2024-01-22T04:47:58.140 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-22T04:47:58.141 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} --verbose --archive /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560 --owner scheduled_vshankar@teuthology --name vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi -- /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560/orig.config.yaml 2024-01-22T04:47:58.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T04:47:58.269 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560 branch: wip-vshankar-testing-pacific-020240119.072505 description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} email: vshankar@redhat.com first_in_suite: false job_id: '7523560' kernel: client: branch: testing flavor: default kdb: true sha1: 06652275eb934672217aaf9d4180f4a90395eb16 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-vshankar-testing-pacific-020240119.072505 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds cache max size: 1000 mds debug frag: true mds debug scatterstat: true mds log max segments: 1 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: 9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-pacific-020240119.072505 sha1: 9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2977 sha1: 9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 sleep_before_teardown: 0 subset: 749/1024 suite: fs suite_branch: wip-vshankar-testing-pacific-020240119.072505 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 targets: smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-19_15:47:44 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-22T04:47:58.269 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/qa; will attempt to use it 2024-01-22T04:47:58.270 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/qa/tasks 2024-01-22T04:47:58.270 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-22T04:47:58.272 INFO:teuthology.task.internal:Checking packages... 2024-01-22T04:47:58.295 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32' 2024-01-22T04:47:58.295 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-22T04:47:58.295 INFO:teuthology.packaging:ref: None 2024-01-22T04:47:58.295 INFO:teuthology.packaging:tag: None 2024-01-22T04:47:58.295 INFO:teuthology.packaging:branch: wip-vshankar-testing-pacific-020240119.072505 2024-01-22T04:47:58.295 INFO:teuthology.packaging:sha1: 9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 2024-01-22T04:47:58.295 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-vshankar-testing-pacific-020240119.072505 2024-01-22T04:47:58.436 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-452-g9854ba8e-1focal 2024-01-22T04:47:58.438 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-22T04:47:58.444 INFO:teuthology.task.internal:no buildpackages task found 2024-01-22T04:47:58.445 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-22T04:47:58.486 INFO:teuthology.task.internal:Saving configuration 2024-01-22T04:47:58.502 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-22T04:47:58.508 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-22T04:47:58.526 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 04:40:54.227718', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-01-22T04:47:58.543 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 04:40:54.226256', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-01-22T04:47:58.543 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-22T04:47:58.549 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-01-22T04:47:58.549 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-01-22T04:47:58.549 INFO:teuthology.run_tasks:Running task console_log... 2024-01-22T04:47:58.610 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5b20290310>, signals=[15]) 2024-01-22T04:47:58.611 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-22T04:47:58.617 INFO:teuthology.task.internal:Opening connections... 2024-01-22T04:47:58.617 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T04:47:58.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:47:58.707 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-01-22T04:47:58.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:47:58.797 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-22T04:47:58.806 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-01-22T04:47:58.813 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-01-22T04:47:58.813 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-01-22T04:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Ubuntu" 2024-01-22T04:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-01-22T04:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout:ID=ubuntu 2024-01-22T04:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE=debian 2024-01-22T04:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-01-22T04:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="20.04" 2024-01-22T04:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-22T04:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-22T04:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-22T04:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-22T04:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_CODENAME=focal 2024-01-22T04:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout:UBUNTU_CODENAME=focal 2024-01-22T04:47:58.864 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-01-22T04:47:58.883 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-01-22T04:47:58.890 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-01-22T04:47:58.890 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-01-22T04:47:58.938 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu" 2024-01-22T04:47:58.938 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-01-22T04:47:58.938 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu 2024-01-22T04:47:58.938 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian 2024-01-22T04:47:58.938 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-01-22T04:47:58.938 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="20.04" 2024-01-22T04:47:58.939 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-22T04:47:58.939 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-22T04:47:58.939 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-22T04:47:58.939 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-22T04:47:58.939 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=focal 2024-01-22T04:47:58.939 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=focal 2024-01-22T04:47:58.939 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-01-22T04:47:58.958 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-22T04:47:58.970 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-22T04:47:58.976 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-22T04:47:58.976 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2024-01-22T04:47:58.978 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-01-22T04:47:58.984 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-22T04:47:58.989 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-22T04:47:58.989 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2024-01-22T04:47:58.991 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-01-22T04:47:59.019 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-22T04:47:59.073 INFO:teuthology.run_tasks:Running task kernel... 2024-01-22T04:47:59.087 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '06652275eb934672217aaf9d4180f4a90395eb16'} 2024-01-22T04:47:59.087 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-01-22T04:47:59.088 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-01-22T04:47:59.088 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-22T04:47:59.088 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-22T04:47:59.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T04:47:59.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2024-01-22T04:47:59.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T04:47:59.098 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2024-01-22T04:47:59.427 DEBUG:teuthology.task.kernel:sha1 for client.1 is 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T04:47:59.427 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "06652275eb934672217aaf9d4180f4a90395eb16"... 2024-01-22T04:47:59.427 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-01-22T04:47:59.434 INFO:teuthology.orchestra.run.smithi110.stdout:5.4.0-124-generic 2024-01-22T04:47:59.434 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T04:47:59.434 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-22T04:47:59.435 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-01-22T04:47:59.435 DEBUG:teuthology.orchestra.run.smithi110:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-22T04:47:59.438 DEBUG:teuthology.task.kernel:sha1 for client.0 is 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T04:47:59.439 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "06652275eb934672217aaf9d4180f4a90395eb16"... 2024-01-22T04:47:59.439 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-01-22T04:47:59.445 INFO:teuthology.orchestra.run.smithi049.stdout:5.4.0-124-generic 2024-01-22T04:47:59.445 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T04:47:59.445 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-22T04:47:59.446 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-01-22T04:47:59.446 DEBUG:teuthology.orchestra.run.smithi049:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-22T04:47:59.497 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2024-01-22T04:47:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2024-01-22T04:47:59.619 INFO:teuthology.orchestra.run.smithi110.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-22T04:47:59.620 DEBUG:teuthology.orchestra.run.smithi110:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-22T04:47:59.625 INFO:teuthology.orchestra.run.smithi049.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-22T04:47:59.627 DEBUG:teuthology.orchestra.run.smithi049:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-22T04:47:59.650 DEBUG:teuthology.orchestra.run.smithi110:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-22T04:47:59.657 DEBUG:teuthology.orchestra.run.smithi049:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-22T04:47:59.664 DEBUG:teuthology.orchestra.run.smithi110:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-22T04:47:59.672 DEBUG:teuthology.orchestra.run.smithi049:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-22T04:49:41.357 INFO:teuthology.orchestra.run.smithi049.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-22T04:49:41.357 INFO:teuthology.orchestra.run.smithi049.stderr: * [new branch] main -> origin/main 2024-01-22T04:49:41.415 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190312 -> 20190312 2024-01-22T04:49:41.415 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190416 -> 20190416 2024-01-22T04:49:41.415 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190514 -> 20190514 2024-01-22T04:49:41.415 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190618 -> 20190618 2024-01-22T04:49:41.415 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190717 -> 20190717 2024-01-22T04:49:41.415 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190815 -> 20190815 2024-01-22T04:49:41.415 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190923 -> 20190923 2024-01-22T04:49:41.415 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20191022 -> 20191022 2024-01-22T04:49:41.415 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20191215 -> 20191215 2024-01-22T04:49:41.415 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200122 -> 20200122 2024-01-22T04:49:41.415 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200316 -> 20200316 2024-01-22T04:49:41.415 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200421 -> 20200421 2024-01-22T04:49:41.416 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200519 -> 20200519 2024-01-22T04:49:41.416 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200619 -> 20200619 2024-01-22T04:49:41.416 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200721 -> 20200721 2024-01-22T04:49:41.416 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200817 -> 20200817 2024-01-22T04:49:41.416 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200918 -> 20200918 2024-01-22T04:49:41.416 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20201022 -> 20201022 2024-01-22T04:49:41.416 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20201118 -> 20201118 2024-01-22T04:49:41.416 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20201218 -> 20201218 2024-01-22T04:49:41.416 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210208 -> 20210208 2024-01-22T04:49:41.416 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210315 -> 20210315 2024-01-22T04:49:41.416 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210511 -> 20210511 2024-01-22T04:49:41.416 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210716 -> 20210716 2024-01-22T04:49:41.416 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210818 -> 20210818 2024-01-22T04:49:41.419 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210919 -> 20210919 2024-01-22T04:49:41.419 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20211027 -> 20211027 2024-01-22T04:49:41.419 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20211216 -> 20211216 2024-01-22T04:49:41.419 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220209 -> 20220209 2024-01-22T04:49:41.419 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220310 -> 20220310 2024-01-22T04:49:41.419 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220411 -> 20220411 2024-01-22T04:49:41.420 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220509 -> 20220509 2024-01-22T04:49:41.420 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220610 -> 20220610 2024-01-22T04:49:41.420 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220708 -> 20220708 2024-01-22T04:49:41.420 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220815 -> 20220815 2024-01-22T04:49:41.420 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220913 -> 20220913 2024-01-22T04:49:41.420 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20221012 -> 20221012 2024-01-22T04:49:41.420 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20221109 -> 20221109 2024-01-22T04:49:41.420 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20221214 -> 20221214 2024-01-22T04:49:41.420 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230117 -> 20230117 2024-01-22T04:49:41.420 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230210 -> 20230210 2024-01-22T04:49:41.420 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230310 -> 20230310 2024-01-22T04:49:41.420 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230404 -> 20230404 2024-01-22T04:49:41.420 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230515 -> 20230515 2024-01-22T04:49:41.420 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230625 -> 20230625 2024-01-22T04:49:41.420 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230804 -> 20230804 2024-01-22T04:49:41.421 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230919 -> 20230919 2024-01-22T04:49:41.421 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20231030 -> 20231030 2024-01-22T04:49:41.421 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20231111 -> 20231111 2024-01-22T04:49:41.421 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20231211 -> 20231211 2024-01-22T04:49:41.421 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20240115 -> 20240115 2024-01-22T04:49:43.571 INFO:teuthology.orchestra.run.smithi110.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-22T04:49:43.572 INFO:teuthology.orchestra.run.smithi110.stderr: * [new branch] main -> origin/main 2024-01-22T04:49:43.633 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190312 -> 20190312 2024-01-22T04:49:43.633 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190416 -> 20190416 2024-01-22T04:49:43.633 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190514 -> 20190514 2024-01-22T04:49:43.633 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190618 -> 20190618 2024-01-22T04:49:43.633 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190717 -> 20190717 2024-01-22T04:49:43.634 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190815 -> 20190815 2024-01-22T04:49:43.634 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190923 -> 20190923 2024-01-22T04:49:43.634 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20191022 -> 20191022 2024-01-22T04:49:43.634 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20191215 -> 20191215 2024-01-22T04:49:43.634 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200122 -> 20200122 2024-01-22T04:49:43.634 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200316 -> 20200316 2024-01-22T04:49:43.634 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200421 -> 20200421 2024-01-22T04:49:43.634 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200519 -> 20200519 2024-01-22T04:49:43.634 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200619 -> 20200619 2024-01-22T04:49:43.634 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200721 -> 20200721 2024-01-22T04:49:43.634 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200817 -> 20200817 2024-01-22T04:49:43.634 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200918 -> 20200918 2024-01-22T04:49:43.634 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20201022 -> 20201022 2024-01-22T04:49:43.635 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20201118 -> 20201118 2024-01-22T04:49:43.636 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20201218 -> 20201218 2024-01-22T04:49:43.636 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210208 -> 20210208 2024-01-22T04:49:43.636 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210315 -> 20210315 2024-01-22T04:49:43.636 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210511 -> 20210511 2024-01-22T04:49:43.636 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210716 -> 20210716 2024-01-22T04:49:43.636 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210818 -> 20210818 2024-01-22T04:49:43.636 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210919 -> 20210919 2024-01-22T04:49:43.636 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20211027 -> 20211027 2024-01-22T04:49:43.636 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20211216 -> 20211216 2024-01-22T04:49:43.638 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220209 -> 20220209 2024-01-22T04:49:43.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220310 -> 20220310 2024-01-22T04:49:43.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220411 -> 20220411 2024-01-22T04:49:43.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220509 -> 20220509 2024-01-22T04:49:43.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220610 -> 20220610 2024-01-22T04:49:43.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220708 -> 20220708 2024-01-22T04:49:43.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220815 -> 20220815 2024-01-22T04:49:43.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220913 -> 20220913 2024-01-22T04:49:43.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20221012 -> 20221012 2024-01-22T04:49:43.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20221109 -> 20221109 2024-01-22T04:49:43.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20221214 -> 20221214 2024-01-22T04:49:43.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230117 -> 20230117 2024-01-22T04:49:43.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230210 -> 20230210 2024-01-22T04:49:43.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230310 -> 20230310 2024-01-22T04:49:43.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230404 -> 20230404 2024-01-22T04:49:43.640 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230515 -> 20230515 2024-01-22T04:49:43.640 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230625 -> 20230625 2024-01-22T04:49:43.640 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230804 -> 20230804 2024-01-22T04:49:43.640 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230919 -> 20230919 2024-01-22T04:49:43.640 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20231030 -> 20231030 2024-01-22T04:49:43.640 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20231111 -> 20231111 2024-01-22T04:49:43.640 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20231211 -> 20231211 2024-01-22T04:49:43.640 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20240115 -> 20240115 2024-01-22T04:49:45.675 INFO:teuthology.orchestra.run.smithi049.stderr:Updating files: 48% (1674/3421) Updating files: 49% (1677/3421) Updating files: 50% (1711/3421) Updating files: 51% (1745/3421) Updating files: 52% (1779/3421) Updating files: 53% (1814/3421) Updating files: 54% (1848/3421) Updating files: 55% (1882/3421) Updating files: 56% (1916/3421) Updating files: 57% (1950/3421) Updating files: 58% (1985/3421) Updating files: 59% (2019/3421) Updating files: 60% (2053/3421) Updating files: 61% (2087/3421) Updating files: 62% (2122/3421) Updating files: 63% (2156/3421) Updating files: 63% (2177/3421) Updating files: 64% (2190/3421) Updating files: 65% (2224/3421) Updating files: 66% (2258/3421) Updating files: 67% (2293/3421) Updating files: 68% (2327/3421) Updating files: 69% (2361/3421) Updating files: 70% (2395/3421) Updating files: 71% (2429/3421) Updating files: 72% (2464/3421) Updating files: 73% (2498/3421) Updating files: 74% (2532/3421) Updating files: 75% (2566/3421) Updating files: 76% (2600/3421) Updating files: 76% (2614/3421) Updating files: 77% (2635/3421) Updating files: 78% (2669/3421) Updating files: 79% (2703/3421) Updating files: 80% (2737/3421) Updating files: 81% (2772/3421) Updating files: 82% (2806/3421) Updating files: 83% (2840/3421) Updating files: 83% (2862/3421) Updating files: 84% (2874/3421) Updating files: 85% (2908/3421) Updating files: 86% (2943/3421) Updating files: 87% (2977/3421) Updating files: 88% (3011/3421) Updating files: 89% (3045/3421) Updating files: 90% (3079/3421) Updating files: 91% (3114/3421) Updating files: 92% (3148/3421) Updating files: 93% (3182/3421) Updating files: 94% (3216/3421) Updating files: 95% (3250/3421) Updating files: 96% (3285/3421) Updating files: 97% (3319/3421) Updating files: 98% (3353/3421) Updating files: 99% (3387/3421) Updating files: 100% (3421/3421) Updating files: 100% (3421/3421), done. 2024-01-22T04:49:45.678 INFO:teuthology.orchestra.run.smithi049.stdout:HEAD is now at bf0987d3 Merge branch 'robot/patch-0-1705440424' into 'main' 2024-01-22T04:49:45.696 INFO:teuthology.task.kernel:Downloading kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.0... 2024-01-22T04:49:45.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T04:49:45.915 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/ubuntu/focal/flavors/default/pool/main/l/linux-6.7.0-g06652275eb93/ 2024-01-22T04:49:45.915 DEBUG:teuthology.orchestra.run.smithi049:> rm -f /tmp/linux-image.deb && echo linux-image-6.7.0-g06652275eb93_6.7.0-g06652275eb93-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/ubuntu/focal/flavors/default/pool/main/l/linux-6.7.0-g06652275eb93/ --input-file=- 2024-01-22T04:49:45.918 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi049.front.sepia.ceph.com to complete... 2024-01-22T04:49:47.673 INFO:teuthology.orchestra.run.smithi110.stderr:Updating files: 50% (1724/3421) Updating files: 51% (1745/3421) Updating files: 52% (1779/3421) Updating files: 53% (1814/3421) Updating files: 54% (1848/3421) Updating files: 55% (1882/3421) Updating files: 56% (1916/3421) Updating files: 57% (1950/3421) Updating files: 58% (1985/3421) Updating files: 59% (2019/3421) Updating files: 60% (2053/3421) Updating files: 61% (2087/3421) Updating files: 62% (2122/3421) Updating files: 63% (2156/3421) Updating files: 64% (2190/3421) Updating files: 64% (2221/3421) Updating files: 65% (2224/3421) Updating files: 66% (2258/3421) Updating files: 67% (2293/3421) Updating files: 68% (2327/3421) Updating files: 69% (2361/3421) Updating files: 70% (2395/3421) Updating files: 71% (2429/3421) Updating files: 72% (2464/3421) Updating files: 73% (2498/3421) Updating files: 74% (2532/3421) Updating files: 75% (2566/3421) Updating files: 76% (2600/3421) Updating files: 77% (2635/3421) Updating files: 78% (2669/3421) Updating files: 79% (2703/3421) Updating files: 80% (2737/3421) Updating files: 81% (2772/3421) Updating files: 81% (2783/3421) Updating files: 82% (2806/3421) Updating files: 83% (2840/3421) Updating files: 84% (2874/3421) Updating files: 85% (2908/3421) Updating files: 86% (2943/3421) Updating files: 87% (2977/3421) Updating files: 88% (3011/3421) Updating files: 89% (3045/3421) Updating files: 90% (3079/3421) Updating files: 91% (3114/3421) Updating files: 92% (3148/3421) Updating files: 93% (3182/3421) Updating files: 94% (3216/3421) Updating files: 95% (3250/3421) Updating files: 96% (3285/3421) Updating files: 97% (3319/3421) Updating files: 98% (3353/3421) Updating files: 98% (3363/3421) Updating files: 99% (3387/3421) Updating files: 100% (3421/3421) Updating files: 100% (3421/3421), done. 2024-01-22T04:49:47.678 INFO:teuthology.orchestra.run.smithi110.stdout:HEAD is now at bf0987d3 Merge branch 'robot/patch-0-1705440424' into 'main' 2024-01-22T04:49:47.695 INFO:teuthology.task.kernel:Downloading kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.1... 2024-01-22T04:49:47.696 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T04:49:47.836 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/ubuntu/focal/flavors/default/pool/main/l/linux-6.7.0-g06652275eb93/ 2024-01-22T04:49:47.836 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /tmp/linux-image.deb && echo linux-image-6.7.0-g06652275eb93_6.7.0-g06652275eb93-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/ubuntu/focal/flavors/default/pool/main/l/linux-6.7.0-g06652275eb93/ --input-file=- 2024-01-22T04:49:47.838 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi110.front.sepia.ceph.com to complete... 2024-01-22T04:49:48.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22 04:49:48 URL:https://2.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/ubuntu/focal/flavors/default/pool/main/l/linux-6.7.0-g06652275eb93/linux-image-6.7.0-g06652275eb93_6.7.0-g06652275eb93-1_amd64.deb [39111794/39111794] -> "/tmp/linux-image.deb" [1] 2024-01-22T04:49:48.188 INFO:teuthology.orchestra.run.smithi049.stderr:FINISHED --2024-01-22 04:49:48-- 2024-01-22T04:49:48.188 INFO:teuthology.orchestra.run.smithi049.stderr:Total wall clock time: 2.2s 2024-01-22T04:49:48.188 INFO:teuthology.orchestra.run.smithi049.stderr:Downloaded: 1 files, 37M in 2.0s (18.3 MB/s) 2024-01-22T04:49:48.191 INFO:teuthology.task.kernel:Installing kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.0... 2024-01-22T04:49:48.191 DEBUG:teuthology.orchestra.run.smithi049:> sudo dpkg -i /tmp/linux-image.deb 2024-01-22T04:49:48.486 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-image-6.7.0-g06652275eb93. 2024-01-22T04:49:49.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22 04:49:49 URL:https://2.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/ubuntu/focal/flavors/default/pool/main/l/linux-6.7.0-g06652275eb93/linux-image-6.7.0-g06652275eb93_6.7.0-g06652275eb93-1_amd64.deb [39111794/39111794] -> "/tmp/linux-image.deb" [1] 2024-01-22T04:49:49.810 INFO:teuthology.orchestra.run.smithi110.stderr:FINISHED --2024-01-22 04:49:49-- 2024-01-22T04:49:49.810 INFO:teuthology.orchestra.run.smithi110.stderr:Total wall clock time: 1.9s 2024-01-22T04:49:49.810 INFO:teuthology.orchestra.run.smithi110.stderr:Downloaded: 1 files, 37M in 1.7s (22.3 MB/s) 2024-01-22T04:49:49.813 INFO:teuthology.task.kernel:Installing kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.1... 2024-01-22T04:49:49.813 DEBUG:teuthology.orchestra.run.smithi110:> sudo dpkg -i /tmp/linux-image.deb 2024-01-22T04:49:50.061 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-image-6.7.0-g06652275eb93. 2024-01-22T04:49:50.203 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... 104373 files and directories currently installed.) 2024-01-22T04:49:50.207 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-22T04:49:50.372 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-image-6.7.0-g06652275eb93 (6.7.0-g06652275eb93-1) ... 2024-01-22T04:49:51.845 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... 104373 files and directories currently installed.) 2024-01-22T04:49:51.850 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-22T04:49:52.019 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-image-6.7.0-g06652275eb93 (6.7.0-g06652275eb93-1) ... 2024-01-22T04:49:53.228 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-image-6.7.0-g06652275eb93 (6.7.0-g06652275eb93-1) ... 2024-01-22T04:49:53.369 INFO:teuthology.orchestra.run.smithi049.stderr:update-initramfs: Generating /boot/initrd.img-6.7.0-g06652275eb93 2024-01-22T04:49:55.069 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-image-6.7.0-g06652275eb93 (6.7.0-g06652275eb93-1) ... 2024-01-22T04:49:55.226 INFO:teuthology.orchestra.run.smithi110.stderr:update-initramfs: Generating /boot/initrd.img-6.7.0-g06652275eb93 2024-01-22T04:50:19.825 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub' 2024-01-22T04:50:19.851 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-22T04:50:19.882 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2024-01-22T04:50:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-6.7.0-g06652275eb93 2024-01-22T04:50:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-6.7.0-g06652275eb93 2024-01-22T04:50:20.667 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-01-22T04:50:20.680 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-01-22T04:50:21.832 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub' 2024-01-22T04:50:21.849 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-22T04:50:21.913 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-01-22T04:50:22.286 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-6.7.0-g06652275eb93 2024-01-22T04:50:22.316 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-6.7.0-g06652275eb93 2024-01-22T04:50:22.684 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-01-22T04:50:22.697 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-01-22T04:50:23.067 INFO:teuthology.orchestra.run.smithi049.stderr:done 2024-01-22T04:50:23.379 DEBUG:teuthology.orchestra.run.smithi049:> dpkg-deb -c /tmp/linux-image.deb 2024-01-22T04:50:23.389 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./ 2024-01-22T04:50:23.389 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./boot/ 2024-01-22T04:50:23.389 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 4444641 2024-01-18 11:42 ./boot/System.map-6.7.0-g06652275eb93 2024-01-22T04:50:23.403 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 170149 2024-01-18 11:42 ./boot/config-6.7.0-g06652275eb93 2024-01-22T04:50:23.404 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11441152 2024-01-18 11:42 ./boot/vmlinuz-6.7.0-g06652275eb93 2024-01-22T04:50:23.426 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/ 2024-01-22T04:50:23.426 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/ 2024-01-22T04:50:23.426 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/postinst.d/ 2024-01-22T04:50:23.426 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/postrm.d/ 2024-01-22T04:50:23.426 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/preinst.d/ 2024-01-22T04:50:23.426 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/prerm.d/ 2024-01-22T04:50:23.427 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/ 2024-01-22T04:50:23.427 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/ 2024-01-22T04:50:23.427 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/ 2024-01-22T04:50:23.427 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/ 2024-01-22T04:50:23.427 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/ 2024-01-22T04:50:23.427 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/ 2024-01-22T04:50:23.427 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/ 2024-01-22T04:50:23.427 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 490345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-22T04:50:23.430 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-22T04:50:23.430 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-22T04:50:23.430 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-22T04:50:23.430 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 93113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-22T04:50:23.430 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 106729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-22T04:50:23.430 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 152241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-22T04:50:23.430 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-22T04:50:23.430 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-22T04:50:23.430 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 83889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-22T04:50:23.430 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-22T04:50:23.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-22T04:50:23.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-22T04:50:23.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-22T04:50:23.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-22T04:50:23.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-22T04:50:23.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-22T04:50:23.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-22T04:50:23.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-22T04:50:23.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-22T04:50:23.431 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/ 2024-01-22T04:50:23.431 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/ 2024-01-22T04:50:23.431 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce/ 2024-01-22T04:50:23.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-22T04:50:23.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpuid.ko 2024-01-22T04:50:23.431 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/msr.ko 2024-01-22T04:50:23.432 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/ 2024-01-22T04:50:23.432 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 353705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-22T04:50:23.432 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 881649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-22T04:50:23.432 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 2276625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm.ko 2024-01-22T04:50:23.504 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/ 2024-01-22T04:50:23.504 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/af_alg.ko 2024-01-22T04:50:23.504 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/algif_hash.ko 2024-01-22T04:50:23.504 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/algif_skcipher.ko 2024-01-22T04:50:23.504 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/ansi_cprng.ko 2024-01-22T04:50:23.504 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/anubis.ko 2024-01-22T04:50:23.504 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/arc4.ko 2024-01-22T04:50:23.504 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/asymmetric_keys/ 2024-01-22T04:50:23.504 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-22T04:50:23.504 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/ 2024-01-22T04:50:23.505 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_memcpy.ko 2024-01-22T04:50:23.505 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_pq.ko 2024-01-22T04:50:23.505 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-22T04:50:23.505 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_tx.ko 2024-01-22T04:50:23.505 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_xor.ko 2024-01-22T04:50:23.505 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/raid6test.ko 2024-01-22T04:50:23.505 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/authenc.ko 2024-01-22T04:50:23.505 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/authencesn.ko 2024-01-22T04:50:23.505 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/blake2b_generic.ko 2024-01-22T04:50:23.505 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_common.ko 2024-01-22T04:50:23.505 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_generic.ko 2024-01-22T04:50:23.505 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/camellia_generic.ko 2024-01-22T04:50:23.505 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast5_generic.ko 2024-01-22T04:50:23.505 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast6_generic.ko 2024-01-22T04:50:23.506 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast_common.ko 2024-01-22T04:50:23.506 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/ccm.ko 2024-01-22T04:50:23.506 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cmac.ko 2024-01-22T04:50:23.506 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crc32_generic.ko 2024-01-22T04:50:23.506 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cryptd.ko 2024-01-22T04:50:23.506 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_engine.ko 2024-01-22T04:50:23.506 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_simd.ko 2024-01-22T04:50:23.506 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_user.ko 2024-01-22T04:50:23.506 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cts.ko 2024-01-22T04:50:23.506 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/des_generic.ko 2024-01-22T04:50:23.506 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/dh_generic.ko 2024-01-22T04:50:23.506 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/echainiv.ko 2024-01-22T04:50:23.506 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/essiv.ko 2024-01-22T04:50:23.506 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/fcrypt.ko 2024-01-22T04:50:23.506 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/khazad.ko 2024-01-22T04:50:23.507 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/lrw.ko 2024-01-22T04:50:23.507 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4.ko 2024-01-22T04:50:23.507 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4hc.ko 2024-01-22T04:50:23.507 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/md4.ko 2024-01-22T04:50:23.507 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/michael_mic.ko 2024-01-22T04:50:23.507 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcbc.ko 2024-01-22T04:50:23.507 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcrypt.ko 2024-01-22T04:50:23.507 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/rmd160.ko 2024-01-22T04:50:23.507 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/seed.ko 2024-01-22T04:50:23.507 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/serpent_generic.ko 2024-01-22T04:50:23.507 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 149481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/tcrypt.ko 2024-01-22T04:50:23.507 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/tea.ko 2024-01-22T04:50:23.507 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_common.ko 2024-01-22T04:50:23.508 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_generic.ko 2024-01-22T04:50:23.508 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/vmac.ko 2024-01-22T04:50:23.508 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/wp512.ko 2024-01-22T04:50:23.508 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xcbc.ko 2024-01-22T04:50:23.508 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xor.ko 2024-01-22T04:50:23.508 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xts.ko 2024-01-22T04:50:23.508 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xxhash_generic.ko 2024-01-22T04:50:23.509 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ 2024-01-22T04:50:23.509 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/ 2024-01-22T04:50:23.509 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_extlog.ko 2024-01-22T04:50:23.509 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-22T04:50:23.509 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_pad.ko 2024-01-22T04:50:23.509 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/apei/ 2024-01-22T04:50:23.509 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/apei/einj.ko 2024-01-22T04:50:23.509 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/ec_sys.ko 2024-01-22T04:50:23.509 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/platform_profile.ko 2024-01-22T04:50:23.509 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbs.ko 2024-01-22T04:50:23.509 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbshc.ko 2024-01-22T04:50:23.509 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 104729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/video.ko 2024-01-22T04:50:23.509 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ 2024-01-22T04:50:23.509 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/acard-ahci.ko 2024-01-22T04:50:23.509 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ahci.ko 2024-01-22T04:50:23.510 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ahci_platform.ko 2024-01-22T04:50:23.510 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 88401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/libahci.ko 2024-01-22T04:50:23.510 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/libahci_platform.ko 2024-01-22T04:50:23.510 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_acpi.ko 2024-01-22T04:50:23.510 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ali.ko 2024-01-22T04:50:23.510 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_amd.ko 2024-01-22T04:50:23.510 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_artop.ko 2024-01-22T04:50:23.510 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atiixp.ko 2024-01-22T04:50:23.510 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atp867x.ko 2024-01-22T04:50:23.510 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd640.ko 2024-01-22T04:50:23.510 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd64x.ko 2024-01-22T04:50:23.510 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cypress.ko 2024-01-22T04:50:23.510 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_efar.ko 2024-01-22T04:50:23.510 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt366.ko 2024-01-22T04:50:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt37x.ko 2024-01-22T04:50:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-22T04:50:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-22T04:50:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it8213.ko 2024-01-22T04:50:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it821x.ko 2024-01-22T04:50:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_jmicron.ko 2024-01-22T04:50:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_legacy.ko 2024-01-22T04:50:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_marvell.ko 2024-01-22T04:50:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_mpiix.ko 2024-01-22T04:50:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_netcell.ko 2024-01-22T04:50:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ninja32.ko 2024-01-22T04:50:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87410.ko 2024-01-22T04:50:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87415.ko 2024-01-22T04:50:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_oldpiix.ko 2024-01-22T04:50:23.511 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_opti.ko 2024-01-22T04:50:23.512 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_optidma.ko 2024-01-22T04:50:23.512 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pcmcia.ko 2024-01-22T04:50:23.512 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-22T04:50:23.512 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-22T04:50:23.512 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_piccolo.ko 2024-01-22T04:50:23.512 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_radisys.ko 2024-01-22T04:50:23.512 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_rdc.ko 2024-01-22T04:50:23.512 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_rz1000.ko 2024-01-22T04:50:23.512 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sch.ko 2024-01-22T04:50:23.512 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_serverworks.ko 2024-01-22T04:50:23.512 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sil680.ko 2024-01-22T04:50:23.512 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sl82c105.ko 2024-01-22T04:50:23.512 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_triflex.ko 2024-01-22T04:50:23.512 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_via.ko 2024-01-22T04:50:23.513 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pdc_adma.ko 2024-01-22T04:50:23.513 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_inic162x.ko 2024-01-22T04:50:23.513 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 83345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_mv.ko 2024-01-22T04:50:23.513 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_nv.ko 2024-01-22T04:50:23.513 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_promise.ko 2024-01-22T04:50:23.513 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_qstor.ko 2024-01-22T04:50:23.513 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil.ko 2024-01-22T04:50:23.513 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil24.ko 2024-01-22T04:50:23.513 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sis.ko 2024-01-22T04:50:23.513 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_svw.ko 2024-01-22T04:50:23.513 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sx4.ko 2024-01-22T04:50:23.513 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_uli.ko 2024-01-22T04:50:23.513 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_via.ko 2024-01-22T04:50:23.513 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_vsc.ko 2024-01-22T04:50:23.514 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay/ 2024-01-22T04:50:23.514 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay/ks0108.ko 2024-01-22T04:50:23.514 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma/ 2024-01-22T04:50:23.514 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 124473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma/bcma.ko 2024-01-22T04:50:23.514 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/ 2024-01-22T04:50:23.514 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe/ 2024-01-22T04:50:23.514 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 113753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe/aoe.ko 2024-01-22T04:50:23.514 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd/ 2024-01-22T04:50:23.514 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 965305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd/drbd.ko 2024-01-22T04:50:23.514 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 173353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/floppy.ko 2024-01-22T04:50:23.514 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx/ 2024-01-22T04:50:23.514 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 94297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-22T04:50:23.514 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 116321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/nbd.ko 2024-01-22T04:50:23.514 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk/ 2024-01-22T04:50:23.514 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 110737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk/null_blk.ko 2024-01-22T04:50:23.515 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 98281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/pktcdvd.ko 2024-01-22T04:50:23.515 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 263769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/rbd.ko 2024-01-22T04:50:23.515 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback/ 2024-01-22T04:50:23.515 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 98185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-22T04:50:23.515 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram/ 2024-01-22T04:50:23.515 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram/zram.ko 2024-01-22T04:50:23.515 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ 2024-01-22T04:50:23.515 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/applicom.ko 2024-01-22T04:50:23.515 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hangcheck-timer.ko 2024-01-22T04:50:23.515 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/ 2024-01-22T04:50:23.515 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-22T04:50:23.515 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-22T04:50:23.515 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-22T04:50:23.515 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/via-rng.ko 2024-01-22T04:50:23.515 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-22T04:50:23.516 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ 2024-01-22T04:50:23.516 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-22T04:50:23.516 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 148609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-22T04:50:23.516 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-22T04:50:23.516 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 139313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-22T04:50:23.516 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-22T04:50:23.516 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-22T04:50:23.516 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/lp.ko 2024-01-22T04:50:23.516 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave/ 2024-01-22T04:50:23.516 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 84097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave/mwave.ko 2024-01-22T04:50:23.516 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/nvram.ko 2024-01-22T04:50:23.517 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ppdev.ko 2024-01-22T04:50:23.517 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tlclk.ko 2024-01-22T04:50:23.517 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/ 2024-01-22T04:50:23.517 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-22T04:50:23.517 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-22T04:50:23.517 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-22T04:50:23.517 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-22T04:50:23.517 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-22T04:50:23.517 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-22T04:50:23.517 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-22T04:50:23.517 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/ 2024-01-22T04:50:23.517 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-22T04:50:23.517 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-22T04:50:23.517 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-22T04:50:23.517 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/ 2024-01-22T04:50:23.518 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-palmas.ko 2024-01-22T04:50:23.518 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-si5351.ko 2024-01-22T04:50:23.518 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-twl6040.ko 2024-01-22T04:50:23.518 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-wm831x.ko 2024-01-22T04:50:23.518 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/ 2024-01-22T04:50:23.518 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-22T04:50:23.518 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-22T04:50:23.518 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-22T04:50:23.518 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ 2024-01-22T04:50:23.518 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ 2024-01-22T04:50:23.518 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-22T04:50:23.518 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 246841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp.ko 2024-01-22T04:50:23.519 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/ 2024-01-22T04:50:23.519 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/ 2024-01-22T04:50:23.519 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-22T04:50:23.519 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 517033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-22T04:50:23.519 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-22T04:50:23.519 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-22T04:50:23.519 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-aes.ko 2024-01-22T04:50:23.519 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-sha.ko 2024-01-22T04:50:23.519 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio/ 2024-01-22T04:50:23.519 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-22T04:50:23.520 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca/ 2024-01-22T04:50:23.520 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca/dca.ko 2024-01-22T04:50:23.520 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ 2024-01-22T04:50:23.520 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw/ 2024-01-22T04:50:23.520 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-22T04:50:23.520 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat/ 2024-01-22T04:50:23.520 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 122569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-22T04:50:23.520 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/ 2024-01-22T04:50:23.520 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 79953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/amd64_edac.ko 2024-01-22T04:50:23.520 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/e752x_edac.ko 2024-01-22T04:50:23.520 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 63617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/edac_mce_amd.ko 2024-01-22T04:50:23.520 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3000_edac.ko 2024-01-22T04:50:23.520 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3200_edac.ko 2024-01-22T04:50:23.521 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5100_edac.ko 2024-01-22T04:50:23.521 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5400_edac.ko 2024-01-22T04:50:23.521 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7300_edac.ko 2024-01-22T04:50:23.521 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7core_edac.ko 2024-01-22T04:50:23.521 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i82975x_edac.ko 2024-01-22T04:50:23.521 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/ie31200_edac.ko 2024-01-22T04:50:23.521 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/sb_edac.ko 2024-01-22T04:50:23.521 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/x38_edac.ko 2024-01-22T04:50:23.521 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/ 2024-01-22T04:50:23.521 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-gpio.ko 2024-01-22T04:50:23.521 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-max14577.ko 2024-01-22T04:50:23.521 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-max77693.ko 2024-01-22T04:50:23.521 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-max8997.ko 2024-01-22T04:50:23.522 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-palmas.ko 2024-01-22T04:50:23.522 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-22T04:50:23.522 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-22T04:50:23.522 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/ 2024-01-22T04:50:23.522 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-22T04:50:23.522 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/efi/ 2024-01-22T04:50:23.522 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-22T04:50:23.522 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-22T04:50:23.522 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/ 2024-01-22T04:50:23.522 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-22T04:50:23.522 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-22T04:50:23.522 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-arizona.ko 2024-01-22T04:50:23.522 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-da9052.ko 2024-01-22T04:50:23.522 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-da9055.ko 2024-01-22T04:50:23.522 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-dln2.ko 2024-01-22T04:50:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 77849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-22T04:50:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-generic.ko 2024-01-22T04:50:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-ich.ko 2024-01-22T04:50:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-22T04:50:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-kempld.ko 2024-01-22T04:50:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-22T04:50:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-max7300.ko 2024-01-22T04:50:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-max730x.ko 2024-01-22T04:50:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-max732x.ko 2024-01-22T04:50:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-22T04:50:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-22T04:50:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-22T04:50:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-22T04:50:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-sch.ko 2024-01-22T04:50:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-22T04:50:23.524 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-22T04:50:23.524 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-22T04:50:23.524 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-22T04:50:23.524 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-22T04:50:23.524 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-vx855.ko 2024-01-22T04:50:23.524 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-22T04:50:23.524 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-22T04:50:23.524 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-22T04:50:23.524 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/ 2024-01-22T04:50:23.524 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-a4tech.ko 2024-01-22T04:50:23.524 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-apple.ko 2024-01-22T04:50:23.524 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-appleir.ko 2024-01-22T04:50:23.524 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-aureal.ko 2024-01-22T04:50:23.525 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-axff.ko 2024-01-22T04:50:23.525 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-belkin.ko 2024-01-22T04:50:23.525 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-cherry.ko 2024-01-22T04:50:23.525 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-chicony.ko 2024-01-22T04:50:23.525 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-cp2112.ko 2024-01-22T04:50:23.525 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-cypress.ko 2024-01-22T04:50:23.525 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-dr.ko 2024-01-22T04:50:23.525 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elecom.ko 2024-01-22T04:50:23.525 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elo.ko 2024-01-22T04:50:23.525 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-emsff.ko 2024-01-22T04:50:23.525 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ezkey.ko 2024-01-22T04:50:23.525 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gaff.ko 2024-01-22T04:50:23.525 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-generic.ko 2024-01-22T04:50:23.525 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gt683r.ko 2024-01-22T04:50:23.526 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gyration.ko 2024-01-22T04:50:23.526 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-22T04:50:23.526 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-22T04:50:23.526 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtekff.ko 2024-01-22T04:50:23.526 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-hyperv.ko 2024-01-22T04:50:23.526 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-icade.ko 2024-01-22T04:50:23.526 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-kensington.ko 2024-01-22T04:50:23.526 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-keytouch.ko 2024-01-22T04:50:23.526 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-kye.ko 2024-01-22T04:50:23.526 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lcpower.ko 2024-01-22T04:50:23.526 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-led.ko 2024-01-22T04:50:23.526 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lenovo.ko 2024-01-22T04:50:23.526 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lg-g15.ko 2024-01-22T04:50:23.526 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-22T04:50:23.526 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-22T04:50:23.527 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech.ko 2024-01-22T04:50:23.527 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-magicmouse.ko 2024-01-22T04:50:23.527 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-microsoft.ko 2024-01-22T04:50:23.527 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-monterey.ko 2024-01-22T04:50:23.527 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-multitouch.ko 2024-01-22T04:50:23.527 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ntrig.ko 2024-01-22T04:50:23.527 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ortek.ko 2024-01-22T04:50:23.527 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-penmount.ko 2024-01-22T04:50:23.527 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-petalynx.ko 2024-01-22T04:50:23.527 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-picolcd.ko 2024-01-22T04:50:23.527 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-pl.ko 2024-01-22T04:50:23.527 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-plantronics.ko 2024-01-22T04:50:23.527 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-primax.ko 2024-01-22T04:50:23.527 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-rmi.ko 2024-01-22T04:50:23.528 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-22T04:50:23.528 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-common.ko 2024-01-22T04:50:23.528 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-22T04:50:23.528 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-22T04:50:23.528 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-22T04:50:23.528 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-22T04:50:23.528 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-22T04:50:23.528 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-22T04:50:23.528 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-22T04:50:23.528 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-22T04:50:23.528 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-22T04:50:23.528 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat.ko 2024-01-22T04:50:23.528 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-saitek.ko 2024-01-22T04:50:23.529 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-samsung.ko 2024-01-22T04:50:23.529 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-22T04:50:23.529 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sjoy.ko 2024-01-22T04:50:23.529 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sony.ko 2024-01-22T04:50:23.529 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-speedlink.ko 2024-01-22T04:50:23.529 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-steelseries.ko 2024-01-22T04:50:23.529 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sunplus.ko 2024-01-22T04:50:23.529 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-22T04:50:23.529 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tivo.ko 2024-01-22T04:50:23.529 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tmff.ko 2024-01-22T04:50:23.530 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-topseed.ko 2024-01-22T04:50:23.530 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-twinhan.ko 2024-01-22T04:50:23.530 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-uclogic.ko 2024-01-22T04:50:23.530 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-waltop.ko 2024-01-22T04:50:23.530 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 143473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-wiimote.ko 2024-01-22T04:50:23.530 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-xinmo.ko 2024-01-22T04:50:23.530 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zpff.ko 2024-01-22T04:50:23.530 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zydacron.ko 2024-01-22T04:50:23.531 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 269281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid.ko 2024-01-22T04:50:23.531 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/uhid.ko 2024-01-22T04:50:23.531 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/ 2024-01-22T04:50:23.531 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 125785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-22T04:50:23.531 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-22T04:50:23.531 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-22T04:50:23.531 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 217873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/wacom.ko 2024-01-22T04:50:23.531 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/ 2024-01-22T04:50:23.531 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 64201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_balloon.ko 2024-01-22T04:50:23.531 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_utils.ko 2024-01-22T04:50:23.531 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 305321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_vmbus.ko 2024-01-22T04:50:23.531 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ 2024-01-22T04:50:23.532 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru.ko 2024-01-22T04:50:23.532 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru3.ko 2024-01-22T04:50:23.532 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-22T04:50:23.532 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7414.ko 2024-01-22T04:50:23.532 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7418.ko 2024-01-22T04:50:23.532 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adc128d818.ko 2024-01-22T04:50:23.532 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1025.ko 2024-01-22T04:50:23.532 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 97977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1026.ko 2024-01-22T04:50:23.532 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1029.ko 2024-01-22T04:50:23.532 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1031.ko 2024-01-22T04:50:23.532 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm9240.ko 2024-01-22T04:50:23.532 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ads7828.ko 2024-01-22T04:50:23.532 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7410.ko 2024-01-22T04:50:23.533 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7411.ko 2024-01-22T04:50:23.533 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 74409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7462.ko 2024-01-22T04:50:23.533 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7470.ko 2024-01-22T04:50:23.533 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7475.ko 2024-01-22T04:50:23.533 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7x10.ko 2024-01-22T04:50:23.533 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/amc6821.ko 2024-01-22T04:50:23.533 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/applesmc.ko 2024-01-22T04:50:23.533 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asb100.ko 2024-01-22T04:50:23.533 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asc7621.ko 2024-01-22T04:50:23.533 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-22T04:50:23.533 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/atxp1.ko 2024-01-22T04:50:23.533 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/coretemp.ko 2024-01-22T04:50:23.533 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-22T04:50:23.533 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-22T04:50:23.534 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-22T04:50:23.534 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 99601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dme1737.ko 2024-01-22T04:50:23.534 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds1621.ko 2024-01-22T04:50:23.534 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds620.ko 2024-01-22T04:50:23.534 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc1403.ko 2024-01-22T04:50:23.534 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc2103.ko 2024-01-22T04:50:23.534 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc6w201.ko 2024-01-22T04:50:23.534 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71805f.ko 2024-01-22T04:50:23.534 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 94689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71882fg.ko 2024-01-22T04:50:23.534 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f75375s.ko 2024-01-22T04:50:23.534 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fam15h_power.ko 2024-01-22T04:50:23.534 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fschmd.ko 2024-01-22T04:50:23.534 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g760a.ko 2024-01-22T04:50:23.534 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g762.ko 2024-01-22T04:50:23.535 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl518sm.ko 2024-01-22T04:50:23.535 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl520sm.ko 2024-01-22T04:50:23.535 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/hih6130.ko 2024-01-22T04:50:23.535 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-22T04:50:23.535 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5500_temp.ko 2024-01-22T04:50:23.535 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5k_amb.ko 2024-01-22T04:50:23.535 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmaem.ko 2024-01-22T04:50:23.535 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmpex.ko 2024-01-22T04:50:23.535 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina209.ko 2024-01-22T04:50:23.535 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina2xx.ko 2024-01-22T04:50:23.535 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 130449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/it87.ko 2024-01-22T04:50:23.536 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/jc42.ko 2024-01-22T04:50:23.536 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k10temp.ko 2024-01-22T04:50:23.536 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k8temp.ko 2024-01-22T04:50:23.536 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lineage-pem.ko 2024-01-22T04:50:23.536 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm63.ko 2024-01-22T04:50:23.536 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm73.ko 2024-01-22T04:50:23.536 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm75.ko 2024-01-22T04:50:23.536 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm77.ko 2024-01-22T04:50:23.536 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm78.ko 2024-01-22T04:50:23.536 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm80.ko 2024-01-22T04:50:23.536 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm83.ko 2024-01-22T04:50:23.536 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm85.ko 2024-01-22T04:50:23.536 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm87.ko 2024-01-22T04:50:23.536 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm90.ko 2024-01-22T04:50:23.537 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm92.ko 2024-01-22T04:50:23.537 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm93.ko 2024-01-22T04:50:23.537 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95234.ko 2024-01-22T04:50:23.537 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95241.ko 2024-01-22T04:50:23.537 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95245.ko 2024-01-22T04:50:23.537 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc2945.ko 2024-01-22T04:50:23.537 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4151.ko 2024-01-22T04:50:23.537 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4215.ko 2024-01-22T04:50:23.537 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4222.ko 2024-01-22T04:50:23.537 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4245.ko 2024-01-22T04:50:23.537 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4260.ko 2024-01-22T04:50:23.537 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4261.ko 2024-01-22T04:50:23.537 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max16065.ko 2024-01-22T04:50:23.537 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1619.ko 2024-01-22T04:50:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1668.ko 2024-01-22T04:50:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max197.ko 2024-01-22T04:50:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6639.ko 2024-01-22T04:50:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6650.ko 2024-01-22T04:50:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6697.ko 2024-01-22T04:50:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-22T04:50:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/mcp3021.ko 2024-01-22T04:50:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-22T04:50:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6683.ko 2024-01-22T04:50:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 119689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775-core.ko 2024-01-22T04:50:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775.ko 2024-01-22T04:50:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct7802.ko 2024-01-22T04:50:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 82337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87360.ko 2024-01-22T04:50:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87427.ko 2024-01-22T04:50:23.539 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pcf8591.ko 2024-01-22T04:50:23.539 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ 2024-01-22T04:50:23.539 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-22T04:50:23.539 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-22T04:50:23.539 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-22T04:50:23.539 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-22T04:50:23.539 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-22T04:50:23.539 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-22T04:50:23.539 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-22T04:50:23.539 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 82577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-22T04:50:23.539 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-22T04:50:23.539 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-22T04:50:23.539 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-22T04:50:23.539 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-22T04:50:23.540 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/powr1220.ko 2024-01-22T04:50:23.540 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5627.ko 2024-01-22T04:50:23.540 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5636.ko 2024-01-22T04:50:23.540 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-22T04:50:23.540 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht15.ko 2024-01-22T04:50:23.540 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht21.ko 2024-01-22T04:50:23.540 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/shtc1.ko 2024-01-22T04:50:23.540 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sis5595.ko 2024-01-22T04:50:23.541 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47b397.ko 2024-01-22T04:50:23.541 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m1.ko 2024-01-22T04:50:23.541 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m192.ko 2024-01-22T04:50:23.541 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/thmc50.ko 2024-01-22T04:50:23.541 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp102.ko 2024-01-22T04:50:23.541 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp103.ko 2024-01-22T04:50:23.541 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp401.ko 2024-01-22T04:50:23.541 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp421.ko 2024-01-22T04:50:23.541 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via-cputemp.ko 2024-01-22T04:50:23.541 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via686a.ko 2024-01-22T04:50:23.541 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt1211.ko 2024-01-22T04:50:23.541 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt8231.ko 2024-01-22T04:50:23.541 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627ehf.ko 2024-01-22T04:50:23.541 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627hf.ko 2024-01-22T04:50:23.541 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83781d.ko 2024-01-22T04:50:23.542 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 63225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83791d.ko 2024-01-22T04:50:23.542 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83792d.ko 2024-01-22T04:50:23.542 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 101473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83793.ko 2024-01-22T04:50:23.542 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 119505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83795.ko 2024-01-22T04:50:23.542 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l785ts.ko 2024-01-22T04:50:23.542 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l786ng.ko 2024-01-22T04:50:23.542 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-22T04:50:23.542 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-22T04:50:23.542 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/ 2024-01-22T04:50:23.542 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/ 2024-01-22T04:50:23.542 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-22T04:50:23.542 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-22T04:50:23.542 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/ 2024-01-22T04:50:23.542 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-22T04:50:23.542 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-22T04:50:23.543 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-22T04:50:23.543 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-22T04:50:23.543 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-22T04:50:23.543 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-22T04:50:23.543 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-22T04:50:23.543 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-22T04:50:23.543 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-22T04:50:23.543 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-22T04:50:23.543 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-22T04:50:23.543 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-22T04:50:23.543 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-22T04:50:23.543 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-22T04:50:23.543 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-22T04:50:23.543 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-22T04:50:23.543 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-22T04:50:23.544 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-22T04:50:23.544 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-22T04:50:23.544 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-22T04:50:23.544 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-22T04:50:23.544 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-22T04:50:23.544 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-22T04:50:23.544 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-22T04:50:23.544 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-22T04:50:23.544 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-22T04:50:23.544 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-22T04:50:23.544 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-22T04:50:23.544 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-22T04:50:23.544 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-22T04:50:23.545 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-22T04:50:23.545 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-22T04:50:23.545 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-22T04:50:23.545 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-22T04:50:23.545 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-22T04:50:23.545 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-22T04:50:23.545 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-22T04:50:23.545 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-mux.ko 2024-01-22T04:50:23.545 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-smbus.ko 2024-01-22T04:50:23.545 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-stub.ko 2024-01-22T04:50:23.545 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/ 2024-01-22T04:50:23.545 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-22T04:50:23.545 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-22T04:50:23.545 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-22T04:50:23.546 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ 2024-01-22T04:50:23.546 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ 2024-01-22T04:50:23.546 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 273609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-22T04:50:23.546 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 883681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_core.ko 2024-01-22T04:50:23.546 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-22T04:50:23.546 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 324329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-22T04:50:23.546 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 97921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-22T04:50:23.546 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 282601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-22T04:50:23.546 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-22T04:50:23.546 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/ 2024-01-22T04:50:23.546 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-22T04:50:23.546 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 493217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-22T04:50:23.546 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4/ 2024-01-22T04:50:23.546 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 420561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-22T04:50:23.547 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5/ 2024-01-22T04:50:23.547 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 741449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-22T04:50:23.547 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca/ 2024-01-22T04:50:23.547 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 296881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-22T04:50:23.547 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-22T04:50:23.547 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 153801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-22T04:50:23.547 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/usnic/ 2024-01-22T04:50:23.547 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 168969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-22T04:50:23.547 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ 2024-01-22T04:50:23.547 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-22T04:50:23.547 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 263081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-22T04:50:23.547 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser/ 2024-01-22T04:50:23.547 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-22T04:50:23.547 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert/ 2024-01-22T04:50:23.547 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 111425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-22T04:50:23.548 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp/ 2024-01-22T04:50:23.548 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 128753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-22T04:50:23.548 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt/ 2024-01-22T04:50:23.548 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 129529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-22T04:50:23.548 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/ 2024-01-22T04:50:23.548 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/evbug.ko 2024-01-22T04:50:23.548 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/ff-memless.ko 2024-01-22T04:50:23.548 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/ 2024-01-22T04:50:23.548 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-22T04:50:23.548 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-22T04:50:23.548 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/gameport.ko 2024-01-22T04:50:23.548 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/joydev.ko 2024-01-22T04:50:23.549 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/ 2024-01-22T04:50:23.549 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-22T04:50:23.549 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-22T04:50:23.549 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-22T04:50:23.549 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-22T04:50:23.549 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-22T04:50:23.549 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-22T04:50:23.549 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-22T04:50:23.549 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/lm8323.ko 2024-01-22T04:50:23.549 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/lm8333.ko 2024-01-22T04:50:23.549 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-22T04:50:23.549 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-22T04:50:23.549 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-22T04:50:23.549 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-22T04:50:23.550 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-22T04:50:23.550 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-22T04:50:23.550 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/qt1070.ko 2024-01-22T04:50:23.550 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/qt2160.ko 2024-01-22T04:50:23.550 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-22T04:50:23.550 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/stowaway.ko 2024-01-22T04:50:23.550 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-22T04:50:23.550 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-22T04:50:23.550 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-22T04:50:23.550 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-22T04:50:23.550 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-22T04:50:23.550 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/matrix-keymap.ko 2024-01-22T04:50:23.551 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/ 2024-01-22T04:50:23.551 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/appletouch.ko 2024-01-22T04:50:23.551 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/bcm5974.ko 2024-01-22T04:50:23.551 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 123417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/cyapatp.ko 2024-01-22T04:50:23.551 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-22T04:50:23.551 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-22T04:50:23.551 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 335953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/psmouse.ko 2024-01-22T04:50:23.551 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/sermouse.ko 2024-01-22T04:50:23.551 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-22T04:50:23.551 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-22T04:50:23.552 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-22T04:50:23.552 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4/ 2024-01-22T04:50:23.552 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 109873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-22T04:50:23.552 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/ 2024-01-22T04:50:23.552 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/altera_ps2.ko 2024-01-22T04:50:23.552 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/arc_ps2.ko 2024-01-22T04:50:23.552 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/ct82c710.ko 2024-01-22T04:50:23.552 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-22T04:50:23.552 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/parkbd.ko 2024-01-22T04:50:23.552 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/pcips2.ko 2024-01-22T04:50:23.552 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/ps2mult.ko 2024-01-22T04:50:23.552 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/serio_raw.ko 2024-01-22T04:50:23.552 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/serport.ko 2024-01-22T04:50:23.553 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/sparse-keymap.ko 2024-01-22T04:50:23.553 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/ 2024-01-22T04:50:23.553 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-88pm860x.ko 2024-01-22T04:50:23.553 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-adp5520.ko 2024-01-22T04:50:23.553 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-bd2802.ko 2024-01-22T04:50:23.553 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-blinkm.ko 2024-01-22T04:50:23.553 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-da903x.ko 2024-01-22T04:50:23.553 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-da9052.ko 2024-01-22T04:50:23.553 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-gpio.ko 2024-01-22T04:50:23.553 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3530.ko 2024-01-22T04:50:23.553 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3533.ko 2024-01-22T04:50:23.553 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm355x.ko 2024-01-22T04:50:23.553 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3642.ko 2024-01-22T04:50:23.553 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lp3944.ko 2024-01-22T04:50:23.554 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lp8788.ko 2024-01-22T04:50:23.554 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-max8997.ko 2024-01-22T04:50:23.554 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-mc13783.ko 2024-01-22T04:50:23.554 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-22T04:50:23.554 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-pca9532.ko 2024-01-22T04:50:23.554 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-pca955x.ko 2024-01-22T04:50:23.554 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-pca963x.ko 2024-01-22T04:50:23.554 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-ss4200.ko 2024-01-22T04:50:23.554 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-tca6507.ko 2024-01-22T04:50:23.554 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-22T04:50:23.554 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-wm8350.ko 2024-01-22T04:50:23.554 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ 2024-01-22T04:50:23.555 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-22T04:50:23.555 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-22T04:50:23.555 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-22T04:50:23.555 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-22T04:50:23.555 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-22T04:50:23.555 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-22T04:50:23.555 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-22T04:50:23.555 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-22T04:50:23.555 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-22T04:50:23.555 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/ 2024-01-22T04:50:23.555 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache/ 2024-01-22T04:50:23.555 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 647193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache/bcache.ko 2024-01-22T04:50:23.555 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-bio-prison.ko 2024-01-22T04:50:23.555 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 93409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-bufio.ko 2024-01-22T04:50:23.555 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache-smq.ko 2024-01-22T04:50:23.556 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 155897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache.ko 2024-01-22T04:50:23.556 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 107257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-crypt.ko 2024-01-22T04:50:23.556 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-delay.ko 2024-01-22T04:50:23.556 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-era.ko 2024-01-22T04:50:23.556 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-flakey.ko 2024-01-22T04:50:23.556 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-log-userspace.ko 2024-01-22T04:50:23.556 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-log.ko 2024-01-22T04:50:23.556 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-mirror.ko 2024-01-22T04:50:23.556 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-multipath.ko 2024-01-22T04:50:23.556 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-queue-length.ko 2024-01-22T04:50:23.556 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-raid.ko 2024-01-22T04:50:23.556 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-region-hash.ko 2024-01-22T04:50:23.556 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-round-robin.ko 2024-01-22T04:50:23.557 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-service-time.ko 2024-01-22T04:50:23.557 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 109529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-snapshot.ko 2024-01-22T04:50:23.557 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-switch.ko 2024-01-22T04:50:23.557 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 181865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-thin-pool.ko 2024-01-22T04:50:23.557 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-verity.ko 2024-01-22T04:50:23.557 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-zero.ko 2024-01-22T04:50:23.557 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/faulty.ko 2024-01-22T04:50:23.557 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/linear.ko 2024-01-22T04:50:23.557 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/multipath.ko 2024-01-22T04:50:23.557 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data/ 2024-01-22T04:50:23.557 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 199937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-22T04:50:23.557 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid0.ko 2024-01-22T04:50:23.557 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 113001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid1.ko 2024-01-22T04:50:23.557 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 158657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid10.ko 2024-01-22T04:50:23.557 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 393777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid456.ko 2024-01-22T04:50:23.558 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/ 2024-01-22T04:50:23.558 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/ 2024-01-22T04:50:23.558 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 178137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptbase.ko 2024-01-22T04:50:23.558 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 63321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptctl.ko 2024-01-22T04:50:23.558 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptfc.ko 2024-01-22T04:50:23.558 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptlan.ko 2024-01-22T04:50:23.558 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 123321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptsas.ko 2024-01-22T04:50:23.558 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptscsih.ko 2024-01-22T04:50:23.558 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptspi.ko 2024-01-22T04:50:23.558 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/ 2024-01-22T04:50:23.558 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/88pm800.ko 2024-01-22T04:50:23.558 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/88pm805.ko 2024-01-22T04:50:23.558 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/88pm80x.ko 2024-01-22T04:50:23.558 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/arizona-i2c.ko 2024-01-22T04:50:23.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 123721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/arizona.ko 2024-01-22T04:50:23.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/bcm590xx.ko 2024-01-22T04:50:23.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-22T04:50:23.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/dln2.ko 2024-01-22T04:50:23.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/janz-cmodio.ko 2024-01-22T04:50:23.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/kempld-core.ko 2024-01-22T04:50:23.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lm3533-core.ko 2024-01-22T04:50:23.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-22T04:50:23.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lp3943.ko 2024-01-22T04:50:23.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_ich.ko 2024-01-22T04:50:23.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_sch.ko 2024-01-22T04:50:23.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/max8907.ko 2024-01-22T04:50:23.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-22T04:50:23.559 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-22T04:50:23.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/menf21bmc.ko 2024-01-22T04:50:23.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-22T04:50:23.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-22T04:50:23.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/pcf50633.ko 2024-01-22T04:50:23.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-22T04:50:23.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/retu-mfd.ko 2024-01-22T04:50:23.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/si476x-core.ko 2024-01-22T04:50:23.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/sm501.ko 2024-01-22T04:50:23.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-22T04:50:23.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/tps65010.ko 2024-01-22T04:50:23.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/tps6507x.ko 2024-01-22T04:50:23.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/viperboard.ko 2024-01-22T04:50:23.560 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/vx855.ko 2024-01-22T04:50:23.561 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/wl1273-core.ko 2024-01-22T04:50:23.561 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/wm8994.ko 2024-01-22T04:50:23.561 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ 2024-01-22T04:50:23.561 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-22T04:50:23.561 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ad525x_dpot.ko 2024-01-22T04:50:23.561 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl/ 2024-01-22T04:50:23.561 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-22T04:50:23.561 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds9802als.ko 2024-01-22T04:50:23.561 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds990x.ko 2024-01-22T04:50:23.561 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/bh1770glc.ko 2024-01-22T04:50:23.561 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/c2port/ 2024-01-22T04:50:23.562 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-22T04:50:23.562 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/c2port/core.ko 2024-01-22T04:50:23.562 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710/ 2024-01-22T04:50:23.562 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710/cb710.ko 2024-01-22T04:50:23.562 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ds1682.ko 2024-01-22T04:50:23.562 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/dummy-irq.ko 2024-01-22T04:50:23.562 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/echo/ 2024-01-22T04:50:23.562 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/echo/echo.ko 2024-01-22T04:50:23.562 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/ 2024-01-22T04:50:23.562 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/at24.ko 2024-01-22T04:50:23.562 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-22T04:50:23.562 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/max6875.ko 2024-01-22T04:50:23.562 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/enclosure.ko 2024-01-22T04:50:23.563 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/genwqe/ 2024-01-22T04:50:23.563 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 152201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-22T04:50:23.563 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/hmc6352.ko 2024-01-22T04:50:23.563 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/hpilo.ko 2024-01-22T04:50:23.563 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ibmasm/ 2024-01-22T04:50:23.563 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-22T04:50:23.563 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ics932s401.ko 2024-01-22T04:50:23.563 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29003.ko 2024-01-22T04:50:23.563 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29020.ko 2024-01-22T04:50:23.563 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/ 2024-01-22T04:50:23.563 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-22T04:50:23.563 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-22T04:50:23.563 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/ 2024-01-22T04:50:23.563 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 125945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-me.ko 2024-01-22T04:50:23.563 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-txe.ko 2024-01-22T04:50:23.564 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 313641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei.ko 2024-01-22T04:50:23.564 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/phantom.ko 2024-01-22T04:50:23.564 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ti-st/ 2024-01-22T04:50:23.564 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 74377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-22T04:50:23.564 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_7xx1.ko 2024-01-22T04:50:23.564 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_core.ko 2024-01-22T04:50:23.564 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tsl2550.ko 2024-01-22T04:50:23.564 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_balloon.ko 2024-01-22T04:50:23.564 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci/ 2024-01-22T04:50:23.564 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 183609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-22T04:50:23.564 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ 2024-01-22T04:50:23.564 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding/ 2024-01-22T04:50:23.564 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 490849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding/bonding.ko 2024-01-22T04:50:23.564 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/ 2024-01-22T04:50:23.565 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53/ 2024-01-22T04:50:23.565 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 106033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-22T04:50:23.565 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-22T04:50:23.565 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-22T04:50:23.565 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-22T04:50:23.565 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 455065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-22T04:50:23.565 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dummy.ko 2024-01-22T04:50:23.565 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/eql.ko 2024-01-22T04:50:23.565 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ 2024-01-22T04:50:23.565 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/ 2024-01-22T04:50:23.565 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-22T04:50:23.565 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-22T04:50:23.565 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 130553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-22T04:50:23.567 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-22T04:50:23.567 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/ 2024-01-22T04:50:23.567 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-22T04:50:23.567 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-22T04:50:23.567 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-22T04:50:23.567 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 99049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-22T04:50:23.567 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec/ 2024-01-22T04:50:23.567 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-22T04:50:23.567 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere/ 2024-01-22T04:50:23.567 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-22T04:50:23.567 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon/ 2024-01-22T04:50:23.568 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-22T04:50:23.568 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera/ 2024-01-22T04:50:23.568 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-22T04:50:23.568 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/ 2024-01-22T04:50:23.568 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-22T04:50:23.568 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-22T04:50:23.568 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 87297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-22T04:50:23.568 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/ 2024-01-22T04:50:23.568 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-22T04:50:23.568 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 97337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-22T04:50:23.568 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-22T04:50:23.568 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-22T04:50:23.568 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-22T04:50:23.568 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 90345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-22T04:50:23.569 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-22T04:50:23.569 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-22T04:50:23.569 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-22T04:50:23.569 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/ 2024-01-22T04:50:23.569 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-22T04:50:23.569 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 176761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-22T04:50:23.569 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-22T04:50:23.569 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1421529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-22T04:50:23.639 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 128569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-22T04:50:23.639 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-22T04:50:23.639 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 131337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-22T04:50:23.639 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 314553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-22T04:50:23.639 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/ 2024-01-22T04:50:23.639 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-22T04:50:23.639 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 323745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-22T04:50:23.639 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/ 2024-01-22T04:50:23.639 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-22T04:50:23.639 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 193497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-22T04:50:23.639 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-22T04:50:23.640 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 347257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-22T04:50:23.640 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-22T04:50:23.640 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1044793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-22T04:50:23.640 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-22T04:50:23.640 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 166193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-22T04:50:23.640 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-22T04:50:23.640 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-22T04:50:23.640 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/ 2024-01-22T04:50:23.640 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-22T04:50:23.640 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 204345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-22T04:50:23.640 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/ 2024-01-22T04:50:23.640 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-22T04:50:23.640 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-22T04:50:23.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-22T04:50:23.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 141225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-22T04:50:23.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-22T04:50:23.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-22T04:50:23.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-22T04:50:23.641 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/ 2024-01-22T04:50:23.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-22T04:50:23.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-22T04:50:23.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dnet.ko 2024-01-22T04:50:23.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-22T04:50:23.641 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/ 2024-01-22T04:50:23.641 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-22T04:50:23.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 281137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-22T04:50:23.641 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ethoc.ko 2024-01-22T04:50:23.642 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fealnx.ko 2024-01-22T04:50:23.642 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fujitsu/ 2024-01-22T04:50:23.642 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-22T04:50:23.642 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ 2024-01-22T04:50:23.642 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 90369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-22T04:50:23.642 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-22T04:50:23.642 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 295481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-22T04:50:23.642 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-22T04:50:23.642 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 584497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-22T04:50:23.642 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-22T04:50:23.642 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 246209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-22T04:50:23.642 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-22T04:50:23.642 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 937673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-22T04:50:23.642 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-22T04:50:23.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 287305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-22T04:50:23.643 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb/ 2024-01-22T04:50:23.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 514569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-22T04:50:23.643 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-22T04:50:23.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 93497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-22T04:50:23.643 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-22T04:50:23.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 734353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-22T04:50:23.643 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-22T04:50:23.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 151769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-22T04:50:23.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 86921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/jme.ko 2024-01-22T04:50:23.643 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/ 2024-01-22T04:50:23.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-22T04:50:23.643 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-22T04:50:23.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 122601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-22T04:50:23.644 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/ 2024-01-22T04:50:23.644 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-22T04:50:23.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 727473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-22T04:50:23.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 278961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-22T04:50:23.644 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-22T04:50:23.644 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-22T04:50:23.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1118201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-22T04:50:23.644 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ 2024-01-22T04:50:23.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-22T04:50:23.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-22T04:50:23.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-22T04:50:23.644 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 95665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-22T04:50:23.644 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/ 2024-01-22T04:50:23.645 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-22T04:50:23.645 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-22T04:50:23.645 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/ 2024-01-22T04:50:23.645 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-22T04:50:23.645 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-22T04:50:23.645 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion/ 2024-01-22T04:50:23.645 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 150905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-22T04:50:23.645 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia/ 2024-01-22T04:50:23.645 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 136721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-22T04:50:23.645 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/ 2024-01-22T04:50:23.645 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-22T04:50:23.645 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-22T04:50:23.645 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/ 2024-01-22T04:50:23.646 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-22T04:50:23.646 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 227897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-22T04:50:23.646 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 87105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-22T04:50:23.646 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-22T04:50:23.646 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 671937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-22T04:50:23.646 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc/ 2024-01-22T04:50:23.646 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-22T04:50:23.646 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/ 2024-01-22T04:50:23.646 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-22T04:50:23.646 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 83985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-22T04:50:23.646 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-22T04:50:23.646 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 192353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-22T04:50:23.647 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/samsung/ 2024-01-22T04:50:23.647 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-22T04:50:23.647 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 104241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-22T04:50:23.647 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc/ 2024-01-22T04:50:23.647 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1064737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-22T04:50:23.647 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan/ 2024-01-22T04:50:23.647 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-22T04:50:23.647 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/ 2024-01-22T04:50:23.647 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-22T04:50:23.647 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 63337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-22T04:50:23.647 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/ 2024-01-22T04:50:23.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-22T04:50:23.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-22T04:50:23.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-22T04:50:23.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-22T04:50:23.648 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/ 2024-01-22T04:50:23.648 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-22T04:50:23.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-22T04:50:23.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-22T04:50:23.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-22T04:50:23.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 487593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-22T04:50:23.648 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/ 2024-01-22T04:50:23.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 103337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-22T04:50:23.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 166097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-22T04:50:23.649 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-22T04:50:23.649 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-22T04:50:23.649 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti/ 2024-01-22T04:50:23.649 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-22T04:50:23.649 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti/ 2024-01-22T04:50:23.649 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 86529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-22T04:50:23.649 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/ 2024-01-22T04:50:23.649 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-22T04:50:23.649 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 83793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-22T04:50:23.649 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/ 2024-01-22T04:50:23.649 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-22T04:50:23.649 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-22T04:50:23.649 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom/ 2024-01-22T04:50:23.649 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-22T04:50:23.649 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/ 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/defxx.ko 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/skfp/ 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 216985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 74569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/geneve.ko 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv/ 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 236225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154/ 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ifb.ko 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan/ 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 85817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvlan.ko 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvtap.ko 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/ 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-22T04:50:23.650 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-22T04:50:23.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-22T04:50:23.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-22T04:50:23.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio.ko 2024-01-22T04:50:23.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mii.ko 2024-01-22T04:50:23.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/netconsole.ko 2024-01-22T04:50:23.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/nlmon.ko 2024-01-22T04:50:23.651 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/ 2024-01-22T04:50:23.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-22T04:50:23.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-22T04:50:23.651 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/ 2024-01-22T04:50:23.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/amd.ko 2024-01-22T04:50:23.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-22T04:50:23.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-22T04:50:23.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm87xx.ko 2024-01-22T04:50:23.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/broadcom.ko 2024-01-22T04:50:23.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/cicada.ko 2024-01-22T04:50:23.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/davicom.ko 2024-01-22T04:50:23.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/et1011c.ko 2024-01-22T04:50:23.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/icplus.ko 2024-01-22T04:50:23.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/lxt.ko 2024-01-22T04:50:23.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 82049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/marvell.ko 2024-01-22T04:50:23.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 76409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/micrel.ko 2024-01-22T04:50:23.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/national.ko 2024-01-22T04:50:23.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 95561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/phylink.ko 2024-01-22T04:50:23.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/qsemi.ko 2024-01-22T04:50:23.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/realtek.ko 2024-01-22T04:50:23.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/smsc.ko 2024-01-22T04:50:23.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/ste10Xp.ko 2024-01-22T04:50:23.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/vitesse.ko 2024-01-22T04:50:23.653 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/plip/ 2024-01-22T04:50:23.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/plip/plip.ko 2024-01-22T04:50:23.653 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ 2024-01-22T04:50:23.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-22T04:50:23.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_async.ko 2024-01-22T04:50:23.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-22T04:50:23.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-22T04:50:23.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-22T04:50:23.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppoe.ko 2024-01-22T04:50:23.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppox.ko 2024-01-22T04:50:23.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pptp.ko 2024-01-22T04:50:23.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/sb1000.ko 2024-01-22T04:50:23.653 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/ 2024-01-22T04:50:23.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slip.ko 2024-01-22T04:50:23.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/sungem_phy.ko 2024-01-22T04:50:23.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 64585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tap.ko 2024-01-22T04:50:23.654 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/ 2024-01-22T04:50:23.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 107089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team.ko 2024-01-22T04:50:23.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-22T04:50:23.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-22T04:50:23.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-22T04:50:23.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_random.ko 2024-01-22T04:50:23.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-22T04:50:23.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 86945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/veth.ko 2024-01-22T04:50:23.654 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3/ 2024-01-22T04:50:23.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 144361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-22T04:50:23.654 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan/ 2024-01-22T04:50:23.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 301281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan/vxlan.ko 2024-01-22T04:50:23.654 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback/ 2024-01-22T04:50:23.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 144001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-22T04:50:23.655 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb/ 2024-01-22T04:50:23.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb/ntb.ko 2024-01-22T04:50:23.655 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/ 2024-01-22T04:50:23.655 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/ 2024-01-22T04:50:23.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 265777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme-core.ko 2024-01-22T04:50:23.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme.ko 2024-01-22T04:50:23.655 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/ 2024-01-22T04:50:23.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 131249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport.ko 2024-01-22T04:50:23.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_cs.ko 2024-01-22T04:50:23.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 85377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_pc.ko 2024-01-22T04:50:23.655 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_serial.ko 2024-01-22T04:50:23.655 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/ 2024-01-22T04:50:23.655 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/ 2024-01-22T04:50:23.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-22T04:50:23.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-22T04:50:23.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-22T04:50:23.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pci-stub.ko 2024-01-22T04:50:23.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/xen-pcifront.ko 2024-01-22T04:50:23.656 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/ 2024-01-22T04:50:23.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/i82092.ko 2024-01-22T04:50:23.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 146289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pcmcia.ko 2024-01-22T04:50:23.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-22T04:50:23.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-22T04:50:23.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pd6729.ko 2024-01-22T04:50:23.656 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 112889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-22T04:50:23.656 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/ 2024-01-22T04:50:23.656 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/broadcom/ 2024-01-22T04:50:23.657 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-22T04:50:23.657 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/samsung/ 2024-01-22T04:50:23.657 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-22T04:50:23.657 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/ 2024-01-22T04:50:23.657 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel/ 2024-01-22T04:50:23.657 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-22T04:50:23.657 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/ 2024-01-22T04:50:23.657 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/ 2024-01-22T04:50:23.657 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-22T04:50:23.657 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-22T04:50:23.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-22T04:50:23.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-22T04:50:23.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-22T04:50:23.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-22T04:50:23.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-22T04:50:23.658 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/ 2024-01-22T04:50:23.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-22T04:50:23.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acerhdf.ko 2024-01-22T04:50:23.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-22T04:50:23.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-22T04:50:23.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-22T04:50:23.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 132025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-22T04:50:23.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-22T04:50:23.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-22T04:50:23.658 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-22T04:50:23.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-22T04:50:23.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-22T04:50:23.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/hdaps.ko 2024-01-22T04:50:23.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-22T04:50:23.659 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/ 2024-01-22T04:50:23.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-22T04:50:23.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-22T04:50:23.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel_ips.ko 2024-01-22T04:50:23.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-22T04:50:23.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-22T04:50:23.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-22T04:50:23.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-22T04:50:23.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-22T04:50:23.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-22T04:50:23.659 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-22T04:50:23.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-22T04:50:23.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-22T04:50:23.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi.ko 2024-01-22T04:50:23.660 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/ 2024-01-22T04:50:23.660 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ 2024-01-22T04:50:23.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-22T04:50:23.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-22T04:50:23.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-22T04:50:23.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-22T04:50:23.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-22T04:50:23.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-22T04:50:23.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/da9030_battery.ko 2024-01-22T04:50:23.660 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/da9052-battery.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/gpio-charger.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max14577_charger.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max17042_battery.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max8903_charger.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max8925_power.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/sbs-battery.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/test_power.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-22T04:50:23.661 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/wm831x_power.ko 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/wm8350_power.ko 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/ 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/ 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/ 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps_parport.ko 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/pps_core.ko 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp.ko 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp_kvm.ko 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/ 2024-01-22T04:50:23.662 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-22T04:50:23.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-22T04:50:23.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-22T04:50:23.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-da9052.ko 2024-01-22T04:50:23.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-da9055.ko 2024-01-22T04:50:23.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-da9063.ko 2024-01-22T04:50:23.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-22T04:50:23.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-22T04:50:23.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-22T04:50:23.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-22T04:50:23.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-22T04:50:23.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-22T04:50:23.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-22T04:50:23.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-22T04:50:23.663 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-22T04:50:23.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-em3027.ko 2024-01-22T04:50:23.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-22T04:50:23.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-22T04:50:23.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-22T04:50:23.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-22T04:50:23.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-22T04:50:23.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-22T04:50:23.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-22T04:50:23.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-22T04:50:23.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max6900.ko 2024-01-22T04:50:23.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8907.ko 2024-01-22T04:50:23.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8925.ko 2024-01-22T04:50:23.664 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8997.ko 2024-01-22T04:50:23.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8998.ko 2024-01-22T04:50:23.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-22T04:50:23.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-22T04:50:23.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-palmas.ko 2024-01-22T04:50:23.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-22T04:50:23.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-22T04:50:23.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-22T04:50:23.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-22T04:50:23.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-22T04:50:23.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-22T04:50:23.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-22T04:50:23.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-22T04:50:23.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-22T04:50:23.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-22T04:50:23.665 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-22T04:50:23.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-22T04:50:23.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-22T04:50:23.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-22T04:50:23.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-22T04:50:23.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-22T04:50:23.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-22T04:50:23.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-22T04:50:23.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-x1205.ko 2024-01-22T04:50:23.666 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ 2024-01-22T04:50:23.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 77617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-9xxx.ko 2024-01-22T04:50:23.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-sas.ko 2024-01-22T04:50:23.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-xxxx.ko 2024-01-22T04:50:23.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 135185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/BusLogic.ko 2024-01-22T04:50:23.666 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/a100u2w.ko 2024-01-22T04:50:23.667 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid/ 2024-01-22T04:50:23.667 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 271113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-22T04:50:23.667 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/advansys.ko 2024-01-22T04:50:23.667 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/ 2024-01-22T04:50:23.667 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 356929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-22T04:50:23.667 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 296049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-22T04:50:23.667 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic94xx/ 2024-01-22T04:50:23.667 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 189185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-22T04:50:23.667 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/am53c974.ko 2024-01-22T04:50:23.667 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr/ 2024-01-22T04:50:23.667 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 106881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-22T04:50:23.667 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/atp870u.ko 2024-01-22T04:50:23.667 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi/ 2024-01-22T04:50:23.667 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 247009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-22T04:50:23.668 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa/ 2024-01-22T04:50:23.668 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1171945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa/bfa.ko 2024-01-22T04:50:23.668 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc/ 2024-01-22T04:50:23.668 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 237721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-22T04:50:23.668 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i/ 2024-01-22T04:50:23.668 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 115369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-22T04:50:23.668 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ch.ko 2024-01-22T04:50:23.668 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor/ 2024-01-22T04:50:23.669 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 308921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-22T04:50:23.669 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/ 2024-01-22T04:50:23.669 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-22T04:50:23.669 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 76145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-22T04:50:23.669 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-22T04:50:23.669 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 101449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-22T04:50:23.669 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 146625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-22T04:50:23.669 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 75553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dc395x.ko 2024-01-22T04:50:23.669 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dmx3191d.ko 2024-01-22T04:50:23.669 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r/ 2024-01-22T04:50:23.669 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 212425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-22T04:50:23.669 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esp_scsi.ko 2024-01-22T04:50:23.669 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/ 2024-01-22T04:50:23.669 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-22T04:50:23.669 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 158505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-22T04:50:23.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fdomain.ko 2024-01-22T04:50:23.670 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic/ 2024-01-22T04:50:23.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 263489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic/fnic.ko 2024-01-22T04:50:23.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 201817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hpsa.ko 2024-01-22T04:50:23.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hptiop.ko 2024-01-22T04:50:23.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hv_storvsc.ko 2024-01-22T04:50:23.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/imm.ko 2024-01-22T04:50:23.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/initio.ko 2024-01-22T04:50:23.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 266537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ipr.ko 2024-01-22T04:50:23.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 101473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ips.ko 2024-01-22T04:50:23.670 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci/ 2024-01-22T04:50:23.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 317153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci/isci.ko 2024-01-22T04:50:23.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-22T04:50:23.670 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-22T04:50:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc/ 2024-01-22T04:50:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 315209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc/libfc.ko 2024-01-22T04:50:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 145585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi.ko 2024-01-22T04:50:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-22T04:50:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas/ 2024-01-22T04:50:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 216441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas/libsas.ko 2024-01-22T04:50:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc/ 2024-01-22T04:50:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 2197481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-22T04:50:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/ 2024-01-22T04:50:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-22T04:50:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-22T04:50:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 310841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-22T04:50:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 84649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid.ko 2024-01-22T04:50:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas/ 2024-01-22T04:50:23.672 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 659801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-22T04:50:23.672 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas/ 2024-01-22T04:50:23.672 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 119561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-22T04:50:23.672 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvumi.ko 2024-01-22T04:50:23.672 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/ 2024-01-22T04:50:23.672 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-22T04:50:23.672 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-22T04:50:23.672 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-22T04:50:23.672 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-22T04:50:23.672 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001/ 2024-01-22T04:50:23.672 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 366401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-22T04:50:23.672 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 124633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pmcraid.ko 2024-01-22T04:50:23.672 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ppa.ko 2024-01-22T04:50:23.672 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla1280.ko 2024-01-22T04:50:23.673 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/ 2024-01-22T04:50:23.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1876633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-22T04:50:23.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 85289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-22T04:50:23.673 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx/ 2024-01-22T04:50:23.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 559033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-22T04:50:23.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qlogicfas408.ko 2024-01-22T04:50:23.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/raid_class.ko 2024-01-22T04:50:23.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 261241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_debug.ko 2024-01-22T04:50:23.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 173937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-22T04:50:23.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 279313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-22T04:50:23.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 97729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-22T04:50:23.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-22T04:50:23.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-22T04:50:23.673 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ses.ko 2024-01-22T04:50:23.674 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 115889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/st.ko 2024-01-22T04:50:23.674 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/stex.ko 2024-01-22T04:50:23.674 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-22T04:50:23.674 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 164961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-22T04:50:23.674 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/virtio_scsi.ko 2024-01-22T04:50:23.674 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-22T04:50:23.674 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/wd719x.ko 2024-01-22T04:50:23.674 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/xen-scsifront.ko 2024-01-22T04:50:23.674 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb/ 2024-01-22T04:50:23.674 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 129441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb/ssb.ko 2024-01-22T04:50:23.674 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/ 2024-01-22T04:50:23.674 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi/ 2024-01-22T04:50:23.674 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 736769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-22T04:50:23.674 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback/ 2024-01-22T04:50:23.674 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-22T04:50:23.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_file.ko 2024-01-22T04:50:23.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_iblock.ko 2024-01-22T04:50:23.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 930697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_mod.ko 2024-01-22T04:50:23.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_pscsi.ko 2024-01-22T04:50:23.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 122521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_user.ko 2024-01-22T04:50:23.675 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc/ 2024-01-22T04:50:23.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 75593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-22T04:50:23.675 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/ 2024-01-22T04:50:23.675 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/ 2024-01-22T04:50:23.675 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-22T04:50:23.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-22T04:50:23.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-22T04:50:23.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-22T04:50:23.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-22T04:50:23.675 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-22T04:50:23.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-22T04:50:23.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-22T04:50:23.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-22T04:50:23.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-22T04:50:23.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-22T04:50:23.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-22T04:50:23.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-22T04:50:23.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-22T04:50:23.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-22T04:50:23.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-22T04:50:23.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-22T04:50:23.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-22T04:50:23.676 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-22T04:50:23.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-22T04:50:23.677 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ 2024-01-22T04:50:23.677 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless/ 2024-01-22T04:50:23.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-22T04:50:23.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/moxa.ko 2024-01-22T04:50:23.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/mxser.ko 2024-01-22T04:50:23.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_gsm.ko 2024-01-22T04:50:23.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_hdlc.ko 2024-01-22T04:50:23.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/nozomi.ko 2024-01-22T04:50:23.677 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/ 2024-01-22T04:50:23.677 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/ 2024-01-22T04:50:23.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-22T04:50:23.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-22T04:50:23.677 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-22T04:50:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/altera_uart.ko 2024-01-22T04:50:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/arc_uart.ko 2024-01-22T04:50:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-22T04:50:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm/ 2024-01-22T04:50:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 103073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-22T04:50:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/rp2.ko 2024-01-22T04:50:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-22T04:50:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/ 2024-01-22T04:50:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core/ 2024-01-22T04:50:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 535985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-22T04:50:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ 2024-01-22T04:50:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-22T04:50:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-22T04:50:23.679 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/ 2024-01-22T04:50:23.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio.ko 2024-01-22T04:50:23.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_aec.ko 2024-01-22T04:50:23.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_cif.ko 2024-01-22T04:50:23.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-22T04:50:23.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_mf624.ko 2024-01-22T04:50:23.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_netx.ko 2024-01-22T04:50:23.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_pci_generic.ko 2024-01-22T04:50:23.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-22T04:50:23.679 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_sercos3.ko 2024-01-22T04:50:23.679 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/ 2024-01-22T04:50:23.680 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/c67x00/ 2024-01-22T04:50:23.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-22T04:50:23.680 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ 2024-01-22T04:50:23.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 144617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-22T04:50:23.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-22T04:50:23.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-01-22T04:50:23.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-22T04:50:23.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-22T04:50:23.680 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/ 2024-01-22T04:50:23.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 87073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-acm.ko 2024-01-22T04:50:23.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-22T04:50:23.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usblp.ko 2024-01-22T04:50:23.680 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usbtmc.ko 2024-01-22T04:50:23.681 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/common/ 2024-01-22T04:50:23.681 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/common/ulpi.ko 2024-01-22T04:50:23.681 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc2/ 2024-01-22T04:50:23.681 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-22T04:50:23.681 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/ 2024-01-22T04:50:23.681 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-22T04:50:23.681 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-22T04:50:23.681 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 454385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-22T04:50:23.681 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/ 2024-01-22T04:50:23.681 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/ 2024-01-22T04:50:23.681 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-22T04:50:23.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-22T04:50:23.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-22T04:50:23.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-22T04:50:23.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-22T04:50:23.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-22T04:50:23.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 92489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-22T04:50:23.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-22T04:50:23.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 122081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-22T04:50:23.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-22T04:50:23.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-22T04:50:23.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-22T04:50:23.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-22T04:50:23.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 85609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-22T04:50:23.682 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-22T04:50:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-22T04:50:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-22T04:50:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/ 2024-01-22T04:50:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-22T04:50:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-22T04:50:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-22T04:50:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-22T04:50:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-22T04:50:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-22T04:50:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-22T04:50:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-22T04:50:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-22T04:50:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-22T04:50:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-22T04:50:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-22T04:50:23.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-22T04:50:23.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-22T04:50:23.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 161225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-22T04:50:23.684 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/ 2024-01-22T04:50:23.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-22T04:50:23.684 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-22T04:50:23.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 157681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-22T04:50:23.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-22T04:50:23.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-22T04:50:23.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-22T04:50:23.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-22T04:50:23.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 76057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-22T04:50:23.684 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 75073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 65809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 156409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/ 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 87353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/sl811_cs.ko 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/ 2024-01-22T04:50:23.685 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/mdc800.ko 2024-01-22T04:50:23.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/microtek.ko 2024-01-22T04:50:23.686 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ 2024-01-22T04:50:23.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/adutux.ko 2024-01-22T04:50:23.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/appledisplay.ko 2024-01-22T04:50:23.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-22T04:50:23.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/cytherm.ko 2024-01-22T04:50:23.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ehset.ko 2024-01-22T04:50:23.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi26.ko 2024-01-22T04:50:23.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi62.ko 2024-01-22T04:50:23.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ezusb.ko 2024-01-22T04:50:23.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/idmouse.ko 2024-01-22T04:50:23.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/iowarrior.ko 2024-01-22T04:50:23.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-22T04:50:23.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ldusb.ko 2024-01-22T04:50:23.686 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/legousbtower.ko 2024-01-22T04:50:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/lvstest.ko 2024-01-22T04:50:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga/ 2024-01-22T04:50:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 64841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-22T04:50:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-22T04:50:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usb3503.ko 2024-01-22T04:50:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usblcd.ko 2024-01-22T04:50:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-22T04:50:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usbtest.ko 2024-01-22T04:50:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/uss720.ko 2024-01-22T04:50:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/yurex.ko 2024-01-22T04:50:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/mon/ 2024-01-22T04:50:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/mon/usbmon.ko 2024-01-22T04:50:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/musb/ 2024-01-22T04:50:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 301697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-22T04:50:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/ 2024-01-22T04:50:23.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-generic.ko 2024-01-22T04:50:23.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-22T04:50:23.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-22T04:50:23.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-22T04:50:23.688 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ 2024-01-22T04:50:23.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/aircable.ko 2024-01-22T04:50:23.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ark3116.ko 2024-01-22T04:50:23.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-22T04:50:23.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ch341.ko 2024-01-22T04:50:23.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cp210x.ko 2024-01-22T04:50:23.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cyberjack.ko 2024-01-22T04:50:23.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-22T04:50:23.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-22T04:50:23.688 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/empeg.ko 2024-01-22T04:50:23.689 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/f81232.ko 2024-01-22T04:50:23.689 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 175193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-22T04:50:23.689 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-22T04:50:23.689 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 137081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-22T04:50:23.689 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 124833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_ti.ko 2024-01-22T04:50:23.689 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipaq.ko 2024-01-22T04:50:23.689 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipw.ko 2024-01-22T04:50:23.689 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ir-usb.ko 2024-01-22T04:50:23.689 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-22T04:50:23.689 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 107521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan.ko 2024-01-22T04:50:23.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-22T04:50:23.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-22T04:50:23.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-22T04:50:23.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mct_u232.ko 2024-01-22T04:50:23.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/metro-usb.ko 2024-01-22T04:50:23.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7720.ko 2024-01-22T04:50:23.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7840.ko 2024-01-22T04:50:23.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mxuport.ko 2024-01-22T04:50:23.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/navman.ko 2024-01-22T04:50:23.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/omninet.ko 2024-01-22T04:50:23.690 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/opticon.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 191801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/option.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/oti6858.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/pl2303.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcaux.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcserial.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/quatech2.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/safe_serial.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/sierra.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ssu100.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/symbolserial.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_debug.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-22T04:50:23.691 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 125609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usbserial.ko 2024-01-22T04:50:23.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/visor.ko 2024-01-22T04:50:23.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/whiteheat.ko 2024-01-22T04:50:23.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-22T04:50:23.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-22T04:50:23.692 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ 2024-01-22T04:50:23.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/uas.ko 2024-01-22T04:50:23.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-22T04:50:23.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-22T04:50:23.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-22T04:50:23.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-22T04:50:23.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-22T04:50:23.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-22T04:50:23.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-22T04:50:23.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-karma.ko 2024-01-22T04:50:23.692 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-22T04:50:23.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-22T04:50:23.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-22T04:50:23.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-22T04:50:23.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-22T04:50:23.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 180225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/usb-storage.ko 2024-01-22T04:50:23.693 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/ 2024-01-22T04:50:23.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-22T04:50:23.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-22T04:50:23.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 103977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-22T04:50:23.693 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/ 2024-01-22T04:50:23.693 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/ 2024-01-22T04:50:23.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 154297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-22T04:50:23.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-22T04:50:23.693 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 103737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio.ko 2024-01-22T04:50:23.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 77609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-22T04:50:23.694 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/ 2024-01-22T04:50:23.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 113785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost.ko 2024-01-22T04:50:23.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-22T04:50:23.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_net.ko 2024-01-22T04:50:23.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_scsi.ko 2024-01-22T04:50:23.694 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/ 2024-01-22T04:50:23.694 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/ 2024-01-22T04:50:23.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-22T04:50:23.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-22T04:50:23.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-22T04:50:23.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-22T04:50:23.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-22T04:50:23.694 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/apple_bl.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/bd6107.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lcd.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-22T04:50:23.695 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/ 2024-01-22T04:50:23.696 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ 2024-01-22T04:50:23.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2482.ko 2024-01-22T04:50:23.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2490.ko 2024-01-22T04:50:23.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-22T04:50:23.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-22T04:50:23.696 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/ 2024-01-22T04:50:23.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-22T04:50:23.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-22T04:50:23.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-22T04:50:23.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-22T04:50:23.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-22T04:50:23.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-22T04:50:23.696 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/wire.ko 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/acquirewdt.ko 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/advantechwdt.ko 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/dw_wdt.ko 2024-01-22T04:50:23.697 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-22T04:50:23.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-22T04:50:23.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/hpwdt.ko 2024-01-22T04:50:23.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/i6300esb.ko 2024-01-22T04:50:23.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-22T04:50:23.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-22T04:50:23.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ib700wdt.ko 2024-01-22T04:50:23.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ibmasr.ko 2024-01-22T04:50:23.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-22T04:50:23.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-22T04:50:23.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it87_wdt.ko 2024-01-22T04:50:23.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-22T04:50:23.698 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/machzwd.ko 2024-01-22T04:50:23.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-22T04:50:23.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-22T04:50:23.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/nv_tco.ko 2024-01-22T04:50:23.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-22T04:50:23.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-22T04:50:23.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-22T04:50:23.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-22T04:50:23.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/retu_wdt.ko 2024-01-22T04:50:23.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-22T04:50:23.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-22T04:50:23.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-22T04:50:23.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-22T04:50:23.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-22T04:50:23.699 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-22T04:50:23.700 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/softdog.ko 2024-01-22T04:50:23.700 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-22T04:50:23.700 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-22T04:50:23.700 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/via_wdt.ko 2024-01-22T04:50:23.700 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-22T04:50:23.700 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-22T04:50:23.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-22T04:50:23.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-22T04:50:23.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wdt_pci.ko 2024-01-22T04:50:23.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-22T04:50:23.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-22T04:50:23.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/xen_wdt.ko 2024-01-22T04:50:23.701 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/ 2024-01-22T04:50:23.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-evtchn.ko 2024-01-22T04:50:23.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntalloc.ko 2024-01-22T04:50:23.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntdev.ko 2024-01-22T04:50:23.701 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback/ 2024-01-22T04:50:23.701 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 176441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-22T04:50:23.702 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-privcmd.ko 2024-01-22T04:50:23.702 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-scsiback.ko 2024-01-22T04:50:23.702 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs/ 2024-01-22T04:50:23.702 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-22T04:50:23.702 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ 2024-01-22T04:50:23.702 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/9p/ 2024-01-22T04:50:23.702 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 166753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/9p/9p.ko 2024-01-22T04:50:23.702 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/adfs/ 2024-01-22T04:50:23.702 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/adfs/adfs.ko 2024-01-22T04:50:23.702 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/affs/ 2024-01-22T04:50:23.702 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 163449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/affs/affs.ko 2024-01-22T04:50:23.702 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/afs/ 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 935033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/afs/kafs.ko 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/autofs/ 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 103401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/autofs/autofs4.ko 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/befs/ 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 64681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/befs/befs.ko 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/bfs/ 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/bfs/bfs.ko 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/binfmt_misc.ko 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs/ 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 3455857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs/btrfs.ko 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles/ 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 306009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles/cachefiles.ko 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph/ 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1336985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph/ceph.ko 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/coda/ 2024-01-22T04:50:23.703 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/coda/coda.ko 2024-01-22T04:50:23.704 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/configfs/ 2024-01-22T04:50:23.704 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/configfs/configfs.ko 2024-01-22T04:50:23.704 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs/ 2024-01-22T04:50:23.704 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs/cramfs.ko 2024-01-22T04:50:23.704 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm/ 2024-01-22T04:50:23.704 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 644073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm/dlm.ko 2024-01-22T04:50:23.704 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/efs/ 2024-01-22T04:50:23.704 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/efs/efs.ko 2024-01-22T04:50:23.704 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs/ 2024-01-22T04:50:23.704 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1506641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs/f2fs.ko 2024-01-22T04:50:23.704 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/ 2024-01-22T04:50:23.704 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/msdos.ko 2024-01-22T04:50:23.704 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/freevxfs/ 2024-01-22T04:50:23.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/freevxfs/freevxfs.ko 2024-01-22T04:50:23.705 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache/ 2024-01-22T04:50:23.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 226481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache/fscache.ko 2024-01-22T04:50:23.705 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/ 2024-01-22T04:50:23.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/cuse.ko 2024-01-22T04:50:23.705 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2/ 2024-01-22T04:50:23.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1229913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2/gfs2.ko 2024-01-22T04:50:23.705 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs/ 2024-01-22T04:50:23.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 141985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs/hfs.ko 2024-01-22T04:50:23.705 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus/ 2024-01-22T04:50:23.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 223225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus/hfsplus.ko 2024-01-22T04:50:23.705 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hpfs/ 2024-01-22T04:50:23.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 193569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hpfs/hpfs.ko 2024-01-22T04:50:23.705 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs/ 2024-01-22T04:50:23.705 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 74785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs/isofs.ko 2024-01-22T04:50:23.706 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs/ 2024-01-22T04:50:23.706 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 419881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs/jfs.ko 2024-01-22T04:50:23.706 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd/ 2024-01-22T04:50:23.706 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 282049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd/lockd.ko 2024-01-22T04:50:23.706 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/minix/ 2024-01-22T04:50:23.706 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/minix/minix.ko 2024-01-22T04:50:23.706 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs/ 2024-01-22T04:50:23.706 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 124649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs/netfs.ko 2024-01-22T04:50:23.706 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/ 2024-01-22T04:50:23.706 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout/ 2024-01-22T04:50:23.706 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-22T04:50:23.706 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout/ 2024-01-22T04:50:23.706 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-22T04:50:23.706 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout/ 2024-01-22T04:50:23.706 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 117465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-22T04:50:23.707 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1057969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfs.ko 2024-01-22T04:50:23.707 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv2.ko 2024-01-22T04:50:23.707 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 120265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv3.ko 2024-01-22T04:50:23.707 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 2042153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv4.ko 2024-01-22T04:50:23.707 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/ 2024-01-22T04:50:23.707 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/grace.ko 2024-01-22T04:50:23.707 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/nfs_acl.ko 2024-01-22T04:50:23.707 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd/ 2024-01-22T04:50:23.707 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1563929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd/nfsd.ko 2024-01-22T04:50:23.752 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2/ 2024-01-22T04:50:23.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 590713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2/nilfs2.ko 2024-01-22T04:50:23.752 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/ 2024-01-22T04:50:23.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-celtic.ko 2024-01-22T04:50:23.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-centeuro.ko 2024-01-22T04:50:23.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-croatian.ko 2024-01-22T04:50:23.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-cyrillic.ko 2024-01-22T04:50:23.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-gaelic.ko 2024-01-22T04:50:23.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-greek.ko 2024-01-22T04:50:23.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-iceland.ko 2024-01-22T04:50:23.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-inuit.ko 2024-01-22T04:50:23.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-roman.ko 2024-01-22T04:50:23.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-romanian.ko 2024-01-22T04:50:23.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-turkish.ko 2024-01-22T04:50:23.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_ascii.ko 2024-01-22T04:50:23.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1250.ko 2024-01-22T04:50:23.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1251.ko 2024-01-22T04:50:23.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1255.ko 2024-01-22T04:50:23.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp737.ko 2024-01-22T04:50:23.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp775.ko 2024-01-22T04:50:23.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp850.ko 2024-01-22T04:50:23.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp852.ko 2024-01-22T04:50:23.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp855.ko 2024-01-22T04:50:23.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp857.ko 2024-01-22T04:50:23.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp860.ko 2024-01-22T04:50:23.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp861.ko 2024-01-22T04:50:23.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp862.ko 2024-01-22T04:50:23.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp863.ko 2024-01-22T04:50:23.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp864.ko 2024-01-22T04:50:23.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp865.ko 2024-01-22T04:50:23.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp866.ko 2024-01-22T04:50:23.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp869.ko 2024-01-22T04:50:23.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp874.ko 2024-01-22T04:50:23.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 94137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp932.ko 2024-01-22T04:50:23.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 142673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp936.ko 2024-01-22T04:50:23.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 165745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp949.ko 2024-01-22T04:50:23.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 118121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp950.ko 2024-01-22T04:50:23.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_euc-jp.ko 2024-01-22T04:50:23.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-1.ko 2024-01-22T04:50:23.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-13.ko 2024-01-22T04:50:23.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-14.ko 2024-01-22T04:50:23.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-15.ko 2024-01-22T04:50:23.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-2.ko 2024-01-22T04:50:23.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-3.ko 2024-01-22T04:50:23.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-4.ko 2024-01-22T04:50:23.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-5.ko 2024-01-22T04:50:23.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-6.ko 2024-01-22T04:50:23.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-7.ko 2024-01-22T04:50:23.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-9.ko 2024-01-22T04:50:23.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-r.ko 2024-01-22T04:50:23.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-ru.ko 2024-01-22T04:50:23.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-u.ko 2024-01-22T04:50:23.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-22T04:50:23.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_utf8.ko 2024-01-22T04:50:23.757 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ntfs/ 2024-01-22T04:50:23.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 220553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ntfs/ntfs.ko 2024-01-22T04:50:23.757 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ 2024-01-22T04:50:23.757 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster/ 2024-01-22T04:50:23.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 244737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-22T04:50:23.757 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm/ 2024-01-22T04:50:23.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 440737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-22T04:50:23.757 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs/ 2024-01-22T04:50:23.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-22T04:50:23.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 2593521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2.ko 2024-01-22T04:50:23.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-22T04:50:23.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-22T04:50:23.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-22T04:50:23.758 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/omfs/ 2024-01-22T04:50:23.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/omfs/omfs.ko 2024-01-22T04:50:23.758 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs/ 2024-01-22T04:50:23.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 370697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs/overlay.ko 2024-01-22T04:50:23.758 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore/ 2024-01-22T04:50:23.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore/ramoops.ko 2024-01-22T04:50:23.758 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx4/ 2024-01-22T04:50:23.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx4/qnx4.ko 2024-01-22T04:50:23.758 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx6/ 2024-01-22T04:50:23.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx6/qnx6.ko 2024-01-22T04:50:23.758 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/ 2024-01-22T04:50:23.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/quota_tree.ko 2024-01-22T04:50:23.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/quota_v1.ko 2024-01-22T04:50:23.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/quota_v2.ko 2024-01-22T04:50:23.759 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs/ 2024-01-22T04:50:23.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 532025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs/reiserfs.ko 2024-01-22T04:50:23.759 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs/ 2024-01-22T04:50:23.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs/romfs.ko 2024-01-22T04:50:23.759 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/ 2024-01-22T04:50:23.759 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client/ 2024-01-22T04:50:23.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 2683249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client/cifs.ko 2024-01-22T04:50:23.759 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/ 2024-01-22T04:50:23.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_arc4.ko 2024-01-22T04:50:23.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_md4.ko 2024-01-22T04:50:23.759 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs/ 2024-01-22T04:50:23.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 134777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs/squashfs.ko 2024-01-22T04:50:23.759 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv/ 2024-01-22T04:50:23.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 91249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv/sysv.ko 2024-01-22T04:50:23.760 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/udf/ 2024-01-22T04:50:23.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 248425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/udf/udf.ko 2024-01-22T04:50:23.760 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs/ 2024-01-22T04:50:23.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 162537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs/ufs.ko 2024-01-22T04:50:23.760 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs/ 2024-01-22T04:50:23.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 4014433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs/xfs.ko 2024-01-22T04:50:23.760 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/ 2024-01-22T04:50:23.760 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/locking/ 2024-01-22T04:50:23.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/locking/locktorture.ko 2024-01-22T04:50:23.760 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/time/ 2024-01-22T04:50:23.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/time/test_udelay.ko 2024-01-22T04:50:23.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/torture.ko 2024-01-22T04:50:23.761 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ 2024-01-22T04:50:23.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crc-itu-t.ko 2024-01-22T04:50:23.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crc7.ko 2024-01-22T04:50:23.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crc8.ko 2024-01-22T04:50:23.761 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/ 2024-01-22T04:50:23.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libarc4.ko 2024-01-22T04:50:23.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libdes.ko 2024-01-22T04:50:23.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/interval_tree_test.ko 2024-01-22T04:50:23.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/libcrc32c.ko 2024-01-22T04:50:23.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lru_cache.ko 2024-01-22T04:50:23.761 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/ 2024-01-22T04:50:23.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4_compress.ko 2024-01-22T04:50:23.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4hc_compress.ko 2024-01-22T04:50:23.761 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/math/ 2024-01-22T04:50:23.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/math/cordic.ko 2024-01-22T04:50:23.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/memory-notifier-error-inject.ko 2024-01-22T04:50:23.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/notifier-error-inject.ko 2024-01-22T04:50:23.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/percpu_test.ko 2024-01-22T04:50:23.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/pm-notifier-error-inject.ko 2024-01-22T04:50:23.762 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6/ 2024-01-22T04:50:23.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 143353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6/raid6_pq.ko 2024-01-22T04:50:23.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/rbtree_test.ko 2024-01-22T04:50:23.762 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon/ 2024-01-22T04:50:23.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-22T04:50:23.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test-kstrtox.ko 2024-01-22T04:50:23.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test-string_helpers.ko 2024-01-22T04:50:23.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 4876633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_bpf.ko 2024-01-22T04:50:23.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_firmware.ko 2024-01-22T04:50:23.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_module.ko 2024-01-22T04:50:23.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_user_copy.ko 2024-01-22T04:50:23.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_bm.ko 2024-01-22T04:50:23.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_fsm.ko 2024-01-22T04:50:23.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_kmp.ko 2024-01-22T04:50:23.763 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/xz/ 2024-01-22T04:50:23.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/xz/xz_dec_test.ko 2024-01-22T04:50:23.763 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/mm/ 2024-01-22T04:50:23.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/mm/hwpoison-inject.ko 2024-01-22T04:50:23.763 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ 2024-01-22T04:50:23.763 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/ 2024-01-22T04:50:23.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/6lowpan.ko 2024-01-22T04:50:23.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_dest.ko 2024-01-22T04:50:23.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_fragment.ko 2024-01-22T04:50:23.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_hop.ko 2024-01-22T04:50:23.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-22T04:50:23.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_mobility.ko 2024-01-22T04:50:23.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_routing.ko 2024-01-22T04:50:23.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_udp.ko 2024-01-22T04:50:23.764 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/ 2024-01-22T04:50:23.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/garp.ko 2024-01-22T04:50:23.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/mrp.ko 2024-01-22T04:50:23.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/p8022.ko 2024-01-22T04:50:23.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/psnap.ko 2024-01-22T04:50:23.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/stp.ko 2024-01-22T04:50:23.764 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/8021q/ 2024-01-22T04:50:23.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 82593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/8021q/8021q.ko 2024-01-22T04:50:23.765 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/ 2024-01-22T04:50:23.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 198905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet.ko 2024-01-22T04:50:23.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_fd.ko 2024-01-22T04:50:23.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_rdma.ko 2024-01-22T04:50:23.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_virtio.ko 2024-01-22T04:50:23.765 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv/ 2024-01-22T04:50:23.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 649977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv/batman-adv.ko 2024-01-22T04:50:23.765 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/ 2024-01-22T04:50:23.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 65137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/br_netfilter.ko 2024-01-22T04:50:23.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 785817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/bridge.ko 2024-01-22T04:50:23.765 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ 2024-01-22T04:50:23.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-22T04:50:23.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-22T04:50:23.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-22T04:50:23.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-22T04:50:23.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-22T04:50:23.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-22T04:50:23.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-22T04:50:23.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-22T04:50:23.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-22T04:50:23.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-22T04:50:23.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-22T04:50:23.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-22T04:50:23.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-22T04:50:23.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-22T04:50:23.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-22T04:50:23.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-22T04:50:23.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-22T04:50:23.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-22T04:50:23.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-22T04:50:23.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-22T04:50:23.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtables.ko 2024-01-22T04:50:23.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-22T04:50:23.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-22T04:50:23.767 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ceph/ 2024-01-22T04:50:23.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1047033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ceph/libceph.ko 2024-01-22T04:50:23.767 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/core/ 2024-01-22T04:50:23.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 126041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/core/pktgen.ko 2024-01-22T04:50:23.767 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/ 2024-01-22T04:50:23.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 194529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp.ko 2024-01-22T04:50:23.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_diag.ko 2024-01-22T04:50:23.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv4.ko 2024-01-22T04:50:23.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv6.ko 2024-01-22T04:50:23.768 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/ 2024-01-22T04:50:23.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 390129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/dsa_core.ko 2024-01-22T04:50:23.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_brcm.ko 2024-01-22T04:50:23.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_dsa.ko 2024-01-22T04:50:23.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_none.ko 2024-01-22T04:50:23.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_trailer.ko 2024-01-22T04:50:23.768 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/hsr/ 2024-01-22T04:50:23.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 99881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/hsr/hsr.ko 2024-01-22T04:50:23.768 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ 2024-01-22T04:50:23.769 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan/ 2024-01-22T04:50:23.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-22T04:50:23.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 255849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154.ko 2024-01-22T04:50:23.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-22T04:50:23.769 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ 2024-01-22T04:50:23.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ah4.ko 2024-01-22T04:50:23.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/esp4.ko 2024-01-22T04:50:23.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/fou.ko 2024-01-22T04:50:23.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/gre.ko 2024-01-22T04:50:23.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/inet_diag.ko 2024-01-22T04:50:23.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_gre.ko 2024-01-22T04:50:23.771 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_tunnel.ko 2024-01-22T04:50:23.771 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_vti.ko 2024-01-22T04:50:23.771 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipcomp.ko 2024-01-22T04:50:23.771 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipip.ko 2024-01-22T04:50:23.771 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ 2024-01-22T04:50:23.771 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-22T04:50:23.771 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-22T04:50:23.771 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-22T04:50:23.771 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-22T04:50:23.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-22T04:50:23.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-22T04:50:23.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-22T04:50:23.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-22T04:50:23.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-22T04:50:23.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-22T04:50:23.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-22T04:50:23.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-22T04:50:23.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-22T04:50:23.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-22T04:50:23.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-22T04:50:23.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-22T04:50:23.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-22T04:50:23.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-22T04:50:23.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-22T04:50:23.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-22T04:50:23.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-22T04:50:23.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-22T04:50:23.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-22T04:50:23.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-22T04:50:23.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-22T04:50:23.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_bic.ko 2024-01-22T04:50:23.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_dctcp.ko 2024-01-22T04:50:23.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_diag.ko 2024-01-22T04:50:23.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_highspeed.ko 2024-01-22T04:50:23.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_htcp.ko 2024-01-22T04:50:23.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_hybla.ko 2024-01-22T04:50:23.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_illinois.ko 2024-01-22T04:50:23.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_lp.ko 2024-01-22T04:50:23.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_scalable.ko 2024-01-22T04:50:23.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_vegas.ko 2024-01-22T04:50:23.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_veno.ko 2024-01-22T04:50:23.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_westwood.ko 2024-01-22T04:50:23.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_yeah.ko 2024-01-22T04:50:23.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tunnel4.ko 2024-01-22T04:50:23.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_diag.ko 2024-01-22T04:50:23.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_tunnel.ko 2024-01-22T04:50:23.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-22T04:50:23.774 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ 2024-01-22T04:50:23.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ah6.ko 2024-01-22T04:50:23.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/esp6.ko 2024-01-22T04:50:23.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/fou6.ko 2024-01-22T04:50:23.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_gre.ko 2024-01-22T04:50:23.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 93977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_tunnel.ko 2024-01-22T04:50:23.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-22T04:50:23.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_vti.ko 2024-01-22T04:50:23.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ipcomp6.ko 2024-01-22T04:50:23.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/mip6.ko 2024-01-22T04:50:23.775 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ 2024-01-22T04:50:23.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-22T04:50:23.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-22T04:50:23.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-22T04:50:23.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-22T04:50:23.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-22T04:50:23.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-22T04:50:23.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-22T04:50:23.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-22T04:50:23.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-22T04:50:23.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-22T04:50:23.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-22T04:50:23.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-22T04:50:23.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-22T04:50:23.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-22T04:50:23.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-22T04:50:23.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-22T04:50:23.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-22T04:50:23.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-22T04:50:23.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-22T04:50:23.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-22T04:50:23.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-22T04:50:23.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-22T04:50:23.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-22T04:50:23.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-22T04:50:23.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-22T04:50:23.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 74921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/sit.ko 2024-01-22T04:50:23.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/tunnel6.ko 2024-01-22T04:50:23.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-22T04:50:23.777 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/key/ 2024-01-22T04:50:23.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 84433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/key/af_key.ko 2024-01-22T04:50:23.777 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/ 2024-01-22T04:50:23.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 125305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_core.ko 2024-01-22T04:50:23.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-22T04:50:23.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_eth.ko 2024-01-22T04:50:23.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip.ko 2024-01-22T04:50:23.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip6.ko 2024-01-22T04:50:23.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_netlink.ko 2024-01-22T04:50:23.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ppp.ko 2024-01-22T04:50:23.778 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/lapb/ 2024-01-22T04:50:23.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/lapb/lapb.ko 2024-01-22T04:50:23.778 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/llc/ 2024-01-22T04:50:23.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/llc/llc.ko 2024-01-22T04:50:23.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 268265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/llc/llc2.ko 2024-01-22T04:50:23.778 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154/ 2024-01-22T04:50:23.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 290441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154/mac802154.ko 2024-01-22T04:50:23.778 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mpls/ 2024-01-22T04:50:23.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mpls/mpls_gso.ko 2024-01-22T04:50:23.778 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ 2024-01-22T04:50:23.778 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ 2024-01-22T04:50:23.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 118801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set.ko 2024-01-22T04:50:23.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-22T04:50:23.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-22T04:50:23.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-22T04:50:23.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-22T04:50:23.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-22T04:50:23.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-22T04:50:23.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-22T04:50:23.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 112017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-22T04:50:23.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-22T04:50:23.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-22T04:50:23.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 112297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-22T04:50:23.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 112649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-22T04:50:23.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 110753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-22T04:50:23.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 113633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-22T04:50:23.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-22T04:50:23.780 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ 2024-01-22T04:50:23.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 412561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-22T04:50:23.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-22T04:50:23.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-22T04:50:23.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-22T04:50:23.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-22T04:50:23.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-22T04:50:23.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-22T04:50:23.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-22T04:50:23.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-22T04:50:23.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-22T04:50:23.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-22T04:50:23.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-22T04:50:23.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-22T04:50:23.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-22T04:50:23.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conncount.ko 2024-01-22T04:50:23.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 411489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack.ko 2024-01-22T04:50:23.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-22T04:50:23.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-22T04:50:23.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-22T04:50:23.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 118193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-22T04:50:23.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-22T04:50:23.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-22T04:50:23.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-22T04:50:23.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-22T04:50:23.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-22T04:50:23.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-22T04:50:23.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-22T04:50:23.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-22T04:50:23.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-22T04:50:23.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 91737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table.ko 2024-01-22T04:50:23.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-22T04:50:23.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_log_syslog.ko 2024-01-22T04:50:23.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 96545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat.ko 2024-01-22T04:50:23.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-22T04:50:23.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-22T04:50:23.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_irc.ko 2024-01-22T04:50:23.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_sip.ko 2024-01-22T04:50:23.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-22T04:50:23.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-22T04:50:23.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 614025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_tables.ko 2024-01-22T04:50:23.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink.ko 2024-01-22T04:50:23.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-22T04:50:23.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-22T04:50:23.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_log.ko 2024-01-22T04:50:23.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-22T04:50:23.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-22T04:50:23.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_chain_nat.ko 2024-01-22T04:50:23.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_compat.ko 2024-01-22T04:50:23.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_ct.ko 2024-01-22T04:50:23.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-22T04:50:23.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fib.ko 2024-01-22T04:50:23.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-22T04:50:23.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_hash.ko 2024-01-22T04:50:23.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_limit.ko 2024-01-22T04:50:23.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_log.ko 2024-01-22T04:50:23.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_masq.ko 2024-01-22T04:50:23.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_nat.ko 2024-01-22T04:50:23.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_numgen.ko 2024-01-22T04:50:23.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_osf.ko 2024-01-22T04:50:23.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_queue.ko 2024-01-22T04:50:23.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_redir.ko 2024-01-22T04:50:23.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject.ko 2024-01-22T04:50:23.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject_inet.ko 2024-01-22T04:50:23.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_socket.ko 2024-01-22T04:50:23.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_synproxy.ko 2024-01-22T04:50:23.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_tproxy.ko 2024-01-22T04:50:23.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/x_tables.ko 2024-01-22T04:50:23.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_AUDIT.ko 2024-01-22T04:50:23.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-22T04:50:23.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-22T04:50:23.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-22T04:50:23.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CT.ko 2024-01-22T04:50:23.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_DSCP.ko 2024-01-22T04:50:23.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HL.ko 2024-01-22T04:50:23.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HMARK.ko 2024-01-22T04:50:23.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-22T04:50:23.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LED.ko 2024-01-22T04:50:23.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LOG.ko 2024-01-22T04:50:23.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-22T04:50:23.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NETMAP.ko 2024-01-22T04:50:23.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFLOG.ko 2024-01-22T04:50:23.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-22T04:50:23.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_RATEEST.ko 2024-01-22T04:50:23.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-22T04:50:23.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_SECMARK.ko 2024-01-22T04:50:23.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-22T04:50:23.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-22T04:50:23.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TEE.ko 2024-01-22T04:50:23.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TPROXY.ko 2024-01-22T04:50:23.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TRACE.ko 2024-01-22T04:50:23.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_addrtype.ko 2024-01-22T04:50:23.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_bpf.ko 2024-01-22T04:50:23.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cgroup.ko 2024-01-22T04:50:23.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cluster.ko 2024-01-22T04:50:23.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_comment.ko 2024-01-22T04:50:23.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connbytes.ko 2024-01-22T04:50:23.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlabel.ko 2024-01-22T04:50:23.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlimit.ko 2024-01-22T04:50:23.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connmark.ko 2024-01-22T04:50:23.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_conntrack.ko 2024-01-22T04:50:23.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cpu.ko 2024-01-22T04:50:23.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dccp.ko 2024-01-22T04:50:23.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_devgroup.ko 2024-01-22T04:50:23.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dscp.ko 2024-01-22T04:50:23.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ecn.ko 2024-01-22T04:50:23.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_esp.ko 2024-01-22T04:50:23.788 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hashlimit.ko 2024-01-22T04:50:23.788 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_helper.ko 2024-01-22T04:50:23.788 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hl.ko 2024-01-22T04:50:23.788 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipcomp.ko 2024-01-22T04:50:23.788 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_iprange.ko 2024-01-22T04:50:23.788 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipvs.ko 2024-01-22T04:50:23.788 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_l2tp.ko 2024-01-22T04:50:23.788 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_length.ko 2024-01-22T04:50:23.788 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_limit.ko 2024-01-22T04:50:23.789 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mac.ko 2024-01-22T04:50:23.789 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mark.ko 2024-01-22T04:50:23.789 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_multiport.ko 2024-01-22T04:50:23.789 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nat.ko 2024-01-22T04:50:23.789 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nfacct.ko 2024-01-22T04:50:23.789 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_osf.ko 2024-01-22T04:50:23.789 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_owner.ko 2024-01-22T04:50:23.789 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_physdev.ko 2024-01-22T04:50:23.789 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_pkttype.ko 2024-01-22T04:50:23.789 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_policy.ko 2024-01-22T04:50:23.789 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_quota.ko 2024-01-22T04:50:23.789 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_rateest.ko 2024-01-22T04:50:23.789 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_realm.ko 2024-01-22T04:50:23.789 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_recent.ko 2024-01-22T04:50:23.790 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_sctp.ko 2024-01-22T04:50:23.790 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_set.ko 2024-01-22T04:50:23.790 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_socket.ko 2024-01-22T04:50:23.790 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_state.ko 2024-01-22T04:50:23.790 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_statistic.ko 2024-01-22T04:50:23.790 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_string.ko 2024-01-22T04:50:23.790 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_tcpmss.ko 2024-01-22T04:50:23.790 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_tcpudp.ko 2024-01-22T04:50:23.790 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_time.ko 2024-01-22T04:50:23.790 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_u32.ko 2024-01-22T04:50:23.790 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netlink/ 2024-01-22T04:50:23.790 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netlink/netlink_diag.ko 2024-01-22T04:50:23.791 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/nsh/ 2024-01-22T04:50:23.791 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/nsh/nsh.ko 2024-01-22T04:50:23.791 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/ 2024-01-22T04:50:23.791 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 383481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/openvswitch.ko 2024-01-22T04:50:23.791 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-geneve.ko 2024-01-22T04:50:23.791 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-gre.ko 2024-01-22T04:50:23.791 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-vxlan.ko 2024-01-22T04:50:23.791 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/packet/ 2024-01-22T04:50:23.791 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/packet/af_packet_diag.ko 2024-01-22T04:50:23.791 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/phonet/ 2024-01-22T04:50:23.791 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 112057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/phonet/phonet.ko 2024-01-22T04:50:23.791 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/phonet/pn_pep.ko 2024-01-22T04:50:23.791 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/ 2024-01-22T04:50:23.792 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 252953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds.ko 2024-01-22T04:50:23.792 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 164937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_rdma.ko 2024-01-22T04:50:23.792 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_tcp.ko 2024-01-22T04:50:23.792 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rxrpc/ 2024-01-22T04:50:23.792 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 818777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rxrpc/rxrpc.ko 2024-01-22T04:50:23.792 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/ 2024-01-22T04:50:23.792 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_csum.ko 2024-01-22T04:50:23.792 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_gact.ko 2024-01-22T04:50:23.792 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_ipt.ko 2024-01-22T04:50:23.792 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_mirred.ko 2024-01-22T04:50:23.792 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_nat.ko 2024-01-22T04:50:23.792 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_pedit.ko 2024-01-22T04:50:23.792 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_police.ko 2024-01-22T04:50:23.793 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_simple.ko 2024-01-22T04:50:23.793 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_skbedit.ko 2024-01-22T04:50:23.793 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_vlan.ko 2024-01-22T04:50:23.793 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_basic.ko 2024-01-22T04:50:23.793 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_bpf.ko 2024-01-22T04:50:23.793 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_cgroup.ko 2024-01-22T04:50:23.793 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_flow.ko 2024-01-22T04:50:23.793 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_fw.ko 2024-01-22T04:50:23.793 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_route.ko 2024-01-22T04:50:23.793 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_u32.ko 2024-01-22T04:50:23.793 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_cmp.ko 2024-01-22T04:50:23.793 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_ipset.ko 2024-01-22T04:50:23.793 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_meta.ko 2024-01-22T04:50:23.794 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_nbyte.ko 2024-01-22T04:50:23.794 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_text.ko 2024-01-22T04:50:23.794 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_u32.ko 2024-01-22T04:50:23.794 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_choke.ko 2024-01-22T04:50:23.794 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_codel.ko 2024-01-22T04:50:23.794 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_drr.ko 2024-01-22T04:50:23.794 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_fq.ko 2024-01-22T04:50:23.794 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_fq_codel.ko 2024-01-22T04:50:23.794 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_gred.ko 2024-01-22T04:50:23.794 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hfsc.ko 2024-01-22T04:50:23.794 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hhf.ko 2024-01-22T04:50:23.794 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_htb.ko 2024-01-22T04:50:23.794 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_ingress.ko 2024-01-22T04:50:23.794 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio.ko 2024-01-22T04:50:23.794 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio_lib.ko 2024-01-22T04:50:23.795 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_multiq.ko 2024-01-22T04:50:23.795 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_netem.ko 2024-01-22T04:50:23.795 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_pie.ko 2024-01-22T04:50:23.795 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_plug.ko 2024-01-22T04:50:23.795 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_prio.ko 2024-01-22T04:50:23.795 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_qfq.ko 2024-01-22T04:50:23.795 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_red.ko 2024-01-22T04:50:23.795 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfb.ko 2024-01-22T04:50:23.795 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfq.ko 2024-01-22T04:50:23.795 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_tbf.ko 2024-01-22T04:50:23.796 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_teql.ko 2024-01-22T04:50:23.796 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/ 2024-01-22T04:50:23.796 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 932169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp.ko 2024-01-22T04:50:23.796 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp_diag.ko 2024-01-22T04:50:23.796 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/ 2024-01-22T04:50:23.796 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/ 2024-01-22T04:50:23.796 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 336777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-22T04:50:23.796 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-22T04:50:23.796 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1518417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/sunrpc.ko 2024-01-22T04:50:23.796 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma/ 2024-01-22T04:50:23.796 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 708281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-22T04:50:23.796 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/ 2024-01-22T04:50:23.797 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/diag.ko 2024-01-22T04:50:23.797 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 866345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/tipc.ko 2024-01-22T04:50:23.797 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/unix/ 2024-01-22T04:50:23.797 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/unix/unix_diag.ko 2024-01-22T04:50:23.797 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/ 2024-01-22T04:50:23.797 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 86417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-22T04:50:23.797 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-22T04:50:23.797 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 98017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock.ko 2024-01-22T04:50:23.797 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-22T04:50:23.797 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-22T04:50:23.797 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/x25/ 2024-01-22T04:50:23.797 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 125409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/x25/x25.ko 2024-01-22T04:50:23.797 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/ 2024-01-22T04:50:23.797 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_algo.ko 2024-01-22T04:50:23.797 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-22T04:50:23.798 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 104161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_user.ko 2024-01-22T04:50:23.798 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/virt/ 2024-01-22T04:50:23.798 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/virt/lib/ 2024-01-22T04:50:23.798 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/virt/lib/irqbypass.ko 2024-01-22T04:50:23.798 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 641009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.alias 2024-01-22T04:50:23.798 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 625033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.alias.bin 2024-01-22T04:50:23.798 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7677 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin 2024-01-22T04:50:23.798 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23634 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin.alias.bin 2024-01-22T04:50:23.798 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9916 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin.bin 2024-01-22T04:50:23.798 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70653 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin.modinfo 2024-01-22T04:50:23.798 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 147734 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.dep 2024-01-22T04:50:23.798 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 234045 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.dep.bin 2024-01-22T04:50:23.798 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 210 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.devname 2024-01-22T04:50:23.798 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72797 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.order 2024-01-22T04:50:23.799 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 879 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.softdep 2024-01-22T04:50:23.799 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 255175 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.symbols 2024-01-22T04:50:23.799 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 309826 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.symbols.bin 2024-01-22T04:50:23.799 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/ 2024-01-22T04:50:23.799 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/share/ 2024-01-22T04:50:23.799 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/share/doc/ 2024-01-22T04:50:23.799 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/share/doc/linux-image-6.7.0-g06652275eb93/ 2024-01-22T04:50:23.799 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 172 2024-01-18 11:42 ./usr/share/doc/linux-image-6.7.0-g06652275eb93/changelog.Debian.gz 2024-01-22T04:50:23.799 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 691 2024-01-18 11:42 ./usr/share/doc/linux-image-6.7.0-g06652275eb93/copyright 2024-01-22T04:50:23.801 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-g06652275eb93 2024-01-22T04:50:23.801 INFO:teuthology.task.kernel:searching for kernel 6.7.0-g06652275eb93 2024-01-22T04:50:23.801 DEBUG:teuthology.orchestra.run.smithi049:> egrep '(submenu|menuentry.*6.7.0-g06652275eb93).*{' /boot/grub/grub.cfg 2024-01-22T04:50:23.808 INFO:teuthology.orchestra.run.smithi049.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-01-22T04:50:23.809 INFO:teuthology.orchestra.run.smithi049.stdout: menuentry 'Ubuntu, with Linux 6.7.0-g06652275eb93' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-g06652275eb93-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-01-22T04:50:23.809 INFO:teuthology.orchestra.run.smithi049.stdout: menuentry 'Ubuntu, with Linux 6.7.0-g06652275eb93 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-g06652275eb93-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-01-22T04:50:23.809 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-22T04:50:23.809 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.7.0-g06652275eb93 2024-01-22T04:50:23.809 DEBUG:teuthology.orchestra.run.smithi049:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-22T04:50:23.853 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi049.front.sepia.ceph.com to complete... 2024-01-22T04:50:24.568 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub' 2024-01-22T04:50:24.575 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-22T04:50:24.599 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2024-01-22T04:50:24.852 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-6.7.0-g06652275eb93 2024-01-22T04:50:24.864 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-6.7.0-g06652275eb93 2024-01-22T04:50:25.215 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-01-22T04:50:25.227 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-01-22T04:50:25.323 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-01-22T04:50:25.475 DEBUG:teuthology.orchestra.run.smithi110:> dpkg-deb -c /tmp/linux-image.deb 2024-01-22T04:50:25.485 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./ 2024-01-22T04:50:25.485 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./boot/ 2024-01-22T04:50:25.485 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 4444641 2024-01-18 11:42 ./boot/System.map-6.7.0-g06652275eb93 2024-01-22T04:50:25.498 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 170149 2024-01-18 11:42 ./boot/config-6.7.0-g06652275eb93 2024-01-22T04:50:25.499 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11441152 2024-01-18 11:42 ./boot/vmlinuz-6.7.0-g06652275eb93 2024-01-22T04:50:25.520 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/ 2024-01-22T04:50:25.520 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/ 2024-01-22T04:50:25.520 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/postinst.d/ 2024-01-22T04:50:25.520 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/postrm.d/ 2024-01-22T04:50:25.520 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/preinst.d/ 2024-01-22T04:50:25.521 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/prerm.d/ 2024-01-22T04:50:25.521 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/ 2024-01-22T04:50:25.521 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/ 2024-01-22T04:50:25.521 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/ 2024-01-22T04:50:25.521 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/ 2024-01-22T04:50:25.521 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/ 2024-01-22T04:50:25.521 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/ 2024-01-22T04:50:25.521 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/ 2024-01-22T04:50:25.521 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 490345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-22T04:50:25.525 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-22T04:50:25.525 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-22T04:50:25.525 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-22T04:50:25.525 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 93113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-22T04:50:25.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 106729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-22T04:50:25.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 152241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-22T04:50:25.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-22T04:50:25.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-22T04:50:25.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 83889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-22T04:50:25.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-22T04:50:25.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-22T04:50:25.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-22T04:50:25.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-22T04:50:25.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-22T04:50:25.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-22T04:50:25.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-22T04:50:25.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-22T04:50:25.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-22T04:50:25.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-22T04:50:25.527 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/ 2024-01-22T04:50:25.527 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/ 2024-01-22T04:50:25.527 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce/ 2024-01-22T04:50:25.527 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-22T04:50:25.527 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpuid.ko 2024-01-22T04:50:25.527 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/msr.ko 2024-01-22T04:50:25.527 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/ 2024-01-22T04:50:25.527 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 353705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-22T04:50:25.527 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 881649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-22T04:50:25.527 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 2276625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm.ko 2024-01-22T04:50:25.597 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/ 2024-01-22T04:50:25.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/af_alg.ko 2024-01-22T04:50:25.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/algif_hash.ko 2024-01-22T04:50:25.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/algif_skcipher.ko 2024-01-22T04:50:25.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/ansi_cprng.ko 2024-01-22T04:50:25.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/anubis.ko 2024-01-22T04:50:25.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/arc4.ko 2024-01-22T04:50:25.598 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/asymmetric_keys/ 2024-01-22T04:50:25.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-22T04:50:25.598 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/ 2024-01-22T04:50:25.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_memcpy.ko 2024-01-22T04:50:25.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_pq.ko 2024-01-22T04:50:25.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-22T04:50:25.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_tx.ko 2024-01-22T04:50:25.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_xor.ko 2024-01-22T04:50:25.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/raid6test.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/authenc.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/authencesn.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/blake2b_generic.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_common.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_generic.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/camellia_generic.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast5_generic.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast6_generic.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast_common.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/ccm.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cmac.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crc32_generic.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cryptd.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_engine.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_simd.ko 2024-01-22T04:50:25.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_user.ko 2024-01-22T04:50:25.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cts.ko 2024-01-22T04:50:25.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/des_generic.ko 2024-01-22T04:50:25.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/dh_generic.ko 2024-01-22T04:50:25.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/echainiv.ko 2024-01-22T04:50:25.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/essiv.ko 2024-01-22T04:50:25.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/fcrypt.ko 2024-01-22T04:50:25.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/khazad.ko 2024-01-22T04:50:25.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/lrw.ko 2024-01-22T04:50:25.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4.ko 2024-01-22T04:50:25.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4hc.ko 2024-01-22T04:50:25.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/md4.ko 2024-01-22T04:50:25.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/michael_mic.ko 2024-01-22T04:50:25.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcbc.ko 2024-01-22T04:50:25.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcrypt.ko 2024-01-22T04:50:25.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/rmd160.ko 2024-01-22T04:50:25.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/seed.ko 2024-01-22T04:50:25.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/serpent_generic.ko 2024-01-22T04:50:25.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 149481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/tcrypt.ko 2024-01-22T04:50:25.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/tea.ko 2024-01-22T04:50:25.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_common.ko 2024-01-22T04:50:25.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_generic.ko 2024-01-22T04:50:25.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/vmac.ko 2024-01-22T04:50:25.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/wp512.ko 2024-01-22T04:50:25.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xcbc.ko 2024-01-22T04:50:25.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xor.ko 2024-01-22T04:50:25.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xts.ko 2024-01-22T04:50:25.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xxhash_generic.ko 2024-01-22T04:50:25.602 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ 2024-01-22T04:50:25.602 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/ 2024-01-22T04:50:25.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_extlog.ko 2024-01-22T04:50:25.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-22T04:50:25.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_pad.ko 2024-01-22T04:50:25.602 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/apei/ 2024-01-22T04:50:25.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/apei/einj.ko 2024-01-22T04:50:25.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/ec_sys.ko 2024-01-22T04:50:25.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/platform_profile.ko 2024-01-22T04:50:25.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbs.ko 2024-01-22T04:50:25.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbshc.ko 2024-01-22T04:50:25.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 104729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/video.ko 2024-01-22T04:50:25.602 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/acard-ahci.ko 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ahci.ko 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ahci_platform.ko 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 88401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/libahci.ko 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/libahci_platform.ko 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_acpi.ko 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ali.ko 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_amd.ko 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_artop.ko 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atiixp.ko 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atp867x.ko 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd640.ko 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd64x.ko 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cypress.ko 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_efar.ko 2024-01-22T04:50:25.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt366.ko 2024-01-22T04:50:25.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt37x.ko 2024-01-22T04:50:25.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-22T04:50:25.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-22T04:50:25.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it8213.ko 2024-01-22T04:50:25.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it821x.ko 2024-01-22T04:50:25.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_jmicron.ko 2024-01-22T04:50:25.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_legacy.ko 2024-01-22T04:50:25.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_marvell.ko 2024-01-22T04:50:25.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_mpiix.ko 2024-01-22T04:50:25.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_netcell.ko 2024-01-22T04:50:25.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ninja32.ko 2024-01-22T04:50:25.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87410.ko 2024-01-22T04:50:25.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87415.ko 2024-01-22T04:50:25.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_oldpiix.ko 2024-01-22T04:50:25.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_opti.ko 2024-01-22T04:50:25.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_optidma.ko 2024-01-22T04:50:25.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pcmcia.ko 2024-01-22T04:50:25.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-22T04:50:25.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-22T04:50:25.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_piccolo.ko 2024-01-22T04:50:25.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_radisys.ko 2024-01-22T04:50:25.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_rdc.ko 2024-01-22T04:50:25.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_rz1000.ko 2024-01-22T04:50:25.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sch.ko 2024-01-22T04:50:25.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_serverworks.ko 2024-01-22T04:50:25.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sil680.ko 2024-01-22T04:50:25.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sl82c105.ko 2024-01-22T04:50:25.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_triflex.ko 2024-01-22T04:50:25.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_via.ko 2024-01-22T04:50:25.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pdc_adma.ko 2024-01-22T04:50:25.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_inic162x.ko 2024-01-22T04:50:25.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 83345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_mv.ko 2024-01-22T04:50:25.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_nv.ko 2024-01-22T04:50:25.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_promise.ko 2024-01-22T04:50:25.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_qstor.ko 2024-01-22T04:50:25.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil.ko 2024-01-22T04:50:25.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil24.ko 2024-01-22T04:50:25.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sis.ko 2024-01-22T04:50:25.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_svw.ko 2024-01-22T04:50:25.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sx4.ko 2024-01-22T04:50:25.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_uli.ko 2024-01-22T04:50:25.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_via.ko 2024-01-22T04:50:25.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_vsc.ko 2024-01-22T04:50:25.607 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay/ 2024-01-22T04:50:25.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay/ks0108.ko 2024-01-22T04:50:25.607 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma/ 2024-01-22T04:50:25.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 124473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma/bcma.ko 2024-01-22T04:50:25.607 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/ 2024-01-22T04:50:25.607 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe/ 2024-01-22T04:50:25.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 113753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe/aoe.ko 2024-01-22T04:50:25.607 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd/ 2024-01-22T04:50:25.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 965305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd/drbd.ko 2024-01-22T04:50:25.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 173353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/floppy.ko 2024-01-22T04:50:25.608 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx/ 2024-01-22T04:50:25.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 94297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-22T04:50:25.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 116321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/nbd.ko 2024-01-22T04:50:25.608 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk/ 2024-01-22T04:50:25.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 110737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk/null_blk.ko 2024-01-22T04:50:25.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 98281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/pktcdvd.ko 2024-01-22T04:50:25.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 263769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/rbd.ko 2024-01-22T04:50:25.608 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback/ 2024-01-22T04:50:25.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 98185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-22T04:50:25.608 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram/ 2024-01-22T04:50:25.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram/zram.ko 2024-01-22T04:50:25.608 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ 2024-01-22T04:50:25.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/applicom.ko 2024-01-22T04:50:25.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hangcheck-timer.ko 2024-01-22T04:50:25.609 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/ 2024-01-22T04:50:25.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-22T04:50:25.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-22T04:50:25.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-22T04:50:25.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/via-rng.ko 2024-01-22T04:50:25.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-22T04:50:25.609 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ 2024-01-22T04:50:25.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-22T04:50:25.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 148609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-22T04:50:25.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-22T04:50:25.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 139313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-22T04:50:25.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-22T04:50:25.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-22T04:50:25.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/lp.ko 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave/ 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 84097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave/mwave.ko 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/nvram.ko 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ppdev.ko 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tlclk.ko 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/ 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/ 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-22T04:50:25.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-22T04:50:25.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-22T04:50:25.611 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/ 2024-01-22T04:50:25.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-palmas.ko 2024-01-22T04:50:25.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-si5351.ko 2024-01-22T04:50:25.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-twl6040.ko 2024-01-22T04:50:25.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-wm831x.ko 2024-01-22T04:50:25.611 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/ 2024-01-22T04:50:25.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-22T04:50:25.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-22T04:50:25.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-22T04:50:25.611 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ 2024-01-22T04:50:25.611 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ 2024-01-22T04:50:25.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-22T04:50:25.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 246841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp.ko 2024-01-22T04:50:25.612 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/ 2024-01-22T04:50:25.612 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/ 2024-01-22T04:50:25.612 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-22T04:50:25.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 517033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-22T04:50:25.612 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-22T04:50:25.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-22T04:50:25.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-aes.ko 2024-01-22T04:50:25.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-sha.ko 2024-01-22T04:50:25.612 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio/ 2024-01-22T04:50:25.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-22T04:50:25.613 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca/ 2024-01-22T04:50:25.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca/dca.ko 2024-01-22T04:50:25.613 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ 2024-01-22T04:50:25.613 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw/ 2024-01-22T04:50:25.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-22T04:50:25.613 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat/ 2024-01-22T04:50:25.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 122569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-22T04:50:25.613 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/ 2024-01-22T04:50:25.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 79953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/amd64_edac.ko 2024-01-22T04:50:25.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/e752x_edac.ko 2024-01-22T04:50:25.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 63617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/edac_mce_amd.ko 2024-01-22T04:50:25.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3000_edac.ko 2024-01-22T04:50:25.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3200_edac.ko 2024-01-22T04:50:25.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5100_edac.ko 2024-01-22T04:50:25.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5400_edac.ko 2024-01-22T04:50:25.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7300_edac.ko 2024-01-22T04:50:25.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7core_edac.ko 2024-01-22T04:50:25.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i82975x_edac.ko 2024-01-22T04:50:25.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/ie31200_edac.ko 2024-01-22T04:50:25.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/sb_edac.ko 2024-01-22T04:50:25.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/x38_edac.ko 2024-01-22T04:50:25.614 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/ 2024-01-22T04:50:25.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-gpio.ko 2024-01-22T04:50:25.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-max14577.ko 2024-01-22T04:50:25.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-max77693.ko 2024-01-22T04:50:25.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-max8997.ko 2024-01-22T04:50:25.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-palmas.ko 2024-01-22T04:50:25.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-22T04:50:25.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-22T04:50:25.615 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/ 2024-01-22T04:50:25.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-22T04:50:25.615 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/efi/ 2024-01-22T04:50:25.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-22T04:50:25.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-22T04:50:25.615 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/ 2024-01-22T04:50:25.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-22T04:50:25.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-22T04:50:25.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-arizona.ko 2024-01-22T04:50:25.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-da9052.ko 2024-01-22T04:50:25.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-da9055.ko 2024-01-22T04:50:25.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-dln2.ko 2024-01-22T04:50:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 77849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-22T04:50:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-generic.ko 2024-01-22T04:50:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-ich.ko 2024-01-22T04:50:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-22T04:50:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-kempld.ko 2024-01-22T04:50:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-22T04:50:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-max7300.ko 2024-01-22T04:50:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-max730x.ko 2024-01-22T04:50:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-max732x.ko 2024-01-22T04:50:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-22T04:50:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-22T04:50:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-22T04:50:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-22T04:50:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-sch.ko 2024-01-22T04:50:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-22T04:50:25.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-22T04:50:25.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-22T04:50:25.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-22T04:50:25.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-22T04:50:25.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-vx855.ko 2024-01-22T04:50:25.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-22T04:50:25.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-22T04:50:25.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-22T04:50:25.617 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/ 2024-01-22T04:50:25.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-a4tech.ko 2024-01-22T04:50:25.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-apple.ko 2024-01-22T04:50:25.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-appleir.ko 2024-01-22T04:50:25.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-aureal.ko 2024-01-22T04:50:25.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-axff.ko 2024-01-22T04:50:25.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-belkin.ko 2024-01-22T04:50:25.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-cherry.ko 2024-01-22T04:50:25.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-chicony.ko 2024-01-22T04:50:25.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-cp2112.ko 2024-01-22T04:50:25.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-cypress.ko 2024-01-22T04:50:25.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-dr.ko 2024-01-22T04:50:25.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elecom.ko 2024-01-22T04:50:25.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elo.ko 2024-01-22T04:50:25.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-emsff.ko 2024-01-22T04:50:25.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ezkey.ko 2024-01-22T04:50:25.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gaff.ko 2024-01-22T04:50:25.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-generic.ko 2024-01-22T04:50:25.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gt683r.ko 2024-01-22T04:50:25.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gyration.ko 2024-01-22T04:50:25.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-22T04:50:25.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-22T04:50:25.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtekff.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-hyperv.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-icade.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-kensington.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-keytouch.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-kye.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lcpower.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-led.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lenovo.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lg-g15.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-magicmouse.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-microsoft.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-monterey.ko 2024-01-22T04:50:25.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-multitouch.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ntrig.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ortek.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-penmount.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-petalynx.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-picolcd.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-pl.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-plantronics.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-primax.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-rmi.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-common.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-22T04:50:25.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-22T04:50:25.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-22T04:50:25.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-22T04:50:25.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-22T04:50:25.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat.ko 2024-01-22T04:50:25.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-saitek.ko 2024-01-22T04:50:25.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-samsung.ko 2024-01-22T04:50:25.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-22T04:50:25.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sjoy.ko 2024-01-22T04:50:25.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sony.ko 2024-01-22T04:50:25.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-speedlink.ko 2024-01-22T04:50:25.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-steelseries.ko 2024-01-22T04:50:25.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sunplus.ko 2024-01-22T04:50:25.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-22T04:50:25.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tivo.ko 2024-01-22T04:50:25.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tmff.ko 2024-01-22T04:50:25.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-topseed.ko 2024-01-22T04:50:25.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-twinhan.ko 2024-01-22T04:50:25.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-uclogic.ko 2024-01-22T04:50:25.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-waltop.ko 2024-01-22T04:50:25.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 143473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-wiimote.ko 2024-01-22T04:50:25.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-xinmo.ko 2024-01-22T04:50:25.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zpff.ko 2024-01-22T04:50:25.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zydacron.ko 2024-01-22T04:50:25.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 269281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid.ko 2024-01-22T04:50:25.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/uhid.ko 2024-01-22T04:50:25.624 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/ 2024-01-22T04:50:25.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-22T04:50:25.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-22T04:50:25.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-22T04:50:25.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 217873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/wacom.ko 2024-01-22T04:50:25.625 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/ 2024-01-22T04:50:25.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 64201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_balloon.ko 2024-01-22T04:50:25.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_utils.ko 2024-01-22T04:50:25.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 305321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_vmbus.ko 2024-01-22T04:50:25.625 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ 2024-01-22T04:50:25.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru.ko 2024-01-22T04:50:25.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru3.ko 2024-01-22T04:50:25.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-22T04:50:25.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7414.ko 2024-01-22T04:50:25.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7418.ko 2024-01-22T04:50:25.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adc128d818.ko 2024-01-22T04:50:25.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1025.ko 2024-01-22T04:50:25.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 97977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1026.ko 2024-01-22T04:50:25.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1029.ko 2024-01-22T04:50:25.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1031.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm9240.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ads7828.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7410.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7411.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 74409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7462.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7470.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7475.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7x10.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/amc6821.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/applesmc.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asb100.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asc7621.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/atxp1.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/coretemp.ko 2024-01-22T04:50:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 99601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dme1737.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds1621.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds620.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc1403.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc2103.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc6w201.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71805f.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 94689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71882fg.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f75375s.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fam15h_power.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fschmd.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g760a.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g762.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl518sm.ko 2024-01-22T04:50:25.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl520sm.ko 2024-01-22T04:50:25.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/hih6130.ko 2024-01-22T04:50:25.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-22T04:50:25.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5500_temp.ko 2024-01-22T04:50:25.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5k_amb.ko 2024-01-22T04:50:25.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmaem.ko 2024-01-22T04:50:25.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmpex.ko 2024-01-22T04:50:25.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina209.ko 2024-01-22T04:50:25.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina2xx.ko 2024-01-22T04:50:25.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 130449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/it87.ko 2024-01-22T04:50:25.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/jc42.ko 2024-01-22T04:50:25.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k10temp.ko 2024-01-22T04:50:25.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k8temp.ko 2024-01-22T04:50:25.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lineage-pem.ko 2024-01-22T04:50:25.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm63.ko 2024-01-22T04:50:25.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm73.ko 2024-01-22T04:50:25.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm75.ko 2024-01-22T04:50:25.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm77.ko 2024-01-22T04:50:25.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm78.ko 2024-01-22T04:50:25.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm80.ko 2024-01-22T04:50:25.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm83.ko 2024-01-22T04:50:25.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm85.ko 2024-01-22T04:50:25.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm87.ko 2024-01-22T04:50:25.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm90.ko 2024-01-22T04:50:25.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm92.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 108841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm93.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95234.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95241.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95245.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc2945.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4151.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4215.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4222.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4245.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4260.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4261.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max16065.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1619.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1668.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max197.ko 2024-01-22T04:50:25.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6639.ko 2024-01-22T04:50:25.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6650.ko 2024-01-22T04:50:25.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6697.ko 2024-01-22T04:50:25.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-22T04:50:25.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/mcp3021.ko 2024-01-22T04:50:25.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-22T04:50:25.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6683.ko 2024-01-22T04:50:25.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 119689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775-core.ko 2024-01-22T04:50:25.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775.ko 2024-01-22T04:50:25.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct7802.ko 2024-01-22T04:50:25.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 82337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87360.ko 2024-01-22T04:50:25.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87427.ko 2024-01-22T04:50:25.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pcf8591.ko 2024-01-22T04:50:25.631 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ 2024-01-22T04:50:25.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-22T04:50:25.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-22T04:50:25.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-22T04:50:25.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-22T04:50:25.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-22T04:50:25.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-22T04:50:25.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-22T04:50:25.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 82577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-22T04:50:25.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-22T04:50:25.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-22T04:50:25.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-22T04:50:25.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-22T04:50:25.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/powr1220.ko 2024-01-22T04:50:25.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5627.ko 2024-01-22T04:50:25.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5636.ko 2024-01-22T04:50:25.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-22T04:50:25.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht15.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht21.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/shtc1.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sis5595.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47b397.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m1.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m192.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/thmc50.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp102.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp103.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp401.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp421.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via-cputemp.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via686a.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt1211.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt8231.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627ehf.ko 2024-01-22T04:50:25.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627hf.ko 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83781d.ko 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 63225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83791d.ko 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83792d.ko 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 101473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83793.ko 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 119505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83795.ko 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l785ts.ko 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l786ng.ko 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/ 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/ 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/ 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-22T04:50:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-22T04:50:25.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-22T04:50:25.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-22T04:50:25.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-22T04:50:25.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-22T04:50:25.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-22T04:50:25.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-22T04:50:25.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-22T04:50:25.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-22T04:50:25.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-22T04:50:25.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-22T04:50:25.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-22T04:50:25.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-22T04:50:25.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-22T04:50:25.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-22T04:50:25.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-22T04:50:25.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-22T04:50:25.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-22T04:50:25.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-22T04:50:25.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-22T04:50:25.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-22T04:50:25.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-mux.ko 2024-01-22T04:50:25.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-smbus.ko 2024-01-22T04:50:25.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-stub.ko 2024-01-22T04:50:25.637 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/ 2024-01-22T04:50:25.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-22T04:50:25.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-22T04:50:25.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-22T04:50:25.637 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 273609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 883681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_core.ko 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 324329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 97921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 282601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/ 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 493217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4/ 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 420561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5/ 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 741449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-22T04:50:25.638 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca/ 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 296881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 153801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/usnic/ 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 168969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 263081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser/ 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert/ 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 111425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp/ 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 128753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt/ 2024-01-22T04:50:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 129529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-22T04:50:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/ 2024-01-22T04:50:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/evbug.ko 2024-01-22T04:50:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/ff-memless.ko 2024-01-22T04:50:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/ 2024-01-22T04:50:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-22T04:50:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-22T04:50:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/gameport.ko 2024-01-22T04:50:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/joydev.ko 2024-01-22T04:50:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/ 2024-01-22T04:50:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-22T04:50:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-22T04:50:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-22T04:50:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-22T04:50:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-22T04:50:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/lm8323.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/lm8333.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/qt1070.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/qt2160.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/stowaway.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-22T04:50:25.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/matrix-keymap.ko 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/ 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/appletouch.ko 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/bcm5974.ko 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 123417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/cyapatp.ko 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 335953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/psmouse.ko 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/sermouse.ko 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4/ 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 109873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-22T04:50:25.642 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/ 2024-01-22T04:50:25.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/altera_ps2.ko 2024-01-22T04:50:25.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/arc_ps2.ko 2024-01-22T04:50:25.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/ct82c710.ko 2024-01-22T04:50:25.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-22T04:50:25.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/parkbd.ko 2024-01-22T04:50:25.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/pcips2.ko 2024-01-22T04:50:25.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/ps2mult.ko 2024-01-22T04:50:25.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/serio_raw.ko 2024-01-22T04:50:25.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/serport.ko 2024-01-22T04:50:25.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/sparse-keymap.ko 2024-01-22T04:50:25.643 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/ 2024-01-22T04:50:25.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-88pm860x.ko 2024-01-22T04:50:25.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-adp5520.ko 2024-01-22T04:50:25.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-bd2802.ko 2024-01-22T04:50:25.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-blinkm.ko 2024-01-22T04:50:25.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-da903x.ko 2024-01-22T04:50:25.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-da9052.ko 2024-01-22T04:50:25.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-gpio.ko 2024-01-22T04:50:25.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3530.ko 2024-01-22T04:50:25.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3533.ko 2024-01-22T04:50:25.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm355x.ko 2024-01-22T04:50:25.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3642.ko 2024-01-22T04:50:25.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lp3944.ko 2024-01-22T04:50:25.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lp8788.ko 2024-01-22T04:50:25.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-max8997.ko 2024-01-22T04:50:25.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-mc13783.ko 2024-01-22T04:50:25.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-22T04:50:25.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-pca9532.ko 2024-01-22T04:50:25.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-pca955x.ko 2024-01-22T04:50:25.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-pca963x.ko 2024-01-22T04:50:25.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-ss4200.ko 2024-01-22T04:50:25.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-tca6507.ko 2024-01-22T04:50:25.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-22T04:50:25.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-wm8350.ko 2024-01-22T04:50:25.645 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ 2024-01-22T04:50:25.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-22T04:50:25.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-22T04:50:25.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-22T04:50:25.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-22T04:50:25.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-22T04:50:25.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-22T04:50:25.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-22T04:50:25.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-22T04:50:25.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-22T04:50:25.646 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/ 2024-01-22T04:50:25.646 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache/ 2024-01-22T04:50:25.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 647193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache/bcache.ko 2024-01-22T04:50:25.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-bio-prison.ko 2024-01-22T04:50:25.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 93409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-bufio.ko 2024-01-22T04:50:25.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache-smq.ko 2024-01-22T04:50:25.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 155897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache.ko 2024-01-22T04:50:25.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 107257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-crypt.ko 2024-01-22T04:50:25.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-delay.ko 2024-01-22T04:50:25.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-era.ko 2024-01-22T04:50:25.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-flakey.ko 2024-01-22T04:50:25.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-log-userspace.ko 2024-01-22T04:50:25.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-log.ko 2024-01-22T04:50:25.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-mirror.ko 2024-01-22T04:50:25.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-multipath.ko 2024-01-22T04:50:25.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-queue-length.ko 2024-01-22T04:50:25.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-raid.ko 2024-01-22T04:50:25.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-region-hash.ko 2024-01-22T04:50:25.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-round-robin.ko 2024-01-22T04:50:25.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-service-time.ko 2024-01-22T04:50:25.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 109529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-snapshot.ko 2024-01-22T04:50:25.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-switch.ko 2024-01-22T04:50:25.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 181865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-thin-pool.ko 2024-01-22T04:50:25.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-verity.ko 2024-01-22T04:50:25.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-zero.ko 2024-01-22T04:50:25.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/faulty.ko 2024-01-22T04:50:25.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/linear.ko 2024-01-22T04:50:25.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/multipath.ko 2024-01-22T04:50:25.648 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data/ 2024-01-22T04:50:25.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 199937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-22T04:50:25.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid0.ko 2024-01-22T04:50:25.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 113001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid1.ko 2024-01-22T04:50:25.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 158657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid10.ko 2024-01-22T04:50:25.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 393777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid456.ko 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/ 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/ 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 178137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptbase.ko 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 63321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptctl.ko 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptfc.ko 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptlan.ko 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 123321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptsas.ko 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptscsih.ko 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptspi.ko 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/ 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/88pm800.ko 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/88pm805.ko 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/88pm80x.ko 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/arizona-i2c.ko 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 123721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/arizona.ko 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/bcm590xx.ko 2024-01-22T04:50:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-22T04:50:25.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/dln2.ko 2024-01-22T04:50:25.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/janz-cmodio.ko 2024-01-22T04:50:25.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/kempld-core.ko 2024-01-22T04:50:25.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lm3533-core.ko 2024-01-22T04:50:25.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-22T04:50:25.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lp3943.ko 2024-01-22T04:50:25.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_ich.ko 2024-01-22T04:50:25.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_sch.ko 2024-01-22T04:50:25.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/max8907.ko 2024-01-22T04:50:25.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-22T04:50:25.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-22T04:50:25.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/menf21bmc.ko 2024-01-22T04:50:25.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-22T04:50:25.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-22T04:50:25.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/pcf50633.ko 2024-01-22T04:50:25.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-22T04:50:25.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/retu-mfd.ko 2024-01-22T04:50:25.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/si476x-core.ko 2024-01-22T04:50:25.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/sm501.ko 2024-01-22T04:50:25.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-22T04:50:25.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/tps65010.ko 2024-01-22T04:50:25.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/tps6507x.ko 2024-01-22T04:50:25.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/viperboard.ko 2024-01-22T04:50:25.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/vx855.ko 2024-01-22T04:50:25.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/wl1273-core.ko 2024-01-22T04:50:25.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/wm8994.ko 2024-01-22T04:50:25.652 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ 2024-01-22T04:50:25.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-22T04:50:25.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ad525x_dpot.ko 2024-01-22T04:50:25.652 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl/ 2024-01-22T04:50:25.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-22T04:50:25.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds9802als.ko 2024-01-22T04:50:25.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds990x.ko 2024-01-22T04:50:25.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/bh1770glc.ko 2024-01-22T04:50:25.652 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/c2port/ 2024-01-22T04:50:25.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-22T04:50:25.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/c2port/core.ko 2024-01-22T04:50:25.652 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710/ 2024-01-22T04:50:25.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710/cb710.ko 2024-01-22T04:50:25.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ds1682.ko 2024-01-22T04:50:25.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/dummy-irq.ko 2024-01-22T04:50:25.653 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/echo/ 2024-01-22T04:50:25.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/echo/echo.ko 2024-01-22T04:50:25.653 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/ 2024-01-22T04:50:25.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/at24.ko 2024-01-22T04:50:25.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-22T04:50:25.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/max6875.ko 2024-01-22T04:50:25.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/enclosure.ko 2024-01-22T04:50:25.653 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/genwqe/ 2024-01-22T04:50:25.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 152201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-22T04:50:25.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/hmc6352.ko 2024-01-22T04:50:25.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/hpilo.ko 2024-01-22T04:50:25.653 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ibmasm/ 2024-01-22T04:50:25.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-22T04:50:25.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ics932s401.ko 2024-01-22T04:50:25.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29003.ko 2024-01-22T04:50:25.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29020.ko 2024-01-22T04:50:25.654 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/ 2024-01-22T04:50:25.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-22T04:50:25.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-22T04:50:25.654 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/ 2024-01-22T04:50:25.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-me.ko 2024-01-22T04:50:25.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-txe.ko 2024-01-22T04:50:25.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 313641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei.ko 2024-01-22T04:50:25.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/phantom.ko 2024-01-22T04:50:25.654 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ti-st/ 2024-01-22T04:50:25.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 74377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-22T04:50:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_7xx1.ko 2024-01-22T04:50:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_core.ko 2024-01-22T04:50:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tsl2550.ko 2024-01-22T04:50:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_balloon.ko 2024-01-22T04:50:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci/ 2024-01-22T04:50:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 183609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-22T04:50:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ 2024-01-22T04:50:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding/ 2024-01-22T04:50:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 490849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding/bonding.ko 2024-01-22T04:50:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/ 2024-01-22T04:50:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53/ 2024-01-22T04:50:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 106033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-22T04:50:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-22T04:50:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-22T04:50:25.656 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-22T04:50:25.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 455065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-22T04:50:25.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dummy.ko 2024-01-22T04:50:25.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/eql.ko 2024-01-22T04:50:25.656 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ 2024-01-22T04:50:25.656 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/ 2024-01-22T04:50:25.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-22T04:50:25.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-22T04:50:25.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 130553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-22T04:50:25.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-22T04:50:25.656 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/ 2024-01-22T04:50:25.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-22T04:50:25.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-22T04:50:25.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-22T04:50:25.657 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 99049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-22T04:50:25.657 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec/ 2024-01-22T04:50:25.657 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-22T04:50:25.657 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere/ 2024-01-22T04:50:25.657 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-22T04:50:25.657 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon/ 2024-01-22T04:50:25.657 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-22T04:50:25.657 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera/ 2024-01-22T04:50:25.657 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-22T04:50:25.657 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/ 2024-01-22T04:50:25.657 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-22T04:50:25.657 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-22T04:50:25.658 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 87297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-22T04:50:25.658 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/ 2024-01-22T04:50:25.658 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-22T04:50:25.658 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 97337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-22T04:50:25.658 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-22T04:50:25.658 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-22T04:50:25.658 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-22T04:50:25.658 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 90345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-22T04:50:25.658 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-22T04:50:25.658 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-22T04:50:25.658 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-22T04:50:25.658 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/ 2024-01-22T04:50:25.658 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-22T04:50:25.658 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 176761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-22T04:50:25.658 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-22T04:50:25.659 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1421529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-22T04:50:25.748 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 128569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-22T04:50:25.748 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-22T04:50:25.748 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 131337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-22T04:50:25.748 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 314553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-22T04:50:25.748 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/ 2024-01-22T04:50:25.748 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-22T04:50:25.748 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 323745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-22T04:50:25.748 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/ 2024-01-22T04:50:25.749 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-22T04:50:25.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 193497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-22T04:50:25.749 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-22T04:50:25.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 347257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-22T04:50:25.749 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-22T04:50:25.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1044793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-22T04:50:25.749 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-22T04:50:25.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 166193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-22T04:50:25.749 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-22T04:50:25.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-22T04:50:25.749 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/ 2024-01-22T04:50:25.750 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-22T04:50:25.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 204345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-22T04:50:25.750 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/ 2024-01-22T04:50:25.750 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-22T04:50:25.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-22T04:50:25.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-22T04:50:25.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 141225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-22T04:50:25.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-22T04:50:25.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-22T04:50:25.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-22T04:50:25.750 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/ 2024-01-22T04:50:25.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-22T04:50:25.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-22T04:50:25.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dnet.ko 2024-01-22T04:50:25.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-22T04:50:25.751 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/ 2024-01-22T04:50:25.751 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-22T04:50:25.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 281137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-22T04:50:25.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ethoc.ko 2024-01-22T04:50:25.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fealnx.ko 2024-01-22T04:50:25.751 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fujitsu/ 2024-01-22T04:50:25.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-22T04:50:25.751 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ 2024-01-22T04:50:25.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 90369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-22T04:50:25.751 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-22T04:50:25.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 295481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-22T04:50:25.751 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-22T04:50:25.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 584497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-22T04:50:25.752 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-22T04:50:25.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 246209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-22T04:50:25.752 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-22T04:50:25.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 937673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-22T04:50:25.752 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-22T04:50:25.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 287305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-22T04:50:25.752 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb/ 2024-01-22T04:50:25.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 514569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-22T04:50:25.752 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-22T04:50:25.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 93497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-22T04:50:25.752 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-22T04:50:25.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 734353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-22T04:50:25.752 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-22T04:50:25.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 151769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-22T04:50:25.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 86921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/jme.ko 2024-01-22T04:50:25.753 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/ 2024-01-22T04:50:25.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-22T04:50:25.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-22T04:50:25.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 122601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-22T04:50:25.753 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/ 2024-01-22T04:50:25.753 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-22T04:50:25.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 727473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-22T04:50:25.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 278961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-22T04:50:25.753 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-22T04:50:25.753 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-22T04:50:25.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1118201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-22T04:50:25.753 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ 2024-01-22T04:50:25.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-22T04:50:25.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-22T04:50:25.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-22T04:50:25.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 95665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-22T04:50:25.754 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/ 2024-01-22T04:50:25.754 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-22T04:50:25.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 108649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-22T04:50:25.754 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/ 2024-01-22T04:50:25.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-22T04:50:25.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-22T04:50:25.754 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion/ 2024-01-22T04:50:25.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 150905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-22T04:50:25.754 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia/ 2024-01-22T04:50:25.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 136721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-22T04:50:25.754 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/ 2024-01-22T04:50:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-22T04:50:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-22T04:50:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/ 2024-01-22T04:50:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-22T04:50:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 227897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-22T04:50:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 87105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-22T04:50:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-22T04:50:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 671937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-22T04:50:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc/ 2024-01-22T04:50:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-22T04:50:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/ 2024-01-22T04:50:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-22T04:50:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 83985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-22T04:50:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-22T04:50:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 192353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-22T04:50:25.756 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/samsung/ 2024-01-22T04:50:25.756 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-22T04:50:25.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 104241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-22T04:50:25.756 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc/ 2024-01-22T04:50:25.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1064737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-22T04:50:25.756 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan/ 2024-01-22T04:50:25.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-22T04:50:25.756 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/ 2024-01-22T04:50:25.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-22T04:50:25.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 63337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-22T04:50:25.757 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/ 2024-01-22T04:50:25.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-22T04:50:25.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-22T04:50:25.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-22T04:50:25.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-22T04:50:25.757 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/ 2024-01-22T04:50:25.757 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-22T04:50:25.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-22T04:50:25.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-22T04:50:25.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-22T04:50:25.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 487593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-22T04:50:25.757 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/ 2024-01-22T04:50:25.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 103337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-22T04:50:25.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 166097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-22T04:50:25.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-22T04:50:25.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-22T04:50:25.758 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti/ 2024-01-22T04:50:25.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-22T04:50:25.758 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti/ 2024-01-22T04:50:25.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 86529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-22T04:50:25.758 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/ 2024-01-22T04:50:25.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-22T04:50:25.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 83793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-22T04:50:25.758 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/ 2024-01-22T04:50:25.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-22T04:50:25.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-22T04:50:25.758 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom/ 2024-01-22T04:50:25.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-22T04:50:25.758 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/ 2024-01-22T04:50:25.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/defxx.ko 2024-01-22T04:50:25.759 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/skfp/ 2024-01-22T04:50:25.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 216985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-22T04:50:25.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 74569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/geneve.ko 2024-01-22T04:50:25.759 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv/ 2024-01-22T04:50:25.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 236225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-22T04:50:25.759 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154/ 2024-01-22T04:50:25.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-22T04:50:25.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ifb.ko 2024-01-22T04:50:25.759 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan/ 2024-01-22T04:50:25.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 85817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-22T04:50:25.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvlan.ko 2024-01-22T04:50:25.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvtap.ko 2024-01-22T04:50:25.760 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/ 2024-01-22T04:50:25.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-22T04:50:25.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-22T04:50:25.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-22T04:50:25.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-22T04:50:25.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio.ko 2024-01-22T04:50:25.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mii.ko 2024-01-22T04:50:25.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/netconsole.ko 2024-01-22T04:50:25.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/nlmon.ko 2024-01-22T04:50:25.760 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/ 2024-01-22T04:50:25.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-22T04:50:25.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-22T04:50:25.760 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/ 2024-01-22T04:50:25.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/amd.ko 2024-01-22T04:50:25.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-22T04:50:25.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-22T04:50:25.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm87xx.ko 2024-01-22T04:50:25.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/broadcom.ko 2024-01-22T04:50:25.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/cicada.ko 2024-01-22T04:50:25.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/davicom.ko 2024-01-22T04:50:25.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/et1011c.ko 2024-01-22T04:50:25.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/icplus.ko 2024-01-22T04:50:25.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/lxt.ko 2024-01-22T04:50:25.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 82049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/marvell.ko 2024-01-22T04:50:25.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 76409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/micrel.ko 2024-01-22T04:50:25.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/national.ko 2024-01-22T04:50:25.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 95561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/phylink.ko 2024-01-22T04:50:25.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/qsemi.ko 2024-01-22T04:50:25.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/realtek.ko 2024-01-22T04:50:25.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/smsc.ko 2024-01-22T04:50:25.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/ste10Xp.ko 2024-01-22T04:50:25.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/vitesse.ko 2024-01-22T04:50:25.762 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/plip/ 2024-01-22T04:50:25.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/plip/plip.ko 2024-01-22T04:50:25.762 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ 2024-01-22T04:50:25.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-22T04:50:25.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_async.ko 2024-01-22T04:50:25.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-22T04:50:25.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-22T04:50:25.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-22T04:50:25.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppoe.ko 2024-01-22T04:50:25.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppox.ko 2024-01-22T04:50:25.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pptp.ko 2024-01-22T04:50:25.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/sb1000.ko 2024-01-22T04:50:25.763 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/ 2024-01-22T04:50:25.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slip.ko 2024-01-22T04:50:25.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/sungem_phy.ko 2024-01-22T04:50:25.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 64585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tap.ko 2024-01-22T04:50:25.763 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/ 2024-01-22T04:50:25.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 107089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team.ko 2024-01-22T04:50:25.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-22T04:50:25.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-22T04:50:25.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-22T04:50:25.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_random.ko 2024-01-22T04:50:25.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-22T04:50:25.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 86945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/veth.ko 2024-01-22T04:50:25.763 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3/ 2024-01-22T04:50:25.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 144361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-22T04:50:25.763 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan/ 2024-01-22T04:50:25.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 301281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan/vxlan.ko 2024-01-22T04:50:25.764 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback/ 2024-01-22T04:50:25.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 144001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-22T04:50:25.764 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb/ 2024-01-22T04:50:25.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb/ntb.ko 2024-01-22T04:50:25.764 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/ 2024-01-22T04:50:25.764 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/ 2024-01-22T04:50:25.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 265777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme-core.ko 2024-01-22T04:50:25.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme.ko 2024-01-22T04:50:25.764 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/ 2024-01-22T04:50:25.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 131249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport.ko 2024-01-22T04:50:25.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_cs.ko 2024-01-22T04:50:25.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 85377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_pc.ko 2024-01-22T04:50:25.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_serial.ko 2024-01-22T04:50:25.765 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/ 2024-01-22T04:50:25.765 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/ 2024-01-22T04:50:25.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-22T04:50:25.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-22T04:50:25.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-22T04:50:25.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pci-stub.ko 2024-01-22T04:50:25.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/xen-pcifront.ko 2024-01-22T04:50:25.765 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/ 2024-01-22T04:50:25.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/i82092.ko 2024-01-22T04:50:25.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 146289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pcmcia.ko 2024-01-22T04:50:25.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-22T04:50:25.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-22T04:50:25.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pd6729.ko 2024-01-22T04:50:25.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 112889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-22T04:50:25.766 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/ 2024-01-22T04:50:25.766 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/broadcom/ 2024-01-22T04:50:25.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-22T04:50:25.766 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/samsung/ 2024-01-22T04:50:25.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-22T04:50:25.766 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/ 2024-01-22T04:50:25.766 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel/ 2024-01-22T04:50:25.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-22T04:50:25.766 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/ 2024-01-22T04:50:25.766 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/ 2024-01-22T04:50:25.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-22T04:50:25.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-22T04:50:25.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-22T04:50:25.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-22T04:50:25.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-22T04:50:25.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-22T04:50:25.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-22T04:50:25.767 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/ 2024-01-22T04:50:25.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-22T04:50:25.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acerhdf.ko 2024-01-22T04:50:25.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-22T04:50:25.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-22T04:50:25.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-22T04:50:25.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 132025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-22T04:50:25.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-22T04:50:25.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-22T04:50:25.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-22T04:50:25.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-22T04:50:25.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-22T04:50:25.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/hdaps.ko 2024-01-22T04:50:25.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-22T04:50:25.768 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/ 2024-01-22T04:50:25.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-22T04:50:25.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-22T04:50:25.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel_ips.ko 2024-01-22T04:50:25.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-22T04:50:25.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-22T04:50:25.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-22T04:50:25.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-22T04:50:25.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-22T04:50:25.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-22T04:50:25.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-22T04:50:25.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-22T04:50:25.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-22T04:50:25.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi.ko 2024-01-22T04:50:25.769 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/ 2024-01-22T04:50:25.769 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ 2024-01-22T04:50:25.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-22T04:50:25.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-22T04:50:25.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-22T04:50:25.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-22T04:50:25.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-22T04:50:25.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-22T04:50:25.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/da9030_battery.ko 2024-01-22T04:50:25.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/da9052-battery.ko 2024-01-22T04:50:25.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-22T04:50:25.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-22T04:50:25.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-22T04:50:25.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-22T04:50:25.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/gpio-charger.ko 2024-01-22T04:50:25.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-22T04:50:25.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-22T04:50:25.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max14577_charger.ko 2024-01-22T04:50:25.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max17042_battery.ko 2024-01-22T04:50:25.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max8903_charger.ko 2024-01-22T04:50:25.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max8925_power.ko 2024-01-22T04:50:25.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-22T04:50:25.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/sbs-battery.ko 2024-01-22T04:50:25.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/test_power.ko 2024-01-22T04:50:25.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-22T04:50:25.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-22T04:50:25.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/wm831x_power.ko 2024-01-22T04:50:25.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/wm8350_power.ko 2024-01-22T04:50:25.771 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/ 2024-01-22T04:50:25.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-22T04:50:25.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-22T04:50:25.771 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/ 2024-01-22T04:50:25.771 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/ 2024-01-22T04:50:25.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-22T04:50:25.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-22T04:50:25.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps_parport.ko 2024-01-22T04:50:25.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/pps_core.ko 2024-01-22T04:50:25.771 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ 2024-01-22T04:50:25.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp.ko 2024-01-22T04:50:25.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp_kvm.ko 2024-01-22T04:50:25.772 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/ 2024-01-22T04:50:25.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-22T04:50:25.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-22T04:50:25.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-22T04:50:25.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-da9052.ko 2024-01-22T04:50:25.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-da9055.ko 2024-01-22T04:50:25.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-da9063.ko 2024-01-22T04:50:25.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-22T04:50:25.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-22T04:50:25.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-22T04:50:25.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-22T04:50:25.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-22T04:50:25.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-22T04:50:25.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-22T04:50:25.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-22T04:50:25.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-22T04:50:25.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-em3027.ko 2024-01-22T04:50:25.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-22T04:50:25.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-22T04:50:25.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-22T04:50:25.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-22T04:50:25.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-22T04:50:25.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-22T04:50:25.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-22T04:50:25.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-22T04:50:25.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max6900.ko 2024-01-22T04:50:25.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8907.ko 2024-01-22T04:50:25.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8925.ko 2024-01-22T04:50:25.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8997.ko 2024-01-22T04:50:25.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8998.ko 2024-01-22T04:50:25.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-22T04:50:25.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-22T04:50:25.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-palmas.ko 2024-01-22T04:50:25.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-22T04:50:25.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-22T04:50:25.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-22T04:50:25.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-22T04:50:25.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-22T04:50:25.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-22T04:50:25.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-22T04:50:25.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-22T04:50:25.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-22T04:50:25.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-22T04:50:25.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-22T04:50:25.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-22T04:50:25.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-22T04:50:25.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-22T04:50:25.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-22T04:50:25.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-22T04:50:25.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-22T04:50:25.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-22T04:50:25.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-x1205.ko 2024-01-22T04:50:25.776 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ 2024-01-22T04:50:25.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 77617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-9xxx.ko 2024-01-22T04:50:25.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-sas.ko 2024-01-22T04:50:25.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-xxxx.ko 2024-01-22T04:50:25.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 135185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/BusLogic.ko 2024-01-22T04:50:25.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/a100u2w.ko 2024-01-22T04:50:25.777 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid/ 2024-01-22T04:50:25.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 271113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-22T04:50:25.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/advansys.ko 2024-01-22T04:50:25.777 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/ 2024-01-22T04:50:25.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 356929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-22T04:50:25.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 296049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-22T04:50:25.777 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic94xx/ 2024-01-22T04:50:25.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 189185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-22T04:50:25.778 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/am53c974.ko 2024-01-22T04:50:25.778 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr/ 2024-01-22T04:50:25.778 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 106881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-22T04:50:25.778 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/atp870u.ko 2024-01-22T04:50:25.778 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi/ 2024-01-22T04:50:25.778 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 247009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-22T04:50:25.778 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa/ 2024-01-22T04:50:25.778 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1171945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa/bfa.ko 2024-01-22T04:50:25.778 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc/ 2024-01-22T04:50:25.778 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 237721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-22T04:50:25.778 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i/ 2024-01-22T04:50:25.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 115369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-22T04:50:25.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ch.ko 2024-01-22T04:50:25.779 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor/ 2024-01-22T04:50:25.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 308921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-22T04:50:25.779 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/ 2024-01-22T04:50:25.779 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-22T04:50:25.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 76145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-22T04:50:25.779 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-22T04:50:25.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 101449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-22T04:50:25.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 146625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-22T04:50:25.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 75553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dc395x.ko 2024-01-22T04:50:25.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dmx3191d.ko 2024-01-22T04:50:25.779 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r/ 2024-01-22T04:50:25.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 212425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-22T04:50:25.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esp_scsi.ko 2024-01-22T04:50:25.780 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/ 2024-01-22T04:50:25.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-22T04:50:25.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 158505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-22T04:50:25.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fdomain.ko 2024-01-22T04:50:25.780 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic/ 2024-01-22T04:50:25.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 263489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic/fnic.ko 2024-01-22T04:50:25.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 201817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hpsa.ko 2024-01-22T04:50:25.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hptiop.ko 2024-01-22T04:50:25.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hv_storvsc.ko 2024-01-22T04:50:25.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/imm.ko 2024-01-22T04:50:25.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/initio.ko 2024-01-22T04:50:25.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 266537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ipr.ko 2024-01-22T04:50:25.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 101473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ips.ko 2024-01-22T04:50:25.781 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci/ 2024-01-22T04:50:25.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 317153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci/isci.ko 2024-01-22T04:50:25.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-22T04:50:25.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-22T04:50:25.781 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc/ 2024-01-22T04:50:25.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 315209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc/libfc.ko 2024-01-22T04:50:25.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 145585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi.ko 2024-01-22T04:50:25.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-22T04:50:25.781 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas/ 2024-01-22T04:50:25.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 216441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas/libsas.ko 2024-01-22T04:50:25.782 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc/ 2024-01-22T04:50:25.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 2197481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-22T04:50:25.782 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/ 2024-01-22T04:50:25.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-22T04:50:25.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-22T04:50:25.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 310841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-22T04:50:25.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 84649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid.ko 2024-01-22T04:50:25.782 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas/ 2024-01-22T04:50:25.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 659801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-22T04:50:25.782 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas/ 2024-01-22T04:50:25.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 119561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-22T04:50:25.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvumi.ko 2024-01-22T04:50:25.783 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/ 2024-01-22T04:50:25.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-22T04:50:25.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-22T04:50:25.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-22T04:50:25.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-22T04:50:25.783 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001/ 2024-01-22T04:50:25.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 366401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-22T04:50:25.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 124633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pmcraid.ko 2024-01-22T04:50:25.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ppa.ko 2024-01-22T04:50:25.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla1280.ko 2024-01-22T04:50:25.783 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/ 2024-01-22T04:50:25.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1876633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-22T04:50:25.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 85289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-22T04:50:25.784 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx/ 2024-01-22T04:50:25.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 559033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-22T04:50:25.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qlogicfas408.ko 2024-01-22T04:50:25.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/raid_class.ko 2024-01-22T04:50:25.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 261241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_debug.ko 2024-01-22T04:50:25.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 173937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-22T04:50:25.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 279313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-22T04:50:25.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 97729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-22T04:50:25.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-22T04:50:25.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-22T04:50:25.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ses.ko 2024-01-22T04:50:25.784 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 115889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/st.ko 2024-01-22T04:50:25.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/stex.ko 2024-01-22T04:50:25.785 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-22T04:50:25.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 164961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-22T04:50:25.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/virtio_scsi.ko 2024-01-22T04:50:25.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-22T04:50:25.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/wd719x.ko 2024-01-22T04:50:25.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/xen-scsifront.ko 2024-01-22T04:50:25.785 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb/ 2024-01-22T04:50:25.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 129441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb/ssb.ko 2024-01-22T04:50:25.785 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/ 2024-01-22T04:50:25.785 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi/ 2024-01-22T04:50:25.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 736769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-22T04:50:25.785 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback/ 2024-01-22T04:50:25.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-22T04:50:25.785 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_file.ko 2024-01-22T04:50:25.786 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_iblock.ko 2024-01-22T04:50:25.786 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 930697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_mod.ko 2024-01-22T04:50:25.786 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_pscsi.ko 2024-01-22T04:50:25.786 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 122521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_user.ko 2024-01-22T04:50:25.786 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc/ 2024-01-22T04:50:25.786 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 75593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-22T04:50:25.786 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/ 2024-01-22T04:50:25.786 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/ 2024-01-22T04:50:25.786 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-22T04:50:25.786 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-22T04:50:25.786 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-22T04:50:25.786 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-22T04:50:25.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-22T04:50:25.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-22T04:50:25.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-22T04:50:25.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-22T04:50:25.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-22T04:50:25.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-22T04:50:25.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-22T04:50:25.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-22T04:50:25.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-22T04:50:25.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-22T04:50:25.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-22T04:50:25.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-22T04:50:25.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-22T04:50:25.787 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-22T04:50:25.788 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-22T04:50:25.788 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-22T04:50:25.788 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ 2024-01-22T04:50:25.788 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless/ 2024-01-22T04:50:25.788 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-22T04:50:25.788 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/moxa.ko 2024-01-22T04:50:25.788 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/mxser.ko 2024-01-22T04:50:25.788 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 108601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_gsm.ko 2024-01-22T04:50:25.788 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_hdlc.ko 2024-01-22T04:50:25.788 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/nozomi.ko 2024-01-22T04:50:25.788 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/ 2024-01-22T04:50:25.788 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/ 2024-01-22T04:50:25.789 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-22T04:50:25.789 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-22T04:50:25.789 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-22T04:50:25.789 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/altera_uart.ko 2024-01-22T04:50:25.789 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/arc_uart.ko 2024-01-22T04:50:25.789 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-22T04:50:25.789 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm/ 2024-01-22T04:50:25.789 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 103073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/rp2.ko 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/ 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core/ 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 535985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/ 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio.ko 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_aec.ko 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_cif.ko 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_mf624.ko 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_netx.ko 2024-01-22T04:50:25.790 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_pci_generic.ko 2024-01-22T04:50:25.791 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-22T04:50:25.791 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_sercos3.ko 2024-01-22T04:50:25.791 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/ 2024-01-22T04:50:25.791 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/c67x00/ 2024-01-22T04:50:25.791 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-22T04:50:25.791 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ 2024-01-22T04:50:25.791 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 144617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-22T04:50:25.791 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-22T04:50:25.791 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-01-22T04:50:25.791 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-22T04:50:25.791 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-22T04:50:25.791 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/ 2024-01-22T04:50:25.791 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 87073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-acm.ko 2024-01-22T04:50:25.791 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-22T04:50:25.791 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usblp.ko 2024-01-22T04:50:25.792 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usbtmc.ko 2024-01-22T04:50:25.792 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/common/ 2024-01-22T04:50:25.792 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/common/ulpi.ko 2024-01-22T04:50:25.792 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc2/ 2024-01-22T04:50:25.792 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-22T04:50:25.792 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/ 2024-01-22T04:50:25.792 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-22T04:50:25.792 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-22T04:50:25.792 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 454385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-22T04:50:25.792 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/ 2024-01-22T04:50:25.792 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/ 2024-01-22T04:50:25.792 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-22T04:50:25.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-22T04:50:25.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-22T04:50:25.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-22T04:50:25.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-22T04:50:25.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-22T04:50:25.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 92489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-22T04:50:25.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-22T04:50:25.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 122081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-22T04:50:25.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-22T04:50:25.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-22T04:50:25.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-22T04:50:25.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-22T04:50:25.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 85609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-22T04:50:25.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-22T04:50:25.793 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-22T04:50:25.794 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-22T04:50:25.794 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/ 2024-01-22T04:50:25.794 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-22T04:50:25.794 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-22T04:50:25.794 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-22T04:50:25.794 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-22T04:50:25.794 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-22T04:50:25.794 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-22T04:50:25.794 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-22T04:50:25.794 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-22T04:50:25.794 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-22T04:50:25.794 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-22T04:50:25.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-22T04:50:25.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-22T04:50:25.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-22T04:50:25.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-22T04:50:25.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 161225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-22T04:50:25.795 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/ 2024-01-22T04:50:25.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-22T04:50:25.795 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-22T04:50:25.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 157681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-22T04:50:25.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-22T04:50:25.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-22T04:50:25.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-22T04:50:25.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-22T04:50:25.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 76057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-22T04:50:25.795 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 75073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-22T04:50:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-22T04:50:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 65809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-22T04:50:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-22T04:50:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-22T04:50:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 156409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-22T04:50:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/ 2024-01-22T04:50:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-22T04:50:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-22T04:50:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 87353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-22T04:50:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-22T04:50:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-22T04:50:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/sl811_cs.ko 2024-01-22T04:50:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-22T04:50:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-22T04:50:25.797 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/ 2024-01-22T04:50:25.797 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/mdc800.ko 2024-01-22T04:50:25.797 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/microtek.ko 2024-01-22T04:50:25.797 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ 2024-01-22T04:50:25.797 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/adutux.ko 2024-01-22T04:50:25.797 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/appledisplay.ko 2024-01-22T04:50:25.797 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-22T04:50:25.797 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/cytherm.ko 2024-01-22T04:50:25.797 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ehset.ko 2024-01-22T04:50:25.797 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi26.ko 2024-01-22T04:50:25.797 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi62.ko 2024-01-22T04:50:25.797 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ezusb.ko 2024-01-22T04:50:25.797 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/idmouse.ko 2024-01-22T04:50:25.797 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/iowarrior.ko 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ldusb.ko 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/legousbtower.ko 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/lvstest.ko 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga/ 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 64841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usb3503.ko 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usblcd.ko 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usbtest.ko 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/uss720.ko 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/yurex.ko 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/mon/ 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/mon/usbmon.ko 2024-01-22T04:50:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/musb/ 2024-01-22T04:50:25.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 301697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-22T04:50:25.799 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/ 2024-01-22T04:50:25.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-generic.ko 2024-01-22T04:50:25.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-22T04:50:25.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-22T04:50:25.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-22T04:50:25.799 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ 2024-01-22T04:50:25.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/aircable.ko 2024-01-22T04:50:25.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ark3116.ko 2024-01-22T04:50:25.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-22T04:50:25.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ch341.ko 2024-01-22T04:50:25.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cp210x.ko 2024-01-22T04:50:25.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cyberjack.ko 2024-01-22T04:50:25.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-22T04:50:25.799 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-22T04:50:25.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/empeg.ko 2024-01-22T04:50:25.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/f81232.ko 2024-01-22T04:50:25.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 175193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-22T04:50:25.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-22T04:50:25.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 137081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-22T04:50:25.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 124833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_ti.ko 2024-01-22T04:50:25.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipaq.ko 2024-01-22T04:50:25.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipw.ko 2024-01-22T04:50:25.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ir-usb.ko 2024-01-22T04:50:25.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-22T04:50:25.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 107521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan.ko 2024-01-22T04:50:25.800 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-22T04:50:25.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-22T04:50:25.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-22T04:50:25.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mct_u232.ko 2024-01-22T04:50:25.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/metro-usb.ko 2024-01-22T04:50:25.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7720.ko 2024-01-22T04:50:25.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7840.ko 2024-01-22T04:50:25.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mxuport.ko 2024-01-22T04:50:25.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/navman.ko 2024-01-22T04:50:25.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/omninet.ko 2024-01-22T04:50:25.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/opticon.ko 2024-01-22T04:50:25.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 191801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/option.ko 2024-01-22T04:50:25.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/oti6858.ko 2024-01-22T04:50:25.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/pl2303.ko 2024-01-22T04:50:25.801 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcaux.ko 2024-01-22T04:50:25.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcserial.ko 2024-01-22T04:50:25.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/quatech2.ko 2024-01-22T04:50:25.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/safe_serial.ko 2024-01-22T04:50:25.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/sierra.ko 2024-01-22T04:50:25.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-22T04:50:25.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ssu100.ko 2024-01-22T04:50:25.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/symbolserial.ko 2024-01-22T04:50:25.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-22T04:50:25.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-22T04:50:25.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_debug.ko 2024-01-22T04:50:25.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-22T04:50:25.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usbserial.ko 2024-01-22T04:50:25.802 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/visor.ko 2024-01-22T04:50:25.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/whiteheat.ko 2024-01-22T04:50:25.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-22T04:50:25.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-22T04:50:25.803 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ 2024-01-22T04:50:25.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/uas.ko 2024-01-22T04:50:25.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-22T04:50:25.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-22T04:50:25.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-22T04:50:25.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-22T04:50:25.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-22T04:50:25.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-22T04:50:25.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-22T04:50:25.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-karma.ko 2024-01-22T04:50:25.803 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-22T04:50:25.804 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-22T04:50:25.804 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-22T04:50:25.804 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-22T04:50:25.804 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-22T04:50:25.804 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 180225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/usb-storage.ko 2024-01-22T04:50:25.804 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/ 2024-01-22T04:50:25.804 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-22T04:50:25.804 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-22T04:50:25.804 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 103977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-22T04:50:25.804 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/ 2024-01-22T04:50:25.804 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/ 2024-01-22T04:50:25.804 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 154297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-22T04:50:25.804 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-22T04:50:25.804 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 103737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio.ko 2024-01-22T04:50:25.805 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 77609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-22T04:50:25.805 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/ 2024-01-22T04:50:25.805 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 113785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost.ko 2024-01-22T04:50:25.805 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-22T04:50:25.805 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_net.ko 2024-01-22T04:50:25.805 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_scsi.ko 2024-01-22T04:50:25.805 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/ 2024-01-22T04:50:25.805 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/ 2024-01-22T04:50:25.805 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-22T04:50:25.805 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-22T04:50:25.805 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-22T04:50:25.805 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-22T04:50:25.805 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-22T04:50:25.805 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/apple_bl.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/bd6107.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lcd.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-22T04:50:25.806 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/ 2024-01-22T04:50:25.807 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ 2024-01-22T04:50:25.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2482.ko 2024-01-22T04:50:25.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2490.ko 2024-01-22T04:50:25.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-22T04:50:25.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-22T04:50:25.807 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/ 2024-01-22T04:50:25.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-22T04:50:25.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-22T04:50:25.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-22T04:50:25.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-22T04:50:25.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-22T04:50:25.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-22T04:50:25.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-22T04:50:25.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-22T04:50:25.807 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-22T04:50:25.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-22T04:50:25.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-22T04:50:25.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/wire.ko 2024-01-22T04:50:25.808 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ 2024-01-22T04:50:25.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/acquirewdt.ko 2024-01-22T04:50:25.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/advantechwdt.ko 2024-01-22T04:50:25.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-22T04:50:25.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-22T04:50:25.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-22T04:50:25.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-22T04:50:25.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-22T04:50:25.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-22T04:50:25.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/dw_wdt.ko 2024-01-22T04:50:25.808 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-22T04:50:25.809 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-22T04:50:25.809 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/hpwdt.ko 2024-01-22T04:50:25.809 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/i6300esb.ko 2024-01-22T04:50:25.809 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-22T04:50:25.809 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-22T04:50:25.809 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ib700wdt.ko 2024-01-22T04:50:25.809 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ibmasr.ko 2024-01-22T04:50:25.809 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-22T04:50:25.809 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-22T04:50:25.809 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it87_wdt.ko 2024-01-22T04:50:25.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-22T04:50:25.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/machzwd.ko 2024-01-22T04:50:25.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-22T04:50:25.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-22T04:50:25.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/nv_tco.ko 2024-01-22T04:50:25.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-22T04:50:25.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-22T04:50:25.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-22T04:50:25.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-22T04:50:25.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/retu_wdt.ko 2024-01-22T04:50:25.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-22T04:50:25.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-22T04:50:25.810 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/softdog.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/via_wdt.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wdt_pci.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/xen_wdt.ko 2024-01-22T04:50:25.811 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/ 2024-01-22T04:50:25.812 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-evtchn.ko 2024-01-22T04:50:25.812 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntalloc.ko 2024-01-22T04:50:25.812 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntdev.ko 2024-01-22T04:50:25.812 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback/ 2024-01-22T04:50:25.812 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 176441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-22T04:50:25.812 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-privcmd.ko 2024-01-22T04:50:25.812 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-scsiback.ko 2024-01-22T04:50:25.812 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs/ 2024-01-22T04:50:25.812 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-22T04:50:25.812 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ 2024-01-22T04:50:25.812 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/9p/ 2024-01-22T04:50:25.812 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 166753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/9p/9p.ko 2024-01-22T04:50:25.813 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/adfs/ 2024-01-22T04:50:25.813 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/adfs/adfs.ko 2024-01-22T04:50:25.813 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/affs/ 2024-01-22T04:50:25.813 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 163449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/affs/affs.ko 2024-01-22T04:50:25.813 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/afs/ 2024-01-22T04:50:25.813 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 935033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/afs/kafs.ko 2024-01-22T04:50:25.813 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/autofs/ 2024-01-22T04:50:25.813 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 103401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/autofs/autofs4.ko 2024-01-22T04:50:25.813 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/befs/ 2024-01-22T04:50:25.813 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 64681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/befs/befs.ko 2024-01-22T04:50:25.813 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/bfs/ 2024-01-22T04:50:25.813 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/bfs/bfs.ko 2024-01-22T04:50:25.813 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/binfmt_misc.ko 2024-01-22T04:50:25.814 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs/ 2024-01-22T04:50:25.814 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 3455857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs/btrfs.ko 2024-01-22T04:50:25.814 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles/ 2024-01-22T04:50:25.814 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 306009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles/cachefiles.ko 2024-01-22T04:50:25.814 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph/ 2024-01-22T04:50:25.814 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1336985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph/ceph.ko 2024-01-22T04:50:25.814 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/coda/ 2024-01-22T04:50:25.814 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/coda/coda.ko 2024-01-22T04:50:25.814 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/configfs/ 2024-01-22T04:50:25.814 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 108641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/configfs/configfs.ko 2024-01-22T04:50:25.814 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs/ 2024-01-22T04:50:25.814 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs/cramfs.ko 2024-01-22T04:50:25.814 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm/ 2024-01-22T04:50:25.814 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 644073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm/dlm.ko 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/efs/ 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/efs/efs.ko 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs/ 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1506641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs/f2fs.ko 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/ 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/msdos.ko 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/freevxfs/ 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/freevxfs/freevxfs.ko 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache/ 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 226481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache/fscache.ko 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/ 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/cuse.ko 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2/ 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1229913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2/gfs2.ko 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs/ 2024-01-22T04:50:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 141985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs/hfs.ko 2024-01-22T04:50:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus/ 2024-01-22T04:50:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 223225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus/hfsplus.ko 2024-01-22T04:50:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hpfs/ 2024-01-22T04:50:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 193569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hpfs/hpfs.ko 2024-01-22T04:50:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs/ 2024-01-22T04:50:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 74785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs/isofs.ko 2024-01-22T04:50:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs/ 2024-01-22T04:50:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 419881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs/jfs.ko 2024-01-22T04:50:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd/ 2024-01-22T04:50:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 282049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd/lockd.ko 2024-01-22T04:50:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/minix/ 2024-01-22T04:50:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/minix/minix.ko 2024-01-22T04:50:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs/ 2024-01-22T04:50:25.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 124649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs/netfs.ko 2024-01-22T04:50:25.817 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/ 2024-01-22T04:50:25.817 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout/ 2024-01-22T04:50:25.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-22T04:50:25.817 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout/ 2024-01-22T04:50:25.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-22T04:50:25.817 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout/ 2024-01-22T04:50:25.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 117465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-22T04:50:25.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1057969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfs.ko 2024-01-22T04:50:25.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv2.ko 2024-01-22T04:50:25.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 120265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv3.ko 2024-01-22T04:50:25.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 2042153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv4.ko 2024-01-22T04:50:25.817 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/ 2024-01-22T04:50:25.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/grace.ko 2024-01-22T04:50:25.817 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/nfs_acl.ko 2024-01-22T04:50:25.818 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd/ 2024-01-22T04:50:25.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1563929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd/nfsd.ko 2024-01-22T04:50:25.818 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2/ 2024-01-22T04:50:25.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 590713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2/nilfs2.ko 2024-01-22T04:50:25.818 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/ 2024-01-22T04:50:25.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-celtic.ko 2024-01-22T04:50:25.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-centeuro.ko 2024-01-22T04:50:25.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-croatian.ko 2024-01-22T04:50:25.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-cyrillic.ko 2024-01-22T04:50:25.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-gaelic.ko 2024-01-22T04:50:25.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-greek.ko 2024-01-22T04:50:25.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-iceland.ko 2024-01-22T04:50:25.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-inuit.ko 2024-01-22T04:50:25.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-roman.ko 2024-01-22T04:50:25.818 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-romanian.ko 2024-01-22T04:50:25.819 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-turkish.ko 2024-01-22T04:50:25.819 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_ascii.ko 2024-01-22T04:50:25.819 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1250.ko 2024-01-22T04:50:25.819 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1251.ko 2024-01-22T04:50:25.819 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1255.ko 2024-01-22T04:50:25.819 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp737.ko 2024-01-22T04:50:25.819 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp775.ko 2024-01-22T04:50:25.819 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp850.ko 2024-01-22T04:50:25.819 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp852.ko 2024-01-22T04:50:25.819 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp855.ko 2024-01-22T04:50:25.819 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp857.ko 2024-01-22T04:50:25.819 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp860.ko 2024-01-22T04:50:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp861.ko 2024-01-22T04:50:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp862.ko 2024-01-22T04:50:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp863.ko 2024-01-22T04:50:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp864.ko 2024-01-22T04:50:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp865.ko 2024-01-22T04:50:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp866.ko 2024-01-22T04:50:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp869.ko 2024-01-22T04:50:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp874.ko 2024-01-22T04:50:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 94137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp932.ko 2024-01-22T04:50:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 142673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp936.ko 2024-01-22T04:50:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 165745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp949.ko 2024-01-22T04:50:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 118121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp950.ko 2024-01-22T04:50:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_euc-jp.ko 2024-01-22T04:50:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-1.ko 2024-01-22T04:50:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-13.ko 2024-01-22T04:50:25.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-14.ko 2024-01-22T04:50:25.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-15.ko 2024-01-22T04:50:25.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-2.ko 2024-01-22T04:50:25.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-3.ko 2024-01-22T04:50:25.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-4.ko 2024-01-22T04:50:25.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-5.ko 2024-01-22T04:50:25.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-6.ko 2024-01-22T04:50:25.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-7.ko 2024-01-22T04:50:25.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-9.ko 2024-01-22T04:50:25.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-r.ko 2024-01-22T04:50:25.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-ru.ko 2024-01-22T04:50:25.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-u.ko 2024-01-22T04:50:25.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-22T04:50:25.821 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_utf8.ko 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ntfs/ 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 220553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ntfs/ntfs.ko 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster/ 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 244737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm/ 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 440737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs/ 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 2593521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2.ko 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/omfs/ 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/omfs/omfs.ko 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs/ 2024-01-22T04:50:25.822 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 370697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs/overlay.ko 2024-01-22T04:50:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore/ 2024-01-22T04:50:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore/ramoops.ko 2024-01-22T04:50:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx4/ 2024-01-22T04:50:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx4/qnx4.ko 2024-01-22T04:50:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx6/ 2024-01-22T04:50:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx6/qnx6.ko 2024-01-22T04:50:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/ 2024-01-22T04:50:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/quota_tree.ko 2024-01-22T04:50:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/quota_v1.ko 2024-01-22T04:50:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/quota_v2.ko 2024-01-22T04:50:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs/ 2024-01-22T04:50:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 532025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs/reiserfs.ko 2024-01-22T04:50:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs/ 2024-01-22T04:50:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs/romfs.ko 2024-01-22T04:50:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/ 2024-01-22T04:50:25.824 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client/ 2024-01-22T04:50:25.824 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 2683249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client/cifs.ko 2024-01-22T04:50:25.872 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/ 2024-01-22T04:50:25.872 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_arc4.ko 2024-01-22T04:50:25.872 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_md4.ko 2024-01-22T04:50:25.872 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs/ 2024-01-22T04:50:25.872 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 134777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs/squashfs.ko 2024-01-22T04:50:25.872 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv/ 2024-01-22T04:50:25.872 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 91249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv/sysv.ko 2024-01-22T04:50:25.872 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/udf/ 2024-01-22T04:50:25.872 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 248425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/udf/udf.ko 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs/ 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 162537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs/ufs.ko 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs/ 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 4014433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs/xfs.ko 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/ 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/locking/ 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/locking/locktorture.ko 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/time/ 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/time/test_udelay.ko 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/torture.ko 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crc-itu-t.ko 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crc7.ko 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crc8.ko 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/ 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libarc4.ko 2024-01-22T04:50:25.873 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libdes.ko 2024-01-22T04:50:25.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/interval_tree_test.ko 2024-01-22T04:50:25.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/libcrc32c.ko 2024-01-22T04:50:25.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lru_cache.ko 2024-01-22T04:50:25.874 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/ 2024-01-22T04:50:25.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4_compress.ko 2024-01-22T04:50:25.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4hc_compress.ko 2024-01-22T04:50:25.874 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/math/ 2024-01-22T04:50:25.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/math/cordic.ko 2024-01-22T04:50:25.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/memory-notifier-error-inject.ko 2024-01-22T04:50:25.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/notifier-error-inject.ko 2024-01-22T04:50:25.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/percpu_test.ko 2024-01-22T04:50:25.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/pm-notifier-error-inject.ko 2024-01-22T04:50:25.874 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6/ 2024-01-22T04:50:25.874 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 143353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6/raid6_pq.ko 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/rbtree_test.ko 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon/ 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test-kstrtox.ko 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test-string_helpers.ko 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 4876633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_bpf.ko 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_firmware.ko 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_module.ko 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_user_copy.ko 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_bm.ko 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_fsm.ko 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_kmp.ko 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/xz/ 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/xz/xz_dec_test.ko 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/mm/ 2024-01-22T04:50:25.875 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/mm/hwpoison-inject.ko 2024-01-22T04:50:25.876 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ 2024-01-22T04:50:25.876 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/ 2024-01-22T04:50:25.876 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/6lowpan.ko 2024-01-22T04:50:25.876 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_dest.ko 2024-01-22T04:50:25.876 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_fragment.ko 2024-01-22T04:50:25.876 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_hop.ko 2024-01-22T04:50:25.876 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-22T04:50:25.876 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_mobility.ko 2024-01-22T04:50:25.876 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_routing.ko 2024-01-22T04:50:25.876 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_udp.ko 2024-01-22T04:50:25.876 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/ 2024-01-22T04:50:25.876 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/garp.ko 2024-01-22T04:50:25.877 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/mrp.ko 2024-01-22T04:50:25.877 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/p8022.ko 2024-01-22T04:50:25.877 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/psnap.ko 2024-01-22T04:50:25.877 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/stp.ko 2024-01-22T04:50:25.877 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/8021q/ 2024-01-22T04:50:25.877 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 82593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/8021q/8021q.ko 2024-01-22T04:50:25.877 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/ 2024-01-22T04:50:25.877 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 198905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet.ko 2024-01-22T04:50:25.877 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_fd.ko 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_rdma.ko 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_virtio.ko 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv/ 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 649977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv/batman-adv.ko 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/ 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 65137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/br_netfilter.ko 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 785817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/bridge.ko 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-22T04:50:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtables.ko 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ceph/ 2024-01-22T04:50:25.879 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1047033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ceph/libceph.ko 2024-01-22T04:50:25.880 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/core/ 2024-01-22T04:50:25.880 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 126041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/core/pktgen.ko 2024-01-22T04:50:25.880 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/ 2024-01-22T04:50:25.880 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 194529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp.ko 2024-01-22T04:50:25.880 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_diag.ko 2024-01-22T04:50:25.880 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv4.ko 2024-01-22T04:50:25.880 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv6.ko 2024-01-22T04:50:25.880 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/ 2024-01-22T04:50:25.880 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 390129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/dsa_core.ko 2024-01-22T04:50:25.880 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_brcm.ko 2024-01-22T04:50:25.881 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_dsa.ko 2024-01-22T04:50:25.881 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_none.ko 2024-01-22T04:50:25.881 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_trailer.ko 2024-01-22T04:50:25.881 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/hsr/ 2024-01-22T04:50:25.881 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 99881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/hsr/hsr.ko 2024-01-22T04:50:25.881 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ 2024-01-22T04:50:25.881 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan/ 2024-01-22T04:50:25.881 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-22T04:50:25.881 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 255849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154.ko 2024-01-22T04:50:25.881 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-22T04:50:25.881 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ 2024-01-22T04:50:25.881 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ah4.ko 2024-01-22T04:50:25.881 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/esp4.ko 2024-01-22T04:50:25.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/fou.ko 2024-01-22T04:50:25.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/gre.ko 2024-01-22T04:50:25.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/inet_diag.ko 2024-01-22T04:50:25.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_gre.ko 2024-01-22T04:50:25.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_tunnel.ko 2024-01-22T04:50:25.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_vti.ko 2024-01-22T04:50:25.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipcomp.ko 2024-01-22T04:50:25.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipip.ko 2024-01-22T04:50:25.882 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ 2024-01-22T04:50:25.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-22T04:50:25.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-22T04:50:25.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-22T04:50:25.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-22T04:50:25.882 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-22T04:50:25.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-22T04:50:25.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-22T04:50:25.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-22T04:50:25.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-22T04:50:25.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-22T04:50:25.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-22T04:50:25.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-22T04:50:25.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-22T04:50:25.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-22T04:50:25.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-22T04:50:25.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-22T04:50:25.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-22T04:50:25.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-22T04:50:25.883 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-22T04:50:25.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-22T04:50:25.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-22T04:50:25.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-22T04:50:25.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-22T04:50:25.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-22T04:50:25.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-22T04:50:25.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_bic.ko 2024-01-22T04:50:25.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_dctcp.ko 2024-01-22T04:50:25.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_diag.ko 2024-01-22T04:50:25.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_highspeed.ko 2024-01-22T04:50:25.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_htcp.ko 2024-01-22T04:50:25.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_hybla.ko 2024-01-22T04:50:25.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_illinois.ko 2024-01-22T04:50:25.884 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_lp.ko 2024-01-22T04:50:25.885 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_scalable.ko 2024-01-22T04:50:25.885 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_vegas.ko 2024-01-22T04:50:25.885 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_veno.ko 2024-01-22T04:50:25.885 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_westwood.ko 2024-01-22T04:50:25.885 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_yeah.ko 2024-01-22T04:50:25.885 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tunnel4.ko 2024-01-22T04:50:25.885 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_diag.ko 2024-01-22T04:50:25.885 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_tunnel.ko 2024-01-22T04:50:25.885 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-22T04:50:25.885 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ 2024-01-22T04:50:25.885 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ah6.ko 2024-01-22T04:50:25.885 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/esp6.ko 2024-01-22T04:50:25.885 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/fou6.ko 2024-01-22T04:50:25.885 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_gre.ko 2024-01-22T04:50:25.886 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 93977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_tunnel.ko 2024-01-22T04:50:25.886 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-22T04:50:25.886 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_vti.ko 2024-01-22T04:50:25.886 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ipcomp6.ko 2024-01-22T04:50:25.886 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/mip6.ko 2024-01-22T04:50:25.886 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ 2024-01-22T04:50:25.886 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-22T04:50:25.886 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-22T04:50:25.886 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-22T04:50:25.886 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-22T04:50:25.886 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-22T04:50:25.886 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-22T04:50:25.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-22T04:50:25.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-22T04:50:25.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-22T04:50:25.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-22T04:50:25.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-22T04:50:25.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-22T04:50:25.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-22T04:50:25.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-22T04:50:25.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-22T04:50:25.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-22T04:50:25.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-22T04:50:25.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-22T04:50:25.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-22T04:50:25.887 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-22T04:50:25.888 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-22T04:50:25.888 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-22T04:50:25.888 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-22T04:50:25.888 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-22T04:50:25.888 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-22T04:50:25.888 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 74921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/sit.ko 2024-01-22T04:50:25.888 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/tunnel6.ko 2024-01-22T04:50:25.888 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-22T04:50:25.888 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/key/ 2024-01-22T04:50:25.888 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 84433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/key/af_key.ko 2024-01-22T04:50:25.888 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/ 2024-01-22T04:50:25.888 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_core.ko 2024-01-22T04:50:25.888 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-22T04:50:25.889 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_eth.ko 2024-01-22T04:50:25.889 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip.ko 2024-01-22T04:50:25.889 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip6.ko 2024-01-22T04:50:25.889 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_netlink.ko 2024-01-22T04:50:25.889 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ppp.ko 2024-01-22T04:50:25.889 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/lapb/ 2024-01-22T04:50:25.889 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/lapb/lapb.ko 2024-01-22T04:50:25.889 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/llc/ 2024-01-22T04:50:25.889 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/llc/llc.ko 2024-01-22T04:50:25.889 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 268265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/llc/llc2.ko 2024-01-22T04:50:25.889 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154/ 2024-01-22T04:50:25.889 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 290441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154/mac802154.ko 2024-01-22T04:50:25.889 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mpls/ 2024-01-22T04:50:25.889 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mpls/mpls_gso.ko 2024-01-22T04:50:25.890 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ 2024-01-22T04:50:25.890 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ 2024-01-22T04:50:25.890 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 118801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set.ko 2024-01-22T04:50:25.890 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-22T04:50:25.890 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-22T04:50:25.890 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-22T04:50:25.890 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-22T04:50:25.890 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-22T04:50:25.890 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-22T04:50:25.890 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-22T04:50:25.890 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 112017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-22T04:50:25.890 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-22T04:50:25.890 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 108761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-22T04:50:25.890 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 112297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-22T04:50:25.890 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 112649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-22T04:50:25.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 110753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-22T04:50:25.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 113633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-22T04:50:25.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-22T04:50:25.891 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ 2024-01-22T04:50:25.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 412561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-22T04:50:25.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-22T04:50:25.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-22T04:50:25.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-22T04:50:25.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-22T04:50:25.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-22T04:50:25.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-22T04:50:25.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-22T04:50:25.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-22T04:50:25.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-22T04:50:25.891 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-22T04:50:25.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-22T04:50:25.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-22T04:50:25.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-22T04:50:25.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conncount.ko 2024-01-22T04:50:25.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 411489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack.ko 2024-01-22T04:50:25.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-22T04:50:25.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-22T04:50:25.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-22T04:50:25.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 118193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-22T04:50:25.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-22T04:50:25.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-22T04:50:25.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 108105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-22T04:50:25.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-22T04:50:25.892 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-22T04:50:25.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-22T04:50:25.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-22T04:50:25.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-22T04:50:25.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-22T04:50:25.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 91737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table.ko 2024-01-22T04:50:25.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-22T04:50:25.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_log_syslog.ko 2024-01-22T04:50:25.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 96545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat.ko 2024-01-22T04:50:25.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-22T04:50:25.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-22T04:50:25.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_irc.ko 2024-01-22T04:50:25.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_sip.ko 2024-01-22T04:50:25.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-22T04:50:25.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-22T04:50:25.893 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 614025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_tables.ko 2024-01-22T04:50:25.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink.ko 2024-01-22T04:50:25.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-22T04:50:25.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-22T04:50:25.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_log.ko 2024-01-22T04:50:25.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-22T04:50:25.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-22T04:50:25.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_chain_nat.ko 2024-01-22T04:50:25.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_compat.ko 2024-01-22T04:50:25.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_ct.ko 2024-01-22T04:50:25.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-22T04:50:25.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fib.ko 2024-01-22T04:50:25.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-22T04:50:25.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_hash.ko 2024-01-22T04:50:25.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_limit.ko 2024-01-22T04:50:25.894 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_log.ko 2024-01-22T04:50:25.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_masq.ko 2024-01-22T04:50:25.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_nat.ko 2024-01-22T04:50:25.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_numgen.ko 2024-01-22T04:50:25.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_osf.ko 2024-01-22T04:50:25.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_queue.ko 2024-01-22T04:50:25.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_redir.ko 2024-01-22T04:50:25.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject.ko 2024-01-22T04:50:25.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject_inet.ko 2024-01-22T04:50:25.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_socket.ko 2024-01-22T04:50:25.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_synproxy.ko 2024-01-22T04:50:25.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_tproxy.ko 2024-01-22T04:50:25.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/x_tables.ko 2024-01-22T04:50:25.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_AUDIT.ko 2024-01-22T04:50:25.895 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-22T04:50:25.896 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-22T04:50:25.896 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-22T04:50:25.896 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CT.ko 2024-01-22T04:50:25.896 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_DSCP.ko 2024-01-22T04:50:25.896 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HL.ko 2024-01-22T04:50:25.896 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HMARK.ko 2024-01-22T04:50:25.896 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-22T04:50:25.896 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LED.ko 2024-01-22T04:50:25.896 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LOG.ko 2024-01-22T04:50:25.896 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-22T04:50:25.896 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NETMAP.ko 2024-01-22T04:50:25.896 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFLOG.ko 2024-01-22T04:50:25.896 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-22T04:50:25.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_RATEEST.ko 2024-01-22T04:50:25.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-22T04:50:25.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_SECMARK.ko 2024-01-22T04:50:25.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-22T04:50:25.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-22T04:50:25.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TEE.ko 2024-01-22T04:50:25.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TPROXY.ko 2024-01-22T04:50:25.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TRACE.ko 2024-01-22T04:50:25.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_addrtype.ko 2024-01-22T04:50:25.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_bpf.ko 2024-01-22T04:50:25.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cgroup.ko 2024-01-22T04:50:25.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cluster.ko 2024-01-22T04:50:25.897 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_comment.ko 2024-01-22T04:50:25.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connbytes.ko 2024-01-22T04:50:25.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlabel.ko 2024-01-22T04:50:25.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlimit.ko 2024-01-22T04:50:25.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connmark.ko 2024-01-22T04:50:25.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_conntrack.ko 2024-01-22T04:50:25.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cpu.ko 2024-01-22T04:50:25.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dccp.ko 2024-01-22T04:50:25.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_devgroup.ko 2024-01-22T04:50:25.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dscp.ko 2024-01-22T04:50:25.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ecn.ko 2024-01-22T04:50:25.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_esp.ko 2024-01-22T04:50:25.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hashlimit.ko 2024-01-22T04:50:25.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_helper.ko 2024-01-22T04:50:25.898 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hl.ko 2024-01-22T04:50:25.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipcomp.ko 2024-01-22T04:50:25.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_iprange.ko 2024-01-22T04:50:25.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipvs.ko 2024-01-22T04:50:25.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_l2tp.ko 2024-01-22T04:50:25.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_length.ko 2024-01-22T04:50:25.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_limit.ko 2024-01-22T04:50:25.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mac.ko 2024-01-22T04:50:25.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mark.ko 2024-01-22T04:50:25.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_multiport.ko 2024-01-22T04:50:25.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nat.ko 2024-01-22T04:50:25.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nfacct.ko 2024-01-22T04:50:25.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_osf.ko 2024-01-22T04:50:25.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_owner.ko 2024-01-22T04:50:25.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_physdev.ko 2024-01-22T04:50:25.899 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_pkttype.ko 2024-01-22T04:50:25.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_policy.ko 2024-01-22T04:50:25.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_quota.ko 2024-01-22T04:50:25.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_rateest.ko 2024-01-22T04:50:25.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_realm.ko 2024-01-22T04:50:25.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_recent.ko 2024-01-22T04:50:25.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_sctp.ko 2024-01-22T04:50:25.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_set.ko 2024-01-22T04:50:25.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_socket.ko 2024-01-22T04:50:25.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_state.ko 2024-01-22T04:50:25.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_statistic.ko 2024-01-22T04:50:25.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_string.ko 2024-01-22T04:50:25.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_tcpmss.ko 2024-01-22T04:50:25.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_tcpudp.ko 2024-01-22T04:50:25.900 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_time.ko 2024-01-22T04:50:25.901 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_u32.ko 2024-01-22T04:50:25.901 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netlink/ 2024-01-22T04:50:25.901 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netlink/netlink_diag.ko 2024-01-22T04:50:25.901 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/nsh/ 2024-01-22T04:50:25.901 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/nsh/nsh.ko 2024-01-22T04:50:25.901 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/ 2024-01-22T04:50:25.901 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 383481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/openvswitch.ko 2024-01-22T04:50:25.901 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-geneve.ko 2024-01-22T04:50:25.901 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-gre.ko 2024-01-22T04:50:25.901 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-vxlan.ko 2024-01-22T04:50:25.901 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/packet/ 2024-01-22T04:50:25.901 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/packet/af_packet_diag.ko 2024-01-22T04:50:25.901 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/phonet/ 2024-01-22T04:50:25.901 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 112057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/phonet/phonet.ko 2024-01-22T04:50:25.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/phonet/pn_pep.ko 2024-01-22T04:50:25.902 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/ 2024-01-22T04:50:25.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 252953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds.ko 2024-01-22T04:50:25.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 164937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_rdma.ko 2024-01-22T04:50:25.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_tcp.ko 2024-01-22T04:50:25.902 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rxrpc/ 2024-01-22T04:50:25.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 818777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rxrpc/rxrpc.ko 2024-01-22T04:50:25.902 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/ 2024-01-22T04:50:25.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_csum.ko 2024-01-22T04:50:25.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_gact.ko 2024-01-22T04:50:25.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_ipt.ko 2024-01-22T04:50:25.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_mirred.ko 2024-01-22T04:50:25.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_nat.ko 2024-01-22T04:50:25.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_pedit.ko 2024-01-22T04:50:25.902 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_police.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_simple.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_skbedit.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_vlan.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_basic.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_bpf.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_cgroup.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_flow.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_fw.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_route.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_u32.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_cmp.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_ipset.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_meta.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_nbyte.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_text.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_u32.ko 2024-01-22T04:50:25.903 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_choke.ko 2024-01-22T04:50:25.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_codel.ko 2024-01-22T04:50:25.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_drr.ko 2024-01-22T04:50:25.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_fq.ko 2024-01-22T04:50:25.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_fq_codel.ko 2024-01-22T04:50:25.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_gred.ko 2024-01-22T04:50:25.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hfsc.ko 2024-01-22T04:50:25.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hhf.ko 2024-01-22T04:50:25.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_htb.ko 2024-01-22T04:50:25.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_ingress.ko 2024-01-22T04:50:25.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio.ko 2024-01-22T04:50:25.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio_lib.ko 2024-01-22T04:50:25.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_multiq.ko 2024-01-22T04:50:25.904 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_netem.ko 2024-01-22T04:50:25.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_pie.ko 2024-01-22T04:50:25.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_plug.ko 2024-01-22T04:50:25.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_prio.ko 2024-01-22T04:50:25.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_qfq.ko 2024-01-22T04:50:25.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_red.ko 2024-01-22T04:50:25.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfb.ko 2024-01-22T04:50:25.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfq.ko 2024-01-22T04:50:25.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_tbf.ko 2024-01-22T04:50:25.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_teql.ko 2024-01-22T04:50:25.905 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/ 2024-01-22T04:50:25.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 932169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp.ko 2024-01-22T04:50:25.905 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp_diag.ko 2024-01-22T04:50:25.905 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/ 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/ 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 336777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1518417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/sunrpc.ko 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma/ 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 708281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/ 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/diag.ko 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 866345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/tipc.ko 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/unix/ 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/unix/unix_diag.ko 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/ 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 86417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 98017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock.ko 2024-01-22T04:50:25.906 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/x25/ 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/x25/x25.ko 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/ 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_algo.ko 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 104161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_user.ko 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/virt/ 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/virt/lib/ 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/virt/lib/irqbypass.ko 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 641009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.alias 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 625033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.alias.bin 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7677 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23634 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin.alias.bin 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9916 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin.bin 2024-01-22T04:50:25.907 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70653 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin.modinfo 2024-01-22T04:50:25.908 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 147734 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.dep 2024-01-22T04:50:25.908 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 234045 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.dep.bin 2024-01-22T04:50:25.908 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 210 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.devname 2024-01-22T04:50:25.908 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72797 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.order 2024-01-22T04:50:25.908 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 879 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.softdep 2024-01-22T04:50:25.908 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 255175 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.symbols 2024-01-22T04:50:25.908 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 309826 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.symbols.bin 2024-01-22T04:50:25.908 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/ 2024-01-22T04:50:25.908 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/share/ 2024-01-22T04:50:25.908 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/share/doc/ 2024-01-22T04:50:25.908 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/share/doc/linux-image-6.7.0-g06652275eb93/ 2024-01-22T04:50:25.908 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 172 2024-01-18 11:42 ./usr/share/doc/linux-image-6.7.0-g06652275eb93/changelog.Debian.gz 2024-01-22T04:50:25.908 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 691 2024-01-18 11:42 ./usr/share/doc/linux-image-6.7.0-g06652275eb93/copyright 2024-01-22T04:50:25.909 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-g06652275eb93 2024-01-22T04:50:25.909 INFO:teuthology.task.kernel:searching for kernel 6.7.0-g06652275eb93 2024-01-22T04:50:25.910 DEBUG:teuthology.orchestra.run.smithi110:> egrep '(submenu|menuentry.*6.7.0-g06652275eb93).*{' /boot/grub/grub.cfg 2024-01-22T04:50:25.918 INFO:teuthology.orchestra.run.smithi110.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-01-22T04:50:25.918 INFO:teuthology.orchestra.run.smithi110.stdout: menuentry 'Ubuntu, with Linux 6.7.0-g06652275eb93' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-g06652275eb93-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-01-22T04:50:25.918 INFO:teuthology.orchestra.run.smithi110.stdout: menuentry 'Ubuntu, with Linux 6.7.0-g06652275eb93 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-g06652275eb93-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-01-22T04:50:25.919 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-22T04:50:25.919 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.7.0-g06652275eb93 2024-01-22T04:50:25.919 DEBUG:teuthology.orchestra.run.smithi110:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-22T04:50:25.921 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi110.front.sepia.ceph.com to complete... 2024-01-22T04:50:26.567 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub' 2024-01-22T04:50:26.574 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-22T04:50:26.596 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-01-22T04:50:26.677 INFO:teuthology.orchestra.run.smithi049.stderr:done 2024-01-22T04:50:26.889 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-6.7.0-g06652275eb93 2024-01-22T04:50:26.901 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-6.7.0-g06652275eb93 2024-01-22T04:50:27.305 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-01-22T04:50:27.317 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-01-22T04:50:28.896 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-01-22T04:50:57.832 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-01-22T04:50:57.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-22T04:50:57.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:51:00.005 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-01-22T04:51:00.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-01-22T04:51:00.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:51:32.284 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-22T04:51:41.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-22T04:51:41.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:51:44.348 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-22T04:51:56.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-22T04:51:56.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:51:59.423 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-22T04:52:00.009 DEBUG:teuthology.orchestra.remote:timed out 2024-01-22T04:52:09.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-01-22T04:52:09.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:52:09.800 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-01-22T04:52:10.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-01-22T04:52:10.878 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.7.0-g06652275eb93"... 2024-01-22T04:52:10.878 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-01-22T04:52:10.933 INFO:teuthology.orchestra.run.smithi110.stdout:6.7.0-g06652275eb93 2024-01-22T04:52:10.934 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-g06652275eb93 vs 6.7.0-g06652275eb93 2024-01-22T04:52:10.934 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-22T04:52:10.934 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-22T04:52:11.938 DEBUG:teuthology.parallel:result is None 2024-01-22T04:52:14.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-22T04:52:14.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:53:14.427 DEBUG:teuthology.orchestra.remote:timed out 2024-01-22T04:53:32.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-22T04:53:32.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:53:32.693 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-01-22T04:53:33.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-22T04:53:33.376 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.7.0-g06652275eb93"... 2024-01-22T04:53:33.376 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-01-22T04:53:33.437 INFO:teuthology.orchestra.run.smithi049.stdout:6.7.0-g06652275eb93 2024-01-22T04:53:33.437 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-g06652275eb93 vs 6.7.0-g06652275eb93 2024-01-22T04:53:33.437 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-22T04:53:33.437 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-22T04:53:34.438 DEBUG:teuthology.parallel:result is None 2024-01-22T04:53:34.439 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-22T04:53:34.447 INFO:teuthology.task.internal:Creating test directory... 2024-01-22T04:53:34.447 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-22T04:53:34.453 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-22T04:53:34.475 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-22T04:53:34.484 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-22T04:53:34.494 INFO:teuthology.task.internal:Creating archive directory... 2024-01-22T04:53:34.494 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-22T04:53:34.513 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-22T04:53:34.548 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-22T04:53:34.554 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-22T04:53:34.554 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-22T04:53:34.584 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-22T04:53:34.688 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-22T04:53:34.704 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-22T04:53:34.716 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-22T04:53:34.735 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-22T04:53:34.738 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-22T04:53:34.745 INFO:teuthology.task.internal:Configuring sudo... 2024-01-22T04:53:34.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-22T04:53:34.751 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-22T04:53:34.787 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-22T04:53:34.853 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-22T04:53:34.853 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-22T04:53:34.859 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-22T04:53:34.877 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-22T04:53:34.930 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-22T04:53:34.988 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T04:53:34.988 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-22T04:53:35.069 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-22T04:53:35.081 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-22T04:53:35.137 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T04:53:35.137 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-22T04:53:35.218 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2024-01-22T04:53:35.224 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-01-22T04:53:35.373 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-22T04:53:35.381 INFO:teuthology.task.internal:Starting timer... 2024-01-22T04:53:35.381 INFO:teuthology.run_tasks:Running task pcp... 2024-01-22T04:53:35.394 INFO:teuthology.run_tasks:Running task selinux... 2024-01-22T04:53:35.402 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-01-22T04:53:35.402 DEBUG:teuthology.task.selinux:Excluding smithi049: OS 'ubuntu' does not support SELinux 2024-01-22T04:53:35.402 DEBUG:teuthology.task.selinux:Excluding smithi110: OS 'ubuntu' does not support SELinux 2024-01-22T04:53:35.402 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-22T04:53:35.403 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-01-22T04:53:35.403 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-22T04:53:35.403 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-22T04:53:35.446 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-22T04:53:35.461 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-22T04:53:35.463 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi049.front.sepia.ceph.com,smithi110.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-22T05:00:25.988 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com')] 2024-01-22T05:00:25.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-22T05:00:25.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T05:00:26.095 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-01-22T05:00:26.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-22T05:00:26.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-01-22T05:00:26.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T05:00:26.421 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-01-22T05:00:26.663 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-01-22T05:00:26.663 INFO:teuthology.run_tasks:Running task clock... 2024-01-22T05:00:26.674 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-22T05:00:26.674 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-22T05:00:26.674 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-22T05:00:26.680 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-22T05:00:26.680 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-22T05:00:26.755 INFO:teuthology.orchestra.run.smithi049.stdout:22 Jan 05:00:26 ntpd[12561]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-01-22T05:00:26.755 INFO:teuthology.orchestra.run.smithi049.stdout:22 Jan 05:00:26 ntpd[12561]: Command line: ntpd -gq 2024-01-22T05:00:26.756 INFO:teuthology.orchestra.run.smithi049.stdout:22 Jan 05:00:26 ntpd[12561]: proto: precision = 0.070 usec (-24) 2024-01-22T05:00:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-22T05:00:26.757 INFO:teuthology.orchestra.run.smithi049.stdout:22 Jan 05:00:26 ntpd[12561]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-22T05:00:26.757 INFO:teuthology.orchestra.run.smithi049.stdout:22 Jan 05:00:26 ntpd[12561]: restrict ::: KOD does nothing without LIMITED. 2024-01-22T05:00:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-22T05:00:26.758 INFO:teuthology.orchestra.run.smithi049.stdout:22 Jan 05:00:26 ntpd[12561]: Listen and drop on 0 v6wildcard [::]:123 2024-01-22T05:00:26.758 INFO:teuthology.orchestra.run.smithi049.stdout:22 Jan 05:00:26 ntpd[12561]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-22T05:00:26.758 INFO:teuthology.orchestra.run.smithi049.stdout:22 Jan 05:00:26 ntpd[12561]: Listen normally on 2 lo 127.0.0.1:123 2024-01-22T05:00:26.758 INFO:teuthology.orchestra.run.smithi049.stdout:22 Jan 05:00:26 ntpd[12561]: Listen normally on 3 ens1f0 172.21.15.49:123 2024-01-22T05:00:26.758 INFO:teuthology.orchestra.run.smithi049.stdout:22 Jan 05:00:26 ntpd[12561]: Listen normally on 4 lo [::1]:123 2024-01-22T05:00:26.759 INFO:teuthology.orchestra.run.smithi049.stdout:22 Jan 05:00:26 ntpd[12561]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1566%3]:123 2024-01-22T05:00:26.759 INFO:teuthology.orchestra.run.smithi049.stdout:22 Jan 05:00:26 ntpd[12561]: Listening on routing socket on fd #22 for interface updates 2024-01-22T05:00:26.783 INFO:teuthology.orchestra.run.smithi110.stdout:22 Jan 05:00:26 ntpd[12584]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-01-22T05:00:26.783 INFO:teuthology.orchestra.run.smithi110.stdout:22 Jan 05:00:26 ntpd[12584]: Command line: ntpd -gq 2024-01-22T05:00:26.783 INFO:teuthology.orchestra.run.smithi110.stdout:22 Jan 05:00:26 ntpd[12584]: proto: precision = 0.062 usec (-24) 2024-01-22T05:00:26.784 INFO:teuthology.orchestra.run.smithi110.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-22T05:00:26.784 INFO:teuthology.orchestra.run.smithi110.stdout:22 Jan 05:00:26 ntpd[12584]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-22T05:00:26.784 INFO:teuthology.orchestra.run.smithi110.stdout:22 Jan 05:00:26 ntpd[12584]: restrict ::: KOD does nothing without LIMITED. 2024-01-22T05:00:26.785 INFO:teuthology.orchestra.run.smithi110.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-22T05:00:26.785 INFO:teuthology.orchestra.run.smithi110.stdout:22 Jan 05:00:26 ntpd[12584]: Listen and drop on 0 v6wildcard [::]:123 2024-01-22T05:00:26.785 INFO:teuthology.orchestra.run.smithi110.stdout:22 Jan 05:00:26 ntpd[12584]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-22T05:00:26.785 INFO:teuthology.orchestra.run.smithi110.stdout:22 Jan 05:00:26 ntpd[12584]: Listen normally on 2 lo 127.0.0.1:123 2024-01-22T05:00:26.785 INFO:teuthology.orchestra.run.smithi110.stdout:22 Jan 05:00:26 ntpd[12584]: Listen normally on 3 enp3s0f1 172.21.15.110:123 2024-01-22T05:00:26.786 INFO:teuthology.orchestra.run.smithi110.stdout:22 Jan 05:00:26 ntpd[12584]: Listen normally on 4 lo [::1]:123 2024-01-22T05:00:26.786 INFO:teuthology.orchestra.run.smithi110.stdout:22 Jan 05:00:26 ntpd[12584]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc35%5]:123 2024-01-22T05:00:26.786 INFO:teuthology.orchestra.run.smithi110.stdout:22 Jan 05:00:26 ntpd[12584]: Listening on routing socket on fd #22 for interface updates 2024-01-22T05:00:27.756 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:27 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:27.756 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:27 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:27.756 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:27 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:27.756 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:27 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:27.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:27 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:27.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:27 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:27.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:27 ntpd[12561]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:27.758 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:27 ntpd[12561]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:27.782 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:27 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:27.782 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:27 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:28.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:28 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:28.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:28 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:28.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:28 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:28.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:28 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:28.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:28 ntpd[12584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:28.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:28 ntpd[12584]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:29.756 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:29 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:29.756 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:29 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:29.756 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:29 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:29.756 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:29 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:29.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:29 ntpd[12561]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:29.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:29 ntpd[12561]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:29.782 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:29 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:29.782 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:29 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:29.782 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:29 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:29.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:29 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:29.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:29 ntpd[12584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:29.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:29 ntpd[12584]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:30.756 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:30 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:30.756 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:30 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:30.756 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:30 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:30.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:30 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:30.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:30 ntpd[12561]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:30.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:30 ntpd[12561]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:30.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:30 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:30.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:30 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:30.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:30 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:30.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:30 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:30.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:30 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:30.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:30 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:30.784 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:30 ntpd[12584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:30.784 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:30 ntpd[12584]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:30.784 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:30 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:30.784 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:30 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:30.784 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:30 ntpd[12584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:30.784 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:30 ntpd[12584]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:31.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:31 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:31.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:31 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:31.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:31 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:31.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:31 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:31.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:31 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:31.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:31 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:31.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:31 ntpd[12561]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:31.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:31 ntpd[12561]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:31.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:31 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:31.758 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:31 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:31.758 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:31 ntpd[12561]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:31.758 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:31 ntpd[12561]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:31.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:31 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:31.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:31 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:31.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:31 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:31.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:31 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:31.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:31 ntpd[12584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:31.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:31 ntpd[12584]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:32.756 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:32 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:32.756 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:32 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:32.756 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:32 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:32.756 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:32 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:32.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:32 ntpd[12561]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:32.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:32 ntpd[12561]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:32.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:32 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:32.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:32 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:32.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:32 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:32.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:32 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:32.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:32 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:32.784 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:32 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:32.784 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:32 ntpd[12584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:32.784 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:32 ntpd[12584]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:32.784 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:32 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:32.784 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:32 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:32.784 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:32 ntpd[12584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:32.784 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:32 ntpd[12584]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:33 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:33 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:33 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:33 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:33 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:33 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:33 ntpd[12561]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:33 ntpd[12561]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:33 ntpd[12561]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:33 ntpd[12561]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:33 ntpd[12561]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:33 ntpd[12561]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:33.758 INFO:teuthology.orchestra.run.smithi049.stdout:22 Jan 05:00:33 ntpd[12561]: ntpd: time slew -0.002232 s 2024-01-22T05:00:33.758 INFO:teuthology.orchestra.run.smithi049.stdout:ntpd: time slew -0.002232s 2024-01-22T05:00:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:33 ntpd[12561]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-22T05:00:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:22 Jan 05:00:33 ntpd[12561]: can't open /var/log/ntpstats/loopstats.20240122: Permission denied 2024-01-22T05:00:33.782 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:33 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:33.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:33 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:33.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:33 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:33.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:33 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:33.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:33 ntpd[12584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:33.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:33 ntpd[12584]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: remote refid st t when poll reach delay offset jitter 2024-01-22T05:00:33.898 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================== 2024-01-22T05:00:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-22T05:00:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-22T05:00:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-22T05:00:33.898 INFO:teuthology.orchestra.run.smithi049.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-22T05:00:34.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:34 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:34.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:34 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:34.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:34 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:34.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:34 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:34.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:34 ntpd[12584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-22T05:00:34.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:34 ntpd[12584]: can't open /var/log/ntpstats/rawstats.20240122: Permission denied 2024-01-22T05:00:34.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:34 ntpd[12584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-22T05:00:34.783 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:34 ntpd[12584]: can't open /var/log/ntpstats/peerstats.20240122: Permission denied 2024-01-22T05:00:34.784 INFO:teuthology.orchestra.run.smithi110.stdout:22 Jan 05:00:34 ntpd[12584]: ntpd: time slew -0.000312 s 2024-01-22T05:00:34.784 INFO:teuthology.orchestra.run.smithi110.stdout:ntpd: time slew -0.000312s 2024-01-22T05:00:34.784 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:34 ntpd[12584]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-22T05:00:34.784 INFO:teuthology.orchestra.run.smithi110.stderr:22 Jan 05:00:34 ntpd[12584]: can't open /var/log/ntpstats/loopstats.20240122: Permission denied 2024-01-22T05:00:34.929 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2024-01-22T05:00:34.929 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2024-01-22T05:00:34.929 INFO:teuthology.orchestra.run.smithi110.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-22T05:00:34.929 INFO:teuthology.orchestra.run.smithi110.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-22T05:00:34.929 INFO:teuthology.orchestra.run.smithi110.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-22T05:00:34.929 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-22T05:00:34.931 INFO:teuthology.run_tasks:Running task install... 2024-01-22T05:00:34.941 DEBUG:teuthology.task.install:project ceph 2024-01-22T05:00:34.941 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32'}} 2024-01-22T05:00:34.941 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32'} 2024-01-22T05:00:34.941 INFO:teuthology.task.install:Using flavor: default 2024-01-22T05:00:34.947 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-22T05:00:34.947 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-01-22T05:00:34.948 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-key list | grep Ceph 2024-01-22T05:00:34.948 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-key list | grep Ceph 2024-01-22T05:00:35.164 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-01-22T05:00:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-01-22T05:00:35.303 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-22T05:00:35.304 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph.com (release key) 2024-01-22T05:00:35.305 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-22T05:00:35.305 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-01-22T05:00:35.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 2024-01-22T05:00:35.310 INFO:teuthology.orchestra.run.smithi049.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-22T05:00:35.310 INFO:teuthology.orchestra.run.smithi049.stdout:uid [ unknown] Ceph.com (release key) 2024-01-22T05:00:35.311 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-22T05:00:35.311 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-01-22T05:00:35.311 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 2024-01-22T05:00:35.524 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default/ 2024-01-22T05:00:35.524 INFO:teuthology.task.install.deb:Package version is 16.2.14-452-g9854ba8e-1focal 2024-01-22T05:00:35.536 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default/ 2024-01-22T05:00:35.536 INFO:teuthology.task.install.deb:Package version is 16.2.14-452-g9854ba8e-1focal 2024-01-22T05:00:35.706 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:00:35.706 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-22T05:00:35.713 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:00:35.713 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-22T05:00:35.733 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-01-22T05:00:35.746 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get update 2024-01-22T05:00:36.019 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-01-22T05:00:36.019 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-01-22T05:00:36.038 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-01-22T05:00:36.042 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-01-22T05:00:36.078 INFO:teuthology.orchestra.run.smithi049.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal InRelease 2024-01-22T05:00:36.100 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal Release [7,680 B] 2024-01-22T05:00:36.119 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal InRelease 2024-01-22T05:00:36.124 INFO:teuthology.orchestra.run.smithi049.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal Release.gpg 2024-01-22T05:00:36.135 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2024-01-22T05:00:36.141 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-01-22T05:00:36.147 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 Packages [17.2 kB] 2024-01-22T05:00:36.157 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal Release [7,680 B] 2024-01-22T05:00:36.196 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal Release.gpg 2024-01-22T05:00:36.201 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main i386 Packages [3,101 B] 2024-01-22T05:00:36.219 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-01-22T05:00:36.233 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 Packages [17.2 kB] 2024-01-22T05:00:36.299 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-01-22T05:00:36.323 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main i386 Packages [3,101 B] 2024-01-22T05:00:37.381 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 28.0 kB in 1s (21.2 kB/s) 2024-01-22T05:00:37.473 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 28.0 kB in 1s (20.4 kB/s) 2024-01-22T05:00:38.594 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-01-22T05:00:38.626 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.14-452-g9854ba8e-1focal cephadm=16.2.14-452-g9854ba8e-1focal ceph-mds=16.2.14-452-g9854ba8e-1focal ceph-mgr=16.2.14-452-g9854ba8e-1focal ceph-common=16.2.14-452-g9854ba8e-1focal ceph-fuse=16.2.14-452-g9854ba8e-1focal ceph-test=16.2.14-452-g9854ba8e-1focal radosgw=16.2.14-452-g9854ba8e-1focal python3-rados=16.2.14-452-g9854ba8e-1focal python3-rgw=16.2.14-452-g9854ba8e-1focal python3-cephfs=16.2.14-452-g9854ba8e-1focal python3-rbd=16.2.14-452-g9854ba8e-1focal libcephfs2=16.2.14-452-g9854ba8e-1focal libcephfs-dev=16.2.14-452-g9854ba8e-1focal librados2=16.2.14-452-g9854ba8e-1focal librbd1=16.2.14-452-g9854ba8e-1focal rbd-fuse=16.2.14-452-g9854ba8e-1focal python3-cephfs=16.2.14-452-g9854ba8e-1focal cephfs-shell=16.2.14-452-g9854ba8e-1focal cephfs-top=16.2.14-452-g9854ba8e-1focal cephfs-mirror=16.2.14-452-g9854ba8e-1focal 2024-01-22T05:00:38.722 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-01-22T05:00:38.754 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-01-22T05:00:38.758 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.14-452-g9854ba8e-1focal cephadm=16.2.14-452-g9854ba8e-1focal ceph-mds=16.2.14-452-g9854ba8e-1focal ceph-mgr=16.2.14-452-g9854ba8e-1focal ceph-common=16.2.14-452-g9854ba8e-1focal ceph-fuse=16.2.14-452-g9854ba8e-1focal ceph-test=16.2.14-452-g9854ba8e-1focal radosgw=16.2.14-452-g9854ba8e-1focal python3-rados=16.2.14-452-g9854ba8e-1focal python3-rgw=16.2.14-452-g9854ba8e-1focal python3-cephfs=16.2.14-452-g9854ba8e-1focal python3-rbd=16.2.14-452-g9854ba8e-1focal libcephfs2=16.2.14-452-g9854ba8e-1focal libcephfs-dev=16.2.14-452-g9854ba8e-1focal librados2=16.2.14-452-g9854ba8e-1focal librbd1=16.2.14-452-g9854ba8e-1focal rbd-fuse=16.2.14-452-g9854ba8e-1focal python3-cephfs=16.2.14-452-g9854ba8e-1focal cephfs-shell=16.2.14-452-g9854ba8e-1focal cephfs-top=16.2.14-452-g9854ba8e-1focal cephfs-mirror=16.2.14-452-g9854ba8e-1focal 2024-01-22T05:00:38.885 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-01-22T05:00:38.961 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-01-22T05:00:38.962 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-01-22T05:00:39.101 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2024-01-22T05:00:39.101 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2024-01-22T05:00:39.145 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-01-22T05:00:39.147 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-01-22T05:00:39.147 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-22T05:00:39.147 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2024-01-22T05:00:39.147 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-22T05:00:39.147 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2024-01-22T05:00:39.147 INFO:teuthology.orchestra.run.smithi110.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2024-01-22T05:00:39.147 INFO:teuthology.orchestra.run.smithi110.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2024-01-22T05:00:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2024-01-22T05:00:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-01-22T05:00:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2024-01-22T05:00:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2024-01-22T05:00:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2024-01-22T05:00:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2024-01-22T05:00:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2024-01-22T05:00:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-01-22T05:00:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-01-22T05:00:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-01-22T05:00:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-01-22T05:00:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-01-22T05:00:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-01-22T05:00:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-01-22T05:00:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2024-01-22T05:00:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet 2024-01-22T05:00:39.149 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2024-01-22T05:00:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2024-01-22T05:00:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-01-22T05:00:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-01-22T05:00:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-01-22T05:00:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-01-22T05:00:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-01-22T05:00:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-22T05:00:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-01-22T05:00:39.150 INFO:teuthology.orchestra.run.smithi110.stdout:Recommended packages: 2024-01-22T05:00:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: btrfs-tools 2024-01-22T05:00:39.312 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2024-01-22T05:00:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-01-22T05:00:39.313 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-22T05:00:39.313 INFO:teuthology.orchestra.run.smithi049.stdout:The following additional packages will be installed: 2024-01-22T05:00:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-22T05:00:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2024-01-22T05:00:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2024-01-22T05:00:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2024-01-22T05:00:39.314 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2024-01-22T05:00:39.314 INFO:teuthology.orchestra.run.smithi049.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-01-22T05:00:39.314 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2024-01-22T05:00:39.314 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2024-01-22T05:00:39.314 INFO:teuthology.orchestra.run.smithi049.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2024-01-22T05:00:39.314 INFO:teuthology.orchestra.run.smithi049.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2024-01-22T05:00:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2024-01-22T05:00:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-01-22T05:00:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-01-22T05:00:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-01-22T05:00:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-01-22T05:00:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-01-22T05:00:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-01-22T05:00:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-01-22T05:00:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2024-01-22T05:00:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet 2024-01-22T05:00:39.316 INFO:teuthology.orchestra.run.smithi049.stdout:Suggested packages: 2024-01-22T05:00:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2024-01-22T05:00:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-01-22T05:00:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-01-22T05:00:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-01-22T05:00:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-01-22T05:00:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-01-22T05:00:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-22T05:00:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-01-22T05:00:39.316 INFO:teuthology.orchestra.run.smithi049.stdout:Recommended packages: 2024-01-22T05:00:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: btrfs-tools 2024-01-22T05:00:39.329 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2024-01-22T05:00:39.329 INFO:teuthology.orchestra.run.smithi110.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-22T05:00:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-22T05:00:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm cephfs-mirror 2024-01-22T05:00:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 libjaeger libjq1 2024-01-22T05:00:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d liblttng-ust0 2024-01-22T05:00:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2024-01-22T05:00:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2024-01-22T05:00:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-01-22T05:00:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-22T05:00:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2024-01-22T05:00:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2024-01-22T05:00:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2024-01-22T05:00:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2024-01-22T05:00:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-01-22T05:00:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-01-22T05:00:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-01-22T05:00:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-01-22T05:00:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-22T05:00:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-01-22T05:00:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-01-22T05:00:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-01-22T05:00:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2024-01-22T05:00:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse socat xmlstarlet 2024-01-22T05:00:39.333 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages will be upgraded: 2024-01-22T05:00:39.333 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 librbd1 2024-01-22T05:00:39.428 INFO:teuthology.orchestra.run.smithi110.stdout:2 upgraded, 104 newly installed, 0 to remove and 264 not upgraded. 2024-01-22T05:00:39.428 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 174 MB of archives. 2024-01-22T05:00:39.428 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 806 MB of additional disk space will be used. 2024-01-22T05:00:39.428 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-01-22T05:00:39.451 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-01-22T05:00:39.461 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-01-22T05:00:39.492 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.14-452-g9854ba8e-1focal [3,964 B] 2024-01-22T05:00:39.495 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-01-22T05:00:39.512 INFO:teuthology.orchestra.run.smithi049.stdout:The following NEW packages will be installed: 2024-01-22T05:00:39.512 INFO:teuthology.orchestra.run.smithi049.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-22T05:00:39.512 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-22T05:00:39.512 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm cephfs-mirror 2024-01-22T05:00:39.512 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 libjaeger libjq1 2024-01-22T05:00:39.512 INFO:teuthology.orchestra.run.smithi049.stdout: libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d liblttng-ust0 2024-01-22T05:00:39.512 INFO:teuthology.orchestra.run.smithi049.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2024-01-22T05:00:39.513 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2024-01-22T05:00:39.513 INFO:teuthology.orchestra.run.smithi049.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-01-22T05:00:39.513 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-22T05:00:39.513 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2024-01-22T05:00:39.513 INFO:teuthology.orchestra.run.smithi049.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2024-01-22T05:00:39.513 INFO:teuthology.orchestra.run.smithi049.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2024-01-22T05:00:39.514 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2024-01-22T05:00:39.514 INFO:teuthology.orchestra.run.smithi049.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-01-22T05:00:39.514 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-01-22T05:00:39.514 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-01-22T05:00:39.514 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-01-22T05:00:39.514 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-22T05:00:39.514 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-01-22T05:00:39.514 INFO:teuthology.orchestra.run.smithi049.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-01-22T05:00:39.514 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-01-22T05:00:39.514 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2024-01-22T05:00:39.514 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse socat xmlstarlet 2024-01-22T05:00:39.515 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages will be upgraded: 2024-01-22T05:00:39.515 INFO:teuthology.orchestra.run.smithi049.stdout: librados2 librbd1 2024-01-22T05:00:39.530 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-01-22T05:00:39.532 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-01-22T05:00:39.536 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.14-452-g9854ba8e-1focal [3,385 kB] 2024-01-22T05:00:39.544 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-01-22T05:00:39.546 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-01-22T05:00:39.570 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2024-01-22T05:00:39.578 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-01-22T05:00:39.579 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.2 [211 kB] 2024-01-22T05:00:39.584 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-01-22T05:00:39.585 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-01-22T05:00:39.586 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-01-22T05:00:39.588 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-01-22T05:00:39.589 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-01-22T05:00:39.589 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-01-22T05:00:39.598 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-01-22T05:00:39.611 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-22T05:00:39.612 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-01-22T05:00:39.612 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-01-22T05:00:39.614 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-01-22T05:00:39.614 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-01-22T05:00:39.616 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-01-22T05:00:39.618 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-01-22T05:00:39.619 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-01-22T05:00:39.624 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-01-22T05:00:39.643 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-01-22T05:00:39.645 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-01-22T05:00:39.645 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-01-22T05:00:39.647 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-01-22T05:00:39.650 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2024-01-22T05:00:39.652 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-22T05:00:39.652 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-01-22T05:00:39.654 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-01-22T05:00:39.678 INFO:teuthology.orchestra.run.smithi049.stdout:2 upgraded, 104 newly installed, 0 to remove and 264 not upgraded. 2024-01-22T05:00:39.678 INFO:teuthology.orchestra.run.smithi049.stdout:Need to get 174 MB of archives. 2024-01-22T05:00:39.678 INFO:teuthology.orchestra.run.smithi049.stdout:After this operation, 806 MB of additional disk space will be used. 2024-01-22T05:00:39.678 INFO:teuthology.orchestra.run.smithi049.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.14-452-g9854ba8e-1focal [3,964 B] 2024-01-22T05:00:39.680 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-01-22T05:00:39.683 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-01-22T05:00:39.693 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-01-22T05:00:39.694 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-01-22T05:00:39.722 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.14-452-g9854ba8e-1focal [3,385 kB] 2024-01-22T05:00:39.733 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-01-22T05:00:39.737 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.14-452-g9854ba8e-1focal [3,424 kB] 2024-01-22T05:00:39.818 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-01-22T05:00:39.856 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-01-22T05:00:39.893 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.14-452-g9854ba8e-1focal [732 kB] 2024-01-22T05:00:39.900 INFO:teuthology.orchestra.run.smithi110.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-01-22T05:00:39.923 INFO:teuthology.orchestra.run.smithi110.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-01-22T05:00:39.924 INFO:teuthology.orchestra.run.smithi110.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-01-22T05:00:39.930 INFO:teuthology.orchestra.run.smithi110.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.14-452-g9854ba8e-1focal [413 kB] 2024-01-22T05:00:39.954 INFO:teuthology.orchestra.run.smithi110.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-01-22T05:00:39.955 INFO:teuthology.orchestra.run.smithi110.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-01-22T05:00:39.955 INFO:teuthology.orchestra.run.smithi110.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-01-22T05:00:39.956 INFO:teuthology.orchestra.run.smithi110.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-01-22T05:00:39.957 INFO:teuthology.orchestra.run.smithi110.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-01-22T05:00:39.957 INFO:teuthology.orchestra.run.smithi110.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-01-22T05:00:39.960 INFO:teuthology.orchestra.run.smithi110.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.14-452-g9854ba8e-1focal [22.2 kB] 2024-01-22T05:00:39.961 INFO:teuthology.orchestra.run.smithi110.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.14-452-g9854ba8e-1focal [212 kB] 2024-01-22T05:00:39.961 INFO:teuthology.orchestra.run.smithi110.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-01-22T05:00:39.963 INFO:teuthology.orchestra.run.smithi110.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-01-22T05:00:39.963 INFO:teuthology.orchestra.run.smithi110.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-01-22T05:00:39.967 INFO:teuthology.orchestra.run.smithi110.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.14-452-g9854ba8e-1focal [38.4 kB] 2024-01-22T05:00:39.968 INFO:teuthology.orchestra.run.smithi110.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.14-452-g9854ba8e-1focal [386 kB] 2024-01-22T05:00:39.992 INFO:teuthology.orchestra.run.smithi110.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-01-22T05:00:39.994 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-01-22T05:00:39.998 INFO:teuthology.orchestra.run.smithi110.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-01-22T05:00:40.000 INFO:teuthology.orchestra.run.smithi110.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-01-22T05:00:40.001 INFO:teuthology.orchestra.run.smithi110.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.14-452-g9854ba8e-1focal [3,707 kB] 2024-01-22T05:00:40.003 INFO:teuthology.orchestra.run.smithi110.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-01-22T05:00:40.005 INFO:teuthology.orchestra.run.smithi110.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-01-22T05:00:40.010 INFO:teuthology.orchestra.run.smithi110.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-01-22T05:00:40.014 INFO:teuthology.orchestra.run.smithi110.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-01-22T05:00:40.014 INFO:teuthology.orchestra.run.smithi110.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-01-22T05:00:40.017 INFO:teuthology.orchestra.run.smithi110.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-01-22T05:00:40.018 INFO:teuthology.orchestra.run.smithi110.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-01-22T05:00:40.033 INFO:teuthology.orchestra.run.smithi110.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-01-22T05:00:40.034 INFO:teuthology.orchestra.run.smithi110.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-01-22T05:00:40.036 INFO:teuthology.orchestra.run.smithi110.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-01-22T05:00:40.052 INFO:teuthology.orchestra.run.smithi110.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-01-22T05:00:40.052 INFO:teuthology.orchestra.run.smithi110.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-22T05:00:40.055 INFO:teuthology.orchestra.run.smithi110.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-01-22T05:00:40.055 INFO:teuthology.orchestra.run.smithi110.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-01-22T05:00:40.057 INFO:teuthology.orchestra.run.smithi110.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-01-22T05:00:40.058 INFO:teuthology.orchestra.run.smithi110.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-01-22T05:00:40.058 INFO:teuthology.orchestra.run.smithi110.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-01-22T05:00:40.071 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.14-452-g9854ba8e-1focal [3,424 kB] 2024-01-22T05:00:40.075 INFO:teuthology.orchestra.run.smithi110.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-01-22T05:00:40.127 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-01-22T05:00:40.136 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-01-22T05:00:40.181 INFO:teuthology.orchestra.run.smithi049.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-01-22T05:00:40.192 INFO:teuthology.orchestra.run.smithi049.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-01-22T05:00:40.255 INFO:teuthology.orchestra.run.smithi110.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.14-452-g9854ba8e-1focal [116 kB] 2024-01-22T05:00:40.257 INFO:teuthology.orchestra.run.smithi110.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.14-452-g9854ba8e-1focal [448 kB] 2024-01-22T05:00:40.275 INFO:teuthology.orchestra.run.smithi049.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2024-01-22T05:00:40.293 INFO:teuthology.orchestra.run.smithi049.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-01-22T05:00:40.299 INFO:teuthology.orchestra.run.smithi049.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.2 [211 kB] 2024-01-22T05:00:40.299 INFO:teuthology.orchestra.run.smithi110.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.14-452-g9854ba8e-1focal [22.5 MB] 2024-01-22T05:00:40.330 INFO:teuthology.orchestra.run.smithi049.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.14-452-g9854ba8e-1focal [732 kB] 2024-01-22T05:00:40.378 INFO:teuthology.orchestra.run.smithi049.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.14-452-g9854ba8e-1focal [413 kB] 2024-01-22T05:00:40.418 INFO:teuthology.orchestra.run.smithi049.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.14-452-g9854ba8e-1focal [22.2 kB] 2024-01-22T05:00:40.419 INFO:teuthology.orchestra.run.smithi049.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.14-452-g9854ba8e-1focal [212 kB] 2024-01-22T05:00:40.426 INFO:teuthology.orchestra.run.smithi049.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.14-452-g9854ba8e-1focal [38.4 kB] 2024-01-22T05:00:40.427 INFO:teuthology.orchestra.run.smithi049.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.14-452-g9854ba8e-1focal [386 kB] 2024-01-22T05:00:40.464 INFO:teuthology.orchestra.run.smithi049.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.14-452-g9854ba8e-1focal [3,707 kB] 2024-01-22T05:00:40.555 INFO:teuthology.orchestra.run.smithi049.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-01-22T05:00:40.697 INFO:teuthology.orchestra.run.smithi049.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.14-452-g9854ba8e-1focal [116 kB] 2024-01-22T05:00:40.699 INFO:teuthology.orchestra.run.smithi049.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.14-452-g9854ba8e-1focal [448 kB] 2024-01-22T05:00:40.740 INFO:teuthology.orchestra.run.smithi049.stdout:Get:25 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.14-452-g9854ba8e-1focal [22.5 MB] 2024-01-22T05:00:40.801 INFO:teuthology.orchestra.run.smithi049.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-01-22T05:00:40.831 INFO:teuthology.orchestra.run.smithi049.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-01-22T05:00:41.022 INFO:teuthology.orchestra.run.smithi049.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-01-22T05:00:41.033 INFO:teuthology.orchestra.run.smithi049.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-01-22T05:00:41.043 INFO:teuthology.orchestra.run.smithi049.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-01-22T05:00:41.051 INFO:teuthology.orchestra.run.smithi049.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-01-22T05:00:41.073 INFO:teuthology.orchestra.run.smithi049.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-22T05:00:41.076 INFO:teuthology.orchestra.run.smithi049.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-01-22T05:00:41.079 INFO:teuthology.orchestra.run.smithi049.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-01-22T05:00:41.106 INFO:teuthology.orchestra.run.smithi049.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-01-22T05:00:41.279 INFO:teuthology.orchestra.run.smithi049.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-01-22T05:00:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-01-22T05:00:41.684 INFO:teuthology.orchestra.run.smithi049.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-01-22T05:00:41.700 INFO:teuthology.orchestra.run.smithi049.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-01-22T05:00:41.880 INFO:teuthology.orchestra.run.smithi049.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-01-22T05:00:41.881 INFO:teuthology.orchestra.run.smithi049.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-01-22T05:00:41.886 INFO:teuthology.orchestra.run.smithi049.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-01-22T05:00:41.891 INFO:teuthology.orchestra.run.smithi049.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-01-22T05:00:41.905 INFO:teuthology.orchestra.run.smithi049.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-01-22T05:00:41.929 INFO:teuthology.orchestra.run.smithi049.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2024-01-22T05:00:41.940 INFO:teuthology.orchestra.run.smithi049.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-22T05:00:42.007 INFO:teuthology.orchestra.run.smithi049.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.14-452-g9854ba8e-1focal [5,916 kB] 2024-01-22T05:00:42.146 INFO:teuthology.orchestra.run.smithi049.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-01-22T05:00:42.324 INFO:teuthology.orchestra.run.smithi049.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.14-452-g9854ba8e-1focal [204 kB] 2024-01-22T05:00:42.345 INFO:teuthology.orchestra.run.smithi049.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.14-452-g9854ba8e-1focal [126 kB] 2024-01-22T05:00:42.349 INFO:teuthology.orchestra.run.smithi049.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.14-452-g9854ba8e-1focal [1,554 kB] 2024-01-22T05:00:42.436 INFO:teuthology.orchestra.run.smithi049.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.14-452-g9854ba8e-1focal [6,995 kB] 2024-01-22T05:00:42.503 INFO:teuthology.orchestra.run.smithi049.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-01-22T05:00:42.567 INFO:teuthology.orchestra.run.smithi049.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-01-22T05:00:42.631 INFO:teuthology.orchestra.run.smithi049.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-01-22T05:00:42.637 INFO:teuthology.orchestra.run.smithi049.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-01-22T05:00:42.653 INFO:teuthology.orchestra.run.smithi049.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-01-22T05:00:42.837 INFO:teuthology.orchestra.run.smithi049.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.14-452-g9854ba8e-1focal [26.3 MB] 2024-01-22T05:00:42.907 INFO:teuthology.orchestra.run.smithi110.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.14-452-g9854ba8e-1focal [5,916 kB] 2024-01-22T05:00:43.166 INFO:teuthology.orchestra.run.smithi049.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-01-22T05:00:43.240 INFO:teuthology.orchestra.run.smithi049.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-01-22T05:00:43.242 INFO:teuthology.orchestra.run.smithi049.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-01-22T05:00:43.280 INFO:teuthology.orchestra.run.smithi049.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-01-22T05:00:43.280 INFO:teuthology.orchestra.run.smithi049.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-01-22T05:00:43.446 INFO:teuthology.orchestra.run.smithi049.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-01-22T05:00:43.656 INFO:teuthology.orchestra.run.smithi049.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-01-22T05:00:43.681 INFO:teuthology.orchestra.run.smithi110.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.14-452-g9854ba8e-1focal [204 kB] 2024-01-22T05:00:43.701 INFO:teuthology.orchestra.run.smithi049.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-01-22T05:00:43.727 INFO:teuthology.orchestra.run.smithi110.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.14-452-g9854ba8e-1focal [126 kB] 2024-01-22T05:00:43.731 INFO:teuthology.orchestra.run.smithi110.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.14-452-g9854ba8e-1focal [1,554 kB] 2024-01-22T05:00:43.791 INFO:teuthology.orchestra.run.smithi049.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-01-22T05:00:43.815 INFO:teuthology.orchestra.run.smithi049.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-01-22T05:00:43.894 INFO:teuthology.orchestra.run.smithi049.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-01-22T05:00:43.906 INFO:teuthology.orchestra.run.smithi049.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-01-22T05:00:43.928 INFO:teuthology.orchestra.run.smithi049.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-01-22T05:00:43.949 INFO:teuthology.orchestra.run.smithi110.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.14-452-g9854ba8e-1focal [6,995 kB] 2024-01-22T05:00:44.022 INFO:teuthology.orchestra.run.smithi049.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-01-22T05:00:44.052 INFO:teuthology.orchestra.run.smithi049.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-01-22T05:00:44.073 INFO:teuthology.orchestra.run.smithi049.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-01-22T05:00:44.244 INFO:teuthology.orchestra.run.smithi049.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-01-22T05:00:44.317 INFO:teuthology.orchestra.run.smithi049.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.14-452-g9854ba8e-1focal [4,056 B] 2024-01-22T05:00:44.318 INFO:teuthology.orchestra.run.smithi049.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.14-452-g9854ba8e-1focal [837 kB] 2024-01-22T05:00:44.350 INFO:teuthology.orchestra.run.smithi049.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.14-452-g9854ba8e-1focal [2,327 kB] 2024-01-22T05:00:44.477 INFO:teuthology.orchestra.run.smithi049.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.14-452-g9854ba8e-1focal [77.4 kB] 2024-01-22T05:00:44.479 INFO:teuthology.orchestra.run.smithi049.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.14-452-g9854ba8e-1focal [100 kB] 2024-01-22T05:00:44.482 INFO:teuthology.orchestra.run.smithi049.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.14-452-g9854ba8e-1focal [2,824 kB] 2024-01-22T05:00:44.655 INFO:teuthology.orchestra.run.smithi049.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.14-452-g9854ba8e-1focal [7,892 kB] 2024-01-22T05:00:44.750 INFO:teuthology.orchestra.run.smithi049.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-01-22T05:00:44.800 INFO:teuthology.orchestra.run.smithi049.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-01-22T05:00:44.804 INFO:teuthology.orchestra.run.smithi049.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-01-22T05:00:44.831 INFO:teuthology.orchestra.run.smithi110.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.14-452-g9854ba8e-1focal [26.3 MB] 2024-01-22T05:00:44.876 INFO:teuthology.orchestra.run.smithi049.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-01-22T05:00:44.877 INFO:teuthology.orchestra.run.smithi049.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-01-22T05:00:44.883 INFO:teuthology.orchestra.run.smithi049.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-01-22T05:00:44.885 INFO:teuthology.orchestra.run.smithi049.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-01-22T05:00:44.898 INFO:teuthology.orchestra.run.smithi049.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-01-22T05:00:45.012 INFO:teuthology.orchestra.run.smithi049.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-01-22T05:00:45.012 INFO:teuthology.orchestra.run.smithi049.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-22T05:00:45.100 INFO:teuthology.orchestra.run.smithi049.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.14-452-g9854ba8e-1focal [4,176 B] 2024-01-22T05:00:45.100 INFO:teuthology.orchestra.run.smithi049.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.14-452-g9854ba8e-1focal [49.4 MB] 2024-01-22T05:00:45.180 INFO:teuthology.orchestra.run.smithi049.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-01-22T05:00:45.358 INFO:teuthology.orchestra.run.smithi049.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-01-22T05:00:45.592 INFO:teuthology.orchestra.run.smithi049.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-01-22T05:00:45.642 INFO:teuthology.orchestra.run.smithi049.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-01-22T05:00:45.656 INFO:teuthology.orchestra.run.smithi049.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-01-22T05:00:45.721 INFO:teuthology.orchestra.run.smithi049.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-01-22T05:00:47.624 INFO:teuthology.orchestra.run.smithi049.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 16.2.14-452-g9854ba8e-1focal [237 kB] 2024-01-22T05:00:47.626 INFO:teuthology.orchestra.run.smithi049.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 16.2.14-452-g9854ba8e-1focal [17.4 kB] 2024-01-22T05:00:47.626 INFO:teuthology.orchestra.run.smithi049.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 16.2.14-452-g9854ba8e-1focal [13.2 kB] 2024-01-22T05:00:47.627 INFO:teuthology.orchestra.run.smithi049.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.14-452-g9854ba8e-1focal [21.5 kB] 2024-01-22T05:00:47.627 INFO:teuthology.orchestra.run.smithi049.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.14-452-g9854ba8e-1focal [11.3 MB] 2024-01-22T05:00:48.206 INFO:teuthology.orchestra.run.smithi049.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.14-452-g9854ba8e-1focal [78.7 kB] 2024-01-22T05:00:48.445 INFO:teuthology.orchestra.run.smithi110.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.14-452-g9854ba8e-1focal [4,056 B] 2024-01-22T05:00:48.445 INFO:teuthology.orchestra.run.smithi110.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.14-452-g9854ba8e-1focal [837 kB] 2024-01-22T05:00:48.475 INFO:teuthology.orchestra.run.smithi110.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.14-452-g9854ba8e-1focal [2,327 kB] 2024-01-22T05:00:48.599 INFO:teuthology.orchestra.run.smithi110.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.14-452-g9854ba8e-1focal [77.4 kB] 2024-01-22T05:00:48.601 INFO:teuthology.orchestra.run.smithi110.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.14-452-g9854ba8e-1focal [100 kB] 2024-01-22T05:00:48.606 INFO:teuthology.orchestra.run.smithi110.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.14-452-g9854ba8e-1focal [2,824 kB] 2024-01-22T05:00:48.749 INFO:teuthology.orchestra.run.smithi110.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.14-452-g9854ba8e-1focal [7,892 kB] 2024-01-22T05:00:49.142 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 174 MB in 9s (20.1 MB/s) 2024-01-22T05:00:49.170 INFO:teuthology.orchestra.run.smithi110.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.14-452-g9854ba8e-1focal [4,176 B] 2024-01-22T05:00:49.171 INFO:teuthology.orchestra.run.smithi110.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.14-452-g9854ba8e-1focal [49.4 MB] 2024-01-22T05:00:49.327 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-22T05:00:49.391 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2024-01-22T05:00:49.394 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-01-22T05:00:49.433 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-01-22T05:00:49.803 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-22T05:00:49.816 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-01-22T05:00:49.853 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-01-22T05:00:50.180 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cmd2. 2024-01-22T05:00:50.193 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-01-22T05:00:50.247 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-01-22T05:00:50.525 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libjaeger. 2024-01-22T05:00:50.538 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../003-libjaeger_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:50.566 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libjaeger (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:50.919 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-01-22T05:00:50.938 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../004-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-01-22T05:00:51.019 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-01-22T05:00:51.425 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../005-librbd1_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:51.548 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librbd1 (16.2.14-452-g9854ba8e-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2024-01-22T05:00:51.962 INFO:teuthology.orchestra.run.smithi110.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 16.2.14-452-g9854ba8e-1focal [237 kB] 2024-01-22T05:00:51.964 INFO:teuthology.orchestra.run.smithi110.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 16.2.14-452-g9854ba8e-1focal [17.4 kB] 2024-01-22T05:00:51.964 INFO:teuthology.orchestra.run.smithi110.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 16.2.14-452-g9854ba8e-1focal [13.2 kB] 2024-01-22T05:00:51.965 INFO:teuthology.orchestra.run.smithi110.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.14-452-g9854ba8e-1focal [21.5 kB] 2024-01-22T05:00:51.965 INFO:teuthology.orchestra.run.smithi110.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.14-452-g9854ba8e-1focal [11.3 MB] 2024-01-22T05:00:52.264 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../006-librados2_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:52.361 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librados2 (16.2.14-452-g9854ba8e-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2024-01-22T05:00:52.633 INFO:teuthology.orchestra.run.smithi110.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.14-452-g9854ba8e-1focal [78.7 kB] 2024-01-22T05:00:53.107 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcephfs2. 2024-01-22T05:00:53.125 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../007-libcephfs2_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:53.165 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcephfs2 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:53.548 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 174 MB in 13s (13.1 MB/s) 2024-01-22T05:00:53.576 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rados. 2024-01-22T05:00:53.595 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../008-python3-rados_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:53.634 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rados (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:53.717 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-22T05:00:53.786 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2024-01-22T05:00:53.789 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-01-22T05:00:53.837 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-01-22T05:00:54.158 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-22T05:00:54.177 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-01-22T05:00:54.241 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-01-22T05:00:54.312 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-22T05:00:54.334 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../009-python3-ceph-argparse_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:00:54.370 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-ceph-argparse (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:54.578 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cmd2. 2024-01-22T05:00:54.597 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-01-22T05:00:54.652 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-01-22T05:00:54.731 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cephfs. 2024-01-22T05:00:54.749 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../010-python3-cephfs_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:54.789 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cephfs (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:54.955 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libjaeger. 2024-01-22T05:00:54.976 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../003-libjaeger_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:55.055 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libjaeger (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:55.175 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-22T05:00:55.188 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../011-python3-ceph-common_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:00:55.225 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-ceph-common (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:55.408 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-01-22T05:00:55.426 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../004-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-01-22T05:00:55.533 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-01-22T05:00:55.611 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-prettytable. 2024-01-22T05:00:55.625 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-5_all.deb ... 2024-01-22T05:00:55.670 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-01-22T05:00:55.922 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../005-librbd1_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:55.980 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rbd. 2024-01-22T05:00:55.993 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../013-python3-rbd_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:56.022 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rbd (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:56.046 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librbd1 (16.2.14-452-g9854ba8e-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2024-01-22T05:00:56.383 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-01-22T05:00:56.406 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../014-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-01-22T05:00:56.466 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-01-22T05:00:56.777 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../006-librados2_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:56.803 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-01-22T05:00:56.821 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../015-librabbitmq4_0.10.0-1_amd64.deb ... 2024-01-22T05:00:56.900 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librados2 (16.2.14-452-g9854ba8e-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2024-01-22T05:00:56.902 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-01-22T05:00:57.214 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-22T05:00:57.232 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../016-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-01-22T05:00:57.272 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-01-22T05:00:57.621 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs2. 2024-01-22T05:00:57.641 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../007-libcephfs2_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:57.666 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librgw2. 2024-01-22T05:00:57.680 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs2 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:57.687 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../017-librgw2_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:57.724 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librgw2 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:58.083 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rados. 2024-01-22T05:00:58.102 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../008-python3-rados_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:58.132 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rados (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:58.403 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rgw. 2024-01-22T05:00:58.420 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../018-python3-rgw_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:58.460 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rgw (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:58.535 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-22T05:00:58.548 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../009-python3-ceph-argparse_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:00:58.585 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-argparse (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:58.805 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libleveldb1d:amd64. 2024-01-22T05:00:58.824 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../019-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2024-01-22T05:00:58.854 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2024-01-22T05:00:58.930 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cephfs. 2024-01-22T05:00:58.949 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../010-python3-cephfs_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:58.988 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cephfs (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:59.241 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liboath0. 2024-01-22T05:00:59.259 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../020-liboath0_2.6.1-1.3_amd64.deb ... 2024-01-22T05:00:59.298 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-01-22T05:00:59.391 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-22T05:00:59.409 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../011-python3-ceph-common_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:00:59.449 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-common (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:59.651 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libradosstriper1. 2024-01-22T05:00:59.670 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../021-libradosstriper1_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:00:59.718 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libradosstriper1 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:00:59.794 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-prettytable. 2024-01-22T05:00:59.812 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-5_all.deb ... 2024-01-22T05:00:59.844 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-01-22T05:01:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rbd. 2024-01-22T05:01:00.172 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-common. 2024-01-22T05:01:00.172 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../013-python3-rbd_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:00.190 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../022-ceph-common_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rbd (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:00.221 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-common (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:00.608 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-01-22T05:01:00.625 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../014-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-01-22T05:01:00.666 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-01-22T05:01:01.055 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-01-22T05:01:01.070 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../015-librabbitmq4_0.10.0-1_amd64.deb ... 2024-01-22T05:01:01.102 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-01-22T05:01:01.497 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-22T05:01:01.516 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../016-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-01-22T05:01:01.555 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-01-22T05:01:01.967 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librgw2. 2024-01-22T05:01:01.985 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../017-librgw2_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:02.025 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librgw2 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:02.527 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-base. 2024-01-22T05:01:02.540 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../023-ceph-base_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:02.614 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-base (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:02.678 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rgw. 2024-01-22T05:01:02.697 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../018-python3-rgw_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:02.736 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rgw (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:03.097 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libleveldb1d:amd64. 2024-01-22T05:01:03.117 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../019-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2024-01-22T05:01:03.155 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2024-01-22T05:01:03.739 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cryptography. 2024-01-22T05:01:03.759 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../024-python3-cryptography_2.8-3ubuntu0.2_amd64.deb ... 2024-01-22T05:01:03.789 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.2) ... 2024-01-22T05:01:03.859 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liboath0. 2024-01-22T05:01:03.877 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../020-liboath0_2.6.1-1.3_amd64.deb ... 2024-01-22T05:01:03.917 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-01-22T05:01:04.209 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-openssl. 2024-01-22T05:01:04.228 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../025-python3-openssl_19.0.0-1build1_all.deb ... 2024-01-22T05:01:04.278 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libradosstriper1. 2024-01-22T05:01:04.292 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-01-22T05:01:04.297 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../021-libradosstriper1_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:04.336 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libradosstriper1 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:04.570 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-22T05:01:04.588 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:01:04.628 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-modules-core (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:04.823 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-common. 2024-01-22T05:01:04.841 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../022-ceph-common_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:04.881 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-common (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:05.075 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-22T05:01:05.095 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-01-22T05:01:05.149 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-01-22T05:01:05.536 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-22T05:01:05.558 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-01-22T05:01:05.602 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-01-22T05:01:06.022 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jwt. 2024-01-22T05:01:06.043 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../029-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-01-22T05:01:06.080 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-01-22T05:01:06.459 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-logutils. 2024-01-22T05:01:06.476 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-01-22T05:01:06.516 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-01-22T05:01:06.861 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-22T05:01:06.882 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-01-22T05:01:06.927 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-01-22T05:01:07.204 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-base. 2024-01-22T05:01:07.224 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../023-ceph-base_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:07.279 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-base (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:07.280 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-mako. 2024-01-22T05:01:07.299 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-01-22T05:01:07.338 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-01-22T05:01:07.708 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-22T05:01:07.728 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-22T05:01:07.766 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-22T05:01:08.111 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-22T05:01:08.131 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-01-22T05:01:08.169 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-01-22T05:01:08.242 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cryptography. 2024-01-22T05:01:08.259 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../024-python3-cryptography_2.8-3ubuntu0.2_amd64.deb ... 2024-01-22T05:01:08.300 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.2) ... 2024-01-22T05:01:08.530 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-webob. 2024-01-22T05:01:08.545 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2024-01-22T05:01:08.588 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-01-22T05:01:08.966 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-soupsieve. 2024-01-22T05:01:08.984 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-01-22T05:01:09.324 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-01-22T05:01:09.454 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-openssl. 2024-01-22T05:01:09.467 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../025-python3-openssl_19.0.0-1build1_all.deb ... 2024-01-22T05:01:09.513 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-01-22T05:01:09.807 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-22T05:01:09.826 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:01:09.890 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-modules-core (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:10.045 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-bs4. 2024-01-22T05:01:10.066 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-01-22T05:01:10.111 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-01-22T05:01:10.345 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-22T05:01:10.364 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-01-22T05:01:10.403 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-01-22T05:01:10.531 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-waitress. 2024-01-22T05:01:10.548 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-01-22T05:01:10.595 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-01-22T05:01:10.790 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-22T05:01:10.809 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-01-22T05:01:10.857 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-01-22T05:01:10.975 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-tempita. 2024-01-22T05:01:10.994 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-01-22T05:01:11.033 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-01-22T05:01:11.260 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jwt. 2024-01-22T05:01:11.278 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../029-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-01-22T05:01:11.310 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-01-22T05:01:11.397 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-paste. 2024-01-22T05:01:11.415 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-01-22T05:01:11.454 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-01-22T05:01:11.672 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-logutils. 2024-01-22T05:01:11.690 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-01-22T05:01:11.730 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-01-22T05:01:11.858 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-22T05:01:11.876 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-01-22T05:01:11.916 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-01-22T05:01:12.091 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-22T05:01:12.109 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-01-22T05:01:12.150 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-01-22T05:01:12.277 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-22T05:01:12.296 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-01-22T05:01:12.327 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-01-22T05:01:12.494 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-mako. 2024-01-22T05:01:12.513 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-01-22T05:01:12.552 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-01-22T05:01:12.697 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-webtest. 2024-01-22T05:01:12.715 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-01-22T05:01:12.755 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-01-22T05:01:12.914 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-22T05:01:12.933 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-22T05:01:12.964 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-22T05:01:13.133 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pecan. 2024-01-22T05:01:13.155 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-01-22T05:01:13.199 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-01-22T05:01:13.325 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-22T05:01:13.345 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-01-22T05:01:13.383 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-01-22T05:01:13.613 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-22T05:01:13.634 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-01-22T05:01:13.679 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-01-22T05:01:13.736 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webob. 2024-01-22T05:01:13.754 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2024-01-22T05:01:13.794 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-01-22T05:01:14.074 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-22T05:01:14.092 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../046-libsqlite3-mod-ceph_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:14.132 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libsqlite3-mod-ceph (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:14.181 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-soupsieve. 2024-01-22T05:01:14.199 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-01-22T05:01:14.239 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-01-22T05:01:14.510 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr. 2024-01-22T05:01:14.528 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../047-ceph-mgr_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:14.568 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:14.601 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-bs4. 2024-01-22T05:01:14.621 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-01-22T05:01:14.659 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-01-22T05:01:15.080 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mon. 2024-01-22T05:01:15.087 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-waitress. 2024-01-22T05:01:15.100 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../048-ceph-mon_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:15.105 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-01-22T05:01:15.137 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mon (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:15.152 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-01-22T05:01:15.540 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-tempita. 2024-01-22T05:01:15.557 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-01-22T05:01:15.598 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-01-22T05:01:15.952 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-paste. 2024-01-22T05:01:15.972 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-01-22T05:01:16.001 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-01-22T05:01:16.236 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-osd. 2024-01-22T05:01:16.250 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../049-ceph-osd_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:16.291 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-osd (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:16.380 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-22T05:01:16.401 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-01-22T05:01:16.446 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-01-22T05:01:16.758 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-22T05:01:16.777 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-01-22T05:01:16.815 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-01-22T05:01:17.177 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webtest. 2024-01-22T05:01:17.195 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-01-22T05:01:17.235 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-01-22T05:01:17.622 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pecan. 2024-01-22T05:01:17.641 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-01-22T05:01:17.680 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-01-22T05:01:18.110 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-22T05:01:18.129 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-01-22T05:01:18.193 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-01-22T05:01:18.597 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-22T05:01:18.618 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../046-libsqlite3-mod-ceph_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:18.646 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph. 2024-01-22T05:01:18.663 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libsqlite3-mod-ceph (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:18.664 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../050-ceph_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:18.704 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:19.075 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr. 2024-01-22T05:01:19.082 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-fuse. 2024-01-22T05:01:19.093 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../047-ceph-mgr_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:19.100 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../051-ceph-fuse_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:19.133 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:19.140 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-fuse (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:19.619 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mds. 2024-01-22T05:01:19.636 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../052-ceph-mds_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:19.637 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mon. 2024-01-22T05:01:19.656 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../048-ceph-mon_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:19.676 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mds (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:19.686 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mon (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:20.355 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephadm. 2024-01-22T05:01:20.368 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../053-cephadm_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:20.412 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephadm (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:20.698 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-osd. 2024-01-22T05:01:20.711 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../049-ceph-osd_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:20.773 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-osd (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:20.799 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jinja2. 2024-01-22T05:01:20.812 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../054-python3-jinja2_2.10.1-2_all.deb ... 2024-01-22T05:01:20.857 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2024-01-22T05:01:21.227 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-22T05:01:21.245 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../055-ceph-mgr-cephadm_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:01:21.284 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-cephadm (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:21.688 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-22T05:01:21.707 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../056-python3-repoze.lru_0.7-2_all.deb ... 2024-01-22T05:01:21.737 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-22T05:01:22.024 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libjs-underscore. 2024-01-22T05:01:22.046 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../057-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-01-22T05:01:22.115 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-01-22T05:01:22.418 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-01-22T05:01:22.435 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../058-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-01-22T05:01:22.475 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-01-22T05:01:22.837 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-routes. 2024-01-22T05:01:22.855 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../059-python3-routes_2.4.1-2_all.deb ... 2024-01-22T05:01:22.894 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-01-22T05:01:23.129 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph. 2024-01-22T05:01:23.149 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../050-ceph_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:23.187 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:23.306 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-22T05:01:23.327 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../060-ceph-mgr-dashboard_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:01:23.372 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-dashboard (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:23.574 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-fuse. 2024-01-22T05:01:23.592 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../051-ceph-fuse_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:23.631 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-fuse (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:24.102 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mds. 2024-01-22T05:01:24.121 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../052-ceph-mds_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:24.185 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mds (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:24.547 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-decorator. 2024-01-22T05:01:24.565 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../061-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-01-22T05:01:24.605 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-01-22T05:01:24.805 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephadm. 2024-01-22T05:01:24.822 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../053-cephadm_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:24.863 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephadm (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:25.242 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jinja2. 2024-01-22T05:01:25.247 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-01-22T05:01:25.262 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../054-python3-jinja2_2.10.1-2_all.deb ... 2024-01-22T05:01:25.264 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../062-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-01-22T05:01:25.299 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2024-01-22T05:01:25.303 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-01-22T05:01:25.666 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-scipy. 2024-01-22T05:01:25.686 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../063-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-01-22T05:01:25.694 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-22T05:01:25.707 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../055-ceph-mgr-cephadm_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:01:25.724 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-01-22T05:01:25.744 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-cephadm (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:26.097 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-22T05:01:26.117 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../056-python3-repoze.lru_0.7-2_all.deb ... 2024-01-22T05:01:26.155 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-22T05:01:26.484 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libjs-underscore. 2024-01-22T05:01:26.501 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../057-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-01-22T05:01:26.541 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-01-22T05:01:26.885 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-01-22T05:01:26.908 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../058-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-01-22T05:01:26.952 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-01-22T05:01:27.216 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-01-22T05:01:27.235 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-01-22T05:01:27.274 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-01-22T05:01:27.330 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-routes. 2024-01-22T05:01:27.349 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../059-python3-routes_2.4.1-2_all.deb ... 2024-01-22T05:01:27.388 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-01-22T05:01:27.785 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-22T05:01:27.802 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../060-ceph-mgr-dashboard_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:01:27.843 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-dashboard (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:27.869 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-joblib. 2024-01-22T05:01:27.888 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../065-python3-joblib_0.14.0-3_all.deb ... 2024-01-22T05:01:27.927 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-01-22T05:01:28.340 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-sklearn. 2024-01-22T05:01:28.359 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../066-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-01-22T05:01:28.398 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-01-22T05:01:29.168 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-decorator. 2024-01-22T05:01:29.187 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../061-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-01-22T05:01:29.235 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-01-22T05:01:29.285 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-22T05:01:29.304 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:01:29.342 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:29.596 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-01-22T05:01:29.610 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../062-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-01-22T05:01:29.654 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-01-22T05:01:30.016 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-scipy. 2024-01-22T05:01:30.029 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../063-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-01-22T05:01:30.073 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-01-22T05:01:30.546 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cachetools. 2024-01-22T05:01:30.564 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../068-python3-cachetools_4.0.0-1_all.deb ... 2024-01-22T05:01:30.603 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-01-22T05:01:30.972 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-22T05:01:30.992 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../069-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-01-22T05:01:31.030 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-01-22T05:01:31.450 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-22T05:01:31.471 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../070-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-01-22T05:01:31.516 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-01-22T05:01:31.608 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-01-22T05:01:31.627 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-01-22T05:01:31.691 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-01-22T05:01:31.903 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rsa. 2024-01-22T05:01:31.920 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../071-python3-rsa_4.0-3_all.deb ... 2024-01-22T05:01:31.960 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rsa (4.0-3) ... 2024-01-22T05:01:32.253 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-joblib. 2024-01-22T05:01:32.270 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../065-python3-joblib_0.14.0-3_all.deb ... 2024-01-22T05:01:32.311 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-01-22T05:01:32.356 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-google-auth. 2024-01-22T05:01:32.376 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../072-python3-google-auth_1.5.1-2_all.deb ... 2024-01-22T05:01:32.414 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-01-22T05:01:32.756 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn. 2024-01-22T05:01:32.774 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../066-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-01-22T05:01:32.809 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-blinker. 2024-01-22T05:01:32.814 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-01-22T05:01:32.829 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../073-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-01-22T05:01:32.867 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-01-22T05:01:33.220 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-oauthlib. 2024-01-22T05:01:33.240 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../074-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-01-22T05:01:33.278 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-01-22T05:01:33.599 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-22T05:01:33.618 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:01:33.656 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:33.673 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-22T05:01:33.693 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../075-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-01-22T05:01:33.731 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-01-22T05:01:34.109 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-websocket. 2024-01-22T05:01:34.128 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../076-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-01-22T05:01:34.167 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-01-22T05:01:34.529 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-22T05:01:34.547 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../077-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-01-22T05:01:34.586 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-01-22T05:01:35.148 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cachetools. 2024-01-22T05:01:35.168 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../068-python3-cachetools_4.0.0-1_all.deb ... 2024-01-22T05:01:35.197 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-01-22T05:01:35.225 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-22T05:01:35.248 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../078-ceph-mgr-k8sevents_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:01:35.290 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-k8sevents (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:35.558 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-22T05:01:35.571 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../069-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-01-22T05:01:35.616 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-01-22T05:01:35.660 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-22T05:01:35.681 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../079-libonig5_6.9.4-1_amd64.deb ... 2024-01-22T05:01:35.718 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-01-22T05:01:36.044 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-22T05:01:36.066 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../070-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-01-22T05:01:36.110 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-01-22T05:01:36.113 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-22T05:01:36.132 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../080-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-01-22T05:01:36.170 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-01-22T05:01:36.481 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rsa. 2024-01-22T05:01:36.501 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../071-python3-rsa_4.0-3_all.deb ... 2024-01-22T05:01:36.539 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rsa (4.0-3) ... 2024-01-22T05:01:36.576 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package jq. 2024-01-22T05:01:36.598 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../081-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-01-22T05:01:36.642 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-01-22T05:01:36.917 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-google-auth. 2024-01-22T05:01:36.934 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../072-python3-google-auth_1.5.1-2_all.deb ... 2024-01-22T05:01:36.953 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package socat. 2024-01-22T05:01:36.972 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../082-socat_1.7.3.3-2_amd64.deb ... 2024-01-22T05:01:36.975 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-01-22T05:01:37.011 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking socat (1.7.3.3-2) ... 2024-01-22T05:01:37.362 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-blinker. 2024-01-22T05:01:37.382 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../073-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-01-22T05:01:37.383 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package xmlstarlet. 2024-01-22T05:01:37.397 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../083-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-01-22T05:01:37.420 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-01-22T05:01:37.441 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-01-22T05:01:37.774 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-oauthlib. 2024-01-22T05:01:37.794 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../074-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-01-22T05:01:37.831 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-01-22T05:01:37.905 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-test. 2024-01-22T05:01:37.923 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../084-ceph-test_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:37.962 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-test (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:38.211 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-22T05:01:38.230 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../075-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-01-22T05:01:38.260 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-01-22T05:01:38.622 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-websocket. 2024-01-22T05:01:38.641 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../076-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-01-22T05:01:38.679 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-01-22T05:01:39.058 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-22T05:01:39.078 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../077-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-01-22T05:01:39.141 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-01-22T05:01:39.796 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-22T05:01:39.814 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../078-ceph-mgr-k8sevents_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:01:39.854 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-k8sevents (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:40.240 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-22T05:01:40.261 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../079-libonig5_6.9.4-1_amd64.deb ... 2024-01-22T05:01:40.298 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-01-22T05:01:40.710 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-22T05:01:40.731 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../080-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-01-22T05:01:40.807 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-01-22T05:01:41.265 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package jq. 2024-01-22T05:01:41.283 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../081-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-01-22T05:01:41.323 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-01-22T05:01:41.624 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package socat. 2024-01-22T05:01:41.643 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../082-socat_1.7.3.3-2_amd64.deb ... 2024-01-22T05:01:41.693 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking socat (1.7.3.3-2) ... 2024-01-22T05:01:42.063 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package xmlstarlet. 2024-01-22T05:01:42.084 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../083-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-01-22T05:01:42.129 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-01-22T05:01:42.217 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-22T05:01:42.237 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../085-cephfs-mirror_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:42.274 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephfs-mirror (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:42.511 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-test. 2024-01-22T05:01:42.533 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../084-ceph-test_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:42.577 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-test (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:42.653 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-colorama. 2024-01-22T05:01:42.672 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../086-python3-colorama_0.4.3-1build1_all.deb ... 2024-01-22T05:01:42.710 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-01-22T05:01:43.039 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephfs-shell. 2024-01-22T05:01:43.057 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../087-cephfs-shell_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:01:43.097 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephfs-shell (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:43.408 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephfs-top. 2024-01-22T05:01:43.428 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../088-cephfs-top_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:01:43.466 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephfs-top (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:43.727 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-22T05:01:43.748 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../089-libcephfs-dev_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:43.785 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcephfs-dev (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:44.239 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package nvme-cli. 2024-01-22T05:01:44.257 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-01-22T05:01:44.327 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-01-22T05:01:44.719 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-atomicwrites. 2024-01-22T05:01:44.736 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../091-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-01-22T05:01:44.809 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-01-22T05:01:45.138 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-attr. 2024-01-22T05:01:45.157 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../092-python3-attr_19.3.0-2_all.deb ... 2024-01-22T05:01:45.195 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-01-22T05:01:45.573 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-webencodings. 2024-01-22T05:01:45.595 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../093-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-01-22T05:01:45.639 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-01-22T05:01:45.984 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-html5lib. 2024-01-22T05:01:46.003 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../094-python3-html5lib_1.0.1-2_all.deb ... 2024-01-22T05:01:46.042 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-01-22T05:01:46.412 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-01-22T05:01:46.432 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../095-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-01-22T05:01:46.469 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-01-22T05:01:46.741 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-22T05:01:46.763 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../085-cephfs-mirror_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:46.806 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephfs-mirror (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:47.115 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-packaging. 2024-01-22T05:01:47.133 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../096-python3-packaging_20.3-1_all.deb ... 2024-01-22T05:01:47.190 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-packaging (20.3-1) ... 2024-01-22T05:01:47.201 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-colorama. 2024-01-22T05:01:47.215 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../086-python3-colorama_0.4.3-1build1_all.deb ... 2024-01-22T05:01:47.260 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-01-22T05:01:47.527 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pastescript. 2024-01-22T05:01:47.544 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../097-python3-pastescript_2.0.2-4_all.deb ... 2024-01-22T05:01:47.563 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephfs-shell. 2024-01-22T05:01:47.582 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../087-cephfs-shell_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:01:47.609 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-22T05:01:47.621 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephfs-shell (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:47.954 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pluggy. 2024-01-22T05:01:47.973 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../098-python3-pluggy_0.13.0-2_all.deb ... 2024-01-22T05:01:47.991 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephfs-top. 2024-01-22T05:01:48.010 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../088-cephfs-top_16.2.14-452-g9854ba8e-1focal_all.deb ... 2024-01-22T05:01:48.012 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-01-22T05:01:48.049 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephfs-top (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:48.369 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-22T05:01:48.388 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../089-libcephfs-dev_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:48.391 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-psutil. 2024-01-22T05:01:48.409 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../099-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-01-22T05:01:48.426 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs-dev (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:48.448 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-01-22T05:01:48.836 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-py. 2024-01-22T05:01:48.854 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../100-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-01-22T05:01:48.855 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package nvme-cli. 2024-01-22T05:01:48.875 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-01-22T05:01:48.893 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-01-22T05:01:48.948 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-01-22T05:01:49.272 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-22T05:01:49.292 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-01-22T05:01:49.338 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-01-22T05:01:49.377 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-atomicwrites. 2024-01-22T05:01:49.395 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../091-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-01-22T05:01:49.434 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-01-22T05:01:49.708 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pytest. 2024-01-22T05:01:49.728 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../102-python3-pytest_4.6.9-1_all.deb ... 2024-01-22T05:01:49.765 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-01-22T05:01:49.796 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-attr. 2024-01-22T05:01:49.814 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../092-python3-attr_19.3.0-2_all.deb ... 2024-01-22T05:01:49.854 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-01-22T05:01:50.150 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-simplejson. 2024-01-22T05:01:50.168 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../103-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-01-22T05:01:50.207 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-01-22T05:01:50.241 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webencodings. 2024-01-22T05:01:50.259 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../093-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-01-22T05:01:50.298 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-01-22T05:01:50.660 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-html5lib. 2024-01-22T05:01:50.678 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package radosgw. 2024-01-22T05:01:50.680 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../094-python3-html5lib_1.0.1-2_all.deb ... 2024-01-22T05:01:50.697 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../104-radosgw_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:50.718 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-01-22T05:01:50.735 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking radosgw (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:51.130 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-01-22T05:01:51.151 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../095-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-01-22T05:01:51.196 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-01-22T05:01:51.733 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-packaging. 2024-01-22T05:01:51.755 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../096-python3-packaging_20.3-1_all.deb ... 2024-01-22T05:01:51.799 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-packaging (20.3-1) ... 2024-01-22T05:01:51.956 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package rbd-fuse. 2024-01-22T05:01:51.977 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../105-rbd-fuse_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking rbd-fuse (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:52.161 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastescript. 2024-01-22T05:01:52.183 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../097-python3-pastescript_2.0.2-4_all.deb ... 2024-01-22T05:01:52.227 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-22T05:01:52.408 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-attr (19.3.0-2) ... 2024-01-22T05:01:52.598 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pluggy. 2024-01-22T05:01:52.618 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../098-python3-pluggy_0.13.0-2_all.deb ... 2024-01-22T05:01:52.656 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-01-22T05:01:52.818 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2024-01-22T05:01:52.944 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-01-22T05:01:53.026 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-psutil. 2024-01-22T05:01:53.047 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../099-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-01-22T05:01:53.079 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-01-22T05:01:53.092 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-01-22T05:01:53.314 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephadm (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:53.487 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-py. 2024-01-22T05:01:53.507 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../100-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-01-22T05:01:53.545 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-01-22T05:01:53.932 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-22T05:01:53.951 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-01-22T05:01:53.990 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-01-22T05:01:54.127 INFO:teuthology.orchestra.run.smithi049.stdout:Adding system user cephadm....done 2024-01-22T05:01:54.348 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-01-22T05:01:54.369 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pytest. 2024-01-22T05:01:54.387 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../102-python3-pytest_4.6.9-1_all.deb ... 2024-01-22T05:01:54.427 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-01-22T05:01:54.776 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-22T05:01:54.831 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplejson. 2024-01-22T05:01:54.851 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../103-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-01-22T05:01:54.889 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-01-22T05:01:55.169 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-01-22T05:01:55.294 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-01-22T05:01:55.428 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package radosgw. 2024-01-22T05:01:55.445 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../104-radosgw_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:55.488 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking radosgw (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:55.721 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-01-22T05:01:56.400 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-01-22T05:01:56.751 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-01-22T05:01:56.767 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package rbd-fuse. 2024-01-22T05:01:56.787 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../105-rbd-fuse_16.2.14-452-g9854ba8e-1focal_amd64.deb ... 2024-01-22T05:01:56.824 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking rbd-fuse (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:57.102 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-01-22T05:01:57.204 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-attr (19.3.0-2) ... 2024-01-22T05:01:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-01-22T05:01:57.605 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2024-01-22T05:01:57.731 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-01-22T05:01:57.821 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-01-22T05:01:57.857 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-01-22T05:01:58.109 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephadm (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:58.180 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-ceph-argparse (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:01:58.548 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-01-22T05:01:58.674 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-01-22T05:01:58.796 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user cephadm....done 2024-01-22T05:01:59.007 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-01-22T05:01:59.025 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-01-22T05:01:59.376 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-01-22T05:01:59.422 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-22T05:01:59.727 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-01-22T05:01:59.783 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-01-22T05:01:59.908 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-01-22T05:02:00.228 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-01-22T05:02:00.293 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-01-22T05:02:00.629 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-01-22T05:02:00.946 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-01-22T05:02:01.047 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-01-22T05:02:01.341 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-01-22T05:02:01.381 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libjaeger (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:01.507 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2024-01-22T05:02:01.692 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-01-22T05:02:01.934 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-01-22T05:02:02.078 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-01-22T05:02:02.293 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-packaging (20.3-1) ... 2024-01-22T05:02:02.446 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-01-22T05:02:02.661 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-01-22T05:02:02.787 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-01-22T05:02:02.830 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-argparse (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:03.154 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-01-22T05:02:03.189 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-01-22T05:02:03.315 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-01-22T05:02:03.647 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-01-22T05:02:03.700 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-01-22T05:02:04.032 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-01-22T05:02:04.084 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-01-22T05:02:04.444 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-01-22T05:02:04.501 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cryptography (2.8-3ubuntu0.2) ... 2024-01-22T05:02:04.912 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-01-22T05:02:04.954 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up socat (1.7.3.3-2) ... 2024-01-22T05:02:05.080 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-ceph-common (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:05.271 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-01-22T05:02:05.474 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-01-22T05:02:05.814 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-01-22T05:02:05.909 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-01-22T05:02:06.035 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-01-22T05:02:06.161 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-01-22T05:02:06.181 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libjaeger (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:06.341 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2024-01-22T05:02:06.520 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-01-22T05:02:06.758 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-01-22T05:02:06.916 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-01-22T05:02:07.042 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-01-22T05:02:07.151 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-packaging (20.3-1) ... 2024-01-22T05:02:07.444 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-01-22T05:02:07.564 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-01-22T05:02:07.695 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-01-22T05:02:07.803 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-01-22T05:02:08.055 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-01-22T05:02:08.154 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-01-22T05:02:08.280 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-22T05:02:08.531 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-01-22T05:02:08.631 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-01-22T05:02:08.907 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-01-22T05:02:09.007 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-01-22T05:02:09.342 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cryptography (2.8-3ubuntu0.2) ... 2024-01-22T05:02:09.402 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-01-22T05:02:09.773 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-01-22T05:02:09.793 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up socat (1.7.3.3-2) ... 2024-01-22T05:02:09.928 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-common (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:10.121 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-01-22T05:02:10.247 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-01-22T05:02:10.337 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-01-22T05:02:10.640 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-01-22T05:02:10.758 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-01-22T05:02:10.909 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-01-22T05:02:11.035 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-01-22T05:02:11.075 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-01-22T05:02:11.201 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-01-22T05:02:11.326 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-01-22T05:02:11.386 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-01-22T05:02:11.770 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-01-22T05:02:11.771 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-01-22T05:02:11.897 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-01-22T05:02:12.137 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librados2 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:12.263 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-01-22T05:02:12.298 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-01-22T05:02:12.644 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-01-22T05:02:13.012 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-01-22T05:02:13.138 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-22T05:02:13.480 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-01-22T05:02:13.831 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-01-22T05:02:14.119 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librgw2 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:14.241 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-01-22T05:02:14.270 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libsqlite3-mod-ceph (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:14.387 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-01-22T05:02:14.513 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-01-22T05:02:14.662 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-01-22T05:02:14.973 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-01-22T05:02:15.004 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-01-22T05:02:15.155 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-01-22T05:02:15.349 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-01-22T05:02:15.547 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-01-22T05:02:15.709 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-01-22T05:02:15.999 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-01-22T05:02:16.125 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-01-22T05:02:16.135 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcephfs2 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:16.251 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-01-22T05:02:16.260 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-01-22T05:02:16.671 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libradosstriper1 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:16.719 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-01-22T05:02:16.796 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-01-22T05:02:17.078 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librados2 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:17.215 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-01-22T05:02:17.229 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-01-22T05:02:18.495 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librbd1 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:18.621 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-01-22T05:02:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-01-22T05:02:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rsa (4.0-3) ... 2024-01-22T05:02:19.001 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librgw2 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:19.127 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libsqlite3-mod-ceph (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:19.274 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-01-22T05:02:19.294 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-01-22T05:02:19.420 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-01-22T05:02:19.667 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-modules-core (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:19.793 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-fuse (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:19.872 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-01-22T05:02:20.082 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-22T05:02:20.082 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-22T05:02:20.231 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-01-22T05:02:20.583 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-01-22T05:02:20.910 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcephfs-dev (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:20.984 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs2 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:21.036 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-01-22T05:02:21.110 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-01-22T05:02:21.388 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-22T05:02:21.511 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libradosstriper1 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:21.637 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-01-22T05:02:22.080 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-01-22T05:02:22.320 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-01-22T05:02:22.763 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rados (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:22.889 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephfs-top (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:23.117 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rbd (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:23.268 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up rbd-fuse (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:23.318 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librbd1 (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:23.394 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-routes (2.4.1-2) ... 2024-01-22T05:02:23.469 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-01-22T05:02:23.595 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-01-22T05:02:23.721 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rsa (4.0-3) ... 2024-01-22T05:02:23.771 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-01-22T05:02:24.122 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-01-22T05:02:24.155 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rgw (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:24.290 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cephfs (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:24.515 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-modules-core (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:24.658 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephfs-shell (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:24.674 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-fuse (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:24.784 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-01-22T05:02:24.939 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-22T05:02:24.939 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-22T05:02:25.759 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs-dev (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:25.928 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-01-22T05:02:25.971 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-common (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:26.547 INFO:teuthology.orchestra.run.smithi049.stdout:Adding group ceph....done 2024-01-22T05:02:26.825 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-22T05:02:27.027 INFO:teuthology.orchestra.run.smithi049.stdout:Adding system user ceph....done 2024-01-22T05:02:27.253 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-01-22T05:02:27.283 INFO:teuthology.orchestra.run.smithi049.stdout:Setting system user ceph properties....done 2024-01-22T05:02:27.321 INFO:teuthology.orchestra.run.smithi049.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-22T05:02:27.512 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-22T05:02:27.711 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rados (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:27.837 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephfs-top (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:28.075 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-22T05:02:28.090 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rbd (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:28.216 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up rbd-fuse (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:28.342 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-routes (2.4.1-2) ... 2024-01-22T05:02:28.702 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-01-22T05:02:28.958 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephfs-mirror (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:29.087 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rgw (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:29.212 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cephfs (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:29.225 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-22T05:02:29.225 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-22T05:02:29.605 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephfs-shell (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:29.756 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-01-22T05:02:30.067 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-test (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:30.227 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up radosgw (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:30.533 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-22T05:02:30.533 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-22T05:02:30.902 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-common (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:31.517 INFO:teuthology.orchestra.run.smithi110.stdout:Adding group ceph....done 2024-01-22T05:02:31.770 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-base (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:31.989 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user ceph....done 2024-01-22T05:02:32.241 INFO:teuthology.orchestra.run.smithi110.stdout:Setting system user ceph properties....done 2024-01-22T05:02:32.264 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-22T05:02:32.282 INFO:teuthology.orchestra.run.smithi110.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-22T05:02:32.471 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-22T05:02:33.016 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-22T05:02:33.206 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mds (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:33.483 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-22T05:02:33.483 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-22T05:02:33.930 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephfs-mirror (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:34.191 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-22T05:02:34.192 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-22T05:02:34.358 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:34.633 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-22T05:02:34.633 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-22T05:02:35.032 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-test (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:35.191 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up radosgw (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:35.477 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-osd (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:35.507 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-22T05:02:35.507 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-22T05:02:36.296 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-22T05:02:36.296 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-22T05:02:36.684 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-base (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:37.179 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-k8sevents (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:37.203 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-22T05:02:37.363 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-diskprediction-local (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:37.515 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mon (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:37.781 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-22T05:02:37.781 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-22T05:02:38.136 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mds (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:38.402 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-22T05:02:38.402 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-22T05:02:38.657 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-cephadm (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:38.808 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:38.934 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-dashboard (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:39.078 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-01-22T05:02:39.212 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:39.519 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-22T05:02:39.519 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-22T05:02:39.637 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-01-22T05:02:40.330 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-osd (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:41.144 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-22T05:02:41.144 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-22T05:02:41.982 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-k8sevents (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:42.108 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-diskprediction-local (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:42.278 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mon (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:42.539 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-22T05:02:42.539 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-22T05:02:43.337 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-cephadm (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:43.496 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:43.622 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-dashboard (16.2.14-452-g9854ba8e-1focal) ... 2024-01-22T05:02:43.775 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-01-22T05:02:44.209 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-01-22T05:02:44.749 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-01-22T05:02:45.381 INFO:teuthology.orchestra.run.smithi049.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-22T05:02:45.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-01-22T05:02:45.514 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-01-22T05:02:45.726 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2024-01-22T05:02:45.726 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2024-01-22T05:02:45.940 INFO:teuthology.orchestra.run.smithi049.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-01-22T05:02:45.940 INFO:teuthology.orchestra.run.smithi049.stdout:flex is already the newest version (2.6.4-6.2). 2024-01-22T05:02:45.940 INFO:teuthology.orchestra.run.smithi049.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-01-22T05:02:45.940 INFO:teuthology.orchestra.run.smithi049.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-01-22T05:02:45.940 INFO:teuthology.orchestra.run.smithi049.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-01-22T05:02:45.940 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2024-01-22T05:02:45.941 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-01-22T05:02:45.941 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-22T05:02:45.941 INFO:teuthology.orchestra.run.smithi049.stdout:The following additional packages will be installed: 2024-01-22T05:02:45.942 INFO:teuthology.orchestra.run.smithi049.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-01-22T05:02:45.942 INFO:teuthology.orchestra.run.smithi049.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-01-22T05:02:45.942 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-01-22T05:02:45.942 INFO:teuthology.orchestra.run.smithi049.stdout: usb-modeswitch-data wpasupplicant 2024-01-22T05:02:45.944 INFO:teuthology.orchestra.run.smithi049.stdout:Suggested packages: 2024-01-22T05:02:45.944 INFO:teuthology.orchestra.run.smithi049.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-01-22T05:02:45.944 INFO:teuthology.orchestra.run.smithi049.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-01-22T05:02:46.032 INFO:teuthology.orchestra.run.smithi049.stdout:The following NEW packages will be installed: 2024-01-22T05:02:46.033 INFO:teuthology.orchestra.run.smithi049.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-01-22T05:02:46.033 INFO:teuthology.orchestra.run.smithi049.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-01-22T05:02:46.033 INFO:teuthology.orchestra.run.smithi049.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-01-22T05:02:46.034 INFO:teuthology.orchestra.run.smithi049.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-22T05:02:46.035 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages will be upgraded: 2024-01-22T05:02:46.036 INFO:teuthology.orchestra.run.smithi049.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-01-22T05:02:46.233 INFO:teuthology.orchestra.run.smithi049.stdout:6 upgraded, 23 newly installed, 0 to remove and 258 not upgraded. 2024-01-22T05:02:46.233 INFO:teuthology.orchestra.run.smithi049.stdout:Need to get 10.4 MB of archives. 2024-01-22T05:02:46.233 INFO:teuthology.orchestra.run.smithi049.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-01-22T05:02:46.233 INFO:teuthology.orchestra.run.smithi049.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2024-01-22T05:02:46.876 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2024-01-22T05:02:46.877 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2024-01-22T05:02:46.879 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-01-22T05:02:46.892 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-01-22T05:02:46.894 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2024-01-22T05:02:46.993 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-01-22T05:02:46.994 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-01-22T05:02:47.002 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-01-22T05:02:47.007 INFO:teuthology.orchestra.run.smithi049.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-01-22T05:02:47.007 INFO:teuthology.orchestra.run.smithi049.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.7 [60.7 kB] 2024-01-22T05:02:47.178 INFO:teuthology.orchestra.run.smithi049.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-01-22T05:02:47.459 INFO:teuthology.orchestra.run.smithi049.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-01-22T05:02:47.593 INFO:teuthology.orchestra.run.smithi049.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-01-22T05:02:47.597 INFO:teuthology.orchestra.run.smithi049.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-01-22T05:02:47.697 INFO:teuthology.orchestra.run.smithi049.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2024-01-22T05:02:47.700 INFO:teuthology.orchestra.run.smithi049.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2024-01-22T05:02:47.782 INFO:teuthology.orchestra.run.smithi049.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-01-22T05:02:47.856 INFO:teuthology.orchestra.run.smithi049.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-01-22T05:02:47.857 INFO:teuthology.orchestra.run.smithi049.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2024-01-22T05:02:47.946 INFO:teuthology.orchestra.run.smithi049.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-01-22T05:02:47.946 INFO:teuthology.orchestra.run.smithi049.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-01-22T05:02:48.139 INFO:teuthology.orchestra.run.smithi049.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2024-01-22T05:02:48.793 INFO:teuthology.orchestra.run.smithi049.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2024-01-22T05:02:48.907 INFO:teuthology.orchestra.run.smithi049.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-01-22T05:02:48.921 INFO:teuthology.orchestra.run.smithi049.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-01-22T05:02:48.923 INFO:teuthology.orchestra.run.smithi049.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-01-22T05:02:48.923 INFO:teuthology.orchestra.run.smithi049.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-01-22T05:02:48.925 INFO:teuthology.orchestra.run.smithi049.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-01-22T05:02:49.294 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-01-22T05:02:49.360 INFO:teuthology.orchestra.run.smithi049.stdout:Preconfiguring packages ... 2024-01-22T05:02:49.540 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 10.4 MB in 3s (3,621 kB/s) 2024-01-22T05:02:49.891 INFO:teuthology.orchestra.run.smithi110.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-22T05:02:49.896 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-01-22T05:02:49.915 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115277 files and directories currently installed.) 2024-01-22T05:02:49.919 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2024-01-22T05:02:50.012 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-01-22T05:02:50.096 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2024-01-22T05:02:50.217 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-01-22T05:02:50.218 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-01-22T05:02:50.422 INFO:teuthology.orchestra.run.smithi110.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-01-22T05:02:50.422 INFO:teuthology.orchestra.run.smithi110.stdout:flex is already the newest version (2.6.4-6.2). 2024-01-22T05:02:50.422 INFO:teuthology.orchestra.run.smithi110.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-01-22T05:02:50.423 INFO:teuthology.orchestra.run.smithi110.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-01-22T05:02:50.423 INFO:teuthology.orchestra.run.smithi110.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-01-22T05:02:50.423 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-01-22T05:02:50.423 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-01-22T05:02:50.423 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-22T05:02:50.424 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2024-01-22T05:02:50.424 INFO:teuthology.orchestra.run.smithi110.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-01-22T05:02:50.424 INFO:teuthology.orchestra.run.smithi110.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-01-22T05:02:50.425 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-01-22T05:02:50.425 INFO:teuthology.orchestra.run.smithi110.stdout: usb-modeswitch-data wpasupplicant 2024-01-22T05:02:50.426 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2024-01-22T05:02:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-01-22T05:02:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-01-22T05:02:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2024-01-22T05:02:50.513 INFO:teuthology.orchestra.run.smithi110.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-01-22T05:02:50.514 INFO:teuthology.orchestra.run.smithi110.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-01-22T05:02:50.514 INFO:teuthology.orchestra.run.smithi110.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-01-22T05:02:50.514 INFO:teuthology.orchestra.run.smithi110.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-22T05:02:50.515 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages will be upgraded: 2024-01-22T05:02:50.516 INFO:teuthology.orchestra.run.smithi110.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-01-22T05:02:50.714 INFO:teuthology.orchestra.run.smithi110.stdout:6 upgraded, 23 newly installed, 0 to remove and 258 not upgraded. 2024-01-22T05:02:50.714 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 10.4 MB of archives. 2024-01-22T05:02:50.714 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-01-22T05:02:50.714 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2024-01-22T05:02:51.353 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2024-01-22T05:02:51.355 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2024-01-22T05:02:51.356 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-01-22T05:02:51.369 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-01-22T05:02:51.372 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2024-01-22T05:02:51.470 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-01-22T05:02:51.472 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-01-22T05:02:51.479 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-01-22T05:02:51.484 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-01-22T05:02:51.485 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.7 [60.7 kB] 2024-01-22T05:02:51.653 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-01-22T05:02:51.719 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2024-01-22T05:02:51.935 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-01-22T05:02:52.070 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-01-22T05:02:52.073 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-01-22T05:02:52.173 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2024-01-22T05:02:52.177 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2024-01-22T05:02:52.257 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-01-22T05:02:52.333 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-01-22T05:02:52.334 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2024-01-22T05:02:52.423 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-01-22T05:02:52.424 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-01-22T05:02:52.617 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2024-01-22T05:02:53.274 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2024-01-22T05:02:53.389 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-01-22T05:02:53.403 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-01-22T05:02:53.405 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-01-22T05:02:53.407 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-01-22T05:02:53.408 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-01-22T05:02:53.738 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115277 files and directories currently installed.) 2024-01-22T05:02:53.741 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2024-01-22T05:02:53.840 INFO:teuthology.orchestra.run.smithi110.stdout:Preconfiguring packages ... 2024-01-22T05:02:53.865 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2024-01-22T05:02:54.024 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 10.4 MB in 3s (3,619 kB/s) 2024-01-22T05:02:54.332 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2024-01-22T05:02:54.375 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115277 files and directories currently installed.) 2024-01-22T05:02:54.378 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2024-01-22T05:02:54.554 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2024-01-22T05:02:54.557 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2024-01-22T05:02:54.948 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2024-01-22T05:02:55.455 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115277 files and directories currently installed.) 2024-01-22T05:02:55.459 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-01-22T05:02:55.595 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-01-22T05:02:56.104 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-01-22T05:02:56.167 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2024-01-22T05:02:56.234 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-01-22T05:02:56.785 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2024-01-22T05:02:56.915 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2024-01-22T05:02:57.494 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-22T05:02:57.513 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-01-22T05:02:57.552 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-01-22T05:02:58.140 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115277 files and directories currently installed.) 2024-01-22T05:02:58.143 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2024-01-22T05:02:58.150 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package dump. 2024-01-22T05:02:58.169 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-01-22T05:02:58.233 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking dump (0.4b46-6) ... 2024-01-22T05:02:58.277 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2024-01-22T05:02:58.545 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package indent. 2024-01-22T05:02:58.567 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-01-22T05:02:58.633 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-01-22T05:02:58.723 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2024-01-22T05:02:58.949 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2024-01-22T05:02:58.981 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-22T05:02:59.001 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-01-22T05:02:59.039 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-01-22T05:02:59.348 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2024-01-22T05:02:59.451 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-22T05:02:59.472 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.7_amd64.deb ... 2024-01-22T05:02:59.547 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-01-22T05:02:59.845 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-22T05:02:59.849 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115277 files and directories currently installed.) 2024-01-22T05:02:59.853 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-01-22T05:02:59.860 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-01-22T05:02:59.903 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-01-22T05:02:59.990 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-01-22T05:03:00.298 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-22T05:03:00.317 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-01-22T05:03:00.356 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-01-22T05:03:00.521 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-01-22T05:03:00.637 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-01-22T05:03:00.668 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-22T05:03:00.689 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-01-22T05:03:00.734 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-01-22T05:03:01.129 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-22T05:03:01.151 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-01-22T05:03:01.168 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2024-01-22T05:03:01.195 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-01-22T05:03:01.308 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2024-01-22T05:03:01.631 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-22T05:03:01.650 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2024-01-22T05:03:01.689 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2024-01-22T05:03:01.895 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-22T05:03:01.915 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-01-22T05:03:01.953 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-01-22T05:03:02.076 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-22T05:03:02.095 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2024-01-22T05:03:02.134 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2024-01-22T05:03:02.517 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package dump. 2024-01-22T05:03:02.533 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-01-22T05:03:02.570 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-22T05:03:02.588 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-01-22T05:03:02.600 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking dump (0.4b46-6) ... 2024-01-22T05:03:02.628 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-01-22T05:03:02.945 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package indent. 2024-01-22T05:03:02.966 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-01-22T05:03:03.006 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-22T05:03:03.027 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-01-22T05:03:03.036 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-01-22T05:03:03.072 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-01-22T05:03:03.373 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-22T05:03:03.392 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-22T05:03:03.394 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-01-22T05:03:03.412 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2024-01-22T05:03:03.450 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2024-01-22T05:03:03.473 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-01-22T05:03:03.876 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-22T05:03:03.895 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.7_amd64.deb ... 2024-01-22T05:03:03.934 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-01-22T05:03:04.003 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-22T05:03:04.025 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-01-22T05:03:04.070 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-01-22T05:03:04.262 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-22T05:03:04.282 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-01-22T05:03:04.320 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-01-22T05:03:04.507 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package modemmanager. 2024-01-22T05:03:04.527 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-01-22T05:03:04.584 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-01-22T05:03:04.731 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-22T05:03:04.754 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-01-22T05:03:04.798 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-01-22T05:03:05.100 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-22T05:03:05.114 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-01-22T05:03:05.158 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-01-22T05:03:05.262 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package wpasupplicant. 2024-01-22T05:03:05.281 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2024-01-22T05:03:05.320 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-01-22T05:03:05.528 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-22T05:03:05.542 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-01-22T05:03:05.586 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-01-22T05:03:05.934 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package network-manager. 2024-01-22T05:03:05.952 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2024-01-22T05:03:06.005 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-22T05:03:06.019 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2024-01-22T05:03:06.040 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2024-01-22T05:03:06.072 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2024-01-22T05:03:06.459 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-22T05:03:06.472 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2024-01-22T05:03:06.517 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2024-01-22T05:03:06.833 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ppp. 2024-01-22T05:03:06.851 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-01-22T05:03:06.953 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-22T05:03:06.966 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-01-22T05:03:07.011 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-01-22T05:03:07.320 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-01-22T05:03:07.405 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-22T05:03:07.427 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-01-22T05:03:07.472 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-01-22T05:03:07.713 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package pptp-linux. 2024-01-22T05:03:07.733 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-01-22T05:03:07.770 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-01-22T05:03:07.808 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-22T05:03:07.827 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2024-01-22T05:03:07.866 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2024-01-22T05:03:08.224 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-22T05:03:08.245 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-01-22T05:03:08.316 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-01-22T05:03:08.445 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-22T05:03:08.463 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-01-22T05:03:08.503 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-01-22T05:03:08.644 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-22T05:03:08.667 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-01-22T05:03:08.710 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-01-22T05:03:08.956 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package modemmanager. 2024-01-22T05:03:08.974 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-01-22T05:03:09.038 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-01-22T05:03:09.147 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-22T05:03:09.167 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-01-22T05:03:09.226 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-01-22T05:03:09.606 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2024-01-22T05:03:09.756 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package wpasupplicant. 2024-01-22T05:03:09.775 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2024-01-22T05:03:09.814 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-01-22T05:03:09.977 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-01-22T05:03:10.103 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-01-22T05:03:10.287 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-01-22T05:03:10.436 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package network-manager. 2024-01-22T05:03:10.455 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2024-01-22T05:03:10.572 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2024-01-22T05:03:10.716 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-22T05:03:10.717 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-22T05:03:11.427 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ppp. 2024-01-22T05:03:11.447 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-01-22T05:03:11.607 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2024-01-22T05:03:11.758 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-01-22T05:03:11.884 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2024-01-22T05:03:11.898 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-01-22T05:03:12.010 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-01-22T05:03:12.170 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2024-01-22T05:03:12.295 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-01-22T05:03:12.307 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package pptp-linux. 2024-01-22T05:03:12.327 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-01-22T05:03:12.365 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-01-22T05:03:12.794 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-22T05:03:12.811 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-01-22T05:03:12.888 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-01-22T05:03:13.222 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-22T05:03:13.239 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-01-22T05:03:13.279 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-01-22T05:03:13.579 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-01-22T05:03:13.708 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-22T05:03:13.727 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-01-22T05:03:13.788 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-01-22T05:03:14.018 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up dump (0.4b46-6) ... 2024-01-22T05:03:14.142 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2024-01-22T05:03:14.155 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-22T05:03:14.220 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-01-22T05:03:14.346 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-01-22T05:03:14.472 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-01-22T05:03:14.555 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-01-22T05:03:14.631 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-01-22T05:03:14.714 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-01-22T05:03:14.816 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2024-01-22T05:03:14.840 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-01-22T05:03:14.942 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-01-22T05:03:15.093 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-01-22T05:03:15.219 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-01-22T05:03:15.301 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-22T05:03:15.301 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-22T05:03:15.387 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-01-22T05:03:15.538 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2024-01-22T05:03:16.193 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2024-01-22T05:03:16.336 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-01-22T05:03:16.471 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2024-01-22T05:03:16.597 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-01-22T05:03:16.739 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:16.739 INFO:teuthology.orchestra.run.smithi049.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-22T05:03:16.739 INFO:teuthology.orchestra.run.smithi049.stdout:which means they are currently configured by ifupdown: 2024-01-22T05:03:16.739 INFO:teuthology.orchestra.run.smithi049.stdout:- ens1f0 2024-01-22T05:03:16.739 INFO:teuthology.orchestra.run.smithi049.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-22T05:03:16.739 INFO:teuthology.orchestra.run.smithi049.stdout:remove their configuration from /etc/network/interfaces. 2024-01-22T05:03:16.739 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:16.764 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2024-01-22T05:03:16.890 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-01-22T05:03:16.973 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-22T05:03:17.506 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-22T05:03:18.124 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-01-22T05:03:18.423 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-22T05:03:18.538 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up dump (0.4b46-6) ... 2024-01-22T05:03:18.643 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-22T05:03:18.706 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-01-22T05:03:18.866 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-01-22T05:03:19.001 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-01-22T05:03:19.127 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-01-22T05:03:19.345 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2024-01-22T05:03:19.416 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-01-22T05:03:19.471 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-01-22T05:03:19.551 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-01-22T05:03:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-01-22T05:03:19.719 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-01-22T05:03:19.748 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-01-22T05:03:19.879 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-01-22T05:03:19.916 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-01-22T05:03:20.004 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-01-22T05:03:20.067 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2024-01-22T05:03:20.130 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-01-22T05:03:20.457 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-22T05:03:20.457 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-22T05:03:21.230 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:21.231 INFO:teuthology.orchestra.run.smithi110.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-22T05:03:21.231 INFO:teuthology.orchestra.run.smithi110.stdout:which means they are currently configured by ifupdown: 2024-01-22T05:03:21.231 INFO:teuthology.orchestra.run.smithi110.stdout:- enp3s0f1 2024-01-22T05:03:21.231 INFO:teuthology.orchestra.run.smithi110.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-22T05:03:21.231 INFO:teuthology.orchestra.run.smithi110.stdout:remove their configuration from /etc/network/interfaces. 2024-01-22T05:03:21.231 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:21.408 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-01-22T05:03:21.461 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-22T05:03:21.525 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-22T05:03:21.660 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-01-22T05:03:21.837 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-01-22T05:03:21.978 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-22T05:03:22.329 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-01-22T05:03:22.883 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-22T05:03:23.837 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-01-22T05:03:23.972 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-01-22T05:03:24.140 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-01-22T05:03:24.291 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-01-22T05:03:24.417 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-01-22T05:03:24.543 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-01-22T05:03:24.901 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-22T05:03:24.901 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-22T05:03:25.837 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-01-22T05:03:25.988 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-22T05:03:26.123 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-01-22T05:03:26.316 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-01-22T05:03:26.791 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-01-22T05:03:29.256 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-01-22T05:03:29.365 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-01-22T05:03:30.606 INFO:teuthology.orchestra.run.smithi049.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-22T05:03:30.613 DEBUG:teuthology.parallel:result is None 2024-01-22T05:03:33.463 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-01-22T05:03:33.569 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-01-22T05:03:34.795 INFO:teuthology.orchestra.run.smithi110.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-22T05:03:34.802 DEBUG:teuthology.parallel:result is None 2024-01-22T05:03:34.803 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 2024-01-22T05:03:34.948 DEBUG:teuthology.orchestra.run.smithi049:> dpkg-query -W -f '${Version}' ceph 2024-01-22T05:03:34.987 INFO:teuthology.orchestra.run.smithi049.stdout:16.2.14-452-g9854ba8e-1focal 2024-01-22T05:03:34.988 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-452-g9854ba8e-1focal 2024-01-22T05:03:34.988 INFO:teuthology.task.install:The correct ceph version 16.2.14-452-g9854ba8e-1focal is installed. 2024-01-22T05:03:34.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 2024-01-22T05:03:35.206 DEBUG:teuthology.orchestra.run.smithi110:> dpkg-query -W -f '${Version}' ceph 2024-01-22T05:03:35.237 INFO:teuthology.orchestra.run.smithi110.stdout:16.2.14-452-g9854ba8e-1focal 2024-01-22T05:03:35.238 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-452-g9854ba8e-1focal 2024-01-22T05:03:35.238 INFO:teuthology.task.install:The correct ceph version 16.2.14-452-g9854ba8e-1focal is installed. 2024-01-22T05:03:35.239 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-22T05:03:35.240 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:03:35.240 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-22T05:03:35.274 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:03:35.275 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-22T05:03:35.313 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-22T05:03:35.313 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:03:35.313 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2024-01-22T05:03:35.349 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-22T05:03:35.430 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:03:35.431 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-01-22T05:03:35.467 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-22T05:03:35.542 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-22T05:03:35.542 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:03:35.542 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-22T05:03:35.575 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-22T05:03:35.654 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:03:35.654 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-22T05:03:35.690 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-22T05:03:35.765 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-22T05:03:35.765 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:03:35.765 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2024-01-22T05:03:35.804 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-22T05:03:35.877 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:03:35.877 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-01-22T05:03:35.915 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-22T05:03:35.986 INFO:teuthology.run_tasks:Running task ceph... 2024-01-22T05:03:36.043 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-22T05:03:36.043 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /var/log/ceph 2024-01-22T05:03:36.052 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2024-01-22T05:03:36.086 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-22T05:03:36.086 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-22T05:03:36.126 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-22T05:03:36.160 INFO:tasks.ceph:Creating extra log directories... 2024-01-22T05:03:36.160 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-22T05:03:36.202 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-22T05:03:36.245 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-22T05:03:36.245 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-22T05:03:36.245 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-22T05:03:36.245 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:03:36.245 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-22T05:03:36.292 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-22T05:03:36.424 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:03:36.424 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-22T05:03:36.442 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-22T05:03:36.568 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-22T05:03:36.568 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-22T05:03:36.569 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560', 'branch': 'wip-vshankar-testing-pacific-020240119.072505', 'description': 'fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7523560', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '06652275eb934672217aaf9d4180f4a90395eb16'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-pacific-020240119.072505'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-pacific-020240119.072505', 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2977, 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32', 'sleep_before_teardown': 0, 'subset': '749/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-pacific-020240119.072505', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32', 'targets': {'smithi049.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '06652275eb934672217aaf9d4180f4a90395eb16'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'cd45576300487d997e5a85abed65500b9f5d143b', 'timestamp': '2024-01-19_15:47:44', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-22T05:03:36.569 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-22T05:03:36.575 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-22T05:03:36.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/run/ceph 2024-01-22T05:03:36.634 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2024-01-22T05:03:36.670 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:03:36.670 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2024-01-22T05:03:36.730 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-22T05:03:36.730 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2024-01-22T05:03:36.794 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-22T05:03:36.794 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:03:36.794 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 498 Links: 1 2024-01-22T05:03:36.794 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:03:36.794 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-01-22 04:58:38.863949352 +0000 2024-01-22T05:03:36.794 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-01-22 04:58:38.539956823 +0000 2024-01-22T05:03:36.794 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-01-22 04:58:38.539956823 +0000 2024-01-22T05:03:36.794 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-01-22T05:03:36.795 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-22T05:03:36.872 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:03:36.872 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:03:36.872 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.00064767 s, 791 kB/s 2024-01-22T05:03:36.875 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-22T05:03:36.942 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2024-01-22T05:03:37.003 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-22T05:03:37.003 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:03:37.003 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 503 Links: 1 2024-01-22T05:03:37.003 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:03:37.003 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-01-22 04:58:39.179942064 +0000 2024-01-22T05:03:37.003 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-01-22 04:58:39.175942157 +0000 2024-01-22T05:03:37.003 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-01-22 04:58:39.175942157 +0000 2024-01-22T05:03:37.003 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-01-22T05:03:37.004 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-22T05:03:37.080 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:03:37.080 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:03:37.080 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000575524 s, 890 kB/s 2024-01-22T05:03:37.082 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-22T05:03:37.150 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2024-01-22T05:03:37.211 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-22T05:03:37.212 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:03:37.212 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 509 Links: 1 2024-01-22T05:03:37.212 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:03:37.212 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-01-22 04:58:39.771928413 +0000 2024-01-22T05:03:37.212 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-01-22 04:58:39.767928505 +0000 2024-01-22T05:03:37.212 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-01-22 04:58:39.767928505 +0000 2024-01-22T05:03:37.212 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-01-22T05:03:37.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-22T05:03:37.283 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:03:37.283 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:03:37.283 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.0006144 s, 833 kB/s 2024-01-22T05:03:37.285 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-22T05:03:37.349 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2024-01-22T05:03:37.411 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-22T05:03:37.411 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:03:37.411 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 514 Links: 1 2024-01-22T05:03:37.411 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:03:37.411 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-01-22 04:58:40.711906735 +0000 2024-01-22T05:03:37.412 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-01-22 04:58:40.379914391 +0000 2024-01-22T05:03:37.412 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-01-22 04:58:40.379914391 +0000 2024-01-22T05:03:37.412 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-01-22T05:03:37.412 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-22T05:03:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:03:37.483 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:03:37.484 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000399954 s, 1.3 MB/s 2024-01-22T05:03:37.486 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-22T05:03:37.552 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-22T05:03:37.552 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:03:37.552 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-01-22T05:03:37.570 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-22T05:03:37.570 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-01-22T05:03:37.630 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-22T05:03:37.630 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:03:37.630 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 500 Links: 1 2024-01-22T05:03:37.630 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:03:37.630 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-01-22 04:58:35.141819881 +0000 2024-01-22T05:03:37.630 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-01-22 04:58:34.801827722 +0000 2024-01-22T05:03:37.631 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-01-22 04:58:34.801827722 +0000 2024-01-22T05:03:37.631 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-01-22T05:03:37.631 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-22T05:03:37.704 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-01-22T05:03:37.704 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-01-22T05:03:37.704 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000584148 s, 876 kB/s 2024-01-22T05:03:37.706 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-22T05:03:37.772 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-01-22T05:03:37.829 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-22T05:03:37.829 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:03:37.829 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 506 Links: 1 2024-01-22T05:03:37.829 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:03:37.830 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-01-22 04:58:35.445812869 +0000 2024-01-22T05:03:37.830 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-01-22 04:58:35.441812962 +0000 2024-01-22T05:03:37.830 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-01-22 04:58:35.441812962 +0000 2024-01-22T05:03:37.830 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-01-22T05:03:37.830 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-22T05:03:37.906 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-01-22T05:03:37.906 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-01-22T05:03:37.906 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000460499 s, 1.1 MB/s 2024-01-22T05:03:37.908 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-22T05:03:37.974 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-01-22T05:03:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-22T05:03:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:03:38.033 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 512 Links: 1 2024-01-22T05:03:38.033 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:03:38.033 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-01-22 04:58:36.045799034 +0000 2024-01-22T05:03:38.033 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-01-22 04:58:36.041799125 +0000 2024-01-22T05:03:38.033 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-01-22 04:58:36.041799125 +0000 2024-01-22T05:03:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-01-22T05:03:38.034 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-22T05:03:38.106 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-01-22T05:03:38.107 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-01-22T05:03:38.107 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.00045046 s, 1.1 MB/s 2024-01-22T05:03:38.109 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-22T05:03:38.173 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-01-22T05:03:38.238 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-22T05:03:38.238 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:03:38.238 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 516 Links: 1 2024-01-22T05:03:38.238 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:03:38.238 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-01-22 04:58:37.005776894 +0000 2024-01-22T05:03:38.239 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-01-22 04:58:36.661784828 +0000 2024-01-22T05:03:38.239 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-01-22 04:58:36.661784828 +0000 2024-01-22T05:03:38.239 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-01-22T05:03:38.239 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-22T05:03:38.312 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-01-22T05:03:38.313 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-01-22T05:03:38.313 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.00055831 s, 917 kB/s 2024-01-22T05:03:38.315 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-22T05:03:38.382 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-22T05:03:38.382 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-22T05:03:38.382 INFO:tasks.ceph:Generating config... 2024-01-22T05:03:38.383 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-22T05:03:38.383 INFO:tasks.ceph:[client] debug client = 20 2024-01-22T05:03:38.383 INFO:tasks.ceph:[client] debug ms = 1 2024-01-22T05:03:38.383 INFO:tasks.ceph:[client] pid file = 2024-01-22T05:03:38.383 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-22T05:03:38.383 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-22T05:03:38.383 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-01-22T05:03:38.383 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-22T05:03:38.384 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-22T05:03:38.384 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-22T05:03:38.384 INFO:tasks.ceph:[mds] mds cache max size = 1000 2024-01-22T05:03:38.384 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-22T05:03:38.384 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-22T05:03:38.384 INFO:tasks.ceph:[mds] mds log max segments = 1 2024-01-22T05:03:38.384 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-22T05:03:38.384 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-22T05:03:38.384 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-22T05:03:38.384 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-22T05:03:38.384 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-22T05:03:38.384 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-22T05:03:38.384 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-22T05:03:38.384 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-22T05:03:38.384 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-22T05:03:38.385 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-22T05:03:38.385 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-22T05:03:38.385 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-22T05:03:38.385 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-22T05:03:38.385 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-01-22T05:03:38.385 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-01-22T05:03:38.385 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-22T05:03:38.385 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-22T05:03:38.385 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-01-22T05:03:38.385 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-22T05:03:38.385 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-22T05:03:38.385 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-22T05:03:38.385 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-22T05:03:38.385 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-22T05:03:38.385 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-22T05:03:38.386 INFO:tasks.ceph:Setting up mon.a... 2024-01-22T05:03:38.386 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-22T05:03:38.462 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.keyring 2024-01-22T05:03:38.469 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-22T05:03:38.533 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-22T05:03:38.570 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.49'), ('mon.b', '172.21.15.110'), ('mon.c', '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]')] 2024-01-22T05:03:38.570 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.49,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-22T05:03:38.571 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:03:38.571 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-22T05:03:38.636 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.49 --add b 172.21.15.110 --addv c '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:03:38.737 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:03:38.738 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: generated fsid f4203cdb-f79e-4d7b-b9de-f994381af719 2024-01-22T05:03:38.738 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 0 2024-01-22T05:03:38.738 INFO:teuthology.orchestra.run.smithi049.stdout:fsid f4203cdb-f79e-4d7b-b9de-f994381af719 2024-01-22T05:03:38.738 INFO:teuthology.orchestra.run.smithi049.stdout:last_changed 2024-01-22T05:03:38.737786+0000 2024-01-22T05:03:38.738 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-01-22T05:03:38.737786+0000 2024-01-22T05:03:38.738 INFO:teuthology.orchestra.run.smithi049.stdout:min_mon_release 0 (unknown) 2024-01-22T05:03:38.738 INFO:teuthology.orchestra.run.smithi049.stdout:election_strategy: 1 2024-01-22T05:03:38.738 INFO:teuthology.orchestra.run.smithi049.stdout:0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-01-22T05:03:38.738 INFO:teuthology.orchestra.run.smithi049.stdout:1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-01-22T05:03:38.738 INFO:teuthology.orchestra.run.smithi049.stdout:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-01-22T05:03:38.738 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-22T05:03:38.741 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-22T05:03:38.757 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f4203cdb-f79e-4d7b-b9de-f994381af719... 2024-01-22T05:03:38.758 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-22T05:03:38.810 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-22T05:03:38.879 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2024-01-22T05:03:38.879 INFO:teuthology.orchestra.run.smithi049.stdout: chdir = "" 2024-01-22T05:03:38.879 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-22T05:03:38.880 INFO:teuthology.orchestra.run.smithi049.stdout: auth supported = cephx 2024-01-22T05:03:38.880 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.880 INFO:teuthology.orchestra.run.smithi049.stdout: filestore xattr use omap = true 2024-01-22T05:03:38.880 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.880 INFO:teuthology.orchestra.run.smithi049.stdout: mon clock drift allowed = 1.000 2024-01-22T05:03:38.880 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.880 INFO:teuthology.orchestra.run.smithi049.stdout: osd crush chooseleaf type = 0 2024-01-22T05:03:38.880 INFO:teuthology.orchestra.run.smithi049.stdout: auth debug = true 2024-01-22T05:03:38.880 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.880 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on old message = true 2024-01-22T05:03:38.880 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on bug = true 2024-01-22T05:03:38.880 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.880 INFO:teuthology.orchestra.run.smithi049.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-22T05:03:38.881 INFO:teuthology.orchestra.run.smithi049.stdout: mon pg warn max object skew = 0 2024-01-22T05:03:38.881 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.881 INFO:teuthology.orchestra.run.smithi049.stdout: # disable pg_autoscaler by default for new pools 2024-01-22T05:03:38.881 INFO:teuthology.orchestra.run.smithi049.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-22T05:03:38.881 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.881 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default size = 2 2024-01-22T05:03:38.881 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.881 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow primary affinity = true 2024-01-22T05:03:38.881 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow pg remap = true 2024-01-22T05:03:38.881 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on legacy crush tunables = false 2024-01-22T05:03:38.881 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on crush straw calc version zero = false 2024-01-22T05:03:38.881 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on no sortbitwise = false 2024-01-22T05:03:38.881 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on osd down out interval zero = false 2024-01-22T05:03:38.881 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on too few osds = false 2024-01-22T05:03:38.881 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: mon_allow_pool_size_one = true 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: osd default data pool replay window = 5 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: mon allow pool delete = true 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: mon cluster log file level = debug 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: debug asserts on shutdown = true 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: mon health detail to clog = false 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: mon host = "172.21.15.49,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on skipped message = False 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = f4203cdb-f79e-4d7b-b9de-f994381af719 2024-01-22T05:03:38.882 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:[osd] 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: osd journal size = 100 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub load threshold = 5.0 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub max interval = 600 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: osd recover clone overlap = true 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: osd recovery max chunk = 1048576 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug shutdown = true 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug op order = true 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug verify stray on activate = true 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: osd open classes on start = true 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug pg log writeout = true 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.883 INFO:teuthology.orchestra.run.smithi049.stdout: osd deep scrub update digest min age = 30 2024-01-22T05:03:38.884 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.884 INFO:teuthology.orchestra.run.smithi049.stdout: osd map max advance = 10 2024-01-22T05:03:38.884 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.884 INFO:teuthology.orchestra.run.smithi049.stdout: journal zero on create = true 2024-01-22T05:03:38.884 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.884 INFO:teuthology.orchestra.run.smithi049.stdout: filestore ondisk finisher threads = 3 2024-01-22T05:03:38.884 INFO:teuthology.orchestra.run.smithi049.stdout: filestore apply finisher threads = 3 2024-01-22T05:03:38.884 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.884 INFO:teuthology.orchestra.run.smithi049.stdout: bdev debug aio = true 2024-01-22T05:03:38.884 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug misdirected ops = true 2024-01-22T05:03:38.884 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore block size = 96636764160 2024-01-22T05:03:38.884 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore fsck on mount = True 2024-01-22T05:03:38.884 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluefs = 20 2024-01-22T05:03:38.884 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluestore = 20 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout: debug osd = 20 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout: debug rocksdb = 10 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd backfillfull_ratio = 0.85 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd full ratio = 0.9 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd nearfull ratio = 0.8 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout: osd failsafe full ratio = 0.95 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout: osd objectstore = bluestore 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr] 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout: debug mgr = 20 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-01-22T05:03:38.885 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: mgr/telemetry/nag = false 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout:[mon] 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: debug paxos = 20 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: mon data avail warn = 5 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: mon mgr mkfs grace = 240 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd reporter subtree level = osd 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd prime pg temp = true 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-22T05:03:38.886 INFO:teuthology.orchestra.run.smithi049.stdout: auth mon ticket ttl = 660 # 11m 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout: auth service ticket ttl = 240 # 4m 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout: # don't complain about insecure global_id in the test suite 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout: mon op complaint time = 120 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout:[client] 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout: rgw cache enabled = true 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable ops log = true 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable usage log = true 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout: client mount timeout = 600 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 20 2024-01-22T05:03:38.887 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:03:38.888 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = "" 2024-01-22T05:03:38.888 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2024-01-22T05:03:38.888 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2024-01-22T05:03:38.888 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.a] 2024-01-22T05:03:38.888 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.b] 2024-01-22T05:03:38.888 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.c] 2024-01-22T05:03:38.888 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2024-01-22T05:03:38.888 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2024-01-22T05:03:38.888 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2024-01-22T05:03:38.888 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2024-01-22T05:03:38.888 INFO:teuthology.orchestra.run.smithi049.stdout:[mds] 2024-01-22T05:03:38.888 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds = 20 2024-01-22T05:03:38.888 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds balancer = 20 2024-01-22T05:03:38.888 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:03:38.889 INFO:teuthology.orchestra.run.smithi049.stdout: mds cache max size = 1000 2024-01-22T05:03:38.889 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug frag = True 2024-01-22T05:03:38.889 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug scatterstat = True 2024-01-22T05:03:38.889 INFO:teuthology.orchestra.run.smithi049.stdout: mds log max segments = 1 2024-01-22T05:03:38.889 INFO:teuthology.orchestra.run.smithi049.stdout: mds op complaint time = 180 2024-01-22T05:03:38.889 INFO:teuthology.orchestra.run.smithi049.stdout: mds verify scatter = True 2024-01-22T05:03:38.889 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2024-01-22T05:03:38.889 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2024-01-22T05:03:38.889 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2024-01-22T05:03:38.889 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-01-22T05:03:38.889 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-01-22T05:03:38.890 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-22T05:03:38.890 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-01-22T05:03:38.890 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.890 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-01-22T05:03:38.890 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.890 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-01-22T05:03:38.890 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.890 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-01-22T05:03:38.890 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-01-22T05:03:38.890 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.890 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-01-22T05:03:38.890 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-01-22T05:03:38.890 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.890 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-22T05:03:38.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-01-22T05:03:38.891 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.891 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-01-22T05:03:38.891 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-22T05:03:38.891 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.891 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-01-22T05:03:38.891 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-01-22T05:03:38.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-01-22T05:03:38.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-01-22T05:03:38.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-01-22T05:03:38.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-01-22T05:03:38.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-01-22T05:03:38.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-01-22T05:03:38.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-22T05:03:38.892 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-22T05:03:38.892 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-01-22T05:03:38.892 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.892 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2024-01-22T05:03:38.892 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.892 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-01-22T05:03:38.892 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.892 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-01-22T05:03:38.892 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.892 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-01-22T05:03:38.892 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-01-22T05:03:38.892 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-01-22T05:03:38.892 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.49,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-01-22T05:03:38.892 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on skipped message = False 2024-01-22T05:03:38.892 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = f4203cdb-f79e-4d7b-b9de-f994381af719 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-01-22T05:03:38.893 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.894 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-01-22T05:03:38.894 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.894 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-01-22T05:03:38.894 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.894 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-01-22T05:03:38.894 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.894 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-01-22T05:03:38.894 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-01-22T05:03:38.894 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.894 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-01-22T05:03:38.894 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-01-22T05:03:38.894 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-01-22T05:03:38.894 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-01-22T05:03:38.894 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 20 2024-01-22T05:03:38.894 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 20 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 10 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:03:38.895 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:03:38.896 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-01-22T05:03:38.896 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.896 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-01-22T05:03:38.896 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:03:38.896 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-01-22T05:03:38.896 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-01-22T05:03:38.896 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-01-22T05:03:38.896 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-01-22T05:03:38.896 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-01-22T05:03:38.896 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:03:38.896 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-01-22T05:03:38.896 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-01-22T05:03:38.896 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:03:38.896 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.897 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-22T05:03:38.897 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-01-22T05:03:38.897 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-01-22T05:03:38.897 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.897 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-01-22T05:03:38.897 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-22T05:03:38.897 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-22T05:03:38.897 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2024-01-22T05:03:38.897 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:03:38.897 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-01-22T05:03:38.897 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-01-22T05:03:38.897 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-01-22T05:03:38.897 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-01-22T05:03:38.897 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-22T05:03:38.898 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-22T05:03:38.898 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2024-01-22T05:03:38.898 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2024-01-22T05:03:38.898 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:03:38.898 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = "" 2024-01-22T05:03:38.898 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-01-22T05:03:38.898 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-01-22T05:03:38.898 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-01-22T05:03:38.898 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-01-22T05:03:38.898 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-01-22T05:03:38.898 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-01-22T05:03:38.898 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-01-22T05:03:38.898 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-01-22T05:03:38.898 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-01-22T05:03:38.898 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2024-01-22T05:03:38.899 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2024-01-22T05:03:38.899 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds balancer = 20 2024-01-22T05:03:38.899 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:03:38.899 INFO:teuthology.orchestra.run.smithi110.stdout: mds cache max size = 1000 2024-01-22T05:03:38.899 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2024-01-22T05:03:38.899 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = True 2024-01-22T05:03:38.899 INFO:teuthology.orchestra.run.smithi110.stdout: mds log max segments = 1 2024-01-22T05:03:38.899 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2024-01-22T05:03:38.899 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = True 2024-01-22T05:03:38.899 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-01-22T05:03:38.899 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-01-22T05:03:38.899 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-01-22T05:03:38.908 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-22T05:03:38.909 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-22T05:03:39.025 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-22T05:03:39.025 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:03:39.025 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-22T05:03:39.040 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:03:39.040 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-22T05:03:39.097 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:03:39.097 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:03:39.097 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-22T05:03:39.097 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-22T05:03:39.200 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:03:39.200 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:03:39.258 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2024-01-22T05:03:39.258 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:03:39.258 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-22T05:03:39.258 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-22T05:03:39.315 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:03:39.315 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:03:39.374 INFO:tasks.ceph:Setting up mon nodes... 2024-01-22T05:03:39.374 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-22T05:03:39.375 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-22T05:03:39.462 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-22T05:03:39.469 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-22T05:03:39.572 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-22T05:03:39.580 INFO:tasks.ceph:Setting up mds nodes... 2024-01-22T05:03:39.580 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-22T05:03:39.669 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-22T05:03:39.675 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-22T05:03:39.707 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-22T05:03:39.842 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-22T05:03:39.849 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-22T05:03:39.878 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-22T05:03:39.966 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-22T05:03:39.973 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-22T05:03:40.002 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-22T05:03:40.135 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-22T05:03:40.139 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-22T05:03:40.170 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-22T05:03:40.171 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-22T05:03:40.238 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-22T05:03:40.267 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-01-22T05:03:40.328 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-01-22T05:03:40.359 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-22T05:03:40.422 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-01-22T05:03:40.447 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-01-22T05:03:40.507 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-01-22T05:03:40.534 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-22T05:03:40.535 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-22T05:03:40.535 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-22T05:03:40.570 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-22T05:03:40.570 INFO:tasks.ceph:role: osd.0 2024-01-22T05:03:40.571 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:03:40.571 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-22T05:03:40.680 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:03:40.680 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:03:40.681 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:03:40.681 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 2024-01-22T05:03:40.681 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:03:40.681 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:03:40.681 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:03:40.681 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:03:40.681 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:03:40.681 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:03:40.685 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2024-01-22T05:03:40.685 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-22T05:03:40.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-22T05:03:40.789 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2024-01-22T05:03:40.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:03:40.791 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-22T05:03:40.868 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-22T05:03:40.868 INFO:tasks.ceph:role: osd.1 2024-01-22T05:03:40.868 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:03:40.868 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-22T05:03:40.977 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:03:40.977 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:03:40.978 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:03:40.978 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 2024-01-22T05:03:40.978 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:03:40.978 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:03:40.978 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:03:40.978 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:03:40.978 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:03:40.978 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:03:40.982 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2024-01-22T05:03:40.982 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-22T05:03:41.026 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-22T05:03:41.092 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2024-01-22T05:03:41.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:03:41.094 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-22T05:03:41.177 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-22T05:03:41.177 INFO:tasks.ceph:role: osd.2 2024-01-22T05:03:41.177 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:03:41.177 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-22T05:03:41.287 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:03:41.288 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:03:41.288 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:03:41.288 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 2024-01-22T05:03:41.288 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:03:41.288 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:03:41.288 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:03:41.288 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:03:41.288 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:03:41.288 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:03:41.295 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2024-01-22T05:03:41.295 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-22T05:03:41.339 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-22T05:03:41.404 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2024-01-22T05:03:41.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:03:41.406 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-22T05:03:41.483 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-22T05:03:41.483 INFO:tasks.ceph:role: osd.3 2024-01-22T05:03:41.483 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:03:41.483 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-22T05:03:41.596 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:03:41.596 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:03:41.597 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:03:41.597 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 2024-01-22T05:03:41.597 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:03:41.597 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:03:41.597 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:03:41.597 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:03:41.597 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:03:41.597 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:03:41.601 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2024-01-22T05:03:41.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-22T05:03:41.644 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-22T05:03:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2024-01-22T05:03:41.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:03:41.714 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:03:41.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:41.875+0000 7fa3dd54b200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-22T05:03:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:41.879+0000 7fa3dd54b200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-22T05:03:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:41.879+0000 7fa3dd54b200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-22T05:03:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:41.879+0000 7fa3dd54b200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-22T05:03:41.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:41.879+0000 7fa3dd54b200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-22T05:03:41.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:41.883+0000 7fa3dd54b200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-22T05:03:45.424 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-22T05:03:45.460 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:03:45.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:45.571+0000 7f2df02e7200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-22T05:03:45.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:45.571+0000 7f2df02e7200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-22T05:03:45.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:45.571+0000 7f2df02e7200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-22T05:03:45.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:45.571+0000 7f2df02e7200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-22T05:03:45.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:45.571+0000 7f2df02e7200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-22T05:03:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:45.575+0000 7f2df02e7200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-22T05:03:49.143 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-22T05:03:49.177 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:03:49.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:49.295+0000 7f25b2305200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-22T05:03:49.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:49.295+0000 7f25b2305200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-22T05:03:49.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:49.299+0000 7f25b2305200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-22T05:03:49.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:49.299+0000 7f25b2305200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-22T05:03:49.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:49.299+0000 7f25b2305200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-22T05:03:49.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:49.299+0000 7f25b2305200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-22T05:03:52.859 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-22T05:03:52.892 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:03:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:53.003+0000 7fcf6a4e6200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-22T05:03:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:53.003+0000 7fcf6a4e6200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-22T05:03:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:53.003+0000 7fcf6a4e6200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-22T05:03:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:53.003+0000 7fcf6a4e6200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-22T05:03:53.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:53.003+0000 7fcf6a4e6200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-22T05:03:53.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:03:53.003+0000 7fcf6a4e6200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-22T05:03:56.550 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-22T05:03:56.583 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-22T05:03:56.618 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-22T05:03:56.618 INFO:tasks.ceph:role: osd.4 2024-01-22T05:03:56.618 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-22T05:03:56.618 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-22T05:03:56.728 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:03:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:03:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:03:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 2024-01-22T05:03:56.728 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:03:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:03:56.728 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:03:56.728 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:03:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:03:56.728 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:03:56.732 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-01-22T05:03:56.732 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-22T05:03:56.775 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-22T05:03:56.838 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-01-22T05:03:56.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:03:56.840 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-22T05:03:56.917 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-22T05:03:56.917 INFO:tasks.ceph:role: osd.5 2024-01-22T05:03:56.917 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-22T05:03:56.917 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-22T05:03:57.031 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:03:57.031 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:03:57.031 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:03:57.031 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 2024-01-22T05:03:57.031 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:03:57.031 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:03:57.032 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:03:57.032 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:03:57.032 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:03:57.032 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:03:57.036 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-01-22T05:03:57.036 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-22T05:03:57.082 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-22T05:03:57.146 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-01-22T05:03:57.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:03:57.148 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-22T05:03:57.220 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-22T05:03:57.220 INFO:tasks.ceph:role: osd.6 2024-01-22T05:03:57.221 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-22T05:03:57.221 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-22T05:03:57.338 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:03:57.338 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:03:57.338 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:03:57.338 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 2024-01-22T05:03:57.338 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:03:57.338 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:03:57.338 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:03:57.338 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:03:57.338 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:03:57.338 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:03:57.343 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-01-22T05:03:57.343 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-22T05:03:57.381 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-22T05:03:57.449 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-01-22T05:03:57.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:03:57.451 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-22T05:03:57.526 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-22T05:03:57.526 INFO:tasks.ceph:role: osd.7 2024-01-22T05:03:57.526 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-22T05:03:57.526 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-22T05:03:57.637 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:03:57.637 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:03:57.637 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:03:57.638 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 2024-01-22T05:03:57.638 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:03:57.638 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:03:57.638 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:03:57.638 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:03:57.638 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:03:57.638 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:03:57.643 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-01-22T05:03:57.643 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-22T05:03:57.679 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-22T05:03:57.743 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-01-22T05:03:57.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:03:57.745 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:03:57.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:03:57.891+0000 7f94c379f200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-22T05:03:57.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:03:57.891+0000 7f94c379f200 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-22T05:03:57.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:03:57.891+0000 7f94c379f200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-22T05:03:57.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:03:57.891+0000 7f94c379f200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-22T05:03:57.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:03:57.891+0000 7f94c379f200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-22T05:03:57.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:03:57.895+0000 7f94c379f200 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-22T05:04:01.449 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-22T05:04:01.490 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:04:01.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:01.596+0000 7f68884da200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-22T05:04:01.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:01.596+0000 7f68884da200 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-22T05:04:01.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:01.596+0000 7f68884da200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-22T05:04:01.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:01.596+0000 7f68884da200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-22T05:04:01.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:01.596+0000 7f68884da200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-22T05:04:01.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:01.600+0000 7f68884da200 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-22T05:04:05.156 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-22T05:04:05.187 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:04:05.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:05.292+0000 7f5ef14e5200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-22T05:04:05.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:05.296+0000 7f5ef14e5200 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-22T05:04:05.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:05.296+0000 7f5ef14e5200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-22T05:04:05.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:05.296+0000 7f5ef14e5200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-22T05:04:05.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:05.296+0000 7f5ef14e5200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-22T05:04:05.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:05.300+0000 7f5ef14e5200 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-22T05:04:06.570 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:04:06.577 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:04:08.841 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-22T05:04:08.873 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:04:08.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:08.984+0000 7f625f2dd200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-22T05:04:08.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:08.984+0000 7f625f2dd200 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-22T05:04:08.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:08.984+0000 7f625f2dd200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-22T05:04:08.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:08.984+0000 7f625f2dd200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-22T05:04:08.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:08.984+0000 7f625f2dd200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-22T05:04:08.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:08.984+0000 7f625f2dd200 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-22T05:04:12.514 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-22T05:04:12.544 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-22T05:04:12.545 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:04:12.545 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-22T05:04:12.581 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:04:12.581 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-22T05:04:12.657 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:04:12.657 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-22T05:04:12.734 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:04:12.735 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-22T05:04:12.809 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:04:12.809 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-22T05:04:12.885 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:04:12.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-22T05:04:12.961 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:04:12.961 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-22T05:04:13.038 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:04:13.038 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-22T05:04:13.072 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:04:13.072 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-22T05:04:13.143 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:04:13.144 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-22T05:04:13.219 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:04:13.219 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-22T05:04:13.293 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:04:13.293 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-22T05:04:13.370 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:04:13.371 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-22T05:04:13.448 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:04:13.448 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-22T05:04:13.525 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:04:13.525 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-22T05:04:13.543 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:04:13.543 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-01-22T05:04:13.603 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:04:13.603 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-01-22T05:04:13.621 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:04:13.622 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-01-22T05:04:13.682 INFO:tasks.ceph:Adding keys to all mons... 2024-01-22T05:04:13.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-22T05:04:13.689 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-22T05:04:13.731 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.y] 2024-01-22T05:04:13.731 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAr961lZlmPGxAA1KVZR+XzNdoFVo/980hD8w== 2024-01-22T05:04:13.731 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2024-01-22T05:04:13.731 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAr961lTCfoJxAAxDGvXKXgooA9/f0J70s6AA== 2024-01-22T05:04:13.731 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2024-01-22T05:04:13.731 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAr961lPo86MhAAonfC3M+AkLldljODYNGzyA== 2024-01-22T05:04:13.731 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.0] 2024-01-22T05:04:13.731 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAt961lH2F9NBAAHm8R9/Q5IuFUvb0o1GyD4Q== 2024-01-22T05:04:13.731 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.1] 2024-01-22T05:04:13.731 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAx961lS1lEIhAAuDm2OYfTYff1kVEq5vXvFw== 2024-01-22T05:04:13.731 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.2] 2024-01-22T05:04:13.732 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA1961limLvERAAv23crKrwjLIg84u48BHHbg== 2024-01-22T05:04:13.732 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.3] 2024-01-22T05:04:13.732 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA5961lShJiABAAnvyhz0ggDaITaMgwzi9kAA== 2024-01-22T05:04:13.732 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.x] 2024-01-22T05:04:13.732 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAr961l0DwDIhAAeuCu79LxNMEJvWiW/BfDhA== 2024-01-22T05:04:13.732 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2024-01-22T05:04:13.732 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAr961lHqV6ORAA1DwpPV2PyDBF/6/ePTdQJw== 2024-01-22T05:04:13.732 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2024-01-22T05:04:13.732 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAs961lLwvMBxAAFm52HWeGbTH1gbWVm6r5zQ== 2024-01-22T05:04:13.732 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.4] 2024-01-22T05:04:13.732 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA9961lcopfNRAAAZgHzI1t7YHI5cAjaCMiNw== 2024-01-22T05:04:13.732 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.5] 2024-01-22T05:04:13.732 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBB961lX+nTIxAAtP3YQypuFWM5O/LADjvybA== 2024-01-22T05:04:13.732 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.6] 2024-01-22T05:04:13.733 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBF961lQ4/XERAARZPqENsV3jokk2g3OXUI5w== 2024-01-22T05:04:13.733 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.7] 2024-01-22T05:04:13.733 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBI961luxnqOhAAGsV74DKQda5cetNA/woOnA== 2024-01-22T05:04:13.733 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-01-22T05:04:13.733 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAs961lmrM6DhAAYU09HviWyrUIz4lio15wFw== 2024-01-22T05:04:13.733 INFO:teuthology.orchestra.run.smithi049.stdout:[client.2] 2024-01-22T05:04:13.733 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAs961lRuyaExAAQO3a7ahOEcuE+WVfXYEBTg== 2024-01-22T05:04:13.733 INFO:teuthology.orchestra.run.smithi049.stdout:[client.1] 2024-01-22T05:04:13.733 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAs961lIhYRGRAAFG+YtkDLFsra6zU44xKCHw== 2024-01-22T05:04:13.733 INFO:teuthology.orchestra.run.smithi049.stdout:[client.3] 2024-01-22T05:04:13.733 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAs961lMiMkHhAAxPdKpcHdtqSphbc/2agq9Q== 2024-01-22T05:04:13.753 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.y] 2024-01-22T05:04:13.753 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAr961lZlmPGxAA1KVZR+XzNdoFVo/980hD8w== 2024-01-22T05:04:13.753 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-01-22T05:04:13.753 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAr961lTCfoJxAAxDGvXKXgooA9/f0J70s6AA== 2024-01-22T05:04:13.753 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-01-22T05:04:13.753 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAr961lPo86MhAAonfC3M+AkLldljODYNGzyA== 2024-01-22T05:04:13.753 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2024-01-22T05:04:13.753 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAt961lH2F9NBAAHm8R9/Q5IuFUvb0o1GyD4Q== 2024-01-22T05:04:13.753 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2024-01-22T05:04:13.753 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAx961lS1lEIhAAuDm2OYfTYff1kVEq5vXvFw== 2024-01-22T05:04:13.754 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2024-01-22T05:04:13.754 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQA1961limLvERAAv23crKrwjLIg84u48BHHbg== 2024-01-22T05:04:13.754 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2024-01-22T05:04:13.754 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQA5961lShJiABAAnvyhz0ggDaITaMgwzi9kAA== 2024-01-22T05:04:13.754 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2024-01-22T05:04:13.754 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAr961l0DwDIhAAeuCu79LxNMEJvWiW/BfDhA== 2024-01-22T05:04:13.754 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-01-22T05:04:13.754 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAr961lHqV6ORAA1DwpPV2PyDBF/6/ePTdQJw== 2024-01-22T05:04:13.754 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-01-22T05:04:13.754 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAs961lLwvMBxAAFm52HWeGbTH1gbWVm6r5zQ== 2024-01-22T05:04:13.754 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.4] 2024-01-22T05:04:13.754 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQA9961lcopfNRAAAZgHzI1t7YHI5cAjaCMiNw== 2024-01-22T05:04:13.754 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.5] 2024-01-22T05:04:13.754 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBB961lX+nTIxAAtP3YQypuFWM5O/LADjvybA== 2024-01-22T05:04:13.755 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.6] 2024-01-22T05:04:13.755 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBF961lQ4/XERAARZPqENsV3jokk2g3OXUI5w== 2024-01-22T05:04:13.755 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.7] 2024-01-22T05:04:13.755 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBI961luxnqOhAAGsV74DKQda5cetNA/woOnA== 2024-01-22T05:04:13.755 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-01-22T05:04:13.755 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAs961lmrM6DhAAYU09HviWyrUIz4lio15wFw== 2024-01-22T05:04:13.755 INFO:teuthology.orchestra.run.smithi110.stdout:[client.2] 2024-01-22T05:04:13.755 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAs961lRuyaExAAQO3a7ahOEcuE+WVfXYEBTg== 2024-01-22T05:04:13.755 INFO:teuthology.orchestra.run.smithi110.stdout:[client.1] 2024-01-22T05:04:13.755 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAs961lIhYRGRAAFG+YtkDLFsra6zU44xKCHw== 2024-01-22T05:04:13.755 INFO:teuthology.orchestra.run.smithi110.stdout:[client.3] 2024-01-22T05:04:13.755 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAs961lMiMkHhAAxPdKpcHdtqSphbc/2agq9Q== 2024-01-22T05:04:13.756 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-22T05:04:13.783 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-22T05:04:13.872 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:04:13.878 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:04:13.956 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:04:13.961 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:04:14.033 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.039 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.107 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.113 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.181 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.186 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.256 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.262 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.331 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-22T05:04:14.336 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-22T05:04:14.408 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:04:14.413 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:04:14.494 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:04:14.500 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:04:14.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.583 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.655 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.661 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.732 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.738 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.809 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.815 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:04:14.882 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:04:14.888 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:04:14.962 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:04:14.967 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:04:15.039 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:04:15.044 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:04:15.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:04:15.129 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:04:15.202 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-22T05:04:15.202 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-22T05:04:15.235 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-22T05:04:15.368 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-22T05:04:15.404 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-22T05:04:15.438 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-22T05:04:15.568 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-22T05:04:15.599 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-22T05:04:15.673 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-22T05:04:15.803 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-22T05:04:15.834 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:04:15.840 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:04:15.894 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-22T05:04:15.894 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-22T05:04:15.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-22T05:04:15.902 INFO:tasks.ceph.mon.a:Started 2024-01-22T05:04:15.903 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-22T05:04:15.903 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-01-22T05:04:15.945 INFO:tasks.ceph.mon.b:Started 2024-01-22T05:04:15.946 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-22T05:04:15.946 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-01-22T05:04:15.950 INFO:tasks.ceph.mon.c:Started 2024-01-22T05:04:15.950 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-22T05:04:15.950 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-22T05:04:15.950 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-22T05:04:15.957 INFO:tasks.ceph.mgr.y:Started 2024-01-22T05:04:15.957 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-22T05:04:15.957 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-22T05:04:15.961 INFO:tasks.ceph.mgr.x:Started 2024-01-22T05:04:15.961 INFO:tasks.ceph:Setting crush tunables to default 2024-01-22T05:04:15.962 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd crush tunables default 2024-01-22T05:04:16.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.106+0000 7f4f4e200700 1 Processor -- start 2024-01-22T05:04:16.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.106+0000 7f4f4e200700 1 -- start start 2024-01-22T05:04:16.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.110+0000 7f4f4e200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4f480bde60 0x7f4f48063e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:16.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.110+0000 7f4f4e200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f48151300 con 0x7f4f480be310 2024-01-22T05:04:16.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.110+0000 7f4f4e200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f481515e0 con 0x7f4f48150e70 2024-01-22T05:04:16.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.110+0000 7f4f4e200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4814b3b0 con 0x7f4f480bde60 2024-01-22T05:04:16.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.110+0000 7f4f47e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4f480be310 0x7f4f480a9220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45606/0 (socket says 172.21.15.49:45606) 2024-01-22T05:04:16.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.110+0000 7f4f47e00700 1 -- 172.21.15.49:0/1965978826 learned_addr learned my addr 172.21.15.49:0/1965978826 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:16.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.110+0000 7f4f46a00700 1 --2- 172.21.15.49:0/1965978826 >> v2:172.21.15.110:3300/0 conn(0x7f4f480bde60 0x7f4f48063e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:16.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.110+0000 7f4f46a00700 1 -- 172.21.15.49:0/1965978826 >> v2:172.21.15.110:3300/0 conn(0x7f4f480bde60 msgr2=0x7f4f48063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-22T05:04:16.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.110+0000 7f4f46a00700 1 -- 172.21.15.49:0/1965978826 >> v2:172.21.15.110:3300/0 conn(0x7f4f480bde60 msgr2=0x7f4f48063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-22T05:04:16.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.110+0000 7f4f46a00700 1 --2- 172.21.15.49:0/1965978826 >> v2:172.21.15.110:3300/0 conn(0x7f4f480bde60 0x7f4f48063e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-01-22T05:04:16.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.110+0000 7f4f46a00700 1 --2- 172.21.15.49:0/1965978826 >> v2:172.21.15.110:3300/0 conn(0x7f4f480bde60 0x7f4f48063e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-01-22T05:04:16.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758199012 0 0) 0x7f4f48151300 con 0x7f4f480be310 2024-01-22T05:04:16.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f280033f0 con 0x7f4f480be310 2024-01-22T05:04:16.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141663213 0 0) 0x7f4f481515e0 con 0x7f4f48150e70 2024-01-22T05:04:16.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f48151300 con 0x7f4f48150e70 2024-01-22T05:04:16.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 402876222 0 0) 0x7f4f280033f0 con 0x7f4f480be310 2024-01-22T05:04:16.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 >> v2:172.21.15.110:3300/0 conn(0x7f4f480bde60 msgr2=0x7f4f48063e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-22T05:04:16.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 --2- 172.21.15.49:0/1965978826 >> v2:172.21.15.110:3300/0 conn(0x7f4f480bde60 0x7f4f48063e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:16.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 >> v1:172.21.15.110:6789/0 conn(0x7f4f48150e70 legacy=0x7f4f4814aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:16.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f481518c0 con 0x7f4f480be310 2024-01-22T05:04:16.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f4f400017f0 con 0x7f4f480be310 2024-01-22T05:04:16.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 >> v1:172.21.15.49:6789/0 conn(0x7f4f480be310 legacy=0x7f4f480a9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:16.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 --2- 172.21.15.49:0/1965978826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f28003a70 0x7f4f28003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:16.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 --2- 172.21.15.49:0/1965978826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f28004690 0x7f4f28004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:16.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 --2- 172.21.15.49:0/1965978826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f28005050 0x7f4f2800daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:16.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4814b3b0 con 0x7f4f28004690 2024-01-22T05:04:16.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2800e120 con 0x7f4f28003a70 2024-01-22T05:04:16.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2800e2e0 con 0x7f4f28005050 2024-01-22T05:04:16.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f46a00700 1 --2- 172.21.15.49:0/1965978826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f28004690 0x7f4f28004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:16.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.278+0000 7f4f47400700 1 --2- 172.21.15.49:0/1965978826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f28003a70 0x7f4f28003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:16.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.282+0000 7f4f47e00700 1 --2- 172.21.15.49:0/1965978826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f28005050 0x7f4f2800daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:16.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.282+0000 7f4f46a00700 1 -- 172.21.15.49:0/1965978826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f28005050 msgr2=0x7f4f2800daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:16.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.282+0000 7f4f46a00700 1 --2- 172.21.15.49:0/1965978826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f28005050 0x7f4f2800daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:16.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.282+0000 7f4f46a00700 1 -- 172.21.15.49:0/1965978826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f28003a70 msgr2=0x7f4f28003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:16.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.282+0000 7f4f46a00700 1 --2- 172.21.15.49:0/1965978826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f28003a70 0x7f4f28003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:16.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.282+0000 7f4f47e00700 1 -- 172.21.15.49:0/1965978826 reap_dead start 2024-01-22T05:04:16.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.282+0000 7f4f46a00700 1 -- 172.21.15.49:0/1965978826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280033f0 con 0x7f4f28004690 2024-01-22T05:04:16.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.282+0000 7f4f46a00700 1 --2- 172.21.15.49:0/1965978826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f28004690 0x7f4f28004b10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4f30006db0 tx=0x7f4f30008040).ready entity=mon.0 client_cookie=2d095160c959ee6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:16.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.282+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30013480 con 0x7f4f28004690 2024-01-22T05:04:16.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.282+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f300135e0 con 0x7f4f28004690 2024-01-22T05:04:16.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.282+0000 7f4f46000700 1 -- 172.21.15.49:0/1965978826 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30013980 con 0x7f4f28004690 2024-01-22T05:04:16.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.286+0000 7f4f4e200700 1 -- 172.21.15.49:0/1965978826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f28004690 msgr2=0x7f4f28004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:16.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.286+0000 7f4f4e200700 1 --2- 172.21.15.49:0/1965978826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f28004690 0x7f4f28004b10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4f30006db0 tx=0x7f4f30008040).stop 2024-01-22T05:04:16.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.286+0000 7f4f4e200700 1 -- 172.21.15.49:0/1965978826 shutdown_connections 2024-01-22T05:04:16.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.286+0000 7f4f4e200700 1 --2- 172.21.15.49:0/1965978826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f28004690 0x7f4f28004b10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:16.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.286+0000 7f4f4e200700 1 -- 172.21.15.49:0/1965978826 >> 172.21.15.49:0/1965978826 conn(0x7f4f480c40f0 msgr2=0x7f4f480c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:16.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.286+0000 7f4f4e200700 1 -- 172.21.15.49:0/1965978826 shutdown_connections 2024-01-22T05:04:16.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.286+0000 7f4f4e200700 1 -- 172.21.15.49:0/1965978826 wait complete. 2024-01-22T05:04:16.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.290+0000 7f4f4e200700 1 Processor -- start 2024-01-22T05:04:16.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.290+0000 7f4f4e200700 1 -- start start 2024-01-22T05:04:16.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f4e200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f28004690 0x7f4f480c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f4e200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4814f1c0 0x7f4f4814f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f4e200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f48160be0 0x7f4f48161060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f4e200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4814fb30 con 0x7f4f4814f1c0 2024-01-22T05:04:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f4e200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f480c1410 con 0x7f4f28004690 2024-01-22T05:04:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f4e200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f48163cd0 con 0x7f4f48160be0 2024-01-22T05:04:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f46a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4814f1c0 0x7f4f4814f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f47e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f48160be0 0x7f4f48161060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f47e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f48160be0 0x7f4f48161060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:32984/0 (socket says 172.21.15.49:32984) 2024-01-22T05:04:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f46a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4814f1c0 0x7f4f4814f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58868/0 (socket says 172.21.15.49:58868) 2024-01-22T05:04:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f47e00700 1 -- 172.21.15.49:0/1534830690 learned_addr learned my addr 172.21.15.49:0/1534830690 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f47400700 1 --2- 172.21.15.49:0/1534830690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f28004690 0x7f4f480c0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f46a00700 1 -- 172.21.15.49:0/1534830690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f48160be0 msgr2=0x7f4f48161060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f46a00700 1 --2- 172.21.15.49:0/1534830690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f48160be0 0x7f4f48161060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f46a00700 1 -- 172.21.15.49:0/1534830690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f28004690 msgr2=0x7f4f480c0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f46a00700 1 --2- 172.21.15.49:0/1534830690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f28004690 0x7f4f480c0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f46a00700 1 -- 172.21.15.49:0/1534830690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f48163fb0 con 0x7f4f4814f1c0 2024-01-22T05:04:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f46a00700 1 --2- 172.21.15.49:0/1534830690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4814f1c0 0x7f4f4814f640 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f4f30015000 tx=0x7f4f30008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f3ea00700 1 -- 172.21.15.49:0/1534830690 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30000d10 con 0x7f4f4814f1c0 2024-01-22T05:04:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f3ea00700 1 -- 172.21.15.49:0/1534830690 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f30013960 con 0x7f4f4814f1c0 2024-01-22T05:04:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f4e200700 1 -- 172.21.15.49:0/1534830690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f48164290 con 0x7f4f4814f1c0 2024-01-22T05:04:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f3ea00700 1 -- 172.21.15.49:0/1534830690 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3001e320 con 0x7f4f4814f1c0 2024-01-22T05:04:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f3ea00700 1 -- 172.21.15.49:0/1534830690 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f4f3001ca90 con 0x7f4f4814f1c0 2024-01-22T05:04:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f4e200700 1 -- 172.21.15.49:0/1534830690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f48161550 con 0x7f4f4814f1c0 2024-01-22T05:04:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.294+0000 7f4f3ea00700 1 -- 172.21.15.49:0/1534830690 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f4f3001e480 con 0x7f4f4814f1c0 2024-01-22T05:04:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.298+0000 7f4f4e200700 1 -- 172.21.15.49:0/1534830690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f480656b0 con 0x7f4f4814f1c0 2024-01-22T05:04:16.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.298+0000 7f4f3ea00700 1 -- 172.21.15.49:0/1534830690 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f4f30018070 con 0x7f4f4814f1c0 2024-01-22T05:04:16.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.390+0000 7f4f4e200700 1 -- 172.21.15.49:0/1534830690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4f48151ba0 con 0x7f4f4814f1c0 2024-01-22T05:04:16.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.398+0000 7f4f3ea00700 1 -- 172.21.15.49:0/1534830690 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4f30029670 con 0x7f4f4814f1c0 2024-01-22T05:04:16.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.402+0000 7f4f4e200700 1 -- 172.21.15.49:0/1534830690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4814f1c0 msgr2=0x7f4f4814f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:16.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.402+0000 7f4f4e200700 1 --2- 172.21.15.49:0/1534830690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4814f1c0 0x7f4f4814f640 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f4f30015000 tx=0x7f4f30008040).stop 2024-01-22T05:04:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.402+0000 7f4f4e200700 1 -- 172.21.15.49:0/1534830690 shutdown_connections 2024-01-22T05:04:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.402+0000 7f4f4e200700 1 --2- 172.21.15.49:0/1534830690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f48160be0 0x7f4f48161060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.402+0000 7f4f4e200700 1 --2- 172.21.15.49:0/1534830690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4814f1c0 0x7f4f4814f640 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.402+0000 7f4f4e200700 1 --2- 172.21.15.49:0/1534830690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f28004690 0x7f4f480c0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.402+0000 7f4f4e200700 1 -- 172.21.15.49:0/1534830690 >> 172.21.15.49:0/1534830690 conn(0x7f4f480c40f0 msgr2=0x7f4f48063e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.402+0000 7f4f4e200700 1 -- 172.21.15.49:0/1534830690 shutdown_connections 2024-01-22T05:04:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:16.402+0000 7f4f4e200700 1 -- 172.21.15.49:0/1534830690 wait complete. 2024-01-22T05:04:16.410 INFO:teuthology.orchestra.run.smithi049.stderr:adjusted tunables profile to default 2024-01-22T05:04:16.431 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-22T05:04:16.432 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:04:16.432 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-22T05:04:16.464 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:04:16.465 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-22T05:04:16.534 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:16.530+0000 7f56274e0500 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-22T05:04:16.538 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:04:16.538 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-22T05:04:16.575 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:16.568+0000 7ff49e962500 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-22T05:04:16.613 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-22T05:04:16.613 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-22T05:04:16.621 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:16.614+0000 7f56274e0500 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-22T05:04:16.654 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:04:16.655 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-22T05:04:16.661 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:16.652+0000 7ff49e962500 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-22T05:04:16.687 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:04:16.687 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-22T05:04:16.760 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:04:16.760 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-22T05:04:16.831 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-22T05:04:16.831 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-22T05:04:16.903 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 295d3558-ee93-4059-bc87-d4fcd45e15a4 0 2024-01-22T05:04:17.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.088+0000 7fbddf200700 1 Processor -- start 2024-01-22T05:04:17.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.092+0000 7fbddf200700 1 -- start start 2024-01-22T05:04:17.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.092+0000 7fbddf200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbdd8069e70 0x7fbdd8063d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.092+0000 7fbddf200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbdd8064200 0x7fbdd8154590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.092+0000 7fbddf200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd80c3c90 con 0x7fbdd80bdd60 2024-01-22T05:04:17.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.092+0000 7fbddf200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd8064690 con 0x7fbdd8064200 2024-01-22T05:04:17.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.092+0000 7fbddf200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd8150df0 con 0x7fbdd8069e70 2024-01-22T05:04:17.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.092+0000 7fbdd7400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbdd8069e70 0x7fbdd8063d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.092+0000 7fbdd7400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbdd8069e70 0x7fbdd8063d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52422/0 (socket says 172.21.15.110:52422) 2024-01-22T05:04:17.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.092+0000 7fbdd7400700 1 -- 172.21.15.110:0/2787729299 learned_addr learned my addr 172.21.15.110:0/2787729299 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:04:17.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.092+0000 7fbdd7e00700 1 --1- 172.21.15.110:0/2787729299 >> v1:172.21.15.110:6789/0 conn(0x7fbdd80bdd60 0x7fbdd81506e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:57632/0 (socket says 172.21.15.110:57632) 2024-01-22T05:04:17.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.092+0000 7fbdd7400700 1 -- 172.21.15.110:0/2787729299 >> v2:172.21.15.49:3300/0 conn(0x7fbdd8064200 msgr2=0x7fbdd8154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:17.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.092+0000 7fbdd7400700 1 --2- 172.21.15.110:0/2787729299 >> v2:172.21.15.49:3300/0 conn(0x7fbdd8064200 0x7fbdd8154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:04:17.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.092+0000 7fbdd7400700 1 -- 172.21.15.110:0/2787729299 >> v1:172.21.15.110:6789/0 conn(0x7fbdd80bdd60 legacy=0x7fbdd81506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.092+0000 7fbdd7400700 1 -- 172.21.15.110:0/2787729299 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd80be300 con 0x7fbdd8069e70 2024-01-22T05:04:17.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.092+0000 7fbdd6a00700 1 -- 172.21.15.110:0/2787729299 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637908978 0 0) 0x7fbdd80c3c90 con 0x7fbdd80bdd60 2024-01-22T05:04:17.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.096+0000 7fbdd7400700 1 --2- 172.21.15.110:0/2787729299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd8069e70 0x7fbdd8063d10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fbdd80bc9d0 tx=0x7fbdc000b3b0).ready entity=mon.1 client_cookie=2a7f1b37d3abf36e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:17.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.096+0000 7fbdd6a00700 1 -- 172.21.15.110:0/2787729299 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc000db10 con 0x7fbdd8069e70 2024-01-22T05:04:17.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.096+0000 7fbdd6a00700 1 -- 172.21.15.110:0/2787729299 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc000dc70 con 0x7fbdd8069e70 2024-01-22T05:04:17.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.096+0000 7fbdd6a00700 1 -- 172.21.15.110:0/2787729299 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0010470 con 0x7fbdd8069e70 2024-01-22T05:04:17.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.096+0000 7fbddf200700 1 -- 172.21.15.110:0/2787729299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd8069e70 msgr2=0x7fbdd8063d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.096+0000 7fbddf200700 1 --2- 172.21.15.110:0/2787729299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd8069e70 0x7fbdd8063d10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fbdd80bc9d0 tx=0x7fbdc000b3b0).stop 2024-01-22T05:04:17.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.096+0000 7fbddf200700 1 -- 172.21.15.110:0/2787729299 shutdown_connections 2024-01-22T05:04:17.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.096+0000 7fbddf200700 1 --2- 172.21.15.110:0/2787729299 >> v2:172.21.15.49:3300/0 conn(0x7fbdd8064200 0x7fbdd8154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:04:17.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.096+0000 7fbddf200700 1 --2- 172.21.15.110:0/2787729299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd8069e70 0x7fbdd8063d10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.096+0000 7fbddf200700 1 -- 172.21.15.110:0/2787729299 >> 172.21.15.110:0/2787729299 conn(0x7fbdd8062720 msgr2=0x7fbdd8062b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:17.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.096+0000 7fbddf200700 1 -- 172.21.15.110:0/2787729299 shutdown_connections 2024-01-22T05:04:17.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.096+0000 7fbddf200700 1 -- 172.21.15.110:0/2787729299 wait complete. 2024-01-22T05:04:17.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.100+0000 7fbddf200700 1 Processor -- start 2024-01-22T05:04:17.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.100+0000 7fbddf200700 1 -- start start 2024-01-22T05:04:17.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.100+0000 7fbddf200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdd8064200 0x7fbdd8148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.100+0000 7fbddf200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd8069e70 0x7fbdd8164310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.100+0000 7fbddf200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd80bdd60 0x7fbdd80abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.100+0000 7fbddf200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8165220 con 0x7fbdd8064200 2024-01-22T05:04:17.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.100+0000 7fbddf200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8151910 con 0x7fbdd80bdd60 2024-01-22T05:04:17.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.100+0000 7fbddf200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8164c60 con 0x7fbdd8069e70 2024-01-22T05:04:17.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.100+0000 7fbdd7400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd8069e70 0x7fbdd8164310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.100+0000 7fbddd200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd80bdd60 0x7fbdd80abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.100+0000 7fbdd7400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd8069e70 0x7fbdd8164310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:42244/0 (socket says 172.21.15.110:42244) 2024-01-22T05:04:17.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.100+0000 7fbdd7400700 1 -- 172.21.15.110:0/1400628521 learned_addr learned my addr 172.21.15.110:0/1400628521 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:04:17.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbdd7e00700 1 --2- 172.21.15.110:0/1400628521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdd8064200 0x7fbdd8148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbddd200700 1 -- 172.21.15.110:0/1400628521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd8069e70 msgr2=0x7fbdd8164310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbddd200700 1 --2- 172.21.15.110:0/1400628521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd8069e70 0x7fbdd8164310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbddd200700 1 -- 172.21.15.110:0/1400628521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdd8064200 msgr2=0x7fbdd8148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbddd200700 1 --2- 172.21.15.110:0/1400628521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdd8064200 0x7fbdd8148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbddd200700 1 -- 172.21.15.110:0/1400628521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc000b610 con 0x7fbdd80bdd60 2024-01-22T05:04:17.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbdd7400700 1 --2- 172.21.15.110:0/1400628521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd8069e70 0x7fbdd8164310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:17.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbddd200700 1 --2- 172.21.15.110:0/1400628521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd80bdd60 0x7fbdd80abab0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fbdd000bad0 tx=0x7fbdd0009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:17.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbdcf400700 1 -- 172.21.15.110:0/1400628521 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd000c760 con 0x7fbdd80bdd60 2024-01-22T05:04:17.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbdcf400700 1 -- 172.21.15.110:0/1400628521 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd000c8e0 con 0x7fbdd80bdd60 2024-01-22T05:04:17.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbdcf400700 1 -- 172.21.15.110:0/1400628521 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd000ca90 con 0x7fbdd80bdd60 2024-01-22T05:04:17.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbddf200700 1 -- 172.21.15.110:0/1400628521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd8164f40 con 0x7fbdd80bdd60 2024-01-22T05:04:17.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbddf200700 1 -- 172.21.15.110:0/1400628521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd8149470 con 0x7fbdd80bdd60 2024-01-22T05:04:17.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbdcf400700 1 -- 172.21.15.110:0/1400628521 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fbdd0012020 con 0x7fbdd80bdd60 2024-01-22T05:04:17.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbdcf400700 1 -- 172.21.15.110:0/1400628521 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fbdd000ce40 con 0x7fbdd80bdd60 2024-01-22T05:04:17.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.104+0000 7fbddf200700 1 -- 172.21.15.110:0/1400628521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd8065940 con 0x7fbdd80bdd60 2024-01-22T05:04:17.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.112+0000 7fbdcf400700 1 -- 172.21.15.110:0/1400628521 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fbdd001a060 con 0x7fbdd80bdd60 2024-01-22T05:04:17.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.188+0000 7fbddf200700 1 -- 172.21.15.110:0/1400628521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "295d3558-ee93-4059-bc87-d4fcd45e15a4", "id": 0} v 0) v1 -- 0x7fbdd8046800 con 0x7fbdd80bdd60 2024-01-22T05:04:17.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.196+0000 7fbdcf400700 1 -- 172.21.15.110:0/1400628521 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "295d3558-ee93-4059-bc87-d4fcd45e15a4", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbdd00158b0 con 0x7fbdd80bdd60 2024-01-22T05:04:17.204 INFO:teuthology.orchestra.run.smithi110.stdout:0 2024-01-22T05:04:17.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.200+0000 7fbddf200700 1 -- 172.21.15.110:0/1400628521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd80bdd60 msgr2=0x7fbdd80abab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.200+0000 7fbddf200700 1 --2- 172.21.15.110:0/1400628521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd80bdd60 0x7fbdd80abab0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fbdd000bad0 tx=0x7fbdd0009780).stop 2024-01-22T05:04:17.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.200+0000 7fbddf200700 1 -- 172.21.15.110:0/1400628521 shutdown_connections 2024-01-22T05:04:17.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.200+0000 7fbddf200700 1 --2- 172.21.15.110:0/1400628521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd80bdd60 0x7fbdd80abab0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.200+0000 7fbddf200700 1 --2- 172.21.15.110:0/1400628521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd8069e70 0x7fbdd8164310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.200+0000 7fbddf200700 1 --2- 172.21.15.110:0/1400628521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdd8064200 0x7fbdd8148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.200+0000 7fbddf200700 1 -- 172.21.15.110:0/1400628521 >> 172.21.15.110:0/1400628521 conn(0x7fbdd8062720 msgr2=0x7fbdd80c5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:17.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.200+0000 7fbddf200700 1 -- 172.21.15.110:0/1400628521 shutdown_connections 2024-01-22T05:04:17.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.200+0000 7fbddf200700 1 -- 172.21.15.110:0/1400628521 wait complete. 2024-01-22T05:04:17.223 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 42b7d27b-f000-4511-8ad2-f9002c77403c 1 2024-01-22T05:04:17.324 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:17.318+0000 7f56274e0500 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-22T05:04:17.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.356+0000 7fa0d9000700 1 Processor -- start 2024-01-22T05:04:17.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.356+0000 7fa0d9000700 1 -- start start 2024-01-22T05:04:17.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d9000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0d41562a0 0x7fa0d4068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d9000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa0d40691a0 0x7fa0d4151690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d9000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0d4151b80 0x7fa0d40ab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d9000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d41559f0 con 0x7fa0d40691a0 2024-01-22T05:04:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d9000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d40c2d90 con 0x7fa0d4151b80 2024-01-22T05:04:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d9000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40c27d0 con 0x7fa0d41562a0 2024-01-22T05:04:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d3e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0d4151b80 0x7fa0d40ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0d41562a0 0x7fa0d4068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d3e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0d4151b80 0x7fa0d40ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52710/0 (socket says 172.21.15.110:52710) 2024-01-22T05:04:17.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d3e00700 1 -- 172.21.15.110:0/3430051863 learned_addr learned my addr 172.21.15.110:0/3430051863 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:04:17.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d2a00700 1 --2- 172.21.15.110:0/3430051863 >> v2:172.21.15.49:3300/0 conn(0x7fa0d40691a0 0x7fa0d4151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d3e00700 1 -- 172.21.15.110:0/3430051863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0d41562a0 msgr2=0x7fa0d4068cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:17.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d3e00700 1 --2- 172.21.15.110:0/3430051863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0d41562a0 0x7fa0d4068cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d3e00700 1 -- 172.21.15.110:0/3430051863 >> v2:172.21.15.49:3300/0 conn(0x7fa0d40691a0 msgr2=0x7fa0d4151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:17.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d3e00700 1 --2- 172.21.15.110:0/3430051863 >> v2:172.21.15.49:3300/0 conn(0x7fa0d40691a0 0x7fa0d4151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d3e00700 1 -- 172.21.15.110:0/3430051863 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d40c2ab0 con 0x7fa0d4151b80 2024-01-22T05:04:17.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d2a00700 1 --2- 172.21.15.110:0/3430051863 >> v2:172.21.15.49:3300/0 conn(0x7fa0d40691a0 0x7fa0d4151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:17.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d3e00700 1 --2- 172.21.15.110:0/3430051863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0d4151b80 0x7fa0d40ab890 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fa0d4065220 tx=0x7fa0cc009840).ready entity=mon.1 client_cookie=eb04af08d4eff6cf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:17.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d2000700 1 -- 172.21.15.110:0/3430051863 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc00e070 con 0x7fa0d4151b80 2024-01-22T05:04:17.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d2000700 1 -- 172.21.15.110:0/3430051863 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc00ba20 con 0x7fa0d4151b80 2024-01-22T05:04:17.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.360+0000 7fa0d2000700 1 -- 172.21.15.110:0/3430051863 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc00bda0 con 0x7fa0d4151b80 2024-01-22T05:04:17.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.364+0000 7fa0d9000700 1 -- 172.21.15.110:0/3430051863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0d4151b80 msgr2=0x7fa0d40ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.364+0000 7fa0d9000700 1 --2- 172.21.15.110:0/3430051863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0d4151b80 0x7fa0d40ab890 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fa0d4065220 tx=0x7fa0cc009840).stop 2024-01-22T05:04:17.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.364+0000 7fa0d9000700 1 -- 172.21.15.110:0/3430051863 shutdown_connections 2024-01-22T05:04:17.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.364+0000 7fa0d9000700 1 --2- 172.21.15.110:0/3430051863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0d4151b80 0x7fa0d40ab890 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.364+0000 7fa0d9000700 1 --2- 172.21.15.110:0/3430051863 >> v2:172.21.15.49:3300/0 conn(0x7fa0d40691a0 0x7fa0d4151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.364+0000 7fa0d9000700 1 --2- 172.21.15.110:0/3430051863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0d41562a0 0x7fa0d4068cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.364+0000 7fa0d9000700 1 -- 172.21.15.110:0/3430051863 >> 172.21.15.110:0/3430051863 conn(0x7fa0d40c6540 msgr2=0x7fa0d40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:17.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.364+0000 7fa0d9000700 1 -- 172.21.15.110:0/3430051863 shutdown_connections 2024-01-22T05:04:17.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.364+0000 7fa0d9000700 1 -- 172.21.15.110:0/3430051863 wait complete. 2024-01-22T05:04:17.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.364+0000 7fa0d9000700 1 Processor -- start 2024-01-22T05:04:17.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d9000700 1 -- start start 2024-01-22T05:04:17.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d9000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0d4151b80 0x7fa0d4150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d9000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0d41562a0 0x7fa0d40c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d9000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0d40c1480 0x7fa0d414dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d9000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d4150790 con 0x7fa0d41562a0 2024-01-22T05:04:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d9000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d4152f80 con 0x7fa0d40c1480 2024-01-22T05:04:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d9000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d414e780 con 0x7fa0d4151b80 2024-01-22T05:04:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0d4151b80 0x7fa0d4150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0d40c1480 0x7fa0d414dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0d4151b80 0x7fa0d4150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43000/0 (socket says 172.21.15.110:43000) 2024-01-22T05:04:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d3400700 1 -- 172.21.15.110:0/1238192532 learned_addr learned my addr 172.21.15.110:0/1238192532 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:04:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d2a00700 1 --2- 172.21.15.110:0/1238192532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0d41562a0 0x7fa0d40c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d3400700 1 -- 172.21.15.110:0/1238192532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0d40c1480 msgr2=0x7fa0d414dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d3400700 1 --2- 172.21.15.110:0/1238192532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0d40c1480 0x7fa0d414dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d3400700 1 -- 172.21.15.110:0/1238192532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0d41562a0 msgr2=0x7fa0d40c0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d3400700 1 --2- 172.21.15.110:0/1238192532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0d41562a0 0x7fa0d40c0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d3400700 1 -- 172.21.15.110:0/1238192532 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc009ae0 con 0x7fa0d4151b80 2024-01-22T05:04:17.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d2a00700 1 --2- 172.21.15.110:0/1238192532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0d41562a0 0x7fa0d40c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:17.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.368+0000 7fa0d3e00700 1 --2- 172.21.15.110:0/1238192532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0d40c1480 0x7fa0d414dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:17.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.372+0000 7fa0d3400700 1 --2- 172.21.15.110:0/1238192532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0d4151b80 0x7fa0d4150c20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fa0c400e900 tx=0x7fa0c4009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:17.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.372+0000 7fa0caa00700 1 -- 172.21.15.110:0/1238192532 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4012600 con 0x7fa0d4151b80 2024-01-22T05:04:17.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.372+0000 7fa0caa00700 1 -- 172.21.15.110:0/1238192532 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c4012760 con 0x7fa0d4151b80 2024-01-22T05:04:17.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.372+0000 7fa0caa00700 1 -- 172.21.15.110:0/1238192532 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4012ae0 con 0x7fa0d4151b80 2024-01-22T05:04:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.372+0000 7fa0d9000700 1 -- 172.21.15.110:0/1238192532 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d4150140 con 0x7fa0d4151b80 2024-01-22T05:04:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.372+0000 7fa0caa00700 1 -- 172.21.15.110:0/1238192532 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fa0c401b660 con 0x7fa0d4151b80 2024-01-22T05:04:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.372+0000 7fa0d9000700 1 -- 172.21.15.110:0/1238192532 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d414fdf0 con 0x7fa0d4151b80 2024-01-22T05:04:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.372+0000 7fa0caa00700 1 -- 172.21.15.110:0/1238192532 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fa0c401bb90 con 0x7fa0d4151b80 2024-01-22T05:04:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.372+0000 7fa0d9000700 1 -- 172.21.15.110:0/1238192532 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d40bcd70 con 0x7fa0d4151b80 2024-01-22T05:04:17.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.376+0000 7fa0caa00700 1 -- 172.21.15.110:0/1238192532 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fa0c403ae50 con 0x7fa0d4151b80 2024-01-22T05:04:17.396 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:17.388+0000 7ff49e962500 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-22T05:04:17.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.452+0000 7fa0d9000700 1 -- 172.21.15.110:0/1238192532 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "42b7d27b-f000-4511-8ad2-f9002c77403c", "id": 1} v 0) v1 -- 0x7fa0d4047060 con 0x7fa0d4151b80 2024-01-22T05:04:17.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.460+0000 7fa0caa00700 1 -- 172.21.15.110:0/1238192532 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42b7d27b-f000-4511-8ad2-f9002c77403c", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa0c4029070 con 0x7fa0d4151b80 2024-01-22T05:04:17.468 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-01-22T05:04:17.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.464+0000 7fa0d9000700 1 -- 172.21.15.110:0/1238192532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0d4151b80 msgr2=0x7fa0d4150c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.464+0000 7fa0d9000700 1 --2- 172.21.15.110:0/1238192532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0d4151b80 0x7fa0d4150c20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fa0c400e900 tx=0x7fa0c4009060).stop 2024-01-22T05:04:17.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.464+0000 7fa0d9000700 1 -- 172.21.15.110:0/1238192532 shutdown_connections 2024-01-22T05:04:17.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.464+0000 7fa0d9000700 1 --2- 172.21.15.110:0/1238192532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0d40c1480 0x7fa0d414dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.464+0000 7fa0d9000700 1 --2- 172.21.15.110:0/1238192532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0d41562a0 0x7fa0d40c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.464+0000 7fa0d9000700 1 --2- 172.21.15.110:0/1238192532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0d4151b80 0x7fa0d4150c20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.464+0000 7fa0d9000700 1 -- 172.21.15.110:0/1238192532 >> 172.21.15.110:0/1238192532 conn(0x7fa0d40c6540 msgr2=0x7fa0d40ab890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:17.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.464+0000 7fa0d9000700 1 -- 172.21.15.110:0/1238192532 shutdown_connections 2024-01-22T05:04:17.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.464+0000 7fa0d9000700 1 -- 172.21.15.110:0/1238192532 wait complete. 2024-01-22T05:04:17.488 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new ab58d13a-6c68-4ba8-a07d-96744498741d 2 2024-01-22T05:04:17.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.624+0000 7fe727e00700 1 Processor -- start 2024-01-22T05:04:17.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.628+0000 7fe727e00700 1 -- start start 2024-01-22T05:04:17.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.628+0000 7fe727e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe7280a8740 0x7fe7280a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.628+0000 7fe727e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe728066080 0x7fe728066510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.628+0000 7fe727e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe728065bd0 con 0x7fe7281581e0 2024-01-22T05:04:17.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.628+0000 7fe727e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7280a9070 con 0x7fe728066080 2024-01-22T05:04:17.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.628+0000 7fe727e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7280c15f0 con 0x7fe7280a8740 2024-01-22T05:04:17.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.628+0000 7fe726a00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe7281581e0 0x7fe7280c0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:35962/0 (socket says 172.21.15.110:35962) 2024-01-22T05:04:17.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.628+0000 7fe726a00700 1 -- 172.21.15.110:0/226602506 learned_addr learned my addr 172.21.15.110:0/226602506 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-01-22T05:04:17.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.628+0000 7fe726000700 1 --2- 172.21.15.110:0/226602506 >> v2:172.21.15.110:3300/0 conn(0x7fe7280a8740 0x7fe7280a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.628+0000 7fe727400700 1 --2- 172.21.15.110:0/226602506 >> v2:172.21.15.49:3300/0 conn(0x7fe728066080 0x7fe728066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.628+0000 7fe726000700 1 -- 172.21.15.110:0/226602506 >> v2:172.21.15.49:3300/0 conn(0x7fe728066080 msgr2=0x7fe728066510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:17.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.628+0000 7fe726000700 1 --2- 172.21.15.110:0/226602506 >> v2:172.21.15.49:3300/0 conn(0x7fe728066080 0x7fe728066510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.628+0000 7fe726000700 1 -- 172.21.15.110:0/226602506 >> v1:172.21.15.110:6789/0 conn(0x7fe7281581e0 legacy=0x7fe7280c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.628+0000 7fe726000700 1 -- 172.21.15.110:0/226602506 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7280c18c0 con 0x7fe7280a8740 2024-01-22T05:04:17.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.628+0000 7fe725600700 1 -- 172.21.15.110:0/226602506 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124788152 0 0) 0x7fe728065bd0 con 0x7fe7281581e0 2024-01-22T05:04:17.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.632+0000 7fe726000700 1 --2- 172.21.15.110:0/226602506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7280a8740 0x7fe7280a8b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fe728065060 tx=0x7fe710009060).ready entity=mon.1 client_cookie=dbd4297a1c911ee4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:17.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.632+0000 7fe725600700 1 -- 172.21.15.110:0/226602506 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7100090d0 con 0x7fe7280a8740 2024-01-22T05:04:17.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.632+0000 7fe725600700 1 -- 172.21.15.110:0/226602506 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71000f510 con 0x7fe7280a8740 2024-01-22T05:04:17.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.632+0000 7fe725600700 1 -- 172.21.15.110:0/226602506 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71000f890 con 0x7fe7280a8740 2024-01-22T05:04:17.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.632+0000 7fe727e00700 1 -- 172.21.15.110:0/226602506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7280a8740 msgr2=0x7fe7280a8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.632+0000 7fe727e00700 1 --2- 172.21.15.110:0/226602506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7280a8740 0x7fe7280a8b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fe728065060 tx=0x7fe710009060).stop 2024-01-22T05:04:17.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.632+0000 7fe727e00700 1 -- 172.21.15.110:0/226602506 shutdown_connections 2024-01-22T05:04:17.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.632+0000 7fe727e00700 1 --2- 172.21.15.110:0/226602506 >> v2:172.21.15.49:3300/0 conn(0x7fe728066080 0x7fe728066510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.632+0000 7fe727e00700 1 --2- 172.21.15.110:0/226602506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7280a8740 0x7fe7280a8b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.632+0000 7fe727e00700 1 -- 172.21.15.110:0/226602506 >> 172.21.15.110:0/226602506 conn(0x7fe7280c6540 msgr2=0x7fe7280c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:17.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.632+0000 7fe727e00700 1 -- 172.21.15.110:0/226602506 shutdown_connections 2024-01-22T05:04:17.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.632+0000 7fe727e00700 1 -- 172.21.15.110:0/226602506 wait complete. 2024-01-22T05:04:17.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.636+0000 7fe727e00700 1 Processor -- start 2024-01-22T05:04:17.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.636+0000 7fe727e00700 1 -- start start 2024-01-22T05:04:17.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe727e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe728066080 0x7fe7281585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe727e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7280a8740 0x7fe728156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe727e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7281581e0 0x7fe7281522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe727e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe728158ab0 con 0x7fe7280a8740 2024-01-22T05:04:17.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe727e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7281533e0 con 0x7fe728066080 2024-01-22T05:04:17.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe727e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe728157080 con 0x7fe7281581e0 2024-01-22T05:04:17.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe726a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe728066080 0x7fe7281585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe726a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe728066080 0x7fe7281585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52734/0 (socket says 172.21.15.110:52734) 2024-01-22T05:04:17.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe726a00700 1 -- 172.21.15.110:0/3867030989 learned_addr learned my addr 172.21.15.110:0/3867030989 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:04:17.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe727400700 1 --2- 172.21.15.110:0/3867030989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7281581e0 0x7fe7281522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe726000700 1 --2- 172.21.15.110:0/3867030989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7280a8740 0x7fe728156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe726a00700 1 -- 172.21.15.110:0/3867030989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7281581e0 msgr2=0x7fe7281522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe726a00700 1 --2- 172.21.15.110:0/3867030989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7281581e0 0x7fe7281522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe726a00700 1 -- 172.21.15.110:0/3867030989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7280a8740 msgr2=0x7fe728156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe726a00700 1 --2- 172.21.15.110:0/3867030989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7280a8740 0x7fe728156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe726a00700 1 -- 172.21.15.110:0/3867030989 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7100092a0 con 0x7fe728066080 2024-01-22T05:04:17.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe727400700 1 --2- 172.21.15.110:0/3867030989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7281581e0 0x7fe7281522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:17.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe726a00700 1 --2- 172.21.15.110:0/3867030989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe728066080 0x7fe7281585c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fe718001eb0 tx=0x7fe718007e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:17.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe71e000700 1 -- 172.21.15.110:0/3867030989 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180070d0 con 0x7fe728066080 2024-01-22T05:04:17.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe71e000700 1 -- 172.21.15.110:0/3867030989 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe718007230 con 0x7fe728066080 2024-01-22T05:04:17.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe727e00700 1 -- 172.21.15.110:0/3867030989 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe728155af0 con 0x7fe728066080 2024-01-22T05:04:17.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe71e000700 1 -- 172.21.15.110:0/3867030989 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180075d0 con 0x7fe728066080 2024-01-22T05:04:17.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe727e00700 1 -- 172.21.15.110:0/3867030989 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7281560b0 con 0x7fe728066080 2024-01-22T05:04:17.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe71e000700 1 -- 172.21.15.110:0/3867030989 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fe718005c10 con 0x7fe728066080 2024-01-22T05:04:17.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.640+0000 7fe71e000700 1 -- 172.21.15.110:0/3867030989 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7fe718013450 con 0x7fe728066080 2024-01-22T05:04:17.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.644+0000 7fe727e00700 1 -- 172.21.15.110:0/3867030989 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe728047060 con 0x7fe728066080 2024-01-22T05:04:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.648+0000 7fe71e000700 1 -- 172.21.15.110:0/3867030989 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fe718018070 con 0x7fe728066080 2024-01-22T05:04:17.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.724+0000 7fe727e00700 1 -- 172.21.15.110:0/3867030989 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ab58d13a-6c68-4ba8-a07d-96744498741d", "id": 2} v 0) v1 -- 0x7fe728046800 con 0x7fe728066080 2024-01-22T05:04:17.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.736+0000 7fe71e000700 1 -- 172.21.15.110:0/3867030989 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ab58d13a-6c68-4ba8-a07d-96744498741d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe718013cc0 con 0x7fe728066080 2024-01-22T05:04:17.741 INFO:teuthology.orchestra.run.smithi110.stdout:2 2024-01-22T05:04:17.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.736+0000 7fe727e00700 1 -- 172.21.15.110:0/3867030989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe728066080 msgr2=0x7fe7281585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.736+0000 7fe727e00700 1 --2- 172.21.15.110:0/3867030989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe728066080 0x7fe7281585c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fe718001eb0 tx=0x7fe718007e90).stop 2024-01-22T05:04:17.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.736+0000 7fe727e00700 1 -- 172.21.15.110:0/3867030989 shutdown_connections 2024-01-22T05:04:17.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.736+0000 7fe727e00700 1 --2- 172.21.15.110:0/3867030989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7281581e0 0x7fe7281522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.736+0000 7fe727e00700 1 --2- 172.21.15.110:0/3867030989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7280a8740 0x7fe728156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.736+0000 7fe727e00700 1 --2- 172.21.15.110:0/3867030989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe728066080 0x7fe7281585c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.736+0000 7fe727e00700 1 -- 172.21.15.110:0/3867030989 >> 172.21.15.110:0/3867030989 conn(0x7fe7280c6540 msgr2=0x7fe728066510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:17.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.736+0000 7fe727e00700 1 -- 172.21.15.110:0/3867030989 shutdown_connections 2024-01-22T05:04:17.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.736+0000 7fe727e00700 1 -- 172.21.15.110:0/3867030989 wait complete. 2024-01-22T05:04:17.765 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 420cb179-1cf6-4897-91da-ad00b55f1adb 3 2024-01-22T05:04:17.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.904+0000 7fa8aac00700 1 Processor -- start 2024-01-22T05:04:17.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.908+0000 7fa8aac00700 1 -- start start 2024-01-22T05:04:17.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.908+0000 7fa8aac00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8a4069060 0x7fa8a4062a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.908+0000 7fa8aac00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8a4153c30 0x7fa8a40bbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.908+0000 7fa8aac00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a4069440 con 0x7fa8a4062f50 2024-01-22T05:04:17.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.908+0000 7fa8aac00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a40642a0 con 0x7fa8a4153c30 2024-01-22T05:04:17.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.908+0000 7fa8aac00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a4064730 con 0x7fa8a4069060 2024-01-22T05:04:17.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.908+0000 7fa8a3e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8a4069060 0x7fa8a4062a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.908+0000 7fa8a8c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8a4153c30 0x7fa8a40bbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.908+0000 7fa8a3e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8a4069060 0x7fa8a4062a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43024/0 (socket says 172.21.15.110:43024) 2024-01-22T05:04:17.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.908+0000 7fa8a3e00700 1 -- 172.21.15.110:0/1239764070 learned_addr learned my addr 172.21.15.110:0/1239764070 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:04:17.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.908+0000 7fa8a3e00700 1 -- 172.21.15.110:0/1239764070 >> v2:172.21.15.110:3300/0 conn(0x7fa8a4153c30 msgr2=0x7fa8a40bbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:17.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.908+0000 7fa8a3e00700 1 --2- 172.21.15.110:0/1239764070 >> v2:172.21.15.110:3300/0 conn(0x7fa8a4153c30 0x7fa8a40bbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.908+0000 7fa8a3e00700 1 -- 172.21.15.110:0/1239764070 >> v1:172.21.15.49:6789/0 conn(0x7fa8a4062f50 legacy=0x7fa8a4153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:17.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.908+0000 7fa8a3e00700 1 -- 172.21.15.110:0/1239764070 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a4066f10 con 0x7fa8a4069060 2024-01-22T05:04:17.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.912+0000 7fa8a3e00700 1 --2- 172.21.15.110:0/1239764070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8a4069060 0x7fa8a4062a60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fa894006fd0 tx=0x7fa8940090f0).ready entity=mon.2 client_cookie=2bb77ba2074e52f8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:17.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.912+0000 7fa8a2a00700 1 -- 172.21.15.110:0/1239764070 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89400b520 con 0x7fa8a4069060 2024-01-22T05:04:17.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.912+0000 7fa8a2a00700 1 -- 172.21.15.110:0/1239764070 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89400b680 con 0x7fa8a4069060 2024-01-22T05:04:17.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.912+0000 7fa8a2a00700 1 -- 172.21.15.110:0/1239764070 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89400ba00 con 0x7fa8a4069060 2024-01-22T05:04:17.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.912+0000 7fa8aac00700 1 -- 172.21.15.110:0/1239764070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8a4069060 msgr2=0x7fa8a4062a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.912+0000 7fa8aac00700 1 --2- 172.21.15.110:0/1239764070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8a4069060 0x7fa8a4062a60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fa894006fd0 tx=0x7fa8940090f0).stop 2024-01-22T05:04:17.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.912+0000 7fa8aac00700 1 -- 172.21.15.110:0/1239764070 shutdown_connections 2024-01-22T05:04:17.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.912+0000 7fa8aac00700 1 --2- 172.21.15.110:0/1239764070 >> v2:172.21.15.110:3300/0 conn(0x7fa8a4153c30 0x7fa8a40bbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.912+0000 7fa8aac00700 1 --2- 172.21.15.110:0/1239764070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8a4069060 0x7fa8a4062a60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.912+0000 7fa8aac00700 1 -- 172.21.15.110:0/1239764070 >> 172.21.15.110:0/1239764070 conn(0x7fa8a40c4310 msgr2=0x7fa8a4065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:17.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.912+0000 7fa8aac00700 1 -- 172.21.15.110:0/1239764070 shutdown_connections 2024-01-22T05:04:17.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.912+0000 7fa8aac00700 1 -- 172.21.15.110:0/1239764070 wait complete. 2024-01-22T05:04:17.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.916+0000 7fa8aac00700 1 Processor -- start 2024-01-22T05:04:17.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.916+0000 7fa8aac00700 1 -- start start 2024-01-22T05:04:17.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8aac00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8a4062f50 0x7fa8a40ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8aac00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8a4069060 0x7fa8a40bf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8aac00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8a4153c30 0x7fa8a4151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:17.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8aac00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a40ac3f0 con 0x7fa8a4153c30 2024-01-22T05:04:17.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8aac00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a40ab7e0 con 0x7fa8a4069060 2024-01-22T05:04:17.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8aac00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a40abac0 con 0x7fa8a4062f50 2024-01-22T05:04:17.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8a3400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8a4069060 0x7fa8a40bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8a3e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8a4062f50 0x7fa8a40ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8a3e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8a4062f50 0x7fa8a40ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43028/0 (socket says 172.21.15.110:43028) 2024-01-22T05:04:17.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8a3e00700 1 -- 172.21.15.110:0/2152041708 learned_addr learned my addr 172.21.15.110:0/2152041708 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:04:17.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8a8c00700 1 --2- 172.21.15.110:0/2152041708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8a4153c30 0x7fa8a4151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:17.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8a3e00700 1 -- 172.21.15.110:0/2152041708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8a4069060 msgr2=0x7fa8a40bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8a3e00700 1 --2- 172.21.15.110:0/2152041708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8a4069060 0x7fa8a40bf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8a3e00700 1 -- 172.21.15.110:0/2152041708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8a4153c30 msgr2=0x7fa8a4151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:17.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8a3e00700 1 --2- 172.21.15.110:0/2152041708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8a4153c30 0x7fa8a4151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:17.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8a3e00700 1 -- 172.21.15.110:0/2152041708 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894009370 con 0x7fa8a4062f50 2024-01-22T05:04:17.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8a3e00700 1 --2- 172.21.15.110:0/2152041708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8a4062f50 0x7fa8a40ac880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fa8a4064870 tx=0x7fa894015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:17.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa89b400700 1 -- 172.21.15.110:0/2152041708 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89400be90 con 0x7fa8a4062f50 2024-01-22T05:04:17.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa89b400700 1 -- 172.21.15.110:0/2152041708 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89400b7f0 con 0x7fa8a4062f50 2024-01-22T05:04:17.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8aac00700 1 -- 172.21.15.110:0/2152041708 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a40abda0 con 0x7fa8a4062f50 2024-01-22T05:04:17.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa89b400700 1 -- 172.21.15.110:0/2152041708 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89401c630 con 0x7fa8a4062f50 2024-01-22T05:04:17.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa8aac00700 1 -- 172.21.15.110:0/2152041708 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a40acd70 con 0x7fa8a4062f50 2024-01-22T05:04:17.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.920+0000 7fa89b400700 1 -- 172.21.15.110:0/2152041708 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fa89401cc40 con 0x7fa8a4062f50 2024-01-22T05:04:17.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.924+0000 7fa89b400700 1 -- 172.21.15.110:0/2152041708 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7fa89400b960 con 0x7fa8a4062f50 2024-01-22T05:04:17.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.924+0000 7fa8aac00700 1 -- 172.21.15.110:0/2152041708 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a4064e40 con 0x7fa8a4062f50 2024-01-22T05:04:17.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:17.928+0000 7fa89b400700 1 -- 172.21.15.110:0/2152041708 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fa89402a060 con 0x7fa8a4062f50 2024-01-22T05:04:18.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.008+0000 7fa8aac00700 1 -- 172.21.15.110:0/2152041708 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "420cb179-1cf6-4897-91da-ad00b55f1adb", "id": 3} v 0) v1 -- 0x7fa8a4063690 con 0x7fa8a4062f50 2024-01-22T05:04:18.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.016+0000 7fa89b400700 1 -- 172.21.15.110:0/2152041708 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "420cb179-1cf6-4897-91da-ad00b55f1adb", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa894020070 con 0x7fa8a4062f50 2024-01-22T05:04:18.024 INFO:teuthology.orchestra.run.smithi110.stdout:3 2024-01-22T05:04:18.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.020+0000 7fa8aac00700 1 -- 172.21.15.110:0/2152041708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8a4062f50 msgr2=0x7fa8a40ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.020+0000 7fa8aac00700 1 --2- 172.21.15.110:0/2152041708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8a4062f50 0x7fa8a40ac880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fa8a4064870 tx=0x7fa894015000).stop 2024-01-22T05:04:18.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.020+0000 7fa8aac00700 1 -- 172.21.15.110:0/2152041708 shutdown_connections 2024-01-22T05:04:18.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.020+0000 7fa8aac00700 1 --2- 172.21.15.110:0/2152041708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8a4153c30 0x7fa8a4151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.020+0000 7fa8aac00700 1 --2- 172.21.15.110:0/2152041708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8a4069060 0x7fa8a40bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.020+0000 7fa8aac00700 1 --2- 172.21.15.110:0/2152041708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8a4062f50 0x7fa8a40ac880 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.020+0000 7fa8aac00700 1 -- 172.21.15.110:0/2152041708 >> 172.21.15.110:0/2152041708 conn(0x7fa8a40c4310 msgr2=0x7fa8a40bbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:18.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.020+0000 7fa8aac00700 1 -- 172.21.15.110:0/2152041708 shutdown_connections 2024-01-22T05:04:18.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.020+0000 7fa8aac00700 1 -- 172.21.15.110:0/2152041708 wait complete. 2024-01-22T05:04:18.044 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d 4 2024-01-22T05:04:18.052 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:18.046+0000 7f56274e0500 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-22T05:04:18.159 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:18.152+0000 7ff49e962500 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-22T05:04:18.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.172+0000 7f372ee00700 1 Processor -- start 2024-01-22T05:04:18.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.172+0000 7f372ee00700 1 -- start start 2024-01-22T05:04:18.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.176+0000 7f372ee00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f37280a4440 0x7f37280a6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:18.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.176+0000 7f372ee00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37280c4770 0x7f37280c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:18.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.176+0000 7f372ee00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37280c6490 con 0x7f37280a4820 2024-01-22T05:04:18.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.176+0000 7f372ee00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3728151ed0 con 0x7f37280a4440 2024-01-22T05:04:18.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.176+0000 7f372ee00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37280c5880 con 0x7f37280c4770 2024-01-22T05:04:18.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.176+0000 7f372da00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f37280a4440 0x7f37280a6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:18.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.176+0000 7f372da00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f37280a4440 0x7f37280a6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52756/0 (socket says 172.21.15.110:52756) 2024-01-22T05:04:18.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.176+0000 7f372da00700 1 -- 172.21.15.110:0/1933833380 learned_addr learned my addr 172.21.15.110:0/1933833380 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:04:18.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.176+0000 7f372e400700 1 --2- 172.21.15.110:0/1933833380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37280c4770 0x7f37280c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:18.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.176+0000 7f372da00700 1 -- 172.21.15.110:0/1933833380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37280c4770 msgr2=0x7f37280c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:18.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.176+0000 7f372da00700 1 --2- 172.21.15.110:0/1933833380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37280c4770 0x7f37280c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.176+0000 7f372da00700 1 -- 172.21.15.110:0/1933833380 >> v1:172.21.15.49:6789/0 conn(0x7f37280a4820 legacy=0x7f37280c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.176+0000 7f372da00700 1 -- 172.21.15.110:0/1933833380 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37280c5b60 con 0x7f37280a4440 2024-01-22T05:04:18.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.180+0000 7f372da00700 1 --2- 172.21.15.110:0/1933833380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37280a4440 0x7f37280a6700 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f3718006fd0 tx=0x7f37180090f0).ready entity=mon.1 client_cookie=b755bf585fb66254 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:18.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.180+0000 7f3727e00700 1 -- 172.21.15.110:0/1933833380 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371800b600 con 0x7f37280a4440 2024-01-22T05:04:18.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.180+0000 7f3727e00700 1 -- 172.21.15.110:0/1933833380 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371800b760 con 0x7f37280a4440 2024-01-22T05:04:18.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.180+0000 7f3727e00700 1 -- 172.21.15.110:0/1933833380 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371800bae0 con 0x7f37280a4440 2024-01-22T05:04:18.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.180+0000 7f372ee00700 1 -- 172.21.15.110:0/1933833380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37280a4440 msgr2=0x7f37280a6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.180+0000 7f372ee00700 1 --2- 172.21.15.110:0/1933833380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37280a4440 0x7f37280a6700 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f3718006fd0 tx=0x7f37180090f0).stop 2024-01-22T05:04:18.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.180+0000 7f372ee00700 1 -- 172.21.15.110:0/1933833380 shutdown_connections 2024-01-22T05:04:18.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.180+0000 7f372ee00700 1 --2- 172.21.15.110:0/1933833380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37280c4770 0x7f37280c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.180+0000 7f372ee00700 1 --2- 172.21.15.110:0/1933833380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37280a4440 0x7f37280a6700 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.180+0000 7f372ee00700 1 -- 172.21.15.110:0/1933833380 >> 172.21.15.110:0/1933833380 conn(0x7f37280aa6b0 msgr2=0x7f37280aaac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:18.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.180+0000 7f372ee00700 1 -- 172.21.15.110:0/1933833380 shutdown_connections 2024-01-22T05:04:18.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.180+0000 7f372ee00700 1 -- 172.21.15.110:0/1933833380 wait complete. 2024-01-22T05:04:18.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372ee00700 1 Processor -- start 2024-01-22T05:04:18.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372ee00700 1 -- start start 2024-01-22T05:04:18.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372ee00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37280a4440 0x7f372814c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:18.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372ee00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37280a4820 0x7f3728091450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:18.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372ee00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37280c4770 0x7f372814b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:18.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372ee00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372814ce90 con 0x7f37280c4770 2024-01-22T05:04:18.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372ee00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372814d050 con 0x7f37280a4820 2024-01-22T05:04:18.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372ee00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372814d610 con 0x7f37280a4440 2024-01-22T05:04:18.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372da00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37280a4440 0x7f372814c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:18.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372d000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37280a4820 0x7f3728091450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:18.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372da00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37280a4440 0x7f372814c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43052/0 (socket says 172.21.15.110:43052) 2024-01-22T05:04:18.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372da00700 1 -- 172.21.15.110:0/1883714403 learned_addr learned my addr 172.21.15.110:0/1883714403 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:04:18.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372e400700 1 --2- 172.21.15.110:0/1883714403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37280c4770 0x7f372814b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:18.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372da00700 1 -- 172.21.15.110:0/1883714403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37280a4820 msgr2=0x7f3728091450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372da00700 1 --2- 172.21.15.110:0/1883714403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37280a4820 0x7f3728091450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372da00700 1 -- 172.21.15.110:0/1883714403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37280c4770 msgr2=0x7f372814b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372da00700 1 --2- 172.21.15.110:0/1883714403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37280c4770 0x7f372814b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372da00700 1 -- 172.21.15.110:0/1883714403 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3718009370 con 0x7f37280a4440 2024-01-22T05:04:18.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372e400700 1 --2- 172.21.15.110:0/1883714403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37280c4770 0x7f372814b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:18.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.184+0000 7f372da00700 1 --2- 172.21.15.110:0/1883714403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37280a4440 0x7f372814c9a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f3718009f50 tx=0x7f3718017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:18.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.188+0000 7f3724c00700 1 -- 172.21.15.110:0/1883714403 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3718006a40 con 0x7f37280a4440 2024-01-22T05:04:18.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.188+0000 7f3724c00700 1 -- 172.21.15.110:0/1883714403 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371800b8d0 con 0x7f37280a4440 2024-01-22T05:04:18.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.188+0000 7f372ee00700 1 -- 172.21.15.110:0/1883714403 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3728091940 con 0x7f37280a4440 2024-01-22T05:04:18.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.188+0000 7f3724c00700 1 -- 172.21.15.110:0/1883714403 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371801b660 con 0x7f37280a4440 2024-01-22T05:04:18.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.188+0000 7f372ee00700 1 -- 172.21.15.110:0/1883714403 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3728091c70 con 0x7f37280a4440 2024-01-22T05:04:18.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.188+0000 7f3724c00700 1 -- 172.21.15.110:0/1883714403 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f371801bc70 con 0x7f37280a4440 2024-01-22T05:04:18.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.188+0000 7f3724c00700 1 -- 172.21.15.110:0/1883714403 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f37180198f0 con 0x7f37280a4440 2024-01-22T05:04:18.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.188+0000 7f372ee00700 1 -- 172.21.15.110:0/1883714403 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372814d360 con 0x7f37280a4440 2024-01-22T05:04:18.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.192+0000 7f3724c00700 1 -- 172.21.15.110:0/1883714403 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f371801f020 con 0x7f37280a4440 2024-01-22T05:04:18.260 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:18.254+0000 7f56274e0500 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-22T05:04:18.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.332+0000 7f372ee00700 1 -- 172.21.15.110:0/1883714403 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d", "id": 4} v 0) v1 -- 0x7f3728046800 con 0x7f37280a4440 2024-01-22T05:04:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.340+0000 7f3724c00700 1 -- 172.21.15.110:0/1883714403 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3718019b30 con 0x7f37280a4440 2024-01-22T05:04:18.348 INFO:teuthology.orchestra.run.smithi110.stdout:4 2024-01-22T05:04:18.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.344+0000 7f372ee00700 1 -- 172.21.15.110:0/1883714403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37280a4440 msgr2=0x7f372814c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.344+0000 7f372ee00700 1 --2- 172.21.15.110:0/1883714403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37280a4440 0x7f372814c9a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f3718009f50 tx=0x7f3718017000).stop 2024-01-22T05:04:18.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.344+0000 7f372ee00700 1 -- 172.21.15.110:0/1883714403 shutdown_connections 2024-01-22T05:04:18.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.344+0000 7f372ee00700 1 --2- 172.21.15.110:0/1883714403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37280c4770 0x7f372814b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.344+0000 7f372ee00700 1 --2- 172.21.15.110:0/1883714403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37280a4820 0x7f3728091450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.344+0000 7f372ee00700 1 --2- 172.21.15.110:0/1883714403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37280a4440 0x7f372814c9a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.344+0000 7f372ee00700 1 -- 172.21.15.110:0/1883714403 >> 172.21.15.110:0/1883714403 conn(0x7f37280aa6b0 msgr2=0x7f3728068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:18.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.344+0000 7f372ee00700 1 -- 172.21.15.110:0/1883714403 shutdown_connections 2024-01-22T05:04:18.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.344+0000 7f372ee00700 1 -- 172.21.15.110:0/1883714403 wait complete. 2024-01-22T05:04:18.377 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 4c829917-a356-46b7-b3f7-1d0381633228 5 2024-01-22T05:04:18.434 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:18.428+0000 7ff49e962500 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-22T05:04:18.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.524+0000 7f4b1cc00700 1 Processor -- start 2024-01-22T05:04:18.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.524+0000 7f4b1cc00700 1 -- start start 2024-01-22T05:04:18.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.524+0000 7f4b1cc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b180c4a40 0x7f4b18062aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:18.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b1cc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4b18062f90 0x7f4b180bd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:18.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b1cc00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b180c41d0 con 0x7f4b180c4660 2024-01-22T05:04:18.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b1cc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b180633f0 con 0x7f4b18062f90 2024-01-22T05:04:18.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b1cc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180c35c0 con 0x7f4b180c4a40 2024-01-22T05:04:18.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b17e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4b18062f90 0x7f4b180bd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:18.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b17e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4b18062f90 0x7f4b180bd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52776/0 (socket says 172.21.15.110:52776) 2024-01-22T05:04:18.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b17e00700 1 -- 172.21.15.110:0/941588842 learned_addr learned my addr 172.21.15.110:0/941588842 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:04:18.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b16a00700 1 --2- 172.21.15.110:0/941588842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b180c4a40 0x7f4b18062aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:18.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b17e00700 1 -- 172.21.15.110:0/941588842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b180c4a40 msgr2=0x7f4b18062aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:18.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b17e00700 1 --2- 172.21.15.110:0/941588842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b180c4a40 0x7f4b18062aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b17e00700 1 -- 172.21.15.110:0/941588842 >> v1:172.21.15.110:6789/0 conn(0x7f4b180c4660 legacy=0x7f4b18068c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b16000700 1 -- 172.21.15.110:0/941588842 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911303801 0 0) 0x7f4b180c41d0 con 0x7f4b180c4660 2024-01-22T05:04:18.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b17e00700 1 -- 172.21.15.110:0/941588842 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180c38a0 con 0x7f4b18062f90 2024-01-22T05:04:18.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b17e00700 1 --2- 172.21.15.110:0/941588842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b18062f90 0x7f4b180bd8a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f4b10009f20 tx=0x7f4b10009840).ready entity=mon.1 client_cookie=ad3636cc4fb93b7a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:18.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b16000700 1 -- 172.21.15.110:0/941588842 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000e070 con 0x7f4b18062f90 2024-01-22T05:04:18.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b16000700 1 -- 172.21.15.110:0/941588842 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1000b9d0 con 0x7f4b18062f90 2024-01-22T05:04:18.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b16000700 1 -- 172.21.15.110:0/941588842 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000bd50 con 0x7f4b18062f90 2024-01-22T05:04:18.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b1cc00700 1 -- 172.21.15.110:0/941588842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b18062f90 msgr2=0x7f4b180bd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b1cc00700 1 --2- 172.21.15.110:0/941588842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b18062f90 0x7f4b180bd8a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f4b10009f20 tx=0x7f4b10009840).stop 2024-01-22T05:04:18.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b1cc00700 1 -- 172.21.15.110:0/941588842 shutdown_connections 2024-01-22T05:04:18.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b1cc00700 1 --2- 172.21.15.110:0/941588842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b18062f90 0x7f4b180bd8a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b1cc00700 1 --2- 172.21.15.110:0/941588842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b180c4a40 0x7f4b18062aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b1cc00700 1 -- 172.21.15.110:0/941588842 >> 172.21.15.110:0/941588842 conn(0x7f4b180c51c0 msgr2=0x7f4b180c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:18.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b1cc00700 1 -- 172.21.15.110:0/941588842 shutdown_connections 2024-01-22T05:04:18.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.528+0000 7f4b1cc00700 1 -- 172.21.15.110:0/941588842 wait complete. 2024-01-22T05:04:18.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.532+0000 7f4b1cc00700 1 Processor -- start 2024-01-22T05:04:18.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.532+0000 7f4b1cc00700 1 -- start start 2024-01-22T05:04:18.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.532+0000 7f4b1cc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b18062f90 0x7f4b180aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:18.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.532+0000 7f4b1cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b180c4660 0x7f4b18143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:18.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b1cc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b180c4a40 0x7f4b1816c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:18.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b1cc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180aa740 con 0x7f4b180c4660 2024-01-22T05:04:18.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b1cc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180a9b30 con 0x7f4b180c4a40 2024-01-22T05:04:18.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b1cc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180a9e10 con 0x7f4b18062f90 2024-01-22T05:04:18.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b17e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b180c4a40 0x7f4b1816c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:18.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b17e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b180c4a40 0x7f4b1816c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52792/0 (socket says 172.21.15.110:52792) 2024-01-22T05:04:18.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b17e00700 1 -- 172.21.15.110:0/2196875116 learned_addr learned my addr 172.21.15.110:0/2196875116 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:04:18.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b17400700 1 --2- 172.21.15.110:0/2196875116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b18062f90 0x7f4b180aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:18.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b16a00700 1 --2- 172.21.15.110:0/2196875116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b180c4660 0x7f4b18143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:18.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b17e00700 1 -- 172.21.15.110:0/2196875116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b18062f90 msgr2=0x7f4b180aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b17e00700 1 --2- 172.21.15.110:0/2196875116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b18062f90 0x7f4b180aabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b17e00700 1 -- 172.21.15.110:0/2196875116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b180c4660 msgr2=0x7f4b18143860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b17e00700 1 --2- 172.21.15.110:0/2196875116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b180c4660 0x7f4b18143860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b17e00700 1 -- 172.21.15.110:0/2196875116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10009ae0 con 0x7f4b180c4a40 2024-01-22T05:04:18.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b17400700 1 --2- 172.21.15.110:0/2196875116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b18062f90 0x7f4b180aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:18.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b17e00700 1 --2- 172.21.15.110:0/2196875116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b180c4a40 0x7f4b1816c200 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4b1000b610 tx=0x7f4b10009840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:18.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b0ea00700 1 -- 172.21.15.110:0/2196875116 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000bd50 con 0x7f4b180c4a40 2024-01-22T05:04:18.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b0ea00700 1 -- 172.21.15.110:0/2196875116 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b100092e0 con 0x7f4b180c4a40 2024-01-22T05:04:18.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b0ea00700 1 -- 172.21.15.110:0/2196875116 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1001d690 con 0x7f4b180c4a40 2024-01-22T05:04:18.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b1cc00700 1 -- 172.21.15.110:0/2196875116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b180aa0f0 con 0x7f4b180c4a40 2024-01-22T05:04:18.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b1cc00700 1 -- 172.21.15.110:0/2196875116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1816bc60 con 0x7f4b180c4a40 2024-01-22T05:04:18.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b0ea00700 1 -- 172.21.15.110:0/2196875116 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f4b10003040 con 0x7f4b180c4a40 2024-01-22T05:04:18.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b0ea00700 1 -- 172.21.15.110:0/2196875116 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f4b1001dd20 con 0x7f4b180c4a40 2024-01-22T05:04:18.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.536+0000 7f4b1cc00700 1 -- 172.21.15.110:0/2196875116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b180aa8b0 con 0x7f4b180c4a40 2024-01-22T05:04:18.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.540+0000 7f4b0ea00700 1 -- 172.21.15.110:0/2196875116 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f4b1002c060 con 0x7f4b180c4a40 2024-01-22T05:04:18.584 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:18.574+0000 7f56274e0500 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-22T05:04:18.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.620+0000 7f4b1cc00700 1 -- 172.21.15.110:0/2196875116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4c829917-a356-46b7-b3f7-1d0381633228", "id": 5} v 0) v1 -- 0x7f4b18047060 con 0x7f4b180c4a40 2024-01-22T05:04:18.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.628+0000 7f4b0ea00700 1 -- 172.21.15.110:0/2196875116 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4c829917-a356-46b7-b3f7-1d0381633228", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4b10022070 con 0x7f4b180c4a40 2024-01-22T05:04:18.635 INFO:teuthology.orchestra.run.smithi110.stdout:5 2024-01-22T05:04:18.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.632+0000 7f4b1cc00700 1 -- 172.21.15.110:0/2196875116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b180c4a40 msgr2=0x7f4b1816c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.632+0000 7f4b1cc00700 1 --2- 172.21.15.110:0/2196875116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b180c4a40 0x7f4b1816c200 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4b1000b610 tx=0x7f4b10009840).stop 2024-01-22T05:04:18.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.632+0000 7f4b1cc00700 1 -- 172.21.15.110:0/2196875116 shutdown_connections 2024-01-22T05:04:18.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.632+0000 7f4b1cc00700 1 --2- 172.21.15.110:0/2196875116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b180c4a40 0x7f4b1816c200 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.632+0000 7f4b1cc00700 1 --2- 172.21.15.110:0/2196875116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b180c4660 0x7f4b18143860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.632+0000 7f4b1cc00700 1 --2- 172.21.15.110:0/2196875116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b18062f90 0x7f4b180aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.632+0000 7f4b1cc00700 1 -- 172.21.15.110:0/2196875116 >> 172.21.15.110:0/2196875116 conn(0x7f4b180c51c0 msgr2=0x7f4b18067ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:18.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.632+0000 7f4b1cc00700 1 -- 172.21.15.110:0/2196875116 shutdown_connections 2024-01-22T05:04:18.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.632+0000 7f4b1cc00700 1 -- 172.21.15.110:0/2196875116 wait complete. 2024-01-22T05:04:18.657 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 4775e21c-633a-4873-86e5-f7b8dbfc89cc 6 2024-01-22T05:04:18.763 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:18.756+0000 7ff49e962500 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-22T05:04:18.777 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:18.770+0000 7f56274e0500 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-22T05:04:18.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.800+0000 7fe82a200700 1 Processor -- start 2024-01-22T05:04:18.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.800+0000 7fe82a200700 1 -- start start 2024-01-22T05:04:18.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.804+0000 7fe82a200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8240c1cf0 0x7fe8240c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:18.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.804+0000 7fe82a200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8240698e0 con 0x7fe824063e30 2024-01-22T05:04:18.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.804+0000 7fe82a200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82415c900 con 0x7fe824064270 2024-01-22T05:04:18.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.804+0000 7fe82a200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8240c26d0 con 0x7fe8240c1cf0 2024-01-22T05:04:18.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.804+0000 7fe823e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe824064270 0x7fe82415c1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:35988/0 (socket says 172.21.15.110:35988) 2024-01-22T05:04:18.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.804+0000 7fe823e00700 1 -- 172.21.15.110:0/741405008 learned_addr learned my addr 172.21.15.110:0/741405008 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-01-22T05:04:18.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.804+0000 7fe823400700 1 --2- 172.21.15.110:0/741405008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8240c1cf0 0x7fe8240c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.804+0000 7fe822000700 1 -- 172.21.15.110:0/741405008 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103914113 0 0) 0x7fe82415c900 con 0x7fe824064270 2024-01-22T05:04:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.804+0000 7fe822000700 1 -- 172.21.15.110:0/741405008 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8040033f0 con 0x7fe824064270 2024-01-22T05:04:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.804+0000 7fe823400700 1 -- 172.21.15.110:0/741405008 >> v1:172.21.15.110:6789/0 conn(0x7fe824064270 legacy=0x7fe82415c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.804+0000 7fe823400700 1 -- 172.21.15.110:0/741405008 >> v1:172.21.15.49:6789/0 conn(0x7fe824063e30 legacy=0x7fe82415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.804+0000 7fe823400700 1 -- 172.21.15.110:0/741405008 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8240c29b0 con 0x7fe8240c1cf0 2024-01-22T05:04:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.808+0000 7fe823400700 1 --2- 172.21.15.110:0/741405008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8240c1cf0 0x7fe8240c20d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fe814009790 tx=0x7fe814009060).ready entity=mon.2 client_cookie=af9cae6e708fb8c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.808+0000 7fe822000700 1 -- 172.21.15.110:0/741405008 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81400b590 con 0x7fe8240c1cf0 2024-01-22T05:04:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.808+0000 7fe822000700 1 -- 172.21.15.110:0/741405008 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81400b6f0 con 0x7fe8240c1cf0 2024-01-22T05:04:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.808+0000 7fe822000700 1 -- 172.21.15.110:0/741405008 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81400ba70 con 0x7fe8240c1cf0 2024-01-22T05:04:18.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.808+0000 7fe82a200700 1 -- 172.21.15.110:0/741405008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8240c1cf0 msgr2=0x7fe8240c20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.808+0000 7fe82a200700 1 --2- 172.21.15.110:0/741405008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8240c1cf0 0x7fe8240c20d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fe814009790 tx=0x7fe814009060).stop 2024-01-22T05:04:18.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.808+0000 7fe82a200700 1 -- 172.21.15.110:0/741405008 shutdown_connections 2024-01-22T05:04:18.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.808+0000 7fe82a200700 1 --2- 172.21.15.110:0/741405008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8240c1cf0 0x7fe8240c20d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.808+0000 7fe82a200700 1 -- 172.21.15.110:0/741405008 >> 172.21.15.110:0/741405008 conn(0x7fe8240c40f0 msgr2=0x7fe8240c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:18.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.808+0000 7fe82a200700 1 -- 172.21.15.110:0/741405008 shutdown_connections 2024-01-22T05:04:18.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.808+0000 7fe82a200700 1 -- 172.21.15.110:0/741405008 wait complete. 2024-01-22T05:04:18.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.812+0000 7fe82a200700 1 Processor -- start 2024-01-22T05:04:18.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.812+0000 7fe82a200700 1 -- start start 2024-01-22T05:04:18.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.812+0000 7fe82a200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe824063e30 0x7fe8240aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:18.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.812+0000 7fe82a200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe824064270 0x7fe8241575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:18.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.812+0000 7fe82a200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8240c1cf0 0x7fe8240a8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:18.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.812+0000 7fe82a200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82415dc50 con 0x7fe824064270 2024-01-22T05:04:18.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.812+0000 7fe82a200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82415ad40 con 0x7fe8240c1cf0 2024-01-22T05:04:18.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.812+0000 7fe82a200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82415d2b0 con 0x7fe824063e30 2024-01-22T05:04:18.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.812+0000 7fe823400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe824063e30 0x7fe8240aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:18.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe823400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe824063e30 0x7fe8240aa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43078/0 (socket says 172.21.15.110:43078) 2024-01-22T05:04:18.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe823400700 1 -- 172.21.15.110:0/362548018 learned_addr learned my addr 172.21.15.110:0/362548018 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:04:18.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe823e00700 1 --2- 172.21.15.110:0/362548018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8240c1cf0 0x7fe8240a8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:18.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe822a00700 1 --2- 172.21.15.110:0/362548018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe824064270 0x7fe8241575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:18.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe823400700 1 -- 172.21.15.110:0/362548018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8240c1cf0 msgr2=0x7fe8240a8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe823400700 1 --2- 172.21.15.110:0/362548018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8240c1cf0 0x7fe8240a8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe823400700 1 -- 172.21.15.110:0/362548018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe824064270 msgr2=0x7fe8241575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe823400700 1 --2- 172.21.15.110:0/362548018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe824064270 0x7fe8241575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe823400700 1 -- 172.21.15.110:0/362548018 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8140092a0 con 0x7fe824063e30 2024-01-22T05:04:18.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe823400700 1 --2- 172.21.15.110:0/362548018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe824063e30 0x7fe8240aa5e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fe814009e30 tx=0x7fe814017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:18.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe81aa00700 1 -- 172.21.15.110:0/362548018 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81400b590 con 0x7fe824063e30 2024-01-22T05:04:18.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe81aa00700 1 -- 172.21.15.110:0/362548018 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81400b860 con 0x7fe824063e30 2024-01-22T05:04:18.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe82a200700 1 -- 172.21.15.110:0/362548018 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82415d590 con 0x7fe824063e30 2024-01-22T05:04:18.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe81aa00700 1 -- 172.21.15.110:0/362548018 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81401b640 con 0x7fe824063e30 2024-01-22T05:04:18.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe81aa00700 1 -- 172.21.15.110:0/362548018 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fe81401bc10 con 0x7fe824063e30 2024-01-22T05:04:18.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe82a200700 1 -- 172.21.15.110:0/362548018 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe824157aa0 con 0x7fe824063e30 2024-01-22T05:04:18.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe81aa00700 1 -- 172.21.15.110:0/362548018 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7fe81401a9c0 con 0x7fe824063e30 2024-01-22T05:04:18.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.816+0000 7fe82a200700 1 -- 172.21.15.110:0/362548018 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82415dec0 con 0x7fe824063e30 2024-01-22T05:04:18.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.820+0000 7fe81aa00700 1 -- 172.21.15.110:0/362548018 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fe81401ac00 con 0x7fe824063e30 2024-01-22T05:04:18.850 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:18.846+0000 7f56274e0500 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-22T05:04:18.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.896+0000 7fe82a200700 1 -- 172.21.15.110:0/362548018 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4775e21c-633a-4873-86e5-f7b8dbfc89cc", "id": 6} v 0) v1 -- 0x7fe824157c90 con 0x7fe824063e30 2024-01-22T05:04:18.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.908+0000 7fe81aa00700 1 -- 172.21.15.110:0/362548018 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4775e21c-633a-4873-86e5-f7b8dbfc89cc", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe824157c90 con 0x7fe824063e30 2024-01-22T05:04:18.913 INFO:teuthology.orchestra.run.smithi110.stdout:6 2024-01-22T05:04:18.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.908+0000 7fe82a200700 1 -- 172.21.15.110:0/362548018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe824063e30 msgr2=0x7fe8240aa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:18.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.908+0000 7fe82a200700 1 --2- 172.21.15.110:0/362548018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe824063e30 0x7fe8240aa5e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fe814009e30 tx=0x7fe814017000).stop 2024-01-22T05:04:18.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.908+0000 7fe82a200700 1 -- 172.21.15.110:0/362548018 shutdown_connections 2024-01-22T05:04:18.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.908+0000 7fe82a200700 1 --2- 172.21.15.110:0/362548018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8240c1cf0 0x7fe8240a8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.908+0000 7fe82a200700 1 --2- 172.21.15.110:0/362548018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe824064270 0x7fe8241575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.908+0000 7fe82a200700 1 --2- 172.21.15.110:0/362548018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe824063e30 0x7fe8240aa5e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:18.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.908+0000 7fe82a200700 1 -- 172.21.15.110:0/362548018 >> 172.21.15.110:0/362548018 conn(0x7fe8240c40f0 msgr2=0x7fe824066750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:18.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.908+0000 7fe82a200700 1 -- 172.21.15.110:0/362548018 shutdown_connections 2024-01-22T05:04:18.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:18.908+0000 7fe82a200700 1 -- 172.21.15.110:0/362548018 wait complete. 2024-01-22T05:04:18.939 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new a1f6e936-fae7-4731-95d2-2a7553ba71fb 7 2024-01-22T05:04:18.944 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:18.938+0000 7f56274e0500 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-22T05:04:18.975 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:18.968+0000 7ff49e962500 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-22T05:04:19.024 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:19.018+0000 7f56274e0500 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-22T05:04:19.054 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:19.048+0000 7ff49e962500 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-22T05:04:19.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.084+0000 7ff93ca00700 1 Processor -- start 2024-01-22T05:04:19.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.084+0000 7ff93ca00700 1 -- start start 2024-01-22T05:04:19.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.084+0000 7ff93ca00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff9381581e0 0x7ff9380c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:19.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.084+0000 7ff93ca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9380a8e50 0x7ff938066080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:19.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.084+0000 7ff93ca00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff938065bd0 con 0x7ff9380c13d0 2024-01-22T05:04:19.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff93ca00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9380c18c0 con 0x7ff9381581e0 2024-01-22T05:04:19.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff93ca00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9380c1ba0 con 0x7ff9380a8e50 2024-01-22T05:04:19.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff937e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9380a8e50 0x7ff938066080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:19.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff937400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff9381581e0 0x7ff9380c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:19.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff937e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9380a8e50 0x7ff938066080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43092/0 (socket says 172.21.15.110:43092) 2024-01-22T05:04:19.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff937e00700 1 -- 172.21.15.110:0/1337944644 learned_addr learned my addr 172.21.15.110:0/1337944644 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:04:19.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff937e00700 1 -- 172.21.15.110:0/1337944644 >> v2:172.21.15.110:3300/0 conn(0x7ff9381581e0 msgr2=0x7ff9380c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:19.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff937e00700 1 --2- 172.21.15.110:0/1337944644 >> v2:172.21.15.110:3300/0 conn(0x7ff9381581e0 0x7ff9380c0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:19.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff937e00700 1 -- 172.21.15.110:0/1337944644 >> v1:172.21.15.49:6789/0 conn(0x7ff9380c13d0 legacy=0x7ff9380a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:19.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff937e00700 1 -- 172.21.15.110:0/1337944644 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9380c1e80 con 0x7ff9380a8e50 2024-01-22T05:04:19.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff937e00700 1 --2- 172.21.15.110:0/1337944644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9380a8e50 0x7ff938066080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff930009f20 tx=0x7ff930009840).ready entity=mon.2 client_cookie=ac0837c86eee771c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:19.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff936000700 1 -- 172.21.15.110:0/1337944644 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93000e070 con 0x7ff9380a8e50 2024-01-22T05:04:19.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff936000700 1 -- 172.21.15.110:0/1337944644 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93000b9d0 con 0x7ff9380a8e50 2024-01-22T05:04:19.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff936000700 1 -- 172.21.15.110:0/1337944644 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93000bd50 con 0x7ff9380a8e50 2024-01-22T05:04:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff93ca00700 1 -- 172.21.15.110:0/1337944644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9380a8e50 msgr2=0x7ff938066080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff93ca00700 1 --2- 172.21.15.110:0/1337944644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9380a8e50 0x7ff938066080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff930009f20 tx=0x7ff930009840).stop 2024-01-22T05:04:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff93ca00700 1 -- 172.21.15.110:0/1337944644 shutdown_connections 2024-01-22T05:04:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff93ca00700 1 --2- 172.21.15.110:0/1337944644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9380a8e50 0x7ff938066080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.088+0000 7ff93ca00700 1 --2- 172.21.15.110:0/1337944644 >> v2:172.21.15.110:3300/0 conn(0x7ff9381581e0 0x7ff9380c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.092+0000 7ff93ca00700 1 -- 172.21.15.110:0/1337944644 >> 172.21.15.110:0/1337944644 conn(0x7ff9380c6540 msgr2=0x7ff9380c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:19.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.092+0000 7ff93ca00700 1 -- 172.21.15.110:0/1337944644 shutdown_connections 2024-01-22T05:04:19.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.092+0000 7ff93ca00700 1 -- 172.21.15.110:0/1337944644 wait complete. 2024-01-22T05:04:19.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.092+0000 7ff93ca00700 1 Processor -- start 2024-01-22T05:04:19.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff93ca00700 1 -- start start 2024-01-22T05:04:19.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff93ca00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9380a8e50 0x7ff938156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:19.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff93ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9380c13d0 0x7ff93815cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:19.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff93ca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9381581e0 0x7ff9381696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:19.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff93ca00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93815aae0 con 0x7ff9380c13d0 2024-01-22T05:04:19.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff93ca00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff938159ed0 con 0x7ff9380a8e50 2024-01-22T05:04:19.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff93ca00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93815a1b0 con 0x7ff9381581e0 2024-01-22T05:04:19.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff937400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9380a8e50 0x7ff938156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:19.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff937e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9381581e0 0x7ff9381696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:19.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff937400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9380a8e50 0x7ff938156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52820/0 (socket says 172.21.15.110:52820) 2024-01-22T05:04:19.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff937e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9381581e0 0x7ff9381696c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43102/0 (socket says 172.21.15.110:43102) 2024-01-22T05:04:19.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff937400700 1 -- 172.21.15.110:0/590788006 learned_addr learned my addr 172.21.15.110:0/590788006 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:04:19.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff936a00700 1 --2- 172.21.15.110:0/590788006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9380c13d0 0x7ff93815cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:19.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff937400700 1 -- 172.21.15.110:0/590788006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9381581e0 msgr2=0x7ff9381696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:19.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff937400700 1 --2- 172.21.15.110:0/590788006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9381581e0 0x7ff9381696c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:19.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff937400700 1 -- 172.21.15.110:0/590788006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9380c13d0 msgr2=0x7ff93815cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:19.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff937400700 1 --2- 172.21.15.110:0/590788006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9380c13d0 0x7ff93815cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:19.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff937400700 1 -- 172.21.15.110:0/590788006 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff930009ae0 con 0x7ff9380a8e50 2024-01-22T05:04:19.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff937e00700 1 --2- 172.21.15.110:0/590788006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9381581e0 0x7ff9381696c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff937400700 1 --2- 172.21.15.110:0/590788006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9380a8e50 0x7ff938156b20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff92800e900 tx=0x7ff928009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff92ea00700 1 -- 172.21.15.110:0/590788006 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928012600 con 0x7ff9380a8e50 2024-01-22T05:04:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff92ea00700 1 -- 172.21.15.110:0/590788006 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff928012760 con 0x7ff9380a8e50 2024-01-22T05:04:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff93ca00700 1 -- 172.21.15.110:0/590788006 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93815a490 con 0x7ff9380a8e50 2024-01-22T05:04:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.096+0000 7ff92ea00700 1 -- 172.21.15.110:0/590788006 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928012ae0 con 0x7ff9380a8e50 2024-01-22T05:04:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.100+0000 7ff92ea00700 1 -- 172.21.15.110:0/590788006 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff92801b660 con 0x7ff9380a8e50 2024-01-22T05:04:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.100+0000 7ff93ca00700 1 -- 172.21.15.110:0/590788006 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff938157010 con 0x7ff9380a8e50 2024-01-22T05:04:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.100+0000 7ff92ea00700 1 -- 172.21.15.110:0/590788006 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7ff92801baf0 con 0x7ff9380a8e50 2024-01-22T05:04:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.100+0000 7ff93ca00700 1 -- 172.21.15.110:0/590788006 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff938047060 con 0x7ff9380a8e50 2024-01-22T05:04:19.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.104+0000 7ff92ea00700 1 -- 172.21.15.110:0/590788006 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7ff92803ae50 con 0x7ff9380a8e50 2024-01-22T05:04:19.141 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:19.136+0000 7ff49e962500 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-22T05:04:19.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.184+0000 7ff93ca00700 1 -- 172.21.15.110:0/590788006 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a1f6e936-fae7-4731-95d2-2a7553ba71fb", "id": 7} v 0) v1 -- 0x7ff9380c2160 con 0x7ff9380a8e50 2024-01-22T05:04:19.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.192+0000 7ff92ea00700 1 -- 172.21.15.110:0/590788006 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a1f6e936-fae7-4731-95d2-2a7553ba71fb", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff928029030 con 0x7ff9380a8e50 2024-01-22T05:04:19.198 INFO:teuthology.orchestra.run.smithi110.stdout:7 2024-01-22T05:04:19.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.192+0000 7ff93ca00700 1 -- 172.21.15.110:0/590788006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9380a8e50 msgr2=0x7ff938156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:19.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.192+0000 7ff93ca00700 1 --2- 172.21.15.110:0/590788006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9380a8e50 0x7ff938156b20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff92800e900 tx=0x7ff928009060).stop 2024-01-22T05:04:19.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.192+0000 7ff93ca00700 1 -- 172.21.15.110:0/590788006 shutdown_connections 2024-01-22T05:04:19.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.192+0000 7ff93ca00700 1 --2- 172.21.15.110:0/590788006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9381581e0 0x7ff9381696c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:19.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.192+0000 7ff93ca00700 1 --2- 172.21.15.110:0/590788006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9380c13d0 0x7ff93815cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:19.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.192+0000 7ff93ca00700 1 --2- 172.21.15.110:0/590788006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9380a8e50 0x7ff938156b20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:19.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.192+0000 7ff93ca00700 1 -- 172.21.15.110:0/590788006 >> 172.21.15.110:0/590788006 conn(0x7ff9380c6540 msgr2=0x7ff9380c55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:19.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.196+0000 7ff93ca00700 1 -- 172.21.15.110:0/590788006 shutdown_connections 2024-01-22T05:04:19.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:04:19.196+0000 7ff93ca00700 1 -- 172.21.15.110:0/590788006 wait complete. 2024-01-22T05:04:19.218 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-22T05:04:19.219 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-01-22T05:04:19.220 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:19.216+0000 7ff49e962500 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-22T05:04:19.223 INFO:tasks.ceph.osd.0:Started 2024-01-22T05:04:19.223 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-22T05:04:19.224 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-01-22T05:04:19.228 INFO:tasks.ceph.osd.1:Started 2024-01-22T05:04:19.228 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-22T05:04:19.228 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-01-22T05:04:19.232 INFO:tasks.ceph.osd.2:Started 2024-01-22T05:04:19.232 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-22T05:04:19.232 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-01-22T05:04:19.237 INFO:tasks.ceph.osd.3:Started 2024-01-22T05:04:19.237 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-22T05:04:19.237 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-01-22T05:04:19.243 INFO:tasks.ceph.osd.4:Started 2024-01-22T05:04:19.243 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-22T05:04:19.243 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-01-22T05:04:19.247 INFO:tasks.ceph.osd.5:Started 2024-01-22T05:04:19.247 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-22T05:04:19.247 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-01-22T05:04:19.252 INFO:tasks.ceph.osd.6:Started 2024-01-22T05:04:19.252 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-22T05:04:19.252 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-01-22T05:04:19.257 INFO:tasks.ceph.osd.7:Started 2024-01-22T05:04:19.257 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:04:19.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.418+0000 7f51b4600700 1 Processor -- start 2024-01-22T05:04:19.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.418+0000 7f51b4600700 1 -- start start 2024-01-22T05:04:19.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b4600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51ac062610 0x7f51ac067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:19.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b4600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac068430 con 0x7f51ac062230 2024-01-22T05:04:19.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b4600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac0c37d0 con 0x7f51ac067f80 2024-01-22T05:04:19.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b4600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac0c3a20 con 0x7f51ac062610 2024-01-22T05:04:19.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b1200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51ac062610 0x7f51ac067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:19.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b1200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51ac062610 0x7f51ac067a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58910/0 (socket says 172.21.15.49:58910) 2024-01-22T05:04:19.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b1200700 1 -- 172.21.15.49:0/2679401642 learned_addr learned my addr 172.21.15.49:0/2679401642 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:19.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b1c00700 1 --1- 172.21.15.49:0/2679401642 >> v1:172.21.15.49:6789/0 conn(0x7f51ac062230 0x7f51ac1507c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45666/0 (socket says 172.21.15.49:45666) 2024-01-22T05:04:19.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b1200700 1 -- 172.21.15.49:0/2679401642 >> v1:172.21.15.110:6789/0 conn(0x7f51ac067f80 legacy=0x7f51ac0bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:19.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b1200700 1 -- 172.21.15.49:0/2679401642 >> v1:172.21.15.49:6789/0 conn(0x7f51ac062230 legacy=0x7f51ac1507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:19.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b1200700 1 -- 172.21.15.49:0/2679401642 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0c3d00 con 0x7f51ac062610 2024-01-22T05:04:19.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b1200700 1 --2- 172.21.15.49:0/2679401642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ac062610 0x7f51ac067a90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5194006fd0 tx=0x7f519400b3b0).ready entity=mon.0 client_cookie=6ba05f142d046e6c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:19.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51abe00700 1 -- 172.21.15.49:0/2679401642 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519400db40 con 0x7f51ac062610 2024-01-22T05:04:19.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51abe00700 1 -- 172.21.15.49:0/2679401642 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519400dca0 con 0x7f51ac062610 2024-01-22T05:04:19.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51abe00700 1 -- 172.21.15.49:0/2679401642 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5194010680 con 0x7f51ac062610 2024-01-22T05:04:19.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b4600700 1 -- 172.21.15.49:0/2679401642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ac062610 msgr2=0x7f51ac067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:19.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b4600700 1 --2- 172.21.15.49:0/2679401642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ac062610 0x7f51ac067a90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5194006fd0 tx=0x7f519400b3b0).stop 2024-01-22T05:04:19.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b4600700 1 -- 172.21.15.49:0/2679401642 shutdown_connections 2024-01-22T05:04:19.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b4600700 1 --2- 172.21.15.49:0/2679401642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ac062610 0x7f51ac067a90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:19.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.422+0000 7f51b4600700 1 -- 172.21.15.49:0/2679401642 >> 172.21.15.49:0/2679401642 conn(0x7f51ac064080 msgr2=0x7f51ac064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:19.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.426+0000 7f51b4600700 1 -- 172.21.15.49:0/2679401642 shutdown_connections 2024-01-22T05:04:19.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.426+0000 7f51b4600700 1 -- 172.21.15.49:0/2679401642 wait complete. 2024-01-22T05:04:19.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.426+0000 7f51b4600700 1 Processor -- start 2024-01-22T05:04:19.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.426+0000 7f51b4600700 1 -- start start 2024-01-22T05:04:19.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b4600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ac062230 0x7f51ac14dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:19.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b4600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac062610 0x7f51ac0a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:19.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b4600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ac067f80 0x7f51ac0a9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:19.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b4600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0c0220 con 0x7f51ac067f80 2024-01-22T05:04:19.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b4600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0aa180 con 0x7f51ac062230 2024-01-22T05:04:19.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b4600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0aa460 con 0x7f51ac062610 2024-01-22T05:04:19.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b3000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ac067f80 0x7f51ac0a9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:19.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b3000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ac067f80 0x7f51ac0a9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58918/0 (socket says 172.21.15.49:58918) 2024-01-22T05:04:19.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b3000700 1 -- 172.21.15.49:0/2140180875 learned_addr learned my addr 172.21.15.49:0/2140180875 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:19.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b1c00700 1 --2- 172.21.15.49:0/2140180875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ac062230 0x7f51ac14dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:19.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b1200700 1 --2- 172.21.15.49:0/2140180875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac062610 0x7f51ac0a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:19.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b3000700 1 -- 172.21.15.49:0/2140180875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac062610 msgr2=0x7f51ac0a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:19.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b3000700 1 --2- 172.21.15.49:0/2140180875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac062610 0x7f51ac0a96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:19.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b3000700 1 -- 172.21.15.49:0/2140180875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ac062230 msgr2=0x7f51ac14dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:19.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b3000700 1 --2- 172.21.15.49:0/2140180875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ac062230 0x7f51ac14dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:19.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b3000700 1 -- 172.21.15.49:0/2140180875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519400b610 con 0x7f51ac067f80 2024-01-22T05:04:19.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b1200700 1 --2- 172.21.15.49:0/2140180875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac062610 0x7f51ac0a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:19.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b3000700 1 --2- 172.21.15.49:0/2140180875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ac067f80 0x7f51ac0a9bb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f51a400c7c0 tx=0x7f51a4001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51a8c00700 1 -- 172.21.15.49:0/2140180875 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a400e4a0 con 0x7f51ac067f80 2024-01-22T05:04:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51a8c00700 1 -- 172.21.15.49:0/2140180875 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a400e600 con 0x7f51ac067f80 2024-01-22T05:04:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b4600700 1 -- 172.21.15.49:0/2140180875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac0aa740 con 0x7f51ac067f80 2024-01-22T05:04:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51a8c00700 1 -- 172.21.15.49:0/2140180875 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a400e980 con 0x7f51ac067f80 2024-01-22T05:04:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51b4600700 1 -- 172.21.15.49:0/2140180875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac154420 con 0x7f51ac067f80 2024-01-22T05:04:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.430+0000 7f51a8c00700 1 -- 172.21.15.49:0/2140180875 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f51a4012400 con 0x7f51ac067f80 2024-01-22T05:04:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.434+0000 7f51a8c00700 1 -- 172.21.15.49:0/2140180875 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f51a401bab0 con 0x7f51ac067f80 2024-01-22T05:04:19.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.434+0000 7f51b4600700 1 -- 172.21.15.49:0/2140180875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac0bfff0 con 0x7f51ac067f80 2024-01-22T05:04:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.438+0000 7f51a8c00700 1 -- 172.21.15.49:0/2140180875 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f51ac0bfff0 con 0x7f51ac067f80 2024-01-22T05:04:19.456 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:19.450+0000 7f56274e0500 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-22T05:04:19.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.510+0000 7f51b4600700 1 -- 172.21.15.49:0/2140180875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51ac047060 con 0x7f51ac067f80 2024-01-22T05:04:19.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.510+0000 7f51a8c00700 1 -- 172.21.15.49:0/2140180875 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f51a4021060 con 0x7f51ac067f80 2024-01-22T05:04:19.516 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:19.516 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":10,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:19.190638+0000","last_up_change":"0.000000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:04:19.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.514+0000 7f51b4600700 1 -- 172.21.15.49:0/2140180875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ac067f80 msgr2=0x7f51ac0a9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:19.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.514+0000 7f51b4600700 1 --2- 172.21.15.49:0/2140180875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ac067f80 0x7f51ac0a9bb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f51a400c7c0 tx=0x7f51a4001510).stop 2024-01-22T05:04:19.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.514+0000 7f51b4600700 1 -- 172.21.15.49:0/2140180875 shutdown_connections 2024-01-22T05:04:19.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.514+0000 7f51b4600700 1 --2- 172.21.15.49:0/2140180875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ac067f80 0x7f51ac0a9bb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:19.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.514+0000 7f51b4600700 1 --2- 172.21.15.49:0/2140180875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac062610 0x7f51ac0a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:19.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.514+0000 7f51b4600700 1 --2- 172.21.15.49:0/2140180875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ac062230 0x7f51ac14dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:19.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.514+0000 7f51b4600700 1 -- 172.21.15.49:0/2140180875 >> 172.21.15.49:0/2140180875 conn(0x7f51ac064080 msgr2=0x7f51ac069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:19.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.514+0000 7f51b4600700 1 -- 172.21.15.49:0/2140180875 shutdown_connections 2024-01-22T05:04:19.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:19.514+0000 7f51b4600700 1 -- 172.21.15.49:0/2140180875 wait complete. 2024-01-22T05:04:19.539 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-22T05:04:19.539 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-22T05:04:19.631 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:19.624+0000 7ff49e962500 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-22T05:04:19.631 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:19.626+0000 7f56274e0500 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-22T05:04:19.803 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:19.796+0000 7ff49e962500 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-22T05:04:19.892 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-01-22T05:04:19.884+0000 7fb72ef20200 -1 Falling back to public interface 2024-01-22T05:04:19.900 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-22T05:04:19.894+0000 7f9f87328200 -1 Falling back to public interface 2024-01-22T05:04:19.907 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-01-22T05:04:19.900+0000 7feb080e3200 -1 Falling back to public interface 2024-01-22T05:04:19.911 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-22T05:04:19.906+0000 7fe4340f1200 -1 Falling back to public interface 2024-01-22T05:04:19.923 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-22T05:04:19.918+0000 7faf358e3200 -1 Falling back to public interface 2024-01-22T05:04:19.926 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-01-22T05:04:19.920+0000 7f5da9fbe200 -1 Falling back to public interface 2024-01-22T05:04:19.934 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-01-22T05:04:19.928+0000 7f50ee8de200 -1 Falling back to public interface 2024-01-22T05:04:19.938 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-22T05:04:19.934+0000 7f64c2128200 -1 Falling back to public interface 2024-01-22T05:04:19.943 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:19.938+0000 7f56274e0500 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-22T05:04:20.035 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:20.030+0000 7f56274e0500 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-22T05:04:20.138 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:20.132+0000 7ff49e962500 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-22T05:04:20.227 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:20.220+0000 7ff49e962500 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-22T05:04:20.332 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:20.326+0000 7f56274e0500 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-22T05:04:20.347 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-22T05:04:20.424 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:20.418+0000 7f56274e0500 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-22T05:04:20.483 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.478+0000 7f4509800700 1 Processor -- start 2024-01-22T05:04:20.483 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.478+0000 7f4509800700 1 -- start start 2024-01-22T05:04:20.485 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.478+0000 7f4509800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4504153e20 0x7f4504064ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:20.485 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.478+0000 7f4509800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4504065f50 con 0x7f45040c5410 2024-01-22T05:04:20.485 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.478+0000 7f4509800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45040626d0 con 0x7f45040653c0 2024-01-22T05:04:20.485 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.478+0000 7f4509800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4504065990 con 0x7f4504153e20 2024-01-22T05:04:20.485 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.478+0000 7f4508e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f45040c5410 0x7f4504062b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45670/0 (socket says 172.21.15.49:45670) 2024-01-22T05:04:20.485 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.478+0000 7f4508e00700 1 -- 172.21.15.49:0/1705430363 learned_addr learned my addr 172.21.15.49:0/1705430363 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:20.485 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.478+0000 7f4503e00700 1 --2- 172.21.15.49:0/1705430363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4504153e20 0x7f4504064ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:20.486 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.482+0000 7f4502a00700 1 -- 172.21.15.49:0/1705430363 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476839728 0 0) 0x7f4504065f50 con 0x7f45040c5410 2024-01-22T05:04:20.486 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.482+0000 7f4502a00700 1 -- 172.21.15.49:0/1705430363 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44e40033f0 con 0x7f45040c5410 2024-01-22T05:04:20.486 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.482+0000 7f4503e00700 1 -- 172.21.15.49:0/1705430363 >> v1:172.21.15.110:6789/0 conn(0x7f45040653c0 legacy=0x7f45040c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:20.486 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.482+0000 7f4503e00700 1 -- 172.21.15.49:0/1705430363 >> v1:172.21.15.49:6789/0 conn(0x7f45040c5410 legacy=0x7f4504062b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:20.486 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.482+0000 7f4503e00700 1 -- 172.21.15.49:0/1705430363 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504065c70 con 0x7f4504153e20 2024-01-22T05:04:20.487 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.482+0000 7f4503e00700 1 --2- 172.21.15.49:0/1705430363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4504153e20 0x7f4504064ed0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f44f4009790 tx=0x7f44f4009060).ready entity=mon.2 client_cookie=50cab07492e3f8a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:20.487 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.482+0000 7f4502a00700 1 -- 172.21.15.49:0/1705430363 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f40090d0 con 0x7f4504153e20 2024-01-22T05:04:20.487 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.482+0000 7f4502a00700 1 -- 172.21.15.49:0/1705430363 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f400f510 con 0x7f4504153e20 2024-01-22T05:04:20.487 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.482+0000 7f4502a00700 1 -- 172.21.15.49:0/1705430363 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400f890 con 0x7f4504153e20 2024-01-22T05:04:20.488 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.482+0000 7f4509800700 1 -- 172.21.15.49:0/1705430363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4504153e20 msgr2=0x7f4504064ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:20.488 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.482+0000 7f4509800700 1 --2- 172.21.15.49:0/1705430363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4504153e20 0x7f4504064ed0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f44f4009790 tx=0x7f44f4009060).stop 2024-01-22T05:04:20.489 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.482+0000 7f4509800700 1 -- 172.21.15.49:0/1705430363 shutdown_connections 2024-01-22T05:04:20.489 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.482+0000 7f4509800700 1 --2- 172.21.15.49:0/1705430363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4504153e20 0x7f4504064ed0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:20.489 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.482+0000 7f4509800700 1 -- 172.21.15.49:0/1705430363 >> 172.21.15.49:0/1705430363 conn(0x7f45040c31c0 msgr2=0x7f45040c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:20.490 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.482+0000 7f4509800700 1 -- 172.21.15.49:0/1705430363 shutdown_connections 2024-01-22T05:04:20.490 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.486+0000 7f4509800700 1 -- 172.21.15.49:0/1705430363 wait complete. 2024-01-22T05:04:20.493 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.486+0000 7f4509800700 1 Processor -- start 2024-01-22T05:04:20.493 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4509800700 1 -- start start 2024-01-22T05:04:20.496 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4509800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45040653c0 0x7f450413b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:20.496 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4509800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45040c5410 0x7f4504150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:20.496 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4509800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4504153e20 0x7f4504151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:20.496 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4509800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45041508e0 con 0x7f45040653c0 2024-01-22T05:04:20.496 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4509800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450414fcd0 con 0x7f4504153e20 2024-01-22T05:04:20.496 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4509800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450414ffb0 con 0x7f45040c5410 2024-01-22T05:04:20.497 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4503e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45040653c0 0x7f450413b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:20.497 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4503e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45040653c0 0x7f450413b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58922/0 (socket says 172.21.15.49:58922) 2024-01-22T05:04:20.497 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4503e00700 1 -- 172.21.15.49:0/3512427716 learned_addr learned my addr 172.21.15.49:0/3512427716 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:20.497 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4503400700 1 --2- 172.21.15.49:0/3512427716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45040c5410 0x7f4504150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:20.497 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4508e00700 1 --2- 172.21.15.49:0/3512427716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4504153e20 0x7f4504151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:20.498 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4503e00700 1 -- 172.21.15.49:0/3512427716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45040c5410 msgr2=0x7f4504150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:20.498 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4503e00700 1 --2- 172.21.15.49:0/3512427716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45040c5410 0x7f4504150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:20.498 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4503e00700 1 -- 172.21.15.49:0/3512427716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4504153e20 msgr2=0x7f4504151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:20.498 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4503e00700 1 --2- 172.21.15.49:0/3512427716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4504153e20 0x7f4504151260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:20.498 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4503e00700 1 -- 172.21.15.49:0/3512427716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f40092a0 con 0x7f45040653c0 2024-01-22T05:04:20.499 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4508e00700 1 --2- 172.21.15.49:0/3512427716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4504153e20 0x7f4504151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:20.499 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f4503e00700 1 --2- 172.21.15.49:0/3512427716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45040653c0 0x7f450413b350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f44f4009e30 tx=0x7f44f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:20.499 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.490+0000 7f44fb400700 1 -- 172.21.15.49:0/3512427716 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400f890 con 0x7f45040653c0 2024-01-22T05:04:20.499 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.494+0000 7f44fb400700 1 -- 172.21.15.49:0/3512427716 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f400fc50 con 0x7f45040653c0 2024-01-22T05:04:20.499 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.494+0000 7f4509800700 1 -- 172.21.15.49:0/3512427716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4504150290 con 0x7f45040653c0 2024-01-22T05:04:20.499 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.494+0000 7f44fb400700 1 -- 172.21.15.49:0/3512427716 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f401c420 con 0x7f45040653c0 2024-01-22T05:04:20.499 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.494+0000 7f4509800700 1 -- 172.21.15.49:0/3512427716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450413b840 con 0x7f45040653c0 2024-01-22T05:04:20.499 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.494+0000 7f44fb400700 1 -- 172.21.15.49:0/3512427716 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f44f401ca70 con 0x7f45040653c0 2024-01-22T05:04:20.499 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.494+0000 7f44fb400700 1 -- 172.21.15.49:0/3512427716 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f44f401cd20 con 0x7f45040653c0 2024-01-22T05:04:20.500 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.494+0000 7f4509800700 1 -- 172.21.15.49:0/3512427716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4504067ca0 con 0x7f45040653c0 2024-01-22T05:04:20.505 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.498+0000 7f44fb400700 1 -- 172.21.15.49:0/3512427716 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f44f402a060 con 0x7f45040653c0 2024-01-22T05:04:20.536 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:20.528+0000 7ff49e962500 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-22T05:04:20.572 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.566+0000 7f4509800700 1 -- 172.21.15.49:0/3512427716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4504046800 con 0x7f45040653c0 2024-01-22T05:04:20.573 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.566+0000 7f44fb400700 1 -- 172.21.15.49:0/3512427716 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f44f4020070 con 0x7f45040653c0 2024-01-22T05:04:20.574 INFO:teuthology.misc.health.smithi049.stdout: 2024-01-22T05:04:20.574 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":10,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:19.190638+0000","last_up_change":"0.000000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:04:20.576 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.570+0000 7f4509800700 1 -- 172.21.15.49:0/3512427716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45040653c0 msgr2=0x7f450413b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:20.576 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.570+0000 7f4509800700 1 --2- 172.21.15.49:0/3512427716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45040653c0 0x7f450413b350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f44f4009e30 tx=0x7f44f4017000).stop 2024-01-22T05:04:20.576 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.570+0000 7f4509800700 1 -- 172.21.15.49:0/3512427716 shutdown_connections 2024-01-22T05:04:20.576 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.570+0000 7f4509800700 1 --2- 172.21.15.49:0/3512427716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4504153e20 0x7f4504151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:20.576 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.570+0000 7f4509800700 1 --2- 172.21.15.49:0/3512427716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45040c5410 0x7f4504150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:20.576 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.570+0000 7f4509800700 1 --2- 172.21.15.49:0/3512427716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45040653c0 0x7f450413b350 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:20.576 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.570+0000 7f4509800700 1 -- 172.21.15.49:0/3512427716 >> 172.21.15.49:0/3512427716 conn(0x7f45040c31c0 msgr2=0x7f45040c2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:20.577 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.570+0000 7f4509800700 1 -- 172.21.15.49:0/3512427716 shutdown_connections 2024-01-22T05:04:20.577 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:20.570+0000 7f4509800700 1 -- 172.21.15.49:0/3512427716 wait complete. 2024-01-22T05:04:20.594 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-22T05:04:20.620 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:20.612+0000 7ff49e962500 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-22T05:04:20.622 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:20.618+0000 7f56274e0500 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-22T05:04:20.752 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:20.746+0000 7f56274e0500 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-22T05:04:20.812 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:20.804+0000 7ff49e962500 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-22T05:04:20.935 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:20.928+0000 7ff49e962500 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-22T05:04:20.940 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:20.934+0000 7f56274e0500 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-22T05:04:21.120 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:21.112+0000 7ff49e962500 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-22T05:04:21.198 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:21.194+0000 7f56274e0500 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-22T05:04:21.358 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-22T05:04:21.352+0000 7ff49e962500 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-22T05:04:22.233 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:22.226+0000 7f5610800700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-22T05:04:22.236 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-22T05:04:22.230+0000 7f5610800700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-22T05:04:24.028 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-22T05:04:24.022+0000 7fe4340f1200 -1 osd.0 0 log_to_monitors {default=true} 2024-01-22T05:04:24.036 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-01-22T05:04:24.027+0000 7fb72ef20200 -1 osd.5 0 log_to_monitors {default=true} 2024-01-22T05:04:24.052 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-01-22T05:04:24.043+0000 7feb080e3200 -1 osd.7 0 log_to_monitors {default=true} 2024-01-22T05:04:24.098 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-01-22T05:04:24.091+0000 7f5da9fbe200 -1 osd.4 0 log_to_monitors {default=true} 2024-01-22T05:04:24.161 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-01-22T05:04:24.155+0000 7f50ee8de200 -1 osd.6 0 log_to_monitors {default=true} 2024-01-22T05:04:24.184 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-22T05:04:24.178+0000 7f64c2128200 -1 osd.1 0 log_to_monitors {default=true} 2024-01-22T05:04:24.216 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-22T05:04:24.210+0000 7f9f87328200 -1 osd.2 0 log_to_monitors {default=true} 2024-01-22T05:04:24.222 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-22T05:04:24.218+0000 7faf358e3200 -1 osd.3 0 log_to_monitors {default=true} 2024-01-22T05:04:25.339 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-01-22T05:04:25.331+0000 7feb01e00700 -1 osd.7 0 waiting for initial osdmap 2024-01-22T05:04:25.339 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-22T05:04:25.334+0000 7f64bc600700 -1 osd.1 0 waiting for initial osdmap 2024-01-22T05:04:25.340 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-01-22T05:04:25.335+0000 7fb728c00700 -1 osd.5 0 waiting for initial osdmap 2024-01-22T05:04:25.341 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-22T05:04:25.334+0000 7f9f81800700 -1 osd.2 0 waiting for initial osdmap 2024-01-22T05:04:25.341 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-01-22T05:04:25.335+0000 7f50e8600700 -1 osd.6 0 waiting for initial osdmap 2024-01-22T05:04:25.342 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-22T05:04:25.334+0000 7faf2f400700 -1 osd.3 0 waiting for initial osdmap 2024-01-22T05:04:25.342 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-01-22T05:04:25.335+0000 7f5da4400700 -1 osd.4 0 waiting for initial osdmap 2024-01-22T05:04:25.342 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-22T05:04:25.338+0000 7fe42de00700 -1 osd.0 0 waiting for initial osdmap 2024-01-22T05:04:25.351 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-01-22T05:04:25.343+0000 7f5da0800700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:04:25.351 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-22T05:04:25.346+0000 7f64b8a00700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:04:25.351 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-01-22T05:04:25.343+0000 7fb725000700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:04:25.352 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-01-22T05:04:25.343+0000 7feafe200700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:04:25.352 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-01-22T05:04:25.343+0000 7f50e4a00700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:04:25.352 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-22T05:04:25.346+0000 7fe42a200700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:04:25.353 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-22T05:04:25.346+0000 7f9f7dc00700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:04:25.353 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-22T05:04:25.346+0000 7faf2b800700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:04:27.400 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-22T05:04:27.549 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.542+0000 7f3cf6e00700 1 Processor -- start 2024-01-22T05:04:27.550 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.546+0000 7f3cf6e00700 1 -- start start 2024-01-22T05:04:27.552 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.546+0000 7f3cf6e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cf00c4d00 0x7f3cf00c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:27.552 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.546+0000 7f3cf6e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf0062360 con 0x7f3cf00627f0 2024-01-22T05:04:27.552 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.546+0000 7f3cf6e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf00c5650 con 0x7f3cf0064ed0 2024-01-22T05:04:27.553 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.546+0000 7f3cf6e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf0158510 con 0x7f3cf00c4d00 2024-01-22T05:04:27.553 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.546+0000 7f3cf6400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3cf00627f0 0x7f3cf0062c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43600/0 (socket says 172.21.15.49:43600) 2024-01-22T05:04:27.553 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.546+0000 7f3cf6400700 1 -- 172.21.15.49:0/2704811059 learned_addr learned my addr 172.21.15.49:0/2704811059 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:27.553 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.546+0000 7f3cf5000700 1 --2- 172.21.15.49:0/2704811059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cf00c4d00 0x7f3cf00c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:27.554 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cefe00700 1 -- 172.21.15.49:0/2704811059 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717422141 0 0) 0x7f3cf0062360 con 0x7f3cf00627f0 2024-01-22T05:04:27.554 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cefe00700 1 -- 172.21.15.49:0/2704811059 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cd00033f0 con 0x7f3cf00627f0 2024-01-22T05:04:27.554 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cf5000700 1 -- 172.21.15.49:0/2704811059 >> v1:172.21.15.110:6789/0 conn(0x7f3cf0064ed0 legacy=0x7f3cf0157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:27.554 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cf5000700 1 -- 172.21.15.49:0/2704811059 >> v1:172.21.15.49:6789/0 conn(0x7f3cf00627f0 legacy=0x7f3cf0062c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:27.554 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cf5000700 1 -- 172.21.15.49:0/2704811059 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf00c49e0 con 0x7f3cf00c4d00 2024-01-22T05:04:27.555 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cf5000700 1 --2- 172.21.15.49:0/2704811059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cf00c4d00 0x7f3cf00c5160 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3cd8009710 tx=0x7f3cd8009060).ready entity=mon.2 client_cookie=fa558f58a519cda5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:27.555 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cefe00700 1 -- 172.21.15.49:0/2704811059 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd80090d0 con 0x7f3cf00c4d00 2024-01-22T05:04:27.555 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cefe00700 1 -- 172.21.15.49:0/2704811059 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd800d4a0 con 0x7f3cf00c4d00 2024-01-22T05:04:27.555 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cefe00700 1 -- 172.21.15.49:0/2704811059 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd800d820 con 0x7f3cf00c4d00 2024-01-22T05:04:27.556 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cf6e00700 1 -- 172.21.15.49:0/2704811059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cf00c4d00 msgr2=0x7f3cf00c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:27.556 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cf6e00700 1 --2- 172.21.15.49:0/2704811059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cf00c4d00 0x7f3cf00c5160 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3cd8009710 tx=0x7f3cd8009060).stop 2024-01-22T05:04:27.557 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cf6e00700 1 -- 172.21.15.49:0/2704811059 shutdown_connections 2024-01-22T05:04:27.557 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cf6e00700 1 --2- 172.21.15.49:0/2704811059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cf00c4d00 0x7f3cf00c5160 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:27.557 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cf6e00700 1 -- 172.21.15.49:0/2704811059 >> 172.21.15.49:0/2704811059 conn(0x7f3cf00c31c0 msgr2=0x7f3cf00c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:27.558 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cf6e00700 1 -- 172.21.15.49:0/2704811059 shutdown_connections 2024-01-22T05:04:27.558 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.550+0000 7f3cf6e00700 1 -- 172.21.15.49:0/2704811059 wait complete. 2024-01-22T05:04:27.560 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.554+0000 7f3cf6e00700 1 Processor -- start 2024-01-22T05:04:27.562 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.558+0000 7f3cf6e00700 1 -- start start 2024-01-22T05:04:27.564 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.558+0000 7f3cf6e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cf00627f0 0x7f3cf0154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:27.564 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.558+0000 7f3cf6e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cf0064ed0 0x7f3cf01539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:27.564 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.558+0000 7f3cf6e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cf00c4d00 0x7f3cf015a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:27.564 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.558+0000 7f3cf6e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf01560e0 con 0x7f3cf00c4d00 2024-01-22T05:04:27.564 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.558+0000 7f3cf6e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf00a8740 con 0x7f3cf0064ed0 2024-01-22T05:04:27.564 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.558+0000 7f3cf6e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf00a8a20 con 0x7f3cf00627f0 2024-01-22T05:04:27.565 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.558+0000 7f3cf6400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cf00c4d00 0x7f3cf015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:27.565 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.558+0000 7f3cf6400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cf00c4d00 0x7f3cf015a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34356/0 (socket says 172.21.15.49:34356) 2024-01-22T05:04:27.565 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.558+0000 7f3cf6400700 1 -- 172.21.15.49:0/1385385000 learned_addr learned my addr 172.21.15.49:0/1385385000 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:27.565 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.558+0000 7f3cf5000700 1 --2- 172.21.15.49:0/1385385000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cf0064ed0 0x7f3cf01539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:27.565 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.558+0000 7f3cf5a00700 1 --2- 172.21.15.49:0/1385385000 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cf00627f0 0x7f3cf0154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:27.566 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.558+0000 7f3cf6400700 1 -- 172.21.15.49:0/1385385000 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cf00627f0 msgr2=0x7f3cf0154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:27.566 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.558+0000 7f3cf6400700 1 --2- 172.21.15.49:0/1385385000 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cf00627f0 0x7f3cf0154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:27.566 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.558+0000 7f3cf6400700 1 -- 172.21.15.49:0/1385385000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cf0064ed0 msgr2=0x7f3cf01539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:27.566 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.562+0000 7f3cf6400700 1 --2- 172.21.15.49:0/1385385000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cf0064ed0 0x7f3cf01539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:27.566 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.562+0000 7f3cf6400700 1 -- 172.21.15.49:0/1385385000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd80092a0 con 0x7f3cf00c4d00 2024-01-22T05:04:27.566 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.562+0000 7f3cf5000700 1 --2- 172.21.15.49:0/1385385000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cf0064ed0 0x7f3cf01539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:27.566 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.562+0000 7f3cf6400700 1 --2- 172.21.15.49:0/1385385000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cf00c4d00 0x7f3cf015a830 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3ce8005ad0 tx=0x7f3ce80015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:27.567 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.562+0000 7f3cecc00700 1 -- 172.21.15.49:0/1385385000 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8005d30 con 0x7f3cf00c4d00 2024-01-22T05:04:27.567 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.562+0000 7f3cecc00700 1 -- 172.21.15.49:0/1385385000 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce8005e90 con 0x7f3cf00c4d00 2024-01-22T05:04:27.567 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.562+0000 7f3cf6e00700 1 -- 172.21.15.49:0/1385385000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf00a8d00 con 0x7f3cf00c4d00 2024-01-22T05:04:27.567 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.562+0000 7f3cecc00700 1 -- 172.21.15.49:0/1385385000 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce80072e0 con 0x7f3cf00c4d00 2024-01-22T05:04:27.567 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.562+0000 7f3cf6e00700 1 -- 172.21.15.49:0/1385385000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf00a9a30 con 0x7f3cf00c4d00 2024-01-22T05:04:27.568 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.562+0000 7f3cf6e00700 1 -- 172.21.15.49:0/1385385000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf0067ca0 con 0x7f3cf00c4d00 2024-01-22T05:04:27.571 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.566+0000 7f3cecc00700 1 -- 172.21.15.49:0/1385385000 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3ce80076d0 con 0x7f3cf00c4d00 2024-01-22T05:04:27.572 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.566+0000 7f3cecc00700 1 --2- 172.21.15.49:0/1385385000 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3cc805a510 0x7f3cc805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:27.572 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.566+0000 7f3cecc00700 1 -- 172.21.15.49:0/1385385000 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7f3ce8073c10 con 0x7f3cf00c4d00 2024-01-22T05:04:27.572 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.566+0000 7f3cf5a00700 1 --2- 172.21.15.49:0/1385385000 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3cc805a510 0x7f3cc805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:27.574 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.570+0000 7f3cf5a00700 1 --2- 172.21.15.49:0/1385385000 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3cc805a510 0x7f3cc805c9d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3ce0000f60 tx=0x7f3ce0007d20).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:27.580 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.574+0000 7f3cecc00700 1 -- 172.21.15.49:0/1385385000 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3ce80477a0 con 0x7f3cf00c4d00 2024-01-22T05:04:27.745 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.738+0000 7f3cf6e00700 1 -- 172.21.15.49:0/1385385000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cf00655d0 con 0x7f3cf00c4d00 2024-01-22T05:04:27.747 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.742+0000 7f3cecc00700 1 -- 172.21.15.49:0/1385385000 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+12180 (secure 0 0 0) 0x7f3ce804adc0 con 0x7f3cf00c4d00 2024-01-22T05:04:27.747 INFO:teuthology.misc.health.smithi049.stdout: 2024-01-22T05:04:27.748 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":14,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:27.355522+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:04:27.753 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.746+0000 7f3cf6e00700 1 -- 172.21.15.49:0/1385385000 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3cc805a510 msgr2=0x7f3cc805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:27.753 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.746+0000 7f3cf6e00700 1 --2- 172.21.15.49:0/1385385000 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3cc805a510 0x7f3cc805c9d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3ce0000f60 tx=0x7f3ce0007d20).stop 2024-01-22T05:04:27.753 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.746+0000 7f3cf6e00700 1 -- 172.21.15.49:0/1385385000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cf00c4d00 msgr2=0x7f3cf015a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:27.753 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.746+0000 7f3cf6e00700 1 --2- 172.21.15.49:0/1385385000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cf00c4d00 0x7f3cf015a830 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3ce8005ad0 tx=0x7f3ce80015b0).stop 2024-01-22T05:04:27.753 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.746+0000 7f3cf6e00700 1 -- 172.21.15.49:0/1385385000 shutdown_connections 2024-01-22T05:04:27.753 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.746+0000 7f3cf6e00700 1 --2- 172.21.15.49:0/1385385000 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3cc805a510 0x7f3cc805c9d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:27.753 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.746+0000 7f3cf6e00700 1 --2- 172.21.15.49:0/1385385000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cf00c4d00 0x7f3cf015a830 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:27.753 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.746+0000 7f3cf6e00700 1 --2- 172.21.15.49:0/1385385000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cf0064ed0 0x7f3cf01539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:27.753 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.746+0000 7f3cf6e00700 1 --2- 172.21.15.49:0/1385385000 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cf00627f0 0x7f3cf0154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:27.753 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.746+0000 7f3cf6e00700 1 -- 172.21.15.49:0/1385385000 >> 172.21.15.49:0/1385385000 conn(0x7f3cf00c31c0 msgr2=0x7f3cf00bc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:27.754 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.746+0000 7f3cf6e00700 1 -- 172.21.15.49:0/1385385000 shutdown_connections 2024-01-22T05:04:27.754 INFO:teuthology.misc.health.smithi049.stderr:2024-01-22T05:04:27.746+0000 7f3cf6e00700 1 -- 172.21.15.49:0/1385385000 wait complete. 2024-01-22T05:04:27.772 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-22T05:04:27.772 INFO:tasks.ceph:Creating RBD pool 2024-01-22T05:04:27.772 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd pool create rbd 8 2024-01-22T05:04:27.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.918+0000 7f6ca3c00700 1 Processor -- start 2024-01-22T05:04:27.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.918+0000 7f6ca3c00700 1 -- start start 2024-01-22T05:04:27.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.922+0000 7f6ca3c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6c9c153cf0 0x7f6c9c0c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:27.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.922+0000 7f6ca3c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9c068280 con 0x7f6c9c0bcba0 2024-01-22T05:04:27.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.922+0000 7f6ca3c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9c0c1f30 con 0x7f6c9c0c1ac0 2024-01-22T05:04:27.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.922+0000 7f6ca3c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9c0bd190 con 0x7f6c9c153cf0 2024-01-22T05:04:27.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.922+0000 7f6ca1c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6c9c0bcba0 0x7f6c9c068710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43604/0 (socket says 172.21.15.49:43604) 2024-01-22T05:04:27.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.922+0000 7f6ca1c00700 1 -- 172.21.15.49:0/4099077752 learned_addr learned my addr 172.21.15.49:0/4099077752 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:27.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.922+0000 7f6ca1200700 1 --2- 172.21.15.49:0/4099077752 >> v2:172.21.15.110:3300/0 conn(0x7f6c9c153cf0 0x7f6c9c0c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:27.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.922+0000 7f6c9b400700 1 -- 172.21.15.49:0/4099077752 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169381383 0 0) 0x7f6c9c068280 con 0x7f6c9c0bcba0 2024-01-22T05:04:27.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.922+0000 7f6c9b400700 1 -- 172.21.15.49:0/4099077752 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c7c0033f0 con 0x7f6c9c0bcba0 2024-01-22T05:04:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.922+0000 7f6c9b400700 1 -- 172.21.15.49:0/4099077752 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254868664 0 0) 0x7f6c9c0c1f30 con 0x7f6c9c0c1ac0 2024-01-22T05:04:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.922+0000 7f6c9b400700 1 -- 172.21.15.49:0/4099077752 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c9c068280 con 0x7f6c9c0c1ac0 2024-01-22T05:04:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.922+0000 7f6ca1200700 1 -- 172.21.15.49:0/4099077752 >> v1:172.21.15.110:6789/0 conn(0x7f6c9c0c1ac0 legacy=0x7f6c9c0bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.926+0000 7f6ca1200700 1 -- 172.21.15.49:0/4099077752 >> v1:172.21.15.49:6789/0 conn(0x7f6c9c0bcba0 legacy=0x7f6c9c068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.926+0000 7f6c9b400700 1 -- 172.21.15.49:0/4099077752 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1356875660 0 0) 0x7f6c7c0033f0 con 0x7f6c9c0bcba0 2024-01-22T05:04:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.926+0000 7f6ca1200700 1 -- 172.21.15.49:0/4099077752 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c067c30 con 0x7f6c9c153cf0 2024-01-22T05:04:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.926+0000 7f6ca1200700 1 --2- 172.21.15.49:0/4099077752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c9c153cf0 0x7f6c9c0c15d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6c8c009760 tx=0x7f6c8c009060).ready entity=mon.1 client_cookie=d2e76d3863cce4a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.926+0000 7f6c9b400700 1 -- 172.21.15.49:0/4099077752 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c940017f0 con 0x7f6c9c153cf0 2024-01-22T05:04:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.926+0000 7f6c9b400700 1 -- 172.21.15.49:0/4099077752 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8c011400 con 0x7f6c9c153cf0 2024-01-22T05:04:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.926+0000 7f6c9b400700 1 -- 172.21.15.49:0/4099077752 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c011780 con 0x7f6c9c153cf0 2024-01-22T05:04:27.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.926+0000 7f6ca3c00700 1 -- 172.21.15.49:0/4099077752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c9c153cf0 msgr2=0x7f6c9c0c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:27.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.926+0000 7f6ca3c00700 1 --2- 172.21.15.49:0/4099077752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c9c153cf0 0x7f6c9c0c15d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6c8c009760 tx=0x7f6c8c009060).stop 2024-01-22T05:04:27.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.926+0000 7f6ca3c00700 1 -- 172.21.15.49:0/4099077752 shutdown_connections 2024-01-22T05:04:27.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.926+0000 7f6ca3c00700 1 --2- 172.21.15.49:0/4099077752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c9c153cf0 0x7f6c9c0c15d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:27.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.926+0000 7f6ca3c00700 1 -- 172.21.15.49:0/4099077752 >> 172.21.15.49:0/4099077752 conn(0x7f6c9c062cb0 msgr2=0x7f6c9c0c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:27.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.926+0000 7f6ca3c00700 1 -- 172.21.15.49:0/4099077752 shutdown_connections 2024-01-22T05:04:27.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.926+0000 7f6ca3c00700 1 -- 172.21.15.49:0/4099077752 wait complete. 2024-01-22T05:04:27.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.930+0000 7f6ca3c00700 1 Processor -- start 2024-01-22T05:04:27.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.930+0000 7f6ca3c00700 1 -- start start 2024-01-22T05:04:27.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6ca3c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c9c0bcba0 0x7f6c9c0befd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:27.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6ca3c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c0c1ac0 0x7f6c9c167b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:27.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6ca3c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c9c153cf0 0x7f6c9c163c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:27.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6ca3c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c164670 con 0x7f6c9c0c1ac0 2024-01-22T05:04:27.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6ca3c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0a3d70 con 0x7f6c9c153cf0 2024-01-22T05:04:27.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6ca3c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0a4050 con 0x7f6c9c0bcba0 2024-01-22T05:04:27.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6c9be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c0c1ac0 0x7f6c9c167b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:27.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6c9be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c0c1ac0 0x7f6c9c167b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34362/0 (socket says 172.21.15.49:34362) 2024-01-22T05:04:27.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6c9be00700 1 -- 172.21.15.49:0/506025629 learned_addr learned my addr 172.21.15.49:0/506025629 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:27.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6ca1200700 1 --2- 172.21.15.49:0/506025629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c9c0bcba0 0x7f6c9c0befd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:27.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6ca1c00700 1 --2- 172.21.15.49:0/506025629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c9c153cf0 0x7f6c9c163c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6c9be00700 1 -- 172.21.15.49:0/506025629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c9c0bcba0 msgr2=0x7f6c9c0befd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6c9be00700 1 --2- 172.21.15.49:0/506025629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c9c0bcba0 0x7f6c9c0befd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6c9be00700 1 -- 172.21.15.49:0/506025629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c9c153cf0 msgr2=0x7f6c9c163c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6c9be00700 1 --2- 172.21.15.49:0/506025629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c9c153cf0 0x7f6c9c163c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6c9be00700 1 -- 172.21.15.49:0/506025629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c0092a0 con 0x7f6c9c0c1ac0 2024-01-22T05:04:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6ca1c00700 1 --2- 172.21.15.49:0/506025629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c9c153cf0 0x7f6c9c163c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6c9be00700 1 --2- 172.21.15.49:0/506025629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c0c1ac0 0x7f6c9c167b00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6c8400c4c0 tx=0x7f6c84007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6c93e00700 1 -- 172.21.15.49:0/506025629 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8400f470 con 0x7f6c9c0c1ac0 2024-01-22T05:04:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6c93e00700 1 -- 172.21.15.49:0/506025629 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8400f5d0 con 0x7f6c9c0c1ac0 2024-01-22T05:04:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6c93e00700 1 -- 172.21.15.49:0/506025629 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8400f970 con 0x7f6c9c0c1ac0 2024-01-22T05:04:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.934+0000 7f6ca3c00700 1 -- 172.21.15.49:0/506025629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9c0a4330 con 0x7f6c9c0c1ac0 2024-01-22T05:04:27.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.938+0000 7f6ca3c00700 1 -- 172.21.15.49:0/506025629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9c0bf4c0 con 0x7f6c9c0c1ac0 2024-01-22T05:04:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.938+0000 7f6ca3c00700 1 -- 172.21.15.49:0/506025629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c9c164820 con 0x7f6c9c0c1ac0 2024-01-22T05:04:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.938+0000 7f6c93e00700 1 -- 172.21.15.49:0/506025629 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6c8400fd20 con 0x7f6c9c0c1ac0 2024-01-22T05:04:27.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.942+0000 7f6c93e00700 1 --2- 172.21.15.49:0/506025629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6c7405a540 0x7f6c7405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:27.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.942+0000 7f6c93e00700 1 -- 172.21.15.49:0/506025629 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7f6c84073880 con 0x7f6c9c0c1ac0 2024-01-22T05:04:27.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.942+0000 7f6ca1200700 1 --2- 172.21.15.49:0/506025629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6c7405a540 0x7f6c7405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:27.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.942+0000 7f6ca1200700 1 --2- 172.21.15.49:0/506025629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6c7405a540 0x7f6c7405ca00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f6c8c00a010 tx=0x7f6c8c016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:27.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:27.946+0000 7f6c93e00700 1 -- 172.21.15.49:0/506025629 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6c9c164820 con 0x7f6c9c0c1ac0 2024-01-22T05:04:28.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.110+0000 7f6ca3c00700 1 -- 172.21.15.49:0/506025629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f6c9c164820 con 0x7f6c9c0c1ac0 2024-01-22T05:04:28.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.374+0000 7f6c93e00700 1 -- 172.21.15.49:0/506025629 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f6c9c164820 con 0x7f6c9c0c1ac0 2024-01-22T05:04:28.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.378+0000 7f6ca3c00700 1 -- 172.21.15.49:0/506025629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6c7405a540 msgr2=0x7f6c7405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:28.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.378+0000 7f6ca3c00700 1 --2- 172.21.15.49:0/506025629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6c7405a540 0x7f6c7405ca00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f6c8c00a010 tx=0x7f6c8c016000).stop 2024-01-22T05:04:28.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.378+0000 7f6ca3c00700 1 -- 172.21.15.49:0/506025629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c0c1ac0 msgr2=0x7f6c9c167b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:28.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.378+0000 7f6ca3c00700 1 --2- 172.21.15.49:0/506025629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c0c1ac0 0x7f6c9c167b00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6c8400c4c0 tx=0x7f6c84007c80).stop 2024-01-22T05:04:28.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.378+0000 7f6ca3c00700 1 -- 172.21.15.49:0/506025629 shutdown_connections 2024-01-22T05:04:28.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.378+0000 7f6ca3c00700 1 --2- 172.21.15.49:0/506025629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6c7405a540 0x7f6c7405ca00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:28.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.378+0000 7f6ca3c00700 1 --2- 172.21.15.49:0/506025629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c9c153cf0 0x7f6c9c163c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:28.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.378+0000 7f6ca3c00700 1 --2- 172.21.15.49:0/506025629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9c0c1ac0 0x7f6c9c167b00 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0x7f6c8400c4c0 tx=0x7f6c84007c80).stop 2024-01-22T05:04:28.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.378+0000 7f6ca3c00700 1 --2- 172.21.15.49:0/506025629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c9c0bcba0 0x7f6c9c0befd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:28.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.378+0000 7f6ca3c00700 1 -- 172.21.15.49:0/506025629 >> 172.21.15.49:0/506025629 conn(0x7f6c9c062cb0 msgr2=0x7f6c9c0c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:28.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.382+0000 7f6ca3c00700 1 -- 172.21.15.49:0/506025629 shutdown_connections 2024-01-22T05:04:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.382+0000 7f6ca3c00700 1 -- 172.21.15.49:0/506025629 wait complete. 2024-01-22T05:04:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'rbd' created 2024-01-22T05:04:28.408 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-01-22T05:04:28.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.566+0000 7f0082c00700 1 Processor -- start 2024-01-22T05:04:28.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.566+0000 7f0082c00700 1 -- start start 2024-01-22T05:04:28.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f0082c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f007c153d80 0x7f007c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:28.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f0082c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f007c0690c0 0x7f007c0c3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:28.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f0082c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007c0c3bf0 con 0x7f007c0c3760 2024-01-22T05:04:28.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f0082c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007c1585b0 con 0x7f007c153d80 2024-01-22T05:04:28.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f0082c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c069520 con 0x7f007c0690c0 2024-01-22T05:04:28.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f007be00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f007c153d80 0x7f007c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:28.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f007b400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f007c0690c0 0x7f007c0c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:28.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f0080c00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f007c0c3760 0x7f007c157710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:46850/0 (socket says 172.21.15.49:46850) 2024-01-22T05:04:28.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f0080c00700 1 -- 172.21.15.49:0/2983532443 learned_addr learned my addr 172.21.15.49:0/2983532443 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:28.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f007aa00700 1 -- 172.21.15.49:0/2983532443 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016173679 0 0) 0x7f0074001490 con 0x7f007c0c3760 2024-01-22T05:04:28.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f007aa00700 1 -- 172.21.15.49:0/2983532443 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f005c0033f0 con 0x7f007c0c3760 2024-01-22T05:04:28.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f007be00700 1 -- 172.21.15.49:0/2983532443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f007c0690c0 msgr2=0x7f007c0c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:28.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f007be00700 1 --2- 172.21.15.49:0/2983532443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f007c0690c0 0x7f007c0c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:28.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f007be00700 1 -- 172.21.15.49:0/2983532443 >> v1:172.21.15.110:6789/0 conn(0x7f007c0c3760 legacy=0x7f007c157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:28.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f007be00700 1 -- 172.21.15.49:0/2983532443 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c068740 con 0x7f007c153d80 2024-01-22T05:04:28.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f007b400700 1 --2- 172.21.15.49:0/2983532443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f007c0690c0 0x7f007c0c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:28.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.570+0000 7f007be00700 1 --2- 172.21.15.49:0/2983532443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f007c153d80 0x7f007c068bd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f006c006fd0 tx=0x7f006c006f40).ready entity=mon.1 client_cookie=5a09c0828455d02d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:28.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.574+0000 7f007aa00700 1 -- 172.21.15.49:0/2983532443 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c005880 con 0x7f007c153d80 2024-01-22T05:04:28.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.574+0000 7f007aa00700 1 -- 172.21.15.49:0/2983532443 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c0059e0 con 0x7f007c153d80 2024-01-22T05:04:28.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.574+0000 7f007aa00700 1 -- 172.21.15.49:0/2983532443 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c005d60 con 0x7f007c153d80 2024-01-22T05:04:28.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.574+0000 7f0082c00700 1 -- 172.21.15.49:0/2983532443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f007c153d80 msgr2=0x7f007c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:28.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.574+0000 7f0082c00700 1 --2- 172.21.15.49:0/2983532443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f007c153d80 0x7f007c068bd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f006c006fd0 tx=0x7f006c006f40).stop 2024-01-22T05:04:28.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.574+0000 7f0082c00700 1 -- 172.21.15.49:0/2983532443 shutdown_connections 2024-01-22T05:04:28.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.574+0000 7f0082c00700 1 --2- 172.21.15.49:0/2983532443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f007c0690c0 0x7f007c0c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:28.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.574+0000 7f0082c00700 1 --2- 172.21.15.49:0/2983532443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f007c153d80 0x7f007c068bd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:28.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.574+0000 7f0082c00700 1 -- 172.21.15.49:0/2983532443 >> 172.21.15.49:0/2983532443 conn(0x7f007c0c8710 msgr2=0x7f007c0c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:28.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.574+0000 7f0082c00700 1 -- 172.21.15.49:0/2983532443 shutdown_connections 2024-01-22T05:04:28.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.574+0000 7f0082c00700 1 -- 172.21.15.49:0/2983532443 wait complete. 2024-01-22T05:04:28.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.578+0000 7f0082c00700 1 Processor -- start 2024-01-22T05:04:28.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.578+0000 7f0082c00700 1 -- start start 2024-01-22T05:04:28.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f0082c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f007c0690c0 0x7f007c147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:28.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f0082c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f007c0c3760 0x7f007c0c16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:28.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f0082c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007c153d80 0x7f007c0c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:28.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f0082c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c1655f0 con 0x7f007c153d80 2024-01-22T05:04:28.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f0082c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c147e40 con 0x7f007c0690c0 2024-01-22T05:04:28.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f0082c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c0c21b0 con 0x7f007c0c3760 2024-01-22T05:04:28.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f0080c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007c153d80 0x7f007c0c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:28.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f007be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f007c0690c0 0x7f007c147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:28.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f007be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f007c0690c0 0x7f007c147950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:59806/0 (socket says 172.21.15.49:59806) 2024-01-22T05:04:28.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f007be00700 1 -- 172.21.15.49:0/3303409195 learned_addr learned my addr 172.21.15.49:0/3303409195 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:28.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f007b400700 1 --2- 172.21.15.49:0/3303409195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f007c0c3760 0x7f007c0c16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:28.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f007be00700 1 -- 172.21.15.49:0/3303409195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f007c0c3760 msgr2=0x7f007c0c16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:28.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f007be00700 1 --2- 172.21.15.49:0/3303409195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f007c0c3760 0x7f007c0c16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:28.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f007be00700 1 -- 172.21.15.49:0/3303409195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007c153d80 msgr2=0x7f007c0c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:28.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f007be00700 1 --2- 172.21.15.49:0/3303409195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007c153d80 0x7f007c0c1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:28.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f007be00700 1 -- 172.21.15.49:0/3303409195 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00640092a0 con 0x7f007c0690c0 2024-01-22T05:04:28.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f007be00700 1 --2- 172.21.15.49:0/3303409195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f007c0690c0 0x7f007c147950 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f006c006f80 tx=0x7f006c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:28.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f0073400700 1 -- 172.21.15.49:0/3303409195 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00d6b0 con 0x7f007c0690c0 2024-01-22T05:04:28.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f0073400700 1 -- 172.21.15.49:0/3303409195 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c00d830 con 0x7f007c0690c0 2024-01-22T05:04:28.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f0082c00700 1 -- 172.21.15.49:0/3303409195 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006c009250 con 0x7f007c0690c0 2024-01-22T05:04:28.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.582+0000 7f0073400700 1 -- 172.21.15.49:0/3303409195 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00dbf0 con 0x7f007c0690c0 2024-01-22T05:04:28.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.586+0000 7f0082c00700 1 -- 172.21.15.49:0/3303409195 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c164fa0 con 0x7f007c0690c0 2024-01-22T05:04:28.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.586+0000 7f0073400700 1 -- 172.21.15.49:0/3303409195 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f006c0113f0 con 0x7f007c0690c0 2024-01-22T05:04:28.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.586+0000 7f0082c00700 1 -- 172.21.15.49:0/3303409195 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c047060 con 0x7f007c0690c0 2024-01-22T05:04:28.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.586+0000 7f0073400700 1 --2- 172.21.15.49:0/3303409195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f005405a510 0x7f005405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:28.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.586+0000 7f0073400700 1 -- 172.21.15.49:0/3303409195 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5258+0+0 (secure 0 0 0) 0x7f006c075b00 con 0x7f007c0690c0 2024-01-22T05:04:28.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.586+0000 7f007b400700 1 --2- 172.21.15.49:0/3303409195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f005405a510 0x7f005405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:28.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.590+0000 7f007b400700 1 --2- 172.21.15.49:0/3303409195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f005405a510 0x7f005405c9d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f007c0c4960 tx=0x7f0064009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:28.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.598+0000 7f0073400700 1 -- 172.21.15.49:0/3303409195 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f006c049680 con 0x7f007c0690c0 2024-01-22T05:04:28.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:28.778+0000 7f0082c00700 1 -- 172.21.15.49:0/3303409195 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f007c067b30 con 0x7f007c0690c0 2024-01-22T05:04:29.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.374+0000 7f0073400700 1 -- 172.21.15.49:0/3303409195 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f006c023030 con 0x7f007c0690c0 2024-01-22T05:04:29.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.378+0000 7f0082c00700 1 -- 172.21.15.49:0/3303409195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f005405a510 msgr2=0x7f005405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:29.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.378+0000 7f0082c00700 1 --2- 172.21.15.49:0/3303409195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f005405a510 0x7f005405c9d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f007c0c4960 tx=0x7f0064009060).stop 2024-01-22T05:04:29.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.382+0000 7f0082c00700 1 -- 172.21.15.49:0/3303409195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f007c0690c0 msgr2=0x7f007c147950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:29.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.382+0000 7f0082c00700 1 --2- 172.21.15.49:0/3303409195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f007c0690c0 0x7f007c147950 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f006c006f80 tx=0x7f006c015000).stop 2024-01-22T05:04:29.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.382+0000 7f0082c00700 1 -- 172.21.15.49:0/3303409195 shutdown_connections 2024-01-22T05:04:29.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.382+0000 7f0082c00700 1 --2- 172.21.15.49:0/3303409195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f005405a510 0x7f005405c9d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.382+0000 7f0082c00700 1 --2- 172.21.15.49:0/3303409195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007c153d80 0x7f007c0c1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.382+0000 7f0082c00700 1 --2- 172.21.15.49:0/3303409195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f007c0c3760 0x7f007c0c16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.382+0000 7f0082c00700 1 --2- 172.21.15.49:0/3303409195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f007c0690c0 0x7f007c147950 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.382+0000 7f0082c00700 1 -- 172.21.15.49:0/3303409195 >> 172.21.15.49:0/3303409195 conn(0x7f007c0c8710 msgr2=0x7f007c0c7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:29.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.382+0000 7f0082c00700 1 -- 172.21.15.49:0/3303409195 shutdown_connections 2024-01-22T05:04:29.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.382+0000 7f0082c00700 1 -- 172.21.15.49:0/3303409195 wait complete. 2024-01-22T05:04:29.391 INFO:teuthology.orchestra.run.smithi049.stderr:enabled application 'rbd' on pool 'rbd' 2024-01-22T05:04:29.409 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-22T05:04:29.410 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:04:29.410 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:04:29.416 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:04:29.416 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:04:29.416 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:04:29.420 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:04:29.420 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:04:29.420 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:04:29.425 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:04:29.425 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:04:29.425 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:04:29.429 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:04:29.431 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-22T05:04:29.431 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:04:29.518 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:04:29.519 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:04:29.534 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-22T05:04:29.547 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:04:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.582+0000 7f2f87c00700 1 Processor -- start 2024-01-22T05:04:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.582+0000 7f2f87c00700 1 -- start start 2024-01-22T05:04:29.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f87c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2f80065660 0x7f2f800a6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:29.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f87c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f80064950 0x7f2f80157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:29.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f87c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f800c2700 con 0x7f2f800644f0 2024-01-22T05:04:29.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f87c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f800bdc90 con 0x7f2f80064950 2024-01-22T05:04:29.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f87c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f800c2930 con 0x7f2f80065660 2024-01-22T05:04:29.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f7fe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2f800644f0 0x7f2f801575b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43628/0 (socket says 172.21.15.49:43628) 2024-01-22T05:04:29.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f7fe00700 1 -- 172.21.15.49:0/3592677326 learned_addr learned my addr 172.21.15.49:0/3592677326 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:29.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f86600700 1 --2- 172.21.15.49:0/3592677326 >> v2:172.21.15.49:3300/0 conn(0x7f2f80064950 0x7f2f80157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:29.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f85200700 1 --2- 172.21.15.49:0/3592677326 >> v2:172.21.15.110:3300/0 conn(0x7f2f80065660 0x7f2f800a6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:29.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f7f400700 1 -- 172.21.15.49:0/3592677326 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917076845 0 0) 0x7f2f800c2700 con 0x7f2f800644f0 2024-01-22T05:04:29.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f7f400700 1 -- 172.21.15.49:0/3592677326 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f600033f0 con 0x7f2f800644f0 2024-01-22T05:04:29.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f86600700 1 -- 172.21.15.49:0/3592677326 >> v2:172.21.15.110:3300/0 conn(0x7f2f80065660 msgr2=0x7f2f800a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:29.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f86600700 1 --2- 172.21.15.49:0/3592677326 >> v2:172.21.15.110:3300/0 conn(0x7f2f80065660 0x7f2f800a6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f86600700 1 -- 172.21.15.49:0/3592677326 >> v1:172.21.15.49:6789/0 conn(0x7f2f800644f0 legacy=0x7f2f801575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f7f400700 1 -- 172.21.15.49:0/3592677326 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2459997366 0 0) 0x7f2f600033f0 con 0x7f2f800644f0 2024-01-22T05:04:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.586+0000 7f2f86600700 1 -- 172.21.15.49:0/3592677326 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f800c2c10 con 0x7f2f80064950 2024-01-22T05:04:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.590+0000 7f2f86600700 1 --2- 172.21.15.49:0/3592677326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f80064950 0x7f2f80157cc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2f80066410 tx=0x7f2f78009780).ready entity=mon.0 client_cookie=e1cf4a8ed9163273 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.590+0000 7f2f7f400700 1 -- 172.21.15.49:0/3592677326 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800e070 con 0x7f2f80064950 2024-01-22T05:04:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.590+0000 7f2f7f400700 1 -- 172.21.15.49:0/3592677326 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7800b7a0 con 0x7f2f80064950 2024-01-22T05:04:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.590+0000 7f2f7f400700 1 -- 172.21.15.49:0/3592677326 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68001470 con 0x7f2f80064950 2024-01-22T05:04:29.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.590+0000 7f2f87c00700 1 -- 172.21.15.49:0/3592677326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f80064950 msgr2=0x7f2f80157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:29.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.590+0000 7f2f87c00700 1 --2- 172.21.15.49:0/3592677326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f80064950 0x7f2f80157cc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2f80066410 tx=0x7f2f78009780).stop 2024-01-22T05:04:29.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.590+0000 7f2f87c00700 1 -- 172.21.15.49:0/3592677326 shutdown_connections 2024-01-22T05:04:29.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.590+0000 7f2f87c00700 1 --2- 172.21.15.49:0/3592677326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f80064950 0x7f2f80157cc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.590+0000 7f2f87c00700 1 --2- 172.21.15.49:0/3592677326 >> v2:172.21.15.110:3300/0 conn(0x7f2f80065660 0x7f2f800a6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.590+0000 7f2f87c00700 1 -- 172.21.15.49:0/3592677326 >> 172.21.15.49:0/3592677326 conn(0x7f2f800c87f0 msgr2=0x7f2f800c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:29.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.590+0000 7f2f87c00700 1 -- 172.21.15.49:0/3592677326 shutdown_connections 2024-01-22T05:04:29.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.590+0000 7f2f87c00700 1 -- 172.21.15.49:0/3592677326 wait complete. 2024-01-22T05:04:29.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.594+0000 7f2f87c00700 1 Processor -- start 2024-01-22T05:04:29.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.594+0000 7f2f87c00700 1 -- start start 2024-01-22T05:04:29.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.594+0000 7f2f87c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f800644f0 0x7f2f800a8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:29.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.594+0000 7f2f87c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f80064950 0x7f2f80167af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:29.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.594+0000 7f2f87c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f80065660 0x7f2f80148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:29.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.594+0000 7f2f87c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800a80a0 con 0x7f2f80064950 2024-01-22T05:04:29.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.594+0000 7f2f87c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800a7490 con 0x7f2f80065660 2024-01-22T05:04:29.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.594+0000 7f2f87c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800a7770 con 0x7f2f800644f0 2024-01-22T05:04:29.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.594+0000 7f2f7fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f80064950 0x7f2f80167af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:29.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.594+0000 7f2f85200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f800644f0 0x7f2f800a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:29.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.594+0000 7f2f86600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f80065660 0x7f2f80148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:29.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.594+0000 7f2f7fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f80064950 0x7f2f80167af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34406/0 (socket says 172.21.15.49:34406) 2024-01-22T05:04:29.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.594+0000 7f2f7fe00700 1 -- 172.21.15.49:0/2551649647 learned_addr learned my addr 172.21.15.49:0/2551649647 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:29.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.598+0000 7f2f7fe00700 1 -- 172.21.15.49:0/2551649647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f800644f0 msgr2=0x7f2f800a8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:29.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.598+0000 7f2f7fe00700 1 --2- 172.21.15.49:0/2551649647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f800644f0 0x7f2f800a8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.598+0000 7f2f7fe00700 1 -- 172.21.15.49:0/2551649647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f80065660 msgr2=0x7f2f80148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:29.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.598+0000 7f2f7fe00700 1 --2- 172.21.15.49:0/2551649647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f80065660 0x7f2f80148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.598+0000 7f2f7fe00700 1 -- 172.21.15.49:0/2551649647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f78009a20 con 0x7f2f80064950 2024-01-22T05:04:29.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.598+0000 7f2f7fe00700 1 --2- 172.21.15.49:0/2551649647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f80064950 0x7f2f80167af0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2f6800c810 tx=0x7f2f68001aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:29.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.598+0000 7f2f77e00700 1 -- 172.21.15.49:0/2551649647 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68007170 con 0x7f2f80064950 2024-01-22T05:04:29.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.598+0000 7f2f77e00700 1 -- 172.21.15.49:0/2551649647 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f680072d0 con 0x7f2f80064950 2024-01-22T05:04:29.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.598+0000 7f2f87c00700 1 -- 172.21.15.49:0/2551649647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f800a7a50 con 0x7f2f80064950 2024-01-22T05:04:29.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.598+0000 7f2f77e00700 1 -- 172.21.15.49:0/2551649647 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f680048c0 con 0x7f2f80064950 2024-01-22T05:04:29.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.598+0000 7f2f87c00700 1 -- 172.21.15.49:0/2551649647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f80167fe0 con 0x7f2f80064950 2024-01-22T05:04:29.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.598+0000 7f2f87c00700 1 -- 172.21.15.49:0/2551649647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f80047060 con 0x7f2f80064950 2024-01-22T05:04:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.602+0000 7f2f77e00700 1 -- 172.21.15.49:0/2551649647 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2f68004cb0 con 0x7f2f80064950 2024-01-22T05:04:29.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.602+0000 7f2f77e00700 1 --2- 172.21.15.49:0/2551649647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f5805a540 0x7f2f5805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:29.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.602+0000 7f2f77e00700 1 -- 172.21.15.49:0/2551649647 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2f68073ec0 con 0x7f2f80064950 2024-01-22T05:04:29.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.602+0000 7f2f85200700 1 --2- 172.21.15.49:0/2551649647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f5805a540 0x7f2f5805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:29.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.602+0000 7f2f85200700 1 --2- 172.21.15.49:0/2551649647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f5805a540 0x7f2f5805ca00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2f70009b90 tx=0x7f2f70009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:29.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.610+0000 7f2f77e00700 1 -- 172.21.15.49:0/2551649647 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2f68047930 con 0x7f2f80064950 2024-01-22T05:04:29.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.782+0000 7f2f87c00700 1 -- 172.21.15.49:0/2551649647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f800c2ef0 con 0x7f2f80064950 2024-01-22T05:04:29.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.782+0000 7f2f77e00700 1 -- 172.21.15.49:0/2551649647 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13722 (secure 0 0 0) 0x7f2f6804af50 con 0x7f2f80064950 2024-01-22T05:04:29.788 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:29.788 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:29.370312+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:04:29.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.786+0000 7f2f87c00700 1 -- 172.21.15.49:0/2551649647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f5805a540 msgr2=0x7f2f5805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:29.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.786+0000 7f2f87c00700 1 --2- 172.21.15.49:0/2551649647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f5805a540 0x7f2f5805ca00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2f70009b90 tx=0x7f2f70009060).stop 2024-01-22T05:04:29.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.786+0000 7f2f87c00700 1 -- 172.21.15.49:0/2551649647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f80064950 msgr2=0x7f2f80167af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:29.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.786+0000 7f2f87c00700 1 --2- 172.21.15.49:0/2551649647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f80064950 0x7f2f80167af0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2f6800c810 tx=0x7f2f68001aa0).stop 2024-01-22T05:04:29.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.786+0000 7f2f87c00700 1 -- 172.21.15.49:0/2551649647 shutdown_connections 2024-01-22T05:04:29.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.786+0000 7f2f87c00700 1 --2- 172.21.15.49:0/2551649647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f5805a540 0x7f2f5805ca00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.786+0000 7f2f87c00700 1 --2- 172.21.15.49:0/2551649647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f80065660 0x7f2f80148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.786+0000 7f2f87c00700 1 --2- 172.21.15.49:0/2551649647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f80064950 0x7f2f80167af0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.786+0000 7f2f87c00700 1 --2- 172.21.15.49:0/2551649647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f800644f0 0x7f2f800a8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.786+0000 7f2f87c00700 1 -- 172.21.15.49:0/2551649647 >> 172.21.15.49:0/2551649647 conn(0x7f2f800c87f0 msgr2=0x7f2f800a3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:29.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.786+0000 7f2f87c00700 1 -- 172.21.15.49:0/2551649647 shutdown_connections 2024-01-22T05:04:29.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.786+0000 7f2f87c00700 1 -- 172.21.15.49:0/2551649647 wait complete. 2024-01-22T05:04:29.818 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:04:29.819 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:04:29.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.978+0000 7f3606200700 1 Processor -- start 2024-01-22T05:04:29.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.978+0000 7f3606200700 1 -- start start 2024-01-22T05:04:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.982+0000 7f3606200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3600064530 0x7f3600069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.982+0000 7f3606200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36000bc700 con 0x7f36000c3ab0 2024-01-22T05:04:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.982+0000 7f3606200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360006a420 con 0x7f36000bcb90 2024-01-22T05:04:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.982+0000 7f3606200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3600150d20 con 0x7f3600064530 2024-01-22T05:04:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.982+0000 7f35ff400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f36000c3ab0 0x7f3600063e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43634/0 (socket says 172.21.15.49:43634) 2024-01-22T05:04:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.982+0000 7f35ff400700 1 -- 172.21.15.49:0/2708267263 learned_addr learned my addr 172.21.15.49:0/2708267263 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.982+0000 7f35fea00700 1 --2- 172.21.15.49:0/2708267263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3600064530 0x7f3600069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.982+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310006547 0 0) 0x7f36000bc700 con 0x7f36000c3ab0 2024-01-22T05:04:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.982+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35e00033f0 con 0x7f36000c3ab0 2024-01-22T05:04:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.982+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668343817 0 0) 0x7f360006a420 con 0x7f36000bcb90 2024-01-22T05:04:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.982+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36000bc700 con 0x7f36000bcb90 2024-01-22T05:04:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.982+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 266683131 0 0) 0x7f35e00033f0 con 0x7f36000c3ab0 2024-01-22T05:04:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3600064530 msgr2=0x7f3600069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fe000700 1 --2- 172.21.15.49:0/2708267263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3600064530 0x7f3600069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 >> v1:172.21.15.110:6789/0 conn(0x7f36000bcb90 legacy=0x7f36000bcfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600068fc0 con 0x7f36000c3ab0 2024-01-22T05:04:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f35f0001470 con 0x7f36000c3ab0 2024-01-22T05:04:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 >> v1:172.21.15.49:6789/0 conn(0x7f36000c3ab0 legacy=0x7f3600063e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fe000700 1 --2- 172.21.15.49:0/2708267263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e0004b00 0x7f35e0004f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fe000700 1 --2- 172.21.15.49:0/2708267263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3600064530 0x7f35e0003630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fe000700 1 --2- 172.21.15.49:0/2708267263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35e0003b20 0x7f35e0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3600150d20 con 0x7f35e0003b20 2024-01-22T05:04:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e000db20 con 0x7f35e0004b00 2024-01-22T05:04:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e000dce0 con 0x7f3600064530 2024-01-22T05:04:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35ff400700 1 --2- 172.21.15.49:0/2708267263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e0004b00 0x7f35e0004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35ffe00700 1 --2- 172.21.15.49:0/2708267263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35e0003b20 0x7f35e0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fea00700 1 --2- 172.21.15.49:0/2708267263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3600064530 0x7f35e0003630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35ffe00700 1 -- 172.21.15.49:0/2708267263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3600064530 msgr2=0x7f35e0003630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:29.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35ffe00700 1 --2- 172.21.15.49:0/2708267263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3600064530 0x7f35e0003630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35ffe00700 1 -- 172.21.15.49:0/2708267263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e0004b00 msgr2=0x7f35e0004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:29.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35ffe00700 1 --2- 172.21.15.49:0/2708267263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e0004b00 0x7f35e0004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:29.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35ffe00700 1 -- 172.21.15.49:0/2708267263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e00033f0 con 0x7f35e0003b20 2024-01-22T05:04:29.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35ffe00700 1 --2- 172.21.15.49:0/2708267263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35e0003b20 0x7f35e0003fa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f35f8001f90 tx=0x7f35f8007f30).ready entity=mon.0 client_cookie=2767bd9dfa055564 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:29.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f80020f0 con 0x7f35e0003b20 2024-01-22T05:04:29.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f8006a20 con 0x7f35e0003b20 2024-01-22T05:04:29.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35fe000700 1 -- 172.21.15.49:0/2708267263 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f8006dc0 con 0x7f35e0003b20 2024-01-22T05:04:29.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f3606200700 1 -- 172.21.15.49:0/2708267263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35e0003b20 msgr2=0x7f35e0003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:29.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f3606200700 1 --2- 172.21.15.49:0/2708267263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35e0003b20 0x7f35e0003fa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f35f8001f90 tx=0x7f35f8007f30).stop 2024-01-22T05:04:29.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.986+0000 7f35ffe00700 1 -- 172.21.15.49:0/2708267263 reap_dead start 2024-01-22T05:04:29.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.990+0000 7f3606200700 1 -- 172.21.15.49:0/2708267263 shutdown_connections 2024-01-22T05:04:29.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.990+0000 7f3606200700 1 -- 172.21.15.49:0/2708267263 >> 172.21.15.49:0/2708267263 conn(0x7f3600066810 msgr2=0x7f3600066bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:29.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.990+0000 7f3606200700 1 -- 172.21.15.49:0/2708267263 shutdown_connections 2024-01-22T05:04:29.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.990+0000 7f3606200700 1 -- 172.21.15.49:0/2708267263 wait complete. 2024-01-22T05:04:29.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.994+0000 7f3606200700 1 Processor -- start 2024-01-22T05:04:29.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.994+0000 7f3606200700 1 -- start start 2024-01-22T05:04:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.994+0000 7f3606200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e0003b20 0x7f36001534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.994+0000 7f3606200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36000ab000 0x7f36000ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.994+0000 7f3606200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f360016b960 0x7f360016bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.994+0000 7f3606200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36000ac000 con 0x7f36000ab000 2024-01-22T05:04:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.994+0000 7f3606200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36001694a0 con 0x7f35e0003b20 2024-01-22T05:04:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.994+0000 7f3606200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3600155610 con 0x7f360016b960 2024-01-22T05:04:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.994+0000 7f35fea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36000ab000 0x7f36000ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.994+0000 7f35fea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36000ab000 0x7f36000ab480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34430/0 (socket says 172.21.15.49:34430) 2024-01-22T05:04:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.994+0000 7f35fea00700 1 -- 172.21.15.49:0/3827056221 learned_addr learned my addr 172.21.15.49:0/3827056221 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.994+0000 7f35ff400700 1 --2- 172.21.15.49:0/3827056221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e0003b20 0x7f36001534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.994+0000 7f35ffe00700 1 --2- 172.21.15.49:0/3827056221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f360016b960 0x7f360016bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.994+0000 7f35ff400700 1 -- 172.21.15.49:0/3827056221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f360016b960 msgr2=0x7f360016bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.998+0000 7f35ff400700 1 --2- 172.21.15.49:0/3827056221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f360016b960 0x7f360016bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.998+0000 7f35ff400700 1 -- 172.21.15.49:0/3827056221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36000ab000 msgr2=0x7f36000ab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.998+0000 7f35ff400700 1 --2- 172.21.15.49:0/3827056221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36000ab000 0x7f36000ab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.998+0000 7f35ff400700 1 -- 172.21.15.49:0/3827056221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600155020 con 0x7f35e0003b20 2024-01-22T05:04:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.998+0000 7f35fea00700 1 --2- 172.21.15.49:0/3827056221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36000ab000 0x7f36000ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.998+0000 7f35ff400700 1 --2- 172.21.15.49:0/3827056221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e0003b20 0x7f36001534e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f35f00077c0 tx=0x7f35f0001e10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.998+0000 7f35f6a00700 1 -- 172.21.15.49:0/3827056221 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f00114c0 con 0x7f35e0003b20 2024-01-22T05:04:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.998+0000 7f35f6a00700 1 -- 172.21.15.49:0/3827056221 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f0011640 con 0x7f35e0003b20 2024-01-22T05:04:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.998+0000 7f3606200700 1 -- 172.21.15.49:0/3827056221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360016c2b0 con 0x7f35e0003b20 2024-01-22T05:04:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.998+0000 7f35f6a00700 1 -- 172.21.15.49:0/3827056221 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0011a00 con 0x7f35e0003b20 2024-01-22T05:04:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.998+0000 7f3606200700 1 -- 172.21.15.49:0/3827056221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36000abaf0 con 0x7f35e0003b20 2024-01-22T05:04:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:29.998+0000 7f3606200700 1 -- 172.21.15.49:0/3827056221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3600065790 con 0x7f35e0003b20 2024-01-22T05:04:30.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.002+0000 7f35f6a00700 1 -- 172.21.15.49:0/3827056221 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f35f001d3b0 con 0x7f35e0003b20 2024-01-22T05:04:30.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.002+0000 7f35f6a00700 1 --2- 172.21.15.49:0/3827056221 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f35d805a510 0x7f35d805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.002+0000 7f35f6a00700 1 -- 172.21.15.49:0/3827056221 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f35f0073d20 con 0x7f35e0003b20 2024-01-22T05:04:30.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.002+0000 7f35fea00700 1 --2- 172.21.15.49:0/3827056221 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f35d805a510 0x7f35d805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.002+0000 7f35fea00700 1 --2- 172.21.15.49:0/3827056221 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f35d805a510 0x7f35d805c9d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f35e8006d30 tx=0x7f35e8009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:30.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.010+0000 7f35f6a00700 1 -- 172.21.15.49:0/3827056221 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f35f0047730 con 0x7f35e0003b20 2024-01-22T05:04:30.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.182+0000 7f3606200700 1 -- 172.21.15.49:0/3827056221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3600069260 con 0x7f35e0003b20 2024-01-22T05:04:30.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.186+0000 7f35f6a00700 1 -- 172.21.15.49:0/3827056221 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v16) v1 ==== 110+0+10 (secure 0 0 0) 0x7f35f0019020 con 0x7f35e0003b20 2024-01-22T05:04:30.190 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:04:30.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.186+0000 7f3606200700 1 -- 172.21.15.49:0/3827056221 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f35d805a510 msgr2=0x7f35d805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:30.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.186+0000 7f3606200700 1 --2- 172.21.15.49:0/3827056221 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f35d805a510 0x7f35d805c9d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f35e8006d30 tx=0x7f35e8009060).stop 2024-01-22T05:04:30.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.186+0000 7f3606200700 1 -- 172.21.15.49:0/3827056221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e0003b20 msgr2=0x7f36001534e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:30.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.186+0000 7f3606200700 1 --2- 172.21.15.49:0/3827056221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e0003b20 0x7f36001534e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f35f00077c0 tx=0x7f35f0001e10).stop 2024-01-22T05:04:30.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.186+0000 7f3606200700 1 -- 172.21.15.49:0/3827056221 shutdown_connections 2024-01-22T05:04:30.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.186+0000 7f3606200700 1 --2- 172.21.15.49:0/3827056221 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f35d805a510 0x7f35d805c9d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.186+0000 7f3606200700 1 --2- 172.21.15.49:0/3827056221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f360016b960 0x7f360016bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.186+0000 7f3606200700 1 --2- 172.21.15.49:0/3827056221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36000ab000 0x7f36000ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.186+0000 7f3606200700 1 --2- 172.21.15.49:0/3827056221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e0003b20 0x7f36001534e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.186+0000 7f3606200700 1 -- 172.21.15.49:0/3827056221 >> 172.21.15.49:0/3827056221 conn(0x7f3600066810 msgr2=0x7f36000c6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:30.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.190+0000 7f3606200700 1 -- 172.21.15.49:0/3827056221 shutdown_connections 2024-01-22T05:04:30.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.190+0000 7f3606200700 1 -- 172.21.15.49:0/3827056221 wait complete. 2024-01-22T05:04:30.217 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:04:30.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.374+0000 7f3bda800700 1 Processor -- start 2024-01-22T05:04:30.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.378+0000 7f3bda800700 1 -- start start 2024-01-22T05:04:30.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bda800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3bd4153cc0 0x7f3bd4068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bda800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3bd4157e00 0x7f3bd40be3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bda800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd4068820 con 0x7f3bd40691a0 2024-01-22T05:04:30.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bda800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd4067c10 con 0x7f3bd4157e00 2024-01-22T05:04:30.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bda800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd4067ef0 con 0x7f3bd4153cc0 2024-01-22T05:04:30.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bd3e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3bd4157e00 0x7f3bd40be3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bd2a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3bd40691a0 0x7f3bd41576f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43644/0 (socket says 172.21.15.49:43644) 2024-01-22T05:04:30.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bd3e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3bd4157e00 0x7f3bd40be3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34436/0 (socket says 172.21.15.49:34436) 2024-01-22T05:04:30.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bd2a00700 1 -- 172.21.15.49:0/2763286772 learned_addr learned my addr 172.21.15.49:0/2763286772 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:30.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bd3400700 1 --2- 172.21.15.49:0/2763286772 >> v2:172.21.15.110:3300/0 conn(0x7f3bd4153cc0 0x7f3bd4068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bd2000700 1 -- 172.21.15.49:0/2763286772 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513108208 0 0) 0x7f3bd4068820 con 0x7f3bd40691a0 2024-01-22T05:04:30.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bd2000700 1 -- 172.21.15.49:0/2763286772 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bb40033f0 con 0x7f3bd40691a0 2024-01-22T05:04:30.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bd3400700 1 -- 172.21.15.49:0/2763286772 >> v2:172.21.15.49:3300/0 conn(0x7f3bd4157e00 msgr2=0x7f3bd40be3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:30.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bd3400700 1 --2- 172.21.15.49:0/2763286772 >> v2:172.21.15.49:3300/0 conn(0x7f3bd4157e00 0x7f3bd40be3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bd3400700 1 -- 172.21.15.49:0/2763286772 >> v1:172.21.15.49:6789/0 conn(0x7f3bd40691a0 legacy=0x7f3bd41576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:30.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bd3400700 1 -- 172.21.15.49:0/2763286772 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd40681d0 con 0x7f3bd4153cc0 2024-01-22T05:04:30.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bd3e00700 1 --2- 172.21.15.49:0/2763286772 >> v2:172.21.15.49:3300/0 conn(0x7f3bd4157e00 0x7f3bd40be3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:30.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.382+0000 7f3bd3400700 1 --2- 172.21.15.49:0/2763286772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd4153cc0 0x7f3bd4068cb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3bd40c62f0 tx=0x7f3bc4009060).ready entity=mon.1 client_cookie=8b98ad3f7ace7e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:30.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.390+0000 7f3bd2000700 1 -- 172.21.15.49:0/2763286772 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400d4a0 con 0x7f3bd4153cc0 2024-01-22T05:04:30.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.390+0000 7f3bd2000700 1 -- 172.21.15.49:0/2763286772 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc400d600 con 0x7f3bd4153cc0 2024-01-22T05:04:30.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.390+0000 7f3bd2000700 1 -- 172.21.15.49:0/2763286772 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400d980 con 0x7f3bd4153cc0 2024-01-22T05:04:30.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.390+0000 7f3bda800700 1 -- 172.21.15.49:0/2763286772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd4153cc0 msgr2=0x7f3bd4068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:30.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.390+0000 7f3bda800700 1 --2- 172.21.15.49:0/2763286772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd4153cc0 0x7f3bd4068cb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3bd40c62f0 tx=0x7f3bc4009060).stop 2024-01-22T05:04:30.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.390+0000 7f3bda800700 1 -- 172.21.15.49:0/2763286772 shutdown_connections 2024-01-22T05:04:30.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.390+0000 7f3bda800700 1 --2- 172.21.15.49:0/2763286772 >> v2:172.21.15.49:3300/0 conn(0x7f3bd4157e00 0x7f3bd40be3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.390+0000 7f3bda800700 1 --2- 172.21.15.49:0/2763286772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd4153cc0 0x7f3bd4068cb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.390+0000 7f3bda800700 1 -- 172.21.15.49:0/2763286772 >> 172.21.15.49:0/2763286772 conn(0x7f3bd40c8780 msgr2=0x7f3bd40c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:30.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.390+0000 7f3bda800700 1 -- 172.21.15.49:0/2763286772 shutdown_connections 2024-01-22T05:04:30.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.390+0000 7f3bda800700 1 -- 172.21.15.49:0/2763286772 wait complete. 2024-01-22T05:04:30.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.394+0000 7f3bda800700 1 Processor -- start 2024-01-22T05:04:30.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.394+0000 7f3bda800700 1 -- start start 2024-01-22T05:04:30.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bda800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bd40691a0 0x7f3bd414f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bda800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd4153cc0 0x7f3bd4168c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bda800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd4157e00 0x7f3bd40a9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bda800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd4169290 con 0x7f3bd4153cc0 2024-01-22T05:04:30.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bda800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40c0dd0 con 0x7f3bd4157e00 2024-01-22T05:04:30.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bda800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40c04a0 con 0x7f3bd40691a0 2024-01-22T05:04:30.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bd2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd4153cc0 0x7f3bd4168c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bd3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd4157e00 0x7f3bd40a9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bd3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bd40691a0 0x7f3bd414f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bd3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd4157e00 0x7f3bd40a9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:59880/0 (socket says 172.21.15.49:59880) 2024-01-22T05:04:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bd3e00700 1 -- 172.21.15.49:0/1351821078 learned_addr learned my addr 172.21.15.49:0/1351821078 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bd3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bd40691a0 0x7f3bd414f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:37844/0 (socket says 172.21.15.49:37844) 2024-01-22T05:04:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bd3400700 1 -- 172.21.15.49:0/1351821078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd4157e00 msgr2=0x7f3bd40a9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bd3400700 1 --2- 172.21.15.49:0/1351821078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd4157e00 0x7f3bd40a9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bd3400700 1 -- 172.21.15.49:0/1351821078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd4153cc0 msgr2=0x7f3bd4168c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bd3400700 1 --2- 172.21.15.49:0/1351821078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd4153cc0 0x7f3bd4168c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bd3400700 1 -- 172.21.15.49:0/1351821078 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc009a20 con 0x7f3bd40691a0 2024-01-22T05:04:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bd3e00700 1 --2- 172.21.15.49:0/1351821078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd4157e00 0x7f3bd40a9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.398+0000 7f3bd3400700 1 --2- 172.21.15.49:0/1351821078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bd40691a0 0x7f3bd414f590 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3bc4013000 tx=0x7f3bc4016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.402+0000 7f3bcaa00700 1 -- 172.21.15.49:0/1351821078 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400dd30 con 0x7f3bd40691a0 2024-01-22T05:04:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.402+0000 7f3bcaa00700 1 -- 172.21.15.49:0/1351821078 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc400de90 con 0x7f3bd40691a0 2024-01-22T05:04:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.402+0000 7f3bda800700 1 -- 172.21.15.49:0/1351821078 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc40092a0 con 0x7f3bd40691a0 2024-01-22T05:04:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.402+0000 7f3bcaa00700 1 -- 172.21.15.49:0/1351821078 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400d9c0 con 0x7f3bd40691a0 2024-01-22T05:04:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.402+0000 7f3bda800700 1 -- 172.21.15.49:0/1351821078 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd40c0a60 con 0x7f3bd40691a0 2024-01-22T05:04:30.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.402+0000 7f3bda800700 1 -- 172.21.15.49:0/1351821078 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd40684b0 con 0x7f3bd40691a0 2024-01-22T05:04:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.406+0000 7f3bcaa00700 1 -- 172.21.15.49:0/1351821078 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3bc40263b0 con 0x7f3bd40691a0 2024-01-22T05:04:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.406+0000 7f3bcaa00700 1 --2- 172.21.15.49:0/1351821078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3bac05a510 0x7f3bac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.406+0000 7f3bcaa00700 1 -- 172.21.15.49:0/1351821078 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f3bc4075270 con 0x7f3bd40691a0 2024-01-22T05:04:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.406+0000 7f3bd2a00700 1 --2- 172.21.15.49:0/1351821078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3bac05a510 0x7f3bac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.406+0000 7f3bd2a00700 1 --2- 172.21.15.49:0/1351821078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3bac05a510 0x7f3bac05c9d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3bbc007fd0 tx=0x7f3bbc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:30.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.418+0000 7f3bcaa00700 1 -- 172.21.15.49:0/1351821078 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3bc4048c80 con 0x7f3bd40691a0 2024-01-22T05:04:30.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.590+0000 7f3bda800700 1 -- 172.21.15.49:0/1351821078 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3bd4046800 con 0x7f3bd40691a0 2024-01-22T05:04:30.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.590+0000 7f3bcaa00700 1 -- 172.21.15.49:0/1351821078 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3bc40220a0 con 0x7f3bd40691a0 2024-01-22T05:04:30.597 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:04:30.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.594+0000 7f3bda800700 1 -- 172.21.15.49:0/1351821078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3bac05a510 msgr2=0x7f3bac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:30.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.594+0000 7f3bda800700 1 --2- 172.21.15.49:0/1351821078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3bac05a510 0x7f3bac05c9d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3bbc007fd0 tx=0x7f3bbc009040).stop 2024-01-22T05:04:30.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.594+0000 7f3bda800700 1 -- 172.21.15.49:0/1351821078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bd40691a0 msgr2=0x7f3bd414f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:30.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.594+0000 7f3bda800700 1 --2- 172.21.15.49:0/1351821078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bd40691a0 0x7f3bd414f590 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3bc4013000 tx=0x7f3bc4016000).stop 2024-01-22T05:04:30.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.594+0000 7f3bda800700 1 -- 172.21.15.49:0/1351821078 shutdown_connections 2024-01-22T05:04:30.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.594+0000 7f3bda800700 1 --2- 172.21.15.49:0/1351821078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3bac05a510 0x7f3bac05c9d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.594+0000 7f3bda800700 1 --2- 172.21.15.49:0/1351821078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd4157e00 0x7f3bd40a9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.594+0000 7f3bda800700 1 --2- 172.21.15.49:0/1351821078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd4153cc0 0x7f3bd4168c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.594+0000 7f3bda800700 1 --2- 172.21.15.49:0/1351821078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bd40691a0 0x7f3bd414f590 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.594+0000 7f3bda800700 1 -- 172.21.15.49:0/1351821078 >> 172.21.15.49:0/1351821078 conn(0x7f3bd40c8780 msgr2=0x7f3bd40c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:30.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.594+0000 7f3bda800700 1 -- 172.21.15.49:0/1351821078 shutdown_connections 2024-01-22T05:04:30.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.594+0000 7f3bda800700 1 -- 172.21.15.49:0/1351821078 wait complete. 2024-01-22T05:04:30.621 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:04:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.770+0000 7f2f4f800700 1 Processor -- start 2024-01-22T05:04:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f4f800700 1 -- start start 2024-01-22T05:04:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f4f800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f48155d20 0x7f2f48065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f4f800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f48066070 0x7f2f480a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f4f800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f480a90e0 con 0x7f2f480a8c30 2024-01-22T05:04:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f4f800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f480c1a40 con 0x7f2f48066070 2024-01-22T05:04:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f4f800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f48159310 con 0x7f2f48155d20 2024-01-22T05:04:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f47e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f48066070 0x7f2f480a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f4d800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2f480a8c30 0x7f2f480c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43652/0 (socket says 172.21.15.49:43652) 2024-01-22T05:04:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f4d800700 1 -- 172.21.15.49:0/587745273 learned_addr learned my addr 172.21.15.49:0/587745273 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f4ce00700 1 --2- 172.21.15.49:0/587745273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f48155d20 0x7f2f48065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f47400700 1 -- 172.21.15.49:0/587745273 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113450802 0 0) 0x7f2f40001490 con 0x7f2f480a8c30 2024-01-22T05:04:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f47400700 1 -- 172.21.15.49:0/587745273 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f280033f0 con 0x7f2f480a8c30 2024-01-22T05:04:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f47e00700 1 -- 172.21.15.49:0/587745273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f48155d20 msgr2=0x7f2f48065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f47e00700 1 --2- 172.21.15.49:0/587745273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f48155d20 0x7f2f48065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f47e00700 1 -- 172.21.15.49:0/587745273 >> v1:172.21.15.49:6789/0 conn(0x7f2f480a8c30 legacy=0x7f2f480c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.774+0000 7f2f47e00700 1 -- 172.21.15.49:0/587745273 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f480c13f0 con 0x7f2f48066070 2024-01-22T05:04:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.778+0000 7f2f47e00700 1 --2- 172.21.15.49:0/587745273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f48066070 0x7f2f480a8740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2f30009760 tx=0x7f2f30009060).ready entity=mon.0 client_cookie=2fe4e6637a1037b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.778+0000 7f2f47400700 1 -- 172.21.15.49:0/587745273 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000d4a0 con 0x7f2f48066070 2024-01-22T05:04:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.778+0000 7f2f47400700 1 -- 172.21.15.49:0/587745273 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3000d600 con 0x7f2f48066070 2024-01-22T05:04:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.778+0000 7f2f47400700 1 -- 172.21.15.49:0/587745273 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000d980 con 0x7f2f48066070 2024-01-22T05:04:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.778+0000 7f2f4f800700 1 -- 172.21.15.49:0/587745273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f48066070 msgr2=0x7f2f480a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.778+0000 7f2f4f800700 1 --2- 172.21.15.49:0/587745273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f48066070 0x7f2f480a8740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2f30009760 tx=0x7f2f30009060).stop 2024-01-22T05:04:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.778+0000 7f2f4f800700 1 -- 172.21.15.49:0/587745273 shutdown_connections 2024-01-22T05:04:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.778+0000 7f2f4f800700 1 --2- 172.21.15.49:0/587745273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f48066070 0x7f2f480a8740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.778+0000 7f2f4f800700 1 --2- 172.21.15.49:0/587745273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f48155d20 0x7f2f48065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.778+0000 7f2f4f800700 1 -- 172.21.15.49:0/587745273 >> 172.21.15.49:0/587745273 conn(0x7f2f480c6540 msgr2=0x7f2f480c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.778+0000 7f2f4f800700 1 -- 172.21.15.49:0/587745273 shutdown_connections 2024-01-22T05:04:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.778+0000 7f2f4f800700 1 -- 172.21.15.49:0/587745273 wait complete. 2024-01-22T05:04:30.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.782+0000 7f2f4f800700 1 Processor -- start 2024-01-22T05:04:30.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.782+0000 7f2f4f800700 1 -- start start 2024-01-22T05:04:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.782+0000 7f2f4f800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f48066070 0x7f2f481532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.782+0000 7f2f4f800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f480a8c30 0x7f2f480ab6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.782+0000 7f2f4f800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f48155d20 0x7f2f480c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.782+0000 7f2f4f800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4815b590 con 0x7f2f480a8c30 2024-01-22T05:04:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.782+0000 7f2f4f800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f481518d0 con 0x7f2f48066070 2024-01-22T05:04:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.782+0000 7f2f4f800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480abed0 con 0x7f2f48155d20 2024-01-22T05:04:30.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f47e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f480a8c30 0x7f2f480ab6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f4d800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f48155d20 0x7f2f480c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f47e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f480a8c30 0x7f2f480ab6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34458/0 (socket says 172.21.15.49:34458) 2024-01-22T05:04:30.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f47e00700 1 -- 172.21.15.49:0/1183056431 learned_addr learned my addr 172.21.15.49:0/1183056431 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:30.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f4ce00700 1 --2- 172.21.15.49:0/1183056431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f48066070 0x7f2f481532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f47e00700 1 -- 172.21.15.49:0/1183056431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f48155d20 msgr2=0x7f2f480c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:30.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f47e00700 1 --2- 172.21.15.49:0/1183056431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f48155d20 0x7f2f480c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f47e00700 1 -- 172.21.15.49:0/1183056431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f48066070 msgr2=0x7f2f481532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:30.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f47e00700 1 --2- 172.21.15.49:0/1183056431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f48066070 0x7f2f481532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:30.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f47e00700 1 -- 172.21.15.49:0/1183056431 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f300092a0 con 0x7f2f480a8c30 2024-01-22T05:04:30.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f4ce00700 1 --2- 172.21.15.49:0/1183056431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f48066070 0x7f2f481532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:30.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f47e00700 1 --2- 172.21.15.49:0/1183056431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f480a8c30 0x7f2f480ab6f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2f48059c60 tx=0x7f2f30016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:30.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f3fe00700 1 -- 172.21.15.49:0/1183056431 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000dd30 con 0x7f2f480a8c30 2024-01-22T05:04:30.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f3fe00700 1 -- 172.21.15.49:0/1183056431 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3000de90 con 0x7f2f480a8c30 2024-01-22T05:04:30.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f4f800700 1 -- 172.21.15.49:0/1183056431 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f480ac1b0 con 0x7f2f480a8c30 2024-01-22T05:04:30.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f3fe00700 1 -- 172.21.15.49:0/1183056431 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000d980 con 0x7f2f480a8c30 2024-01-22T05:04:30.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.786+0000 7f2f4f800700 1 -- 172.21.15.49:0/1183056431 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f48151b90 con 0x7f2f480a8c30 2024-01-22T05:04:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.790+0000 7f2f4f800700 1 -- 172.21.15.49:0/1183056431 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f48151d80 con 0x7f2f480a8c30 2024-01-22T05:04:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.790+0000 7f2f3fe00700 1 -- 172.21.15.49:0/1183056431 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2f3001d640 con 0x7f2f480a8c30 2024-01-22T05:04:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.790+0000 7f2f3fe00700 1 --2- 172.21.15.49:0/1183056431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f2005a510 0x7f2f2005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.790+0000 7f2f3fe00700 1 -- 172.21.15.49:0/1183056431 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2f30075c00 con 0x7f2f480a8c30 2024-01-22T05:04:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.790+0000 7f2f4ce00700 1 --2- 172.21.15.49:0/1183056431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f2005a510 0x7f2f2005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.790+0000 7f2f4ce00700 1 --2- 172.21.15.49:0/1183056431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f2005a510 0x7f2f2005c9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2f38009f90 tx=0x7f2f38009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:30.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.798+0000 7f2f3fe00700 1 -- 172.21.15.49:0/1183056431 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2f30049670 con 0x7f2f480a8c30 2024-01-22T05:04:31.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.994+0000 7f2f4f800700 1 -- 172.21.15.49:0/1183056431 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f48047060 con 0x7f2f480a8c30 2024-01-22T05:04:31.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.998+0000 7f2f3fe00700 1 -- 172.21.15.49:0/1183056431 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f2f3004cc90 con 0x7f2f480a8c30 2024-01-22T05:04:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:31.002 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/4240919875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4240919875},{"type":"v1","addr":"172.21.15.49:6836","nonce":4240919875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3591660134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3591660134},{"type":"v1","addr":"172.21.15.49:6837","nonce":3591660134}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1228202507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1228202507},{"type":"v1","addr":"172.21.15.110:6833","nonce":1228202507}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3391981756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3391981756},{"type":"v1","addr":"172.21.15.110:6835","nonce":3391981756}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-01-22T05:04:31.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.998+0000 7f2f4f800700 1 -- 172.21.15.49:0/1183056431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f2005a510 msgr2=0x7f2f2005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.998+0000 7f2f4f800700 1 --2- 172.21.15.49:0/1183056431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f2005a510 0x7f2f2005c9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2f38009f90 tx=0x7f2f38009060).stop 2024-01-22T05:04:31.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.998+0000 7f2f4f800700 1 -- 172.21.15.49:0/1183056431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f480a8c30 msgr2=0x7f2f480ab6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.998+0000 7f2f4f800700 1 --2- 172.21.15.49:0/1183056431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f480a8c30 0x7f2f480ab6f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2f48059c60 tx=0x7f2f30016000).stop 2024-01-22T05:04:31.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.998+0000 7f2f4f800700 1 -- 172.21.15.49:0/1183056431 shutdown_connections 2024-01-22T05:04:31.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.998+0000 7f2f4f800700 1 --2- 172.21.15.49:0/1183056431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f2005a510 0x7f2f2005c9d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.998+0000 7f2f4f800700 1 --2- 172.21.15.49:0/1183056431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f48155d20 0x7f2f480c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.998+0000 7f2f4f800700 1 --2- 172.21.15.49:0/1183056431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f480a8c30 0x7f2f480ab6f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.998+0000 7f2f4f800700 1 --2- 172.21.15.49:0/1183056431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f48066070 0x7f2f481532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:30.998+0000 7f2f4f800700 1 -- 172.21.15.49:0/1183056431 >> 172.21.15.49:0/1183056431 conn(0x7f2f480c6540 msgr2=0x7f2f48067b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:31.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.002+0000 7f2f4f800700 1 -- 172.21.15.49:0/1183056431 shutdown_connections 2024-01-22T05:04:31.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.002+0000 7f2f4f800700 1 -- 172.21.15.49:0/1183056431 wait complete. 2024-01-22T05:04:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 3 2024-01-22T05:04:31.029 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:04:31.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.174+0000 7fbe17a00700 1 Processor -- start 2024-01-22T05:04:31.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.174+0000 7fbe17a00700 1 -- start start 2024-01-22T05:04:31.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe17a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe10065240 0x7fbe100644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe17a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe10064e90 con 0x7fbe10065620 2024-01-22T05:04:31.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe17a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1015c7d0 con 0x7fbe100649e0 2024-01-22T05:04:31.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe17a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100c2700 con 0x7fbe10065240 2024-01-22T05:04:31.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0fe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbe10065620 0x7fbe1015b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43660/0 (socket says 172.21.15.49:43660) 2024-01-22T05:04:31.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0fe00700 1 -- 172.21.15.49:0/4030051979 learned_addr learned my addr 172.21.15.49:0/4030051979 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:31.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe15000700 1 --2- 172.21.15.49:0/4030051979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe10065240 0x7fbe100644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0f400700 1 -- 172.21.15.49:0/4030051979 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587206870 0 0) 0x7fbdf8001110 con 0x7fbe10065620 2024-01-22T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0f400700 1 -- 172.21.15.49:0/4030051979 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf00033f0 con 0x7fbe10065620 2024-01-22T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0f400700 1 -- 172.21.15.49:0/4030051979 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 813025181 0 0) 0x7fbdf00033f0 con 0x7fbe10065620 2024-01-22T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0f400700 1 -- 172.21.15.49:0/4030051979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe10065240 msgr2=0x7fbe100644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0f400700 1 --2- 172.21.15.49:0/4030051979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe10065240 0x7fbe100644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0f400700 1 -- 172.21.15.49:0/4030051979 >> v1:172.21.15.110:6789/0 conn(0x7fbe100649e0 legacy=0x7fbe1015c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0f400700 1 -- 172.21.15.49:0/4030051979 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe100c29a0 con 0x7fbe10065620 2024-01-22T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0f400700 1 -- 172.21.15.49:0/4030051979 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fbdf8001600 con 0x7fbe10065620 2024-01-22T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0f400700 1 -- 172.21.15.49:0/4030051979 >> v1:172.21.15.49:6789/0 conn(0x7fbe10065620 legacy=0x7fbe1015b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0f400700 1 --2- 172.21.15.49:0/4030051979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe10065240 0x7fbdf0003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0f400700 1 --2- 172.21.15.49:0/4030051979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf0003e00 0x7fbdf0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0f400700 1 --2- 172.21.15.49:0/4030051979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf0004b80 0x7fbdf0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0f400700 1 -- 172.21.15.49:0/4030051979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100c2700 con 0x7fbdf0003e00 2024-01-22T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0f400700 1 -- 172.21.15.49:0/4030051979 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf000b8e0 con 0x7fbdf0004b80 2024-01-22T05:04:31.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0f400700 1 -- 172.21.15.49:0/4030051979 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf000baa0 con 0x7fbe10065240 2024-01-22T05:04:31.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.178+0000 7fbe0fe00700 1 --2- 172.21.15.49:0/4030051979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf0003e00 0x7fbdf0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe15000700 1 --2- 172.21.15.49:0/4030051979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe10065240 0x7fbdf0003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe16400700 1 --2- 172.21.15.49:0/4030051979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf0004b80 0x7fbdf0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe0fe00700 1 -- 172.21.15.49:0/4030051979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe10065240 msgr2=0x7fbdf0003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe0fe00700 1 --2- 172.21.15.49:0/4030051979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe10065240 0x7fbdf0003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe0fe00700 1 -- 172.21.15.49:0/4030051979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf0004b80 msgr2=0x7fbdf0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe0fe00700 1 --2- 172.21.15.49:0/4030051979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf0004b80 0x7fbdf0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe0fe00700 1 -- 172.21.15.49:0/4030051979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf00033f0 con 0x7fbdf0003e00 2024-01-22T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe0fe00700 1 --2- 172.21.15.49:0/4030051979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf0003e00 0x7fbdf0004690 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fbdf800c2a0 tx=0x7fbdf8007850).ready entity=mon.0 client_cookie=50794e28d610ebff server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe0f400700 1 -- 172.21.15.49:0/4030051979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8007b60 con 0x7fbdf0003e00 2024-01-22T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe0f400700 1 -- 172.21.15.49:0/4030051979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf800cbd0 con 0x7fbdf0003e00 2024-01-22T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe0f400700 1 -- 172.21.15.49:0/4030051979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf80070d0 con 0x7fbdf0003e00 2024-01-22T05:04:31.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe17a00700 1 -- 172.21.15.49:0/4030051979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf0003e00 msgr2=0x7fbdf0004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe17a00700 1 --2- 172.21.15.49:0/4030051979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf0003e00 0x7fbdf0004690 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fbdf800c2a0 tx=0x7fbdf8007850).stop 2024-01-22T05:04:31.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe16400700 1 -- 172.21.15.49:0/4030051979 reap_dead start 2024-01-22T05:04:31.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe17a00700 1 -- 172.21.15.49:0/4030051979 shutdown_connections 2024-01-22T05:04:31.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe17a00700 1 -- 172.21.15.49:0/4030051979 >> 172.21.15.49:0/4030051979 conn(0x7fbe100c87f0 msgr2=0x7fbe100c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:31.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe17a00700 1 -- 172.21.15.49:0/4030051979 shutdown_connections 2024-01-22T05:04:31.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.182+0000 7fbe17a00700 1 -- 172.21.15.49:0/4030051979 wait complete. 2024-01-22T05:04:31.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.186+0000 7fbe17a00700 1 Processor -- start 2024-01-22T05:04:31.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe17a00700 1 -- start start 2024-01-22T05:04:31.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe17a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf0003e00 0x7fbe10147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe17a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe100bf7e0 0x7fbe100a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe17a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe100a7c20 0x7fbe100c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe17a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100a8cb0 con 0x7fbe100bf7e0 2024-01-22T05:04:31.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe17a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100a80a0 con 0x7fbe100a7c20 2024-01-22T05:04:31.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe17a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100a8380 con 0x7fbdf0003e00 2024-01-22T05:04:31.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe0fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe100bf7e0 0x7fbe100a7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe0fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe100bf7e0 0x7fbe100a7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34476/0 (socket says 172.21.15.49:34476) 2024-01-22T05:04:31.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe0fe00700 1 -- 172.21.15.49:0/1328939760 learned_addr learned my addr 172.21.15.49:0/1328939760 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:31.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe16400700 1 --2- 172.21.15.49:0/1328939760 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe100a7c20 0x7fbe100c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe15000700 1 --2- 172.21.15.49:0/1328939760 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf0003e00 0x7fbe10147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe0fe00700 1 -- 172.21.15.49:0/1328939760 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf0003e00 msgr2=0x7fbe10147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe0fe00700 1 --2- 172.21.15.49:0/1328939760 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf0003e00 0x7fbe10147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe0fe00700 1 -- 172.21.15.49:0/1328939760 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe100a7c20 msgr2=0x7fbe100c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe0fe00700 1 --2- 172.21.15.49:0/1328939760 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe100a7c20 0x7fbe100c14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe0fe00700 1 -- 172.21.15.49:0/1328939760 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe100a8660 con 0x7fbe100bf7e0 2024-01-22T05:04:31.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe0fe00700 1 --2- 172.21.15.49:0/1328939760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe100bf7e0 0x7fbe100a7730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbdf0004610 tx=0x7fbdf8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:31.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.190+0000 7fbe07e00700 1 -- 172.21.15.49:0/1328939760 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8007440 con 0x7fbe100bf7e0 2024-01-22T05:04:31.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.194+0000 7fbe07e00700 1 -- 172.21.15.49:0/1328939760 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf80075a0 con 0x7fbe100bf7e0 2024-01-22T05:04:31.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.194+0000 7fbe17a00700 1 -- 172.21.15.49:0/1328939760 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe100a8940 con 0x7fbe100bf7e0 2024-01-22T05:04:31.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.194+0000 7fbe07e00700 1 -- 172.21.15.49:0/1328939760 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf80048e0 con 0x7fbe100bf7e0 2024-01-22T05:04:31.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.194+0000 7fbe17a00700 1 -- 172.21.15.49:0/1328939760 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe100c19a0 con 0x7fbe100bf7e0 2024-01-22T05:04:31.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.194+0000 7fbe17a00700 1 -- 172.21.15.49:0/1328939760 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe10047060 con 0x7fbe100bf7e0 2024-01-22T05:04:31.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.194+0000 7fbe07e00700 1 -- 172.21.15.49:0/1328939760 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbdf8004cd0 con 0x7fbe100bf7e0 2024-01-22T05:04:31.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.198+0000 7fbe07e00700 1 --2- 172.21.15.49:0/1328939760 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbde805a510 0x7fbde805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.198+0000 7fbe07e00700 1 -- 172.21.15.49:0/1328939760 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fbdf8075110 con 0x7fbe100bf7e0 2024-01-22T05:04:31.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.198+0000 7fbe15000700 1 --2- 172.21.15.49:0/1328939760 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbde805a510 0x7fbde805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.198+0000 7fbe15000700 1 --2- 172.21.15.49:0/1328939760 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbde805a510 0x7fbde805c9d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fbe00009d60 tx=0x7fbe00008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:31.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.202+0000 7fbe07e00700 1 -- 172.21.15.49:0/1328939760 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbdf8048c30 con 0x7fbe100bf7e0 2024-01-22T05:04:31.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.378+0000 7fbe17a00700 1 -- 172.21.15.49:0/1328939760 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe10064e90 con 0x7fbe100bf7e0 2024-01-22T05:04:31.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.382+0000 7fbe07e00700 1 -- 172.21.15.49:0/1328939760 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13709 (secure 0 0 0) 0x7fbe10064e90 con 0x7fbe100bf7e0 2024-01-22T05:04:31.386 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:31.387 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":17,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:30.384571+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:04:31.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.386+0000 7fbe17a00700 1 -- 172.21.15.49:0/1328939760 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbde805a510 msgr2=0x7fbde805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.386+0000 7fbe17a00700 1 --2- 172.21.15.49:0/1328939760 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbde805a510 0x7fbde805c9d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fbe00009d60 tx=0x7fbe00008040).stop 2024-01-22T05:04:31.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.386+0000 7fbe17a00700 1 -- 172.21.15.49:0/1328939760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe100bf7e0 msgr2=0x7fbe100a7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.386+0000 7fbe17a00700 1 --2- 172.21.15.49:0/1328939760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe100bf7e0 0x7fbe100a7730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbdf0004610 tx=0x7fbdf8015000).stop 2024-01-22T05:04:31.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.386+0000 7fbe17a00700 1 -- 172.21.15.49:0/1328939760 shutdown_connections 2024-01-22T05:04:31.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.386+0000 7fbe17a00700 1 --2- 172.21.15.49:0/1328939760 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbde805a510 0x7fbde805c9d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.386+0000 7fbe17a00700 1 --2- 172.21.15.49:0/1328939760 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe100a7c20 0x7fbe100c14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.386+0000 7fbe17a00700 1 --2- 172.21.15.49:0/1328939760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe100bf7e0 0x7fbe100a7730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.386+0000 7fbe17a00700 1 --2- 172.21.15.49:0/1328939760 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf0003e00 0x7fbe10147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.386+0000 7fbe17a00700 1 -- 172.21.15.49:0/1328939760 >> 172.21.15.49:0/1328939760 conn(0x7fbe100c87f0 msgr2=0x7fbe100aacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:31.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.386+0000 7fbe17a00700 1 -- 172.21.15.49:0/1328939760 shutdown_connections 2024-01-22T05:04:31.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.386+0000 7fbe17a00700 1 -- 172.21.15.49:0/1328939760 wait complete. 2024-01-22T05:04:31.415 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:04:31.416 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:04:31.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.566+0000 7fdf9e800700 1 Processor -- start 2024-01-22T05:04:31.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.570+0000 7fdf9e800700 1 -- start start 2024-01-22T05:04:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.570+0000 7fdf9e800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf98068710 0x7fdf981577d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.570+0000 7fdf9e800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdf98068af0 0x7fdf98157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.570+0000 7fdf9e800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf98068280 con 0x7fdf98065590 2024-01-22T05:04:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.570+0000 7fdf9e800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf981581b0 con 0x7fdf98068af0 2024-01-22T05:04:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.570+0000 7fdf9e800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98069600 con 0x7fdf98068710 2024-01-22T05:04:31.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9ca00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdf98068af0 0x7fdf98157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9d400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf98068710 0x7fdf981577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9ca00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdf98068af0 0x7fdf98157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34482/0 (socket says 172.21.15.49:34482) 2024-01-22T05:04:31.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9ca00700 1 -- 172.21.15.49:0/1428123181 learned_addr learned my addr 172.21.15.49:0/1428123181 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:31.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9de00700 1 --1- 172.21.15.49:0/1428123181 >> v1:172.21.15.49:6789/0 conn(0x7fdf98065590 0x7fdf98065a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43662/0 (socket says 172.21.15.49:43662) 2024-01-22T05:04:31.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9d400700 1 -- 172.21.15.49:0/1428123181 >> v2:172.21.15.49:3300/0 conn(0x7fdf98068af0 msgr2=0x7fdf98157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:31.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9d400700 1 --2- 172.21.15.49:0/1428123181 >> v2:172.21.15.49:3300/0 conn(0x7fdf98068af0 0x7fdf98157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9d400700 1 -- 172.21.15.49:0/1428123181 >> v1:172.21.15.49:6789/0 conn(0x7fdf98065590 legacy=0x7fdf98065a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9d400700 1 -- 172.21.15.49:0/1428123181 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980c1cc0 con 0x7fdf98068710 2024-01-22T05:04:31.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9ca00700 1 --2- 172.21.15.49:0/1428123181 >> v2:172.21.15.49:3300/0 conn(0x7fdf98068af0 0x7fdf98157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:31.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9d400700 1 --2- 172.21.15.49:0/1428123181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf98068710 0x7fdf981577d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fdf88006fd0 tx=0x7fdf88006f40).ready entity=mon.2 client_cookie=80a134afac9158b7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:31.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf97e00700 1 -- 172.21.15.49:0/1428123181 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88005880 con 0x7fdf98068710 2024-01-22T05:04:31.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf97e00700 1 -- 172.21.15.49:0/1428123181 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf880059e0 con 0x7fdf98068710 2024-01-22T05:04:31.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf97e00700 1 -- 172.21.15.49:0/1428123181 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88005d60 con 0x7fdf98068710 2024-01-22T05:04:31.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9e800700 1 -- 172.21.15.49:0/1428123181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf98068710 msgr2=0x7fdf981577d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9e800700 1 --2- 172.21.15.49:0/1428123181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf98068710 0x7fdf981577d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fdf88006fd0 tx=0x7fdf88006f40).stop 2024-01-22T05:04:31.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9e800700 1 -- 172.21.15.49:0/1428123181 shutdown_connections 2024-01-22T05:04:31.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9e800700 1 --2- 172.21.15.49:0/1428123181 >> v2:172.21.15.49:3300/0 conn(0x7fdf98068af0 0x7fdf98157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9e800700 1 --2- 172.21.15.49:0/1428123181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf98068710 0x7fdf981577d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.574+0000 7fdf9e800700 1 -- 172.21.15.49:0/1428123181 >> 172.21.15.49:0/1428123181 conn(0x7fdf980c6fc0 msgr2=0x7fdf980c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:31.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.578+0000 7fdf9e800700 1 -- 172.21.15.49:0/1428123181 shutdown_connections 2024-01-22T05:04:31.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.578+0000 7fdf9e800700 1 -- 172.21.15.49:0/1428123181 wait complete. 2024-01-22T05:04:31.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.578+0000 7fdf9e800700 1 Processor -- start 2024-01-22T05:04:31.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.578+0000 7fdf9e800700 1 -- start start 2024-01-22T05:04:31.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9e800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf98065590 0x7fdf9813cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9e800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf98068710 0x7fdf980bf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf98068af0 0x7fdf980bf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9e800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980c01e0 con 0x7fdf98068af0 2024-01-22T05:04:31.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9e800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980c04c0 con 0x7fdf98065590 2024-01-22T05:04:31.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9e800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980c07a0 con 0x7fdf98068710 2024-01-22T05:04:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf98068af0 0x7fdf980bf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf98068af0 0x7fdf980bf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34486/0 (socket says 172.21.15.49:34486) 2024-01-22T05:04:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9de00700 1 -- 172.21.15.49:0/3726369995 learned_addr learned my addr 172.21.15.49:0/3726369995 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9ca00700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf98068710 0x7fdf980bf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9d400700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf98065590 0x7fdf9813cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9de00700 1 -- 172.21.15.49:0/3726369995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf98068710 msgr2=0x7fdf980bf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9de00700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf98068710 0x7fdf980bf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9de00700 1 -- 172.21.15.49:0/3726369995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf98065590 msgr2=0x7fdf9813cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9de00700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf98065590 0x7fdf9813cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9de00700 1 -- 172.21.15.49:0/3726369995 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf80009370 con 0x7fdf98068af0 2024-01-22T05:04:31.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9ca00700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf98068710 0x7fdf980bf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:31.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9d400700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf98065590 0x7fdf9813cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:31.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9de00700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf98068af0 0x7fdf980bf9a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fdf9000c7c0 tx=0x7fdf90001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:31.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf94c00700 1 -- 172.21.15.49:0/3726369995 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf90005c70 con 0x7fdf98068af0 2024-01-22T05:04:31.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf94c00700 1 -- 172.21.15.49:0/3726369995 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf90005dd0 con 0x7fdf98068af0 2024-01-22T05:04:31.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf94c00700 1 -- 172.21.15.49:0/3726369995 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf90007320 con 0x7fdf98068af0 2024-01-22T05:04:31.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9e800700 1 -- 172.21.15.49:0/3726369995 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf88009250 con 0x7fdf98068af0 2024-01-22T05:04:31.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.582+0000 7fdf9e800700 1 -- 172.21.15.49:0/3726369995 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9813dcd0 con 0x7fdf98068af0 2024-01-22T05:04:31.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.586+0000 7fdf94c00700 1 -- 172.21.15.49:0/3726369995 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdf90007710 con 0x7fdf98068af0 2024-01-22T05:04:31.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.586+0000 7fdf9e800700 1 -- 172.21.15.49:0/3726369995 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf98047060 con 0x7fdf98068af0 2024-01-22T05:04:31.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.586+0000 7fdf94c00700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf7005a510 0x7fdf7005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.586+0000 7fdf94c00700 1 -- 172.21.15.49:0/3726369995 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdf900743b0 con 0x7fdf98068af0 2024-01-22T05:04:31.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.586+0000 7fdf9d400700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf7005a510 0x7fdf7005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.586+0000 7fdf9d400700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf7005a510 0x7fdf7005c9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fdf88006f80 tx=0x7fdf88016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:31.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.594+0000 7fdf94c00700 1 -- 172.21.15.49:0/3726369995 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdf90047ee0 con 0x7fdf98068af0 2024-01-22T05:04:31.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.758+0000 7fdf9e800700 1 -- 172.21.15.49:0/3726369995 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdf98067c30 con 0x7fdf98068af0 2024-01-22T05:04:31.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.758+0000 7fdf94c00700 1 -- 172.21.15.49:0/3726369995 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdf9004b500 con 0x7fdf98068af0 2024-01-22T05:04:31.763 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:04:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.758+0000 7fdf9e800700 1 -- 172.21.15.49:0/3726369995 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf7005a510 msgr2=0x7fdf7005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.762+0000 7fdf9e800700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf7005a510 0x7fdf7005c9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fdf88006f80 tx=0x7fdf88016000).stop 2024-01-22T05:04:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.762+0000 7fdf9e800700 1 -- 172.21.15.49:0/3726369995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf98068af0 msgr2=0x7fdf980bf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.762+0000 7fdf9e800700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf98068af0 0x7fdf980bf9a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fdf9000c7c0 tx=0x7fdf90001510).stop 2024-01-22T05:04:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.762+0000 7fdf9e800700 1 -- 172.21.15.49:0/3726369995 shutdown_connections 2024-01-22T05:04:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.762+0000 7fdf9e800700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf7005a510 0x7fdf7005c9d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.762+0000 7fdf9e800700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf98068af0 0x7fdf980bf9a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.762+0000 7fdf9e800700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf98068710 0x7fdf980bf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.762+0000 7fdf9e800700 1 --2- 172.21.15.49:0/3726369995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf98065590 0x7fdf9813cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.762+0000 7fdf9e800700 1 -- 172.21.15.49:0/3726369995 >> 172.21.15.49:0/3726369995 conn(0x7fdf980c6fc0 msgr2=0x7fdf980c0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.762+0000 7fdf9e800700 1 -- 172.21.15.49:0/3726369995 shutdown_connections 2024-01-22T05:04:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.762+0000 7fdf9e800700 1 -- 172.21.15.49:0/3726369995 wait complete. 2024-01-22T05:04:31.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:04:31.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.946+0000 7f1b6be00700 1 Processor -- start 2024-01-22T05:04:31.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.946+0000 7f1b6be00700 1 -- start start 2024-01-22T05:04:31.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.946+0000 7f1b6be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b6c067a90 0x7f1b6c15bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.946+0000 7f1b6be00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1b6c066910 0x7f1b6c158d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.946+0000 7f1b6be00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6c069600 con 0x7f1b6c15c0b0 2024-01-22T05:04:31.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.946+0000 7f1b6be00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6c1561a0 con 0x7f1b6c066910 2024-01-22T05:04:31.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.946+0000 7f1b6be00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c068dd0 con 0x7f1b6c067a90 2024-01-22T05:04:31.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6a000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1b6c15c0b0 0x7f1b6c158670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43664/0 (socket says 172.21.15.49:43664) 2024-01-22T05:04:31.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6a000700 1 -- 172.21.15.49:0/2669251230 learned_addr learned my addr 172.21.15.49:0/2669251230 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:31.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6aa00700 1 --2- 172.21.15.49:0/2669251230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b6c067a90 0x7f1b6c15bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6b400700 1 --2- 172.21.15.49:0/2669251230 >> v2:172.21.15.110:3300/0 conn(0x7f1b6c066910 0x7f1b6c158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b69600700 1 -- 172.21.15.49:0/2669251230 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455615792 0 0) 0x7f1b6c069600 con 0x7f1b6c15c0b0 2024-01-22T05:04:31.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b69600700 1 -- 172.21.15.49:0/2669251230 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b4c0033f0 con 0x7f1b6c15c0b0 2024-01-22T05:04:31.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6aa00700 1 -- 172.21.15.49:0/2669251230 >> v2:172.21.15.110:3300/0 conn(0x7f1b6c066910 msgr2=0x7f1b6c158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:31.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6aa00700 1 --2- 172.21.15.49:0/2669251230 >> v2:172.21.15.110:3300/0 conn(0x7f1b6c066910 0x7f1b6c158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6aa00700 1 -- 172.21.15.49:0/2669251230 >> v1:172.21.15.49:6789/0 conn(0x7f1b6c15c0b0 legacy=0x7f1b6c158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6aa00700 1 -- 172.21.15.49:0/2669251230 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c15c510 con 0x7f1b6c067a90 2024-01-22T05:04:31.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6b400700 1 --2- 172.21.15.49:0/2669251230 >> v2:172.21.15.110:3300/0 conn(0x7f1b6c066910 0x7f1b6c158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:31.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6aa00700 1 --2- 172.21.15.49:0/2669251230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b6c067a90 0x7f1b6c15bbc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f1b5c006fd0 tx=0x7f1b5c006f40).ready entity=mon.2 client_cookie=ff1f05431eace7d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:31.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b69600700 1 -- 172.21.15.49:0/2669251230 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c005880 con 0x7f1b6c067a90 2024-01-22T05:04:31.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b69600700 1 -- 172.21.15.49:0/2669251230 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c0059e0 con 0x7f1b6c067a90 2024-01-22T05:04:31.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b69600700 1 -- 172.21.15.49:0/2669251230 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c005d60 con 0x7f1b6c067a90 2024-01-22T05:04:31.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6be00700 1 -- 172.21.15.49:0/2669251230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b6c067a90 msgr2=0x7f1b6c15bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6be00700 1 --2- 172.21.15.49:0/2669251230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b6c067a90 0x7f1b6c15bbc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f1b5c006fd0 tx=0x7f1b5c006f40).stop 2024-01-22T05:04:31.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6be00700 1 -- 172.21.15.49:0/2669251230 shutdown_connections 2024-01-22T05:04:31.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6be00700 1 --2- 172.21.15.49:0/2669251230 >> v2:172.21.15.110:3300/0 conn(0x7f1b6c066910 0x7f1b6c158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6be00700 1 --2- 172.21.15.49:0/2669251230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b6c067a90 0x7f1b6c15bbc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.950+0000 7f1b6be00700 1 -- 172.21.15.49:0/2669251230 >> 172.21.15.49:0/2669251230 conn(0x7f1b6c0c6fc0 msgr2=0x7f1b6c0c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:31.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.954+0000 7f1b6be00700 1 -- 172.21.15.49:0/2669251230 shutdown_connections 2024-01-22T05:04:31.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.954+0000 7f1b6be00700 1 -- 172.21.15.49:0/2669251230 wait complete. 2024-01-22T05:04:31.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.958+0000 7f1b6be00700 1 Processor -- start 2024-01-22T05:04:31.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.958+0000 7f1b6be00700 1 -- start start 2024-01-22T05:04:31.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.958+0000 7f1b6be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b6c066910 0x7f1b6c1519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.958+0000 7f1b6be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b6c067a90 0x7f1b6c0bf350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.958+0000 7f1b6be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b6c15c0b0 0x7f1b6c15b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.958+0000 7f1b6be00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c151ec0 con 0x7f1b6c066910 2024-01-22T05:04:31.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.958+0000 7f1b6be00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c16a9b0 con 0x7f1b6c15c0b0 2024-01-22T05:04:31.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.958+0000 7f1b6be00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c169da0 con 0x7f1b6c067a90 2024-01-22T05:04:31.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.958+0000 7f1b6aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b6c066910 0x7f1b6c1519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.958+0000 7f1b6aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b6c066910 0x7f1b6c1519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34492/0 (socket says 172.21.15.49:34492) 2024-01-22T05:04:31.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.958+0000 7f1b6aa00700 1 -- 172.21.15.49:0/707722380 learned_addr learned my addr 172.21.15.49:0/707722380 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:31.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.958+0000 7f1b6a000700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b6c067a90 0x7f1b6c0bf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.958+0000 7f1b6b400700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b6c15c0b0 0x7f1b6c15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.962+0000 7f1b6aa00700 1 -- 172.21.15.49:0/707722380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b6c067a90 msgr2=0x7f1b6c0bf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.962+0000 7f1b6aa00700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b6c067a90 0x7f1b6c0bf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.962+0000 7f1b6aa00700 1 -- 172.21.15.49:0/707722380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b6c15c0b0 msgr2=0x7f1b6c15b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:31.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.962+0000 7f1b6aa00700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b6c15c0b0 0x7f1b6c15b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:31.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.962+0000 7f1b6aa00700 1 -- 172.21.15.49:0/707722380 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c009250 con 0x7f1b6c066910 2024-01-22T05:04:31.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.962+0000 7f1b6a000700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b6c067a90 0x7f1b6c0bf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:31.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.962+0000 7f1b6b400700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b6c15c0b0 0x7f1b6c15b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:31.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.962+0000 7f1b6aa00700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b6c066910 0x7f1b6c1519d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1b5c005fd0 tx=0x7f1b5c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:31.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.962+0000 7f1b62000700 1 -- 172.21.15.49:0/707722380 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00f7f0 con 0x7f1b6c066910 2024-01-22T05:04:31.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.962+0000 7f1b62000700 1 -- 172.21.15.49:0/707722380 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c00f950 con 0x7f1b6c066910 2024-01-22T05:04:31.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.962+0000 7f1b6be00700 1 -- 172.21.15.49:0/707722380 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6c16a080 con 0x7f1b6c066910 2024-01-22T05:04:31.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.962+0000 7f1b62000700 1 -- 172.21.15.49:0/707722380 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00fd10 con 0x7f1b6c066910 2024-01-22T05:04:31.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.962+0000 7f1b6be00700 1 -- 172.21.15.49:0/707722380 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6c16a640 con 0x7f1b6c066910 2024-01-22T05:04:31.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.962+0000 7f1b6be00700 1 -- 172.21.15.49:0/707722380 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6c047060 con 0x7f1b6c066910 2024-01-22T05:04:31.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.966+0000 7f1b62000700 1 -- 172.21.15.49:0/707722380 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1b5c018030 con 0x7f1b6c066910 2024-01-22T05:04:31.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.966+0000 7f1b62000700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b4405a510 0x7f1b4405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:31.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.966+0000 7f1b62000700 1 -- 172.21.15.49:0/707722380 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1b5c074990 con 0x7f1b6c066910 2024-01-22T05:04:31.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.966+0000 7f1b6a000700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b4405a510 0x7f1b4405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:31.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.970+0000 7f1b6a000700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b4405a510 0x7f1b4405c9d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1b54007fd0 tx=0x7f1b54009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:31.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:31.974+0000 7f1b62000700 1 -- 172.21.15.49:0/707722380 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1b5c048480 con 0x7f1b6c066910 2024-01-22T05:04:32.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.138+0000 7f1b6be00700 1 -- 172.21.15.49:0/707722380 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1b6c0a90f0 con 0x7f1b6c066910 2024-01-22T05:04:32.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.138+0000 7f1b62000700 1 -- 172.21.15.49:0/707722380 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1b5c04baa0 con 0x7f1b6c066910 2024-01-22T05:04:32.145 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:04:32.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.142+0000 7f1b6be00700 1 -- 172.21.15.49:0/707722380 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b4405a510 msgr2=0x7f1b4405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:32.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.142+0000 7f1b6be00700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b4405a510 0x7f1b4405c9d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1b54007fd0 tx=0x7f1b54009040).stop 2024-01-22T05:04:32.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.142+0000 7f1b6be00700 1 -- 172.21.15.49:0/707722380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b6c066910 msgr2=0x7f1b6c1519d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:32.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.142+0000 7f1b6be00700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b6c066910 0x7f1b6c1519d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1b5c005fd0 tx=0x7f1b5c016000).stop 2024-01-22T05:04:32.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.142+0000 7f1b6be00700 1 -- 172.21.15.49:0/707722380 shutdown_connections 2024-01-22T05:04:32.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.142+0000 7f1b6be00700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b4405a510 0x7f1b4405c9d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:32.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.142+0000 7f1b6be00700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b6c15c0b0 0x7f1b6c15b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:32.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.142+0000 7f1b6be00700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b6c067a90 0x7f1b6c0bf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:32.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.142+0000 7f1b6be00700 1 --2- 172.21.15.49:0/707722380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b6c066910 0x7f1b6c1519d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:32.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.142+0000 7f1b6be00700 1 -- 172.21.15.49:0/707722380 >> 172.21.15.49:0/707722380 conn(0x7f1b6c0c6fc0 msgr2=0x7f1b6c0c5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:32.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.142+0000 7f1b6be00700 1 -- 172.21.15.49:0/707722380 shutdown_connections 2024-01-22T05:04:32.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.142+0000 7f1b6be00700 1 -- 172.21.15.49:0/707722380 wait complete. 2024-01-22T05:04:32.174 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:04:32.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.329+0000 7f5865200700 1 Processor -- start 2024-01-22T05:04:32.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.329+0000 7f5865200700 1 -- start start 2024-01-22T05:04:32.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.329+0000 7f5865200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f58600bdf60 0x7f5860150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.329+0000 7f5865200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5860151db0 con 0x7f58601550e0 2024-01-22T05:04:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f5865200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5860151510 con 0x7f5860068ba0 2024-01-22T05:04:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f5865200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58600a9f10 con 0x7f58600bdf60 2024-01-22T05:04:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f585e800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f58601550e0 0x7f58600c3390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43676/0 (socket says 172.21.15.49:43676) 2024-01-22T05:04:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f585e800700 1 -- 172.21.15.49:0/2307488157 learned_addr learned my addr 172.21.15.49:0/2307488157 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f585de00700 1 --2- 172.21.15.49:0/2307488157 >> v2:172.21.15.110:3300/0 conn(0x7f58600bdf60 0x7f5860150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:32.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f585ca00700 1 -- 172.21.15.49:0/2307488157 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554320600 0 0) 0x7f5860151db0 con 0x7f58601550e0 2024-01-22T05:04:32.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f585ca00700 1 -- 172.21.15.49:0/2307488157 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58400033f0 con 0x7f58601550e0 2024-01-22T05:04:32.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f585ca00700 1 -- 172.21.15.49:0/2307488157 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676804000 0 0) 0x7f5860151510 con 0x7f5860068ba0 2024-01-22T05:04:32.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f585ca00700 1 -- 172.21.15.49:0/2307488157 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5860151db0 con 0x7f5860068ba0 2024-01-22T05:04:32.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f585de00700 1 -- 172.21.15.49:0/2307488157 >> v1:172.21.15.110:6789/0 conn(0x7f5860068ba0 legacy=0x7f58601549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:32.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f585de00700 1 -- 172.21.15.49:0/2307488157 >> v1:172.21.15.49:6789/0 conn(0x7f58601550e0 legacy=0x7f58600c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:32.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f585ca00700 1 -- 172.21.15.49:0/2307488157 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2878676935 0 0) 0x7f58400033f0 con 0x7f58601550e0 2024-01-22T05:04:32.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f585de00700 1 -- 172.21.15.49:0/2307488157 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58601517f0 con 0x7f58600bdf60 2024-01-22T05:04:32.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f585de00700 1 --2- 172.21.15.49:0/2307488157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58600bdf60 0x7f5860150cd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5850009760 tx=0x7f5850009060).ready entity=mon.1 client_cookie=faaa7fb9b4a8ed06 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:32.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f585ca00700 1 -- 172.21.15.49:0/2307488157 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58580017f0 con 0x7f58600bdf60 2024-01-22T05:04:32.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f585ca00700 1 -- 172.21.15.49:0/2307488157 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58500090d0 con 0x7f58600bdf60 2024-01-22T05:04:32.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f585ca00700 1 -- 172.21.15.49:0/2307488157 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850011610 con 0x7f58600bdf60 2024-01-22T05:04:32.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f5865200700 1 -- 172.21.15.49:0/2307488157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58600bdf60 msgr2=0x7f5860150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:32.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.333+0000 7f5865200700 1 --2- 172.21.15.49:0/2307488157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58600bdf60 0x7f5860150cd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5850009760 tx=0x7f5850009060).stop 2024-01-22T05:04:32.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.337+0000 7f5865200700 1 -- 172.21.15.49:0/2307488157 shutdown_connections 2024-01-22T05:04:32.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.337+0000 7f5865200700 1 --2- 172.21.15.49:0/2307488157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58600bdf60 0x7f5860150cd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:32.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.337+0000 7f5865200700 1 -- 172.21.15.49:0/2307488157 >> 172.21.15.49:0/2307488157 conn(0x7f58600c40c0 msgr2=0x7f58600c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:32.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.337+0000 7f5865200700 1 -- 172.21.15.49:0/2307488157 shutdown_connections 2024-01-22T05:04:32.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.337+0000 7f5865200700 1 -- 172.21.15.49:0/2307488157 wait complete. 2024-01-22T05:04:32.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.337+0000 7f5865200700 1 Processor -- start 2024-01-22T05:04:32.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.337+0000 7f5865200700 1 -- start start 2024-01-22T05:04:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f5865200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5860068ba0 0x7f58601485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f5865200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58600bdf60 0x7f5860067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f5865200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58601550e0 0x7f5860068180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f5865200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58600ab5a0 con 0x7f58601550e0 2024-01-22T05:04:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f5865200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5860068670 con 0x7f5860068ba0 2024-01-22T05:04:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f5865200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58600bf830 con 0x7f58600bdf60 2024-01-22T05:04:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f585e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58601550e0 0x7f5860068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f585e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58601550e0 0x7f5860068180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34494/0 (socket says 172.21.15.49:34494) 2024-01-22T05:04:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f585e800700 1 -- 172.21.15.49:0/90132395 learned_addr learned my addr 172.21.15.49:0/90132395 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f585d400700 1 --2- 172.21.15.49:0/90132395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58600bdf60 0x7f5860067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f585de00700 1 --2- 172.21.15.49:0/90132395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5860068ba0 0x7f58601485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f585e800700 1 -- 172.21.15.49:0/90132395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58600bdf60 msgr2=0x7f5860067c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f585e800700 1 --2- 172.21.15.49:0/90132395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58600bdf60 0x7f5860067c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f585e800700 1 -- 172.21.15.49:0/90132395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5860068ba0 msgr2=0x7f58601485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f585e800700 1 --2- 172.21.15.49:0/90132395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5860068ba0 0x7f58601485a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f585e800700 1 -- 172.21.15.49:0/90132395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58500092a0 con 0x7f58601550e0 2024-01-22T05:04:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f585de00700 1 --2- 172.21.15.49:0/90132395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5860068ba0 0x7f58601485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f585e800700 1 --2- 172.21.15.49:0/90132395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58601550e0 0x7f5860068180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f585800cb90 tx=0x7f5858007ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f5855600700 1 -- 172.21.15.49:0/90132395 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5858004c40 con 0x7f58601550e0 2024-01-22T05:04:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f5855600700 1 -- 172.21.15.49:0/90132395 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5858004da0 con 0x7f58601550e0 2024-01-22T05:04:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f5865200700 1 -- 172.21.15.49:0/90132395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58600bfb10 con 0x7f58601550e0 2024-01-22T05:04:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f5855600700 1 -- 172.21.15.49:0/90132395 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5858007380 con 0x7f58601550e0 2024-01-22T05:04:32.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.341+0000 7f5865200700 1 -- 172.21.15.49:0/90132395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58600c00d0 con 0x7f58601550e0 2024-01-22T05:04:32.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.345+0000 7f5865200700 1 -- 172.21.15.49:0/90132395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5860065660 con 0x7f58601550e0 2024-01-22T05:04:32.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.345+0000 7f5855600700 1 -- 172.21.15.49:0/90132395 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5858007770 con 0x7f58601550e0 2024-01-22T05:04:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.345+0000 7f5855600700 1 --2- 172.21.15.49:0/90132395 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f583805a510 0x7f583805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.345+0000 7f5855600700 1 -- 172.21.15.49:0/90132395 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f58580743f0 con 0x7f58601550e0 2024-01-22T05:04:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.345+0000 7f585de00700 1 --2- 172.21.15.49:0/90132395 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f583805a510 0x7f583805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:32.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.349+0000 7f585de00700 1 --2- 172.21.15.49:0/90132395 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f583805a510 0x7f583805c9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5850009760 tx=0x7f5850016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:32.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.353+0000 7f5855600700 1 -- 172.21.15.49:0/90132395 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5858047e60 con 0x7f58601550e0 2024-01-22T05:04:32.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.513+0000 7f5865200700 1 -- 172.21.15.49:0/90132395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f58600c02c0 con 0x7f58601550e0 2024-01-22T05:04:32.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.513+0000 7f5855600700 1 -- 172.21.15.49:0/90132395 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+143 (secure 0 0 0) 0x7f585804b480 con 0x7f58601550e0 2024-01-22T05:04:32.521 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:32.522 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-22T05:04:32.522 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:04:32.522 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-01-22T05:04:32.522 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2024-01-22T05:04:32.522 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:04:32.522 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:04:32.522 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2024-01-22T05:04:32.522 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2024-01-22T05:04:32.522 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:04:32.522 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-22T05:04:32.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.521+0000 7f5865200700 1 -- 172.21.15.49:0/90132395 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f583805a510 msgr2=0x7f583805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:32.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.521+0000 7f5865200700 1 --2- 172.21.15.49:0/90132395 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f583805a510 0x7f583805c9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5850009760 tx=0x7f5850016000).stop 2024-01-22T05:04:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.521+0000 7f5865200700 1 -- 172.21.15.49:0/90132395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58601550e0 msgr2=0x7f5860068180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.521+0000 7f5865200700 1 --2- 172.21.15.49:0/90132395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58601550e0 0x7f5860068180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f585800cb90 tx=0x7f5858007ba0).stop 2024-01-22T05:04:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.521+0000 7f5865200700 1 -- 172.21.15.49:0/90132395 shutdown_connections 2024-01-22T05:04:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.521+0000 7f5865200700 1 --2- 172.21.15.49:0/90132395 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f583805a510 0x7f583805c9d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.521+0000 7f5865200700 1 --2- 172.21.15.49:0/90132395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58601550e0 0x7f5860068180 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.521+0000 7f5865200700 1 --2- 172.21.15.49:0/90132395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58600bdf60 0x7f5860067c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.521+0000 7f5865200700 1 --2- 172.21.15.49:0/90132395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5860068ba0 0x7f58601485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.521+0000 7f5865200700 1 -- 172.21.15.49:0/90132395 >> 172.21.15.49:0/90132395 conn(0x7f58600c40c0 msgr2=0x7f58600c3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:32.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.521+0000 7f5865200700 1 -- 172.21.15.49:0/90132395 shutdown_connections 2024-01-22T05:04:32.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.521+0000 7f5865200700 1 -- 172.21.15.49:0/90132395 wait complete. 2024-01-22T05:04:32.551 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:04:32.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:04:32.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.717+0000 7f4163e00700 1 Processor -- start 2024-01-22T05:04:32.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.717+0000 7f4163e00700 1 -- start start 2024-01-22T05:04:32.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.721+0000 7f4163e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f41640bfd30 0x7f4164157840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:32.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.721+0000 7f4163e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4164158190 con 0x7f4164157d30 2024-01-22T05:04:32.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.721+0000 7f4163e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4164067c30 con 0x7f4164154de0 2024-01-22T05:04:32.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.721+0000 7f4163e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41640ad670 con 0x7f41640bfd30 2024-01-22T05:04:32.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.721+0000 7f4162000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4164157d30 0x7f41640656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43686/0 (socket says 172.21.15.49:43686) 2024-01-22T05:04:32.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.721+0000 7f4162000700 1 -- 172.21.15.49:0/1380613140 learned_addr learned my addr 172.21.15.49:0/1380613140 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:32.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.721+0000 7f4162a00700 1 --2- 172.21.15.49:0/1380613140 >> v2:172.21.15.49:3300/0 conn(0x7f41640bfd30 0x7f4164157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:32.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4161600700 1 -- 172.21.15.49:0/1380613140 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36702341 0 0) 0x7f4164158190 con 0x7f4164157d30 2024-01-22T05:04:32.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4161600700 1 -- 172.21.15.49:0/1380613140 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41440033f0 con 0x7f4164157d30 2024-01-22T05:04:32.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4161600700 1 -- 172.21.15.49:0/1380613140 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1241418101 0 0) 0x7f41440033f0 con 0x7f4164157d30 2024-01-22T05:04:32.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4162a00700 1 -- 172.21.15.49:0/1380613140 >> v1:172.21.15.110:6789/0 conn(0x7f4164154de0 legacy=0x7f4164065de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:32.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4162a00700 1 -- 172.21.15.49:0/1380613140 >> v1:172.21.15.49:6789/0 conn(0x7f4164157d30 legacy=0x7f41640656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:32.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4162a00700 1 -- 172.21.15.49:0/1380613140 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4164067f10 con 0x7f41640bfd30 2024-01-22T05:04:32.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4162a00700 1 --2- 172.21.15.49:0/1380613140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41640bfd30 0x7f4164157840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f4154009760 tx=0x7f4154009060).ready entity=mon.0 client_cookie=8f8f0646af9042ad server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:32.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4161600700 1 -- 172.21.15.49:0/1380613140 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c001470 con 0x7f41640bfd30 2024-01-22T05:04:32.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4161600700 1 -- 172.21.15.49:0/1380613140 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4154011400 con 0x7f41640bfd30 2024-01-22T05:04:32.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4161600700 1 -- 172.21.15.49:0/1380613140 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154011780 con 0x7f41640bfd30 2024-01-22T05:04:32.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4163e00700 1 -- 172.21.15.49:0/1380613140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41640bfd30 msgr2=0x7f4164157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4163e00700 1 --2- 172.21.15.49:0/1380613140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41640bfd30 0x7f4164157840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f4154009760 tx=0x7f4154009060).stop 2024-01-22T05:04:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4163e00700 1 -- 172.21.15.49:0/1380613140 shutdown_connections 2024-01-22T05:04:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4163e00700 1 --2- 172.21.15.49:0/1380613140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41640bfd30 0x7f4164157840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4163e00700 1 -- 172.21.15.49:0/1380613140 >> 172.21.15.49:0/1380613140 conn(0x7f4164062cc0 msgr2=0x7f41640ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4163e00700 1 -- 172.21.15.49:0/1380613140 shutdown_connections 2024-01-22T05:04:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.725+0000 7f4163e00700 1 -- 172.21.15.49:0/1380613140 wait complete. 2024-01-22T05:04:32.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.729+0000 7f4163e00700 1 Processor -- start 2024-01-22T05:04:32.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.729+0000 7f4163e00700 1 -- start start 2024-01-22T05:04:32.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.729+0000 7f4163e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41640bfd30 0x7f41641445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:32.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.729+0000 7f4163e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4164154de0 0x7f41640ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:32.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.729+0000 7f4163e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4164157d30 0x7f41640ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.729+0000 7f4163e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4164155230 con 0x7f41640bfd30 2024-01-22T05:04:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.729+0000 7f4163e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41640688b0 con 0x7f4164154de0 2024-01-22T05:04:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.729+0000 7f4163e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41640acad0 con 0x7f4164157d30 2024-01-22T05:04:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f4162a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41640bfd30 0x7f41641445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f4162a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41640bfd30 0x7f41641445d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34524/0 (socket says 172.21.15.49:34524) 2024-01-22T05:04:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f4162000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4164154de0 0x7f41640ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f4162a00700 1 -- 172.21.15.49:0/2549405103 learned_addr learned my addr 172.21.15.49:0/2549405103 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f4163400700 1 --2- 172.21.15.49:0/2549405103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4164157d30 0x7f41640ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f4162000700 1 -- 172.21.15.49:0/2549405103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4164157d30 msgr2=0x7f41640ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f4162000700 1 --2- 172.21.15.49:0/2549405103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4164157d30 0x7f41640ac5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f4162000700 1 -- 172.21.15.49:0/2549405103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41640bfd30 msgr2=0x7f41641445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f4162000700 1 --2- 172.21.15.49:0/2549405103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41640bfd30 0x7f41641445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f4162000700 1 -- 172.21.15.49:0/2549405103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41540092a0 con 0x7f4164154de0 2024-01-22T05:04:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f4162000700 1 --2- 172.21.15.49:0/2549405103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4164154de0 0x7f41640ac0f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f414c00c760 tx=0x7f414c001aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f415a000700 1 -- 172.21.15.49:0/2549405103 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c007170 con 0x7f4164154de0 2024-01-22T05:04:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f415a000700 1 -- 172.21.15.49:0/2549405103 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414c007310 con 0x7f4164154de0 2024-01-22T05:04:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f415a000700 1 -- 172.21.15.49:0/2549405103 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c0048c0 con 0x7f4164154de0 2024-01-22T05:04:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f4163e00700 1 -- 172.21.15.49:0/2549405103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41640ada30 con 0x7f4164154de0 2024-01-22T05:04:32.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.733+0000 7f4163e00700 1 -- 172.21.15.49:0/2549405103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41640c7560 con 0x7f4164154de0 2024-01-22T05:04:32.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.737+0000 7f4163e00700 1 -- 172.21.15.49:0/2549405103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4164064350 con 0x7f4164154de0 2024-01-22T05:04:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.737+0000 7f415a000700 1 -- 172.21.15.49:0/2549405103 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f414c004c30 con 0x7f4164154de0 2024-01-22T05:04:32.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.737+0000 7f415a000700 1 --2- 172.21.15.49:0/2549405103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f413c05a510 0x7f413c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:32.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.737+0000 7f415a000700 1 -- 172.21.15.49:0/2549405103 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f414c073e20 con 0x7f4164154de0 2024-01-22T05:04:32.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.737+0000 7f4162a00700 1 --2- 172.21.15.49:0/2549405103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f413c05a510 0x7f413c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.741+0000 7f4162a00700 1 --2- 172.21.15.49:0/2549405103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f413c05a510 0x7f413c05c9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f4154009630 tx=0x7f4154014000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.745+0000 7f415a000700 1 -- 172.21.15.49:0/2549405103 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f414c047890 con 0x7f4164154de0 2024-01-22T05:04:32.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:32.917+0000 7f4163e00700 1 -- 172.21.15.49:0/2549405103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f4164046800 con 0x7f4164154de0 2024-01-22T05:04:33.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.565+0000 7f415a000700 1 -- 172.21.15.49:0/2549405103 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 152+0+0 (secure 0 0 0) 0x7f414c019030 con 0x7f4164154de0 2024-01-22T05:04:33.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.577+0000 7f4163e00700 1 -- 172.21.15.49:0/2549405103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f413c05a510 msgr2=0x7f413c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:33.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.577+0000 7f4163e00700 1 --2- 172.21.15.49:0/2549405103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f413c05a510 0x7f413c05c9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f4154009630 tx=0x7f4154014000).stop 2024-01-22T05:04:33.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.577+0000 7f4163e00700 1 -- 172.21.15.49:0/2549405103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4164154de0 msgr2=0x7f41640ac0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:33.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.577+0000 7f4163e00700 1 --2- 172.21.15.49:0/2549405103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4164154de0 0x7f41640ac0f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f414c00c760 tx=0x7f414c001aa0).stop 2024-01-22T05:04:33.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.577+0000 7f4163e00700 1 -- 172.21.15.49:0/2549405103 shutdown_connections 2024-01-22T05:04:33.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.577+0000 7f4163e00700 1 --2- 172.21.15.49:0/2549405103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f413c05a510 0x7f413c05c9d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:33.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.577+0000 7f4163e00700 1 --2- 172.21.15.49:0/2549405103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4164157d30 0x7f41640ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:33.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.577+0000 7f4163e00700 1 --2- 172.21.15.49:0/2549405103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4164154de0 0x7f41640ac0f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:33.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.577+0000 7f4163e00700 1 --2- 172.21.15.49:0/2549405103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41640bfd30 0x7f41641445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:33.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.577+0000 7f4163e00700 1 -- 172.21.15.49:0/2549405103 >> 172.21.15.49:0/2549405103 conn(0x7f4164062cc0 msgr2=0x7f4164151b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:33.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.577+0000 7f4163e00700 1 -- 172.21.15.49:0/2549405103 shutdown_connections 2024-01-22T05:04:33.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.577+0000 7f4163e00700 1 -- 172.21.15.49:0/2549405103 wait complete. 2024-01-22T05:04:33.589 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-01-22T05:04:33.605 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-01-22T05:04:33.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.773+0000 7fbfa7e00700 1 Processor -- start 2024-01-22T05:04:33.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.773+0000 7fbfa7e00700 1 -- start start 2024-01-22T05:04:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.777+0000 7fbfa7e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa0153cf0 0x7fbfa00c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.777+0000 7fbfa7e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbfa00bcba0 0x7fbfa0068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.777+0000 7fbfa7e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa0068280 con 0x7fbfa00c1ac0 2024-01-22T05:04:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.777+0000 7fbfa7e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa00c1f00 con 0x7fbfa00bcba0 2024-01-22T05:04:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.777+0000 7fbfa7e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa00bd190 con 0x7fbfa0153cf0 2024-01-22T05:04:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbfa4a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbfa00c1ac0 0x7fbfa00bc490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39678/0 (socket says 172.21.15.49:39678) 2024-01-22T05:04:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbfa4a00700 1 -- 172.21.15.49:0/1614865627 learned_addr learned my addr 172.21.15.49:0/1614865627 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbfa5e00700 1 --2- 172.21.15.49:0/1614865627 >> v2:172.21.15.110:3300/0 conn(0x7fbfa00bcba0 0x7fbfa0068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbfa5400700 1 --2- 172.21.15.49:0/1614865627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa0153cf0 0x7fbfa00c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbf9fe00700 1 -- 172.21.15.49:0/1614865627 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686785045 0 0) 0x7fbfa0068280 con 0x7fbfa00c1ac0 2024-01-22T05:04:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbf9fe00700 1 -- 172.21.15.49:0/1614865627 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf800033f0 con 0x7fbfa00c1ac0 2024-01-22T05:04:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbfa5e00700 1 -- 172.21.15.49:0/1614865627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa0153cf0 msgr2=0x7fbfa00c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbfa5e00700 1 --2- 172.21.15.49:0/1614865627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa0153cf0 0x7fbfa00c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbfa5e00700 1 -- 172.21.15.49:0/1614865627 >> v1:172.21.15.49:6789/0 conn(0x7fbfa00c1ac0 legacy=0x7fbfa00bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbfa5e00700 1 -- 172.21.15.49:0/1614865627 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa0067c30 con 0x7fbfa00bcba0 2024-01-22T05:04:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbfa5e00700 1 --2- 172.21.15.49:0/1614865627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfa00bcba0 0x7fbfa0068710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fbf98009e60 tx=0x7fbf98009780).ready entity=mon.1 client_cookie=853901992e4e156c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbf9fe00700 1 -- 172.21.15.49:0/1614865627 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9800e070 con 0x7fbfa00bcba0 2024-01-22T05:04:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbf9fe00700 1 -- 172.21.15.49:0/1614865627 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9800bb40 con 0x7fbfa00bcba0 2024-01-22T05:04:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbf9fe00700 1 -- 172.21.15.49:0/1614865627 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98012410 con 0x7fbfa00bcba0 2024-01-22T05:04:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbfa7e00700 1 -- 172.21.15.49:0/1614865627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfa00bcba0 msgr2=0x7fbfa0068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/1614865627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfa00bcba0 0x7fbfa0068710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fbf98009e60 tx=0x7fbf98009780).stop 2024-01-22T05:04:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbfa7e00700 1 -- 172.21.15.49:0/1614865627 shutdown_connections 2024-01-22T05:04:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/1614865627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfa00bcba0 0x7fbfa0068710 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/1614865627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa0153cf0 0x7fbfa00c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.781+0000 7fbfa7e00700 1 -- 172.21.15.49:0/1614865627 >> 172.21.15.49:0/1614865627 conn(0x7fbfa0062cb0 msgr2=0x7fbfa00c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:33.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.785+0000 7fbfa7e00700 1 -- 172.21.15.49:0/1614865627 shutdown_connections 2024-01-22T05:04:33.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.785+0000 7fbfa7e00700 1 -- 172.21.15.49:0/1614865627 wait complete. 2024-01-22T05:04:33.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.785+0000 7fbfa7e00700 1 Processor -- start 2024-01-22T05:04:33.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.785+0000 7fbfa7e00700 1 -- start start 2024-01-22T05:04:33.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa00bcba0 0x7fbfa0144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:33.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfa00c1ac0 0x7fbfa00a8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:33.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa7e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa0153cf0 0x7fbfa00a8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:33.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa7e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa00a8d30 con 0x7fbfa00bcba0 2024-01-22T05:04:33.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa7e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa00bfec0 con 0x7fbfa00c1ac0 2024-01-22T05:04:33.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa7e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa00a70a0 con 0x7fbfa0153cf0 2024-01-22T05:04:33.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa00bcba0 0x7fbfa0144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:33.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa00bcba0 0x7fbfa0144e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54222/0 (socket says 172.21.15.49:54222) 2024-01-22T05:04:33.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa5400700 1 -- 172.21.15.49:0/3512024889 learned_addr learned my addr 172.21.15.49:0/3512024889 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:33.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa4a00700 1 --2- 172.21.15.49:0/3512024889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfa00c1ac0 0x7fbfa00a8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:33.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa5e00700 1 --2- 172.21.15.49:0/3512024889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa0153cf0 0x7fbfa00a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:33.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa5e00700 1 -- 172.21.15.49:0/3512024889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfa00c1ac0 msgr2=0x7fbfa00a8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:33.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa5e00700 1 --2- 172.21.15.49:0/3512024889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfa00c1ac0 0x7fbfa00a8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:33.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa5e00700 1 -- 172.21.15.49:0/3512024889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa00bcba0 msgr2=0x7fbfa0144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:33.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa5e00700 1 --2- 172.21.15.49:0/3512024889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa00bcba0 0x7fbfa0144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:33.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa5e00700 1 -- 172.21.15.49:0/3512024889 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf98009a20 con 0x7fbfa0153cf0 2024-01-22T05:04:33.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa5400700 1 --2- 172.21.15.49:0/3512024889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa00bcba0 0x7fbfa0144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:33.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa5e00700 1 --2- 172.21.15.49:0/3512024889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa0153cf0 0x7fbfa00a8840 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fbf98014000 tx=0x7fbf98009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:33.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbf9cc00700 1 -- 172.21.15.49:0/3512024889 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98012410 con 0x7fbfa0153cf0 2024-01-22T05:04:33.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbf9cc00700 1 -- 172.21.15.49:0/3512024889 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9801d630 con 0x7fbfa0153cf0 2024-01-22T05:04:33.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa7e00700 1 -- 172.21.15.49:0/3512024889 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa00a7380 con 0x7fbfa0153cf0 2024-01-22T05:04:33.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbf9cc00700 1 -- 172.21.15.49:0/3512024889 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9801d9d0 con 0x7fbfa0153cf0 2024-01-22T05:04:33.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.789+0000 7fbfa7e00700 1 -- 172.21.15.49:0/3512024889 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa00a7940 con 0x7fbfa0153cf0 2024-01-22T05:04:33.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.793+0000 7fbfa7e00700 1 -- 172.21.15.49:0/3512024889 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa0067f10 con 0x7fbfa0153cf0 2024-01-22T05:04:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.793+0000 7fbf9cc00700 1 -- 172.21.15.49:0/3512024889 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbf98003040 con 0x7fbfa0153cf0 2024-01-22T05:04:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.797+0000 7fbf9cc00700 1 --2- 172.21.15.49:0/3512024889 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf7805a510 0x7fbf7805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:33.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.797+0000 7fbf9cc00700 1 -- 172.21.15.49:0/3512024889 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5639+0+0 (secure 0 0 0) 0x7fbf98076410 con 0x7fbfa0153cf0 2024-01-22T05:04:33.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.797+0000 7fbfa5400700 1 --2- 172.21.15.49:0/3512024889 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf7805a510 0x7fbf7805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:33.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.797+0000 7fbfa5400700 1 --2- 172.21.15.49:0/3512024889 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf7805a510 0x7fbf7805c9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fbf90011310 tx=0x7fbf90009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.805+0000 7fbf9cc00700 1 -- 172.21.15.49:0/3512024889 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbf98049d10 con 0x7fbfa0153cf0 2024-01-22T05:04:33.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:33.973+0000 7fbfa7e00700 1 -- 172.21.15.49:0/3512024889 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fbfa00a9180 con 0x7fbfa0153cf0 2024-01-22T05:04:34.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.577+0000 7fbf9cc00700 1 -- 172.21.15.49:0/3512024889 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fbf9804d330 con 0x7fbfa0153cf0 2024-01-22T05:04:34.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.593+0000 7fbfa7e00700 1 -- 172.21.15.49:0/3512024889 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf7805a510 msgr2=0x7fbf7805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:34.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.593+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/3512024889 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf7805a510 0x7fbf7805c9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fbf90011310 tx=0x7fbf90009060).stop 2024-01-22T05:04:34.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.593+0000 7fbfa7e00700 1 -- 172.21.15.49:0/3512024889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa0153cf0 msgr2=0x7fbfa00a8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:34.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.593+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/3512024889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa0153cf0 0x7fbfa00a8840 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fbf98014000 tx=0x7fbf98009780).stop 2024-01-22T05:04:34.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.593+0000 7fbfa7e00700 1 -- 172.21.15.49:0/3512024889 shutdown_connections 2024-01-22T05:04:34.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.593+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/3512024889 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf7805a510 0x7fbf7805c9d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:34.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.593+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/3512024889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa0153cf0 0x7fbfa00a8840 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:34.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.593+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/3512024889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfa00c1ac0 0x7fbfa00a8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:34.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.593+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/3512024889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa00bcba0 0x7fbfa0144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:34.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.593+0000 7fbfa7e00700 1 -- 172.21.15.49:0/3512024889 >> 172.21.15.49:0/3512024889 conn(0x7fbfa0062cb0 msgr2=0x7fbfa00bbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:34.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.597+0000 7fbfa7e00700 1 -- 172.21.15.49:0/3512024889 shutdown_connections 2024-01-22T05:04:34.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.597+0000 7fbfa7e00700 1 -- 172.21.15.49:0/3512024889 wait complete. 2024-01-22T05:04:34.606 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-01-22T05:04:34.629 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:04:34.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.789+0000 7f1901400700 1 Processor -- start 2024-01-22T05:04:34.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.789+0000 7f1901400700 1 -- start start 2024-01-22T05:04:34.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.789+0000 7f1901400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f18fc0c3700 0x7f18fc157d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:34.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.789+0000 7f1901400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f18fc15c1f0 0x7f18fc0be830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:34.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.789+0000 7f1901400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18fc0bda70 con 0x7f18fc062970 2024-01-22T05:04:34.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.789+0000 7f1901400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18fc0bdd50 con 0x7f18fc15c1f0 2024-01-22T05:04:34.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.789+0000 7f1901400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18fc0be030 con 0x7f18fc0c3700 2024-01-22T05:04:34.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.793+0000 7f18fb200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f18fc15c1f0 0x7f18fc0be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:34.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.793+0000 7f18fa800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f18fc0c3700 0x7f18fc157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:34.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.793+0000 7f18fb200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f18fc15c1f0 0x7f18fc0be830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54232/0 (socket says 172.21.15.49:54232) 2024-01-22T05:04:34.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.793+0000 7f18fb200700 1 -- 172.21.15.49:0/2907624366 learned_addr learned my addr 172.21.15.49:0/2907624366 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:34.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.793+0000 7f18fb200700 1 -- 172.21.15.49:0/2907624366 >> v2:172.21.15.110:3300/0 conn(0x7f18fc0c3700 msgr2=0x7f18fc157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:34.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.793+0000 7f18fb200700 1 --2- 172.21.15.49:0/2907624366 >> v2:172.21.15.110:3300/0 conn(0x7f18fc0c3700 0x7f18fc157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:34.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.793+0000 7f18fb200700 1 -- 172.21.15.49:0/2907624366 >> v1:172.21.15.110:6789/0 conn(0x7f18fc062970 legacy=0x7f18fc15bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:34.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.793+0000 7f18fb200700 1 -- 172.21.15.49:0/2907624366 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc0be310 con 0x7f18fc15c1f0 2024-01-22T05:04:34.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.793+0000 7f18fb200700 1 --2- 172.21.15.49:0/2907624366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18fc15c1f0 0x7f18fc0be830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f18fc0c62f0 tx=0x7f18f4009840).ready entity=mon.0 client_cookie=d66bda0f2bc82f0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:34.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.793+0000 7f18f9400700 1 -- 172.21.15.49:0/2907624366 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400e070 con 0x7f18fc15c1f0 2024-01-22T05:04:34.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.793+0000 7f18f9400700 1 -- 172.21.15.49:0/2907624366 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f400ba20 con 0x7f18fc15c1f0 2024-01-22T05:04:34.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.793+0000 7f18f9400700 1 -- 172.21.15.49:0/2907624366 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400bda0 con 0x7f18fc15c1f0 2024-01-22T05:04:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.793+0000 7f1901400700 1 -- 172.21.15.49:0/2907624366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18fc15c1f0 msgr2=0x7f18fc0be830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.793+0000 7f1901400700 1 --2- 172.21.15.49:0/2907624366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18fc15c1f0 0x7f18fc0be830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f18fc0c62f0 tx=0x7f18f4009840).stop 2024-01-22T05:04:34.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.797+0000 7f1901400700 1 -- 172.21.15.49:0/2907624366 shutdown_connections 2024-01-22T05:04:34.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.797+0000 7f1901400700 1 --2- 172.21.15.49:0/2907624366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18fc15c1f0 0x7f18fc0be830 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:34.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.797+0000 7f1901400700 1 --2- 172.21.15.49:0/2907624366 >> v2:172.21.15.110:3300/0 conn(0x7f18fc0c3700 0x7f18fc157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:34.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.797+0000 7f1901400700 1 -- 172.21.15.49:0/2907624366 >> 172.21.15.49:0/2907624366 conn(0x7f18fc0c8780 msgr2=0x7f18fc0c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:34.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.797+0000 7f1901400700 1 -- 172.21.15.49:0/2907624366 shutdown_connections 2024-01-22T05:04:34.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.797+0000 7f1901400700 1 -- 172.21.15.49:0/2907624366 wait complete. 2024-01-22T05:04:34.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.801+0000 7f1901400700 1 Processor -- start 2024-01-22T05:04:34.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.801+0000 7f1901400700 1 -- start start 2024-01-22T05:04:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.801+0000 7f1901400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18fc062970 0x7f18fc168cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.801+0000 7f1901400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18fc0c3700 0x7f18fc156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.801+0000 7f1901400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18fc15c1f0 0x7f18fc0acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.801+0000 7f1901400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc1691a0 con 0x7f18fc15c1f0 2024-01-22T05:04:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.801+0000 7f1901400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc0aa440 con 0x7f18fc0c3700 2024-01-22T05:04:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.801+0000 7f1901400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc0aa720 con 0x7f18fc062970 2024-01-22T05:04:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f18fb200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18fc15c1f0 0x7f18fc0acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f18fa800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18fc062970 0x7f18fc168cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f18fb200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18fc15c1f0 0x7f18fc0acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54234/0 (socket says 172.21.15.49:54234) 2024-01-22T05:04:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f18fb200700 1 -- 172.21.15.49:0/3952648822 learned_addr learned my addr 172.21.15.49:0/3952648822 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f18f9e00700 1 --2- 172.21.15.49:0/3952648822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18fc0c3700 0x7f18fc156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:34.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f18fb200700 1 -- 172.21.15.49:0/3952648822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18fc062970 msgr2=0x7f18fc168cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:34.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f18fb200700 1 --2- 172.21.15.49:0/3952648822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18fc062970 0x7f18fc168cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:34.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f18fb200700 1 -- 172.21.15.49:0/3952648822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18fc0c3700 msgr2=0x7f18fc156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f18fb200700 1 --2- 172.21.15.49:0/3952648822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18fc0c3700 0x7f18fc156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f18fb200700 1 -- 172.21.15.49:0/3952648822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f4009ae0 con 0x7f18fc15c1f0 2024-01-22T05:04:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f18f9e00700 1 --2- 172.21.15.49:0/3952648822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18fc0c3700 0x7f18fc156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f18fb200700 1 --2- 172.21.15.49:0/3952648822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18fc15c1f0 0x7f18fc0acb00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f18fc0c62c0 tx=0x7f18f4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f18f2000700 1 -- 172.21.15.49:0/3952648822 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f40092e0 con 0x7f18fc15c1f0 2024-01-22T05:04:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f18f2000700 1 -- 172.21.15.49:0/3952648822 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f4007610 con 0x7f18fc15c1f0 2024-01-22T05:04:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f18f2000700 1 -- 172.21.15.49:0/3952648822 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f40079d0 con 0x7f18fc15c1f0 2024-01-22T05:04:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f1901400700 1 -- 172.21.15.49:0/3952648822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18fc0aaa00 con 0x7f18fc15c1f0 2024-01-22T05:04:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.805+0000 7f1901400700 1 -- 172.21.15.49:0/3952648822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18fc0aafc0 con 0x7f18fc15c1f0 2024-01-22T05:04:34.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.809+0000 7f1901400700 1 -- 172.21.15.49:0/3952648822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18fc063350 con 0x7f18fc15c1f0 2024-01-22T05:04:34.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.809+0000 7f18f2000700 1 -- 172.21.15.49:0/3952648822 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f18f4003040 con 0x7f18fc15c1f0 2024-01-22T05:04:34.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.809+0000 7f18f2000700 1 --2- 172.21.15.49:0/3952648822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f18d405a510 0x7f18d405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:34.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.809+0000 7f18f2000700 1 -- 172.21.15.49:0/3952648822 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f18f4075fa0 con 0x7f18fc15c1f0 2024-01-22T05:04:34.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.809+0000 7f18fa800700 1 --2- 172.21.15.49:0/3952648822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f18d405a510 0x7f18d405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:34.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.809+0000 7f18fa800700 1 --2- 172.21.15.49:0/3952648822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f18d405a510 0x7f18d405c9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f18ec009c30 tx=0x7f18ec009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:34.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:34.817+0000 7f18f2000700 1 -- 172.21.15.49:0/3952648822 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f18f40a4b00 con 0x7f18fc15c1f0 2024-01-22T05:04:35.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.009+0000 7f1901400700 1 -- 172.21.15.49:0/3952648822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f18fc046800 con 0x7f18fc15c1f0 2024-01-22T05:04:35.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.021+0000 7f18f2000700 1 -- 172.21.15.49:0/3952648822 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f18f4023030 con 0x7f18fc15c1f0 2024-01-22T05:04:35.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.029+0000 7f1901400700 1 -- 172.21.15.49:0/3952648822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f18d405a510 msgr2=0x7f18d405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:35.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.029+0000 7f1901400700 1 --2- 172.21.15.49:0/3952648822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f18d405a510 0x7f18d405c9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f18ec009c30 tx=0x7f18ec009060).stop 2024-01-22T05:04:35.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.029+0000 7f1901400700 1 -- 172.21.15.49:0/3952648822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18fc15c1f0 msgr2=0x7f18fc0acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:35.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.029+0000 7f1901400700 1 --2- 172.21.15.49:0/3952648822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18fc15c1f0 0x7f18fc0acb00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f18fc0c62c0 tx=0x7f18f4009840).stop 2024-01-22T05:04:35.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.033+0000 7f1901400700 1 -- 172.21.15.49:0/3952648822 shutdown_connections 2024-01-22T05:04:35.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.033+0000 7f1901400700 1 --2- 172.21.15.49:0/3952648822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f18d405a510 0x7f18d405c9d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:35.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.033+0000 7f1901400700 1 --2- 172.21.15.49:0/3952648822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18fc15c1f0 0x7f18fc0acb00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:35.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.033+0000 7f1901400700 1 --2- 172.21.15.49:0/3952648822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18fc0c3700 0x7f18fc156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:35.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.033+0000 7f1901400700 1 --2- 172.21.15.49:0/3952648822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18fc062970 0x7f18fc168cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:35.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.033+0000 7f1901400700 1 -- 172.21.15.49:0/3952648822 >> 172.21.15.49:0/3952648822 conn(0x7f18fc0c8780 msgr2=0x7f18fc0c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:35.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.033+0000 7f1901400700 1 -- 172.21.15.49:0/3952648822 shutdown_connections 2024-01-22T05:04:35.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.033+0000 7f1901400700 1 -- 172.21.15.49:0/3952648822 wait complete. 2024-01-22T05:04:35.052 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 3 and data pool 4 2024-01-22T05:04:35.076 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-01-22T05:04:35.077 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-01-22T05:04:35.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.229+0000 7f2f27e00700 1 Processor -- start 2024-01-22T05:04:35.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.229+0000 7f2f27e00700 1 -- start start 2024-01-22T05:04:35.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f27e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f20063f40 0x7f2f20064380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:35.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f27e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f20157b40 con 0x7f2f200bdfa0 2024-01-22T05:04:35.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f27e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f20158610 con 0x7f2f20153650 2024-01-22T05:04:35.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f27e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f20069000 con 0x7f2f20063f40 2024-01-22T05:04:35.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f25400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2f200bdfa0 0x7f2f200688f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39690/0 (socket says 172.21.15.49:39690) 2024-01-22T05:04:35.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f25400700 1 -- 172.21.15.49:0/13750341 learned_addr learned my addr 172.21.15.49:0/13750341 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:35.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f24a00700 1 --2- 172.21.15.49:0/13750341 >> v2:172.21.15.49:3300/0 conn(0x7f2f20063f40 0x7f2f20064380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:35.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f1fe00700 1 -- 172.21.15.49:0/13750341 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322531224 0 0) 0x7f2f20157b40 con 0x7f2f200bdfa0 2024-01-22T05:04:35.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f1fe00700 1 -- 172.21.15.49:0/13750341 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f000033f0 con 0x7f2f200bdfa0 2024-01-22T05:04:35.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f1fe00700 1 -- 172.21.15.49:0/13750341 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193629237 0 0) 0x7f2f20158610 con 0x7f2f20153650 2024-01-22T05:04:35.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f1fe00700 1 -- 172.21.15.49:0/13750341 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f20157b40 con 0x7f2f20153650 2024-01-22T05:04:35.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f24a00700 1 -- 172.21.15.49:0/13750341 >> v1:172.21.15.110:6789/0 conn(0x7f2f20153650 legacy=0x7f2f20153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:35.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f24a00700 1 -- 172.21.15.49:0/13750341 >> v1:172.21.15.49:6789/0 conn(0x7f2f200bdfa0 legacy=0x7f2f200688f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:35.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f1fe00700 1 -- 172.21.15.49:0/13750341 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 134373684 0 0) 0x7f2f000033f0 con 0x7f2f200bdfa0 2024-01-22T05:04:35.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f24a00700 1 -- 172.21.15.49:0/13750341 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200bc740 con 0x7f2f20063f40 2024-01-22T05:04:35.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f24a00700 1 --2- 172.21.15.49:0/13750341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f20063f40 0x7f2f20064380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2f08009760 tx=0x7f2f08009060).ready entity=mon.0 client_cookie=4af2901c49dd4f91 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:35.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f1fe00700 1 -- 172.21.15.49:0/13750341 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10001470 con 0x7f2f20063f40 2024-01-22T05:04:35.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f1fe00700 1 -- 172.21.15.49:0/13750341 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f080090d0 con 0x7f2f20063f40 2024-01-22T05:04:35.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.233+0000 7f2f1fe00700 1 -- 172.21.15.49:0/13750341 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08011610 con 0x7f2f20063f40 2024-01-22T05:04:35.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.237+0000 7f2f27e00700 1 -- 172.21.15.49:0/13750341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f20063f40 msgr2=0x7f2f20064380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:35.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.237+0000 7f2f27e00700 1 --2- 172.21.15.49:0/13750341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f20063f40 0x7f2f20064380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2f08009760 tx=0x7f2f08009060).stop 2024-01-22T05:04:35.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.237+0000 7f2f27e00700 1 -- 172.21.15.49:0/13750341 shutdown_connections 2024-01-22T05:04:35.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.237+0000 7f2f27e00700 1 --2- 172.21.15.49:0/13750341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f20063f40 0x7f2f20064380 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:35.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.237+0000 7f2f27e00700 1 -- 172.21.15.49:0/13750341 >> 172.21.15.49:0/13750341 conn(0x7f2f200c40c0 msgr2=0x7f2f200c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:35.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.237+0000 7f2f27e00700 1 -- 172.21.15.49:0/13750341 shutdown_connections 2024-01-22T05:04:35.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.237+0000 7f2f27e00700 1 -- 172.21.15.49:0/13750341 wait complete. 2024-01-22T05:04:35.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.237+0000 7f2f27e00700 1 Processor -- start 2024-01-22T05:04:35.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f27e00700 1 -- start start 2024-01-22T05:04:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f27e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f20063f40 0x7f2f201568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f27e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f200bdfa0 0x7f2f200a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f27e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f20153650 0x7f2f200a7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f27e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200a8530 con 0x7f2f20063f40 2024-01-22T05:04:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f27e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200a9d50 con 0x7f2f200bdfa0 2024-01-22T05:04:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f27e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200abd10 con 0x7f2f20153650 2024-01-22T05:04:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f25400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f20063f40 0x7f2f201568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f25400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f20063f40 0x7f2f201568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54264/0 (socket says 172.21.15.49:54264) 2024-01-22T05:04:35.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f25400700 1 -- 172.21.15.49:0/88366117 learned_addr learned my addr 172.21.15.49:0/88366117 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f24a00700 1 --2- 172.21.15.49:0/88366117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f200bdfa0 0x7f2f200a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f25e00700 1 --2- 172.21.15.49:0/88366117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f20153650 0x7f2f200a7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f25400700 1 -- 172.21.15.49:0/88366117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f20153650 msgr2=0x7f2f200a7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f25400700 1 --2- 172.21.15.49:0/88366117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f20153650 0x7f2f200a7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f25400700 1 -- 172.21.15.49:0/88366117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f200bdfa0 msgr2=0x7f2f200a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f25400700 1 --2- 172.21.15.49:0/88366117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f200bdfa0 0x7f2f200a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f25400700 1 -- 172.21.15.49:0/88366117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f080092a0 con 0x7f2f20063f40 2024-01-22T05:04:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.241+0000 7f2f25400700 1 --2- 172.21.15.49:0/88366117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f20063f40 0x7f2f201568a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2f1000c7c0 tx=0x7f2f10001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.245+0000 7f2f1cc00700 1 -- 172.21.15.49:0/88366117 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10007170 con 0x7f2f20063f40 2024-01-22T05:04:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.245+0000 7f2f1cc00700 1 -- 172.21.15.49:0/88366117 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f100072d0 con 0x7f2f20063f40 2024-01-22T05:04:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.245+0000 7f2f27e00700 1 -- 172.21.15.49:0/88366117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f200abff0 con 0x7f2f20063f40 2024-01-22T05:04:35.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.245+0000 7f2f1cc00700 1 -- 172.21.15.49:0/88366117 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f100048c0 con 0x7f2f20063f40 2024-01-22T05:04:35.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.245+0000 7f2f27e00700 1 -- 172.21.15.49:0/88366117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f200ac5b0 con 0x7f2f20063f40 2024-01-22T05:04:35.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.245+0000 7f2f27e00700 1 -- 172.21.15.49:0/88366117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f20065660 con 0x7f2f20063f40 2024-01-22T05:04:35.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.245+0000 7f2f1cc00700 1 -- 172.21.15.49:0/88366117 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2f10004c70 con 0x7f2f20063f40 2024-01-22T05:04:35.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.245+0000 7f2f1cc00700 1 --2- 172.21.15.49:0/88366117 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2ef805a510 0x7f2ef805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:35.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.245+0000 7f2f1cc00700 1 -- 172.21.15.49:0/88366117 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2f100742e0 con 0x7f2f20063f40 2024-01-22T05:04:35.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.249+0000 7f2f24a00700 1 --2- 172.21.15.49:0/88366117 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2ef805a510 0x7f2ef805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:35.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.249+0000 7f2f24a00700 1 --2- 172.21.15.49:0/88366117 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2ef805a510 0x7f2ef805c9d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2f20153180 tx=0x7f2f08016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:35.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.253+0000 7f2f1cc00700 1 -- 172.21.15.49:0/88366117 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2f10047ac0 con 0x7f2f20063f40 2024-01-22T05:04:35.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:35.425+0000 7f2f27e00700 1 -- 172.21.15.49:0/88366117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f2f20157d70 con 0x7f2f20063f40 2024-01-22T05:04:36.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.029+0000 7f2f1cc00700 1 -- 172.21.15.49:0/88366117 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f2f10019030 con 0x7f2f20063f40 2024-01-22T05:04:36.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.033+0000 7f2f27e00700 1 -- 172.21.15.49:0/88366117 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2ef805a510 msgr2=0x7f2ef805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:36.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.033+0000 7f2f27e00700 1 --2- 172.21.15.49:0/88366117 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2ef805a510 0x7f2ef805c9d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2f20153180 tx=0x7f2f08016000).stop 2024-01-22T05:04:36.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.033+0000 7f2f27e00700 1 -- 172.21.15.49:0/88366117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f20063f40 msgr2=0x7f2f201568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:36.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.033+0000 7f2f27e00700 1 --2- 172.21.15.49:0/88366117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f20063f40 0x7f2f201568a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2f1000c7c0 tx=0x7f2f10001b50).stop 2024-01-22T05:04:36.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.037+0000 7f2f27e00700 1 -- 172.21.15.49:0/88366117 shutdown_connections 2024-01-22T05:04:36.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.037+0000 7f2f27e00700 1 --2- 172.21.15.49:0/88366117 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2ef805a510 0x7f2ef805c9d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:36.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.037+0000 7f2f27e00700 1 --2- 172.21.15.49:0/88366117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f20153650 0x7f2f200a7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:36.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.037+0000 7f2f27e00700 1 --2- 172.21.15.49:0/88366117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f200bdfa0 0x7f2f200a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:36.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.037+0000 7f2f27e00700 1 --2- 172.21.15.49:0/88366117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f20063f40 0x7f2f201568a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:36.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.037+0000 7f2f27e00700 1 -- 172.21.15.49:0/88366117 >> 172.21.15.49:0/88366117 conn(0x7f2f200c40c0 msgr2=0x7f2f200c6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:36.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.037+0000 7f2f27e00700 1 -- 172.21.15.49:0/88366117 shutdown_connections 2024-01-22T05:04:36.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.037+0000 7f2f27e00700 1 -- 172.21.15.49:0/88366117 wait complete. 2024-01-22T05:04:36.064 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:04:36.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.233+0000 7fcace400700 1 Processor -- start 2024-01-22T05:04:36.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.233+0000 7fcace400700 1 -- start start 2024-01-22T05:04:36.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcace400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcac8141890 0x7fcac80c3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:36.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcace400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcac8069f00 0x7fcac8066640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:36.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcace400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcac806a360 0x7fcac8066b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:36.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcace400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac8067020 con 0x7fcac806a360 2024-01-22T05:04:36.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcace400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac8069a70 con 0x7fcac8069f00 2024-01-22T05:04:36.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcace400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac8068e60 con 0x7fcac8141890 2024-01-22T05:04:36.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcac7e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcac806a360 0x7fcac8066b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:36.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcac7e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcac806a360 0x7fcac8066b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54280/0 (socket says 172.21.15.49:54280) 2024-01-22T05:04:36.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcac7e00700 1 -- 172.21.15.49:0/284950967 learned_addr learned my addr 172.21.15.49:0/284950967 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:36.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcac7e00700 1 -- 172.21.15.49:0/284950967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcac8141890 msgr2=0x7fcac80c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:36.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcac7e00700 1 --2- 172.21.15.49:0/284950967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcac8141890 0x7fcac80c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:04:36.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcac7e00700 1 -- 172.21.15.49:0/284950967 >> v2:172.21.15.110:3300/0 conn(0x7fcac8069f00 msgr2=0x7fcac8066640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:36.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcac7e00700 1 --2- 172.21.15.49:0/284950967 >> v2:172.21.15.110:3300/0 conn(0x7fcac8069f00 0x7fcac8066640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:04:36.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcac7e00700 1 -- 172.21.15.49:0/284950967 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac8069140 con 0x7fcac806a360 2024-01-22T05:04:36.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcac7e00700 1 --2- 172.21.15.49:0/284950967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac806a360 0x7fcac8066b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fcac80661f0 tx=0x7fcac0009840).ready entity=mon.0 client_cookie=2d1c99522cb9f946 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:36.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcac6000700 1 -- 172.21.15.49:0/284950967 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000e070 con 0x7fcac806a360 2024-01-22T05:04:36.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcac6000700 1 -- 172.21.15.49:0/284950967 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac000ba50 con 0x7fcac806a360 2024-01-22T05:04:36.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcac6000700 1 -- 172.21.15.49:0/284950967 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000bdd0 con 0x7fcac806a360 2024-01-22T05:04:36.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcace400700 1 -- 172.21.15.49:0/284950967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac806a360 msgr2=0x7fcac8066b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:36.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.237+0000 7fcace400700 1 --2- 172.21.15.49:0/284950967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac806a360 0x7fcac8066b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fcac80661f0 tx=0x7fcac0009840).stop 2024-01-22T05:04:36.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.241+0000 7fcace400700 1 -- 172.21.15.49:0/284950967 shutdown_connections 2024-01-22T05:04:36.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.241+0000 7fcace400700 1 --2- 172.21.15.49:0/284950967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac806a360 0x7fcac8066b30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:36.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.241+0000 7fcace400700 1 --2- 172.21.15.49:0/284950967 >> v2:172.21.15.110:3300/0 conn(0x7fcac8069f00 0x7fcac8066640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:04:36.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.241+0000 7fcace400700 1 --2- 172.21.15.49:0/284950967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcac8141890 0x7fcac80c3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:04:36.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.241+0000 7fcace400700 1 -- 172.21.15.49:0/284950967 >> 172.21.15.49:0/284950967 conn(0x7fcac80c4120 msgr2=0x7fcac80c4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:36.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.241+0000 7fcace400700 1 -- 172.21.15.49:0/284950967 shutdown_connections 2024-01-22T05:04:36.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.241+0000 7fcace400700 1 -- 172.21.15.49:0/284950967 wait complete. 2024-01-22T05:04:36.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.245+0000 7fcace400700 1 Processor -- start 2024-01-22T05:04:36.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.245+0000 7fcace400700 1 -- start start 2024-01-22T05:04:36.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.245+0000 7fcace400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcac8069f00 0x7fcac816c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:36.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.245+0000 7fcace400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcac806a360 0x7fcac813ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:36.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.245+0000 7fcace400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac8141890 0x7fcac80a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:36.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.245+0000 7fcace400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac8158e20 con 0x7fcac8141890 2024-01-22T05:04:36.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.245+0000 7fcace400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac8169790 con 0x7fcac8069f00 2024-01-22T05:04:36.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.245+0000 7fcace400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac81694b0 con 0x7fcac806a360 2024-01-22T05:04:36.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.245+0000 7fcac7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac8141890 0x7fcac80a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:36.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.245+0000 7fcac7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac8141890 0x7fcac80a9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54282/0 (socket says 172.21.15.49:54282) 2024-01-22T05:04:36.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.245+0000 7fcac7e00700 1 -- 172.21.15.49:0/1543204601 learned_addr learned my addr 172.21.15.49:0/1543204601 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.245+0000 7fcac6a00700 1 --2- 172.21.15.49:0/1543204601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcac806a360 0x7fcac813ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.245+0000 7fcac7400700 1 --2- 172.21.15.49:0/1543204601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcac8069f00 0x7fcac816c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.249+0000 7fcac7e00700 1 -- 172.21.15.49:0/1543204601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcac806a360 msgr2=0x7fcac813ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.249+0000 7fcac7e00700 1 --2- 172.21.15.49:0/1543204601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcac806a360 0x7fcac813ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.249+0000 7fcac7e00700 1 -- 172.21.15.49:0/1543204601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcac8069f00 msgr2=0x7fcac816c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.249+0000 7fcac7e00700 1 --2- 172.21.15.49:0/1543204601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcac8069f00 0x7fcac816c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.249+0000 7fcac7e00700 1 -- 172.21.15.49:0/1543204601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac0009ae0 con 0x7fcac8141890 2024-01-22T05:04:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.249+0000 7fcac7e00700 1 --2- 172.21.15.49:0/1543204601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac8141890 0x7fcac80a9290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fcac0009fd0 tx=0x7fcac0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.249+0000 7fcabea00700 1 -- 172.21.15.49:0/1543204601 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac00092e0 con 0x7fcac8141890 2024-01-22T05:04:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.249+0000 7fcabea00700 1 -- 172.21.15.49:0/1543204601 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac001d410 con 0x7fcac8141890 2024-01-22T05:04:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.249+0000 7fcabea00700 1 -- 172.21.15.49:0/1543204601 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac001d7d0 con 0x7fcac8141890 2024-01-22T05:04:36.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.249+0000 7fcace400700 1 -- 172.21.15.49:0/1543204601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac816be80 con 0x7fcac8141890 2024-01-22T05:04:36.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.249+0000 7fcace400700 1 -- 172.21.15.49:0/1543204601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac816c440 con 0x7fcac8141890 2024-01-22T05:04:36.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.249+0000 7fcace400700 1 -- 172.21.15.49:0/1543204601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac80656a0 con 0x7fcac8141890 2024-01-22T05:04:36.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.249+0000 7fcabea00700 1 -- 172.21.15.49:0/1543204601 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcac001dc00 con 0x7fcac8141890 2024-01-22T05:04:36.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.253+0000 7fcabea00700 1 --2- 172.21.15.49:0/1543204601 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcaa005a510 0x7fcaa005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:36.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.253+0000 7fcabea00700 1 -- 172.21.15.49:0/1543204601 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6380+0+0 (secure 0 0 0) 0x7fcac00763f0 con 0x7fcac8141890 2024-01-22T05:04:36.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.253+0000 7fcac7400700 1 --2- 172.21.15.49:0/1543204601 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcaa005a510 0x7fcaa005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:36.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.253+0000 7fcac7400700 1 --2- 172.21.15.49:0/1543204601 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcaa005a510 0x7fcaa005c9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fcab8006fd0 tx=0x7fcab8006e90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:36.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.257+0000 7fcabea00700 1 -- 172.21.15.49:0/1543204601 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcac0049ad0 con 0x7fcac8141890 2024-01-22T05:04:36.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:36.421+0000 7fcace400700 1 -- 172.21.15.49:0/1543204601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcac8069420 con 0x7fcac8141890 2024-01-22T05:04:36.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:04:36.676 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:04:38.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.057+0000 7fcabea00700 1 -- 172.21.15.49:0/1543204601 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7fcac004d0f0 con 0x7fcac8141890 2024-01-22T05:04:38.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.061+0000 7fcace400700 1 -- 172.21.15.49:0/1543204601 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcaa005a510 msgr2=0x7fcaa005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:38.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.061+0000 7fcace400700 1 --2- 172.21.15.49:0/1543204601 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcaa005a510 0x7fcaa005c9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fcab8006fd0 tx=0x7fcab8006e90).stop 2024-01-22T05:04:38.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.061+0000 7fcace400700 1 -- 172.21.15.49:0/1543204601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac8141890 msgr2=0x7fcac80a9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:38.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.061+0000 7fcace400700 1 --2- 172.21.15.49:0/1543204601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac8141890 0x7fcac80a9290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fcac0009fd0 tx=0x7fcac0009840).stop 2024-01-22T05:04:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.061+0000 7fcace400700 1 -- 172.21.15.49:0/1543204601 shutdown_connections 2024-01-22T05:04:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.061+0000 7fcace400700 1 --2- 172.21.15.49:0/1543204601 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcaa005a510 0x7fcaa005c9d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.061+0000 7fcace400700 1 --2- 172.21.15.49:0/1543204601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcac8141890 0x7fcac80a9290 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.061+0000 7fcace400700 1 --2- 172.21.15.49:0/1543204601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcac806a360 0x7fcac813ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.061+0000 7fcace400700 1 --2- 172.21.15.49:0/1543204601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcac8069f00 0x7fcac816c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.061+0000 7fcace400700 1 -- 172.21.15.49:0/1543204601 >> 172.21.15.49:0/1543204601 conn(0x7fcac80c4120 msgr2=0x7fcac80bc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:38.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.065+0000 7fcace400700 1 -- 172.21.15.49:0/1543204601 shutdown_connections 2024-01-22T05:04:38.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.065+0000 7fcace400700 1 -- 172.21.15.49:0/1543204601 wait complete. 2024-01-22T05:04:38.080 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data_ec' created 2024-01-22T05:04:38.099 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-01-22T05:04:38.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.261+0000 7faf17200700 1 Processor -- start 2024-01-22T05:04:38.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.261+0000 7faf17200700 1 -- start start 2024-01-22T05:04:38.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.265+0000 7faf17200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faf18158190 0x7faf18069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:38.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.265+0000 7faf17200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf1806a0a0 0x7faf180bc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:38.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.265+0000 7faf17200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf180bca10 0x7faf180c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:38.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.265+0000 7faf17200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf180c2b20 con 0x7faf180bca10 2024-01-22T05:04:38.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.265+0000 7faf17200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf180c1f10 con 0x7faf18158190 2024-01-22T05:04:38.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.265+0000 7faf17200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf180c21f0 con 0x7faf1806a0a0 2024-01-22T05:04:38.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf16800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf180bca10 0x7faf180c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:38.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf16800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf180bca10 0x7faf180c2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54284/0 (socket says 172.21.15.49:54284) 2024-01-22T05:04:38.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf16800700 1 -- 172.21.15.49:0/81059918 learned_addr learned my addr 172.21.15.49:0/81059918 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:38.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf15e00700 1 --2- 172.21.15.49:0/81059918 >> v2:172.21.15.110:3300/0 conn(0x7faf18158190 0x7faf18069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:38.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf15400700 1 --2- 172.21.15.49:0/81059918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf1806a0a0 0x7faf180bc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:38.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf16800700 1 -- 172.21.15.49:0/81059918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf1806a0a0 msgr2=0x7faf180bc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:38.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf16800700 1 --2- 172.21.15.49:0/81059918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf1806a0a0 0x7faf180bc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:38.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf16800700 1 -- 172.21.15.49:0/81059918 >> v2:172.21.15.110:3300/0 conn(0x7faf18158190 msgr2=0x7faf18069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:38.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf16800700 1 --2- 172.21.15.49:0/81059918 >> v2:172.21.15.110:3300/0 conn(0x7faf18158190 0x7faf18069bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:38.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf16800700 1 -- 172.21.15.49:0/81059918 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf180c24d0 con 0x7faf180bca10 2024-01-22T05:04:38.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf16800700 1 --2- 172.21.15.49:0/81059918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf180bca10 0x7faf180c2fb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7faf18059c70 tx=0x7faf10009840).ready entity=mon.0 client_cookie=f241826d8cb186c8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:38.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf14a00700 1 -- 172.21.15.49:0/81059918 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1000e070 con 0x7faf180bca10 2024-01-22T05:04:38.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf14a00700 1 -- 172.21.15.49:0/81059918 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1000b970 con 0x7faf180bca10 2024-01-22T05:04:38.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf14a00700 1 -- 172.21.15.49:0/81059918 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1000bcf0 con 0x7faf180bca10 2024-01-22T05:04:38.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf17200700 1 -- 172.21.15.49:0/81059918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf180bca10 msgr2=0x7faf180c2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:38.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.269+0000 7faf17200700 1 --2- 172.21.15.49:0/81059918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf180bca10 0x7faf180c2fb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7faf18059c70 tx=0x7faf10009840).stop 2024-01-22T05:04:38.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.273+0000 7faf17200700 1 -- 172.21.15.49:0/81059918 shutdown_connections 2024-01-22T05:04:38.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.273+0000 7faf17200700 1 --2- 172.21.15.49:0/81059918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf180bca10 0x7faf180c2fb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:38.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.273+0000 7faf17200700 1 --2- 172.21.15.49:0/81059918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf1806a0a0 0x7faf180bc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:38.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.273+0000 7faf17200700 1 --2- 172.21.15.49:0/81059918 >> v2:172.21.15.110:3300/0 conn(0x7faf18158190 0x7faf18069bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:38.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.273+0000 7faf17200700 1 -- 172.21.15.49:0/81059918 >> 172.21.15.49:0/81059918 conn(0x7faf180627d0 msgr2=0x7faf18062bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:38.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.273+0000 7faf17200700 1 -- 172.21.15.49:0/81059918 shutdown_connections 2024-01-22T05:04:38.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.273+0000 7faf17200700 1 -- 172.21.15.49:0/81059918 wait complete. 2024-01-22T05:04:38.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.273+0000 7faf17200700 1 Processor -- start 2024-01-22T05:04:38.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.277+0000 7faf17200700 1 -- start start 2024-01-22T05:04:38.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.277+0000 7faf17200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf1806a0a0 0x7faf180a8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:38.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.277+0000 7faf17200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf180bca10 0x7faf18151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:38.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.277+0000 7faf17200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf18158190 0x7faf18159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:38.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.277+0000 7faf17200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf18158600 con 0x7faf18158190 2024-01-22T05:04:38.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.277+0000 7faf17200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf18159460 con 0x7faf180bca10 2024-01-22T05:04:38.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.277+0000 7faf17200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf18158850 con 0x7faf1806a0a0 2024-01-22T05:04:38.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.277+0000 7faf16800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf18158190 0x7faf18159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:38.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.277+0000 7faf15400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf180bca10 0x7faf18151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:38.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.277+0000 7faf15e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf1806a0a0 0x7faf180a8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:38.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.277+0000 7faf15400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf180bca10 0x7faf18151860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:44952/0 (socket says 172.21.15.49:44952) 2024-01-22T05:04:38.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.277+0000 7faf15400700 1 -- 172.21.15.49:0/3654775907 learned_addr learned my addr 172.21.15.49:0/3654775907 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.281+0000 7faf16800700 1 -- 172.21.15.49:0/3654775907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf1806a0a0 msgr2=0x7faf180a8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.281+0000 7faf16800700 1 --2- 172.21.15.49:0/3654775907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf1806a0a0 0x7faf180a8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.281+0000 7faf16800700 1 -- 172.21.15.49:0/3654775907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf180bca10 msgr2=0x7faf18151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.281+0000 7faf16800700 1 --2- 172.21.15.49:0/3654775907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf180bca10 0x7faf18151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.281+0000 7faf16800700 1 -- 172.21.15.49:0/3654775907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf10009ae0 con 0x7faf18158190 2024-01-22T05:04:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.281+0000 7faf16800700 1 --2- 172.21.15.49:0/3654775907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf18158190 0x7faf18159bc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7faf18068670 tx=0x7faf10009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.281+0000 7faf0d600700 1 -- 172.21.15.49:0/3654775907 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1000bee0 con 0x7faf18158190 2024-01-22T05:04:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.281+0000 7faf0d600700 1 -- 172.21.15.49:0/3654775907 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1000bcf0 con 0x7faf18158190 2024-01-22T05:04:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.281+0000 7faf17200700 1 -- 172.21.15.49:0/3654775907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf18158b30 con 0x7faf18158190 2024-01-22T05:04:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.281+0000 7faf0d600700 1 -- 172.21.15.49:0/3654775907 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1001d6b0 con 0x7faf18158190 2024-01-22T05:04:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.281+0000 7faf17200700 1 -- 172.21.15.49:0/3654775907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf181590f0 con 0x7faf18158190 2024-01-22T05:04:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.281+0000 7faf17200700 1 -- 172.21.15.49:0/3654775907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf180655f0 con 0x7faf18158190 2024-01-22T05:04:38.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.285+0000 7faf0d600700 1 -- 172.21.15.49:0/3654775907 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7faf10003040 con 0x7faf18158190 2024-01-22T05:04:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.285+0000 7faf0d600700 1 --2- 172.21.15.49:0/3654775907 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faef005a510 0x7faef005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.285+0000 7faf0d600700 1 -- 172.21.15.49:0/3654775907 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6873+0+0 (secure 0 0 0) 0x7faf10075af0 con 0x7faf18158190 2024-01-22T05:04:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.285+0000 7faf15e00700 1 --2- 172.21.15.49:0/3654775907 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faef005a510 0x7faef005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:38.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.285+0000 7faf15e00700 1 --2- 172.21.15.49:0/3654775907 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faef005a510 0x7faef005c9d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7faf08009c30 tx=0x7faf08009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:38.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.293+0000 7faf0d600700 1 -- 172.21.15.49:0/3654775907 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faf10049090 con 0x7faf18158190 2024-01-22T05:04:38.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:38.465+0000 7faf17200700 1 -- 172.21.15.49:0/3654775907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7faf181595a0 con 0x7faf18158190 2024-01-22T05:04:39.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.069+0000 7faf0d600700 1 -- 172.21.15.49:0/3654775907 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7faf10022070 con 0x7faf18158190 2024-01-22T05:04:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.081+0000 7faf17200700 1 -- 172.21.15.49:0/3654775907 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faef005a510 msgr2=0x7faef005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.081+0000 7faf17200700 1 --2- 172.21.15.49:0/3654775907 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faef005a510 0x7faef005c9d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7faf08009c30 tx=0x7faf08009060).stop 2024-01-22T05:04:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.081+0000 7faf17200700 1 -- 172.21.15.49:0/3654775907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf18158190 msgr2=0x7faf18159bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:39.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.081+0000 7faf17200700 1 --2- 172.21.15.49:0/3654775907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf18158190 0x7faf18159bc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7faf18068670 tx=0x7faf10009840).stop 2024-01-22T05:04:39.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.081+0000 7faf17200700 1 -- 172.21.15.49:0/3654775907 shutdown_connections 2024-01-22T05:04:39.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.081+0000 7faf17200700 1 --2- 172.21.15.49:0/3654775907 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faef005a510 0x7faef005c9d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.081+0000 7faf17200700 1 --2- 172.21.15.49:0/3654775907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf18158190 0x7faf18159bc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.081+0000 7faf17200700 1 --2- 172.21.15.49:0/3654775907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf180bca10 0x7faf18151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.081+0000 7faf17200700 1 --2- 172.21.15.49:0/3654775907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf1806a0a0 0x7faf180a8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.081+0000 7faf17200700 1 -- 172.21.15.49:0/3654775907 >> 172.21.15.49:0/3654775907 conn(0x7faf180627d0 msgr2=0x7faf180c62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:39.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.085+0000 7faf17200700 1 -- 172.21.15.49:0/3654775907 shutdown_connections 2024-01-22T05:04:39.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.085+0000 7faf17200700 1 -- 172.21.15.49:0/3654775907 wait complete. 2024-01-22T05:04:39.098 INFO:teuthology.orchestra.run.smithi049.stderr:set pool 5 allow_ec_overwrites to true 2024-01-22T05:04:39.128 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-01-22T05:04:39.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.277+0000 7f356b200700 1 Processor -- start 2024-01-22T05:04:39.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.281+0000 7f356b200700 1 -- start start 2024-01-22T05:04:39.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.285+0000 7f356b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f356c0a8b10 0x7f356c066d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:39.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.285+0000 7f356b200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f356c067220 0x7f356c067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:39.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.285+0000 7f356b200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356c0bbde0 con 0x7f356c067f80 2024-01-22T05:04:39.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.285+0000 7f356b200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356c068430 con 0x7f356c067220 2024-01-22T05:04:39.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.285+0000 7f356b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c0bc680 con 0x7f356c0a8b10 2024-01-22T05:04:39.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.285+0000 7f3569400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f356c067220 0x7f356c067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:39.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.285+0000 7f3569e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f356c0a8b10 0x7f356c066d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:39.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.285+0000 7f3569e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f356c0a8b10 0x7f356c066d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:40028/0 (socket says 172.21.15.49:40028) 2024-01-22T05:04:39.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.285+0000 7f3569e00700 1 -- 172.21.15.49:0/3458784182 learned_addr learned my addr 172.21.15.49:0/3458784182 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:39.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.285+0000 7f356a800700 1 --1- 172.21.15.49:0/3458784182 >> v1:172.21.15.110:6789/0 conn(0x7f356c067f80 0x7f356c157760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:36926/0 (socket says 172.21.15.49:36926) 2024-01-22T05:04:39.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.285+0000 7f3569e00700 1 -- 172.21.15.49:0/3458784182 >> v2:172.21.15.110:3300/0 conn(0x7f356c067220 msgr2=0x7f356c067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:39.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.285+0000 7f3569e00700 1 --2- 172.21.15.49:0/3458784182 >> v2:172.21.15.110:3300/0 conn(0x7f356c067220 0x7f356c067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.285+0000 7f3569e00700 1 -- 172.21.15.49:0/3458784182 >> v1:172.21.15.110:6789/0 conn(0x7f356c067f80 legacy=0x7f356c157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:39.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.285+0000 7f3568a00700 1 -- 172.21.15.49:0/3458784182 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133955541 0 0) 0x7f356c0bbde0 con 0x7f356c067f80 2024-01-22T05:04:39.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.285+0000 7f3569e00700 1 -- 172.21.15.49:0/3458784182 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c0bc0c0 con 0x7f356c0a8b10 2024-01-22T05:04:39.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.289+0000 7f3569e00700 1 --2- 172.21.15.49:0/3458784182 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f356c0a8b10 0x7f356c066d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f355c006fd0 tx=0x7f355c0090f0).ready entity=mon.2 client_cookie=8f44eb83ae72bd03 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:39.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.289+0000 7f3568a00700 1 -- 172.21.15.49:0/3458784182 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c00b580 con 0x7f356c0a8b10 2024-01-22T05:04:39.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.289+0000 7f3568a00700 1 -- 172.21.15.49:0/3458784182 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c00b6e0 con 0x7f356c0a8b10 2024-01-22T05:04:39.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.289+0000 7f3568a00700 1 -- 172.21.15.49:0/3458784182 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c00ba60 con 0x7f356c0a8b10 2024-01-22T05:04:39.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.289+0000 7f356b200700 1 -- 172.21.15.49:0/3458784182 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f356c0a8b10 msgr2=0x7f356c066d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:39.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.289+0000 7f356b200700 1 --2- 172.21.15.49:0/3458784182 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f356c0a8b10 0x7f356c066d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f355c006fd0 tx=0x7f355c0090f0).stop 2024-01-22T05:04:39.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.289+0000 7f356b200700 1 -- 172.21.15.49:0/3458784182 shutdown_connections 2024-01-22T05:04:39.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.289+0000 7f356b200700 1 --2- 172.21.15.49:0/3458784182 >> v2:172.21.15.110:3300/0 conn(0x7f356c067220 0x7f356c067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.289+0000 7f356b200700 1 --2- 172.21.15.49:0/3458784182 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f356c0a8b10 0x7f356c066d30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.289+0000 7f356b200700 1 -- 172.21.15.49:0/3458784182 >> 172.21.15.49:0/3458784182 conn(0x7f356c0c6540 msgr2=0x7f356c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:39.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.289+0000 7f356b200700 1 -- 172.21.15.49:0/3458784182 shutdown_connections 2024-01-22T05:04:39.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.289+0000 7f356b200700 1 -- 172.21.15.49:0/3458784182 wait complete. 2024-01-22T05:04:39.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.293+0000 7f356b200700 1 Processor -- start 2024-01-22T05:04:39.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.293+0000 7f356b200700 1 -- start start 2024-01-22T05:04:39.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f356b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f356c067220 0x7f356c0bdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:39.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f356b200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f356c067f80 0x7f356c0a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:39.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f356b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f356c0a8b10 0x7f356c0a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:39.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f356b200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c0a9f90 con 0x7f356c067f80 2024-01-22T05:04:39.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f356b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c168a20 con 0x7f356c0a8b10 2024-01-22T05:04:39.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f356b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c0be580 con 0x7f356c067220 2024-01-22T05:04:39.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f3569400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f356c067f80 0x7f356c0a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:39.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f3569400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f356c067f80 0x7f356c0a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54300/0 (socket says 172.21.15.49:54300) 2024-01-22T05:04:39.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f3569400700 1 -- 172.21.15.49:0/2477142341 learned_addr learned my addr 172.21.15.49:0/2477142341 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:39.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f356a800700 1 --2- 172.21.15.49:0/2477142341 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f356c0a8b10 0x7f356c0a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:39.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f3569e00700 1 --2- 172.21.15.49:0/2477142341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f356c067220 0x7f356c0bdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f356a800700 1 -- 172.21.15.49:0/2477142341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f356c067220 msgr2=0x7f356c0bdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f356a800700 1 --2- 172.21.15.49:0/2477142341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f356c067220 0x7f356c0bdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f356a800700 1 -- 172.21.15.49:0/2477142341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f356c067f80 msgr2=0x7f356c0a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f356a800700 1 --2- 172.21.15.49:0/2477142341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f356c067f80 0x7f356c0a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f356a800700 1 -- 172.21.15.49:0/2477142341 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c009370 con 0x7f356c0a8b10 2024-01-22T05:04:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f3569400700 1 --2- 172.21.15.49:0/2477142341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f356c067f80 0x7f356c0a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f356a800700 1 --2- 172.21.15.49:0/2477142341 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f356c0a8b10 0x7f356c0a9aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f356400c810 tx=0x7f3564001420).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f3561600700 1 -- 172.21.15.49:0/2477142341 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564005c70 con 0x7f356c0a8b10 2024-01-22T05:04:39.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f3561600700 1 -- 172.21.15.49:0/2477142341 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3564005dd0 con 0x7f356c0a8b10 2024-01-22T05:04:39.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f356b200700 1 -- 172.21.15.49:0/2477142341 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356c14c060 con 0x7f356c0a8b10 2024-01-22T05:04:39.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f3561600700 1 -- 172.21.15.49:0/2477142341 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564007320 con 0x7f356c0a8b10 2024-01-22T05:04:39.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.297+0000 7f356b200700 1 -- 172.21.15.49:0/2477142341 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c14c3f0 con 0x7f356c0a8b10 2024-01-22T05:04:39.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.301+0000 7f356b200700 1 -- 172.21.15.49:0/2477142341 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356c047060 con 0x7f356c0a8b10 2024-01-22T05:04:39.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.301+0000 7f3561600700 1 -- 172.21.15.49:0/2477142341 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f35640076d0 con 0x7f356c0a8b10 2024-01-22T05:04:39.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.305+0000 7f3561600700 1 --2- 172.21.15.49:0/2477142341 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f354405a560 0x7f354405ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:39.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.305+0000 7f3561600700 1 -- 172.21.15.49:0/2477142341 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6873+0+0 (secure 0 0 0) 0x7f3564074530 con 0x7f356c0a8b10 2024-01-22T05:04:39.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.305+0000 7f3569e00700 1 --2- 172.21.15.49:0/2477142341 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f354405a560 0x7f354405ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:39.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.305+0000 7f3569e00700 1 --2- 172.21.15.49:0/2477142341 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f354405a560 0x7f354405ca20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f355c009130 tx=0x7f355c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:39.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.313+0000 7f3561600700 1 -- 172.21.15.49:0/2477142341 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3564047900 con 0x7f356c0a8b10 2024-01-22T05:04:39.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.517+0000 7f356b200700 1 -- 172.21.15.49:0/2477142341 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f356c069a00 con 0x7f356c0a8b10 2024-01-22T05:04:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.533+0000 7f3561600700 1 -- 172.21.15.49:0/2477142341 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f3564018070 con 0x7f356c0a8b10 2024-01-22T05:04:39.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.533+0000 7f356b200700 1 -- 172.21.15.49:0/2477142341 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f354405a560 msgr2=0x7f354405ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:39.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.533+0000 7f356b200700 1 --2- 172.21.15.49:0/2477142341 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f354405a560 0x7f354405ca20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f355c009130 tx=0x7f355c017000).stop 2024-01-22T05:04:39.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.533+0000 7f356b200700 1 -- 172.21.15.49:0/2477142341 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f356c0a8b10 msgr2=0x7f356c0a9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:39.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.533+0000 7f356b200700 1 --2- 172.21.15.49:0/2477142341 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f356c0a8b10 0x7f356c0a9aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f356400c810 tx=0x7f3564001420).stop 2024-01-22T05:04:39.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.533+0000 7f356b200700 1 -- 172.21.15.49:0/2477142341 shutdown_connections 2024-01-22T05:04:39.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.533+0000 7f356b200700 1 --2- 172.21.15.49:0/2477142341 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f354405a560 0x7f354405ca20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.533+0000 7f356b200700 1 --2- 172.21.15.49:0/2477142341 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f356c0a8b10 0x7f356c0a9aa0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.533+0000 7f356b200700 1 --2- 172.21.15.49:0/2477142341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f356c067f80 0x7f356c0a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.533+0000 7f356b200700 1 --2- 172.21.15.49:0/2477142341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f356c067220 0x7f356c0bdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.533+0000 7f356b200700 1 -- 172.21.15.49:0/2477142341 >> 172.21.15.49:0/2477142341 conn(0x7f356c0c6540 msgr2=0x7f356c154030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:39.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.537+0000 7f356b200700 1 -- 172.21.15.49:0/2477142341 shutdown_connections 2024-01-22T05:04:39.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.537+0000 7f356b200700 1 -- 172.21.15.49:0/2477142341 wait complete. 2024-01-22T05:04:39.544 INFO:teuthology.orchestra.run.smithi049.stderr:added data pool 5 to fsmap 2024-01-22T05:04:39.563 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:04:39.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.729+0000 7f494ce00700 1 Processor -- start 2024-01-22T05:04:39.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.733+0000 7f494ce00700 1 -- start start 2024-01-22T05:04:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f494ce00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4948157740 0x7f4948153900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f494ce00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4948063d50 con 0x7f4948068aa0 2024-01-22T05:04:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f494ce00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49480bbd00 con 0x7f4948153df0 2024-01-22T05:04:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f494ce00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49480bbfe0 con 0x7f4948157740 2024-01-22T05:04:39.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f4947400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4948157740 0x7f4948153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:39.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f4947400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4948157740 0x7f4948153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54316/0 (socket says 172.21.15.49:54316) 2024-01-22T05:04:39.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f4947e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4948068aa0 0x7f49480bc470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39694/0 (socket says 172.21.15.49:39694) 2024-01-22T05:04:39.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f4947400700 1 -- 172.21.15.49:0/883343767 learned_addr learned my addr 172.21.15.49:0/883343767 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:39.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f4947400700 1 -- 172.21.15.49:0/883343767 >> v1:172.21.15.110:6789/0 conn(0x7f4948153df0 legacy=0x7f49480c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:39.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f4947400700 1 -- 172.21.15.49:0/883343767 >> v1:172.21.15.49:6789/0 conn(0x7f4948068aa0 legacy=0x7f49480bc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:39.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f4947400700 1 -- 172.21.15.49:0/883343767 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4948157f00 con 0x7f4948157740 2024-01-22T05:04:39.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f4946000700 1 -- 172.21.15.49:0/883343767 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820158333 0 0) 0x7f4948063d50 con 0x7f4948068aa0 2024-01-22T05:04:39.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f4947400700 1 --2- 172.21.15.49:0/883343767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948157740 0x7f4948153900 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f4938006fd0 tx=0x7f49380090f0).ready entity=mon.0 client_cookie=a0909b066923939f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:39.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f4946000700 1 -- 172.21.15.49:0/883343767 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493800b600 con 0x7f4948157740 2024-01-22T05:04:39.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f4946000700 1 -- 172.21.15.49:0/883343767 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493800b760 con 0x7f4948157740 2024-01-22T05:04:39.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.737+0000 7f4946000700 1 -- 172.21.15.49:0/883343767 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493800bae0 con 0x7f4948157740 2024-01-22T05:04:39.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.741+0000 7f494ce00700 1 -- 172.21.15.49:0/883343767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948157740 msgr2=0x7f4948153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:39.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.741+0000 7f494ce00700 1 --2- 172.21.15.49:0/883343767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948157740 0x7f4948153900 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f4938006fd0 tx=0x7f49380090f0).stop 2024-01-22T05:04:39.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.741+0000 7f494ce00700 1 -- 172.21.15.49:0/883343767 shutdown_connections 2024-01-22T05:04:39.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.741+0000 7f494ce00700 1 --2- 172.21.15.49:0/883343767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948157740 0x7f4948153900 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.741+0000 7f494ce00700 1 -- 172.21.15.49:0/883343767 >> 172.21.15.49:0/883343767 conn(0x7f49480c42a0 msgr2=0x7f4948065f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:39.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.741+0000 7f494ce00700 1 -- 172.21.15.49:0/883343767 shutdown_connections 2024-01-22T05:04:39.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.741+0000 7f494ce00700 1 -- 172.21.15.49:0/883343767 wait complete. 2024-01-22T05:04:39.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.741+0000 7f494ce00700 1 Processor -- start 2024-01-22T05:04:39.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f494ce00700 1 -- start start 2024-01-22T05:04:39.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f494ce00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4948068aa0 0x7f49480ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:39.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f494ce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948153df0 0x7f4948167cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:39.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f494ce00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4948157740 0x7f4948150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:39.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f494ce00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49480acbc0 con 0x7f4948153df0 2024-01-22T05:04:39.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f494ce00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49480ac730 con 0x7f4948157740 2024-01-22T05:04:39.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f494ce00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49481681c0 con 0x7f4948068aa0 2024-01-22T05:04:39.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f4946a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948153df0 0x7f4948167cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:39.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f4946a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948153df0 0x7f4948167cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54330/0 (socket says 172.21.15.49:54330) 2024-01-22T05:04:39.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f4946a00700 1 -- 172.21.15.49:0/4069444475 learned_addr learned my addr 172.21.15.49:0/4069444475 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:39.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f4947e00700 1 --2- 172.21.15.49:0/4069444475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4948157740 0x7f4948150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:39.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f4947400700 1 --2- 172.21.15.49:0/4069444475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4948068aa0 0x7f49480ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:39.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f4946a00700 1 -- 172.21.15.49:0/4069444475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4948068aa0 msgr2=0x7f49480ab590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:39.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f4946a00700 1 --2- 172.21.15.49:0/4069444475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4948068aa0 0x7f49480ab590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f4946a00700 1 -- 172.21.15.49:0/4069444475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4948157740 msgr2=0x7f4948150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:39.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f4946a00700 1 --2- 172.21.15.49:0/4069444475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4948157740 0x7f4948150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f4946a00700 1 -- 172.21.15.49:0/4069444475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4938009370 con 0x7f4948153df0 2024-01-22T05:04:39.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.745+0000 7f4946a00700 1 --2- 172.21.15.49:0/4069444475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948153df0 0x7f4948167cd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f493000c4c0 tx=0x7f4930007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:39.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.749+0000 7f493ea00700 1 -- 172.21.15.49:0/4069444475 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493000ce10 con 0x7f4948153df0 2024-01-22T05:04:39.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.749+0000 7f493ea00700 1 -- 172.21.15.49:0/4069444475 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4930007020 con 0x7f4948153df0 2024-01-22T05:04:39.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.749+0000 7f494ce00700 1 -- 172.21.15.49:0/4069444475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49480abb20 con 0x7f4948153df0 2024-01-22T05:04:39.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.749+0000 7f493ea00700 1 -- 172.21.15.49:0/4069444475 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49300073c0 con 0x7f4948153df0 2024-01-22T05:04:39.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.749+0000 7f494ce00700 1 -- 172.21.15.49:0/4069444475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49480ac0e0 con 0x7f4948153df0 2024-01-22T05:04:39.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.749+0000 7f494ce00700 1 -- 172.21.15.49:0/4069444475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49480ac8c0 con 0x7f4948153df0 2024-01-22T05:04:39.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.749+0000 7f493ea00700 1 -- 172.21.15.49:0/4069444475 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f49300068b0 con 0x7f4948153df0 2024-01-22T05:04:39.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.753+0000 7f493ea00700 1 --2- 172.21.15.49:0/4069444475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f492005a510 0x7f492005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:39.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.753+0000 7f493ea00700 1 -- 172.21.15.49:0/4069444475 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f4930073e70 con 0x7f4948153df0 2024-01-22T05:04:39.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.753+0000 7f4947400700 1 --2- 172.21.15.49:0/4069444475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f492005a510 0x7f492005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:39.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.753+0000 7f4947400700 1 --2- 172.21.15.49:0/4069444475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f492005a510 0x7f492005c9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4938009130 tx=0x7f4938017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:39.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.761+0000 7f493ea00700 1 -- 172.21.15.49:0/4069444475 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4930047280 con 0x7f4948153df0 2024-01-22T05:04:39.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.973+0000 7f494ce00700 1 -- 172.21.15.49:0/4069444475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49480c46b0 con 0x7f4948153df0 2024-01-22T05:04:39.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.977+0000 7f493ea00700 1 -- 172.21.15.49:0/4069444475 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4491 (secure 0 0 0) 0x7f493004d1a0 con 0x7f4948153df0 2024-01-22T05:04:39.982 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:39.982 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/4240919875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4240919875},{"type":"v1","addr":"172.21.15.49:6836","nonce":4240919875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3591660134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3591660134},{"type":"v1","addr":"172.21.15.49:6837","nonce":3591660134}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1228202507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1228202507},{"type":"v1","addr":"172.21.15.110:6833","nonce":1228202507}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:04:35.017706+0000","modified":"2024-01-22T05:04:39.526774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3391981756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3391981756},{"type":"v1","addr":"172.21.15.110:6835","nonce":3391981756}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-01-22T05:04:39.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.977+0000 7f494ce00700 1 -- 172.21.15.49:0/4069444475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f492005a510 msgr2=0x7f492005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:39.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.977+0000 7f494ce00700 1 --2- 172.21.15.49:0/4069444475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f492005a510 0x7f492005c9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4938009130 tx=0x7f4938017000).stop 2024-01-22T05:04:39.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.977+0000 7f494ce00700 1 -- 172.21.15.49:0/4069444475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948153df0 msgr2=0x7f4948167cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:39.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.977+0000 7f494ce00700 1 --2- 172.21.15.49:0/4069444475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948153df0 0x7f4948167cd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f493000c4c0 tx=0x7f4930007dd0).stop 2024-01-22T05:04:39.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.977+0000 7f494ce00700 1 -- 172.21.15.49:0/4069444475 shutdown_connections 2024-01-22T05:04:39.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.977+0000 7f494ce00700 1 --2- 172.21.15.49:0/4069444475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f492005a510 0x7f492005c9d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.977+0000 7f494ce00700 1 --2- 172.21.15.49:0/4069444475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4948157740 0x7f4948150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.977+0000 7f494ce00700 1 --2- 172.21.15.49:0/4069444475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948153df0 0x7f4948167cd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.977+0000 7f494ce00700 1 --2- 172.21.15.49:0/4069444475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4948068aa0 0x7f49480ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:39.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.977+0000 7f494ce00700 1 -- 172.21.15.49:0/4069444475 >> 172.21.15.49:0/4069444475 conn(0x7f49480c42a0 msgr2=0x7f4948152090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:39.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.981+0000 7f494ce00700 1 -- 172.21.15.49:0/4069444475 shutdown_connections 2024-01-22T05:04:39.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:39.981+0000 7f494ce00700 1 -- 172.21.15.49:0/4069444475 wait complete. 2024-01-22T05:04:39.990 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 7 2024-01-22T05:04:40.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:04:40.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.169+0000 7f81cb600700 1 Processor -- start 2024-01-22T05:04:40.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.169+0000 7f81cb600700 1 -- start start 2024-01-22T05:04:40.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.169+0000 7f81cb600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f81c40bcc50 0x7f81c40bd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.169+0000 7f81cb600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81c40a8b80 0x7f81c4154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.169+0000 7f81cb600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c40bc4d0 con 0x7f81c40a8740 2024-01-22T05:04:40.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.169+0000 7f81cb600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c40bc960 con 0x7f81c40bcc50 2024-01-22T05:04:40.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.169+0000 7f81cb600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40bb8c0 con 0x7f81c40a8b80 2024-01-22T05:04:40.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.173+0000 7f81c8c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f81c40bcc50 0x7f81c40bd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.173+0000 7f81c9600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81c40a8b80 0x7f81c4154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.173+0000 7f81c8c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f81c40bcc50 0x7f81c40bd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:44976/0 (socket says 172.21.15.49:44976) 2024-01-22T05:04:40.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.173+0000 7f81c8c00700 1 -- 172.21.15.49:0/1363161692 learned_addr learned my addr 172.21.15.49:0/1363161692 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:40.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.173+0000 7f81c3e00700 1 --1- 172.21.15.49:0/1363161692 >> v1:172.21.15.110:6789/0 conn(0x7f81c40a8740 0x7f81c41544a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:36940/0 (socket says 172.21.15.49:36940) 2024-01-22T05:04:40.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.173+0000 7f81c8c00700 1 -- 172.21.15.49:0/1363161692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81c40a8b80 msgr2=0x7f81c4154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.173+0000 7f81c8c00700 1 --2- 172.21.15.49:0/1363161692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81c40a8b80 0x7f81c4154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.173+0000 7f81c8c00700 1 -- 172.21.15.49:0/1363161692 >> v1:172.21.15.110:6789/0 conn(0x7f81c40a8740 legacy=0x7f81c41544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.173+0000 7f81c8c00700 1 -- 172.21.15.49:0/1363161692 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c40bbba0 con 0x7f81c40bcc50 2024-01-22T05:04:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.173+0000 7f81c8c00700 1 --2- 172.21.15.49:0/1363161692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c40bcc50 0x7f81c40bd030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f81b4006fd0 tx=0x7f81b40090f0).ready entity=mon.1 client_cookie=5ed697a139a0e110 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.173+0000 7f81c3400700 1 -- 172.21.15.49:0/1363161692 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b400b580 con 0x7f81c40bcc50 2024-01-22T05:04:40.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.173+0000 7f81c3400700 1 -- 172.21.15.49:0/1363161692 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b400b6e0 con 0x7f81c40bcc50 2024-01-22T05:04:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.173+0000 7f81c3400700 1 -- 172.21.15.49:0/1363161692 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b400ba60 con 0x7f81c40bcc50 2024-01-22T05:04:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.177+0000 7f81cb600700 1 -- 172.21.15.49:0/1363161692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c40bcc50 msgr2=0x7f81c40bd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.177+0000 7f81cb600700 1 --2- 172.21.15.49:0/1363161692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c40bcc50 0x7f81c40bd030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f81b4006fd0 tx=0x7f81b40090f0).stop 2024-01-22T05:04:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.177+0000 7f81cb600700 1 -- 172.21.15.49:0/1363161692 shutdown_connections 2024-01-22T05:04:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.177+0000 7f81cb600700 1 --2- 172.21.15.49:0/1363161692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81c40a8b80 0x7f81c4154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.177+0000 7f81cb600700 1 --2- 172.21.15.49:0/1363161692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c40bcc50 0x7f81c40bd030 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.177+0000 7f81cb600700 1 -- 172.21.15.49:0/1363161692 >> 172.21.15.49:0/1363161692 conn(0x7f81c40c6540 msgr2=0x7f81c40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:40.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.177+0000 7f81cb600700 1 -- 172.21.15.49:0/1363161692 shutdown_connections 2024-01-22T05:04:40.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.177+0000 7f81cb600700 1 -- 172.21.15.49:0/1363161692 wait complete. 2024-01-22T05:04:40.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.181+0000 7f81cb600700 1 Processor -- start 2024-01-22T05:04:40.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.181+0000 7f81cb600700 1 -- start start 2024-01-22T05:04:40.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.181+0000 7f81cb600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c40a8740 0x7f81c4144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.181+0000 7f81cb600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81c40a8b80 0x7f81c4148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.181+0000 7f81cb600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c40bcc50 0x7f81c4149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.181+0000 7f81cb600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c4143ce0 con 0x7f81c40a8740 2024-01-22T05:04:40.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.181+0000 7f81cb600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c4149950 con 0x7f81c40bcc50 2024-01-22T05:04:40.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.181+0000 7f81cb600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40bfbd0 con 0x7f81c40a8b80 2024-01-22T05:04:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.181+0000 7f81c8c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c40a8740 0x7f81c4144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.181+0000 7f81c8c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c40a8740 0x7f81c4144fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54340/0 (socket says 172.21.15.49:54340) 2024-01-22T05:04:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.181+0000 7f81c8c00700 1 -- 172.21.15.49:0/2096751511 learned_addr learned my addr 172.21.15.49:0/2096751511 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.185+0000 7f81c3e00700 1 --2- 172.21.15.49:0/2096751511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81c40a8b80 0x7f81c4148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.185+0000 7f81c9600700 1 --2- 172.21.15.49:0/2096751511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c40bcc50 0x7f81c4149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.185+0000 7f81c8c00700 1 -- 172.21.15.49:0/2096751511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81c40a8b80 msgr2=0x7f81c4148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.185+0000 7f81c8c00700 1 --2- 172.21.15.49:0/2096751511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81c40a8b80 0x7f81c4148f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.185+0000 7f81c8c00700 1 -- 172.21.15.49:0/2096751511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c40bcc50 msgr2=0x7f81c4149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.185+0000 7f81c8c00700 1 --2- 172.21.15.49:0/2096751511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c40bcc50 0x7f81c4149460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.185+0000 7f81c8c00700 1 -- 172.21.15.49:0/2096751511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b4009370 con 0x7f81c40a8740 2024-01-22T05:04:40.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.185+0000 7f81c8c00700 1 --2- 172.21.15.49:0/2096751511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c40a8740 0x7f81c4144fa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f81c40647c0 tx=0x7f81b4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:40.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.185+0000 7f81bbe00700 1 -- 172.21.15.49:0/2096751511 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4000bc0 con 0x7f81c40a8740 2024-01-22T05:04:40.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.185+0000 7f81bbe00700 1 -- 172.21.15.49:0/2096751511 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b400b850 con 0x7f81c40a8740 2024-01-22T05:04:40.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.185+0000 7f81cb600700 1 -- 172.21.15.49:0/2096751511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c41440e0 con 0x7f81c40a8740 2024-01-22T05:04:40.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.185+0000 7f81bbe00700 1 -- 172.21.15.49:0/2096751511 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4000d20 con 0x7f81c40a8740 2024-01-22T05:04:40.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.185+0000 7f81cb600700 1 -- 172.21.15.49:0/2096751511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c40bf040 con 0x7f81c40a8740 2024-01-22T05:04:40.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.189+0000 7f81cb600700 1 -- 172.21.15.49:0/2096751511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c4047060 con 0x7f81c40a8740 2024-01-22T05:04:40.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.189+0000 7f81bbe00700 1 -- 172.21.15.49:0/2096751511 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f81b401ca90 con 0x7f81c40a8740 2024-01-22T05:04:40.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.189+0000 7f81bbe00700 1 --2- 172.21.15.49:0/2096751511 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f819c05a510 0x7f819c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.193+0000 7f81bbe00700 1 -- 172.21.15.49:0/2096751511 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f81b40767c0 con 0x7f81c40a8740 2024-01-22T05:04:40.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.193+0000 7f81c3e00700 1 --2- 172.21.15.49:0/2096751511 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f819c05a510 0x7f819c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.193+0000 7f81c3e00700 1 --2- 172.21.15.49:0/2096751511 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f819c05a510 0x7f819c05c9d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f81c4144810 tx=0x7f81ac007d30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:40.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.197+0000 7f81bbe00700 1 -- 172.21.15.49:0/2096751511 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f81b4049bd0 con 0x7f81c40a8740 2024-01-22T05:04:40.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.365+0000 7f81cb600700 1 -- 172.21.15.49:0/2096751511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81c4046800 con 0x7f81c40a8740 2024-01-22T05:04:40.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.369+0000 7f81bbe00700 1 -- 172.21.15.49:0/2096751511 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f81b404d1f0 con 0x7f81c40a8740 2024-01-22T05:04:40.374 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:40.374 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:39.526211+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:04:40.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.369+0000 7f81cb600700 1 -- 172.21.15.49:0/2096751511 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f819c05a510 msgr2=0x7f819c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.369+0000 7f81cb600700 1 --2- 172.21.15.49:0/2096751511 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f819c05a510 0x7f819c05c9d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f81c4144810 tx=0x7f81ac007d30).stop 2024-01-22T05:04:40.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.369+0000 7f81cb600700 1 -- 172.21.15.49:0/2096751511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c40a8740 msgr2=0x7f81c4144fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.369+0000 7f81cb600700 1 --2- 172.21.15.49:0/2096751511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c40a8740 0x7f81c4144fa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f81c40647c0 tx=0x7f81b4017000).stop 2024-01-22T05:04:40.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.369+0000 7f81cb600700 1 -- 172.21.15.49:0/2096751511 shutdown_connections 2024-01-22T05:04:40.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.369+0000 7f81cb600700 1 --2- 172.21.15.49:0/2096751511 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f819c05a510 0x7f819c05c9d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.369+0000 7f81cb600700 1 --2- 172.21.15.49:0/2096751511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c40bcc50 0x7f81c4149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.369+0000 7f81cb600700 1 --2- 172.21.15.49:0/2096751511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81c40a8b80 0x7f81c4148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.369+0000 7f81cb600700 1 --2- 172.21.15.49:0/2096751511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c40a8740 0x7f81c4144fa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.369+0000 7f81cb600700 1 -- 172.21.15.49:0/2096751511 >> 172.21.15.49:0/2096751511 conn(0x7f81c40c6540 msgr2=0x7f81c40680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:40.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.369+0000 7f81cb600700 1 -- 172.21.15.49:0/2096751511 shutdown_connections 2024-01-22T05:04:40.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.369+0000 7f81cb600700 1 -- 172.21.15.49:0/2096751511 wait complete. 2024-01-22T05:04:40.399 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:04:40.556 INFO:tasks.ceph.mds.b.smithi110.stderr:2024-01-22T05:04:40.547+0000 7f0948e00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:04:40.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.557+0000 7f7316c00700 1 Processor -- start 2024-01-22T05:04:40.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.557+0000 7f7316c00700 1 -- start start 2024-01-22T05:04:40.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.557+0000 7f7316c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73100a8740 0x7f73100a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.557+0000 7f7316c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73100c1ed0 0x7f73100c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.557+0000 7f7316c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73100c1a40 con 0x7f7310155d20 2024-01-22T05:04:40.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.557+0000 7f7316c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73100a90b0 con 0x7f73100c1ed0 2024-01-22T05:04:40.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.557+0000 7f7316c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7310159310 con 0x7f73100a8740 2024-01-22T05:04:40.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7314c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73100c1ed0 0x7f73100c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f730f400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73100a8740 0x7f73100a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7314c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f73100c1ed0 0x7f73100c2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54348/0 (socket says 172.21.15.49:54348) 2024-01-22T05:04:40.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f730f400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73100a8740 0x7f73100a8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:44988/0 (socket says 172.21.15.49:44988) 2024-01-22T05:04:40.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7314c00700 1 -- 172.21.15.49:0/1129263220 learned_addr learned my addr 172.21.15.49:0/1129263220 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:40.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7314c00700 1 -- 172.21.15.49:0/1129263220 >> v2:172.21.15.110:3300/0 conn(0x7f73100a8740 msgr2=0x7f73100a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:40.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7314c00700 1 --2- 172.21.15.49:0/1129263220 >> v2:172.21.15.110:3300/0 conn(0x7f73100a8740 0x7f73100a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7314c00700 1 -- 172.21.15.49:0/1129263220 >> v1:172.21.15.49:6789/0 conn(0x7f7310155d20 legacy=0x7f7310065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7314c00700 1 -- 172.21.15.49:0/1129263220 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73100c13f0 con 0x7f73100c1ed0 2024-01-22T05:04:40.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f730ea00700 1 -- 172.21.15.49:0/1129263220 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224265701 0 0) 0x7f73100c1a40 con 0x7f7310155d20 2024-01-22T05:04:40.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7314c00700 1 --2- 172.21.15.49:0/1129263220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73100c1ed0 0x7f73100c2360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f73100c0ad0 tx=0x7f7308009840).ready entity=mon.0 client_cookie=771914314296ed38 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:40.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f730ea00700 1 -- 172.21.15.49:0/1129263220 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730800e070 con 0x7f73100c1ed0 2024-01-22T05:04:40.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f730ea00700 1 -- 172.21.15.49:0/1129263220 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730800ba20 con 0x7f73100c1ed0 2024-01-22T05:04:40.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f730ea00700 1 -- 172.21.15.49:0/1129263220 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730800bda0 con 0x7f73100c1ed0 2024-01-22T05:04:40.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7316c00700 1 -- 172.21.15.49:0/1129263220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73100c1ed0 msgr2=0x7f73100c2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7316c00700 1 --2- 172.21.15.49:0/1129263220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73100c1ed0 0x7f73100c2360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f73100c0ad0 tx=0x7f7308009840).stop 2024-01-22T05:04:40.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7316c00700 1 -- 172.21.15.49:0/1129263220 shutdown_connections 2024-01-22T05:04:40.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7316c00700 1 --2- 172.21.15.49:0/1129263220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73100c1ed0 0x7f73100c2360 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7316c00700 1 --2- 172.21.15.49:0/1129263220 >> v2:172.21.15.110:3300/0 conn(0x7f73100a8740 0x7f73100a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7316c00700 1 -- 172.21.15.49:0/1129263220 >> 172.21.15.49:0/1129263220 conn(0x7f73100c6540 msgr2=0x7f73100c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:40.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7316c00700 1 -- 172.21.15.49:0/1129263220 shutdown_connections 2024-01-22T05:04:40.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.561+0000 7f7316c00700 1 -- 172.21.15.49:0/1129263220 wait complete. 2024-01-22T05:04:40.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.565+0000 7f7316c00700 1 Processor -- start 2024-01-22T05:04:40.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.565+0000 7f7316c00700 1 -- start start 2024-01-22T05:04:40.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7316c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73100a8740 0x7f73101527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7316c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73100c1ed0 0x7f7310152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7316c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7310155d20 0x7f73100a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7316c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7310152070 con 0x7f7310155d20 2024-01-22T05:04:40.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7316c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7310152350 con 0x7f73100c1ed0 2024-01-22T05:04:40.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7316c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73101692f0 con 0x7f73100a8740 2024-01-22T05:04:40.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7314c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7310155d20 0x7f73100a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7314c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7310155d20 0x7f73100a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54358/0 (socket says 172.21.15.49:54358) 2024-01-22T05:04:40.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7314c00700 1 -- 172.21.15.49:0/3082702835 learned_addr learned my addr 172.21.15.49:0/3082702835 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:40.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f730fe00700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73100a8740 0x7f73101527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f730f400700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73100c1ed0 0x7f7310152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7314c00700 1 -- 172.21.15.49:0/3082702835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73100a8740 msgr2=0x7f73101527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7314c00700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73100a8740 0x7f73101527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7314c00700 1 -- 172.21.15.49:0/3082702835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73100c1ed0 msgr2=0x7f7310152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7314c00700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73100c1ed0 0x7f7310152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7314c00700 1 -- 172.21.15.49:0/3082702835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7308009ae0 con 0x7f7310155d20 2024-01-22T05:04:40.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f730fe00700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73100a8740 0x7f73101527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:40.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f730f400700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73100c1ed0 0x7f7310152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:40.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7314c00700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7310155d20 0x7f73100a95b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f730800bec0 tx=0x7f7308009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:40.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7307400700 1 -- 172.21.15.49:0/3082702835 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7308009500 con 0x7f7310155d20 2024-01-22T05:04:40.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7307400700 1 -- 172.21.15.49:0/3082702835 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73080092e0 con 0x7f7310155d20 2024-01-22T05:04:40.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7316c00700 1 -- 172.21.15.49:0/3082702835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73101695d0 con 0x7f7310155d20 2024-01-22T05:04:40.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7307400700 1 -- 172.21.15.49:0/3082702835 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730801d660 con 0x7f7310155d20 2024-01-22T05:04:40.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.569+0000 7f7316c00700 1 -- 172.21.15.49:0/3082702835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73100ab1e0 con 0x7f7310155d20 2024-01-22T05:04:40.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.573+0000 7f7316c00700 1 -- 172.21.15.49:0/3082702835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7310047060 con 0x7f7310155d20 2024-01-22T05:04:40.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.573+0000 7f7307400700 1 -- 172.21.15.49:0/3082702835 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f730801da90 con 0x7f7310155d20 2024-01-22T05:04:40.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.573+0000 7f7307400700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f72e805a510 0x7f72e805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.573+0000 7f7307400700 1 -- 172.21.15.49:0/3082702835 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f7308076730 con 0x7f7310155d20 2024-01-22T05:04:40.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.573+0000 7f730fe00700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f72e805a510 0x7f72e805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.577+0000 7f730fe00700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f72e805a510 0x7f72e805c9d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7300001700 tx=0x7f7300009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:40.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.577+0000 7f7307400700 1 -- 172.21.15.49:0/3082702835 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7308049b40 con 0x7f7310155d20 2024-01-22T05:04:40.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.749+0000 7f7316c00700 1 -- 172.21.15.49:0/3082702835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73100c16d0 con 0x7f7310155d20 2024-01-22T05:04:40.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.749+0000 7f7307400700 1 -- 172.21.15.49:0/3082702835 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f730804d160 con 0x7f7310155d20 2024-01-22T05:04:40.758 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:40.758 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:39.526211+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:04:40.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.753+0000 7f7316c00700 1 -- 172.21.15.49:0/3082702835 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f72e805a510 msgr2=0x7f72e805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.753+0000 7f7316c00700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f72e805a510 0x7f72e805c9d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7300001700 tx=0x7f7300009040).stop 2024-01-22T05:04:40.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.753+0000 7f7316c00700 1 -- 172.21.15.49:0/3082702835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7310155d20 msgr2=0x7f73100a95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.753+0000 7f7316c00700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7310155d20 0x7f73100a95b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f730800bec0 tx=0x7f7308009840).stop 2024-01-22T05:04:40.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.753+0000 7f7316c00700 1 -- 172.21.15.49:0/3082702835 shutdown_connections 2024-01-22T05:04:40.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.753+0000 7f7316c00700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f72e805a510 0x7f72e805c9d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.753+0000 7f7316c00700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7310155d20 0x7f73100a95b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.753+0000 7f7316c00700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73100c1ed0 0x7f7310152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.753+0000 7f7316c00700 1 --2- 172.21.15.49:0/3082702835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73100a8740 0x7f73101527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.753+0000 7f7316c00700 1 -- 172.21.15.49:0/3082702835 >> 172.21.15.49:0/3082702835 conn(0x7f73100c6540 msgr2=0x7f73100c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:40.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.753+0000 7f7316c00700 1 -- 172.21.15.49:0/3082702835 shutdown_connections 2024-01-22T05:04:40.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.753+0000 7f7316c00700 1 -- 172.21.15.49:0/3082702835 wait complete. 2024-01-22T05:04:40.796 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:04:40.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.949+0000 7fc3e0200700 1 Processor -- start 2024-01-22T05:04:40.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.953+0000 7fc3e0200700 1 -- start start 2024-01-22T05:04:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.953+0000 7fc3e0200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3d80bcc50 0x7fc3d80bd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.953+0000 7fc3e0200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d80bc4d0 con 0x7fc3d80a8740 2024-01-22T05:04:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.953+0000 7fc3e0200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d81552c0 con 0x7fc3d80a8b80 2024-01-22T05:04:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.953+0000 7fc3e0200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d80bc960 con 0x7fc3d80bcc50 2024-01-22T05:04:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.953+0000 7fc3dce00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc3d80a8740 0x7fc3d81544a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39708/0 (socket says 172.21.15.49:39708) 2024-01-22T05:04:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.953+0000 7fc3dce00700 1 -- 172.21.15.49:0/103564811 learned_addr learned my addr 172.21.15.49:0/103564811 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.953+0000 7fc3dd800700 1 --2- 172.21.15.49:0/103564811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3d80bcc50 0x7fc3d80bd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3d7e00700 1 -- 172.21.15.49:0/103564811 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278080062 0 0) 0x7fc3d80bc4d0 con 0x7fc3d80a8740 2024-01-22T05:04:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3d7e00700 1 -- 172.21.15.49:0/103564811 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3b80033f0 con 0x7fc3d80a8740 2024-01-22T05:04:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3d7e00700 1 -- 172.21.15.49:0/103564811 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294037873 0 0) 0x7fc3d81552c0 con 0x7fc3d80a8b80 2024-01-22T05:04:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3d7e00700 1 -- 172.21.15.49:0/103564811 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3d80bc4d0 con 0x7fc3d80a8b80 2024-01-22T05:04:40.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3dd800700 1 -- 172.21.15.49:0/103564811 >> v1:172.21.15.110:6789/0 conn(0x7fc3d80a8b80 legacy=0x7fc3d8154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3d7e00700 1 -- 172.21.15.49:0/103564811 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2227849416 0 0) 0x7fc3b80033f0 con 0x7fc3d80a8740 2024-01-22T05:04:40.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3dd800700 1 -- 172.21.15.49:0/103564811 >> v1:172.21.15.49:6789/0 conn(0x7fc3d80a8740 legacy=0x7fc3d81544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3dd800700 1 -- 172.21.15.49:0/103564811 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d80bb8c0 con 0x7fc3d80bcc50 2024-01-22T05:04:40.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3dd800700 1 --2- 172.21.15.49:0/103564811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3d80bcc50 0x7fc3d80bd030 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc3c8009790 tx=0x7fc3c8009060).ready entity=mon.2 client_cookie=20a17d1191aec054 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:40.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3d7e00700 1 -- 172.21.15.49:0/103564811 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0001470 con 0x7fc3d80bcc50 2024-01-22T05:04:40.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3d7e00700 1 -- 172.21.15.49:0/103564811 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c8011400 con 0x7fc3d80bcc50 2024-01-22T05:04:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3d7e00700 1 -- 172.21.15.49:0/103564811 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8011780 con 0x7fc3d80bcc50 2024-01-22T05:04:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3e0200700 1 -- 172.21.15.49:0/103564811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3d80bcc50 msgr2=0x7fc3d80bd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3e0200700 1 --2- 172.21.15.49:0/103564811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3d80bcc50 0x7fc3d80bd030 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc3c8009790 tx=0x7fc3c8009060).stop 2024-01-22T05:04:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3e0200700 1 -- 172.21.15.49:0/103564811 shutdown_connections 2024-01-22T05:04:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3e0200700 1 --2- 172.21.15.49:0/103564811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3d80bcc50 0x7fc3d80bd030 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3e0200700 1 -- 172.21.15.49:0/103564811 >> 172.21.15.49:0/103564811 conn(0x7fc3d80c6540 msgr2=0x7fc3d80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:40.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3e0200700 1 -- 172.21.15.49:0/103564811 shutdown_connections 2024-01-22T05:04:40.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.957+0000 7fc3e0200700 1 -- 172.21.15.49:0/103564811 wait complete. 2024-01-22T05:04:40.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.961+0000 7fc3e0200700 1 Processor -- start 2024-01-22T05:04:40.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.961+0000 7fc3e0200700 1 -- start start 2024-01-22T05:04:40.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3e0200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d80a8740 0x7fc3d80bddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3e0200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3d80a8b80 0x7fc3d8164280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3e0200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3d80bcc50 0x7fc3d8165450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3e0200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d80be720 con 0x7fc3d80bcc50 2024-01-22T05:04:40.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3e0200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d80be9b0 con 0x7fc3d80a8740 2024-01-22T05:04:40.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3e0200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d8164a60 con 0x7fc3d80a8b80 2024-01-22T05:04:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3de200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3d80bcc50 0x7fc3d8165450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3de200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3d80bcc50 0x7fc3d8165450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54364/0 (socket says 172.21.15.49:54364) 2024-01-22T05:04:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3de200700 1 -- 172.21.15.49:0/1252573152 learned_addr learned my addr 172.21.15.49:0/1252573152 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3dd800700 1 --2- 172.21.15.49:0/1252573152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d80a8740 0x7fc3d80bddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3dce00700 1 --2- 172.21.15.49:0/1252573152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3d80a8b80 0x7fc3d8164280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3de200700 1 -- 172.21.15.49:0/1252573152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3d80a8b80 msgr2=0x7fc3d8164280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3de200700 1 --2- 172.21.15.49:0/1252573152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3d80a8b80 0x7fc3d8164280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3de200700 1 -- 172.21.15.49:0/1252573152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d80a8740 msgr2=0x7fc3d80bddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3de200700 1 --2- 172.21.15.49:0/1252573152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d80a8740 0x7fc3d80bddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3de200700 1 -- 172.21.15.49:0/1252573152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80092a0 con 0x7fc3d80bcc50 2024-01-22T05:04:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3dce00700 1 --2- 172.21.15.49:0/1252573152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3d80a8b80 0x7fc3d8164280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:40.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.965+0000 7fc3de200700 1 --2- 172.21.15.49:0/1252573152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3d80bcc50 0x7fc3d8165450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc3d000c710 tx=0x7fc3d000ca20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:40.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.969+0000 7fc3d4c00700 1 -- 172.21.15.49:0/1252573152 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0010510 con 0x7fc3d80bcc50 2024-01-22T05:04:40.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.969+0000 7fc3d4c00700 1 -- 172.21.15.49:0/1252573152 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d0010670 con 0x7fc3d80bcc50 2024-01-22T05:04:40.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.969+0000 7fc3e0200700 1 -- 172.21.15.49:0/1252573152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d8164d40 con 0x7fc3d80bcc50 2024-01-22T05:04:40.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.969+0000 7fc3d4c00700 1 -- 172.21.15.49:0/1252573152 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00109f0 con 0x7fc3d80bcc50 2024-01-22T05:04:40.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.969+0000 7fc3e0200700 1 -- 172.21.15.49:0/1252573152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d8164770 con 0x7fc3d80bcc50 2024-01-22T05:04:40.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.969+0000 7fc3e0200700 1 -- 172.21.15.49:0/1252573152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d80beb40 con 0x7fc3d80bcc50 2024-01-22T05:04:40.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.973+0000 7fc3d4c00700 1 -- 172.21.15.49:0/1252573152 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc3d001b400 con 0x7fc3d80bcc50 2024-01-22T05:04:40.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.973+0000 7fc3d4c00700 1 --2- 172.21.15.49:0/1252573152 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc3b005a540 0x7fc3b005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:40.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.973+0000 7fc3d4c00700 1 -- 172.21.15.49:0/1252573152 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fc3d0074940 con 0x7fc3d80bcc50 2024-01-22T05:04:40.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.973+0000 7fc3dd800700 1 --2- 172.21.15.49:0/1252573152 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc3b005a540 0x7fc3b005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:40.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.973+0000 7fc3dd800700 1 --2- 172.21.15.49:0/1252573152 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc3b005a540 0x7fc3b005ca00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc3c80096e0 tx=0x7fc3c8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:40.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:40.981+0000 7fc3d4c00700 1 -- 172.21.15.49:0/1252573152 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc3d0047cf0 con 0x7fc3d80bcc50 2024-01-22T05:04:41.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.185+0000 7fc3e0200700 1 -- 172.21.15.49:0/1252573152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3d80bbba0 con 0x7fc3d80bcc50 2024-01-22T05:04:41.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.185+0000 7fc3d4c00700 1 -- 172.21.15.49:0/1252573152 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4491 (secure 0 0 0) 0x7fc3d004b310 con 0x7fc3d80bcc50 2024-01-22T05:04:41.193 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:41.193 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/4240919875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4240919875},{"type":"v1","addr":"172.21.15.49:6836","nonce":4240919875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3591660134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3591660134},{"type":"v1","addr":"172.21.15.49:6837","nonce":3591660134}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1228202507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1228202507},{"type":"v1","addr":"172.21.15.110:6833","nonce":1228202507}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:04:35.017706+0000","modified":"2024-01-22T05:04:39.526774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3391981756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3391981756},{"type":"v1","addr":"172.21.15.110:6835","nonce":3391981756}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-01-22T05:04:41.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.189+0000 7fc3e0200700 1 -- 172.21.15.49:0/1252573152 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc3b005a540 msgr2=0x7fc3b005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:41.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.189+0000 7fc3e0200700 1 --2- 172.21.15.49:0/1252573152 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc3b005a540 0x7fc3b005ca00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc3c80096e0 tx=0x7fc3c8016000).stop 2024-01-22T05:04:41.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.189+0000 7fc3e0200700 1 -- 172.21.15.49:0/1252573152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3d80bcc50 msgr2=0x7fc3d8165450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:41.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.189+0000 7fc3e0200700 1 --2- 172.21.15.49:0/1252573152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3d80bcc50 0x7fc3d8165450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc3d000c710 tx=0x7fc3d000ca20).stop 2024-01-22T05:04:41.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.189+0000 7fc3e0200700 1 -- 172.21.15.49:0/1252573152 shutdown_connections 2024-01-22T05:04:41.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.189+0000 7fc3e0200700 1 --2- 172.21.15.49:0/1252573152 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc3b005a540 0x7fc3b005ca00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:41.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.189+0000 7fc3e0200700 1 --2- 172.21.15.49:0/1252573152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3d80bcc50 0x7fc3d8165450 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:41.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.189+0000 7fc3e0200700 1 --2- 172.21.15.49:0/1252573152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3d80a8b80 0x7fc3d8164280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:41.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.189+0000 7fc3e0200700 1 --2- 172.21.15.49:0/1252573152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d80a8740 0x7fc3d80bddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:41.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.189+0000 7fc3e0200700 1 -- 172.21.15.49:0/1252573152 >> 172.21.15.49:0/1252573152 conn(0x7fc3d80c6540 msgr2=0x7fc3d814e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:41.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.189+0000 7fc3e0200700 1 -- 172.21.15.49:0/1252573152 shutdown_connections 2024-01-22T05:04:41.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.189+0000 7fc3e0200700 1 -- 172.21.15.49:0/1252573152 wait complete. 2024-01-22T05:04:41.201 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 7 2024-01-22T05:04:41.222 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:04:41.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.385+0000 7f257e200700 1 Processor -- start 2024-01-22T05:04:41.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.385+0000 7f257e200700 1 -- start start 2024-01-22T05:04:41.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f257e200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f25780beae0 0x7f257815c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f257e200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25780693b0 con 0x7f25781554f0 2024-01-22T05:04:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f257e200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2578152dd0 con 0x7f2578067a90 2024-01-22T05:04:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f257e200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25780687a0 con 0x7f25780beae0 2024-01-22T05:04:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f2577400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f25781554f0 0x7f25781558d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39710/0 (socket says 172.21.15.49:39710) 2024-01-22T05:04:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f2577400700 1 -- 172.21.15.49:0/667358491 learned_addr learned my addr 172.21.15.49:0/667358491 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f2577e00700 1 --2- 172.21.15.49:0/667358491 >> v2:172.21.15.110:3300/0 conn(0x7f25780beae0 0x7f257815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:41.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f2576000700 1 -- 172.21.15.49:0/667358491 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429609581 0 0) 0x7f25780693b0 con 0x7f25781554f0 2024-01-22T05:04:41.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f2576000700 1 -- 172.21.15.49:0/667358491 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25580033f0 con 0x7f25781554f0 2024-01-22T05:04:41.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f2576000700 1 -- 172.21.15.49:0/667358491 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728734948 0 0) 0x7f2578152dd0 con 0x7f2578067a90 2024-01-22T05:04:41.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f2576000700 1 -- 172.21.15.49:0/667358491 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25780693b0 con 0x7f2578067a90 2024-01-22T05:04:41.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f2577e00700 1 -- 172.21.15.49:0/667358491 >> v1:172.21.15.110:6789/0 conn(0x7f2578067a90 legacy=0x7f2578067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:41.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f2577e00700 1 -- 172.21.15.49:0/667358491 >> v1:172.21.15.49:6789/0 conn(0x7f25781554f0 legacy=0x7f25781558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:41.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f2577e00700 1 -- 172.21.15.49:0/667358491 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2578068a80 con 0x7f25780beae0 2024-01-22T05:04:41.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f2577e00700 1 --2- 172.21.15.49:0/667358491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25780beae0 0x7f257815c890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f2570009e60 tx=0x7f2570009780).ready entity=mon.1 client_cookie=3f965a22d196bba4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:41.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f2576000700 1 -- 172.21.15.49:0/667358491 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257000e070 con 0x7f25780beae0 2024-01-22T05:04:41.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f2576000700 1 -- 172.21.15.49:0/667358491 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257000bab0 con 0x7f25780beae0 2024-01-22T05:04:41.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.389+0000 7f2576000700 1 -- 172.21.15.49:0/667358491 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257000be30 con 0x7f25780beae0 2024-01-22T05:04:41.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.393+0000 7f257e200700 1 -- 172.21.15.49:0/667358491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25780beae0 msgr2=0x7f257815c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:41.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.393+0000 7f257e200700 1 --2- 172.21.15.49:0/667358491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25780beae0 0x7f257815c890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f2570009e60 tx=0x7f2570009780).stop 2024-01-22T05:04:41.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.393+0000 7f257e200700 1 -- 172.21.15.49:0/667358491 shutdown_connections 2024-01-22T05:04:41.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.393+0000 7f257e200700 1 --2- 172.21.15.49:0/667358491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25780beae0 0x7f257815c890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:41.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.393+0000 7f257e200700 1 -- 172.21.15.49:0/667358491 >> 172.21.15.49:0/667358491 conn(0x7f25780c8710 msgr2=0x7f25780c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:41.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.393+0000 7f257e200700 1 -- 172.21.15.49:0/667358491 shutdown_connections 2024-01-22T05:04:41.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.393+0000 7f257e200700 1 -- 172.21.15.49:0/667358491 wait complete. 2024-01-22T05:04:41.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.397+0000 7f257e200700 1 Processor -- start 2024-01-22T05:04:41.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.397+0000 7f257e200700 1 -- start start 2024-01-22T05:04:41.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.397+0000 7f257e200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2578067a90 0x7f2578141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:41.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.397+0000 7f257e200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780beae0 0x7f25780bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:41.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.397+0000 7f257e200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25781554f0 0x7f25780be260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:41.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.397+0000 7f257e200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25780be750 con 0x7f25780beae0 2024-01-22T05:04:41.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.397+0000 7f257e200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25780ae480 con 0x7f2578067a90 2024-01-22T05:04:41.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.397+0000 7f257e200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2578162be0 con 0x7f25781554f0 2024-01-22T05:04:41.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.397+0000 7f2576a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780beae0 0x7f25780bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:41.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.397+0000 7f2576a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780beae0 0x7f25780bdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54378/0 (socket says 172.21.15.49:54378) 2024-01-22T05:04:41.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.397+0000 7f2576a00700 1 -- 172.21.15.49:0/1838333754 learned_addr learned my addr 172.21.15.49:0/1838333754 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:41.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.397+0000 7f2577e00700 1 --2- 172.21.15.49:0/1838333754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25781554f0 0x7f25780be260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:41.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.397+0000 7f2577400700 1 --2- 172.21.15.49:0/1838333754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2578067a90 0x7f2578141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:41.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.401+0000 7f2576a00700 1 -- 172.21.15.49:0/1838333754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25781554f0 msgr2=0x7f25780be260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:41.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.401+0000 7f2576a00700 1 --2- 172.21.15.49:0/1838333754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25781554f0 0x7f25780be260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:41.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.401+0000 7f2576a00700 1 -- 172.21.15.49:0/1838333754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2578067a90 msgr2=0x7f2578141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:41.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.401+0000 7f2576a00700 1 --2- 172.21.15.49:0/1838333754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2578067a90 0x7f2578141090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:41.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.401+0000 7f2576a00700 1 -- 172.21.15.49:0/1838333754 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2570009a20 con 0x7f25780beae0 2024-01-22T05:04:41.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.401+0000 7f2576a00700 1 --2- 172.21.15.49:0/1838333754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780beae0 0x7f25780bdd70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f256000c440 tx=0x7f2560007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:41.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.401+0000 7f256ea00700 1 -- 172.21.15.49:0/1838333754 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560012400 con 0x7f25780beae0 2024-01-22T05:04:41.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.401+0000 7f256ea00700 1 -- 172.21.15.49:0/1838333754 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2560012560 con 0x7f25780beae0 2024-01-22T05:04:41.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.401+0000 7f256ea00700 1 -- 172.21.15.49:0/1838333754 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560012920 con 0x7f25780beae0 2024-01-22T05:04:41.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.401+0000 7f257e200700 1 -- 172.21.15.49:0/1838333754 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25781622b0 con 0x7f25780beae0 2024-01-22T05:04:41.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.401+0000 7f257e200700 1 -- 172.21.15.49:0/1838333754 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2578162870 con 0x7f25780beae0 2024-01-22T05:04:41.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.401+0000 7f257e200700 1 -- 172.21.15.49:0/1838333754 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2578047060 con 0x7f25780beae0 2024-01-22T05:04:41.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.405+0000 7f256ea00700 1 -- 172.21.15.49:0/1838333754 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f256001b3b0 con 0x7f25780beae0 2024-01-22T05:04:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.405+0000 7f256ea00700 1 --2- 172.21.15.49:0/1838333754 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f255005a510 0x7f255005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.405+0000 7f256ea00700 1 -- 172.21.15.49:0/1838333754 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f2560074290 con 0x7f25780beae0 2024-01-22T05:04:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.405+0000 7f2577400700 1 --2- 172.21.15.49:0/1838333754 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f255005a510 0x7f255005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:41.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.409+0000 7f2577400700 1 --2- 172.21.15.49:0/1838333754 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f255005a510 0x7f255005c9d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2568001260 tx=0x7f2568009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:41.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.413+0000 7f256ea00700 1 -- 172.21.15.49:0/1838333754 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2560047700 con 0x7f25780beae0 2024-01-22T05:04:41.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.577+0000 7f257e200700 1 -- 172.21.15.49:0/1838333754 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2578069a00 con 0x7f25780beae0 2024-01-22T05:04:41.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.577+0000 7f256ea00700 1 -- 172.21.15.49:0/1838333754 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f256004ad20 con 0x7f25780beae0 2024-01-22T05:04:41.585 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:41.585 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:39.526211+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:04:41.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.581+0000 7f257e200700 1 -- 172.21.15.49:0/1838333754 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f255005a510 msgr2=0x7f255005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:41.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.581+0000 7f257e200700 1 --2- 172.21.15.49:0/1838333754 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f255005a510 0x7f255005c9d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2568001260 tx=0x7f2568009040).stop 2024-01-22T05:04:41.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.581+0000 7f257e200700 1 -- 172.21.15.49:0/1838333754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780beae0 msgr2=0x7f25780bdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:41.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.581+0000 7f257e200700 1 --2- 172.21.15.49:0/1838333754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780beae0 0x7f25780bdd70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f256000c440 tx=0x7f2560007c90).stop 2024-01-22T05:04:41.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.585+0000 7f257e200700 1 -- 172.21.15.49:0/1838333754 shutdown_connections 2024-01-22T05:04:41.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.585+0000 7f257e200700 1 --2- 172.21.15.49:0/1838333754 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f255005a510 0x7f255005c9d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.585+0000 7f257e200700 1 --2- 172.21.15.49:0/1838333754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25781554f0 0x7f25780be260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.585+0000 7f257e200700 1 --2- 172.21.15.49:0/1838333754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25780beae0 0x7f25780bdd70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.585+0000 7f257e200700 1 --2- 172.21.15.49:0/1838333754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2578067a90 0x7f2578141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:41.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.585+0000 7f257e200700 1 -- 172.21.15.49:0/1838333754 >> 172.21.15.49:0/1838333754 conn(0x7f25780c8710 msgr2=0x7f2578153050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:41.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.585+0000 7f257e200700 1 -- 172.21.15.49:0/1838333754 shutdown_connections 2024-01-22T05:04:41.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:41.585+0000 7f257e200700 1 -- 172.21.15.49:0/1838333754 wait complete. 2024-01-22T05:04:42.016 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:04:35.017706+0000', 'modified': '2024-01-22T05:04:39.526774+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.110:6835/3391981756', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6834', 'nonce': 3391981756}, {'type': 'v1', 'addr': '172.21.15.110:6835', 'nonce': 3391981756}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2024-01-22T05:04:42.016 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:04:42.017 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-22T05:04:42.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.185+0000 7f9625e00700 1 Processor -- start 2024-01-22T05:04:42.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.185+0000 7f9625e00700 1 -- start start 2024-01-22T05:04:42.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.189+0000 7f9625e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96201554a0 0x7f9620067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.189+0000 7f9625e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f96200c8e70 0x7f96200c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.189+0000 7f9625e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96200c5840 con 0x7f9620151350 2024-01-22T05:04:42.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.189+0000 7f9625e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9620155cf0 con 0x7f96200c8e70 2024-01-22T05:04:42.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.189+0000 7f9625e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9620155fd0 con 0x7f96201554a0 2024-01-22T05:04:42.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.189+0000 7f961fe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9620151350 0x7f9620151800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39720/0 (socket says 172.21.15.49:39720) 2024-01-22T05:04:42.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.189+0000 7f961fe00700 1 -- 172.21.15.49:0/1144367794 learned_addr learned my addr 172.21.15.49:0/1144367794 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:42.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.189+0000 7f961ea00700 1 --2- 172.21.15.49:0/1144367794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96201554a0 0x7f9620067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.189+0000 7f961e000700 1 --2- 172.21.15.49:0/1144367794 >> v2:172.21.15.110:3300/0 conn(0x7f96200c8e70 0x7f96200c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.189+0000 7f961d600700 1 -- 172.21.15.49:0/1144367794 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589882907 0 0) 0x7f96200c5840 con 0x7f9620151350 2024-01-22T05:04:42.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.189+0000 7f961ea00700 1 -- 172.21.15.49:0/1144367794 >> v2:172.21.15.110:3300/0 conn(0x7f96200c8e70 msgr2=0x7f96200c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:42.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.193+0000 7f961ea00700 1 --2- 172.21.15.49:0/1144367794 >> v2:172.21.15.110:3300/0 conn(0x7f96200c8e70 0x7f96200c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.193+0000 7f961ea00700 1 -- 172.21.15.49:0/1144367794 >> v1:172.21.15.49:6789/0 conn(0x7f9620151350 legacy=0x7f9620151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.193+0000 7f961ea00700 1 -- 172.21.15.49:0/1144367794 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96201562b0 con 0x7f96201554a0 2024-01-22T05:04:42.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.193+0000 7f961ea00700 1 --2- 172.21.15.49:0/1144367794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96201554a0 0x7f9620067a90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f9610009760 tx=0x7f9610009060).ready entity=mon.2 client_cookie=2c906205c3e5d719 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:42.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.193+0000 7f961d600700 1 -- 172.21.15.49:0/1144367794 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961000f510 con 0x7f96201554a0 2024-01-22T05:04:42.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.193+0000 7f961d600700 1 -- 172.21.15.49:0/1144367794 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961000f670 con 0x7f96201554a0 2024-01-22T05:04:42.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.193+0000 7f961d600700 1 -- 172.21.15.49:0/1144367794 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961000f9f0 con 0x7f96201554a0 2024-01-22T05:04:42.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.193+0000 7f9625e00700 1 -- 172.21.15.49:0/1144367794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96201554a0 msgr2=0x7f9620067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.193+0000 7f9625e00700 1 --2- 172.21.15.49:0/1144367794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96201554a0 0x7f9620067a90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f9610009760 tx=0x7f9610009060).stop 2024-01-22T05:04:42.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.193+0000 7f9625e00700 1 -- 172.21.15.49:0/1144367794 shutdown_connections 2024-01-22T05:04:42.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.193+0000 7f9625e00700 1 --2- 172.21.15.49:0/1144367794 >> v2:172.21.15.110:3300/0 conn(0x7f96200c8e70 0x7f96200c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.193+0000 7f9625e00700 1 --2- 172.21.15.49:0/1144367794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96201554a0 0x7f9620067a90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.193+0000 7f9625e00700 1 -- 172.21.15.49:0/1144367794 >> 172.21.15.49:0/1144367794 conn(0x7f96200c9f50 msgr2=0x7f96200ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:42.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.193+0000 7f9625e00700 1 -- 172.21.15.49:0/1144367794 shutdown_connections 2024-01-22T05:04:42.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.193+0000 7f9625e00700 1 -- 172.21.15.49:0/1144367794 wait complete. 2024-01-22T05:04:42.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.197+0000 7f9625e00700 1 Processor -- start 2024-01-22T05:04:42.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.197+0000 7f9625e00700 1 -- start start 2024-01-22T05:04:42.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f9625e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c8e70 0x7f96200639d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f9625e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9620151350 0x7f96200c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f9625e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96201554a0 0x7f96200af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f9625e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96200c1100 con 0x7f96200c8e70 2024-01-22T05:04:42.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f9625e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96200aee30 con 0x7f9620151350 2024-01-22T05:04:42.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f9625e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96200ae220 con 0x7f96201554a0 2024-01-22T05:04:42.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f961ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c8e70 0x7f96200639d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f961ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c8e70 0x7f96200639d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54386/0 (socket says 172.21.15.49:54386) 2024-01-22T05:04:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f961ea00700 1 -- 172.21.15.49:0/2493996196 learned_addr learned my addr 172.21.15.49:0/2493996196 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f961e000700 1 --2- 172.21.15.49:0/2493996196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9620151350 0x7f96200c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f961fe00700 1 --2- 172.21.15.49:0/2493996196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96201554a0 0x7f96200af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f961ea00700 1 -- 172.21.15.49:0/2493996196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96201554a0 msgr2=0x7f96200af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f961ea00700 1 --2- 172.21.15.49:0/2493996196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96201554a0 0x7f96200af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f961ea00700 1 -- 172.21.15.49:0/2493996196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9620151350 msgr2=0x7f96200c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f961ea00700 1 --2- 172.21.15.49:0/2493996196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9620151350 0x7f96200c3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f961ea00700 1 -- 172.21.15.49:0/2493996196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96100092a0 con 0x7f96200c8e70 2024-01-22T05:04:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f961e000700 1 --2- 172.21.15.49:0/2493996196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9620151350 0x7f96200c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:42.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f961ea00700 1 --2- 172.21.15.49:0/2493996196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c8e70 0x7f96200639d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9610009e00 tx=0x7f9610017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:42.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f9616000700 1 -- 172.21.15.49:0/2493996196 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961000f7e0 con 0x7f96200c8e70 2024-01-22T05:04:42.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f9616000700 1 -- 172.21.15.49:0/2493996196 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961000f940 con 0x7f96200c8e70 2024-01-22T05:04:42.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f9616000700 1 -- 172.21.15.49:0/2493996196 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961001b660 con 0x7f96200c8e70 2024-01-22T05:04:42.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f9625e00700 1 -- 172.21.15.49:0/2493996196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96200ae500 con 0x7f96200c8e70 2024-01-22T05:04:42.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.201+0000 7f9625e00700 1 -- 172.21.15.49:0/2493996196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96200aeac0 con 0x7f96200c8e70 2024-01-22T05:04:42.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.205+0000 7f9616000700 1 -- 172.21.15.49:0/2493996196 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f961001ba50 con 0x7f96200c8e70 2024-01-22T05:04:42.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.205+0000 7f9616000700 1 --2- 172.21.15.49:0/2493996196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f95f805a510 0x7f95f805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.209+0000 7f9616000700 1 -- 172.21.15.49:0/2493996196 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f9610076400 con 0x7f96200c8e70 2024-01-22T05:04:42.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.209+0000 7f961e000700 1 --2- 172.21.15.49:0/2493996196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f95f805a510 0x7f95f805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.209+0000 7f9630200740 1 Processor -- start 2024-01-22T05:04:42.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.209+0000 7f961e000700 1 --2- 172.21.15.49:0/2493996196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f95f805a510 0x7f95f805c9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9620064300 tx=0x7f9608008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:42.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.209+0000 7f9630200740 1 -- start start 2024-01-22T05:04:42.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.209+0000 7f9630200740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12283a0 0x1228780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.209+0000 7f9630200740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 0x11e68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.209+0000 7f9630200740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11e7e40 0x11e0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.209+0000 7f9630200740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1167410 con 0x12283a0 2024-01-22T05:04:42.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.209+0000 7f9630200740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1167550 con 0x122ac80 2024-01-22T05:04:42.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.209+0000 7f9630200740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1167a00 con 0x11e7e40 2024-01-22T05:04:42.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f961ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12283a0 0x1228780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f961ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12283a0 0x1228780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54394/0 (socket says 172.21.15.49:54394) 2024-01-22T05:04:42.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f961ea00700 1 -- 172.21.15.49:0/2069246191 learned_addr learned my addr 172.21.15.49:0/2069246191 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:42.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f961e000700 1 --2- 172.21.15.49:0/2069246191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 0x11e68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f961fe00700 1 --2- 172.21.15.49:0/2069246191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11e7e40 0x11e0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f961ea00700 1 -- 172.21.15.49:0/2069246191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11e7e40 msgr2=0x11e0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:42.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f961ea00700 1 --2- 172.21.15.49:0/2069246191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11e7e40 0x11e0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f961ea00700 1 -- 172.21.15.49:0/2069246191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 msgr2=0x11e68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:42.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f961ea00700 1 --2- 172.21.15.49:0/2069246191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 0x11e68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f961ea00700 1 -- 172.21.15.49:0/2069246191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1160730 con 0x12283a0 2024-01-22T05:04:42.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f961ea00700 1 --2- 172.21.15.49:0/2069246191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12283a0 0x1228780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f961004d2f0 tx=0x7f961000e000).ready entity=mon.0 client_cookie=53a059e33a5c0af server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:42.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f960ea00700 1 -- 172.21.15.49:0/2069246191 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961004b870 con 0x12283a0 2024-01-22T05:04:42.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f960ea00700 1 -- 172.21.15.49:0/2069246191 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96100760a0 con 0x12283a0 2024-01-22T05:04:42.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f960ea00700 1 -- 172.21.15.49:0/2069246191 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610076210 con 0x12283a0 2024-01-22T05:04:42.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f9630200740 1 -- 172.21.15.49:0/2069246191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12283a0 msgr2=0x1228780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f9630200740 1 --2- 172.21.15.49:0/2069246191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12283a0 0x1228780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f961004d2f0 tx=0x7f961000e000).stop 2024-01-22T05:04:42.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f9630200740 1 -- 172.21.15.49:0/2069246191 shutdown_connections 2024-01-22T05:04:42.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f9630200740 1 --2- 172.21.15.49:0/2069246191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11e7e40 0x11e0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f9630200740 1 --2- 172.21.15.49:0/2069246191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 0x11e68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f9630200740 1 --2- 172.21.15.49:0/2069246191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12283a0 0x1228780 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f9630200740 1 -- 172.21.15.49:0/2069246191 >> 172.21.15.49:0/2069246191 conn(0xfc5550 msgr2=0x11e7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:42.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f9630200740 1 -- 172.21.15.49:0/2069246191 shutdown_connections 2024-01-22T05:04:42.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f9630200740 1 -- 172.21.15.49:0/2069246191 wait complete. 2024-01-22T05:04:42.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.213+0000 7f9630200740 1 -- start start 2024-01-22T05:04:42.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f9630200740 1 Processor -- start 2024-01-22T05:04:42.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f9630200740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11e7e40 0x1242490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f9630200740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12283a0 0x120c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f9630200740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x122ac80 0x1212340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f9630200740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1132650 con 0x11e7e40 2024-01-22T05:04:42.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f9630200740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1210d80 con 0x12283a0 2024-01-22T05:04:42.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f9630200740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1211060 con 0x122ac80 2024-01-22T05:04:42.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f9630200740 10 client.0 ll_register_callbacks cb 0x119f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:04:42.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f961ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11e7e40 0x1242490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f961ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11e7e40 0x1242490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54400/0 (socket says 172.21.15.49:54400) 2024-01-22T05:04:42.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f961ea00700 1 -- 172.21.15.49:0/1207235875 learned_addr learned my addr 172.21.15.49:0/1207235875 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:42.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f961e000700 1 --2- 172.21.15.49:0/1207235875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12283a0 0x120c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f961fe00700 1 --2- 172.21.15.49:0/1207235875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x122ac80 0x1212340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f961ea00700 1 -- 172.21.15.49:0/1207235875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x122ac80 msgr2=0x1212340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:42.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f961ea00700 1 --2- 172.21.15.49:0/1207235875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x122ac80 0x1212340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f961ea00700 1 -- 172.21.15.49:0/1207235875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12283a0 msgr2=0x120c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:42.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f961ea00700 1 --2- 172.21.15.49:0/1207235875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12283a0 0x120c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f961ea00700 1 -- 172.21.15.49:0/1207235875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96200aeac0 con 0x11e7e40 2024-01-22T05:04:42.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.217+0000 7f961ea00700 1 --2- 172.21.15.49:0/1207235875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11e7e40 0x1242490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f9610051040 tx=0x7f961004f000).ready entity=mon.0 client_cookie=76f955b27aeedf61 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:42.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9607400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:04:42.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9607400700 1 -- 172.21.15.49:0/1207235875 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610049be0 con 0x11e7e40 2024-01-22T05:04:42.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9607400700 1 -- 172.21.15.49:0/1207235875 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f9610049d40 con 0x11e7e40 2024-01-22T05:04:42.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9630200740 1 -- 172.21.15.49:0/1207235875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x115d1a0 con 0x11e7e40 2024-01-22T05:04:42.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9607400700 1 -- 172.21.15.49:0/1207235875 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9610024570 con 0x11e7e40 2024-01-22T05:04:42.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9630200740 10 client.4428 fetch_fsmap learned FSMap version 7 2024-01-22T05:04:42.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9630200740 1 -- 172.21.15.49:0/1207235875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x115b960 con 0x11e7e40 2024-01-22T05:04:42.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9607400700 1 -- 172.21.15.49:0/1207235875 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x115d1a0 con 0x11e7e40 2024-01-22T05:04:42.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9607400700 1 -- 172.21.15.49:0/1207235875 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f961004c9c0 con 0x11e7e40 2024-01-22T05:04:42.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9630200740 10 client.4428 fetch_fsmap finished waiting for FSMap version 7 2024-01-22T05:04:42.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9630200740 10 client.4428 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-22T05:04:42.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9630200740 20 client.4428 populate_metadata read hostname 'smithi049' 2024-01-22T05:04:42.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9630200740 1 --2- 172.21.15.49:0/1207235875 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x120b240 0x120b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9630200740 4 client.4428 mds_command: new command op to 4288 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:04:42.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9630200740 1 -- 172.21.15.49:0/1207235875 --> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11536f0 con 0x120b240 2024-01-22T05:04:42.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f961e000700 1 --2- 172.21.15.49:0/1207235875 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x120b240 0x120b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f9607400700 10 client.4428 ms_handle_connect on v2:172.21.15.110:6834/3391981756 2024-01-22T05:04:42.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.221+0000 7f961e000700 1 --2- 172.21.15.49:0/1207235875 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x120b240 0x120b620 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ba4c29f65380110a server_cookie=623db7cafae5aeb2 in_seq=0 out_seq=0 2024-01-22T05:04:42.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.225+0000 7f9607400700 1 -- 172.21.15.49:0/1207235875 <== mds.0 v2:172.21.15.110:6834/3391981756 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x11536f0 con 0x120b240 2024-01-22T05:04:42.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.225+0000 7f9607400700 10 client.4428 handle_command_reply: tid=0 2024-01-22T05:04:42.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.225+0000 7f9630200740 1 client.4428 shutdown 2024-01-22T05:04:42.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.225+0000 7f9630200740 1 -- 172.21.15.49:0/1207235875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11e7e40 msgr2=0x1242490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.225+0000 7f9630200740 1 --2- 172.21.15.49:0/1207235875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11e7e40 0x1242490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f9610051040 tx=0x7f961004f000).stop 2024-01-22T05:04:42.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.225+0000 7f9630200740 1 -- 172.21.15.49:0/1207235875 shutdown_connections 2024-01-22T05:04:42.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.225+0000 7f9630200740 1 --2- 172.21.15.49:0/1207235875 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x120b240 0x120b620 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.225+0000 7f9630200740 1 --2- 172.21.15.49:0/1207235875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x122ac80 0x1212340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.225+0000 7f9630200740 1 --2- 172.21.15.49:0/1207235875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12283a0 0x120c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.225+0000 7f9630200740 1 --2- 172.21.15.49:0/1207235875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11e7e40 0x1242490 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.225+0000 7f9607400700 0 client.4428 ms_handle_reset on v2:172.21.15.110:6834/3391981756 2024-01-22T05:04:42.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.225+0000 7f9630200740 1 -- 172.21.15.49:0/1207235875 >> 172.21.15.49:0/1207235875 conn(0xfc5550 msgr2=0x122e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:42.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.225+0000 7f9630200740 1 -- 172.21.15.49:0/1207235875 shutdown_connections 2024-01-22T05:04:42.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.225+0000 7f9630200740 1 -- 172.21.15.49:0/1207235875 wait complete. 2024-01-22T05:04:42.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.225+0000 7f9630200740 20 client.4428 trim_cache size 0 max 16384 2024-01-22T05:04:42.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.245+0000 7f9630200740 1 Processor -- start 2024-01-22T05:04:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.245+0000 7f9630200740 1 -- start start 2024-01-22T05:04:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.245+0000 7f9630200740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11e7e40 0x1241a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.245+0000 7f9630200740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x12283a0 0x11e7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.245+0000 7f9630200740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 0x1242460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.245+0000 7f9630200740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x115b960 con 0x11e7e40 2024-01-22T05:04:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.245+0000 7f9630200740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x11394a0 con 0x122ac80 2024-01-22T05:04:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.245+0000 7f9630200740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1140000 con 0x12283a0 2024-01-22T05:04:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.245+0000 7f961ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11e7e40 0x1241a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.245+0000 7f961fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 0x1242460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.245+0000 7f961ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11e7e40 0x1241a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54406/0 (socket says 172.21.15.49:54406) 2024-01-22T05:04:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.245+0000 7f961ea00700 1 -- 172.21.15.49:0/1634548442 learned_addr learned my addr 172.21.15.49:0/1634548442 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:42.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.245+0000 7f961e000700 1 --2- 172.21.15.49:0/1634548442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x12283a0 0x11e7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.245+0000 7f961ea00700 1 -- 172.21.15.49:0/1634548442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x12283a0 msgr2=0x11e7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.245+0000 7f961ea00700 1 --2- 172.21.15.49:0/1634548442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x12283a0 0x11e7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f961ea00700 1 -- 172.21.15.49:0/1634548442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 msgr2=0x1242460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f961ea00700 1 --2- 172.21.15.49:0/1634548442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 0x1242460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f961ea00700 1 -- 172.21.15.49:0/1634548442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96201542b0 con 0x11e7e40 2024-01-22T05:04:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f961fe00700 1 --2- 172.21.15.49:0/1634548442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 0x1242460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f961ea00700 1 --2- 172.21.15.49:0/1634548442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11e7e40 0x1241a80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f961004d400 tx=0x7f9610032070).ready entity=mon.0 client_cookie=ae12012d07d11dc0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:42.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f960f400700 1 -- 172.21.15.49:0/1634548442 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610024570 con 0x11e7e40 2024-01-22T05:04:42.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f960f400700 1 -- 172.21.15.49:0/1634548442 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961004b610 con 0x11e7e40 2024-01-22T05:04:42.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f960f400700 1 -- 172.21.15.49:0/1634548442 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100494a0 con 0x11e7e40 2024-01-22T05:04:42.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f9630200740 1 -- 172.21.15.49:0/1634548442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11e7e40 msgr2=0x1241a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f9630200740 1 --2- 172.21.15.49:0/1634548442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11e7e40 0x1241a80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f961004d400 tx=0x7f9610032070).stop 2024-01-22T05:04:42.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f9630200740 1 -- 172.21.15.49:0/1634548442 shutdown_connections 2024-01-22T05:04:42.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f9630200740 1 --2- 172.21.15.49:0/1634548442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 0x1242460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f9630200740 1 --2- 172.21.15.49:0/1634548442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x12283a0 0x11e7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f9630200740 1 --2- 172.21.15.49:0/1634548442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11e7e40 0x1241a80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f9630200740 1 -- 172.21.15.49:0/1634548442 >> 172.21.15.49:0/1634548442 conn(0xfc5550 msgr2=0x11e2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f9630200740 1 -- 172.21.15.49:0/1634548442 shutdown_connections 2024-01-22T05:04:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f9630200740 1 -- 172.21.15.49:0/1634548442 wait complete. 2024-01-22T05:04:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.249+0000 7f9630200740 1 -- start start 2024-01-22T05:04:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f9630200740 1 Processor -- start 2024-01-22T05:04:42.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f9630200740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11e7e40 0x1296690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f9630200740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12283a0 0x120fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f9630200740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 0x1210120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f9630200740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1210610 con 0x12283a0 2024-01-22T05:04:42.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f9630200740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x11e14c0 con 0x122ac80 2024-01-22T05:04:42.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f9630200740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x120c6d0 con 0x11e7e40 2024-01-22T05:04:42.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f9630200740 10 client.0 ll_register_callbacks cb 0x7f9610009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:04:42.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f961e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12283a0 0x120fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f961e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12283a0 0x120fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54418/0 (socket says 172.21.15.49:54418) 2024-01-22T05:04:42.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f961e000700 1 -- 172.21.15.49:0/1250533581 learned_addr learned my addr 172.21.15.49:0/1250533581 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:42.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f961ea00700 1 --2- 172.21.15.49:0/1250533581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11e7e40 0x1296690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f961fe00700 1 --2- 172.21.15.49:0/1250533581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 0x1210120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f961e000700 1 -- 172.21.15.49:0/1250533581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11e7e40 msgr2=0x1296690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:42.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f961e000700 1 --2- 172.21.15.49:0/1250533581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11e7e40 0x1296690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f961e000700 1 -- 172.21.15.49:0/1250533581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 msgr2=0x1210120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:42.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.253+0000 7f961e000700 1 --2- 172.21.15.49:0/1250533581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 0x1210120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f961e000700 1 -- 172.21.15.49:0/1250533581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9618007050 con 0x12283a0 2024-01-22T05:04:42.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f961e000700 1 --2- 172.21.15.49:0/1250533581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12283a0 0x120fc30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x11e2420 tx=0x7f9608016000).ready entity=mon.0 client_cookie=10699b16c8e3ec23 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:42.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9607400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:04:42.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9607400700 1 -- 172.21.15.49:0/1250533581 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608015db0 con 0x12283a0 2024-01-22T05:04:42.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9630200740 1 -- 172.21.15.49:0/1250533581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96100760a0 con 0x12283a0 2024-01-22T05:04:42.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9607400700 1 -- 172.21.15.49:0/1250533581 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f9608023440 con 0x12283a0 2024-01-22T05:04:42.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9607400700 1 -- 172.21.15.49:0/1250533581 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9608023810 con 0x12283a0 2024-01-22T05:04:42.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9630200740 10 client.4434 fetch_fsmap learned FSMap version 7 2024-01-22T05:04:42.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9630200740 1 -- 172.21.15.49:0/1250533581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x7f961003e070 con 0x12283a0 2024-01-22T05:04:42.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9607400700 1 -- 172.21.15.49:0/1250533581 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96100760a0 con 0x12283a0 2024-01-22T05:04:42.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9607400700 1 -- 172.21.15.49:0/1250533581 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f9608023970 con 0x12283a0 2024-01-22T05:04:42.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9630200740 10 client.4434 fetch_fsmap finished waiting for FSMap version 7 2024-01-22T05:04:42.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9630200740 10 client.4434 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-22T05:04:42.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9630200740 20 client.4434 populate_metadata read hostname 'smithi049' 2024-01-22T05:04:42.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9630200740 1 --2- 172.21.15.49:0/1250533581 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x1209280 0x1209660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9630200740 4 client.4434 mds_command: new command op to 4288 tid=0[{"prefix": "status"}] 2024-01-22T05:04:42.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9630200740 1 -- 172.21.15.49:0/1250533581 --> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] -- command(tid 0: {"prefix": "status"}) v1 -- 0x101c4e0 con 0x1209280 2024-01-22T05:04:42.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f961ea00700 1 --2- 172.21.15.49:0/1250533581 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x1209280 0x1209660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f961ea00700 1 --2- 172.21.15.49:0/1250533581 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x1209280 0x1209660 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9c57eae4ae9f811c server_cookie=3bf0a1f0f66de372 in_seq=0 out_seq=0 2024-01-22T05:04:42.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.257+0000 7f9607400700 10 client.4434 ms_handle_connect on v2:172.21.15.110:6834/3391981756 2024-01-22T05:04:42.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9607400700 1 -- 172.21.15.49:0/1250533581 <== mds.0 v2:172.21.15.110:6834/3391981756 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x101c4e0 con 0x1209280 2024-01-22T05:04:42.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9607400700 10 client.4434 handle_command_reply: tid=0 2024-01-22T05:04:42.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9630200740 1 client.4434 shutdown 2024-01-22T05:04:42.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9630200740 1 -- 172.21.15.49:0/1250533581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12283a0 msgr2=0x120fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9630200740 1 --2- 172.21.15.49:0/1250533581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12283a0 0x120fc30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x11e2420 tx=0x7f9608016000).stop 2024-01-22T05:04:42.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9630200740 1 -- 172.21.15.49:0/1250533581 shutdown_connections 2024-01-22T05:04:42.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9630200740 1 --2- 172.21.15.49:0/1250533581 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x1209280 0x1209660 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9630200740 1 --2- 172.21.15.49:0/1250533581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x122ac80 0x1210120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9630200740 1 --2- 172.21.15.49:0/1250533581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12283a0 0x120fc30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9630200740 1 --2- 172.21.15.49:0/1250533581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11e7e40 0x1296690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9630200740 1 -- 172.21.15.49:0/1250533581 >> 172.21.15.49:0/1250533581 conn(0xfc5550 msgr2=0x122d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:42.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9607400700 0 client.4434 ms_handle_reset on v2:172.21.15.110:6834/3391981756 2024-01-22T05:04:42.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9630200740 1 -- 172.21.15.49:0/1250533581 shutdown_connections 2024-01-22T05:04:42.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9630200740 1 -- 172.21.15.49:0/1250533581 wait complete. 2024-01-22T05:04:42.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9630200740 20 client.4434 trim_cache size 0 max 16384 2024-01-22T05:04:42.269 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:04:42.269 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:04:42.269 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:04:42.269 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4288, 2024-01-22T05:04:42.269 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:04:42.269 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:04:42.269 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:04:42.269 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 7.2404913710000001, 2024-01-22T05:04:42.269 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 7, 2024-01-22T05:04:42.269 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 25, 2024-01-22T05:04:42.269 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 24, 2024-01-22T05:04:42.270 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 12.714666479 2024-01-22T05:04:42.270 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:04:42.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9625e00700 1 -- 172.21.15.49:0/2493996196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f95f805a510 msgr2=0x7f95f805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9625e00700 1 --2- 172.21.15.49:0/2493996196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f95f805a510 0x7f95f805c9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9620064300 tx=0x7f9608008040).stop 2024-01-22T05:04:42.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9625e00700 1 -- 172.21.15.49:0/2493996196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c8e70 msgr2=0x7f96200639d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9625e00700 1 --2- 172.21.15.49:0/2493996196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c8e70 0x7f96200639d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9610009e00 tx=0x7f9610017000).stop 2024-01-22T05:04:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9625e00700 1 -- 172.21.15.49:0/2493996196 shutdown_connections 2024-01-22T05:04:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9625e00700 1 --2- 172.21.15.49:0/2493996196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f95f805a510 0x7f95f805c9d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9625e00700 1 --2- 172.21.15.49:0/2493996196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96201554a0 0x7f96200af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9625e00700 1 --2- 172.21.15.49:0/2493996196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9620151350 0x7f96200c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9625e00700 1 --2- 172.21.15.49:0/2493996196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96200c8e70 0x7f96200639d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.261+0000 7f9625e00700 1 -- 172.21.15.49:0/2493996196 >> 172.21.15.49:0/2493996196 conn(0x7f96200c9f50 msgr2=0x7f9620064440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.265+0000 7f9625e00700 1 -- 172.21.15.49:0/2493996196 shutdown_connections 2024-01-22T05:04:42.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.265+0000 7f9625e00700 1 -- 172.21.15.49:0/2493996196 wait complete. 2024-01-22T05:04:42.292 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:04:42.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.433+0000 7f80b1a00700 1 Processor -- start 2024-01-22T05:04:42.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.433+0000 7f80b1a00700 1 -- start start 2024-01-22T05:04:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.433+0000 7f80b1a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f80ac158090 0x7f80ac063300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.433+0000 7f80b1a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80ac0637f0 0x7f80ac064ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.433+0000 7f80b1a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ac062e70 con 0x7f80ac064fa0 2024-01-22T05:04:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.433+0000 7f80b1a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ac158470 con 0x7f80ac158090 2024-01-22T05:04:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.433+0000 7f80b1a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0622d0 con 0x7f80ac0637f0 2024-01-22T05:04:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.437+0000 7f80aa000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80ac0637f0 0x7f80ac064ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.437+0000 7f80aaa00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f80ac158090 0x7f80ac063300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.437+0000 7f80aa000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80ac0637f0 0x7f80ac064ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:40160/0 (socket says 172.21.15.49:40160) 2024-01-22T05:04:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.437+0000 7f80aaa00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f80ac158090 0x7f80ac063300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:45076/0 (socket says 172.21.15.49:45076) 2024-01-22T05:04:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.437+0000 7f80aa000700 1 -- 172.21.15.49:0/1071260551 learned_addr learned my addr 172.21.15.49:0/1071260551 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.437+0000 7f80aaa00700 1 -- 172.21.15.49:0/1071260551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80ac0637f0 msgr2=0x7f80ac064ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:42.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.437+0000 7f80aaa00700 1 --2- 172.21.15.49:0/1071260551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80ac0637f0 0x7f80ac064ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.437+0000 7f80aaa00700 1 -- 172.21.15.49:0/1071260551 >> v1:172.21.15.110:6789/0 conn(0x7f80ac064fa0 legacy=0x7f80ac0c10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.437+0000 7f80aaa00700 1 -- 172.21.15.49:0/1071260551 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac065410 con 0x7f80ac158090 2024-01-22T05:04:42.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.437+0000 7f80aaa00700 1 --2- 172.21.15.49:0/1071260551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80ac158090 0x7f80ac063300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f809c009760 tx=0x7f809c009060).ready entity=mon.1 client_cookie=73f6291ffc350271 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:42.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.437+0000 7f80a9600700 1 -- 172.21.15.49:0/1071260551 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c00f510 con 0x7f80ac158090 2024-01-22T05:04:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.437+0000 7f80a9600700 1 -- 172.21.15.49:0/1071260551 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c00f670 con 0x7f80ac158090 2024-01-22T05:04:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.437+0000 7f80a9600700 1 -- 172.21.15.49:0/1071260551 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c00f9f0 con 0x7f80ac158090 2024-01-22T05:04:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.441+0000 7f80b1a00700 1 -- 172.21.15.49:0/1071260551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80ac158090 msgr2=0x7f80ac063300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.441+0000 7f80b1a00700 1 --2- 172.21.15.49:0/1071260551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80ac158090 0x7f80ac063300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f809c009760 tx=0x7f809c009060).stop 2024-01-22T05:04:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.441+0000 7f80b1a00700 1 -- 172.21.15.49:0/1071260551 shutdown_connections 2024-01-22T05:04:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.441+0000 7f80b1a00700 1 --2- 172.21.15.49:0/1071260551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80ac0637f0 0x7f80ac064ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.441+0000 7f80b1a00700 1 --2- 172.21.15.49:0/1071260551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80ac158090 0x7f80ac063300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.441+0000 7f80b1a00700 1 -- 172.21.15.49:0/1071260551 >> 172.21.15.49:0/1071260551 conn(0x7f80ac0c30c0 msgr2=0x7f80ac0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.441+0000 7f80b1a00700 1 -- 172.21.15.49:0/1071260551 shutdown_connections 2024-01-22T05:04:42.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.441+0000 7f80b1a00700 1 -- 172.21.15.49:0/1071260551 wait complete. 2024-01-22T05:04:42.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.441+0000 7f80b1a00700 1 Processor -- start 2024-01-22T05:04:42.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80b1a00700 1 -- start start 2024-01-22T05:04:42.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80b1a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ac0637f0 0x7f80ac150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80b1a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80ac064fa0 0x7f80ac0ab490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80b1a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80ac158090 0x7f80ac0ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80b1a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac15a050 con 0x7f80ac0637f0 2024-01-22T05:04:42.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80b1a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0abe70 con 0x7f80ac158090 2024-01-22T05:04:42.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80b1a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac1593d0 con 0x7f80ac064fa0 2024-01-22T05:04:42.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80aaa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ac0637f0 0x7f80ac150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80aaa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ac0637f0 0x7f80ac150500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54434/0 (socket says 172.21.15.49:54434) 2024-01-22T05:04:42.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80aaa00700 1 -- 172.21.15.49:0/4231218475 learned_addr learned my addr 172.21.15.49:0/4231218475 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:42.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80ab400700 1 --2- 172.21.15.49:0/4231218475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80ac158090 0x7f80ac0ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80aa000700 1 --2- 172.21.15.49:0/4231218475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80ac064fa0 0x7f80ac0ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80aaa00700 1 -- 172.21.15.49:0/4231218475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80ac064fa0 msgr2=0x7f80ac0ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80aaa00700 1 --2- 172.21.15.49:0/4231218475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80ac064fa0 0x7f80ac0ab490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80aaa00700 1 -- 172.21.15.49:0/4231218475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80ac158090 msgr2=0x7f80ac0ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80aaa00700 1 --2- 172.21.15.49:0/4231218475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80ac158090 0x7f80ac0ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.445+0000 7f80aaa00700 1 -- 172.21.15.49:0/4231218475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c0092a0 con 0x7f80ac0637f0 2024-01-22T05:04:42.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.449+0000 7f80aaa00700 1 --2- 172.21.15.49:0/4231218475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ac0637f0 0x7f80ac150500 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f80ac063d80 tx=0x7f809c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:42.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.449+0000 7f80a2000700 1 -- 172.21.15.49:0/4231218475 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c00f7e0 con 0x7f80ac0637f0 2024-01-22T05:04:42.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.449+0000 7f80a2000700 1 -- 172.21.15.49:0/4231218475 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c00f940 con 0x7f80ac0637f0 2024-01-22T05:04:42.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.449+0000 7f80a2000700 1 -- 172.21.15.49:0/4231218475 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c01b660 con 0x7f80ac0637f0 2024-01-22T05:04:42.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.449+0000 7f80b1a00700 1 -- 172.21.15.49:0/4231218475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ac1596b0 con 0x7f80ac0637f0 2024-01-22T05:04:42.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.449+0000 7f80b1a00700 1 -- 172.21.15.49:0/4231218475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ac159c70 con 0x7f80ac0637f0 2024-01-22T05:04:42.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.449+0000 7f80b1a00700 1 -- 172.21.15.49:0/4231218475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ac067700 con 0x7f80ac0637f0 2024-01-22T05:04:42.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.453+0000 7f80a2000700 1 -- 172.21.15.49:0/4231218475 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f809c01ba50 con 0x7f80ac0637f0 2024-01-22T05:04:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.453+0000 7f80a2000700 1 --2- 172.21.15.49:0/4231218475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f808405a510 0x7f808405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.453+0000 7f80a2000700 1 -- 172.21.15.49:0/4231218475 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f809c076530 con 0x7f80ac0637f0 2024-01-22T05:04:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.453+0000 7f80aa000700 1 --2- 172.21.15.49:0/4231218475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f808405a510 0x7f808405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:42.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.453+0000 7f80aa000700 1 --2- 172.21.15.49:0/4231218475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f808405a510 0x7f808405c9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f80ac15aa30 tx=0x7f80940090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:42.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.457+0000 7f80a2000700 1 -- 172.21.15.49:0/4231218475 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f809c049980 con 0x7f80ac0637f0 2024-01-22T05:04:42.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.661+0000 7f80b1a00700 1 -- 172.21.15.49:0/4231218475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f80ac046800 con 0x7f80ac0637f0 2024-01-22T05:04:42.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.665+0000 7f80a2000700 1 -- 172.21.15.49:0/4231218475 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f809c028020 con 0x7f80ac0637f0 2024-01-22T05:04:42.671 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-22T05:04:42.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.665+0000 7f80b1a00700 1 -- 172.21.15.49:0/4231218475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f808405a510 msgr2=0x7f808405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.665+0000 7f80b1a00700 1 --2- 172.21.15.49:0/4231218475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f808405a510 0x7f808405c9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f80ac15aa30 tx=0x7f80940090f0).stop 2024-01-22T05:04:42.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.669+0000 7f80b1a00700 1 -- 172.21.15.49:0/4231218475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ac0637f0 msgr2=0x7f80ac150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:42.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.669+0000 7f80b1a00700 1 --2- 172.21.15.49:0/4231218475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ac0637f0 0x7f80ac150500 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f80ac063d80 tx=0x7f809c017000).stop 2024-01-22T05:04:42.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.669+0000 7f80b1a00700 1 -- 172.21.15.49:0/4231218475 shutdown_connections 2024-01-22T05:04:42.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.669+0000 7f80b1a00700 1 --2- 172.21.15.49:0/4231218475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f808405a510 0x7f808405c9d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.669+0000 7f80b1a00700 1 --2- 172.21.15.49:0/4231218475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80ac158090 0x7f80ac0ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.669+0000 7f80b1a00700 1 --2- 172.21.15.49:0/4231218475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80ac064fa0 0x7f80ac0ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.669+0000 7f80b1a00700 1 --2- 172.21.15.49:0/4231218475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ac0637f0 0x7f80ac150500 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:42.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.669+0000 7f80b1a00700 1 -- 172.21.15.49:0/4231218475 >> 172.21.15.49:0/4231218475 conn(0x7f80ac0c30c0 msgr2=0x7f80ac0c48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:42.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.669+0000 7f80b1a00700 1 -- 172.21.15.49:0/4231218475 shutdown_connections 2024-01-22T05:04:42.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:42.669+0000 7f80b1a00700 1 -- 172.21.15.49:0/4231218475 wait complete. 2024-01-22T05:04:42.693 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-22T05:04:42.693 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:04:42.693 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:04:42.693 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-01-22T05:04:42.693 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-22T05:04:42.693 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-22T05:04:42.693 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T05:04:42.693 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:04:42.693 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-01-22T05:04:42.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:04:42.694 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:04:42.711 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:04:42.711 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:04:42.711 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:04:42.711 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:04:42.711 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:04:42.711 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:04:42.712 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:04:42.712 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:04:42.712 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:04:42.712 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:04:42.712 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:04:42.712 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:04:42.712 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:04:42.712 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42488sec preferred_lft 42488sec 2024-01-22T05:04:42.712 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:04:42.712 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:04:42.712 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:04:42.712 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:04:42.712 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:04:42.712 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:04:42.713 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:04:42.713 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:04:42.713 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:04:42.713 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:04:42.713 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:04:42.713 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:04:42.714 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-22T05:04:42.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:04:42.714 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:04:42.714 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:04:42.714 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2024-01-22T05:04:42.715 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2024-01-22T05:04:42.715 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2024-01-22T05:04:42.715 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-22T05:04:42.715 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:04:42.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:04:42.870 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:04:42.904 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:04:42.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:04:42.907 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:04:42.986 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:04:42.987 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:04:42.987 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:04:42.987 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:04:42.987 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:04:42.987 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:04:42.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:04:42.988 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:04:42.988 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:04:42.988 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:04:42.988 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:04:42.988 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:04:42.988 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:04:43.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:04:43.120 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:04:43.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:04:43.138 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2024-01-22T05:04:43.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:04:43.200 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:04:43.201 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:04:43.201 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-22T05:04:43.201 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-01-22T05:04:43.201 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:04:43.320 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-01-22T05:04:43.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:04:43.321 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:04:43.321 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:04:43.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-01-22T05:04:43.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-22T05:04:43.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-01-22T05:04:43.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-01-22T05:04:43.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-01-22T05:04:43.321 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:04:43.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:04:43.489 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:04:43.489 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:04:43.489 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-22T05:04:43.489 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2024-01-22T05:04:43.489 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:04:43.560 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-01-22T05:04:43.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:04:43.560 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.admin 2024-01-22T05:04:43.579 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-01-22T05:04:43.579 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-01-22T05:04:43.662 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:04:43.662 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:04:43.740 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:04:43.744 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:04:43.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:04:43.744 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-01-22T05:04:43.806 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-22T05:04:43.806 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id admin --client_fs=cephfs /home/ubuntu/cephtest/mnt.admin 2024-01-22T05:04:43.855 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-01-22T05:04:43.885 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:04:43.886 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:04:43.967 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:04:43.971 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:04:43.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:04:43.972 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-01-22T05:04:43.998 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:2024-01-22T05:04:43.989+0000 7fbd0e161200 -1 init, newargv = 0x5559ec592550 newargc=15 2024-01-22T05:04:43.998 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:ceph-fuse[27262]: starting ceph client 2024-01-22T05:04:44.017 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:ceph-fuse[27262]: starting fuse 2024-01-22T05:04:45.117 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-01-22T05:04:45.158 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:04:45.158 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:04:45.234 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:04:45.237 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:04:45.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:04:45.237 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-01-22T05:04:45.298 INFO:teuthology.orchestra.run.smithi049.stdout:49 2024-01-22T05:04:45.298 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2024-01-22T05:04:45.299 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:04:45.299 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-01-22T05:04:45.299 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-01-22T05:04:45.299 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-01-22T05:04:45.299 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-01-22T05:04:45.299 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:04:45.299 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-01-22T05:04:45.299 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-01-22T05:04:45.299 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-01-22T05:04:45.299 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-01-22T05:04:45.299 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:04:45.299 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-01-22T05:04:45.300 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-01-22T05:04:45.300 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-01-22T05:04:45.300 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-01-22T05:04:45.300 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:04:45.300 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-01-22T05:04:45.300 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-22T05:04:45.300 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-22T05:04:45.300 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-22T05:04:45.300 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-01-22T05:04:45.300 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-01-22T05:04:45.300 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-01-22T05:04:45.300 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-22T05:04:45.300 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:04:45.301 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.admin")) 2024-01-22T05:04:45.301 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-01-22T05:04:45.455 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.admin.27262.asok 2024-01-22T05:04:45.643 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.27262.asok 2024-01-22T05:04:45.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:04:45.643 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.27262.asok status 2024-01-22T05:04:45.832 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:04:45.833 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-01-22T05:04:45.833 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "9854ba8e5f82e4476d4c6c06dd8feefca92b8b32", 2024-01-22T05:04:45.833 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 16.2.14-452-g9854ba8e (9854ba8e5f82e4476d4c6c06dd8feefca92b8b32) pacific (stable)", 2024-01-22T05:04:45.833 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "admin", 2024-01-22T05:04:45.833 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-01-22T05:04:45.833 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-01-22T05:04:45.833 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "27262", 2024-01-22T05:04:45.833 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-01-22T05:04:45.833 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:04:45.833 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-01-22T05:04:45.833 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-01-22T05:04:45.833 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4443, 2024-01-22T05:04:45.833 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-01-22T05:04:45.834 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-01-22T05:04:45.834 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-01-22T05:04:45.834 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4443 2024-01-22T05:04:45.834 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:04:45.834 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-01-22T05:04:45.834 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-01-22T05:04:45.834 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:04:45.834 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 1856280735 2024-01-22T05:04:45.834 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:04:45.834 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:04:45.834 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-01-22T05:04:45.834 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-01-22T05:04:45.834 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:04:45.834 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 1856280735 2024-01-22T05:04:45.834 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:04:45.835 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4443 192.168.0.1:0/1856280735", 2024-01-22T05:04:45.835 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/1856280735", 2024-01-22T05:04:45.835 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-01-22T05:04:45.835 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 7, 2024-01-22T05:04:45.835 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 25, 2024-01-22T05:04:45.835 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-01-22T05:04:45.835 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-01-22T05:04:45.835 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-01-22T05:04:45.835 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:04:45.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:04:45.846 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-01-22T05:04:45.846 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-01-22T05:04:45.864 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-01-22T05:04:45.864 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-01-22T05:04:45.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:04:45.864 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-01-22T05:04:45.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:04:45.950 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-01-22T05:04:46.068 INFO:teuthology.orchestra.run.smithi049.stdout:# file: . 2024-01-22T05:04:46.069 INFO:teuthology.orchestra.run.smithi049.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-01-22T05:04:46.069 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:46.070 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-01-22T05:04:46.070 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:04:46.070 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-01-22T05:04:46.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:ceph-fuse[27262]: fuse finished with error 0 and tester_r 0 2024-01-22T05:04:46.135 INFO:teuthology.orchestra.run:waiting for 900 2024-01-22T05:04:46.184 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:04:46.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:04:46.184 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-01-22T05:04:46.304 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:04:46.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.461+0000 7f9a4b200700 1 Processor -- start 2024-01-22T05:04:46.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.461+0000 7f9a4b200700 1 -- start start 2024-01-22T05:04:46.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.461+0000 7f9a4b200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9a440bca30 0x7f9a44068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:46.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.461+0000 7f9a4b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a44066f60 0x7f9a44062230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:46.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.461+0000 7f9a4b200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a440bbd00 con 0x7f9a44151830 2024-01-22T05:04:46.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.461+0000 7f9a4b200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a440bce10 con 0x7f9a440bca30 2024-01-22T05:04:46.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.461+0000 7f9a4b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a440bc5a0 con 0x7f9a44066f60 2024-01-22T05:04:46.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.465+0000 7f9a49e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9a440bca30 0x7f9a44068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:46.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.465+0000 7f9a4a800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a44066f60 0x7f9a44062230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:46.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.465+0000 7f9a49e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9a440bca30 0x7f9a44068aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:34062/0 (socket says 172.21.15.49:34062) 2024-01-22T05:04:46.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.465+0000 7f9a49e00700 1 -- 172.21.15.49:0/3321461954 learned_addr learned my addr 172.21.15.49:0/3321461954 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:46.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.465+0000 7f9a49e00700 1 -- 172.21.15.49:0/3321461954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a44066f60 msgr2=0x7f9a44062230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:46.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.465+0000 7f9a49e00700 1 --2- 172.21.15.49:0/3321461954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a44066f60 0x7f9a44062230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:46.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.465+0000 7f9a49e00700 1 -- 172.21.15.49:0/3321461954 >> v1:172.21.15.110:6789/0 conn(0x7f9a44151830 legacy=0x7f9a44066850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:46.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.465+0000 7f9a49e00700 1 -- 172.21.15.49:0/3321461954 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a440692f0 con 0x7f9a440bca30 2024-01-22T05:04:46.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.465+0000 7f9a49e00700 1 --2- 172.21.15.49:0/3321461954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a440bca30 0x7f9a44068aa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f9a34006fd0 tx=0x7f9a340090f0).ready entity=mon.1 client_cookie=ea09bf06a3975ad server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:46.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.465+0000 7f9a48a00700 1 -- 172.21.15.49:0/3321461954 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3400b580 con 0x7f9a440bca30 2024-01-22T05:04:46.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.465+0000 7f9a48a00700 1 -- 172.21.15.49:0/3321461954 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3400b6e0 con 0x7f9a440bca30 2024-01-22T05:04:46.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.465+0000 7f9a48a00700 1 -- 172.21.15.49:0/3321461954 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3400ba60 con 0x7f9a440bca30 2024-01-22T05:04:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.469+0000 7f9a4b200700 1 -- 172.21.15.49:0/3321461954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a440bca30 msgr2=0x7f9a44068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.469+0000 7f9a4b200700 1 --2- 172.21.15.49:0/3321461954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a440bca30 0x7f9a44068aa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f9a34006fd0 tx=0x7f9a340090f0).stop 2024-01-22T05:04:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.469+0000 7f9a4b200700 1 -- 172.21.15.49:0/3321461954 shutdown_connections 2024-01-22T05:04:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.469+0000 7f9a4b200700 1 --2- 172.21.15.49:0/3321461954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a44066f60 0x7f9a44062230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.469+0000 7f9a4b200700 1 --2- 172.21.15.49:0/3321461954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a440bca30 0x7f9a44068aa0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.469+0000 7f9a4b200700 1 -- 172.21.15.49:0/3321461954 >> 172.21.15.49:0/3321461954 conn(0x7f9a440c42a0 msgr2=0x7f9a44065f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.469+0000 7f9a4b200700 1 -- 172.21.15.49:0/3321461954 shutdown_connections 2024-01-22T05:04:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.469+0000 7f9a4b200700 1 -- 172.21.15.49:0/3321461954 wait complete. 2024-01-22T05:04:46.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.473+0000 7f9a4b200700 1 Processor -- start 2024-01-22T05:04:46.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.473+0000 7f9a4b200700 1 -- start start 2024-01-22T05:04:46.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.473+0000 7f9a4b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a44066f60 0x7f9a44169880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:46.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.473+0000 7f9a4b200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a440bca30 0x7f9a4414ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:46.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.473+0000 7f9a4b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a44151830 0x7f9a4414eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:46.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.473+0000 7f9a4b200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a44169d70 con 0x7f9a440bca30 2024-01-22T05:04:46.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.473+0000 7f9a4b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a441693f0 con 0x7f9a44066f60 2024-01-22T05:04:46.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.473+0000 7f9a4b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a440c2ff0 con 0x7f9a44151830 2024-01-22T05:04:46.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.473+0000 7f9a49400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a440bca30 0x7f9a4414ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:46.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.473+0000 7f9a49400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a440bca30 0x7f9a4414ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48058/0 (socket says 172.21.15.49:48058) 2024-01-22T05:04:46.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.473+0000 7f9a49400700 1 -- 172.21.15.49:0/1163433364 learned_addr learned my addr 172.21.15.49:0/1163433364 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.473+0000 7f9a4a800700 1 --2- 172.21.15.49:0/1163433364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a44151830 0x7f9a4414eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.473+0000 7f9a49e00700 1 --2- 172.21.15.49:0/1163433364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a44066f60 0x7f9a44169880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.477+0000 7f9a49400700 1 -- 172.21.15.49:0/1163433364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a44151830 msgr2=0x7f9a4414eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.477+0000 7f9a49400700 1 --2- 172.21.15.49:0/1163433364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a44151830 0x7f9a4414eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.477+0000 7f9a49400700 1 -- 172.21.15.49:0/1163433364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a44066f60 msgr2=0x7f9a44169880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.477+0000 7f9a49400700 1 --2- 172.21.15.49:0/1163433364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a44066f60 0x7f9a44169880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.477+0000 7f9a49400700 1 -- 172.21.15.49:0/1163433364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a34009370 con 0x7f9a440bca30 2024-01-22T05:04:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.477+0000 7f9a49400700 1 --2- 172.21.15.49:0/1163433364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a440bca30 0x7f9a4414ea00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f9a2c00c440 tx=0x7f9a2c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.477+0000 7f9a41600700 1 -- 172.21.15.49:0/1163433364 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c007020 con 0x7f9a440bca30 2024-01-22T05:04:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.477+0000 7f9a41600700 1 -- 172.21.15.49:0/1163433364 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c007180 con 0x7f9a440bca30 2024-01-22T05:04:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.477+0000 7f9a4b200700 1 -- 172.21.15.49:0/1163433364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4416ce70 con 0x7f9a440bca30 2024-01-22T05:04:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.477+0000 7f9a41600700 1 -- 172.21.15.49:0/1163433364 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c007520 con 0x7f9a440bca30 2024-01-22T05:04:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.477+0000 7f9a4b200700 1 -- 172.21.15.49:0/1163433364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a44168d30 con 0x7f9a440bca30 2024-01-22T05:04:46.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.477+0000 7f9a4b200700 1 -- 172.21.15.49:0/1163433364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a440c6b30 con 0x7f9a440bca30 2024-01-22T05:04:46.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.477+0000 7f9a41600700 1 -- 172.21.15.49:0/1163433364 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9a2c0068b0 con 0x7f9a440bca30 2024-01-22T05:04:46.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.481+0000 7f9a41600700 1 --2- 172.21.15.49:0/1163433364 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a1c05a510 0x7f9a1c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:46.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.481+0000 7f9a41600700 1 -- 172.21.15.49:0/1163433364 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f9a2c073cb0 con 0x7f9a440bca30 2024-01-22T05:04:46.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.481+0000 7f9a49e00700 1 --2- 172.21.15.49:0/1163433364 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a1c05a510 0x7f9a1c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:46.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.481+0000 7f9a49e00700 1 --2- 172.21.15.49:0/1163433364 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a1c05a510 0x7f9a1c05c9d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9a34009fd0 tx=0x7f9a34017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:46.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.493+0000 7f9a41600700 1 -- 172.21.15.49:0/1163433364 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9a440c6b30 con 0x7f9a440bca30 2024-01-22T05:04:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.649+0000 7f9a4b200700 1 -- 172.21.15.49:0/1163433364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a440c6b30 con 0x7f9a440bca30 2024-01-22T05:04:46.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.653+0000 7f9a41600700 1 -- 172.21.15.49:0/1163433364 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f9a440c6b30 con 0x7f9a440bca30 2024-01-22T05:04:46.660 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:46.661 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:39.526211+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:04:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.657+0000 7f9a4b200700 1 -- 172.21.15.49:0/1163433364 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a1c05a510 msgr2=0x7f9a1c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.657+0000 7f9a4b200700 1 --2- 172.21.15.49:0/1163433364 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a1c05a510 0x7f9a1c05c9d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9a34009fd0 tx=0x7f9a34017000).stop 2024-01-22T05:04:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.657+0000 7f9a4b200700 1 -- 172.21.15.49:0/1163433364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a440bca30 msgr2=0x7f9a4414ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.657+0000 7f9a4b200700 1 --2- 172.21.15.49:0/1163433364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a440bca30 0x7f9a4414ea00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f9a2c00c440 tx=0x7f9a2c007e00).stop 2024-01-22T05:04:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.657+0000 7f9a4b200700 1 -- 172.21.15.49:0/1163433364 shutdown_connections 2024-01-22T05:04:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.657+0000 7f9a4b200700 1 --2- 172.21.15.49:0/1163433364 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a1c05a510 0x7f9a1c05c9d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.657+0000 7f9a4b200700 1 --2- 172.21.15.49:0/1163433364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a44151830 0x7f9a4414eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.657+0000 7f9a4b200700 1 --2- 172.21.15.49:0/1163433364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a440bca30 0x7f9a4414ea00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.657+0000 7f9a4b200700 1 --2- 172.21.15.49:0/1163433364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a44066f60 0x7f9a44169880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.657+0000 7f9a4b200700 1 -- 172.21.15.49:0/1163433364 >> 172.21.15.49:0/1163433364 conn(0x7f9a440c42a0 msgr2=0x7f9a44153af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.657+0000 7f9a4b200700 1 -- 172.21.15.49:0/1163433364 shutdown_connections 2024-01-22T05:04:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.657+0000 7f9a4b200700 1 -- 172.21.15.49:0/1163433364 wait complete. 2024-01-22T05:04:46.686 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:04:46.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.845+0000 7f8e76000700 1 Processor -- start 2024-01-22T05:04:46.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.845+0000 7f8e76000700 1 -- start start 2024-01-22T05:04:46.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.849+0000 7f8e76000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8e70067180 0x7f8e70154850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:46.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.849+0000 7f8e76000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e700c1e70 con 0x7f8e701518d0 2024-01-22T05:04:46.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.849+0000 7f8e76000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e70155110 con 0x7f8e701514f0 2024-01-22T05:04:46.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.849+0000 7f8e76000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e70154e30 con 0x7f8e70067180 2024-01-22T05:04:46.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.849+0000 7f8e6fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8e70067180 0x7f8e70154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:46.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.849+0000 7f8e6ea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8e701518d0 0x7f8e70154140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33524/0 (socket says 172.21.15.49:33524) 2024-01-22T05:04:46.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.849+0000 7f8e6ea00700 1 -- 172.21.15.49:0/1251539117 learned_addr learned my addr 172.21.15.49:0/1251539117 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:46.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.849+0000 7f8e6fe00700 1 -- 172.21.15.49:0/1251539117 >> v1:172.21.15.110:6789/0 conn(0x7f8e701514f0 legacy=0x7f8e70066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:46.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.849+0000 7f8e6fe00700 1 -- 172.21.15.49:0/1251539117 >> v1:172.21.15.49:6789/0 conn(0x7f8e701518d0 legacy=0x7f8e70154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:46.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.849+0000 7f8e6fe00700 1 -- 172.21.15.49:0/1251539117 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e700c0f70 con 0x7f8e70067180 2024-01-22T05:04:46.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.849+0000 7f8e6fe00700 1 --2- 172.21.15.49:0/1251539117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70067180 0x7f8e70154850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f8e68009e60 tx=0x7f8e68009780).ready entity=mon.0 client_cookie=56f7b4f7e536977e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:46.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.853+0000 7f8e6e000700 1 -- 172.21.15.49:0/1251539117 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6800e070 con 0x7f8e70067180 2024-01-22T05:04:46.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.853+0000 7f8e6e000700 1 -- 172.21.15.49:0/1251539117 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6800bc30 con 0x7f8e70067180 2024-01-22T05:04:46.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.853+0000 7f8e6e000700 1 -- 172.21.15.49:0/1251539117 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68012410 con 0x7f8e70067180 2024-01-22T05:04:46.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.853+0000 7f8e76000700 1 -- 172.21.15.49:0/1251539117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70067180 msgr2=0x7f8e70154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:46.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.853+0000 7f8e76000700 1 --2- 172.21.15.49:0/1251539117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70067180 0x7f8e70154850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f8e68009e60 tx=0x7f8e68009780).stop 2024-01-22T05:04:46.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.853+0000 7f8e76000700 1 -- 172.21.15.49:0/1251539117 shutdown_connections 2024-01-22T05:04:46.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.853+0000 7f8e76000700 1 --2- 172.21.15.49:0/1251539117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70067180 0x7f8e70154850 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:46.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.853+0000 7f8e76000700 1 -- 172.21.15.49:0/1251539117 >> 172.21.15.49:0/1251539117 conn(0x7f8e700c64a0 msgr2=0x7f8e700c68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:46.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.853+0000 7f8e76000700 1 -- 172.21.15.49:0/1251539117 shutdown_connections 2024-01-22T05:04:46.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.853+0000 7f8e76000700 1 -- 172.21.15.49:0/1251539117 wait complete. 2024-01-22T05:04:46.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.857+0000 7f8e76000700 1 Processor -- start 2024-01-22T05:04:46.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.857+0000 7f8e76000700 1 -- start start 2024-01-22T05:04:46.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.857+0000 7f8e76000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70067180 0x7f8e700ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:46.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.857+0000 7f8e76000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e701514f0 0x7f8e70156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:46.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.857+0000 7f8e76000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e701518d0 0x7f8e70156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:46.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.857+0000 7f8e76000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e701574b0 con 0x7f8e70067180 2024-01-22T05:04:46.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.857+0000 7f8e76000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70164d60 con 0x7f8e701518d0 2024-01-22T05:04:46.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.857+0000 7f8e76000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70155340 con 0x7f8e701514f0 2024-01-22T05:04:46.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.857+0000 7f8e6f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70067180 0x7f8e700ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:46.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.857+0000 7f8e6f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70067180 0x7f8e700ac0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48066/0 (socket says 172.21.15.49:48066) 2024-01-22T05:04:46.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.857+0000 7f8e6f400700 1 -- 172.21.15.49:0/492335856 learned_addr learned my addr 172.21.15.49:0/492335856 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:46.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.857+0000 7f8e6fe00700 1 --2- 172.21.15.49:0/492335856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e701518d0 0x7f8e70156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:46.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.857+0000 7f8e6ea00700 1 --2- 172.21.15.49:0/492335856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e701514f0 0x7f8e70156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:46.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.861+0000 7f8e6f400700 1 -- 172.21.15.49:0/492335856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e701514f0 msgr2=0x7f8e70156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:46.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.861+0000 7f8e6f400700 1 --2- 172.21.15.49:0/492335856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e701514f0 0x7f8e70156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:46.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.861+0000 7f8e6f400700 1 -- 172.21.15.49:0/492335856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e701518d0 msgr2=0x7f8e70156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:46.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.861+0000 7f8e6f400700 1 --2- 172.21.15.49:0/492335856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e701518d0 0x7f8e70156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:46.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.861+0000 7f8e6f400700 1 -- 172.21.15.49:0/492335856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e68009a20 con 0x7f8e70067180 2024-01-22T05:04:46.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.861+0000 7f8e6ea00700 1 --2- 172.21.15.49:0/492335856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e701514f0 0x7f8e70156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:46.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.861+0000 7f8e6f400700 1 --2- 172.21.15.49:0/492335856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70067180 0x7f8e700ac0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8e6000c4c0 tx=0x7f8e60007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.861+0000 7f8e66a00700 1 -- 172.21.15.49:0/492335856 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60007020 con 0x7f8e70067180 2024-01-22T05:04:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.861+0000 7f8e66a00700 1 -- 172.21.15.49:0/492335856 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e60001e90 con 0x7f8e70067180 2024-01-22T05:04:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.861+0000 7f8e76000700 1 -- 172.21.15.49:0/492335856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e70155620 con 0x7f8e70067180 2024-01-22T05:04:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.861+0000 7f8e66a00700 1 -- 172.21.15.49:0/492335856 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e600073d0 con 0x7f8e70067180 2024-01-22T05:04:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.861+0000 7f8e76000700 1 -- 172.21.15.49:0/492335856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e70155be0 con 0x7f8e70067180 2024-01-22T05:04:46.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.861+0000 7f8e76000700 1 -- 172.21.15.49:0/492335856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e700c0b40 con 0x7f8e70067180 2024-01-22T05:04:46.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.865+0000 7f8e66a00700 1 -- 172.21.15.49:0/492335856 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8e600068b0 con 0x7f8e70067180 2024-01-22T05:04:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.865+0000 7f8e66a00700 1 --2- 172.21.15.49:0/492335856 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8e4805a510 0x7f8e4805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.865+0000 7f8e66a00700 1 -- 172.21.15.49:0/492335856 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f8e60074300 con 0x7f8e70067180 2024-01-22T05:04:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.865+0000 7f8e6ea00700 1 --2- 172.21.15.49:0/492335856 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8e4805a510 0x7f8e4805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:46.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.865+0000 7f8e6ea00700 1 --2- 172.21.15.49:0/492335856 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8e4805a510 0x7f8e4805c9d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8e700c61e0 tx=0x7f8e58009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:46.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:46.873+0000 7f8e66a00700 1 -- 172.21.15.49:0/492335856 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8e600477d0 con 0x7f8e70067180 2024-01-22T05:04:47.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.041+0000 7f8e76000700 1 -- 172.21.15.49:0/492335856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e700c1250 con 0x7f8e70067180 2024-01-22T05:04:47.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.041+0000 7f8e66a00700 1 -- 172.21.15.49:0/492335856 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f8e6004adf0 con 0x7f8e70067180 2024-01-22T05:04:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:47.045 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:39.526211+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:04:47.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.045+0000 7f8e76000700 1 -- 172.21.15.49:0/492335856 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8e4805a510 msgr2=0x7f8e4805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:47.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.045+0000 7f8e76000700 1 --2- 172.21.15.49:0/492335856 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8e4805a510 0x7f8e4805c9d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8e700c61e0 tx=0x7f8e58009040).stop 2024-01-22T05:04:47.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.045+0000 7f8e76000700 1 -- 172.21.15.49:0/492335856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70067180 msgr2=0x7f8e700ac0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:47.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.045+0000 7f8e76000700 1 --2- 172.21.15.49:0/492335856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70067180 0x7f8e700ac0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8e6000c4c0 tx=0x7f8e60007e00).stop 2024-01-22T05:04:47.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.045+0000 7f8e76000700 1 -- 172.21.15.49:0/492335856 shutdown_connections 2024-01-22T05:04:47.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.045+0000 7f8e76000700 1 --2- 172.21.15.49:0/492335856 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8e4805a510 0x7f8e4805c9d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.045+0000 7f8e76000700 1 --2- 172.21.15.49:0/492335856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e701518d0 0x7f8e70156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.045+0000 7f8e76000700 1 --2- 172.21.15.49:0/492335856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e701514f0 0x7f8e70156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.045+0000 7f8e76000700 1 --2- 172.21.15.49:0/492335856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70067180 0x7f8e700ac0c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.045+0000 7f8e76000700 1 -- 172.21.15.49:0/492335856 >> 172.21.15.49:0/492335856 conn(0x7f8e700c64a0 msgr2=0x7f8e700c5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.045+0000 7f8e76000700 1 -- 172.21.15.49:0/492335856 shutdown_connections 2024-01-22T05:04:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.045+0000 7f8e76000700 1 -- 172.21.15.49:0/492335856 wait complete. 2024-01-22T05:04:47.072 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:04:47.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.233+0000 7fe759600700 1 Processor -- start 2024-01-22T05:04:47.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.233+0000 7fe759600700 1 -- start start 2024-01-22T05:04:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.237+0000 7fe759600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe754062c00 0x7fe7540bc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.237+0000 7fe759600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe7540bc7c0 0x7fe754068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.237+0000 7fe759600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe754059b70 con 0x7fe7540a6d60 2024-01-22T05:04:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.237+0000 7fe759600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe754151f80 con 0x7fe754062c00 2024-01-22T05:04:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.237+0000 7fe759600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe754063090 con 0x7fe7540bc7c0 2024-01-22T05:04:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.237+0000 7fe752000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe754062c00 0x7fe7540bc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.237+0000 7fe752a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe7540a6d60 0x7fe754151870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33536/0 (socket says 172.21.15.49:33536) 2024-01-22T05:04:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.237+0000 7fe752a00700 1 -- 172.21.15.49:0/2695077775 learned_addr learned my addr 172.21.15.49:0/2695077775 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.237+0000 7fe753400700 1 --2- 172.21.15.49:0/2695077775 >> v2:172.21.15.110:3300/0 conn(0x7fe7540bc7c0 0x7fe754068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:47.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe751600700 1 -- 172.21.15.49:0/2695077775 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864504882 0 0) 0x7fe754059b70 con 0x7fe7540a6d60 2024-01-22T05:04:47.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe751600700 1 -- 172.21.15.49:0/2695077775 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7340033f0 con 0x7fe7540a6d60 2024-01-22T05:04:47.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe753400700 1 -- 172.21.15.49:0/2695077775 >> v2:172.21.15.49:3300/0 conn(0x7fe754062c00 msgr2=0x7fe7540bc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:47.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe753400700 1 --2- 172.21.15.49:0/2695077775 >> v2:172.21.15.49:3300/0 conn(0x7fe754062c00 0x7fe7540bc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:47.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe753400700 1 -- 172.21.15.49:0/2695077775 >> v1:172.21.15.49:6789/0 conn(0x7fe7540a6d60 legacy=0x7fe754151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:47.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe753400700 1 -- 172.21.15.49:0/2695077775 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7540bcbf0 con 0x7fe7540bc7c0 2024-01-22T05:04:47.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe752000700 1 --2- 172.21.15.49:0/2695077775 >> v2:172.21.15.49:3300/0 conn(0x7fe754062c00 0x7fe7540bc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe753400700 1 --2- 172.21.15.49:0/2695077775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7540bc7c0 0x7fe754068710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe7540a9400 tx=0x7fe74c009780).ready entity=mon.1 client_cookie=1a5a18a1b8a66183 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe751600700 1 -- 172.21.15.49:0/2695077775 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00e070 con 0x7fe7540bc7c0 2024-01-22T05:04:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe751600700 1 -- 172.21.15.49:0/2695077775 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c00bab0 con 0x7fe7540bc7c0 2024-01-22T05:04:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe751600700 1 -- 172.21.15.49:0/2695077775 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00be30 con 0x7fe7540bc7c0 2024-01-22T05:04:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe759600700 1 -- 172.21.15.49:0/2695077775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7540bc7c0 msgr2=0x7fe754068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe759600700 1 --2- 172.21.15.49:0/2695077775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7540bc7c0 0x7fe754068710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe7540a9400 tx=0x7fe74c009780).stop 2024-01-22T05:04:47.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe759600700 1 -- 172.21.15.49:0/2695077775 shutdown_connections 2024-01-22T05:04:47.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe759600700 1 --2- 172.21.15.49:0/2695077775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7540bc7c0 0x7fe754068710 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:47.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe759600700 1 --2- 172.21.15.49:0/2695077775 >> v2:172.21.15.49:3300/0 conn(0x7fe754062c00 0x7fe7540bc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:47.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.241+0000 7fe759600700 1 -- 172.21.15.49:0/2695077775 >> 172.21.15.49:0/2695077775 conn(0x7fe7540c3900 msgr2=0x7fe7540c3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:47.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.245+0000 7fe759600700 1 -- 172.21.15.49:0/2695077775 shutdown_connections 2024-01-22T05:04:47.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.245+0000 7fe759600700 1 -- 172.21.15.49:0/2695077775 wait complete. 2024-01-22T05:04:47.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.245+0000 7fe759600700 1 Processor -- start 2024-01-22T05:04:47.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.245+0000 7fe759600700 1 -- start start 2024-01-22T05:04:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe759600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe754062c00 0x7fe754163950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe759600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7540a6d60 0x7fe7540be910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe759600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7540bc7c0 0x7fe7540abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe759600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7541660d0 con 0x7fe7540bc7c0 2024-01-22T05:04:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe759600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7541651e0 con 0x7fe7540a6d60 2024-01-22T05:04:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe759600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7541654c0 con 0x7fe754062c00 2024-01-22T05:04:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe753400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7540bc7c0 0x7fe7540abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe753400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7540bc7c0 0x7fe7540abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48094/0 (socket says 172.21.15.49:48094) 2024-01-22T05:04:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe753400700 1 -- 172.21.15.49:0/1009346110 learned_addr learned my addr 172.21.15.49:0/1009346110 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe752000700 1 --2- 172.21.15.49:0/1009346110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7540a6d60 0x7fe7540be910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe752a00700 1 --2- 172.21.15.49:0/1009346110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe754062c00 0x7fe754163950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:47.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe753400700 1 -- 172.21.15.49:0/1009346110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe754062c00 msgr2=0x7fe754163950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:47.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe753400700 1 --2- 172.21.15.49:0/1009346110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe754062c00 0x7fe754163950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:47.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe753400700 1 -- 172.21.15.49:0/1009346110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7540a6d60 msgr2=0x7fe7540be910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:47.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe753400700 1 --2- 172.21.15.49:0/1009346110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7540a6d60 0x7fe7540be910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:47.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe753400700 1 -- 172.21.15.49:0/1009346110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c0092a0 con 0x7fe7540bc7c0 2024-01-22T05:04:47.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe753400700 1 --2- 172.21.15.49:0/1009346110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7540bc7c0 0x7fe7540abf60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fe74c00b610 tx=0x7fe74c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:47.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe74a000700 1 -- 172.21.15.49:0/1009346110 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c01d630 con 0x7fe7540bc7c0 2024-01-22T05:04:47.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe74a000700 1 -- 172.21.15.49:0/1009346110 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c01d790 con 0x7fe7540bc7c0 2024-01-22T05:04:47.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe74a000700 1 -- 172.21.15.49:0/1009346110 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c01db30 con 0x7fe7540bc7c0 2024-01-22T05:04:47.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe759600700 1 -- 172.21.15.49:0/1009346110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74c009a20 con 0x7fe7540bc7c0 2024-01-22T05:04:47.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.249+0000 7fe759600700 1 -- 172.21.15.49:0/1009346110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe754165a80 con 0x7fe7540bc7c0 2024-01-22T05:04:47.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.253+0000 7fe759600700 1 -- 172.21.15.49:0/1009346110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe754166240 con 0x7fe7540bc7c0 2024-01-22T05:04:47.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.253+0000 7fe74a000700 1 -- 172.21.15.49:0/1009346110 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe74c026410 con 0x7fe7540bc7c0 2024-01-22T05:04:47.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.253+0000 7fe74a000700 1 --2- 172.21.15.49:0/1009346110 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe72c05a510 0x7fe72c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:47.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.253+0000 7fe74a000700 1 -- 172.21.15.49:0/1009346110 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fe74c076890 con 0x7fe7540bc7c0 2024-01-22T05:04:47.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.253+0000 7fe752a00700 1 --2- 172.21.15.49:0/1009346110 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe72c05a510 0x7fe72c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:47.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.253+0000 7fe752a00700 1 --2- 172.21.15.49:0/1009346110 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe72c05a510 0x7fe72c05c9d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe744007fd0 tx=0x7fe744009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:47.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.261+0000 7fe74a000700 1 -- 172.21.15.49:0/1009346110 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe74c049c40 con 0x7fe7540bc7c0 2024-01-22T05:04:47.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:47.465+0000 7fe759600700 1 -- 172.21.15.49:0/1009346110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe754065280 con 0x7fe7540bc7c0 2024-01-22T05:04:48.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.305+0000 7fe74a000700 1 -- 172.21.15.49:0/1009346110 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe74c04d260 con 0x7fe7540bc7c0 2024-01-22T05:04:48.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.309+0000 7fe759600700 1 -- 172.21.15.49:0/1009346110 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe72c05a510 msgr2=0x7fe72c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:48.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.309+0000 7fe759600700 1 --2- 172.21.15.49:0/1009346110 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe72c05a510 0x7fe72c05c9d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe744007fd0 tx=0x7fe744009040).stop 2024-01-22T05:04:48.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.309+0000 7fe759600700 1 -- 172.21.15.49:0/1009346110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7540bc7c0 msgr2=0x7fe7540abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:48.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.309+0000 7fe759600700 1 --2- 172.21.15.49:0/1009346110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7540bc7c0 0x7fe7540abf60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fe74c00b610 tx=0x7fe74c009780).stop 2024-01-22T05:04:48.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.309+0000 7fe759600700 1 -- 172.21.15.49:0/1009346110 shutdown_connections 2024-01-22T05:04:48.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.309+0000 7fe759600700 1 --2- 172.21.15.49:0/1009346110 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe72c05a510 0x7fe72c05c9d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:48.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.309+0000 7fe759600700 1 --2- 172.21.15.49:0/1009346110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7540bc7c0 0x7fe7540abf60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:48.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.309+0000 7fe759600700 1 --2- 172.21.15.49:0/1009346110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7540a6d60 0x7fe7540be910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:48.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.309+0000 7fe759600700 1 --2- 172.21.15.49:0/1009346110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe754062c00 0x7fe754163950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:48.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.309+0000 7fe759600700 1 -- 172.21.15.49:0/1009346110 >> 172.21.15.49:0/1009346110 conn(0x7fe7540c3900 msgr2=0x7fe7540c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:48.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.309+0000 7fe759600700 1 -- 172.21.15.49:0/1009346110 shutdown_connections 2024-01-22T05:04:48.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.309+0000 7fe759600700 1 -- 172.21.15.49:0/1009346110 wait complete. 2024-01-22T05:04:48.338 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-01-22T05:04:48.339 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:04:48.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.505+0000 7f7f9d600700 1 Processor -- start 2024-01-22T05:04:48.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.505+0000 7f7f9d600700 1 -- start start 2024-01-22T05:04:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.509+0000 7f7f9d600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f980c1ce0 0x7f7f980bc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.509+0000 7f7f9d600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f98068280 con 0x7f7f980bc980 2024-01-22T05:04:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.509+0000 7f7f9d600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f980bd190 con 0x7f7f98153cf0 2024-01-22T05:04:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.509+0000 7f7f9d600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f98067c30 con 0x7f7f980c1ce0 2024-01-22T05:04:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.509+0000 7f7f97400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7f980bc980 0x7f7f98068710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33538/0 (socket says 172.21.15.49:33538) 2024-01-22T05:04:48.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.509+0000 7f7f97400700 1 -- 172.21.15.49:0/1352632253 learned_addr learned my addr 172.21.15.49:0/1352632253 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:48.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f96000700 1 --2- 172.21.15.49:0/1352632253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f980c1ce0 0x7f7f980bc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:48.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f95600700 1 -- 172.21.15.49:0/1352632253 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142694302 0 0) 0x7f7f98068280 con 0x7f7f980bc980 2024-01-22T05:04:48.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f95600700 1 -- 172.21.15.49:0/1352632253 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f780033f0 con 0x7f7f980bc980 2024-01-22T05:04:48.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f95600700 1 -- 172.21.15.49:0/1352632253 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853522434 0 0) 0x7f7f980bd190 con 0x7f7f98153cf0 2024-01-22T05:04:48.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f95600700 1 -- 172.21.15.49:0/1352632253 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f98068280 con 0x7f7f98153cf0 2024-01-22T05:04:48.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f96000700 1 -- 172.21.15.49:0/1352632253 >> v1:172.21.15.110:6789/0 conn(0x7f7f98153cf0 legacy=0x7f7f980c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:48.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f96000700 1 -- 172.21.15.49:0/1352632253 >> v1:172.21.15.49:6789/0 conn(0x7f7f980bc980 legacy=0x7f7f98068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:48.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f96000700 1 -- 172.21.15.49:0/1352632253 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f98067f10 con 0x7f7f980c1ce0 2024-01-22T05:04:48.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f96000700 1 --2- 172.21.15.49:0/1352632253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f980c1ce0 0x7f7f980bc490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7f80009760 tx=0x7f7f80006f40).ready entity=mon.2 client_cookie=e907ac624971bb7e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:48.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f95600700 1 -- 172.21.15.49:0/1352632253 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80005880 con 0x7f7f980c1ce0 2024-01-22T05:04:48.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f95600700 1 -- 172.21.15.49:0/1352632253 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f800059e0 con 0x7f7f980c1ce0 2024-01-22T05:04:48.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f95600700 1 -- 172.21.15.49:0/1352632253 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80005d60 con 0x7f7f980c1ce0 2024-01-22T05:04:48.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f9d600700 1 -- 172.21.15.49:0/1352632253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f980c1ce0 msgr2=0x7f7f980bc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:48.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f9d600700 1 --2- 172.21.15.49:0/1352632253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f980c1ce0 0x7f7f980bc490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7f80009760 tx=0x7f7f80006f40).stop 2024-01-22T05:04:48.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f9d600700 1 -- 172.21.15.49:0/1352632253 shutdown_connections 2024-01-22T05:04:48.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f9d600700 1 --2- 172.21.15.49:0/1352632253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f980c1ce0 0x7f7f980bc490 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:48.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f9d600700 1 -- 172.21.15.49:0/1352632253 >> 172.21.15.49:0/1352632253 conn(0x7f7f98062cb0 msgr2=0x7f7f980c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:48.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f9d600700 1 -- 172.21.15.49:0/1352632253 shutdown_connections 2024-01-22T05:04:48.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.513+0000 7f7f9d600700 1 -- 172.21.15.49:0/1352632253 wait complete. 2024-01-22T05:04:48.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.517+0000 7f7f9d600700 1 Processor -- start 2024-01-22T05:04:48.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.517+0000 7f7f9d600700 1 -- start start 2024-01-22T05:04:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.517+0000 7f7f9d600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f980bc980 0x7f7f98167fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.517+0000 7f7f9d600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f980c1ce0 0x7f7f9809feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.517+0000 7f7f9d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f98153cf0 0x7f7f98068610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.517+0000 7f7f9d600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980a0820 con 0x7f7f98153cf0 2024-01-22T05:04:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.517+0000 7f7f9d600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980a0b00 con 0x7f7f980bc980 2024-01-22T05:04:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.517+0000 7f7f9d600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980a0de0 con 0x7f7f980c1ce0 2024-01-22T05:04:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.517+0000 7f7f97400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f98153cf0 0x7f7f98068610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.517+0000 7f7f97400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f98153cf0 0x7f7f98068610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48096/0 (socket says 172.21.15.49:48096) 2024-01-22T05:04:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.517+0000 7f7f97400700 1 -- 172.21.15.49:0/3401299238 learned_addr learned my addr 172.21.15.49:0/3401299238 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.521+0000 7f7f96000700 1 --2- 172.21.15.49:0/3401299238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f980c1ce0 0x7f7f9809feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.521+0000 7f7f96a00700 1 --2- 172.21.15.49:0/3401299238 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f980bc980 0x7f7f98167fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.521+0000 7f7f97400700 1 -- 172.21.15.49:0/3401299238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f980c1ce0 msgr2=0x7f7f9809feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.521+0000 7f7f97400700 1 --2- 172.21.15.49:0/3401299238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f980c1ce0 0x7f7f9809feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.521+0000 7f7f97400700 1 -- 172.21.15.49:0/3401299238 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f980bc980 msgr2=0x7f7f98167fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.521+0000 7f7f97400700 1 --2- 172.21.15.49:0/3401299238 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f980bc980 0x7f7f98167fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.521+0000 7f7f97400700 1 -- 172.21.15.49:0/3401299238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f80009250 con 0x7f7f98153cf0 2024-01-22T05:04:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.521+0000 7f7f96000700 1 --2- 172.21.15.49:0/3401299238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f980c1ce0 0x7f7f9809feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.521+0000 7f7f97400700 1 --2- 172.21.15.49:0/3401299238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f98153cf0 0x7f7f98068610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f7f90001560 tx=0x7f7f900015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.521+0000 7f7f8e000700 1 -- 172.21.15.49:0/3401299238 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90005d30 con 0x7f7f98153cf0 2024-01-22T05:04:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.521+0000 7f7f8e000700 1 -- 172.21.15.49:0/3401299238 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f90005e90 con 0x7f7f98153cf0 2024-01-22T05:04:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.521+0000 7f7f8e000700 1 -- 172.21.15.49:0/3401299238 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f900072e0 con 0x7f7f98153cf0 2024-01-22T05:04:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.521+0000 7f7f9d600700 1 -- 172.21.15.49:0/3401299238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f981688b0 con 0x7f7f98153cf0 2024-01-22T05:04:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.521+0000 7f7f9d600700 1 -- 172.21.15.49:0/3401299238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f981684c0 con 0x7f7f98153cf0 2024-01-22T05:04:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.525+0000 7f7f9d600700 1 -- 172.21.15.49:0/3401299238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f98168710 con 0x7f7f98153cf0 2024-01-22T05:04:48.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.525+0000 7f7f8e000700 1 -- 172.21.15.49:0/3401299238 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7f90007650 con 0x7f7f98153cf0 2024-01-22T05:04:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.525+0000 7f7f8e000700 1 --2- 172.21.15.49:0/3401299238 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f7005a510 0x7f7f7005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.525+0000 7f7f8e000700 1 -- 172.21.15.49:0/3401299238 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f7f900744a0 con 0x7f7f98153cf0 2024-01-22T05:04:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.525+0000 7f7f96a00700 1 --2- 172.21.15.49:0/3401299238 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f7005a510 0x7f7f7005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.525+0000 7f7f96a00700 1 --2- 172.21.15.49:0/3401299238 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f7005a510 0x7f7f7005c9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7f88003930 tx=0x7f7f88007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:48.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.529+0000 7f7f8e000700 1 -- 172.21.15.49:0/3401299238 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7f98168710 con 0x7f7f98153cf0 2024-01-22T05:04:48.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:48.725+0000 7f7f9d600700 1 -- 172.21.15.49:0/3401299238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7f98168710 con 0x7f7f98153cf0 2024-01-22T05:04:49.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.321+0000 7f7f8e000700 1 -- 172.21.15.49:0/3401299238 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7f98168710 con 0x7f7f98153cf0 2024-01-22T05:04:49.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.325+0000 7f7f9d600700 1 -- 172.21.15.49:0/3401299238 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f7005a510 msgr2=0x7f7f7005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:49.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.325+0000 7f7f9d600700 1 --2- 172.21.15.49:0/3401299238 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f7005a510 0x7f7f7005c9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7f88003930 tx=0x7f7f88007bd0).stop 2024-01-22T05:04:49.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.325+0000 7f7f9d600700 1 -- 172.21.15.49:0/3401299238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f98153cf0 msgr2=0x7f7f98068610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:49.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.325+0000 7f7f9d600700 1 --2- 172.21.15.49:0/3401299238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f98153cf0 0x7f7f98068610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f7f90001560 tx=0x7f7f900015b0).stop 2024-01-22T05:04:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.325+0000 7f7f9d600700 1 -- 172.21.15.49:0/3401299238 shutdown_connections 2024-01-22T05:04:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.325+0000 7f7f9d600700 1 --2- 172.21.15.49:0/3401299238 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f7005a510 0x7f7f7005c9d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.325+0000 7f7f9d600700 1 --2- 172.21.15.49:0/3401299238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f98153cf0 0x7f7f98068610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.325+0000 7f7f9d600700 1 --2- 172.21.15.49:0/3401299238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f980c1ce0 0x7f7f9809feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.325+0000 7f7f9d600700 1 --2- 172.21.15.49:0/3401299238 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f980bc980 0x7f7f98167fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.325+0000 7f7f9d600700 1 -- 172.21.15.49:0/3401299238 >> 172.21.15.49:0/3401299238 conn(0x7f7f98062cb0 msgr2=0x7f7f980c4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.325+0000 7f7f9d600700 1 -- 172.21.15.49:0/3401299238 shutdown_connections 2024-01-22T05:04:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.325+0000 7f7f9d600700 1 -- 172.21.15.49:0/3401299238 wait complete. 2024-01-22T05:04:49.355 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:04:49.356 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:04:49.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.521+0000 7fa157c00700 1 Processor -- start 2024-01-22T05:04:49.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.521+0000 7fa157c00700 1 -- start start 2024-01-22T05:04:49.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.525+0000 7fa157c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1500c37d0 0x7fa1500c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:49.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.525+0000 7fa157c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500681a0 0x7fa1500bebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:49.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.525+0000 7fa157c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1500c4db0 con 0x7fa150153bd0 2024-01-22T05:04:49.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.525+0000 7fa157c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1500c5240 con 0x7fa1500c37d0 2024-01-22T05:04:49.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.525+0000 7fa157c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa150062230 con 0x7fa1500681a0 2024-01-22T05:04:49.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.525+0000 7fa155200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1500c37d0 0x7fa1500c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:49.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.525+0000 7fa155200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1500c37d0 0x7fa1500c3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48102/0 (socket says 172.21.15.49:48102) 2024-01-22T05:04:49.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.525+0000 7fa155200700 1 -- 172.21.15.49:0/3933432766 learned_addr learned my addr 172.21.15.49:0/3933432766 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:49.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.525+0000 7fa156600700 1 --2- 172.21.15.49:0/3933432766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500681a0 0x7fa1500bebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:49.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.525+0000 7fa155200700 1 -- 172.21.15.49:0/3933432766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500681a0 msgr2=0x7fa1500bebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:49.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.525+0000 7fa155200700 1 --2- 172.21.15.49:0/3933432766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500681a0 0x7fa1500bebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.525+0000 7fa155200700 1 -- 172.21.15.49:0/3933432766 >> v1:172.21.15.110:6789/0 conn(0x7fa150153bd0 legacy=0x7fa150067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:49.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.525+0000 7fa155200700 1 -- 172.21.15.49:0/3933432766 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500c4140 con 0x7fa1500c37d0 2024-01-22T05:04:49.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.525+0000 7fa14f400700 1 -- 172.21.15.49:0/3933432766 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133820318 0 0) 0x7fa1500c4db0 con 0x7fa150153bd0 2024-01-22T05:04:49.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.525+0000 7fa155200700 1 --2- 172.21.15.49:0/3933432766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1500c37d0 0x7fa1500c3bb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fa140006fd0 tx=0x7fa1400090f0).ready entity=mon.0 client_cookie=97f1a62193df9195 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:49.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.529+0000 7fa14f400700 1 -- 172.21.15.49:0/3933432766 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000b610 con 0x7fa1500c37d0 2024-01-22T05:04:49.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.529+0000 7fa14f400700 1 -- 172.21.15.49:0/3933432766 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14000b770 con 0x7fa1500c37d0 2024-01-22T05:04:49.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.529+0000 7fa14f400700 1 -- 172.21.15.49:0/3933432766 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000baf0 con 0x7fa1500c37d0 2024-01-22T05:04:49.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.529+0000 7fa157c00700 1 -- 172.21.15.49:0/3933432766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1500c37d0 msgr2=0x7fa1500c3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:49.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.529+0000 7fa157c00700 1 --2- 172.21.15.49:0/3933432766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1500c37d0 0x7fa1500c3bb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fa140006fd0 tx=0x7fa1400090f0).stop 2024-01-22T05:04:49.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.529+0000 7fa157c00700 1 -- 172.21.15.49:0/3933432766 shutdown_connections 2024-01-22T05:04:49.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.529+0000 7fa157c00700 1 --2- 172.21.15.49:0/3933432766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500681a0 0x7fa1500bebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.529+0000 7fa157c00700 1 --2- 172.21.15.49:0/3933432766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1500c37d0 0x7fa1500c3bb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.529+0000 7fa157c00700 1 -- 172.21.15.49:0/3933432766 >> 172.21.15.49:0/3933432766 conn(0x7fa150064080 msgr2=0x7fa150064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:49.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.529+0000 7fa157c00700 1 -- 172.21.15.49:0/3933432766 shutdown_connections 2024-01-22T05:04:49.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.529+0000 7fa157c00700 1 -- 172.21.15.49:0/3933432766 wait complete. 2024-01-22T05:04:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.533+0000 7fa157c00700 1 Processor -- start 2024-01-22T05:04:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa157c00700 1 -- start start 2024-01-22T05:04:49.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa157c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1500681a0 0x7fa150152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:49.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa157c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500c37d0 0x7fa1500aaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:49.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa157c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa150153bd0 0x7fa150069070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:49.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa157c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500acc50 con 0x7fa150153bd0 2024-01-22T05:04:49.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa157c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500acf30 con 0x7fa1500681a0 2024-01-22T05:04:49.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa157c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa150164220 con 0x7fa1500c37d0 2024-01-22T05:04:49.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa156600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa150153bd0 0x7fa150069070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:49.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa156600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa150153bd0 0x7fa150069070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48116/0 (socket says 172.21.15.49:48116) 2024-01-22T05:04:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa156600700 1 -- 172.21.15.49:0/3094713263 learned_addr learned my addr 172.21.15.49:0/3094713263 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa155200700 1 --2- 172.21.15.49:0/3094713263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1500681a0 0x7fa150152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa14fe00700 1 --2- 172.21.15.49:0/3094713263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500c37d0 0x7fa1500aaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa156600700 1 -- 172.21.15.49:0/3094713263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500c37d0 msgr2=0x7fa1500aaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa156600700 1 --2- 172.21.15.49:0/3094713263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500c37d0 0x7fa1500aaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa156600700 1 -- 172.21.15.49:0/3094713263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1500681a0 msgr2=0x7fa150152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa156600700 1 --2- 172.21.15.49:0/3094713263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1500681a0 0x7fa150152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa156600700 1 -- 172.21.15.49:0/3094713263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140009370 con 0x7fa150153bd0 2024-01-22T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa156600700 1 --2- 172.21.15.49:0/3094713263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa150153bd0 0x7fa150069070 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fa148009e90 tx=0x7fa14800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa147e00700 1 -- 172.21.15.49:0/3094713263 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14800cc20 con 0x7fa150153bd0 2024-01-22T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa147e00700 1 -- 172.21.15.49:0/3094713263 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14800f040 con 0x7fa150153bd0 2024-01-22T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa157c00700 1 -- 172.21.15.49:0/3094713263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa150164500 con 0x7fa150153bd0 2024-01-22T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.537+0000 7fa147e00700 1 -- 172.21.15.49:0/3094713263 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148013400 con 0x7fa150153bd0 2024-01-22T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.541+0000 7fa157c00700 1 -- 172.21.15.49:0/3094713263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1501532d0 con 0x7fa150153bd0 2024-01-22T05:04:49.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.541+0000 7fa157c00700 1 -- 172.21.15.49:0/3094713263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa150164a00 con 0x7fa150153bd0 2024-01-22T05:04:49.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.541+0000 7fa147e00700 1 -- 172.21.15.49:0/3094713263 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa1480137b0 con 0x7fa150153bd0 2024-01-22T05:04:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.545+0000 7fa147e00700 1 --2- 172.21.15.49:0/3094713263 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa12805a510 0x7fa12805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.545+0000 7fa147e00700 1 -- 172.21.15.49:0/3094713263 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fa148075410 con 0x7fa150153bd0 2024-01-22T05:04:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.545+0000 7fa155200700 1 --2- 172.21.15.49:0/3094713263 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa12805a510 0x7fa12805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.545+0000 7fa155200700 1 --2- 172.21.15.49:0/3094713263 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa12805a510 0x7fa12805c9d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fa140009fd0 tx=0x7fa140017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:49.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.549+0000 7fa147e00700 1 -- 172.21.15.49:0/3094713263 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa1480488e0 con 0x7fa150153bd0 2024-01-22T05:04:49.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.749+0000 7fa157c00700 1 -- 172.21.15.49:0/3094713263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1500c4760 con 0x7fa150153bd0 2024-01-22T05:04:49.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.753+0000 7fa147e00700 1 -- 172.21.15.49:0/3094713263 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4491 (secure 0 0 0) 0x7fa14804bf00 con 0x7fa150153bd0 2024-01-22T05:04:49.755 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:49.755 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/4240919875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4240919875},{"type":"v1","addr":"172.21.15.49:6836","nonce":4240919875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3591660134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3591660134},{"type":"v1","addr":"172.21.15.49:6837","nonce":3591660134}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1228202507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1228202507},{"type":"v1","addr":"172.21.15.110:6833","nonce":1228202507}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:04:35.017706+0000","modified":"2024-01-22T05:04:49.308211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3391981756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3391981756},{"type":"v1","addr":"172.21.15.110:6835","nonce":3391981756}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:04:49.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.753+0000 7fa157c00700 1 -- 172.21.15.49:0/3094713263 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa12805a510 msgr2=0x7fa12805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:49.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.753+0000 7fa157c00700 1 --2- 172.21.15.49:0/3094713263 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa12805a510 0x7fa12805c9d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fa140009fd0 tx=0x7fa140017000).stop 2024-01-22T05:04:49.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.753+0000 7fa157c00700 1 -- 172.21.15.49:0/3094713263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa150153bd0 msgr2=0x7fa150069070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:49.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.753+0000 7fa157c00700 1 --2- 172.21.15.49:0/3094713263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa150153bd0 0x7fa150069070 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fa148009e90 tx=0x7fa14800b040).stop 2024-01-22T05:04:49.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.757+0000 7fa157c00700 1 -- 172.21.15.49:0/3094713263 shutdown_connections 2024-01-22T05:04:49.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.757+0000 7fa157c00700 1 --2- 172.21.15.49:0/3094713263 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa12805a510 0x7fa12805c9d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.757+0000 7fa157c00700 1 --2- 172.21.15.49:0/3094713263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa150153bd0 0x7fa150069070 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.757+0000 7fa157c00700 1 --2- 172.21.15.49:0/3094713263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500c37d0 0x7fa1500aaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.757+0000 7fa157c00700 1 --2- 172.21.15.49:0/3094713263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1500681a0 0x7fa150152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.757+0000 7fa157c00700 1 -- 172.21.15.49:0/3094713263 >> 172.21.15.49:0/3094713263 conn(0x7fa150064080 msgr2=0x7fa15014d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:49.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.757+0000 7fa157c00700 1 -- 172.21.15.49:0/3094713263 shutdown_connections 2024-01-22T05:04:49.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.757+0000 7fa157c00700 1 -- 172.21.15.49:0/3094713263 wait complete. 2024-01-22T05:04:49.763 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-22T05:04:49.784 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:04:49.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.933+0000 7f22cde00700 1 Processor -- start 2024-01-22T05:04:49.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.933+0000 7f22cde00700 1 -- start start 2024-01-22T05:04:49.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.937+0000 7f22cde00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f22c80bdfa0 0x7f22c80688f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:49.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.937+0000 7f22cde00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f22c8063f40 0x7f22c8064380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:49.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.937+0000 7f22cde00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c8157b40 con 0x7f22c8153650 2024-01-22T05:04:49.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.937+0000 7f22cde00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c8158610 con 0x7f22c8063f40 2024-01-22T05:04:49.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.937+0000 7f22cde00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c80bc740 con 0x7f22c80bdfa0 2024-01-22T05:04:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.937+0000 7f22c7400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f22c8153650 0x7f22c8153ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33550/0 (socket says 172.21.15.49:33550) 2024-01-22T05:04:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.937+0000 7f22c7400700 1 -- 172.21.15.49:0/3028874375 learned_addr learned my addr 172.21.15.49:0/3028874375 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.937+0000 7f22c6000700 1 --2- 172.21.15.49:0/3028874375 >> v2:172.21.15.49:3300/0 conn(0x7f22c8063f40 0x7f22c8064380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.937+0000 7f22c6a00700 1 --2- 172.21.15.49:0/3028874375 >> v2:172.21.15.110:3300/0 conn(0x7f22c80bdfa0 0x7f22c80688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.937+0000 7f22c6000700 1 -- 172.21.15.49:0/3028874375 >> v2:172.21.15.110:3300/0 conn(0x7f22c80bdfa0 msgr2=0x7f22c80688f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.937+0000 7f22c6000700 1 --2- 172.21.15.49:0/3028874375 >> v2:172.21.15.110:3300/0 conn(0x7f22c80bdfa0 0x7f22c80688f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.937+0000 7f22c6000700 1 -- 172.21.15.49:0/3028874375 >> v1:172.21.15.49:6789/0 conn(0x7f22c8153650 legacy=0x7f22c8153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.937+0000 7f22c6000700 1 -- 172.21.15.49:0/3028874375 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8157d70 con 0x7f22c8063f40 2024-01-22T05:04:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.937+0000 7f22c5600700 1 -- 172.21.15.49:0/3028874375 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776052675 0 0) 0x7f22c8157b40 con 0x7f22c8153650 2024-01-22T05:04:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.937+0000 7f22c6000700 1 --2- 172.21.15.49:0/3028874375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c8063f40 0x7f22c8064380 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f22c8065b50 tx=0x7f22b0009060).ready entity=mon.0 client_cookie=7495311d0b43c936 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:49.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.941+0000 7f22c5600700 1 -- 172.21.15.49:0/3028874375 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b00090d0 con 0x7f22c8063f40 2024-01-22T05:04:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.941+0000 7f22c5600700 1 -- 172.21.15.49:0/3028874375 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b000f510 con 0x7f22c8063f40 2024-01-22T05:04:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.941+0000 7f22c5600700 1 -- 172.21.15.49:0/3028874375 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b000f890 con 0x7f22c8063f40 2024-01-22T05:04:49.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.941+0000 7f22cde00700 1 -- 172.21.15.49:0/3028874375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c8063f40 msgr2=0x7f22c8064380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:49.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.941+0000 7f22cde00700 1 --2- 172.21.15.49:0/3028874375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c8063f40 0x7f22c8064380 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f22c8065b50 tx=0x7f22b0009060).stop 2024-01-22T05:04:49.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.941+0000 7f22cde00700 1 -- 172.21.15.49:0/3028874375 shutdown_connections 2024-01-22T05:04:49.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.941+0000 7f22cde00700 1 --2- 172.21.15.49:0/3028874375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c8063f40 0x7f22c8064380 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.941+0000 7f22cde00700 1 --2- 172.21.15.49:0/3028874375 >> v2:172.21.15.110:3300/0 conn(0x7f22c80bdfa0 0x7f22c80688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.941+0000 7f22cde00700 1 -- 172.21.15.49:0/3028874375 >> 172.21.15.49:0/3028874375 conn(0x7f22c80c40c0 msgr2=0x7f22c80c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:49.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.941+0000 7f22cde00700 1 -- 172.21.15.49:0/3028874375 shutdown_connections 2024-01-22T05:04:49.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.941+0000 7f22cde00700 1 -- 172.21.15.49:0/3028874375 wait complete. 2024-01-22T05:04:49.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.945+0000 7f22cde00700 1 Processor -- start 2024-01-22T05:04:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.945+0000 7f22cde00700 1 -- start start 2024-01-22T05:04:49.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.945+0000 7f22cde00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c8063f40 0x7f22c8150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:49.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22cde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c80bdfa0 0x7f22c8151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:49.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22cde00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22c8153650 0x7f22c814d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:49.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22cde00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c8152dd0 con 0x7f22c80bdfa0 2024-01-22T05:04:49.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22cde00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c8151f20 con 0x7f22c8153650 2024-01-22T05:04:49.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22cde00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c814dab0 con 0x7f22c8063f40 2024-01-22T05:04:49.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22c6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c80bdfa0 0x7f22c8151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:49.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22c6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c80bdfa0 0x7f22c8151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48140/0 (socket says 172.21.15.49:48140) 2024-01-22T05:04:49.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22c6000700 1 -- 172.21.15.49:0/1596308197 learned_addr learned my addr 172.21.15.49:0/1596308197 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:49.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22c7400700 1 --2- 172.21.15.49:0/1596308197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22c8153650 0x7f22c814d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:49.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22c6a00700 1 --2- 172.21.15.49:0/1596308197 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c8063f40 0x7f22c8150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:49.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22c6000700 1 -- 172.21.15.49:0/1596308197 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c8063f40 msgr2=0x7f22c8150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:49.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22c6000700 1 --2- 172.21.15.49:0/1596308197 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c8063f40 0x7f22c8150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22c6000700 1 -- 172.21.15.49:0/1596308197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22c8153650 msgr2=0x7f22c814d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:49.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22c6000700 1 --2- 172.21.15.49:0/1596308197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22c8153650 0x7f22c814d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:49.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22c6000700 1 -- 172.21.15.49:0/1596308197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b00092a0 con 0x7f22c80bdfa0 2024-01-22T05:04:49.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22c6000700 1 --2- 172.21.15.49:0/1596308197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c80bdfa0 0x7f22c8151a30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f22b0009dd0 tx=0x7f22b0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:49.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22be000700 1 -- 172.21.15.49:0/1596308197 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b000fc50 con 0x7f22c80bdfa0 2024-01-22T05:04:49.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22be000700 1 -- 172.21.15.49:0/1596308197 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b000fdb0 con 0x7f22c80bdfa0 2024-01-22T05:04:49.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22cde00700 1 -- 172.21.15.49:0/1596308197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c81521c0 con 0x7f22c80bdfa0 2024-01-22T05:04:49.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22be000700 1 -- 172.21.15.49:0/1596308197 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b001b620 con 0x7f22c80bdfa0 2024-01-22T05:04:49.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22cde00700 1 -- 172.21.15.49:0/1596308197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c8152780 con 0x7f22c80bdfa0 2024-01-22T05:04:49.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.949+0000 7f22cde00700 1 -- 172.21.15.49:0/1596308197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c8152f80 con 0x7f22c80bdfa0 2024-01-22T05:04:49.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.953+0000 7f22be000700 1 -- 172.21.15.49:0/1596308197 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f22b001ba10 con 0x7f22c80bdfa0 2024-01-22T05:04:49.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.953+0000 7f22be000700 1 --2- 172.21.15.49:0/1596308197 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f22a005a510 0x7f22a005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:49.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.953+0000 7f22be000700 1 -- 172.21.15.49:0/1596308197 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f22b0076510 con 0x7f22c80bdfa0 2024-01-22T05:04:49.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.953+0000 7f22c6a00700 1 --2- 172.21.15.49:0/1596308197 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f22a005a510 0x7f22a005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:49.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.953+0000 7f22c6a00700 1 --2- 172.21.15.49:0/1596308197 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f22a005a510 0x7f22a005c9d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f22b8009bc0 tx=0x7f22b8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:49.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:49.961+0000 7f22be000700 1 -- 172.21.15.49:0/1596308197 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f22c8152f80 con 0x7f22c80bdfa0 2024-01-22T05:04:50.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.129+0000 7f22cde00700 1 -- 172.21.15.49:0/1596308197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22c8152f10 con 0x7f22c80bdfa0 2024-01-22T05:04:50.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.129+0000 7f22be000700 1 -- 172.21.15.49:0/1596308197 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f22b0029020 con 0x7f22c80bdfa0 2024-01-22T05:04:50.133 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:50.133 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:39.526211+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:04:50.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.133+0000 7f22cde00700 1 -- 172.21.15.49:0/1596308197 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f22a005a510 msgr2=0x7f22a005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:50.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.133+0000 7f22cde00700 1 --2- 172.21.15.49:0/1596308197 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f22a005a510 0x7f22a005c9d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f22b8009bc0 tx=0x7f22b8008040).stop 2024-01-22T05:04:50.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.133+0000 7f22cde00700 1 -- 172.21.15.49:0/1596308197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c80bdfa0 msgr2=0x7f22c8151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:50.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.133+0000 7f22cde00700 1 --2- 172.21.15.49:0/1596308197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c80bdfa0 0x7f22c8151a30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f22b0009dd0 tx=0x7f22b0017000).stop 2024-01-22T05:04:50.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.133+0000 7f22cde00700 1 -- 172.21.15.49:0/1596308197 shutdown_connections 2024-01-22T05:04:50.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.133+0000 7f22cde00700 1 --2- 172.21.15.49:0/1596308197 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f22a005a510 0x7f22a005c9d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.133+0000 7f22cde00700 1 --2- 172.21.15.49:0/1596308197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22c8153650 0x7f22c814d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.133+0000 7f22cde00700 1 --2- 172.21.15.49:0/1596308197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c80bdfa0 0x7f22c8151a30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.133+0000 7f22cde00700 1 --2- 172.21.15.49:0/1596308197 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c8063f40 0x7f22c8150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.133+0000 7f22cde00700 1 -- 172.21.15.49:0/1596308197 >> 172.21.15.49:0/1596308197 conn(0x7f22c80c40c0 msgr2=0x7f22c80c6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:50.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.133+0000 7f22cde00700 1 -- 172.21.15.49:0/1596308197 shutdown_connections 2024-01-22T05:04:50.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.133+0000 7f22cde00700 1 -- 172.21.15.49:0/1596308197 wait complete. 2024-01-22T05:04:50.160 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:04:50.160 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:04:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.329+0000 7f235e000700 1 Processor -- start 2024-01-22T05:04:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.329+0000 7f235e000700 1 -- start start 2024-01-22T05:04:50.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f235e000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f235814de40 0x7f235814e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:50.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f235e000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23580c06e0 0x7f2358157b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:50.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f235e000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2358158050 con 0x7f23581576b0 2024-01-22T05:04:50.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f235e000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2358067b30 con 0x7f235814de40 2024-01-22T05:04:50.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f235e000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2358067e10 con 0x7f23580c06e0 2024-01-22T05:04:50.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f2357400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f235814de40 0x7f235814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:50.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f2357400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f235814de40 0x7f235814e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48148/0 (socket says 172.21.15.49:48148) 2024-01-22T05:04:50.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f2357400700 1 -- 172.21.15.49:0/3592998152 learned_addr learned my addr 172.21.15.49:0/3592998152 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:50.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f235ca00700 1 --2- 172.21.15.49:0/3592998152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23580c06e0 0x7f2358157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:50.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f2356000700 1 -- 172.21.15.49:0/3592998152 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810124992 0 0) 0x7f2340001110 con 0x7f23581576b0 2024-01-22T05:04:50.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f2356000700 1 -- 172.21.15.49:0/3592998152 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23380033f0 con 0x7f23581576b0 2024-01-22T05:04:50.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f2357400700 1 -- 172.21.15.49:0/3592998152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23580c06e0 msgr2=0x7f2358157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:50.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f2357400700 1 --2- 172.21.15.49:0/3592998152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23580c06e0 0x7f2358157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f2357400700 1 -- 172.21.15.49:0/3592998152 >> v1:172.21.15.110:6789/0 conn(0x7f23581576b0 legacy=0x7f23580bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:50.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f2357400700 1 -- 172.21.15.49:0/3592998152 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23580680f0 con 0x7f235814de40 2024-01-22T05:04:50.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f2357400700 1 --2- 172.21.15.49:0/3592998152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f235814de40 0x7f235814e220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f2348006fd0 tx=0x7f23480090f0).ready entity=mon.0 client_cookie=94de7591de7a1673 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:50.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f2356000700 1 -- 172.21.15.49:0/3592998152 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234800f510 con 0x7f235814de40 2024-01-22T05:04:50.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f2356000700 1 -- 172.21.15.49:0/3592998152 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234800f670 con 0x7f235814de40 2024-01-22T05:04:50.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.333+0000 7f2356000700 1 -- 172.21.15.49:0/3592998152 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234800f9f0 con 0x7f235814de40 2024-01-22T05:04:50.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.337+0000 7f235e000700 1 -- 172.21.15.49:0/3592998152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f235814de40 msgr2=0x7f235814e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:50.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.337+0000 7f235e000700 1 --2- 172.21.15.49:0/3592998152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f235814de40 0x7f235814e220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f2348006fd0 tx=0x7f23480090f0).stop 2024-01-22T05:04:50.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.337+0000 7f235e000700 1 -- 172.21.15.49:0/3592998152 shutdown_connections 2024-01-22T05:04:50.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.337+0000 7f235e000700 1 --2- 172.21.15.49:0/3592998152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23580c06e0 0x7f2358157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.337+0000 7f235e000700 1 --2- 172.21.15.49:0/3592998152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f235814de40 0x7f235814e220 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.337+0000 7f235e000700 1 -- 172.21.15.49:0/3592998152 >> 172.21.15.49:0/3592998152 conn(0x7f23580c9f50 msgr2=0x7f23580ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:50.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.337+0000 7f235e000700 1 -- 172.21.15.49:0/3592998152 shutdown_connections 2024-01-22T05:04:50.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.337+0000 7f235e000700 1 -- 172.21.15.49:0/3592998152 wait complete. 2024-01-22T05:04:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.337+0000 7f235e000700 1 Processor -- start 2024-01-22T05:04:50.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f235e000700 1 -- start start 2024-01-22T05:04:50.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f235e000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23580c06e0 0x7f23581581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:50.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f235e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f235814de40 0x7f2358154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:50.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f235e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23581576b0 0x7f2358139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:50.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f235e000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23580ab180 con 0x7f235814de40 2024-01-22T05:04:50.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f235e000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23580ac0f0 con 0x7f23581576b0 2024-01-22T05:04:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f235e000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23580aaea0 con 0x7f23580c06e0 2024-01-22T05:04:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f2356a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f235814de40 0x7f2358154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f2356a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f235814de40 0x7f2358154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48162/0 (socket says 172.21.15.49:48162) 2024-01-22T05:04:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f2356a00700 1 -- 172.21.15.49:0/1867811625 learned_addr learned my addr 172.21.15.49:0/1867811625 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f2357400700 1 --2- 172.21.15.49:0/1867811625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23580c06e0 0x7f23581581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f235ca00700 1 --2- 172.21.15.49:0/1867811625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23581576b0 0x7f2358139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f2356a00700 1 -- 172.21.15.49:0/1867811625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23580c06e0 msgr2=0x7f23581581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f2356a00700 1 --2- 172.21.15.49:0/1867811625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23580c06e0 0x7f23581581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f2356a00700 1 -- 172.21.15.49:0/1867811625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23581576b0 msgr2=0x7f2358139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f2356a00700 1 --2- 172.21.15.49:0/1867811625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23581576b0 0x7f2358139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f2356a00700 1 -- 172.21.15.49:0/1867811625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2348009370 con 0x7f235814de40 2024-01-22T05:04:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f235ca00700 1 --2- 172.21.15.49:0/1867811625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23581576b0 0x7f2358139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:50.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.341+0000 7f2356a00700 1 --2- 172.21.15.49:0/1867811625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f235814de40 0x7f2358154a60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f234000c4a0 tx=0x7f2340007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:50.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.345+0000 7f234ea00700 1 -- 172.21.15.49:0/1867811625 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234000f470 con 0x7f235814de40 2024-01-22T05:04:50.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.345+0000 7f234ea00700 1 -- 172.21.15.49:0/1867811625 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234000f5d0 con 0x7f235814de40 2024-01-22T05:04:50.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.345+0000 7f234ea00700 1 -- 172.21.15.49:0/1867811625 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234000f970 con 0x7f235814de40 2024-01-22T05:04:50.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.345+0000 7f235e000700 1 -- 172.21.15.49:0/1867811625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23580ac390 con 0x7f235814de40 2024-01-22T05:04:50.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.345+0000 7f235e000700 1 -- 172.21.15.49:0/1867811625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23580ae1d0 con 0x7f235814de40 2024-01-22T05:04:50.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.345+0000 7f235e000700 1 -- 172.21.15.49:0/1867811625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23580c2db0 con 0x7f235814de40 2024-01-22T05:04:50.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.345+0000 7f234ea00700 1 -- 172.21.15.49:0/1867811625 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f234000fce0 con 0x7f235814de40 2024-01-22T05:04:50.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.349+0000 7f234ea00700 1 --2- 172.21.15.49:0/1867811625 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f233005a540 0x7f233005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:50.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.349+0000 7f234ea00700 1 -- 172.21.15.49:0/1867811625 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f2340073ec0 con 0x7f235814de40 2024-01-22T05:04:50.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.349+0000 7f2357400700 1 --2- 172.21.15.49:0/1867811625 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f233005a540 0x7f233005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:50.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.349+0000 7f2357400700 1 --2- 172.21.15.49:0/1867811625 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f233005a540 0x7f233005ca00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2348009130 tx=0x7f2348017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:50.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.353+0000 7f234ea00700 1 -- 172.21.15.49:0/1867811625 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2340047390 con 0x7f235814de40 2024-01-22T05:04:50.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.517+0000 7f235e000700 1 -- 172.21.15.49:0/1867811625 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2358158050 con 0x7f233005a540 2024-01-22T05:04:50.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.533+0000 7f234ea00700 1 -- 172.21.15.49:0/1867811625 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+410440 (secure 0 0 0) 0x7f2358158050 con 0x7f233005a540 2024-01-22T05:04:50.542 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.541+0000 7f235e000700 1 -- 172.21.15.49:0/1867811625 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f233005a540 msgr2=0x7f233005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.541+0000 7f235e000700 1 --2- 172.21.15.49:0/1867811625 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f233005a540 0x7f233005ca00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2348009130 tx=0x7f2348017000).stop 2024-01-22T05:04:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.541+0000 7f235e000700 1 -- 172.21.15.49:0/1867811625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f235814de40 msgr2=0x7f2358154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.541+0000 7f235e000700 1 --2- 172.21.15.49:0/1867811625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f235814de40 0x7f2358154a60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f234000c4a0 tx=0x7f2340007b00).stop 2024-01-22T05:04:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.541+0000 7f235e000700 1 -- 172.21.15.49:0/1867811625 shutdown_connections 2024-01-22T05:04:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.541+0000 7f235e000700 1 --2- 172.21.15.49:0/1867811625 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f233005a540 0x7f233005ca00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.541+0000 7f235e000700 1 --2- 172.21.15.49:0/1867811625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23581576b0 0x7f2358139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.541+0000 7f235e000700 1 --2- 172.21.15.49:0/1867811625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f235814de40 0x7f2358154a60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.541+0000 7f235e000700 1 --2- 172.21.15.49:0/1867811625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23580c06e0 0x7f23581581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.541+0000 7f235e000700 1 -- 172.21.15.49:0/1867811625 >> 172.21.15.49:0/1867811625 conn(0x7f23580c9f50 msgr2=0x7f23580ca330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.545+0000 7f235e000700 1 -- 172.21.15.49:0/1867811625 shutdown_connections 2024-01-22T05:04:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.545+0000 7f235e000700 1 -- 172.21.15.49:0/1867811625 wait complete. 2024-01-22T05:04:50.549 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:04:50.569 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-01-22T05:04:49.227238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378912,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595808,"statfs":{"total":773094113280,"available":770658107392,"internally_reserved":0,"allocated":2195456,"data_stored":896466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2179,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003561"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082694+0000","last_change":"2024-01-22T05:04:35.050369+0000","last_active":"2024-01-22T05:04:39.082694+0000","last_peered":"2024-01-22T05:04:39.082694+0000","last_clean":"2024-01-22T05:04:39.082694+0000","last_became_active":"2024-01-22T05:04:35.050006+0000","last_became_peered":"2024-01-22T05:04:35.050006+0000","last_unstale":"2024-01-22T05:04:39.082694+0000","last_undegraded":"2024-01-22T05:04:39.082694+0000","last_fullsized":"2024-01-22T05:04:39.082694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101110+0000","last_change":"2024-01-22T05:04:34.615730+0000","last_active":"2024-01-22T05:04:39.101110+0000","last_peered":"2024-01-22T05:04:39.101110+0000","last_clean":"2024-01-22T05:04:39.101110+0000","last_became_active":"2024-01-22T05:04:34.615423+0000","last_became_peered":"2024-01-22T05:04:34.615423+0000","last_unstale":"2024-01-22T05:04:39.101110+0000","last_undegraded":"2024-01-22T05:04:39.101110+0000","last_fullsized":"2024-01-22T05:04:39.101110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091379+0000","last_change":"2024-01-22T05:04:35.061052+0000","last_active":"2024-01-22T05:04:39.091379+0000","last_peered":"2024-01-22T05:04:39.091379+0000","last_clean":"2024-01-22T05:04:39.091379+0000","last_became_active":"2024-01-22T05:04:35.060391+0000","last_became_peered":"2024-01-22T05:04:35.060391+0000","last_unstale":"2024-01-22T05:04:39.091379+0000","last_undegraded":"2024-01-22T05:04:39.091379+0000","last_fullsized":"2024-01-22T05:04:39.091379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079454+0000","last_change":"2024-01-22T05:04:34.625335+0000","last_active":"2024-01-22T05:04:39.079454+0000","last_peered":"2024-01-22T05:04:39.079454+0000","last_clean":"2024-01-22T05:04:39.079454+0000","last_became_active":"2024-01-22T05:04:34.625033+0000","last_became_peered":"2024-01-22T05:04:34.625033+0000","last_unstale":"2024-01-22T05:04:39.079454+0000","last_undegraded":"2024-01-22T05:04:39.079454+0000","last_fullsized":"2024-01-22T05:04:39.079454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.083181+0000","last_change":"2024-01-22T05:04:34.613206+0000","last_active":"2024-01-22T05:04:39.083181+0000","last_peered":"2024-01-22T05:04:39.083181+0000","last_clean":"2024-01-22T05:04:39.083181+0000","last_became_active":"2024-01-22T05:04:34.612458+0000","last_became_peered":"2024-01-22T05:04:34.612458+0000","last_unstale":"2024-01-22T05:04:39.083181+0000","last_undegraded":"2024-01-22T05:04:39.083181+0000","last_fullsized":"2024-01-22T05:04:39.083181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087816+0000","last_change":"2024-01-22T05:04:35.067504+0000","last_active":"2024-01-22T05:04:39.087816+0000","last_peered":"2024-01-22T05:04:39.087816+0000","last_clean":"2024-01-22T05:04:39.087816+0000","last_became_active":"2024-01-22T05:04:35.067007+0000","last_became_peered":"2024-01-22T05:04:35.067007+0000","last_unstale":"2024-01-22T05:04:39.087816+0000","last_undegraded":"2024-01-22T05:04:39.087816+0000","last_fullsized":"2024-01-22T05:04:39.087816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.074244+0000","last_change":"2024-01-22T05:04:34.618016+0000","last_active":"2024-01-22T05:04:39.074244+0000","last_peered":"2024-01-22T05:04:39.074244+0000","last_clean":"2024-01-22T05:04:39.074244+0000","last_became_active":"2024-01-22T05:04:34.616976+0000","last_became_peered":"2024-01-22T05:04:34.616976+0000","last_unstale":"2024-01-22T05:04:39.074244+0000","last_undegraded":"2024-01-22T05:04:39.074244+0000","last_fullsized":"2024-01-22T05:04:39.074244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087750+0000","last_change":"2024-01-22T05:04:35.055742+0000","last_active":"2024-01-22T05:04:39.087750+0000","last_peered":"2024-01-22T05:04:39.087750+0000","last_clean":"2024-01-22T05:04:39.087750+0000","last_became_active":"2024-01-22T05:04:35.055484+0000","last_became_peered":"2024-01-22T05:04:35.055484+0000","last_unstale":"2024-01-22T05:04:39.087750+0000","last_undegraded":"2024-01-22T05:04:39.087750+0000","last_fullsized":"2024-01-22T05:04:39.087750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091158+0000","last_change":"2024-01-22T05:04:34.602682+0000","last_active":"2024-01-22T05:04:39.091158+0000","last_peered":"2024-01-22T05:04:39.091158+0000","last_clean":"2024-01-22T05:04:39.091158+0000","last_became_active":"2024-01-22T05:04:34.602415+0000","last_became_peered":"2024-01-22T05:04:34.602415+0000","last_unstale":"2024-01-22T05:04:39.091158+0000","last_undegraded":"2024-01-22T05:04:39.091158+0000","last_fullsized":"2024-01-22T05:04:39.091158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077259+0000","last_change":"2024-01-22T05:04:35.046243+0000","last_active":"2024-01-22T05:04:39.077259+0000","last_peered":"2024-01-22T05:04:39.077259+0000","last_clean":"2024-01-22T05:04:39.077259+0000","last_became_active":"2024-01-22T05:04:35.045968+0000","last_became_peered":"2024-01-22T05:04:35.045968+0000","last_unstale":"2024-01-22T05:04:39.077259+0000","last_undegraded":"2024-01-22T05:04:39.077259+0000","last_fullsized":"2024-01-22T05:04:39.077259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.094051+0000","last_change":"2024-01-22T05:04:34.612841+0000","last_active":"2024-01-22T05:04:39.094051+0000","last_peered":"2024-01-22T05:04:39.094051+0000","last_clean":"2024-01-22T05:04:39.094051+0000","last_became_active":"2024-01-22T05:04:34.612529+0000","last_became_peered":"2024-01-22T05:04:34.612529+0000","last_unstale":"2024-01-22T05:04:39.094051+0000","last_undegraded":"2024-01-22T05:04:39.094051+0000","last_fullsized":"2024-01-22T05:04:39.094051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090289+0000","last_change":"2024-01-22T05:04:35.067328+0000","last_active":"2024-01-22T05:04:39.090289+0000","last_peered":"2024-01-22T05:04:39.090289+0000","last_clean":"2024-01-22T05:04:39.090289+0000","last_became_active":"2024-01-22T05:04:35.066995+0000","last_became_peered":"2024-01-22T05:04:35.066995+0000","last_unstale":"2024-01-22T05:04:39.090289+0000","last_undegraded":"2024-01-22T05:04:39.090289+0000","last_fullsized":"2024-01-22T05:04:39.090289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091559+0000","last_change":"2024-01-22T05:04:34.613788+0000","last_active":"2024-01-22T05:04:39.091559+0000","last_peered":"2024-01-22T05:04:39.091559+0000","last_clean":"2024-01-22T05:04:39.091559+0000","last_became_active":"2024-01-22T05:04:34.611731+0000","last_became_peered":"2024-01-22T05:04:34.611731+0000","last_unstale":"2024-01-22T05:04:39.091559+0000","last_undegraded":"2024-01-22T05:04:39.091559+0000","last_fullsized":"2024-01-22T05:04:39.091559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072961+0000","last_change":"2024-01-22T05:04:35.053554+0000","last_active":"2024-01-22T05:04:39.072961+0000","last_peered":"2024-01-22T05:04:39.072961+0000","last_clean":"2024-01-22T05:04:39.072961+0000","last_became_active":"2024-01-22T05:04:35.052755+0000","last_became_peered":"2024-01-22T05:04:35.052755+0000","last_unstale":"2024-01-22T05:04:39.072961+0000","last_undegraded":"2024-01-22T05:04:39.072961+0000","last_fullsized":"2024-01-22T05:04:39.072961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077414+0000","last_change":"2024-01-22T05:04:34.612292+0000","last_active":"2024-01-22T05:04:39.077414+0000","last_peered":"2024-01-22T05:04:39.077414+0000","last_clean":"2024-01-22T05:04:39.077414+0000","last_became_active":"2024-01-22T05:04:34.611340+0000","last_became_peered":"2024-01-22T05:04:34.611340+0000","last_unstale":"2024-01-22T05:04:39.077414+0000","last_undegraded":"2024-01-22T05:04:39.077414+0000","last_fullsized":"2024-01-22T05:04:39.077414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073500+0000","last_change":"2024-01-22T05:04:35.047170+0000","last_active":"2024-01-22T05:04:39.073500+0000","last_peered":"2024-01-22T05:04:39.073500+0000","last_clean":"2024-01-22T05:04:39.073500+0000","last_became_active":"2024-01-22T05:04:35.046891+0000","last_became_peered":"2024-01-22T05:04:35.046891+0000","last_unstale":"2024-01-22T05:04:39.073500+0000","last_undegraded":"2024-01-22T05:04:39.073500+0000","last_fullsized":"2024-01-22T05:04:39.073500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.088007+0000","last_change":"2024-01-22T05:04:34.614155+0000","last_active":"2024-01-22T05:04:39.088007+0000","last_peered":"2024-01-22T05:04:39.088007+0000","last_clean":"2024-01-22T05:04:39.088007+0000","last_became_active":"2024-01-22T05:04:34.613838+0000","last_became_peered":"2024-01-22T05:04:34.613838+0000","last_unstale":"2024-01-22T05:04:39.088007+0000","last_undegraded":"2024-01-22T05:04:39.088007+0000","last_fullsized":"2024-01-22T05:04:39.088007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073280+0000","last_change":"2024-01-22T05:04:35.059943+0000","last_active":"2024-01-22T05:04:39.073280+0000","last_peered":"2024-01-22T05:04:39.073280+0000","last_clean":"2024-01-22T05:04:39.073280+0000","last_became_active":"2024-01-22T05:04:35.057491+0000","last_became_peered":"2024-01-22T05:04:35.057491+0000","last_unstale":"2024-01-22T05:04:39.073280+0000","last_undegraded":"2024-01-22T05:04:39.073280+0000","last_fullsized":"2024-01-22T05:04:39.073280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079555+0000","last_change":"2024-01-22T05:04:34.602873+0000","last_active":"2024-01-22T05:04:39.079555+0000","last_peered":"2024-01-22T05:04:39.079555+0000","last_clean":"2024-01-22T05:04:39.079555+0000","last_became_active":"2024-01-22T05:04:34.602401+0000","last_became_peered":"2024-01-22T05:04:34.602401+0000","last_unstale":"2024-01-22T05:04:39.079555+0000","last_undegraded":"2024-01-22T05:04:39.079555+0000","last_fullsized":"2024-01-22T05:04:39.079555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091439+0000","last_change":"2024-01-22T05:04:35.061246+0000","last_active":"2024-01-22T05:04:39.091439+0000","last_peered":"2024-01-22T05:04:39.091439+0000","last_clean":"2024-01-22T05:04:39.091439+0000","last_became_active":"2024-01-22T05:04:35.060730+0000","last_became_peered":"2024-01-22T05:04:35.060730+0000","last_unstale":"2024-01-22T05:04:39.091439+0000","last_undegraded":"2024-01-22T05:04:39.091439+0000","last_fullsized":"2024-01-22T05:04:39.091439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.085851+0000","last_change":"2024-01-22T05:04:34.619066+0000","last_active":"2024-01-22T05:04:39.085851+0000","last_peered":"2024-01-22T05:04:39.085851+0000","last_clean":"2024-01-22T05:04:39.085851+0000","last_became_active":"2024-01-22T05:04:34.618524+0000","last_became_peered":"2024-01-22T05:04:34.618524+0000","last_unstale":"2024-01-22T05:04:39.085851+0000","last_undegraded":"2024-01-22T05:04:39.085851+0000","last_fullsized":"2024-01-22T05:04:39.085851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.088848+0000","last_change":"2024-01-22T05:04:35.047351+0000","last_active":"2024-01-22T05:04:39.088848+0000","last_peered":"2024-01-22T05:04:39.088848+0000","last_clean":"2024-01-22T05:04:39.088848+0000","last_became_active":"2024-01-22T05:04:35.047047+0000","last_became_peered":"2024-01-22T05:04:35.047047+0000","last_unstale":"2024-01-22T05:04:39.088848+0000","last_undegraded":"2024-01-22T05:04:39.088848+0000","last_fullsized":"2024-01-22T05:04:39.088848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.558487+0000","last_change":"2024-01-22T05:04:34.619862+0000","last_active":"2024-01-22T05:04:39.558487+0000","last_peered":"2024-01-22T05:04:39.558487+0000","last_clean":"2024-01-22T05:04:39.558487+0000","last_became_active":"2024-01-22T05:04:34.615400+0000","last_became_peered":"2024-01-22T05:04:34.615400+0000","last_unstale":"2024-01-22T05:04:39.558487+0000","last_undegraded":"2024-01-22T05:04:39.558487+0000","last_fullsized":"2024-01-22T05:04:39.558487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087854+0000","last_change":"2024-01-22T05:04:35.062780+0000","last_active":"2024-01-22T05:04:39.087854+0000","last_peered":"2024-01-22T05:04:39.087854+0000","last_clean":"2024-01-22T05:04:39.087854+0000","last_became_active":"2024-01-22T05:04:35.062412+0000","last_became_peered":"2024-01-22T05:04:35.062412+0000","last_unstale":"2024-01-22T05:04:39.087854+0000","last_undegraded":"2024-01-22T05:04:39.087854+0000","last_fullsized":"2024-01-22T05:04:39.087854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104001+0000","last_change":"2024-01-22T05:04:34.613410+0000","last_active":"2024-01-22T05:04:39.104001+0000","last_peered":"2024-01-22T05:04:39.104001+0000","last_clean":"2024-01-22T05:04:39.104001+0000","last_became_active":"2024-01-22T05:04:34.613064+0000","last_became_peered":"2024-01-22T05:04:34.613064+0000","last_unstale":"2024-01-22T05:04:39.104001+0000","last_undegraded":"2024-01-22T05:04:39.104001+0000","last_fullsized":"2024-01-22T05:04:39.104001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071476+0000","last_change":"2024-01-22T05:04:35.057169+0000","last_active":"2024-01-22T05:04:39.071476+0000","last_peered":"2024-01-22T05:04:39.071476+0000","last_clean":"2024-01-22T05:04:39.071476+0000","last_became_active":"2024-01-22T05:04:35.052838+0000","last_became_peered":"2024-01-22T05:04:35.052838+0000","last_unstale":"2024-01-22T05:04:39.071476+0000","last_undegraded":"2024-01-22T05:04:39.071476+0000","last_fullsized":"2024-01-22T05:04:39.071476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087571+0000","last_change":"2024-01-22T05:04:34.621537+0000","last_active":"2024-01-22T05:04:39.087571+0000","last_peered":"2024-01-22T05:04:39.087571+0000","last_clean":"2024-01-22T05:04:39.087571+0000","last_became_active":"2024-01-22T05:04:34.619679+0000","last_became_peered":"2024-01-22T05:04:34.619679+0000","last_unstale":"2024-01-22T05:04:39.087571+0000","last_undegraded":"2024-01-22T05:04:39.087571+0000","last_fullsized":"2024-01-22T05:04:39.087571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082734+0000","last_change":"2024-01-22T05:04:35.058927+0000","last_active":"2024-01-22T05:04:39.082734+0000","last_peered":"2024-01-22T05:04:39.082734+0000","last_clean":"2024-01-22T05:04:39.082734+0000","last_became_active":"2024-01-22T05:04:35.058360+0000","last_became_peered":"2024-01-22T05:04:35.058360+0000","last_unstale":"2024-01-22T05:04:39.082734+0000","last_undegraded":"2024-01-22T05:04:39.082734+0000","last_fullsized":"2024-01-22T05:04:39.082734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091650+0000","last_change":"2024-01-22T05:04:34.603402+0000","last_active":"2024-01-22T05:04:39.091650+0000","last_peered":"2024-01-22T05:04:39.091650+0000","last_clean":"2024-01-22T05:04:39.091650+0000","last_became_active":"2024-01-22T05:04:34.601578+0000","last_became_peered":"2024-01-22T05:04:34.601578+0000","last_unstale":"2024-01-22T05:04:39.091650+0000","last_undegraded":"2024-01-22T05:04:39.091650+0000","last_fullsized":"2024-01-22T05:04:39.091650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104259+0000","last_change":"2024-01-22T05:04:35.069261+0000","last_active":"2024-01-22T05:04:39.104259+0000","last_peered":"2024-01-22T05:04:39.104259+0000","last_clean":"2024-01-22T05:04:39.104259+0000","last_became_active":"2024-01-22T05:04:35.068641+0000","last_became_peered":"2024-01-22T05:04:35.068641+0000","last_unstale":"2024-01-22T05:04:39.104259+0000","last_undegraded":"2024-01-22T05:04:39.104259+0000","last_fullsized":"2024-01-22T05:04:39.104259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077499+0000","last_change":"2024-01-22T05:04:34.613087+0000","last_active":"2024-01-22T05:04:39.077499+0000","last_peered":"2024-01-22T05:04:39.077499+0000","last_clean":"2024-01-22T05:04:39.077499+0000","last_became_active":"2024-01-22T05:04:34.612162+0000","last_became_peered":"2024-01-22T05:04:34.612162+0000","last_unstale":"2024-01-22T05:04:39.077499+0000","last_undegraded":"2024-01-22T05:04:39.077499+0000","last_fullsized":"2024-01-22T05:04:39.077499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082087+0000","last_change":"2024-01-22T05:04:35.064923+0000","last_active":"2024-01-22T05:04:39.082087+0000","last_peered":"2024-01-22T05:04:39.082087+0000","last_clean":"2024-01-22T05:04:39.082087+0000","last_became_active":"2024-01-22T05:04:35.064659+0000","last_became_peered":"2024-01-22T05:04:35.064659+0000","last_unstale":"2024-01-22T05:04:39.082087+0000","last_undegraded":"2024-01-22T05:04:39.082087+0000","last_fullsized":"2024-01-22T05:04:39.082087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.069357+0000","last_change":"2024-01-22T05:04:34.613407+0000","last_active":"2024-01-22T05:04:39.069357+0000","last_peered":"2024-01-22T05:04:39.069357+0000","last_clean":"2024-01-22T05:04:39.069357+0000","last_became_active":"2024-01-22T05:04:34.613071+0000","last_became_peered":"2024-01-22T05:04:34.613071+0000","last_unstale":"2024-01-22T05:04:39.069357+0000","last_undegraded":"2024-01-22T05:04:39.069357+0000","last_fullsized":"2024-01-22T05:04:39.069357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.106863+0000","last_change":"2024-01-22T05:04:35.041221+0000","last_active":"2024-01-22T05:04:39.106863+0000","last_peered":"2024-01-22T05:04:39.106863+0000","last_clean":"2024-01-22T05:04:39.106863+0000","last_became_active":"2024-01-22T05:04:35.040768+0000","last_became_peered":"2024-01-22T05:04:35.040768+0000","last_unstale":"2024-01-22T05:04:39.106863+0000","last_undegraded":"2024-01-22T05:04:39.106863+0000","last_fullsized":"2024-01-22T05:04:39.106863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.088940+0000","last_change":"2024-01-22T05:04:34.620016+0000","last_active":"2024-01-22T05:04:39.088940+0000","last_peered":"2024-01-22T05:04:39.088940+0000","last_clean":"2024-01-22T05:04:39.088940+0000","last_became_active":"2024-01-22T05:04:34.617253+0000","last_became_peered":"2024-01-22T05:04:34.617253+0000","last_unstale":"2024-01-22T05:04:39.088940+0000","last_undegraded":"2024-01-22T05:04:39.088940+0000","last_fullsized":"2024-01-22T05:04:39.088940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.116642+0000","last_change":"2024-01-22T05:04:35.046592+0000","last_active":"2024-01-22T05:04:39.116642+0000","last_peered":"2024-01-22T05:04:39.116642+0000","last_clean":"2024-01-22T05:04:39.116642+0000","last_became_active":"2024-01-22T05:04:35.046327+0000","last_became_peered":"2024-01-22T05:04:35.046327+0000","last_unstale":"2024-01-22T05:04:39.116642+0000","last_undegraded":"2024-01-22T05:04:39.116642+0000","last_fullsized":"2024-01-22T05:04:39.116642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.120146+0000","last_change":"2024-01-22T05:04:39.111440+0000","last_active":"2024-01-22T05:04:39.120146+0000","last_peered":"2024-01-22T05:04:39.120146+0000","last_clean":"2024-01-22T05:04:39.120146+0000","last_became_active":"2024-01-22T05:04:39.111025+0000","last_became_peered":"2024-01-22T05:04:39.111025+0000","last_unstale":"2024-01-22T05:04:39.120146+0000","last_undegraded":"2024-01-22T05:04:39.120146+0000","last_fullsized":"2024-01-22T05:04:39.120146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091490+0000","last_change":"2024-01-22T05:04:34.605684+0000","last_active":"2024-01-22T05:04:39.091490+0000","last_peered":"2024-01-22T05:04:39.091490+0000","last_clean":"2024-01-22T05:04:39.091490+0000","last_became_active":"2024-01-22T05:04:34.605346+0000","last_became_peered":"2024-01-22T05:04:34.605346+0000","last_unstale":"2024-01-22T05:04:39.091490+0000","last_undegraded":"2024-01-22T05:04:39.091490+0000","last_fullsized":"2024-01-22T05:04:39.091490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071714+0000","last_change":"2024-01-22T05:04:35.053273+0000","last_active":"2024-01-22T05:04:39.071714+0000","last_peered":"2024-01-22T05:04:39.071714+0000","last_clean":"2024-01-22T05:04:39.071714+0000","last_became_active":"2024-01-22T05:04:35.052833+0000","last_became_peered":"2024-01-22T05:04:35.052833+0000","last_unstale":"2024-01-22T05:04:39.071714+0000","last_undegraded":"2024-01-22T05:04:39.071714+0000","last_fullsized":"2024-01-22T05:04:39.071714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103041+0000","last_change":"2024-01-22T05:04:39.099537+0000","last_active":"2024-01-22T05:04:39.103041+0000","last_peered":"2024-01-22T05:04:39.103041+0000","last_clean":"2024-01-22T05:04:39.103041+0000","last_became_active":"2024-01-22T05:04:39.099039+0000","last_became_peered":"2024-01-22T05:04:39.099039+0000","last_unstale":"2024-01-22T05:04:39.103041+0000","last_undegraded":"2024-01-22T05:04:39.103041+0000","last_fullsized":"2024-01-22T05:04:39.103041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.083714+0000","last_change":"2024-01-22T05:04:34.622996+0000","last_active":"2024-01-22T05:04:39.083714+0000","last_peered":"2024-01-22T05:04:39.083714+0000","last_clean":"2024-01-22T05:04:39.083714+0000","last_became_active":"2024-01-22T05:04:34.622644+0000","last_became_peered":"2024-01-22T05:04:34.622644+0000","last_unstale":"2024-01-22T05:04:39.083714+0000","last_undegraded":"2024-01-22T05:04:39.083714+0000","last_fullsized":"2024-01-22T05:04:39.083714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087958+0000","last_change":"2024-01-22T05:04:35.054335+0000","last_active":"2024-01-22T05:04:39.087958+0000","last_peered":"2024-01-22T05:04:39.087958+0000","last_clean":"2024-01-22T05:04:39.087958+0000","last_became_active":"2024-01-22T05:04:35.049434+0000","last_became_peered":"2024-01-22T05:04:35.049434+0000","last_unstale":"2024-01-22T05:04:39.087958+0000","last_undegraded":"2024-01-22T05:04:39.087958+0000","last_fullsized":"2024-01-22T05:04:39.087958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.108343+0000","last_change":"2024-01-22T05:04:39.099472+0000","last_active":"2024-01-22T05:04:39.108343+0000","last_peered":"2024-01-22T05:04:39.108343+0000","last_clean":"2024-01-22T05:04:39.108343+0000","last_became_active":"2024-01-22T05:04:39.099032+0000","last_became_peered":"2024-01-22T05:04:39.099032+0000","last_unstale":"2024-01-22T05:04:39.108343+0000","last_undegraded":"2024-01-22T05:04:39.108343+0000","last_fullsized":"2024-01-22T05:04:39.108343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082319+0000","last_change":"2024-01-22T05:04:34.601591+0000","last_active":"2024-01-22T05:04:39.082319+0000","last_peered":"2024-01-22T05:04:39.082319+0000","last_clean":"2024-01-22T05:04:39.082319+0000","last_became_active":"2024-01-22T05:04:34.601315+0000","last_became_peered":"2024-01-22T05:04:34.601315+0000","last_unstale":"2024-01-22T05:04:39.082319+0000","last_undegraded":"2024-01-22T05:04:39.082319+0000","last_fullsized":"2024-01-22T05:04:39.082319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071207+0000","last_change":"2024-01-22T05:04:35.061009+0000","last_active":"2024-01-22T05:04:39.071207+0000","last_peered":"2024-01-22T05:04:39.071207+0000","last_clean":"2024-01-22T05:04:39.071207+0000","last_became_active":"2024-01-22T05:04:35.060328+0000","last_became_peered":"2024-01-22T05:04:35.060328+0000","last_unstale":"2024-01-22T05:04:39.071207+0000","last_undegraded":"2024-01-22T05:04:39.071207+0000","last_fullsized":"2024-01-22T05:04:39.071207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.116310+0000","last_change":"2024-01-22T05:04:39.114183+0000","last_active":"2024-01-22T05:04:39.116310+0000","last_peered":"2024-01-22T05:04:39.116310+0000","last_clean":"2024-01-22T05:04:39.116310+0000","last_became_active":"2024-01-22T05:04:39.113514+0000","last_became_peered":"2024-01-22T05:04:39.113514+0000","last_unstale":"2024-01-22T05:04:39.116310+0000","last_undegraded":"2024-01-22T05:04:39.116310+0000","last_fullsized":"2024-01-22T05:04:39.116310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.080489+0000","last_change":"2024-01-22T05:04:34.599714+0000","last_active":"2024-01-22T05:04:39.080489+0000","last_peered":"2024-01-22T05:04:39.080489+0000","last_clean":"2024-01-22T05:04:39.080489+0000","last_became_active":"2024-01-22T05:04:34.599372+0000","last_became_peered":"2024-01-22T05:04:34.599372+0000","last_unstale":"2024-01-22T05:04:39.080489+0000","last_undegraded":"2024-01-22T05:04:39.080489+0000","last_fullsized":"2024-01-22T05:04:39.080489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071613+0000","last_change":"2024-01-22T05:04:35.063064+0000","last_active":"2024-01-22T05:04:39.071613+0000","last_peered":"2024-01-22T05:04:39.071613+0000","last_clean":"2024-01-22T05:04:39.071613+0000","last_became_active":"2024-01-22T05:04:35.060532+0000","last_became_peered":"2024-01-22T05:04:35.060532+0000","last_unstale":"2024-01-22T05:04:39.071613+0000","last_undegraded":"2024-01-22T05:04:39.071613+0000","last_fullsized":"2024-01-22T05:04:39.071613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.120120+0000","last_change":"2024-01-22T05:04:39.112845+0000","last_active":"2024-01-22T05:04:39.120120+0000","last_peered":"2024-01-22T05:04:39.120120+0000","last_clean":"2024-01-22T05:04:39.120120+0000","last_became_active":"2024-01-22T05:04:39.107762+0000","last_became_peered":"2024-01-22T05:04:39.107762+0000","last_unstale":"2024-01-22T05:04:39.120120+0000","last_undegraded":"2024-01-22T05:04:39.120120+0000","last_fullsized":"2024-01-22T05:04:39.120120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091889+0000","last_change":"2024-01-22T05:04:34.615318+0000","last_active":"2024-01-22T05:04:39.091889+0000","last_peered":"2024-01-22T05:04:39.091889+0000","last_clean":"2024-01-22T05:04:39.091889+0000","last_became_active":"2024-01-22T05:04:34.609702+0000","last_became_peered":"2024-01-22T05:04:34.609702+0000","last_unstale":"2024-01-22T05:04:39.091889+0000","last_undegraded":"2024-01-22T05:04:39.091889+0000","last_fullsized":"2024-01-22T05:04:39.091889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070678+0000","last_change":"2024-01-22T05:04:35.042388+0000","last_active":"2024-01-22T05:04:39.070678+0000","last_peered":"2024-01-22T05:04:39.070678+0000","last_clean":"2024-01-22T05:04:39.070678+0000","last_became_active":"2024-01-22T05:04:35.041995+0000","last_became_peered":"2024-01-22T05:04:35.041995+0000","last_unstale":"2024-01-22T05:04:39.070678+0000","last_undegraded":"2024-01-22T05:04:39.070678+0000","last_fullsized":"2024-01-22T05:04:39.070678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.095146+0000","last_change":"2024-01-22T05:04:39.091003+0000","last_active":"2024-01-22T05:04:39.095146+0000","last_peered":"2024-01-22T05:04:39.095146+0000","last_clean":"2024-01-22T05:04:39.095146+0000","last_became_active":"2024-01-22T05:04:39.090439+0000","last_became_peered":"2024-01-22T05:04:39.090439+0000","last_unstale":"2024-01-22T05:04:39.095146+0000","last_undegraded":"2024-01-22T05:04:39.095146+0000","last_fullsized":"2024-01-22T05:04:39.095146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071709+0000","last_change":"2024-01-22T05:04:34.618944+0000","last_active":"2024-01-22T05:04:39.071709+0000","last_peered":"2024-01-22T05:04:39.071709+0000","last_clean":"2024-01-22T05:04:39.071709+0000","last_became_active":"2024-01-22T05:04:34.618671+0000","last_became_peered":"2024-01-22T05:04:34.618671+0000","last_unstale":"2024-01-22T05:04:39.071709+0000","last_undegraded":"2024-01-22T05:04:39.071709+0000","last_fullsized":"2024-01-22T05:04:39.071709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.084520+0000","last_change":"2024-01-22T05:04:35.057293+0000","last_active":"2024-01-22T05:04:39.084520+0000","last_peered":"2024-01-22T05:04:39.084520+0000","last_clean":"2024-01-22T05:04:39.084520+0000","last_became_active":"2024-01-22T05:04:35.054936+0000","last_became_peered":"2024-01-22T05:04:35.054936+0000","last_unstale":"2024-01-22T05:04:39.084520+0000","last_undegraded":"2024-01-22T05:04:39.084520+0000","last_fullsized":"2024-01-22T05:04:39.084520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.098476+0000","last_change":"2024-01-22T05:04:39.096209+0000","last_active":"2024-01-22T05:04:39.098476+0000","last_peered":"2024-01-22T05:04:39.098476+0000","last_clean":"2024-01-22T05:04:39.098476+0000","last_became_active":"2024-01-22T05:04:39.095774+0000","last_became_peered":"2024-01-22T05:04:39.095774+0000","last_unstale":"2024-01-22T05:04:39.098476+0000","last_undegraded":"2024-01-22T05:04:39.098476+0000","last_fullsized":"2024-01-22T05:04:39.098476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101268+0000","last_change":"2024-01-22T05:04:34.618376+0000","last_active":"2024-01-22T05:04:39.101268+0000","last_peered":"2024-01-22T05:04:39.101268+0000","last_clean":"2024-01-22T05:04:39.101268+0000","last_became_active":"2024-01-22T05:04:34.618050+0000","last_became_peered":"2024-01-22T05:04:34.618050+0000","last_unstale":"2024-01-22T05:04:39.101268+0000","last_undegraded":"2024-01-22T05:04:39.101268+0000","last_fullsized":"2024-01-22T05:04:39.101268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092655+0000","last_change":"2024-01-22T05:04:35.066609+0000","last_active":"2024-01-22T05:04:39.092655+0000","last_peered":"2024-01-22T05:04:39.092655+0000","last_clean":"2024-01-22T05:04:39.092655+0000","last_became_active":"2024-01-22T05:04:35.066264+0000","last_became_peered":"2024-01-22T05:04:35.066264+0000","last_unstale":"2024-01-22T05:04:39.092655+0000","last_undegraded":"2024-01-22T05:04:39.092655+0000","last_fullsized":"2024-01-22T05:04:39.092655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107734+0000","last_change":"2024-01-22T05:04:39.101032+0000","last_active":"2024-01-22T05:04:39.107734+0000","last_peered":"2024-01-22T05:04:39.107734+0000","last_clean":"2024-01-22T05:04:39.107734+0000","last_became_active":"2024-01-22T05:04:39.100632+0000","last_became_peered":"2024-01-22T05:04:39.100632+0000","last_unstale":"2024-01-22T05:04:39.107734+0000","last_undegraded":"2024-01-22T05:04:39.107734+0000","last_fullsized":"2024-01-22T05:04:39.107734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078768+0000","last_change":"2024-01-22T05:04:34.600852+0000","last_active":"2024-01-22T05:04:39.078768+0000","last_peered":"2024-01-22T05:04:39.078768+0000","last_clean":"2024-01-22T05:04:39.078768+0000","last_became_active":"2024-01-22T05:04:34.600549+0000","last_became_peered":"2024-01-22T05:04:34.600549+0000","last_unstale":"2024-01-22T05:04:39.078768+0000","last_undegraded":"2024-01-22T05:04:39.078768+0000","last_fullsized":"2024-01-22T05:04:39.078768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.094690+0000","last_change":"2024-01-22T05:04:35.048337+0000","last_active":"2024-01-22T05:04:39.094690+0000","last_peered":"2024-01-22T05:04:39.094690+0000","last_clean":"2024-01-22T05:04:39.094690+0000","last_became_active":"2024-01-22T05:04:35.048075+0000","last_became_peered":"2024-01-22T05:04:35.048075+0000","last_unstale":"2024-01-22T05:04:39.094690+0000","last_undegraded":"2024-01-22T05:04:39.094690+0000","last_fullsized":"2024-01-22T05:04:39.094690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.100793+0000","last_change":"2024-01-22T05:04:39.099916+0000","last_active":"2024-01-22T05:04:39.100793+0000","last_peered":"2024-01-22T05:04:39.100793+0000","last_clean":"2024-01-22T05:04:39.100793+0000","last_became_active":"2024-01-22T05:04:39.097629+0000","last_became_peered":"2024-01-22T05:04:39.097629+0000","last_unstale":"2024-01-22T05:04:39.100793+0000","last_undegraded":"2024-01-22T05:04:39.100793+0000","last_fullsized":"2024-01-22T05:04:39.100793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091544+0000","last_change":"2024-01-22T05:04:34.605586+0000","last_active":"2024-01-22T05:04:39.091544+0000","last_peered":"2024-01-22T05:04:39.091544+0000","last_clean":"2024-01-22T05:04:39.091544+0000","last_became_active":"2024-01-22T05:04:34.605258+0000","last_became_peered":"2024-01-22T05:04:34.605258+0000","last_unstale":"2024-01-22T05:04:39.091544+0000","last_undegraded":"2024-01-22T05:04:39.091544+0000","last_fullsized":"2024-01-22T05:04:39.091544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078565+0000","last_change":"2024-01-22T05:04:35.063054+0000","last_active":"2024-01-22T05:04:39.078565+0000","last_peered":"2024-01-22T05:04:39.078565+0000","last_clean":"2024-01-22T05:04:39.078565+0000","last_became_active":"2024-01-22T05:04:35.062800+0000","last_became_peered":"2024-01-22T05:04:35.062800+0000","last_unstale":"2024-01-22T05:04:39.078565+0000","last_undegraded":"2024-01-22T05:04:39.078565+0000","last_fullsized":"2024-01-22T05:04:39.078565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.108862+0000","last_change":"2024-01-22T05:04:39.106490+0000","last_active":"2024-01-22T05:04:39.108862+0000","last_peered":"2024-01-22T05:04:39.108862+0000","last_clean":"2024-01-22T05:04:39.108862+0000","last_became_active":"2024-01-22T05:04:39.106108+0000","last_became_peered":"2024-01-22T05:04:39.106108+0000","last_unstale":"2024-01-22T05:04:39.108862+0000","last_undegraded":"2024-01-22T05:04:39.108862+0000","last_fullsized":"2024-01-22T05:04:39.108862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082736+0000","last_change":"2024-01-22T05:04:34.611849+0000","last_active":"2024-01-22T05:04:39.082736+0000","last_peered":"2024-01-22T05:04:39.082736+0000","last_clean":"2024-01-22T05:04:39.082736+0000","last_became_active":"2024-01-22T05:04:34.611571+0000","last_became_peered":"2024-01-22T05:04:34.611571+0000","last_unstale":"2024-01-22T05:04:39.082736+0000","last_undegraded":"2024-01-22T05:04:39.082736+0000","last_fullsized":"2024-01-22T05:04:39.082736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087897+0000","last_change":"2024-01-22T05:04:35.059209+0000","last_active":"2024-01-22T05:04:39.087897+0000","last_peered":"2024-01-22T05:04:39.087897+0000","last_clean":"2024-01-22T05:04:39.087897+0000","last_became_active":"2024-01-22T05:04:35.058481+0000","last_became_peered":"2024-01-22T05:04:35.058481+0000","last_unstale":"2024-01-22T05:04:39.087897+0000","last_undegraded":"2024-01-22T05:04:39.087897+0000","last_fullsized":"2024-01-22T05:04:39.087897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107238+0000","last_change":"2024-01-22T05:04:39.100104+0000","last_active":"2024-01-22T05:04:39.107238+0000","last_peered":"2024-01-22T05:04:39.107238+0000","last_clean":"2024-01-22T05:04:39.107238+0000","last_became_active":"2024-01-22T05:04:39.099678+0000","last_became_peered":"2024-01-22T05:04:39.099678+0000","last_unstale":"2024-01-22T05:04:39.107238+0000","last_undegraded":"2024-01-22T05:04:39.107238+0000","last_fullsized":"2024-01-22T05:04:39.107238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091440+0000","last_change":"2024-01-22T05:04:34.605902+0000","last_active":"2024-01-22T05:04:39.091440+0000","last_peered":"2024-01-22T05:04:39.091440+0000","last_clean":"2024-01-22T05:04:39.091440+0000","last_became_active":"2024-01-22T05:04:34.605565+0000","last_became_peered":"2024-01-22T05:04:34.605565+0000","last_unstale":"2024-01-22T05:04:39.091440+0000","last_undegraded":"2024-01-22T05:04:39.091440+0000","last_fullsized":"2024-01-22T05:04:39.091440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101579+0000","last_change":"2024-01-22T05:04:35.057060+0000","last_active":"2024-01-22T05:04:39.101579+0000","last_peered":"2024-01-22T05:04:39.101579+0000","last_clean":"2024-01-22T05:04:39.101579+0000","last_became_active":"2024-01-22T05:04:35.052366+0000","last_became_peered":"2024-01-22T05:04:35.052366+0000","last_unstale":"2024-01-22T05:04:39.101579+0000","last_undegraded":"2024-01-22T05:04:39.101579+0000","last_fullsized":"2024-01-22T05:04:39.101579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119060+0000","last_change":"2024-01-22T05:04:39.112388+0000","last_active":"2024-01-22T05:04:39.119060+0000","last_peered":"2024-01-22T05:04:39.119060+0000","last_clean":"2024-01-22T05:04:39.119060+0000","last_became_active":"2024-01-22T05:04:39.112008+0000","last_became_peered":"2024-01-22T05:04:39.112008+0000","last_unstale":"2024-01-22T05:04:39.119060+0000","last_undegraded":"2024-01-22T05:04:39.119060+0000","last_fullsized":"2024-01-22T05:04:39.119060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073424+0000","last_change":"2024-01-22T05:04:34.613609+0000","last_active":"2024-01-22T05:04:39.073424+0000","last_peered":"2024-01-22T05:04:39.073424+0000","last_clean":"2024-01-22T05:04:39.073424+0000","last_became_active":"2024-01-22T05:04:34.613113+0000","last_became_peered":"2024-01-22T05:04:34.613113+0000","last_unstale":"2024-01-22T05:04:39.073424+0000","last_undegraded":"2024-01-22T05:04:39.073424+0000","last_fullsized":"2024-01-22T05:04:39.073424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071728+0000","last_change":"2024-01-22T05:04:35.055447+0000","last_active":"2024-01-22T05:04:39.071728+0000","last_peered":"2024-01-22T05:04:39.071728+0000","last_clean":"2024-01-22T05:04:39.071728+0000","last_became_active":"2024-01-22T05:04:35.047320+0000","last_became_peered":"2024-01-22T05:04:35.047320+0000","last_unstale":"2024-01-22T05:04:39.071728+0000","last_undegraded":"2024-01-22T05:04:39.071728+0000","last_fullsized":"2024-01-22T05:04:39.071728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.113249+0000","last_change":"2024-01-22T05:04:39.111233+0000","last_active":"2024-01-22T05:04:39.113249+0000","last_peered":"2024-01-22T05:04:39.113249+0000","last_clean":"2024-01-22T05:04:39.113249+0000","last_became_active":"2024-01-22T05:04:39.108755+0000","last_became_peered":"2024-01-22T05:04:39.108755+0000","last_unstale":"2024-01-22T05:04:39.113249+0000","last_undegraded":"2024-01-22T05:04:39.113249+0000","last_fullsized":"2024-01-22T05:04:39.113249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.094775+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:04:39.094775+0000","last_peered":"2024-01-22T05:04:39.094775+0000","last_clean":"2024-01-22T05:04:39.094775+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:04:39.094775+0000","last_undegraded":"2024-01-22T05:04:39.094775+0000","last_fullsized":"2024-01-22T05:04:39.094775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092517+0000","last_change":"2024-01-22T05:04:34.613912+0000","last_active":"2024-01-22T05:04:39.092517+0000","last_peered":"2024-01-22T05:04:39.092517+0000","last_clean":"2024-01-22T05:04:39.092517+0000","last_became_active":"2024-01-22T05:04:34.612145+0000","last_became_peered":"2024-01-22T05:04:34.612145+0000","last_unstale":"2024-01-22T05:04:39.092517+0000","last_undegraded":"2024-01-22T05:04:39.092517+0000","last_fullsized":"2024-01-22T05:04:39.092517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072061+0000","last_change":"2024-01-22T05:04:35.056830+0000","last_active":"2024-01-22T05:04:39.072061+0000","last_peered":"2024-01-22T05:04:39.072061+0000","last_clean":"2024-01-22T05:04:39.072061+0000","last_became_active":"2024-01-22T05:04:35.054433+0000","last_became_peered":"2024-01-22T05:04:35.054433+0000","last_unstale":"2024-01-22T05:04:39.072061+0000","last_undegraded":"2024-01-22T05:04:39.072061+0000","last_fullsized":"2024-01-22T05:04:39.072061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.109522+0000","last_change":"2024-01-22T05:04:39.104407+0000","last_active":"2024-01-22T05:04:39.109522+0000","last_peered":"2024-01-22T05:04:39.109522+0000","last_clean":"2024-01-22T05:04:39.109522+0000","last_became_active":"2024-01-22T05:04:39.103894+0000","last_became_peered":"2024-01-22T05:04:39.103894+0000","last_unstale":"2024-01-22T05:04:39.109522+0000","last_undegraded":"2024-01-22T05:04:39.109522+0000","last_fullsized":"2024-01-22T05:04:39.109522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.111694+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:04:39.111694+0000","last_peered":"2024-01-22T05:04:39.111694+0000","last_clean":"2024-01-22T05:04:39.111694+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:04:39.111694+0000","last_undegraded":"2024-01-22T05:04:39.111694+0000","last_fullsized":"2024-01-22T05:04:39.111694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.086118+0000","last_change":"2024-01-22T05:04:34.607413+0000","last_active":"2024-01-22T05:04:39.086118+0000","last_peered":"2024-01-22T05:04:39.086118+0000","last_clean":"2024-01-22T05:04:39.086118+0000","last_became_active":"2024-01-22T05:04:34.606865+0000","last_became_peered":"2024-01-22T05:04:34.606865+0000","last_unstale":"2024-01-22T05:04:39.086118+0000","last_undegraded":"2024-01-22T05:04:39.086118+0000","last_fullsized":"2024-01-22T05:04:39.086118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078381+0000","last_change":"2024-01-22T05:04:35.066781+0000","last_active":"2024-01-22T05:04:39.078381+0000","last_peered":"2024-01-22T05:04:39.078381+0000","last_clean":"2024-01-22T05:04:39.078381+0000","last_became_active":"2024-01-22T05:04:35.066462+0000","last_became_peered":"2024-01-22T05:04:35.066462+0000","last_unstale":"2024-01-22T05:04:39.078381+0000","last_undegraded":"2024-01-22T05:04:39.078381+0000","last_fullsized":"2024-01-22T05:04:39.078381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103937+0000","last_change":"2024-01-22T05:04:39.101743+0000","last_active":"2024-01-22T05:04:39.103937+0000","last_peered":"2024-01-22T05:04:39.103937+0000","last_clean":"2024-01-22T05:04:39.103937+0000","last_became_active":"2024-01-22T05:04:39.100970+0000","last_became_peered":"2024-01-22T05:04:39.100970+0000","last_unstale":"2024-01-22T05:04:39.103937+0000","last_undegraded":"2024-01-22T05:04:39.103937+0000","last_fullsized":"2024-01-22T05:04:39.103937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091262+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:04:39.091262+0000","last_peered":"2024-01-22T05:04:39.091262+0000","last_clean":"2024-01-22T05:04:39.091262+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:04:39.091262+0000","last_undegraded":"2024-01-22T05:04:39.091262+0000","last_fullsized":"2024-01-22T05:04:39.091262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104174+0000","last_change":"2024-01-22T05:04:34.606188+0000","last_active":"2024-01-22T05:04:39.104174+0000","last_peered":"2024-01-22T05:04:39.104174+0000","last_clean":"2024-01-22T05:04:39.104174+0000","last_became_active":"2024-01-22T05:04:34.605902+0000","last_became_peered":"2024-01-22T05:04:34.605902+0000","last_unstale":"2024-01-22T05:04:39.104174+0000","last_undegraded":"2024-01-22T05:04:39.104174+0000","last_fullsized":"2024-01-22T05:04:39.104174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091318+0000","last_change":"2024-01-22T05:04:35.048169+0000","last_active":"2024-01-22T05:04:39.091318+0000","last_peered":"2024-01-22T05:04:39.091318+0000","last_clean":"2024-01-22T05:04:39.091318+0000","last_became_active":"2024-01-22T05:04:35.047797+0000","last_became_peered":"2024-01-22T05:04:35.047797+0000","last_unstale":"2024-01-22T05:04:39.091318+0000","last_undegraded":"2024-01-22T05:04:39.091318+0000","last_fullsized":"2024-01-22T05:04:39.091318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103229+0000","last_change":"2024-01-22T05:04:39.095494+0000","last_active":"2024-01-22T05:04:39.103229+0000","last_peered":"2024-01-22T05:04:39.103229+0000","last_clean":"2024-01-22T05:04:39.103229+0000","last_became_active":"2024-01-22T05:04:39.094639+0000","last_became_peered":"2024-01-22T05:04:39.094639+0000","last_unstale":"2024-01-22T05:04:39.103229+0000","last_undegraded":"2024-01-22T05:04:39.103229+0000","last_fullsized":"2024-01-22T05:04:39.103229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104333+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:04:39.104333+0000","last_peered":"2024-01-22T05:04:39.104333+0000","last_clean":"2024-01-22T05:04:39.104333+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:04:39.104333+0000","last_undegraded":"2024-01-22T05:04:39.104333+0000","last_fullsized":"2024-01-22T05:04:39.104333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082413+0000","last_change":"2024-01-22T05:04:34.614897+0000","last_active":"2024-01-22T05:04:39.082413+0000","last_peered":"2024-01-22T05:04:39.082413+0000","last_clean":"2024-01-22T05:04:39.082413+0000","last_became_active":"2024-01-22T05:04:34.611793+0000","last_became_peered":"2024-01-22T05:04:34.611793+0000","last_unstale":"2024-01-22T05:04:39.082413+0000","last_undegraded":"2024-01-22T05:04:39.082413+0000","last_fullsized":"2024-01-22T05:04:39.082413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101671+0000","last_change":"2024-01-22T05:04:35.037716+0000","last_active":"2024-01-22T05:04:39.101671+0000","last_peered":"2024-01-22T05:04:39.101671+0000","last_clean":"2024-01-22T05:04:39.101671+0000","last_became_active":"2024-01-22T05:04:35.037443+0000","last_became_peered":"2024-01-22T05:04:35.037443+0000","last_unstale":"2024-01-22T05:04:39.101671+0000","last_undegraded":"2024-01-22T05:04:39.101671+0000","last_fullsized":"2024-01-22T05:04:39.101671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.114339+0000","last_change":"2024-01-22T05:04:39.110687+0000","last_active":"2024-01-22T05:04:39.114339+0000","last_peered":"2024-01-22T05:04:39.114339+0000","last_clean":"2024-01-22T05:04:39.114339+0000","last_became_active":"2024-01-22T05:04:39.109377+0000","last_became_peered":"2024-01-22T05:04:39.109377+0000","last_unstale":"2024-01-22T05:04:39.114339+0000","last_undegraded":"2024-01-22T05:04:39.114339+0000","last_fullsized":"2024-01-22T05:04:39.114339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071921+0000","last_change":"2024-01-22T05:04:34.599538+0000","last_active":"2024-01-22T05:04:39.071921+0000","last_peered":"2024-01-22T05:04:39.071921+0000","last_clean":"2024-01-22T05:04:39.071921+0000","last_became_active":"2024-01-22T05:04:34.599188+0000","last_became_peered":"2024-01-22T05:04:34.599188+0000","last_unstale":"2024-01-22T05:04:39.071921+0000","last_undegraded":"2024-01-22T05:04:39.071921+0000","last_fullsized":"2024-01-22T05:04:39.071921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077580+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:04:39.077580+0000","last_peered":"2024-01-22T05:04:39.077580+0000","last_clean":"2024-01-22T05:04:39.077580+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:04:39.077580+0000","last_undegraded":"2024-01-22T05:04:39.077580+0000","last_fullsized":"2024-01-22T05:04:39.077580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104088+0000","last_change":"2024-01-22T05:04:35.038500+0000","last_active":"2024-01-22T05:04:39.104088+0000","last_peered":"2024-01-22T05:04:39.104088+0000","last_clean":"2024-01-22T05:04:39.104088+0000","last_became_active":"2024-01-22T05:04:35.038140+0000","last_became_peered":"2024-01-22T05:04:35.038140+0000","last_unstale":"2024-01-22T05:04:39.104088+0000","last_undegraded":"2024-01-22T05:04:39.104088+0000","last_fullsized":"2024-01-22T05:04:39.104088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119739+0000","last_change":"2024-01-22T05:04:39.116907+0000","last_active":"2024-01-22T05:04:39.119739+0000","last_peered":"2024-01-22T05:04:39.119739+0000","last_clean":"2024-01-22T05:04:39.119739+0000","last_became_active":"2024-01-22T05:04:39.116486+0000","last_became_peered":"2024-01-22T05:04:39.116486+0000","last_unstale":"2024-01-22T05:04:39.119739+0000","last_undegraded":"2024-01-22T05:04:39.119739+0000","last_fullsized":"2024-01-22T05:04:39.119739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101316+0000","last_change":"2024-01-22T05:04:34.615907+0000","last_active":"2024-01-22T05:04:39.101316+0000","last_peered":"2024-01-22T05:04:39.101316+0000","last_clean":"2024-01-22T05:04:39.101316+0000","last_became_active":"2024-01-22T05:04:34.615598+0000","last_became_peered":"2024-01-22T05:04:34.615598+0000","last_unstale":"2024-01-22T05:04:39.101316+0000","last_undegraded":"2024-01-22T05:04:39.101316+0000","last_fullsized":"2024-01-22T05:04:39.101316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.069623+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:04:39.069623+0000","last_peered":"2024-01-22T05:04:39.069623+0000","last_clean":"2024-01-22T05:04:39.069623+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:04:39.069623+0000","last_undegraded":"2024-01-22T05:04:39.069623+0000","last_fullsized":"2024-01-22T05:04:39.069623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.115610+0000","last_change":"2024-01-22T05:04:35.038846+0000","last_active":"2024-01-22T05:04:39.115610+0000","last_peered":"2024-01-22T05:04:39.115610+0000","last_clean":"2024-01-22T05:04:39.115610+0000","last_became_active":"2024-01-22T05:04:35.038166+0000","last_became_peered":"2024-01-22T05:04:35.038166+0000","last_unstale":"2024-01-22T05:04:39.115610+0000","last_undegraded":"2024-01-22T05:04:39.115610+0000","last_fullsized":"2024-01-22T05:04:39.115610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.117398+0000","last_change":"2024-01-22T05:04:39.115986+0000","last_active":"2024-01-22T05:04:39.117398+0000","last_peered":"2024-01-22T05:04:39.117398+0000","last_clean":"2024-01-22T05:04:39.117398+0000","last_became_active":"2024-01-22T05:04:39.115151+0000","last_became_peered":"2024-01-22T05:04:39.115151+0000","last_unstale":"2024-01-22T05:04:39.117398+0000","last_undegraded":"2024-01-22T05:04:39.117398+0000","last_fullsized":"2024-01-22T05:04:39.117398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087798+0000","last_change":"2024-01-22T05:04:34.609174+0000","last_active":"2024-01-22T05:04:39.087798+0000","last_peered":"2024-01-22T05:04:39.087798+0000","last_clean":"2024-01-22T05:04:39.087798+0000","last_became_active":"2024-01-22T05:04:34.608868+0000","last_became_peered":"2024-01-22T05:04:34.608868+0000","last_unstale":"2024-01-22T05:04:39.087798+0000","last_undegraded":"2024-01-22T05:04:39.087798+0000","last_fullsized":"2024-01-22T05:04:39.087798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087902+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:04:39.087902+0000","last_peered":"2024-01-22T05:04:39.087902+0000","last_clean":"2024-01-22T05:04:39.087902+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:04:39.087902+0000","last_undegraded":"2024-01-22T05:04:39.087902+0000","last_fullsized":"2024-01-22T05:04:39.087902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092366+0000","last_change":"2024-01-22T05:04:35.049694+0000","last_active":"2024-01-22T05:04:39.092366+0000","last_peered":"2024-01-22T05:04:39.092366+0000","last_clean":"2024-01-22T05:04:39.092366+0000","last_became_active":"2024-01-22T05:04:35.048722+0000","last_became_peered":"2024-01-22T05:04:35.048722+0000","last_unstale":"2024-01-22T05:04:39.092366+0000","last_undegraded":"2024-01-22T05:04:39.092366+0000","last_fullsized":"2024-01-22T05:04:39.092366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.106875+0000","last_change":"2024-01-22T05:04:39.103272+0000","last_active":"2024-01-22T05:04:39.106875+0000","last_peered":"2024-01-22T05:04:39.106875+0000","last_clean":"2024-01-22T05:04:39.106875+0000","last_became_active":"2024-01-22T05:04:39.102710+0000","last_became_peered":"2024-01-22T05:04:39.102710+0000","last_unstale":"2024-01-22T05:04:39.106875+0000","last_undegraded":"2024-01-22T05:04:39.106875+0000","last_fullsized":"2024-01-22T05:04:39.106875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082591+0000","last_change":"2024-01-22T05:04:34.621934+0000","last_active":"2024-01-22T05:04:39.082591+0000","last_peered":"2024-01-22T05:04:39.082591+0000","last_clean":"2024-01-22T05:04:39.082591+0000","last_became_active":"2024-01-22T05:04:34.621531+0000","last_became_peered":"2024-01-22T05:04:34.621531+0000","last_unstale":"2024-01-22T05:04:39.082591+0000","last_undegraded":"2024-01-22T05:04:39.082591+0000","last_fullsized":"2024-01-22T05:04:39.082591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.080271+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:04:39.080271+0000","last_peered":"2024-01-22T05:04:39.080271+0000","last_clean":"2024-01-22T05:04:39.080271+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:04:39.080271+0000","last_undegraded":"2024-01-22T05:04:39.080271+0000","last_fullsized":"2024-01-22T05:04:39.080271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087998+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:04:39.087998+0000","last_peered":"2024-01-22T05:04:39.087998+0000","last_clean":"2024-01-22T05:04:39.087998+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:04:39.087998+0000","last_undegraded":"2024-01-22T05:04:39.087998+0000","last_fullsized":"2024-01-22T05:04:39.087998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092360+0000","last_change":"2024-01-22T05:04:35.062222+0000","last_active":"2024-01-22T05:04:39.092360+0000","last_peered":"2024-01-22T05:04:39.092360+0000","last_clean":"2024-01-22T05:04:39.092360+0000","last_became_active":"2024-01-22T05:04:35.061909+0000","last_became_peered":"2024-01-22T05:04:35.061909+0000","last_unstale":"2024-01-22T05:04:39.092360+0000","last_undegraded":"2024-01-22T05:04:39.092360+0000","last_fullsized":"2024-01-22T05:04:39.092360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103574+0000","last_change":"2024-01-22T05:04:39.097762+0000","last_active":"2024-01-22T05:04:39.103574+0000","last_peered":"2024-01-22T05:04:39.103574+0000","last_clean":"2024-01-22T05:04:39.103574+0000","last_became_active":"2024-01-22T05:04:39.097387+0000","last_became_peered":"2024-01-22T05:04:39.097387+0000","last_unstale":"2024-01-22T05:04:39.103574+0000","last_undegraded":"2024-01-22T05:04:39.103574+0000","last_fullsized":"2024-01-22T05:04:39.103574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078865+0000","last_change":"2024-01-22T05:04:34.618785+0000","last_active":"2024-01-22T05:04:39.078865+0000","last_peered":"2024-01-22T05:04:39.078865+0000","last_clean":"2024-01-22T05:04:39.078865+0000","last_became_active":"2024-01-22T05:04:34.618434+0000","last_became_peered":"2024-01-22T05:04:34.618434+0000","last_unstale":"2024-01-22T05:04:39.078865+0000","last_undegraded":"2024-01-22T05:04:39.078865+0000","last_fullsized":"2024-01-22T05:04:39.078865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.115520+0000","last_change":"2024-01-22T05:04:35.053526+0000","last_active":"2024-01-22T05:04:39.115520+0000","last_peered":"2024-01-22T05:04:39.115520+0000","last_clean":"2024-01-22T05:04:39.115520+0000","last_became_active":"2024-01-22T05:04:35.053256+0000","last_became_peered":"2024-01-22T05:04:35.053256+0000","last_unstale":"2024-01-22T05:04:39.115520+0000","last_undegraded":"2024-01-22T05:04:39.115520+0000","last_fullsized":"2024-01-22T05:04:39.115520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087821+0000","last_change":"2024-01-22T05:04:39.085964+0000","last_active":"2024-01-22T05:04:39.087821+0000","last_peered":"2024-01-22T05:04:39.087821+0000","last_clean":"2024-01-22T05:04:39.087821+0000","last_became_active":"2024-01-22T05:04:39.085535+0000","last_became_peered":"2024-01-22T05:04:39.085535+0000","last_unstale":"2024-01-22T05:04:39.087821+0000","last_undegraded":"2024-01-22T05:04:39.087821+0000","last_fullsized":"2024-01-22T05:04:39.087821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072213+0000","last_change":"2024-01-22T05:04:34.606362+0000","last_active":"2024-01-22T05:04:39.072213+0000","last_peered":"2024-01-22T05:04:39.072213+0000","last_clean":"2024-01-22T05:04:39.072213+0000","last_became_active":"2024-01-22T05:04:34.606055+0000","last_became_peered":"2024-01-22T05:04:34.606055+0000","last_unstale":"2024-01-22T05:04:39.072213+0000","last_undegraded":"2024-01-22T05:04:39.072213+0000","last_fullsized":"2024-01-22T05:04:39.072213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073421+0000","last_change":"2024-01-22T05:04:35.058051+0000","last_active":"2024-01-22T05:04:39.073421+0000","last_peered":"2024-01-22T05:04:39.073421+0000","last_clean":"2024-01-22T05:04:39.073421+0000","last_became_active":"2024-01-22T05:04:35.057790+0000","last_became_peered":"2024-01-22T05:04:35.057790+0000","last_unstale":"2024-01-22T05:04:39.073421+0000","last_undegraded":"2024-01-22T05:04:39.073421+0000","last_fullsized":"2024-01-22T05:04:39.073421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.116871+0000","last_change":"2024-01-22T05:04:39.106800+0000","last_active":"2024-01-22T05:04:39.116871+0000","last_peered":"2024-01-22T05:04:39.116871+0000","last_clean":"2024-01-22T05:04:39.116871+0000","last_became_active":"2024-01-22T05:04:39.106323+0000","last_became_peered":"2024-01-22T05:04:39.106323+0000","last_unstale":"2024-01-22T05:04:39.116871+0000","last_undegraded":"2024-01-22T05:04:39.116871+0000","last_fullsized":"2024-01-22T05:04:39.116871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091150+0000","last_change":"2024-01-22T05:04:34.612849+0000","last_active":"2024-01-22T05:04:39.091150+0000","last_peered":"2024-01-22T05:04:39.091150+0000","last_clean":"2024-01-22T05:04:39.091150+0000","last_became_active":"2024-01-22T05:04:34.612516+0000","last_became_peered":"2024-01-22T05:04:34.612516+0000","last_unstale":"2024-01-22T05:04:39.091150+0000","last_undegraded":"2024-01-22T05:04:39.091150+0000","last_fullsized":"2024-01-22T05:04:39.091150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073015+0000","last_change":"2024-01-22T05:04:35.052723+0000","last_active":"2024-01-22T05:04:39.073015+0000","last_peered":"2024-01-22T05:04:39.073015+0000","last_clean":"2024-01-22T05:04:39.073015+0000","last_became_active":"2024-01-22T05:04:35.051494+0000","last_became_peered":"2024-01-22T05:04:35.051494+0000","last_unstale":"2024-01-22T05:04:39.073015+0000","last_undegraded":"2024-01-22T05:04:39.073015+0000","last_fullsized":"2024-01-22T05:04:39.073015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104928+0000","last_change":"2024-01-22T05:04:39.101428+0000","last_active":"2024-01-22T05:04:39.104928+0000","last_peered":"2024-01-22T05:04:39.104928+0000","last_clean":"2024-01-22T05:04:39.104928+0000","last_became_active":"2024-01-22T05:04:39.100920+0000","last_became_peered":"2024-01-22T05:04:39.100920+0000","last_unstale":"2024-01-22T05:04:39.104928+0000","last_undegraded":"2024-01-22T05:04:39.104928+0000","last_fullsized":"2024-01-22T05:04:39.104928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.083763+0000","last_change":"2024-01-22T05:04:34.602186+0000","last_active":"2024-01-22T05:04:39.083763+0000","last_peered":"2024-01-22T05:04:39.083763+0000","last_clean":"2024-01-22T05:04:39.083763+0000","last_became_active":"2024-01-22T05:04:34.601827+0000","last_became_peered":"2024-01-22T05:04:34.601827+0000","last_unstale":"2024-01-22T05:04:39.083763+0000","last_undegraded":"2024-01-22T05:04:39.083763+0000","last_fullsized":"2024-01-22T05:04:39.083763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073177+0000","last_change":"2024-01-22T05:04:35.054388+0000","last_active":"2024-01-22T05:04:39.073177+0000","last_peered":"2024-01-22T05:04:39.073177+0000","last_clean":"2024-01-22T05:04:39.073177+0000","last_became_active":"2024-01-22T05:04:35.054183+0000","last_became_peered":"2024-01-22T05:04:35.054183+0000","last_unstale":"2024-01-22T05:04:39.073177+0000","last_undegraded":"2024-01-22T05:04:39.073177+0000","last_fullsized":"2024-01-22T05:04:39.073177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107631+0000","last_change":"2024-01-22T05:04:39.102774+0000","last_active":"2024-01-22T05:04:39.107631+0000","last_peered":"2024-01-22T05:04:39.107631+0000","last_clean":"2024-01-22T05:04:39.107631+0000","last_became_active":"2024-01-22T05:04:39.102291+0000","last_became_peered":"2024-01-22T05:04:39.102291+0000","last_unstale":"2024-01-22T05:04:39.107631+0000","last_undegraded":"2024-01-22T05:04:39.107631+0000","last_fullsized":"2024-01-22T05:04:39.107631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.080482+0000","last_change":"2024-01-22T05:04:34.608068+0000","last_active":"2024-01-22T05:04:39.080482+0000","last_peered":"2024-01-22T05:04:39.080482+0000","last_clean":"2024-01-22T05:04:39.080482+0000","last_became_active":"2024-01-22T05:04:34.607482+0000","last_became_peered":"2024-01-22T05:04:34.607482+0000","last_unstale":"2024-01-22T05:04:39.080482+0000","last_undegraded":"2024-01-22T05:04:39.080482+0000","last_fullsized":"2024-01-22T05:04:39.080482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091190+0000","last_change":"2024-01-22T05:04:35.045213+0000","last_active":"2024-01-22T05:04:39.091190+0000","last_peered":"2024-01-22T05:04:39.091190+0000","last_clean":"2024-01-22T05:04:39.091190+0000","last_became_active":"2024-01-22T05:04:35.044882+0000","last_became_peered":"2024-01-22T05:04:35.044882+0000","last_unstale":"2024-01-22T05:04:39.091190+0000","last_undegraded":"2024-01-22T05:04:39.091190+0000","last_fullsized":"2024-01-22T05:04:39.091190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107871+0000","last_change":"2024-01-22T05:04:39.103229+0000","last_active":"2024-01-22T05:04:39.107871+0000","last_peered":"2024-01-22T05:04:39.107871+0000","last_clean":"2024-01-22T05:04:39.107871+0000","last_became_active":"2024-01-22T05:04:39.102798+0000","last_became_peered":"2024-01-22T05:04:39.102798+0000","last_unstale":"2024-01-22T05:04:39.107871+0000","last_undegraded":"2024-01-22T05:04:39.107871+0000","last_fullsized":"2024-01-22T05:04:39.107871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091000+0000","last_change":"2024-01-22T05:04:34.612506+0000","last_active":"2024-01-22T05:04:39.091000+0000","last_peered":"2024-01-22T05:04:39.091000+0000","last_clean":"2024-01-22T05:04:39.091000+0000","last_became_active":"2024-01-22T05:04:34.612255+0000","last_became_peered":"2024-01-22T05:04:34.612255+0000","last_unstale":"2024-01-22T05:04:39.091000+0000","last_undegraded":"2024-01-22T05:04:39.091000+0000","last_fullsized":"2024-01-22T05:04:39.091000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090985+0000","last_change":"2024-01-22T05:04:35.048108+0000","last_active":"2024-01-22T05:04:39.090985+0000","last_peered":"2024-01-22T05:04:39.090985+0000","last_clean":"2024-01-22T05:04:39.090985+0000","last_became_active":"2024-01-22T05:04:35.047784+0000","last_became_peered":"2024-01-22T05:04:35.047784+0000","last_unstale":"2024-01-22T05:04:39.090985+0000","last_undegraded":"2024-01-22T05:04:39.090985+0000","last_fullsized":"2024-01-22T05:04:39.090985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119163+0000","last_change":"2024-01-22T05:04:39.114068+0000","last_active":"2024-01-22T05:04:39.119163+0000","last_peered":"2024-01-22T05:04:39.119163+0000","last_clean":"2024-01-22T05:04:39.119163+0000","last_became_active":"2024-01-22T05:04:39.113694+0000","last_became_peered":"2024-01-22T05:04:39.113694+0000","last_unstale":"2024-01-22T05:04:39.119163+0000","last_undegraded":"2024-01-22T05:04:39.119163+0000","last_fullsized":"2024-01-22T05:04:39.119163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092578+0000","last_change":"2024-01-22T05:04:34.608169+0000","last_active":"2024-01-22T05:04:39.092578+0000","last_peered":"2024-01-22T05:04:39.092578+0000","last_clean":"2024-01-22T05:04:39.092578+0000","last_became_active":"2024-01-22T05:04:34.607884+0000","last_became_peered":"2024-01-22T05:04:34.607884+0000","last_unstale":"2024-01-22T05:04:39.092578+0000","last_undegraded":"2024-01-22T05:04:39.092578+0000","last_fullsized":"2024-01-22T05:04:39.092578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071885+0000","last_change":"2024-01-22T05:04:35.046615+0000","last_active":"2024-01-22T05:04:39.071885+0000","last_peered":"2024-01-22T05:04:39.071885+0000","last_clean":"2024-01-22T05:04:39.071885+0000","last_became_active":"2024-01-22T05:04:35.044177+0000","last_became_peered":"2024-01-22T05:04:35.044177+0000","last_unstale":"2024-01-22T05:04:39.071885+0000","last_undegraded":"2024-01-22T05:04:39.071885+0000","last_fullsized":"2024-01-22T05:04:39.071885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.108538+0000","last_change":"2024-01-22T05:04:39.106119+0000","last_active":"2024-01-22T05:04:39.108538+0000","last_peered":"2024-01-22T05:04:39.108538+0000","last_clean":"2024-01-22T05:04:39.108538+0000","last_became_active":"2024-01-22T05:04:39.105691+0000","last_became_peered":"2024-01-22T05:04:39.105691+0000","last_unstale":"2024-01-22T05:04:39.108538+0000","last_undegraded":"2024-01-22T05:04:39.108538+0000","last_fullsized":"2024-01-22T05:04:39.108538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092748+0000","last_change":"2024-01-22T05:04:34.609294+0000","last_active":"2024-01-22T05:04:39.092748+0000","last_peered":"2024-01-22T05:04:39.092748+0000","last_clean":"2024-01-22T05:04:39.092748+0000","last_became_active":"2024-01-22T05:04:34.609001+0000","last_became_peered":"2024-01-22T05:04:34.609001+0000","last_unstale":"2024-01-22T05:04:39.092748+0000","last_undegraded":"2024-01-22T05:04:39.092748+0000","last_fullsized":"2024-01-22T05:04:39.092748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079342+0000","last_change":"2024-01-22T05:04:35.063766+0000","last_active":"2024-01-22T05:04:39.079342+0000","last_peered":"2024-01-22T05:04:39.079342+0000","last_clean":"2024-01-22T05:04:39.079342+0000","last_became_active":"2024-01-22T05:04:35.063477+0000","last_became_peered":"2024-01-22T05:04:35.063477+0000","last_unstale":"2024-01-22T05:04:39.079342+0000","last_undegraded":"2024-01-22T05:04:39.079342+0000","last_fullsized":"2024-01-22T05:04:39.079342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.113628+0000","last_change":"2024-01-22T05:04:39.112131+0000","last_active":"2024-01-22T05:04:39.113628+0000","last_peered":"2024-01-22T05:04:39.113628+0000","last_clean":"2024-01-22T05:04:39.113628+0000","last_became_active":"2024-01-22T05:04:39.111715+0000","last_became_peered":"2024-01-22T05:04:39.111715+0000","last_unstale":"2024-01-22T05:04:39.113628+0000","last_undegraded":"2024-01-22T05:04:39.113628+0000","last_fullsized":"2024-01-22T05:04:39.113628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.089065+0000","last_change":"2024-01-22T05:04:34.619934+0000","last_active":"2024-01-22T05:04:39.089065+0000","last_peered":"2024-01-22T05:04:39.089065+0000","last_clean":"2024-01-22T05:04:39.089065+0000","last_became_active":"2024-01-22T05:04:34.617261+0000","last_became_peered":"2024-01-22T05:04:34.617261+0000","last_unstale":"2024-01-22T05:04:39.089065+0000","last_undegraded":"2024-01-22T05:04:39.089065+0000","last_fullsized":"2024-01-22T05:04:39.089065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.085702+0000","last_change":"2024-01-22T05:04:35.073485+0000","last_active":"2024-01-22T05:04:39.085702+0000","last_peered":"2024-01-22T05:04:39.085702+0000","last_clean":"2024-01-22T05:04:39.085702+0000","last_became_active":"2024-01-22T05:04:35.073124+0000","last_became_peered":"2024-01-22T05:04:35.073124+0000","last_unstale":"2024-01-22T05:04:39.085702+0000","last_undegraded":"2024-01-22T05:04:39.085702+0000","last_fullsized":"2024-01-22T05:04:39.085702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119896+0000","last_change":"2024-01-22T05:04:39.118034+0000","last_active":"2024-01-22T05:04:39.119896+0000","last_peered":"2024-01-22T05:04:39.119896+0000","last_clean":"2024-01-22T05:04:39.119896+0000","last_became_active":"2024-01-22T05:04:39.117544+0000","last_became_peered":"2024-01-22T05:04:39.117544+0000","last_unstale":"2024-01-22T05:04:39.119896+0000","last_undegraded":"2024-01-22T05:04:39.119896+0000","last_fullsized":"2024-01-22T05:04:39.119896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090880+0000","last_change":"2024-01-22T05:04:34.607793+0000","last_active":"2024-01-22T05:04:39.090880+0000","last_peered":"2024-01-22T05:04:39.090880+0000","last_clean":"2024-01-22T05:04:39.090880+0000","last_became_active":"2024-01-22T05:04:34.607475+0000","last_became_peered":"2024-01-22T05:04:34.607475+0000","last_unstale":"2024-01-22T05:04:39.090880+0000","last_undegraded":"2024-01-22T05:04:39.090880+0000","last_fullsized":"2024-01-22T05:04:39.090880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092444+0000","last_change":"2024-01-22T05:04:35.059510+0000","last_active":"2024-01-22T05:04:39.092444+0000","last_peered":"2024-01-22T05:04:39.092444+0000","last_clean":"2024-01-22T05:04:39.092444+0000","last_became_active":"2024-01-22T05:04:35.059143+0000","last_became_peered":"2024-01-22T05:04:35.059143+0000","last_unstale":"2024-01-22T05:04:39.092444+0000","last_undegraded":"2024-01-22T05:04:39.092444+0000","last_fullsized":"2024-01-22T05:04:39.092444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.099973+0000","last_change":"2024-01-22T05:04:39.097504+0000","last_active":"2024-01-22T05:04:39.099973+0000","last_peered":"2024-01-22T05:04:39.099973+0000","last_clean":"2024-01-22T05:04:39.099973+0000","last_became_active":"2024-01-22T05:04:39.097014+0000","last_became_peered":"2024-01-22T05:04:39.097014+0000","last_unstale":"2024-01-22T05:04:39.099973+0000","last_undegraded":"2024-01-22T05:04:39.099973+0000","last_fullsized":"2024-01-22T05:04:39.099973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077581+0000","last_change":"2024-01-22T05:04:34.611364+0000","last_active":"2024-01-22T05:04:39.077581+0000","last_peered":"2024-01-22T05:04:39.077581+0000","last_clean":"2024-01-22T05:04:39.077581+0000","last_became_active":"2024-01-22T05:04:34.610334+0000","last_became_peered":"2024-01-22T05:04:34.610334+0000","last_unstale":"2024-01-22T05:04:39.077581+0000","last_undegraded":"2024-01-22T05:04:39.077581+0000","last_fullsized":"2024-01-22T05:04:39.077581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082200+0000","last_change":"2024-01-22T05:04:35.069773+0000","last_active":"2024-01-22T05:04:39.082200+0000","last_peered":"2024-01-22T05:04:39.082200+0000","last_clean":"2024-01-22T05:04:39.082200+0000","last_became_active":"2024-01-22T05:04:35.069468+0000","last_became_peered":"2024-01-22T05:04:35.069468+0000","last_unstale":"2024-01-22T05:04:39.082200+0000","last_undegraded":"2024-01-22T05:04:39.082200+0000","last_fullsized":"2024-01-22T05:04:39.082200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.110957+0000","last_change":"2024-01-22T05:04:39.110074+0000","last_active":"2024-01-22T05:04:39.110957+0000","last_peered":"2024-01-22T05:04:39.110957+0000","last_clean":"2024-01-22T05:04:39.110957+0000","last_became_active":"2024-01-22T05:04:39.109579+0000","last_became_peered":"2024-01-22T05:04:39.109579+0000","last_unstale":"2024-01-22T05:04:39.110957+0000","last_undegraded":"2024-01-22T05:04:39.110957+0000","last_fullsized":"2024-01-22T05:04:39.110957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090495+0000","last_change":"2024-01-22T05:04:34.608932+0000","last_active":"2024-01-22T05:04:39.090495+0000","last_peered":"2024-01-22T05:04:39.090495+0000","last_clean":"2024-01-22T05:04:39.090495+0000","last_became_active":"2024-01-22T05:04:34.608567+0000","last_became_peered":"2024-01-22T05:04:34.608567+0000","last_unstale":"2024-01-22T05:04:39.090495+0000","last_undegraded":"2024-01-22T05:04:39.090495+0000","last_fullsized":"2024-01-22T05:04:39.090495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087479+0000","last_change":"2024-01-22T05:04:35.054670+0000","last_active":"2024-01-22T05:04:39.087479+0000","last_peered":"2024-01-22T05:04:39.087479+0000","last_clean":"2024-01-22T05:04:39.087479+0000","last_became_active":"2024-01-22T05:04:35.054302+0000","last_became_peered":"2024-01-22T05:04:35.054302+0000","last_unstale":"2024-01-22T05:04:39.087479+0000","last_undegraded":"2024-01-22T05:04:39.087479+0000","last_fullsized":"2024-01-22T05:04:39.087479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077441+0000","last_change":"2024-01-22T05:04:34.621810+0000","last_active":"2024-01-22T05:04:39.077441+0000","last_peered":"2024-01-22T05:04:39.077441+0000","last_clean":"2024-01-22T05:04:39.077441+0000","last_became_active":"2024-01-22T05:04:34.620591+0000","last_became_peered":"2024-01-22T05:04:34.620591+0000","last_unstale":"2024-01-22T05:04:39.077441+0000","last_undegraded":"2024-01-22T05:04:39.077441+0000","last_fullsized":"2024-01-22T05:04:39.077441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072938+0000","last_change":"2024-01-22T05:04:35.053530+0000","last_active":"2024-01-22T05:04:39.072938+0000","last_peered":"2024-01-22T05:04:39.072938+0000","last_clean":"2024-01-22T05:04:39.072938+0000","last_became_active":"2024-01-22T05:04:35.053256+0000","last_became_peered":"2024-01-22T05:04:35.053256+0000","last_unstale":"2024-01-22T05:04:39.072938+0000","last_undegraded":"2024-01-22T05:04:39.072938+0000","last_fullsized":"2024-01-22T05:04:39.072938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082902+0000","last_change":"2024-01-22T05:04:34.623001+0000","last_active":"2024-01-22T05:04:39.082902+0000","last_peered":"2024-01-22T05:04:39.082902+0000","last_clean":"2024-01-22T05:04:39.082902+0000","last_became_active":"2024-01-22T05:04:34.622591+0000","last_became_peered":"2024-01-22T05:04:34.622591+0000","last_unstale":"2024-01-22T05:04:39.082902+0000","last_undegraded":"2024-01-22T05:04:39.082902+0000","last_fullsized":"2024-01-22T05:04:39.082902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070523+0000","last_change":"2024-01-22T05:04:35.063913+0000","last_active":"2024-01-22T05:04:39.070523+0000","last_peered":"2024-01-22T05:04:39.070523+0000","last_clean":"2024-01-22T05:04:39.070523+0000","last_became_active":"2024-01-22T05:04:35.063630+0000","last_became_peered":"2024-01-22T05:04:35.063630+0000","last_unstale":"2024-01-22T05:04:39.070523+0000","last_undegraded":"2024-01-22T05:04:39.070523+0000","last_fullsized":"2024-01-22T05:04:39.070523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"25'7","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-22T05:04:46.053222+0000","last_change":"2024-01-22T05:04:34.620106+0000","last_active":"2024-01-22T05:04:46.053222+0000","last_peered":"2024-01-22T05:04:46.053222+0000","last_clean":"2024-01-22T05:04:46.053222+0000","last_became_active":"2024-01-22T05:04:34.619792+0000","last_became_peered":"2024-01-22T05:04:34.619792+0000","last_unstale":"2024-01-22T05:04:46.053222+0000","last_undegraded":"2024-01-22T05:04:46.053222+0000","last_fullsized":"2024-01-22T05:04:46.053222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3071,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070845+0000","last_change":"2024-01-22T05:04:35.057279+0000","last_active":"2024-01-22T05:04:39.070845+0000","last_peered":"2024-01-22T05:04:39.070845+0000","last_clean":"2024-01-22T05:04:39.070845+0000","last_became_active":"2024-01-22T05:04:35.056980+0000","last_became_peered":"2024-01-22T05:04:35.056980+0000","last_unstale":"2024-01-22T05:04:39.070845+0000","last_undegraded":"2024-01-22T05:04:39.070845+0000","last_fullsized":"2024-01-22T05:04:39.070845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092494+0000","last_change":"2024-01-22T05:04:34.611971+0000","last_active":"2024-01-22T05:04:39.092494+0000","last_peered":"2024-01-22T05:04:39.092494+0000","last_clean":"2024-01-22T05:04:39.092494+0000","last_became_active":"2024-01-22T05:04:34.605153+0000","last_became_peered":"2024-01-22T05:04:34.605153+0000","last_unstale":"2024-01-22T05:04:39.092494+0000","last_undegraded":"2024-01-22T05:04:39.092494+0000","last_fullsized":"2024-01-22T05:04:39.092494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077326+0000","last_change":"2024-01-22T05:04:35.037542+0000","last_active":"2024-01-22T05:04:39.077326+0000","last_peered":"2024-01-22T05:04:39.077326+0000","last_clean":"2024-01-22T05:04:39.077326+0000","last_became_active":"2024-01-22T05:04:35.037178+0000","last_became_peered":"2024-01-22T05:04:35.037178+0000","last_unstale":"2024-01-22T05:04:39.077326+0000","last_undegraded":"2024-01-22T05:04:39.077326+0000","last_fullsized":"2024-01-22T05:04:39.077326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091860+0000","last_change":"2024-01-22T05:04:34.615870+0000","last_active":"2024-01-22T05:04:39.091860+0000","last_peered":"2024-01-22T05:04:39.091860+0000","last_clean":"2024-01-22T05:04:39.091860+0000","last_became_active":"2024-01-22T05:04:34.615601+0000","last_became_peered":"2024-01-22T05:04:34.615601+0000","last_unstale":"2024-01-22T05:04:39.091860+0000","last_undegraded":"2024-01-22T05:04:39.091860+0000","last_fullsized":"2024-01-22T05:04:39.091860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090691+0000","last_change":"2024-01-22T05:04:35.070694+0000","last_active":"2024-01-22T05:04:39.090691+0000","last_peered":"2024-01-22T05:04:39.090691+0000","last_clean":"2024-01-22T05:04:39.090691+0000","last_became_active":"2024-01-22T05:04:35.070448+0000","last_became_peered":"2024-01-22T05:04:35.070448+0000","last_unstale":"2024-01-22T05:04:39.090691+0000","last_undegraded":"2024-01-22T05:04:39.090691+0000","last_fullsized":"2024-01-22T05:04:39.090691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092663+0000","last_change":"2024-01-22T05:04:34.616419+0000","last_active":"2024-01-22T05:04:39.092663+0000","last_peered":"2024-01-22T05:04:39.092663+0000","last_clean":"2024-01-22T05:04:39.092663+0000","last_became_active":"2024-01-22T05:04:34.616108+0000","last_became_peered":"2024-01-22T05:04:34.616108+0000","last_unstale":"2024-01-22T05:04:39.092663+0000","last_undegraded":"2024-01-22T05:04:39.092663+0000","last_fullsized":"2024-01-22T05:04:39.092663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071575+0000","last_change":"2024-01-22T05:04:35.058871+0000","last_active":"2024-01-22T05:04:39.071575+0000","last_peered":"2024-01-22T05:04:39.071575+0000","last_clean":"2024-01-22T05:04:39.071575+0000","last_became_active":"2024-01-22T05:04:35.058576+0000","last_became_peered":"2024-01-22T05:04:35.058576+0000","last_unstale":"2024-01-22T05:04:39.071575+0000","last_undegraded":"2024-01-22T05:04:39.071575+0000","last_fullsized":"2024-01-22T05:04:39.071575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070542+0000","last_change":"2024-01-22T05:04:35.057257+0000","last_active":"2024-01-22T05:04:39.070542+0000","last_peered":"2024-01-22T05:04:39.070542+0000","last_clean":"2024-01-22T05:04:39.070542+0000","last_became_active":"2024-01-22T05:04:35.056962+0000","last_became_peered":"2024-01-22T05:04:35.056962+0000","last_unstale":"2024-01-22T05:04:39.070542+0000","last_undegraded":"2024-01-22T05:04:39.070542+0000","last_fullsized":"2024-01-22T05:04:39.070542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078666+0000","last_change":"2024-01-22T05:04:34.604249+0000","last_active":"2024-01-22T05:04:39.078666+0000","last_peered":"2024-01-22T05:04:39.078666+0000","last_clean":"2024-01-22T05:04:39.078666+0000","last_became_active":"2024-01-22T05:04:34.603896+0000","last_became_peered":"2024-01-22T05:04:34.603896+0000","last_unstale":"2024-01-22T05:04:39.078666+0000","last_undegraded":"2024-01-22T05:04:39.078666+0000","last_fullsized":"2024-01-22T05:04:39.078666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082626+0000","last_change":"2024-01-22T05:04:35.045030+0000","last_active":"2024-01-22T05:04:39.082626+0000","last_peered":"2024-01-22T05:04:39.082626+0000","last_clean":"2024-01-22T05:04:39.082626+0000","last_became_active":"2024-01-22T05:04:35.043890+0000","last_became_peered":"2024-01-22T05:04:35.043890+0000","last_unstale":"2024-01-22T05:04:39.082626+0000","last_undegraded":"2024-01-22T05:04:39.082626+0000","last_fullsized":"2024-01-22T05:04:39.082626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090782+0000","last_change":"2024-01-22T05:04:34.625268+0000","last_active":"2024-01-22T05:04:39.090782+0000","last_peered":"2024-01-22T05:04:39.090782+0000","last_clean":"2024-01-22T05:04:39.090782+0000","last_became_active":"2024-01-22T05:04:34.624645+0000","last_became_peered":"2024-01-22T05:04:34.624645+0000","last_unstale":"2024-01-22T05:04:39.090782+0000","last_undegraded":"2024-01-22T05:04:39.090782+0000","last_fullsized":"2024-01-22T05:04:39.090782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072828+0000","last_change":"2024-01-22T05:04:35.061505+0000","last_active":"2024-01-22T05:04:39.072828+0000","last_peered":"2024-01-22T05:04:39.072828+0000","last_clean":"2024-01-22T05:04:39.072828+0000","last_became_active":"2024-01-22T05:04:35.061173+0000","last_became_peered":"2024-01-22T05:04:35.061173+0000","last_unstale":"2024-01-22T05:04:39.072828+0000","last_undegraded":"2024-01-22T05:04:39.072828+0000","last_fullsized":"2024-01-22T05:04:39.072828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077231+0000","last_change":"2024-01-22T05:04:34.612548+0000","last_active":"2024-01-22T05:04:39.077231+0000","last_peered":"2024-01-22T05:04:39.077231+0000","last_clean":"2024-01-22T05:04:39.077231+0000","last_became_active":"2024-01-22T05:04:34.612040+0000","last_became_peered":"2024-01-22T05:04:34.612040+0000","last_unstale":"2024-01-22T05:04:39.077231+0000","last_undegraded":"2024-01-22T05:04:39.077231+0000","last_fullsized":"2024-01-22T05:04:39.077231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.093708+0000","last_change":"2024-01-22T05:04:35.048950+0000","last_active":"2024-01-22T05:04:39.093708+0000","last_peered":"2024-01-22T05:04:39.093708+0000","last_clean":"2024-01-22T05:04:39.093708+0000","last_became_active":"2024-01-22T05:04:35.048676+0000","last_became_peered":"2024-01-22T05:04:35.048676+0000","last_unstale":"2024-01-22T05:04:39.093708+0000","last_undegraded":"2024-01-22T05:04:39.093708+0000","last_fullsized":"2024-01-22T05:04:39.093708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090409+0000","last_change":"2024-01-22T05:04:34.602672+0000","last_active":"2024-01-22T05:04:39.090409+0000","last_peered":"2024-01-22T05:04:39.090409+0000","last_clean":"2024-01-22T05:04:39.090409+0000","last_became_active":"2024-01-22T05:04:34.602360+0000","last_became_peered":"2024-01-22T05:04:34.602360+0000","last_unstale":"2024-01-22T05:04:39.090409+0000","last_undegraded":"2024-01-22T05:04:39.090409+0000","last_fullsized":"2024-01-22T05:04:39.090409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091801+0000","last_change":"2024-01-22T05:04:35.054902+0000","last_active":"2024-01-22T05:04:39.091801+0000","last_peered":"2024-01-22T05:04:39.091801+0000","last_clean":"2024-01-22T05:04:39.091801+0000","last_became_active":"2024-01-22T05:04:35.054584+0000","last_became_peered":"2024-01-22T05:04:35.054584+0000","last_unstale":"2024-01-22T05:04:39.091801+0000","last_undegraded":"2024-01-22T05:04:39.091801+0000","last_fullsized":"2024-01-22T05:04:39.091801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079986+0000","last_change":"2024-01-22T05:04:34.608195+0000","last_active":"2024-01-22T05:04:39.079986+0000","last_peered":"2024-01-22T05:04:39.079986+0000","last_clean":"2024-01-22T05:04:39.079986+0000","last_became_active":"2024-01-22T05:04:34.607837+0000","last_became_peered":"2024-01-22T05:04:34.607837+0000","last_unstale":"2024-01-22T05:04:39.079986+0000","last_undegraded":"2024-01-22T05:04:39.079986+0000","last_fullsized":"2024-01-22T05:04:39.079986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070953+0000","last_change":"2024-01-22T05:04:35.061215+0000","last_active":"2024-01-22T05:04:39.070953+0000","last_peered":"2024-01-22T05:04:39.070953+0000","last_clean":"2024-01-22T05:04:39.070953+0000","last_became_active":"2024-01-22T05:04:35.060725+0000","last_became_peered":"2024-01-22T05:04:35.060725+0000","last_unstale":"2024-01-22T05:04:39.070953+0000","last_undegraded":"2024-01-22T05:04:39.070953+0000","last_fullsized":"2024-01-22T05:04:39.070953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091439+0000","last_change":"2024-01-22T05:04:34.609097+0000","last_active":"2024-01-22T05:04:39.091439+0000","last_peered":"2024-01-22T05:04:39.091439+0000","last_clean":"2024-01-22T05:04:39.091439+0000","last_became_active":"2024-01-22T05:04:34.608713+0000","last_became_peered":"2024-01-22T05:04:34.608713+0000","last_unstale":"2024-01-22T05:04:39.091439+0000","last_undegraded":"2024-01-22T05:04:39.091439+0000","last_fullsized":"2024-01-22T05:04:39.091439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090630+0000","last_change":"2024-01-22T05:04:35.070206+0000","last_active":"2024-01-22T05:04:39.090630+0000","last_peered":"2024-01-22T05:04:39.090630+0000","last_clean":"2024-01-22T05:04:39.090630+0000","last_became_active":"2024-01-22T05:04:35.068703+0000","last_became_peered":"2024-01-22T05:04:35.068703+0000","last_unstale":"2024-01-22T05:04:39.090630+0000","last_undegraded":"2024-01-22T05:04:39.090630+0000","last_fullsized":"2024-01-22T05:04:39.090630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.111639+0000","last_change":"2024-01-22T05:04:34.620326+0000","last_active":"2024-01-22T05:04:39.111639+0000","last_peered":"2024-01-22T05:04:39.111639+0000","last_clean":"2024-01-22T05:04:39.111639+0000","last_became_active":"2024-01-22T05:04:34.620046+0000","last_became_peered":"2024-01-22T05:04:34.620046+0000","last_unstale":"2024-01-22T05:04:39.111639+0000","last_undegraded":"2024-01-22T05:04:39.111639+0000","last_fullsized":"2024-01-22T05:04:39.111639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079200+0000","last_change":"2024-01-22T05:04:35.054096+0000","last_active":"2024-01-22T05:04:39.079200+0000","last_peered":"2024-01-22T05:04:39.079200+0000","last_clean":"2024-01-22T05:04:39.079200+0000","last_became_active":"2024-01-22T05:04:35.053815+0000","last_became_peered":"2024-01-22T05:04:35.053815+0000","last_unstale":"2024-01-22T05:04:39.079200+0000","last_undegraded":"2024-01-22T05:04:39.079200+0000","last_fullsized":"2024-01-22T05:04:39.079200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092578+0000","last_change":"2024-01-22T05:04:34.617396+0000","last_active":"2024-01-22T05:04:39.092578+0000","last_peered":"2024-01-22T05:04:39.092578+0000","last_clean":"2024-01-22T05:04:39.092578+0000","last_became_active":"2024-01-22T05:04:34.617128+0000","last_became_peered":"2024-01-22T05:04:34.617128+0000","last_unstale":"2024-01-22T05:04:39.092578+0000","last_undegraded":"2024-01-22T05:04:39.092578+0000","last_fullsized":"2024-01-22T05:04:39.092578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297384,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074456,"statfs":{"total":96636764160,"available":96332242944,"internally_reserved":0,"allocated":294912,"data_stored":112351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297364,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074476,"statfs":{"total":96636764160,"available":96332263424,"internally_reserved":0,"allocated":274432,"data_stored":114562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297356,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074484,"statfs":{"total":96636764160,"available":96332271616,"internally_reserved":0,"allocated":266240,"data_stored":110937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297376,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074464,"statfs":{"total":96636764160,"available":96332251136,"internally_reserved":0,"allocated":286720,"data_stored":114708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.534}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7709999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297360,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074480,"statfs":{"total":96636764160,"available":96332267520,"internally_reserved":0,"allocated":270336,"data_stored":111027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.798}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8939999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.835}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297360,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074480,"statfs":{"total":96636764160,"available":96332267520,"internally_reserved":0,"allocated":270336,"data_stored":111007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297356,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074484,"statfs":{"total":96636764160,"available":96332271616,"internally_reserved":0,"allocated":266240,"data_stored":110937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.643}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.776}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8959999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.419}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297356,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074484,"statfs":{"total":96636764160,"available":96332271616,"internally_reserved":0,"allocated":266240,"data_stored":110937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:04:50.579 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:04:50.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.761+0000 7f5b10800700 1 Processor -- start 2024-01-22T05:04:50.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.761+0000 7f5b10800700 1 -- start start 2024-01-22T05:04:50.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.765+0000 7f5b10800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b080c25e0 0x7f5b080a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:50.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.765+0000 7f5b10800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b080c1a40 con 0x7f5b080a8740 2024-01-22T05:04:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.765+0000 7f5b10800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b080a90b0 con 0x7f5b08155d20 2024-01-22T05:04:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.765+0000 7f5b10800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b08159310 con 0x7f5b080c25e0 2024-01-22T05:04:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.765+0000 7f5b0d400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5b080a8740 0x7f5b080c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33552/0 (socket says 172.21.15.49:33552) 2024-01-22T05:04:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.765+0000 7f5b0d400700 1 -- 172.21.15.49:0/3449461577 learned_addr learned my addr 172.21.15.49:0/3449461577 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.765+0000 7f5b0e800700 1 --2- 172.21.15.49:0/3449461577 >> v2:172.21.15.49:3300/0 conn(0x7f5b080c25e0 0x7f5b080a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.765+0000 7f5b0ca00700 1 -- 172.21.15.49:0/3449461577 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251939072 0 0) 0x7f5b080c1a40 con 0x7f5b080a8740 2024-01-22T05:04:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.765+0000 7f5b0ca00700 1 -- 172.21.15.49:0/3449461577 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae80033f0 con 0x7f5b080a8740 2024-01-22T05:04:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 -- 172.21.15.49:0/3449461577 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3036037079 0 0) 0x7f5ae80033f0 con 0x7f5b080a8740 2024-01-22T05:04:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 -- 172.21.15.49:0/3449461577 >> v2:172.21.15.49:3300/0 conn(0x7f5b080c25e0 msgr2=0x7f5b080a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 --2- 172.21.15.49:0/3449461577 >> v2:172.21.15.49:3300/0 conn(0x7f5b080c25e0 0x7f5b080a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 -- 172.21.15.49:0/3449461577 >> v1:172.21.15.110:6789/0 conn(0x7f5b08155d20 legacy=0x7f5b08065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 -- 172.21.15.49:0/3449461577 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b080c13f0 con 0x7f5b080a8740 2024-01-22T05:04:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 -- 172.21.15.49:0/3449461577 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f5af0001470 con 0x7f5b080a8740 2024-01-22T05:04:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 -- 172.21.15.49:0/3449461577 >> v1:172.21.15.49:6789/0 conn(0x7f5b080a8740 legacy=0x7f5b080c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 --2- 172.21.15.49:0/3449461577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ae80038e0 0x7f5ae8003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 --2- 172.21.15.49:0/3449461577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ae8004690 0x7f5ae8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 --2- 172.21.15.49:0/3449461577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ae8005000 0x7f5ae800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 -- 172.21.15.49:0/3449461577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b08159310 con 0x7f5ae8004690 2024-01-22T05:04:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 -- 172.21.15.49:0/3449461577 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae800beb0 con 0x7f5ae80038e0 2024-01-22T05:04:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 -- 172.21.15.49:0/3449461577 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae800c070 con 0x7f5ae8005000 2024-01-22T05:04:50.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0d400700 1 --2- 172.21.15.49:0/3449461577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ae8004690 0x7f5ae8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:50.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0de00700 1 --2- 172.21.15.49:0/3449461577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ae80038e0 0x7f5ae8003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:50.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0e800700 1 --2- 172.21.15.49:0/3449461577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ae8005000 0x7f5ae800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:50.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0d400700 1 -- 172.21.15.49:0/3449461577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ae8005000 msgr2=0x7f5ae800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:50.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0d400700 1 --2- 172.21.15.49:0/3449461577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ae8005000 0x7f5ae800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0d400700 1 -- 172.21.15.49:0/3449461577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ae80038e0 msgr2=0x7f5ae8003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0d400700 1 --2- 172.21.15.49:0/3449461577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ae80038e0 0x7f5ae8003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0d400700 1 -- 172.21.15.49:0/3449461577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae80033f0 con 0x7f5ae8004690 2024-01-22T05:04:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0e800700 1 -- 172.21.15.49:0/3449461577 reap_dead start 2024-01-22T05:04:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0d400700 1 --2- 172.21.15.49:0/3449461577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ae8004690 0x7f5ae8004b10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f5af000c110 tx=0x7f5af0001df0).ready entity=mon.0 client_cookie=d4278d3d10b874bd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 -- 172.21.15.49:0/3449461577 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000ca40 con 0x7f5ae8004690 2024-01-22T05:04:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 -- 172.21.15.49:0/3449461577 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af000cba0 con 0x7f5ae8004690 2024-01-22T05:04:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b0ca00700 1 -- 172.21.15.49:0/3449461577 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af00070d0 con 0x7f5ae8004690 2024-01-22T05:04:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b10800700 1 -- 172.21.15.49:0/3449461577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ae8004690 msgr2=0x7f5ae8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.769+0000 7f5b10800700 1 --2- 172.21.15.49:0/3449461577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ae8004690 0x7f5ae8004b10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f5af000c110 tx=0x7f5af0001df0).stop 2024-01-22T05:04:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.773+0000 7f5b10800700 1 -- 172.21.15.49:0/3449461577 shutdown_connections 2024-01-22T05:04:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.773+0000 7f5b10800700 1 --2- 172.21.15.49:0/3449461577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ae8004690 0x7f5ae8004b10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.773+0000 7f5b10800700 1 -- 172.21.15.49:0/3449461577 >> 172.21.15.49:0/3449461577 conn(0x7f5b080c6540 msgr2=0x7f5b080c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.773+0000 7f5b10800700 1 -- 172.21.15.49:0/3449461577 shutdown_connections 2024-01-22T05:04:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.773+0000 7f5b10800700 1 -- 172.21.15.49:0/3449461577 wait complete. 2024-01-22T05:04:50.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.773+0000 7f5b10800700 1 Processor -- start 2024-01-22T05:04:50.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b10800700 1 -- start start 2024-01-22T05:04:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b10800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ae8004690 0x7f5b08145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:50.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b10800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b08145d70 0x7f5b08066be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:50.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b10800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b08142fb0 0x7f5b080670d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:50.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b10800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080675c0 con 0x7f5b08145d70 2024-01-22T05:04:50.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b10800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b08068630 con 0x7f5b08142fb0 2024-01-22T05:04:50.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b10800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080ac180 con 0x7f5ae8004690 2024-01-22T05:04:50.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b0d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b08145d70 0x7f5b08066be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:50.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b0d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b08145d70 0x7f5b08066be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48192/0 (socket says 172.21.15.49:48192) 2024-01-22T05:04:50.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b0d400700 1 -- 172.21.15.49:0/1524708904 learned_addr learned my addr 172.21.15.49:0/1524708904 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:50.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b0de00700 1 --2- 172.21.15.49:0/1524708904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ae8004690 0x7f5b08145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:50.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b0e800700 1 --2- 172.21.15.49:0/1524708904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b08142fb0 0x7f5b080670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:50.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b0d400700 1 -- 172.21.15.49:0/1524708904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ae8004690 msgr2=0x7f5b08145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:50.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b0d400700 1 --2- 172.21.15.49:0/1524708904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ae8004690 0x7f5b08145880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b0d400700 1 -- 172.21.15.49:0/1524708904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b08142fb0 msgr2=0x7f5b080670d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:50.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b0d400700 1 --2- 172.21.15.49:0/1524708904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b08142fb0 0x7f5b080670d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b0d400700 1 -- 172.21.15.49:0/1524708904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b080ac460 con 0x7f5b08145d70 2024-01-22T05:04:50.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.777+0000 7f5b0d400700 1 --2- 172.21.15.49:0/1524708904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b08145d70 0x7f5b08066be0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f5af000c700 tx=0x7f5af0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:50.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.781+0000 7f5b05600700 1 -- 172.21.15.49:0/1524708904 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0001760 con 0x7f5b08145d70 2024-01-22T05:04:50.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.781+0000 7f5b05600700 1 -- 172.21.15.49:0/1524708904 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af0018070 con 0x7f5b08145d70 2024-01-22T05:04:50.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.781+0000 7f5b05600700 1 -- 172.21.15.49:0/1524708904 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af00048c0 con 0x7f5b08145d70 2024-01-22T05:04:50.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.781+0000 7f5b10800700 1 -- 172.21.15.49:0/1524708904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b081514f0 con 0x7f5b08145d70 2024-01-22T05:04:50.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.781+0000 7f5b10800700 1 -- 172.21.15.49:0/1524708904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b08151ab0 con 0x7f5b08145d70 2024-01-22T05:04:50.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.781+0000 7f5b10800700 1 -- 172.21.15.49:0/1524708904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b08047060 con 0x7f5b08145d70 2024-01-22T05:04:50.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.785+0000 7f5b05600700 1 -- 172.21.15.49:0/1524708904 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5af0004c70 con 0x7f5b08145d70 2024-01-22T05:04:50.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.785+0000 7f5b05600700 1 --2- 172.21.15.49:0/1524708904 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5ae005a540 0x7f5ae005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:50.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.785+0000 7f5b05600700 1 -- 172.21.15.49:0/1524708904 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f5af0075500 con 0x7f5b08145d70 2024-01-22T05:04:50.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.785+0000 7f5b0de00700 1 --2- 172.21.15.49:0/1524708904 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5ae005a540 0x7f5ae005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:50.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.785+0000 7f5b0de00700 1 --2- 172.21.15.49:0/1524708904 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5ae005a540 0x7f5ae005ca00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5af8000c00 tx=0x7f5af8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:50.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.793+0000 7f5b05600700 1 -- 172.21.15.49:0/1524708904 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5af00489d0 con 0x7f5b08145d70 2024-01-22T05:04:50.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.953+0000 7f5b10800700 1 -- 172.21.15.49:0/1524708904 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b080c16d0 con 0x7f5ae005a540 2024-01-22T05:04:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.973+0000 7f5b05600700 1 -- 172.21.15.49:0/1524708904 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+410440 (secure 0 0 0) 0x7f5b080c16d0 con 0x7f5ae005a540 2024-01-22T05:04:50.980 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.977+0000 7f5b10800700 1 -- 172.21.15.49:0/1524708904 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5ae005a540 msgr2=0x7f5ae005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.977+0000 7f5b10800700 1 --2- 172.21.15.49:0/1524708904 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5ae005a540 0x7f5ae005ca00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5af8000c00 tx=0x7f5af8009040).stop 2024-01-22T05:04:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.977+0000 7f5b10800700 1 -- 172.21.15.49:0/1524708904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b08145d70 msgr2=0x7f5b08066be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.977+0000 7f5b10800700 1 --2- 172.21.15.49:0/1524708904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b08145d70 0x7f5b08066be0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f5af000c700 tx=0x7f5af0015000).stop 2024-01-22T05:04:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.977+0000 7f5b10800700 1 -- 172.21.15.49:0/1524708904 shutdown_connections 2024-01-22T05:04:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.977+0000 7f5b10800700 1 --2- 172.21.15.49:0/1524708904 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5ae005a540 0x7f5ae005ca00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.977+0000 7f5b10800700 1 --2- 172.21.15.49:0/1524708904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b08142fb0 0x7f5b080670d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.977+0000 7f5b10800700 1 --2- 172.21.15.49:0/1524708904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b08145d70 0x7f5b08066be0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.977+0000 7f5b10800700 1 --2- 172.21.15.49:0/1524708904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ae8004690 0x7f5b08145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:50.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.977+0000 7f5b10800700 1 -- 172.21.15.49:0/1524708904 >> 172.21.15.49:0/1524708904 conn(0x7f5b080c6540 msgr2=0x7f5b08066010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:50.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.981+0000 7f5b10800700 1 -- 172.21.15.49:0/1524708904 shutdown_connections 2024-01-22T05:04:50.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:50.981+0000 7f5b10800700 1 -- 172.21.15.49:0/1524708904 wait complete. 2024-01-22T05:04:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:04:51.004 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-01-22T05:04:49.227238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378912,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595808,"statfs":{"total":773094113280,"available":770658107392,"internally_reserved":0,"allocated":2195456,"data_stored":896466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2179,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003561"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082694+0000","last_change":"2024-01-22T05:04:35.050369+0000","last_active":"2024-01-22T05:04:39.082694+0000","last_peered":"2024-01-22T05:04:39.082694+0000","last_clean":"2024-01-22T05:04:39.082694+0000","last_became_active":"2024-01-22T05:04:35.050006+0000","last_became_peered":"2024-01-22T05:04:35.050006+0000","last_unstale":"2024-01-22T05:04:39.082694+0000","last_undegraded":"2024-01-22T05:04:39.082694+0000","last_fullsized":"2024-01-22T05:04:39.082694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101110+0000","last_change":"2024-01-22T05:04:34.615730+0000","last_active":"2024-01-22T05:04:39.101110+0000","last_peered":"2024-01-22T05:04:39.101110+0000","last_clean":"2024-01-22T05:04:39.101110+0000","last_became_active":"2024-01-22T05:04:34.615423+0000","last_became_peered":"2024-01-22T05:04:34.615423+0000","last_unstale":"2024-01-22T05:04:39.101110+0000","last_undegraded":"2024-01-22T05:04:39.101110+0000","last_fullsized":"2024-01-22T05:04:39.101110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091379+0000","last_change":"2024-01-22T05:04:35.061052+0000","last_active":"2024-01-22T05:04:39.091379+0000","last_peered":"2024-01-22T05:04:39.091379+0000","last_clean":"2024-01-22T05:04:39.091379+0000","last_became_active":"2024-01-22T05:04:35.060391+0000","last_became_peered":"2024-01-22T05:04:35.060391+0000","last_unstale":"2024-01-22T05:04:39.091379+0000","last_undegraded":"2024-01-22T05:04:39.091379+0000","last_fullsized":"2024-01-22T05:04:39.091379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079454+0000","last_change":"2024-01-22T05:04:34.625335+0000","last_active":"2024-01-22T05:04:39.079454+0000","last_peered":"2024-01-22T05:04:39.079454+0000","last_clean":"2024-01-22T05:04:39.079454+0000","last_became_active":"2024-01-22T05:04:34.625033+0000","last_became_peered":"2024-01-22T05:04:34.625033+0000","last_unstale":"2024-01-22T05:04:39.079454+0000","last_undegraded":"2024-01-22T05:04:39.079454+0000","last_fullsized":"2024-01-22T05:04:39.079454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.083181+0000","last_change":"2024-01-22T05:04:34.613206+0000","last_active":"2024-01-22T05:04:39.083181+0000","last_peered":"2024-01-22T05:04:39.083181+0000","last_clean":"2024-01-22T05:04:39.083181+0000","last_became_active":"2024-01-22T05:04:34.612458+0000","last_became_peered":"2024-01-22T05:04:34.612458+0000","last_unstale":"2024-01-22T05:04:39.083181+0000","last_undegraded":"2024-01-22T05:04:39.083181+0000","last_fullsized":"2024-01-22T05:04:39.083181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087816+0000","last_change":"2024-01-22T05:04:35.067504+0000","last_active":"2024-01-22T05:04:39.087816+0000","last_peered":"2024-01-22T05:04:39.087816+0000","last_clean":"2024-01-22T05:04:39.087816+0000","last_became_active":"2024-01-22T05:04:35.067007+0000","last_became_peered":"2024-01-22T05:04:35.067007+0000","last_unstale":"2024-01-22T05:04:39.087816+0000","last_undegraded":"2024-01-22T05:04:39.087816+0000","last_fullsized":"2024-01-22T05:04:39.087816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.074244+0000","last_change":"2024-01-22T05:04:34.618016+0000","last_active":"2024-01-22T05:04:39.074244+0000","last_peered":"2024-01-22T05:04:39.074244+0000","last_clean":"2024-01-22T05:04:39.074244+0000","last_became_active":"2024-01-22T05:04:34.616976+0000","last_became_peered":"2024-01-22T05:04:34.616976+0000","last_unstale":"2024-01-22T05:04:39.074244+0000","last_undegraded":"2024-01-22T05:04:39.074244+0000","last_fullsized":"2024-01-22T05:04:39.074244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087750+0000","last_change":"2024-01-22T05:04:35.055742+0000","last_active":"2024-01-22T05:04:39.087750+0000","last_peered":"2024-01-22T05:04:39.087750+0000","last_clean":"2024-01-22T05:04:39.087750+0000","last_became_active":"2024-01-22T05:04:35.055484+0000","last_became_peered":"2024-01-22T05:04:35.055484+0000","last_unstale":"2024-01-22T05:04:39.087750+0000","last_undegraded":"2024-01-22T05:04:39.087750+0000","last_fullsized":"2024-01-22T05:04:39.087750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091158+0000","last_change":"2024-01-22T05:04:34.602682+0000","last_active":"2024-01-22T05:04:39.091158+0000","last_peered":"2024-01-22T05:04:39.091158+0000","last_clean":"2024-01-22T05:04:39.091158+0000","last_became_active":"2024-01-22T05:04:34.602415+0000","last_became_peered":"2024-01-22T05:04:34.602415+0000","last_unstale":"2024-01-22T05:04:39.091158+0000","last_undegraded":"2024-01-22T05:04:39.091158+0000","last_fullsized":"2024-01-22T05:04:39.091158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077259+0000","last_change":"2024-01-22T05:04:35.046243+0000","last_active":"2024-01-22T05:04:39.077259+0000","last_peered":"2024-01-22T05:04:39.077259+0000","last_clean":"2024-01-22T05:04:39.077259+0000","last_became_active":"2024-01-22T05:04:35.045968+0000","last_became_peered":"2024-01-22T05:04:35.045968+0000","last_unstale":"2024-01-22T05:04:39.077259+0000","last_undegraded":"2024-01-22T05:04:39.077259+0000","last_fullsized":"2024-01-22T05:04:39.077259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.094051+0000","last_change":"2024-01-22T05:04:34.612841+0000","last_active":"2024-01-22T05:04:39.094051+0000","last_peered":"2024-01-22T05:04:39.094051+0000","last_clean":"2024-01-22T05:04:39.094051+0000","last_became_active":"2024-01-22T05:04:34.612529+0000","last_became_peered":"2024-01-22T05:04:34.612529+0000","last_unstale":"2024-01-22T05:04:39.094051+0000","last_undegraded":"2024-01-22T05:04:39.094051+0000","last_fullsized":"2024-01-22T05:04:39.094051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090289+0000","last_change":"2024-01-22T05:04:35.067328+0000","last_active":"2024-01-22T05:04:39.090289+0000","last_peered":"2024-01-22T05:04:39.090289+0000","last_clean":"2024-01-22T05:04:39.090289+0000","last_became_active":"2024-01-22T05:04:35.066995+0000","last_became_peered":"2024-01-22T05:04:35.066995+0000","last_unstale":"2024-01-22T05:04:39.090289+0000","last_undegraded":"2024-01-22T05:04:39.090289+0000","last_fullsized":"2024-01-22T05:04:39.090289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091559+0000","last_change":"2024-01-22T05:04:34.613788+0000","last_active":"2024-01-22T05:04:39.091559+0000","last_peered":"2024-01-22T05:04:39.091559+0000","last_clean":"2024-01-22T05:04:39.091559+0000","last_became_active":"2024-01-22T05:04:34.611731+0000","last_became_peered":"2024-01-22T05:04:34.611731+0000","last_unstale":"2024-01-22T05:04:39.091559+0000","last_undegraded":"2024-01-22T05:04:39.091559+0000","last_fullsized":"2024-01-22T05:04:39.091559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072961+0000","last_change":"2024-01-22T05:04:35.053554+0000","last_active":"2024-01-22T05:04:39.072961+0000","last_peered":"2024-01-22T05:04:39.072961+0000","last_clean":"2024-01-22T05:04:39.072961+0000","last_became_active":"2024-01-22T05:04:35.052755+0000","last_became_peered":"2024-01-22T05:04:35.052755+0000","last_unstale":"2024-01-22T05:04:39.072961+0000","last_undegraded":"2024-01-22T05:04:39.072961+0000","last_fullsized":"2024-01-22T05:04:39.072961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077414+0000","last_change":"2024-01-22T05:04:34.612292+0000","last_active":"2024-01-22T05:04:39.077414+0000","last_peered":"2024-01-22T05:04:39.077414+0000","last_clean":"2024-01-22T05:04:39.077414+0000","last_became_active":"2024-01-22T05:04:34.611340+0000","last_became_peered":"2024-01-22T05:04:34.611340+0000","last_unstale":"2024-01-22T05:04:39.077414+0000","last_undegraded":"2024-01-22T05:04:39.077414+0000","last_fullsized":"2024-01-22T05:04:39.077414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073500+0000","last_change":"2024-01-22T05:04:35.047170+0000","last_active":"2024-01-22T05:04:39.073500+0000","last_peered":"2024-01-22T05:04:39.073500+0000","last_clean":"2024-01-22T05:04:39.073500+0000","last_became_active":"2024-01-22T05:04:35.046891+0000","last_became_peered":"2024-01-22T05:04:35.046891+0000","last_unstale":"2024-01-22T05:04:39.073500+0000","last_undegraded":"2024-01-22T05:04:39.073500+0000","last_fullsized":"2024-01-22T05:04:39.073500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.088007+0000","last_change":"2024-01-22T05:04:34.614155+0000","last_active":"2024-01-22T05:04:39.088007+0000","last_peered":"2024-01-22T05:04:39.088007+0000","last_clean":"2024-01-22T05:04:39.088007+0000","last_became_active":"2024-01-22T05:04:34.613838+0000","last_became_peered":"2024-01-22T05:04:34.613838+0000","last_unstale":"2024-01-22T05:04:39.088007+0000","last_undegraded":"2024-01-22T05:04:39.088007+0000","last_fullsized":"2024-01-22T05:04:39.088007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073280+0000","last_change":"2024-01-22T05:04:35.059943+0000","last_active":"2024-01-22T05:04:39.073280+0000","last_peered":"2024-01-22T05:04:39.073280+0000","last_clean":"2024-01-22T05:04:39.073280+0000","last_became_active":"2024-01-22T05:04:35.057491+0000","last_became_peered":"2024-01-22T05:04:35.057491+0000","last_unstale":"2024-01-22T05:04:39.073280+0000","last_undegraded":"2024-01-22T05:04:39.073280+0000","last_fullsized":"2024-01-22T05:04:39.073280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079555+0000","last_change":"2024-01-22T05:04:34.602873+0000","last_active":"2024-01-22T05:04:39.079555+0000","last_peered":"2024-01-22T05:04:39.079555+0000","last_clean":"2024-01-22T05:04:39.079555+0000","last_became_active":"2024-01-22T05:04:34.602401+0000","last_became_peered":"2024-01-22T05:04:34.602401+0000","last_unstale":"2024-01-22T05:04:39.079555+0000","last_undegraded":"2024-01-22T05:04:39.079555+0000","last_fullsized":"2024-01-22T05:04:39.079555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091439+0000","last_change":"2024-01-22T05:04:35.061246+0000","last_active":"2024-01-22T05:04:39.091439+0000","last_peered":"2024-01-22T05:04:39.091439+0000","last_clean":"2024-01-22T05:04:39.091439+0000","last_became_active":"2024-01-22T05:04:35.060730+0000","last_became_peered":"2024-01-22T05:04:35.060730+0000","last_unstale":"2024-01-22T05:04:39.091439+0000","last_undegraded":"2024-01-22T05:04:39.091439+0000","last_fullsized":"2024-01-22T05:04:39.091439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.085851+0000","last_change":"2024-01-22T05:04:34.619066+0000","last_active":"2024-01-22T05:04:39.085851+0000","last_peered":"2024-01-22T05:04:39.085851+0000","last_clean":"2024-01-22T05:04:39.085851+0000","last_became_active":"2024-01-22T05:04:34.618524+0000","last_became_peered":"2024-01-22T05:04:34.618524+0000","last_unstale":"2024-01-22T05:04:39.085851+0000","last_undegraded":"2024-01-22T05:04:39.085851+0000","last_fullsized":"2024-01-22T05:04:39.085851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.088848+0000","last_change":"2024-01-22T05:04:35.047351+0000","last_active":"2024-01-22T05:04:39.088848+0000","last_peered":"2024-01-22T05:04:39.088848+0000","last_clean":"2024-01-22T05:04:39.088848+0000","last_became_active":"2024-01-22T05:04:35.047047+0000","last_became_peered":"2024-01-22T05:04:35.047047+0000","last_unstale":"2024-01-22T05:04:39.088848+0000","last_undegraded":"2024-01-22T05:04:39.088848+0000","last_fullsized":"2024-01-22T05:04:39.088848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.558487+0000","last_change":"2024-01-22T05:04:34.619862+0000","last_active":"2024-01-22T05:04:39.558487+0000","last_peered":"2024-01-22T05:04:39.558487+0000","last_clean":"2024-01-22T05:04:39.558487+0000","last_became_active":"2024-01-22T05:04:34.615400+0000","last_became_peered":"2024-01-22T05:04:34.615400+0000","last_unstale":"2024-01-22T05:04:39.558487+0000","last_undegraded":"2024-01-22T05:04:39.558487+0000","last_fullsized":"2024-01-22T05:04:39.558487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087854+0000","last_change":"2024-01-22T05:04:35.062780+0000","last_active":"2024-01-22T05:04:39.087854+0000","last_peered":"2024-01-22T05:04:39.087854+0000","last_clean":"2024-01-22T05:04:39.087854+0000","last_became_active":"2024-01-22T05:04:35.062412+0000","last_became_peered":"2024-01-22T05:04:35.062412+0000","last_unstale":"2024-01-22T05:04:39.087854+0000","last_undegraded":"2024-01-22T05:04:39.087854+0000","last_fullsized":"2024-01-22T05:04:39.087854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104001+0000","last_change":"2024-01-22T05:04:34.613410+0000","last_active":"2024-01-22T05:04:39.104001+0000","last_peered":"2024-01-22T05:04:39.104001+0000","last_clean":"2024-01-22T05:04:39.104001+0000","last_became_active":"2024-01-22T05:04:34.613064+0000","last_became_peered":"2024-01-22T05:04:34.613064+0000","last_unstale":"2024-01-22T05:04:39.104001+0000","last_undegraded":"2024-01-22T05:04:39.104001+0000","last_fullsized":"2024-01-22T05:04:39.104001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071476+0000","last_change":"2024-01-22T05:04:35.057169+0000","last_active":"2024-01-22T05:04:39.071476+0000","last_peered":"2024-01-22T05:04:39.071476+0000","last_clean":"2024-01-22T05:04:39.071476+0000","last_became_active":"2024-01-22T05:04:35.052838+0000","last_became_peered":"2024-01-22T05:04:35.052838+0000","last_unstale":"2024-01-22T05:04:39.071476+0000","last_undegraded":"2024-01-22T05:04:39.071476+0000","last_fullsized":"2024-01-22T05:04:39.071476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087571+0000","last_change":"2024-01-22T05:04:34.621537+0000","last_active":"2024-01-22T05:04:39.087571+0000","last_peered":"2024-01-22T05:04:39.087571+0000","last_clean":"2024-01-22T05:04:39.087571+0000","last_became_active":"2024-01-22T05:04:34.619679+0000","last_became_peered":"2024-01-22T05:04:34.619679+0000","last_unstale":"2024-01-22T05:04:39.087571+0000","last_undegraded":"2024-01-22T05:04:39.087571+0000","last_fullsized":"2024-01-22T05:04:39.087571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082734+0000","last_change":"2024-01-22T05:04:35.058927+0000","last_active":"2024-01-22T05:04:39.082734+0000","last_peered":"2024-01-22T05:04:39.082734+0000","last_clean":"2024-01-22T05:04:39.082734+0000","last_became_active":"2024-01-22T05:04:35.058360+0000","last_became_peered":"2024-01-22T05:04:35.058360+0000","last_unstale":"2024-01-22T05:04:39.082734+0000","last_undegraded":"2024-01-22T05:04:39.082734+0000","last_fullsized":"2024-01-22T05:04:39.082734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091650+0000","last_change":"2024-01-22T05:04:34.603402+0000","last_active":"2024-01-22T05:04:39.091650+0000","last_peered":"2024-01-22T05:04:39.091650+0000","last_clean":"2024-01-22T05:04:39.091650+0000","last_became_active":"2024-01-22T05:04:34.601578+0000","last_became_peered":"2024-01-22T05:04:34.601578+0000","last_unstale":"2024-01-22T05:04:39.091650+0000","last_undegraded":"2024-01-22T05:04:39.091650+0000","last_fullsized":"2024-01-22T05:04:39.091650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104259+0000","last_change":"2024-01-22T05:04:35.069261+0000","last_active":"2024-01-22T05:04:39.104259+0000","last_peered":"2024-01-22T05:04:39.104259+0000","last_clean":"2024-01-22T05:04:39.104259+0000","last_became_active":"2024-01-22T05:04:35.068641+0000","last_became_peered":"2024-01-22T05:04:35.068641+0000","last_unstale":"2024-01-22T05:04:39.104259+0000","last_undegraded":"2024-01-22T05:04:39.104259+0000","last_fullsized":"2024-01-22T05:04:39.104259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077499+0000","last_change":"2024-01-22T05:04:34.613087+0000","last_active":"2024-01-22T05:04:39.077499+0000","last_peered":"2024-01-22T05:04:39.077499+0000","last_clean":"2024-01-22T05:04:39.077499+0000","last_became_active":"2024-01-22T05:04:34.612162+0000","last_became_peered":"2024-01-22T05:04:34.612162+0000","last_unstale":"2024-01-22T05:04:39.077499+0000","last_undegraded":"2024-01-22T05:04:39.077499+0000","last_fullsized":"2024-01-22T05:04:39.077499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082087+0000","last_change":"2024-01-22T05:04:35.064923+0000","last_active":"2024-01-22T05:04:39.082087+0000","last_peered":"2024-01-22T05:04:39.082087+0000","last_clean":"2024-01-22T05:04:39.082087+0000","last_became_active":"2024-01-22T05:04:35.064659+0000","last_became_peered":"2024-01-22T05:04:35.064659+0000","last_unstale":"2024-01-22T05:04:39.082087+0000","last_undegraded":"2024-01-22T05:04:39.082087+0000","last_fullsized":"2024-01-22T05:04:39.082087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.069357+0000","last_change":"2024-01-22T05:04:34.613407+0000","last_active":"2024-01-22T05:04:39.069357+0000","last_peered":"2024-01-22T05:04:39.069357+0000","last_clean":"2024-01-22T05:04:39.069357+0000","last_became_active":"2024-01-22T05:04:34.613071+0000","last_became_peered":"2024-01-22T05:04:34.613071+0000","last_unstale":"2024-01-22T05:04:39.069357+0000","last_undegraded":"2024-01-22T05:04:39.069357+0000","last_fullsized":"2024-01-22T05:04:39.069357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.106863+0000","last_change":"2024-01-22T05:04:35.041221+0000","last_active":"2024-01-22T05:04:39.106863+0000","last_peered":"2024-01-22T05:04:39.106863+0000","last_clean":"2024-01-22T05:04:39.106863+0000","last_became_active":"2024-01-22T05:04:35.040768+0000","last_became_peered":"2024-01-22T05:04:35.040768+0000","last_unstale":"2024-01-22T05:04:39.106863+0000","last_undegraded":"2024-01-22T05:04:39.106863+0000","last_fullsized":"2024-01-22T05:04:39.106863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.088940+0000","last_change":"2024-01-22T05:04:34.620016+0000","last_active":"2024-01-22T05:04:39.088940+0000","last_peered":"2024-01-22T05:04:39.088940+0000","last_clean":"2024-01-22T05:04:39.088940+0000","last_became_active":"2024-01-22T05:04:34.617253+0000","last_became_peered":"2024-01-22T05:04:34.617253+0000","last_unstale":"2024-01-22T05:04:39.088940+0000","last_undegraded":"2024-01-22T05:04:39.088940+0000","last_fullsized":"2024-01-22T05:04:39.088940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.116642+0000","last_change":"2024-01-22T05:04:35.046592+0000","last_active":"2024-01-22T05:04:39.116642+0000","last_peered":"2024-01-22T05:04:39.116642+0000","last_clean":"2024-01-22T05:04:39.116642+0000","last_became_active":"2024-01-22T05:04:35.046327+0000","last_became_peered":"2024-01-22T05:04:35.046327+0000","last_unstale":"2024-01-22T05:04:39.116642+0000","last_undegraded":"2024-01-22T05:04:39.116642+0000","last_fullsized":"2024-01-22T05:04:39.116642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.120146+0000","last_change":"2024-01-22T05:04:39.111440+0000","last_active":"2024-01-22T05:04:39.120146+0000","last_peered":"2024-01-22T05:04:39.120146+0000","last_clean":"2024-01-22T05:04:39.120146+0000","last_became_active":"2024-01-22T05:04:39.111025+0000","last_became_peered":"2024-01-22T05:04:39.111025+0000","last_unstale":"2024-01-22T05:04:39.120146+0000","last_undegraded":"2024-01-22T05:04:39.120146+0000","last_fullsized":"2024-01-22T05:04:39.120146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091490+0000","last_change":"2024-01-22T05:04:34.605684+0000","last_active":"2024-01-22T05:04:39.091490+0000","last_peered":"2024-01-22T05:04:39.091490+0000","last_clean":"2024-01-22T05:04:39.091490+0000","last_became_active":"2024-01-22T05:04:34.605346+0000","last_became_peered":"2024-01-22T05:04:34.605346+0000","last_unstale":"2024-01-22T05:04:39.091490+0000","last_undegraded":"2024-01-22T05:04:39.091490+0000","last_fullsized":"2024-01-22T05:04:39.091490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071714+0000","last_change":"2024-01-22T05:04:35.053273+0000","last_active":"2024-01-22T05:04:39.071714+0000","last_peered":"2024-01-22T05:04:39.071714+0000","last_clean":"2024-01-22T05:04:39.071714+0000","last_became_active":"2024-01-22T05:04:35.052833+0000","last_became_peered":"2024-01-22T05:04:35.052833+0000","last_unstale":"2024-01-22T05:04:39.071714+0000","last_undegraded":"2024-01-22T05:04:39.071714+0000","last_fullsized":"2024-01-22T05:04:39.071714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103041+0000","last_change":"2024-01-22T05:04:39.099537+0000","last_active":"2024-01-22T05:04:39.103041+0000","last_peered":"2024-01-22T05:04:39.103041+0000","last_clean":"2024-01-22T05:04:39.103041+0000","last_became_active":"2024-01-22T05:04:39.099039+0000","last_became_peered":"2024-01-22T05:04:39.099039+0000","last_unstale":"2024-01-22T05:04:39.103041+0000","last_undegraded":"2024-01-22T05:04:39.103041+0000","last_fullsized":"2024-01-22T05:04:39.103041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.083714+0000","last_change":"2024-01-22T05:04:34.622996+0000","last_active":"2024-01-22T05:04:39.083714+0000","last_peered":"2024-01-22T05:04:39.083714+0000","last_clean":"2024-01-22T05:04:39.083714+0000","last_became_active":"2024-01-22T05:04:34.622644+0000","last_became_peered":"2024-01-22T05:04:34.622644+0000","last_unstale":"2024-01-22T05:04:39.083714+0000","last_undegraded":"2024-01-22T05:04:39.083714+0000","last_fullsized":"2024-01-22T05:04:39.083714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087958+0000","last_change":"2024-01-22T05:04:35.054335+0000","last_active":"2024-01-22T05:04:39.087958+0000","last_peered":"2024-01-22T05:04:39.087958+0000","last_clean":"2024-01-22T05:04:39.087958+0000","last_became_active":"2024-01-22T05:04:35.049434+0000","last_became_peered":"2024-01-22T05:04:35.049434+0000","last_unstale":"2024-01-22T05:04:39.087958+0000","last_undegraded":"2024-01-22T05:04:39.087958+0000","last_fullsized":"2024-01-22T05:04:39.087958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.108343+0000","last_change":"2024-01-22T05:04:39.099472+0000","last_active":"2024-01-22T05:04:39.108343+0000","last_peered":"2024-01-22T05:04:39.108343+0000","last_clean":"2024-01-22T05:04:39.108343+0000","last_became_active":"2024-01-22T05:04:39.099032+0000","last_became_peered":"2024-01-22T05:04:39.099032+0000","last_unstale":"2024-01-22T05:04:39.108343+0000","last_undegraded":"2024-01-22T05:04:39.108343+0000","last_fullsized":"2024-01-22T05:04:39.108343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082319+0000","last_change":"2024-01-22T05:04:34.601591+0000","last_active":"2024-01-22T05:04:39.082319+0000","last_peered":"2024-01-22T05:04:39.082319+0000","last_clean":"2024-01-22T05:04:39.082319+0000","last_became_active":"2024-01-22T05:04:34.601315+0000","last_became_peered":"2024-01-22T05:04:34.601315+0000","last_unstale":"2024-01-22T05:04:39.082319+0000","last_undegraded":"2024-01-22T05:04:39.082319+0000","last_fullsized":"2024-01-22T05:04:39.082319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071207+0000","last_change":"2024-01-22T05:04:35.061009+0000","last_active":"2024-01-22T05:04:39.071207+0000","last_peered":"2024-01-22T05:04:39.071207+0000","last_clean":"2024-01-22T05:04:39.071207+0000","last_became_active":"2024-01-22T05:04:35.060328+0000","last_became_peered":"2024-01-22T05:04:35.060328+0000","last_unstale":"2024-01-22T05:04:39.071207+0000","last_undegraded":"2024-01-22T05:04:39.071207+0000","last_fullsized":"2024-01-22T05:04:39.071207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.116310+0000","last_change":"2024-01-22T05:04:39.114183+0000","last_active":"2024-01-22T05:04:39.116310+0000","last_peered":"2024-01-22T05:04:39.116310+0000","last_clean":"2024-01-22T05:04:39.116310+0000","last_became_active":"2024-01-22T05:04:39.113514+0000","last_became_peered":"2024-01-22T05:04:39.113514+0000","last_unstale":"2024-01-22T05:04:39.116310+0000","last_undegraded":"2024-01-22T05:04:39.116310+0000","last_fullsized":"2024-01-22T05:04:39.116310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.080489+0000","last_change":"2024-01-22T05:04:34.599714+0000","last_active":"2024-01-22T05:04:39.080489+0000","last_peered":"2024-01-22T05:04:39.080489+0000","last_clean":"2024-01-22T05:04:39.080489+0000","last_became_active":"2024-01-22T05:04:34.599372+0000","last_became_peered":"2024-01-22T05:04:34.599372+0000","last_unstale":"2024-01-22T05:04:39.080489+0000","last_undegraded":"2024-01-22T05:04:39.080489+0000","last_fullsized":"2024-01-22T05:04:39.080489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071613+0000","last_change":"2024-01-22T05:04:35.063064+0000","last_active":"2024-01-22T05:04:39.071613+0000","last_peered":"2024-01-22T05:04:39.071613+0000","last_clean":"2024-01-22T05:04:39.071613+0000","last_became_active":"2024-01-22T05:04:35.060532+0000","last_became_peered":"2024-01-22T05:04:35.060532+0000","last_unstale":"2024-01-22T05:04:39.071613+0000","last_undegraded":"2024-01-22T05:04:39.071613+0000","last_fullsized":"2024-01-22T05:04:39.071613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.120120+0000","last_change":"2024-01-22T05:04:39.112845+0000","last_active":"2024-01-22T05:04:39.120120+0000","last_peered":"2024-01-22T05:04:39.120120+0000","last_clean":"2024-01-22T05:04:39.120120+0000","last_became_active":"2024-01-22T05:04:39.107762+0000","last_became_peered":"2024-01-22T05:04:39.107762+0000","last_unstale":"2024-01-22T05:04:39.120120+0000","last_undegraded":"2024-01-22T05:04:39.120120+0000","last_fullsized":"2024-01-22T05:04:39.120120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091889+0000","last_change":"2024-01-22T05:04:34.615318+0000","last_active":"2024-01-22T05:04:39.091889+0000","last_peered":"2024-01-22T05:04:39.091889+0000","last_clean":"2024-01-22T05:04:39.091889+0000","last_became_active":"2024-01-22T05:04:34.609702+0000","last_became_peered":"2024-01-22T05:04:34.609702+0000","last_unstale":"2024-01-22T05:04:39.091889+0000","last_undegraded":"2024-01-22T05:04:39.091889+0000","last_fullsized":"2024-01-22T05:04:39.091889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070678+0000","last_change":"2024-01-22T05:04:35.042388+0000","last_active":"2024-01-22T05:04:39.070678+0000","last_peered":"2024-01-22T05:04:39.070678+0000","last_clean":"2024-01-22T05:04:39.070678+0000","last_became_active":"2024-01-22T05:04:35.041995+0000","last_became_peered":"2024-01-22T05:04:35.041995+0000","last_unstale":"2024-01-22T05:04:39.070678+0000","last_undegraded":"2024-01-22T05:04:39.070678+0000","last_fullsized":"2024-01-22T05:04:39.070678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.095146+0000","last_change":"2024-01-22T05:04:39.091003+0000","last_active":"2024-01-22T05:04:39.095146+0000","last_peered":"2024-01-22T05:04:39.095146+0000","last_clean":"2024-01-22T05:04:39.095146+0000","last_became_active":"2024-01-22T05:04:39.090439+0000","last_became_peered":"2024-01-22T05:04:39.090439+0000","last_unstale":"2024-01-22T05:04:39.095146+0000","last_undegraded":"2024-01-22T05:04:39.095146+0000","last_fullsized":"2024-01-22T05:04:39.095146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071709+0000","last_change":"2024-01-22T05:04:34.618944+0000","last_active":"2024-01-22T05:04:39.071709+0000","last_peered":"2024-01-22T05:04:39.071709+0000","last_clean":"2024-01-22T05:04:39.071709+0000","last_became_active":"2024-01-22T05:04:34.618671+0000","last_became_peered":"2024-01-22T05:04:34.618671+0000","last_unstale":"2024-01-22T05:04:39.071709+0000","last_undegraded":"2024-01-22T05:04:39.071709+0000","last_fullsized":"2024-01-22T05:04:39.071709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.084520+0000","last_change":"2024-01-22T05:04:35.057293+0000","last_active":"2024-01-22T05:04:39.084520+0000","last_peered":"2024-01-22T05:04:39.084520+0000","last_clean":"2024-01-22T05:04:39.084520+0000","last_became_active":"2024-01-22T05:04:35.054936+0000","last_became_peered":"2024-01-22T05:04:35.054936+0000","last_unstale":"2024-01-22T05:04:39.084520+0000","last_undegraded":"2024-01-22T05:04:39.084520+0000","last_fullsized":"2024-01-22T05:04:39.084520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.098476+0000","last_change":"2024-01-22T05:04:39.096209+0000","last_active":"2024-01-22T05:04:39.098476+0000","last_peered":"2024-01-22T05:04:39.098476+0000","last_clean":"2024-01-22T05:04:39.098476+0000","last_became_active":"2024-01-22T05:04:39.095774+0000","last_became_peered":"2024-01-22T05:04:39.095774+0000","last_unstale":"2024-01-22T05:04:39.098476+0000","last_undegraded":"2024-01-22T05:04:39.098476+0000","last_fullsized":"2024-01-22T05:04:39.098476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101268+0000","last_change":"2024-01-22T05:04:34.618376+0000","last_active":"2024-01-22T05:04:39.101268+0000","last_peered":"2024-01-22T05:04:39.101268+0000","last_clean":"2024-01-22T05:04:39.101268+0000","last_became_active":"2024-01-22T05:04:34.618050+0000","last_became_peered":"2024-01-22T05:04:34.618050+0000","last_unstale":"2024-01-22T05:04:39.101268+0000","last_undegraded":"2024-01-22T05:04:39.101268+0000","last_fullsized":"2024-01-22T05:04:39.101268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092655+0000","last_change":"2024-01-22T05:04:35.066609+0000","last_active":"2024-01-22T05:04:39.092655+0000","last_peered":"2024-01-22T05:04:39.092655+0000","last_clean":"2024-01-22T05:04:39.092655+0000","last_became_active":"2024-01-22T05:04:35.066264+0000","last_became_peered":"2024-01-22T05:04:35.066264+0000","last_unstale":"2024-01-22T05:04:39.092655+0000","last_undegraded":"2024-01-22T05:04:39.092655+0000","last_fullsized":"2024-01-22T05:04:39.092655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107734+0000","last_change":"2024-01-22T05:04:39.101032+0000","last_active":"2024-01-22T05:04:39.107734+0000","last_peered":"2024-01-22T05:04:39.107734+0000","last_clean":"2024-01-22T05:04:39.107734+0000","last_became_active":"2024-01-22T05:04:39.100632+0000","last_became_peered":"2024-01-22T05:04:39.100632+0000","last_unstale":"2024-01-22T05:04:39.107734+0000","last_undegraded":"2024-01-22T05:04:39.107734+0000","last_fullsized":"2024-01-22T05:04:39.107734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078768+0000","last_change":"2024-01-22T05:04:34.600852+0000","last_active":"2024-01-22T05:04:39.078768+0000","last_peered":"2024-01-22T05:04:39.078768+0000","last_clean":"2024-01-22T05:04:39.078768+0000","last_became_active":"2024-01-22T05:04:34.600549+0000","last_became_peered":"2024-01-22T05:04:34.600549+0000","last_unstale":"2024-01-22T05:04:39.078768+0000","last_undegraded":"2024-01-22T05:04:39.078768+0000","last_fullsized":"2024-01-22T05:04:39.078768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.094690+0000","last_change":"2024-01-22T05:04:35.048337+0000","last_active":"2024-01-22T05:04:39.094690+0000","last_peered":"2024-01-22T05:04:39.094690+0000","last_clean":"2024-01-22T05:04:39.094690+0000","last_became_active":"2024-01-22T05:04:35.048075+0000","last_became_peered":"2024-01-22T05:04:35.048075+0000","last_unstale":"2024-01-22T05:04:39.094690+0000","last_undegraded":"2024-01-22T05:04:39.094690+0000","last_fullsized":"2024-01-22T05:04:39.094690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.100793+0000","last_change":"2024-01-22T05:04:39.099916+0000","last_active":"2024-01-22T05:04:39.100793+0000","last_peered":"2024-01-22T05:04:39.100793+0000","last_clean":"2024-01-22T05:04:39.100793+0000","last_became_active":"2024-01-22T05:04:39.097629+0000","last_became_peered":"2024-01-22T05:04:39.097629+0000","last_unstale":"2024-01-22T05:04:39.100793+0000","last_undegraded":"2024-01-22T05:04:39.100793+0000","last_fullsized":"2024-01-22T05:04:39.100793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091544+0000","last_change":"2024-01-22T05:04:34.605586+0000","last_active":"2024-01-22T05:04:39.091544+0000","last_peered":"2024-01-22T05:04:39.091544+0000","last_clean":"2024-01-22T05:04:39.091544+0000","last_became_active":"2024-01-22T05:04:34.605258+0000","last_became_peered":"2024-01-22T05:04:34.605258+0000","last_unstale":"2024-01-22T05:04:39.091544+0000","last_undegraded":"2024-01-22T05:04:39.091544+0000","last_fullsized":"2024-01-22T05:04:39.091544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078565+0000","last_change":"2024-01-22T05:04:35.063054+0000","last_active":"2024-01-22T05:04:39.078565+0000","last_peered":"2024-01-22T05:04:39.078565+0000","last_clean":"2024-01-22T05:04:39.078565+0000","last_became_active":"2024-01-22T05:04:35.062800+0000","last_became_peered":"2024-01-22T05:04:35.062800+0000","last_unstale":"2024-01-22T05:04:39.078565+0000","last_undegraded":"2024-01-22T05:04:39.078565+0000","last_fullsized":"2024-01-22T05:04:39.078565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.108862+0000","last_change":"2024-01-22T05:04:39.106490+0000","last_active":"2024-01-22T05:04:39.108862+0000","last_peered":"2024-01-22T05:04:39.108862+0000","last_clean":"2024-01-22T05:04:39.108862+0000","last_became_active":"2024-01-22T05:04:39.106108+0000","last_became_peered":"2024-01-22T05:04:39.106108+0000","last_unstale":"2024-01-22T05:04:39.108862+0000","last_undegraded":"2024-01-22T05:04:39.108862+0000","last_fullsized":"2024-01-22T05:04:39.108862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082736+0000","last_change":"2024-01-22T05:04:34.611849+0000","last_active":"2024-01-22T05:04:39.082736+0000","last_peered":"2024-01-22T05:04:39.082736+0000","last_clean":"2024-01-22T05:04:39.082736+0000","last_became_active":"2024-01-22T05:04:34.611571+0000","last_became_peered":"2024-01-22T05:04:34.611571+0000","last_unstale":"2024-01-22T05:04:39.082736+0000","last_undegraded":"2024-01-22T05:04:39.082736+0000","last_fullsized":"2024-01-22T05:04:39.082736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087897+0000","last_change":"2024-01-22T05:04:35.059209+0000","last_active":"2024-01-22T05:04:39.087897+0000","last_peered":"2024-01-22T05:04:39.087897+0000","last_clean":"2024-01-22T05:04:39.087897+0000","last_became_active":"2024-01-22T05:04:35.058481+0000","last_became_peered":"2024-01-22T05:04:35.058481+0000","last_unstale":"2024-01-22T05:04:39.087897+0000","last_undegraded":"2024-01-22T05:04:39.087897+0000","last_fullsized":"2024-01-22T05:04:39.087897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107238+0000","last_change":"2024-01-22T05:04:39.100104+0000","last_active":"2024-01-22T05:04:39.107238+0000","last_peered":"2024-01-22T05:04:39.107238+0000","last_clean":"2024-01-22T05:04:39.107238+0000","last_became_active":"2024-01-22T05:04:39.099678+0000","last_became_peered":"2024-01-22T05:04:39.099678+0000","last_unstale":"2024-01-22T05:04:39.107238+0000","last_undegraded":"2024-01-22T05:04:39.107238+0000","last_fullsized":"2024-01-22T05:04:39.107238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091440+0000","last_change":"2024-01-22T05:04:34.605902+0000","last_active":"2024-01-22T05:04:39.091440+0000","last_peered":"2024-01-22T05:04:39.091440+0000","last_clean":"2024-01-22T05:04:39.091440+0000","last_became_active":"2024-01-22T05:04:34.605565+0000","last_became_peered":"2024-01-22T05:04:34.605565+0000","last_unstale":"2024-01-22T05:04:39.091440+0000","last_undegraded":"2024-01-22T05:04:39.091440+0000","last_fullsized":"2024-01-22T05:04:39.091440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101579+0000","last_change":"2024-01-22T05:04:35.057060+0000","last_active":"2024-01-22T05:04:39.101579+0000","last_peered":"2024-01-22T05:04:39.101579+0000","last_clean":"2024-01-22T05:04:39.101579+0000","last_became_active":"2024-01-22T05:04:35.052366+0000","last_became_peered":"2024-01-22T05:04:35.052366+0000","last_unstale":"2024-01-22T05:04:39.101579+0000","last_undegraded":"2024-01-22T05:04:39.101579+0000","last_fullsized":"2024-01-22T05:04:39.101579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119060+0000","last_change":"2024-01-22T05:04:39.112388+0000","last_active":"2024-01-22T05:04:39.119060+0000","last_peered":"2024-01-22T05:04:39.119060+0000","last_clean":"2024-01-22T05:04:39.119060+0000","last_became_active":"2024-01-22T05:04:39.112008+0000","last_became_peered":"2024-01-22T05:04:39.112008+0000","last_unstale":"2024-01-22T05:04:39.119060+0000","last_undegraded":"2024-01-22T05:04:39.119060+0000","last_fullsized":"2024-01-22T05:04:39.119060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073424+0000","last_change":"2024-01-22T05:04:34.613609+0000","last_active":"2024-01-22T05:04:39.073424+0000","last_peered":"2024-01-22T05:04:39.073424+0000","last_clean":"2024-01-22T05:04:39.073424+0000","last_became_active":"2024-01-22T05:04:34.613113+0000","last_became_peered":"2024-01-22T05:04:34.613113+0000","last_unstale":"2024-01-22T05:04:39.073424+0000","last_undegraded":"2024-01-22T05:04:39.073424+0000","last_fullsized":"2024-01-22T05:04:39.073424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071728+0000","last_change":"2024-01-22T05:04:35.055447+0000","last_active":"2024-01-22T05:04:39.071728+0000","last_peered":"2024-01-22T05:04:39.071728+0000","last_clean":"2024-01-22T05:04:39.071728+0000","last_became_active":"2024-01-22T05:04:35.047320+0000","last_became_peered":"2024-01-22T05:04:35.047320+0000","last_unstale":"2024-01-22T05:04:39.071728+0000","last_undegraded":"2024-01-22T05:04:39.071728+0000","last_fullsized":"2024-01-22T05:04:39.071728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.113249+0000","last_change":"2024-01-22T05:04:39.111233+0000","last_active":"2024-01-22T05:04:39.113249+0000","last_peered":"2024-01-22T05:04:39.113249+0000","last_clean":"2024-01-22T05:04:39.113249+0000","last_became_active":"2024-01-22T05:04:39.108755+0000","last_became_peered":"2024-01-22T05:04:39.108755+0000","last_unstale":"2024-01-22T05:04:39.113249+0000","last_undegraded":"2024-01-22T05:04:39.113249+0000","last_fullsized":"2024-01-22T05:04:39.113249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.094775+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:04:39.094775+0000","last_peered":"2024-01-22T05:04:39.094775+0000","last_clean":"2024-01-22T05:04:39.094775+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:04:39.094775+0000","last_undegraded":"2024-01-22T05:04:39.094775+0000","last_fullsized":"2024-01-22T05:04:39.094775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092517+0000","last_change":"2024-01-22T05:04:34.613912+0000","last_active":"2024-01-22T05:04:39.092517+0000","last_peered":"2024-01-22T05:04:39.092517+0000","last_clean":"2024-01-22T05:04:39.092517+0000","last_became_active":"2024-01-22T05:04:34.612145+0000","last_became_peered":"2024-01-22T05:04:34.612145+0000","last_unstale":"2024-01-22T05:04:39.092517+0000","last_undegraded":"2024-01-22T05:04:39.092517+0000","last_fullsized":"2024-01-22T05:04:39.092517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072061+0000","last_change":"2024-01-22T05:04:35.056830+0000","last_active":"2024-01-22T05:04:39.072061+0000","last_peered":"2024-01-22T05:04:39.072061+0000","last_clean":"2024-01-22T05:04:39.072061+0000","last_became_active":"2024-01-22T05:04:35.054433+0000","last_became_peered":"2024-01-22T05:04:35.054433+0000","last_unstale":"2024-01-22T05:04:39.072061+0000","last_undegraded":"2024-01-22T05:04:39.072061+0000","last_fullsized":"2024-01-22T05:04:39.072061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.109522+0000","last_change":"2024-01-22T05:04:39.104407+0000","last_active":"2024-01-22T05:04:39.109522+0000","last_peered":"2024-01-22T05:04:39.109522+0000","last_clean":"2024-01-22T05:04:39.109522+0000","last_became_active":"2024-01-22T05:04:39.103894+0000","last_became_peered":"2024-01-22T05:04:39.103894+0000","last_unstale":"2024-01-22T05:04:39.109522+0000","last_undegraded":"2024-01-22T05:04:39.109522+0000","last_fullsized":"2024-01-22T05:04:39.109522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.111694+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:04:39.111694+0000","last_peered":"2024-01-22T05:04:39.111694+0000","last_clean":"2024-01-22T05:04:39.111694+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:04:39.111694+0000","last_undegraded":"2024-01-22T05:04:39.111694+0000","last_fullsized":"2024-01-22T05:04:39.111694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.086118+0000","last_change":"2024-01-22T05:04:34.607413+0000","last_active":"2024-01-22T05:04:39.086118+0000","last_peered":"2024-01-22T05:04:39.086118+0000","last_clean":"2024-01-22T05:04:39.086118+0000","last_became_active":"2024-01-22T05:04:34.606865+0000","last_became_peered":"2024-01-22T05:04:34.606865+0000","last_unstale":"2024-01-22T05:04:39.086118+0000","last_undegraded":"2024-01-22T05:04:39.086118+0000","last_fullsized":"2024-01-22T05:04:39.086118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078381+0000","last_change":"2024-01-22T05:04:35.066781+0000","last_active":"2024-01-22T05:04:39.078381+0000","last_peered":"2024-01-22T05:04:39.078381+0000","last_clean":"2024-01-22T05:04:39.078381+0000","last_became_active":"2024-01-22T05:04:35.066462+0000","last_became_peered":"2024-01-22T05:04:35.066462+0000","last_unstale":"2024-01-22T05:04:39.078381+0000","last_undegraded":"2024-01-22T05:04:39.078381+0000","last_fullsized":"2024-01-22T05:04:39.078381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103937+0000","last_change":"2024-01-22T05:04:39.101743+0000","last_active":"2024-01-22T05:04:39.103937+0000","last_peered":"2024-01-22T05:04:39.103937+0000","last_clean":"2024-01-22T05:04:39.103937+0000","last_became_active":"2024-01-22T05:04:39.100970+0000","last_became_peered":"2024-01-22T05:04:39.100970+0000","last_unstale":"2024-01-22T05:04:39.103937+0000","last_undegraded":"2024-01-22T05:04:39.103937+0000","last_fullsized":"2024-01-22T05:04:39.103937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091262+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:04:39.091262+0000","last_peered":"2024-01-22T05:04:39.091262+0000","last_clean":"2024-01-22T05:04:39.091262+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:04:39.091262+0000","last_undegraded":"2024-01-22T05:04:39.091262+0000","last_fullsized":"2024-01-22T05:04:39.091262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104174+0000","last_change":"2024-01-22T05:04:34.606188+0000","last_active":"2024-01-22T05:04:39.104174+0000","last_peered":"2024-01-22T05:04:39.104174+0000","last_clean":"2024-01-22T05:04:39.104174+0000","last_became_active":"2024-01-22T05:04:34.605902+0000","last_became_peered":"2024-01-22T05:04:34.605902+0000","last_unstale":"2024-01-22T05:04:39.104174+0000","last_undegraded":"2024-01-22T05:04:39.104174+0000","last_fullsized":"2024-01-22T05:04:39.104174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091318+0000","last_change":"2024-01-22T05:04:35.048169+0000","last_active":"2024-01-22T05:04:39.091318+0000","last_peered":"2024-01-22T05:04:39.091318+0000","last_clean":"2024-01-22T05:04:39.091318+0000","last_became_active":"2024-01-22T05:04:35.047797+0000","last_became_peered":"2024-01-22T05:04:35.047797+0000","last_unstale":"2024-01-22T05:04:39.091318+0000","last_undegraded":"2024-01-22T05:04:39.091318+0000","last_fullsized":"2024-01-22T05:04:39.091318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103229+0000","last_change":"2024-01-22T05:04:39.095494+0000","last_active":"2024-01-22T05:04:39.103229+0000","last_peered":"2024-01-22T05:04:39.103229+0000","last_clean":"2024-01-22T05:04:39.103229+0000","last_became_active":"2024-01-22T05:04:39.094639+0000","last_became_peered":"2024-01-22T05:04:39.094639+0000","last_unstale":"2024-01-22T05:04:39.103229+0000","last_undegraded":"2024-01-22T05:04:39.103229+0000","last_fullsized":"2024-01-22T05:04:39.103229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104333+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:04:39.104333+0000","last_peered":"2024-01-22T05:04:39.104333+0000","last_clean":"2024-01-22T05:04:39.104333+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:04:39.104333+0000","last_undegraded":"2024-01-22T05:04:39.104333+0000","last_fullsized":"2024-01-22T05:04:39.104333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082413+0000","last_change":"2024-01-22T05:04:34.614897+0000","last_active":"2024-01-22T05:04:39.082413+0000","last_peered":"2024-01-22T05:04:39.082413+0000","last_clean":"2024-01-22T05:04:39.082413+0000","last_became_active":"2024-01-22T05:04:34.611793+0000","last_became_peered":"2024-01-22T05:04:34.611793+0000","last_unstale":"2024-01-22T05:04:39.082413+0000","last_undegraded":"2024-01-22T05:04:39.082413+0000","last_fullsized":"2024-01-22T05:04:39.082413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101671+0000","last_change":"2024-01-22T05:04:35.037716+0000","last_active":"2024-01-22T05:04:39.101671+0000","last_peered":"2024-01-22T05:04:39.101671+0000","last_clean":"2024-01-22T05:04:39.101671+0000","last_became_active":"2024-01-22T05:04:35.037443+0000","last_became_peered":"2024-01-22T05:04:35.037443+0000","last_unstale":"2024-01-22T05:04:39.101671+0000","last_undegraded":"2024-01-22T05:04:39.101671+0000","last_fullsized":"2024-01-22T05:04:39.101671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.114339+0000","last_change":"2024-01-22T05:04:39.110687+0000","last_active":"2024-01-22T05:04:39.114339+0000","last_peered":"2024-01-22T05:04:39.114339+0000","last_clean":"2024-01-22T05:04:39.114339+0000","last_became_active":"2024-01-22T05:04:39.109377+0000","last_became_peered":"2024-01-22T05:04:39.109377+0000","last_unstale":"2024-01-22T05:04:39.114339+0000","last_undegraded":"2024-01-22T05:04:39.114339+0000","last_fullsized":"2024-01-22T05:04:39.114339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071921+0000","last_change":"2024-01-22T05:04:34.599538+0000","last_active":"2024-01-22T05:04:39.071921+0000","last_peered":"2024-01-22T05:04:39.071921+0000","last_clean":"2024-01-22T05:04:39.071921+0000","last_became_active":"2024-01-22T05:04:34.599188+0000","last_became_peered":"2024-01-22T05:04:34.599188+0000","last_unstale":"2024-01-22T05:04:39.071921+0000","last_undegraded":"2024-01-22T05:04:39.071921+0000","last_fullsized":"2024-01-22T05:04:39.071921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077580+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:04:39.077580+0000","last_peered":"2024-01-22T05:04:39.077580+0000","last_clean":"2024-01-22T05:04:39.077580+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:04:39.077580+0000","last_undegraded":"2024-01-22T05:04:39.077580+0000","last_fullsized":"2024-01-22T05:04:39.077580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104088+0000","last_change":"2024-01-22T05:04:35.038500+0000","last_active":"2024-01-22T05:04:39.104088+0000","last_peered":"2024-01-22T05:04:39.104088+0000","last_clean":"2024-01-22T05:04:39.104088+0000","last_became_active":"2024-01-22T05:04:35.038140+0000","last_became_peered":"2024-01-22T05:04:35.038140+0000","last_unstale":"2024-01-22T05:04:39.104088+0000","last_undegraded":"2024-01-22T05:04:39.104088+0000","last_fullsized":"2024-01-22T05:04:39.104088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119739+0000","last_change":"2024-01-22T05:04:39.116907+0000","last_active":"2024-01-22T05:04:39.119739+0000","last_peered":"2024-01-22T05:04:39.119739+0000","last_clean":"2024-01-22T05:04:39.119739+0000","last_became_active":"2024-01-22T05:04:39.116486+0000","last_became_peered":"2024-01-22T05:04:39.116486+0000","last_unstale":"2024-01-22T05:04:39.119739+0000","last_undegraded":"2024-01-22T05:04:39.119739+0000","last_fullsized":"2024-01-22T05:04:39.119739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101316+0000","last_change":"2024-01-22T05:04:34.615907+0000","last_active":"2024-01-22T05:04:39.101316+0000","last_peered":"2024-01-22T05:04:39.101316+0000","last_clean":"2024-01-22T05:04:39.101316+0000","last_became_active":"2024-01-22T05:04:34.615598+0000","last_became_peered":"2024-01-22T05:04:34.615598+0000","last_unstale":"2024-01-22T05:04:39.101316+0000","last_undegraded":"2024-01-22T05:04:39.101316+0000","last_fullsized":"2024-01-22T05:04:39.101316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.069623+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:04:39.069623+0000","last_peered":"2024-01-22T05:04:39.069623+0000","last_clean":"2024-01-22T05:04:39.069623+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:04:39.069623+0000","last_undegraded":"2024-01-22T05:04:39.069623+0000","last_fullsized":"2024-01-22T05:04:39.069623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.115610+0000","last_change":"2024-01-22T05:04:35.038846+0000","last_active":"2024-01-22T05:04:39.115610+0000","last_peered":"2024-01-22T05:04:39.115610+0000","last_clean":"2024-01-22T05:04:39.115610+0000","last_became_active":"2024-01-22T05:04:35.038166+0000","last_became_peered":"2024-01-22T05:04:35.038166+0000","last_unstale":"2024-01-22T05:04:39.115610+0000","last_undegraded":"2024-01-22T05:04:39.115610+0000","last_fullsized":"2024-01-22T05:04:39.115610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.117398+0000","last_change":"2024-01-22T05:04:39.115986+0000","last_active":"2024-01-22T05:04:39.117398+0000","last_peered":"2024-01-22T05:04:39.117398+0000","last_clean":"2024-01-22T05:04:39.117398+0000","last_became_active":"2024-01-22T05:04:39.115151+0000","last_became_peered":"2024-01-22T05:04:39.115151+0000","last_unstale":"2024-01-22T05:04:39.117398+0000","last_undegraded":"2024-01-22T05:04:39.117398+0000","last_fullsized":"2024-01-22T05:04:39.117398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087798+0000","last_change":"2024-01-22T05:04:34.609174+0000","last_active":"2024-01-22T05:04:39.087798+0000","last_peered":"2024-01-22T05:04:39.087798+0000","last_clean":"2024-01-22T05:04:39.087798+0000","last_became_active":"2024-01-22T05:04:34.608868+0000","last_became_peered":"2024-01-22T05:04:34.608868+0000","last_unstale":"2024-01-22T05:04:39.087798+0000","last_undegraded":"2024-01-22T05:04:39.087798+0000","last_fullsized":"2024-01-22T05:04:39.087798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087902+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:04:39.087902+0000","last_peered":"2024-01-22T05:04:39.087902+0000","last_clean":"2024-01-22T05:04:39.087902+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:04:39.087902+0000","last_undegraded":"2024-01-22T05:04:39.087902+0000","last_fullsized":"2024-01-22T05:04:39.087902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092366+0000","last_change":"2024-01-22T05:04:35.049694+0000","last_active":"2024-01-22T05:04:39.092366+0000","last_peered":"2024-01-22T05:04:39.092366+0000","last_clean":"2024-01-22T05:04:39.092366+0000","last_became_active":"2024-01-22T05:04:35.048722+0000","last_became_peered":"2024-01-22T05:04:35.048722+0000","last_unstale":"2024-01-22T05:04:39.092366+0000","last_undegraded":"2024-01-22T05:04:39.092366+0000","last_fullsized":"2024-01-22T05:04:39.092366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.106875+0000","last_change":"2024-01-22T05:04:39.103272+0000","last_active":"2024-01-22T05:04:39.106875+0000","last_peered":"2024-01-22T05:04:39.106875+0000","last_clean":"2024-01-22T05:04:39.106875+0000","last_became_active":"2024-01-22T05:04:39.102710+0000","last_became_peered":"2024-01-22T05:04:39.102710+0000","last_unstale":"2024-01-22T05:04:39.106875+0000","last_undegraded":"2024-01-22T05:04:39.106875+0000","last_fullsized":"2024-01-22T05:04:39.106875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082591+0000","last_change":"2024-01-22T05:04:34.621934+0000","last_active":"2024-01-22T05:04:39.082591+0000","last_peered":"2024-01-22T05:04:39.082591+0000","last_clean":"2024-01-22T05:04:39.082591+0000","last_became_active":"2024-01-22T05:04:34.621531+0000","last_became_peered":"2024-01-22T05:04:34.621531+0000","last_unstale":"2024-01-22T05:04:39.082591+0000","last_undegraded":"2024-01-22T05:04:39.082591+0000","last_fullsized":"2024-01-22T05:04:39.082591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.080271+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:04:39.080271+0000","last_peered":"2024-01-22T05:04:39.080271+0000","last_clean":"2024-01-22T05:04:39.080271+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:04:39.080271+0000","last_undegraded":"2024-01-22T05:04:39.080271+0000","last_fullsized":"2024-01-22T05:04:39.080271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087998+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:04:39.087998+0000","last_peered":"2024-01-22T05:04:39.087998+0000","last_clean":"2024-01-22T05:04:39.087998+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:04:39.087998+0000","last_undegraded":"2024-01-22T05:04:39.087998+0000","last_fullsized":"2024-01-22T05:04:39.087998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092360+0000","last_change":"2024-01-22T05:04:35.062222+0000","last_active":"2024-01-22T05:04:39.092360+0000","last_peered":"2024-01-22T05:04:39.092360+0000","last_clean":"2024-01-22T05:04:39.092360+0000","last_became_active":"2024-01-22T05:04:35.061909+0000","last_became_peered":"2024-01-22T05:04:35.061909+0000","last_unstale":"2024-01-22T05:04:39.092360+0000","last_undegraded":"2024-01-22T05:04:39.092360+0000","last_fullsized":"2024-01-22T05:04:39.092360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103574+0000","last_change":"2024-01-22T05:04:39.097762+0000","last_active":"2024-01-22T05:04:39.103574+0000","last_peered":"2024-01-22T05:04:39.103574+0000","last_clean":"2024-01-22T05:04:39.103574+0000","last_became_active":"2024-01-22T05:04:39.097387+0000","last_became_peered":"2024-01-22T05:04:39.097387+0000","last_unstale":"2024-01-22T05:04:39.103574+0000","last_undegraded":"2024-01-22T05:04:39.103574+0000","last_fullsized":"2024-01-22T05:04:39.103574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078865+0000","last_change":"2024-01-22T05:04:34.618785+0000","last_active":"2024-01-22T05:04:39.078865+0000","last_peered":"2024-01-22T05:04:39.078865+0000","last_clean":"2024-01-22T05:04:39.078865+0000","last_became_active":"2024-01-22T05:04:34.618434+0000","last_became_peered":"2024-01-22T05:04:34.618434+0000","last_unstale":"2024-01-22T05:04:39.078865+0000","last_undegraded":"2024-01-22T05:04:39.078865+0000","last_fullsized":"2024-01-22T05:04:39.078865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.115520+0000","last_change":"2024-01-22T05:04:35.053526+0000","last_active":"2024-01-22T05:04:39.115520+0000","last_peered":"2024-01-22T05:04:39.115520+0000","last_clean":"2024-01-22T05:04:39.115520+0000","last_became_active":"2024-01-22T05:04:35.053256+0000","last_became_peered":"2024-01-22T05:04:35.053256+0000","last_unstale":"2024-01-22T05:04:39.115520+0000","last_undegraded":"2024-01-22T05:04:39.115520+0000","last_fullsized":"2024-01-22T05:04:39.115520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087821+0000","last_change":"2024-01-22T05:04:39.085964+0000","last_active":"2024-01-22T05:04:39.087821+0000","last_peered":"2024-01-22T05:04:39.087821+0000","last_clean":"2024-01-22T05:04:39.087821+0000","last_became_active":"2024-01-22T05:04:39.085535+0000","last_became_peered":"2024-01-22T05:04:39.085535+0000","last_unstale":"2024-01-22T05:04:39.087821+0000","last_undegraded":"2024-01-22T05:04:39.087821+0000","last_fullsized":"2024-01-22T05:04:39.087821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072213+0000","last_change":"2024-01-22T05:04:34.606362+0000","last_active":"2024-01-22T05:04:39.072213+0000","last_peered":"2024-01-22T05:04:39.072213+0000","last_clean":"2024-01-22T05:04:39.072213+0000","last_became_active":"2024-01-22T05:04:34.606055+0000","last_became_peered":"2024-01-22T05:04:34.606055+0000","last_unstale":"2024-01-22T05:04:39.072213+0000","last_undegraded":"2024-01-22T05:04:39.072213+0000","last_fullsized":"2024-01-22T05:04:39.072213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073421+0000","last_change":"2024-01-22T05:04:35.058051+0000","last_active":"2024-01-22T05:04:39.073421+0000","last_peered":"2024-01-22T05:04:39.073421+0000","last_clean":"2024-01-22T05:04:39.073421+0000","last_became_active":"2024-01-22T05:04:35.057790+0000","last_became_peered":"2024-01-22T05:04:35.057790+0000","last_unstale":"2024-01-22T05:04:39.073421+0000","last_undegraded":"2024-01-22T05:04:39.073421+0000","last_fullsized":"2024-01-22T05:04:39.073421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.116871+0000","last_change":"2024-01-22T05:04:39.106800+0000","last_active":"2024-01-22T05:04:39.116871+0000","last_peered":"2024-01-22T05:04:39.116871+0000","last_clean":"2024-01-22T05:04:39.116871+0000","last_became_active":"2024-01-22T05:04:39.106323+0000","last_became_peered":"2024-01-22T05:04:39.106323+0000","last_unstale":"2024-01-22T05:04:39.116871+0000","last_undegraded":"2024-01-22T05:04:39.116871+0000","last_fullsized":"2024-01-22T05:04:39.116871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091150+0000","last_change":"2024-01-22T05:04:34.612849+0000","last_active":"2024-01-22T05:04:39.091150+0000","last_peered":"2024-01-22T05:04:39.091150+0000","last_clean":"2024-01-22T05:04:39.091150+0000","last_became_active":"2024-01-22T05:04:34.612516+0000","last_became_peered":"2024-01-22T05:04:34.612516+0000","last_unstale":"2024-01-22T05:04:39.091150+0000","last_undegraded":"2024-01-22T05:04:39.091150+0000","last_fullsized":"2024-01-22T05:04:39.091150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073015+0000","last_change":"2024-01-22T05:04:35.052723+0000","last_active":"2024-01-22T05:04:39.073015+0000","last_peered":"2024-01-22T05:04:39.073015+0000","last_clean":"2024-01-22T05:04:39.073015+0000","last_became_active":"2024-01-22T05:04:35.051494+0000","last_became_peered":"2024-01-22T05:04:35.051494+0000","last_unstale":"2024-01-22T05:04:39.073015+0000","last_undegraded":"2024-01-22T05:04:39.073015+0000","last_fullsized":"2024-01-22T05:04:39.073015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104928+0000","last_change":"2024-01-22T05:04:39.101428+0000","last_active":"2024-01-22T05:04:39.104928+0000","last_peered":"2024-01-22T05:04:39.104928+0000","last_clean":"2024-01-22T05:04:39.104928+0000","last_became_active":"2024-01-22T05:04:39.100920+0000","last_became_peered":"2024-01-22T05:04:39.100920+0000","last_unstale":"2024-01-22T05:04:39.104928+0000","last_undegraded":"2024-01-22T05:04:39.104928+0000","last_fullsized":"2024-01-22T05:04:39.104928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.083763+0000","last_change":"2024-01-22T05:04:34.602186+0000","last_active":"2024-01-22T05:04:39.083763+0000","last_peered":"2024-01-22T05:04:39.083763+0000","last_clean":"2024-01-22T05:04:39.083763+0000","last_became_active":"2024-01-22T05:04:34.601827+0000","last_became_peered":"2024-01-22T05:04:34.601827+0000","last_unstale":"2024-01-22T05:04:39.083763+0000","last_undegraded":"2024-01-22T05:04:39.083763+0000","last_fullsized":"2024-01-22T05:04:39.083763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073177+0000","last_change":"2024-01-22T05:04:35.054388+0000","last_active":"2024-01-22T05:04:39.073177+0000","last_peered":"2024-01-22T05:04:39.073177+0000","last_clean":"2024-01-22T05:04:39.073177+0000","last_became_active":"2024-01-22T05:04:35.054183+0000","last_became_peered":"2024-01-22T05:04:35.054183+0000","last_unstale":"2024-01-22T05:04:39.073177+0000","last_undegraded":"2024-01-22T05:04:39.073177+0000","last_fullsized":"2024-01-22T05:04:39.073177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107631+0000","last_change":"2024-01-22T05:04:39.102774+0000","last_active":"2024-01-22T05:04:39.107631+0000","last_peered":"2024-01-22T05:04:39.107631+0000","last_clean":"2024-01-22T05:04:39.107631+0000","last_became_active":"2024-01-22T05:04:39.102291+0000","last_became_peered":"2024-01-22T05:04:39.102291+0000","last_unstale":"2024-01-22T05:04:39.107631+0000","last_undegraded":"2024-01-22T05:04:39.107631+0000","last_fullsized":"2024-01-22T05:04:39.107631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.080482+0000","last_change":"2024-01-22T05:04:34.608068+0000","last_active":"2024-01-22T05:04:39.080482+0000","last_peered":"2024-01-22T05:04:39.080482+0000","last_clean":"2024-01-22T05:04:39.080482+0000","last_became_active":"2024-01-22T05:04:34.607482+0000","last_became_peered":"2024-01-22T05:04:34.607482+0000","last_unstale":"2024-01-22T05:04:39.080482+0000","last_undegraded":"2024-01-22T05:04:39.080482+0000","last_fullsized":"2024-01-22T05:04:39.080482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091190+0000","last_change":"2024-01-22T05:04:35.045213+0000","last_active":"2024-01-22T05:04:39.091190+0000","last_peered":"2024-01-22T05:04:39.091190+0000","last_clean":"2024-01-22T05:04:39.091190+0000","last_became_active":"2024-01-22T05:04:35.044882+0000","last_became_peered":"2024-01-22T05:04:35.044882+0000","last_unstale":"2024-01-22T05:04:39.091190+0000","last_undegraded":"2024-01-22T05:04:39.091190+0000","last_fullsized":"2024-01-22T05:04:39.091190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107871+0000","last_change":"2024-01-22T05:04:39.103229+0000","last_active":"2024-01-22T05:04:39.107871+0000","last_peered":"2024-01-22T05:04:39.107871+0000","last_clean":"2024-01-22T05:04:39.107871+0000","last_became_active":"2024-01-22T05:04:39.102798+0000","last_became_peered":"2024-01-22T05:04:39.102798+0000","last_unstale":"2024-01-22T05:04:39.107871+0000","last_undegraded":"2024-01-22T05:04:39.107871+0000","last_fullsized":"2024-01-22T05:04:39.107871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091000+0000","last_change":"2024-01-22T05:04:34.612506+0000","last_active":"2024-01-22T05:04:39.091000+0000","last_peered":"2024-01-22T05:04:39.091000+0000","last_clean":"2024-01-22T05:04:39.091000+0000","last_became_active":"2024-01-22T05:04:34.612255+0000","last_became_peered":"2024-01-22T05:04:34.612255+0000","last_unstale":"2024-01-22T05:04:39.091000+0000","last_undegraded":"2024-01-22T05:04:39.091000+0000","last_fullsized":"2024-01-22T05:04:39.091000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090985+0000","last_change":"2024-01-22T05:04:35.048108+0000","last_active":"2024-01-22T05:04:39.090985+0000","last_peered":"2024-01-22T05:04:39.090985+0000","last_clean":"2024-01-22T05:04:39.090985+0000","last_became_active":"2024-01-22T05:04:35.047784+0000","last_became_peered":"2024-01-22T05:04:35.047784+0000","last_unstale":"2024-01-22T05:04:39.090985+0000","last_undegraded":"2024-01-22T05:04:39.090985+0000","last_fullsized":"2024-01-22T05:04:39.090985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119163+0000","last_change":"2024-01-22T05:04:39.114068+0000","last_active":"2024-01-22T05:04:39.119163+0000","last_peered":"2024-01-22T05:04:39.119163+0000","last_clean":"2024-01-22T05:04:39.119163+0000","last_became_active":"2024-01-22T05:04:39.113694+0000","last_became_peered":"2024-01-22T05:04:39.113694+0000","last_unstale":"2024-01-22T05:04:39.119163+0000","last_undegraded":"2024-01-22T05:04:39.119163+0000","last_fullsized":"2024-01-22T05:04:39.119163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092578+0000","last_change":"2024-01-22T05:04:34.608169+0000","last_active":"2024-01-22T05:04:39.092578+0000","last_peered":"2024-01-22T05:04:39.092578+0000","last_clean":"2024-01-22T05:04:39.092578+0000","last_became_active":"2024-01-22T05:04:34.607884+0000","last_became_peered":"2024-01-22T05:04:34.607884+0000","last_unstale":"2024-01-22T05:04:39.092578+0000","last_undegraded":"2024-01-22T05:04:39.092578+0000","last_fullsized":"2024-01-22T05:04:39.092578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071885+0000","last_change":"2024-01-22T05:04:35.046615+0000","last_active":"2024-01-22T05:04:39.071885+0000","last_peered":"2024-01-22T05:04:39.071885+0000","last_clean":"2024-01-22T05:04:39.071885+0000","last_became_active":"2024-01-22T05:04:35.044177+0000","last_became_peered":"2024-01-22T05:04:35.044177+0000","last_unstale":"2024-01-22T05:04:39.071885+0000","last_undegraded":"2024-01-22T05:04:39.071885+0000","last_fullsized":"2024-01-22T05:04:39.071885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.108538+0000","last_change":"2024-01-22T05:04:39.106119+0000","last_active":"2024-01-22T05:04:39.108538+0000","last_peered":"2024-01-22T05:04:39.108538+0000","last_clean":"2024-01-22T05:04:39.108538+0000","last_became_active":"2024-01-22T05:04:39.105691+0000","last_became_peered":"2024-01-22T05:04:39.105691+0000","last_unstale":"2024-01-22T05:04:39.108538+0000","last_undegraded":"2024-01-22T05:04:39.108538+0000","last_fullsized":"2024-01-22T05:04:39.108538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092748+0000","last_change":"2024-01-22T05:04:34.609294+0000","last_active":"2024-01-22T05:04:39.092748+0000","last_peered":"2024-01-22T05:04:39.092748+0000","last_clean":"2024-01-22T05:04:39.092748+0000","last_became_active":"2024-01-22T05:04:34.609001+0000","last_became_peered":"2024-01-22T05:04:34.609001+0000","last_unstale":"2024-01-22T05:04:39.092748+0000","last_undegraded":"2024-01-22T05:04:39.092748+0000","last_fullsized":"2024-01-22T05:04:39.092748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079342+0000","last_change":"2024-01-22T05:04:35.063766+0000","last_active":"2024-01-22T05:04:39.079342+0000","last_peered":"2024-01-22T05:04:39.079342+0000","last_clean":"2024-01-22T05:04:39.079342+0000","last_became_active":"2024-01-22T05:04:35.063477+0000","last_became_peered":"2024-01-22T05:04:35.063477+0000","last_unstale":"2024-01-22T05:04:39.079342+0000","last_undegraded":"2024-01-22T05:04:39.079342+0000","last_fullsized":"2024-01-22T05:04:39.079342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.113628+0000","last_change":"2024-01-22T05:04:39.112131+0000","last_active":"2024-01-22T05:04:39.113628+0000","last_peered":"2024-01-22T05:04:39.113628+0000","last_clean":"2024-01-22T05:04:39.113628+0000","last_became_active":"2024-01-22T05:04:39.111715+0000","last_became_peered":"2024-01-22T05:04:39.111715+0000","last_unstale":"2024-01-22T05:04:39.113628+0000","last_undegraded":"2024-01-22T05:04:39.113628+0000","last_fullsized":"2024-01-22T05:04:39.113628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.089065+0000","last_change":"2024-01-22T05:04:34.619934+0000","last_active":"2024-01-22T05:04:39.089065+0000","last_peered":"2024-01-22T05:04:39.089065+0000","last_clean":"2024-01-22T05:04:39.089065+0000","last_became_active":"2024-01-22T05:04:34.617261+0000","last_became_peered":"2024-01-22T05:04:34.617261+0000","last_unstale":"2024-01-22T05:04:39.089065+0000","last_undegraded":"2024-01-22T05:04:39.089065+0000","last_fullsized":"2024-01-22T05:04:39.089065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.085702+0000","last_change":"2024-01-22T05:04:35.073485+0000","last_active":"2024-01-22T05:04:39.085702+0000","last_peered":"2024-01-22T05:04:39.085702+0000","last_clean":"2024-01-22T05:04:39.085702+0000","last_became_active":"2024-01-22T05:04:35.073124+0000","last_became_peered":"2024-01-22T05:04:35.073124+0000","last_unstale":"2024-01-22T05:04:39.085702+0000","last_undegraded":"2024-01-22T05:04:39.085702+0000","last_fullsized":"2024-01-22T05:04:39.085702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119896+0000","last_change":"2024-01-22T05:04:39.118034+0000","last_active":"2024-01-22T05:04:39.119896+0000","last_peered":"2024-01-22T05:04:39.119896+0000","last_clean":"2024-01-22T05:04:39.119896+0000","last_became_active":"2024-01-22T05:04:39.117544+0000","last_became_peered":"2024-01-22T05:04:39.117544+0000","last_unstale":"2024-01-22T05:04:39.119896+0000","last_undegraded":"2024-01-22T05:04:39.119896+0000","last_fullsized":"2024-01-22T05:04:39.119896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090880+0000","last_change":"2024-01-22T05:04:34.607793+0000","last_active":"2024-01-22T05:04:39.090880+0000","last_peered":"2024-01-22T05:04:39.090880+0000","last_clean":"2024-01-22T05:04:39.090880+0000","last_became_active":"2024-01-22T05:04:34.607475+0000","last_became_peered":"2024-01-22T05:04:34.607475+0000","last_unstale":"2024-01-22T05:04:39.090880+0000","last_undegraded":"2024-01-22T05:04:39.090880+0000","last_fullsized":"2024-01-22T05:04:39.090880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092444+0000","last_change":"2024-01-22T05:04:35.059510+0000","last_active":"2024-01-22T05:04:39.092444+0000","last_peered":"2024-01-22T05:04:39.092444+0000","last_clean":"2024-01-22T05:04:39.092444+0000","last_became_active":"2024-01-22T05:04:35.059143+0000","last_became_peered":"2024-01-22T05:04:35.059143+0000","last_unstale":"2024-01-22T05:04:39.092444+0000","last_undegraded":"2024-01-22T05:04:39.092444+0000","last_fullsized":"2024-01-22T05:04:39.092444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.099973+0000","last_change":"2024-01-22T05:04:39.097504+0000","last_active":"2024-01-22T05:04:39.099973+0000","last_peered":"2024-01-22T05:04:39.099973+0000","last_clean":"2024-01-22T05:04:39.099973+0000","last_became_active":"2024-01-22T05:04:39.097014+0000","last_became_peered":"2024-01-22T05:04:39.097014+0000","last_unstale":"2024-01-22T05:04:39.099973+0000","last_undegraded":"2024-01-22T05:04:39.099973+0000","last_fullsized":"2024-01-22T05:04:39.099973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077581+0000","last_change":"2024-01-22T05:04:34.611364+0000","last_active":"2024-01-22T05:04:39.077581+0000","last_peered":"2024-01-22T05:04:39.077581+0000","last_clean":"2024-01-22T05:04:39.077581+0000","last_became_active":"2024-01-22T05:04:34.610334+0000","last_became_peered":"2024-01-22T05:04:34.610334+0000","last_unstale":"2024-01-22T05:04:39.077581+0000","last_undegraded":"2024-01-22T05:04:39.077581+0000","last_fullsized":"2024-01-22T05:04:39.077581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082200+0000","last_change":"2024-01-22T05:04:35.069773+0000","last_active":"2024-01-22T05:04:39.082200+0000","last_peered":"2024-01-22T05:04:39.082200+0000","last_clean":"2024-01-22T05:04:39.082200+0000","last_became_active":"2024-01-22T05:04:35.069468+0000","last_became_peered":"2024-01-22T05:04:35.069468+0000","last_unstale":"2024-01-22T05:04:39.082200+0000","last_undegraded":"2024-01-22T05:04:39.082200+0000","last_fullsized":"2024-01-22T05:04:39.082200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.110957+0000","last_change":"2024-01-22T05:04:39.110074+0000","last_active":"2024-01-22T05:04:39.110957+0000","last_peered":"2024-01-22T05:04:39.110957+0000","last_clean":"2024-01-22T05:04:39.110957+0000","last_became_active":"2024-01-22T05:04:39.109579+0000","last_became_peered":"2024-01-22T05:04:39.109579+0000","last_unstale":"2024-01-22T05:04:39.110957+0000","last_undegraded":"2024-01-22T05:04:39.110957+0000","last_fullsized":"2024-01-22T05:04:39.110957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090495+0000","last_change":"2024-01-22T05:04:34.608932+0000","last_active":"2024-01-22T05:04:39.090495+0000","last_peered":"2024-01-22T05:04:39.090495+0000","last_clean":"2024-01-22T05:04:39.090495+0000","last_became_active":"2024-01-22T05:04:34.608567+0000","last_became_peered":"2024-01-22T05:04:34.608567+0000","last_unstale":"2024-01-22T05:04:39.090495+0000","last_undegraded":"2024-01-22T05:04:39.090495+0000","last_fullsized":"2024-01-22T05:04:39.090495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087479+0000","last_change":"2024-01-22T05:04:35.054670+0000","last_active":"2024-01-22T05:04:39.087479+0000","last_peered":"2024-01-22T05:04:39.087479+0000","last_clean":"2024-01-22T05:04:39.087479+0000","last_became_active":"2024-01-22T05:04:35.054302+0000","last_became_peered":"2024-01-22T05:04:35.054302+0000","last_unstale":"2024-01-22T05:04:39.087479+0000","last_undegraded":"2024-01-22T05:04:39.087479+0000","last_fullsized":"2024-01-22T05:04:39.087479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077441+0000","last_change":"2024-01-22T05:04:34.621810+0000","last_active":"2024-01-22T05:04:39.077441+0000","last_peered":"2024-01-22T05:04:39.077441+0000","last_clean":"2024-01-22T05:04:39.077441+0000","last_became_active":"2024-01-22T05:04:34.620591+0000","last_became_peered":"2024-01-22T05:04:34.620591+0000","last_unstale":"2024-01-22T05:04:39.077441+0000","last_undegraded":"2024-01-22T05:04:39.077441+0000","last_fullsized":"2024-01-22T05:04:39.077441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072938+0000","last_change":"2024-01-22T05:04:35.053530+0000","last_active":"2024-01-22T05:04:39.072938+0000","last_peered":"2024-01-22T05:04:39.072938+0000","last_clean":"2024-01-22T05:04:39.072938+0000","last_became_active":"2024-01-22T05:04:35.053256+0000","last_became_peered":"2024-01-22T05:04:35.053256+0000","last_unstale":"2024-01-22T05:04:39.072938+0000","last_undegraded":"2024-01-22T05:04:39.072938+0000","last_fullsized":"2024-01-22T05:04:39.072938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082902+0000","last_change":"2024-01-22T05:04:34.623001+0000","last_active":"2024-01-22T05:04:39.082902+0000","last_peered":"2024-01-22T05:04:39.082902+0000","last_clean":"2024-01-22T05:04:39.082902+0000","last_became_active":"2024-01-22T05:04:34.622591+0000","last_became_peered":"2024-01-22T05:04:34.622591+0000","last_unstale":"2024-01-22T05:04:39.082902+0000","last_undegraded":"2024-01-22T05:04:39.082902+0000","last_fullsized":"2024-01-22T05:04:39.082902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070523+0000","last_change":"2024-01-22T05:04:35.063913+0000","last_active":"2024-01-22T05:04:39.070523+0000","last_peered":"2024-01-22T05:04:39.070523+0000","last_clean":"2024-01-22T05:04:39.070523+0000","last_became_active":"2024-01-22T05:04:35.063630+0000","last_became_peered":"2024-01-22T05:04:35.063630+0000","last_unstale":"2024-01-22T05:04:39.070523+0000","last_undegraded":"2024-01-22T05:04:39.070523+0000","last_fullsized":"2024-01-22T05:04:39.070523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"25'7","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-22T05:04:46.053222+0000","last_change":"2024-01-22T05:04:34.620106+0000","last_active":"2024-01-22T05:04:46.053222+0000","last_peered":"2024-01-22T05:04:46.053222+0000","last_clean":"2024-01-22T05:04:46.053222+0000","last_became_active":"2024-01-22T05:04:34.619792+0000","last_became_peered":"2024-01-22T05:04:34.619792+0000","last_unstale":"2024-01-22T05:04:46.053222+0000","last_undegraded":"2024-01-22T05:04:46.053222+0000","last_fullsized":"2024-01-22T05:04:46.053222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3071,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070845+0000","last_change":"2024-01-22T05:04:35.057279+0000","last_active":"2024-01-22T05:04:39.070845+0000","last_peered":"2024-01-22T05:04:39.070845+0000","last_clean":"2024-01-22T05:04:39.070845+0000","last_became_active":"2024-01-22T05:04:35.056980+0000","last_became_peered":"2024-01-22T05:04:35.056980+0000","last_unstale":"2024-01-22T05:04:39.070845+0000","last_undegraded":"2024-01-22T05:04:39.070845+0000","last_fullsized":"2024-01-22T05:04:39.070845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092494+0000","last_change":"2024-01-22T05:04:34.611971+0000","last_active":"2024-01-22T05:04:39.092494+0000","last_peered":"2024-01-22T05:04:39.092494+0000","last_clean":"2024-01-22T05:04:39.092494+0000","last_became_active":"2024-01-22T05:04:34.605153+0000","last_became_peered":"2024-01-22T05:04:34.605153+0000","last_unstale":"2024-01-22T05:04:39.092494+0000","last_undegraded":"2024-01-22T05:04:39.092494+0000","last_fullsized":"2024-01-22T05:04:39.092494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077326+0000","last_change":"2024-01-22T05:04:35.037542+0000","last_active":"2024-01-22T05:04:39.077326+0000","last_peered":"2024-01-22T05:04:39.077326+0000","last_clean":"2024-01-22T05:04:39.077326+0000","last_became_active":"2024-01-22T05:04:35.037178+0000","last_became_peered":"2024-01-22T05:04:35.037178+0000","last_unstale":"2024-01-22T05:04:39.077326+0000","last_undegraded":"2024-01-22T05:04:39.077326+0000","last_fullsized":"2024-01-22T05:04:39.077326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091860+0000","last_change":"2024-01-22T05:04:34.615870+0000","last_active":"2024-01-22T05:04:39.091860+0000","last_peered":"2024-01-22T05:04:39.091860+0000","last_clean":"2024-01-22T05:04:39.091860+0000","last_became_active":"2024-01-22T05:04:34.615601+0000","last_became_peered":"2024-01-22T05:04:34.615601+0000","last_unstale":"2024-01-22T05:04:39.091860+0000","last_undegraded":"2024-01-22T05:04:39.091860+0000","last_fullsized":"2024-01-22T05:04:39.091860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090691+0000","last_change":"2024-01-22T05:04:35.070694+0000","last_active":"2024-01-22T05:04:39.090691+0000","last_peered":"2024-01-22T05:04:39.090691+0000","last_clean":"2024-01-22T05:04:39.090691+0000","last_became_active":"2024-01-22T05:04:35.070448+0000","last_became_peered":"2024-01-22T05:04:35.070448+0000","last_unstale":"2024-01-22T05:04:39.090691+0000","last_undegraded":"2024-01-22T05:04:39.090691+0000","last_fullsized":"2024-01-22T05:04:39.090691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092663+0000","last_change":"2024-01-22T05:04:34.616419+0000","last_active":"2024-01-22T05:04:39.092663+0000","last_peered":"2024-01-22T05:04:39.092663+0000","last_clean":"2024-01-22T05:04:39.092663+0000","last_became_active":"2024-01-22T05:04:34.616108+0000","last_became_peered":"2024-01-22T05:04:34.616108+0000","last_unstale":"2024-01-22T05:04:39.092663+0000","last_undegraded":"2024-01-22T05:04:39.092663+0000","last_fullsized":"2024-01-22T05:04:39.092663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071575+0000","last_change":"2024-01-22T05:04:35.058871+0000","last_active":"2024-01-22T05:04:39.071575+0000","last_peered":"2024-01-22T05:04:39.071575+0000","last_clean":"2024-01-22T05:04:39.071575+0000","last_became_active":"2024-01-22T05:04:35.058576+0000","last_became_peered":"2024-01-22T05:04:35.058576+0000","last_unstale":"2024-01-22T05:04:39.071575+0000","last_undegraded":"2024-01-22T05:04:39.071575+0000","last_fullsized":"2024-01-22T05:04:39.071575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070542+0000","last_change":"2024-01-22T05:04:35.057257+0000","last_active":"2024-01-22T05:04:39.070542+0000","last_peered":"2024-01-22T05:04:39.070542+0000","last_clean":"2024-01-22T05:04:39.070542+0000","last_became_active":"2024-01-22T05:04:35.056962+0000","last_became_peered":"2024-01-22T05:04:35.056962+0000","last_unstale":"2024-01-22T05:04:39.070542+0000","last_undegraded":"2024-01-22T05:04:39.070542+0000","last_fullsized":"2024-01-22T05:04:39.070542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078666+0000","last_change":"2024-01-22T05:04:34.604249+0000","last_active":"2024-01-22T05:04:39.078666+0000","last_peered":"2024-01-22T05:04:39.078666+0000","last_clean":"2024-01-22T05:04:39.078666+0000","last_became_active":"2024-01-22T05:04:34.603896+0000","last_became_peered":"2024-01-22T05:04:34.603896+0000","last_unstale":"2024-01-22T05:04:39.078666+0000","last_undegraded":"2024-01-22T05:04:39.078666+0000","last_fullsized":"2024-01-22T05:04:39.078666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082626+0000","last_change":"2024-01-22T05:04:35.045030+0000","last_active":"2024-01-22T05:04:39.082626+0000","last_peered":"2024-01-22T05:04:39.082626+0000","last_clean":"2024-01-22T05:04:39.082626+0000","last_became_active":"2024-01-22T05:04:35.043890+0000","last_became_peered":"2024-01-22T05:04:35.043890+0000","last_unstale":"2024-01-22T05:04:39.082626+0000","last_undegraded":"2024-01-22T05:04:39.082626+0000","last_fullsized":"2024-01-22T05:04:39.082626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090782+0000","last_change":"2024-01-22T05:04:34.625268+0000","last_active":"2024-01-22T05:04:39.090782+0000","last_peered":"2024-01-22T05:04:39.090782+0000","last_clean":"2024-01-22T05:04:39.090782+0000","last_became_active":"2024-01-22T05:04:34.624645+0000","last_became_peered":"2024-01-22T05:04:34.624645+0000","last_unstale":"2024-01-22T05:04:39.090782+0000","last_undegraded":"2024-01-22T05:04:39.090782+0000","last_fullsized":"2024-01-22T05:04:39.090782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072828+0000","last_change":"2024-01-22T05:04:35.061505+0000","last_active":"2024-01-22T05:04:39.072828+0000","last_peered":"2024-01-22T05:04:39.072828+0000","last_clean":"2024-01-22T05:04:39.072828+0000","last_became_active":"2024-01-22T05:04:35.061173+0000","last_became_peered":"2024-01-22T05:04:35.061173+0000","last_unstale":"2024-01-22T05:04:39.072828+0000","last_undegraded":"2024-01-22T05:04:39.072828+0000","last_fullsized":"2024-01-22T05:04:39.072828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077231+0000","last_change":"2024-01-22T05:04:34.612548+0000","last_active":"2024-01-22T05:04:39.077231+0000","last_peered":"2024-01-22T05:04:39.077231+0000","last_clean":"2024-01-22T05:04:39.077231+0000","last_became_active":"2024-01-22T05:04:34.612040+0000","last_became_peered":"2024-01-22T05:04:34.612040+0000","last_unstale":"2024-01-22T05:04:39.077231+0000","last_undegraded":"2024-01-22T05:04:39.077231+0000","last_fullsized":"2024-01-22T05:04:39.077231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.093708+0000","last_change":"2024-01-22T05:04:35.048950+0000","last_active":"2024-01-22T05:04:39.093708+0000","last_peered":"2024-01-22T05:04:39.093708+0000","last_clean":"2024-01-22T05:04:39.093708+0000","last_became_active":"2024-01-22T05:04:35.048676+0000","last_became_peered":"2024-01-22T05:04:35.048676+0000","last_unstale":"2024-01-22T05:04:39.093708+0000","last_undegraded":"2024-01-22T05:04:39.093708+0000","last_fullsized":"2024-01-22T05:04:39.093708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090409+0000","last_change":"2024-01-22T05:04:34.602672+0000","last_active":"2024-01-22T05:04:39.090409+0000","last_peered":"2024-01-22T05:04:39.090409+0000","last_clean":"2024-01-22T05:04:39.090409+0000","last_became_active":"2024-01-22T05:04:34.602360+0000","last_became_peered":"2024-01-22T05:04:34.602360+0000","last_unstale":"2024-01-22T05:04:39.090409+0000","last_undegraded":"2024-01-22T05:04:39.090409+0000","last_fullsized":"2024-01-22T05:04:39.090409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091801+0000","last_change":"2024-01-22T05:04:35.054902+0000","last_active":"2024-01-22T05:04:39.091801+0000","last_peered":"2024-01-22T05:04:39.091801+0000","last_clean":"2024-01-22T05:04:39.091801+0000","last_became_active":"2024-01-22T05:04:35.054584+0000","last_became_peered":"2024-01-22T05:04:35.054584+0000","last_unstale":"2024-01-22T05:04:39.091801+0000","last_undegraded":"2024-01-22T05:04:39.091801+0000","last_fullsized":"2024-01-22T05:04:39.091801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079986+0000","last_change":"2024-01-22T05:04:34.608195+0000","last_active":"2024-01-22T05:04:39.079986+0000","last_peered":"2024-01-22T05:04:39.079986+0000","last_clean":"2024-01-22T05:04:39.079986+0000","last_became_active":"2024-01-22T05:04:34.607837+0000","last_became_peered":"2024-01-22T05:04:34.607837+0000","last_unstale":"2024-01-22T05:04:39.079986+0000","last_undegraded":"2024-01-22T05:04:39.079986+0000","last_fullsized":"2024-01-22T05:04:39.079986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070953+0000","last_change":"2024-01-22T05:04:35.061215+0000","last_active":"2024-01-22T05:04:39.070953+0000","last_peered":"2024-01-22T05:04:39.070953+0000","last_clean":"2024-01-22T05:04:39.070953+0000","last_became_active":"2024-01-22T05:04:35.060725+0000","last_became_peered":"2024-01-22T05:04:35.060725+0000","last_unstale":"2024-01-22T05:04:39.070953+0000","last_undegraded":"2024-01-22T05:04:39.070953+0000","last_fullsized":"2024-01-22T05:04:39.070953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091439+0000","last_change":"2024-01-22T05:04:34.609097+0000","last_active":"2024-01-22T05:04:39.091439+0000","last_peered":"2024-01-22T05:04:39.091439+0000","last_clean":"2024-01-22T05:04:39.091439+0000","last_became_active":"2024-01-22T05:04:34.608713+0000","last_became_peered":"2024-01-22T05:04:34.608713+0000","last_unstale":"2024-01-22T05:04:39.091439+0000","last_undegraded":"2024-01-22T05:04:39.091439+0000","last_fullsized":"2024-01-22T05:04:39.091439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090630+0000","last_change":"2024-01-22T05:04:35.070206+0000","last_active":"2024-01-22T05:04:39.090630+0000","last_peered":"2024-01-22T05:04:39.090630+0000","last_clean":"2024-01-22T05:04:39.090630+0000","last_became_active":"2024-01-22T05:04:35.068703+0000","last_became_peered":"2024-01-22T05:04:35.068703+0000","last_unstale":"2024-01-22T05:04:39.090630+0000","last_undegraded":"2024-01-22T05:04:39.090630+0000","last_fullsized":"2024-01-22T05:04:39.090630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.111639+0000","last_change":"2024-01-22T05:04:34.620326+0000","last_active":"2024-01-22T05:04:39.111639+0000","last_peered":"2024-01-22T05:04:39.111639+0000","last_clean":"2024-01-22T05:04:39.111639+0000","last_became_active":"2024-01-22T05:04:34.620046+0000","last_became_peered":"2024-01-22T05:04:34.620046+0000","last_unstale":"2024-01-22T05:04:39.111639+0000","last_undegraded":"2024-01-22T05:04:39.111639+0000","last_fullsized":"2024-01-22T05:04:39.111639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079200+0000","last_change":"2024-01-22T05:04:35.054096+0000","last_active":"2024-01-22T05:04:39.079200+0000","last_peered":"2024-01-22T05:04:39.079200+0000","last_clean":"2024-01-22T05:04:39.079200+0000","last_became_active":"2024-01-22T05:04:35.053815+0000","last_became_peered":"2024-01-22T05:04:35.053815+0000","last_unstale":"2024-01-22T05:04:39.079200+0000","last_undegraded":"2024-01-22T05:04:39.079200+0000","last_fullsized":"2024-01-22T05:04:39.079200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092578+0000","last_change":"2024-01-22T05:04:34.617396+0000","last_active":"2024-01-22T05:04:39.092578+0000","last_peered":"2024-01-22T05:04:39.092578+0000","last_clean":"2024-01-22T05:04:39.092578+0000","last_became_active":"2024-01-22T05:04:34.617128+0000","last_became_peered":"2024-01-22T05:04:34.617128+0000","last_unstale":"2024-01-22T05:04:39.092578+0000","last_undegraded":"2024-01-22T05:04:39.092578+0000","last_fullsized":"2024-01-22T05:04:39.092578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297384,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074456,"statfs":{"total":96636764160,"available":96332242944,"internally_reserved":0,"allocated":294912,"data_stored":112351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297364,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074476,"statfs":{"total":96636764160,"available":96332263424,"internally_reserved":0,"allocated":274432,"data_stored":114562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297356,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074484,"statfs":{"total":96636764160,"available":96332271616,"internally_reserved":0,"allocated":266240,"data_stored":110937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297376,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074464,"statfs":{"total":96636764160,"available":96332251136,"internally_reserved":0,"allocated":286720,"data_stored":114708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.534}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7709999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297360,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074480,"statfs":{"total":96636764160,"available":96332267520,"internally_reserved":0,"allocated":270336,"data_stored":111027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.798}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8939999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.835}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297360,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074480,"statfs":{"total":96636764160,"available":96332267520,"internally_reserved":0,"allocated":270336,"data_stored":111007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297356,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074484,"statfs":{"total":96636764160,"available":96332271616,"internally_reserved":0,"allocated":266240,"data_stored":110937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.643}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.776}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8959999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.419}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297356,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074484,"statfs":{"total":96636764160,"available":96332271616,"internally_reserved":0,"allocated":266240,"data_stored":110937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:04:51.011 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:04:51.011 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-22T05:04:51.011 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-22T05:04:51.011 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-22T05:04:51.012 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-22T05:04:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.205+0000 7fe534400700 1 Processor -- start 2024-01-22T05:04:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.205+0000 7fe534400700 1 -- start start 2024-01-22T05:04:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.209+0000 7fe534400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe52c0656f0 0x7fe52c065ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.209+0000 7fe534400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe52c0681a0 0x7fe52c0bbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.209+0000 7fe534400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52c0c1c80 con 0x7fe52c065fc0 2024-01-22T05:04:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.209+0000 7fe534400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c0c16c0 con 0x7fe52c0656f0 2024-01-22T05:04:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.209+0000 7fe534400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c081d30 con 0x7fe52c0681a0 2024-01-22T05:04:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.209+0000 7fe531a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe52c0656f0 0x7fe52c065ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.209+0000 7fe531000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe52c065fc0 0x7fe52c067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33558/0 (socket says 172.21.15.49:33558) 2024-01-22T05:04:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.209+0000 7fe531000700 1 -- 172.21.15.49:0/1861386011 learned_addr learned my addr 172.21.15.49:0/1861386011 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.209+0000 7fe532400700 1 --2- 172.21.15.49:0/1861386011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe52c0681a0 0x7fe52c0bbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:51.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.209+0000 7fe52be00700 1 -- 172.21.15.49:0/1861386011 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720914637 0 0) 0x7fe52c0c1c80 con 0x7fe52c065fc0 2024-01-22T05:04:51.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe52be00700 1 -- 172.21.15.49:0/1861386011 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe50c0033f0 con 0x7fe52c065fc0 2024-01-22T05:04:51.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe531a00700 1 -- 172.21.15.49:0/1861386011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe52c0681a0 msgr2=0x7fe52c0bbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:51.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe531a00700 1 --2- 172.21.15.49:0/1861386011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe52c0681a0 0x7fe52c0bbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe531a00700 1 -- 172.21.15.49:0/1861386011 >> v1:172.21.15.49:6789/0 conn(0x7fe52c065fc0 legacy=0x7fe52c067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:51.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe531a00700 1 -- 172.21.15.49:0/1861386011 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c066830 con 0x7fe52c0656f0 2024-01-22T05:04:51.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe531a00700 1 --2- 172.21.15.49:0/1861386011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe52c0656f0 0x7fe52c065ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fe51c006fd0 tx=0x7fe51c006f40).ready entity=mon.0 client_cookie=6d7afeda15f8f18f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:51.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe52be00700 1 -- 172.21.15.49:0/1861386011 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c00bd00 con 0x7fe52c0656f0 2024-01-22T05:04:51.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe52be00700 1 -- 172.21.15.49:0/1861386011 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c00be60 con 0x7fe52c0656f0 2024-01-22T05:04:51.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe52be00700 1 -- 172.21.15.49:0/1861386011 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c005a90 con 0x7fe52c0656f0 2024-01-22T05:04:51.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe534400700 1 -- 172.21.15.49:0/1861386011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe52c0656f0 msgr2=0x7fe52c065ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:51.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe534400700 1 --2- 172.21.15.49:0/1861386011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe52c0656f0 0x7fe52c065ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fe51c006fd0 tx=0x7fe51c006f40).stop 2024-01-22T05:04:51.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe534400700 1 -- 172.21.15.49:0/1861386011 shutdown_connections 2024-01-22T05:04:51.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe534400700 1 --2- 172.21.15.49:0/1861386011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe52c0681a0 0x7fe52c0bbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe534400700 1 --2- 172.21.15.49:0/1861386011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe52c0656f0 0x7fe52c065ad0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe534400700 1 -- 172.21.15.49:0/1861386011 >> 172.21.15.49:0/1861386011 conn(0x7fe52c062cc0 msgr2=0x7fe52c0c6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:51.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.265+0000 7fe534400700 1 -- 172.21.15.49:0/1861386011 shutdown_connections 2024-01-22T05:04:51.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.269+0000 7fe534400700 1 -- 172.21.15.49:0/1861386011 wait complete. 2024-01-22T05:04:51.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.269+0000 7fe534400700 1 Processor -- start 2024-01-22T05:04:51.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.269+0000 7fe534400700 1 -- start start 2024-01-22T05:04:51.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe534400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe52c0656f0 0x7fe52c0ac170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:51.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe534400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe52c065fc0 0x7fe52c166c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:51.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe534400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe52c0681a0 0x7fe52c168b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:51.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe534400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c1686c0 con 0x7fe52c065fc0 2024-01-22T05:04:51.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe534400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c167150 con 0x7fe52c0681a0 2024-01-22T05:04:51.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe534400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c169040 con 0x7fe52c0656f0 2024-01-22T05:04:51.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe531000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe52c065fc0 0x7fe52c166c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:51.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe531000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe52c065fc0 0x7fe52c166c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48224/0 (socket says 172.21.15.49:48224) 2024-01-22T05:04:51.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe531000700 1 -- 172.21.15.49:0/32060739 learned_addr learned my addr 172.21.15.49:0/32060739 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:51.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe531a00700 1 --2- 172.21.15.49:0/32060739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe52c0656f0 0x7fe52c0ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:51.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe532400700 1 --2- 172.21.15.49:0/32060739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe52c0681a0 0x7fe52c168b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe531000700 1 -- 172.21.15.49:0/32060739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe52c0656f0 msgr2=0x7fe52c0ac170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe531000700 1 --2- 172.21.15.49:0/32060739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe52c0656f0 0x7fe52c0ac170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe531000700 1 -- 172.21.15.49:0/32060739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe52c0681a0 msgr2=0x7fe52c168b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe531000700 1 --2- 172.21.15.49:0/32060739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe52c0681a0 0x7fe52c168b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe531000700 1 -- 172.21.15.49:0/32060739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51c009250 con 0x7fe52c065fc0 2024-01-22T05:04:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe531000700 1 --2- 172.21.15.49:0/32060739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe52c065fc0 0x7fe52c166c60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe51400c4c0 tx=0x7fe514007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe528c00700 1 -- 172.21.15.49:0/32060739 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5140070d0 con 0x7fe52c065fc0 2024-01-22T05:04:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe528c00700 1 -- 172.21.15.49:0/32060739 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe514007230 con 0x7fe52c065fc0 2024-01-22T05:04:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe534400700 1 -- 172.21.15.49:0/32060739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52c167ab0 con 0x7fe52c065fc0 2024-01-22T05:04:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe528c00700 1 -- 172.21.15.49:0/32060739 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5140075d0 con 0x7fe52c065fc0 2024-01-22T05:04:51.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.273+0000 7fe534400700 1 -- 172.21.15.49:0/32060739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52c168070 con 0x7fe52c065fc0 2024-01-22T05:04:51.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.277+0000 7fe534400700 1 -- 172.21.15.49:0/32060739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52c168870 con 0x7fe52c065fc0 2024-01-22T05:04:51.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.277+0000 7fe528c00700 1 -- 172.21.15.49:0/32060739 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe5140059b0 con 0x7fe52c065fc0 2024-01-22T05:04:51.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.277+0000 7fe528c00700 1 --2- 172.21.15.49:0/32060739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe50405a510 0x7fe50405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:51.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.277+0000 7fe528c00700 1 -- 172.21.15.49:0/32060739 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fe514074180 con 0x7fe52c065fc0 2024-01-22T05:04:51.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.277+0000 7fe531a00700 1 --2- 172.21.15.49:0/32060739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe50405a510 0x7fe50405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:51.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.281+0000 7fe531a00700 1 --2- 172.21.15.49:0/32060739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe50405a510 0x7fe50405c9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe51c00c010 tx=0x7fe51c016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:51.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.285+0000 7fe528c00700 1 -- 172.21.15.49:0/32060739 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe52c168870 con 0x7fe52c065fc0 2024-01-22T05:04:51.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.485+0000 7fe534400700 1 -- 172.21.15.49:0/32060739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe52c168870 con 0x7fe52c065fc0 2024-01-22T05:04:51.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.493+0000 7fe528c00700 1 -- 172.21.15.49:0/32060739 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+142146 (secure 0 0 0) 0x7fe52c168870 con 0x7fe52c065fc0 2024-01-22T05:04:51.499 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:51.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.501+0000 7fe534400700 1 -- 172.21.15.49:0/32060739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe50405a510 msgr2=0x7fe50405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:51.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.501+0000 7fe534400700 1 --2- 172.21.15.49:0/32060739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe50405a510 0x7fe50405c9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe51c00c010 tx=0x7fe51c016000).stop 2024-01-22T05:04:51.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.501+0000 7fe534400700 1 -- 172.21.15.49:0/32060739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe52c065fc0 msgr2=0x7fe52c166c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:51.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.501+0000 7fe534400700 1 --2- 172.21.15.49:0/32060739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe52c065fc0 0x7fe52c166c60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe51400c4c0 tx=0x7fe514007c70).stop 2024-01-22T05:04:51.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.501+0000 7fe534400700 1 -- 172.21.15.49:0/32060739 shutdown_connections 2024-01-22T05:04:51.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.501+0000 7fe534400700 1 --2- 172.21.15.49:0/32060739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe50405a510 0x7fe50405c9d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.501+0000 7fe534400700 1 --2- 172.21.15.49:0/32060739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe52c0681a0 0x7fe52c168b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.501+0000 7fe534400700 1 --2- 172.21.15.49:0/32060739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe52c065fc0 0x7fe52c166c60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.501+0000 7fe534400700 1 --2- 172.21.15.49:0/32060739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe52c0656f0 0x7fe52c0ac170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.501+0000 7fe534400700 1 -- 172.21.15.49:0/32060739 >> 172.21.15.49:0/32060739 conn(0x7fe52c062cc0 msgr2=0x7fe52c0c5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:51.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.501+0000 7fe534400700 1 -- 172.21.15.49:0/32060739 shutdown_connections 2024-01-22T05:04:51.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.501+0000 7fe534400700 1 -- 172.21.15.49:0/32060739 wait complete. 2024-01-22T05:04:51.528 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":4,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":22885},{"type":"v1","addr":"172.21.15.49:6833","nonce":22885}]},"active_addr":"172.21.15.49:6833/22885","active_change":"2024-01-22T05:04:21.201383+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":3020672798}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":3446550138}]}]} 2024-01-22T05:04:51.531 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-22T05:04:51.531 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-22T05:04:51.531 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:04:51.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.697+0000 7f3a0fc00700 1 Processor -- start 2024-01-22T05:04:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.697+0000 7f3a0fc00700 1 -- start start 2024-01-22T05:04:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.697+0000 7f3a0fc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3a080c4a40 0x7f3a08062aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.697+0000 7f3a0fc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3a08062f90 0x7f3a080bd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.697+0000 7f3a0fc00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a080c41d0 con 0x7f3a080c4660 2024-01-22T05:04:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.697+0000 7f3a0fc00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a080633e0 con 0x7f3a08062f90 2024-01-22T05:04:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.697+0000 7f3a0fc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a080c35c0 con 0x7f3a080c4a40 2024-01-22T05:04:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.697+0000 7f3a0d200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3a080c4660 0x7f3a08068c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33572/0 (socket says 172.21.15.49:33572) 2024-01-22T05:04:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.697+0000 7f3a0d200700 1 -- 172.21.15.49:0/1209072748 learned_addr learned my addr 172.21.15.49:0/1209072748 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.697+0000 7f3a0dc00700 1 --2- 172.21.15.49:0/1209072748 >> v2:172.21.15.49:3300/0 conn(0x7f3a08062f90 0x7f3a080bd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a07e00700 1 --2- 172.21.15.49:0/1209072748 >> v2:172.21.15.110:3300/0 conn(0x7f3a080c4a40 0x7f3a08062aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a07400700 1 -- 172.21.15.49:0/1209072748 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778927316 0 0) 0x7f3a080c41d0 con 0x7f3a080c4660 2024-01-22T05:04:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a07400700 1 -- 172.21.15.49:0/1209072748 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39e80033f0 con 0x7f3a080c4660 2024-01-22T05:04:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a0dc00700 1 -- 172.21.15.49:0/1209072748 >> v2:172.21.15.110:3300/0 conn(0x7f3a080c4a40 msgr2=0x7f3a08062aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a0dc00700 1 --2- 172.21.15.49:0/1209072748 >> v2:172.21.15.110:3300/0 conn(0x7f3a080c4a40 0x7f3a08062aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a0dc00700 1 -- 172.21.15.49:0/1209072748 >> v1:172.21.15.49:6789/0 conn(0x7f3a080c4660 legacy=0x7f3a08068c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a0dc00700 1 -- 172.21.15.49:0/1209072748 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a080c38a0 con 0x7f3a08062f90 2024-01-22T05:04:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a0dc00700 1 --2- 172.21.15.49:0/1209072748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a08062f90 0x7f3a080bd8a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f3a080c5190 tx=0x7f3a00009780).ready entity=mon.0 client_cookie=5350df50f7a85c79 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a07400700 1 -- 172.21.15.49:0/1209072748 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0000e070 con 0x7f3a08062f90 2024-01-22T05:04:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a07400700 1 -- 172.21.15.49:0/1209072748 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0000bb60 con 0x7f3a08062f90 2024-01-22T05:04:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a07400700 1 -- 172.21.15.49:0/1209072748 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00012410 con 0x7f3a08062f90 2024-01-22T05:04:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a0fc00700 1 -- 172.21.15.49:0/1209072748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a08062f90 msgr2=0x7f3a080bd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a0fc00700 1 --2- 172.21.15.49:0/1209072748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a08062f90 0x7f3a080bd8a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f3a080c5190 tx=0x7f3a00009780).stop 2024-01-22T05:04:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a0fc00700 1 -- 172.21.15.49:0/1209072748 shutdown_connections 2024-01-22T05:04:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a0fc00700 1 --2- 172.21.15.49:0/1209072748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a08062f90 0x7f3a080bd8a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a0fc00700 1 --2- 172.21.15.49:0/1209072748 >> v2:172.21.15.110:3300/0 conn(0x7f3a080c4a40 0x7f3a08062aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a0fc00700 1 -- 172.21.15.49:0/1209072748 >> 172.21.15.49:0/1209072748 conn(0x7f3a080c51c0 msgr2=0x7f3a080c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a0fc00700 1 -- 172.21.15.49:0/1209072748 shutdown_connections 2024-01-22T05:04:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.701+0000 7f3a0fc00700 1 -- 172.21.15.49:0/1209072748 wait complete. 2024-01-22T05:04:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.705+0000 7f3a0fc00700 1 Processor -- start 2024-01-22T05:04:51.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.705+0000 7f3a0fc00700 1 -- start start 2024-01-22T05:04:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0fc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a08062f90 0x7f3a080aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0fc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a080c4660 0x7f3a080ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0fc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a080c4a40 0x7f3a0816b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0fc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0813f200 con 0x7f3a08062f90 2024-01-22T05:04:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0fc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a081690a0 con 0x7f3a080c4660 2024-01-22T05:04:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0fc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080c0ba0 con 0x7f3a080c4a40 2024-01-22T05:04:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0d200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a08062f90 0x7f3a080aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0d200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a08062f90 0x7f3a080aac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48230/0 (socket says 172.21.15.49:48230) 2024-01-22T05:04:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0d200700 1 -- 172.21.15.49:0/2239735791 learned_addr learned my addr 172.21.15.49:0/2239735791 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a07e00700 1 --2- 172.21.15.49:0/2239735791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a080c4660 0x7f3a080ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0dc00700 1 --2- 172.21.15.49:0/2239735791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a080c4a40 0x7f3a0816b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0d200700 1 -- 172.21.15.49:0/2239735791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a080c4a40 msgr2=0x7f3a0816b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0d200700 1 --2- 172.21.15.49:0/2239735791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a080c4a40 0x7f3a0816b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0d200700 1 -- 172.21.15.49:0/2239735791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a080c4660 msgr2=0x7f3a080ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0d200700 1 --2- 172.21.15.49:0/2239735791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a080c4660 0x7f3a080ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0d200700 1 -- 172.21.15.49:0/2239735791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a00009a20 con 0x7f3a08062f90 2024-01-22T05:04:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0d200700 1 --2- 172.21.15.49:0/2239735791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a08062f90 0x7f3a080aac30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f39f800c5c0 tx=0x7f39f8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f39ffe00700 1 -- 172.21.15.49:0/2239735791 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f80072e0 con 0x7f3a08062f90 2024-01-22T05:04:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f39ffe00700 1 -- 172.21.15.49:0/2239735791 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f8007440 con 0x7f3a08062f90 2024-01-22T05:04:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f39ffe00700 1 -- 172.21.15.49:0/2239735791 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f80057a0 con 0x7f3a08062f90 2024-01-22T05:04:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0fc00700 1 -- 172.21.15.49:0/2239735791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a080ae180 con 0x7f3a08062f90 2024-01-22T05:04:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.709+0000 7f3a0fc00700 1 -- 172.21.15.49:0/2239735791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a080ae740 con 0x7f3a08062f90 2024-01-22T05:04:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.713+0000 7f3a0fc00700 1 -- 172.21.15.49:0/2239735791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a08047060 con 0x7f3a08062f90 2024-01-22T05:04:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.713+0000 7f39ffe00700 1 -- 172.21.15.49:0/2239735791 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f39f8005bd0 con 0x7f3a08062f90 2024-01-22T05:04:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.713+0000 7f39ffe00700 1 --2- 172.21.15.49:0/2239735791 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f39e005a510 0x7f39e005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.713+0000 7f39ffe00700 1 -- 172.21.15.49:0/2239735791 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f39f80742b0 con 0x7f3a08062f90 2024-01-22T05:04:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.717+0000 7f3a07e00700 1 --2- 172.21.15.49:0/2239735791 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f39e005a510 0x7f39e005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.717+0000 7f3a07e00700 1 --2- 172.21.15.49:0/2239735791 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f39e005a510 0x7f39e005c9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3a080ab120 tx=0x7f39f0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:51.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.721+0000 7f39ffe00700 1 -- 172.21.15.49:0/2239735791 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f39f80476c0 con 0x7f3a08062f90 2024-01-22T05:04:51.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.889+0000 7f3a0fc00700 1 -- 172.21.15.49:0/2239735791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a080c3b80 con 0x7f3a08062f90 2024-01-22T05:04:51.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.893+0000 7f39ffe00700 1 -- 172.21.15.49:0/2239735791 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f39f804ace0 con 0x7f3a08062f90 2024-01-22T05:04:51.895 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:51.895 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:39.526211+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:04:51.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.897+0000 7f3a0fc00700 1 -- 172.21.15.49:0/2239735791 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f39e005a510 msgr2=0x7f39e005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:51.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.897+0000 7f3a0fc00700 1 --2- 172.21.15.49:0/2239735791 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f39e005a510 0x7f39e005c9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3a080ab120 tx=0x7f39f0008040).stop 2024-01-22T05:04:51.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.897+0000 7f3a0fc00700 1 -- 172.21.15.49:0/2239735791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a08062f90 msgr2=0x7f3a080aac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:51.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.897+0000 7f3a0fc00700 1 --2- 172.21.15.49:0/2239735791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a08062f90 0x7f3a080aac30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f39f800c5c0 tx=0x7f39f8007c80).stop 2024-01-22T05:04:51.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.897+0000 7f3a0fc00700 1 -- 172.21.15.49:0/2239735791 shutdown_connections 2024-01-22T05:04:51.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.897+0000 7f3a0fc00700 1 --2- 172.21.15.49:0/2239735791 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f39e005a510 0x7f39e005c9d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.897+0000 7f3a0fc00700 1 --2- 172.21.15.49:0/2239735791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a080c4a40 0x7f3a0816b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.897+0000 7f3a0fc00700 1 --2- 172.21.15.49:0/2239735791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a080c4660 0x7f3a080ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.897+0000 7f3a0fc00700 1 --2- 172.21.15.49:0/2239735791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a08062f90 0x7f3a080aac30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:51.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.897+0000 7f3a0fc00700 1 -- 172.21.15.49:0/2239735791 >> 172.21.15.49:0/2239735791 conn(0x7f3a080c51c0 msgr2=0x7f3a080a75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:51.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.897+0000 7f3a0fc00700 1 -- 172.21.15.49:0/2239735791 shutdown_connections 2024-01-22T05:04:51.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:51.897+0000 7f3a0fc00700 1 -- 172.21.15.49:0/2239735791 wait complete. 2024-01-22T05:04:51.923 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-22T05:04:51.923 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:04:52.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.085+0000 7f002ae00700 1 Processor -- start 2024-01-22T05:04:52.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.085+0000 7f002ae00700 1 -- start start 2024-01-22T05:04:52.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.089+0000 7f002ae00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f00241554a0 0x7f0024067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.089+0000 7f002ae00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00240c5840 con 0x7f0024151a60 2024-01-22T05:04:52.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.089+0000 7f002ae00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0024155cf0 con 0x7f00240c8e70 2024-01-22T05:04:52.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.089+0000 7f002ae00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0024155fd0 con 0x7f00241554a0 2024-01-22T05:04:52.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.089+0000 7f0023e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f00241554a0 0x7f0024067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.089+0000 7f0029800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0024151a60 0x7f00240c5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33584/0 (socket says 172.21.15.49:33584) 2024-01-22T05:04:52.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.089+0000 7f0029800700 1 -- 172.21.15.49:0/2254741079 learned_addr learned my addr 172.21.15.49:0/2254741079 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:52.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.089+0000 7f0023e00700 1 -- 172.21.15.49:0/2254741079 >> v1:172.21.15.110:6789/0 conn(0x7f00240c8e70 legacy=0x7f0024151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.089+0000 7f0023e00700 1 -- 172.21.15.49:0/2254741079 >> v1:172.21.15.49:6789/0 conn(0x7f0024151a60 legacy=0x7f00240c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.089+0000 7f0022a00700 1 -- 172.21.15.49:0/2254741079 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102688 0 0) 0x7f00240c5840 con 0x7f0024151a60 2024-01-22T05:04:52.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.089+0000 7f0023e00700 1 -- 172.21.15.49:0/2254741079 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00241562b0 con 0x7f00241554a0 2024-01-22T05:04:52.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.089+0000 7f0023e00700 1 --2- 172.21.15.49:0/2254741079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00241554a0 0x7f0024067a90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0014009760 tx=0x7f0014009060).ready entity=mon.0 client_cookie=5f02f3aef98e65a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:52.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.089+0000 7f0022a00700 1 -- 172.21.15.49:0/2254741079 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001400b580 con 0x7f00241554a0 2024-01-22T05:04:52.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.089+0000 7f0022a00700 1 -- 172.21.15.49:0/2254741079 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001400b6e0 con 0x7f00241554a0 2024-01-22T05:04:52.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.089+0000 7f0022a00700 1 -- 172.21.15.49:0/2254741079 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001400ba60 con 0x7f00241554a0 2024-01-22T05:04:52.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.093+0000 7f002ae00700 1 -- 172.21.15.49:0/2254741079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00241554a0 msgr2=0x7f0024067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.093+0000 7f002ae00700 1 --2- 172.21.15.49:0/2254741079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00241554a0 0x7f0024067a90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0014009760 tx=0x7f0014009060).stop 2024-01-22T05:04:52.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.093+0000 7f002ae00700 1 -- 172.21.15.49:0/2254741079 shutdown_connections 2024-01-22T05:04:52.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.093+0000 7f002ae00700 1 --2- 172.21.15.49:0/2254741079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00241554a0 0x7f0024067a90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.093+0000 7f002ae00700 1 -- 172.21.15.49:0/2254741079 >> 172.21.15.49:0/2254741079 conn(0x7f00240c9f50 msgr2=0x7f00240ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:52.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.093+0000 7f002ae00700 1 -- 172.21.15.49:0/2254741079 shutdown_connections 2024-01-22T05:04:52.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.093+0000 7f002ae00700 1 -- 172.21.15.49:0/2254741079 wait complete. 2024-01-22T05:04:52.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.093+0000 7f002ae00700 1 Processor -- start 2024-01-22T05:04:52.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f002ae00700 1 -- start start 2024-01-22T05:04:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f002ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00240c8e70 0x7f002414c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f002ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0024151a60 0x7f00240a9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f002ae00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00241554a0 0x7f00240a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f002ae00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240aa1f0 con 0x7f00241554a0 2024-01-22T05:04:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f002ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240af720 con 0x7f0024151a60 2024-01-22T05:04:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f002ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00240aa650 con 0x7f00240c8e70 2024-01-22T05:04:52.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f0029800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00241554a0 0x7f00240a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f0029800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00241554a0 0x7f00240a9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48246/0 (socket says 172.21.15.49:48246) 2024-01-22T05:04:52.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f0029800700 1 -- 172.21.15.49:0/2475003528 learned_addr learned my addr 172.21.15.49:0/2475003528 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:52.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f0023e00700 1 --2- 172.21.15.49:0/2475003528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00240c8e70 0x7f002414c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f0023400700 1 --2- 172.21.15.49:0/2475003528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0024151a60 0x7f00240a9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f0029800700 1 -- 172.21.15.49:0/2475003528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00240c8e70 msgr2=0x7f002414c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f0029800700 1 --2- 172.21.15.49:0/2475003528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00240c8e70 0x7f002414c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f0029800700 1 -- 172.21.15.49:0/2475003528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0024151a60 msgr2=0x7f00240a9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f0029800700 1 --2- 172.21.15.49:0/2475003528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0024151a60 0x7f00240a9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f0029800700 1 -- 172.21.15.49:0/2475003528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00140092a0 con 0x7f00241554a0 2024-01-22T05:04:52.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f0023400700 1 --2- 172.21.15.49:0/2475003528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0024151a60 0x7f00240a9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:52.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f0029800700 1 --2- 172.21.15.49:0/2475003528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00241554a0 0x7f00240a9d00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f001c00c8c0 tx=0x7f001c001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:52.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f001b400700 1 -- 172.21.15.49:0/2475003528 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c005d30 con 0x7f00241554a0 2024-01-22T05:04:52.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f001b400700 1 -- 172.21.15.49:0/2475003528 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001c005e90 con 0x7f00241554a0 2024-01-22T05:04:52.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f002ae00700 1 -- 172.21.15.49:0/2475003528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00240ae880 con 0x7f00241554a0 2024-01-22T05:04:52.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f001b400700 1 -- 172.21.15.49:0/2475003528 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c007320 con 0x7f00241554a0 2024-01-22T05:04:52.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.097+0000 7f002ae00700 1 -- 172.21.15.49:0/2475003528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00240af0d0 con 0x7f00241554a0 2024-01-22T05:04:52.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.101+0000 7f002ae00700 1 -- 172.21.15.49:0/2475003528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00240af8d0 con 0x7f00241554a0 2024-01-22T05:04:52.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.101+0000 7f001b400700 1 -- 172.21.15.49:0/2475003528 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f001c007710 con 0x7f00241554a0 2024-01-22T05:04:52.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.101+0000 7f001b400700 1 --2- 172.21.15.49:0/2475003528 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efffc05a4e0 0x7efffc05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.101+0000 7f001b400700 1 -- 172.21.15.49:0/2475003528 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f001c074be0 con 0x7f00241554a0 2024-01-22T05:04:52.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.105+0000 7f0023e00700 1 --2- 172.21.15.49:0/2475003528 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efffc05a4e0 0x7efffc05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.105+0000 7f0023e00700 1 --2- 172.21.15.49:0/2475003528 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efffc05a4e0 0x7efffc05c9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f001400b340 tx=0x7f0014017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:52.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.109+0000 7f001b400700 1 -- 172.21.15.49:0/2475003528 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f00240af8d0 con 0x7f00241554a0 2024-01-22T05:04:52.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.285+0000 7f002ae00700 1 -- 172.21.15.49:0/2475003528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00240af8d0 con 0x7f00241554a0 2024-01-22T05:04:52.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.285+0000 7f001b400700 1 -- 172.21.15.49:0/2475003528 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f00240af8d0 con 0x7f00241554a0 2024-01-22T05:04:52.288 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:52.288 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:39.526211+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:04:52.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.289+0000 7f002ae00700 1 -- 172.21.15.49:0/2475003528 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efffc05a4e0 msgr2=0x7efffc05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.289+0000 7f002ae00700 1 --2- 172.21.15.49:0/2475003528 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efffc05a4e0 0x7efffc05c9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f001400b340 tx=0x7f0014017000).stop 2024-01-22T05:04:52.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.289+0000 7f002ae00700 1 -- 172.21.15.49:0/2475003528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00241554a0 msgr2=0x7f00240a9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.289+0000 7f002ae00700 1 --2- 172.21.15.49:0/2475003528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00241554a0 0x7f00240a9d00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f001c00c8c0 tx=0x7f001c001560).stop 2024-01-22T05:04:52.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.289+0000 7f002ae00700 1 -- 172.21.15.49:0/2475003528 shutdown_connections 2024-01-22T05:04:52.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.289+0000 7f002ae00700 1 --2- 172.21.15.49:0/2475003528 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efffc05a4e0 0x7efffc05c9a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.289+0000 7f002ae00700 1 --2- 172.21.15.49:0/2475003528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00241554a0 0x7f00240a9d00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.289+0000 7f002ae00700 1 --2- 172.21.15.49:0/2475003528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0024151a60 0x7f00240a9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.289+0000 7f002ae00700 1 --2- 172.21.15.49:0/2475003528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00240c8e70 0x7f002414c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.289+0000 7f002ae00700 1 -- 172.21.15.49:0/2475003528 >> 172.21.15.49:0/2475003528 conn(0x7f00240c9f50 msgr2=0x7f0024068160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:52.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.289+0000 7f002ae00700 1 -- 172.21.15.49:0/2475003528 shutdown_connections 2024-01-22T05:04:52.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.289+0000 7f002ae00700 1 -- 172.21.15.49:0/2475003528 wait complete. 2024-01-22T05:04:52.314 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-22T05:04:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.477+0000 7f64d9400700 1 Processor -- start 2024-01-22T05:04:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.477+0000 7f64d9400700 1 -- start start 2024-01-22T05:04:52.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.481+0000 7f64d9400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64d4065240 0x7f64d40644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.481+0000 7f64d9400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64d40649e0 0x7f64d415c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.481+0000 7f64d9400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d4064e90 con 0x7f64d4065620 2024-01-22T05:04:52.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.481+0000 7f64d9400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d40c2700 con 0x7f64d40649e0 2024-01-22T05:04:52.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.481+0000 7f64d9400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d40c29a0 con 0x7f64d4065240 2024-01-22T05:04:52.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.481+0000 7f64d2800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64d4065240 0x7f64d40644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.481+0000 7f64d8a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64d40649e0 0x7f64d415c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.481+0000 7f64d1e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f64d4065620 0x7f64d415b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:39402/0 (socket says 172.21.15.49:39402) 2024-01-22T05:04:52.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.481+0000 7f64d1e00700 1 -- 172.21.15.49:0/108757336 learned_addr learned my addr 172.21.15.49:0/108757336 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:52.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d2800700 1 -- 172.21.15.49:0/108757336 >> v2:172.21.15.110:3300/0 conn(0x7f64d40649e0 msgr2=0x7f64d415c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:52.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d2800700 1 --2- 172.21.15.49:0/108757336 >> v2:172.21.15.110:3300/0 conn(0x7f64d40649e0 0x7f64d415c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d2800700 1 -- 172.21.15.49:0/108757336 >> v1:172.21.15.110:6789/0 conn(0x7f64d4065620 legacy=0x7f64d415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d2800700 1 -- 172.21.15.49:0/108757336 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d40c2c80 con 0x7f64d4065240 2024-01-22T05:04:52.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d2800700 1 --2- 172.21.15.49:0/108757336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64d4065240 0x7f64d40644f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f64c4009760 tx=0x7f64c4009060).ready entity=mon.2 client_cookie=19007974f84a561e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:52.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d1400700 1 -- 172.21.15.49:0/108757336 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c400f510 con 0x7f64d4065240 2024-01-22T05:04:52.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d1400700 1 -- 172.21.15.49:0/108757336 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c400f670 con 0x7f64d4065240 2024-01-22T05:04:52.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d1400700 1 -- 172.21.15.49:0/108757336 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c400f9f0 con 0x7f64d4065240 2024-01-22T05:04:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d9400700 1 -- 172.21.15.49:0/108757336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64d4065240 msgr2=0x7f64d40644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d9400700 1 --2- 172.21.15.49:0/108757336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64d4065240 0x7f64d40644f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f64c4009760 tx=0x7f64c4009060).stop 2024-01-22T05:04:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d9400700 1 -- 172.21.15.49:0/108757336 shutdown_connections 2024-01-22T05:04:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d9400700 1 --2- 172.21.15.49:0/108757336 >> v2:172.21.15.110:3300/0 conn(0x7f64d40649e0 0x7f64d415c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d9400700 1 --2- 172.21.15.49:0/108757336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64d4065240 0x7f64d40644f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d9400700 1 -- 172.21.15.49:0/108757336 >> 172.21.15.49:0/108757336 conn(0x7f64d40c87f0 msgr2=0x7f64d40c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d9400700 1 -- 172.21.15.49:0/108757336 shutdown_connections 2024-01-22T05:04:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.485+0000 7f64d9400700 1 -- 172.21.15.49:0/108757336 wait complete. 2024-01-22T05:04:52.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.489+0000 7f64d9400700 1 Processor -- start 2024-01-22T05:04:52.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.493+0000 7f64d9400700 1 -- start start 2024-01-22T05:04:52.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.493+0000 7f64d9400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64d40649e0 0x7f64d4150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.493+0000 7f64d9400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64d4065240 0x7f64d40a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.493+0000 7f64d9400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64d4065620 0x7f64d40a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.493+0000 7f64d9400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d40a8a70 con 0x7f64d4065620 2024-01-22T05:04:52.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.493+0000 7f64d9400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d40a8e10 con 0x7f64d40649e0 2024-01-22T05:04:52.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.493+0000 7f64d9400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d4150720 con 0x7f64d4065240 2024-01-22T05:04:52.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.493+0000 7f64d8a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64d4065620 0x7f64d40a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.497+0000 7f64d2800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64d40649e0 0x7f64d4150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.497+0000 7f64d1e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64d4065240 0x7f64d40a7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.493+0000 7f64d8a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64d4065620 0x7f64d40a7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48256/0 (socket says 172.21.15.49:48256) 2024-01-22T05:04:52.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.497+0000 7f64d8a00700 1 -- 172.21.15.49:0/806855896 learned_addr learned my addr 172.21.15.49:0/806855896 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:52.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.497+0000 7f64d8a00700 1 -- 172.21.15.49:0/806855896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64d4065240 msgr2=0x7f64d40a7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.497+0000 7f64d8a00700 1 --2- 172.21.15.49:0/806855896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64d4065240 0x7f64d40a7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.497+0000 7f64d8a00700 1 -- 172.21.15.49:0/806855896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64d40649e0 msgr2=0x7f64d4150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.497+0000 7f64d8a00700 1 --2- 172.21.15.49:0/806855896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64d40649e0 0x7f64d4150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.497+0000 7f64d8a00700 1 -- 172.21.15.49:0/806855896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c40092a0 con 0x7f64d4065620 2024-01-22T05:04:52.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.497+0000 7f64d8a00700 1 --2- 172.21.15.49:0/806855896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64d4065620 0x7f64d40a7c20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f64cc009e90 tx=0x7f64cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:52.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.497+0000 7f64ca000700 1 -- 172.21.15.49:0/806855896 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc00caa0 con 0x7f64d4065620 2024-01-22T05:04:52.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.497+0000 7f64ca000700 1 -- 172.21.15.49:0/806855896 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc00f040 con 0x7f64d4065620 2024-01-22T05:04:52.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.497+0000 7f64d9400700 1 -- 172.21.15.49:0/806855896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d40a81d0 con 0x7f64d4065620 2024-01-22T05:04:52.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.497+0000 7f64ca000700 1 -- 172.21.15.49:0/806855896 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc00ce10 con 0x7f64d4065620 2024-01-22T05:04:52.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.497+0000 7f64d9400700 1 -- 172.21.15.49:0/806855896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d40a8790 con 0x7f64d4065620 2024-01-22T05:04:52.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.497+0000 7f64d9400700 1 -- 172.21.15.49:0/806855896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64d40a8be0 con 0x7f64d4065620 2024-01-22T05:04:52.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.501+0000 7f64ca000700 1 -- 172.21.15.49:0/806855896 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f64cc013610 con 0x7f64d4065620 2024-01-22T05:04:52.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.501+0000 7f64ca000700 1 --2- 172.21.15.49:0/806855896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f64ac05a510 0x7f64ac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.501+0000 7f64ca000700 1 -- 172.21.15.49:0/806855896 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f64cc075450 con 0x7f64d4065620 2024-01-22T05:04:52.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.501+0000 7f64d2800700 1 --2- 172.21.15.49:0/806855896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f64ac05a510 0x7f64ac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.501+0000 7f64ca000700 1 --2- 172.21.15.49:0/806855896 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x7f64ac064d60 0x7f64ac067200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.501+0000 7f64ca000700 1 -- 172.21.15.49:0/806855896 --> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64ac067880 con 0x7f64ac064d60 2024-01-22T05:04:52.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.501+0000 7f64ca000700 1 -- 172.21.15.49:0/806855896 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64cc0779b0 con 0x7f64d4065620 2024-01-22T05:04:52.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.501+0000 7f64d1e00700 1 --2- 172.21.15.49:0/806855896 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x7f64ac064d60 0x7f64ac067200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.501+0000 7f64d2800700 1 --2- 172.21.15.49:0/806855896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f64ac05a510 0x7f64ac05c9d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f64c4009fd0 tx=0x7f64c4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:52.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.505+0000 7f64d1e00700 1 --2- 172.21.15.49:0/806855896 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x7f64ac064d60 0x7f64ac067200 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:52.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.505+0000 7f64ca000700 1 -- 172.21.15.49:0/806855896 <== osd.0 v2:172.21.15.49:6808/22975 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f64ac067880 con 0x7f64ac064d60 2024-01-22T05:04:52.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.525+0000 7f64d9400700 1 -- 172.21.15.49:0/806855896 --> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f64d40a8fa0 con 0x7f64ac064d60 2024-01-22T05:04:52.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.525+0000 7f64ca000700 1 -- 172.21.15.49:0/806855896 <== osd.0 v2:172.21.15.49:6808/22975 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f64d40a8fa0 con 0x7f64ac064d60 2024-01-22T05:04:52.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.525+0000 7f64d9400700 1 -- 172.21.15.49:0/806855896 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x7f64ac064d60 msgr2=0x7f64ac067200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.525+0000 7f64d9400700 1 --2- 172.21.15.49:0/806855896 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x7f64ac064d60 0x7f64ac067200 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.525+0000 7f64d9400700 1 -- 172.21.15.49:0/806855896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f64ac05a510 msgr2=0x7f64ac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.525+0000 7f64d9400700 1 --2- 172.21.15.49:0/806855896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f64ac05a510 0x7f64ac05c9d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f64c4009fd0 tx=0x7f64c4017000).stop 2024-01-22T05:04:52.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.525+0000 7f64d9400700 1 -- 172.21.15.49:0/806855896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64d4065620 msgr2=0x7f64d40a7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.525+0000 7f64d9400700 1 --2- 172.21.15.49:0/806855896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64d4065620 0x7f64d40a7c20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f64cc009e90 tx=0x7f64cc00b040).stop 2024-01-22T05:04:52.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.525+0000 7f64d8a00700 1 -- 172.21.15.49:0/806855896 reap_dead start 2024-01-22T05:04:52.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.525+0000 7f64d9400700 1 -- 172.21.15.49:0/806855896 shutdown_connections 2024-01-22T05:04:52.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.525+0000 7f64d9400700 1 -- 172.21.15.49:0/806855896 >> 172.21.15.49:0/806855896 conn(0x7f64d40c87f0 msgr2=0x7f64d4062af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:52.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.525+0000 7f64d9400700 1 -- 172.21.15.49:0/806855896 shutdown_connections 2024-01-22T05:04:52.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.525+0000 7f64d9400700 1 -- 172.21.15.49:0/806855896 wait complete. 2024-01-22T05:04:52.551 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2024-01-22T05:04:52.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-22T05:04:52.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.705+0000 7fcdcb600700 1 Processor -- start 2024-01-22T05:04:52.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.705+0000 7fcdcb600700 1 -- start start 2024-01-22T05:04:52.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.709+0000 7fcdcb600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcdc41547c0 0x7fcdc40c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.709+0000 7fcdcb600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc40691b0 0x7fcdc40bbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.709+0000 7fcdcb600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc40c2330 con 0x7fcdc41500b0 2024-01-22T05:04:52.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.709+0000 7fcdcb600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc4066950 con 0x7fcdc41547c0 2024-01-22T05:04:52.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.709+0000 7fcdcb600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc40c2610 con 0x7fcdc40691b0 2024-01-22T05:04:52.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.709+0000 7fcdc8c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcdc41547c0 0x7fcdc40c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.709+0000 7fcdc3e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcdc41500b0 0x7fcdc4068aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33598/0 (socket says 172.21.15.49:33598) 2024-01-22T05:04:52.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.709+0000 7fcdc3e00700 1 -- 172.21.15.49:0/127876303 learned_addr learned my addr 172.21.15.49:0/127876303 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:52.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.709+0000 7fcdc9600700 1 --2- 172.21.15.49:0/127876303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc40691b0 0x7fcdc40bbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.709+0000 7fcdc3400700 1 -- 172.21.15.49:0/127876303 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637976494 0 0) 0x7fcdc40c2330 con 0x7fcdc41500b0 2024-01-22T05:04:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.709+0000 7fcdc3400700 1 -- 172.21.15.49:0/127876303 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcda40033f0 con 0x7fcdc41500b0 2024-01-22T05:04:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.709+0000 7fcdc8c00700 1 -- 172.21.15.49:0/127876303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc40691b0 msgr2=0x7fcdc40bbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.709+0000 7fcdc8c00700 1 --2- 172.21.15.49:0/127876303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc40691b0 0x7fcdc40bbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.709+0000 7fcdc8c00700 1 -- 172.21.15.49:0/127876303 >> v1:172.21.15.49:6789/0 conn(0x7fcdc41500b0 legacy=0x7fcdc4068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.709+0000 7fcdc8c00700 1 -- 172.21.15.49:0/127876303 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc40c28f0 con 0x7fcdc41547c0 2024-01-22T05:04:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.713+0000 7fcdc8c00700 1 --2- 172.21.15.49:0/127876303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc41547c0 0x7fcdc40c30f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fcdb4009760 tx=0x7fcdb4009060).ready entity=mon.0 client_cookie=24660f60bf5f7c07 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.713+0000 7fcdc3400700 1 -- 172.21.15.49:0/127876303 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400d4a0 con 0x7fcdc41547c0 2024-01-22T05:04:52.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.713+0000 7fcdc3400700 1 -- 172.21.15.49:0/127876303 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb400d600 con 0x7fcdc41547c0 2024-01-22T05:04:52.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.713+0000 7fcdc3400700 1 -- 172.21.15.49:0/127876303 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400d980 con 0x7fcdc41547c0 2024-01-22T05:04:52.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.713+0000 7fcdcb600700 1 -- 172.21.15.49:0/127876303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc41547c0 msgr2=0x7fcdc40c30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.713+0000 7fcdcb600700 1 --2- 172.21.15.49:0/127876303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc41547c0 0x7fcdc40c30f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fcdb4009760 tx=0x7fcdb4009060).stop 2024-01-22T05:04:52.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.713+0000 7fcdcb600700 1 -- 172.21.15.49:0/127876303 shutdown_connections 2024-01-22T05:04:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.713+0000 7fcdcb600700 1 --2- 172.21.15.49:0/127876303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc40691b0 0x7fcdc40bbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.713+0000 7fcdcb600700 1 --2- 172.21.15.49:0/127876303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc41547c0 0x7fcdc40c30f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.713+0000 7fcdcb600700 1 -- 172.21.15.49:0/127876303 >> 172.21.15.49:0/127876303 conn(0x7fcdc40c4300 msgr2=0x7fcdc4065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.713+0000 7fcdcb600700 1 -- 172.21.15.49:0/127876303 shutdown_connections 2024-01-22T05:04:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.713+0000 7fcdcb600700 1 -- 172.21.15.49:0/127876303 wait complete. 2024-01-22T05:04:52.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.717+0000 7fcdcb600700 1 Processor -- start 2024-01-22T05:04:52.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.717+0000 7fcdcb600700 1 -- start start 2024-01-22T05:04:52.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.717+0000 7fcdcb600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdc40691b0 0x7fcdc40a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.717+0000 7fcdcb600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc41500b0 0x7fcdc4149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.717+0000 7fcdcb600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc41547c0 0x7fcdc40bf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.717+0000 7fcdcb600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc40a3a50 con 0x7fcdc41500b0 2024-01-22T05:04:52.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.717+0000 7fcdcb600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc40a3d30 con 0x7fcdc40691b0 2024-01-22T05:04:52.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.717+0000 7fcdcb600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc40a4010 con 0x7fcdc41547c0 2024-01-22T05:04:52.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.717+0000 7fcdc3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc41500b0 0x7fcdc4149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.717+0000 7fcdc3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc41500b0 0x7fcdc4149870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48286/0 (socket says 172.21.15.49:48286) 2024-01-22T05:04:52.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.717+0000 7fcdc3e00700 1 -- 172.21.15.49:0/3426938869 learned_addr learned my addr 172.21.15.49:0/3426938869 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:52.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.717+0000 7fcdc9600700 1 --2- 172.21.15.49:0/3426938869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc41547c0 0x7fcdc40bf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.717+0000 7fcdc8c00700 1 --2- 172.21.15.49:0/3426938869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdc40691b0 0x7fcdc40a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.721+0000 7fcdc3e00700 1 -- 172.21.15.49:0/3426938869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc41547c0 msgr2=0x7fcdc40bf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.721+0000 7fcdc3e00700 1 --2- 172.21.15.49:0/3426938869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc41547c0 0x7fcdc40bf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.721+0000 7fcdc3e00700 1 -- 172.21.15.49:0/3426938869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdc40691b0 msgr2=0x7fcdc40a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.721+0000 7fcdc3e00700 1 --2- 172.21.15.49:0/3426938869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdc40691b0 0x7fcdc40a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.721+0000 7fcdc3e00700 1 -- 172.21.15.49:0/3426938869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb40092a0 con 0x7fcdc41500b0 2024-01-22T05:04:52.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.721+0000 7fcdc3e00700 1 --2- 172.21.15.49:0/3426938869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc41500b0 0x7fcdc4149870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fcdac00c590 tx=0x7fcdac007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:52.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.721+0000 7fcdbbe00700 1 -- 172.21.15.49:0/3426938869 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac007e40 con 0x7fcdc41500b0 2024-01-22T05:04:52.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.721+0000 7fcdbbe00700 1 -- 172.21.15.49:0/3426938869 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac0072e0 con 0x7fcdc41500b0 2024-01-22T05:04:52.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.721+0000 7fcdbbe00700 1 -- 172.21.15.49:0/3426938869 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac0057a0 con 0x7fcdc41500b0 2024-01-22T05:04:52.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.721+0000 7fcdcb600700 1 -- 172.21.15.49:0/3426938869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc40a42f0 con 0x7fcdc41500b0 2024-01-22T05:04:52.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.721+0000 7fcdcb600700 1 -- 172.21.15.49:0/3426938869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc40a51c0 con 0x7fcdc41500b0 2024-01-22T05:04:52.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.721+0000 7fcdcb600700 1 -- 172.21.15.49:0/3426938869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcdc4064b90 con 0x7fcdc41500b0 2024-01-22T05:04:52.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.725+0000 7fcdbbe00700 1 -- 172.21.15.49:0/3426938869 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcdac005bd0 con 0x7fcdc41500b0 2024-01-22T05:04:52.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.725+0000 7fcdbbe00700 1 --2- 172.21.15.49:0/3426938869 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd9c05a510 0x7fcd9c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.725+0000 7fcdbbe00700 1 -- 172.21.15.49:0/3426938869 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fcdac074470 con 0x7fcdc41500b0 2024-01-22T05:04:52.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.725+0000 7fcdc8c00700 1 --2- 172.21.15.49:0/3426938869 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd9c05a510 0x7fcd9c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.725+0000 7fcdbbe00700 1 --2- 172.21.15.49:0/3426938869 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x7fcd9c064d60 0x7fcd9c067200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.725+0000 7fcdbbe00700 1 -- 172.21.15.49:0/3426938869 --> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd9c067880 con 0x7fcd9c064d60 2024-01-22T05:04:52.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.725+0000 7fcdbbe00700 1 -- 172.21.15.49:0/3426938869 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdac0769d0 con 0x7fcdc41500b0 2024-01-22T05:04:52.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.725+0000 7fcdc9600700 1 --2- 172.21.15.49:0/3426938869 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x7fcd9c064d60 0x7fcd9c067200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.725+0000 7fcdc8c00700 1 --2- 172.21.15.49:0/3426938869 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd9c05a510 0x7fcd9c05c9d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fcdb400d260 tx=0x7fcdb4016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:52.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.725+0000 7fcdc9600700 1 --2- 172.21.15.49:0/3426938869 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x7fcd9c064d60 0x7fcd9c067200 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:52.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.729+0000 7fcdbbe00700 1 -- 172.21.15.49:0/3426938869 <== osd.1 v2:172.21.15.49:6824/22976 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fcd9c067880 con 0x7fcd9c064d60 2024-01-22T05:04:52.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.745+0000 7fcdcb600700 1 -- 172.21.15.49:0/3426938869 --> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcdc40a5350 con 0x7fcd9c064d60 2024-01-22T05:04:52.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.749+0000 7fcdbbe00700 1 -- 172.21.15.49:0/3426938869 <== osd.1 v2:172.21.15.49:6824/22976 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcdbc00f040 con 0x7fcd9c064d60 2024-01-22T05:04:52.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.749+0000 7fcdcb600700 1 -- 172.21.15.49:0/3426938869 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x7fcd9c064d60 msgr2=0x7fcd9c067200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.749+0000 7fcdcb600700 1 --2- 172.21.15.49:0/3426938869 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x7fcd9c064d60 0x7fcd9c067200 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.749+0000 7fcdcb600700 1 -- 172.21.15.49:0/3426938869 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd9c05a510 msgr2=0x7fcd9c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.749+0000 7fcdcb600700 1 --2- 172.21.15.49:0/3426938869 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd9c05a510 0x7fcd9c05c9d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fcdb400d260 tx=0x7fcdb4016000).stop 2024-01-22T05:04:52.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.749+0000 7fcdcb600700 1 -- 172.21.15.49:0/3426938869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc41500b0 msgr2=0x7fcdc4149870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.749+0000 7fcdcb600700 1 --2- 172.21.15.49:0/3426938869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc41500b0 0x7fcdc4149870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fcdac00c590 tx=0x7fcdac007c80).stop 2024-01-22T05:04:52.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.749+0000 7fcdc9600700 1 -- 172.21.15.49:0/3426938869 reap_dead start 2024-01-22T05:04:52.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.749+0000 7fcdcb600700 1 -- 172.21.15.49:0/3426938869 shutdown_connections 2024-01-22T05:04:52.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.749+0000 7fcdcb600700 1 -- 172.21.15.49:0/3426938869 >> 172.21.15.49:0/3426938869 conn(0x7fcdc40c4300 msgr2=0x7fcdc414bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:52.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.749+0000 7fcdcb600700 1 -- 172.21.15.49:0/3426938869 shutdown_connections 2024-01-22T05:04:52.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.749+0000 7fcdcb600700 1 -- 172.21.15.49:0/3426938869 wait complete. 2024-01-22T05:04:52.775 INFO:teuthology.orchestra.run.smithi049.stdout:55834574856 2024-01-22T05:04:52.775 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-22T05:04:52.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.937+0000 7f5078e00700 1 Processor -- start 2024-01-22T05:04:52.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.937+0000 7f5078e00700 1 -- start start 2024-01-22T05:04:52.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5078e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f507406a1c0 0x7f50741508e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5078e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50740a6720 0x7f5074063e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5078e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50740c3dd0 con 0x7f5074064310 2024-01-22T05:04:52.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5078e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50740a6f00 con 0x7f507406a1c0 2024-01-22T05:04:52.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5078e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5074150dd0 con 0x7f50740a6720 2024-01-22T05:04:52.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5071e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f507406a1c0 0x7f50741508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5071400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50740a6720 0x7f5074063e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5072800700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5074064310 0x7f5074154600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:39412/0 (socket says 172.21.15.49:39412) 2024-01-22T05:04:52.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5072800700 1 -- 172.21.15.49:0/298514696 learned_addr learned my addr 172.21.15.49:0/298514696 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:52.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5071e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f507406a1c0 0x7f50741508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:34238/0 (socket says 172.21.15.49:34238) 2024-01-22T05:04:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5070a00700 1 -- 172.21.15.49:0/298514696 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1773702819 0 0) 0x7f50740c3dd0 con 0x7f5074064310 2024-01-22T05:04:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5070a00700 1 -- 172.21.15.49:0/298514696 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50540033f0 con 0x7f5074064310 2024-01-22T05:04:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5071e00700 1 -- 172.21.15.49:0/298514696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50740a6720 msgr2=0x7f5074063e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5071e00700 1 --2- 172.21.15.49:0/298514696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50740a6720 0x7f5074063e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5071e00700 1 -- 172.21.15.49:0/298514696 >> v1:172.21.15.110:6789/0 conn(0x7f5074064310 legacy=0x7f5074154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5071e00700 1 -- 172.21.15.49:0/298514696 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507406a5a0 con 0x7f507406a1c0 2024-01-22T05:04:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5071400700 1 --2- 172.21.15.49:0/298514696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50740a6720 0x7f5074063e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5071e00700 1 --2- 172.21.15.49:0/298514696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f507406a1c0 0x7f50741508e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5064009760 tx=0x7f5064009060).ready entity=mon.1 client_cookie=188a5c90e55d4fbd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.941+0000 7f5070a00700 1 -- 172.21.15.49:0/298514696 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506400d4a0 con 0x7f507406a1c0 2024-01-22T05:04:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.945+0000 7f5070a00700 1 -- 172.21.15.49:0/298514696 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506400d600 con 0x7f507406a1c0 2024-01-22T05:04:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.945+0000 7f5070a00700 1 -- 172.21.15.49:0/298514696 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506400d980 con 0x7f507406a1c0 2024-01-22T05:04:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.945+0000 7f5078e00700 1 -- 172.21.15.49:0/298514696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f507406a1c0 msgr2=0x7f50741508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.945+0000 7f5078e00700 1 --2- 172.21.15.49:0/298514696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f507406a1c0 0x7f50741508e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5064009760 tx=0x7f5064009060).stop 2024-01-22T05:04:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.945+0000 7f5078e00700 1 -- 172.21.15.49:0/298514696 shutdown_connections 2024-01-22T05:04:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.945+0000 7f5078e00700 1 --2- 172.21.15.49:0/298514696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50740a6720 0x7f5074063e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.945+0000 7f5078e00700 1 --2- 172.21.15.49:0/298514696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f507406a1c0 0x7f50741508e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.945+0000 7f5078e00700 1 -- 172.21.15.49:0/298514696 >> 172.21.15.49:0/298514696 conn(0x7f5074066830 msgr2=0x7f5074066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:52.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.945+0000 7f5078e00700 1 -- 172.21.15.49:0/298514696 shutdown_connections 2024-01-22T05:04:52.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.945+0000 7f5078e00700 1 -- 172.21.15.49:0/298514696 wait complete. 2024-01-22T05:04:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.949+0000 7f5078e00700 1 Processor -- start 2024-01-22T05:04:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.949+0000 7f5078e00700 1 -- start start 2024-01-22T05:04:52.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.949+0000 7f5078e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5074064310 0x7f50740ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.949+0000 7f5078e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f507406a1c0 0x7f50740a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.949+0000 7f5078e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50740a6720 0x7f50740a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.949+0000 7f5078e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50740a5260 con 0x7f50740a6720 2024-01-22T05:04:52.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.949+0000 7f5078e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50740ab030 con 0x7f507406a1c0 2024-01-22T05:04:52.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.949+0000 7f5078e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5074164eb0 con 0x7f5074064310 2024-01-22T05:04:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.949+0000 7f5072800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50740a6720 0x7f50740a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5071e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5074064310 0x7f50740ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5072800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50740a6720 0x7f50740a4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48300/0 (socket says 172.21.15.49:48300) 2024-01-22T05:04:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5072800700 1 -- 172.21.15.49:0/3306742039 learned_addr learned my addr 172.21.15.49:0/3306742039 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5071400700 1 --2- 172.21.15.49:0/3306742039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f507406a1c0 0x7f50740a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5072800700 1 -- 172.21.15.49:0/3306742039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5074064310 msgr2=0x7f50740ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5072800700 1 --2- 172.21.15.49:0/3306742039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5074064310 0x7f50740ac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5072800700 1 -- 172.21.15.49:0/3306742039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f507406a1c0 msgr2=0x7f50740a4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5072800700 1 --2- 172.21.15.49:0/3306742039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f507406a1c0 0x7f50740a4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5072800700 1 -- 172.21.15.49:0/3306742039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c0092a0 con 0x7f50740a6720 2024-01-22T05:04:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5071e00700 1 --2- 172.21.15.49:0/3306742039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5074064310 0x7f50740ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5072800700 1 --2- 172.21.15.49:0/3306742039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50740a6720 0x7f50740a4d70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f506c001460 tx=0x7f506c001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5069600700 1 -- 172.21.15.49:0/3306742039 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c005d30 con 0x7f50740a6720 2024-01-22T05:04:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5069600700 1 -- 172.21.15.49:0/3306742039 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c005e90 con 0x7f50740a6720 2024-01-22T05:04:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5078e00700 1 -- 172.21.15.49:0/3306742039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50640092a0 con 0x7f50740a6720 2024-01-22T05:04:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5069600700 1 -- 172.21.15.49:0/3306742039 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c007320 con 0x7f50740a6720 2024-01-22T05:04:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5078e00700 1 -- 172.21.15.49:0/3306742039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50740aa700 con 0x7f50740a6720 2024-01-22T05:04:52.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.953+0000 7f5078e00700 1 -- 172.21.15.49:0/3306742039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50740657b0 con 0x7f50740a6720 2024-01-22T05:04:52.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.957+0000 7f5069600700 1 -- 172.21.15.49:0/3306742039 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f506c0076d0 con 0x7f50740a6720 2024-01-22T05:04:52.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.957+0000 7f5069600700 1 --2- 172.21.15.49:0/3306742039 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f504c05a510 0x7f504c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.957+0000 7f5069600700 1 -- 172.21.15.49:0/3306742039 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f506c074b30 con 0x7f50740a6720 2024-01-22T05:04:52.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.961+0000 7f5071e00700 1 --2- 172.21.15.49:0/3306742039 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f504c05a510 0x7f504c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.961+0000 7f5069600700 1 --2- 172.21.15.49:0/3306742039 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x7f504c064d60 0x7f504c067200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:52.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.961+0000 7f5069600700 1 -- 172.21.15.49:0/3306742039 --> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f504c067880 con 0x7f504c064d60 2024-01-22T05:04:52.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.961+0000 7f5069600700 1 -- 172.21.15.49:0/3306742039 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f506c079220 con 0x7f50740a6720 2024-01-22T05:04:52.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.961+0000 7f5071400700 1 --2- 172.21.15.49:0/3306742039 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x7f504c064d60 0x7f504c067200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:52.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.961+0000 7f5071e00700 1 --2- 172.21.15.49:0/3306742039 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f504c05a510 0x7f504c05c9d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f50740a8260 tx=0x7f5064016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:52.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.961+0000 7f5071400700 1 --2- 172.21.15.49:0/3306742039 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x7f504c064d60 0x7f504c067200 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.961+0000 7f5069600700 1 -- 172.21.15.49:0/3306742039 <== osd.2 v2:172.21.15.49:6800/22974 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f504c067880 con 0x7f504c064d60 2024-01-22T05:04:52.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.981+0000 7f5078e00700 1 -- 172.21.15.49:0/3306742039 --> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5074046800 con 0x7f504c064d60 2024-01-22T05:04:52.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.981+0000 7f5069600700 1 -- 172.21.15.49:0/3306742039 <== osd.2 v2:172.21.15.49:6800/22974 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5074046800 con 0x7f504c064d60 2024-01-22T05:04:52.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.981+0000 7f5078e00700 1 -- 172.21.15.49:0/3306742039 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x7f504c064d60 msgr2=0x7f504c067200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.981+0000 7f5078e00700 1 --2- 172.21.15.49:0/3306742039 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x7f504c064d60 0x7f504c067200 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:52.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.985+0000 7f5078e00700 1 -- 172.21.15.49:0/3306742039 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f504c05a510 msgr2=0x7f504c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.985+0000 7f5078e00700 1 --2- 172.21.15.49:0/3306742039 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f504c05a510 0x7f504c05c9d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f50740a8260 tx=0x7f5064016000).stop 2024-01-22T05:04:52.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.985+0000 7f5078e00700 1 -- 172.21.15.49:0/3306742039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50740a6720 msgr2=0x7f50740a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:52.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.985+0000 7f5078e00700 1 --2- 172.21.15.49:0/3306742039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50740a6720 0x7f50740a4d70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f506c001460 tx=0x7f506c001650).stop 2024-01-22T05:04:52.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.985+0000 7f5072800700 1 -- 172.21.15.49:0/3306742039 reap_dead start 2024-01-22T05:04:52.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.985+0000 7f5078e00700 1 -- 172.21.15.49:0/3306742039 shutdown_connections 2024-01-22T05:04:52.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.985+0000 7f5078e00700 1 -- 172.21.15.49:0/3306742039 >> 172.21.15.49:0/3306742039 conn(0x7f5074066830 msgr2=0x7f50740682b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:52.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.985+0000 7f5078e00700 1 -- 172.21.15.49:0/3306742039 shutdown_connections 2024-01-22T05:04:52.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:52.985+0000 7f5078e00700 1 -- 172.21.15.49:0/3306742039 wait complete. 2024-01-22T05:04:53.008 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2024-01-22T05:04:53.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-22T05:04:53.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.177+0000 7fa87ba00700 1 Processor -- start 2024-01-22T05:04:53.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.177+0000 7fa87ba00700 1 -- start start 2024-01-22T05:04:53.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa87ba00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8740bdd90 0x7fa8740be170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa87ba00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa874062330 0x7fa8740627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa87ba00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa874068120 con 0x7fa8741587c0 2024-01-22T05:04:53.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa87ba00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8740683e0 con 0x7fa8740bdd90 2024-01-22T05:04:53.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa87ba00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8740686c0 con 0x7fa874062330 2024-01-22T05:04:53.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa879000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8740bdd90 0x7fa8740be170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa879000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8740bdd90 0x7fa8740be170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:34266/0 (socket says 172.21.15.49:34266) 2024-01-22T05:04:53.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa879000700 1 -- 172.21.15.49:0/4001716905 learned_addr learned my addr 172.21.15.49:0/4001716905 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:53.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa87a400700 1 --2- 172.21.15.49:0/4001716905 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa874062330 0x7fa8740627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa879000700 1 -- 172.21.15.49:0/4001716905 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa874062330 msgr2=0x7fa8740627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:53.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa879000700 1 --2- 172.21.15.49:0/4001716905 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa874062330 0x7fa8740627a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa879000700 1 -- 172.21.15.49:0/4001716905 >> v1:172.21.15.110:6789/0 conn(0x7fa8741587c0 legacy=0x7fa874158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa879000700 1 -- 172.21.15.49:0/4001716905 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8740689a0 con 0x7fa8740bdd90 2024-01-22T05:04:53.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa879000700 1 --2- 172.21.15.49:0/4001716905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8740bdd90 0x7fa8740be170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fa864006fd0 tx=0x7fa8640090f0).ready entity=mon.1 client_cookie=ef501748a9149c11 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa873400700 1 -- 172.21.15.49:0/4001716905 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86400b580 con 0x7fa8740bdd90 2024-01-22T05:04:53.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa873400700 1 -- 172.21.15.49:0/4001716905 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86400b6e0 con 0x7fa8740bdd90 2024-01-22T05:04:53.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.181+0000 7fa873400700 1 -- 172.21.15.49:0/4001716905 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86400ba60 con 0x7fa8740bdd90 2024-01-22T05:04:53.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.185+0000 7fa87ba00700 1 -- 172.21.15.49:0/4001716905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8740bdd90 msgr2=0x7fa8740be170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.185+0000 7fa87ba00700 1 --2- 172.21.15.49:0/4001716905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8740bdd90 0x7fa8740be170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fa864006fd0 tx=0x7fa8640090f0).stop 2024-01-22T05:04:53.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.185+0000 7fa87ba00700 1 -- 172.21.15.49:0/4001716905 shutdown_connections 2024-01-22T05:04:53.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.185+0000 7fa87ba00700 1 --2- 172.21.15.49:0/4001716905 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa874062330 0x7fa8740627a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.185+0000 7fa87ba00700 1 --2- 172.21.15.49:0/4001716905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8740bdd90 0x7fa8740be170 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.185+0000 7fa87ba00700 1 -- 172.21.15.49:0/4001716905 >> 172.21.15.49:0/4001716905 conn(0x7fa874064080 msgr2=0x7fa874064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:53.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.185+0000 7fa87ba00700 1 -- 172.21.15.49:0/4001716905 shutdown_connections 2024-01-22T05:04:53.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.185+0000 7fa87ba00700 1 -- 172.21.15.49:0/4001716905 wait complete. 2024-01-22T05:04:53.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.189+0000 7fa87ba00700 1 Processor -- start 2024-01-22T05:04:53.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.189+0000 7fa87ba00700 1 -- start start 2024-01-22T05:04:53.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.189+0000 7fa87ba00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa874062330 0x7fa8741683c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.189+0000 7fa87ba00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8740bdd90 0x7fa874151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.189+0000 7fa87ba00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8741587c0 0x7fa874154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.189+0000 7fa87ba00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa874152d20 con 0x7fa874062330 2024-01-22T05:04:53.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.189+0000 7fa87ba00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8741689f0 con 0x7fa8741587c0 2024-01-22T05:04:53.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.189+0000 7fa87ba00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa874168cd0 con 0x7fa8740bdd90 2024-01-22T05:04:53.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa879000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa874062330 0x7fa8741683c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa87a400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8741587c0 0x7fa874154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa87a400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8741587c0 0x7fa874154780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:34274/0 (socket says 172.21.15.49:34274) 2024-01-22T05:04:53.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa87a400700 1 -- 172.21.15.49:0/673053342 learned_addr learned my addr 172.21.15.49:0/673053342 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:53.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa873e00700 1 --2- 172.21.15.49:0/673053342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8740bdd90 0x7fa874151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa879000700 1 -- 172.21.15.49:0/673053342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8740bdd90 msgr2=0x7fa874151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa879000700 1 --2- 172.21.15.49:0/673053342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8740bdd90 0x7fa874151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa879000700 1 -- 172.21.15.49:0/673053342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8741587c0 msgr2=0x7fa874154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa879000700 1 --2- 172.21.15.49:0/673053342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8741587c0 0x7fa874154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa879000700 1 -- 172.21.15.49:0/673053342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa864009370 con 0x7fa874062330 2024-01-22T05:04:53.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa87a400700 1 --2- 172.21.15.49:0/673053342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8741587c0 0x7fa874154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:53.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa879000700 1 --2- 172.21.15.49:0/673053342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa874062330 0x7fa8741683c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa864014000 tx=0x7fa864017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa86be00700 1 -- 172.21.15.49:0/673053342 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864000bc0 con 0x7fa874062330 2024-01-22T05:04:53.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa86be00700 1 -- 172.21.15.49:0/673053342 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86400b850 con 0x7fa874062330 2024-01-22T05:04:53.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa86be00700 1 -- 172.21.15.49:0/673053342 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864000d20 con 0x7fa874062330 2024-01-22T05:04:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa87ba00700 1 -- 172.21.15.49:0/673053342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa874168fb0 con 0x7fa874062330 2024-01-22T05:04:53.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.193+0000 7fa87ba00700 1 -- 172.21.15.49:0/673053342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa874151710 con 0x7fa874062330 2024-01-22T05:04:53.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.197+0000 7fa87ba00700 1 -- 172.21.15.49:0/673053342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa874047060 con 0x7fa874062330 2024-01-22T05:04:53.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.197+0000 7fa86be00700 1 -- 172.21.15.49:0/673053342 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa86401cad0 con 0x7fa874062330 2024-01-22T05:04:53.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.197+0000 7fa86be00700 1 --2- 172.21.15.49:0/673053342 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa84c05a510 0x7fa84c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.197+0000 7fa86be00700 1 -- 172.21.15.49:0/673053342 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fa8640769f0 con 0x7fa874062330 2024-01-22T05:04:53.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.197+0000 7fa873e00700 1 --2- 172.21.15.49:0/673053342 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa84c05a510 0x7fa84c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.197+0000 7fa86be00700 1 --2- 172.21.15.49:0/673053342 >> [v2:172.21.15.49:6816/22977,v1:172.21.15.49:6817/22977] conn(0x7fa84c064d60 0x7fa84c067200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.197+0000 7fa86be00700 1 -- 172.21.15.49:0/673053342 --> [v2:172.21.15.49:6816/22977,v1:172.21.15.49:6817/22977] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa84c067880 con 0x7fa84c064d60 2024-01-22T05:04:53.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.197+0000 7fa86be00700 1 -- 172.21.15.49:0/673053342 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa86407b220 con 0x7fa874062330 2024-01-22T05:04:53.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.197+0000 7fa87a400700 1 --2- 172.21.15.49:0/673053342 >> [v2:172.21.15.49:6816/22977,v1:172.21.15.49:6817/22977] conn(0x7fa84c064d60 0x7fa84c067200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.201+0000 7fa873e00700 1 --2- 172.21.15.49:0/673053342 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa84c05a510 0x7fa84c05c9d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fa8740abb00 tx=0x7fa85c007d20).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.201+0000 7fa87a400700 1 --2- 172.21.15.49:0/673053342 >> [v2:172.21.15.49:6816/22977,v1:172.21.15.49:6817/22977] conn(0x7fa84c064d60 0x7fa84c067200 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.201+0000 7fa86be00700 1 -- 172.21.15.49:0/673053342 <== osd.3 v2:172.21.15.49:6816/22977 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fa84c067880 con 0x7fa84c064d60 2024-01-22T05:04:53.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.217+0000 7fa87ba00700 1 -- 172.21.15.49:0/673053342 --> [v2:172.21.15.49:6816/22977,v1:172.21.15.49:6817/22977] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa874152e60 con 0x7fa84c064d60 2024-01-22T05:04:53.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.221+0000 7fa86be00700 1 -- 172.21.15.49:0/673053342 <== osd.3 v2:172.21.15.49:6816/22977 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa86c00f040 con 0x7fa84c064d60 2024-01-22T05:04:53.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.221+0000 7fa87ba00700 1 -- 172.21.15.49:0/673053342 >> [v2:172.21.15.49:6816/22977,v1:172.21.15.49:6817/22977] conn(0x7fa84c064d60 msgr2=0x7fa84c067200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.221+0000 7fa87ba00700 1 --2- 172.21.15.49:0/673053342 >> [v2:172.21.15.49:6816/22977,v1:172.21.15.49:6817/22977] conn(0x7fa84c064d60 0x7fa84c067200 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.221+0000 7fa87ba00700 1 -- 172.21.15.49:0/673053342 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa84c05a510 msgr2=0x7fa84c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.221+0000 7fa87ba00700 1 --2- 172.21.15.49:0/673053342 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa84c05a510 0x7fa84c05c9d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fa8740abb00 tx=0x7fa85c007d20).stop 2024-01-22T05:04:53.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.221+0000 7fa87ba00700 1 -- 172.21.15.49:0/673053342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa874062330 msgr2=0x7fa8741683c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.221+0000 7fa87ba00700 1 --2- 172.21.15.49:0/673053342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa874062330 0x7fa8741683c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa864014000 tx=0x7fa864017000).stop 2024-01-22T05:04:53.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.221+0000 7fa87a400700 1 -- 172.21.15.49:0/673053342 reap_dead start 2024-01-22T05:04:53.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.221+0000 7fa87ba00700 1 -- 172.21.15.49:0/673053342 shutdown_connections 2024-01-22T05:04:53.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.221+0000 7fa87ba00700 1 -- 172.21.15.49:0/673053342 >> 172.21.15.49:0/673053342 conn(0x7fa874064080 msgr2=0x7fa8740c5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:53.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.221+0000 7fa87ba00700 1 -- 172.21.15.49:0/673053342 shutdown_connections 2024-01-22T05:04:53.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.221+0000 7fa87ba00700 1 -- 172.21.15.49:0/673053342 wait complete. 2024-01-22T05:04:53.252 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2024-01-22T05:04:53.252 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-22T05:04:53.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.417+0000 7f386be00700 1 Processor -- start 2024-01-22T05:04:53.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.421+0000 7f386be00700 1 -- start start 2024-01-22T05:04:53.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f386be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3864062230 0x7f3864062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f386be00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3864068aa0 0x7f3864068ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f386be00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3864062b40 con 0x7f3864153e90 2024-01-22T05:04:53.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f386be00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3864154270 con 0x7f3864068aa0 2024-01-22T05:04:53.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f386be00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38640693e0 con 0x7f3864062230 2024-01-22T05:04:53.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f3869400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3864153e90 0x7f38640c2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33970/0 (socket says 172.21.15.49:33970) 2024-01-22T05:04:53.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f3869400700 1 -- 172.21.15.49:0/3154505521 learned_addr learned my addr 172.21.15.49:0/3154505521 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:53.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f3868a00700 1 --2- 172.21.15.49:0/3154505521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3864062230 0x7f3864062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f3869e00700 1 --2- 172.21.15.49:0/3154505521 >> v2:172.21.15.110:3300/0 conn(0x7f3864068aa0 0x7f3864068ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f3863e00700 1 -- 172.21.15.49:0/3154505521 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476616175 0 0) 0x7f3864062b40 con 0x7f3864153e90 2024-01-22T05:04:53.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f3863e00700 1 -- 172.21.15.49:0/3154505521 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38440033f0 con 0x7f3864153e90 2024-01-22T05:04:53.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f3868a00700 1 -- 172.21.15.49:0/3154505521 >> v2:172.21.15.110:3300/0 conn(0x7f3864068aa0 msgr2=0x7f3864068ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:53.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f3868a00700 1 --2- 172.21.15.49:0/3154505521 >> v2:172.21.15.110:3300/0 conn(0x7f3864068aa0 0x7f3864068ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f3868a00700 1 -- 172.21.15.49:0/3154505521 >> v1:172.21.15.49:6789/0 conn(0x7f3864153e90 legacy=0x7f38640c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f3868a00700 1 -- 172.21.15.49:0/3154505521 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38640c1d40 con 0x7f3864062230 2024-01-22T05:04:53.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f3868a00700 1 --2- 172.21.15.49:0/3154505521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3864062230 0x7f3864062650 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f384c009760 tx=0x7f384c009060).ready entity=mon.2 client_cookie=3d28040ba7a41180 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f3863e00700 1 -- 172.21.15.49:0/3154505521 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c0090d0 con 0x7f3864062230 2024-01-22T05:04:53.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f3863e00700 1 -- 172.21.15.49:0/3154505521 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384c00d4a0 con 0x7f3864062230 2024-01-22T05:04:53.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.425+0000 7f3863e00700 1 -- 172.21.15.49:0/3154505521 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c00d820 con 0x7f3864062230 2024-01-22T05:04:53.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.429+0000 7f386be00700 1 -- 172.21.15.49:0/3154505521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3864062230 msgr2=0x7f3864062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.429+0000 7f386be00700 1 --2- 172.21.15.49:0/3154505521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3864062230 0x7f3864062650 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f384c009760 tx=0x7f384c009060).stop 2024-01-22T05:04:53.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.429+0000 7f386be00700 1 -- 172.21.15.49:0/3154505521 shutdown_connections 2024-01-22T05:04:53.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.429+0000 7f386be00700 1 --2- 172.21.15.49:0/3154505521 >> v2:172.21.15.110:3300/0 conn(0x7f3864068aa0 0x7f3864068ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.429+0000 7f386be00700 1 --2- 172.21.15.49:0/3154505521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3864062230 0x7f3864062650 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.429+0000 7f386be00700 1 -- 172.21.15.49:0/3154505521 >> 172.21.15.49:0/3154505521 conn(0x7f38640c4300 msgr2=0x7f3864065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:53.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.429+0000 7f386be00700 1 -- 172.21.15.49:0/3154505521 shutdown_connections 2024-01-22T05:04:53.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.429+0000 7f386be00700 1 -- 172.21.15.49:0/3154505521 wait complete. 2024-01-22T05:04:53.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.429+0000 7f386be00700 1 Processor -- start 2024-01-22T05:04:53.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f386be00700 1 -- start start 2024-01-22T05:04:53.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f386be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3864062230 0x7f3864148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f386be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3864068aa0 0x7f38640bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f386be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3864153e90 0x7f38640bfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f386be00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386414bf20 con 0x7f3864153e90 2024-01-22T05:04:53.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f386be00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38640bffd0 con 0x7f3864068aa0 2024-01-22T05:04:53.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f386be00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38641497b0 con 0x7f3864062230 2024-01-22T05:04:53.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f3869e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3864153e90 0x7f38640bfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f3869e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3864153e90 0x7f38640bfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36116/0 (socket says 172.21.15.49:36116) 2024-01-22T05:04:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f3869e00700 1 -- 172.21.15.49:0/2254869664 learned_addr learned my addr 172.21.15.49:0/2254869664 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f3868a00700 1 --2- 172.21.15.49:0/2254869664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3864068aa0 0x7f38640bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f3869400700 1 --2- 172.21.15.49:0/2254869664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3864062230 0x7f3864148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f3869e00700 1 -- 172.21.15.49:0/2254869664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3864062230 msgr2=0x7f3864148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f3869e00700 1 --2- 172.21.15.49:0/2254869664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3864062230 0x7f3864148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f3869e00700 1 -- 172.21.15.49:0/2254869664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3864068aa0 msgr2=0x7f38640bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f3869e00700 1 --2- 172.21.15.49:0/2254869664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3864068aa0 0x7f38640bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f3869e00700 1 -- 172.21.15.49:0/2254869664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c0092a0 con 0x7f3864153e90 2024-01-22T05:04:53.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.433+0000 7f3869e00700 1 --2- 172.21.15.49:0/2254869664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3864153e90 0x7f38640bfae0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f385c009e90 tx=0x7f385c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.437+0000 7f3860c00700 1 -- 172.21.15.49:0/2254869664 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c00ca40 con 0x7f3864153e90 2024-01-22T05:04:53.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.437+0000 7f3860c00700 1 -- 172.21.15.49:0/2254869664 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c00f040 con 0x7f3864153e90 2024-01-22T05:04:53.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.437+0000 7f386be00700 1 -- 172.21.15.49:0/2254869664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386414b2a0 con 0x7f3864153e90 2024-01-22T05:04:53.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.437+0000 7f3860c00700 1 -- 172.21.15.49:0/2254869664 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c00cdb0 con 0x7f3864153e90 2024-01-22T05:04:53.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.437+0000 7f386be00700 1 -- 172.21.15.49:0/2254869664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386414b860 con 0x7f3864153e90 2024-01-22T05:04:53.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.437+0000 7f386be00700 1 -- 172.21.15.49:0/2254869664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38640c2650 con 0x7f3864153e90 2024-01-22T05:04:53.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.437+0000 7f3860c00700 1 -- 172.21.15.49:0/2254869664 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f385c013610 con 0x7f3864153e90 2024-01-22T05:04:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.437+0000 7f3860c00700 1 --2- 172.21.15.49:0/2254869664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f383c05a540 0x7f383c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.441+0000 7f3860c00700 1 -- 172.21.15.49:0/2254869664 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f385c0752b0 con 0x7f3864153e90 2024-01-22T05:04:53.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.441+0000 7f3869400700 1 --2- 172.21.15.49:0/2254869664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f383c05a540 0x7f383c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.441+0000 7f3860c00700 1 --2- 172.21.15.49:0/2254869664 >> [v2:172.21.15.110:6816/23256,v1:172.21.15.110:6817/23256] conn(0x7f383c064d90 0x7f383c067230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.441+0000 7f3860c00700 1 -- 172.21.15.49:0/2254869664 --> [v2:172.21.15.110:6816/23256,v1:172.21.15.110:6817/23256] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f383c0678b0 con 0x7f383c064d90 2024-01-22T05:04:53.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.441+0000 7f3860c00700 1 -- 172.21.15.49:0/2254869664 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f385c0778d0 con 0x7f3864153e90 2024-01-22T05:04:53.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.441+0000 7f3868a00700 1 --2- 172.21.15.49:0/2254869664 >> [v2:172.21.15.110:6816/23256,v1:172.21.15.110:6817/23256] conn(0x7f383c064d90 0x7f383c067230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.441+0000 7f3869400700 1 --2- 172.21.15.49:0/2254869664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f383c05a540 0x7f383c05ca00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3854007fd0 tx=0x7f3854009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.441+0000 7f3868a00700 1 --2- 172.21.15.49:0/2254869664 >> [v2:172.21.15.110:6816/23256,v1:172.21.15.110:6817/23256] conn(0x7f383c064d90 0x7f383c067230 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.441+0000 7f3860c00700 1 -- 172.21.15.49:0/2254869664 <== osd.4 v2:172.21.15.110:6816/23256 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f383c0678b0 con 0x7f383c064d90 2024-01-22T05:04:53.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.461+0000 7f386be00700 1 -- 172.21.15.49:0/2254869664 --> [v2:172.21.15.110:6816/23256,v1:172.21.15.110:6817/23256] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3864064b90 con 0x7f383c064d90 2024-01-22T05:04:53.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.461+0000 7f3860c00700 1 -- 172.21.15.49:0/2254869664 <== osd.4 v2:172.21.15.110:6816/23256 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3864064b90 con 0x7f383c064d90 2024-01-22T05:04:53.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.461+0000 7f386be00700 1 -- 172.21.15.49:0/2254869664 >> [v2:172.21.15.110:6816/23256,v1:172.21.15.110:6817/23256] conn(0x7f383c064d90 msgr2=0x7f383c067230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.461+0000 7f386be00700 1 --2- 172.21.15.49:0/2254869664 >> [v2:172.21.15.110:6816/23256,v1:172.21.15.110:6817/23256] conn(0x7f383c064d90 0x7f383c067230 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.461+0000 7f386be00700 1 -- 172.21.15.49:0/2254869664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f383c05a540 msgr2=0x7f383c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.461+0000 7f386be00700 1 --2- 172.21.15.49:0/2254869664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f383c05a540 0x7f383c05ca00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3854007fd0 tx=0x7f3854009040).stop 2024-01-22T05:04:53.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.461+0000 7f386be00700 1 -- 172.21.15.49:0/2254869664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3864153e90 msgr2=0x7f38640bfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.461+0000 7f386be00700 1 --2- 172.21.15.49:0/2254869664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3864153e90 0x7f38640bfae0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f385c009e90 tx=0x7f385c00b040).stop 2024-01-22T05:04:53.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.461+0000 7f3869e00700 1 -- 172.21.15.49:0/2254869664 reap_dead start 2024-01-22T05:04:53.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.461+0000 7f386be00700 1 -- 172.21.15.49:0/2254869664 shutdown_connections 2024-01-22T05:04:53.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.461+0000 7f386be00700 1 -- 172.21.15.49:0/2254869664 >> 172.21.15.49:0/2254869664 conn(0x7f38640c4300 msgr2=0x7f38640c5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:53.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.461+0000 7f386be00700 1 -- 172.21.15.49:0/2254869664 shutdown_connections 2024-01-22T05:04:53.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.465+0000 7f386be00700 1 -- 172.21.15.49:0/2254869664 wait complete. 2024-01-22T05:04:53.487 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2024-01-22T05:04:53.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-22T05:04:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.653+0000 7f9d79c00700 1 Processor -- start 2024-01-22T05:04:53.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.657+0000 7f9d79c00700 1 -- start start 2024-01-22T05:04:53.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.657+0000 7f9d79c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d740a9770 0x7f9d740be450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.657+0000 7f9d79c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d74069250 con 0x7f9d740c3b30 2024-01-22T05:04:53.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.657+0000 7f9d79c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d740bf140 con 0x7f9d740be940 2024-01-22T05:04:53.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.657+0000 7f9d79c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d74068460 con 0x7f9d740a9770 2024-01-22T05:04:53.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.657+0000 7f9d73e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9d740c3b30 0x7f9d740bdd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33980/0 (socket says 172.21.15.49:33980) 2024-01-22T05:04:53.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.657+0000 7f9d73e00700 1 -- 172.21.15.49:0/4020469264 learned_addr learned my addr 172.21.15.49:0/4020469264 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:53.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.657+0000 7f9d79200700 1 --1- 172.21.15.49:0/4020469264 >> v1:172.21.15.110:6789/0 conn(0x7f9d740be940 0x7f9d7415b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:54930/0 (socket says 172.21.15.49:54930) 2024-01-22T05:04:53.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.657+0000 7f9d73400700 1 --2- 172.21.15.49:0/4020469264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d740a9770 0x7f9d740be450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d72a00700 1 -- 172.21.15.49:0/4020469264 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620761227 0 0) 0x7f9d74069250 con 0x7f9d740c3b30 2024-01-22T05:04:53.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d72a00700 1 -- 172.21.15.49:0/4020469264 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d540033f0 con 0x7f9d740c3b30 2024-01-22T05:04:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d73400700 1 -- 172.21.15.49:0/4020469264 >> v1:172.21.15.110:6789/0 conn(0x7f9d740be940 legacy=0x7f9d7415b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d72a00700 1 -- 172.21.15.49:0/4020469264 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3916254092 0 0) 0x7f9d740bf140 con 0x7f9d740be940 2024-01-22T05:04:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d73400700 1 -- 172.21.15.49:0/4020469264 >> v1:172.21.15.49:6789/0 conn(0x7f9d740c3b30 legacy=0x7f9d740bdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d73400700 1 -- 172.21.15.49:0/4020469264 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d74068640 con 0x7f9d740a9770 2024-01-22T05:04:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d73400700 1 --2- 172.21.15.49:0/4020469264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d740a9770 0x7f9d740be450 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f9d5c009790 tx=0x7f9d5c009060).ready entity=mon.2 client_cookie=3f314776fbd15184 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d72a00700 1 -- 172.21.15.49:0/4020469264 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c00f510 con 0x7f9d740a9770 2024-01-22T05:04:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d72a00700 1 -- 172.21.15.49:0/4020469264 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c00f670 con 0x7f9d740a9770 2024-01-22T05:04:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d72a00700 1 -- 172.21.15.49:0/4020469264 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c00f9f0 con 0x7f9d740a9770 2024-01-22T05:04:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d79c00700 1 -- 172.21.15.49:0/4020469264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d740a9770 msgr2=0x7f9d740be450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d79c00700 1 --2- 172.21.15.49:0/4020469264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d740a9770 0x7f9d740be450 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f9d5c009790 tx=0x7f9d5c009060).stop 2024-01-22T05:04:53.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d79c00700 1 -- 172.21.15.49:0/4020469264 shutdown_connections 2024-01-22T05:04:53.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d79c00700 1 --2- 172.21.15.49:0/4020469264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d740a9770 0x7f9d740be450 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d79c00700 1 -- 172.21.15.49:0/4020469264 >> 172.21.15.49:0/4020469264 conn(0x7f9d740c8740 msgr2=0x7f9d740c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:53.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d79c00700 1 -- 172.21.15.49:0/4020469264 shutdown_connections 2024-01-22T05:04:53.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.661+0000 7f9d79c00700 1 -- 172.21.15.49:0/4020469264 wait complete. 2024-01-22T05:04:53.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.665+0000 7f9d79c00700 1 Processor -- start 2024-01-22T05:04:53.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.665+0000 7f9d79c00700 1 -- start start 2024-01-22T05:04:53.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d79c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d740a9770 0x7f9d74164d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d79c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740be940 0x7f9d7414f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d79c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d740c3b30 0x7f9d7414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d79c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d74147d50 con 0x7f9d740be940 2024-01-22T05:04:53.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d79c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d74150320 con 0x7f9d740c3b30 2024-01-22T05:04:53.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d79c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740c2070 con 0x7f9d740a9770 2024-01-22T05:04:53.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d73400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740be940 0x7f9d7414f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d73400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740be940 0x7f9d7414f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36120/0 (socket says 172.21.15.49:36120) 2024-01-22T05:04:53.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d73400700 1 -- 172.21.15.49:0/1143930689 learned_addr learned my addr 172.21.15.49:0/1143930689 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:53.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d73e00700 1 --2- 172.21.15.49:0/1143930689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d740a9770 0x7f9d74164d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d79200700 1 --2- 172.21.15.49:0/1143930689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d740c3b30 0x7f9d7414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d73400700 1 -- 172.21.15.49:0/1143930689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d740a9770 msgr2=0x7f9d74164d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d73400700 1 --2- 172.21.15.49:0/1143930689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d740a9770 0x7f9d74164d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d73400700 1 -- 172.21.15.49:0/1143930689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d740c3b30 msgr2=0x7f9d7414fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d73400700 1 --2- 172.21.15.49:0/1143930689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d740c3b30 0x7f9d7414fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d73400700 1 -- 172.21.15.49:0/1143930689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c0092a0 con 0x7f9d740be940 2024-01-22T05:04:53.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d79200700 1 --2- 172.21.15.49:0/1143930689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d740c3b30 0x7f9d7414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:53.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d73400700 1 --2- 172.21.15.49:0/1143930689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740be940 0x7f9d7414f940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f9d740a9c00 tx=0x7f9d5c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d6b400700 1 -- 172.21.15.49:0/1143930689 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c01a6e0 con 0x7f9d740be940 2024-01-22T05:04:53.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d6b400700 1 -- 172.21.15.49:0/1143930689 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c01a880 con 0x7f9d740be940 2024-01-22T05:04:53.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d79c00700 1 -- 172.21.15.49:0/1143930689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d740c1460 con 0x7f9d740be940 2024-01-22T05:04:53.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d6b400700 1 -- 172.21.15.49:0/1143930689 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c01ac40 con 0x7f9d740be940 2024-01-22T05:04:53.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.669+0000 7f9d79c00700 1 -- 172.21.15.49:0/1143930689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d740c1a20 con 0x7f9d740be940 2024-01-22T05:04:53.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.673+0000 7f9d79c00700 1 -- 172.21.15.49:0/1143930689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d740664e0 con 0x7f9d740be940 2024-01-22T05:04:53.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.673+0000 7f9d6b400700 1 -- 172.21.15.49:0/1143930689 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9d5c020070 con 0x7f9d740be940 2024-01-22T05:04:53.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.677+0000 7f9d6b400700 1 --2- 172.21.15.49:0/1143930689 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d4c05a4e0 0x7f9d4c05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.677+0000 7f9d6b400700 1 -- 172.21.15.49:0/1143930689 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f9d5c075d80 con 0x7f9d740be940 2024-01-22T05:04:53.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.677+0000 7f9d73e00700 1 --2- 172.21.15.49:0/1143930689 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d4c05a4e0 0x7f9d4c05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.677+0000 7f9d6b400700 1 --2- 172.21.15.49:0/1143930689 >> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] conn(0x7f9d4c064d30 0x7f9d4c0671d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.677+0000 7f9d6b400700 1 -- 172.21.15.49:0/1143930689 --> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d4c067850 con 0x7f9d4c064d30 2024-01-22T05:04:53.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.677+0000 7f9d6b400700 1 -- 172.21.15.49:0/1143930689 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d5c07a030 con 0x7f9d740be940 2024-01-22T05:04:53.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.677+0000 7f9d73e00700 1 --2- 172.21.15.49:0/1143930689 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d4c05a4e0 0x7f9d4c05c9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9d64005750 tx=0x7f9d64009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.677+0000 7f9d79200700 1 --2- 172.21.15.49:0/1143930689 >> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] conn(0x7f9d4c064d30 0x7f9d4c0671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.677+0000 7f9d79200700 1 --2- 172.21.15.49:0/1143930689 >> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] conn(0x7f9d4c064d30 0x7f9d4c0671d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.681+0000 7f9d6b400700 1 -- 172.21.15.49:0/1143930689 <== osd.5 v2:172.21.15.110:6800/23253 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f9d4c067850 con 0x7f9d4c064d30 2024-01-22T05:04:53.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.701+0000 7f9d79c00700 1 -- 172.21.15.49:0/1143930689 --> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d740c21b0 con 0x7f9d4c064d30 2024-01-22T05:04:53.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.701+0000 7f9d6b400700 1 -- 172.21.15.49:0/1143930689 <== osd.5 v2:172.21.15.110:6800/23253 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d740c21b0 con 0x7f9d4c064d30 2024-01-22T05:04:53.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.701+0000 7f9d79c00700 1 -- 172.21.15.49:0/1143930689 >> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] conn(0x7f9d4c064d30 msgr2=0x7f9d4c0671d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.701+0000 7f9d79c00700 1 --2- 172.21.15.49:0/1143930689 >> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] conn(0x7f9d4c064d30 0x7f9d4c0671d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.705+0000 7f9d79c00700 1 -- 172.21.15.49:0/1143930689 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d4c05a4e0 msgr2=0x7f9d4c05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.705+0000 7f9d79c00700 1 --2- 172.21.15.49:0/1143930689 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d4c05a4e0 0x7f9d4c05c9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9d64005750 tx=0x7f9d64009040).stop 2024-01-22T05:04:53.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.705+0000 7f9d79c00700 1 -- 172.21.15.49:0/1143930689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740be940 msgr2=0x7f9d7414f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.705+0000 7f9d79c00700 1 --2- 172.21.15.49:0/1143930689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d740be940 0x7f9d7414f940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f9d740a9c00 tx=0x7f9d5c017000).stop 2024-01-22T05:04:53.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.705+0000 7f9d79200700 1 -- 172.21.15.49:0/1143930689 reap_dead start 2024-01-22T05:04:53.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.705+0000 7f9d79c00700 1 -- 172.21.15.49:0/1143930689 shutdown_connections 2024-01-22T05:04:53.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.705+0000 7f9d79c00700 1 -- 172.21.15.49:0/1143930689 >> 172.21.15.49:0/1143930689 conn(0x7f9d740c8740 msgr2=0x7f9d74067b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:53.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.705+0000 7f9d79c00700 1 -- 172.21.15.49:0/1143930689 shutdown_connections 2024-01-22T05:04:53.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.705+0000 7f9d79c00700 1 -- 172.21.15.49:0/1143930689 wait complete. 2024-01-22T05:04:53.733 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2024-01-22T05:04:53.734 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-22T05:04:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.901+0000 7f03e8200700 1 Processor -- start 2024-01-22T05:04:53.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.901+0000 7f03e8200700 1 -- start start 2024-01-22T05:04:53.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.905+0000 7f03e8200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f03e0066fb0 0x7f03e00c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.905+0000 7f03e8200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f03e00a8b10 0x7f03e0157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.905+0000 7f03e8200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03e00a8f90 0x7f03e0157c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.905+0000 7f03e8200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e0158120 con 0x7f03e00a8b10 2024-01-22T05:04:53.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.905+0000 7f03e8200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e00c1ee0 con 0x7f03e0066fb0 2024-01-22T05:04:53.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.905+0000 7f03e8200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e00c12f0 con 0x7f03e00a8f90 2024-01-22T05:04:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.905+0000 7f03e4e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f03e00a8b10 0x7f03e0157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.905+0000 7f03e4e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f03e00a8b10 0x7f03e0157740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36134/0 (socket says 172.21.15.49:36134) 2024-01-22T05:04:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.905+0000 7f03e4e00700 1 -- 172.21.15.49:0/2160585375 learned_addr learned my addr 172.21.15.49:0/2160585375 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.905+0000 7f03e6200700 1 --2- 172.21.15.49:0/2160585375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03e00a8f90 0x7f03e0157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.905+0000 7f03e5800700 1 --2- 172.21.15.49:0/2160585375 >> v2:172.21.15.110:3300/0 conn(0x7f03e0066fb0 0x7f03e00c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03e4e00700 1 -- 172.21.15.49:0/2160585375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03e00a8f90 msgr2=0x7f03e0157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03e4e00700 1 --2- 172.21.15.49:0/2160585375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03e00a8f90 0x7f03e0157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03e4e00700 1 -- 172.21.15.49:0/2160585375 >> v2:172.21.15.110:3300/0 conn(0x7f03e0066fb0 msgr2=0x7f03e00c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:53.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03e4e00700 1 --2- 172.21.15.49:0/2160585375 >> v2:172.21.15.110:3300/0 conn(0x7f03e0066fb0 0x7f03e00c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03e4e00700 1 -- 172.21.15.49:0/2160585375 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e00c15b0 con 0x7f03e00a8b10 2024-01-22T05:04:53.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03e4e00700 1 --2- 172.21.15.49:0/2160585375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e00a8b10 0x7f03e0157740 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f03e00c4010 tx=0x7f03c80090f0).ready entity=mon.0 client_cookie=1e906bd1bcec01b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03dfe00700 1 -- 172.21.15.49:0/2160585375 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c800f510 con 0x7f03e00a8b10 2024-01-22T05:04:53.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03dfe00700 1 -- 172.21.15.49:0/2160585375 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c800f670 con 0x7f03e00a8b10 2024-01-22T05:04:53.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03dfe00700 1 -- 172.21.15.49:0/2160585375 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c800f9f0 con 0x7f03e00a8b10 2024-01-22T05:04:53.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03e8200700 1 -- 172.21.15.49:0/2160585375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e00a8b10 msgr2=0x7f03e0157740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03e8200700 1 --2- 172.21.15.49:0/2160585375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e00a8b10 0x7f03e0157740 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f03e00c4010 tx=0x7f03c80090f0).stop 2024-01-22T05:04:53.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03e8200700 1 -- 172.21.15.49:0/2160585375 shutdown_connections 2024-01-22T05:04:53.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03e8200700 1 --2- 172.21.15.49:0/2160585375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03e00a8f90 0x7f03e0157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03e8200700 1 --2- 172.21.15.49:0/2160585375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e00a8b10 0x7f03e0157740 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03e8200700 1 --2- 172.21.15.49:0/2160585375 >> v2:172.21.15.110:3300/0 conn(0x7f03e0066fb0 0x7f03e00c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03e8200700 1 -- 172.21.15.49:0/2160585375 >> 172.21.15.49:0/2160585375 conn(0x7f03e00c6540 msgr2=0x7f03e00c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:53.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03e8200700 1 -- 172.21.15.49:0/2160585375 shutdown_connections 2024-01-22T05:04:53.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.909+0000 7f03e8200700 1 -- 172.21.15.49:0/2160585375 wait complete. 2024-01-22T05:04:53.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.913+0000 7f03e8200700 1 Processor -- start 2024-01-22T05:04:53.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.913+0000 7f03e8200700 1 -- start start 2024-01-22T05:04:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e8200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e0066fb0 0x7f03e01641a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e8200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03e00a8b10 0x7f03e0156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e8200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03e00a8f90 0x7f03e0156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e8200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e0143900 con 0x7f03e0066fb0 2024-01-22T05:04:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e8200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e0164690 con 0x7f03e00a8b10 2024-01-22T05:04:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e8200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e00ab5b0 con 0x7f03e00a8f90 2024-01-22T05:04:53.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e5800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e0066fb0 0x7f03e01641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e5800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e0066fb0 0x7f03e01641a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36142/0 (socket says 172.21.15.49:36142) 2024-01-22T05:04:53.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e5800700 1 -- 172.21.15.49:0/2351694634 learned_addr learned my addr 172.21.15.49:0/2351694634 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:53.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e4e00700 1 --2- 172.21.15.49:0/2351694634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03e00a8b10 0x7f03e0156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e6200700 1 --2- 172.21.15.49:0/2351694634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03e00a8f90 0x7f03e0156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e5800700 1 -- 172.21.15.49:0/2351694634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03e00a8f90 msgr2=0x7f03e0156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e5800700 1 --2- 172.21.15.49:0/2351694634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03e00a8f90 0x7f03e0156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e5800700 1 -- 172.21.15.49:0/2351694634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03e00a8b10 msgr2=0x7f03e0156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e5800700 1 --2- 172.21.15.49:0/2351694634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03e00a8b10 0x7f03e0156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e5800700 1 -- 172.21.15.49:0/2351694634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c8009370 con 0x7f03e0066fb0 2024-01-22T05:04:53.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e5800700 1 --2- 172.21.15.49:0/2351694634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e0066fb0 0x7f03e01641a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f03d000e930 tx=0x7f03d0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03dcc00700 1 -- 172.21.15.49:0/2351694634 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0012600 con 0x7f03e0066fb0 2024-01-22T05:04:53.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03dcc00700 1 -- 172.21.15.49:0/2351694634 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d0012760 con 0x7f03e0066fb0 2024-01-22T05:04:53.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e8200700 1 -- 172.21.15.49:0/2351694634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e00ab890 con 0x7f03e0066fb0 2024-01-22T05:04:53.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03dcc00700 1 -- 172.21.15.49:0/2351694634 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0012ae0 con 0x7f03e0066fb0 2024-01-22T05:04:53.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.917+0000 7f03e8200700 1 -- 172.21.15.49:0/2351694634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e00abe50 con 0x7f03e0066fb0 2024-01-22T05:04:53.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.921+0000 7f03e8200700 1 -- 172.21.15.49:0/2351694634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f03e0047060 con 0x7f03e0066fb0 2024-01-22T05:04:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.921+0000 7f03dcc00700 1 -- 172.21.15.49:0/2351694634 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f03d001b400 con 0x7f03e0066fb0 2024-01-22T05:04:53.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.921+0000 7f03dcc00700 1 --2- 172.21.15.49:0/2351694634 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f03b805a4e0 0x7f03b805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.921+0000 7f03dcc00700 1 -- 172.21.15.49:0/2351694634 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f03d0074ee0 con 0x7f03e0066fb0 2024-01-22T05:04:53.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.921+0000 7f03e4e00700 1 --2- 172.21.15.49:0/2351694634 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f03b805a4e0 0x7f03b805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.921+0000 7f03dcc00700 1 --2- 172.21.15.49:0/2351694634 >> [v2:172.21.15.110:6822/23255,v1:172.21.15.110:6823/23255] conn(0x7f03b8064d30 0x7f03b80671d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:53.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.921+0000 7f03dcc00700 1 -- 172.21.15.49:0/2351694634 --> [v2:172.21.15.110:6822/23255,v1:172.21.15.110:6823/23255] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03b8067850 con 0x7f03b8064d30 2024-01-22T05:04:53.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.921+0000 7f03dcc00700 1 -- 172.21.15.49:0/2351694634 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03d0077500 con 0x7f03e0066fb0 2024-01-22T05:04:53.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.925+0000 7f03e4e00700 1 --2- 172.21.15.49:0/2351694634 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f03b805a4e0 0x7f03b805c9a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f03c8009130 tx=0x7f03c8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.925+0000 7f03e6200700 1 --2- 172.21.15.49:0/2351694634 >> [v2:172.21.15.110:6822/23255,v1:172.21.15.110:6823/23255] conn(0x7f03b8064d30 0x7f03b80671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:53.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.925+0000 7f03e6200700 1 --2- 172.21.15.49:0/2351694634 >> [v2:172.21.15.110:6822/23255,v1:172.21.15.110:6823/23255] conn(0x7f03b8064d30 0x7f03b80671d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:53.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.925+0000 7f03dcc00700 1 -- 172.21.15.49:0/2351694634 <== osd.6 v2:172.21.15.110:6822/23255 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f03b8067850 con 0x7f03b8064d30 2024-01-22T05:04:53.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.945+0000 7f03e8200700 1 -- 172.21.15.49:0/2351694634 --> [v2:172.21.15.110:6822/23255,v1:172.21.15.110:6823/23255] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f03e00c1890 con 0x7f03b8064d30 2024-01-22T05:04:53.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.949+0000 7f03dcc00700 1 -- 172.21.15.49:0/2351694634 <== osd.6 v2:172.21.15.110:6822/23255 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f03e00c1890 con 0x7f03b8064d30 2024-01-22T05:04:53.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.949+0000 7f03e8200700 1 -- 172.21.15.49:0/2351694634 >> [v2:172.21.15.110:6822/23255,v1:172.21.15.110:6823/23255] conn(0x7f03b8064d30 msgr2=0x7f03b80671d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.949+0000 7f03e8200700 1 --2- 172.21.15.49:0/2351694634 >> [v2:172.21.15.110:6822/23255,v1:172.21.15.110:6823/23255] conn(0x7f03b8064d30 0x7f03b80671d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.949+0000 7f03e8200700 1 -- 172.21.15.49:0/2351694634 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f03b805a4e0 msgr2=0x7f03b805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.949+0000 7f03e8200700 1 --2- 172.21.15.49:0/2351694634 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f03b805a4e0 0x7f03b805c9a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f03c8009130 tx=0x7f03c8017000).stop 2024-01-22T05:04:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.949+0000 7f03e8200700 1 -- 172.21.15.49:0/2351694634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e0066fb0 msgr2=0x7f03e01641a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.949+0000 7f03e8200700 1 --2- 172.21.15.49:0/2351694634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e0066fb0 0x7f03e01641a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f03d000e930 tx=0x7f03d0009060).stop 2024-01-22T05:04:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.949+0000 7f03e6200700 1 -- 172.21.15.49:0/2351694634 reap_dead start 2024-01-22T05:04:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.949+0000 7f03e8200700 1 -- 172.21.15.49:0/2351694634 shutdown_connections 2024-01-22T05:04:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.949+0000 7f03e8200700 1 -- 172.21.15.49:0/2351694634 >> 172.21.15.49:0/2351694634 conn(0x7f03e00c6540 msgr2=0x7f03e00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:53.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.949+0000 7f03e8200700 1 -- 172.21.15.49:0/2351694634 shutdown_connections 2024-01-22T05:04:53.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:53.949+0000 7f03e8200700 1 -- 172.21.15.49:0/2351694634 wait complete. 2024-01-22T05:04:53.978 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2024-01-22T05:04:53.978 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-22T05:04:54.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.137+0000 7f910fe00700 1 Processor -- start 2024-01-22T05:04:54.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.137+0000 7f910fe00700 1 -- start start 2024-01-22T05:04:54.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.137+0000 7f910fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9110066a50 0x7f9110066e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.137+0000 7f910fe00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91100665c0 con 0x7f91100c5180 2024-01-22T05:04:54.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.137+0000 7f910fe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91100659d0 con 0x7f91100c6350 2024-01-22T05:04:54.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.137+0000 7f910fe00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9110065c90 con 0x7f9110066a50 2024-01-22T05:04:54.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9110066a50 0x7f9110066e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9110066a50 0x7f9110066e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36150/0 (socket says 172.21.15.49:36150) 2024-01-22T05:04:54.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910f400700 1 -- 172.21.15.49:0/3877109234 learned_addr learned my addr 172.21.15.49:0/3877109234 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:54.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910ea00700 1 --1- 172.21.15.49:0/3877109234 >> v1:172.21.15.49:6789/0 conn(0x7f91100c5180 0x7f91100c1990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33984/0 (socket says 172.21.15.49:33984) 2024-01-22T05:04:54.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910f400700 1 -- 172.21.15.49:0/3877109234 >> v1:172.21.15.110:6789/0 conn(0x7f91100c6350 legacy=0x7f9110062780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910f400700 1 -- 172.21.15.49:0/3877109234 >> v1:172.21.15.49:6789/0 conn(0x7f91100c5180 legacy=0x7f91100c1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910f400700 1 -- 172.21.15.49:0/3877109234 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9110065f70 con 0x7f9110066a50 2024-01-22T05:04:54.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910f400700 1 --2- 172.21.15.49:0/3877109234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9110066a50 0x7f9110066e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f9108009f20 tx=0x7f9108009840).ready entity=mon.0 client_cookie=3d95c6f8f21db172 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:54.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910d600700 1 -- 172.21.15.49:0/3877109234 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910800e070 con 0x7f9110066a50 2024-01-22T05:04:54.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910d600700 1 -- 172.21.15.49:0/3877109234 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910800ba80 con 0x7f9110066a50 2024-01-22T05:04:54.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910d600700 1 -- 172.21.15.49:0/3877109234 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910800be00 con 0x7f9110066a50 2024-01-22T05:04:54.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910fe00700 1 -- 172.21.15.49:0/3877109234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9110066a50 msgr2=0x7f9110066e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910fe00700 1 --2- 172.21.15.49:0/3877109234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9110066a50 0x7f9110066e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f9108009f20 tx=0x7f9108009840).stop 2024-01-22T05:04:54.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910fe00700 1 -- 172.21.15.49:0/3877109234 shutdown_connections 2024-01-22T05:04:54.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910fe00700 1 --2- 172.21.15.49:0/3877109234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9110066a50 0x7f9110066e90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910fe00700 1 -- 172.21.15.49:0/3877109234 >> 172.21.15.49:0/3877109234 conn(0x7f9110067a90 msgr2=0x7f9110067ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:54.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910fe00700 1 -- 172.21.15.49:0/3877109234 shutdown_connections 2024-01-22T05:04:54.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.141+0000 7f910fe00700 1 -- 172.21.15.49:0/3877109234 wait complete. 2024-01-22T05:04:54.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.145+0000 7f910fe00700 1 Processor -- start 2024-01-22T05:04:54.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910fe00700 1 -- start start 2024-01-22T05:04:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9110066a50 0x7f911016be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91100c6350 0x7f91101538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91100bfca0 0x7f91100c0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910fe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911016c410 con 0x7f9110066a50 2024-01-22T05:04:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911016c6f0 con 0x7f91100c6350 2024-01-22T05:04:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911016c9d0 con 0x7f91100bfca0 2024-01-22T05:04:54.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9110066a50 0x7f911016be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9110066a50 0x7f911016be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36164/0 (socket says 172.21.15.49:36164) 2024-01-22T05:04:54.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910ea00700 1 -- 172.21.15.49:0/4025768645 learned_addr learned my addr 172.21.15.49:0/4025768645 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:54.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910f400700 1 --2- 172.21.15.49:0/4025768645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91100bfca0 0x7f91100c0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910e000700 1 --2- 172.21.15.49:0/4025768645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91100c6350 0x7f91101538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910ea00700 1 -- 172.21.15.49:0/4025768645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91100bfca0 msgr2=0x7f91100c0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910ea00700 1 --2- 172.21.15.49:0/4025768645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91100bfca0 0x7f91100c0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910ea00700 1 -- 172.21.15.49:0/4025768645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91100c6350 msgr2=0x7f91101538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910ea00700 1 --2- 172.21.15.49:0/4025768645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91100c6350 0x7f91101538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910ea00700 1 -- 172.21.15.49:0/4025768645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9108009ae0 con 0x7f9110066a50 2024-01-22T05:04:54.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.149+0000 7f910ea00700 1 --2- 172.21.15.49:0/4025768645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9110066a50 0x7f911016be30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f9100007fd0 tx=0x7f9100007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:54.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.153+0000 7f9106000700 1 -- 172.21.15.49:0/4025768645 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910000ce10 con 0x7f9110066a50 2024-01-22T05:04:54.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.153+0000 7f9106000700 1 -- 172.21.15.49:0/4025768645 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91000072e0 con 0x7f9110066a50 2024-01-22T05:04:54.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.153+0000 7f910fe00700 1 -- 172.21.15.49:0/4025768645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911016ccb0 con 0x7f9110066a50 2024-01-22T05:04:54.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.153+0000 7f9106000700 1 -- 172.21.15.49:0/4025768645 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91000056e0 con 0x7f9110066a50 2024-01-22T05:04:54.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.153+0000 7f910fe00700 1 -- 172.21.15.49:0/4025768645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9110153dd0 con 0x7f9110066a50 2024-01-22T05:04:54.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.153+0000 7f910fe00700 1 -- 172.21.15.49:0/4025768645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9110064a30 con 0x7f9110066a50 2024-01-22T05:04:54.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.153+0000 7f9106000700 1 -- 172.21.15.49:0/4025768645 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9100005ad0 con 0x7f9110066a50 2024-01-22T05:04:54.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.157+0000 7f9106000700 1 --2- 172.21.15.49:0/4025768645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f90e805a510 0x7f90e805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.157+0000 7f9106000700 1 -- 172.21.15.49:0/4025768645 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f9100074120 con 0x7f9110066a50 2024-01-22T05:04:54.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.157+0000 7f910e000700 1 --2- 172.21.15.49:0/4025768645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f90e805a510 0x7f90e805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.157+0000 7f9106000700 1 --2- 172.21.15.49:0/4025768645 >> [v2:172.21.15.110:6808/23254,v1:172.21.15.110:6809/23254] conn(0x7f90e8064d60 0x7f90e8067200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.157+0000 7f9106000700 1 -- 172.21.15.49:0/4025768645 --> [v2:172.21.15.110:6808/23254,v1:172.21.15.110:6809/23254] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90e8067880 con 0x7f90e8064d60 2024-01-22T05:04:54.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.157+0000 7f9106000700 1 -- 172.21.15.49:0/4025768645 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9100076740 con 0x7f9110066a50 2024-01-22T05:04:54.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.157+0000 7f910f400700 1 --2- 172.21.15.49:0/4025768645 >> [v2:172.21.15.110:6808/23254,v1:172.21.15.110:6809/23254] conn(0x7f90e8064d60 0x7f90e8067200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.157+0000 7f910e000700 1 --2- 172.21.15.49:0/4025768645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f90e805a510 0x7f90e805c9d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f9110063b80 tx=0x7f90f8007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:54.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.157+0000 7f910f400700 1 --2- 172.21.15.49:0/4025768645 >> [v2:172.21.15.110:6808/23254,v1:172.21.15.110:6809/23254] conn(0x7f90e8064d60 0x7f90e8067200 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:54.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.161+0000 7f9106000700 1 -- 172.21.15.49:0/4025768645 <== osd.7 v2:172.21.15.110:6808/23254 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f90e8067880 con 0x7f90e8064d60 2024-01-22T05:04:54.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.181+0000 7f910fe00700 1 -- 172.21.15.49:0/4025768645 --> [v2:172.21.15.110:6808/23254,v1:172.21.15.110:6809/23254] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9110066250 con 0x7f90e8064d60 2024-01-22T05:04:54.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.181+0000 7f9106000700 1 -- 172.21.15.49:0/4025768645 <== osd.7 v2:172.21.15.110:6808/23254 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9110066250 con 0x7f90e8064d60 2024-01-22T05:04:54.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.185+0000 7f910fe00700 1 -- 172.21.15.49:0/4025768645 >> [v2:172.21.15.110:6808/23254,v1:172.21.15.110:6809/23254] conn(0x7f90e8064d60 msgr2=0x7f90e8067200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.185+0000 7f910fe00700 1 --2- 172.21.15.49:0/4025768645 >> [v2:172.21.15.110:6808/23254,v1:172.21.15.110:6809/23254] conn(0x7f90e8064d60 0x7f90e8067200 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.185+0000 7f910fe00700 1 -- 172.21.15.49:0/4025768645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f90e805a510 msgr2=0x7f90e805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.185+0000 7f910fe00700 1 --2- 172.21.15.49:0/4025768645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f90e805a510 0x7f90e805c9d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f9110063b80 tx=0x7f90f8007d40).stop 2024-01-22T05:04:54.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.185+0000 7f910fe00700 1 -- 172.21.15.49:0/4025768645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9110066a50 msgr2=0x7f911016be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.185+0000 7f910fe00700 1 --2- 172.21.15.49:0/4025768645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9110066a50 0x7f911016be30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f9100007fd0 tx=0x7f9100007df0).stop 2024-01-22T05:04:54.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.185+0000 7f910f400700 1 -- 172.21.15.49:0/4025768645 reap_dead start 2024-01-22T05:04:54.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.185+0000 7f910fe00700 1 -- 172.21.15.49:0/4025768645 shutdown_connections 2024-01-22T05:04:54.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.185+0000 7f910fe00700 1 -- 172.21.15.49:0/4025768645 >> 172.21.15.49:0/4025768645 conn(0x7f9110067a90 msgr2=0x7f9110063c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:54.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.185+0000 7f910fe00700 1 -- 172.21.15.49:0/4025768645 shutdown_connections 2024-01-22T05:04:54.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.185+0000 7f910fe00700 1 -- 172.21.15.49:0/4025768645 wait complete. 2024-01-22T05:04:54.213 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2024-01-22T05:04:54.214 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-22T05:04:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.373+0000 7f0a45a00700 1 Processor -- start 2024-01-22T05:04:54.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.373+0000 7f0a45a00700 1 -- start start 2024-01-22T05:04:54.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.377+0000 7f0a45a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0a40155d20 0x7f0a40065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.377+0000 7f0a45a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0a400a8e50 0x7f0a400c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.377+0000 7f0a45a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a400c1a40 con 0x7f0a40066070 2024-01-22T05:04:54.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.377+0000 7f0a45a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a40159310 con 0x7f0a400a8e50 2024-01-22T05:04:54.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.377+0000 7f0a45a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a400c13f0 con 0x7f0a40155d20 2024-01-22T05:04:54.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.377+0000 7f0a3f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0a400a8e50 0x7f0a400c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.377+0000 7f0a3f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0a400a8e50 0x7f0a400c1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36178/0 (socket says 172.21.15.49:36178) 2024-01-22T05:04:54.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.377+0000 7f0a3f400700 1 -- 172.21.15.49:0/2134151194 learned_addr learned my addr 172.21.15.49:0/2134151194 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:54.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.377+0000 7f0a3ea00700 1 --2- 172.21.15.49:0/2134151194 >> v2:172.21.15.110:3300/0 conn(0x7f0a40155d20 0x7f0a40065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.377+0000 7f0a3f400700 1 -- 172.21.15.49:0/2134151194 >> v2:172.21.15.110:3300/0 conn(0x7f0a40155d20 msgr2=0x7f0a40065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:54.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.377+0000 7f0a3f400700 1 --2- 172.21.15.49:0/2134151194 >> v2:172.21.15.110:3300/0 conn(0x7f0a40155d20 0x7f0a40065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.377+0000 7f0a3f400700 1 -- 172.21.15.49:0/2134151194 >> v1:172.21.15.110:6789/0 conn(0x7f0a40066070 legacy=0x7f0a400a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.377+0000 7f0a3f400700 1 -- 172.21.15.49:0/2134151194 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a400c16d0 con 0x7f0a400a8e50 2024-01-22T05:04:54.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.381+0000 7f0a3f400700 1 --2- 172.21.15.49:0/2134151194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a400a8e50 0x7f0a400c1ed0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f0a4005ff40 tx=0x7f0a38009840).ready entity=mon.0 client_cookie=90ac191162959380 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.381+0000 7f0a3d600700 1 -- 172.21.15.49:0/2134151194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3800e070 con 0x7f0a400a8e50 2024-01-22T05:04:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.381+0000 7f0a3d600700 1 -- 172.21.15.49:0/2134151194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3800ba20 con 0x7f0a400a8e50 2024-01-22T05:04:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.381+0000 7f0a3d600700 1 -- 172.21.15.49:0/2134151194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3800bda0 con 0x7f0a400a8e50 2024-01-22T05:04:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.381+0000 7f0a45a00700 1 -- 172.21.15.49:0/2134151194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a400a8e50 msgr2=0x7f0a400c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.381+0000 7f0a45a00700 1 --2- 172.21.15.49:0/2134151194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a400a8e50 0x7f0a400c1ed0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f0a4005ff40 tx=0x7f0a38009840).stop 2024-01-22T05:04:54.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.381+0000 7f0a45a00700 1 -- 172.21.15.49:0/2134151194 shutdown_connections 2024-01-22T05:04:54.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.381+0000 7f0a45a00700 1 --2- 172.21.15.49:0/2134151194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a400a8e50 0x7f0a400c1ed0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.381+0000 7f0a45a00700 1 --2- 172.21.15.49:0/2134151194 >> v2:172.21.15.110:3300/0 conn(0x7f0a40155d20 0x7f0a40065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.381+0000 7f0a45a00700 1 -- 172.21.15.49:0/2134151194 >> 172.21.15.49:0/2134151194 conn(0x7f0a400c6540 msgr2=0x7f0a400c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:54.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.381+0000 7f0a45a00700 1 -- 172.21.15.49:0/2134151194 shutdown_connections 2024-01-22T05:04:54.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.381+0000 7f0a45a00700 1 -- 172.21.15.49:0/2134151194 wait complete. 2024-01-22T05:04:54.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.385+0000 7f0a45a00700 1 Processor -- start 2024-01-22T05:04:54.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.385+0000 7f0a45a00700 1 -- start start 2024-01-22T05:04:54.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a45a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a40066070 0x7f0a40168ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a45a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a400a8e50 0x7f0a400c0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a45a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a40155d20 0x7f0a40149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a45a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a400aab50 con 0x7f0a40155d20 2024-01-22T05:04:54.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a45a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a400aae30 con 0x7f0a400a8e50 2024-01-22T05:04:54.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a45a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a400ab110 con 0x7f0a40066070 2024-01-22T05:04:54.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a3f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a40155d20 0x7f0a40149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a3f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a40155d20 0x7f0a40149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36184/0 (socket says 172.21.15.49:36184) 2024-01-22T05:04:54.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a3f400700 1 -- 172.21.15.49:0/523183542 learned_addr learned my addr 172.21.15.49:0/523183542 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:54.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a3ea00700 1 --2- 172.21.15.49:0/523183542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a40066070 0x7f0a40168ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a3e000700 1 --2- 172.21.15.49:0/523183542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a400a8e50 0x7f0a400c0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a3f400700 1 -- 172.21.15.49:0/523183542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a40066070 msgr2=0x7f0a40168ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a3f400700 1 --2- 172.21.15.49:0/523183542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a40066070 0x7f0a40168ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a3f400700 1 -- 172.21.15.49:0/523183542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a400a8e50 msgr2=0x7f0a400c0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a3f400700 1 --2- 172.21.15.49:0/523183542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a400a8e50 0x7f0a400c0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a3f400700 1 -- 172.21.15.49:0/523183542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a38009ae0 con 0x7f0a40155d20 2024-01-22T05:04:54.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a3f400700 1 --2- 172.21.15.49:0/523183542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a40155d20 0x7f0a40149700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f0a40059c60 tx=0x7f0a38009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:54.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a36000700 1 -- 172.21.15.49:0/523183542 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a380092e0 con 0x7f0a40155d20 2024-01-22T05:04:54.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a36000700 1 -- 172.21.15.49:0/523183542 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3801e470 con 0x7f0a40155d20 2024-01-22T05:04:54.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a45a00700 1 -- 172.21.15.49:0/523183542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a401683a0 con 0x7f0a40155d20 2024-01-22T05:04:54.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a36000700 1 -- 172.21.15.49:0/523183542 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3801e830 con 0x7f0a40155d20 2024-01-22T05:04:54.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.389+0000 7f0a45a00700 1 -- 172.21.15.49:0/523183542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a40169090 con 0x7f0a40155d20 2024-01-22T05:04:54.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.393+0000 7f0a45a00700 1 -- 172.21.15.49:0/523183542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a40047060 con 0x7f0a40155d20 2024-01-22T05:04:54.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.393+0000 7f0a36000700 1 -- 172.21.15.49:0/523183542 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0a38003040 con 0x7f0a40155d20 2024-01-22T05:04:54.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.393+0000 7f0a36000700 1 --2- 172.21.15.49:0/523183542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a1805a510 0x7f0a1805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.393+0000 7f0a36000700 1 -- 172.21.15.49:0/523183542 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f0a38075e30 con 0x7f0a40155d20 2024-01-22T05:04:54.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.393+0000 7f0a3ea00700 1 --2- 172.21.15.49:0/523183542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a1805a510 0x7f0a1805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.393+0000 7f0a3ea00700 1 --2- 172.21.15.49:0/523183542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a1805a510 0x7f0a1805c9d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0a30009b90 tx=0x7f0a30009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:54.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.401+0000 7f0a36000700 1 -- 172.21.15.49:0/523183542 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0a380493b0 con 0x7f0a40155d20 2024-01-22T05:04:54.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.565+0000 7f0a45a00700 1 -- 172.21.15.49:0/523183542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0a400c3df0 con 0x7f0a40155d20 2024-01-22T05:04:54.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.565+0000 7f0a36000700 1 -- 172.21.15.49:0/523183542 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a38023030 con 0x7f0a40155d20 2024-01-22T05:04:54.569 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2024-01-22T05:04:54.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.573+0000 7f0a45a00700 1 -- 172.21.15.49:0/523183542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a1805a510 msgr2=0x7f0a1805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.573+0000 7f0a45a00700 1 --2- 172.21.15.49:0/523183542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a1805a510 0x7f0a1805c9d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0a30009b90 tx=0x7f0a30009060).stop 2024-01-22T05:04:54.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.573+0000 7f0a45a00700 1 -- 172.21.15.49:0/523183542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a40155d20 msgr2=0x7f0a40149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.573+0000 7f0a45a00700 1 --2- 172.21.15.49:0/523183542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a40155d20 0x7f0a40149700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f0a40059c60 tx=0x7f0a38009840).stop 2024-01-22T05:04:54.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.573+0000 7f0a45a00700 1 -- 172.21.15.49:0/523183542 shutdown_connections 2024-01-22T05:04:54.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.573+0000 7f0a45a00700 1 --2- 172.21.15.49:0/523183542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a1805a510 0x7f0a1805c9d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.573+0000 7f0a45a00700 1 --2- 172.21.15.49:0/523183542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a40155d20 0x7f0a40149700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.573+0000 7f0a45a00700 1 --2- 172.21.15.49:0/523183542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a400a8e50 0x7f0a400c0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.573+0000 7f0a45a00700 1 --2- 172.21.15.49:0/523183542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a40066070 0x7f0a40168ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.573+0000 7f0a45a00700 1 -- 172.21.15.49:0/523183542 >> 172.21.15.49:0/523183542 conn(0x7f0a400c6540 msgr2=0x7f0a400c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:54.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.573+0000 7f0a45a00700 1 -- 172.21.15.49:0/523183542 shutdown_connections 2024-01-22T05:04:54.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.573+0000 7f0a45a00700 1 -- 172.21.15.49:0/523183542 wait complete. 2024-01-22T05:04:54.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-01-22T05:04:54.600 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-22T05:04:54.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.765+0000 7fc048c00700 1 Processor -- start 2024-01-22T05:04:54.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.765+0000 7fc048c00700 1 -- start start 2024-01-22T05:04:54.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc048c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc044155d20 0x7fc044065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc048c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0440c1a40 con 0x7fc0440a8e50 2024-01-22T05:04:54.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc048c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc044159310 con 0x7fc044066070 2024-01-22T05:04:54.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc048c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440c13f0 con 0x7fc044155d20 2024-01-22T05:04:54.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc041e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc044155d20 0x7fc044065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc041e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc044155d20 0x7fc044065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:46662/0 (socket says 172.21.15.49:46662) 2024-01-22T05:04:54.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc041e00700 1 -- 172.21.15.49:0/3929179160 learned_addr learned my addr 172.21.15.49:0/3929179160 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:54.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc042800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc0440a8e50 0x7fc0440c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33998/0 (socket says 172.21.15.49:33998) 2024-01-22T05:04:54.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc041400700 1 --1- 172.21.15.49:0/3929179160 >> v1:172.21.15.110:6789/0 conn(0x7fc044066070 0x7fc0440a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:54948/0 (socket says 172.21.15.49:54948) 2024-01-22T05:04:54.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc041e00700 1 -- 172.21.15.49:0/3929179160 >> v1:172.21.15.110:6789/0 conn(0x7fc044066070 legacy=0x7fc0440a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc041e00700 1 -- 172.21.15.49:0/3929179160 >> v1:172.21.15.49:6789/0 conn(0x7fc0440a8e50 legacy=0x7fc0440c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc041e00700 1 -- 172.21.15.49:0/3929179160 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0440c16d0 con 0x7fc044155d20 2024-01-22T05:04:54.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc041e00700 1 --2- 172.21.15.49:0/3929179160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc044155d20 0x7fc044065b80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc034009830 tx=0x7fc0340090f0).ready entity=mon.2 client_cookie=f632c3cd24e24eee server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:54.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc040a00700 1 -- 172.21.15.49:0/3929179160 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400b640 con 0x7fc044155d20 2024-01-22T05:04:54.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc040a00700 1 -- 172.21.15.49:0/3929179160 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03400b7a0 con 0x7fc044155d20 2024-01-22T05:04:54.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.769+0000 7fc040a00700 1 -- 172.21.15.49:0/3929179160 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400bb20 con 0x7fc044155d20 2024-01-22T05:04:54.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.773+0000 7fc048c00700 1 -- 172.21.15.49:0/3929179160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc044155d20 msgr2=0x7fc044065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.773+0000 7fc048c00700 1 --2- 172.21.15.49:0/3929179160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc044155d20 0x7fc044065b80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc034009830 tx=0x7fc0340090f0).stop 2024-01-22T05:04:54.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.773+0000 7fc048c00700 1 -- 172.21.15.49:0/3929179160 shutdown_connections 2024-01-22T05:04:54.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.773+0000 7fc048c00700 1 --2- 172.21.15.49:0/3929179160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc044155d20 0x7fc044065b80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.773+0000 7fc048c00700 1 -- 172.21.15.49:0/3929179160 >> 172.21.15.49:0/3929179160 conn(0x7fc0440c6540 msgr2=0x7fc0440c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:54.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.773+0000 7fc048c00700 1 -- 172.21.15.49:0/3929179160 shutdown_connections 2024-01-22T05:04:54.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.773+0000 7fc048c00700 1 -- 172.21.15.49:0/3929179160 wait complete. 2024-01-22T05:04:54.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.777+0000 7fc048c00700 1 Processor -- start 2024-01-22T05:04:54.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.777+0000 7fc048c00700 1 -- start start 2024-01-22T05:04:54.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc048c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc044066070 0x7fc0441689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc048c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440a8e50 0x7fc0440a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc048c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc044155d20 0x7fc0440ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc048c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440be0b0 con 0x7fc0440a8e50 2024-01-22T05:04:54.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc048c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440bd780 con 0x7fc044066070 2024-01-22T05:04:54.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc048c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440bda60 con 0x7fc044155d20 2024-01-22T05:04:54.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc041400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440a8e50 0x7fc0440a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc041400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440a8e50 0x7fc0440a9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36198/0 (socket says 172.21.15.49:36198) 2024-01-22T05:04:54.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc041400700 1 -- 172.21.15.49:0/185856441 learned_addr learned my addr 172.21.15.49:0/185856441 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:54.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc041e00700 1 --2- 172.21.15.49:0/185856441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc044066070 0x7fc0441689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc042800700 1 --2- 172.21.15.49:0/185856441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc044155d20 0x7fc0440ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc041400700 1 -- 172.21.15.49:0/185856441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc044155d20 msgr2=0x7fc0440ab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc041400700 1 --2- 172.21.15.49:0/185856441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc044155d20 0x7fc0440ab110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc041400700 1 -- 172.21.15.49:0/185856441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc044066070 msgr2=0x7fc0441689b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc041400700 1 --2- 172.21.15.49:0/185856441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc044066070 0x7fc0441689b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc041400700 1 -- 172.21.15.49:0/185856441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc034009370 con 0x7fc0440a8e50 2024-01-22T05:04:54.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc041400700 1 --2- 172.21.15.49:0/185856441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440a8e50 0x7fc0440a9e50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fc02c00c4c0 tx=0x7fc02c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:54.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc039600700 1 -- 172.21.15.49:0/185856441 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c00ce10 con 0x7fc0440a8e50 2024-01-22T05:04:54.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc039600700 1 -- 172.21.15.49:0/185856441 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02c0072e0 con 0x7fc0440a8e50 2024-01-22T05:04:54.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc048c00700 1 -- 172.21.15.49:0/185856441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0440bdd40 con 0x7fc0440a8e50 2024-01-22T05:04:54.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc039600700 1 -- 172.21.15.49:0/185856441 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c0056e0 con 0x7fc0440a8e50 2024-01-22T05:04:54.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.781+0000 7fc048c00700 1 -- 172.21.15.49:0/185856441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0440aa340 con 0x7fc0440a8e50 2024-01-22T05:04:54.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.785+0000 7fc048c00700 1 -- 172.21.15.49:0/185856441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc044047060 con 0x7fc0440a8e50 2024-01-22T05:04:54.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.785+0000 7fc039600700 1 -- 172.21.15.49:0/185856441 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc02c005b10 con 0x7fc0440a8e50 2024-01-22T05:04:54.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.789+0000 7fc039600700 1 --2- 172.21.15.49:0/185856441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc01c05a510 0x7fc01c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:54.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.789+0000 7fc039600700 1 -- 172.21.15.49:0/185856441 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fc02c074100 con 0x7fc0440a8e50 2024-01-22T05:04:54.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.789+0000 7fc041e00700 1 --2- 172.21.15.49:0/185856441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc01c05a510 0x7fc01c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:54.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.789+0000 7fc041e00700 1 --2- 172.21.15.49:0/185856441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc01c05a510 0x7fc01c05c9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fc034009130 tx=0x7fc034017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:54.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.793+0000 7fc039600700 1 -- 172.21.15.49:0/185856441 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc02c047510 con 0x7fc0440a8e50 2024-01-22T05:04:54.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.957+0000 7fc048c00700 1 -- 172.21.15.49:0/185856441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc044068d70 con 0x7fc0440a8e50 2024-01-22T05:04:54.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.961+0000 7fc039600700 1 -- 172.21.15.49:0/185856441 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc02c04ab30 con 0x7fc0440a8e50 2024-01-22T05:04:54.962 INFO:teuthology.orchestra.run.smithi049.stdout:55834574856 2024-01-22T05:04:54.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.961+0000 7fc048c00700 1 -- 172.21.15.49:0/185856441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc01c05a510 msgr2=0x7fc01c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.961+0000 7fc048c00700 1 --2- 172.21.15.49:0/185856441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc01c05a510 0x7fc01c05c9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fc034009130 tx=0x7fc034017000).stop 2024-01-22T05:04:54.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.961+0000 7fc048c00700 1 -- 172.21.15.49:0/185856441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440a8e50 msgr2=0x7fc0440a9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:54.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.961+0000 7fc048c00700 1 --2- 172.21.15.49:0/185856441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440a8e50 0x7fc0440a9e50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fc02c00c4c0 tx=0x7fc02c007dc0).stop 2024-01-22T05:04:54.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.961+0000 7fc048c00700 1 -- 172.21.15.49:0/185856441 shutdown_connections 2024-01-22T05:04:54.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.961+0000 7fc048c00700 1 --2- 172.21.15.49:0/185856441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc01c05a510 0x7fc01c05c9d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.961+0000 7fc048c00700 1 --2- 172.21.15.49:0/185856441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc044155d20 0x7fc0440ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.961+0000 7fc048c00700 1 --2- 172.21.15.49:0/185856441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0440a8e50 0x7fc0440a9e50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.961+0000 7fc048c00700 1 --2- 172.21.15.49:0/185856441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc044066070 0x7fc0441689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:54.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.961+0000 7fc048c00700 1 -- 172.21.15.49:0/185856441 >> 172.21.15.49:0/185856441 conn(0x7fc0440c6540 msgr2=0x7fc0440bc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:54.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.961+0000 7fc048c00700 1 -- 172.21.15.49:0/185856441 shutdown_connections 2024-01-22T05:04:54.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:54.961+0000 7fc048c00700 1 -- 172.21.15.49:0/185856441 wait complete. 2024-01-22T05:04:54.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-01-22T05:04:54.986 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-22T05:04:55.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.149+0000 7f322f600700 1 Processor -- start 2024-01-22T05:04:55.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.153+0000 7f322f600700 1 -- start start 2024-01-22T05:04:55.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.153+0000 7f322f600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3228068ba0 0x7f3228069020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.153+0000 7f322f600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3228151db0 con 0x7f32281549d0 2024-01-22T05:04:55.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.153+0000 7f322f600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3228151510 con 0x7f32280bdf60 2024-01-22T05:04:55.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.153+0000 7f322f600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32280a9f10 con 0x7f3228068ba0 2024-01-22T05:04:55.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.153+0000 7f322d600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f32281549d0 0x7f32280c3390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34000/0 (socket says 172.21.15.49:34000) 2024-01-22T05:04:55.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.153+0000 7f3227e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3228068ba0 0x7f3228069020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.153+0000 7f322d600700 1 -- 172.21.15.49:0/918694256 learned_addr learned my addr 172.21.15.49:0/918694256 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:55.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.153+0000 7f322cc00700 1 --1- 172.21.15.49:0/918694256 >> v1:172.21.15.110:6789/0 conn(0x7f32280bdf60 0x7f3228150cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:54960/0 (socket says 172.21.15.49:54960) 2024-01-22T05:04:55.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.153+0000 7f3227400700 1 -- 172.21.15.49:0/918694256 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701439978 0 0) 0x7f3228151db0 con 0x7f32281549d0 2024-01-22T05:04:55.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.153+0000 7f3227e00700 1 -- 172.21.15.49:0/918694256 >> v1:172.21.15.110:6789/0 conn(0x7f32280bdf60 legacy=0x7f3228150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.153+0000 7f3227e00700 1 -- 172.21.15.49:0/918694256 >> v1:172.21.15.49:6789/0 conn(0x7f32281549d0 legacy=0x7f32280c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.153+0000 7f3227e00700 1 -- 172.21.15.49:0/918694256 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32281517f0 con 0x7f3228068ba0 2024-01-22T05:04:55.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.157+0000 7f3227e00700 1 --2- 172.21.15.49:0/918694256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3228068ba0 0x7f3228069020 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3210009760 tx=0x7f3210009060).ready entity=mon.1 client_cookie=61637e42105ff138 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:55.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.157+0000 7f3227400700 1 -- 172.21.15.49:0/918694256 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3210009120 con 0x7f3228068ba0 2024-01-22T05:04:55.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.157+0000 7f3227400700 1 -- 172.21.15.49:0/918694256 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321000f6b0 con 0x7f3228068ba0 2024-01-22T05:04:55.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.157+0000 7f3227400700 1 -- 172.21.15.49:0/918694256 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321000fa30 con 0x7f3228068ba0 2024-01-22T05:04:55.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.157+0000 7f322f600700 1 -- 172.21.15.49:0/918694256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3228068ba0 msgr2=0x7f3228069020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.157+0000 7f322f600700 1 --2- 172.21.15.49:0/918694256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3228068ba0 0x7f3228069020 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3210009760 tx=0x7f3210009060).stop 2024-01-22T05:04:55.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.157+0000 7f322f600700 1 -- 172.21.15.49:0/918694256 shutdown_connections 2024-01-22T05:04:55.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.157+0000 7f322f600700 1 --2- 172.21.15.49:0/918694256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3228068ba0 0x7f3228069020 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.157+0000 7f322f600700 1 -- 172.21.15.49:0/918694256 >> 172.21.15.49:0/918694256 conn(0x7f32280c40c0 msgr2=0x7f32280c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:55.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.157+0000 7f322f600700 1 -- 172.21.15.49:0/918694256 shutdown_connections 2024-01-22T05:04:55.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.157+0000 7f322f600700 1 -- 172.21.15.49:0/918694256 wait complete. 2024-01-22T05:04:55.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.161+0000 7f322f600700 1 Processor -- start 2024-01-22T05:04:55.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.161+0000 7f322f600700 1 -- start start 2024-01-22T05:04:55.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322f600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3228068ba0 0x7f322814d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322f600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32280bdf60 0x7f32280a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322f600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32281549d0 0x7f322814c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322f600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32280a80d0 con 0x7f32281549d0 2024-01-22T05:04:55.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322f600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322814f9e0 con 0x7f32280bdf60 2024-01-22T05:04:55.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322f600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322814fcc0 con 0x7f3228068ba0 2024-01-22T05:04:55.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32281549d0 0x7f322814c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f3227e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32280bdf60 0x7f32280a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322cc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3228068ba0 0x7f322814d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322cc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3228068ba0 0x7f322814d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:46682/0 (socket says 172.21.15.49:46682) 2024-01-22T05:04:55.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f3227e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32280bdf60 0x7f32280a8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:58952/0 (socket says 172.21.15.49:58952) 2024-01-22T05:04:55.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322cc00700 1 -- 172.21.15.49:0/2226490374 learned_addr learned my addr 172.21.15.49:0/2226490374 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:55.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322cc00700 1 -- 172.21.15.49:0/2226490374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32280bdf60 msgr2=0x7f32280a8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322cc00700 1 --2- 172.21.15.49:0/2226490374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32280bdf60 0x7f32280a8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322cc00700 1 -- 172.21.15.49:0/2226490374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32281549d0 msgr2=0x7f322814c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322cc00700 1 --2- 172.21.15.49:0/2226490374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32281549d0 0x7f322814c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322cc00700 1 -- 172.21.15.49:0/2226490374 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32100092a0 con 0x7f3228068ba0 2024-01-22T05:04:55.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322d600700 1 --2- 172.21.15.49:0/2226490374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32281549d0 0x7f322814c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:55.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322cc00700 1 --2- 172.21.15.49:0/2226490374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3228068ba0 0x7f322814d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3218007fd0 tx=0x7f3218007df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:55.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f321fe00700 1 -- 172.21.15.49:0/2226490374 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321800ce10 con 0x7f3228068ba0 2024-01-22T05:04:55.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f321fe00700 1 -- 172.21.15.49:0/2226490374 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32180072e0 con 0x7f3228068ba0 2024-01-22T05:04:55.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f322f600700 1 -- 172.21.15.49:0/2226490374 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32280a82e0 con 0x7f3228068ba0 2024-01-22T05:04:55.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.165+0000 7f321fe00700 1 -- 172.21.15.49:0/2226490374 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32180056e0 con 0x7f3228068ba0 2024-01-22T05:04:55.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.169+0000 7f322f600700 1 -- 172.21.15.49:0/2226490374 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322814f5c0 con 0x7f3228068ba0 2024-01-22T05:04:55.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.169+0000 7f322f600700 1 -- 172.21.15.49:0/2226490374 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3228065660 con 0x7f3228068ba0 2024-01-22T05:04:55.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.169+0000 7f321fe00700 1 -- 172.21.15.49:0/2226490374 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3218005ad0 con 0x7f3228068ba0 2024-01-22T05:04:55.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.169+0000 7f321fe00700 1 --2- 172.21.15.49:0/2226490374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f320005a510 0x7f320005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.169+0000 7f321fe00700 1 -- 172.21.15.49:0/2226490374 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f3218074290 con 0x7f3228068ba0 2024-01-22T05:04:55.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.173+0000 7f3227e00700 1 --2- 172.21.15.49:0/2226490374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f320005a510 0x7f320005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.173+0000 7f3227e00700 1 --2- 172.21.15.49:0/2226490374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f320005a510 0x7f320005c9d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f321000f470 tx=0x7f3210019000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:55.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.181+0000 7f321fe00700 1 -- 172.21.15.49:0/2226490374 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3218047720 con 0x7f3228068ba0 2024-01-22T05:04:55.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.353+0000 7f322f600700 1 -- 172.21.15.49:0/2226490374 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3228046800 con 0x7f3228068ba0 2024-01-22T05:04:55.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.353+0000 7f321fe00700 1 -- 172.21.15.49:0/2226490374 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f321804ad40 con 0x7f3228068ba0 2024-01-22T05:04:55.357 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2024-01-22T05:04:55.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.357+0000 7f322f600700 1 -- 172.21.15.49:0/2226490374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f320005a510 msgr2=0x7f320005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.357+0000 7f322f600700 1 --2- 172.21.15.49:0/2226490374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f320005a510 0x7f320005c9d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f321000f470 tx=0x7f3210019000).stop 2024-01-22T05:04:55.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.357+0000 7f322f600700 1 -- 172.21.15.49:0/2226490374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3228068ba0 msgr2=0x7f322814d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.357+0000 7f322f600700 1 --2- 172.21.15.49:0/2226490374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3228068ba0 0x7f322814d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3218007fd0 tx=0x7f3218007df0).stop 2024-01-22T05:04:55.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.361+0000 7f322f600700 1 -- 172.21.15.49:0/2226490374 shutdown_connections 2024-01-22T05:04:55.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.361+0000 7f322f600700 1 --2- 172.21.15.49:0/2226490374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f320005a510 0x7f320005c9d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.361+0000 7f322f600700 1 --2- 172.21.15.49:0/2226490374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32281549d0 0x7f322814c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.361+0000 7f322f600700 1 --2- 172.21.15.49:0/2226490374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32280bdf60 0x7f32280a8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.361+0000 7f322f600700 1 --2- 172.21.15.49:0/2226490374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3228068ba0 0x7f322814d100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.361+0000 7f322f600700 1 -- 172.21.15.49:0/2226490374 >> 172.21.15.49:0/2226490374 conn(0x7f32280c40c0 msgr2=0x7f3228151fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:55.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.361+0000 7f322f600700 1 -- 172.21.15.49:0/2226490374 shutdown_connections 2024-01-22T05:04:55.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.361+0000 7f322f600700 1 -- 172.21.15.49:0/2226490374 wait complete. 2024-01-22T05:04:55.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-01-22T05:04:55.386 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-22T05:04:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.549+0000 7f890b000700 1 Processor -- start 2024-01-22T05:04:55.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.549+0000 7f890b000700 1 -- start start 2024-01-22T05:04:55.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f890b000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89040a8740 0x7f89040a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f890b000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89040c1ed0 0x7f89040c2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f890b000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89040c1a40 con 0x7f8904155d20 2024-01-22T05:04:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f890b000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89040a90b0 con 0x7f89040c1ed0 2024-01-22T05:04:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f890b000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8904159310 con 0x7f89040a8740 2024-01-22T05:04:55.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f8903e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8904155d20 0x7f8904065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34010/0 (socket says 172.21.15.49:34010) 2024-01-22T05:04:55.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f8903e00700 1 -- 172.21.15.49:0/2759106404 learned_addr learned my addr 172.21.15.49:0/2759106404 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:55.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f8909000700 1 --2- 172.21.15.49:0/2759106404 >> v2:172.21.15.49:3300/0 conn(0x7f89040c1ed0 0x7f89040c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f8903400700 1 --2- 172.21.15.49:0/2759106404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89040a8740 0x7f89040a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f8902a00700 1 -- 172.21.15.49:0/2759106404 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159621014 0 0) 0x7f89040c1a40 con 0x7f8904155d20 2024-01-22T05:04:55.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f8902a00700 1 -- 172.21.15.49:0/2759106404 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e40033f0 con 0x7f8904155d20 2024-01-22T05:04:55.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f8909000700 1 -- 172.21.15.49:0/2759106404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89040a8740 msgr2=0x7f89040a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:55.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f8909000700 1 --2- 172.21.15.49:0/2759106404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89040a8740 0x7f89040a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f8909000700 1 -- 172.21.15.49:0/2759106404 >> v1:172.21.15.49:6789/0 conn(0x7f8904155d20 legacy=0x7f8904065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f8909000700 1 -- 172.21.15.49:0/2759106404 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89040c13f0 con 0x7f89040c1ed0 2024-01-22T05:04:55.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f8909000700 1 --2- 172.21.15.49:0/2759106404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89040c1ed0 0x7f89040c2330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f88fc009e60 tx=0x7f88fc009780).ready entity=mon.0 client_cookie=df1af364485a3de4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:55.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f8902a00700 1 -- 172.21.15.49:0/2759106404 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc00e070 con 0x7f89040c1ed0 2024-01-22T05:04:55.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f8902a00700 1 -- 172.21.15.49:0/2759106404 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88fc00bab0 con 0x7f89040c1ed0 2024-01-22T05:04:55.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.553+0000 7f8902a00700 1 -- 172.21.15.49:0/2759106404 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc00be30 con 0x7f89040c1ed0 2024-01-22T05:04:55.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.557+0000 7f890b000700 1 -- 172.21.15.49:0/2759106404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89040c1ed0 msgr2=0x7f89040c2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.557+0000 7f890b000700 1 --2- 172.21.15.49:0/2759106404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89040c1ed0 0x7f89040c2330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f88fc009e60 tx=0x7f88fc009780).stop 2024-01-22T05:04:55.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.557+0000 7f890b000700 1 -- 172.21.15.49:0/2759106404 shutdown_connections 2024-01-22T05:04:55.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.557+0000 7f890b000700 1 --2- 172.21.15.49:0/2759106404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89040c1ed0 0x7f89040c2330 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.557+0000 7f890b000700 1 --2- 172.21.15.49:0/2759106404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89040a8740 0x7f89040a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.557+0000 7f890b000700 1 -- 172.21.15.49:0/2759106404 >> 172.21.15.49:0/2759106404 conn(0x7f89040c6540 msgr2=0x7f89040c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:55.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.557+0000 7f890b000700 1 -- 172.21.15.49:0/2759106404 shutdown_connections 2024-01-22T05:04:55.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.557+0000 7f890b000700 1 -- 172.21.15.49:0/2759106404 wait complete. 2024-01-22T05:04:55.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.561+0000 7f890b000700 1 Processor -- start 2024-01-22T05:04:55.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.561+0000 7f890b000700 1 -- start start 2024-01-22T05:04:55.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.561+0000 7f890b000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89040a8740 0x7f8904168fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.561+0000 7f890b000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89040c1ed0 0x7f8904156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.561+0000 7f890b000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8904155d20 0x7f89041573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.561+0000 7f890b000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89041523a0 con 0x7f8904155d20 2024-01-22T05:04:55.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.561+0000 7f890b000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89040bd680 con 0x7f89040c1ed0 2024-01-22T05:04:55.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.561+0000 7f890b000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89040bd920 con 0x7f89040a8740 2024-01-22T05:04:55.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.561+0000 7f8909000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8904155d20 0x7f89041573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.561+0000 7f8909000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8904155d20 0x7f89041573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36230/0 (socket says 172.21.15.49:36230) 2024-01-22T05:04:55.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.561+0000 7f8909000700 1 -- 172.21.15.49:0/2357901728 learned_addr learned my addr 172.21.15.49:0/2357901728 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:55.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.561+0000 7f8903e00700 1 --2- 172.21.15.49:0/2357901728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89040a8740 0x7f8904168fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.561+0000 7f8903400700 1 --2- 172.21.15.49:0/2357901728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89040c1ed0 0x7f8904156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.565+0000 7f8909000700 1 -- 172.21.15.49:0/2357901728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89040a8740 msgr2=0x7f8904168fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.565+0000 7f8909000700 1 --2- 172.21.15.49:0/2357901728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89040a8740 0x7f8904168fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.565+0000 7f8909000700 1 -- 172.21.15.49:0/2357901728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89040c1ed0 msgr2=0x7f8904156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.565+0000 7f8909000700 1 --2- 172.21.15.49:0/2357901728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89040c1ed0 0x7f8904156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.565+0000 7f8909000700 1 -- 172.21.15.49:0/2357901728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc009a20 con 0x7f8904155d20 2024-01-22T05:04:55.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.565+0000 7f8909000700 1 --2- 172.21.15.49:0/2357901728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8904155d20 0x7f89041573a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f88fc00b610 tx=0x7f88fc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:55.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.565+0000 7f88fb400700 1 -- 172.21.15.49:0/2357901728 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc013e70 con 0x7f8904155d20 2024-01-22T05:04:55.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.565+0000 7f88fb400700 1 -- 172.21.15.49:0/2357901728 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88fc01d630 con 0x7f8904155d20 2024-01-22T05:04:55.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.565+0000 7f890b000700 1 -- 172.21.15.49:0/2357901728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89040bdc00 con 0x7f8904155d20 2024-01-22T05:04:55.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.565+0000 7f88fb400700 1 -- 172.21.15.49:0/2357901728 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc01d9f0 con 0x7f8904155d20 2024-01-22T05:04:55.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.565+0000 7f890b000700 1 -- 172.21.15.49:0/2357901728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89040be1c0 con 0x7f8904155d20 2024-01-22T05:04:55.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.565+0000 7f890b000700 1 -- 172.21.15.49:0/2357901728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8904047060 con 0x7f8904155d20 2024-01-22T05:04:55.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.569+0000 7f88fb400700 1 -- 172.21.15.49:0/2357901728 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f88fc003040 con 0x7f8904155d20 2024-01-22T05:04:55.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.569+0000 7f88fb400700 1 --2- 172.21.15.49:0/2357901728 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f88dc05a4e0 0x7f88dc05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.569+0000 7f88fb400700 1 -- 172.21.15.49:0/2357901728 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f88fc076830 con 0x7f8904155d20 2024-01-22T05:04:55.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.569+0000 7f8903e00700 1 --2- 172.21.15.49:0/2357901728 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f88dc05a4e0 0x7f88dc05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.573+0000 7f8903e00700 1 --2- 172.21.15.49:0/2357901728 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f88dc05a4e0 0x7f88dc05c9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f88f4007fd0 tx=0x7f88f4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:55.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.577+0000 7f88fb400700 1 -- 172.21.15.49:0/2357901728 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f88fc049c40 con 0x7f8904155d20 2024-01-22T05:04:55.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.737+0000 7f890b000700 1 -- 172.21.15.49:0/2357901728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f89040c16d0 con 0x7f8904155d20 2024-01-22T05:04:55.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.741+0000 7f88fb400700 1 -- 172.21.15.49:0/2357901728 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88fc04d260 con 0x7f8904155d20 2024-01-22T05:04:55.742 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2024-01-22T05:04:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.741+0000 7f890b000700 1 -- 172.21.15.49:0/2357901728 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f88dc05a4e0 msgr2=0x7f88dc05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.741+0000 7f890b000700 1 --2- 172.21.15.49:0/2357901728 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f88dc05a4e0 0x7f88dc05c9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f88f4007fd0 tx=0x7f88f4009040).stop 2024-01-22T05:04:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.741+0000 7f890b000700 1 -- 172.21.15.49:0/2357901728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8904155d20 msgr2=0x7f89041573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.741+0000 7f890b000700 1 --2- 172.21.15.49:0/2357901728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8904155d20 0x7f89041573a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f88fc00b610 tx=0x7f88fc009780).stop 2024-01-22T05:04:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.741+0000 7f890b000700 1 -- 172.21.15.49:0/2357901728 shutdown_connections 2024-01-22T05:04:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.741+0000 7f890b000700 1 --2- 172.21.15.49:0/2357901728 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f88dc05a4e0 0x7f88dc05c9a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.741+0000 7f890b000700 1 --2- 172.21.15.49:0/2357901728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8904155d20 0x7f89041573a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.741+0000 7f890b000700 1 --2- 172.21.15.49:0/2357901728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89040c1ed0 0x7f8904156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.741+0000 7f890b000700 1 --2- 172.21.15.49:0/2357901728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89040a8740 0x7f8904168fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.741+0000 7f890b000700 1 -- 172.21.15.49:0/2357901728 >> 172.21.15.49:0/2357901728 conn(0x7f89040c6540 msgr2=0x7f89040c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:55.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.741+0000 7f890b000700 1 -- 172.21.15.49:0/2357901728 shutdown_connections 2024-01-22T05:04:55.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.741+0000 7f890b000700 1 -- 172.21.15.49:0/2357901728 wait complete. 2024-01-22T05:04:55.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-01-22T05:04:55.767 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-22T05:04:55.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.933+0000 7f7255200700 1 Processor -- start 2024-01-22T05:04:55.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.933+0000 7f7255200700 1 -- start start 2024-01-22T05:04:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.937+0000 7f7255200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7250154d60 0x7f72500c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.937+0000 7f7255200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f72500c3530 0x7f72500c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.937+0000 7f7255200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72501548d0 con 0x7f72500c30d0 2024-01-22T05:04:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.937+0000 7f7255200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7250150c40 con 0x7f72500c3530 2024-01-22T05:04:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.937+0000 7f7255200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725006a510 con 0x7f7250154d60 2024-01-22T05:04:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.937+0000 7f724ea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f72500c30d0 0x7f7250063ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34020/0 (socket says 172.21.15.49:34020) 2024-01-22T05:04:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.937+0000 7f724ea00700 1 -- 172.21.15.49:0/4038711262 learned_addr learned my addr 172.21.15.49:0/4038711262 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.937+0000 7f724fe00700 1 --2- 172.21.15.49:0/4038711262 >> v2:172.21.15.49:3300/0 conn(0x7f72500c3530 0x7f72500c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.937+0000 7f724f400700 1 --2- 172.21.15.49:0/4038711262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7250154d60 0x7f72500c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f724e000700 1 -- 172.21.15.49:0/4038711262 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256709501 0 0) 0x7f72501548d0 con 0x7f72500c30d0 2024-01-22T05:04:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f724e000700 1 -- 172.21.15.49:0/4038711262 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72300033f0 con 0x7f72500c30d0 2024-01-22T05:04:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f724fe00700 1 -- 172.21.15.49:0/4038711262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7250154d60 msgr2=0x7f72500c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f724fe00700 1 --2- 172.21.15.49:0/4038711262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7250154d60 0x7f72500c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f724fe00700 1 -- 172.21.15.49:0/4038711262 >> v1:172.21.15.49:6789/0 conn(0x7f72500c30d0 legacy=0x7f7250063ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f724fe00700 1 -- 172.21.15.49:0/4038711262 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72501542a0 con 0x7f72500c3530 2024-01-22T05:04:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f724fe00700 1 --2- 172.21.15.49:0/4038711262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72500c3530 0x7f72500c50f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f7248009e60 tx=0x7f7248009780).ready entity=mon.0 client_cookie=fc9613ab4f76474d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f724e000700 1 -- 172.21.15.49:0/4038711262 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800e070 con 0x7f72500c3530 2024-01-22T05:04:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f724e000700 1 -- 172.21.15.49:0/4038711262 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724800bab0 con 0x7f72500c3530 2024-01-22T05:04:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f724e000700 1 -- 172.21.15.49:0/4038711262 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800be30 con 0x7f72500c3530 2024-01-22T05:04:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f7255200700 1 -- 172.21.15.49:0/4038711262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72500c3530 msgr2=0x7f72500c50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f7255200700 1 --2- 172.21.15.49:0/4038711262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72500c3530 0x7f72500c50f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f7248009e60 tx=0x7f7248009780).stop 2024-01-22T05:04:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f7255200700 1 -- 172.21.15.49:0/4038711262 shutdown_connections 2024-01-22T05:04:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f7255200700 1 --2- 172.21.15.49:0/4038711262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72500c3530 0x7f72500c50f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f7255200700 1 --2- 172.21.15.49:0/4038711262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7250154d60 0x7f72500c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f7255200700 1 -- 172.21.15.49:0/4038711262 >> 172.21.15.49:0/4038711262 conn(0x7f72500626d0 msgr2=0x7f7250062ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f7255200700 1 -- 172.21.15.49:0/4038711262 shutdown_connections 2024-01-22T05:04:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.941+0000 7f7255200700 1 -- 172.21.15.49:0/4038711262 wait complete. 2024-01-22T05:04:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.945+0000 7f7255200700 1 Processor -- start 2024-01-22T05:04:55.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.945+0000 7f7255200700 1 -- start start 2024-01-22T05:04:55.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.945+0000 7f7255200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72500c30d0 0x7f7250168590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.945+0000 7f7255200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72500c3530 0x7f7250145e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.945+0000 7f7255200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7250154d60 0x7f72500acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.945+0000 7f7255200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7250168a80 con 0x7f7250154d60 2024-01-22T05:04:55.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.945+0000 7f7255200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72501462f0 con 0x7f72500c3530 2024-01-22T05:04:55.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.945+0000 7f7255200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72500ab220 con 0x7f72500c30d0 2024-01-22T05:04:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f724fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7250154d60 0x7f72500acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f724fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7250154d60 0x7f72500acf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36252/0 (socket says 172.21.15.49:36252) 2024-01-22T05:04:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f724f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72500c30d0 0x7f7250168590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f724fe00700 1 -- 172.21.15.49:0/663476656 learned_addr learned my addr 172.21.15.49:0/663476656 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f724ea00700 1 --2- 172.21.15.49:0/663476656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72500c3530 0x7f7250145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f724fe00700 1 -- 172.21.15.49:0/663476656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72500c30d0 msgr2=0x7f7250168590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f724fe00700 1 --2- 172.21.15.49:0/663476656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72500c30d0 0x7f7250168590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f724fe00700 1 -- 172.21.15.49:0/663476656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72500c3530 msgr2=0x7f7250145e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f724fe00700 1 --2- 172.21.15.49:0/663476656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72500c3530 0x7f7250145e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f724fe00700 1 -- 172.21.15.49:0/663476656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7248009a20 con 0x7f7250154d60 2024-01-22T05:04:55.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f724fe00700 1 --2- 172.21.15.49:0/663476656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7250154d60 0x7f72500acf10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f72500be590 tx=0x7f7248009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:55.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f7246a00700 1 -- 172.21.15.49:0/663476656 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248013e40 con 0x7f7250154d60 2024-01-22T05:04:55.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f7246a00700 1 -- 172.21.15.49:0/663476656 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724801d630 con 0x7f7250154d60 2024-01-22T05:04:55.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f7255200700 1 -- 172.21.15.49:0/663476656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72500ab500 con 0x7f7250154d60 2024-01-22T05:04:55.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f7246a00700 1 -- 172.21.15.49:0/663476656 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724801d9f0 con 0x7f7250154d60 2024-01-22T05:04:55.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.949+0000 7f7255200700 1 -- 172.21.15.49:0/663476656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7250167d90 con 0x7f7250154d60 2024-01-22T05:04:55.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.953+0000 7f7255200700 1 -- 172.21.15.49:0/663476656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7250065330 con 0x7f7250154d60 2024-01-22T05:04:55.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.953+0000 7f7246a00700 1 -- 172.21.15.49:0/663476656 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7248003040 con 0x7f7250154d60 2024-01-22T05:04:55.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.953+0000 7f7246a00700 1 --2- 172.21.15.49:0/663476656 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f722805a510 0x7f722805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:55.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.953+0000 7f7246a00700 1 -- 172.21.15.49:0/663476656 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f72480767f0 con 0x7f7250154d60 2024-01-22T05:04:55.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.953+0000 7f724f400700 1 --2- 172.21.15.49:0/663476656 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f722805a510 0x7f722805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:55.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.957+0000 7f724f400700 1 --2- 172.21.15.49:0/663476656 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f722805a510 0x7f722805c9d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f7240006fd0 tx=0x7f7240006f40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:55.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:55.961+0000 7f7246a00700 1 -- 172.21.15.49:0/663476656 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7248049cc0 con 0x7f7250154d60 2024-01-22T05:04:56.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.129+0000 7f7255200700 1 -- 172.21.15.49:0/663476656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f72500c39b0 con 0x7f7250154d60 2024-01-22T05:04:56.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.129+0000 7f7246a00700 1 -- 172.21.15.49:0/663476656 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f724804d2e0 con 0x7f7250154d60 2024-01-22T05:04:56.131 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2024-01-22T05:04:56.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.133+0000 7f7255200700 1 -- 172.21.15.49:0/663476656 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f722805a510 msgr2=0x7f722805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:56.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.133+0000 7f7255200700 1 --2- 172.21.15.49:0/663476656 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f722805a510 0x7f722805c9d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f7240006fd0 tx=0x7f7240006f40).stop 2024-01-22T05:04:56.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.133+0000 7f7255200700 1 -- 172.21.15.49:0/663476656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7250154d60 msgr2=0x7f72500acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:56.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.133+0000 7f7255200700 1 --2- 172.21.15.49:0/663476656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7250154d60 0x7f72500acf10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f72500be590 tx=0x7f7248009780).stop 2024-01-22T05:04:56.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.133+0000 7f7255200700 1 -- 172.21.15.49:0/663476656 shutdown_connections 2024-01-22T05:04:56.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.133+0000 7f7255200700 1 --2- 172.21.15.49:0/663476656 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f722805a510 0x7f722805c9d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.133+0000 7f7255200700 1 --2- 172.21.15.49:0/663476656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7250154d60 0x7f72500acf10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.133+0000 7f7255200700 1 --2- 172.21.15.49:0/663476656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72500c3530 0x7f7250145e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.133+0000 7f7255200700 1 --2- 172.21.15.49:0/663476656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72500c30d0 0x7f7250168590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.133+0000 7f7255200700 1 -- 172.21.15.49:0/663476656 >> 172.21.15.49:0/663476656 conn(0x7f72500626d0 msgr2=0x7f72500a8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:56.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.133+0000 7f7255200700 1 -- 172.21.15.49:0/663476656 shutdown_connections 2024-01-22T05:04:56.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.133+0000 7f7255200700 1 -- 172.21.15.49:0/663476656 wait complete. 2024-01-22T05:04:56.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-01-22T05:04:56.158 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-22T05:04:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.317+0000 7faee2e00700 1 Processor -- start 2024-01-22T05:04:56.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.321+0000 7faee2e00700 1 -- start start 2024-01-22T05:04:56.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.321+0000 7faee2e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faedc155d20 0x7faedc065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:56.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.321+0000 7faee2e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faedc0c1a40 con 0x7faedc066070 2024-01-22T05:04:56.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.321+0000 7faee2e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faedc159310 con 0x7faedc0a8e50 2024-01-22T05:04:56.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.321+0000 7faee2e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0c13f0 con 0x7faedc155d20 2024-01-22T05:04:56.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.321+0000 7faedb400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faedc066070 0x7faedc0a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34034/0 (socket says 172.21.15.49:34034) 2024-01-22T05:04:56.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.321+0000 7faedb400700 1 -- 172.21.15.49:0/2299169694 learned_addr learned my addr 172.21.15.49:0/2299169694 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:56.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.321+0000 7faedbe00700 1 --2- 172.21.15.49:0/2299169694 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faedc155d20 0x7faedc065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.325+0000 7faedaa00700 1 -- 172.21.15.49:0/2299169694 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416453558 0 0) 0x7faedc0c1a40 con 0x7faedc066070 2024-01-22T05:04:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.325+0000 7faedaa00700 1 -- 172.21.15.49:0/2299169694 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faebc0033f0 con 0x7faedc066070 2024-01-22T05:04:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.325+0000 7faedaa00700 1 -- 172.21.15.49:0/2299169694 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734351910 0 0) 0x7faedc159310 con 0x7faedc0a8e50 2024-01-22T05:04:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.325+0000 7faedbe00700 1 -- 172.21.15.49:0/2299169694 >> v1:172.21.15.110:6789/0 conn(0x7faedc0a8e50 legacy=0x7faedc0c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.325+0000 7faedbe00700 1 -- 172.21.15.49:0/2299169694 >> v1:172.21.15.49:6789/0 conn(0x7faedc066070 legacy=0x7faedc0a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.325+0000 7faedbe00700 1 -- 172.21.15.49:0/2299169694 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc0c16d0 con 0x7faedc155d20 2024-01-22T05:04:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.325+0000 7faedbe00700 1 --2- 172.21.15.49:0/2299169694 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faedc155d20 0x7faedc065b80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7faecc009790 tx=0x7faecc009060).ready entity=mon.2 client_cookie=c31ed11cabed605f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:56.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.325+0000 7faedaa00700 1 -- 172.21.15.49:0/2299169694 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc00f510 con 0x7faedc155d20 2024-01-22T05:04:56.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.325+0000 7faedaa00700 1 -- 172.21.15.49:0/2299169694 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc00f670 con 0x7faedc155d20 2024-01-22T05:04:56.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.325+0000 7faedaa00700 1 -- 172.21.15.49:0/2299169694 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc00f9f0 con 0x7faedc155d20 2024-01-22T05:04:56.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.325+0000 7faee2e00700 1 -- 172.21.15.49:0/2299169694 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faedc155d20 msgr2=0x7faedc065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:56.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.325+0000 7faee2e00700 1 --2- 172.21.15.49:0/2299169694 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faedc155d20 0x7faedc065b80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7faecc009790 tx=0x7faecc009060).stop 2024-01-22T05:04:56.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.329+0000 7faee2e00700 1 -- 172.21.15.49:0/2299169694 shutdown_connections 2024-01-22T05:04:56.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.329+0000 7faee2e00700 1 --2- 172.21.15.49:0/2299169694 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faedc155d20 0x7faedc065b80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.329+0000 7faee2e00700 1 -- 172.21.15.49:0/2299169694 >> 172.21.15.49:0/2299169694 conn(0x7faedc0c6540 msgr2=0x7faedc0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.329+0000 7faee2e00700 1 -- 172.21.15.49:0/2299169694 shutdown_connections 2024-01-22T05:04:56.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.329+0000 7faee2e00700 1 -- 172.21.15.49:0/2299169694 wait complete. 2024-01-22T05:04:56.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.329+0000 7faee2e00700 1 Processor -- start 2024-01-22T05:04:56.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faee2e00700 1 -- start start 2024-01-22T05:04:56.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faee2e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faedc066070 0x7faedc0a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:56.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faee2e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faedc0a8e50 0x7faedc168400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:56.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faee2e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faedc155d20 0x7faedc15af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:56.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faee2e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0a9aa0 con 0x7faedc066070 2024-01-22T05:04:56.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faee2e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0bf300 con 0x7faedc0a8e50 2024-01-22T05:04:56.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faee2e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc1576c0 con 0x7faedc155d20 2024-01-22T05:04:56.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faedbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faedc066070 0x7faedc0a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:56.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faedbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faedc066070 0x7faedc0a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36266/0 (socket says 172.21.15.49:36266) 2024-01-22T05:04:56.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faedbe00700 1 -- 172.21.15.49:0/272061916 learned_addr learned my addr 172.21.15.49:0/272061916 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:56.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faedb400700 1 --2- 172.21.15.49:0/272061916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faedc0a8e50 0x7faedc168400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:56.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faee0e00700 1 --2- 172.21.15.49:0/272061916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faedc155d20 0x7faedc15af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:56.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faedbe00700 1 -- 172.21.15.49:0/272061916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faedc155d20 msgr2=0x7faedc15af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:56.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faedbe00700 1 --2- 172.21.15.49:0/272061916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faedc155d20 0x7faedc15af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faedbe00700 1 -- 172.21.15.49:0/272061916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faedc0a8e50 msgr2=0x7faedc168400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:56.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faedbe00700 1 --2- 172.21.15.49:0/272061916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faedc0a8e50 0x7faedc168400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.333+0000 7faedbe00700 1 -- 172.21.15.49:0/272061916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc0092a0 con 0x7faedc066070 2024-01-22T05:04:56.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.337+0000 7faedbe00700 1 --2- 172.21.15.49:0/272061916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faedc066070 0x7faedc0a95b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7faecc009e30 tx=0x7faecc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:56.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.337+0000 7faed3400700 1 -- 172.21.15.49:0/272061916 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc00fe80 con 0x7faedc066070 2024-01-22T05:04:56.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.337+0000 7faed3400700 1 -- 172.21.15.49:0/272061916 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc00f7e0 con 0x7faedc066070 2024-01-22T05:04:56.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.337+0000 7faed3400700 1 -- 172.21.15.49:0/272061916 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc01b620 con 0x7faedc066070 2024-01-22T05:04:56.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.337+0000 7faee2e00700 1 -- 172.21.15.49:0/272061916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc1579a0 con 0x7faedc066070 2024-01-22T05:04:56.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.337+0000 7faee2e00700 1 -- 172.21.15.49:0/272061916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faedc157f60 con 0x7faedc066070 2024-01-22T05:04:56.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.337+0000 7faee2e00700 1 -- 172.21.15.49:0/272061916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faedc047060 con 0x7faedc066070 2024-01-22T05:04:56.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.337+0000 7faed3400700 1 -- 172.21.15.49:0/272061916 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7faecc01b990 con 0x7faedc066070 2024-01-22T05:04:56.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.341+0000 7faed3400700 1 --2- 172.21.15.49:0/272061916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faeb405a590 0x7faeb405ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:56.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.341+0000 7faed3400700 1 -- 172.21.15.49:0/272061916 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7faecc076250 con 0x7faedc066070 2024-01-22T05:04:56.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.341+0000 7faedb400700 1 --2- 172.21.15.49:0/272061916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faeb405a590 0x7faeb405ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:56.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.341+0000 7faedb400700 1 --2- 172.21.15.49:0/272061916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faeb405a590 0x7faeb405ca50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7faedc0c32f0 tx=0x7faec4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:56.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.349+0000 7faed3400700 1 -- 172.21.15.49:0/272061916 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faecc0496e0 con 0x7faedc066070 2024-01-22T05:04:56.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.513+0000 7faee2e00700 1 -- 172.21.15.49:0/272061916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7faedc0bf0d0 con 0x7faedc066070 2024-01-22T05:04:56.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.513+0000 7faed3400700 1 -- 172.21.15.49:0/272061916 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faecc04cd00 con 0x7faedc066070 2024-01-22T05:04:56.516 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2024-01-22T05:04:56.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.517+0000 7faee2e00700 1 -- 172.21.15.49:0/272061916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faeb405a590 msgr2=0x7faeb405ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:56.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.517+0000 7faee2e00700 1 --2- 172.21.15.49:0/272061916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faeb405a590 0x7faeb405ca50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7faedc0c32f0 tx=0x7faec4009040).stop 2024-01-22T05:04:56.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.517+0000 7faee2e00700 1 -- 172.21.15.49:0/272061916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faedc066070 msgr2=0x7faedc0a95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:56.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.517+0000 7faee2e00700 1 --2- 172.21.15.49:0/272061916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faedc066070 0x7faedc0a95b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7faecc009e30 tx=0x7faecc017000).stop 2024-01-22T05:04:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.517+0000 7faee2e00700 1 -- 172.21.15.49:0/272061916 shutdown_connections 2024-01-22T05:04:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.517+0000 7faee2e00700 1 --2- 172.21.15.49:0/272061916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faeb405a590 0x7faeb405ca50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.517+0000 7faee2e00700 1 --2- 172.21.15.49:0/272061916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faedc155d20 0x7faedc15af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.517+0000 7faee2e00700 1 --2- 172.21.15.49:0/272061916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faedc0a8e50 0x7faedc168400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.517+0000 7faee2e00700 1 --2- 172.21.15.49:0/272061916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faedc066070 0x7faedc0a95b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.517+0000 7faee2e00700 1 -- 172.21.15.49:0/272061916 >> 172.21.15.49:0/272061916 conn(0x7faedc0c6540 msgr2=0x7faedc0c2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.517+0000 7faee2e00700 1 -- 172.21.15.49:0/272061916 shutdown_connections 2024-01-22T05:04:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.517+0000 7faee2e00700 1 -- 172.21.15.49:0/272061916 wait complete. 2024-01-22T05:04:56.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-01-22T05:04:56.542 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-22T05:04:56.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.705+0000 7f1b87a00700 1 Processor -- start 2024-01-22T05:04:56.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.705+0000 7f1b87a00700 1 -- start start 2024-01-22T05:04:56.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.705+0000 7f1b87a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b800bd340 0x7f1b800bd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:56.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.705+0000 7f1b87a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1b80062230 0x7f1b800626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:56.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.705+0000 7f1b87a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b80154680 con 0x7f1b80153e30 2024-01-22T05:04:56.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.705+0000 7f1b87a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b80062bb0 con 0x7f1b800bd340 2024-01-22T05:04:56.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.705+0000 7f1b87a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b80154960 con 0x7f1b80062230 2024-01-22T05:04:56.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.705+0000 7f1b7fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b800bd340 0x7f1b800bd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:56.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.705+0000 7f1b85000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1b80153e30 0x7f1b800a90e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34038/0 (socket says 172.21.15.49:34038) 2024-01-22T05:04:56.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.705+0000 7f1b85000700 1 -- 172.21.15.49:0/1239472631 learned_addr learned my addr 172.21.15.49:0/1239472631 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:56.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.705+0000 7f1b85a00700 1 --2- 172.21.15.49:0/1239472631 >> v2:172.21.15.110:3300/0 conn(0x7f1b80062230 0x7f1b800626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:56.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b7f400700 1 -- 172.21.15.49:0/1239472631 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370852850 0 0) 0x7f1b80154680 con 0x7f1b80153e30 2024-01-22T05:04:56.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b7f400700 1 -- 172.21.15.49:0/1239472631 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b600033f0 con 0x7f1b80153e30 2024-01-22T05:04:56.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b7fe00700 1 -- 172.21.15.49:0/1239472631 >> v2:172.21.15.110:3300/0 conn(0x7f1b80062230 msgr2=0x7f1b800626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:56.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b7fe00700 1 --2- 172.21.15.49:0/1239472631 >> v2:172.21.15.110:3300/0 conn(0x7f1b80062230 0x7f1b800626c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b7fe00700 1 -- 172.21.15.49:0/1239472631 >> v1:172.21.15.49:6789/0 conn(0x7f1b80153e30 legacy=0x7f1b800a90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:56.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b7fe00700 1 -- 172.21.15.49:0/1239472631 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b80154c40 con 0x7f1b800bd340 2024-01-22T05:04:56.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b7fe00700 1 --2- 172.21.15.49:0/1239472631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b800bd340 0x7f1b800bd7d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f1b800c31c0 tx=0x7f1b6800a200).ready entity=mon.0 client_cookie=7a6dd079156df3cd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:56.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b7f400700 1 -- 172.21.15.49:0/1239472631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6800a270 con 0x7f1b800bd340 2024-01-22T05:04:56.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b7f400700 1 -- 172.21.15.49:0/1239472631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6800c690 con 0x7f1b800bd340 2024-01-22T05:04:56.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b7f400700 1 -- 172.21.15.49:0/1239472631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6800ca10 con 0x7f1b800bd340 2024-01-22T05:04:56.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b87a00700 1 -- 172.21.15.49:0/1239472631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b800bd340 msgr2=0x7f1b800bd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:56.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b87a00700 1 --2- 172.21.15.49:0/1239472631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b800bd340 0x7f1b800bd7d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f1b800c31c0 tx=0x7f1b6800a200).stop 2024-01-22T05:04:56.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b87a00700 1 -- 172.21.15.49:0/1239472631 shutdown_connections 2024-01-22T05:04:56.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b87a00700 1 --2- 172.21.15.49:0/1239472631 >> v2:172.21.15.110:3300/0 conn(0x7f1b80062230 0x7f1b800626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b87a00700 1 --2- 172.21.15.49:0/1239472631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b800bd340 0x7f1b800bd7d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b87a00700 1 -- 172.21.15.49:0/1239472631 >> 172.21.15.49:0/1239472631 conn(0x7f1b800c7850 msgr2=0x7f1b800c3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:56.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b87a00700 1 -- 172.21.15.49:0/1239472631 shutdown_connections 2024-01-22T05:04:56.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.709+0000 7f1b87a00700 1 -- 172.21.15.49:0/1239472631 wait complete. 2024-01-22T05:04:56.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.713+0000 7f1b87a00700 1 Processor -- start 2024-01-22T05:04:56.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.713+0000 7f1b87a00700 1 -- start start 2024-01-22T05:04:56.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b87a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b80062230 0x7f1b800bde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b87a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b800bd340 0x7f1b8016cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b87a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b80153e30 0x7f1b800bf960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b87a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8014f400 con 0x7f1b80062230 2024-01-22T05:04:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b87a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8016d150 con 0x7f1b800bd340 2024-01-22T05:04:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b87a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b800be450 con 0x7f1b80153e30 2024-01-22T05:04:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b85000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b80062230 0x7f1b800bde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b85000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b80062230 0x7f1b800bde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36290/0 (socket says 172.21.15.49:36290) 2024-01-22T05:04:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b85000700 1 -- 172.21.15.49:0/1863073716 learned_addr learned my addr 172.21.15.49:0/1863073716 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b7fe00700 1 --2- 172.21.15.49:0/1863073716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b800bd340 0x7f1b8016cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b85a00700 1 --2- 172.21.15.49:0/1863073716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b80153e30 0x7f1b800bf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b85000700 1 -- 172.21.15.49:0/1863073716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b80153e30 msgr2=0x7f1b800bf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b85000700 1 --2- 172.21.15.49:0/1863073716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b80153e30 0x7f1b800bf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b85000700 1 -- 172.21.15.49:0/1863073716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b800bd340 msgr2=0x7f1b8016cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b85000700 1 --2- 172.21.15.49:0/1863073716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b800bd340 0x7f1b8016cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b85000700 1 -- 172.21.15.49:0/1863073716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6800a440 con 0x7f1b80062230 2024-01-22T05:04:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b85000700 1 --2- 172.21.15.49:0/1863073716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b80062230 0x7f1b800bde20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f1b7000c420 tx=0x7f1b70007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b77e00700 1 -- 172.21.15.49:0/1863073716 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7000ce80 con 0x7f1b80062230 2024-01-22T05:04:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b77e00700 1 -- 172.21.15.49:0/1863073716 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b700072e0 con 0x7f1b80062230 2024-01-22T05:04:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b87a00700 1 -- 172.21.15.49:0/1863073716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b800be730 con 0x7f1b80062230 2024-01-22T05:04:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.717+0000 7f1b77e00700 1 -- 172.21.15.49:0/1863073716 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70007660 con 0x7f1b80062230 2024-01-22T05:04:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.721+0000 7f1b87a00700 1 -- 172.21.15.49:0/1863073716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b800becf0 con 0x7f1b80062230 2024-01-22T05:04:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.721+0000 7f1b87a00700 1 -- 172.21.15.49:0/1863073716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b80065120 con 0x7f1b80062230 2024-01-22T05:04:56.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.721+0000 7f1b77e00700 1 -- 172.21.15.49:0/1863073716 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1b700059b0 con 0x7f1b80062230 2024-01-22T05:04:56.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.725+0000 7f1b77e00700 1 --2- 172.21.15.49:0/1863073716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b5805a510 0x7f1b5805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:56.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.725+0000 7f1b77e00700 1 -- 172.21.15.49:0/1863073716 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f1b70074200 con 0x7f1b80062230 2024-01-22T05:04:56.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.725+0000 7f1b7fe00700 1 --2- 172.21.15.49:0/1863073716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b5805a510 0x7f1b5805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:56.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.725+0000 7f1b7fe00700 1 --2- 172.21.15.49:0/1863073716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b5805a510 0x7f1b5805c9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f1b6800c450 tx=0x7f1b6800a200).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:56.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.729+0000 7f1b77e00700 1 -- 172.21.15.49:0/1863073716 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1b700476d0 con 0x7f1b80062230 2024-01-22T05:04:56.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.897+0000 7f1b87a00700 1 -- 172.21.15.49:0/1863073716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1b800bce20 con 0x7f1b80062230 2024-01-22T05:04:56.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.897+0000 7f1b77e00700 1 -- 172.21.15.49:0/1863073716 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b7004acf0 con 0x7f1b80062230 2024-01-22T05:04:56.899 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2024-01-22T05:04:56.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.897+0000 7f1b87a00700 1 -- 172.21.15.49:0/1863073716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b5805a510 msgr2=0x7f1b5805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:56.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.897+0000 7f1b87a00700 1 --2- 172.21.15.49:0/1863073716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b5805a510 0x7f1b5805c9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f1b6800c450 tx=0x7f1b6800a200).stop 2024-01-22T05:04:56.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.897+0000 7f1b87a00700 1 -- 172.21.15.49:0/1863073716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b80062230 msgr2=0x7f1b800bde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:56.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.897+0000 7f1b87a00700 1 --2- 172.21.15.49:0/1863073716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b80062230 0x7f1b800bde20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f1b7000c420 tx=0x7f1b70007c80).stop 2024-01-22T05:04:56.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.897+0000 7f1b87a00700 1 -- 172.21.15.49:0/1863073716 shutdown_connections 2024-01-22T05:04:56.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.897+0000 7f1b87a00700 1 --2- 172.21.15.49:0/1863073716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b5805a510 0x7f1b5805c9d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.897+0000 7f1b87a00700 1 --2- 172.21.15.49:0/1863073716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b80153e30 0x7f1b800bf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.897+0000 7f1b87a00700 1 --2- 172.21.15.49:0/1863073716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b800bd340 0x7f1b8016cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.897+0000 7f1b87a00700 1 --2- 172.21.15.49:0/1863073716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b80062230 0x7f1b800bde20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:56.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.901+0000 7f1b87a00700 1 -- 172.21.15.49:0/1863073716 >> 172.21.15.49:0/1863073716 conn(0x7f1b800c7850 msgr2=0x7f1b80059470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:56.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.901+0000 7f1b87a00700 1 -- 172.21.15.49:0/1863073716 shutdown_connections 2024-01-22T05:04:56.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:56.901+0000 7f1b87a00700 1 -- 172.21.15.49:0/1863073716 wait complete. 2024-01-22T05:04:56.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-01-22T05:04:56.925 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-22T05:04:57.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.089+0000 7fcab2a00700 1 Processor -- start 2024-01-22T05:04:57.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.089+0000 7fcab2a00700 1 -- start start 2024-01-22T05:04:57.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.093+0000 7fcab2a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcaac0a7260 0x7fcaac0659b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.093+0000 7fcab2a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac068a60 con 0x7fcaac155c60 2024-01-22T05:04:57.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.093+0000 7fcab2a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac067e50 con 0x7fcaac155880 2024-01-22T05:04:57.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.093+0000 7fcab2a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac068130 con 0x7fcaac0a7260 2024-01-22T05:04:57.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.093+0000 7fcab2000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcaac0a7260 0x7fcaac0659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.093+0000 7fcab2000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcaac0a7260 0x7fcaac0659b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36304/0 (socket says 172.21.15.49:36304) 2024-01-22T05:04:57.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.093+0000 7fcab2000700 1 -- 172.21.15.49:0/3952250794 learned_addr learned my addr 172.21.15.49:0/3952250794 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:57.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.093+0000 7fcab2000700 1 -- 172.21.15.49:0/3952250794 >> v1:172.21.15.110:6789/0 conn(0x7fcaac155880 legacy=0x7fcaac0a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.093+0000 7fcab2000700 1 -- 172.21.15.49:0/3952250794 >> v1:172.21.15.49:6789/0 conn(0x7fcaac155c60 legacy=0x7fcaac0a6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.093+0000 7fcaabe00700 1 -- 172.21.15.49:0/3952250794 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551121613 0 0) 0x7fcaac067e50 con 0x7fcaac155880 2024-01-22T05:04:57.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.093+0000 7fcab2000700 1 -- 172.21.15.49:0/3952250794 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac068410 con 0x7fcaac0a7260 2024-01-22T05:04:57.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.093+0000 7fcab2000700 1 --2- 172.21.15.49:0/3952250794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaac0a7260 0x7fcaac0659b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fcaac0a7700 tx=0x7fcaa4009840).ready entity=mon.0 client_cookie=bec9421423006851 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:57.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.093+0000 7fcaabe00700 1 -- 172.21.15.49:0/3952250794 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa400e070 con 0x7fcaac0a7260 2024-01-22T05:04:57.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.093+0000 7fcaabe00700 1 -- 172.21.15.49:0/3952250794 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa400ba50 con 0x7fcaac0a7260 2024-01-22T05:04:57.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.093+0000 7fcaabe00700 1 -- 172.21.15.49:0/3952250794 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa400bdd0 con 0x7fcaac0a7260 2024-01-22T05:04:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.097+0000 7fcab2a00700 1 -- 172.21.15.49:0/3952250794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaac0a7260 msgr2=0x7fcaac0659b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.097+0000 7fcab2a00700 1 --2- 172.21.15.49:0/3952250794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaac0a7260 0x7fcaac0659b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fcaac0a7700 tx=0x7fcaa4009840).stop 2024-01-22T05:04:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.097+0000 7fcab2a00700 1 -- 172.21.15.49:0/3952250794 shutdown_connections 2024-01-22T05:04:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.097+0000 7fcab2a00700 1 --2- 172.21.15.49:0/3952250794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaac0a7260 0x7fcaac0659b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.097+0000 7fcab2a00700 1 -- 172.21.15.49:0/3952250794 >> 172.21.15.49:0/3952250794 conn(0x7fcaac0c6530 msgr2=0x7fcaac0c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.097+0000 7fcab2a00700 1 -- 172.21.15.49:0/3952250794 shutdown_connections 2024-01-22T05:04:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.097+0000 7fcab2a00700 1 -- 172.21.15.49:0/3952250794 wait complete. 2024-01-22T05:04:57.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.097+0000 7fcab2a00700 1 Processor -- start 2024-01-22T05:04:57.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2a00700 1 -- start start 2024-01-22T05:04:57.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcaac0a7260 0x7fcaac0ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac155880 0x7fcaac1543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaac155c60 0x7fcaac0a11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0a31c0 con 0x7fcaac155c60 2024-01-22T05:04:57.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac15b0c0 con 0x7fcaac155880 2024-01-22T05:04:57.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac15a540 con 0x7fcaac0a7260 2024-01-22T05:04:57.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaac155c60 0x7fcaac0a11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaac155c60 0x7fcaac0a11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36316/0 (socket says 172.21.15.49:36316) 2024-01-22T05:04:57.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2000700 1 -- 172.21.15.49:0/2709836748 learned_addr learned my addr 172.21.15.49:0/2709836748 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:57.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab0c00700 1 --2- 172.21.15.49:0/2709836748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac155880 0x7fcaac1543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab1600700 1 --2- 172.21.15.49:0/2709836748 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcaac0a7260 0x7fcaac0ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2000700 1 -- 172.21.15.49:0/2709836748 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcaac0a7260 msgr2=0x7fcaac0ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2000700 1 --2- 172.21.15.49:0/2709836748 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcaac0a7260 0x7fcaac0ab040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2000700 1 -- 172.21.15.49:0/2709836748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac155880 msgr2=0x7fcaac1543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2000700 1 --2- 172.21.15.49:0/2709836748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac155880 0x7fcaac1543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2000700 1 -- 172.21.15.49:0/2709836748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa4009ae0 con 0x7fcaac155c60 2024-01-22T05:04:57.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab0c00700 1 --2- 172.21.15.49:0/2709836748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac155880 0x7fcaac1543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:04:57.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2000700 1 --2- 172.21.15.49:0/2709836748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaac155c60 0x7fcaac0a11d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fcaac059510 tx=0x7fcaac1584c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:57.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcaa8c00700 1 -- 172.21.15.49:0/2709836748 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40092e0 con 0x7fcaac155c60 2024-01-22T05:04:57.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcab2a00700 1 -- 172.21.15.49:0/2709836748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac15a820 con 0x7fcaac155c60 2024-01-22T05:04:57.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcaa8c00700 1 -- 172.21.15.49:0/2709836748 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa401e470 con 0x7fcaac155c60 2024-01-22T05:04:57.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.101+0000 7fcaa8c00700 1 -- 172.21.15.49:0/2709836748 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa401e7f0 con 0x7fcaac155c60 2024-01-22T05:04:57.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.105+0000 7fcab2a00700 1 -- 172.21.15.49:0/2709836748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac15ade0 con 0x7fcaac155c60 2024-01-22T05:04:57.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.105+0000 7fcab2a00700 1 -- 172.21.15.49:0/2709836748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac05fd40 con 0x7fcaac155c60 2024-01-22T05:04:57.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.105+0000 7fcaa8c00700 1 -- 172.21.15.49:0/2709836748 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcaa4003040 con 0x7fcaac155c60 2024-01-22T05:04:57.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.105+0000 7fcaa8c00700 1 --2- 172.21.15.49:0/2709836748 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca8405a510 0x7fca8405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.105+0000 7fcaa8c00700 1 -- 172.21.15.49:0/2709836748 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fcaa4076250 con 0x7fcaac155c60 2024-01-22T05:04:57.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.109+0000 7fcab1600700 1 --2- 172.21.15.49:0/2709836748 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca8405a510 0x7fca8405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.109+0000 7fcab1600700 1 --2- 172.21.15.49:0/2709836748 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca8405a510 0x7fca8405c9d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fca9c0011e0 tx=0x7fca9c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:57.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.113+0000 7fcaa8c00700 1 -- 172.21.15.49:0/2709836748 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcaa4049710 con 0x7fcaac155c60 2024-01-22T05:04:57.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.281+0000 7fcab2a00700 1 -- 172.21.15.49:0/2709836748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fcaac046800 con 0x7fcaac155c60 2024-01-22T05:04:57.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.281+0000 7fcaa8c00700 1 -- 172.21.15.49:0/2709836748 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcaa4023070 con 0x7fcaac155c60 2024-01-22T05:04:57.284 INFO:teuthology.orchestra.run.smithi049.stdout:55834574855 2024-01-22T05:04:57.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.285+0000 7fcab2a00700 1 -- 172.21.15.49:0/2709836748 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca8405a510 msgr2=0x7fca8405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.285+0000 7fcab2a00700 1 --2- 172.21.15.49:0/2709836748 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca8405a510 0x7fca8405c9d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fca9c0011e0 tx=0x7fca9c009040).stop 2024-01-22T05:04:57.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.285+0000 7fcab2a00700 1 -- 172.21.15.49:0/2709836748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaac155c60 msgr2=0x7fcaac0a11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.285+0000 7fcab2a00700 1 --2- 172.21.15.49:0/2709836748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaac155c60 0x7fcaac0a11d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fcaac059510 tx=0x7fcaac1584c0).stop 2024-01-22T05:04:57.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.285+0000 7fcab2a00700 1 -- 172.21.15.49:0/2709836748 shutdown_connections 2024-01-22T05:04:57.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.285+0000 7fcab2a00700 1 --2- 172.21.15.49:0/2709836748 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca8405a510 0x7fca8405c9d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.285+0000 7fcab2a00700 1 --2- 172.21.15.49:0/2709836748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaac155c60 0x7fcaac0a11d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.285+0000 7fcab2a00700 1 --2- 172.21.15.49:0/2709836748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac155880 0x7fcaac1543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.285+0000 7fcab2a00700 1 --2- 172.21.15.49:0/2709836748 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcaac0a7260 0x7fcaac0ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.285+0000 7fcab2a00700 1 -- 172.21.15.49:0/2709836748 >> 172.21.15.49:0/2709836748 conn(0x7fcaac0c6530 msgr2=0x7fcaac0659b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:57.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.285+0000 7fcab2a00700 1 -- 172.21.15.49:0/2709836748 shutdown_connections 2024-01-22T05:04:57.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.285+0000 7fcab2a00700 1 -- 172.21.15.49:0/2709836748 wait complete. 2024-01-22T05:04:57.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-01-22T05:04:57.312 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-22T05:04:57.312 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:04:57.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.465+0000 7f11c1c00700 1 Processor -- start 2024-01-22T05:04:57.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.465+0000 7f11c1c00700 1 -- start start 2024-01-22T05:04:57.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.465+0000 7f11c1c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f11bc0c2d90 0x7f11bc0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.465+0000 7f11c1c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11bc0bd110 con 0x7f11bc0bc580 2024-01-22T05:04:57.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.465+0000 7f11c1c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11bc0c2130 con 0x7f11bc153930 2024-01-22T05:04:57.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.465+0000 7f11c1c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11bc154c50 con 0x7f11bc0c2d90 2024-01-22T05:04:57.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.465+0000 7f11ba000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f11bc0bc580 0x7f11bc0bca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34044/0 (socket says 172.21.15.49:34044) 2024-01-22T05:04:57.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.465+0000 7f11ba000700 1 -- 172.21.15.49:0/2784881053 learned_addr learned my addr 172.21.15.49:0/2784881053 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:57.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.469+0000 7f11baa00700 1 --2- 172.21.15.49:0/2784881053 >> v2:172.21.15.110:3300/0 conn(0x7f11bc0c2d90 0x7f11bc0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.469+0000 7f11b9600700 1 -- 172.21.15.49:0/2784881053 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950473204 0 0) 0x7f11a4001110 con 0x7f11bc0bc580 2024-01-22T05:04:57.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.469+0000 7f11b9600700 1 -- 172.21.15.49:0/2784881053 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f119c0033f0 con 0x7f11bc0bc580 2024-01-22T05:04:57.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.469+0000 7f11b9600700 1 -- 172.21.15.49:0/2784881053 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272897854 0 0) 0x7f11bc0c2130 con 0x7f11bc153930 2024-01-22T05:04:57.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.469+0000 7f11b9600700 1 -- 172.21.15.49:0/2784881053 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11a4001110 con 0x7f11bc153930 2024-01-22T05:04:57.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.469+0000 7f11b9600700 1 -- 172.21.15.49:0/2784881053 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1601110509 0 0) 0x7f119c0033f0 con 0x7f11bc0bc580 2024-01-22T05:04:57.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.469+0000 7f11baa00700 1 -- 172.21.15.49:0/2784881053 >> v1:172.21.15.110:6789/0 conn(0x7f11bc153930 legacy=0x7f11bc153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.469+0000 7f11baa00700 1 -- 172.21.15.49:0/2784881053 >> v1:172.21.15.49:6789/0 conn(0x7f11bc0bc580 legacy=0x7f11bc0bca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.469+0000 7f11baa00700 1 -- 172.21.15.49:0/2784881053 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc154f30 con 0x7f11bc0c2d90 2024-01-22T05:04:57.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.469+0000 7f11baa00700 1 --2- 172.21.15.49:0/2784881053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11bc0c2d90 0x7f11bc0c3170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f11ac009760 tx=0x7f11ac009060).ready entity=mon.1 client_cookie=dcf539dcdb824405 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:57.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.469+0000 7f11b9600700 1 -- 172.21.15.49:0/2784881053 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4001600 con 0x7f11bc0c2d90 2024-01-22T05:04:57.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.469+0000 7f11b9600700 1 -- 172.21.15.49:0/2784881053 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac011400 con 0x7f11bc0c2d90 2024-01-22T05:04:57.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.469+0000 7f11b9600700 1 -- 172.21.15.49:0/2784881053 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac011780 con 0x7f11bc0c2d90 2024-01-22T05:04:57.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.469+0000 7f11c1c00700 1 -- 172.21.15.49:0/2784881053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11bc0c2d90 msgr2=0x7f11bc0c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.469+0000 7f11c1c00700 1 --2- 172.21.15.49:0/2784881053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11bc0c2d90 0x7f11bc0c3170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f11ac009760 tx=0x7f11ac009060).stop 2024-01-22T05:04:57.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.473+0000 7f11c1c00700 1 -- 172.21.15.49:0/2784881053 shutdown_connections 2024-01-22T05:04:57.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.473+0000 7f11c1c00700 1 --2- 172.21.15.49:0/2784881053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11bc0c2d90 0x7f11bc0c3170 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.473+0000 7f11c1c00700 1 -- 172.21.15.49:0/2784881053 >> 172.21.15.49:0/2784881053 conn(0x7f11bc066830 msgr2=0x7f11bc066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:57.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.473+0000 7f11c1c00700 1 -- 172.21.15.49:0/2784881053 shutdown_connections 2024-01-22T05:04:57.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.473+0000 7f11c1c00700 1 -- 172.21.15.49:0/2784881053 wait complete. 2024-01-22T05:04:57.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.473+0000 7f11c1c00700 1 Processor -- start 2024-01-22T05:04:57.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.473+0000 7f11c1c00700 1 -- start start 2024-01-22T05:04:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11c1c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11bc0bc580 0x7f11bc159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11c1c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc0c2d90 0x7f11bc157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11c1c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11bc153930 0x7f11bc157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11c1c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc157f40 con 0x7f11bc0c2d90 2024-01-22T05:04:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11c1c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc1508e0 con 0x7f11bc0bc580 2024-01-22T05:04:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11c1c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc15a8d0 con 0x7f11bc153930 2024-01-22T05:04:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11ba000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc0c2d90 0x7f11bc157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11ba000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc0c2d90 0x7f11bc157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36320/0 (socket says 172.21.15.49:36320) 2024-01-22T05:04:57.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11ba000700 1 -- 172.21.15.49:0/80898179 learned_addr learned my addr 172.21.15.49:0/80898179 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:57.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11baa00700 1 --2- 172.21.15.49:0/80898179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11bc0bc580 0x7f11bc159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11bb400700 1 --2- 172.21.15.49:0/80898179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11bc153930 0x7f11bc157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11ba000700 1 -- 172.21.15.49:0/80898179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11bc153930 msgr2=0x7f11bc157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11ba000700 1 --2- 172.21.15.49:0/80898179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11bc153930 0x7f11bc157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11ba000700 1 -- 172.21.15.49:0/80898179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11bc0bc580 msgr2=0x7f11bc159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11ba000700 1 --2- 172.21.15.49:0/80898179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11bc0bc580 0x7f11bc159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11ba000700 1 -- 172.21.15.49:0/80898179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac0092a0 con 0x7f11bc0c2d90 2024-01-22T05:04:57.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11ba000700 1 --2- 172.21.15.49:0/80898179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc0c2d90 0x7f11bc157560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f11a400c960 tx=0x7f11a4001c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:57.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11b2000700 1 -- 172.21.15.49:0/80898179 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a400cea0 con 0x7f11bc0c2d90 2024-01-22T05:04:57.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11b2000700 1 -- 172.21.15.49:0/80898179 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a4007170 con 0x7f11bc0c2d90 2024-01-22T05:04:57.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11b2000700 1 -- 172.21.15.49:0/80898179 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4007510 con 0x7f11bc0c2d90 2024-01-22T05:04:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11c1c00700 1 -- 172.21.15.49:0/80898179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11bc15ad60 con 0x7f11bc0c2d90 2024-01-22T05:04:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.477+0000 7f11c1c00700 1 -- 172.21.15.49:0/80898179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11bc159fa0 con 0x7f11bc0c2d90 2024-01-22T05:04:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.481+0000 7f11c1c00700 1 -- 172.21.15.49:0/80898179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11bc0657b0 con 0x7f11bc0c2d90 2024-01-22T05:04:57.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.481+0000 7f11b2000700 1 -- 172.21.15.49:0/80898179 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f11a4004ad0 con 0x7f11bc0c2d90 2024-01-22T05:04:57.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.481+0000 7f11b2000700 1 --2- 172.21.15.49:0/80898179 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f119405a510 0x7f119405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.481+0000 7f11b2000700 1 -- 172.21.15.49:0/80898179 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f11a40745b0 con 0x7f11bc0c2d90 2024-01-22T05:04:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.485+0000 7f11baa00700 1 --2- 172.21.15.49:0/80898179 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f119405a510 0x7f119405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.485+0000 7f11baa00700 1 --2- 172.21.15.49:0/80898179 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f119405a510 0x7f119405c9d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f11ac009760 tx=0x7f11ac016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:57.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.489+0000 7f11b2000700 1 -- 172.21.15.49:0/80898179 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f11a4047a80 con 0x7f11bc0c2d90 2024-01-22T05:04:57.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.653+0000 7f11c1c00700 1 -- 172.21.15.49:0/80898179 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11bc0bd0e0 con 0x7f119405a510 2024-01-22T05:04:57.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.669+0000 7f11b2000700 1 -- 172.21.15.49:0/80898179 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+410511 (secure 0 0 0) 0x7f11bc0bd0e0 con 0x7f119405a510 2024-01-22T05:04:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:57.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.677+0000 7f11c1c00700 1 -- 172.21.15.49:0/80898179 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f119405a510 msgr2=0x7f119405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.677+0000 7f11c1c00700 1 --2- 172.21.15.49:0/80898179 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f119405a510 0x7f119405c9d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f11ac009760 tx=0x7f11ac016000).stop 2024-01-22T05:04:57.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.677+0000 7f11c1c00700 1 -- 172.21.15.49:0/80898179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc0c2d90 msgr2=0x7f11bc157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.677+0000 7f11c1c00700 1 --2- 172.21.15.49:0/80898179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc0c2d90 0x7f11bc157560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f11a400c960 tx=0x7f11a4001c40).stop 2024-01-22T05:04:57.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.677+0000 7f11c1c00700 1 -- 172.21.15.49:0/80898179 shutdown_connections 2024-01-22T05:04:57.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.677+0000 7f11c1c00700 1 --2- 172.21.15.49:0/80898179 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f119405a510 0x7f119405c9d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.677+0000 7f11c1c00700 1 --2- 172.21.15.49:0/80898179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11bc153930 0x7f11bc157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.677+0000 7f11c1c00700 1 --2- 172.21.15.49:0/80898179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc0c2d90 0x7f11bc157560 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.677+0000 7f11c1c00700 1 --2- 172.21.15.49:0/80898179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11bc0bc580 0x7f11bc159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.677+0000 7f11c1c00700 1 -- 172.21.15.49:0/80898179 >> 172.21.15.49:0/80898179 conn(0x7f11bc066830 msgr2=0x7f11bc0bdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:57.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.677+0000 7f11c1c00700 1 -- 172.21.15.49:0/80898179 shutdown_connections 2024-01-22T05:04:57.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.677+0000 7f11c1c00700 1 -- 172.21.15.49:0/80898179 wait complete. 2024-01-22T05:04:57.686 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:04:57.704 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-01-22T05:04:57.230495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378912,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595808,"statfs":{"total":773094113280,"available":770658107392,"internally_reserved":0,"allocated":2195456,"data_stored":896466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2179,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004549"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082694+0000","last_change":"2024-01-22T05:04:35.050369+0000","last_active":"2024-01-22T05:04:39.082694+0000","last_peered":"2024-01-22T05:04:39.082694+0000","last_clean":"2024-01-22T05:04:39.082694+0000","last_became_active":"2024-01-22T05:04:35.050006+0000","last_became_peered":"2024-01-22T05:04:35.050006+0000","last_unstale":"2024-01-22T05:04:39.082694+0000","last_undegraded":"2024-01-22T05:04:39.082694+0000","last_fullsized":"2024-01-22T05:04:39.082694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101110+0000","last_change":"2024-01-22T05:04:34.615730+0000","last_active":"2024-01-22T05:04:39.101110+0000","last_peered":"2024-01-22T05:04:39.101110+0000","last_clean":"2024-01-22T05:04:39.101110+0000","last_became_active":"2024-01-22T05:04:34.615423+0000","last_became_peered":"2024-01-22T05:04:34.615423+0000","last_unstale":"2024-01-22T05:04:39.101110+0000","last_undegraded":"2024-01-22T05:04:39.101110+0000","last_fullsized":"2024-01-22T05:04:39.101110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091379+0000","last_change":"2024-01-22T05:04:35.061052+0000","last_active":"2024-01-22T05:04:39.091379+0000","last_peered":"2024-01-22T05:04:39.091379+0000","last_clean":"2024-01-22T05:04:39.091379+0000","last_became_active":"2024-01-22T05:04:35.060391+0000","last_became_peered":"2024-01-22T05:04:35.060391+0000","last_unstale":"2024-01-22T05:04:39.091379+0000","last_undegraded":"2024-01-22T05:04:39.091379+0000","last_fullsized":"2024-01-22T05:04:39.091379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079454+0000","last_change":"2024-01-22T05:04:34.625335+0000","last_active":"2024-01-22T05:04:39.079454+0000","last_peered":"2024-01-22T05:04:39.079454+0000","last_clean":"2024-01-22T05:04:39.079454+0000","last_became_active":"2024-01-22T05:04:34.625033+0000","last_became_peered":"2024-01-22T05:04:34.625033+0000","last_unstale":"2024-01-22T05:04:39.079454+0000","last_undegraded":"2024-01-22T05:04:39.079454+0000","last_fullsized":"2024-01-22T05:04:39.079454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.083181+0000","last_change":"2024-01-22T05:04:34.613206+0000","last_active":"2024-01-22T05:04:39.083181+0000","last_peered":"2024-01-22T05:04:39.083181+0000","last_clean":"2024-01-22T05:04:39.083181+0000","last_became_active":"2024-01-22T05:04:34.612458+0000","last_became_peered":"2024-01-22T05:04:34.612458+0000","last_unstale":"2024-01-22T05:04:39.083181+0000","last_undegraded":"2024-01-22T05:04:39.083181+0000","last_fullsized":"2024-01-22T05:04:39.083181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087816+0000","last_change":"2024-01-22T05:04:35.067504+0000","last_active":"2024-01-22T05:04:39.087816+0000","last_peered":"2024-01-22T05:04:39.087816+0000","last_clean":"2024-01-22T05:04:39.087816+0000","last_became_active":"2024-01-22T05:04:35.067007+0000","last_became_peered":"2024-01-22T05:04:35.067007+0000","last_unstale":"2024-01-22T05:04:39.087816+0000","last_undegraded":"2024-01-22T05:04:39.087816+0000","last_fullsized":"2024-01-22T05:04:39.087816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.074244+0000","last_change":"2024-01-22T05:04:34.618016+0000","last_active":"2024-01-22T05:04:39.074244+0000","last_peered":"2024-01-22T05:04:39.074244+0000","last_clean":"2024-01-22T05:04:39.074244+0000","last_became_active":"2024-01-22T05:04:34.616976+0000","last_became_peered":"2024-01-22T05:04:34.616976+0000","last_unstale":"2024-01-22T05:04:39.074244+0000","last_undegraded":"2024-01-22T05:04:39.074244+0000","last_fullsized":"2024-01-22T05:04:39.074244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087750+0000","last_change":"2024-01-22T05:04:35.055742+0000","last_active":"2024-01-22T05:04:39.087750+0000","last_peered":"2024-01-22T05:04:39.087750+0000","last_clean":"2024-01-22T05:04:39.087750+0000","last_became_active":"2024-01-22T05:04:35.055484+0000","last_became_peered":"2024-01-22T05:04:35.055484+0000","last_unstale":"2024-01-22T05:04:39.087750+0000","last_undegraded":"2024-01-22T05:04:39.087750+0000","last_fullsized":"2024-01-22T05:04:39.087750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091158+0000","last_change":"2024-01-22T05:04:34.602682+0000","last_active":"2024-01-22T05:04:39.091158+0000","last_peered":"2024-01-22T05:04:39.091158+0000","last_clean":"2024-01-22T05:04:39.091158+0000","last_became_active":"2024-01-22T05:04:34.602415+0000","last_became_peered":"2024-01-22T05:04:34.602415+0000","last_unstale":"2024-01-22T05:04:39.091158+0000","last_undegraded":"2024-01-22T05:04:39.091158+0000","last_fullsized":"2024-01-22T05:04:39.091158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077259+0000","last_change":"2024-01-22T05:04:35.046243+0000","last_active":"2024-01-22T05:04:39.077259+0000","last_peered":"2024-01-22T05:04:39.077259+0000","last_clean":"2024-01-22T05:04:39.077259+0000","last_became_active":"2024-01-22T05:04:35.045968+0000","last_became_peered":"2024-01-22T05:04:35.045968+0000","last_unstale":"2024-01-22T05:04:39.077259+0000","last_undegraded":"2024-01-22T05:04:39.077259+0000","last_fullsized":"2024-01-22T05:04:39.077259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.094051+0000","last_change":"2024-01-22T05:04:34.612841+0000","last_active":"2024-01-22T05:04:39.094051+0000","last_peered":"2024-01-22T05:04:39.094051+0000","last_clean":"2024-01-22T05:04:39.094051+0000","last_became_active":"2024-01-22T05:04:34.612529+0000","last_became_peered":"2024-01-22T05:04:34.612529+0000","last_unstale":"2024-01-22T05:04:39.094051+0000","last_undegraded":"2024-01-22T05:04:39.094051+0000","last_fullsized":"2024-01-22T05:04:39.094051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090289+0000","last_change":"2024-01-22T05:04:35.067328+0000","last_active":"2024-01-22T05:04:39.090289+0000","last_peered":"2024-01-22T05:04:39.090289+0000","last_clean":"2024-01-22T05:04:39.090289+0000","last_became_active":"2024-01-22T05:04:35.066995+0000","last_became_peered":"2024-01-22T05:04:35.066995+0000","last_unstale":"2024-01-22T05:04:39.090289+0000","last_undegraded":"2024-01-22T05:04:39.090289+0000","last_fullsized":"2024-01-22T05:04:39.090289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091559+0000","last_change":"2024-01-22T05:04:34.613788+0000","last_active":"2024-01-22T05:04:39.091559+0000","last_peered":"2024-01-22T05:04:39.091559+0000","last_clean":"2024-01-22T05:04:39.091559+0000","last_became_active":"2024-01-22T05:04:34.611731+0000","last_became_peered":"2024-01-22T05:04:34.611731+0000","last_unstale":"2024-01-22T05:04:39.091559+0000","last_undegraded":"2024-01-22T05:04:39.091559+0000","last_fullsized":"2024-01-22T05:04:39.091559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072961+0000","last_change":"2024-01-22T05:04:35.053554+0000","last_active":"2024-01-22T05:04:39.072961+0000","last_peered":"2024-01-22T05:04:39.072961+0000","last_clean":"2024-01-22T05:04:39.072961+0000","last_became_active":"2024-01-22T05:04:35.052755+0000","last_became_peered":"2024-01-22T05:04:35.052755+0000","last_unstale":"2024-01-22T05:04:39.072961+0000","last_undegraded":"2024-01-22T05:04:39.072961+0000","last_fullsized":"2024-01-22T05:04:39.072961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077414+0000","last_change":"2024-01-22T05:04:34.612292+0000","last_active":"2024-01-22T05:04:39.077414+0000","last_peered":"2024-01-22T05:04:39.077414+0000","last_clean":"2024-01-22T05:04:39.077414+0000","last_became_active":"2024-01-22T05:04:34.611340+0000","last_became_peered":"2024-01-22T05:04:34.611340+0000","last_unstale":"2024-01-22T05:04:39.077414+0000","last_undegraded":"2024-01-22T05:04:39.077414+0000","last_fullsized":"2024-01-22T05:04:39.077414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073500+0000","last_change":"2024-01-22T05:04:35.047170+0000","last_active":"2024-01-22T05:04:39.073500+0000","last_peered":"2024-01-22T05:04:39.073500+0000","last_clean":"2024-01-22T05:04:39.073500+0000","last_became_active":"2024-01-22T05:04:35.046891+0000","last_became_peered":"2024-01-22T05:04:35.046891+0000","last_unstale":"2024-01-22T05:04:39.073500+0000","last_undegraded":"2024-01-22T05:04:39.073500+0000","last_fullsized":"2024-01-22T05:04:39.073500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.088007+0000","last_change":"2024-01-22T05:04:34.614155+0000","last_active":"2024-01-22T05:04:39.088007+0000","last_peered":"2024-01-22T05:04:39.088007+0000","last_clean":"2024-01-22T05:04:39.088007+0000","last_became_active":"2024-01-22T05:04:34.613838+0000","last_became_peered":"2024-01-22T05:04:34.613838+0000","last_unstale":"2024-01-22T05:04:39.088007+0000","last_undegraded":"2024-01-22T05:04:39.088007+0000","last_fullsized":"2024-01-22T05:04:39.088007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073280+0000","last_change":"2024-01-22T05:04:35.059943+0000","last_active":"2024-01-22T05:04:39.073280+0000","last_peered":"2024-01-22T05:04:39.073280+0000","last_clean":"2024-01-22T05:04:39.073280+0000","last_became_active":"2024-01-22T05:04:35.057491+0000","last_became_peered":"2024-01-22T05:04:35.057491+0000","last_unstale":"2024-01-22T05:04:39.073280+0000","last_undegraded":"2024-01-22T05:04:39.073280+0000","last_fullsized":"2024-01-22T05:04:39.073280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079555+0000","last_change":"2024-01-22T05:04:34.602873+0000","last_active":"2024-01-22T05:04:39.079555+0000","last_peered":"2024-01-22T05:04:39.079555+0000","last_clean":"2024-01-22T05:04:39.079555+0000","last_became_active":"2024-01-22T05:04:34.602401+0000","last_became_peered":"2024-01-22T05:04:34.602401+0000","last_unstale":"2024-01-22T05:04:39.079555+0000","last_undegraded":"2024-01-22T05:04:39.079555+0000","last_fullsized":"2024-01-22T05:04:39.079555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091439+0000","last_change":"2024-01-22T05:04:35.061246+0000","last_active":"2024-01-22T05:04:39.091439+0000","last_peered":"2024-01-22T05:04:39.091439+0000","last_clean":"2024-01-22T05:04:39.091439+0000","last_became_active":"2024-01-22T05:04:35.060730+0000","last_became_peered":"2024-01-22T05:04:35.060730+0000","last_unstale":"2024-01-22T05:04:39.091439+0000","last_undegraded":"2024-01-22T05:04:39.091439+0000","last_fullsized":"2024-01-22T05:04:39.091439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.085851+0000","last_change":"2024-01-22T05:04:34.619066+0000","last_active":"2024-01-22T05:04:39.085851+0000","last_peered":"2024-01-22T05:04:39.085851+0000","last_clean":"2024-01-22T05:04:39.085851+0000","last_became_active":"2024-01-22T05:04:34.618524+0000","last_became_peered":"2024-01-22T05:04:34.618524+0000","last_unstale":"2024-01-22T05:04:39.085851+0000","last_undegraded":"2024-01-22T05:04:39.085851+0000","last_fullsized":"2024-01-22T05:04:39.085851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.088848+0000","last_change":"2024-01-22T05:04:35.047351+0000","last_active":"2024-01-22T05:04:39.088848+0000","last_peered":"2024-01-22T05:04:39.088848+0000","last_clean":"2024-01-22T05:04:39.088848+0000","last_became_active":"2024-01-22T05:04:35.047047+0000","last_became_peered":"2024-01-22T05:04:35.047047+0000","last_unstale":"2024-01-22T05:04:39.088848+0000","last_undegraded":"2024-01-22T05:04:39.088848+0000","last_fullsized":"2024-01-22T05:04:39.088848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.558487+0000","last_change":"2024-01-22T05:04:34.619862+0000","last_active":"2024-01-22T05:04:39.558487+0000","last_peered":"2024-01-22T05:04:39.558487+0000","last_clean":"2024-01-22T05:04:39.558487+0000","last_became_active":"2024-01-22T05:04:34.615400+0000","last_became_peered":"2024-01-22T05:04:34.615400+0000","last_unstale":"2024-01-22T05:04:39.558487+0000","last_undegraded":"2024-01-22T05:04:39.558487+0000","last_fullsized":"2024-01-22T05:04:39.558487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087854+0000","last_change":"2024-01-22T05:04:35.062780+0000","last_active":"2024-01-22T05:04:39.087854+0000","last_peered":"2024-01-22T05:04:39.087854+0000","last_clean":"2024-01-22T05:04:39.087854+0000","last_became_active":"2024-01-22T05:04:35.062412+0000","last_became_peered":"2024-01-22T05:04:35.062412+0000","last_unstale":"2024-01-22T05:04:39.087854+0000","last_undegraded":"2024-01-22T05:04:39.087854+0000","last_fullsized":"2024-01-22T05:04:39.087854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104001+0000","last_change":"2024-01-22T05:04:34.613410+0000","last_active":"2024-01-22T05:04:39.104001+0000","last_peered":"2024-01-22T05:04:39.104001+0000","last_clean":"2024-01-22T05:04:39.104001+0000","last_became_active":"2024-01-22T05:04:34.613064+0000","last_became_peered":"2024-01-22T05:04:34.613064+0000","last_unstale":"2024-01-22T05:04:39.104001+0000","last_undegraded":"2024-01-22T05:04:39.104001+0000","last_fullsized":"2024-01-22T05:04:39.104001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071476+0000","last_change":"2024-01-22T05:04:35.057169+0000","last_active":"2024-01-22T05:04:39.071476+0000","last_peered":"2024-01-22T05:04:39.071476+0000","last_clean":"2024-01-22T05:04:39.071476+0000","last_became_active":"2024-01-22T05:04:35.052838+0000","last_became_peered":"2024-01-22T05:04:35.052838+0000","last_unstale":"2024-01-22T05:04:39.071476+0000","last_undegraded":"2024-01-22T05:04:39.071476+0000","last_fullsized":"2024-01-22T05:04:39.071476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087571+0000","last_change":"2024-01-22T05:04:34.621537+0000","last_active":"2024-01-22T05:04:39.087571+0000","last_peered":"2024-01-22T05:04:39.087571+0000","last_clean":"2024-01-22T05:04:39.087571+0000","last_became_active":"2024-01-22T05:04:34.619679+0000","last_became_peered":"2024-01-22T05:04:34.619679+0000","last_unstale":"2024-01-22T05:04:39.087571+0000","last_undegraded":"2024-01-22T05:04:39.087571+0000","last_fullsized":"2024-01-22T05:04:39.087571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082734+0000","last_change":"2024-01-22T05:04:35.058927+0000","last_active":"2024-01-22T05:04:39.082734+0000","last_peered":"2024-01-22T05:04:39.082734+0000","last_clean":"2024-01-22T05:04:39.082734+0000","last_became_active":"2024-01-22T05:04:35.058360+0000","last_became_peered":"2024-01-22T05:04:35.058360+0000","last_unstale":"2024-01-22T05:04:39.082734+0000","last_undegraded":"2024-01-22T05:04:39.082734+0000","last_fullsized":"2024-01-22T05:04:39.082734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091650+0000","last_change":"2024-01-22T05:04:34.603402+0000","last_active":"2024-01-22T05:04:39.091650+0000","last_peered":"2024-01-22T05:04:39.091650+0000","last_clean":"2024-01-22T05:04:39.091650+0000","last_became_active":"2024-01-22T05:04:34.601578+0000","last_became_peered":"2024-01-22T05:04:34.601578+0000","last_unstale":"2024-01-22T05:04:39.091650+0000","last_undegraded":"2024-01-22T05:04:39.091650+0000","last_fullsized":"2024-01-22T05:04:39.091650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104259+0000","last_change":"2024-01-22T05:04:35.069261+0000","last_active":"2024-01-22T05:04:39.104259+0000","last_peered":"2024-01-22T05:04:39.104259+0000","last_clean":"2024-01-22T05:04:39.104259+0000","last_became_active":"2024-01-22T05:04:35.068641+0000","last_became_peered":"2024-01-22T05:04:35.068641+0000","last_unstale":"2024-01-22T05:04:39.104259+0000","last_undegraded":"2024-01-22T05:04:39.104259+0000","last_fullsized":"2024-01-22T05:04:39.104259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077499+0000","last_change":"2024-01-22T05:04:34.613087+0000","last_active":"2024-01-22T05:04:39.077499+0000","last_peered":"2024-01-22T05:04:39.077499+0000","last_clean":"2024-01-22T05:04:39.077499+0000","last_became_active":"2024-01-22T05:04:34.612162+0000","last_became_peered":"2024-01-22T05:04:34.612162+0000","last_unstale":"2024-01-22T05:04:39.077499+0000","last_undegraded":"2024-01-22T05:04:39.077499+0000","last_fullsized":"2024-01-22T05:04:39.077499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082087+0000","last_change":"2024-01-22T05:04:35.064923+0000","last_active":"2024-01-22T05:04:39.082087+0000","last_peered":"2024-01-22T05:04:39.082087+0000","last_clean":"2024-01-22T05:04:39.082087+0000","last_became_active":"2024-01-22T05:04:35.064659+0000","last_became_peered":"2024-01-22T05:04:35.064659+0000","last_unstale":"2024-01-22T05:04:39.082087+0000","last_undegraded":"2024-01-22T05:04:39.082087+0000","last_fullsized":"2024-01-22T05:04:39.082087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.069357+0000","last_change":"2024-01-22T05:04:34.613407+0000","last_active":"2024-01-22T05:04:39.069357+0000","last_peered":"2024-01-22T05:04:39.069357+0000","last_clean":"2024-01-22T05:04:39.069357+0000","last_became_active":"2024-01-22T05:04:34.613071+0000","last_became_peered":"2024-01-22T05:04:34.613071+0000","last_unstale":"2024-01-22T05:04:39.069357+0000","last_undegraded":"2024-01-22T05:04:39.069357+0000","last_fullsized":"2024-01-22T05:04:39.069357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.106863+0000","last_change":"2024-01-22T05:04:35.041221+0000","last_active":"2024-01-22T05:04:39.106863+0000","last_peered":"2024-01-22T05:04:39.106863+0000","last_clean":"2024-01-22T05:04:39.106863+0000","last_became_active":"2024-01-22T05:04:35.040768+0000","last_became_peered":"2024-01-22T05:04:35.040768+0000","last_unstale":"2024-01-22T05:04:39.106863+0000","last_undegraded":"2024-01-22T05:04:39.106863+0000","last_fullsized":"2024-01-22T05:04:39.106863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.088940+0000","last_change":"2024-01-22T05:04:34.620016+0000","last_active":"2024-01-22T05:04:39.088940+0000","last_peered":"2024-01-22T05:04:39.088940+0000","last_clean":"2024-01-22T05:04:39.088940+0000","last_became_active":"2024-01-22T05:04:34.617253+0000","last_became_peered":"2024-01-22T05:04:34.617253+0000","last_unstale":"2024-01-22T05:04:39.088940+0000","last_undegraded":"2024-01-22T05:04:39.088940+0000","last_fullsized":"2024-01-22T05:04:39.088940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.116642+0000","last_change":"2024-01-22T05:04:35.046592+0000","last_active":"2024-01-22T05:04:39.116642+0000","last_peered":"2024-01-22T05:04:39.116642+0000","last_clean":"2024-01-22T05:04:39.116642+0000","last_became_active":"2024-01-22T05:04:35.046327+0000","last_became_peered":"2024-01-22T05:04:35.046327+0000","last_unstale":"2024-01-22T05:04:39.116642+0000","last_undegraded":"2024-01-22T05:04:39.116642+0000","last_fullsized":"2024-01-22T05:04:39.116642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.120146+0000","last_change":"2024-01-22T05:04:39.111440+0000","last_active":"2024-01-22T05:04:39.120146+0000","last_peered":"2024-01-22T05:04:39.120146+0000","last_clean":"2024-01-22T05:04:39.120146+0000","last_became_active":"2024-01-22T05:04:39.111025+0000","last_became_peered":"2024-01-22T05:04:39.111025+0000","last_unstale":"2024-01-22T05:04:39.120146+0000","last_undegraded":"2024-01-22T05:04:39.120146+0000","last_fullsized":"2024-01-22T05:04:39.120146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091490+0000","last_change":"2024-01-22T05:04:34.605684+0000","last_active":"2024-01-22T05:04:39.091490+0000","last_peered":"2024-01-22T05:04:39.091490+0000","last_clean":"2024-01-22T05:04:39.091490+0000","last_became_active":"2024-01-22T05:04:34.605346+0000","last_became_peered":"2024-01-22T05:04:34.605346+0000","last_unstale":"2024-01-22T05:04:39.091490+0000","last_undegraded":"2024-01-22T05:04:39.091490+0000","last_fullsized":"2024-01-22T05:04:39.091490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071714+0000","last_change":"2024-01-22T05:04:35.053273+0000","last_active":"2024-01-22T05:04:39.071714+0000","last_peered":"2024-01-22T05:04:39.071714+0000","last_clean":"2024-01-22T05:04:39.071714+0000","last_became_active":"2024-01-22T05:04:35.052833+0000","last_became_peered":"2024-01-22T05:04:35.052833+0000","last_unstale":"2024-01-22T05:04:39.071714+0000","last_undegraded":"2024-01-22T05:04:39.071714+0000","last_fullsized":"2024-01-22T05:04:39.071714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103041+0000","last_change":"2024-01-22T05:04:39.099537+0000","last_active":"2024-01-22T05:04:39.103041+0000","last_peered":"2024-01-22T05:04:39.103041+0000","last_clean":"2024-01-22T05:04:39.103041+0000","last_became_active":"2024-01-22T05:04:39.099039+0000","last_became_peered":"2024-01-22T05:04:39.099039+0000","last_unstale":"2024-01-22T05:04:39.103041+0000","last_undegraded":"2024-01-22T05:04:39.103041+0000","last_fullsized":"2024-01-22T05:04:39.103041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.083714+0000","last_change":"2024-01-22T05:04:34.622996+0000","last_active":"2024-01-22T05:04:39.083714+0000","last_peered":"2024-01-22T05:04:39.083714+0000","last_clean":"2024-01-22T05:04:39.083714+0000","last_became_active":"2024-01-22T05:04:34.622644+0000","last_became_peered":"2024-01-22T05:04:34.622644+0000","last_unstale":"2024-01-22T05:04:39.083714+0000","last_undegraded":"2024-01-22T05:04:39.083714+0000","last_fullsized":"2024-01-22T05:04:39.083714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087958+0000","last_change":"2024-01-22T05:04:35.054335+0000","last_active":"2024-01-22T05:04:39.087958+0000","last_peered":"2024-01-22T05:04:39.087958+0000","last_clean":"2024-01-22T05:04:39.087958+0000","last_became_active":"2024-01-22T05:04:35.049434+0000","last_became_peered":"2024-01-22T05:04:35.049434+0000","last_unstale":"2024-01-22T05:04:39.087958+0000","last_undegraded":"2024-01-22T05:04:39.087958+0000","last_fullsized":"2024-01-22T05:04:39.087958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.108343+0000","last_change":"2024-01-22T05:04:39.099472+0000","last_active":"2024-01-22T05:04:39.108343+0000","last_peered":"2024-01-22T05:04:39.108343+0000","last_clean":"2024-01-22T05:04:39.108343+0000","last_became_active":"2024-01-22T05:04:39.099032+0000","last_became_peered":"2024-01-22T05:04:39.099032+0000","last_unstale":"2024-01-22T05:04:39.108343+0000","last_undegraded":"2024-01-22T05:04:39.108343+0000","last_fullsized":"2024-01-22T05:04:39.108343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082319+0000","last_change":"2024-01-22T05:04:34.601591+0000","last_active":"2024-01-22T05:04:39.082319+0000","last_peered":"2024-01-22T05:04:39.082319+0000","last_clean":"2024-01-22T05:04:39.082319+0000","last_became_active":"2024-01-22T05:04:34.601315+0000","last_became_peered":"2024-01-22T05:04:34.601315+0000","last_unstale":"2024-01-22T05:04:39.082319+0000","last_undegraded":"2024-01-22T05:04:39.082319+0000","last_fullsized":"2024-01-22T05:04:39.082319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071207+0000","last_change":"2024-01-22T05:04:35.061009+0000","last_active":"2024-01-22T05:04:39.071207+0000","last_peered":"2024-01-22T05:04:39.071207+0000","last_clean":"2024-01-22T05:04:39.071207+0000","last_became_active":"2024-01-22T05:04:35.060328+0000","last_became_peered":"2024-01-22T05:04:35.060328+0000","last_unstale":"2024-01-22T05:04:39.071207+0000","last_undegraded":"2024-01-22T05:04:39.071207+0000","last_fullsized":"2024-01-22T05:04:39.071207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.116310+0000","last_change":"2024-01-22T05:04:39.114183+0000","last_active":"2024-01-22T05:04:39.116310+0000","last_peered":"2024-01-22T05:04:39.116310+0000","last_clean":"2024-01-22T05:04:39.116310+0000","last_became_active":"2024-01-22T05:04:39.113514+0000","last_became_peered":"2024-01-22T05:04:39.113514+0000","last_unstale":"2024-01-22T05:04:39.116310+0000","last_undegraded":"2024-01-22T05:04:39.116310+0000","last_fullsized":"2024-01-22T05:04:39.116310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.080489+0000","last_change":"2024-01-22T05:04:34.599714+0000","last_active":"2024-01-22T05:04:39.080489+0000","last_peered":"2024-01-22T05:04:39.080489+0000","last_clean":"2024-01-22T05:04:39.080489+0000","last_became_active":"2024-01-22T05:04:34.599372+0000","last_became_peered":"2024-01-22T05:04:34.599372+0000","last_unstale":"2024-01-22T05:04:39.080489+0000","last_undegraded":"2024-01-22T05:04:39.080489+0000","last_fullsized":"2024-01-22T05:04:39.080489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071613+0000","last_change":"2024-01-22T05:04:35.063064+0000","last_active":"2024-01-22T05:04:39.071613+0000","last_peered":"2024-01-22T05:04:39.071613+0000","last_clean":"2024-01-22T05:04:39.071613+0000","last_became_active":"2024-01-22T05:04:35.060532+0000","last_became_peered":"2024-01-22T05:04:35.060532+0000","last_unstale":"2024-01-22T05:04:39.071613+0000","last_undegraded":"2024-01-22T05:04:39.071613+0000","last_fullsized":"2024-01-22T05:04:39.071613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.120120+0000","last_change":"2024-01-22T05:04:39.112845+0000","last_active":"2024-01-22T05:04:39.120120+0000","last_peered":"2024-01-22T05:04:39.120120+0000","last_clean":"2024-01-22T05:04:39.120120+0000","last_became_active":"2024-01-22T05:04:39.107762+0000","last_became_peered":"2024-01-22T05:04:39.107762+0000","last_unstale":"2024-01-22T05:04:39.120120+0000","last_undegraded":"2024-01-22T05:04:39.120120+0000","last_fullsized":"2024-01-22T05:04:39.120120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091889+0000","last_change":"2024-01-22T05:04:34.615318+0000","last_active":"2024-01-22T05:04:39.091889+0000","last_peered":"2024-01-22T05:04:39.091889+0000","last_clean":"2024-01-22T05:04:39.091889+0000","last_became_active":"2024-01-22T05:04:34.609702+0000","last_became_peered":"2024-01-22T05:04:34.609702+0000","last_unstale":"2024-01-22T05:04:39.091889+0000","last_undegraded":"2024-01-22T05:04:39.091889+0000","last_fullsized":"2024-01-22T05:04:39.091889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070678+0000","last_change":"2024-01-22T05:04:35.042388+0000","last_active":"2024-01-22T05:04:39.070678+0000","last_peered":"2024-01-22T05:04:39.070678+0000","last_clean":"2024-01-22T05:04:39.070678+0000","last_became_active":"2024-01-22T05:04:35.041995+0000","last_became_peered":"2024-01-22T05:04:35.041995+0000","last_unstale":"2024-01-22T05:04:39.070678+0000","last_undegraded":"2024-01-22T05:04:39.070678+0000","last_fullsized":"2024-01-22T05:04:39.070678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.095146+0000","last_change":"2024-01-22T05:04:39.091003+0000","last_active":"2024-01-22T05:04:39.095146+0000","last_peered":"2024-01-22T05:04:39.095146+0000","last_clean":"2024-01-22T05:04:39.095146+0000","last_became_active":"2024-01-22T05:04:39.090439+0000","last_became_peered":"2024-01-22T05:04:39.090439+0000","last_unstale":"2024-01-22T05:04:39.095146+0000","last_undegraded":"2024-01-22T05:04:39.095146+0000","last_fullsized":"2024-01-22T05:04:39.095146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071709+0000","last_change":"2024-01-22T05:04:34.618944+0000","last_active":"2024-01-22T05:04:39.071709+0000","last_peered":"2024-01-22T05:04:39.071709+0000","last_clean":"2024-01-22T05:04:39.071709+0000","last_became_active":"2024-01-22T05:04:34.618671+0000","last_became_peered":"2024-01-22T05:04:34.618671+0000","last_unstale":"2024-01-22T05:04:39.071709+0000","last_undegraded":"2024-01-22T05:04:39.071709+0000","last_fullsized":"2024-01-22T05:04:39.071709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.084520+0000","last_change":"2024-01-22T05:04:35.057293+0000","last_active":"2024-01-22T05:04:39.084520+0000","last_peered":"2024-01-22T05:04:39.084520+0000","last_clean":"2024-01-22T05:04:39.084520+0000","last_became_active":"2024-01-22T05:04:35.054936+0000","last_became_peered":"2024-01-22T05:04:35.054936+0000","last_unstale":"2024-01-22T05:04:39.084520+0000","last_undegraded":"2024-01-22T05:04:39.084520+0000","last_fullsized":"2024-01-22T05:04:39.084520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.098476+0000","last_change":"2024-01-22T05:04:39.096209+0000","last_active":"2024-01-22T05:04:39.098476+0000","last_peered":"2024-01-22T05:04:39.098476+0000","last_clean":"2024-01-22T05:04:39.098476+0000","last_became_active":"2024-01-22T05:04:39.095774+0000","last_became_peered":"2024-01-22T05:04:39.095774+0000","last_unstale":"2024-01-22T05:04:39.098476+0000","last_undegraded":"2024-01-22T05:04:39.098476+0000","last_fullsized":"2024-01-22T05:04:39.098476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101268+0000","last_change":"2024-01-22T05:04:34.618376+0000","last_active":"2024-01-22T05:04:39.101268+0000","last_peered":"2024-01-22T05:04:39.101268+0000","last_clean":"2024-01-22T05:04:39.101268+0000","last_became_active":"2024-01-22T05:04:34.618050+0000","last_became_peered":"2024-01-22T05:04:34.618050+0000","last_unstale":"2024-01-22T05:04:39.101268+0000","last_undegraded":"2024-01-22T05:04:39.101268+0000","last_fullsized":"2024-01-22T05:04:39.101268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092655+0000","last_change":"2024-01-22T05:04:35.066609+0000","last_active":"2024-01-22T05:04:39.092655+0000","last_peered":"2024-01-22T05:04:39.092655+0000","last_clean":"2024-01-22T05:04:39.092655+0000","last_became_active":"2024-01-22T05:04:35.066264+0000","last_became_peered":"2024-01-22T05:04:35.066264+0000","last_unstale":"2024-01-22T05:04:39.092655+0000","last_undegraded":"2024-01-22T05:04:39.092655+0000","last_fullsized":"2024-01-22T05:04:39.092655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107734+0000","last_change":"2024-01-22T05:04:39.101032+0000","last_active":"2024-01-22T05:04:39.107734+0000","last_peered":"2024-01-22T05:04:39.107734+0000","last_clean":"2024-01-22T05:04:39.107734+0000","last_became_active":"2024-01-22T05:04:39.100632+0000","last_became_peered":"2024-01-22T05:04:39.100632+0000","last_unstale":"2024-01-22T05:04:39.107734+0000","last_undegraded":"2024-01-22T05:04:39.107734+0000","last_fullsized":"2024-01-22T05:04:39.107734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078768+0000","last_change":"2024-01-22T05:04:34.600852+0000","last_active":"2024-01-22T05:04:39.078768+0000","last_peered":"2024-01-22T05:04:39.078768+0000","last_clean":"2024-01-22T05:04:39.078768+0000","last_became_active":"2024-01-22T05:04:34.600549+0000","last_became_peered":"2024-01-22T05:04:34.600549+0000","last_unstale":"2024-01-22T05:04:39.078768+0000","last_undegraded":"2024-01-22T05:04:39.078768+0000","last_fullsized":"2024-01-22T05:04:39.078768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.094690+0000","last_change":"2024-01-22T05:04:35.048337+0000","last_active":"2024-01-22T05:04:39.094690+0000","last_peered":"2024-01-22T05:04:39.094690+0000","last_clean":"2024-01-22T05:04:39.094690+0000","last_became_active":"2024-01-22T05:04:35.048075+0000","last_became_peered":"2024-01-22T05:04:35.048075+0000","last_unstale":"2024-01-22T05:04:39.094690+0000","last_undegraded":"2024-01-22T05:04:39.094690+0000","last_fullsized":"2024-01-22T05:04:39.094690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.100793+0000","last_change":"2024-01-22T05:04:39.099916+0000","last_active":"2024-01-22T05:04:39.100793+0000","last_peered":"2024-01-22T05:04:39.100793+0000","last_clean":"2024-01-22T05:04:39.100793+0000","last_became_active":"2024-01-22T05:04:39.097629+0000","last_became_peered":"2024-01-22T05:04:39.097629+0000","last_unstale":"2024-01-22T05:04:39.100793+0000","last_undegraded":"2024-01-22T05:04:39.100793+0000","last_fullsized":"2024-01-22T05:04:39.100793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091544+0000","last_change":"2024-01-22T05:04:34.605586+0000","last_active":"2024-01-22T05:04:39.091544+0000","last_peered":"2024-01-22T05:04:39.091544+0000","last_clean":"2024-01-22T05:04:39.091544+0000","last_became_active":"2024-01-22T05:04:34.605258+0000","last_became_peered":"2024-01-22T05:04:34.605258+0000","last_unstale":"2024-01-22T05:04:39.091544+0000","last_undegraded":"2024-01-22T05:04:39.091544+0000","last_fullsized":"2024-01-22T05:04:39.091544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078565+0000","last_change":"2024-01-22T05:04:35.063054+0000","last_active":"2024-01-22T05:04:39.078565+0000","last_peered":"2024-01-22T05:04:39.078565+0000","last_clean":"2024-01-22T05:04:39.078565+0000","last_became_active":"2024-01-22T05:04:35.062800+0000","last_became_peered":"2024-01-22T05:04:35.062800+0000","last_unstale":"2024-01-22T05:04:39.078565+0000","last_undegraded":"2024-01-22T05:04:39.078565+0000","last_fullsized":"2024-01-22T05:04:39.078565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.108862+0000","last_change":"2024-01-22T05:04:39.106490+0000","last_active":"2024-01-22T05:04:39.108862+0000","last_peered":"2024-01-22T05:04:39.108862+0000","last_clean":"2024-01-22T05:04:39.108862+0000","last_became_active":"2024-01-22T05:04:39.106108+0000","last_became_peered":"2024-01-22T05:04:39.106108+0000","last_unstale":"2024-01-22T05:04:39.108862+0000","last_undegraded":"2024-01-22T05:04:39.108862+0000","last_fullsized":"2024-01-22T05:04:39.108862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082736+0000","last_change":"2024-01-22T05:04:34.611849+0000","last_active":"2024-01-22T05:04:39.082736+0000","last_peered":"2024-01-22T05:04:39.082736+0000","last_clean":"2024-01-22T05:04:39.082736+0000","last_became_active":"2024-01-22T05:04:34.611571+0000","last_became_peered":"2024-01-22T05:04:34.611571+0000","last_unstale":"2024-01-22T05:04:39.082736+0000","last_undegraded":"2024-01-22T05:04:39.082736+0000","last_fullsized":"2024-01-22T05:04:39.082736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087897+0000","last_change":"2024-01-22T05:04:35.059209+0000","last_active":"2024-01-22T05:04:39.087897+0000","last_peered":"2024-01-22T05:04:39.087897+0000","last_clean":"2024-01-22T05:04:39.087897+0000","last_became_active":"2024-01-22T05:04:35.058481+0000","last_became_peered":"2024-01-22T05:04:35.058481+0000","last_unstale":"2024-01-22T05:04:39.087897+0000","last_undegraded":"2024-01-22T05:04:39.087897+0000","last_fullsized":"2024-01-22T05:04:39.087897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107238+0000","last_change":"2024-01-22T05:04:39.100104+0000","last_active":"2024-01-22T05:04:39.107238+0000","last_peered":"2024-01-22T05:04:39.107238+0000","last_clean":"2024-01-22T05:04:39.107238+0000","last_became_active":"2024-01-22T05:04:39.099678+0000","last_became_peered":"2024-01-22T05:04:39.099678+0000","last_unstale":"2024-01-22T05:04:39.107238+0000","last_undegraded":"2024-01-22T05:04:39.107238+0000","last_fullsized":"2024-01-22T05:04:39.107238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091440+0000","last_change":"2024-01-22T05:04:34.605902+0000","last_active":"2024-01-22T05:04:39.091440+0000","last_peered":"2024-01-22T05:04:39.091440+0000","last_clean":"2024-01-22T05:04:39.091440+0000","last_became_active":"2024-01-22T05:04:34.605565+0000","last_became_peered":"2024-01-22T05:04:34.605565+0000","last_unstale":"2024-01-22T05:04:39.091440+0000","last_undegraded":"2024-01-22T05:04:39.091440+0000","last_fullsized":"2024-01-22T05:04:39.091440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101579+0000","last_change":"2024-01-22T05:04:35.057060+0000","last_active":"2024-01-22T05:04:39.101579+0000","last_peered":"2024-01-22T05:04:39.101579+0000","last_clean":"2024-01-22T05:04:39.101579+0000","last_became_active":"2024-01-22T05:04:35.052366+0000","last_became_peered":"2024-01-22T05:04:35.052366+0000","last_unstale":"2024-01-22T05:04:39.101579+0000","last_undegraded":"2024-01-22T05:04:39.101579+0000","last_fullsized":"2024-01-22T05:04:39.101579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119060+0000","last_change":"2024-01-22T05:04:39.112388+0000","last_active":"2024-01-22T05:04:39.119060+0000","last_peered":"2024-01-22T05:04:39.119060+0000","last_clean":"2024-01-22T05:04:39.119060+0000","last_became_active":"2024-01-22T05:04:39.112008+0000","last_became_peered":"2024-01-22T05:04:39.112008+0000","last_unstale":"2024-01-22T05:04:39.119060+0000","last_undegraded":"2024-01-22T05:04:39.119060+0000","last_fullsized":"2024-01-22T05:04:39.119060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073424+0000","last_change":"2024-01-22T05:04:34.613609+0000","last_active":"2024-01-22T05:04:39.073424+0000","last_peered":"2024-01-22T05:04:39.073424+0000","last_clean":"2024-01-22T05:04:39.073424+0000","last_became_active":"2024-01-22T05:04:34.613113+0000","last_became_peered":"2024-01-22T05:04:34.613113+0000","last_unstale":"2024-01-22T05:04:39.073424+0000","last_undegraded":"2024-01-22T05:04:39.073424+0000","last_fullsized":"2024-01-22T05:04:39.073424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071728+0000","last_change":"2024-01-22T05:04:35.055447+0000","last_active":"2024-01-22T05:04:39.071728+0000","last_peered":"2024-01-22T05:04:39.071728+0000","last_clean":"2024-01-22T05:04:39.071728+0000","last_became_active":"2024-01-22T05:04:35.047320+0000","last_became_peered":"2024-01-22T05:04:35.047320+0000","last_unstale":"2024-01-22T05:04:39.071728+0000","last_undegraded":"2024-01-22T05:04:39.071728+0000","last_fullsized":"2024-01-22T05:04:39.071728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.113249+0000","last_change":"2024-01-22T05:04:39.111233+0000","last_active":"2024-01-22T05:04:39.113249+0000","last_peered":"2024-01-22T05:04:39.113249+0000","last_clean":"2024-01-22T05:04:39.113249+0000","last_became_active":"2024-01-22T05:04:39.108755+0000","last_became_peered":"2024-01-22T05:04:39.108755+0000","last_unstale":"2024-01-22T05:04:39.113249+0000","last_undegraded":"2024-01-22T05:04:39.113249+0000","last_fullsized":"2024-01-22T05:04:39.113249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.094775+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:04:39.094775+0000","last_peered":"2024-01-22T05:04:39.094775+0000","last_clean":"2024-01-22T05:04:39.094775+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:04:39.094775+0000","last_undegraded":"2024-01-22T05:04:39.094775+0000","last_fullsized":"2024-01-22T05:04:39.094775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092517+0000","last_change":"2024-01-22T05:04:34.613912+0000","last_active":"2024-01-22T05:04:39.092517+0000","last_peered":"2024-01-22T05:04:39.092517+0000","last_clean":"2024-01-22T05:04:39.092517+0000","last_became_active":"2024-01-22T05:04:34.612145+0000","last_became_peered":"2024-01-22T05:04:34.612145+0000","last_unstale":"2024-01-22T05:04:39.092517+0000","last_undegraded":"2024-01-22T05:04:39.092517+0000","last_fullsized":"2024-01-22T05:04:39.092517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072061+0000","last_change":"2024-01-22T05:04:35.056830+0000","last_active":"2024-01-22T05:04:39.072061+0000","last_peered":"2024-01-22T05:04:39.072061+0000","last_clean":"2024-01-22T05:04:39.072061+0000","last_became_active":"2024-01-22T05:04:35.054433+0000","last_became_peered":"2024-01-22T05:04:35.054433+0000","last_unstale":"2024-01-22T05:04:39.072061+0000","last_undegraded":"2024-01-22T05:04:39.072061+0000","last_fullsized":"2024-01-22T05:04:39.072061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.109522+0000","last_change":"2024-01-22T05:04:39.104407+0000","last_active":"2024-01-22T05:04:39.109522+0000","last_peered":"2024-01-22T05:04:39.109522+0000","last_clean":"2024-01-22T05:04:39.109522+0000","last_became_active":"2024-01-22T05:04:39.103894+0000","last_became_peered":"2024-01-22T05:04:39.103894+0000","last_unstale":"2024-01-22T05:04:39.109522+0000","last_undegraded":"2024-01-22T05:04:39.109522+0000","last_fullsized":"2024-01-22T05:04:39.109522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.111694+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:04:39.111694+0000","last_peered":"2024-01-22T05:04:39.111694+0000","last_clean":"2024-01-22T05:04:39.111694+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:04:39.111694+0000","last_undegraded":"2024-01-22T05:04:39.111694+0000","last_fullsized":"2024-01-22T05:04:39.111694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.086118+0000","last_change":"2024-01-22T05:04:34.607413+0000","last_active":"2024-01-22T05:04:39.086118+0000","last_peered":"2024-01-22T05:04:39.086118+0000","last_clean":"2024-01-22T05:04:39.086118+0000","last_became_active":"2024-01-22T05:04:34.606865+0000","last_became_peered":"2024-01-22T05:04:34.606865+0000","last_unstale":"2024-01-22T05:04:39.086118+0000","last_undegraded":"2024-01-22T05:04:39.086118+0000","last_fullsized":"2024-01-22T05:04:39.086118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078381+0000","last_change":"2024-01-22T05:04:35.066781+0000","last_active":"2024-01-22T05:04:39.078381+0000","last_peered":"2024-01-22T05:04:39.078381+0000","last_clean":"2024-01-22T05:04:39.078381+0000","last_became_active":"2024-01-22T05:04:35.066462+0000","last_became_peered":"2024-01-22T05:04:35.066462+0000","last_unstale":"2024-01-22T05:04:39.078381+0000","last_undegraded":"2024-01-22T05:04:39.078381+0000","last_fullsized":"2024-01-22T05:04:39.078381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103937+0000","last_change":"2024-01-22T05:04:39.101743+0000","last_active":"2024-01-22T05:04:39.103937+0000","last_peered":"2024-01-22T05:04:39.103937+0000","last_clean":"2024-01-22T05:04:39.103937+0000","last_became_active":"2024-01-22T05:04:39.100970+0000","last_became_peered":"2024-01-22T05:04:39.100970+0000","last_unstale":"2024-01-22T05:04:39.103937+0000","last_undegraded":"2024-01-22T05:04:39.103937+0000","last_fullsized":"2024-01-22T05:04:39.103937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091262+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:04:39.091262+0000","last_peered":"2024-01-22T05:04:39.091262+0000","last_clean":"2024-01-22T05:04:39.091262+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:04:39.091262+0000","last_undegraded":"2024-01-22T05:04:39.091262+0000","last_fullsized":"2024-01-22T05:04:39.091262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104174+0000","last_change":"2024-01-22T05:04:34.606188+0000","last_active":"2024-01-22T05:04:39.104174+0000","last_peered":"2024-01-22T05:04:39.104174+0000","last_clean":"2024-01-22T05:04:39.104174+0000","last_became_active":"2024-01-22T05:04:34.605902+0000","last_became_peered":"2024-01-22T05:04:34.605902+0000","last_unstale":"2024-01-22T05:04:39.104174+0000","last_undegraded":"2024-01-22T05:04:39.104174+0000","last_fullsized":"2024-01-22T05:04:39.104174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091318+0000","last_change":"2024-01-22T05:04:35.048169+0000","last_active":"2024-01-22T05:04:39.091318+0000","last_peered":"2024-01-22T05:04:39.091318+0000","last_clean":"2024-01-22T05:04:39.091318+0000","last_became_active":"2024-01-22T05:04:35.047797+0000","last_became_peered":"2024-01-22T05:04:35.047797+0000","last_unstale":"2024-01-22T05:04:39.091318+0000","last_undegraded":"2024-01-22T05:04:39.091318+0000","last_fullsized":"2024-01-22T05:04:39.091318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103229+0000","last_change":"2024-01-22T05:04:39.095494+0000","last_active":"2024-01-22T05:04:39.103229+0000","last_peered":"2024-01-22T05:04:39.103229+0000","last_clean":"2024-01-22T05:04:39.103229+0000","last_became_active":"2024-01-22T05:04:39.094639+0000","last_became_peered":"2024-01-22T05:04:39.094639+0000","last_unstale":"2024-01-22T05:04:39.103229+0000","last_undegraded":"2024-01-22T05:04:39.103229+0000","last_fullsized":"2024-01-22T05:04:39.103229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104333+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:04:39.104333+0000","last_peered":"2024-01-22T05:04:39.104333+0000","last_clean":"2024-01-22T05:04:39.104333+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:04:39.104333+0000","last_undegraded":"2024-01-22T05:04:39.104333+0000","last_fullsized":"2024-01-22T05:04:39.104333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082413+0000","last_change":"2024-01-22T05:04:34.614897+0000","last_active":"2024-01-22T05:04:39.082413+0000","last_peered":"2024-01-22T05:04:39.082413+0000","last_clean":"2024-01-22T05:04:39.082413+0000","last_became_active":"2024-01-22T05:04:34.611793+0000","last_became_peered":"2024-01-22T05:04:34.611793+0000","last_unstale":"2024-01-22T05:04:39.082413+0000","last_undegraded":"2024-01-22T05:04:39.082413+0000","last_fullsized":"2024-01-22T05:04:39.082413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101671+0000","last_change":"2024-01-22T05:04:35.037716+0000","last_active":"2024-01-22T05:04:39.101671+0000","last_peered":"2024-01-22T05:04:39.101671+0000","last_clean":"2024-01-22T05:04:39.101671+0000","last_became_active":"2024-01-22T05:04:35.037443+0000","last_became_peered":"2024-01-22T05:04:35.037443+0000","last_unstale":"2024-01-22T05:04:39.101671+0000","last_undegraded":"2024-01-22T05:04:39.101671+0000","last_fullsized":"2024-01-22T05:04:39.101671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.114339+0000","last_change":"2024-01-22T05:04:39.110687+0000","last_active":"2024-01-22T05:04:39.114339+0000","last_peered":"2024-01-22T05:04:39.114339+0000","last_clean":"2024-01-22T05:04:39.114339+0000","last_became_active":"2024-01-22T05:04:39.109377+0000","last_became_peered":"2024-01-22T05:04:39.109377+0000","last_unstale":"2024-01-22T05:04:39.114339+0000","last_undegraded":"2024-01-22T05:04:39.114339+0000","last_fullsized":"2024-01-22T05:04:39.114339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071921+0000","last_change":"2024-01-22T05:04:34.599538+0000","last_active":"2024-01-22T05:04:39.071921+0000","last_peered":"2024-01-22T05:04:39.071921+0000","last_clean":"2024-01-22T05:04:39.071921+0000","last_became_active":"2024-01-22T05:04:34.599188+0000","last_became_peered":"2024-01-22T05:04:34.599188+0000","last_unstale":"2024-01-22T05:04:39.071921+0000","last_undegraded":"2024-01-22T05:04:39.071921+0000","last_fullsized":"2024-01-22T05:04:39.071921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077580+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:04:39.077580+0000","last_peered":"2024-01-22T05:04:39.077580+0000","last_clean":"2024-01-22T05:04:39.077580+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:04:39.077580+0000","last_undegraded":"2024-01-22T05:04:39.077580+0000","last_fullsized":"2024-01-22T05:04:39.077580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104088+0000","last_change":"2024-01-22T05:04:35.038500+0000","last_active":"2024-01-22T05:04:39.104088+0000","last_peered":"2024-01-22T05:04:39.104088+0000","last_clean":"2024-01-22T05:04:39.104088+0000","last_became_active":"2024-01-22T05:04:35.038140+0000","last_became_peered":"2024-01-22T05:04:35.038140+0000","last_unstale":"2024-01-22T05:04:39.104088+0000","last_undegraded":"2024-01-22T05:04:39.104088+0000","last_fullsized":"2024-01-22T05:04:39.104088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119739+0000","last_change":"2024-01-22T05:04:39.116907+0000","last_active":"2024-01-22T05:04:39.119739+0000","last_peered":"2024-01-22T05:04:39.119739+0000","last_clean":"2024-01-22T05:04:39.119739+0000","last_became_active":"2024-01-22T05:04:39.116486+0000","last_became_peered":"2024-01-22T05:04:39.116486+0000","last_unstale":"2024-01-22T05:04:39.119739+0000","last_undegraded":"2024-01-22T05:04:39.119739+0000","last_fullsized":"2024-01-22T05:04:39.119739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101316+0000","last_change":"2024-01-22T05:04:34.615907+0000","last_active":"2024-01-22T05:04:39.101316+0000","last_peered":"2024-01-22T05:04:39.101316+0000","last_clean":"2024-01-22T05:04:39.101316+0000","last_became_active":"2024-01-22T05:04:34.615598+0000","last_became_peered":"2024-01-22T05:04:34.615598+0000","last_unstale":"2024-01-22T05:04:39.101316+0000","last_undegraded":"2024-01-22T05:04:39.101316+0000","last_fullsized":"2024-01-22T05:04:39.101316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.069623+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:04:39.069623+0000","last_peered":"2024-01-22T05:04:39.069623+0000","last_clean":"2024-01-22T05:04:39.069623+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:04:39.069623+0000","last_undegraded":"2024-01-22T05:04:39.069623+0000","last_fullsized":"2024-01-22T05:04:39.069623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.115610+0000","last_change":"2024-01-22T05:04:35.038846+0000","last_active":"2024-01-22T05:04:39.115610+0000","last_peered":"2024-01-22T05:04:39.115610+0000","last_clean":"2024-01-22T05:04:39.115610+0000","last_became_active":"2024-01-22T05:04:35.038166+0000","last_became_peered":"2024-01-22T05:04:35.038166+0000","last_unstale":"2024-01-22T05:04:39.115610+0000","last_undegraded":"2024-01-22T05:04:39.115610+0000","last_fullsized":"2024-01-22T05:04:39.115610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.117398+0000","last_change":"2024-01-22T05:04:39.115986+0000","last_active":"2024-01-22T05:04:39.117398+0000","last_peered":"2024-01-22T05:04:39.117398+0000","last_clean":"2024-01-22T05:04:39.117398+0000","last_became_active":"2024-01-22T05:04:39.115151+0000","last_became_peered":"2024-01-22T05:04:39.115151+0000","last_unstale":"2024-01-22T05:04:39.117398+0000","last_undegraded":"2024-01-22T05:04:39.117398+0000","last_fullsized":"2024-01-22T05:04:39.117398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087798+0000","last_change":"2024-01-22T05:04:34.609174+0000","last_active":"2024-01-22T05:04:39.087798+0000","last_peered":"2024-01-22T05:04:39.087798+0000","last_clean":"2024-01-22T05:04:39.087798+0000","last_became_active":"2024-01-22T05:04:34.608868+0000","last_became_peered":"2024-01-22T05:04:34.608868+0000","last_unstale":"2024-01-22T05:04:39.087798+0000","last_undegraded":"2024-01-22T05:04:39.087798+0000","last_fullsized":"2024-01-22T05:04:39.087798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087902+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:04:39.087902+0000","last_peered":"2024-01-22T05:04:39.087902+0000","last_clean":"2024-01-22T05:04:39.087902+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:04:39.087902+0000","last_undegraded":"2024-01-22T05:04:39.087902+0000","last_fullsized":"2024-01-22T05:04:39.087902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092366+0000","last_change":"2024-01-22T05:04:35.049694+0000","last_active":"2024-01-22T05:04:39.092366+0000","last_peered":"2024-01-22T05:04:39.092366+0000","last_clean":"2024-01-22T05:04:39.092366+0000","last_became_active":"2024-01-22T05:04:35.048722+0000","last_became_peered":"2024-01-22T05:04:35.048722+0000","last_unstale":"2024-01-22T05:04:39.092366+0000","last_undegraded":"2024-01-22T05:04:39.092366+0000","last_fullsized":"2024-01-22T05:04:39.092366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.106875+0000","last_change":"2024-01-22T05:04:39.103272+0000","last_active":"2024-01-22T05:04:39.106875+0000","last_peered":"2024-01-22T05:04:39.106875+0000","last_clean":"2024-01-22T05:04:39.106875+0000","last_became_active":"2024-01-22T05:04:39.102710+0000","last_became_peered":"2024-01-22T05:04:39.102710+0000","last_unstale":"2024-01-22T05:04:39.106875+0000","last_undegraded":"2024-01-22T05:04:39.106875+0000","last_fullsized":"2024-01-22T05:04:39.106875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082591+0000","last_change":"2024-01-22T05:04:34.621934+0000","last_active":"2024-01-22T05:04:39.082591+0000","last_peered":"2024-01-22T05:04:39.082591+0000","last_clean":"2024-01-22T05:04:39.082591+0000","last_became_active":"2024-01-22T05:04:34.621531+0000","last_became_peered":"2024-01-22T05:04:34.621531+0000","last_unstale":"2024-01-22T05:04:39.082591+0000","last_undegraded":"2024-01-22T05:04:39.082591+0000","last_fullsized":"2024-01-22T05:04:39.082591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.080271+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:04:39.080271+0000","last_peered":"2024-01-22T05:04:39.080271+0000","last_clean":"2024-01-22T05:04:39.080271+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:04:39.080271+0000","last_undegraded":"2024-01-22T05:04:39.080271+0000","last_fullsized":"2024-01-22T05:04:39.080271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087998+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:04:39.087998+0000","last_peered":"2024-01-22T05:04:39.087998+0000","last_clean":"2024-01-22T05:04:39.087998+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:04:39.087998+0000","last_undegraded":"2024-01-22T05:04:39.087998+0000","last_fullsized":"2024-01-22T05:04:39.087998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092360+0000","last_change":"2024-01-22T05:04:35.062222+0000","last_active":"2024-01-22T05:04:39.092360+0000","last_peered":"2024-01-22T05:04:39.092360+0000","last_clean":"2024-01-22T05:04:39.092360+0000","last_became_active":"2024-01-22T05:04:35.061909+0000","last_became_peered":"2024-01-22T05:04:35.061909+0000","last_unstale":"2024-01-22T05:04:39.092360+0000","last_undegraded":"2024-01-22T05:04:39.092360+0000","last_fullsized":"2024-01-22T05:04:39.092360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103574+0000","last_change":"2024-01-22T05:04:39.097762+0000","last_active":"2024-01-22T05:04:39.103574+0000","last_peered":"2024-01-22T05:04:39.103574+0000","last_clean":"2024-01-22T05:04:39.103574+0000","last_became_active":"2024-01-22T05:04:39.097387+0000","last_became_peered":"2024-01-22T05:04:39.097387+0000","last_unstale":"2024-01-22T05:04:39.103574+0000","last_undegraded":"2024-01-22T05:04:39.103574+0000","last_fullsized":"2024-01-22T05:04:39.103574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078865+0000","last_change":"2024-01-22T05:04:34.618785+0000","last_active":"2024-01-22T05:04:39.078865+0000","last_peered":"2024-01-22T05:04:39.078865+0000","last_clean":"2024-01-22T05:04:39.078865+0000","last_became_active":"2024-01-22T05:04:34.618434+0000","last_became_peered":"2024-01-22T05:04:34.618434+0000","last_unstale":"2024-01-22T05:04:39.078865+0000","last_undegraded":"2024-01-22T05:04:39.078865+0000","last_fullsized":"2024-01-22T05:04:39.078865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.115520+0000","last_change":"2024-01-22T05:04:35.053526+0000","last_active":"2024-01-22T05:04:39.115520+0000","last_peered":"2024-01-22T05:04:39.115520+0000","last_clean":"2024-01-22T05:04:39.115520+0000","last_became_active":"2024-01-22T05:04:35.053256+0000","last_became_peered":"2024-01-22T05:04:35.053256+0000","last_unstale":"2024-01-22T05:04:39.115520+0000","last_undegraded":"2024-01-22T05:04:39.115520+0000","last_fullsized":"2024-01-22T05:04:39.115520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087821+0000","last_change":"2024-01-22T05:04:39.085964+0000","last_active":"2024-01-22T05:04:39.087821+0000","last_peered":"2024-01-22T05:04:39.087821+0000","last_clean":"2024-01-22T05:04:39.087821+0000","last_became_active":"2024-01-22T05:04:39.085535+0000","last_became_peered":"2024-01-22T05:04:39.085535+0000","last_unstale":"2024-01-22T05:04:39.087821+0000","last_undegraded":"2024-01-22T05:04:39.087821+0000","last_fullsized":"2024-01-22T05:04:39.087821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072213+0000","last_change":"2024-01-22T05:04:34.606362+0000","last_active":"2024-01-22T05:04:39.072213+0000","last_peered":"2024-01-22T05:04:39.072213+0000","last_clean":"2024-01-22T05:04:39.072213+0000","last_became_active":"2024-01-22T05:04:34.606055+0000","last_became_peered":"2024-01-22T05:04:34.606055+0000","last_unstale":"2024-01-22T05:04:39.072213+0000","last_undegraded":"2024-01-22T05:04:39.072213+0000","last_fullsized":"2024-01-22T05:04:39.072213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073421+0000","last_change":"2024-01-22T05:04:35.058051+0000","last_active":"2024-01-22T05:04:39.073421+0000","last_peered":"2024-01-22T05:04:39.073421+0000","last_clean":"2024-01-22T05:04:39.073421+0000","last_became_active":"2024-01-22T05:04:35.057790+0000","last_became_peered":"2024-01-22T05:04:35.057790+0000","last_unstale":"2024-01-22T05:04:39.073421+0000","last_undegraded":"2024-01-22T05:04:39.073421+0000","last_fullsized":"2024-01-22T05:04:39.073421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.116871+0000","last_change":"2024-01-22T05:04:39.106800+0000","last_active":"2024-01-22T05:04:39.116871+0000","last_peered":"2024-01-22T05:04:39.116871+0000","last_clean":"2024-01-22T05:04:39.116871+0000","last_became_active":"2024-01-22T05:04:39.106323+0000","last_became_peered":"2024-01-22T05:04:39.106323+0000","last_unstale":"2024-01-22T05:04:39.116871+0000","last_undegraded":"2024-01-22T05:04:39.116871+0000","last_fullsized":"2024-01-22T05:04:39.116871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091150+0000","last_change":"2024-01-22T05:04:34.612849+0000","last_active":"2024-01-22T05:04:39.091150+0000","last_peered":"2024-01-22T05:04:39.091150+0000","last_clean":"2024-01-22T05:04:39.091150+0000","last_became_active":"2024-01-22T05:04:34.612516+0000","last_became_peered":"2024-01-22T05:04:34.612516+0000","last_unstale":"2024-01-22T05:04:39.091150+0000","last_undegraded":"2024-01-22T05:04:39.091150+0000","last_fullsized":"2024-01-22T05:04:39.091150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073015+0000","last_change":"2024-01-22T05:04:35.052723+0000","last_active":"2024-01-22T05:04:39.073015+0000","last_peered":"2024-01-22T05:04:39.073015+0000","last_clean":"2024-01-22T05:04:39.073015+0000","last_became_active":"2024-01-22T05:04:35.051494+0000","last_became_peered":"2024-01-22T05:04:35.051494+0000","last_unstale":"2024-01-22T05:04:39.073015+0000","last_undegraded":"2024-01-22T05:04:39.073015+0000","last_fullsized":"2024-01-22T05:04:39.073015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104928+0000","last_change":"2024-01-22T05:04:39.101428+0000","last_active":"2024-01-22T05:04:39.104928+0000","last_peered":"2024-01-22T05:04:39.104928+0000","last_clean":"2024-01-22T05:04:39.104928+0000","last_became_active":"2024-01-22T05:04:39.100920+0000","last_became_peered":"2024-01-22T05:04:39.100920+0000","last_unstale":"2024-01-22T05:04:39.104928+0000","last_undegraded":"2024-01-22T05:04:39.104928+0000","last_fullsized":"2024-01-22T05:04:39.104928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.083763+0000","last_change":"2024-01-22T05:04:34.602186+0000","last_active":"2024-01-22T05:04:39.083763+0000","last_peered":"2024-01-22T05:04:39.083763+0000","last_clean":"2024-01-22T05:04:39.083763+0000","last_became_active":"2024-01-22T05:04:34.601827+0000","last_became_peered":"2024-01-22T05:04:34.601827+0000","last_unstale":"2024-01-22T05:04:39.083763+0000","last_undegraded":"2024-01-22T05:04:39.083763+0000","last_fullsized":"2024-01-22T05:04:39.083763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073177+0000","last_change":"2024-01-22T05:04:35.054388+0000","last_active":"2024-01-22T05:04:39.073177+0000","last_peered":"2024-01-22T05:04:39.073177+0000","last_clean":"2024-01-22T05:04:39.073177+0000","last_became_active":"2024-01-22T05:04:35.054183+0000","last_became_peered":"2024-01-22T05:04:35.054183+0000","last_unstale":"2024-01-22T05:04:39.073177+0000","last_undegraded":"2024-01-22T05:04:39.073177+0000","last_fullsized":"2024-01-22T05:04:39.073177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107631+0000","last_change":"2024-01-22T05:04:39.102774+0000","last_active":"2024-01-22T05:04:39.107631+0000","last_peered":"2024-01-22T05:04:39.107631+0000","last_clean":"2024-01-22T05:04:39.107631+0000","last_became_active":"2024-01-22T05:04:39.102291+0000","last_became_peered":"2024-01-22T05:04:39.102291+0000","last_unstale":"2024-01-22T05:04:39.107631+0000","last_undegraded":"2024-01-22T05:04:39.107631+0000","last_fullsized":"2024-01-22T05:04:39.107631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.080482+0000","last_change":"2024-01-22T05:04:34.608068+0000","last_active":"2024-01-22T05:04:39.080482+0000","last_peered":"2024-01-22T05:04:39.080482+0000","last_clean":"2024-01-22T05:04:39.080482+0000","last_became_active":"2024-01-22T05:04:34.607482+0000","last_became_peered":"2024-01-22T05:04:34.607482+0000","last_unstale":"2024-01-22T05:04:39.080482+0000","last_undegraded":"2024-01-22T05:04:39.080482+0000","last_fullsized":"2024-01-22T05:04:39.080482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091190+0000","last_change":"2024-01-22T05:04:35.045213+0000","last_active":"2024-01-22T05:04:39.091190+0000","last_peered":"2024-01-22T05:04:39.091190+0000","last_clean":"2024-01-22T05:04:39.091190+0000","last_became_active":"2024-01-22T05:04:35.044882+0000","last_became_peered":"2024-01-22T05:04:35.044882+0000","last_unstale":"2024-01-22T05:04:39.091190+0000","last_undegraded":"2024-01-22T05:04:39.091190+0000","last_fullsized":"2024-01-22T05:04:39.091190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107871+0000","last_change":"2024-01-22T05:04:39.103229+0000","last_active":"2024-01-22T05:04:39.107871+0000","last_peered":"2024-01-22T05:04:39.107871+0000","last_clean":"2024-01-22T05:04:39.107871+0000","last_became_active":"2024-01-22T05:04:39.102798+0000","last_became_peered":"2024-01-22T05:04:39.102798+0000","last_unstale":"2024-01-22T05:04:39.107871+0000","last_undegraded":"2024-01-22T05:04:39.107871+0000","last_fullsized":"2024-01-22T05:04:39.107871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091000+0000","last_change":"2024-01-22T05:04:34.612506+0000","last_active":"2024-01-22T05:04:39.091000+0000","last_peered":"2024-01-22T05:04:39.091000+0000","last_clean":"2024-01-22T05:04:39.091000+0000","last_became_active":"2024-01-22T05:04:34.612255+0000","last_became_peered":"2024-01-22T05:04:34.612255+0000","last_unstale":"2024-01-22T05:04:39.091000+0000","last_undegraded":"2024-01-22T05:04:39.091000+0000","last_fullsized":"2024-01-22T05:04:39.091000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090985+0000","last_change":"2024-01-22T05:04:35.048108+0000","last_active":"2024-01-22T05:04:39.090985+0000","last_peered":"2024-01-22T05:04:39.090985+0000","last_clean":"2024-01-22T05:04:39.090985+0000","last_became_active":"2024-01-22T05:04:35.047784+0000","last_became_peered":"2024-01-22T05:04:35.047784+0000","last_unstale":"2024-01-22T05:04:39.090985+0000","last_undegraded":"2024-01-22T05:04:39.090985+0000","last_fullsized":"2024-01-22T05:04:39.090985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119163+0000","last_change":"2024-01-22T05:04:39.114068+0000","last_active":"2024-01-22T05:04:39.119163+0000","last_peered":"2024-01-22T05:04:39.119163+0000","last_clean":"2024-01-22T05:04:39.119163+0000","last_became_active":"2024-01-22T05:04:39.113694+0000","last_became_peered":"2024-01-22T05:04:39.113694+0000","last_unstale":"2024-01-22T05:04:39.119163+0000","last_undegraded":"2024-01-22T05:04:39.119163+0000","last_fullsized":"2024-01-22T05:04:39.119163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092578+0000","last_change":"2024-01-22T05:04:34.608169+0000","last_active":"2024-01-22T05:04:39.092578+0000","last_peered":"2024-01-22T05:04:39.092578+0000","last_clean":"2024-01-22T05:04:39.092578+0000","last_became_active":"2024-01-22T05:04:34.607884+0000","last_became_peered":"2024-01-22T05:04:34.607884+0000","last_unstale":"2024-01-22T05:04:39.092578+0000","last_undegraded":"2024-01-22T05:04:39.092578+0000","last_fullsized":"2024-01-22T05:04:39.092578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071885+0000","last_change":"2024-01-22T05:04:35.046615+0000","last_active":"2024-01-22T05:04:39.071885+0000","last_peered":"2024-01-22T05:04:39.071885+0000","last_clean":"2024-01-22T05:04:39.071885+0000","last_became_active":"2024-01-22T05:04:35.044177+0000","last_became_peered":"2024-01-22T05:04:35.044177+0000","last_unstale":"2024-01-22T05:04:39.071885+0000","last_undegraded":"2024-01-22T05:04:39.071885+0000","last_fullsized":"2024-01-22T05:04:39.071885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.108538+0000","last_change":"2024-01-22T05:04:39.106119+0000","last_active":"2024-01-22T05:04:39.108538+0000","last_peered":"2024-01-22T05:04:39.108538+0000","last_clean":"2024-01-22T05:04:39.108538+0000","last_became_active":"2024-01-22T05:04:39.105691+0000","last_became_peered":"2024-01-22T05:04:39.105691+0000","last_unstale":"2024-01-22T05:04:39.108538+0000","last_undegraded":"2024-01-22T05:04:39.108538+0000","last_fullsized":"2024-01-22T05:04:39.108538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092748+0000","last_change":"2024-01-22T05:04:34.609294+0000","last_active":"2024-01-22T05:04:39.092748+0000","last_peered":"2024-01-22T05:04:39.092748+0000","last_clean":"2024-01-22T05:04:39.092748+0000","last_became_active":"2024-01-22T05:04:34.609001+0000","last_became_peered":"2024-01-22T05:04:34.609001+0000","last_unstale":"2024-01-22T05:04:39.092748+0000","last_undegraded":"2024-01-22T05:04:39.092748+0000","last_fullsized":"2024-01-22T05:04:39.092748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079342+0000","last_change":"2024-01-22T05:04:35.063766+0000","last_active":"2024-01-22T05:04:39.079342+0000","last_peered":"2024-01-22T05:04:39.079342+0000","last_clean":"2024-01-22T05:04:39.079342+0000","last_became_active":"2024-01-22T05:04:35.063477+0000","last_became_peered":"2024-01-22T05:04:35.063477+0000","last_unstale":"2024-01-22T05:04:39.079342+0000","last_undegraded":"2024-01-22T05:04:39.079342+0000","last_fullsized":"2024-01-22T05:04:39.079342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.113628+0000","last_change":"2024-01-22T05:04:39.112131+0000","last_active":"2024-01-22T05:04:39.113628+0000","last_peered":"2024-01-22T05:04:39.113628+0000","last_clean":"2024-01-22T05:04:39.113628+0000","last_became_active":"2024-01-22T05:04:39.111715+0000","last_became_peered":"2024-01-22T05:04:39.111715+0000","last_unstale":"2024-01-22T05:04:39.113628+0000","last_undegraded":"2024-01-22T05:04:39.113628+0000","last_fullsized":"2024-01-22T05:04:39.113628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.089065+0000","last_change":"2024-01-22T05:04:34.619934+0000","last_active":"2024-01-22T05:04:39.089065+0000","last_peered":"2024-01-22T05:04:39.089065+0000","last_clean":"2024-01-22T05:04:39.089065+0000","last_became_active":"2024-01-22T05:04:34.617261+0000","last_became_peered":"2024-01-22T05:04:34.617261+0000","last_unstale":"2024-01-22T05:04:39.089065+0000","last_undegraded":"2024-01-22T05:04:39.089065+0000","last_fullsized":"2024-01-22T05:04:39.089065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.085702+0000","last_change":"2024-01-22T05:04:35.073485+0000","last_active":"2024-01-22T05:04:39.085702+0000","last_peered":"2024-01-22T05:04:39.085702+0000","last_clean":"2024-01-22T05:04:39.085702+0000","last_became_active":"2024-01-22T05:04:35.073124+0000","last_became_peered":"2024-01-22T05:04:35.073124+0000","last_unstale":"2024-01-22T05:04:39.085702+0000","last_undegraded":"2024-01-22T05:04:39.085702+0000","last_fullsized":"2024-01-22T05:04:39.085702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119896+0000","last_change":"2024-01-22T05:04:39.118034+0000","last_active":"2024-01-22T05:04:39.119896+0000","last_peered":"2024-01-22T05:04:39.119896+0000","last_clean":"2024-01-22T05:04:39.119896+0000","last_became_active":"2024-01-22T05:04:39.117544+0000","last_became_peered":"2024-01-22T05:04:39.117544+0000","last_unstale":"2024-01-22T05:04:39.119896+0000","last_undegraded":"2024-01-22T05:04:39.119896+0000","last_fullsized":"2024-01-22T05:04:39.119896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090880+0000","last_change":"2024-01-22T05:04:34.607793+0000","last_active":"2024-01-22T05:04:39.090880+0000","last_peered":"2024-01-22T05:04:39.090880+0000","last_clean":"2024-01-22T05:04:39.090880+0000","last_became_active":"2024-01-22T05:04:34.607475+0000","last_became_peered":"2024-01-22T05:04:34.607475+0000","last_unstale":"2024-01-22T05:04:39.090880+0000","last_undegraded":"2024-01-22T05:04:39.090880+0000","last_fullsized":"2024-01-22T05:04:39.090880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092444+0000","last_change":"2024-01-22T05:04:35.059510+0000","last_active":"2024-01-22T05:04:39.092444+0000","last_peered":"2024-01-22T05:04:39.092444+0000","last_clean":"2024-01-22T05:04:39.092444+0000","last_became_active":"2024-01-22T05:04:35.059143+0000","last_became_peered":"2024-01-22T05:04:35.059143+0000","last_unstale":"2024-01-22T05:04:39.092444+0000","last_undegraded":"2024-01-22T05:04:39.092444+0000","last_fullsized":"2024-01-22T05:04:39.092444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.099973+0000","last_change":"2024-01-22T05:04:39.097504+0000","last_active":"2024-01-22T05:04:39.099973+0000","last_peered":"2024-01-22T05:04:39.099973+0000","last_clean":"2024-01-22T05:04:39.099973+0000","last_became_active":"2024-01-22T05:04:39.097014+0000","last_became_peered":"2024-01-22T05:04:39.097014+0000","last_unstale":"2024-01-22T05:04:39.099973+0000","last_undegraded":"2024-01-22T05:04:39.099973+0000","last_fullsized":"2024-01-22T05:04:39.099973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077581+0000","last_change":"2024-01-22T05:04:34.611364+0000","last_active":"2024-01-22T05:04:39.077581+0000","last_peered":"2024-01-22T05:04:39.077581+0000","last_clean":"2024-01-22T05:04:39.077581+0000","last_became_active":"2024-01-22T05:04:34.610334+0000","last_became_peered":"2024-01-22T05:04:34.610334+0000","last_unstale":"2024-01-22T05:04:39.077581+0000","last_undegraded":"2024-01-22T05:04:39.077581+0000","last_fullsized":"2024-01-22T05:04:39.077581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082200+0000","last_change":"2024-01-22T05:04:35.069773+0000","last_active":"2024-01-22T05:04:39.082200+0000","last_peered":"2024-01-22T05:04:39.082200+0000","last_clean":"2024-01-22T05:04:39.082200+0000","last_became_active":"2024-01-22T05:04:35.069468+0000","last_became_peered":"2024-01-22T05:04:35.069468+0000","last_unstale":"2024-01-22T05:04:39.082200+0000","last_undegraded":"2024-01-22T05:04:39.082200+0000","last_fullsized":"2024-01-22T05:04:39.082200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.110957+0000","last_change":"2024-01-22T05:04:39.110074+0000","last_active":"2024-01-22T05:04:39.110957+0000","last_peered":"2024-01-22T05:04:39.110957+0000","last_clean":"2024-01-22T05:04:39.110957+0000","last_became_active":"2024-01-22T05:04:39.109579+0000","last_became_peered":"2024-01-22T05:04:39.109579+0000","last_unstale":"2024-01-22T05:04:39.110957+0000","last_undegraded":"2024-01-22T05:04:39.110957+0000","last_fullsized":"2024-01-22T05:04:39.110957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090495+0000","last_change":"2024-01-22T05:04:34.608932+0000","last_active":"2024-01-22T05:04:39.090495+0000","last_peered":"2024-01-22T05:04:39.090495+0000","last_clean":"2024-01-22T05:04:39.090495+0000","last_became_active":"2024-01-22T05:04:34.608567+0000","last_became_peered":"2024-01-22T05:04:34.608567+0000","last_unstale":"2024-01-22T05:04:39.090495+0000","last_undegraded":"2024-01-22T05:04:39.090495+0000","last_fullsized":"2024-01-22T05:04:39.090495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087479+0000","last_change":"2024-01-22T05:04:35.054670+0000","last_active":"2024-01-22T05:04:39.087479+0000","last_peered":"2024-01-22T05:04:39.087479+0000","last_clean":"2024-01-22T05:04:39.087479+0000","last_became_active":"2024-01-22T05:04:35.054302+0000","last_became_peered":"2024-01-22T05:04:35.054302+0000","last_unstale":"2024-01-22T05:04:39.087479+0000","last_undegraded":"2024-01-22T05:04:39.087479+0000","last_fullsized":"2024-01-22T05:04:39.087479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077441+0000","last_change":"2024-01-22T05:04:34.621810+0000","last_active":"2024-01-22T05:04:39.077441+0000","last_peered":"2024-01-22T05:04:39.077441+0000","last_clean":"2024-01-22T05:04:39.077441+0000","last_became_active":"2024-01-22T05:04:34.620591+0000","last_became_peered":"2024-01-22T05:04:34.620591+0000","last_unstale":"2024-01-22T05:04:39.077441+0000","last_undegraded":"2024-01-22T05:04:39.077441+0000","last_fullsized":"2024-01-22T05:04:39.077441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072938+0000","last_change":"2024-01-22T05:04:35.053530+0000","last_active":"2024-01-22T05:04:39.072938+0000","last_peered":"2024-01-22T05:04:39.072938+0000","last_clean":"2024-01-22T05:04:39.072938+0000","last_became_active":"2024-01-22T05:04:35.053256+0000","last_became_peered":"2024-01-22T05:04:35.053256+0000","last_unstale":"2024-01-22T05:04:39.072938+0000","last_undegraded":"2024-01-22T05:04:39.072938+0000","last_fullsized":"2024-01-22T05:04:39.072938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082902+0000","last_change":"2024-01-22T05:04:34.623001+0000","last_active":"2024-01-22T05:04:39.082902+0000","last_peered":"2024-01-22T05:04:39.082902+0000","last_clean":"2024-01-22T05:04:39.082902+0000","last_became_active":"2024-01-22T05:04:34.622591+0000","last_became_peered":"2024-01-22T05:04:34.622591+0000","last_unstale":"2024-01-22T05:04:39.082902+0000","last_undegraded":"2024-01-22T05:04:39.082902+0000","last_fullsized":"2024-01-22T05:04:39.082902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070523+0000","last_change":"2024-01-22T05:04:35.063913+0000","last_active":"2024-01-22T05:04:39.070523+0000","last_peered":"2024-01-22T05:04:39.070523+0000","last_clean":"2024-01-22T05:04:39.070523+0000","last_became_active":"2024-01-22T05:04:35.063630+0000","last_became_peered":"2024-01-22T05:04:35.063630+0000","last_unstale":"2024-01-22T05:04:39.070523+0000","last_undegraded":"2024-01-22T05:04:39.070523+0000","last_fullsized":"2024-01-22T05:04:39.070523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"25'7","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-22T05:04:46.053222+0000","last_change":"2024-01-22T05:04:34.620106+0000","last_active":"2024-01-22T05:04:46.053222+0000","last_peered":"2024-01-22T05:04:46.053222+0000","last_clean":"2024-01-22T05:04:46.053222+0000","last_became_active":"2024-01-22T05:04:34.619792+0000","last_became_peered":"2024-01-22T05:04:34.619792+0000","last_unstale":"2024-01-22T05:04:46.053222+0000","last_undegraded":"2024-01-22T05:04:46.053222+0000","last_fullsized":"2024-01-22T05:04:46.053222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3071,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070845+0000","last_change":"2024-01-22T05:04:35.057279+0000","last_active":"2024-01-22T05:04:39.070845+0000","last_peered":"2024-01-22T05:04:39.070845+0000","last_clean":"2024-01-22T05:04:39.070845+0000","last_became_active":"2024-01-22T05:04:35.056980+0000","last_became_peered":"2024-01-22T05:04:35.056980+0000","last_unstale":"2024-01-22T05:04:39.070845+0000","last_undegraded":"2024-01-22T05:04:39.070845+0000","last_fullsized":"2024-01-22T05:04:39.070845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092494+0000","last_change":"2024-01-22T05:04:34.611971+0000","last_active":"2024-01-22T05:04:39.092494+0000","last_peered":"2024-01-22T05:04:39.092494+0000","last_clean":"2024-01-22T05:04:39.092494+0000","last_became_active":"2024-01-22T05:04:34.605153+0000","last_became_peered":"2024-01-22T05:04:34.605153+0000","last_unstale":"2024-01-22T05:04:39.092494+0000","last_undegraded":"2024-01-22T05:04:39.092494+0000","last_fullsized":"2024-01-22T05:04:39.092494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077326+0000","last_change":"2024-01-22T05:04:35.037542+0000","last_active":"2024-01-22T05:04:39.077326+0000","last_peered":"2024-01-22T05:04:39.077326+0000","last_clean":"2024-01-22T05:04:39.077326+0000","last_became_active":"2024-01-22T05:04:35.037178+0000","last_became_peered":"2024-01-22T05:04:35.037178+0000","last_unstale":"2024-01-22T05:04:39.077326+0000","last_undegraded":"2024-01-22T05:04:39.077326+0000","last_fullsized":"2024-01-22T05:04:39.077326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091860+0000","last_change":"2024-01-22T05:04:34.615870+0000","last_active":"2024-01-22T05:04:39.091860+0000","last_peered":"2024-01-22T05:04:39.091860+0000","last_clean":"2024-01-22T05:04:39.091860+0000","last_became_active":"2024-01-22T05:04:34.615601+0000","last_became_peered":"2024-01-22T05:04:34.615601+0000","last_unstale":"2024-01-22T05:04:39.091860+0000","last_undegraded":"2024-01-22T05:04:39.091860+0000","last_fullsized":"2024-01-22T05:04:39.091860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090691+0000","last_change":"2024-01-22T05:04:35.070694+0000","last_active":"2024-01-22T05:04:39.090691+0000","last_peered":"2024-01-22T05:04:39.090691+0000","last_clean":"2024-01-22T05:04:39.090691+0000","last_became_active":"2024-01-22T05:04:35.070448+0000","last_became_peered":"2024-01-22T05:04:35.070448+0000","last_unstale":"2024-01-22T05:04:39.090691+0000","last_undegraded":"2024-01-22T05:04:39.090691+0000","last_fullsized":"2024-01-22T05:04:39.090691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092663+0000","last_change":"2024-01-22T05:04:34.616419+0000","last_active":"2024-01-22T05:04:39.092663+0000","last_peered":"2024-01-22T05:04:39.092663+0000","last_clean":"2024-01-22T05:04:39.092663+0000","last_became_active":"2024-01-22T05:04:34.616108+0000","last_became_peered":"2024-01-22T05:04:34.616108+0000","last_unstale":"2024-01-22T05:04:39.092663+0000","last_undegraded":"2024-01-22T05:04:39.092663+0000","last_fullsized":"2024-01-22T05:04:39.092663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071575+0000","last_change":"2024-01-22T05:04:35.058871+0000","last_active":"2024-01-22T05:04:39.071575+0000","last_peered":"2024-01-22T05:04:39.071575+0000","last_clean":"2024-01-22T05:04:39.071575+0000","last_became_active":"2024-01-22T05:04:35.058576+0000","last_became_peered":"2024-01-22T05:04:35.058576+0000","last_unstale":"2024-01-22T05:04:39.071575+0000","last_undegraded":"2024-01-22T05:04:39.071575+0000","last_fullsized":"2024-01-22T05:04:39.071575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070542+0000","last_change":"2024-01-22T05:04:35.057257+0000","last_active":"2024-01-22T05:04:39.070542+0000","last_peered":"2024-01-22T05:04:39.070542+0000","last_clean":"2024-01-22T05:04:39.070542+0000","last_became_active":"2024-01-22T05:04:35.056962+0000","last_became_peered":"2024-01-22T05:04:35.056962+0000","last_unstale":"2024-01-22T05:04:39.070542+0000","last_undegraded":"2024-01-22T05:04:39.070542+0000","last_fullsized":"2024-01-22T05:04:39.070542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078666+0000","last_change":"2024-01-22T05:04:34.604249+0000","last_active":"2024-01-22T05:04:39.078666+0000","last_peered":"2024-01-22T05:04:39.078666+0000","last_clean":"2024-01-22T05:04:39.078666+0000","last_became_active":"2024-01-22T05:04:34.603896+0000","last_became_peered":"2024-01-22T05:04:34.603896+0000","last_unstale":"2024-01-22T05:04:39.078666+0000","last_undegraded":"2024-01-22T05:04:39.078666+0000","last_fullsized":"2024-01-22T05:04:39.078666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082626+0000","last_change":"2024-01-22T05:04:35.045030+0000","last_active":"2024-01-22T05:04:39.082626+0000","last_peered":"2024-01-22T05:04:39.082626+0000","last_clean":"2024-01-22T05:04:39.082626+0000","last_became_active":"2024-01-22T05:04:35.043890+0000","last_became_peered":"2024-01-22T05:04:35.043890+0000","last_unstale":"2024-01-22T05:04:39.082626+0000","last_undegraded":"2024-01-22T05:04:39.082626+0000","last_fullsized":"2024-01-22T05:04:39.082626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090782+0000","last_change":"2024-01-22T05:04:34.625268+0000","last_active":"2024-01-22T05:04:39.090782+0000","last_peered":"2024-01-22T05:04:39.090782+0000","last_clean":"2024-01-22T05:04:39.090782+0000","last_became_active":"2024-01-22T05:04:34.624645+0000","last_became_peered":"2024-01-22T05:04:34.624645+0000","last_unstale":"2024-01-22T05:04:39.090782+0000","last_undegraded":"2024-01-22T05:04:39.090782+0000","last_fullsized":"2024-01-22T05:04:39.090782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072828+0000","last_change":"2024-01-22T05:04:35.061505+0000","last_active":"2024-01-22T05:04:39.072828+0000","last_peered":"2024-01-22T05:04:39.072828+0000","last_clean":"2024-01-22T05:04:39.072828+0000","last_became_active":"2024-01-22T05:04:35.061173+0000","last_became_peered":"2024-01-22T05:04:35.061173+0000","last_unstale":"2024-01-22T05:04:39.072828+0000","last_undegraded":"2024-01-22T05:04:39.072828+0000","last_fullsized":"2024-01-22T05:04:39.072828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077231+0000","last_change":"2024-01-22T05:04:34.612548+0000","last_active":"2024-01-22T05:04:39.077231+0000","last_peered":"2024-01-22T05:04:39.077231+0000","last_clean":"2024-01-22T05:04:39.077231+0000","last_became_active":"2024-01-22T05:04:34.612040+0000","last_became_peered":"2024-01-22T05:04:34.612040+0000","last_unstale":"2024-01-22T05:04:39.077231+0000","last_undegraded":"2024-01-22T05:04:39.077231+0000","last_fullsized":"2024-01-22T05:04:39.077231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.093708+0000","last_change":"2024-01-22T05:04:35.048950+0000","last_active":"2024-01-22T05:04:39.093708+0000","last_peered":"2024-01-22T05:04:39.093708+0000","last_clean":"2024-01-22T05:04:39.093708+0000","last_became_active":"2024-01-22T05:04:35.048676+0000","last_became_peered":"2024-01-22T05:04:35.048676+0000","last_unstale":"2024-01-22T05:04:39.093708+0000","last_undegraded":"2024-01-22T05:04:39.093708+0000","last_fullsized":"2024-01-22T05:04:39.093708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090409+0000","last_change":"2024-01-22T05:04:34.602672+0000","last_active":"2024-01-22T05:04:39.090409+0000","last_peered":"2024-01-22T05:04:39.090409+0000","last_clean":"2024-01-22T05:04:39.090409+0000","last_became_active":"2024-01-22T05:04:34.602360+0000","last_became_peered":"2024-01-22T05:04:34.602360+0000","last_unstale":"2024-01-22T05:04:39.090409+0000","last_undegraded":"2024-01-22T05:04:39.090409+0000","last_fullsized":"2024-01-22T05:04:39.090409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091801+0000","last_change":"2024-01-22T05:04:35.054902+0000","last_active":"2024-01-22T05:04:39.091801+0000","last_peered":"2024-01-22T05:04:39.091801+0000","last_clean":"2024-01-22T05:04:39.091801+0000","last_became_active":"2024-01-22T05:04:35.054584+0000","last_became_peered":"2024-01-22T05:04:35.054584+0000","last_unstale":"2024-01-22T05:04:39.091801+0000","last_undegraded":"2024-01-22T05:04:39.091801+0000","last_fullsized":"2024-01-22T05:04:39.091801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079986+0000","last_change":"2024-01-22T05:04:34.608195+0000","last_active":"2024-01-22T05:04:39.079986+0000","last_peered":"2024-01-22T05:04:39.079986+0000","last_clean":"2024-01-22T05:04:39.079986+0000","last_became_active":"2024-01-22T05:04:34.607837+0000","last_became_peered":"2024-01-22T05:04:34.607837+0000","last_unstale":"2024-01-22T05:04:39.079986+0000","last_undegraded":"2024-01-22T05:04:39.079986+0000","last_fullsized":"2024-01-22T05:04:39.079986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070953+0000","last_change":"2024-01-22T05:04:35.061215+0000","last_active":"2024-01-22T05:04:39.070953+0000","last_peered":"2024-01-22T05:04:39.070953+0000","last_clean":"2024-01-22T05:04:39.070953+0000","last_became_active":"2024-01-22T05:04:35.060725+0000","last_became_peered":"2024-01-22T05:04:35.060725+0000","last_unstale":"2024-01-22T05:04:39.070953+0000","last_undegraded":"2024-01-22T05:04:39.070953+0000","last_fullsized":"2024-01-22T05:04:39.070953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091439+0000","last_change":"2024-01-22T05:04:34.609097+0000","last_active":"2024-01-22T05:04:39.091439+0000","last_peered":"2024-01-22T05:04:39.091439+0000","last_clean":"2024-01-22T05:04:39.091439+0000","last_became_active":"2024-01-22T05:04:34.608713+0000","last_became_peered":"2024-01-22T05:04:34.608713+0000","last_unstale":"2024-01-22T05:04:39.091439+0000","last_undegraded":"2024-01-22T05:04:39.091439+0000","last_fullsized":"2024-01-22T05:04:39.091439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090630+0000","last_change":"2024-01-22T05:04:35.070206+0000","last_active":"2024-01-22T05:04:39.090630+0000","last_peered":"2024-01-22T05:04:39.090630+0000","last_clean":"2024-01-22T05:04:39.090630+0000","last_became_active":"2024-01-22T05:04:35.068703+0000","last_became_peered":"2024-01-22T05:04:35.068703+0000","last_unstale":"2024-01-22T05:04:39.090630+0000","last_undegraded":"2024-01-22T05:04:39.090630+0000","last_fullsized":"2024-01-22T05:04:39.090630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.111639+0000","last_change":"2024-01-22T05:04:34.620326+0000","last_active":"2024-01-22T05:04:39.111639+0000","last_peered":"2024-01-22T05:04:39.111639+0000","last_clean":"2024-01-22T05:04:39.111639+0000","last_became_active":"2024-01-22T05:04:34.620046+0000","last_became_peered":"2024-01-22T05:04:34.620046+0000","last_unstale":"2024-01-22T05:04:39.111639+0000","last_undegraded":"2024-01-22T05:04:39.111639+0000","last_fullsized":"2024-01-22T05:04:39.111639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079200+0000","last_change":"2024-01-22T05:04:35.054096+0000","last_active":"2024-01-22T05:04:39.079200+0000","last_peered":"2024-01-22T05:04:39.079200+0000","last_clean":"2024-01-22T05:04:39.079200+0000","last_became_active":"2024-01-22T05:04:35.053815+0000","last_became_peered":"2024-01-22T05:04:35.053815+0000","last_unstale":"2024-01-22T05:04:39.079200+0000","last_undegraded":"2024-01-22T05:04:39.079200+0000","last_fullsized":"2024-01-22T05:04:39.079200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092578+0000","last_change":"2024-01-22T05:04:34.617396+0000","last_active":"2024-01-22T05:04:39.092578+0000","last_peered":"2024-01-22T05:04:39.092578+0000","last_clean":"2024-01-22T05:04:39.092578+0000","last_became_active":"2024-01-22T05:04:34.617128+0000","last_became_peered":"2024-01-22T05:04:34.617128+0000","last_unstale":"2024-01-22T05:04:39.092578+0000","last_undegraded":"2024-01-22T05:04:39.092578+0000","last_fullsized":"2024-01-22T05:04:39.092578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297384,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074456,"statfs":{"total":96636764160,"available":96332242944,"internally_reserved":0,"allocated":294912,"data_stored":112351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297364,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074476,"statfs":{"total":96636764160,"available":96332263424,"internally_reserved":0,"allocated":274432,"data_stored":114562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297356,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074484,"statfs":{"total":96636764160,"available":96332271616,"internally_reserved":0,"allocated":266240,"data_stored":110937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4750000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4470000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7809999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297376,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074464,"statfs":{"total":96636764160,"available":96332251136,"internally_reserved":0,"allocated":286720,"data_stored":114708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297360,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074480,"statfs":{"total":96636764160,"available":96332267520,"internally_reserved":0,"allocated":270336,"data_stored":111027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7170000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5469999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297360,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074480,"statfs":{"total":96636764160,"available":96332267520,"internally_reserved":0,"allocated":270336,"data_stored":111007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297356,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074484,"statfs":{"total":96636764160,"available":96332271616,"internally_reserved":0,"allocated":266240,"data_stored":110937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297356,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074484,"statfs":{"total":96636764160,"available":96332271616,"internally_reserved":0,"allocated":266240,"data_stored":110937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.548}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:04:57.711 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:04:57.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.917+0000 7f5f6da00700 1 Processor -- start 2024-01-22T05:04:57.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.917+0000 7f5f6da00700 1 -- start start 2024-01-22T05:04:57.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f6da00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f680c3690 0x7f5f680c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f6da00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5f68155550 0x7f5f681559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f6da00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f680bdc10 con 0x7f5f68067a90 2024-01-22T05:04:57.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f6da00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f680c3f60 con 0x7f5f68155550 2024-01-22T05:04:57.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f6da00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f68155ea0 con 0x7f5f680c3690 2024-01-22T05:04:57.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f66000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5f68155550 0x7f5f681559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f66a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f680c3690 0x7f5f680c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f66a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f680c3690 0x7f5f680c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:46784/0 (socket says 172.21.15.49:46784) 2024-01-22T05:04:57.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f66a00700 1 -- 172.21.15.49:0/395826040 learned_addr learned my addr 172.21.15.49:0/395826040 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:57.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f66a00700 1 -- 172.21.15.49:0/395826040 >> v2:172.21.15.49:3300/0 conn(0x7f5f68155550 msgr2=0x7f5f681559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:57.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f66a00700 1 --2- 172.21.15.49:0/395826040 >> v2:172.21.15.49:3300/0 conn(0x7f5f68155550 0x7f5f681559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f66a00700 1 -- 172.21.15.49:0/395826040 >> v1:172.21.15.110:6789/0 conn(0x7f5f68067a90 legacy=0x7f5f68067f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f66a00700 1 -- 172.21.15.49:0/395826040 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f68068e10 con 0x7f5f680c3690 2024-01-22T05:04:57.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f66a00700 1 --2- 172.21.15.49:0/395826040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f680c3690 0x7f5f680c3a70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f5f58006fd0 tx=0x7f5f580090f0).ready entity=mon.2 client_cookie=c43e782bb19058dc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:57.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f65600700 1 -- 172.21.15.49:0/395826040 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800b580 con 0x7f5f680c3690 2024-01-22T05:04:57.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f65600700 1 -- 172.21.15.49:0/395826040 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5800b6e0 con 0x7f5f680c3690 2024-01-22T05:04:57.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.921+0000 7f5f65600700 1 -- 172.21.15.49:0/395826040 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800ba60 con 0x7f5f680c3690 2024-01-22T05:04:57.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.925+0000 7f5f6da00700 1 -- 172.21.15.49:0/395826040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f680c3690 msgr2=0x7f5f680c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.925+0000 7f5f6da00700 1 --2- 172.21.15.49:0/395826040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f680c3690 0x7f5f680c3a70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f5f58006fd0 tx=0x7f5f580090f0).stop 2024-01-22T05:04:57.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.925+0000 7f5f6da00700 1 -- 172.21.15.49:0/395826040 shutdown_connections 2024-01-22T05:04:57.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.925+0000 7f5f6da00700 1 --2- 172.21.15.49:0/395826040 >> v2:172.21.15.49:3300/0 conn(0x7f5f68155550 0x7f5f681559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.925+0000 7f5f6da00700 1 --2- 172.21.15.49:0/395826040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f680c3690 0x7f5f680c3a70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.925+0000 7f5f6da00700 1 -- 172.21.15.49:0/395826040 >> 172.21.15.49:0/395826040 conn(0x7f5f680c51c0 msgr2=0x7f5f680c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:57.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.925+0000 7f5f6da00700 1 -- 172.21.15.49:0/395826040 shutdown_connections 2024-01-22T05:04:57.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.925+0000 7f5f6da00700 1 -- 172.21.15.49:0/395826040 wait complete. 2024-01-22T05:04:57.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.929+0000 7f5f6da00700 1 Processor -- start 2024-01-22T05:04:57.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.929+0000 7f5f6da00700 1 -- start start 2024-01-22T05:04:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.929+0000 7f5f6da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f68067a90 0x7f5f680ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.929+0000 7f5f6da00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f680c3690 0x7f5f6814ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.929+0000 7f5f6da00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f68155550 0x7f5f68063ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.929+0000 7f5f6da00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680ae310 con 0x7f5f68067a90 2024-01-22T05:04:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.929+0000 7f5f6da00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6814b100 con 0x7f5f680c3690 2024-01-22T05:04:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.929+0000 7f5f6da00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680ad700 con 0x7f5f68155550 2024-01-22T05:04:57.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.929+0000 7f5f66a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f68067a90 0x7f5f680ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.929+0000 7f5f66a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f68067a90 0x7f5f680ad070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36348/0 (socket says 172.21.15.49:36348) 2024-01-22T05:04:57.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.929+0000 7f5f66a00700 1 -- 172.21.15.49:0/2000017867 learned_addr learned my addr 172.21.15.49:0/2000017867 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:57.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.933+0000 7f5f66000700 1 --2- 172.21.15.49:0/2000017867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f680c3690 0x7f5f6814ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.933+0000 7f5f67400700 1 --2- 172.21.15.49:0/2000017867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f68155550 0x7f5f68063ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.933+0000 7f5f66a00700 1 -- 172.21.15.49:0/2000017867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f68155550 msgr2=0x7f5f68063ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.933+0000 7f5f66a00700 1 --2- 172.21.15.49:0/2000017867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f68155550 0x7f5f68063ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.933+0000 7f5f66a00700 1 -- 172.21.15.49:0/2000017867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f680c3690 msgr2=0x7f5f6814ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:57.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.933+0000 7f5f66a00700 1 --2- 172.21.15.49:0/2000017867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f680c3690 0x7f5f6814ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:57.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.933+0000 7f5f66a00700 1 -- 172.21.15.49:0/2000017867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58009370 con 0x7f5f68067a90 2024-01-22T05:04:57.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.933+0000 7f5f66a00700 1 --2- 172.21.15.49:0/2000017867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f68067a90 0x7f5f680ad070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f5f58009fd0 tx=0x7f5f58017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:57.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.933+0000 7f5f5e000700 1 -- 172.21.15.49:0/2000017867 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58000bc0 con 0x7f5f68067a90 2024-01-22T05:04:57.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.933+0000 7f5f5e000700 1 -- 172.21.15.49:0/2000017867 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5800b850 con 0x7f5f68067a90 2024-01-22T05:04:57.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.933+0000 7f5f5e000700 1 -- 172.21.15.49:0/2000017867 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58000d20 con 0x7f5f68067a90 2024-01-22T05:04:57.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.933+0000 7f5f6da00700 1 -- 172.21.15.49:0/2000017867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f680ad9e0 con 0x7f5f68067a90 2024-01-22T05:04:57.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.933+0000 7f5f6da00700 1 -- 172.21.15.49:0/2000017867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f680adfa0 con 0x7f5f68067a90 2024-01-22T05:04:57.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.937+0000 7f5f6da00700 1 -- 172.21.15.49:0/2000017867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f68047060 con 0x7f5f68067a90 2024-01-22T05:04:57.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.937+0000 7f5f5e000700 1 -- 172.21.15.49:0/2000017867 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5f5801c8c0 con 0x7f5f68067a90 2024-01-22T05:04:57.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.937+0000 7f5f5e000700 1 --2- 172.21.15.49:0/2000017867 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f4005a510 0x7f5f4005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:57.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.937+0000 7f5f5e000700 1 -- 172.21.15.49:0/2000017867 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f5f58076990 con 0x7f5f68067a90 2024-01-22T05:04:57.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.937+0000 7f5f66000700 1 --2- 172.21.15.49:0/2000017867 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f4005a510 0x7f5f4005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:57.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.941+0000 7f5f66000700 1 --2- 172.21.15.49:0/2000017867 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f4005a510 0x7f5f4005c9d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5f68163920 tx=0x7f5f5000f040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:57.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:57.941+0000 7f5f5e000700 1 -- 172.21.15.49:0/2000017867 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5f58049da0 con 0x7f5f68067a90 2024-01-22T05:04:58.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.101+0000 7f5f6da00700 1 -- 172.21.15.49:0/2000017867 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f680ae450 con 0x7f5f4005a510 2024-01-22T05:04:58.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.121+0000 7f5f5e000700 1 -- 172.21.15.49:0/2000017867 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+410511 (secure 0 0 0) 0x7f5f50013040 con 0x7f5f4005a510 2024-01-22T05:04:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.125+0000 7f5f6da00700 1 -- 172.21.15.49:0/2000017867 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f4005a510 msgr2=0x7f5f4005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.125+0000 7f5f6da00700 1 --2- 172.21.15.49:0/2000017867 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f4005a510 0x7f5f4005c9d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5f68163920 tx=0x7f5f5000f040).stop 2024-01-22T05:04:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.125+0000 7f5f6da00700 1 -- 172.21.15.49:0/2000017867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f68067a90 msgr2=0x7f5f680ad070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.125+0000 7f5f6da00700 1 --2- 172.21.15.49:0/2000017867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f68067a90 0x7f5f680ad070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f5f58009fd0 tx=0x7f5f58017000).stop 2024-01-22T05:04:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.129+0000 7f5f6da00700 1 -- 172.21.15.49:0/2000017867 shutdown_connections 2024-01-22T05:04:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.129+0000 7f5f6da00700 1 --2- 172.21.15.49:0/2000017867 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f4005a510 0x7f5f4005c9d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.129+0000 7f5f6da00700 1 --2- 172.21.15.49:0/2000017867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f68155550 0x7f5f68063ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.129+0000 7f5f6da00700 1 --2- 172.21.15.49:0/2000017867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f680c3690 0x7f5f6814ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.129+0000 7f5f6da00700 1 --2- 172.21.15.49:0/2000017867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f68067a90 0x7f5f680ad070 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.129+0000 7f5f6da00700 1 -- 172.21.15.49:0/2000017867 >> 172.21.15.49:0/2000017867 conn(0x7f5f680c51c0 msgr2=0x7f5f680a8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.129+0000 7f5f6da00700 1 -- 172.21.15.49:0/2000017867 shutdown_connections 2024-01-22T05:04:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.129+0000 7f5f6da00700 1 -- 172.21.15.49:0/2000017867 wait complete. 2024-01-22T05:04:58.134 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:04:58.153 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-01-22T05:04:57.230495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378912,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595808,"statfs":{"total":773094113280,"available":770658107392,"internally_reserved":0,"allocated":2195456,"data_stored":896466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2179,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004549"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082694+0000","last_change":"2024-01-22T05:04:35.050369+0000","last_active":"2024-01-22T05:04:39.082694+0000","last_peered":"2024-01-22T05:04:39.082694+0000","last_clean":"2024-01-22T05:04:39.082694+0000","last_became_active":"2024-01-22T05:04:35.050006+0000","last_became_peered":"2024-01-22T05:04:35.050006+0000","last_unstale":"2024-01-22T05:04:39.082694+0000","last_undegraded":"2024-01-22T05:04:39.082694+0000","last_fullsized":"2024-01-22T05:04:39.082694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101110+0000","last_change":"2024-01-22T05:04:34.615730+0000","last_active":"2024-01-22T05:04:39.101110+0000","last_peered":"2024-01-22T05:04:39.101110+0000","last_clean":"2024-01-22T05:04:39.101110+0000","last_became_active":"2024-01-22T05:04:34.615423+0000","last_became_peered":"2024-01-22T05:04:34.615423+0000","last_unstale":"2024-01-22T05:04:39.101110+0000","last_undegraded":"2024-01-22T05:04:39.101110+0000","last_fullsized":"2024-01-22T05:04:39.101110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091379+0000","last_change":"2024-01-22T05:04:35.061052+0000","last_active":"2024-01-22T05:04:39.091379+0000","last_peered":"2024-01-22T05:04:39.091379+0000","last_clean":"2024-01-22T05:04:39.091379+0000","last_became_active":"2024-01-22T05:04:35.060391+0000","last_became_peered":"2024-01-22T05:04:35.060391+0000","last_unstale":"2024-01-22T05:04:39.091379+0000","last_undegraded":"2024-01-22T05:04:39.091379+0000","last_fullsized":"2024-01-22T05:04:39.091379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079454+0000","last_change":"2024-01-22T05:04:34.625335+0000","last_active":"2024-01-22T05:04:39.079454+0000","last_peered":"2024-01-22T05:04:39.079454+0000","last_clean":"2024-01-22T05:04:39.079454+0000","last_became_active":"2024-01-22T05:04:34.625033+0000","last_became_peered":"2024-01-22T05:04:34.625033+0000","last_unstale":"2024-01-22T05:04:39.079454+0000","last_undegraded":"2024-01-22T05:04:39.079454+0000","last_fullsized":"2024-01-22T05:04:39.079454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.083181+0000","last_change":"2024-01-22T05:04:34.613206+0000","last_active":"2024-01-22T05:04:39.083181+0000","last_peered":"2024-01-22T05:04:39.083181+0000","last_clean":"2024-01-22T05:04:39.083181+0000","last_became_active":"2024-01-22T05:04:34.612458+0000","last_became_peered":"2024-01-22T05:04:34.612458+0000","last_unstale":"2024-01-22T05:04:39.083181+0000","last_undegraded":"2024-01-22T05:04:39.083181+0000","last_fullsized":"2024-01-22T05:04:39.083181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087816+0000","last_change":"2024-01-22T05:04:35.067504+0000","last_active":"2024-01-22T05:04:39.087816+0000","last_peered":"2024-01-22T05:04:39.087816+0000","last_clean":"2024-01-22T05:04:39.087816+0000","last_became_active":"2024-01-22T05:04:35.067007+0000","last_became_peered":"2024-01-22T05:04:35.067007+0000","last_unstale":"2024-01-22T05:04:39.087816+0000","last_undegraded":"2024-01-22T05:04:39.087816+0000","last_fullsized":"2024-01-22T05:04:39.087816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.074244+0000","last_change":"2024-01-22T05:04:34.618016+0000","last_active":"2024-01-22T05:04:39.074244+0000","last_peered":"2024-01-22T05:04:39.074244+0000","last_clean":"2024-01-22T05:04:39.074244+0000","last_became_active":"2024-01-22T05:04:34.616976+0000","last_became_peered":"2024-01-22T05:04:34.616976+0000","last_unstale":"2024-01-22T05:04:39.074244+0000","last_undegraded":"2024-01-22T05:04:39.074244+0000","last_fullsized":"2024-01-22T05:04:39.074244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087750+0000","last_change":"2024-01-22T05:04:35.055742+0000","last_active":"2024-01-22T05:04:39.087750+0000","last_peered":"2024-01-22T05:04:39.087750+0000","last_clean":"2024-01-22T05:04:39.087750+0000","last_became_active":"2024-01-22T05:04:35.055484+0000","last_became_peered":"2024-01-22T05:04:35.055484+0000","last_unstale":"2024-01-22T05:04:39.087750+0000","last_undegraded":"2024-01-22T05:04:39.087750+0000","last_fullsized":"2024-01-22T05:04:39.087750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091158+0000","last_change":"2024-01-22T05:04:34.602682+0000","last_active":"2024-01-22T05:04:39.091158+0000","last_peered":"2024-01-22T05:04:39.091158+0000","last_clean":"2024-01-22T05:04:39.091158+0000","last_became_active":"2024-01-22T05:04:34.602415+0000","last_became_peered":"2024-01-22T05:04:34.602415+0000","last_unstale":"2024-01-22T05:04:39.091158+0000","last_undegraded":"2024-01-22T05:04:39.091158+0000","last_fullsized":"2024-01-22T05:04:39.091158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077259+0000","last_change":"2024-01-22T05:04:35.046243+0000","last_active":"2024-01-22T05:04:39.077259+0000","last_peered":"2024-01-22T05:04:39.077259+0000","last_clean":"2024-01-22T05:04:39.077259+0000","last_became_active":"2024-01-22T05:04:35.045968+0000","last_became_peered":"2024-01-22T05:04:35.045968+0000","last_unstale":"2024-01-22T05:04:39.077259+0000","last_undegraded":"2024-01-22T05:04:39.077259+0000","last_fullsized":"2024-01-22T05:04:39.077259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.094051+0000","last_change":"2024-01-22T05:04:34.612841+0000","last_active":"2024-01-22T05:04:39.094051+0000","last_peered":"2024-01-22T05:04:39.094051+0000","last_clean":"2024-01-22T05:04:39.094051+0000","last_became_active":"2024-01-22T05:04:34.612529+0000","last_became_peered":"2024-01-22T05:04:34.612529+0000","last_unstale":"2024-01-22T05:04:39.094051+0000","last_undegraded":"2024-01-22T05:04:39.094051+0000","last_fullsized":"2024-01-22T05:04:39.094051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090289+0000","last_change":"2024-01-22T05:04:35.067328+0000","last_active":"2024-01-22T05:04:39.090289+0000","last_peered":"2024-01-22T05:04:39.090289+0000","last_clean":"2024-01-22T05:04:39.090289+0000","last_became_active":"2024-01-22T05:04:35.066995+0000","last_became_peered":"2024-01-22T05:04:35.066995+0000","last_unstale":"2024-01-22T05:04:39.090289+0000","last_undegraded":"2024-01-22T05:04:39.090289+0000","last_fullsized":"2024-01-22T05:04:39.090289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091559+0000","last_change":"2024-01-22T05:04:34.613788+0000","last_active":"2024-01-22T05:04:39.091559+0000","last_peered":"2024-01-22T05:04:39.091559+0000","last_clean":"2024-01-22T05:04:39.091559+0000","last_became_active":"2024-01-22T05:04:34.611731+0000","last_became_peered":"2024-01-22T05:04:34.611731+0000","last_unstale":"2024-01-22T05:04:39.091559+0000","last_undegraded":"2024-01-22T05:04:39.091559+0000","last_fullsized":"2024-01-22T05:04:39.091559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072961+0000","last_change":"2024-01-22T05:04:35.053554+0000","last_active":"2024-01-22T05:04:39.072961+0000","last_peered":"2024-01-22T05:04:39.072961+0000","last_clean":"2024-01-22T05:04:39.072961+0000","last_became_active":"2024-01-22T05:04:35.052755+0000","last_became_peered":"2024-01-22T05:04:35.052755+0000","last_unstale":"2024-01-22T05:04:39.072961+0000","last_undegraded":"2024-01-22T05:04:39.072961+0000","last_fullsized":"2024-01-22T05:04:39.072961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077414+0000","last_change":"2024-01-22T05:04:34.612292+0000","last_active":"2024-01-22T05:04:39.077414+0000","last_peered":"2024-01-22T05:04:39.077414+0000","last_clean":"2024-01-22T05:04:39.077414+0000","last_became_active":"2024-01-22T05:04:34.611340+0000","last_became_peered":"2024-01-22T05:04:34.611340+0000","last_unstale":"2024-01-22T05:04:39.077414+0000","last_undegraded":"2024-01-22T05:04:39.077414+0000","last_fullsized":"2024-01-22T05:04:39.077414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073500+0000","last_change":"2024-01-22T05:04:35.047170+0000","last_active":"2024-01-22T05:04:39.073500+0000","last_peered":"2024-01-22T05:04:39.073500+0000","last_clean":"2024-01-22T05:04:39.073500+0000","last_became_active":"2024-01-22T05:04:35.046891+0000","last_became_peered":"2024-01-22T05:04:35.046891+0000","last_unstale":"2024-01-22T05:04:39.073500+0000","last_undegraded":"2024-01-22T05:04:39.073500+0000","last_fullsized":"2024-01-22T05:04:39.073500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.088007+0000","last_change":"2024-01-22T05:04:34.614155+0000","last_active":"2024-01-22T05:04:39.088007+0000","last_peered":"2024-01-22T05:04:39.088007+0000","last_clean":"2024-01-22T05:04:39.088007+0000","last_became_active":"2024-01-22T05:04:34.613838+0000","last_became_peered":"2024-01-22T05:04:34.613838+0000","last_unstale":"2024-01-22T05:04:39.088007+0000","last_undegraded":"2024-01-22T05:04:39.088007+0000","last_fullsized":"2024-01-22T05:04:39.088007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073280+0000","last_change":"2024-01-22T05:04:35.059943+0000","last_active":"2024-01-22T05:04:39.073280+0000","last_peered":"2024-01-22T05:04:39.073280+0000","last_clean":"2024-01-22T05:04:39.073280+0000","last_became_active":"2024-01-22T05:04:35.057491+0000","last_became_peered":"2024-01-22T05:04:35.057491+0000","last_unstale":"2024-01-22T05:04:39.073280+0000","last_undegraded":"2024-01-22T05:04:39.073280+0000","last_fullsized":"2024-01-22T05:04:39.073280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079555+0000","last_change":"2024-01-22T05:04:34.602873+0000","last_active":"2024-01-22T05:04:39.079555+0000","last_peered":"2024-01-22T05:04:39.079555+0000","last_clean":"2024-01-22T05:04:39.079555+0000","last_became_active":"2024-01-22T05:04:34.602401+0000","last_became_peered":"2024-01-22T05:04:34.602401+0000","last_unstale":"2024-01-22T05:04:39.079555+0000","last_undegraded":"2024-01-22T05:04:39.079555+0000","last_fullsized":"2024-01-22T05:04:39.079555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091439+0000","last_change":"2024-01-22T05:04:35.061246+0000","last_active":"2024-01-22T05:04:39.091439+0000","last_peered":"2024-01-22T05:04:39.091439+0000","last_clean":"2024-01-22T05:04:39.091439+0000","last_became_active":"2024-01-22T05:04:35.060730+0000","last_became_peered":"2024-01-22T05:04:35.060730+0000","last_unstale":"2024-01-22T05:04:39.091439+0000","last_undegraded":"2024-01-22T05:04:39.091439+0000","last_fullsized":"2024-01-22T05:04:39.091439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.085851+0000","last_change":"2024-01-22T05:04:34.619066+0000","last_active":"2024-01-22T05:04:39.085851+0000","last_peered":"2024-01-22T05:04:39.085851+0000","last_clean":"2024-01-22T05:04:39.085851+0000","last_became_active":"2024-01-22T05:04:34.618524+0000","last_became_peered":"2024-01-22T05:04:34.618524+0000","last_unstale":"2024-01-22T05:04:39.085851+0000","last_undegraded":"2024-01-22T05:04:39.085851+0000","last_fullsized":"2024-01-22T05:04:39.085851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.088848+0000","last_change":"2024-01-22T05:04:35.047351+0000","last_active":"2024-01-22T05:04:39.088848+0000","last_peered":"2024-01-22T05:04:39.088848+0000","last_clean":"2024-01-22T05:04:39.088848+0000","last_became_active":"2024-01-22T05:04:35.047047+0000","last_became_peered":"2024-01-22T05:04:35.047047+0000","last_unstale":"2024-01-22T05:04:39.088848+0000","last_undegraded":"2024-01-22T05:04:39.088848+0000","last_fullsized":"2024-01-22T05:04:39.088848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.558487+0000","last_change":"2024-01-22T05:04:34.619862+0000","last_active":"2024-01-22T05:04:39.558487+0000","last_peered":"2024-01-22T05:04:39.558487+0000","last_clean":"2024-01-22T05:04:39.558487+0000","last_became_active":"2024-01-22T05:04:34.615400+0000","last_became_peered":"2024-01-22T05:04:34.615400+0000","last_unstale":"2024-01-22T05:04:39.558487+0000","last_undegraded":"2024-01-22T05:04:39.558487+0000","last_fullsized":"2024-01-22T05:04:39.558487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087854+0000","last_change":"2024-01-22T05:04:35.062780+0000","last_active":"2024-01-22T05:04:39.087854+0000","last_peered":"2024-01-22T05:04:39.087854+0000","last_clean":"2024-01-22T05:04:39.087854+0000","last_became_active":"2024-01-22T05:04:35.062412+0000","last_became_peered":"2024-01-22T05:04:35.062412+0000","last_unstale":"2024-01-22T05:04:39.087854+0000","last_undegraded":"2024-01-22T05:04:39.087854+0000","last_fullsized":"2024-01-22T05:04:39.087854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104001+0000","last_change":"2024-01-22T05:04:34.613410+0000","last_active":"2024-01-22T05:04:39.104001+0000","last_peered":"2024-01-22T05:04:39.104001+0000","last_clean":"2024-01-22T05:04:39.104001+0000","last_became_active":"2024-01-22T05:04:34.613064+0000","last_became_peered":"2024-01-22T05:04:34.613064+0000","last_unstale":"2024-01-22T05:04:39.104001+0000","last_undegraded":"2024-01-22T05:04:39.104001+0000","last_fullsized":"2024-01-22T05:04:39.104001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071476+0000","last_change":"2024-01-22T05:04:35.057169+0000","last_active":"2024-01-22T05:04:39.071476+0000","last_peered":"2024-01-22T05:04:39.071476+0000","last_clean":"2024-01-22T05:04:39.071476+0000","last_became_active":"2024-01-22T05:04:35.052838+0000","last_became_peered":"2024-01-22T05:04:35.052838+0000","last_unstale":"2024-01-22T05:04:39.071476+0000","last_undegraded":"2024-01-22T05:04:39.071476+0000","last_fullsized":"2024-01-22T05:04:39.071476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087571+0000","last_change":"2024-01-22T05:04:34.621537+0000","last_active":"2024-01-22T05:04:39.087571+0000","last_peered":"2024-01-22T05:04:39.087571+0000","last_clean":"2024-01-22T05:04:39.087571+0000","last_became_active":"2024-01-22T05:04:34.619679+0000","last_became_peered":"2024-01-22T05:04:34.619679+0000","last_unstale":"2024-01-22T05:04:39.087571+0000","last_undegraded":"2024-01-22T05:04:39.087571+0000","last_fullsized":"2024-01-22T05:04:39.087571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082734+0000","last_change":"2024-01-22T05:04:35.058927+0000","last_active":"2024-01-22T05:04:39.082734+0000","last_peered":"2024-01-22T05:04:39.082734+0000","last_clean":"2024-01-22T05:04:39.082734+0000","last_became_active":"2024-01-22T05:04:35.058360+0000","last_became_peered":"2024-01-22T05:04:35.058360+0000","last_unstale":"2024-01-22T05:04:39.082734+0000","last_undegraded":"2024-01-22T05:04:39.082734+0000","last_fullsized":"2024-01-22T05:04:39.082734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091650+0000","last_change":"2024-01-22T05:04:34.603402+0000","last_active":"2024-01-22T05:04:39.091650+0000","last_peered":"2024-01-22T05:04:39.091650+0000","last_clean":"2024-01-22T05:04:39.091650+0000","last_became_active":"2024-01-22T05:04:34.601578+0000","last_became_peered":"2024-01-22T05:04:34.601578+0000","last_unstale":"2024-01-22T05:04:39.091650+0000","last_undegraded":"2024-01-22T05:04:39.091650+0000","last_fullsized":"2024-01-22T05:04:39.091650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104259+0000","last_change":"2024-01-22T05:04:35.069261+0000","last_active":"2024-01-22T05:04:39.104259+0000","last_peered":"2024-01-22T05:04:39.104259+0000","last_clean":"2024-01-22T05:04:39.104259+0000","last_became_active":"2024-01-22T05:04:35.068641+0000","last_became_peered":"2024-01-22T05:04:35.068641+0000","last_unstale":"2024-01-22T05:04:39.104259+0000","last_undegraded":"2024-01-22T05:04:39.104259+0000","last_fullsized":"2024-01-22T05:04:39.104259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077499+0000","last_change":"2024-01-22T05:04:34.613087+0000","last_active":"2024-01-22T05:04:39.077499+0000","last_peered":"2024-01-22T05:04:39.077499+0000","last_clean":"2024-01-22T05:04:39.077499+0000","last_became_active":"2024-01-22T05:04:34.612162+0000","last_became_peered":"2024-01-22T05:04:34.612162+0000","last_unstale":"2024-01-22T05:04:39.077499+0000","last_undegraded":"2024-01-22T05:04:39.077499+0000","last_fullsized":"2024-01-22T05:04:39.077499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082087+0000","last_change":"2024-01-22T05:04:35.064923+0000","last_active":"2024-01-22T05:04:39.082087+0000","last_peered":"2024-01-22T05:04:39.082087+0000","last_clean":"2024-01-22T05:04:39.082087+0000","last_became_active":"2024-01-22T05:04:35.064659+0000","last_became_peered":"2024-01-22T05:04:35.064659+0000","last_unstale":"2024-01-22T05:04:39.082087+0000","last_undegraded":"2024-01-22T05:04:39.082087+0000","last_fullsized":"2024-01-22T05:04:39.082087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.069357+0000","last_change":"2024-01-22T05:04:34.613407+0000","last_active":"2024-01-22T05:04:39.069357+0000","last_peered":"2024-01-22T05:04:39.069357+0000","last_clean":"2024-01-22T05:04:39.069357+0000","last_became_active":"2024-01-22T05:04:34.613071+0000","last_became_peered":"2024-01-22T05:04:34.613071+0000","last_unstale":"2024-01-22T05:04:39.069357+0000","last_undegraded":"2024-01-22T05:04:39.069357+0000","last_fullsized":"2024-01-22T05:04:39.069357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.106863+0000","last_change":"2024-01-22T05:04:35.041221+0000","last_active":"2024-01-22T05:04:39.106863+0000","last_peered":"2024-01-22T05:04:39.106863+0000","last_clean":"2024-01-22T05:04:39.106863+0000","last_became_active":"2024-01-22T05:04:35.040768+0000","last_became_peered":"2024-01-22T05:04:35.040768+0000","last_unstale":"2024-01-22T05:04:39.106863+0000","last_undegraded":"2024-01-22T05:04:39.106863+0000","last_fullsized":"2024-01-22T05:04:39.106863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.088940+0000","last_change":"2024-01-22T05:04:34.620016+0000","last_active":"2024-01-22T05:04:39.088940+0000","last_peered":"2024-01-22T05:04:39.088940+0000","last_clean":"2024-01-22T05:04:39.088940+0000","last_became_active":"2024-01-22T05:04:34.617253+0000","last_became_peered":"2024-01-22T05:04:34.617253+0000","last_unstale":"2024-01-22T05:04:39.088940+0000","last_undegraded":"2024-01-22T05:04:39.088940+0000","last_fullsized":"2024-01-22T05:04:39.088940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.116642+0000","last_change":"2024-01-22T05:04:35.046592+0000","last_active":"2024-01-22T05:04:39.116642+0000","last_peered":"2024-01-22T05:04:39.116642+0000","last_clean":"2024-01-22T05:04:39.116642+0000","last_became_active":"2024-01-22T05:04:35.046327+0000","last_became_peered":"2024-01-22T05:04:35.046327+0000","last_unstale":"2024-01-22T05:04:39.116642+0000","last_undegraded":"2024-01-22T05:04:39.116642+0000","last_fullsized":"2024-01-22T05:04:39.116642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.120146+0000","last_change":"2024-01-22T05:04:39.111440+0000","last_active":"2024-01-22T05:04:39.120146+0000","last_peered":"2024-01-22T05:04:39.120146+0000","last_clean":"2024-01-22T05:04:39.120146+0000","last_became_active":"2024-01-22T05:04:39.111025+0000","last_became_peered":"2024-01-22T05:04:39.111025+0000","last_unstale":"2024-01-22T05:04:39.120146+0000","last_undegraded":"2024-01-22T05:04:39.120146+0000","last_fullsized":"2024-01-22T05:04:39.120146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091490+0000","last_change":"2024-01-22T05:04:34.605684+0000","last_active":"2024-01-22T05:04:39.091490+0000","last_peered":"2024-01-22T05:04:39.091490+0000","last_clean":"2024-01-22T05:04:39.091490+0000","last_became_active":"2024-01-22T05:04:34.605346+0000","last_became_peered":"2024-01-22T05:04:34.605346+0000","last_unstale":"2024-01-22T05:04:39.091490+0000","last_undegraded":"2024-01-22T05:04:39.091490+0000","last_fullsized":"2024-01-22T05:04:39.091490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071714+0000","last_change":"2024-01-22T05:04:35.053273+0000","last_active":"2024-01-22T05:04:39.071714+0000","last_peered":"2024-01-22T05:04:39.071714+0000","last_clean":"2024-01-22T05:04:39.071714+0000","last_became_active":"2024-01-22T05:04:35.052833+0000","last_became_peered":"2024-01-22T05:04:35.052833+0000","last_unstale":"2024-01-22T05:04:39.071714+0000","last_undegraded":"2024-01-22T05:04:39.071714+0000","last_fullsized":"2024-01-22T05:04:39.071714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103041+0000","last_change":"2024-01-22T05:04:39.099537+0000","last_active":"2024-01-22T05:04:39.103041+0000","last_peered":"2024-01-22T05:04:39.103041+0000","last_clean":"2024-01-22T05:04:39.103041+0000","last_became_active":"2024-01-22T05:04:39.099039+0000","last_became_peered":"2024-01-22T05:04:39.099039+0000","last_unstale":"2024-01-22T05:04:39.103041+0000","last_undegraded":"2024-01-22T05:04:39.103041+0000","last_fullsized":"2024-01-22T05:04:39.103041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.083714+0000","last_change":"2024-01-22T05:04:34.622996+0000","last_active":"2024-01-22T05:04:39.083714+0000","last_peered":"2024-01-22T05:04:39.083714+0000","last_clean":"2024-01-22T05:04:39.083714+0000","last_became_active":"2024-01-22T05:04:34.622644+0000","last_became_peered":"2024-01-22T05:04:34.622644+0000","last_unstale":"2024-01-22T05:04:39.083714+0000","last_undegraded":"2024-01-22T05:04:39.083714+0000","last_fullsized":"2024-01-22T05:04:39.083714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087958+0000","last_change":"2024-01-22T05:04:35.054335+0000","last_active":"2024-01-22T05:04:39.087958+0000","last_peered":"2024-01-22T05:04:39.087958+0000","last_clean":"2024-01-22T05:04:39.087958+0000","last_became_active":"2024-01-22T05:04:35.049434+0000","last_became_peered":"2024-01-22T05:04:35.049434+0000","last_unstale":"2024-01-22T05:04:39.087958+0000","last_undegraded":"2024-01-22T05:04:39.087958+0000","last_fullsized":"2024-01-22T05:04:39.087958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.108343+0000","last_change":"2024-01-22T05:04:39.099472+0000","last_active":"2024-01-22T05:04:39.108343+0000","last_peered":"2024-01-22T05:04:39.108343+0000","last_clean":"2024-01-22T05:04:39.108343+0000","last_became_active":"2024-01-22T05:04:39.099032+0000","last_became_peered":"2024-01-22T05:04:39.099032+0000","last_unstale":"2024-01-22T05:04:39.108343+0000","last_undegraded":"2024-01-22T05:04:39.108343+0000","last_fullsized":"2024-01-22T05:04:39.108343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082319+0000","last_change":"2024-01-22T05:04:34.601591+0000","last_active":"2024-01-22T05:04:39.082319+0000","last_peered":"2024-01-22T05:04:39.082319+0000","last_clean":"2024-01-22T05:04:39.082319+0000","last_became_active":"2024-01-22T05:04:34.601315+0000","last_became_peered":"2024-01-22T05:04:34.601315+0000","last_unstale":"2024-01-22T05:04:39.082319+0000","last_undegraded":"2024-01-22T05:04:39.082319+0000","last_fullsized":"2024-01-22T05:04:39.082319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071207+0000","last_change":"2024-01-22T05:04:35.061009+0000","last_active":"2024-01-22T05:04:39.071207+0000","last_peered":"2024-01-22T05:04:39.071207+0000","last_clean":"2024-01-22T05:04:39.071207+0000","last_became_active":"2024-01-22T05:04:35.060328+0000","last_became_peered":"2024-01-22T05:04:35.060328+0000","last_unstale":"2024-01-22T05:04:39.071207+0000","last_undegraded":"2024-01-22T05:04:39.071207+0000","last_fullsized":"2024-01-22T05:04:39.071207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.116310+0000","last_change":"2024-01-22T05:04:39.114183+0000","last_active":"2024-01-22T05:04:39.116310+0000","last_peered":"2024-01-22T05:04:39.116310+0000","last_clean":"2024-01-22T05:04:39.116310+0000","last_became_active":"2024-01-22T05:04:39.113514+0000","last_became_peered":"2024-01-22T05:04:39.113514+0000","last_unstale":"2024-01-22T05:04:39.116310+0000","last_undegraded":"2024-01-22T05:04:39.116310+0000","last_fullsized":"2024-01-22T05:04:39.116310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.080489+0000","last_change":"2024-01-22T05:04:34.599714+0000","last_active":"2024-01-22T05:04:39.080489+0000","last_peered":"2024-01-22T05:04:39.080489+0000","last_clean":"2024-01-22T05:04:39.080489+0000","last_became_active":"2024-01-22T05:04:34.599372+0000","last_became_peered":"2024-01-22T05:04:34.599372+0000","last_unstale":"2024-01-22T05:04:39.080489+0000","last_undegraded":"2024-01-22T05:04:39.080489+0000","last_fullsized":"2024-01-22T05:04:39.080489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071613+0000","last_change":"2024-01-22T05:04:35.063064+0000","last_active":"2024-01-22T05:04:39.071613+0000","last_peered":"2024-01-22T05:04:39.071613+0000","last_clean":"2024-01-22T05:04:39.071613+0000","last_became_active":"2024-01-22T05:04:35.060532+0000","last_became_peered":"2024-01-22T05:04:35.060532+0000","last_unstale":"2024-01-22T05:04:39.071613+0000","last_undegraded":"2024-01-22T05:04:39.071613+0000","last_fullsized":"2024-01-22T05:04:39.071613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.120120+0000","last_change":"2024-01-22T05:04:39.112845+0000","last_active":"2024-01-22T05:04:39.120120+0000","last_peered":"2024-01-22T05:04:39.120120+0000","last_clean":"2024-01-22T05:04:39.120120+0000","last_became_active":"2024-01-22T05:04:39.107762+0000","last_became_peered":"2024-01-22T05:04:39.107762+0000","last_unstale":"2024-01-22T05:04:39.120120+0000","last_undegraded":"2024-01-22T05:04:39.120120+0000","last_fullsized":"2024-01-22T05:04:39.120120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091889+0000","last_change":"2024-01-22T05:04:34.615318+0000","last_active":"2024-01-22T05:04:39.091889+0000","last_peered":"2024-01-22T05:04:39.091889+0000","last_clean":"2024-01-22T05:04:39.091889+0000","last_became_active":"2024-01-22T05:04:34.609702+0000","last_became_peered":"2024-01-22T05:04:34.609702+0000","last_unstale":"2024-01-22T05:04:39.091889+0000","last_undegraded":"2024-01-22T05:04:39.091889+0000","last_fullsized":"2024-01-22T05:04:39.091889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070678+0000","last_change":"2024-01-22T05:04:35.042388+0000","last_active":"2024-01-22T05:04:39.070678+0000","last_peered":"2024-01-22T05:04:39.070678+0000","last_clean":"2024-01-22T05:04:39.070678+0000","last_became_active":"2024-01-22T05:04:35.041995+0000","last_became_peered":"2024-01-22T05:04:35.041995+0000","last_unstale":"2024-01-22T05:04:39.070678+0000","last_undegraded":"2024-01-22T05:04:39.070678+0000","last_fullsized":"2024-01-22T05:04:39.070678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.095146+0000","last_change":"2024-01-22T05:04:39.091003+0000","last_active":"2024-01-22T05:04:39.095146+0000","last_peered":"2024-01-22T05:04:39.095146+0000","last_clean":"2024-01-22T05:04:39.095146+0000","last_became_active":"2024-01-22T05:04:39.090439+0000","last_became_peered":"2024-01-22T05:04:39.090439+0000","last_unstale":"2024-01-22T05:04:39.095146+0000","last_undegraded":"2024-01-22T05:04:39.095146+0000","last_fullsized":"2024-01-22T05:04:39.095146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071709+0000","last_change":"2024-01-22T05:04:34.618944+0000","last_active":"2024-01-22T05:04:39.071709+0000","last_peered":"2024-01-22T05:04:39.071709+0000","last_clean":"2024-01-22T05:04:39.071709+0000","last_became_active":"2024-01-22T05:04:34.618671+0000","last_became_peered":"2024-01-22T05:04:34.618671+0000","last_unstale":"2024-01-22T05:04:39.071709+0000","last_undegraded":"2024-01-22T05:04:39.071709+0000","last_fullsized":"2024-01-22T05:04:39.071709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.084520+0000","last_change":"2024-01-22T05:04:35.057293+0000","last_active":"2024-01-22T05:04:39.084520+0000","last_peered":"2024-01-22T05:04:39.084520+0000","last_clean":"2024-01-22T05:04:39.084520+0000","last_became_active":"2024-01-22T05:04:35.054936+0000","last_became_peered":"2024-01-22T05:04:35.054936+0000","last_unstale":"2024-01-22T05:04:39.084520+0000","last_undegraded":"2024-01-22T05:04:39.084520+0000","last_fullsized":"2024-01-22T05:04:39.084520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.098476+0000","last_change":"2024-01-22T05:04:39.096209+0000","last_active":"2024-01-22T05:04:39.098476+0000","last_peered":"2024-01-22T05:04:39.098476+0000","last_clean":"2024-01-22T05:04:39.098476+0000","last_became_active":"2024-01-22T05:04:39.095774+0000","last_became_peered":"2024-01-22T05:04:39.095774+0000","last_unstale":"2024-01-22T05:04:39.098476+0000","last_undegraded":"2024-01-22T05:04:39.098476+0000","last_fullsized":"2024-01-22T05:04:39.098476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101268+0000","last_change":"2024-01-22T05:04:34.618376+0000","last_active":"2024-01-22T05:04:39.101268+0000","last_peered":"2024-01-22T05:04:39.101268+0000","last_clean":"2024-01-22T05:04:39.101268+0000","last_became_active":"2024-01-22T05:04:34.618050+0000","last_became_peered":"2024-01-22T05:04:34.618050+0000","last_unstale":"2024-01-22T05:04:39.101268+0000","last_undegraded":"2024-01-22T05:04:39.101268+0000","last_fullsized":"2024-01-22T05:04:39.101268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092655+0000","last_change":"2024-01-22T05:04:35.066609+0000","last_active":"2024-01-22T05:04:39.092655+0000","last_peered":"2024-01-22T05:04:39.092655+0000","last_clean":"2024-01-22T05:04:39.092655+0000","last_became_active":"2024-01-22T05:04:35.066264+0000","last_became_peered":"2024-01-22T05:04:35.066264+0000","last_unstale":"2024-01-22T05:04:39.092655+0000","last_undegraded":"2024-01-22T05:04:39.092655+0000","last_fullsized":"2024-01-22T05:04:39.092655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107734+0000","last_change":"2024-01-22T05:04:39.101032+0000","last_active":"2024-01-22T05:04:39.107734+0000","last_peered":"2024-01-22T05:04:39.107734+0000","last_clean":"2024-01-22T05:04:39.107734+0000","last_became_active":"2024-01-22T05:04:39.100632+0000","last_became_peered":"2024-01-22T05:04:39.100632+0000","last_unstale":"2024-01-22T05:04:39.107734+0000","last_undegraded":"2024-01-22T05:04:39.107734+0000","last_fullsized":"2024-01-22T05:04:39.107734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078768+0000","last_change":"2024-01-22T05:04:34.600852+0000","last_active":"2024-01-22T05:04:39.078768+0000","last_peered":"2024-01-22T05:04:39.078768+0000","last_clean":"2024-01-22T05:04:39.078768+0000","last_became_active":"2024-01-22T05:04:34.600549+0000","last_became_peered":"2024-01-22T05:04:34.600549+0000","last_unstale":"2024-01-22T05:04:39.078768+0000","last_undegraded":"2024-01-22T05:04:39.078768+0000","last_fullsized":"2024-01-22T05:04:39.078768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.094690+0000","last_change":"2024-01-22T05:04:35.048337+0000","last_active":"2024-01-22T05:04:39.094690+0000","last_peered":"2024-01-22T05:04:39.094690+0000","last_clean":"2024-01-22T05:04:39.094690+0000","last_became_active":"2024-01-22T05:04:35.048075+0000","last_became_peered":"2024-01-22T05:04:35.048075+0000","last_unstale":"2024-01-22T05:04:39.094690+0000","last_undegraded":"2024-01-22T05:04:39.094690+0000","last_fullsized":"2024-01-22T05:04:39.094690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.100793+0000","last_change":"2024-01-22T05:04:39.099916+0000","last_active":"2024-01-22T05:04:39.100793+0000","last_peered":"2024-01-22T05:04:39.100793+0000","last_clean":"2024-01-22T05:04:39.100793+0000","last_became_active":"2024-01-22T05:04:39.097629+0000","last_became_peered":"2024-01-22T05:04:39.097629+0000","last_unstale":"2024-01-22T05:04:39.100793+0000","last_undegraded":"2024-01-22T05:04:39.100793+0000","last_fullsized":"2024-01-22T05:04:39.100793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091544+0000","last_change":"2024-01-22T05:04:34.605586+0000","last_active":"2024-01-22T05:04:39.091544+0000","last_peered":"2024-01-22T05:04:39.091544+0000","last_clean":"2024-01-22T05:04:39.091544+0000","last_became_active":"2024-01-22T05:04:34.605258+0000","last_became_peered":"2024-01-22T05:04:34.605258+0000","last_unstale":"2024-01-22T05:04:39.091544+0000","last_undegraded":"2024-01-22T05:04:39.091544+0000","last_fullsized":"2024-01-22T05:04:39.091544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078565+0000","last_change":"2024-01-22T05:04:35.063054+0000","last_active":"2024-01-22T05:04:39.078565+0000","last_peered":"2024-01-22T05:04:39.078565+0000","last_clean":"2024-01-22T05:04:39.078565+0000","last_became_active":"2024-01-22T05:04:35.062800+0000","last_became_peered":"2024-01-22T05:04:35.062800+0000","last_unstale":"2024-01-22T05:04:39.078565+0000","last_undegraded":"2024-01-22T05:04:39.078565+0000","last_fullsized":"2024-01-22T05:04:39.078565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.108862+0000","last_change":"2024-01-22T05:04:39.106490+0000","last_active":"2024-01-22T05:04:39.108862+0000","last_peered":"2024-01-22T05:04:39.108862+0000","last_clean":"2024-01-22T05:04:39.108862+0000","last_became_active":"2024-01-22T05:04:39.106108+0000","last_became_peered":"2024-01-22T05:04:39.106108+0000","last_unstale":"2024-01-22T05:04:39.108862+0000","last_undegraded":"2024-01-22T05:04:39.108862+0000","last_fullsized":"2024-01-22T05:04:39.108862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082736+0000","last_change":"2024-01-22T05:04:34.611849+0000","last_active":"2024-01-22T05:04:39.082736+0000","last_peered":"2024-01-22T05:04:39.082736+0000","last_clean":"2024-01-22T05:04:39.082736+0000","last_became_active":"2024-01-22T05:04:34.611571+0000","last_became_peered":"2024-01-22T05:04:34.611571+0000","last_unstale":"2024-01-22T05:04:39.082736+0000","last_undegraded":"2024-01-22T05:04:39.082736+0000","last_fullsized":"2024-01-22T05:04:39.082736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087897+0000","last_change":"2024-01-22T05:04:35.059209+0000","last_active":"2024-01-22T05:04:39.087897+0000","last_peered":"2024-01-22T05:04:39.087897+0000","last_clean":"2024-01-22T05:04:39.087897+0000","last_became_active":"2024-01-22T05:04:35.058481+0000","last_became_peered":"2024-01-22T05:04:35.058481+0000","last_unstale":"2024-01-22T05:04:39.087897+0000","last_undegraded":"2024-01-22T05:04:39.087897+0000","last_fullsized":"2024-01-22T05:04:39.087897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107238+0000","last_change":"2024-01-22T05:04:39.100104+0000","last_active":"2024-01-22T05:04:39.107238+0000","last_peered":"2024-01-22T05:04:39.107238+0000","last_clean":"2024-01-22T05:04:39.107238+0000","last_became_active":"2024-01-22T05:04:39.099678+0000","last_became_peered":"2024-01-22T05:04:39.099678+0000","last_unstale":"2024-01-22T05:04:39.107238+0000","last_undegraded":"2024-01-22T05:04:39.107238+0000","last_fullsized":"2024-01-22T05:04:39.107238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091440+0000","last_change":"2024-01-22T05:04:34.605902+0000","last_active":"2024-01-22T05:04:39.091440+0000","last_peered":"2024-01-22T05:04:39.091440+0000","last_clean":"2024-01-22T05:04:39.091440+0000","last_became_active":"2024-01-22T05:04:34.605565+0000","last_became_peered":"2024-01-22T05:04:34.605565+0000","last_unstale":"2024-01-22T05:04:39.091440+0000","last_undegraded":"2024-01-22T05:04:39.091440+0000","last_fullsized":"2024-01-22T05:04:39.091440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101579+0000","last_change":"2024-01-22T05:04:35.057060+0000","last_active":"2024-01-22T05:04:39.101579+0000","last_peered":"2024-01-22T05:04:39.101579+0000","last_clean":"2024-01-22T05:04:39.101579+0000","last_became_active":"2024-01-22T05:04:35.052366+0000","last_became_peered":"2024-01-22T05:04:35.052366+0000","last_unstale":"2024-01-22T05:04:39.101579+0000","last_undegraded":"2024-01-22T05:04:39.101579+0000","last_fullsized":"2024-01-22T05:04:39.101579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119060+0000","last_change":"2024-01-22T05:04:39.112388+0000","last_active":"2024-01-22T05:04:39.119060+0000","last_peered":"2024-01-22T05:04:39.119060+0000","last_clean":"2024-01-22T05:04:39.119060+0000","last_became_active":"2024-01-22T05:04:39.112008+0000","last_became_peered":"2024-01-22T05:04:39.112008+0000","last_unstale":"2024-01-22T05:04:39.119060+0000","last_undegraded":"2024-01-22T05:04:39.119060+0000","last_fullsized":"2024-01-22T05:04:39.119060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073424+0000","last_change":"2024-01-22T05:04:34.613609+0000","last_active":"2024-01-22T05:04:39.073424+0000","last_peered":"2024-01-22T05:04:39.073424+0000","last_clean":"2024-01-22T05:04:39.073424+0000","last_became_active":"2024-01-22T05:04:34.613113+0000","last_became_peered":"2024-01-22T05:04:34.613113+0000","last_unstale":"2024-01-22T05:04:39.073424+0000","last_undegraded":"2024-01-22T05:04:39.073424+0000","last_fullsized":"2024-01-22T05:04:39.073424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071728+0000","last_change":"2024-01-22T05:04:35.055447+0000","last_active":"2024-01-22T05:04:39.071728+0000","last_peered":"2024-01-22T05:04:39.071728+0000","last_clean":"2024-01-22T05:04:39.071728+0000","last_became_active":"2024-01-22T05:04:35.047320+0000","last_became_peered":"2024-01-22T05:04:35.047320+0000","last_unstale":"2024-01-22T05:04:39.071728+0000","last_undegraded":"2024-01-22T05:04:39.071728+0000","last_fullsized":"2024-01-22T05:04:39.071728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.113249+0000","last_change":"2024-01-22T05:04:39.111233+0000","last_active":"2024-01-22T05:04:39.113249+0000","last_peered":"2024-01-22T05:04:39.113249+0000","last_clean":"2024-01-22T05:04:39.113249+0000","last_became_active":"2024-01-22T05:04:39.108755+0000","last_became_peered":"2024-01-22T05:04:39.108755+0000","last_unstale":"2024-01-22T05:04:39.113249+0000","last_undegraded":"2024-01-22T05:04:39.113249+0000","last_fullsized":"2024-01-22T05:04:39.113249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.094775+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:04:39.094775+0000","last_peered":"2024-01-22T05:04:39.094775+0000","last_clean":"2024-01-22T05:04:39.094775+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:04:39.094775+0000","last_undegraded":"2024-01-22T05:04:39.094775+0000","last_fullsized":"2024-01-22T05:04:39.094775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092517+0000","last_change":"2024-01-22T05:04:34.613912+0000","last_active":"2024-01-22T05:04:39.092517+0000","last_peered":"2024-01-22T05:04:39.092517+0000","last_clean":"2024-01-22T05:04:39.092517+0000","last_became_active":"2024-01-22T05:04:34.612145+0000","last_became_peered":"2024-01-22T05:04:34.612145+0000","last_unstale":"2024-01-22T05:04:39.092517+0000","last_undegraded":"2024-01-22T05:04:39.092517+0000","last_fullsized":"2024-01-22T05:04:39.092517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072061+0000","last_change":"2024-01-22T05:04:35.056830+0000","last_active":"2024-01-22T05:04:39.072061+0000","last_peered":"2024-01-22T05:04:39.072061+0000","last_clean":"2024-01-22T05:04:39.072061+0000","last_became_active":"2024-01-22T05:04:35.054433+0000","last_became_peered":"2024-01-22T05:04:35.054433+0000","last_unstale":"2024-01-22T05:04:39.072061+0000","last_undegraded":"2024-01-22T05:04:39.072061+0000","last_fullsized":"2024-01-22T05:04:39.072061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.109522+0000","last_change":"2024-01-22T05:04:39.104407+0000","last_active":"2024-01-22T05:04:39.109522+0000","last_peered":"2024-01-22T05:04:39.109522+0000","last_clean":"2024-01-22T05:04:39.109522+0000","last_became_active":"2024-01-22T05:04:39.103894+0000","last_became_peered":"2024-01-22T05:04:39.103894+0000","last_unstale":"2024-01-22T05:04:39.109522+0000","last_undegraded":"2024-01-22T05:04:39.109522+0000","last_fullsized":"2024-01-22T05:04:39.109522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.111694+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:04:39.111694+0000","last_peered":"2024-01-22T05:04:39.111694+0000","last_clean":"2024-01-22T05:04:39.111694+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:04:39.111694+0000","last_undegraded":"2024-01-22T05:04:39.111694+0000","last_fullsized":"2024-01-22T05:04:39.111694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.086118+0000","last_change":"2024-01-22T05:04:34.607413+0000","last_active":"2024-01-22T05:04:39.086118+0000","last_peered":"2024-01-22T05:04:39.086118+0000","last_clean":"2024-01-22T05:04:39.086118+0000","last_became_active":"2024-01-22T05:04:34.606865+0000","last_became_peered":"2024-01-22T05:04:34.606865+0000","last_unstale":"2024-01-22T05:04:39.086118+0000","last_undegraded":"2024-01-22T05:04:39.086118+0000","last_fullsized":"2024-01-22T05:04:39.086118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078381+0000","last_change":"2024-01-22T05:04:35.066781+0000","last_active":"2024-01-22T05:04:39.078381+0000","last_peered":"2024-01-22T05:04:39.078381+0000","last_clean":"2024-01-22T05:04:39.078381+0000","last_became_active":"2024-01-22T05:04:35.066462+0000","last_became_peered":"2024-01-22T05:04:35.066462+0000","last_unstale":"2024-01-22T05:04:39.078381+0000","last_undegraded":"2024-01-22T05:04:39.078381+0000","last_fullsized":"2024-01-22T05:04:39.078381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103937+0000","last_change":"2024-01-22T05:04:39.101743+0000","last_active":"2024-01-22T05:04:39.103937+0000","last_peered":"2024-01-22T05:04:39.103937+0000","last_clean":"2024-01-22T05:04:39.103937+0000","last_became_active":"2024-01-22T05:04:39.100970+0000","last_became_peered":"2024-01-22T05:04:39.100970+0000","last_unstale":"2024-01-22T05:04:39.103937+0000","last_undegraded":"2024-01-22T05:04:39.103937+0000","last_fullsized":"2024-01-22T05:04:39.103937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091262+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:04:39.091262+0000","last_peered":"2024-01-22T05:04:39.091262+0000","last_clean":"2024-01-22T05:04:39.091262+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:04:39.091262+0000","last_undegraded":"2024-01-22T05:04:39.091262+0000","last_fullsized":"2024-01-22T05:04:39.091262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104174+0000","last_change":"2024-01-22T05:04:34.606188+0000","last_active":"2024-01-22T05:04:39.104174+0000","last_peered":"2024-01-22T05:04:39.104174+0000","last_clean":"2024-01-22T05:04:39.104174+0000","last_became_active":"2024-01-22T05:04:34.605902+0000","last_became_peered":"2024-01-22T05:04:34.605902+0000","last_unstale":"2024-01-22T05:04:39.104174+0000","last_undegraded":"2024-01-22T05:04:39.104174+0000","last_fullsized":"2024-01-22T05:04:39.104174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091318+0000","last_change":"2024-01-22T05:04:35.048169+0000","last_active":"2024-01-22T05:04:39.091318+0000","last_peered":"2024-01-22T05:04:39.091318+0000","last_clean":"2024-01-22T05:04:39.091318+0000","last_became_active":"2024-01-22T05:04:35.047797+0000","last_became_peered":"2024-01-22T05:04:35.047797+0000","last_unstale":"2024-01-22T05:04:39.091318+0000","last_undegraded":"2024-01-22T05:04:39.091318+0000","last_fullsized":"2024-01-22T05:04:39.091318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103229+0000","last_change":"2024-01-22T05:04:39.095494+0000","last_active":"2024-01-22T05:04:39.103229+0000","last_peered":"2024-01-22T05:04:39.103229+0000","last_clean":"2024-01-22T05:04:39.103229+0000","last_became_active":"2024-01-22T05:04:39.094639+0000","last_became_peered":"2024-01-22T05:04:39.094639+0000","last_unstale":"2024-01-22T05:04:39.103229+0000","last_undegraded":"2024-01-22T05:04:39.103229+0000","last_fullsized":"2024-01-22T05:04:39.103229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104333+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:04:39.104333+0000","last_peered":"2024-01-22T05:04:39.104333+0000","last_clean":"2024-01-22T05:04:39.104333+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:04:39.104333+0000","last_undegraded":"2024-01-22T05:04:39.104333+0000","last_fullsized":"2024-01-22T05:04:39.104333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082413+0000","last_change":"2024-01-22T05:04:34.614897+0000","last_active":"2024-01-22T05:04:39.082413+0000","last_peered":"2024-01-22T05:04:39.082413+0000","last_clean":"2024-01-22T05:04:39.082413+0000","last_became_active":"2024-01-22T05:04:34.611793+0000","last_became_peered":"2024-01-22T05:04:34.611793+0000","last_unstale":"2024-01-22T05:04:39.082413+0000","last_undegraded":"2024-01-22T05:04:39.082413+0000","last_fullsized":"2024-01-22T05:04:39.082413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101671+0000","last_change":"2024-01-22T05:04:35.037716+0000","last_active":"2024-01-22T05:04:39.101671+0000","last_peered":"2024-01-22T05:04:39.101671+0000","last_clean":"2024-01-22T05:04:39.101671+0000","last_became_active":"2024-01-22T05:04:35.037443+0000","last_became_peered":"2024-01-22T05:04:35.037443+0000","last_unstale":"2024-01-22T05:04:39.101671+0000","last_undegraded":"2024-01-22T05:04:39.101671+0000","last_fullsized":"2024-01-22T05:04:39.101671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.114339+0000","last_change":"2024-01-22T05:04:39.110687+0000","last_active":"2024-01-22T05:04:39.114339+0000","last_peered":"2024-01-22T05:04:39.114339+0000","last_clean":"2024-01-22T05:04:39.114339+0000","last_became_active":"2024-01-22T05:04:39.109377+0000","last_became_peered":"2024-01-22T05:04:39.109377+0000","last_unstale":"2024-01-22T05:04:39.114339+0000","last_undegraded":"2024-01-22T05:04:39.114339+0000","last_fullsized":"2024-01-22T05:04:39.114339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071921+0000","last_change":"2024-01-22T05:04:34.599538+0000","last_active":"2024-01-22T05:04:39.071921+0000","last_peered":"2024-01-22T05:04:39.071921+0000","last_clean":"2024-01-22T05:04:39.071921+0000","last_became_active":"2024-01-22T05:04:34.599188+0000","last_became_peered":"2024-01-22T05:04:34.599188+0000","last_unstale":"2024-01-22T05:04:39.071921+0000","last_undegraded":"2024-01-22T05:04:39.071921+0000","last_fullsized":"2024-01-22T05:04:39.071921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077580+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:04:39.077580+0000","last_peered":"2024-01-22T05:04:39.077580+0000","last_clean":"2024-01-22T05:04:39.077580+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:04:39.077580+0000","last_undegraded":"2024-01-22T05:04:39.077580+0000","last_fullsized":"2024-01-22T05:04:39.077580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104088+0000","last_change":"2024-01-22T05:04:35.038500+0000","last_active":"2024-01-22T05:04:39.104088+0000","last_peered":"2024-01-22T05:04:39.104088+0000","last_clean":"2024-01-22T05:04:39.104088+0000","last_became_active":"2024-01-22T05:04:35.038140+0000","last_became_peered":"2024-01-22T05:04:35.038140+0000","last_unstale":"2024-01-22T05:04:39.104088+0000","last_undegraded":"2024-01-22T05:04:39.104088+0000","last_fullsized":"2024-01-22T05:04:39.104088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119739+0000","last_change":"2024-01-22T05:04:39.116907+0000","last_active":"2024-01-22T05:04:39.119739+0000","last_peered":"2024-01-22T05:04:39.119739+0000","last_clean":"2024-01-22T05:04:39.119739+0000","last_became_active":"2024-01-22T05:04:39.116486+0000","last_became_peered":"2024-01-22T05:04:39.116486+0000","last_unstale":"2024-01-22T05:04:39.119739+0000","last_undegraded":"2024-01-22T05:04:39.119739+0000","last_fullsized":"2024-01-22T05:04:39.119739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.101316+0000","last_change":"2024-01-22T05:04:34.615907+0000","last_active":"2024-01-22T05:04:39.101316+0000","last_peered":"2024-01-22T05:04:39.101316+0000","last_clean":"2024-01-22T05:04:39.101316+0000","last_became_active":"2024-01-22T05:04:34.615598+0000","last_became_peered":"2024-01-22T05:04:34.615598+0000","last_unstale":"2024-01-22T05:04:39.101316+0000","last_undegraded":"2024-01-22T05:04:39.101316+0000","last_fullsized":"2024-01-22T05:04:39.101316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.069623+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:04:39.069623+0000","last_peered":"2024-01-22T05:04:39.069623+0000","last_clean":"2024-01-22T05:04:39.069623+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:04:39.069623+0000","last_undegraded":"2024-01-22T05:04:39.069623+0000","last_fullsized":"2024-01-22T05:04:39.069623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.115610+0000","last_change":"2024-01-22T05:04:35.038846+0000","last_active":"2024-01-22T05:04:39.115610+0000","last_peered":"2024-01-22T05:04:39.115610+0000","last_clean":"2024-01-22T05:04:39.115610+0000","last_became_active":"2024-01-22T05:04:35.038166+0000","last_became_peered":"2024-01-22T05:04:35.038166+0000","last_unstale":"2024-01-22T05:04:39.115610+0000","last_undegraded":"2024-01-22T05:04:39.115610+0000","last_fullsized":"2024-01-22T05:04:39.115610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.117398+0000","last_change":"2024-01-22T05:04:39.115986+0000","last_active":"2024-01-22T05:04:39.117398+0000","last_peered":"2024-01-22T05:04:39.117398+0000","last_clean":"2024-01-22T05:04:39.117398+0000","last_became_active":"2024-01-22T05:04:39.115151+0000","last_became_peered":"2024-01-22T05:04:39.115151+0000","last_unstale":"2024-01-22T05:04:39.117398+0000","last_undegraded":"2024-01-22T05:04:39.117398+0000","last_fullsized":"2024-01-22T05:04:39.117398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087798+0000","last_change":"2024-01-22T05:04:34.609174+0000","last_active":"2024-01-22T05:04:39.087798+0000","last_peered":"2024-01-22T05:04:39.087798+0000","last_clean":"2024-01-22T05:04:39.087798+0000","last_became_active":"2024-01-22T05:04:34.608868+0000","last_became_peered":"2024-01-22T05:04:34.608868+0000","last_unstale":"2024-01-22T05:04:39.087798+0000","last_undegraded":"2024-01-22T05:04:39.087798+0000","last_fullsized":"2024-01-22T05:04:39.087798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087902+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:04:39.087902+0000","last_peered":"2024-01-22T05:04:39.087902+0000","last_clean":"2024-01-22T05:04:39.087902+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:04:39.087902+0000","last_undegraded":"2024-01-22T05:04:39.087902+0000","last_fullsized":"2024-01-22T05:04:39.087902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092366+0000","last_change":"2024-01-22T05:04:35.049694+0000","last_active":"2024-01-22T05:04:39.092366+0000","last_peered":"2024-01-22T05:04:39.092366+0000","last_clean":"2024-01-22T05:04:39.092366+0000","last_became_active":"2024-01-22T05:04:35.048722+0000","last_became_peered":"2024-01-22T05:04:35.048722+0000","last_unstale":"2024-01-22T05:04:39.092366+0000","last_undegraded":"2024-01-22T05:04:39.092366+0000","last_fullsized":"2024-01-22T05:04:39.092366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.106875+0000","last_change":"2024-01-22T05:04:39.103272+0000","last_active":"2024-01-22T05:04:39.106875+0000","last_peered":"2024-01-22T05:04:39.106875+0000","last_clean":"2024-01-22T05:04:39.106875+0000","last_became_active":"2024-01-22T05:04:39.102710+0000","last_became_peered":"2024-01-22T05:04:39.102710+0000","last_unstale":"2024-01-22T05:04:39.106875+0000","last_undegraded":"2024-01-22T05:04:39.106875+0000","last_fullsized":"2024-01-22T05:04:39.106875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082591+0000","last_change":"2024-01-22T05:04:34.621934+0000","last_active":"2024-01-22T05:04:39.082591+0000","last_peered":"2024-01-22T05:04:39.082591+0000","last_clean":"2024-01-22T05:04:39.082591+0000","last_became_active":"2024-01-22T05:04:34.621531+0000","last_became_peered":"2024-01-22T05:04:34.621531+0000","last_unstale":"2024-01-22T05:04:39.082591+0000","last_undegraded":"2024-01-22T05:04:39.082591+0000","last_fullsized":"2024-01-22T05:04:39.082591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.080271+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:04:39.080271+0000","last_peered":"2024-01-22T05:04:39.080271+0000","last_clean":"2024-01-22T05:04:39.080271+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:04:39.080271+0000","last_undegraded":"2024-01-22T05:04:39.080271+0000","last_fullsized":"2024-01-22T05:04:39.080271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087998+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:04:39.087998+0000","last_peered":"2024-01-22T05:04:39.087998+0000","last_clean":"2024-01-22T05:04:39.087998+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:04:39.087998+0000","last_undegraded":"2024-01-22T05:04:39.087998+0000","last_fullsized":"2024-01-22T05:04:39.087998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092360+0000","last_change":"2024-01-22T05:04:35.062222+0000","last_active":"2024-01-22T05:04:39.092360+0000","last_peered":"2024-01-22T05:04:39.092360+0000","last_clean":"2024-01-22T05:04:39.092360+0000","last_became_active":"2024-01-22T05:04:35.061909+0000","last_became_peered":"2024-01-22T05:04:35.061909+0000","last_unstale":"2024-01-22T05:04:39.092360+0000","last_undegraded":"2024-01-22T05:04:39.092360+0000","last_fullsized":"2024-01-22T05:04:39.092360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.103574+0000","last_change":"2024-01-22T05:04:39.097762+0000","last_active":"2024-01-22T05:04:39.103574+0000","last_peered":"2024-01-22T05:04:39.103574+0000","last_clean":"2024-01-22T05:04:39.103574+0000","last_became_active":"2024-01-22T05:04:39.097387+0000","last_became_peered":"2024-01-22T05:04:39.097387+0000","last_unstale":"2024-01-22T05:04:39.103574+0000","last_undegraded":"2024-01-22T05:04:39.103574+0000","last_fullsized":"2024-01-22T05:04:39.103574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078865+0000","last_change":"2024-01-22T05:04:34.618785+0000","last_active":"2024-01-22T05:04:39.078865+0000","last_peered":"2024-01-22T05:04:39.078865+0000","last_clean":"2024-01-22T05:04:39.078865+0000","last_became_active":"2024-01-22T05:04:34.618434+0000","last_became_peered":"2024-01-22T05:04:34.618434+0000","last_unstale":"2024-01-22T05:04:39.078865+0000","last_undegraded":"2024-01-22T05:04:39.078865+0000","last_fullsized":"2024-01-22T05:04:39.078865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.115520+0000","last_change":"2024-01-22T05:04:35.053526+0000","last_active":"2024-01-22T05:04:39.115520+0000","last_peered":"2024-01-22T05:04:39.115520+0000","last_clean":"2024-01-22T05:04:39.115520+0000","last_became_active":"2024-01-22T05:04:35.053256+0000","last_became_peered":"2024-01-22T05:04:35.053256+0000","last_unstale":"2024-01-22T05:04:39.115520+0000","last_undegraded":"2024-01-22T05:04:39.115520+0000","last_fullsized":"2024-01-22T05:04:39.115520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087821+0000","last_change":"2024-01-22T05:04:39.085964+0000","last_active":"2024-01-22T05:04:39.087821+0000","last_peered":"2024-01-22T05:04:39.087821+0000","last_clean":"2024-01-22T05:04:39.087821+0000","last_became_active":"2024-01-22T05:04:39.085535+0000","last_became_peered":"2024-01-22T05:04:39.085535+0000","last_unstale":"2024-01-22T05:04:39.087821+0000","last_undegraded":"2024-01-22T05:04:39.087821+0000","last_fullsized":"2024-01-22T05:04:39.087821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072213+0000","last_change":"2024-01-22T05:04:34.606362+0000","last_active":"2024-01-22T05:04:39.072213+0000","last_peered":"2024-01-22T05:04:39.072213+0000","last_clean":"2024-01-22T05:04:39.072213+0000","last_became_active":"2024-01-22T05:04:34.606055+0000","last_became_peered":"2024-01-22T05:04:34.606055+0000","last_unstale":"2024-01-22T05:04:39.072213+0000","last_undegraded":"2024-01-22T05:04:39.072213+0000","last_fullsized":"2024-01-22T05:04:39.072213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073421+0000","last_change":"2024-01-22T05:04:35.058051+0000","last_active":"2024-01-22T05:04:39.073421+0000","last_peered":"2024-01-22T05:04:39.073421+0000","last_clean":"2024-01-22T05:04:39.073421+0000","last_became_active":"2024-01-22T05:04:35.057790+0000","last_became_peered":"2024-01-22T05:04:35.057790+0000","last_unstale":"2024-01-22T05:04:39.073421+0000","last_undegraded":"2024-01-22T05:04:39.073421+0000","last_fullsized":"2024-01-22T05:04:39.073421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.116871+0000","last_change":"2024-01-22T05:04:39.106800+0000","last_active":"2024-01-22T05:04:39.116871+0000","last_peered":"2024-01-22T05:04:39.116871+0000","last_clean":"2024-01-22T05:04:39.116871+0000","last_became_active":"2024-01-22T05:04:39.106323+0000","last_became_peered":"2024-01-22T05:04:39.106323+0000","last_unstale":"2024-01-22T05:04:39.116871+0000","last_undegraded":"2024-01-22T05:04:39.116871+0000","last_fullsized":"2024-01-22T05:04:39.116871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091150+0000","last_change":"2024-01-22T05:04:34.612849+0000","last_active":"2024-01-22T05:04:39.091150+0000","last_peered":"2024-01-22T05:04:39.091150+0000","last_clean":"2024-01-22T05:04:39.091150+0000","last_became_active":"2024-01-22T05:04:34.612516+0000","last_became_peered":"2024-01-22T05:04:34.612516+0000","last_unstale":"2024-01-22T05:04:39.091150+0000","last_undegraded":"2024-01-22T05:04:39.091150+0000","last_fullsized":"2024-01-22T05:04:39.091150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073015+0000","last_change":"2024-01-22T05:04:35.052723+0000","last_active":"2024-01-22T05:04:39.073015+0000","last_peered":"2024-01-22T05:04:39.073015+0000","last_clean":"2024-01-22T05:04:39.073015+0000","last_became_active":"2024-01-22T05:04:35.051494+0000","last_became_peered":"2024-01-22T05:04:35.051494+0000","last_unstale":"2024-01-22T05:04:39.073015+0000","last_undegraded":"2024-01-22T05:04:39.073015+0000","last_fullsized":"2024-01-22T05:04:39.073015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.104928+0000","last_change":"2024-01-22T05:04:39.101428+0000","last_active":"2024-01-22T05:04:39.104928+0000","last_peered":"2024-01-22T05:04:39.104928+0000","last_clean":"2024-01-22T05:04:39.104928+0000","last_became_active":"2024-01-22T05:04:39.100920+0000","last_became_peered":"2024-01-22T05:04:39.100920+0000","last_unstale":"2024-01-22T05:04:39.104928+0000","last_undegraded":"2024-01-22T05:04:39.104928+0000","last_fullsized":"2024-01-22T05:04:39.104928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.083763+0000","last_change":"2024-01-22T05:04:34.602186+0000","last_active":"2024-01-22T05:04:39.083763+0000","last_peered":"2024-01-22T05:04:39.083763+0000","last_clean":"2024-01-22T05:04:39.083763+0000","last_became_active":"2024-01-22T05:04:34.601827+0000","last_became_peered":"2024-01-22T05:04:34.601827+0000","last_unstale":"2024-01-22T05:04:39.083763+0000","last_undegraded":"2024-01-22T05:04:39.083763+0000","last_fullsized":"2024-01-22T05:04:39.083763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.073177+0000","last_change":"2024-01-22T05:04:35.054388+0000","last_active":"2024-01-22T05:04:39.073177+0000","last_peered":"2024-01-22T05:04:39.073177+0000","last_clean":"2024-01-22T05:04:39.073177+0000","last_became_active":"2024-01-22T05:04:35.054183+0000","last_became_peered":"2024-01-22T05:04:35.054183+0000","last_unstale":"2024-01-22T05:04:39.073177+0000","last_undegraded":"2024-01-22T05:04:39.073177+0000","last_fullsized":"2024-01-22T05:04:39.073177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107631+0000","last_change":"2024-01-22T05:04:39.102774+0000","last_active":"2024-01-22T05:04:39.107631+0000","last_peered":"2024-01-22T05:04:39.107631+0000","last_clean":"2024-01-22T05:04:39.107631+0000","last_became_active":"2024-01-22T05:04:39.102291+0000","last_became_peered":"2024-01-22T05:04:39.102291+0000","last_unstale":"2024-01-22T05:04:39.107631+0000","last_undegraded":"2024-01-22T05:04:39.107631+0000","last_fullsized":"2024-01-22T05:04:39.107631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.080482+0000","last_change":"2024-01-22T05:04:34.608068+0000","last_active":"2024-01-22T05:04:39.080482+0000","last_peered":"2024-01-22T05:04:39.080482+0000","last_clean":"2024-01-22T05:04:39.080482+0000","last_became_active":"2024-01-22T05:04:34.607482+0000","last_became_peered":"2024-01-22T05:04:34.607482+0000","last_unstale":"2024-01-22T05:04:39.080482+0000","last_undegraded":"2024-01-22T05:04:39.080482+0000","last_fullsized":"2024-01-22T05:04:39.080482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091190+0000","last_change":"2024-01-22T05:04:35.045213+0000","last_active":"2024-01-22T05:04:39.091190+0000","last_peered":"2024-01-22T05:04:39.091190+0000","last_clean":"2024-01-22T05:04:39.091190+0000","last_became_active":"2024-01-22T05:04:35.044882+0000","last_became_peered":"2024-01-22T05:04:35.044882+0000","last_unstale":"2024-01-22T05:04:39.091190+0000","last_undegraded":"2024-01-22T05:04:39.091190+0000","last_fullsized":"2024-01-22T05:04:39.091190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.107871+0000","last_change":"2024-01-22T05:04:39.103229+0000","last_active":"2024-01-22T05:04:39.107871+0000","last_peered":"2024-01-22T05:04:39.107871+0000","last_clean":"2024-01-22T05:04:39.107871+0000","last_became_active":"2024-01-22T05:04:39.102798+0000","last_became_peered":"2024-01-22T05:04:39.102798+0000","last_unstale":"2024-01-22T05:04:39.107871+0000","last_undegraded":"2024-01-22T05:04:39.107871+0000","last_fullsized":"2024-01-22T05:04:39.107871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091000+0000","last_change":"2024-01-22T05:04:34.612506+0000","last_active":"2024-01-22T05:04:39.091000+0000","last_peered":"2024-01-22T05:04:39.091000+0000","last_clean":"2024-01-22T05:04:39.091000+0000","last_became_active":"2024-01-22T05:04:34.612255+0000","last_became_peered":"2024-01-22T05:04:34.612255+0000","last_unstale":"2024-01-22T05:04:39.091000+0000","last_undegraded":"2024-01-22T05:04:39.091000+0000","last_fullsized":"2024-01-22T05:04:39.091000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090985+0000","last_change":"2024-01-22T05:04:35.048108+0000","last_active":"2024-01-22T05:04:39.090985+0000","last_peered":"2024-01-22T05:04:39.090985+0000","last_clean":"2024-01-22T05:04:39.090985+0000","last_became_active":"2024-01-22T05:04:35.047784+0000","last_became_peered":"2024-01-22T05:04:35.047784+0000","last_unstale":"2024-01-22T05:04:39.090985+0000","last_undegraded":"2024-01-22T05:04:39.090985+0000","last_fullsized":"2024-01-22T05:04:39.090985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119163+0000","last_change":"2024-01-22T05:04:39.114068+0000","last_active":"2024-01-22T05:04:39.119163+0000","last_peered":"2024-01-22T05:04:39.119163+0000","last_clean":"2024-01-22T05:04:39.119163+0000","last_became_active":"2024-01-22T05:04:39.113694+0000","last_became_peered":"2024-01-22T05:04:39.113694+0000","last_unstale":"2024-01-22T05:04:39.119163+0000","last_undegraded":"2024-01-22T05:04:39.119163+0000","last_fullsized":"2024-01-22T05:04:39.119163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092578+0000","last_change":"2024-01-22T05:04:34.608169+0000","last_active":"2024-01-22T05:04:39.092578+0000","last_peered":"2024-01-22T05:04:39.092578+0000","last_clean":"2024-01-22T05:04:39.092578+0000","last_became_active":"2024-01-22T05:04:34.607884+0000","last_became_peered":"2024-01-22T05:04:34.607884+0000","last_unstale":"2024-01-22T05:04:39.092578+0000","last_undegraded":"2024-01-22T05:04:39.092578+0000","last_fullsized":"2024-01-22T05:04:39.092578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071885+0000","last_change":"2024-01-22T05:04:35.046615+0000","last_active":"2024-01-22T05:04:39.071885+0000","last_peered":"2024-01-22T05:04:39.071885+0000","last_clean":"2024-01-22T05:04:39.071885+0000","last_became_active":"2024-01-22T05:04:35.044177+0000","last_became_peered":"2024-01-22T05:04:35.044177+0000","last_unstale":"2024-01-22T05:04:39.071885+0000","last_undegraded":"2024-01-22T05:04:39.071885+0000","last_fullsized":"2024-01-22T05:04:39.071885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.108538+0000","last_change":"2024-01-22T05:04:39.106119+0000","last_active":"2024-01-22T05:04:39.108538+0000","last_peered":"2024-01-22T05:04:39.108538+0000","last_clean":"2024-01-22T05:04:39.108538+0000","last_became_active":"2024-01-22T05:04:39.105691+0000","last_became_peered":"2024-01-22T05:04:39.105691+0000","last_unstale":"2024-01-22T05:04:39.108538+0000","last_undegraded":"2024-01-22T05:04:39.108538+0000","last_fullsized":"2024-01-22T05:04:39.108538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092748+0000","last_change":"2024-01-22T05:04:34.609294+0000","last_active":"2024-01-22T05:04:39.092748+0000","last_peered":"2024-01-22T05:04:39.092748+0000","last_clean":"2024-01-22T05:04:39.092748+0000","last_became_active":"2024-01-22T05:04:34.609001+0000","last_became_peered":"2024-01-22T05:04:34.609001+0000","last_unstale":"2024-01-22T05:04:39.092748+0000","last_undegraded":"2024-01-22T05:04:39.092748+0000","last_fullsized":"2024-01-22T05:04:39.092748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079342+0000","last_change":"2024-01-22T05:04:35.063766+0000","last_active":"2024-01-22T05:04:39.079342+0000","last_peered":"2024-01-22T05:04:39.079342+0000","last_clean":"2024-01-22T05:04:39.079342+0000","last_became_active":"2024-01-22T05:04:35.063477+0000","last_became_peered":"2024-01-22T05:04:35.063477+0000","last_unstale":"2024-01-22T05:04:39.079342+0000","last_undegraded":"2024-01-22T05:04:39.079342+0000","last_fullsized":"2024-01-22T05:04:39.079342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.113628+0000","last_change":"2024-01-22T05:04:39.112131+0000","last_active":"2024-01-22T05:04:39.113628+0000","last_peered":"2024-01-22T05:04:39.113628+0000","last_clean":"2024-01-22T05:04:39.113628+0000","last_became_active":"2024-01-22T05:04:39.111715+0000","last_became_peered":"2024-01-22T05:04:39.111715+0000","last_unstale":"2024-01-22T05:04:39.113628+0000","last_undegraded":"2024-01-22T05:04:39.113628+0000","last_fullsized":"2024-01-22T05:04:39.113628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.089065+0000","last_change":"2024-01-22T05:04:34.619934+0000","last_active":"2024-01-22T05:04:39.089065+0000","last_peered":"2024-01-22T05:04:39.089065+0000","last_clean":"2024-01-22T05:04:39.089065+0000","last_became_active":"2024-01-22T05:04:34.617261+0000","last_became_peered":"2024-01-22T05:04:34.617261+0000","last_unstale":"2024-01-22T05:04:39.089065+0000","last_undegraded":"2024-01-22T05:04:39.089065+0000","last_fullsized":"2024-01-22T05:04:39.089065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.085702+0000","last_change":"2024-01-22T05:04:35.073485+0000","last_active":"2024-01-22T05:04:39.085702+0000","last_peered":"2024-01-22T05:04:39.085702+0000","last_clean":"2024-01-22T05:04:39.085702+0000","last_became_active":"2024-01-22T05:04:35.073124+0000","last_became_peered":"2024-01-22T05:04:35.073124+0000","last_unstale":"2024-01-22T05:04:39.085702+0000","last_undegraded":"2024-01-22T05:04:39.085702+0000","last_fullsized":"2024-01-22T05:04:39.085702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.119896+0000","last_change":"2024-01-22T05:04:39.118034+0000","last_active":"2024-01-22T05:04:39.119896+0000","last_peered":"2024-01-22T05:04:39.119896+0000","last_clean":"2024-01-22T05:04:39.119896+0000","last_became_active":"2024-01-22T05:04:39.117544+0000","last_became_peered":"2024-01-22T05:04:39.117544+0000","last_unstale":"2024-01-22T05:04:39.119896+0000","last_undegraded":"2024-01-22T05:04:39.119896+0000","last_fullsized":"2024-01-22T05:04:39.119896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090880+0000","last_change":"2024-01-22T05:04:34.607793+0000","last_active":"2024-01-22T05:04:39.090880+0000","last_peered":"2024-01-22T05:04:39.090880+0000","last_clean":"2024-01-22T05:04:39.090880+0000","last_became_active":"2024-01-22T05:04:34.607475+0000","last_became_peered":"2024-01-22T05:04:34.607475+0000","last_unstale":"2024-01-22T05:04:39.090880+0000","last_undegraded":"2024-01-22T05:04:39.090880+0000","last_fullsized":"2024-01-22T05:04:39.090880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092444+0000","last_change":"2024-01-22T05:04:35.059510+0000","last_active":"2024-01-22T05:04:39.092444+0000","last_peered":"2024-01-22T05:04:39.092444+0000","last_clean":"2024-01-22T05:04:39.092444+0000","last_became_active":"2024-01-22T05:04:35.059143+0000","last_became_peered":"2024-01-22T05:04:35.059143+0000","last_unstale":"2024-01-22T05:04:39.092444+0000","last_undegraded":"2024-01-22T05:04:39.092444+0000","last_fullsized":"2024-01-22T05:04:39.092444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.099973+0000","last_change":"2024-01-22T05:04:39.097504+0000","last_active":"2024-01-22T05:04:39.099973+0000","last_peered":"2024-01-22T05:04:39.099973+0000","last_clean":"2024-01-22T05:04:39.099973+0000","last_became_active":"2024-01-22T05:04:39.097014+0000","last_became_peered":"2024-01-22T05:04:39.097014+0000","last_unstale":"2024-01-22T05:04:39.099973+0000","last_undegraded":"2024-01-22T05:04:39.099973+0000","last_fullsized":"2024-01-22T05:04:39.099973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077581+0000","last_change":"2024-01-22T05:04:34.611364+0000","last_active":"2024-01-22T05:04:39.077581+0000","last_peered":"2024-01-22T05:04:39.077581+0000","last_clean":"2024-01-22T05:04:39.077581+0000","last_became_active":"2024-01-22T05:04:34.610334+0000","last_became_peered":"2024-01-22T05:04:34.610334+0000","last_unstale":"2024-01-22T05:04:39.077581+0000","last_undegraded":"2024-01-22T05:04:39.077581+0000","last_fullsized":"2024-01-22T05:04:39.077581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082200+0000","last_change":"2024-01-22T05:04:35.069773+0000","last_active":"2024-01-22T05:04:39.082200+0000","last_peered":"2024-01-22T05:04:39.082200+0000","last_clean":"2024-01-22T05:04:39.082200+0000","last_became_active":"2024-01-22T05:04:35.069468+0000","last_became_peered":"2024-01-22T05:04:35.069468+0000","last_unstale":"2024-01-22T05:04:39.082200+0000","last_undegraded":"2024-01-22T05:04:39.082200+0000","last_fullsized":"2024-01-22T05:04:39.082200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.110957+0000","last_change":"2024-01-22T05:04:39.110074+0000","last_active":"2024-01-22T05:04:39.110957+0000","last_peered":"2024-01-22T05:04:39.110957+0000","last_clean":"2024-01-22T05:04:39.110957+0000","last_became_active":"2024-01-22T05:04:39.109579+0000","last_became_peered":"2024-01-22T05:04:39.109579+0000","last_unstale":"2024-01-22T05:04:39.110957+0000","last_undegraded":"2024-01-22T05:04:39.110957+0000","last_fullsized":"2024-01-22T05:04:39.110957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:38.047951+0000","last_clean_scrub_stamp":"2024-01-22T05:04:38.047951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090495+0000","last_change":"2024-01-22T05:04:34.608932+0000","last_active":"2024-01-22T05:04:39.090495+0000","last_peered":"2024-01-22T05:04:39.090495+0000","last_clean":"2024-01-22T05:04:39.090495+0000","last_became_active":"2024-01-22T05:04:34.608567+0000","last_became_peered":"2024-01-22T05:04:34.608567+0000","last_unstale":"2024-01-22T05:04:39.090495+0000","last_undegraded":"2024-01-22T05:04:39.090495+0000","last_fullsized":"2024-01-22T05:04:39.090495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.087479+0000","last_change":"2024-01-22T05:04:35.054670+0000","last_active":"2024-01-22T05:04:39.087479+0000","last_peered":"2024-01-22T05:04:39.087479+0000","last_clean":"2024-01-22T05:04:39.087479+0000","last_became_active":"2024-01-22T05:04:35.054302+0000","last_became_peered":"2024-01-22T05:04:35.054302+0000","last_unstale":"2024-01-22T05:04:39.087479+0000","last_undegraded":"2024-01-22T05:04:39.087479+0000","last_fullsized":"2024-01-22T05:04:39.087479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077441+0000","last_change":"2024-01-22T05:04:34.621810+0000","last_active":"2024-01-22T05:04:39.077441+0000","last_peered":"2024-01-22T05:04:39.077441+0000","last_clean":"2024-01-22T05:04:39.077441+0000","last_became_active":"2024-01-22T05:04:34.620591+0000","last_became_peered":"2024-01-22T05:04:34.620591+0000","last_unstale":"2024-01-22T05:04:39.077441+0000","last_undegraded":"2024-01-22T05:04:39.077441+0000","last_fullsized":"2024-01-22T05:04:39.077441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072938+0000","last_change":"2024-01-22T05:04:35.053530+0000","last_active":"2024-01-22T05:04:39.072938+0000","last_peered":"2024-01-22T05:04:39.072938+0000","last_clean":"2024-01-22T05:04:39.072938+0000","last_became_active":"2024-01-22T05:04:35.053256+0000","last_became_peered":"2024-01-22T05:04:35.053256+0000","last_unstale":"2024-01-22T05:04:39.072938+0000","last_undegraded":"2024-01-22T05:04:39.072938+0000","last_fullsized":"2024-01-22T05:04:39.072938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082902+0000","last_change":"2024-01-22T05:04:34.623001+0000","last_active":"2024-01-22T05:04:39.082902+0000","last_peered":"2024-01-22T05:04:39.082902+0000","last_clean":"2024-01-22T05:04:39.082902+0000","last_became_active":"2024-01-22T05:04:34.622591+0000","last_became_peered":"2024-01-22T05:04:34.622591+0000","last_unstale":"2024-01-22T05:04:39.082902+0000","last_undegraded":"2024-01-22T05:04:39.082902+0000","last_fullsized":"2024-01-22T05:04:39.082902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070523+0000","last_change":"2024-01-22T05:04:35.063913+0000","last_active":"2024-01-22T05:04:39.070523+0000","last_peered":"2024-01-22T05:04:39.070523+0000","last_clean":"2024-01-22T05:04:39.070523+0000","last_became_active":"2024-01-22T05:04:35.063630+0000","last_became_peered":"2024-01-22T05:04:35.063630+0000","last_unstale":"2024-01-22T05:04:39.070523+0000","last_undegraded":"2024-01-22T05:04:39.070523+0000","last_fullsized":"2024-01-22T05:04:39.070523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"25'7","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-22T05:04:46.053222+0000","last_change":"2024-01-22T05:04:34.620106+0000","last_active":"2024-01-22T05:04:46.053222+0000","last_peered":"2024-01-22T05:04:46.053222+0000","last_clean":"2024-01-22T05:04:46.053222+0000","last_became_active":"2024-01-22T05:04:34.619792+0000","last_became_peered":"2024-01-22T05:04:34.619792+0000","last_unstale":"2024-01-22T05:04:46.053222+0000","last_undegraded":"2024-01-22T05:04:46.053222+0000","last_fullsized":"2024-01-22T05:04:46.053222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3071,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070845+0000","last_change":"2024-01-22T05:04:35.057279+0000","last_active":"2024-01-22T05:04:39.070845+0000","last_peered":"2024-01-22T05:04:39.070845+0000","last_clean":"2024-01-22T05:04:39.070845+0000","last_became_active":"2024-01-22T05:04:35.056980+0000","last_became_peered":"2024-01-22T05:04:35.056980+0000","last_unstale":"2024-01-22T05:04:39.070845+0000","last_undegraded":"2024-01-22T05:04:39.070845+0000","last_fullsized":"2024-01-22T05:04:39.070845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092494+0000","last_change":"2024-01-22T05:04:34.611971+0000","last_active":"2024-01-22T05:04:39.092494+0000","last_peered":"2024-01-22T05:04:39.092494+0000","last_clean":"2024-01-22T05:04:39.092494+0000","last_became_active":"2024-01-22T05:04:34.605153+0000","last_became_peered":"2024-01-22T05:04:34.605153+0000","last_unstale":"2024-01-22T05:04:39.092494+0000","last_undegraded":"2024-01-22T05:04:39.092494+0000","last_fullsized":"2024-01-22T05:04:39.092494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077326+0000","last_change":"2024-01-22T05:04:35.037542+0000","last_active":"2024-01-22T05:04:39.077326+0000","last_peered":"2024-01-22T05:04:39.077326+0000","last_clean":"2024-01-22T05:04:39.077326+0000","last_became_active":"2024-01-22T05:04:35.037178+0000","last_became_peered":"2024-01-22T05:04:35.037178+0000","last_unstale":"2024-01-22T05:04:39.077326+0000","last_undegraded":"2024-01-22T05:04:39.077326+0000","last_fullsized":"2024-01-22T05:04:39.077326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091860+0000","last_change":"2024-01-22T05:04:34.615870+0000","last_active":"2024-01-22T05:04:39.091860+0000","last_peered":"2024-01-22T05:04:39.091860+0000","last_clean":"2024-01-22T05:04:39.091860+0000","last_became_active":"2024-01-22T05:04:34.615601+0000","last_became_peered":"2024-01-22T05:04:34.615601+0000","last_unstale":"2024-01-22T05:04:39.091860+0000","last_undegraded":"2024-01-22T05:04:39.091860+0000","last_fullsized":"2024-01-22T05:04:39.091860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090691+0000","last_change":"2024-01-22T05:04:35.070694+0000","last_active":"2024-01-22T05:04:39.090691+0000","last_peered":"2024-01-22T05:04:39.090691+0000","last_clean":"2024-01-22T05:04:39.090691+0000","last_became_active":"2024-01-22T05:04:35.070448+0000","last_became_peered":"2024-01-22T05:04:35.070448+0000","last_unstale":"2024-01-22T05:04:39.090691+0000","last_undegraded":"2024-01-22T05:04:39.090691+0000","last_fullsized":"2024-01-22T05:04:39.090691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092663+0000","last_change":"2024-01-22T05:04:34.616419+0000","last_active":"2024-01-22T05:04:39.092663+0000","last_peered":"2024-01-22T05:04:39.092663+0000","last_clean":"2024-01-22T05:04:39.092663+0000","last_became_active":"2024-01-22T05:04:34.616108+0000","last_became_peered":"2024-01-22T05:04:34.616108+0000","last_unstale":"2024-01-22T05:04:39.092663+0000","last_undegraded":"2024-01-22T05:04:39.092663+0000","last_fullsized":"2024-01-22T05:04:39.092663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.071575+0000","last_change":"2024-01-22T05:04:35.058871+0000","last_active":"2024-01-22T05:04:39.071575+0000","last_peered":"2024-01-22T05:04:39.071575+0000","last_clean":"2024-01-22T05:04:39.071575+0000","last_became_active":"2024-01-22T05:04:35.058576+0000","last_became_peered":"2024-01-22T05:04:35.058576+0000","last_unstale":"2024-01-22T05:04:39.071575+0000","last_undegraded":"2024-01-22T05:04:39.071575+0000","last_fullsized":"2024-01-22T05:04:39.071575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070542+0000","last_change":"2024-01-22T05:04:35.057257+0000","last_active":"2024-01-22T05:04:39.070542+0000","last_peered":"2024-01-22T05:04:39.070542+0000","last_clean":"2024-01-22T05:04:39.070542+0000","last_became_active":"2024-01-22T05:04:35.056962+0000","last_became_peered":"2024-01-22T05:04:35.056962+0000","last_unstale":"2024-01-22T05:04:39.070542+0000","last_undegraded":"2024-01-22T05:04:39.070542+0000","last_fullsized":"2024-01-22T05:04:39.070542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.078666+0000","last_change":"2024-01-22T05:04:34.604249+0000","last_active":"2024-01-22T05:04:39.078666+0000","last_peered":"2024-01-22T05:04:39.078666+0000","last_clean":"2024-01-22T05:04:39.078666+0000","last_became_active":"2024-01-22T05:04:34.603896+0000","last_became_peered":"2024-01-22T05:04:34.603896+0000","last_unstale":"2024-01-22T05:04:39.078666+0000","last_undegraded":"2024-01-22T05:04:39.078666+0000","last_fullsized":"2024-01-22T05:04:39.078666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.082626+0000","last_change":"2024-01-22T05:04:35.045030+0000","last_active":"2024-01-22T05:04:39.082626+0000","last_peered":"2024-01-22T05:04:39.082626+0000","last_clean":"2024-01-22T05:04:39.082626+0000","last_became_active":"2024-01-22T05:04:35.043890+0000","last_became_peered":"2024-01-22T05:04:35.043890+0000","last_unstale":"2024-01-22T05:04:39.082626+0000","last_undegraded":"2024-01-22T05:04:39.082626+0000","last_fullsized":"2024-01-22T05:04:39.082626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090782+0000","last_change":"2024-01-22T05:04:34.625268+0000","last_active":"2024-01-22T05:04:39.090782+0000","last_peered":"2024-01-22T05:04:39.090782+0000","last_clean":"2024-01-22T05:04:39.090782+0000","last_became_active":"2024-01-22T05:04:34.624645+0000","last_became_peered":"2024-01-22T05:04:34.624645+0000","last_unstale":"2024-01-22T05:04:39.090782+0000","last_undegraded":"2024-01-22T05:04:39.090782+0000","last_fullsized":"2024-01-22T05:04:39.090782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.072828+0000","last_change":"2024-01-22T05:04:35.061505+0000","last_active":"2024-01-22T05:04:39.072828+0000","last_peered":"2024-01-22T05:04:39.072828+0000","last_clean":"2024-01-22T05:04:39.072828+0000","last_became_active":"2024-01-22T05:04:35.061173+0000","last_became_peered":"2024-01-22T05:04:35.061173+0000","last_unstale":"2024-01-22T05:04:39.072828+0000","last_undegraded":"2024-01-22T05:04:39.072828+0000","last_fullsized":"2024-01-22T05:04:39.072828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.077231+0000","last_change":"2024-01-22T05:04:34.612548+0000","last_active":"2024-01-22T05:04:39.077231+0000","last_peered":"2024-01-22T05:04:39.077231+0000","last_clean":"2024-01-22T05:04:39.077231+0000","last_became_active":"2024-01-22T05:04:34.612040+0000","last_became_peered":"2024-01-22T05:04:34.612040+0000","last_unstale":"2024-01-22T05:04:39.077231+0000","last_undegraded":"2024-01-22T05:04:39.077231+0000","last_fullsized":"2024-01-22T05:04:39.077231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.093708+0000","last_change":"2024-01-22T05:04:35.048950+0000","last_active":"2024-01-22T05:04:39.093708+0000","last_peered":"2024-01-22T05:04:39.093708+0000","last_clean":"2024-01-22T05:04:39.093708+0000","last_became_active":"2024-01-22T05:04:35.048676+0000","last_became_peered":"2024-01-22T05:04:35.048676+0000","last_unstale":"2024-01-22T05:04:39.093708+0000","last_undegraded":"2024-01-22T05:04:39.093708+0000","last_fullsized":"2024-01-22T05:04:39.093708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090409+0000","last_change":"2024-01-22T05:04:34.602672+0000","last_active":"2024-01-22T05:04:39.090409+0000","last_peered":"2024-01-22T05:04:39.090409+0000","last_clean":"2024-01-22T05:04:39.090409+0000","last_became_active":"2024-01-22T05:04:34.602360+0000","last_became_peered":"2024-01-22T05:04:34.602360+0000","last_unstale":"2024-01-22T05:04:39.090409+0000","last_undegraded":"2024-01-22T05:04:39.090409+0000","last_fullsized":"2024-01-22T05:04:39.090409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091801+0000","last_change":"2024-01-22T05:04:35.054902+0000","last_active":"2024-01-22T05:04:39.091801+0000","last_peered":"2024-01-22T05:04:39.091801+0000","last_clean":"2024-01-22T05:04:39.091801+0000","last_became_active":"2024-01-22T05:04:35.054584+0000","last_became_peered":"2024-01-22T05:04:35.054584+0000","last_unstale":"2024-01-22T05:04:39.091801+0000","last_undegraded":"2024-01-22T05:04:39.091801+0000","last_fullsized":"2024-01-22T05:04:39.091801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079986+0000","last_change":"2024-01-22T05:04:34.608195+0000","last_active":"2024-01-22T05:04:39.079986+0000","last_peered":"2024-01-22T05:04:39.079986+0000","last_clean":"2024-01-22T05:04:39.079986+0000","last_became_active":"2024-01-22T05:04:34.607837+0000","last_became_peered":"2024-01-22T05:04:34.607837+0000","last_unstale":"2024-01-22T05:04:39.079986+0000","last_undegraded":"2024-01-22T05:04:39.079986+0000","last_fullsized":"2024-01-22T05:04:39.079986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.070953+0000","last_change":"2024-01-22T05:04:35.061215+0000","last_active":"2024-01-22T05:04:39.070953+0000","last_peered":"2024-01-22T05:04:39.070953+0000","last_clean":"2024-01-22T05:04:39.070953+0000","last_became_active":"2024-01-22T05:04:35.060725+0000","last_became_peered":"2024-01-22T05:04:35.060725+0000","last_unstale":"2024-01-22T05:04:39.070953+0000","last_undegraded":"2024-01-22T05:04:39.070953+0000","last_fullsized":"2024-01-22T05:04:39.070953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.091439+0000","last_change":"2024-01-22T05:04:34.609097+0000","last_active":"2024-01-22T05:04:39.091439+0000","last_peered":"2024-01-22T05:04:39.091439+0000","last_clean":"2024-01-22T05:04:39.091439+0000","last_became_active":"2024-01-22T05:04:34.608713+0000","last_became_peered":"2024-01-22T05:04:34.608713+0000","last_unstale":"2024-01-22T05:04:39.091439+0000","last_undegraded":"2024-01-22T05:04:39.091439+0000","last_fullsized":"2024-01-22T05:04:39.091439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.090630+0000","last_change":"2024-01-22T05:04:35.070206+0000","last_active":"2024-01-22T05:04:39.090630+0000","last_peered":"2024-01-22T05:04:39.090630+0000","last_clean":"2024-01-22T05:04:39.090630+0000","last_became_active":"2024-01-22T05:04:35.068703+0000","last_became_peered":"2024-01-22T05:04:35.068703+0000","last_unstale":"2024-01-22T05:04:39.090630+0000","last_undegraded":"2024-01-22T05:04:39.090630+0000","last_fullsized":"2024-01-22T05:04:39.090630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.111639+0000","last_change":"2024-01-22T05:04:34.620326+0000","last_active":"2024-01-22T05:04:39.111639+0000","last_peered":"2024-01-22T05:04:39.111639+0000","last_clean":"2024-01-22T05:04:39.111639+0000","last_became_active":"2024-01-22T05:04:34.620046+0000","last_became_peered":"2024-01-22T05:04:34.620046+0000","last_unstale":"2024-01-22T05:04:39.111639+0000","last_undegraded":"2024-01-22T05:04:39.111639+0000","last_fullsized":"2024-01-22T05:04:39.111639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.079200+0000","last_change":"2024-01-22T05:04:35.054096+0000","last_active":"2024-01-22T05:04:39.079200+0000","last_peered":"2024-01-22T05:04:39.079200+0000","last_clean":"2024-01-22T05:04:39.079200+0000","last_became_active":"2024-01-22T05:04:35.053815+0000","last_became_peered":"2024-01-22T05:04:35.053815+0000","last_unstale":"2024-01-22T05:04:39.079200+0000","last_undegraded":"2024-01-22T05:04:39.079200+0000","last_fullsized":"2024-01-22T05:04:39.079200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:34.565543+0000","last_clean_scrub_stamp":"2024-01-22T05:04:34.565543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-22T05:04:39.092578+0000","last_change":"2024-01-22T05:04:34.617396+0000","last_active":"2024-01-22T05:04:39.092578+0000","last_peered":"2024-01-22T05:04:39.092578+0000","last_clean":"2024-01-22T05:04:39.092578+0000","last_became_active":"2024-01-22T05:04:34.617128+0000","last_became_peered":"2024-01-22T05:04:34.617128+0000","last_unstale":"2024-01-22T05:04:39.092578+0000","last_undegraded":"2024-01-22T05:04:39.092578+0000","last_fullsized":"2024-01-22T05:04:39.092578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:33.554729+0000","last_clean_scrub_stamp":"2024-01-22T05:04:33.554729+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297384,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074456,"statfs":{"total":96636764160,"available":96332242944,"internally_reserved":0,"allocated":294912,"data_stored":112351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297364,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074476,"statfs":{"total":96636764160,"available":96332263424,"internally_reserved":0,"allocated":274432,"data_stored":114562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297356,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074484,"statfs":{"total":96636764160,"available":96332271616,"internally_reserved":0,"allocated":266240,"data_stored":110937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4750000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4470000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7809999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297376,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074464,"statfs":{"total":96636764160,"available":96332251136,"internally_reserved":0,"allocated":286720,"data_stored":114708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297360,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074480,"statfs":{"total":96636764160,"available":96332267520,"internally_reserved":0,"allocated":270336,"data_stored":111027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7170000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5469999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297360,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074480,"statfs":{"total":96636764160,"available":96332267520,"internally_reserved":0,"allocated":270336,"data_stored":111007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297356,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074484,"statfs":{"total":96636764160,"available":96332271616,"internally_reserved":0,"allocated":266240,"data_stored":110937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297356,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074484,"statfs":{"total":96636764160,"available":96332271616,"internally_reserved":0,"allocated":266240,"data_stored":110937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.548}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:04:58.160 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-22T05:04:58.160 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-22T05:04:58.160 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-22T05:04:58.160 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-22T05:04:58.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.361+0000 7f49c5e00700 1 Processor -- start 2024-01-22T05:04:58.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.361+0000 7f49c5e00700 1 -- start start 2024-01-22T05:04:58.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.361+0000 7f49c5e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f49c0065240 0x7f49c00644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:58.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.361+0000 7f49c5e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f49c0065620 0x7f49c00649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:58.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.361+0000 7f49c5e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c00c2700 con 0x7f49c015b9b0 2024-01-22T05:04:58.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.361+0000 7f49c5e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c0064ed0 con 0x7f49c0065240 2024-01-22T05:04:58.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.361+0000 7f49c5e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c00c29a0 con 0x7f49c0065620 2024-01-22T05:04:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.361+0000 7f49bea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f49c0065240 0x7f49c00644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49bea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f49c0065240 0x7f49c00644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36354/0 (socket says 172.21.15.49:36354) 2024-01-22T05:04:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49bea00700 1 -- 172.21.15.49:0/2978219521 learned_addr learned my addr 172.21.15.49:0/2978219521 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49be000700 1 --2- 172.21.15.49:0/2978219521 >> v2:172.21.15.110:3300/0 conn(0x7f49c0065620 0x7f49c00649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49bea00700 1 -- 172.21.15.49:0/2978219521 >> v2:172.21.15.110:3300/0 conn(0x7f49c0065620 msgr2=0x7f49c00649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49bea00700 1 --2- 172.21.15.49:0/2978219521 >> v2:172.21.15.110:3300/0 conn(0x7f49c0065620 0x7f49c00649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49bea00700 1 -- 172.21.15.49:0/2978219521 >> v1:172.21.15.110:6789/0 conn(0x7f49c015b9b0 legacy=0x7f49c015bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49bea00700 1 -- 172.21.15.49:0/2978219521 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c00c2c80 con 0x7f49c0065240 2024-01-22T05:04:58.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49be000700 1 --2- 172.21.15.49:0/2978219521 >> v2:172.21.15.110:3300/0 conn(0x7f49c0065620 0x7f49c00649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49bea00700 1 --2- 172.21.15.49:0/2978219521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c0065240 0x7f49c00644f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f49c00c4770 tx=0x7f49b00090f0).ready entity=mon.0 client_cookie=750a5a04a1101319 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49bd600700 1 -- 172.21.15.49:0/2978219521 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b000b520 con 0x7f49c0065240 2024-01-22T05:04:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49bd600700 1 -- 172.21.15.49:0/2978219521 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b000b680 con 0x7f49c0065240 2024-01-22T05:04:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49bd600700 1 -- 172.21.15.49:0/2978219521 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b000ba00 con 0x7f49c0065240 2024-01-22T05:04:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49c5e00700 1 -- 172.21.15.49:0/2978219521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c0065240 msgr2=0x7f49c00644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49c5e00700 1 --2- 172.21.15.49:0/2978219521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c0065240 0x7f49c00644f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f49c00c4770 tx=0x7f49b00090f0).stop 2024-01-22T05:04:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49c5e00700 1 -- 172.21.15.49:0/2978219521 shutdown_connections 2024-01-22T05:04:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49c5e00700 1 --2- 172.21.15.49:0/2978219521 >> v2:172.21.15.110:3300/0 conn(0x7f49c0065620 0x7f49c00649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49c5e00700 1 --2- 172.21.15.49:0/2978219521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c0065240 0x7f49c00644f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.365+0000 7f49c5e00700 1 -- 172.21.15.49:0/2978219521 >> 172.21.15.49:0/2978219521 conn(0x7f49c00c87f0 msgr2=0x7f49c00c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:58.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.369+0000 7f49c5e00700 1 -- 172.21.15.49:0/2978219521 shutdown_connections 2024-01-22T05:04:58.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.369+0000 7f49c5e00700 1 -- 172.21.15.49:0/2978219521 wait complete. 2024-01-22T05:04:58.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.369+0000 7f49c5e00700 1 Processor -- start 2024-01-22T05:04:58.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49c5e00700 1 -- start start 2024-01-22T05:04:58.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49c5e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c0065240 0x7f49c014b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:58.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49c5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49c0065620 0x7f49c015a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:58.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49c5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c015b9b0 0x7f49c015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:58.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49c5e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c015abb0 con 0x7f49c015b9b0 2024-01-22T05:04:58.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49c5e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c00a7e20 con 0x7f49c0065240 2024-01-22T05:04:58.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49c5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0155960 con 0x7f49c0065620 2024-01-22T05:04:58.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49bfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c015b9b0 0x7f49c015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:58.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49bfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c015b9b0 0x7f49c015a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36364/0 (socket says 172.21.15.49:36364) 2024-01-22T05:04:58.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49bfe00700 1 -- 172.21.15.49:0/904270967 learned_addr learned my addr 172.21.15.49:0/904270967 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:58.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49bea00700 1 --2- 172.21.15.49:0/904270967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c0065240 0x7f49c014b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:58.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49be000700 1 --2- 172.21.15.49:0/904270967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49c0065620 0x7f49c015a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:58.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49bea00700 1 -- 172.21.15.49:0/904270967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49c0065620 msgr2=0x7f49c015a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:58.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49bea00700 1 --2- 172.21.15.49:0/904270967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49c0065620 0x7f49c015a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49bea00700 1 -- 172.21.15.49:0/904270967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c015b9b0 msgr2=0x7f49c015a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:58.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49bea00700 1 --2- 172.21.15.49:0/904270967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c015b9b0 0x7f49c015a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49bea00700 1 -- 172.21.15.49:0/904270967 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a80092a0 con 0x7f49c0065240 2024-01-22T05:04:58.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.373+0000 7f49bfe00700 1 --2- 172.21.15.49:0/904270967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c015b9b0 0x7f49c015a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:04:58.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.377+0000 7f49bea00700 1 --2- 172.21.15.49:0/904270967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c0065240 0x7f49c014b130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f49b0014000 tx=0x7f49b0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:58.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.377+0000 7f49b6000700 1 -- 172.21.15.49:0/904270967 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b0006d90 con 0x7f49c0065240 2024-01-22T05:04:58.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.377+0000 7f49b6000700 1 -- 172.21.15.49:0/904270967 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b0000bc0 con 0x7f49c0065240 2024-01-22T05:04:58.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.377+0000 7f49c5e00700 1 -- 172.21.15.49:0/904270967 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b0009370 con 0x7f49c0065240 2024-01-22T05:04:58.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.377+0000 7f49b6000700 1 -- 172.21.15.49:0/904270967 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b001c420 con 0x7f49c0065240 2024-01-22T05:04:58.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.377+0000 7f49c5e00700 1 -- 172.21.15.49:0/904270967 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c00a77d0 con 0x7f49c0065240 2024-01-22T05:04:58.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.377+0000 7f49c5e00700 1 -- 172.21.15.49:0/904270967 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c0047060 con 0x7f49c0065240 2024-01-22T05:04:58.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.377+0000 7f49b6000700 1 -- 172.21.15.49:0/904270967 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f49b001c7d0 con 0x7f49c0065240 2024-01-22T05:04:58.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.381+0000 7f49b6000700 1 --2- 172.21.15.49:0/904270967 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f499805a510 0x7f499805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:58.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.381+0000 7f49b6000700 1 -- 172.21.15.49:0/904270967 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f49b0076790 con 0x7f49c0065240 2024-01-22T05:04:58.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.381+0000 7f49be000700 1 --2- 172.21.15.49:0/904270967 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f499805a510 0x7f499805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:58.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.381+0000 7f49be000700 1 --2- 172.21.15.49:0/904270967 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f499805a510 0x7f499805c9d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f49c00c0640 tx=0x7f49a8009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:58.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.389+0000 7f49b6000700 1 -- 172.21.15.49:0/904270967 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f49b0049b40 con 0x7f49c0065240 2024-01-22T05:04:58.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.589+0000 7f49c5e00700 1 -- 172.21.15.49:0/904270967 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f49c00c2f60 con 0x7f49c0065240 2024-01-22T05:04:58.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.589+0000 7f49b6000700 1 -- 172.21.15.49:0/904270967 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f49b0020080 con 0x7f49c0065240 2024-01-22T05:04:58.592 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:58.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.593+0000 7f49c5e00700 1 -- 172.21.15.49:0/904270967 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f499805a510 msgr2=0x7f499805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:58.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.593+0000 7f49c5e00700 1 --2- 172.21.15.49:0/904270967 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f499805a510 0x7f499805c9d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f49c00c0640 tx=0x7f49a8009060).stop 2024-01-22T05:04:58.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.593+0000 7f49c5e00700 1 -- 172.21.15.49:0/904270967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c0065240 msgr2=0x7f49c014b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:58.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.593+0000 7f49c5e00700 1 --2- 172.21.15.49:0/904270967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c0065240 0x7f49c014b130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f49b0014000 tx=0x7f49b0017000).stop 2024-01-22T05:04:58.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.593+0000 7f49c5e00700 1 -- 172.21.15.49:0/904270967 shutdown_connections 2024-01-22T05:04:58.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.593+0000 7f49c5e00700 1 --2- 172.21.15.49:0/904270967 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f499805a510 0x7f499805c9d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.593+0000 7f49c5e00700 1 --2- 172.21.15.49:0/904270967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c015b9b0 0x7f49c015a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.593+0000 7f49c5e00700 1 --2- 172.21.15.49:0/904270967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49c0065620 0x7f49c015a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.593+0000 7f49c5e00700 1 --2- 172.21.15.49:0/904270967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c0065240 0x7f49c014b130 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.593+0000 7f49c5e00700 1 -- 172.21.15.49:0/904270967 >> 172.21.15.49:0/904270967 conn(0x7f49c00c87f0 msgr2=0x7f49c00bcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:58.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.593+0000 7f49c5e00700 1 -- 172.21.15.49:0/904270967 shutdown_connections 2024-01-22T05:04:58.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.593+0000 7f49c5e00700 1 -- 172.21.15.49:0/904270967 wait complete. 2024-01-22T05:04:58.619 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-22T05:04:58.619 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-22T05:04:58.619 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:04:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.773+0000 7f0920400700 1 Processor -- start 2024-01-22T05:04:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.777+0000 7f0920400700 1 -- start start 2024-01-22T05:04:58.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.777+0000 7f0920400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09180bcfa0 0x7f0918151700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:58.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.777+0000 7f0920400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0918151bf0 0x7f09180ab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:58.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.777+0000 7f0920400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0918068a60 con 0x7f09180abd80 2024-01-22T05:04:58.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.777+0000 7f0920400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09180bb790 con 0x7f0918151bf0 2024-01-22T05:04:58.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.777+0000 7f0920400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09180bd380 con 0x7f09180bcfa0 2024-01-22T05:04:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.777+0000 7f091e400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f09180abd80 0x7f09181555c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34048/0 (socket says 172.21.15.49:34048) 2024-01-22T05:04:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.777+0000 7f091e400700 1 -- 172.21.15.49:0/3595059090 learned_addr learned my addr 172.21.15.49:0/3595059090 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f091d000700 1 --2- 172.21.15.49:0/3595059090 >> v2:172.21.15.49:3300/0 conn(0x7f0918151bf0 0x7f09180ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f091da00700 1 --2- 172.21.15.49:0/3595059090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09180bcfa0 0x7f0918151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f0917e00700 1 -- 172.21.15.49:0/3595059090 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436855416 0 0) 0x7f0918068a60 con 0x7f09180abd80 2024-01-22T05:04:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f0917e00700 1 -- 172.21.15.49:0/3595059090 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08f80033f0 con 0x7f09180abd80 2024-01-22T05:04:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f091d000700 1 -- 172.21.15.49:0/3595059090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09180bcfa0 msgr2=0x7f0918151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f091d000700 1 --2- 172.21.15.49:0/3595059090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09180bcfa0 0x7f0918151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f091d000700 1 -- 172.21.15.49:0/3595059090 >> v1:172.21.15.49:6789/0 conn(0x7f09180abd80 legacy=0x7f09181555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:58.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f091d000700 1 -- 172.21.15.49:0/3595059090 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09180ac210 con 0x7f0918151bf0 2024-01-22T05:04:58.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f091d000700 1 --2- 172.21.15.49:0/3595059090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0918151bf0 0x7f09180ab890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f0900009760 tx=0x7f0900009060).ready entity=mon.0 client_cookie=2a6f218c224b054b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:58.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f0917e00700 1 -- 172.21.15.49:0/3595059090 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09000090d0 con 0x7f0918151bf0 2024-01-22T05:04:58.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f0917e00700 1 -- 172.21.15.49:0/3595059090 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090000d4a0 con 0x7f0918151bf0 2024-01-22T05:04:58.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f0917e00700 1 -- 172.21.15.49:0/3595059090 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000d820 con 0x7f0918151bf0 2024-01-22T05:04:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f0920400700 1 -- 172.21.15.49:0/3595059090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0918151bf0 msgr2=0x7f09180ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f0920400700 1 --2- 172.21.15.49:0/3595059090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0918151bf0 0x7f09180ab890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f0900009760 tx=0x7f0900009060).stop 2024-01-22T05:04:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f0920400700 1 -- 172.21.15.49:0/3595059090 shutdown_connections 2024-01-22T05:04:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f0920400700 1 --2- 172.21.15.49:0/3595059090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0918151bf0 0x7f09180ab890 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f0920400700 1 --2- 172.21.15.49:0/3595059090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09180bcfa0 0x7f0918151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f0920400700 1 -- 172.21.15.49:0/3595059090 >> 172.21.15.49:0/3595059090 conn(0x7f09180c6540 msgr2=0x7f09180c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f0920400700 1 -- 172.21.15.49:0/3595059090 shutdown_connections 2024-01-22T05:04:58.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.781+0000 7f0920400700 1 -- 172.21.15.49:0/3595059090 wait complete. 2024-01-22T05:04:58.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.785+0000 7f0920400700 1 Processor -- start 2024-01-22T05:04:58.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.785+0000 7f0920400700 1 -- start start 2024-01-22T05:04:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.785+0000 7f0920400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09180abd80 0x7f09180a7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:58.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.785+0000 7f0920400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180bcfa0 0x7f091814c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.785+0000 7f0920400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0918151bf0 0x7f0918165230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.785+0000 7f0920400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09181564f0 con 0x7f09180bcfa0 2024-01-22T05:04:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.785+0000 7f0920400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09180a9d80 con 0x7f0918151bf0 2024-01-22T05:04:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.785+0000 7f0920400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091814cb80 con 0x7f09180abd80 2024-01-22T05:04:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f091d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180bcfa0 0x7f091814c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f091d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180bcfa0 0x7f091814c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36394/0 (socket says 172.21.15.49:36394) 2024-01-22T05:04:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f091d000700 1 -- 172.21.15.49:0/3396756683 learned_addr learned my addr 172.21.15.49:0/3396756683 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f091e400700 1 --2- 172.21.15.49:0/3396756683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0918151bf0 0x7f0918165230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f091da00700 1 --2- 172.21.15.49:0/3396756683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09180abd80 0x7f09180a7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f091d000700 1 -- 172.21.15.49:0/3396756683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09180abd80 msgr2=0x7f09180a7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f091d000700 1 --2- 172.21.15.49:0/3396756683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09180abd80 0x7f09180a7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f091d000700 1 -- 172.21.15.49:0/3396756683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0918151bf0 msgr2=0x7f0918165230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f091d000700 1 --2- 172.21.15.49:0/3396756683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0918151bf0 0x7f0918165230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f091d000700 1 -- 172.21.15.49:0/3396756683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09000092a0 con 0x7f09180bcfa0 2024-01-22T05:04:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f091d000700 1 --2- 172.21.15.49:0/3396756683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180bcfa0 0x7f091814c280 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f0918064d80 tx=0x7f0900016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f0914c00700 1 -- 172.21.15.49:0/3396756683 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900006910 con 0x7f09180bcfa0 2024-01-22T05:04:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f0920400700 1 -- 172.21.15.49:0/3396756683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0918156a20 con 0x7f09180bcfa0 2024-01-22T05:04:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f0914c00700 1 -- 172.21.15.49:0/3396756683 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09000127f0 con 0x7f09180bcfa0 2024-01-22T05:04:58.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f0914c00700 1 -- 172.21.15.49:0/3396756683 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900012b90 con 0x7f09180bcfa0 2024-01-22T05:04:58.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.789+0000 7f0920400700 1 -- 172.21.15.49:0/3396756683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0918165720 con 0x7f09180bcfa0 2024-01-22T05:04:58.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.793+0000 7f0920400700 1 -- 172.21.15.49:0/3396756683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09180a9f10 con 0x7f09180bcfa0 2024-01-22T05:04:58.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.793+0000 7f0914c00700 1 -- 172.21.15.49:0/3396756683 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0900026460 con 0x7f09180bcfa0 2024-01-22T05:04:58.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.793+0000 7f0914c00700 1 --2- 172.21.15.49:0/3396756683 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f005a510 0x7f08f005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:58.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.793+0000 7f0914c00700 1 -- 172.21.15.49:0/3396756683 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f0900075f60 con 0x7f09180bcfa0 2024-01-22T05:04:58.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.793+0000 7f091da00700 1 --2- 172.21.15.49:0/3396756683 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f005a510 0x7f08f005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:58.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.793+0000 7f091da00700 1 --2- 172.21.15.49:0/3396756683 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f005a510 0x7f08f005c9d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f0908009c30 tx=0x7f0908009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:58.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.801+0000 7f0914c00700 1 -- 172.21.15.49:0/3396756683 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0900049310 con 0x7f09180bcfa0 2024-01-22T05:04:58.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.965+0000 7f0920400700 1 -- 172.21.15.49:0/3396756683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0918047060 con 0x7f09180bcfa0 2024-01-22T05:04:58.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.969+0000 7f0914c00700 1 -- 172.21.15.49:0/3396756683 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f090004c930 con 0x7f09180bcfa0 2024-01-22T05:04:58.971 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:04:58.971 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:39.526211+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:04:58.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.973+0000 7f0920400700 1 -- 172.21.15.49:0/3396756683 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f005a510 msgr2=0x7f08f005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:58.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.973+0000 7f0920400700 1 --2- 172.21.15.49:0/3396756683 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f005a510 0x7f08f005c9d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f0908009c30 tx=0x7f0908009060).stop 2024-01-22T05:04:58.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.973+0000 7f0920400700 1 -- 172.21.15.49:0/3396756683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180bcfa0 msgr2=0x7f091814c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:58.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.973+0000 7f0920400700 1 --2- 172.21.15.49:0/3396756683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180bcfa0 0x7f091814c280 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f0918064d80 tx=0x7f0900016000).stop 2024-01-22T05:04:58.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.973+0000 7f0920400700 1 -- 172.21.15.49:0/3396756683 shutdown_connections 2024-01-22T05:04:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.973+0000 7f0920400700 1 --2- 172.21.15.49:0/3396756683 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f005a510 0x7f08f005c9d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.973+0000 7f0920400700 1 --2- 172.21.15.49:0/3396756683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0918151bf0 0x7f0918165230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.973+0000 7f0920400700 1 --2- 172.21.15.49:0/3396756683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180bcfa0 0x7f091814c280 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.973+0000 7f0920400700 1 --2- 172.21.15.49:0/3396756683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09180abd80 0x7f09180a7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.973+0000 7f0920400700 1 -- 172.21.15.49:0/3396756683 >> 172.21.15.49:0/3396756683 conn(0x7f09180c6540 msgr2=0x7f09180bd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.973+0000 7f0920400700 1 -- 172.21.15.49:0/3396756683 shutdown_connections 2024-01-22T05:04:58.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:58.973+0000 7f0920400700 1 -- 172.21.15.49:0/3396756683 wait complete. 2024-01-22T05:04:58.999 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:04:32.991898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:04:34.057128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-22T05:04:37.108860+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:04:59.000 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:04:59.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.165+0000 7f2c85a00700 1 Processor -- start 2024-01-22T05:04:59.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.165+0000 7f2c85a00700 1 -- start start 2024-01-22T05:04:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.169+0000 7f2c85a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2c80153cf0 0x7f2c800c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.169+0000 7f2c85a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2c800c1ac0 0x7f2c800bc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.169+0000 7f2c85a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c80068280 con 0x7f2c800bc980 2024-01-22T05:04:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.169+0000 7f2c85a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c800c1f30 con 0x7f2c800c1ac0 2024-01-22T05:04:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.169+0000 7f2c85a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c800bd190 con 0x7f2c80153cf0 2024-01-22T05:04:59.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.169+0000 7f2c7e000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2c800c1ac0 0x7f2c800bc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.169+0000 7f2c7e000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2c800c1ac0 0x7f2c800bc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36404/0 (socket says 172.21.15.49:36404) 2024-01-22T05:04:59.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.169+0000 7f2c7e000700 1 -- 172.21.15.49:0/3244728442 learned_addr learned my addr 172.21.15.49:0/3244728442 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:59.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.169+0000 7f2c7f400700 1 --1- 172.21.15.49:0/3244728442 >> v1:172.21.15.49:6789/0 conn(0x7f2c800bc980 0x7f2c80068710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34058/0 (socket says 172.21.15.49:34058) 2024-01-22T05:04:59.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.169+0000 7f2c7ea00700 1 --2- 172.21.15.49:0/3244728442 >> v2:172.21.15.110:3300/0 conn(0x7f2c80153cf0 0x7f2c800c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.169+0000 7f2c7e000700 1 -- 172.21.15.49:0/3244728442 >> v2:172.21.15.110:3300/0 conn(0x7f2c80153cf0 msgr2=0x7f2c800c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:59.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.169+0000 7f2c7e000700 1 --2- 172.21.15.49:0/3244728442 >> v2:172.21.15.110:3300/0 conn(0x7f2c80153cf0 0x7f2c800c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.169+0000 7f2c7e000700 1 -- 172.21.15.49:0/3244728442 >> v1:172.21.15.49:6789/0 conn(0x7f2c800bc980 legacy=0x7f2c80068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.169+0000 7f2c7e000700 1 -- 172.21.15.49:0/3244728442 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c80067c30 con 0x7f2c800c1ac0 2024-01-22T05:04:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.173+0000 7f2c7e000700 1 --2- 172.21.15.49:0/3244728442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c800c1ac0 0x7f2c800bc490 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f2c80063be0 tx=0x7f2c68009060).ready entity=mon.0 client_cookie=93c68e3b522ff2d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.173+0000 7f2c7d600700 1 -- 172.21.15.49:0/3244728442 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68005880 con 0x7f2c800c1ac0 2024-01-22T05:04:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.173+0000 7f2c7d600700 1 -- 172.21.15.49:0/3244728442 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c680059e0 con 0x7f2c800c1ac0 2024-01-22T05:04:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.173+0000 7f2c7d600700 1 -- 172.21.15.49:0/3244728442 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68005d60 con 0x7f2c800c1ac0 2024-01-22T05:04:59.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.173+0000 7f2c85a00700 1 -- 172.21.15.49:0/3244728442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c800c1ac0 msgr2=0x7f2c800bc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:59.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.173+0000 7f2c85a00700 1 --2- 172.21.15.49:0/3244728442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c800c1ac0 0x7f2c800bc490 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f2c80063be0 tx=0x7f2c68009060).stop 2024-01-22T05:04:59.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.173+0000 7f2c85a00700 1 -- 172.21.15.49:0/3244728442 shutdown_connections 2024-01-22T05:04:59.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.173+0000 7f2c85a00700 1 --2- 172.21.15.49:0/3244728442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c800c1ac0 0x7f2c800bc490 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.173+0000 7f2c85a00700 1 --2- 172.21.15.49:0/3244728442 >> v2:172.21.15.110:3300/0 conn(0x7f2c80153cf0 0x7f2c800c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.173+0000 7f2c85a00700 1 -- 172.21.15.49:0/3244728442 >> 172.21.15.49:0/3244728442 conn(0x7f2c80062cb0 msgr2=0x7f2c800c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:59.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.173+0000 7f2c85a00700 1 -- 172.21.15.49:0/3244728442 shutdown_connections 2024-01-22T05:04:59.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.173+0000 7f2c85a00700 1 -- 172.21.15.49:0/3244728442 wait complete. 2024-01-22T05:04:59.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.177+0000 7f2c85a00700 1 Processor -- start 2024-01-22T05:04:59.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.177+0000 7f2c85a00700 1 -- start start 2024-01-22T05:04:59.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c85a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c800bc980 0x7f2c80149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c85a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c800c1ac0 0x7f2c800a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c85a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c80153cf0 0x7f2c800a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c85a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c80149640 con 0x7f2c800bc980 2024-01-22T05:04:59.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c85a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c800a76d0 con 0x7f2c80153cf0 2024-01-22T05:04:59.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c85a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c800a4200 con 0x7f2c800c1ac0 2024-01-22T05:04:59.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c7ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c800bc980 0x7f2c80149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c7ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c800bc980 0x7f2c80149150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36418/0 (socket says 172.21.15.49:36418) 2024-01-22T05:04:59.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c7ea00700 1 -- 172.21.15.49:0/1162088532 learned_addr learned my addr 172.21.15.49:0/1162088532 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:59.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c7f400700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c80153cf0 0x7f2c800a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c7e000700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c800c1ac0 0x7f2c800a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c7ea00700 1 -- 172.21.15.49:0/1162088532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c800c1ac0 msgr2=0x7f2c800a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:59.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c7ea00700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c800c1ac0 0x7f2c800a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c7ea00700 1 -- 172.21.15.49:0/1162088532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c80153cf0 msgr2=0x7f2c800a9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:59.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c7ea00700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c80153cf0 0x7f2c800a9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c7ea00700 1 -- 172.21.15.49:0/1162088532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c68009300 con 0x7f2c800bc980 2024-01-22T05:04:59.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c7e000700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c800c1ac0 0x7f2c800a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:04:59.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c7f400700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c80153cf0 0x7f2c800a9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:04:59.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c7ea00700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c800bc980 0x7f2c80149150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f2c7000e900 tx=0x7f2c70009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:59.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c76000700 1 -- 172.21.15.49:0/1162088532 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000c640 con 0x7f2c800bc980 2024-01-22T05:04:59.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c76000700 1 -- 172.21.15.49:0/1162088532 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7000c7a0 con 0x7f2c800bc980 2024-01-22T05:04:59.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c85a00700 1 -- 172.21.15.49:0/1162088532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c800a44e0 con 0x7f2c800bc980 2024-01-22T05:04:59.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c76000700 1 -- 172.21.15.49:0/1162088532 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000cb20 con 0x7f2c800bc980 2024-01-22T05:04:59.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.181+0000 7f2c85a00700 1 -- 172.21.15.49:0/1162088532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c800a4aa0 con 0x7f2c800bc980 2024-01-22T05:04:59.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.185+0000 7f2c85a00700 1 -- 172.21.15.49:0/1162088532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c800a4cc0 con 0x7f2c800bc980 2024-01-22T05:04:59.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.185+0000 7f2c76000700 1 -- 172.21.15.49:0/1162088532 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2c7001b400 con 0x7f2c800bc980 2024-01-22T05:04:59.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.185+0000 7f2c76000700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c5805a510 0x7f2c5805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.185+0000 7f2c76000700 1 -- 172.21.15.49:0/1162088532 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f2c70074ed0 con 0x7f2c800bc980 2024-01-22T05:04:59.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.185+0000 7f2c7e000700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c5805a510 0x7f2c5805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.189+0000 7f2c7e000700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c5805a510 0x7f2c5805c9d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f2c801533f0 tx=0x7f2c68016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:59.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.193+0000 7f2c76000700 1 -- 172.21.15.49:0/1162088532 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2c70048340 con 0x7f2c800bc980 2024-01-22T05:04:59.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.369+0000 7f2c85a00700 1 -- 172.21.15.49:0/1162088532 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2c800c0c00 con 0x7f2c800bc980 2024-01-22T05:04:59.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.373+0000 7f2c76000700 1 -- 172.21.15.49:0/1162088532 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2c70016030 con 0x7f2c800bc980 2024-01-22T05:04:59.375 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:04:59.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.373+0000 7f2c85a00700 1 -- 172.21.15.49:0/1162088532 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c5805a510 msgr2=0x7f2c5805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:59.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.373+0000 7f2c85a00700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c5805a510 0x7f2c5805c9d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f2c801533f0 tx=0x7f2c68016000).stop 2024-01-22T05:04:59.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.373+0000 7f2c85a00700 1 -- 172.21.15.49:0/1162088532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c800bc980 msgr2=0x7f2c80149150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:59.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.373+0000 7f2c85a00700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c800bc980 0x7f2c80149150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f2c7000e900 tx=0x7f2c70009060).stop 2024-01-22T05:04:59.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.373+0000 7f2c85a00700 1 -- 172.21.15.49:0/1162088532 shutdown_connections 2024-01-22T05:04:59.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.377+0000 7f2c85a00700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c5805a510 0x7f2c5805c9d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.377+0000 7f2c85a00700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c80153cf0 0x7f2c800a9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.377+0000 7f2c85a00700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c800c1ac0 0x7f2c800a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.377+0000 7f2c85a00700 1 --2- 172.21.15.49:0/1162088532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c800bc980 0x7f2c80149150 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.377+0000 7f2c85a00700 1 -- 172.21.15.49:0/1162088532 >> 172.21.15.49:0/1162088532 conn(0x7f2c80062cb0 msgr2=0x7f2c800c5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:59.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.377+0000 7f2c85a00700 1 -- 172.21.15.49:0/1162088532 shutdown_connections 2024-01-22T05:04:59.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.377+0000 7f2c85a00700 1 -- 172.21.15.49:0/1162088532 wait complete. 2024-01-22T05:04:59.402 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:04:59.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.561+0000 7f15cee00700 1 Processor -- start 2024-01-22T05:04:59.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.561+0000 7f15cee00700 1 -- start start 2024-01-22T05:04:59.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15cee00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f15c8067a90 0x7f15c80a87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15cee00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15c80a8cd0 0x7f15c8151a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15cee00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c80659a0 con 0x7f15c8151f30 2024-01-22T05:04:59.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15cee00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c80a9130 con 0x7f15c80a8cd0 2024-01-22T05:04:59.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15cee00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c8152930 con 0x7f15c8067a90 2024-01-22T05:04:59.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15ce400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f15c8151f30 0x7f15c8065e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34072/0 (socket says 172.21.15.49:34072) 2024-01-22T05:04:59.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15ce400700 1 -- 172.21.15.49:0/2457524726 learned_addr learned my addr 172.21.15.49:0/2457524726 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:04:59.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15cd000700 1 --2- 172.21.15.49:0/2457524726 >> v2:172.21.15.49:3300/0 conn(0x7f15c80a8cd0 0x7f15c8151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15cda00700 1 --2- 172.21.15.49:0/2457524726 >> v2:172.21.15.110:3300/0 conn(0x7f15c8067a90 0x7f15c80a87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15c7e00700 1 -- 172.21.15.49:0/2457524726 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171693772 0 0) 0x7f15c80659a0 con 0x7f15c8151f30 2024-01-22T05:04:59.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15c7e00700 1 -- 172.21.15.49:0/2457524726 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a80033f0 con 0x7f15c8151f30 2024-01-22T05:04:59.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15cda00700 1 -- 172.21.15.49:0/2457524726 >> v2:172.21.15.49:3300/0 conn(0x7f15c80a8cd0 msgr2=0x7f15c8151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:59.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15cda00700 1 --2- 172.21.15.49:0/2457524726 >> v2:172.21.15.49:3300/0 conn(0x7f15c80a8cd0 0x7f15c8151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15cda00700 1 -- 172.21.15.49:0/2457524726 >> v1:172.21.15.49:6789/0 conn(0x7f15c8151f30 legacy=0x7f15c8065e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:59.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15cda00700 1 -- 172.21.15.49:0/2457524726 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c8152c10 con 0x7f15c8067a90 2024-01-22T05:04:59.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.565+0000 7f15cda00700 1 --2- 172.21.15.49:0/2457524726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8067a90 0x7f15c80a87e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f15c80c75a0 tx=0x7f15b8006f40).ready entity=mon.1 client_cookie=28714de52b9d5ffa server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:59.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.569+0000 7f15c7e00700 1 -- 172.21.15.49:0/2457524726 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8005880 con 0x7f15c8067a90 2024-01-22T05:04:59.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.569+0000 7f15c7e00700 1 -- 172.21.15.49:0/2457524726 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b80059e0 con 0x7f15c8067a90 2024-01-22T05:04:59.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.569+0000 7f15c7e00700 1 -- 172.21.15.49:0/2457524726 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8005d60 con 0x7f15c8067a90 2024-01-22T05:04:59.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.569+0000 7f15cee00700 1 -- 172.21.15.49:0/2457524726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8067a90 msgr2=0x7f15c80a87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:59.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.569+0000 7f15cee00700 1 --2- 172.21.15.49:0/2457524726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8067a90 0x7f15c80a87e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f15c80c75a0 tx=0x7f15b8006f40).stop 2024-01-22T05:04:59.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.569+0000 7f15cee00700 1 -- 172.21.15.49:0/2457524726 shutdown_connections 2024-01-22T05:04:59.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.569+0000 7f15cee00700 1 --2- 172.21.15.49:0/2457524726 >> v2:172.21.15.49:3300/0 conn(0x7f15c80a8cd0 0x7f15c8151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.569+0000 7f15cee00700 1 --2- 172.21.15.49:0/2457524726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8067a90 0x7f15c80a87e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.569+0000 7f15cee00700 1 -- 172.21.15.49:0/2457524726 >> 172.21.15.49:0/2457524726 conn(0x7f15c80c6fc0 msgr2=0x7f15c80c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:59.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.569+0000 7f15cee00700 1 -- 172.21.15.49:0/2457524726 shutdown_connections 2024-01-22T05:04:59.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.569+0000 7f15cee00700 1 -- 172.21.15.49:0/2457524726 wait complete. 2024-01-22T05:04:59.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.573+0000 7f15cee00700 1 Processor -- start 2024-01-22T05:04:59.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.573+0000 7f15cee00700 1 -- start start 2024-01-22T05:04:59.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.573+0000 7f15cee00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c8067a90 0x7f15c814c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.573+0000 7f15cee00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15c80a8cd0 0x7f15c80a8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.573+0000 7f15cee00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8151f30 0x7f15c8157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.573+0000 7f15cee00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c80c62a0 con 0x7f15c8067a90 2024-01-22T05:04:59.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.573+0000 7f15cee00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c80a8a20 con 0x7f15c8151f30 2024-01-22T05:04:59.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.573+0000 7f15cee00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c8165110 con 0x7f15c80a8cd0 2024-01-22T05:04:59.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.573+0000 7f15cda00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c8067a90 0x7f15c814c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.573+0000 7f15cd000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15c80a8cd0 0x7f15c80a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.573+0000 7f15cda00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c8067a90 0x7f15c814c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36444/0 (socket says 172.21.15.49:36444) 2024-01-22T05:04:59.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.573+0000 7f15cda00700 1 -- 172.21.15.49:0/888515900 learned_addr learned my addr 172.21.15.49:0/888515900 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:59.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.573+0000 7f15ce400700 1 --2- 172.21.15.49:0/888515900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8151f30 0x7f15c8157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.577+0000 7f15cda00700 1 -- 172.21.15.49:0/888515900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15c80a8cd0 msgr2=0x7f15c80a8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:59.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.577+0000 7f15cda00700 1 --2- 172.21.15.49:0/888515900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15c80a8cd0 0x7f15c80a8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.577+0000 7f15cda00700 1 -- 172.21.15.49:0/888515900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8151f30 msgr2=0x7f15c8157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:59.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.577+0000 7f15cda00700 1 --2- 172.21.15.49:0/888515900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8151f30 0x7f15c8157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.577+0000 7f15cda00700 1 -- 172.21.15.49:0/888515900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b8009250 con 0x7f15c8067a90 2024-01-22T05:04:59.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.577+0000 7f15cda00700 1 --2- 172.21.15.49:0/888515900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c8067a90 0x7f15c814c0d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f15b8005fd0 tx=0x7f15b8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:59.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.577+0000 7f15c4c00700 1 -- 172.21.15.49:0/888515900 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8006bb0 con 0x7f15c8067a90 2024-01-22T05:04:59.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.577+0000 7f15c4c00700 1 -- 172.21.15.49:0/888515900 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b800d6b0 con 0x7f15c8067a90 2024-01-22T05:04:59.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.577+0000 7f15cee00700 1 -- 172.21.15.49:0/888515900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c81653f0 con 0x7f15c8067a90 2024-01-22T05:04:59.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.577+0000 7f15c4c00700 1 -- 172.21.15.49:0/888515900 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b800da30 con 0x7f15c8067a90 2024-01-22T05:04:59.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.577+0000 7f15cee00700 1 -- 172.21.15.49:0/888515900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c81659b0 con 0x7f15c8067a90 2024-01-22T05:04:59.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.577+0000 7f15cee00700 1 -- 172.21.15.49:0/888515900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c80a9610 con 0x7f15c8067a90 2024-01-22T05:04:59.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.581+0000 7f15c4c00700 1 -- 172.21.15.49:0/888515900 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f15b801e460 con 0x7f15c8067a90 2024-01-22T05:04:59.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.581+0000 7f15c4c00700 1 --2- 172.21.15.49:0/888515900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f15a005a4e0 0x7f15a005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.581+0000 7f15c4c00700 1 -- 172.21.15.49:0/888515900 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f15b8075eb0 con 0x7f15c8067a90 2024-01-22T05:04:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.581+0000 7f15cd000700 1 --2- 172.21.15.49:0/888515900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f15a005a4e0 0x7f15a005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.581+0000 7f15cd000700 1 --2- 172.21.15.49:0/888515900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f15a005a4e0 0x7f15a005c9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f15c80a7dc0 tx=0x7f15b0009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:59.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.585+0000 7f15c4c00700 1 -- 172.21.15.49:0/888515900 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f15b8049310 con 0x7f15c8067a90 2024-01-22T05:04:59.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.749+0000 7f15cee00700 1 -- 172.21.15.49:0/888515900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f15c8047060 con 0x7f15c8067a90 2024-01-22T05:04:59.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.749+0000 7f15c4c00700 1 -- 172.21.15.49:0/888515900 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f15b8023030 con 0x7f15c8067a90 2024-01-22T05:04:59.751 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:04:59.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.749+0000 7f15cee00700 1 -- 172.21.15.49:0/888515900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f15a005a4e0 msgr2=0x7f15a005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:59.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.749+0000 7f15cee00700 1 --2- 172.21.15.49:0/888515900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f15a005a4e0 0x7f15a005c9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f15c80a7dc0 tx=0x7f15b0009060).stop 2024-01-22T05:04:59.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.749+0000 7f15cee00700 1 -- 172.21.15.49:0/888515900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c8067a90 msgr2=0x7f15c814c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:59.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.749+0000 7f15cee00700 1 --2- 172.21.15.49:0/888515900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c8067a90 0x7f15c814c0d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f15b8005fd0 tx=0x7f15b8015000).stop 2024-01-22T05:04:59.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.753+0000 7f15cee00700 1 -- 172.21.15.49:0/888515900 shutdown_connections 2024-01-22T05:04:59.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.753+0000 7f15cee00700 1 --2- 172.21.15.49:0/888515900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f15a005a4e0 0x7f15a005c9a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.753+0000 7f15cee00700 1 --2- 172.21.15.49:0/888515900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8151f30 0x7f15c8157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.753+0000 7f15cee00700 1 --2- 172.21.15.49:0/888515900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15c80a8cd0 0x7f15c80a8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.753+0000 7f15cee00700 1 --2- 172.21.15.49:0/888515900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c8067a90 0x7f15c814c0d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.753+0000 7f15cee00700 1 -- 172.21.15.49:0/888515900 >> 172.21.15.49:0/888515900 conn(0x7f15c80c6fc0 msgr2=0x7f15c8065d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:59.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.753+0000 7f15cee00700 1 -- 172.21.15.49:0/888515900 shutdown_connections 2024-01-22T05:04:59.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.753+0000 7f15cee00700 1 -- 172.21.15.49:0/888515900 wait complete. 2024-01-22T05:04:59.779 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:04:59.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.941+0000 7f758be00700 1 Processor -- start 2024-01-22T05:04:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.941+0000 7f758be00700 1 -- start start 2024-01-22T05:04:59.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f758be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75840c1ce0 0x7f75840bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f758be00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f75840bc9c0 0x7f7584068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f758be00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7584158650 con 0x7f75840a8c20 2024-01-22T05:04:59.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f758be00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75840bd170 con 0x7f75840c1ce0 2024-01-22T05:04:59.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f758be00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7584067c30 con 0x7f75840bc9c0 2024-01-22T05:04:59.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f7588a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75840c1ce0 0x7f75840bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f7588a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75840c1ce0 0x7f75840bc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36450/0 (socket says 172.21.15.49:36450) 2024-01-22T05:04:59.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f7588a00700 1 -- 172.21.15.49:0/2335914455 learned_addr learned my addr 172.21.15.49:0/2335914455 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:59.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f7589e00700 1 --2- 172.21.15.49:0/2335914455 >> v2:172.21.15.110:3300/0 conn(0x7f75840bc9c0 0x7f7584068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f7588a00700 1 -- 172.21.15.49:0/2335914455 >> v2:172.21.15.110:3300/0 conn(0x7f75840bc9c0 msgr2=0x7f7584068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:59.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f7588a00700 1 --2- 172.21.15.49:0/2335914455 >> v2:172.21.15.110:3300/0 conn(0x7f75840bc9c0 0x7f7584068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f7588a00700 1 -- 172.21.15.49:0/2335914455 >> v1:172.21.15.110:6789/0 conn(0x7f75840a8c20 legacy=0x7f75840c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:04:59.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f7588a00700 1 -- 172.21.15.49:0/2335914455 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7584067f10 con 0x7f75840c1ce0 2024-01-22T05:04:59.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f7589e00700 1 --2- 172.21.15.49:0/2335914455 >> v2:172.21.15.110:3300/0 conn(0x7f75840bc9c0 0x7f7584068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:04:59.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f7588a00700 1 --2- 172.21.15.49:0/2335914455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75840c1ce0 0x7f75840bc4d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f75840c72f0 tx=0x7f756c009060).ready entity=mon.0 client_cookie=b1ec54c7ddb59d82 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:59.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f7583e00700 1 -- 172.21.15.49:0/2335914455 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c005880 con 0x7f75840c1ce0 2024-01-22T05:04:59.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f7583e00700 1 -- 172.21.15.49:0/2335914455 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c0059e0 con 0x7f75840c1ce0 2024-01-22T05:04:59.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.945+0000 7f7583e00700 1 -- 172.21.15.49:0/2335914455 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c005d60 con 0x7f75840c1ce0 2024-01-22T05:04:59.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.949+0000 7f758be00700 1 -- 172.21.15.49:0/2335914455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75840c1ce0 msgr2=0x7f75840bc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:59.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.949+0000 7f758be00700 1 --2- 172.21.15.49:0/2335914455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75840c1ce0 0x7f75840bc4d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f75840c72f0 tx=0x7f756c009060).stop 2024-01-22T05:04:59.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.949+0000 7f758be00700 1 -- 172.21.15.49:0/2335914455 shutdown_connections 2024-01-22T05:04:59.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.949+0000 7f758be00700 1 --2- 172.21.15.49:0/2335914455 >> v2:172.21.15.110:3300/0 conn(0x7f75840bc9c0 0x7f7584068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.949+0000 7f758be00700 1 --2- 172.21.15.49:0/2335914455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75840c1ce0 0x7f75840bc4d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.949+0000 7f758be00700 1 -- 172.21.15.49:0/2335914455 >> 172.21.15.49:0/2335914455 conn(0x7f7584062cb0 msgr2=0x7f75840c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:04:59.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.949+0000 7f758be00700 1 -- 172.21.15.49:0/2335914455 shutdown_connections 2024-01-22T05:04:59.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.949+0000 7f758be00700 1 -- 172.21.15.49:0/2335914455 wait complete. 2024-01-22T05:04:59.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.953+0000 7f758be00700 1 Processor -- start 2024-01-22T05:04:59.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.953+0000 7f758be00700 1 -- start start 2024-01-22T05:04:59.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.953+0000 7f758be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75840a8c20 0x7f75840be220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.953+0000 7f758be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75840bc9c0 0x7f758415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.953+0000 7f758be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75840c1ce0 0x7f758415c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.953+0000 7f758be00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75840bf320 con 0x7f75840c1ce0 2024-01-22T05:04:59.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.953+0000 7f758be00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758415ece0 con 0x7f75840bc9c0 2024-01-22T05:04:59.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.953+0000 7f758be00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758415ca60 con 0x7f75840a8c20 2024-01-22T05:04:59.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.953+0000 7f7589e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75840c1ce0 0x7f758415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.953+0000 7f7589e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75840c1ce0 0x7f758415c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36464/0 (socket says 172.21.15.49:36464) 2024-01-22T05:04:59.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.953+0000 7f7589e00700 1 -- 172.21.15.49:0/265202377 learned_addr learned my addr 172.21.15.49:0/265202377 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:04:59.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.953+0000 7f7589400700 1 --2- 172.21.15.49:0/265202377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75840a8c20 0x7f75840be220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.953+0000 7f7588a00700 1 --2- 172.21.15.49:0/265202377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75840bc9c0 0x7f758415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.957+0000 7f7589e00700 1 -- 172.21.15.49:0/265202377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75840a8c20 msgr2=0x7f75840be220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:59.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.957+0000 7f7589e00700 1 --2- 172.21.15.49:0/265202377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75840a8c20 0x7f75840be220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.957+0000 7f7589e00700 1 -- 172.21.15.49:0/265202377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75840bc9c0 msgr2=0x7f758415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:04:59.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.957+0000 7f7589e00700 1 --2- 172.21.15.49:0/265202377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75840bc9c0 0x7f758415e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:04:59.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.957+0000 7f7589e00700 1 -- 172.21.15.49:0/265202377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c009300 con 0x7f75840c1ce0 2024-01-22T05:04:59.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.957+0000 7f7589e00700 1 --2- 172.21.15.49:0/265202377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75840c1ce0 0x7f758415c210 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f757c00a380 tx=0x7f757c007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:59.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.957+0000 7f7580c00700 1 -- 172.21.15.49:0/265202377 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c016470 con 0x7f75840c1ce0 2024-01-22T05:04:59.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.957+0000 7f7580c00700 1 -- 172.21.15.49:0/265202377 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c0165d0 con 0x7f75840c1ce0 2024-01-22T05:04:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.957+0000 7f758be00700 1 -- 172.21.15.49:0/265202377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758415cd40 con 0x7f75840c1ce0 2024-01-22T05:04:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.957+0000 7f7580c00700 1 -- 172.21.15.49:0/265202377 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c016950 con 0x7f75840c1ce0 2024-01-22T05:04:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.957+0000 7f758be00700 1 -- 172.21.15.49:0/265202377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758415d300 con 0x7f75840c1ce0 2024-01-22T05:04:59.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.957+0000 7f758be00700 1 -- 172.21.15.49:0/265202377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75840bf4d0 con 0x7f75840c1ce0 2024-01-22T05:04:59.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.961+0000 7f7580c00700 1 -- 172.21.15.49:0/265202377 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f757c013070 con 0x7f75840c1ce0 2024-01-22T05:04:59.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.961+0000 7f7580c00700 1 --2- 172.21.15.49:0/265202377 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f755c05a560 0x7f755c05ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:04:59.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.961+0000 7f7580c00700 1 -- 172.21.15.49:0/265202377 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f757c075520 con 0x7f75840c1ce0 2024-01-22T05:04:59.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.961+0000 7f7589400700 1 --2- 172.21.15.49:0/265202377 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f755c05a560 0x7f755c05ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:04:59.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.961+0000 7f7589400700 1 --2- 172.21.15.49:0/265202377 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f755c05a560 0x7f755c05ca20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f758415a9e0 tx=0x7f7574008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:04:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:04:59.965+0000 7f7580c00700 1 -- 172.21.15.49:0/265202377 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f75840bf4d0 con 0x7f75840c1ce0 2024-01-22T05:05:00.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.129+0000 7f758be00700 1 -- 172.21.15.49:0/265202377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75840bf4d0 con 0x7f75840c1ce0 2024-01-22T05:05:00.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.133+0000 7f7580c00700 1 -- 172.21.15.49:0/265202377 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f75840bf4d0 con 0x7f75840c1ce0 2024-01-22T05:05:00.135 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:05:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.137+0000 7f758be00700 1 -- 172.21.15.49:0/265202377 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f755c05a560 msgr2=0x7f755c05ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.137+0000 7f758be00700 1 --2- 172.21.15.49:0/265202377 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f755c05a560 0x7f755c05ca20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f758415a9e0 tx=0x7f7574008040).stop 2024-01-22T05:05:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.137+0000 7f758be00700 1 -- 172.21.15.49:0/265202377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75840c1ce0 msgr2=0x7f758415c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.137+0000 7f758be00700 1 --2- 172.21.15.49:0/265202377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75840c1ce0 0x7f758415c210 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f757c00a380 tx=0x7f757c007900).stop 2024-01-22T05:05:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.137+0000 7f758be00700 1 -- 172.21.15.49:0/265202377 shutdown_connections 2024-01-22T05:05:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.137+0000 7f758be00700 1 --2- 172.21.15.49:0/265202377 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f755c05a560 0x7f755c05ca20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.137+0000 7f758be00700 1 --2- 172.21.15.49:0/265202377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75840c1ce0 0x7f758415c210 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.137+0000 7f758be00700 1 --2- 172.21.15.49:0/265202377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75840bc9c0 0x7f758415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.137+0000 7f758be00700 1 --2- 172.21.15.49:0/265202377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75840a8c20 0x7f75840be220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.137+0000 7f758be00700 1 -- 172.21.15.49:0/265202377 >> 172.21.15.49:0/265202377 conn(0x7f7584062cb0 msgr2=0x7f75840bba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.137+0000 7f758be00700 1 -- 172.21.15.49:0/265202377 shutdown_connections 2024-01-22T05:05:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.137+0000 7f758be00700 1 -- 172.21.15.49:0/265202377 wait complete. 2024-01-22T05:05:00.162 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:05:00.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.329+0000 7f6801e00700 1 Processor -- start 2024-01-22T05:05:00.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.329+0000 7f6801e00700 1 -- start start 2024-01-22T05:05:00.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.333+0000 7f6801e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67fc151c60 0x7f67fc0a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:00.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.333+0000 7f6801e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f67fc0a7730 0x7f67fc0a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:00.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.333+0000 7f6801e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f67fc0be910 0x7f67fc0bed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:00.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.333+0000 7f6801e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67fc0bd900 con 0x7f67fc0be910 2024-01-22T05:05:00.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.333+0000 7f6801e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67fc0be480 con 0x7f67fc0a7730 2024-01-22T05:05:00.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.333+0000 7f6801e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc0bdb50 con 0x7f67fc151c60 2024-01-22T05:05:00.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.333+0000 7f6801400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f67fc0be910 0x7f67fc0bed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:00.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.333+0000 7f6801400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f67fc0be910 0x7f67fc0bed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36474/0 (socket says 172.21.15.49:36474) 2024-01-22T05:05:00.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.333+0000 7f6800a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67fc151c60 0x7f67fc0a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:00.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.333+0000 7f6801400700 1 -- 172.21.15.49:0/153385301 learned_addr learned my addr 172.21.15.49:0/153385301 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:00.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.333+0000 7f67fbe00700 1 --2- 172.21.15.49:0/153385301 >> v2:172.21.15.110:3300/0 conn(0x7f67fc0a7730 0x7f67fc0a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:00.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f6801400700 1 -- 172.21.15.49:0/153385301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67fc151c60 msgr2=0x7f67fc0a85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:00.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f6801400700 1 --2- 172.21.15.49:0/153385301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67fc151c60 0x7f67fc0a85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f6801400700 1 -- 172.21.15.49:0/153385301 >> v2:172.21.15.110:3300/0 conn(0x7f67fc0a7730 msgr2=0x7f67fc0a7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:00.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f6801400700 1 --2- 172.21.15.49:0/153385301 >> v2:172.21.15.110:3300/0 conn(0x7f67fc0a7730 0x7f67fc0a7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f6801400700 1 -- 172.21.15.49:0/153385301 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc0bde30 con 0x7f67fc0be910 2024-01-22T05:05:00.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f6801400700 1 --2- 172.21.15.49:0/153385301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67fc0be910 0x7f67fc0bed40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f67fc067350 tx=0x7f67f4009840).ready entity=mon.0 client_cookie=e94a1875d9f2f3e5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:00.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f67fb400700 1 -- 172.21.15.49:0/153385301 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f400e070 con 0x7f67fc0be910 2024-01-22T05:05:00.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f67fb400700 1 -- 172.21.15.49:0/153385301 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f400b970 con 0x7f67fc0be910 2024-01-22T05:05:00.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f67fb400700 1 -- 172.21.15.49:0/153385301 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f400bcf0 con 0x7f67fc0be910 2024-01-22T05:05:00.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f6801e00700 1 -- 172.21.15.49:0/153385301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67fc0be910 msgr2=0x7f67fc0bed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:00.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f6801e00700 1 --2- 172.21.15.49:0/153385301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67fc0be910 0x7f67fc0bed40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f67fc067350 tx=0x7f67f4009840).stop 2024-01-22T05:05:00.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f6801e00700 1 -- 172.21.15.49:0/153385301 shutdown_connections 2024-01-22T05:05:00.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f6801e00700 1 --2- 172.21.15.49:0/153385301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67fc0be910 0x7f67fc0bed40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f6801e00700 1 --2- 172.21.15.49:0/153385301 >> v2:172.21.15.110:3300/0 conn(0x7f67fc0a7730 0x7f67fc0a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f6801e00700 1 --2- 172.21.15.49:0/153385301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67fc151c60 0x7f67fc0a85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f6801e00700 1 -- 172.21.15.49:0/153385301 >> 172.21.15.49:0/153385301 conn(0x7f67fc0c8740 msgr2=0x7f67fc0c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:00.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f6801e00700 1 -- 172.21.15.49:0/153385301 shutdown_connections 2024-01-22T05:05:00.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.337+0000 7f6801e00700 1 -- 172.21.15.49:0/153385301 wait complete. 2024-01-22T05:05:00.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.341+0000 7f6801e00700 1 Processor -- start 2024-01-22T05:05:00.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.345+0000 7f6801e00700 1 -- start start 2024-01-22T05:05:00.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.345+0000 7f6801e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67fc0a7730 0x7f67fc0c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:00.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.345+0000 7f6801e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67fc0be910 0x7f67fc140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:00.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.345+0000 7f6801e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67fc151c60 0x7f67fc14fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:00.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.345+0000 7f6801e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc0c1f70 con 0x7f67fc0a7730 2024-01-22T05:05:00.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.345+0000 7f6801e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc168780 con 0x7f67fc0be910 2024-01-22T05:05:00.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.345+0000 7f6801e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc167b70 con 0x7f67fc151c60 2024-01-22T05:05:00.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.345+0000 7f6800a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67fc0a7730 0x7f67fc0c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:00.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.345+0000 7f6800a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67fc0a7730 0x7f67fc0c2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36486/0 (socket says 172.21.15.49:36486) 2024-01-22T05:05:00.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.345+0000 7f6800a00700 1 -- 172.21.15.49:0/581702877 learned_addr learned my addr 172.21.15.49:0/581702877 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:00.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.345+0000 7f6801400700 1 --2- 172.21.15.49:0/581702877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67fc151c60 0x7f67fc14fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:00.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.345+0000 7f67fbe00700 1 --2- 172.21.15.49:0/581702877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67fc0be910 0x7f67fc140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:00.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.345+0000 7f6800a00700 1 -- 172.21.15.49:0/581702877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67fc151c60 msgr2=0x7f67fc14fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:00.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.345+0000 7f6800a00700 1 --2- 172.21.15.49:0/581702877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67fc151c60 0x7f67fc14fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.349+0000 7f6800a00700 1 -- 172.21.15.49:0/581702877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67fc0be910 msgr2=0x7f67fc140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:00.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.349+0000 7f6800a00700 1 --2- 172.21.15.49:0/581702877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67fc0be910 0x7f67fc140180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.349+0000 7f6800a00700 1 -- 172.21.15.49:0/581702877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f4009ae0 con 0x7f67fc0a7730 2024-01-22T05:05:00.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.349+0000 7f6800a00700 1 --2- 172.21.15.49:0/581702877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67fc0a7730 0x7f67fc0c2480 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f67ec00e900 tx=0x7f67ec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:00.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.349+0000 7f67f3e00700 1 -- 172.21.15.49:0/581702877 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec009390 con 0x7f67fc0a7730 2024-01-22T05:05:00.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.349+0000 7f67f3e00700 1 -- 172.21.15.49:0/581702877 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec012600 con 0x7f67fc0a7730 2024-01-22T05:05:00.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.349+0000 7f6801e00700 1 -- 172.21.15.49:0/581702877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67fc167e50 con 0x7f67fc0a7730 2024-01-22T05:05:00.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.349+0000 7f67f3e00700 1 -- 172.21.15.49:0/581702877 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec012980 con 0x7f67fc0a7730 2024-01-22T05:05:00.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.349+0000 7f6801e00700 1 -- 172.21.15.49:0/581702877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67fc168410 con 0x7f67fc0a7730 2024-01-22T05:05:00.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.349+0000 7f6801e00700 1 -- 172.21.15.49:0/581702877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67fc066520 con 0x7f67fc0a7730 2024-01-22T05:05:00.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.353+0000 7f67f3e00700 1 -- 172.21.15.49:0/581702877 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f67ec012d30 con 0x7f67fc0a7730 2024-01-22T05:05:00.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.353+0000 7f67f3e00700 1 --2- 172.21.15.49:0/581702877 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f67d405a510 0x7f67d405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:00.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.353+0000 7f67f3e00700 1 -- 172.21.15.49:0/581702877 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f67ec074d30 con 0x7f67fc0a7730 2024-01-22T05:05:00.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.353+0000 7f67fbe00700 1 --2- 172.21.15.49:0/581702877 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f67d405a510 0x7f67d405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:00.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.353+0000 7f67fbe00700 1 --2- 172.21.15.49:0/581702877 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f67d405a510 0x7f67d405c9d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f67fc0643a0 tx=0x7f67e4009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.361+0000 7f67f3e00700 1 -- 172.21.15.49:0/581702877 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f67ec048140 con 0x7f67fc0a7730 2024-01-22T05:05:00.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.521+0000 7f6801e00700 1 -- 172.21.15.49:0/581702877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67fc0aada0 con 0x7f67fc0a7730 2024-01-22T05:05:00.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.525+0000 7f67f3e00700 1 -- 172.21.15.49:0/581702877 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f67ec04b760 con 0x7f67fc0a7730 2024-01-22T05:05:00.526 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:05:00.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.529+0000 7f6801e00700 1 -- 172.21.15.49:0/581702877 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f67d405a510 msgr2=0x7f67d405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:00.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.529+0000 7f6801e00700 1 --2- 172.21.15.49:0/581702877 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f67d405a510 0x7f67d405c9d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f67fc0643a0 tx=0x7f67e4009060).stop 2024-01-22T05:05:00.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.529+0000 7f6801e00700 1 -- 172.21.15.49:0/581702877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67fc0a7730 msgr2=0x7f67fc0c2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.529+0000 7f6801e00700 1 --2- 172.21.15.49:0/581702877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67fc0a7730 0x7f67fc0c2480 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f67ec00e900 tx=0x7f67ec009060).stop 2024-01-22T05:05:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.529+0000 7f6801e00700 1 -- 172.21.15.49:0/581702877 shutdown_connections 2024-01-22T05:05:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.529+0000 7f6801e00700 1 --2- 172.21.15.49:0/581702877 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f67d405a510 0x7f67d405c9d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.529+0000 7f6801e00700 1 --2- 172.21.15.49:0/581702877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67fc151c60 0x7f67fc14fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.529+0000 7f6801e00700 1 --2- 172.21.15.49:0/581702877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67fc0be910 0x7f67fc140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.529+0000 7f6801e00700 1 --2- 172.21.15.49:0/581702877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67fc0a7730 0x7f67fc0c2480 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.529+0000 7f6801e00700 1 -- 172.21.15.49:0/581702877 >> 172.21.15.49:0/581702877 conn(0x7f67fc0c8740 msgr2=0x7f67fc062230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.529+0000 7f6801e00700 1 -- 172.21.15.49:0/581702877 shutdown_connections 2024-01-22T05:05:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.529+0000 7f6801e00700 1 -- 172.21.15.49:0/581702877 wait complete. 2024-01-22T05:05:00.552 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-22T05:05:00.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.725+0000 7f4e97600700 1 Processor -- start 2024-01-22T05:05:00.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.725+0000 7f4e97600700 1 -- start start 2024-01-22T05:05:00.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e97600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4e90153cf0 0x7f4e900c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:00.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e97600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e900c1ac0 0x7f4e900bc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:00.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e97600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4e900bc980 0x7f4e90068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:00.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e97600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e90068280 con 0x7f4e90153cf0 2024-01-22T05:05:00.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e97600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e900c1f00 con 0x7f4e900bc980 2024-01-22T05:05:00.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e97600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900bd190 con 0x7f4e900c1ac0 2024-01-22T05:05:00.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e94c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4e90153cf0 0x7f4e900c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:00.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e8fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e900c1ac0 0x7f4e900bc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:00.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e94c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4e90153cf0 0x7f4e900c15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36498/0 (socket says 172.21.15.49:36498) 2024-01-22T05:05:00.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e94c00700 1 -- 172.21.15.49:0/3373396521 learned_addr learned my addr 172.21.15.49:0/3373396521 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:00.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e95600700 1 --2- 172.21.15.49:0/3373396521 >> v2:172.21.15.110:3300/0 conn(0x7f4e900bc980 0x7f4e90068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:00.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e94c00700 1 -- 172.21.15.49:0/3373396521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e900c1ac0 msgr2=0x7f4e900bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:00.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e94c00700 1 --2- 172.21.15.49:0/3373396521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e900c1ac0 0x7f4e900bc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e94c00700 1 -- 172.21.15.49:0/3373396521 >> v2:172.21.15.110:3300/0 conn(0x7f4e900bc980 msgr2=0x7f4e90068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:00.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e94c00700 1 --2- 172.21.15.49:0/3373396521 >> v2:172.21.15.110:3300/0 conn(0x7f4e900bc980 0x7f4e90068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e94c00700 1 -- 172.21.15.49:0/3373396521 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e90067c30 con 0x7f4e90153cf0 2024-01-22T05:05:00.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e95600700 1 --2- 172.21.15.49:0/3373396521 >> v2:172.21.15.110:3300/0 conn(0x7f4e900bc980 0x7f4e90068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:00.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.729+0000 7f4e94c00700 1 --2- 172.21.15.49:0/3373396521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e90153cf0 0x7f4e900c15d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f4e90064de0 tx=0x7f4e800090f0).ready entity=mon.0 client_cookie=dbf9fa278147f80c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:00.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.733+0000 7f4e8f400700 1 -- 172.21.15.49:0/3373396521 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8000b5b0 con 0x7f4e90153cf0 2024-01-22T05:05:00.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.733+0000 7f4e8f400700 1 -- 172.21.15.49:0/3373396521 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8000b710 con 0x7f4e90153cf0 2024-01-22T05:05:00.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.733+0000 7f4e8f400700 1 -- 172.21.15.49:0/3373396521 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8000ba90 con 0x7f4e90153cf0 2024-01-22T05:05:00.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.733+0000 7f4e97600700 1 -- 172.21.15.49:0/3373396521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e90153cf0 msgr2=0x7f4e900c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:00.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.733+0000 7f4e97600700 1 --2- 172.21.15.49:0/3373396521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e90153cf0 0x7f4e900c15d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f4e90064de0 tx=0x7f4e800090f0).stop 2024-01-22T05:05:00.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.733+0000 7f4e97600700 1 -- 172.21.15.49:0/3373396521 shutdown_connections 2024-01-22T05:05:00.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.733+0000 7f4e97600700 1 --2- 172.21.15.49:0/3373396521 >> v2:172.21.15.110:3300/0 conn(0x7f4e900bc980 0x7f4e90068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.733+0000 7f4e97600700 1 --2- 172.21.15.49:0/3373396521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e900c1ac0 0x7f4e900bc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.733+0000 7f4e97600700 1 --2- 172.21.15.49:0/3373396521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e90153cf0 0x7f4e900c15d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.733+0000 7f4e97600700 1 -- 172.21.15.49:0/3373396521 >> 172.21.15.49:0/3373396521 conn(0x7f4e90062cb0 msgr2=0x7f4e900c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:00.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.733+0000 7f4e97600700 1 -- 172.21.15.49:0/3373396521 shutdown_connections 2024-01-22T05:05:00.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.733+0000 7f4e97600700 1 -- 172.21.15.49:0/3373396521 wait complete. 2024-01-22T05:05:00.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.737+0000 7f4e97600700 1 Processor -- start 2024-01-22T05:05:00.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.737+0000 7f4e97600700 1 -- start start 2024-01-22T05:05:00.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.737+0000 7f4e97600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e900bc980 0x7f4e90165200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:00.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.737+0000 7f4e97600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e900c1ac0 0x7f4e900a42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:00.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.737+0000 7f4e97600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e90153cf0 0x7f4e900a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:00.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.737+0000 7f4e97600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e901656f0 con 0x7f4e900c1ac0 2024-01-22T05:05:00.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.737+0000 7f4e97600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900a4c80 con 0x7f4e900bc980 2024-01-22T05:05:00.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.737+0000 7f4e97600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e90156350 con 0x7f4e90153cf0 2024-01-22T05:05:00.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.737+0000 7f4e8fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e900c1ac0 0x7f4e900a42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:00.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.737+0000 7f4e8fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e900c1ac0 0x7f4e900a42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36502/0 (socket says 172.21.15.49:36502) 2024-01-22T05:05:00.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.737+0000 7f4e8fe00700 1 -- 172.21.15.49:0/1209751975 learned_addr learned my addr 172.21.15.49:0/1209751975 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:00.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.737+0000 7f4e94c00700 1 --2- 172.21.15.49:0/1209751975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e900bc980 0x7f4e90165200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:00.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.737+0000 7f4e95600700 1 --2- 172.21.15.49:0/1209751975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e90153cf0 0x7f4e900a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:00.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.741+0000 7f4e8fe00700 1 -- 172.21.15.49:0/1209751975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e90153cf0 msgr2=0x7f4e900a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:00.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.741+0000 7f4e8fe00700 1 --2- 172.21.15.49:0/1209751975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e90153cf0 0x7f4e900a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.741+0000 7f4e8fe00700 1 -- 172.21.15.49:0/1209751975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e900bc980 msgr2=0x7f4e90165200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:00.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.741+0000 7f4e8fe00700 1 --2- 172.21.15.49:0/1209751975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e900bc980 0x7f4e90165200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.741+0000 7f4e8fe00700 1 -- 172.21.15.49:0/1209751975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e80009370 con 0x7f4e900c1ac0 2024-01-22T05:05:00.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.741+0000 7f4e95600700 1 --2- 172.21.15.49:0/1209751975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e90153cf0 0x7f4e900a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:05:00.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.741+0000 7f4e8fe00700 1 --2- 172.21.15.49:0/1209751975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e900c1ac0 0x7f4e900a42a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f4e7800e8d0 tx=0x7f4e78006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:00.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.741+0000 7f4e87e00700 1 -- 172.21.15.49:0/1209751975 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e78012600 con 0x7f4e900c1ac0 2024-01-22T05:05:00.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.741+0000 7f4e87e00700 1 -- 172.21.15.49:0/1209751975 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e78012760 con 0x7f4e900c1ac0 2024-01-22T05:05:00.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.741+0000 7f4e87e00700 1 -- 172.21.15.49:0/1209751975 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e78012ae0 con 0x7f4e900c1ac0 2024-01-22T05:05:00.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.741+0000 7f4e97600700 1 -- 172.21.15.49:0/1209751975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e90156630 con 0x7f4e900c1ac0 2024-01-22T05:05:00.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.741+0000 7f4e97600700 1 -- 172.21.15.49:0/1209751975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e90156bf0 con 0x7f4e900c1ac0 2024-01-22T05:05:00.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.741+0000 7f4e97600700 1 -- 172.21.15.49:0/1209751975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e900c0c00 con 0x7f4e900c1ac0 2024-01-22T05:05:00.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.745+0000 7f4e87e00700 1 -- 172.21.15.49:0/1209751975 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4e7801b400 con 0x7f4e900c1ac0 2024-01-22T05:05:00.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.745+0000 7f4e87e00700 1 --2- 172.21.15.49:0/1209751975 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e6805a540 0x7f4e6805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:00.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.745+0000 7f4e87e00700 1 -- 172.21.15.49:0/1209751975 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f4e78074ff0 con 0x7f4e900c1ac0 2024-01-22T05:05:00.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.745+0000 7f4e94c00700 1 --2- 172.21.15.49:0/1209751975 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e6805a540 0x7f4e6805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:00.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.745+0000 7f4e94c00700 1 --2- 172.21.15.49:0/1209751975 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e6805a540 0x7f4e6805ca00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4e80009130 tx=0x7f4e80017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:00.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.753+0000 7f4e87e00700 1 -- 172.21.15.49:0/1209751975 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4e780483a0 con 0x7f4e900c1ac0 2024-01-22T05:05:00.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.913+0000 7f4e97600700 1 -- 172.21.15.49:0/1209751975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4e90067f10 con 0x7f4e900c1ac0 2024-01-22T05:05:00.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.917+0000 7f4e87e00700 1 -- 172.21.15.49:0/1209751975 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4e78016030 con 0x7f4e900c1ac0 2024-01-22T05:05:00.918 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-22T05:05:00.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.921+0000 7f4e97600700 1 -- 172.21.15.49:0/1209751975 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e6805a540 msgr2=0x7f4e6805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:00.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.921+0000 7f4e97600700 1 --2- 172.21.15.49:0/1209751975 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e6805a540 0x7f4e6805ca00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4e80009130 tx=0x7f4e80017000).stop 2024-01-22T05:05:00.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.921+0000 7f4e97600700 1 -- 172.21.15.49:0/1209751975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e900c1ac0 msgr2=0x7f4e900a42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:00.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.921+0000 7f4e97600700 1 --2- 172.21.15.49:0/1209751975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e900c1ac0 0x7f4e900a42a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f4e7800e8d0 tx=0x7f4e78006f40).stop 2024-01-22T05:05:00.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.921+0000 7f4e97600700 1 -- 172.21.15.49:0/1209751975 shutdown_connections 2024-01-22T05:05:00.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.921+0000 7f4e97600700 1 --2- 172.21.15.49:0/1209751975 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e6805a540 0x7f4e6805ca00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.921+0000 7f4e97600700 1 --2- 172.21.15.49:0/1209751975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e90153cf0 0x7f4e900a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.921+0000 7f4e97600700 1 --2- 172.21.15.49:0/1209751975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e900c1ac0 0x7f4e900a42a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.921+0000 7f4e97600700 1 --2- 172.21.15.49:0/1209751975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e900bc980 0x7f4e90165200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:00.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.921+0000 7f4e97600700 1 -- 172.21.15.49:0/1209751975 >> 172.21.15.49:0/1209751975 conn(0x7f4e90062cb0 msgr2=0x7f4e900ab2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:00.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.921+0000 7f4e97600700 1 -- 172.21.15.49:0/1209751975 shutdown_connections 2024-01-22T05:05:00.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:00.921+0000 7f4e97600700 1 -- 172.21.15.49:0/1209751975 wait complete. 2024-01-22T05:05:00.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:05:01.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.101+0000 7fb617200700 1 Processor -- start 2024-01-22T05:05:01.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.105+0000 7fb617200700 1 -- start start 2024-01-22T05:05:01.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb617200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb610067a90 0x7fb6100a6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb617200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb610151780 0x7fb6100a9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb617200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6100c2180 con 0x7fb610151be0 2024-01-22T05:05:01.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb617200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6100c3620 con 0x7fb610067a90 2024-01-22T05:05:01.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb617200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb610064320 con 0x7fb610151780 2024-01-22T05:05:01.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb615e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb610067a90 0x7fb6100a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb615e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb610067a90 0x7fb6100a6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36512/0 (socket says 172.21.15.49:36512) 2024-01-22T05:05:01.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb615e00700 1 -- 172.21.15.49:0/731966196 learned_addr learned my addr 172.21.15.49:0/731966196 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:01.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb616800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb610151be0 0x7fb610155610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34076/0 (socket says 172.21.15.49:34076) 2024-01-22T05:05:01.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb615400700 1 --2- 172.21.15.49:0/731966196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb610151780 0x7fb6100a9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb615e00700 1 -- 172.21.15.49:0/731966196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb610151780 msgr2=0x7fb6100a9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:01.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb615e00700 1 --2- 172.21.15.49:0/731966196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb610151780 0x7fb6100a9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb615e00700 1 -- 172.21.15.49:0/731966196 >> v1:172.21.15.49:6789/0 conn(0x7fb610151be0 legacy=0x7fb610155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb614a00700 1 -- 172.21.15.49:0/731966196 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971952349 0 0) 0x7fb6100c2180 con 0x7fb610151be0 2024-01-22T05:05:01.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb615e00700 1 -- 172.21.15.49:0/731966196 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb610064600 con 0x7fb610067a90 2024-01-22T05:05:01.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb615e00700 1 --2- 172.21.15.49:0/731966196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb610067a90 0x7fb6100a6920 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fb600006fd0 tx=0x7fb6000090f0).ready entity=mon.0 client_cookie=3553e857da26eb70 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:01.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb614a00700 1 -- 172.21.15.49:0/731966196 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60000b600 con 0x7fb610067a90 2024-01-22T05:05:01.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb614a00700 1 -- 172.21.15.49:0/731966196 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60000b760 con 0x7fb610067a90 2024-01-22T05:05:01.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb614a00700 1 -- 172.21.15.49:0/731966196 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60000bae0 con 0x7fb610067a90 2024-01-22T05:05:01.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb617200700 1 -- 172.21.15.49:0/731966196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb610067a90 msgr2=0x7fb6100a6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.109+0000 7fb617200700 1 --2- 172.21.15.49:0/731966196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb610067a90 0x7fb6100a6920 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fb600006fd0 tx=0x7fb6000090f0).stop 2024-01-22T05:05:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.113+0000 7fb617200700 1 -- 172.21.15.49:0/731966196 shutdown_connections 2024-01-22T05:05:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.113+0000 7fb617200700 1 --2- 172.21.15.49:0/731966196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb610151780 0x7fb6100a9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.113+0000 7fb617200700 1 --2- 172.21.15.49:0/731966196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb610067a90 0x7fb6100a6920 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.113+0000 7fb617200700 1 -- 172.21.15.49:0/731966196 >> 172.21.15.49:0/731966196 conn(0x7fb610066750 msgr2=0x7fb610066b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.113+0000 7fb617200700 1 -- 172.21.15.49:0/731966196 shutdown_connections 2024-01-22T05:05:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.113+0000 7fb617200700 1 -- 172.21.15.49:0/731966196 wait complete. 2024-01-22T05:05:01.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.113+0000 7fb617200700 1 Processor -- start 2024-01-22T05:05:01.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb617200700 1 -- start start 2024-01-22T05:05:01.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb617200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb610151780 0x7fb610149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb617200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb610151be0 0x7fb6100ab580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb617200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6100aba70 0x7fb61014c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb617200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb610168240 con 0x7fb6100aba70 2024-01-22T05:05:01.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb617200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100acb10 con 0x7fb610151780 2024-01-22T05:05:01.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb617200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100abf00 con 0x7fb610151be0 2024-01-22T05:05:01.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb616800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6100aba70 0x7fb61014c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb616800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6100aba70 0x7fb61014c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36526/0 (socket says 172.21.15.49:36526) 2024-01-22T05:05:01.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb616800700 1 -- 172.21.15.49:0/2427742783 learned_addr learned my addr 172.21.15.49:0/2427742783 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:01.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb615400700 1 --2- 172.21.15.49:0/2427742783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb610151be0 0x7fb6100ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb615e00700 1 --2- 172.21.15.49:0/2427742783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb610151780 0x7fb610149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb616800700 1 -- 172.21.15.49:0/2427742783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb610151be0 msgr2=0x7fb6100ab580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb616800700 1 --2- 172.21.15.49:0/2427742783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb610151be0 0x7fb6100ab580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb616800700 1 -- 172.21.15.49:0/2427742783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb610151780 msgr2=0x7fb610149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.117+0000 7fb616800700 1 --2- 172.21.15.49:0/2427742783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb610151780 0x7fb610149160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.121+0000 7fb616800700 1 -- 172.21.15.49:0/2427742783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb600009370 con 0x7fb6100aba70 2024-01-22T05:05:01.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.121+0000 7fb616800700 1 --2- 172.21.15.49:0/2427742783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6100aba70 0x7fb61014c250 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fb60800c730 tx=0x7fb608001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:01.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.121+0000 7fb60d600700 1 -- 172.21.15.49:0/2427742783 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608005c70 con 0x7fb6100aba70 2024-01-22T05:05:01.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.121+0000 7fb60d600700 1 -- 172.21.15.49:0/2427742783 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb608005dd0 con 0x7fb6100aba70 2024-01-22T05:05:01.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.121+0000 7fb617200700 1 -- 172.21.15.49:0/2427742783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6100ac1e0 con 0x7fb6100aba70 2024-01-22T05:05:01.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.121+0000 7fb60d600700 1 -- 172.21.15.49:0/2427742783 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608007300 con 0x7fb6100aba70 2024-01-22T05:05:01.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.121+0000 7fb617200700 1 -- 172.21.15.49:0/2427742783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6100ac7a0 con 0x7fb6100aba70 2024-01-22T05:05:01.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.121+0000 7fb617200700 1 -- 172.21.15.49:0/2427742783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6100acca0 con 0x7fb6100aba70 2024-01-22T05:05:01.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.125+0000 7fb60d600700 1 -- 172.21.15.49:0/2427742783 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb6080076b0 con 0x7fb6100aba70 2024-01-22T05:05:01.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.125+0000 7fb60d600700 1 --2- 172.21.15.49:0/2427742783 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb5e805a510 0x7fb5e805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.125+0000 7fb60d600700 1 -- 172.21.15.49:0/2427742783 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fb6080744c0 con 0x7fb6100aba70 2024-01-22T05:05:01.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.125+0000 7fb615e00700 1 --2- 172.21.15.49:0/2427742783 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb5e805a510 0x7fb5e805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.125+0000 7fb615e00700 1 --2- 172.21.15.49:0/2427742783 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb5e805a510 0x7fb5e805c9d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb600009130 tx=0x7fb600017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:01.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.133+0000 7fb60d600700 1 -- 172.21.15.49:0/2427742783 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb608047990 con 0x7fb6100aba70 2024-01-22T05:05:01.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.341+0000 7fb617200700 1 -- 172.21.15.49:0/2427742783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6100656d0 con 0x7fb6100aba70 2024-01-22T05:05:01.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.345+0000 7fb60d600700 1 -- 172.21.15.49:0/2427742783 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4491 (secure 0 0 0) 0x7fb608018070 con 0x7fb6100aba70 2024-01-22T05:05:01.347 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:01.347 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/4240919875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4240919875},{"type":"v1","addr":"172.21.15.49:6836","nonce":4240919875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3591660134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3591660134},{"type":"v1","addr":"172.21.15.49:6837","nonce":3591660134}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1228202507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1228202507},{"type":"v1","addr":"172.21.15.110:6833","nonce":1228202507}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:04:35.017706+0000","modified":"2024-01-22T05:04:49.308211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3391981756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3391981756},{"type":"v1","addr":"172.21.15.110:6835","nonce":3391981756}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:05:01.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.349+0000 7fb617200700 1 -- 172.21.15.49:0/2427742783 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb5e805a510 msgr2=0x7fb5e805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.349+0000 7fb617200700 1 --2- 172.21.15.49:0/2427742783 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb5e805a510 0x7fb5e805c9d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb600009130 tx=0x7fb600017000).stop 2024-01-22T05:05:01.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.349+0000 7fb617200700 1 -- 172.21.15.49:0/2427742783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6100aba70 msgr2=0x7fb61014c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.349+0000 7fb617200700 1 --2- 172.21.15.49:0/2427742783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6100aba70 0x7fb61014c250 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fb60800c730 tx=0x7fb608001520).stop 2024-01-22T05:05:01.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.349+0000 7fb617200700 1 -- 172.21.15.49:0/2427742783 shutdown_connections 2024-01-22T05:05:01.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.349+0000 7fb617200700 1 --2- 172.21.15.49:0/2427742783 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb5e805a510 0x7fb5e805c9d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.349+0000 7fb617200700 1 --2- 172.21.15.49:0/2427742783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6100aba70 0x7fb61014c250 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.349+0000 7fb617200700 1 --2- 172.21.15.49:0/2427742783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb610151be0 0x7fb6100ab580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.349+0000 7fb617200700 1 --2- 172.21.15.49:0/2427742783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb610151780 0x7fb610149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.349+0000 7fb617200700 1 -- 172.21.15.49:0/2427742783 >> 172.21.15.49:0/2427742783 conn(0x7fb610066750 msgr2=0x7fb6101555a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:01.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.349+0000 7fb617200700 1 -- 172.21.15.49:0/2427742783 shutdown_connections 2024-01-22T05:05:01.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.349+0000 7fb617200700 1 -- 172.21.15.49:0/2427742783 wait complete. 2024-01-22T05:05:01.355 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-22T05:05:01.377 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:05:01.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.525+0000 7f7a23000700 1 Processor -- start 2024-01-22T05:05:01.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.529+0000 7f7a23000700 1 -- start start 2024-01-22T05:05:01.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.529+0000 7f7a23000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a1c0bcc50 0x7f7a1c0bd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.529+0000 7f7a23000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7a1c0a8740 0x7f7a1c0a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.529+0000 7f7a23000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c0bc4d0 con 0x7f7a1c1544a0 2024-01-22T05:05:01.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.529+0000 7f7a23000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1c0bc960 con 0x7f7a1c0a8740 2024-01-22T05:05:01.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.529+0000 7f7a23000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0a9070 con 0x7f7a1c0bcc50 2024-01-22T05:05:01.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a1b400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7a1c0a8740 0x7f7a1c0a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a21000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7a1c1544a0 0x7f7a1c154950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34088/0 (socket says 172.21.15.49:34088) 2024-01-22T05:05:01.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a21000700 1 -- 172.21.15.49:0/2425525447 learned_addr learned my addr 172.21.15.49:0/2425525447 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:01.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a1be00700 1 --2- 172.21.15.49:0/2425525447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a1c0bcc50 0x7f7a1c0bd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a1aa00700 1 -- 172.21.15.49:0/2425525447 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858758621 0 0) 0x7f7a1c0bc4d0 con 0x7f7a1c1544a0 2024-01-22T05:05:01.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a1aa00700 1 -- 172.21.15.49:0/2425525447 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79fc0033f0 con 0x7f7a1c1544a0 2024-01-22T05:05:01.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a1b400700 1 -- 172.21.15.49:0/2425525447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a1c0bcc50 msgr2=0x7f7a1c0bd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:01.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a1b400700 1 --2- 172.21.15.49:0/2425525447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a1c0bcc50 0x7f7a1c0bd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a1b400700 1 -- 172.21.15.49:0/2425525447 >> v1:172.21.15.49:6789/0 conn(0x7f7a1c1544a0 legacy=0x7f7a1c154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a1b400700 1 -- 172.21.15.49:0/2425525447 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c0bb8c0 con 0x7f7a1c0a8740 2024-01-22T05:05:01.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a1b400700 1 --2- 172.21.15.49:0/2425525447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a1c0a8740 0x7f7a1c0a8b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f7a04009760 tx=0x7f7a04009060).ready entity=mon.0 client_cookie=d42b512bff1264d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:01.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a1aa00700 1 -- 172.21.15.49:0/2425525447 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0400d4a0 con 0x7f7a1c0a8740 2024-01-22T05:05:01.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a1aa00700 1 -- 172.21.15.49:0/2425525447 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0400d600 con 0x7f7a1c0a8740 2024-01-22T05:05:01.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a1aa00700 1 -- 172.21.15.49:0/2425525447 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0400d980 con 0x7f7a1c0a8740 2024-01-22T05:05:01.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a23000700 1 -- 172.21.15.49:0/2425525447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a1c0a8740 msgr2=0x7f7a1c0a8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a23000700 1 --2- 172.21.15.49:0/2425525447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a1c0a8740 0x7f7a1c0a8b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f7a04009760 tx=0x7f7a04009060).stop 2024-01-22T05:05:01.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a23000700 1 -- 172.21.15.49:0/2425525447 shutdown_connections 2024-01-22T05:05:01.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a23000700 1 --2- 172.21.15.49:0/2425525447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a1c0a8740 0x7f7a1c0a8b80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a23000700 1 --2- 172.21.15.49:0/2425525447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a1c0bcc50 0x7f7a1c0bd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.533+0000 7f7a23000700 1 -- 172.21.15.49:0/2425525447 >> 172.21.15.49:0/2425525447 conn(0x7f7a1c0c6540 msgr2=0x7f7a1c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:01.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.537+0000 7f7a23000700 1 -- 172.21.15.49:0/2425525447 shutdown_connections 2024-01-22T05:05:01.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.537+0000 7f7a23000700 1 -- 172.21.15.49:0/2425525447 wait complete. 2024-01-22T05:05:01.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.537+0000 7f7a23000700 1 Processor -- start 2024-01-22T05:05:01.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.537+0000 7f7a23000700 1 -- start start 2024-01-22T05:05:01.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a23000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a1c0a8740 0x7f7a1c14d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a23000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a1c0bcc50 0x7f7a1c153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a23000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a1c1544a0 0x7f7a1c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a23000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c154360 con 0x7f7a1c1544a0 2024-01-22T05:05:01.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a23000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0a11d0 con 0x7f7a1c0a8740 2024-01-22T05:05:01.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a23000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c09f540 con 0x7f7a1c0bcc50 2024-01-22T05:05:01.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a21000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a1c1544a0 0x7f7a1c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a21000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a1c1544a0 0x7f7a1c153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36546/0 (socket says 172.21.15.49:36546) 2024-01-22T05:05:01.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a21000700 1 -- 172.21.15.49:0/1681483642 learned_addr learned my addr 172.21.15.49:0/1681483642 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:01.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a1b400700 1 --2- 172.21.15.49:0/1681483642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a1c0bcc50 0x7f7a1c153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a1be00700 1 --2- 172.21.15.49:0/1681483642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a1c0a8740 0x7f7a1c14d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a21000700 1 -- 172.21.15.49:0/1681483642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a1c0bcc50 msgr2=0x7f7a1c153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a21000700 1 --2- 172.21.15.49:0/1681483642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a1c0bcc50 0x7f7a1c153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a21000700 1 -- 172.21.15.49:0/1681483642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a1c0a8740 msgr2=0x7f7a1c14d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a21000700 1 --2- 172.21.15.49:0/1681483642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a1c0a8740 0x7f7a1c14d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a21000700 1 -- 172.21.15.49:0/1681483642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a040092a0 con 0x7f7a1c1544a0 2024-01-22T05:05:01.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a1b400700 1 --2- 172.21.15.49:0/1681483642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a1c0bcc50 0x7f7a1c153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:01.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a21000700 1 --2- 172.21.15.49:0/1681483642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a1c1544a0 0x7f7a1c153e70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f7a14005ad0 tx=0x7f7a14001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:01.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a13400700 1 -- 172.21.15.49:0/1681483642 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14005d30 con 0x7f7a1c1544a0 2024-01-22T05:05:01.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a13400700 1 -- 172.21.15.49:0/1681483642 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14005e90 con 0x7f7a1c1544a0 2024-01-22T05:05:01.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a13400700 1 -- 172.21.15.49:0/1681483642 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14007320 con 0x7f7a1c1544a0 2024-01-22T05:05:01.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.541+0000 7f7a23000700 1 -- 172.21.15.49:0/1681483642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c0a13e0 con 0x7f7a1c1544a0 2024-01-22T05:05:01.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.545+0000 7f7a23000700 1 -- 172.21.15.49:0/1681483642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c0a1a20 con 0x7f7a1c1544a0 2024-01-22T05:05:01.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.545+0000 7f7a23000700 1 -- 172.21.15.49:0/1681483642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c09f700 con 0x7f7a1c1544a0 2024-01-22T05:05:01.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.545+0000 7f7a13400700 1 -- 172.21.15.49:0/1681483642 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7a14007710 con 0x7f7a1c1544a0 2024-01-22T05:05:01.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.549+0000 7f7a13400700 1 --2- 172.21.15.49:0/1681483642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79f405a510 0x7f79f405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.549+0000 7f7a13400700 1 -- 172.21.15.49:0/1681483642 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f7a14074b70 con 0x7f7a1c1544a0 2024-01-22T05:05:01.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.549+0000 7f7a1be00700 1 --2- 172.21.15.49:0/1681483642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79f405a510 0x7f79f405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.549+0000 7f7a1be00700 1 --2- 172.21.15.49:0/1681483642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79f405a510 0x7f79f405c9d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f7a0c009b90 tx=0x7f7a0c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:01.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.553+0000 7f7a13400700 1 -- 172.21.15.49:0/1681483642 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7a14047f20 con 0x7f7a1c1544a0 2024-01-22T05:05:01.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.717+0000 7f7a23000700 1 -- 172.21.15.49:0/1681483642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a1c0bbba0 con 0x7f7a1c1544a0 2024-01-22T05:05:01.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.721+0000 7f7a13400700 1 -- 172.21.15.49:0/1681483642 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f7a1404b540 con 0x7f7a1c1544a0 2024-01-22T05:05:01.724 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:01.724 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:39.526211+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:05:01.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.725+0000 7f7a23000700 1 -- 172.21.15.49:0/1681483642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79f405a510 msgr2=0x7f79f405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.725+0000 7f7a23000700 1 --2- 172.21.15.49:0/1681483642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79f405a510 0x7f79f405c9d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f7a0c009b90 tx=0x7f7a0c009060).stop 2024-01-22T05:05:01.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.725+0000 7f7a23000700 1 -- 172.21.15.49:0/1681483642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a1c1544a0 msgr2=0x7f7a1c153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.725+0000 7f7a23000700 1 --2- 172.21.15.49:0/1681483642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a1c1544a0 0x7f7a1c153e70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f7a14005ad0 tx=0x7f7a14001650).stop 2024-01-22T05:05:01.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.725+0000 7f7a23000700 1 -- 172.21.15.49:0/1681483642 shutdown_connections 2024-01-22T05:05:01.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.725+0000 7f7a23000700 1 --2- 172.21.15.49:0/1681483642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79f405a510 0x7f79f405c9d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.725+0000 7f7a23000700 1 --2- 172.21.15.49:0/1681483642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a1c1544a0 0x7f7a1c153e70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.725+0000 7f7a23000700 1 --2- 172.21.15.49:0/1681483642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a1c0bcc50 0x7f7a1c153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.725+0000 7f7a23000700 1 --2- 172.21.15.49:0/1681483642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a1c0a8740 0x7f7a1c14d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.725+0000 7f7a23000700 1 -- 172.21.15.49:0/1681483642 >> 172.21.15.49:0/1681483642 conn(0x7f7a1c0c6540 msgr2=0x7f7a1c0c5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:01.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.725+0000 7f7a23000700 1 -- 172.21.15.49:0/1681483642 shutdown_connections 2024-01-22T05:05:01.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.725+0000 7f7a23000700 1 -- 172.21.15.49:0/1681483642 wait complete. 2024-01-22T05:05:01.751 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:04:32.991898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:04:34.057128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-22T05:04:37.108860+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:05:01.752 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:05:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.917+0000 7f3fbdc00700 1 Processor -- start 2024-01-22T05:05:01.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.917+0000 7f3fbdc00700 1 -- start start 2024-01-22T05:05:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.921+0000 7f3fbdc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3fb80c1ce0 0x7f3fb80bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.921+0000 7f3fbdc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3fb80bc9c0 0x7f3fb8068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.921+0000 7f3fbdc00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb8158650 con 0x7f3fb80a8c20 2024-01-22T05:05:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.921+0000 7f3fbdc00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb80bd170 con 0x7f3fb80bc9c0 2024-01-22T05:05:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.921+0000 7f3fbdc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb8067c30 con 0x7f3fb80c1ce0 2024-01-22T05:05:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.921+0000 7f3fb6a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3fb80a8c20 0x7f3fb80c15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34096/0 (socket says 172.21.15.49:34096) 2024-01-22T05:05:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.921+0000 7f3fb6a00700 1 -- 172.21.15.49:0/1109490387 learned_addr learned my addr 172.21.15.49:0/1109490387 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.921+0000 7f3fb7400700 1 --2- 172.21.15.49:0/1109490387 >> v2:172.21.15.49:3300/0 conn(0x7f3fb80bc9c0 0x7f3fb8068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.921+0000 7f3fb6000700 1 --2- 172.21.15.49:0/1109490387 >> v2:172.21.15.110:3300/0 conn(0x7f3fb80c1ce0 0x7f3fb80bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.921+0000 7f3fb7400700 1 -- 172.21.15.49:0/1109490387 >> v2:172.21.15.110:3300/0 conn(0x7f3fb80c1ce0 msgr2=0x7f3fb80bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.921+0000 7f3fb7400700 1 --2- 172.21.15.49:0/1109490387 >> v2:172.21.15.110:3300/0 conn(0x7f3fb80c1ce0 0x7f3fb80bc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.921+0000 7f3fb7400700 1 -- 172.21.15.49:0/1109490387 >> v1:172.21.15.49:6789/0 conn(0x7f3fb80a8c20 legacy=0x7f3fb80c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.921+0000 7f3fb7400700 1 -- 172.21.15.49:0/1109490387 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb8067f10 con 0x7f3fb80bc9c0 2024-01-22T05:05:01.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.921+0000 7f3fb7400700 1 --2- 172.21.15.49:0/1109490387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb80bc9c0 0x7f3fb8068710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f3fb80bb7b0 tx=0x7f3fb0009780).ready entity=mon.0 client_cookie=bb9e460a399a6c2d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:01.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.921+0000 7f3fb5600700 1 -- 172.21.15.49:0/1109490387 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000e070 con 0x7f3fb80bc9c0 2024-01-22T05:05:01.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.925+0000 7f3fb5600700 1 -- 172.21.15.49:0/1109490387 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb000bc30 con 0x7f3fb80bc9c0 2024-01-22T05:05:01.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.925+0000 7f3fb5600700 1 -- 172.21.15.49:0/1109490387 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0012410 con 0x7f3fb80bc9c0 2024-01-22T05:05:01.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.925+0000 7f3fbdc00700 1 -- 172.21.15.49:0/1109490387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb80bc9c0 msgr2=0x7f3fb8068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.925+0000 7f3fbdc00700 1 --2- 172.21.15.49:0/1109490387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb80bc9c0 0x7f3fb8068710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f3fb80bb7b0 tx=0x7f3fb0009780).stop 2024-01-22T05:05:01.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.925+0000 7f3fbdc00700 1 -- 172.21.15.49:0/1109490387 shutdown_connections 2024-01-22T05:05:01.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.925+0000 7f3fbdc00700 1 --2- 172.21.15.49:0/1109490387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb80bc9c0 0x7f3fb8068710 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.925+0000 7f3fbdc00700 1 --2- 172.21.15.49:0/1109490387 >> v2:172.21.15.110:3300/0 conn(0x7f3fb80c1ce0 0x7f3fb80bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.925+0000 7f3fbdc00700 1 -- 172.21.15.49:0/1109490387 >> 172.21.15.49:0/1109490387 conn(0x7f3fb8062cb0 msgr2=0x7f3fb80c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.925+0000 7f3fbdc00700 1 -- 172.21.15.49:0/1109490387 shutdown_connections 2024-01-22T05:05:01.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.925+0000 7f3fbdc00700 1 -- 172.21.15.49:0/1109490387 wait complete. 2024-01-22T05:05:01.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.929+0000 7f3fbdc00700 1 Processor -- start 2024-01-22T05:05:01.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.929+0000 7f3fbdc00700 1 -- start start 2024-01-22T05:05:01.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fbdc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fb80a8c20 0x7f3fb8149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fbdc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fb80bc9c0 0x7f3fb80a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fbdc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb80c1ce0 0x7f3fb80c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fbdc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb816a450 con 0x7f3fb80c1ce0 2024-01-22T05:05:01.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fbdc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8169880 con 0x7f3fb80bc9c0 2024-01-22T05:05:01.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fbdc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8169b20 con 0x7f3fb80a8c20 2024-01-22T05:05:01.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fb7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb80c1ce0 0x7f3fb80c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fb7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb80c1ce0 0x7f3fb80c2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36558/0 (socket says 172.21.15.49:36558) 2024-01-22T05:05:01.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fb7400700 1 -- 172.21.15.49:0/3309227658 learned_addr learned my addr 172.21.15.49:0/3309227658 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:01.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fb6a00700 1 --2- 172.21.15.49:0/3309227658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fb80a8c20 0x7f3fb8149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fb6000700 1 --2- 172.21.15.49:0/3309227658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fb80bc9c0 0x7f3fb80a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fb7400700 1 -- 172.21.15.49:0/3309227658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fb80a8c20 msgr2=0x7f3fb8149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fb7400700 1 --2- 172.21.15.49:0/3309227658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fb80a8c20 0x7f3fb8149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fb7400700 1 -- 172.21.15.49:0/3309227658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fb80bc9c0 msgr2=0x7f3fb80a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:01.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fb7400700 1 --2- 172.21.15.49:0/3309227658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fb80bc9c0 0x7f3fb80a0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:01.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fb7400700 1 -- 172.21.15.49:0/3309227658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb0009a20 con 0x7f3fb80c1ce0 2024-01-22T05:05:01.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fb6000700 1 --2- 172.21.15.49:0/3309227658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fb80bc9c0 0x7f3fb80a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:01.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.933+0000 7f3fb7400700 1 --2- 172.21.15.49:0/3309227658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb80c1ce0 0x7f3fb80c2f60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f3fb8059c20 tx=0x7f3fb0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:01.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.937+0000 7f3fae000700 1 -- 172.21.15.49:0/3309227658 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0011750 con 0x7f3fb80c1ce0 2024-01-22T05:05:01.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.937+0000 7f3fae000700 1 -- 172.21.15.49:0/3309227658 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb00118d0 con 0x7f3fb80c1ce0 2024-01-22T05:05:01.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.937+0000 7f3fae000700 1 -- 172.21.15.49:0/3309227658 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0011c90 con 0x7f3fb80c1ce0 2024-01-22T05:05:01.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.937+0000 7f3fbdc00700 1 -- 172.21.15.49:0/3309227658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb8169e00 con 0x7f3fb80c1ce0 2024-01-22T05:05:01.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.937+0000 7f3fbdc00700 1 -- 172.21.15.49:0/3309227658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb8149c80 con 0x7f3fb80c1ce0 2024-01-22T05:05:01.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.937+0000 7f3fbdc00700 1 -- 172.21.15.49:0/3309227658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb816a5c0 con 0x7f3fb80c1ce0 2024-01-22T05:05:01.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.937+0000 7f3fae000700 1 -- 172.21.15.49:0/3309227658 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3fb0003040 con 0x7f3fb80c1ce0 2024-01-22T05:05:01.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.941+0000 7f3fae000700 1 --2- 172.21.15.49:0/3309227658 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3f9005a510 0x7f3f9005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:01.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.941+0000 7f3fae000700 1 -- 172.21.15.49:0/3309227658 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f3fb0076a60 con 0x7f3fb80c1ce0 2024-01-22T05:05:01.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.941+0000 7f3fb6a00700 1 --2- 172.21.15.49:0/3309227658 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3f9005a510 0x7f3f9005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:01.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.941+0000 7f3fb6a00700 1 --2- 172.21.15.49:0/3309227658 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3f9005a510 0x7f3f9005c9d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3fa8007fd0 tx=0x7f3fa8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:01.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:01.945+0000 7f3fae000700 1 -- 172.21.15.49:0/3309227658 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3fb0049e50 con 0x7f3fb80c1ce0 2024-01-22T05:05:02.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.113+0000 7f3fbdc00700 1 -- 172.21.15.49:0/3309227658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3fb80c0c00 con 0x7f3fb80c1ce0 2024-01-22T05:05:02.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.113+0000 7f3fae000700 1 -- 172.21.15.49:0/3309227658 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3fb004d470 con 0x7f3fb80c1ce0 2024-01-22T05:05:02.116 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:05:02.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.117+0000 7f3fbdc00700 1 -- 172.21.15.49:0/3309227658 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3f9005a510 msgr2=0x7f3f9005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:02.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.117+0000 7f3fbdc00700 1 --2- 172.21.15.49:0/3309227658 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3f9005a510 0x7f3f9005c9d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3fa8007fd0 tx=0x7f3fa8009040).stop 2024-01-22T05:05:02.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.117+0000 7f3fbdc00700 1 -- 172.21.15.49:0/3309227658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb80c1ce0 msgr2=0x7f3fb80c2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:02.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.117+0000 7f3fbdc00700 1 --2- 172.21.15.49:0/3309227658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb80c1ce0 0x7f3fb80c2f60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f3fb8059c20 tx=0x7f3fb0009780).stop 2024-01-22T05:05:02.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.117+0000 7f3fbdc00700 1 -- 172.21.15.49:0/3309227658 shutdown_connections 2024-01-22T05:05:02.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.117+0000 7f3fbdc00700 1 --2- 172.21.15.49:0/3309227658 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3f9005a510 0x7f3f9005c9d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.117+0000 7f3fbdc00700 1 --2- 172.21.15.49:0/3309227658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fb80c1ce0 0x7f3fb80c2f60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.117+0000 7f3fbdc00700 1 --2- 172.21.15.49:0/3309227658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fb80bc9c0 0x7f3fb80a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.117+0000 7f3fbdc00700 1 --2- 172.21.15.49:0/3309227658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fb80a8c20 0x7f3fb8149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.117+0000 7f3fbdc00700 1 -- 172.21.15.49:0/3309227658 >> 172.21.15.49:0/3309227658 conn(0x7f3fb8062cb0 msgr2=0x7f3fb80c14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:02.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.117+0000 7f3fbdc00700 1 -- 172.21.15.49:0/3309227658 shutdown_connections 2024-01-22T05:05:02.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.117+0000 7f3fbdc00700 1 -- 172.21.15.49:0/3309227658 wait complete. 2024-01-22T05:05:02.142 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:05:02.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.305+0000 7efc7da00700 1 Processor -- start 2024-01-22T05:05:02.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.309+0000 7efc7da00700 1 -- start start 2024-01-22T05:05:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.309+0000 7efc7da00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efc78155690 0x7efc78067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.309+0000 7efc7da00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc78064500 0x7efc780a74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.309+0000 7efc7da00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc78068d30 con 0x7efc780a9a60 2024-01-22T05:05:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.309+0000 7efc7da00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc780650d0 con 0x7efc78064500 2024-01-22T05:05:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.309+0000 7efc7da00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc78068120 con 0x7efc78155690 2024-01-22T05:05:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.309+0000 7efc77400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc78064500 0x7efc780a74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.309+0000 7efc77400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc78064500 0x7efc780a74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36562/0 (socket says 172.21.15.49:36562) 2024-01-22T05:05:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.309+0000 7efc77400700 1 -- 172.21.15.49:0/151976961 learned_addr learned my addr 172.21.15.49:0/151976961 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.309+0000 7efc76a00700 1 --2- 172.21.15.49:0/151976961 >> v2:172.21.15.110:3300/0 conn(0x7efc78155690 0x7efc78067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.309+0000 7efc77400700 1 -- 172.21.15.49:0/151976961 >> v2:172.21.15.110:3300/0 conn(0x7efc78155690 msgr2=0x7efc78067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc77400700 1 --2- 172.21.15.49:0/151976961 >> v2:172.21.15.110:3300/0 conn(0x7efc78155690 0x7efc78067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc77400700 1 -- 172.21.15.49:0/151976961 >> v1:172.21.15.49:6789/0 conn(0x7efc780a9a60 legacy=0x7efc78063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc77400700 1 -- 172.21.15.49:0/151976961 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc78068400 con 0x7efc78064500 2024-01-22T05:05:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc75600700 1 -- 172.21.15.49:0/151976961 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493325631 0 0) 0x7efc78068d30 con 0x7efc780a9a60 2024-01-22T05:05:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc77400700 1 --2- 172.21.15.49:0/151976961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc78064500 0x7efc780a74e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7efc78065ba0 tx=0x7efc70009840).ready entity=mon.0 client_cookie=a6703dc38c0f9ced server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc75600700 1 -- 172.21.15.49:0/151976961 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7000e070 con 0x7efc78064500 2024-01-22T05:05:02.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc75600700 1 -- 172.21.15.49:0/151976961 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7000ba20 con 0x7efc78064500 2024-01-22T05:05:02.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc75600700 1 -- 172.21.15.49:0/151976961 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7000bda0 con 0x7efc78064500 2024-01-22T05:05:02.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc7da00700 1 -- 172.21.15.49:0/151976961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc78064500 msgr2=0x7efc780a74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:02.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc7da00700 1 --2- 172.21.15.49:0/151976961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc78064500 0x7efc780a74e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7efc78065ba0 tx=0x7efc70009840).stop 2024-01-22T05:05:02.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc7da00700 1 -- 172.21.15.49:0/151976961 shutdown_connections 2024-01-22T05:05:02.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc7da00700 1 --2- 172.21.15.49:0/151976961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc78064500 0x7efc780a74e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc7da00700 1 --2- 172.21.15.49:0/151976961 >> v2:172.21.15.110:3300/0 conn(0x7efc78155690 0x7efc78067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc7da00700 1 -- 172.21.15.49:0/151976961 >> 172.21.15.49:0/151976961 conn(0x7efc780c40f0 msgr2=0x7efc780c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:02.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc7da00700 1 -- 172.21.15.49:0/151976961 shutdown_connections 2024-01-22T05:05:02.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.313+0000 7efc7da00700 1 -- 172.21.15.49:0/151976961 wait complete. 2024-01-22T05:05:02.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.317+0000 7efc7da00700 1 Processor -- start 2024-01-22T05:05:02.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.317+0000 7efc7da00700 1 -- start start 2024-01-22T05:05:02.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.317+0000 7efc7da00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc78064500 0x7efc780accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:02.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.317+0000 7efc7da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc780a9a60 0x7efc780aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:02.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.317+0000 7efc7da00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc78155690 0x7efc780a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:02.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.317+0000 7efc7da00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc780a6fe0 con 0x7efc780a9a60 2024-01-22T05:05:02.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.317+0000 7efc7da00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc780ad350 con 0x7efc78064500 2024-01-22T05:05:02.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.317+0000 7efc7da00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc78153550 con 0x7efc78155690 2024-01-22T05:05:02.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.317+0000 7efc76000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc780a9a60 0x7efc780aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:02.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc77400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc78155690 0x7efc780a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:02.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc76000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc780a9a60 0x7efc780aa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36572/0 (socket says 172.21.15.49:36572) 2024-01-22T05:05:02.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc76000700 1 -- 172.21.15.49:0/2300849103 learned_addr learned my addr 172.21.15.49:0/2300849103 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:02.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc76a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc78064500 0x7efc780accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:02.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc76000700 1 -- 172.21.15.49:0/2300849103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc78155690 msgr2=0x7efc780a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:02.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc76000700 1 --2- 172.21.15.49:0/2300849103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc78155690 0x7efc780a6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc76000700 1 -- 172.21.15.49:0/2300849103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc78064500 msgr2=0x7efc780accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:02.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc76000700 1 --2- 172.21.15.49:0/2300849103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc78064500 0x7efc780accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc76000700 1 -- 172.21.15.49:0/2300849103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc70009ae0 con 0x7efc780a9a60 2024-01-22T05:05:02.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc76000700 1 --2- 172.21.15.49:0/2300849103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc780a9a60 0x7efc780aa5e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7efc60001eb0 tx=0x7efc60007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:02.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc6e000700 1 -- 172.21.15.49:0/2300849103 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6000ce60 con 0x7efc780a9a60 2024-01-22T05:05:02.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc6e000700 1 -- 172.21.15.49:0/2300849103 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6000f470 con 0x7efc780a9a60 2024-01-22T05:05:02.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc7da00700 1 -- 172.21.15.49:0/2300849103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc78153830 con 0x7efc780a9a60 2024-01-22T05:05:02.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc6e000700 1 -- 172.21.15.49:0/2300849103 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6000f810 con 0x7efc780a9a60 2024-01-22T05:05:02.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc7da00700 1 -- 172.21.15.49:0/2300849103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc780ac3d0 con 0x7efc780a9a60 2024-01-22T05:05:02.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.321+0000 7efc7da00700 1 -- 172.21.15.49:0/2300849103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc780656b0 con 0x7efc780a9a60 2024-01-22T05:05:02.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.325+0000 7efc6e000700 1 -- 172.21.15.49:0/2300849103 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7efc6000fb80 con 0x7efc780a9a60 2024-01-22T05:05:02.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.325+0000 7efc6e000700 1 --2- 172.21.15.49:0/2300849103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc5005a510 0x7efc5005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:02.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.325+0000 7efc6e000700 1 -- 172.21.15.49:0/2300849103 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7efc60073fe0 con 0x7efc780a9a60 2024-01-22T05:05:02.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.325+0000 7efc76a00700 1 --2- 172.21.15.49:0/2300849103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc5005a510 0x7efc5005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:02.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.325+0000 7efc76a00700 1 --2- 172.21.15.49:0/2300849103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc5005a510 0x7efc5005c9d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7efc68009b90 tx=0x7efc68009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:02.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.329+0000 7efc6e000700 1 -- 172.21.15.49:0/2300849103 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efc600474b0 con 0x7efc780a9a60 2024-01-22T05:05:02.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.493+0000 7efc7da00700 1 -- 172.21.15.49:0/2300849103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efc780686e0 con 0x7efc780a9a60 2024-01-22T05:05:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.493+0000 7efc6e000700 1 -- 172.21.15.49:0/2300849103 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7efc6004aad0 con 0x7efc780a9a60 2024-01-22T05:05:02.498 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:05:02.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.497+0000 7efc7da00700 1 -- 172.21.15.49:0/2300849103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc5005a510 msgr2=0x7efc5005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:02.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.497+0000 7efc7da00700 1 --2- 172.21.15.49:0/2300849103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc5005a510 0x7efc5005c9d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7efc68009b90 tx=0x7efc68009060).stop 2024-01-22T05:05:02.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.497+0000 7efc7da00700 1 -- 172.21.15.49:0/2300849103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc780a9a60 msgr2=0x7efc780aa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:02.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.497+0000 7efc7da00700 1 --2- 172.21.15.49:0/2300849103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc780a9a60 0x7efc780aa5e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7efc60001eb0 tx=0x7efc60007c70).stop 2024-01-22T05:05:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.497+0000 7efc7da00700 1 -- 172.21.15.49:0/2300849103 shutdown_connections 2024-01-22T05:05:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.497+0000 7efc7da00700 1 --2- 172.21.15.49:0/2300849103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc5005a510 0x7efc5005c9d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.497+0000 7efc7da00700 1 --2- 172.21.15.49:0/2300849103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc78155690 0x7efc780a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.497+0000 7efc7da00700 1 --2- 172.21.15.49:0/2300849103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc780a9a60 0x7efc780aa5e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.497+0000 7efc7da00700 1 --2- 172.21.15.49:0/2300849103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc78064500 0x7efc780accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.497+0000 7efc7da00700 1 -- 172.21.15.49:0/2300849103 >> 172.21.15.49:0/2300849103 conn(0x7efc780c40f0 msgr2=0x7efc780c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.497+0000 7efc7da00700 1 -- 172.21.15.49:0/2300849103 shutdown_connections 2024-01-22T05:05:02.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.497+0000 7efc7da00700 1 -- 172.21.15.49:0/2300849103 wait complete. 2024-01-22T05:05:02.524 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:05:02.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.689+0000 7f1e83000700 1 Processor -- start 2024-01-22T05:05:02.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.689+0000 7f1e83000700 1 -- start start 2024-01-22T05:05:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.693+0000 7f1e83000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1e7c0c4500 0x7f1e7c063f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.693+0000 7f1e83000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1e7c157510 0x7f1e7c157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e83000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7c0c22e0 con 0x7f1e7c153e80 2024-01-22T05:05:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e83000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7c0c2770 con 0x7f1e7c0c4500 2024-01-22T05:05:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e83000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7c157e60 con 0x7f1e7c157510 2024-01-22T05:05:02.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e7be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1e7c0c4500 0x7f1e7c063f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:02.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e7be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1e7c0c4500 0x7f1e7c063f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36580/0 (socket says 172.21.15.49:36580) 2024-01-22T05:05:02.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e7be00700 1 -- 172.21.15.49:0/325732596 learned_addr learned my addr 172.21.15.49:0/325732596 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:02.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e7b400700 1 --2- 172.21.15.49:0/325732596 >> v2:172.21.15.110:3300/0 conn(0x7f1e7c157510 0x7f1e7c157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:02.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e7be00700 1 -- 172.21.15.49:0/325732596 >> v2:172.21.15.110:3300/0 conn(0x7f1e7c157510 msgr2=0x7f1e7c157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:02.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e7be00700 1 --2- 172.21.15.49:0/325732596 >> v2:172.21.15.110:3300/0 conn(0x7f1e7c157510 0x7f1e7c157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e7be00700 1 -- 172.21.15.49:0/325732596 >> v1:172.21.15.110:6789/0 conn(0x7f1e7c153e80 legacy=0x7f1e7c1542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:02.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e7be00700 1 -- 172.21.15.49:0/325732596 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c0c16d0 con 0x7f1e7c0c4500 2024-01-22T05:05:02.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e7b400700 1 --2- 172.21.15.49:0/325732596 >> v2:172.21.15.110:3300/0 conn(0x7f1e7c157510 0x7f1e7c157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:02.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e7be00700 1 --2- 172.21.15.49:0/325732596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e7c0c4500 0x7f1e7c063f00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f1e7c158610 tx=0x7f1e6c0090f0).ready entity=mon.0 client_cookie=5aec0c4a928710e5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:02.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e7aa00700 1 -- 172.21.15.49:0/325732596 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00b520 con 0x7f1e7c0c4500 2024-01-22T05:05:02.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e7aa00700 1 -- 172.21.15.49:0/325732596 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c00b680 con 0x7f1e7c0c4500 2024-01-22T05:05:02.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e7aa00700 1 -- 172.21.15.49:0/325732596 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00ba00 con 0x7f1e7c0c4500 2024-01-22T05:05:02.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e83000700 1 -- 172.21.15.49:0/325732596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e7c0c4500 msgr2=0x7f1e7c063f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:02.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.697+0000 7f1e83000700 1 --2- 172.21.15.49:0/325732596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e7c0c4500 0x7f1e7c063f00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f1e7c158610 tx=0x7f1e6c0090f0).stop 2024-01-22T05:05:02.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.701+0000 7f1e83000700 1 -- 172.21.15.49:0/325732596 shutdown_connections 2024-01-22T05:05:02.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.701+0000 7f1e83000700 1 --2- 172.21.15.49:0/325732596 >> v2:172.21.15.110:3300/0 conn(0x7f1e7c157510 0x7f1e7c157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.701+0000 7f1e83000700 1 --2- 172.21.15.49:0/325732596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e7c0c4500 0x7f1e7c063f00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.701+0000 7f1e83000700 1 -- 172.21.15.49:0/325732596 >> 172.21.15.49:0/325732596 conn(0x7f1e7c0c3f10 msgr2=0x7f1e7c065a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:02.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.701+0000 7f1e83000700 1 -- 172.21.15.49:0/325732596 shutdown_connections 2024-01-22T05:05:02.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.701+0000 7f1e83000700 1 -- 172.21.15.49:0/325732596 wait complete. 2024-01-22T05:05:02.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.705+0000 7f1e83000700 1 Processor -- start 2024-01-22T05:05:02.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.705+0000 7f1e83000700 1 -- start start 2024-01-22T05:05:02.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.705+0000 7f1e83000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e7c0c4500 0x7f1e7c0be270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:02.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.705+0000 7f1e83000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e7c153e80 0x7f1e7c14c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:02.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.705+0000 7f1e83000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e7c157510 0x7f1e7c0c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:02.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.705+0000 7f1e83000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0bfc10 con 0x7f1e7c157510 2024-01-22T05:05:02.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.705+0000 7f1e83000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0bf000 con 0x7f1e7c0c4500 2024-01-22T05:05:02.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.705+0000 7f1e83000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0bf2e0 con 0x7f1e7c153e80 2024-01-22T05:05:02.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.705+0000 7f1e81000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e7c157510 0x7f1e7c0c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:02.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.705+0000 7f1e81000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e7c157510 0x7f1e7c0c00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36590/0 (socket says 172.21.15.49:36590) 2024-01-22T05:05:02.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.705+0000 7f1e81000700 1 -- 172.21.15.49:0/1371799566 learned_addr learned my addr 172.21.15.49:0/1371799566 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:02.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.709+0000 7f1e7be00700 1 --2- 172.21.15.49:0/1371799566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e7c0c4500 0x7f1e7c0be270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:02.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.709+0000 7f1e7b400700 1 --2- 172.21.15.49:0/1371799566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e7c153e80 0x7f1e7c14c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:02.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.709+0000 7f1e81000700 1 -- 172.21.15.49:0/1371799566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e7c153e80 msgr2=0x7f1e7c14c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:02.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.709+0000 7f1e81000700 1 --2- 172.21.15.49:0/1371799566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e7c153e80 0x7f1e7c14c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.709+0000 7f1e81000700 1 -- 172.21.15.49:0/1371799566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e7c0c4500 msgr2=0x7f1e7c0be270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:02.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.709+0000 7f1e81000700 1 --2- 172.21.15.49:0/1371799566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e7c0c4500 0x7f1e7c0be270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.709+0000 7f1e81000700 1 -- 172.21.15.49:0/1371799566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e640092a0 con 0x7f1e7c157510 2024-01-22T05:05:02.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.709+0000 7f1e7be00700 1 --2- 172.21.15.49:0/1371799566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e7c0c4500 0x7f1e7c0be270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:02.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.709+0000 7f1e81000700 1 --2- 172.21.15.49:0/1371799566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e7c157510 0x7f1e7c0c00a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f1e74002230 tx=0x7f1e740015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:02.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.709+0000 7f1e73400700 1 -- 172.21.15.49:0/1371799566 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400e4a0 con 0x7f1e7c157510 2024-01-22T05:05:02.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.709+0000 7f1e73400700 1 -- 172.21.15.49:0/1371799566 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7400e600 con 0x7f1e7c157510 2024-01-22T05:05:02.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.709+0000 7f1e83000700 1 -- 172.21.15.49:0/1371799566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c009370 con 0x7f1e7c157510 2024-01-22T05:05:02.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.709+0000 7f1e73400700 1 -- 172.21.15.49:0/1371799566 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400e980 con 0x7f1e7c157510 2024-01-22T05:05:02.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.709+0000 7f1e83000700 1 -- 172.21.15.49:0/1371799566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7c0be760 con 0x7f1e7c157510 2024-01-22T05:05:02.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.713+0000 7f1e83000700 1 -- 172.21.15.49:0/1371799566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7c0bfd80 con 0x7f1e7c157510 2024-01-22T05:05:02.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.713+0000 7f1e73400700 1 -- 172.21.15.49:0/1371799566 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1e7401b3b0 con 0x7f1e7c157510 2024-01-22T05:05:02.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.713+0000 7f1e73400700 1 --2- 172.21.15.49:0/1371799566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e5405a510 0x7f1e5405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:02.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.713+0000 7f1e73400700 1 -- 172.21.15.49:0/1371799566 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f1e740741b0 con 0x7f1e7c157510 2024-01-22T05:05:02.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.713+0000 7f1e7be00700 1 --2- 172.21.15.49:0/1371799566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e5405a510 0x7f1e5405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:02.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.717+0000 7f1e7be00700 1 --2- 172.21.15.49:0/1371799566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e5405a510 0x7f1e5405c9d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1e6c009130 tx=0x7f1e6c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:02.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.721+0000 7f1e73400700 1 -- 172.21.15.49:0/1371799566 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1e74047610 con 0x7f1e7c157510 2024-01-22T05:05:02.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.885+0000 7f1e83000700 1 -- 172.21.15.49:0/1371799566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e7c0646e0 con 0x7f1e7c157510 2024-01-22T05:05:02.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.885+0000 7f1e73400700 1 -- 172.21.15.49:0/1371799566 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1e7404ac30 con 0x7f1e7c157510 2024-01-22T05:05:02.888 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:05:02.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.889+0000 7f1e83000700 1 -- 172.21.15.49:0/1371799566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e5405a510 msgr2=0x7f1e5405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:02.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.889+0000 7f1e83000700 1 --2- 172.21.15.49:0/1371799566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e5405a510 0x7f1e5405c9d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1e6c009130 tx=0x7f1e6c017000).stop 2024-01-22T05:05:02.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.889+0000 7f1e83000700 1 -- 172.21.15.49:0/1371799566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e7c157510 msgr2=0x7f1e7c0c00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:02.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.889+0000 7f1e83000700 1 --2- 172.21.15.49:0/1371799566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e7c157510 0x7f1e7c0c00a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f1e74002230 tx=0x7f1e740015e0).stop 2024-01-22T05:05:02.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.889+0000 7f1e83000700 1 -- 172.21.15.49:0/1371799566 shutdown_connections 2024-01-22T05:05:02.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.889+0000 7f1e83000700 1 --2- 172.21.15.49:0/1371799566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e5405a510 0x7f1e5405c9d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.889+0000 7f1e83000700 1 --2- 172.21.15.49:0/1371799566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e7c157510 0x7f1e7c0c00a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.889+0000 7f1e83000700 1 --2- 172.21.15.49:0/1371799566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e7c153e80 0x7f1e7c14c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.889+0000 7f1e83000700 1 --2- 172.21.15.49:0/1371799566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e7c0c4500 0x7f1e7c0be270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:02.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.889+0000 7f1e83000700 1 -- 172.21.15.49:0/1371799566 >> 172.21.15.49:0/1371799566 conn(0x7f1e7c0c3f10 msgr2=0x7f1e7c068c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:02.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.893+0000 7f1e83000700 1 -- 172.21.15.49:0/1371799566 shutdown_connections 2024-01-22T05:05:02.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:02.893+0000 7f1e83000700 1 -- 172.21.15.49:0/1371799566 wait complete. 2024-01-22T05:05:02.919 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:05:03.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.081+0000 7f1fc7a00700 1 Processor -- start 2024-01-22T05:05:03.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.081+0000 7f1fc7a00700 1 -- start start 2024-01-22T05:05:03.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.081+0000 7f1fc7a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1fc0155f10 0x7f1fc00bc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.081+0000 7f1fc7a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fc00bc6d0 0x7f1fc0062800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.081+0000 7f1fc7a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc00bcb80 con 0x7f1fc0155b30 2024-01-22T05:05:03.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fc7a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc0159730 con 0x7f1fc0155f10 2024-01-22T05:05:03.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fc7a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00c20c0 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fbfe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1fc0155f10 0x7f1fc00bc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fc5a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fc00bc6d0 0x7f1fc0062800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fc5000700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f1fc0155b30 0x7f1fc00c19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:55026/0 (socket says 172.21.15.49:55026) 2024-01-22T05:05:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fc5000700 1 -- 172.21.15.49:0/1196688197 learned_addr learned my addr 172.21.15.49:0/1196688197 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fbf400700 1 -- 172.21.15.49:0/1196688197 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837574404 0 0) 0x7f1fb0001110 con 0x7f1fc0155b30 2024-01-22T05:05:03.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fbf400700 1 -- 172.21.15.49:0/1196688197 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa00033f0 con 0x7f1fc0155b30 2024-01-22T05:05:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fc5a00700 1 -- 172.21.15.49:0/1196688197 >> v2:172.21.15.110:3300/0 conn(0x7f1fc0155f10 msgr2=0x7f1fc00bc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fc5a00700 1 --2- 172.21.15.49:0/1196688197 >> v2:172.21.15.110:3300/0 conn(0x7f1fc0155f10 0x7f1fc00bc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fc5a00700 1 -- 172.21.15.49:0/1196688197 >> v1:172.21.15.110:6789/0 conn(0x7f1fc0155b30 legacy=0x7f1fc00c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fc5a00700 1 -- 172.21.15.49:0/1196688197 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc00c2ef0 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fbfe00700 1 --2- 172.21.15.49:0/1196688197 >> v2:172.21.15.110:3300/0 conn(0x7f1fc0155f10 0x7f1fc00bc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fc5a00700 1 --2- 172.21.15.49:0/1196688197 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fc00bc6d0 0x7f1fc0062800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1fb8009e60 tx=0x7f1fb8009780).ready entity=mon.2 client_cookie=1de241f0eb25c2f8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:03.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fbf400700 1 -- 172.21.15.49:0/1196688197 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800e070 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fbf400700 1 -- 172.21.15.49:0/1196688197 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb800bab0 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.085+0000 7f1fbf400700 1 -- 172.21.15.49:0/1196688197 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800be30 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.089+0000 7f1fc7a00700 1 -- 172.21.15.49:0/1196688197 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fc00bc6d0 msgr2=0x7f1fc0062800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.089+0000 7f1fc7a00700 1 --2- 172.21.15.49:0/1196688197 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fc00bc6d0 0x7f1fc0062800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1fb8009e60 tx=0x7f1fb8009780).stop 2024-01-22T05:05:03.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.089+0000 7f1fc7a00700 1 -- 172.21.15.49:0/1196688197 shutdown_connections 2024-01-22T05:05:03.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.089+0000 7f1fc7a00700 1 --2- 172.21.15.49:0/1196688197 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fc00bc6d0 0x7f1fc0062800 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.089+0000 7f1fc7a00700 1 --2- 172.21.15.49:0/1196688197 >> v2:172.21.15.110:3300/0 conn(0x7f1fc0155f10 0x7f1fc00bc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.089+0000 7f1fc7a00700 1 -- 172.21.15.49:0/1196688197 >> 172.21.15.49:0/1196688197 conn(0x7f1fc00c3900 msgr2=0x7f1fc00c3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:03.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.089+0000 7f1fc7a00700 1 -- 172.21.15.49:0/1196688197 shutdown_connections 2024-01-22T05:05:03.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.089+0000 7f1fc7a00700 1 -- 172.21.15.49:0/1196688197 wait complete. 2024-01-22T05:05:03.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.089+0000 7f1fc7a00700 1 Processor -- start 2024-01-22T05:05:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc7a00700 1 -- start start 2024-01-22T05:05:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc7a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fc00bc6d0 0x7f1fc00bdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc7a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc0155b30 0x7f1fc00c0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc7a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fc0155f10 0x7f1fc0153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc7a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00c0840 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc7a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00bff10 con 0x7f1fc0155b30 2024-01-22T05:05:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc7a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00c01f0 con 0x7f1fc0155f10 2024-01-22T05:05:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fc00bc6d0 0x7f1fc00bdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fc00bc6d0 0x7f1fc00bdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36606/0 (socket says 172.21.15.49:36606) 2024-01-22T05:05:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc5000700 1 -- 172.21.15.49:0/1789853848 learned_addr learned my addr 172.21.15.49:0/1789853848 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fbfe00700 1 --2- 172.21.15.49:0/1789853848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc0155b30 0x7f1fc00c0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc5a00700 1 --2- 172.21.15.49:0/1789853848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fc0155f10 0x7f1fc0153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc5000700 1 -- 172.21.15.49:0/1789853848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fc0155f10 msgr2=0x7f1fc0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc5000700 1 --2- 172.21.15.49:0/1789853848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fc0155f10 0x7f1fc0153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc5000700 1 -- 172.21.15.49:0/1789853848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc0155b30 msgr2=0x7f1fc00c0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc5000700 1 --2- 172.21.15.49:0/1789853848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc0155b30 0x7f1fc00c0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc5000700 1 -- 172.21.15.49:0/1789853848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa80092a0 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.093+0000 7f1fc5000700 1 --2- 172.21.15.49:0/1789853848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fc00bc6d0 0x7f1fc00bdf00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f1fb000c4a0 tx=0x7f1fb0007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.097+0000 7f1fb7e00700 1 -- 172.21.15.49:0/1789853848 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb000ce50 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.097+0000 7f1fb7e00700 1 -- 172.21.15.49:0/1789853848 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb00072e0 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.097+0000 7f1fc7a00700 1 -- 172.21.15.49:0/1789853848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb8009a20 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.097+0000 7f1fb7e00700 1 -- 172.21.15.49:0/1789853848 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00057a0 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.097+0000 7f1fc7a00700 1 -- 172.21.15.49:0/1789853848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc00bfbe0 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.097+0000 7f1fc7a00700 1 -- 172.21.15.49:0/1789853848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc0065280 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.101+0000 7f1fb7e00700 1 -- 172.21.15.49:0/1789853848 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1fb0005bd0 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.101+0000 7f1fb7e00700 1 --2- 172.21.15.49:0/1789853848 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1f9805a510 0x7f1f9805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.101+0000 7f1fb7e00700 1 -- 172.21.15.49:0/1789853848 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f1fb0074050 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.101+0000 7f1fbfe00700 1 --2- 172.21.15.49:0/1789853848 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1f9805a510 0x7f1f9805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.101+0000 7f1fbfe00700 1 --2- 172.21.15.49:0/1789853848 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1f9805a510 0x7f1f9805c9d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1fc01553c0 tx=0x7f1fa8009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:03.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.109+0000 7f1fb7e00700 1 -- 172.21.15.49:0/1789853848 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1fb0047520 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.277+0000 7f1fc7a00700 1 -- 172.21.15.49:0/1789853848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1fc00bcb80 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.277+0000 7f1fb7e00700 1 -- 172.21.15.49:0/1789853848 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1fc00bcb80 con 0x7f1fc00bc6d0 2024-01-22T05:05:03.279 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:05:03.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.281+0000 7f1fc7a00700 1 -- 172.21.15.49:0/1789853848 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1f9805a510 msgr2=0x7f1f9805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.281+0000 7f1fc7a00700 1 --2- 172.21.15.49:0/1789853848 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1f9805a510 0x7f1f9805c9d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1fc01553c0 tx=0x7f1fa8009060).stop 2024-01-22T05:05:03.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.281+0000 7f1fc7a00700 1 -- 172.21.15.49:0/1789853848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fc00bc6d0 msgr2=0x7f1fc00bdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.281+0000 7f1fc7a00700 1 --2- 172.21.15.49:0/1789853848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fc00bc6d0 0x7f1fc00bdf00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f1fb000c4a0 tx=0x7f1fb0007af0).stop 2024-01-22T05:05:03.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.281+0000 7f1fc7a00700 1 -- 172.21.15.49:0/1789853848 shutdown_connections 2024-01-22T05:05:03.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.281+0000 7f1fc7a00700 1 --2- 172.21.15.49:0/1789853848 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1f9805a510 0x7f1f9805c9d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.281+0000 7f1fc7a00700 1 --2- 172.21.15.49:0/1789853848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fc0155f10 0x7f1fc0153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.281+0000 7f1fc7a00700 1 --2- 172.21.15.49:0/1789853848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc0155b30 0x7f1fc00c0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.281+0000 7f1fc7a00700 1 --2- 172.21.15.49:0/1789853848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fc00bc6d0 0x7f1fc00bdf00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.281+0000 7f1fc7a00700 1 -- 172.21.15.49:0/1789853848 >> 172.21.15.49:0/1789853848 conn(0x7f1fc00c3900 msgr2=0x7f1fc0058c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:03.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.281+0000 7f1fc7a00700 1 -- 172.21.15.49:0/1789853848 shutdown_connections 2024-01-22T05:05:03.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.281+0000 7f1fc7a00700 1 -- 172.21.15.49:0/1789853848 wait complete. 2024-01-22T05:05:03.309 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-22T05:05:03.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.473+0000 7ffa39000700 1 Processor -- start 2024-01-22T05:05:03.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.473+0000 7ffa39000700 1 -- start start 2024-01-22T05:05:03.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.477+0000 7ffa39000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffa340644c0 0x7ffa340bc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.477+0000 7ffa39000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa34069b70 con 0x7ffa34068960 2024-01-22T05:05:03.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.477+0000 7ffa39000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa340c3510 con 0x7ffa3415c6e0 2024-01-22T05:05:03.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.477+0000 7ffa39000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa341586a0 con 0x7ffa340644c0 2024-01-22T05:05:03.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.477+0000 7ffa33400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ffa34068960 0x7ffa340bda90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54556/0 (socket says 172.21.15.49:54556) 2024-01-22T05:05:03.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.477+0000 7ffa33400700 1 -- 172.21.15.49:0/11758081 learned_addr learned my addr 172.21.15.49:0/11758081 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:03.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.477+0000 7ffa33e00700 1 --2- 172.21.15.49:0/11758081 >> v2:172.21.15.110:3300/0 conn(0x7ffa340644c0 0x7ffa340bc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa32000700 1 -- 172.21.15.49:0/11758081 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812951293 0 0) 0x7ffa34069b70 con 0x7ffa34068960 2024-01-22T05:05:03.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa32000700 1 -- 172.21.15.49:0/11758081 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa140033f0 con 0x7ffa34068960 2024-01-22T05:05:03.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa32000700 1 -- 172.21.15.49:0/11758081 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388631755 0 0) 0x7ffa340c3510 con 0x7ffa3415c6e0 2024-01-22T05:05:03.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa32000700 1 -- 172.21.15.49:0/11758081 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa34069b70 con 0x7ffa3415c6e0 2024-01-22T05:05:03.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa33e00700 1 -- 172.21.15.49:0/11758081 >> v1:172.21.15.110:6789/0 conn(0x7ffa3415c6e0 legacy=0x7ffa34063db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa32000700 1 -- 172.21.15.49:0/11758081 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2950175359 0 0) 0x7ffa140033f0 con 0x7ffa34068960 2024-01-22T05:05:03.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa33e00700 1 -- 172.21.15.49:0/11758081 >> v1:172.21.15.49:6789/0 conn(0x7ffa34068960 legacy=0x7ffa340bda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa33e00700 1 -- 172.21.15.49:0/11758081 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3415cb40 con 0x7ffa340644c0 2024-01-22T05:05:03.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa33e00700 1 --2- 172.21.15.49:0/11758081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa340644c0 0x7ffa340bc5b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7ffa2c009e60 tx=0x7ffa2c009780).ready entity=mon.1 client_cookie=56445c2e6aefd007 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:03.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa32000700 1 -- 172.21.15.49:0/11758081 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c00e070 con 0x7ffa340644c0 2024-01-22T05:05:03.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa32000700 1 -- 172.21.15.49:0/11758081 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2c00b7a0 con 0x7ffa340644c0 2024-01-22T05:05:03.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa32000700 1 -- 172.21.15.49:0/11758081 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa240015f0 con 0x7ffa340644c0 2024-01-22T05:05:03.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa39000700 1 -- 172.21.15.49:0/11758081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa340644c0 msgr2=0x7ffa340bc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa39000700 1 --2- 172.21.15.49:0/11758081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa340644c0 0x7ffa340bc5b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7ffa2c009e60 tx=0x7ffa2c009780).stop 2024-01-22T05:05:03.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa39000700 1 -- 172.21.15.49:0/11758081 shutdown_connections 2024-01-22T05:05:03.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa39000700 1 --2- 172.21.15.49:0/11758081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa340644c0 0x7ffa340bc5b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.481+0000 7ffa39000700 1 -- 172.21.15.49:0/11758081 >> 172.21.15.49:0/11758081 conn(0x7ffa340667c0 msgr2=0x7ffa34066bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:03.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.485+0000 7ffa39000700 1 -- 172.21.15.49:0/11758081 shutdown_connections 2024-01-22T05:05:03.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.485+0000 7ffa39000700 1 -- 172.21.15.49:0/11758081 wait complete. 2024-01-22T05:05:03.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.485+0000 7ffa39000700 1 Processor -- start 2024-01-22T05:05:03.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.489+0000 7ffa39000700 1 -- start start 2024-01-22T05:05:03.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.489+0000 7ffa39000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa340644c0 0x7ffa341498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.489+0000 7ffa39000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa34068960 0x7ffa341587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.489+0000 7ffa39000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa3415c6e0 0x7ffa34158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.489+0000 7ffa39000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa34159870 con 0x7ffa3415c6e0 2024-01-22T05:05:03.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.489+0000 7ffa39000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa340beb90 con 0x7ffa340644c0 2024-01-22T05:05:03.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.489+0000 7ffa39000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa341592b0 con 0x7ffa34068960 2024-01-22T05:05:03.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.489+0000 7ffa33e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa3415c6e0 0x7ffa34158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.489+0000 7ffa33e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa3415c6e0 0x7ffa34158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47884/0 (socket says 172.21.15.49:47884) 2024-01-22T05:05:03.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.489+0000 7ffa33e00700 1 -- 172.21.15.49:0/3826713643 learned_addr learned my addr 172.21.15.49:0/3826713643 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:03.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.489+0000 7ffa33400700 1 --2- 172.21.15.49:0/3826713643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa340644c0 0x7ffa341498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.489+0000 7ffa32a00700 1 --2- 172.21.15.49:0/3826713643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa34068960 0x7ffa341587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.493+0000 7ffa33e00700 1 -- 172.21.15.49:0/3826713643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa34068960 msgr2=0x7ffa341587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.493+0000 7ffa33e00700 1 --2- 172.21.15.49:0/3826713643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa34068960 0x7ffa341587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.493+0000 7ffa33e00700 1 -- 172.21.15.49:0/3826713643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa340644c0 msgr2=0x7ffa341498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.493+0000 7ffa33e00700 1 --2- 172.21.15.49:0/3826713643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa340644c0 0x7ffa341498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.493+0000 7ffa33e00700 1 -- 172.21.15.49:0/3826713643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2c009a20 con 0x7ffa3415c6e0 2024-01-22T05:05:03.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.493+0000 7ffa33e00700 1 --2- 172.21.15.49:0/3826713643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa3415c6e0 0x7ffa34158ce0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7ffa2c00b610 tx=0x7ffa34069ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:03.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.493+0000 7ffa2aa00700 1 -- 172.21.15.49:0/3826713643 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c009460 con 0x7ffa3415c6e0 2024-01-22T05:05:03.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.493+0000 7ffa2aa00700 1 -- 172.21.15.49:0/3826713643 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2c01d470 con 0x7ffa3415c6e0 2024-01-22T05:05:03.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.493+0000 7ffa2aa00700 1 -- 172.21.15.49:0/3826713643 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c01d810 con 0x7ffa3415c6e0 2024-01-22T05:05:03.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.493+0000 7ffa39000700 1 -- 172.21.15.49:0/3826713643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa34159590 con 0x7ffa3415c6e0 2024-01-22T05:05:03.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.493+0000 7ffa39000700 1 -- 172.21.15.49:0/3826713643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa34154f40 con 0x7ffa3415c6e0 2024-01-22T05:05:03.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.493+0000 7ffa39000700 1 -- 172.21.15.49:0/3826713643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa340bed20 con 0x7ffa3415c6e0 2024-01-22T05:05:03.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.497+0000 7ffa2aa00700 1 -- 172.21.15.49:0/3826713643 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ffa2c01dc00 con 0x7ffa3415c6e0 2024-01-22T05:05:03.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.497+0000 7ffa2aa00700 1 --2- 172.21.15.49:0/3826713643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa0c05a510 0x7ffa0c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.497+0000 7ffa2aa00700 1 -- 172.21.15.49:0/3826713643 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7ffa2c076990 con 0x7ffa3415c6e0 2024-01-22T05:05:03.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.497+0000 7ffa33400700 1 --2- 172.21.15.49:0/3826713643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa0c05a510 0x7ffa0c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.501+0000 7ffa33400700 1 --2- 172.21.15.49:0/3826713643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa0c05a510 0x7ffa0c05c9d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ffa24000ef0 tx=0x7ffa240016e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:03.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.505+0000 7ffa2aa00700 1 -- 172.21.15.49:0/3826713643 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffa2c049da0 con 0x7ffa3415c6e0 2024-01-22T05:05:03.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.665+0000 7ffa39000700 1 -- 172.21.15.49:0/3826713643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ffa34046800 con 0x7ffa3415c6e0 2024-01-22T05:05:03.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.669+0000 7ffa2aa00700 1 -- 172.21.15.49:0/3826713643 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7ffa2c04d3c0 con 0x7ffa3415c6e0 2024-01-22T05:05:03.671 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-22T05:05:03.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.673+0000 7ffa39000700 1 -- 172.21.15.49:0/3826713643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa0c05a510 msgr2=0x7ffa0c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.673+0000 7ffa39000700 1 --2- 172.21.15.49:0/3826713643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa0c05a510 0x7ffa0c05c9d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ffa24000ef0 tx=0x7ffa240016e0).stop 2024-01-22T05:05:03.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.673+0000 7ffa39000700 1 -- 172.21.15.49:0/3826713643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa3415c6e0 msgr2=0x7ffa34158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.673+0000 7ffa39000700 1 --2- 172.21.15.49:0/3826713643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa3415c6e0 0x7ffa34158ce0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7ffa2c00b610 tx=0x7ffa34069ae0).stop 2024-01-22T05:05:03.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.673+0000 7ffa39000700 1 -- 172.21.15.49:0/3826713643 shutdown_connections 2024-01-22T05:05:03.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.673+0000 7ffa39000700 1 --2- 172.21.15.49:0/3826713643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa0c05a510 0x7ffa0c05c9d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.673+0000 7ffa39000700 1 --2- 172.21.15.49:0/3826713643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa3415c6e0 0x7ffa34158ce0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.673+0000 7ffa39000700 1 --2- 172.21.15.49:0/3826713643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa34068960 0x7ffa341587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.673+0000 7ffa39000700 1 --2- 172.21.15.49:0/3826713643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa340644c0 0x7ffa341498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.673+0000 7ffa39000700 1 -- 172.21.15.49:0/3826713643 >> 172.21.15.49:0/3826713643 conn(0x7ffa340667c0 msgr2=0x7ffa34155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:03.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.673+0000 7ffa39000700 1 -- 172.21.15.49:0/3826713643 shutdown_connections 2024-01-22T05:05:03.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.673+0000 7ffa39000700 1 -- 172.21.15.49:0/3826713643 wait complete. 2024-01-22T05:05:03.699 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:05:03.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.861+0000 7f228e000700 1 Processor -- start 2024-01-22T05:05:03.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.861+0000 7f228e000700 1 -- start start 2024-01-22T05:05:03.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f228e000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2288064c00 0x7f22880bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f228e000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2288065620 0x7f22880bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f228e000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22880c2700 con 0x7f2288065240 2024-01-22T05:05:03.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f228e000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22880c29a0 con 0x7f2288065620 2024-01-22T05:05:03.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f228e000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22880c2c80 con 0x7f2288064c00 2024-01-22T05:05:03.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f228ca00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2288065620 0x7f22880bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f228ca00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2288065620 0x7f22880bd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47886/0 (socket says 172.21.15.49:47886) 2024-01-22T05:05:03.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f228ca00700 1 -- 172.21.15.49:0/80046278 learned_addr learned my addr 172.21.15.49:0/80046278 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:03.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f2286a00700 1 --2- 172.21.15.49:0/80046278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2288064c00 0x7f22880bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f228ca00700 1 -- 172.21.15.49:0/80046278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2288064c00 msgr2=0x7f22880bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:03.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f228ca00700 1 --2- 172.21.15.49:0/80046278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2288064c00 0x7f22880bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f228ca00700 1 -- 172.21.15.49:0/80046278 >> v1:172.21.15.110:6789/0 conn(0x7f2288065240 legacy=0x7f22880644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f228ca00700 1 -- 172.21.15.49:0/80046278 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22880c2f60 con 0x7f2288065620 2024-01-22T05:05:03.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f2286a00700 1 --2- 172.21.15.49:0/80046278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2288064c00 0x7f22880bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:03.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f228ca00700 1 --2- 172.21.15.49:0/80046278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288065620 0x7f22880bd170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f2280009f20 tx=0x7f2280009840).ready entity=mon.0 client_cookie=f26d0cb161084a9d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:03.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f2286000700 1 -- 172.21.15.49:0/80046278 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228000e070 con 0x7f2288065620 2024-01-22T05:05:03.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f2286000700 1 -- 172.21.15.49:0/80046278 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228000ba80 con 0x7f2288065620 2024-01-22T05:05:03.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.865+0000 7f2286000700 1 -- 172.21.15.49:0/80046278 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228000be00 con 0x7f2288065620 2024-01-22T05:05:03.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.869+0000 7f228e000700 1 -- 172.21.15.49:0/80046278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288065620 msgr2=0x7f22880bd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.869+0000 7f228e000700 1 --2- 172.21.15.49:0/80046278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288065620 0x7f22880bd170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f2280009f20 tx=0x7f2280009840).stop 2024-01-22T05:05:03.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.869+0000 7f228e000700 1 -- 172.21.15.49:0/80046278 shutdown_connections 2024-01-22T05:05:03.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.869+0000 7f228e000700 1 --2- 172.21.15.49:0/80046278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288065620 0x7f22880bd170 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.869+0000 7f228e000700 1 --2- 172.21.15.49:0/80046278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2288064c00 0x7f22880bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.869+0000 7f228e000700 1 -- 172.21.15.49:0/80046278 >> 172.21.15.49:0/80046278 conn(0x7f22880c87f0 msgr2=0x7f22880c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:03.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.869+0000 7f228e000700 1 -- 172.21.15.49:0/80046278 shutdown_connections 2024-01-22T05:05:03.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.869+0000 7f228e000700 1 -- 172.21.15.49:0/80046278 wait complete. 2024-01-22T05:05:03.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.869+0000 7f228e000700 1 Processor -- start 2024-01-22T05:05:03.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f228e000700 1 -- start start 2024-01-22T05:05:03.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f228e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288064c00 0x7f2288140b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f228e000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2288065240 0x7f2288141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f228e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2288065620 0x7f22880bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f228e000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2288144030 con 0x7f2288064c00 2024-01-22T05:05:03.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f228e000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2288142460 con 0x7f2288065620 2024-01-22T05:05:03.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f228e000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22881408b0 con 0x7f2288065240 2024-01-22T05:05:03.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f2287400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288064c00 0x7f2288140b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f2287400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288064c00 0x7f2288140b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47890/0 (socket says 172.21.15.49:47890) 2024-01-22T05:05:03.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f2287400700 1 -- 172.21.15.49:0/426453917 learned_addr learned my addr 172.21.15.49:0/426453917 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:03.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f228ca00700 1 --2- 172.21.15.49:0/426453917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2288065620 0x7f22880bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f2286a00700 1 --2- 172.21.15.49:0/426453917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2288065240 0x7f2288141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f2287400700 1 -- 172.21.15.49:0/426453917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2288065240 msgr2=0x7f2288141050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f2287400700 1 --2- 172.21.15.49:0/426453917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2288065240 0x7f2288141050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f2287400700 1 -- 172.21.15.49:0/426453917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2288065620 msgr2=0x7f22880bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:03.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f2287400700 1 --2- 172.21.15.49:0/426453917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2288065620 0x7f22880bf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:03.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f2287400700 1 -- 172.21.15.49:0/426453917 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2280009ae0 con 0x7f2288064c00 2024-01-22T05:05:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f228ca00700 1 --2- 172.21.15.49:0/426453917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2288065620 0x7f22880bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f2287400700 1 --2- 172.21.15.49:0/426453917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288064c00 0x7f2288140b60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f227800c4c0 tx=0x7f2278007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f227ea00700 1 -- 172.21.15.49:0/426453917 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278007020 con 0x7f2288064c00 2024-01-22T05:05:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f227ea00700 1 -- 172.21.15.49:0/426453917 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2278001e90 con 0x7f2288064c00 2024-01-22T05:05:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.873+0000 7f228e000700 1 -- 172.21.15.49:0/426453917 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2288141850 con 0x7f2288064c00 2024-01-22T05:05:03.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.877+0000 7f227ea00700 1 -- 172.21.15.49:0/426453917 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780073b0 con 0x7f2288064c00 2024-01-22T05:05:03.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.877+0000 7f228e000700 1 -- 172.21.15.49:0/426453917 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2288141e10 con 0x7f2288064c00 2024-01-22T05:05:03.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.877+0000 7f228e000700 1 -- 172.21.15.49:0/426453917 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2288047060 con 0x7f2288064c00 2024-01-22T05:05:03.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.877+0000 7f227ea00700 1 -- 172.21.15.49:0/426453917 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f22780068b0 con 0x7f2288064c00 2024-01-22T05:05:03.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.881+0000 7f227ea00700 1 --2- 172.21.15.49:0/426453917 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f226005a510 0x7f226005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:03.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.881+0000 7f227ea00700 1 -- 172.21.15.49:0/426453917 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f2278074560 con 0x7f2288064c00 2024-01-22T05:05:03.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.881+0000 7f2286a00700 1 --2- 172.21.15.49:0/426453917 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f226005a510 0x7f226005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:03.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.881+0000 7f2286a00700 1 --2- 172.21.15.49:0/426453917 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f226005a510 0x7f226005c9d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f2288159390 tx=0x7f2270008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:03.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:03.885+0000 7f227ea00700 1 -- 172.21.15.49:0/426453917 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2278047970 con 0x7f2288064c00 2024-01-22T05:05:04.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.085+0000 7f228e000700 1 -- 172.21.15.49:0/426453917 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22880c3240 con 0x7f2288064c00 2024-01-22T05:05:04.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.085+0000 7f227ea00700 1 -- 172.21.15.49:0/426453917 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4491 (secure 0 0 0) 0x7f227804af90 con 0x7f2288064c00 2024-01-22T05:05:04.089 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:04.089 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/4240919875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4240919875},{"type":"v1","addr":"172.21.15.49:6836","nonce":4240919875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3591660134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3591660134},{"type":"v1","addr":"172.21.15.49:6837","nonce":3591660134}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1228202507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1228202507},{"type":"v1","addr":"172.21.15.110:6833","nonce":1228202507}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:04:35.017706+0000","modified":"2024-01-22T05:04:49.308211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3391981756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3391981756},{"type":"v1","addr":"172.21.15.110:6835","nonce":3391981756}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:05:04.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.089+0000 7f228e000700 1 -- 172.21.15.49:0/426453917 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f226005a510 msgr2=0x7f226005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:04.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.089+0000 7f228e000700 1 --2- 172.21.15.49:0/426453917 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f226005a510 0x7f226005c9d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f2288159390 tx=0x7f2270008040).stop 2024-01-22T05:05:04.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.089+0000 7f228e000700 1 -- 172.21.15.49:0/426453917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288064c00 msgr2=0x7f2288140b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:04.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.089+0000 7f228e000700 1 --2- 172.21.15.49:0/426453917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288064c00 0x7f2288140b60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f227800c4c0 tx=0x7f2278007e00).stop 2024-01-22T05:05:04.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.089+0000 7f228e000700 1 -- 172.21.15.49:0/426453917 shutdown_connections 2024-01-22T05:05:04.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.089+0000 7f228e000700 1 --2- 172.21.15.49:0/426453917 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f226005a510 0x7f226005c9d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.089+0000 7f228e000700 1 --2- 172.21.15.49:0/426453917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2288065620 0x7f22880bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.089+0000 7f228e000700 1 --2- 172.21.15.49:0/426453917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2288065240 0x7f2288141050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.089+0000 7f228e000700 1 --2- 172.21.15.49:0/426453917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288064c00 0x7f2288140b60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.089+0000 7f228e000700 1 -- 172.21.15.49:0/426453917 >> 172.21.15.49:0/426453917 conn(0x7f22880c87f0 msgr2=0x7f22880639a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:04.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.089+0000 7f228e000700 1 -- 172.21.15.49:0/426453917 shutdown_connections 2024-01-22T05:05:04.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.089+0000 7f228e000700 1 -- 172.21.15.49:0/426453917 wait complete. 2024-01-22T05:05:04.097 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-22T05:05:04.115 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:05:04.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.281+0000 7f3238c00700 1 Processor -- start 2024-01-22T05:05:04.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.281+0000 7f3238c00700 1 -- start start 2024-01-22T05:05:04.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.281+0000 7f3238c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f32341547c0 0x7f32340c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:04.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.281+0000 7f3238c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32341500b0 0x7f3234068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:04.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.281+0000 7f3238c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3234068f90 0x7f32340bbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:04.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.281+0000 7f3238c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3234066950 con 0x7f3234068f90 2024-01-22T05:05:04.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.281+0000 7f3238c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3234069400 con 0x7f32341547c0 2024-01-22T05:05:04.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.281+0000 7f3238c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32340c2330 con 0x7f32341500b0 2024-01-22T05:05:04.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3232800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3234068f90 0x7f32340bbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:04.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3231e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f32341547c0 0x7f32340c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:04.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3231400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32341500b0 0x7f3234068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:04.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3232800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3234068f90 0x7f32340bbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47900/0 (socket says 172.21.15.49:47900) 2024-01-22T05:05:04.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3232800700 1 -- 172.21.15.49:0/370487388 learned_addr learned my addr 172.21.15.49:0/370487388 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:04.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3232800700 1 -- 172.21.15.49:0/370487388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32341500b0 msgr2=0x7f3234068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:04.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3232800700 1 --2- 172.21.15.49:0/370487388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32341500b0 0x7f3234068aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3232800700 1 -- 172.21.15.49:0/370487388 >> v2:172.21.15.110:3300/0 conn(0x7f32341547c0 msgr2=0x7f32340c30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:04.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3232800700 1 --2- 172.21.15.49:0/370487388 >> v2:172.21.15.110:3300/0 conn(0x7f32341547c0 0x7f32340c30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3232800700 1 -- 172.21.15.49:0/370487388 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32340c2610 con 0x7f3234068f90 2024-01-22T05:05:04.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3231400700 1 --2- 172.21.15.49:0/370487388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32341500b0 0x7f3234068aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:04.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3232800700 1 --2- 172.21.15.49:0/370487388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3234068f90 0x7f32340bbf10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f32340c6cd0 tx=0x7f322c009840).ready entity=mon.0 client_cookie=b7d1572ec2230a54 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:04.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3230a00700 1 -- 172.21.15.49:0/370487388 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c00e070 con 0x7f3234068f90 2024-01-22T05:05:04.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3230a00700 1 -- 172.21.15.49:0/370487388 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c00b970 con 0x7f3234068f90 2024-01-22T05:05:04.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3230a00700 1 -- 172.21.15.49:0/370487388 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c00bcf0 con 0x7f3234068f90 2024-01-22T05:05:04.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3238c00700 1 -- 172.21.15.49:0/370487388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3234068f90 msgr2=0x7f32340bbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:04.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3238c00700 1 --2- 172.21.15.49:0/370487388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3234068f90 0x7f32340bbf10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f32340c6cd0 tx=0x7f322c009840).stop 2024-01-22T05:05:04.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3238c00700 1 -- 172.21.15.49:0/370487388 shutdown_connections 2024-01-22T05:05:04.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3238c00700 1 --2- 172.21.15.49:0/370487388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3234068f90 0x7f32340bbf10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3238c00700 1 --2- 172.21.15.49:0/370487388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32341500b0 0x7f3234068aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3238c00700 1 --2- 172.21.15.49:0/370487388 >> v2:172.21.15.110:3300/0 conn(0x7f32341547c0 0x7f32340c30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.285+0000 7f3238c00700 1 -- 172.21.15.49:0/370487388 >> 172.21.15.49:0/370487388 conn(0x7f32340c4300 msgr2=0x7f3234065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:04.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.289+0000 7f3238c00700 1 -- 172.21.15.49:0/370487388 shutdown_connections 2024-01-22T05:05:04.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.289+0000 7f3238c00700 1 -- 172.21.15.49:0/370487388 wait complete. 2024-01-22T05:05:04.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.289+0000 7f3238c00700 1 Processor -- start 2024-01-22T05:05:04.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.289+0000 7f3238c00700 1 -- start start 2024-01-22T05:05:04.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3238c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3234068f90 0x7f323414cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:04.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3238c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32341500b0 0x7f32340a9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:04.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3238c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32341547c0 0x7f32341459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:04.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3238c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32340a9750 con 0x7f32341547c0 2024-01-22T05:05:04.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3238c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32340bf260 con 0x7f32341500b0 2024-01-22T05:05:04.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3238c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32340beca0 con 0x7f3234068f90 2024-01-22T05:05:04.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3232800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32341547c0 0x7f32341459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3232800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32341547c0 0x7f32341459e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47908/0 (socket says 172.21.15.49:47908) 2024-01-22T05:05:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3232800700 1 -- 172.21.15.49:0/2912131929 learned_addr learned my addr 172.21.15.49:0/2912131929 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3231400700 1 --2- 172.21.15.49:0/2912131929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32341500b0 0x7f32340a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3231e00700 1 --2- 172.21.15.49:0/2912131929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3234068f90 0x7f323414cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3232800700 1 -- 172.21.15.49:0/2912131929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3234068f90 msgr2=0x7f323414cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3232800700 1 --2- 172.21.15.49:0/2912131929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3234068f90 0x7f323414cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3232800700 1 -- 172.21.15.49:0/2912131929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32341500b0 msgr2=0x7f32340a9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3232800700 1 --2- 172.21.15.49:0/2912131929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32341500b0 0x7f32340a9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3232800700 1 -- 172.21.15.49:0/2912131929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c0092a0 con 0x7f32341547c0 2024-01-22T05:05:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3232800700 1 --2- 172.21.15.49:0/2912131929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32341547c0 0x7f32341459e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f322c00b610 tx=0x7f322c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:04.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3229600700 1 -- 172.21.15.49:0/2912131929 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c00bcf0 con 0x7f32341547c0 2024-01-22T05:05:04.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3229600700 1 -- 172.21.15.49:0/2912131929 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c0092e0 con 0x7f32341547c0 2024-01-22T05:05:04.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3238c00700 1 -- 172.21.15.49:0/2912131929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322c009ae0 con 0x7f32341547c0 2024-01-22T05:05:04.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3229600700 1 -- 172.21.15.49:0/2912131929 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c01d6b0 con 0x7f32341547c0 2024-01-22T05:05:04.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.293+0000 7f3238c00700 1 -- 172.21.15.49:0/2912131929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323414c2f0 con 0x7f32341547c0 2024-01-22T05:05:04.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.297+0000 7f3238c00700 1 -- 172.21.15.49:0/2912131929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3234064b90 con 0x7f32341547c0 2024-01-22T05:05:04.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.297+0000 7f3229600700 1 -- 172.21.15.49:0/2912131929 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f322c003040 con 0x7f32341547c0 2024-01-22T05:05:04.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.297+0000 7f3229600700 1 --2- 172.21.15.49:0/2912131929 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f320c05a510 0x7f320c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:04.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.297+0000 7f3229600700 1 -- 172.21.15.49:0/2912131929 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f322c075ed0 con 0x7f32341547c0 2024-01-22T05:05:04.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.297+0000 7f3231e00700 1 --2- 172.21.15.49:0/2912131929 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f320c05a510 0x7f320c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:04.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.301+0000 7f3231e00700 1 --2- 172.21.15.49:0/2912131929 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f320c05a510 0x7f320c05c9d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f3224009bc0 tx=0x7f3224008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:04.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.305+0000 7f3229600700 1 -- 172.21.15.49:0/2912131929 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f322c0492e0 con 0x7f32341547c0 2024-01-22T05:05:04.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.465+0000 7f3238c00700 1 -- 172.21.15.49:0/2912131929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32340a6720 con 0x7f32341547c0 2024-01-22T05:05:04.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.469+0000 7f3229600700 1 -- 172.21.15.49:0/2912131929 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f322c022030 con 0x7f32341547c0 2024-01-22T05:05:04.471 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:04.472 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:39.526211+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:05:04.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.473+0000 7f3238c00700 1 -- 172.21.15.49:0/2912131929 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f320c05a510 msgr2=0x7f320c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:04.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.473+0000 7f3238c00700 1 --2- 172.21.15.49:0/2912131929 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f320c05a510 0x7f320c05c9d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f3224009bc0 tx=0x7f3224008040).stop 2024-01-22T05:05:04.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.473+0000 7f3238c00700 1 -- 172.21.15.49:0/2912131929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32341547c0 msgr2=0x7f32341459e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:04.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.473+0000 7f3238c00700 1 --2- 172.21.15.49:0/2912131929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32341547c0 0x7f32341459e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f322c00b610 tx=0x7f322c009840).stop 2024-01-22T05:05:04.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.473+0000 7f3238c00700 1 -- 172.21.15.49:0/2912131929 shutdown_connections 2024-01-22T05:05:04.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.473+0000 7f3238c00700 1 --2- 172.21.15.49:0/2912131929 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f320c05a510 0x7f320c05c9d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.473+0000 7f3238c00700 1 --2- 172.21.15.49:0/2912131929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32341547c0 0x7f32341459e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.473+0000 7f3238c00700 1 --2- 172.21.15.49:0/2912131929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32341500b0 0x7f32340a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.473+0000 7f3238c00700 1 --2- 172.21.15.49:0/2912131929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3234068f90 0x7f323414cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.473+0000 7f3238c00700 1 -- 172.21.15.49:0/2912131929 >> 172.21.15.49:0/2912131929 conn(0x7f32340c4300 msgr2=0x7f3234067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:04.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.473+0000 7f3238c00700 1 -- 172.21.15.49:0/2912131929 shutdown_connections 2024-01-22T05:05:04.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.473+0000 7f3238c00700 1 -- 172.21.15.49:0/2912131929 wait complete. 2024-01-22T05:05:04.499 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:05:04.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.657+0000 7f4129800700 1 Processor -- start 2024-01-22T05:05:04.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.661+0000 7f4129800700 1 -- start start 2024-01-22T05:05:04.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.661+0000 7f4129800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4124155d20 0x7f4124065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:04.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.661+0000 7f4129800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f41240a8e50 0x7f41240c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:04.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.661+0000 7f4129800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41240c1a40 con 0x7f4124066070 2024-01-22T05:05:04.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.661+0000 7f4129800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4124159310 con 0x7f41240a8e50 2024-01-22T05:05:04.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.661+0000 7f4129800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41240c13f0 con 0x7f4124155d20 2024-01-22T05:05:04.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.661+0000 7f4123400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f41240a8e50 0x7f41240c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:04.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4123400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f41240a8e50 0x7f41240c1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47912/0 (socket says 172.21.15.49:47912) 2024-01-22T05:05:04.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4123400700 1 -- 172.21.15.49:0/3264579463 learned_addr learned my addr 172.21.15.49:0/3264579463 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:04.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4122a00700 1 --2- 172.21.15.49:0/3264579463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4124155d20 0x7f4124065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:04.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4123400700 1 -- 172.21.15.49:0/3264579463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4124155d20 msgr2=0x7f4124065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:04.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4123400700 1 --2- 172.21.15.49:0/3264579463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4124155d20 0x7f4124065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4123400700 1 -- 172.21.15.49:0/3264579463 >> v1:172.21.15.110:6789/0 conn(0x7f4124066070 legacy=0x7f41240a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:04.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4123400700 1 -- 172.21.15.49:0/3264579463 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41240c16d0 con 0x7f41240a8e50 2024-01-22T05:05:04.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4123400700 1 --2- 172.21.15.49:0/3264579463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41240a8e50 0x7f41240c1ed0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f411c009f20 tx=0x7f411c009840).ready entity=mon.0 client_cookie=7bb97e632f4d3a6b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:04.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4121600700 1 -- 172.21.15.49:0/3264579463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c00e070 con 0x7f41240a8e50 2024-01-22T05:05:04.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4121600700 1 -- 172.21.15.49:0/3264579463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c00b9d0 con 0x7f41240a8e50 2024-01-22T05:05:04.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4121600700 1 -- 172.21.15.49:0/3264579463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c00bd50 con 0x7f41240a8e50 2024-01-22T05:05:04.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4129800700 1 -- 172.21.15.49:0/3264579463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41240a8e50 msgr2=0x7f41240c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:04.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4129800700 1 --2- 172.21.15.49:0/3264579463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41240a8e50 0x7f41240c1ed0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f411c009f20 tx=0x7f411c009840).stop 2024-01-22T05:05:04.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4129800700 1 -- 172.21.15.49:0/3264579463 shutdown_connections 2024-01-22T05:05:04.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4129800700 1 --2- 172.21.15.49:0/3264579463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41240a8e50 0x7f41240c1ed0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4129800700 1 --2- 172.21.15.49:0/3264579463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4124155d20 0x7f4124065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4129800700 1 -- 172.21.15.49:0/3264579463 >> 172.21.15.49:0/3264579463 conn(0x7f41240c6540 msgr2=0x7f41240c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:04.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4129800700 1 -- 172.21.15.49:0/3264579463 shutdown_connections 2024-01-22T05:05:04.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.665+0000 7f4129800700 1 -- 172.21.15.49:0/3264579463 wait complete. 2024-01-22T05:05:04.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.669+0000 7f4129800700 1 Processor -- start 2024-01-22T05:05:04.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.669+0000 7f4129800700 1 -- start start 2024-01-22T05:05:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4129800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4124066070 0x7f41241518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:04.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4129800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41240a8e50 0x7f412415af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:04.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4129800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4124155d20 0x7f41240c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:04.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4129800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41240be620 con 0x7f4124066070 2024-01-22T05:05:04.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4129800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41241598f0 con 0x7f41240a8e50 2024-01-22T05:05:04.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4129800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4124159bd0 con 0x7f4124155d20 2024-01-22T05:05:04.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4122a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4124066070 0x7f41241518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:04.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4122a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4124066070 0x7f41241518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47914/0 (socket says 172.21.15.49:47914) 2024-01-22T05:05:04.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4122a00700 1 -- 172.21.15.49:0/2991292353 learned_addr learned my addr 172.21.15.49:0/2991292353 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:04.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4122000700 1 --2- 172.21.15.49:0/2991292353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41240a8e50 0x7f412415af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:04.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4123400700 1 --2- 172.21.15.49:0/2991292353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4124155d20 0x7f41240c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:04.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4122a00700 1 -- 172.21.15.49:0/2991292353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4124155d20 msgr2=0x7f41240c28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:04.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4122a00700 1 --2- 172.21.15.49:0/2991292353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4124155d20 0x7f41240c28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4122a00700 1 -- 172.21.15.49:0/2991292353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41240a8e50 msgr2=0x7f412415af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:04.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4122a00700 1 --2- 172.21.15.49:0/2991292353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41240a8e50 0x7f412415af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4122a00700 1 -- 172.21.15.49:0/2991292353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c009ae0 con 0x7f4124066070 2024-01-22T05:05:04.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4122a00700 1 --2- 172.21.15.49:0/2991292353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4124066070 0x7f41241518e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f411400e900 tx=0x7f4114009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:04.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f411a000700 1 -- 172.21.15.49:0/2991292353 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114012600 con 0x7f4124066070 2024-01-22T05:05:04.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4129800700 1 -- 172.21.15.49:0/2991292353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4124159eb0 con 0x7f4124066070 2024-01-22T05:05:04.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f411a000700 1 -- 172.21.15.49:0/2991292353 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4114012760 con 0x7f4124066070 2024-01-22T05:05:04.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f411a000700 1 -- 172.21.15.49:0/2991292353 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114012ae0 con 0x7f4124066070 2024-01-22T05:05:04.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.673+0000 7f4129800700 1 -- 172.21.15.49:0/2991292353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4124151dd0 con 0x7f4124066070 2024-01-22T05:05:04.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.677+0000 7f4129800700 1 -- 172.21.15.49:0/2991292353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4124047060 con 0x7f4124066070 2024-01-22T05:05:04.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.677+0000 7f411a000700 1 -- 172.21.15.49:0/2991292353 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f411401b400 con 0x7f4124066070 2024-01-22T05:05:04.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.677+0000 7f411a000700 1 --2- 172.21.15.49:0/2991292353 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40fc05a510 0x7f40fc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:04.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.677+0000 7f411a000700 1 -- 172.21.15.49:0/2991292353 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f4114074e70 con 0x7f4124066070 2024-01-22T05:05:04.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.677+0000 7f4122000700 1 --2- 172.21.15.49:0/2991292353 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40fc05a510 0x7f40fc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:04.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.681+0000 7f4122000700 1 --2- 172.21.15.49:0/2991292353 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40fc05a510 0x7f40fc05c9d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f41241579d0 tx=0x7f410c000bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:04.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.685+0000 7f411a000700 1 -- 172.21.15.49:0/2991292353 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4114048220 con 0x7f4124066070 2024-01-22T05:05:04.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.881+0000 7f4129800700 1 -- 172.21.15.49:0/2991292353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41240c23c0 con 0x7f4124066070 2024-01-22T05:05:04.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.881+0000 7f411a000700 1 -- 172.21.15.49:0/2991292353 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4491 (secure 0 0 0) 0x7f411404b840 con 0x7f4124066070 2024-01-22T05:05:04.886 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:04.886 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/4240919875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4240919875},{"type":"v1","addr":"172.21.15.49:6836","nonce":4240919875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3591660134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3591660134},{"type":"v1","addr":"172.21.15.49:6837","nonce":3591660134}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1228202507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1228202507},{"type":"v1","addr":"172.21.15.110:6833","nonce":1228202507}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:04:35.017706+0000","modified":"2024-01-22T05:04:49.308211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3391981756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3391981756},{"type":"v1","addr":"172.21.15.110:6835","nonce":3391981756}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:05:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.889+0000 7f4129800700 1 -- 172.21.15.49:0/2991292353 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40fc05a510 msgr2=0x7f40fc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.889+0000 7f4129800700 1 --2- 172.21.15.49:0/2991292353 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40fc05a510 0x7f40fc05c9d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f41241579d0 tx=0x7f410c000bc0).stop 2024-01-22T05:05:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.889+0000 7f4129800700 1 -- 172.21.15.49:0/2991292353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4124066070 msgr2=0x7f41241518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.889+0000 7f4129800700 1 --2- 172.21.15.49:0/2991292353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4124066070 0x7f41241518e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f411400e900 tx=0x7f4114009060).stop 2024-01-22T05:05:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.889+0000 7f4129800700 1 -- 172.21.15.49:0/2991292353 shutdown_connections 2024-01-22T05:05:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.889+0000 7f4129800700 1 --2- 172.21.15.49:0/2991292353 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40fc05a510 0x7f40fc05c9d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.889+0000 7f4129800700 1 --2- 172.21.15.49:0/2991292353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4124155d20 0x7f41240c28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.889+0000 7f4129800700 1 --2- 172.21.15.49:0/2991292353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41240a8e50 0x7f412415af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.889+0000 7f4129800700 1 --2- 172.21.15.49:0/2991292353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4124066070 0x7f41241518e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.889+0000 7f4129800700 1 -- 172.21.15.49:0/2991292353 >> 172.21.15.49:0/2991292353 conn(0x7f41240c6540 msgr2=0x7f41240c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.889+0000 7f4129800700 1 -- 172.21.15.49:0/2991292353 shutdown_connections 2024-01-22T05:05:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:04.889+0000 7f4129800700 1 -- 172.21.15.49:0/2991292353 wait complete. 2024-01-22T05:05:04.895 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-22T05:05:05.320 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:04:35.017706+0000', 'modified': '2024-01-22T05:04:49.308211+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.110:6835/3391981756', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6834', 'nonce': 3391981756}, {'type': 'v1', 'addr': '172.21.15.110:6835', 'nonce': 3391981756}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:05:05.320 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:05:05.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-22T05:05:05.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.489+0000 7efc31a00700 1 Processor -- start 2024-01-22T05:05:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.489+0000 7efc31a00700 1 -- start start 2024-01-22T05:05:05.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.489+0000 7efc31a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efc2c155d20 0x7efc2c065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.489+0000 7efc31a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc2c0a8e50 0x7efc2c0c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.489+0000 7efc31a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c0c1a40 con 0x7efc2c066070 2024-01-22T05:05:05.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.489+0000 7efc31a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c159310 con 0x7efc2c0a8e50 2024-01-22T05:05:05.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.489+0000 7efc31a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c0c13f0 con 0x7efc2c155d20 2024-01-22T05:05:05.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc2b400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc2c0a8e50 0x7efc2c0c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc2a000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efc2c066070 0x7efc2c0a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54564/0 (socket says 172.21.15.49:54564) 2024-01-22T05:05:05.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc2a000700 1 -- 172.21.15.49:0/4081618753 learned_addr learned my addr 172.21.15.49:0/4081618753 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:05.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc2aa00700 1 --2- 172.21.15.49:0/4081618753 >> v2:172.21.15.110:3300/0 conn(0x7efc2c155d20 0x7efc2c065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc29600700 1 -- 172.21.15.49:0/4081618753 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414465703 0 0) 0x7efc2c0c1a40 con 0x7efc2c066070 2024-01-22T05:05:05.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc29600700 1 -- 172.21.15.49:0/4081618753 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc0c0033f0 con 0x7efc2c066070 2024-01-22T05:05:05.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc2b400700 1 -- 172.21.15.49:0/4081618753 >> v2:172.21.15.110:3300/0 conn(0x7efc2c155d20 msgr2=0x7efc2c065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:05.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc2b400700 1 --2- 172.21.15.49:0/4081618753 >> v2:172.21.15.110:3300/0 conn(0x7efc2c155d20 0x7efc2c065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc2b400700 1 -- 172.21.15.49:0/4081618753 >> v1:172.21.15.49:6789/0 conn(0x7efc2c066070 legacy=0x7efc2c0a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:05.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc2b400700 1 -- 172.21.15.49:0/4081618753 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c0c16d0 con 0x7efc2c0a8e50 2024-01-22T05:05:05.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc2b400700 1 --2- 172.21.15.49:0/4081618753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc2c0a8e50 0x7efc2c0c1ed0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7efc2c05ff40 tx=0x7efc24009780).ready entity=mon.0 client_cookie=5c96350ea09368e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:05.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc29600700 1 -- 172.21.15.49:0/4081618753 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400e070 con 0x7efc2c0a8e50 2024-01-22T05:05:05.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc29600700 1 -- 172.21.15.49:0/4081618753 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2400bab0 con 0x7efc2c0a8e50 2024-01-22T05:05:05.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc29600700 1 -- 172.21.15.49:0/4081618753 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400be30 con 0x7efc2c0a8e50 2024-01-22T05:05:05.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc31a00700 1 -- 172.21.15.49:0/4081618753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc2c0a8e50 msgr2=0x7efc2c0c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:05.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.493+0000 7efc31a00700 1 --2- 172.21.15.49:0/4081618753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc2c0a8e50 0x7efc2c0c1ed0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7efc2c05ff40 tx=0x7efc24009780).stop 2024-01-22T05:05:05.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.497+0000 7efc31a00700 1 -- 172.21.15.49:0/4081618753 shutdown_connections 2024-01-22T05:05:05.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.497+0000 7efc31a00700 1 --2- 172.21.15.49:0/4081618753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc2c0a8e50 0x7efc2c0c1ed0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.497+0000 7efc31a00700 1 --2- 172.21.15.49:0/4081618753 >> v2:172.21.15.110:3300/0 conn(0x7efc2c155d20 0x7efc2c065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.497+0000 7efc31a00700 1 -- 172.21.15.49:0/4081618753 >> 172.21.15.49:0/4081618753 conn(0x7efc2c0c6540 msgr2=0x7efc2c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:05.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.497+0000 7efc31a00700 1 -- 172.21.15.49:0/4081618753 shutdown_connections 2024-01-22T05:05:05.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.497+0000 7efc31a00700 1 -- 172.21.15.49:0/4081618753 wait complete. 2024-01-22T05:05:05.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.497+0000 7efc31a00700 1 Processor -- start 2024-01-22T05:05:05.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc31a00700 1 -- start start 2024-01-22T05:05:05.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc31a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc2c066070 0x7efc2c1497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc31a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc2c0a8e50 0x7efc2c067a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc31a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc2c155d20 0x7efc2c067f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc31a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c068470 con 0x7efc2c0a8e50 2024-01-22T05:05:05.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc31a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0bf280 con 0x7efc2c155d20 2024-01-22T05:05:05.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc31a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0bf560 con 0x7efc2c066070 2024-01-22T05:05:05.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc2a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc2c0a8e50 0x7efc2c067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc2a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc2c0a8e50 0x7efc2c067a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47922/0 (socket says 172.21.15.49:47922) 2024-01-22T05:05:05.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc2a000700 1 -- 172.21.15.49:0/4065212677 learned_addr learned my addr 172.21.15.49:0/4065212677 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:05.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc2b400700 1 --2- 172.21.15.49:0/4065212677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc2c155d20 0x7efc2c067f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc2aa00700 1 --2- 172.21.15.49:0/4065212677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc2c066070 0x7efc2c1497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc2a000700 1 -- 172.21.15.49:0/4065212677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc2c066070 msgr2=0x7efc2c1497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:05.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc2a000700 1 --2- 172.21.15.49:0/4065212677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc2c066070 0x7efc2c1497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc2a000700 1 -- 172.21.15.49:0/4065212677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc2c155d20 msgr2=0x7efc2c067f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:05.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc2a000700 1 --2- 172.21.15.49:0/4065212677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc2c155d20 0x7efc2c067f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc2a000700 1 -- 172.21.15.49:0/4065212677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc24009a20 con 0x7efc2c0a8e50 2024-01-22T05:05:05.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc2a000700 1 --2- 172.21.15.49:0/4065212677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc2c0a8e50 0x7efc2c067a90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7efc1400c590 tx=0x7efc14007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:05.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc22000700 1 -- 172.21.15.49:0/4065212677 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc140072e0 con 0x7efc2c0a8e50 2024-01-22T05:05:05.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc22000700 1 -- 172.21.15.49:0/4065212677 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc14007440 con 0x7efc2c0a8e50 2024-01-22T05:05:05.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc31a00700 1 -- 172.21.15.49:0/4065212677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c0bf840 con 0x7efc2c0a8e50 2024-01-22T05:05:05.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.501+0000 7efc22000700 1 -- 172.21.15.49:0/4065212677 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc140057a0 con 0x7efc2c0a8e50 2024-01-22T05:05:05.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.505+0000 7efc31a00700 1 -- 172.21.15.49:0/4065212677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c0bfe00 con 0x7efc2c0a8e50 2024-01-22T05:05:05.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.505+0000 7efc22000700 1 -- 172.21.15.49:0/4065212677 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7efc14005bd0 con 0x7efc2c0a8e50 2024-01-22T05:05:05.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.505+0000 7efc22000700 1 --2- 172.21.15.49:0/4065212677 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc0405a510 0x7efc0405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.505+0000 7efc22000700 1 -- 172.21.15.49:0/4065212677 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7efc14073f90 con 0x7efc2c0a8e50 2024-01-22T05:05:05.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.509+0000 7efc2aa00700 1 --2- 172.21.15.49:0/4065212677 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc0405a510 0x7efc0405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.509+0000 7efc2aa00700 1 --2- 172.21.15.49:0/4065212677 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc0405a510 0x7efc0405c9d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7efc1c009b90 tx=0x7efc1c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:05.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.509+0000 7efc3bdb0740 1 Processor -- start 2024-01-22T05:05:05.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.509+0000 7efc3bdb0740 1 -- start start 2024-01-22T05:05:05.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc3bdb0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x2490d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc3bdb0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x2467af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc3bdb0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 0x24653a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc3bdb0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x23eb410 con 0x24ac3a0 2024-01-22T05:05:05.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc3bdb0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x23eb550 con 0x24ac780 2024-01-22T05:05:05.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc3bdb0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x23eba00 con 0x246be40 2024-01-22T05:05:05.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc2aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x2490d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc2aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x2490d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47938/0 (socket says 172.21.15.49:47938) 2024-01-22T05:05:05.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc2aa00700 1 -- 172.21.15.49:0/1440365919 learned_addr learned my addr 172.21.15.49:0/1440365919 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:05.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc2b400700 1 --2- 172.21.15.49:0/1440365919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 0x24653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc2a000700 1 --2- 172.21.15.49:0/1440365919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x2467af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc2aa00700 1 -- 172.21.15.49:0/1440365919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 msgr2=0x2467af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:05.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc2aa00700 1 --2- 172.21.15.49:0/1440365919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x2467af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc2aa00700 1 -- 172.21.15.49:0/1440365919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 msgr2=0x24653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:05.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc2aa00700 1 --2- 172.21.15.49:0/1440365919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 0x24653a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc2aa00700 1 -- 172.21.15.49:0/1440365919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23e4730 con 0x24ac3a0 2024-01-22T05:05:05.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc2aa00700 1 --2- 172.21.15.49:0/1440365919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x2490d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7efc1c011cc0 tx=0x7efc1c017000).ready entity=mon.0 client_cookie=7c55397b8d0f9ea server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:05.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc1aa00700 1 -- 172.21.15.49:0/1440365919 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c0149a0 con 0x24ac3a0 2024-01-22T05:05:05.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc1aa00700 1 -- 172.21.15.49:0/1440365919 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c014b00 con 0x24ac3a0 2024-01-22T05:05:05.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.513+0000 7efc1aa00700 1 -- 172.21.15.49:0/1440365919 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c014e80 con 0x24ac3a0 2024-01-22T05:05:05.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.517+0000 7efc3bdb0740 1 -- 172.21.15.49:0/1440365919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 msgr2=0x2490d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:05.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.517+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/1440365919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x2490d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7efc1c011cc0 tx=0x7efc1c017000).stop 2024-01-22T05:05:05.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.517+0000 7efc3bdb0740 1 -- 172.21.15.49:0/1440365919 shutdown_connections 2024-01-22T05:05:05.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.517+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/1440365919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 0x24653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.517+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/1440365919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x2467af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.517+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/1440365919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x2490d10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.517+0000 7efc3bdb0740 1 -- 172.21.15.49:0/1440365919 >> 172.21.15.49:0/1440365919 conn(0x2249550 msgr2=0x246b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:05.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.517+0000 7efc3bdb0740 1 -- 172.21.15.49:0/1440365919 shutdown_connections 2024-01-22T05:05:05.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.517+0000 7efc3bdb0740 1 -- 172.21.15.49:0/1440365919 wait complete. 2024-01-22T05:05:05.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.517+0000 7efc3bdb0740 1 -- start start 2024-01-22T05:05:05.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.517+0000 7efc3bdb0740 1 Processor -- start 2024-01-22T05:05:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc3bdb0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x24be080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc3bdb0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac3a0 0x2468e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc3bdb0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac780 0x2469310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc3bdb0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x23b6650 con 0x24ac780 2024-01-22T05:05:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc3bdb0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2469800 con 0x24ac3a0 2024-01-22T05:05:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc3bdb0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x24be570 con 0x246be40 2024-01-22T05:05:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc3bdb0740 10 client.0 ll_register_callbacks cb 0x2423020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:05:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc2b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac780 0x2469310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc2b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac780 0x2469310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47954/0 (socket says 172.21.15.49:47954) 2024-01-22T05:05:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc2b400700 1 -- 172.21.15.49:0/3803425903 learned_addr learned my addr 172.21.15.49:0/3803425903 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc2aa00700 1 --2- 172.21.15.49:0/3803425903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x24be080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc2a000700 1 --2- 172.21.15.49:0/3803425903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac3a0 0x2468e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc2b400700 1 -- 172.21.15.49:0/3803425903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 msgr2=0x24be080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc2b400700 1 --2- 172.21.15.49:0/3803425903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x24be080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc2b400700 1 -- 172.21.15.49:0/3803425903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac3a0 msgr2=0x2468e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc2b400700 1 --2- 172.21.15.49:0/3803425903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac3a0 0x2468e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc2b400700 1 -- 172.21.15.49:0/3803425903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c0118e0 con 0x24ac780 2024-01-22T05:05:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc2b400700 1 --2- 172.21.15.49:0/3803425903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac780 0x2469310 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7efc2c059c60 tx=0x7efc24009780).ready entity=mon.0 client_cookie=b8a2eb23bd6e2efd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:05.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc13400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:05:05.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc13400700 1 -- 172.21.15.49:0/3803425903 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2401f410 con 0x24ac780 2024-01-22T05:05:05.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc13400700 1 -- 172.21.15.49:0/3803425903 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7efc2401f570 con 0x24ac780 2024-01-22T05:05:05.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc3bdb0740 1 -- 172.21.15.49:0/3803425903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x23e11a0 con 0x24ac780 2024-01-22T05:05:05.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc13400700 1 -- 172.21.15.49:0/3803425903 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc2401f730 con 0x24ac780 2024-01-22T05:05:05.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc3bdb0740 10 client.4776 fetch_fsmap learned FSMap version 9 2024-01-22T05:05:05.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc3bdb0740 1 -- 172.21.15.49:0/3803425903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x23df960 con 0x24ac780 2024-01-22T05:05:05.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc13400700 1 -- 172.21.15.49:0/3803425903 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x23e11a0 con 0x24ac780 2024-01-22T05:05:05.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.521+0000 7efc13400700 1 -- 172.21.15.49:0/3803425903 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7efc2401f890 con 0x24ac780 2024-01-22T05:05:05.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.525+0000 7efc3bdb0740 10 client.4776 fetch_fsmap finished waiting for FSMap version 9 2024-01-22T05:05:05.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.525+0000 7efc3bdb0740 10 client.4776 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-22T05:05:05.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.525+0000 7efc3bdb0740 20 client.4776 populate_metadata read hostname 'smithi049' 2024-01-22T05:05:05.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.525+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/3803425903 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x248bf80 0x24afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.525+0000 7efc3bdb0740 4 client.4776 mds_command: new command op to 4288 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:05:05.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.525+0000 7efc3bdb0740 1 -- 172.21.15.49:0/3803425903 --> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x23d76f0 con 0x248bf80 2024-01-22T05:05:05.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.525+0000 7efc2aa00700 1 --2- 172.21.15.49:0/3803425903 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x248bf80 0x24afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.525+0000 7efc2aa00700 1 --2- 172.21.15.49:0/3803425903 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x248bf80 0x24afdb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f1f5211e60d1f8a4 server_cookie=809d1e1613d243d4 in_seq=0 out_seq=0 2024-01-22T05:05:05.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.525+0000 7efc13400700 10 client.4776 ms_handle_connect on v2:172.21.15.110:6834/3391981756 2024-01-22T05:05:05.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.525+0000 7efc13400700 1 -- 172.21.15.49:0/3803425903 <== mds.0 v2:172.21.15.110:6834/3391981756 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x23d76f0 con 0x248bf80 2024-01-22T05:05:05.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.525+0000 7efc13400700 10 client.4776 handle_command_reply: tid=0 2024-01-22T05:05:05.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.525+0000 7efc3bdb0740 1 client.4776 shutdown 2024-01-22T05:05:05.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.529+0000 7efc3bdb0740 1 -- 172.21.15.49:0/3803425903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac780 msgr2=0x2469310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:05.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.529+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/3803425903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac780 0x2469310 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7efc2c059c60 tx=0x7efc24009780).stop 2024-01-22T05:05:05.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.529+0000 7efc3bdb0740 1 -- 172.21.15.49:0/3803425903 shutdown_connections 2024-01-22T05:05:05.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.529+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/3803425903 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x248bf80 0x24afdb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.529+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/3803425903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac780 0x2469310 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.529+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/3803425903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac3a0 0x2468e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.529+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/3803425903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x24be080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.529+0000 7efc3bdb0740 1 -- 172.21.15.49:0/3803425903 >> 172.21.15.49:0/3803425903 conn(0x2249550 msgr2=0x24b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:05.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.529+0000 7efc13400700 0 client.4776 ms_handle_reset on v2:172.21.15.110:6834/3391981756 2024-01-22T05:05:05.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.529+0000 7efc3bdb0740 1 -- 172.21.15.49:0/3803425903 shutdown_connections 2024-01-22T05:05:05.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.529+0000 7efc3bdb0740 1 -- 172.21.15.49:0/3803425903 wait complete. 2024-01-22T05:05:05.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.529+0000 7efc3bdb0740 20 client.4776 trim_cache size 0 max 16384 2024-01-22T05:05:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.549+0000 7efc3bdb0740 1 Processor -- start 2024-01-22T05:05:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.549+0000 7efc3bdb0740 1 -- start start 2024-01-22T05:05:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc3bdb0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x246b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc3bdb0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x248dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc3bdb0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 0x24bf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc3bdb0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x24372c0 con 0x24ac3a0 2024-01-22T05:05:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc3bdb0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x242ee60 con 0x24ac780 2024-01-22T05:05:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc3bdb0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x248da80 con 0x246be40 2024-01-22T05:05:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc2a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x248dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc2a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x248dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47956/0 (socket says 172.21.15.49:47956) 2024-01-22T05:05:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc2a000700 1 -- 172.21.15.49:0/698355182 learned_addr learned my addr 172.21.15.49:0/698355182 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc2b400700 1 --2- 172.21.15.49:0/698355182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 0x24bf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc2aa00700 1 --2- 172.21.15.49:0/698355182 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x246b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc2a000700 1 -- 172.21.15.49:0/698355182 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 msgr2=0x246b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc2a000700 1 --2- 172.21.15.49:0/698355182 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x246b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc2a000700 1 -- 172.21.15.49:0/698355182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 msgr2=0x24bf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc2a000700 1 --2- 172.21.15.49:0/698355182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 0x24bf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc2a000700 1 -- 172.21.15.49:0/698355182 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c0c52b0 con 0x24ac3a0 2024-01-22T05:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc2b400700 1 --2- 172.21.15.49:0/698355182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 0x24bf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc2a000700 1 --2- 172.21.15.49:0/698355182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x248dcf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7efc1404ad60 tx=0x7efc14053040).ready entity=mon.0 client_cookie=22cc1829ff5d2122 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc1b400700 1 -- 172.21.15.49:0/698355182 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc14056040 con 0x24ac3a0 2024-01-22T05:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc1b400700 1 -- 172.21.15.49:0/698355182 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc14007de0 con 0x24ac3a0 2024-01-22T05:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.553+0000 7efc1b400700 1 -- 172.21.15.49:0/698355182 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc14047770 con 0x24ac3a0 2024-01-22T05:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.557+0000 7efc3bdb0740 1 -- 172.21.15.49:0/698355182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 msgr2=0x248dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.557+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/698355182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x248dcf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7efc1404ad60 tx=0x7efc14053040).stop 2024-01-22T05:05:05.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.557+0000 7efc3bdb0740 1 -- 172.21.15.49:0/698355182 shutdown_connections 2024-01-22T05:05:05.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.557+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/698355182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 0x24bf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.557+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/698355182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x248dcf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.557+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/698355182 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x246b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.557+0000 7efc3bdb0740 1 -- 172.21.15.49:0/698355182 >> 172.21.15.49:0/698355182 conn(0x2249550 msgr2=0x24bcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:05.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.557+0000 7efc3bdb0740 1 -- 172.21.15.49:0/698355182 shutdown_connections 2024-01-22T05:05:05.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.557+0000 7efc3bdb0740 1 -- 172.21.15.49:0/698355182 wait complete. 2024-01-22T05:05:05.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.557+0000 7efc3bdb0740 1 -- start start 2024-01-22T05:05:05.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.557+0000 7efc3bdb0740 1 Processor -- start 2024-01-22T05:05:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc3bdb0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x24b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc3bdb0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x2516440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc3bdb0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 0x25136e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc3bdb0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x24b0bd0 con 0x24ac3a0 2024-01-22T05:05:05.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc3bdb0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2513250 con 0x24ac780 2024-01-22T05:05:05.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc3bdb0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x24b0df0 con 0x246be40 2024-01-22T05:05:05.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc3bdb0740 10 client.0 ll_register_callbacks cb 0x7efc24012620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:05:05.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc2a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x2516440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc2a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x2516440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47972/0 (socket says 172.21.15.49:47972) 2024-01-22T05:05:05.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc2a000700 1 -- 172.21.15.49:0/1697522323 learned_addr learned my addr 172.21.15.49:0/1697522323 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:05.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc2aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x24b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc2b400700 1 --2- 172.21.15.49:0/1697522323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 0x25136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc2a000700 1 -- 172.21.15.49:0/1697522323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 msgr2=0x24b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:05.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc2a000700 1 --2- 172.21.15.49:0/1697522323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x24b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc2a000700 1 -- 172.21.15.49:0/1697522323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 msgr2=0x25136e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc2a000700 1 --2- 172.21.15.49:0/1697522323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 0x25136e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc2a000700 1 -- 172.21.15.49:0/1697522323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x23df960 con 0x24ac3a0 2024-01-22T05:05:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc2a000700 1 --2- 172.21.15.49:0/1697522323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x2516440 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7efc140493b0 tx=0x7efc1405c000).ready entity=mon.0 client_cookie=c8a801e5f98c9ccc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc13400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:05:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc13400700 1 -- 172.21.15.49:0/1697522323 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc14062070 con 0x24ac3a0 2024-01-22T05:05:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc13400700 1 -- 172.21.15.49:0/1697522323 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7efc1404a550 con 0x24ac3a0 2024-01-22T05:05:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc3bdb0740 1 -- 172.21.15.49:0/1697522323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efc1c014b00 con 0x24ac3a0 2024-01-22T05:05:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc13400700 1 -- 172.21.15.49:0/1697522323 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc14056040 con 0x24ac3a0 2024-01-22T05:05:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.561+0000 7efc3bdb0740 10 client.4782 fetch_fsmap learned FSMap version 9 2024-01-22T05:05:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.565+0000 7efc3bdb0740 1 -- 172.21.15.49:0/1697522323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x7efc2c0bfe00 con 0x24ac3a0 2024-01-22T05:05:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.565+0000 7efc13400700 1 -- 172.21.15.49:0/1697522323 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c014b00 con 0x24ac3a0 2024-01-22T05:05:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.565+0000 7efc13400700 1 -- 172.21.15.49:0/1697522323 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7efc14065020 con 0x24ac3a0 2024-01-22T05:05:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.565+0000 7efc3bdb0740 10 client.4782 fetch_fsmap finished waiting for FSMap version 9 2024-01-22T05:05:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.565+0000 7efc3bdb0740 10 client.4782 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-22T05:05:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.565+0000 7efc3bdb0740 20 client.4782 populate_metadata read hostname 'smithi049' 2024-01-22T05:05:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.565+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/1697522323 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x24cf600 0x24cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.565+0000 7efc3bdb0740 4 client.4782 mds_command: new command op to 4288 tid=0[{"prefix": "status"}] 2024-01-22T05:05:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.565+0000 7efc3bdb0740 1 -- 172.21.15.49:0/1697522323 --> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] -- command(tid 0: {"prefix": "status"}) v1 -- 0x22a04e0 con 0x24cf600 2024-01-22T05:05:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.565+0000 7efc2aa00700 1 --2- 172.21.15.49:0/1697522323 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x24cf600 0x24cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.565+0000 7efc13400700 10 client.4782 ms_handle_connect on v2:172.21.15.110:6834/3391981756 2024-01-22T05:05:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.565+0000 7efc2aa00700 1 --2- 172.21.15.49:0/1697522323 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x24cf600 0x24cf9e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=45c5ab62d1d84023 server_cookie=2db46ff88b753983 in_seq=0 out_seq=0 2024-01-22T05:05:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.565+0000 7efc13400700 1 -- 172.21.15.49:0/1697522323 <== mds.0 v2:172.21.15.110:6834/3391981756 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x22a04e0 con 0x24cf600 2024-01-22T05:05:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.565+0000 7efc13400700 10 client.4782 handle_command_reply: tid=0 2024-01-22T05:05:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.565+0000 7efc3bdb0740 1 client.4782 shutdown 2024-01-22T05:05:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc3bdb0740 1 -- 172.21.15.49:0/1697522323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 msgr2=0x2516440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/1697522323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x2516440 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7efc140493b0 tx=0x7efc1405c000).stop 2024-01-22T05:05:05.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc3bdb0740 1 -- 172.21.15.49:0/1697522323 shutdown_connections 2024-01-22T05:05:05.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/1697522323 >> [v2:172.21.15.110:6834/3391981756,v1:172.21.15.110:6835/3391981756] conn(0x24cf600 0x24cf9e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/1697522323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24ac780 0x25136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/1697522323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24ac3a0 0x2516440 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc3bdb0740 1 --2- 172.21.15.49:0/1697522323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x246be40 0x24b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc13400700 0 client.4782 ms_handle_reset on v2:172.21.15.110:6834/3391981756 2024-01-22T05:05:05.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc3bdb0740 1 -- 172.21.15.49:0/1697522323 >> 172.21.15.49:0/1697522323 conn(0x2249550 msgr2=0x24bcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:05.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc3bdb0740 1 -- 172.21.15.49:0/1697522323 shutdown_connections 2024-01-22T05:05:05.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc3bdb0740 1 -- 172.21.15.49:0/1697522323 wait complete. 2024-01-22T05:05:05.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc3bdb0740 20 client.4782 trim_cache size 0 max 16384 2024-01-22T05:05:05.572 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:05:05.573 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:05:05.573 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:05:05.573 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4288, 2024-01-22T05:05:05.573 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:05:05.573 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:05:05.573 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:05:05.573 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 30.544089417999999, 2024-01-22T05:05:05.573 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 9, 2024-01-22T05:05:05.573 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 25, 2024-01-22T05:05:05.573 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 25, 2024-01-22T05:05:05.573 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 36.018269977000003 2024-01-22T05:05:05.573 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:05:05.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc31a00700 1 -- 172.21.15.49:0/4065212677 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc0405a510 msgr2=0x7efc0405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:05.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc31a00700 1 --2- 172.21.15.49:0/4065212677 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc0405a510 0x7efc0405c9d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7efc1c009b90 tx=0x7efc1c009060).stop 2024-01-22T05:05:05.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc31a00700 1 -- 172.21.15.49:0/4065212677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc2c0a8e50 msgr2=0x7efc2c067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc31a00700 1 --2- 172.21.15.49:0/4065212677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc2c0a8e50 0x7efc2c067a90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7efc1400c590 tx=0x7efc14007c80).stop 2024-01-22T05:05:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc31a00700 1 -- 172.21.15.49:0/4065212677 shutdown_connections 2024-01-22T05:05:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc31a00700 1 --2- 172.21.15.49:0/4065212677 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc0405a510 0x7efc0405c9d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc31a00700 1 --2- 172.21.15.49:0/4065212677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc2c155d20 0x7efc2c067f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc31a00700 1 --2- 172.21.15.49:0/4065212677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc2c0a8e50 0x7efc2c067a90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc31a00700 1 --2- 172.21.15.49:0/4065212677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc2c066070 0x7efc2c1497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc31a00700 1 -- 172.21.15.49:0/4065212677 >> 172.21.15.49:0/4065212677 conn(0x7efc2c0c6540 msgr2=0x7efc2c0c5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc31a00700 1 -- 172.21.15.49:0/4065212677 shutdown_connections 2024-01-22T05:05:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:05.569+0000 7efc31a00700 1 -- 172.21.15.49:0/4065212677 wait complete. 2024-01-22T05:05:05.599 INFO:teuthology.run_tasks:Running task kclient... 2024-01-22T05:05:05.612 INFO:tasks.kclient:Mounting kernel clients... 2024-01-22T05:05:05.612 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-01-22T05:05:05.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:05.612 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:05:05.628 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-01-22T05:05:05.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:05.630 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-22T05:05:05.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:05.714 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-01-22T05:05:05.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:05.919 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:05:05.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:05.935 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-01-22T05:05:06.019 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2024-01-22T05:05:06.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:05:06.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:06.023 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-22T05:05:06.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:06.045 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-01-22T05:05:06.127 INFO:teuthology.orchestra.run.smithi110.stderr:Cannot find device "ceph-brx" 2024-01-22T05:05:06.132 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:05:06.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:06.132 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-22T05:05:06.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:06.190 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-01-22T05:05:06.271 INFO:teuthology.orchestra.run.smithi110.stderr:Cannot find device "ceph-brx" 2024-01-22T05:05:06.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:05:06.273 INFO:tasks.kclient:client.0 config is {} 2024-01-22T05:05:06.274 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:05:06.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.421+0000 7f10b6600700 1 Processor -- start 2024-01-22T05:05:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.421+0000 7f10b6600700 1 -- start start 2024-01-22T05:05:06.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10b6600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f10b00c7de0 0x7f10b00bd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:06.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10b6600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10b00c35f0 0x7f10b00c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:06.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10b6600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b00bdb50 con 0x7f10b00bd090 2024-01-22T05:05:06.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10b6600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b00bd960 con 0x7f10b00c7de0 2024-01-22T05:05:06.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10b6600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b0158810 con 0x7f10b00c35f0 2024-01-22T05:05:06.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10af400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f10b00bd090 0x7f10b00c76d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54566/0 (socket says 172.21.15.49:54566) 2024-01-22T05:05:06.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10af400700 1 -- 172.21.15.49:0/1947757075 learned_addr learned my addr 172.21.15.49:0/1947757075 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:06.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10aea00700 1 --2- 172.21.15.49:0/1947757075 >> v2:172.21.15.49:3300/0 conn(0x7f10b00c7de0 0x7f10b00bd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:06.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10afe00700 1 --2- 172.21.15.49:0/1947757075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10b00c35f0 0x7f10b00c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:06.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10ae000700 1 -- 172.21.15.49:0/1947757075 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557065544 0 0) 0x7f10b00bdb50 con 0x7f10b00bd090 2024-01-22T05:05:06.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10ae000700 1 -- 172.21.15.49:0/1947757075 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10900033f0 con 0x7f10b00bd090 2024-01-22T05:05:06.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10aea00700 1 -- 172.21.15.49:0/1947757075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10b00c35f0 msgr2=0x7f10b00c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:06.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10aea00700 1 --2- 172.21.15.49:0/1947757075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10b00c35f0 0x7f10b00c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:06.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10aea00700 1 -- 172.21.15.49:0/1947757075 >> v1:172.21.15.49:6789/0 conn(0x7f10b00bd090 legacy=0x7f10b00c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:06.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10aea00700 1 -- 172.21.15.49:0/1947757075 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b00bde30 con 0x7f10b00c7de0 2024-01-22T05:05:06.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10aea00700 1 --2- 172.21.15.49:0/1947757075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10b00c7de0 0x7f10b00bd470 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f1098009760 tx=0x7f1098009060).ready entity=mon.0 client_cookie=e231797eb37c9438 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:06.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10ae000700 1 -- 172.21.15.49:0/1947757075 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109800d4a0 con 0x7f10b00c7de0 2024-01-22T05:05:06.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10ae000700 1 -- 172.21.15.49:0/1947757075 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109800d600 con 0x7f10b00c7de0 2024-01-22T05:05:06.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.425+0000 7f10ae000700 1 -- 172.21.15.49:0/1947757075 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109800d980 con 0x7f10b00c7de0 2024-01-22T05:05:06.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.429+0000 7f10b6600700 1 -- 172.21.15.49:0/1947757075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10b00c7de0 msgr2=0x7f10b00bd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.429+0000 7f10b6600700 1 --2- 172.21.15.49:0/1947757075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10b00c7de0 0x7f10b00bd470 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f1098009760 tx=0x7f1098009060).stop 2024-01-22T05:05:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.429+0000 7f10b6600700 1 -- 172.21.15.49:0/1947757075 shutdown_connections 2024-01-22T05:05:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.429+0000 7f10b6600700 1 --2- 172.21.15.49:0/1947757075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10b00c35f0 0x7f10b00c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.429+0000 7f10b6600700 1 --2- 172.21.15.49:0/1947757075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10b00c7de0 0x7f10b00bd470 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.429+0000 7f10b6600700 1 -- 172.21.15.49:0/1947757075 >> 172.21.15.49:0/1947757075 conn(0x7f10b00aa7e0 msgr2=0x7f10b00aabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.429+0000 7f10b6600700 1 -- 172.21.15.49:0/1947757075 shutdown_connections 2024-01-22T05:05:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.429+0000 7f10b6600700 1 -- 172.21.15.49:0/1947757075 wait complete. 2024-01-22T05:05:06.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.433+0000 7f10b6600700 1 Processor -- start 2024-01-22T05:05:06.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.433+0000 7f10b6600700 1 -- start start 2024-01-22T05:05:06.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.433+0000 7f10b6600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10b00bd090 0x7f10b00a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:06.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.433+0000 7f10b6600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10b00c35f0 0x7f10b0153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:06.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.433+0000 7f10b6600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10b00c7de0 0x7f10b00c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:06.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.433+0000 7f10b6600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b016c970 con 0x7f10b00bd090 2024-01-22T05:05:06.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.433+0000 7f10b6600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b00aa2c0 con 0x7f10b00c35f0 2024-01-22T05:05:06.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.433+0000 7f10b6600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b00a7b20 con 0x7f10b00c7de0 2024-01-22T05:05:06.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.433+0000 7f10af400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10b00bd090 0x7f10b00a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:06.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.433+0000 7f10af400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10b00bd090 0x7f10b00a9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47998/0 (socket says 172.21.15.49:47998) 2024-01-22T05:05:06.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.433+0000 7f10af400700 1 -- 172.21.15.49:0/1595822502 learned_addr learned my addr 172.21.15.49:0/1595822502 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:06.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.433+0000 7f10afe00700 1 --2- 172.21.15.49:0/1595822502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10b00c7de0 0x7f10b00c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:06.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.433+0000 7f10aea00700 1 --2- 172.21.15.49:0/1595822502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10b00c35f0 0x7f10b0153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:06.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.437+0000 7f10af400700 1 -- 172.21.15.49:0/1595822502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10b00c7de0 msgr2=0x7f10b00c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:06.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.437+0000 7f10af400700 1 --2- 172.21.15.49:0/1595822502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10b00c7de0 0x7f10b00c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:06.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.437+0000 7f10af400700 1 -- 172.21.15.49:0/1595822502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10b00c35f0 msgr2=0x7f10b0153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:06.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.437+0000 7f10af400700 1 --2- 172.21.15.49:0/1595822502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10b00c35f0 0x7f10b0153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:06.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.437+0000 7f10af400700 1 -- 172.21.15.49:0/1595822502 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10980092a0 con 0x7f10b00bd090 2024-01-22T05:05:06.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.437+0000 7f10af400700 1 --2- 172.21.15.49:0/1595822502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10b00bd090 0x7f10b00a9dd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f10a0001ed0 tx=0x7f10a0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:06.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.437+0000 7f10a6a00700 1 -- 172.21.15.49:0/1595822502 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a000ce10 con 0x7f10b00bd090 2024-01-22T05:05:06.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.437+0000 7f10a6a00700 1 -- 172.21.15.49:0/1595822502 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a00072e0 con 0x7f10b00bd090 2024-01-22T05:05:06.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.437+0000 7f10a6a00700 1 -- 172.21.15.49:0/1595822502 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a00057a0 con 0x7f10b00bd090 2024-01-22T05:05:06.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.437+0000 7f10b6600700 1 -- 172.21.15.49:0/1595822502 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b016c320 con 0x7f10b00bd090 2024-01-22T05:05:06.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.437+0000 7f10b6600700 1 -- 172.21.15.49:0/1595822502 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b00a7800 con 0x7f10b00bd090 2024-01-22T05:05:06.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.437+0000 7f10b6600700 1 -- 172.21.15.49:0/1595822502 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b016c180 con 0x7f10b00bd090 2024-01-22T05:05:06.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.441+0000 7f10a6a00700 1 -- 172.21.15.49:0/1595822502 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f10a0005b50 con 0x7f10b00bd090 2024-01-22T05:05:06.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.441+0000 7f10a6a00700 1 --2- 172.21.15.49:0/1595822502 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f108805a510 0x7f108805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:06.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.441+0000 7f10a6a00700 1 -- 172.21.15.49:0/1595822502 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f10a0074180 con 0x7f10b00bd090 2024-01-22T05:05:06.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.441+0000 7f10aea00700 1 --2- 172.21.15.49:0/1595822502 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f108805a510 0x7f108805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:06.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.441+0000 7f10aea00700 1 --2- 172.21.15.49:0/1595822502 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f108805a510 0x7f108805c9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f10b00c81e0 tx=0x7f1098016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:06.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.445+0000 7f10a6a00700 1 -- 172.21.15.49:0/1595822502 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f10b016c180 con 0x7f10b00bd090 2024-01-22T05:05:06.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.645+0000 7f10b6600700 1 -- 172.21.15.49:0/1595822502 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f10b016c180 con 0x7f10b00bd090 2024-01-22T05:05:06.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.649+0000 7f10a6a00700 1 -- 172.21.15.49:0/1595822502 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f10b016c180 con 0x7f10b00bd090 2024-01-22T05:05:06.650 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-22T05:05:06.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.649+0000 7f10b6600700 1 -- 172.21.15.49:0/1595822502 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f108805a510 msgr2=0x7f108805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:06.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.649+0000 7f10b6600700 1 --2- 172.21.15.49:0/1595822502 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f108805a510 0x7f108805c9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f10b00c81e0 tx=0x7f1098016000).stop 2024-01-22T05:05:06.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.649+0000 7f10b6600700 1 -- 172.21.15.49:0/1595822502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10b00bd090 msgr2=0x7f10b00a9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:06.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.649+0000 7f10b6600700 1 --2- 172.21.15.49:0/1595822502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10b00bd090 0x7f10b00a9dd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f10a0001ed0 tx=0x7f10a0007c70).stop 2024-01-22T05:05:06.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.649+0000 7f10b6600700 1 -- 172.21.15.49:0/1595822502 shutdown_connections 2024-01-22T05:05:06.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.649+0000 7f10b6600700 1 --2- 172.21.15.49:0/1595822502 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f108805a510 0x7f108805c9d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:06.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.649+0000 7f10b6600700 1 --2- 172.21.15.49:0/1595822502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10b00c7de0 0x7f10b00c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:06.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.649+0000 7f10b6600700 1 --2- 172.21.15.49:0/1595822502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10b00c35f0 0x7f10b0153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:06.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.649+0000 7f10b6600700 1 --2- 172.21.15.49:0/1595822502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10b00bd090 0x7f10b00a9dd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:06.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.649+0000 7f10b6600700 1 -- 172.21.15.49:0/1595822502 >> 172.21.15.49:0/1595822502 conn(0x7f10b00aa7e0 msgr2=0x7f10b00a6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:06.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.649+0000 7f10b6600700 1 -- 172.21.15.49:0/1595822502 shutdown_connections 2024-01-22T05:05:06.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:06.649+0000 7f10b6600700 1 -- 172.21.15.49:0/1595822502 wait complete. 2024-01-22T05:05:06.671 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-22T05:05:06.671 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:05:06.671 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:05:06.671 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:05:06.671 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:05:06.671 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-22T05:05:06.671 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T05:05:06.672 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:05:06.672 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:05:06.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:06.672 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:05:06.688 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:05:06.688 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:05:06.688 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:05:06.688 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:06.688 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:05:06.688 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:06.689 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:05:06.689 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:06.689 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:05:06.689 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:05:06.689 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:06.689 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:05:06.689 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:05:06.689 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42464sec preferred_lft 42464sec 2024-01-22T05:05:06.689 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:05:06.689 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:06.689 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:05:06.689 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:06.689 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:05:06.689 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:05:06.689 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:06.690 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:05:06.690 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:05:06.690 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:06.690 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:05:06.690 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:06.691 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-22T05:05:06.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:06.691 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:05:06.691 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:05:06.691 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2024-01-22T05:05:06.691 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2024-01-22T05:05:06.691 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2024-01-22T05:05:06.691 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-22T05:05:06.691 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:05:06.747 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:05:06.785 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:05:06.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:06.842 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:05:06.920 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:05:06.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:06.923 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:05:06.989 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:05:06.989 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:05:06.989 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:05:06.989 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:05:06.989 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:05:06.989 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:05:06.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:06.990 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:05:06.991 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:05:06.991 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:05:06.991 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:05:06.991 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:05:06.991 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:05:07.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:07.123 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:05:07.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:07.141 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2024-01-22T05:05:07.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:07.201 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:05:07.201 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:05:07.201 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:05:07.201 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-22T05:05:07.201 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:05:07.314 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-22T05:05:07.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:07.314 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:05:07.314 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:05:07.315 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-22T05:05:07.315 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-22T05:05:07.315 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-22T05:05:07.315 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-22T05:05:07.315 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-22T05:05:07.315 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:05:07.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:07.477 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:05:07.477 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:05:07.477 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-22T05:05:07.477 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2024-01-22T05:05:07.477 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:05:07.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:07.541 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-22T05:05:07.554 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:05:07.554 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:05:07.673 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:05:07.673 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:05:08.247 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:05:08.247 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:05:08.253 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:05:08.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:08.254 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:05:08.282 INFO:tasks.kclient:client.2 config is {} 2024-01-22T05:05:08.283 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:05:08.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.464+0000 7ff386200700 1 Processor -- start 2024-01-22T05:05:08.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.464+0000 7ff386200700 1 -- start start 2024-01-22T05:05:08.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.464+0000 7ff386200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff380063930 0x7ff380157b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:08.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.464+0000 7ff386200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff380158010 0x7ff3800c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:08.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.464+0000 7ff386200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff380064a70 con 0x7ff380063550 2024-01-22T05:05:08.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.464+0000 7ff386200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38015cc50 con 0x7ff380063930 2024-01-22T05:05:08.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.464+0000 7ff386200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3801584c0 con 0x7ff380158010 2024-01-22T05:05:08.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.464+0000 7ff37ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff380063930 0x7ff380157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.464+0000 7ff37ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff380063930 0x7ff380157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48006/0 (socket says 172.21.15.49:48006) 2024-01-22T05:05:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.464+0000 7ff37ea00700 1 -- 172.21.15.49:0/3824618435 learned_addr learned my addr 172.21.15.49:0/3824618435 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.464+0000 7ff384c00700 1 --2- 172.21.15.49:0/3824618435 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff380158010 0x7ff3800c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.464+0000 7ff37ea00700 1 -- 172.21.15.49:0/3824618435 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff380158010 msgr2=0x7ff3800c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.464+0000 7ff37ea00700 1 --2- 172.21.15.49:0/3824618435 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff380158010 0x7ff3800c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.464+0000 7ff37ea00700 1 -- 172.21.15.49:0/3824618435 >> v1:172.21.15.110:6789/0 conn(0x7ff380063550 legacy=0x7ff3800677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.468+0000 7ff37ea00700 1 -- 172.21.15.49:0/3824618435 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff380064f00 con 0x7ff380063930 2024-01-22T05:05:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.468+0000 7ff384c00700 1 --2- 172.21.15.49:0/3824618435 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff380158010 0x7ff3800c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:05:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.468+0000 7ff37ea00700 1 --2- 172.21.15.49:0/3824618435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380063930 0x7ff380157b20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7ff368006fd0 tx=0x7ff3680090f0).ready entity=mon.0 client_cookie=c9fec575c2b39426 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.468+0000 7ff37e000700 1 -- 172.21.15.49:0/3824618435 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36800b600 con 0x7ff380063930 2024-01-22T05:05:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.468+0000 7ff37e000700 1 -- 172.21.15.49:0/3824618435 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36800b760 con 0x7ff380063930 2024-01-22T05:05:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.468+0000 7ff37e000700 1 -- 172.21.15.49:0/3824618435 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36800bae0 con 0x7ff380063930 2024-01-22T05:05:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.468+0000 7ff386200700 1 -- 172.21.15.49:0/3824618435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380063930 msgr2=0x7ff380157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.468+0000 7ff386200700 1 --2- 172.21.15.49:0/3824618435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380063930 0x7ff380157b20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7ff368006fd0 tx=0x7ff3680090f0).stop 2024-01-22T05:05:08.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.468+0000 7ff386200700 1 -- 172.21.15.49:0/3824618435 shutdown_connections 2024-01-22T05:05:08.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.468+0000 7ff386200700 1 --2- 172.21.15.49:0/3824618435 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff380158010 0x7ff3800c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:08.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.468+0000 7ff386200700 1 --2- 172.21.15.49:0/3824618435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380063930 0x7ff380157b20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:08.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.468+0000 7ff386200700 1 -- 172.21.15.49:0/3824618435 >> 172.21.15.49:0/3824618435 conn(0x7ff3800c4940 msgr2=0x7ff3800c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:08.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.468+0000 7ff386200700 1 -- 172.21.15.49:0/3824618435 shutdown_connections 2024-01-22T05:05:08.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.468+0000 7ff386200700 1 -- 172.21.15.49:0/3824618435 wait complete. 2024-01-22T05:05:08.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.472+0000 7ff386200700 1 Processor -- start 2024-01-22T05:05:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.472+0000 7ff386200700 1 -- start start 2024-01-22T05:05:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff386200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff380063550 0x7ff380141b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff386200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff380063930 0x7ff3800aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff386200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380158010 0x7ff3800a7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff386200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800c08e0 con 0x7ff380158010 2024-01-22T05:05:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff386200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800bfff0 con 0x7ff380063930 2024-01-22T05:05:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff386200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800c0290 con 0x7ff380063550 2024-01-22T05:05:08.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff384c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380158010 0x7ff3800a7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:08.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff384c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380158010 0x7ff3800a7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48020/0 (socket says 172.21.15.49:48020) 2024-01-22T05:05:08.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff384c00700 1 -- 172.21.15.49:0/2893378425 learned_addr learned my addr 172.21.15.49:0/2893378425 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:08.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff37f400700 1 --2- 172.21.15.49:0/2893378425 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff380063550 0x7ff380141b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:08.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff37ea00700 1 --2- 172.21.15.49:0/2893378425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff380063930 0x7ff3800aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff384c00700 1 -- 172.21.15.49:0/2893378425 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff380063550 msgr2=0x7ff380141b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff384c00700 1 --2- 172.21.15.49:0/2893378425 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff380063550 0x7ff380141b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff384c00700 1 -- 172.21.15.49:0/2893378425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff380063930 msgr2=0x7ff3800aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff384c00700 1 --2- 172.21.15.49:0/2893378425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff380063930 0x7ff3800aa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:08.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff384c00700 1 -- 172.21.15.49:0/2893378425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff368009370 con 0x7ff380158010 2024-01-22T05:05:08.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff37ea00700 1 --2- 172.21.15.49:0/2893378425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff380063930 0x7ff3800aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:08.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff384c00700 1 --2- 172.21.15.49:0/2893378425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380158010 0x7ff3800a7ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7ff37800a380 tx=0x7ff378007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:08.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff376a00700 1 -- 172.21.15.49:0/2893378425 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378016470 con 0x7ff380158010 2024-01-22T05:05:08.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff376a00700 1 -- 172.21.15.49:0/2893378425 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3780165d0 con 0x7ff380158010 2024-01-22T05:05:08.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff386200700 1 -- 172.21.15.49:0/2893378425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3800c0570 con 0x7ff380158010 2024-01-22T05:05:08.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff376a00700 1 -- 172.21.15.49:0/2893378425 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378016950 con 0x7ff380158010 2024-01-22T05:05:08.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.476+0000 7ff386200700 1 -- 172.21.15.49:0/2893378425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3800ad8f0 con 0x7ff380158010 2024-01-22T05:05:08.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.480+0000 7ff386200700 1 -- 172.21.15.49:0/2893378425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3800c0a50 con 0x7ff380158010 2024-01-22T05:05:08.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.480+0000 7ff376a00700 1 -- 172.21.15.49:0/2893378425 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff378013070 con 0x7ff380158010 2024-01-22T05:05:08.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.480+0000 7ff376a00700 1 --2- 172.21.15.49:0/2893378425 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff35805a510 0x7ff35805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:08.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.480+0000 7ff376a00700 1 -- 172.21.15.49:0/2893378425 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7ff378075580 con 0x7ff380158010 2024-01-22T05:05:08.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.484+0000 7ff37f400700 1 --2- 172.21.15.49:0/2893378425 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff35805a510 0x7ff35805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:08.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.484+0000 7ff37f400700 1 --2- 172.21.15.49:0/2893378425 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff35805a510 0x7ff35805c9d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7ff380153af0 tx=0x7ff370009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:08.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.488+0000 7ff376a00700 1 -- 172.21.15.49:0/2893378425 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff378048990 con 0x7ff380158010 2024-01-22T05:05:08.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.692+0000 7ff386200700 1 -- 172.21.15.49:0/2893378425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff380069ab0 con 0x7ff380158010 2024-01-22T05:05:08.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.692+0000 7ff376a00700 1 -- 172.21.15.49:0/2893378425 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff37801b070 con 0x7ff380158010 2024-01-22T05:05:08.724 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-22T05:05:08.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.696+0000 7ff386200700 1 -- 172.21.15.49:0/2893378425 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff35805a510 msgr2=0x7ff35805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:08.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.696+0000 7ff386200700 1 --2- 172.21.15.49:0/2893378425 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff35805a510 0x7ff35805c9d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7ff380153af0 tx=0x7ff370009040).stop 2024-01-22T05:05:08.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.696+0000 7ff386200700 1 -- 172.21.15.49:0/2893378425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380158010 msgr2=0x7ff3800a7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:08.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.696+0000 7ff386200700 1 --2- 172.21.15.49:0/2893378425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380158010 0x7ff3800a7ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7ff37800a380 tx=0x7ff378007900).stop 2024-01-22T05:05:08.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.696+0000 7ff386200700 1 -- 172.21.15.49:0/2893378425 shutdown_connections 2024-01-22T05:05:08.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.696+0000 7ff386200700 1 --2- 172.21.15.49:0/2893378425 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff35805a510 0x7ff35805c9d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:08.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.696+0000 7ff386200700 1 --2- 172.21.15.49:0/2893378425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380158010 0x7ff3800a7ad0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:08.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.696+0000 7ff386200700 1 --2- 172.21.15.49:0/2893378425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff380063930 0x7ff3800aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:08.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.696+0000 7ff386200700 1 --2- 172.21.15.49:0/2893378425 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff380063550 0x7ff380141b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:08.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.696+0000 7ff386200700 1 -- 172.21.15.49:0/2893378425 >> 172.21.15.49:0/2893378425 conn(0x7ff3800c4940 msgr2=0x7ff380152980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:08.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.696+0000 7ff386200700 1 -- 172.21.15.49:0/2893378425 shutdown_connections 2024-01-22T05:05:08.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:08.696+0000 7ff386200700 1 -- 172.21.15.49:0/2893378425 wait complete. 2024-01-22T05:05:08.727 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-22T05:05:08.727 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:05:08.727 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:05:08.727 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-01-22T05:05:08.727 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-01-22T05:05:08.727 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-22T05:05:08.727 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T05:05:08.727 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:05:08.727 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-01-22T05:05:08.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:08.728 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:05:08.746 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:05:08.747 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:05:08.747 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:05:08.747 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:08.747 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:05:08.747 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:08.747 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:05:08.747 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:08.747 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:05:08.747 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:05:08.747 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:08.747 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:05:08.747 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:05:08.748 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42462sec preferred_lft 42462sec 2024-01-22T05:05:08.748 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:05:08.748 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:08.748 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:05:08.748 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:08.748 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:05:08.748 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:05:08.748 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:08.748 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:05:08.748 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:05:08.748 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:08.748 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:05:08.748 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:08.748 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:05:08.748 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 82:c1:48:e7:c7:31 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:08.749 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:05:08.749 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:08.749 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::7ce7:e3ff:fed1:1e88/64 scope link 2024-01-22T05:05:08.749 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:08.749 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:05:08.749 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 82:c1:48:e7:c7:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:05:08.749 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::80c1:48ff:fee7:c731/64 scope link tentative 2024-01-22T05:05:08.749 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:08.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:08.750 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:05:08.827 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:05:08.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:08.830 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:05:08.893 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:05:08.894 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:05:08.894 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:05:08.894 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:05:08.894 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:05:08.894 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:05:08.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:08.894 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:05:08.894 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:05:08.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:05:08.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:05:08.895 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:05:08.895 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:05:09.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:09.032 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:05:09.047 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:05:09.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:09.049 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2024-01-22T05:05:09.107 INFO:teuthology.orchestra.run.smithi049.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-01-22T05:05:09.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:09.108 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:05:09.109 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:05:09.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:05:09.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-01-22T05:05:09.109 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:05:09.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:09.220 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-22T05:05:09.259 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:05:09.259 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:05:09.259 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:05:09.259 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:09.259 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:05:09.260 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:09.260 INFO:teuthology.orchestra.run.smithi049.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:05:09.260 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 6e:3b:36:53:b3:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-22T05:05:09.260 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-22T05:05:09.260 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:09.260 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::6c3b:36ff:fe53:b3b6/64 scope link 2024-01-22T05:05:09.260 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:09.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:09.264 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-22T05:05:09.345 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:05:09.346 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:05:09.346 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:05:09.346 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:09.346 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:05:09.346 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:09.346 INFO:teuthology.orchestra.run.smithi049.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:05:09.346 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 6e:3b:36:53:b3:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-22T05:05:09.346 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-22T05:05:09.346 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:09.346 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::6c3b:36ff:fe53:b3b6/64 scope link 2024-01-22T05:05:09.346 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:09.349 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-01-22T05:05:09.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:09.350 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:05:09.350 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:05:09.350 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-01-22T05:05:09.350 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-22T05:05:09.350 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-01-22T05:05:09.350 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-01-22T05:05:09.350 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-01-22T05:05:09.350 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:05:09.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:09.546 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:05:09.547 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:05:09.547 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.1 up 2024-01-22T05:05:09.547 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.1 master ceph-brx 2024-01-22T05:05:09.547 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:05:09.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:09.617 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.2 2024-01-22T05:05:09.634 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:05:09.634 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:05:09.752 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:05:09.752 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:05:09.776 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:05:09.776 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:05:09.782 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:05:09.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:09.783 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-01-22T05:05:09.816 INFO:tasks.kclient:client.1 config is {} 2024-01-22T05:05:09.816 DEBUG:teuthology.orchestra.run.smithi110:> ceph fs ls 2024-01-22T05:05:09.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.947+0000 7f9480e00700 1 Processor -- start 2024-01-22T05:05:09.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.947+0000 7f9480e00700 1 -- start start 2024-01-22T05:05:09.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9480e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f947c0c7de0 0x7f947c15bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:09.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9480e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c0c2ff0 con 0x7f947c0bd090 2024-01-22T05:05:09.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9480e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c0bd9d0 con 0x7f947c0bd470 2024-01-22T05:05:09.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9480e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947c0be550 con 0x7f947c0c7de0 2024-01-22T05:05:09.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9479400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f947c0bd470 0x7f947c0c76d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45752/0 (socket says 172.21.15.110:45752) 2024-01-22T05:05:09.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9479400700 1 -- 172.21.15.110:0/2868399889 learned_addr learned my addr 172.21.15.110:0/2868399889 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-01-22T05:05:09.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f947a800700 1 --2- 172.21.15.110:0/2868399889 >> v2:172.21.15.49:3300/0 conn(0x7f947c0c7de0 0x7f947c15bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:09.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346807043 0 0) 0x7f947c0bd9d0 con 0x7f947c0bd470 2024-01-22T05:05:09.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f945c0033f0 con 0x7f947c0bd470 2024-01-22T05:05:09.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519739689 0 0) 0x7f947c0c2ff0 con 0x7f947c0bd090 2024-01-22T05:05:09.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f947c0bd9d0 con 0x7f947c0bd090 2024-01-22T05:05:09.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3872955396 0 0) 0x7f945c0033f0 con 0x7f947c0bd470 2024-01-22T05:05:09.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 >> v2:172.21.15.49:3300/0 conn(0x7f947c0c7de0 msgr2=0x7f947c15bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:09.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 --2- 172.21.15.110:0/2868399889 >> v2:172.21.15.49:3300/0 conn(0x7f947c0c7de0 0x7f947c15bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:09.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 >> v1:172.21.15.49:6789/0 conn(0x7f947c0bd090 legacy=0x7f947c066d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:09.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c0bdcb0 con 0x7f947c0bd470 2024-01-22T05:05:09.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f9464001470 con 0x7f947c0bd470 2024-01-22T05:05:09.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 >> v1:172.21.15.110:6789/0 conn(0x7f947c0bd470 legacy=0x7f947c0c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:09.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 --2- 172.21.15.110:0/2868399889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f945c003a70 0x7f945c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:09.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 --2- 172.21.15.110:0/2868399889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f945c004690 0x7f945c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:09.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 --2- 172.21.15.110:0/2868399889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f945c005050 0x7f945c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:09.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c0be550 con 0x7f945c005050 2024-01-22T05:05:09.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c00bfc0 con 0x7f945c004690 2024-01-22T05:05:09.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c00c180 con 0x7f945c003a70 2024-01-22T05:05:09.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9479400700 1 --2- 172.21.15.110:0/2868399889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f945c004690 0x7f945c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:09.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.951+0000 7f9479e00700 1 --2- 172.21.15.110:0/2868399889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f945c003a70 0x7f945c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:09.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f947a800700 1 --2- 172.21.15.110:0/2868399889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f945c005050 0x7f945c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:09.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9479400700 1 -- 172.21.15.110:0/2868399889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f945c003a70 msgr2=0x7f945c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:09.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9479400700 1 --2- 172.21.15.110:0/2868399889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f945c003a70 0x7f945c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:09.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9479400700 1 -- 172.21.15.110:0/2868399889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f945c005050 msgr2=0x7f945c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:09.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9479400700 1 --2- 172.21.15.110:0/2868399889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f945c005050 0x7f945c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:09.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9479400700 1 -- 172.21.15.110:0/2868399889 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0033f0 con 0x7f945c004690 2024-01-22T05:05:09.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9479e00700 1 --2- 172.21.15.110:0/2868399889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f945c003a70 0x7f945c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:09.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f947a800700 1 --2- 172.21.15.110:0/2868399889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f945c005050 0x7f945c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:09.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f947a800700 1 -- 172.21.15.110:0/2868399889 reap_dead start 2024-01-22T05:05:09.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9479400700 1 --2- 172.21.15.110:0/2868399889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f945c004690 0x7f945c004b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f946400c160 tx=0x7f9464001e10).ready entity=mon.1 client_cookie=2e046e0d91996ae7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:09.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400c9d0 con 0x7f945c004690 2024-01-22T05:05:09.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946400cb30 con 0x7f945c004690 2024-01-22T05:05:09.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9478a00700 1 -- 172.21.15.110:0/2868399889 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94640070d0 con 0x7f945c004690 2024-01-22T05:05:09.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9480e00700 1 -- 172.21.15.110:0/2868399889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f945c004690 msgr2=0x7f945c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:09.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9480e00700 1 --2- 172.21.15.110:0/2868399889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f945c004690 0x7f945c004b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f946400c160 tx=0x7f9464001e10).stop 2024-01-22T05:05:09.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9480e00700 1 -- 172.21.15.110:0/2868399889 shutdown_connections 2024-01-22T05:05:09.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9480e00700 1 --2- 172.21.15.110:0/2868399889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f945c004690 0x7f945c004b10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:09.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9480e00700 1 -- 172.21.15.110:0/2868399889 >> 172.21.15.110:0/2868399889 conn(0x7f947c0aa7e0 msgr2=0x7f947c0aabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:09.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9480e00700 1 -- 172.21.15.110:0/2868399889 shutdown_connections 2024-01-22T05:05:09.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.955+0000 7f9480e00700 1 -- 172.21.15.110:0/2868399889 wait complete. 2024-01-22T05:05:09.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.959+0000 7f9480e00700 1 Processor -- start 2024-01-22T05:05:09.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.959+0000 7f9480e00700 1 -- start start 2024-01-22T05:05:09.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f9480e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f945c004690 0x7f947c14cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:09.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f9480e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f947c0928f0 0x7f947c0937b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:09.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f9480e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f947c093ca0 0x7f947c094250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:09.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f9480e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c0918e0 con 0x7f945c004690 2024-01-22T05:05:09.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f9480e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c091b30 con 0x7f947c0928f0 2024-01-22T05:05:09.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f9480e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c091e10 con 0x7f947c093ca0 2024-01-22T05:05:09.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f947a800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f947c093ca0 0x7f947c094250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:09.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f9479400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f947c0928f0 0x7f947c0937b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:09.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f947a800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f947c093ca0 0x7f947c094250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:42250/0 (socket says 172.21.15.110:42250) 2024-01-22T05:05:09.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f947a800700 1 -- 172.21.15.110:0/3770958360 learned_addr learned my addr 172.21.15.110:0/3770958360 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:05:09.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f9479e00700 1 --2- 172.21.15.110:0/3770958360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f945c004690 0x7f947c14cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:09.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f947a800700 1 -- 172.21.15.110:0/3770958360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f947c0928f0 msgr2=0x7f947c0937b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:09.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f947a800700 1 --2- 172.21.15.110:0/3770958360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f947c0928f0 0x7f947c0937b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:09.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f947a800700 1 -- 172.21.15.110:0/3770958360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f945c004690 msgr2=0x7f947c14cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:09.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f947a800700 1 --2- 172.21.15.110:0/3770958360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f945c004690 0x7f947c14cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:09.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f947a800700 1 -- 172.21.15.110:0/3770958360 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c0920f0 con 0x7f947c093ca0 2024-01-22T05:05:09.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f9479400700 1 --2- 172.21.15.110:0/3770958360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f947c0928f0 0x7f947c0937b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:09.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f9479e00700 1 --2- 172.21.15.110:0/3770958360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f945c004690 0x7f947c14cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:09.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f947a800700 1 --2- 172.21.15.110:0/3770958360 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f947c093ca0 0x7f947c094250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f947c0681a0 tx=0x7f947400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:09.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f9471600700 1 -- 172.21.15.110:0/3770958360 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947400e030 con 0x7f947c093ca0 2024-01-22T05:05:09.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f9471600700 1 -- 172.21.15.110:0/3770958360 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947400f040 con 0x7f947c093ca0 2024-01-22T05:05:09.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f9480e00700 1 -- 172.21.15.110:0/3770958360 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947c0923d0 con 0x7f947c093ca0 2024-01-22T05:05:09.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f9471600700 1 -- 172.21.15.110:0/3770958360 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9474010e30 con 0x7f947c093ca0 2024-01-22T05:05:09.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.963+0000 7f9480e00700 1 -- 172.21.15.110:0/3770958360 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c162fe0 con 0x7f947c093ca0 2024-01-22T05:05:09.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.967+0000 7f9480e00700 1 -- 172.21.15.110:0/3770958360 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947c05ee90 con 0x7f947c093ca0 2024-01-22T05:05:09.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.967+0000 7f9471600700 1 -- 172.21.15.110:0/3770958360 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9474015690 con 0x7f947c093ca0 2024-01-22T05:05:09.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.967+0000 7f9471600700 1 --2- 172.21.15.110:0/3770958360 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f945405a540 0x7f945405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:09.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.967+0000 7f9471600700 1 -- 172.21.15.110:0/3770958360 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f9474075320 con 0x7f947c093ca0 2024-01-22T05:05:09.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.971+0000 7f9479e00700 1 --2- 172.21.15.110:0/3770958360 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f945405a540 0x7f945405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:09.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.971+0000 7f9479e00700 1 --2- 172.21.15.110:0/3770958360 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f945405a540 0x7f945405ca00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f946c0010e0 tx=0x7f946c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:09.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:09.975+0000 7f9471600700 1 -- 172.21.15.110:0/3770958360 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f94740487f0 con 0x7f947c093ca0 2024-01-22T05:05:10.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:10.171+0000 7f9480e00700 1 -- 172.21.15.110:0/3770958360 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f947c0bdf90 con 0x7f947c093ca0 2024-01-22T05:05:10.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:10.175+0000 7f9471600700 1 -- 172.21.15.110:0/3770958360 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f947404be10 con 0x7f947c093ca0 2024-01-22T05:05:10.181 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-22T05:05:10.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:10.179+0000 7f9480e00700 1 -- 172.21.15.110:0/3770958360 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f945405a540 msgr2=0x7f945405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:10.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:10.179+0000 7f9480e00700 1 --2- 172.21.15.110:0/3770958360 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f945405a540 0x7f945405ca00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f946c0010e0 tx=0x7f946c009040).stop 2024-01-22T05:05:10.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:10.179+0000 7f9480e00700 1 -- 172.21.15.110:0/3770958360 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f947c093ca0 msgr2=0x7f947c094250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:10.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:10.179+0000 7f9480e00700 1 --2- 172.21.15.110:0/3770958360 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f947c093ca0 0x7f947c094250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f947c0681a0 tx=0x7f947400b040).stop 2024-01-22T05:05:10.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:10.179+0000 7f9480e00700 1 -- 172.21.15.110:0/3770958360 shutdown_connections 2024-01-22T05:05:10.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:10.179+0000 7f9480e00700 1 --2- 172.21.15.110:0/3770958360 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f945405a540 0x7f945405ca00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:10.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:10.179+0000 7f9480e00700 1 --2- 172.21.15.110:0/3770958360 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f947c093ca0 0x7f947c094250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:10.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:10.179+0000 7f9480e00700 1 --2- 172.21.15.110:0/3770958360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f947c0928f0 0x7f947c0937b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:10.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:10.179+0000 7f9480e00700 1 --2- 172.21.15.110:0/3770958360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f945c004690 0x7f947c14cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:10.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:10.179+0000 7f9480e00700 1 -- 172.21.15.110:0/3770958360 >> 172.21.15.110:0/3770958360 conn(0x7f947c0aa7e0 msgr2=0x7f947c0c6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:10.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:10.179+0000 7f9480e00700 1 -- 172.21.15.110:0/3770958360 shutdown_connections 2024-01-22T05:05:10.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:10.179+0000 7f9480e00700 1 -- 172.21.15.110:0/3770958360 wait complete. 2024-01-22T05:05:10.203 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-22T05:05:10.203 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:05:10.204 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-01-22T05:05:10.204 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-22T05:05:10.204 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-22T05:05:10.204 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-22T05:05:10.204 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T05:05:10.204 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:05:10.204 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-22T05:05:10.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:10.204 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-01-22T05:05:10.221 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:05:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:05:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:05:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-01-22T05:05:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:10.222 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:05:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-01-22T05:05:10.222 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:05:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-01-22T05:05:10.222 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:05:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:10.223 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:05:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-22T05:05:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42417sec preferred_lft 42417sec 2024-01-22T05:05:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-01-22T05:05:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:10.223 INFO:teuthology.orchestra.run.smithi110.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:05:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 02:42:ce:88:4e:de brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:05:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:10.224 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-22T05:05:10.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:10.225 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-22T05:05:10.225 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-22T05:05:10.225 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add name ceph-brx type bridge 2024-01-22T05:05:10.225 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr flush dev ceph-brx 2024-01-22T05:05:10.225 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set ceph-brx up 2024-01-22T05:05:10.225 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-22T05:05:10.225 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-22T05:05:10.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:10.377 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:05:10.409 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-01-22T05:05:10.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:10.412 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-01-22T05:05:10.490 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-01-22T05:05:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:05:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-22T05:05:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-22T05:05:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:05:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-01-22T05:05:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-22T05:05:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:05:10.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:10.491 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-22T05:05:10.491 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-22T05:05:10.491 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-22T05:05:10.491 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-22T05:05:10.492 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-22T05:05:10.492 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-22T05:05:10.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:10.621 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-22T05:05:10.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:10.637 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2024-01-22T05:05:10.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:10.697 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-22T05:05:10.697 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-22T05:05:10.697 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-22T05:05:10.697 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-01-22T05:05:10.697 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-22T05:05:10.811 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-01-22T05:05:10.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:10.811 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-22T05:05:10.811 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-22T05:05:10.811 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-01-22T05:05:10.811 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-22T05:05:10.811 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-01-22T05:05:10.811 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-01-22T05:05:10.811 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-01-22T05:05:10.811 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-22T05:05:10.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:10.986 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-22T05:05:10.986 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-22T05:05:10.986 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-01-22T05:05:10.986 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.0 master ceph-brx 2024-01-22T05:05:10.986 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-22T05:05:11.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:11.056 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p /home/ubuntu/cephtest/mnt.1 2024-01-22T05:05:11.071 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:05:11.071 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:05:11.189 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:05:11.189 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:05:11.815 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:05:11.816 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:05:11.821 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:05:11.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:11.821 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-22T05:05:11.846 INFO:tasks.kclient:client.3 config is {} 2024-01-22T05:05:11.847 DEBUG:teuthology.orchestra.run.smithi110:> ceph fs ls 2024-01-22T05:05:12.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.011+0000 7f8528e00700 1 Processor -- start 2024-01-22T05:05:12.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.011+0000 7f8528e00700 1 -- start start 2024-01-22T05:05:12.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.015+0000 7f8528e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f85240c3790 0x7f85240c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:12.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.015+0000 7f8528e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8524062610 0x7f8524062aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:12.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.015+0000 7f8528e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8524064c40 con 0x7f8524064860 2024-01-22T05:05:12.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.015+0000 7f8528e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85240c40e0 con 0x7f85240c3790 2024-01-22T05:05:12.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.015+0000 7f8528e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852415bfd0 con 0x7f8524062610 2024-01-22T05:05:12.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.015+0000 7f8523e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8524062610 0x7f8524062aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:12.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.015+0000 7f8523e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8524062610 0x7f8524062aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:42254/0 (socket says 172.21.15.110:42254) 2024-01-22T05:05:12.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.015+0000 7f8523e00700 1 -- 172.21.15.110:0/3036929046 learned_addr learned my addr 172.21.15.110:0/3036929046 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:05:12.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.015+0000 7f8522a00700 1 --2- 172.21.15.110:0/3036929046 >> v2:172.21.15.49:3300/0 conn(0x7f85240c3790 0x7f85240c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:12.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8523e00700 1 -- 172.21.15.110:0/3036929046 >> v2:172.21.15.49:3300/0 conn(0x7f85240c3790 msgr2=0x7f85240c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:12.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8523e00700 1 --2- 172.21.15.110:0/3036929046 >> v2:172.21.15.49:3300/0 conn(0x7f85240c3790 0x7f85240c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:12.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8523e00700 1 -- 172.21.15.110:0/3036929046 >> v1:172.21.15.49:6789/0 conn(0x7f8524064860 legacy=0x7f8524157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:12.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8523e00700 1 -- 172.21.15.110:0/3036929046 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852415c2b0 con 0x7f8524062610 2024-01-22T05:05:12.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8523e00700 1 --2- 172.21.15.110:0/3036929046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8524062610 0x7f8524062aa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f851c009f20 tx=0x7f851c009840).ready entity=mon.2 client_cookie=c19b2a4b5d81f1c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:12.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8522000700 1 -- 172.21.15.110:0/3036929046 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00e070 con 0x7f8524062610 2024-01-22T05:05:12.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8522000700 1 -- 172.21.15.110:0/3036929046 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c00ba80 con 0x7f8524062610 2024-01-22T05:05:12.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8522000700 1 -- 172.21.15.110:0/3036929046 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00be00 con 0x7f8524062610 2024-01-22T05:05:12.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8528e00700 1 -- 172.21.15.110:0/3036929046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8524062610 msgr2=0x7f8524062aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:12.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8528e00700 1 --2- 172.21.15.110:0/3036929046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8524062610 0x7f8524062aa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f851c009f20 tx=0x7f851c009840).stop 2024-01-22T05:05:12.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8528e00700 1 -- 172.21.15.110:0/3036929046 shutdown_connections 2024-01-22T05:05:12.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8528e00700 1 --2- 172.21.15.110:0/3036929046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8524062610 0x7f8524062aa0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:12.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8528e00700 1 --2- 172.21.15.110:0/3036929046 >> v2:172.21.15.49:3300/0 conn(0x7f85240c3790 0x7f85240c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:12.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8528e00700 1 -- 172.21.15.110:0/3036929046 >> 172.21.15.110:0/3036929046 conn(0x7f85240c70b0 msgr2=0x7f85240c3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:12.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8528e00700 1 -- 172.21.15.110:0/3036929046 shutdown_connections 2024-01-22T05:05:12.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.019+0000 7f8528e00700 1 -- 172.21.15.110:0/3036929046 wait complete. 2024-01-22T05:05:12.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.023+0000 7f8528e00700 1 Processor -- start 2024-01-22T05:05:12.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.023+0000 7f8528e00700 1 -- start start 2024-01-22T05:05:12.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.023+0000 7f8528e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8524062610 0x7f8524168e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:12.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.023+0000 7f8528e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8524064860 0x7f8524159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:12.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.023+0000 7f8528e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85240c3790 0x7f8524159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:12.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.023+0000 7f8528e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852415aa00 con 0x7f85240c3790 2024-01-22T05:05:12.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.023+0000 7f8528e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852415b860 con 0x7f8524062610 2024-01-22T05:05:12.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.023+0000 7f8528e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852415bcf0 con 0x7f8524064860 2024-01-22T05:05:12.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f8523400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8524062610 0x7f8524168e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:12.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f8522a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8524064860 0x7f8524159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:12.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f8523400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8524062610 0x7f8524168e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33186/0 (socket says 172.21.15.110:33186) 2024-01-22T05:05:12.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f8523400700 1 -- 172.21.15.110:0/4192328431 learned_addr learned my addr 172.21.15.110:0/4192328431 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-22T05:05:12.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f8523e00700 1 --2- 172.21.15.110:0/4192328431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85240c3790 0x7f8524159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:12.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f8523400700 1 -- 172.21.15.110:0/4192328431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8524064860 msgr2=0x7f8524159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:12.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f8523400700 1 --2- 172.21.15.110:0/4192328431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8524064860 0x7f8524159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:12.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f8523400700 1 -- 172.21.15.110:0/4192328431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85240c3790 msgr2=0x7f8524159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:12.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f8523400700 1 --2- 172.21.15.110:0/4192328431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85240c3790 0x7f8524159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:12.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f8523400700 1 -- 172.21.15.110:0/4192328431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c009ae0 con 0x7f8524062610 2024-01-22T05:05:12.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f8523e00700 1 --2- 172.21.15.110:0/4192328431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85240c3790 0x7f8524159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:12.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f8522a00700 1 --2- 172.21.15.110:0/4192328431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8524064860 0x7f8524159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:12.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f8523400700 1 --2- 172.21.15.110:0/4192328431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8524062610 0x7f8524168e80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f851400c4c0 tx=0x7f8514007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:12.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f851aa00700 1 -- 172.21.15.110:0/4192328431 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851400ce70 con 0x7f8524062610 2024-01-22T05:05:12.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f851aa00700 1 -- 172.21.15.110:0/4192328431 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8514001e90 con 0x7f8524062610 2024-01-22T05:05:12.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f851aa00700 1 -- 172.21.15.110:0/4192328431 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514007250 con 0x7f8524062610 2024-01-22T05:05:12.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f8528e00700 1 -- 172.21.15.110:0/4192328431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8524168920 con 0x7f8524062610 2024-01-22T05:05:12.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.027+0000 7f8528e00700 1 -- 172.21.15.110:0/4192328431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852415ac50 con 0x7f8524062610 2024-01-22T05:05:12.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.031+0000 7f8528e00700 1 -- 172.21.15.110:0/4192328431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8524067450 con 0x7f8524062610 2024-01-22T05:05:12.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.031+0000 7f851aa00700 1 -- 172.21.15.110:0/4192328431 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f85140066a0 con 0x7f8524062610 2024-01-22T05:05:12.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.031+0000 7f851aa00700 1 --2- 172.21.15.110:0/4192328431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84fc05a510 0x7f84fc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:12.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.031+0000 7f851aa00700 1 -- 172.21.15.110:0/4192328431 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f8514074320 con 0x7f8524062610 2024-01-22T05:05:12.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.031+0000 7f8522a00700 1 --2- 172.21.15.110:0/4192328431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84fc05a510 0x7f84fc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:12.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.031+0000 7f8522a00700 1 --2- 172.21.15.110:0/4192328431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84fc05a510 0x7f84fc05c9d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f852415a6c0 tx=0x7f850c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:12.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.039+0000 7f851aa00700 1 -- 172.21.15.110:0/4192328431 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f85140477f0 con 0x7f8524062610 2024-01-22T05:05:12.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.235+0000 7f8528e00700 1 -- 172.21.15.110:0/4192328431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f852415c590 con 0x7f8524062610 2024-01-22T05:05:12.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.235+0000 7f851aa00700 1 -- 172.21.15.110:0/4192328431 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f851404ae10 con 0x7f8524062610 2024-01-22T05:05:12.242 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-22T05:05:12.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.239+0000 7f8528e00700 1 -- 172.21.15.110:0/4192328431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84fc05a510 msgr2=0x7f84fc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:12.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.239+0000 7f8528e00700 1 --2- 172.21.15.110:0/4192328431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84fc05a510 0x7f84fc05c9d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f852415a6c0 tx=0x7f850c008040).stop 2024-01-22T05:05:12.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.239+0000 7f8528e00700 1 -- 172.21.15.110:0/4192328431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8524062610 msgr2=0x7f8524168e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:12.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.239+0000 7f8528e00700 1 --2- 172.21.15.110:0/4192328431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8524062610 0x7f8524168e80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f851400c4c0 tx=0x7f8514007e00).stop 2024-01-22T05:05:12.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.239+0000 7f8528e00700 1 -- 172.21.15.110:0/4192328431 shutdown_connections 2024-01-22T05:05:12.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.239+0000 7f8528e00700 1 --2- 172.21.15.110:0/4192328431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84fc05a510 0x7f84fc05c9d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:12.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.239+0000 7f8528e00700 1 --2- 172.21.15.110:0/4192328431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85240c3790 0x7f8524159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:12.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.239+0000 7f8528e00700 1 --2- 172.21.15.110:0/4192328431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8524064860 0x7f8524159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:12.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.239+0000 7f8528e00700 1 --2- 172.21.15.110:0/4192328431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8524062610 0x7f8524168e80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:12.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.239+0000 7f8528e00700 1 -- 172.21.15.110:0/4192328431 >> 172.21.15.110:0/4192328431 conn(0x7f85240c70b0 msgr2=0x7f85240c55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:12.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.239+0000 7f8528e00700 1 -- 172.21.15.110:0/4192328431 shutdown_connections 2024-01-22T05:05:12.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-22T05:05:12.239+0000 7f8528e00700 1 -- 172.21.15.110:0/4192328431 wait complete. 2024-01-22T05:05:12.266 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-22T05:05:12.266 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:05:12.266 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-01-22T05:05:12.266 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-01-22T05:05:12.266 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-01-22T05:05:12.266 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-22T05:05:12.266 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T05:05:12.266 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:05:12.266 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-01-22T05:05:12.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:12.266 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-01-22T05:05:12.281 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:05:12.281 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:05:12.281 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:05:12.282 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:12.282 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-01-22T05:05:12.282 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:12.282 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:05:12.282 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:12.282 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-01-22T05:05:12.282 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:05:12.282 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:12.282 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-01-22T05:05:12.282 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:05:12.282 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:12.282 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:05:12.282 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:12.282 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-22T05:05:12.282 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42415sec preferred_lft 42415sec 2024-01-22T05:05:12.283 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-01-22T05:05:12.283 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:12.283 INFO:teuthology.orchestra.run.smithi110.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:05:12.283 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 02:42:ce:88:4e:de brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:12.283 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:05:12.283 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:12.283 INFO:teuthology.orchestra.run.smithi110.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:05:12.283 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 1a:92:c1:5e:82:97 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:12.283 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:05:12.283 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:12.283 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::6036:46ff:fee9:9023/64 scope link tentative 2024-01-22T05:05:12.283 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:12.283 INFO:teuthology.orchestra.run.smithi110.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:05:12.283 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 1a:92:c1:5e:82:97 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-22T05:05:12.283 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::1892:c1ff:fe5e:8297/64 scope link tentative 2024-01-22T05:05:12.284 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:12.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:12.285 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:05:12.362 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-01-22T05:05:12.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:12.365 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-01-22T05:05:12.425 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-01-22T05:05:12.425 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:05:12.425 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-22T05:05:12.425 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-22T05:05:12.425 INFO:teuthology.orchestra.run.smithi110.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:05:12.425 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-01-22T05:05:12.425 INFO:teuthology.orchestra.run.smithi110.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-22T05:05:12.425 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:05:12.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:12.426 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-22T05:05:12.426 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-22T05:05:12.426 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-22T05:05:12.426 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-22T05:05:12.427 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-22T05:05:12.427 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-22T05:05:12.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:12.555 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-22T05:05:12.569 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-22T05:05:12.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:12.570 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2024-01-22T05:05:12.629 INFO:teuthology.orchestra.run.smithi110.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-01-22T05:05:12.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:12.630 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-22T05:05:12.631 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-22T05:05:12.631 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-22T05:05:12.631 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-01-22T05:05:12.631 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-22T05:05:12.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:12.741 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-22T05:05:12.772 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:05:12.772 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:05:12.772 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:05:12.772 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:12.773 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-01-22T05:05:12.773 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:12.773 INFO:teuthology.orchestra.run.smithi110.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:05:12.773 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 42:91:fe:43:d9:2a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-22T05:05:12.773 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-22T05:05:12.773 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:12.773 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::4091:feff:fe43:d92a/64 scope link 2024-01-22T05:05:12.773 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:12.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:12.776 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-22T05:05:12.857 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:05:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:05:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:05:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-01-22T05:05:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:12.858 INFO:teuthology.orchestra.run.smithi110.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:05:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 42:91:fe:43:d9:2a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-22T05:05:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-22T05:05:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::4091:feff:fe43:d92a/64 scope link 2024-01-22T05:05:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:12.862 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-01-22T05:05:12.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:12.862 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-22T05:05:12.862 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-22T05:05:12.862 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-01-22T05:05:12.862 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-22T05:05:12.862 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-01-22T05:05:12.863 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-01-22T05:05:12.863 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-01-22T05:05:12.863 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-22T05:05:13.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:13.048 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-22T05:05:13.048 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-22T05:05:13.048 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.1 up 2024-01-22T05:05:13.048 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.1 master ceph-brx 2024-01-22T05:05:13.048 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-22T05:05:13.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:13.113 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p /home/ubuntu/cephtest/mnt.3 2024-01-22T05:05:13.126 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:05:13.126 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:05:13.246 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:05:13.246 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:05:13.270 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:05:13.270 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:05:13.275 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:05:13.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:13.275 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-01-22T05:05:13.304 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-01-22T05:05:13.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:05:13.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.496+0000 7f0a99000700 1 Processor -- start 2024-01-22T05:05:13.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.500+0000 7f0a99000700 1 -- start start 2024-01-22T05:05:13.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.500+0000 7f0a99000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0a94065240 0x7f0a940644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:13.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.500+0000 7f0a99000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0a94065620 0x7f0a940649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:13.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.500+0000 7f0a99000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a940c2700 con 0x7f0a9415b9b0 2024-01-22T05:05:13.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.500+0000 7f0a99000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a94064ed0 con 0x7f0a94065240 2024-01-22T05:05:13.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.500+0000 7f0a99000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a940c29a0 con 0x7f0a94065620 2024-01-22T05:05:13.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.500+0000 7f0a91e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0a94065240 0x7f0a940644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:13.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.500+0000 7f0a93200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0a9415b9b0 0x7f0a9415bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44674/0 (socket says 172.21.15.49:44674) 2024-01-22T05:05:13.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.500+0000 7f0a93200700 1 -- 172.21.15.49:0/3866708827 learned_addr learned my addr 172.21.15.49:0/3866708827 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:13.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.500+0000 7f0a91400700 1 --2- 172.21.15.49:0/3866708827 >> v2:172.21.15.110:3300/0 conn(0x7f0a94065620 0x7f0a940649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:13.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.500+0000 7f0a91e00700 1 -- 172.21.15.49:0/3866708827 >> v2:172.21.15.110:3300/0 conn(0x7f0a94065620 msgr2=0x7f0a940649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.500+0000 7f0a91e00700 1 --2- 172.21.15.49:0/3866708827 >> v2:172.21.15.110:3300/0 conn(0x7f0a94065620 0x7f0a940649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.500+0000 7f0a91e00700 1 -- 172.21.15.49:0/3866708827 >> v1:172.21.15.49:6789/0 conn(0x7f0a9415b9b0 legacy=0x7f0a9415bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.500+0000 7f0a91e00700 1 -- 172.21.15.49:0/3866708827 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a940c2c80 con 0x7f0a94065240 2024-01-22T05:05:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.500+0000 7f0a91e00700 1 --2- 172.21.15.49:0/3866708827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a94065240 0x7f0a940644f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f0a940c4770 tx=0x7f0a84009060).ready entity=mon.0 client_cookie=203b6c53b99caeff server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.504+0000 7f0a90a00700 1 -- 172.21.15.49:0/3866708827 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8400f510 con 0x7f0a94065240 2024-01-22T05:05:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.504+0000 7f0a90a00700 1 -- 172.21.15.49:0/3866708827 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8400f670 con 0x7f0a94065240 2024-01-22T05:05:13.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.504+0000 7f0a90a00700 1 -- 172.21.15.49:0/3866708827 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8400f9f0 con 0x7f0a94065240 2024-01-22T05:05:13.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.504+0000 7f0a99000700 1 -- 172.21.15.49:0/3866708827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a94065240 msgr2=0x7f0a940644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:13.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.504+0000 7f0a99000700 1 --2- 172.21.15.49:0/3866708827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a94065240 0x7f0a940644f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f0a940c4770 tx=0x7f0a84009060).stop 2024-01-22T05:05:13.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.504+0000 7f0a99000700 1 -- 172.21.15.49:0/3866708827 shutdown_connections 2024-01-22T05:05:13.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.504+0000 7f0a99000700 1 --2- 172.21.15.49:0/3866708827 >> v2:172.21.15.110:3300/0 conn(0x7f0a94065620 0x7f0a940649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:13.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.504+0000 7f0a99000700 1 --2- 172.21.15.49:0/3866708827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a94065240 0x7f0a940644f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:13.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.504+0000 7f0a99000700 1 -- 172.21.15.49:0/3866708827 >> 172.21.15.49:0/3866708827 conn(0x7f0a940c87f0 msgr2=0x7f0a940c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:13.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.504+0000 7f0a99000700 1 -- 172.21.15.49:0/3866708827 shutdown_connections 2024-01-22T05:05:13.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.504+0000 7f0a99000700 1 -- 172.21.15.49:0/3866708827 wait complete. 2024-01-22T05:05:13.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.508+0000 7f0a99000700 1 Processor -- start 2024-01-22T05:05:13.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.508+0000 7f0a99000700 1 -- start start 2024-01-22T05:05:13.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.508+0000 7f0a99000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a94065240 0x7f0a940bfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:13.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a99000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a94065620 0x7f0a941553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:13.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a99000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a9415b9b0 0x7f0a94168d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:13.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a99000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a941696c0 con 0x7f0a94065240 2024-01-22T05:05:13.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a99000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a941699a0 con 0x7f0a9415b9b0 2024-01-22T05:05:13.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a99000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94169c80 con 0x7f0a94065620 2024-01-22T05:05:13.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a91e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a94065240 0x7f0a940bfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:13.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a91e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a94065240 0x7f0a940bfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57884/0 (socket says 172.21.15.49:57884) 2024-01-22T05:05:13.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a91e00700 1 -- 172.21.15.49:0/2083121078 learned_addr learned my addr 172.21.15.49:0/2083121078 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:13.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a93200700 1 --2- 172.21.15.49:0/2083121078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a9415b9b0 0x7f0a94168d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:13.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a91400700 1 --2- 172.21.15.49:0/2083121078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a94065620 0x7f0a941553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:13.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a91e00700 1 -- 172.21.15.49:0/2083121078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a94065620 msgr2=0x7f0a941553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:13.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a91e00700 1 --2- 172.21.15.49:0/2083121078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a94065620 0x7f0a941553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:13.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a91e00700 1 -- 172.21.15.49:0/2083121078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a9415b9b0 msgr2=0x7f0a94168d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:13.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a91e00700 1 --2- 172.21.15.49:0/2083121078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a9415b9b0 0x7f0a94168d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:13.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a91e00700 1 -- 172.21.15.49:0/2083121078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840092a0 con 0x7f0a94065240 2024-01-22T05:05:13.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a91e00700 1 --2- 172.21.15.49:0/2083121078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a94065240 0x7f0a940bfd20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f0a84009dd0 tx=0x7f0a84017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:13.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a89600700 1 -- 172.21.15.49:0/2083121078 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8400f7e0 con 0x7f0a94065240 2024-01-22T05:05:13.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a89600700 1 -- 172.21.15.49:0/2083121078 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8400f940 con 0x7f0a94065240 2024-01-22T05:05:13.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a99000700 1 -- 172.21.15.49:0/2083121078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a94169fe0 con 0x7f0a94065240 2024-01-22T05:05:13.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a89600700 1 -- 172.21.15.49:0/2083121078 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8401b660 con 0x7f0a94065240 2024-01-22T05:05:13.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.512+0000 7f0a99000700 1 -- 172.21.15.49:0/2083121078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a941558b0 con 0x7f0a94065240 2024-01-22T05:05:13.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.516+0000 7f0a99000700 1 -- 172.21.15.49:0/2083121078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a94047060 con 0x7f0a94065240 2024-01-22T05:05:13.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.516+0000 7f0a89600700 1 -- 172.21.15.49:0/2083121078 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0a8401ba10 con 0x7f0a94065240 2024-01-22T05:05:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.516+0000 7f0a89600700 1 --2- 172.21.15.49:0/2083121078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a6c05a510 0x7f0a6c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:13.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.516+0000 7f0a89600700 1 -- 172.21.15.49:0/2083121078 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f0a84076410 con 0x7f0a94065240 2024-01-22T05:05:13.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.520+0000 7f0a91400700 1 --2- 172.21.15.49:0/2083121078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a6c05a510 0x7f0a6c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:13.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.520+0000 7f0a91400700 1 --2- 172.21.15.49:0/2083121078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a6c05a510 0x7f0a6c05c9d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f0a94166990 tx=0x7f0a7c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:13.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.524+0000 7f0a89600700 1 -- 172.21.15.49:0/2083121078 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0a840498e0 con 0x7f0a94065240 2024-01-22T05:05:13.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.688+0000 7f0a99000700 1 -- 172.21.15.49:0/2083121078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a940c2f60 con 0x7f0a94065240 2024-01-22T05:05:13.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.692+0000 7f0a89600700 1 -- 172.21.15.49:0/2083121078 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f0a8404cf00 con 0x7f0a94065240 2024-01-22T05:05:13.695 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:13.695 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:39.526211+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:05:13.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.692+0000 7f0a99000700 1 -- 172.21.15.49:0/2083121078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a6c05a510 msgr2=0x7f0a6c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:13.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.692+0000 7f0a99000700 1 --2- 172.21.15.49:0/2083121078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a6c05a510 0x7f0a6c05c9d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f0a94166990 tx=0x7f0a7c009060).stop 2024-01-22T05:05:13.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.692+0000 7f0a99000700 1 -- 172.21.15.49:0/2083121078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a94065240 msgr2=0x7f0a940bfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:13.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.692+0000 7f0a99000700 1 --2- 172.21.15.49:0/2083121078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a94065240 0x7f0a940bfd20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f0a84009dd0 tx=0x7f0a84017000).stop 2024-01-22T05:05:13.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.692+0000 7f0a99000700 1 -- 172.21.15.49:0/2083121078 shutdown_connections 2024-01-22T05:05:13.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.692+0000 7f0a99000700 1 --2- 172.21.15.49:0/2083121078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a6c05a510 0x7f0a6c05c9d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:13.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.692+0000 7f0a99000700 1 --2- 172.21.15.49:0/2083121078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a9415b9b0 0x7f0a94168d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:13.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.692+0000 7f0a99000700 1 --2- 172.21.15.49:0/2083121078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a94065620 0x7f0a941553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:13.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.692+0000 7f0a99000700 1 --2- 172.21.15.49:0/2083121078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a94065240 0x7f0a940bfd20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:13.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.692+0000 7f0a99000700 1 -- 172.21.15.49:0/2083121078 >> 172.21.15.49:0/2083121078 conn(0x7f0a940c87f0 msgr2=0x7f0a94063780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:13.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.696+0000 7f0a99000700 1 -- 172.21.15.49:0/2083121078 shutdown_connections 2024-01-22T05:05:13.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.696+0000 7f0a99000700 1 -- 172.21.15.49:0/2083121078 wait complete. 2024-01-22T05:05:13.720 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:04:32.991898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:04:34.057128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-22T05:04:37.108860+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:05:13.721 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:05:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.880+0000 7ff047600700 1 Processor -- start 2024-01-22T05:05:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.880+0000 7ff047600700 1 -- start start 2024-01-22T05:05:13.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.884+0000 7ff047600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff0400bcaa0 0x7ff0400c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:13.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.884+0000 7ff047600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0400bd0a0 con 0x7ff040150b30 2024-01-22T05:05:13.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.884+0000 7ff047600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0400c0fa0 con 0x7ff0401506a0 2024-01-22T05:05:13.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.884+0000 7ff047600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0400bce80 con 0x7ff0400bcaa0 2024-01-22T05:05:13.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.884+0000 7ff045600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff040150b30 0x7ff040067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44682/0 (socket says 172.21.15.49:44682) 2024-01-22T05:05:13.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.884+0000 7ff045600700 1 -- 172.21.15.49:0/1976360152 learned_addr learned my addr 172.21.15.49:0/1976360152 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:13.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.884+0000 7ff044c00700 1 --2- 172.21.15.49:0/1976360152 >> v2:172.21.15.110:3300/0 conn(0x7ff0400bcaa0 0x7ff0400c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.884+0000 7ff03f400700 1 -- 172.21.15.49:0/1976360152 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050396288 0 0) 0x7ff0400bd0a0 con 0x7ff040150b30 2024-01-22T05:05:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.884+0000 7ff03f400700 1 -- 172.21.15.49:0/1976360152 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0200033f0 con 0x7ff040150b30 2024-01-22T05:05:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.884+0000 7ff044c00700 1 -- 172.21.15.49:0/1976360152 >> v1:172.21.15.110:6789/0 conn(0x7ff0401506a0 legacy=0x7ff0400a87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.884+0000 7ff044c00700 1 -- 172.21.15.49:0/1976360152 >> v1:172.21.15.49:6789/0 conn(0x7ff040150b30 legacy=0x7ff040067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.884+0000 7ff03f400700 1 -- 172.21.15.49:0/1976360152 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887267099 0 0) 0x7ff0400c0fa0 con 0x7ff0401506a0 2024-01-22T05:05:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.884+0000 7ff044c00700 1 -- 172.21.15.49:0/1976360152 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0400c1280 con 0x7ff0400bcaa0 2024-01-22T05:05:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.888+0000 7ff044c00700 1 --2- 172.21.15.49:0/1976360152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0400bcaa0 0x7ff0400c1a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff030009760 tx=0x7ff030009060).ready entity=mon.1 client_cookie=212c7f0cdbe0c470 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.888+0000 7ff03f400700 1 -- 172.21.15.49:0/1976360152 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300090d0 con 0x7ff0400bcaa0 2024-01-22T05:05:13.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.888+0000 7ff03f400700 1 -- 172.21.15.49:0/1976360152 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03000f510 con 0x7ff0400bcaa0 2024-01-22T05:05:13.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.888+0000 7ff03f400700 1 -- 172.21.15.49:0/1976360152 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03000f890 con 0x7ff0400bcaa0 2024-01-22T05:05:13.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.888+0000 7ff047600700 1 -- 172.21.15.49:0/1976360152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0400bcaa0 msgr2=0x7ff0400c1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:13.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.888+0000 7ff047600700 1 --2- 172.21.15.49:0/1976360152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0400bcaa0 0x7ff0400c1a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff030009760 tx=0x7ff030009060).stop 2024-01-22T05:05:13.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.888+0000 7ff047600700 1 -- 172.21.15.49:0/1976360152 shutdown_connections 2024-01-22T05:05:13.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.888+0000 7ff047600700 1 --2- 172.21.15.49:0/1976360152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0400bcaa0 0x7ff0400c1a80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:13.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.888+0000 7ff047600700 1 -- 172.21.15.49:0/1976360152 >> 172.21.15.49:0/1976360152 conn(0x7ff040062cb0 msgr2=0x7ff0400c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:13.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.888+0000 7ff047600700 1 -- 172.21.15.49:0/1976360152 shutdown_connections 2024-01-22T05:05:13.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.888+0000 7ff047600700 1 -- 172.21.15.49:0/1976360152 wait complete. 2024-01-22T05:05:13.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.892+0000 7ff047600700 1 Processor -- start 2024-01-22T05:05:13.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.892+0000 7ff047600700 1 -- start start 2024-01-22T05:05:13.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.892+0000 7ff047600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0400bcaa0 0x7ff04014e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:13.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.892+0000 7ff047600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0401506a0 0x7ff04014ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:13.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.892+0000 7ff047600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff040150b30 0x7ff0400a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:13.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.892+0000 7ff047600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04014f390 con 0x7ff0401506a0 2024-01-22T05:05:13.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.892+0000 7ff047600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04014d1b0 con 0x7ff0400bcaa0 2024-01-22T05:05:13.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.892+0000 7ff047600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0400a8950 con 0x7ff040150b30 2024-01-22T05:05:13.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.892+0000 7ff03fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0401506a0 0x7ff04014ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:13.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.892+0000 7ff03fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0401506a0 0x7ff04014ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57894/0 (socket says 172.21.15.49:57894) 2024-01-22T05:05:13.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.892+0000 7ff03fe00700 1 -- 172.21.15.49:0/196076028 learned_addr learned my addr 172.21.15.49:0/196076028 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:13.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.892+0000 7ff044c00700 1 --2- 172.21.15.49:0/196076028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0400bcaa0 0x7ff04014e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:13.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.892+0000 7ff045600700 1 --2- 172.21.15.49:0/196076028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff040150b30 0x7ff0400a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:13.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.896+0000 7ff03fe00700 1 -- 172.21.15.49:0/196076028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff040150b30 msgr2=0x7ff0400a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:13.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.896+0000 7ff03fe00700 1 --2- 172.21.15.49:0/196076028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff040150b30 0x7ff0400a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:13.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.896+0000 7ff03fe00700 1 -- 172.21.15.49:0/196076028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0400bcaa0 msgr2=0x7ff04014e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:13.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.896+0000 7ff03fe00700 1 --2- 172.21.15.49:0/196076028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0400bcaa0 0x7ff04014e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:13.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.896+0000 7ff03fe00700 1 -- 172.21.15.49:0/196076028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300092a0 con 0x7ff0401506a0 2024-01-22T05:05:13.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.896+0000 7ff03fe00700 1 --2- 172.21.15.49:0/196076028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0401506a0 0x7ff04014ccc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7ff02800c4d0 tx=0x7ff028007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:13.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.896+0000 7ff037e00700 1 -- 172.21.15.49:0/196076028 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02800ce40 con 0x7ff0401506a0 2024-01-22T05:05:13.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.896+0000 7ff037e00700 1 -- 172.21.15.49:0/196076028 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02800f470 con 0x7ff0401506a0 2024-01-22T05:05:13.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.896+0000 7ff047600700 1 -- 172.21.15.49:0/196076028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04014e780 con 0x7ff0401506a0 2024-01-22T05:05:13.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.896+0000 7ff037e00700 1 -- 172.21.15.49:0/196076028 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02800f830 con 0x7ff0401506a0 2024-01-22T05:05:13.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.896+0000 7ff047600700 1 -- 172.21.15.49:0/196076028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04014ed40 con 0x7ff0401506a0 2024-01-22T05:05:13.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.896+0000 7ff047600700 1 -- 172.21.15.49:0/196076028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0400c0c00 con 0x7ff0401506a0 2024-01-22T05:05:13.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.900+0000 7ff037e00700 1 -- 172.21.15.49:0/196076028 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff02800fba0 con 0x7ff0401506a0 2024-01-22T05:05:13.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.900+0000 7ff037e00700 1 --2- 172.21.15.49:0/196076028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff01805a540 0x7ff01805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:13.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.900+0000 7ff037e00700 1 -- 172.21.15.49:0/196076028 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7ff0280740b0 con 0x7ff0401506a0 2024-01-22T05:05:13.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.900+0000 7ff044c00700 1 --2- 172.21.15.49:0/196076028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff01805a540 0x7ff01805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:13.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.900+0000 7ff044c00700 1 --2- 172.21.15.49:0/196076028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff01805a540 0x7ff01805ca00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7ff030009760 tx=0x7ff030017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:13.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:13.908+0000 7ff037e00700 1 -- 172.21.15.49:0/196076028 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff0280474c0 con 0x7ff0401506a0 2024-01-22T05:05:14.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.068+0000 7ff047600700 1 -- 172.21.15.49:0/196076028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff040046800 con 0x7ff0401506a0 2024-01-22T05:05:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.072+0000 7ff037e00700 1 -- 172.21.15.49:0/196076028 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff028007d70 con 0x7ff0401506a0 2024-01-22T05:05:14.075 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:05:14.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.072+0000 7ff047600700 1 -- 172.21.15.49:0/196076028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff01805a540 msgr2=0x7ff01805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:14.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.072+0000 7ff047600700 1 --2- 172.21.15.49:0/196076028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff01805a540 0x7ff01805ca00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7ff030009760 tx=0x7ff030017000).stop 2024-01-22T05:05:14.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.072+0000 7ff047600700 1 -- 172.21.15.49:0/196076028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0401506a0 msgr2=0x7ff04014ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:14.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.072+0000 7ff047600700 1 --2- 172.21.15.49:0/196076028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0401506a0 0x7ff04014ccc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7ff02800c4d0 tx=0x7ff028007c50).stop 2024-01-22T05:05:14.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.076+0000 7ff047600700 1 -- 172.21.15.49:0/196076028 shutdown_connections 2024-01-22T05:05:14.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.076+0000 7ff047600700 1 --2- 172.21.15.49:0/196076028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff01805a540 0x7ff01805ca00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.076+0000 7ff047600700 1 --2- 172.21.15.49:0/196076028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff040150b30 0x7ff0400a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.076+0000 7ff047600700 1 --2- 172.21.15.49:0/196076028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0401506a0 0x7ff04014ccc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.076+0000 7ff047600700 1 --2- 172.21.15.49:0/196076028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0400bcaa0 0x7ff04014e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.076+0000 7ff047600700 1 -- 172.21.15.49:0/196076028 >> 172.21.15.49:0/196076028 conn(0x7ff040062cb0 msgr2=0x7ff0400a9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:14.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.076+0000 7ff047600700 1 -- 172.21.15.49:0/196076028 shutdown_connections 2024-01-22T05:05:14.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.076+0000 7ff047600700 1 -- 172.21.15.49:0/196076028 wait complete. 2024-01-22T05:05:14.099 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:05:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.260+0000 7f06f5000700 1 Processor -- start 2024-01-22T05:05:14.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.260+0000 7f06f5000700 1 -- start start 2024-01-22T05:05:14.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.264+0000 7f06f5000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f06f00a8c20 0x7f06f00c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:14.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.264+0000 7f06f5000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f06f00bcbe0 0x7f06f0068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:14.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.264+0000 7f06f5000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f0158650 con 0x7f06f00c1ac0 2024-01-22T05:05:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.264+0000 7f06f5000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f00c1f20 con 0x7f06f00bcbe0 2024-01-22T05:05:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.264+0000 7f06f5000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f00bd170 con 0x7f06f00a8c20 2024-01-22T05:05:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.264+0000 7f06ee800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f06f00bcbe0 0x7f06f0068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.264+0000 7f06ed400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f06f00c1ac0 0x7f06f00bc4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44692/0 (socket says 172.21.15.49:44692) 2024-01-22T05:05:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.264+0000 7f06ed400700 1 -- 172.21.15.49:0/1224050466 learned_addr learned my addr 172.21.15.49:0/1224050466 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.264+0000 7f06ede00700 1 --2- 172.21.15.49:0/1224050466 >> v2:172.21.15.110:3300/0 conn(0x7f06f00a8c20 0x7f06f00c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06eca00700 1 -- 172.21.15.49:0/1224050466 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254758061 0 0) 0x7f06d8001290 con 0x7f06f00c1ac0 2024-01-22T05:05:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06eca00700 1 -- 172.21.15.49:0/1224050466 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06d00033f0 con 0x7f06f00c1ac0 2024-01-22T05:05:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06ede00700 1 -- 172.21.15.49:0/1224050466 >> v2:172.21.15.49:3300/0 conn(0x7f06f00bcbe0 msgr2=0x7f06f0068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06ede00700 1 --2- 172.21.15.49:0/1224050466 >> v2:172.21.15.49:3300/0 conn(0x7f06f00bcbe0 0x7f06f0068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06ede00700 1 -- 172.21.15.49:0/1224050466 >> v1:172.21.15.49:6789/0 conn(0x7f06f00c1ac0 legacy=0x7f06f00bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06ede00700 1 -- 172.21.15.49:0/1224050466 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f0067c30 con 0x7f06f00a8c20 2024-01-22T05:05:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06ede00700 1 --2- 172.21.15.49:0/1224050466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f00a8c20 0x7f06f00c15d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f06f00c4300 tx=0x7f06e0009060).ready entity=mon.1 client_cookie=3012621a4d849fc5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06eca00700 1 -- 172.21.15.49:0/1224050466 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e000d4a0 con 0x7f06f00a8c20 2024-01-22T05:05:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06eca00700 1 -- 172.21.15.49:0/1224050466 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e000d600 con 0x7f06f00a8c20 2024-01-22T05:05:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06eca00700 1 -- 172.21.15.49:0/1224050466 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e000d980 con 0x7f06f00a8c20 2024-01-22T05:05:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06f5000700 1 -- 172.21.15.49:0/1224050466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f00a8c20 msgr2=0x7f06f00c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06f5000700 1 --2- 172.21.15.49:0/1224050466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f00a8c20 0x7f06f00c15d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f06f00c4300 tx=0x7f06e0009060).stop 2024-01-22T05:05:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06f5000700 1 -- 172.21.15.49:0/1224050466 shutdown_connections 2024-01-22T05:05:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06f5000700 1 --2- 172.21.15.49:0/1224050466 >> v2:172.21.15.49:3300/0 conn(0x7f06f00bcbe0 0x7f06f0068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06f5000700 1 --2- 172.21.15.49:0/1224050466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f00a8c20 0x7f06f00c15d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.268+0000 7f06f5000700 1 -- 172.21.15.49:0/1224050466 >> 172.21.15.49:0/1224050466 conn(0x7f06f0062cb0 msgr2=0x7f06f00c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:14.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.272+0000 7f06f5000700 1 -- 172.21.15.49:0/1224050466 shutdown_connections 2024-01-22T05:05:14.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.272+0000 7f06f5000700 1 -- 172.21.15.49:0/1224050466 wait complete. 2024-01-22T05:05:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.272+0000 7f06f5000700 1 Processor -- start 2024-01-22T05:05:14.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.272+0000 7f06f5000700 1 -- start start 2024-01-22T05:05:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06f5000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f00a8c20 0x7f06f0159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06f5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f00bcbe0 0x7f06f0153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06f5000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f00c1ac0 0x7f06f00becb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06f5000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f016c3c0 con 0x7f06f00bcbe0 2024-01-22T05:05:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06f5000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f016c6a0 con 0x7f06f00c1ac0 2024-01-22T05:05:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06f5000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f0153520 con 0x7f06f00a8c20 2024-01-22T05:05:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06ed400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f00bcbe0 0x7f06f0153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06ed400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f00bcbe0 0x7f06f0153030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57916/0 (socket says 172.21.15.49:57916) 2024-01-22T05:05:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06ed400700 1 -- 172.21.15.49:0/780521739 learned_addr learned my addr 172.21.15.49:0/780521739 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06ee800700 1 --2- 172.21.15.49:0/780521739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f00c1ac0 0x7f06f00becb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06ede00700 1 --2- 172.21.15.49:0/780521739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f00a8c20 0x7f06f0159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06ed400700 1 -- 172.21.15.49:0/780521739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f00a8c20 msgr2=0x7f06f0159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06ed400700 1 --2- 172.21.15.49:0/780521739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f00a8c20 0x7f06f0159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06ed400700 1 -- 172.21.15.49:0/780521739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f00c1ac0 msgr2=0x7f06f00becb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06ed400700 1 --2- 172.21.15.49:0/780521739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f00c1ac0 0x7f06f00becb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06ed400700 1 -- 172.21.15.49:0/780521739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e00092a0 con 0x7f06f00bcbe0 2024-01-22T05:05:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06ee800700 1 --2- 172.21.15.49:0/780521739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f00c1ac0 0x7f06f00becb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06ed400700 1 --2- 172.21.15.49:0/780521739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f00bcbe0 0x7f06f0153030 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f06d800c470 tx=0x7f06d8007960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:14.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06e5600700 1 -- 172.21.15.49:0/780521739 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d80070d0 con 0x7f06f00bcbe0 2024-01-22T05:05:14.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06e5600700 1 -- 172.21.15.49:0/780521739 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d8007230 con 0x7f06f00bcbe0 2024-01-22T05:05:14.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06f5000700 1 -- 172.21.15.49:0/780521739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f015a560 con 0x7f06f00bcbe0 2024-01-22T05:05:14.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06e5600700 1 -- 172.21.15.49:0/780521739 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8005670 con 0x7f06f00bcbe0 2024-01-22T05:05:14.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.276+0000 7f06f5000700 1 -- 172.21.15.49:0/780521739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f015ab20 con 0x7f06f00bcbe0 2024-01-22T05:05:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.280+0000 7f06f5000700 1 -- 172.21.15.49:0/780521739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f016c830 con 0x7f06f00bcbe0 2024-01-22T05:05:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.280+0000 7f06e5600700 1 -- 172.21.15.49:0/780521739 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f06d8005cb0 con 0x7f06f00bcbe0 2024-01-22T05:05:14.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.280+0000 7f06e5600700 1 --2- 172.21.15.49:0/780521739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f06c805a540 0x7f06c805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:14.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.280+0000 7f06e5600700 1 -- 172.21.15.49:0/780521739 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f06d8074330 con 0x7f06f00bcbe0 2024-01-22T05:05:14.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.280+0000 7f06ede00700 1 --2- 172.21.15.49:0/780521739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f06c805a540 0x7f06c805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:14.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.284+0000 7f06ede00700 1 --2- 172.21.15.49:0/780521739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f06c805a540 0x7f06c805ca00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f06e000d260 tx=0x7f06e0016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.288+0000 7f06e5600700 1 -- 172.21.15.49:0/780521739 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f06d8047740 con 0x7f06f00bcbe0 2024-01-22T05:05:14.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.448+0000 7f06f5000700 1 -- 172.21.15.49:0/780521739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f06f00c0c00 con 0x7f06f00bcbe0 2024-01-22T05:05:14.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.448+0000 7f06e5600700 1 -- 172.21.15.49:0/780521739 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f06d8018070 con 0x7f06f00bcbe0 2024-01-22T05:05:14.451 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:05:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.452+0000 7f06f5000700 1 -- 172.21.15.49:0/780521739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f06c805a540 msgr2=0x7f06c805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.452+0000 7f06f5000700 1 --2- 172.21.15.49:0/780521739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f06c805a540 0x7f06c805ca00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f06e000d260 tx=0x7f06e0016000).stop 2024-01-22T05:05:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.452+0000 7f06f5000700 1 -- 172.21.15.49:0/780521739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f00bcbe0 msgr2=0x7f06f0153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.452+0000 7f06f5000700 1 --2- 172.21.15.49:0/780521739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f00bcbe0 0x7f06f0153030 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f06d800c470 tx=0x7f06d8007960).stop 2024-01-22T05:05:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.452+0000 7f06f5000700 1 -- 172.21.15.49:0/780521739 shutdown_connections 2024-01-22T05:05:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.452+0000 7f06f5000700 1 --2- 172.21.15.49:0/780521739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f06c805a540 0x7f06c805ca00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.452+0000 7f06f5000700 1 --2- 172.21.15.49:0/780521739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f00c1ac0 0x7f06f00becb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.452+0000 7f06f5000700 1 --2- 172.21.15.49:0/780521739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f00bcbe0 0x7f06f0153030 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.452+0000 7f06f5000700 1 --2- 172.21.15.49:0/780521739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f00a8c20 0x7f06f0159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.452+0000 7f06f5000700 1 -- 172.21.15.49:0/780521739 >> 172.21.15.49:0/780521739 conn(0x7f06f0062cb0 msgr2=0x7f06f00bc140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.452+0000 7f06f5000700 1 -- 172.21.15.49:0/780521739 shutdown_connections 2024-01-22T05:05:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.452+0000 7f06f5000700 1 -- 172.21.15.49:0/780521739 wait complete. 2024-01-22T05:05:14.479 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:05:14.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.644+0000 7f8127c00700 1 Processor -- start 2024-01-22T05:05:14.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.644+0000 7f8127c00700 1 -- start start 2024-01-22T05:05:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f8127c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f81200c3ab0 0x7f8120069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f8127c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8120063e20 0x7f81200642b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f8127c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81201543a0 0x7f8120154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f8127c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8120150d20 con 0x7f81200c3ab0 2024-01-22T05:05:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f8127c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81200bc700 con 0x7f8120063e20 2024-01-22T05:05:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f8127c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81200647a0 con 0x7f81201543a0 2024-01-22T05:05:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f8125200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f81200c3ab0 0x7f8120069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f8125200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f81200c3ab0 0x7f8120069f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57932/0 (socket says 172.21.15.49:57932) 2024-01-22T05:05:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f8125200700 1 -- 172.21.15.49:0/2095101316 learned_addr learned my addr 172.21.15.49:0/2095101316 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f811fe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8120063e20 0x7f81200642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f8125c00700 1 --2- 172.21.15.49:0/2095101316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81201543a0 0x7f8120154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f8125200700 1 -- 172.21.15.49:0/2095101316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81201543a0 msgr2=0x7f8120154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f8125200700 1 --2- 172.21.15.49:0/2095101316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81201543a0 0x7f8120154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f8125200700 1 -- 172.21.15.49:0/2095101316 >> v2:172.21.15.110:3300/0 conn(0x7f8120063e20 msgr2=0x7f81200642b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f8125200700 1 --2- 172.21.15.49:0/2095101316 >> v2:172.21.15.110:3300/0 conn(0x7f8120063e20 0x7f81200642b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f8125200700 1 -- 172.21.15.49:0/2095101316 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812006a420 con 0x7f81200c3ab0 2024-01-22T05:05:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.648+0000 7f811fe00700 1 --2- 172.21.15.49:0/2095101316 >> v2:172.21.15.110:3300/0 conn(0x7f8120063e20 0x7f81200642b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.652+0000 7f8125200700 1 --2- 172.21.15.49:0/2095101316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81200c3ab0 0x7f8120069f30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f8120064ed0 tx=0x7f81100090f0).ready entity=mon.0 client_cookie=cecb0e62af11f494 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:14.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.652+0000 7f811f400700 1 -- 172.21.15.49:0/2095101316 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811000f510 con 0x7f81200c3ab0 2024-01-22T05:05:14.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.652+0000 7f811f400700 1 -- 172.21.15.49:0/2095101316 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811000f670 con 0x7f81200c3ab0 2024-01-22T05:05:14.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.652+0000 7f811f400700 1 -- 172.21.15.49:0/2095101316 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811000f9f0 con 0x7f81200c3ab0 2024-01-22T05:05:14.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.652+0000 7f8127c00700 1 -- 172.21.15.49:0/2095101316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81200c3ab0 msgr2=0x7f8120069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:14.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.652+0000 7f8127c00700 1 --2- 172.21.15.49:0/2095101316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81200c3ab0 0x7f8120069f30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f8120064ed0 tx=0x7f81100090f0).stop 2024-01-22T05:05:14.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.652+0000 7f8127c00700 1 -- 172.21.15.49:0/2095101316 shutdown_connections 2024-01-22T05:05:14.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.652+0000 7f8127c00700 1 --2- 172.21.15.49:0/2095101316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81201543a0 0x7f8120154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.652+0000 7f8127c00700 1 --2- 172.21.15.49:0/2095101316 >> v2:172.21.15.110:3300/0 conn(0x7f8120063e20 0x7f81200642b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.652+0000 7f8127c00700 1 --2- 172.21.15.49:0/2095101316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81200c3ab0 0x7f8120069f30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.652+0000 7f8127c00700 1 -- 172.21.15.49:0/2095101316 >> 172.21.15.49:0/2095101316 conn(0x7f8120066810 msgr2=0x7f8120066bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:14.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.652+0000 7f8127c00700 1 -- 172.21.15.49:0/2095101316 shutdown_connections 2024-01-22T05:05:14.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.652+0000 7f8127c00700 1 -- 172.21.15.49:0/2095101316 wait complete. 2024-01-22T05:05:14.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.656+0000 7f8127c00700 1 Processor -- start 2024-01-22T05:05:14.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.656+0000 7f8127c00700 1 -- start start 2024-01-22T05:05:14.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8127c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8120063e20 0x7f81200a91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8127c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81200c3ab0 0x7f81200a3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8127c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81201543a0 0x7f8120152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8127c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8120166390 con 0x7f81201543a0 2024-01-22T05:05:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8127c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8120165780 con 0x7f81200c3ab0 2024-01-22T05:05:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8127c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8120165a60 con 0x7f8120063e20 2024-01-22T05:05:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8125c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81201543a0 0x7f8120152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8125c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81201543a0 0x7f8120152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57944/0 (socket says 172.21.15.49:57944) 2024-01-22T05:05:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8125c00700 1 -- 172.21.15.49:0/2853884678 learned_addr learned my addr 172.21.15.49:0/2853884678 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8125200700 1 --2- 172.21.15.49:0/2853884678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8120063e20 0x7f81200a91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f811fe00700 1 --2- 172.21.15.49:0/2853884678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81200c3ab0 0x7f81200a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8125c00700 1 -- 172.21.15.49:0/2853884678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8120063e20 msgr2=0x7f81200a91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8125c00700 1 --2- 172.21.15.49:0/2853884678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8120063e20 0x7f81200a91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8125c00700 1 -- 172.21.15.49:0/2853884678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81200c3ab0 msgr2=0x7f81200a3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:14.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8125c00700 1 --2- 172.21.15.49:0/2853884678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81200c3ab0 0x7f81200a3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8125c00700 1 -- 172.21.15.49:0/2853884678 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81080092a0 con 0x7f81201543a0 2024-01-22T05:05:14.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8125c00700 1 --2- 172.21.15.49:0/2853884678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81201543a0 0x7f8120152fb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f8118009e90 tx=0x7f811800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:14.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8117e00700 1 -- 172.21.15.49:0/2853884678 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811800caa0 con 0x7f81201543a0 2024-01-22T05:05:14.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8117e00700 1 -- 172.21.15.49:0/2853884678 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811800f040 con 0x7f81201543a0 2024-01-22T05:05:14.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8117e00700 1 -- 172.21.15.49:0/2853884678 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811800ce10 con 0x7f81201543a0 2024-01-22T05:05:14.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.660+0000 7f8127c00700 1 -- 172.21.15.49:0/2853884678 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8110009370 con 0x7f81201543a0 2024-01-22T05:05:14.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.664+0000 7f8127c00700 1 -- 172.21.15.49:0/2853884678 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8120166020 con 0x7f81201543a0 2024-01-22T05:05:14.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.664+0000 7f8127c00700 1 -- 172.21.15.49:0/2853884678 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81200c5980 con 0x7f81201543a0 2024-01-22T05:05:14.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.664+0000 7f8117e00700 1 -- 172.21.15.49:0/2853884678 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8118013610 con 0x7f81201543a0 2024-01-22T05:05:14.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.668+0000 7f8117e00700 1 --2- 172.21.15.49:0/2853884678 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f80f805a540 0x7f80f805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:14.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.668+0000 7f8117e00700 1 -- 172.21.15.49:0/2853884678 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f81180752c0 con 0x7f81201543a0 2024-01-22T05:05:14.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.668+0000 7f8125200700 1 --2- 172.21.15.49:0/2853884678 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f80f805a540 0x7f80f805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:14.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.668+0000 7f8125200700 1 --2- 172.21.15.49:0/2853884678 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f80f805a540 0x7f80f805ca00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8110009130 tx=0x7f8110017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:14.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.676+0000 7f8117e00700 1 -- 172.21.15.49:0/2853884678 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f81200c5980 con 0x7f81201543a0 2024-01-22T05:05:14.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.852+0000 7f8127c00700 1 -- 172.21.15.49:0/2853884678 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f81200c5980 con 0x7f81201543a0 2024-01-22T05:05:14.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.852+0000 7f8117e00700 1 -- 172.21.15.49:0/2853884678 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f81200c5980 con 0x7f81201543a0 2024-01-22T05:05:14.858 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:05:14.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.860+0000 7f8127c00700 1 -- 172.21.15.49:0/2853884678 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f80f805a540 msgr2=0x7f80f805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:14.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.860+0000 7f8127c00700 1 --2- 172.21.15.49:0/2853884678 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f80f805a540 0x7f80f805ca00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8110009130 tx=0x7f8110017000).stop 2024-01-22T05:05:14.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.860+0000 7f8127c00700 1 -- 172.21.15.49:0/2853884678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81201543a0 msgr2=0x7f8120152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:14.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.860+0000 7f8127c00700 1 --2- 172.21.15.49:0/2853884678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81201543a0 0x7f8120152fb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f8118009e90 tx=0x7f811800b040).stop 2024-01-22T05:05:14.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.860+0000 7f8127c00700 1 -- 172.21.15.49:0/2853884678 shutdown_connections 2024-01-22T05:05:14.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.860+0000 7f8127c00700 1 --2- 172.21.15.49:0/2853884678 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f80f805a540 0x7f80f805ca00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.860+0000 7f8127c00700 1 --2- 172.21.15.49:0/2853884678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81201543a0 0x7f8120152fb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.860+0000 7f8127c00700 1 --2- 172.21.15.49:0/2853884678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81200c3ab0 0x7f81200a3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.860+0000 7f8127c00700 1 --2- 172.21.15.49:0/2853884678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8120063e20 0x7f81200a91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:14.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.860+0000 7f8127c00700 1 -- 172.21.15.49:0/2853884678 >> 172.21.15.49:0/2853884678 conn(0x7f8120066810 msgr2=0x7f812014f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:14.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.860+0000 7f8127c00700 1 -- 172.21.15.49:0/2853884678 shutdown_connections 2024-01-22T05:05:14.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:14.860+0000 7f8127c00700 1 -- 172.21.15.49:0/2853884678 wait complete. 2024-01-22T05:05:14.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:05:15.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.052+0000 7fcd25400700 1 Processor -- start 2024-01-22T05:05:15.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.052+0000 7fcd25400700 1 -- start start 2024-01-22T05:05:15.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd25400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcd200c6bc0 0x7fcd200bdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd25400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd200be1b0 0x7fcd200a6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd25400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd20154250 con 0x7fcd200c67e0 2024-01-22T05:05:15.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd25400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd200c4350 con 0x7fcd200be1b0 2024-01-22T05:05:15.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd25400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd200c7150 con 0x7fcd200c6bc0 2024-01-22T05:05:15.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd1f200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd200be1b0 0x7fcd200a6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd1de00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcd200c6bc0 0x7fcd200bdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd1f200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd200be1b0 0x7fcd200a6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57952/0 (socket says 172.21.15.49:57952) 2024-01-22T05:05:15.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd1f200700 1 -- 172.21.15.49:0/3574644516 learned_addr learned my addr 172.21.15.49:0/3574644516 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:15.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd1f200700 1 -- 172.21.15.49:0/3574644516 >> v2:172.21.15.110:3300/0 conn(0x7fcd200c6bc0 msgr2=0x7fcd200bdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:15.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd1f200700 1 --2- 172.21.15.49:0/3574644516 >> v2:172.21.15.110:3300/0 conn(0x7fcd200c6bc0 0x7fcd200bdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd1f200700 1 -- 172.21.15.49:0/3574644516 >> v1:172.21.15.110:6789/0 conn(0x7fcd200c67e0 legacy=0x7fcd200c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd1f200700 1 -- 172.21.15.49:0/3574644516 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd200c3d00 con 0x7fcd200be1b0 2024-01-22T05:05:15.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd1f200700 1 --2- 172.21.15.49:0/3574644516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd200be1b0 0x7fcd200a6660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fcd18009f20 tx=0x7fcd18009840).ready entity=mon.0 client_cookie=651e9f736673a035 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:15.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd1d400700 1 -- 172.21.15.49:0/3574644516 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1800e070 con 0x7fcd200be1b0 2024-01-22T05:05:15.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd1d400700 1 -- 172.21.15.49:0/3574644516 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1800b990 con 0x7fcd200be1b0 2024-01-22T05:05:15.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.056+0000 7fcd1d400700 1 -- 172.21.15.49:0/3574644516 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1800bd10 con 0x7fcd200be1b0 2024-01-22T05:05:15.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.060+0000 7fcd25400700 1 -- 172.21.15.49:0/3574644516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd200be1b0 msgr2=0x7fcd200a6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.060+0000 7fcd25400700 1 --2- 172.21.15.49:0/3574644516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd200be1b0 0x7fcd200a6660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fcd18009f20 tx=0x7fcd18009840).stop 2024-01-22T05:05:15.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.060+0000 7fcd25400700 1 -- 172.21.15.49:0/3574644516 shutdown_connections 2024-01-22T05:05:15.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.060+0000 7fcd25400700 1 --2- 172.21.15.49:0/3574644516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd200be1b0 0x7fcd200a6660 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.060+0000 7fcd25400700 1 --2- 172.21.15.49:0/3574644516 >> v2:172.21.15.110:3300/0 conn(0x7fcd200c6bc0 0x7fcd200bdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.060+0000 7fcd25400700 1 -- 172.21.15.49:0/3574644516 >> 172.21.15.49:0/3574644516 conn(0x7fcd200aa740 msgr2=0x7fcd200aab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:15.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.060+0000 7fcd25400700 1 -- 172.21.15.49:0/3574644516 shutdown_connections 2024-01-22T05:05:15.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.060+0000 7fcd25400700 1 -- 172.21.15.49:0/3574644516 wait complete. 2024-01-22T05:05:15.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.064+0000 7fcd25400700 1 Processor -- start 2024-01-22T05:05:15.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.064+0000 7fcd25400700 1 -- start start 2024-01-22T05:05:15.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.064+0000 7fcd25400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd200be1b0 0x7fcd201543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.064+0000 7fcd25400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd200c67e0 0x7fcd20167ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.064+0000 7fcd25400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd200c6bc0 0x7fcd20150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.064+0000 7fcd25400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd201548e0 con 0x7fcd200be1b0 2024-01-22T05:05:15.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.064+0000 7fcd25400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20167fa0 con 0x7fcd200c6bc0 2024-01-22T05:05:15.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.064+0000 7fcd25400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd201647c0 con 0x7fcd200c67e0 2024-01-22T05:05:15.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd1e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd200be1b0 0x7fcd201543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd1e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd200be1b0 0x7fcd201543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57968/0 (socket says 172.21.15.49:57968) 2024-01-22T05:05:15.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd1e800700 1 -- 172.21.15.49:0/1955946956 learned_addr learned my addr 172.21.15.49:0/1955946956 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:15.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd1f200700 1 --2- 172.21.15.49:0/1955946956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd200c6bc0 0x7fcd20150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd1de00700 1 --2- 172.21.15.49:0/1955946956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd200c67e0 0x7fcd20167ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd1e800700 1 -- 172.21.15.49:0/1955946956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd200c67e0 msgr2=0x7fcd20167ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd1e800700 1 --2- 172.21.15.49:0/1955946956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd200c67e0 0x7fcd20167ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd1e800700 1 -- 172.21.15.49:0/1955946956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd200c6bc0 msgr2=0x7fcd20150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd1e800700 1 --2- 172.21.15.49:0/1955946956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd200c6bc0 0x7fcd20150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd1e800700 1 -- 172.21.15.49:0/1955946956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18009ae0 con 0x7fcd200be1b0 2024-01-22T05:05:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd1e800700 1 --2- 172.21.15.49:0/1955946956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd200be1b0 0x7fcd201543f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fcd1000c440 tx=0x7fcd10007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd16000700 1 -- 172.21.15.49:0/1955946956 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10012400 con 0x7fcd200be1b0 2024-01-22T05:05:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd16000700 1 -- 172.21.15.49:0/1955946956 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd10012560 con 0x7fcd200be1b0 2024-01-22T05:05:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd16000700 1 -- 172.21.15.49:0/1955946956 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10012900 con 0x7fcd200be1b0 2024-01-22T05:05:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd25400700 1 -- 172.21.15.49:0/1955946956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd20164aa0 con 0x7fcd200be1b0 2024-01-22T05:05:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd25400700 1 -- 172.21.15.49:0/1955946956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd20165060 con 0x7fcd200be1b0 2024-01-22T05:05:15.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.068+0000 7fcd25400700 1 -- 172.21.15.49:0/1955946956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd200648b0 con 0x7fcd200be1b0 2024-01-22T05:05:15.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.072+0000 7fcd16000700 1 -- 172.21.15.49:0/1955946956 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcd1001b3b0 con 0x7fcd200be1b0 2024-01-22T05:05:15.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.072+0000 7fcd16000700 1 --2- 172.21.15.49:0/1955946956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccf805a4e0 0x7fccf805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.072+0000 7fcd16000700 1 -- 172.21.15.49:0/1955946956 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fcd10073c30 con 0x7fcd200be1b0 2024-01-22T05:05:15.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.072+0000 7fcd1de00700 1 --2- 172.21.15.49:0/1955946956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccf805a4e0 0x7fccf805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.072+0000 7fcd1de00700 1 --2- 172.21.15.49:0/1955946956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccf805a4e0 0x7fccf805c9a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fcd20062cb0 tx=0x7fcd08009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:15.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.080+0000 7fcd16000700 1 -- 172.21.15.49:0/1955946956 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcd10047150 con 0x7fcd200be1b0 2024-01-22T05:05:15.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.244+0000 7fcd25400700 1 -- 172.21.15.49:0/1955946956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd20154250 con 0x7fcd200be1b0 2024-01-22T05:05:15.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.244+0000 7fcd16000700 1 -- 172.21.15.49:0/1955946956 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd20154250 con 0x7fcd200be1b0 2024-01-22T05:05:15.247 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:05:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.244+0000 7fcd25400700 1 -- 172.21.15.49:0/1955946956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccf805a4e0 msgr2=0x7fccf805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.248+0000 7fcd25400700 1 --2- 172.21.15.49:0/1955946956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccf805a4e0 0x7fccf805c9a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fcd20062cb0 tx=0x7fcd08009060).stop 2024-01-22T05:05:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.248+0000 7fcd25400700 1 -- 172.21.15.49:0/1955946956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd200be1b0 msgr2=0x7fcd201543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.248+0000 7fcd25400700 1 --2- 172.21.15.49:0/1955946956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd200be1b0 0x7fcd201543f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fcd1000c440 tx=0x7fcd10007dc0).stop 2024-01-22T05:05:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.248+0000 7fcd25400700 1 -- 172.21.15.49:0/1955946956 shutdown_connections 2024-01-22T05:05:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.248+0000 7fcd25400700 1 --2- 172.21.15.49:0/1955946956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccf805a4e0 0x7fccf805c9a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.248+0000 7fcd25400700 1 --2- 172.21.15.49:0/1955946956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd200c6bc0 0x7fcd20150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.248+0000 7fcd25400700 1 --2- 172.21.15.49:0/1955946956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd200c67e0 0x7fcd20167ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.248+0000 7fcd25400700 1 --2- 172.21.15.49:0/1955946956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd200be1b0 0x7fcd201543f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.248+0000 7fcd25400700 1 -- 172.21.15.49:0/1955946956 >> 172.21.15.49:0/1955946956 conn(0x7fcd200aa740 msgr2=0x7fcd200c7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:15.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.248+0000 7fcd25400700 1 -- 172.21.15.49:0/1955946956 shutdown_connections 2024-01-22T05:05:15.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.248+0000 7fcd25400700 1 -- 172.21.15.49:0/1955946956 wait complete. 2024-01-22T05:05:15.273 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-22T05:05:15.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.436+0000 7f82e5800700 1 Processor -- start 2024-01-22T05:05:15.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.440+0000 7f82e5800700 1 -- start start 2024-01-22T05:05:15.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82e5800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e0068f70 0x7f82e00c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82e5800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f82e00c53c0 0x7f82e0067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82e5800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e00a6280 con 0x7f82e00a5c30 2024-01-22T05:05:15.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82e5800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e00c1f80 con 0x7f82e00c53c0 2024-01-22T05:05:15.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82e5800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00a6010 con 0x7f82e0068f70 2024-01-22T05:05:15.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82e4e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f82e00c53c0 0x7f82e0067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82dfe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f82e00a5c30 0x7f82e0157f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44706/0 (socket says 172.21.15.49:44706) 2024-01-22T05:05:15.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82dfe00700 1 -- 172.21.15.49:0/1122824979 learned_addr learned my addr 172.21.15.49:0/1122824979 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:15.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82df400700 1 --2- 172.21.15.49:0/1122824979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e0068f70 0x7f82e00c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82e4e00700 1 -- 172.21.15.49:0/1122824979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e0068f70 msgr2=0x7f82e00c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:15.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82e4e00700 1 --2- 172.21.15.49:0/1122824979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e0068f70 0x7f82e00c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82e4e00700 1 -- 172.21.15.49:0/1122824979 >> v1:172.21.15.49:6789/0 conn(0x7f82e00a5c30 legacy=0x7f82e0157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82dea00700 1 -- 172.21.15.49:0/1122824979 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185927304 0 0) 0x7f82d0001110 con 0x7f82e00a5c30 2024-01-22T05:05:15.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82e4e00700 1 -- 172.21.15.49:0/1122824979 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e00693f0 con 0x7f82e00c53c0 2024-01-22T05:05:15.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82e4e00700 1 --2- 172.21.15.49:0/1122824979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e00c53c0 0x7f82e0067a90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f82d8009e60 tx=0x7f82d8009780).ready entity=mon.0 client_cookie=22a8aff0d6cb93de server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:15.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82dea00700 1 -- 172.21.15.49:0/1122824979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d800e070 con 0x7f82e00c53c0 2024-01-22T05:05:15.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82dea00700 1 -- 172.21.15.49:0/1122824979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d800bb60 con 0x7f82e00c53c0 2024-01-22T05:05:15.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.444+0000 7f82dea00700 1 -- 172.21.15.49:0/1122824979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8012410 con 0x7f82e00c53c0 2024-01-22T05:05:15.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.448+0000 7f82e5800700 1 -- 172.21.15.49:0/1122824979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e00c53c0 msgr2=0x7f82e0067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.448+0000 7f82e5800700 1 --2- 172.21.15.49:0/1122824979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e00c53c0 0x7f82e0067a90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f82d8009e60 tx=0x7f82d8009780).stop 2024-01-22T05:05:15.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.448+0000 7f82e5800700 1 -- 172.21.15.49:0/1122824979 shutdown_connections 2024-01-22T05:05:15.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.448+0000 7f82e5800700 1 --2- 172.21.15.49:0/1122824979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e00c53c0 0x7f82e0067a90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.448+0000 7f82e5800700 1 --2- 172.21.15.49:0/1122824979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e0068f70 0x7f82e00c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.448+0000 7f82e5800700 1 -- 172.21.15.49:0/1122824979 >> 172.21.15.49:0/1122824979 conn(0x7f82e00c3ed0 msgr2=0x7f82e0065a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:15.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.448+0000 7f82e5800700 1 -- 172.21.15.49:0/1122824979 shutdown_connections 2024-01-22T05:05:15.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.448+0000 7f82e5800700 1 -- 172.21.15.49:0/1122824979 wait complete. 2024-01-22T05:05:15.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.452+0000 7f82e5800700 1 Processor -- start 2024-01-22T05:05:15.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.452+0000 7f82e5800700 1 -- start start 2024-01-22T05:05:15.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.452+0000 7f82e5800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e0068f70 0x7f82e016b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.452+0000 7f82e5800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e00a5c30 0x7f82e0168bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.452+0000 7f82e5800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e00c53c0 0x7f82e00ac200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.452+0000 7f82e5800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e016c170 con 0x7f82e00c53c0 2024-01-22T05:05:15.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.452+0000 7f82e5800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e016c450 con 0x7f82e0068f70 2024-01-22T05:05:15.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.452+0000 7f82e5800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e016c730 con 0x7f82e00a5c30 2024-01-22T05:05:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.452+0000 7f82e4e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e00c53c0 0x7f82e00ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.452+0000 7f82e4e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e00c53c0 0x7f82e00ac200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57984/0 (socket says 172.21.15.49:57984) 2024-01-22T05:05:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.452+0000 7f82e4e00700 1 -- 172.21.15.49:0/3108379302 learned_addr learned my addr 172.21.15.49:0/3108379302 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.456+0000 7f82df400700 1 --2- 172.21.15.49:0/3108379302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e00a5c30 0x7f82e0168bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.456+0000 7f82dfe00700 1 --2- 172.21.15.49:0/3108379302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e0068f70 0x7f82e016b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.456+0000 7f82e4e00700 1 -- 172.21.15.49:0/3108379302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e00a5c30 msgr2=0x7f82e0168bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.456+0000 7f82e4e00700 1 --2- 172.21.15.49:0/3108379302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e00a5c30 0x7f82e0168bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.456+0000 7f82e4e00700 1 -- 172.21.15.49:0/3108379302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e0068f70 msgr2=0x7f82e016b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.456+0000 7f82e4e00700 1 --2- 172.21.15.49:0/3108379302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e0068f70 0x7f82e016b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.456+0000 7f82e4e00700 1 -- 172.21.15.49:0/3108379302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d8009a20 con 0x7f82e00c53c0 2024-01-22T05:05:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.456+0000 7f82df400700 1 --2- 172.21.15.49:0/3108379302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e00a5c30 0x7f82e0168bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.456+0000 7f82e4e00700 1 --2- 172.21.15.49:0/3108379302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e00c53c0 0x7f82e00ac200 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f82d800b6c0 tx=0x7f82d8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.456+0000 7f82d7400700 1 -- 172.21.15.49:0/3108379302 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d801c660 con 0x7f82e00c53c0 2024-01-22T05:05:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.456+0000 7f82d7400700 1 -- 172.21.15.49:0/3108379302 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d801c7c0 con 0x7f82e00c53c0 2024-01-22T05:05:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.456+0000 7f82e5800700 1 -- 172.21.15.49:0/3108379302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e01683c0 con 0x7f82e00c53c0 2024-01-22T05:05:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.456+0000 7f82d7400700 1 -- 172.21.15.49:0/3108379302 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d801cb80 con 0x7f82e00c53c0 2024-01-22T05:05:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.456+0000 7f82e5800700 1 -- 172.21.15.49:0/3108379302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e016be10 con 0x7f82e00c53c0 2024-01-22T05:05:15.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.460+0000 7f82e5800700 1 -- 172.21.15.49:0/3108379302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e0168840 con 0x7f82e00c53c0 2024-01-22T05:05:15.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.460+0000 7f82d7400700 1 -- 172.21.15.49:0/3108379302 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f82d8003040 con 0x7f82e00c53c0 2024-01-22T05:05:15.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.460+0000 7f82d7400700 1 --2- 172.21.15.49:0/3108379302 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82b805a510 0x7f82b805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.460+0000 7f82d7400700 1 -- 172.21.15.49:0/3108379302 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f82d8076b90 con 0x7f82e00c53c0 2024-01-22T05:05:15.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.460+0000 7f82dfe00700 1 --2- 172.21.15.49:0/3108379302 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82b805a510 0x7f82b805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.460+0000 7f82dfe00700 1 --2- 172.21.15.49:0/3108379302 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82b805a510 0x7f82b805c9d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f82d0001720 tx=0x7f82d0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:15.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.468+0000 7f82d7400700 1 -- 172.21.15.49:0/3108379302 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f82d8049fa0 con 0x7f82e00c53c0 2024-01-22T05:05:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.632+0000 7f82e5800700 1 -- 172.21.15.49:0/3108379302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f82e0046800 con 0x7f82e00c53c0 2024-01-22T05:05:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.632+0000 7f82d7400700 1 -- 172.21.15.49:0/3108379302 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f82d804d5c0 con 0x7f82e00c53c0 2024-01-22T05:05:15.636 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-22T05:05:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.636+0000 7f82e5800700 1 -- 172.21.15.49:0/3108379302 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82b805a510 msgr2=0x7f82b805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.636+0000 7f82e5800700 1 --2- 172.21.15.49:0/3108379302 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82b805a510 0x7f82b805c9d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f82d0001720 tx=0x7f82d0009040).stop 2024-01-22T05:05:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.636+0000 7f82e5800700 1 -- 172.21.15.49:0/3108379302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e00c53c0 msgr2=0x7f82e00ac200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.636+0000 7f82e5800700 1 --2- 172.21.15.49:0/3108379302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e00c53c0 0x7f82e00ac200 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f82d800b6c0 tx=0x7f82d8009780).stop 2024-01-22T05:05:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.636+0000 7f82e5800700 1 -- 172.21.15.49:0/3108379302 shutdown_connections 2024-01-22T05:05:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.636+0000 7f82e5800700 1 --2- 172.21.15.49:0/3108379302 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82b805a510 0x7f82b805c9d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.636+0000 7f82e5800700 1 --2- 172.21.15.49:0/3108379302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82e00c53c0 0x7f82e00ac200 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.636+0000 7f82e5800700 1 --2- 172.21.15.49:0/3108379302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82e00a5c30 0x7f82e0168bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.636+0000 7f82e5800700 1 --2- 172.21.15.49:0/3108379302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e0068f70 0x7f82e016b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.636+0000 7f82e5800700 1 -- 172.21.15.49:0/3108379302 >> 172.21.15.49:0/3108379302 conn(0x7f82e00c3ed0 msgr2=0x7f82e0062a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.636+0000 7f82e5800700 1 -- 172.21.15.49:0/3108379302 shutdown_connections 2024-01-22T05:05:15.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.636+0000 7f82e5800700 1 -- 172.21.15.49:0/3108379302 wait complete. 2024-01-22T05:05:15.665 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:05:15.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.824+0000 7f338fc00700 1 Processor -- start 2024-01-22T05:05:15.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.828+0000 7f338fc00700 1 -- start start 2024-01-22T05:05:15.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.828+0000 7f338fc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3388155d20 0x7f3388065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.828+0000 7f338fc00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33880c1a40 con 0x7f3388066070 2024-01-22T05:05:15.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.828+0000 7f338fc00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3388159310 con 0x7f33880a8e50 2024-01-22T05:05:15.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.828+0000 7f338fc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33880c13f0 con 0x7f3388155d20 2024-01-22T05:05:15.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.828+0000 7f3387e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3388066070 0x7f33880a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44722/0 (socket says 172.21.15.49:44722) 2024-01-22T05:05:15.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.828+0000 7f3387e00700 1 -- 172.21.15.49:0/2285708040 learned_addr learned my addr 172.21.15.49:0/2285708040 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:15.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.828+0000 7f338d200700 1 --2- 172.21.15.49:0/2285708040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3388155d20 0x7f3388065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.828+0000 7f3387400700 1 -- 172.21.15.49:0/2285708040 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121133898 0 0) 0x7f33880c1a40 con 0x7f3388066070 2024-01-22T05:05:15.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f3387400700 1 -- 172.21.15.49:0/2285708040 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33680033f0 con 0x7f3388066070 2024-01-22T05:05:15.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f3387400700 1 -- 172.21.15.49:0/2285708040 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857305723 0 0) 0x7f3388159310 con 0x7f33880a8e50 2024-01-22T05:05:15.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f3387400700 1 -- 172.21.15.49:0/2285708040 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33880c1a40 con 0x7f33880a8e50 2024-01-22T05:05:15.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f338d200700 1 -- 172.21.15.49:0/2285708040 >> v1:172.21.15.110:6789/0 conn(0x7f33880a8e50 legacy=0x7f33880c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f338d200700 1 -- 172.21.15.49:0/2285708040 >> v1:172.21.15.49:6789/0 conn(0x7f3388066070 legacy=0x7f33880a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f3387400700 1 -- 172.21.15.49:0/2285708040 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1638367063 0 0) 0x7f33680033f0 con 0x7f3388066070 2024-01-22T05:05:15.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f338d200700 1 -- 172.21.15.49:0/2285708040 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33880c16d0 con 0x7f3388155d20 2024-01-22T05:05:15.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f338d200700 1 --2- 172.21.15.49:0/2285708040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3388155d20 0x7f3388065b80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3378009790 tx=0x7f3378009060).ready entity=mon.2 client_cookie=9c53b1c6042c2121 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:15.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f3387400700 1 -- 172.21.15.49:0/2285708040 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3370001470 con 0x7f3388155d20 2024-01-22T05:05:15.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f3387400700 1 -- 172.21.15.49:0/2285708040 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378011400 con 0x7f3388155d20 2024-01-22T05:05:15.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f3387400700 1 -- 172.21.15.49:0/2285708040 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378011780 con 0x7f3388155d20 2024-01-22T05:05:15.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f338fc00700 1 -- 172.21.15.49:0/2285708040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3388155d20 msgr2=0x7f3388065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f338fc00700 1 --2- 172.21.15.49:0/2285708040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3388155d20 0x7f3388065b80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3378009790 tx=0x7f3378009060).stop 2024-01-22T05:05:15.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f338fc00700 1 -- 172.21.15.49:0/2285708040 shutdown_connections 2024-01-22T05:05:15.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f338fc00700 1 --2- 172.21.15.49:0/2285708040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3388155d20 0x7f3388065b80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f338fc00700 1 -- 172.21.15.49:0/2285708040 >> 172.21.15.49:0/2285708040 conn(0x7f33880c6540 msgr2=0x7f33880c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:15.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f338fc00700 1 -- 172.21.15.49:0/2285708040 shutdown_connections 2024-01-22T05:05:15.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.832+0000 7f338fc00700 1 -- 172.21.15.49:0/2285708040 wait complete. 2024-01-22T05:05:15.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.836+0000 7f338fc00700 1 Processor -- start 2024-01-22T05:05:15.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.836+0000 7f338fc00700 1 -- start start 2024-01-22T05:05:15.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338fc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3388066070 0x7f3388152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338fc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33880a8e50 0x7f33880ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338fc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3388155d20 0x7f33880c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338fc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338815a520 con 0x7f3388066070 2024-01-22T05:05:15.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338fc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33880a95b0 con 0x7f33880a8e50 2024-01-22T05:05:15.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338fc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3388159910 con 0x7f3388155d20 2024-01-22T05:05:15.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338d200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3388066070 0x7f3388152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338d200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3388066070 0x7f3388152a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58000/0 (socket says 172.21.15.49:58000) 2024-01-22T05:05:15.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338d200700 1 -- 172.21.15.49:0/3069835154 learned_addr learned my addr 172.21.15.49:0/3069835154 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:15.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f3387e00700 1 --2- 172.21.15.49:0/3069835154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33880a8e50 0x7f33880ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338dc00700 1 --2- 172.21.15.49:0/3069835154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3388155d20 0x7f33880c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338d200700 1 -- 172.21.15.49:0/3069835154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3388155d20 msgr2=0x7f33880c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338d200700 1 --2- 172.21.15.49:0/3069835154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3388155d20 0x7f33880c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338d200700 1 -- 172.21.15.49:0/3069835154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33880a8e50 msgr2=0x7f33880ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:15.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338d200700 1 --2- 172.21.15.49:0/3069835154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33880a8e50 0x7f33880ab700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:15.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338d200700 1 -- 172.21.15.49:0/3069835154 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33780092a0 con 0x7f3388066070 2024-01-22T05:05:15.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f3387e00700 1 --2- 172.21.15.49:0/3069835154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33880a8e50 0x7f33880ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:15.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338d200700 1 --2- 172.21.15.49:0/3069835154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3388066070 0x7f3388152a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f3378010000 tx=0x7f3378016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:15.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f337fe00700 1 -- 172.21.15.49:0/3069835154 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378010840 con 0x7f3388066070 2024-01-22T05:05:15.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f337fe00700 1 -- 172.21.15.49:0/3069835154 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33780109a0 con 0x7f3388066070 2024-01-22T05:05:15.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f338fc00700 1 -- 172.21.15.49:0/3069835154 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3388159bf0 con 0x7f3388066070 2024-01-22T05:05:15.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.840+0000 7f337fe00700 1 -- 172.21.15.49:0/3069835154 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378010d40 con 0x7f3388066070 2024-01-22T05:05:15.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.844+0000 7f338fc00700 1 -- 172.21.15.49:0/3069835154 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338815a1b0 con 0x7f3388066070 2024-01-22T05:05:15.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.844+0000 7f338fc00700 1 -- 172.21.15.49:0/3069835154 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33880be340 con 0x7f3388066070 2024-01-22T05:05:15.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.844+0000 7f337fe00700 1 -- 172.21.15.49:0/3069835154 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f337801d640 con 0x7f3388066070 2024-01-22T05:05:15.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.848+0000 7f337fe00700 1 --2- 172.21.15.49:0/3069835154 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f336005a510 0x7f336005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:15.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.848+0000 7f337fe00700 1 -- 172.21.15.49:0/3069835154 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f3378076030 con 0x7f3388066070 2024-01-22T05:05:15.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.848+0000 7f3387e00700 1 --2- 172.21.15.49:0/3069835154 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f336005a510 0x7f336005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:15.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.848+0000 7f3387e00700 1 --2- 172.21.15.49:0/3069835154 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f336005a510 0x7f336005c9d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f338815abc0 tx=0x7f3370009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:15.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:15.852+0000 7f337fe00700 1 -- 172.21.15.49:0/3069835154 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3378049500 con 0x7f3388066070 2024-01-22T05:05:16.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.020+0000 7f338fc00700 1 -- 172.21.15.49:0/3069835154 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3388047060 con 0x7f3388066070 2024-01-22T05:05:16.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.020+0000 7f337fe00700 1 -- 172.21.15.49:0/3069835154 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f337804cb20 con 0x7f3388066070 2024-01-22T05:05:16.025 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:16.025 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:39.526211+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:05:16.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.024+0000 7f338fc00700 1 -- 172.21.15.49:0/3069835154 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f336005a510 msgr2=0x7f336005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:16.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.024+0000 7f338fc00700 1 --2- 172.21.15.49:0/3069835154 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f336005a510 0x7f336005c9d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f338815abc0 tx=0x7f3370009040).stop 2024-01-22T05:05:16.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.024+0000 7f338fc00700 1 -- 172.21.15.49:0/3069835154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3388066070 msgr2=0x7f3388152a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:16.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.024+0000 7f338fc00700 1 --2- 172.21.15.49:0/3069835154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3388066070 0x7f3388152a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f3378010000 tx=0x7f3378016000).stop 2024-01-22T05:05:16.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.024+0000 7f338fc00700 1 -- 172.21.15.49:0/3069835154 shutdown_connections 2024-01-22T05:05:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.024+0000 7f338fc00700 1 --2- 172.21.15.49:0/3069835154 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f336005a510 0x7f336005c9d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.024+0000 7f338fc00700 1 --2- 172.21.15.49:0/3069835154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3388155d20 0x7f33880c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.024+0000 7f338fc00700 1 --2- 172.21.15.49:0/3069835154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33880a8e50 0x7f33880ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.024+0000 7f338fc00700 1 --2- 172.21.15.49:0/3069835154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3388066070 0x7f3388152a00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.024+0000 7f338fc00700 1 -- 172.21.15.49:0/3069835154 >> 172.21.15.49:0/3069835154 conn(0x7f33880c6540 msgr2=0x7f33881542c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.024+0000 7f338fc00700 1 -- 172.21.15.49:0/3069835154 shutdown_connections 2024-01-22T05:05:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.028+0000 7f338fc00700 1 -- 172.21.15.49:0/3069835154 wait complete. 2024-01-22T05:05:16.053 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:04:32.991898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:04:34.057128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-22T05:04:37.108860+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:05:16.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:05:16.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.216+0000 7f24bfe00700 1 Processor -- start 2024-01-22T05:05:16.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.216+0000 7f24bfe00700 1 -- start start 2024-01-22T05:05:16.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.220+0000 7f24bfe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f24c00691b0 0x7f24c00a7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:16.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.220+0000 7f24bfe00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c00a8cc0 con 0x7f24c00a7730 2024-01-22T05:05:16.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.220+0000 7f24bfe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c00bd900 con 0x7f24c0151c60 2024-01-22T05:05:16.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.220+0000 7f24bfe00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c00be480 con 0x7f24c00691b0 2024-01-22T05:05:16.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.220+0000 7f24be000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f24c00a7730 0x7f24c0068aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44736/0 (socket says 172.21.15.49:44736) 2024-01-22T05:05:16.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.220+0000 7f24be000700 1 -- 172.21.15.49:0/2376983297 learned_addr learned my addr 172.21.15.49:0/2376983297 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.220+0000 7f24bf400700 1 --2- 172.21.15.49:0/2376983297 >> v2:172.21.15.110:3300/0 conn(0x7f24c00691b0 0x7f24c00a7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269815193 0 0) 0x7f24a8001110 con 0x7f24c00a7730 2024-01-22T05:05:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a00033f0 con 0x7f24c00a7730 2024-01-22T05:05:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436955689 0 0) 0x7f24c00bd900 con 0x7f24c0151c60 2024-01-22T05:05:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a8001110 con 0x7f24c0151c60 2024-01-22T05:05:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2281600394 0 0) 0x7f24a00033f0 con 0x7f24c00a7730 2024-01-22T05:05:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 >> v2:172.21.15.110:3300/0 conn(0x7f24c00691b0 msgr2=0x7f24c00a7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 --2- 172.21.15.49:0/2376983297 >> v2:172.21.15.110:3300/0 conn(0x7f24c00691b0 0x7f24c00a7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 >> v1:172.21.15.110:6789/0 conn(0x7f24c0151c60 legacy=0x7f24c00a85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c00bdb50 con 0x7f24c00a7730 2024-01-22T05:05:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f24a8001600 con 0x7f24c00a7730 2024-01-22T05:05:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 >> v1:172.21.15.49:6789/0 conn(0x7f24c00a7730 legacy=0x7f24c0068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 --2- 172.21.15.49:0/2376983297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a0003a70 0x7f24a0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 --2- 172.21.15.49:0/2376983297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a0004690 0x7f24a0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 --2- 172.21.15.49:0/2376983297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24a0005000 0x7f24a000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00be480 con 0x7f24a0004690 2024-01-22T05:05:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a000be80 con 0x7f24a0003a70 2024-01-22T05:05:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a000c040 con 0x7f24a0005000 2024-01-22T05:05:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24be000700 1 --2- 172.21.15.49:0/2376983297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a0004690 0x7f24a0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bf400700 1 --2- 172.21.15.49:0/2376983297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24a0005000 0x7f24a000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:16.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bea00700 1 --2- 172.21.15.49:0/2376983297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a0003a70 0x7f24a0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24be000700 1 -- 172.21.15.49:0/2376983297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24a0005000 msgr2=0x7f24a000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24be000700 1 --2- 172.21.15.49:0/2376983297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24a0005000 0x7f24a000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24be000700 1 -- 172.21.15.49:0/2376983297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a0003a70 msgr2=0x7f24a0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24be000700 1 --2- 172.21.15.49:0/2376983297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a0003a70 0x7f24a0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24be000700 1 -- 172.21.15.49:0/2376983297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a00033f0 con 0x7f24a0004690 2024-01-22T05:05:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bf400700 1 -- 172.21.15.49:0/2376983297 reap_dead start 2024-01-22T05:05:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bea00700 1 --2- 172.21.15.49:0/2376983297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a0003a70 0x7f24a0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24be000700 1 --2- 172.21.15.49:0/2376983297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a0004690 0x7f24a0004b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f24a800c2a0 tx=0x7f24a8007880).ready entity=mon.0 client_cookie=bd1ad2d6e3a7c650 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a8007b70 con 0x7f24a0004690 2024-01-22T05:05:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a800cb90 con 0x7f24a0004690 2024-01-22T05:05:16.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.224+0000 7f24bd600700 1 -- 172.21.15.49:0/2376983297 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a80070d0 con 0x7f24a0004690 2024-01-22T05:05:16.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.228+0000 7f24bfe00700 1 -- 172.21.15.49:0/2376983297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a0004690 msgr2=0x7f24a0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:16.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.228+0000 7f24bfe00700 1 --2- 172.21.15.49:0/2376983297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a0004690 0x7f24a0004b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f24a800c2a0 tx=0x7f24a8007880).stop 2024-01-22T05:05:16.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.228+0000 7f24bfe00700 1 -- 172.21.15.49:0/2376983297 shutdown_connections 2024-01-22T05:05:16.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.228+0000 7f24bfe00700 1 --2- 172.21.15.49:0/2376983297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24a0004690 0x7f24a0004b10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.228+0000 7f24bfe00700 1 -- 172.21.15.49:0/2376983297 >> 172.21.15.49:0/2376983297 conn(0x7f24c00c8740 msgr2=0x7f24c00c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:16.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.228+0000 7f24bfe00700 1 -- 172.21.15.49:0/2376983297 shutdown_connections 2024-01-22T05:05:16.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.228+0000 7f24bfe00700 1 -- 172.21.15.49:0/2376983297 wait complete. 2024-01-22T05:05:16.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.228+0000 7f24bfe00700 1 Processor -- start 2024-01-22T05:05:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bfe00700 1 -- start start 2024-01-22T05:05:16.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a0004690 0x7f24c0162f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:16.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bfe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c00bf7e0 0x7f24c0135840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:16.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24c0162390 0x7f24c0162810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:16.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bfe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c014ebe0 con 0x7f24c0162390 2024-01-22T05:05:16.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bfe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00c1ba0 con 0x7f24a0004690 2024-01-22T05:05:16.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bfe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c0162d00 con 0x7f24c00bf7e0 2024-01-22T05:05:16.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24c0162390 0x7f24c0162810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:16.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24c0162390 0x7f24c0162810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58006/0 (socket says 172.21.15.49:58006) 2024-01-22T05:05:16.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bf400700 1 -- 172.21.15.49:0/3683109243 learned_addr learned my addr 172.21.15.49:0/3683109243 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bea00700 1 --2- 172.21.15.49:0/3683109243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a0004690 0x7f24c0162f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24be000700 1 --2- 172.21.15.49:0/3683109243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c00bf7e0 0x7f24c0135840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bf400700 1 -- 172.21.15.49:0/3683109243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c00bf7e0 msgr2=0x7f24c0135840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bf400700 1 --2- 172.21.15.49:0/3683109243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c00bf7e0 0x7f24c0135840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bf400700 1 -- 172.21.15.49:0/3683109243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a0004690 msgr2=0x7f24c0162f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bf400700 1 --2- 172.21.15.49:0/3683109243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a0004690 0x7f24c0162f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bf400700 1 -- 172.21.15.49:0/3683109243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c00bfc60 con 0x7f24c0162390 2024-01-22T05:05:16.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24bf400700 1 --2- 172.21.15.49:0/3683109243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24c0162390 0x7f24c0162810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f24b8009fd0 tx=0x7f24b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:16.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24b6000700 1 -- 172.21.15.49:0/3683109243 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b800e070 con 0x7f24c0162390 2024-01-22T05:05:16.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24b6000700 1 -- 172.21.15.49:0/3683109243 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b8011c00 con 0x7f24c0162390 2024-01-22T05:05:16.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.232+0000 7f24b6000700 1 -- 172.21.15.49:0/3683109243 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8016450 con 0x7f24c0162390 2024-01-22T05:05:16.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.236+0000 7f24bfe00700 1 -- 172.21.15.49:0/3683109243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c00c1df0 con 0x7f24c0162390 2024-01-22T05:05:16.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.236+0000 7f24bfe00700 1 -- 172.21.15.49:0/3683109243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c00c23b0 con 0x7f24c0162390 2024-01-22T05:05:16.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.236+0000 7f24bfe00700 1 -- 172.21.15.49:0/3683109243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c014ed50 con 0x7f24c0162390 2024-01-22T05:05:16.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.236+0000 7f24b6000700 1 -- 172.21.15.49:0/3683109243 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f24b8016840 con 0x7f24c0162390 2024-01-22T05:05:16.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.240+0000 7f24b6000700 1 --2- 172.21.15.49:0/3683109243 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249805a540 0x7f249805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:16.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.240+0000 7f24b6000700 1 -- 172.21.15.49:0/3683109243 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f24b8074f50 con 0x7f24c0162390 2024-01-22T05:05:16.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.240+0000 7f24bea00700 1 --2- 172.21.15.49:0/3683109243 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249805a540 0x7f249805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:16.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.240+0000 7f24bea00700 1 --2- 172.21.15.49:0/3683109243 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249805a540 0x7f249805ca00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f24b0007a40 tx=0x7f24b0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:16.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.244+0000 7f24b6000700 1 -- 172.21.15.49:0/3683109243 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f24c014ed50 con 0x7f24c0162390 2024-01-22T05:05:16.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.412+0000 7f24bfe00700 1 -- 172.21.15.49:0/3683109243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f24c0066520 con 0x7f24c0162390 2024-01-22T05:05:16.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.412+0000 7f24b6000700 1 -- 172.21.15.49:0/3683109243 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f24b8048410 con 0x7f24c0162390 2024-01-22T05:05:16.417 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:05:16.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.420+0000 7f24bfe00700 1 -- 172.21.15.49:0/3683109243 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249805a540 msgr2=0x7f249805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:16.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.420+0000 7f24bfe00700 1 --2- 172.21.15.49:0/3683109243 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249805a540 0x7f249805ca00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f24b0007a40 tx=0x7f24b0009040).stop 2024-01-22T05:05:16.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.420+0000 7f24bfe00700 1 -- 172.21.15.49:0/3683109243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24c0162390 msgr2=0x7f24c0162810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:16.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.420+0000 7f24bfe00700 1 --2- 172.21.15.49:0/3683109243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24c0162390 0x7f24c0162810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f24b8009fd0 tx=0x7f24b800b040).stop 2024-01-22T05:05:16.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.420+0000 7f24bfe00700 1 -- 172.21.15.49:0/3683109243 shutdown_connections 2024-01-22T05:05:16.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.420+0000 7f24bfe00700 1 --2- 172.21.15.49:0/3683109243 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249805a540 0x7f249805ca00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.420+0000 7f24bfe00700 1 --2- 172.21.15.49:0/3683109243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24c0162390 0x7f24c0162810 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.420+0000 7f24bfe00700 1 --2- 172.21.15.49:0/3683109243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c00bf7e0 0x7f24c0135840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.420+0000 7f24bfe00700 1 --2- 172.21.15.49:0/3683109243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a0004690 0x7f24c0162f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.420+0000 7f24bfe00700 1 -- 172.21.15.49:0/3683109243 >> 172.21.15.49:0/3683109243 conn(0x7f24c00c8740 msgr2=0x7f24c00c65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:16.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.420+0000 7f24bfe00700 1 -- 172.21.15.49:0/3683109243 shutdown_connections 2024-01-22T05:05:16.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.420+0000 7f24bfe00700 1 -- 172.21.15.49:0/3683109243 wait complete. 2024-01-22T05:05:16.449 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:05:16.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.616+0000 7fe055600700 1 Processor -- start 2024-01-22T05:05:16.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.616+0000 7fe055600700 1 -- start start 2024-01-22T05:05:16.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe055600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe050153c20 0x7fe050067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:16.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe055600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe050154000 0x7fe050067f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:16.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe055600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0500ad5a0 con 0x7fe0500c0940 2024-01-22T05:05:16.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe055600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe050068470 con 0x7fe050153c20 2024-01-22T05:05:16.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe055600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0500c04b0 con 0x7fe050154000 2024-01-22T05:05:16.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe054c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe0500c0940 0x7fe0500c0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44748/0 (socket says 172.21.15.49:44748) 2024-01-22T05:05:16.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe054c00700 1 -- 172.21.15.49:0/4188142816 learned_addr learned my addr 172.21.15.49:0/4188142816 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:16.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe04fe00700 1 --2- 172.21.15.49:0/4188142816 >> v2:172.21.15.49:3300/0 conn(0x7fe050153c20 0x7fe050067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:16.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe04f400700 1 --2- 172.21.15.49:0/4188142816 >> v2:172.21.15.110:3300/0 conn(0x7fe050154000 0x7fe050067f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:16.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe04ea00700 1 -- 172.21.15.49:0/4188142816 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354420689 0 0) 0x7fe048001490 con 0x7fe0500c0940 2024-01-22T05:05:16.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe04ea00700 1 -- 172.21.15.49:0/4188142816 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0300033f0 con 0x7fe0500c0940 2024-01-22T05:05:16.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe04fe00700 1 -- 172.21.15.49:0/4188142816 >> v2:172.21.15.110:3300/0 conn(0x7fe050154000 msgr2=0x7fe050067f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:16.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe04fe00700 1 --2- 172.21.15.49:0/4188142816 >> v2:172.21.15.110:3300/0 conn(0x7fe050154000 0x7fe050067f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe04fe00700 1 -- 172.21.15.49:0/4188142816 >> v1:172.21.15.49:6789/0 conn(0x7fe0500c0940 legacy=0x7fe0500c0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:16.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe04fe00700 1 -- 172.21.15.49:0/4188142816 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0500c5ef0 con 0x7fe050153c20 2024-01-22T05:05:16.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.620+0000 7fe04fe00700 1 --2- 172.21.15.49:0/4188142816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe050153c20 0x7fe050067a90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fe0500ade40 tx=0x7fe040009060).ready entity=mon.0 client_cookie=852754239d6ed0e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:16.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.624+0000 7fe04ea00700 1 -- 172.21.15.49:0/4188142816 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04000d4a0 con 0x7fe050153c20 2024-01-22T05:05:16.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.624+0000 7fe04ea00700 1 -- 172.21.15.49:0/4188142816 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04000d600 con 0x7fe050153c20 2024-01-22T05:05:16.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.624+0000 7fe04ea00700 1 -- 172.21.15.49:0/4188142816 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04000d980 con 0x7fe050153c20 2024-01-22T05:05:16.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.624+0000 7fe055600700 1 -- 172.21.15.49:0/4188142816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe050153c20 msgr2=0x7fe050067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:16.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.624+0000 7fe055600700 1 --2- 172.21.15.49:0/4188142816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe050153c20 0x7fe050067a90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fe0500ade40 tx=0x7fe040009060).stop 2024-01-22T05:05:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.624+0000 7fe055600700 1 -- 172.21.15.49:0/4188142816 shutdown_connections 2024-01-22T05:05:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.624+0000 7fe055600700 1 --2- 172.21.15.49:0/4188142816 >> v2:172.21.15.110:3300/0 conn(0x7fe050154000 0x7fe050067f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.624+0000 7fe055600700 1 --2- 172.21.15.49:0/4188142816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe050153c20 0x7fe050067a90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.624+0000 7fe055600700 1 -- 172.21.15.49:0/4188142816 >> 172.21.15.49:0/4188142816 conn(0x7fe0500cb3d0 msgr2=0x7fe0500c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:16.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.624+0000 7fe055600700 1 -- 172.21.15.49:0/4188142816 shutdown_connections 2024-01-22T05:05:16.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.624+0000 7fe055600700 1 -- 172.21.15.49:0/4188142816 wait complete. 2024-01-22T05:05:16.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.624+0000 7fe055600700 1 Processor -- start 2024-01-22T05:05:16.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe055600700 1 -- start start 2024-01-22T05:05:16.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe055600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0500c0940 0x7fe0500c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:16.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe055600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe050153c20 0x7fe050147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:16.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe055600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe050154000 0x7fe0501565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:16.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe055600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0500c1ed0 con 0x7fe0500c0940 2024-01-22T05:05:16.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe055600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0501527a0 con 0x7fe050154000 2024-01-22T05:05:16.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe055600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0500c20c0 con 0x7fe050153c20 2024-01-22T05:05:16.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe04fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0500c0940 0x7fe0500c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:16.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe04fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0500c0940 0x7fe0500c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58022/0 (socket says 172.21.15.49:58022) 2024-01-22T05:05:16.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe04fe00700 1 -- 172.21.15.49:0/3850027175 learned_addr learned my addr 172.21.15.49:0/3850027175 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:16.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe054c00700 1 --2- 172.21.15.49:0/3850027175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe050154000 0x7fe0501565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:16.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe04f400700 1 --2- 172.21.15.49:0/3850027175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe050153c20 0x7fe050147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:16.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe04fe00700 1 -- 172.21.15.49:0/3850027175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe050153c20 msgr2=0x7fe050147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:16.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe04fe00700 1 --2- 172.21.15.49:0/3850027175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe050153c20 0x7fe050147d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe04fe00700 1 -- 172.21.15.49:0/3850027175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe050154000 msgr2=0x7fe0501565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:16.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe04fe00700 1 --2- 172.21.15.49:0/3850027175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe050154000 0x7fe0501565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe04fe00700 1 -- 172.21.15.49:0/3850027175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0400092a0 con 0x7fe0500c0940 2024-01-22T05:05:16.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.628+0000 7fe04fe00700 1 --2- 172.21.15.49:0/3850027175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0500c0940 0x7fe0500c19e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fe050064ae0 tx=0x7fe040016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:16.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.632+0000 7fe047400700 1 -- 172.21.15.49:0/3850027175 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04000dd30 con 0x7fe0500c0940 2024-01-22T05:05:16.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.632+0000 7fe047400700 1 -- 172.21.15.49:0/3850027175 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04000de90 con 0x7fe0500c0940 2024-01-22T05:05:16.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.632+0000 7fe055600700 1 -- 172.21.15.49:0/3850027175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0500c23a0 con 0x7fe0500c0940 2024-01-22T05:05:16.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.632+0000 7fe047400700 1 -- 172.21.15.49:0/3850027175 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04000d9c0 con 0x7fe0500c0940 2024-01-22T05:05:16.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.632+0000 7fe055600700 1 -- 172.21.15.49:0/3850027175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0500c2960 con 0x7fe0500c0940 2024-01-22T05:05:16.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.632+0000 7fe055600700 1 -- 172.21.15.49:0/3850027175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0500ace20 con 0x7fe0500c0940 2024-01-22T05:05:16.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.632+0000 7fe047400700 1 -- 172.21.15.49:0/3850027175 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe0400263b0 con 0x7fe0500c0940 2024-01-22T05:05:16.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.636+0000 7fe047400700 1 --2- 172.21.15.49:0/3850027175 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe02805a510 0x7fe02805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:16.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.636+0000 7fe047400700 1 -- 172.21.15.49:0/3850027175 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fe0400759d0 con 0x7fe0500c0940 2024-01-22T05:05:16.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.636+0000 7fe04f400700 1 --2- 172.21.15.49:0/3850027175 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe02805a510 0x7fe02805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:16.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.636+0000 7fe04f400700 1 --2- 172.21.15.49:0/3850027175 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe02805a510 0x7fe02805c9d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe050152bc0 tx=0x7fe038008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:16.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.640+0000 7fe047400700 1 -- 172.21.15.49:0/3850027175 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe040048e40 con 0x7fe0500c0940 2024-01-22T05:05:16.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.808+0000 7fe055600700 1 -- 172.21.15.49:0/3850027175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe050047060 con 0x7fe0500c0940 2024-01-22T05:05:16.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.808+0000 7fe047400700 1 -- 172.21.15.49:0/3850027175 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe040022070 con 0x7fe0500c0940 2024-01-22T05:05:16.814 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:05:16.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.812+0000 7fe055600700 1 -- 172.21.15.49:0/3850027175 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe02805a510 msgr2=0x7fe02805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:16.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.812+0000 7fe055600700 1 --2- 172.21.15.49:0/3850027175 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe02805a510 0x7fe02805c9d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe050152bc0 tx=0x7fe038008040).stop 2024-01-22T05:05:16.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.812+0000 7fe055600700 1 -- 172.21.15.49:0/3850027175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0500c0940 msgr2=0x7fe0500c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:16.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.812+0000 7fe055600700 1 --2- 172.21.15.49:0/3850027175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0500c0940 0x7fe0500c19e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fe050064ae0 tx=0x7fe040016000).stop 2024-01-22T05:05:16.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.812+0000 7fe055600700 1 -- 172.21.15.49:0/3850027175 shutdown_connections 2024-01-22T05:05:16.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.812+0000 7fe055600700 1 --2- 172.21.15.49:0/3850027175 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe02805a510 0x7fe02805c9d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.812+0000 7fe055600700 1 --2- 172.21.15.49:0/3850027175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe050154000 0x7fe0501565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.812+0000 7fe055600700 1 --2- 172.21.15.49:0/3850027175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe050153c20 0x7fe050147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.812+0000 7fe055600700 1 --2- 172.21.15.49:0/3850027175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0500c0940 0x7fe0500c19e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:16.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.812+0000 7fe055600700 1 -- 172.21.15.49:0/3850027175 >> 172.21.15.49:0/3850027175 conn(0x7fe0500cb3d0 msgr2=0x7fe050067d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:16.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.812+0000 7fe055600700 1 -- 172.21.15.49:0/3850027175 shutdown_connections 2024-01-22T05:05:16.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.812+0000 7fe055600700 1 -- 172.21.15.49:0/3850027175 wait complete. 2024-01-22T05:05:16.838 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:05:16.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.996+0000 7f6137400700 1 Processor -- start 2024-01-22T05:05:16.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:16.996+0000 7f6137400700 1 -- start start 2024-01-22T05:05:17.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f6137400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6130068ba0 0x7f6130063540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f6137400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61300c29d0 0x7f61300c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f6137400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6130069310 con 0x7f61301545a0 2024-01-22T05:05:17.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f6137400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6130151f30 con 0x7f6130068ba0 2024-01-22T05:05:17.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f6137400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6130151170 con 0x7f61300c29d0 2024-01-22T05:05:17.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f612fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61300c29d0 0x7f61300c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f612fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61300c29d0 0x7f61300c2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:45750/0 (socket says 172.21.15.49:45750) 2024-01-22T05:05:17.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f612fe00700 1 -- 172.21.15.49:0/4044936082 learned_addr learned my addr 172.21.15.49:0/4044936082 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:17.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f6135400700 1 --1- 172.21.15.49:0/4044936082 >> v1:172.21.15.110:6789/0 conn(0x7f61301545a0 0x7f61301549f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:47746/0 (socket says 172.21.15.49:47746) 2024-01-22T05:05:17.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f6134a00700 1 --2- 172.21.15.49:0/4044936082 >> v2:172.21.15.110:3300/0 conn(0x7f6130068ba0 0x7f6130063540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f612f400700 1 -- 172.21.15.49:0/4044936082 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551159215 0 0) 0x7f6130069310 con 0x7f61301545a0 2024-01-22T05:05:17.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f612f400700 1 -- 172.21.15.49:0/4044936082 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61100033f0 con 0x7f61301545a0 2024-01-22T05:05:17.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f612fe00700 1 -- 172.21.15.49:0/4044936082 >> v2:172.21.15.110:3300/0 conn(0x7f6130068ba0 msgr2=0x7f6130063540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:17.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f612fe00700 1 --2- 172.21.15.49:0/4044936082 >> v2:172.21.15.110:3300/0 conn(0x7f6130068ba0 0x7f6130063540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f612fe00700 1 -- 172.21.15.49:0/4044936082 >> v1:172.21.15.110:6789/0 conn(0x7f61301545a0 legacy=0x7f61301549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f612fe00700 1 -- 172.21.15.49:0/4044936082 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6130151450 con 0x7f61300c29d0 2024-01-22T05:05:17.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f6134a00700 1 --2- 172.21.15.49:0/4044936082 >> v2:172.21.15.110:3300/0 conn(0x7f6130068ba0 0x7f6130063540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:17.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.000+0000 7f612fe00700 1 --2- 172.21.15.49:0/4044936082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61300c29d0 0x7f61300c2e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6118006fd0 tx=0x7f61180090f0).ready entity=mon.2 client_cookie=821c977e3dcb956d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:17.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.004+0000 7f612f400700 1 -- 172.21.15.49:0/4044936082 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611800f510 con 0x7f61300c29d0 2024-01-22T05:05:17.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.004+0000 7f612f400700 1 -- 172.21.15.49:0/4044936082 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611800f670 con 0x7f61300c29d0 2024-01-22T05:05:17.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.004+0000 7f612f400700 1 -- 172.21.15.49:0/4044936082 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611800f9f0 con 0x7f61300c29d0 2024-01-22T05:05:17.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.004+0000 7f6137400700 1 -- 172.21.15.49:0/4044936082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61300c29d0 msgr2=0x7f61300c2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.004+0000 7f6137400700 1 --2- 172.21.15.49:0/4044936082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61300c29d0 0x7f61300c2e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6118006fd0 tx=0x7f61180090f0).stop 2024-01-22T05:05:17.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.004+0000 7f6137400700 1 -- 172.21.15.49:0/4044936082 shutdown_connections 2024-01-22T05:05:17.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.004+0000 7f6137400700 1 --2- 172.21.15.49:0/4044936082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61300c29d0 0x7f61300c2e10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.004+0000 7f6137400700 1 --2- 172.21.15.49:0/4044936082 >> v2:172.21.15.110:3300/0 conn(0x7f6130068ba0 0x7f6130063540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.004+0000 7f6137400700 1 -- 172.21.15.49:0/4044936082 >> 172.21.15.49:0/4044936082 conn(0x7f61300c3900 msgr2=0x7f61300c3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:17.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.004+0000 7f6137400700 1 -- 172.21.15.49:0/4044936082 shutdown_connections 2024-01-22T05:05:17.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.004+0000 7f6137400700 1 -- 172.21.15.49:0/4044936082 wait complete. 2024-01-22T05:05:17.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.008+0000 7f6137400700 1 Processor -- start 2024-01-22T05:05:17.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.008+0000 7f6137400700 1 -- start start 2024-01-22T05:05:17.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.008+0000 7f6137400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6130068ba0 0x7f613014b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.008+0000 7f6137400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61300c29d0 0x7f61300abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.008+0000 7f6137400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61301545a0 0x7f61300ac430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.008+0000 7f6137400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61300bfd60 con 0x7f61301545a0 2024-01-22T05:05:17.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.008+0000 7f6137400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61300bee70 con 0x7f6130068ba0 2024-01-22T05:05:17.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.008+0000 7f6137400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61300bf150 con 0x7f61300c29d0 2024-01-22T05:05:17.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.008+0000 7f6135400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61301545a0 0x7f61300ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.008+0000 7f6135400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61301545a0 0x7f61300ac430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58028/0 (socket says 172.21.15.49:58028) 2024-01-22T05:05:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.008+0000 7f6135400700 1 -- 172.21.15.49:0/351855557 learned_addr learned my addr 172.21.15.49:0/351855557 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.008+0000 7f612fe00700 1 --2- 172.21.15.49:0/351855557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61300c29d0 0x7f61300abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.012+0000 7f6134a00700 1 --2- 172.21.15.49:0/351855557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6130068ba0 0x7f613014b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.012+0000 7f6135400700 1 -- 172.21.15.49:0/351855557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61300c29d0 msgr2=0x7f61300abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.012+0000 7f6135400700 1 --2- 172.21.15.49:0/351855557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61300c29d0 0x7f61300abf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.012+0000 7f6135400700 1 -- 172.21.15.49:0/351855557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6130068ba0 msgr2=0x7f613014b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.012+0000 7f6135400700 1 --2- 172.21.15.49:0/351855557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6130068ba0 0x7f613014b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.012+0000 7f6135400700 1 -- 172.21.15.49:0/351855557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61200092a0 con 0x7f61301545a0 2024-01-22T05:05:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.012+0000 7f6135400700 1 --2- 172.21.15.49:0/351855557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61301545a0 0x7f61300ac430 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f612800c740 tx=0x7f6128007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.012+0000 7f6127e00700 1 -- 172.21.15.49:0/351855557 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128005c70 con 0x7f61301545a0 2024-01-22T05:05:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.012+0000 7f6127e00700 1 -- 172.21.15.49:0/351855557 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6128005dd0 con 0x7f61301545a0 2024-01-22T05:05:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.012+0000 7f6127e00700 1 -- 172.21.15.49:0/351855557 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61280072e0 con 0x7f61301545a0 2024-01-22T05:05:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.012+0000 7f6137400700 1 -- 172.21.15.49:0/351855557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6118009370 con 0x7f61301545a0 2024-01-22T05:05:17.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.012+0000 7f6137400700 1 -- 172.21.15.49:0/351855557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61300bf710 con 0x7f61301545a0 2024-01-22T05:05:17.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.012+0000 7f6137400700 1 -- 172.21.15.49:0/351855557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61300bfed0 con 0x7f61301545a0 2024-01-22T05:05:17.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.016+0000 7f6127e00700 1 -- 172.21.15.49:0/351855557 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6128007710 con 0x7f61301545a0 2024-01-22T05:05:17.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.016+0000 7f6127e00700 1 --2- 172.21.15.49:0/351855557 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f610805a540 0x7f610805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.016+0000 7f6127e00700 1 -- 172.21.15.49:0/351855557 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f61280744f0 con 0x7f61301545a0 2024-01-22T05:05:17.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.016+0000 7f6134a00700 1 --2- 172.21.15.49:0/351855557 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f610805a540 0x7f610805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.016+0000 7f6134a00700 1 --2- 172.21.15.49:0/351855557 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f610805a540 0x7f610805ca00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f6120009270 tx=0x7f6120008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:17.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.024+0000 7f6127e00700 1 -- 172.21.15.49:0/351855557 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6128047900 con 0x7f61301545a0 2024-01-22T05:05:17.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.184+0000 7f6137400700 1 -- 172.21.15.49:0/351855557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6130046800 con 0x7f61301545a0 2024-01-22T05:05:17.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.184+0000 7f6127e00700 1 -- 172.21.15.49:0/351855557 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f612804af20 con 0x7f61301545a0 2024-01-22T05:05:17.189 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:05:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.188+0000 7f6137400700 1 -- 172.21.15.49:0/351855557 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f610805a540 msgr2=0x7f610805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.188+0000 7f6137400700 1 --2- 172.21.15.49:0/351855557 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f610805a540 0x7f610805ca00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f6120009270 tx=0x7f6120008040).stop 2024-01-22T05:05:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.188+0000 7f6137400700 1 -- 172.21.15.49:0/351855557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61301545a0 msgr2=0x7f61300ac430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.188+0000 7f6137400700 1 --2- 172.21.15.49:0/351855557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61301545a0 0x7f61300ac430 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f612800c740 tx=0x7f6128007f90).stop 2024-01-22T05:05:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.188+0000 7f6137400700 1 -- 172.21.15.49:0/351855557 shutdown_connections 2024-01-22T05:05:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.188+0000 7f6137400700 1 --2- 172.21.15.49:0/351855557 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f610805a540 0x7f610805ca00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.188+0000 7f6137400700 1 --2- 172.21.15.49:0/351855557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61301545a0 0x7f61300ac430 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.188+0000 7f6137400700 1 --2- 172.21.15.49:0/351855557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61300c29d0 0x7f61300abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.188+0000 7f6137400700 1 --2- 172.21.15.49:0/351855557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6130068ba0 0x7f613014b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.188+0000 7f6137400700 1 -- 172.21.15.49:0/351855557 >> 172.21.15.49:0/351855557 conn(0x7f61300c3900 msgr2=0x7f61300c65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.188+0000 7f6137400700 1 -- 172.21.15.49:0/351855557 shutdown_connections 2024-01-22T05:05:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.188+0000 7f6137400700 1 -- 172.21.15.49:0/351855557 wait complete. 2024-01-22T05:05:17.215 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:05:17.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.384+0000 7f8049200700 1 Processor -- start 2024-01-22T05:05:17.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.384+0000 7f8049200700 1 -- start start 2024-01-22T05:05:17.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.388+0000 7f8049200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8044157ee0 0x7f8044065590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.388+0000 7f8049200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8044068af0 0x7f8044065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.388+0000 7f8049200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8044068280 con 0x7f8044068710 2024-01-22T05:05:17.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.388+0000 7f8049200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8044069600 con 0x7f8044068af0 2024-01-22T05:05:17.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.388+0000 7f8049200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80440c1cc0 con 0x7f8044157ee0 2024-01-22T05:05:17.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.388+0000 7f8043e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8044068af0 0x7f8044065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.388+0000 7f8043e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8044068af0 0x7f8044065a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58038/0 (socket says 172.21.15.49:58038) 2024-01-22T05:05:17.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.388+0000 7f8043e00700 1 -- 172.21.15.49:0/4069135325 learned_addr learned my addr 172.21.15.49:0/4069135325 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:17.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.388+0000 7f8042a00700 1 --2- 172.21.15.49:0/4069135325 >> v2:172.21.15.110:3300/0 conn(0x7f8044157ee0 0x7f8044065590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.388+0000 7f8043e00700 1 -- 172.21.15.49:0/4069135325 >> v2:172.21.15.110:3300/0 conn(0x7f8044157ee0 msgr2=0x7f8044065590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:17.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.388+0000 7f8043e00700 1 --2- 172.21.15.49:0/4069135325 >> v2:172.21.15.110:3300/0 conn(0x7f8044157ee0 0x7f8044065590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.388+0000 7f8043e00700 1 -- 172.21.15.49:0/4069135325 >> v1:172.21.15.110:6789/0 conn(0x7f8044068710 legacy=0x7f80441577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.388+0000 7f8043e00700 1 -- 172.21.15.49:0/4069135325 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8044067c30 con 0x7f8044068af0 2024-01-22T05:05:17.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.392+0000 7f8043e00700 1 --2- 172.21.15.49:0/4069135325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8044068af0 0x7f8044065a80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f80440c2fa0 tx=0x7f803c009840).ready entity=mon.0 client_cookie=30400ce3391c9768 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:17.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.392+0000 7f8042000700 1 -- 172.21.15.49:0/4069135325 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00e070 con 0x7f8044068af0 2024-01-22T05:05:17.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.392+0000 7f8042000700 1 -- 172.21.15.49:0/4069135325 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c00ba20 con 0x7f8044068af0 2024-01-22T05:05:17.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.392+0000 7f8042000700 1 -- 172.21.15.49:0/4069135325 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00bda0 con 0x7f8044068af0 2024-01-22T05:05:17.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.392+0000 7f8049200700 1 -- 172.21.15.49:0/4069135325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8044068af0 msgr2=0x7f8044065a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.392+0000 7f8049200700 1 --2- 172.21.15.49:0/4069135325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8044068af0 0x7f8044065a80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f80440c2fa0 tx=0x7f803c009840).stop 2024-01-22T05:05:17.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.392+0000 7f8049200700 1 -- 172.21.15.49:0/4069135325 shutdown_connections 2024-01-22T05:05:17.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.392+0000 7f8049200700 1 --2- 172.21.15.49:0/4069135325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8044068af0 0x7f8044065a80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.392+0000 7f8049200700 1 --2- 172.21.15.49:0/4069135325 >> v2:172.21.15.110:3300/0 conn(0x7f8044157ee0 0x7f8044065590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.392+0000 7f8049200700 1 -- 172.21.15.49:0/4069135325 >> 172.21.15.49:0/4069135325 conn(0x7f80440c6fc0 msgr2=0x7f80440c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:17.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.392+0000 7f8049200700 1 -- 172.21.15.49:0/4069135325 shutdown_connections 2024-01-22T05:05:17.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.392+0000 7f8049200700 1 -- 172.21.15.49:0/4069135325 wait complete. 2024-01-22T05:05:17.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.396+0000 7f8049200700 1 Processor -- start 2024-01-22T05:05:17.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.396+0000 7f8049200700 1 -- start start 2024-01-22T05:05:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.396+0000 7f8049200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8044068710 0x7f8044159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.396+0000 7f8049200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8044068af0 0x7f804414ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.396+0000 7f8049200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8044157ee0 0x7f804414da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.396+0000 7f8049200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8044152b30 con 0x7f8044068710 2024-01-22T05:05:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.396+0000 7f8049200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804415a320 con 0x7f8044068af0 2024-01-22T05:05:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.396+0000 7f8049200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804414cf80 con 0x7f8044157ee0 2024-01-22T05:05:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.396+0000 7f8043400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8044068710 0x7f8044159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.396+0000 7f8043400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8044068710 0x7f8044159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58044/0 (socket says 172.21.15.49:58044) 2024-01-22T05:05:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.396+0000 7f8043400700 1 -- 172.21.15.49:0/4273831119 learned_addr learned my addr 172.21.15.49:0/4273831119 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.396+0000 7f8042a00700 1 --2- 172.21.15.49:0/4273831119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8044068af0 0x7f804414ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.396+0000 7f8043e00700 1 --2- 172.21.15.49:0/4273831119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8044157ee0 0x7f804414da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.400+0000 7f8043400700 1 -- 172.21.15.49:0/4273831119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8044157ee0 msgr2=0x7f804414da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.400+0000 7f8043400700 1 --2- 172.21.15.49:0/4273831119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8044157ee0 0x7f804414da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.400+0000 7f8043400700 1 -- 172.21.15.49:0/4273831119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8044068af0 msgr2=0x7f804414ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.400+0000 7f8043400700 1 --2- 172.21.15.49:0/4273831119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8044068af0 0x7f804414ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.400+0000 7f8043400700 1 -- 172.21.15.49:0/4273831119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c009ae0 con 0x7f8044068710 2024-01-22T05:05:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.400+0000 7f8042a00700 1 --2- 172.21.15.49:0/4273831119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8044068af0 0x7f804414ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.400+0000 7f8043400700 1 --2- 172.21.15.49:0/4273831119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8044068710 0x7f8044159d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f803400c440 tx=0x7f8034007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.400+0000 7f803aa00700 1 -- 172.21.15.49:0/4273831119 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340123f0 con 0x7f8044068710 2024-01-22T05:05:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.400+0000 7f803aa00700 1 -- 172.21.15.49:0/4273831119 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8034012550 con 0x7f8044068710 2024-01-22T05:05:17.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.400+0000 7f8049200700 1 -- 172.21.15.49:0/4273831119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8044152570 con 0x7f8044068710 2024-01-22T05:05:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.400+0000 7f803aa00700 1 -- 172.21.15.49:0/4273831119 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340128f0 con 0x7f8044068710 2024-01-22T05:05:17.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.400+0000 7f8049200700 1 -- 172.21.15.49:0/4273831119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8044152ef0 con 0x7f8044068710 2024-01-22T05:05:17.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.400+0000 7f8049200700 1 -- 172.21.15.49:0/4273831119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8044152d50 con 0x7f8044068710 2024-01-22T05:05:17.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.404+0000 7f803aa00700 1 -- 172.21.15.49:0/4273831119 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8034012ca0 con 0x7f8044068710 2024-01-22T05:05:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.404+0000 7f803aa00700 1 --2- 172.21.15.49:0/4273831119 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f801c05a510 0x7f801c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.404+0000 7f803aa00700 1 -- 172.21.15.49:0/4273831119 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f8034073f90 con 0x7f8044068710 2024-01-22T05:05:17.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.404+0000 7f8042a00700 1 --2- 172.21.15.49:0/4273831119 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f801c05a510 0x7f801c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.404+0000 7f8042a00700 1 --2- 172.21.15.49:0/4273831119 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f801c05a510 0x7f801c05c9d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8044154180 tx=0x7f802c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:17.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.412+0000 7f803aa00700 1 -- 172.21.15.49:0/4273831119 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8044152d50 con 0x7f8044068710 2024-01-22T05:05:17.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.576+0000 7f8049200700 1 -- 172.21.15.49:0/4273831119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8044158710 con 0x7f8044068710 2024-01-22T05:05:17.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.576+0000 7f803aa00700 1 -- 172.21.15.49:0/4273831119 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8044158710 con 0x7f8044068710 2024-01-22T05:05:17.579 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:05:17.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.580+0000 7f8049200700 1 -- 172.21.15.49:0/4273831119 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f801c05a510 msgr2=0x7f801c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.580+0000 7f8049200700 1 --2- 172.21.15.49:0/4273831119 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f801c05a510 0x7f801c05c9d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8044154180 tx=0x7f802c009060).stop 2024-01-22T05:05:17.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.580+0000 7f8049200700 1 -- 172.21.15.49:0/4273831119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8044068710 msgr2=0x7f8044159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.580+0000 7f8049200700 1 --2- 172.21.15.49:0/4273831119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8044068710 0x7f8044159d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f803400c440 tx=0x7f8034007e00).stop 2024-01-22T05:05:17.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.580+0000 7f8049200700 1 -- 172.21.15.49:0/4273831119 shutdown_connections 2024-01-22T05:05:17.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.580+0000 7f8049200700 1 --2- 172.21.15.49:0/4273831119 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f801c05a510 0x7f801c05c9d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.580+0000 7f8049200700 1 --2- 172.21.15.49:0/4273831119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8044157ee0 0x7f804414da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.580+0000 7f8049200700 1 --2- 172.21.15.49:0/4273831119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8044068af0 0x7f804414ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.580+0000 7f8049200700 1 --2- 172.21.15.49:0/4273831119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8044068710 0x7f8044159d90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.580+0000 7f8049200700 1 -- 172.21.15.49:0/4273831119 >> 172.21.15.49:0/4273831119 conn(0x7f80440c6fc0 msgr2=0x7f80440c46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:17.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.580+0000 7f8049200700 1 -- 172.21.15.49:0/4273831119 shutdown_connections 2024-01-22T05:05:17.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.580+0000 7f8049200700 1 -- 172.21.15.49:0/4273831119 wait complete. 2024-01-22T05:05:17.609 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-22T05:05:17.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.780+0000 7f9fe5e00700 1 Processor -- start 2024-01-22T05:05:17.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.780+0000 7f9fe5e00700 1 -- start start 2024-01-22T05:05:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.780+0000 7f9fe5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00645d0 0x7f9fe00be160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.780+0000 7f9fe5e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe0154440 con 0x7f9fe00a6d90 2024-01-22T05:05:17.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.780+0000 7f9fe5e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe00bcd30 con 0x7f9fe00bdd00 2024-01-22T05:05:17.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.780+0000 7f9fe5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00c3680 con 0x7f9fe00645d0 2024-01-22T05:05:17.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fdea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9fe00a6d90 0x7f9fe00bc620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44752/0 (socket says 172.21.15.49:44752) 2024-01-22T05:05:17.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fdea00700 1 -- 172.21.15.49:0/1986896019 learned_addr learned my addr 172.21.15.49:0/1986896019 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:17.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fdf400700 1 --2- 172.21.15.49:0/1986896019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00645d0 0x7f9fe00be160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fdd600700 1 -- 172.21.15.49:0/1986896019 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197215382 0 0) 0x7f9fe0154440 con 0x7f9fe00a6d90 2024-01-22T05:05:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fdd600700 1 -- 172.21.15.49:0/1986896019 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fc00033f0 con 0x7f9fe00a6d90 2024-01-22T05:05:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fdd600700 1 -- 172.21.15.49:0/1986896019 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152060314 0 0) 0x7f9fe00bcd30 con 0x7f9fe00bdd00 2024-01-22T05:05:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fdd600700 1 -- 172.21.15.49:0/1986896019 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fe0154440 con 0x7f9fe00bdd00 2024-01-22T05:05:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fdd600700 1 -- 172.21.15.49:0/1986896019 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2397537340 0 0) 0x7f9fc00033f0 con 0x7f9fe00a6d90 2024-01-22T05:05:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fdf400700 1 -- 172.21.15.49:0/1986896019 >> v1:172.21.15.110:6789/0 conn(0x7f9fe00bdd00 legacy=0x7f9fe0063ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fdf400700 1 -- 172.21.15.49:0/1986896019 >> v1:172.21.15.49:6789/0 conn(0x7f9fe00a6d90 legacy=0x7f9fe00bc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fdf400700 1 -- 172.21.15.49:0/1986896019 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00c3960 con 0x7f9fe00645d0 2024-01-22T05:05:17.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fdf400700 1 --2- 172.21.15.49:0/1986896019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00645d0 0x7f9fe00be160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9fd8009e90 tx=0x7f9fd8009780).ready entity=mon.2 client_cookie=5b13045d0ebcc14 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:17.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fdd600700 1 -- 172.21.15.49:0/1986896019 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800e070 con 0x7f9fe00645d0 2024-01-22T05:05:17.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fdd600700 1 -- 172.21.15.49:0/1986896019 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd800b7a0 con 0x7f9fe00645d0 2024-01-22T05:05:17.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fdd600700 1 -- 172.21.15.49:0/1986896019 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0001470 con 0x7f9fe00645d0 2024-01-22T05:05:17.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fe5e00700 1 -- 172.21.15.49:0/1986896019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00645d0 msgr2=0x7f9fe00be160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.784+0000 7f9fe5e00700 1 --2- 172.21.15.49:0/1986896019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00645d0 0x7f9fe00be160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9fd8009e90 tx=0x7f9fd8009780).stop 2024-01-22T05:05:17.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.788+0000 7f9fe5e00700 1 -- 172.21.15.49:0/1986896019 shutdown_connections 2024-01-22T05:05:17.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.788+0000 7f9fe5e00700 1 --2- 172.21.15.49:0/1986896019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00645d0 0x7f9fe00be160 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.788+0000 7f9fe5e00700 1 -- 172.21.15.49:0/1986896019 >> 172.21.15.49:0/1986896019 conn(0x7f9fe00c8130 msgr2=0x7f9fe00c4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:17.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.788+0000 7f9fe5e00700 1 -- 172.21.15.49:0/1986896019 shutdown_connections 2024-01-22T05:05:17.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.788+0000 7f9fe5e00700 1 -- 172.21.15.49:0/1986896019 wait complete. 2024-01-22T05:05:17.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.788+0000 7f9fe5e00700 1 Processor -- start 2024-01-22T05:05:17.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.788+0000 7f9fe5e00700 1 -- start start 2024-01-22T05:05:17.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fe5e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fe00645d0 0x7f9fe00c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fe5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fe00a6d90 0x7f9fe00a8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fe5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00bdd00 0x7f9fe00628b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fe5e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00a7600 con 0x7f9fe00a6d90 2024-01-22T05:05:17.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fe5e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00a4a30 con 0x7f9fe00645d0 2024-01-22T05:05:17.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fe5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00a8a70 con 0x7f9fe00bdd00 2024-01-22T05:05:17.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fde000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fe00a6d90 0x7f9fe00a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fdea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fe00645d0 0x7f9fe00c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fdf400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00bdd00 0x7f9fe00628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fde000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fe00a6d90 0x7f9fe00a8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58050/0 (socket says 172.21.15.49:58050) 2024-01-22T05:05:17.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fde000700 1 -- 172.21.15.49:0/580774137 learned_addr learned my addr 172.21.15.49:0/580774137 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:17.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fdf400700 1 -- 172.21.15.49:0/580774137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fe00645d0 msgr2=0x7f9fe00c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fdf400700 1 --2- 172.21.15.49:0/580774137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fe00645d0 0x7f9fe00c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fdf400700 1 -- 172.21.15.49:0/580774137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fe00a6d90 msgr2=0x7f9fe00a8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fdf400700 1 --2- 172.21.15.49:0/580774137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fe00a6d90 0x7f9fe00a8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fdf400700 1 -- 172.21.15.49:0/580774137 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd8009a20 con 0x7f9fe00bdd00 2024-01-22T05:05:17.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fde000700 1 --2- 172.21.15.49:0/580774137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fe00a6d90 0x7f9fe00a8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:17.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fdf400700 1 --2- 172.21.15.49:0/580774137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00bdd00 0x7f9fe00628b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9fd8013000 tx=0x7f9fd8009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:17.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fd6000700 1 -- 172.21.15.49:0/580774137 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd801d440 con 0x7f9fe00bdd00 2024-01-22T05:05:17.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fd6000700 1 -- 172.21.15.49:0/580774137 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd801d5a0 con 0x7f9fe00bdd00 2024-01-22T05:05:17.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.792+0000 7f9fd6000700 1 -- 172.21.15.49:0/580774137 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd801d940 con 0x7f9fe00bdd00 2024-01-22T05:05:17.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.796+0000 7f9fe5e00700 1 -- 172.21.15.49:0/580774137 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe00a3e20 con 0x7f9fe00bdd00 2024-01-22T05:05:17.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.796+0000 7f9fe5e00700 1 -- 172.21.15.49:0/580774137 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe00a43e0 con 0x7f9fe00bdd00 2024-01-22T05:05:17.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.796+0000 7f9fe5e00700 1 -- 172.21.15.49:0/580774137 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe00657d0 con 0x7f9fe00bdd00 2024-01-22T05:05:17.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.796+0000 7f9fd6000700 1 -- 172.21.15.49:0/580774137 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9fd801dd30 con 0x7f9fe00bdd00 2024-01-22T05:05:17.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.800+0000 7f9fd6000700 1 --2- 172.21.15.49:0/580774137 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9fb805a510 0x7f9fb805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:17.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.800+0000 7f9fd6000700 1 -- 172.21.15.49:0/580774137 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f9fd8076b20 con 0x7f9fe00bdd00 2024-01-22T05:05:17.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.800+0000 7f9fdea00700 1 --2- 172.21.15.49:0/580774137 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9fb805a510 0x7f9fb805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:17.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.800+0000 7f9fdea00700 1 --2- 172.21.15.49:0/580774137 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9fb805a510 0x7f9fb805c9d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9fd00015a0 tx=0x7f9fd0000bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:17.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.804+0000 7f9fd6000700 1 -- 172.21.15.49:0/580774137 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9fd8049f30 con 0x7f9fe00bdd00 2024-01-22T05:05:17.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.964+0000 7f9fe5e00700 1 -- 172.21.15.49:0/580774137 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9fe00c3c40 con 0x7f9fe00bdd00 2024-01-22T05:05:17.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.968+0000 7f9fd6000700 1 -- 172.21.15.49:0/580774137 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9fd804d550 con 0x7f9fe00bdd00 2024-01-22T05:05:17.970 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-22T05:05:17.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.972+0000 7f9fe5e00700 1 -- 172.21.15.49:0/580774137 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9fb805a510 msgr2=0x7f9fb805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.972+0000 7f9fe5e00700 1 --2- 172.21.15.49:0/580774137 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9fb805a510 0x7f9fb805c9d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9fd00015a0 tx=0x7f9fd0000bc0).stop 2024-01-22T05:05:17.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.972+0000 7f9fe5e00700 1 -- 172.21.15.49:0/580774137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00bdd00 msgr2=0x7f9fe00628b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.972+0000 7f9fe5e00700 1 --2- 172.21.15.49:0/580774137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00bdd00 0x7f9fe00628b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9fd8013000 tx=0x7f9fd8009780).stop 2024-01-22T05:05:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.972+0000 7f9fe5e00700 1 -- 172.21.15.49:0/580774137 shutdown_connections 2024-01-22T05:05:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.972+0000 7f9fe5e00700 1 --2- 172.21.15.49:0/580774137 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9fb805a510 0x7f9fb805c9d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.972+0000 7f9fe5e00700 1 --2- 172.21.15.49:0/580774137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fe00bdd00 0x7f9fe00628b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.972+0000 7f9fe5e00700 1 --2- 172.21.15.49:0/580774137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fe00a6d90 0x7f9fe00a8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.972+0000 7f9fe5e00700 1 --2- 172.21.15.49:0/580774137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fe00645d0 0x7f9fe00c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:17.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.972+0000 7f9fe5e00700 1 -- 172.21.15.49:0/580774137 >> 172.21.15.49:0/580774137 conn(0x7f9fe00c8130 msgr2=0x7f9fe00c6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.972+0000 7f9fe5e00700 1 -- 172.21.15.49:0/580774137 shutdown_connections 2024-01-22T05:05:17.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:17.972+0000 7f9fe5e00700 1 -- 172.21.15.49:0/580774137 wait complete. 2024-01-22T05:05:17.999 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:05:18.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.156+0000 7f86ec400700 1 Processor -- start 2024-01-22T05:05:18.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.156+0000 7f86ec400700 1 -- start start 2024-01-22T05:05:18.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.156+0000 7f86ec400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f86e4155d20 0x7f86e4065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.156+0000 7f86ec400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e40c1a40 con 0x7f86e40a8e50 2024-01-22T05:05:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.156+0000 7f86ec400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e4159310 con 0x7f86e4066070 2024-01-22T05:05:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.160+0000 7f86ec400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e40c13f0 con 0x7f86e4155d20 2024-01-22T05:05:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.160+0000 7f86ea400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f86e40a8e50 0x7f86e40c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44768/0 (socket says 172.21.15.49:44768) 2024-01-22T05:05:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.160+0000 7f86ea400700 1 -- 172.21.15.49:0/1419119757 learned_addr learned my addr 172.21.15.49:0/1419119757 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.160+0000 7f86e9a00700 1 --2- 172.21.15.49:0/1419119757 >> v2:172.21.15.110:3300/0 conn(0x7f86e4155d20 0x7f86e4065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.160+0000 7f86e3e00700 1 -- 172.21.15.49:0/1419119757 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602553389 0 0) 0x7f86e40c1a40 con 0x7f86e40a8e50 2024-01-22T05:05:18.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.160+0000 7f86e3e00700 1 -- 172.21.15.49:0/1419119757 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c40033f0 con 0x7f86e40a8e50 2024-01-22T05:05:18.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.160+0000 7f86e9a00700 1 -- 172.21.15.49:0/1419119757 >> v1:172.21.15.110:6789/0 conn(0x7f86e4066070 legacy=0x7f86e40a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.160+0000 7f86e9a00700 1 -- 172.21.15.49:0/1419119757 >> v1:172.21.15.49:6789/0 conn(0x7f86e40a8e50 legacy=0x7f86e40c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.160+0000 7f86e9a00700 1 -- 172.21.15.49:0/1419119757 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40c16d0 con 0x7f86e4155d20 2024-01-22T05:05:18.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.160+0000 7f86e9a00700 1 --2- 172.21.15.49:0/1419119757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e4155d20 0x7f86e4065b80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f86d4009760 tx=0x7f86d4009060).ready entity=mon.1 client_cookie=a90517b0769ae515 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:18.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.160+0000 7f86e3e00700 1 -- 172.21.15.49:0/1419119757 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d400f510 con 0x7f86e4155d20 2024-01-22T05:05:18.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.160+0000 7f86e3e00700 1 -- 172.21.15.49:0/1419119757 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d400f670 con 0x7f86e4155d20 2024-01-22T05:05:18.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.160+0000 7f86e3e00700 1 -- 172.21.15.49:0/1419119757 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d400f9f0 con 0x7f86e4155d20 2024-01-22T05:05:18.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.160+0000 7f86ec400700 1 -- 172.21.15.49:0/1419119757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e4155d20 msgr2=0x7f86e4065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.160+0000 7f86ec400700 1 --2- 172.21.15.49:0/1419119757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e4155d20 0x7f86e4065b80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f86d4009760 tx=0x7f86d4009060).stop 2024-01-22T05:05:18.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.164+0000 7f86ec400700 1 -- 172.21.15.49:0/1419119757 shutdown_connections 2024-01-22T05:05:18.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.164+0000 7f86ec400700 1 --2- 172.21.15.49:0/1419119757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e4155d20 0x7f86e4065b80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.164+0000 7f86ec400700 1 -- 172.21.15.49:0/1419119757 >> 172.21.15.49:0/1419119757 conn(0x7f86e40c6540 msgr2=0x7f86e40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:18.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.164+0000 7f86ec400700 1 -- 172.21.15.49:0/1419119757 shutdown_connections 2024-01-22T05:05:18.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.164+0000 7f86ec400700 1 -- 172.21.15.49:0/1419119757 wait complete. 2024-01-22T05:05:18.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.164+0000 7f86ec400700 1 Processor -- start 2024-01-22T05:05:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.164+0000 7f86ec400700 1 -- start start 2024-01-22T05:05:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86ec400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e4066070 0x7f86e41447f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86ec400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e40a8e50 0x7f86e41685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86ec400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e4155d20 0x7f86e40c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86ec400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40a95b0 con 0x7f86e40a8e50 2024-01-22T05:05:18.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86ec400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4144ce0 con 0x7f86e4155d20 2024-01-22T05:05:18.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86ec400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4168dc0 con 0x7f86e4066070 2024-01-22T05:05:18.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86e9000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e40a8e50 0x7f86e41685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86e9000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e40a8e50 0x7f86e41685e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58052/0 (socket says 172.21.15.49:58052) 2024-01-22T05:05:18.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86e9000700 1 -- 172.21.15.49:0/3672436733 learned_addr learned my addr 172.21.15.49:0/3672436733 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:18.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86e9a00700 1 --2- 172.21.15.49:0/3672436733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e4066070 0x7f86e41447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86ea400700 1 --2- 172.21.15.49:0/3672436733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e4155d20 0x7f86e40c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86e9000700 1 -- 172.21.15.49:0/3672436733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e4066070 msgr2=0x7f86e41447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86e9000700 1 --2- 172.21.15.49:0/3672436733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e4066070 0x7f86e41447f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86e9000700 1 -- 172.21.15.49:0/3672436733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e4155d20 msgr2=0x7f86e40c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86e9000700 1 --2- 172.21.15.49:0/3672436733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e4155d20 0x7f86e40c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86e9000700 1 -- 172.21.15.49:0/3672436733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d40092a0 con 0x7f86e40a8e50 2024-01-22T05:05:18.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86ea400700 1 --2- 172.21.15.49:0/3672436733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e4155d20 0x7f86e40c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:18.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86e9000700 1 --2- 172.21.15.49:0/3672436733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e40a8e50 0x7f86e41685e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f86cc00c4c0 tx=0x7f86cc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:18.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86e0c00700 1 -- 172.21.15.49:0/3672436733 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc007020 con 0x7f86e40a8e50 2024-01-22T05:05:18.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86e0c00700 1 -- 172.21.15.49:0/3672436733 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc001e90 con 0x7f86e40a8e50 2024-01-22T05:05:18.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86ec400700 1 -- 172.21.15.49:0/3672436733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e41690a0 con 0x7f86e40a8e50 2024-01-22T05:05:18.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86e0c00700 1 -- 172.21.15.49:0/3672436733 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0073d0 con 0x7f86e40a8e50 2024-01-22T05:05:18.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.168+0000 7f86ec400700 1 -- 172.21.15.49:0/3672436733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e40a9800 con 0x7f86e40a8e50 2024-01-22T05:05:18.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.172+0000 7f86ec400700 1 -- 172.21.15.49:0/3672436733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e4047060 con 0x7f86e40a8e50 2024-01-22T05:05:18.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.172+0000 7f86e0c00700 1 -- 172.21.15.49:0/3672436733 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f86cc0068b0 con 0x7f86e40a8e50 2024-01-22T05:05:18.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.172+0000 7f86e0c00700 1 --2- 172.21.15.49:0/3672436733 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86bc05a510 0x7f86bc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.172+0000 7f86e0c00700 1 -- 172.21.15.49:0/3672436733 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f86cc0743a0 con 0x7f86e40a8e50 2024-01-22T05:05:18.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.172+0000 7f86e9a00700 1 --2- 172.21.15.49:0/3672436733 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86bc05a510 0x7f86bc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.176+0000 7f86e9a00700 1 --2- 172.21.15.49:0/3672436733 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86bc05a510 0x7f86bc05c9d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f86d4009760 tx=0x7f86d4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:18.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.180+0000 7f86e0c00700 1 -- 172.21.15.49:0/3672436733 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f86cc047870 con 0x7f86e40a8e50 2024-01-22T05:05:18.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.352+0000 7f86ec400700 1 -- 172.21.15.49:0/3672436733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86e4046800 con 0x7f86e40a8e50 2024-01-22T05:05:18.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.356+0000 7f86e0c00700 1 -- 172.21.15.49:0/3672436733 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f86cc050e60 con 0x7f86e40a8e50 2024-01-22T05:05:18.359 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:18.359 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:39.526211+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:05:18.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.356+0000 7f86ec400700 1 -- 172.21.15.49:0/3672436733 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86bc05a510 msgr2=0x7f86bc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.356+0000 7f86ec400700 1 --2- 172.21.15.49:0/3672436733 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86bc05a510 0x7f86bc05c9d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f86d4009760 tx=0x7f86d4017000).stop 2024-01-22T05:05:18.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.356+0000 7f86ec400700 1 -- 172.21.15.49:0/3672436733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e40a8e50 msgr2=0x7f86e41685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.356+0000 7f86ec400700 1 --2- 172.21.15.49:0/3672436733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e40a8e50 0x7f86e41685e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f86cc00c4c0 tx=0x7f86cc007e00).stop 2024-01-22T05:05:18.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.360+0000 7f86ec400700 1 -- 172.21.15.49:0/3672436733 shutdown_connections 2024-01-22T05:05:18.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.360+0000 7f86ec400700 1 --2- 172.21.15.49:0/3672436733 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86bc05a510 0x7f86bc05c9d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.360+0000 7f86ec400700 1 --2- 172.21.15.49:0/3672436733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e4155d20 0x7f86e40c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.360+0000 7f86ec400700 1 --2- 172.21.15.49:0/3672436733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e40a8e50 0x7f86e41685e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.360+0000 7f86ec400700 1 --2- 172.21.15.49:0/3672436733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e4066070 0x7f86e41447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.360+0000 7f86ec400700 1 -- 172.21.15.49:0/3672436733 >> 172.21.15.49:0/3672436733 conn(0x7f86e40c6540 msgr2=0x7f86e4068200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:18.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.360+0000 7f86ec400700 1 -- 172.21.15.49:0/3672436733 shutdown_connections 2024-01-22T05:05:18.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.360+0000 7f86ec400700 1 -- 172.21.15.49:0/3672436733 wait complete. 2024-01-22T05:05:18.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:04:32.991898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:04:34.057128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-22T05:04:37.108860+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:05:18.388 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:05:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.544+0000 7fbffe000700 1 Processor -- start 2024-01-22T05:05:18.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.548+0000 7fbffe000700 1 -- start start 2024-01-22T05:05:18.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.548+0000 7fbffe000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff80bcbe0 0x7fbff8068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.548+0000 7fbffe000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff8158650 con 0x7fbff80a8c20 2024-01-22T05:05:18.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbffe000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff80bd170 con 0x7fbff80c1ce0 2024-01-22T05:05:18.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbffe000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff8067c30 con 0x7fbff80bcbe0 2024-01-22T05:05:18.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbff7400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbff80a8c20 0x7fbff80c15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44778/0 (socket says 172.21.15.49:44778) 2024-01-22T05:05:18.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbff7400700 1 -- 172.21.15.49:0/3368418668 learned_addr learned my addr 172.21.15.49:0/3368418668 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:18.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbff7e00700 1 --2- 172.21.15.49:0/3368418668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff80bcbe0 0x7fbff8068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbff6000700 1 -- 172.21.15.49:0/3368418668 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163425952 0 0) 0x7fbfe8001110 con 0x7fbff80a8c20 2024-01-22T05:05:18.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbff6000700 1 -- 172.21.15.49:0/3368418668 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfd80033f0 con 0x7fbff80a8c20 2024-01-22T05:05:18.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbff6000700 1 -- 172.21.15.49:0/3368418668 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041504098 0 0) 0x7fbff80bd170 con 0x7fbff80c1ce0 2024-01-22T05:05:18.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbff6000700 1 -- 172.21.15.49:0/3368418668 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfe8001110 con 0x7fbff80c1ce0 2024-01-22T05:05:18.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbff6000700 1 -- 172.21.15.49:0/3368418668 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1455609247 0 0) 0x7fbfd80033f0 con 0x7fbff80a8c20 2024-01-22T05:05:18.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbff7e00700 1 -- 172.21.15.49:0/3368418668 >> v1:172.21.15.110:6789/0 conn(0x7fbff80c1ce0 legacy=0x7fbff80bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbff7e00700 1 -- 172.21.15.49:0/3368418668 >> v1:172.21.15.49:6789/0 conn(0x7fbff80a8c20 legacy=0x7fbff80c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbff7e00700 1 -- 172.21.15.49:0/3368418668 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff8067f10 con 0x7fbff80bcbe0 2024-01-22T05:05:18.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbff7e00700 1 --2- 172.21.15.49:0/3368418668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff80bcbe0 0x7fbff8068710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fbff0009e90 tx=0x7fbff0009780).ready entity=mon.2 client_cookie=3cd6158d22ea651b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:18.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbff6000700 1 -- 172.21.15.49:0/3368418668 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff000e070 con 0x7fbff80bcbe0 2024-01-22T05:05:18.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbff6000700 1 -- 172.21.15.49:0/3368418668 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff000b7a0 con 0x7fbff80bcbe0 2024-01-22T05:05:18.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.552+0000 7fbff6000700 1 -- 172.21.15.49:0/3368418668 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8001620 con 0x7fbff80bcbe0 2024-01-22T05:05:18.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.556+0000 7fbffe000700 1 -- 172.21.15.49:0/3368418668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff80bcbe0 msgr2=0x7fbff8068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.556+0000 7fbffe000700 1 --2- 172.21.15.49:0/3368418668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff80bcbe0 0x7fbff8068710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fbff0009e90 tx=0x7fbff0009780).stop 2024-01-22T05:05:18.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.556+0000 7fbffe000700 1 -- 172.21.15.49:0/3368418668 shutdown_connections 2024-01-22T05:05:18.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.556+0000 7fbffe000700 1 --2- 172.21.15.49:0/3368418668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff80bcbe0 0x7fbff8068710 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.556+0000 7fbffe000700 1 -- 172.21.15.49:0/3368418668 >> 172.21.15.49:0/3368418668 conn(0x7fbff8062cb0 msgr2=0x7fbff80c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:18.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.556+0000 7fbffe000700 1 -- 172.21.15.49:0/3368418668 shutdown_connections 2024-01-22T05:05:18.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.556+0000 7fbffe000700 1 -- 172.21.15.49:0/3368418668 wait complete. 2024-01-22T05:05:18.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.560+0000 7fbffe000700 1 Processor -- start 2024-01-22T05:05:18.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.560+0000 7fbffe000700 1 -- start start 2024-01-22T05:05:18.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.560+0000 7fbffe000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff80a8c20 0x7fbff8148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.560+0000 7fbffe000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbff80bcbe0 0x7fbff80656d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.560+0000 7fbffe000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff80c1ce0 0x7fbff8065bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.560+0000 7fbffe000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff80660b0 con 0x7fbff80c1ce0 2024-01-22T05:05:18.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.560+0000 7fbffe000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff81491e0 con 0x7fbff80bcbe0 2024-01-22T05:05:18.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.560+0000 7fbffe000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff80be570 con 0x7fbff80a8c20 2024-01-22T05:05:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbff7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff80c1ce0 0x7fbff8065bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbff7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff80c1ce0 0x7fbff8065bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58058/0 (socket says 172.21.15.49:58058) 2024-01-22T05:05:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbff7e00700 1 -- 172.21.15.49:0/1835327133 learned_addr learned my addr 172.21.15.49:0/1835327133 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbff7400700 1 --2- 172.21.15.49:0/1835327133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff80a8c20 0x7fbff8148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbff6a00700 1 --2- 172.21.15.49:0/1835327133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbff80bcbe0 0x7fbff80656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbff7e00700 1 -- 172.21.15.49:0/1835327133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff80a8c20 msgr2=0x7fbff8148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbff7e00700 1 --2- 172.21.15.49:0/1835327133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff80a8c20 0x7fbff8148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbff7e00700 1 -- 172.21.15.49:0/1835327133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbff80bcbe0 msgr2=0x7fbff80656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbff7e00700 1 --2- 172.21.15.49:0/1835327133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbff80bcbe0 0x7fbff80656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbff7e00700 1 -- 172.21.15.49:0/1835327133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff0009a20 con 0x7fbff80c1ce0 2024-01-22T05:05:18.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbff7e00700 1 --2- 172.21.15.49:0/1835327133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff80c1ce0 0x7fbff8065bc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fbff000b610 tx=0x7fbff0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:18.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbfeea00700 1 -- 172.21.15.49:0/1835327133 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff000be50 con 0x7fbff80c1ce0 2024-01-22T05:05:18.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbfeea00700 1 -- 172.21.15.49:0/1835327133 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff001d650 con 0x7fbff80c1ce0 2024-01-22T05:05:18.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbffe000700 1 -- 172.21.15.49:0/1835327133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff80be850 con 0x7fbff80c1ce0 2024-01-22T05:05:18.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbfeea00700 1 -- 172.21.15.49:0/1835327133 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff001d9d0 con 0x7fbff80c1ce0 2024-01-22T05:05:18.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbffe000700 1 -- 172.21.15.49:0/1835327133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff80bee10 con 0x7fbff80c1ce0 2024-01-22T05:05:18.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.564+0000 7fbffe000700 1 -- 172.21.15.49:0/1835327133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff80c0c00 con 0x7fbff80c1ce0 2024-01-22T05:05:18.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.568+0000 7fbfeea00700 1 -- 172.21.15.49:0/1835327133 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbff0027460 con 0x7fbff80c1ce0 2024-01-22T05:05:18.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.568+0000 7fbfeea00700 1 --2- 172.21.15.49:0/1835327133 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbfd005a510 0x7fbfd005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.568+0000 7fbfeea00700 1 -- 172.21.15.49:0/1835327133 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7fbff0076d00 con 0x7fbff80c1ce0 2024-01-22T05:05:18.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.568+0000 7fbff7400700 1 --2- 172.21.15.49:0/1835327133 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbfd005a510 0x7fbfd005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.568+0000 7fbff7400700 1 --2- 172.21.15.49:0/1835327133 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbfd005a510 0x7fbfd005c9d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fbfe8001010 tx=0x7fbfe80014a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:18.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.576+0000 7fbfeea00700 1 -- 172.21.15.49:0/1835327133 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbff004a0b0 con 0x7fbff80c1ce0 2024-01-22T05:05:18.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.736+0000 7fbffe000700 1 -- 172.21.15.49:0/1835327133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbff8046800 con 0x7fbff80c1ce0 2024-01-22T05:05:18.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.736+0000 7fbfeea00700 1 -- 172.21.15.49:0/1835327133 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbff004d6d0 con 0x7fbff80c1ce0 2024-01-22T05:05:18.741 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:05:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.740+0000 7fbffe000700 1 -- 172.21.15.49:0/1835327133 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbfd005a510 msgr2=0x7fbfd005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.740+0000 7fbffe000700 1 --2- 172.21.15.49:0/1835327133 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbfd005a510 0x7fbfd005c9d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fbfe8001010 tx=0x7fbfe80014a0).stop 2024-01-22T05:05:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.740+0000 7fbffe000700 1 -- 172.21.15.49:0/1835327133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff80c1ce0 msgr2=0x7fbff8065bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.740+0000 7fbffe000700 1 --2- 172.21.15.49:0/1835327133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff80c1ce0 0x7fbff8065bc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fbff000b610 tx=0x7fbff0009780).stop 2024-01-22T05:05:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.740+0000 7fbffe000700 1 -- 172.21.15.49:0/1835327133 shutdown_connections 2024-01-22T05:05:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.740+0000 7fbffe000700 1 --2- 172.21.15.49:0/1835327133 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbfd005a510 0x7fbfd005c9d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.740+0000 7fbffe000700 1 --2- 172.21.15.49:0/1835327133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff80c1ce0 0x7fbff8065bc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.740+0000 7fbffe000700 1 --2- 172.21.15.49:0/1835327133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbff80bcbe0 0x7fbff80656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.740+0000 7fbffe000700 1 --2- 172.21.15.49:0/1835327133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff80a8c20 0x7fbff8148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.740+0000 7fbffe000700 1 -- 172.21.15.49:0/1835327133 >> 172.21.15.49:0/1835327133 conn(0x7fbff8062cb0 msgr2=0x7fbff8157960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.740+0000 7fbffe000700 1 -- 172.21.15.49:0/1835327133 shutdown_connections 2024-01-22T05:05:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.740+0000 7fbffe000700 1 -- 172.21.15.49:0/1835327133 wait complete. 2024-01-22T05:05:18.767 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:05:18.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.928+0000 7f6687400700 1 Processor -- start 2024-01-22T05:05:18.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.928+0000 7f6687400700 1 -- start start 2024-01-22T05:05:18.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.932+0000 7f6687400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66800c1ce0 0x7f66800bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.932+0000 7f6687400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f66800bc9c0 0x7f6680068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.932+0000 7f6687400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6680158650 con 0x7f66800a8c20 2024-01-22T05:05:18.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.932+0000 7f6687400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66800bd170 con 0x7f66800bc9c0 2024-01-22T05:05:18.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.932+0000 7f6687400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6680067c30 con 0x7f66800c1ce0 2024-01-22T05:05:18.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.932+0000 7f6684a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f66800a8c20 0x7f66800c15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44784/0 (socket says 172.21.15.49:44784) 2024-01-22T05:05:18.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.932+0000 7f6684a00700 1 -- 172.21.15.49:0/4017675513 learned_addr learned my addr 172.21.15.49:0/4017675513 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:18.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.932+0000 7f667fe00700 1 --2- 172.21.15.49:0/4017675513 >> v2:172.21.15.110:3300/0 conn(0x7f66800c1ce0 0x7f66800bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.932+0000 7f6685400700 1 --2- 172.21.15.49:0/4017675513 >> v2:172.21.15.49:3300/0 conn(0x7f66800bc9c0 0x7f6680068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.932+0000 7f667f400700 1 -- 172.21.15.49:0/4017675513 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235724018 0 0) 0x7f6670001110 con 0x7f66800a8c20 2024-01-22T05:05:18.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.932+0000 7f667f400700 1 -- 172.21.15.49:0/4017675513 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66600033f0 con 0x7f66800a8c20 2024-01-22T05:05:18.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.932+0000 7f6685400700 1 -- 172.21.15.49:0/4017675513 >> v2:172.21.15.110:3300/0 conn(0x7f66800c1ce0 msgr2=0x7f66800bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:18.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.932+0000 7f6685400700 1 --2- 172.21.15.49:0/4017675513 >> v2:172.21.15.110:3300/0 conn(0x7f66800c1ce0 0x7f66800bc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.932+0000 7f6685400700 1 -- 172.21.15.49:0/4017675513 >> v1:172.21.15.49:6789/0 conn(0x7f66800a8c20 legacy=0x7f66800c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.932+0000 7f6685400700 1 -- 172.21.15.49:0/4017675513 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6680067f10 con 0x7f66800bc9c0 2024-01-22T05:05:18.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.936+0000 7f6685400700 1 --2- 172.21.15.49:0/4017675513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66800bc9c0 0x7f6680068710 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f66800bb7b0 tx=0x7f6678009780).ready entity=mon.0 client_cookie=b2c303f9776a972d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:18.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.936+0000 7f667f400700 1 -- 172.21.15.49:0/4017675513 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667800e070 con 0x7f66800bc9c0 2024-01-22T05:05:18.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.936+0000 7f667f400700 1 -- 172.21.15.49:0/4017675513 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667800bab0 con 0x7f66800bc9c0 2024-01-22T05:05:18.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.936+0000 7f667f400700 1 -- 172.21.15.49:0/4017675513 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667800be30 con 0x7f66800bc9c0 2024-01-22T05:05:18.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.936+0000 7f6687400700 1 -- 172.21.15.49:0/4017675513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66800bc9c0 msgr2=0x7f6680068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.936+0000 7f6687400700 1 --2- 172.21.15.49:0/4017675513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66800bc9c0 0x7f6680068710 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f66800bb7b0 tx=0x7f6678009780).stop 2024-01-22T05:05:18.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.936+0000 7f6687400700 1 -- 172.21.15.49:0/4017675513 shutdown_connections 2024-01-22T05:05:18.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.936+0000 7f6687400700 1 --2- 172.21.15.49:0/4017675513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66800bc9c0 0x7f6680068710 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.936+0000 7f6687400700 1 --2- 172.21.15.49:0/4017675513 >> v2:172.21.15.110:3300/0 conn(0x7f66800c1ce0 0x7f66800bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.936+0000 7f6687400700 1 -- 172.21.15.49:0/4017675513 >> 172.21.15.49:0/4017675513 conn(0x7f6680062cb0 msgr2=0x7f66800c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:18.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.936+0000 7f6687400700 1 -- 172.21.15.49:0/4017675513 shutdown_connections 2024-01-22T05:05:18.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.936+0000 7f6687400700 1 -- 172.21.15.49:0/4017675513 wait complete. 2024-01-22T05:05:18.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.940+0000 7f6687400700 1 Processor -- start 2024-01-22T05:05:18.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.940+0000 7f6687400700 1 -- start start 2024-01-22T05:05:18.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6687400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66800a8c20 0x7f66800be970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6687400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800bc9c0 0x7f668015ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6687400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800c1ce0 0x7f668015b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6687400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668015a8d0 con 0x7f66800a8c20 2024-01-22T05:05:18.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6687400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680159cc0 con 0x7f66800bc9c0 2024-01-22T05:05:18.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6687400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6680159fa0 con 0x7f66800c1ce0 2024-01-22T05:05:18.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6684a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66800a8c20 0x7f66800be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6684a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66800a8c20 0x7f66800be970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58078/0 (socket says 172.21.15.49:58078) 2024-01-22T05:05:18.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6684a00700 1 -- 172.21.15.49:0/2499245483 learned_addr learned my addr 172.21.15.49:0/2499245483 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:18.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f667fe00700 1 --2- 172.21.15.49:0/2499245483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800bc9c0 0x7f668015ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6685400700 1 --2- 172.21.15.49:0/2499245483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800c1ce0 0x7f668015b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6684a00700 1 -- 172.21.15.49:0/2499245483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800c1ce0 msgr2=0x7f668015b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6684a00700 1 --2- 172.21.15.49:0/2499245483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800c1ce0 0x7f668015b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6684a00700 1 -- 172.21.15.49:0/2499245483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800bc9c0 msgr2=0x7f668015ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6684a00700 1 --2- 172.21.15.49:0/2499245483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800bc9c0 0x7f668015ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6684a00700 1 -- 172.21.15.49:0/2499245483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6678009a20 con 0x7f66800a8c20 2024-01-22T05:05:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f667fe00700 1 --2- 172.21.15.49:0/2499245483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800bc9c0 0x7f668015ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6684a00700 1 --2- 172.21.15.49:0/2499245483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66800a8c20 0x7f66800be970 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f667000c440 tx=0x7f6670007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:18.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6677e00700 1 -- 172.21.15.49:0/2499245483 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66700070d0 con 0x7f66800a8c20 2024-01-22T05:05:18.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6677e00700 1 -- 172.21.15.49:0/2499245483 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6670007230 con 0x7f66800a8c20 2024-01-22T05:05:18.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6687400700 1 -- 172.21.15.49:0/2499245483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668015a280 con 0x7f66800a8c20 2024-01-22T05:05:18.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.944+0000 7f6677e00700 1 -- 172.21.15.49:0/2499245483 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66700075d0 con 0x7f66800a8c20 2024-01-22T05:05:18.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.948+0000 7f6687400700 1 -- 172.21.15.49:0/2499245483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66800bee60 con 0x7f66800a8c20 2024-01-22T05:05:18.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.948+0000 7f6687400700 1 -- 172.21.15.49:0/2499245483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668015a700 con 0x7f66800a8c20 2024-01-22T05:05:18.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.948+0000 7f6677e00700 1 -- 172.21.15.49:0/2499245483 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f66700059b0 con 0x7f66800a8c20 2024-01-22T05:05:18.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.952+0000 7f6677e00700 1 --2- 172.21.15.49:0/2499245483 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f665805a510 0x7f665805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:18.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.952+0000 7f6677e00700 1 -- 172.21.15.49:0/2499245483 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f6670073c80 con 0x7f66800a8c20 2024-01-22T05:05:18.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.952+0000 7f667fe00700 1 --2- 172.21.15.49:0/2499245483 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f665805a510 0x7f665805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:18.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.952+0000 7f667fe00700 1 --2- 172.21.15.49:0/2499245483 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f665805a510 0x7f665805c9d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f66801571f0 tx=0x7f6668006f40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:18.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:18.956+0000 7f6677e00700 1 -- 172.21.15.49:0/2499245483 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6670047150 con 0x7f66800a8c20 2024-01-22T05:05:19.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.136+0000 7f6687400700 1 -- 172.21.15.49:0/2499245483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6680158650 con 0x7f66800a8c20 2024-01-22T05:05:19.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.136+0000 7f6677e00700 1 -- 172.21.15.49:0/2499245483 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6680158650 con 0x7f66800a8c20 2024-01-22T05:05:19.140 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:05:19.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.140+0000 7f6687400700 1 -- 172.21.15.49:0/2499245483 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f665805a510 msgr2=0x7f665805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:19.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.140+0000 7f6687400700 1 --2- 172.21.15.49:0/2499245483 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f665805a510 0x7f665805c9d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f66801571f0 tx=0x7f6668006f40).stop 2024-01-22T05:05:19.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.140+0000 7f6687400700 1 -- 172.21.15.49:0/2499245483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66800a8c20 msgr2=0x7f66800be970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:19.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.140+0000 7f6687400700 1 --2- 172.21.15.49:0/2499245483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66800a8c20 0x7f66800be970 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f667000c440 tx=0x7f6670007af0).stop 2024-01-22T05:05:19.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.140+0000 7f6687400700 1 -- 172.21.15.49:0/2499245483 shutdown_connections 2024-01-22T05:05:19.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.140+0000 7f6687400700 1 --2- 172.21.15.49:0/2499245483 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f665805a510 0x7f665805c9d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.140+0000 7f6687400700 1 --2- 172.21.15.49:0/2499245483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800c1ce0 0x7f668015b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.140+0000 7f6687400700 1 --2- 172.21.15.49:0/2499245483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800bc9c0 0x7f668015ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.140+0000 7f6687400700 1 --2- 172.21.15.49:0/2499245483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66800a8c20 0x7f66800be970 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.140+0000 7f6687400700 1 -- 172.21.15.49:0/2499245483 >> 172.21.15.49:0/2499245483 conn(0x7f6680062cb0 msgr2=0x7f66800bba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:19.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.140+0000 7f6687400700 1 -- 172.21.15.49:0/2499245483 shutdown_connections 2024-01-22T05:05:19.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.140+0000 7f6687400700 1 -- 172.21.15.49:0/2499245483 wait complete. 2024-01-22T05:05:19.168 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:05:19.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.340+0000 7f3b33e00700 1 Processor -- start 2024-01-22T05:05:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.340+0000 7f3b33e00700 1 -- start start 2024-01-22T05:05:19.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.344+0000 7f3b33e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b340bc1c0 0x7f3b340bc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:19.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.344+0000 7f3b33e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b340c2c00 con 0x7f3b34067a90 2024-01-22T05:05:19.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.344+0000 7f3b33e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b340c3090 con 0x7f3b34157f90 2024-01-22T05:05:19.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.344+0000 7f3b33e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340bcaf0 con 0x7f3b340bc1c0 2024-01-22T05:05:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.344+0000 7f3b33400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3b34067a90 0x7f3b34067f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44792/0 (socket says 172.21.15.49:44792) 2024-01-22T05:05:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.344+0000 7f3b33400700 1 -- 172.21.15.49:0/92838371 learned_addr learned my addr 172.21.15.49:0/92838371 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.344+0000 7f3b32000700 1 --2- 172.21.15.49:0/92838371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b340bc1c0 0x7f3b340bc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:19.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.344+0000 7f3b31600700 1 -- 172.21.15.49:0/92838371 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186795617 0 0) 0x7f3b340c2c00 con 0x7f3b34067a90 2024-01-22T05:05:19.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b31600700 1 -- 172.21.15.49:0/92838371 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b140033f0 con 0x7f3b34067a90 2024-01-22T05:05:19.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b31600700 1 -- 172.21.15.49:0/92838371 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614586025 0 0) 0x7f3b340c3090 con 0x7f3b34157f90 2024-01-22T05:05:19.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b31600700 1 -- 172.21.15.49:0/92838371 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b340c2c00 con 0x7f3b34157f90 2024-01-22T05:05:19.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b32000700 1 -- 172.21.15.49:0/92838371 >> v1:172.21.15.110:6789/0 conn(0x7f3b34157f90 legacy=0x7f3b34158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:19.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b32000700 1 -- 172.21.15.49:0/92838371 >> v1:172.21.15.49:6789/0 conn(0x7f3b34067a90 legacy=0x7f3b34067f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:19.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b32000700 1 -- 172.21.15.49:0/92838371 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b340c1d30 con 0x7f3b340bc1c0 2024-01-22T05:05:19.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b32000700 1 --2- 172.21.15.49:0/92838371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b340bc1c0 0x7f3b340bc600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3b1c009790 tx=0x7f3b1c009060).ready entity=mon.2 client_cookie=61721ac50eb03825 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:19.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b31600700 1 -- 172.21.15.49:0/92838371 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c00f510 con 0x7f3b340bc1c0 2024-01-22T05:05:19.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b31600700 1 -- 172.21.15.49:0/92838371 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c00f670 con 0x7f3b340bc1c0 2024-01-22T05:05:19.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b31600700 1 -- 172.21.15.49:0/92838371 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c00f9f0 con 0x7f3b340bc1c0 2024-01-22T05:05:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b33e00700 1 -- 172.21.15.49:0/92838371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b340bc1c0 msgr2=0x7f3b340bc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b33e00700 1 --2- 172.21.15.49:0/92838371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b340bc1c0 0x7f3b340bc600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3b1c009790 tx=0x7f3b1c009060).stop 2024-01-22T05:05:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b33e00700 1 -- 172.21.15.49:0/92838371 shutdown_connections 2024-01-22T05:05:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b33e00700 1 --2- 172.21.15.49:0/92838371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b340bc1c0 0x7f3b340bc600 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b33e00700 1 -- 172.21.15.49:0/92838371 >> 172.21.15.49:0/92838371 conn(0x7f3b340c3880 msgr2=0x7f3b340c3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b33e00700 1 -- 172.21.15.49:0/92838371 shutdown_connections 2024-01-22T05:05:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.348+0000 7f3b33e00700 1 -- 172.21.15.49:0/92838371 wait complete. 2024-01-22T05:05:19.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.352+0000 7f3b33e00700 1 Processor -- start 2024-01-22T05:05:19.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.352+0000 7f3b33e00700 1 -- start start 2024-01-22T05:05:19.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.352+0000 7f3b33e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b34067a90 0x7f3b34169390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:19.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.352+0000 7f3b33e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b340bc1c0 0x7f3b34155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:19.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.352+0000 7f3b33e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b34157f90 0x7f3b340a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:19.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.352+0000 7f3b33e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3416caf0 con 0x7f3b340bc1c0 2024-01-22T05:05:19.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.352+0000 7f3b33e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34169880 con 0x7f3b34157f90 2024-01-22T05:05:19.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.352+0000 7f3b33e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3416bee0 con 0x7f3b34067a90 2024-01-22T05:05:19.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b32000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b340bc1c0 0x7f3b34155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:19.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b32000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b340bc1c0 0x7f3b34155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58086/0 (socket says 172.21.15.49:58086) 2024-01-22T05:05:19.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b33400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b34157f90 0x7f3b340a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:19.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b32000700 1 -- 172.21.15.49:0/3169496270 learned_addr learned my addr 172.21.15.49:0/3169496270 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:19.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b32a00700 1 --2- 172.21.15.49:0/3169496270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b34067a90 0x7f3b34169390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:19.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b32000700 1 -- 172.21.15.49:0/3169496270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b34067a90 msgr2=0x7f3b34169390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:19.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b32000700 1 --2- 172.21.15.49:0/3169496270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b34067a90 0x7f3b34169390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b32000700 1 -- 172.21.15.49:0/3169496270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b34157f90 msgr2=0x7f3b340a8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:19.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b32000700 1 --2- 172.21.15.49:0/3169496270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b34157f90 0x7f3b340a8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b32000700 1 -- 172.21.15.49:0/3169496270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c0092a0 con 0x7f3b340bc1c0 2024-01-22T05:05:19.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b33400700 1 --2- 172.21.15.49:0/3169496270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b34157f90 0x7f3b340a8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:19.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b32000700 1 --2- 172.21.15.49:0/3169496270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b340bc1c0 0x7f3b34155270 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f3b34065890 tx=0x7f3b1c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:19.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b2a000700 1 -- 172.21.15.49:0/3169496270 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c01a4d0 con 0x7f3b340bc1c0 2024-01-22T05:05:19.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b2a000700 1 -- 172.21.15.49:0/3169496270 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c01e070 con 0x7f3b340bc1c0 2024-01-22T05:05:19.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b2a000700 1 -- 172.21.15.49:0/3169496270 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c01a880 con 0x7f3b340bc1c0 2024-01-22T05:05:19.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b33e00700 1 -- 172.21.15.49:0/3169496270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3416c1c0 con 0x7f3b340bc1c0 2024-01-22T05:05:19.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.356+0000 7f3b33e00700 1 -- 172.21.15.49:0/3169496270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3416c780 con 0x7f3b340bc1c0 2024-01-22T05:05:19.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.360+0000 7f3b33e00700 1 -- 172.21.15.49:0/3169496270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b34064eb0 con 0x7f3b340bc1c0 2024-01-22T05:05:19.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.360+0000 7f3b2a000700 1 -- 172.21.15.49:0/3169496270 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3b1c020030 con 0x7f3b340bc1c0 2024-01-22T05:05:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.360+0000 7f3b2a000700 1 --2- 172.21.15.49:0/3169496270 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b0c05a510 0x7f3b0c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.360+0000 7f3b2a000700 1 -- 172.21.15.49:0/3169496270 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f3b1c075950 con 0x7f3b340bc1c0 2024-01-22T05:05:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.360+0000 7f3b32a00700 1 --2- 172.21.15.49:0/3169496270 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b0c05a510 0x7f3b0c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.364+0000 7f3b32a00700 1 --2- 172.21.15.49:0/3169496270 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b0c05a510 0x7f3b0c05c9d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f3b24007fd0 tx=0x7f3b24007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:19.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.368+0000 7f3b2a000700 1 -- 172.21.15.49:0/3169496270 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3b1c048e20 con 0x7f3b340bc1c0 2024-01-22T05:05:19.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.532+0000 7f3b33e00700 1 -- 172.21.15.49:0/3169496270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b340c1ff0 con 0x7f3b340bc1c0 2024-01-22T05:05:19.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.532+0000 7f3b2a000700 1 -- 172.21.15.49:0/3169496270 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b1c0280a0 con 0x7f3b340bc1c0 2024-01-22T05:05:19.535 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:05:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.536+0000 7f3b33e00700 1 -- 172.21.15.49:0/3169496270 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b0c05a510 msgr2=0x7f3b0c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.536+0000 7f3b33e00700 1 --2- 172.21.15.49:0/3169496270 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b0c05a510 0x7f3b0c05c9d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f3b24007fd0 tx=0x7f3b24007bd0).stop 2024-01-22T05:05:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.536+0000 7f3b33e00700 1 -- 172.21.15.49:0/3169496270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b340bc1c0 msgr2=0x7f3b34155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.536+0000 7f3b33e00700 1 --2- 172.21.15.49:0/3169496270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b340bc1c0 0x7f3b34155270 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f3b34065890 tx=0x7f3b1c017000).stop 2024-01-22T05:05:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.536+0000 7f3b33e00700 1 -- 172.21.15.49:0/3169496270 shutdown_connections 2024-01-22T05:05:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.536+0000 7f3b33e00700 1 --2- 172.21.15.49:0/3169496270 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b0c05a510 0x7f3b0c05c9d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.536+0000 7f3b33e00700 1 --2- 172.21.15.49:0/3169496270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b34157f90 0x7f3b340a8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.536+0000 7f3b33e00700 1 --2- 172.21.15.49:0/3169496270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b340bc1c0 0x7f3b34155270 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.536+0000 7f3b33e00700 1 --2- 172.21.15.49:0/3169496270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b34067a90 0x7f3b34169390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.536+0000 7f3b33e00700 1 -- 172.21.15.49:0/3169496270 >> 172.21.15.49:0/3169496270 conn(0x7f3b340c3880 msgr2=0x7f3b34068710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.540+0000 7f3b33e00700 1 -- 172.21.15.49:0/3169496270 shutdown_connections 2024-01-22T05:05:19.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.540+0000 7f3b33e00700 1 -- 172.21.15.49:0/3169496270 wait complete. 2024-01-22T05:05:19.560 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:05:19.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.724+0000 7f1e2d400700 1 Processor -- start 2024-01-22T05:05:19.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.724+0000 7f1e2d400700 1 -- start start 2024-01-22T05:05:19.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e2d400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1e28151d30 0x7f1e280a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:19.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e2d400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1e280bdc30 0x7f1e280ac750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:19.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e2d400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e280acc40 0x7f1e280c4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:19.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e2d400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e280a6360 con 0x7f1e280bdc30 2024-01-22T05:05:19.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e2d400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e280ad700 con 0x7f1e28151d30 2024-01-22T05:05:19.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e2d400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280c3c70 con 0x7f1e280acc40 2024-01-22T05:05:19.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e27200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e280acc40 0x7f1e280c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:19.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e26800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1e28151d30 0x7f1e280a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:19.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e27200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e280acc40 0x7f1e280c4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:45834/0 (socket says 172.21.15.49:45834) 2024-01-22T05:05:19.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e27200700 1 -- 172.21.15.49:0/413306452 learned_addr learned my addr 172.21.15.49:0/413306452 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:19.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e25e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1e280bdc30 0x7f1e280ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:19.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e27200700 1 -- 172.21.15.49:0/413306452 >> v2:172.21.15.110:3300/0 conn(0x7f1e28151d30 msgr2=0x7f1e280a44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:19.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e27200700 1 --2- 172.21.15.49:0/413306452 >> v2:172.21.15.110:3300/0 conn(0x7f1e28151d30 0x7f1e280a44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e27200700 1 -- 172.21.15.49:0/413306452 >> v2:172.21.15.49:3300/0 conn(0x7f1e280bdc30 msgr2=0x7f1e280ac750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:19.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e27200700 1 --2- 172.21.15.49:0/413306452 >> v2:172.21.15.49:3300/0 conn(0x7f1e280bdc30 0x7f1e280ac750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e27200700 1 -- 172.21.15.49:0/413306452 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e280c33b0 con 0x7f1e280acc40 2024-01-22T05:05:19.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e27200700 1 --2- 172.21.15.49:0/413306452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e280acc40 0x7f1e280c4100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1e2805f490 tx=0x7f1e20009840).ready entity=mon.2 client_cookie=82ac50a8f317dbc9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:19.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e25400700 1 -- 172.21.15.49:0/413306452 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000e070 con 0x7f1e280acc40 2024-01-22T05:05:19.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e25400700 1 -- 172.21.15.49:0/413306452 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2000b970 con 0x7f1e280acc40 2024-01-22T05:05:19.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.728+0000 7f1e25400700 1 -- 172.21.15.49:0/413306452 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000bcf0 con 0x7f1e280acc40 2024-01-22T05:05:19.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.732+0000 7f1e2d400700 1 -- 172.21.15.49:0/413306452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e280acc40 msgr2=0x7f1e280c4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:19.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.732+0000 7f1e2d400700 1 --2- 172.21.15.49:0/413306452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e280acc40 0x7f1e280c4100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1e2805f490 tx=0x7f1e20009840).stop 2024-01-22T05:05:19.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.732+0000 7f1e2d400700 1 -- 172.21.15.49:0/413306452 shutdown_connections 2024-01-22T05:05:19.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.732+0000 7f1e2d400700 1 --2- 172.21.15.49:0/413306452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e280acc40 0x7f1e280c4100 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.732+0000 7f1e2d400700 1 --2- 172.21.15.49:0/413306452 >> v2:172.21.15.49:3300/0 conn(0x7f1e280bdc30 0x7f1e280ac750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.732+0000 7f1e2d400700 1 --2- 172.21.15.49:0/413306452 >> v2:172.21.15.110:3300/0 conn(0x7f1e28151d30 0x7f1e280a44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.732+0000 7f1e2d400700 1 -- 172.21.15.49:0/413306452 >> 172.21.15.49:0/413306452 conn(0x7f1e280aa700 msgr2=0x7f1e280aab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:19.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.732+0000 7f1e2d400700 1 -- 172.21.15.49:0/413306452 shutdown_connections 2024-01-22T05:05:19.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.732+0000 7f1e2d400700 1 -- 172.21.15.49:0/413306452 wait complete. 2024-01-22T05:05:19.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e2d400700 1 Processor -- start 2024-01-22T05:05:19.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e2d400700 1 -- start start 2024-01-22T05:05:19.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e2d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e280acc40 0x7f1e280a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:19.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e2d400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e280bdc30 0x7f1e2814dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:19.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e2d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e28151d30 0x7f1e280c0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:19.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e2d400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280a6990 con 0x7f1e280acc40 2024-01-22T05:05:19.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e2d400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280bf6f0 con 0x7f1e28151d30 2024-01-22T05:05:19.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e2d400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280bff90 con 0x7f1e280bdc30 2024-01-22T05:05:19.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e26800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e280acc40 0x7f1e280a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:19.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e26800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e280acc40 0x7f1e280a64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58104/0 (socket says 172.21.15.49:58104) 2024-01-22T05:05:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e26800700 1 -- 172.21.15.49:0/4172270332 learned_addr learned my addr 172.21.15.49:0/4172270332 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e27200700 1 --2- 172.21.15.49:0/4172270332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e28151d30 0x7f1e280c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e25e00700 1 --2- 172.21.15.49:0/4172270332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e280bdc30 0x7f1e2814dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e26800700 1 -- 172.21.15.49:0/4172270332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e280bdc30 msgr2=0x7f1e2814dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e26800700 1 --2- 172.21.15.49:0/4172270332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e280bdc30 0x7f1e2814dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e26800700 1 -- 172.21.15.49:0/4172270332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e28151d30 msgr2=0x7f1e280c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e26800700 1 --2- 172.21.15.49:0/4172270332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e28151d30 0x7f1e280c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e26800700 1 -- 172.21.15.49:0/4172270332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e20009ae0 con 0x7f1e280acc40 2024-01-22T05:05:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.736+0000 7f1e26800700 1 --2- 172.21.15.49:0/4172270332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e280acc40 0x7f1e280a64a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f1e1800e930 tx=0x7f1e18009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.740+0000 7f1e1e000700 1 -- 172.21.15.49:0/4172270332 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18012600 con 0x7f1e280acc40 2024-01-22T05:05:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.740+0000 7f1e1e000700 1 -- 172.21.15.49:0/4172270332 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e18012760 con 0x7f1e280acc40 2024-01-22T05:05:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.740+0000 7f1e2d400700 1 -- 172.21.15.49:0/4172270332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e280c5bd0 con 0x7f1e280acc40 2024-01-22T05:05:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.740+0000 7f1e1e000700 1 -- 172.21.15.49:0/4172270332 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18012ae0 con 0x7f1e280acc40 2024-01-22T05:05:19.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.740+0000 7f1e2d400700 1 -- 172.21.15.49:0/4172270332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e280bfc20 con 0x7f1e280acc40 2024-01-22T05:05:19.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.740+0000 7f1e2d400700 1 -- 172.21.15.49:0/4172270332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e28064990 con 0x7f1e280acc40 2024-01-22T05:05:19.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.740+0000 7f1e1e000700 1 -- 172.21.15.49:0/4172270332 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1e1801b400 con 0x7f1e280acc40 2024-01-22T05:05:19.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.744+0000 7f1e1e000700 1 --2- 172.21.15.49:0/4172270332 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e0005a510 0x7f1e0005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:19.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.744+0000 7f1e1e000700 1 -- 172.21.15.49:0/4172270332 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f1e18074d70 con 0x7f1e280acc40 2024-01-22T05:05:19.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.744+0000 7f1e25e00700 1 --2- 172.21.15.49:0/4172270332 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e0005a510 0x7f1e0005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:19.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.744+0000 7f1e25e00700 1 --2- 172.21.15.49:0/4172270332 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e0005a510 0x7f1e0005c9d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1e2814ffe0 tx=0x7f1e10009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:19.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.748+0000 7f1e1e000700 1 -- 172.21.15.49:0/4172270332 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1e180481e0 con 0x7f1e280acc40 2024-01-22T05:05:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.912+0000 7f1e2d400700 1 -- 172.21.15.49:0/4172270332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e28046800 con 0x7f1e280acc40 2024-01-22T05:05:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.912+0000 7f1e1e000700 1 -- 172.21.15.49:0/4172270332 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e1804b800 con 0x7f1e280acc40 2024-01-22T05:05:19.917 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:05:19.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.916+0000 7f1e2d400700 1 -- 172.21.15.49:0/4172270332 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e0005a510 msgr2=0x7f1e0005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:19.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.916+0000 7f1e2d400700 1 --2- 172.21.15.49:0/4172270332 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e0005a510 0x7f1e0005c9d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1e2814ffe0 tx=0x7f1e10009060).stop 2024-01-22T05:05:19.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.916+0000 7f1e2d400700 1 -- 172.21.15.49:0/4172270332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e280acc40 msgr2=0x7f1e280a64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:19.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.916+0000 7f1e2d400700 1 --2- 172.21.15.49:0/4172270332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e280acc40 0x7f1e280a64a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f1e1800e930 tx=0x7f1e18009060).stop 2024-01-22T05:05:19.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.916+0000 7f1e2d400700 1 -- 172.21.15.49:0/4172270332 shutdown_connections 2024-01-22T05:05:19.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.916+0000 7f1e2d400700 1 --2- 172.21.15.49:0/4172270332 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e0005a510 0x7f1e0005c9d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.916+0000 7f1e2d400700 1 --2- 172.21.15.49:0/4172270332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e28151d30 0x7f1e280c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.916+0000 7f1e2d400700 1 --2- 172.21.15.49:0/4172270332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e280bdc30 0x7f1e2814dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.916+0000 7f1e2d400700 1 --2- 172.21.15.49:0/4172270332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e280acc40 0x7f1e280a64a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:19.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.916+0000 7f1e2d400700 1 -- 172.21.15.49:0/4172270332 >> 172.21.15.49:0/4172270332 conn(0x7f1e280aa700 msgr2=0x7f1e28063160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:19.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.916+0000 7f1e2d400700 1 -- 172.21.15.49:0/4172270332 shutdown_connections 2024-01-22T05:05:19.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:19.916+0000 7f1e2d400700 1 -- 172.21.15.49:0/4172270332 wait complete. 2024-01-22T05:05:19.944 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-22T05:05:20.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.104+0000 7f7961600700 1 Processor -- start 2024-01-22T05:05:20.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.104+0000 7f7961600700 1 -- start start 2024-01-22T05:05:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.108+0000 7f7961600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f795c063e40 0x7f795c064280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.108+0000 7f7961600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f795c0bc610 0x7f795c0bca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.108+0000 7f7961600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795c0c33c0 con 0x7f795c069a70 2024-01-22T05:05:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.108+0000 7f7961600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795c0c27f0 con 0x7f795c0bc610 2024-01-22T05:05:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.108+0000 7f7961600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795c0c2540 con 0x7f795c063e40 2024-01-22T05:05:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.108+0000 7f795aa00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f795c069a70 0x7f795c153980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44808/0 (socket says 172.21.15.49:44808) 2024-01-22T05:05:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.108+0000 7f795aa00700 1 -- 172.21.15.49:0/3796363628 learned_addr learned my addr 172.21.15.49:0/3796363628 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.108+0000 7f795b400700 1 --2- 172.21.15.49:0/3796363628 >> v2:172.21.15.49:3300/0 conn(0x7f795c0bc610 0x7f795c0bca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.108+0000 7f795a000700 1 --2- 172.21.15.49:0/3796363628 >> v2:172.21.15.110:3300/0 conn(0x7f795c063e40 0x7f795c064280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f7959600700 1 -- 172.21.15.49:0/3796363628 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508268331 0 0) 0x7f795c0c33c0 con 0x7f795c069a70 2024-01-22T05:05:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f7959600700 1 -- 172.21.15.49:0/3796363628 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f793c0033f0 con 0x7f795c069a70 2024-01-22T05:05:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f795a000700 1 -- 172.21.15.49:0/3796363628 >> v2:172.21.15.49:3300/0 conn(0x7f795c0bc610 msgr2=0x7f795c0bca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f795a000700 1 --2- 172.21.15.49:0/3796363628 >> v2:172.21.15.49:3300/0 conn(0x7f795c0bc610 0x7f795c0bca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f795a000700 1 -- 172.21.15.49:0/3796363628 >> v1:172.21.15.49:6789/0 conn(0x7f795c069a70 legacy=0x7f795c153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f795a000700 1 -- 172.21.15.49:0/3796363628 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c064770 con 0x7f795c063e40 2024-01-22T05:05:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f795b400700 1 --2- 172.21.15.49:0/3796363628 >> v2:172.21.15.49:3300/0 conn(0x7f795c0bc610 0x7f795c0bca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f795a000700 1 --2- 172.21.15.49:0/3796363628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f795c063e40 0x7f795c064280 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f795c066340 tx=0x7f7944009060).ready entity=mon.1 client_cookie=c627ebb5b52b5eb6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f7959600700 1 -- 172.21.15.49:0/3796363628 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79440090d0 con 0x7f795c063e40 2024-01-22T05:05:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f7959600700 1 -- 172.21.15.49:0/3796363628 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794400d4a0 con 0x7f795c063e40 2024-01-22T05:05:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f7959600700 1 -- 172.21.15.49:0/3796363628 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794400d820 con 0x7f795c063e40 2024-01-22T05:05:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f7961600700 1 -- 172.21.15.49:0/3796363628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f795c063e40 msgr2=0x7f795c064280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f7961600700 1 --2- 172.21.15.49:0/3796363628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f795c063e40 0x7f795c064280 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f795c066340 tx=0x7f7944009060).stop 2024-01-22T05:05:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f7961600700 1 -- 172.21.15.49:0/3796363628 shutdown_connections 2024-01-22T05:05:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f7961600700 1 --2- 172.21.15.49:0/3796363628 >> v2:172.21.15.49:3300/0 conn(0x7f795c0bc610 0x7f795c0bca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f7961600700 1 --2- 172.21.15.49:0/3796363628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f795c063e40 0x7f795c064280 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f7961600700 1 -- 172.21.15.49:0/3796363628 >> 172.21.15.49:0/3796363628 conn(0x7f795c0c4150 msgr2=0x7f795c0c4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:20.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f7961600700 1 -- 172.21.15.49:0/3796363628 shutdown_connections 2024-01-22T05:05:20.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.112+0000 7f7961600700 1 -- 172.21.15.49:0/3796363628 wait complete. 2024-01-22T05:05:20.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.116+0000 7f7961600700 1 Processor -- start 2024-01-22T05:05:20.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.116+0000 7f7961600700 1 -- start start 2024-01-22T05:05:20.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.116+0000 7f7961600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c063e40 0x7f795c164980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f7961600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f795c069a70 0x7f795c14f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f7961600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f795c0bc610 0x7f795c1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f7961600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c0a9ac0 con 0x7f795c063e40 2024-01-22T05:05:20.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f7961600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c14fbf0 con 0x7f795c069a70 2024-01-22T05:05:20.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f7961600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795c1501b0 con 0x7f795c0bc610 2024-01-22T05:05:20.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f795aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c063e40 0x7f795c164980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f795aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c063e40 0x7f795c164980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58114/0 (socket says 172.21.15.49:58114) 2024-01-22T05:05:20.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f795aa00700 1 -- 172.21.15.49:0/1607159690 learned_addr learned my addr 172.21.15.49:0/1607159690 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:20.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f795a000700 1 --2- 172.21.15.49:0/1607159690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f795c069a70 0x7f795c14f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f795b400700 1 --2- 172.21.15.49:0/1607159690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f795c0bc610 0x7f795c1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f795aa00700 1 -- 172.21.15.49:0/1607159690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f795c0bc610 msgr2=0x7f795c1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f795aa00700 1 --2- 172.21.15.49:0/1607159690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f795c0bc610 0x7f795c1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f795aa00700 1 -- 172.21.15.49:0/1607159690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f795c069a70 msgr2=0x7f795c14f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f795aa00700 1 --2- 172.21.15.49:0/1607159690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f795c069a70 0x7f795c14f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f795aa00700 1 -- 172.21.15.49:0/1607159690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7954009a20 con 0x7f795c063e40 2024-01-22T05:05:20.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f795a000700 1 --2- 172.21.15.49:0/1607159690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f795c069a70 0x7f795c14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:20.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f795aa00700 1 --2- 172.21.15.49:0/1607159690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c063e40 0x7f795c164980 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f794c001ed0 tx=0x7f794c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:20.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f7952000700 1 -- 172.21.15.49:0/1607159690 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0072e0 con 0x7f795c063e40 2024-01-22T05:05:20.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f7952000700 1 -- 172.21.15.49:0/1607159690 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c007440 con 0x7f795c063e40 2024-01-22T05:05:20.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f7961600700 1 -- 172.21.15.49:0/1607159690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79440092a0 con 0x7f795c063e40 2024-01-22T05:05:20.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f7952000700 1 -- 172.21.15.49:0/1607159690 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0057a0 con 0x7f795c063e40 2024-01-22T05:05:20.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.120+0000 7f7961600700 1 -- 172.21.15.49:0/1607159690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c0a9f80 con 0x7f795c063e40 2024-01-22T05:05:20.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.124+0000 7f7961600700 1 -- 172.21.15.49:0/1607159690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c0657b0 con 0x7f795c063e40 2024-01-22T05:05:20.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.124+0000 7f7952000700 1 -- 172.21.15.49:0/1607159690 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f794c005b50 con 0x7f795c063e40 2024-01-22T05:05:20.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.128+0000 7f7952000700 1 --2- 172.21.15.49:0/1607159690 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f793405a540 0x7f793405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.128+0000 7f7952000700 1 -- 172.21.15.49:0/1607159690 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f794c074200 con 0x7f795c063e40 2024-01-22T05:05:20.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.128+0000 7f795a000700 1 --2- 172.21.15.49:0/1607159690 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f793405a540 0x7f793405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.128+0000 7f795a000700 1 --2- 172.21.15.49:0/1607159690 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f793405a540 0x7f793405ca00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f7944009fd0 tx=0x7f7944016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:20.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.132+0000 7f7952000700 1 -- 172.21.15.49:0/1607159690 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f794c0476d0 con 0x7f795c063e40 2024-01-22T05:05:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.296+0000 7f7961600700 1 -- 172.21.15.49:0/1607159690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f795c046800 con 0x7f795c063e40 2024-01-22T05:05:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.296+0000 7f7952000700 1 -- 172.21.15.49:0/1607159690 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f794c04acf0 con 0x7f795c063e40 2024-01-22T05:05:20.300 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-22T05:05:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.300+0000 7f7961600700 1 -- 172.21.15.49:0/1607159690 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f793405a540 msgr2=0x7f793405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.300+0000 7f7961600700 1 --2- 172.21.15.49:0/1607159690 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f793405a540 0x7f793405ca00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f7944009fd0 tx=0x7f7944016000).stop 2024-01-22T05:05:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.300+0000 7f7961600700 1 -- 172.21.15.49:0/1607159690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c063e40 msgr2=0x7f795c164980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.300+0000 7f7961600700 1 --2- 172.21.15.49:0/1607159690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c063e40 0x7f795c164980 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f794c001ed0 tx=0x7f794c007c70).stop 2024-01-22T05:05:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.300+0000 7f7961600700 1 -- 172.21.15.49:0/1607159690 shutdown_connections 2024-01-22T05:05:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.300+0000 7f7961600700 1 --2- 172.21.15.49:0/1607159690 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f793405a540 0x7f793405ca00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.300+0000 7f7961600700 1 --2- 172.21.15.49:0/1607159690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f795c0bc610 0x7f795c1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.300+0000 7f7961600700 1 --2- 172.21.15.49:0/1607159690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f795c069a70 0x7f795c14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.300+0000 7f7961600700 1 --2- 172.21.15.49:0/1607159690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c063e40 0x7f795c164980 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.300+0000 7f7961600700 1 -- 172.21.15.49:0/1607159690 >> 172.21.15.49:0/1607159690 conn(0x7f795c0c4150 msgr2=0x7f795c0c6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.300+0000 7f7961600700 1 -- 172.21.15.49:0/1607159690 shutdown_connections 2024-01-22T05:05:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.300+0000 7f7961600700 1 -- 172.21.15.49:0/1607159690 wait complete. 2024-01-22T05:05:20.328 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:05:20.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.488+0000 7f745ac00700 1 Processor -- start 2024-01-22T05:05:20.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.488+0000 7f745ac00700 1 -- start start 2024-01-22T05:05:20.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.488+0000 7f745ac00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74540a8740 0x7f74540a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.488+0000 7f745ac00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f74540c1ed0 0x7f74540c2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.488+0000 7f745ac00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74540c1a40 con 0x7f7454155d20 2024-01-22T05:05:20.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.488+0000 7f745ac00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74540a90b0 con 0x7f74540c1ed0 2024-01-22T05:05:20.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.488+0000 7f745ac00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7454159310 con 0x7f74540a8740 2024-01-22T05:05:20.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f7453400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74540a8740 0x7f74540a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f7458c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f74540c1ed0 0x7f74540c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f7453400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74540a8740 0x7f74540a8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:45852/0 (socket says 172.21.15.49:45852) 2024-01-22T05:05:20.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f7453400700 1 -- 172.21.15.49:0/270383734 learned_addr learned my addr 172.21.15.49:0/270383734 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:20.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f7453e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7454155d20 0x7f7454065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:47794/0 (socket says 172.21.15.49:47794) 2024-01-22T05:05:20.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f7453400700 1 -- 172.21.15.49:0/270383734 >> v2:172.21.15.110:3300/0 conn(0x7f74540c1ed0 msgr2=0x7f74540c2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:20.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f7453400700 1 --2- 172.21.15.49:0/270383734 >> v2:172.21.15.110:3300/0 conn(0x7f74540c1ed0 0x7f74540c2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f7453400700 1 -- 172.21.15.49:0/270383734 >> v1:172.21.15.110:6789/0 conn(0x7f7454155d20 legacy=0x7f7454065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f7453400700 1 -- 172.21.15.49:0/270383734 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74540c13f0 con 0x7f74540a8740 2024-01-22T05:05:20.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f7453400700 1 --2- 172.21.15.49:0/270383734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74540a8740 0x7f74540a8bc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f743c006fd0 tx=0x7f743c0090f0).ready entity=mon.2 client_cookie=7abaac3e001b4a0e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:20.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f7452a00700 1 -- 172.21.15.49:0/270383734 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c00b580 con 0x7f74540a8740 2024-01-22T05:05:20.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f7452a00700 1 -- 172.21.15.49:0/270383734 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c00b6e0 con 0x7f74540a8740 2024-01-22T05:05:20.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f7452a00700 1 -- 172.21.15.49:0/270383734 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c00ba60 con 0x7f74540a8740 2024-01-22T05:05:20.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f745ac00700 1 -- 172.21.15.49:0/270383734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74540a8740 msgr2=0x7f74540a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f745ac00700 1 --2- 172.21.15.49:0/270383734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74540a8740 0x7f74540a8bc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f743c006fd0 tx=0x7f743c0090f0).stop 2024-01-22T05:05:20.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f745ac00700 1 -- 172.21.15.49:0/270383734 shutdown_connections 2024-01-22T05:05:20.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f745ac00700 1 --2- 172.21.15.49:0/270383734 >> v2:172.21.15.110:3300/0 conn(0x7f74540c1ed0 0x7f74540c2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f745ac00700 1 --2- 172.21.15.49:0/270383734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74540a8740 0x7f74540a8bc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.492+0000 7f745ac00700 1 -- 172.21.15.49:0/270383734 >> 172.21.15.49:0/270383734 conn(0x7f74540c6540 msgr2=0x7f74540c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:20.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.496+0000 7f745ac00700 1 -- 172.21.15.49:0/270383734 shutdown_connections 2024-01-22T05:05:20.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.496+0000 7f745ac00700 1 -- 172.21.15.49:0/270383734 wait complete. 2024-01-22T05:05:20.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.496+0000 7f745ac00700 1 Processor -- start 2024-01-22T05:05:20.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.496+0000 7f745ac00700 1 -- start start 2024-01-22T05:05:20.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f745ac00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74540a8740 0x7f7454153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f745ac00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74540c1ed0 0x7f7454149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f745ac00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7454155d20 0x7f7454159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f745ac00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7454152d60 con 0x7f7454155d20 2024-01-22T05:05:20.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f745ac00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7454149930 con 0x7f74540c1ed0 2024-01-22T05:05:20.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f745ac00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7454152730 con 0x7f74540a8740 2024-01-22T05:05:20.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f7458c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7454155d20 0x7f7454159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f7458c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7454155d20 0x7f7454159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58128/0 (socket says 172.21.15.49:58128) 2024-01-22T05:05:20.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f7458c00700 1 -- 172.21.15.49:0/1336802080 learned_addr learned my addr 172.21.15.49:0/1336802080 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:20.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f7453e00700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74540a8740 0x7f7454153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f7453400700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74540c1ed0 0x7f7454149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f7458c00700 1 -- 172.21.15.49:0/1336802080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74540a8740 msgr2=0x7f7454153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f7458c00700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74540a8740 0x7f7454153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f7458c00700 1 -- 172.21.15.49:0/1336802080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74540c1ed0 msgr2=0x7f7454149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f7458c00700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74540c1ed0 0x7f7454149440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f7458c00700 1 -- 172.21.15.49:0/1336802080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c009370 con 0x7f7454155d20 2024-01-22T05:05:20.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f7453400700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74540c1ed0 0x7f7454149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:20.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f7453e00700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74540a8740 0x7f7454153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:20.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f7458c00700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7454155d20 0x7f7454159510 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f744c009e90 tx=0x7f744c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:20.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f744b400700 1 -- 172.21.15.49:0/1336802080 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c00cc20 con 0x7f7454155d20 2024-01-22T05:05:20.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f744b400700 1 -- 172.21.15.49:0/1336802080 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c00f040 con 0x7f7454155d20 2024-01-22T05:05:20.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f745ac00700 1 -- 172.21.15.49:0/1336802080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7454159ef0 con 0x7f7454155d20 2024-01-22T05:05:20.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.500+0000 7f744b400700 1 -- 172.21.15.49:0/1336802080 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c013400 con 0x7f7454155d20 2024-01-22T05:05:20.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.504+0000 7f745ac00700 1 -- 172.21.15.49:0/1336802080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7454152980 con 0x7f7454155d20 2024-01-22T05:05:20.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.504+0000 7f745ac00700 1 -- 172.21.15.49:0/1336802080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7454152ea0 con 0x7f7454155d20 2024-01-22T05:05:20.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.504+0000 7f744b400700 1 -- 172.21.15.49:0/1336802080 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f744c013770 con 0x7f7454155d20 2024-01-22T05:05:20.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.508+0000 7f744b400700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f742c05a510 0x7f742c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.508+0000 7f744b400700 1 -- 172.21.15.49:0/1336802080 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f744c0754b0 con 0x7f7454155d20 2024-01-22T05:05:20.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.508+0000 7f7453e00700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f742c05a510 0x7f742c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.508+0000 7f7453e00700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f742c05a510 0x7f742c05c9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f74440076b0 tx=0x7f7444007c00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:20.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.512+0000 7f744b400700 1 -- 172.21.15.49:0/1336802080 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7454152ea0 con 0x7f7454155d20 2024-01-22T05:05:20.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.676+0000 7f745ac00700 1 -- 172.21.15.49:0/1336802080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7454152ea0 con 0x7f7454155d20 2024-01-22T05:05:20.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.680+0000 7f744b400700 1 -- 172.21.15.49:0/1336802080 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f7454152ea0 con 0x7f7454155d20 2024-01-22T05:05:20.683 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:20.684 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:04:39.526211+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:05:20.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.680+0000 7f745ac00700 1 -- 172.21.15.49:0/1336802080 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f742c05a510 msgr2=0x7f742c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.680+0000 7f745ac00700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f742c05a510 0x7f742c05c9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f74440076b0 tx=0x7f7444007c00).stop 2024-01-22T05:05:20.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.680+0000 7f745ac00700 1 -- 172.21.15.49:0/1336802080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7454155d20 msgr2=0x7f7454159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.680+0000 7f745ac00700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7454155d20 0x7f7454159510 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f744c009e90 tx=0x7f744c00b040).stop 2024-01-22T05:05:20.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.684+0000 7f745ac00700 1 -- 172.21.15.49:0/1336802080 shutdown_connections 2024-01-22T05:05:20.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.684+0000 7f745ac00700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f742c05a510 0x7f742c05c9d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.684+0000 7f745ac00700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7454155d20 0x7f7454159510 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.684+0000 7f745ac00700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74540c1ed0 0x7f7454149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.684+0000 7f745ac00700 1 --2- 172.21.15.49:0/1336802080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74540a8740 0x7f7454153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.684+0000 7f745ac00700 1 -- 172.21.15.49:0/1336802080 >> 172.21.15.49:0/1336802080 conn(0x7f74540c6540 msgr2=0x7f74540c25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:20.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.684+0000 7f745ac00700 1 -- 172.21.15.49:0/1336802080 shutdown_connections 2024-01-22T05:05:20.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.684+0000 7f745ac00700 1 -- 172.21.15.49:0/1336802080 wait complete. 2024-01-22T05:05:20.708 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:04:32.991898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:04:34.057128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-22T05:04:37.108860+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:05:20.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:05:20.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.868+0000 7f86ece00700 1 Processor -- start 2024-01-22T05:05:20.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.872+0000 7f86ece00700 1 -- start start 2024-01-22T05:05:20.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86ece00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86e81581b0 0x7f86e8068c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86ece00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f86e8069150 0x7f86e8062aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86ece00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e80687d0 con 0x7f86e8062f90 2024-01-22T05:05:20.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86ece00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e80633c0 con 0x7f86e81581b0 2024-01-22T05:05:20.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86ece00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e8067bc0 con 0x7f86e8069150 2024-01-22T05:05:20.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86e7400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86e81581b0 0x7f86e8068c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86e7400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86e81581b0 0x7f86e8068c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58136/0 (socket says 172.21.15.49:58136) 2024-01-22T05:05:20.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86e7400700 1 -- 172.21.15.49:0/2879460695 learned_addr learned my addr 172.21.15.49:0/2879460695 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:20.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86e7400700 1 -- 172.21.15.49:0/2879460695 >> v2:172.21.15.110:3300/0 conn(0x7f86e8069150 msgr2=0x7f86e8062aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:20.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86e6a00700 1 --2- 172.21.15.49:0/2879460695 >> v2:172.21.15.110:3300/0 conn(0x7f86e8069150 0x7f86e8062aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86e7400700 1 --2- 172.21.15.49:0/2879460695 >> v2:172.21.15.110:3300/0 conn(0x7f86e8069150 0x7f86e8062aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86e7400700 1 -- 172.21.15.49:0/2879460695 >> v1:172.21.15.49:6789/0 conn(0x7f86e8062f90 legacy=0x7f86e80c31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86e7400700 1 -- 172.21.15.49:0/2879460695 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e8067ea0 con 0x7f86e81581b0 2024-01-22T05:05:20.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86e6000700 1 -- 172.21.15.49:0/2879460695 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795433523 0 0) 0x7f86e80687d0 con 0x7f86e8062f90 2024-01-22T05:05:20.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86e6a00700 1 --2- 172.21.15.49:0/2879460695 >> v2:172.21.15.110:3300/0 conn(0x7f86e8069150 0x7f86e8062aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:05:20.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86e7400700 1 --2- 172.21.15.49:0/2879460695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e81581b0 0x7f86e8068c60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f86e806a930 tx=0x7f86d80090f0).ready entity=mon.0 client_cookie=da84922d0122b8a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:20.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86e6000700 1 -- 172.21.15.49:0/2879460695 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d800b600 con 0x7f86e81581b0 2024-01-22T05:05:20.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86e6000700 1 -- 172.21.15.49:0/2879460695 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d800b760 con 0x7f86e81581b0 2024-01-22T05:05:20.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86e6000700 1 -- 172.21.15.49:0/2879460695 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d800bae0 con 0x7f86e81581b0 2024-01-22T05:05:20.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86ece00700 1 -- 172.21.15.49:0/2879460695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e81581b0 msgr2=0x7f86e8068c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86ece00700 1 --2- 172.21.15.49:0/2879460695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e81581b0 0x7f86e8068c60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f86e806a930 tx=0x7f86d80090f0).stop 2024-01-22T05:05:20.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86ece00700 1 -- 172.21.15.49:0/2879460695 shutdown_connections 2024-01-22T05:05:20.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86ece00700 1 --2- 172.21.15.49:0/2879460695 >> v2:172.21.15.110:3300/0 conn(0x7f86e8069150 0x7f86e8062aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86ece00700 1 --2- 172.21.15.49:0/2879460695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e81581b0 0x7f86e8068c60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.876+0000 7f86ece00700 1 -- 172.21.15.49:0/2879460695 >> 172.21.15.49:0/2879460695 conn(0x7f86e80c8740 msgr2=0x7f86e80c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:20.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.880+0000 7f86ece00700 1 -- 172.21.15.49:0/2879460695 shutdown_connections 2024-01-22T05:05:20.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.880+0000 7f86ece00700 1 -- 172.21.15.49:0/2879460695 wait complete. 2024-01-22T05:05:20.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.880+0000 7f86ece00700 1 Processor -- start 2024-01-22T05:05:20.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.880+0000 7f86ece00700 1 -- start start 2024-01-22T05:05:20.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86ece00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e8062f90 0x7f86e81529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86ece00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e8069150 0x7f86e80c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86ece00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e81581b0 0x7f86e815a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86ece00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e8153ca0 con 0x7f86e81581b0 2024-01-22T05:05:20.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86ece00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e8154820 con 0x7f86e8062f90 2024-01-22T05:05:20.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86ece00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e8153ef0 con 0x7f86e8069150 2024-01-22T05:05:20.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86e7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e81581b0 0x7f86e815a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86e7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e81581b0 0x7f86e815a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58152/0 (socket says 172.21.15.49:58152) 2024-01-22T05:05:20.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86e7e00700 1 -- 172.21.15.49:0/1893545340 learned_addr learned my addr 172.21.15.49:0/1893545340 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:20.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86e7400700 1 --2- 172.21.15.49:0/1893545340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e8062f90 0x7f86e81529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86e6a00700 1 --2- 172.21.15.49:0/1893545340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e8069150 0x7f86e80c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86e7e00700 1 -- 172.21.15.49:0/1893545340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e8069150 msgr2=0x7f86e80c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86e7e00700 1 --2- 172.21.15.49:0/1893545340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e8069150 0x7f86e80c0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86e7e00700 1 -- 172.21.15.49:0/1893545340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e8062f90 msgr2=0x7f86e81529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:20.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86e7e00700 1 --2- 172.21.15.49:0/1893545340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e8062f90 0x7f86e81529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:20.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86e7e00700 1 -- 172.21.15.49:0/1893545340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d8009370 con 0x7f86e81581b0 2024-01-22T05:05:20.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86e6a00700 1 --2- 172.21.15.49:0/1893545340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e8069150 0x7f86e80c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:20.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86e7e00700 1 --2- 172.21.15.49:0/1893545340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e81581b0 0x7f86e815a6e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f86e0002230 tx=0x7f86e0007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:20.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86dea00700 1 -- 172.21.15.49:0/1893545340 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0010510 con 0x7f86e81581b0 2024-01-22T05:05:20.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86dea00700 1 -- 172.21.15.49:0/1893545340 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e0010670 con 0x7f86e81581b0 2024-01-22T05:05:20.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86ece00700 1 -- 172.21.15.49:0/1893545340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e81541d0 con 0x7f86e81581b0 2024-01-22T05:05:20.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86dea00700 1 -- 172.21.15.49:0/1893545340 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0010a10 con 0x7f86e81581b0 2024-01-22T05:05:20.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.884+0000 7f86ece00700 1 -- 172.21.15.49:0/1893545340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e8152ed0 con 0x7f86e81581b0 2024-01-22T05:05:20.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.888+0000 7f86ece00700 1 -- 172.21.15.49:0/1893545340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e8154990 con 0x7f86e81581b0 2024-01-22T05:05:20.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.888+0000 7f86dea00700 1 -- 172.21.15.49:0/1893545340 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f86e001b400 con 0x7f86e81581b0 2024-01-22T05:05:20.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.892+0000 7f86dea00700 1 --2- 172.21.15.49:0/1893545340 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86c005a510 0x7f86c005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:20.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.892+0000 7f86dea00700 1 -- 172.21.15.49:0/1893545340 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f86e0074990 con 0x7f86e81581b0 2024-01-22T05:05:20.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.892+0000 7f86e7400700 1 --2- 172.21.15.49:0/1893545340 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86c005a510 0x7f86c005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:20.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.892+0000 7f86e7400700 1 --2- 172.21.15.49:0/1893545340 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86c005a510 0x7f86c005c9d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f86d8009130 tx=0x7f86d8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:20.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:20.896+0000 7f86dea00700 1 -- 172.21.15.49:0/1893545340 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f86e0047d40 con 0x7f86e81581b0 2024-01-22T05:05:21.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.056+0000 7f86ece00700 1 -- 172.21.15.49:0/1893545340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f86e8066520 con 0x7f86e81581b0 2024-01-22T05:05:21.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.056+0000 7f86dea00700 1 -- 172.21.15.49:0/1893545340 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f86e004b360 con 0x7f86e81581b0 2024-01-22T05:05:21.061 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:05:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.064+0000 7f86ece00700 1 -- 172.21.15.49:0/1893545340 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86c005a510 msgr2=0x7f86c005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.064+0000 7f86ece00700 1 --2- 172.21.15.49:0/1893545340 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86c005a510 0x7f86c005c9d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f86d8009130 tx=0x7f86d8017000).stop 2024-01-22T05:05:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.064+0000 7f86ece00700 1 -- 172.21.15.49:0/1893545340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e81581b0 msgr2=0x7f86e815a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.064+0000 7f86ece00700 1 --2- 172.21.15.49:0/1893545340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e81581b0 0x7f86e815a6e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f86e0002230 tx=0x7f86e0007f70).stop 2024-01-22T05:05:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.064+0000 7f86ece00700 1 -- 172.21.15.49:0/1893545340 shutdown_connections 2024-01-22T05:05:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.064+0000 7f86ece00700 1 --2- 172.21.15.49:0/1893545340 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86c005a510 0x7f86c005c9d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.064+0000 7f86ece00700 1 --2- 172.21.15.49:0/1893545340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e81581b0 0x7f86e815a6e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.064+0000 7f86ece00700 1 --2- 172.21.15.49:0/1893545340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e8069150 0x7f86e80c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.064+0000 7f86ece00700 1 --2- 172.21.15.49:0/1893545340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e8062f90 0x7f86e81529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.064+0000 7f86ece00700 1 -- 172.21.15.49:0/1893545340 >> 172.21.15.49:0/1893545340 conn(0x7f86e80c8740 msgr2=0x7f86e80c77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.064+0000 7f86ece00700 1 -- 172.21.15.49:0/1893545340 shutdown_connections 2024-01-22T05:05:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.064+0000 7f86ece00700 1 -- 172.21.15.49:0/1893545340 wait complete. 2024-01-22T05:05:21.088 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:05:21.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.252+0000 7f9985600700 1 Processor -- start 2024-01-22T05:05:21.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.252+0000 7f9985600700 1 -- start start 2024-01-22T05:05:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.256+0000 7f9985600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99800a7e60 0x7f99801554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.256+0000 7f9985600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99801559c0 0x7f99800aa750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.256+0000 7f9985600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99800bdc70 con 0x7f9980068460 2024-01-22T05:05:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.256+0000 7f9985600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99800bd9d0 con 0x7f99800a7e60 2024-01-22T05:05:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.256+0000 7f9985600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9980155e50 con 0x7f99801559c0 2024-01-22T05:05:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.256+0000 7f997e000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99800a7e60 0x7f99801554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.256+0000 7f997ea00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9980068460 0x7f99800a7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:47806/0 (socket says 172.21.15.49:47806) 2024-01-22T05:05:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.256+0000 7f997ea00700 1 -- 172.21.15.49:0/2638293941 learned_addr learned my addr 172.21.15.49:0/2638293941 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.256+0000 7f997f400700 1 --2- 172.21.15.49:0/2638293941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99801559c0 0x7f99800aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.256+0000 7f997d600700 1 -- 172.21.15.49:0/2638293941 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916084545 0 0) 0x7f99800bdc70 con 0x7f9980068460 2024-01-22T05:05:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.256+0000 7f997e000700 1 -- 172.21.15.49:0/2638293941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99801559c0 msgr2=0x7f99800aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.256+0000 7f997e000700 1 --2- 172.21.15.49:0/2638293941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99801559c0 0x7f99800aa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.256+0000 7f997e000700 1 -- 172.21.15.49:0/2638293941 >> v1:172.21.15.110:6789/0 conn(0x7f9980068460 legacy=0x7f99800a7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.256+0000 7f997e000700 1 -- 172.21.15.49:0/2638293941 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99800c4040 con 0x7f99800a7e60 2024-01-22T05:05:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.256+0000 7f997e000700 1 --2- 172.21.15.49:0/2638293941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99800a7e60 0x7f99801554d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9968009760 tx=0x7f9968009060).ready entity=mon.1 client_cookie=f8747bc0ed0359c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:21.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.260+0000 7f997d600700 1 -- 172.21.15.49:0/2638293941 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996800f510 con 0x7f99800a7e60 2024-01-22T05:05:21.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.260+0000 7f997d600700 1 -- 172.21.15.49:0/2638293941 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996800f670 con 0x7f99800a7e60 2024-01-22T05:05:21.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.260+0000 7f997d600700 1 -- 172.21.15.49:0/2638293941 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996800f9f0 con 0x7f99800a7e60 2024-01-22T05:05:21.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.260+0000 7f9985600700 1 -- 172.21.15.49:0/2638293941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99800a7e60 msgr2=0x7f99801554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:21.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.260+0000 7f9985600700 1 --2- 172.21.15.49:0/2638293941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99800a7e60 0x7f99801554d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9968009760 tx=0x7f9968009060).stop 2024-01-22T05:05:21.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.260+0000 7f9985600700 1 -- 172.21.15.49:0/2638293941 shutdown_connections 2024-01-22T05:05:21.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.260+0000 7f9985600700 1 --2- 172.21.15.49:0/2638293941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99801559c0 0x7f99800aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.260+0000 7f9985600700 1 --2- 172.21.15.49:0/2638293941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99800a7e60 0x7f99801554d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.260+0000 7f9985600700 1 -- 172.21.15.49:0/2638293941 >> 172.21.15.49:0/2638293941 conn(0x7f99800c8780 msgr2=0x7f99800c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:21.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.260+0000 7f9985600700 1 -- 172.21.15.49:0/2638293941 shutdown_connections 2024-01-22T05:05:21.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.260+0000 7f9985600700 1 -- 172.21.15.49:0/2638293941 wait complete. 2024-01-22T05:05:21.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.264+0000 7f9985600700 1 Processor -- start 2024-01-22T05:05:21.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.264+0000 7f9985600700 1 -- start start 2024-01-22T05:05:21.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f9985600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9980068460 0x7f99800ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:21.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f9985600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99800a7e60 0x7f99800acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:21.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f9985600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99801559c0 0x7f998014cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:21.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f9985600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99800ac7c0 con 0x7f99800a7e60 2024-01-22T05:05:21.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f9985600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99800ad2e0 con 0x7f99801559c0 2024-01-22T05:05:21.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f9985600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99800ad560 con 0x7f9980068460 2024-01-22T05:05:21.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f997e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99800a7e60 0x7f99800acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:21.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f997e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99800a7e60 0x7f99800acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58158/0 (socket says 172.21.15.49:58158) 2024-01-22T05:05:21.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f997e000700 1 -- 172.21.15.49:0/2817686880 learned_addr learned my addr 172.21.15.49:0/2817686880 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:21.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f997ea00700 1 --2- 172.21.15.49:0/2817686880 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9980068460 0x7f99800ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:21.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f997f400700 1 --2- 172.21.15.49:0/2817686880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99801559c0 0x7f998014cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:21.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f997e000700 1 -- 172.21.15.49:0/2817686880 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9980068460 msgr2=0x7f99800ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:21.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f997e000700 1 --2- 172.21.15.49:0/2817686880 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9980068460 0x7f99800ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f997e000700 1 -- 172.21.15.49:0/2817686880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99801559c0 msgr2=0x7f998014cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:21.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f997e000700 1 --2- 172.21.15.49:0/2817686880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99801559c0 0x7f998014cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f997e000700 1 -- 172.21.15.49:0/2817686880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680092a0 con 0x7f99800a7e60 2024-01-22T05:05:21.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f997e000700 1 --2- 172.21.15.49:0/2817686880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99800a7e60 0x7f99800acdf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f9968009e00 tx=0x7f9968017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:21.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f9976000700 1 -- 172.21.15.49:0/2817686880 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996800f7e0 con 0x7f99800a7e60 2024-01-22T05:05:21.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f9976000700 1 -- 172.21.15.49:0/2817686880 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996800f940 con 0x7f99800a7e60 2024-01-22T05:05:21.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f9976000700 1 -- 172.21.15.49:0/2817686880 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996801b660 con 0x7f99800a7e60 2024-01-22T05:05:21.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f9985600700 1 -- 172.21.15.49:0/2817686880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99800ad840 con 0x7f99800a7e60 2024-01-22T05:05:21.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.268+0000 7f9985600700 1 -- 172.21.15.49:0/2817686880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9980062510 con 0x7f99800a7e60 2024-01-22T05:05:21.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.272+0000 7f9985600700 1 -- 172.21.15.49:0/2817686880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9980069240 con 0x7f99800a7e60 2024-01-22T05:05:21.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.272+0000 7f9976000700 1 -- 172.21.15.49:0/2817686880 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f996801ba50 con 0x7f99800a7e60 2024-01-22T05:05:21.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.276+0000 7f9976000700 1 --2- 172.21.15.49:0/2817686880 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f995805a4e0 0x7f995805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:21.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.276+0000 7f9976000700 1 -- 172.21.15.49:0/2817686880 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f9968076550 con 0x7f99800a7e60 2024-01-22T05:05:21.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.276+0000 7f997ea00700 1 --2- 172.21.15.49:0/2817686880 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f995805a4e0 0x7f995805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:21.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.276+0000 7f997ea00700 1 --2- 172.21.15.49:0/2817686880 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f995805a4e0 0x7f995805c9a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f9970007fd0 tx=0x7f9970007dd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:21.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.280+0000 7f9976000700 1 -- 172.21.15.49:0/2817686880 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9968049a50 con 0x7f99800a7e60 2024-01-22T05:05:21.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.440+0000 7f9985600700 1 -- 172.21.15.49:0/2817686880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9980046800 con 0x7f99800a7e60 2024-01-22T05:05:21.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.444+0000 7f9976000700 1 -- 172.21.15.49:0/2817686880 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9968028020 con 0x7f99800a7e60 2024-01-22T05:05:21.446 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:05:21.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.444+0000 7f9985600700 1 -- 172.21.15.49:0/2817686880 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f995805a4e0 msgr2=0x7f995805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:21.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.444+0000 7f9985600700 1 --2- 172.21.15.49:0/2817686880 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f995805a4e0 0x7f995805c9a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f9970007fd0 tx=0x7f9970007dd0).stop 2024-01-22T05:05:21.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.444+0000 7f9985600700 1 -- 172.21.15.49:0/2817686880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99800a7e60 msgr2=0x7f99800acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:21.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.444+0000 7f9985600700 1 --2- 172.21.15.49:0/2817686880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99800a7e60 0x7f99800acdf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f9968009e00 tx=0x7f9968017000).stop 2024-01-22T05:05:21.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.448+0000 7f9985600700 1 -- 172.21.15.49:0/2817686880 shutdown_connections 2024-01-22T05:05:21.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.448+0000 7f9985600700 1 --2- 172.21.15.49:0/2817686880 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f995805a4e0 0x7f995805c9a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.448+0000 7f9985600700 1 --2- 172.21.15.49:0/2817686880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99801559c0 0x7f998014cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.448+0000 7f9985600700 1 --2- 172.21.15.49:0/2817686880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99800a7e60 0x7f99800acdf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.448+0000 7f9985600700 1 --2- 172.21.15.49:0/2817686880 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9980068460 0x7f99800ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.448+0000 7f9985600700 1 -- 172.21.15.49:0/2817686880 >> 172.21.15.49:0/2817686880 conn(0x7f99800c8780 msgr2=0x7f99800c3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:21.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.448+0000 7f9985600700 1 -- 172.21.15.49:0/2817686880 shutdown_connections 2024-01-22T05:05:21.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.448+0000 7f9985600700 1 -- 172.21.15.49:0/2817686880 wait complete. 2024-01-22T05:05:21.472 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:05:21.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.640+0000 7f4c9b800700 1 Processor -- start 2024-01-22T05:05:21.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.640+0000 7f4c9b800700 1 -- start start 2024-01-22T05:05:21.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.644+0000 7f4c9b800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4c940c1ce0 0x7f4c940bc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:21.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.644+0000 7f4c9b800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c940bc980 0x7f4c94068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:21.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.644+0000 7f4c9b800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c94068280 con 0x7f4c94153cf0 2024-01-22T05:05:21.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.644+0000 7f4c9b800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c940bd190 con 0x7f4c940bc980 2024-01-22T05:05:21.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.644+0000 7f4c9b800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c94067c30 con 0x7f4c940c1ce0 2024-01-22T05:05:21.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.644+0000 7f4c99800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c940bc980 0x7f4c94068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:21.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.644+0000 7f4c99800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c940bc980 0x7f4c94068710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58166/0 (socket says 172.21.15.49:58166) 2024-01-22T05:05:21.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.644+0000 7f4c99800700 1 -- 172.21.15.49:0/2242015944 learned_addr learned my addr 172.21.15.49:0/2242015944 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:21.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c93e00700 1 --2- 172.21.15.49:0/2242015944 >> v2:172.21.15.110:3300/0 conn(0x7f4c940c1ce0 0x7f4c940bc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:21.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c99800700 1 -- 172.21.15.49:0/2242015944 >> v2:172.21.15.110:3300/0 conn(0x7f4c940c1ce0 msgr2=0x7f4c940bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c99800700 1 --2- 172.21.15.49:0/2242015944 >> v2:172.21.15.110:3300/0 conn(0x7f4c940c1ce0 0x7f4c940bc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c99800700 1 -- 172.21.15.49:0/2242015944 >> v1:172.21.15.110:6789/0 conn(0x7f4c94153cf0 legacy=0x7f4c940c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c99800700 1 -- 172.21.15.49:0/2242015944 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c94067f10 con 0x7f4c940bc980 2024-01-22T05:05:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c93e00700 1 --2- 172.21.15.49:0/2242015944 >> v2:172.21.15.110:3300/0 conn(0x7f4c940c1ce0 0x7f4c940bc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:05:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c99800700 1 --2- 172.21.15.49:0/2242015944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c940bc980 0x7f4c94068710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f4c94064b20 tx=0x7f4c8c009840).ready entity=mon.0 client_cookie=b5fecf4d7fbf5cc6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c93400700 1 -- 172.21.15.49:0/2242015944 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c00e070 con 0x7f4c940bc980 2024-01-22T05:05:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c93400700 1 -- 172.21.15.49:0/2242015944 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c00bae0 con 0x7f4c940bc980 2024-01-22T05:05:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c93400700 1 -- 172.21.15.49:0/2242015944 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c00be60 con 0x7f4c940bc980 2024-01-22T05:05:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c9b800700 1 -- 172.21.15.49:0/2242015944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c940bc980 msgr2=0x7f4c94068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c9b800700 1 --2- 172.21.15.49:0/2242015944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c940bc980 0x7f4c94068710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f4c94064b20 tx=0x7f4c8c009840).stop 2024-01-22T05:05:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c9b800700 1 -- 172.21.15.49:0/2242015944 shutdown_connections 2024-01-22T05:05:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c9b800700 1 --2- 172.21.15.49:0/2242015944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c940bc980 0x7f4c94068710 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c9b800700 1 --2- 172.21.15.49:0/2242015944 >> v2:172.21.15.110:3300/0 conn(0x7f4c940c1ce0 0x7f4c940bc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c9b800700 1 -- 172.21.15.49:0/2242015944 >> 172.21.15.49:0/2242015944 conn(0x7f4c94062cb0 msgr2=0x7f4c940c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c9b800700 1 -- 172.21.15.49:0/2242015944 shutdown_connections 2024-01-22T05:05:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.648+0000 7f4c9b800700 1 -- 172.21.15.49:0/2242015944 wait complete. 2024-01-22T05:05:21.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.652+0000 7f4c9b800700 1 Processor -- start 2024-01-22T05:05:21.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.652+0000 7f4c9b800700 1 -- start start 2024-01-22T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c9b800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c940bc980 0x7f4c9413e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c9b800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c940c1ce0 0x7f4c9413f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c9b800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c94153cf0 0x7f4c9413f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c9b800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c941527d0 con 0x7f4c94153cf0 2024-01-22T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c9b800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c941408b0 con 0x7f4c940c1ce0 2024-01-22T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c9b800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9413fca0 con 0x7f4c940bc980 2024-01-22T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c99800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c94153cf0 0x7f4c9413f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c93e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c940c1ce0 0x7f4c9413f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c99800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c94153cf0 0x7f4c9413f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58182/0 (socket says 172.21.15.49:58182) 2024-01-22T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c99800700 1 -- 172.21.15.49:0/1000095185 learned_addr learned my addr 172.21.15.49:0/1000095185 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c98e00700 1 --2- 172.21.15.49:0/1000095185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c940bc980 0x7f4c9413e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c93e00700 1 -- 172.21.15.49:0/1000095185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c940bc980 msgr2=0x7f4c9413e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c93e00700 1 --2- 172.21.15.49:0/1000095185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c940bc980 0x7f4c9413e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c93e00700 1 -- 172.21.15.49:0/1000095185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c94153cf0 msgr2=0x7f4c9413f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c93e00700 1 --2- 172.21.15.49:0/1000095185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c94153cf0 0x7f4c9413f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c93e00700 1 -- 172.21.15.49:0/1000095185 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c009ae0 con 0x7f4c940c1ce0 2024-01-22T05:05:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c99800700 1 --2- 172.21.15.49:0/1000095185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c94153cf0 0x7f4c9413f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c93e00700 1 --2- 172.21.15.49:0/1000095185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c940c1ce0 0x7f4c9413f130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f4c7c00c670 tx=0x7f4c7c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c8be00700 1 -- 172.21.15.49:0/1000095185 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c015070 con 0x7f4c940c1ce0 2024-01-22T05:05:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c8be00700 1 -- 172.21.15.49:0/1000095185 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c010580 con 0x7f4c940c1ce0 2024-01-22T05:05:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c9b800700 1 -- 172.21.15.49:0/1000095185 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9413ff80 con 0x7f4c940c1ce0 2024-01-22T05:05:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c8be00700 1 -- 172.21.15.49:0/1000095185 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c010900 con 0x7f4c940c1ce0 2024-01-22T05:05:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.656+0000 7f4c9b800700 1 -- 172.21.15.49:0/1000095185 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c94140540 con 0x7f4c940c1ce0 2024-01-22T05:05:21.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.660+0000 7f4c9b800700 1 -- 172.21.15.49:0/1000095185 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c94140a60 con 0x7f4c940c1ce0 2024-01-22T05:05:21.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.660+0000 7f4c8be00700 1 -- 172.21.15.49:0/1000095185 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4c7c010d30 con 0x7f4c940c1ce0 2024-01-22T05:05:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.660+0000 7f4c8be00700 1 --2- 172.21.15.49:0/1000095185 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c6c05a510 0x7f4c6c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.660+0000 7f4c8be00700 1 -- 172.21.15.49:0/1000095185 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f4c7c074270 con 0x7f4c940c1ce0 2024-01-22T05:05:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.660+0000 7f4c98e00700 1 --2- 172.21.15.49:0/1000095185 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c6c05a510 0x7f4c6c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.664+0000 7f4c98e00700 1 --2- 172.21.15.49:0/1000095185 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c6c05a510 0x7f4c6c05c9d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f4c84003860 tx=0x7f4c84007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:21.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.668+0000 7f4c8be00700 1 -- 172.21.15.49:0/1000095185 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c94140a60 con 0x7f4c940c1ce0 2024-01-22T05:05:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.832+0000 7f4c9b800700 1 -- 172.21.15.49:0/1000095185 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c941409f0 con 0x7f4c940c1ce0 2024-01-22T05:05:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.836+0000 7f4c8be00700 1 -- 172.21.15.49:0/1000095185 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c7c047740 con 0x7f4c940c1ce0 2024-01-22T05:05:21.839 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:05:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.836+0000 7f4c9b800700 1 -- 172.21.15.49:0/1000095185 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c6c05a510 msgr2=0x7f4c6c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.836+0000 7f4c9b800700 1 --2- 172.21.15.49:0/1000095185 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c6c05a510 0x7f4c6c05c9d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f4c84003860 tx=0x7f4c84007d40).stop 2024-01-22T05:05:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.840+0000 7f4c9b800700 1 -- 172.21.15.49:0/1000095185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c940c1ce0 msgr2=0x7f4c9413f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.840+0000 7f4c9b800700 1 --2- 172.21.15.49:0/1000095185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c940c1ce0 0x7f4c9413f130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f4c7c00c670 tx=0x7f4c7c008040).stop 2024-01-22T05:05:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.840+0000 7f4c9b800700 1 -- 172.21.15.49:0/1000095185 shutdown_connections 2024-01-22T05:05:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.840+0000 7f4c9b800700 1 --2- 172.21.15.49:0/1000095185 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c6c05a510 0x7f4c6c05c9d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.840+0000 7f4c9b800700 1 --2- 172.21.15.49:0/1000095185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c94153cf0 0x7f4c9413f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.840+0000 7f4c9b800700 1 --2- 172.21.15.49:0/1000095185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c940c1ce0 0x7f4c9413f130 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.840+0000 7f4c9b800700 1 --2- 172.21.15.49:0/1000095185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c940bc980 0x7f4c9413e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.840+0000 7f4c9b800700 1 -- 172.21.15.49:0/1000095185 >> 172.21.15.49:0/1000095185 conn(0x7f4c94062cb0 msgr2=0x7f4c940c3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:21.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.840+0000 7f4c9b800700 1 -- 172.21.15.49:0/1000095185 shutdown_connections 2024-01-22T05:05:21.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:21.840+0000 7f4c9b800700 1 -- 172.21.15.49:0/1000095185 wait complete. 2024-01-22T05:05:21.867 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:05:22.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.040+0000 7f4237600700 1 Processor -- start 2024-01-22T05:05:22.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.040+0000 7f4237600700 1 -- start start 2024-01-22T05:05:22.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f4237600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4230067a90 0x7f4230063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f4237600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f42300642e0 0x7f42300a74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f4237600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4230067ef0 con 0x7f4230155690 2024-01-22T05:05:22.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f4237600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4230068d30 con 0x7f42300642e0 2024-01-22T05:05:22.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f4237600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4230064770 con 0x7f4230067a90 2024-01-22T05:05:22.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f4234c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4230155690 0x7f42300a9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44818/0 (socket says 172.21.15.49:44818) 2024-01-22T05:05:22.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f4234c00700 1 -- 172.21.15.49:0/2974604544 learned_addr learned my addr 172.21.15.49:0/2974604544 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:22.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f422fe00700 1 --2- 172.21.15.49:0/2974604544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4230067a90 0x7f4230063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f4235600700 1 --2- 172.21.15.49:0/2974604544 >> v2:172.21.15.110:3300/0 conn(0x7f42300642e0 0x7f42300a74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f422f400700 1 -- 172.21.15.49:0/2974604544 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641911543 0 0) 0x7f4230067ef0 con 0x7f4230155690 2024-01-22T05:05:22.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f422f400700 1 -- 172.21.15.49:0/2974604544 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42100033f0 con 0x7f4230155690 2024-01-22T05:05:22.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f4235600700 1 -- 172.21.15.49:0/2974604544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4230067a90 msgr2=0x7f4230063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:22.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f4235600700 1 --2- 172.21.15.49:0/2974604544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4230067a90 0x7f4230063df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f4235600700 1 -- 172.21.15.49:0/2974604544 >> v1:172.21.15.49:6789/0 conn(0x7f4230155690 legacy=0x7f42300a9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f4235600700 1 -- 172.21.15.49:0/2974604544 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42300650d0 con 0x7f42300642e0 2024-01-22T05:05:22.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.044+0000 7f4235600700 1 --2- 172.21.15.49:0/2974604544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42300642e0 0x7f42300a74e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f4228009e60 tx=0x7f4228009780).ready entity=mon.1 client_cookie=12d2bbae46f4e0e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:22.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.048+0000 7f422f400700 1 -- 172.21.15.49:0/2974604544 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422800e070 con 0x7f42300642e0 2024-01-22T05:05:22.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.048+0000 7f422f400700 1 -- 172.21.15.49:0/2974604544 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422800bab0 con 0x7f42300642e0 2024-01-22T05:05:22.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.048+0000 7f422f400700 1 -- 172.21.15.49:0/2974604544 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422800be30 con 0x7f42300642e0 2024-01-22T05:05:22.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.048+0000 7f4237600700 1 -- 172.21.15.49:0/2974604544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42300642e0 msgr2=0x7f42300a74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.048+0000 7f4237600700 1 --2- 172.21.15.49:0/2974604544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42300642e0 0x7f42300a74e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f4228009e60 tx=0x7f4228009780).stop 2024-01-22T05:05:22.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.048+0000 7f4237600700 1 -- 172.21.15.49:0/2974604544 shutdown_connections 2024-01-22T05:05:22.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.048+0000 7f4237600700 1 --2- 172.21.15.49:0/2974604544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42300642e0 0x7f42300a74e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.048+0000 7f4237600700 1 --2- 172.21.15.49:0/2974604544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4230067a90 0x7f4230063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.048+0000 7f4237600700 1 -- 172.21.15.49:0/2974604544 >> 172.21.15.49:0/2974604544 conn(0x7f42300c40f0 msgr2=0x7f42300c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:22.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.048+0000 7f4237600700 1 -- 172.21.15.49:0/2974604544 shutdown_connections 2024-01-22T05:05:22.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.048+0000 7f4237600700 1 -- 172.21.15.49:0/2974604544 wait complete. 2024-01-22T05:05:22.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.052+0000 7f4237600700 1 Processor -- start 2024-01-22T05:05:22.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.052+0000 7f4237600700 1 -- start start 2024-01-22T05:05:22.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.052+0000 7f4237600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42300642e0 0x7f42301463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.052+0000 7f4237600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230067a90 0x7f4230168cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.052+0000 7f4237600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4230155690 0x7f42301692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.052+0000 7f4237600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4230156b10 con 0x7f42300642e0 2024-01-22T05:05:22.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.052+0000 7f4237600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42301697d0 con 0x7f4230067a90 2024-01-22T05:05:22.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.052+0000 7f4237600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4230156270 con 0x7f4230155690 2024-01-22T05:05:22.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.052+0000 7f4234c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42300642e0 0x7f42301463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.052+0000 7f4234c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42300642e0 0x7f42301463e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58190/0 (socket says 172.21.15.49:58190) 2024-01-22T05:05:22.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.052+0000 7f4234c00700 1 -- 172.21.15.49:0/2825823637 learned_addr learned my addr 172.21.15.49:0/2825823637 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.056+0000 7f4235600700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4230155690 0x7f42301692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.056+0000 7f422fe00700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230067a90 0x7f4230168cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.056+0000 7f4234c00700 1 -- 172.21.15.49:0/2825823637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4230155690 msgr2=0x7f42301692e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.056+0000 7f4234c00700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4230155690 0x7f42301692e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.056+0000 7f4234c00700 1 -- 172.21.15.49:0/2825823637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230067a90 msgr2=0x7f4230168cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.056+0000 7f4234c00700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230067a90 0x7f4230168cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.056+0000 7f4234c00700 1 -- 172.21.15.49:0/2825823637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228009a20 con 0x7f42300642e0 2024-01-22T05:05:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.056+0000 7f422fe00700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230067a90 0x7f4230168cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.056+0000 7f4235600700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4230155690 0x7f42301692e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.056+0000 7f4234c00700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42300642e0 0x7f42301463e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f422000c420 tx=0x7f4220007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:22.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.056+0000 7f4227e00700 1 -- 172.21.15.49:0/2825823637 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42200070d0 con 0x7f42300642e0 2024-01-22T05:05:22.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.056+0000 7f4227e00700 1 -- 172.21.15.49:0/2825823637 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4220007230 con 0x7f42300642e0 2024-01-22T05:05:22.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.056+0000 7f4227e00700 1 -- 172.21.15.49:0/2825823637 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42200075b0 con 0x7f42300642e0 2024-01-22T05:05:22.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.056+0000 7f4237600700 1 -- 172.21.15.49:0/2825823637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4230156550 con 0x7f42300642e0 2024-01-22T05:05:22.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.056+0000 7f4237600700 1 -- 172.21.15.49:0/2825823637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4230153300 con 0x7f42300642e0 2024-01-22T05:05:22.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.060+0000 7f4237600700 1 -- 172.21.15.49:0/2825823637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4230153160 con 0x7f42300642e0 2024-01-22T05:05:22.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.060+0000 7f4227e00700 1 -- 172.21.15.49:0/2825823637 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f42200059b0 con 0x7f42300642e0 2024-01-22T05:05:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.060+0000 7f4227e00700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f420805a4e0 0x7f420805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.060+0000 7f4227e00700 1 -- 172.21.15.49:0/2825823637 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f4220074130 con 0x7f42300642e0 2024-01-22T05:05:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.060+0000 7f422fe00700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f420805a4e0 0x7f420805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.060+0000 7f422fe00700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f420805a4e0 0x7f420805c9a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f42300a83d0 tx=0x7f4218009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.068+0000 7f4227e00700 1 -- 172.21.15.49:0/2825823637 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4230153160 con 0x7f42300642e0 2024-01-22T05:05:22.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.240+0000 7f4237600700 1 -- 172.21.15.49:0/2825823637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4230153160 con 0x7f42300642e0 2024-01-22T05:05:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.240+0000 7f4227e00700 1 -- 172.21.15.49:0/2825823637 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4230153160 con 0x7f42300642e0 2024-01-22T05:05:22.243 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:05:22.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.244+0000 7f4237600700 1 -- 172.21.15.49:0/2825823637 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f420805a4e0 msgr2=0x7f420805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.244+0000 7f4237600700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f420805a4e0 0x7f420805c9a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f42300a83d0 tx=0x7f4218009060).stop 2024-01-22T05:05:22.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.244+0000 7f4237600700 1 -- 172.21.15.49:0/2825823637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42300642e0 msgr2=0x7f42301463e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.244+0000 7f4237600700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42300642e0 0x7f42301463e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f422000c420 tx=0x7f4220007c80).stop 2024-01-22T05:05:22.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.244+0000 7f4237600700 1 -- 172.21.15.49:0/2825823637 shutdown_connections 2024-01-22T05:05:22.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.244+0000 7f4237600700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f420805a4e0 0x7f420805c9a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.244+0000 7f4237600700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4230155690 0x7f42301692e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.244+0000 7f4237600700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230067a90 0x7f4230168cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.244+0000 7f4237600700 1 --2- 172.21.15.49:0/2825823637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42300642e0 0x7f42301463e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.244+0000 7f4237600700 1 -- 172.21.15.49:0/2825823637 >> 172.21.15.49:0/2825823637 conn(0x7f42300c40f0 msgr2=0x7f4230150e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.244+0000 7f4237600700 1 -- 172.21.15.49:0/2825823637 shutdown_connections 2024-01-22T05:05:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.244+0000 7f4237600700 1 -- 172.21.15.49:0/2825823637 wait complete. 2024-01-22T05:05:22.269 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-22T05:05:22.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.440+0000 7f8aa6000700 1 Processor -- start 2024-01-22T05:05:22.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.440+0000 7f8aa6000700 1 -- start start 2024-01-22T05:05:22.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.440+0000 7f8aa6000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8aa00a8c20 0x7f8aa00c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.440+0000 7f8aa6000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8aa00bcbe0 0x7f8aa0068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.440+0000 7f8aa6000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa0158650 con 0x7f8aa00c1ac0 2024-01-22T05:05:22.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.440+0000 7f8aa6000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa00c1f20 con 0x7f8aa00bcbe0 2024-01-22T05:05:22.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.440+0000 7f8aa6000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa00bd170 con 0x7f8aa00a8c20 2024-01-22T05:05:22.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8a9f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8aa00a8c20 0x7f8aa00c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8a9ea00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8aa00c1ac0 0x7f8aa00bc4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:47830/0 (socket says 172.21.15.49:47830) 2024-01-22T05:05:22.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8a9fe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8aa00bcbe0 0x7f8aa0068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8a9ea00700 1 -- 172.21.15.49:0/3230082721 learned_addr learned my addr 172.21.15.49:0/3230082721 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:22.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8a9f400700 1 -- 172.21.15.49:0/3230082721 >> v2:172.21.15.110:3300/0 conn(0x7f8aa00bcbe0 msgr2=0x7f8aa0068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:22.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8a9f400700 1 --2- 172.21.15.49:0/3230082721 >> v2:172.21.15.110:3300/0 conn(0x7f8aa00bcbe0 0x7f8aa0068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8a9e000700 1 -- 172.21.15.49:0/3230082721 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216046640 0 0) 0x7f8a88001160 con 0x7f8aa00c1ac0 2024-01-22T05:05:22.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8a9f400700 1 -- 172.21.15.49:0/3230082721 >> v1:172.21.15.110:6789/0 conn(0x7f8aa00c1ac0 legacy=0x7f8aa00bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8a9f400700 1 -- 172.21.15.49:0/3230082721 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa0067c30 con 0x7f8aa00a8c20 2024-01-22T05:05:22.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8a9f400700 1 --2- 172.21.15.49:0/3230082721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8aa00a8c20 0x7f8aa00c15d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8a90009760 tx=0x7f8a90009060).ready entity=mon.2 client_cookie=8ef93ee85f3f86e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:22.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8a9e000700 1 -- 172.21.15.49:0/3230082721 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9000f510 con 0x7f8aa00a8c20 2024-01-22T05:05:22.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8a9e000700 1 -- 172.21.15.49:0/3230082721 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9000f670 con 0x7f8aa00a8c20 2024-01-22T05:05:22.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8a9e000700 1 -- 172.21.15.49:0/3230082721 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9000f9f0 con 0x7f8aa00a8c20 2024-01-22T05:05:22.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8aa6000700 1 -- 172.21.15.49:0/3230082721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8aa00a8c20 msgr2=0x7f8aa00c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8aa6000700 1 --2- 172.21.15.49:0/3230082721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8aa00a8c20 0x7f8aa00c15d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8a90009760 tx=0x7f8a90009060).stop 2024-01-22T05:05:22.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8aa6000700 1 -- 172.21.15.49:0/3230082721 shutdown_connections 2024-01-22T05:05:22.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8aa6000700 1 --2- 172.21.15.49:0/3230082721 >> v2:172.21.15.110:3300/0 conn(0x7f8aa00bcbe0 0x7f8aa0068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8aa6000700 1 --2- 172.21.15.49:0/3230082721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8aa00a8c20 0x7f8aa00c15d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.444+0000 7f8aa6000700 1 -- 172.21.15.49:0/3230082721 >> 172.21.15.49:0/3230082721 conn(0x7f8aa0062cb0 msgr2=0x7f8aa00c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:22.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.448+0000 7f8aa6000700 1 -- 172.21.15.49:0/3230082721 shutdown_connections 2024-01-22T05:05:22.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.448+0000 7f8aa6000700 1 -- 172.21.15.49:0/3230082721 wait complete. 2024-01-22T05:05:22.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.448+0000 7f8aa6000700 1 Processor -- start 2024-01-22T05:05:22.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.448+0000 7f8aa6000700 1 -- start start 2024-01-22T05:05:22.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8aa6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8aa00a8c20 0x7f8aa0149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8aa6000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8aa00bcbe0 0x7f8aa0159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8aa6000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8aa00c1ac0 0x7f8aa015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8aa6000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa015b410 con 0x7f8aa00a8c20 2024-01-22T05:05:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8aa6000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa015a790 con 0x7f8aa00c1ac0 2024-01-22T05:05:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8aa6000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa015aa70 con 0x7f8aa00bcbe0 2024-01-22T05:05:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a9f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8aa00a8c20 0x7f8aa0149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a9f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8aa00a8c20 0x7f8aa0149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58202/0 (socket says 172.21.15.49:58202) 2024-01-22T05:05:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a9f400700 1 -- 172.21.15.49:0/1206373416 learned_addr learned my addr 172.21.15.49:0/1206373416 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a9ea00700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8aa00bcbe0 0x7f8aa0159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a9fe00700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8aa00c1ac0 0x7f8aa015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a9f400700 1 -- 172.21.15.49:0/1206373416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8aa00bcbe0 msgr2=0x7f8aa0159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a9f400700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8aa00bcbe0 0x7f8aa0159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a9f400700 1 -- 172.21.15.49:0/1206373416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8aa00c1ac0 msgr2=0x7f8aa015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a9f400700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8aa00c1ac0 0x7f8aa015a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a9f400700 1 -- 172.21.15.49:0/1206373416 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a900092a0 con 0x7f8aa00a8c20 2024-01-22T05:05:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a9fe00700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8aa00c1ac0 0x7f8aa015a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a9ea00700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8aa00bcbe0 0x7f8aa0159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a9f400700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8aa00a8c20 0x7f8aa0149990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f8aa00bd2b0 tx=0x7f8a90017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:22.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a96a00700 1 -- 172.21.15.49:0/1206373416 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9000f7e0 con 0x7f8aa00a8c20 2024-01-22T05:05:22.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a96a00700 1 -- 172.21.15.49:0/1206373416 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9000f960 con 0x7f8aa00a8c20 2024-01-22T05:05:22.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8a96a00700 1 -- 172.21.15.49:0/1206373416 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9001b660 con 0x7f8aa00a8c20 2024-01-22T05:05:22.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.452+0000 7f8aa6000700 1 -- 172.21.15.49:0/1206373416 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa015ad50 con 0x7f8aa00a8c20 2024-01-22T05:05:22.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.456+0000 7f8aa6000700 1 -- 172.21.15.49:0/1206373416 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa009f6d0 con 0x7f8aa00a8c20 2024-01-22T05:05:22.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.456+0000 7f8aa6000700 1 -- 172.21.15.49:0/1206373416 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa015b680 con 0x7f8aa00a8c20 2024-01-22T05:05:22.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.456+0000 7f8a96a00700 1 -- 172.21.15.49:0/1206373416 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8a9001b9d0 con 0x7f8aa00a8c20 2024-01-22T05:05:22.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.456+0000 7f8a96a00700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8a7805a510 0x7f8a7805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.460+0000 7f8a96a00700 1 -- 172.21.15.49:0/1206373416 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7058+0+0 (secure 0 0 0) 0x7f8a900766c0 con 0x7f8aa00a8c20 2024-01-22T05:05:22.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.460+0000 7f8a9ea00700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8a7805a510 0x7f8a7805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.460+0000 7f8a9ea00700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8a7805a510 0x7f8a7805c9d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f8aa009fcd0 tx=0x7f8a88009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:22.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.464+0000 7f8a96a00700 1 -- 172.21.15.49:0/1206373416 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8aa015b680 con 0x7f8aa00a8c20 2024-01-22T05:05:22.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.636+0000 7f8aa6000700 1 -- 172.21.15.49:0/1206373416 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8aa015b680 con 0x7f8aa00a8c20 2024-01-22T05:05:22.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.636+0000 7f8a96a00700 1 -- 172.21.15.49:0/1206373416 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8aa015b680 con 0x7f8aa00a8c20 2024-01-22T05:05:22.639 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-22T05:05:22.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.640+0000 7f8aa6000700 1 -- 172.21.15.49:0/1206373416 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8a7805a510 msgr2=0x7f8a7805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.640+0000 7f8aa6000700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8a7805a510 0x7f8a7805c9d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f8aa009fcd0 tx=0x7f8a88009040).stop 2024-01-22T05:05:22.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.640+0000 7f8aa6000700 1 -- 172.21.15.49:0/1206373416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8aa00a8c20 msgr2=0x7f8aa0149990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.640+0000 7f8aa6000700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8aa00a8c20 0x7f8aa0149990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f8aa00bd2b0 tx=0x7f8a90017000).stop 2024-01-22T05:05:22.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.640+0000 7f8aa6000700 1 -- 172.21.15.49:0/1206373416 shutdown_connections 2024-01-22T05:05:22.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.640+0000 7f8aa6000700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8a7805a510 0x7f8a7805c9d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.640+0000 7f8aa6000700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8aa00c1ac0 0x7f8aa015a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.640+0000 7f8aa6000700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8aa00bcbe0 0x7f8aa0159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.640+0000 7f8aa6000700 1 --2- 172.21.15.49:0/1206373416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8aa00a8c20 0x7f8aa0149990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.640+0000 7f8aa6000700 1 -- 172.21.15.49:0/1206373416 >> 172.21.15.49:0/1206373416 conn(0x7f8aa0062cb0 msgr2=0x7f8aa00c6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:22.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.640+0000 7f8aa6000700 1 -- 172.21.15.49:0/1206373416 shutdown_connections 2024-01-22T05:05:22.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.640+0000 7f8aa6000700 1 -- 172.21.15.49:0/1206373416 wait complete. 2024-01-22T05:05:22.697 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2024-01-22T05:05:22.697 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-01-22T05:05:22.698 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-01-22T05:05:22.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.860+0000 7fdb69e00700 1 Processor -- start 2024-01-22T05:05:22.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.860+0000 7fdb69e00700 1 -- start start 2024-01-22T05:05:22.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb69e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb640c25e0 0x7fdb640a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb69e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb640c1a40 con 0x7fdb640a8740 2024-01-22T05:05:22.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb69e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb640a90b0 con 0x7fdb64155d20 2024-01-22T05:05:22.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb69e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64159310 con 0x7fdb640c25e0 2024-01-22T05:05:22.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb62000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdb640a8740 0x7fdb640c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44824/0 (socket says 172.21.15.49:44824) 2024-01-22T05:05:22.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb62000700 1 -- 172.21.15.49:0/2588348459 learned_addr learned my addr 172.21.15.49:0/2588348459 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:22.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb63400700 1 --2- 172.21.15.49:0/2588348459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb640c25e0 0x7fdb640a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb61600700 1 -- 172.21.15.49:0/2588348459 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480996677 0 0) 0x7fdb640c1a40 con 0x7fdb640a8740 2024-01-22T05:05:22.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb61600700 1 -- 172.21.15.49:0/2588348459 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb440033f0 con 0x7fdb640a8740 2024-01-22T05:05:22.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb61600700 1 -- 172.21.15.49:0/2588348459 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049858351 0 0) 0x7fdb640a90b0 con 0x7fdb64155d20 2024-01-22T05:05:22.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb61600700 1 -- 172.21.15.49:0/2588348459 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb640c1a40 con 0x7fdb64155d20 2024-01-22T05:05:22.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb63400700 1 -- 172.21.15.49:0/2588348459 >> v1:172.21.15.110:6789/0 conn(0x7fdb64155d20 legacy=0x7fdb64065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb63400700 1 -- 172.21.15.49:0/2588348459 >> v1:172.21.15.49:6789/0 conn(0x7fdb640a8740 legacy=0x7fdb640c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb61600700 1 -- 172.21.15.49:0/2588348459 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2040010573 0 0) 0x7fdb440033f0 con 0x7fdb640a8740 2024-01-22T05:05:22.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb63400700 1 -- 172.21.15.49:0/2588348459 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb640c13f0 con 0x7fdb640c25e0 2024-01-22T05:05:22.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.864+0000 7fdb63400700 1 --2- 172.21.15.49:0/2588348459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb640c25e0 0x7fdb640a8bc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdb5c009e90 tx=0x7fdb5c009780).ready entity=mon.2 client_cookie=ecc792be91cdb8d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:22.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.868+0000 7fdb61600700 1 -- 172.21.15.49:0/2588348459 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c00e070 con 0x7fdb640c25e0 2024-01-22T05:05:22.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.868+0000 7fdb61600700 1 -- 172.21.15.49:0/2588348459 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c00b7a0 con 0x7fdb640c25e0 2024-01-22T05:05:22.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.868+0000 7fdb61600700 1 -- 172.21.15.49:0/2588348459 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c001470 con 0x7fdb640c25e0 2024-01-22T05:05:22.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.868+0000 7fdb69e00700 1 -- 172.21.15.49:0/2588348459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb640c25e0 msgr2=0x7fdb640a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.868+0000 7fdb69e00700 1 --2- 172.21.15.49:0/2588348459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb640c25e0 0x7fdb640a8bc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdb5c009e90 tx=0x7fdb5c009780).stop 2024-01-22T05:05:22.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.868+0000 7fdb69e00700 1 -- 172.21.15.49:0/2588348459 shutdown_connections 2024-01-22T05:05:22.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.868+0000 7fdb69e00700 1 --2- 172.21.15.49:0/2588348459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb640c25e0 0x7fdb640a8bc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.868+0000 7fdb69e00700 1 -- 172.21.15.49:0/2588348459 >> 172.21.15.49:0/2588348459 conn(0x7fdb640c6540 msgr2=0x7fdb640c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:22.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.868+0000 7fdb69e00700 1 -- 172.21.15.49:0/2588348459 shutdown_connections 2024-01-22T05:05:22.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.868+0000 7fdb69e00700 1 -- 172.21.15.49:0/2588348459 wait complete. 2024-01-22T05:05:22.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.872+0000 7fdb69e00700 1 Processor -- start 2024-01-22T05:05:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.872+0000 7fdb69e00700 1 -- start start 2024-01-22T05:05:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb69e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb640a8740 0x7fdb6415ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb69e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb640c25e0 0x7fdb640a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb69e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb64155d20 0x7fdb64168400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb69e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640ac040 con 0x7fdb64155d20 2024-01-22T05:05:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb69e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6415b1f0 con 0x7fdb640a8740 2024-01-22T05:05:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb69e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640abd40 con 0x7fdb640c25e0 2024-01-22T05:05:22.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb63400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb64155d20 0x7fdb64168400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb63400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb64155d20 0x7fdb64168400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58216/0 (socket says 172.21.15.49:58216) 2024-01-22T05:05:22.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb63400700 1 -- 172.21.15.49:0/2632874221 learned_addr learned my addr 172.21.15.49:0/2632874221 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:22.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb62000700 1 --2- 172.21.15.49:0/2632874221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb640c25e0 0x7fdb640a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb62a00700 1 --2- 172.21.15.49:0/2632874221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb640a8740 0x7fdb6415ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb63400700 1 -- 172.21.15.49:0/2632874221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb640c25e0 msgr2=0x7fdb640a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb63400700 1 --2- 172.21.15.49:0/2632874221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb640c25e0 0x7fdb640a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb63400700 1 -- 172.21.15.49:0/2632874221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb640a8740 msgr2=0x7fdb6415ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:22.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb63400700 1 --2- 172.21.15.49:0/2632874221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb640a8740 0x7fdb6415ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:22.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb63400700 1 -- 172.21.15.49:0/2632874221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c009a20 con 0x7fdb64155d20 2024-01-22T05:05:22.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb63400700 1 --2- 172.21.15.49:0/2632874221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb64155d20 0x7fdb64168400 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fdb5c012fa0 tx=0x7fdb5c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb5a000700 1 -- 172.21.15.49:0/2632874221 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c009440 con 0x7fdb64155d20 2024-01-22T05:05:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb5a000700 1 -- 172.21.15.49:0/2632874221 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c00be40 con 0x7fdb64155d20 2024-01-22T05:05:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb5a000700 1 -- 172.21.15.49:0/2632874221 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c01d860 con 0x7fdb64155d20 2024-01-22T05:05:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb69e00700 1 -- 172.21.15.49:0/2632874221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb640ac4d0 con 0x7fdb64155d20 2024-01-22T05:05:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.876+0000 7fdb69e00700 1 -- 172.21.15.49:0/2632874221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb640c5820 con 0x7fdb64155d20 2024-01-22T05:05:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.880+0000 7fdb69e00700 1 -- 172.21.15.49:0/2632874221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb640ac1f0 con 0x7fdb64155d20 2024-01-22T05:05:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.880+0000 7fdb5a000700 1 -- 172.21.15.49:0/2632874221 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdb5c01dc50 con 0x7fdb64155d20 2024-01-22T05:05:22.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.880+0000 7fdb5a000700 1 --2- 172.21.15.49:0/2632874221 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb3c05a510 0x7fdb3c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:22.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.880+0000 7fdb5a000700 1 -- 172.21.15.49:0/2632874221 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7058+0+0 (secure 0 0 0) 0x7fdb5c076b80 con 0x7fdb64155d20 2024-01-22T05:05:22.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.884+0000 7fdb62a00700 1 --2- 172.21.15.49:0/2632874221 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb3c05a510 0x7fdb3c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:22.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.884+0000 7fdb62a00700 1 --2- 172.21.15.49:0/2632874221 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb3c05a510 0x7fdb3c05c9d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fdb54003660 tx=0x7fdb54009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:22.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:22.888+0000 7fdb5a000700 1 -- 172.21.15.49:0/2632874221 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdb640ac1f0 con 0x7fdb64155d20 2024-01-22T05:05:23.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.112+0000 7fdb69e00700 1 -- 172.21.15.49:0/2632874221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) v1 -- 0x7fdb64047060 con 0x7fdb64155d20 2024-01-22T05:05:23.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.160+0000 7fdb5a000700 1 -- 172.21.15.49:0/2632874221 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v64) v1 ==== 151+0+0 (secure 0 0 0) 0x7fdb5c04d9e0 con 0x7fdb64155d20 2024-01-22T05:05:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.160+0000 7fdb69e00700 1 -- 172.21.15.49:0/2632874221 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb3c05a510 msgr2=0x7fdb3c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.160+0000 7fdb69e00700 1 --2- 172.21.15.49:0/2632874221 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb3c05a510 0x7fdb3c05c9d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fdb54003660 tx=0x7fdb54009040).stop 2024-01-22T05:05:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.160+0000 7fdb69e00700 1 -- 172.21.15.49:0/2632874221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb64155d20 msgr2=0x7fdb64168400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.160+0000 7fdb69e00700 1 --2- 172.21.15.49:0/2632874221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb64155d20 0x7fdb64168400 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fdb5c012fa0 tx=0x7fdb5c009780).stop 2024-01-22T05:05:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.160+0000 7fdb69e00700 1 -- 172.21.15.49:0/2632874221 shutdown_connections 2024-01-22T05:05:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.160+0000 7fdb69e00700 1 --2- 172.21.15.49:0/2632874221 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb3c05a510 0x7fdb3c05c9d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.160+0000 7fdb69e00700 1 --2- 172.21.15.49:0/2632874221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb64155d20 0x7fdb64168400 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.160+0000 7fdb69e00700 1 --2- 172.21.15.49:0/2632874221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb640c25e0 0x7fdb640a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.160+0000 7fdb69e00700 1 --2- 172.21.15.49:0/2632874221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb640a8740 0x7fdb6415ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.160+0000 7fdb69e00700 1 -- 172.21.15.49:0/2632874221 >> 172.21.15.49:0/2632874221 conn(0x7fdb640c6540 msgr2=0x7fdb640c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.164+0000 7fdb69e00700 1 -- 172.21.15.49:0/2632874221 shutdown_connections 2024-01-22T05:05:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.164+0000 7fdb69e00700 1 -- 172.21.15.49:0/2632874221 wait complete. 2024-01-22T05:05:23.186 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-22T05:05:23.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.356+0000 7ffb16200700 1 Processor -- start 2024-01-22T05:05:23.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.356+0000 7ffb16200700 1 -- start start 2024-01-22T05:05:23.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.360+0000 7ffb16200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffb100644b0 0x7ffb100c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:23.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.360+0000 7ffb16200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffb100c6080 0x7ffb100c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:23.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.360+0000 7ffb16200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb100696a0 con 0x7ffb10153930 2024-01-22T05:05:23.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.360+0000 7ffb16200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb100c3970 con 0x7ffb100c6080 2024-01-22T05:05:23.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.360+0000 7ffb16200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb10069f50 con 0x7ffb100644b0 2024-01-22T05:05:23.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.360+0000 7ffb15800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffb100c6080 0x7ffb100c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:23.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.360+0000 7ffb15800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffb100c6080 0x7ffb100c1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45626/0 (socket says 172.21.15.49:45626) 2024-01-22T05:05:23.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.360+0000 7ffb15800700 1 -- 172.21.15.49:0/3512740101 learned_addr learned my addr 172.21.15.49:0/3512740101 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:23.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.360+0000 7ffb14e00700 1 --1- 172.21.15.49:0/3512740101 >> v1:172.21.15.110:6789/0 conn(0x7ffb10153930 0x7ffb10063da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:41878/0 (socket says 172.21.15.49:41878) 2024-01-22T05:05:23.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.360+0000 7ffb0fe00700 1 --2- 172.21.15.49:0/3512740101 >> v2:172.21.15.110:3300/0 conn(0x7ffb100644b0 0x7ffb100c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:23.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.360+0000 7ffb15800700 1 -- 172.21.15.49:0/3512740101 >> v2:172.21.15.110:3300/0 conn(0x7ffb100644b0 msgr2=0x7ffb100c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:23.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.360+0000 7ffb0f400700 1 -- 172.21.15.49:0/3512740101 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156864551 0 0) 0x7ffb100696a0 con 0x7ffb10153930 2024-01-22T05:05:23.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.360+0000 7ffb15800700 1 --2- 172.21.15.49:0/3512740101 >> v2:172.21.15.110:3300/0 conn(0x7ffb100644b0 0x7ffb100c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:23.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.360+0000 7ffb15800700 1 -- 172.21.15.49:0/3512740101 >> v1:172.21.15.110:6789/0 conn(0x7ffb10153930 legacy=0x7ffb10063da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:23.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.360+0000 7ffb15800700 1 -- 172.21.15.49:0/3512740101 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb100687f0 con 0x7ffb100c6080 2024-01-22T05:05:23.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.364+0000 7ffb15800700 1 --2- 172.21.15.49:0/3512740101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb100c6080 0x7ffb100c1c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7ffb100ad7f0 tx=0x7ffb08009840).ready entity=mon.0 client_cookie=29e50120cbc6a32a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:23.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.364+0000 7ffb0f400700 1 -- 172.21.15.49:0/3512740101 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0800e070 con 0x7ffb100c6080 2024-01-22T05:05:23.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.364+0000 7ffb0f400700 1 -- 172.21.15.49:0/3512740101 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0800b990 con 0x7ffb100c6080 2024-01-22T05:05:23.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.364+0000 7ffb0f400700 1 -- 172.21.15.49:0/3512740101 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0800bd10 con 0x7ffb100c6080 2024-01-22T05:05:23.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.364+0000 7ffb16200700 1 -- 172.21.15.49:0/3512740101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb100c6080 msgr2=0x7ffb100c1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:23.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.364+0000 7ffb16200700 1 --2- 172.21.15.49:0/3512740101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb100c6080 0x7ffb100c1c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7ffb100ad7f0 tx=0x7ffb08009840).stop 2024-01-22T05:05:23.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.364+0000 7ffb16200700 1 -- 172.21.15.49:0/3512740101 shutdown_connections 2024-01-22T05:05:23.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.364+0000 7ffb16200700 1 --2- 172.21.15.49:0/3512740101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb100c6080 0x7ffb100c1c20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:23.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.364+0000 7ffb16200700 1 --2- 172.21.15.49:0/3512740101 >> v2:172.21.15.110:3300/0 conn(0x7ffb100644b0 0x7ffb100c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:23.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.364+0000 7ffb16200700 1 -- 172.21.15.49:0/3512740101 >> 172.21.15.49:0/3512740101 conn(0x7ffb10062760 msgr2=0x7ffb10062b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:23.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.364+0000 7ffb16200700 1 -- 172.21.15.49:0/3512740101 shutdown_connections 2024-01-22T05:05:23.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.364+0000 7ffb16200700 1 -- 172.21.15.49:0/3512740101 wait complete. 2024-01-22T05:05:23.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.368+0000 7ffb16200700 1 Processor -- start 2024-01-22T05:05:23.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb16200700 1 -- start start 2024-01-22T05:05:23.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb16200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb100644b0 0x7ffb100a6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:23.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb16200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb100c6080 0x7ffb10154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:23.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb16200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb10153930 0x7ffb100a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:23.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb16200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb100bf870 con 0x7ffb100644b0 2024-01-22T05:05:23.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb16200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb100bfb50 con 0x7ffb10153930 2024-01-22T05:05:23.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb16200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb100bfe30 con 0x7ffb100c6080 2024-01-22T05:05:23.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb14e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb100644b0 0x7ffb100a6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:23.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb14e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb100644b0 0x7ffb100a6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45628/0 (socket says 172.21.15.49:45628) 2024-01-22T05:05:23.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb14e00700 1 -- 172.21.15.49:0/3680429226 learned_addr learned my addr 172.21.15.49:0/3680429226 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:23.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb0fe00700 1 --2- 172.21.15.49:0/3680429226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb100c6080 0x7ffb10154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:23.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb15800700 1 --2- 172.21.15.49:0/3680429226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb10153930 0x7ffb100a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:23.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb14e00700 1 -- 172.21.15.49:0/3680429226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb100c6080 msgr2=0x7ffb10154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:23.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb14e00700 1 --2- 172.21.15.49:0/3680429226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb100c6080 0x7ffb10154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:23.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb14e00700 1 -- 172.21.15.49:0/3680429226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb10153930 msgr2=0x7ffb100a5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:23.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb14e00700 1 --2- 172.21.15.49:0/3680429226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb10153930 0x7ffb100a5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:23.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb14e00700 1 -- 172.21.15.49:0/3680429226 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08009ae0 con 0x7ffb100644b0 2024-01-22T05:05:23.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.372+0000 7ffb14e00700 1 --2- 172.21.15.49:0/3680429226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb100644b0 0x7ffb100a6790 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7ffb0000c440 tx=0x7ffb00007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:23.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.376+0000 7ffb07e00700 1 -- 172.21.15.49:0/3680429226 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb000070d0 con 0x7ffb100644b0 2024-01-22T05:05:23.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.376+0000 7ffb07e00700 1 -- 172.21.15.49:0/3680429226 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb00007230 con 0x7ffb100644b0 2024-01-22T05:05:23.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.376+0000 7ffb16200700 1 -- 172.21.15.49:0/3680429226 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb100c0110 con 0x7ffb100644b0 2024-01-22T05:05:23.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.376+0000 7ffb07e00700 1 -- 172.21.15.49:0/3680429226 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb000056e0 con 0x7ffb100644b0 2024-01-22T05:05:23.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.376+0000 7ffb16200700 1 -- 172.21.15.49:0/3680429226 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb101531c0 con 0x7ffb100644b0 2024-01-22T05:05:23.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.376+0000 7ffb16200700 1 -- 172.21.15.49:0/3680429226 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb100656d0 con 0x7ffb100644b0 2024-01-22T05:05:23.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.380+0000 7ffb07e00700 1 -- 172.21.15.49:0/3680429226 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ffb00005ad0 con 0x7ffb100644b0 2024-01-22T05:05:23.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.380+0000 7ffb07e00700 1 --2- 172.21.15.49:0/3680429226 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffae805a510 0x7ffae805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:23.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.380+0000 7ffb07e00700 1 -- 172.21.15.49:0/3680429226 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7058+0+0 (secure 0 0 0) 0x7ffb000740e0 con 0x7ffb100644b0 2024-01-22T05:05:23.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.380+0000 7ffb0fe00700 1 --2- 172.21.15.49:0/3680429226 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffae805a510 0x7ffae805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:23.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.380+0000 7ffb0fe00700 1 --2- 172.21.15.49:0/3680429226 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffae805a510 0x7ffae805c9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7ffb100c2df0 tx=0x7ffaf8009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.388+0000 7ffb07e00700 1 -- 172.21.15.49:0/3680429226 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffb00047510 con 0x7ffb100644b0 2024-01-22T05:05:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.564+0000 7ffb16200700 1 -- 172.21.15.49:0/3680429226 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ffb10068a90 con 0x7ffb100644b0 2024-01-22T05:05:23.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.568+0000 7ffb07e00700 1 -- 172.21.15.49:0/3680429226 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffb00018070 con 0x7ffb100644b0 2024-01-22T05:05:23.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.572+0000 7ffb16200700 1 -- 172.21.15.49:0/3680429226 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffae805a510 msgr2=0x7ffae805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:23.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.572+0000 7ffb16200700 1 --2- 172.21.15.49:0/3680429226 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffae805a510 0x7ffae805c9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7ffb100c2df0 tx=0x7ffaf8009060).stop 2024-01-22T05:05:23.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.572+0000 7ffb16200700 1 -- 172.21.15.49:0/3680429226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb100644b0 msgr2=0x7ffb100a6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:23.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.572+0000 7ffb16200700 1 --2- 172.21.15.49:0/3680429226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb100644b0 0x7ffb100a6790 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7ffb0000c440 tx=0x7ffb00007e30).stop 2024-01-22T05:05:23.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.572+0000 7ffb16200700 1 -- 172.21.15.49:0/3680429226 shutdown_connections 2024-01-22T05:05:23.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.572+0000 7ffb16200700 1 --2- 172.21.15.49:0/3680429226 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffae805a510 0x7ffae805c9d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:23.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.572+0000 7ffb16200700 1 --2- 172.21.15.49:0/3680429226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb10153930 0x7ffb100a5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:23.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.572+0000 7ffb16200700 1 --2- 172.21.15.49:0/3680429226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb100c6080 0x7ffb10154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:23.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.572+0000 7ffb16200700 1 --2- 172.21.15.49:0/3680429226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb100644b0 0x7ffb100a6790 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:23.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.572+0000 7ffb16200700 1 -- 172.21.15.49:0/3680429226 >> 172.21.15.49:0/3680429226 conn(0x7ffb10062760 msgr2=0x7ffb100c58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:23.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.572+0000 7ffb16200700 1 -- 172.21.15.49:0/3680429226 shutdown_connections 2024-01-22T05:05:23.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:23.572+0000 7ffb16200700 1 -- 172.21.15.49:0/3680429226 wait complete. 2024-01-22T05:05:23.599 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:05:23.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:05:23.641 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:05:23.682 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:05:23.682 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T05:05:23.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:05:23.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-01-22T05:05:23.734 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:05:23.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:23.734 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:05:23.749 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-22T05:05:23.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:05:23.749 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-01-22T05:05:23.804 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-01-22T05:05:23.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:23.804 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-22T05:05:23.878 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-01-22T05:05:23.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:05:23.878 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-01-22T05:05:23.918 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:05:23.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:23.919 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-01-22T05:05:23.980 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-01-22T05:05:23.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:05:23.981 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-01-22T05:05:24.023 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-01-22T05:05:24.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:24.024 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-01-22T05:05:24.086 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-22T05:05:24.086 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:05:24.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.260+0000 7ffa3aa00700 1 Processor -- start 2024-01-22T05:05:24.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.260+0000 7ffa3aa00700 1 -- start start 2024-01-22T05:05:24.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.264+0000 7ffa3aa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffa34062230 0x7ffa341507c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:24.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.264+0000 7ffa3aa00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffa340681a0 0x7ffa340bf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:24.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.264+0000 7ffa3aa00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa340c37d0 con 0x7ffa34062610 2024-01-22T05:05:24.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.264+0000 7ffa3aa00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa340c3a20 con 0x7ffa34062230 2024-01-22T05:05:24.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.264+0000 7ffa3aa00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa340c3d00 con 0x7ffa340681a0 2024-01-22T05:05:24.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.264+0000 7ffa33e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffa34062230 0x7ffa341507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:24.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.264+0000 7ffa33e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffa34062230 0x7ffa341507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45640/0 (socket says 172.21.15.49:45640) 2024-01-22T05:05:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.264+0000 7ffa33e00700 1 -- 172.21.15.49:0/79179994 learned_addr learned my addr 172.21.15.49:0/79179994 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.264+0000 7ffa39400700 1 --2- 172.21.15.49:0/79179994 >> v2:172.21.15.110:3300/0 conn(0x7ffa340681a0 0x7ffa340bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.264+0000 7ffa33e00700 1 -- 172.21.15.49:0/79179994 >> v2:172.21.15.110:3300/0 conn(0x7ffa340681a0 msgr2=0x7ffa340bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.264+0000 7ffa33e00700 1 --2- 172.21.15.49:0/79179994 >> v2:172.21.15.110:3300/0 conn(0x7ffa340681a0 0x7ffa340bf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.264+0000 7ffa33e00700 1 -- 172.21.15.49:0/79179994 >> v1:172.21.15.110:6789/0 conn(0x7ffa34062610 legacy=0x7ffa34067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:24.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.264+0000 7ffa33e00700 1 -- 172.21.15.49:0/79179994 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa340c3fe0 con 0x7ffa34062230 2024-01-22T05:05:24.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.264+0000 7ffa33e00700 1 --2- 172.21.15.49:0/79179994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa34062230 0x7ffa341507c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7ffa34064e50 tx=0x7ffa240090f0).ready entity=mon.0 client_cookie=3f425d453eea4ac7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:24.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.264+0000 7ffa32a00700 1 -- 172.21.15.49:0/79179994 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2400b520 con 0x7ffa34062230 2024-01-22T05:05:24.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.268+0000 7ffa32a00700 1 -- 172.21.15.49:0/79179994 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2400b680 con 0x7ffa34062230 2024-01-22T05:05:24.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.268+0000 7ffa32a00700 1 -- 172.21.15.49:0/79179994 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2400ba00 con 0x7ffa34062230 2024-01-22T05:05:24.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.268+0000 7ffa3aa00700 1 -- 172.21.15.49:0/79179994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa34062230 msgr2=0x7ffa341507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:24.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.268+0000 7ffa3aa00700 1 --2- 172.21.15.49:0/79179994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa34062230 0x7ffa341507c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7ffa34064e50 tx=0x7ffa240090f0).stop 2024-01-22T05:05:24.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.268+0000 7ffa3aa00700 1 -- 172.21.15.49:0/79179994 shutdown_connections 2024-01-22T05:05:24.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.268+0000 7ffa3aa00700 1 --2- 172.21.15.49:0/79179994 >> v2:172.21.15.110:3300/0 conn(0x7ffa340681a0 0x7ffa340bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.268+0000 7ffa3aa00700 1 --2- 172.21.15.49:0/79179994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa34062230 0x7ffa341507c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.268+0000 7ffa3aa00700 1 -- 172.21.15.49:0/79179994 >> 172.21.15.49:0/79179994 conn(0x7ffa34064080 msgr2=0x7ffa34064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:24.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.268+0000 7ffa3aa00700 1 -- 172.21.15.49:0/79179994 shutdown_connections 2024-01-22T05:05:24.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.268+0000 7ffa3aa00700 1 -- 172.21.15.49:0/79179994 wait complete. 2024-01-22T05:05:24.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.272+0000 7ffa3aa00700 1 Processor -- start 2024-01-22T05:05:24.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.272+0000 7ffa3aa00700 1 -- start start 2024-01-22T05:05:24.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa3aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa34062230 0x7ffa34146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:24.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa3aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa34062610 0x7ffa340ac620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:24.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa3aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa340681a0 0x7ffa340a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:24.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa3aa00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa340adc80 con 0x7ffa34062230 2024-01-22T05:05:24.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa3aa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa34147410 con 0x7ffa34062610 2024-01-22T05:05:24.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa3aa00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa340ad070 con 0x7ffa340681a0 2024-01-22T05:05:24.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa33e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa34062230 0x7ffa34146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:24.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa33e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa34062230 0x7ffa34146f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45646/0 (socket says 172.21.15.49:45646) 2024-01-22T05:05:24.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa33e00700 1 -- 172.21.15.49:0/2934665592 learned_addr learned my addr 172.21.15.49:0/2934665592 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:24.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa33400700 1 --2- 172.21.15.49:0/2934665592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa34062610 0x7ffa340ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:24.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa39400700 1 --2- 172.21.15.49:0/2934665592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa340681a0 0x7ffa340a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa33e00700 1 -- 172.21.15.49:0/2934665592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa340681a0 msgr2=0x7ffa340a8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa33e00700 1 --2- 172.21.15.49:0/2934665592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa340681a0 0x7ffa340a8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa33e00700 1 -- 172.21.15.49:0/2934665592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa34062610 msgr2=0x7ffa340ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa33e00700 1 --2- 172.21.15.49:0/2934665592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa34062610 0x7ffa340ac620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa33e00700 1 -- 172.21.15.49:0/2934665592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa24009370 con 0x7ffa34062230 2024-01-22T05:05:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa33e00700 1 --2- 172.21.15.49:0/2934665592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa34062230 0x7ffa34146f20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7ffa24009130 tx=0x7ffa24017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:24.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa2b400700 1 -- 172.21.15.49:0/2934665592 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa24000bc0 con 0x7ffa34062230 2024-01-22T05:05:24.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa2b400700 1 -- 172.21.15.49:0/2934665592 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2400b7f0 con 0x7ffa34062230 2024-01-22T05:05:24.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa2b400700 1 -- 172.21.15.49:0/2934665592 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa24000d20 con 0x7ffa34062230 2024-01-22T05:05:24.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.276+0000 7ffa3aa00700 1 -- 172.21.15.49:0/2934665592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa340ad350 con 0x7ffa34062230 2024-01-22T05:05:24.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.280+0000 7ffa3aa00700 1 -- 172.21.15.49:0/2934665592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa340ad910 con 0x7ffa34062230 2024-01-22T05:05:24.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.280+0000 7ffa3aa00700 1 -- 172.21.15.49:0/2934665592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa34047060 con 0x7ffa34062230 2024-01-22T05:05:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.280+0000 7ffa2b400700 1 -- 172.21.15.49:0/2934665592 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ffa2401c8c0 con 0x7ffa34062230 2024-01-22T05:05:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.284+0000 7ffa2b400700 1 --2- 172.21.15.49:0/2934665592 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa0c05a540 0x7ffa0c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.284+0000 7ffa2b400700 1 -- 172.21.15.49:0/2934665592 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7058+0+0 (secure 0 0 0) 0x7ffa24076930 con 0x7ffa34062230 2024-01-22T05:05:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.284+0000 7ffa33400700 1 --2- 172.21.15.49:0/2934665592 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa0c05a540 0x7ffa0c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:24.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.284+0000 7ffa33400700 1 --2- 172.21.15.49:0/2934665592 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa0c05a540 0x7ffa0c05ca00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7ffa340ab950 tx=0x7ffa1c007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:24.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.292+0000 7ffa2b400700 1 -- 172.21.15.49:0/2934665592 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffa24049ce0 con 0x7ffa34062230 2024-01-22T05:05:24.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.492+0000 7ffa3aa00700 1 -- 172.21.15.49:0/2934665592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa340c42c0 con 0x7ffa34062230 2024-01-22T05:05:24.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.496+0000 7ffa2b400700 1 -- 172.21.15.49:0/2934665592 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4491 (secure 0 0 0) 0x7ffa24020020 con 0x7ffa34062230 2024-01-22T05:05:24.498 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:24.498 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/4240919875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4240919875},{"type":"v1","addr":"172.21.15.49:6836","nonce":4240919875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3591660134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3591660134},{"type":"v1","addr":"172.21.15.49:6837","nonce":3591660134}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1228202507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1228202507},{"type":"v1","addr":"172.21.15.110:6833","nonce":1228202507}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:04:35.017706+0000","modified":"2024-01-22T05:04:49.308211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3391981756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3391981756},{"type":"v1","addr":"172.21.15.110:6835","nonce":3391981756}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:05:24.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.500+0000 7ffa3aa00700 1 -- 172.21.15.49:0/2934665592 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa0c05a540 msgr2=0x7ffa0c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:24.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.500+0000 7ffa3aa00700 1 --2- 172.21.15.49:0/2934665592 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa0c05a540 0x7ffa0c05ca00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7ffa340ab950 tx=0x7ffa1c007d40).stop 2024-01-22T05:05:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.500+0000 7ffa3aa00700 1 -- 172.21.15.49:0/2934665592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa34062230 msgr2=0x7ffa34146f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.500+0000 7ffa3aa00700 1 --2- 172.21.15.49:0/2934665592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa34062230 0x7ffa34146f20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7ffa24009130 tx=0x7ffa24017000).stop 2024-01-22T05:05:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.500+0000 7ffa3aa00700 1 -- 172.21.15.49:0/2934665592 shutdown_connections 2024-01-22T05:05:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.500+0000 7ffa3aa00700 1 --2- 172.21.15.49:0/2934665592 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa0c05a540 0x7ffa0c05ca00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.500+0000 7ffa3aa00700 1 --2- 172.21.15.49:0/2934665592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa340681a0 0x7ffa340a8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.500+0000 7ffa3aa00700 1 --2- 172.21.15.49:0/2934665592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa34062610 0x7ffa340ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.500+0000 7ffa3aa00700 1 --2- 172.21.15.49:0/2934665592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa34062230 0x7ffa34146f20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.500+0000 7ffa3aa00700 1 -- 172.21.15.49:0/2934665592 >> 172.21.15.49:0/2934665592 conn(0x7ffa34064080 msgr2=0x7ffa340c6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:24.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.500+0000 7ffa3aa00700 1 -- 172.21.15.49:0/2934665592 shutdown_connections 2024-01-22T05:05:24.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.500+0000 7ffa3aa00700 1 -- 172.21.15.49:0/2934665592 wait complete. 2024-01-22T05:05:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-22T05:05:24.526 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:05:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.680+0000 7f0dc9c00700 1 Processor -- start 2024-01-22T05:05:24.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.680+0000 7f0dc9c00700 1 -- start start 2024-01-22T05:05:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.684+0000 7f0dc9c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0dc41554a0 0x7f0dc4067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.684+0000 7f0dc9c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0dc4151a60 0x7f0dc40c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:24.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.684+0000 7f0dc9c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc40c5840 con 0x7f0dc40c8e70 2024-01-22T05:05:24.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.684+0000 7f0dc9c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc4155cf0 con 0x7f0dc4151a60 2024-01-22T05:05:24.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.684+0000 7f0dc9c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc4155fd0 con 0x7f0dc41554a0 2024-01-22T05:05:24.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.684+0000 7f0dc3e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0dc4151a60 0x7f0dc40c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:24.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.684+0000 7f0dc3e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0dc4151a60 0x7f0dc40c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45654/0 (socket says 172.21.15.49:45654) 2024-01-22T05:05:24.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.684+0000 7f0dc3e00700 1 -- 172.21.15.49:0/3613036005 learned_addr learned my addr 172.21.15.49:0/3613036005 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.684+0000 7f0dc2a00700 1 --2- 172.21.15.49:0/3613036005 >> v2:172.21.15.110:3300/0 conn(0x7f0dc41554a0 0x7f0dc4067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc3e00700 1 -- 172.21.15.49:0/3613036005 >> v2:172.21.15.110:3300/0 conn(0x7f0dc41554a0 msgr2=0x7f0dc4067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc3e00700 1 --2- 172.21.15.49:0/3613036005 >> v2:172.21.15.110:3300/0 conn(0x7f0dc41554a0 0x7f0dc4067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc3e00700 1 -- 172.21.15.49:0/3613036005 >> v1:172.21.15.110:6789/0 conn(0x7f0dc40c8e70 legacy=0x7f0dc4151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc3e00700 1 -- 172.21.15.49:0/3613036005 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc41562b0 con 0x7f0dc4151a60 2024-01-22T05:05:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc3e00700 1 --2- 172.21.15.49:0/3613036005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc4151a60 0x7f0dc40c92d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f0dc4082e10 tx=0x7f0dbc009840).ready entity=mon.0 client_cookie=359e5a8408187074 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:24.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc1600700 1 -- 172.21.15.49:0/3613036005 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00e070 con 0x7f0dc4151a60 2024-01-22T05:05:24.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc1600700 1 -- 172.21.15.49:0/3613036005 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc00ba20 con 0x7f0dc4151a60 2024-01-22T05:05:24.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc1600700 1 -- 172.21.15.49:0/3613036005 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00bda0 con 0x7f0dc4151a60 2024-01-22T05:05:24.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc9c00700 1 -- 172.21.15.49:0/3613036005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc4151a60 msgr2=0x7f0dc40c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:24.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc9c00700 1 --2- 172.21.15.49:0/3613036005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc4151a60 0x7f0dc40c92d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f0dc4082e10 tx=0x7f0dbc009840).stop 2024-01-22T05:05:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc9c00700 1 -- 172.21.15.49:0/3613036005 shutdown_connections 2024-01-22T05:05:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc9c00700 1 --2- 172.21.15.49:0/3613036005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc4151a60 0x7f0dc40c92d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc9c00700 1 --2- 172.21.15.49:0/3613036005 >> v2:172.21.15.110:3300/0 conn(0x7f0dc41554a0 0x7f0dc4067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc9c00700 1 -- 172.21.15.49:0/3613036005 >> 172.21.15.49:0/3613036005 conn(0x7f0dc40c9f50 msgr2=0x7f0dc40ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc9c00700 1 -- 172.21.15.49:0/3613036005 shutdown_connections 2024-01-22T05:05:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.688+0000 7f0dc9c00700 1 -- 172.21.15.49:0/3613036005 wait complete. 2024-01-22T05:05:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.692+0000 7f0dc9c00700 1 Processor -- start 2024-01-22T05:05:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.692+0000 7f0dc9c00700 1 -- start start 2024-01-22T05:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc9c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dc40c8e70 0x7f0dc4168bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc9c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dc4151a60 0x7f0dc4063890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc9c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc41554a0 0x7f0dc4063d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc9c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc41690e0 con 0x7f0dc41554a0 2024-01-22T05:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc9c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40ad2c0 con 0x7f0dc40c8e70 2024-01-22T05:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc9c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40ad5a0 con 0x7f0dc4151a60 2024-01-22T05:05:24.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc41554a0 0x7f0dc4063d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:24.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc41554a0 0x7f0dc4063d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45662/0 (socket says 172.21.15.49:45662) 2024-01-22T05:05:24.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc3e00700 1 -- 172.21.15.49:0/844959051 learned_addr learned my addr 172.21.15.49:0/844959051 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:24.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc2000700 1 --2- 172.21.15.49:0/844959051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dc4151a60 0x7f0dc4063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:24.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc2a00700 1 --2- 172.21.15.49:0/844959051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dc40c8e70 0x7f0dc4168bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:24.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc3e00700 1 -- 172.21.15.49:0/844959051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dc4151a60 msgr2=0x7f0dc4063890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:24.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc3e00700 1 --2- 172.21.15.49:0/844959051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dc4151a60 0x7f0dc4063890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc3e00700 1 -- 172.21.15.49:0/844959051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dc40c8e70 msgr2=0x7f0dc4168bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:24.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc3e00700 1 --2- 172.21.15.49:0/844959051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dc40c8e70 0x7f0dc4168bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc3e00700 1 -- 172.21.15.49:0/844959051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc009ae0 con 0x7f0dc41554a0 2024-01-22T05:05:24.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc3e00700 1 --2- 172.21.15.49:0/844959051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc41554a0 0x7f0dc4063d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f0dc4082de0 tx=0x7f0dbc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dba000700 1 -- 172.21.15.49:0/844959051 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc007170 con 0x7f0dc41554a0 2024-01-22T05:05:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dba000700 1 -- 172.21.15.49:0/844959051 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc0092e0 con 0x7f0dc41554a0 2024-01-22T05:05:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc9c00700 1 -- 172.21.15.49:0/844959051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc40ad880 con 0x7f0dc41554a0 2024-01-22T05:05:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dba000700 1 -- 172.21.15.49:0/844959051 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc01d640 con 0x7f0dc41554a0 2024-01-22T05:05:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.696+0000 7f0dc9c00700 1 -- 172.21.15.49:0/844959051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc40ade40 con 0x7f0dc41554a0 2024-01-22T05:05:24.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.700+0000 7f0dc9c00700 1 -- 172.21.15.49:0/844959051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc40a91f0 con 0x7f0dc41554a0 2024-01-22T05:05:24.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.700+0000 7f0dba000700 1 -- 172.21.15.49:0/844959051 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0dbc01da70 con 0x7f0dc41554a0 2024-01-22T05:05:24.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.704+0000 7f0dba000700 1 --2- 172.21.15.49:0/844959051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0d9c05a4e0 0x7f0d9c05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:24.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.704+0000 7f0dba000700 1 -- 172.21.15.49:0/844959051 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7058+0+0 (secure 0 0 0) 0x7f0dbc0767b0 con 0x7f0dc41554a0 2024-01-22T05:05:24.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.704+0000 7f0dc2a00700 1 --2- 172.21.15.49:0/844959051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0d9c05a4e0 0x7f0d9c05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:24.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.704+0000 7f0dc2a00700 1 --2- 172.21.15.49:0/844959051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0d9c05a4e0 0x7f0d9c05c9a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0db4009b90 tx=0x7f0db4009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:24.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.708+0000 7f0dba000700 1 -- 172.21.15.49:0/844959051 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0dc40a91f0 con 0x7f0dc41554a0 2024-01-22T05:05:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.876+0000 7f0dc9c00700 1 -- 172.21.15.49:0/844959051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dc40a91f0 con 0x7f0dc41554a0 2024-01-22T05:05:24.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.880+0000 7f0dba000700 1 -- 172.21.15.49:0/844959051 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19053 (secure 0 0 0) 0x7f0dc40a91f0 con 0x7f0dc41554a0 2024-01-22T05:05:24.883 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:24.883 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:05:23.141884+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2},{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:05:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.880+0000 7f0dc9c00700 1 -- 172.21.15.49:0/844959051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0d9c05a4e0 msgr2=0x7f0d9c05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:24.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.880+0000 7f0dc9c00700 1 --2- 172.21.15.49:0/844959051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0d9c05a4e0 0x7f0d9c05c9a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0db4009b90 tx=0x7f0db4009060).stop 2024-01-22T05:05:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.880+0000 7f0dc9c00700 1 -- 172.21.15.49:0/844959051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc41554a0 msgr2=0x7f0dc4063d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.880+0000 7f0dc9c00700 1 --2- 172.21.15.49:0/844959051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc41554a0 0x7f0dc4063d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f0dc4082de0 tx=0x7f0dbc009840).stop 2024-01-22T05:05:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.884+0000 7f0dc9c00700 1 -- 172.21.15.49:0/844959051 shutdown_connections 2024-01-22T05:05:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.884+0000 7f0dc9c00700 1 --2- 172.21.15.49:0/844959051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0d9c05a4e0 0x7f0d9c05c9a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.884+0000 7f0dc9c00700 1 --2- 172.21.15.49:0/844959051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dc41554a0 0x7f0dc4063d80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.884+0000 7f0dc9c00700 1 --2- 172.21.15.49:0/844959051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dc4151a60 0x7f0dc4063890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.884+0000 7f0dc9c00700 1 --2- 172.21.15.49:0/844959051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dc40c8e70 0x7f0dc4168bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:24.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.884+0000 7f0dc9c00700 1 -- 172.21.15.49:0/844959051 >> 172.21.15.49:0/844959051 conn(0x7f0dc40c9f50 msgr2=0x7f0dc4153f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:24.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.884+0000 7f0dc9c00700 1 -- 172.21.15.49:0/844959051 shutdown_connections 2024-01-22T05:05:24.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:24.884+0000 7f0dc9c00700 1 -- 172.21.15.49:0/844959051 wait complete. 2024-01-22T05:05:24.911 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:04:32.991898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:04:34.057128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-22T05:04:37.108860+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:05:24.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:05:25.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.072+0000 7f6a4ac00700 1 Processor -- start 2024-01-22T05:05:25.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.076+0000 7f6a4ac00700 1 -- start start 2024-01-22T05:05:25.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.076+0000 7f6a4ac00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a44068460 0x7f6a440a7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.076+0000 7f6a4ac00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a440bdc70 con 0x7f6a440a7c40 2024-01-22T05:05:25.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.076+0000 7f6a4ac00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a440c4040 con 0x7f6a44155be0 2024-01-22T05:05:25.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.076+0000 7f6a4ac00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440bd9d0 con 0x7f6a44068460 2024-01-22T05:05:25.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.080+0000 7f6a43400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6a440a7c40 0x7f6a441554d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60458/0 (socket says 172.21.15.49:60458) 2024-01-22T05:05:25.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.080+0000 7f6a43400700 1 -- 172.21.15.49:0/3188424797 learned_addr learned my addr 172.21.15.49:0/3188424797 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:25.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.080+0000 7f6a43e00700 1 --2- 172.21.15.49:0/3188424797 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a44068460 0x7f6a440a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.080+0000 7f6a42a00700 1 -- 172.21.15.49:0/3188424797 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084721187 0 0) 0x7f6a440bdc70 con 0x7f6a440a7c40 2024-01-22T05:05:25.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.080+0000 7f6a42a00700 1 -- 172.21.15.49:0/3188424797 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a240033f0 con 0x7f6a440a7c40 2024-01-22T05:05:25.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.080+0000 7f6a42a00700 1 -- 172.21.15.49:0/3188424797 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254212326 0 0) 0x7f6a440c4040 con 0x7f6a44155be0 2024-01-22T05:05:25.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.080+0000 7f6a42a00700 1 -- 172.21.15.49:0/3188424797 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a440bdc70 con 0x7f6a44155be0 2024-01-22T05:05:25.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.080+0000 7f6a43e00700 1 -- 172.21.15.49:0/3188424797 >> v1:172.21.15.110:6789/0 conn(0x7f6a44155be0 legacy=0x7f6a440aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.080+0000 7f6a43e00700 1 -- 172.21.15.49:0/3188424797 >> v1:172.21.15.49:6789/0 conn(0x7f6a440a7c40 legacy=0x7f6a441554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.080+0000 7f6a43e00700 1 -- 172.21.15.49:0/3188424797 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a440a8040 con 0x7f6a44068460 2024-01-22T05:05:25.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.080+0000 7f6a43e00700 1 --2- 172.21.15.49:0/3188424797 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a44068460 0x7f6a440a7750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6a34009790 tx=0x7f6a34009060).ready entity=mon.2 client_cookie=3957141c227723db server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:25.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.080+0000 7f6a42a00700 1 -- 172.21.15.49:0/3188424797 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3400f510 con 0x7f6a44068460 2024-01-22T05:05:25.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.080+0000 7f6a42a00700 1 -- 172.21.15.49:0/3188424797 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3400f670 con 0x7f6a44068460 2024-01-22T05:05:25.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.080+0000 7f6a42a00700 1 -- 172.21.15.49:0/3188424797 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3400f9f0 con 0x7f6a44068460 2024-01-22T05:05:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.084+0000 7f6a4ac00700 1 -- 172.21.15.49:0/3188424797 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a44068460 msgr2=0x7f6a440a7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.084+0000 7f6a4ac00700 1 --2- 172.21.15.49:0/3188424797 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a44068460 0x7f6a440a7750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6a34009790 tx=0x7f6a34009060).stop 2024-01-22T05:05:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.084+0000 7f6a4ac00700 1 -- 172.21.15.49:0/3188424797 shutdown_connections 2024-01-22T05:05:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.084+0000 7f6a4ac00700 1 --2- 172.21.15.49:0/3188424797 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a44068460 0x7f6a440a7750 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.084+0000 7f6a4ac00700 1 -- 172.21.15.49:0/3188424797 >> 172.21.15.49:0/3188424797 conn(0x7f6a440c8780 msgr2=0x7f6a440c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:25.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.084+0000 7f6a4ac00700 1 -- 172.21.15.49:0/3188424797 shutdown_connections 2024-01-22T05:05:25.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.084+0000 7f6a4ac00700 1 -- 172.21.15.49:0/3188424797 wait complete. 2024-01-22T05:05:25.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.084+0000 7f6a4ac00700 1 Processor -- start 2024-01-22T05:05:25.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a4ac00700 1 -- start start 2024-01-22T05:05:25.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a4ac00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a44068460 0x7f6a44157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a4ac00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a440a7c40 0x7f6a440ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a4ac00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a44155be0 0x7f6a440ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a4ac00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a44157af0 con 0x7f6a44155be0 2024-01-22T05:05:25.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a4ac00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440acab0 con 0x7f6a44068460 2024-01-22T05:05:25.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a4ac00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a441588f0 con 0x7f6a440a7c40 2024-01-22T05:05:25.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a48c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a44155be0 0x7f6a440ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a43400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a440a7c40 0x7f6a440ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a48c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a44155be0 0x7f6a440ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45666/0 (socket says 172.21.15.49:45666) 2024-01-22T05:05:25.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a43e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a44068460 0x7f6a44157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a48c00700 1 -- 172.21.15.49:0/1498382195 learned_addr learned my addr 172.21.15.49:0/1498382195 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:25.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a48c00700 1 -- 172.21.15.49:0/1498382195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a440a7c40 msgr2=0x7f6a440ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a48c00700 1 --2- 172.21.15.49:0/1498382195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a440a7c40 0x7f6a440ac5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a48c00700 1 -- 172.21.15.49:0/1498382195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a44068460 msgr2=0x7f6a44157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a48c00700 1 --2- 172.21.15.49:0/1498382195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a44068460 0x7f6a44157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.088+0000 7f6a48c00700 1 -- 172.21.15.49:0/1498382195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a340092a0 con 0x7f6a44155be0 2024-01-22T05:05:25.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.092+0000 7f6a43400700 1 --2- 172.21.15.49:0/1498382195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a440a7c40 0x7f6a440ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:25.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.092+0000 7f6a48c00700 1 --2- 172.21.15.49:0/1498382195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a44155be0 0x7f6a440ad590 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f6a3c00c790 tx=0x7f6a3c007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:25.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.092+0000 7f6a3b400700 1 -- 172.21.15.49:0/1498382195 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c00e4a0 con 0x7f6a44155be0 2024-01-22T05:05:25.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.092+0000 7f6a3b400700 1 -- 172.21.15.49:0/1498382195 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c00e600 con 0x7f6a44155be0 2024-01-22T05:05:25.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.092+0000 7f6a4ac00700 1 -- 172.21.15.49:0/1498382195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a44157ce0 con 0x7f6a44155be0 2024-01-22T05:05:25.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.092+0000 7f6a3b400700 1 -- 172.21.15.49:0/1498382195 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c00e9a0 con 0x7f6a44155be0 2024-01-22T05:05:25.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.092+0000 7f6a4ac00700 1 -- 172.21.15.49:0/1498382195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a44158070 con 0x7f6a44155be0 2024-01-22T05:05:25.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.092+0000 7f6a4ac00700 1 -- 172.21.15.49:0/1498382195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a44158a30 con 0x7f6a44155be0 2024-01-22T05:05:25.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.092+0000 7f6a3b400700 1 -- 172.21.15.49:0/1498382195 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6a3c00ed10 con 0x7f6a44155be0 2024-01-22T05:05:25.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.096+0000 7f6a3b400700 1 --2- 172.21.15.49:0/1498382195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6a1c05a510 0x7f6a1c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.096+0000 7f6a3b400700 1 -- 172.21.15.49:0/1498382195 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7058+0+0 (secure 0 0 0) 0x7f6a3c074380 con 0x7f6a44155be0 2024-01-22T05:05:25.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.096+0000 7f6a43e00700 1 --2- 172.21.15.49:0/1498382195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6a1c05a510 0x7f6a1c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.096+0000 7f6a43e00700 1 --2- 172.21.15.49:0/1498382195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6a1c05a510 0x7f6a1c05c9d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f6a34009fd0 tx=0x7f6a34017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:25.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.104+0000 7f6a3b400700 1 -- 172.21.15.49:0/1498382195 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6a3c0476f0 con 0x7f6a44155be0 2024-01-22T05:05:25.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.272+0000 7f6a4ac00700 1 -- 172.21.15.49:0/1498382195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6a44158640 con 0x7f6a44155be0 2024-01-22T05:05:25.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.272+0000 7f6a3b400700 1 -- 172.21.15.49:0/1498382195 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v27) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6a3c017070 con 0x7f6a44155be0 2024-01-22T05:05:25.277 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:05:25.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.276+0000 7f6a4ac00700 1 -- 172.21.15.49:0/1498382195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6a1c05a510 msgr2=0x7f6a1c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.276+0000 7f6a4ac00700 1 --2- 172.21.15.49:0/1498382195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6a1c05a510 0x7f6a1c05c9d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f6a34009fd0 tx=0x7f6a34017000).stop 2024-01-22T05:05:25.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.276+0000 7f6a4ac00700 1 -- 172.21.15.49:0/1498382195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a44155be0 msgr2=0x7f6a440ad590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.276+0000 7f6a4ac00700 1 --2- 172.21.15.49:0/1498382195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a44155be0 0x7f6a440ad590 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f6a3c00c790 tx=0x7f6a3c007f20).stop 2024-01-22T05:05:25.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.276+0000 7f6a4ac00700 1 -- 172.21.15.49:0/1498382195 shutdown_connections 2024-01-22T05:05:25.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.276+0000 7f6a4ac00700 1 --2- 172.21.15.49:0/1498382195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6a1c05a510 0x7f6a1c05c9d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.276+0000 7f6a4ac00700 1 --2- 172.21.15.49:0/1498382195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a44155be0 0x7f6a440ad590 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.276+0000 7f6a4ac00700 1 --2- 172.21.15.49:0/1498382195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a440a7c40 0x7f6a440ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.276+0000 7f6a4ac00700 1 --2- 172.21.15.49:0/1498382195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a44068460 0x7f6a44157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.276+0000 7f6a4ac00700 1 -- 172.21.15.49:0/1498382195 >> 172.21.15.49:0/1498382195 conn(0x7f6a440c8780 msgr2=0x7f6a441534f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:25.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.276+0000 7f6a4ac00700 1 -- 172.21.15.49:0/1498382195 shutdown_connections 2024-01-22T05:05:25.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.276+0000 7f6a4ac00700 1 -- 172.21.15.49:0/1498382195 wait complete. 2024-01-22T05:05:25.306 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:05:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.488+0000 7f876a400700 1 Processor -- start 2024-01-22T05:05:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.488+0000 7f876a400700 1 -- start start 2024-01-22T05:05:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.492+0000 7f876a400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87640644b0 0x7f87640c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.492+0000 7f876a400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87640c3520 con 0x7f87640c2110 2024-01-22T05:05:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.492+0000 7f876a400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87640c2910 con 0x7f8764155c20 2024-01-22T05:05:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.492+0000 7f876a400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87640c2bf0 con 0x7f87640644b0 2024-01-22T05:05:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.492+0000 7f8763e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87640644b0 0x7f87640c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f8769000700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8764155c20 0x7f8764063da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:41910/0 (socket says 172.21.15.49:41910) 2024-01-22T05:05:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f8769000700 1 -- 172.21.15.49:0/920578901 learned_addr learned my addr 172.21.15.49:0/920578901 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f8769a00700 1 --1- 172.21.15.49:0/920578901 >> v1:172.21.15.49:6789/0 conn(0x7f87640c2110 0x7f87640687f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60460/0 (socket says 172.21.15.49:60460) 2024-01-22T05:05:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f8763400700 1 -- 172.21.15.49:0/920578901 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203846512 0 0) 0x7f87640c2910 con 0x7f8764155c20 2024-01-22T05:05:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f8763400700 1 -- 172.21.15.49:0/920578901 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87440033f0 con 0x7f8764155c20 2024-01-22T05:05:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f8763400700 1 -- 172.21.15.49:0/920578901 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955691654 0 0) 0x7f87640c3520 con 0x7f87640c2110 2024-01-22T05:05:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f8763400700 1 -- 172.21.15.49:0/920578901 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87640c2910 con 0x7f87640c2110 2024-01-22T05:05:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f8763e00700 1 -- 172.21.15.49:0/920578901 >> v1:172.21.15.110:6789/0 conn(0x7f8764155c20 legacy=0x7f8764063da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f8763e00700 1 -- 172.21.15.49:0/920578901 >> v1:172.21.15.49:6789/0 conn(0x7f87640c2110 legacy=0x7f87640687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f8763e00700 1 -- 172.21.15.49:0/920578901 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87640c2ed0 con 0x7f87640644b0 2024-01-22T05:05:25.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f8763e00700 1 --2- 172.21.15.49:0/920578901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87640644b0 0x7f87640c1c20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f874c009760 tx=0x7f874c009060).ready entity=mon.0 client_cookie=ff4917f8b26930f9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:25.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f8763400700 1 -- 172.21.15.49:0/920578901 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c00d4a0 con 0x7f87640644b0 2024-01-22T05:05:25.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f8763400700 1 -- 172.21.15.49:0/920578901 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c00d600 con 0x7f87640644b0 2024-01-22T05:05:25.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f8763400700 1 -- 172.21.15.49:0/920578901 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c00d980 con 0x7f87640644b0 2024-01-22T05:05:25.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f876a400700 1 -- 172.21.15.49:0/920578901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87640644b0 msgr2=0x7f87640c1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.496+0000 7f876a400700 1 --2- 172.21.15.49:0/920578901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87640644b0 0x7f87640c1c20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f874c009760 tx=0x7f874c009060).stop 2024-01-22T05:05:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.500+0000 7f876a400700 1 -- 172.21.15.49:0/920578901 shutdown_connections 2024-01-22T05:05:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.500+0000 7f876a400700 1 --2- 172.21.15.49:0/920578901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87640644b0 0x7f87640c1c20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.500+0000 7f876a400700 1 -- 172.21.15.49:0/920578901 >> 172.21.15.49:0/920578901 conn(0x7f8764062760 msgr2=0x7f8764062b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.500+0000 7f876a400700 1 -- 172.21.15.49:0/920578901 shutdown_connections 2024-01-22T05:05:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.500+0000 7f876a400700 1 -- 172.21.15.49:0/920578901 wait complete. 2024-01-22T05:05:25.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.500+0000 7f876a400700 1 Processor -- start 2024-01-22T05:05:25.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.500+0000 7f876a400700 1 -- start start 2024-01-22T05:05:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f876a400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87640644b0 0x7f87640a7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f876a400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87640c2110 0x7f87640c0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f876a400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8764155c20 0x7f8764154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f876a400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87641689c0 con 0x7f87640644b0 2024-01-22T05:05:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f876a400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87640c0630 con 0x7f87640c2110 2024-01-22T05:05:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f876a400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87640a76e0 con 0x7f8764155c20 2024-01-22T05:05:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f8769000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87640644b0 0x7f87640a7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f8769000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87640644b0 0x7f87640a7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45684/0 (socket says 172.21.15.49:45684) 2024-01-22T05:05:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f8769000700 1 -- 172.21.15.49:0/3403426476 learned_addr learned my addr 172.21.15.49:0/3403426476 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f8763e00700 1 --2- 172.21.15.49:0/3403426476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87640c2110 0x7f87640c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f8769a00700 1 --2- 172.21.15.49:0/3403426476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8764155c20 0x7f8764154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f8769000700 1 -- 172.21.15.49:0/3403426476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8764155c20 msgr2=0x7f8764154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f8769000700 1 --2- 172.21.15.49:0/3403426476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8764155c20 0x7f8764154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f8769000700 1 -- 172.21.15.49:0/3403426476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87640c2110 msgr2=0x7f87640c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f8769000700 1 --2- 172.21.15.49:0/3403426476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87640c2110 0x7f87640c0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f8769000700 1 -- 172.21.15.49:0/3403426476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c0092a0 con 0x7f87640644b0 2024-01-22T05:05:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f8769000700 1 --2- 172.21.15.49:0/3403426476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87640644b0 0x7f87640a7100 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f875400c490 tx=0x7f8754007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f875be00700 1 -- 172.21.15.49:0/3403426476 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540070d0 con 0x7f87640644b0 2024-01-22T05:05:25.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f875be00700 1 -- 172.21.15.49:0/3403426476 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8754007230 con 0x7f87640644b0 2024-01-22T05:05:25.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f876a400700 1 -- 172.21.15.49:0/3403426476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87640a79c0 con 0x7f87640644b0 2024-01-22T05:05:25.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.504+0000 7f875be00700 1 -- 172.21.15.49:0/3403426476 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540075b0 con 0x7f87640644b0 2024-01-22T05:05:25.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.508+0000 7f876a400700 1 -- 172.21.15.49:0/3403426476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87640a7f80 con 0x7f87640644b0 2024-01-22T05:05:25.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.508+0000 7f876a400700 1 -- 172.21.15.49:0/3403426476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87640656d0 con 0x7f87640644b0 2024-01-22T05:05:25.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.508+0000 7f875be00700 1 -- 172.21.15.49:0/3403426476 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f87540059b0 con 0x7f87640644b0 2024-01-22T05:05:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.508+0000 7f875be00700 1 --2- 172.21.15.49:0/3403426476 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f873c05a510 0x7f873c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.508+0000 7f875be00700 1 -- 172.21.15.49:0/3403426476 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7058+0+0 (secure 0 0 0) 0x7f8754074200 con 0x7f87640644b0 2024-01-22T05:05:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.508+0000 7f8763e00700 1 --2- 172.21.15.49:0/3403426476 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f873c05a510 0x7f873c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.512+0000 7f8763e00700 1 --2- 172.21.15.49:0/3403426476 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f873c05a510 0x7f873c05c9d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f87640648b0 tx=0x7f874c016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:25.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.516+0000 7f875be00700 1 -- 172.21.15.49:0/3403426476 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8754047630 con 0x7f87640644b0 2024-01-22T05:05:25.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.680+0000 7f876a400700 1 -- 172.21.15.49:0/3403426476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f87640c31b0 con 0x7f87640644b0 2024-01-22T05:05:25.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.684+0000 7f875be00700 1 -- 172.21.15.49:0/3403426476 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f875404ac50 con 0x7f87640644b0 2024-01-22T05:05:25.686 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:05:25.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.688+0000 7f876a400700 1 -- 172.21.15.49:0/3403426476 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f873c05a510 msgr2=0x7f873c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.688+0000 7f876a400700 1 --2- 172.21.15.49:0/3403426476 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f873c05a510 0x7f873c05c9d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f87640648b0 tx=0x7f874c016000).stop 2024-01-22T05:05:25.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.688+0000 7f876a400700 1 -- 172.21.15.49:0/3403426476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87640644b0 msgr2=0x7f87640a7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.688+0000 7f876a400700 1 --2- 172.21.15.49:0/3403426476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87640644b0 0x7f87640a7100 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f875400c490 tx=0x7f8754007d20).stop 2024-01-22T05:05:25.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.688+0000 7f876a400700 1 -- 172.21.15.49:0/3403426476 shutdown_connections 2024-01-22T05:05:25.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.688+0000 7f876a400700 1 --2- 172.21.15.49:0/3403426476 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f873c05a510 0x7f873c05c9d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.688+0000 7f876a400700 1 --2- 172.21.15.49:0/3403426476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8764155c20 0x7f8764154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.688+0000 7f876a400700 1 --2- 172.21.15.49:0/3403426476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87640c2110 0x7f87640c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.688+0000 7f876a400700 1 --2- 172.21.15.49:0/3403426476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87640644b0 0x7f87640a7100 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.688+0000 7f876a400700 1 -- 172.21.15.49:0/3403426476 >> 172.21.15.49:0/3403426476 conn(0x7f8764062760 msgr2=0x7f87640bd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:25.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.688+0000 7f876a400700 1 -- 172.21.15.49:0/3403426476 shutdown_connections 2024-01-22T05:05:25.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.688+0000 7f876a400700 1 -- 172.21.15.49:0/3403426476 wait complete. 2024-01-22T05:05:25.714 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:05:25.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.880+0000 7f0939200700 1 Processor -- start 2024-01-22T05:05:25.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.880+0000 7f0939200700 1 -- start start 2024-01-22T05:05:25.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.884+0000 7f0939200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0934063df0 0x7f09340642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.884+0000 7f0939200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09340c1c50 0x7f09340c2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.884+0000 7f0939200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0934064790 con 0x7f09341582a0 2024-01-22T05:05:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.884+0000 7f0939200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093406a400 con 0x7f0934063df0 2024-01-22T05:05:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.884+0000 7f0939200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0934069f70 con 0x7f09340c1c50 2024-01-22T05:05:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.884+0000 7f0931400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0934063df0 0x7f09340642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.884+0000 7f0931e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f09341582a0 0x7f0934068880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60464/0 (socket says 172.21.15.49:60464) 2024-01-22T05:05:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.884+0000 7f0931e00700 1 -- 172.21.15.49:0/990726588 learned_addr learned my addr 172.21.15.49:0/990726588 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.884+0000 7f0932800700 1 --2- 172.21.15.49:0/990726588 >> v2:172.21.15.110:3300/0 conn(0x7f09340c1c50 0x7f09340c2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.884+0000 7f0930a00700 1 -- 172.21.15.49:0/990726588 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871695148 0 0) 0x7f0924001110 con 0x7f09341582a0 2024-01-22T05:05:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0930a00700 1 -- 172.21.15.49:0/990726588 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09140033f0 con 0x7f09341582a0 2024-01-22T05:05:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0931400700 1 -- 172.21.15.49:0/990726588 >> v2:172.21.15.110:3300/0 conn(0x7f09340c1c50 msgr2=0x7f09340c2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0931400700 1 --2- 172.21.15.49:0/990726588 >> v2:172.21.15.110:3300/0 conn(0x7f09340c1c50 0x7f09340c2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0931400700 1 -- 172.21.15.49:0/990726588 >> v1:172.21.15.49:6789/0 conn(0x7f09341582a0 legacy=0x7f0934068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0931400700 1 -- 172.21.15.49:0/990726588 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0934069360 con 0x7f0934063df0 2024-01-22T05:05:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0931400700 1 --2- 172.21.15.49:0/990726588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0934063df0 0x7f09340642a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f09340a70e0 tx=0x7f091c009060).ready entity=mon.0 client_cookie=97f595811880a1b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0930a00700 1 -- 172.21.15.49:0/990726588 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00d4a0 con 0x7f0934063df0 2024-01-22T05:05:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0930a00700 1 -- 172.21.15.49:0/990726588 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c00d600 con 0x7f0934063df0 2024-01-22T05:05:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0930a00700 1 -- 172.21.15.49:0/990726588 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00d980 con 0x7f0934063df0 2024-01-22T05:05:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0939200700 1 -- 172.21.15.49:0/990726588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0934063df0 msgr2=0x7f09340642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0939200700 1 --2- 172.21.15.49:0/990726588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0934063df0 0x7f09340642a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f09340a70e0 tx=0x7f091c009060).stop 2024-01-22T05:05:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0939200700 1 -- 172.21.15.49:0/990726588 shutdown_connections 2024-01-22T05:05:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0939200700 1 --2- 172.21.15.49:0/990726588 >> v2:172.21.15.110:3300/0 conn(0x7f09340c1c50 0x7f09340c2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0939200700 1 --2- 172.21.15.49:0/990726588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0934063df0 0x7f09340642a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0939200700 1 -- 172.21.15.49:0/990726588 >> 172.21.15.49:0/990726588 conn(0x7f09340c40f0 msgr2=0x7f09340c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0939200700 1 -- 172.21.15.49:0/990726588 shutdown_connections 2024-01-22T05:05:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.888+0000 7f0939200700 1 -- 172.21.15.49:0/990726588 wait complete. 2024-01-22T05:05:25.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.892+0000 7f0939200700 1 Processor -- start 2024-01-22T05:05:25.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.892+0000 7f0939200700 1 -- start start 2024-01-22T05:05:25.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.892+0000 7f0939200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934063df0 0x7f09340acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.892+0000 7f0939200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09340c1c50 0x7f093416c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.892+0000 7f0939200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09341582a0 0x7f093416c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.892+0000 7f0939200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093416cbf0 con 0x7f09341582a0 2024-01-22T05:05:25.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.892+0000 7f0939200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0934144a90 con 0x7f0934063df0 2024-01-22T05:05:25.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.892+0000 7f0939200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0934143e80 con 0x7f09340c1c50 2024-01-22T05:05:25.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0932800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09341582a0 0x7f093416c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0932800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09341582a0 0x7f093416c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45696/0 (socket says 172.21.15.49:45696) 2024-01-22T05:05:25.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0932800700 1 -- 172.21.15.49:0/331681927 learned_addr learned my addr 172.21.15.49:0/331681927 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0931400700 1 --2- 172.21.15.49:0/331681927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09340c1c50 0x7f093416c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0931e00700 1 --2- 172.21.15.49:0/331681927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934063df0 0x7f09340acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0932800700 1 -- 172.21.15.49:0/331681927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09340c1c50 msgr2=0x7f093416c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0932800700 1 --2- 172.21.15.49:0/331681927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09340c1c50 0x7f093416c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0932800700 1 -- 172.21.15.49:0/331681927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934063df0 msgr2=0x7f09340acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0932800700 1 --2- 172.21.15.49:0/331681927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934063df0 0x7f09340acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0932800700 1 -- 172.21.15.49:0/331681927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c0092a0 con 0x7f09341582a0 2024-01-22T05:05:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0931e00700 1 --2- 172.21.15.49:0/331681927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934063df0 0x7f09340acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0932800700 1 --2- 172.21.15.49:0/331681927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09341582a0 0x7f093416c700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f092c009e90 tx=0x7f092c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0929600700 1 -- 172.21.15.49:0/331681927 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c00cc20 con 0x7f09341582a0 2024-01-22T05:05:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0929600700 1 -- 172.21.15.49:0/331681927 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c00f040 con 0x7f09341582a0 2024-01-22T05:05:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0939200700 1 -- 172.21.15.49:0/331681927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0934144160 con 0x7f09341582a0 2024-01-22T05:05:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0929600700 1 -- 172.21.15.49:0/331681927 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c013400 con 0x7f09341582a0 2024-01-22T05:05:25.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.896+0000 7f0939200700 1 -- 172.21.15.49:0/331681927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09341447a0 con 0x7f09341582a0 2024-01-22T05:05:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.900+0000 7f0939200700 1 -- 172.21.15.49:0/331681927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0934144c00 con 0x7f09341582a0 2024-01-22T05:05:25.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.900+0000 7f0929600700 1 -- 172.21.15.49:0/331681927 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f092c0137b0 con 0x7f09341582a0 2024-01-22T05:05:25.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.900+0000 7f0929600700 1 --2- 172.21.15.49:0/331681927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f090c05a510 0x7f090c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:25.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.900+0000 7f0929600700 1 -- 172.21.15.49:0/331681927 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7058+0+0 (secure 0 0 0) 0x7f092c0754b0 con 0x7f09341582a0 2024-01-22T05:05:25.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.900+0000 7f0931e00700 1 --2- 172.21.15.49:0/331681927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f090c05a510 0x7f090c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:25.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.900+0000 7f0931e00700 1 --2- 172.21.15.49:0/331681927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f090c05a510 0x7f090c05c9d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f0924007fd0 tx=0x7f0924009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:25.904+0000 7f0929600700 1 -- 172.21.15.49:0/331681927 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f092c0488e0 con 0x7f09341582a0 2024-01-22T05:05:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.076+0000 7f0939200700 1 -- 172.21.15.49:0/331681927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f09340656b0 con 0x7f09341582a0 2024-01-22T05:05:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.076+0000 7f0929600700 1 -- 172.21.15.49:0/331681927 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f092c04bf00 con 0x7f09341582a0 2024-01-22T05:05:26.081 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:05:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.080+0000 7f0939200700 1 -- 172.21.15.49:0/331681927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f090c05a510 msgr2=0x7f090c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:26.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.080+0000 7f0939200700 1 --2- 172.21.15.49:0/331681927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f090c05a510 0x7f090c05c9d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f0924007fd0 tx=0x7f0924009040).stop 2024-01-22T05:05:26.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.080+0000 7f0939200700 1 -- 172.21.15.49:0/331681927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09341582a0 msgr2=0x7f093416c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:26.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.080+0000 7f0939200700 1 --2- 172.21.15.49:0/331681927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09341582a0 0x7f093416c700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f092c009e90 tx=0x7f092c00b040).stop 2024-01-22T05:05:26.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.080+0000 7f0939200700 1 -- 172.21.15.49:0/331681927 shutdown_connections 2024-01-22T05:05:26.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.080+0000 7f0939200700 1 --2- 172.21.15.49:0/331681927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f090c05a510 0x7f090c05c9d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.080+0000 7f0939200700 1 --2- 172.21.15.49:0/331681927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09341582a0 0x7f093416c700 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.080+0000 7f0939200700 1 --2- 172.21.15.49:0/331681927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09340c1c50 0x7f093416c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.080+0000 7f0939200700 1 --2- 172.21.15.49:0/331681927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934063df0 0x7f09340acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.080+0000 7f0939200700 1 -- 172.21.15.49:0/331681927 >> 172.21.15.49:0/331681927 conn(0x7f09340c40f0 msgr2=0x7f09340bc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:26.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.080+0000 7f0939200700 1 -- 172.21.15.49:0/331681927 shutdown_connections 2024-01-22T05:05:26.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.080+0000 7f0939200700 1 -- 172.21.15.49:0/331681927 wait complete. 2024-01-22T05:05:26.107 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:05:26.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.268+0000 7fc652600700 1 Processor -- start 2024-01-22T05:05:26.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.272+0000 7fc652600700 1 -- start start 2024-01-22T05:05:26.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.272+0000 7fc652600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc64c0c0760 0x7fc64c1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:26.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.272+0000 7fc652600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc64c151ba0 0x7fc64c067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:26.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.272+0000 7fc652600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64c155770 con 0x7fc64c067f80 2024-01-22T05:05:26.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.272+0000 7fc652600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c0c2e40 con 0x7fc64c0c0760 2024-01-22T05:05:26.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.272+0000 7fc652600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0c2880 con 0x7fc64c151ba0 2024-01-22T05:05:26.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.272+0000 7fc64be00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc64c067f80 0x7fc64c155c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60468/0 (socket says 172.21.15.49:60468) 2024-01-22T05:05:26.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.272+0000 7fc64be00700 1 -- 172.21.15.49:0/2328406280 learned_addr learned my addr 172.21.15.49:0/2328406280 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:26.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.276+0000 7fc64b400700 1 --2- 172.21.15.49:0/2328406280 >> v2:172.21.15.110:3300/0 conn(0x7fc64c0c0760 0x7fc64c1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:26.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.276+0000 7fc64aa00700 1 --2- 172.21.15.49:0/2328406280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc64c151ba0 0x7fc64c067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:26.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.276+0000 7fc64a000700 1 -- 172.21.15.49:0/2328406280 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077487170 0 0) 0x7fc64c155770 con 0x7fc64c067f80 2024-01-22T05:05:26.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.276+0000 7fc64a000700 1 -- 172.21.15.49:0/2328406280 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc62c0033f0 con 0x7fc64c067f80 2024-01-22T05:05:26.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.276+0000 7fc64b400700 1 -- 172.21.15.49:0/2328406280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc64c151ba0 msgr2=0x7fc64c067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:26.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.276+0000 7fc64b400700 1 --2- 172.21.15.49:0/2328406280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc64c151ba0 0x7fc64c067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.276+0000 7fc64b400700 1 -- 172.21.15.49:0/2328406280 >> v1:172.21.15.49:6789/0 conn(0x7fc64c067f80 legacy=0x7fc64c155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:26.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.276+0000 7fc64a000700 1 -- 172.21.15.49:0/2328406280 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3441993303 0 0) 0x7fc62c0033f0 con 0x7fc64c067f80 2024-01-22T05:05:26.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.276+0000 7fc64b400700 1 -- 172.21.15.49:0/2328406280 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c0c2b60 con 0x7fc64c0c0760 2024-01-22T05:05:26.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.276+0000 7fc64b400700 1 --2- 172.21.15.49:0/2328406280 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc64c0c0760 0x7fc64c1516b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fc63c009760 tx=0x7fc63c009060).ready entity=mon.1 client_cookie=41972afb50b3b16 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:26.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.276+0000 7fc64a000700 1 -- 172.21.15.49:0/2328406280 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c0090d0 con 0x7fc64c0c0760 2024-01-22T05:05:26.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.276+0000 7fc64a000700 1 -- 172.21.15.49:0/2328406280 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63c00d4a0 con 0x7fc64c0c0760 2024-01-22T05:05:26.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.276+0000 7fc64a000700 1 -- 172.21.15.49:0/2328406280 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00d820 con 0x7fc64c0c0760 2024-01-22T05:05:26.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.276+0000 7fc652600700 1 -- 172.21.15.49:0/2328406280 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc64c0c0760 msgr2=0x7fc64c1516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.276+0000 7fc652600700 1 --2- 172.21.15.49:0/2328406280 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc64c0c0760 0x7fc64c1516b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fc63c009760 tx=0x7fc63c009060).stop 2024-01-22T05:05:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.280+0000 7fc652600700 1 -- 172.21.15.49:0/2328406280 shutdown_connections 2024-01-22T05:05:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.280+0000 7fc652600700 1 --2- 172.21.15.49:0/2328406280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc64c151ba0 0x7fc64c067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.280+0000 7fc652600700 1 --2- 172.21.15.49:0/2328406280 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc64c0c0760 0x7fc64c1516b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.280+0000 7fc652600700 1 -- 172.21.15.49:0/2328406280 >> 172.21.15.49:0/2328406280 conn(0x7fc64c062cb0 msgr2=0x7fc64c0c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:26.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.280+0000 7fc652600700 1 -- 172.21.15.49:0/2328406280 shutdown_connections 2024-01-22T05:05:26.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.280+0000 7fc652600700 1 -- 172.21.15.49:0/2328406280 wait complete. 2024-01-22T05:05:26.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.280+0000 7fc652600700 1 Processor -- start 2024-01-22T05:05:26.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc652600700 1 -- start start 2024-01-22T05:05:26.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc652600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc64c067f80 0x7fc64c0bd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:26.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc652600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc64c0c0760 0x7fc64c0bf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:26.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc652600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc64c151ba0 0x7fc64c13de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:26.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc652600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c168b80 con 0x7fc64c151ba0 2024-01-22T05:05:26.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc652600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0bdaf0 con 0x7fc64c067f80 2024-01-22T05:05:26.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc652600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0bf990 con 0x7fc64c0c0760 2024-01-22T05:05:26.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc64be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc64c151ba0 0x7fc64c13de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc64be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc64c151ba0 0x7fc64c13de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45704/0 (socket says 172.21.15.49:45704) 2024-01-22T05:05:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc64be00700 1 -- 172.21.15.49:0/1861238729 learned_addr learned my addr 172.21.15.49:0/1861238729 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc64b400700 1 --2- 172.21.15.49:0/1861238729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc64c067f80 0x7fc64c0bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc64aa00700 1 --2- 172.21.15.49:0/1861238729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc64c0c0760 0x7fc64c0bf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc64be00700 1 -- 172.21.15.49:0/1861238729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc64c0c0760 msgr2=0x7fc64c0bf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc64be00700 1 --2- 172.21.15.49:0/1861238729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc64c0c0760 0x7fc64c0bf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc64be00700 1 -- 172.21.15.49:0/1861238729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc64c067f80 msgr2=0x7fc64c0bd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc64be00700 1 --2- 172.21.15.49:0/1861238729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc64c067f80 0x7fc64c0bd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc64be00700 1 -- 172.21.15.49:0/1861238729 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c0092a0 con 0x7fc64c151ba0 2024-01-22T05:05:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc64be00700 1 --2- 172.21.15.49:0/1861238729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc64c151ba0 0x7fc64c13de50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fc64400c810 tx=0x7fc644007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc642a00700 1 -- 172.21.15.49:0/1861238729 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644004c40 con 0x7fc64c151ba0 2024-01-22T05:05:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc642a00700 1 -- 172.21.15.49:0/1861238729 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc644004dc0 con 0x7fc64c151ba0 2024-01-22T05:05:26.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc652600700 1 -- 172.21.15.49:0/1861238729 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c168000 con 0x7fc64c151ba0 2024-01-22T05:05:26.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc642a00700 1 -- 172.21.15.49:0/1861238729 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6440073c0 con 0x7fc64c151ba0 2024-01-22T05:05:26.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.284+0000 7fc652600700 1 -- 172.21.15.49:0/1861238729 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c1685c0 con 0x7fc64c151ba0 2024-01-22T05:05:26.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.288+0000 7fc652600700 1 -- 172.21.15.49:0/1861238729 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c0c0c00 con 0x7fc64c151ba0 2024-01-22T05:05:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.288+0000 7fc642a00700 1 -- 172.21.15.49:0/1861238729 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc6440077b0 con 0x7fc64c151ba0 2024-01-22T05:05:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.288+0000 7fc642a00700 1 --2- 172.21.15.49:0/1861238729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc62405a510 0x7fc62405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.288+0000 7fc642a00700 1 -- 172.21.15.49:0/1861238729 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7058+0+0 (secure 0 0 0) 0x7fc6440747f0 con 0x7fc64c151ba0 2024-01-22T05:05:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.288+0000 7fc64b400700 1 --2- 172.21.15.49:0/1861238729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc62405a510 0x7fc62405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.292+0000 7fc64b400700 1 --2- 172.21.15.49:0/1861238729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc62405a510 0x7fc62405c9d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fc63c00d260 tx=0x7fc63c016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:26.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.296+0000 7fc642a00700 1 -- 172.21.15.49:0/1861238729 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc644047c20 con 0x7fc64c151ba0 2024-01-22T05:05:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.460+0000 7fc652600700 1 -- 172.21.15.49:0/1861238729 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc64c0c2530 con 0x7fc64c151ba0 2024-01-22T05:05:26.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.460+0000 7fc642a00700 1 -- 172.21.15.49:0/1861238729 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc644019030 con 0x7fc64c151ba0 2024-01-22T05:05:26.465 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:05:26.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.464+0000 7fc652600700 1 -- 172.21.15.49:0/1861238729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc62405a510 msgr2=0x7fc62405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:26.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.464+0000 7fc652600700 1 --2- 172.21.15.49:0/1861238729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc62405a510 0x7fc62405c9d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fc63c00d260 tx=0x7fc63c016000).stop 2024-01-22T05:05:26.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.464+0000 7fc652600700 1 -- 172.21.15.49:0/1861238729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc64c151ba0 msgr2=0x7fc64c13de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:26.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.464+0000 7fc652600700 1 --2- 172.21.15.49:0/1861238729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc64c151ba0 0x7fc64c13de50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fc64400c810 tx=0x7fc644007f70).stop 2024-01-22T05:05:26.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.464+0000 7fc652600700 1 -- 172.21.15.49:0/1861238729 shutdown_connections 2024-01-22T05:05:26.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.464+0000 7fc652600700 1 --2- 172.21.15.49:0/1861238729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc62405a510 0x7fc62405c9d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.464+0000 7fc652600700 1 --2- 172.21.15.49:0/1861238729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc64c151ba0 0x7fc64c13de50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.464+0000 7fc652600700 1 --2- 172.21.15.49:0/1861238729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc64c0c0760 0x7fc64c0bf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.464+0000 7fc652600700 1 --2- 172.21.15.49:0/1861238729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc64c067f80 0x7fc64c0bd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.464+0000 7fc652600700 1 -- 172.21.15.49:0/1861238729 >> 172.21.15.49:0/1861238729 conn(0x7fc64c062cb0 msgr2=0x7fc64c0c5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:26.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.464+0000 7fc652600700 1 -- 172.21.15.49:0/1861238729 shutdown_connections 2024-01-22T05:05:26.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.464+0000 7fc652600700 1 -- 172.21.15.49:0/1861238729 wait complete. 2024-01-22T05:05:26.494 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-22T05:05:26.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.672+0000 7f4cf4000700 1 Processor -- start 2024-01-22T05:05:26.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.672+0000 7f4cf4000700 1 -- start start 2024-01-22T05:05:26.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.676+0000 7f4cf4000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4cec153cf0 0x7f4cec0c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:26.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.676+0000 7f4cf4000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec068280 con 0x7f4cec0bcba0 2024-01-22T05:05:26.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.676+0000 7f4cf4000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec0c1f30 con 0x7f4cec0c1ac0 2024-01-22T05:05:26.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.676+0000 7f4cf4000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec0bd190 con 0x7f4cec153cf0 2024-01-22T05:05:26.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.676+0000 7f4cf2000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4cec0bcba0 0x7f4cec068710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60474/0 (socket says 172.21.15.49:60474) 2024-01-22T05:05:26.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.676+0000 7f4cf2000700 1 -- 172.21.15.49:0/3832210983 learned_addr learned my addr 172.21.15.49:0/3832210983 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:26.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.676+0000 7f4cf1600700 1 --2- 172.21.15.49:0/3832210983 >> v2:172.21.15.110:3300/0 conn(0x7f4cec153cf0 0x7f4cec0c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:26.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.676+0000 7f4cebe00700 1 -- 172.21.15.49:0/3832210983 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145742134 0 0) 0x7f4cec068280 con 0x7f4cec0bcba0 2024-01-22T05:05:26.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.676+0000 7f4cebe00700 1 -- 172.21.15.49:0/3832210983 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ccc0033f0 con 0x7f4cec0bcba0 2024-01-22T05:05:26.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.676+0000 7f4cf1600700 1 -- 172.21.15.49:0/3832210983 >> v1:172.21.15.110:6789/0 conn(0x7f4cec0c1ac0 legacy=0x7f4cec0bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:26.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.676+0000 7f4cf1600700 1 -- 172.21.15.49:0/3832210983 >> v1:172.21.15.49:6789/0 conn(0x7f4cec0bcba0 legacy=0x7f4cec068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:26.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.676+0000 7f4cf1600700 1 -- 172.21.15.49:0/3832210983 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec067c30 con 0x7f4cec153cf0 2024-01-22T05:05:26.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.680+0000 7f4cf1600700 1 --2- 172.21.15.49:0/3832210983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec153cf0 0x7f4cec0c15d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f4cdc009760 tx=0x7f4cdc009060).ready entity=mon.1 client_cookie=3e68eb9b3ae570c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:26.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.680+0000 7f4cebe00700 1 -- 172.21.15.49:0/3832210983 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc00b590 con 0x7f4cec153cf0 2024-01-22T05:05:26.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.680+0000 7f4cebe00700 1 -- 172.21.15.49:0/3832210983 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cdc00b6f0 con 0x7f4cec153cf0 2024-01-22T05:05:26.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.680+0000 7f4cebe00700 1 -- 172.21.15.49:0/3832210983 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc00ba70 con 0x7f4cec153cf0 2024-01-22T05:05:26.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.680+0000 7f4cf4000700 1 -- 172.21.15.49:0/3832210983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec153cf0 msgr2=0x7f4cec0c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:26.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.680+0000 7f4cf4000700 1 --2- 172.21.15.49:0/3832210983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec153cf0 0x7f4cec0c15d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f4cdc009760 tx=0x7f4cdc009060).stop 2024-01-22T05:05:26.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.680+0000 7f4cf4000700 1 -- 172.21.15.49:0/3832210983 shutdown_connections 2024-01-22T05:05:26.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.680+0000 7f4cf4000700 1 --2- 172.21.15.49:0/3832210983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec153cf0 0x7f4cec0c15d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.680+0000 7f4cf4000700 1 -- 172.21.15.49:0/3832210983 >> 172.21.15.49:0/3832210983 conn(0x7f4cec062cb0 msgr2=0x7f4cec0c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:26.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.680+0000 7f4cf4000700 1 -- 172.21.15.49:0/3832210983 shutdown_connections 2024-01-22T05:05:26.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.680+0000 7f4cf4000700 1 -- 172.21.15.49:0/3832210983 wait complete. 2024-01-22T05:05:26.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.684+0000 7f4cf4000700 1 Processor -- start 2024-01-22T05:05:26.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.684+0000 7f4cf4000700 1 -- start start 2024-01-22T05:05:26.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf4000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cec0bcba0 0x7f4cec13d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:26.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf4000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cec0c1ac0 0x7f4cec14db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:26.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf4000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec153cf0 0x7f4cec14e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:26.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf4000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec14e500 con 0x7f4cec0bcba0 2024-01-22T05:05:26.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf4000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec155f90 con 0x7f4cec153cf0 2024-01-22T05:05:26.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf4000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec156270 con 0x7f4cec0c1ac0 2024-01-22T05:05:26.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf1600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cec0bcba0 0x7f4cec13d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:26.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf1600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cec0bcba0 0x7f4cec13d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45708/0 (socket says 172.21.15.49:45708) 2024-01-22T05:05:26.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf1600700 1 -- 172.21.15.49:0/2662499078 learned_addr learned my addr 172.21.15.49:0/2662499078 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf2000700 1 --2- 172.21.15.49:0/2662499078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec153cf0 0x7f4cec14e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf0c00700 1 --2- 172.21.15.49:0/2662499078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cec0c1ac0 0x7f4cec14db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf1600700 1 -- 172.21.15.49:0/2662499078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cec0c1ac0 msgr2=0x7f4cec14db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf1600700 1 --2- 172.21.15.49:0/2662499078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cec0c1ac0 0x7f4cec14db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf1600700 1 -- 172.21.15.49:0/2662499078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec153cf0 msgr2=0x7f4cec14e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf1600700 1 --2- 172.21.15.49:0/2662499078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec153cf0 0x7f4cec14e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf1600700 1 -- 172.21.15.49:0/2662499078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc0092a0 con 0x7f4cec0bcba0 2024-01-22T05:05:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf2000700 1 --2- 172.21.15.49:0/2662499078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec153cf0 0x7f4cec14e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf1600700 1 --2- 172.21.15.49:0/2662499078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cec0bcba0 0x7f4cec13d3e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f4cec059c20 tx=0x7f4cdc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:26.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4ce8c00700 1 -- 172.21.15.49:0/2662499078 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc00b860 con 0x7f4cec0bcba0 2024-01-22T05:05:26.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4ce8c00700 1 -- 172.21.15.49:0/2662499078 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cdc00b9c0 con 0x7f4cec0bcba0 2024-01-22T05:05:26.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf4000700 1 -- 172.21.15.49:0/2662499078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cec156550 con 0x7f4cec0bcba0 2024-01-22T05:05:26.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4ce8c00700 1 -- 172.21.15.49:0/2662499078 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc01b690 con 0x7f4cec0bcba0 2024-01-22T05:05:26.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.688+0000 7f4cf4000700 1 -- 172.21.15.49:0/2662499078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec13d8d0 con 0x7f4cec0bcba0 2024-01-22T05:05:26.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.692+0000 7f4cf4000700 1 -- 172.21.15.49:0/2662499078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cec0c0c00 con 0x7f4cec0bcba0 2024-01-22T05:05:26.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.692+0000 7f4ce8c00700 1 -- 172.21.15.49:0/2662499078 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4cdc01ba80 con 0x7f4cec0bcba0 2024-01-22T05:05:26.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.692+0000 7f4ce8c00700 1 --2- 172.21.15.49:0/2662499078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4cc405a540 0x7f4cc405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:26.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.696+0000 7f4ce8c00700 1 -- 172.21.15.49:0/2662499078 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7058+0+0 (secure 0 0 0) 0x7f4cdc076390 con 0x7f4cec0bcba0 2024-01-22T05:05:26.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.696+0000 7f4cf0c00700 1 --2- 172.21.15.49:0/2662499078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4cc405a540 0x7f4cc405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:26.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.696+0000 7f4cf0c00700 1 --2- 172.21.15.49:0/2662499078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4cc405a540 0x7f4cc405ca00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f4cec1570d0 tx=0x7f4cd4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:26.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.700+0000 7f4ce8c00700 1 -- 172.21.15.49:0/2662499078 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4cdc0497c0 con 0x7f4cec0bcba0 2024-01-22T05:05:26.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.864+0000 7f4cf4000700 1 -- 172.21.15.49:0/2662499078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4cec0bdc00 con 0x7f4cec0bcba0 2024-01-22T05:05:26.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.864+0000 7f4ce8c00700 1 -- 172.21.15.49:0/2662499078 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4cdc04cde0 con 0x7f4cec0bcba0 2024-01-22T05:05:26.868 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-22T05:05:26.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.868+0000 7f4cf4000700 1 -- 172.21.15.49:0/2662499078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4cc405a540 msgr2=0x7f4cc405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:26.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.868+0000 7f4cf4000700 1 --2- 172.21.15.49:0/2662499078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4cc405a540 0x7f4cc405ca00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f4cec1570d0 tx=0x7f4cd4009040).stop 2024-01-22T05:05:26.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.868+0000 7f4cf4000700 1 -- 172.21.15.49:0/2662499078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cec0bcba0 msgr2=0x7f4cec13d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:26.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.868+0000 7f4cf4000700 1 --2- 172.21.15.49:0/2662499078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cec0bcba0 0x7f4cec13d3e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f4cec059c20 tx=0x7f4cdc017000).stop 2024-01-22T05:05:26.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.868+0000 7f4cf4000700 1 -- 172.21.15.49:0/2662499078 shutdown_connections 2024-01-22T05:05:26.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.868+0000 7f4cf4000700 1 --2- 172.21.15.49:0/2662499078 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4cc405a540 0x7f4cc405ca00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.868+0000 7f4cf4000700 1 --2- 172.21.15.49:0/2662499078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec153cf0 0x7f4cec14e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.868+0000 7f4cf4000700 1 --2- 172.21.15.49:0/2662499078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cec0c1ac0 0x7f4cec14db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.868+0000 7f4cf4000700 1 --2- 172.21.15.49:0/2662499078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cec0bcba0 0x7f4cec13d3e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:26.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.868+0000 7f4cf4000700 1 -- 172.21.15.49:0/2662499078 >> 172.21.15.49:0/2662499078 conn(0x7f4cec062cb0 msgr2=0x7f4cec0c59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:26.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.868+0000 7f4cf4000700 1 -- 172.21.15.49:0/2662499078 shutdown_connections 2024-01-22T05:05:26.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:26.868+0000 7f4cf4000700 1 -- 172.21.15.49:0/2662499078 wait complete. 2024-01-22T05:05:26.891 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:05:27.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.044+0000 7fc4c2600700 1 Processor -- start 2024-01-22T05:05:27.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.044+0000 7fc4c2600700 1 -- start start 2024-01-22T05:05:27.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4c2600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4bc0a8740 0x7fc4bc0a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4c2600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc0c1a40 con 0x7fc4bc155d20 2024-01-22T05:05:27.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4c2600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc0a90b0 con 0x7fc4bc0c1ed0 2024-01-22T05:05:27.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4c2600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc159310 con 0x7fc4bc0a8740 2024-01-22T05:05:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4bb400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc4bc155d20 0x7fc4bc065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60490/0 (socket says 172.21.15.49:60490) 2024-01-22T05:05:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4bb400700 1 -- 172.21.15.49:0/3484102013 learned_addr learned my addr 172.21.15.49:0/3484102013 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4baa00700 1 --2- 172.21.15.49:0/3484102013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4bc0a8740 0x7fc4bc0a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4ba000700 1 -- 172.21.15.49:0/3484102013 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844991806 0 0) 0x7fc4bc0c1a40 con 0x7fc4bc155d20 2024-01-22T05:05:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4ba000700 1 -- 172.21.15.49:0/3484102013 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc49c0033f0 con 0x7fc4bc155d20 2024-01-22T05:05:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4baa00700 1 -- 172.21.15.49:0/3484102013 >> v1:172.21.15.110:6789/0 conn(0x7fc4bc0c1ed0 legacy=0x7fc4bc0c2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4baa00700 1 -- 172.21.15.49:0/3484102013 >> v1:172.21.15.49:6789/0 conn(0x7fc4bc155d20 legacy=0x7fc4bc065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4ba000700 1 -- 172.21.15.49:0/3484102013 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2316062716 0 0) 0x7fc49c0033f0 con 0x7fc4bc155d20 2024-01-22T05:05:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4baa00700 1 -- 172.21.15.49:0/3484102013 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc0c13f0 con 0x7fc4bc0a8740 2024-01-22T05:05:27.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4baa00700 1 --2- 172.21.15.49:0/3484102013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4bc0a8740 0x7fc4bc0a8bc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc4a4009790 tx=0x7fc4a4009060).ready entity=mon.2 client_cookie=cfa0f3e2e1570e15 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:27.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4ba000700 1 -- 172.21.15.49:0/3484102013 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac001470 con 0x7fc4bc0a8740 2024-01-22T05:05:27.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4ba000700 1 -- 172.21.15.49:0/3484102013 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a4011400 con 0x7fc4bc0a8740 2024-01-22T05:05:27.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.048+0000 7fc4ba000700 1 -- 172.21.15.49:0/3484102013 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4011780 con 0x7fc4bc0a8740 2024-01-22T05:05:27.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.052+0000 7fc4c2600700 1 -- 172.21.15.49:0/3484102013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4bc0a8740 msgr2=0x7fc4bc0a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.052+0000 7fc4c2600700 1 --2- 172.21.15.49:0/3484102013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4bc0a8740 0x7fc4bc0a8bc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc4a4009790 tx=0x7fc4a4009060).stop 2024-01-22T05:05:27.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.052+0000 7fc4c2600700 1 -- 172.21.15.49:0/3484102013 shutdown_connections 2024-01-22T05:05:27.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.052+0000 7fc4c2600700 1 --2- 172.21.15.49:0/3484102013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4bc0a8740 0x7fc4bc0a8bc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.052+0000 7fc4c2600700 1 -- 172.21.15.49:0/3484102013 >> 172.21.15.49:0/3484102013 conn(0x7fc4bc0c6540 msgr2=0x7fc4bc0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:27.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.052+0000 7fc4c2600700 1 -- 172.21.15.49:0/3484102013 shutdown_connections 2024-01-22T05:05:27.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.052+0000 7fc4c2600700 1 -- 172.21.15.49:0/3484102013 wait complete. 2024-01-22T05:05:27.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.052+0000 7fc4c2600700 1 Processor -- start 2024-01-22T05:05:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4c2600700 1 -- start start 2024-01-22T05:05:27.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4c2600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4bc0a8740 0x7fc4bc159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4c2600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4bc0c1ed0 0x7fc4bc0c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4c2600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4bc155d20 0x7fc4bc152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4c2600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0c5c50 con 0x7fc4bc0c1ed0 2024-01-22T05:05:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4c2600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc159d00 con 0x7fc4bc0a8740 2024-01-22T05:05:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4c2600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc159fe0 con 0x7fc4bc155d20 2024-01-22T05:05:27.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4baa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4bc0c1ed0 0x7fc4bc0c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4baa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4bc0c1ed0 0x7fc4bc0c5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45718/0 (socket says 172.21.15.49:45718) 2024-01-22T05:05:27.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4baa00700 1 -- 172.21.15.49:0/1726558798 learned_addr learned my addr 172.21.15.49:0/1726558798 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:27.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4bb400700 1 --2- 172.21.15.49:0/1726558798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4bc0a8740 0x7fc4bc159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4bbe00700 1 --2- 172.21.15.49:0/1726558798 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4bc155d20 0x7fc4bc152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4baa00700 1 -- 172.21.15.49:0/1726558798 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4bc155d20 msgr2=0x7fc4bc152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4baa00700 1 --2- 172.21.15.49:0/1726558798 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4bc155d20 0x7fc4bc152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4baa00700 1 -- 172.21.15.49:0/1726558798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4bc0a8740 msgr2=0x7fc4bc159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4baa00700 1 --2- 172.21.15.49:0/1726558798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4bc0a8740 0x7fc4bc159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4baa00700 1 -- 172.21.15.49:0/1726558798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a40092a0 con 0x7fc4bc0c1ed0 2024-01-22T05:05:27.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4bb400700 1 --2- 172.21.15.49:0/1726558798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4bc0a8740 0x7fc4bc159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:27.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.056+0000 7fc4baa00700 1 --2- 172.21.15.49:0/1726558798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4bc0c1ed0 0x7fc4bc0c5760 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fc4a4009e30 tx=0x7fc4a4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:27.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.060+0000 7fc4b2a00700 1 -- 172.21.15.49:0/1726558798 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4010740 con 0x7fc4bc0c1ed0 2024-01-22T05:05:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.060+0000 7fc4b2a00700 1 -- 172.21.15.49:0/1726558798 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a40108a0 con 0x7fc4bc0c1ed0 2024-01-22T05:05:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.060+0000 7fc4b2a00700 1 -- 172.21.15.49:0/1726558798 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4010c40 con 0x7fc4bc0c1ed0 2024-01-22T05:05:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.060+0000 7fc4c2600700 1 -- 172.21.15.49:0/1726558798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc15a2c0 con 0x7fc4bc0c1ed0 2024-01-22T05:05:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.060+0000 7fc4c2600700 1 -- 172.21.15.49:0/1726558798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc15a880 con 0x7fc4bc0c1ed0 2024-01-22T05:05:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.060+0000 7fc4c2600700 1 -- 172.21.15.49:0/1726558798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc047060 con 0x7fc4bc0c1ed0 2024-01-22T05:05:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.060+0000 7fc4b2a00700 1 -- 172.21.15.49:0/1726558798 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc4a401d640 con 0x7fc4bc0c1ed0 2024-01-22T05:05:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.064+0000 7fc4b2a00700 1 --2- 172.21.15.49:0/1726558798 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc49405a510 0x7fc49405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.064+0000 7fc4b2a00700 1 -- 172.21.15.49:0/1726558798 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7058+0+0 (secure 0 0 0) 0x7fc4a4076160 con 0x7fc4bc0c1ed0 2024-01-22T05:05:27.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.064+0000 7fc4bb400700 1 --2- 172.21.15.49:0/1726558798 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc49405a510 0x7fc49405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.064+0000 7fc4bb400700 1 --2- 172.21.15.49:0/1726558798 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc49405a510 0x7fc49405c9d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fc4ac0011e0 tx=0x7fc4ac000bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.068+0000 7fc4b2a00700 1 -- 172.21.15.49:0/1726558798 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc4a40494d0 con 0x7fc4bc0c1ed0 2024-01-22T05:05:27.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.272+0000 7fc4c2600700 1 -- 172.21.15.49:0/1726558798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4bc0c16d0 con 0x7fc4bc0c1ed0 2024-01-22T05:05:27.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.272+0000 7fc4b2a00700 1 -- 172.21.15.49:0/1726558798 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4491 (secure 0 0 0) 0x7fc4a404caf0 con 0x7fc4bc0c1ed0 2024-01-22T05:05:27.277 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:27.277 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/4240919875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4240919875},{"type":"v1","addr":"172.21.15.49:6836","nonce":4240919875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3591660134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3591660134},{"type":"v1","addr":"172.21.15.49:6837","nonce":3591660134}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1228202507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1228202507},{"type":"v1","addr":"172.21.15.110:6833","nonce":1228202507}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:04:35.017706+0000","modified":"2024-01-22T05:04:49.308211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3391981756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3391981756},{"type":"v1","addr":"172.21.15.110:6835","nonce":3391981756}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:05:27.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.276+0000 7fc4c2600700 1 -- 172.21.15.49:0/1726558798 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc49405a510 msgr2=0x7fc49405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.276+0000 7fc4c2600700 1 --2- 172.21.15.49:0/1726558798 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc49405a510 0x7fc49405c9d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fc4ac0011e0 tx=0x7fc4ac000bc0).stop 2024-01-22T05:05:27.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.276+0000 7fc4c2600700 1 -- 172.21.15.49:0/1726558798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4bc0c1ed0 msgr2=0x7fc4bc0c5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.276+0000 7fc4c2600700 1 --2- 172.21.15.49:0/1726558798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4bc0c1ed0 0x7fc4bc0c5760 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fc4a4009e30 tx=0x7fc4a4016000).stop 2024-01-22T05:05:27.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.276+0000 7fc4c2600700 1 -- 172.21.15.49:0/1726558798 shutdown_connections 2024-01-22T05:05:27.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.276+0000 7fc4c2600700 1 --2- 172.21.15.49:0/1726558798 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc49405a510 0x7fc49405c9d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.276+0000 7fc4c2600700 1 --2- 172.21.15.49:0/1726558798 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4bc155d20 0x7fc4bc152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.276+0000 7fc4c2600700 1 --2- 172.21.15.49:0/1726558798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4bc0c1ed0 0x7fc4bc0c5760 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.276+0000 7fc4c2600700 1 --2- 172.21.15.49:0/1726558798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4bc0a8740 0x7fc4bc159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.276+0000 7fc4c2600700 1 -- 172.21.15.49:0/1726558798 >> 172.21.15.49:0/1726558798 conn(0x7fc4bc0c6540 msgr2=0x7fc4bc068c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:27.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.276+0000 7fc4c2600700 1 -- 172.21.15.49:0/1726558798 shutdown_connections 2024-01-22T05:05:27.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.276+0000 7fc4c2600700 1 -- 172.21.15.49:0/1726558798 wait complete. 2024-01-22T05:05:27.283 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-22T05:05:27.307 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:05:27.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.468+0000 7fbc20400700 1 Processor -- start 2024-01-22T05:05:27.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.468+0000 7fbc20400700 1 -- start start 2024-01-22T05:05:27.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.468+0000 7fbc20400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc181580e0 0x7fbc18059470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.468+0000 7fbc20400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbc180c6cd0 0x7fbc180c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.468+0000 7fbc20400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc180c7620 con 0x7fbc18067a90 2024-01-22T05:05:27.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.468+0000 7fbc20400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc180a5590 con 0x7fbc180c6cd0 2024-01-22T05:05:27.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.468+0000 7fbc20400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc180bf240 con 0x7fbc181580e0 2024-01-22T05:05:27.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.468+0000 7fbc1d000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbc180c6cd0 0x7fbc180c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.468+0000 7fbc1ee00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbc18067a90 0x7fbc18067f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60504/0 (socket says 172.21.15.49:60504) 2024-01-22T05:05:27.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc1ee00700 1 -- 172.21.15.49:0/750038650 learned_addr learned my addr 172.21.15.49:0/750038650 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:27.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc1da00700 1 --2- 172.21.15.49:0/750038650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc181580e0 0x7fbc18059470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc17e00700 1 -- 172.21.15.49:0/750038650 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280661828 0 0) 0x7fbc180c7620 con 0x7fbc18067a90 2024-01-22T05:05:27.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc17e00700 1 -- 172.21.15.49:0/750038650 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbf80033f0 con 0x7fbc18067a90 2024-01-22T05:05:27.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc1d000700 1 -- 172.21.15.49:0/750038650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc181580e0 msgr2=0x7fbc18059470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:27.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc1d000700 1 --2- 172.21.15.49:0/750038650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc181580e0 0x7fbc18059470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc1d000700 1 -- 172.21.15.49:0/750038650 >> v1:172.21.15.49:6789/0 conn(0x7fbc18067a90 legacy=0x7fbc18067f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc1d000700 1 -- 172.21.15.49:0/750038650 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc180be9a0 con 0x7fbc180c6cd0 2024-01-22T05:05:27.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc1d000700 1 --2- 172.21.15.49:0/750038650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc180c6cd0 0x7fbc180c7130 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fbc00009760 tx=0x7fbc00009060).ready entity=mon.0 client_cookie=e9d42243a4de33ff server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:27.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc17e00700 1 -- 172.21.15.49:0/750038650 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000f510 con 0x7fbc180c6cd0 2024-01-22T05:05:27.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc17e00700 1 -- 172.21.15.49:0/750038650 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0000f670 con 0x7fbc180c6cd0 2024-01-22T05:05:27.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc17e00700 1 -- 172.21.15.49:0/750038650 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000f9f0 con 0x7fbc180c6cd0 2024-01-22T05:05:27.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc20400700 1 -- 172.21.15.49:0/750038650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc180c6cd0 msgr2=0x7fbc180c7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc20400700 1 --2- 172.21.15.49:0/750038650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc180c6cd0 0x7fbc180c7130 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fbc00009760 tx=0x7fbc00009060).stop 2024-01-22T05:05:27.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc20400700 1 -- 172.21.15.49:0/750038650 shutdown_connections 2024-01-22T05:05:27.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc20400700 1 --2- 172.21.15.49:0/750038650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc180c6cd0 0x7fbc180c7130 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc20400700 1 --2- 172.21.15.49:0/750038650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc181580e0 0x7fbc18059470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.472+0000 7fbc20400700 1 -- 172.21.15.49:0/750038650 >> 172.21.15.49:0/750038650 conn(0x7fbc18062a10 msgr2=0x7fbc18081fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:27.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.476+0000 7fbc20400700 1 -- 172.21.15.49:0/750038650 shutdown_connections 2024-01-22T05:05:27.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.476+0000 7fbc20400700 1 -- 172.21.15.49:0/750038650 wait complete. 2024-01-22T05:05:27.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.476+0000 7fbc20400700 1 Processor -- start 2024-01-22T05:05:27.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.480+0000 7fbc20400700 1 -- start start 2024-01-22T05:05:27.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.480+0000 7fbc20400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc18067a90 0x7fbc18123800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.480+0000 7fbc20400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc180c6cd0 0x7fbc18142e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.480+0000 7fbc20400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc181580e0 0x7fbc18123d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.480+0000 7fbc20400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18122760 con 0x7fbc18067a90 2024-01-22T05:05:27.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.480+0000 7fbc20400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18122a40 con 0x7fbc181580e0 2024-01-22T05:05:27.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.480+0000 7fbc20400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18122d20 con 0x7fbc180c6cd0 2024-01-22T05:05:27.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.480+0000 7fbc1da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc18067a90 0x7fbc18123800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.480+0000 7fbc1da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc18067a90 0x7fbc18123800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45730/0 (socket says 172.21.15.49:45730) 2024-01-22T05:05:27.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.480+0000 7fbc1da00700 1 -- 172.21.15.49:0/1667857481 learned_addr learned my addr 172.21.15.49:0/1667857481 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:27.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.480+0000 7fbc1d000700 1 --2- 172.21.15.49:0/1667857481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc180c6cd0 0x7fbc18142e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.480+0000 7fbc1ee00700 1 --2- 172.21.15.49:0/1667857481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc181580e0 0x7fbc18123d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.484+0000 7fbc1da00700 1 -- 172.21.15.49:0/1667857481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc180c6cd0 msgr2=0x7fbc18142e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.484+0000 7fbc1da00700 1 --2- 172.21.15.49:0/1667857481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc180c6cd0 0x7fbc18142e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.484+0000 7fbc1da00700 1 -- 172.21.15.49:0/1667857481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc181580e0 msgr2=0x7fbc18123d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.484+0000 7fbc1da00700 1 --2- 172.21.15.49:0/1667857481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc181580e0 0x7fbc18123d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.484+0000 7fbc1da00700 1 -- 172.21.15.49:0/1667857481 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc000092a0 con 0x7fbc18067a90 2024-01-22T05:05:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.484+0000 7fbc1da00700 1 --2- 172.21.15.49:0/1667857481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc18067a90 0x7fbc18123800 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fbc0800d890 tx=0x7fbc08008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.484+0000 7fbc14c00700 1 -- 172.21.15.49:0/1667857481 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc08011590 con 0x7fbc18067a90 2024-01-22T05:05:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.484+0000 7fbc14c00700 1 -- 172.21.15.49:0/1667857481 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc080116f0 con 0x7fbc18067a90 2024-01-22T05:05:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.484+0000 7fbc20400700 1 -- 172.21.15.49:0/1667857481 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc18123000 con 0x7fbc18067a90 2024-01-22T05:05:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.484+0000 7fbc14c00700 1 -- 172.21.15.49:0/1667857481 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc08011a70 con 0x7fbc18067a90 2024-01-22T05:05:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.484+0000 7fbc20400700 1 -- 172.21.15.49:0/1667857481 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc181432f0 con 0x7fbc18067a90 2024-01-22T05:05:27.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.484+0000 7fbc20400700 1 -- 172.21.15.49:0/1667857481 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc18123480 con 0x7fbc18067a90 2024-01-22T05:05:27.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.488+0000 7fbc14c00700 1 -- 172.21.15.49:0/1667857481 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbc0801c460 con 0x7fbc18067a90 2024-01-22T05:05:27.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.488+0000 7fbc14c00700 1 --2- 172.21.15.49:0/1667857481 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbf005a510 0x7fbbf005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.488+0000 7fbc14c00700 1 -- 172.21.15.49:0/1667857481 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7058+0+0 (secure 0 0 0) 0x7fbc08074930 con 0x7fbc18067a90 2024-01-22T05:05:27.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.488+0000 7fbc1d000700 1 --2- 172.21.15.49:0/1667857481 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbf005a510 0x7fbbf005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.488+0000 7fbc1d000700 1 --2- 172.21.15.49:0/1667857481 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbf005a510 0x7fbbf005c9d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fbc00009760 tx=0x7fbc00017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:27.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.492+0000 7fbc14c00700 1 -- 172.21.15.49:0/1667857481 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbc08047c40 con 0x7fbc18067a90 2024-01-22T05:05:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.652+0000 7fbc20400700 1 -- 172.21.15.49:0/1667857481 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc180bec80 con 0x7fbc18067a90 2024-01-22T05:05:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.652+0000 7fbc14c00700 1 -- 172.21.15.49:0/1667857481 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19053 (secure 0 0 0) 0x7fbc08011e60 con 0x7fbc18067a90 2024-01-22T05:05:27.657 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:27.657 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:05:23.141884+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2},{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:05:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.656+0000 7fbc20400700 1 -- 172.21.15.49:0/1667857481 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbf005a510 msgr2=0x7fbbf005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.660+0000 7fbc20400700 1 --2- 172.21.15.49:0/1667857481 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbf005a510 0x7fbbf005c9d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fbc00009760 tx=0x7fbc00017000).stop 2024-01-22T05:05:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.660+0000 7fbc20400700 1 -- 172.21.15.49:0/1667857481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc18067a90 msgr2=0x7fbc18123800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.660+0000 7fbc20400700 1 --2- 172.21.15.49:0/1667857481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc18067a90 0x7fbc18123800 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fbc0800d890 tx=0x7fbc08008040).stop 2024-01-22T05:05:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.660+0000 7fbc20400700 1 -- 172.21.15.49:0/1667857481 shutdown_connections 2024-01-22T05:05:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.660+0000 7fbc20400700 1 --2- 172.21.15.49:0/1667857481 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbf005a510 0x7fbbf005c9d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.660+0000 7fbc20400700 1 --2- 172.21.15.49:0/1667857481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc181580e0 0x7fbc18123d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.660+0000 7fbc20400700 1 --2- 172.21.15.49:0/1667857481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc180c6cd0 0x7fbc18142e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.660+0000 7fbc20400700 1 --2- 172.21.15.49:0/1667857481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc18067a90 0x7fbc18123800 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.660+0000 7fbc20400700 1 -- 172.21.15.49:0/1667857481 >> 172.21.15.49:0/1667857481 conn(0x7fbc18062a10 msgr2=0x7fbc180bfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.660+0000 7fbc20400700 1 -- 172.21.15.49:0/1667857481 shutdown_connections 2024-01-22T05:05:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.660+0000 7fbc20400700 1 -- 172.21.15.49:0/1667857481 wait complete. 2024-01-22T05:05:27.686 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:05:27.686 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:05:27.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.852+0000 7fb6a1000700 1 Processor -- start 2024-01-22T05:05:27.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.852+0000 7fb6a1000700 1 -- start start 2024-01-22T05:05:27.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb6a1000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb69c064c00 0x7fb69c0bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb6a1000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69c0c2700 con 0x7fb69c065620 2024-01-22T05:05:27.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb6a1000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69c0c29a0 con 0x7fb69c065240 2024-01-22T05:05:27.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb6a1000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69c0c2c80 con 0x7fb69c064c00 2024-01-22T05:05:27.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb69b200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb69c065620 0x7fb69c0bd170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60516/0 (socket says 172.21.15.49:60516) 2024-01-22T05:05:27.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb69b200700 1 -- 172.21.15.49:0/931667824 learned_addr learned my addr 172.21.15.49:0/931667824 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:27.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb699400700 1 --2- 172.21.15.49:0/931667824 >> v2:172.21.15.110:3300/0 conn(0x7fb69c064c00 0x7fb69c0bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474386008 0 0) 0x7fb69c0c2700 con 0x7fb69c065620 2024-01-22T05:05:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb67c0033f0 con 0x7fb69c065620 2024-01-22T05:05:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873796882 0 0) 0x7fb69c0c29a0 con 0x7fb69c065240 2024-01-22T05:05:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb69c0c2700 con 0x7fb69c065240 2024-01-22T05:05:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3180091788 0 0) 0x7fb67c0033f0 con 0x7fb69c065620 2024-01-22T05:05:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 >> v2:172.21.15.110:3300/0 conn(0x7fb69c064c00 msgr2=0x7fb69c0bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 --2- 172.21.15.49:0/931667824 >> v2:172.21.15.110:3300/0 conn(0x7fb69c064c00 0x7fb69c0bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 >> v1:172.21.15.110:6789/0 conn(0x7fb69c065240 legacy=0x7fb69c0644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c0c2f60 con 0x7fb69c065620 2024-01-22T05:05:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fb6940017f0 con 0x7fb69c065620 2024-01-22T05:05:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 >> v1:172.21.15.49:6789/0 conn(0x7fb69c065620 legacy=0x7fb69c0bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 --2- 172.21.15.49:0/931667824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67c003a70 0x7fb67c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 --2- 172.21.15.49:0/931667824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb67c004690 0x7fb67c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 --2- 172.21.15.49:0/931667824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb67c005000 0x7fb67c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c0c2c80 con 0x7fb67c003a70 2024-01-22T05:05:27.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c00be80 con 0x7fb67c005000 2024-01-22T05:05:27.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c00c040 con 0x7fb67c004690 2024-01-22T05:05:27.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb699e00700 1 --2- 172.21.15.49:0/931667824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67c003a70 0x7fb67c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb699400700 1 --2- 172.21.15.49:0/931667824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb67c004690 0x7fb67c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.856+0000 7fb69b200700 1 --2- 172.21.15.49:0/931667824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb67c005000 0x7fb67c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb699e00700 1 -- 172.21.15.49:0/931667824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb67c004690 msgr2=0x7fb67c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:27.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb699e00700 1 --2- 172.21.15.49:0/931667824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb67c004690 0x7fb67c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb699e00700 1 -- 172.21.15.49:0/931667824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb67c005000 msgr2=0x7fb67c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:27.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb699e00700 1 --2- 172.21.15.49:0/931667824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb67c005000 0x7fb67c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb699e00700 1 -- 172.21.15.49:0/931667824 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c0033f0 con 0x7fb67c003a70 2024-01-22T05:05:27.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb69b200700 1 -- 172.21.15.49:0/931667824 reap_dead start 2024-01-22T05:05:27.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb699e00700 1 --2- 172.21.15.49:0/931667824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67c003a70 0x7fb67c003e70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fb68c001860 tx=0x7fb68c007bb0).ready entity=mon.0 client_cookie=9cf034c94874cb45 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:27.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c007020 con 0x7fb67c003a70 2024-01-22T05:05:27.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c007180 con 0x7fb67c003a70 2024-01-22T05:05:27.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb698a00700 1 -- 172.21.15.49:0/931667824 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c007500 con 0x7fb67c003a70 2024-01-22T05:05:27.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb6a1000700 1 -- 172.21.15.49:0/931667824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67c003a70 msgr2=0x7fb67c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb6a1000700 1 --2- 172.21.15.49:0/931667824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67c003a70 0x7fb67c003e70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fb68c001860 tx=0x7fb68c007bb0).stop 2024-01-22T05:05:27.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb6a1000700 1 -- 172.21.15.49:0/931667824 shutdown_connections 2024-01-22T05:05:27.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb6a1000700 1 --2- 172.21.15.49:0/931667824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67c003a70 0x7fb67c003e70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb6a1000700 1 -- 172.21.15.49:0/931667824 >> 172.21.15.49:0/931667824 conn(0x7fb69c0c87f0 msgr2=0x7fb69c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:27.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb6a1000700 1 -- 172.21.15.49:0/931667824 shutdown_connections 2024-01-22T05:05:27.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.860+0000 7fb6a1000700 1 -- 172.21.15.49:0/931667824 wait complete. 2024-01-22T05:05:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.864+0000 7fb6a1000700 1 Processor -- start 2024-01-22T05:05:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.864+0000 7fb6a1000700 1 -- start start 2024-01-22T05:05:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.864+0000 7fb6a1000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb67c003a70 0x7fb69c145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.864+0000 7fb6a1000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb69c159ee0 0x7fb69c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.864+0000 7fb6a1000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb69c0bee30 0x7fb69c0bf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.864+0000 7fb6a1000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c0c07b0 con 0x7fb69c0bee30 2024-01-22T05:05:27.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.864+0000 7fb6a1000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c15a850 con 0x7fb69c159ee0 2024-01-22T05:05:27.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.864+0000 7fb6a1000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c0bfba0 con 0x7fb67c003a70 2024-01-22T05:05:27.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb69b200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb69c0bee30 0x7fb69c0bf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb69b200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb69c0bee30 0x7fb69c0bf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45750/0 (socket says 172.21.15.49:45750) 2024-01-22T05:05:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb69b200700 1 -- 172.21.15.49:0/1666903206 learned_addr learned my addr 172.21.15.49:0/1666903206 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb699400700 1 --2- 172.21.15.49:0/1666903206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb69c159ee0 0x7fb69c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb699e00700 1 --2- 172.21.15.49:0/1666903206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb67c003a70 0x7fb69c145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb69b200700 1 -- 172.21.15.49:0/1666903206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb67c003a70 msgr2=0x7fb69c145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb69b200700 1 --2- 172.21.15.49:0/1666903206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb67c003a70 0x7fb69c145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb69b200700 1 -- 172.21.15.49:0/1666903206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb69c159ee0 msgr2=0x7fb69c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb69b200700 1 --2- 172.21.15.49:0/1666903206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb69c159ee0 0x7fb69c15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb69b200700 1 -- 172.21.15.49:0/1666903206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c0bfe80 con 0x7fb69c0bee30 2024-01-22T05:05:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb69b200700 1 --2- 172.21.15.49:0/1666903206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb69c0bee30 0x7fb69c0bf2b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fb694001350 tx=0x7fb694007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb691600700 1 -- 172.21.15.49:0/1666903206 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69400f8a0 con 0x7fb69c0bee30 2024-01-22T05:05:27.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb691600700 1 -- 172.21.15.49:0/1666903206 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69400fa00 con 0x7fb69c0bee30 2024-01-22T05:05:27.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb6a1000700 1 -- 172.21.15.49:0/1666903206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69c0c0160 con 0x7fb69c0bee30 2024-01-22T05:05:27.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb691600700 1 -- 172.21.15.49:0/1666903206 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69400fd80 con 0x7fb69c0bee30 2024-01-22T05:05:27.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.868+0000 7fb6a1000700 1 -- 172.21.15.49:0/1666903206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69c1463f0 con 0x7fb69c0bee30 2024-01-22T05:05:27.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.872+0000 7fb6a1000700 1 -- 172.21.15.49:0/1666903206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69c1469e0 con 0x7fb69c0bee30 2024-01-22T05:05:27.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.872+0000 7fb691600700 1 -- 172.21.15.49:0/1666903206 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb694012560 con 0x7fb69c0bee30 2024-01-22T05:05:27.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.876+0000 7fb691600700 1 --2- 172.21.15.49:0/1666903206 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb67405a4e0 0x7fb67405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:27.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.876+0000 7fb691600700 1 -- 172.21.15.49:0/1666903206 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7058+0+0 (secure 0 0 0) 0x7fb694074470 con 0x7fb69c0bee30 2024-01-22T05:05:27.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.876+0000 7fb699e00700 1 --2- 172.21.15.49:0/1666903206 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb67405a4e0 0x7fb67405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:27.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.876+0000 7fb699e00700 1 --2- 172.21.15.49:0/1666903206 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb67405a4e0 0x7fb67405c9a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fb68c009000 tx=0x7fb68c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:27.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:27.880+0000 7fb691600700 1 -- 172.21.15.49:0/1666903206 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb694047780 con 0x7fb69c0bee30 2024-01-22T05:05:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.080+0000 7fb6a1000700 1 -- 172.21.15.49:0/1666903206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb69c047060 con 0x7fb69c0bee30 2024-01-22T05:05:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.084+0000 7fb691600700 1 -- 172.21.15.49:0/1666903206 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4491 (secure 0 0 0) 0x7fb694019020 con 0x7fb69c0bee30 2024-01-22T05:05:28.086 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:28.087 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/4240919875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4240919875},{"type":"v1","addr":"172.21.15.49:6836","nonce":4240919875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3591660134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3591660134},{"type":"v1","addr":"172.21.15.49:6837","nonce":3591660134}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1228202507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1228202507},{"type":"v1","addr":"172.21.15.110:6833","nonce":1228202507}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:04:35.017706+0000","modified":"2024-01-22T05:04:49.308211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3391981756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3391981756},{"type":"v1","addr":"172.21.15.110:6835","nonce":3391981756}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:05:28.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.088+0000 7fb6a1000700 1 -- 172.21.15.49:0/1666903206 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb67405a4e0 msgr2=0x7fb67405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.088+0000 7fb6a1000700 1 --2- 172.21.15.49:0/1666903206 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb67405a4e0 0x7fb67405c9a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fb68c009000 tx=0x7fb68c015000).stop 2024-01-22T05:05:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.088+0000 7fb6a1000700 1 -- 172.21.15.49:0/1666903206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb69c0bee30 msgr2=0x7fb69c0bf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.088+0000 7fb6a1000700 1 --2- 172.21.15.49:0/1666903206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb69c0bee30 0x7fb69c0bf2b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fb694001350 tx=0x7fb694007f20).stop 2024-01-22T05:05:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.088+0000 7fb6a1000700 1 -- 172.21.15.49:0/1666903206 shutdown_connections 2024-01-22T05:05:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.088+0000 7fb6a1000700 1 --2- 172.21.15.49:0/1666903206 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb67405a4e0 0x7fb67405c9a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.088+0000 7fb6a1000700 1 --2- 172.21.15.49:0/1666903206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb69c0bee30 0x7fb69c0bf2b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.088+0000 7fb6a1000700 1 --2- 172.21.15.49:0/1666903206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb69c159ee0 0x7fb69c15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.088+0000 7fb6a1000700 1 --2- 172.21.15.49:0/1666903206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb67c003a70 0x7fb69c145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.088+0000 7fb6a1000700 1 -- 172.21.15.49:0/1666903206 >> 172.21.15.49:0/1666903206 conn(0x7fb69c0c87f0 msgr2=0x7fb69c0ad260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.088+0000 7fb6a1000700 1 -- 172.21.15.49:0/1666903206 shutdown_connections 2024-01-22T05:05:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.088+0000 7fb6a1000700 1 -- 172.21.15.49:0/1666903206 wait complete. 2024-01-22T05:05:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-22T05:05:28.114 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:05:28.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.276+0000 7fcd85600700 1 Processor -- start 2024-01-22T05:05:28.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.280+0000 7fcd85600700 1 -- start start 2024-01-22T05:05:28.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.280+0000 7fcd85600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcd800681a0 0x7fcd80159690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:28.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd85600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd80068600 0x7fcd8015bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:28.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd85600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd800bedd0 con 0x7fcd800bdc70 2024-01-22T05:05:28.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd85600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd800a9560 con 0x7fcd80068600 2024-01-22T05:05:28.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd85600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd800be1c0 con 0x7fcd800681a0 2024-01-22T05:05:28.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd7fe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcd800bdc70 0x7fcd80067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60520/0 (socket says 172.21.15.49:60520) 2024-01-22T05:05:28.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd7fe00700 1 -- 172.21.15.49:0/4194138352 learned_addr learned my addr 172.21.15.49:0/4194138352 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:28.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd84c00700 1 --2- 172.21.15.49:0/4194138352 >> v2:172.21.15.49:3300/0 conn(0x7fcd80068600 0x7fcd8015bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:28.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd7f400700 1 --2- 172.21.15.49:0/4194138352 >> v2:172.21.15.110:3300/0 conn(0x7fcd800681a0 0x7fcd80159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:28.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd7ea00700 1 -- 172.21.15.49:0/4194138352 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775107105 0 0) 0x7fcd800bedd0 con 0x7fcd800bdc70 2024-01-22T05:05:28.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd7ea00700 1 -- 172.21.15.49:0/4194138352 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd600033f0 con 0x7fcd800bdc70 2024-01-22T05:05:28.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd7f400700 1 -- 172.21.15.49:0/4194138352 >> v2:172.21.15.49:3300/0 conn(0x7fcd80068600 msgr2=0x7fcd8015bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:28.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd7f400700 1 --2- 172.21.15.49:0/4194138352 >> v2:172.21.15.49:3300/0 conn(0x7fcd80068600 0x7fcd8015bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd7f400700 1 -- 172.21.15.49:0/4194138352 >> v1:172.21.15.49:6789/0 conn(0x7fcd800bdc70 legacy=0x7fcd80067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:28.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd7f400700 1 -- 172.21.15.49:0/4194138352 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd800be4a0 con 0x7fcd800681a0 2024-01-22T05:05:28.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd7f400700 1 --2- 172.21.15.49:0/4194138352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd800681a0 0x7fcd80159690 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fcd80069ba0 tx=0x7fcd68009060).ready entity=mon.1 client_cookie=c9da0d11edbb5cbe server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:28.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd7ea00700 1 -- 172.21.15.49:0/4194138352 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6800d4a0 con 0x7fcd800681a0 2024-01-22T05:05:28.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd7ea00700 1 -- 172.21.15.49:0/4194138352 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6800d600 con 0x7fcd800681a0 2024-01-22T05:05:28.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd7ea00700 1 -- 172.21.15.49:0/4194138352 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6800d980 con 0x7fcd800681a0 2024-01-22T05:05:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd85600700 1 -- 172.21.15.49:0/4194138352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd800681a0 msgr2=0x7fcd80159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.284+0000 7fcd85600700 1 --2- 172.21.15.49:0/4194138352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd800681a0 0x7fcd80159690 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fcd80069ba0 tx=0x7fcd68009060).stop 2024-01-22T05:05:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.288+0000 7fcd85600700 1 -- 172.21.15.49:0/4194138352 shutdown_connections 2024-01-22T05:05:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.288+0000 7fcd85600700 1 --2- 172.21.15.49:0/4194138352 >> v2:172.21.15.49:3300/0 conn(0x7fcd80068600 0x7fcd8015bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.288+0000 7fcd85600700 1 --2- 172.21.15.49:0/4194138352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd800681a0 0x7fcd80159690 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.288+0000 7fcd85600700 1 -- 172.21.15.49:0/4194138352 >> 172.21.15.49:0/4194138352 conn(0x7fcd800c86e0 msgr2=0x7fcd800c8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:28.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.288+0000 7fcd85600700 1 -- 172.21.15.49:0/4194138352 shutdown_connections 2024-01-22T05:05:28.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.288+0000 7fcd85600700 1 -- 172.21.15.49:0/4194138352 wait complete. 2024-01-22T05:05:28.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.288+0000 7fcd85600700 1 Processor -- start 2024-01-22T05:05:28.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.288+0000 7fcd85600700 1 -- start start 2024-01-22T05:05:28.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd85600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd800681a0 0x7fcd80146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:28.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd85600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd80068600 0x7fcd800a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:28.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd85600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd800bdc70 0x7fcd800a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:28.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd85600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd800a27a0 con 0x7fcd800681a0 2024-01-22T05:05:28.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd85600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd800a05e0 con 0x7fcd800bdc70 2024-01-22T05:05:28.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd85600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8009f9d0 con 0x7fcd80068600 2024-01-22T05:05:28.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd7fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd800681a0 0x7fcd80146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:28.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd7fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd800681a0 0x7fcd80146bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45768/0 (socket says 172.21.15.49:45768) 2024-01-22T05:05:28.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd7fe00700 1 -- 172.21.15.49:0/986609499 learned_addr learned my addr 172.21.15.49:0/986609499 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:28.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd84c00700 1 --2- 172.21.15.49:0/986609499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd800bdc70 0x7fcd800a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:28.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd7f400700 1 --2- 172.21.15.49:0/986609499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd80068600 0x7fcd800a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:28.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd7fe00700 1 -- 172.21.15.49:0/986609499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd80068600 msgr2=0x7fcd800a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:28.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd7fe00700 1 --2- 172.21.15.49:0/986609499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd80068600 0x7fcd800a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd7fe00700 1 -- 172.21.15.49:0/986609499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd800bdc70 msgr2=0x7fcd800a22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:28.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd7fe00700 1 --2- 172.21.15.49:0/986609499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd800bdc70 0x7fcd800a22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd7fe00700 1 -- 172.21.15.49:0/986609499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd680092a0 con 0x7fcd800681a0 2024-01-22T05:05:28.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd7fe00700 1 --2- 172.21.15.49:0/986609499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd800681a0 0x7fcd80146bf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fcd7000c420 tx=0x7fcd70007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:28.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd77400700 1 -- 172.21.15.49:0/986609499 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd700070d0 con 0x7fcd800681a0 2024-01-22T05:05:28.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd77400700 1 -- 172.21.15.49:0/986609499 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd70007230 con 0x7fcd800681a0 2024-01-22T05:05:28.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd85600700 1 -- 172.21.15.49:0/986609499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8009fcb0 con 0x7fcd800681a0 2024-01-22T05:05:28.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd77400700 1 -- 172.21.15.49:0/986609499 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd700075b0 con 0x7fcd800681a0 2024-01-22T05:05:28.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.292+0000 7fcd85600700 1 -- 172.21.15.49:0/986609499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd800a0270 con 0x7fcd800681a0 2024-01-22T05:05:28.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.296+0000 7fcd85600700 1 -- 172.21.15.49:0/986609499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd800664e0 con 0x7fcd800681a0 2024-01-22T05:05:28.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.296+0000 7fcd77400700 1 -- 172.21.15.49:0/986609499 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcd700059b0 con 0x7fcd800681a0 2024-01-22T05:05:28.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.300+0000 7fcd77400700 1 --2- 172.21.15.49:0/986609499 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5805a510 0x7fcd5805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:28.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.300+0000 7fcd77400700 1 -- 172.21.15.49:0/986609499 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7058+0+0 (secure 0 0 0) 0x7fcd70074350 con 0x7fcd800681a0 2024-01-22T05:05:28.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.300+0000 7fcd7f400700 1 --2- 172.21.15.49:0/986609499 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5805a510 0x7fcd5805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:28.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.300+0000 7fcd7f400700 1 --2- 172.21.15.49:0/986609499 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5805a510 0x7fcd5805c9d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fcd68009fd0 tx=0x7fcd68016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:28.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.304+0000 7fcd77400700 1 -- 172.21.15.49:0/986609499 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcd700476c0 con 0x7fcd800681a0 2024-01-22T05:05:28.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.500+0000 7fcd85600700 1 -- 172.21.15.49:0/986609499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd800be780 con 0x7fcd800681a0 2024-01-22T05:05:28.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.500+0000 7fcd77400700 1 -- 172.21.15.49:0/986609499 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4491 (secure 0 0 0) 0x7fcd70018070 con 0x7fcd800681a0 2024-01-22T05:05:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:28.504 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/4240919875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4240919875},{"type":"v1","addr":"172.21.15.49:6836","nonce":4240919875}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3591660134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3591660134},{"type":"v1","addr":"172.21.15.49:6837","nonce":3591660134}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1228202507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1228202507},{"type":"v1","addr":"172.21.15.110:6833","nonce":1228202507}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:04:35.017706+0000","modified":"2024-01-22T05:04:49.308211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3391981756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3391981756},{"type":"v1","addr":"172.21.15.110:6835","nonce":3391981756}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:05:28.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.504+0000 7fcd85600700 1 -- 172.21.15.49:0/986609499 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5805a510 msgr2=0x7fcd5805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:28.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.504+0000 7fcd85600700 1 --2- 172.21.15.49:0/986609499 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5805a510 0x7fcd5805c9d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fcd68009fd0 tx=0x7fcd68016000).stop 2024-01-22T05:05:28.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.504+0000 7fcd85600700 1 -- 172.21.15.49:0/986609499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd800681a0 msgr2=0x7fcd80146bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:28.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.504+0000 7fcd85600700 1 --2- 172.21.15.49:0/986609499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd800681a0 0x7fcd80146bf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fcd7000c420 tx=0x7fcd70007c80).stop 2024-01-22T05:05:28.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.504+0000 7fcd85600700 1 -- 172.21.15.49:0/986609499 shutdown_connections 2024-01-22T05:05:28.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.504+0000 7fcd85600700 1 --2- 172.21.15.49:0/986609499 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5805a510 0x7fcd5805c9d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.504+0000 7fcd85600700 1 --2- 172.21.15.49:0/986609499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd800bdc70 0x7fcd800a22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.504+0000 7fcd85600700 1 --2- 172.21.15.49:0/986609499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd80068600 0x7fcd800a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.504+0000 7fcd85600700 1 --2- 172.21.15.49:0/986609499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd800681a0 0x7fcd80146bf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.504+0000 7fcd85600700 1 -- 172.21.15.49:0/986609499 >> 172.21.15.49:0/986609499 conn(0x7fcd800c86e0 msgr2=0x7fcd800c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:28.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.504+0000 7fcd85600700 1 -- 172.21.15.49:0/986609499 shutdown_connections 2024-01-22T05:05:28.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.504+0000 7fcd85600700 1 -- 172.21.15.49:0/986609499 wait complete. 2024-01-22T05:05:28.511 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-22T05:05:28.528 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:05:28.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.692+0000 7f48bf000700 1 Processor -- start 2024-01-22T05:05:28.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.692+0000 7f48bf000700 1 -- start start 2024-01-22T05:05:28.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.692+0000 7f48bf000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f48b80c25e0 0x7f48b80a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:28.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.692+0000 7f48bf000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b80c1a40 con 0x7f48b8155d20 2024-01-22T05:05:28.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.692+0000 7f48bf000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b80a90b0 con 0x7f48b80a8740 2024-01-22T05:05:28.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.692+0000 7f48bf000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b8159310 con 0x7f48b80c25e0 2024-01-22T05:05:28.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48b7e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f48b8155d20 0x7f48b8065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60536/0 (socket says 172.21.15.49:60536) 2024-01-22T05:05:28.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48b7e00700 1 -- 172.21.15.49:0/2198435591 learned_addr learned my addr 172.21.15.49:0/2198435591 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:28.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48b7400700 1 --1- 172.21.15.49:0/2198435591 >> v1:172.21.15.110:6789/0 conn(0x7f48b80a8740 0x7f48b80c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:41946/0 (socket says 172.21.15.49:41946) 2024-01-22T05:05:28.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48bd000700 1 --2- 172.21.15.49:0/2198435591 >> v2:172.21.15.49:3300/0 conn(0x7f48b80c25e0 0x7f48b80a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48b6a00700 1 -- 172.21.15.49:0/2198435591 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567523863 0 0) 0x7f48b80a90b0 con 0x7f48b80a8740 2024-01-22T05:05:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48b6a00700 1 -- 172.21.15.49:0/2198435591 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48980033f0 con 0x7f48b80a8740 2024-01-22T05:05:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48bd000700 1 -- 172.21.15.49:0/2198435591 >> v1:172.21.15.110:6789/0 conn(0x7f48b80a8740 legacy=0x7f48b80c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48bd000700 1 -- 172.21.15.49:0/2198435591 >> v1:172.21.15.49:6789/0 conn(0x7f48b8155d20 legacy=0x7f48b8065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48bd000700 1 -- 172.21.15.49:0/2198435591 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b80c13f0 con 0x7f48b80c25e0 2024-01-22T05:05:28.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48bd000700 1 --2- 172.21.15.49:0/2198435591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b80c25e0 0x7f48b80a8bc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f48b0009e60 tx=0x7f48b0009780).ready entity=mon.0 client_cookie=598cf6dc851393b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:28.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48b6a00700 1 -- 172.21.15.49:0/2198435591 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b000e070 con 0x7f48b80c25e0 2024-01-22T05:05:28.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48b6a00700 1 -- 172.21.15.49:0/2198435591 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b000bb60 con 0x7f48b80c25e0 2024-01-22T05:05:28.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48b6a00700 1 -- 172.21.15.49:0/2198435591 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b0012410 con 0x7f48b80c25e0 2024-01-22T05:05:28.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48bf000700 1 -- 172.21.15.49:0/2198435591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b80c25e0 msgr2=0x7f48b80a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48bf000700 1 --2- 172.21.15.49:0/2198435591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b80c25e0 0x7f48b80a8bc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f48b0009e60 tx=0x7f48b0009780).stop 2024-01-22T05:05:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48bf000700 1 -- 172.21.15.49:0/2198435591 shutdown_connections 2024-01-22T05:05:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48bf000700 1 --2- 172.21.15.49:0/2198435591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b80c25e0 0x7f48b80a8bc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.696+0000 7f48bf000700 1 -- 172.21.15.49:0/2198435591 >> 172.21.15.49:0/2198435591 conn(0x7f48b80c6540 msgr2=0x7f48b80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.700+0000 7f48bf000700 1 -- 172.21.15.49:0/2198435591 shutdown_connections 2024-01-22T05:05:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.700+0000 7f48bf000700 1 -- 172.21.15.49:0/2198435591 wait complete. 2024-01-22T05:05:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.700+0000 7f48bf000700 1 Processor -- start 2024-01-22T05:05:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.700+0000 7f48bf000700 1 -- start start 2024-01-22T05:05:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48bf000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80a8740 0x7f48b80bdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48bf000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80c25e0 0x7f48b80be000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48bf000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b8155d20 0x7f48b80be4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48bf000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8168700 con 0x7f48b8155d20 2024-01-22T05:05:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48bf000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b815acf0 con 0x7f48b80a8740 2024-01-22T05:05:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48bf000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8159e20 con 0x7f48b80c25e0 2024-01-22T05:05:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48b7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80a8740 0x7f48b80bdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48b7400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80c25e0 0x7f48b80be000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48bd000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b8155d20 0x7f48b80be4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48b7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80a8740 0x7f48b80bdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:47628/0 (socket says 172.21.15.49:47628) 2024-01-22T05:05:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48b7e00700 1 -- 172.21.15.49:0/1039615696 learned_addr learned my addr 172.21.15.49:0/1039615696 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48b7e00700 1 -- 172.21.15.49:0/1039615696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80c25e0 msgr2=0x7f48b80be000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48b7e00700 1 --2- 172.21.15.49:0/1039615696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80c25e0 0x7f48b80be000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48b7e00700 1 -- 172.21.15.49:0/1039615696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b8155d20 msgr2=0x7f48b80be4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48b7e00700 1 --2- 172.21.15.49:0/1039615696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b8155d20 0x7f48b80be4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48b7e00700 1 -- 172.21.15.49:0/1039615696 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b0009a20 con 0x7f48b80a8740 2024-01-22T05:05:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48b7400700 1 --2- 172.21.15.49:0/1039615696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80c25e0 0x7f48b80be000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48b7e00700 1 --2- 172.21.15.49:0/1039615696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80a8740 0x7f48b80bdb10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f48a8001eb0 tx=0x7f48a8007e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48af400700 1 -- 172.21.15.49:0/1039615696 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a80070d0 con 0x7f48b80a8740 2024-01-22T05:05:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48af400700 1 -- 172.21.15.49:0/1039615696 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a8007230 con 0x7f48b80a8740 2024-01-22T05:05:28.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48af400700 1 -- 172.21.15.49:0/1039615696 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a80075d0 con 0x7f48b80a8740 2024-01-22T05:05:28.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48bf000700 1 -- 172.21.15.49:0/1039615696 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b815a0e0 con 0x7f48b80a8740 2024-01-22T05:05:28.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.704+0000 7f48bf000700 1 -- 172.21.15.49:0/1039615696 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b815a6a0 con 0x7f48b80a8740 2024-01-22T05:05:28.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.708+0000 7f48bf000700 1 -- 172.21.15.49:0/1039615696 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b8047060 con 0x7f48b80a8740 2024-01-22T05:05:28.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.708+0000 7f48af400700 1 -- 172.21.15.49:0/1039615696 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f48a80059b0 con 0x7f48b80a8740 2024-01-22T05:05:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.712+0000 7f48af400700 1 --2- 172.21.15.49:0/1039615696 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f489005a510 0x7f489005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.712+0000 7f48af400700 1 -- 172.21.15.49:0/1039615696 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7058+0+0 (secure 0 0 0) 0x7f48a8074200 con 0x7f48b80a8740 2024-01-22T05:05:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.712+0000 7f48b7400700 1 --2- 172.21.15.49:0/1039615696 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f489005a510 0x7f489005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.712+0000 7f48b7400700 1 --2- 172.21.15.49:0/1039615696 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f489005a510 0x7f489005c9d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f48b80aabc0 tx=0x7f48a0007bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:28.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.720+0000 7f48af400700 1 -- 172.21.15.49:0/1039615696 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f48a8047570 con 0x7f48b80a8740 2024-01-22T05:05:28.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.884+0000 7f48bf000700 1 -- 172.21.15.49:0/1039615696 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48b8046800 con 0x7f48b80a8740 2024-01-22T05:05:28.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.884+0000 7f48af400700 1 -- 172.21.15.49:0/1039615696 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19053 (secure 0 0 0) 0x7f48a804ab90 con 0x7f48b80a8740 2024-01-22T05:05:28.890 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:28.890 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:05:23.141884+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:04:32.991898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:04:34.057128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2024-01-22T05:04:37.108860+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2},{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:05:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.888+0000 7f48bf000700 1 -- 172.21.15.49:0/1039615696 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f489005a510 msgr2=0x7f489005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.888+0000 7f48bf000700 1 --2- 172.21.15.49:0/1039615696 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f489005a510 0x7f489005c9d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f48b80aabc0 tx=0x7f48a0007bc0).stop 2024-01-22T05:05:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.888+0000 7f48bf000700 1 -- 172.21.15.49:0/1039615696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80a8740 msgr2=0x7f48b80bdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.888+0000 7f48bf000700 1 --2- 172.21.15.49:0/1039615696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80a8740 0x7f48b80bdb10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f48a8001eb0 tx=0x7f48a8007e50).stop 2024-01-22T05:05:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.888+0000 7f48bf000700 1 -- 172.21.15.49:0/1039615696 shutdown_connections 2024-01-22T05:05:28.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.888+0000 7f48bf000700 1 --2- 172.21.15.49:0/1039615696 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f489005a510 0x7f489005c9d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.888+0000 7f48bf000700 1 --2- 172.21.15.49:0/1039615696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b8155d20 0x7f48b80be4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.888+0000 7f48bf000700 1 --2- 172.21.15.49:0/1039615696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80c25e0 0x7f48b80be000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.888+0000 7f48bf000700 1 --2- 172.21.15.49:0/1039615696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80a8740 0x7f48b80bdb10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:28.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.888+0000 7f48bf000700 1 -- 172.21.15.49:0/1039615696 >> 172.21.15.49:0/1039615696 conn(0x7f48b80c6540 msgr2=0x7f48b8066600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:28.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.888+0000 7f48bf000700 1 -- 172.21.15.49:0/1039615696 shutdown_connections 2024-01-22T05:05:28.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:28.888+0000 7f48bf000700 1 -- 172.21.15.49:0/1039615696 wait complete. 2024-01-22T05:05:28.917 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:05:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.072+0000 7f13faa00700 1 Processor -- start 2024-01-22T05:05:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.076+0000 7f13faa00700 1 -- start start 2024-01-22T05:05:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.076+0000 7f13faa00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f13f4157e80 0x7f13f40c1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.076+0000 7f13faa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13f4064350 0x7f13f4068f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.076+0000 7f13faa00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f4062eb0 con 0x7f13f4068aa0 2024-01-22T05:05:29.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.076+0000 7f13faa00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f40c2c70 con 0x7f13f4157e80 2024-01-22T05:05:29.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.076+0000 7f13faa00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40693f0 con 0x7f13f4064350 2024-01-22T05:05:29.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.076+0000 7f13f9600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f13f4157e80 0x7f13f40c1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:29.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.076+0000 7f13fa000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13f4064350 0x7f13f4068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:29.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.080+0000 7f13f9600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f13f4157e80 0x7f13f40c1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:47642/0 (socket says 172.21.15.49:47642) 2024-01-22T05:05:29.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.080+0000 7f13f9600700 1 -- 172.21.15.49:0/997878546 learned_addr learned my addr 172.21.15.49:0/997878546 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:29.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.080+0000 7f13f8c00700 1 --1- 172.21.15.49:0/997878546 >> v1:172.21.15.110:6789/0 conn(0x7f13f4068aa0 0x7f13f415bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:41948/0 (socket says 172.21.15.49:41948) 2024-01-22T05:05:29.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.080+0000 7f13f9600700 1 -- 172.21.15.49:0/997878546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13f4064350 msgr2=0x7f13f4068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.080+0000 7f13f9600700 1 --2- 172.21.15.49:0/997878546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13f4064350 0x7f13f4068f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.080+0000 7f13f9600700 1 -- 172.21.15.49:0/997878546 >> v1:172.21.15.110:6789/0 conn(0x7f13f4068aa0 legacy=0x7f13f415bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.080+0000 7f13f3e00700 1 -- 172.21.15.49:0/997878546 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991711780 0 0) 0x7f13f4062eb0 con 0x7f13f4068aa0 2024-01-22T05:05:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.080+0000 7f13f9600700 1 -- 172.21.15.49:0/997878546 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f4062b80 con 0x7f13f4157e80 2024-01-22T05:05:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.080+0000 7f13fa000700 1 --2- 172.21.15.49:0/997878546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13f4064350 0x7f13f4068f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.080+0000 7f13f9600700 1 --2- 172.21.15.49:0/997878546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f4157e80 0x7f13f40c1b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f13e4006fd0 tx=0x7f13e40090f0).ready entity=mon.1 client_cookie=599e70ba7b7d67ef server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.080+0000 7f13f3e00700 1 -- 172.21.15.49:0/997878546 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e400b580 con 0x7f13f4157e80 2024-01-22T05:05:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.080+0000 7f13f3e00700 1 -- 172.21.15.49:0/997878546 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e400b6e0 con 0x7f13f4157e80 2024-01-22T05:05:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.080+0000 7f13f3e00700 1 -- 172.21.15.49:0/997878546 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e400ba60 con 0x7f13f4157e80 2024-01-22T05:05:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.080+0000 7f13faa00700 1 -- 172.21.15.49:0/997878546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f4157e80 msgr2=0x7f13f40c1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.080+0000 7f13faa00700 1 --2- 172.21.15.49:0/997878546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f4157e80 0x7f13f40c1b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f13e4006fd0 tx=0x7f13e40090f0).stop 2024-01-22T05:05:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.084+0000 7f13faa00700 1 -- 172.21.15.49:0/997878546 shutdown_connections 2024-01-22T05:05:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.084+0000 7f13faa00700 1 --2- 172.21.15.49:0/997878546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13f4064350 0x7f13f4068f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.084+0000 7f13faa00700 1 --2- 172.21.15.49:0/997878546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f4157e80 0x7f13f40c1b30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.084+0000 7f13faa00700 1 -- 172.21.15.49:0/997878546 >> 172.21.15.49:0/997878546 conn(0x7f13f40c42c0 msgr2=0x7f13f4065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.084+0000 7f13faa00700 1 -- 172.21.15.49:0/997878546 shutdown_connections 2024-01-22T05:05:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.084+0000 7f13faa00700 1 -- 172.21.15.49:0/997878546 wait complete. 2024-01-22T05:05:29.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.084+0000 7f13faa00700 1 Processor -- start 2024-01-22T05:05:29.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13faa00700 1 -- start start 2024-01-22T05:05:29.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13faa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13f4064350 0x7f13f416bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:29.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13faa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f4068aa0 0x7f13f40c0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:29.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13faa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13f4157e80 0x7f13f40c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:29.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13faa00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f416c9e0 con 0x7f13f4064350 2024-01-22T05:05:29.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13faa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f416c140 con 0x7f13f4068aa0 2024-01-22T05:05:29.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13faa00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f416c420 con 0x7f13f4157e80 2024-01-22T05:05:29.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13f9600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13f4064350 0x7f13f416bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:29.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13f9600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13f4064350 0x7f13f416bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45784/0 (socket says 172.21.15.49:45784) 2024-01-22T05:05:29.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13f9600700 1 -- 172.21.15.49:0/1346451882 learned_addr learned my addr 172.21.15.49:0/1346451882 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:29.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13f8c00700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f4068aa0 0x7f13f40c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:29.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13fa000700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13f4157e80 0x7f13f40c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:29.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13f9600700 1 -- 172.21.15.49:0/1346451882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13f4157e80 msgr2=0x7f13f40c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:29.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13f9600700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13f4157e80 0x7f13f40c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:29.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13f9600700 1 -- 172.21.15.49:0/1346451882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f4068aa0 msgr2=0x7f13f40c0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:29.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13f9600700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f4068aa0 0x7f13f40c0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:29.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13f9600700 1 -- 172.21.15.49:0/1346451882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ec009a20 con 0x7f13f4064350 2024-01-22T05:05:29.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13f8c00700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f4068aa0 0x7f13f40c0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:05:29.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13fa000700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13f4157e80 0x7f13f40c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:05:29.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.088+0000 7f13f9600700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13f4064350 0x7f13f416bb60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f13f406a000 tx=0x7f13e4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:29.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.092+0000 7f13f0c00700 1 -- 172.21.15.49:0/1346451882 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e400b850 con 0x7f13f4064350 2024-01-22T05:05:29.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.092+0000 7f13faa00700 1 -- 172.21.15.49:0/1346451882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e4009370 con 0x7f13f4064350 2024-01-22T05:05:29.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.092+0000 7f13f0c00700 1 -- 172.21.15.49:0/1346451882 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e400b9b0 con 0x7f13f4064350 2024-01-22T05:05:29.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.092+0000 7f13f0c00700 1 -- 172.21.15.49:0/1346451882 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e401c670 con 0x7f13f4064350 2024-01-22T05:05:29.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.092+0000 7f13faa00700 1 -- 172.21.15.49:0/1346451882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f40bbd50 con 0x7f13f4064350 2024-01-22T05:05:29.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.092+0000 7f13faa00700 1 -- 172.21.15.49:0/1346451882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f40a9750 con 0x7f13f4064350 2024-01-22T05:05:29.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.092+0000 7f13f0c00700 1 -- 172.21.15.49:0/1346451882 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f13e401c9e0 con 0x7f13f4064350 2024-01-22T05:05:29.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.092+0000 7f13f0c00700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13cc05a510 0x7f13cc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:29.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.092+0000 7f13f0c00700 1 -- 172.21.15.49:0/1346451882 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7058+0+0 (secure 0 0 0) 0x7f13e4076750 con 0x7f13f4064350 2024-01-22T05:05:29.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.096+0000 7f13f8c00700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13cc05a510 0x7f13cc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:29.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.096+0000 7f13f8c00700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13cc05a510 0x7f13cc05c9d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f13f4156ab0 tx=0x7f13dc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.100+0000 7f13f0c00700 1 -- 172.21.15.49:0/1346451882 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f13f40a9750 con 0x7f13f4064350 2024-01-22T05:05:29.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:29.304+0000 7f13faa00700 1 -- 172.21.15.49:0/1346451882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f13f40a9750 con 0x7f13f4064350 2024-01-22T05:05:30.207 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:05:30.204+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:05:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.216+0000 7f13f0c00700 1 -- 172.21.15.49:0/1346451882 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f13f40a9750 con 0x7f13f4064350 2024-01-22T05:05:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.220+0000 7f13faa00700 1 -- 172.21.15.49:0/1346451882 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13cc05a510 msgr2=0x7f13cc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.220+0000 7f13faa00700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13cc05a510 0x7f13cc05c9d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f13f4156ab0 tx=0x7f13dc009040).stop 2024-01-22T05:05:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.220+0000 7f13faa00700 1 -- 172.21.15.49:0/1346451882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13f4064350 msgr2=0x7f13f416bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.220+0000 7f13faa00700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13f4064350 0x7f13f416bb60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f13f406a000 tx=0x7f13e4017000).stop 2024-01-22T05:05:30.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.224+0000 7f13faa00700 1 -- 172.21.15.49:0/1346451882 shutdown_connections 2024-01-22T05:05:30.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.224+0000 7f13faa00700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13cc05a510 0x7f13cc05c9d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:30.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.224+0000 7f13faa00700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13f4157e80 0x7f13f40c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:30.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.224+0000 7f13faa00700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f4068aa0 0x7f13f40c0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:30.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.224+0000 7f13faa00700 1 --2- 172.21.15.49:0/1346451882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13f4064350 0x7f13f416bb60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:30.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.224+0000 7f13faa00700 1 -- 172.21.15.49:0/1346451882 >> 172.21.15.49:0/1346451882 conn(0x7f13f40c42c0 msgr2=0x7f13f4159e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:30.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.224+0000 7f13faa00700 1 -- 172.21.15.49:0/1346451882 shutdown_connections 2024-01-22T05:05:30.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.224+0000 7f13faa00700 1 -- 172.21.15.49:0/1346451882 wait complete. 2024-01-22T05:05:30.229 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:05:30.233 INFO:tasks.ceph.mds.b.smithi110.stderr: -3174> 2024-01-22T05:04:40.547+0000 7f0948e00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:05:30.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:05:30.279 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:05:30.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.416+0000 7fccece00700 1 Processor -- start 2024-01-22T05:05:30.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.416+0000 7fccece00700 1 -- start start 2024-01-22T05:05:30.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.420+0000 7fccece00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcce80bc7b0 0x7fcce814d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:30.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.420+0000 7fccece00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcce8157de0 0x7fcce814dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:30.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.420+0000 7fccece00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce8067a90 con 0x7fcce80bc3d0 2024-01-22T05:05:30.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.420+0000 7fccece00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce80c1160 con 0x7fcce80bc7b0 2024-01-22T05:05:30.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.420+0000 7fccece00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce8067d70 con 0x7fcce8157de0 2024-01-22T05:05:30.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.420+0000 7fcce5e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcce80bc3d0 0x7fcce81576d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60542/0 (socket says 172.21.15.49:60542) 2024-01-22T05:05:30.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.420+0000 7fcce5e00700 1 -- 172.21.15.49:0/2023513381 learned_addr learned my addr 172.21.15.49:0/2023513381 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:30.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.420+0000 7fcce5400700 1 --2- 172.21.15.49:0/2023513381 >> v2:172.21.15.49:3300/0 conn(0x7fcce80bc7b0 0x7fcce814d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:30.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.420+0000 7fcce6800700 1 --2- 172.21.15.49:0/2023513381 >> v2:172.21.15.110:3300/0 conn(0x7fcce8157de0 0x7fcce814dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:30.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.420+0000 7fcce4a00700 1 -- 172.21.15.49:0/2023513381 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084145521 0 0) 0x7fcce8067a90 con 0x7fcce80bc3d0 2024-01-22T05:05:30.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fcce4a00700 1 -- 172.21.15.49:0/2023513381 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc80033f0 con 0x7fcce80bc3d0 2024-01-22T05:05:30.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fcce6800700 1 -- 172.21.15.49:0/2023513381 >> v2:172.21.15.49:3300/0 conn(0x7fcce80bc7b0 msgr2=0x7fcce814d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:30.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fcce6800700 1 --2- 172.21.15.49:0/2023513381 >> v2:172.21.15.49:3300/0 conn(0x7fcce80bc7b0 0x7fcce814d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:30.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fcce6800700 1 -- 172.21.15.49:0/2023513381 >> v1:172.21.15.49:6789/0 conn(0x7fcce80bc3d0 legacy=0x7fcce81576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:30.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fcce6800700 1 -- 172.21.15.49:0/2023513381 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce80bcc60 con 0x7fcce8157de0 2024-01-22T05:05:30.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fcce5400700 1 --2- 172.21.15.49:0/2023513381 >> v2:172.21.15.49:3300/0 conn(0x7fcce80bc7b0 0x7fcce814d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:30.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fcce6800700 1 --2- 172.21.15.49:0/2023513381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcce8157de0 0x7fcce814dd10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fcce8067ce0 tx=0x7fcce0009780).ready entity=mon.1 client_cookie=cb76f362aef1232a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:30.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fcce4a00700 1 -- 172.21.15.49:0/2023513381 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce000e070 con 0x7fcce8157de0 2024-01-22T05:05:30.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fcce4a00700 1 -- 172.21.15.49:0/2023513381 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce000bab0 con 0x7fcce8157de0 2024-01-22T05:05:30.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fcce4a00700 1 -- 172.21.15.49:0/2023513381 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce000be30 con 0x7fcce8157de0 2024-01-22T05:05:30.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fccece00700 1 -- 172.21.15.49:0/2023513381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcce8157de0 msgr2=0x7fcce814dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:30.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fccece00700 1 --2- 172.21.15.49:0/2023513381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcce8157de0 0x7fcce814dd10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fcce8067ce0 tx=0x7fcce0009780).stop 2024-01-22T05:05:30.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fccece00700 1 -- 172.21.15.49:0/2023513381 shutdown_connections 2024-01-22T05:05:30.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fccece00700 1 --2- 172.21.15.49:0/2023513381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcce8157de0 0x7fcce814dd10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:30.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fccece00700 1 --2- 172.21.15.49:0/2023513381 >> v2:172.21.15.49:3300/0 conn(0x7fcce80bc7b0 0x7fcce814d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:30.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fccece00700 1 -- 172.21.15.49:0/2023513381 >> 172.21.15.49:0/2023513381 conn(0x7fcce80c6560 msgr2=0x7fcce80c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:30.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fccece00700 1 -- 172.21.15.49:0/2023513381 shutdown_connections 2024-01-22T05:05:30.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.424+0000 7fccece00700 1 -- 172.21.15.49:0/2023513381 wait complete. 2024-01-22T05:05:30.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.428+0000 7fccece00700 1 Processor -- start 2024-01-22T05:05:30.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.428+0000 7fccece00700 1 -- start start 2024-01-22T05:05:30.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.428+0000 7fccece00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcce80bc3d0 0x7fcce8146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:30.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fccece00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcce80bc7b0 0x7fcce80a8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:30.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fccece00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcce8157de0 0x7fcce80c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:30.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fccece00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80a4660 con 0x7fcce80bc7b0 2024-01-22T05:05:30.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fccece00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80a3a50 con 0x7fcce80bc3d0 2024-01-22T05:05:30.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fccece00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80a3d30 con 0x7fcce8157de0 2024-01-22T05:05:30.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fcce5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcce80bc7b0 0x7fcce80a8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:30.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fcce5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcce80bc7b0 0x7fcce80a8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45796/0 (socket says 172.21.15.49:45796) 2024-01-22T05:05:30.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fcce5400700 1 -- 172.21.15.49:0/1991208630 learned_addr learned my addr 172.21.15.49:0/1991208630 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:30.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fcce5e00700 1 --2- 172.21.15.49:0/1991208630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcce80bc3d0 0x7fcce8146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:30.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fcce6800700 1 --2- 172.21.15.49:0/1991208630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcce8157de0 0x7fcce80c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:30.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fcce5400700 1 -- 172.21.15.49:0/1991208630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcce8157de0 msgr2=0x7fcce80c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:30.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fcce5400700 1 --2- 172.21.15.49:0/1991208630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcce8157de0 0x7fcce80c17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:30.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fcce5400700 1 -- 172.21.15.49:0/1991208630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcce80bc3d0 msgr2=0x7fcce8146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:30.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fcce5400700 1 --2- 172.21.15.49:0/1991208630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcce80bc3d0 0x7fcce8146240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:30.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fcce5400700 1 -- 172.21.15.49:0/1991208630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd00092a0 con 0x7fcce80bc7b0 2024-01-22T05:05:30.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fcce5400700 1 --2- 172.21.15.49:0/1991208630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcce80bc7b0 0x7fcce80a8a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fccd000e9a0 tx=0x7fccd0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:30.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fccdd600700 1 -- 172.21.15.49:0/1991208630 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd000c670 con 0x7fcce80bc7b0 2024-01-22T05:05:30.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fccdd600700 1 -- 172.21.15.49:0/1991208630 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd000c7d0 con 0x7fcce80bc7b0 2024-01-22T05:05:30.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fccdd600700 1 -- 172.21.15.49:0/1991208630 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd000cb50 con 0x7fcce80bc7b0 2024-01-22T05:05:30.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fccece00700 1 -- 172.21.15.49:0/1991208630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce0009a20 con 0x7fcce80bc7b0 2024-01-22T05:05:30.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.432+0000 7fccece00700 1 -- 172.21.15.49:0/1991208630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce80a42f0 con 0x7fcce80bc7b0 2024-01-22T05:05:30.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.436+0000 7fccece00700 1 -- 172.21.15.49:0/1991208630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce80a47d0 con 0x7fcce80bc7b0 2024-01-22T05:05:30.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.436+0000 7fccdd600700 1 -- 172.21.15.49:0/1991208630 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fccd001b400 con 0x7fcce80bc7b0 2024-01-22T05:05:30.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.436+0000 7fccdd600700 1 --2- 172.21.15.49:0/1991208630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccc005a510 0x7fccc005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:30.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.436+0000 7fccdd600700 1 -- 172.21.15.49:0/1991208630 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7144+0+0 (secure 0 0 0) 0x7fccd0075130 con 0x7fcce80bc7b0 2024-01-22T05:05:30.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.436+0000 7fcce5e00700 1 --2- 172.21.15.49:0/1991208630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccc005a510 0x7fccc005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:30.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.440+0000 7fcce5e00700 1 --2- 172.21.15.49:0/1991208630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccc005a510 0x7fccc005c9d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fccd8007fd0 tx=0x7fccd8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:30.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.444+0000 7fccdd600700 1 -- 172.21.15.49:0/1991208630 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fccd00484b0 con 0x7fcce80bc7b0 2024-01-22T05:05:30.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:30.648+0000 7fccece00700 1 -- 172.21.15.49:0/1991208630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcce8046800 con 0x7fcce80bc7b0 2024-01-22T05:05:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.224+0000 7fccdd600700 1 -- 172.21.15.49:0/1991208630 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fccd00160a0 con 0x7fcce80bc7b0 2024-01-22T05:05:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.228+0000 7fccece00700 1 -- 172.21.15.49:0/1991208630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccc005a510 msgr2=0x7fccc005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:31.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.228+0000 7fccece00700 1 --2- 172.21.15.49:0/1991208630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccc005a510 0x7fccc005c9d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fccd8007fd0 tx=0x7fccd8009040).stop 2024-01-22T05:05:31.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.228+0000 7fccece00700 1 -- 172.21.15.49:0/1991208630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcce80bc7b0 msgr2=0x7fcce80a8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:31.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.228+0000 7fccece00700 1 --2- 172.21.15.49:0/1991208630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcce80bc7b0 0x7fcce80a8a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fccd000e9a0 tx=0x7fccd0009060).stop 2024-01-22T05:05:31.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.228+0000 7fccece00700 1 -- 172.21.15.49:0/1991208630 shutdown_connections 2024-01-22T05:05:31.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.228+0000 7fccece00700 1 --2- 172.21.15.49:0/1991208630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccc005a510 0x7fccc005c9d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:31.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.228+0000 7fccece00700 1 --2- 172.21.15.49:0/1991208630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcce8157de0 0x7fcce80c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:31.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.228+0000 7fccece00700 1 --2- 172.21.15.49:0/1991208630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcce80bc7b0 0x7fcce80a8a20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:31.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.228+0000 7fccece00700 1 --2- 172.21.15.49:0/1991208630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcce80bc3d0 0x7fcce8146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:31.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.228+0000 7fccece00700 1 -- 172.21.15.49:0/1991208630 >> 172.21.15.49:0/1991208630 conn(0x7fcce80c6560 msgr2=0x7fcce81564f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:31.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.228+0000 7fccece00700 1 -- 172.21.15.49:0/1991208630 shutdown_connections 2024-01-22T05:05:31.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.228+0000 7fccece00700 1 -- 172.21.15.49:0/1991208630 wait complete. 2024-01-22T05:05:31.255 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:05:31.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.420+0000 7fca4b200700 1 Processor -- start 2024-01-22T05:05:31.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.424+0000 7fca4b200700 1 -- start start 2024-01-22T05:05:31.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca4b200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fca4c063080 0x7fca4c0c4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:31.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca4b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c0bdcd0 0x7fca4c0c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:31.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca4b200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4c067a90 con 0x7fca4c0bd8f0 2024-01-22T05:05:31.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca4b200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca4c0c3690 con 0x7fca4c063080 2024-01-22T05:05:31.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca4b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c068610 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca49e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fca4c0bd8f0 0x7fca4c062970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60558/0 (socket says 172.21.15.49:60558) 2024-01-22T05:05:31.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca49e00700 1 -- 172.21.15.49:0/2451823301 learned_addr learned my addr 172.21.15.49:0/2451823301 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:31.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca49400700 1 --2- 172.21.15.49:0/2451823301 >> v2:172.21.15.110:3300/0 conn(0x7fca4c063080 0x7fca4c0c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:31.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca4a800700 1 --2- 172.21.15.49:0/2451823301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c0bdcd0 0x7fca4c0c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:31.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca48a00700 1 -- 172.21.15.49:0/2451823301 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632852547 0 0) 0x7fca4c067a90 con 0x7fca4c0bd8f0 2024-01-22T05:05:31.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca48a00700 1 -- 172.21.15.49:0/2451823301 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca2c0033f0 con 0x7fca4c0bd8f0 2024-01-22T05:05:31.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca4a800700 1 -- 172.21.15.49:0/2451823301 >> v2:172.21.15.110:3300/0 conn(0x7fca4c063080 msgr2=0x7fca4c0c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:31.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca4a800700 1 --2- 172.21.15.49:0/2451823301 >> v2:172.21.15.110:3300/0 conn(0x7fca4c063080 0x7fca4c0c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:31.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca4a800700 1 -- 172.21.15.49:0/2451823301 >> v1:172.21.15.49:6789/0 conn(0x7fca4c0bd8f0 legacy=0x7fca4c062970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:31.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca4a800700 1 -- 172.21.15.49:0/2451823301 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c0c4c30 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca49400700 1 --2- 172.21.15.49:0/2451823301 >> v2:172.21.15.110:3300/0 conn(0x7fca4c063080 0x7fca4c0c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:31.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.428+0000 7fca4a800700 1 --2- 172.21.15.49:0/2451823301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c0bdcd0 0x7fca4c0c4740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fca44009e60 tx=0x7fca44009780).ready entity=mon.2 client_cookie=a735251f875e924f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:31.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.432+0000 7fca48a00700 1 -- 172.21.15.49:0/2451823301 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400e070 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.432+0000 7fca48a00700 1 -- 172.21.15.49:0/2451823301 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4400bab0 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.432+0000 7fca48a00700 1 -- 172.21.15.49:0/2451823301 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400be30 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.432+0000 7fca4b200700 1 -- 172.21.15.49:0/2451823301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c0bdcd0 msgr2=0x7fca4c0c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:31.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.432+0000 7fca4b200700 1 --2- 172.21.15.49:0/2451823301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c0bdcd0 0x7fca4c0c4740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fca44009e60 tx=0x7fca44009780).stop 2024-01-22T05:05:31.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.432+0000 7fca4b200700 1 -- 172.21.15.49:0/2451823301 shutdown_connections 2024-01-22T05:05:31.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.432+0000 7fca4b200700 1 --2- 172.21.15.49:0/2451823301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c0bdcd0 0x7fca4c0c4740 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:31.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.432+0000 7fca4b200700 1 --2- 172.21.15.49:0/2451823301 >> v2:172.21.15.110:3300/0 conn(0x7fca4c063080 0x7fca4c0c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:31.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.432+0000 7fca4b200700 1 -- 172.21.15.49:0/2451823301 >> 172.21.15.49:0/2451823301 conn(0x7fca4c0c8770 msgr2=0x7fca4c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:31.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.432+0000 7fca4b200700 1 -- 172.21.15.49:0/2451823301 shutdown_connections 2024-01-22T05:05:31.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.432+0000 7fca4b200700 1 -- 172.21.15.49:0/2451823301 wait complete. 2024-01-22T05:05:31.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.436+0000 7fca4b200700 1 Processor -- start 2024-01-22T05:05:31.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.436+0000 7fca4b200700 1 -- start start 2024-01-22T05:05:31.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.436+0000 7fca4b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c063080 0x7fca4c155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:31.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.436+0000 7fca4b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca4c0bd8f0 0x7fca4c149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:31.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.436+0000 7fca4b200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0bdcd0 0x7fca4c0ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:31.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.436+0000 7fca4b200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c156960 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.436+0000 7fca4b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c149fe0 con 0x7fca4c0bd8f0 2024-01-22T05:05:31.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.436+0000 7fca4b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c159920 con 0x7fca4c063080 2024-01-22T05:05:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca4a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0bdcd0 0x7fca4c0ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca49e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c063080 0x7fca4c155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca49e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c063080 0x7fca4c155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:39576/0 (socket says 172.21.15.49:39576) 2024-01-22T05:05:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca49400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca4c0bd8f0 0x7fca4c149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca49e00700 1 -- 172.21.15.49:0/108617517 learned_addr learned my addr 172.21.15.49:0/108617517 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:31.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca4a800700 1 -- 172.21.15.49:0/108617517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c063080 msgr2=0x7fca4c155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:31.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca4a800700 1 --2- 172.21.15.49:0/108617517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c063080 0x7fca4c155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:31.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca4a800700 1 -- 172.21.15.49:0/108617517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca4c0bd8f0 msgr2=0x7fca4c149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:31.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca4a800700 1 --2- 172.21.15.49:0/108617517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca4c0bd8f0 0x7fca4c149af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:31.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca4a800700 1 -- 172.21.15.49:0/108617517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca340092a0 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca4a800700 1 --2- 172.21.15.49:0/108617517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0bdcd0 0x7fca4c0ab8f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fca4c066700 tx=0x7fca44009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:31.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca41600700 1 -- 172.21.15.49:0/108617517 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44013e40 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca41600700 1 -- 172.21.15.49:0/108617517 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4401d630 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca4b200700 1 -- 172.21.15.49:0/108617517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca44009a20 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca41600700 1 -- 172.21.15.49:0/108617517 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4401d9f0 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.440+0000 7fca4b200700 1 -- 172.21.15.49:0/108617517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4c1563a0 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.444+0000 7fca4b200700 1 -- 172.21.15.49:0/108617517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4c066840 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.444+0000 7fca41600700 1 -- 172.21.15.49:0/108617517 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fca44003040 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.444+0000 7fca41600700 1 --2- 172.21.15.49:0/108617517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca2405a510 0x7fca2405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.444+0000 7fca41600700 1 -- 172.21.15.49:0/108617517 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7144+0+0 (secure 0 0 0) 0x7fca440768a0 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.444+0000 7fca49e00700 1 --2- 172.21.15.49:0/108617517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca2405a510 0x7fca2405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.444+0000 7fca49e00700 1 --2- 172.21.15.49:0/108617517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca2405a510 0x7fca2405c9d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fca3c001950 tx=0x7fca3c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:31.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.452+0000 7fca41600700 1 -- 172.21.15.49:0/108617517 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fca44049bc0 con 0x7fca4c0bdcd0 2024-01-22T05:05:31.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:31.620+0000 7fca4b200700 1 -- 172.21.15.49:0/108617517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fca4c067ce0 con 0x7fca4c0bdcd0 2024-01-22T05:05:32.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.232+0000 7fca41600700 1 -- 172.21.15.49:0/108617517 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7fca4404d1e0 con 0x7fca4c0bdcd0 2024-01-22T05:05:32.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.240+0000 7fca4b200700 1 -- 172.21.15.49:0/108617517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca2405a510 msgr2=0x7fca2405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.240+0000 7fca4b200700 1 --2- 172.21.15.49:0/108617517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca2405a510 0x7fca2405c9d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fca3c001950 tx=0x7fca3c009040).stop 2024-01-22T05:05:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.240+0000 7fca4b200700 1 -- 172.21.15.49:0/108617517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0bdcd0 msgr2=0x7fca4c0ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.240+0000 7fca4b200700 1 --2- 172.21.15.49:0/108617517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0bdcd0 0x7fca4c0ab8f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fca4c066700 tx=0x7fca44009780).stop 2024-01-22T05:05:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.240+0000 7fca4b200700 1 -- 172.21.15.49:0/108617517 shutdown_connections 2024-01-22T05:05:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.240+0000 7fca4b200700 1 --2- 172.21.15.49:0/108617517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca2405a510 0x7fca2405c9d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.240+0000 7fca4b200700 1 --2- 172.21.15.49:0/108617517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0bdcd0 0x7fca4c0ab8f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:32.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.240+0000 7fca4b200700 1 --2- 172.21.15.49:0/108617517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca4c0bd8f0 0x7fca4c149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:32.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.240+0000 7fca4b200700 1 --2- 172.21.15.49:0/108617517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c063080 0x7fca4c155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:32.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.240+0000 7fca4b200700 1 -- 172.21.15.49:0/108617517 >> 172.21.15.49:0/108617517 conn(0x7fca4c0c8770 msgr2=0x7fca4c068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:32.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.240+0000 7fca4b200700 1 -- 172.21.15.49:0/108617517 shutdown_connections 2024-01-22T05:05:32.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.240+0000 7fca4b200700 1 -- 172.21.15.49:0/108617517 wait complete. 2024-01-22T05:05:32.247 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:05:32.266 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:05:32.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.440+0000 7fae55a00700 1 Processor -- start 2024-01-22T05:05:32.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.440+0000 7fae55a00700 1 -- start start 2024-01-22T05:05:32.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae55a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fae50068cb0 0x7fae50156f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:32.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae55a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae50067a90 0x7fae50067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:32.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae55a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae50066560 con 0x7fae500683e0 2024-01-22T05:05:32.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae55a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae500bc930 con 0x7fae50068cb0 2024-01-22T05:05:32.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae55a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae500bd240 con 0x7fae50067a90 2024-01-22T05:05:32.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae55000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fae500683e0 0x7fae501577b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60570/0 (socket says 172.21.15.49:60570) 2024-01-22T05:05:32.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae55000700 1 -- 172.21.15.49:0/1979326389 learned_addr learned my addr 172.21.15.49:0/1979326389 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:32.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4f400700 1 --2- 172.21.15.49:0/1979326389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae50067a90 0x7fae50067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:32.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4fe00700 1 --2- 172.21.15.49:0/1979326389 >> v2:172.21.15.110:3300/0 conn(0x7fae50068cb0 0x7fae50156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:32.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 -- 172.21.15.49:0/1979326389 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413480184 0 0) 0x7fae50066560 con 0x7fae500683e0 2024-01-22T05:05:32.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 -- 172.21.15.49:0/1979326389 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae300033f0 con 0x7fae500683e0 2024-01-22T05:05:32.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 -- 172.21.15.49:0/1979326389 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2543822618 0 0) 0x7fae300033f0 con 0x7fae500683e0 2024-01-22T05:05:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 -- 172.21.15.49:0/1979326389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae50067a90 msgr2=0x7fae50067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 --2- 172.21.15.49:0/1979326389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae50067a90 0x7fae50067ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 -- 172.21.15.49:0/1979326389 >> v2:172.21.15.110:3300/0 conn(0x7fae50068cb0 msgr2=0x7fae50156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 --2- 172.21.15.49:0/1979326389 >> v2:172.21.15.110:3300/0 conn(0x7fae50068cb0 0x7fae50156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 -- 172.21.15.49:0/1979326389 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae50068870 con 0x7fae500683e0 2024-01-22T05:05:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 -- 172.21.15.49:0/1979326389 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fae480017f0 con 0x7fae500683e0 2024-01-22T05:05:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 -- 172.21.15.49:0/1979326389 >> v1:172.21.15.49:6789/0 conn(0x7fae500683e0 legacy=0x7fae501577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 --2- 172.21.15.49:0/1979326389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae30003910 0x7fae30003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 --2- 172.21.15.49:0/1979326389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae30004690 0x7fae30004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 --2- 172.21.15.49:0/1979326389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae50067a90 0x7fae30005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 -- 172.21.15.49:0/1979326389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500bc930 con 0x7fae30004690 2024-01-22T05:05:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 -- 172.21.15.49:0/1979326389 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500bd240 con 0x7fae30003910 2024-01-22T05:05:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.444+0000 7fae4ea00700 1 -- 172.21.15.49:0/1979326389 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3000b8e0 con 0x7fae50067a90 2024-01-22T05:05:32.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.448+0000 7fae55000700 1 --2- 172.21.15.49:0/1979326389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae50067a90 0x7fae30005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:32.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.448+0000 7fae4fe00700 1 --2- 172.21.15.49:0/1979326389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae30003910 0x7fae30003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:32.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.448+0000 7fae4f400700 1 --2- 172.21.15.49:0/1979326389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae30004690 0x7fae30004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:32.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.448+0000 7fae55000700 1 -- 172.21.15.49:0/1979326389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae30003910 msgr2=0x7fae30003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:32.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.448+0000 7fae55000700 1 --2- 172.21.15.49:0/1979326389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae30003910 0x7fae30003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:32.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.448+0000 7fae55000700 1 -- 172.21.15.49:0/1979326389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae30004690 msgr2=0x7fae30004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:32.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.448+0000 7fae55000700 1 --2- 172.21.15.49:0/1979326389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae30004690 0x7fae30004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:32.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.448+0000 7fae55000700 1 -- 172.21.15.49:0/1979326389 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae300033f0 con 0x7fae50067a90 2024-01-22T05:05:32.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.448+0000 7fae55000700 1 --2- 172.21.15.49:0/1979326389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae50067a90 0x7fae30005000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fae4800c5f0 tx=0x7fae50066e10).ready entity=mon.2 client_cookie=383f189d0bd63160 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:32.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.448+0000 7fae4ea00700 1 -- 172.21.15.49:0/1979326389 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800cdf0 con 0x7fae50067a90 2024-01-22T05:05:32.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.448+0000 7fae4ea00700 1 -- 172.21.15.49:0/1979326389 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae48005b20 con 0x7fae50067a90 2024-01-22T05:05:32.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.448+0000 7fae4ea00700 1 -- 172.21.15.49:0/1979326389 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48005ea0 con 0x7fae50067a90 2024-01-22T05:05:32.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.448+0000 7fae55a00700 1 -- 172.21.15.49:0/1979326389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae50067a90 msgr2=0x7fae30005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:32.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.448+0000 7fae55a00700 1 --2- 172.21.15.49:0/1979326389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae50067a90 0x7fae30005000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fae4800c5f0 tx=0x7fae50066e10).stop 2024-01-22T05:05:32.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.448+0000 7fae55000700 1 -- 172.21.15.49:0/1979326389 reap_dead start 2024-01-22T05:05:32.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.452+0000 7fae55a00700 1 -- 172.21.15.49:0/1979326389 shutdown_connections 2024-01-22T05:05:32.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.452+0000 7fae55a00700 1 -- 172.21.15.49:0/1979326389 >> 172.21.15.49:0/1979326389 conn(0x7fae500c6f70 msgr2=0x7fae500c2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:32.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.452+0000 7fae55a00700 1 -- 172.21.15.49:0/1979326389 shutdown_connections 2024-01-22T05:05:32.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.452+0000 7fae55a00700 1 -- 172.21.15.49:0/1979326389 wait complete. 2024-01-22T05:05:32.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.456+0000 7fae55a00700 1 Processor -- start 2024-01-22T05:05:32.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.456+0000 7fae55a00700 1 -- start start 2024-01-22T05:05:32.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.456+0000 7fae55a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae50067a90 0x7fae500ac300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:32.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.456+0000 7fae55a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae50153b50 0x7fae50153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:32.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.456+0000 7fae55a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae500aada0 0x7fae500ab220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:32.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.456+0000 7fae55a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500bd600 con 0x7fae50067a90 2024-01-22T05:05:32.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.456+0000 7fae55a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500be460 con 0x7fae50153b50 2024-01-22T05:05:32.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.456+0000 7fae55a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae501543c0 con 0x7fae500aada0 2024-01-22T05:05:32.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.456+0000 7fae4fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae50067a90 0x7fae500ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:32.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.456+0000 7fae4fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae50067a90 0x7fae500ac300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45808/0 (socket says 172.21.15.49:45808) 2024-01-22T05:05:32.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.456+0000 7fae4fe00700 1 -- 172.21.15.49:0/3388338638 learned_addr learned my addr 172.21.15.49:0/3388338638 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:32.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.460+0000 7fae4f400700 1 --2- 172.21.15.49:0/3388338638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae50153b50 0x7fae50153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:32.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.460+0000 7fae55000700 1 --2- 172.21.15.49:0/3388338638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae500aada0 0x7fae500ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:32.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.460+0000 7fae4fe00700 1 -- 172.21.15.49:0/3388338638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae500aada0 msgr2=0x7fae500ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:32.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.460+0000 7fae4fe00700 1 --2- 172.21.15.49:0/3388338638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae500aada0 0x7fae500ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:32.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.460+0000 7fae4fe00700 1 -- 172.21.15.49:0/3388338638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae50153b50 msgr2=0x7fae50153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:32.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.460+0000 7fae4fe00700 1 --2- 172.21.15.49:0/3388338638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae50153b50 0x7fae50153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:32.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.460+0000 7fae4fe00700 1 -- 172.21.15.49:0/3388338638 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae500ab710 con 0x7fae50067a90 2024-01-22T05:05:32.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.460+0000 7fae4f400700 1 --2- 172.21.15.49:0/3388338638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae50153b50 0x7fae50153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:32.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.460+0000 7fae4fe00700 1 --2- 172.21.15.49:0/3388338638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae50067a90 0x7fae500ac300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fae40011a20 tx=0x7fae40009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:32.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.460+0000 7fae47400700 1 -- 172.21.15.49:0/3388338638 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4000f940 con 0x7fae50067a90 2024-01-22T05:05:32.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.460+0000 7fae47400700 1 -- 172.21.15.49:0/3388338638 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4000faa0 con 0x7fae50067a90 2024-01-22T05:05:32.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.460+0000 7fae55a00700 1 -- 172.21.15.49:0/3388338638 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae500bd850 con 0x7fae50067a90 2024-01-22T05:05:32.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.460+0000 7fae47400700 1 -- 172.21.15.49:0/3388338638 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4000fe20 con 0x7fae50067a90 2024-01-22T05:05:32.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.460+0000 7fae55a00700 1 -- 172.21.15.49:0/3388338638 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae500bde10 con 0x7fae50067a90 2024-01-22T05:05:32.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.460+0000 7fae55a00700 1 -- 172.21.15.49:0/3388338638 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5005fd40 con 0x7fae50067a90 2024-01-22T05:05:32.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.464+0000 7fae47400700 1 -- 172.21.15.49:0/3388338638 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fae40014650 con 0x7fae50067a90 2024-01-22T05:05:32.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.464+0000 7fae47400700 1 --2- 172.21.15.49:0/3388338638 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae2805a540 0x7fae2805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:32.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.464+0000 7fae47400700 1 -- 172.21.15.49:0/3388338638 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fae400754e0 con 0x7fae50067a90 2024-01-22T05:05:32.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.464+0000 7fae4f400700 1 --2- 172.21.15.49:0/3388338638 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae2805a540 0x7fae2805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:32.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.464+0000 7fae4f400700 1 --2- 172.21.15.49:0/3388338638 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae2805a540 0x7fae2805ca00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fae38006d30 tx=0x7fae38008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:32.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.468+0000 7fae47400700 1 -- 172.21.15.49:0/3388338638 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fae40048af0 con 0x7fae50067a90 2024-01-22T05:05:32.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:32.632+0000 7fae55a00700 1 -- 172.21.15.49:0/3388338638 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fae500bc510 con 0x7fae50067a90 2024-01-22T05:05:33.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.236+0000 7fae47400700 1 -- 172.21.15.49:0/3388338638 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7fae500bc510 con 0x7fae50067a90 2024-01-22T05:05:33.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.244+0000 7fae55a00700 1 -- 172.21.15.49:0/3388338638 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae2805a540 msgr2=0x7fae2805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:33.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.244+0000 7fae55a00700 1 --2- 172.21.15.49:0/3388338638 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae2805a540 0x7fae2805ca00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fae38006d30 tx=0x7fae38008040).stop 2024-01-22T05:05:33.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.244+0000 7fae55a00700 1 -- 172.21.15.49:0/3388338638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae50067a90 msgr2=0x7fae500ac300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:33.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.244+0000 7fae55a00700 1 --2- 172.21.15.49:0/3388338638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae50067a90 0x7fae500ac300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fae40011a20 tx=0x7fae40009060).stop 2024-01-22T05:05:33.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.244+0000 7fae55a00700 1 -- 172.21.15.49:0/3388338638 shutdown_connections 2024-01-22T05:05:33.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.244+0000 7fae55a00700 1 --2- 172.21.15.49:0/3388338638 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae2805a540 0x7fae2805ca00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:33.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.244+0000 7fae55a00700 1 --2- 172.21.15.49:0/3388338638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae500aada0 0x7fae500ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:33.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.244+0000 7fae55a00700 1 --2- 172.21.15.49:0/3388338638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae50153b50 0x7fae50153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:33.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.244+0000 7fae55a00700 1 --2- 172.21.15.49:0/3388338638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae50067a90 0x7fae500ac300 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:33.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.244+0000 7fae55a00700 1 -- 172.21.15.49:0/3388338638 >> 172.21.15.49:0/3388338638 conn(0x7fae500c6f70 msgr2=0x7fae500a95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:33.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.244+0000 7fae55a00700 1 -- 172.21.15.49:0/3388338638 shutdown_connections 2024-01-22T05:05:33.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.244+0000 7fae55a00700 1 -- 172.21.15.49:0/3388338638 wait complete. 2024-01-22T05:05:33.253 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-01-22T05:05:33.272 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-01-22T05:05:33.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.452+0000 7ff6ae200700 1 Processor -- start 2024-01-22T05:05:33.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.456+0000 7ff6ae200700 1 -- start start 2024-01-22T05:05:33.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.456+0000 7ff6ae200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6a80691b0 0x7ff6a8153e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:33.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.456+0000 7ff6ae200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6a80bc520 0x7ff6a80bc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:33.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.456+0000 7ff6ae200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a80c1c70 con 0x7ff6a8153a70 2024-01-22T05:05:33.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.456+0000 7ff6ae200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a80c1f50 con 0x7ff6a80bc520 2024-01-22T05:05:33.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.456+0000 7ff6ae200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80c2230 con 0x7ff6a80691b0 2024-01-22T05:05:33.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.456+0000 7ff6ad800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6a80bc520 0x7ff6a80bc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:33.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.456+0000 7ff6ad800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6a80bc520 0x7ff6a80bc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35760/0 (socket says 172.21.15.49:35760) 2024-01-22T05:05:33.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.456+0000 7ff6ad800700 1 -- 172.21.15.49:0/2410425889 learned_addr learned my addr 172.21.15.49:0/2410425889 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:33.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6a7e00700 1 --2- 172.21.15.49:0/2410425889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6a80691b0 0x7ff6a8153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:33.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6a7400700 1 -- 172.21.15.49:0/2410425889 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566319615 0 0) 0x7ff6a80c1c70 con 0x7ff6a8153a70 2024-01-22T05:05:33.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6ad800700 1 -- 172.21.15.49:0/2410425889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6a80691b0 msgr2=0x7ff6a8153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:33.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6ad800700 1 --2- 172.21.15.49:0/2410425889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6a80691b0 0x7ff6a8153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:33.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6ad800700 1 -- 172.21.15.49:0/2410425889 >> v1:172.21.15.110:6789/0 conn(0x7ff6a8153a70 legacy=0x7ff6a8068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:33.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6ad800700 1 -- 172.21.15.49:0/2410425889 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a80c2510 con 0x7ff6a80bc520 2024-01-22T05:05:33.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6ad800700 1 --2- 172.21.15.49:0/2410425889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a80bc520 0x7ff6a80bc9d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7ff6a0009f20 tx=0x7ff6a0009840).ready entity=mon.0 client_cookie=da4199c328a8ed61 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:33.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6a7400700 1 -- 172.21.15.49:0/2410425889 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a000e070 con 0x7ff6a80bc520 2024-01-22T05:05:33.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6a7400700 1 -- 172.21.15.49:0/2410425889 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a000ba80 con 0x7ff6a80bc520 2024-01-22T05:05:33.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6a7400700 1 -- 172.21.15.49:0/2410425889 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a000be00 con 0x7ff6a80bc520 2024-01-22T05:05:33.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6ae200700 1 -- 172.21.15.49:0/2410425889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a80bc520 msgr2=0x7ff6a80bc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:33.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6ae200700 1 --2- 172.21.15.49:0/2410425889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a80bc520 0x7ff6a80bc9d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7ff6a0009f20 tx=0x7ff6a0009840).stop 2024-01-22T05:05:33.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6ae200700 1 -- 172.21.15.49:0/2410425889 shutdown_connections 2024-01-22T05:05:33.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6ae200700 1 --2- 172.21.15.49:0/2410425889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a80bc520 0x7ff6a80bc9d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:33.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6ae200700 1 --2- 172.21.15.49:0/2410425889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6a80691b0 0x7ff6a8153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.460+0000 7ff6ae200700 1 -- 172.21.15.49:0/2410425889 >> 172.21.15.49:0/2410425889 conn(0x7ff6a80c4310 msgr2=0x7ff6a8065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.464+0000 7ff6ae200700 1 -- 172.21.15.49:0/2410425889 shutdown_connections 2024-01-22T05:05:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.464+0000 7ff6ae200700 1 -- 172.21.15.49:0/2410425889 wait complete. 2024-01-22T05:05:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.468+0000 7ff6ae200700 1 Processor -- start 2024-01-22T05:05:33.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.468+0000 7ff6ae200700 1 -- start start 2024-01-22T05:05:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.468+0000 7ff6ae200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a80691b0 0x7ff6a8157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.468+0000 7ff6ae200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80bc520 0x7ff6a80aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.468+0000 7ff6ae200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6a8153a70 0x7ff6a80ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.468+0000 7ff6ae200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80be390 con 0x7ff6a80691b0 2024-01-22T05:05:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.468+0000 7ff6ae200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80be670 con 0x7ff6a80bc520 2024-01-22T05:05:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.468+0000 7ff6ae200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80be950 con 0x7ff6a8153a70 2024-01-22T05:05:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff6ace00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a80691b0 0x7ff6a8157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff6ace00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a80691b0 0x7ff6a8157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35768/0 (socket says 172.21.15.49:35768) 2024-01-22T05:05:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff6ace00700 1 -- 172.21.15.49:0/2043250099 learned_addr learned my addr 172.21.15.49:0/2043250099 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff6a7e00700 1 --2- 172.21.15.49:0/2043250099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80bc520 0x7ff6a80aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff6ad800700 1 --2- 172.21.15.49:0/2043250099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6a8153a70 0x7ff6a80ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:33.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff6ace00700 1 -- 172.21.15.49:0/2043250099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6a8153a70 msgr2=0x7ff6a80ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:33.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff6ace00700 1 --2- 172.21.15.49:0/2043250099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6a8153a70 0x7ff6a80ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:33.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff6ace00700 1 -- 172.21.15.49:0/2043250099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80bc520 msgr2=0x7ff6a80aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:33.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff6ace00700 1 --2- 172.21.15.49:0/2043250099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80bc520 0x7ff6a80aa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:33.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff6ace00700 1 -- 172.21.15.49:0/2043250099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a0009ae0 con 0x7ff6a80691b0 2024-01-22T05:05:33.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff6ace00700 1 --2- 172.21.15.49:0/2043250099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a80691b0 0x7ff6a8157c60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7ff69800c490 tx=0x7ff698007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:33.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff69fe00700 1 -- 172.21.15.49:0/2043250099 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6980123f0 con 0x7ff6a80691b0 2024-01-22T05:05:33.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff69fe00700 1 -- 172.21.15.49:0/2043250099 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff698012570 con 0x7ff6a80691b0 2024-01-22T05:05:33.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff69fe00700 1 -- 172.21.15.49:0/2043250099 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698012930 con 0x7ff6a80691b0 2024-01-22T05:05:33.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff6ae200700 1 -- 172.21.15.49:0/2043250099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a80bec30 con 0x7ff6a80691b0 2024-01-22T05:05:33.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.472+0000 7ff6ae200700 1 -- 172.21.15.49:0/2043250099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a8158150 con 0x7ff6a80691b0 2024-01-22T05:05:33.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.476+0000 7ff6ae200700 1 -- 172.21.15.49:0/2043250099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a80bf0b0 con 0x7ff6a80691b0 2024-01-22T05:05:33.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.476+0000 7ff69fe00700 1 -- 172.21.15.49:0/2043250099 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff6980113a0 con 0x7ff6a80691b0 2024-01-22T05:05:33.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.476+0000 7ff69fe00700 1 --2- 172.21.15.49:0/2043250099 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff68005a510 0x7ff68005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:33.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.476+0000 7ff69fe00700 1 -- 172.21.15.49:0/2043250099 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6139+0+0 (secure 0 0 0) 0x7ff698073f20 con 0x7ff6a80691b0 2024-01-22T05:05:33.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.476+0000 7ff6a7e00700 1 --2- 172.21.15.49:0/2043250099 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff68005a510 0x7ff68005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:33.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.480+0000 7ff6a7e00700 1 --2- 172.21.15.49:0/2043250099 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff68005a510 0x7ff68005c9d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7ff6a8067370 tx=0x7ff690008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:33.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.484+0000 7ff69fe00700 1 -- 172.21.15.49:0/2043250099 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff698047690 con 0x7ff6a80691b0 2024-01-22T05:05:33.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:33.660+0000 7ff6ae200700 1 -- 172.21.15.49:0/2043250099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff6a80c27f0 con 0x7ff6a80691b0 2024-01-22T05:05:34.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.260+0000 7ff69fe00700 1 -- 172.21.15.49:0/2043250099 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7ff69804acb0 con 0x7ff6a80691b0 2024-01-22T05:05:34.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.264+0000 7ff6ae200700 1 -- 172.21.15.49:0/2043250099 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff68005a510 msgr2=0x7ff68005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:34.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.264+0000 7ff6ae200700 1 --2- 172.21.15.49:0/2043250099 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff68005a510 0x7ff68005c9d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7ff6a8067370 tx=0x7ff690008040).stop 2024-01-22T05:05:34.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.264+0000 7ff6ae200700 1 -- 172.21.15.49:0/2043250099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a80691b0 msgr2=0x7ff6a8157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:34.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.264+0000 7ff6ae200700 1 --2- 172.21.15.49:0/2043250099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a80691b0 0x7ff6a8157c60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7ff69800c490 tx=0x7ff698007de0).stop 2024-01-22T05:05:34.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.264+0000 7ff6ae200700 1 -- 172.21.15.49:0/2043250099 shutdown_connections 2024-01-22T05:05:34.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.264+0000 7ff6ae200700 1 --2- 172.21.15.49:0/2043250099 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff68005a510 0x7ff68005c9d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:34.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.264+0000 7ff6ae200700 1 --2- 172.21.15.49:0/2043250099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6a8153a70 0x7ff6a80ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:34.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.264+0000 7ff6ae200700 1 --2- 172.21.15.49:0/2043250099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80bc520 0x7ff6a80aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:34.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.264+0000 7ff6ae200700 1 --2- 172.21.15.49:0/2043250099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a80691b0 0x7ff6a8157c60 secure :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0x7ff69800c490 tx=0x7ff698007de0).stop 2024-01-22T05:05:34.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.264+0000 7ff6ae200700 1 -- 172.21.15.49:0/2043250099 >> 172.21.15.49:0/2043250099 conn(0x7ff6a80c4310 msgr2=0x7ff6a8148630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:34.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.264+0000 7ff6ae200700 1 -- 172.21.15.49:0/2043250099 shutdown_connections 2024-01-22T05:05:34.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.264+0000 7ff6ae200700 1 -- 172.21.15.49:0/2043250099 wait complete. 2024-01-22T05:05:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data_ec' removed 2024-01-22T05:05:34.289 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:05:34.289 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-22T05:05:34.289 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:05:34.289 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:05:34.289 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:05:34.290 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-22T05:05:34.290 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:05:34.290 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:05:34.290 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:05:34.290 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-22T05:05:34.290 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:05:34.290 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:05:34.291 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:05:34.291 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-22T05:05:34.291 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:05:34.291 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:05:34.308 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:05:34.309 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:05:34.310 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:05:34.310 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:05:34.311 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:05:34.311 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:05:34.313 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:05:34.313 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:05:34.358 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:05:34.359 DEBUG:teuthology.parallel:result is None 2024-01-22T05:05:34.360 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:05:34.361 DEBUG:teuthology.parallel:result is None 2024-01-22T05:05:34.364 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:05:34.364 DEBUG:teuthology.parallel:result is None 2024-01-22T05:05:34.366 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:05:34.366 DEBUG:teuthology.parallel:result is None 2024-01-22T05:05:34.366 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-22T05:05:34.479 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:05:34.481 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:05:34.481 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-22T05:05:34.483 INFO:tasks.ceph.mds.b.smithi110.stderr:2024-01-22T05:05:34.475+0000 7f4483600700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6833/0: (98) Address already in use 2024-01-22T05:05:34.483 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:05:34.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.536+0000 7f0217e00700 1 Processor -- start 2024-01-22T05:05:34.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.536+0000 7f0217e00700 1 -- start start 2024-01-22T05:05:34.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.540+0000 7f0217e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0210151d70 0x7f02100be360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:34.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.540+0000 7f0217e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02100be850 0x7f02100a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:34.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.540+0000 7f0217e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02100bf4f0 con 0x7f0210151990 2024-01-22T05:05:34.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.540+0000 7f0217e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02100ab8b0 con 0x7f0210151d70 2024-01-22T05:05:34.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.540+0000 7f0217e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0210067e00 con 0x7f02100be850 2024-01-22T05:05:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.540+0000 7f0216800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02100be850 0x7f02100a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.540+0000 7f0214a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0210151d70 0x7f02100be360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.540+0000 7f0215400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0210151990 0x7f02100684a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:46308/0 (socket says 172.21.15.49:46308) 2024-01-22T05:05:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.540+0000 7f0215400700 1 -- 172.21.15.49:0/3135299348 learned_addr learned my addr 172.21.15.49:0/3135299348 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f0214a00700 1 -- 172.21.15.49:0/3135299348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02100be850 msgr2=0x7f02100a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f0214a00700 1 --2- 172.21.15.49:0/3135299348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02100be850 0x7f02100a8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f0214a00700 1 -- 172.21.15.49:0/3135299348 >> v1:172.21.15.110:6789/0 conn(0x7f0210151990 legacy=0x7f02100684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f0214a00700 1 -- 172.21.15.49:0/3135299348 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100680e0 con 0x7f0210151d70 2024-01-22T05:05:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f0216800700 1 --2- 172.21.15.49:0/3135299348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02100be850 0x7f02100a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:34.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f0214a00700 1 --2- 172.21.15.49:0/3135299348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0210151d70 0x7f02100be360 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f01f8009760 tx=0x7f01f8009060).ready entity=mon.1 client_cookie=cf1e48055d9f0708 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:34.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f020fe00700 1 -- 172.21.15.49:0/3135299348 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800d4a0 con 0x7f0210151d70 2024-01-22T05:05:34.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f020fe00700 1 -- 172.21.15.49:0/3135299348 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f800d600 con 0x7f0210151d70 2024-01-22T05:05:34.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f020fe00700 1 -- 172.21.15.49:0/3135299348 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800d980 con 0x7f0210151d70 2024-01-22T05:05:34.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f0217e00700 1 -- 172.21.15.49:0/3135299348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0210151d70 msgr2=0x7f02100be360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:34.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f0217e00700 1 --2- 172.21.15.49:0/3135299348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0210151d70 0x7f02100be360 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f01f8009760 tx=0x7f01f8009060).stop 2024-01-22T05:05:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f0217e00700 1 -- 172.21.15.49:0/3135299348 shutdown_connections 2024-01-22T05:05:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f0217e00700 1 --2- 172.21.15.49:0/3135299348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02100be850 0x7f02100a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f0217e00700 1 --2- 172.21.15.49:0/3135299348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0210151d70 0x7f02100be360 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f0217e00700 1 -- 172.21.15.49:0/3135299348 >> 172.21.15.49:0/3135299348 conn(0x7f02100c5860 msgr2=0x7f02100c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f0217e00700 1 -- 172.21.15.49:0/3135299348 shutdown_connections 2024-01-22T05:05:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.544+0000 7f0217e00700 1 -- 172.21.15.49:0/3135299348 wait complete. 2024-01-22T05:05:34.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.548+0000 7f0217e00700 1 Processor -- start 2024-01-22T05:05:34.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.548+0000 7f0217e00700 1 -- start start 2024-01-22T05:05:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0217e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02100be850 0x7f0210163930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0217e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0210151990 0x7f02100c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0217e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0210151d70 0x7f02100c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0217e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100ace50 con 0x7f0210151d70 2024-01-22T05:05:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0217e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100c01d0 con 0x7f0210151990 2024-01-22T05:05:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0217e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02100c04b0 con 0x7f02100be850 2024-01-22T05:05:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0216800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0210151d70 0x7f02100c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0216800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0210151d70 0x7f02100c44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35796/0 (socket says 172.21.15.49:35796) 2024-01-22T05:05:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0216800700 1 -- 172.21.15.49:0/3627825246 learned_addr learned my addr 172.21.15.49:0/3627825246 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0214a00700 1 --2- 172.21.15.49:0/3627825246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0210151990 0x7f02100c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0215400700 1 --2- 172.21.15.49:0/3627825246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02100be850 0x7f0210163930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0216800700 1 -- 172.21.15.49:0/3627825246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02100be850 msgr2=0x7f0210163930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:34.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0216800700 1 --2- 172.21.15.49:0/3627825246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02100be850 0x7f0210163930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:34.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0216800700 1 -- 172.21.15.49:0/3627825246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0210151990 msgr2=0x7f02100c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:34.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0216800700 1 --2- 172.21.15.49:0/3627825246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0210151990 0x7f02100c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:34.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0216800700 1 -- 172.21.15.49:0/3627825246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208009a20 con 0x7f0210151d70 2024-01-22T05:05:34.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0216800700 1 --2- 172.21.15.49:0/3627825246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0210151d70 0x7f02100c44a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f0208009f20 tx=0x7f020800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:34.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f020cc00700 1 -- 172.21.15.49:0/3627825246 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020800cc80 con 0x7f0210151d70 2024-01-22T05:05:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f020cc00700 1 -- 172.21.15.49:0/3627825246 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020800f040 con 0x7f0210151d70 2024-01-22T05:05:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f0217e00700 1 -- 172.21.15.49:0/3627825246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f80092a0 con 0x7f0210151d70 2024-01-22T05:05:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.552+0000 7f020cc00700 1 -- 172.21.15.49:0/3627825246 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208013400 con 0x7f0210151d70 2024-01-22T05:05:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.556+0000 7f0217e00700 1 -- 172.21.15.49:0/3627825246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02100bfe60 con 0x7f0210151d70 2024-01-22T05:05:34.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.556+0000 7f0217e00700 1 -- 172.21.15.49:0/3627825246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02100acfc0 con 0x7f0210151d70 2024-01-22T05:05:34.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.556+0000 7f020cc00700 1 -- 172.21.15.49:0/3627825246 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f02080137f0 con 0x7f0210151d70 2024-01-22T05:05:34.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.560+0000 7f020cc00700 1 --2- 172.21.15.49:0/3627825246 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f01e805a510 0x7f01e805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:34.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.560+0000 7f020cc00700 1 -- 172.21.15.49:0/3627825246 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f02080750b0 con 0x7f0210151d70 2024-01-22T05:05:34.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.560+0000 7f0215400700 1 --2- 172.21.15.49:0/3627825246 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f01e805a510 0x7f01e805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:34.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.560+0000 7f0215400700 1 --2- 172.21.15.49:0/3627825246 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f01e805a510 0x7f01e805c9d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f0200005750 tx=0x7f0200009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:34.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.564+0000 7f020cc00700 1 -- 172.21.15.49:0/3627825246 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f02100acfc0 con 0x7f0210151d70 2024-01-22T05:05:34.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:34.736+0000 7f0217e00700 1 -- 172.21.15.49:0/3627825246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f02100acf90 con 0x7f0210151d70 2024-01-22T05:05:35.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.520+0000 7f020cc00700 1 -- 172.21.15.49:0/3627825246 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0208048970 con 0x7f0210151d70 2024-01-22T05:05:35.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.524+0000 7f0217e00700 1 -- 172.21.15.49:0/3627825246 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f01e805a510 msgr2=0x7f01e805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:35.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.524+0000 7f0217e00700 1 --2- 172.21.15.49:0/3627825246 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f01e805a510 0x7f01e805c9d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f0200005750 tx=0x7f0200009040).stop 2024-01-22T05:05:35.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.524+0000 7f0217e00700 1 -- 172.21.15.49:0/3627825246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0210151d70 msgr2=0x7f02100c44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:35.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.524+0000 7f0217e00700 1 --2- 172.21.15.49:0/3627825246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0210151d70 0x7f02100c44a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f0208009f20 tx=0x7f020800b040).stop 2024-01-22T05:05:35.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.524+0000 7f0217e00700 1 -- 172.21.15.49:0/3627825246 shutdown_connections 2024-01-22T05:05:35.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.524+0000 7f0217e00700 1 --2- 172.21.15.49:0/3627825246 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f01e805a510 0x7f01e805c9d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:35.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.524+0000 7f0217e00700 1 --2- 172.21.15.49:0/3627825246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0210151d70 0x7f02100c44a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:35.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.524+0000 7f0217e00700 1 --2- 172.21.15.49:0/3627825246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0210151990 0x7f02100c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:35.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.524+0000 7f0217e00700 1 --2- 172.21.15.49:0/3627825246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02100be850 0x7f0210163930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:35.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.524+0000 7f0217e00700 1 -- 172.21.15.49:0/3627825246 >> 172.21.15.49:0/3627825246 conn(0x7f02100c5860 msgr2=0x7f02100a9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:35.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.524+0000 7f0217e00700 1 -- 172.21.15.49:0/3627825246 shutdown_connections 2024-01-22T05:05:35.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.524+0000 7f0217e00700 1 -- 172.21.15.49:0/3627825246 wait complete. 2024-01-22T05:05:35.531 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-01-22T05:05:35.552 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-22T05:05:35.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.720+0000 7f4587e00700 1 Processor -- start 2024-01-22T05:05:35.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.720+0000 7f4587e00700 1 -- start start 2024-01-22T05:05:35.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.724+0000 7f4587e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4580155d20 0x7f4580065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:35.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.724+0000 7f4587e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4580066070 0x7f45800a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:35.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.724+0000 7f4587e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45800c1a40 con 0x7f45800a8c30 2024-01-22T05:05:35.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.724+0000 7f4587e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45800a9090 con 0x7f4580155d20 2024-01-22T05:05:35.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.724+0000 7f4587e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4580159310 con 0x7f4580066070 2024-01-22T05:05:35.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.724+0000 7f4585400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4580155d20 0x7f4580065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:35.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.724+0000 7f4585400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4580155d20 0x7f4580065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:49792/0 (socket says 172.21.15.49:49792) 2024-01-22T05:05:35.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.724+0000 7f4584a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4580066070 0x7f45800a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:35.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.724+0000 7f4585400700 1 -- 172.21.15.49:0/3705837840 learned_addr learned my addr 172.21.15.49:0/3705837840 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:35.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.724+0000 7f4585e00700 1 --1- 172.21.15.49:0/3705837840 >> v1:172.21.15.110:6789/0 conn(0x7f45800a8c30 0x7f45800c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:46322/0 (socket says 172.21.15.49:46322) 2024-01-22T05:05:35.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.724+0000 7f4585400700 1 -- 172.21.15.49:0/3705837840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4580066070 msgr2=0x7f45800a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:35.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.724+0000 7f4585400700 1 --2- 172.21.15.49:0/3705837840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4580066070 0x7f45800a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:35.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.724+0000 7f4585400700 1 -- 172.21.15.49:0/3705837840 >> v1:172.21.15.110:6789/0 conn(0x7f45800a8c30 legacy=0x7f45800c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:35.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.724+0000 7f4585400700 1 -- 172.21.15.49:0/3705837840 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800c13f0 con 0x7f4580155d20 2024-01-22T05:05:35.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.724+0000 7f4584a00700 1 --2- 172.21.15.49:0/3705837840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4580066070 0x7f45800a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:35.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.728+0000 7f4585400700 1 --2- 172.21.15.49:0/3705837840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4580155d20 0x7f4580065b80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f4570006fd0 tx=0x7f45700090f0).ready entity=mon.1 client_cookie=b1bb0ff699408440 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:35.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.728+0000 7f457fe00700 1 -- 172.21.15.49:0/3705837840 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000b580 con 0x7f4580155d20 2024-01-22T05:05:35.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.728+0000 7f457fe00700 1 -- 172.21.15.49:0/3705837840 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457000b6e0 con 0x7f4580155d20 2024-01-22T05:05:35.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.728+0000 7f457fe00700 1 -- 172.21.15.49:0/3705837840 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000ba60 con 0x7f4580155d20 2024-01-22T05:05:35.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.728+0000 7f4587e00700 1 -- 172.21.15.49:0/3705837840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4580155d20 msgr2=0x7f4580065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:35.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.728+0000 7f4587e00700 1 --2- 172.21.15.49:0/3705837840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4580155d20 0x7f4580065b80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f4570006fd0 tx=0x7f45700090f0).stop 2024-01-22T05:05:35.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.728+0000 7f4587e00700 1 -- 172.21.15.49:0/3705837840 shutdown_connections 2024-01-22T05:05:35.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.728+0000 7f4587e00700 1 --2- 172.21.15.49:0/3705837840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4580066070 0x7f45800a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:35.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.728+0000 7f4587e00700 1 --2- 172.21.15.49:0/3705837840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4580155d20 0x7f4580065b80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:35.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.728+0000 7f4587e00700 1 -- 172.21.15.49:0/3705837840 >> 172.21.15.49:0/3705837840 conn(0x7f45800c6540 msgr2=0x7f45800c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:35.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.728+0000 7f4587e00700 1 -- 172.21.15.49:0/3705837840 shutdown_connections 2024-01-22T05:05:35.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.728+0000 7f4587e00700 1 -- 172.21.15.49:0/3705837840 wait complete. 2024-01-22T05:05:35.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.732+0000 7f4587e00700 1 Processor -- start 2024-01-22T05:05:35.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.732+0000 7f4587e00700 1 -- start start 2024-01-22T05:05:35.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4587e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4580066070 0x7f45800be180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:35.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4587e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45800a8c30 0x7f45800c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:35.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4587e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4580155d20 0x7f4580159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:35.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4587e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800bf3f0 con 0x7f4580066070 2024-01-22T05:05:35.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4587e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800bf6d0 con 0x7f45800a8c30 2024-01-22T05:05:35.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4587e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45800bf9b0 con 0x7f4580155d20 2024-01-22T05:05:35.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4585400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4580066070 0x7f45800be180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:35.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4585400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4580066070 0x7f45800be180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35798/0 (socket says 172.21.15.49:35798) 2024-01-22T05:05:35.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4585400700 1 -- 172.21.15.49:0/1683814990 learned_addr learned my addr 172.21.15.49:0/1683814990 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:35.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4584a00700 1 --2- 172.21.15.49:0/1683814990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45800a8c30 0x7f45800c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:35.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4585e00700 1 --2- 172.21.15.49:0/1683814990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4580155d20 0x7f4580159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:35.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4585400700 1 -- 172.21.15.49:0/1683814990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4580155d20 msgr2=0x7f4580159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:35.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4585400700 1 --2- 172.21.15.49:0/1683814990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4580155d20 0x7f4580159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:35.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4585400700 1 -- 172.21.15.49:0/1683814990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45800a8c30 msgr2=0x7f45800c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:35.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4585400700 1 --2- 172.21.15.49:0/1683814990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45800a8c30 0x7f45800c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:35.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4585400700 1 -- 172.21.15.49:0/1683814990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45680092a0 con 0x7f4580066070 2024-01-22T05:05:35.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.736+0000 7f4585e00700 1 --2- 172.21.15.49:0/1683814990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4580155d20 0x7f4580159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:35.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.740+0000 7f4585400700 1 --2- 172.21.15.49:0/1683814990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4580066070 0x7f45800be180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f4570009130 tx=0x7f4570017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:35.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.740+0000 7f457cc00700 1 -- 172.21.15.49:0/1683814990 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000b850 con 0x7f4580066070 2024-01-22T05:05:35.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.740+0000 7f457cc00700 1 -- 172.21.15.49:0/1683814990 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457000b9b0 con 0x7f4580066070 2024-01-22T05:05:35.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.740+0000 7f457cc00700 1 -- 172.21.15.49:0/1683814990 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457001b660 con 0x7f4580066070 2024-01-22T05:05:35.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.740+0000 7f4587e00700 1 -- 172.21.15.49:0/1683814990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4570009370 con 0x7f4580066070 2024-01-22T05:05:35.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.740+0000 7f4587e00700 1 -- 172.21.15.49:0/1683814990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45800bf010 con 0x7f4580066070 2024-01-22T05:05:35.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.740+0000 7f4587e00700 1 -- 172.21.15.49:0/1683814990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4580047060 con 0x7f4580066070 2024-01-22T05:05:35.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.744+0000 7f457cc00700 1 -- 172.21.15.49:0/1683814990 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f457001b9d0 con 0x7f4580066070 2024-01-22T05:05:35.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.744+0000 7f457cc00700 1 --2- 172.21.15.49:0/1683814990 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f455805a540 0x7f455805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:35.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.744+0000 7f457cc00700 1 -- 172.21.15.49:0/1683814990 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f4570075fa0 con 0x7f4580066070 2024-01-22T05:05:35.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.744+0000 7f4584a00700 1 --2- 172.21.15.49:0/1683814990 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f455805a540 0x7f455805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:35.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.744+0000 7f4584a00700 1 --2- 172.21.15.49:0/1683814990 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f455805a540 0x7f455805ca00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f45800aa590 tx=0x7f4568009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.752+0000 7f457cc00700 1 -- 172.21.15.49:0/1683814990 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f45700498b0 con 0x7f4580066070 2024-01-22T05:05:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.972+0000 7f4587e00700 1 -- 172.21.15.49:0/1683814990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f45800c16d0 con 0x7f4580066070 2024-01-22T05:05:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.972+0000 7f457cc00700 1 -- 172.21.15.49:0/1683814990 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f457001bd00 con 0x7f4580066070 2024-01-22T05:05:35.977 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:35.977 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:05:35.977 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-01-22T05:05:35.977 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.977 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-01-22T05:05:35.977 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lTCfoJxAAxDGvXKXgooA9/f0J70s6AA==", 2024-01-22T05:05:35.977 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.977 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:05:35.977 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:05:35.977 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:05:35.977 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:05:35.977 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.977 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.977 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lHqV6ORAA1DwpPV2PyDBF/6/ePTdQJw==", 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lPo86MhAAonfC3M+AkLldljODYNGzyA==", 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:05:35.978 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lLwvMBxAAFm52HWeGbTH1gbWVm6r5zQ==", 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAt961lH2F9NBAAHm8R9/Q5IuFUvb0o1GyD4Q==", 2024-01-22T05:05:35.979 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.980 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:05:35.980 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:05:35.980 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:05:35.980 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.980 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.980 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.980 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-01-22T05:05:35.980 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAx961lS1lEIhAAuDm2OYfTYff1kVEq5vXvFw==", 2024-01-22T05:05:35.980 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.980 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:05:35.980 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:05:35.980 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:05:35.980 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.980 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA1961limLvERAAv23crKrwjLIg84u48BHHbg==", 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA5961lShJiABAAnvyhz0ggDaITaMgwzi9kAA==", 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:05:35.981 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:05:35.982 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.982 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.982 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.982 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2024-01-22T05:05:35.982 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA9961lcopfNRAAAZgHzI1t7YHI5cAjaCMiNw==", 2024-01-22T05:05:35.982 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.982 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:05:35.982 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:05:35.982 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:05:35.982 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.982 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.982 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.982 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2024-01-22T05:05:35.982 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBB961lX+nTIxAAtP3YQypuFWM5O/LADjvybA==", 2024-01-22T05:05:35.982 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBF961lQ4/XERAARZPqENsV3jokk2g3OXUI5w==", 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.983 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2024-01-22T05:05:35.984 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBI961luxnqOhAAGsV74DKQda5cetNA/woOnA==", 2024-01-22T05:05:35.984 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.984 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:05:35.984 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:05:35.984 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:05:35.984 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.984 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.984 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.984 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-01-22T05:05:35.984 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lmrM6DhAAYU09HviWyrUIz4lio15wFw==", 2024-01-22T05:05:35.984 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.984 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:05:35.984 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:05:35.984 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:05:35.984 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lIhYRGRAAFG+YtkDLFsra6zU44xKCHw==", 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lRuyaExAAQO3a7ahOEcuE+WVfXYEBTg==", 2024-01-22T05:05:35.985 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lMiMkHhAAxPdKpcHdtqSphbc/2agq9Q==", 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.986 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961ljsweARAAJrY3z/sBjayjB2BRQNrJew==", 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-mds", 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBQ961lgv3VDxAAoQL30vt4o0ncDwhTqY/Fkw==", 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-mds" 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-mgr", 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBQ961lrg3WDxAAY1CU4wL3gWcSHx7+qkst6g==", 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-mgr" 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-osd", 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBQ961lEh3WDxAAdxHAM4Pocu1Fl8egBx6TYw==", 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-osd" 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rbd", 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBQ961lrSnWDxAA98AjA2ls7ox27mqc+9xqUQ==", 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rbd" 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBQ961lmDbWDxAAUgO/eflY0kRrvyY49M7ibQ==", 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rgw", 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBQ961lVEPWDxAAkPELciYC04WGo5elBfKGMQ==", 2024-01-22T05:05:35.989 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rgw" 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961l0DwDIhAAeuCu79LxNMEJvWiW/BfDhA==", 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lZlmPGxAA1KVZR+XzNdoFVo/980hD8w==", 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:05:35.990 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:05:35.991 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:05:35.991 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:05:35.991 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.991 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:35.991 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-01-22T05:05:35.991 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:05:35.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.976+0000 7f4587e00700 1 -- 172.21.15.49:0/1683814990 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f455805a540 msgr2=0x7f455805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:35.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.976+0000 7f4587e00700 1 --2- 172.21.15.49:0/1683814990 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f455805a540 0x7f455805ca00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f45800aa590 tx=0x7f4568009060).stop 2024-01-22T05:05:35.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.976+0000 7f4587e00700 1 -- 172.21.15.49:0/1683814990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4580066070 msgr2=0x7f45800be180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:35.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.976+0000 7f4587e00700 1 --2- 172.21.15.49:0/1683814990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4580066070 0x7f45800be180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f4570009130 tx=0x7f4570017000).stop 2024-01-22T05:05:35.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.976+0000 7f4587e00700 1 -- 172.21.15.49:0/1683814990 shutdown_connections 2024-01-22T05:05:35.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.976+0000 7f4587e00700 1 --2- 172.21.15.49:0/1683814990 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f455805a540 0x7f455805ca00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:35.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.976+0000 7f4587e00700 1 --2- 172.21.15.49:0/1683814990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4580155d20 0x7f4580159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:35.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.976+0000 7f4587e00700 1 --2- 172.21.15.49:0/1683814990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45800a8c30 0x7f45800c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:35.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.976+0000 7f4587e00700 1 --2- 172.21.15.49:0/1683814990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4580066070 0x7f45800be180 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:35.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.976+0000 7f4587e00700 1 -- 172.21.15.49:0/1683814990 >> 172.21.15.49:0/1683814990 conn(0x7f45800c6540 msgr2=0x7f4580066540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:35.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.976+0000 7f4587e00700 1 -- 172.21.15.49:0/1683814990 shutdown_connections 2024-01-22T05:05:35.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:35.976+0000 7f4587e00700 1 -- 172.21.15.49:0/1683814990 wait complete. 2024-01-22T05:05:36.005 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-01-22T05:05:36.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.172+0000 7f0342400700 1 Processor -- start 2024-01-22T05:05:36.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.176+0000 7f0342400700 1 -- start start 2024-01-22T05:05:36.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.176+0000 7f0342400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f033c0be6a0 0x7f033c0c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:36.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.176+0000 7f0342400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c0be210 con 0x7f033c064690 2024-01-22T05:05:36.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.176+0000 7f0342400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c0bd650 con 0x7f033c151a80 2024-01-22T05:05:36.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.176+0000 7f0342400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c0bd8e0 con 0x7f033c0be6a0 2024-01-22T05:05:36.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.176+0000 7f033b400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f033c0be6a0 0x7f033c0c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:36.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.176+0000 7f033aa00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f033c064690 0x7f033c151370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59264/0 (socket says 172.21.15.49:59264) 2024-01-22T05:05:36.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.176+0000 7f033aa00700 1 -- 172.21.15.49:0/3979845987 learned_addr learned my addr 172.21.15.49:0/3979845987 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:36.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.176+0000 7f033b400700 1 -- 172.21.15.49:0/3979845987 >> v1:172.21.15.110:6789/0 conn(0x7f033c151a80 legacy=0x7f033c0a7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:36.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.176+0000 7f033b400700 1 -- 172.21.15.49:0/3979845987 >> v1:172.21.15.49:6789/0 conn(0x7f033c064690 legacy=0x7f033c151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:36.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.176+0000 7f033b400700 1 -- 172.21.15.49:0/3979845987 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c0bdbc0 con 0x7f033c0be6a0 2024-01-22T05:05:36.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.176+0000 7f033b400700 1 --2- 172.21.15.49:0/3979845987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0be6a0 0x7f033c0c2cf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f032c009760 tx=0x7f032c009060).ready entity=mon.0 client_cookie=11df26cbdb5beef4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:36.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.180+0000 7f033a000700 1 -- 172.21.15.49:0/3979845987 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c00b520 con 0x7f033c0be6a0 2024-01-22T05:05:36.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.180+0000 7f033a000700 1 -- 172.21.15.49:0/3979845987 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c00b680 con 0x7f033c0be6a0 2024-01-22T05:05:36.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.180+0000 7f033a000700 1 -- 172.21.15.49:0/3979845987 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c00ba00 con 0x7f033c0be6a0 2024-01-22T05:05:36.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.180+0000 7f0342400700 1 -- 172.21.15.49:0/3979845987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0be6a0 msgr2=0x7f033c0c2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:36.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.180+0000 7f0342400700 1 --2- 172.21.15.49:0/3979845987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0be6a0 0x7f033c0c2cf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f032c009760 tx=0x7f032c009060).stop 2024-01-22T05:05:36.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.180+0000 7f0342400700 1 -- 172.21.15.49:0/3979845987 shutdown_connections 2024-01-22T05:05:36.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.180+0000 7f0342400700 1 --2- 172.21.15.49:0/3979845987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0be6a0 0x7f033c0c2cf0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.180+0000 7f0342400700 1 -- 172.21.15.49:0/3979845987 >> 172.21.15.49:0/3979845987 conn(0x7f033c0c87f0 msgr2=0x7f033c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:36.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.180+0000 7f0342400700 1 -- 172.21.15.49:0/3979845987 shutdown_connections 2024-01-22T05:05:36.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.180+0000 7f0342400700 1 -- 172.21.15.49:0/3979845987 wait complete. 2024-01-22T05:05:36.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.184+0000 7f0342400700 1 Processor -- start 2024-01-22T05:05:36.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.184+0000 7f0342400700 1 -- start start 2024-01-22T05:05:36.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.184+0000 7f0342400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c064690 0x7f033c153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:36.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.184+0000 7f0342400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f033c0be6a0 0x7f033c0aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:36.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.184+0000 7f0342400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f033c151a80 0x7f033c149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:36.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.184+0000 7f0342400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c153e30 con 0x7f033c064690 2024-01-22T05:05:36.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.184+0000 7f0342400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0ab2a0 con 0x7f033c151a80 2024-01-22T05:05:36.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.184+0000 7f0342400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c14e860 con 0x7f033c0be6a0 2024-01-22T05:05:36.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f033b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c064690 0x7f033c153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:36.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f033b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c064690 0x7f033c153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35812/0 (socket says 172.21.15.49:35812) 2024-01-22T05:05:36.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f033b400700 1 -- 172.21.15.49:0/486364585 learned_addr learned my addr 172.21.15.49:0/486364585 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:36.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f0340e00700 1 --2- 172.21.15.49:0/486364585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f033c151a80 0x7f033c149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:36.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f033aa00700 1 --2- 172.21.15.49:0/486364585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f033c0be6a0 0x7f033c0aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:36.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f033b400700 1 -- 172.21.15.49:0/486364585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f033c0be6a0 msgr2=0x7f033c0aadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:36.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f033b400700 1 --2- 172.21.15.49:0/486364585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f033c0be6a0 0x7f033c0aadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f033b400700 1 -- 172.21.15.49:0/486364585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f033c151a80 msgr2=0x7f033c149980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:36.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f033b400700 1 --2- 172.21.15.49:0/486364585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f033c151a80 0x7f033c149980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f033b400700 1 -- 172.21.15.49:0/486364585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c0092a0 con 0x7f033c064690 2024-01-22T05:05:36.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f0340e00700 1 --2- 172.21.15.49:0/486364585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f033c151a80 0x7f033c149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:36.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f033b400700 1 --2- 172.21.15.49:0/486364585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c064690 0x7f033c153940 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f032c009eb0 tx=0x7f032c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f0332a00700 1 -- 172.21.15.49:0/486364585 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c00ba00 con 0x7f033c064690 2024-01-22T05:05:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f0332a00700 1 -- 172.21.15.49:0/486364585 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c000c90 con 0x7f033c064690 2024-01-22T05:05:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f0342400700 1 -- 172.21.15.49:0/486364585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033c154020 con 0x7f033c064690 2024-01-22T05:05:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f0332a00700 1 -- 172.21.15.49:0/486364585 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c01b620 con 0x7f033c064690 2024-01-22T05:05:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f0342400700 1 -- 172.21.15.49:0/486364585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033c1545e0 con 0x7f033c064690 2024-01-22T05:05:36.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.188+0000 7f0342400700 1 -- 172.21.15.49:0/486364585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033c14e630 con 0x7f033c064690 2024-01-22T05:05:36.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.192+0000 7f0332a00700 1 -- 172.21.15.49:0/486364585 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f032c01b990 con 0x7f033c064690 2024-01-22T05:05:36.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.192+0000 7f0332a00700 1 --2- 172.21.15.49:0/486364585 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f031405a510 0x7f031405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:36.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.192+0000 7f0332a00700 1 -- 172.21.15.49:0/486364585 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f032c076180 con 0x7f033c064690 2024-01-22T05:05:36.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.192+0000 7f033aa00700 1 --2- 172.21.15.49:0/486364585 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f031405a510 0x7f031405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:36.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.196+0000 7f033aa00700 1 --2- 172.21.15.49:0/486364585 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f031405a510 0x7f031405c9d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f033c0a7590 tx=0x7f0324009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:36.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.200+0000 7f0332a00700 1 -- 172.21.15.49:0/486364585 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f033c14e630 con 0x7f033c064690 2024-01-22T05:05:36.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.420+0000 7f0342400700 1 -- 172.21.15.49:0/486364585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f033c14e630 con 0x7f033c064690 2024-01-22T05:05:36.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.428+0000 7f0332a00700 1 -- 172.21.15.49:0/486364585 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f033c14e630 con 0x7f033c064690 2024-01-22T05:05:36.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.432+0000 7f0342400700 1 -- 172.21.15.49:0/486364585 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f031405a510 msgr2=0x7f031405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:36.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.432+0000 7f0342400700 1 --2- 172.21.15.49:0/486364585 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f031405a510 0x7f031405c9d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f033c0a7590 tx=0x7f0324009040).stop 2024-01-22T05:05:36.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.432+0000 7f0342400700 1 -- 172.21.15.49:0/486364585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c064690 msgr2=0x7f033c153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:36.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.432+0000 7f0342400700 1 --2- 172.21.15.49:0/486364585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c064690 0x7f033c153940 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f032c009eb0 tx=0x7f032c017000).stop 2024-01-22T05:05:36.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.432+0000 7f0342400700 1 -- 172.21.15.49:0/486364585 shutdown_connections 2024-01-22T05:05:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.432+0000 7f0342400700 1 --2- 172.21.15.49:0/486364585 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f031405a510 0x7f031405c9d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.432+0000 7f0342400700 1 --2- 172.21.15.49:0/486364585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f033c151a80 0x7f033c149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.432+0000 7f0342400700 1 --2- 172.21.15.49:0/486364585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f033c0be6a0 0x7f033c0aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.432+0000 7f0342400700 1 --2- 172.21.15.49:0/486364585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c064690 0x7f033c153940 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.432+0000 7f0342400700 1 -- 172.21.15.49:0/486364585 >> 172.21.15.49:0/486364585 conn(0x7f033c0c87f0 msgr2=0x7f033c0a7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.432+0000 7f0342400700 1 -- 172.21.15.49:0/486364585 shutdown_connections 2024-01-22T05:05:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.432+0000 7f0342400700 1 -- 172.21.15.49:0/486364585 wait complete. 2024-01-22T05:05:36.439 INFO:teuthology.orchestra.run.smithi049.stderr:updated 2024-01-22T05:05:36.458 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-01-22T05:05:36.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.624+0000 7fa8d4a00700 1 Processor -- start 2024-01-22T05:05:36.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.624+0000 7fa8d4a00700 1 -- start start 2024-01-22T05:05:36.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d4a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa8cc0c4660 0x7fa8cc0c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:36.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d4a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8cc0631b0 0x7fa8cc0690b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:36.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d4a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc0c41d0 con 0x7fa8cc068c50 2024-01-22T05:05:36.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d4a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc0c35c0 con 0x7fa8cc0c4660 2024-01-22T05:05:36.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d4a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0c38a0 con 0x7fa8cc0631b0 2024-01-22T05:05:36.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d2000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa8cc0c4660 0x7fa8cc0c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:36.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d2000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa8cc0c4660 0x7fa8cc0c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35820/0 (socket says 172.21.15.49:35820) 2024-01-22T05:05:36.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d2000700 1 -- 172.21.15.49:0/3691053632 learned_addr learned my addr 172.21.15.49:0/3691053632 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:36.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d2a00700 1 --2- 172.21.15.49:0/3691053632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8cc0631b0 0x7fa8cc0690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:36.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d2000700 1 -- 172.21.15.49:0/3691053632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8cc0631b0 msgr2=0x7fa8cc0690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:36.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d2000700 1 --2- 172.21.15.49:0/3691053632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8cc0631b0 0x7fa8cc0690b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d2000700 1 -- 172.21.15.49:0/3691053632 >> v1:172.21.15.110:6789/0 conn(0x7fa8cc068c50 legacy=0x7fa8cc062aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:36.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d2000700 1 -- 172.21.15.49:0/3691053632 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0c3b80 con 0x7fa8cc0c4660 2024-01-22T05:05:36.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d2000700 1 --2- 172.21.15.49:0/3691053632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8cc0c4660 0x7fa8cc0c4a40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fa8bc006fd0 tx=0x7fa8bc0090f0).ready entity=mon.0 client_cookie=7fc019d13abf7658 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:36.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d0c00700 1 -- 172.21.15.49:0/3691053632 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00b580 con 0x7fa8cc0c4660 2024-01-22T05:05:36.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d0c00700 1 -- 172.21.15.49:0/3691053632 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc00b6e0 con 0x7fa8cc0c4660 2024-01-22T05:05:36.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.628+0000 7fa8d0c00700 1 -- 172.21.15.49:0/3691053632 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00ba60 con 0x7fa8cc0c4660 2024-01-22T05:05:36.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.632+0000 7fa8d4a00700 1 -- 172.21.15.49:0/3691053632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8cc0c4660 msgr2=0x7fa8cc0c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:36.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.632+0000 7fa8d4a00700 1 --2- 172.21.15.49:0/3691053632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8cc0c4660 0x7fa8cc0c4a40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fa8bc006fd0 tx=0x7fa8bc0090f0).stop 2024-01-22T05:05:36.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.632+0000 7fa8d4a00700 1 -- 172.21.15.49:0/3691053632 shutdown_connections 2024-01-22T05:05:36.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.632+0000 7fa8d4a00700 1 --2- 172.21.15.49:0/3691053632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8cc0631b0 0x7fa8cc0690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.632+0000 7fa8d4a00700 1 --2- 172.21.15.49:0/3691053632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8cc0c4660 0x7fa8cc0c4a40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.632+0000 7fa8d4a00700 1 -- 172.21.15.49:0/3691053632 >> 172.21.15.49:0/3691053632 conn(0x7fa8cc0c51c0 msgr2=0x7fa8cc0c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:36.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.632+0000 7fa8d4a00700 1 -- 172.21.15.49:0/3691053632 shutdown_connections 2024-01-22T05:05:36.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.632+0000 7fa8d4a00700 1 -- 172.21.15.49:0/3691053632 wait complete. 2024-01-22T05:05:36.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.636+0000 7fa8d4a00700 1 Processor -- start 2024-01-22T05:05:36.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.636+0000 7fa8d4a00700 1 -- start start 2024-01-22T05:05:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d4a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8cc0631b0 0x7fa8cc0ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d4a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8cc068c50 0x7fa8cc0aa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d4a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8cc0c4660 0x7fa8cc0acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d4a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0aaac0 con 0x7fa8cc0c4660 2024-01-22T05:05:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d4a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0ad090 con 0x7fa8cc068c50 2024-01-22T05:05:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d4a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0adeb0 con 0x7fa8cc0631b0 2024-01-22T05:05:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8cc0c4660 0x7fa8cc0acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8cc0c4660 0x7fa8cc0acba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35822/0 (socket says 172.21.15.49:35822) 2024-01-22T05:05:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d2a00700 1 -- 172.21.15.49:0/1196728965 learned_addr learned my addr 172.21.15.49:0/1196728965 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d2000700 1 --2- 172.21.15.49:0/1196728965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8cc0631b0 0x7fa8cc0ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d1600700 1 --2- 172.21.15.49:0/1196728965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8cc068c50 0x7fa8cc0aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d2a00700 1 -- 172.21.15.49:0/1196728965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8cc0631b0 msgr2=0x7fa8cc0ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d2a00700 1 --2- 172.21.15.49:0/1196728965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8cc0631b0 0x7fa8cc0ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d2a00700 1 -- 172.21.15.49:0/1196728965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8cc068c50 msgr2=0x7fa8cc0aa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d2a00700 1 --2- 172.21.15.49:0/1196728965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8cc068c50 0x7fa8cc0aa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d2a00700 1 -- 172.21.15.49:0/1196728965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc009370 con 0x7fa8cc0c4660 2024-01-22T05:05:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d2a00700 1 --2- 172.21.15.49:0/1196728965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8cc0c4660 0x7fa8cc0acba0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fa8c4009d40 tx=0x7fa8c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8c9600700 1 -- 172.21.15.49:0/1196728965 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c400cb50 con 0x7fa8cc0c4660 2024-01-22T05:05:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8c9600700 1 -- 172.21.15.49:0/1196728965 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c400f040 con 0x7fa8cc0c4660 2024-01-22T05:05:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d4a00700 1 -- 172.21.15.49:0/1196728965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc0ad2a0 con 0x7fa8cc0c4660 2024-01-22T05:05:36.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8c9600700 1 -- 172.21.15.49:0/1196728965 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4013400 con 0x7fa8cc0c4660 2024-01-22T05:05:36.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.640+0000 7fa8d4a00700 1 -- 172.21.15.49:0/1196728965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc0ad860 con 0x7fa8cc0c4660 2024-01-22T05:05:36.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.644+0000 7fa8d4a00700 1 -- 172.21.15.49:0/1196728965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8cc047060 con 0x7fa8cc0c4660 2024-01-22T05:05:36.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.644+0000 7fa8c9600700 1 -- 172.21.15.49:0/1196728965 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa8c4013770 con 0x7fa8cc0c4660 2024-01-22T05:05:36.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.644+0000 7fa8c9600700 1 --2- 172.21.15.49:0/1196728965 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa8a405a510 0x7fa8a405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:36.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.644+0000 7fa8c9600700 1 -- 172.21.15.49:0/1196728965 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fa8c4074da0 con 0x7fa8cc0c4660 2024-01-22T05:05:36.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.644+0000 7fa8d2000700 1 --2- 172.21.15.49:0/1196728965 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa8a405a510 0x7fa8a405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.648+0000 7fa8d2000700 1 --2- 172.21.15.49:0/1196728965 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa8a405a510 0x7fa8a405c9d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fa8bc009fd0 tx=0x7fa8bc017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:36.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.652+0000 7fa8c9600700 1 -- 172.21.15.49:0/1196728965 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa8c4048770 con 0x7fa8cc0c4660 2024-01-22T05:05:36.871 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:05:36.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.868+0000 7fa8d4a00700 1 -- 172.21.15.49:0/1196728965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fa8cc046800 con 0x7fa8cc0c4660 2024-01-22T05:05:36.878 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:05:36.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.880+0000 7fa8c9600700 1 -- 172.21.15.49:0/1196728965 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa8c404bd90 con 0x7fa8cc0c4660 2024-01-22T05:05:36.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.880+0000 7fa8d4a00700 1 -- 172.21.15.49:0/1196728965 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa8a405a510 msgr2=0x7fa8a405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:36.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.880+0000 7fa8d4a00700 1 --2- 172.21.15.49:0/1196728965 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa8a405a510 0x7fa8a405c9d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fa8bc009fd0 tx=0x7fa8bc017000).stop 2024-01-22T05:05:36.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.880+0000 7fa8d4a00700 1 -- 172.21.15.49:0/1196728965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8cc0c4660 msgr2=0x7fa8cc0acba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:36.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.880+0000 7fa8d4a00700 1 --2- 172.21.15.49:0/1196728965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8cc0c4660 0x7fa8cc0acba0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fa8c4009d40 tx=0x7fa8c400b040).stop 2024-01-22T05:05:36.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.880+0000 7fa8d4a00700 1 -- 172.21.15.49:0/1196728965 shutdown_connections 2024-01-22T05:05:36.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.880+0000 7fa8d4a00700 1 --2- 172.21.15.49:0/1196728965 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa8a405a510 0x7fa8a405c9d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.880+0000 7fa8d4a00700 1 --2- 172.21.15.49:0/1196728965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8cc0c4660 0x7fa8cc0acba0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.880+0000 7fa8d4a00700 1 --2- 172.21.15.49:0/1196728965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8cc068c50 0x7fa8cc0aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.880+0000 7fa8d4a00700 1 --2- 172.21.15.49:0/1196728965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8cc0631b0 0x7fa8cc0ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:36.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.880+0000 7fa8d4a00700 1 -- 172.21.15.49:0/1196728965 >> 172.21.15.49:0/1196728965 conn(0x7fa8cc0c51c0 msgr2=0x7fa8cc0641d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:36.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.880+0000 7fa8d4a00700 1 -- 172.21.15.49:0/1196728965 shutdown_connections 2024-01-22T05:05:36.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:36.880+0000 7fa8d4a00700 1 -- 172.21.15.49:0/1196728965 wait complete. 2024-01-22T05:05:36.888 INFO:teuthology.orchestra.run.smithi049.stderr:updated 2024-01-22T05:05:36.906 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-01-22T05:05:37.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.140+0000 7f0379c00700 1 Processor -- start 2024-01-22T05:05:37.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.140+0000 7f0379c00700 1 -- start start 2024-01-22T05:05:37.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0379c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f03740644f0 0x7f0374064950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:37.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0379c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f03740bcc80 0x7f03740bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:37.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0379c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03740c2700 con 0x7f0374065660 2024-01-22T05:05:37.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0379c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03740a7650 con 0x7f03740bcc80 2024-01-22T05:05:37.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0379c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0374064e40 con 0x7f03740644f0 2024-01-22T05:05:37.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0373e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f03740bcc80 0x7f03740bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:37.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0372a00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0374065660 0x7f03740a6f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:46340/0 (socket says 172.21.15.49:46340) 2024-01-22T05:05:37.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0372a00700 1 -- 172.21.15.49:0/3052981231 learned_addr learned my addr 172.21.15.49:0/3052981231 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:37.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0372000700 1 --2- 172.21.15.49:0/3052981231 >> v2:172.21.15.110:3300/0 conn(0x7f03740644f0 0x7f0374064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:37.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0371600700 1 -- 172.21.15.49:0/3052981231 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805253345 0 0) 0x7f03740c2700 con 0x7f0374065660 2024-01-22T05:05:37.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0371600700 1 -- 172.21.15.49:0/3052981231 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03540033f0 con 0x7f0374065660 2024-01-22T05:05:37.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0373e00700 1 -- 172.21.15.49:0/3052981231 >> v2:172.21.15.110:3300/0 conn(0x7f03740644f0 msgr2=0x7f0374064950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:37.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0373e00700 1 --2- 172.21.15.49:0/3052981231 >> v2:172.21.15.110:3300/0 conn(0x7f03740644f0 0x7f0374064950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0373e00700 1 -- 172.21.15.49:0/3052981231 >> v1:172.21.15.110:6789/0 conn(0x7f0374065660 legacy=0x7f03740a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:37.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0373e00700 1 -- 172.21.15.49:0/3052981231 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03740c2930 con 0x7f03740bcc80 2024-01-22T05:05:37.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0373e00700 1 --2- 172.21.15.49:0/3052981231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03740bcc80 0x7f03740bd110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f0374065d80 tx=0x7f036c009780).ready entity=mon.0 client_cookie=cf60b1fb6d0a8a68 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:37.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0371600700 1 -- 172.21.15.49:0/3052981231 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c00e070 con 0x7f03740bcc80 2024-01-22T05:05:37.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0371600700 1 -- 172.21.15.49:0/3052981231 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c00bab0 con 0x7f03740bcc80 2024-01-22T05:05:37.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.144+0000 7f0371600700 1 -- 172.21.15.49:0/3052981231 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c00be30 con 0x7f03740bcc80 2024-01-22T05:05:37.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.148+0000 7f0379c00700 1 -- 172.21.15.49:0/3052981231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03740bcc80 msgr2=0x7f03740bd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:37.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.148+0000 7f0379c00700 1 --2- 172.21.15.49:0/3052981231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03740bcc80 0x7f03740bd110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f0374065d80 tx=0x7f036c009780).stop 2024-01-22T05:05:37.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.148+0000 7f0379c00700 1 -- 172.21.15.49:0/3052981231 shutdown_connections 2024-01-22T05:05:37.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.148+0000 7f0379c00700 1 --2- 172.21.15.49:0/3052981231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03740bcc80 0x7f03740bd110 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.148+0000 7f0379c00700 1 --2- 172.21.15.49:0/3052981231 >> v2:172.21.15.110:3300/0 conn(0x7f03740644f0 0x7f0374064950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.148+0000 7f0379c00700 1 -- 172.21.15.49:0/3052981231 >> 172.21.15.49:0/3052981231 conn(0x7f03740c87f0 msgr2=0x7f03740c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:37.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.148+0000 7f0379c00700 1 -- 172.21.15.49:0/3052981231 shutdown_connections 2024-01-22T05:05:37.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.148+0000 7f0379c00700 1 -- 172.21.15.49:0/3052981231 wait complete. 2024-01-22T05:05:37.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.152+0000 7f0379c00700 1 Processor -- start 2024-01-22T05:05:37.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.152+0000 7f0379c00700 1 -- start start 2024-01-22T05:05:37.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0379c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03740644f0 0x7f03740aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:37.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0379c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0374065660 0x7f0374152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:37.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0379c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03740bcc80 0x7f03740a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:37.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0379c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03740ac590 con 0x7f0374065660 2024-01-22T05:05:37.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0379c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03740ab620 con 0x7f03740bcc80 2024-01-22T05:05:37.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0379c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03740ab900 con 0x7f03740644f0 2024-01-22T05:05:37.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0372000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0374065660 0x7f0374152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0372000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0374065660 0x7f0374152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35850/0 (socket says 172.21.15.49:35850) 2024-01-22T05:05:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0373e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03740bcc80 0x7f03740a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0372a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03740644f0 0x7f03740aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0372000700 1 -- 172.21.15.49:0/893153295 learned_addr learned my addr 172.21.15.49:0/893153295 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0372000700 1 -- 172.21.15.49:0/893153295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03740644f0 msgr2=0x7f03740aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0372000700 1 --2- 172.21.15.49:0/893153295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03740644f0 0x7f03740aacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0372000700 1 -- 172.21.15.49:0/893153295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03740bcc80 msgr2=0x7f03740a9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0372000700 1 --2- 172.21.15.49:0/893153295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03740bcc80 0x7f03740a9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0372000700 1 -- 172.21.15.49:0/893153295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c009a20 con 0x7f0374065660 2024-01-22T05:05:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0372a00700 1 --2- 172.21.15.49:0/893153295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03740644f0 0x7f03740aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0373e00700 1 --2- 172.21.15.49:0/893153295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03740bcc80 0x7f03740a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0372000700 1 --2- 172.21.15.49:0/893153295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0374065660 0x7f0374152090 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f035c00e930 tx=0x7f035c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:37.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f036a000700 1 -- 172.21.15.49:0/893153295 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c012600 con 0x7f0374065660 2024-01-22T05:05:37.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0379c00700 1 -- 172.21.15.49:0/893153295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03740abbe0 con 0x7f0374065660 2024-01-22T05:05:37.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f036a000700 1 -- 172.21.15.49:0/893153295 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035c012760 con 0x7f0374065660 2024-01-22T05:05:37.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f036a000700 1 -- 172.21.15.49:0/893153295 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c012ae0 con 0x7f0374065660 2024-01-22T05:05:37.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.156+0000 7f0379c00700 1 -- 172.21.15.49:0/893153295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03740ab1c0 con 0x7f0374065660 2024-01-22T05:05:37.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.160+0000 7f0379c00700 1 -- 172.21.15.49:0/893153295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0374047060 con 0x7f0374065660 2024-01-22T05:05:37.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.160+0000 7f036a000700 1 -- 172.21.15.49:0/893153295 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f035c01b400 con 0x7f0374065660 2024-01-22T05:05:37.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.164+0000 7f036a000700 1 --2- 172.21.15.49:0/893153295 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f034c05a510 0x7f034c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:37.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.164+0000 7f036a000700 1 -- 172.21.15.49:0/893153295 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f035c074a70 con 0x7f0374065660 2024-01-22T05:05:37.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.164+0000 7f0372a00700 1 --2- 172.21.15.49:0/893153295 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f034c05a510 0x7f034c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:37.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.164+0000 7f0372a00700 1 --2- 172.21.15.49:0/893153295 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f034c05a510 0x7f034c05c9d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f0364005750 tx=0x7f0364009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:37.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.168+0000 7f036a000700 1 -- 172.21.15.49:0/893153295 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f035c0483e0 con 0x7f0374065660 2024-01-22T05:05:37.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.396+0000 7f0379c00700 1 -- 172.21.15.49:0/893153295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f03740c2c10 con 0x7f0374065660 2024-01-22T05:05:37.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.404+0000 7f036a000700 1 -- 172.21.15.49:0/893153295 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f035c04ba00 con 0x7f0374065660 2024-01-22T05:05:37.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.408+0000 7f0379c00700 1 -- 172.21.15.49:0/893153295 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f034c05a510 msgr2=0x7f034c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:37.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.408+0000 7f0379c00700 1 --2- 172.21.15.49:0/893153295 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f034c05a510 0x7f034c05c9d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f0364005750 tx=0x7f0364009040).stop 2024-01-22T05:05:37.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.408+0000 7f0379c00700 1 -- 172.21.15.49:0/893153295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0374065660 msgr2=0x7f0374152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:37.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.408+0000 7f0379c00700 1 --2- 172.21.15.49:0/893153295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0374065660 0x7f0374152090 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f035c00e930 tx=0x7f035c009060).stop 2024-01-22T05:05:37.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.408+0000 7f0379c00700 1 -- 172.21.15.49:0/893153295 shutdown_connections 2024-01-22T05:05:37.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.408+0000 7f0379c00700 1 --2- 172.21.15.49:0/893153295 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f034c05a510 0x7f034c05c9d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.408+0000 7f0379c00700 1 --2- 172.21.15.49:0/893153295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03740bcc80 0x7f03740a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.408+0000 7f0379c00700 1 --2- 172.21.15.49:0/893153295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0374065660 0x7f0374152090 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.408+0000 7f0379c00700 1 --2- 172.21.15.49:0/893153295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03740644f0 0x7f03740aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.408+0000 7f0379c00700 1 -- 172.21.15.49:0/893153295 >> 172.21.15.49:0/893153295 conn(0x7f03740c87f0 msgr2=0x7f03740c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:37.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.408+0000 7f0379c00700 1 -- 172.21.15.49:0/893153295 shutdown_connections 2024-01-22T05:05:37.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.408+0000 7f0379c00700 1 -- 172.21.15.49:0/893153295 wait complete. 2024-01-22T05:05:37.417 INFO:teuthology.orchestra.run.smithi049.stderr:updated 2024-01-22T05:05:37.433 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-01-22T05:05:37.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.600+0000 7ff93da00700 1 Processor -- start 2024-01-22T05:05:37.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.600+0000 7ff93da00700 1 -- start start 2024-01-22T05:05:37.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.604+0000 7ff93da00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff9380a5d30 0x7ff938062230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:37.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.604+0000 7ff93da00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff938062720 0x7ff938065930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:37.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.604+0000 7ff93da00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff938067e30 con 0x7ff938065e20 2024-01-22T05:05:37.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.604+0000 7ff93da00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff938068c90 con 0x7ff9380a5d30 2024-01-22T05:05:37.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.604+0000 7ff93da00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff938069120 con 0x7ff938062720 2024-01-22T05:05:37.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.604+0000 7ff936a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff9380a5d30 0x7ff938062230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:37.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.604+0000 7ff936a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff9380a5d30 0x7ff938062230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35862/0 (socket says 172.21.15.49:35862) 2024-01-22T05:05:37.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.604+0000 7ff936a00700 1 -- 172.21.15.49:0/3305734642 learned_addr learned my addr 172.21.15.49:0/3305734642 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:37.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.604+0000 7ff936000700 1 --2- 172.21.15.49:0/3305734642 >> v2:172.21.15.110:3300/0 conn(0x7ff938062720 0x7ff938065930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:37.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff936a00700 1 -- 172.21.15.49:0/3305734642 >> v2:172.21.15.110:3300/0 conn(0x7ff938062720 msgr2=0x7ff938065930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:37.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff936a00700 1 --2- 172.21.15.49:0/3305734642 >> v2:172.21.15.110:3300/0 conn(0x7ff938062720 0x7ff938065930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff936a00700 1 -- 172.21.15.49:0/3305734642 >> v1:172.21.15.110:6789/0 conn(0x7ff938065e20 legacy=0x7ff9380c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:37.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff936a00700 1 -- 172.21.15.49:0/3305734642 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff938062b80 con 0x7ff9380a5d30 2024-01-22T05:05:37.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff936000700 1 --2- 172.21.15.49:0/3305734642 >> v2:172.21.15.110:3300/0 conn(0x7ff938062720 0x7ff938065930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:37.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff936a00700 1 --2- 172.21.15.49:0/3305734642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9380a5d30 0x7ff938062230 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7ff9380c6880 tx=0x7ff9280090f0).ready entity=mon.0 client_cookie=bf9a2bd3c700f902 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:37.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff935600700 1 -- 172.21.15.49:0/3305734642 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92800b520 con 0x7ff9380a5d30 2024-01-22T05:05:37.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff935600700 1 -- 172.21.15.49:0/3305734642 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92800b680 con 0x7ff9380a5d30 2024-01-22T05:05:37.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff935600700 1 -- 172.21.15.49:0/3305734642 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92800ba00 con 0x7ff9380a5d30 2024-01-22T05:05:37.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff93da00700 1 -- 172.21.15.49:0/3305734642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9380a5d30 msgr2=0x7ff938062230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:37.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff93da00700 1 --2- 172.21.15.49:0/3305734642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9380a5d30 0x7ff938062230 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7ff9380c6880 tx=0x7ff9280090f0).stop 2024-01-22T05:05:37.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff93da00700 1 -- 172.21.15.49:0/3305734642 shutdown_connections 2024-01-22T05:05:37.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff93da00700 1 --2- 172.21.15.49:0/3305734642 >> v2:172.21.15.110:3300/0 conn(0x7ff938062720 0x7ff938065930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff93da00700 1 --2- 172.21.15.49:0/3305734642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9380a5d30 0x7ff938062230 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff93da00700 1 -- 172.21.15.49:0/3305734642 >> 172.21.15.49:0/3305734642 conn(0x7ff9380c6920 msgr2=0x7ff9380c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:37.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff93da00700 1 -- 172.21.15.49:0/3305734642 shutdown_connections 2024-01-22T05:05:37.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.608+0000 7ff93da00700 1 -- 172.21.15.49:0/3305734642 wait complete. 2024-01-22T05:05:37.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.612+0000 7ff93da00700 1 Processor -- start 2024-01-22T05:05:37.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff93da00700 1 -- start start 2024-01-22T05:05:37.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff93da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff938062720 0x7ff9380a7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:37.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff93da00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff938065e20 0x7ff938142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:37.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff93da00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9380a5d30 0x7ff938142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:37.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff93da00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff938142a30 con 0x7ff938062720 2024-01-22T05:05:37.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff93da00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9380aae60 con 0x7ff9380a5d30 2024-01-22T05:05:37.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff93da00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff938159730 con 0x7ff938065e20 2024-01-22T05:05:37.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff936a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff938062720 0x7ff9380a7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:37.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff936a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff938062720 0x7ff9380a7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35870/0 (socket says 172.21.15.49:35870) 2024-01-22T05:05:37.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff936a00700 1 -- 172.21.15.49:0/1511054542 learned_addr learned my addr 172.21.15.49:0/1511054542 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:37.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff937400700 1 --2- 172.21.15.49:0/1511054542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9380a5d30 0x7ff938142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:37.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff936000700 1 --2- 172.21.15.49:0/1511054542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff938065e20 0x7ff938142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:37.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff936a00700 1 -- 172.21.15.49:0/1511054542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff938065e20 msgr2=0x7ff938142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:37.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff936a00700 1 --2- 172.21.15.49:0/1511054542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff938065e20 0x7ff938142050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff936a00700 1 -- 172.21.15.49:0/1511054542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9380a5d30 msgr2=0x7ff938142540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:37.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff936a00700 1 --2- 172.21.15.49:0/1511054542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9380a5d30 0x7ff938142540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff936a00700 1 -- 172.21.15.49:0/1511054542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9200092a0 con 0x7ff938062720 2024-01-22T05:05:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.616+0000 7ff936a00700 1 --2- 172.21.15.49:0/1511054542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff938062720 0x7ff9380a7b00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7ff928009130 tx=0x7ff928017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.620+0000 7ff92e000700 1 -- 172.21.15.49:0/1511054542 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92800be90 con 0x7ff938062720 2024-01-22T05:05:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.620+0000 7ff92e000700 1 -- 172.21.15.49:0/1511054542 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92800b7f0 con 0x7ff938062720 2024-01-22T05:05:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.620+0000 7ff93da00700 1 -- 172.21.15.49:0/1511054542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff928009370 con 0x7ff938062720 2024-01-22T05:05:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.620+0000 7ff92e000700 1 -- 172.21.15.49:0/1511054542 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92801c670 con 0x7ff938062720 2024-01-22T05:05:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.620+0000 7ff93da00700 1 -- 172.21.15.49:0/1511054542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff938159ac0 con 0x7ff938062720 2024-01-22T05:05:37.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.620+0000 7ff93da00700 1 -- 172.21.15.49:0/1511054542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff938064f50 con 0x7ff938062720 2024-01-22T05:05:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.624+0000 7ff92e000700 1 -- 172.21.15.49:0/1511054542 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff92801c9e0 con 0x7ff938062720 2024-01-22T05:05:37.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.624+0000 7ff92e000700 1 --2- 172.21.15.49:0/1511054542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff91005a540 0x7ff91005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:37.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.624+0000 7ff92e000700 1 -- 172.21.15.49:0/1511054542 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5622+0+0 (secure 0 0 0) 0x7ff9280763c0 con 0x7ff938062720 2024-01-22T05:05:37.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.624+0000 7ff936000700 1 --2- 172.21.15.49:0/1511054542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff91005a540 0x7ff91005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:37.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.624+0000 7ff936000700 1 --2- 172.21.15.49:0/1511054542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff91005a540 0x7ff91005ca00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7ff9380a8790 tx=0x7ff920009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:37.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.628+0000 7ff92e000700 1 -- 172.21.15.49:0/1511054542 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff928049cd0 con 0x7ff938062720 2024-01-22T05:05:37.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.844+0000 7ff93da00700 1 -- 172.21.15.49:0/1511054542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff938066b90 con 0x7ff938062720 2024-01-22T05:05:37.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.852+0000 7ff92e000700 1 -- 172.21.15.49:0/1511054542 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff928020020 con 0x7ff938062720 2024-01-22T05:05:37.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.856+0000 7ff93da00700 1 -- 172.21.15.49:0/1511054542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff91005a540 msgr2=0x7ff91005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:37.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.856+0000 7ff93da00700 1 --2- 172.21.15.49:0/1511054542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff91005a540 0x7ff91005ca00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7ff9380a8790 tx=0x7ff920009060).stop 2024-01-22T05:05:37.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.856+0000 7ff93da00700 1 -- 172.21.15.49:0/1511054542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff938062720 msgr2=0x7ff9380a7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:37.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.856+0000 7ff93da00700 1 --2- 172.21.15.49:0/1511054542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff938062720 0x7ff9380a7b00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7ff928009130 tx=0x7ff928017000).stop 2024-01-22T05:05:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.856+0000 7ff93da00700 1 -- 172.21.15.49:0/1511054542 shutdown_connections 2024-01-22T05:05:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.856+0000 7ff93da00700 1 --2- 172.21.15.49:0/1511054542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff91005a540 0x7ff91005ca00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.856+0000 7ff93da00700 1 --2- 172.21.15.49:0/1511054542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9380a5d30 0x7ff938142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.856+0000 7ff93da00700 1 --2- 172.21.15.49:0/1511054542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff938065e20 0x7ff938142050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.856+0000 7ff93da00700 1 --2- 172.21.15.49:0/1511054542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff938062720 0x7ff9380a7b00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.856+0000 7ff93da00700 1 -- 172.21.15.49:0/1511054542 >> 172.21.15.49:0/1511054542 conn(0x7ff9380c6920 msgr2=0x7ff9380bb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.856+0000 7ff93da00700 1 -- 172.21.15.49:0/1511054542 shutdown_connections 2024-01-22T05:05:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:37.856+0000 7ff93da00700 1 -- 172.21.15.49:0/1511054542 wait complete. 2024-01-22T05:05:37.865 INFO:teuthology.orchestra.run.smithi049.stderr:updated 2024-01-22T05:05:37.888 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-01-22T05:05:38.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.052+0000 7fb8ee400700 1 Processor -- start 2024-01-22T05:05:38.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.052+0000 7fb8ee400700 1 -- start start 2024-01-22T05:05:38.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8ee400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb8e806a1c0 0x7fb8e81508e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8ee400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8e8064530 0x7fb8e8154600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8ee400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e80c3dd0 con 0x7fb8e80a6720 2024-01-22T05:05:38.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8ee400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e80a6f00 con 0x7fb8e8064530 2024-01-22T05:05:38.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8ee400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e8150dd0 con 0x7fb8e806a1c0 2024-01-22T05:05:38.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8e7e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8e8064530 0x7fb8e8154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8e7e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8e8064530 0x7fb8e8154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35876/0 (socket says 172.21.15.49:35876) 2024-01-22T05:05:38.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8e7e00700 1 -- 172.21.15.49:0/1178408734 learned_addr learned my addr 172.21.15.49:0/1178408734 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:38.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8e7400700 1 --2- 172.21.15.49:0/1178408734 >> v2:172.21.15.110:3300/0 conn(0x7fb8e806a1c0 0x7fb8e81508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8e7e00700 1 -- 172.21.15.49:0/1178408734 >> v2:172.21.15.110:3300/0 conn(0x7fb8e806a1c0 msgr2=0x7fb8e81508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:38.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8e7e00700 1 --2- 172.21.15.49:0/1178408734 >> v2:172.21.15.110:3300/0 conn(0x7fb8e806a1c0 0x7fb8e81508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8e7e00700 1 -- 172.21.15.49:0/1178408734 >> v1:172.21.15.110:6789/0 conn(0x7fb8e80a6720 legacy=0x7fb8e8063e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:38.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8e7e00700 1 -- 172.21.15.49:0/1178408734 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e806a5a0 con 0x7fb8e8064530 2024-01-22T05:05:38.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8e7400700 1 --2- 172.21.15.49:0/1178408734 >> v2:172.21.15.110:3300/0 conn(0x7fb8e806a1c0 0x7fb8e81508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:05:38.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8e7e00700 1 --2- 172.21.15.49:0/1178408734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8e8064530 0x7fb8e8154600 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fb8e8065ca0 tx=0x7fb8e0009840).ready entity=mon.0 client_cookie=b06f9de91e14a285 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:38.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8e6000700 1 -- 172.21.15.49:0/1178408734 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e000e070 con 0x7fb8e8064530 2024-01-22T05:05:38.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8e6000700 1 -- 172.21.15.49:0/1178408734 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e000ba10 con 0x7fb8e8064530 2024-01-22T05:05:38.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8e6000700 1 -- 172.21.15.49:0/1178408734 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e000bd90 con 0x7fb8e8064530 2024-01-22T05:05:38.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8ee400700 1 -- 172.21.15.49:0/1178408734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8e8064530 msgr2=0x7fb8e8154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8ee400700 1 --2- 172.21.15.49:0/1178408734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8e8064530 0x7fb8e8154600 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fb8e8065ca0 tx=0x7fb8e0009840).stop 2024-01-22T05:05:38.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8ee400700 1 -- 172.21.15.49:0/1178408734 shutdown_connections 2024-01-22T05:05:38.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8ee400700 1 --2- 172.21.15.49:0/1178408734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8e8064530 0x7fb8e8154600 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8ee400700 1 --2- 172.21.15.49:0/1178408734 >> v2:172.21.15.110:3300/0 conn(0x7fb8e806a1c0 0x7fb8e81508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.056+0000 7fb8ee400700 1 -- 172.21.15.49:0/1178408734 >> 172.21.15.49:0/1178408734 conn(0x7fb8e8066830 msgr2=0x7fb8e8066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:38.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.060+0000 7fb8ee400700 1 -- 172.21.15.49:0/1178408734 shutdown_connections 2024-01-22T05:05:38.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.060+0000 7fb8ee400700 1 -- 172.21.15.49:0/1178408734 wait complete. 2024-01-22T05:05:38.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.064+0000 7fb8ee400700 1 Processor -- start 2024-01-22T05:05:38.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.064+0000 7fb8ee400700 1 -- start start 2024-01-22T05:05:38.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.064+0000 7fb8ee400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8e8064530 0x7fb8e80c01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.064+0000 7fb8ee400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8e806a1c0 0x7fb8e8163f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.064+0000 7fb8ee400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8e80a6720 0x7fb8e814f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.064+0000 7fb8ee400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80be6c0 con 0x7fb8e80a6720 2024-01-22T05:05:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.064+0000 7fb8ee400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80be9a0 con 0x7fb8e806a1c0 2024-01-22T05:05:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.064+0000 7fb8ee400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8164830 con 0x7fb8e8064530 2024-01-22T05:05:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.064+0000 7fb8e7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8e80a6720 0x7fb8e814f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.064+0000 7fb8e7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8e80a6720 0x7fb8e814f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35880/0 (socket says 172.21.15.49:35880) 2024-01-22T05:05:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.064+0000 7fb8e7e00700 1 -- 172.21.15.49:0/3347816084 learned_addr learned my addr 172.21.15.49:0/3347816084 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.068+0000 7fb8e6a00700 1 --2- 172.21.15.49:0/3347816084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8e806a1c0 0x7fb8e8163f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.068+0000 7fb8e7400700 1 --2- 172.21.15.49:0/3347816084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8e8064530 0x7fb8e80c01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.068+0000 7fb8e7e00700 1 -- 172.21.15.49:0/3347816084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8e8064530 msgr2=0x7fb8e80c01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.068+0000 7fb8e7e00700 1 --2- 172.21.15.49:0/3347816084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8e8064530 0x7fb8e80c01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.068+0000 7fb8e7e00700 1 -- 172.21.15.49:0/3347816084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8e806a1c0 msgr2=0x7fb8e8163f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.068+0000 7fb8e7e00700 1 --2- 172.21.15.49:0/3347816084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8e806a1c0 0x7fb8e8163f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.068+0000 7fb8e7e00700 1 -- 172.21.15.49:0/3347816084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e0009ae0 con 0x7fb8e80a6720 2024-01-22T05:05:38.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.068+0000 7fb8e7e00700 1 --2- 172.21.15.49:0/3347816084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8e80a6720 0x7fb8e814f5d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fb8e0010000 tx=0x7fb8e0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:38.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.068+0000 7fb8dea00700 1 -- 172.21.15.49:0/3347816084 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0013dc0 con 0x7fb8e80a6720 2024-01-22T05:05:38.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.068+0000 7fb8dea00700 1 -- 172.21.15.49:0/3347816084 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e001c400 con 0x7fb8e80a6720 2024-01-22T05:05:38.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.068+0000 7fb8ee400700 1 -- 172.21.15.49:0/3347816084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e8164b10 con 0x7fb8e80a6720 2024-01-22T05:05:38.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.068+0000 7fb8dea00700 1 -- 172.21.15.49:0/3347816084 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e001c7a0 con 0x7fb8e80a6720 2024-01-22T05:05:38.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.068+0000 7fb8ee400700 1 -- 172.21.15.49:0/3347816084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e8164450 con 0x7fb8e80a6720 2024-01-22T05:05:38.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.068+0000 7fb8ee400700 1 -- 172.21.15.49:0/3347816084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e80beb10 con 0x7fb8e80a6720 2024-01-22T05:05:38.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.072+0000 7fb8dea00700 1 -- 172.21.15.49:0/3347816084 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb8e001cbd0 con 0x7fb8e80a6720 2024-01-22T05:05:38.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.072+0000 7fb8dea00700 1 --2- 172.21.15.49:0/3347816084 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8c005a510 0x7fb8c005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.072+0000 7fb8dea00700 1 -- 172.21.15.49:0/3347816084 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fb8e0076060 con 0x7fb8e80a6720 2024-01-22T05:05:38.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.072+0000 7fb8e7400700 1 --2- 172.21.15.49:0/3347816084 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8c005a510 0x7fb8c005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.076+0000 7fb8e7400700 1 --2- 172.21.15.49:0/3347816084 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8c005a510 0x7fb8c005c9d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fb8e81674c0 tx=0x7fb8d8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:38.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.080+0000 7fb8dea00700 1 -- 172.21.15.49:0/3347816084 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb8e00a4b00 con 0x7fb8e80a6720 2024-01-22T05:05:38.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.304+0000 7fb8ee400700 1 -- 172.21.15.49:0/3347816084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fb8e80beb10 con 0x7fb8e80a6720 2024-01-22T05:05:38.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.312+0000 7fb8dea00700 1 -- 172.21.15.49:0/3347816084 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb8e0049970 con 0x7fb8e80a6720 2024-01-22T05:05:38.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.316+0000 7fb8ee400700 1 -- 172.21.15.49:0/3347816084 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8c005a510 msgr2=0x7fb8c005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.316+0000 7fb8ee400700 1 --2- 172.21.15.49:0/3347816084 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8c005a510 0x7fb8c005c9d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fb8e81674c0 tx=0x7fb8d8008040).stop 2024-01-22T05:05:38.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.316+0000 7fb8ee400700 1 -- 172.21.15.49:0/3347816084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8e80a6720 msgr2=0x7fb8e814f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.316+0000 7fb8ee400700 1 --2- 172.21.15.49:0/3347816084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8e80a6720 0x7fb8e814f5d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fb8e0010000 tx=0x7fb8e0009840).stop 2024-01-22T05:05:38.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.316+0000 7fb8ee400700 1 -- 172.21.15.49:0/3347816084 shutdown_connections 2024-01-22T05:05:38.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.316+0000 7fb8ee400700 1 --2- 172.21.15.49:0/3347816084 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8c005a510 0x7fb8c005c9d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.316+0000 7fb8ee400700 1 --2- 172.21.15.49:0/3347816084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8e80a6720 0x7fb8e814f5d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.316+0000 7fb8ee400700 1 --2- 172.21.15.49:0/3347816084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8e806a1c0 0x7fb8e8163f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.316+0000 7fb8ee400700 1 --2- 172.21.15.49:0/3347816084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8e8064530 0x7fb8e80c01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.316+0000 7fb8ee400700 1 -- 172.21.15.49:0/3347816084 >> 172.21.15.49:0/3347816084 conn(0x7fb8e8066830 msgr2=0x7fb8e80c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:38.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.316+0000 7fb8ee400700 1 -- 172.21.15.49:0/3347816084 shutdown_connections 2024-01-22T05:05:38.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.316+0000 7fb8ee400700 1 -- 172.21.15.49:0/3347816084 wait complete. 2024-01-22T05:05:38.324 INFO:teuthology.orchestra.run.smithi049.stderr:updated 2024-01-22T05:05:38.343 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-01-22T05:05:38.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.500+0000 7faae3200700 1 Processor -- start 2024-01-22T05:05:38.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.500+0000 7faae3200700 1 -- start start 2024-01-22T05:05:38.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.504+0000 7faae3200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faadc0abf80 0x7faadc15b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.504+0000 7faae3200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc0a9f80 con 0x7faadc0a5710 2024-01-22T05:05:38.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.504+0000 7faae3200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc0a6010 con 0x7faadc0a5af0 2024-01-22T05:05:38.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.504+0000 7faae3200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc066470 con 0x7faadc0abf80 2024-01-22T05:05:38.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.504+0000 7faae1e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faadc0a5710 0x7faadc065650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59266/0 (socket says 172.21.15.49:59266) 2024-01-22T05:05:38.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.504+0000 7faae1e00700 1 -- 172.21.15.49:0/953904738 learned_addr learned my addr 172.21.15.49:0/953904738 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:38.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.504+0000 7faae2800700 1 --2- 172.21.15.49:0/953904738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faadc0abf80 0x7faadc15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.504+0000 7faae0a00700 1 -- 172.21.15.49:0/953904738 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260882661 0 0) 0x7faadc0a9f80 con 0x7faadc0a5710 2024-01-22T05:05:38.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.504+0000 7faae0a00700 1 -- 172.21.15.49:0/953904738 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faabc0033f0 con 0x7faadc0a5710 2024-01-22T05:05:38.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.504+0000 7faae0a00700 1 -- 172.21.15.49:0/953904738 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036849611 0 0) 0x7faadc0a6010 con 0x7faadc0a5af0 2024-01-22T05:05:38.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.504+0000 7faae0a00700 1 -- 172.21.15.49:0/953904738 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faadc0a9f80 con 0x7faadc0a5af0 2024-01-22T05:05:38.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.504+0000 7faae2800700 1 -- 172.21.15.49:0/953904738 >> v1:172.21.15.110:6789/0 conn(0x7faadc0a5af0 legacy=0x7faadc065d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.504+0000 7faae2800700 1 -- 172.21.15.49:0/953904738 >> v1:172.21.15.49:6789/0 conn(0x7faadc0a5710 legacy=0x7faadc065650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.504+0000 7faae2800700 1 -- 172.21.15.49:0/953904738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc0aa1b0 con 0x7faadc0abf80 2024-01-22T05:05:38.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.508+0000 7faae2800700 1 --2- 172.21.15.49:0/953904738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faadc0abf80 0x7faadc15b450 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7faad4009e90 tx=0x7faad4009780).ready entity=mon.2 client_cookie=9d6051cd47b63ae0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:38.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.508+0000 7faae0a00700 1 -- 172.21.15.49:0/953904738 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400e070 con 0x7faadc0abf80 2024-01-22T05:05:38.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.508+0000 7faae0a00700 1 -- 172.21.15.49:0/953904738 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad400bab0 con 0x7faadc0abf80 2024-01-22T05:05:38.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.508+0000 7faae0a00700 1 -- 172.21.15.49:0/953904738 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400be30 con 0x7faadc0abf80 2024-01-22T05:05:38.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.508+0000 7faae3200700 1 -- 172.21.15.49:0/953904738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faadc0abf80 msgr2=0x7faadc15b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.508+0000 7faae3200700 1 --2- 172.21.15.49:0/953904738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faadc0abf80 0x7faadc15b450 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7faad4009e90 tx=0x7faad4009780).stop 2024-01-22T05:05:38.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.508+0000 7faae3200700 1 -- 172.21.15.49:0/953904738 shutdown_connections 2024-01-22T05:05:38.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.508+0000 7faae3200700 1 --2- 172.21.15.49:0/953904738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faadc0abf80 0x7faadc15b450 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.508+0000 7faae3200700 1 -- 172.21.15.49:0/953904738 >> 172.21.15.49:0/953904738 conn(0x7faadc0c6530 msgr2=0x7faadc0c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:38.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.508+0000 7faae3200700 1 -- 172.21.15.49:0/953904738 shutdown_connections 2024-01-22T05:05:38.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.508+0000 7faae3200700 1 -- 172.21.15.49:0/953904738 wait complete. 2024-01-22T05:05:38.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.512+0000 7faae3200700 1 Processor -- start 2024-01-22T05:05:38.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.512+0000 7faae3200700 1 -- start start 2024-01-22T05:05:38.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.512+0000 7faae3200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faadc0a5710 0x7faadc14a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.512+0000 7faae3200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc0a5af0 0x7faadc152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.512+0000 7faae3200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faadc0abf80 0x7faadc164720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.512+0000 7faae3200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc14a830 con 0x7faadc0a5af0 2024-01-22T05:05:38.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.512+0000 7faae3200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0a6fe0 con 0x7faadc0a5710 2024-01-22T05:05:38.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.512+0000 7faae3200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0a7880 con 0x7faadc0abf80 2024-01-22T05:05:38.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faae1400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc0a5af0 0x7faadc152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faae1400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc0a5af0 0x7faadc152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35882/0 (socket says 172.21.15.49:35882) 2024-01-22T05:05:38.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faae1400700 1 -- 172.21.15.49:0/1215000986 learned_addr learned my addr 172.21.15.49:0/1215000986 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:38.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faae1e00700 1 --2- 172.21.15.49:0/1215000986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faadc0a5710 0x7faadc14a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faae2800700 1 --2- 172.21.15.49:0/1215000986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faadc0abf80 0x7faadc164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faae1400700 1 -- 172.21.15.49:0/1215000986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faadc0abf80 msgr2=0x7faadc164720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faae1400700 1 --2- 172.21.15.49:0/1215000986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faadc0abf80 0x7faadc164720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faae1400700 1 -- 172.21.15.49:0/1215000986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faadc0a5710 msgr2=0x7faadc14a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faae1400700 1 --2- 172.21.15.49:0/1215000986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faadc0a5710 0x7faadc14a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faae1400700 1 -- 172.21.15.49:0/1215000986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad4009a20 con 0x7faadc0a5af0 2024-01-22T05:05:38.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faae1e00700 1 --2- 172.21.15.49:0/1215000986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faadc0a5710 0x7faadc14a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:38.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faae1400700 1 --2- 172.21.15.49:0/1215000986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc0a5af0 0x7faadc152690 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7faac400c490 tx=0x7faac4007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:38.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faad9600700 1 -- 172.21.15.49:0/1215000986 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac400ce40 con 0x7faadc0a5af0 2024-01-22T05:05:38.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faad9600700 1 -- 172.21.15.49:0/1215000986 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac400f470 con 0x7faadc0a5af0 2024-01-22T05:05:38.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faad9600700 1 -- 172.21.15.49:0/1215000986 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac400f830 con 0x7faadc0a5af0 2024-01-22T05:05:38.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faae3200700 1 -- 172.21.15.49:0/1215000986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc153000 con 0x7faadc0a5af0 2024-01-22T05:05:38.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.516+0000 7faae3200700 1 -- 172.21.15.49:0/1215000986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc0a7510 con 0x7faadc0a5af0 2024-01-22T05:05:38.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.520+0000 7faae3200700 1 -- 172.21.15.49:0/1215000986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc150260 con 0x7faadc0a5af0 2024-01-22T05:05:38.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.520+0000 7faad9600700 1 -- 172.21.15.49:0/1215000986 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7faac400fbe0 con 0x7faadc0a5af0 2024-01-22T05:05:38.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.520+0000 7faad9600700 1 --2- 172.21.15.49:0/1215000986 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faab405a510 0x7faab405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.524+0000 7faad9600700 1 -- 172.21.15.49:0/1215000986 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5622+0+0 (secure 0 0 0) 0x7faac4073aa0 con 0x7faadc0a5af0 2024-01-22T05:05:38.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.524+0000 7faae1e00700 1 --2- 172.21.15.49:0/1215000986 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faab405a510 0x7faab405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.524+0000 7faae1e00700 1 --2- 172.21.15.49:0/1215000986 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faab405a510 0x7faab405c9d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7faacc005750 tx=0x7faacc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:38.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.528+0000 7faad9600700 1 -- 172.21.15.49:0/1215000986 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faadc150260 con 0x7faadc0a5af0 2024-01-22T05:05:38.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.748+0000 7faae3200700 1 -- 172.21.15.49:0/1215000986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7faadc150260 con 0x7faadc0a5af0 2024-01-22T05:05:38.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.756+0000 7faad9600700 1 -- 172.21.15.49:0/1215000986 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7faadc150260 con 0x7faadc0a5af0 2024-01-22T05:05:38.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.760+0000 7faae3200700 1 -- 172.21.15.49:0/1215000986 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faab405a510 msgr2=0x7faab405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.760+0000 7faae3200700 1 --2- 172.21.15.49:0/1215000986 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faab405a510 0x7faab405c9d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7faacc005750 tx=0x7faacc009040).stop 2024-01-22T05:05:38.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.760+0000 7faae3200700 1 -- 172.21.15.49:0/1215000986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc0a5af0 msgr2=0x7faadc152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.760+0000 7faae3200700 1 --2- 172.21.15.49:0/1215000986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc0a5af0 0x7faadc152690 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7faac400c490 tx=0x7faac4007c60).stop 2024-01-22T05:05:38.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.760+0000 7faae3200700 1 -- 172.21.15.49:0/1215000986 shutdown_connections 2024-01-22T05:05:38.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.760+0000 7faae3200700 1 --2- 172.21.15.49:0/1215000986 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faab405a510 0x7faab405c9d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.760+0000 7faae3200700 1 --2- 172.21.15.49:0/1215000986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faadc0abf80 0x7faadc164720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.760+0000 7faae3200700 1 --2- 172.21.15.49:0/1215000986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faadc0a5af0 0x7faadc152690 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.760+0000 7faae3200700 1 --2- 172.21.15.49:0/1215000986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faadc0a5710 0x7faadc14a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.760+0000 7faae3200700 1 -- 172.21.15.49:0/1215000986 >> 172.21.15.49:0/1215000986 conn(0x7faadc0c6530 msgr2=0x7faadc0a4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:38.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.760+0000 7faae3200700 1 -- 172.21.15.49:0/1215000986 shutdown_connections 2024-01-22T05:05:38.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.760+0000 7faae3200700 1 -- 172.21.15.49:0/1215000986 wait complete. 2024-01-22T05:05:38.768 INFO:teuthology.orchestra.run.smithi049.stderr:updated 2024-01-22T05:05:38.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:05:38.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.944+0000 7f1e4fe00700 1 Processor -- start 2024-01-22T05:05:38.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.948+0000 7f1e4fe00700 1 -- start start 2024-01-22T05:05:38.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.948+0000 7f1e4fe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1e500a7260 0x7f1e500659b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.948+0000 7f1e4fe00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e50068a60 con 0x7f1e50155880 2024-01-22T05:05:38.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.948+0000 7f1e4fe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e50067e50 con 0x7f1e50155c60 2024-01-22T05:05:38.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.948+0000 7f1e4fe00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e50068130 con 0x7f1e500a7260 2024-01-22T05:05:38.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.948+0000 7f1e4ea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1e50155880 0x7f1e500a8990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59282/0 (socket says 172.21.15.49:59282) 2024-01-22T05:05:38.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.948+0000 7f1e4ea00700 1 -- 172.21.15.49:0/645446407 learned_addr learned my addr 172.21.15.49:0/645446407 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:38.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.948+0000 7f1e4f400700 1 --2- 172.21.15.49:0/645446407 >> v2:172.21.15.110:3300/0 conn(0x7f1e500a7260 0x7f1e500659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.948+0000 7f1e4d600700 1 -- 172.21.15.49:0/645446407 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845796795 0 0) 0x7f1e50068a60 con 0x7f1e50155880 2024-01-22T05:05:38.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.948+0000 7f1e4d600700 1 -- 172.21.15.49:0/645446407 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e300033f0 con 0x7f1e50155880 2024-01-22T05:05:38.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.948+0000 7f1e4d600700 1 -- 172.21.15.49:0/645446407 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289267772 0 0) 0x7f1e50067e50 con 0x7f1e50155c60 2024-01-22T05:05:38.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.948+0000 7f1e4d600700 1 -- 172.21.15.49:0/645446407 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e50068a60 con 0x7f1e50155c60 2024-01-22T05:05:38.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.952+0000 7f1e4f400700 1 -- 172.21.15.49:0/645446407 >> v1:172.21.15.110:6789/0 conn(0x7f1e50155c60 legacy=0x7f1e500a6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.952+0000 7f1e4f400700 1 -- 172.21.15.49:0/645446407 >> v1:172.21.15.49:6789/0 conn(0x7f1e50155880 legacy=0x7f1e500a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.952+0000 7f1e4f400700 1 -- 172.21.15.49:0/645446407 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e50068410 con 0x7f1e500a7260 2024-01-22T05:05:38.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.952+0000 7f1e4f400700 1 --2- 172.21.15.49:0/645446407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e500a7260 0x7f1e500659b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f1e500a7700 tx=0x7f1e48009780).ready entity=mon.1 client_cookie=be3f5953e9089e9e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:38.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.952+0000 7f1e4d600700 1 -- 172.21.15.49:0/645446407 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4800e070 con 0x7f1e500a7260 2024-01-22T05:05:38.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.952+0000 7f1e4d600700 1 -- 172.21.15.49:0/645446407 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4800bab0 con 0x7f1e500a7260 2024-01-22T05:05:38.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.952+0000 7f1e4d600700 1 -- 172.21.15.49:0/645446407 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4800be30 con 0x7f1e500a7260 2024-01-22T05:05:38.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.952+0000 7f1e4fe00700 1 -- 172.21.15.49:0/645446407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e500a7260 msgr2=0x7f1e500659b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.952+0000 7f1e4fe00700 1 --2- 172.21.15.49:0/645446407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e500a7260 0x7f1e500659b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f1e500a7700 tx=0x7f1e48009780).stop 2024-01-22T05:05:38.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.952+0000 7f1e4fe00700 1 -- 172.21.15.49:0/645446407 shutdown_connections 2024-01-22T05:05:38.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.952+0000 7f1e4fe00700 1 --2- 172.21.15.49:0/645446407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e500a7260 0x7f1e500659b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.952+0000 7f1e4fe00700 1 -- 172.21.15.49:0/645446407 >> 172.21.15.49:0/645446407 conn(0x7f1e500c6530 msgr2=0x7f1e500c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:38.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.952+0000 7f1e4fe00700 1 -- 172.21.15.49:0/645446407 shutdown_connections 2024-01-22T05:05:38.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.952+0000 7f1e4fe00700 1 -- 172.21.15.49:0/645446407 wait complete. 2024-01-22T05:05:38.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.956+0000 7f1e4fe00700 1 Processor -- start 2024-01-22T05:05:38.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.956+0000 7f1e4fe00700 1 -- start start 2024-01-22T05:05:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e500a7260 0x7f1e500aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e50155880 0x7f1e500a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e50155c60 0x7f1e500a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4fe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500a5780 con 0x7f1e50155880 2024-01-22T05:05:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500abb60 con 0x7f1e50155c60 2024-01-22T05:05:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500aaf50 con 0x7f1e500a7260 2024-01-22T05:05:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e50155880 0x7f1e500a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e500a7260 0x7f1e500aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e500a7260 0x7f1e500aa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:33748/0 (socket says 172.21.15.49:33748) 2024-01-22T05:05:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4ea00700 1 -- 172.21.15.49:0/3886195738 learned_addr learned my addr 172.21.15.49:0/3886195738 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4f400700 1 --2- 172.21.15.49:0/3886195738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e50155c60 0x7f1e500a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4ea00700 1 -- 172.21.15.49:0/3886195738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e50155c60 msgr2=0x7f1e500a5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4ea00700 1 --2- 172.21.15.49:0/3886195738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e50155c60 0x7f1e500a5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4ea00700 1 -- 172.21.15.49:0/3886195738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e50155880 msgr2=0x7f1e500a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4ea00700 1 --2- 172.21.15.49:0/3886195738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e50155880 0x7f1e500a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4ea00700 1 -- 172.21.15.49:0/3886195738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e48009a20 con 0x7f1e500a7260 2024-01-22T05:05:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4e000700 1 --2- 172.21.15.49:0/3886195738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e50155880 0x7f1e500a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4ea00700 1 --2- 172.21.15.49:0/3886195738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e500a7260 0x7f1e500aa5e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1e4000c560 tx=0x7f1e40007d00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e46000700 1 -- 172.21.15.49:0/3886195738 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000ce70 con 0x7f1e500a7260 2024-01-22T05:05:38.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e46000700 1 -- 172.21.15.49:0/3886195738 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e400072e0 con 0x7f1e500a7260 2024-01-22T05:05:38.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.960+0000 7f1e4fe00700 1 -- 172.21.15.49:0/3886195738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e500ab230 con 0x7f1e500a7260 2024-01-22T05:05:38.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.964+0000 7f1e46000700 1 -- 172.21.15.49:0/3886195738 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40007660 con 0x7f1e500a7260 2024-01-22T05:05:38.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.964+0000 7f1e4fe00700 1 -- 172.21.15.49:0/3886195738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e500ab7f0 con 0x7f1e500a7260 2024-01-22T05:05:38.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.964+0000 7f1e4fe00700 1 -- 172.21.15.49:0/3886195738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e5005fd40 con 0x7f1e500a7260 2024-01-22T05:05:38.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.964+0000 7f1e46000700 1 -- 172.21.15.49:0/3886195738 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1e400059b0 con 0x7f1e500a7260 2024-01-22T05:05:38.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.968+0000 7f1e46000700 1 --2- 172.21.15.49:0/3886195738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e2805a540 0x7f1e2805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:38.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.968+0000 7f1e46000700 1 -- 172.21.15.49:0/3886195738 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f1e40073d10 con 0x7f1e500a7260 2024-01-22T05:05:38.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.968+0000 7f1e4e000700 1 --2- 172.21.15.49:0/3886195738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e2805a540 0x7f1e2805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:38.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.968+0000 7f1e4e000700 1 --2- 172.21.15.49:0/3886195738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e2805a540 0x7f1e2805ca00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f1e38007fd0 tx=0x7f1e38007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:38.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:38.976+0000 7f1e46000700 1 -- 172.21.15.49:0/3886195738 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1e40079020 con 0x7f1e500a7260 2024-01-22T05:05:39.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.140+0000 7f1e4fe00700 1 -- 172.21.15.49:0/3886195738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e50046800 con 0x7f1e500a7260 2024-01-22T05:05:39.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.144+0000 7f1e46000700 1 -- 172.21.15.49:0/3886195738 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13948 (secure 0 0 0) 0x7f1e40047620 con 0x7f1e500a7260 2024-01-22T05:05:39.147 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:39.147 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":36,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:05:35.510600+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:05:39.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.148+0000 7f1e4fe00700 1 -- 172.21.15.49:0/3886195738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e2805a540 msgr2=0x7f1e2805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:39.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.148+0000 7f1e4fe00700 1 --2- 172.21.15.49:0/3886195738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e2805a540 0x7f1e2805ca00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f1e38007fd0 tx=0x7f1e38007bd0).stop 2024-01-22T05:05:39.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.148+0000 7f1e4fe00700 1 -- 172.21.15.49:0/3886195738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e500a7260 msgr2=0x7f1e500aa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:39.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.148+0000 7f1e4fe00700 1 --2- 172.21.15.49:0/3886195738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e500a7260 0x7f1e500aa5e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1e4000c560 tx=0x7f1e40007d00).stop 2024-01-22T05:05:39.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.148+0000 7f1e4fe00700 1 -- 172.21.15.49:0/3886195738 shutdown_connections 2024-01-22T05:05:39.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.148+0000 7f1e4fe00700 1 --2- 172.21.15.49:0/3886195738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e2805a540 0x7f1e2805ca00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.148+0000 7f1e4fe00700 1 --2- 172.21.15.49:0/3886195738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e50155c60 0x7f1e500a5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.148+0000 7f1e4fe00700 1 --2- 172.21.15.49:0/3886195738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e50155880 0x7f1e500a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.148+0000 7f1e4fe00700 1 --2- 172.21.15.49:0/3886195738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e500a7260 0x7f1e500aa5e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.148+0000 7f1e4fe00700 1 -- 172.21.15.49:0/3886195738 >> 172.21.15.49:0/3886195738 conn(0x7f1e500c6530 msgr2=0x7f1e50156110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:39.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.148+0000 7f1e4fe00700 1 -- 172.21.15.49:0/3886195738 shutdown_connections 2024-01-22T05:05:39.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.148+0000 7f1e4fe00700 1 -- 172.21.15.49:0/3886195738 wait complete. 2024-01-22T05:05:39.176 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:05:39.176 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:05:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.336+0000 7f6b1ac00700 1 Processor -- start 2024-01-22T05:05:39.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.336+0000 7f6b1ac00700 1 -- start start 2024-01-22T05:05:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b1ac00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6b140a8c20 0x7f6b140c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b1ac00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c1ac0 0x7f6b140bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b1ac00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6b140bc9c0 0x7f6b14068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b1ac00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b14158650 con 0x7f6b140bc9c0 2024-01-22T05:05:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b1ac00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b140c1f20 con 0x7f6b140a8c20 2024-01-22T05:05:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b1ac00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140bd170 con 0x7f6b140c1ac0 2024-01-22T05:05:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b13e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6b140a8c20 0x7f6b140c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b18c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6b140bc9c0 0x7f6b14068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b13400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c1ac0 0x7f6b140bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b13e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6b140a8c20 0x7f6b140c15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:49910/0 (socket says 172.21.15.49:49910) 2024-01-22T05:05:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b13e00700 1 -- 172.21.15.49:0/2146322300 learned_addr learned my addr 172.21.15.49:0/2146322300 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:39.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b13e00700 1 -- 172.21.15.49:0/2146322300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c1ac0 msgr2=0x7f6b140bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:39.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b13e00700 1 --2- 172.21.15.49:0/2146322300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c1ac0 0x7f6b140bc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b13e00700 1 -- 172.21.15.49:0/2146322300 >> v2:172.21.15.49:3300/0 conn(0x7f6b140bc9c0 msgr2=0x7f6b14068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:39.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b13e00700 1 --2- 172.21.15.49:0/2146322300 >> v2:172.21.15.49:3300/0 conn(0x7f6b140bc9c0 0x7f6b14068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.340+0000 7f6b13e00700 1 -- 172.21.15.49:0/2146322300 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b14067c30 con 0x7f6b140a8c20 2024-01-22T05:05:39.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.344+0000 7f6b13e00700 1 --2- 172.21.15.49:0/2146322300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b140a8c20 0x7f6b140c15d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f6b140c4300 tx=0x7f6b040090f0).ready entity=mon.1 client_cookie=ee1c98b1766abe30 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.344+0000 7f6b12a00700 1 -- 172.21.15.49:0/2146322300 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0400f510 con 0x7f6b140a8c20 2024-01-22T05:05:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.344+0000 7f6b12a00700 1 -- 172.21.15.49:0/2146322300 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0400f670 con 0x7f6b140a8c20 2024-01-22T05:05:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.344+0000 7f6b12a00700 1 -- 172.21.15.49:0/2146322300 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0400f9f0 con 0x7f6b140a8c20 2024-01-22T05:05:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.344+0000 7f6b1ac00700 1 -- 172.21.15.49:0/2146322300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b140a8c20 msgr2=0x7f6b140c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.344+0000 7f6b1ac00700 1 --2- 172.21.15.49:0/2146322300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b140a8c20 0x7f6b140c15d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f6b140c4300 tx=0x7f6b040090f0).stop 2024-01-22T05:05:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.344+0000 7f6b1ac00700 1 -- 172.21.15.49:0/2146322300 shutdown_connections 2024-01-22T05:05:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.344+0000 7f6b1ac00700 1 --2- 172.21.15.49:0/2146322300 >> v2:172.21.15.49:3300/0 conn(0x7f6b140bc9c0 0x7f6b14068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.344+0000 7f6b1ac00700 1 --2- 172.21.15.49:0/2146322300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c1ac0 0x7f6b140bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.344+0000 7f6b1ac00700 1 --2- 172.21.15.49:0/2146322300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b140a8c20 0x7f6b140c15d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.344+0000 7f6b1ac00700 1 -- 172.21.15.49:0/2146322300 >> 172.21.15.49:0/2146322300 conn(0x7f6b14062cb0 msgr2=0x7f6b140c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:39.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.344+0000 7f6b1ac00700 1 -- 172.21.15.49:0/2146322300 shutdown_connections 2024-01-22T05:05:39.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.344+0000 7f6b1ac00700 1 -- 172.21.15.49:0/2146322300 wait complete. 2024-01-22T05:05:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.348+0000 7f6b1ac00700 1 Processor -- start 2024-01-22T05:05:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.348+0000 7f6b1ac00700 1 -- start start 2024-01-22T05:05:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b1ac00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b140a8c20 0x7f6b1414d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b1ac00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b140bc9c0 0x7f6b140c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:39.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b1ac00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c1ac0 0x7f6b140c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b1ac00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140c6740 con 0x7f6b140a8c20 2024-01-22T05:05:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b1ac00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b14169070 con 0x7f6b140bc9c0 2024-01-22T05:05:39.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b1ac00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b141681f0 con 0x7f6b140c1ac0 2024-01-22T05:05:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b13e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b140a8c20 0x7f6b1414d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b13e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b140a8c20 0x7f6b1414d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35906/0 (socket says 172.21.15.49:35906) 2024-01-22T05:05:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b13e00700 1 -- 172.21.15.49:0/1533789142 learned_addr learned my addr 172.21.15.49:0/1533789142 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b13400700 1 --2- 172.21.15.49:0/1533789142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b140bc9c0 0x7f6b140c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b18c00700 1 --2- 172.21.15.49:0/1533789142 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c1ac0 0x7f6b140c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b13e00700 1 -- 172.21.15.49:0/1533789142 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c1ac0 msgr2=0x7f6b140c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b13e00700 1 --2- 172.21.15.49:0/1533789142 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c1ac0 0x7f6b140c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b13e00700 1 -- 172.21.15.49:0/1533789142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b140bc9c0 msgr2=0x7f6b140c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:39.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b13e00700 1 --2- 172.21.15.49:0/1533789142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b140bc9c0 0x7f6b140c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b13e00700 1 -- 172.21.15.49:0/1533789142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b04009370 con 0x7f6b140a8c20 2024-01-22T05:05:39.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b18c00700 1 --2- 172.21.15.49:0/1533789142 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c1ac0 0x7f6b140c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:39.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b13e00700 1 --2- 172.21.15.49:0/1533789142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b140a8c20 0x7f6b1414d9c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f6b04006fd0 tx=0x7f6b04017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:39.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b0b400700 1 -- 172.21.15.49:0/1533789142 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0400f7e0 con 0x7f6b140a8c20 2024-01-22T05:05:39.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b0b400700 1 -- 172.21.15.49:0/1533789142 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0400f940 con 0x7f6b140a8c20 2024-01-22T05:05:39.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b1ac00700 1 -- 172.21.15.49:0/1533789142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b14168460 con 0x7f6b140a8c20 2024-01-22T05:05:39.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b0b400700 1 -- 172.21.15.49:0/1533789142 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0401c650 con 0x7f6b140a8c20 2024-01-22T05:05:39.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.352+0000 7f6b1ac00700 1 -- 172.21.15.49:0/1533789142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b14168a20 con 0x7f6b140a8c20 2024-01-22T05:05:39.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.356+0000 7f6b1ac00700 1 -- 172.21.15.49:0/1533789142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b140c0c00 con 0x7f6b140a8c20 2024-01-22T05:05:39.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.356+0000 7f6b0b400700 1 -- 172.21.15.49:0/1533789142 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6b0401ca40 con 0x7f6b140a8c20 2024-01-22T05:05:39.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.360+0000 7f6b0b400700 1 --2- 172.21.15.49:0/1533789142 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6aec05a510 0x7f6aec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:39.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.360+0000 7f6b0b400700 1 -- 172.21.15.49:0/1533789142 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f6b04076330 con 0x7f6b140a8c20 2024-01-22T05:05:39.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.360+0000 7f6b13400700 1 --2- 172.21.15.49:0/1533789142 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6aec05a510 0x7f6aec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:39.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.360+0000 7f6b13400700 1 --2- 172.21.15.49:0/1533789142 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6aec05a510 0x7f6aec05c9d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f6b14154ff0 tx=0x7f6afc006f40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:39.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.364+0000 7f6b0b400700 1 -- 172.21.15.49:0/1533789142 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6b04049c40 con 0x7f6b140a8c20 2024-01-22T05:05:39.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.528+0000 7f6b1ac00700 1 -- 172.21.15.49:0/1533789142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6b14067f10 con 0x7f6b140a8c20 2024-01-22T05:05:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.528+0000 7f6b0b400700 1 -- 172.21.15.49:0/1533789142 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v36) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6b040200b0 con 0x7f6b140a8c20 2024-01-22T05:05:39.533 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:05:39.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.532+0000 7f6b1ac00700 1 -- 172.21.15.49:0/1533789142 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6aec05a510 msgr2=0x7f6aec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:39.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.532+0000 7f6b1ac00700 1 --2- 172.21.15.49:0/1533789142 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6aec05a510 0x7f6aec05c9d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f6b14154ff0 tx=0x7f6afc006f40).stop 2024-01-22T05:05:39.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.532+0000 7f6b1ac00700 1 -- 172.21.15.49:0/1533789142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b140a8c20 msgr2=0x7f6b1414d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:39.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.532+0000 7f6b1ac00700 1 --2- 172.21.15.49:0/1533789142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b140a8c20 0x7f6b1414d9c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f6b04006fd0 tx=0x7f6b04017000).stop 2024-01-22T05:05:39.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.532+0000 7f6b1ac00700 1 -- 172.21.15.49:0/1533789142 shutdown_connections 2024-01-22T05:05:39.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.532+0000 7f6b1ac00700 1 --2- 172.21.15.49:0/1533789142 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6aec05a510 0x7f6aec05c9d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.532+0000 7f6b1ac00700 1 --2- 172.21.15.49:0/1533789142 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b140c1ac0 0x7f6b140c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.532+0000 7f6b1ac00700 1 --2- 172.21.15.49:0/1533789142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b140bc9c0 0x7f6b140c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.532+0000 7f6b1ac00700 1 --2- 172.21.15.49:0/1533789142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b140a8c20 0x7f6b1414d9c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.532+0000 7f6b1ac00700 1 -- 172.21.15.49:0/1533789142 >> 172.21.15.49:0/1533789142 conn(0x7f6b14062cb0 msgr2=0x7f6b140bba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:39.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.532+0000 7f6b1ac00700 1 -- 172.21.15.49:0/1533789142 shutdown_connections 2024-01-22T05:05:39.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.532+0000 7f6b1ac00700 1 -- 172.21.15.49:0/1533789142 wait complete. 2024-01-22T05:05:39.563 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:05:39.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.732+0000 7f3928c00700 1 Processor -- start 2024-01-22T05:05:39.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.732+0000 7f3928c00700 1 -- start start 2024-01-22T05:05:39.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.736+0000 7f3928c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f392415c2d0 0x7f3924065900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:39.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.736+0000 7f3928c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3924065df0 0x7f3924066240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:39.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.736+0000 7f3928c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3924069600 con 0x7f3924067a90 2024-01-22T05:05:39.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.736+0000 7f3928c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39241561a0 con 0x7f392415c2d0 2024-01-22T05:05:39.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.736+0000 7f3928c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3924068dd0 con 0x7f3924065df0 2024-01-22T05:05:39.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.736+0000 7f3923400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3924067a90 0x7f392415bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59292/0 (socket says 172.21.15.49:59292) 2024-01-22T05:05:39.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.736+0000 7f3923400700 1 -- 172.21.15.49:0/440387787 learned_addr learned my addr 172.21.15.49:0/440387787 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:39.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.736+0000 7f3922a00700 1 --2- 172.21.15.49:0/440387787 >> v2:172.21.15.110:3300/0 conn(0x7f392415c2d0 0x7f3924065900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:39.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.736+0000 7f3923e00700 1 --2- 172.21.15.49:0/440387787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3924065df0 0x7f3924066240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:39.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.736+0000 7f3922000700 1 -- 172.21.15.49:0/440387787 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322921031 0 0) 0x7f3924069600 con 0x7f3924067a90 2024-01-22T05:05:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3922000700 1 -- 172.21.15.49:0/440387787 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39040033f0 con 0x7f3924067a90 2024-01-22T05:05:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3922a00700 1 -- 172.21.15.49:0/440387787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3924065df0 msgr2=0x7f3924066240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3922a00700 1 --2- 172.21.15.49:0/440387787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3924065df0 0x7f3924066240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3922a00700 1 -- 172.21.15.49:0/440387787 >> v1:172.21.15.49:6789/0 conn(0x7f3924067a90 legacy=0x7f392415bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3922a00700 1 -- 172.21.15.49:0/440387787 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39240a90f0 con 0x7f392415c2d0 2024-01-22T05:05:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3922a00700 1 --2- 172.21.15.49:0/440387787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f392415c2d0 0x7f3924065900 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f390c009760 tx=0x7f390c009060).ready entity=mon.1 client_cookie=b99e07fa05c607da server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:39.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3922000700 1 -- 172.21.15.49:0/440387787 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c00d4a0 con 0x7f392415c2d0 2024-01-22T05:05:39.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3922000700 1 -- 172.21.15.49:0/440387787 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c00d600 con 0x7f392415c2d0 2024-01-22T05:05:39.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3922000700 1 -- 172.21.15.49:0/440387787 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c00d980 con 0x7f392415c2d0 2024-01-22T05:05:39.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3928c00700 1 -- 172.21.15.49:0/440387787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f392415c2d0 msgr2=0x7f3924065900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:39.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3928c00700 1 --2- 172.21.15.49:0/440387787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f392415c2d0 0x7f3924065900 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f390c009760 tx=0x7f390c009060).stop 2024-01-22T05:05:39.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3928c00700 1 -- 172.21.15.49:0/440387787 shutdown_connections 2024-01-22T05:05:39.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3928c00700 1 --2- 172.21.15.49:0/440387787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3924065df0 0x7f3924066240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3928c00700 1 --2- 172.21.15.49:0/440387787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f392415c2d0 0x7f3924065900 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3928c00700 1 -- 172.21.15.49:0/440387787 >> 172.21.15.49:0/440387787 conn(0x7f39240c6fc0 msgr2=0x7f39240c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:39.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3928c00700 1 -- 172.21.15.49:0/440387787 shutdown_connections 2024-01-22T05:05:39.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.740+0000 7f3928c00700 1 -- 172.21.15.49:0/440387787 wait complete. 2024-01-22T05:05:39.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.744+0000 7f3928c00700 1 Processor -- start 2024-01-22T05:05:39.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.744+0000 7f3928c00700 1 -- start start 2024-01-22T05:05:39.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.744+0000 7f3928c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3924065df0 0x7f3924153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:39.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.744+0000 7f3928c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3924067a90 0x7f3924169150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:39.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.744+0000 7f3928c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392415c2d0 0x7f3924169640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:39.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.744+0000 7f3928c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39240ab120 con 0x7f392415c2d0 2024-01-22T05:05:39.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.744+0000 7f3928c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39240be4a0 con 0x7f3924065df0 2024-01-22T05:05:39.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.744+0000 7f3928c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39240aa510 con 0x7f3924067a90 2024-01-22T05:05:39.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f3923e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392415c2d0 0x7f3924169640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:39.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f3923e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392415c2d0 0x7f3924169640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35912/0 (socket says 172.21.15.49:35912) 2024-01-22T05:05:39.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f3923e00700 1 -- 172.21.15.49:0/13341508 learned_addr learned my addr 172.21.15.49:0/13341508 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:39.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f3922a00700 1 --2- 172.21.15.49:0/13341508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3924067a90 0x7f3924169150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:39.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f3923400700 1 --2- 172.21.15.49:0/13341508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3924065df0 0x7f3924153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:39.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f3923e00700 1 -- 172.21.15.49:0/13341508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3924067a90 msgr2=0x7f3924169150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:39.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f3923e00700 1 --2- 172.21.15.49:0/13341508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3924067a90 0x7f3924169150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f3923e00700 1 -- 172.21.15.49:0/13341508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3924065df0 msgr2=0x7f3924153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:39.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f3923e00700 1 --2- 172.21.15.49:0/13341508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3924065df0 0x7f3924153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f3923e00700 1 -- 172.21.15.49:0/13341508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c0092a0 con 0x7f392415c2d0 2024-01-22T05:05:39.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f3923400700 1 --2- 172.21.15.49:0/13341508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3924065df0 0x7f3924153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:39.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f3923e00700 1 --2- 172.21.15.49:0/13341508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392415c2d0 0x7f3924169640 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f391c009e90 tx=0x7f391c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:39.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f391aa00700 1 -- 172.21.15.49:0/13341508 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00cc20 con 0x7f392415c2d0 2024-01-22T05:05:39.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f3928c00700 1 -- 172.21.15.49:0/13341508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39240aa7f0 con 0x7f392415c2d0 2024-01-22T05:05:39.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f391aa00700 1 -- 172.21.15.49:0/13341508 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c00f040 con 0x7f392415c2d0 2024-01-22T05:05:39.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f391aa00700 1 -- 172.21.15.49:0/13341508 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c013400 con 0x7f392415c2d0 2024-01-22T05:05:39.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.748+0000 7f3928c00700 1 -- 172.21.15.49:0/13341508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39240aadb0 con 0x7f392415c2d0 2024-01-22T05:05:39.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.752+0000 7f3928c00700 1 -- 172.21.15.49:0/13341508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39240a8b60 con 0x7f392415c2d0 2024-01-22T05:05:39.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.752+0000 7f391aa00700 1 -- 172.21.15.49:0/13341508 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f391c0137b0 con 0x7f392415c2d0 2024-01-22T05:05:39.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.752+0000 7f391aa00700 1 --2- 172.21.15.49:0/13341508 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f38fc05a510 0x7f38fc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:39.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.752+0000 7f391aa00700 1 -- 172.21.15.49:0/13341508 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f391c074f60 con 0x7f392415c2d0 2024-01-22T05:05:39.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.752+0000 7f3923400700 1 --2- 172.21.15.49:0/13341508 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f38fc05a510 0x7f38fc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:39.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.756+0000 7f3923400700 1 --2- 172.21.15.49:0/13341508 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f38fc05a510 0x7f38fc05c9d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f3914001360 tx=0x7f3914009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:39.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.760+0000 7f391aa00700 1 -- 172.21.15.49:0/13341508 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f391c0a3b00 con 0x7f392415c2d0 2024-01-22T05:05:39.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.924+0000 7f3928c00700 1 -- 172.21.15.49:0/13341508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3924047060 con 0x7f392415c2d0 2024-01-22T05:05:39.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.924+0000 7f391aa00700 1 -- 172.21.15.49:0/13341508 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7f39240a8b60 con 0x7f392415c2d0 2024-01-22T05:05:39.929 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:05:39.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.928+0000 7f3928c00700 1 -- 172.21.15.49:0/13341508 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f38fc05a510 msgr2=0x7f38fc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:39.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.928+0000 7f3928c00700 1 --2- 172.21.15.49:0/13341508 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f38fc05a510 0x7f38fc05c9d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f3914001360 tx=0x7f3914009040).stop 2024-01-22T05:05:39.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.928+0000 7f3928c00700 1 -- 172.21.15.49:0/13341508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392415c2d0 msgr2=0x7f3924169640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:39.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.928+0000 7f3928c00700 1 --2- 172.21.15.49:0/13341508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392415c2d0 0x7f3924169640 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f391c009e90 tx=0x7f391c00b040).stop 2024-01-22T05:05:39.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.928+0000 7f3928c00700 1 -- 172.21.15.49:0/13341508 shutdown_connections 2024-01-22T05:05:39.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.928+0000 7f3928c00700 1 --2- 172.21.15.49:0/13341508 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f38fc05a510 0x7f38fc05c9d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.928+0000 7f3928c00700 1 --2- 172.21.15.49:0/13341508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392415c2d0 0x7f3924169640 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.928+0000 7f3928c00700 1 --2- 172.21.15.49:0/13341508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3924067a90 0x7f3924169150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.928+0000 7f3928c00700 1 --2- 172.21.15.49:0/13341508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3924065df0 0x7f3924153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:39.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.928+0000 7f3928c00700 1 -- 172.21.15.49:0/13341508 >> 172.21.15.49:0/13341508 conn(0x7f39240c6fc0 msgr2=0x7f392415bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:39.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.928+0000 7f3928c00700 1 -- 172.21.15.49:0/13341508 shutdown_connections 2024-01-22T05:05:39.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:39.928+0000 7f3928c00700 1 -- 172.21.15.49:0/13341508 wait complete. 2024-01-22T05:05:39.955 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:05:40.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.116+0000 7f2c8bc00700 1 Processor -- start 2024-01-22T05:05:40.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.116+0000 7f2c8bc00700 1 -- start start 2024-01-22T05:05:40.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.116+0000 7f2c8bc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2c84155d20 0x7f2c84065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:40.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.116+0000 7f2c8bc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c840a8e50 0x7f2c840c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:40.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.116+0000 7f2c8bc00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c840c1a40 con 0x7f2c84066070 2024-01-22T05:05:40.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.116+0000 7f2c8bc00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c84159310 con 0x7f2c84155d20 2024-01-22T05:05:40.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.116+0000 7f2c8bc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840c13f0 con 0x7f2c840a8e50 2024-01-22T05:05:40.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.116+0000 7f2c89200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2c84155d20 0x7f2c84065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:40.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.116+0000 7f2c89200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2c84155d20 0x7f2c84065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35926/0 (socket says 172.21.15.49:35926) 2024-01-22T05:05:40.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.116+0000 7f2c89200700 1 -- 172.21.15.49:0/776376047 learned_addr learned my addr 172.21.15.49:0/776376047 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:40.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c89c00700 1 --2- 172.21.15.49:0/776376047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c840a8e50 0x7f2c840c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:40.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c89200700 1 -- 172.21.15.49:0/776376047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c840a8e50 msgr2=0x7f2c840c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:40.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c89200700 1 --2- 172.21.15.49:0/776376047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c840a8e50 0x7f2c840c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:40.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c89200700 1 -- 172.21.15.49:0/776376047 >> v1:172.21.15.110:6789/0 conn(0x7f2c84066070 legacy=0x7f2c840a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:40.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c89200700 1 -- 172.21.15.49:0/776376047 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c840c16d0 con 0x7f2c84155d20 2024-01-22T05:05:40.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c89c00700 1 --2- 172.21.15.49:0/776376047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c840a8e50 0x7f2c840c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:05:40.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c89200700 1 --2- 172.21.15.49:0/776376047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c84155d20 0x7f2c84065b80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f2c74006fd0 tx=0x7f2c740090f0).ready entity=mon.0 client_cookie=28131cb6dd385ca8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:40.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c83400700 1 -- 172.21.15.49:0/776376047 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7400b600 con 0x7f2c84155d20 2024-01-22T05:05:40.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c83400700 1 -- 172.21.15.49:0/776376047 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7400b760 con 0x7f2c84155d20 2024-01-22T05:05:40.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c83400700 1 -- 172.21.15.49:0/776376047 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7400bae0 con 0x7f2c84155d20 2024-01-22T05:05:40.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c8bc00700 1 -- 172.21.15.49:0/776376047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c84155d20 msgr2=0x7f2c84065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:40.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c8bc00700 1 --2- 172.21.15.49:0/776376047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c84155d20 0x7f2c84065b80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f2c74006fd0 tx=0x7f2c740090f0).stop 2024-01-22T05:05:40.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c8bc00700 1 -- 172.21.15.49:0/776376047 shutdown_connections 2024-01-22T05:05:40.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c8bc00700 1 --2- 172.21.15.49:0/776376047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c840a8e50 0x7f2c840c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:40.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c8bc00700 1 --2- 172.21.15.49:0/776376047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c84155d20 0x7f2c84065b80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:40.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c8bc00700 1 -- 172.21.15.49:0/776376047 >> 172.21.15.49:0/776376047 conn(0x7f2c840c6540 msgr2=0x7f2c840c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:40.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c8bc00700 1 -- 172.21.15.49:0/776376047 shutdown_connections 2024-01-22T05:05:40.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.120+0000 7f2c8bc00700 1 -- 172.21.15.49:0/776376047 wait complete. 2024-01-22T05:05:40.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.124+0000 7f2c8bc00700 1 Processor -- start 2024-01-22T05:05:40.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.124+0000 7f2c8bc00700 1 -- start start 2024-01-22T05:05:40.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c8bc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c84066070 0x7f2c841512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:40.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c8bc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c840a8e50 0x7f2c840a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:40.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c8bc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c84155d20 0x7f2c840a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:40.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c8bc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840a9f90 con 0x7f2c84066070 2024-01-22T05:05:40.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c8bc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c84159450 con 0x7f2c840a8e50 2024-01-22T05:05:40.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c8bc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c84145d80 con 0x7f2c84155d20 2024-01-22T05:05:40.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c89200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c84066070 0x7f2c841512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:40.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c89200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c84066070 0x7f2c841512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35938/0 (socket says 172.21.15.49:35938) 2024-01-22T05:05:40.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c89200700 1 -- 172.21.15.49:0/2198593308 learned_addr learned my addr 172.21.15.49:0/2198593308 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:40.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c89c00700 1 --2- 172.21.15.49:0/2198593308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c84155d20 0x7f2c840a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:40.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c83e00700 1 --2- 172.21.15.49:0/2198593308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c840a8e50 0x7f2c840a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:40.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c89200700 1 -- 172.21.15.49:0/2198593308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c84155d20 msgr2=0x7f2c840a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:40.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c89200700 1 --2- 172.21.15.49:0/2198593308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c84155d20 0x7f2c840a9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:40.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c89200700 1 -- 172.21.15.49:0/2198593308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c840a8e50 msgr2=0x7f2c840a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:40.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c89200700 1 --2- 172.21.15.49:0/2198593308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c840a8e50 0x7f2c840a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:40.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c89200700 1 -- 172.21.15.49:0/2198593308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c74009370 con 0x7f2c84066070 2024-01-22T05:05:40.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c83e00700 1 --2- 172.21.15.49:0/2198593308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c840a8e50 0x7f2c840a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:40.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c89200700 1 --2- 172.21.15.49:0/2198593308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c84066070 0x7f2c841512a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f2c74009130 tx=0x7f2c74017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:40.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c7be00700 1 -- 172.21.15.49:0/2198593308 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7400bae0 con 0x7f2c84066070 2024-01-22T05:05:40.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c7be00700 1 -- 172.21.15.49:0/2198593308 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c74000c90 con 0x7f2c84066070 2024-01-22T05:05:40.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c8bc00700 1 -- 172.21.15.49:0/2198593308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c84151790 con 0x7f2c84066070 2024-01-22T05:05:40.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c7be00700 1 -- 172.21.15.49:0/2198593308 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7401b640 con 0x7f2c84066070 2024-01-22T05:05:40.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.128+0000 7f2c8bc00700 1 -- 172.21.15.49:0/2198593308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c841596a0 con 0x7f2c84066070 2024-01-22T05:05:40.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.132+0000 7f2c8bc00700 1 -- 172.21.15.49:0/2198593308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c84047060 con 0x7f2c84066070 2024-01-22T05:05:40.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.132+0000 7f2c7be00700 1 -- 172.21.15.49:0/2198593308 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2c7401b9f0 con 0x7f2c84066070 2024-01-22T05:05:40.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.132+0000 7f2c7be00700 1 --2- 172.21.15.49:0/2198593308 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c5c05a510 0x7f2c5c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:40.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.132+0000 7f2c7be00700 1 -- 172.21.15.49:0/2198593308 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f2c74075ff0 con 0x7f2c84066070 2024-01-22T05:05:40.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.136+0000 7f2c83e00700 1 --2- 172.21.15.49:0/2198593308 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c5c05a510 0x7f2c5c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:40.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.136+0000 7f2c83e00700 1 --2- 172.21.15.49:0/2198593308 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c5c05a510 0x7f2c5c05c9d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f2c840aa1a0 tx=0x7f2c6c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:40.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.140+0000 7f2c7be00700 1 -- 172.21.15.49:0/2198593308 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2c74049940 con 0x7f2c84066070 2024-01-22T05:05:40.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.308+0000 7f2c8bc00700 1 -- 172.21.15.49:0/2198593308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2c84046800 con 0x7f2c84066070 2024-01-22T05:05:40.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.308+0000 7f2c7be00700 1 -- 172.21.15.49:0/2198593308 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2c7404cf60 con 0x7f2c84066070 2024-01-22T05:05:40.311 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:40.311 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-22T05:05:40.311 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:40.312 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-01-22T05:05:40.312 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2024-01-22T05:05:40.312 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:05:40.312 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:05:40.312 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2024-01-22T05:05:40.312 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2024-01-22T05:05:40.312 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:05:40.312 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-22T05:05:40.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.312+0000 7f2c8bc00700 1 -- 172.21.15.49:0/2198593308 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c5c05a510 msgr2=0x7f2c5c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:40.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.312+0000 7f2c8bc00700 1 --2- 172.21.15.49:0/2198593308 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c5c05a510 0x7f2c5c05c9d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f2c840aa1a0 tx=0x7f2c6c009040).stop 2024-01-22T05:05:40.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.312+0000 7f2c8bc00700 1 -- 172.21.15.49:0/2198593308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c84066070 msgr2=0x7f2c841512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:40.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.312+0000 7f2c8bc00700 1 --2- 172.21.15.49:0/2198593308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c84066070 0x7f2c841512a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f2c74009130 tx=0x7f2c74017000).stop 2024-01-22T05:05:40.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.312+0000 7f2c8bc00700 1 -- 172.21.15.49:0/2198593308 shutdown_connections 2024-01-22T05:05:40.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.312+0000 7f2c8bc00700 1 --2- 172.21.15.49:0/2198593308 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c5c05a510 0x7f2c5c05c9d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:40.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.312+0000 7f2c8bc00700 1 --2- 172.21.15.49:0/2198593308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c84155d20 0x7f2c840a9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:40.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.312+0000 7f2c8bc00700 1 --2- 172.21.15.49:0/2198593308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c840a8e50 0x7f2c840a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:40.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.312+0000 7f2c8bc00700 1 --2- 172.21.15.49:0/2198593308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c84066070 0x7f2c841512a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:40.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.312+0000 7f2c8bc00700 1 -- 172.21.15.49:0/2198593308 >> 172.21.15.49:0/2198593308 conn(0x7f2c840c6540 msgr2=0x7f2c840685f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:40.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.312+0000 7f2c8bc00700 1 -- 172.21.15.49:0/2198593308 shutdown_connections 2024-01-22T05:05:40.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.312+0000 7f2c8bc00700 1 -- 172.21.15.49:0/2198593308 wait complete. 2024-01-22T05:05:40.338 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:05:40.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:05:40.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.504+0000 7f7c5de00700 1 Processor -- start 2024-01-22T05:05:40.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.508+0000 7f7c5de00700 1 -- start start 2024-01-22T05:05:40.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.512+0000 7f7c5de00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c58153d20 0x7f7c58068880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:40.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.512+0000 7f7c5de00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c580c2c30 con 0x7f7c58153940 2024-01-22T05:05:40.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.512+0000 7f7c5de00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c580c23e0 con 0x7f7c58068d70 2024-01-22T05:05:40.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.512+0000 7f7c5de00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c580c2670 con 0x7f7c58153d20 2024-01-22T05:05:40.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.512+0000 7f7c56a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7c58153940 0x7f7c580c1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59296/0 (socket says 172.21.15.49:59296) 2024-01-22T05:05:40.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.512+0000 7f7c56a00700 1 -- 172.21.15.49:0/168998115 learned_addr learned my addr 172.21.15.49:0/168998115 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:40.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.512+0000 7f7c56000700 1 --2- 172.21.15.49:0/168998115 >> v2:172.21.15.49:3300/0 conn(0x7f7c58153d20 0x7f7c58068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:40.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.512+0000 7f7c55600700 1 -- 172.21.15.49:0/168998115 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435026151 0 0) 0x7f7c580c2c30 con 0x7f7c58153940 2024-01-22T05:05:40.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.512+0000 7f7c55600700 1 -- 172.21.15.49:0/168998115 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c380033f0 con 0x7f7c58153940 2024-01-22T05:05:40.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.512+0000 7f7c55600700 1 -- 172.21.15.49:0/168998115 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416942806 0 0) 0x7f7c580c23e0 con 0x7f7c58068d70 2024-01-22T05:05:40.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.512+0000 7f7c55600700 1 -- 172.21.15.49:0/168998115 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c580c2c30 con 0x7f7c58068d70 2024-01-22T05:05:40.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.512+0000 7f7c56000700 1 -- 172.21.15.49:0/168998115 >> v1:172.21.15.110:6789/0 conn(0x7f7c58068d70 legacy=0x7f7c58063e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:40.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.512+0000 7f7c56000700 1 -- 172.21.15.49:0/168998115 >> v1:172.21.15.49:6789/0 conn(0x7f7c58153940 legacy=0x7f7c580c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:40.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.512+0000 7f7c56000700 1 -- 172.21.15.49:0/168998115 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c580c2950 con 0x7f7c58153d20 2024-01-22T05:05:40.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.512+0000 7f7c56000700 1 --2- 172.21.15.49:0/168998115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c58153d20 0x7f7c58068880 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f7c40009760 tx=0x7f7c40009060).ready entity=mon.0 client_cookie=698e147bb78ed2b7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:40.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.516+0000 7f7c55600700 1 -- 172.21.15.49:0/168998115 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000d4a0 con 0x7f7c58153d20 2024-01-22T05:05:40.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.516+0000 7f7c55600700 1 -- 172.21.15.49:0/168998115 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4000d600 con 0x7f7c58153d20 2024-01-22T05:05:40.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.516+0000 7f7c55600700 1 -- 172.21.15.49:0/168998115 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000d980 con 0x7f7c58153d20 2024-01-22T05:05:40.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.516+0000 7f7c5de00700 1 -- 172.21.15.49:0/168998115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c58153d20 msgr2=0x7f7c58068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:40.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.516+0000 7f7c5de00700 1 --2- 172.21.15.49:0/168998115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c58153d20 0x7f7c58068880 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f7c40009760 tx=0x7f7c40009060).stop 2024-01-22T05:05:40.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.516+0000 7f7c5de00700 1 -- 172.21.15.49:0/168998115 shutdown_connections 2024-01-22T05:05:40.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.516+0000 7f7c5de00700 1 --2- 172.21.15.49:0/168998115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c58153d20 0x7f7c58068880 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:40.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.516+0000 7f7c5de00700 1 -- 172.21.15.49:0/168998115 >> 172.21.15.49:0/168998115 conn(0x7f7c580c7630 msgr2=0x7f7c580c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:40.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.516+0000 7f7c5de00700 1 -- 172.21.15.49:0/168998115 shutdown_connections 2024-01-22T05:05:40.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.516+0000 7f7c5de00700 1 -- 172.21.15.49:0/168998115 wait complete. 2024-01-22T05:05:40.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c5de00700 1 Processor -- start 2024-01-22T05:05:40.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c5de00700 1 -- start start 2024-01-22T05:05:40.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c5de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c58068d70 0x7f7c58153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:40.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c5de00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c58153940 0x7f7c580bfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:40.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c5de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c58153d20 0x7f7c580a9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:40.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c5de00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580a8d90 con 0x7f7c58153d20 2024-01-22T05:05:40.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c5de00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580bedf0 con 0x7f7c58068d70 2024-01-22T05:05:40.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c5de00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580a8180 con 0x7f7c58153940 2024-01-22T05:05:40.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c57400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c58153d20 0x7f7c580a9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:40.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c57400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c58153d20 0x7f7c580a9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35952/0 (socket says 172.21.15.49:35952) 2024-01-22T05:05:40.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c57400700 1 -- 172.21.15.49:0/2817625442 learned_addr learned my addr 172.21.15.49:0/2817625442 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c56000700 1 --2- 172.21.15.49:0/2817625442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c58153940 0x7f7c580bfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c56a00700 1 --2- 172.21.15.49:0/2817625442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c58068d70 0x7f7c58153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c57400700 1 -- 172.21.15.49:0/2817625442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c58153940 msgr2=0x7f7c580bfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c57400700 1 --2- 172.21.15.49:0/2817625442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c58153940 0x7f7c580bfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:40.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c57400700 1 -- 172.21.15.49:0/2817625442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c58068d70 msgr2=0x7f7c58153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:40.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c57400700 1 --2- 172.21.15.49:0/2817625442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c58068d70 0x7f7c58153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:40.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c57400700 1 -- 172.21.15.49:0/2817625442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c400092a0 con 0x7f7c58153d20 2024-01-22T05:05:40.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.520+0000 7f7c56a00700 1 --2- 172.21.15.49:0/2817625442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c58068d70 0x7f7c58153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:05:40.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.524+0000 7f7c57400700 1 --2- 172.21.15.49:0/2817625442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c58153d20 0x7f7c580a9220 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f7c5000c7c0 tx=0x7f7c50007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:40.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.524+0000 7f7c4e000700 1 -- 172.21.15.49:0/2817625442 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000a520 con 0x7f7c58153d20 2024-01-22T05:05:40.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.524+0000 7f7c4e000700 1 -- 172.21.15.49:0/2817625442 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5000a680 con 0x7f7c58153d20 2024-01-22T05:05:40.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.524+0000 7f7c4e000700 1 -- 172.21.15.49:0/2817625442 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000aa20 con 0x7f7c58153d20 2024-01-22T05:05:40.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.524+0000 7f7c5de00700 1 -- 172.21.15.49:0/2817625442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c580a8460 con 0x7f7c58153d20 2024-01-22T05:05:40.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.524+0000 7f7c5de00700 1 -- 172.21.15.49:0/2817625442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c580a8a20 con 0x7f7c58153d20 2024-01-22T05:05:40.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.524+0000 7f7c5de00700 1 -- 172.21.15.49:0/2817625442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c580a8f00 con 0x7f7c58153d20 2024-01-22T05:05:40.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.528+0000 7f7c4e000700 1 -- 172.21.15.49:0/2817625442 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7c5001b400 con 0x7f7c58153d20 2024-01-22T05:05:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.528+0000 7f7c4e000700 1 --2- 172.21.15.49:0/2817625442 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c3005a510 0x7f7c3005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:40.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.528+0000 7f7c4e000700 1 -- 172.21.15.49:0/2817625442 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f7c50074420 con 0x7f7c58153d20 2024-01-22T05:05:40.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.528+0000 7f7c56a00700 1 --2- 172.21.15.49:0/2817625442 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c3005a510 0x7f7c3005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.528+0000 7f7c56a00700 1 --2- 172.21.15.49:0/2817625442 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c3005a510 0x7f7c3005c9d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f7c48005750 tx=0x7f7c48009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:40.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.532+0000 7f7c4e000700 1 -- 172.21.15.49:0/2817625442 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7c50047d90 con 0x7f7c58153d20 2024-01-22T05:05:40.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:40.692+0000 7f7c5de00700 1 -- 172.21.15.49:0/2817625442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f7c580bc6c0 con 0x7f7c58153d20 2024-01-22T05:05:41.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.300+0000 7f7c4e000700 1 -- 172.21.15.49:0/2817625442 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 152+0+0 (secure 0 0 0) 0x7f7c5004b3b0 con 0x7f7c58153d20 2024-01-22T05:05:41.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.308+0000 7f7c5de00700 1 -- 172.21.15.49:0/2817625442 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c3005a510 msgr2=0x7f7c3005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:41.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.308+0000 7f7c5de00700 1 --2- 172.21.15.49:0/2817625442 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c3005a510 0x7f7c3005c9d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f7c48005750 tx=0x7f7c48009040).stop 2024-01-22T05:05:41.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.308+0000 7f7c5de00700 1 -- 172.21.15.49:0/2817625442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c58153d20 msgr2=0x7f7c580a9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:41.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.308+0000 7f7c5de00700 1 --2- 172.21.15.49:0/2817625442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c58153d20 0x7f7c580a9220 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f7c5000c7c0 tx=0x7f7c50007f50).stop 2024-01-22T05:05:41.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.308+0000 7f7c5de00700 1 -- 172.21.15.49:0/2817625442 shutdown_connections 2024-01-22T05:05:41.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.308+0000 7f7c5de00700 1 --2- 172.21.15.49:0/2817625442 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c3005a510 0x7f7c3005c9d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:41.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.308+0000 7f7c5de00700 1 --2- 172.21.15.49:0/2817625442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c58153d20 0x7f7c580a9220 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:41.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.308+0000 7f7c5de00700 1 --2- 172.21.15.49:0/2817625442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c58153940 0x7f7c580bfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:41.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.308+0000 7f7c5de00700 1 --2- 172.21.15.49:0/2817625442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c58068d70 0x7f7c58153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:41.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.308+0000 7f7c5de00700 1 -- 172.21.15.49:0/2817625442 >> 172.21.15.49:0/2817625442 conn(0x7f7c580c7630 msgr2=0x7f7c580ac5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:41.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.308+0000 7f7c5de00700 1 -- 172.21.15.49:0/2817625442 shutdown_connections 2024-01-22T05:05:41.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.308+0000 7f7c5de00700 1 -- 172.21.15.49:0/2817625442 wait complete. 2024-01-22T05:05:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-01-22T05:05:41.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:05:41.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.508+0000 7f02a2a00700 1 Processor -- start 2024-01-22T05:05:41.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.508+0000 7f02a2a00700 1 -- start start 2024-01-22T05:05:41.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f02a2a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f029c0c3c80 0x7f029c150d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:41.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f02a2a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f029c064500 0x7f029c0bca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:41.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f02a2a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029c0bc5b0 con 0x7f029c0bddc0 2024-01-22T05:05:41.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f02a2a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c151340 con 0x7f029c064500 2024-01-22T05:05:41.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f02a2a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c151620 con 0x7f029c0c3c80 2024-01-22T05:05:41.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f02a0a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f029c064500 0x7f029c0bca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:41.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f029b400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f029c0bddc0 0x7f029c063df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59298/0 (socket says 172.21.15.49:59298) 2024-01-22T05:05:41.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f029b400700 1 -- 172.21.15.49:0/2105986509 learned_addr learned my addr 172.21.15.49:0/2105986509 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:41.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f029be00700 1 --2- 172.21.15.49:0/2105986509 >> v2:172.21.15.110:3300/0 conn(0x7f029c0c3c80 0x7f029c150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:41.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f02a0a00700 1 -- 172.21.15.49:0/2105986509 >> v2:172.21.15.110:3300/0 conn(0x7f029c0c3c80 msgr2=0x7f029c150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:41.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f02a0a00700 1 --2- 172.21.15.49:0/2105986509 >> v2:172.21.15.110:3300/0 conn(0x7f029c0c3c80 0x7f029c150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:41.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f02a0a00700 1 -- 172.21.15.49:0/2105986509 >> v1:172.21.15.49:6789/0 conn(0x7f029c0bddc0 legacy=0x7f029c063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:41.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f02a0a00700 1 -- 172.21.15.49:0/2105986509 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c151900 con 0x7f029c064500 2024-01-22T05:05:41.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f02a0a00700 1 --2- 172.21.15.49:0/2105986509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029c064500 0x7f029c0bca40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f029c063940 tx=0x7f0294009780).ready entity=mon.0 client_cookie=503e44170ed8cc8e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:41.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f029aa00700 1 -- 172.21.15.49:0/2105986509 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029400bc30 con 0x7f029c064500 2024-01-22T05:05:41.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f029aa00700 1 -- 172.21.15.49:0/2105986509 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029400bd90 con 0x7f029c064500 2024-01-22T05:05:41.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.512+0000 7f029aa00700 1 -- 172.21.15.49:0/2105986509 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294011690 con 0x7f029c064500 2024-01-22T05:05:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.516+0000 7f02a2a00700 1 -- 172.21.15.49:0/2105986509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029c064500 msgr2=0x7f029c0bca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.516+0000 7f02a2a00700 1 --2- 172.21.15.49:0/2105986509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029c064500 0x7f029c0bca40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f029c063940 tx=0x7f0294009780).stop 2024-01-22T05:05:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.516+0000 7f02a2a00700 1 -- 172.21.15.49:0/2105986509 shutdown_connections 2024-01-22T05:05:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.516+0000 7f02a2a00700 1 --2- 172.21.15.49:0/2105986509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029c064500 0x7f029c0bca40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:41.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.516+0000 7f02a2a00700 1 --2- 172.21.15.49:0/2105986509 >> v2:172.21.15.110:3300/0 conn(0x7f029c0c3c80 0x7f029c150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:41.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.516+0000 7f02a2a00700 1 -- 172.21.15.49:0/2105986509 >> 172.21.15.49:0/2105986509 conn(0x7f029c0c40f0 msgr2=0x7f029c0c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:41.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.516+0000 7f02a2a00700 1 -- 172.21.15.49:0/2105986509 shutdown_connections 2024-01-22T05:05:41.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.516+0000 7f02a2a00700 1 -- 172.21.15.49:0/2105986509 wait complete. 2024-01-22T05:05:41.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.520+0000 7f02a2a00700 1 Processor -- start 2024-01-22T05:05:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.520+0000 7f02a2a00700 1 -- start start 2024-01-22T05:05:41.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f02a2a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f029c064500 0x7f029c13ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:41.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f02a2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029c0bddc0 0x7f029c0bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:41.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f02a2a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f029c0c3c80 0x7f029c0c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:41.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f02a2a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0bfa70 con 0x7f029c0bddc0 2024-01-22T05:05:41.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f02a2a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0bfd50 con 0x7f029c0c3c80 2024-01-22T05:05:41.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f02a2a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0c0030 con 0x7f029c064500 2024-01-22T05:05:41.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f029b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029c0bddc0 0x7f029c0bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:41.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f029b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029c0bddc0 0x7f029c0bf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35968/0 (socket says 172.21.15.49:35968) 2024-01-22T05:05:41.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f029b400700 1 -- 172.21.15.49:0/3016188631 learned_addr learned my addr 172.21.15.49:0/3016188631 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:41.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f02a0a00700 1 --2- 172.21.15.49:0/3016188631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f029c0c3c80 0x7f029c0c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:41.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f029be00700 1 --2- 172.21.15.49:0/3016188631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f029c064500 0x7f029c13ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:41.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f029b400700 1 -- 172.21.15.49:0/3016188631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f029c064500 msgr2=0x7f029c13ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:41.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f029b400700 1 --2- 172.21.15.49:0/3016188631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f029c064500 0x7f029c13ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:41.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f029b400700 1 -- 172.21.15.49:0/3016188631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f029c0c3c80 msgr2=0x7f029c0c0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f029b400700 1 --2- 172.21.15.49:0/3016188631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f029c0c3c80 0x7f029c0c0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f029b400700 1 -- 172.21.15.49:0/3016188631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0294009a20 con 0x7f029c0bddc0 2024-01-22T05:05:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f029b400700 1 --2- 172.21.15.49:0/3016188631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029c0bddc0 0x7f029c0bf0b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f0284007fd0 tx=0x7f0284007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f0293400700 1 -- 172.21.15.49:0/3016188631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02840072e0 con 0x7f029c0bddc0 2024-01-22T05:05:41.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f0293400700 1 -- 172.21.15.49:0/3016188631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0284007440 con 0x7f029c0bddc0 2024-01-22T05:05:41.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f02a2a00700 1 -- 172.21.15.49:0/3016188631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029c0c0310 con 0x7f029c0bddc0 2024-01-22T05:05:41.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f0293400700 1 -- 172.21.15.49:0/3016188631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02840057a0 con 0x7f029c0bddc0 2024-01-22T05:05:41.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.524+0000 7f02a2a00700 1 -- 172.21.15.49:0/3016188631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c13b060 con 0x7f029c0bddc0 2024-01-22T05:05:41.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.528+0000 7f02a2a00700 1 -- 172.21.15.49:0/3016188631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029c0656b0 con 0x7f029c0bddc0 2024-01-22T05:05:41.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.528+0000 7f0293400700 1 -- 172.21.15.49:0/3016188631 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0284005b90 con 0x7f029c0bddc0 2024-01-22T05:05:41.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.532+0000 7f0293400700 1 --2- 172.21.15.49:0/3016188631 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f027405a510 0x7f027405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:41.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.532+0000 7f0293400700 1 -- 172.21.15.49:0/3016188631 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5992+0+0 (secure 0 0 0) 0x7f0284073fe0 con 0x7f029c0bddc0 2024-01-22T05:05:41.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.532+0000 7f029be00700 1 --2- 172.21.15.49:0/3016188631 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f027405a510 0x7f027405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:41.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.532+0000 7f029be00700 1 --2- 172.21.15.49:0/3016188631 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f027405a510 0x7f027405c9d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f028c006fd0 tx=0x7f028c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:41.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.536+0000 7f0293400700 1 -- 172.21.15.49:0/3016188631 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0284047780 con 0x7f029c0bddc0 2024-01-22T05:05:41.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:41.704+0000 7f02a2a00700 1 -- 172.21.15.49:0/3016188631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f029c151be0 con 0x7f029c0bddc0 2024-01-22T05:05:42.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.312+0000 7f0293400700 1 -- 172.21.15.49:0/3016188631 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7f028404ada0 con 0x7f029c0bddc0 2024-01-22T05:05:42.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.324+0000 7f02a2a00700 1 -- 172.21.15.49:0/3016188631 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f027405a510 msgr2=0x7f027405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:42.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.324+0000 7f02a2a00700 1 --2- 172.21.15.49:0/3016188631 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f027405a510 0x7f027405c9d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f028c006fd0 tx=0x7f028c008040).stop 2024-01-22T05:05:42.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.324+0000 7f02a2a00700 1 -- 172.21.15.49:0/3016188631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029c0bddc0 msgr2=0x7f029c0bf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:42.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.324+0000 7f02a2a00700 1 --2- 172.21.15.49:0/3016188631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029c0bddc0 0x7f029c0bf0b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f0284007fd0 tx=0x7f0284007df0).stop 2024-01-22T05:05:42.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.328+0000 7f02a2a00700 1 -- 172.21.15.49:0/3016188631 shutdown_connections 2024-01-22T05:05:42.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.328+0000 7f02a2a00700 1 --2- 172.21.15.49:0/3016188631 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f027405a510 0x7f027405c9d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.328+0000 7f02a2a00700 1 --2- 172.21.15.49:0/3016188631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f029c0c3c80 0x7f029c0c0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.328+0000 7f02a2a00700 1 --2- 172.21.15.49:0/3016188631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029c0bddc0 0x7f029c0bf0b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.328+0000 7f02a2a00700 1 --2- 172.21.15.49:0/3016188631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f029c064500 0x7f029c13ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.328+0000 7f02a2a00700 1 -- 172.21.15.49:0/3016188631 >> 172.21.15.49:0/3016188631 conn(0x7f029c0c40f0 msgr2=0x7f029c0c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:42.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.328+0000 7f02a2a00700 1 -- 172.21.15.49:0/3016188631 shutdown_connections 2024-01-22T05:05:42.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.328+0000 7f02a2a00700 1 -- 172.21.15.49:0/3016188631 wait complete. 2024-01-22T05:05:42.337 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-01-22T05:05:42.366 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:05:42.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.524+0000 7fb33ee00700 1 Processor -- start 2024-01-22T05:05:42.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.524+0000 7fb33ee00700 1 -- start start 2024-01-22T05:05:42.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb33ee00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3380c4d10 0x7fb3380a6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:42.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb33ee00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb3380be130 0x7fb3380a4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:42.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb33ee00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb338152f80 con 0x7fb3380a6c60 2024-01-22T05:05:42.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb33ee00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb338152190 con 0x7fb3380be130 2024-01-22T05:05:42.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb33ee00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb338152370 con 0x7fb3380c4d10 2024-01-22T05:05:42.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb337400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb3380a6c60 0x7fb3380bda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59314/0 (socket says 172.21.15.49:59314) 2024-01-22T05:05:42.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb337400700 1 -- 172.21.15.49:0/2459177100 learned_addr learned my addr 172.21.15.49:0/2459177100 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:42.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb33ce00700 1 --2- 172.21.15.49:0/2459177100 >> v2:172.21.15.110:3300/0 conn(0x7fb3380be130 0x7fb3380a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:42.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb337e00700 1 --2- 172.21.15.49:0/2459177100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3380c4d10 0x7fb3380a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:42.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb336a00700 1 -- 172.21.15.49:0/2459177100 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191715644 0 0) 0x7fb338152f80 con 0x7fb3380a6c60 2024-01-22T05:05:42.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb336a00700 1 -- 172.21.15.49:0/2459177100 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3180033f0 con 0x7fb3380a6c60 2024-01-22T05:05:42.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb33ce00700 1 -- 172.21.15.49:0/2459177100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3380c4d10 msgr2=0x7fb3380a6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:42.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb33ce00700 1 --2- 172.21.15.49:0/2459177100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3380c4d10 0x7fb3380a6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb336a00700 1 -- 172.21.15.49:0/2459177100 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 229670699 0 0) 0x7fb3180033f0 con 0x7fb3380a6c60 2024-01-22T05:05:42.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb33ce00700 1 -- 172.21.15.49:0/2459177100 >> v1:172.21.15.49:6789/0 conn(0x7fb3380a6c60 legacy=0x7fb3380bda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:42.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb33ce00700 1 -- 172.21.15.49:0/2459177100 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb338152650 con 0x7fb3380be130 2024-01-22T05:05:42.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb33ce00700 1 --2- 172.21.15.49:0/2459177100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3380be130 0x7fb3380a4510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fb330009e60 tx=0x7fb330009780).ready entity=mon.1 client_cookie=4f998bce14ee2bcb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:42.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb336a00700 1 -- 172.21.15.49:0/2459177100 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33000e070 con 0x7fb3380be130 2024-01-22T05:05:42.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb336a00700 1 -- 172.21.15.49:0/2459177100 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33000b7a0 con 0x7fb3380be130 2024-01-22T05:05:42.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.528+0000 7fb336a00700 1 -- 172.21.15.49:0/2459177100 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb320001470 con 0x7fb3380be130 2024-01-22T05:05:42.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.532+0000 7fb33ee00700 1 -- 172.21.15.49:0/2459177100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3380be130 msgr2=0x7fb3380a4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:42.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.532+0000 7fb33ee00700 1 --2- 172.21.15.49:0/2459177100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3380be130 0x7fb3380a4510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fb330009e60 tx=0x7fb330009780).stop 2024-01-22T05:05:42.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.532+0000 7fb33ee00700 1 -- 172.21.15.49:0/2459177100 shutdown_connections 2024-01-22T05:05:42.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.532+0000 7fb33ee00700 1 --2- 172.21.15.49:0/2459177100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3380be130 0x7fb3380a4510 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.532+0000 7fb33ee00700 1 --2- 172.21.15.49:0/2459177100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3380c4d10 0x7fb3380a6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.532+0000 7fb33ee00700 1 -- 172.21.15.49:0/2459177100 >> 172.21.15.49:0/2459177100 conn(0x7fb3380aa740 msgr2=0x7fb3380aab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:42.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.532+0000 7fb33ee00700 1 -- 172.21.15.49:0/2459177100 shutdown_connections 2024-01-22T05:05:42.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.532+0000 7fb33ee00700 1 -- 172.21.15.49:0/2459177100 wait complete. 2024-01-22T05:05:42.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.536+0000 7fb33ee00700 1 Processor -- start 2024-01-22T05:05:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.536+0000 7fb33ee00700 1 -- start start 2024-01-22T05:05:42.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.536+0000 7fb33ee00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3380a6c60 0x7fb3380c0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:42.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.536+0000 7fb33ee00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3380be130 0x7fb33816bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:42.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.536+0000 7fb33ee00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3380c4d10 0x7fb3380a8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:42.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.536+0000 7fb33ee00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33816ba30 con 0x7fb3380a6c60 2024-01-22T05:05:42.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.536+0000 7fb33ee00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3380c12d0 con 0x7fb3380c4d10 2024-01-22T05:05:42.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.536+0000 7fb33ee00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3380a8ed0 con 0x7fb3380be130 2024-01-22T05:05:42.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.536+0000 7fb337e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3380a6c60 0x7fb3380c0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:42.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.536+0000 7fb337e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3380a6c60 0x7fb3380c0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35984/0 (socket says 172.21.15.49:35984) 2024-01-22T05:05:42.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.536+0000 7fb337e00700 1 -- 172.21.15.49:0/3631201991 learned_addr learned my addr 172.21.15.49:0/3631201991 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:42.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb337e00700 1 -- 172.21.15.49:0/3631201991 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3380be130 msgr2=0x7fb33816bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:42.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb337400700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3380be130 0x7fb33816bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:42.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb33ce00700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3380c4d10 0x7fb3380a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:42.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb337e00700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3380be130 0x7fb33816bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb337e00700 1 -- 172.21.15.49:0/3631201991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3380c4d10 msgr2=0x7fb3380a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:42.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb337e00700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3380c4d10 0x7fb3380a8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb337e00700 1 -- 172.21.15.49:0/3631201991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb330009a20 con 0x7fb3380a6c60 2024-01-22T05:05:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb33ce00700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3380c4d10 0x7fb3380a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:05:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb337400700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3380be130 0x7fb33816bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:05:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb337e00700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3380a6c60 0x7fb3380c0de0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fb32800e900 tx=0x7fb328009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb32f400700 1 -- 172.21.15.49:0/3631201991 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32800c640 con 0x7fb3380a6c60 2024-01-22T05:05:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb32f400700 1 -- 172.21.15.49:0/3631201991 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32800c7a0 con 0x7fb3380a6c60 2024-01-22T05:05:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb33ee00700 1 -- 172.21.15.49:0/3631201991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3380a91b0 con 0x7fb3380a6c60 2024-01-22T05:05:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb32f400700 1 -- 172.21.15.49:0/3631201991 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32800cb20 con 0x7fb3380a6c60 2024-01-22T05:05:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb33ee00700 1 -- 172.21.15.49:0/3631201991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33816b6c0 con 0x7fb3380a6c60 2024-01-22T05:05:42.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.540+0000 7fb33ee00700 1 -- 172.21.15.49:0/3631201991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3380648b0 con 0x7fb3380a6c60 2024-01-22T05:05:42.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.544+0000 7fb32f400700 1 -- 172.21.15.49:0/3631201991 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb32801b400 con 0x7fb3380a6c60 2024-01-22T05:05:42.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.544+0000 7fb32f400700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb31005a540 0x7fb31005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:42.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.544+0000 7fb32f400700 1 -- 172.21.15.49:0/3631201991 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6374+0+0 (secure 0 0 0) 0x7fb328074d80 con 0x7fb3380a6c60 2024-01-22T05:05:42.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.544+0000 7fb337400700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb31005a540 0x7fb31005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:42.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.544+0000 7fb337400700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb31005a540 0x7fb31005ca00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fb320001620 tx=0x7fb320009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:42.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.548+0000 7fb32f400700 1 -- 172.21.15.49:0/3631201991 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb3280483f0 con 0x7fb3380a6c60 2024-01-22T05:05:42.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.740+0000 7fb33ee00700 1 -- 172.21.15.49:0/3631201991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb338046800 con 0x7fb3380a6c60 2024-01-22T05:05:42.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.756+0000 7fb32f400700 1 -- 172.21.15.49:0/3631201991 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb328016030 con 0x7fb3380a6c60 2024-01-22T05:05:42.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.772+0000 7fb33ee00700 1 -- 172.21.15.49:0/3631201991 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb31005a540 msgr2=0x7fb31005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:42.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.772+0000 7fb33ee00700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb31005a540 0x7fb31005ca00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fb320001620 tx=0x7fb320009040).stop 2024-01-22T05:05:42.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.772+0000 7fb33ee00700 1 -- 172.21.15.49:0/3631201991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3380a6c60 msgr2=0x7fb3380c0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:42.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.772+0000 7fb33ee00700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3380a6c60 0x7fb3380c0de0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fb32800e900 tx=0x7fb328009060).stop 2024-01-22T05:05:42.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.776+0000 7fb33ee00700 1 -- 172.21.15.49:0/3631201991 shutdown_connections 2024-01-22T05:05:42.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.776+0000 7fb33ee00700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb31005a540 0x7fb31005ca00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.776+0000 7fb33ee00700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3380c4d10 0x7fb3380a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.776+0000 7fb33ee00700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3380be130 0x7fb33816bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.776+0000 7fb33ee00700 1 --2- 172.21.15.49:0/3631201991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3380a6c60 0x7fb3380c0de0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.776+0000 7fb33ee00700 1 -- 172.21.15.49:0/3631201991 >> 172.21.15.49:0/3631201991 conn(0x7fb3380aa740 msgr2=0x7fb3380c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:42.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.780+0000 7fb33ee00700 1 -- 172.21.15.49:0/3631201991 shutdown_connections 2024-01-22T05:05:42.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.780+0000 7fb33ee00700 1 -- 172.21.15.49:0/3631201991 wait complete. 2024-01-22T05:05:42.802 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 6 and data pool 7 2024-01-22T05:05:42.819 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:05:42.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.976+0000 7f8887200700 1 Processor -- start 2024-01-22T05:05:42.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.976+0000 7f8887200700 1 -- start start 2024-01-22T05:05:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f8887200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8880065240 0x7f88800644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f8887200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88800649e0 0x7f888015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f8887200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88800c2700 con 0x7f8880065620 2024-01-22T05:05:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f8887200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8880064e30 con 0x7f8880065240 2024-01-22T05:05:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f8887200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88800c29a0 con 0x7f88800649e0 2024-01-22T05:05:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f887f400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8880065620 0x7f888015b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59316/0 (socket says 172.21.15.49:59316) 2024-01-22T05:05:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f887f400700 1 -- 172.21.15.49:0/2243986228 learned_addr learned my addr 172.21.15.49:0/2243986228 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f887fe00700 1 --2- 172.21.15.49:0/2243986228 >> v2:172.21.15.110:3300/0 conn(0x7f8880065240 0x7f88800644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f8885c00700 1 --2- 172.21.15.49:0/2243986228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88800649e0 0x7f888015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f887ea00700 1 -- 172.21.15.49:0/2243986228 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050095711 0 0) 0x7f88800c2700 con 0x7f8880065620 2024-01-22T05:05:42.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f887ea00700 1 -- 172.21.15.49:0/2243986228 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88600033f0 con 0x7f8880065620 2024-01-22T05:05:42.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f887fe00700 1 -- 172.21.15.49:0/2243986228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88800649e0 msgr2=0x7f888015c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:42.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f887fe00700 1 --2- 172.21.15.49:0/2243986228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88800649e0 0x7f888015c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f887fe00700 1 -- 172.21.15.49:0/2243986228 >> v1:172.21.15.49:6789/0 conn(0x7f8880065620 legacy=0x7f888015b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:42.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f887fe00700 1 -- 172.21.15.49:0/2243986228 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88800c2c80 con 0x7f8880065240 2024-01-22T05:05:42.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f887fe00700 1 --2- 172.21.15.49:0/2243986228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8880065240 0x7f88800644f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f8870009760 tx=0x7f8870009060).ready entity=mon.1 client_cookie=cc6fbb7e45410e9c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:42.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f887ea00700 1 -- 172.21.15.49:0/2243986228 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887000d4a0 con 0x7f8880065240 2024-01-22T05:05:42.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f887ea00700 1 -- 172.21.15.49:0/2243986228 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887000d600 con 0x7f8880065240 2024-01-22T05:05:42.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.980+0000 7f887ea00700 1 -- 172.21.15.49:0/2243986228 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887000d980 con 0x7f8880065240 2024-01-22T05:05:42.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.984+0000 7f8887200700 1 -- 172.21.15.49:0/2243986228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8880065240 msgr2=0x7f88800644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:42.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.984+0000 7f8887200700 1 --2- 172.21.15.49:0/2243986228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8880065240 0x7f88800644f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f8870009760 tx=0x7f8870009060).stop 2024-01-22T05:05:42.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.984+0000 7f8887200700 1 -- 172.21.15.49:0/2243986228 shutdown_connections 2024-01-22T05:05:42.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.984+0000 7f8887200700 1 --2- 172.21.15.49:0/2243986228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88800649e0 0x7f888015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.984+0000 7f8887200700 1 --2- 172.21.15.49:0/2243986228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8880065240 0x7f88800644f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.984+0000 7f8887200700 1 -- 172.21.15.49:0/2243986228 >> 172.21.15.49:0/2243986228 conn(0x7f88800c87f0 msgr2=0x7f88800c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.984+0000 7f8887200700 1 -- 172.21.15.49:0/2243986228 shutdown_connections 2024-01-22T05:05:42.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.984+0000 7f8887200700 1 -- 172.21.15.49:0/2243986228 wait complete. 2024-01-22T05:05:42.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.988+0000 7f8887200700 1 Processor -- start 2024-01-22T05:05:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.988+0000 7f8887200700 1 -- start start 2024-01-22T05:05:42.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.988+0000 7f8887200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88800649e0 0x7f88801690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:42.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.988+0000 7f8887200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8880065240 0x7f8880168930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:42.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.988+0000 7f8887200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8880065620 0x7f88801677c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:42.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.988+0000 7f8887200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88800c0010 con 0x7f8880065620 2024-01-22T05:05:42.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.988+0000 7f8887200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88801695b0 con 0x7f88800649e0 2024-01-22T05:05:42.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.988+0000 7f8887200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8880168e20 con 0x7f8880065240 2024-01-22T05:05:42.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f8885c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8880065620 0x7f88801677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:42.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f887fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88800649e0 0x7f88801690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:42.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f887f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8880065240 0x7f8880168930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:42.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f887fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88800649e0 0x7f88801690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:50014/0 (socket says 172.21.15.49:50014) 2024-01-22T05:05:42.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f887fe00700 1 -- 172.21.15.49:0/2761472131 learned_addr learned my addr 172.21.15.49:0/2761472131 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:42.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f887fe00700 1 -- 172.21.15.49:0/2761472131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8880065240 msgr2=0x7f8880168930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:42.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f887fe00700 1 --2- 172.21.15.49:0/2761472131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8880065240 0x7f8880168930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f887fe00700 1 -- 172.21.15.49:0/2761472131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8880065620 msgr2=0x7f88801677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:42.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f887fe00700 1 --2- 172.21.15.49:0/2761472131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8880065620 0x7f88801677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:42.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f887fe00700 1 -- 172.21.15.49:0/2761472131 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88700092a0 con 0x7f88800649e0 2024-01-22T05:05:42.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f887fe00700 1 --2- 172.21.15.49:0/2761472131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88800649e0 0x7f88801690c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f8870009d50 tx=0x7f8870016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:42.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f8877400700 1 -- 172.21.15.49:0/2761472131 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887000dd30 con 0x7f88800649e0 2024-01-22T05:05:42.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f8877400700 1 -- 172.21.15.49:0/2761472131 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887000de90 con 0x7f88800649e0 2024-01-22T05:05:42.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f8887200700 1 -- 172.21.15.49:0/2761472131 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88800bf400 con 0x7f88800649e0 2024-01-22T05:05:42.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f8877400700 1 -- 172.21.15.49:0/2761472131 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887000d980 con 0x7f88800649e0 2024-01-22T05:05:42.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f8887200700 1 -- 172.21.15.49:0/2761472131 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88800bf9c0 con 0x7f88800649e0 2024-01-22T05:05:42.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.992+0000 7f8887200700 1 -- 172.21.15.49:0/2761472131 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8880047060 con 0x7f88800649e0 2024-01-22T05:05:42.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.996+0000 7f8877400700 1 -- 172.21.15.49:0/2761472131 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f887001d640 con 0x7f88800649e0 2024-01-22T05:05:43.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.996+0000 7f8877400700 1 --2- 172.21.15.49:0/2761472131 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f885805a560 0x7f885805ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:43.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.996+0000 7f8877400700 1 -- 172.21.15.49:0/2761472131 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f8870075fe0 con 0x7f88800649e0 2024-01-22T05:05:43.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:42.996+0000 7f887f400700 1 --2- 172.21.15.49:0/2761472131 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f885805a560 0x7f885805ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:43.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.000+0000 7f887f400700 1 --2- 172.21.15.49:0/2761472131 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f885805a560 0x7f885805ca20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f8868007fd0 tx=0x7f8868009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:43.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.004+0000 7f8877400700 1 -- 172.21.15.49:0/2761472131 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8870049640 con 0x7f88800649e0 2024-01-22T05:05:43.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.172+0000 7f8887200700 1 -- 172.21.15.49:0/2761472131 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88800c2f60 con 0x7f88800649e0 2024-01-22T05:05:43.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.176+0000 7f8877400700 1 -- 172.21.15.49:0/2761472131 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+17177 (secure 0 0 0) 0x7f887004cc60 con 0x7f88800649e0 2024-01-22T05:05:43.179 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:43.179 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":39,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:05:42.746335+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:05:40.764447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-01-22T05:05:41.767543+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:05:43.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.180+0000 7f8887200700 1 -- 172.21.15.49:0/2761472131 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f885805a560 msgr2=0x7f885805ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:43.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.180+0000 7f8887200700 1 --2- 172.21.15.49:0/2761472131 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f885805a560 0x7f885805ca20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f8868007fd0 tx=0x7f8868009040).stop 2024-01-22T05:05:43.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.180+0000 7f8887200700 1 -- 172.21.15.49:0/2761472131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88800649e0 msgr2=0x7f88801690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:43.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.180+0000 7f8887200700 1 --2- 172.21.15.49:0/2761472131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88800649e0 0x7f88801690c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f8870009d50 tx=0x7f8870016000).stop 2024-01-22T05:05:43.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.180+0000 7f8887200700 1 -- 172.21.15.49:0/2761472131 shutdown_connections 2024-01-22T05:05:43.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.180+0000 7f8887200700 1 --2- 172.21.15.49:0/2761472131 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f885805a560 0x7f885805ca20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.180+0000 7f8887200700 1 --2- 172.21.15.49:0/2761472131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8880065620 0x7f88801677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.180+0000 7f8887200700 1 --2- 172.21.15.49:0/2761472131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8880065240 0x7f8880168930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.180+0000 7f8887200700 1 --2- 172.21.15.49:0/2761472131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88800649e0 0x7f88801690c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.180+0000 7f8887200700 1 -- 172.21.15.49:0/2761472131 >> 172.21.15.49:0/2761472131 conn(0x7f88800c87f0 msgr2=0x7f8880156800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.180+0000 7f8887200700 1 -- 172.21.15.49:0/2761472131 shutdown_connections 2024-01-22T05:05:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.180+0000 7f8887200700 1 -- 172.21.15.49:0/2761472131 wait complete. 2024-01-22T05:05:43.208 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:05:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.368+0000 7fa577200700 1 Processor -- start 2024-01-22T05:05:43.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.368+0000 7fa577200700 1 -- start start 2024-01-22T05:05:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa577200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa5780c36e0 0x7fa5780c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa577200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa578155460 0x7fa5781558c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa577200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5780684a0 con 0x7fa578151da0 2024-01-22T05:05:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa577200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa578156280 con 0x7fa5780c36e0 2024-01-22T05:05:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa577200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa578155db0 con 0x7fa578155460 2024-01-22T05:05:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa575e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa5780c36e0 0x7fa5780c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa575400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa578155460 0x7fa5781558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa575400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa578155460 0x7fa5781558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:43978/0 (socket says 172.21.15.49:43978) 2024-01-22T05:05:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa575e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa5780c36e0 0x7fa5780c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:40580/0 (socket says 172.21.15.49:40580) 2024-01-22T05:05:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa575400700 1 -- 172.21.15.49:0/950736884 learned_addr learned my addr 172.21.15.49:0/950736884 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:43.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa575e00700 1 -- 172.21.15.49:0/950736884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa578155460 msgr2=0x7fa5781558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:43.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa575e00700 1 --2- 172.21.15.49:0/950736884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa578155460 0x7fa5781558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa575e00700 1 -- 172.21.15.49:0/950736884 >> v1:172.21.15.110:6789/0 conn(0x7fa578151da0 legacy=0x7fa578152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:43.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa575e00700 1 -- 172.21.15.49:0/950736884 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5780686f0 con 0x7fa5780c36e0 2024-01-22T05:05:43.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa575400700 1 --2- 172.21.15.49:0/950736884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa578155460 0x7fa5781558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:43.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.372+0000 7fa575e00700 1 --2- 172.21.15.49:0/950736884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5780c36e0 0x7fa5780c3ac0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fa568009760 tx=0x7fa568009060).ready entity=mon.1 client_cookie=738e78fdcf1ab233 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:43.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.376+0000 7fa574a00700 1 -- 172.21.15.49:0/950736884 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56800f510 con 0x7fa5780c36e0 2024-01-22T05:05:43.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.376+0000 7fa574a00700 1 -- 172.21.15.49:0/950736884 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56800f670 con 0x7fa5780c36e0 2024-01-22T05:05:43.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.376+0000 7fa574a00700 1 -- 172.21.15.49:0/950736884 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56800f9f0 con 0x7fa5780c36e0 2024-01-22T05:05:43.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.376+0000 7fa577200700 1 -- 172.21.15.49:0/950736884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5780c36e0 msgr2=0x7fa5780c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:43.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.376+0000 7fa577200700 1 --2- 172.21.15.49:0/950736884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5780c36e0 0x7fa5780c3ac0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fa568009760 tx=0x7fa568009060).stop 2024-01-22T05:05:43.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.376+0000 7fa577200700 1 -- 172.21.15.49:0/950736884 shutdown_connections 2024-01-22T05:05:43.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.376+0000 7fa577200700 1 --2- 172.21.15.49:0/950736884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa578155460 0x7fa5781558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.376+0000 7fa577200700 1 --2- 172.21.15.49:0/950736884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5780c36e0 0x7fa5780c3ac0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.376+0000 7fa577200700 1 -- 172.21.15.49:0/950736884 >> 172.21.15.49:0/950736884 conn(0x7fa5780c86f0 msgr2=0x7fa5780c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:43.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.376+0000 7fa577200700 1 -- 172.21.15.49:0/950736884 shutdown_connections 2024-01-22T05:05:43.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.376+0000 7fa577200700 1 -- 172.21.15.49:0/950736884 wait complete. 2024-01-22T05:05:43.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.380+0000 7fa577200700 1 Processor -- start 2024-01-22T05:05:43.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.380+0000 7fa577200700 1 -- start start 2024-01-22T05:05:43.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.380+0000 7fa577200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5780c36e0 0x7fa5781462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:43.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.380+0000 7fa577200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa578151da0 0x7fa578062230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:43.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.380+0000 7fa577200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa578155460 0x7fa578062720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:43.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.380+0000 7fa577200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa578062c10 con 0x7fa578155460 2024-01-22T05:05:43.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.380+0000 7fa577200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57814dd60 con 0x7fa578151da0 2024-01-22T05:05:43.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.380+0000 7fa577200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5780c2590 con 0x7fa5780c36e0 2024-01-22T05:05:43.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.380+0000 7fa576800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa578155460 0x7fa578062720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:43.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.384+0000 7fa576800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa578155460 0x7fa578062720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53846/0 (socket says 172.21.15.49:53846) 2024-01-22T05:05:43.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.384+0000 7fa576800700 1 -- 172.21.15.49:0/2102488331 learned_addr learned my addr 172.21.15.49:0/2102488331 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:43.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.384+0000 7fa575400700 1 --2- 172.21.15.49:0/2102488331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa578151da0 0x7fa578062230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:43.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.384+0000 7fa575e00700 1 --2- 172.21.15.49:0/2102488331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5780c36e0 0x7fa5781462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:43.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.384+0000 7fa576800700 1 -- 172.21.15.49:0/2102488331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5780c36e0 msgr2=0x7fa5781462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:43.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.384+0000 7fa576800700 1 --2- 172.21.15.49:0/2102488331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5780c36e0 0x7fa5781462d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.384+0000 7fa576800700 1 -- 172.21.15.49:0/2102488331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa578151da0 msgr2=0x7fa578062230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:43.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.384+0000 7fa576800700 1 --2- 172.21.15.49:0/2102488331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa578151da0 0x7fa578062230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.384+0000 7fa576800700 1 -- 172.21.15.49:0/2102488331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa560009370 con 0x7fa578155460 2024-01-22T05:05:43.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.384+0000 7fa576800700 1 --2- 172.21.15.49:0/2102488331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa578155460 0x7fa578062720 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fa570002230 tx=0x7fa5700015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:43.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.384+0000 7fa56d600700 1 -- 172.21.15.49:0/2102488331 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57000e4a0 con 0x7fa578155460 2024-01-22T05:05:43.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.384+0000 7fa56d600700 1 -- 172.21.15.49:0/2102488331 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57000e600 con 0x7fa578155460 2024-01-22T05:05:43.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.384+0000 7fa56d600700 1 -- 172.21.15.49:0/2102488331 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57000e980 con 0x7fa578155460 2024-01-22T05:05:43.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.384+0000 7fa577200700 1 -- 172.21.15.49:0/2102488331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5680092a0 con 0x7fa578155460 2024-01-22T05:05:43.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.384+0000 7fa577200700 1 -- 172.21.15.49:0/2102488331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5780630d0 con 0x7fa578155460 2024-01-22T05:05:43.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.388+0000 7fa577200700 1 -- 172.21.15.49:0/2102488331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa578066560 con 0x7fa578155460 2024-01-22T05:05:43.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.388+0000 7fa56d600700 1 -- 172.21.15.49:0/2102488331 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa57001b3b0 con 0x7fa578155460 2024-01-22T05:05:43.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.388+0000 7fa56d600700 1 --2- 172.21.15.49:0/2102488331 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa55005a510 0x7fa55005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:43.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.388+0000 7fa56d600700 1 -- 172.21.15.49:0/2102488331 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa570073fe0 con 0x7fa578155460 2024-01-22T05:05:43.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.388+0000 7fa575e00700 1 --2- 172.21.15.49:0/2102488331 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa55005a510 0x7fa55005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:43.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.388+0000 7fa575e00700 1 --2- 172.21.15.49:0/2102488331 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa55005a510 0x7fa55005c9d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fa568009fd0 tx=0x7fa568017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:43.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.396+0000 7fa56d600700 1 -- 172.21.15.49:0/2102488331 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa5700476b0 con 0x7fa578155460 2024-01-22T05:05:43.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.568+0000 7fa577200700 1 -- 172.21.15.49:0/2102488331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5780689d0 con 0x7fa578155460 2024-01-22T05:05:43.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.572+0000 7fa56d600700 1 -- 172.21.15.49:0/2102488331 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+17177 (secure 0 0 0) 0x7fa57004acd0 con 0x7fa578155460 2024-01-22T05:05:43.574 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:43.574 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":39,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:05:42.746335+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:05:40.764447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-01-22T05:05:41.767543+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:05:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.572+0000 7fa577200700 1 -- 172.21.15.49:0/2102488331 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa55005a510 msgr2=0x7fa55005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.572+0000 7fa577200700 1 --2- 172.21.15.49:0/2102488331 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa55005a510 0x7fa55005c9d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fa568009fd0 tx=0x7fa568017000).stop 2024-01-22T05:05:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.572+0000 7fa577200700 1 -- 172.21.15.49:0/2102488331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa578155460 msgr2=0x7fa578062720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.572+0000 7fa577200700 1 --2- 172.21.15.49:0/2102488331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa578155460 0x7fa578062720 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fa570002230 tx=0x7fa5700015e0).stop 2024-01-22T05:05:43.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.572+0000 7fa577200700 1 -- 172.21.15.49:0/2102488331 shutdown_connections 2024-01-22T05:05:43.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.572+0000 7fa577200700 1 --2- 172.21.15.49:0/2102488331 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa55005a510 0x7fa55005c9d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.572+0000 7fa577200700 1 --2- 172.21.15.49:0/2102488331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa578155460 0x7fa578062720 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.572+0000 7fa577200700 1 --2- 172.21.15.49:0/2102488331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa578151da0 0x7fa578062230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.572+0000 7fa577200700 1 --2- 172.21.15.49:0/2102488331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5780c36e0 0x7fa5781462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.572+0000 7fa577200700 1 -- 172.21.15.49:0/2102488331 >> 172.21.15.49:0/2102488331 conn(0x7fa5780c86f0 msgr2=0x7fa5780c4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:43.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.572+0000 7fa577200700 1 -- 172.21.15.49:0/2102488331 shutdown_connections 2024-01-22T05:05:43.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.572+0000 7fa577200700 1 -- 172.21.15.49:0/2102488331 wait complete. 2024-01-22T05:05:43.600 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:05:43.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.768+0000 7fdfab800700 1 Processor -- start 2024-01-22T05:05:43.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.768+0000 7fdfab800700 1 -- start start 2024-01-22T05:05:43.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.768+0000 7fdfab800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdfa40bf430 0x7fdfa40bf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:43.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.768+0000 7fdfab800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfa4154d30 0x7fdfa40c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:43.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.768+0000 7fdfab800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfa4063220 con 0x7fdfa40c3a90 2024-01-22T05:05:43.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.768+0000 7fdfab800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa40c4400 con 0x7fdfa40bf430 2024-01-22T05:05:43.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.768+0000 7fdfab800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa4063ad0 con 0x7fdfa4154d30 2024-01-22T05:05:43.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.768+0000 7fdfa8e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdfa40bf430 0x7fdfa40bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:43.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.768+0000 7fdfa8e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdfa40bf430 0x7fdfa40bf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53852/0 (socket says 172.21.15.49:53852) 2024-01-22T05:05:43.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.768+0000 7fdfa8e00700 1 -- 172.21.15.49:0/1707336039 learned_addr learned my addr 172.21.15.49:0/1707336039 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:43.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.768+0000 7fdfaa200700 1 --2- 172.21.15.49:0/1707336039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfa4154d30 0x7fdfa40c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfa8e00700 1 -- 172.21.15.49:0/1707336039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfa4154d30 msgr2=0x7fdfa40c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfa8e00700 1 --2- 172.21.15.49:0/1707336039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfa4154d30 0x7fdfa40c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfa8e00700 1 -- 172.21.15.49:0/1707336039 >> v1:172.21.15.110:6789/0 conn(0x7fdfa40c3a90 legacy=0x7fdfa4067ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfa8e00700 1 -- 172.21.15.49:0/1707336039 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa4062610 con 0x7fdfa40bf430 2024-01-22T05:05:43.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfa8e00700 1 --2- 172.21.15.49:0/1707336039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa40bf430 0x7fdfa40bf810 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fdf94006fd0 tx=0x7fdf940090f0).ready entity=mon.0 client_cookie=33e31d7437b9d9b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:43.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfa3400700 1 -- 172.21.15.49:0/1707336039 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9400b580 con 0x7fdfa40bf430 2024-01-22T05:05:43.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfa3400700 1 -- 172.21.15.49:0/1707336039 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9400b6e0 con 0x7fdfa40bf430 2024-01-22T05:05:43.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfa3400700 1 -- 172.21.15.49:0/1707336039 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9400ba60 con 0x7fdfa40bf430 2024-01-22T05:05:43.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfab800700 1 -- 172.21.15.49:0/1707336039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa40bf430 msgr2=0x7fdfa40bf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:43.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfab800700 1 --2- 172.21.15.49:0/1707336039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa40bf430 0x7fdfa40bf810 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fdf94006fd0 tx=0x7fdf940090f0).stop 2024-01-22T05:05:43.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfab800700 1 -- 172.21.15.49:0/1707336039 shutdown_connections 2024-01-22T05:05:43.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfab800700 1 --2- 172.21.15.49:0/1707336039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfa4154d30 0x7fdfa40c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfab800700 1 --2- 172.21.15.49:0/1707336039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa40bf430 0x7fdfa40bf810 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfab800700 1 -- 172.21.15.49:0/1707336039 >> 172.21.15.49:0/1707336039 conn(0x7fdfa40c5860 msgr2=0x7fdfa40c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:43.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfab800700 1 -- 172.21.15.49:0/1707336039 shutdown_connections 2024-01-22T05:05:43.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.772+0000 7fdfab800700 1 -- 172.21.15.49:0/1707336039 wait complete. 2024-01-22T05:05:43.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.776+0000 7fdfab800700 1 Processor -- start 2024-01-22T05:05:43.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.776+0000 7fdfab800700 1 -- start start 2024-01-22T05:05:43.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.776+0000 7fdfab800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdfa40bf430 0x7fdfa40aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:43.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.776+0000 7fdfab800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfa40c3a90 0x7fdfa414fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:43.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.776+0000 7fdfab800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa4154d30 0x7fdfa40c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:43.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.776+0000 7fdfab800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40c0de0 con 0x7fdfa4154d30 2024-01-22T05:05:43.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.776+0000 7fdfab800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40c10c0 con 0x7fdfa40bf430 2024-01-22T05:05:43.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.776+0000 7fdfab800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40a8a40 con 0x7fdfa40c3a90 2024-01-22T05:05:43.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.776+0000 7fdfaa200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa4154d30 0x7fdfa40c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:43.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.776+0000 7fdfaa200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa4154d30 0x7fdfa40c14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53856/0 (socket says 172.21.15.49:53856) 2024-01-22T05:05:43.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.776+0000 7fdfaa200700 1 -- 172.21.15.49:0/617903193 learned_addr learned my addr 172.21.15.49:0/617903193 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:43.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.776+0000 7fdfa8e00700 1 --2- 172.21.15.49:0/617903193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdfa40bf430 0x7fdfa40aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:43.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.776+0000 7fdfa3e00700 1 --2- 172.21.15.49:0/617903193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfa40c3a90 0x7fdfa414fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.780+0000 7fdfaa200700 1 -- 172.21.15.49:0/617903193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfa40c3a90 msgr2=0x7fdfa414fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.780+0000 7fdfaa200700 1 --2- 172.21.15.49:0/617903193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfa40c3a90 0x7fdfa414fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.780+0000 7fdfaa200700 1 -- 172.21.15.49:0/617903193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdfa40bf430 msgr2=0x7fdfa40aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.780+0000 7fdfaa200700 1 --2- 172.21.15.49:0/617903193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdfa40bf430 0x7fdfa40aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.780+0000 7fdfaa200700 1 -- 172.21.15.49:0/617903193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf94009370 con 0x7fdfa4154d30 2024-01-22T05:05:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.780+0000 7fdfaa200700 1 --2- 172.21.15.49:0/617903193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa4154d30 0x7fdfa40c14d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fdf9c009e90 tx=0x7fdf9c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.780+0000 7fdf9be00700 1 -- 172.21.15.49:0/617903193 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c00cb50 con 0x7fdfa4154d30 2024-01-22T05:05:43.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.780+0000 7fdf9be00700 1 -- 172.21.15.49:0/617903193 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9c00f040 con 0x7fdfa4154d30 2024-01-22T05:05:43.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.780+0000 7fdfab800700 1 -- 172.21.15.49:0/617903193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa40a8d20 con 0x7fdfa4154d30 2024-01-22T05:05:43.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.780+0000 7fdf9be00700 1 -- 172.21.15.49:0/617903193 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c00cec0 con 0x7fdfa4154d30 2024-01-22T05:05:43.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.780+0000 7fdfab800700 1 -- 172.21.15.49:0/617903193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa40aac90 con 0x7fdfa4154d30 2024-01-22T05:05:43.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.780+0000 7fdfab800700 1 -- 172.21.15.49:0/617903193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa40bfb70 con 0x7fdfa4154d30 2024-01-22T05:05:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.784+0000 7fdf9be00700 1 -- 172.21.15.49:0/617903193 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdf9c013610 con 0x7fdfa4154d30 2024-01-22T05:05:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.784+0000 7fdf9be00700 1 --2- 172.21.15.49:0/617903193 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf7c05a510 0x7fdf7c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.784+0000 7fdf9be00700 1 -- 172.21.15.49:0/617903193 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fdf9c0752a0 con 0x7fdfa4154d30 2024-01-22T05:05:43.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.784+0000 7fdfa8e00700 1 --2- 172.21.15.49:0/617903193 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf7c05a510 0x7fdf7c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:43.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.784+0000 7fdfa8e00700 1 --2- 172.21.15.49:0/617903193 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf7c05a510 0x7fdf7c05c9d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fdf94009fd0 tx=0x7fdf94017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:43.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:43.792+0000 7fdf9be00700 1 -- 172.21.15.49:0/617903193 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdf9c048860 con 0x7fdfa4154d30 2024-01-22T05:05:44.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.004+0000 7fdfab800700 1 -- 172.21.15.49:0/617903193 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdfa4047060 con 0x7fdfa4154d30 2024-01-22T05:05:44.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.768+0000 7fdf9be00700 1 -- 172.21.15.49:0/617903193 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdf9c04be80 con 0x7fdfa4154d30 2024-01-22T05:05:44.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.772+0000 7fdfab800700 1 -- 172.21.15.49:0/617903193 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf7c05a510 msgr2=0x7fdf7c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:44.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.772+0000 7fdfab800700 1 --2- 172.21.15.49:0/617903193 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf7c05a510 0x7fdf7c05c9d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fdf94009fd0 tx=0x7fdf94017000).stop 2024-01-22T05:05:44.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.772+0000 7fdfab800700 1 -- 172.21.15.49:0/617903193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa4154d30 msgr2=0x7fdfa40c14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:44.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.772+0000 7fdfab800700 1 --2- 172.21.15.49:0/617903193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa4154d30 0x7fdfa40c14d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fdf9c009e90 tx=0x7fdf9c00b040).stop 2024-01-22T05:05:44.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.776+0000 7fdfab800700 1 -- 172.21.15.49:0/617903193 shutdown_connections 2024-01-22T05:05:44.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.776+0000 7fdfab800700 1 --2- 172.21.15.49:0/617903193 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf7c05a510 0x7fdf7c05c9d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:44.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.776+0000 7fdfab800700 1 --2- 172.21.15.49:0/617903193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa4154d30 0x7fdfa40c14d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:44.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.776+0000 7fdfab800700 1 --2- 172.21.15.49:0/617903193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfa40c3a90 0x7fdfa414fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:44.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.776+0000 7fdfab800700 1 --2- 172.21.15.49:0/617903193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdfa40bf430 0x7fdfa40aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.776+0000 7fdfab800700 1 -- 172.21.15.49:0/617903193 >> 172.21.15.49:0/617903193 conn(0x7fdfa40c5860 msgr2=0x7fdfa40c6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.776+0000 7fdfab800700 1 -- 172.21.15.49:0/617903193 shutdown_connections 2024-01-22T05:05:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.776+0000 7fdfab800700 1 -- 172.21.15.49:0/617903193 wait complete. 2024-01-22T05:05:44.801 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T05:05:44.802 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:05:44.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.964+0000 7f26ab200700 1 Processor -- start 2024-01-22T05:05:44.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.964+0000 7f26ab200700 1 -- start start 2024-01-22T05:05:44.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26ab200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26a40a9bb0 0x7f26a40c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:44.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26ab200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a4150d00 con 0x7f26a40642c0 2024-01-22T05:05:44.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26ab200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a40bc5b0 con 0x7f26a4063e60 2024-01-22T05:05:44.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26ab200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40bcb70 con 0x7f26a40a9bb0 2024-01-22T05:05:44.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26aa800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f26a40642c0 0x7f26a40bd710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51036/0 (socket says 172.21.15.49:51036) 2024-01-22T05:05:44.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26aa800700 1 -- 172.21.15.49:0/1842458400 learned_addr learned my addr 172.21.15.49:0/1842458400 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:44.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a9e00700 1 --2- 172.21.15.49:0/1842458400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26a40a9bb0 0x7f26a40c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:44.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229640852 0 0) 0x7f269c001490 con 0x7f26a40642c0 2024-01-22T05:05:44.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26840033f0 con 0x7f26a40642c0 2024-01-22T05:05:44.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649450863 0 0) 0x7f26a40bc5b0 con 0x7f26a4063e60 2024-01-22T05:05:44.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f269c001490 con 0x7f26a4063e60 2024-01-22T05:05:44.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2779766777 0 0) 0x7f26840033f0 con 0x7f26a40642c0 2024-01-22T05:05:44.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26a40a9bb0 msgr2=0x7f26a40c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:44.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 --2- 172.21.15.49:0/1842458400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26a40a9bb0 0x7f26a40c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:44.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 >> v1:172.21.15.110:6789/0 conn(0x7f26a4063e60 legacy=0x7f26a40bd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:44.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a4069c90 con 0x7f26a40642c0 2024-01-22T05:05:44.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f269c001980 con 0x7f26a40642c0 2024-01-22T05:05:44.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 >> v1:172.21.15.49:6789/0 conn(0x7f26a40642c0 legacy=0x7f26a40bd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:44.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 --2- 172.21.15.49:0/1842458400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2684003aa0 0x7f2684003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:44.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 --2- 172.21.15.49:0/1842458400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2684004690 0x7f2684004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:44.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 --2- 172.21.15.49:0/1842458400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2684005000 0x7f268400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:44.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40bcb70 con 0x7f2684005000 2024-01-22T05:05:44.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268400e090 con 0x7f2684003aa0 2024-01-22T05:05:44.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268400e250 con 0x7f2684004690 2024-01-22T05:05:44.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.968+0000 7f26aa800700 1 --2- 172.21.15.49:0/1842458400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2684005000 0x7f268400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:44.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26a9e00700 1 --2- 172.21.15.49:0/1842458400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2684003aa0 0x7f2684003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:44.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26a9400700 1 --2- 172.21.15.49:0/1842458400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2684004690 0x7f2684004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:44.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26aa800700 1 -- 172.21.15.49:0/1842458400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2684004690 msgr2=0x7f2684004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:44.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26aa800700 1 --2- 172.21.15.49:0/1842458400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2684004690 0x7f2684004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:44.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26aa800700 1 -- 172.21.15.49:0/1842458400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2684003aa0 msgr2=0x7f2684003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:44.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26aa800700 1 --2- 172.21.15.49:0/1842458400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2684003aa0 0x7f2684003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:44.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26aa800700 1 -- 172.21.15.49:0/1842458400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26840033f0 con 0x7f2684005000 2024-01-22T05:05:44.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26aa800700 1 --2- 172.21.15.49:0/1842458400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2684005000 0x7f268400b8e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f269c00c650 tx=0x7f269c007c00).ready entity=mon.0 client_cookie=c9eb7c345ea42449 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:44.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c005b20 con 0x7f2684005000 2024-01-22T05:05:44.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c005c80 con 0x7f2684005000 2024-01-22T05:05:44.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26a8a00700 1 -- 172.21.15.49:0/1842458400 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c007110 con 0x7f2684005000 2024-01-22T05:05:44.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26ab200700 1 -- 172.21.15.49:0/1842458400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2684005000 msgr2=0x7f268400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:44.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26ab200700 1 --2- 172.21.15.49:0/1842458400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2684005000 0x7f268400b8e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f269c00c650 tx=0x7f269c007c00).stop 2024-01-22T05:05:44.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26aa800700 1 -- 172.21.15.49:0/1842458400 reap_dead start 2024-01-22T05:05:44.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26ab200700 1 -- 172.21.15.49:0/1842458400 shutdown_connections 2024-01-22T05:05:44.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26ab200700 1 -- 172.21.15.49:0/1842458400 >> 172.21.15.49:0/1842458400 conn(0x7f26a40c8120 msgr2=0x7f26a40c40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:44.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26ab200700 1 -- 172.21.15.49:0/1842458400 shutdown_connections 2024-01-22T05:05:44.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.972+0000 7f26ab200700 1 -- 172.21.15.49:0/1842458400 wait complete. 2024-01-22T05:05:44.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.976+0000 7f26ab200700 1 Processor -- start 2024-01-22T05:05:44.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.976+0000 7f26ab200700 1 -- start start 2024-01-22T05:05:44.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.976+0000 7f26ab200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2684005000 0x7f26a40a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:44.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.976+0000 7f26ab200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26a4067a90 0x7f26a4067ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:44.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.976+0000 7f26ab200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a4152fb0 0x7f26a4153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:44.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.976+0000 7f26ab200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40683c0 con 0x7f26a4152fb0 2024-01-22T05:05:44.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.976+0000 7f26ab200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a4153da0 con 0x7f2684005000 2024-01-22T05:05:44.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.976+0000 7f26ab200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a4154080 con 0x7f26a4067a90 2024-01-22T05:05:44.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.976+0000 7f26aa800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a4152fb0 0x7f26a4153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:44.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.976+0000 7f26aa800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a4152fb0 0x7f26a4153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53876/0 (socket says 172.21.15.49:53876) 2024-01-22T05:05:44.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.976+0000 7f26aa800700 1 -- 172.21.15.49:0/1446777251 learned_addr learned my addr 172.21.15.49:0/1446777251 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:44.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.976+0000 7f26a9400700 1 --2- 172.21.15.49:0/1446777251 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26a4067a90 0x7f26a4067ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:44.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.976+0000 7f26a9e00700 1 --2- 172.21.15.49:0/1446777251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2684005000 0x7f26a40a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:44.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.980+0000 7f26a9e00700 1 -- 172.21.15.49:0/1446777251 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26a4067a90 msgr2=0x7f26a4067ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:44.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.980+0000 7f26a9e00700 1 --2- 172.21.15.49:0/1446777251 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26a4067a90 0x7f26a4067ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:44.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.980+0000 7f26a9e00700 1 -- 172.21.15.49:0/1446777251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a4152fb0 msgr2=0x7f26a4153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.980+0000 7f26a9e00700 1 --2- 172.21.15.49:0/1446777251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a4152fb0 0x7f26a4153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.980+0000 7f26a9e00700 1 -- 172.21.15.49:0/1446777251 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a4160d30 con 0x7f2684005000 2024-01-22T05:05:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.980+0000 7f26aa800700 1 --2- 172.21.15.49:0/1446777251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a4152fb0 0x7f26a4153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.980+0000 7f26a9e00700 1 --2- 172.21.15.49:0/1446777251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2684005000 0x7f26a40a5b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f26a40c49d0 tx=0x7f2694009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.980+0000 7f26a1600700 1 -- 172.21.15.49:0/1446777251 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694013680 con 0x7f2684005000 2024-01-22T05:05:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.980+0000 7f26a1600700 1 -- 172.21.15.49:0/1446777251 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26940137e0 con 0x7f2684005000 2024-01-22T05:05:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.980+0000 7f26ab200700 1 -- 172.21.15.49:0/1446777251 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a4161010 con 0x7f2684005000 2024-01-22T05:05:44.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.980+0000 7f26a1600700 1 -- 172.21.15.49:0/1446777251 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694013b80 con 0x7f2684005000 2024-01-22T05:05:44.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.980+0000 7f26ab200700 1 -- 172.21.15.49:0/1446777251 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a40a5ff0 con 0x7f2684005000 2024-01-22T05:05:44.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.980+0000 7f26ab200700 1 -- 172.21.15.49:0/1446777251 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a4065990 con 0x7f2684005000 2024-01-22T05:05:44.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.984+0000 7f26a1600700 1 -- 172.21.15.49:0/1446777251 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2694014440 con 0x7f2684005000 2024-01-22T05:05:44.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.984+0000 7f26a1600700 1 --2- 172.21.15.49:0/1446777251 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f267c05a540 0x7f267c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:44.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.984+0000 7f26a1600700 1 -- 172.21.15.49:0/1446777251 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f26940750f0 con 0x7f2684005000 2024-01-22T05:05:44.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.984+0000 7f26a9400700 1 --2- 172.21.15.49:0/1446777251 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f267c05a540 0x7f267c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:44.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.984+0000 7f26a9400700 1 --2- 172.21.15.49:0/1446777251 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f267c05a540 0x7f267c05ca00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f26a4150270 tx=0x7f268c00c040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:44.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:44.992+0000 7f26a1600700 1 -- 172.21.15.49:0/1446777251 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2694048710 con 0x7f2684005000 2024-01-22T05:05:45.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.192+0000 7f26ab200700 1 -- 172.21.15.49:0/1446777251 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f26a4069410 con 0x7f2684005000 2024-01-22T05:05:45.282 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-22T05:05:45.280+0000 7fb04c400700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:05:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.780+0000 7f26a1600700 1 -- 172.21.15.49:0/1446777251 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f269404bd30 con 0x7f2684005000 2024-01-22T05:05:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.784+0000 7f26ab200700 1 -- 172.21.15.49:0/1446777251 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f267c05a540 msgr2=0x7f267c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.784+0000 7f26ab200700 1 --2- 172.21.15.49:0/1446777251 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f267c05a540 0x7f267c05ca00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f26a4150270 tx=0x7f268c00c040).stop 2024-01-22T05:05:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.784+0000 7f26ab200700 1 -- 172.21.15.49:0/1446777251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2684005000 msgr2=0x7f26a40a5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.784+0000 7f26ab200700 1 --2- 172.21.15.49:0/1446777251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2684005000 0x7f26a40a5b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f26a40c49d0 tx=0x7f2694009060).stop 2024-01-22T05:05:45.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.784+0000 7f26ab200700 1 -- 172.21.15.49:0/1446777251 shutdown_connections 2024-01-22T05:05:45.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.784+0000 7f26ab200700 1 --2- 172.21.15.49:0/1446777251 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f267c05a540 0x7f267c05ca00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:45.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.784+0000 7f26ab200700 1 --2- 172.21.15.49:0/1446777251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a4152fb0 0x7f26a4153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:45.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.784+0000 7f26ab200700 1 --2- 172.21.15.49:0/1446777251 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26a4067a90 0x7f26a4067ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:45.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.784+0000 7f26ab200700 1 --2- 172.21.15.49:0/1446777251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2684005000 0x7f26a40a5b00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:45.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.784+0000 7f26ab200700 1 -- 172.21.15.49:0/1446777251 >> 172.21.15.49:0/1446777251 conn(0x7f26a40c8120 msgr2=0x7f26a40686b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:45.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.784+0000 7f26ab200700 1 -- 172.21.15.49:0/1446777251 shutdown_connections 2024-01-22T05:05:45.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.784+0000 7f26ab200700 1 -- 172.21.15.49:0/1446777251 wait complete. 2024-01-22T05:05:45.814 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:05:45.814 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:05:45.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.976+0000 7fd7a1e00700 1 Processor -- start 2024-01-22T05:05:45.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.976+0000 7fd7a1e00700 1 -- start start 2024-01-22T05:05:45.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.976+0000 7fd7a1e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd79c065240 0x7fd79c0644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:45.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd7a1e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd79c0649e0 0x7fd79c15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:45.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd7a1e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79c0c2700 con 0x7fd79c065620 2024-01-22T05:05:45.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd7a1e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79c0c29a0 con 0x7fd79c0649e0 2024-01-22T05:05:45.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd7a1e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79c0c2c80 con 0x7fd79c065240 2024-01-22T05:05:45.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd79be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd79c0649e0 0x7fd79c15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:45.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd79aa00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd79c065240 0x7fd79c0644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:45.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd79be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd79c0649e0 0x7fd79c15c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53882/0 (socket says 172.21.15.49:53882) 2024-01-22T05:05:45.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd79be00700 1 -- 172.21.15.49:0/3796496402 learned_addr learned my addr 172.21.15.49:0/3796496402 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:45.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd79aa00700 1 -- 172.21.15.49:0/3796496402 >> v2:172.21.15.49:3300/0 conn(0x7fd79c0649e0 msgr2=0x7fd79c15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:45.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd79aa00700 1 --2- 172.21.15.49:0/3796496402 >> v2:172.21.15.49:3300/0 conn(0x7fd79c0649e0 0x7fd79c15c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:45.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd79aa00700 1 -- 172.21.15.49:0/3796496402 >> v1:172.21.15.110:6789/0 conn(0x7fd79c065620 legacy=0x7fd79c15b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd79aa00700 1 -- 172.21.15.49:0/3796496402 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c0c2f60 con 0x7fd79c065240 2024-01-22T05:05:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd79be00700 1 --2- 172.21.15.49:0/3796496402 >> v2:172.21.15.49:3300/0 conn(0x7fd79c0649e0 0x7fd79c15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd79aa00700 1 --2- 172.21.15.49:0/3796496402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd79c065240 0x7fd79c0644f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fd79c060220 tx=0x7fd78c009060).ready entity=mon.1 client_cookie=165c14bb953a4949 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd799600700 1 -- 172.21.15.49:0/3796496402 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c00f510 con 0x7fd79c065240 2024-01-22T05:05:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd799600700 1 -- 172.21.15.49:0/3796496402 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c00f670 con 0x7fd79c065240 2024-01-22T05:05:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.980+0000 7fd799600700 1 -- 172.21.15.49:0/3796496402 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c00f9f0 con 0x7fd79c065240 2024-01-22T05:05:45.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.984+0000 7fd7a1e00700 1 -- 172.21.15.49:0/3796496402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd79c065240 msgr2=0x7fd79c0644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:45.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.984+0000 7fd7a1e00700 1 --2- 172.21.15.49:0/3796496402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd79c065240 0x7fd79c0644f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fd79c060220 tx=0x7fd78c009060).stop 2024-01-22T05:05:45.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.984+0000 7fd7a1e00700 1 -- 172.21.15.49:0/3796496402 shutdown_connections 2024-01-22T05:05:45.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.984+0000 7fd7a1e00700 1 --2- 172.21.15.49:0/3796496402 >> v2:172.21.15.49:3300/0 conn(0x7fd79c0649e0 0x7fd79c15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:45.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.984+0000 7fd7a1e00700 1 --2- 172.21.15.49:0/3796496402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd79c065240 0x7fd79c0644f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:45.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.984+0000 7fd7a1e00700 1 -- 172.21.15.49:0/3796496402 >> 172.21.15.49:0/3796496402 conn(0x7fd79c0c87f0 msgr2=0x7fd79c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:45.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.984+0000 7fd7a1e00700 1 -- 172.21.15.49:0/3796496402 shutdown_connections 2024-01-22T05:05:45.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.984+0000 7fd7a1e00700 1 -- 172.21.15.49:0/3796496402 wait complete. 2024-01-22T05:05:45.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.988+0000 7fd7a1e00700 1 Processor -- start 2024-01-22T05:05:45.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.988+0000 7fd7a1e00700 1 -- start start 2024-01-22T05:05:45.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd7a1e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd79c0649e0 0x7fd79c143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:45.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd7a1e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd79c065240 0x7fd79c0a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:45.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd7a1e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd79c065620 0x7fd79c153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:45.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd7a1e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c143530 con 0x7fd79c0649e0 2024-01-22T05:05:45.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd7a1e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c0bfa70 con 0x7fd79c065240 2024-01-22T05:05:45.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd7a1e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c0bee60 con 0x7fd79c065620 2024-01-22T05:05:45.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd79aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd79c0649e0 0x7fd79c143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:45.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd79aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd79c0649e0 0x7fd79c143040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53894/0 (socket says 172.21.15.49:53894) 2024-01-22T05:05:45.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd79aa00700 1 -- 172.21.15.49:0/1734546787 learned_addr learned my addr 172.21.15.49:0/1734546787 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:45.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd79be00700 1 --2- 172.21.15.49:0/1734546787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd79c065620 0x7fd79c153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:45.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd79a000700 1 --2- 172.21.15.49:0/1734546787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd79c065240 0x7fd79c0a7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:45.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd79aa00700 1 -- 172.21.15.49:0/1734546787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd79c065620 msgr2=0x7fd79c153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:45.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd79aa00700 1 --2- 172.21.15.49:0/1734546787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd79c065620 0x7fd79c153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:45.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd79aa00700 1 -- 172.21.15.49:0/1734546787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd79c065240 msgr2=0x7fd79c0a7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:45.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd79aa00700 1 --2- 172.21.15.49:0/1734546787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd79c065240 0x7fd79c0a7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:45.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd79aa00700 1 -- 172.21.15.49:0/1734546787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd794009ae0 con 0x7fd79c0649e0 2024-01-22T05:05:45.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd79be00700 1 --2- 172.21.15.49:0/1734546787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd79c065620 0x7fd79c153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:45.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd79aa00700 1 --2- 172.21.15.49:0/1734546787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd79c0649e0 0x7fd79c143040 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fd78c009dd0 tx=0x7fd78c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:45.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd792000700 1 -- 172.21.15.49:0/1734546787 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c00f7e0 con 0x7fd79c0649e0 2024-01-22T05:05:45.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd792000700 1 -- 172.21.15.49:0/1734546787 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c00f940 con 0x7fd79c0649e0 2024-01-22T05:05:45.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd7a1e00700 1 -- 172.21.15.49:0/1734546787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78c0092a0 con 0x7fd79c0649e0 2024-01-22T05:05:45.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd792000700 1 -- 172.21.15.49:0/1734546787 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c01b660 con 0x7fd79c0649e0 2024-01-22T05:05:45.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.992+0000 7fd7a1e00700 1 -- 172.21.15.49:0/1734546787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79c0bf420 con 0x7fd79c0649e0 2024-01-22T05:05:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.996+0000 7fd7a1e00700 1 -- 172.21.15.49:0/1734546787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79c047060 con 0x7fd79c0649e0 2024-01-22T05:05:46.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:45.996+0000 7fd792000700 1 -- 172.21.15.49:0/1734546787 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd78c01b9d0 con 0x7fd79c0649e0 2024-01-22T05:05:46.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.000+0000 7fd792000700 1 --2- 172.21.15.49:0/1734546787 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd77405a540 0x7fd77405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:46.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.000+0000 7fd792000700 1 -- 172.21.15.49:0/1734546787 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd78c0762e0 con 0x7fd79c0649e0 2024-01-22T05:05:46.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.000+0000 7fd79a000700 1 --2- 172.21.15.49:0/1734546787 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd77405a540 0x7fd77405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:46.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.000+0000 7fd79a000700 1 --2- 172.21.15.49:0/1734546787 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd77405a540 0x7fd77405ca00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fd79c156370 tx=0x7fd784007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:46.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.004+0000 7fd792000700 1 -- 172.21.15.49:0/1734546787 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd78c0498a0 con 0x7fd79c0649e0 2024-01-22T05:05:46.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.208+0000 7fd7a1e00700 1 -- 172.21.15.49:0/1734546787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd79c0c3240 con 0x7fd79c0649e0 2024-01-22T05:05:46.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.208+0000 7fd792000700 1 -- 172.21.15.49:0/1734546787 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fd78c04cec0 con 0x7fd79c0649e0 2024-01-22T05:05:46.212 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:46.212 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4066204164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":4066204164},{"type":"v1","addr":"172.21.15.110:6835","nonce":4066204164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/3793850760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3793850760},{"type":"v1","addr":"172.21.15.110:6834","nonce":3793850760}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/331321155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":331321155},{"type":"v1","addr":"172.21.15.49:6837","nonce":331321155}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:05:42.747172+0000","modified":"2024-01-22T05:05:45.769072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6836/3211151680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3211151680},{"type":"v1","addr":"172.21.15.49:6836","nonce":3211151680}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-22T05:05:46.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.212+0000 7fd7a1e00700 1 -- 172.21.15.49:0/1734546787 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd77405a540 msgr2=0x7fd77405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:46.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.212+0000 7fd7a1e00700 1 --2- 172.21.15.49:0/1734546787 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd77405a540 0x7fd77405ca00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fd79c156370 tx=0x7fd784007d40).stop 2024-01-22T05:05:46.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.212+0000 7fd7a1e00700 1 -- 172.21.15.49:0/1734546787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd79c0649e0 msgr2=0x7fd79c143040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:46.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.212+0000 7fd7a1e00700 1 --2- 172.21.15.49:0/1734546787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd79c0649e0 0x7fd79c143040 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fd78c009dd0 tx=0x7fd78c017000).stop 2024-01-22T05:05:46.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.212+0000 7fd7a1e00700 1 -- 172.21.15.49:0/1734546787 shutdown_connections 2024-01-22T05:05:46.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.212+0000 7fd7a1e00700 1 --2- 172.21.15.49:0/1734546787 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd77405a540 0x7fd77405ca00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.212+0000 7fd7a1e00700 1 --2- 172.21.15.49:0/1734546787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd79c065620 0x7fd79c153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.212+0000 7fd7a1e00700 1 --2- 172.21.15.49:0/1734546787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd79c065240 0x7fd79c0a7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.212+0000 7fd7a1e00700 1 --2- 172.21.15.49:0/1734546787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd79c0649e0 0x7fd79c143040 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.212+0000 7fd7a1e00700 1 -- 172.21.15.49:0/1734546787 >> 172.21.15.49:0/1734546787 conn(0x7fd79c0c87f0 msgr2=0x7fd79c0ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:46.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.212+0000 7fd7a1e00700 1 -- 172.21.15.49:0/1734546787 shutdown_connections 2024-01-22T05:05:46.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.216+0000 7fd7a1e00700 1 -- 172.21.15.49:0/1734546787 wait complete. 2024-01-22T05:05:46.221 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 17 2024-01-22T05:05:46.240 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:05:46.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.396+0000 7f90cf000700 1 Processor -- start 2024-01-22T05:05:46.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.400+0000 7f90cf000700 1 -- start start 2024-01-22T05:05:46.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.400+0000 7f90cf000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f90c80bcfa0 0x7f90c8151700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:46.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.400+0000 7f90cf000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f90c80abfa0 0x7f90c8065550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:46.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.400+0000 7f90cf000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c8068a60 con 0x7f90c8151bf0 2024-01-22T05:05:46.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.400+0000 7f90cf000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c80bb790 con 0x7f90c80abfa0 2024-01-22T05:05:46.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.400+0000 7f90cf000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c80bd380 con 0x7f90c80bcfa0 2024-01-22T05:05:46.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.400+0000 7f90c7400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f90c8151bf0 0x7f90c80ab890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51044/0 (socket says 172.21.15.49:51044) 2024-01-22T05:05:46.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.400+0000 7f90cd000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f90c80abfa0 0x7f90c8065550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:46.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.400+0000 7f90c7400700 1 -- 172.21.15.49:0/715170957 learned_addr learned my addr 172.21.15.49:0/715170957 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:46.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.400+0000 7f90c7e00700 1 --2- 172.21.15.49:0/715170957 >> v2:172.21.15.110:3300/0 conn(0x7f90c80bcfa0 0x7f90c8151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:46.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90c6a00700 1 -- 172.21.15.49:0/715170957 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905928403 0 0) 0x7f90c8068a60 con 0x7f90c8151bf0 2024-01-22T05:05:46.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90c6a00700 1 -- 172.21.15.49:0/715170957 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90a80033f0 con 0x7f90c8151bf0 2024-01-22T05:05:46.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90cd000700 1 -- 172.21.15.49:0/715170957 >> v2:172.21.15.110:3300/0 conn(0x7f90c80bcfa0 msgr2=0x7f90c8151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:46.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90cd000700 1 --2- 172.21.15.49:0/715170957 >> v2:172.21.15.110:3300/0 conn(0x7f90c80bcfa0 0x7f90c8151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90cd000700 1 -- 172.21.15.49:0/715170957 >> v1:172.21.15.49:6789/0 conn(0x7f90c8151bf0 legacy=0x7f90c80ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:46.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90cd000700 1 -- 172.21.15.49:0/715170957 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c8068460 con 0x7f90c80abfa0 2024-01-22T05:05:46.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90cd000700 1 --2- 172.21.15.49:0/715170957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80abfa0 0x7f90c8065550 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f90c8065060 tx=0x7f90c0009780).ready entity=mon.0 client_cookie=df6d740898079b46 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:46.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90c6a00700 1 -- 172.21.15.49:0/715170957 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c000e070 con 0x7f90c80abfa0 2024-01-22T05:05:46.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90c6a00700 1 -- 172.21.15.49:0/715170957 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c000bab0 con 0x7f90c80abfa0 2024-01-22T05:05:46.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90c6a00700 1 -- 172.21.15.49:0/715170957 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c000be30 con 0x7f90c80abfa0 2024-01-22T05:05:46.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90cf000700 1 -- 172.21.15.49:0/715170957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80abfa0 msgr2=0x7f90c8065550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:46.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90cf000700 1 --2- 172.21.15.49:0/715170957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80abfa0 0x7f90c8065550 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f90c8065060 tx=0x7f90c0009780).stop 2024-01-22T05:05:46.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90cf000700 1 -- 172.21.15.49:0/715170957 shutdown_connections 2024-01-22T05:05:46.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90cf000700 1 --2- 172.21.15.49:0/715170957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80abfa0 0x7f90c8065550 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90cf000700 1 --2- 172.21.15.49:0/715170957 >> v2:172.21.15.110:3300/0 conn(0x7f90c80bcfa0 0x7f90c8151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90cf000700 1 -- 172.21.15.49:0/715170957 >> 172.21.15.49:0/715170957 conn(0x7f90c80c6540 msgr2=0x7f90c80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:46.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90cf000700 1 -- 172.21.15.49:0/715170957 shutdown_connections 2024-01-22T05:05:46.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.404+0000 7f90cf000700 1 -- 172.21.15.49:0/715170957 wait complete. 2024-01-22T05:05:46.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.408+0000 7f90cf000700 1 Processor -- start 2024-01-22T05:05:46.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.408+0000 7f90cf000700 1 -- start start 2024-01-22T05:05:46.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90cf000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80abfa0 0x7f90c8149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:46.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90cf000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90c80bcfa0 0x7f90c80a9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:46.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90cf000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90c8151bf0 0x7f90c80a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:46.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90cf000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80aacc0 con 0x7f90c80abfa0 2024-01-22T05:05:46.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90cf000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c814a2b0 con 0x7f90c80bcfa0 2024-01-22T05:05:46.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90cf000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80aa140 con 0x7f90c8151bf0 2024-01-22T05:05:46.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90c7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80abfa0 0x7f90c8149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:46.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90c7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80abfa0 0x7f90c8149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53910/0 (socket says 172.21.15.49:53910) 2024-01-22T05:05:46.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90c7e00700 1 -- 172.21.15.49:0/1359163731 learned_addr learned my addr 172.21.15.49:0/1359163731 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:46.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90cd000700 1 --2- 172.21.15.49:0/1359163731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90c8151bf0 0x7f90c80a9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:46.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90c7400700 1 --2- 172.21.15.49:0/1359163731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90c80bcfa0 0x7f90c80a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:46.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90c7e00700 1 -- 172.21.15.49:0/1359163731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90c8151bf0 msgr2=0x7f90c80a9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:46.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90c7e00700 1 --2- 172.21.15.49:0/1359163731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90c8151bf0 0x7f90c80a9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90c7e00700 1 -- 172.21.15.49:0/1359163731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90c80bcfa0 msgr2=0x7f90c80a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:46.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90c7e00700 1 --2- 172.21.15.49:0/1359163731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90c80bcfa0 0x7f90c80a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90c7e00700 1 -- 172.21.15.49:0/1359163731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c0009a20 con 0x7f90c80abfa0 2024-01-22T05:05:46.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90c7400700 1 --2- 172.21.15.49:0/1359163731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90c80bcfa0 0x7f90c80a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:46.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90c7e00700 1 --2- 172.21.15.49:0/1359163731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80abfa0 0x7f90c8149dc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f90b800e930 tx=0x7f90b8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:46.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90bf400700 1 -- 172.21.15.49:0/1359163731 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b800c670 con 0x7f90c80abfa0 2024-01-22T05:05:46.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90bf400700 1 -- 172.21.15.49:0/1359163731 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b800c7d0 con 0x7f90c80abfa0 2024-01-22T05:05:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90cf000700 1 -- 172.21.15.49:0/1359163731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c80aa420 con 0x7f90c80abfa0 2024-01-22T05:05:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90bf400700 1 -- 172.21.15.49:0/1359163731 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b800cb50 con 0x7f90c80abfa0 2024-01-22T05:05:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.412+0000 7f90cf000700 1 -- 172.21.15.49:0/1359163731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c80aa9e0 con 0x7f90c80abfa0 2024-01-22T05:05:46.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.416+0000 7f90cf000700 1 -- 172.21.15.49:0/1359163731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c8047060 con 0x7f90c80abfa0 2024-01-22T05:05:46.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.416+0000 7f90bf400700 1 -- 172.21.15.49:0/1359163731 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f90b801b400 con 0x7f90c80abfa0 2024-01-22T05:05:46.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.416+0000 7f90bf400700 1 --2- 172.21.15.49:0/1359163731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f90a005a510 0x7f90a005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:46.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.416+0000 7f90bf400700 1 -- 172.21.15.49:0/1359163731 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f90b8074ea0 con 0x7f90c80abfa0 2024-01-22T05:05:46.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.416+0000 7f90c7400700 1 --2- 172.21.15.49:0/1359163731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f90a005a510 0x7f90a005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:46.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.416+0000 7f90c7400700 1 --2- 172.21.15.49:0/1359163731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f90a005a510 0x7f90a005c9d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f90b0007fd0 tx=0x7f90b0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:46.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.424+0000 7f90bf400700 1 -- 172.21.15.49:0/1359163731 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f90b8048400 con 0x7f90c80abfa0 2024-01-22T05:05:46.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.592+0000 7f90cf000700 1 -- 172.21.15.49:0/1359163731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90c80c1dc0 con 0x7f90c80abfa0 2024-01-22T05:05:46.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.592+0000 7f90bf400700 1 -- 172.21.15.49:0/1359163731 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17164 (secure 0 0 0) 0x7f90b804ba20 con 0x7f90c80abfa0 2024-01-22T05:05:46.598 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:46.598 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:05:43.753442+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:05:40.764447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-01-22T05:05:41.767543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:05:46.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.596+0000 7f90cf000700 1 -- 172.21.15.49:0/1359163731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f90a005a510 msgr2=0x7f90a005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:46.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.596+0000 7f90cf000700 1 --2- 172.21.15.49:0/1359163731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f90a005a510 0x7f90a005c9d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f90b0007fd0 tx=0x7f90b0009040).stop 2024-01-22T05:05:46.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.596+0000 7f90cf000700 1 -- 172.21.15.49:0/1359163731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80abfa0 msgr2=0x7f90c8149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:46.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.596+0000 7f90cf000700 1 --2- 172.21.15.49:0/1359163731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80abfa0 0x7f90c8149dc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f90b800e930 tx=0x7f90b8009060).stop 2024-01-22T05:05:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.596+0000 7f90cf000700 1 -- 172.21.15.49:0/1359163731 shutdown_connections 2024-01-22T05:05:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.596+0000 7f90cf000700 1 --2- 172.21.15.49:0/1359163731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f90a005a510 0x7f90a005c9d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.596+0000 7f90cf000700 1 --2- 172.21.15.49:0/1359163731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90c8151bf0 0x7f90c80a9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.596+0000 7f90cf000700 1 --2- 172.21.15.49:0/1359163731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90c80bcfa0 0x7f90c80a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.596+0000 7f90cf000700 1 --2- 172.21.15.49:0/1359163731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80abfa0 0x7f90c8149dc0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.596+0000 7f90cf000700 1 -- 172.21.15.49:0/1359163731 >> 172.21.15.49:0/1359163731 conn(0x7f90c80c6540 msgr2=0x7f90c8066330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.596+0000 7f90cf000700 1 -- 172.21.15.49:0/1359163731 shutdown_connections 2024-01-22T05:05:46.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.596+0000 7f90cf000700 1 -- 172.21.15.49:0/1359163731 wait complete. 2024-01-22T05:05:46.625 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:05:46.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:05:46.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.780+0000 7f6388400700 1 Processor -- start 2024-01-22T05:05:46.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.780+0000 7f6388400700 1 -- start start 2024-01-22T05:05:46.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.784+0000 7f6388400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f63801554a0 0x7f6380067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:46.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.784+0000 7f6388400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6380151a60 0x7f63800c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:46.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.784+0000 7f6388400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63800c5840 con 0x7f63800c8e70 2024-01-22T05:05:46.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.784+0000 7f6388400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6380155cf0 con 0x7f63801554a0 2024-01-22T05:05:46.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.784+0000 7f6388400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6380155fd0 con 0x7f6380151a60 2024-01-22T05:05:46.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.784+0000 7f6385a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f63801554a0 0x7f6380067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:46.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.784+0000 7f6385a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f63801554a0 0x7f6380067a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53926/0 (socket says 172.21.15.49:53926) 2024-01-22T05:05:46.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.784+0000 7f6386e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6380151a60 0x7f63800c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:46.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.784+0000 7f6385a00700 1 -- 172.21.15.49:0/615149405 learned_addr learned my addr 172.21.15.49:0/615149405 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:46.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.784+0000 7f6385000700 1 --1- 172.21.15.49:0/615149405 >> v1:172.21.15.110:6789/0 conn(0x7f63800c8e70 0x7f6380151350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:39686/0 (socket says 172.21.15.49:39686) 2024-01-22T05:05:46.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.784+0000 7f6385a00700 1 -- 172.21.15.49:0/615149405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6380151a60 msgr2=0x7f63800c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:46.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.784+0000 7f6385a00700 1 --2- 172.21.15.49:0/615149405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6380151a60 0x7f63800c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.784+0000 7f6385a00700 1 -- 172.21.15.49:0/615149405 >> v1:172.21.15.110:6789/0 conn(0x7f63800c8e70 legacy=0x7f6380151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:46.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.788+0000 7f6385a00700 1 -- 172.21.15.49:0/615149405 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63801562b0 con 0x7f63801554a0 2024-01-22T05:05:46.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.788+0000 7f6385a00700 1 --2- 172.21.15.49:0/615149405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63801554a0 0x7f6380067a90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f6370006fd0 tx=0x7f63700090f0).ready entity=mon.0 client_cookie=cde795a40687911a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:46.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.788+0000 7f637fe00700 1 -- 172.21.15.49:0/615149405 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637000b580 con 0x7f63801554a0 2024-01-22T05:05:46.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.788+0000 7f637fe00700 1 -- 172.21.15.49:0/615149405 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637000b6e0 con 0x7f63801554a0 2024-01-22T05:05:46.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.788+0000 7f637fe00700 1 -- 172.21.15.49:0/615149405 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637000ba60 con 0x7f63801554a0 2024-01-22T05:05:46.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.788+0000 7f6388400700 1 -- 172.21.15.49:0/615149405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63801554a0 msgr2=0x7f6380067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:46.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.788+0000 7f6388400700 1 --2- 172.21.15.49:0/615149405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63801554a0 0x7f6380067a90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f6370006fd0 tx=0x7f63700090f0).stop 2024-01-22T05:05:46.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.788+0000 7f6388400700 1 -- 172.21.15.49:0/615149405 shutdown_connections 2024-01-22T05:05:46.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.788+0000 7f6388400700 1 --2- 172.21.15.49:0/615149405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6380151a60 0x7f63800c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.788+0000 7f6388400700 1 --2- 172.21.15.49:0/615149405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63801554a0 0x7f6380067a90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.788+0000 7f6388400700 1 -- 172.21.15.49:0/615149405 >> 172.21.15.49:0/615149405 conn(0x7f63800c9f50 msgr2=0x7f63800ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:46.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.788+0000 7f6388400700 1 -- 172.21.15.49:0/615149405 shutdown_connections 2024-01-22T05:05:46.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.788+0000 7f6388400700 1 -- 172.21.15.49:0/615149405 wait complete. 2024-01-22T05:05:46.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.792+0000 7f6388400700 1 Processor -- start 2024-01-22T05:05:46.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.792+0000 7f6388400700 1 -- start start 2024-01-22T05:05:46.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.792+0000 7f6388400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63800c8e70 0x7f63801533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:46.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.792+0000 7f6388400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6380151a60 0x7f63801538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:46.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.792+0000 7f6388400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63801554a0 0x7f63800ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:46.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.792+0000 7f6388400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638013e280 con 0x7f6380151a60 2024-01-22T05:05:46.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.792+0000 7f6388400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6380154980 con 0x7f63800c8e70 2024-01-22T05:05:46.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.792+0000 7f6388400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63801540e0 con 0x7f63801554a0 2024-01-22T05:05:46.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.792+0000 7f6385000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6380151a60 0x7f63801538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:46.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f6385000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6380151a60 0x7f63801538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53932/0 (socket says 172.21.15.49:53932) 2024-01-22T05:05:46.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f6385000700 1 -- 172.21.15.49:0/434539732 learned_addr learned my addr 172.21.15.49:0/434539732 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:46.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f6386e00700 1 --2- 172.21.15.49:0/434539732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63801554a0 0x7f63800ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:46.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f6385a00700 1 --2- 172.21.15.49:0/434539732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63800c8e70 0x7f63801533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:46.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f6385000700 1 -- 172.21.15.49:0/434539732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63801554a0 msgr2=0x7f63800ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:46.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f6385000700 1 --2- 172.21.15.49:0/434539732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63801554a0 0x7f63800ab610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f6385000700 1 -- 172.21.15.49:0/434539732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63800c8e70 msgr2=0x7f63801533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:46.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f6385000700 1 --2- 172.21.15.49:0/434539732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63800c8e70 0x7f63801533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:46.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f6385000700 1 -- 172.21.15.49:0/434539732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6370009370 con 0x7f6380151a60 2024-01-22T05:05:46.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f6386e00700 1 --2- 172.21.15.49:0/434539732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63801554a0 0x7f63800ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:46.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f6385000700 1 --2- 172.21.15.49:0/434539732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6380151a60 0x7f63801538a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f6368007fd0 tx=0x7f6368007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:46.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f637cc00700 1 -- 172.21.15.49:0/434539732 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636800ce10 con 0x7f6380151a60 2024-01-22T05:05:46.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f637cc00700 1 -- 172.21.15.49:0/434539732 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63680072e0 con 0x7f6380151a60 2024-01-22T05:05:46.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f637cc00700 1 -- 172.21.15.49:0/434539732 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63680056e0 con 0x7f6380151a60 2024-01-22T05:05:46.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f6388400700 1 -- 172.21.15.49:0/434539732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6380154420 con 0x7f6380151a60 2024-01-22T05:05:46.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.796+0000 7f6388400700 1 -- 172.21.15.49:0/434539732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6380153d90 con 0x7f6380151a60 2024-01-22T05:05:46.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.800+0000 7f6388400700 1 -- 172.21.15.49:0/434539732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6380047060 con 0x7f6380151a60 2024-01-22T05:05:46.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.800+0000 7f637cc00700 1 -- 172.21.15.49:0/434539732 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6368005ad0 con 0x7f6380151a60 2024-01-22T05:05:46.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.800+0000 7f637cc00700 1 --2- 172.21.15.49:0/434539732 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f635805a510 0x7f635805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:46.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.800+0000 7f637cc00700 1 -- 172.21.15.49:0/434539732 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f6368073f70 con 0x7f6380151a60 2024-01-22T05:05:46.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.800+0000 7f6385a00700 1 --2- 172.21.15.49:0/434539732 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f635805a510 0x7f635805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:46.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.800+0000 7f6385a00700 1 --2- 172.21.15.49:0/434539732 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f635805a510 0x7f635805c9d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f6370009fd0 tx=0x7f6370017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:46.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.808+0000 7f637cc00700 1 -- 172.21.15.49:0/434539732 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f63680475f0 con 0x7f6380151a60 2024-01-22T05:05:46.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.968+0000 7f6388400700 1 -- 172.21.15.49:0/434539732 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63800c5460 con 0x7f635805a510 2024-01-22T05:05:46.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.988+0000 7f637cc00700 1 -- 172.21.15.49:0/434539732 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355106 (secure 0 0 0) 0x7f63800c5460 con 0x7f635805a510 2024-01-22T05:05:46.995 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:47.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.996+0000 7f6388400700 1 -- 172.21.15.49:0/434539732 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f635805a510 msgr2=0x7f635805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:47.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.996+0000 7f6388400700 1 --2- 172.21.15.49:0/434539732 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f635805a510 0x7f635805c9d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f6370009fd0 tx=0x7f6370017000).stop 2024-01-22T05:05:47.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.996+0000 7f6388400700 1 -- 172.21.15.49:0/434539732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6380151a60 msgr2=0x7f63801538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:47.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.996+0000 7f6388400700 1 --2- 172.21.15.49:0/434539732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6380151a60 0x7f63801538a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f6368007fd0 tx=0x7f6368007df0).stop 2024-01-22T05:05:47.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.996+0000 7f6388400700 1 -- 172.21.15.49:0/434539732 shutdown_connections 2024-01-22T05:05:47.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.996+0000 7f6388400700 1 --2- 172.21.15.49:0/434539732 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f635805a510 0x7f635805c9d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.996+0000 7f6388400700 1 --2- 172.21.15.49:0/434539732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63801554a0 0x7f63800ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.996+0000 7f6388400700 1 --2- 172.21.15.49:0/434539732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6380151a60 0x7f63801538a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.996+0000 7f6388400700 1 --2- 172.21.15.49:0/434539732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63800c8e70 0x7f63801533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:46.996+0000 7f6388400700 1 -- 172.21.15.49:0/434539732 >> 172.21.15.49:0/434539732 conn(0x7f63800c9f50 msgr2=0x7f63800c5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:47.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.000+0000 7f6388400700 1 -- 172.21.15.49:0/434539732 shutdown_connections 2024-01-22T05:05:47.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.000+0000 7f6388400700 1 -- 172.21.15.49:0/434539732 wait complete. 2024-01-22T05:05:47.005 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:05:47.022 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-01-22T05:05:45.248760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2380096,"kb_used_data":3328,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594624,"statfs":{"total":773094113280,"available":770656894976,"internally_reserved":0,"allocated":3407872,"data_stored":1517888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5501,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-53,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.993450"},"pg_stats":[{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329251+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348631+0000","last_change":"2024-01-22T05:05:42.348729+0000","last_active":"2024-01-22T05:05:42.348631+0000","last_peered":"2024-01-22T05:05:42.348631+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348416+0000","last_became_peered":"2024-01-22T05:05:42.348416+0000","last_unstale":"2024-01-22T05:05:42.348631+0000","last_undegraded":"2024-01-22T05:05:42.348631+0000","last_fullsized":"2024-01-22T05:05:42.348631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323114+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.333060+0000","last_change":"2024-01-22T05:05:42.333186+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.333060+0000","last_undegraded":"2024-01-22T05:05:42.333060+0000","last_fullsized":"2024-01-22T05:05:42.333060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324407+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.354145+0000","last_change":"2024-01-22T05:05:42.354261+0000","last_active":"2024-01-22T05:05:42.354145+0000","last_peered":"2024-01-22T05:05:42.354145+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347227+0000","last_became_peered":"2024-01-22T05:05:42.347227+0000","last_unstale":"2024-01-22T05:05:42.354145+0000","last_undegraded":"2024-01-22T05:05:42.354145+0000","last_fullsized":"2024-01-22T05:05:42.354145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325801+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.314509+0000","last_change":"2024-01-22T05:05:42.314824+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.314509+0000","last_undegraded":"2024-01-22T05:05:42.314509+0000","last_fullsized":"2024-01-22T05:05:42.314509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.335660+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.338151+0000","last_change":"2024-01-22T05:05:42.338151+0000","last_active":"2024-01-22T05:05:42.338151+0000","last_peered":"2024-01-22T05:05:42.338151+0000","last_clean":"2024-01-22T05:05:42.338151+0000","last_became_active":"2024-01-22T05:05:42.337821+0000","last_became_peered":"2024-01-22T05:05:42.337821+0000","last_unstale":"2024-01-22T05:05:42.338151+0000","last_undegraded":"2024-01-22T05:05:42.338151+0000","last_fullsized":"2024-01-22T05:05:42.338151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324800+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.319442+0000","last_change":"2024-01-22T05:05:42.319615+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.319442+0000","last_undegraded":"2024-01-22T05:05:42.319442+0000","last_fullsized":"2024-01-22T05:05:42.319442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325085+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341452+0000","last_change":"2024-01-22T05:05:42.341452+0000","last_active":"2024-01-22T05:05:42.341452+0000","last_peered":"2024-01-22T05:05:42.341452+0000","last_clean":"2024-01-22T05:05:42.341452+0000","last_became_active":"2024-01-22T05:05:42.338600+0000","last_became_peered":"2024-01-22T05:05:42.338600+0000","last_unstale":"2024-01-22T05:05:42.341452+0000","last_undegraded":"2024-01-22T05:05:42.341452+0000","last_fullsized":"2024-01-22T05:05:42.341452+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323074+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.346315+0000","last_change":"2024-01-22T05:05:42.346397+0000","last_active":"2024-01-22T05:05:42.346315+0000","last_peered":"2024-01-22T05:05:42.346315+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.346085+0000","last_became_peered":"2024-01-22T05:05:42.346085+0000","last_unstale":"2024-01-22T05:05:42.346315+0000","last_undegraded":"2024-01-22T05:05:42.346315+0000","last_fullsized":"2024-01-22T05:05:42.346315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325729+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.352390+0000","last_change":"2024-01-22T05:05:42.352458+0000","last_active":"2024-01-22T05:05:42.352390+0000","last_peered":"2024-01-22T05:05:42.352390+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.352103+0000","last_became_peered":"2024-01-22T05:05:42.352103+0000","last_unstale":"2024-01-22T05:05:42.352390+0000","last_undegraded":"2024-01-22T05:05:42.352390+0000","last_fullsized":"2024-01-22T05:05:42.352390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329216+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342554+0000","last_change":"2024-01-22T05:05:42.342554+0000","last_active":"2024-01-22T05:05:42.342554+0000","last_peered":"2024-01-22T05:05:42.342554+0000","last_clean":"2024-01-22T05:05:42.342554+0000","last_became_active":"2024-01-22T05:05:42.342223+0000","last_became_peered":"2024-01-22T05:05:42.342223+0000","last_unstale":"2024-01-22T05:05:42.342554+0000","last_undegraded":"2024-01-22T05:05:42.342554+0000","last_fullsized":"2024-01-22T05:05:42.342554+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.330639+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.350418+0000","last_change":"2024-01-22T05:05:42.350418+0000","last_active":"2024-01-22T05:05:42.350418+0000","last_peered":"2024-01-22T05:05:42.350418+0000","last_clean":"2024-01-22T05:05:42.350418+0000","last_became_active":"2024-01-22T05:05:42.348672+0000","last_became_peered":"2024-01-22T05:05:42.348672+0000","last_unstale":"2024-01-22T05:05:42.350418+0000","last_undegraded":"2024-01-22T05:05:42.350418+0000","last_fullsized":"2024-01-22T05:05:42.350418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324999+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342349+0000","last_change":"2024-01-22T05:05:42.342458+0000","last_active":"2024-01-22T05:05:42.342349+0000","last_peered":"2024-01-22T05:05:42.342349+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.341925+0000","last_became_peered":"2024-01-22T05:05:42.341925+0000","last_unstale":"2024-01-22T05:05:42.342349+0000","last_undegraded":"2024-01-22T05:05:42.342349+0000","last_fullsized":"2024-01-22T05:05:42.342349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.326053+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342444+0000","last_change":"2024-01-22T05:05:42.342444+0000","last_active":"2024-01-22T05:05:42.342444+0000","last_peered":"2024-01-22T05:05:42.342444+0000","last_clean":"2024-01-22T05:05:42.342444+0000","last_became_active":"2024-01-22T05:05:42.342153+0000","last_became_peered":"2024-01-22T05:05:42.342153+0000","last_unstale":"2024-01-22T05:05:42.342444+0000","last_undegraded":"2024-01-22T05:05:42.342444+0000","last_fullsized":"2024-01-22T05:05:42.342444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322050+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348473+0000","last_change":"2024-01-22T05:05:42.348591+0000","last_active":"2024-01-22T05:05:42.348473+0000","last_peered":"2024-01-22T05:05:42.348473+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348005+0000","last_became_peered":"2024-01-22T05:05:42.348005+0000","last_unstale":"2024-01-22T05:05:42.348473+0000","last_undegraded":"2024-01-22T05:05:42.348473+0000","last_fullsized":"2024-01-22T05:05:42.348473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.316716+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.345568+0000","last_change":"2024-01-22T05:05:42.345568+0000","last_active":"2024-01-22T05:05:42.345568+0000","last_peered":"2024-01-22T05:05:42.345568+0000","last_clean":"2024-01-22T05:05:42.345568+0000","last_became_active":"2024-01-22T05:05:42.344946+0000","last_became_peered":"2024-01-22T05:05:42.344946+0000","last_unstale":"2024-01-22T05:05:42.345568+0000","last_undegraded":"2024-01-22T05:05:42.345568+0000","last_fullsized":"2024-01-22T05:05:42.345568+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329749+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349037+0000","last_change":"2024-01-22T05:05:42.349106+0000","last_active":"2024-01-22T05:05:42.349037+0000","last_peered":"2024-01-22T05:05:42.349037+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348826+0000","last_became_peered":"2024-01-22T05:05:42.348826+0000","last_unstale":"2024-01-22T05:05:42.349037+0000","last_undegraded":"2024-01-22T05:05:42.349037+0000","last_fullsized":"2024-01-22T05:05:42.349037+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328668+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.329674+0000","last_change":"2024-01-22T05:05:42.329791+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.329674+0000","last_undegraded":"2024-01-22T05:05:42.329674+0000","last_fullsized":"2024-01-22T05:05:42.329674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324173+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349214+0000","last_change":"2024-01-22T05:05:42.350366+0000","last_active":"2024-01-22T05:05:42.349214+0000","last_peered":"2024-01-22T05:05:42.349214+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348991+0000","last_became_peered":"2024-01-22T05:05:42.348991+0000","last_unstale":"2024-01-22T05:05:42.349214+0000","last_undegraded":"2024-01-22T05:05:42.349214+0000","last_fullsized":"2024-01-22T05:05:42.349214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322622+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342802+0000","last_change":"2024-01-22T05:05:42.342877+0000","last_active":"2024-01-22T05:05:42.342802+0000","last_peered":"2024-01-22T05:05:42.342802+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.342414+0000","last_became_peered":"2024-01-22T05:05:42.342414+0000","last_unstale":"2024-01-22T05:05:42.342802+0000","last_undegraded":"2024-01-22T05:05:42.342802+0000","last_fullsized":"2024-01-22T05:05:42.342802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.319316+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341779+0000","last_change":"2024-01-22T05:05:42.341779+0000","last_active":"2024-01-22T05:05:42.341779+0000","last_peered":"2024-01-22T05:05:42.341779+0000","last_clean":"2024-01-22T05:05:42.341779+0000","last_became_active":"2024-01-22T05:05:42.341427+0000","last_became_peered":"2024-01-22T05:05:42.341427+0000","last_unstale":"2024-01-22T05:05:42.341779+0000","last_undegraded":"2024-01-22T05:05:42.341779+0000","last_fullsized":"2024-01-22T05:05:42.341779+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325476+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344902+0000","last_change":"2024-01-22T05:05:42.344902+0000","last_active":"2024-01-22T05:05:42.344902+0000","last_peered":"2024-01-22T05:05:42.344902+0000","last_clean":"2024-01-22T05:05:42.344902+0000","last_became_active":"2024-01-22T05:05:42.344587+0000","last_became_peered":"2024-01-22T05:05:42.344587+0000","last_unstale":"2024-01-22T05:05:42.344902+0000","last_undegraded":"2024-01-22T05:05:42.344902+0000","last_fullsized":"2024-01-22T05:05:42.344902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.331408+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.328734+0000","last_change":"2024-01-22T05:05:42.328858+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.328734+0000","last_undegraded":"2024-01-22T05:05:42.328734+0000","last_fullsized":"2024-01-22T05:05:42.328734+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.315913+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325052+0000","last_change":"2024-01-22T05:05:42.325186+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325052+0000","last_undegraded":"2024-01-22T05:05:42.325052+0000","last_fullsized":"2024-01-22T05:05:42.325052+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318073+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.347547+0000","last_change":"2024-01-22T05:05:42.347615+0000","last_active":"2024-01-22T05:05:42.347547+0000","last_peered":"2024-01-22T05:05:42.347547+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347347+0000","last_became_peered":"2024-01-22T05:05:42.347347+0000","last_unstale":"2024-01-22T05:05:42.347547+0000","last_undegraded":"2024-01-22T05:05:42.347547+0000","last_fullsized":"2024-01-22T05:05:42.347547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.321175+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342693+0000","last_change":"2024-01-22T05:05:42.342693+0000","last_active":"2024-01-22T05:05:42.342693+0000","last_peered":"2024-01-22T05:05:42.342693+0000","last_clean":"2024-01-22T05:05:42.342693+0000","last_became_active":"2024-01-22T05:05:42.342424+0000","last_became_peered":"2024-01-22T05:05:42.342424+0000","last_unstale":"2024-01-22T05:05:42.342693+0000","last_undegraded":"2024-01-22T05:05:42.342693+0000","last_fullsized":"2024-01-22T05:05:42.342693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.320463+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349899+0000","last_change":"2024-01-22T05:05:42.349978+0000","last_active":"2024-01-22T05:05:42.349899+0000","last_peered":"2024-01-22T05:05:42.349899+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349679+0000","last_became_peered":"2024-01-22T05:05:42.349679+0000","last_unstale":"2024-01-22T05:05:42.349899+0000","last_undegraded":"2024-01-22T05:05:42.349899+0000","last_fullsized":"2024-01-22T05:05:42.349899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324676+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.347988+0000","last_change":"2024-01-22T05:05:42.347988+0000","last_active":"2024-01-22T05:05:42.347988+0000","last_peered":"2024-01-22T05:05:42.347988+0000","last_clean":"2024-01-22T05:05:42.347988+0000","last_became_active":"2024-01-22T05:05:42.347693+0000","last_became_peered":"2024-01-22T05:05:42.347693+0000","last_unstale":"2024-01-22T05:05:42.347988+0000","last_undegraded":"2024-01-22T05:05:42.347988+0000","last_fullsized":"2024-01-22T05:05:42.347988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325321+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.323932+0000","last_change":"2024-01-22T05:05:42.324056+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.323932+0000","last_undegraded":"2024-01-22T05:05:42.323932+0000","last_fullsized":"2024-01-22T05:05:42.323932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.330033+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.338150+0000","last_change":"2024-01-22T05:05:42.338150+0000","last_active":"2024-01-22T05:05:42.338150+0000","last_peered":"2024-01-22T05:05:42.338150+0000","last_clean":"2024-01-22T05:05:42.338150+0000","last_became_active":"2024-01-22T05:05:42.337828+0000","last_became_peered":"2024-01-22T05:05:42.337828+0000","last_unstale":"2024-01-22T05:05:42.338150+0000","last_undegraded":"2024-01-22T05:05:42.338150+0000","last_fullsized":"2024-01-22T05:05:42.338150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318707+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.317908+0000","last_change":"2024-01-22T05:05:42.318067+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.317908+0000","last_undegraded":"2024-01-22T05:05:42.317908+0000","last_fullsized":"2024-01-22T05:05:42.317908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":["6","3"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.321114+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325385+0000","last_change":"2024-01-22T05:05:42.325514+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325385+0000","last_undegraded":"2024-01-22T05:05:42.325385+0000","last_fullsized":"2024-01-22T05:05:42.325385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329246+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.337984+0000","last_change":"2024-01-22T05:05:42.337984+0000","last_active":"2024-01-22T05:05:42.337984+0000","last_peered":"2024-01-22T05:05:42.337984+0000","last_clean":"2024-01-22T05:05:42.337984+0000","last_became_active":"2024-01-22T05:05:42.337050+0000","last_became_peered":"2024-01-22T05:05:42.337050+0000","last_unstale":"2024-01-22T05:05:42.337984+0000","last_undegraded":"2024-01-22T05:05:42.337984+0000","last_fullsized":"2024-01-22T05:05:42.337984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323301+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342175+0000","last_change":"2024-01-22T05:05:42.342250+0000","last_active":"2024-01-22T05:05:42.342175+0000","last_peered":"2024-01-22T05:05:42.342175+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.341974+0000","last_became_peered":"2024-01-22T05:05:42.341974+0000","last_unstale":"2024-01-22T05:05:42.342175+0000","last_undegraded":"2024-01-22T05:05:42.342175+0000","last_fullsized":"2024-01-22T05:05:42.342175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.319539+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341030+0000","last_change":"2024-01-22T05:05:42.341030+0000","last_active":"2024-01-22T05:05:42.341030+0000","last_peered":"2024-01-22T05:05:42.341030+0000","last_clean":"2024-01-22T05:05:42.341030+0000","last_became_active":"2024-01-22T05:05:42.340774+0000","last_became_peered":"2024-01-22T05:05:42.340774+0000","last_unstale":"2024-01-22T05:05:42.341030+0000","last_undegraded":"2024-01-22T05:05:42.341030+0000","last_fullsized":"2024-01-22T05:05:42.341030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324162+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.350752+0000","last_change":"2024-01-22T05:05:42.350837+0000","last_active":"2024-01-22T05:05:42.350752+0000","last_peered":"2024-01-22T05:05:42.350752+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.350332+0000","last_became_peered":"2024-01-22T05:05:42.350332+0000","last_unstale":"2024-01-22T05:05:42.350752+0000","last_undegraded":"2024-01-22T05:05:42.350752+0000","last_fullsized":"2024-01-22T05:05:42.350752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323993+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349729+0000","last_change":"2024-01-22T05:05:42.349799+0000","last_active":"2024-01-22T05:05:42.349729+0000","last_peered":"2024-01-22T05:05:42.349729+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349522+0000","last_became_peered":"2024-01-22T05:05:42.349522+0000","last_unstale":"2024-01-22T05:05:42.349729+0000","last_undegraded":"2024-01-22T05:05:42.349729+0000","last_fullsized":"2024-01-22T05:05:42.349729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329646+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349792+0000","last_change":"2024-01-22T05:05:42.349880+0000","last_active":"2024-01-22T05:05:42.349792+0000","last_peered":"2024-01-22T05:05:42.349792+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349346+0000","last_became_peered":"2024-01-22T05:05:42.349346+0000","last_unstale":"2024-01-22T05:05:42.349792+0000","last_undegraded":"2024-01-22T05:05:42.349792+0000","last_fullsized":"2024-01-22T05:05:42.349792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325410+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348272+0000","last_change":"2024-01-22T05:05:42.348366+0000","last_active":"2024-01-22T05:05:42.348272+0000","last_peered":"2024-01-22T05:05:42.348272+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347668+0000","last_became_peered":"2024-01-22T05:05:42.347668+0000","last_unstale":"2024-01-22T05:05:42.348272+0000","last_undegraded":"2024-01-22T05:05:42.348272+0000","last_fullsized":"2024-01-22T05:05:42.348272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324600+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.345773+0000","last_change":"2024-01-22T05:05:42.345773+0000","last_active":"2024-01-22T05:05:42.345773+0000","last_peered":"2024-01-22T05:05:42.345773+0000","last_clean":"2024-01-22T05:05:42.345773+0000","last_became_active":"2024-01-22T05:05:42.345307+0000","last_became_peered":"2024-01-22T05:05:42.345307+0000","last_unstale":"2024-01-22T05:05:42.345773+0000","last_undegraded":"2024-01-22T05:05:42.345773+0000","last_fullsized":"2024-01-22T05:05:42.345773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.317581+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344392+0000","last_change":"2024-01-22T05:05:42.344465+0000","last_active":"2024-01-22T05:05:42.344392+0000","last_peered":"2024-01-22T05:05:42.344392+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.344171+0000","last_became_peered":"2024-01-22T05:05:42.344171+0000","last_unstale":"2024-01-22T05:05:42.344392+0000","last_undegraded":"2024-01-22T05:05:42.344392+0000","last_fullsized":"2024-01-22T05:05:42.344392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328235+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339764+0000","last_change":"2024-01-22T05:05:42.339764+0000","last_active":"2024-01-22T05:05:42.339764+0000","last_peered":"2024-01-22T05:05:42.339764+0000","last_clean":"2024-01-22T05:05:42.339764+0000","last_became_active":"2024-01-22T05:05:42.339442+0000","last_became_peered":"2024-01-22T05:05:42.339442+0000","last_unstale":"2024-01-22T05:05:42.339764+0000","last_undegraded":"2024-01-22T05:05:42.339764+0000","last_fullsized":"2024-01-22T05:05:42.339764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322637+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339443+0000","last_change":"2024-01-22T05:05:42.339443+0000","last_active":"2024-01-22T05:05:42.339443+0000","last_peered":"2024-01-22T05:05:42.339443+0000","last_clean":"2024-01-22T05:05:42.339443+0000","last_became_active":"2024-01-22T05:05:42.339151+0000","last_became_peered":"2024-01-22T05:05:42.339151+0000","last_unstale":"2024-01-22T05:05:42.339443+0000","last_undegraded":"2024-01-22T05:05:42.339443+0000","last_fullsized":"2024-01-22T05:05:42.339443+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.326457+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341590+0000","last_change":"2024-01-22T05:05:42.341590+0000","last_active":"2024-01-22T05:05:42.341590+0000","last_peered":"2024-01-22T05:05:42.341590+0000","last_clean":"2024-01-22T05:05:42.341590+0000","last_became_active":"2024-01-22T05:05:42.340992+0000","last_became_peered":"2024-01-22T05:05:42.340992+0000","last_unstale":"2024-01-22T05:05:42.341590+0000","last_undegraded":"2024-01-22T05:05:42.341590+0000","last_fullsized":"2024-01-22T05:05:42.341590+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324144+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339284+0000","last_change":"2024-01-22T05:05:42.339386+0000","last_active":"2024-01-22T05:05:42.339284+0000","last_peered":"2024-01-22T05:05:42.339284+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.338881+0000","last_became_peered":"2024-01-22T05:05:42.338881+0000","last_unstale":"2024-01-22T05:05:42.339284+0000","last_undegraded":"2024-01-22T05:05:42.339284+0000","last_fullsized":"2024-01-22T05:05:42.339284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.320038+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349596+0000","last_change":"2024-01-22T05:05:42.349679+0000","last_active":"2024-01-22T05:05:42.349596+0000","last_peered":"2024-01-22T05:05:42.349596+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349307+0000","last_became_peered":"2024-01-22T05:05:42.349307+0000","last_unstale":"2024-01-22T05:05:42.349596+0000","last_undegraded":"2024-01-22T05:05:42.349596+0000","last_fullsized":"2024-01-22T05:05:42.349596+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323402+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325798+0000","last_change":"2024-01-22T05:05:42.325929+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325798+0000","last_undegraded":"2024-01-22T05:05:42.325798+0000","last_fullsized":"2024-01-22T05:05:42.325798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324883+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349870+0000","last_change":"2024-01-22T05:05:42.349941+0000","last_active":"2024-01-22T05:05:42.349870+0000","last_peered":"2024-01-22T05:05:42.349870+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349656+0000","last_became_peered":"2024-01-22T05:05:42.349656+0000","last_unstale":"2024-01-22T05:05:42.349870+0000","last_undegraded":"2024-01-22T05:05:42.349870+0000","last_fullsized":"2024-01-22T05:05:42.349870+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322543+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.353557+0000","last_change":"2024-01-22T05:05:42.353644+0000","last_active":"2024-01-22T05:05:42.353557+0000","last_peered":"2024-01-22T05:05:42.353557+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.346934+0000","last_became_peered":"2024-01-22T05:05:42.346934+0000","last_unstale":"2024-01-22T05:05:42.353557+0000","last_undegraded":"2024-01-22T05:05:42.353557+0000","last_fullsized":"2024-01-22T05:05:42.353557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.320145+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.315287+0000","last_change":"2024-01-22T05:05:42.315427+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.315287+0000","last_undegraded":"2024-01-22T05:05:42.315287+0000","last_fullsized":"2024-01-22T05:05:42.315287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328633+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.347740+0000","last_change":"2024-01-22T05:05:42.347821+0000","last_active":"2024-01-22T05:05:42.347740+0000","last_peered":"2024-01-22T05:05:42.347740+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347410+0000","last_became_peered":"2024-01-22T05:05:42.347410+0000","last_unstale":"2024-01-22T05:05:42.347740+0000","last_undegraded":"2024-01-22T05:05:42.347740+0000","last_fullsized":"2024-01-22T05:05:42.347740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.317245+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344802+0000","last_change":"2024-01-22T05:05:42.344802+0000","last_active":"2024-01-22T05:05:42.344802+0000","last_peered":"2024-01-22T05:05:42.344802+0000","last_clean":"2024-01-22T05:05:42.344802+0000","last_became_active":"2024-01-22T05:05:42.344442+0000","last_became_peered":"2024-01-22T05:05:42.344442+0000","last_unstale":"2024-01-22T05:05:42.344802+0000","last_undegraded":"2024-01-22T05:05:42.344802+0000","last_fullsized":"2024-01-22T05:05:42.344802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.317812+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341229+0000","last_change":"2024-01-22T05:05:42.347745+0000","last_active":"2024-01-22T05:05:42.341229+0000","last_peered":"2024-01-22T05:05:42.341229+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.341018+0000","last_became_peered":"2024-01-22T05:05:42.341018+0000","last_unstale":"2024-01-22T05:05:42.341229+0000","last_undegraded":"2024-01-22T05:05:42.341229+0000","last_fullsized":"2024-01-22T05:05:42.341229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.335130+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349994+0000","last_change":"2024-01-22T05:05:42.350071+0000","last_active":"2024-01-22T05:05:42.349994+0000","last_peered":"2024-01-22T05:05:42.349994+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349778+0000","last_became_peered":"2024-01-22T05:05:42.349778+0000","last_unstale":"2024-01-22T05:05:42.349994+0000","last_undegraded":"2024-01-22T05:05:42.349994+0000","last_fullsized":"2024-01-22T05:05:42.349994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.319758+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.338002+0000","last_change":"2024-01-22T05:05:42.338002+0000","last_active":"2024-01-22T05:05:42.338002+0000","last_peered":"2024-01-22T05:05:42.338002+0000","last_clean":"2024-01-22T05:05:42.338002+0000","last_became_active":"2024-01-22T05:05:42.337734+0000","last_became_peered":"2024-01-22T05:05:42.337734+0000","last_unstale":"2024-01-22T05:05:42.338002+0000","last_undegraded":"2024-01-22T05:05:42.338002+0000","last_fullsized":"2024-01-22T05:05:42.338002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318932+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344542+0000","last_change":"2024-01-22T05:05:42.344542+0000","last_active":"2024-01-22T05:05:42.344542+0000","last_peered":"2024-01-22T05:05:42.344542+0000","last_clean":"2024-01-22T05:05:42.344542+0000","last_became_active":"2024-01-22T05:05:42.342874+0000","last_became_peered":"2024-01-22T05:05:42.342874+0000","last_unstale":"2024-01-22T05:05:42.344542+0000","last_undegraded":"2024-01-22T05:05:42.344542+0000","last_fullsized":"2024-01-22T05:05:42.344542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328176+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325366+0000","last_change":"2024-01-22T05:05:42.326707+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325366+0000","last_undegraded":"2024-01-22T05:05:42.325366+0000","last_fullsized":"2024-01-22T05:05:42.325366+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.334650+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339234+0000","last_change":"2024-01-22T05:05:42.339234+0000","last_active":"2024-01-22T05:05:42.339234+0000","last_peered":"2024-01-22T05:05:42.339234+0000","last_clean":"2024-01-22T05:05:42.339234+0000","last_became_active":"2024-01-22T05:05:42.338850+0000","last_became_peered":"2024-01-22T05:05:42.338850+0000","last_unstale":"2024-01-22T05:05:42.339234+0000","last_undegraded":"2024-01-22T05:05:42.339234+0000","last_fullsized":"2024-01-22T05:05:42.339234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.315458+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:05:41.315458+0000","last_peered":"2024-01-22T05:05:41.315458+0000","last_clean":"2024-01-22T05:05:41.315458+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:05:41.315458+0000","last_undegraded":"2024-01-22T05:05:41.315458+0000","last_fullsized":"2024-01-22T05:05:41.315458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.330991+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.328769+0000","last_change":"2024-01-22T05:05:42.328933+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.328769+0000","last_undegraded":"2024-01-22T05:05:42.328769+0000","last_fullsized":"2024-01-22T05:05:42.328769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.317228+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:05:41.317228+0000","last_peered":"2024-01-22T05:05:41.317228+0000","last_clean":"2024-01-22T05:05:41.317228+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:05:41.317228+0000","last_undegraded":"2024-01-22T05:05:41.317228+0000","last_fullsized":"2024-01-22T05:05:41.317228+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.321560+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.337281+0000","last_change":"2024-01-22T05:05:42.337281+0000","last_active":"2024-01-22T05:05:42.337281+0000","last_peered":"2024-01-22T05:05:42.337281+0000","last_clean":"2024-01-22T05:05:42.337281+0000","last_became_active":"2024-01-22T05:05:42.336978+0000","last_became_peered":"2024-01-22T05:05:42.336978+0000","last_unstale":"2024-01-22T05:05:42.337281+0000","last_undegraded":"2024-01-22T05:05:42.337281+0000","last_fullsized":"2024-01-22T05:05:42.337281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.320588+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:05:41.320588+0000","last_peered":"2024-01-22T05:05:41.320588+0000","last_clean":"2024-01-22T05:05:41.320588+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:05:41.320588+0000","last_undegraded":"2024-01-22T05:05:41.320588+0000","last_fullsized":"2024-01-22T05:05:41.320588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.327801+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.356048+0000","last_change":"2024-01-22T05:05:42.356135+0000","last_active":"2024-01-22T05:05:42.356048+0000","last_peered":"2024-01-22T05:05:42.356048+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.354489+0000","last_became_peered":"2024-01-22T05:05:42.354489+0000","last_unstale":"2024-01-22T05:05:42.356048+0000","last_undegraded":"2024-01-22T05:05:42.356048+0000","last_fullsized":"2024-01-22T05:05:42.356048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.317248+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:05:41.317248+0000","last_peered":"2024-01-22T05:05:41.317248+0000","last_clean":"2024-01-22T05:05:41.317248+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:05:41.317248+0000","last_undegraded":"2024-01-22T05:05:41.317248+0000","last_fullsized":"2024-01-22T05:05:41.317248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318834+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348871+0000","last_change":"2024-01-22T05:05:42.348953+0000","last_active":"2024-01-22T05:05:42.348871+0000","last_peered":"2024-01-22T05:05:42.348871+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348577+0000","last_became_peered":"2024-01-22T05:05:42.348577+0000","last_unstale":"2024-01-22T05:05:42.348871+0000","last_undegraded":"2024-01-22T05:05:42.348871+0000","last_fullsized":"2024-01-22T05:05:42.348871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.312204+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:05:41.312204+0000","last_peered":"2024-01-22T05:05:41.312204+0000","last_clean":"2024-01-22T05:05:41.312204+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:05:41.312204+0000","last_undegraded":"2024-01-22T05:05:41.312204+0000","last_fullsized":"2024-01-22T05:05:41.312204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323280+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341704+0000","last_change":"2024-01-22T05:05:42.341704+0000","last_active":"2024-01-22T05:05:42.341704+0000","last_peered":"2024-01-22T05:05:42.341704+0000","last_clean":"2024-01-22T05:05:42.341704+0000","last_became_active":"2024-01-22T05:05:42.341329+0000","last_became_peered":"2024-01-22T05:05:42.341329+0000","last_unstale":"2024-01-22T05:05:42.341704+0000","last_undegraded":"2024-01-22T05:05:42.341704+0000","last_fullsized":"2024-01-22T05:05:42.341704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.310547+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:05:41.310547+0000","last_peered":"2024-01-22T05:05:41.310547+0000","last_clean":"2024-01-22T05:05:41.310547+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:05:41.310547+0000","last_undegraded":"2024-01-22T05:05:41.310547+0000","last_fullsized":"2024-01-22T05:05:41.310547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323610+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344542+0000","last_change":"2024-01-22T05:05:42.344663+0000","last_active":"2024-01-22T05:05:42.344542+0000","last_peered":"2024-01-22T05:05:42.344542+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.344347+0000","last_became_peered":"2024-01-22T05:05:42.344347+0000","last_unstale":"2024-01-22T05:05:42.344542+0000","last_undegraded":"2024-01-22T05:05:42.344542+0000","last_fullsized":"2024-01-22T05:05:42.344542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.319271+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:05:41.319271+0000","last_peered":"2024-01-22T05:05:41.319271+0000","last_clean":"2024-01-22T05:05:41.319271+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:05:41.319271+0000","last_undegraded":"2024-01-22T05:05:41.319271+0000","last_fullsized":"2024-01-22T05:05:41.319271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323280+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.323159+0000","last_change":"2024-01-22T05:05:42.323294+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.323159+0000","last_undegraded":"2024-01-22T05:05:42.323159+0000","last_fullsized":"2024-01-22T05:05:42.323159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.312237+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:05:41.312237+0000","last_peered":"2024-01-22T05:05:41.312237+0000","last_clean":"2024-01-22T05:05:41.312237+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:05:41.312237+0000","last_undegraded":"2024-01-22T05:05:41.312237+0000","last_fullsized":"2024-01-22T05:05:41.312237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.319384+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:05:41.319384+0000","last_peered":"2024-01-22T05:05:41.319384+0000","last_clean":"2024-01-22T05:05:41.319384+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:05:41.319384+0000","last_undegraded":"2024-01-22T05:05:41.319384+0000","last_fullsized":"2024-01-22T05:05:41.319384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.90500000000000003}]},{"osd":1,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.3029999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":1.0409999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.85699999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.143},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.343}]},{"osd":5,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.4259999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.381},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.5369999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.552},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.88500000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":4.1760000000000002,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.2010000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":0.94299999999999995}]},{"osd":4,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.462},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.4299999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.383}]},{"osd":7,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":3.2850000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":1.4890000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.079},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.96899999999999997}]},{"osd":1,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.204},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.2749999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.88500000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.3220000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.998},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.1120000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.2010000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.1759999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.248},{"interface":"front","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":3.1840000000000002,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.226}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.0049999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.1539999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.0649999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.196}]},{"osd":5,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.2549999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.369},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":3.085,"5min":3.085,"15min":3.085},"last":1.2769999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.5129999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.4219999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.78400000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.472},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.494}]},{"osd":4,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.161}]},{"osd":5,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.995}]},{"osd":6,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.355},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.3280000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.339},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.5189999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.86799999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.369}]},{"osd":3,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.91100000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.0840000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.222},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.3089999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.234},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.5109999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.302},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.571}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.91000000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.044}]},{"osd":3,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.002},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.97999999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.179}]},{"osd":5,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.153},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.4279999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.496}]},{"osd":7,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.474},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":1.5309999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.746},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.2290000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.85599999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.7989999999999999,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.0700000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":5.1799999999999997,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.80800000000000005}]},{"osd":5,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":3.548,"5min":3.548,"15min":3.548},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.276}]},{"osd":6,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.1140000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":5.29,"5min":5.29,"15min":5.29},"last":1.169},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.97399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:05:47.029 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:05:47.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.228+0000 7fc246c00700 1 Processor -- start 2024-01-22T05:05:47.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.232+0000 7fc246c00700 1 -- start start 2024-01-22T05:05:47.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.232+0000 7fc246c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc240062230 0x7fc2401581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:47.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.232+0000 7fc246c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2400c4210 0x7fc240067f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.232+0000 7fc246c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2400632d0 con 0x7fc240153ae0 2024-01-22T05:05:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc246c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2401586a0 con 0x7fc240062230 2024-01-22T05:05:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc246c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400bfa30 con 0x7fc2400c4210 2024-01-22T05:05:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc23fe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc240062230 0x7fc2401581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc23fe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc240062230 0x7fc2401581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:40672/0 (socket says 172.21.15.49:40672) 2024-01-22T05:05:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc23fe00700 1 -- 172.21.15.49:0/369497574 learned_addr learned my addr 172.21.15.49:0/369497574 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc245600700 1 --2- 172.21.15.49:0/369497574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2400c4210 0x7fc240067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc23ea00700 1 -- 172.21.15.49:0/369497574 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109105517 0 0) 0x7fc2400632d0 con 0x7fc240153ae0 2024-01-22T05:05:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc23ea00700 1 -- 172.21.15.49:0/369497574 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2200033f0 con 0x7fc240153ae0 2024-01-22T05:05:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc23fe00700 1 -- 172.21.15.49:0/369497574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2400c4210 msgr2=0x7fc240067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc23fe00700 1 --2- 172.21.15.49:0/369497574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2400c4210 0x7fc240067f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc23fe00700 1 -- 172.21.15.49:0/369497574 >> v1:172.21.15.110:6789/0 conn(0x7fc240153ae0 legacy=0x7fc2400c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc23fe00700 1 -- 172.21.15.49:0/369497574 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc240063b80 con 0x7fc240062230 2024-01-22T05:05:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc23fe00700 1 --2- 172.21.15.49:0/369497574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc240062230 0x7fc2401581b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fc230006fd0 tx=0x7fc2300090f0).ready entity=mon.1 client_cookie=61e76a473848ba31 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc23ea00700 1 -- 172.21.15.49:0/369497574 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23000f510 con 0x7fc240062230 2024-01-22T05:05:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc23ea00700 1 -- 172.21.15.49:0/369497574 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23000f670 con 0x7fc240062230 2024-01-22T05:05:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.236+0000 7fc23ea00700 1 -- 172.21.15.49:0/369497574 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23000f9f0 con 0x7fc240062230 2024-01-22T05:05:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.240+0000 7fc246c00700 1 -- 172.21.15.49:0/369497574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc240062230 msgr2=0x7fc2401581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.240+0000 7fc246c00700 1 --2- 172.21.15.49:0/369497574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc240062230 0x7fc2401581b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fc230006fd0 tx=0x7fc2300090f0).stop 2024-01-22T05:05:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.240+0000 7fc246c00700 1 -- 172.21.15.49:0/369497574 shutdown_connections 2024-01-22T05:05:47.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.240+0000 7fc246c00700 1 --2- 172.21.15.49:0/369497574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2400c4210 0x7fc240067f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.240+0000 7fc246c00700 1 --2- 172.21.15.49:0/369497574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc240062230 0x7fc2401581b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.240+0000 7fc246c00700 1 -- 172.21.15.49:0/369497574 >> 172.21.15.49:0/369497574 conn(0x7fc2400c5860 msgr2=0x7fc2400c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:47.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.240+0000 7fc246c00700 1 -- 172.21.15.49:0/369497574 shutdown_connections 2024-01-22T05:05:47.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.240+0000 7fc246c00700 1 -- 172.21.15.49:0/369497574 wait complete. 2024-01-22T05:05:47.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.244+0000 7fc246c00700 1 Processor -- start 2024-01-22T05:05:47.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.244+0000 7fc246c00700 1 -- start start 2024-01-22T05:05:47.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.244+0000 7fc246c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2400c4210 0x7fc240156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:47.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.244+0000 7fc246c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc240153ae0 0x7fc240153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:47.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.244+0000 7fc246c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2401487a0 0x7fc24014dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:47.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.244+0000 7fc246c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc240154460 con 0x7fc2401487a0 2024-01-22T05:05:47.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.244+0000 7fc246c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc240155b70 con 0x7fc2400c4210 2024-01-22T05:05:47.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.244+0000 7fc246c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc240154670 con 0x7fc240153ae0 2024-01-22T05:05:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.244+0000 7fc245600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2401487a0 0x7fc24014dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.244+0000 7fc245600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2401487a0 0x7fc24014dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53938/0 (socket says 172.21.15.49:53938) 2024-01-22T05:05:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.244+0000 7fc245600700 1 -- 172.21.15.49:0/4024553205 learned_addr learned my addr 172.21.15.49:0/4024553205 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.244+0000 7fc23fe00700 1 --2- 172.21.15.49:0/4024553205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2400c4210 0x7fc240156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.244+0000 7fc23f400700 1 --2- 172.21.15.49:0/4024553205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc240153ae0 0x7fc240153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.248+0000 7fc245600700 1 -- 172.21.15.49:0/4024553205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc240153ae0 msgr2=0x7fc240153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.248+0000 7fc245600700 1 --2- 172.21.15.49:0/4024553205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc240153ae0 0x7fc240153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.248+0000 7fc245600700 1 -- 172.21.15.49:0/4024553205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2400c4210 msgr2=0x7fc240156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.248+0000 7fc245600700 1 --2- 172.21.15.49:0/4024553205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2400c4210 0x7fc240156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.248+0000 7fc245600700 1 -- 172.21.15.49:0/4024553205 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc230009370 con 0x7fc2401487a0 2024-01-22T05:05:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.248+0000 7fc245600700 1 --2- 172.21.15.49:0/4024553205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2401487a0 0x7fc24014dc70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fc238009e20 tx=0x7fc23800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.248+0000 7fc237400700 1 -- 172.21.15.49:0/4024553205 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23800caa0 con 0x7fc2401487a0 2024-01-22T05:05:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.248+0000 7fc237400700 1 -- 172.21.15.49:0/4024553205 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23800f040 con 0x7fc2401487a0 2024-01-22T05:05:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.248+0000 7fc237400700 1 -- 172.21.15.49:0/4024553205 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23800ce10 con 0x7fc2401487a0 2024-01-22T05:05:47.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.248+0000 7fc246c00700 1 -- 172.21.15.49:0/4024553205 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2401566d0 con 0x7fc2401487a0 2024-01-22T05:05:47.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.248+0000 7fc246c00700 1 -- 172.21.15.49:0/4024553205 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc240156080 con 0x7fc2401487a0 2024-01-22T05:05:47.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.252+0000 7fc246c00700 1 -- 172.21.15.49:0/4024553205 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc240156860 con 0x7fc2401487a0 2024-01-22T05:05:47.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.252+0000 7fc237400700 1 -- 172.21.15.49:0/4024553205 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc238013610 con 0x7fc2401487a0 2024-01-22T05:05:47.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.252+0000 7fc237400700 1 --2- 172.21.15.49:0/4024553205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc21805a510 0x7fc21805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:47.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.252+0000 7fc237400700 1 -- 172.21.15.49:0/4024553205 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc238074fe0 con 0x7fc2401487a0 2024-01-22T05:05:47.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.252+0000 7fc23fe00700 1 --2- 172.21.15.49:0/4024553205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc21805a510 0x7fc21805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:47.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.256+0000 7fc23fe00700 1 --2- 172.21.15.49:0/4024553205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc21805a510 0x7fc21805c9d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fc230009130 tx=0x7fc230017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:47.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.260+0000 7fc237400700 1 -- 172.21.15.49:0/4024553205 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc238048660 con 0x7fc2401487a0 2024-01-22T05:05:47.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.424+0000 7fc246c00700 1 -- 172.21.15.49:0/4024553205 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2400626c0 con 0x7fc21805a510 2024-01-22T05:05:47.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.444+0000 7fc237400700 1 -- 172.21.15.49:0/4024553205 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355106 (secure 0 0 0) 0x7fc2400626c0 con 0x7fc21805a510 2024-01-22T05:05:47.453 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:47.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.452+0000 7fc246c00700 1 -- 172.21.15.49:0/4024553205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc21805a510 msgr2=0x7fc21805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:47.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.452+0000 7fc246c00700 1 --2- 172.21.15.49:0/4024553205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc21805a510 0x7fc21805c9d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fc230009130 tx=0x7fc230017000).stop 2024-01-22T05:05:47.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.452+0000 7fc246c00700 1 -- 172.21.15.49:0/4024553205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2401487a0 msgr2=0x7fc24014dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:47.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.452+0000 7fc246c00700 1 --2- 172.21.15.49:0/4024553205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2401487a0 0x7fc24014dc70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fc238009e20 tx=0x7fc23800b040).stop 2024-01-22T05:05:47.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.452+0000 7fc246c00700 1 -- 172.21.15.49:0/4024553205 shutdown_connections 2024-01-22T05:05:47.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.452+0000 7fc246c00700 1 --2- 172.21.15.49:0/4024553205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc21805a510 0x7fc21805c9d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.452+0000 7fc246c00700 1 --2- 172.21.15.49:0/4024553205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2401487a0 0x7fc24014dc70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.452+0000 7fc246c00700 1 --2- 172.21.15.49:0/4024553205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc240153ae0 0x7fc240153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.452+0000 7fc246c00700 1 --2- 172.21.15.49:0/4024553205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2400c4210 0x7fc240156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.452+0000 7fc246c00700 1 -- 172.21.15.49:0/4024553205 >> 172.21.15.49:0/4024553205 conn(0x7fc2400c5860 msgr2=0x7fc2400c36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:47.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.456+0000 7fc246c00700 1 -- 172.21.15.49:0/4024553205 shutdown_connections 2024-01-22T05:05:47.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.456+0000 7fc246c00700 1 -- 172.21.15.49:0/4024553205 wait complete. 2024-01-22T05:05:47.461 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:05:47.478 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-01-22T05:05:47.249253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2380096,"kb_used_data":3328,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594624,"statfs":{"total":773094113280,"available":770656894976,"internally_reserved":0,"allocated":3407872,"data_stored":1517888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5501,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-53,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.993450"},"pg_stats":[{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329251+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348631+0000","last_change":"2024-01-22T05:05:42.348729+0000","last_active":"2024-01-22T05:05:42.348631+0000","last_peered":"2024-01-22T05:05:42.348631+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348416+0000","last_became_peered":"2024-01-22T05:05:42.348416+0000","last_unstale":"2024-01-22T05:05:42.348631+0000","last_undegraded":"2024-01-22T05:05:42.348631+0000","last_fullsized":"2024-01-22T05:05:42.348631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323114+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.333060+0000","last_change":"2024-01-22T05:05:42.333186+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.333060+0000","last_undegraded":"2024-01-22T05:05:42.333060+0000","last_fullsized":"2024-01-22T05:05:42.333060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324407+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.354145+0000","last_change":"2024-01-22T05:05:42.354261+0000","last_active":"2024-01-22T05:05:42.354145+0000","last_peered":"2024-01-22T05:05:42.354145+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347227+0000","last_became_peered":"2024-01-22T05:05:42.347227+0000","last_unstale":"2024-01-22T05:05:42.354145+0000","last_undegraded":"2024-01-22T05:05:42.354145+0000","last_fullsized":"2024-01-22T05:05:42.354145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325801+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.314509+0000","last_change":"2024-01-22T05:05:42.314824+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.314509+0000","last_undegraded":"2024-01-22T05:05:42.314509+0000","last_fullsized":"2024-01-22T05:05:42.314509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.335660+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.338151+0000","last_change":"2024-01-22T05:05:42.338151+0000","last_active":"2024-01-22T05:05:42.338151+0000","last_peered":"2024-01-22T05:05:42.338151+0000","last_clean":"2024-01-22T05:05:42.338151+0000","last_became_active":"2024-01-22T05:05:42.337821+0000","last_became_peered":"2024-01-22T05:05:42.337821+0000","last_unstale":"2024-01-22T05:05:42.338151+0000","last_undegraded":"2024-01-22T05:05:42.338151+0000","last_fullsized":"2024-01-22T05:05:42.338151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324800+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.319442+0000","last_change":"2024-01-22T05:05:42.319615+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.319442+0000","last_undegraded":"2024-01-22T05:05:42.319442+0000","last_fullsized":"2024-01-22T05:05:42.319442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325085+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341452+0000","last_change":"2024-01-22T05:05:42.341452+0000","last_active":"2024-01-22T05:05:42.341452+0000","last_peered":"2024-01-22T05:05:42.341452+0000","last_clean":"2024-01-22T05:05:42.341452+0000","last_became_active":"2024-01-22T05:05:42.338600+0000","last_became_peered":"2024-01-22T05:05:42.338600+0000","last_unstale":"2024-01-22T05:05:42.341452+0000","last_undegraded":"2024-01-22T05:05:42.341452+0000","last_fullsized":"2024-01-22T05:05:42.341452+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323074+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.346315+0000","last_change":"2024-01-22T05:05:42.346397+0000","last_active":"2024-01-22T05:05:42.346315+0000","last_peered":"2024-01-22T05:05:42.346315+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.346085+0000","last_became_peered":"2024-01-22T05:05:42.346085+0000","last_unstale":"2024-01-22T05:05:42.346315+0000","last_undegraded":"2024-01-22T05:05:42.346315+0000","last_fullsized":"2024-01-22T05:05:42.346315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325729+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.352390+0000","last_change":"2024-01-22T05:05:42.352458+0000","last_active":"2024-01-22T05:05:42.352390+0000","last_peered":"2024-01-22T05:05:42.352390+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.352103+0000","last_became_peered":"2024-01-22T05:05:42.352103+0000","last_unstale":"2024-01-22T05:05:42.352390+0000","last_undegraded":"2024-01-22T05:05:42.352390+0000","last_fullsized":"2024-01-22T05:05:42.352390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329216+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342554+0000","last_change":"2024-01-22T05:05:42.342554+0000","last_active":"2024-01-22T05:05:42.342554+0000","last_peered":"2024-01-22T05:05:42.342554+0000","last_clean":"2024-01-22T05:05:42.342554+0000","last_became_active":"2024-01-22T05:05:42.342223+0000","last_became_peered":"2024-01-22T05:05:42.342223+0000","last_unstale":"2024-01-22T05:05:42.342554+0000","last_undegraded":"2024-01-22T05:05:42.342554+0000","last_fullsized":"2024-01-22T05:05:42.342554+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.330639+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.350418+0000","last_change":"2024-01-22T05:05:42.350418+0000","last_active":"2024-01-22T05:05:42.350418+0000","last_peered":"2024-01-22T05:05:42.350418+0000","last_clean":"2024-01-22T05:05:42.350418+0000","last_became_active":"2024-01-22T05:05:42.348672+0000","last_became_peered":"2024-01-22T05:05:42.348672+0000","last_unstale":"2024-01-22T05:05:42.350418+0000","last_undegraded":"2024-01-22T05:05:42.350418+0000","last_fullsized":"2024-01-22T05:05:42.350418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324999+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342349+0000","last_change":"2024-01-22T05:05:42.342458+0000","last_active":"2024-01-22T05:05:42.342349+0000","last_peered":"2024-01-22T05:05:42.342349+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.341925+0000","last_became_peered":"2024-01-22T05:05:42.341925+0000","last_unstale":"2024-01-22T05:05:42.342349+0000","last_undegraded":"2024-01-22T05:05:42.342349+0000","last_fullsized":"2024-01-22T05:05:42.342349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.326053+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342444+0000","last_change":"2024-01-22T05:05:42.342444+0000","last_active":"2024-01-22T05:05:42.342444+0000","last_peered":"2024-01-22T05:05:42.342444+0000","last_clean":"2024-01-22T05:05:42.342444+0000","last_became_active":"2024-01-22T05:05:42.342153+0000","last_became_peered":"2024-01-22T05:05:42.342153+0000","last_unstale":"2024-01-22T05:05:42.342444+0000","last_undegraded":"2024-01-22T05:05:42.342444+0000","last_fullsized":"2024-01-22T05:05:42.342444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322050+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348473+0000","last_change":"2024-01-22T05:05:42.348591+0000","last_active":"2024-01-22T05:05:42.348473+0000","last_peered":"2024-01-22T05:05:42.348473+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348005+0000","last_became_peered":"2024-01-22T05:05:42.348005+0000","last_unstale":"2024-01-22T05:05:42.348473+0000","last_undegraded":"2024-01-22T05:05:42.348473+0000","last_fullsized":"2024-01-22T05:05:42.348473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.316716+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.345568+0000","last_change":"2024-01-22T05:05:42.345568+0000","last_active":"2024-01-22T05:05:42.345568+0000","last_peered":"2024-01-22T05:05:42.345568+0000","last_clean":"2024-01-22T05:05:42.345568+0000","last_became_active":"2024-01-22T05:05:42.344946+0000","last_became_peered":"2024-01-22T05:05:42.344946+0000","last_unstale":"2024-01-22T05:05:42.345568+0000","last_undegraded":"2024-01-22T05:05:42.345568+0000","last_fullsized":"2024-01-22T05:05:42.345568+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329749+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349037+0000","last_change":"2024-01-22T05:05:42.349106+0000","last_active":"2024-01-22T05:05:42.349037+0000","last_peered":"2024-01-22T05:05:42.349037+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348826+0000","last_became_peered":"2024-01-22T05:05:42.348826+0000","last_unstale":"2024-01-22T05:05:42.349037+0000","last_undegraded":"2024-01-22T05:05:42.349037+0000","last_fullsized":"2024-01-22T05:05:42.349037+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328668+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.329674+0000","last_change":"2024-01-22T05:05:42.329791+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.329674+0000","last_undegraded":"2024-01-22T05:05:42.329674+0000","last_fullsized":"2024-01-22T05:05:42.329674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324173+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349214+0000","last_change":"2024-01-22T05:05:42.350366+0000","last_active":"2024-01-22T05:05:42.349214+0000","last_peered":"2024-01-22T05:05:42.349214+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348991+0000","last_became_peered":"2024-01-22T05:05:42.348991+0000","last_unstale":"2024-01-22T05:05:42.349214+0000","last_undegraded":"2024-01-22T05:05:42.349214+0000","last_fullsized":"2024-01-22T05:05:42.349214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322622+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342802+0000","last_change":"2024-01-22T05:05:42.342877+0000","last_active":"2024-01-22T05:05:42.342802+0000","last_peered":"2024-01-22T05:05:42.342802+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.342414+0000","last_became_peered":"2024-01-22T05:05:42.342414+0000","last_unstale":"2024-01-22T05:05:42.342802+0000","last_undegraded":"2024-01-22T05:05:42.342802+0000","last_fullsized":"2024-01-22T05:05:42.342802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.319316+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341779+0000","last_change":"2024-01-22T05:05:42.341779+0000","last_active":"2024-01-22T05:05:42.341779+0000","last_peered":"2024-01-22T05:05:42.341779+0000","last_clean":"2024-01-22T05:05:42.341779+0000","last_became_active":"2024-01-22T05:05:42.341427+0000","last_became_peered":"2024-01-22T05:05:42.341427+0000","last_unstale":"2024-01-22T05:05:42.341779+0000","last_undegraded":"2024-01-22T05:05:42.341779+0000","last_fullsized":"2024-01-22T05:05:42.341779+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325476+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344902+0000","last_change":"2024-01-22T05:05:42.344902+0000","last_active":"2024-01-22T05:05:42.344902+0000","last_peered":"2024-01-22T05:05:42.344902+0000","last_clean":"2024-01-22T05:05:42.344902+0000","last_became_active":"2024-01-22T05:05:42.344587+0000","last_became_peered":"2024-01-22T05:05:42.344587+0000","last_unstale":"2024-01-22T05:05:42.344902+0000","last_undegraded":"2024-01-22T05:05:42.344902+0000","last_fullsized":"2024-01-22T05:05:42.344902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.331408+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.328734+0000","last_change":"2024-01-22T05:05:42.328858+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.328734+0000","last_undegraded":"2024-01-22T05:05:42.328734+0000","last_fullsized":"2024-01-22T05:05:42.328734+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.315913+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325052+0000","last_change":"2024-01-22T05:05:42.325186+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325052+0000","last_undegraded":"2024-01-22T05:05:42.325052+0000","last_fullsized":"2024-01-22T05:05:42.325052+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318073+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.347547+0000","last_change":"2024-01-22T05:05:42.347615+0000","last_active":"2024-01-22T05:05:42.347547+0000","last_peered":"2024-01-22T05:05:42.347547+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347347+0000","last_became_peered":"2024-01-22T05:05:42.347347+0000","last_unstale":"2024-01-22T05:05:42.347547+0000","last_undegraded":"2024-01-22T05:05:42.347547+0000","last_fullsized":"2024-01-22T05:05:42.347547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.321175+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342693+0000","last_change":"2024-01-22T05:05:42.342693+0000","last_active":"2024-01-22T05:05:42.342693+0000","last_peered":"2024-01-22T05:05:42.342693+0000","last_clean":"2024-01-22T05:05:42.342693+0000","last_became_active":"2024-01-22T05:05:42.342424+0000","last_became_peered":"2024-01-22T05:05:42.342424+0000","last_unstale":"2024-01-22T05:05:42.342693+0000","last_undegraded":"2024-01-22T05:05:42.342693+0000","last_fullsized":"2024-01-22T05:05:42.342693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.320463+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349899+0000","last_change":"2024-01-22T05:05:42.349978+0000","last_active":"2024-01-22T05:05:42.349899+0000","last_peered":"2024-01-22T05:05:42.349899+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349679+0000","last_became_peered":"2024-01-22T05:05:42.349679+0000","last_unstale":"2024-01-22T05:05:42.349899+0000","last_undegraded":"2024-01-22T05:05:42.349899+0000","last_fullsized":"2024-01-22T05:05:42.349899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324676+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.347988+0000","last_change":"2024-01-22T05:05:42.347988+0000","last_active":"2024-01-22T05:05:42.347988+0000","last_peered":"2024-01-22T05:05:42.347988+0000","last_clean":"2024-01-22T05:05:42.347988+0000","last_became_active":"2024-01-22T05:05:42.347693+0000","last_became_peered":"2024-01-22T05:05:42.347693+0000","last_unstale":"2024-01-22T05:05:42.347988+0000","last_undegraded":"2024-01-22T05:05:42.347988+0000","last_fullsized":"2024-01-22T05:05:42.347988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325321+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.323932+0000","last_change":"2024-01-22T05:05:42.324056+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.323932+0000","last_undegraded":"2024-01-22T05:05:42.323932+0000","last_fullsized":"2024-01-22T05:05:42.323932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.330033+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.338150+0000","last_change":"2024-01-22T05:05:42.338150+0000","last_active":"2024-01-22T05:05:42.338150+0000","last_peered":"2024-01-22T05:05:42.338150+0000","last_clean":"2024-01-22T05:05:42.338150+0000","last_became_active":"2024-01-22T05:05:42.337828+0000","last_became_peered":"2024-01-22T05:05:42.337828+0000","last_unstale":"2024-01-22T05:05:42.338150+0000","last_undegraded":"2024-01-22T05:05:42.338150+0000","last_fullsized":"2024-01-22T05:05:42.338150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318707+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.317908+0000","last_change":"2024-01-22T05:05:42.318067+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.317908+0000","last_undegraded":"2024-01-22T05:05:42.317908+0000","last_fullsized":"2024-01-22T05:05:42.317908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":["6","3"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.321114+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325385+0000","last_change":"2024-01-22T05:05:42.325514+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325385+0000","last_undegraded":"2024-01-22T05:05:42.325385+0000","last_fullsized":"2024-01-22T05:05:42.325385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329246+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.337984+0000","last_change":"2024-01-22T05:05:42.337984+0000","last_active":"2024-01-22T05:05:42.337984+0000","last_peered":"2024-01-22T05:05:42.337984+0000","last_clean":"2024-01-22T05:05:42.337984+0000","last_became_active":"2024-01-22T05:05:42.337050+0000","last_became_peered":"2024-01-22T05:05:42.337050+0000","last_unstale":"2024-01-22T05:05:42.337984+0000","last_undegraded":"2024-01-22T05:05:42.337984+0000","last_fullsized":"2024-01-22T05:05:42.337984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323301+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342175+0000","last_change":"2024-01-22T05:05:42.342250+0000","last_active":"2024-01-22T05:05:42.342175+0000","last_peered":"2024-01-22T05:05:42.342175+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.341974+0000","last_became_peered":"2024-01-22T05:05:42.341974+0000","last_unstale":"2024-01-22T05:05:42.342175+0000","last_undegraded":"2024-01-22T05:05:42.342175+0000","last_fullsized":"2024-01-22T05:05:42.342175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.319539+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341030+0000","last_change":"2024-01-22T05:05:42.341030+0000","last_active":"2024-01-22T05:05:42.341030+0000","last_peered":"2024-01-22T05:05:42.341030+0000","last_clean":"2024-01-22T05:05:42.341030+0000","last_became_active":"2024-01-22T05:05:42.340774+0000","last_became_peered":"2024-01-22T05:05:42.340774+0000","last_unstale":"2024-01-22T05:05:42.341030+0000","last_undegraded":"2024-01-22T05:05:42.341030+0000","last_fullsized":"2024-01-22T05:05:42.341030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324162+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.350752+0000","last_change":"2024-01-22T05:05:42.350837+0000","last_active":"2024-01-22T05:05:42.350752+0000","last_peered":"2024-01-22T05:05:42.350752+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.350332+0000","last_became_peered":"2024-01-22T05:05:42.350332+0000","last_unstale":"2024-01-22T05:05:42.350752+0000","last_undegraded":"2024-01-22T05:05:42.350752+0000","last_fullsized":"2024-01-22T05:05:42.350752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323993+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349729+0000","last_change":"2024-01-22T05:05:42.349799+0000","last_active":"2024-01-22T05:05:42.349729+0000","last_peered":"2024-01-22T05:05:42.349729+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349522+0000","last_became_peered":"2024-01-22T05:05:42.349522+0000","last_unstale":"2024-01-22T05:05:42.349729+0000","last_undegraded":"2024-01-22T05:05:42.349729+0000","last_fullsized":"2024-01-22T05:05:42.349729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329646+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349792+0000","last_change":"2024-01-22T05:05:42.349880+0000","last_active":"2024-01-22T05:05:42.349792+0000","last_peered":"2024-01-22T05:05:42.349792+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349346+0000","last_became_peered":"2024-01-22T05:05:42.349346+0000","last_unstale":"2024-01-22T05:05:42.349792+0000","last_undegraded":"2024-01-22T05:05:42.349792+0000","last_fullsized":"2024-01-22T05:05:42.349792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325410+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348272+0000","last_change":"2024-01-22T05:05:42.348366+0000","last_active":"2024-01-22T05:05:42.348272+0000","last_peered":"2024-01-22T05:05:42.348272+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347668+0000","last_became_peered":"2024-01-22T05:05:42.347668+0000","last_unstale":"2024-01-22T05:05:42.348272+0000","last_undegraded":"2024-01-22T05:05:42.348272+0000","last_fullsized":"2024-01-22T05:05:42.348272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324600+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.345773+0000","last_change":"2024-01-22T05:05:42.345773+0000","last_active":"2024-01-22T05:05:42.345773+0000","last_peered":"2024-01-22T05:05:42.345773+0000","last_clean":"2024-01-22T05:05:42.345773+0000","last_became_active":"2024-01-22T05:05:42.345307+0000","last_became_peered":"2024-01-22T05:05:42.345307+0000","last_unstale":"2024-01-22T05:05:42.345773+0000","last_undegraded":"2024-01-22T05:05:42.345773+0000","last_fullsized":"2024-01-22T05:05:42.345773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.317581+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344392+0000","last_change":"2024-01-22T05:05:42.344465+0000","last_active":"2024-01-22T05:05:42.344392+0000","last_peered":"2024-01-22T05:05:42.344392+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.344171+0000","last_became_peered":"2024-01-22T05:05:42.344171+0000","last_unstale":"2024-01-22T05:05:42.344392+0000","last_undegraded":"2024-01-22T05:05:42.344392+0000","last_fullsized":"2024-01-22T05:05:42.344392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328235+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339764+0000","last_change":"2024-01-22T05:05:42.339764+0000","last_active":"2024-01-22T05:05:42.339764+0000","last_peered":"2024-01-22T05:05:42.339764+0000","last_clean":"2024-01-22T05:05:42.339764+0000","last_became_active":"2024-01-22T05:05:42.339442+0000","last_became_peered":"2024-01-22T05:05:42.339442+0000","last_unstale":"2024-01-22T05:05:42.339764+0000","last_undegraded":"2024-01-22T05:05:42.339764+0000","last_fullsized":"2024-01-22T05:05:42.339764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322637+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339443+0000","last_change":"2024-01-22T05:05:42.339443+0000","last_active":"2024-01-22T05:05:42.339443+0000","last_peered":"2024-01-22T05:05:42.339443+0000","last_clean":"2024-01-22T05:05:42.339443+0000","last_became_active":"2024-01-22T05:05:42.339151+0000","last_became_peered":"2024-01-22T05:05:42.339151+0000","last_unstale":"2024-01-22T05:05:42.339443+0000","last_undegraded":"2024-01-22T05:05:42.339443+0000","last_fullsized":"2024-01-22T05:05:42.339443+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.326457+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341590+0000","last_change":"2024-01-22T05:05:42.341590+0000","last_active":"2024-01-22T05:05:42.341590+0000","last_peered":"2024-01-22T05:05:42.341590+0000","last_clean":"2024-01-22T05:05:42.341590+0000","last_became_active":"2024-01-22T05:05:42.340992+0000","last_became_peered":"2024-01-22T05:05:42.340992+0000","last_unstale":"2024-01-22T05:05:42.341590+0000","last_undegraded":"2024-01-22T05:05:42.341590+0000","last_fullsized":"2024-01-22T05:05:42.341590+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324144+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339284+0000","last_change":"2024-01-22T05:05:42.339386+0000","last_active":"2024-01-22T05:05:42.339284+0000","last_peered":"2024-01-22T05:05:42.339284+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.338881+0000","last_became_peered":"2024-01-22T05:05:42.338881+0000","last_unstale":"2024-01-22T05:05:42.339284+0000","last_undegraded":"2024-01-22T05:05:42.339284+0000","last_fullsized":"2024-01-22T05:05:42.339284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.320038+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349596+0000","last_change":"2024-01-22T05:05:42.349679+0000","last_active":"2024-01-22T05:05:42.349596+0000","last_peered":"2024-01-22T05:05:42.349596+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349307+0000","last_became_peered":"2024-01-22T05:05:42.349307+0000","last_unstale":"2024-01-22T05:05:42.349596+0000","last_undegraded":"2024-01-22T05:05:42.349596+0000","last_fullsized":"2024-01-22T05:05:42.349596+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323402+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325798+0000","last_change":"2024-01-22T05:05:42.325929+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325798+0000","last_undegraded":"2024-01-22T05:05:42.325798+0000","last_fullsized":"2024-01-22T05:05:42.325798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324883+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349870+0000","last_change":"2024-01-22T05:05:42.349941+0000","last_active":"2024-01-22T05:05:42.349870+0000","last_peered":"2024-01-22T05:05:42.349870+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349656+0000","last_became_peered":"2024-01-22T05:05:42.349656+0000","last_unstale":"2024-01-22T05:05:42.349870+0000","last_undegraded":"2024-01-22T05:05:42.349870+0000","last_fullsized":"2024-01-22T05:05:42.349870+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322543+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.353557+0000","last_change":"2024-01-22T05:05:42.353644+0000","last_active":"2024-01-22T05:05:42.353557+0000","last_peered":"2024-01-22T05:05:42.353557+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.346934+0000","last_became_peered":"2024-01-22T05:05:42.346934+0000","last_unstale":"2024-01-22T05:05:42.353557+0000","last_undegraded":"2024-01-22T05:05:42.353557+0000","last_fullsized":"2024-01-22T05:05:42.353557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.320145+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.315287+0000","last_change":"2024-01-22T05:05:42.315427+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.315287+0000","last_undegraded":"2024-01-22T05:05:42.315287+0000","last_fullsized":"2024-01-22T05:05:42.315287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328633+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.347740+0000","last_change":"2024-01-22T05:05:42.347821+0000","last_active":"2024-01-22T05:05:42.347740+0000","last_peered":"2024-01-22T05:05:42.347740+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347410+0000","last_became_peered":"2024-01-22T05:05:42.347410+0000","last_unstale":"2024-01-22T05:05:42.347740+0000","last_undegraded":"2024-01-22T05:05:42.347740+0000","last_fullsized":"2024-01-22T05:05:42.347740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.317245+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344802+0000","last_change":"2024-01-22T05:05:42.344802+0000","last_active":"2024-01-22T05:05:42.344802+0000","last_peered":"2024-01-22T05:05:42.344802+0000","last_clean":"2024-01-22T05:05:42.344802+0000","last_became_active":"2024-01-22T05:05:42.344442+0000","last_became_peered":"2024-01-22T05:05:42.344442+0000","last_unstale":"2024-01-22T05:05:42.344802+0000","last_undegraded":"2024-01-22T05:05:42.344802+0000","last_fullsized":"2024-01-22T05:05:42.344802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.317812+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341229+0000","last_change":"2024-01-22T05:05:42.347745+0000","last_active":"2024-01-22T05:05:42.341229+0000","last_peered":"2024-01-22T05:05:42.341229+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.341018+0000","last_became_peered":"2024-01-22T05:05:42.341018+0000","last_unstale":"2024-01-22T05:05:42.341229+0000","last_undegraded":"2024-01-22T05:05:42.341229+0000","last_fullsized":"2024-01-22T05:05:42.341229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.335130+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349994+0000","last_change":"2024-01-22T05:05:42.350071+0000","last_active":"2024-01-22T05:05:42.349994+0000","last_peered":"2024-01-22T05:05:42.349994+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349778+0000","last_became_peered":"2024-01-22T05:05:42.349778+0000","last_unstale":"2024-01-22T05:05:42.349994+0000","last_undegraded":"2024-01-22T05:05:42.349994+0000","last_fullsized":"2024-01-22T05:05:42.349994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.319758+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.338002+0000","last_change":"2024-01-22T05:05:42.338002+0000","last_active":"2024-01-22T05:05:42.338002+0000","last_peered":"2024-01-22T05:05:42.338002+0000","last_clean":"2024-01-22T05:05:42.338002+0000","last_became_active":"2024-01-22T05:05:42.337734+0000","last_became_peered":"2024-01-22T05:05:42.337734+0000","last_unstale":"2024-01-22T05:05:42.338002+0000","last_undegraded":"2024-01-22T05:05:42.338002+0000","last_fullsized":"2024-01-22T05:05:42.338002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318932+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344542+0000","last_change":"2024-01-22T05:05:42.344542+0000","last_active":"2024-01-22T05:05:42.344542+0000","last_peered":"2024-01-22T05:05:42.344542+0000","last_clean":"2024-01-22T05:05:42.344542+0000","last_became_active":"2024-01-22T05:05:42.342874+0000","last_became_peered":"2024-01-22T05:05:42.342874+0000","last_unstale":"2024-01-22T05:05:42.344542+0000","last_undegraded":"2024-01-22T05:05:42.344542+0000","last_fullsized":"2024-01-22T05:05:42.344542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328176+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325366+0000","last_change":"2024-01-22T05:05:42.326707+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325366+0000","last_undegraded":"2024-01-22T05:05:42.325366+0000","last_fullsized":"2024-01-22T05:05:42.325366+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.334650+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339234+0000","last_change":"2024-01-22T05:05:42.339234+0000","last_active":"2024-01-22T05:05:42.339234+0000","last_peered":"2024-01-22T05:05:42.339234+0000","last_clean":"2024-01-22T05:05:42.339234+0000","last_became_active":"2024-01-22T05:05:42.338850+0000","last_became_peered":"2024-01-22T05:05:42.338850+0000","last_unstale":"2024-01-22T05:05:42.339234+0000","last_undegraded":"2024-01-22T05:05:42.339234+0000","last_fullsized":"2024-01-22T05:05:42.339234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.315458+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:05:41.315458+0000","last_peered":"2024-01-22T05:05:41.315458+0000","last_clean":"2024-01-22T05:05:41.315458+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:05:41.315458+0000","last_undegraded":"2024-01-22T05:05:41.315458+0000","last_fullsized":"2024-01-22T05:05:41.315458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.330991+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.328769+0000","last_change":"2024-01-22T05:05:42.328933+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.328769+0000","last_undegraded":"2024-01-22T05:05:42.328769+0000","last_fullsized":"2024-01-22T05:05:42.328769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.317228+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:05:41.317228+0000","last_peered":"2024-01-22T05:05:41.317228+0000","last_clean":"2024-01-22T05:05:41.317228+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:05:41.317228+0000","last_undegraded":"2024-01-22T05:05:41.317228+0000","last_fullsized":"2024-01-22T05:05:41.317228+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.321560+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.337281+0000","last_change":"2024-01-22T05:05:42.337281+0000","last_active":"2024-01-22T05:05:42.337281+0000","last_peered":"2024-01-22T05:05:42.337281+0000","last_clean":"2024-01-22T05:05:42.337281+0000","last_became_active":"2024-01-22T05:05:42.336978+0000","last_became_peered":"2024-01-22T05:05:42.336978+0000","last_unstale":"2024-01-22T05:05:42.337281+0000","last_undegraded":"2024-01-22T05:05:42.337281+0000","last_fullsized":"2024-01-22T05:05:42.337281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.320588+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:05:41.320588+0000","last_peered":"2024-01-22T05:05:41.320588+0000","last_clean":"2024-01-22T05:05:41.320588+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:05:41.320588+0000","last_undegraded":"2024-01-22T05:05:41.320588+0000","last_fullsized":"2024-01-22T05:05:41.320588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.327801+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.356048+0000","last_change":"2024-01-22T05:05:42.356135+0000","last_active":"2024-01-22T05:05:42.356048+0000","last_peered":"2024-01-22T05:05:42.356048+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.354489+0000","last_became_peered":"2024-01-22T05:05:42.354489+0000","last_unstale":"2024-01-22T05:05:42.356048+0000","last_undegraded":"2024-01-22T05:05:42.356048+0000","last_fullsized":"2024-01-22T05:05:42.356048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.317248+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:05:41.317248+0000","last_peered":"2024-01-22T05:05:41.317248+0000","last_clean":"2024-01-22T05:05:41.317248+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:05:41.317248+0000","last_undegraded":"2024-01-22T05:05:41.317248+0000","last_fullsized":"2024-01-22T05:05:41.317248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318834+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348871+0000","last_change":"2024-01-22T05:05:42.348953+0000","last_active":"2024-01-22T05:05:42.348871+0000","last_peered":"2024-01-22T05:05:42.348871+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348577+0000","last_became_peered":"2024-01-22T05:05:42.348577+0000","last_unstale":"2024-01-22T05:05:42.348871+0000","last_undegraded":"2024-01-22T05:05:42.348871+0000","last_fullsized":"2024-01-22T05:05:42.348871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.312204+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:05:41.312204+0000","last_peered":"2024-01-22T05:05:41.312204+0000","last_clean":"2024-01-22T05:05:41.312204+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:05:41.312204+0000","last_undegraded":"2024-01-22T05:05:41.312204+0000","last_fullsized":"2024-01-22T05:05:41.312204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323280+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341704+0000","last_change":"2024-01-22T05:05:42.341704+0000","last_active":"2024-01-22T05:05:42.341704+0000","last_peered":"2024-01-22T05:05:42.341704+0000","last_clean":"2024-01-22T05:05:42.341704+0000","last_became_active":"2024-01-22T05:05:42.341329+0000","last_became_peered":"2024-01-22T05:05:42.341329+0000","last_unstale":"2024-01-22T05:05:42.341704+0000","last_undegraded":"2024-01-22T05:05:42.341704+0000","last_fullsized":"2024-01-22T05:05:42.341704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.310547+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:05:41.310547+0000","last_peered":"2024-01-22T05:05:41.310547+0000","last_clean":"2024-01-22T05:05:41.310547+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:05:41.310547+0000","last_undegraded":"2024-01-22T05:05:41.310547+0000","last_fullsized":"2024-01-22T05:05:41.310547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323610+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344542+0000","last_change":"2024-01-22T05:05:42.344663+0000","last_active":"2024-01-22T05:05:42.344542+0000","last_peered":"2024-01-22T05:05:42.344542+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.344347+0000","last_became_peered":"2024-01-22T05:05:42.344347+0000","last_unstale":"2024-01-22T05:05:42.344542+0000","last_undegraded":"2024-01-22T05:05:42.344542+0000","last_fullsized":"2024-01-22T05:05:42.344542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.319271+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:05:41.319271+0000","last_peered":"2024-01-22T05:05:41.319271+0000","last_clean":"2024-01-22T05:05:41.319271+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:05:41.319271+0000","last_undegraded":"2024-01-22T05:05:41.319271+0000","last_fullsized":"2024-01-22T05:05:41.319271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323280+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.323159+0000","last_change":"2024-01-22T05:05:42.323294+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.323159+0000","last_undegraded":"2024-01-22T05:05:42.323159+0000","last_fullsized":"2024-01-22T05:05:42.323159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.312237+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:05:41.312237+0000","last_peered":"2024-01-22T05:05:41.312237+0000","last_clean":"2024-01-22T05:05:41.312237+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:05:41.312237+0000","last_undegraded":"2024-01-22T05:05:41.312237+0000","last_fullsized":"2024-01-22T05:05:41.312237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.319384+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:05:41.319384+0000","last_peered":"2024-01-22T05:05:41.319384+0000","last_clean":"2024-01-22T05:05:41.319384+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:05:41.319384+0000","last_undegraded":"2024-01-22T05:05:41.319384+0000","last_fullsized":"2024-01-22T05:05:41.319384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.90500000000000003}]},{"osd":1,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.3029999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":1.0409999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.85699999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.143},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.343}]},{"osd":5,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.4259999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.381},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.5369999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.552},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.88500000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":4.1760000000000002,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.2010000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":0.94299999999999995}]},{"osd":4,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.462},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.4299999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.383}]},{"osd":7,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":3.2850000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":1.4890000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.079},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.96899999999999997}]},{"osd":1,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.204},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.2749999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.88500000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.3220000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.998},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.1120000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.2010000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.1759999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.248},{"interface":"front","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":3.1840000000000002,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.226}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.0049999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.1539999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.0649999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.196}]},{"osd":5,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.2549999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.369},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":3.085,"5min":3.085,"15min":3.085},"last":1.2769999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.5129999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.4219999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.78400000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.472},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.494}]},{"osd":4,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.161}]},{"osd":5,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.995}]},{"osd":6,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.355},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.3280000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.339},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.5189999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.86799999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.369}]},{"osd":3,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.91100000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.0840000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.222},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.3089999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.234},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.5109999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.302},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.571}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.91000000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.044}]},{"osd":3,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.002},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.97999999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.179}]},{"osd":5,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.153},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.4279999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.496}]},{"osd":7,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.474},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":1.5309999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.746},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.2290000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.85599999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.7989999999999999,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.0700000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":5.1799999999999997,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.80800000000000005}]},{"osd":5,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":3.548,"5min":3.548,"15min":3.548},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.276}]},{"osd":6,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.1140000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":5.29,"5min":5.29,"15min":5.29},"last":1.169},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.97399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:05:47.484 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:05:47.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.684+0000 7f8d5de00700 1 Processor -- start 2024-01-22T05:05:47.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.684+0000 7f8d5de00700 1 -- start start 2024-01-22T05:05:47.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d5de00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d58064c00 0x7f8d580bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:47.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d5de00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d580c2700 con 0x7f8d58065620 2024-01-22T05:05:47.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d5de00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d580c29a0 con 0x7f8d58065240 2024-01-22T05:05:47.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d5de00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d580c2c80 con 0x7f8d58064c00 2024-01-22T05:05:47.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d57e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8d58065620 0x7f8d580bd170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51052/0 (socket says 172.21.15.49:51052) 2024-01-22T05:05:47.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d57e00700 1 -- 172.21.15.49:0/2626015022 learned_addr learned my addr 172.21.15.49:0/2626015022 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:47.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d56000700 1 --2- 172.21.15.49:0/2626015022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d58064c00 0x7f8d580bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:47.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d55600700 1 -- 172.21.15.49:0/2626015022 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613047118 0 0) 0x7f8d580c2700 con 0x7f8d58065620 2024-01-22T05:05:47.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d55600700 1 -- 172.21.15.49:0/2626015022 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d380033f0 con 0x7f8d58065620 2024-01-22T05:05:47.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d55600700 1 -- 172.21.15.49:0/2626015022 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937575953 0 0) 0x7f8d580c29a0 con 0x7f8d58065240 2024-01-22T05:05:47.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d55600700 1 -- 172.21.15.49:0/2626015022 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d580c2700 con 0x7f8d58065240 2024-01-22T05:05:47.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d56000700 1 -- 172.21.15.49:0/2626015022 >> v1:172.21.15.110:6789/0 conn(0x7f8d58065240 legacy=0x7f8d580644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:47.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d56000700 1 -- 172.21.15.49:0/2626015022 >> v1:172.21.15.49:6789/0 conn(0x7f8d58065620 legacy=0x7f8d580bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:47.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d56000700 1 -- 172.21.15.49:0/2626015022 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d580c2f60 con 0x7f8d58064c00 2024-01-22T05:05:47.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d56000700 1 --2- 172.21.15.49:0/2626015022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d58064c00 0x7f8d580bcc80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8d40009790 tx=0x7f8d40009060).ready entity=mon.2 client_cookie=db93f97eb1758d6f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:47.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d55600700 1 -- 172.21.15.49:0/2626015022 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4000f510 con 0x7f8d58064c00 2024-01-22T05:05:47.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d55600700 1 -- 172.21.15.49:0/2626015022 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4000f670 con 0x7f8d58064c00 2024-01-22T05:05:47.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.688+0000 7f8d55600700 1 -- 172.21.15.49:0/2626015022 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4000f9f0 con 0x7f8d58064c00 2024-01-22T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.692+0000 7f8d5de00700 1 -- 172.21.15.49:0/2626015022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d58064c00 msgr2=0x7f8d580bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.692+0000 7f8d5de00700 1 --2- 172.21.15.49:0/2626015022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d58064c00 0x7f8d580bcc80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8d40009790 tx=0x7f8d40009060).stop 2024-01-22T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.692+0000 7f8d5de00700 1 -- 172.21.15.49:0/2626015022 shutdown_connections 2024-01-22T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.692+0000 7f8d5de00700 1 --2- 172.21.15.49:0/2626015022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d58064c00 0x7f8d580bcc80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.692+0000 7f8d5de00700 1 -- 172.21.15.49:0/2626015022 >> 172.21.15.49:0/2626015022 conn(0x7f8d580c87f0 msgr2=0x7f8d580c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.692+0000 7f8d5de00700 1 -- 172.21.15.49:0/2626015022 shutdown_connections 2024-01-22T05:05:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.692+0000 7f8d5de00700 1 -- 172.21.15.49:0/2626015022 wait complete. 2024-01-22T05:05:47.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.696+0000 7f8d5de00700 1 Processor -- start 2024-01-22T05:05:47.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.696+0000 7f8d5de00700 1 -- start start 2024-01-22T05:05:47.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.696+0000 7f8d5de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d58064c00 0x7f8d58152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:47.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.696+0000 7f8d5de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d58065240 0x7f8d580bedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:47.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.696+0000 7f8d5de00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d58065620 0x7f8d58062a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:47.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.696+0000 7f8d5de00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d580a7e20 con 0x7f8d58065240 2024-01-22T05:05:47.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.696+0000 7f8d5de00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d580bf820 con 0x7f8d58064c00 2024-01-22T05:05:47.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.696+0000 7f8d5de00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d580a77d0 con 0x7f8d58065620 2024-01-22T05:05:47.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d56000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d58065240 0x7f8d580bedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:47.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d56000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d58065240 0x7f8d580bedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53944/0 (socket says 172.21.15.49:53944) 2024-01-22T05:05:47.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d56000700 1 -- 172.21.15.49:0/3172248578 learned_addr learned my addr 172.21.15.49:0/3172248578 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:47.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d57e00700 1 --2- 172.21.15.49:0/3172248578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d58065620 0x7f8d58062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:47.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d56a00700 1 --2- 172.21.15.49:0/3172248578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d58064c00 0x7f8d58152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:47.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d56000700 1 -- 172.21.15.49:0/3172248578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d58065620 msgr2=0x7f8d58062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:47.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d56000700 1 --2- 172.21.15.49:0/3172248578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d58065620 0x7f8d58062a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d56000700 1 -- 172.21.15.49:0/3172248578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d58064c00 msgr2=0x7f8d58152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:47.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d56000700 1 --2- 172.21.15.49:0/3172248578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d58064c00 0x7f8d58152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d56000700 1 -- 172.21.15.49:0/3172248578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d400092a0 con 0x7f8d58065240 2024-01-22T05:05:47.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d56000700 1 --2- 172.21.15.49:0/3172248578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d58065240 0x7f8d580bedc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f8d40011000 tx=0x7f8d40017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:47.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d4e000700 1 -- 172.21.15.49:0/3172248578 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4000fe80 con 0x7f8d58065240 2024-01-22T05:05:47.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d4e000700 1 -- 172.21.15.49:0/3172248578 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4000f7e0 con 0x7f8d58065240 2024-01-22T05:05:47.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d5de00700 1 -- 172.21.15.49:0/3172248578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d580a7ab0 con 0x7f8d58065240 2024-01-22T05:05:47.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d4e000700 1 -- 172.21.15.49:0/3172248578 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4001b640 con 0x7f8d58065240 2024-01-22T05:05:47.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.700+0000 7f8d5de00700 1 -- 172.21.15.49:0/3172248578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5815ea30 con 0x7f8d58065240 2024-01-22T05:05:47.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.704+0000 7f8d5de00700 1 -- 172.21.15.49:0/3172248578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d580a7f90 con 0x7f8d58065240 2024-01-22T05:05:47.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.704+0000 7f8d4e000700 1 -- 172.21.15.49:0/3172248578 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8d4001b9b0 con 0x7f8d58065240 2024-01-22T05:05:47.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.708+0000 7f8d4e000700 1 --2- 172.21.15.49:0/3172248578 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8d3005a540 0x7f8d3005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:47.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.708+0000 7f8d4e000700 1 -- 172.21.15.49:0/3172248578 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f8d40076340 con 0x7f8d58065240 2024-01-22T05:05:47.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.708+0000 7f8d56a00700 1 --2- 172.21.15.49:0/3172248578 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8d3005a540 0x7f8d3005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:47.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.708+0000 7f8d56a00700 1 --2- 172.21.15.49:0/3172248578 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8d3005a540 0x7f8d3005ca00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f8d48003930 tx=0x7f8d48007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.712+0000 7f8d4e000700 1 -- 172.21.15.49:0/3172248578 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8d40049900 con 0x7f8d58065240 2024-01-22T05:05:47.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.880+0000 7f8d5de00700 1 -- 172.21.15.49:0/3172248578 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d58047060 con 0x7f8d3005a540 2024-01-22T05:05:47.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.896+0000 7f8d4e000700 1 -- 172.21.15.49:0/3172248578 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355106 (secure 0 0 0) 0x7f8d58047060 con 0x7f8d3005a540 2024-01-22T05:05:47.905 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:47.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.908+0000 7f8d5de00700 1 -- 172.21.15.49:0/3172248578 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8d3005a540 msgr2=0x7f8d3005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:47.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.908+0000 7f8d5de00700 1 --2- 172.21.15.49:0/3172248578 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8d3005a540 0x7f8d3005ca00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f8d48003930 tx=0x7f8d48007bd0).stop 2024-01-22T05:05:47.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.908+0000 7f8d5de00700 1 -- 172.21.15.49:0/3172248578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d58065240 msgr2=0x7f8d580bedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:47.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.908+0000 7f8d5de00700 1 --2- 172.21.15.49:0/3172248578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d58065240 0x7f8d580bedc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f8d40011000 tx=0x7f8d40017000).stop 2024-01-22T05:05:47.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.908+0000 7f8d5de00700 1 -- 172.21.15.49:0/3172248578 shutdown_connections 2024-01-22T05:05:47.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.908+0000 7f8d5de00700 1 --2- 172.21.15.49:0/3172248578 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8d3005a540 0x7f8d3005ca00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.908+0000 7f8d5de00700 1 --2- 172.21.15.49:0/3172248578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d58065620 0x7f8d58062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.908+0000 7f8d5de00700 1 --2- 172.21.15.49:0/3172248578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d58065240 0x7f8d580bedc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.908+0000 7f8d5de00700 1 --2- 172.21.15.49:0/3172248578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d58064c00 0x7f8d58152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:47.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.908+0000 7f8d5de00700 1 -- 172.21.15.49:0/3172248578 >> 172.21.15.49:0/3172248578 conn(0x7f8d580c87f0 msgr2=0x7f8d580aacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:47.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.908+0000 7f8d5de00700 1 -- 172.21.15.49:0/3172248578 shutdown_connections 2024-01-22T05:05:47.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:47.908+0000 7f8d5de00700 1 -- 172.21.15.49:0/3172248578 wait complete. 2024-01-22T05:05:47.915 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:05:47.934 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-01-22T05:05:47.249253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2380096,"kb_used_data":3328,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594624,"statfs":{"total":773094113280,"available":770656894976,"internally_reserved":0,"allocated":3407872,"data_stored":1517888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5501,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-53,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.993450"},"pg_stats":[{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329251+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348631+0000","last_change":"2024-01-22T05:05:42.348729+0000","last_active":"2024-01-22T05:05:42.348631+0000","last_peered":"2024-01-22T05:05:42.348631+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348416+0000","last_became_peered":"2024-01-22T05:05:42.348416+0000","last_unstale":"2024-01-22T05:05:42.348631+0000","last_undegraded":"2024-01-22T05:05:42.348631+0000","last_fullsized":"2024-01-22T05:05:42.348631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323114+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.333060+0000","last_change":"2024-01-22T05:05:42.333186+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.333060+0000","last_undegraded":"2024-01-22T05:05:42.333060+0000","last_fullsized":"2024-01-22T05:05:42.333060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324407+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.354145+0000","last_change":"2024-01-22T05:05:42.354261+0000","last_active":"2024-01-22T05:05:42.354145+0000","last_peered":"2024-01-22T05:05:42.354145+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347227+0000","last_became_peered":"2024-01-22T05:05:42.347227+0000","last_unstale":"2024-01-22T05:05:42.354145+0000","last_undegraded":"2024-01-22T05:05:42.354145+0000","last_fullsized":"2024-01-22T05:05:42.354145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325801+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.314509+0000","last_change":"2024-01-22T05:05:42.314824+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.314509+0000","last_undegraded":"2024-01-22T05:05:42.314509+0000","last_fullsized":"2024-01-22T05:05:42.314509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.335660+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.338151+0000","last_change":"2024-01-22T05:05:42.338151+0000","last_active":"2024-01-22T05:05:42.338151+0000","last_peered":"2024-01-22T05:05:42.338151+0000","last_clean":"2024-01-22T05:05:42.338151+0000","last_became_active":"2024-01-22T05:05:42.337821+0000","last_became_peered":"2024-01-22T05:05:42.337821+0000","last_unstale":"2024-01-22T05:05:42.338151+0000","last_undegraded":"2024-01-22T05:05:42.338151+0000","last_fullsized":"2024-01-22T05:05:42.338151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324800+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.319442+0000","last_change":"2024-01-22T05:05:42.319615+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.319442+0000","last_undegraded":"2024-01-22T05:05:42.319442+0000","last_fullsized":"2024-01-22T05:05:42.319442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325085+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341452+0000","last_change":"2024-01-22T05:05:42.341452+0000","last_active":"2024-01-22T05:05:42.341452+0000","last_peered":"2024-01-22T05:05:42.341452+0000","last_clean":"2024-01-22T05:05:42.341452+0000","last_became_active":"2024-01-22T05:05:42.338600+0000","last_became_peered":"2024-01-22T05:05:42.338600+0000","last_unstale":"2024-01-22T05:05:42.341452+0000","last_undegraded":"2024-01-22T05:05:42.341452+0000","last_fullsized":"2024-01-22T05:05:42.341452+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323074+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.346315+0000","last_change":"2024-01-22T05:05:42.346397+0000","last_active":"2024-01-22T05:05:42.346315+0000","last_peered":"2024-01-22T05:05:42.346315+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.346085+0000","last_became_peered":"2024-01-22T05:05:42.346085+0000","last_unstale":"2024-01-22T05:05:42.346315+0000","last_undegraded":"2024-01-22T05:05:42.346315+0000","last_fullsized":"2024-01-22T05:05:42.346315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325729+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.352390+0000","last_change":"2024-01-22T05:05:42.352458+0000","last_active":"2024-01-22T05:05:42.352390+0000","last_peered":"2024-01-22T05:05:42.352390+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.352103+0000","last_became_peered":"2024-01-22T05:05:42.352103+0000","last_unstale":"2024-01-22T05:05:42.352390+0000","last_undegraded":"2024-01-22T05:05:42.352390+0000","last_fullsized":"2024-01-22T05:05:42.352390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329216+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342554+0000","last_change":"2024-01-22T05:05:42.342554+0000","last_active":"2024-01-22T05:05:42.342554+0000","last_peered":"2024-01-22T05:05:42.342554+0000","last_clean":"2024-01-22T05:05:42.342554+0000","last_became_active":"2024-01-22T05:05:42.342223+0000","last_became_peered":"2024-01-22T05:05:42.342223+0000","last_unstale":"2024-01-22T05:05:42.342554+0000","last_undegraded":"2024-01-22T05:05:42.342554+0000","last_fullsized":"2024-01-22T05:05:42.342554+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.330639+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.350418+0000","last_change":"2024-01-22T05:05:42.350418+0000","last_active":"2024-01-22T05:05:42.350418+0000","last_peered":"2024-01-22T05:05:42.350418+0000","last_clean":"2024-01-22T05:05:42.350418+0000","last_became_active":"2024-01-22T05:05:42.348672+0000","last_became_peered":"2024-01-22T05:05:42.348672+0000","last_unstale":"2024-01-22T05:05:42.350418+0000","last_undegraded":"2024-01-22T05:05:42.350418+0000","last_fullsized":"2024-01-22T05:05:42.350418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324999+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342349+0000","last_change":"2024-01-22T05:05:42.342458+0000","last_active":"2024-01-22T05:05:42.342349+0000","last_peered":"2024-01-22T05:05:42.342349+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.341925+0000","last_became_peered":"2024-01-22T05:05:42.341925+0000","last_unstale":"2024-01-22T05:05:42.342349+0000","last_undegraded":"2024-01-22T05:05:42.342349+0000","last_fullsized":"2024-01-22T05:05:42.342349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.326053+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342444+0000","last_change":"2024-01-22T05:05:42.342444+0000","last_active":"2024-01-22T05:05:42.342444+0000","last_peered":"2024-01-22T05:05:42.342444+0000","last_clean":"2024-01-22T05:05:42.342444+0000","last_became_active":"2024-01-22T05:05:42.342153+0000","last_became_peered":"2024-01-22T05:05:42.342153+0000","last_unstale":"2024-01-22T05:05:42.342444+0000","last_undegraded":"2024-01-22T05:05:42.342444+0000","last_fullsized":"2024-01-22T05:05:42.342444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322050+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348473+0000","last_change":"2024-01-22T05:05:42.348591+0000","last_active":"2024-01-22T05:05:42.348473+0000","last_peered":"2024-01-22T05:05:42.348473+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348005+0000","last_became_peered":"2024-01-22T05:05:42.348005+0000","last_unstale":"2024-01-22T05:05:42.348473+0000","last_undegraded":"2024-01-22T05:05:42.348473+0000","last_fullsized":"2024-01-22T05:05:42.348473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.316716+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.345568+0000","last_change":"2024-01-22T05:05:42.345568+0000","last_active":"2024-01-22T05:05:42.345568+0000","last_peered":"2024-01-22T05:05:42.345568+0000","last_clean":"2024-01-22T05:05:42.345568+0000","last_became_active":"2024-01-22T05:05:42.344946+0000","last_became_peered":"2024-01-22T05:05:42.344946+0000","last_unstale":"2024-01-22T05:05:42.345568+0000","last_undegraded":"2024-01-22T05:05:42.345568+0000","last_fullsized":"2024-01-22T05:05:42.345568+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329749+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349037+0000","last_change":"2024-01-22T05:05:42.349106+0000","last_active":"2024-01-22T05:05:42.349037+0000","last_peered":"2024-01-22T05:05:42.349037+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348826+0000","last_became_peered":"2024-01-22T05:05:42.348826+0000","last_unstale":"2024-01-22T05:05:42.349037+0000","last_undegraded":"2024-01-22T05:05:42.349037+0000","last_fullsized":"2024-01-22T05:05:42.349037+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328668+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.329674+0000","last_change":"2024-01-22T05:05:42.329791+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.329674+0000","last_undegraded":"2024-01-22T05:05:42.329674+0000","last_fullsized":"2024-01-22T05:05:42.329674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324173+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349214+0000","last_change":"2024-01-22T05:05:42.350366+0000","last_active":"2024-01-22T05:05:42.349214+0000","last_peered":"2024-01-22T05:05:42.349214+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348991+0000","last_became_peered":"2024-01-22T05:05:42.348991+0000","last_unstale":"2024-01-22T05:05:42.349214+0000","last_undegraded":"2024-01-22T05:05:42.349214+0000","last_fullsized":"2024-01-22T05:05:42.349214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322622+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342802+0000","last_change":"2024-01-22T05:05:42.342877+0000","last_active":"2024-01-22T05:05:42.342802+0000","last_peered":"2024-01-22T05:05:42.342802+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.342414+0000","last_became_peered":"2024-01-22T05:05:42.342414+0000","last_unstale":"2024-01-22T05:05:42.342802+0000","last_undegraded":"2024-01-22T05:05:42.342802+0000","last_fullsized":"2024-01-22T05:05:42.342802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.319316+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341779+0000","last_change":"2024-01-22T05:05:42.341779+0000","last_active":"2024-01-22T05:05:42.341779+0000","last_peered":"2024-01-22T05:05:42.341779+0000","last_clean":"2024-01-22T05:05:42.341779+0000","last_became_active":"2024-01-22T05:05:42.341427+0000","last_became_peered":"2024-01-22T05:05:42.341427+0000","last_unstale":"2024-01-22T05:05:42.341779+0000","last_undegraded":"2024-01-22T05:05:42.341779+0000","last_fullsized":"2024-01-22T05:05:42.341779+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325476+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344902+0000","last_change":"2024-01-22T05:05:42.344902+0000","last_active":"2024-01-22T05:05:42.344902+0000","last_peered":"2024-01-22T05:05:42.344902+0000","last_clean":"2024-01-22T05:05:42.344902+0000","last_became_active":"2024-01-22T05:05:42.344587+0000","last_became_peered":"2024-01-22T05:05:42.344587+0000","last_unstale":"2024-01-22T05:05:42.344902+0000","last_undegraded":"2024-01-22T05:05:42.344902+0000","last_fullsized":"2024-01-22T05:05:42.344902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.331408+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.328734+0000","last_change":"2024-01-22T05:05:42.328858+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.328734+0000","last_undegraded":"2024-01-22T05:05:42.328734+0000","last_fullsized":"2024-01-22T05:05:42.328734+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.315913+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325052+0000","last_change":"2024-01-22T05:05:42.325186+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325052+0000","last_undegraded":"2024-01-22T05:05:42.325052+0000","last_fullsized":"2024-01-22T05:05:42.325052+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318073+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.347547+0000","last_change":"2024-01-22T05:05:42.347615+0000","last_active":"2024-01-22T05:05:42.347547+0000","last_peered":"2024-01-22T05:05:42.347547+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347347+0000","last_became_peered":"2024-01-22T05:05:42.347347+0000","last_unstale":"2024-01-22T05:05:42.347547+0000","last_undegraded":"2024-01-22T05:05:42.347547+0000","last_fullsized":"2024-01-22T05:05:42.347547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.321175+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342693+0000","last_change":"2024-01-22T05:05:42.342693+0000","last_active":"2024-01-22T05:05:42.342693+0000","last_peered":"2024-01-22T05:05:42.342693+0000","last_clean":"2024-01-22T05:05:42.342693+0000","last_became_active":"2024-01-22T05:05:42.342424+0000","last_became_peered":"2024-01-22T05:05:42.342424+0000","last_unstale":"2024-01-22T05:05:42.342693+0000","last_undegraded":"2024-01-22T05:05:42.342693+0000","last_fullsized":"2024-01-22T05:05:42.342693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.320463+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349899+0000","last_change":"2024-01-22T05:05:42.349978+0000","last_active":"2024-01-22T05:05:42.349899+0000","last_peered":"2024-01-22T05:05:42.349899+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349679+0000","last_became_peered":"2024-01-22T05:05:42.349679+0000","last_unstale":"2024-01-22T05:05:42.349899+0000","last_undegraded":"2024-01-22T05:05:42.349899+0000","last_fullsized":"2024-01-22T05:05:42.349899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324676+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.347988+0000","last_change":"2024-01-22T05:05:42.347988+0000","last_active":"2024-01-22T05:05:42.347988+0000","last_peered":"2024-01-22T05:05:42.347988+0000","last_clean":"2024-01-22T05:05:42.347988+0000","last_became_active":"2024-01-22T05:05:42.347693+0000","last_became_peered":"2024-01-22T05:05:42.347693+0000","last_unstale":"2024-01-22T05:05:42.347988+0000","last_undegraded":"2024-01-22T05:05:42.347988+0000","last_fullsized":"2024-01-22T05:05:42.347988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325321+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.323932+0000","last_change":"2024-01-22T05:05:42.324056+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.323932+0000","last_undegraded":"2024-01-22T05:05:42.323932+0000","last_fullsized":"2024-01-22T05:05:42.323932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.330033+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.338150+0000","last_change":"2024-01-22T05:05:42.338150+0000","last_active":"2024-01-22T05:05:42.338150+0000","last_peered":"2024-01-22T05:05:42.338150+0000","last_clean":"2024-01-22T05:05:42.338150+0000","last_became_active":"2024-01-22T05:05:42.337828+0000","last_became_peered":"2024-01-22T05:05:42.337828+0000","last_unstale":"2024-01-22T05:05:42.338150+0000","last_undegraded":"2024-01-22T05:05:42.338150+0000","last_fullsized":"2024-01-22T05:05:42.338150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318707+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.317908+0000","last_change":"2024-01-22T05:05:42.318067+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.317908+0000","last_undegraded":"2024-01-22T05:05:42.317908+0000","last_fullsized":"2024-01-22T05:05:42.317908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":["6","3"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.321114+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325385+0000","last_change":"2024-01-22T05:05:42.325514+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325385+0000","last_undegraded":"2024-01-22T05:05:42.325385+0000","last_fullsized":"2024-01-22T05:05:42.325385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329246+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.337984+0000","last_change":"2024-01-22T05:05:42.337984+0000","last_active":"2024-01-22T05:05:42.337984+0000","last_peered":"2024-01-22T05:05:42.337984+0000","last_clean":"2024-01-22T05:05:42.337984+0000","last_became_active":"2024-01-22T05:05:42.337050+0000","last_became_peered":"2024-01-22T05:05:42.337050+0000","last_unstale":"2024-01-22T05:05:42.337984+0000","last_undegraded":"2024-01-22T05:05:42.337984+0000","last_fullsized":"2024-01-22T05:05:42.337984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323301+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342175+0000","last_change":"2024-01-22T05:05:42.342250+0000","last_active":"2024-01-22T05:05:42.342175+0000","last_peered":"2024-01-22T05:05:42.342175+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.341974+0000","last_became_peered":"2024-01-22T05:05:42.341974+0000","last_unstale":"2024-01-22T05:05:42.342175+0000","last_undegraded":"2024-01-22T05:05:42.342175+0000","last_fullsized":"2024-01-22T05:05:42.342175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.319539+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341030+0000","last_change":"2024-01-22T05:05:42.341030+0000","last_active":"2024-01-22T05:05:42.341030+0000","last_peered":"2024-01-22T05:05:42.341030+0000","last_clean":"2024-01-22T05:05:42.341030+0000","last_became_active":"2024-01-22T05:05:42.340774+0000","last_became_peered":"2024-01-22T05:05:42.340774+0000","last_unstale":"2024-01-22T05:05:42.341030+0000","last_undegraded":"2024-01-22T05:05:42.341030+0000","last_fullsized":"2024-01-22T05:05:42.341030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324162+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.350752+0000","last_change":"2024-01-22T05:05:42.350837+0000","last_active":"2024-01-22T05:05:42.350752+0000","last_peered":"2024-01-22T05:05:42.350752+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.350332+0000","last_became_peered":"2024-01-22T05:05:42.350332+0000","last_unstale":"2024-01-22T05:05:42.350752+0000","last_undegraded":"2024-01-22T05:05:42.350752+0000","last_fullsized":"2024-01-22T05:05:42.350752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323993+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349729+0000","last_change":"2024-01-22T05:05:42.349799+0000","last_active":"2024-01-22T05:05:42.349729+0000","last_peered":"2024-01-22T05:05:42.349729+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349522+0000","last_became_peered":"2024-01-22T05:05:42.349522+0000","last_unstale":"2024-01-22T05:05:42.349729+0000","last_undegraded":"2024-01-22T05:05:42.349729+0000","last_fullsized":"2024-01-22T05:05:42.349729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329646+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349792+0000","last_change":"2024-01-22T05:05:42.349880+0000","last_active":"2024-01-22T05:05:42.349792+0000","last_peered":"2024-01-22T05:05:42.349792+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349346+0000","last_became_peered":"2024-01-22T05:05:42.349346+0000","last_unstale":"2024-01-22T05:05:42.349792+0000","last_undegraded":"2024-01-22T05:05:42.349792+0000","last_fullsized":"2024-01-22T05:05:42.349792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325410+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348272+0000","last_change":"2024-01-22T05:05:42.348366+0000","last_active":"2024-01-22T05:05:42.348272+0000","last_peered":"2024-01-22T05:05:42.348272+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347668+0000","last_became_peered":"2024-01-22T05:05:42.347668+0000","last_unstale":"2024-01-22T05:05:42.348272+0000","last_undegraded":"2024-01-22T05:05:42.348272+0000","last_fullsized":"2024-01-22T05:05:42.348272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324600+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.345773+0000","last_change":"2024-01-22T05:05:42.345773+0000","last_active":"2024-01-22T05:05:42.345773+0000","last_peered":"2024-01-22T05:05:42.345773+0000","last_clean":"2024-01-22T05:05:42.345773+0000","last_became_active":"2024-01-22T05:05:42.345307+0000","last_became_peered":"2024-01-22T05:05:42.345307+0000","last_unstale":"2024-01-22T05:05:42.345773+0000","last_undegraded":"2024-01-22T05:05:42.345773+0000","last_fullsized":"2024-01-22T05:05:42.345773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.317581+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344392+0000","last_change":"2024-01-22T05:05:42.344465+0000","last_active":"2024-01-22T05:05:42.344392+0000","last_peered":"2024-01-22T05:05:42.344392+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.344171+0000","last_became_peered":"2024-01-22T05:05:42.344171+0000","last_unstale":"2024-01-22T05:05:42.344392+0000","last_undegraded":"2024-01-22T05:05:42.344392+0000","last_fullsized":"2024-01-22T05:05:42.344392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328235+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339764+0000","last_change":"2024-01-22T05:05:42.339764+0000","last_active":"2024-01-22T05:05:42.339764+0000","last_peered":"2024-01-22T05:05:42.339764+0000","last_clean":"2024-01-22T05:05:42.339764+0000","last_became_active":"2024-01-22T05:05:42.339442+0000","last_became_peered":"2024-01-22T05:05:42.339442+0000","last_unstale":"2024-01-22T05:05:42.339764+0000","last_undegraded":"2024-01-22T05:05:42.339764+0000","last_fullsized":"2024-01-22T05:05:42.339764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322637+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339443+0000","last_change":"2024-01-22T05:05:42.339443+0000","last_active":"2024-01-22T05:05:42.339443+0000","last_peered":"2024-01-22T05:05:42.339443+0000","last_clean":"2024-01-22T05:05:42.339443+0000","last_became_active":"2024-01-22T05:05:42.339151+0000","last_became_peered":"2024-01-22T05:05:42.339151+0000","last_unstale":"2024-01-22T05:05:42.339443+0000","last_undegraded":"2024-01-22T05:05:42.339443+0000","last_fullsized":"2024-01-22T05:05:42.339443+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.326457+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341590+0000","last_change":"2024-01-22T05:05:42.341590+0000","last_active":"2024-01-22T05:05:42.341590+0000","last_peered":"2024-01-22T05:05:42.341590+0000","last_clean":"2024-01-22T05:05:42.341590+0000","last_became_active":"2024-01-22T05:05:42.340992+0000","last_became_peered":"2024-01-22T05:05:42.340992+0000","last_unstale":"2024-01-22T05:05:42.341590+0000","last_undegraded":"2024-01-22T05:05:42.341590+0000","last_fullsized":"2024-01-22T05:05:42.341590+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324144+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339284+0000","last_change":"2024-01-22T05:05:42.339386+0000","last_active":"2024-01-22T05:05:42.339284+0000","last_peered":"2024-01-22T05:05:42.339284+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.338881+0000","last_became_peered":"2024-01-22T05:05:42.338881+0000","last_unstale":"2024-01-22T05:05:42.339284+0000","last_undegraded":"2024-01-22T05:05:42.339284+0000","last_fullsized":"2024-01-22T05:05:42.339284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.320038+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349596+0000","last_change":"2024-01-22T05:05:42.349679+0000","last_active":"2024-01-22T05:05:42.349596+0000","last_peered":"2024-01-22T05:05:42.349596+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349307+0000","last_became_peered":"2024-01-22T05:05:42.349307+0000","last_unstale":"2024-01-22T05:05:42.349596+0000","last_undegraded":"2024-01-22T05:05:42.349596+0000","last_fullsized":"2024-01-22T05:05:42.349596+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323402+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325798+0000","last_change":"2024-01-22T05:05:42.325929+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325798+0000","last_undegraded":"2024-01-22T05:05:42.325798+0000","last_fullsized":"2024-01-22T05:05:42.325798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324883+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349870+0000","last_change":"2024-01-22T05:05:42.349941+0000","last_active":"2024-01-22T05:05:42.349870+0000","last_peered":"2024-01-22T05:05:42.349870+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349656+0000","last_became_peered":"2024-01-22T05:05:42.349656+0000","last_unstale":"2024-01-22T05:05:42.349870+0000","last_undegraded":"2024-01-22T05:05:42.349870+0000","last_fullsized":"2024-01-22T05:05:42.349870+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322543+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.353557+0000","last_change":"2024-01-22T05:05:42.353644+0000","last_active":"2024-01-22T05:05:42.353557+0000","last_peered":"2024-01-22T05:05:42.353557+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.346934+0000","last_became_peered":"2024-01-22T05:05:42.346934+0000","last_unstale":"2024-01-22T05:05:42.353557+0000","last_undegraded":"2024-01-22T05:05:42.353557+0000","last_fullsized":"2024-01-22T05:05:42.353557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.320145+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.315287+0000","last_change":"2024-01-22T05:05:42.315427+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.315287+0000","last_undegraded":"2024-01-22T05:05:42.315287+0000","last_fullsized":"2024-01-22T05:05:42.315287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328633+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.347740+0000","last_change":"2024-01-22T05:05:42.347821+0000","last_active":"2024-01-22T05:05:42.347740+0000","last_peered":"2024-01-22T05:05:42.347740+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347410+0000","last_became_peered":"2024-01-22T05:05:42.347410+0000","last_unstale":"2024-01-22T05:05:42.347740+0000","last_undegraded":"2024-01-22T05:05:42.347740+0000","last_fullsized":"2024-01-22T05:05:42.347740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.317245+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344802+0000","last_change":"2024-01-22T05:05:42.344802+0000","last_active":"2024-01-22T05:05:42.344802+0000","last_peered":"2024-01-22T05:05:42.344802+0000","last_clean":"2024-01-22T05:05:42.344802+0000","last_became_active":"2024-01-22T05:05:42.344442+0000","last_became_peered":"2024-01-22T05:05:42.344442+0000","last_unstale":"2024-01-22T05:05:42.344802+0000","last_undegraded":"2024-01-22T05:05:42.344802+0000","last_fullsized":"2024-01-22T05:05:42.344802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.317812+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341229+0000","last_change":"2024-01-22T05:05:42.347745+0000","last_active":"2024-01-22T05:05:42.341229+0000","last_peered":"2024-01-22T05:05:42.341229+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.341018+0000","last_became_peered":"2024-01-22T05:05:42.341018+0000","last_unstale":"2024-01-22T05:05:42.341229+0000","last_undegraded":"2024-01-22T05:05:42.341229+0000","last_fullsized":"2024-01-22T05:05:42.341229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.335130+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349994+0000","last_change":"2024-01-22T05:05:42.350071+0000","last_active":"2024-01-22T05:05:42.349994+0000","last_peered":"2024-01-22T05:05:42.349994+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349778+0000","last_became_peered":"2024-01-22T05:05:42.349778+0000","last_unstale":"2024-01-22T05:05:42.349994+0000","last_undegraded":"2024-01-22T05:05:42.349994+0000","last_fullsized":"2024-01-22T05:05:42.349994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.319758+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.338002+0000","last_change":"2024-01-22T05:05:42.338002+0000","last_active":"2024-01-22T05:05:42.338002+0000","last_peered":"2024-01-22T05:05:42.338002+0000","last_clean":"2024-01-22T05:05:42.338002+0000","last_became_active":"2024-01-22T05:05:42.337734+0000","last_became_peered":"2024-01-22T05:05:42.337734+0000","last_unstale":"2024-01-22T05:05:42.338002+0000","last_undegraded":"2024-01-22T05:05:42.338002+0000","last_fullsized":"2024-01-22T05:05:42.338002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318932+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344542+0000","last_change":"2024-01-22T05:05:42.344542+0000","last_active":"2024-01-22T05:05:42.344542+0000","last_peered":"2024-01-22T05:05:42.344542+0000","last_clean":"2024-01-22T05:05:42.344542+0000","last_became_active":"2024-01-22T05:05:42.342874+0000","last_became_peered":"2024-01-22T05:05:42.342874+0000","last_unstale":"2024-01-22T05:05:42.344542+0000","last_undegraded":"2024-01-22T05:05:42.344542+0000","last_fullsized":"2024-01-22T05:05:42.344542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328176+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325366+0000","last_change":"2024-01-22T05:05:42.326707+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325366+0000","last_undegraded":"2024-01-22T05:05:42.325366+0000","last_fullsized":"2024-01-22T05:05:42.325366+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.334650+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339234+0000","last_change":"2024-01-22T05:05:42.339234+0000","last_active":"2024-01-22T05:05:42.339234+0000","last_peered":"2024-01-22T05:05:42.339234+0000","last_clean":"2024-01-22T05:05:42.339234+0000","last_became_active":"2024-01-22T05:05:42.338850+0000","last_became_peered":"2024-01-22T05:05:42.338850+0000","last_unstale":"2024-01-22T05:05:42.339234+0000","last_undegraded":"2024-01-22T05:05:42.339234+0000","last_fullsized":"2024-01-22T05:05:42.339234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.315458+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:05:41.315458+0000","last_peered":"2024-01-22T05:05:41.315458+0000","last_clean":"2024-01-22T05:05:41.315458+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:05:41.315458+0000","last_undegraded":"2024-01-22T05:05:41.315458+0000","last_fullsized":"2024-01-22T05:05:41.315458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.330991+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.328769+0000","last_change":"2024-01-22T05:05:42.328933+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.328769+0000","last_undegraded":"2024-01-22T05:05:42.328769+0000","last_fullsized":"2024-01-22T05:05:42.328769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.317228+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:05:41.317228+0000","last_peered":"2024-01-22T05:05:41.317228+0000","last_clean":"2024-01-22T05:05:41.317228+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:05:41.317228+0000","last_undegraded":"2024-01-22T05:05:41.317228+0000","last_fullsized":"2024-01-22T05:05:41.317228+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.321560+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.337281+0000","last_change":"2024-01-22T05:05:42.337281+0000","last_active":"2024-01-22T05:05:42.337281+0000","last_peered":"2024-01-22T05:05:42.337281+0000","last_clean":"2024-01-22T05:05:42.337281+0000","last_became_active":"2024-01-22T05:05:42.336978+0000","last_became_peered":"2024-01-22T05:05:42.336978+0000","last_unstale":"2024-01-22T05:05:42.337281+0000","last_undegraded":"2024-01-22T05:05:42.337281+0000","last_fullsized":"2024-01-22T05:05:42.337281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.320588+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:05:41.320588+0000","last_peered":"2024-01-22T05:05:41.320588+0000","last_clean":"2024-01-22T05:05:41.320588+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:05:41.320588+0000","last_undegraded":"2024-01-22T05:05:41.320588+0000","last_fullsized":"2024-01-22T05:05:41.320588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.327801+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.356048+0000","last_change":"2024-01-22T05:05:42.356135+0000","last_active":"2024-01-22T05:05:42.356048+0000","last_peered":"2024-01-22T05:05:42.356048+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.354489+0000","last_became_peered":"2024-01-22T05:05:42.354489+0000","last_unstale":"2024-01-22T05:05:42.356048+0000","last_undegraded":"2024-01-22T05:05:42.356048+0000","last_fullsized":"2024-01-22T05:05:42.356048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.317248+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:05:41.317248+0000","last_peered":"2024-01-22T05:05:41.317248+0000","last_clean":"2024-01-22T05:05:41.317248+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:05:41.317248+0000","last_undegraded":"2024-01-22T05:05:41.317248+0000","last_fullsized":"2024-01-22T05:05:41.317248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318834+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348871+0000","last_change":"2024-01-22T05:05:42.348953+0000","last_active":"2024-01-22T05:05:42.348871+0000","last_peered":"2024-01-22T05:05:42.348871+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348577+0000","last_became_peered":"2024-01-22T05:05:42.348577+0000","last_unstale":"2024-01-22T05:05:42.348871+0000","last_undegraded":"2024-01-22T05:05:42.348871+0000","last_fullsized":"2024-01-22T05:05:42.348871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.312204+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:05:41.312204+0000","last_peered":"2024-01-22T05:05:41.312204+0000","last_clean":"2024-01-22T05:05:41.312204+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:05:41.312204+0000","last_undegraded":"2024-01-22T05:05:41.312204+0000","last_fullsized":"2024-01-22T05:05:41.312204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323280+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341704+0000","last_change":"2024-01-22T05:05:42.341704+0000","last_active":"2024-01-22T05:05:42.341704+0000","last_peered":"2024-01-22T05:05:42.341704+0000","last_clean":"2024-01-22T05:05:42.341704+0000","last_became_active":"2024-01-22T05:05:42.341329+0000","last_became_peered":"2024-01-22T05:05:42.341329+0000","last_unstale":"2024-01-22T05:05:42.341704+0000","last_undegraded":"2024-01-22T05:05:42.341704+0000","last_fullsized":"2024-01-22T05:05:42.341704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.310547+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:05:41.310547+0000","last_peered":"2024-01-22T05:05:41.310547+0000","last_clean":"2024-01-22T05:05:41.310547+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:05:41.310547+0000","last_undegraded":"2024-01-22T05:05:41.310547+0000","last_fullsized":"2024-01-22T05:05:41.310547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323610+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344542+0000","last_change":"2024-01-22T05:05:42.344663+0000","last_active":"2024-01-22T05:05:42.344542+0000","last_peered":"2024-01-22T05:05:42.344542+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.344347+0000","last_became_peered":"2024-01-22T05:05:42.344347+0000","last_unstale":"2024-01-22T05:05:42.344542+0000","last_undegraded":"2024-01-22T05:05:42.344542+0000","last_fullsized":"2024-01-22T05:05:42.344542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.319271+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:05:41.319271+0000","last_peered":"2024-01-22T05:05:41.319271+0000","last_clean":"2024-01-22T05:05:41.319271+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:05:41.319271+0000","last_undegraded":"2024-01-22T05:05:41.319271+0000","last_fullsized":"2024-01-22T05:05:41.319271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323280+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.323159+0000","last_change":"2024-01-22T05:05:42.323294+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.323159+0000","last_undegraded":"2024-01-22T05:05:42.323159+0000","last_fullsized":"2024-01-22T05:05:42.323159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.312237+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:05:41.312237+0000","last_peered":"2024-01-22T05:05:41.312237+0000","last_clean":"2024-01-22T05:05:41.312237+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:05:41.312237+0000","last_undegraded":"2024-01-22T05:05:41.312237+0000","last_fullsized":"2024-01-22T05:05:41.312237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.319384+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:05:41.319384+0000","last_peered":"2024-01-22T05:05:41.319384+0000","last_clean":"2024-01-22T05:05:41.319384+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:05:41.319384+0000","last_undegraded":"2024-01-22T05:05:41.319384+0000","last_fullsized":"2024-01-22T05:05:41.319384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.90500000000000003}]},{"osd":1,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.3029999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":1.0409999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.85699999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.143},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.343}]},{"osd":5,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.4259999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.381},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.5369999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.552},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.88500000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":4.1760000000000002,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.2010000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":0.94299999999999995}]},{"osd":4,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.462},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.4299999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.383}]},{"osd":7,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":3.2850000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":1.4890000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.079},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.96899999999999997}]},{"osd":1,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.204},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.2749999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.88500000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.3220000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.998},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.1120000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.2010000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.1759999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.248},{"interface":"front","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":3.1840000000000002,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.226}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.0049999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.1539999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.0649999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.196}]},{"osd":5,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.2549999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.369},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":3.085,"5min":3.085,"15min":3.085},"last":1.2769999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.5129999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.4219999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.78400000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.472},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.494}]},{"osd":4,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.161}]},{"osd":5,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.995}]},{"osd":6,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.355},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.3280000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.339},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.5189999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.86799999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.369}]},{"osd":3,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.91100000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.0840000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.222},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.3089999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.234},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.5109999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.302},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.571}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.91000000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.044}]},{"osd":3,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.002},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.97999999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.179}]},{"osd":5,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.153},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.4279999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.496}]},{"osd":7,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.474},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":1.5309999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.746},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.2290000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.85599999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.7989999999999999,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.0700000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":5.1799999999999997,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.80800000000000005}]},{"osd":5,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":3.548,"5min":3.548,"15min":3.548},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.276}]},{"osd":6,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.1140000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":5.29,"5min":5.29,"15min":5.29},"last":1.169},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.97399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:05:47.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2024-01-22T05:05:47.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.329251+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:05:47.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2024-01-22T05:05:47.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.323114+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:05:47.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-01-22T05:05:47.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 38, 'state': 'creating+activating', 'last_fresh': '2024-01-22T05:05:42.333060+0000', 'last_change': '2024-01-22T05:05:42.333186+0000', 'last_active': '2024-01-22T05:05:41.291706+0000', 'last_peered': '2024-01-22T05:05:41.291706+0000', 'last_clean': '2024-01-22T05:05:41.291706+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.333060+0000', 'last_undegraded': '2024-01-22T05:05:42.333060+0000', 'last_fullsized': '2024-01-22T05:05:42.333060+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:05:47.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2024-01-22T05:05:47.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.324407+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:05:47.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2024-01-22T05:05:47.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.325801+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:05:47.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2024-01-22T05:05:47.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 38, 'state': 'creating+activating', 'last_fresh': '2024-01-22T05:05:42.314509+0000', 'last_change': '2024-01-22T05:05:42.314824+0000', 'last_active': '2024-01-22T05:05:41.291706+0000', 'last_peered': '2024-01-22T05:05:41.291706+0000', 'last_clean': '2024-01-22T05:05:41.291706+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.314509+0000', 'last_undegraded': '2024-01-22T05:05:42.314509+0000', 'last_fullsized': '2024-01-22T05:05:42.314509+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': ['2', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:05:47.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2024-01-22T05:05:47.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.335660+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:05:47.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2024-01-22T05:05:47.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.324800+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:05:47.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-01-22T05:05:47.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 38, 'state': 'creating+activating', 'last_fresh': '2024-01-22T05:05:42.319442+0000', 'last_change': '2024-01-22T05:05:42.319615+0000', 'last_active': '2024-01-22T05:05:41.291706+0000', 'last_peered': '2024-01-22T05:05:41.291706+0000', 'last_clean': '2024-01-22T05:05:41.291706+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.319442+0000', 'last_undegraded': '2024-01-22T05:05:42.319442+0000', 'last_fullsized': '2024-01-22T05:05:42.319442+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:05:47.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2024-01-22T05:05:47.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.325085+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:05:47.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2024-01-22T05:05:47.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.323074+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:05:47.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2024-01-22T05:05:47.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.325729+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:05:47.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2024-01-22T05:05:47.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.329216+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:05:47.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2024-01-22T05:05:47.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.330639+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:05:47.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2024-01-22T05:05:47.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.324999+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:05:47.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2024-01-22T05:05:47.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.326053+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:05:47.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2024-01-22T05:05:47.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.322050+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:05:47.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2024-01-22T05:05:47.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.316716+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:05:47.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2024-01-22T05:05:47.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.329749+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:05:47.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2024-01-22T05:05:47.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.328668+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:05:47.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2024-01-22T05:05:47.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 38, 'state': 'creating+activating', 'last_fresh': '2024-01-22T05:05:42.329674+0000', 'last_change': '2024-01-22T05:05:42.329791+0000', 'last_active': '2024-01-22T05:05:41.291706+0000', 'last_peered': '2024-01-22T05:05:41.291706+0000', 'last_clean': '2024-01-22T05:05:41.291706+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.329674+0000', 'last_undegraded': '2024-01-22T05:05:42.329674+0000', 'last_fullsized': '2024-01-22T05:05:42.329674+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': ['7', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:05:47.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2024-01-22T05:05:47.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.324173+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:05:47.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2024-01-22T05:05:47.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.322622+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:05:47.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2024-01-22T05:05:47.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.319316+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:05:47.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2024-01-22T05:05:47.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.325476+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:05:47.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2024-01-22T05:05:47.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.331408+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:05:47.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2024-01-22T05:05:47.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 38, 'state': 'creating+activating', 'last_fresh': '2024-01-22T05:05:42.328734+0000', 'last_change': '2024-01-22T05:05:42.328858+0000', 'last_active': '2024-01-22T05:05:41.291706+0000', 'last_peered': '2024-01-22T05:05:41.291706+0000', 'last_clean': '2024-01-22T05:05:41.291706+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.328734+0000', 'last_undegraded': '2024-01-22T05:05:42.328734+0000', 'last_fullsized': '2024-01-22T05:05:42.328734+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': ['4', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:05:47.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2024-01-22T05:05:47.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.315913+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:05:47.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2024-01-22T05:05:47.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 38, 'state': 'creating+activating', 'last_fresh': '2024-01-22T05:05:42.325052+0000', 'last_change': '2024-01-22T05:05:42.325186+0000', 'last_active': '2024-01-22T05:05:41.291706+0000', 'last_peered': '2024-01-22T05:05:41.291706+0000', 'last_clean': '2024-01-22T05:05:41.291706+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.325052+0000', 'last_undegraded': '2024-01-22T05:05:42.325052+0000', 'last_fullsized': '2024-01-22T05:05:42.325052+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': ['7', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:05:47.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2024-01-22T05:05:47.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.318073+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:05:47.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2024-01-22T05:05:47.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.321175+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:05:47.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2024-01-22T05:05:47.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.320463+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:05:47.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2024-01-22T05:05:47.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.324676+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:05:47.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2024-01-22T05:05:47.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.325321+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:05:47.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2024-01-22T05:05:47.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 38, 'state': 'creating+activating', 'last_fresh': '2024-01-22T05:05:42.323932+0000', 'last_change': '2024-01-22T05:05:42.324056+0000', 'last_active': '2024-01-22T05:05:41.291706+0000', 'last_peered': '2024-01-22T05:05:41.291706+0000', 'last_clean': '2024-01-22T05:05:41.291706+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.323932+0000', 'last_undegraded': '2024-01-22T05:05:42.323932+0000', 'last_fullsized': '2024-01-22T05:05:42.323932+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': ['5', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:05:47.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2024-01-22T05:05:47.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.330033+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:05:47.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2024-01-22T05:05:47.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.318707+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:05:47.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2024-01-22T05:05:47.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 38, 'state': 'creating+activating', 'last_fresh': '2024-01-22T05:05:42.317908+0000', 'last_change': '2024-01-22T05:05:42.318067+0000', 'last_active': '2024-01-22T05:05:41.291706+0000', 'last_peered': '2024-01-22T05:05:41.291706+0000', 'last_clean': '2024-01-22T05:05:41.291706+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.317908+0000', 'last_undegraded': '2024-01-22T05:05:42.317908+0000', 'last_fullsized': '2024-01-22T05:05:42.317908+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': ['6', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:05:47.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2024-01-22T05:05:47.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.321114+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:05:47.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2024-01-22T05:05:47.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 38, 'state': 'creating+activating', 'last_fresh': '2024-01-22T05:05:42.325385+0000', 'last_change': '2024-01-22T05:05:42.325514+0000', 'last_active': '2024-01-22T05:05:41.291706+0000', 'last_peered': '2024-01-22T05:05:41.291706+0000', 'last_clean': '2024-01-22T05:05:41.291706+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.325385+0000', 'last_undegraded': '2024-01-22T05:05:42.325385+0000', 'last_fullsized': '2024-01-22T05:05:42.325385+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': ['7', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:05:47.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2024-01-22T05:05:47.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.329246+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:05:47.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-01-22T05:05:47.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.323301+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:05:47.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-01-22T05:05:47.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.319539+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:05:47.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2024-01-22T05:05:47.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.324162+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:05:47.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-01-22T05:05:47.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.323993+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:05:47.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2024-01-22T05:05:47.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.329646+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:05:47.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2024-01-22T05:05:47.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.325410+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:05:47.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2024-01-22T05:05:47.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.324600+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:05:47.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-01-22T05:05:47.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.317581+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:05:47.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2024-01-22T05:05:47.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.328235+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:05:47.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2024-01-22T05:05:47.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.322637+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:05:47.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2024-01-22T05:05:47.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.326457+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:05:47.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2024-01-22T05:05:47.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.324144+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:05:47.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-01-22T05:05:47.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.320038+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:05:47.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2024-01-22T05:05:47.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.323402+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:05:47.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-01-22T05:05:47.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 38, 'state': 'creating+activating', 'last_fresh': '2024-01-22T05:05:42.325798+0000', 'last_change': '2024-01-22T05:05:42.325929+0000', 'last_active': '2024-01-22T05:05:41.291706+0000', 'last_peered': '2024-01-22T05:05:41.291706+0000', 'last_clean': '2024-01-22T05:05:41.291706+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.325798+0000', 'last_undegraded': '2024-01-22T05:05:42.325798+0000', 'last_fullsized': '2024-01-22T05:05:42.325798+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': ['7', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:05:47.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2024-01-22T05:05:47.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.324883+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:05:47.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2024-01-22T05:05:47.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.322543+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:05:47.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2024-01-22T05:05:47.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.320145+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:05:47.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-01-22T05:05:47.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 38, 'state': 'creating+activating', 'last_fresh': '2024-01-22T05:05:42.315287+0000', 'last_change': '2024-01-22T05:05:42.315427+0000', 'last_active': '2024-01-22T05:05:41.291706+0000', 'last_peered': '2024-01-22T05:05:41.291706+0000', 'last_clean': '2024-01-22T05:05:41.291706+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.315287+0000', 'last_undegraded': '2024-01-22T05:05:42.315287+0000', 'last_fullsized': '2024-01-22T05:05:42.315287+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:05:47.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2024-01-22T05:05:47.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.328633+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:05:47.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-01-22T05:05:47.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.317245+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:05:47.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-01-22T05:05:47.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.317812+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:05:47.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2024-01-22T05:05:47.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.335130+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:05:47.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-01-22T05:05:47.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.319758+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:05:47.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2024-01-22T05:05:47.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.318932+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:05:47.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-01-22T05:05:47.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.328176+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:05:47.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-01-22T05:05:47.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 38, 'state': 'creating+activating', 'last_fresh': '2024-01-22T05:05:42.325366+0000', 'last_change': '2024-01-22T05:05:42.326707+0000', 'last_active': '2024-01-22T05:05:41.291706+0000', 'last_peered': '2024-01-22T05:05:41.291706+0000', 'last_clean': '2024-01-22T05:05:41.291706+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.325366+0000', 'last_undegraded': '2024-01-22T05:05:42.325366+0000', 'last_fullsized': '2024-01-22T05:05:42.325366+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': ['7', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:05:47.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2024-01-22T05:05:47.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.334650+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:05:47.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2024-01-22T05:05:47.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.330991+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:05:47.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-01-22T05:05:47.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 38, 'state': 'creating+activating', 'last_fresh': '2024-01-22T05:05:42.328769+0000', 'last_change': '2024-01-22T05:05:42.328933+0000', 'last_active': '2024-01-22T05:05:41.291706+0000', 'last_peered': '2024-01-22T05:05:41.291706+0000', 'last_clean': '2024-01-22T05:05:41.291706+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.328769+0000', 'last_undegraded': '2024-01-22T05:05:42.328769+0000', 'last_fullsized': '2024-01-22T05:05:42.328769+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': ['4', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:05:47.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2024-01-22T05:05:47.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.321560+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:05:47.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2024-01-22T05:05:47.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.327801+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:05:47.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-01-22T05:05:47.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.318834+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:05:47.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2024-01-22T05:05:47.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.323280+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:05:47.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2024-01-22T05:05:47.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.323610+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:05:47.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2024-01-22T05:05:47.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:05:42.302441+0000', 'last_change': '2024-01-22T05:05:42.323280+0000', 'last_active': '2024-01-22T05:05:42.302441+0000', 'last_peered': '2024-01-22T05:05:42.302441+0000', 'last_clean': '2024-01-22T05:05:42.302441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.302441+0000', 'last_undegraded': '2024-01-22T05:05:42.302441+0000', 'last_fullsized': '2024-01-22T05:05:42.302441+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:42.302441+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:05:47.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-01-22T05:05:47.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 38, 'state': 'creating+activating', 'last_fresh': '2024-01-22T05:05:42.323159+0000', 'last_change': '2024-01-22T05:05:42.323294+0000', 'last_active': '2024-01-22T05:05:41.291706+0000', 'last_peered': '2024-01-22T05:05:41.291706+0000', 'last_clean': '2024-01-22T05:05:41.291706+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:05:42.323159+0000', 'last_undegraded': '2024-01-22T05:05:42.323159+0000', 'last_fullsized': '2024-01-22T05:05:42.323159+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'last_clean_scrub_stamp': '2024-01-22T05:05:41.291706+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': ['5', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:05:47.957 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:05:48.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.140+0000 7f003a800700 1 Processor -- start 2024-01-22T05:05:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.140+0000 7f003a800700 1 -- start start 2024-01-22T05:05:48.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.144+0000 7f003a800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0034065240 0x7f00340644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:48.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.144+0000 7f003a800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00340649e0 0x7f003415c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:48.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.144+0000 7f003a800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00340c2700 con 0x7f0034065620 2024-01-22T05:05:48.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.144+0000 7f003a800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0034064e30 con 0x7f0034065240 2024-01-22T05:05:48.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.144+0000 7f003a800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00340c29a0 con 0x7f00340649e0 2024-01-22T05:05:48.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.144+0000 7f0033400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0034065240 0x7f00340644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:48.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.144+0000 7f0033400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0034065240 0x7f00340644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53950/0 (socket says 172.21.15.49:53950) 2024-01-22T05:05:48.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.144+0000 7f0033400700 1 -- 172.21.15.49:0/3732923133 learned_addr learned my addr 172.21.15.49:0/3732923133 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:48.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.144+0000 7f0039200700 1 --2- 172.21.15.49:0/3732923133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00340649e0 0x7f003415c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f0033400700 1 -- 172.21.15.49:0/3732923133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00340649e0 msgr2=0x7f003415c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f0033400700 1 --2- 172.21.15.49:0/3732923133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00340649e0 0x7f003415c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f0033400700 1 -- 172.21.15.49:0/3732923133 >> v1:172.21.15.110:6789/0 conn(0x7f0034065620 legacy=0x7f003415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f0033400700 1 -- 172.21.15.49:0/3732923133 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00340c2c80 con 0x7f0034065240 2024-01-22T05:05:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f0032000700 1 -- 172.21.15.49:0/3732923133 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233295517 0 0) 0x7f00340c2700 con 0x7f0034065620 2024-01-22T05:05:48.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f0033400700 1 --2- 172.21.15.49:0/3732923133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0034065240 0x7f00340644f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f0024006fd0 tx=0x7f00240090f0).ready entity=mon.0 client_cookie=987078ab9e454da1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:48.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f0032000700 1 -- 172.21.15.49:0/3732923133 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002400b600 con 0x7f0034065240 2024-01-22T05:05:48.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f0032000700 1 -- 172.21.15.49:0/3732923133 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002400b760 con 0x7f0034065240 2024-01-22T05:05:48.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f0032000700 1 -- 172.21.15.49:0/3732923133 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002400bae0 con 0x7f0034065240 2024-01-22T05:05:48.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f003a800700 1 -- 172.21.15.49:0/3732923133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0034065240 msgr2=0x7f00340644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:48.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f003a800700 1 --2- 172.21.15.49:0/3732923133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0034065240 0x7f00340644f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f0024006fd0 tx=0x7f00240090f0).stop 2024-01-22T05:05:48.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f003a800700 1 -- 172.21.15.49:0/3732923133 shutdown_connections 2024-01-22T05:05:48.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f003a800700 1 --2- 172.21.15.49:0/3732923133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00340649e0 0x7f003415c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f003a800700 1 --2- 172.21.15.49:0/3732923133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0034065240 0x7f00340644f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f003a800700 1 -- 172.21.15.49:0/3732923133 >> 172.21.15.49:0/3732923133 conn(0x7f00340c87f0 msgr2=0x7f00340c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:48.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f003a800700 1 -- 172.21.15.49:0/3732923133 shutdown_connections 2024-01-22T05:05:48.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.148+0000 7f003a800700 1 -- 172.21.15.49:0/3732923133 wait complete. 2024-01-22T05:05:48.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.152+0000 7f003a800700 1 Processor -- start 2024-01-22T05:05:48.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.152+0000 7f003a800700 1 -- start start 2024-01-22T05:05:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f003a800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00340649e0 0x7f00340c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f003a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0034065240 0x7f00340ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f003a800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0034065620 0x7f00340ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f003a800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00340c21d0 con 0x7f0034065240 2024-01-22T05:05:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f003a800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00340bfc80 con 0x7f0034065620 2024-01-22T05:05:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f003a800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00341549e0 con 0x7f00340649e0 2024-01-22T05:05:48.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f0033400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00340649e0 0x7f00340c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:48.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f0032a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0034065240 0x7f00340ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:48.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f0033400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00340649e0 0x7f00340c1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:44120/0 (socket says 172.21.15.49:44120) 2024-01-22T05:05:48.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f0033400700 1 -- 172.21.15.49:0/2279088665 learned_addr learned my addr 172.21.15.49:0/2279088665 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:48.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f0039200700 1 --2- 172.21.15.49:0/2279088665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0034065620 0x7f00340ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:48.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f0033400700 1 -- 172.21.15.49:0/2279088665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0034065620 msgr2=0x7f00340ac610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:48.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f0033400700 1 --2- 172.21.15.49:0/2279088665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0034065620 0x7f00340ac610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f0033400700 1 -- 172.21.15.49:0/2279088665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0034065240 msgr2=0x7f00340ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:48.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f0033400700 1 --2- 172.21.15.49:0/2279088665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0034065240 0x7f00340ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f0033400700 1 -- 172.21.15.49:0/2279088665 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0024009370 con 0x7f00340649e0 2024-01-22T05:05:48.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f0032a00700 1 --2- 172.21.15.49:0/2279088665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0034065240 0x7f00340ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:48.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f0033400700 1 --2- 172.21.15.49:0/2279088665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00340649e0 0x7f00340c1b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0034066be0 tx=0x7f0024017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:48.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f002aa00700 1 -- 172.21.15.49:0/2279088665 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002400bea0 con 0x7f00340649e0 2024-01-22T05:05:48.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f002aa00700 1 -- 172.21.15.49:0/2279088665 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002400b8d0 con 0x7f00340649e0 2024-01-22T05:05:48.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f003a800700 1 -- 172.21.15.49:0/2279088665 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00340bf350 con 0x7f00340649e0 2024-01-22T05:05:48.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f002aa00700 1 -- 172.21.15.49:0/2279088665 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002401c670 con 0x7f00340649e0 2024-01-22T05:05:48.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.156+0000 7f003a800700 1 -- 172.21.15.49:0/2279088665 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00340bf910 con 0x7f00340649e0 2024-01-22T05:05:48.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.160+0000 7f003a800700 1 -- 172.21.15.49:0/2279088665 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0034047060 con 0x7f00340649e0 2024-01-22T05:05:48.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.160+0000 7f002aa00700 1 -- 172.21.15.49:0/2279088665 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f002401c9e0 con 0x7f00340649e0 2024-01-22T05:05:48.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.164+0000 7f002aa00700 1 --2- 172.21.15.49:0/2279088665 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f000c05a540 0x7f000c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:48.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.164+0000 7f002aa00700 1 -- 172.21.15.49:0/2279088665 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f00240765a0 con 0x7f00340649e0 2024-01-22T05:05:48.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.164+0000 7f0032a00700 1 --2- 172.21.15.49:0/2279088665 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f000c05a540 0x7f000c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:48.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.164+0000 7f0032a00700 1 --2- 172.21.15.49:0/2279088665 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f000c05a540 0x7f000c05ca00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f0034154190 tx=0x7f001c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:48.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.172+0000 7f002aa00700 1 -- 172.21.15.49:0/2279088665 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0024049c20 con 0x7f00340649e0 2024-01-22T05:05:48.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.400+0000 7f003a800700 1 -- 172.21.15.49:0/2279088665 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f00340c2f60 con 0x7f00340649e0 2024-01-22T05:05:48.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.400+0000 7f002aa00700 1 -- 172.21.15.49:0/2279088665 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1241 (secure 0 0 0) 0x7f0024020080 con 0x7f00340649e0 2024-01-22T05:05:48.404 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:48.404 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":92,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":59},{"state_name":"creating+activating","count":14}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2437218304,"bytes_avail":770656894976,"bytes_total":773094113280,"inactive_pgs_ratio":0.56934309005737305},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5121}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-01-22T05:05:31.244160+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:05:48.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.404+0000 7f003a800700 1 -- 172.21.15.49:0/2279088665 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f000c05a540 msgr2=0x7f000c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:48.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.404+0000 7f003a800700 1 --2- 172.21.15.49:0/2279088665 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f000c05a540 0x7f000c05ca00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f0034154190 tx=0x7f001c009040).stop 2024-01-22T05:05:48.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.404+0000 7f003a800700 1 -- 172.21.15.49:0/2279088665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00340649e0 msgr2=0x7f00340c1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:48.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.404+0000 7f003a800700 1 --2- 172.21.15.49:0/2279088665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00340649e0 0x7f00340c1b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0034066be0 tx=0x7f0024017000).stop 2024-01-22T05:05:48.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.404+0000 7f003a800700 1 -- 172.21.15.49:0/2279088665 shutdown_connections 2024-01-22T05:05:48.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.404+0000 7f003a800700 1 --2- 172.21.15.49:0/2279088665 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f000c05a540 0x7f000c05ca00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.404+0000 7f003a800700 1 --2- 172.21.15.49:0/2279088665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0034065620 0x7f00340ac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.404+0000 7f003a800700 1 --2- 172.21.15.49:0/2279088665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0034065240 0x7f00340ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.404+0000 7f003a800700 1 --2- 172.21.15.49:0/2279088665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00340649e0 0x7f00340c1b40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.404+0000 7f003a800700 1 -- 172.21.15.49:0/2279088665 >> 172.21.15.49:0/2279088665 conn(0x7f00340c87f0 msgr2=0x7f00340638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:48.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.404+0000 7f003a800700 1 -- 172.21.15.49:0/2279088665 shutdown_connections 2024-01-22T05:05:48.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.404+0000 7f003a800700 1 -- 172.21.15.49:0/2279088665 wait complete. 2024-01-22T05:05:48.431 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-22T05:05:48.431 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:05:48.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.588+0000 7f838e200700 1 Processor -- start 2024-01-22T05:05:48.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.588+0000 7f838e200700 1 -- start start 2024-01-22T05:05:48.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f838e200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8388065620 0x7f83880bd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:48.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f838e200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83880c2700 con 0x7f8388065240 2024-01-22T05:05:48.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f838e200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83880c29a0 con 0x7f8388064c00 2024-01-22T05:05:48.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f838e200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83880c2c80 con 0x7f8388065620 2024-01-22T05:05:48.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8387400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8388065240 0x7f83880644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51066/0 (socket says 172.21.15.49:51066) 2024-01-22T05:05:48.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8387400700 1 -- 172.21.15.49:0/275797463 learned_addr learned my addr 172.21.15.49:0/275797463 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:48.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f838cc00700 1 --2- 172.21.15.49:0/275797463 >> v2:172.21.15.110:3300/0 conn(0x7f8388065620 0x7f83880bd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:48.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420993617 0 0) 0x7f83880c2700 con 0x7f8388065240 2024-01-22T05:05:48.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83680033f0 con 0x7f8388065240 2024-01-22T05:05:48.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464054869 0 0) 0x7f83880c29a0 con 0x7f8388064c00 2024-01-22T05:05:48.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83880c2700 con 0x7f8388064c00 2024-01-22T05:05:48.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3094470103 0 0) 0x7f83680033f0 con 0x7f8388065240 2024-01-22T05:05:48.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 >> v2:172.21.15.110:3300/0 conn(0x7f8388065620 msgr2=0x7f83880bd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 --2- 172.21.15.49:0/275797463 >> v2:172.21.15.110:3300/0 conn(0x7f8388065620 0x7f83880bd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 >> v1:172.21.15.110:6789/0 conn(0x7f8388064c00 legacy=0x7f83880bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880c2f60 con 0x7f8388065240 2024-01-22T05:05:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f8378001470 con 0x7f8388065240 2024-01-22T05:05:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f838cc00700 1 --2- 172.21.15.49:0/275797463 >> v2:172.21.15.110:3300/0 conn(0x7f8388065620 0x7f83880bd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 >> v1:172.21.15.49:6789/0 conn(0x7f8388065240 legacy=0x7f83880644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 --2- 172.21.15.49:0/275797463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8368003a70 0x7f8368003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 --2- 172.21.15.49:0/275797463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8368004690 0x7f8368004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 --2- 172.21.15.49:0/275797463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8368005000 0x7f836800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83880c2c80 con 0x7f8368004690 2024-01-22T05:05:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836800be80 con 0x7f8368003a70 2024-01-22T05:05:48.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.592+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836800c040 con 0x7f8368005000 2024-01-22T05:05:48.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f8387400700 1 --2- 172.21.15.49:0/275797463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8368003a70 0x7f8368003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:48.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f8386a00700 1 --2- 172.21.15.49:0/275797463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8368004690 0x7f8368004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:48.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f838cc00700 1 --2- 172.21.15.49:0/275797463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8368005000 0x7f836800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:48.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f838cc00700 1 -- 172.21.15.49:0/275797463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8368003a70 msgr2=0x7f8368003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:48.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f838cc00700 1 --2- 172.21.15.49:0/275797463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8368003a70 0x7f8368003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f838cc00700 1 -- 172.21.15.49:0/275797463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8368004690 msgr2=0x7f8368004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:48.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f838cc00700 1 --2- 172.21.15.49:0/275797463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8368004690 0x7f8368004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f838cc00700 1 -- 172.21.15.49:0/275797463 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83680033f0 con 0x7f8368005000 2024-01-22T05:05:48.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f8386a00700 1 --2- 172.21.15.49:0/275797463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8368004690 0x7f8368004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:48.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f838cc00700 1 -- 172.21.15.49:0/275797463 reap_dead start 2024-01-22T05:05:48.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f838cc00700 1 --2- 172.21.15.49:0/275797463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8368005000 0x7f836800b8e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f838000e3c0 tx=0x7f838000b040).ready entity=mon.2 client_cookie=be54edd5fa441248 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:48.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380017070 con 0x7f8368005000 2024-01-22T05:05:48.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838000f040 con 0x7f8368005000 2024-01-22T05:05:48.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f8386000700 1 -- 172.21.15.49:0/275797463 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380009cf0 con 0x7f8368005000 2024-01-22T05:05:48.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f838e200700 1 -- 172.21.15.49:0/275797463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8368005000 msgr2=0x7f836800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:48.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f838e200700 1 --2- 172.21.15.49:0/275797463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8368005000 0x7f836800b8e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f838000e3c0 tx=0x7f838000b040).stop 2024-01-22T05:05:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f838e200700 1 -- 172.21.15.49:0/275797463 shutdown_connections 2024-01-22T05:05:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f838e200700 1 --2- 172.21.15.49:0/275797463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8368005000 0x7f836800b8e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.596+0000 7f838e200700 1 -- 172.21.15.49:0/275797463 >> 172.21.15.49:0/275797463 conn(0x7f83880c87f0 msgr2=0x7f83880c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.600+0000 7f838e200700 1 -- 172.21.15.49:0/275797463 shutdown_connections 2024-01-22T05:05:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.600+0000 7f838e200700 1 -- 172.21.15.49:0/275797463 wait complete. 2024-01-22T05:05:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.600+0000 7f838e200700 1 Processor -- start 2024-01-22T05:05:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.600+0000 7f838e200700 1 -- start start 2024-01-22T05:05:48.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f838e200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8368005000 0x7f83880ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:48.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f838e200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8388151230 0x7f83880ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:48.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f838e200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83880a9660 0x7f83880a9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:48.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f838e200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83881516b0 con 0x7f83880a9660 2024-01-22T05:05:48.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f838e200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83880bffb0 con 0x7f8368005000 2024-01-22T05:05:48.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f838e200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83880c0140 con 0x7f8388151230 2024-01-22T05:05:48.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f838cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83880a9660 0x7f83880a9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:48.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f8387400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8368005000 0x7f83880ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:48.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f8386a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8388151230 0x7f83880ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:48.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f8387400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8368005000 0x7f83880ada20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:40736/0 (socket says 172.21.15.49:40736) 2024-01-22T05:05:48.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f838cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83880a9660 0x7f83880a9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53970/0 (socket says 172.21.15.49:53970) 2024-01-22T05:05:48.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f8387400700 1 -- 172.21.15.49:0/814920891 learned_addr learned my addr 172.21.15.49:0/814920891 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:48.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f8387400700 1 -- 172.21.15.49:0/814920891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8388151230 msgr2=0x7f83880ac010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:48.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f8387400700 1 --2- 172.21.15.49:0/814920891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8388151230 0x7f83880ac010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f8387400700 1 -- 172.21.15.49:0/814920891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83880a9660 msgr2=0x7f83880a9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:48.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f8387400700 1 --2- 172.21.15.49:0/814920891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83880a9660 0x7f83880a9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f8387400700 1 -- 172.21.15.49:0/814920891 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880a9fd0 con 0x7f8368005000 2024-01-22T05:05:48.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f838cc00700 1 --2- 172.21.15.49:0/814920891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83880a9660 0x7f83880a9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:48.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f8387400700 1 --2- 172.21.15.49:0/814920891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8368005000 0x7f83880ada20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f8378004a40 tx=0x7f8378001df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:48.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f837ea00700 1 -- 172.21.15.49:0/814920891 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780014f0 con 0x7f8368005000 2024-01-22T05:05:48.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f837ea00700 1 -- 172.21.15.49:0/814920891 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837800f870 con 0x7f8368005000 2024-01-22T05:05:48.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f838e200700 1 -- 172.21.15.49:0/814920891 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83880ac830 con 0x7f8368005000 2024-01-22T05:05:48.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.604+0000 7f837ea00700 1 -- 172.21.15.49:0/814920891 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837800fbf0 con 0x7f8368005000 2024-01-22T05:05:48.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.608+0000 7f838e200700 1 -- 172.21.15.49:0/814920891 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83880acdf0 con 0x7f8368005000 2024-01-22T05:05:48.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.608+0000 7f838e200700 1 -- 172.21.15.49:0/814920891 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8388047060 con 0x7f8368005000 2024-01-22T05:05:48.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.608+0000 7f837ea00700 1 -- 172.21.15.49:0/814920891 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8378015410 con 0x7f8368005000 2024-01-22T05:05:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.612+0000 7f837ea00700 1 --2- 172.21.15.49:0/814920891 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f836005a540 0x7f836005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.612+0000 7f837ea00700 1 -- 172.21.15.49:0/814920891 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f8378074c80 con 0x7f8368005000 2024-01-22T05:05:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.612+0000 7f8386a00700 1 --2- 172.21.15.49:0/814920891 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f836005a540 0x7f836005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:48.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.612+0000 7f8386a00700 1 --2- 172.21.15.49:0/814920891 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f836005a540 0x7f836005ca00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f83880ab140 tx=0x7f8370007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:48.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.620+0000 7f837ea00700 1 -- 172.21.15.49:0/814920891 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f83780481e0 con 0x7f8368005000 2024-01-22T05:05:48.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.780+0000 7f838e200700 1 -- 172.21.15.49:0/814920891 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83880c0280 con 0x7f836005a540 2024-01-22T05:05:48.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.800+0000 7f837ea00700 1 -- 172.21.15.49:0/814920891 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355106 (secure 0 0 0) 0x7f8370002810 con 0x7f836005a540 2024-01-22T05:05:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:48.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.808+0000 7f838e200700 1 -- 172.21.15.49:0/814920891 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f836005a540 msgr2=0x7f836005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:48.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.808+0000 7f838e200700 1 --2- 172.21.15.49:0/814920891 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f836005a540 0x7f836005ca00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f83880ab140 tx=0x7f8370007bb0).stop 2024-01-22T05:05:48.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.808+0000 7f838e200700 1 -- 172.21.15.49:0/814920891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8368005000 msgr2=0x7f83880ada20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:48.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.808+0000 7f838e200700 1 --2- 172.21.15.49:0/814920891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8368005000 0x7f83880ada20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f8378004a40 tx=0x7f8378001df0).stop 2024-01-22T05:05:48.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.812+0000 7f838e200700 1 -- 172.21.15.49:0/814920891 shutdown_connections 2024-01-22T05:05:48.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.812+0000 7f838e200700 1 --2- 172.21.15.49:0/814920891 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f836005a540 0x7f836005ca00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.812+0000 7f838e200700 1 --2- 172.21.15.49:0/814920891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83880a9660 0x7f83880a9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.812+0000 7f838e200700 1 --2- 172.21.15.49:0/814920891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8388151230 0x7f83880ac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.812+0000 7f838e200700 1 --2- 172.21.15.49:0/814920891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8368005000 0x7f83880ada20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:48.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.812+0000 7f838e200700 1 -- 172.21.15.49:0/814920891 >> 172.21.15.49:0/814920891 conn(0x7f83880c87f0 msgr2=0x7f83880639c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:48.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.812+0000 7f838e200700 1 -- 172.21.15.49:0/814920891 shutdown_connections 2024-01-22T05:05:48.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:48.812+0000 7f838e200700 1 -- 172.21.15.49:0/814920891 wait complete. 2024-01-22T05:05:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:05:48.836 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-01-22T05:05:47.249253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2380096,"kb_used_data":3328,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594624,"statfs":{"total":773094113280,"available":770656894976,"internally_reserved":0,"allocated":3407872,"data_stored":1517888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5501,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-53,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.993450"},"pg_stats":[{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329251+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348631+0000","last_change":"2024-01-22T05:05:42.348729+0000","last_active":"2024-01-22T05:05:42.348631+0000","last_peered":"2024-01-22T05:05:42.348631+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348416+0000","last_became_peered":"2024-01-22T05:05:42.348416+0000","last_unstale":"2024-01-22T05:05:42.348631+0000","last_undegraded":"2024-01-22T05:05:42.348631+0000","last_fullsized":"2024-01-22T05:05:42.348631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323114+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.333060+0000","last_change":"2024-01-22T05:05:42.333186+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.333060+0000","last_undegraded":"2024-01-22T05:05:42.333060+0000","last_fullsized":"2024-01-22T05:05:42.333060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324407+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.354145+0000","last_change":"2024-01-22T05:05:42.354261+0000","last_active":"2024-01-22T05:05:42.354145+0000","last_peered":"2024-01-22T05:05:42.354145+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347227+0000","last_became_peered":"2024-01-22T05:05:42.347227+0000","last_unstale":"2024-01-22T05:05:42.354145+0000","last_undegraded":"2024-01-22T05:05:42.354145+0000","last_fullsized":"2024-01-22T05:05:42.354145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325801+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.314509+0000","last_change":"2024-01-22T05:05:42.314824+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.314509+0000","last_undegraded":"2024-01-22T05:05:42.314509+0000","last_fullsized":"2024-01-22T05:05:42.314509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.335660+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.338151+0000","last_change":"2024-01-22T05:05:42.338151+0000","last_active":"2024-01-22T05:05:42.338151+0000","last_peered":"2024-01-22T05:05:42.338151+0000","last_clean":"2024-01-22T05:05:42.338151+0000","last_became_active":"2024-01-22T05:05:42.337821+0000","last_became_peered":"2024-01-22T05:05:42.337821+0000","last_unstale":"2024-01-22T05:05:42.338151+0000","last_undegraded":"2024-01-22T05:05:42.338151+0000","last_fullsized":"2024-01-22T05:05:42.338151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324800+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.319442+0000","last_change":"2024-01-22T05:05:42.319615+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.319442+0000","last_undegraded":"2024-01-22T05:05:42.319442+0000","last_fullsized":"2024-01-22T05:05:42.319442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325085+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341452+0000","last_change":"2024-01-22T05:05:42.341452+0000","last_active":"2024-01-22T05:05:42.341452+0000","last_peered":"2024-01-22T05:05:42.341452+0000","last_clean":"2024-01-22T05:05:42.341452+0000","last_became_active":"2024-01-22T05:05:42.338600+0000","last_became_peered":"2024-01-22T05:05:42.338600+0000","last_unstale":"2024-01-22T05:05:42.341452+0000","last_undegraded":"2024-01-22T05:05:42.341452+0000","last_fullsized":"2024-01-22T05:05:42.341452+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323074+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.346315+0000","last_change":"2024-01-22T05:05:42.346397+0000","last_active":"2024-01-22T05:05:42.346315+0000","last_peered":"2024-01-22T05:05:42.346315+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.346085+0000","last_became_peered":"2024-01-22T05:05:42.346085+0000","last_unstale":"2024-01-22T05:05:42.346315+0000","last_undegraded":"2024-01-22T05:05:42.346315+0000","last_fullsized":"2024-01-22T05:05:42.346315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325729+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.352390+0000","last_change":"2024-01-22T05:05:42.352458+0000","last_active":"2024-01-22T05:05:42.352390+0000","last_peered":"2024-01-22T05:05:42.352390+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.352103+0000","last_became_peered":"2024-01-22T05:05:42.352103+0000","last_unstale":"2024-01-22T05:05:42.352390+0000","last_undegraded":"2024-01-22T05:05:42.352390+0000","last_fullsized":"2024-01-22T05:05:42.352390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329216+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342554+0000","last_change":"2024-01-22T05:05:42.342554+0000","last_active":"2024-01-22T05:05:42.342554+0000","last_peered":"2024-01-22T05:05:42.342554+0000","last_clean":"2024-01-22T05:05:42.342554+0000","last_became_active":"2024-01-22T05:05:42.342223+0000","last_became_peered":"2024-01-22T05:05:42.342223+0000","last_unstale":"2024-01-22T05:05:42.342554+0000","last_undegraded":"2024-01-22T05:05:42.342554+0000","last_fullsized":"2024-01-22T05:05:42.342554+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.330639+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.350418+0000","last_change":"2024-01-22T05:05:42.350418+0000","last_active":"2024-01-22T05:05:42.350418+0000","last_peered":"2024-01-22T05:05:42.350418+0000","last_clean":"2024-01-22T05:05:42.350418+0000","last_became_active":"2024-01-22T05:05:42.348672+0000","last_became_peered":"2024-01-22T05:05:42.348672+0000","last_unstale":"2024-01-22T05:05:42.350418+0000","last_undegraded":"2024-01-22T05:05:42.350418+0000","last_fullsized":"2024-01-22T05:05:42.350418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324999+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342349+0000","last_change":"2024-01-22T05:05:42.342458+0000","last_active":"2024-01-22T05:05:42.342349+0000","last_peered":"2024-01-22T05:05:42.342349+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.341925+0000","last_became_peered":"2024-01-22T05:05:42.341925+0000","last_unstale":"2024-01-22T05:05:42.342349+0000","last_undegraded":"2024-01-22T05:05:42.342349+0000","last_fullsized":"2024-01-22T05:05:42.342349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.326053+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342444+0000","last_change":"2024-01-22T05:05:42.342444+0000","last_active":"2024-01-22T05:05:42.342444+0000","last_peered":"2024-01-22T05:05:42.342444+0000","last_clean":"2024-01-22T05:05:42.342444+0000","last_became_active":"2024-01-22T05:05:42.342153+0000","last_became_peered":"2024-01-22T05:05:42.342153+0000","last_unstale":"2024-01-22T05:05:42.342444+0000","last_undegraded":"2024-01-22T05:05:42.342444+0000","last_fullsized":"2024-01-22T05:05:42.342444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322050+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348473+0000","last_change":"2024-01-22T05:05:42.348591+0000","last_active":"2024-01-22T05:05:42.348473+0000","last_peered":"2024-01-22T05:05:42.348473+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348005+0000","last_became_peered":"2024-01-22T05:05:42.348005+0000","last_unstale":"2024-01-22T05:05:42.348473+0000","last_undegraded":"2024-01-22T05:05:42.348473+0000","last_fullsized":"2024-01-22T05:05:42.348473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.316716+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.345568+0000","last_change":"2024-01-22T05:05:42.345568+0000","last_active":"2024-01-22T05:05:42.345568+0000","last_peered":"2024-01-22T05:05:42.345568+0000","last_clean":"2024-01-22T05:05:42.345568+0000","last_became_active":"2024-01-22T05:05:42.344946+0000","last_became_peered":"2024-01-22T05:05:42.344946+0000","last_unstale":"2024-01-22T05:05:42.345568+0000","last_undegraded":"2024-01-22T05:05:42.345568+0000","last_fullsized":"2024-01-22T05:05:42.345568+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329749+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349037+0000","last_change":"2024-01-22T05:05:42.349106+0000","last_active":"2024-01-22T05:05:42.349037+0000","last_peered":"2024-01-22T05:05:42.349037+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348826+0000","last_became_peered":"2024-01-22T05:05:42.348826+0000","last_unstale":"2024-01-22T05:05:42.349037+0000","last_undegraded":"2024-01-22T05:05:42.349037+0000","last_fullsized":"2024-01-22T05:05:42.349037+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328668+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.329674+0000","last_change":"2024-01-22T05:05:42.329791+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.329674+0000","last_undegraded":"2024-01-22T05:05:42.329674+0000","last_fullsized":"2024-01-22T05:05:42.329674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324173+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349214+0000","last_change":"2024-01-22T05:05:42.350366+0000","last_active":"2024-01-22T05:05:42.349214+0000","last_peered":"2024-01-22T05:05:42.349214+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348991+0000","last_became_peered":"2024-01-22T05:05:42.348991+0000","last_unstale":"2024-01-22T05:05:42.349214+0000","last_undegraded":"2024-01-22T05:05:42.349214+0000","last_fullsized":"2024-01-22T05:05:42.349214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322622+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342802+0000","last_change":"2024-01-22T05:05:42.342877+0000","last_active":"2024-01-22T05:05:42.342802+0000","last_peered":"2024-01-22T05:05:42.342802+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.342414+0000","last_became_peered":"2024-01-22T05:05:42.342414+0000","last_unstale":"2024-01-22T05:05:42.342802+0000","last_undegraded":"2024-01-22T05:05:42.342802+0000","last_fullsized":"2024-01-22T05:05:42.342802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.319316+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341779+0000","last_change":"2024-01-22T05:05:42.341779+0000","last_active":"2024-01-22T05:05:42.341779+0000","last_peered":"2024-01-22T05:05:42.341779+0000","last_clean":"2024-01-22T05:05:42.341779+0000","last_became_active":"2024-01-22T05:05:42.341427+0000","last_became_peered":"2024-01-22T05:05:42.341427+0000","last_unstale":"2024-01-22T05:05:42.341779+0000","last_undegraded":"2024-01-22T05:05:42.341779+0000","last_fullsized":"2024-01-22T05:05:42.341779+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325476+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344902+0000","last_change":"2024-01-22T05:05:42.344902+0000","last_active":"2024-01-22T05:05:42.344902+0000","last_peered":"2024-01-22T05:05:42.344902+0000","last_clean":"2024-01-22T05:05:42.344902+0000","last_became_active":"2024-01-22T05:05:42.344587+0000","last_became_peered":"2024-01-22T05:05:42.344587+0000","last_unstale":"2024-01-22T05:05:42.344902+0000","last_undegraded":"2024-01-22T05:05:42.344902+0000","last_fullsized":"2024-01-22T05:05:42.344902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.331408+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.328734+0000","last_change":"2024-01-22T05:05:42.328858+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.328734+0000","last_undegraded":"2024-01-22T05:05:42.328734+0000","last_fullsized":"2024-01-22T05:05:42.328734+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.315913+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325052+0000","last_change":"2024-01-22T05:05:42.325186+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325052+0000","last_undegraded":"2024-01-22T05:05:42.325052+0000","last_fullsized":"2024-01-22T05:05:42.325052+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318073+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.347547+0000","last_change":"2024-01-22T05:05:42.347615+0000","last_active":"2024-01-22T05:05:42.347547+0000","last_peered":"2024-01-22T05:05:42.347547+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347347+0000","last_became_peered":"2024-01-22T05:05:42.347347+0000","last_unstale":"2024-01-22T05:05:42.347547+0000","last_undegraded":"2024-01-22T05:05:42.347547+0000","last_fullsized":"2024-01-22T05:05:42.347547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.321175+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342693+0000","last_change":"2024-01-22T05:05:42.342693+0000","last_active":"2024-01-22T05:05:42.342693+0000","last_peered":"2024-01-22T05:05:42.342693+0000","last_clean":"2024-01-22T05:05:42.342693+0000","last_became_active":"2024-01-22T05:05:42.342424+0000","last_became_peered":"2024-01-22T05:05:42.342424+0000","last_unstale":"2024-01-22T05:05:42.342693+0000","last_undegraded":"2024-01-22T05:05:42.342693+0000","last_fullsized":"2024-01-22T05:05:42.342693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.320463+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349899+0000","last_change":"2024-01-22T05:05:42.349978+0000","last_active":"2024-01-22T05:05:42.349899+0000","last_peered":"2024-01-22T05:05:42.349899+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349679+0000","last_became_peered":"2024-01-22T05:05:42.349679+0000","last_unstale":"2024-01-22T05:05:42.349899+0000","last_undegraded":"2024-01-22T05:05:42.349899+0000","last_fullsized":"2024-01-22T05:05:42.349899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324676+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.347988+0000","last_change":"2024-01-22T05:05:42.347988+0000","last_active":"2024-01-22T05:05:42.347988+0000","last_peered":"2024-01-22T05:05:42.347988+0000","last_clean":"2024-01-22T05:05:42.347988+0000","last_became_active":"2024-01-22T05:05:42.347693+0000","last_became_peered":"2024-01-22T05:05:42.347693+0000","last_unstale":"2024-01-22T05:05:42.347988+0000","last_undegraded":"2024-01-22T05:05:42.347988+0000","last_fullsized":"2024-01-22T05:05:42.347988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325321+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.323932+0000","last_change":"2024-01-22T05:05:42.324056+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.323932+0000","last_undegraded":"2024-01-22T05:05:42.323932+0000","last_fullsized":"2024-01-22T05:05:42.323932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.330033+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.338150+0000","last_change":"2024-01-22T05:05:42.338150+0000","last_active":"2024-01-22T05:05:42.338150+0000","last_peered":"2024-01-22T05:05:42.338150+0000","last_clean":"2024-01-22T05:05:42.338150+0000","last_became_active":"2024-01-22T05:05:42.337828+0000","last_became_peered":"2024-01-22T05:05:42.337828+0000","last_unstale":"2024-01-22T05:05:42.338150+0000","last_undegraded":"2024-01-22T05:05:42.338150+0000","last_fullsized":"2024-01-22T05:05:42.338150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318707+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.317908+0000","last_change":"2024-01-22T05:05:42.318067+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.317908+0000","last_undegraded":"2024-01-22T05:05:42.317908+0000","last_fullsized":"2024-01-22T05:05:42.317908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":["6","3"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.321114+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325385+0000","last_change":"2024-01-22T05:05:42.325514+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325385+0000","last_undegraded":"2024-01-22T05:05:42.325385+0000","last_fullsized":"2024-01-22T05:05:42.325385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329246+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.337984+0000","last_change":"2024-01-22T05:05:42.337984+0000","last_active":"2024-01-22T05:05:42.337984+0000","last_peered":"2024-01-22T05:05:42.337984+0000","last_clean":"2024-01-22T05:05:42.337984+0000","last_became_active":"2024-01-22T05:05:42.337050+0000","last_became_peered":"2024-01-22T05:05:42.337050+0000","last_unstale":"2024-01-22T05:05:42.337984+0000","last_undegraded":"2024-01-22T05:05:42.337984+0000","last_fullsized":"2024-01-22T05:05:42.337984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323301+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.342175+0000","last_change":"2024-01-22T05:05:42.342250+0000","last_active":"2024-01-22T05:05:42.342175+0000","last_peered":"2024-01-22T05:05:42.342175+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.341974+0000","last_became_peered":"2024-01-22T05:05:42.341974+0000","last_unstale":"2024-01-22T05:05:42.342175+0000","last_undegraded":"2024-01-22T05:05:42.342175+0000","last_fullsized":"2024-01-22T05:05:42.342175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.319539+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341030+0000","last_change":"2024-01-22T05:05:42.341030+0000","last_active":"2024-01-22T05:05:42.341030+0000","last_peered":"2024-01-22T05:05:42.341030+0000","last_clean":"2024-01-22T05:05:42.341030+0000","last_became_active":"2024-01-22T05:05:42.340774+0000","last_became_peered":"2024-01-22T05:05:42.340774+0000","last_unstale":"2024-01-22T05:05:42.341030+0000","last_undegraded":"2024-01-22T05:05:42.341030+0000","last_fullsized":"2024-01-22T05:05:42.341030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324162+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.350752+0000","last_change":"2024-01-22T05:05:42.350837+0000","last_active":"2024-01-22T05:05:42.350752+0000","last_peered":"2024-01-22T05:05:42.350752+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.350332+0000","last_became_peered":"2024-01-22T05:05:42.350332+0000","last_unstale":"2024-01-22T05:05:42.350752+0000","last_undegraded":"2024-01-22T05:05:42.350752+0000","last_fullsized":"2024-01-22T05:05:42.350752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323993+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349729+0000","last_change":"2024-01-22T05:05:42.349799+0000","last_active":"2024-01-22T05:05:42.349729+0000","last_peered":"2024-01-22T05:05:42.349729+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349522+0000","last_became_peered":"2024-01-22T05:05:42.349522+0000","last_unstale":"2024-01-22T05:05:42.349729+0000","last_undegraded":"2024-01-22T05:05:42.349729+0000","last_fullsized":"2024-01-22T05:05:42.349729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.329646+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349792+0000","last_change":"2024-01-22T05:05:42.349880+0000","last_active":"2024-01-22T05:05:42.349792+0000","last_peered":"2024-01-22T05:05:42.349792+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349346+0000","last_became_peered":"2024-01-22T05:05:42.349346+0000","last_unstale":"2024-01-22T05:05:42.349792+0000","last_undegraded":"2024-01-22T05:05:42.349792+0000","last_fullsized":"2024-01-22T05:05:42.349792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.325410+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348272+0000","last_change":"2024-01-22T05:05:42.348366+0000","last_active":"2024-01-22T05:05:42.348272+0000","last_peered":"2024-01-22T05:05:42.348272+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347668+0000","last_became_peered":"2024-01-22T05:05:42.347668+0000","last_unstale":"2024-01-22T05:05:42.348272+0000","last_undegraded":"2024-01-22T05:05:42.348272+0000","last_fullsized":"2024-01-22T05:05:42.348272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324600+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.345773+0000","last_change":"2024-01-22T05:05:42.345773+0000","last_active":"2024-01-22T05:05:42.345773+0000","last_peered":"2024-01-22T05:05:42.345773+0000","last_clean":"2024-01-22T05:05:42.345773+0000","last_became_active":"2024-01-22T05:05:42.345307+0000","last_became_peered":"2024-01-22T05:05:42.345307+0000","last_unstale":"2024-01-22T05:05:42.345773+0000","last_undegraded":"2024-01-22T05:05:42.345773+0000","last_fullsized":"2024-01-22T05:05:42.345773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.317581+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344392+0000","last_change":"2024-01-22T05:05:42.344465+0000","last_active":"2024-01-22T05:05:42.344392+0000","last_peered":"2024-01-22T05:05:42.344392+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.344171+0000","last_became_peered":"2024-01-22T05:05:42.344171+0000","last_unstale":"2024-01-22T05:05:42.344392+0000","last_undegraded":"2024-01-22T05:05:42.344392+0000","last_fullsized":"2024-01-22T05:05:42.344392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328235+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339764+0000","last_change":"2024-01-22T05:05:42.339764+0000","last_active":"2024-01-22T05:05:42.339764+0000","last_peered":"2024-01-22T05:05:42.339764+0000","last_clean":"2024-01-22T05:05:42.339764+0000","last_became_active":"2024-01-22T05:05:42.339442+0000","last_became_peered":"2024-01-22T05:05:42.339442+0000","last_unstale":"2024-01-22T05:05:42.339764+0000","last_undegraded":"2024-01-22T05:05:42.339764+0000","last_fullsized":"2024-01-22T05:05:42.339764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322637+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339443+0000","last_change":"2024-01-22T05:05:42.339443+0000","last_active":"2024-01-22T05:05:42.339443+0000","last_peered":"2024-01-22T05:05:42.339443+0000","last_clean":"2024-01-22T05:05:42.339443+0000","last_became_active":"2024-01-22T05:05:42.339151+0000","last_became_peered":"2024-01-22T05:05:42.339151+0000","last_unstale":"2024-01-22T05:05:42.339443+0000","last_undegraded":"2024-01-22T05:05:42.339443+0000","last_fullsized":"2024-01-22T05:05:42.339443+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.326457+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341590+0000","last_change":"2024-01-22T05:05:42.341590+0000","last_active":"2024-01-22T05:05:42.341590+0000","last_peered":"2024-01-22T05:05:42.341590+0000","last_clean":"2024-01-22T05:05:42.341590+0000","last_became_active":"2024-01-22T05:05:42.340992+0000","last_became_peered":"2024-01-22T05:05:42.340992+0000","last_unstale":"2024-01-22T05:05:42.341590+0000","last_undegraded":"2024-01-22T05:05:42.341590+0000","last_fullsized":"2024-01-22T05:05:42.341590+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324144+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339284+0000","last_change":"2024-01-22T05:05:42.339386+0000","last_active":"2024-01-22T05:05:42.339284+0000","last_peered":"2024-01-22T05:05:42.339284+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.338881+0000","last_became_peered":"2024-01-22T05:05:42.338881+0000","last_unstale":"2024-01-22T05:05:42.339284+0000","last_undegraded":"2024-01-22T05:05:42.339284+0000","last_fullsized":"2024-01-22T05:05:42.339284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.320038+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349596+0000","last_change":"2024-01-22T05:05:42.349679+0000","last_active":"2024-01-22T05:05:42.349596+0000","last_peered":"2024-01-22T05:05:42.349596+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349307+0000","last_became_peered":"2024-01-22T05:05:42.349307+0000","last_unstale":"2024-01-22T05:05:42.349596+0000","last_undegraded":"2024-01-22T05:05:42.349596+0000","last_fullsized":"2024-01-22T05:05:42.349596+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323402+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325798+0000","last_change":"2024-01-22T05:05:42.325929+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325798+0000","last_undegraded":"2024-01-22T05:05:42.325798+0000","last_fullsized":"2024-01-22T05:05:42.325798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.324883+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349870+0000","last_change":"2024-01-22T05:05:42.349941+0000","last_active":"2024-01-22T05:05:42.349870+0000","last_peered":"2024-01-22T05:05:42.349870+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349656+0000","last_became_peered":"2024-01-22T05:05:42.349656+0000","last_unstale":"2024-01-22T05:05:42.349870+0000","last_undegraded":"2024-01-22T05:05:42.349870+0000","last_fullsized":"2024-01-22T05:05:42.349870+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.322543+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.353557+0000","last_change":"2024-01-22T05:05:42.353644+0000","last_active":"2024-01-22T05:05:42.353557+0000","last_peered":"2024-01-22T05:05:42.353557+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.346934+0000","last_became_peered":"2024-01-22T05:05:42.346934+0000","last_unstale":"2024-01-22T05:05:42.353557+0000","last_undegraded":"2024-01-22T05:05:42.353557+0000","last_fullsized":"2024-01-22T05:05:42.353557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.320145+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.315287+0000","last_change":"2024-01-22T05:05:42.315427+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.315287+0000","last_undegraded":"2024-01-22T05:05:42.315287+0000","last_fullsized":"2024-01-22T05:05:42.315287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328633+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.347740+0000","last_change":"2024-01-22T05:05:42.347821+0000","last_active":"2024-01-22T05:05:42.347740+0000","last_peered":"2024-01-22T05:05:42.347740+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.347410+0000","last_became_peered":"2024-01-22T05:05:42.347410+0000","last_unstale":"2024-01-22T05:05:42.347740+0000","last_undegraded":"2024-01-22T05:05:42.347740+0000","last_fullsized":"2024-01-22T05:05:42.347740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.317245+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344802+0000","last_change":"2024-01-22T05:05:42.344802+0000","last_active":"2024-01-22T05:05:42.344802+0000","last_peered":"2024-01-22T05:05:42.344802+0000","last_clean":"2024-01-22T05:05:42.344802+0000","last_became_active":"2024-01-22T05:05:42.344442+0000","last_became_peered":"2024-01-22T05:05:42.344442+0000","last_unstale":"2024-01-22T05:05:42.344802+0000","last_undegraded":"2024-01-22T05:05:42.344802+0000","last_fullsized":"2024-01-22T05:05:42.344802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.317812+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341229+0000","last_change":"2024-01-22T05:05:42.347745+0000","last_active":"2024-01-22T05:05:42.341229+0000","last_peered":"2024-01-22T05:05:42.341229+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.341018+0000","last_became_peered":"2024-01-22T05:05:42.341018+0000","last_unstale":"2024-01-22T05:05:42.341229+0000","last_undegraded":"2024-01-22T05:05:42.341229+0000","last_fullsized":"2024-01-22T05:05:42.341229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.335130+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.349994+0000","last_change":"2024-01-22T05:05:42.350071+0000","last_active":"2024-01-22T05:05:42.349994+0000","last_peered":"2024-01-22T05:05:42.349994+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.349778+0000","last_became_peered":"2024-01-22T05:05:42.349778+0000","last_unstale":"2024-01-22T05:05:42.349994+0000","last_undegraded":"2024-01-22T05:05:42.349994+0000","last_fullsized":"2024-01-22T05:05:42.349994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.319758+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.338002+0000","last_change":"2024-01-22T05:05:42.338002+0000","last_active":"2024-01-22T05:05:42.338002+0000","last_peered":"2024-01-22T05:05:42.338002+0000","last_clean":"2024-01-22T05:05:42.338002+0000","last_became_active":"2024-01-22T05:05:42.337734+0000","last_became_peered":"2024-01-22T05:05:42.337734+0000","last_unstale":"2024-01-22T05:05:42.338002+0000","last_undegraded":"2024-01-22T05:05:42.338002+0000","last_fullsized":"2024-01-22T05:05:42.338002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318932+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344542+0000","last_change":"2024-01-22T05:05:42.344542+0000","last_active":"2024-01-22T05:05:42.344542+0000","last_peered":"2024-01-22T05:05:42.344542+0000","last_clean":"2024-01-22T05:05:42.344542+0000","last_became_active":"2024-01-22T05:05:42.342874+0000","last_became_peered":"2024-01-22T05:05:42.342874+0000","last_unstale":"2024-01-22T05:05:42.344542+0000","last_undegraded":"2024-01-22T05:05:42.344542+0000","last_fullsized":"2024-01-22T05:05:42.344542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.328176+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.325366+0000","last_change":"2024-01-22T05:05:42.326707+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.325366+0000","last_undegraded":"2024-01-22T05:05:42.325366+0000","last_fullsized":"2024-01-22T05:05:42.325366+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.334650+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.339234+0000","last_change":"2024-01-22T05:05:42.339234+0000","last_active":"2024-01-22T05:05:42.339234+0000","last_peered":"2024-01-22T05:05:42.339234+0000","last_clean":"2024-01-22T05:05:42.339234+0000","last_became_active":"2024-01-22T05:05:42.338850+0000","last_became_peered":"2024-01-22T05:05:42.338850+0000","last_unstale":"2024-01-22T05:05:42.339234+0000","last_undegraded":"2024-01-22T05:05:42.339234+0000","last_fullsized":"2024-01-22T05:05:42.339234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.315458+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:05:41.315458+0000","last_peered":"2024-01-22T05:05:41.315458+0000","last_clean":"2024-01-22T05:05:41.315458+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:05:41.315458+0000","last_undegraded":"2024-01-22T05:05:41.315458+0000","last_fullsized":"2024-01-22T05:05:41.315458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.330991+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.328769+0000","last_change":"2024-01-22T05:05:42.328933+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.328769+0000","last_undegraded":"2024-01-22T05:05:42.328769+0000","last_fullsized":"2024-01-22T05:05:42.328769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.317228+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:05:41.317228+0000","last_peered":"2024-01-22T05:05:41.317228+0000","last_clean":"2024-01-22T05:05:41.317228+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:05:41.317228+0000","last_undegraded":"2024-01-22T05:05:41.317228+0000","last_fullsized":"2024-01-22T05:05:41.317228+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.321560+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.337281+0000","last_change":"2024-01-22T05:05:42.337281+0000","last_active":"2024-01-22T05:05:42.337281+0000","last_peered":"2024-01-22T05:05:42.337281+0000","last_clean":"2024-01-22T05:05:42.337281+0000","last_became_active":"2024-01-22T05:05:42.336978+0000","last_became_peered":"2024-01-22T05:05:42.336978+0000","last_unstale":"2024-01-22T05:05:42.337281+0000","last_undegraded":"2024-01-22T05:05:42.337281+0000","last_fullsized":"2024-01-22T05:05:42.337281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.320588+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:05:41.320588+0000","last_peered":"2024-01-22T05:05:41.320588+0000","last_clean":"2024-01-22T05:05:41.320588+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:05:41.320588+0000","last_undegraded":"2024-01-22T05:05:41.320588+0000","last_fullsized":"2024-01-22T05:05:41.320588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.327801+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.356048+0000","last_change":"2024-01-22T05:05:42.356135+0000","last_active":"2024-01-22T05:05:42.356048+0000","last_peered":"2024-01-22T05:05:42.356048+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.354489+0000","last_became_peered":"2024-01-22T05:05:42.354489+0000","last_unstale":"2024-01-22T05:05:42.356048+0000","last_undegraded":"2024-01-22T05:05:42.356048+0000","last_fullsized":"2024-01-22T05:05:42.356048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.317248+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:05:41.317248+0000","last_peered":"2024-01-22T05:05:41.317248+0000","last_clean":"2024-01-22T05:05:41.317248+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:05:41.317248+0000","last_undegraded":"2024-01-22T05:05:41.317248+0000","last_fullsized":"2024-01-22T05:05:41.317248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.318834+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.348871+0000","last_change":"2024-01-22T05:05:42.348953+0000","last_active":"2024-01-22T05:05:42.348871+0000","last_peered":"2024-01-22T05:05:42.348871+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.348577+0000","last_became_peered":"2024-01-22T05:05:42.348577+0000","last_unstale":"2024-01-22T05:05:42.348871+0000","last_undegraded":"2024-01-22T05:05:42.348871+0000","last_fullsized":"2024-01-22T05:05:42.348871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.312204+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:05:41.312204+0000","last_peered":"2024-01-22T05:05:41.312204+0000","last_clean":"2024-01-22T05:05:41.312204+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:05:41.312204+0000","last_undegraded":"2024-01-22T05:05:41.312204+0000","last_fullsized":"2024-01-22T05:05:41.312204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323280+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.341704+0000","last_change":"2024-01-22T05:05:42.341704+0000","last_active":"2024-01-22T05:05:42.341704+0000","last_peered":"2024-01-22T05:05:42.341704+0000","last_clean":"2024-01-22T05:05:42.341704+0000","last_became_active":"2024-01-22T05:05:42.341329+0000","last_became_peered":"2024-01-22T05:05:42.341329+0000","last_unstale":"2024-01-22T05:05:42.341704+0000","last_undegraded":"2024-01-22T05:05:42.341704+0000","last_fullsized":"2024-01-22T05:05:42.341704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.310547+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:05:41.310547+0000","last_peered":"2024-01-22T05:05:41.310547+0000","last_clean":"2024-01-22T05:05:41.310547+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:05:41.310547+0000","last_undegraded":"2024-01-22T05:05:41.310547+0000","last_fullsized":"2024-01-22T05:05:41.310547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323610+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":7,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.344542+0000","last_change":"2024-01-22T05:05:42.344663+0000","last_active":"2024-01-22T05:05:42.344542+0000","last_peered":"2024-01-22T05:05:42.344542+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"2024-01-22T05:05:42.344347+0000","last_became_peered":"2024-01-22T05:05:42.344347+0000","last_unstale":"2024-01-22T05:05:42.344542+0000","last_undegraded":"2024-01-22T05:05:42.344542+0000","last_fullsized":"2024-01-22T05:05:42.344542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.319271+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:05:41.319271+0000","last_peered":"2024-01-22T05:05:41.319271+0000","last_clean":"2024-01-22T05:05:41.319271+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:05:41.319271+0000","last_undegraded":"2024-01-22T05:05:41.319271+0000","last_fullsized":"2024-01-22T05:05:41.319271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:05:42.302441+0000","last_change":"2024-01-22T05:05:42.323280+0000","last_active":"2024-01-22T05:05:42.302441+0000","last_peered":"2024-01-22T05:05:42.302441+0000","last_clean":"2024-01-22T05:05:42.302441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.302441+0000","last_undegraded":"2024-01-22T05:05:42.302441+0000","last_fullsized":"2024-01-22T05:05:42.302441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":2,"reported_epoch":38,"state":"creating+activating","last_fresh":"2024-01-22T05:05:42.323159+0000","last_change":"2024-01-22T05:05:42.323294+0000","last_active":"2024-01-22T05:05:41.291706+0000","last_peered":"2024-01-22T05:05:41.291706+0000","last_clean":"2024-01-22T05:05:41.291706+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:05:42.323159+0000","last_undegraded":"2024-01-22T05:05:42.323159+0000","last_fullsized":"2024-01-22T05:05:42.323159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.312237+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:05:41.312237+0000","last_peered":"2024-01-22T05:05:41.312237+0000","last_clean":"2024-01-22T05:05:41.312237+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:05:41.312237+0000","last_undegraded":"2024-01-22T05:05:41.312237+0000","last_fullsized":"2024-01-22T05:05:41.312237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-22T05:05:41.319384+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:05:41.319384+0000","last_peered":"2024-01-22T05:05:41.319384+0000","last_clean":"2024-01-22T05:05:41.319384+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:05:41.319384+0000","last_undegraded":"2024-01-22T05:05:41.319384+0000","last_fullsized":"2024-01-22T05:05:41.319384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.90500000000000003}]},{"osd":1,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.3029999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":1.0409999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.85699999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.143},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.343}]},{"osd":5,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.4259999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.381},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.5369999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.552},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.88500000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":4.1760000000000002,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.2010000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":0.94299999999999995}]},{"osd":4,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.462},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.4299999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.383}]},{"osd":7,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":3.2850000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":1.4890000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.079},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.96899999999999997}]},{"osd":1,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.204},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.2749999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.88500000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.3220000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.998},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.1120000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.2010000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.1759999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.248},{"interface":"front","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":3.1840000000000002,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.226}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.0049999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.1539999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.0649999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.196}]},{"osd":5,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.2549999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.369},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":3.085,"5min":3.085,"15min":3.085},"last":1.2769999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.5129999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.4219999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.78400000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.472},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.494}]},{"osd":4,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.161}]},{"osd":5,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.995}]},{"osd":6,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.355},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.3280000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.339},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.5189999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.86799999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.369}]},{"osd":3,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.91100000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.0840000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.222},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.3089999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.234},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.5109999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.302},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.571}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.91000000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.044}]},{"osd":3,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.002},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.97999999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.179}]},{"osd":5,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.153},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.4279999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.496}]},{"osd":7,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.474},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":1.5309999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":425984,"data_stored":189736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.746},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.2290000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.85599999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.7989999999999999,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.0700000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":5.1799999999999997,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.80800000000000005}]},{"osd":5,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":3.548,"5min":3.548,"15min":3.548},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.276}]},{"osd":6,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.1140000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":5.29,"5min":5.29,"15min":5.29},"last":1.169},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.97399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:05:51.843 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:05:52.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.007+0000 7f7800a00700 1 Processor -- start 2024-01-22T05:05:52.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.007+0000 7f7800a00700 1 -- start start 2024-01-22T05:05:52.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f7800a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f77f8065240 0x7f77f80644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f7800a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f815c7d0 con 0x7f77f8065620 2024-01-22T05:05:52.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f7800a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f80c2700 con 0x7f77f80649e0 2024-01-22T05:05:52.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f7800a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f80c29a0 con 0x7f77f8065240 2024-01-22T05:05:52.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f77fd600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f77f8065620 0x7f77f815b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51076/0 (socket says 172.21.15.49:51076) 2024-01-22T05:05:52.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f77fd600700 1 -- 172.21.15.49:0/673978930 learned_addr learned my addr 172.21.15.49:0/673978930 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:52.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f77fe000700 1 --2- 172.21.15.49:0/673978930 >> v2:172.21.15.110:3300/0 conn(0x7f77f8065240 0x7f77f80644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f77fcc00700 1 -- 172.21.15.49:0/673978930 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715423042 0 0) 0x7f77f815c7d0 con 0x7f77f8065620 2024-01-22T05:05:52.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f77fcc00700 1 -- 172.21.15.49:0/673978930 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77d80033f0 con 0x7f77f8065620 2024-01-22T05:05:52.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f77fcc00700 1 -- 172.21.15.49:0/673978930 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813225330 0 0) 0x7f77f80c2700 con 0x7f77f80649e0 2024-01-22T05:05:52.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f77fcc00700 1 -- 172.21.15.49:0/673978930 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f815c7d0 con 0x7f77f80649e0 2024-01-22T05:05:52.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f77fe000700 1 -- 172.21.15.49:0/673978930 >> v1:172.21.15.110:6789/0 conn(0x7f77f80649e0 legacy=0x7f77f815c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f77fe000700 1 -- 172.21.15.49:0/673978930 >> v1:172.21.15.49:6789/0 conn(0x7f77f8065620 legacy=0x7f77f815b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f77fcc00700 1 -- 172.21.15.49:0/673978930 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4077632224 0 0) 0x7f77d80033f0 con 0x7f77f8065620 2024-01-22T05:05:52.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f77fe000700 1 -- 172.21.15.49:0/673978930 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f80c2c80 con 0x7f77f8065240 2024-01-22T05:05:52.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.011+0000 7f77fe000700 1 --2- 172.21.15.49:0/673978930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77f8065240 0x7f77f80644f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f77e8009760 tx=0x7f77e8009060).ready entity=mon.1 client_cookie=62edb1bc3aaa4210 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:52.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.015+0000 7f77fcc00700 1 -- 172.21.15.49:0/673978930 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0001470 con 0x7f77f8065240 2024-01-22T05:05:52.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.015+0000 7f77fcc00700 1 -- 172.21.15.49:0/673978930 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e8011400 con 0x7f77f8065240 2024-01-22T05:05:52.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.015+0000 7f77fcc00700 1 -- 172.21.15.49:0/673978930 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8011780 con 0x7f77f8065240 2024-01-22T05:05:52.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.015+0000 7f7800a00700 1 -- 172.21.15.49:0/673978930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77f8065240 msgr2=0x7f77f80644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.015+0000 7f7800a00700 1 --2- 172.21.15.49:0/673978930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77f8065240 0x7f77f80644f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f77e8009760 tx=0x7f77e8009060).stop 2024-01-22T05:05:52.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.015+0000 7f7800a00700 1 -- 172.21.15.49:0/673978930 shutdown_connections 2024-01-22T05:05:52.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.015+0000 7f7800a00700 1 --2- 172.21.15.49:0/673978930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77f8065240 0x7f77f80644f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.015+0000 7f7800a00700 1 -- 172.21.15.49:0/673978930 >> 172.21.15.49:0/673978930 conn(0x7f77f80c87f0 msgr2=0x7f77f80c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:52.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.015+0000 7f7800a00700 1 -- 172.21.15.49:0/673978930 shutdown_connections 2024-01-22T05:05:52.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.015+0000 7f7800a00700 1 -- 172.21.15.49:0/673978930 wait complete. 2024-01-22T05:05:52.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.019+0000 7f7800a00700 1 Processor -- start 2024-01-22T05:05:52.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.019+0000 7f7800a00700 1 -- start start 2024-01-22T05:05:52.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.019+0000 7f7800a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77f80649e0 0x7f77f8159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.019+0000 7f7800a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77f8065240 0x7f77f8143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.019+0000 7f7800a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77f8065620 0x7f77f816c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.019+0000 7f7800a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80a88d0 con 0x7f77f8065620 2024-01-22T05:05:52.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.019+0000 7f7800a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80a7cc0 con 0x7f77f8065240 2024-01-22T05:05:52.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.019+0000 7f7800a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80a7fa0 con 0x7f77f80649e0 2024-01-22T05:05:52.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.019+0000 7f77ff400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77f8065620 0x7f77f816c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.019+0000 7f77fd600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77f8065240 0x7f77f8143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.019+0000 7f77fe000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77f80649e0 0x7f77f8159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.019+0000 7f77ff400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77f8065620 0x7f77f816c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53986/0 (socket says 172.21.15.49:53986) 2024-01-22T05:05:52.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.019+0000 7f77fd600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77f8065240 0x7f77f8143850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:40768/0 (socket says 172.21.15.49:40768) 2024-01-22T05:05:52.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.019+0000 7f77fe000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77f80649e0 0x7f77f8159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:44146/0 (socket says 172.21.15.49:44146) 2024-01-22T05:05:52.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.019+0000 7f77ff400700 1 -- 172.21.15.49:0/94710703 learned_addr learned my addr 172.21.15.49:0/94710703 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:52.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.023+0000 7f77fd600700 1 -- 172.21.15.49:0/94710703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77f80649e0 msgr2=0x7f77f8159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.023+0000 7f77fd600700 1 --2- 172.21.15.49:0/94710703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77f80649e0 0x7f77f8159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.023+0000 7f77fd600700 1 -- 172.21.15.49:0/94710703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77f8065620 msgr2=0x7f77f816c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.023+0000 7f77fd600700 1 --2- 172.21.15.49:0/94710703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77f8065620 0x7f77f816c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.023+0000 7f77fd600700 1 -- 172.21.15.49:0/94710703 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e80092a0 con 0x7f77f8065240 2024-01-22T05:05:52.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.023+0000 7f77fe000700 1 --2- 172.21.15.49:0/94710703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77f80649e0 0x7f77f8159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:52.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.023+0000 7f77fd600700 1 --2- 172.21.15.49:0/94710703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77f8065240 0x7f77f8143850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f77f8065a50 tx=0x7f77e0001980).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:52.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.023+0000 7f77f5600700 1 -- 172.21.15.49:0/94710703 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e00072e0 con 0x7f77f8065240 2024-01-22T05:05:52.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.023+0000 7f77f5600700 1 -- 172.21.15.49:0/94710703 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e0007460 con 0x7f77f8065240 2024-01-22T05:05:52.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.023+0000 7f7800a00700 1 -- 172.21.15.49:0/94710703 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f80a8280 con 0x7f77f8065240 2024-01-22T05:05:52.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.023+0000 7f77f5600700 1 -- 172.21.15.49:0/94710703 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e00059f0 con 0x7f77f8065240 2024-01-22T05:05:52.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.023+0000 7f7800a00700 1 -- 172.21.15.49:0/94710703 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f80aa030 con 0x7f77f8065240 2024-01-22T05:05:52.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.023+0000 7f7800a00700 1 -- 172.21.15.49:0/94710703 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f8047060 con 0x7f77f8065240 2024-01-22T05:05:52.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.023+0000 7f77f5600700 1 -- 172.21.15.49:0/94710703 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f77e0013450 con 0x7f77f8065240 2024-01-22T05:05:52.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.027+0000 7f77f5600700 1 --2- 172.21.15.49:0/94710703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f77d005a510 0x7f77d005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.027+0000 7f77f5600700 1 -- 172.21.15.49:0/94710703 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f77e0074150 con 0x7f77f8065240 2024-01-22T05:05:52.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.027+0000 7f77fe000700 1 --2- 172.21.15.49:0/94710703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f77d005a510 0x7f77d005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.027+0000 7f77fe000700 1 --2- 172.21.15.49:0/94710703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f77d005a510 0x7f77d005c9d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f77e8011fd0 tx=0x7f77e8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:52.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.035+0000 7f77f5600700 1 -- 172.21.15.49:0/94710703 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f77e00476b0 con 0x7f77f8065240 2024-01-22T05:05:52.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.207+0000 7f7800a00700 1 -- 172.21.15.49:0/94710703 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77f80c2f60 con 0x7f77d005a510 2024-01-22T05:05:52.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.227+0000 7f77f5600700 1 -- 172.21.15.49:0/94710703 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358345 (secure 0 0 0) 0x7f77f80c2f60 con 0x7f77d005a510 2024-01-22T05:05:52.235 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:52.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.231+0000 7f7800a00700 1 -- 172.21.15.49:0/94710703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f77d005a510 msgr2=0x7f77d005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.231+0000 7f7800a00700 1 --2- 172.21.15.49:0/94710703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f77d005a510 0x7f77d005c9d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f77e8011fd0 tx=0x7f77e8016000).stop 2024-01-22T05:05:52.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.231+0000 7f7800a00700 1 -- 172.21.15.49:0/94710703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77f8065240 msgr2=0x7f77f8143850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.231+0000 7f7800a00700 1 --2- 172.21.15.49:0/94710703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77f8065240 0x7f77f8143850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f77f8065a50 tx=0x7f77e0001980).stop 2024-01-22T05:05:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.231+0000 7f7800a00700 1 -- 172.21.15.49:0/94710703 shutdown_connections 2024-01-22T05:05:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.231+0000 7f7800a00700 1 --2- 172.21.15.49:0/94710703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f77d005a510 0x7f77d005c9d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.231+0000 7f7800a00700 1 --2- 172.21.15.49:0/94710703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77f8065620 0x7f77f816c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.231+0000 7f7800a00700 1 --2- 172.21.15.49:0/94710703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77f8065240 0x7f77f8143850 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.231+0000 7f7800a00700 1 --2- 172.21.15.49:0/94710703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77f80649e0 0x7f77f8159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.231+0000 7f7800a00700 1 -- 172.21.15.49:0/94710703 >> 172.21.15.49:0/94710703 conn(0x7f77f80c87f0 msgr2=0x7f77f80ad650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.231+0000 7f7800a00700 1 -- 172.21.15.49:0/94710703 shutdown_connections 2024-01-22T05:05:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.231+0000 7f7800a00700 1 -- 172.21.15.49:0/94710703 wait complete. 2024-01-22T05:05:52.241 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:05:52.258 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-01-22T05:05:51.250992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2380448,"kb_used_data":3680,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594272,"statfs":{"total":773094113280,"available":770656534528,"internally_reserved":0,"allocated":3768320,"data_stored":1695468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5501,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-53,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.993826"},"pg_stats":[{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.799237+0000","last_change":"2024-01-22T05:05:42.797656+0000","last_active":"2024-01-22T05:05:42.799237+0000","last_peered":"2024-01-22T05:05:42.799237+0000","last_clean":"2024-01-22T05:05:42.799237+0000","last_became_active":"2024-01-22T05:05:42.797384+0000","last_became_peered":"2024-01-22T05:05:42.797384+0000","last_unstale":"2024-01-22T05:05:42.799237+0000","last_undegraded":"2024-01-22T05:05:42.799237+0000","last_fullsized":"2024-01-22T05:05:42.799237+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"39'3","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.803712+0000","last_change":"2024-01-22T05:05:42.348729+0000","last_active":"2024-01-22T05:05:42.803712+0000","last_peered":"2024-01-22T05:05:42.803712+0000","last_clean":"2024-01-22T05:05:42.803712+0000","last_became_active":"2024-01-22T05:05:42.348416+0000","last_became_peered":"2024-01-22T05:05:42.348416+0000","last_unstale":"2024-01-22T05:05:42.803712+0000","last_undegraded":"2024-01-22T05:05:42.803712+0000","last_fullsized":"2024-01-22T05:05:42.803712+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.790806+0000","last_change":"2024-01-22T05:05:42.787015+0000","last_active":"2024-01-22T05:05:42.790806+0000","last_peered":"2024-01-22T05:05:42.790806+0000","last_clean":"2024-01-22T05:05:42.790806+0000","last_became_active":"2024-01-22T05:05:42.786611+0000","last_became_peered":"2024-01-22T05:05:42.786611+0000","last_unstale":"2024-01-22T05:05:42.790806+0000","last_undegraded":"2024-01-22T05:05:42.790806+0000","last_fullsized":"2024-01-22T05:05:42.790806+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.761909+0000","last_change":"2024-01-22T05:05:42.360191+0000","last_active":"2024-01-22T05:05:42.761909+0000","last_peered":"2024-01-22T05:05:42.761909+0000","last_clean":"2024-01-22T05:05:42.761909+0000","last_became_active":"2024-01-22T05:05:42.359899+0000","last_became_peered":"2024-01-22T05:05:42.359899+0000","last_unstale":"2024-01-22T05:05:42.761909+0000","last_undegraded":"2024-01-22T05:05:42.761909+0000","last_fullsized":"2024-01-22T05:05:42.761909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.803890+0000","last_change":"2024-01-22T05:05:42.786003+0000","last_active":"2024-01-22T05:05:42.803890+0000","last_peered":"2024-01-22T05:05:42.803890+0000","last_clean":"2024-01-22T05:05:42.803890+0000","last_became_active":"2024-01-22T05:05:42.785718+0000","last_became_peered":"2024-01-22T05:05:42.785718+0000","last_unstale":"2024-01-22T05:05:42.803890+0000","last_undegraded":"2024-01-22T05:05:42.803890+0000","last_fullsized":"2024-01-22T05:05:42.803890+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.773595+0000","last_change":"2024-01-22T05:05:42.354261+0000","last_active":"2024-01-22T05:05:42.773595+0000","last_peered":"2024-01-22T05:05:42.773595+0000","last_clean":"2024-01-22T05:05:42.773595+0000","last_became_active":"2024-01-22T05:05:42.347227+0000","last_became_peered":"2024-01-22T05:05:42.347227+0000","last_unstale":"2024-01-22T05:05:42.773595+0000","last_undegraded":"2024-01-22T05:05:42.773595+0000","last_fullsized":"2024-01-22T05:05:42.773595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.780585+0000","last_change":"2024-01-22T05:05:42.774357+0000","last_active":"2024-01-22T05:05:42.780585+0000","last_peered":"2024-01-22T05:05:42.780585+0000","last_clean":"2024-01-22T05:05:42.780585+0000","last_became_active":"2024-01-22T05:05:42.774041+0000","last_became_peered":"2024-01-22T05:05:42.774041+0000","last_unstale":"2024-01-22T05:05:42.780585+0000","last_undegraded":"2024-01-22T05:05:42.780585+0000","last_fullsized":"2024-01-22T05:05:42.780585+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.795679+0000","last_change":"2024-01-22T05:05:42.352828+0000","last_active":"2024-01-22T05:05:42.795679+0000","last_peered":"2024-01-22T05:05:42.795679+0000","last_clean":"2024-01-22T05:05:42.795679+0000","last_became_active":"2024-01-22T05:05:42.352484+0000","last_became_peered":"2024-01-22T05:05:42.352484+0000","last_unstale":"2024-01-22T05:05:42.795679+0000","last_undegraded":"2024-01-22T05:05:42.795679+0000","last_fullsized":"2024-01-22T05:05:42.795679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.783372+0000","last_change":"2024-01-22T05:05:42.779637+0000","last_active":"2024-01-22T05:05:42.783372+0000","last_peered":"2024-01-22T05:05:42.783372+0000","last_clean":"2024-01-22T05:05:42.783372+0000","last_became_active":"2024-01-22T05:05:42.779376+0000","last_became_peered":"2024-01-22T05:05:42.779376+0000","last_unstale":"2024-01-22T05:05:42.783372+0000","last_undegraded":"2024-01-22T05:05:42.783372+0000","last_fullsized":"2024-01-22T05:05:42.783372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3b","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.794173+0000","last_change":"2024-01-22T05:05:42.338151+0000","last_active":"2024-01-22T05:05:42.794173+0000","last_peered":"2024-01-22T05:05:42.794173+0000","last_clean":"2024-01-22T05:05:42.794173+0000","last_became_active":"2024-01-22T05:05:42.337821+0000","last_became_peered":"2024-01-22T05:05:42.337821+0000","last_unstale":"2024-01-22T05:05:42.794173+0000","last_undegraded":"2024-01-22T05:05:42.794173+0000","last_fullsized":"2024-01-22T05:05:42.794173+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.791372+0000","last_change":"2024-01-22T05:05:42.776215+0000","last_active":"2024-01-22T05:05:42.791372+0000","last_peered":"2024-01-22T05:05:42.791372+0000","last_clean":"2024-01-22T05:05:42.791372+0000","last_became_active":"2024-01-22T05:05:42.775331+0000","last_became_peered":"2024-01-22T05:05:42.775331+0000","last_unstale":"2024-01-22T05:05:42.791372+0000","last_undegraded":"2024-01-22T05:05:42.791372+0000","last_fullsized":"2024-01-22T05:05:42.791372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3a","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.793272+0000","last_change":"2024-01-22T05:05:42.354843+0000","last_active":"2024-01-22T05:05:42.793272+0000","last_peered":"2024-01-22T05:05:42.793272+0000","last_clean":"2024-01-22T05:05:42.793272+0000","last_became_active":"2024-01-22T05:05:42.354589+0000","last_became_peered":"2024-01-22T05:05:42.354589+0000","last_unstale":"2024-01-22T05:05:42.793272+0000","last_undegraded":"2024-01-22T05:05:42.793272+0000","last_fullsized":"2024-01-22T05:05:42.793272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.803945+0000","last_change":"2024-01-22T05:05:42.788819+0000","last_active":"2024-01-22T05:05:42.803945+0000","last_peered":"2024-01-22T05:05:42.803945+0000","last_clean":"2024-01-22T05:05:42.803945+0000","last_became_active":"2024-01-22T05:05:42.788554+0000","last_became_peered":"2024-01-22T05:05:42.788554+0000","last_unstale":"2024-01-22T05:05:42.803945+0000","last_undegraded":"2024-01-22T05:05:42.803945+0000","last_fullsized":"2024-01-22T05:05:42.803945+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.762993+0000","last_change":"2024-01-22T05:05:42.341452+0000","last_active":"2024-01-22T05:05:42.762993+0000","last_peered":"2024-01-22T05:05:42.762993+0000","last_clean":"2024-01-22T05:05:42.762993+0000","last_became_active":"2024-01-22T05:05:42.338600+0000","last_became_peered":"2024-01-22T05:05:42.338600+0000","last_unstale":"2024-01-22T05:05:42.762993+0000","last_undegraded":"2024-01-22T05:05:42.762993+0000","last_fullsized":"2024-01-22T05:05:42.762993+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.792225+0000","last_change":"2024-01-22T05:05:42.790145+0000","last_active":"2024-01-22T05:05:42.792225+0000","last_peered":"2024-01-22T05:05:42.792225+0000","last_clean":"2024-01-22T05:05:42.792225+0000","last_became_active":"2024-01-22T05:05:42.789667+0000","last_became_peered":"2024-01-22T05:05:42.789667+0000","last_unstale":"2024-01-22T05:05:42.792225+0000","last_undegraded":"2024-01-22T05:05:42.792225+0000","last_fullsized":"2024-01-22T05:05:42.792225+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.762274+0000","last_change":"2024-01-22T05:05:42.346397+0000","last_active":"2024-01-22T05:05:42.762274+0000","last_peered":"2024-01-22T05:05:42.762274+0000","last_clean":"2024-01-22T05:05:42.762274+0000","last_became_active":"2024-01-22T05:05:42.346085+0000","last_became_peered":"2024-01-22T05:05:42.346085+0000","last_unstale":"2024-01-22T05:05:42.762274+0000","last_undegraded":"2024-01-22T05:05:42.762274+0000","last_fullsized":"2024-01-22T05:05:42.762274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.804297+0000","last_change":"2024-01-22T05:05:42.789615+0000","last_active":"2024-01-22T05:05:42.804297+0000","last_peered":"2024-01-22T05:05:42.804297+0000","last_clean":"2024-01-22T05:05:42.804297+0000","last_became_active":"2024-01-22T05:05:42.788959+0000","last_became_peered":"2024-01-22T05:05:42.788959+0000","last_unstale":"2024-01-22T05:05:42.804297+0000","last_undegraded":"2024-01-22T05:05:42.804297+0000","last_fullsized":"2024-01-22T05:05:42.804297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.780085+0000","last_change":"2024-01-22T05:05:42.352458+0000","last_active":"2024-01-22T05:05:42.780085+0000","last_peered":"2024-01-22T05:05:42.780085+0000","last_clean":"2024-01-22T05:05:42.780085+0000","last_became_active":"2024-01-22T05:05:42.352103+0000","last_became_peered":"2024-01-22T05:05:42.352103+0000","last_unstale":"2024-01-22T05:05:42.780085+0000","last_undegraded":"2024-01-22T05:05:42.780085+0000","last_fullsized":"2024-01-22T05:05:42.780085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.804449+0000","last_change":"2024-01-22T05:05:42.800138+0000","last_active":"2024-01-22T05:05:42.804449+0000","last_peered":"2024-01-22T05:05:42.804449+0000","last_clean":"2024-01-22T05:05:42.804449+0000","last_became_active":"2024-01-22T05:05:42.799680+0000","last_became_peered":"2024-01-22T05:05:42.799680+0000","last_unstale":"2024-01-22T05:05:42.804449+0000","last_undegraded":"2024-01-22T05:05:42.804449+0000","last_fullsized":"2024-01-22T05:05:42.804449+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.764391+0000","last_change":"2024-01-22T05:05:42.342554+0000","last_active":"2024-01-22T05:05:42.764391+0000","last_peered":"2024-01-22T05:05:42.764391+0000","last_clean":"2024-01-22T05:05:42.764391+0000","last_became_active":"2024-01-22T05:05:42.342223+0000","last_became_peered":"2024-01-22T05:05:42.342223+0000","last_unstale":"2024-01-22T05:05:42.764391+0000","last_undegraded":"2024-01-22T05:05:42.764391+0000","last_fullsized":"2024-01-22T05:05:42.764391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.798433+0000","last_change":"2024-01-22T05:05:42.796140+0000","last_active":"2024-01-22T05:05:42.798433+0000","last_peered":"2024-01-22T05:05:42.798433+0000","last_clean":"2024-01-22T05:05:42.798433+0000","last_became_active":"2024-01-22T05:05:42.795856+0000","last_became_peered":"2024-01-22T05:05:42.795856+0000","last_unstale":"2024-01-22T05:05:42.798433+0000","last_undegraded":"2024-01-22T05:05:42.798433+0000","last_fullsized":"2024-01-22T05:05:42.798433+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.764199+0000","last_change":"2024-01-22T05:05:42.350418+0000","last_active":"2024-01-22T05:05:42.764199+0000","last_peered":"2024-01-22T05:05:42.764199+0000","last_clean":"2024-01-22T05:05:42.764199+0000","last_became_active":"2024-01-22T05:05:42.348672+0000","last_became_peered":"2024-01-22T05:05:42.348672+0000","last_unstale":"2024-01-22T05:05:42.764199+0000","last_undegraded":"2024-01-22T05:05:42.764199+0000","last_fullsized":"2024-01-22T05:05:42.764199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.803985+0000","last_change":"2024-01-22T05:05:42.788541+0000","last_active":"2024-01-22T05:05:42.803985+0000","last_peered":"2024-01-22T05:05:42.803985+0000","last_clean":"2024-01-22T05:05:42.803985+0000","last_became_active":"2024-01-22T05:05:42.788227+0000","last_became_peered":"2024-01-22T05:05:42.788227+0000","last_unstale":"2024-01-22T05:05:42.803985+0000","last_undegraded":"2024-01-22T05:05:42.803985+0000","last_fullsized":"2024-01-22T05:05:42.803985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"39'4","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.806350+0000","last_change":"2024-01-22T05:05:42.342458+0000","last_active":"2024-01-22T05:05:42.806350+0000","last_peered":"2024-01-22T05:05:42.806350+0000","last_clean":"2024-01-22T05:05:42.806350+0000","last_became_active":"2024-01-22T05:05:42.341925+0000","last_became_peered":"2024-01-22T05:05:42.341925+0000","last_unstale":"2024-01-22T05:05:42.806350+0000","last_undegraded":"2024-01-22T05:05:42.806350+0000","last_fullsized":"2024-01-22T05:05:42.806350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.802830+0000","last_change":"2024-01-22T05:05:42.784373+0000","last_active":"2024-01-22T05:05:42.802830+0000","last_peered":"2024-01-22T05:05:42.802830+0000","last_clean":"2024-01-22T05:05:42.802830+0000","last_became_active":"2024-01-22T05:05:42.784077+0000","last_became_peered":"2024-01-22T05:05:42.784077+0000","last_unstale":"2024-01-22T05:05:42.802830+0000","last_undegraded":"2024-01-22T05:05:42.802830+0000","last_fullsized":"2024-01-22T05:05:42.802830+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.791586+0000","last_change":"2024-01-22T05:05:42.342444+0000","last_active":"2024-01-22T05:05:42.791586+0000","last_peered":"2024-01-22T05:05:42.791586+0000","last_clean":"2024-01-22T05:05:42.791586+0000","last_became_active":"2024-01-22T05:05:42.342153+0000","last_became_peered":"2024-01-22T05:05:42.342153+0000","last_unstale":"2024-01-22T05:05:42.791586+0000","last_undegraded":"2024-01-22T05:05:42.791586+0000","last_fullsized":"2024-01-22T05:05:42.791586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.794310+0000","last_change":"2024-01-22T05:05:42.785680+0000","last_active":"2024-01-22T05:05:42.794310+0000","last_peered":"2024-01-22T05:05:42.794310+0000","last_clean":"2024-01-22T05:05:42.794310+0000","last_became_active":"2024-01-22T05:05:42.785379+0000","last_became_peered":"2024-01-22T05:05:42.785379+0000","last_unstale":"2024-01-22T05:05:42.794310+0000","last_undegraded":"2024-01-22T05:05:42.794310+0000","last_fullsized":"2024-01-22T05:05:42.794310+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.760614+0000","last_change":"2024-01-22T05:05:42.348591+0000","last_active":"2024-01-22T05:05:42.760614+0000","last_peered":"2024-01-22T05:05:42.760614+0000","last_clean":"2024-01-22T05:05:42.760614+0000","last_became_active":"2024-01-22T05:05:42.348005+0000","last_became_peered":"2024-01-22T05:05:42.348005+0000","last_unstale":"2024-01-22T05:05:42.760614+0000","last_undegraded":"2024-01-22T05:05:42.760614+0000","last_fullsized":"2024-01-22T05:05:42.760614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.799461+0000","last_change":"2024-01-22T05:05:42.797843+0000","last_active":"2024-01-22T05:05:42.799461+0000","last_peered":"2024-01-22T05:05:42.799461+0000","last_clean":"2024-01-22T05:05:42.799461+0000","last_became_active":"2024-01-22T05:05:42.797443+0000","last_became_peered":"2024-01-22T05:05:42.797443+0000","last_unstale":"2024-01-22T05:05:42.799461+0000","last_undegraded":"2024-01-22T05:05:42.799461+0000","last_fullsized":"2024-01-22T05:05:42.799461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.763120+0000","last_change":"2024-01-22T05:05:42.345568+0000","last_active":"2024-01-22T05:05:42.763120+0000","last_peered":"2024-01-22T05:05:42.763120+0000","last_clean":"2024-01-22T05:05:42.763120+0000","last_became_active":"2024-01-22T05:05:42.344946+0000","last_became_peered":"2024-01-22T05:05:42.344946+0000","last_unstale":"2024-01-22T05:05:42.763120+0000","last_undegraded":"2024-01-22T05:05:42.763120+0000","last_fullsized":"2024-01-22T05:05:42.763120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.781606+0000","last_change":"2024-01-22T05:05:42.771153+0000","last_active":"2024-01-22T05:05:42.781606+0000","last_peered":"2024-01-22T05:05:42.781606+0000","last_clean":"2024-01-22T05:05:42.781606+0000","last_became_active":"2024-01-22T05:05:42.769520+0000","last_became_peered":"2024-01-22T05:05:42.769520+0000","last_unstale":"2024-01-22T05:05:42.781606+0000","last_undegraded":"2024-01-22T05:05:42.781606+0000","last_fullsized":"2024-01-22T05:05:42.781606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"39'4","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.792172+0000","last_change":"2024-01-22T05:05:42.349106+0000","last_active":"2024-01-22T05:05:42.792172+0000","last_peered":"2024-01-22T05:05:42.792172+0000","last_clean":"2024-01-22T05:05:42.792172+0000","last_became_active":"2024-01-22T05:05:42.348826+0000","last_became_peered":"2024-01-22T05:05:42.348826+0000","last_unstale":"2024-01-22T05:05:42.792172+0000","last_undegraded":"2024-01-22T05:05:42.792172+0000","last_fullsized":"2024-01-22T05:05:42.792172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.789241+0000","last_change":"2024-01-22T05:05:42.781972+0000","last_active":"2024-01-22T05:05:42.789241+0000","last_peered":"2024-01-22T05:05:42.789241+0000","last_clean":"2024-01-22T05:05:42.789241+0000","last_became_active":"2024-01-22T05:05:42.781476+0000","last_became_peered":"2024-01-22T05:05:42.781476+0000","last_unstale":"2024-01-22T05:05:42.789241+0000","last_undegraded":"2024-01-22T05:05:42.789241+0000","last_fullsized":"2024-01-22T05:05:42.789241+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.775728+0000","last_change":"2024-01-22T05:05:42.354389+0000","last_active":"2024-01-22T05:05:42.775728+0000","last_peered":"2024-01-22T05:05:42.775728+0000","last_clean":"2024-01-22T05:05:42.775728+0000","last_became_active":"2024-01-22T05:05:42.354150+0000","last_became_peered":"2024-01-22T05:05:42.354150+0000","last_unstale":"2024-01-22T05:05:42.775728+0000","last_undegraded":"2024-01-22T05:05:42.775728+0000","last_fullsized":"2024-01-22T05:05:42.775728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.772159+0000","last_change":"2024-01-22T05:05:42.767136+0000","last_active":"2024-01-22T05:05:42.772159+0000","last_peered":"2024-01-22T05:05:42.772159+0000","last_clean":"2024-01-22T05:05:42.772159+0000","last_became_active":"2024-01-22T05:05:42.766837+0000","last_became_peered":"2024-01-22T05:05:42.766837+0000","last_unstale":"2024-01-22T05:05:42.772159+0000","last_undegraded":"2024-01-22T05:05:42.772159+0000","last_fullsized":"2024-01-22T05:05:42.772159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.769834+0000","last_change":"2024-01-22T05:05:42.350366+0000","last_active":"2024-01-22T05:05:42.769834+0000","last_peered":"2024-01-22T05:05:42.769834+0000","last_clean":"2024-01-22T05:05:42.769834+0000","last_became_active":"2024-01-22T05:05:42.348991+0000","last_became_peered":"2024-01-22T05:05:42.348991+0000","last_unstale":"2024-01-22T05:05:42.769834+0000","last_undegraded":"2024-01-22T05:05:42.769834+0000","last_fullsized":"2024-01-22T05:05:42.769834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.805678+0000","last_change":"2024-01-22T05:05:42.803169+0000","last_active":"2024-01-22T05:05:42.805678+0000","last_peered":"2024-01-22T05:05:42.805678+0000","last_clean":"2024-01-22T05:05:42.805678+0000","last_became_active":"2024-01-22T05:05:42.802881+0000","last_became_peered":"2024-01-22T05:05:42.802881+0000","last_unstale":"2024-01-22T05:05:42.805678+0000","last_undegraded":"2024-01-22T05:05:42.805678+0000","last_fullsized":"2024-01-22T05:05:42.805678+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2d","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.801090+0000","last_change":"2024-01-22T05:05:42.342877+0000","last_active":"2024-01-22T05:05:42.801090+0000","last_peered":"2024-01-22T05:05:42.801090+0000","last_clean":"2024-01-22T05:05:42.801090+0000","last_became_active":"2024-01-22T05:05:42.342414+0000","last_became_peered":"2024-01-22T05:05:42.342414+0000","last_unstale":"2024-01-22T05:05:42.801090+0000","last_undegraded":"2024-01-22T05:05:42.801090+0000","last_fullsized":"2024-01-22T05:05:42.801090+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.800197+0000","last_change":"2024-01-22T05:05:42.799338+0000","last_active":"2024-01-22T05:05:42.800197+0000","last_peered":"2024-01-22T05:05:42.800197+0000","last_clean":"2024-01-22T05:05:42.800197+0000","last_became_active":"2024-01-22T05:05:42.797600+0000","last_became_peered":"2024-01-22T05:05:42.797600+0000","last_unstale":"2024-01-22T05:05:42.800197+0000","last_undegraded":"2024-01-22T05:05:42.800197+0000","last_fullsized":"2024-01-22T05:05:42.800197+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.770380+0000","last_change":"2024-01-22T05:05:42.341779+0000","last_active":"2024-01-22T05:05:42.770380+0000","last_peered":"2024-01-22T05:05:42.770380+0000","last_clean":"2024-01-22T05:05:42.770380+0000","last_became_active":"2024-01-22T05:05:42.341427+0000","last_became_peered":"2024-01-22T05:05:42.341427+0000","last_unstale":"2024-01-22T05:05:42.770380+0000","last_undegraded":"2024-01-22T05:05:42.770380+0000","last_fullsized":"2024-01-22T05:05:42.770380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.803505+0000","last_change":"2024-01-22T05:05:42.784945+0000","last_active":"2024-01-22T05:05:42.803505+0000","last_peered":"2024-01-22T05:05:42.803505+0000","last_clean":"2024-01-22T05:05:42.803505+0000","last_became_active":"2024-01-22T05:05:42.784659+0000","last_became_peered":"2024-01-22T05:05:42.784659+0000","last_unstale":"2024-01-22T05:05:42.803505+0000","last_undegraded":"2024-01-22T05:05:42.803505+0000","last_fullsized":"2024-01-22T05:05:42.803505+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.800502+0000","last_change":"2024-01-22T05:05:42.344902+0000","last_active":"2024-01-22T05:05:42.800502+0000","last_peered":"2024-01-22T05:05:42.800502+0000","last_clean":"2024-01-22T05:05:42.800502+0000","last_became_active":"2024-01-22T05:05:42.344587+0000","last_became_peered":"2024-01-22T05:05:42.344587+0000","last_unstale":"2024-01-22T05:05:42.800502+0000","last_undegraded":"2024-01-22T05:05:42.800502+0000","last_fullsized":"2024-01-22T05:05:42.800502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.785069+0000","last_change":"2024-01-22T05:05:42.781509+0000","last_active":"2024-01-22T05:05:42.785069+0000","last_peered":"2024-01-22T05:05:42.785069+0000","last_clean":"2024-01-22T05:05:42.785069+0000","last_became_active":"2024-01-22T05:05:42.778865+0000","last_became_peered":"2024-01-22T05:05:42.778865+0000","last_unstale":"2024-01-22T05:05:42.785069+0000","last_undegraded":"2024-01-22T05:05:42.785069+0000","last_fullsized":"2024-01-22T05:05:42.785069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.760631+0000","last_change":"2024-01-22T05:05:42.355295+0000","last_active":"2024-01-22T05:05:42.760631+0000","last_peered":"2024-01-22T05:05:42.760631+0000","last_clean":"2024-01-22T05:05:42.760631+0000","last_became_active":"2024-01-22T05:05:42.353598+0000","last_became_peered":"2024-01-22T05:05:42.353598+0000","last_unstale":"2024-01-22T05:05:42.760631+0000","last_undegraded":"2024-01-22T05:05:42.760631+0000","last_fullsized":"2024-01-22T05:05:42.760631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.785001+0000","last_change":"2024-01-22T05:05:42.779709+0000","last_active":"2024-01-22T05:05:42.785001+0000","last_peered":"2024-01-22T05:05:42.785001+0000","last_clean":"2024-01-22T05:05:42.785001+0000","last_became_active":"2024-01-22T05:05:42.779429+0000","last_became_peered":"2024-01-22T05:05:42.779429+0000","last_unstale":"2024-01-22T05:05:42.785001+0000","last_undegraded":"2024-01-22T05:05:42.785001+0000","last_fullsized":"2024-01-22T05:05:42.785001+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.775029+0000","last_change":"2024-01-22T05:05:42.360732+0000","last_active":"2024-01-22T05:05:42.775029+0000","last_peered":"2024-01-22T05:05:42.775029+0000","last_clean":"2024-01-22T05:05:42.775029+0000","last_became_active":"2024-01-22T05:05:42.360483+0000","last_became_peered":"2024-01-22T05:05:42.360483+0000","last_unstale":"2024-01-22T05:05:42.775029+0000","last_undegraded":"2024-01-22T05:05:42.775029+0000","last_fullsized":"2024-01-22T05:05:42.775029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.784790+0000","last_change":"2024-01-22T05:05:42.779341+0000","last_active":"2024-01-22T05:05:42.784790+0000","last_peered":"2024-01-22T05:05:42.784790+0000","last_clean":"2024-01-22T05:05:42.784790+0000","last_became_active":"2024-01-22T05:05:42.778673+0000","last_became_peered":"2024-01-22T05:05:42.778673+0000","last_unstale":"2024-01-22T05:05:42.784790+0000","last_undegraded":"2024-01-22T05:05:42.784790+0000","last_fullsized":"2024-01-22T05:05:42.784790+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.763759+0000","last_change":"2024-01-22T05:05:42.347615+0000","last_active":"2024-01-22T05:05:42.763759+0000","last_peered":"2024-01-22T05:05:42.763759+0000","last_clean":"2024-01-22T05:05:42.763759+0000","last_became_active":"2024-01-22T05:05:42.347347+0000","last_became_peered":"2024-01-22T05:05:42.347347+0000","last_unstale":"2024-01-22T05:05:42.763759+0000","last_undegraded":"2024-01-22T05:05:42.763759+0000","last_fullsized":"2024-01-22T05:05:42.763759+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.794333+0000","last_change":"2024-01-22T05:05:42.785747+0000","last_active":"2024-01-22T05:05:42.794333+0000","last_peered":"2024-01-22T05:05:42.794333+0000","last_clean":"2024-01-22T05:05:42.794333+0000","last_became_active":"2024-01-22T05:05:42.785451+0000","last_became_peered":"2024-01-22T05:05:42.785451+0000","last_unstale":"2024-01-22T05:05:42.794333+0000","last_undegraded":"2024-01-22T05:05:42.794333+0000","last_fullsized":"2024-01-22T05:05:42.794333+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.772547+0000","last_change":"2024-01-22T05:05:42.342693+0000","last_active":"2024-01-22T05:05:42.772547+0000","last_peered":"2024-01-22T05:05:42.772547+0000","last_clean":"2024-01-22T05:05:42.772547+0000","last_became_active":"2024-01-22T05:05:42.342424+0000","last_became_peered":"2024-01-22T05:05:42.342424+0000","last_unstale":"2024-01-22T05:05:42.772547+0000","last_undegraded":"2024-01-22T05:05:42.772547+0000","last_fullsized":"2024-01-22T05:05:42.772547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.798508+0000","last_change":"2024-01-22T05:05:42.796248+0000","last_active":"2024-01-22T05:05:42.798508+0000","last_peered":"2024-01-22T05:05:42.798508+0000","last_clean":"2024-01-22T05:05:42.798508+0000","last_became_active":"2024-01-22T05:05:42.795962+0000","last_became_peered":"2024-01-22T05:05:42.795962+0000","last_unstale":"2024-01-22T05:05:42.798508+0000","last_undegraded":"2024-01-22T05:05:42.798508+0000","last_fullsized":"2024-01-22T05:05:42.798508+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-22T05:05:44.498496+0000","last_change":"2024-01-22T05:05:42.349978+0000","last_active":"2024-01-22T05:05:44.498496+0000","last_peered":"2024-01-22T05:05:44.498496+0000","last_clean":"2024-01-22T05:05:44.498496+0000","last_became_active":"2024-01-22T05:05:42.349679+0000","last_became_peered":"2024-01-22T05:05:42.349679+0000","last_unstale":"2024-01-22T05:05:44.498496+0000","last_undegraded":"2024-01-22T05:05:44.498496+0000","last_fullsized":"2024-01-22T05:05:44.498496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.796439+0000","last_change":"2024-01-22T05:05:42.795378+0000","last_active":"2024-01-22T05:05:42.796439+0000","last_peered":"2024-01-22T05:05:42.796439+0000","last_clean":"2024-01-22T05:05:42.796439+0000","last_became_active":"2024-01-22T05:05:42.795026+0000","last_became_peered":"2024-01-22T05:05:42.795026+0000","last_unstale":"2024-01-22T05:05:42.796439+0000","last_undegraded":"2024-01-22T05:05:42.796439+0000","last_fullsized":"2024-01-22T05:05:42.796439+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.770591+0000","last_change":"2024-01-22T05:05:42.347988+0000","last_active":"2024-01-22T05:05:42.770591+0000","last_peered":"2024-01-22T05:05:42.770591+0000","last_clean":"2024-01-22T05:05:42.770591+0000","last_became_active":"2024-01-22T05:05:42.347693+0000","last_became_peered":"2024-01-22T05:05:42.347693+0000","last_unstale":"2024-01-22T05:05:42.770591+0000","last_undegraded":"2024-01-22T05:05:42.770591+0000","last_fullsized":"2024-01-22T05:05:42.770591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.772127+0000","last_change":"2024-01-22T05:05:42.767070+0000","last_active":"2024-01-22T05:05:42.772127+0000","last_peered":"2024-01-22T05:05:42.772127+0000","last_clean":"2024-01-22T05:05:42.772127+0000","last_became_active":"2024-01-22T05:05:42.766408+0000","last_became_peered":"2024-01-22T05:05:42.766408+0000","last_unstale":"2024-01-22T05:05:42.772127+0000","last_undegraded":"2024-01-22T05:05:42.772127+0000","last_fullsized":"2024-01-22T05:05:42.772127+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.764419+0000","last_change":"2024-01-22T05:05:42.355489+0000","last_active":"2024-01-22T05:05:42.764419+0000","last_peered":"2024-01-22T05:05:42.764419+0000","last_clean":"2024-01-22T05:05:42.764419+0000","last_became_active":"2024-01-22T05:05:42.355186+0000","last_became_peered":"2024-01-22T05:05:42.355186+0000","last_unstale":"2024-01-22T05:05:42.764419+0000","last_undegraded":"2024-01-22T05:05:42.764419+0000","last_fullsized":"2024-01-22T05:05:42.764419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.780396+0000","last_change":"2024-01-22T05:05:42.774575+0000","last_active":"2024-01-22T05:05:42.780396+0000","last_peered":"2024-01-22T05:05:42.780396+0000","last_clean":"2024-01-22T05:05:42.780396+0000","last_became_active":"2024-01-22T05:05:42.774216+0000","last_became_peered":"2024-01-22T05:05:42.774216+0000","last_unstale":"2024-01-22T05:05:42.780396+0000","last_undegraded":"2024-01-22T05:05:42.780396+0000","last_fullsized":"2024-01-22T05:05:42.780396+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.770334+0000","last_change":"2024-01-22T05:05:42.338150+0000","last_active":"2024-01-22T05:05:42.770334+0000","last_peered":"2024-01-22T05:05:42.770334+0000","last_clean":"2024-01-22T05:05:42.770334+0000","last_became_active":"2024-01-22T05:05:42.337828+0000","last_became_peered":"2024-01-22T05:05:42.337828+0000","last_unstale":"2024-01-22T05:05:42.770334+0000","last_undegraded":"2024-01-22T05:05:42.770334+0000","last_fullsized":"2024-01-22T05:05:42.770334+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.792634+0000","last_change":"2024-01-22T05:05:42.787674+0000","last_active":"2024-01-22T05:05:42.792634+0000","last_peered":"2024-01-22T05:05:42.792634+0000","last_clean":"2024-01-22T05:05:42.792634+0000","last_became_active":"2024-01-22T05:05:42.787385+0000","last_became_peered":"2024-01-22T05:05:42.787385+0000","last_unstale":"2024-01-22T05:05:42.792634+0000","last_undegraded":"2024-01-22T05:05:42.792634+0000","last_fullsized":"2024-01-22T05:05:42.792634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.770162+0000","last_change":"2024-01-22T05:05:42.352186+0000","last_active":"2024-01-22T05:05:42.770162+0000","last_peered":"2024-01-22T05:05:42.770162+0000","last_clean":"2024-01-22T05:05:42.770162+0000","last_became_active":"2024-01-22T05:05:42.351686+0000","last_became_peered":"2024-01-22T05:05:42.351686+0000","last_unstale":"2024-01-22T05:05:42.770162+0000","last_undegraded":"2024-01-22T05:05:42.770162+0000","last_fullsized":"2024-01-22T05:05:42.770162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.794567+0000","last_change":"2024-01-22T05:05:42.792252+0000","last_active":"2024-01-22T05:05:42.794567+0000","last_peered":"2024-01-22T05:05:42.794567+0000","last_clean":"2024-01-22T05:05:42.794567+0000","last_became_active":"2024-01-22T05:05:42.791485+0000","last_became_peered":"2024-01-22T05:05:42.791485+0000","last_unstale":"2024-01-22T05:05:42.794567+0000","last_undegraded":"2024-01-22T05:05:42.794567+0000","last_fullsized":"2024-01-22T05:05:42.794567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.775129+0000","last_change":"2024-01-22T05:05:42.360668+0000","last_active":"2024-01-22T05:05:42.775129+0000","last_peered":"2024-01-22T05:05:42.775129+0000","last_clean":"2024-01-22T05:05:42.775129+0000","last_became_active":"2024-01-22T05:05:42.360444+0000","last_became_peered":"2024-01-22T05:05:42.360444+0000","last_unstale":"2024-01-22T05:05:42.775129+0000","last_undegraded":"2024-01-22T05:05:42.775129+0000","last_fullsized":"2024-01-22T05:05:42.775129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.783428+0000","last_change":"2024-01-22T05:05:42.775506+0000","last_active":"2024-01-22T05:05:42.783428+0000","last_peered":"2024-01-22T05:05:42.783428+0000","last_clean":"2024-01-22T05:05:42.783428+0000","last_became_active":"2024-01-22T05:05:42.775249+0000","last_became_peered":"2024-01-22T05:05:42.775249+0000","last_unstale":"2024-01-22T05:05:42.783428+0000","last_undegraded":"2024-01-22T05:05:42.783428+0000","last_fullsized":"2024-01-22T05:05:42.783428+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.776997+0000","last_change":"2024-01-22T05:05:42.337984+0000","last_active":"2024-01-22T05:05:42.776997+0000","last_peered":"2024-01-22T05:05:42.776997+0000","last_clean":"2024-01-22T05:05:42.776997+0000","last_became_active":"2024-01-22T05:05:42.337050+0000","last_became_peered":"2024-01-22T05:05:42.337050+0000","last_unstale":"2024-01-22T05:05:42.776997+0000","last_undegraded":"2024-01-22T05:05:42.776997+0000","last_fullsized":"2024-01-22T05:05:42.776997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.801778+0000","last_change":"2024-01-22T05:05:42.792939+0000","last_active":"2024-01-22T05:05:42.801778+0000","last_peered":"2024-01-22T05:05:42.801778+0000","last_clean":"2024-01-22T05:05:42.801778+0000","last_became_active":"2024-01-22T05:05:42.792681+0000","last_became_peered":"2024-01-22T05:05:42.792681+0000","last_unstale":"2024-01-22T05:05:42.801778+0000","last_undegraded":"2024-01-22T05:05:42.801778+0000","last_fullsized":"2024-01-22T05:05:42.801778+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.798803+0000","last_change":"2024-01-22T05:05:42.342250+0000","last_active":"2024-01-22T05:05:42.798803+0000","last_peered":"2024-01-22T05:05:42.798803+0000","last_clean":"2024-01-22T05:05:42.798803+0000","last_became_active":"2024-01-22T05:05:42.341974+0000","last_became_peered":"2024-01-22T05:05:42.341974+0000","last_unstale":"2024-01-22T05:05:42.798803+0000","last_undegraded":"2024-01-22T05:05:42.798803+0000","last_fullsized":"2024-01-22T05:05:42.798803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.784846+0000","last_change":"2024-01-22T05:05:42.777060+0000","last_active":"2024-01-22T05:05:42.784846+0000","last_peered":"2024-01-22T05:05:42.784846+0000","last_clean":"2024-01-22T05:05:42.784846+0000","last_became_active":"2024-01-22T05:05:42.773757+0000","last_became_peered":"2024-01-22T05:05:42.773757+0000","last_unstale":"2024-01-22T05:05:42.784846+0000","last_undegraded":"2024-01-22T05:05:42.784846+0000","last_fullsized":"2024-01-22T05:05:42.784846+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.789513+0000","last_change":"2024-01-22T05:05:42.341030+0000","last_active":"2024-01-22T05:05:42.789513+0000","last_peered":"2024-01-22T05:05:42.789513+0000","last_clean":"2024-01-22T05:05:42.789513+0000","last_became_active":"2024-01-22T05:05:42.340774+0000","last_became_peered":"2024-01-22T05:05:42.340774+0000","last_unstale":"2024-01-22T05:05:42.789513+0000","last_undegraded":"2024-01-22T05:05:42.789513+0000","last_fullsized":"2024-01-22T05:05:42.789513+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.785278+0000","last_change":"2024-01-22T05:05:42.777075+0000","last_active":"2024-01-22T05:05:42.785278+0000","last_peered":"2024-01-22T05:05:42.785278+0000","last_clean":"2024-01-22T05:05:42.785278+0000","last_became_active":"2024-01-22T05:05:42.776701+0000","last_became_peered":"2024-01-22T05:05:42.776701+0000","last_unstale":"2024-01-22T05:05:42.785278+0000","last_undegraded":"2024-01-22T05:05:42.785278+0000","last_fullsized":"2024-01-22T05:05:42.785278+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.801671+0000","last_change":"2024-01-22T05:05:42.350837+0000","last_active":"2024-01-22T05:05:42.801671+0000","last_peered":"2024-01-22T05:05:42.801671+0000","last_clean":"2024-01-22T05:05:42.801671+0000","last_became_active":"2024-01-22T05:05:42.350332+0000","last_became_peered":"2024-01-22T05:05:42.350332+0000","last_unstale":"2024-01-22T05:05:42.801671+0000","last_undegraded":"2024-01-22T05:05:42.801671+0000","last_fullsized":"2024-01-22T05:05:42.801671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.795251+0000","last_change":"2024-01-22T05:05:42.788382+0000","last_active":"2024-01-22T05:05:42.795251+0000","last_peered":"2024-01-22T05:05:42.795251+0000","last_clean":"2024-01-22T05:05:42.795251+0000","last_became_active":"2024-01-22T05:05:42.788055+0000","last_became_peered":"2024-01-22T05:05:42.788055+0000","last_unstale":"2024-01-22T05:05:42.795251+0000","last_undegraded":"2024-01-22T05:05:42.795251+0000","last_fullsized":"2024-01-22T05:05:42.795251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.773461+0000","last_change":"2024-01-22T05:05:42.349799+0000","last_active":"2024-01-22T05:05:42.773461+0000","last_peered":"2024-01-22T05:05:42.773461+0000","last_clean":"2024-01-22T05:05:42.773461+0000","last_became_active":"2024-01-22T05:05:42.349522+0000","last_became_peered":"2024-01-22T05:05:42.349522+0000","last_unstale":"2024-01-22T05:05:42.773461+0000","last_undegraded":"2024-01-22T05:05:42.773461+0000","last_fullsized":"2024-01-22T05:05:42.773461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.780715+0000","last_change":"2024-01-22T05:05:42.774968+0000","last_active":"2024-01-22T05:05:42.780715+0000","last_peered":"2024-01-22T05:05:42.780715+0000","last_clean":"2024-01-22T05:05:42.780715+0000","last_became_active":"2024-01-22T05:05:42.774646+0000","last_became_peered":"2024-01-22T05:05:42.774646+0000","last_unstale":"2024-01-22T05:05:42.780715+0000","last_undegraded":"2024-01-22T05:05:42.780715+0000","last_fullsized":"2024-01-22T05:05:42.780715+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.762708+0000","last_change":"2024-01-22T05:05:42.349880+0000","last_active":"2024-01-22T05:05:42.762708+0000","last_peered":"2024-01-22T05:05:42.762708+0000","last_clean":"2024-01-22T05:05:42.762708+0000","last_became_active":"2024-01-22T05:05:42.349346+0000","last_became_peered":"2024-01-22T05:05:42.349346+0000","last_unstale":"2024-01-22T05:05:42.762708+0000","last_undegraded":"2024-01-22T05:05:42.762708+0000","last_fullsized":"2024-01-22T05:05:42.762708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.804499+0000","last_change":"2024-01-22T05:05:42.801074+0000","last_active":"2024-01-22T05:05:42.804499+0000","last_peered":"2024-01-22T05:05:42.804499+0000","last_clean":"2024-01-22T05:05:42.804499+0000","last_became_active":"2024-01-22T05:05:42.800769+0000","last_became_peered":"2024-01-22T05:05:42.800769+0000","last_unstale":"2024-01-22T05:05:42.804499+0000","last_undegraded":"2024-01-22T05:05:42.804499+0000","last_fullsized":"2024-01-22T05:05:42.804499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.760739+0000","last_change":"2024-01-22T05:05:42.348366+0000","last_active":"2024-01-22T05:05:42.760739+0000","last_peered":"2024-01-22T05:05:42.760739+0000","last_clean":"2024-01-22T05:05:42.760739+0000","last_became_active":"2024-01-22T05:05:42.347668+0000","last_became_peered":"2024-01-22T05:05:42.347668+0000","last_unstale":"2024-01-22T05:05:42.760739+0000","last_undegraded":"2024-01-22T05:05:42.760739+0000","last_fullsized":"2024-01-22T05:05:42.760739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.800052+0000","last_change":"2024-01-22T05:05:42.776919+0000","last_active":"2024-01-22T05:05:42.800052+0000","last_peered":"2024-01-22T05:05:42.800052+0000","last_clean":"2024-01-22T05:05:42.800052+0000","last_became_active":"2024-01-22T05:05:42.776646+0000","last_became_peered":"2024-01-22T05:05:42.776646+0000","last_unstale":"2024-01-22T05:05:42.800052+0000","last_undegraded":"2024-01-22T05:05:42.800052+0000","last_fullsized":"2024-01-22T05:05:42.800052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.763276+0000","last_change":"2024-01-22T05:05:42.345773+0000","last_active":"2024-01-22T05:05:42.763276+0000","last_peered":"2024-01-22T05:05:42.763276+0000","last_clean":"2024-01-22T05:05:42.763276+0000","last_became_active":"2024-01-22T05:05:42.345307+0000","last_became_peered":"2024-01-22T05:05:42.345307+0000","last_unstale":"2024-01-22T05:05:42.763276+0000","last_undegraded":"2024-01-22T05:05:42.763276+0000","last_fullsized":"2024-01-22T05:05:42.763276+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.791058+0000","last_change":"2024-01-22T05:05:42.785544+0000","last_active":"2024-01-22T05:05:42.791058+0000","last_peered":"2024-01-22T05:05:42.791058+0000","last_clean":"2024-01-22T05:05:42.791058+0000","last_became_active":"2024-01-22T05:05:42.785226+0000","last_became_peered":"2024-01-22T05:05:42.785226+0000","last_unstale":"2024-01-22T05:05:42.791058+0000","last_undegraded":"2024-01-22T05:05:42.791058+0000","last_fullsized":"2024-01-22T05:05:42.791058+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.766366+0000","last_change":"2024-01-22T05:05:42.344465+0000","last_active":"2024-01-22T05:05:42.766366+0000","last_peered":"2024-01-22T05:05:42.766366+0000","last_clean":"2024-01-22T05:05:42.766366+0000","last_became_active":"2024-01-22T05:05:42.344171+0000","last_became_peered":"2024-01-22T05:05:42.344171+0000","last_unstale":"2024-01-22T05:05:42.766366+0000","last_undegraded":"2024-01-22T05:05:42.766366+0000","last_fullsized":"2024-01-22T05:05:42.766366+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.789222+0000","last_change":"2024-01-22T05:05:42.781772+0000","last_active":"2024-01-22T05:05:42.789222+0000","last_peered":"2024-01-22T05:05:42.789222+0000","last_clean":"2024-01-22T05:05:42.789222+0000","last_became_active":"2024-01-22T05:05:42.781126+0000","last_became_peered":"2024-01-22T05:05:42.781126+0000","last_unstale":"2024-01-22T05:05:42.789222+0000","last_undegraded":"2024-01-22T05:05:42.789222+0000","last_fullsized":"2024-01-22T05:05:42.789222+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.760455+0000","last_change":"2024-01-22T05:05:42.339764+0000","last_active":"2024-01-22T05:05:42.760455+0000","last_peered":"2024-01-22T05:05:42.760455+0000","last_clean":"2024-01-22T05:05:42.760455+0000","last_became_active":"2024-01-22T05:05:42.339442+0000","last_became_peered":"2024-01-22T05:05:42.339442+0000","last_unstale":"2024-01-22T05:05:42.760455+0000","last_undegraded":"2024-01-22T05:05:42.760455+0000","last_fullsized":"2024-01-22T05:05:42.760455+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.793814+0000","last_change":"2024-01-22T05:05:42.792739+0000","last_active":"2024-01-22T05:05:42.793814+0000","last_peered":"2024-01-22T05:05:42.793814+0000","last_clean":"2024-01-22T05:05:42.793814+0000","last_became_active":"2024-01-22T05:05:42.792030+0000","last_became_peered":"2024-01-22T05:05:42.792030+0000","last_unstale":"2024-01-22T05:05:42.793814+0000","last_undegraded":"2024-01-22T05:05:42.793814+0000","last_fullsized":"2024-01-22T05:05:42.793814+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.771882+0000","last_change":"2024-01-22T05:05:42.339443+0000","last_active":"2024-01-22T05:05:42.771882+0000","last_peered":"2024-01-22T05:05:42.771882+0000","last_clean":"2024-01-22T05:05:42.771882+0000","last_became_active":"2024-01-22T05:05:42.339151+0000","last_became_peered":"2024-01-22T05:05:42.339151+0000","last_unstale":"2024-01-22T05:05:42.771882+0000","last_undegraded":"2024-01-22T05:05:42.771882+0000","last_fullsized":"2024-01-22T05:05:42.771882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.793456+0000","last_change":"2024-01-22T05:05:42.791040+0000","last_active":"2024-01-22T05:05:42.793456+0000","last_peered":"2024-01-22T05:05:42.793456+0000","last_clean":"2024-01-22T05:05:42.793456+0000","last_became_active":"2024-01-22T05:05:42.790544+0000","last_became_peered":"2024-01-22T05:05:42.790544+0000","last_unstale":"2024-01-22T05:05:42.793456+0000","last_undegraded":"2024-01-22T05:05:42.793456+0000","last_fullsized":"2024-01-22T05:05:42.793456+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'3","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.791376+0000","last_change":"2024-01-22T05:05:42.341590+0000","last_active":"2024-01-22T05:05:42.791376+0000","last_peered":"2024-01-22T05:05:42.791376+0000","last_clean":"2024-01-22T05:05:42.791376+0000","last_became_active":"2024-01-22T05:05:42.340992+0000","last_became_peered":"2024-01-22T05:05:42.340992+0000","last_unstale":"2024-01-22T05:05:42.791376+0000","last_undegraded":"2024-01-22T05:05:42.791376+0000","last_fullsized":"2024-01-22T05:05:42.791376+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.799032+0000","last_change":"2024-01-22T05:05:42.797791+0000","last_active":"2024-01-22T05:05:42.799032+0000","last_peered":"2024-01-22T05:05:42.799032+0000","last_clean":"2024-01-22T05:05:42.799032+0000","last_became_active":"2024-01-22T05:05:42.797050+0000","last_became_peered":"2024-01-22T05:05:42.797050+0000","last_unstale":"2024-01-22T05:05:42.799032+0000","last_undegraded":"2024-01-22T05:05:42.799032+0000","last_fullsized":"2024-01-22T05:05:42.799032+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.795743+0000","last_change":"2024-01-22T05:05:42.339386+0000","last_active":"2024-01-22T05:05:42.795743+0000","last_peered":"2024-01-22T05:05:42.795743+0000","last_clean":"2024-01-22T05:05:42.795743+0000","last_became_active":"2024-01-22T05:05:42.338881+0000","last_became_peered":"2024-01-22T05:05:42.338881+0000","last_unstale":"2024-01-22T05:05:42.795743+0000","last_undegraded":"2024-01-22T05:05:42.795743+0000","last_fullsized":"2024-01-22T05:05:42.795743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.799442+0000","last_change":"2024-01-22T05:05:42.797819+0000","last_active":"2024-01-22T05:05:42.799442+0000","last_peered":"2024-01-22T05:05:42.799442+0000","last_clean":"2024-01-22T05:05:42.799442+0000","last_became_active":"2024-01-22T05:05:42.797505+0000","last_became_peered":"2024-01-22T05:05:42.797505+0000","last_unstale":"2024-01-22T05:05:42.799442+0000","last_undegraded":"2024-01-22T05:05:42.799442+0000","last_fullsized":"2024-01-22T05:05:42.799442+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.803997+0000","last_change":"2024-01-22T05:05:42.349679+0000","last_active":"2024-01-22T05:05:42.803997+0000","last_peered":"2024-01-22T05:05:42.803997+0000","last_clean":"2024-01-22T05:05:42.803997+0000","last_became_active":"2024-01-22T05:05:42.349307+0000","last_became_peered":"2024-01-22T05:05:42.349307+0000","last_unstale":"2024-01-22T05:05:42.803997+0000","last_undegraded":"2024-01-22T05:05:42.803997+0000","last_fullsized":"2024-01-22T05:05:42.803997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.804380+0000","last_change":"2024-01-22T05:05:42.786120+0000","last_active":"2024-01-22T05:05:42.804380+0000","last_peered":"2024-01-22T05:05:42.804380+0000","last_clean":"2024-01-22T05:05:42.804380+0000","last_became_active":"2024-01-22T05:05:42.785806+0000","last_became_peered":"2024-01-22T05:05:42.785806+0000","last_unstale":"2024-01-22T05:05:42.804380+0000","last_undegraded":"2024-01-22T05:05:42.804380+0000","last_fullsized":"2024-01-22T05:05:42.804380+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.773426+0000","last_change":"2024-01-22T05:05:42.358631+0000","last_active":"2024-01-22T05:05:42.773426+0000","last_peered":"2024-01-22T05:05:42.773426+0000","last_clean":"2024-01-22T05:05:42.773426+0000","last_became_active":"2024-01-22T05:05:42.358394+0000","last_became_peered":"2024-01-22T05:05:42.358394+0000","last_unstale":"2024-01-22T05:05:42.773426+0000","last_undegraded":"2024-01-22T05:05:42.773426+0000","last_fullsized":"2024-01-22T05:05:42.773426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.802848+0000","last_change":"2024-01-22T05:05:42.799533+0000","last_active":"2024-01-22T05:05:42.802848+0000","last_peered":"2024-01-22T05:05:42.802848+0000","last_clean":"2024-01-22T05:05:42.802848+0000","last_became_active":"2024-01-22T05:05:42.799260+0000","last_became_peered":"2024-01-22T05:05:42.799260+0000","last_unstale":"2024-01-22T05:05:42.802848+0000","last_undegraded":"2024-01-22T05:05:42.802848+0000","last_fullsized":"2024-01-22T05:05:42.802848+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.762470+0000","last_change":"2024-01-22T05:05:42.349941+0000","last_active":"2024-01-22T05:05:42.762470+0000","last_peered":"2024-01-22T05:05:42.762470+0000","last_clean":"2024-01-22T05:05:42.762470+0000","last_became_active":"2024-01-22T05:05:42.349656+0000","last_became_peered":"2024-01-22T05:05:42.349656+0000","last_unstale":"2024-01-22T05:05:42.762470+0000","last_undegraded":"2024-01-22T05:05:42.762470+0000","last_fullsized":"2024-01-22T05:05:42.762470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.790958+0000","last_change":"2024-01-22T05:05:42.786140+0000","last_active":"2024-01-22T05:05:42.790958+0000","last_peered":"2024-01-22T05:05:42.790958+0000","last_clean":"2024-01-22T05:05:42.790958+0000","last_became_active":"2024-01-22T05:05:42.785748+0000","last_became_peered":"2024-01-22T05:05:42.785748+0000","last_unstale":"2024-01-22T05:05:42.790958+0000","last_undegraded":"2024-01-22T05:05:42.790958+0000","last_fullsized":"2024-01-22T05:05:42.790958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'4","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.800362+0000","last_change":"2024-01-22T05:05:42.353644+0000","last_active":"2024-01-22T05:05:42.800362+0000","last_peered":"2024-01-22T05:05:42.800362+0000","last_clean":"2024-01-22T05:05:42.800362+0000","last_became_active":"2024-01-22T05:05:42.346934+0000","last_became_peered":"2024-01-22T05:05:42.346934+0000","last_unstale":"2024-01-22T05:05:42.800362+0000","last_undegraded":"2024-01-22T05:05:42.800362+0000","last_fullsized":"2024-01-22T05:05:42.800362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.794531+0000","last_change":"2024-01-22T05:05:42.790436+0000","last_active":"2024-01-22T05:05:42.794531+0000","last_peered":"2024-01-22T05:05:42.794531+0000","last_clean":"2024-01-22T05:05:42.794531+0000","last_became_active":"2024-01-22T05:05:42.790104+0000","last_became_peered":"2024-01-22T05:05:42.790104+0000","last_unstale":"2024-01-22T05:05:42.794531+0000","last_undegraded":"2024-01-22T05:05:42.794531+0000","last_fullsized":"2024-01-22T05:05:42.794531+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.797785+0000","last_change":"2024-01-22T05:05:42.352868+0000","last_active":"2024-01-22T05:05:42.797785+0000","last_peered":"2024-01-22T05:05:42.797785+0000","last_clean":"2024-01-22T05:05:42.797785+0000","last_became_active":"2024-01-22T05:05:42.352586+0000","last_became_peered":"2024-01-22T05:05:42.352586+0000","last_unstale":"2024-01-22T05:05:42.797785+0000","last_undegraded":"2024-01-22T05:05:42.797785+0000","last_fullsized":"2024-01-22T05:05:42.797785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.803882+0000","last_change":"2024-01-22T05:05:42.785286+0000","last_active":"2024-01-22T05:05:42.803882+0000","last_peered":"2024-01-22T05:05:42.803882+0000","last_clean":"2024-01-22T05:05:42.803882+0000","last_became_active":"2024-01-22T05:05:42.784981+0000","last_became_peered":"2024-01-22T05:05:42.784981+0000","last_unstale":"2024-01-22T05:05:42.803882+0000","last_undegraded":"2024-01-22T05:05:42.803882+0000","last_fullsized":"2024-01-22T05:05:42.803882+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.800847+0000","last_change":"2024-01-22T05:05:42.347821+0000","last_active":"2024-01-22T05:05:42.800847+0000","last_peered":"2024-01-22T05:05:42.800847+0000","last_clean":"2024-01-22T05:05:42.800847+0000","last_became_active":"2024-01-22T05:05:42.347410+0000","last_became_peered":"2024-01-22T05:05:42.347410+0000","last_unstale":"2024-01-22T05:05:42.800847+0000","last_undegraded":"2024-01-22T05:05:42.800847+0000","last_fullsized":"2024-01-22T05:05:42.800847+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.790848+0000","last_change":"2024-01-22T05:05:42.784729+0000","last_active":"2024-01-22T05:05:42.790848+0000","last_peered":"2024-01-22T05:05:42.790848+0000","last_clean":"2024-01-22T05:05:42.790848+0000","last_became_active":"2024-01-22T05:05:42.781035+0000","last_became_peered":"2024-01-22T05:05:42.781035+0000","last_unstale":"2024-01-22T05:05:42.790848+0000","last_undegraded":"2024-01-22T05:05:42.790848+0000","last_fullsized":"2024-01-22T05:05:42.790848+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.764323+0000","last_change":"2024-01-22T05:05:42.344802+0000","last_active":"2024-01-22T05:05:42.764323+0000","last_peered":"2024-01-22T05:05:42.764323+0000","last_clean":"2024-01-22T05:05:42.764323+0000","last_became_active":"2024-01-22T05:05:42.344442+0000","last_became_peered":"2024-01-22T05:05:42.344442+0000","last_unstale":"2024-01-22T05:05:42.764323+0000","last_undegraded":"2024-01-22T05:05:42.764323+0000","last_fullsized":"2024-01-22T05:05:42.764323+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.793472+0000","last_change":"2024-01-22T05:05:42.790981+0000","last_active":"2024-01-22T05:05:42.793472+0000","last_peered":"2024-01-22T05:05:42.793472+0000","last_clean":"2024-01-22T05:05:42.793472+0000","last_became_active":"2024-01-22T05:05:42.790653+0000","last_became_peered":"2024-01-22T05:05:42.790653+0000","last_unstale":"2024-01-22T05:05:42.793472+0000","last_undegraded":"2024-01-22T05:05:42.793472+0000","last_fullsized":"2024-01-22T05:05:42.793472+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.765043+0000","last_change":"2024-01-22T05:05:42.347745+0000","last_active":"2024-01-22T05:05:42.765043+0000","last_peered":"2024-01-22T05:05:42.765043+0000","last_clean":"2024-01-22T05:05:42.765043+0000","last_became_active":"2024-01-22T05:05:42.341018+0000","last_became_peered":"2024-01-22T05:05:42.341018+0000","last_unstale":"2024-01-22T05:05:42.765043+0000","last_undegraded":"2024-01-22T05:05:42.765043+0000","last_fullsized":"2024-01-22T05:05:42.765043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.798201+0000","last_change":"2024-01-22T05:05:42.791592+0000","last_active":"2024-01-22T05:05:42.798201+0000","last_peered":"2024-01-22T05:05:42.798201+0000","last_clean":"2024-01-22T05:05:42.798201+0000","last_became_active":"2024-01-22T05:05:42.791323+0000","last_became_peered":"2024-01-22T05:05:42.791323+0000","last_unstale":"2024-01-22T05:05:42.798201+0000","last_undegraded":"2024-01-22T05:05:42.798201+0000","last_fullsized":"2024-01-22T05:05:42.798201+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.799577+0000","last_change":"2024-01-22T05:05:42.350071+0000","last_active":"2024-01-22T05:05:42.799577+0000","last_peered":"2024-01-22T05:05:42.799577+0000","last_clean":"2024-01-22T05:05:42.799577+0000","last_became_active":"2024-01-22T05:05:42.349778+0000","last_became_peered":"2024-01-22T05:05:42.349778+0000","last_unstale":"2024-01-22T05:05:42.799577+0000","last_undegraded":"2024-01-22T05:05:42.799577+0000","last_fullsized":"2024-01-22T05:05:42.799577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.804339+0000","last_change":"2024-01-22T05:05:42.801107+0000","last_active":"2024-01-22T05:05:42.804339+0000","last_peered":"2024-01-22T05:05:42.804339+0000","last_clean":"2024-01-22T05:05:42.804339+0000","last_became_active":"2024-01-22T05:05:42.800759+0000","last_became_peered":"2024-01-22T05:05:42.800759+0000","last_unstale":"2024-01-22T05:05:42.804339+0000","last_undegraded":"2024-01-22T05:05:42.804339+0000","last_fullsized":"2024-01-22T05:05:42.804339+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.763732+0000","last_change":"2024-01-22T05:05:42.338002+0000","last_active":"2024-01-22T05:05:42.763732+0000","last_peered":"2024-01-22T05:05:42.763732+0000","last_clean":"2024-01-22T05:05:42.763732+0000","last_became_active":"2024-01-22T05:05:42.337734+0000","last_became_peered":"2024-01-22T05:05:42.337734+0000","last_unstale":"2024-01-22T05:05:42.763732+0000","last_undegraded":"2024-01-22T05:05:42.763732+0000","last_fullsized":"2024-01-22T05:05:42.763732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.794550+0000","last_change":"2024-01-22T05:05:42.789114+0000","last_active":"2024-01-22T05:05:42.794550+0000","last_peered":"2024-01-22T05:05:42.794550+0000","last_clean":"2024-01-22T05:05:42.794550+0000","last_became_active":"2024-01-22T05:05:42.788795+0000","last_became_peered":"2024-01-22T05:05:42.788795+0000","last_unstale":"2024-01-22T05:05:42.794550+0000","last_undegraded":"2024-01-22T05:05:42.794550+0000","last_fullsized":"2024-01-22T05:05:42.794550+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.771729+0000","last_change":"2024-01-22T05:05:42.344542+0000","last_active":"2024-01-22T05:05:42.771729+0000","last_peered":"2024-01-22T05:05:42.771729+0000","last_clean":"2024-01-22T05:05:42.771729+0000","last_became_active":"2024-01-22T05:05:42.342874+0000","last_became_peered":"2024-01-22T05:05:42.342874+0000","last_unstale":"2024-01-22T05:05:42.771729+0000","last_undegraded":"2024-01-22T05:05:42.771729+0000","last_fullsized":"2024-01-22T05:05:42.771729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.803354+0000","last_change":"2024-01-22T05:05:42.784487+0000","last_active":"2024-01-22T05:05:42.803354+0000","last_peered":"2024-01-22T05:05:42.803354+0000","last_clean":"2024-01-22T05:05:42.803354+0000","last_became_active":"2024-01-22T05:05:42.784157+0000","last_became_peered":"2024-01-22T05:05:42.784157+0000","last_unstale":"2024-01-22T05:05:42.803354+0000","last_undegraded":"2024-01-22T05:05:42.803354+0000","last_fullsized":"2024-01-22T05:05:42.803354+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.778374+0000","last_change":"2024-01-22T05:05:42.359119+0000","last_active":"2024-01-22T05:05:42.778374+0000","last_peered":"2024-01-22T05:05:42.778374+0000","last_clean":"2024-01-22T05:05:42.778374+0000","last_became_active":"2024-01-22T05:05:42.358885+0000","last_became_peered":"2024-01-22T05:05:42.358885+0000","last_unstale":"2024-01-22T05:05:42.778374+0000","last_undegraded":"2024-01-22T05:05:42.778374+0000","last_fullsized":"2024-01-22T05:05:42.778374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.789866+0000","last_change":"2024-01-22T05:05:42.784206+0000","last_active":"2024-01-22T05:05:42.789866+0000","last_peered":"2024-01-22T05:05:42.789866+0000","last_clean":"2024-01-22T05:05:42.789866+0000","last_became_active":"2024-01-22T05:05:42.783916+0000","last_became_peered":"2024-01-22T05:05:42.783916+0000","last_unstale":"2024-01-22T05:05:42.789866+0000","last_undegraded":"2024-01-22T05:05:42.789866+0000","last_fullsized":"2024-01-22T05:05:42.789866+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.774477+0000","last_change":"2024-01-22T05:05:42.339234+0000","last_active":"2024-01-22T05:05:42.774477+0000","last_peered":"2024-01-22T05:05:42.774477+0000","last_clean":"2024-01-22T05:05:42.774477+0000","last_became_active":"2024-01-22T05:05:42.338850+0000","last_became_peered":"2024-01-22T05:05:42.338850+0000","last_unstale":"2024-01-22T05:05:42.774477+0000","last_undegraded":"2024-01-22T05:05:42.774477+0000","last_fullsized":"2024-01-22T05:05:42.774477+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.772544+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:05:42.772544+0000","last_peered":"2024-01-22T05:05:42.772544+0000","last_clean":"2024-01-22T05:05:42.772544+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:05:42.772544+0000","last_undegraded":"2024-01-22T05:05:42.772544+0000","last_fullsized":"2024-01-22T05:05:42.772544+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.799509+0000","last_change":"2024-01-22T05:05:42.792839+0000","last_active":"2024-01-22T05:05:42.799509+0000","last_peered":"2024-01-22T05:05:42.799509+0000","last_clean":"2024-01-22T05:05:42.799509+0000","last_became_active":"2024-01-22T05:05:42.792589+0000","last_became_peered":"2024-01-22T05:05:42.792589+0000","last_unstale":"2024-01-22T05:05:42.799509+0000","last_undegraded":"2024-01-22T05:05:42.799509+0000","last_fullsized":"2024-01-22T05:05:42.799509+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.760803+0000","last_change":"2024-01-22T05:05:42.354516+0000","last_active":"2024-01-22T05:05:42.760803+0000","last_peered":"2024-01-22T05:05:42.760803+0000","last_clean":"2024-01-22T05:05:42.760803+0000","last_became_active":"2024-01-22T05:05:42.354247+0000","last_became_peered":"2024-01-22T05:05:42.354247+0000","last_unstale":"2024-01-22T05:05:42.760803+0000","last_undegraded":"2024-01-22T05:05:42.760803+0000","last_fullsized":"2024-01-22T05:05:42.760803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.778764+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:05:42.778764+0000","last_peered":"2024-01-22T05:05:42.778764+0000","last_clean":"2024-01-22T05:05:42.778764+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:05:42.778764+0000","last_undegraded":"2024-01-22T05:05:42.778764+0000","last_fullsized":"2024-01-22T05:05:42.778764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.791716+0000","last_change":"2024-01-22T05:05:42.788498+0000","last_active":"2024-01-22T05:05:42.791716+0000","last_peered":"2024-01-22T05:05:42.791716+0000","last_clean":"2024-01-22T05:05:42.791716+0000","last_became_active":"2024-01-22T05:05:42.788163+0000","last_became_peered":"2024-01-22T05:05:42.788163+0000","last_unstale":"2024-01-22T05:05:42.791716+0000","last_undegraded":"2024-01-22T05:05:42.791716+0000","last_fullsized":"2024-01-22T05:05:42.791716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.773719+0000","last_change":"2024-01-22T05:05:42.337281+0000","last_active":"2024-01-22T05:05:42.773719+0000","last_peered":"2024-01-22T05:05:42.773719+0000","last_clean":"2024-01-22T05:05:42.773719+0000","last_became_active":"2024-01-22T05:05:42.336978+0000","last_became_peered":"2024-01-22T05:05:42.336978+0000","last_unstale":"2024-01-22T05:05:42.773719+0000","last_undegraded":"2024-01-22T05:05:42.773719+0000","last_fullsized":"2024-01-22T05:05:42.773719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.775957+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:05:42.775957+0000","last_peered":"2024-01-22T05:05:42.775957+0000","last_clean":"2024-01-22T05:05:42.775957+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:05:42.775957+0000","last_undegraded":"2024-01-22T05:05:42.775957+0000","last_fullsized":"2024-01-22T05:05:42.775957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.785765+0000","last_change":"2024-01-22T05:05:42.776607+0000","last_active":"2024-01-22T05:05:42.785765+0000","last_peered":"2024-01-22T05:05:42.785765+0000","last_clean":"2024-01-22T05:05:42.785765+0000","last_became_active":"2024-01-22T05:05:42.776324+0000","last_became_peered":"2024-01-22T05:05:42.776324+0000","last_unstale":"2024-01-22T05:05:42.785765+0000","last_undegraded":"2024-01-22T05:05:42.785765+0000","last_fullsized":"2024-01-22T05:05:42.785765+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.774443+0000","last_change":"2024-01-22T05:05:42.356135+0000","last_active":"2024-01-22T05:05:42.774443+0000","last_peered":"2024-01-22T05:05:42.774443+0000","last_clean":"2024-01-22T05:05:42.774443+0000","last_became_active":"2024-01-22T05:05:42.354489+0000","last_became_peered":"2024-01-22T05:05:42.354489+0000","last_unstale":"2024-01-22T05:05:42.774443+0000","last_undegraded":"2024-01-22T05:05:42.774443+0000","last_fullsized":"2024-01-22T05:05:42.774443+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.773647+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:05:42.773647+0000","last_peered":"2024-01-22T05:05:42.773647+0000","last_clean":"2024-01-22T05:05:42.773647+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:05:42.773647+0000","last_undegraded":"2024-01-22T05:05:42.773647+0000","last_fullsized":"2024-01-22T05:05:42.773647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.799391+0000","last_change":"2024-01-22T05:05:42.797566+0000","last_active":"2024-01-22T05:05:42.799391+0000","last_peered":"2024-01-22T05:05:42.799391+0000","last_clean":"2024-01-22T05:05:42.799391+0000","last_became_active":"2024-01-22T05:05:42.796990+0000","last_became_peered":"2024-01-22T05:05:42.796990+0000","last_unstale":"2024-01-22T05:05:42.799391+0000","last_undegraded":"2024-01-22T05:05:42.799391+0000","last_fullsized":"2024-01-22T05:05:42.799391+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.762088+0000","last_change":"2024-01-22T05:05:42.348953+0000","last_active":"2024-01-22T05:05:42.762088+0000","last_peered":"2024-01-22T05:05:42.762088+0000","last_clean":"2024-01-22T05:05:42.762088+0000","last_became_active":"2024-01-22T05:05:42.348577+0000","last_became_peered":"2024-01-22T05:05:42.348577+0000","last_unstale":"2024-01-22T05:05:42.762088+0000","last_undegraded":"2024-01-22T05:05:42.762088+0000","last_fullsized":"2024-01-22T05:05:42.762088+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.763906+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:05:42.763906+0000","last_peered":"2024-01-22T05:05:42.763906+0000","last_clean":"2024-01-22T05:05:42.763906+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:05:42.763906+0000","last_undegraded":"2024-01-22T05:05:42.763906+0000","last_fullsized":"2024-01-22T05:05:42.763906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.797273+0000","last_change":"2024-01-22T05:05:42.774735+0000","last_active":"2024-01-22T05:05:42.797273+0000","last_peered":"2024-01-22T05:05:42.797273+0000","last_clean":"2024-01-22T05:05:42.797273+0000","last_became_active":"2024-01-22T05:05:42.774456+0000","last_became_peered":"2024-01-22T05:05:42.774456+0000","last_unstale":"2024-01-22T05:05:42.797273+0000","last_undegraded":"2024-01-22T05:05:42.797273+0000","last_fullsized":"2024-01-22T05:05:42.797273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.775867+0000","last_change":"2024-01-22T05:05:42.341704+0000","last_active":"2024-01-22T05:05:42.775867+0000","last_peered":"2024-01-22T05:05:42.775867+0000","last_clean":"2024-01-22T05:05:42.775867+0000","last_became_active":"2024-01-22T05:05:42.341329+0000","last_became_peered":"2024-01-22T05:05:42.341329+0000","last_unstale":"2024-01-22T05:05:42.775867+0000","last_undegraded":"2024-01-22T05:05:42.775867+0000","last_fullsized":"2024-01-22T05:05:42.775867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.766379+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:05:42.766379+0000","last_peered":"2024-01-22T05:05:42.766379+0000","last_clean":"2024-01-22T05:05:42.766379+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:05:42.766379+0000","last_undegraded":"2024-01-22T05:05:42.766379+0000","last_fullsized":"2024-01-22T05:05:42.766379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.795367+0000","last_change":"2024-01-22T05:05:42.794409+0000","last_active":"2024-01-22T05:05:42.795367+0000","last_peered":"2024-01-22T05:05:42.795367+0000","last_clean":"2024-01-22T05:05:42.795367+0000","last_became_active":"2024-01-22T05:05:42.794150+0000","last_became_peered":"2024-01-22T05:05:42.794150+0000","last_unstale":"2024-01-22T05:05:42.795367+0000","last_undegraded":"2024-01-22T05:05:42.795367+0000","last_fullsized":"2024-01-22T05:05:42.795367+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.773544+0000","last_change":"2024-01-22T05:05:42.344663+0000","last_active":"2024-01-22T05:05:42.773544+0000","last_peered":"2024-01-22T05:05:42.773544+0000","last_clean":"2024-01-22T05:05:42.773544+0000","last_became_active":"2024-01-22T05:05:42.344347+0000","last_became_peered":"2024-01-22T05:05:42.344347+0000","last_unstale":"2024-01-22T05:05:42.773544+0000","last_undegraded":"2024-01-22T05:05:42.773544+0000","last_fullsized":"2024-01-22T05:05:42.773544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.778259+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:05:42.778259+0000","last_peered":"2024-01-22T05:05:42.778259+0000","last_clean":"2024-01-22T05:05:42.778259+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:05:42.778259+0000","last_undegraded":"2024-01-22T05:05:42.778259+0000","last_fullsized":"2024-01-22T05:05:42.778259+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.804348+0000","last_change":"2024-01-22T05:05:42.790586+0000","last_active":"2024-01-22T05:05:42.804348+0000","last_peered":"2024-01-22T05:05:42.804348+0000","last_clean":"2024-01-22T05:05:42.804348+0000","last_became_active":"2024-01-22T05:05:42.781603+0000","last_became_peered":"2024-01-22T05:05:42.781603+0000","last_unstale":"2024-01-22T05:05:42.804348+0000","last_undegraded":"2024-01-22T05:05:42.804348+0000","last_fullsized":"2024-01-22T05:05:42.804348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:42.302441+0000","last_clean_scrub_stamp":"2024-01-22T05:05:42.302441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.798559+0000","last_change":"2024-01-22T05:05:42.355643+0000","last_active":"2024-01-22T05:05:42.798559+0000","last_peered":"2024-01-22T05:05:42.798559+0000","last_clean":"2024-01-22T05:05:42.798559+0000","last_became_active":"2024-01-22T05:05:42.355174+0000","last_became_peered":"2024-01-22T05:05:42.355174+0000","last_unstale":"2024-01-22T05:05:42.798559+0000","last_undegraded":"2024-01-22T05:05:42.798559+0000","last_fullsized":"2024-01-22T05:05:42.798559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:05:41.291706+0000","last_clean_scrub_stamp":"2024-01-22T05:05:41.291706+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.764059+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:05:42.764059+0000","last_peered":"2024-01-22T05:05:42.764059+0000","last_clean":"2024-01-22T05:05:42.764059+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:05:42.764059+0000","last_undegraded":"2024-01-22T05:05:42.764059+0000","last_fullsized":"2024-01-22T05:05:42.764059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-22T05:05:42.778452+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:05:42.778452+0000","last_peered":"2024-01-22T05:05:42.778452+0000","last_clean":"2024-01-22T05:05:42.778452+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:05:42.778452+0000","last_undegraded":"2024-01-22T05:05:42.778452+0000","last_fullsized":"2024-01-22T05:05:42.778452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":466944,"data_stored":211447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.264},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.53}]},{"osd":1,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.3049999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.659},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":1.5780000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.351},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.502}]},{"osd":4,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.8}]},{"osd":5,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.736},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.915}]},{"osd":6,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.823},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.8680000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":466944,"data_stored":211447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.202}]},{"osd":1,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":4.1760000000000002,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.1839999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.0549999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.1299999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.155}]},{"osd":5,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.109}]},{"osd":7,"last update":"Mon Jan 22 05:05:30 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":3.2850000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.242},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":1.0780000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":462848,"data_stored":211357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.86299999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.077},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0940000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.0409999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.91400000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.139},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.153}]},{"osd":6,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.2010000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.323}]},{"osd":7,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":3.1840000000000002,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.1839999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":471040,"data_stored":212001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.425}]},{"osd":1,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.871},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.83899999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.91800000000000004}]},{"osd":3,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.5620000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.593},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.101}]},{"osd":6,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":3.085,"5min":3.085,"15min":3.085},"last":1.377}]},{"osd":7,"last update":"Mon Jan 22 05:05:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.25}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":475136,"data_stored":211967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.61599999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.94399999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.1619999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.286}]},{"osd":5,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.357},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":1.3400000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.373},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.423}]},{"osd":7,"last update":"Mon Jan 22 05:05:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.105},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.2}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":483328,"data_stored":212985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.57299999999999995}]},{"osd":1,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.98199999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.087}]},{"osd":4,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.27},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.121}]},{"osd":5,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.079},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.1499999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.137}]},{"osd":7,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.016},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.25}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":466944,"data_stored":211427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":1.21}]},{"osd":2,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.92600000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.032},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.0840000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.298},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.3220000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.4430000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.544}]},{"osd":7,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":1.419}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":475136,"data_stored":212837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.69499999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.57599999999999996}]},{"osd":3,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.7989999999999999,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.323}]},{"osd":4,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":5.1799999999999997,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.94399999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":3.548,"5min":3.548,"15min":3.548},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.2110000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.272},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.0820000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:05:29 2024","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":5.29,"5min":5.29,"15min":5.29},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.292}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:05:52.264 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:05:52.264 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-22T05:05:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.475+0000 7fbe4c600700 1 Processor -- start 2024-01-22T05:05:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.479+0000 7fbe4c600700 1 -- start start 2024-01-22T05:05:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe4c600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe44069ac0 0x7fbe440c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe4c600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe440bdd40 0x7fbe44063da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe4c600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbe44064290 0x7fbe440bc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe4c600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe44069ea0 con 0x7fbe440bdd40 2024-01-22T05:05:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe4c600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe440be590 con 0x7fbe44064290 2024-01-22T05:05:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe4c600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe44064740 con 0x7fbe44069ac0 2024-01-22T05:05:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe49200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe440bdd40 0x7fbe44063da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe49c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe44069ac0 0x7fbe440c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe49200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe440bdd40 0x7fbe44063da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53996/0 (socket says 172.21.15.49:53996) 2024-01-22T05:05:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe49200700 1 -- 172.21.15.49:0/1688875842 learned_addr learned my addr 172.21.15.49:0/1688875842 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe4a600700 1 --2- 172.21.15.49:0/1688875842 >> v2:172.21.15.110:3300/0 conn(0x7fbe44064290 0x7fbe440bc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe49200700 1 -- 172.21.15.49:0/1688875842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe44069ac0 msgr2=0x7fbe440c3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe49200700 1 --2- 172.21.15.49:0/1688875842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe44069ac0 0x7fbe440c3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe49200700 1 -- 172.21.15.49:0/1688875842 >> v2:172.21.15.110:3300/0 conn(0x7fbe44064290 msgr2=0x7fbe440bc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe49200700 1 --2- 172.21.15.49:0/1688875842 >> v2:172.21.15.110:3300/0 conn(0x7fbe44064290 0x7fbe440bc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe49200700 1 -- 172.21.15.49:0/1688875842 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe44068d40 con 0x7fbe440bdd40 2024-01-22T05:05:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe49200700 1 --2- 172.21.15.49:0/1688875842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe440bdd40 0x7fbe44063da0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fbe44063400 tx=0x7fbe2c0090f0).ready entity=mon.0 client_cookie=6b0d2fef3158de23 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe43e00700 1 -- 172.21.15.49:0/1688875842 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c00c780 con 0x7fbe440bdd40 2024-01-22T05:05:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe43e00700 1 -- 172.21.15.49:0/1688875842 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c00c8e0 con 0x7fbe440bdd40 2024-01-22T05:05:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.483+0000 7fbe43e00700 1 -- 172.21.15.49:0/1688875842 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c00cc60 con 0x7fbe440bdd40 2024-01-22T05:05:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.487+0000 7fbe4c600700 1 -- 172.21.15.49:0/1688875842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe440bdd40 msgr2=0x7fbe44063da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.487+0000 7fbe4c600700 1 --2- 172.21.15.49:0/1688875842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe440bdd40 0x7fbe44063da0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fbe44063400 tx=0x7fbe2c0090f0).stop 2024-01-22T05:05:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.487+0000 7fbe4c600700 1 -- 172.21.15.49:0/1688875842 shutdown_connections 2024-01-22T05:05:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.487+0000 7fbe4c600700 1 --2- 172.21.15.49:0/1688875842 >> v2:172.21.15.110:3300/0 conn(0x7fbe44064290 0x7fbe440bc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.487+0000 7fbe4c600700 1 --2- 172.21.15.49:0/1688875842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe440bdd40 0x7fbe44063da0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.487+0000 7fbe4c600700 1 --2- 172.21.15.49:0/1688875842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe44069ac0 0x7fbe440c3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.487+0000 7fbe4c600700 1 -- 172.21.15.49:0/1688875842 >> 172.21.15.49:0/1688875842 conn(0x7fbe44062760 msgr2=0x7fbe44062b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:52.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.487+0000 7fbe4c600700 1 -- 172.21.15.49:0/1688875842 shutdown_connections 2024-01-22T05:05:52.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.487+0000 7fbe4c600700 1 -- 172.21.15.49:0/1688875842 wait complete. 2024-01-22T05:05:52.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.487+0000 7fbe4c600700 1 Processor -- start 2024-01-22T05:05:52.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4c600700 1 -- start start 2024-01-22T05:05:52.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4c600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe44064290 0x7fbe4414d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4c600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe44069ac0 0x7fbe440be730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4c600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe440bdd40 0x7fbe440c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4c600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe440bf010 con 0x7fbe440bdd40 2024-01-22T05:05:52.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4c600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe440bf2f0 con 0x7fbe44069ac0 2024-01-22T05:05:52.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4c600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe440bf5d0 con 0x7fbe44064290 2024-01-22T05:05:52.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4a600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe440bdd40 0x7fbe440c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4a600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe440bdd40 0x7fbe440c0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53998/0 (socket says 172.21.15.49:53998) 2024-01-22T05:05:52.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4a600700 1 -- 172.21.15.49:0/2029630901 learned_addr learned my addr 172.21.15.49:0/2029630901 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:52.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe49c00700 1 --2- 172.21.15.49:0/2029630901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe44064290 0x7fbe4414d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe49200700 1 --2- 172.21.15.49:0/2029630901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe44069ac0 0x7fbe440be730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4a600700 1 -- 172.21.15.49:0/2029630901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe44064290 msgr2=0x7fbe4414d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4a600700 1 --2- 172.21.15.49:0/2029630901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe44064290 0x7fbe4414d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4a600700 1 -- 172.21.15.49:0/2029630901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe44069ac0 msgr2=0x7fbe440be730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4a600700 1 --2- 172.21.15.49:0/2029630901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe44069ac0 0x7fbe440be730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4a600700 1 -- 172.21.15.49:0/2029630901 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c00b420 con 0x7fbe440bdd40 2024-01-22T05:05:52.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.491+0000 7fbe4a600700 1 --2- 172.21.15.49:0/2029630901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe440bdd40 0x7fbe440c0f80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fbe3c009e90 tx=0x7fbe3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:52.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.495+0000 7fbe40c00700 1 -- 172.21.15.49:0/2029630901 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00caa0 con 0x7fbe440bdd40 2024-01-22T05:05:52.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.495+0000 7fbe40c00700 1 -- 172.21.15.49:0/2029630901 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c00f040 con 0x7fbe440bdd40 2024-01-22T05:05:52.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.495+0000 7fbe4c600700 1 -- 172.21.15.49:0/2029630901 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe440bf8b0 con 0x7fbe440bdd40 2024-01-22T05:05:52.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.495+0000 7fbe40c00700 1 -- 172.21.15.49:0/2029630901 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00ce10 con 0x7fbe440bdd40 2024-01-22T05:05:52.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.495+0000 7fbe4c600700 1 -- 172.21.15.49:0/2029630901 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe440bec20 con 0x7fbe440bdd40 2024-01-22T05:05:52.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.495+0000 7fbe4c600700 1 -- 172.21.15.49:0/2029630901 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe440c29a0 con 0x7fbe440bdd40 2024-01-22T05:05:52.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.495+0000 7fbe40c00700 1 -- 172.21.15.49:0/2029630901 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbe3c013610 con 0x7fbe440bdd40 2024-01-22T05:05:52.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.499+0000 7fbe40c00700 1 --2- 172.21.15.49:0/2029630901 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe1c05a510 0x7fbe1c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.499+0000 7fbe40c00700 1 -- 172.21.15.49:0/2029630901 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fbe3c075200 con 0x7fbe440bdd40 2024-01-22T05:05:52.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.499+0000 7fbe49c00700 1 --2- 172.21.15.49:0/2029630901 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe1c05a510 0x7fbe1c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.499+0000 7fbe49c00700 1 --2- 172.21.15.49:0/2029630901 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe1c05a510 0x7fbe1c05c9d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fbe34015280 tx=0x7fbe3400f040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:52.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.503+0000 7fbe40c00700 1 -- 172.21.15.49:0/2029630901 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbe440c29a0 con 0x7fbe440bdd40 2024-01-22T05:05:52.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.719+0000 7fbe4c600700 1 -- 172.21.15.49:0/2029630901 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbe440c29a0 con 0x7fbe440bdd40 2024-01-22T05:05:52.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.727+0000 7fbe40c00700 1 -- 172.21.15.49:0/2029630901 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fbe440c29a0 con 0x7fbe440bdd40 2024-01-22T05:05:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.731+0000 7fbe4c600700 1 -- 172.21.15.49:0/2029630901 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe1c05a510 msgr2=0x7fbe1c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.731+0000 7fbe4c600700 1 --2- 172.21.15.49:0/2029630901 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe1c05a510 0x7fbe1c05c9d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fbe34015280 tx=0x7fbe3400f040).stop 2024-01-22T05:05:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.731+0000 7fbe4c600700 1 -- 172.21.15.49:0/2029630901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe440bdd40 msgr2=0x7fbe440c0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.731+0000 7fbe4c600700 1 --2- 172.21.15.49:0/2029630901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe440bdd40 0x7fbe440c0f80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fbe3c009e90 tx=0x7fbe3c00b040).stop 2024-01-22T05:05:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.735+0000 7fbe4c600700 1 -- 172.21.15.49:0/2029630901 shutdown_connections 2024-01-22T05:05:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.735+0000 7fbe4c600700 1 --2- 172.21.15.49:0/2029630901 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe1c05a510 0x7fbe1c05c9d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.735+0000 7fbe4c600700 1 --2- 172.21.15.49:0/2029630901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe440bdd40 0x7fbe440c0f80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.735+0000 7fbe4c600700 1 --2- 172.21.15.49:0/2029630901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe44069ac0 0x7fbe440be730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.735+0000 7fbe4c600700 1 --2- 172.21.15.49:0/2029630901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe44064290 0x7fbe4414d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.735+0000 7fbe4c600700 1 -- 172.21.15.49:0/2029630901 >> 172.21.15.49:0/2029630901 conn(0x7fbe44062760 msgr2=0x7fbe440a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.735+0000 7fbe4c600700 1 -- 172.21.15.49:0/2029630901 shutdown_connections 2024-01-22T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.735+0000 7fbe4c600700 1 -- 172.21.15.49:0/2029630901 wait complete. 2024-01-22T05:05:52.742 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-01-22T05:05:52.763 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:05:52.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.915+0000 7f7b36200700 1 Processor -- start 2024-01-22T05:05:52.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.915+0000 7f7b36200700 1 -- start start 2024-01-22T05:05:52.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.919+0000 7f7b36200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7b30065620 0x7f7b300bd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.919+0000 7f7b36200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b300c2700 con 0x7f7b30065240 2024-01-22T05:05:52.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.919+0000 7f7b36200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b300c29a0 con 0x7f7b30064c00 2024-01-22T05:05:52.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.919+0000 7f7b36200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b300c2c80 con 0x7f7b30065620 2024-01-22T05:05:52.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.919+0000 7f7b2f400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7b30065240 0x7f7b300644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51086/0 (socket says 172.21.15.49:51086) 2024-01-22T05:05:52.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.919+0000 7f7b2f400700 1 -- 172.21.15.49:0/4109580704 learned_addr learned my addr 172.21.15.49:0/4109580704 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:52.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.919+0000 7f7b34c00700 1 --2- 172.21.15.49:0/4109580704 >> v2:172.21.15.49:3300/0 conn(0x7f7b30065620 0x7f7b300bd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.919+0000 7f7b2e000700 1 -- 172.21.15.49:0/4109580704 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333220891 0 0) 0x7f7b300c2700 con 0x7f7b30065240 2024-01-22T05:05:52.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.919+0000 7f7b2e000700 1 -- 172.21.15.49:0/4109580704 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b100033f0 con 0x7f7b30065240 2024-01-22T05:05:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.919+0000 7f7b2e000700 1 -- 172.21.15.49:0/4109580704 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792001155 0 0) 0x7f7b300c29a0 con 0x7f7b30064c00 2024-01-22T05:05:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.919+0000 7f7b2e000700 1 -- 172.21.15.49:0/4109580704 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b300c2700 con 0x7f7b30064c00 2024-01-22T05:05:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.919+0000 7f7b34c00700 1 -- 172.21.15.49:0/4109580704 >> v1:172.21.15.110:6789/0 conn(0x7f7b30064c00 legacy=0x7f7b300bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.923+0000 7f7b34c00700 1 -- 172.21.15.49:0/4109580704 >> v1:172.21.15.49:6789/0 conn(0x7f7b30065240 legacy=0x7f7b300644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.923+0000 7f7b34c00700 1 -- 172.21.15.49:0/4109580704 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b300c2f60 con 0x7f7b30065620 2024-01-22T05:05:52.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.923+0000 7f7b34c00700 1 --2- 172.21.15.49:0/4109580704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b30065620 0x7f7b300bd390 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f7b28009e60 tx=0x7f7b28009780).ready entity=mon.0 client_cookie=35a17a06221f120b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:52.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.923+0000 7f7b2e000700 1 -- 172.21.15.49:0/4109580704 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2800e070 con 0x7f7b30065620 2024-01-22T05:05:52.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.923+0000 7f7b2e000700 1 -- 172.21.15.49:0/4109580704 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2800bab0 con 0x7f7b30065620 2024-01-22T05:05:52.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.923+0000 7f7b2e000700 1 -- 172.21.15.49:0/4109580704 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2800be30 con 0x7f7b30065620 2024-01-22T05:05:52.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.923+0000 7f7b36200700 1 -- 172.21.15.49:0/4109580704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b30065620 msgr2=0x7f7b300bd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.923+0000 7f7b36200700 1 --2- 172.21.15.49:0/4109580704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b30065620 0x7f7b300bd390 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f7b28009e60 tx=0x7f7b28009780).stop 2024-01-22T05:05:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.923+0000 7f7b36200700 1 -- 172.21.15.49:0/4109580704 shutdown_connections 2024-01-22T05:05:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.923+0000 7f7b36200700 1 --2- 172.21.15.49:0/4109580704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b30065620 0x7f7b300bd390 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.923+0000 7f7b36200700 1 -- 172.21.15.49:0/4109580704 >> 172.21.15.49:0/4109580704 conn(0x7f7b300c87f0 msgr2=0x7f7b300c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.923+0000 7f7b36200700 1 -- 172.21.15.49:0/4109580704 shutdown_connections 2024-01-22T05:05:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.923+0000 7f7b36200700 1 -- 172.21.15.49:0/4109580704 wait complete. 2024-01-22T05:05:52.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.927+0000 7f7b36200700 1 Processor -- start 2024-01-22T05:05:52.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.927+0000 7f7b36200700 1 -- start start 2024-01-22T05:05:52.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.927+0000 7f7b36200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b30064c00 0x7f7b301564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.927+0000 7f7b36200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b30065240 0x7f7b300bf790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.927+0000 7f7b36200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b30065620 0x7f7b301593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.927+0000 7f7b36200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b30168710 con 0x7f7b30064c00 2024-01-22T05:05:52.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.927+0000 7f7b36200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300c0140 con 0x7f7b30065620 2024-01-22T05:05:52.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.927+0000 7f7b36200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300c0420 con 0x7f7b30065240 2024-01-22T05:05:52.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.927+0000 7f7b2f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b30064c00 0x7f7b301564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.931+0000 7f7b2f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b30064c00 0x7f7b301564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54012/0 (socket says 172.21.15.49:54012) 2024-01-22T05:05:52.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.931+0000 7f7b2f400700 1 -- 172.21.15.49:0/1429355484 learned_addr learned my addr 172.21.15.49:0/1429355484 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:52.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.931+0000 7f7b34c00700 1 --2- 172.21.15.49:0/1429355484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b30065620 0x7f7b301593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.931+0000 7f7b2ea00700 1 --2- 172.21.15.49:0/1429355484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b30065240 0x7f7b300bf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.931+0000 7f7b2f400700 1 -- 172.21.15.49:0/1429355484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b30065240 msgr2=0x7f7b300bf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.931+0000 7f7b2f400700 1 --2- 172.21.15.49:0/1429355484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b30065240 0x7f7b300bf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.931+0000 7f7b2f400700 1 -- 172.21.15.49:0/1429355484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b30065620 msgr2=0x7f7b301593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:52.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.931+0000 7f7b2f400700 1 --2- 172.21.15.49:0/1429355484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b30065620 0x7f7b301593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:52.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.931+0000 7f7b2f400700 1 -- 172.21.15.49:0/1429355484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b28009a20 con 0x7f7b30064c00 2024-01-22T05:05:52.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.931+0000 7f7b2f400700 1 --2- 172.21.15.49:0/1429355484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b30064c00 0x7f7b301564c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f7b2000c560 tx=0x7f7b20007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:52.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.931+0000 7f7b26a00700 1 -- 172.21.15.49:0/1429355484 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000ce70 con 0x7f7b30064c00 2024-01-22T05:05:52.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.931+0000 7f7b26a00700 1 -- 172.21.15.49:0/1429355484 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b200072e0 con 0x7f7b30064c00 2024-01-22T05:05:52.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.931+0000 7f7b36200700 1 -- 172.21.15.49:0/1429355484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b300c0700 con 0x7f7b30064c00 2024-01-22T05:05:52.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.931+0000 7f7b26a00700 1 -- 172.21.15.49:0/1429355484 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20007660 con 0x7f7b30064c00 2024-01-22T05:05:52.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.931+0000 7f7b36200700 1 -- 172.21.15.49:0/1429355484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b300c12d0 con 0x7f7b30064c00 2024-01-22T05:05:52.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.935+0000 7f7b36200700 1 -- 172.21.15.49:0/1429355484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b301684d0 con 0x7f7b30064c00 2024-01-22T05:05:52.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.935+0000 7f7b26a00700 1 -- 172.21.15.49:0/1429355484 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7b200059b0 con 0x7f7b30064c00 2024-01-22T05:05:52.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.935+0000 7f7b26a00700 1 --2- 172.21.15.49:0/1429355484 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7b0805a510 0x7f7b0805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:52.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.935+0000 7f7b26a00700 1 -- 172.21.15.49:0/1429355484 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7b20073f30 con 0x7f7b30064c00 2024-01-22T05:05:52.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.935+0000 7f7b2ea00700 1 --2- 172.21.15.49:0/1429355484 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7b0805a510 0x7f7b0805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:52.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.939+0000 7f7b2ea00700 1 --2- 172.21.15.49:0/1429355484 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7b0805a510 0x7f7b0805c9d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f7b3016b7e0 tx=0x7f7b18007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:52.943+0000 7f7b26a00700 1 -- 172.21.15.49:0/1429355484 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7b200475b0 con 0x7f7b30064c00 2024-01-22T05:05:53.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.139+0000 7f7b36200700 1 -- 172.21.15.49:0/1429355484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b30047060 con 0x7f7b30064c00 2024-01-22T05:05:53.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.143+0000 7f7b26a00700 1 -- 172.21.15.49:0/1429355484 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f7b2004abd0 con 0x7f7b30064c00 2024-01-22T05:05:53.146 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:05:53.146 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4066204164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":4066204164},{"type":"v1","addr":"172.21.15.110:6835","nonce":4066204164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/3793850760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3793850760},{"type":"v1","addr":"172.21.15.110:6834","nonce":3793850760}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/331321155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":331321155},{"type":"v1","addr":"172.21.15.49:6837","nonce":331321155}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:05:42.747172+0000","modified":"2024-01-22T05:05:45.769072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6836/3211151680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3211151680},{"type":"v1","addr":"172.21.15.49:6836","nonce":3211151680}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-22T05:05:53.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.147+0000 7f7b36200700 1 -- 172.21.15.49:0/1429355484 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7b0805a510 msgr2=0x7f7b0805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:53.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.147+0000 7f7b36200700 1 --2- 172.21.15.49:0/1429355484 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7b0805a510 0x7f7b0805c9d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f7b3016b7e0 tx=0x7f7b18007bd0).stop 2024-01-22T05:05:53.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.147+0000 7f7b36200700 1 -- 172.21.15.49:0/1429355484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b30064c00 msgr2=0x7f7b301564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:53.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.147+0000 7f7b36200700 1 --2- 172.21.15.49:0/1429355484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b30064c00 0x7f7b301564c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f7b2000c560 tx=0x7f7b20007d00).stop 2024-01-22T05:05:53.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.147+0000 7f7b36200700 1 -- 172.21.15.49:0/1429355484 shutdown_connections 2024-01-22T05:05:53.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.147+0000 7f7b36200700 1 --2- 172.21.15.49:0/1429355484 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7b0805a510 0x7f7b0805c9d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.147+0000 7f7b36200700 1 --2- 172.21.15.49:0/1429355484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b30065620 0x7f7b301593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.147+0000 7f7b36200700 1 --2- 172.21.15.49:0/1429355484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b30065240 0x7f7b300bf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.147+0000 7f7b36200700 1 --2- 172.21.15.49:0/1429355484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b30064c00 0x7f7b301564c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.147+0000 7f7b36200700 1 -- 172.21.15.49:0/1429355484 >> 172.21.15.49:0/1429355484 conn(0x7f7b300c87f0 msgr2=0x7f7b30062230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:53.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.147+0000 7f7b36200700 1 -- 172.21.15.49:0/1429355484 shutdown_connections 2024-01-22T05:05:53.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.147+0000 7f7b36200700 1 -- 172.21.15.49:0/1429355484 wait complete. 2024-01-22T05:05:53.155 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 17 2024-01-22T05:05:53.577 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:05:42.747172+0000', 'modified': '2024-01-22T05:05:45.769072+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5121}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5121': {'gid': 5121, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.49:6836/3211151680', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 3211151680}, {'type': 'v1', 'addr': '172.21.15.49:6836', 'nonce': 3211151680}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:05:53.577 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:05:53.578 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-22T05:05:53.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.739+0000 7f8ddd200700 1 Processor -- start 2024-01-22T05:05:53.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.739+0000 7f8ddd200700 1 -- start start 2024-01-22T05:05:53.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.739+0000 7f8ddd200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8dd8157740 0x7f8dd8153900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.739+0000 7f8ddd200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8dd8153df0 0x7f8dd80c1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8ddd200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd8063d50 con 0x7f8dd80c1d80 2024-01-22T05:05:53.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8ddd200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd80bbd00 con 0x7f8dd8153df0 2024-01-22T05:05:53.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8ddd200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd80bbfe0 con 0x7f8dd8157740 2024-01-22T05:05:53.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8dd6a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8dd8153df0 0x7f8dd80c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8dd7e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8dd80c1d80 0x7f8dd8068aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56816/0 (socket says 172.21.15.49:56816) 2024-01-22T05:05:53.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8dd7e00700 1 -- 172.21.15.49:0/3191311316 learned_addr learned my addr 172.21.15.49:0/3191311316 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:53.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8dd7400700 1 --2- 172.21.15.49:0/3191311316 >> v2:172.21.15.110:3300/0 conn(0x7f8dd8157740 0x7f8dd8153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8dd6000700 1 -- 172.21.15.49:0/3191311316 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703460160 0 0) 0x7f8dd8063d50 con 0x7f8dd80c1d80 2024-01-22T05:05:53.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8dd6a00700 1 -- 172.21.15.49:0/3191311316 >> v2:172.21.15.110:3300/0 conn(0x7f8dd8157740 msgr2=0x7f8dd8153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:53.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8dd6a00700 1 --2- 172.21.15.49:0/3191311316 >> v2:172.21.15.110:3300/0 conn(0x7f8dd8157740 0x7f8dd8153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8dd6a00700 1 -- 172.21.15.49:0/3191311316 >> v1:172.21.15.49:6789/0 conn(0x7f8dd80c1d80 legacy=0x7f8dd8068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:53.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8dd6a00700 1 -- 172.21.15.49:0/3191311316 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd8157f00 con 0x7f8dd8153df0 2024-01-22T05:05:53.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8dd6a00700 1 --2- 172.21.15.49:0/3191311316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dd8153df0 0x7f8dd80c1890 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f8dd8060300 tx=0x7f8dc0009060).ready entity=mon.0 client_cookie=4facd11176f1bbe2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:53.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8dd6000700 1 -- 172.21.15.49:0/3191311316 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc000f510 con 0x7f8dd8153df0 2024-01-22T05:05:53.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8dd6000700 1 -- 172.21.15.49:0/3191311316 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc000f670 con 0x7f8dd8153df0 2024-01-22T05:05:53.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8dd6000700 1 -- 172.21.15.49:0/3191311316 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc000f9f0 con 0x7f8dd8153df0 2024-01-22T05:05:53.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8ddd200700 1 -- 172.21.15.49:0/3191311316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dd8153df0 msgr2=0x7f8dd80c1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:53.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.743+0000 7f8ddd200700 1 --2- 172.21.15.49:0/3191311316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dd8153df0 0x7f8dd80c1890 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f8dd8060300 tx=0x7f8dc0009060).stop 2024-01-22T05:05:53.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.747+0000 7f8ddd200700 1 -- 172.21.15.49:0/3191311316 shutdown_connections 2024-01-22T05:05:53.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.747+0000 7f8ddd200700 1 --2- 172.21.15.49:0/3191311316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dd8153df0 0x7f8dd80c1890 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.747+0000 7f8ddd200700 1 --2- 172.21.15.49:0/3191311316 >> v2:172.21.15.110:3300/0 conn(0x7f8dd8157740 0x7f8dd8153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.747+0000 7f8ddd200700 1 -- 172.21.15.49:0/3191311316 >> 172.21.15.49:0/3191311316 conn(0x7f8dd80c42a0 msgr2=0x7f8dd8065f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:53.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.747+0000 7f8ddd200700 1 -- 172.21.15.49:0/3191311316 shutdown_connections 2024-01-22T05:05:53.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.747+0000 7f8ddd200700 1 -- 172.21.15.49:0/3191311316 wait complete. 2024-01-22T05:05:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.747+0000 7f8ddd200700 1 Processor -- start 2024-01-22T05:05:53.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.747+0000 7f8ddd200700 1 -- start start 2024-01-22T05:05:53.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8ddd200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dd80c1d80 0x7f8dd80a9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8ddd200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dd8153df0 0x7f8dd80a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8ddd200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dd8157740 0x7f8dd8065da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8ddd200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd80a4190 con 0x7f8dd80c1d80 2024-01-22T05:05:53.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8ddd200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd80a4470 con 0x7f8dd8157740 2024-01-22T05:05:53.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8ddd200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd80a4750 con 0x7f8dd8153df0 2024-01-22T05:05:53.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8dd7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dd80c1d80 0x7f8dd80a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8dd7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dd80c1d80 0x7f8dd80a9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34280/0 (socket says 172.21.15.49:34280) 2024-01-22T05:05:53.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8dd7400700 1 -- 172.21.15.49:0/2375101719 learned_addr learned my addr 172.21.15.49:0/2375101719 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8dd6a00700 1 --2- 172.21.15.49:0/2375101719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dd8153df0 0x7f8dd80a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8dd7e00700 1 --2- 172.21.15.49:0/2375101719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dd8157740 0x7f8dd8065da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8dd7400700 1 -- 172.21.15.49:0/2375101719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dd8153df0 msgr2=0x7f8dd80a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8dd7400700 1 --2- 172.21.15.49:0/2375101719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dd8153df0 0x7f8dd80a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8dd7400700 1 -- 172.21.15.49:0/2375101719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dd8157740 msgr2=0x7f8dd8065da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8dd7400700 1 --2- 172.21.15.49:0/2375101719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dd8157740 0x7f8dd8065da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8dd7400700 1 -- 172.21.15.49:0/2375101719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc00092a0 con 0x7f8dd80c1d80 2024-01-22T05:05:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8dd7400700 1 --2- 172.21.15.49:0/2375101719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dd80c1d80 0x7f8dd80a9350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f8dc800e900 tx=0x7f8dc8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8dcea00700 1 -- 172.21.15.49:0/2375101719 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8009390 con 0x7f8dd80c1d80 2024-01-22T05:05:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8dcea00700 1 -- 172.21.15.49:0/2375101719 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc800c640 con 0x7f8dd80c1d80 2024-01-22T05:05:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8ddd200700 1 -- 172.21.15.49:0/2375101719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd80a4a30 con 0x7f8dd80c1d80 2024-01-22T05:05:53.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8dcea00700 1 -- 172.21.15.49:0/2375101719 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800c9c0 con 0x7f8dd80c1d80 2024-01-22T05:05:53.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.751+0000 7f8ddd200700 1 -- 172.21.15.49:0/2375101719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd80a7290 con 0x7f8dd80c1d80 2024-01-22T05:05:53.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.755+0000 7f8dcea00700 1 -- 172.21.15.49:0/2375101719 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8dc801b400 con 0x7f8dd80c1d80 2024-01-22T05:05:53.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.759+0000 7f8dcea00700 1 --2- 172.21.15.49:0/2375101719 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8db005a510 0x7f8db005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.759+0000 7f8dcea00700 1 -- 172.21.15.49:0/2375101719 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f8dc8074d50 con 0x7f8dd80c1d80 2024-01-22T05:05:53.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.759+0000 7f8dd6a00700 1 --2- 172.21.15.49:0/2375101719 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8db005a510 0x7f8db005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.759+0000 7f8dd6a00700 1 --2- 172.21.15.49:0/2375101719 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8db005a510 0x7f8db005c9d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f8dd8154230 tx=0x7f8dc0017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:53.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.759+0000 7f8de8d79740 1 Processor -- start 2024-01-22T05:05:53.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.759+0000 7f8de8d79740 1 -- start start 2024-01-22T05:05:53.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8de8d79740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 0x1a45d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8de8d79740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a20e40 0x1a1caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8de8d79740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a61780 0x1a1a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8de8d79740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x19a0410 con 0x1a20e40 2024-01-22T05:05:53.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8de8d79740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x19a0550 con 0x1a61780 2024-01-22T05:05:53.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8de8d79740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x19a0a00 con 0x1a613a0 2024-01-22T05:05:53.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8dd6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a20e40 0x1a1caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8dd6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a20e40 0x1a1caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34284/0 (socket says 172.21.15.49:34284) 2024-01-22T05:05:53.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8dd6a00700 1 -- 172.21.15.49:0/2700908424 learned_addr learned my addr 172.21.15.49:0/2700908424 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:53.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8dd7400700 1 --2- 172.21.15.49:0/2700908424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 0x1a45d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8dd7e00700 1 --2- 172.21.15.49:0/2700908424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a61780 0x1a1a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8dd6a00700 1 -- 172.21.15.49:0/2700908424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 msgr2=0x1a45d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:53.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8dd6a00700 1 --2- 172.21.15.49:0/2700908424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 0x1a45d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8dd6a00700 1 -- 172.21.15.49:0/2700908424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a61780 msgr2=0x1a1a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:53.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8dd6a00700 1 --2- 172.21.15.49:0/2700908424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a61780 0x1a1a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8dd6a00700 1 -- 172.21.15.49:0/2700908424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1999730 con 0x1a20e40 2024-01-22T05:05:53.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8dd6a00700 1 --2- 172.21.15.49:0/2700908424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a20e40 0x1a1caf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f8dd80653a0 tx=0x7f8dc001d040).ready entity=mon.0 client_cookie=82f5043cbc0080dc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:53.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8dc7400700 1 -- 172.21.15.49:0/2700908424 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc001b870 con 0x1a20e40 2024-01-22T05:05:53.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8dc7400700 1 -- 172.21.15.49:0/2700908424 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc001b9d0 con 0x1a20e40 2024-01-22T05:05:53.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8dc7400700 1 -- 172.21.15.49:0/2700908424 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc001bd50 con 0x1a20e40 2024-01-22T05:05:53.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8de8d79740 1 -- 172.21.15.49:0/2700908424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a20e40 msgr2=0x1a1caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:53.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.763+0000 7f8de8d79740 1 --2- 172.21.15.49:0/2700908424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a20e40 0x1a1caf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f8dd80653a0 tx=0x7f8dc001d040).stop 2024-01-22T05:05:53.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.767+0000 7f8de8d79740 1 -- 172.21.15.49:0/2700908424 shutdown_connections 2024-01-22T05:05:53.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.767+0000 7f8de8d79740 1 --2- 172.21.15.49:0/2700908424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a61780 0x1a1a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.767+0000 7f8de8d79740 1 --2- 172.21.15.49:0/2700908424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a20e40 0x1a1caf0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.767+0000 7f8de8d79740 1 --2- 172.21.15.49:0/2700908424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 0x1a45d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.767+0000 7f8de8d79740 1 -- 172.21.15.49:0/2700908424 >> 172.21.15.49:0/2700908424 conn(0x17fe550 msgr2=0x1a20730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:53.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.767+0000 7f8de8d79740 1 -- 172.21.15.49:0/2700908424 shutdown_connections 2024-01-22T05:05:53.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.767+0000 7f8de8d79740 1 -- 172.21.15.49:0/2700908424 wait complete. 2024-01-22T05:05:53.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.767+0000 7f8de8d79740 1 -- start start 2024-01-22T05:05:53.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.767+0000 7f8de8d79740 1 Processor -- start 2024-01-22T05:05:53.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8de8d79740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a20e40 0x1a405a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8de8d79740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a613a0 0x1a646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8de8d79740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a61780 0x1a1d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8de8d79740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x196b650 con 0x1a613a0 2024-01-22T05:05:53.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8de8d79740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a65e20 con 0x1a20e40 2024-01-22T05:05:53.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8de8d79740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a72820 con 0x1a61780 2024-01-22T05:05:53.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8de8d79740 10 client.0 ll_register_callbacks cb 0x19d8020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:05:53.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8dd6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a613a0 0x1a646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8dd6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a613a0 0x1a646d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34286/0 (socket says 172.21.15.49:34286) 2024-01-22T05:05:53.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8dd6a00700 1 -- 172.21.15.49:0/3363447411 learned_addr learned my addr 172.21.15.49:0/3363447411 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:53.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8dd7400700 1 --2- 172.21.15.49:0/3363447411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a20e40 0x1a405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8dd7e00700 1 --2- 172.21.15.49:0/3363447411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a61780 0x1a1d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8dd6a00700 1 -- 172.21.15.49:0/3363447411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a61780 msgr2=0x1a1d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:53.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8dd6a00700 1 --2- 172.21.15.49:0/3363447411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a61780 0x1a1d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8dd6a00700 1 -- 172.21.15.49:0/3363447411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a20e40 msgr2=0x1a405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:53.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8dd6a00700 1 --2- 172.21.15.49:0/3363447411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a20e40 0x1a405a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8dd6a00700 1 -- 172.21.15.49:0/3363447411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd8157f00 con 0x1a613a0 2024-01-22T05:05:53.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8dd6a00700 1 --2- 172.21.15.49:0/3363447411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a613a0 0x1a646d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f8dc000ff90 tx=0x7f8dc0026000).ready entity=mon.0 client_cookie=32676aecfd9ce682 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:53.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8dbfe00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:05:53.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8dbfe00700 1 -- 172.21.15.49:0/3363447411 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0025820 con 0x1a613a0 2024-01-22T05:05:53.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8dbfe00700 1 -- 172.21.15.49:0/3363447411 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f8dc0025980 con 0x1a613a0 2024-01-22T05:05:53.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8de8d79740 1 -- 172.21.15.49:0/3363447411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x19961a0 con 0x1a613a0 2024-01-22T05:05:53.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8dbfe00700 1 -- 172.21.15.49:0/3363447411 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8dc0025d50 con 0x1a613a0 2024-01-22T05:05:53.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8de8d79740 10 client.5316 fetch_fsmap learned FSMap version 17 2024-01-22T05:05:53.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.771+0000 7f8de8d79740 1 -- 172.21.15.49:0/3363447411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x1994960 con 0x1a613a0 2024-01-22T05:05:53.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8dbfe00700 1 -- 172.21.15.49:0/3363447411 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x19961a0 con 0x1a613a0 2024-01-22T05:05:53.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8dbfe00700 1 -- 172.21.15.49:0/3363447411 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8dc002e450 con 0x1a613a0 2024-01-22T05:05:53.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8de8d79740 10 client.5316 fetch_fsmap finished waiting for FSMap version 17 2024-01-22T05:05:53.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8de8d79740 10 client.5316 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-22T05:05:53.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8de8d79740 20 client.5316 populate_metadata read hostname 'smithi049' 2024-01-22T05:05:53.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8de8d79740 1 --2- 172.21.15.49:0/3363447411 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1a74d10 0x1a750f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8de8d79740 4 client.5316 mds_command: new command op to 5121 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:05:53.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8de8d79740 1 -- 172.21.15.49:0/3363447411 --> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x198c6f0 con 0x1a74d10 2024-01-22T05:05:53.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8dd7400700 1 --2- 172.21.15.49:0/3363447411 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1a74d10 0x1a750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8dd7400700 1 --2- 172.21.15.49:0/3363447411 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1a74d10 0x1a750f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e9f9b40ae9536e51 server_cookie=3c4ac31f2f7646c0 in_seq=0 out_seq=0 2024-01-22T05:05:53.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8dbfe00700 10 client.5316 ms_handle_connect on v2:172.21.15.49:6834/3211151680 2024-01-22T05:05:53.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8dbfe00700 1 -- 172.21.15.49:0/3363447411 <== mds.0 v2:172.21.15.49:6834/3211151680 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x198c6f0 con 0x1a74d10 2024-01-22T05:05:53.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8dbfe00700 10 client.5316 handle_command_reply: tid=0 2024-01-22T05:05:53.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8de8d79740 1 client.5316 shutdown 2024-01-22T05:05:53.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8de8d79740 1 -- 172.21.15.49:0/3363447411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a613a0 msgr2=0x1a646d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:53.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8de8d79740 1 --2- 172.21.15.49:0/3363447411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a613a0 0x1a646d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f8dc000ff90 tx=0x7f8dc0026000).stop 2024-01-22T05:05:53.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8de8d79740 1 -- 172.21.15.49:0/3363447411 shutdown_connections 2024-01-22T05:05:53.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8de8d79740 1 --2- 172.21.15.49:0/3363447411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a61780 0x1a1d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.775+0000 7f8de8d79740 1 --2- 172.21.15.49:0/3363447411 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1a74d10 0x1a750f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.779+0000 7f8de8d79740 1 --2- 172.21.15.49:0/3363447411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a613a0 0x1a646d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.779+0000 7f8de8d79740 1 --2- 172.21.15.49:0/3363447411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a20e40 0x1a405a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.779+0000 7f8de8d79740 1 -- 172.21.15.49:0/3363447411 >> 172.21.15.49:0/3363447411 conn(0x17fe550 msgr2=0x1a20730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:53.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.779+0000 7f8dbfe00700 0 client.5316 ms_handle_reset on v2:172.21.15.49:6834/3211151680 2024-01-22T05:05:53.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.779+0000 7f8de8d79740 1 -- 172.21.15.49:0/3363447411 shutdown_connections 2024-01-22T05:05:53.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.779+0000 7f8de8d79740 1 -- 172.21.15.49:0/3363447411 wait complete. 2024-01-22T05:05:53.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.779+0000 7f8de8d79740 20 client.5316 trim_cache size 0 max 16384 2024-01-22T05:05:53.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8de8d79740 1 Processor -- start 2024-01-22T05:05:53.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8de8d79740 1 -- start start 2024-01-22T05:05:53.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8de8d79740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a20e40 0x1a66030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8de8d79740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 0x1a66f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8de8d79740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a61780 0x1a1fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8de8d79740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x196fc50 con 0x1a20e40 2024-01-22T05:05:53.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8de8d79740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a212b0 con 0x1a61780 2024-01-22T05:05:53.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8de8d79740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1916eb0 con 0x1a613a0 2024-01-22T05:05:53.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dd7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a20e40 0x1a66030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dd7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a20e40 0x1a66030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34296/0 (socket says 172.21.15.49:34296) 2024-01-22T05:05:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dd7400700 1 -- 172.21.15.49:0/194586089 learned_addr learned my addr 172.21.15.49:0/194586089 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dd7e00700 1 --2- 172.21.15.49:0/194586089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a61780 0x1a1fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dd6a00700 1 --2- 172.21.15.49:0/194586089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 0x1a66f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dd7400700 1 -- 172.21.15.49:0/194586089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 msgr2=0x1a66f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dd7400700 1 --2- 172.21.15.49:0/194586089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 0x1a66f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dd7400700 1 -- 172.21.15.49:0/194586089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a61780 msgr2=0x1a1fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dd7400700 1 --2- 172.21.15.49:0/194586089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a61780 0x1a1fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dd7400700 1 -- 172.21.15.49:0/194586089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a1ce50 con 0x1a20e40 2024-01-22T05:05:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dd7e00700 1 --2- 172.21.15.49:0/194586089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a61780 0x1a1fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dd6a00700 1 --2- 172.21.15.49:0/194586089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 0x1a66f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:05:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dd7400700 1 --2- 172.21.15.49:0/194586089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a20e40 0x1a66030 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f8dc8048520 tx=0x7f8dc804d040).ready entity=mon.0 client_cookie=a808e0e21da760e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:53.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dc7e00700 1 -- 172.21.15.49:0/194586089 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8050030 con 0x1a20e40 2024-01-22T05:05:53.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dc7e00700 1 -- 172.21.15.49:0/194586089 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc8051040 con 0x1a20e40 2024-01-22T05:05:53.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.799+0000 7f8dc7e00700 1 -- 172.21.15.49:0/194586089 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8072c80 con 0x1a20e40 2024-01-22T05:05:53.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.803+0000 7f8de8d79740 1 -- 172.21.15.49:0/194586089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a20e40 msgr2=0x1a66030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:53.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.803+0000 7f8de8d79740 1 --2- 172.21.15.49:0/194586089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a20e40 0x1a66030 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f8dc8048520 tx=0x7f8dc804d040).stop 2024-01-22T05:05:53.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.803+0000 7f8de8d79740 1 -- 172.21.15.49:0/194586089 shutdown_connections 2024-01-22T05:05:53.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.803+0000 7f8de8d79740 1 --2- 172.21.15.49:0/194586089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a61780 0x1a1fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.803+0000 7f8de8d79740 1 --2- 172.21.15.49:0/194586089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 0x1a66f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.803+0000 7f8de8d79740 1 --2- 172.21.15.49:0/194586089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a20e40 0x1a66030 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.803+0000 7f8de8d79740 1 -- 172.21.15.49:0/194586089 >> 172.21.15.49:0/194586089 conn(0x17fe550 msgr2=0x1a20730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:53.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.803+0000 7f8de8d79740 1 -- 172.21.15.49:0/194586089 shutdown_connections 2024-01-22T05:05:53.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.803+0000 7f8de8d79740 1 -- 172.21.15.49:0/194586089 wait complete. 2024-01-22T05:05:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.803+0000 7f8de8d79740 1 -- start start 2024-01-22T05:05:53.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.803+0000 7f8de8d79740 1 Processor -- start 2024-01-22T05:05:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8de8d79740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a20e40 0x1ac1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8de8d79740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 0x1a416e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8de8d79740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a61780 0x1a1e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8de8d79740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a49ae0 con 0x1a61780 2024-01-22T05:05:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8de8d79740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a41bd0 con 0x1a20e40 2024-01-22T05:05:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8de8d79740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a498c0 con 0x1a613a0 2024-01-22T05:05:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8de8d79740 10 client.0 ll_register_callbacks cb 0x7f8dc001bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:05:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8dd7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a61780 0x1a1e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8dd7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a61780 0x1a1e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34302/0 (socket says 172.21.15.49:34302) 2024-01-22T05:05:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8dd7e00700 1 -- 172.21.15.49:0/1397254276 learned_addr learned my addr 172.21.15.49:0/1397254276 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8dd7400700 1 --2- 172.21.15.49:0/1397254276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a20e40 0x1ac1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8dd6a00700 1 --2- 172.21.15.49:0/1397254276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 0x1a416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8dd7e00700 1 -- 172.21.15.49:0/1397254276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 msgr2=0x1a416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:53.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8dd7e00700 1 --2- 172.21.15.49:0/1397254276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 0x1a416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8dd7e00700 1 -- 172.21.15.49:0/1397254276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a20e40 msgr2=0x1ac1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:53.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8dd7e00700 1 --2- 172.21.15.49:0/1397254276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a20e40 0x1ac1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.807+0000 7f8dd7e00700 1 -- 172.21.15.49:0/1397254276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd80a7290 con 0x1a61780 2024-01-22T05:05:53.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8dd7e00700 1 --2- 172.21.15.49:0/1397254276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a61780 0x1a1e220 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f8dd0005ad0 tx=0x7f8dd0009040).ready entity=mon.0 client_cookie=f53a06ec9454d38a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:53.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8dbfe00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:05:53.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8dbfe00700 1 -- 172.21.15.49:0/1397254276 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0005c00 con 0x1a61780 2024-01-22T05:05:53.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8dbfe00700 1 -- 172.21.15.49:0/1397254276 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f8dd0017430 con 0x1a61780 2024-01-22T05:05:53.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8de8d79740 1 -- 172.21.15.49:0/1397254276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8dc001b9d0 con 0x1a61780 2024-01-22T05:05:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8dbfe00700 1 -- 172.21.15.49:0/1397254276 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8dd0017840 con 0x1a61780 2024-01-22T05:05:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8de8d79740 10 client.5322 fetch_fsmap learned FSMap version 17 2024-01-22T05:05:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8de8d79740 1 -- 172.21.15.49:0/1397254276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f8dd80665f0 con 0x1a61780 2024-01-22T05:05:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8dbfe00700 1 -- 172.21.15.49:0/1397254276 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc001b9d0 con 0x1a61780 2024-01-22T05:05:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8dbfe00700 1 -- 172.21.15.49:0/1397254276 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8dd00179a0 con 0x1a61780 2024-01-22T05:05:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8de8d79740 10 client.5322 fetch_fsmap finished waiting for FSMap version 17 2024-01-22T05:05:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8de8d79740 10 client.5322 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-22T05:05:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8de8d79740 20 client.5322 populate_metadata read hostname 'smithi049' 2024-01-22T05:05:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8de8d79740 1 --2- 172.21.15.49:0/1397254276 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1ac7e10 0x1ac81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8de8d79740 4 client.5322 mds_command: new command op to 5121 tid=0[{"prefix": "status"}] 2024-01-22T05:05:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8de8d79740 1 -- 172.21.15.49:0/1397254276 --> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] -- command(tid 0: {"prefix": "status"}) v1 -- 0x18554e0 con 0x1ac7e10 2024-01-22T05:05:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8dd7400700 1 --2- 172.21.15.49:0/1397254276 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1ac7e10 0x1ac81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8dbfe00700 10 client.5322 ms_handle_connect on v2:172.21.15.49:6834/3211151680 2024-01-22T05:05:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8dd7400700 1 --2- 172.21.15.49:0/1397254276 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1ac7e10 0x1ac81f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e8a2807b66bc16f6 server_cookie=b043532d670915a5 in_seq=0 out_seq=0 2024-01-22T05:05:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8dbfe00700 1 -- 172.21.15.49:0/1397254276 <== mds.0 v2:172.21.15.49:6834/3211151680 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x18554e0 con 0x1ac7e10 2024-01-22T05:05:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8dbfe00700 10 client.5322 handle_command_reply: tid=0 2024-01-22T05:05:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.811+0000 7f8de8d79740 1 client.5322 shutdown 2024-01-22T05:05:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8de8d79740 1 -- 172.21.15.49:0/1397254276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a61780 msgr2=0x1a1e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8de8d79740 1 --2- 172.21.15.49:0/1397254276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a61780 0x1a1e220 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f8dd0005ad0 tx=0x7f8dd0009040).stop 2024-01-22T05:05:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8de8d79740 1 -- 172.21.15.49:0/1397254276 shutdown_connections 2024-01-22T05:05:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8de8d79740 1 --2- 172.21.15.49:0/1397254276 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1ac7e10 0x1ac81f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8de8d79740 1 --2- 172.21.15.49:0/1397254276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1a61780 0x1a1e220 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8de8d79740 1 --2- 172.21.15.49:0/1397254276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1a613a0 0x1a416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8de8d79740 1 --2- 172.21.15.49:0/1397254276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1a20e40 0x1ac1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8de8d79740 1 -- 172.21.15.49:0/1397254276 >> 172.21.15.49:0/1397254276 conn(0x17fe550 msgr2=0x1a42160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8dbfe00700 0 client.5322 ms_handle_reset on v2:172.21.15.49:6834/3211151680 2024-01-22T05:05:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8de8d79740 1 -- 172.21.15.49:0/1397254276 shutdown_connections 2024-01-22T05:05:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8de8d79740 1 -- 172.21.15.49:0/1397254276 wait complete. 2024-01-22T05:05:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8de8d79740 20 client.5322 trim_cache size 0 max 16384 2024-01-22T05:05:53.820 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:05:53.820 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:05:53.820 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:05:53.820 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5121, 2024-01-22T05:05:53.820 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:05:53.820 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:05:53.820 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:05:53.821 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 11.063409423, 2024-01-22T05:05:53.821 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 17, 2024-01-22T05:05:53.821 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 40, 2024-01-22T05:05:53.821 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 40, 2024-01-22T05:05:53.821 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 19.330187663 2024-01-22T05:05:53.821 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:05:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8ddd200700 1 -- 172.21.15.49:0/2375101719 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8db005a510 msgr2=0x7f8db005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8ddd200700 1 --2- 172.21.15.49:0/2375101719 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8db005a510 0x7f8db005c9d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f8dd8154230 tx=0x7f8dc0017000).stop 2024-01-22T05:05:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8ddd200700 1 -- 172.21.15.49:0/2375101719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dd80c1d80 msgr2=0x7f8dd80a9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8ddd200700 1 --2- 172.21.15.49:0/2375101719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dd80c1d80 0x7f8dd80a9350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f8dc800e900 tx=0x7f8dc8009060).stop 2024-01-22T05:05:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8ddd200700 1 -- 172.21.15.49:0/2375101719 shutdown_connections 2024-01-22T05:05:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8ddd200700 1 --2- 172.21.15.49:0/2375101719 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8db005a510 0x7f8db005c9d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8ddd200700 1 --2- 172.21.15.49:0/2375101719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dd8157740 0x7f8dd8065da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8ddd200700 1 --2- 172.21.15.49:0/2375101719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dd8153df0 0x7f8dd80a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8ddd200700 1 --2- 172.21.15.49:0/2375101719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dd80c1d80 0x7f8dd80a9350 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.815+0000 7f8ddd200700 1 -- 172.21.15.49:0/2375101719 >> 172.21.15.49:0/2375101719 conn(0x7f8dd80c42a0 msgr2=0x7f8dd8152330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.819+0000 7f8ddd200700 1 -- 172.21.15.49:0/2375101719 shutdown_connections 2024-01-22T05:05:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.819+0000 7f8ddd200700 1 -- 172.21.15.49:0/2375101719 wait complete. 2024-01-22T05:05:53.846 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:05:53.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.983+0000 7fb7e9c00700 1 Processor -- start 2024-01-22T05:05:53.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.983+0000 7fb7e9c00700 1 -- start start 2024-01-22T05:05:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.987+0000 7fb7e9c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb7e4063870 0x7fb7e4153800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.987+0000 7fb7e9c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb7e4153cf0 0x7fb7e40c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.987+0000 7fb7e9c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e4062fc0 con 0x7fb7e40c2090 2024-01-22T05:05:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.987+0000 7fb7e9c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e40c24e0 con 0x7fb7e4153cf0 2024-01-22T05:05:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.987+0000 7fb7e9c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e40623b0 con 0x7fb7e4063870 2024-01-22T05:05:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.987+0000 7fb7e3400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb7e40c2090 0x7fb7e4157730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56820/0 (socket says 172.21.15.49:56820) 2024-01-22T05:05:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.987+0000 7fb7e3400700 1 -- 172.21.15.49:0/4206048310 learned_addr learned my addr 172.21.15.49:0/4206048310 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.987+0000 7fb7e2000700 1 --2- 172.21.15.49:0/4206048310 >> v2:172.21.15.49:3300/0 conn(0x7fb7e4153cf0 0x7fb7e40c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.987+0000 7fb7e2a00700 1 --2- 172.21.15.49:0/4206048310 >> v2:172.21.15.110:3300/0 conn(0x7fb7e4063870 0x7fb7e4153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.987+0000 7fb7e1600700 1 -- 172.21.15.49:0/4206048310 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210717027 0 0) 0x7fb7e4062fc0 con 0x7fb7e40c2090 2024-01-22T05:05:53.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.987+0000 7fb7e1600700 1 -- 172.21.15.49:0/4206048310 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7c40033f0 con 0x7fb7e40c2090 2024-01-22T05:05:53.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e2000700 1 -- 172.21.15.49:0/4206048310 >> v2:172.21.15.110:3300/0 conn(0x7fb7e4063870 msgr2=0x7fb7e4153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:05:53.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e2000700 1 --2- 172.21.15.49:0/4206048310 >> v2:172.21.15.110:3300/0 conn(0x7fb7e4063870 0x7fb7e4153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e2000700 1 -- 172.21.15.49:0/4206048310 >> v1:172.21.15.49:6789/0 conn(0x7fb7e40c2090 legacy=0x7fb7e4157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:53.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e2000700 1 -- 172.21.15.49:0/4206048310 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e4062690 con 0x7fb7e4153cf0 2024-01-22T05:05:53.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e2a00700 1 --2- 172.21.15.49:0/4206048310 >> v2:172.21.15.110:3300/0 conn(0x7fb7e4063870 0x7fb7e4153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:05:53.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e2000700 1 --2- 172.21.15.49:0/4206048310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e4153cf0 0x7fb7e40c1ba0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fb7e4067b80 tx=0x7fb7cc009060).ready entity=mon.0 client_cookie=d30a2acb34d9ea4a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:53.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e1600700 1 -- 172.21.15.49:0/4206048310 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc00d4a0 con 0x7fb7e4153cf0 2024-01-22T05:05:53.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e1600700 1 -- 172.21.15.49:0/4206048310 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc00d600 con 0x7fb7e4153cf0 2024-01-22T05:05:53.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e1600700 1 -- 172.21.15.49:0/4206048310 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc00d980 con 0x7fb7e4153cf0 2024-01-22T05:05:53.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e9c00700 1 -- 172.21.15.49:0/4206048310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e4153cf0 msgr2=0x7fb7e40c1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:53.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e9c00700 1 --2- 172.21.15.49:0/4206048310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e4153cf0 0x7fb7e40c1ba0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fb7e4067b80 tx=0x7fb7cc009060).stop 2024-01-22T05:05:53.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e9c00700 1 -- 172.21.15.49:0/4206048310 shutdown_connections 2024-01-22T05:05:53.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e9c00700 1 --2- 172.21.15.49:0/4206048310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e4153cf0 0x7fb7e40c1ba0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e9c00700 1 --2- 172.21.15.49:0/4206048310 >> v2:172.21.15.110:3300/0 conn(0x7fb7e4063870 0x7fb7e4153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:53.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e9c00700 1 -- 172.21.15.49:0/4206048310 >> 172.21.15.49:0/4206048310 conn(0x7fb7e40c30c0 msgr2=0x7fb7e40c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:53.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e9c00700 1 -- 172.21.15.49:0/4206048310 shutdown_connections 2024-01-22T05:05:53.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.991+0000 7fb7e9c00700 1 -- 172.21.15.49:0/4206048310 wait complete. 2024-01-22T05:05:54.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.995+0000 7fb7e9c00700 1 Processor -- start 2024-01-22T05:05:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e9c00700 1 -- start start 2024-01-22T05:05:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e9c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e4063870 0x7fb7e4147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e9c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7e40c2090 0x7fb7e40a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e9c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7e4153cf0 0x7fb7e40a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e9c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e4147660 con 0x7fb7e4063870 2024-01-22T05:05:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e9c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e40a64f0 con 0x7fb7e4153cf0 2024-01-22T05:05:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e9c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e40a67d0 con 0x7fb7e40c2090 2024-01-22T05:05:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e4063870 0x7fb7e4147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:54.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e4063870 0x7fb7e4147170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34318/0 (socket says 172.21.15.49:34318) 2024-01-22T05:05:54.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e2a00700 1 -- 172.21.15.49:0/3890064542 learned_addr learned my addr 172.21.15.49:0/3890064542 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:54.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e2000700 1 --2- 172.21.15.49:0/3890064542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7e40c2090 0x7fb7e40a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:54.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e3400700 1 --2- 172.21.15.49:0/3890064542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7e4153cf0 0x7fb7e40a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:54.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e2a00700 1 -- 172.21.15.49:0/3890064542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7e40c2090 msgr2=0x7fb7e40a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:54.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e2a00700 1 --2- 172.21.15.49:0/3890064542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7e40c2090 0x7fb7e40a5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:54.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e2a00700 1 -- 172.21.15.49:0/3890064542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7e4153cf0 msgr2=0x7fb7e40a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:54.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e2a00700 1 --2- 172.21.15.49:0/3890064542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7e4153cf0 0x7fb7e40a38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:54.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:53.999+0000 7fb7e2a00700 1 -- 172.21.15.49:0/3890064542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d40092a0 con 0x7fb7e4063870 2024-01-22T05:05:54.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.003+0000 7fb7e2a00700 1 --2- 172.21.15.49:0/3890064542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e4063870 0x7fb7e4147170 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fb7d400e980 tx=0x7fb7d4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:54.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.003+0000 7fb7da000700 1 -- 172.21.15.49:0/3890064542 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4009560 con 0x7fb7e4063870 2024-01-22T05:05:54.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.003+0000 7fb7da000700 1 -- 172.21.15.49:0/3890064542 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d4012600 con 0x7fb7e4063870 2024-01-22T05:05:54.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.003+0000 7fb7e9c00700 1 -- 172.21.15.49:0/3890064542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7cc0092a0 con 0x7fb7e4063870 2024-01-22T05:05:54.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.003+0000 7fb7da000700 1 -- 172.21.15.49:0/3890064542 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4012980 con 0x7fb7e4063870 2024-01-22T05:05:54.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.003+0000 7fb7e9c00700 1 -- 172.21.15.49:0/3890064542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e40a6e00 con 0x7fb7e4063870 2024-01-22T05:05:54.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.003+0000 7fb7e9c00700 1 -- 172.21.15.49:0/3890064542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e4067700 con 0x7fb7e4063870 2024-01-22T05:05:54.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.007+0000 7fb7da000700 1 -- 172.21.15.49:0/3890064542 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb7d4012cf0 con 0x7fb7e4063870 2024-01-22T05:05:54.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.007+0000 7fb7da000700 1 --2- 172.21.15.49:0/3890064542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb7bc05a540 0x7fb7bc05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:54.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.007+0000 7fb7da000700 1 -- 172.21.15.49:0/3890064542 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb7d4074d60 con 0x7fb7e4063870 2024-01-22T05:05:54.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.007+0000 7fb7e2000700 1 --2- 172.21.15.49:0/3890064542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb7bc05a540 0x7fb7bc05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:54.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.007+0000 7fb7e2000700 1 --2- 172.21.15.49:0/3890064542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb7bc05a540 0x7fb7bc05ca00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fb7cc00d260 tx=0x7fb7cc016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:54.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.015+0000 7fb7da000700 1 -- 172.21.15.49:0/3890064542 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb7d4048320 con 0x7fb7e4063870 2024-01-22T05:05:54.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.211+0000 7fb7e9c00700 1 -- 172.21.15.49:0/3890064542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb7e4046800 con 0x7fb7e4063870 2024-01-22T05:05:54.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.211+0000 7fb7da000700 1 -- 172.21.15.49:0/3890064542 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb7d4016020 con 0x7fb7e4063870 2024-01-22T05:05:54.217 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:05:54.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.215+0000 7fb7e9c00700 1 -- 172.21.15.49:0/3890064542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb7bc05a540 msgr2=0x7fb7bc05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:54.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.215+0000 7fb7e9c00700 1 --2- 172.21.15.49:0/3890064542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb7bc05a540 0x7fb7bc05ca00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fb7cc00d260 tx=0x7fb7cc016000).stop 2024-01-22T05:05:54.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.215+0000 7fb7e9c00700 1 -- 172.21.15.49:0/3890064542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e4063870 msgr2=0x7fb7e4147170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:54.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.215+0000 7fb7e9c00700 1 --2- 172.21.15.49:0/3890064542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e4063870 0x7fb7e4147170 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fb7d400e980 tx=0x7fb7d4009060).stop 2024-01-22T05:05:54.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.215+0000 7fb7e9c00700 1 -- 172.21.15.49:0/3890064542 shutdown_connections 2024-01-22T05:05:54.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.215+0000 7fb7e9c00700 1 --2- 172.21.15.49:0/3890064542 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb7bc05a540 0x7fb7bc05ca00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:54.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.215+0000 7fb7e9c00700 1 --2- 172.21.15.49:0/3890064542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7e4153cf0 0x7fb7e40a38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:54.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.215+0000 7fb7e9c00700 1 --2- 172.21.15.49:0/3890064542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7e40c2090 0x7fb7e40a5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:54.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.215+0000 7fb7e9c00700 1 --2- 172.21.15.49:0/3890064542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7e4063870 0x7fb7e4147170 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:54.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.215+0000 7fb7e9c00700 1 -- 172.21.15.49:0/3890064542 >> 172.21.15.49:0/3890064542 conn(0x7fb7e40c30c0 msgr2=0x7fb7e40c4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:54.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.215+0000 7fb7e9c00700 1 -- 172.21.15.49:0/3890064542 shutdown_connections 2024-01-22T05:05:54.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:54.215+0000 7fb7e9c00700 1 -- 172.21.15.49:0/3890064542 wait complete. 2024-01-22T05:05:54.239 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-22T05:05:54.240 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:05:54.240 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:05:54.240 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:05:54.240 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:05:54.240 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-22T05:05:54.240 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-22T05:05:54.240 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:05:54.240 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:05:54.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:54.241 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:05:54.257 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:05:54.257 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:05:54.258 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:05:54.258 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:54.258 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:05:54.258 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:54.258 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:05:54.258 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:54.258 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:05:54.258 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:05:54.258 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:54.258 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:05:54.258 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:05:54.258 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42417sec preferred_lft 42417sec 2024-01-22T05:05:54.258 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:05:54.258 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::7ce7:e3ff:fed1:1e88/64 scope link 2024-01-22T05:05:54.259 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:54.260 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:05:54.260 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 82:c1:48:e7:c7:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:05:54.260 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::80c1:48ff:fee7:c731/64 scope link 2024-01-22T05:05:54.260 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:54.260 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:05:54.260 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:05:54.260 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3426:32ff:feee:c4c9/64 scope link 2024-01-22T05:05:54.260 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:05:54.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:54.261 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:05:54.341 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:05:54.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:54.344 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:05:54.404 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:05:54.404 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:05:54.405 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:05:54.405 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:05:54.405 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:05:54.405 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:05:54.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:54.405 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:05:54.405 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:05:54.405 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:05:54.405 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:05:54.405 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:05:54.406 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:05:54.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:54.541 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:05:54.557 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:05:54.557 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:05:54.558 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:05:54.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:54.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-22T05:05:54.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:54.636 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-22T05:05:54.694 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:05:54.694 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:05:54.819 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:05:54.819 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:05:54.841 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:05:54.841 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:05:54.847 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:05:54.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:05:54.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:05:54.877 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-01-22T05:05:55.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.095+0000 7fe89be00700 1 Processor -- start 2024-01-22T05:05:55.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.099+0000 7fe89be00700 1 -- start start 2024-01-22T05:05:55.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.103+0000 7fe89be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe89c068cb0 0x7fe89c156f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:55.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.103+0000 7fe89be00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c066560 con 0x7fe89c068600 2024-01-22T05:05:55.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.103+0000 7fe89be00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c065950 con 0x7fe89c067a90 2024-01-22T05:05:55.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.103+0000 7fe89be00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c0bc930 con 0x7fe89c068cb0 2024-01-22T05:05:55.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.103+0000 7fe89aa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe89c068cb0 0x7fe89c156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:55.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.103+0000 7fe89b400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe89c068600 0x7fe89c0c1280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56826/0 (socket says 172.21.15.49:56826) 2024-01-22T05:05:55.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.103+0000 7fe89b400700 1 -- 172.21.15.49:0/3955482280 learned_addr learned my addr 172.21.15.49:0/3955482280 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:05:55.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.103+0000 7fe89aa00700 1 -- 172.21.15.49:0/3955482280 >> v1:172.21.15.110:6789/0 conn(0x7fe89c067a90 legacy=0x7fe89c067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:55.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.103+0000 7fe89aa00700 1 -- 172.21.15.49:0/3955482280 >> v1:172.21.15.49:6789/0 conn(0x7fe89c068600 legacy=0x7fe89c0c1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:55.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.103+0000 7fe89aa00700 1 -- 172.21.15.49:0/3955482280 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c065c30 con 0x7fe89c068cb0 2024-01-22T05:05:55.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.103+0000 7fe89aa00700 1 --2- 172.21.15.49:0/3955482280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c068cb0 0x7fe89c156f00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fe88c009760 tx=0x7fe88c009060).ready entity=mon.0 client_cookie=8516328d544b17d0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:55.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.107+0000 7fe899600700 1 -- 172.21.15.49:0/3955482280 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00b580 con 0x7fe89c068cb0 2024-01-22T05:05:55.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.107+0000 7fe899600700 1 -- 172.21.15.49:0/3955482280 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c00b6e0 con 0x7fe89c068cb0 2024-01-22T05:05:55.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.107+0000 7fe899600700 1 -- 172.21.15.49:0/3955482280 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00ba60 con 0x7fe89c068cb0 2024-01-22T05:05:55.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.107+0000 7fe89be00700 1 -- 172.21.15.49:0/3955482280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c068cb0 msgr2=0x7fe89c156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:55.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.107+0000 7fe89be00700 1 --2- 172.21.15.49:0/3955482280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c068cb0 0x7fe89c156f00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fe88c009760 tx=0x7fe88c009060).stop 2024-01-22T05:05:55.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.107+0000 7fe89be00700 1 -- 172.21.15.49:0/3955482280 shutdown_connections 2024-01-22T05:05:55.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.107+0000 7fe89be00700 1 --2- 172.21.15.49:0/3955482280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c068cb0 0x7fe89c156f00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:55.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.107+0000 7fe89be00700 1 -- 172.21.15.49:0/3955482280 >> 172.21.15.49:0/3955482280 conn(0x7fe89c0c6f70 msgr2=0x7fe89c0c2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:55.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.107+0000 7fe89be00700 1 -- 172.21.15.49:0/3955482280 shutdown_connections 2024-01-22T05:05:55.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.107+0000 7fe89be00700 1 -- 172.21.15.49:0/3955482280 wait complete. 2024-01-22T05:05:55.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.111+0000 7fe89be00700 1 Processor -- start 2024-01-22T05:05:55.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.111+0000 7fe89be00700 1 -- start start 2024-01-22T05:05:55.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c067a90 0x7fe89c1659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:55.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c068600 0x7fe89c0bff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:55.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe89c068cb0 0x7fe89c0a42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:55.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89be00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c0bd240 con 0x7fe89c067a90 2024-01-22T05:05:55.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89be00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c153b70 con 0x7fe89c068600 2024-01-22T05:05:55.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89be00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c0c0400 con 0x7fe89c068cb0 2024-01-22T05:05:55.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c067a90 0x7fe89c1659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:55.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c067a90 0x7fe89c1659c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34330/0 (socket says 172.21.15.49:34330) 2024-01-22T05:05:55.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89aa00700 1 -- 172.21.15.49:0/1755180175 learned_addr learned my addr 172.21.15.49:0/1755180175 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:05:55.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89b400700 1 --2- 172.21.15.49:0/1755180175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe89c068cb0 0x7fe89c0a42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:55.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89a000700 1 --2- 172.21.15.49:0/1755180175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c068600 0x7fe89c0bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:55.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89aa00700 1 -- 172.21.15.49:0/1755180175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe89c068cb0 msgr2=0x7fe89c0a42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:55.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89aa00700 1 --2- 172.21.15.49:0/1755180175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe89c068cb0 0x7fe89c0a42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:55.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89aa00700 1 -- 172.21.15.49:0/1755180175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c068600 msgr2=0x7fe89c0bff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:55.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89aa00700 1 --2- 172.21.15.49:0/1755180175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c068600 0x7fe89c0bff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:55.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89aa00700 1 -- 172.21.15.49:0/1755180175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c0092a0 con 0x7fe89c067a90 2024-01-22T05:05:55.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89aa00700 1 --2- 172.21.15.49:0/1755180175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c067a90 0x7fe89c1659c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fe88c009eb0 tx=0x7fe88c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:55.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe892000700 1 -- 172.21.15.49:0/1755180175 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00ba60 con 0x7fe89c067a90 2024-01-22T05:05:55.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe892000700 1 -- 172.21.15.49:0/1755180175 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c000cc0 con 0x7fe89c067a90 2024-01-22T05:05:55.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe892000700 1 -- 172.21.15.49:0/1755180175 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c01c630 con 0x7fe89c067a90 2024-01-22T05:05:55.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89be00700 1 -- 172.21.15.49:0/1755180175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c152f60 con 0x7fe89c067a90 2024-01-22T05:05:55.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.115+0000 7fe89be00700 1 -- 172.21.15.49:0/1755180175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c153520 con 0x7fe89c067a90 2024-01-22T05:05:55.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.119+0000 7fe89be00700 1 -- 172.21.15.49:0/1755180175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c05fd40 con 0x7fe89c067a90 2024-01-22T05:05:55.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.119+0000 7fe892000700 1 -- 172.21.15.49:0/1755180175 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe88c01ca20 con 0x7fe89c067a90 2024-01-22T05:05:55.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.119+0000 7fe892000700 1 --2- 172.21.15.49:0/1755180175 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe87405a4e0 0x7fe87405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:05:55.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.119+0000 7fe892000700 1 -- 172.21.15.49:0/1755180175 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe88c076880 con 0x7fe89c067a90 2024-01-22T05:05:55.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.123+0000 7fe89a000700 1 --2- 172.21.15.49:0/1755180175 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe87405a4e0 0x7fe87405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:05:55.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.123+0000 7fe89a000700 1 --2- 172.21.15.49:0/1755180175 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe87405a4e0 0x7fe87405c9a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fe89c167d20 tx=0x7fe884009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:05:55.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.127+0000 7fe892000700 1 -- 172.21.15.49:0/1755180175 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe88c049e40 con 0x7fe89c067a90 2024-01-22T05:05:55.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:55.327+0000 7fe89be00700 1 -- 172.21.15.49:0/1755180175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe89c0bc510 con 0x7fe89c067a90 2024-01-22T05:05:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:56.115+0000 7fe892000700 1 -- 172.21.15.49:0/1755180175 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v18) v1 ==== 167+0+0 (secure 0 0 0) 0x7fe88c04d460 con 0x7fe89c067a90 2024-01-22T05:05:56.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:56.119+0000 7fe89be00700 1 -- 172.21.15.49:0/1755180175 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe87405a4e0 msgr2=0x7fe87405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:56.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:56.119+0000 7fe89be00700 1 --2- 172.21.15.49:0/1755180175 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe87405a4e0 0x7fe87405c9a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fe89c167d20 tx=0x7fe884009040).stop 2024-01-22T05:05:56.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:56.119+0000 7fe89be00700 1 -- 172.21.15.49:0/1755180175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c067a90 msgr2=0x7fe89c1659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:05:56.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:56.119+0000 7fe89be00700 1 --2- 172.21.15.49:0/1755180175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c067a90 0x7fe89c1659c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fe88c009eb0 tx=0x7fe88c017000).stop 2024-01-22T05:05:56.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:56.119+0000 7fe89be00700 1 -- 172.21.15.49:0/1755180175 shutdown_connections 2024-01-22T05:05:56.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:56.119+0000 7fe89be00700 1 --2- 172.21.15.49:0/1755180175 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe87405a4e0 0x7fe87405c9a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:56.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:56.119+0000 7fe89be00700 1 --2- 172.21.15.49:0/1755180175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe89c068cb0 0x7fe89c0a42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:56.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:56.119+0000 7fe89be00700 1 --2- 172.21.15.49:0/1755180175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c068600 0x7fe89c0bff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:56.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:56.119+0000 7fe89be00700 1 --2- 172.21.15.49:0/1755180175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe89c067a90 0x7fe89c1659c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:05:56.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:56.119+0000 7fe89be00700 1 -- 172.21.15.49:0/1755180175 >> 172.21.15.49:0/1755180175 conn(0x7fe89c0c6f70 msgr2=0x7fe89c0a9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:05:56.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:56.119+0000 7fe89be00700 1 -- 172.21.15.49:0/1755180175 shutdown_connections 2024-01-22T05:05:56.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:05:56.119+0000 7fe89be00700 1 -- 172.21.15.49:0/1755180175 wait complete. 2024-01-22T05:05:56.127 INFO:teuthology.orchestra.run.smithi049.stderr:enabled new snapshots 2024-01-22T05:05:56.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:05:56.151 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-01-22T05:05:56.186 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> import uuid 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> n = 2000 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> create_hard_links = False 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> if 3 > 0: 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> create_hard_links = True 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> dpath = os.path.dirname(path) 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> fnameprefix = os.path.basename(path) 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> os.makedirs(dpath, exist_ok=True) 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> try: 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-01-22T05:05:56.187 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:05:56.188 DEBUG:teuthology.orchestra.run.smithi049:> for i in range(n): 2024-01-22T05:05:56.188 DEBUG:teuthology.orchestra.run.smithi049:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-01-22T05:05:56.188 DEBUG:teuthology.orchestra.run.smithi049:> with open(fpath, '"'"'w'"'"') as f: 2024-01-22T05:05:56.188 DEBUG:teuthology.orchestra.run.smithi049:> f.write(f"{i}") 2024-01-22T05:05:56.188 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-01-22T05:05:56.188 DEBUG:teuthology.orchestra.run.smithi049:> f.flush() 2024-01-22T05:05:56.188 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(f.fileno()) 2024-01-22T05:05:56.188 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-01-22T05:05:56.188 DEBUG:teuthology.orchestra.run.smithi049:> os.unlink(fpath) 2024-01-22T05:05:56.188 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-01-22T05:05:56.188 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(dirfd) 2024-01-22T05:05:56.188 DEBUG:teuthology.orchestra.run.smithi049:> if create_hard_links: 2024-01-22T05:05:56.188 DEBUG:teuthology.orchestra.run.smithi049:> for j in range(3): 2024-01-22T05:05:56.188 DEBUG:teuthology.orchestra.run.smithi049:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-01-22T05:05:56.188 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-01-22T05:05:56.189 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(dirfd) 2024-01-22T05:05:56.189 DEBUG:teuthology.orchestra.run.smithi049:> finally: 2024-01-22T05:05:56.189 DEBUG:teuthology.orchestra.run.smithi049:> os.close(dirfd) 2024-01-22T05:05:56.189 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-01-22T05:06:07.047 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:06:07.053 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:06:37.146 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:06:37.151 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:06:38.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:06:38.586 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-01-22T05:06:38.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:06:38.630 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-01-22T05:07:07.211 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:07:07.219 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:07:13.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:07:13.752 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-01-22T05:07:13.844 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-01-22T05:07:14.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.006+0000 7faa7fe00700 1 Processor -- start 2024-01-22T05:07:14.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.006+0000 7faa7fe00700 1 -- start start 2024-01-22T05:07:14.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.010+0000 7faa7fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faa780c7630 0x7faa78162ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.010+0000 7faa7fe00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa780c6190 con 0x7faa780bcdd0 2024-01-22T05:07:14.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.010+0000 7faa7fe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa780c50d0 con 0x7faa780c4070 2024-01-22T05:07:14.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.010+0000 7faa7fe00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa780c22f0 con 0x7faa780c7630 2024-01-22T05:07:14.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.010+0000 7faa7ca00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faa780bcdd0 0x7faa780bd1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54342/0 (socket says 172.21.15.49:54342) 2024-01-22T05:07:14.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.010+0000 7faa7ca00700 1 -- 172.21.15.49:0/473455271 learned_addr learned my addr 172.21.15.49:0/473455271 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:14.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.010+0000 7faa7e800700 1 --2- 172.21.15.49:0/473455271 >> v2:172.21.15.49:3300/0 conn(0x7faa780c7630 0x7faa78162ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.010+0000 7faa77e00700 1 -- 172.21.15.49:0/473455271 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021390602 0 0) 0x7faa780c6190 con 0x7faa780bcdd0 2024-01-22T05:07:14.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.010+0000 7faa7e800700 1 -- 172.21.15.49:0/473455271 >> v1:172.21.15.110:6789/0 conn(0x7faa780c4070 legacy=0x7faa78157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.010+0000 7faa7e800700 1 -- 172.21.15.49:0/473455271 >> v1:172.21.15.49:6789/0 conn(0x7faa780bcdd0 legacy=0x7faa780bd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.014+0000 7faa7e800700 1 -- 172.21.15.49:0/473455271 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780c5b60 con 0x7faa780c7630 2024-01-22T05:07:14.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.014+0000 7faa7e800700 1 --2- 172.21.15.49:0/473455271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa780c7630 0x7faa78162ba0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7faa70009e60 tx=0x7faa70009780).ready entity=mon.0 client_cookie=14fb6c3fb91261ad server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.014+0000 7faa77e00700 1 -- 172.21.15.49:0/473455271 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000e070 con 0x7faa780c7630 2024-01-22T05:07:14.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.014+0000 7faa77e00700 1 -- 172.21.15.49:0/473455271 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7000bc30 con 0x7faa780c7630 2024-01-22T05:07:14.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.014+0000 7faa77e00700 1 -- 172.21.15.49:0/473455271 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70012410 con 0x7faa780c7630 2024-01-22T05:07:14.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.014+0000 7faa7fe00700 1 -- 172.21.15.49:0/473455271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa780c7630 msgr2=0x7faa78162ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.014+0000 7faa7fe00700 1 --2- 172.21.15.49:0/473455271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa780c7630 0x7faa78162ba0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7faa70009e60 tx=0x7faa70009780).stop 2024-01-22T05:07:14.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.014+0000 7faa7fe00700 1 -- 172.21.15.49:0/473455271 shutdown_connections 2024-01-22T05:07:14.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.014+0000 7faa7fe00700 1 --2- 172.21.15.49:0/473455271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa780c7630 0x7faa78162ba0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.014+0000 7faa7fe00700 1 -- 172.21.15.49:0/473455271 >> 172.21.15.49:0/473455271 conn(0x7faa780c8720 msgr2=0x7faa780c4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.014+0000 7faa7fe00700 1 -- 172.21.15.49:0/473455271 shutdown_connections 2024-01-22T05:07:14.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.014+0000 7faa7fe00700 1 -- 172.21.15.49:0/473455271 wait complete. 2024-01-22T05:07:14.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.018+0000 7faa7fe00700 1 Processor -- start 2024-01-22T05:07:14.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.018+0000 7faa7fe00700 1 -- start start 2024-01-22T05:07:14.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.018+0000 7faa7fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780bcdd0 0x7faa78149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.018+0000 7faa7fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa780c4070 0x7faa780a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.018+0000 7faa7fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa780c7630 0x7faa780abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.018+0000 7faa7fe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa780a2820 con 0x7faa780c4070 2024-01-22T05:07:14.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.018+0000 7faa7fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7814a230 con 0x7faa780c7630 2024-01-22T05:07:14.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.018+0000 7faa7fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa780a1c10 con 0x7faa780bcdd0 2024-01-22T05:07:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.018+0000 7faa7ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa780c4070 0x7faa780a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.018+0000 7faa7ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa780c4070 0x7faa780a13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37592/0 (socket says 172.21.15.49:37592) 2024-01-22T05:07:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.018+0000 7faa7ca00700 1 -- 172.21.15.49:0/2373106304 learned_addr learned my addr 172.21.15.49:0/2373106304 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.018+0000 7faa7e800700 1 --2- 172.21.15.49:0/2373106304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa780c7630 0x7faa780abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.018+0000 7faa7d400700 1 --2- 172.21.15.49:0/2373106304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780bcdd0 0x7faa78149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.022+0000 7faa7ca00700 1 -- 172.21.15.49:0/2373106304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780bcdd0 msgr2=0x7faa78149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.022+0000 7faa7ca00700 1 --2- 172.21.15.49:0/2373106304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780bcdd0 0x7faa78149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.022+0000 7faa7ca00700 1 -- 172.21.15.49:0/2373106304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa780c7630 msgr2=0x7faa780abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.022+0000 7faa7ca00700 1 --2- 172.21.15.49:0/2373106304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa780c7630 0x7faa780abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.022+0000 7faa7ca00700 1 -- 172.21.15.49:0/2373106304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa70009a20 con 0x7faa780c4070 2024-01-22T05:07:14.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.022+0000 7faa7ca00700 1 --2- 172.21.15.49:0/2373106304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa780c4070 0x7faa780a13e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7faa6000c4c0 tx=0x7faa60007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.022+0000 7faa74c00700 1 -- 172.21.15.49:0/2373106304 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000ce30 con 0x7faa780c4070 2024-01-22T05:07:14.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.022+0000 7faa74c00700 1 -- 172.21.15.49:0/2373106304 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa600072e0 con 0x7faa780c4070 2024-01-22T05:07:14.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.022+0000 7faa74c00700 1 -- 172.21.15.49:0/2373106304 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa600057a0 con 0x7faa780c4070 2024-01-22T05:07:14.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.022+0000 7faa7fe00700 1 -- 172.21.15.49:0/2373106304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa780a1ef0 con 0x7faa780c4070 2024-01-22T05:07:14.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.022+0000 7faa7fe00700 1 -- 172.21.15.49:0/2373106304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa780a24b0 con 0x7faa780c4070 2024-01-22T05:07:14.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.026+0000 7faa74c00700 1 -- 172.21.15.49:0/2373106304 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7faa60005bd0 con 0x7faa780c4070 2024-01-22T05:07:14.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.026+0000 7faa74c00700 1 --2- 172.21.15.49:0/2373106304 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faa5005a540 0x7faa5005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.026+0000 7faa74c00700 1 -- 172.21.15.49:0/2373106304 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6561+0+0 (secure 0 0 0) 0x7faa600740b0 con 0x7faa780c4070 2024-01-22T05:07:14.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.026+0000 7faa7d400700 1 --2- 172.21.15.49:0/2373106304 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faa5005a540 0x7faa5005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.026+0000 7faa7d400700 1 --2- 172.21.15.49:0/2373106304 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faa5005a540 0x7faa5005ca00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7faa68003900 tx=0x7faa68007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.030+0000 7faa8a22d740 1 Processor -- start 2024-01-22T05:07:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.030+0000 7faa8a22d740 1 -- start start 2024-01-22T05:07:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.030+0000 7faa8a22d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf789a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.030+0000 7faa8a22d740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf79170 0xf33cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.030+0000 7faa8a22d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf341b0 0xf34610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.030+0000 7faa8a22d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xe712a0 con 0xf785c0 2024-01-22T05:07:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.030+0000 7faa8a22d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xe944a0 con 0xf341b0 2024-01-22T05:07:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.030+0000 7faa8a22d740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xe5dce0 con 0xf79170 2024-01-22T05:07:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.030+0000 7faa7d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf789a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.030+0000 7faa7d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf789a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37594/0 (socket says 172.21.15.49:37594) 2024-01-22T05:07:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.030+0000 7faa7d400700 1 -- 172.21.15.49:0/2078974605 learned_addr learned my addr 172.21.15.49:0/2078974605 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa7ca00700 1 --2- 172.21.15.49:0/2078974605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf79170 0xf33cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa7e800700 1 --2- 172.21.15.49:0/2078974605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf341b0 0xf34610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa7d400700 1 -- 172.21.15.49:0/2078974605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf79170 msgr2=0xf33cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa7d400700 1 --2- 172.21.15.49:0/2078974605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf79170 0xf33cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa7d400700 1 -- 172.21.15.49:0/2078974605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf341b0 msgr2=0xf34610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa7d400700 1 --2- 172.21.15.49:0/2078974605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf341b0 0xf34610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa7d400700 1 -- 172.21.15.49:0/2078974605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xec28e0 con 0xf785c0 2024-01-22T05:07:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa7d400700 1 --2- 172.21.15.49:0/2078974605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf789a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7faa6800f790 tx=0x7faa6800a000).ready entity=mon.0 client_cookie=cc2cf4a606330be8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa6d200700 1 -- 172.21.15.49:0/2078974605 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6801c070 con 0xf785c0 2024-01-22T05:07:14.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa6d200700 1 -- 172.21.15.49:0/2078974605 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa680031e0 con 0xf785c0 2024-01-22T05:07:14.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa6d200700 1 -- 172.21.15.49:0/2078974605 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa68003040 con 0xf785c0 2024-01-22T05:07:14.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa8a22d740 1 -- 172.21.15.49:0/2078974605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 msgr2=0xf789a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa8a22d740 1 --2- 172.21.15.49:0/2078974605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf789a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7faa6800f790 tx=0x7faa6800a000).stop 2024-01-22T05:07:14.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa8a22d740 1 -- 172.21.15.49:0/2078974605 shutdown_connections 2024-01-22T05:07:14.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa8a22d740 1 --2- 172.21.15.49:0/2078974605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf341b0 0xf34610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa8a22d740 1 --2- 172.21.15.49:0/2078974605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf79170 0xf33cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa8a22d740 1 --2- 172.21.15.49:0/2078974605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf789a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa8a22d740 1 -- 172.21.15.49:0/2078974605 >> 172.21.15.49:0/2078974605 conn(0xd16640 msgr2=0xf7de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa8a22d740 1 -- 172.21.15.49:0/2078974605 shutdown_connections 2024-01-22T05:07:14.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.034+0000 7faa8a22d740 1 -- 172.21.15.49:0/2078974605 wait complete. 2024-01-22T05:07:14.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.038+0000 7faa8a22d740 1 -- start start 2024-01-22T05:07:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.038+0000 7faa8a22d740 1 Processor -- start 2024-01-22T05:07:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.038+0000 7faa8a22d740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf341b0 0xf63aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.038+0000 7faa8a22d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf785c0 0xf50050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.038+0000 7faa8a22d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf79170 0xf617d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.038+0000 7faa8a22d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xf77a40 con 0xf79170 2024-01-22T05:07:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.038+0000 7faa8a22d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xf7b3a0 con 0xf785c0 2024-01-22T05:07:14.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.038+0000 7faa8a22d740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xf76270 con 0xf341b0 2024-01-22T05:07:14.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.038+0000 7faa8a22d740 10 client.0 ll_register_callbacks cb 0xeee9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:07:14.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa7e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf79170 0xf617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa7e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf79170 0xf617d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37600/0 (socket says 172.21.15.49:37600) 2024-01-22T05:07:14.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa7e800700 1 -- 172.21.15.49:0/4202796622 learned_addr learned my addr 172.21.15.49:0/4202796622 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:14.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa7ca00700 1 --2- 172.21.15.49:0/4202796622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf785c0 0xf50050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa7d400700 1 --2- 172.21.15.49:0/4202796622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf341b0 0xf63aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa7e800700 1 -- 172.21.15.49:0/4202796622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf341b0 msgr2=0xf63aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa7e800700 1 --2- 172.21.15.49:0/4202796622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf341b0 0xf63aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa7e800700 1 -- 172.21.15.49:0/4202796622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf785c0 msgr2=0xf50050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa7e800700 1 --2- 172.21.15.49:0/4202796622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf785c0 0xf50050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa7e800700 1 -- 172.21.15.49:0/4202796622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa780c50d0 con 0xf79170 2024-01-22T05:07:14.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa7e800700 1 --2- 172.21.15.49:0/4202796622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf79170 0xf617d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7faa7000b6c0 tx=0x7faa70009780).ready entity=mon.0 client_cookie=aba585f1d1660990 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa65600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:07:14.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa65600700 1 -- 172.21.15.49:0/4202796622 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7001f620 con 0xf79170 2024-01-22T05:07:14.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa65600700 1 -- 172.21.15.49:0/4202796622 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6561+0+0 (secure 0 0 0) 0x7faa7001f780 con 0xf79170 2024-01-22T05:07:14.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa8a22d740 1 -- 172.21.15.49:0/4202796622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xeae1f0 con 0xf79170 2024-01-22T05:07:14.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa65600700 1 -- 172.21.15.49:0/4202796622 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa7001f940 con 0xf79170 2024-01-22T05:07:14.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa8a22d740 10 client.5352 fetch_fsmap learned FSMap version 31 2024-01-22T05:07:14.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa8a22d740 1 -- 172.21.15.49:0/4202796622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0xeb1780 con 0xf79170 2024-01-22T05:07:14.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa65600700 1 -- 172.21.15.49:0/4202796622 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xeae1f0 con 0xf79170 2024-01-22T05:07:14.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa65600700 1 -- 172.21.15.49:0/4202796622 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faa7001faa0 con 0xf79170 2024-01-22T05:07:14.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa8a22d740 10 client.5352 fetch_fsmap finished waiting for FSMap version 31 2024-01-22T05:07:14.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa8a22d740 10 client.5352 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-01-22T05:07:14.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa8a22d740 20 client.5352 populate_metadata read hostname 'smithi049' 2024-01-22T05:07:14.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa8a22d740 1 --2- 172.21.15.49:0/4202796622 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xf8cdc0 0xf8d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa8a22d740 4 client.5352 mds_command: new command op to 5121 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:07:14.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa8a22d740 1 -- 172.21.15.49:0/4202796622 --> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xea4740 con 0xf8cdc0 2024-01-22T05:07:14.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.042+0000 7faa7d400700 1 --2- 172.21.15.49:0/4202796622 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xf8cdc0 0xf8d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa7d400700 1 --2- 172.21.15.49:0/4202796622 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xf8cdc0 0xf8d1d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c897435563319576 server_cookie=baa0f1ccce4498e2 in_seq=0 out_seq=0 2024-01-22T05:07:14.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa65600700 10 client.5352 ms_handle_connect on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:14.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa65600700 1 -- 172.21.15.49:0/4202796622 <== mds.0 v2:172.21.15.49:6834/3211151680 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xea4740 con 0xf8cdc0 2024-01-22T05:07:14.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa65600700 10 client.5352 handle_command_reply: tid=0 2024-01-22T05:07:14.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa8a22d740 1 client.5352 shutdown 2024-01-22T05:07:14.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa8a22d740 1 -- 172.21.15.49:0/4202796622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf79170 msgr2=0xf617d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa8a22d740 1 --2- 172.21.15.49:0/4202796622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf79170 0xf617d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7faa7000b6c0 tx=0x7faa70009780).stop 2024-01-22T05:07:14.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa8a22d740 1 -- 172.21.15.49:0/4202796622 shutdown_connections 2024-01-22T05:07:14.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa8a22d740 1 --2- 172.21.15.49:0/4202796622 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xf8cdc0 0xf8d1d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa8a22d740 1 --2- 172.21.15.49:0/4202796622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf79170 0xf617d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa8a22d740 1 --2- 172.21.15.49:0/4202796622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf785c0 0xf50050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa8a22d740 1 --2- 172.21.15.49:0/4202796622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf341b0 0xf63aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa8a22d740 1 -- 172.21.15.49:0/4202796622 >> 172.21.15.49:0/4202796622 conn(0xd16640 msgr2=0xf745c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa65600700 0 client.5352 ms_handle_reset on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:14.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa8a22d740 1 -- 172.21.15.49:0/4202796622 shutdown_connections 2024-01-22T05:07:14.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.046+0000 7faa8a22d740 1 -- 172.21.15.49:0/4202796622 wait complete. 2024-01-22T05:07:14.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.050+0000 7faa8a22d740 20 client.5352 trim_cache size 0 max 16384 2024-01-22T05:07:14.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.070+0000 7faa8a22d740 1 Processor -- start 2024-01-22T05:07:14.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.070+0000 7faa8a22d740 1 -- start start 2024-01-22T05:07:14.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa8a22d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf341b0 0xf7dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa8a22d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf7e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa8a22d740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf79170 0xf8bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa8a22d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xf8b8d0 con 0xf785c0 2024-01-22T05:07:14.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa8a22d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xf74420 con 0xf341b0 2024-01-22T05:07:14.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa8a22d740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xefa460 con 0xf79170 2024-01-22T05:07:14.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa7ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf7e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa7ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf7e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37602/0 (socket says 172.21.15.49:37602) 2024-01-22T05:07:14.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa7ca00700 1 -- 172.21.15.49:0/3967899555 learned_addr learned my addr 172.21.15.49:0/3967899555 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa7e800700 1 --2- 172.21.15.49:0/3967899555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf79170 0xf8bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa7d400700 1 --2- 172.21.15.49:0/3967899555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf341b0 0xf7dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa7ca00700 1 -- 172.21.15.49:0/3967899555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf79170 msgr2=0xf8bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa7ca00700 1 --2- 172.21.15.49:0/3967899555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf79170 0xf8bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa7ca00700 1 -- 172.21.15.49:0/3967899555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf341b0 msgr2=0xf7dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa7ca00700 1 --2- 172.21.15.49:0/3967899555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf341b0 0xf7dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa7ca00700 1 -- 172.21.15.49:0/3967899555 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780ac430 con 0xf785c0 2024-01-22T05:07:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa7e800700 1 --2- 172.21.15.49:0/3967899555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf79170 0xf8bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:07:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa7d400700 1 --2- 172.21.15.49:0/3967899555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf341b0 0xf7dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:07:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa7ca00700 1 --2- 172.21.15.49:0/3967899555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf7e180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7faa6004afd0 tx=0x7faa6004d040).ready entity=mon.0 client_cookie=88ed23616da976ae server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa6dc00700 1 -- 172.21.15.49:0/3967899555 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60055070 con 0xf785c0 2024-01-22T05:07:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa6dc00700 1 -- 172.21.15.49:0/3967899555 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa60056040 con 0xf785c0 2024-01-22T05:07:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa6dc00700 1 -- 172.21.15.49:0/3967899555 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6004ac30 con 0xf785c0 2024-01-22T05:07:14.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa8a22d740 1 -- 172.21.15.49:0/3967899555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 msgr2=0xf7e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa8a22d740 1 --2- 172.21.15.49:0/3967899555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf7e180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7faa6004afd0 tx=0x7faa6004d040).stop 2024-01-22T05:07:14.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa8a22d740 1 -- 172.21.15.49:0/3967899555 shutdown_connections 2024-01-22T05:07:14.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa8a22d740 1 --2- 172.21.15.49:0/3967899555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf79170 0xf8bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa8a22d740 1 --2- 172.21.15.49:0/3967899555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf7e180 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa8a22d740 1 --2- 172.21.15.49:0/3967899555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf341b0 0xf7dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa8a22d740 1 -- 172.21.15.49:0/3967899555 >> 172.21.15.49:0/3967899555 conn(0xd16640 msgr2=0xf745c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.074+0000 7faa8a22d740 1 -- 172.21.15.49:0/3967899555 shutdown_connections 2024-01-22T05:07:14.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.078+0000 7faa8a22d740 1 -- 172.21.15.49:0/3967899555 wait complete. 2024-01-22T05:07:14.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.078+0000 7faa8a22d740 1 -- start start 2024-01-22T05:07:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.078+0000 7faa8a22d740 1 Processor -- start 2024-01-22T05:07:14.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf341b0 0xf9abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf5f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf79170 0xfe2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xf989f0 con 0xf785c0 2024-01-22T05:07:14.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xf4ee90 con 0xf79170 2024-01-22T05:07:14.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xf9b0c0 con 0xf341b0 2024-01-22T05:07:14.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 10 client.0 ll_register_callbacks cb 0x7faa70012ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:07:14.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa7ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf5f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa7ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf5f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37618/0 (socket says 172.21.15.49:37618) 2024-01-22T05:07:14.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa7ca00700 1 -- 172.21.15.49:0/2967060954 learned_addr learned my addr 172.21.15.49:0/2967060954 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa7d400700 1 --2- 172.21.15.49:0/2967060954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf341b0 0xf9abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa7e800700 1 --2- 172.21.15.49:0/2967060954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf79170 0xfe2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa7ca00700 1 -- 172.21.15.49:0/2967060954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf341b0 msgr2=0xf9abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa7ca00700 1 --2- 172.21.15.49:0/2967060954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf341b0 0xf9abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa7ca00700 1 -- 172.21.15.49:0/2967060954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf79170 msgr2=0xfe2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa7ca00700 1 --2- 172.21.15.49:0/2967060954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf79170 0xfe2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa7ca00700 1 -- 172.21.15.49:0/2967060954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa780a24b0 con 0xf785c0 2024-01-22T05:07:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa7d400700 1 --2- 172.21.15.49:0/2967060954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf341b0 0xf9abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:07:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa7e800700 1 --2- 172.21.15.49:0/2967060954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf79170 0xfe2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:07:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa7ca00700 1 --2- 172.21.15.49:0/2967060954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf5f890 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7faa6004afd0 tx=0x7faa6005c000).ready entity=mon.0 client_cookie=e7c0ddc6af406ebc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa65600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:07:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa65600700 1 -- 172.21.15.49:0/2967060954 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60049670 con 0xf785c0 2024-01-22T05:07:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 1 -- 172.21.15.49:0/2967060954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa680031e0 con 0xf785c0 2024-01-22T05:07:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa65600700 1 -- 172.21.15.49:0/2967060954 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6561+0+0 (secure 0 0 0) 0x7faa600470c0 con 0xf785c0 2024-01-22T05:07:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa65600700 1 -- 172.21.15.49:0/2967060954 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa6004a230 con 0xf785c0 2024-01-22T05:07:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 10 client.5358 fetch_fsmap learned FSMap version 31 2024-01-22T05:07:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 1 -- 172.21.15.49:0/2967060954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0xeac9b0 con 0xf785c0 2024-01-22T05:07:14.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa65600700 1 -- 172.21.15.49:0/2967060954 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa680031e0 con 0xf785c0 2024-01-22T05:07:14.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa65600700 1 -- 172.21.15.49:0/2967060954 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faa6004a390 con 0xf785c0 2024-01-22T05:07:14.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 10 client.5358 fetch_fsmap finished waiting for FSMap version 31 2024-01-22T05:07:14.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 10 client.5358 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-01-22T05:07:14.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 20 client.5358 populate_metadata read hostname 'smithi049' 2024-01-22T05:07:14.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 1 --2- 172.21.15.49:0/2967060954 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xf33c20 0xfe33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 4 client.5358 mds_command: new command op to 5121 tid=0[{"prefix": "perf dump"}] 2024-01-22T05:07:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa8a22d740 1 -- 172.21.15.49:0/2967060954 --> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0xd6d5d0 con 0xf33c20 2024-01-22T05:07:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.082+0000 7faa7d400700 1 --2- 172.21.15.49:0/2967060954 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xf33c20 0xfe33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa7d400700 1 --2- 172.21.15.49:0/2967060954 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xf33c20 0xfe33a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d6bbaf569cfd5f41 server_cookie=430630c38abf6e5c in_seq=0 out_seq=0 2024-01-22T05:07:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa65600700 10 client.5358 ms_handle_connect on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa65600700 1 -- 172.21.15.49:0/2967060954 <== mds.0 v2:172.21.15.49:6834/3211151680 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17080 (crc 0 0 0) 0xd6d5d0 con 0xf33c20 2024-01-22T05:07:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa65600700 10 client.5358 handle_command_reply: tid=0 2024-01-22T05:07:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa8a22d740 1 client.5358 shutdown 2024-01-22T05:07:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa8a22d740 1 -- 172.21.15.49:0/2967060954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 msgr2=0xf5f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa8a22d740 1 --2- 172.21.15.49:0/2967060954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf5f890 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7faa6004afd0 tx=0x7faa6005c000).stop 2024-01-22T05:07:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa8a22d740 1 -- 172.21.15.49:0/2967060954 shutdown_connections 2024-01-22T05:07:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa8a22d740 1 --2- 172.21.15.49:0/2967060954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf79170 0xfe2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa8a22d740 1 --2- 172.21.15.49:0/2967060954 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xf33c20 0xfe33a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa8a22d740 1 --2- 172.21.15.49:0/2967060954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf785c0 0xf5f890 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa8a22d740 1 --2- 172.21.15.49:0/2967060954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf341b0 0xf9abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa65600700 0 client.5358 ms_handle_reset on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa8a22d740 1 -- 172.21.15.49:0/2967060954 >> 172.21.15.49:0/2967060954 conn(0xd16640 msgr2=0xf8ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa8a22d740 1 -- 172.21.15.49:0/2967060954 shutdown_connections 2024-01-22T05:07:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa8a22d740 1 -- 172.21.15.49:0/2967060954 wait complete. 2024-01-22T05:07:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.086+0000 7faa8a22d740 20 client.5358 trim_cache size 0 max 16384 2024-01-22T05:07:14.093 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:07:14.093 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-01-22T05:07:14.093 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 3061, 2024-01-22T05:07:14.093 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3040, 2024-01-22T05:07:14.093 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 955759, 2024-01-22T05:07:14.093 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 30196898, 2024-01-22T05:07:14.094 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 8, 2024-01-22T05:07:14.094 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-01-22T05:07:14.094 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.454734958, 2024-01-22T05:07:14.094 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.220986113, 2024-01-22T05:07:14.094 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.098463003, 2024-01-22T05:07:14.094 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.106216006, 2024-01-22T05:07:14.094 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-01-22T05:07:14.094 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3040, 2024-01-22T05:07:14.094 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 1.273450305, 2024-01-22T05:07:14.094 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000418898 2024-01-22T05:07:14.094 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.094 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-01-22T05:07:14.094 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2, 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000386, 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000193 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 30447, 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 51777, 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 10221164, 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 53487041, 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 8, 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 6.764594618, 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 4.745412968, 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.899966937, 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.340399001, 2024-01-22T05:07:14.095 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-01-22T05:07:14.096 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 51775, 2024-01-22T05:07:14.096 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 3.533664591, 2024-01-22T05:07:14.096 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000068250 2024-01-22T05:07:14.096 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.096 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-01-22T05:07:14.096 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 46713, 2024-01-22T05:07:14.096 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.017772198, 2024-01-22T05:07:14.096 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000380 2024-01-22T05:07:14.096 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:14.096 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.096 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-01-22T05:07:14.096 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 4497, 2024-01-22T05:07:14.096 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 4499, 2024-01-22T05:07:14.096 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1482155, 2024-01-22T05:07:14.097 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 34345626, 2024-01-22T05:07:14.097 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 6, 2024-01-22T05:07:14.097 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-01-22T05:07:14.097 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.672530396, 2024-01-22T05:07:14.097 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.362866797, 2024-01-22T05:07:14.097 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.111009940, 2024-01-22T05:07:14.097 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.164514768, 2024-01-22T05:07:14.097 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-01-22T05:07:14.097 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 4497, 2024-01-22T05:07:14.097 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 10.496363695, 2024-01-22T05:07:14.097 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002334081 2024-01-22T05:07:14.097 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.097 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-01-22T05:07:14.098 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.098 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.098 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.098 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:14.098 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.098 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-01-22T05:07:14.098 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 1, 2024-01-22T05:07:14.098 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-01-22T05:07:14.098 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.098 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-MDSRank": { 2024-01-22T05:07:14.098 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-01-22T05:07:14.098 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-01-22T05:07:14.098 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 5155, 2024-01-22T05:07:14.098 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 18.841453233, 2024-01-22T05:07:14.098 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.003654986 2024-01-22T05:07:14.099 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:14.099 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.099 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-PurgeQueue": { 2024-01-22T05:07:14.099 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-01-22T05:07:14.099 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-01-22T05:07:14.099 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1736, 2024-01-22T05:07:14.099 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 1.047850847, 2024-01-22T05:07:14.099 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000603600 2024-01-22T05:07:14.099 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:14.099 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.099 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-01-22T05:07:14.099 INFO:teuthology.orchestra.run.smithi049.stdout: "request": 26141, 2024-01-22T05:07:14.099 INFO:teuthology.orchestra.run.smithi049.stdout: "reply": 26141, 2024-01-22T05:07:14.099 INFO:teuthology.orchestra.run.smithi049.stdout: "reply_latency": { 2024-01-22T05:07:14.100 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 26141, 2024-01-22T05:07:14.100 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 280.912312468, 2024-01-22T05:07:14.100 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.010746043 2024-01-22T05:07:14.100 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.100 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_reply": 0, 2024-01-22T05:07:14.100 INFO:teuthology.orchestra.run.smithi049.stdout: "forward": 0, 2024-01-22T05:07:14.100 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch": 0, 2024-01-22T05:07:14.100 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_commit": 47, 2024-01-22T05:07:14.100 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_split": 0, 2024-01-22T05:07:14.100 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_merge": 0, 2024-01-22T05:07:14.100 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes": 10011, 2024-01-22T05:07:14.100 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_top": 5646, 2024-01-22T05:07:14.100 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_bottom": 4365, 2024-01-22T05:07:14.100 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pin_tail": 0, 2024-01-22T05:07:14.100 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pinned": 1944, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_expired": 6791, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_with_caps": 124, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": 124, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "subtrees": 2, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse": 49188, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_hit": 48575, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_forward": 0, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_discover": 0, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_dir_fetch": 0, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_remote_ino": 0, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_lock": 174, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "load_cent": 578686, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "q": 3, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "exported": 0, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "exported_inodes": 0, 2024-01-22T05:07:14.101 INFO:teuthology.orchestra.run.smithi049.stdout: "imported": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "imported_inodes": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_dir_fetch": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_backtrace_fetch": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_peer_discover": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rfiles": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rbytes": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rsnaps": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_fetch": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_set_tag": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_repaired": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_inotable_repaired": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_inodes": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_base_inodes": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dirfrag_rstats": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_file_inodes": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_inode_file_caps": 0, 2024-01-22T05:07:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_revoke": 1050, 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_grant": 4031, 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_trunc": 0, 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps": 3640, 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps_dirty": 2000, 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_cap_release": 60, 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "process_request_cap_release": 14107 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache": { 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays": 2000, 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_delayed": 154, 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_enqueuing": 0, 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_created": 4091, 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_enqueued": 1725, 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_reintegrated": 2206, 2024-01-22T05:07:14.103 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_migrated": 0, 2024-01-22T05:07:14.104 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_processing": 0, 2024-01-22T05:07:14.104 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_enqueued": 0, 2024-01-22T05:07:14.104 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_prioritized": 0, 2024-01-22T05:07:14.104 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_started": 0, 2024-01-22T05:07:14.104 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_completed": 0, 2024-01-22T05:07:14.104 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_enqueue_scrub": 0, 2024-01-22T05:07:14.104 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_exportdir": 0, 2024-01-22T05:07:14.104 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_flush": 0, 2024-01-22T05:07:14.104 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragmentdir": 0, 2024-01-22T05:07:14.104 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragstats": 0, 2024-01-22T05:07:14.104 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_inodestats": 0 2024-01-22T05:07:14.104 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.104 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log": { 2024-01-22T05:07:14.104 INFO:teuthology.orchestra.run.smithi049.stdout: "evadd": 24497, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "evex": 20705, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "evtrm": 18718, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "ev": 5779, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "evexg": 0, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "evexd": 1987, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "segadd": 32, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "segex": 25, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "segtrm": 23, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "seg": 9, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "segexg": 0, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "segexd": 2, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "expos": 62921087, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "wrpos": 85077399, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "rdpos": 0, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "jlat": { 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 4403, 2024-01-22T05:07:14.105 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 81.450986465, 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018498974 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: "replayed": 0 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_mem": { 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 2014, 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: "ino+": 2014, 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: "ino-": 0, 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: "dir": 13, 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: "dir+": 13, 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: "dir-": 0, 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: "dn": 11483, 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: "dn+": 19940, 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: "dn-": 8457, 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: "cap": 124, 2024-01-22T05:07:14.106 INFO:teuthology.orchestra.run.smithi049.stdout: "cap+": 8226, 2024-01-22T05:07:14.107 INFO:teuthology.orchestra.run.smithi049.stdout: "cap-": 8102, 2024-01-22T05:07:14.107 INFO:teuthology.orchestra.run.smithi049.stdout: "rss": 109924, 2024-01-22T05:07:14.107 INFO:teuthology.orchestra.run.smithi049.stdout: "heap": 340196 2024-01-22T05:07:14.107 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.107 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_server": { 2024-01-22T05:07:14.107 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_client_request": 29946, 2024-01-22T05:07:14.107 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_server_request": 0, 2024-01-22T05:07:14.107 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_request": 26141, 2024-01-22T05:07:14.107 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_session": 5, 2024-01-22T05:07:14.107 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_peer_request": 0, 2024-01-22T05:07:14.107 INFO:teuthology.orchestra.run.smithi049.stdout: "req_create_latency": { 2024-01-22T05:07:14.107 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2000, 2024-01-22T05:07:14.107 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.404811377, 2024-01-22T05:07:14.107 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001202405 2024-01-22T05:07:14.107 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.108 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getattr_latency": { 2024-01-22T05:07:14.108 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-01-22T05:07:14.108 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.003698907, 2024-01-22T05:07:14.108 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000462363 2024-01-22T05:07:14.108 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.108 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getfilelock_latency": { 2024-01-22T05:07:14.108 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.108 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.108 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.108 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.108 INFO:teuthology.orchestra.run.smithi049.stdout: "req_link_latency": { 2024-01-22T05:07:14.108 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6000, 2024-01-22T05:07:14.108 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 11.918429222, 2024-01-22T05:07:14.108 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001986404 2024-01-22T05:07:14.108 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.109 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookup_latency": { 2024-01-22T05:07:14.109 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 7914, 2024-01-22T05:07:14.109 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 9.207072358, 2024-01-22T05:07:14.109 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001163390 2024-01-22T05:07:14.109 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.109 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookuphash_latency": { 2024-01-22T05:07:14.109 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.109 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.109 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.109 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.109 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupino_latency": { 2024-01-22T05:07:14.109 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.109 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.109 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.109 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupname_latency": { 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupparent_latency": { 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupsnap_latency": { 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000188031, 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000188031 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.110 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lssnap_latency": { 2024-01-22T05:07:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mkdir_latency": { 2024-01-22T05:07:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:07:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.004872684, 2024-01-22T05:07:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.004872684 2024-01-22T05:07:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mknod_latency": { 2024-01-22T05:07:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mksnap_latency": { 2024-01-22T05:07:14.112 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:07:14.112 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.017555346, 2024-01-22T05:07:14.112 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.017555346 2024-01-22T05:07:14.112 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.112 INFO:teuthology.orchestra.run.smithi049.stdout: "req_open_latency": { 2024-01-22T05:07:14.112 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.112 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.112 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.112 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.112 INFO:teuthology.orchestra.run.smithi049.stdout: "req_readdir_latency": { 2024-01-22T05:07:14.112 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-01-22T05:07:14.112 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.137426115, 2024-01-22T05:07:14.112 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.017178264 2024-01-22T05:07:14.112 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rename_latency": { 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2206, 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 237.389705576, 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.107610927 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: "req_renamesnap_latency": { 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmdir_latency": { 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.113 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmsnap_latency": { 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.071521469, 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.071521469 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmxattr_latency": { 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setattr_latency": { 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000549976, 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000549976 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setdirlayout_latency": { 2024-01-22T05:07:14.114 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.115 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.115 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.115 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.115 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setfilelock_latency": { 2024-01-22T05:07:14.115 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.115 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.115 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.115 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.115 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setlayout_latency": { 2024-01-22T05:07:14.115 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.115 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.115 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.115 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.115 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setxattr_latency": { 2024-01-22T05:07:14.116 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.116 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.116 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.116 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.116 INFO:teuthology.orchestra.run.smithi049.stdout: "req_symlink_latency": { 2024-01-22T05:07:14.116 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.116 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.116 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.116 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.116 INFO:teuthology.orchestra.run.smithi049.stdout: "req_unlink_latency": { 2024-01-22T05:07:14.116 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8000, 2024-01-22T05:07:14.116 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 19.756481407, 2024-01-22T05:07:14.116 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002469560 2024-01-22T05:07:14.116 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.117 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_revoke_eviction": 0, 2024-01-22T05:07:14.117 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_acquisition_throttle": 0, 2024-01-22T05:07:14.117 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getvxattr_latency": { 2024-01-22T05:07:14.117 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.117 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.117 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.117 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:14.117 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.117 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_sessions": { 2024-01-22T05:07:14.117 INFO:teuthology.orchestra.run.smithi049.stdout: "session_count": 1, 2024-01-22T05:07:14.117 INFO:teuthology.orchestra.run.smithi049.stdout: "session_add": 1, 2024-01-22T05:07:14.117 INFO:teuthology.orchestra.run.smithi049.stdout: "session_remove": 0, 2024-01-22T05:07:14.117 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_open": 1, 2024-01-22T05:07:14.117 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_stale": 0, 2024-01-22T05:07:14.117 INFO:teuthology.orchestra.run.smithi049.stdout: "total_load": 17381, 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: "average_load": 17381, 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_session_uptime": 74, 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: "mdthresh_evicted": 0 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 18706, 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 18706, 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-01-22T05:07:14.118 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-01-22T05:07:14.119 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-01-22T05:07:14.119 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Buffer_bytes": 0, 2024-01-22T05:07:14.119 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Buffer_items": 0, 2024-01-22T05:07:14.119 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Extent_bytes": 0, 2024-01-22T05:07:14.119 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Extent_items": 0, 2024-01-22T05:07:14.119 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Blob_bytes": 0, 2024-01-22T05:07:14.119 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Blob_items": 0, 2024-01-22T05:07:14.119 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_SharedBlob_bytes": 0, 2024-01-22T05:07:14.119 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_SharedBlob_items": 0, 2024-01-22T05:07:14.119 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-22T05:07:14.119 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-01-22T05:07:14.119 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-01-22T05:07:14.119 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-01-22T05:07:14.119 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-01-22T05:07:14.119 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-01-22T05:07:14.120 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-22T05:07:14.120 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-01-22T05:07:14.120 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-01-22T05:07:14.120 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-01-22T05:07:14.120 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-01-22T05:07:14.120 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-01-22T05:07:14.120 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-01-22T05:07:14.120 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-01-22T05:07:14.120 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-01-22T05:07:14.120 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-01-22T05:07:14.120 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 8588559, 2024-01-22T05:07:14.120 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 2246, 2024-01-22T05:07:14.120 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-01-22T05:07:14.120 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-01-22T05:07:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-01-22T05:07:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-01-22T05:07:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-01-22T05:07:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-01-22T05:07:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-01-22T05:07:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-01-22T05:07:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 6504, 2024-01-22T05:07:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 85, 2024-01-22T05:07:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-01-22T05:07:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-01-22T05:07:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-01-22T05:07:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-01-22T05:07:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 15492336, 2024-01-22T05:07:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 599699, 2024-01-22T05:07:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": { 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 10142, 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 90158653, 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 25, 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 10142, 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 10142, 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 17677 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 10142, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 64, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 10078, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 34, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 3707, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 64, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 4467, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 56, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 1725, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 45, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-01-22T05:07:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-01-22T05:07:14.124 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-01-22T05:07:14.124 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-01-22T05:07:14.124 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 7414, 2024-01-22T05:07:14.124 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-01-22T05:07:14.124 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-01-22T05:07:14.124 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-01-22T05:07:14.124 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-01-22T05:07:14.124 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-01-22T05:07:14.124 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-01-22T05:07:14.124 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-01-22T05:07:14.124 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-01-22T05:07:14.124 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-01-22T05:07:14.124 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-01-22T05:07:14.124 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-01-22T05:07:14.125 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 42, 2024-01-22T05:07:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-01-22T05:07:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 3, 2024-01-22T05:07:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 8, 2024-01-22T05:07:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 8, 2024-01-22T05:07:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-01-22T05:07:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-01-22T05:07:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 134, 2024-01-22T05:07:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-01-22T05:07:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 31 2024-01-22T05:07:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: "oft": { 2024-01-22T05:07:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_objs": 1, 2024-01-22T05:07:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_kv_pairs": 0, 2024-01-22T05:07:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_updates": 0, 2024-01-22T05:07:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_removes": 0 2024-01-22T05:07:14.127 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.127 INFO:teuthology.orchestra.run.smithi049.stdout: "purge_queue": { 2024-01-22T05:07:14.127 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops": 0, 2024-01-22T05:07:14.127 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops_high_water": 32, 2024-01-22T05:07:14.127 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing": 0, 2024-01-22T05:07:14.127 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_high_water": 32, 2024-01-22T05:07:14.127 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed": 1725, 2024-01-22T05:07:14.127 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_item_in_journal": 0 2024-01-22T05:07:14.127 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.127 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-22T05:07:14.127 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:07:14.127 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-01-22T05:07:14.127 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:07:14.127 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 38000, 2024-01-22T05:07:14.127 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 9677839, 2024-01-22T05:07:14.128 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:07:14.128 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 38000, 2024-01-22T05:07:14.128 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-01-22T05:07:14.128 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-01-22T05:07:14.128 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 38000, 2024-01-22T05:07:14.128 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 9677839, 2024-01-22T05:07:14.128 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:07:14.128 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.128 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.128 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.128 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:14.128 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.128 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": { 2024-01-22T05:07:14.128 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:07:14.129 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-01-22T05:07:14.129 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:07:14.129 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-01-22T05:07:14.129 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-01-22T05:07:14.129 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:07:14.129 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-01-22T05:07:14.129 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 10142, 2024-01-22T05:07:14.129 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 90346678, 2024-01-22T05:07:14.129 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 10142, 2024-01-22T05:07:14.129 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 90346678, 2024-01-22T05:07:14.129 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:07:14.129 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.129 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.129 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.129 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:14.130 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.130 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": { 2024-01-22T05:07:14.130 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:07:14.130 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-01-22T05:07:14.130 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:07:14.130 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-01-22T05:07:14.130 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-01-22T05:07:14.130 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:07:14.130 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-01-22T05:07:14.130 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 10142, 2024-01-22T05:07:14.130 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 10142, 2024-01-22T05:07:14.130 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 10142, 2024-01-22T05:07:14.130 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 10142, 2024-01-22T05:07:14.130 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:07:14.130 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.131 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.131 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.131 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:14.131 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.131 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle": { 2024-01-22T05:07:14.131 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:07:14.131 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-01-22T05:07:14.131 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:07:14.131 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 1725, 2024-01-22T05:07:14.131 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 188025, 2024-01-22T05:07:14.131 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:07:14.131 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 1725, 2024-01-22T05:07:14.131 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 64, 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 188025, 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle-0x560704f14280": { 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 84, 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 24497, 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 80883095, 2024-01-22T05:07:14.132 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:07:14.133 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 24497, 2024-01-22T05:07:14.133 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-01-22T05:07:14.133 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-01-22T05:07:14.133 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 4403, 2024-01-22T05:07:14.133 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 80883011, 2024-01-22T05:07:14.133 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:07:14.133 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:14.133 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:14.133 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:14.133 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:14.133 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:14.133 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:07:14.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.090+0000 7faa7fe00700 1 -- 172.21.15.49:0/2373106304 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faa5005a540 msgr2=0x7faa5005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.090+0000 7faa7fe00700 1 --2- 172.21.15.49:0/2373106304 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faa5005a540 0x7faa5005ca00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7faa68003900 tx=0x7faa68007d40).stop 2024-01-22T05:07:14.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.090+0000 7faa7fe00700 1 -- 172.21.15.49:0/2373106304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa780c4070 msgr2=0x7faa780a13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.090+0000 7faa7fe00700 1 --2- 172.21.15.49:0/2373106304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa780c4070 0x7faa780a13e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7faa6000c4c0 tx=0x7faa60007c10).stop 2024-01-22T05:07:14.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.090+0000 7faa7fe00700 1 -- 172.21.15.49:0/2373106304 shutdown_connections 2024-01-22T05:07:14.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.090+0000 7faa7fe00700 1 --2- 172.21.15.49:0/2373106304 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faa5005a540 0x7faa5005ca00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.090+0000 7faa7fe00700 1 --2- 172.21.15.49:0/2373106304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa780c7630 0x7faa780abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.090+0000 7faa7fe00700 1 --2- 172.21.15.49:0/2373106304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa780c4070 0x7faa780a13e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.090+0000 7faa7fe00700 1 --2- 172.21.15.49:0/2373106304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780bcdd0 0x7faa78149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.090+0000 7faa7fe00700 1 -- 172.21.15.49:0/2373106304 >> 172.21.15.49:0/2373106304 conn(0x7faa780c8720 msgr2=0x7faa780631a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.090+0000 7faa7fe00700 1 -- 172.21.15.49:0/2373106304 shutdown_connections 2024-01-22T05:07:14.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.090+0000 7faa7fe00700 1 -- 172.21.15.49:0/2373106304 wait complete. 2024-01-22T05:07:14.136 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-01-22T05:07:14.136 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2024-01-22T05:07:14.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.314+0000 7fa26fa00700 1 Processor -- start 2024-01-22T05:07:14.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.314+0000 7fa26fa00700 1 -- start start 2024-01-22T05:07:14.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.314+0000 7fa26fa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa268160bd0 0x7fa268162fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.314+0000 7fa26fa00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2680a7cb0 con 0x7fa2680ac3b0 2024-01-22T05:07:14.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.314+0000 7fa26fa00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2680a8b10 con 0x7fa268066690 2024-01-22T05:07:14.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.314+0000 7fa26fa00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680a7f00 con 0x7fa268160bd0 2024-01-22T05:07:14.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.314+0000 7fa26d000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa2680ac3b0 0x7fa268159000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54358/0 (socket says 172.21.15.49:54358) 2024-01-22T05:07:14.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.314+0000 7fa26d000700 1 -- 172.21.15.49:0/2932368921 learned_addr learned my addr 172.21.15.49:0/2932368921 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:14.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.314+0000 7fa26da00700 1 --2- 172.21.15.49:0/2932368921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa268160bd0 0x7fa268162fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.314+0000 7fa267400700 1 -- 172.21.15.49:0/2932368921 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294854970 0 0) 0x7fa2680a7cb0 con 0x7fa2680ac3b0 2024-01-22T05:07:14.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.314+0000 7fa267400700 1 -- 172.21.15.49:0/2932368921 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2480033f0 con 0x7fa2680ac3b0 2024-01-22T05:07:14.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa267400700 1 -- 172.21.15.49:0/2932368921 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634414930 0 0) 0x7fa2680a8b10 con 0x7fa268066690 2024-01-22T05:07:14.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa267400700 1 -- 172.21.15.49:0/2932368921 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2680a7cb0 con 0x7fa268066690 2024-01-22T05:07:14.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa26da00700 1 -- 172.21.15.49:0/2932368921 >> v1:172.21.15.110:6789/0 conn(0x7fa268066690 legacy=0x7fa268066af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa26da00700 1 -- 172.21.15.49:0/2932368921 >> v1:172.21.15.49:6789/0 conn(0x7fa2680ac3b0 legacy=0x7fa268159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa26da00700 1 -- 172.21.15.49:0/2932368921 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2680a81e0 con 0x7fa268160bd0 2024-01-22T05:07:14.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa26da00700 1 --2- 172.21.15.49:0/2932368921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa268160bd0 0x7fa268162fc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa260009e90 tx=0x7fa260009780).ready entity=mon.2 client_cookie=bf74c2ce1772ccc5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa267400700 1 -- 172.21.15.49:0/2932368921 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26000e070 con 0x7fa268160bd0 2024-01-22T05:07:14.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa267400700 1 -- 172.21.15.49:0/2932368921 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26000bab0 con 0x7fa268160bd0 2024-01-22T05:07:14.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa267400700 1 -- 172.21.15.49:0/2932368921 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26000be30 con 0x7fa268160bd0 2024-01-22T05:07:14.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa26fa00700 1 -- 172.21.15.49:0/2932368921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa268160bd0 msgr2=0x7fa268162fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa26fa00700 1 --2- 172.21.15.49:0/2932368921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa268160bd0 0x7fa268162fc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa260009e90 tx=0x7fa260009780).stop 2024-01-22T05:07:14.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa26fa00700 1 -- 172.21.15.49:0/2932368921 shutdown_connections 2024-01-22T05:07:14.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa26fa00700 1 --2- 172.21.15.49:0/2932368921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa268160bd0 0x7fa268162fc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa26fa00700 1 -- 172.21.15.49:0/2932368921 >> 172.21.15.49:0/2932368921 conn(0x7fa2680c6500 msgr2=0x7fa2680c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa26fa00700 1 -- 172.21.15.49:0/2932368921 shutdown_connections 2024-01-22T05:07:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.318+0000 7fa26fa00700 1 -- 172.21.15.49:0/2932368921 wait complete. 2024-01-22T05:07:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.322+0000 7fa26fa00700 1 Processor -- start 2024-01-22T05:07:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26fa00700 1 -- start start 2024-01-22T05:07:14.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26fa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa268066690 0x7fa2680bbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26fa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2680ac3b0 0x7fa26814e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26fa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa268160bd0 0x7fa268149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26fa00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680bbb50 con 0x7fa268066690 2024-01-22T05:07:14.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26fa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26814ef40 con 0x7fa2680ac3b0 2024-01-22T05:07:14.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26fa00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26814f220 con 0x7fa268160bd0 2024-01-22T05:07:14.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa268066690 0x7fa2680bbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa268066690 0x7fa2680bbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37620/0 (socket says 172.21.15.49:37620) 2024-01-22T05:07:14.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26d000700 1 -- 172.21.15.49:0/552379573 learned_addr learned my addr 172.21.15.49:0/552379573 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:14.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26da00700 1 --2- 172.21.15.49:0/552379573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa268160bd0 0x7fa268149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa267e00700 1 --2- 172.21.15.49:0/552379573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2680ac3b0 0x7fa26814e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26d000700 1 -- 172.21.15.49:0/552379573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa268160bd0 msgr2=0x7fa268149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26d000700 1 --2- 172.21.15.49:0/552379573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa268160bd0 0x7fa268149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26d000700 1 -- 172.21.15.49:0/552379573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2680ac3b0 msgr2=0x7fa26814e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26d000700 1 --2- 172.21.15.49:0/552379573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2680ac3b0 0x7fa26814e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26d000700 1 -- 172.21.15.49:0/552379573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa260009a20 con 0x7fa268066690 2024-01-22T05:07:14.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26da00700 1 --2- 172.21.15.49:0/552379573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa268160bd0 0x7fa268149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:14.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.326+0000 7fa26d000700 1 --2- 172.21.15.49:0/552379573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa268066690 0x7fa2680bbfe0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fa25800c560 tx=0x7fa258007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.330+0000 7fa25fe00700 1 -- 172.21.15.49:0/552379573 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800ce70 con 0x7fa268066690 2024-01-22T05:07:14.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.330+0000 7fa25fe00700 1 -- 172.21.15.49:0/552379573 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2580072e0 con 0x7fa268066690 2024-01-22T05:07:14.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.330+0000 7fa25fe00700 1 -- 172.21.15.49:0/552379573 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258007660 con 0x7fa268066690 2024-01-22T05:07:14.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.330+0000 7fa26fa00700 1 -- 172.21.15.49:0/552379573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2680bb500 con 0x7fa268066690 2024-01-22T05:07:14.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.330+0000 7fa26fa00700 1 -- 172.21.15.49:0/552379573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2680bc4d0 con 0x7fa268066690 2024-01-22T05:07:14.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.330+0000 7fa25fe00700 1 -- 172.21.15.49:0/552379573 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa2580059b0 con 0x7fa268066690 2024-01-22T05:07:14.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.334+0000 7fa25fe00700 1 --2- 172.21.15.49:0/552379573 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa24005a510 0x7fa24005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.334+0000 7fa25fe00700 1 -- 172.21.15.49:0/552379573 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6561+0+0 (secure 0 0 0) 0x7fa258073f50 con 0x7fa268066690 2024-01-22T05:07:14.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.334+0000 7fa267e00700 1 --2- 172.21.15.49:0/552379573 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa24005a510 0x7fa24005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.334+0000 7fa267e00700 1 --2- 172.21.15.49:0/552379573 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa24005a510 0x7fa24005c9d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fa2680c5ec0 tx=0x7fa250007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.338+0000 7fa279ed2740 1 Processor -- start 2024-01-22T05:07:14.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.338+0000 7fa279ed2740 1 -- start start 2024-01-22T05:07:14.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.338+0000 7fa279ed2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26efee0 0x2704d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.338+0000 7fa279ed2740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f02c0 0x273c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.338+0000 7fa279ed2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x273ca70 0x273cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.338+0000 7fa279ed2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2621080 con 0x273ca70 2024-01-22T05:07:14.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.338+0000 7fa279ed2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x26224c0 con 0x26efee0 2024-01-22T05:07:14.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.338+0000 7fa279ed2740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x263b2d0 con 0x26f02c0 2024-01-22T05:07:14.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.338+0000 7fa26da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x273ca70 0x273cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.338+0000 7fa26da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x273ca70 0x273cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37630/0 (socket says 172.21.15.49:37630) 2024-01-22T05:07:14.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.338+0000 7fa26da00700 1 -- 172.21.15.49:0/1056609310 learned_addr learned my addr 172.21.15.49:0/1056609310 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:14.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.338+0000 7fa267e00700 1 --2- 172.21.15.49:0/1056609310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f02c0 0x273c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.338+0000 7fa26d000700 1 --2- 172.21.15.49:0/1056609310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26efee0 0x2704d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa26da00700 1 -- 172.21.15.49:0/1056609310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f02c0 msgr2=0x273c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa26da00700 1 --2- 172.21.15.49:0/1056609310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f02c0 0x273c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa26da00700 1 -- 172.21.15.49:0/1056609310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26efee0 msgr2=0x2704d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa26da00700 1 --2- 172.21.15.49:0/1056609310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26efee0 0x2704d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa26da00700 1 -- 172.21.15.49:0/1056609310 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x267ab00 con 0x273ca70 2024-01-22T05:07:14.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa26da00700 1 --2- 172.21.15.49:0/1056609310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x273ca70 0x273cef0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fa268064350 tx=0x7fa260009780).ready entity=mon.0 client_cookie=723153d5402a3998 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa25cc00700 1 -- 172.21.15.49:0/1056609310 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260012870 con 0x273ca70 2024-01-22T05:07:14.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa25cc00700 1 -- 172.21.15.49:0/1056609310 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2600129d0 con 0x273ca70 2024-01-22T05:07:14.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa25cc00700 1 -- 172.21.15.49:0/1056609310 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260012b40 con 0x273ca70 2024-01-22T05:07:14.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa279ed2740 1 -- 172.21.15.49:0/1056609310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x273ca70 msgr2=0x273cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa279ed2740 1 --2- 172.21.15.49:0/1056609310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x273ca70 0x273cef0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fa268064350 tx=0x7fa260009780).stop 2024-01-22T05:07:14.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa279ed2740 1 -- 172.21.15.49:0/1056609310 shutdown_connections 2024-01-22T05:07:14.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa279ed2740 1 --2- 172.21.15.49:0/1056609310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x273ca70 0x273cef0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa279ed2740 1 --2- 172.21.15.49:0/1056609310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f02c0 0x273c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa279ed2740 1 --2- 172.21.15.49:0/1056609310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26efee0 0x2704d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa279ed2740 1 -- 172.21.15.49:0/1056609310 >> 172.21.15.49:0/1056609310 conn(0x24ce8f0 msgr2=0x26eeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa279ed2740 1 -- 172.21.15.49:0/1056609310 shutdown_connections 2024-01-22T05:07:14.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa279ed2740 1 -- 172.21.15.49:0/1056609310 wait complete. 2024-01-22T05:07:14.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.342+0000 7fa279ed2740 1 -- start start 2024-01-22T05:07:14.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa279ed2740 1 Processor -- start 2024-01-22T05:07:14.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa279ed2740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26efee0 0x273a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa279ed2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26f02c0 0x2734e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa279ed2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x273ca70 0x273a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa279ed2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2716b50 con 0x273ca70 2024-01-22T05:07:14.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa279ed2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x273c1c0 con 0x26f02c0 2024-01-22T05:07:14.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa279ed2740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2738a10 con 0x26efee0 2024-01-22T05:07:14.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa279ed2740 10 client.0 ll_register_callbacks cb 0x26a7330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:07:14.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa26da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x273ca70 0x273a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa26d000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26efee0 0x273a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa26da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x273ca70 0x273a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37634/0 (socket says 172.21.15.49:37634) 2024-01-22T05:07:14.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa26da00700 1 -- 172.21.15.49:0/4114739481 learned_addr learned my addr 172.21.15.49:0/4114739481 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:14.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa267e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26f02c0 0x2734e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa26da00700 1 -- 172.21.15.49:0/4114739481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26efee0 msgr2=0x273a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa26da00700 1 --2- 172.21.15.49:0/4114739481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26efee0 0x273a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa26da00700 1 -- 172.21.15.49:0/4114739481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26f02c0 msgr2=0x2734e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa26da00700 1 --2- 172.21.15.49:0/4114739481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26f02c0 0x2734e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.346+0000 7fa26da00700 1 -- 172.21.15.49:0/4114739481 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2680a81e0 con 0x273ca70 2024-01-22T05:07:14.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa26da00700 1 --2- 172.21.15.49:0/4114739481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x273ca70 0x273a930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fa260009de0 tx=0x7fa260020070).ready entity=mon.0 client_cookie=e800588ebd6e44cd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa255600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:07:14.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa255600700 1 -- 172.21.15.49:0/4114739481 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260012870 con 0x273ca70 2024-01-22T05:07:14.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa255600700 1 -- 172.21.15.49:0/4114739481 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6561+0+0 (secure 0 0 0) 0x7fa26001db70 con 0x273ca70 2024-01-22T05:07:14.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa279ed2740 1 -- 172.21.15.49:0/4114739481 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2665db0 con 0x273ca70 2024-01-22T05:07:14.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa255600700 1 -- 172.21.15.49:0/4114739481 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa260012b40 con 0x273ca70 2024-01-22T05:07:14.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa279ed2740 10 client.5370 fetch_fsmap learned FSMap version 31 2024-01-22T05:07:14.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa279ed2740 1 -- 172.21.15.49:0/4114739481 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x2669340 con 0x273ca70 2024-01-22T05:07:14.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa255600700 1 -- 172.21.15.49:0/4114739481 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2665db0 con 0x273ca70 2024-01-22T05:07:14.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa255600700 1 -- 172.21.15.49:0/4114739481 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa26001dd30 con 0x273ca70 2024-01-22T05:07:14.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa279ed2740 10 client.5370 fetch_fsmap finished waiting for FSMap version 31 2024-01-22T05:07:14.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa279ed2740 10 client.5370 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-01-22T05:07:14.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa279ed2740 20 client.5370 populate_metadata read hostname 'smithi049' 2024-01-22T05:07:14.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa279ed2740 1 --2- 172.21.15.49:0/4114739481 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x2719180 0x2719560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa279ed2740 4 client.5370 mds_command: new command op to 5121 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:07:14.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa279ed2740 1 -- 172.21.15.49:0/4114739481 --> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x265c300 con 0x2719180 2024-01-22T05:07:14.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa26d000700 1 --2- 172.21.15.49:0/4114739481 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x2719180 0x2719560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa255600700 10 client.5370 ms_handle_connect on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:14.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa26d000700 1 --2- 172.21.15.49:0/4114739481 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x2719180 0x2719560 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=da37876dfe5de01f server_cookie=98d75b54e1ff4de4 in_seq=0 out_seq=0 2024-01-22T05:07:14.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa255600700 1 -- 172.21.15.49:0/4114739481 <== mds.0 v2:172.21.15.49:6834/3211151680 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x265c300 con 0x2719180 2024-01-22T05:07:14.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa255600700 10 client.5370 handle_command_reply: tid=0 2024-01-22T05:07:14.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.350+0000 7fa279ed2740 1 client.5370 shutdown 2024-01-22T05:07:14.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.354+0000 7fa279ed2740 1 -- 172.21.15.49:0/4114739481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x273ca70 msgr2=0x273a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.354+0000 7fa279ed2740 1 --2- 172.21.15.49:0/4114739481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x273ca70 0x273a930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fa260009de0 tx=0x7fa260020070).stop 2024-01-22T05:07:14.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.354+0000 7fa279ed2740 1 -- 172.21.15.49:0/4114739481 shutdown_connections 2024-01-22T05:07:14.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.354+0000 7fa279ed2740 1 --2- 172.21.15.49:0/4114739481 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x2719180 0x2719560 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.354+0000 7fa279ed2740 1 --2- 172.21.15.49:0/4114739481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x273ca70 0x273a930 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.354+0000 7fa279ed2740 1 --2- 172.21.15.49:0/4114739481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26f02c0 0x2734e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.354+0000 7fa279ed2740 1 --2- 172.21.15.49:0/4114739481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26efee0 0x273a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.354+0000 7fa279ed2740 1 -- 172.21.15.49:0/4114739481 >> 172.21.15.49:0/4114739481 conn(0x24ce8f0 msgr2=0x26e9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.354+0000 7fa255600700 0 client.5370 ms_handle_reset on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:14.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.354+0000 7fa279ed2740 1 -- 172.21.15.49:0/4114739481 shutdown_connections 2024-01-22T05:07:14.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.354+0000 7fa279ed2740 1 -- 172.21.15.49:0/4114739481 wait complete. 2024-01-22T05:07:14.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.354+0000 7fa279ed2740 20 client.5370 trim_cache size 0 max 16384 2024-01-22T05:07:14.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.374+0000 7fa279ed2740 1 Processor -- start 2024-01-22T05:07:14.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.374+0000 7fa279ed2740 1 -- start start 2024-01-22T05:07:14.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa279ed2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26efee0 0x2734710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa279ed2740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f02c0 0x2734c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa279ed2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x273ca70 0x274c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa279ed2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x262e960 con 0x26efee0 2024-01-22T05:07:14.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa279ed2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2705a30 con 0x273ca70 2024-01-22T05:07:14.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa279ed2740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2694d50 con 0x26f02c0 2024-01-22T05:07:14.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa26d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26efee0 0x2734710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa26d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26efee0 0x2734710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37640/0 (socket says 172.21.15.49:37640) 2024-01-22T05:07:14.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa26d000700 1 -- 172.21.15.49:0/2956927173 learned_addr learned my addr 172.21.15.49:0/2956927173 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:14.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa267e00700 1 --2- 172.21.15.49:0/2956927173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f02c0 0x2734c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa26da00700 1 --2- 172.21.15.49:0/2956927173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x273ca70 0x274c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa26d000700 1 -- 172.21.15.49:0/2956927173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f02c0 msgr2=0x2734c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa26d000700 1 --2- 172.21.15.49:0/2956927173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f02c0 0x2734c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa26d000700 1 -- 172.21.15.49:0/2956927173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x273ca70 msgr2=0x274c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa26d000700 1 --2- 172.21.15.49:0/2956927173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x273ca70 0x274c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa26d000700 1 -- 172.21.15.49:0/2956927173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2680abc30 con 0x26efee0 2024-01-22T05:07:14.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa26d000700 1 --2- 172.21.15.49:0/2956927173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26efee0 0x2734710 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fa258012000 tx=0x7fa258015040).ready entity=mon.0 client_cookie=f5339507c62ff9f7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa25d600700 1 -- 172.21.15.49:0/2956927173 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258056070 con 0x26efee0 2024-01-22T05:07:14.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa25d600700 1 -- 172.21.15.49:0/2956927173 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa258047940 con 0x26efee0 2024-01-22T05:07:14.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.378+0000 7fa25d600700 1 -- 172.21.15.49:0/2956927173 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258005e70 con 0x26efee0 2024-01-22T05:07:14.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.382+0000 7fa279ed2740 1 -- 172.21.15.49:0/2956927173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26efee0 msgr2=0x2734710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.382+0000 7fa279ed2740 1 --2- 172.21.15.49:0/2956927173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26efee0 0x2734710 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fa258012000 tx=0x7fa258015040).stop 2024-01-22T05:07:14.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.382+0000 7fa279ed2740 1 -- 172.21.15.49:0/2956927173 shutdown_connections 2024-01-22T05:07:14.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.382+0000 7fa279ed2740 1 --2- 172.21.15.49:0/2956927173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x273ca70 0x274c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.382+0000 7fa279ed2740 1 --2- 172.21.15.49:0/2956927173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f02c0 0x2734c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.382+0000 7fa279ed2740 1 --2- 172.21.15.49:0/2956927173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26efee0 0x2734710 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.382+0000 7fa279ed2740 1 -- 172.21.15.49:0/2956927173 >> 172.21.15.49:0/2956927173 conn(0x24ce8f0 msgr2=0x273b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.382+0000 7fa279ed2740 1 -- 172.21.15.49:0/2956927173 shutdown_connections 2024-01-22T05:07:14.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.382+0000 7fa279ed2740 1 -- 172.21.15.49:0/2956927173 wait complete. 2024-01-22T05:07:14.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.382+0000 7fa279ed2740 1 -- start start 2024-01-22T05:07:14.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.382+0000 7fa279ed2740 1 Processor -- start 2024-01-22T05:07:14.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26efee0 0x2734710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f02c0 0x2734c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x273ca70 0x274c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x27350f0 con 0x26efee0 2024-01-22T05:07:14.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x278d380 con 0x273ca70 2024-01-22T05:07:14.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x273a2b0 con 0x26f02c0 2024-01-22T05:07:14.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 10 client.0 ll_register_callbacks cb 0x7fa260015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:07:14.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa26d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26efee0 0x2734710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa26d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26efee0 0x2734710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37646/0 (socket says 172.21.15.49:37646) 2024-01-22T05:07:14.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa26d000700 1 -- 172.21.15.49:0/4284439891 learned_addr learned my addr 172.21.15.49:0/4284439891 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:14.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa267e00700 1 --2- 172.21.15.49:0/4284439891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f02c0 0x2734c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa26da00700 1 --2- 172.21.15.49:0/4284439891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x273ca70 0x274c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa26d000700 1 -- 172.21.15.49:0/4284439891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f02c0 msgr2=0x2734c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa26d000700 1 --2- 172.21.15.49:0/4284439891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f02c0 0x2734c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa26d000700 1 -- 172.21.15.49:0/4284439891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x273ca70 msgr2=0x274c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa26d000700 1 --2- 172.21.15.49:0/4284439891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x273ca70 0x274c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa26d000700 1 -- 172.21.15.49:0/4284439891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2680bc4d0 con 0x26efee0 2024-01-22T05:07:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa26d000700 1 --2- 172.21.15.49:0/4284439891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26efee0 0x2734710 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fa25804b380 tx=0x7fa258018000).ready entity=mon.0 client_cookie=2b3b5babdf12335d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa255600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:07:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa255600700 1 -- 172.21.15.49:0/4284439891 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258060070 con 0x26efee0 2024-01-22T05:07:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa255600700 1 -- 172.21.15.49:0/4284439891 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6561+0+0 (secure 0 0 0) 0x7fa258050040 con 0x26efee0 2024-01-22T05:07:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 1 -- 172.21.15.49:0/4284439891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x273c050 con 0x26efee0 2024-01-22T05:07:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa255600700 1 -- 172.21.15.49:0/4284439891 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa258005820 con 0x26efee0 2024-01-22T05:07:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 10 client.5376 fetch_fsmap learned FSMap version 31 2024-01-22T05:07:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 1 -- 172.21.15.49:0/4284439891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x27198c0 con 0x26efee0 2024-01-22T05:07:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa255600700 1 -- 172.21.15.49:0/4284439891 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x273c050 con 0x26efee0 2024-01-22T05:07:14.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa255600700 1 -- 172.21.15.49:0/4284439891 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa258047020 con 0x26efee0 2024-01-22T05:07:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 10 client.5376 fetch_fsmap finished waiting for FSMap version 31 2024-01-22T05:07:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 10 client.5376 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-01-22T05:07:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 20 client.5376 populate_metadata read hostname 'smithi049' 2024-01-22T05:07:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 1 --2- 172.21.15.49:0/4284439891 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x273c300 0x274c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 4 client.5376 mds_command: new command op to 5121 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2024-01-22T05:07:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.386+0000 7fa279ed2740 1 -- 172.21.15.49:0/4284439891 --> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) v1 -- 0x7fa2600129d0 con 0x273c300 2024-01-22T05:07:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.390+0000 7fa267e00700 1 --2- 172.21.15.49:0/4284439891 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x273c300 0x274c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.390+0000 7fa267e00700 1 --2- 172.21.15.49:0/4284439891 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x273c300 0x274c900 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4864f37615c512f7 server_cookie=afac3acb69e1e2b6 in_seq=0 out_seq=0 2024-01-22T05:07:14.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.390+0000 7fa255600700 10 client.5376 ms_handle_connect on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:14.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.398+0000 7fa255600700 1 -- 172.21.15.49:0/4284439891 <== mds.0 v2:172.21.15.49:6834/3211151680 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7fa2600129d0 con 0x273c300 2024-01-22T05:07:14.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.398+0000 7fa255600700 10 client.5376 handle_command_reply: tid=0 2024-01-22T05:07:14.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.398+0000 7fa279ed2740 1 client.5376 shutdown 2024-01-22T05:07:14.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.398+0000 7fa279ed2740 1 -- 172.21.15.49:0/4284439891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26efee0 msgr2=0x2734710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.398+0000 7fa279ed2740 1 --2- 172.21.15.49:0/4284439891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26efee0 0x2734710 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fa25804b380 tx=0x7fa258018000).stop 2024-01-22T05:07:14.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.398+0000 7fa279ed2740 1 -- 172.21.15.49:0/4284439891 shutdown_connections 2024-01-22T05:07:14.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.398+0000 7fa279ed2740 1 --2- 172.21.15.49:0/4284439891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x273ca70 0x274c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.398+0000 7fa279ed2740 1 --2- 172.21.15.49:0/4284439891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f02c0 0x2734c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.398+0000 7fa279ed2740 1 --2- 172.21.15.49:0/4284439891 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x273c300 0x274c900 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.398+0000 7fa279ed2740 1 --2- 172.21.15.49:0/4284439891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26efee0 0x2734710 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.398+0000 7fa279ed2740 1 -- 172.21.15.49:0/4284439891 >> 172.21.15.49:0/4284439891 conn(0x24ce8f0 msgr2=0x2737180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.398+0000 7fa255600700 0 client.5376 ms_handle_reset on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:14.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.398+0000 7fa279ed2740 1 -- 172.21.15.49:0/4284439891 shutdown_connections 2024-01-22T05:07:14.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.398+0000 7fa279ed2740 1 -- 172.21.15.49:0/4284439891 wait complete. 2024-01-22T05:07:14.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.398+0000 7fa279ed2740 20 client.5376 trim_cache size 0 max 16384 2024-01-22T05:07:14.405 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:07:14.405 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:07:14.405 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "8dc24c63-672d-4b8e-a709-ce142352623f", 2024-01-22T05:07:14.405 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:07:14.406 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:07:14.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.402+0000 7fa26fa00700 1 -- 172.21.15.49:0/552379573 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa24005a510 msgr2=0x7fa24005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.402+0000 7fa26fa00700 1 --2- 172.21.15.49:0/552379573 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa24005a510 0x7fa24005c9d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fa2680c5ec0 tx=0x7fa250007bb0).stop 2024-01-22T05:07:14.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.402+0000 7fa26fa00700 1 -- 172.21.15.49:0/552379573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa268066690 msgr2=0x7fa2680bbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.402+0000 7fa26fa00700 1 --2- 172.21.15.49:0/552379573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa268066690 0x7fa2680bbfe0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fa25800c560 tx=0x7fa258007d20).stop 2024-01-22T05:07:14.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.402+0000 7fa26fa00700 1 -- 172.21.15.49:0/552379573 shutdown_connections 2024-01-22T05:07:14.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.402+0000 7fa26fa00700 1 --2- 172.21.15.49:0/552379573 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa24005a510 0x7fa24005c9d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.402+0000 7fa26fa00700 1 --2- 172.21.15.49:0/552379573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa268160bd0 0x7fa268149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.402+0000 7fa26fa00700 1 --2- 172.21.15.49:0/552379573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2680ac3b0 0x7fa26814e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.402+0000 7fa26fa00700 1 --2- 172.21.15.49:0/552379573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa268066690 0x7fa2680bbfe0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.402+0000 7fa26fa00700 1 -- 172.21.15.49:0/552379573 >> 172.21.15.49:0/552379573 conn(0x7fa2680c6500 msgr2=0x7fa26814bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.402+0000 7fa26fa00700 1 -- 172.21.15.49:0/552379573 shutdown_connections 2024-01-22T05:07:14.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.402+0000 7fa26fa00700 1 -- 172.21.15.49:0/552379573 wait complete. 2024-01-22T05:07:14.433 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2024-01-22T05:07:14.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.593+0000 7f05c7c00700 1 Processor -- start 2024-01-22T05:07:14.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.593+0000 7f05c7c00700 1 -- start start 2024-01-22T05:07:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.597+0000 7f05c7c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c0153960 0x7f05c0153d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.597+0000 7f05c7c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f05c0063d10 0x7f05c0064110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.597+0000 7f05c7c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c0069710 con 0x7f05c00bcf70 2024-01-22T05:07:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.597+0000 7f05c7c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c0068880 con 0x7f05c0063d10 2024-01-22T05:07:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.597+0000 7f05c7c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c0068b00 con 0x7f05c0153960 2024-01-22T05:07:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.597+0000 7f05c5c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f05c00bcf70 0x7f05c0157750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54366/0 (socket says 172.21.15.49:54366) 2024-01-22T05:07:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.597+0000 7f05c5c00700 1 -- 172.21.15.49:0/3921483710 learned_addr learned my addr 172.21.15.49:0/3921483710 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.597+0000 7f05bfe00700 1 --2- 172.21.15.49:0/3921483710 >> v2:172.21.15.110:3300/0 conn(0x7f05c0063d10 0x7f05c0064110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.597+0000 7f05c5200700 1 --2- 172.21.15.49:0/3921483710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c0153960 0x7f05c0153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.597+0000 7f05bf400700 1 -- 172.21.15.49:0/3921483710 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812416815 0 0) 0x7f05c0069710 con 0x7f05c00bcf70 2024-01-22T05:07:14.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.597+0000 7f05bf400700 1 -- 172.21.15.49:0/3921483710 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05a00033f0 con 0x7f05c00bcf70 2024-01-22T05:07:14.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.597+0000 7f05c5200700 1 -- 172.21.15.49:0/3921483710 >> v2:172.21.15.110:3300/0 conn(0x7f05c0063d10 msgr2=0x7f05c0064110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.597+0000 7f05c5200700 1 --2- 172.21.15.49:0/3921483710 >> v2:172.21.15.110:3300/0 conn(0x7f05c0063d10 0x7f05c0064110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.597+0000 7f05c5200700 1 -- 172.21.15.49:0/3921483710 >> v1:172.21.15.49:6789/0 conn(0x7f05c00bcf70 legacy=0x7f05c0157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.597+0000 7f05c5200700 1 -- 172.21.15.49:0/3921483710 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c0068de0 con 0x7f05c0153960 2024-01-22T05:07:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.601+0000 7f05c5200700 1 --2- 172.21.15.49:0/3921483710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c0153960 0x7f05c0153d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f05b0009760 tx=0x7f05b0009060).ready entity=mon.2 client_cookie=93da4867f0288944 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.601+0000 7f05bf400700 1 -- 172.21.15.49:0/3921483710 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b000d4a0 con 0x7f05c0153960 2024-01-22T05:07:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.601+0000 7f05bf400700 1 -- 172.21.15.49:0/3921483710 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b000d600 con 0x7f05c0153960 2024-01-22T05:07:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.601+0000 7f05bf400700 1 -- 172.21.15.49:0/3921483710 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b000d980 con 0x7f05c0153960 2024-01-22T05:07:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.601+0000 7f05c7c00700 1 -- 172.21.15.49:0/3921483710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c0153960 msgr2=0x7f05c0153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.601+0000 7f05c7c00700 1 --2- 172.21.15.49:0/3921483710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c0153960 0x7f05c0153d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f05b0009760 tx=0x7f05b0009060).stop 2024-01-22T05:07:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.605+0000 7f05c7c00700 1 -- 172.21.15.49:0/3921483710 shutdown_connections 2024-01-22T05:07:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.605+0000 7f05c7c00700 1 --2- 172.21.15.49:0/3921483710 >> v2:172.21.15.110:3300/0 conn(0x7f05c0063d10 0x7f05c0064110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.605+0000 7f05c7c00700 1 --2- 172.21.15.49:0/3921483710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c0153960 0x7f05c0153d40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.605+0000 7f05c7c00700 1 -- 172.21.15.49:0/3921483710 >> 172.21.15.49:0/3921483710 conn(0x7f05c0062720 msgr2=0x7f05c0062b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.605+0000 7f05c7c00700 1 -- 172.21.15.49:0/3921483710 shutdown_connections 2024-01-22T05:07:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.609+0000 7f05c7c00700 1 -- 172.21.15.49:0/3921483710 wait complete. 2024-01-22T05:07:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.629+0000 7f05c7c00700 1 Processor -- start 2024-01-22T05:07:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.629+0000 7f05c7c00700 1 -- start start 2024-01-22T05:07:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.633+0000 7f05c7c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c0063d10 0x7f05c01507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c7c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c00bcf70 0x7f05c016bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c7c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c0153960 0x7f05c016c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c7c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c016c6e0 con 0x7f05c0153960 2024-01-22T05:07:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c7c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c0155ff0 con 0x7f05c00bcf70 2024-01-22T05:07:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c7c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c01553e0 con 0x7f05c0063d10 2024-01-22T05:07:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c5200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c0063d10 0x7f05c01507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c5200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c0063d10 0x7f05c01507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:37020/0 (socket says 172.21.15.49:37020) 2024-01-22T05:07:14.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c5200700 1 -- 172.21.15.49:0/2437871636 learned_addr learned my addr 172.21.15.49:0/2437871636 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:14.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c5c00700 1 --2- 172.21.15.49:0/2437871636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c0153960 0x7f05c016c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c5200700 1 -- 172.21.15.49:0/2437871636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c00bcf70 msgr2=0x7f05c016bd00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-22T05:07:14.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c5200700 1 --2- 172.21.15.49:0/2437871636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c00bcf70 0x7f05c016bd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:07:14.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c5200700 1 -- 172.21.15.49:0/2437871636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c0153960 msgr2=0x7f05c016c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c5200700 1 --2- 172.21.15.49:0/2437871636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c0153960 0x7f05c016c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c5200700 1 -- 172.21.15.49:0/2437871636 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b00092a0 con 0x7f05c0063d10 2024-01-22T05:07:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c5c00700 1 --2- 172.21.15.49:0/2437871636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c0153960 0x7f05c016c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:07:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.637+0000 7f05c5200700 1 --2- 172.21.15.49:0/2437871636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c0063d10 0x7f05c01507d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f05b0009d50 tx=0x7f05b0016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.641+0000 7f05b7e00700 1 -- 172.21.15.49:0/2437871636 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0000cb0 con 0x7f05c0063d10 2024-01-22T05:07:14.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.641+0000 7f05b7e00700 1 -- 172.21.15.49:0/2437871636 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b000d770 con 0x7f05c0063d10 2024-01-22T05:07:14.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.641+0000 7f05b7e00700 1 -- 172.21.15.49:0/2437871636 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b001d430 con 0x7f05c0063d10 2024-01-22T05:07:14.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.641+0000 7f05c7c00700 1 -- 172.21.15.49:0/2437871636 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c01556c0 con 0x7f05c0063d10 2024-01-22T05:07:14.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.641+0000 7f05c7c00700 1 -- 172.21.15.49:0/2437871636 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c0155c80 con 0x7f05c0063d10 2024-01-22T05:07:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.649+0000 7f05b7e00700 1 -- 172.21.15.49:0/2437871636 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f05b001d860 con 0x7f05c0063d10 2024-01-22T05:07:14.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.649+0000 7f05b7e00700 1 --2- 172.21.15.49:0/2437871636 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f059805a560 0x7f059805ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.649+0000 7f05b7e00700 1 -- 172.21.15.49:0/2437871636 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6561+0+0 (secure 0 0 0) 0x7f05b00762a0 con 0x7f05c0063d10 2024-01-22T05:07:14.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.649+0000 7f05bfe00700 1 --2- 172.21.15.49:0/2437871636 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f059805a560 0x7f059805ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.657+0000 7f05d2099740 1 Processor -- start 2024-01-22T05:07:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.657+0000 7f05d2099740 1 -- start start 2024-01-22T05:07:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.657+0000 7f05d2099740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d3b4d0 0x1d3b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.657+0000 7f05d2099740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d42570 0x1d429f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.657+0000 7f05d2099740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d214f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.657+0000 7f05d2099740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c53540 con 0x1d42ee0 2024-01-22T05:07:14.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.657+0000 7f05d2099740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c16e90 con 0x1d3b4d0 2024-01-22T05:07:14.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.657+0000 7f05d2099740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c1cd90 con 0x1d42570 2024-01-22T05:07:14.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.661+0000 7f05c5c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d214f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.661+0000 7f05c5c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d214f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37670/0 (socket says 172.21.15.49:37670) 2024-01-22T05:07:14.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.661+0000 7f05c5c00700 1 -- 172.21.15.49:0/1603205668 learned_addr learned my addr 172.21.15.49:0/1603205668 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:14.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.661+0000 7f05c5c00700 1 -- 172.21.15.49:0/1603205668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d42570 msgr2=0x1d429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.661+0000 7f05c5c00700 1 --2- 172.21.15.49:0/1603205668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d42570 0x1d429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:07:14.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.661+0000 7f05c5c00700 1 -- 172.21.15.49:0/1603205668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d3b4d0 msgr2=0x1d3b8b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-22T05:07:14.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.661+0000 7f05c5c00700 1 --2- 172.21.15.49:0/1603205668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d3b4d0 0x1d3b8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:07:14.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.661+0000 7f05c5c00700 1 -- 172.21.15.49:0/1603205668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c814c0 con 0x1d42ee0 2024-01-22T05:07:14.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.661+0000 7f05bfe00700 1 --2- 172.21.15.49:0/2437871636 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f059805a560 0x7f059805ca20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f05c00c5450 tx=0x7f05a8009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.661+0000 7f05c5c00700 1 --2- 172.21.15.49:0/1603205668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d214f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f05b8001cc0 tx=0x7f05b8009040).ready entity=mon.0 client_cookie=8d233cdd54574cd8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.661+0000 7f05b4c00700 1 -- 172.21.15.49:0/1603205668 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8005d10 con 0x1d42ee0 2024-01-22T05:07:14.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.661+0000 7f05b4c00700 1 -- 172.21.15.49:0/1603205668 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b8005e70 con 0x1d42ee0 2024-01-22T05:07:14.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.661+0000 7f05b4c00700 1 -- 172.21.15.49:0/1603205668 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b800d7f0 con 0x1d42ee0 2024-01-22T05:07:14.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.661+0000 7f05d2099740 1 -- 172.21.15.49:0/1603205668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 msgr2=0x1d214f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.661+0000 7f05d2099740 1 --2- 172.21.15.49:0/1603205668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d214f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f05b8001cc0 tx=0x7f05b8009040).stop 2024-01-22T05:07:14.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.665+0000 7f05d2099740 1 -- 172.21.15.49:0/1603205668 shutdown_connections 2024-01-22T05:07:14.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.665+0000 7f05d2099740 1 --2- 172.21.15.49:0/1603205668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d214f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.665+0000 7f05d2099740 1 --2- 172.21.15.49:0/1603205668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d42570 0x1d429f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:07:14.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.665+0000 7f05d2099740 1 --2- 172.21.15.49:0/1603205668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d3b4d0 0x1d3b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:07:14.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.665+0000 7f05d2099740 1 -- 172.21.15.49:0/1603205668 >> 172.21.15.49:0/1603205668 conn(0x1ad5680 msgr2=0x1cf4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.665+0000 7f05d2099740 1 -- 172.21.15.49:0/1603205668 shutdown_connections 2024-01-22T05:07:14.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.665+0000 7f05d2099740 1 -- 172.21.15.49:0/1603205668 wait complete. 2024-01-22T05:07:14.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.665+0000 7f05d2099740 1 -- start start 2024-01-22T05:07:14.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.665+0000 7f05d2099740 1 Processor -- start 2024-01-22T05:07:14.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.669+0000 7f05d2099740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d3b4d0 0x1d12a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.669+0000 7f05d2099740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d42570 0x1d13600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.669+0000 7f05d2099740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d42ee0 0x1d13af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.669+0000 7f05d2099740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d18df0 con 0x1d3b4d0 2024-01-22T05:07:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.669+0000 7f05d2099740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d13fe0 con 0x1d42570 2024-01-22T05:07:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.669+0000 7f05d2099740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d1b000 con 0x1d42ee0 2024-01-22T05:07:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.669+0000 7f05d2099740 10 client.0 ll_register_callbacks cb 0x1cad5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:07:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.669+0000 7f05bfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d42570 0x1d13600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.669+0000 7f05bfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d42570 0x1d13600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:42192/0 (socket says 172.21.15.49:42192) 2024-01-22T05:07:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.669+0000 7f05bfe00700 1 -- 172.21.15.49:0/1579622317 learned_addr learned my addr 172.21.15.49:0/1579622317 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.669+0000 7f05bfe00700 1 -- 172.21.15.49:0/1579622317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d42ee0 msgr2=0x1d13af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.669+0000 7f05bfe00700 1 --2- 172.21.15.49:0/1579622317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d42ee0 0x1d13af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:07:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.669+0000 7f05bfe00700 1 -- 172.21.15.49:0/1579622317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d3b4d0 msgr2=0x1d12a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.669+0000 7f05bfe00700 1 --2- 172.21.15.49:0/1579622317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d3b4d0 0x1d12a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:07:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.669+0000 7f05bfe00700 1 -- 172.21.15.49:0/1579622317 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a00033f0 con 0x1d42570 2024-01-22T05:07:14.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.681+0000 7f05bfe00700 1 --2- 172.21.15.49:0/1579622317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d42570 0x1d13600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f05a8015600 tx=0x7f05a8016000).ready entity=mon.1 client_cookie=528624cdff9d68cb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.681+0000 7f05ad600700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-01-22T05:07:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.685+0000 7f05ad600700 1 -- 172.21.15.49:0/1579622317 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a80145e0 con 0x1d42570 2024-01-22T05:07:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.685+0000 7f05ad600700 1 -- 172.21.15.49:0/1579622317 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6561+0+0 (secure 0 0 0) 0x7f05a8014740 con 0x1d42570 2024-01-22T05:07:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.685+0000 7f05d2099740 1 -- 172.21.15.49:0/1579622317 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1c6d230 con 0x1d42570 2024-01-22T05:07:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.685+0000 7f05ad600700 1 -- 172.21.15.49:0/1579622317 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05a8014b10 con 0x1d42570 2024-01-22T05:07:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.685+0000 7f05d2099740 10 client.5347 fetch_fsmap learned FSMap version 31 2024-01-22T05:07:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.685+0000 7f05d2099740 1 -- 172.21.15.49:0/1579622317 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x1c707c0 con 0x1d42570 2024-01-22T05:07:14.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.689+0000 7f05ad600700 1 -- 172.21.15.49:0/1579622317 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1c6d230 con 0x1d42570 2024-01-22T05:07:14.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.689+0000 7f05ad600700 1 -- 172.21.15.49:0/1579622317 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f05a8026070 con 0x1d42570 2024-01-22T05:07:14.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.689+0000 7f05d2099740 10 client.5347 fetch_fsmap finished waiting for FSMap version 31 2024-01-22T05:07:14.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.689+0000 7f05d2099740 10 client.5347 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-01-22T05:07:14.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.689+0000 7f05d2099740 20 client.5347 populate_metadata read hostname 'smithi049' 2024-01-22T05:07:14.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.689+0000 7f05d2099740 1 --2- 172.21.15.49:0/1579622317 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1cf4080 0x1d1a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.689+0000 7f05d2099740 4 client.5347 mds_command: new command op to 5121 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:07:14.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.689+0000 7f05d2099740 1 -- 172.21.15.49:0/1579622317 --> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1c63780 con 0x1cf4080 2024-01-22T05:07:14.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.693+0000 7f05c5200700 1 --2- 172.21.15.49:0/1579622317 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1cf4080 0x1d1a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.705+0000 7f05ad600700 10 client.5347 ms_handle_connect on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:14.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.705+0000 7f05c5200700 1 --2- 172.21.15.49:0/1579622317 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1cf4080 0x1d1a640 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=28a85ae0e72c150b server_cookie=bf93056f9c4ab413 in_seq=0 out_seq=0 2024-01-22T05:07:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.709+0000 7f05ad600700 1 -- 172.21.15.49:0/1579622317 <== mds.0 v2:172.21.15.49:6834/3211151680 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1c63780 con 0x1cf4080 2024-01-22T05:07:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.709+0000 7f05ad600700 10 client.5347 handle_command_reply: tid=0 2024-01-22T05:07:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.709+0000 7f05d2099740 1 client.5347 shutdown 2024-01-22T05:07:14.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.713+0000 7f05d2099740 1 -- 172.21.15.49:0/1579622317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d42570 msgr2=0x1d13600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.713+0000 7f05d2099740 1 --2- 172.21.15.49:0/1579622317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d42570 0x1d13600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f05a8015600 tx=0x7f05a8016000).stop 2024-01-22T05:07:14.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.713+0000 7f05d2099740 1 -- 172.21.15.49:0/1579622317 shutdown_connections 2024-01-22T05:07:14.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.713+0000 7f05d2099740 1 --2- 172.21.15.49:0/1579622317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d42ee0 0x1d13af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:07:14.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.713+0000 7f05d2099740 1 --2- 172.21.15.49:0/1579622317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d42570 0x1d13600 secure :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0x7f05a8015600 tx=0x7f05a8016000).stop 2024-01-22T05:07:14.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.713+0000 7f05d2099740 1 --2- 172.21.15.49:0/1579622317 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1cf4080 0x1d1a640 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.713+0000 7f05d2099740 1 --2- 172.21.15.49:0/1579622317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d3b4d0 0x1d12a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:07:14.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.713+0000 7f05d2099740 1 -- 172.21.15.49:0/1579622317 >> 172.21.15.49:0/1579622317 conn(0x1ad5680 msgr2=0x1d3c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.717+0000 7f05ad600700 0 client.5347 ms_handle_reset on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:14.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.721+0000 7f05d2099740 1 -- 172.21.15.49:0/1579622317 shutdown_connections 2024-01-22T05:07:14.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.721+0000 7f05d2099740 1 -- 172.21.15.49:0/1579622317 wait complete. 2024-01-22T05:07:14.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.721+0000 7f05d2099740 20 client.5347 trim_cache size 0 max 16384 2024-01-22T05:07:14.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.741+0000 7f05d2099740 1 Processor -- start 2024-01-22T05:07:14.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.741+0000 7f05d2099740 1 -- start start 2024-01-22T05:07:14.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.741+0000 7f05d2099740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d3b4d0 0x1d135e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.741+0000 7f05d2099740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d18f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.741+0000 7f05d2099740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d371b0 0x1d19420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.741+0000 7f05d2099740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c2c290 con 0x1d42ee0 2024-01-22T05:07:14.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.741+0000 7f05d2099740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d18600 con 0x1d371b0 2024-01-22T05:07:14.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.741+0000 7f05d2099740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1cf3210 con 0x1d3b4d0 2024-01-22T05:07:14.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.741+0000 7f05bfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d18f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.741+0000 7f05bfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d18f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37694/0 (socket says 172.21.15.49:37694) 2024-01-22T05:07:14.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.741+0000 7f05bfe00700 1 -- 172.21.15.49:0/1109033467 learned_addr learned my addr 172.21.15.49:0/1109033467 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:14.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.741+0000 7f05c5c00700 1 --2- 172.21.15.49:0/1109033467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d371b0 0x1d19420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.741+0000 7f05c5200700 1 --2- 172.21.15.49:0/1109033467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d3b4d0 0x1d135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05bfe00700 1 -- 172.21.15.49:0/1109033467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d3b4d0 msgr2=0x1d135e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05bfe00700 1 --2- 172.21.15.49:0/1109033467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d3b4d0 0x1d135e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05bfe00700 1 -- 172.21.15.49:0/1109033467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d371b0 msgr2=0x1d19420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05bfe00700 1 --2- 172.21.15.49:0/1109033467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d371b0 0x1d19420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05bfe00700 1 -- 172.21.15.49:0/1109033467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c0151e70 con 0x1d42ee0 2024-01-22T05:07:14.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05c5c00700 1 --2- 172.21.15.49:0/1109033467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d371b0 0x1d19420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:14.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05bfe00700 1 --2- 172.21.15.49:0/1109033467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d18f30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f05a80091b0 tx=0x7f05a8021000).ready entity=mon.0 client_cookie=2317a5e3beba058e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05b5600700 1 -- 172.21.15.49:0/1109033467 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a800e4b0 con 0x1d42ee0 2024-01-22T05:07:14.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05b5600700 1 -- 172.21.15.49:0/1109033467 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1c6d230 con 0x1d42ee0 2024-01-22T05:07:14.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05b5600700 1 -- 172.21.15.49:0/1109033467 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a800d040 con 0x1d42ee0 2024-01-22T05:07:14.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05d2099740 1 -- 172.21.15.49:0/1109033467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 msgr2=0x1d18f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05d2099740 1 --2- 172.21.15.49:0/1109033467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d18f30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f05a80091b0 tx=0x7f05a8021000).stop 2024-01-22T05:07:14.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05d2099740 1 -- 172.21.15.49:0/1109033467 shutdown_connections 2024-01-22T05:07:14.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05d2099740 1 --2- 172.21.15.49:0/1109033467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d371b0 0x1d19420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05d2099740 1 --2- 172.21.15.49:0/1109033467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d18f30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05d2099740 1 --2- 172.21.15.49:0/1109033467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d3b4d0 0x1d135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05d2099740 1 -- 172.21.15.49:0/1109033467 >> 172.21.15.49:0/1109033467 conn(0x1ad5680 msgr2=0x1d20450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05d2099740 1 -- 172.21.15.49:0/1109033467 shutdown_connections 2024-01-22T05:07:14.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.745+0000 7f05d2099740 1 -- 172.21.15.49:0/1109033467 wait complete. 2024-01-22T05:07:14.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.749+0000 7f05d2099740 1 -- start start 2024-01-22T05:07:14.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.749+0000 7f05d2099740 1 Processor -- start 2024-01-22T05:07:14.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05d2099740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d371b0 0x1d85740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05d2099740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d3b4d0 0x1d35890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05d2099740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d35d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05d2099740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d21210 con 0x1d42ee0 2024-01-22T05:07:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05d2099740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d36270 con 0x1d3b4d0 2024-01-22T05:07:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05d2099740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1da2ce0 con 0x1d371b0 2024-01-22T05:07:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05d2099740 10 client.0 ll_register_callbacks cb 0x7f05a80096d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:07:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05c5200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d371b0 0x1d85740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05c5c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d35d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05c5200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d371b0 0x1d85740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:37054/0 (socket says 172.21.15.49:37054) 2024-01-22T05:07:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05c5200700 1 -- 172.21.15.49:0/3391167107 learned_addr learned my addr 172.21.15.49:0/3391167107 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05bfe00700 1 --2- 172.21.15.49:0/3391167107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d3b4d0 0x1d35890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05bfe00700 1 -- 172.21.15.49:0/3391167107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d371b0 msgr2=0x1d85740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05bfe00700 1 --2- 172.21.15.49:0/3391167107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d371b0 0x1d85740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05bfe00700 1 -- 172.21.15.49:0/3391167107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 msgr2=0x1d35d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:14.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05bfe00700 1 --2- 172.21.15.49:0/3391167107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d35d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05bfe00700 1 -- 172.21.15.49:0/3391167107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b8017040 con 0x1d3b4d0 2024-01-22T05:07:14.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05c5200700 1 --2- 172.21.15.49:0/3391167107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d371b0 0x1d85740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:14.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05bfe00700 1 --2- 172.21.15.49:0/3391167107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d3b4d0 0x1d35890 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f05a8031000 tx=0x7f05a802f000).ready entity=mon.1 client_cookie=6684cfb598af9c5e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:14.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05ad600700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-01-22T05:07:14.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05ad600700 1 -- 172.21.15.49:0/3391167107 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a800e4b0 con 0x1d3b4d0 2024-01-22T05:07:14.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05d2099740 1 -- 172.21.15.49:0/3391167107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05b8005e70 con 0x1d3b4d0 2024-01-22T05:07:14.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05ad600700 1 -- 172.21.15.49:0/3391167107 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6561+0+0 (secure 0 0 0) 0x7f05a80145e0 con 0x1d3b4d0 2024-01-22T05:07:14.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05ad600700 1 -- 172.21.15.49:0/3391167107 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05a800d040 con 0x1d3b4d0 2024-01-22T05:07:14.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05d2099740 10 client.5353 fetch_fsmap learned FSMap version 31 2024-01-22T05:07:14.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05d2099740 1 -- 172.21.15.49:0/3391167107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x1c707c0 con 0x1d3b4d0 2024-01-22T05:07:14.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.753+0000 7f05ad600700 1 -- 172.21.15.49:0/3391167107 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a8045020 con 0x1d3b4d0 2024-01-22T05:07:14.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05ad600700 1 -- 172.21.15.49:0/3391167107 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f05a802f070 con 0x1d3b4d0 2024-01-22T05:07:14.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 10 client.5353 fetch_fsmap finished waiting for FSMap version 31 2024-01-22T05:07:14.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 10 client.5353 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-01-22T05:07:14.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 20 client.5353 populate_metadata read hostname 'smithi049' 2024-01-22T05:07:14.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 1 --2- 172.21.15.49:0/3391167107 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1cebea0 0x1d15820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:14.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 4 client.5353 mds_command: new command op to 5121 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:07:14.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 1 -- 172.21.15.49:0/3391167107 --> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1b2c610 con 0x1cebea0 2024-01-22T05:07:14.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05c5200700 1 --2- 172.21.15.49:0/3391167107 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1cebea0 0x1d15820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:14.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05c5200700 1 --2- 172.21.15.49:0/3391167107 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1cebea0 0x1d15820 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=58e3a2d2ae206bc5 server_cookie=61f6ba4d12a8edfd in_seq=0 out_seq=0 2024-01-22T05:07:14.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05ad600700 10 client.5353 ms_handle_connect on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:14.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05ad600700 1 -- 172.21.15.49:0/3391167107 <== mds.0 v2:172.21.15.49:6834/3211151680 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+275 (crc 0 0 0) 0x1b2c610 con 0x1cebea0 2024-01-22T05:07:14.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05ad600700 10 client.5353 handle_command_reply: tid=0 2024-01-22T05:07:14.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 1 client.5353 shutdown 2024-01-22T05:07:14.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 1 -- 172.21.15.49:0/3391167107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d3b4d0 msgr2=0x1d35890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 1 --2- 172.21.15.49:0/3391167107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d3b4d0 0x1d35890 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f05a8031000 tx=0x7f05a802f000).stop 2024-01-22T05:07:14.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 1 -- 172.21.15.49:0/3391167107 shutdown_connections 2024-01-22T05:07:14.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 1 --2- 172.21.15.49:0/3391167107 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x1cebea0 0x1d15820 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 1 --2- 172.21.15.49:0/3391167107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1d42ee0 0x1d35d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 1 --2- 172.21.15.49:0/3391167107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1d3b4d0 0x1d35890 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05ad600700 0 client.5353 ms_handle_reset on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:14.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 1 --2- 172.21.15.49:0/3391167107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1d371b0 0x1d85740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 1 -- 172.21.15.49:0/3391167107 >> 172.21.15.49:0/3391167107 conn(0x1ad5680 msgr2=0x1d18f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 1 -- 172.21.15.49:0/3391167107 shutdown_connections 2024-01-22T05:07:14.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 1 -- 172.21.15.49:0/3391167107 wait complete. 2024-01-22T05:07:14.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.757+0000 7f05d2099740 20 client.5353 trim_cache size 0 max 16384 2024-01-22T05:07:14.765 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:07:14.765 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "scrub active (1209 inodes in the stack)", 2024-01-22T05:07:14.766 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-01-22T05:07:14.766 INFO:teuthology.orchestra.run.smithi049.stdout: "8dc24c63-672d-4b8e-a709-ce142352623f": { 2024-01-22T05:07:14.766 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-01-22T05:07:14.766 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "8dc24c63-672d-4b8e-a709-ce142352623f", 2024-01-22T05:07:14.766 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,scrub_mdsdir" 2024-01-22T05:07:14.766 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:14.766 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:14.766 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:07:14.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.761+0000 7f05c7c00700 1 -- 172.21.15.49:0/2437871636 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f059805a560 msgr2=0x7f059805ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.761+0000 7f05c7c00700 1 --2- 172.21.15.49:0/2437871636 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f059805a560 0x7f059805ca20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f05c00c5450 tx=0x7f05a8009060).stop 2024-01-22T05:07:14.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.761+0000 7f05c7c00700 1 -- 172.21.15.49:0/2437871636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c0063d10 msgr2=0x7f05c01507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:14.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.761+0000 7f05c7c00700 1 --2- 172.21.15.49:0/2437871636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c0063d10 0x7f05c01507d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f05b0009d50 tx=0x7f05b0016000).stop 2024-01-22T05:07:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.761+0000 7f05c7c00700 1 -- 172.21.15.49:0/2437871636 shutdown_connections 2024-01-22T05:07:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.761+0000 7f05c7c00700 1 --2- 172.21.15.49:0/2437871636 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f059805a560 0x7f059805ca20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.761+0000 7f05c7c00700 1 --2- 172.21.15.49:0/2437871636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c0153960 0x7f05c016c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.761+0000 7f05c7c00700 1 --2- 172.21.15.49:0/2437871636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c00bcf70 0x7f05c016bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:07:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.761+0000 7f05c7c00700 1 --2- 172.21.15.49:0/2437871636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c0063d10 0x7f05c01507d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.761+0000 7f05c7c00700 1 -- 172.21.15.49:0/2437871636 >> 172.21.15.49:0/2437871636 conn(0x7f05c0062720 msgr2=0x7f05c00666e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.761+0000 7f05c7c00700 1 -- 172.21.15.49:0/2437871636 shutdown_connections 2024-01-22T05:07:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:14.761+0000 7f05c7c00700 1 -- 172.21.15.49:0/2437871636 wait complete. 2024-01-22T05:07:14.787 INFO:tasks.cephfs.filesystem:scrub status for tag:8dc24c63-672d-4b8e-a709-ce142352623f - {'path': '/', 'tag': '8dc24c63-672d-4b8e-a709-ce142352623f', 'options': 'recursive,scrub_mdsdir'} 2024-01-22T05:07:37.368 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:07:37.375 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:07:44.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2024-01-22T05:07:44.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.957+0000 7f7551c00700 1 Processor -- start 2024-01-22T05:07:44.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.961+0000 7f7551c00700 1 -- start start 2024-01-22T05:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f7551c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f754c0bc7b0 0x7f754c14d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f7551c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f754c157de0 0x7f754c14dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f7551c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754c067a90 con 0x7f754c0bc3d0 2024-01-22T05:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f7551c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754c0c1160 con 0x7f754c0bc7b0 2024-01-22T05:07:44.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f7551c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754c067d70 con 0x7f754c157de0 2024-01-22T05:07:44.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f754a000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f754c0bc7b0 0x7f754c14d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:44.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f754aa00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f754c0bc3d0 0x7f754c1576d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:45250/0 (socket says 172.21.15.49:45250) 2024-01-22T05:07:44.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f754aa00700 1 -- 172.21.15.49:0/1814574451 learned_addr learned my addr 172.21.15.49:0/1814574451 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:44.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f754b400700 1 --2- 172.21.15.49:0/1814574451 >> v2:172.21.15.110:3300/0 conn(0x7f754c157de0 0x7f754c14dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:44.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f7549600700 1 -- 172.21.15.49:0/1814574451 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781863616 0 0) 0x7f754c067a90 con 0x7f754c0bc3d0 2024-01-22T05:07:44.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f7549600700 1 -- 172.21.15.49:0/1814574451 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f752c0033f0 con 0x7f754c0bc3d0 2024-01-22T05:07:44.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f754a000700 1 -- 172.21.15.49:0/1814574451 >> v2:172.21.15.110:3300/0 conn(0x7f754c157de0 msgr2=0x7f754c14dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:44.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f754a000700 1 --2- 172.21.15.49:0/1814574451 >> v2:172.21.15.110:3300/0 conn(0x7f754c157de0 0x7f754c14dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:44.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f754a000700 1 -- 172.21.15.49:0/1814574451 >> v1:172.21.15.110:6789/0 conn(0x7f754c0bc3d0 legacy=0x7f754c1576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:44.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f754a000700 1 -- 172.21.15.49:0/1814574451 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c0bcc60 con 0x7f754c0bc7b0 2024-01-22T05:07:44.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f754a000700 1 --2- 172.21.15.49:0/1814574451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c0bc7b0 0x7f754c14d820 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f754c067ce0 tx=0x7f7534009060).ready entity=mon.0 client_cookie=cfed7daba1f87bd8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:44.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f7549600700 1 -- 172.21.15.49:0/1814574451 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753400d4a0 con 0x7f754c0bc7b0 2024-01-22T05:07:44.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f7549600700 1 -- 172.21.15.49:0/1814574451 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753400d600 con 0x7f754c0bc7b0 2024-01-22T05:07:44.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.965+0000 7f7549600700 1 -- 172.21.15.49:0/1814574451 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753400d980 con 0x7f754c0bc7b0 2024-01-22T05:07:44.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.969+0000 7f7551c00700 1 -- 172.21.15.49:0/1814574451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c0bc7b0 msgr2=0x7f754c14d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:44.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.969+0000 7f7551c00700 1 --2- 172.21.15.49:0/1814574451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c0bc7b0 0x7f754c14d820 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f754c067ce0 tx=0x7f7534009060).stop 2024-01-22T05:07:44.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.969+0000 7f7551c00700 1 -- 172.21.15.49:0/1814574451 shutdown_connections 2024-01-22T05:07:44.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.969+0000 7f7551c00700 1 --2- 172.21.15.49:0/1814574451 >> v2:172.21.15.110:3300/0 conn(0x7f754c157de0 0x7f754c14dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:44.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.969+0000 7f7551c00700 1 --2- 172.21.15.49:0/1814574451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c0bc7b0 0x7f754c14d820 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:44.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.969+0000 7f7551c00700 1 -- 172.21.15.49:0/1814574451 >> 172.21.15.49:0/1814574451 conn(0x7f754c0c6560 msgr2=0x7f754c0c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:44.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.969+0000 7f7551c00700 1 -- 172.21.15.49:0/1814574451 shutdown_connections 2024-01-22T05:07:44.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.969+0000 7f7551c00700 1 -- 172.21.15.49:0/1814574451 wait complete. 2024-01-22T05:07:44.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.969+0000 7f7551c00700 1 Processor -- start 2024-01-22T05:07:44.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.973+0000 7f7551c00700 1 -- start start 2024-01-22T05:07:44.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.973+0000 7f7551c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c0bc3d0 0x7f754c154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:44.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.973+0000 7f7551c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c0bc7b0 0x7f754c151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:44.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.973+0000 7f7551c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f754c157de0 0x7f754c0aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:44.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.973+0000 7f7551c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c153b60 con 0x7f754c0bc7b0 2024-01-22T05:07:44.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.973+0000 7f7551c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c153dd0 con 0x7f754c157de0 2024-01-22T05:07:44.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.973+0000 7f7551c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c1540b0 con 0x7f754c0bc3d0 2024-01-22T05:07:44.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.973+0000 7f754a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c0bc7b0 0x7f754c151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:44.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.973+0000 7f754a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c0bc7b0 0x7f754c151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44866/0 (socket says 172.21.15.49:44866) 2024-01-22T05:07:44.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.973+0000 7f754a000700 1 -- 172.21.15.49:0/2921975134 learned_addr learned my addr 172.21.15.49:0/2921975134 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:44.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.973+0000 7f754b400700 1 --2- 172.21.15.49:0/2921975134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f754c157de0 0x7f754c0aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:44.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.973+0000 7f754aa00700 1 --2- 172.21.15.49:0/2921975134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c0bc3d0 0x7f754c154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:44.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.977+0000 7f754a000700 1 -- 172.21.15.49:0/2921975134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c0bc3d0 msgr2=0x7f754c154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:44.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.977+0000 7f754a000700 1 --2- 172.21.15.49:0/2921975134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c0bc3d0 0x7f754c154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:44.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.977+0000 7f754a000700 1 -- 172.21.15.49:0/2921975134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f754c157de0 msgr2=0x7f754c0aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:44.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.977+0000 7f754a000700 1 --2- 172.21.15.49:0/2921975134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f754c157de0 0x7f754c0aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:44.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.977+0000 7f754a000700 1 -- 172.21.15.49:0/2921975134 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75340092a0 con 0x7f754c0bc7b0 2024-01-22T05:07:44.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.977+0000 7f754a000700 1 --2- 172.21.15.49:0/2921975134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c0bc7b0 0x7f754c151100 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f7534010000 tx=0x7f7534016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:44.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.977+0000 7f7542000700 1 -- 172.21.15.49:0/2921975134 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753400dd30 con 0x7f754c0bc7b0 2024-01-22T05:07:44.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.977+0000 7f7542000700 1 -- 172.21.15.49:0/2921975134 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753400de90 con 0x7f754c0bc7b0 2024-01-22T05:07:44.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.977+0000 7f7542000700 1 -- 172.21.15.49:0/2921975134 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753400d9c0 con 0x7f754c0bc7b0 2024-01-22T05:07:44.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.977+0000 7f7551c00700 1 -- 172.21.15.49:0/2921975134 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c154390 con 0x7f754c0bc7b0 2024-01-22T05:07:44.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.977+0000 7f7551c00700 1 -- 172.21.15.49:0/2921975134 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754c1515f0 con 0x7f754c0bc7b0 2024-01-22T05:07:44.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.981+0000 7f7542000700 1 -- 172.21.15.49:0/2921975134 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f75340263b0 con 0x7f754c0bc7b0 2024-01-22T05:07:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.981+0000 7f7542000700 1 --2- 172.21.15.49:0/2921975134 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f752405a530 0x7f752405c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.981+0000 7f7542000700 1 -- 172.21.15.49:0/2921975134 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f7534075750 con 0x7f754c0bc7b0 2024-01-22T05:07:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.981+0000 7f754aa00700 1 --2- 172.21.15.49:0/2921975134 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f752405a530 0x7f752405c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:44.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.981+0000 7f754aa00700 1 --2- 172.21.15.49:0/2921975134 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f752405a530 0x7f752405c9f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f753c007fd0 tx=0x7f753c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:44.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.985+0000 7f755c03a740 1 Processor -- start 2024-01-22T05:07:44.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.985+0000 7f755c03a740 1 -- start start 2024-01-22T05:07:44.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f755c03a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x10be8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:44.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f755c03a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5570 0x10c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:44.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f755c03a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5ee0 0x10a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:44.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f755c03a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xfd6540 con 0x10be4d0 2024-01-22T05:07:44.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f755c03a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xf99e90 con 0x10c5ee0 2024-01-22T05:07:44.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f755c03a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xf9fd90 con 0x10c5570 2024-01-22T05:07:44.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f754aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x10be8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:44.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f754aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x10be8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44874/0 (socket says 172.21.15.49:44874) 2024-01-22T05:07:44.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f754aa00700 1 -- 172.21.15.49:0/1716587919 learned_addr learned my addr 172.21.15.49:0/1716587919 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:44.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f754b400700 1 --2- 172.21.15.49:0/1716587919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5ee0 0x10a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:44.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f754a000700 1 --2- 172.21.15.49:0/1716587919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5570 0x10c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:44.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f754aa00700 1 -- 172.21.15.49:0/1716587919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5570 msgr2=0x10c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:44.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f754aa00700 1 --2- 172.21.15.49:0/1716587919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5570 0x10c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:44.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f754aa00700 1 -- 172.21.15.49:0/1716587919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5ee0 msgr2=0x10a44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:44.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f754aa00700 1 --2- 172.21.15.49:0/1716587919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5ee0 0x10a44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:44.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f754aa00700 1 -- 172.21.15.49:0/1716587919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10044c0 con 0x10be4d0 2024-01-22T05:07:44.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f754b400700 1 --2- 172.21.15.49:0/1716587919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5ee0 0x10a44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:44.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f754aa00700 1 --2- 172.21.15.49:0/1716587919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x10be8b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f753c00f820 tx=0x7f753c013000).ready entity=mon.0 client_cookie=b693d81fee57a1b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:44.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f753aa00700 1 -- 172.21.15.49:0/1716587919 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c020400 con 0x10be4d0 2024-01-22T05:07:44.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f753aa00700 1 -- 172.21.15.49:0/1716587919 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c020560 con 0x10be4d0 2024-01-22T05:07:44.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f753aa00700 1 -- 172.21.15.49:0/1716587919 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c0206d0 con 0x10be4d0 2024-01-22T05:07:44.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f755c03a740 1 -- 172.21.15.49:0/1716587919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 msgr2=0x10be8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:44.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.989+0000 7f755c03a740 1 --2- 172.21.15.49:0/1716587919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x10be8b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f753c00f820 tx=0x7f753c013000).stop 2024-01-22T05:07:44.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.993+0000 7f755c03a740 1 -- 172.21.15.49:0/1716587919 shutdown_connections 2024-01-22T05:07:44.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.993+0000 7f755c03a740 1 --2- 172.21.15.49:0/1716587919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5ee0 0x10a44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:44.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.993+0000 7f755c03a740 1 --2- 172.21.15.49:0/1716587919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5570 0x10c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:44.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.993+0000 7f755c03a740 1 --2- 172.21.15.49:0/1716587919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x10be8b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:44.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.993+0000 7f755c03a740 1 -- 172.21.15.49:0/1716587919 >> 172.21.15.49:0/1716587919 conn(0xe58680 msgr2=0x1077de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:44.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.993+0000 7f755c03a740 1 -- 172.21.15.49:0/1716587919 shutdown_connections 2024-01-22T05:07:44.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.993+0000 7f755c03a740 1 -- 172.21.15.49:0/1716587919 wait complete. 2024-01-22T05:07:44.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.993+0000 7f755c03a740 1 -- start start 2024-01-22T05:07:44.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.993+0000 7f755c03a740 1 Processor -- start 2024-01-22T05:07:44.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f755c03a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x109b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:44.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f755c03a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5570 0x10a0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:44.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f755c03a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5ee0 0x10a1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:44.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f755c03a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x10a1880 con 0x10be4d0 2024-01-22T05:07:44.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f755c03a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x109eee0 con 0x10c5570 2024-01-22T05:07:44.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f755c03a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x109f1c0 con 0x10c5ee0 2024-01-22T05:07:44.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f755c03a740 10 client.0 ll_register_callbacks cb 0x10305d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:07:44.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f754aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x109b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:44.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f754aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x109b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44888/0 (socket says 172.21.15.49:44888) 2024-01-22T05:07:44.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f754aa00700 1 -- 172.21.15.49:0/3827745288 learned_addr learned my addr 172.21.15.49:0/3827745288 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:44.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f754b400700 1 --2- 172.21.15.49:0/3827745288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5ee0 0x10a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:44.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f754a000700 1 --2- 172.21.15.49:0/3827745288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5570 0x10a0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:44.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f754aa00700 1 -- 172.21.15.49:0/3827745288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5ee0 msgr2=0x10a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:45.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f754aa00700 1 --2- 172.21.15.49:0/3827745288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5ee0 0x10a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f754aa00700 1 -- 172.21.15.49:0/3827745288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5570 msgr2=0x10a0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:45.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f754aa00700 1 --2- 172.21.15.49:0/3827745288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5570 0x10a0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f754aa00700 1 -- 172.21.15.49:0/3827745288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7544011230 con 0x10be4d0 2024-01-22T05:07:45.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f754b400700 1 --2- 172.21.15.49:0/3827745288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5ee0 0x10a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:07:45.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f754aa00700 1 --2- 172.21.15.49:0/3827745288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x109b570 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f753c000fd0 tx=0x7f753c017000).ready entity=mon.0 client_cookie=c56fbfac4165c6ba server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:45.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f7533400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:07:45.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f7533400700 1 -- 172.21.15.49:0/3827745288 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c026070 con 0x10be4d0 2024-01-22T05:07:45.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f7533400700 1 -- 172.21.15.49:0/3827745288 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f753c023a70 con 0x10be4d0 2024-01-22T05:07:45.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f755c03a740 1 -- 172.21.15.49:0/3827745288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xff0230 con 0x10be4d0 2024-01-22T05:07:45.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f7533400700 1 -- 172.21.15.49:0/3827745288 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f753c023e40 con 0x10be4d0 2024-01-22T05:07:45.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f755c03a740 10 client.5400 fetch_fsmap learned FSMap version 34 2024-01-22T05:07:45.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:44.997+0000 7f755c03a740 1 -- 172.21.15.49:0/3827745288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x7f752c0033f0 con 0x10be4d0 2024-01-22T05:07:45.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f7533400700 1 -- 172.21.15.49:0/3827745288 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c030070 con 0x10be4d0 2024-01-22T05:07:45.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f7533400700 1 -- 172.21.15.49:0/3827745288 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f753c01e030 con 0x10be4d0 2024-01-22T05:07:45.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f755c03a740 10 client.5400 fetch_fsmap finished waiting for FSMap version 34 2024-01-22T05:07:45.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f755c03a740 10 client.5400 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-01-22T05:07:45.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f755c03a740 20 client.5400 populate_metadata read hostname 'smithi049' 2024-01-22T05:07:45.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f755c03a740 1 --2- 172.21.15.49:0/3827745288 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x10d6560 0x10d8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f755c03a740 4 client.5400 mds_command: new command op to 5121 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:07:45.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f755c03a740 1 -- 172.21.15.49:0/3827745288 --> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xfe6780 con 0x10d6560 2024-01-22T05:07:45.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f754a000700 1 --2- 172.21.15.49:0/3827745288 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x10d6560 0x10d8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f7533400700 10 client.5400 ms_handle_connect on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:45.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f754a000700 1 --2- 172.21.15.49:0/3827745288 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x10d6560 0x10d8950 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=49d534cd71a7be3c server_cookie=982b7622ba0676c0 in_seq=0 out_seq=0 2024-01-22T05:07:45.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f7533400700 1 -- 172.21.15.49:0/3827745288 <== mds.0 v2:172.21.15.49:6834/3211151680 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xfe6780 con 0x10d6560 2024-01-22T05:07:45.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f7533400700 10 client.5400 handle_command_reply: tid=0 2024-01-22T05:07:45.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f755c03a740 1 client.5400 shutdown 2024-01-22T05:07:45.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f755c03a740 1 -- 172.21.15.49:0/3827745288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 msgr2=0x109b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.001+0000 7f755c03a740 1 --2- 172.21.15.49:0/3827745288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x109b570 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f753c000fd0 tx=0x7f753c017000).stop 2024-01-22T05:07:45.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.005+0000 7f755c03a740 1 -- 172.21.15.49:0/3827745288 shutdown_connections 2024-01-22T05:07:45.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.005+0000 7f755c03a740 1 --2- 172.21.15.49:0/3827745288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5ee0 0x10a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.005+0000 7f755c03a740 1 --2- 172.21.15.49:0/3827745288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5570 0x10a0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.005+0000 7f755c03a740 1 --2- 172.21.15.49:0/3827745288 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x10d6560 0x10d8950 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.005+0000 7f755c03a740 1 --2- 172.21.15.49:0/3827745288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x109b570 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.005+0000 7f755c03a740 1 -- 172.21.15.49:0/3827745288 >> 172.21.15.49:0/3827745288 conn(0xe58680 msgr2=0x10a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:45.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.005+0000 7f7533400700 0 client.5400 ms_handle_reset on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:45.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.005+0000 7f755c03a740 1 -- 172.21.15.49:0/3827745288 shutdown_connections 2024-01-22T05:07:45.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.005+0000 7f755c03a740 1 -- 172.21.15.49:0/3827745288 wait complete. 2024-01-22T05:07:45.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.005+0000 7f755c03a740 20 client.5400 trim_cache size 0 max 16384 2024-01-22T05:07:45.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f755c03a740 1 Processor -- start 2024-01-22T05:07:45.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f755c03a740 1 -- start start 2024-01-22T05:07:45.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f755c03a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x10785f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f755c03a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5570 0x109c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f755c03a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5ee0 0x109c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f755c03a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1074b10 con 0x10be4d0 2024-01-22T05:07:45.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f755c03a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x10bec20 con 0x10c5570 2024-01-22T05:07:45.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f755c03a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x109cc90 con 0x10c5ee0 2024-01-22T05:07:45.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f754aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x10785f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f754aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x10785f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44894/0 (socket says 172.21.15.49:44894) 2024-01-22T05:07:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f754aa00700 1 -- 172.21.15.49:0/1234626318 learned_addr learned my addr 172.21.15.49:0/1234626318 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f754a000700 1 --2- 172.21.15.49:0/1234626318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5570 0x109c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f754b400700 1 --2- 172.21.15.49:0/1234626318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5ee0 0x109c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f754aa00700 1 -- 172.21.15.49:0/1234626318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5ee0 msgr2=0x109c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f754aa00700 1 --2- 172.21.15.49:0/1234626318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5ee0 0x109c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f754aa00700 1 -- 172.21.15.49:0/1234626318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5570 msgr2=0x109c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f754aa00700 1 --2- 172.21.15.49:0/1234626318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5570 0x109c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f754aa00700 1 -- 172.21.15.49:0/1234626318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c068420 con 0x10be4d0 2024-01-22T05:07:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f754b400700 1 --2- 172.21.15.49:0/1234626318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5ee0 0x109c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:07:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.025+0000 7f754aa00700 1 --2- 172.21.15.49:0/1234626318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x10785f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f753c0015b0 tx=0x7f753c026000).ready entity=mon.0 client_cookie=2deb80e9490b7266 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:45.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.029+0000 7f753b400700 1 -- 172.21.15.49:0/1234626318 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c00fbe0 con 0x10be4d0 2024-01-22T05:07:45.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.029+0000 7f753b400700 1 -- 172.21.15.49:0/1234626318 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c030020 con 0x10be4d0 2024-01-22T05:07:45.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.029+0000 7f753b400700 1 -- 172.21.15.49:0/1234626318 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c00fd80 con 0x10be4d0 2024-01-22T05:07:45.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.029+0000 7f755c03a740 1 -- 172.21.15.49:0/1234626318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 msgr2=0x10785f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.029+0000 7f755c03a740 1 --2- 172.21.15.49:0/1234626318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x10785f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f753c0015b0 tx=0x7f753c026000).stop 2024-01-22T05:07:45.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.029+0000 7f755c03a740 1 -- 172.21.15.49:0/1234626318 shutdown_connections 2024-01-22T05:07:45.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.029+0000 7f755c03a740 1 --2- 172.21.15.49:0/1234626318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5ee0 0x109c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.029+0000 7f755c03a740 1 --2- 172.21.15.49:0/1234626318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10c5570 0x109c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.029+0000 7f755c03a740 1 --2- 172.21.15.49:0/1234626318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10be4d0 0x10785f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.029+0000 7f755c03a740 1 -- 172.21.15.49:0/1234626318 >> 172.21.15.49:0/1234626318 conn(0xe58680 msgr2=0x109d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:45.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.029+0000 7f755c03a740 1 -- 172.21.15.49:0/1234626318 shutdown_connections 2024-01-22T05:07:45.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.029+0000 7f755c03a740 1 -- 172.21.15.49:0/1234626318 wait complete. 2024-01-22T05:07:45.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.033+0000 7f755c03a740 1 -- start start 2024-01-22T05:07:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.033+0000 7f755c03a740 1 Processor -- start 2024-01-22T05:07:45.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10be4d0 0x1108290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5570 0x10a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10c5ee0 0x109c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x10a5440 con 0x10c5ee0 2024-01-22T05:07:45.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1123100 con 0x10be4d0 2024-01-22T05:07:45.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1122230 con 0x10c5570 2024-01-22T05:07:45.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 10 client.0 ll_register_callbacks cb 0x7f753c00f710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:07:45.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f754b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10c5ee0 0x109c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f754b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10c5ee0 0x109c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44908/0 (socket says 172.21.15.49:44908) 2024-01-22T05:07:45.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f754b400700 1 -- 172.21.15.49:0/4251992634 learned_addr learned my addr 172.21.15.49:0/4251992634 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:45.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f754a000700 1 --2- 172.21.15.49:0/4251992634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5570 0x10a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f754aa00700 1 --2- 172.21.15.49:0/4251992634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10be4d0 0x1108290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f754b400700 1 -- 172.21.15.49:0/4251992634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5570 msgr2=0x10a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:45.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f754b400700 1 --2- 172.21.15.49:0/4251992634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5570 0x10a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f754b400700 1 -- 172.21.15.49:0/4251992634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10be4d0 msgr2=0x1108290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:45.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f754b400700 1 --2- 172.21.15.49:0/4251992634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10be4d0 0x1108290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f754b400700 1 -- 172.21.15.49:0/4251992634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752c0033f0 con 0x10c5ee0 2024-01-22T05:07:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f754b400700 1 --2- 172.21.15.49:0/4251992634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10c5ee0 0x109c0f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f754c152710 tx=0x7f754400b040).ready entity=mon.0 client_cookie=b0c319bb6e932534 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f7533400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:07:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f7533400700 1 -- 172.21.15.49:0/4251992634 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754400e040 con 0x10c5ee0 2024-01-22T05:07:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f7533400700 1 -- 172.21.15.49:0/4251992634 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f75440115d0 con 0x10c5ee0 2024-01-22T05:07:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 1 -- 172.21.15.49:0/4251992634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f753c020560 con 0x10c5ee0 2024-01-22T05:07:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f7533400700 1 -- 172.21.15.49:0/4251992634 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75440119a0 con 0x10c5ee0 2024-01-22T05:07:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 10 client.5406 fetch_fsmap learned FSMap version 34 2024-01-22T05:07:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 1 -- 172.21.15.49:0/4251992634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0xff37c0 con 0x10c5ee0 2024-01-22T05:07:45.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f7533400700 1 -- 172.21.15.49:0/4251992634 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c020560 con 0x10c5ee0 2024-01-22T05:07:45.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f7533400700 1 -- 172.21.15.49:0/4251992634 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7544011b00 con 0x10c5ee0 2024-01-22T05:07:45.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 10 client.5406 fetch_fsmap finished waiting for FSMap version 34 2024-01-22T05:07:45.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 10 client.5406 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-01-22T05:07:45.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 20 client.5406 populate_metadata read hostname 'smithi049' 2024-01-22T05:07:45.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 1 --2- 172.21.15.49:0/4251992634 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x109c5e0 0x10b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 4 client.5406 mds_command: new command op to 5121 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:07:45.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.037+0000 7f755c03a740 1 -- 172.21.15.49:0/4251992634 --> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xeaf610 con 0x109c5e0 2024-01-22T05:07:45.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.041+0000 7f754aa00700 1 --2- 172.21.15.49:0/4251992634 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x109c5e0 0x10b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.041+0000 7f754aa00700 1 --2- 172.21.15.49:0/4251992634 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x109c5e0 0x10b95f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8f230cae4fa1544f server_cookie=88b978daee775818 in_seq=0 out_seq=0 2024-01-22T05:07:45.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.041+0000 7f7533400700 10 client.5406 ms_handle_connect on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:45.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.041+0000 7f7533400700 1 -- 172.21.15.49:0/4251992634 <== mds.0 v2:172.21.15.49:6834/3211151680 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0xeaf610 con 0x109c5e0 2024-01-22T05:07:45.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.041+0000 7f7533400700 10 client.5406 handle_command_reply: tid=0 2024-01-22T05:07:45.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.041+0000 7f755c03a740 1 client.5406 shutdown 2024-01-22T05:07:45.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.041+0000 7f755c03a740 1 -- 172.21.15.49:0/4251992634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10c5ee0 msgr2=0x109c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.041+0000 7f755c03a740 1 --2- 172.21.15.49:0/4251992634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10c5ee0 0x109c0f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f754c152710 tx=0x7f754400b040).stop 2024-01-22T05:07:45.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.041+0000 7f755c03a740 1 -- 172.21.15.49:0/4251992634 shutdown_connections 2024-01-22T05:07:45.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.041+0000 7f755c03a740 1 --2- 172.21.15.49:0/4251992634 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0x109c5e0 0x10b95f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.041+0000 7f755c03a740 1 --2- 172.21.15.49:0/4251992634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x10c5ee0 0x109c0f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.041+0000 7f755c03a740 1 --2- 172.21.15.49:0/4251992634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x10c5570 0x10a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.041+0000 7f755c03a740 1 --2- 172.21.15.49:0/4251992634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x10be4d0 0x1108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.041+0000 7f7533400700 0 client.5406 ms_handle_reset on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:45.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.041+0000 7f755c03a740 1 -- 172.21.15.49:0/4251992634 >> 172.21.15.49:0/4251992634 conn(0xe58680 msgr2=0x10a5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:45.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.045+0000 7f755c03a740 1 -- 172.21.15.49:0/4251992634 shutdown_connections 2024-01-22T05:07:45.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.045+0000 7f755c03a740 1 -- 172.21.15.49:0/4251992634 wait complete. 2024-01-22T05:07:45.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.045+0000 7f755c03a740 20 client.5406 trim_cache size 0 max 16384 2024-01-22T05:07:45.046 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:07:45.046 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-01-22T05:07:45.046 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-01-22T05:07:45.046 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:07:45.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.045+0000 7f7551c00700 1 -- 172.21.15.49:0/2921975134 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f752405a530 msgr2=0x7f752405c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.045+0000 7f7551c00700 1 --2- 172.21.15.49:0/2921975134 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f752405a530 0x7f752405c9f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f753c007fd0 tx=0x7f753c009040).stop 2024-01-22T05:07:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.045+0000 7f7551c00700 1 -- 172.21.15.49:0/2921975134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c0bc7b0 msgr2=0x7f754c151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.045+0000 7f7551c00700 1 --2- 172.21.15.49:0/2921975134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c0bc7b0 0x7f754c151100 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f7534010000 tx=0x7f7534016000).stop 2024-01-22T05:07:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.045+0000 7f7551c00700 1 -- 172.21.15.49:0/2921975134 shutdown_connections 2024-01-22T05:07:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.045+0000 7f7551c00700 1 --2- 172.21.15.49:0/2921975134 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f752405a530 0x7f752405c9f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.045+0000 7f7551c00700 1 --2- 172.21.15.49:0/2921975134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f754c157de0 0x7f754c0aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.045+0000 7f7551c00700 1 --2- 172.21.15.49:0/2921975134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f754c0bc7b0 0x7f754c151100 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.045+0000 7f7551c00700 1 --2- 172.21.15.49:0/2921975134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f754c0bc3d0 0x7f754c154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.045+0000 7f7551c00700 1 -- 172.21.15.49:0/2921975134 >> 172.21.15.49:0/2921975134 conn(0x7f754c0c6560 msgr2=0x7f754c0bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:45.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.045+0000 7f7551c00700 1 -- 172.21.15.49:0/2921975134 shutdown_connections 2024-01-22T05:07:45.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.045+0000 7f7551c00700 1 -- 172.21.15.49:0/2921975134 wait complete. 2024-01-22T05:07:45.070 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-22T05:07:45.070 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-01-22T05:07:45.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.237+0000 7f1466c00700 1 Processor -- start 2024-01-22T05:07:45.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.237+0000 7f1466c00700 1 -- start start 2024-01-22T05:07:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.241+0000 7f1466c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f14600bec40 0x7f1460068280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.241+0000 7f1466c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14600694b0 con 0x7f1460155de0 2024-01-22T05:07:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.241+0000 7f1466c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14600688a0 con 0x7f14600aaf60 2024-01-22T05:07:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.241+0000 7f1466c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1460068b80 con 0x7f14600bec40 2024-01-22T05:07:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.241+0000 7f145f400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1460155de0 0x7f1460067b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48414/0 (socket says 172.21.15.49:48414) 2024-01-22T05:07:45.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.241+0000 7f145f400700 1 -- 172.21.15.49:0/4190086954 learned_addr learned my addr 172.21.15.49:0/4190086954 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:45.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.241+0000 7f1464c00700 1 --2- 172.21.15.49:0/4190086954 >> v2:172.21.15.110:3300/0 conn(0x7f14600bec40 0x7f1460068280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.241+0000 7f145ea00700 1 -- 172.21.15.49:0/4190086954 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104517332 0 0) 0x7f14600694b0 con 0x7f1460155de0 2024-01-22T05:07:45.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.241+0000 7f145ea00700 1 -- 172.21.15.49:0/4190086954 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14400033f0 con 0x7f1460155de0 2024-01-22T05:07:45.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.241+0000 7f1464c00700 1 -- 172.21.15.49:0/4190086954 >> v1:172.21.15.110:6789/0 conn(0x7f14600aaf60 legacy=0x7f14601556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.241+0000 7f1464c00700 1 -- 172.21.15.49:0/4190086954 >> v1:172.21.15.49:6789/0 conn(0x7f1460155de0 legacy=0x7f1460067b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.241+0000 7f145ea00700 1 -- 172.21.15.49:0/4190086954 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517447478 0 0) 0x7f14600688a0 con 0x7f14600aaf60 2024-01-22T05:07:45.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.241+0000 7f1464c00700 1 -- 172.21.15.49:0/4190086954 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1460068e60 con 0x7f14600bec40 2024-01-22T05:07:45.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.245+0000 7f1464c00700 1 --2- 172.21.15.49:0/4190086954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14600bec40 0x7f1460068280 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f1458009e90 tx=0x7f1458009780).ready entity=mon.1 client_cookie=c48c5687a0dbb3c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:45.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.245+0000 7f145ea00700 1 -- 172.21.15.49:0/4190086954 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145800e070 con 0x7f14600bec40 2024-01-22T05:07:45.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.245+0000 7f145ea00700 1 -- 172.21.15.49:0/4190086954 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145800bb20 con 0x7f14600bec40 2024-01-22T05:07:45.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.245+0000 7f145ea00700 1 -- 172.21.15.49:0/4190086954 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145800bea0 con 0x7f14600bec40 2024-01-22T05:07:45.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.245+0000 7f1466c00700 1 -- 172.21.15.49:0/4190086954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14600bec40 msgr2=0x7f1460068280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.245+0000 7f1466c00700 1 --2- 172.21.15.49:0/4190086954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14600bec40 0x7f1460068280 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f1458009e90 tx=0x7f1458009780).stop 2024-01-22T05:07:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.245+0000 7f1466c00700 1 -- 172.21.15.49:0/4190086954 shutdown_connections 2024-01-22T05:07:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.245+0000 7f1466c00700 1 --2- 172.21.15.49:0/4190086954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14600bec40 0x7f1460068280 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.245+0000 7f1466c00700 1 -- 172.21.15.49:0/4190086954 >> 172.21.15.49:0/4190086954 conn(0x7f14600c8740 msgr2=0x7f14600c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:45.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.245+0000 7f1466c00700 1 -- 172.21.15.49:0/4190086954 shutdown_connections 2024-01-22T05:07:45.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.245+0000 7f1466c00700 1 -- 172.21.15.49:0/4190086954 wait complete. 2024-01-22T05:07:45.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.249+0000 7f1466c00700 1 Processor -- start 2024-01-22T05:07:45.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.249+0000 7f1466c00700 1 -- start start 2024-01-22T05:07:45.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.249+0000 7f1466c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14600aaf60 0x7f1460144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.249+0000 7f1466c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600bec40 0x7f14600c01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.249+0000 7f1466c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1460155de0 0x7f14600c06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.249+0000 7f1466c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14600c0bb0 con 0x7f14600bec40 2024-01-22T05:07:45.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.249+0000 7f1466c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146014c0f0 con 0x7f1460155de0 2024-01-22T05:07:45.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.249+0000 7f1466c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146014c340 con 0x7f14600aaf60 2024-01-22T05:07:45.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f145f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600bec40 0x7f14600c01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f145f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600bec40 0x7f14600c01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44924/0 (socket says 172.21.15.49:44924) 2024-01-22T05:07:45.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f145f400700 1 -- 172.21.15.49:0/1841537657 learned_addr learned my addr 172.21.15.49:0/1841537657 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:45.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f145fe00700 1 --2- 172.21.15.49:0/1841537657 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14600aaf60 0x7f1460144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f1464c00700 1 --2- 172.21.15.49:0/1841537657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1460155de0 0x7f14600c06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f145f400700 1 -- 172.21.15.49:0/1841537657 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14600aaf60 msgr2=0x7f1460144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f145f400700 1 --2- 172.21.15.49:0/1841537657 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14600aaf60 0x7f1460144480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f145f400700 1 -- 172.21.15.49:0/1841537657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1460155de0 msgr2=0x7f14600c06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f145f400700 1 --2- 172.21.15.49:0/1841537657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1460155de0 0x7f14600c06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f145f400700 1 -- 172.21.15.49:0/1841537657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1458009a20 con 0x7f14600bec40 2024-01-22T05:07:45.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f145f400700 1 --2- 172.21.15.49:0/1841537657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600bec40 0x7f14600c01d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f144800c3f0 tx=0x7f1448007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:45.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f1457400700 1 -- 172.21.15.49:0/1841537657 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14480070d0 con 0x7f14600bec40 2024-01-22T05:07:45.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f1457400700 1 -- 172.21.15.49:0/1841537657 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1448007230 con 0x7f14600bec40 2024-01-22T05:07:45.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f1457400700 1 -- 172.21.15.49:0/1841537657 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14480075d0 con 0x7f14600bec40 2024-01-22T05:07:45.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f1466c00700 1 -- 172.21.15.49:0/1841537657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146014c620 con 0x7f14600bec40 2024-01-22T05:07:45.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.253+0000 7f1466c00700 1 -- 172.21.15.49:0/1841537657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146014cbe0 con 0x7f14600bec40 2024-01-22T05:07:45.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.257+0000 7f1457400700 1 -- 172.21.15.49:0/1841537657 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f14480059b0 con 0x7f14600bec40 2024-01-22T05:07:45.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.261+0000 7f1457400700 1 --2- 172.21.15.49:0/1841537657 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f143805a4e0 0x7f143805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.261+0000 7f1457400700 1 -- 172.21.15.49:0/1841537657 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f1448073fb0 con 0x7f14600bec40 2024-01-22T05:07:45.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.261+0000 7f145fe00700 1 --2- 172.21.15.49:0/1841537657 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f143805a4e0 0x7f143805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.261+0000 7f145fe00700 1 --2- 172.21.15.49:0/1841537657 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f143805a4e0 0x7f143805c9a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f1450007fd0 tx=0x7f1450007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:45.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.261+0000 7f1471132740 1 Processor -- start 2024-01-22T05:07:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.261+0000 7f1471132740 1 -- start start 2024-01-22T05:07:45.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f1471132740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe215c0 0xe219a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f1471132740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe22170 0xddccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f1471132740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 0xddd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f1471132740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xd1a2a0 con 0xe215c0 2024-01-22T05:07:45.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f1471132740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xd3d4a0 con 0xddd1b0 2024-01-22T05:07:45.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f1471132740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xd06ce0 con 0xe22170 2024-01-22T05:07:45.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f145fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe215c0 0xe219a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f145fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe215c0 0xe219a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44932/0 (socket says 172.21.15.49:44932) 2024-01-22T05:07:45.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f145fe00700 1 -- 172.21.15.49:0/2940889338 learned_addr learned my addr 172.21.15.49:0/2940889338 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:45.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f1464c00700 1 --2- 172.21.15.49:0/2940889338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 0xddd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f145f400700 1 --2- 172.21.15.49:0/2940889338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe22170 0xddccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f145fe00700 1 -- 172.21.15.49:0/2940889338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe22170 msgr2=0xddccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:45.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f145fe00700 1 --2- 172.21.15.49:0/2940889338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe22170 0xddccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f145fe00700 1 -- 172.21.15.49:0/2940889338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 msgr2=0xddd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:45.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f145fe00700 1 --2- 172.21.15.49:0/2940889338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 0xddd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f145fe00700 1 -- 172.21.15.49:0/2940889338 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd6b8e0 con 0xe215c0 2024-01-22T05:07:45.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f145fe00700 1 --2- 172.21.15.49:0/2940889338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe215c0 0xe219a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f1450002b30 tx=0x7f1450013000).ready entity=mon.0 client_cookie=f0bbdaabb736c124 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:45.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f144f400700 1 -- 172.21.15.49:0/2940889338 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14500147e0 con 0xe215c0 2024-01-22T05:07:45.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f144f400700 1 -- 172.21.15.49:0/2940889338 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1450014940 con 0xe215c0 2024-01-22T05:07:45.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.265+0000 7f144f400700 1 -- 172.21.15.49:0/2940889338 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450014cc0 con 0xe215c0 2024-01-22T05:07:45.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.269+0000 7f1471132740 1 -- 172.21.15.49:0/2940889338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe215c0 msgr2=0xe219a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.269+0000 7f1471132740 1 --2- 172.21.15.49:0/2940889338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe215c0 0xe219a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f1450002b30 tx=0x7f1450013000).stop 2024-01-22T05:07:45.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.269+0000 7f1471132740 1 -- 172.21.15.49:0/2940889338 shutdown_connections 2024-01-22T05:07:45.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.269+0000 7f1471132740 1 --2- 172.21.15.49:0/2940889338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 0xddd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.269+0000 7f1471132740 1 --2- 172.21.15.49:0/2940889338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe22170 0xddccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.269+0000 7f1471132740 1 --2- 172.21.15.49:0/2940889338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe215c0 0xe219a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.269+0000 7f1471132740 1 -- 172.21.15.49:0/2940889338 >> 172.21.15.49:0/2940889338 conn(0xbbf640 msgr2=0xe26e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:45.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.269+0000 7f1471132740 1 -- 172.21.15.49:0/2940889338 shutdown_connections 2024-01-22T05:07:45.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.269+0000 7f1471132740 1 -- 172.21.15.49:0/2940889338 wait complete. 2024-01-22T05:07:45.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.269+0000 7f1471132740 1 -- start start 2024-01-22T05:07:45.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.269+0000 7f1471132740 1 Processor -- start 2024-01-22T05:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1471132740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 0xe05110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1471132740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe215c0 0xe06910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1471132740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe22170 0xddaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1471132740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xe32fe0 con 0xe22170 2024-01-22T05:07:45.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1471132740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xe07140 con 0xddd1b0 2024-01-22T05:07:45.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1471132740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xe32b50 con 0xe215c0 2024-01-22T05:07:45.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1471132740 10 client.0 ll_register_callbacks cb 0xd979f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:07:45.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1464c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe22170 0xddaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1464c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe22170 0xddaac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44934/0 (socket says 172.21.15.49:44934) 2024-01-22T05:07:45.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1464c00700 1 -- 172.21.15.49:0/3313269771 learned_addr learned my addr 172.21.15.49:0/3313269771 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:45.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f145f400700 1 --2- 172.21.15.49:0/3313269771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe215c0 0xe06910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f145fe00700 1 --2- 172.21.15.49:0/3313269771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 0xe05110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1464c00700 1 -- 172.21.15.49:0/3313269771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe215c0 msgr2=0xe06910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1464c00700 1 --2- 172.21.15.49:0/3313269771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe215c0 0xe06910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1464c00700 1 -- 172.21.15.49:0/3313269771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 msgr2=0xe05110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1464c00700 1 --2- 172.21.15.49:0/3313269771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 0xe05110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1464c00700 1 -- 172.21.15.49:0/3313269771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14500027d0 con 0xe22170 2024-01-22T05:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f145fe00700 1 --2- 172.21.15.49:0/3313269771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 0xe05110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1464c00700 1 --2- 172.21.15.49:0/3313269771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe22170 0xddaac0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f1458011000 tx=0x7f1458009780).ready entity=mon.0 client_cookie=f206cbd8704a807a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1447e00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:07:45.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1447e00700 1 -- 172.21.15.49:0/3313269771 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145800be40 con 0xe22170 2024-01-22T05:07:45.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1471132740 1 -- 172.21.15.49:0/3313269771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xd571f0 con 0xe22170 2024-01-22T05:07:45.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1447e00700 1 -- 172.21.15.49:0/3313269771 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f145801e610 con 0xe22170 2024-01-22T05:07:45.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1447e00700 1 -- 172.21.15.49:0/3313269771 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f145801e9e0 con 0xe22170 2024-01-22T05:07:45.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1471132740 10 client.5418 fetch_fsmap learned FSMap version 34 2024-01-22T05:07:45.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.273+0000 7f1471132740 1 -- 172.21.15.49:0/3313269771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0xd5a780 con 0xe22170 2024-01-22T05:07:45.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f1447e00700 1 -- 172.21.15.49:0/3313269771 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xd571f0 con 0xe22170 2024-01-22T05:07:45.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f1447e00700 1 -- 172.21.15.49:0/3313269771 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f145801eb40 con 0xe22170 2024-01-22T05:07:45.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f1471132740 10 client.5418 fetch_fsmap finished waiting for FSMap version 34 2024-01-22T05:07:45.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f1471132740 10 client.5418 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-01-22T05:07:45.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f1471132740 20 client.5418 populate_metadata read hostname 'smithi049' 2024-01-22T05:07:45.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f1471132740 1 --2- 172.21.15.49:0/3313269771 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xe0c560 0xe0c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f1471132740 4 client.5418 mds_command: new command op to 5121 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:07:45.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f1471132740 1 -- 172.21.15.49:0/3313269771 --> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xd4d740 con 0xe0c560 2024-01-22T05:07:45.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f145fe00700 1 --2- 172.21.15.49:0/3313269771 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xe0c560 0xe0c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f1447e00700 10 client.5418 ms_handle_connect on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:45.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f145fe00700 1 --2- 172.21.15.49:0/3313269771 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xe0c560 0xe0c970 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f098a1af26df1283 server_cookie=17508838f2fce50b in_seq=0 out_seq=0 2024-01-22T05:07:45.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f1447e00700 1 -- 172.21.15.49:0/3313269771 <== mds.0 v2:172.21.15.49:6834/3211151680 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xd4d740 con 0xe0c560 2024-01-22T05:07:45.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f1447e00700 10 client.5418 handle_command_reply: tid=0 2024-01-22T05:07:45.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f1471132740 1 client.5418 shutdown 2024-01-22T05:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f1471132740 1 -- 172.21.15.49:0/3313269771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe22170 msgr2=0xddaac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.277+0000 7f1471132740 1 --2- 172.21.15.49:0/3313269771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe22170 0xddaac0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f1458011000 tx=0x7f1458009780).stop 2024-01-22T05:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.281+0000 7f1471132740 1 -- 172.21.15.49:0/3313269771 shutdown_connections 2024-01-22T05:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.281+0000 7f1471132740 1 --2- 172.21.15.49:0/3313269771 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xe0c560 0xe0c970 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.281+0000 7f1471132740 1 --2- 172.21.15.49:0/3313269771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe22170 0xddaac0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.281+0000 7f1447e00700 0 client.5418 ms_handle_reset on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.281+0000 7f1471132740 1 --2- 172.21.15.49:0/3313269771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe215c0 0xe06910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.281+0000 7f1471132740 1 --2- 172.21.15.49:0/3313269771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 0xe05110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.281+0000 7f1471132740 1 -- 172.21.15.49:0/3313269771 >> 172.21.15.49:0/3313269771 conn(0xbbf640 msgr2=0xe23fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:45.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.281+0000 7f1471132740 1 -- 172.21.15.49:0/3313269771 shutdown_connections 2024-01-22T05:07:45.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.281+0000 7f1471132740 1 -- 172.21.15.49:0/3313269771 wait complete. 2024-01-22T05:07:45.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.281+0000 7f1471132740 20 client.5418 trim_cache size 0 max 16384 2024-01-22T05:07:45.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.301+0000 7f1471132740 1 Processor -- start 2024-01-22T05:07:45.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.301+0000 7f1471132740 1 -- start start 2024-01-22T05:07:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.301+0000 7f1471132740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xddd1b0 0xe26be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.301+0000 7f1471132740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe215c0 0xe3c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.301+0000 7f1471132740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe22170 0xe3ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.301+0000 7f1471132740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xe0ceb0 con 0xe215c0 2024-01-22T05:07:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.301+0000 7f1471132740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xe08e90 con 0xe22170 2024-01-22T05:07:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.301+0000 7f1471132740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xe3cf40 con 0xddd1b0 2024-01-22T05:07:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f145f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe215c0 0xe3c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f145fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xddd1b0 0xe26be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f145fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xddd1b0 0xe26be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:60894/0 (socket says 172.21.15.49:60894) 2024-01-22T05:07:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f145fe00700 1 -- 172.21.15.49:0/3749149553 learned_addr learned my addr 172.21.15.49:0/3749149553 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:45.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f1464c00700 1 --2- 172.21.15.49:0/3749149553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe22170 0xe3ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f145fe00700 1 -- 172.21.15.49:0/3749149553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe22170 msgr2=0xe3ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:45.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f145fe00700 1 --2- 172.21.15.49:0/3749149553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe22170 0xe3ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f145fe00700 1 -- 172.21.15.49:0/3749149553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe215c0 msgr2=0xe3c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:45.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f145fe00700 1 --2- 172.21.15.49:0/3749149553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe215c0 0xe3c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f145fe00700 1 -- 172.21.15.49:0/3749149553 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd559b0 con 0xddd1b0 2024-01-22T05:07:45.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f145f400700 1 --2- 172.21.15.49:0/3749149553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe215c0 0xe3c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:45.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f145fe00700 1 --2- 172.21.15.49:0/3749149553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xddd1b0 0xe26be0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1450003770 tx=0x7f1450016000).ready entity=mon.2 client_cookie=eddb4fbffb38139e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:45.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f144fe00700 1 -- 172.21.15.49:0/3749149553 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14500147e0 con 0xddd1b0 2024-01-22T05:07:45.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f144fe00700 1 -- 172.21.15.49:0/3749149553 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145002d0e0 con 0xddd1b0 2024-01-22T05:07:45.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f144fe00700 1 -- 172.21.15.49:0/3749149553 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450014040 con 0xddd1b0 2024-01-22T05:07:45.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f1471132740 1 -- 172.21.15.49:0/3749149553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xddd1b0 msgr2=0xe26be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f1471132740 1 --2- 172.21.15.49:0/3749149553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xddd1b0 0xe26be0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1450003770 tx=0x7f1450016000).stop 2024-01-22T05:07:45.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f1471132740 1 -- 172.21.15.49:0/3749149553 shutdown_connections 2024-01-22T05:07:45.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f1471132740 1 --2- 172.21.15.49:0/3749149553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe22170 0xe3ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f1471132740 1 --2- 172.21.15.49:0/3749149553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe215c0 0xe3c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f1471132740 1 --2- 172.21.15.49:0/3749149553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xddd1b0 0xe26be0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f1471132740 1 -- 172.21.15.49:0/3749149553 >> 172.21.15.49:0/3749149553 conn(0xbbf640 msgr2=0xe05110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:45.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.305+0000 7f1471132740 1 -- 172.21.15.49:0/3749149553 shutdown_connections 2024-01-22T05:07:45.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.309+0000 7f1471132740 1 -- 172.21.15.49:0/3749149553 wait complete. 2024-01-22T05:07:45.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.309+0000 7f1471132740 1 -- start start 2024-01-22T05:07:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.309+0000 7f1471132740 1 Processor -- start 2024-01-22T05:07:45.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1471132740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 0xe87f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1471132740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe215c0 0xe88410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1471132740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe22170 0xdd9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1471132740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xe06ce0 con 0xe22170 2024-01-22T05:07:45.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1471132740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xddc0d0 con 0xddd1b0 2024-01-22T05:07:45.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1471132740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xe32950 con 0xe215c0 2024-01-22T05:07:45.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1471132740 10 client.0 ll_register_callbacks cb 0x7f1458012a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:07:45.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1464c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe22170 0xdd9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1464c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe22170 0xdd9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44962/0 (socket says 172.21.15.49:44962) 2024-01-22T05:07:45.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1464c00700 1 -- 172.21.15.49:0/3522455715 learned_addr learned my addr 172.21.15.49:0/3522455715 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:45.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f145fe00700 1 --2- 172.21.15.49:0/3522455715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 0xe87f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f145f400700 1 --2- 172.21.15.49:0/3522455715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe215c0 0xe88410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1464c00700 1 -- 172.21.15.49:0/3522455715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe215c0 msgr2=0xe88410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1464c00700 1 --2- 172.21.15.49:0/3522455715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe215c0 0xe88410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1464c00700 1 -- 172.21.15.49:0/3522455715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 msgr2=0xe87f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1464c00700 1 --2- 172.21.15.49:0/3522455715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 0xe87f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1464c00700 1 -- 172.21.15.49:0/3522455715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146014cbe0 con 0xe22170 2024-01-22T05:07:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1464c00700 1 --2- 172.21.15.49:0/3522455715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe22170 0xdd9840 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f1458009e90 tx=0x7f1458021040).ready entity=mon.0 client_cookie=5cfa2f8b66a786cb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1447e00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:07:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1447e00700 1 -- 172.21.15.49:0/3522455715 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145801e610 con 0xe22170 2024-01-22T05:07:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1447e00700 1 -- 172.21.15.49:0/3522455715 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f1458028630 con 0xe22170 2024-01-22T05:07:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.313+0000 7f1471132740 1 -- 172.21.15.49:0/3522455715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1450014940 con 0xe22170 2024-01-22T05:07:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1447e00700 1 -- 172.21.15.49:0/3522455715 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1458028a00 con 0xe22170 2024-01-22T05:07:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1471132740 10 client.5424 fetch_fsmap learned FSMap version 34 2024-01-22T05:07:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1471132740 1 -- 172.21.15.49:0/3522455715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x7f1450024040 con 0xe22170 2024-01-22T05:07:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1447e00700 1 -- 172.21.15.49:0/3522455715 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1450014940 con 0xe22170 2024-01-22T05:07:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1447e00700 1 -- 172.21.15.49:0/3522455715 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1458028b60 con 0xe22170 2024-01-22T05:07:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1471132740 10 client.5424 fetch_fsmap finished waiting for FSMap version 34 2024-01-22T05:07:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1471132740 10 client.5424 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-01-22T05:07:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1471132740 20 client.5424 populate_metadata read hostname 'smithi049' 2024-01-22T05:07:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1471132740 1 --2- 172.21.15.49:0/3522455715 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xdd9d30 0xe03a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1471132740 4 client.5424 mds_command: new command op to 5121 tid=0[{"prefix": "perf dump"}] 2024-01-22T05:07:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1471132740 1 -- 172.21.15.49:0/3522455715 --> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0xc165d0 con 0xdd9d30 2024-01-22T05:07:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f145fe00700 1 --2- 172.21.15.49:0/3522455715 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xdd9d30 0xe03a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1447e00700 10 client.5424 ms_handle_connect on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f145fe00700 1 --2- 172.21.15.49:0/3522455715 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xdd9d30 0xe03a70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1fa37941cc51076 server_cookie=e182758071da3073 in_seq=0 out_seq=0 2024-01-22T05:07:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1447e00700 1 -- 172.21.15.49:0/3522455715 <== mds.0 v2:172.21.15.49:6834/3211151680 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17084 (crc 0 0 0) 0xc165d0 con 0xdd9d30 2024-01-22T05:07:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1447e00700 10 client.5424 handle_command_reply: tid=0 2024-01-22T05:07:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1471132740 1 client.5424 shutdown 2024-01-22T05:07:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1471132740 1 -- 172.21.15.49:0/3522455715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe22170 msgr2=0xdd9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.317+0000 7f1471132740 1 --2- 172.21.15.49:0/3522455715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe22170 0xdd9840 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f1458009e90 tx=0x7f1458021040).stop 2024-01-22T05:07:45.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1471132740 1 -- 172.21.15.49:0/3522455715 shutdown_connections 2024-01-22T05:07:45.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1471132740 1 --2- 172.21.15.49:0/3522455715 >> [v2:172.21.15.49:6834/3211151680,v1:172.21.15.49:6836/3211151680] conn(0xdd9d30 0xe03a70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1471132740 1 --2- 172.21.15.49:0/3522455715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe22170 0xdd9840 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1471132740 1 --2- 172.21.15.49:0/3522455715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe215c0 0xe88410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1471132740 1 --2- 172.21.15.49:0/3522455715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xddd1b0 0xe87f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1471132740 1 -- 172.21.15.49:0/3522455715 >> 172.21.15.49:0/3522455715 conn(0xbbf640 msgr2=0xe083e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1447e00700 0 client.5424 ms_handle_reset on v2:172.21.15.49:6834/3211151680 2024-01-22T05:07:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1471132740 1 -- 172.21.15.49:0/3522455715 shutdown_connections 2024-01-22T05:07:45.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1471132740 1 -- 172.21.15.49:0/3522455715 wait complete. 2024-01-22T05:07:45.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1471132740 20 client.5424 trim_cache size 0 max 16384 2024-01-22T05:07:45.323 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:07:45.323 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-01-22T05:07:45.323 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 4411, 2024-01-22T05:07:45.323 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 4387, 2024-01-22T05:07:45.323 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1378495, 2024-01-22T05:07:45.323 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 31094275, 2024-01-22T05:07:45.323 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 16, 2024-01-22T05:07:45.324 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 6, 2024-01-22T05:07:45.324 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.610988221, 2024-01-22T05:07:45.324 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.279183445, 2024-01-22T05:07:45.324 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.137224778, 2024-01-22T05:07:45.324 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.150978128, 2024-01-22T05:07:45.324 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-01-22T05:07:45.324 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 4387, 2024-01-22T05:07:45.324 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.243696105, 2024-01-22T05:07:45.324 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000511442 2024-01-22T05:07:45.324 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.324 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-01-22T05:07:45.324 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 10, 2024-01-22T05:07:45.324 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000002255, 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000225 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 31328, 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 52632, 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 10501407, 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 53805539, 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 8, 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 6.876114351, 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 4.792423005, 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.924721306, 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.370174207, 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-01-22T05:07:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 52630, 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 3.921712626, 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000074514 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 46715, 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.017774367, 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000380 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 6876, 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 6878, 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 2425158, 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 37177062, 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 6, 2024-01-22T05:07:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.922571936, 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.463231579, 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.166392610, 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.228929370, 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6876, 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 12.096660764, 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001759258 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.327 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-01-22T05:07:45.328 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 1, 2024-01-22T05:07:45.328 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-01-22T05:07:45.328 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.328 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-MDSRank": { 2024-01-22T05:07:45.328 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-01-22T05:07:45.328 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-01-22T05:07:45.328 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6559, 2024-01-22T05:07:45.328 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 19.439503574, 2024-01-22T05:07:45.328 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002963790 2024-01-22T05:07:45.328 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:45.328 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.328 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-PurgeQueue": { 2024-01-22T05:07:45.328 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-01-22T05:07:45.328 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-01-22T05:07:45.329 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3221, 2024-01-22T05:07:45.329 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 1.328233427, 2024-01-22T05:07:45.329 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000412366 2024-01-22T05:07:45.329 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:45.329 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.329 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-01-22T05:07:45.329 INFO:teuthology.orchestra.run.smithi049.stdout: "request": 26141, 2024-01-22T05:07:45.329 INFO:teuthology.orchestra.run.smithi049.stdout: "reply": 26141, 2024-01-22T05:07:45.329 INFO:teuthology.orchestra.run.smithi049.stdout: "reply_latency": { 2024-01-22T05:07:45.329 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 26141, 2024-01-22T05:07:45.329 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 280.912312468, 2024-01-22T05:07:45.329 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.010746043 2024-01-22T05:07:45.329 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.329 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_reply": 0, 2024-01-22T05:07:45.330 INFO:teuthology.orchestra.run.smithi049.stdout: "forward": 0, 2024-01-22T05:07:45.330 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch": 0, 2024-01-22T05:07:45.330 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_commit": 68, 2024-01-22T05:07:45.330 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_split": 0, 2024-01-22T05:07:45.330 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_merge": 0, 2024-01-22T05:07:45.330 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes": 7503, 2024-01-22T05:07:45.330 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_top": 5244, 2024-01-22T05:07:45.330 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_bottom": 2259, 2024-01-22T05:07:45.330 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pin_tail": 0, 2024-01-22T05:07:45.330 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pinned": 11, 2024-01-22T05:07:45.330 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_expired": 8001, 2024-01-22T05:07:45.330 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_with_caps": 2, 2024-01-22T05:07:45.330 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": 2, 2024-01-22T05:07:45.330 INFO:teuthology.orchestra.run.smithi049.stdout: "subtrees": 2, 2024-01-22T05:07:45.330 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse": 49189, 2024-01-22T05:07:45.331 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_hit": 48576, 2024-01-22T05:07:45.331 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_forward": 0, 2024-01-22T05:07:45.331 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_discover": 0, 2024-01-22T05:07:45.331 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_dir_fetch": 0, 2024-01-22T05:07:45.331 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_remote_ino": 0, 2024-01-22T05:07:45.331 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_lock": 174, 2024-01-22T05:07:45.331 INFO:teuthology.orchestra.run.smithi049.stdout: "load_cent": 15367, 2024-01-22T05:07:45.331 INFO:teuthology.orchestra.run.smithi049.stdout: "q": 0, 2024-01-22T05:07:45.331 INFO:teuthology.orchestra.run.smithi049.stdout: "exported": 0, 2024-01-22T05:07:45.331 INFO:teuthology.orchestra.run.smithi049.stdout: "exported_inodes": 0, 2024-01-22T05:07:45.331 INFO:teuthology.orchestra.run.smithi049.stdout: "imported": 0, 2024-01-22T05:07:45.331 INFO:teuthology.orchestra.run.smithi049.stdout: "imported_inodes": 0, 2024-01-22T05:07:45.331 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_dir_fetch": 0, 2024-01-22T05:07:45.331 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_backtrace_fetch": 1860, 2024-01-22T05:07:45.332 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_peer_discover": 0, 2024-01-22T05:07:45.332 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rfiles": 0, 2024-01-22T05:07:45.332 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rbytes": 0, 2024-01-22T05:07:45.332 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rsnaps": 0, 2024-01-22T05:07:45.332 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_fetch": 1860, 2024-01-22T05:07:45.332 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_set_tag": 0, 2024-01-22T05:07:45.332 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_repaired": 0, 2024-01-22T05:07:45.332 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_inotable_repaired": 0, 2024-01-22T05:07:45.332 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_inodes": 13, 2024-01-22T05:07:45.332 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_base_inodes": 2, 2024-01-22T05:07:45.332 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dirfrag_rstats": 11, 2024-01-22T05:07:45.332 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_file_inodes": 1847, 2024-01-22T05:07:45.332 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_inode_file_caps": 0, 2024-01-22T05:07:45.332 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_revoke": 1050, 2024-01-22T05:07:45.333 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_grant": 4031, 2024-01-22T05:07:45.333 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_trunc": 0, 2024-01-22T05:07:45.333 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-22T05:07:45.333 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-22T05:07:45.333 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps": 3640, 2024-01-22T05:07:45.333 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps_dirty": 2000, 2024-01-22T05:07:45.333 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_cap_release": 61, 2024-01-22T05:07:45.333 INFO:teuthology.orchestra.run.smithi049.stdout: "process_request_cap_release": 14107 2024-01-22T05:07:45.333 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.333 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache": { 2024-01-22T05:07:45.333 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays": 0, 2024-01-22T05:07:45.333 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_delayed": 0, 2024-01-22T05:07:45.333 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_enqueuing": 0, 2024-01-22T05:07:45.333 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_created": 4091, 2024-01-22T05:07:45.333 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_enqueued": 3725, 2024-01-22T05:07:45.334 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_reintegrated": 2206, 2024-01-22T05:07:45.334 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_migrated": 0, 2024-01-22T05:07:45.334 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_processing": 0, 2024-01-22T05:07:45.334 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_enqueued": 0, 2024-01-22T05:07:45.334 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_prioritized": 0, 2024-01-22T05:07:45.334 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_started": 0, 2024-01-22T05:07:45.334 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_completed": 0, 2024-01-22T05:07:45.334 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_enqueue_scrub": 1, 2024-01-22T05:07:45.334 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_exportdir": 0, 2024-01-22T05:07:45.334 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_flush": 0, 2024-01-22T05:07:45.334 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragmentdir": 0, 2024-01-22T05:07:45.334 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragstats": 0, 2024-01-22T05:07:45.334 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_inodestats": 0 2024-01-22T05:07:45.335 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.335 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log": { 2024-01-22T05:07:45.335 INFO:teuthology.orchestra.run.smithi049.stdout: "evadd": 26505, 2024-01-22T05:07:45.335 INFO:teuthology.orchestra.run.smithi049.stdout: "evex": 26185, 2024-01-22T05:07:45.335 INFO:teuthology.orchestra.run.smithi049.stdout: "evtrm": 26185, 2024-01-22T05:07:45.335 INFO:teuthology.orchestra.run.smithi049.stdout: "ev": 1344, 2024-01-22T05:07:45.335 INFO:teuthology.orchestra.run.smithi049.stdout: "evexg": 0, 2024-01-22T05:07:45.335 INFO:teuthology.orchestra.run.smithi049.stdout: "evexd": 1024, 2024-01-22T05:07:45.335 INFO:teuthology.orchestra.run.smithi049.stdout: "segadd": 35, 2024-01-22T05:07:45.335 INFO:teuthology.orchestra.run.smithi049.stdout: "segex": 34, 2024-01-22T05:07:45.335 INFO:teuthology.orchestra.run.smithi049.stdout: "segtrm": 34, 2024-01-22T05:07:45.335 INFO:teuthology.orchestra.run.smithi049.stdout: "seg": 2, 2024-01-22T05:07:45.335 INFO:teuthology.orchestra.run.smithi049.stdout: "segexg": 0, 2024-01-22T05:07:45.335 INFO:teuthology.orchestra.run.smithi049.stdout: "segexd": 1, 2024-01-22T05:07:45.336 INFO:teuthology.orchestra.run.smithi049.stdout: "expos": 86101476, 2024-01-22T05:07:45.336 INFO:teuthology.orchestra.run.smithi049.stdout: "wrpos": 86294986, 2024-01-22T05:07:45.336 INFO:teuthology.orchestra.run.smithi049.stdout: "rdpos": 0, 2024-01-22T05:07:45.336 INFO:teuthology.orchestra.run.smithi049.stdout: "jlat": { 2024-01-22T05:07:45.336 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 4407, 2024-01-22T05:07:45.336 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 81.538925472, 2024-01-22T05:07:45.336 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018502138 2024-01-22T05:07:45.336 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.336 INFO:teuthology.orchestra.run.smithi049.stdout: "replayed": 0 2024-01-22T05:07:45.336 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.336 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_mem": { 2024-01-22T05:07:45.336 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 14, 2024-01-22T05:07:45.336 INFO:teuthology.orchestra.run.smithi049.stdout: "ino+": 2016, 2024-01-22T05:07:45.337 INFO:teuthology.orchestra.run.smithi049.stdout: "ino-": 2002, 2024-01-22T05:07:45.337 INFO:teuthology.orchestra.run.smithi049.stdout: "dir": 13, 2024-01-22T05:07:45.337 INFO:teuthology.orchestra.run.smithi049.stdout: "dir+": 13, 2024-01-22T05:07:45.337 INFO:teuthology.orchestra.run.smithi049.stdout: "dir-": 0, 2024-01-22T05:07:45.337 INFO:teuthology.orchestra.run.smithi049.stdout: "dn": 7670, 2024-01-22T05:07:45.337 INFO:teuthology.orchestra.run.smithi049.stdout: "dn+": 19940, 2024-01-22T05:07:45.337 INFO:teuthology.orchestra.run.smithi049.stdout: "dn-": 12270, 2024-01-22T05:07:45.337 INFO:teuthology.orchestra.run.smithi049.stdout: "cap": 2, 2024-01-22T05:07:45.337 INFO:teuthology.orchestra.run.smithi049.stdout: "cap+": 8226, 2024-01-22T05:07:45.337 INFO:teuthology.orchestra.run.smithi049.stdout: "cap-": 8224, 2024-01-22T05:07:45.337 INFO:teuthology.orchestra.run.smithi049.stdout: "rss": 84548, 2024-01-22T05:07:45.337 INFO:teuthology.orchestra.run.smithi049.stdout: "heap": 340196 2024-01-22T05:07:45.337 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.337 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_server": { 2024-01-22T05:07:45.337 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_client_request": 29946, 2024-01-22T05:07:45.338 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_server_request": 0, 2024-01-22T05:07:45.338 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_request": 26141, 2024-01-22T05:07:45.338 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_session": 7, 2024-01-22T05:07:45.338 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_peer_request": 0, 2024-01-22T05:07:45.338 INFO:teuthology.orchestra.run.smithi049.stdout: "req_create_latency": { 2024-01-22T05:07:45.338 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2000, 2024-01-22T05:07:45.338 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.404811377, 2024-01-22T05:07:45.338 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001202405 2024-01-22T05:07:45.338 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.338 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getattr_latency": { 2024-01-22T05:07:45.338 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-01-22T05:07:45.338 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.003698907, 2024-01-22T05:07:45.338 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000462363 2024-01-22T05:07:45.338 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.338 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getfilelock_latency": { 2024-01-22T05:07:45.339 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.339 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.339 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.339 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.339 INFO:teuthology.orchestra.run.smithi049.stdout: "req_link_latency": { 2024-01-22T05:07:45.339 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6000, 2024-01-22T05:07:45.339 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 11.918429222, 2024-01-22T05:07:45.339 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001986404 2024-01-22T05:07:45.339 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.339 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookup_latency": { 2024-01-22T05:07:45.339 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 7914, 2024-01-22T05:07:45.339 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 9.207072358, 2024-01-22T05:07:45.339 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001163390 2024-01-22T05:07:45.339 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.339 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookuphash_latency": { 2024-01-22T05:07:45.340 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.340 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.340 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.340 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.340 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupino_latency": { 2024-01-22T05:07:45.340 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.340 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.340 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.340 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.340 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupname_latency": { 2024-01-22T05:07:45.340 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.340 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.340 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.340 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.341 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupparent_latency": { 2024-01-22T05:07:45.341 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.341 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.341 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.341 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.341 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupsnap_latency": { 2024-01-22T05:07:45.341 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:07:45.341 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000188031, 2024-01-22T05:07:45.341 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000188031 2024-01-22T05:07:45.341 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.341 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lssnap_latency": { 2024-01-22T05:07:45.341 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.341 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.341 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.342 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.342 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mkdir_latency": { 2024-01-22T05:07:45.342 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:07:45.342 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.004872684, 2024-01-22T05:07:45.342 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.004872684 2024-01-22T05:07:45.342 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.342 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mknod_latency": { 2024-01-22T05:07:45.342 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.342 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.342 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.342 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.342 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mksnap_latency": { 2024-01-22T05:07:45.342 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:07:45.342 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.017555346, 2024-01-22T05:07:45.342 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.017555346 2024-01-22T05:07:45.343 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.343 INFO:teuthology.orchestra.run.smithi049.stdout: "req_open_latency": { 2024-01-22T05:07:45.343 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.343 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.343 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.343 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.343 INFO:teuthology.orchestra.run.smithi049.stdout: "req_readdir_latency": { 2024-01-22T05:07:45.343 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-01-22T05:07:45.343 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.137426115, 2024-01-22T05:07:45.343 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.017178264 2024-01-22T05:07:45.343 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.343 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rename_latency": { 2024-01-22T05:07:45.343 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2206, 2024-01-22T05:07:45.343 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 237.389705576, 2024-01-22T05:07:45.344 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.107610927 2024-01-22T05:07:45.344 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.344 INFO:teuthology.orchestra.run.smithi049.stdout: "req_renamesnap_latency": { 2024-01-22T05:07:45.344 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.344 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.344 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.344 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.344 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmdir_latency": { 2024-01-22T05:07:45.344 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.344 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.344 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.344 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.345 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmsnap_latency": { 2024-01-22T05:07:45.345 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:07:45.345 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.071521469, 2024-01-22T05:07:45.345 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.071521469 2024-01-22T05:07:45.345 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.345 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmxattr_latency": { 2024-01-22T05:07:45.345 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.345 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.345 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.345 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.345 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setattr_latency": { 2024-01-22T05:07:45.345 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:07:45.345 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000549976, 2024-01-22T05:07:45.345 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000549976 2024-01-22T05:07:45.346 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.346 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setdirlayout_latency": { 2024-01-22T05:07:45.346 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.346 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.346 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.346 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.346 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setfilelock_latency": { 2024-01-22T05:07:45.346 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.346 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.346 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.346 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.346 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setlayout_latency": { 2024-01-22T05:07:45.346 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.346 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.346 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.347 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.347 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setxattr_latency": { 2024-01-22T05:07:45.347 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.347 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.347 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.347 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.347 INFO:teuthology.orchestra.run.smithi049.stdout: "req_symlink_latency": { 2024-01-22T05:07:45.347 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.347 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.347 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.347 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.347 INFO:teuthology.orchestra.run.smithi049.stdout: "req_unlink_latency": { 2024-01-22T05:07:45.347 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8000, 2024-01-22T05:07:45.347 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 19.756481407, 2024-01-22T05:07:45.348 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002469560 2024-01-22T05:07:45.348 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.348 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_revoke_eviction": 0, 2024-01-22T05:07:45.348 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_acquisition_throttle": 0, 2024-01-22T05:07:45.348 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getvxattr_latency": { 2024-01-22T05:07:45.348 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.348 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.348 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.348 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:45.348 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.348 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_sessions": { 2024-01-22T05:07:45.348 INFO:teuthology.orchestra.run.smithi049.stdout: "session_count": 1, 2024-01-22T05:07:45.348 INFO:teuthology.orchestra.run.smithi049.stdout: "session_add": 1, 2024-01-22T05:07:45.348 INFO:teuthology.orchestra.run.smithi049.stdout: "session_remove": 0, 2024-01-22T05:07:45.349 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_open": 1, 2024-01-22T05:07:45.349 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_stale": 0, 2024-01-22T05:07:45.349 INFO:teuthology.orchestra.run.smithi049.stdout: "total_load": 17381, 2024-01-22T05:07:45.349 INFO:teuthology.orchestra.run.smithi049.stdout: "average_load": 17381, 2024-01-22T05:07:45.349 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_session_uptime": 109, 2024-01-22T05:07:45.349 INFO:teuthology.orchestra.run.smithi049.stdout: "mdthresh_evicted": 0 2024-01-22T05:07:45.349 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.349 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-01-22T05:07:45.349 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 18706, 2024-01-22T05:07:45.349 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 18706, 2024-01-22T05:07:45.349 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-01-22T05:07:45.349 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-01-22T05:07:45.349 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-01-22T05:07:45.349 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-01-22T05:07:45.350 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-22T05:07:45.350 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-01-22T05:07:45.350 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-22T05:07:45.350 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-01-22T05:07:45.350 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-01-22T05:07:45.350 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-01-22T05:07:45.350 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Buffer_bytes": 0, 2024-01-22T05:07:45.350 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Buffer_items": 0, 2024-01-22T05:07:45.350 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Extent_bytes": 0, 2024-01-22T05:07:45.350 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Extent_items": 0, 2024-01-22T05:07:45.350 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Blob_bytes": 0, 2024-01-22T05:07:45.350 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Blob_items": 0, 2024-01-22T05:07:45.350 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_SharedBlob_bytes": 0, 2024-01-22T05:07:45.350 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_SharedBlob_items": 0, 2024-01-22T05:07:45.351 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-22T05:07:45.351 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-01-22T05:07:45.351 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-01-22T05:07:45.351 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-01-22T05:07:45.351 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-01-22T05:07:45.351 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-01-22T05:07:45.351 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-22T05:07:45.351 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-01-22T05:07:45.351 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-01-22T05:07:45.351 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-01-22T05:07:45.351 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-01-22T05:07:45.351 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-01-22T05:07:45.351 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-01-22T05:07:45.351 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-01-22T05:07:45.351 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-01-22T05:07:45.352 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-01-22T05:07:45.352 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 179602, 2024-01-22T05:07:45.352 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 95, 2024-01-22T05:07:45.352 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-01-22T05:07:45.352 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-01-22T05:07:45.352 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-01-22T05:07:45.352 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-01-22T05:07:45.352 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-01-22T05:07:45.352 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-01-22T05:07:45.352 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-01-22T05:07:45.352 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-01-22T05:07:45.352 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 6608, 2024-01-22T05:07:45.352 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 87, 2024-01-22T05:07:45.352 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-01-22T05:07:45.353 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-01-22T05:07:45.353 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-01-22T05:07:45.353 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-01-22T05:07:45.353 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 5720055, 2024-01-22T05:07:45.353 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 298736, 2024-01-22T05:07:45.353 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-01-22T05:07:45.353 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-01-22T05:07:45.353 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-01-22T05:07:45.353 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-01-22T05:07:45.353 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.353 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": { 2024-01-22T05:07:45.353 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-01-22T05:07:45.353 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-01-22T05:07:45.353 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 14691, 2024-01-22T05:07:45.354 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 92600311, 2024-01-22T05:07:45.354 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 25, 2024-01-22T05:07:45.354 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 14691, 2024-01-22T05:07:45.354 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-01-22T05:07:45.354 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 14691, 2024-01-22T05:07:45.354 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 23523 2024-01-22T05:07:45.354 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.354 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 14691, 2024-01-22T05:07:45.354 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 1937, 2024-01-22T05:07:45.354 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 12754, 2024-01-22T05:07:45.354 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-01-22T05:07:45.354 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-01-22T05:07:45.354 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 55, 2024-01-22T05:07:45.354 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 4329, 2024-01-22T05:07:45.354 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 75, 2024-01-22T05:07:45.355 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 4480, 2024-01-22T05:07:45.355 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 68, 2024-01-22T05:07:45.355 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-01-22T05:07:45.355 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-01-22T05:07:45.355 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 1725, 2024-01-22T05:07:45.355 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-01-22T05:07:45.355 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 2050, 2024-01-22T05:07:45.355 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-01-22T05:07:45.355 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-01-22T05:07:45.355 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-01-22T05:07:45.355 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 1862, 2024-01-22T05:07:45.355 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 8658, 2024-01-22T05:07:45.355 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-01-22T05:07:45.355 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-01-22T05:07:45.355 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-01-22T05:07:45.356 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-01-22T05:07:45.356 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-01-22T05:07:45.356 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-01-22T05:07:45.356 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-01-22T05:07:45.356 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-01-22T05:07:45.356 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-01-22T05:07:45.356 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-01-22T05:07:45.356 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-01-22T05:07:45.356 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-01-22T05:07:45.356 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-01-22T05:07:45.356 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-01-22T05:07:45.356 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-01-22T05:07:45.356 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-01-22T05:07:45.356 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-01-22T05:07:45.357 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-01-22T05:07:45.357 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-01-22T05:07:45.357 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-01-22T05:07:45.357 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-01-22T05:07:45.357 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-01-22T05:07:45.357 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-01-22T05:07:45.357 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-01-22T05:07:45.357 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-01-22T05:07:45.357 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-01-22T05:07:45.357 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 44, 2024-01-22T05:07:45.357 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-01-22T05:07:45.357 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 5, 2024-01-22T05:07:45.357 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 8, 2024-01-22T05:07:45.357 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 8, 2024-01-22T05:07:45.357 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-01-22T05:07:45.358 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-01-22T05:07:45.358 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 170, 2024-01-22T05:07:45.358 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-01-22T05:07:45.358 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 51 2024-01-22T05:07:45.358 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.358 INFO:teuthology.orchestra.run.smithi049.stdout: "oft": { 2024-01-22T05:07:45.358 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_objs": 1, 2024-01-22T05:07:45.358 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_kv_pairs": 0, 2024-01-22T05:07:45.358 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_updates": 0, 2024-01-22T05:07:45.358 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_removes": 0 2024-01-22T05:07:45.358 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.358 INFO:teuthology.orchestra.run.smithi049.stdout: "purge_queue": { 2024-01-22T05:07:45.358 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops": 0, 2024-01-22T05:07:45.358 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops_high_water": 32, 2024-01-22T05:07:45.358 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing": 0, 2024-01-22T05:07:45.359 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_high_water": 32, 2024-01-22T05:07:45.359 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed": 3725, 2024-01-22T05:07:45.359 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_item_in_journal": 0 2024-01-22T05:07:45.359 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.359 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-22T05:07:45.359 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:07:45.359 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-01-22T05:07:45.359 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:07:45.359 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 42610, 2024-01-22T05:07:45.359 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 10908616, 2024-01-22T05:07:45.359 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:07:45.359 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 42610, 2024-01-22T05:07:45.359 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-01-22T05:07:45.359 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-01-22T05:07:45.359 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 42610, 2024-01-22T05:07:45.360 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 10908616, 2024-01-22T05:07:45.360 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:07:45.360 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.360 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.360 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.360 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:45.360 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.360 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": { 2024-01-22T05:07:45.360 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:07:45.360 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-01-22T05:07:45.360 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:07:45.360 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-01-22T05:07:45.360 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-01-22T05:07:45.360 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:07:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-01-22T05:07:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 14691, 2024-01-22T05:07:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 92990336, 2024-01-22T05:07:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 14691, 2024-01-22T05:07:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 92990336, 2024-01-22T05:07:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:07:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": { 2024-01-22T05:07:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:07:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-01-22T05:07:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 14691, 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 14691, 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 14691, 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 14691, 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle": { 2024-01-22T05:07:45.362 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:07:45.363 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-01-22T05:07:45.363 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:07:45.363 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 3725, 2024-01-22T05:07:45.363 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 390025, 2024-01-22T05:07:45.363 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:07:45.363 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 3725, 2024-01-22T05:07:45.363 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-01-22T05:07:45.363 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-01-22T05:07:45.363 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 73, 2024-01-22T05:07:45.363 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 390025, 2024-01-22T05:07:45.363 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:07:45.363 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.363 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.363 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.363 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:45.364 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:45.364 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle-0x560704f14280": { 2024-01-22T05:07:45.364 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:07:45.364 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-01-22T05:07:45.364 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:07:45.364 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 26505, 2024-01-22T05:07:45.364 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 82100682, 2024-01-22T05:07:45.364 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:07:45.364 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 26505, 2024-01-22T05:07:45.364 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-01-22T05:07:45.364 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-01-22T05:07:45.364 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 4407, 2024-01-22T05:07:45.364 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 82100682, 2024-01-22T05:07:45.364 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:07:45.364 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:07:45.365 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:07:45.365 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:07:45.365 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:45.365 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:45.365 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:07:45.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1466c00700 1 -- 172.21.15.49:0/1841537657 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f143805a4e0 msgr2=0x7f143805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1466c00700 1 --2- 172.21.15.49:0/1841537657 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f143805a4e0 0x7f143805c9a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f1450007fd0 tx=0x7f1450007bb0).stop 2024-01-22T05:07:45.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1466c00700 1 -- 172.21.15.49:0/1841537657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600bec40 msgr2=0x7f14600c01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1466c00700 1 --2- 172.21.15.49:0/1841537657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600bec40 0x7f14600c01d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f144800c3f0 tx=0x7f1448007c10).stop 2024-01-22T05:07:45.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1466c00700 1 -- 172.21.15.49:0/1841537657 shutdown_connections 2024-01-22T05:07:45.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1466c00700 1 --2- 172.21.15.49:0/1841537657 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f143805a4e0 0x7f143805c9a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1466c00700 1 --2- 172.21.15.49:0/1841537657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1460155de0 0x7f14600c06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1466c00700 1 --2- 172.21.15.49:0/1841537657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600bec40 0x7f14600c01d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1466c00700 1 --2- 172.21.15.49:0/1841537657 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14600aaf60 0x7f1460144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1466c00700 1 -- 172.21.15.49:0/1841537657 >> 172.21.15.49:0/1841537657 conn(0x7f14600c8740 msgr2=0x7f14600c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:45.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1466c00700 1 -- 172.21.15.49:0/1841537657 shutdown_connections 2024-01-22T05:07:45.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.321+0000 7f1466c00700 1 -- 172.21.15.49:0/1841537657 wait complete. 2024-01-22T05:07:45.368 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:07:45.368 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:07:45.409 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:07:45.451 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:07:45.451 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T05:07:45.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:07:45.451 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-22T05:07:45.507 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:07:45.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:07:45.507 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:07:45.532 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:07:45.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.733+0000 7f4041000700 1 Processor -- start 2024-01-22T05:07:45.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.733+0000 7f4041000700 1 -- start start 2024-01-22T05:07:45.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.737+0000 7f4041000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f403c0bd650 0x7f403c1503c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.737+0000 7f4041000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f403c1508b0 0x7f403c0c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.737+0000 7f4041000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403c0c5880 con 0x7f403c0c3cc0 2024-01-22T05:07:45.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.737+0000 7f4041000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f403c0c5220 con 0x7f403c0bd650 2024-01-22T05:07:45.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.737+0000 7f4041000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f403c0bdd90 con 0x7f403c1508b0 2024-01-22T05:07:45.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.737+0000 7f4039e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f403c0bd650 0x7f403c1503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4039e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f403c0bd650 0x7f403c1503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44966/0 (socket says 172.21.15.49:44966) 2024-01-22T05:07:45.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4039e00700 1 -- 172.21.15.49:0/1461812772 learned_addr learned my addr 172.21.15.49:0/1461812772 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:45.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4039400700 1 --2- 172.21.15.49:0/1461812772 >> v2:172.21.15.110:3300/0 conn(0x7f403c1508b0 0x7f403c0c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4039e00700 1 -- 172.21.15.49:0/1461812772 >> v2:172.21.15.110:3300/0 conn(0x7f403c1508b0 msgr2=0x7f403c0c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:45.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4039e00700 1 --2- 172.21.15.49:0/1461812772 >> v2:172.21.15.110:3300/0 conn(0x7f403c1508b0 0x7f403c0c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4039e00700 1 -- 172.21.15.49:0/1461812772 >> v1:172.21.15.110:6789/0 conn(0x7f403c0c3cc0 legacy=0x7f403c1542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4039e00700 1 -- 172.21.15.49:0/1461812772 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c0be070 con 0x7f403c0bd650 2024-01-22T05:07:45.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4039e00700 1 --2- 172.21.15.49:0/1461812772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f403c0bd650 0x7f403c1503c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f403c065920 tx=0x7f402c0090f0).ready entity=mon.0 client_cookie=a326e74411995a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:45.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4038a00700 1 -- 172.21.15.49:0/1461812772 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c00b520 con 0x7f403c0bd650 2024-01-22T05:07:45.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4038a00700 1 -- 172.21.15.49:0/1461812772 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402c00b680 con 0x7f403c0bd650 2024-01-22T05:07:45.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4038a00700 1 -- 172.21.15.49:0/1461812772 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c00ba00 con 0x7f403c0bd650 2024-01-22T05:07:45.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4041000700 1 -- 172.21.15.49:0/1461812772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f403c0bd650 msgr2=0x7f403c1503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4041000700 1 --2- 172.21.15.49:0/1461812772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f403c0bd650 0x7f403c1503c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f403c065920 tx=0x7f402c0090f0).stop 2024-01-22T05:07:45.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4041000700 1 -- 172.21.15.49:0/1461812772 shutdown_connections 2024-01-22T05:07:45.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4041000700 1 --2- 172.21.15.49:0/1461812772 >> v2:172.21.15.110:3300/0 conn(0x7f403c1508b0 0x7f403c0c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4041000700 1 --2- 172.21.15.49:0/1461812772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f403c0bd650 0x7f403c1503c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.741+0000 7f4041000700 1 -- 172.21.15.49:0/1461812772 >> 172.21.15.49:0/1461812772 conn(0x7f403c0c87f0 msgr2=0x7f403c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:45.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.745+0000 7f4041000700 1 -- 172.21.15.49:0/1461812772 shutdown_connections 2024-01-22T05:07:45.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.745+0000 7f4041000700 1 -- 172.21.15.49:0/1461812772 wait complete. 2024-01-22T05:07:45.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.749+0000 7f4041000700 1 Processor -- start 2024-01-22T05:07:45.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.749+0000 7f4041000700 1 -- start start 2024-01-22T05:07:45.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.749+0000 7f4041000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f403c0bd650 0x7f403c0ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.749+0000 7f4041000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f403c0c3cc0 0x7f403c14e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.749+0000 7f4041000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f403c1508b0 0x7f403c1518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.749+0000 7f4041000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c0ad500 con 0x7f403c1508b0 2024-01-22T05:07:45.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.749+0000 7f4041000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c0ac680 con 0x7f403c0bd650 2024-01-22T05:07:45.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.749+0000 7f4041000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403c0ac8f0 con 0x7f403c0c3cc0 2024-01-22T05:07:45.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f403b200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f403c1508b0 0x7f403c1518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f4039400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f403c0c3cc0 0x7f403c14e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f4039400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f403c0c3cc0 0x7f403c14e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:60912/0 (socket says 172.21.15.49:60912) 2024-01-22T05:07:45.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f4039400700 1 -- 172.21.15.49:0/519250421 learned_addr learned my addr 172.21.15.49:0/519250421 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:45.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f4039e00700 1 --2- 172.21.15.49:0/519250421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f403c0bd650 0x7f403c0ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f403b200700 1 -- 172.21.15.49:0/519250421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f403c0c3cc0 msgr2=0x7f403c14e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f403b200700 1 --2- 172.21.15.49:0/519250421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f403c0c3cc0 0x7f403c14e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f403b200700 1 -- 172.21.15.49:0/519250421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f403c0bd650 msgr2=0x7f403c0ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f403b200700 1 --2- 172.21.15.49:0/519250421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f403c0bd650 0x7f403c0ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f403b200700 1 -- 172.21.15.49:0/519250421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c009370 con 0x7f403c1508b0 2024-01-22T05:07:45.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f4039400700 1 --2- 172.21.15.49:0/519250421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f403c0c3cc0 0x7f403c14e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:45.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f403b200700 1 --2- 172.21.15.49:0/519250421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f403c1508b0 0x7f403c1518a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f40340013d0 tx=0x7f4034001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:45.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f4031600700 1 -- 172.21.15.49:0/519250421 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400e4a0 con 0x7f403c1508b0 2024-01-22T05:07:45.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f4031600700 1 -- 172.21.15.49:0/519250421 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403400e600 con 0x7f403c1508b0 2024-01-22T05:07:45.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f4041000700 1 -- 172.21.15.49:0/519250421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403c0acbd0 con 0x7f403c1508b0 2024-01-22T05:07:45.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f4031600700 1 -- 172.21.15.49:0/519250421 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400e980 con 0x7f403c1508b0 2024-01-22T05:07:45.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.753+0000 7f4041000700 1 -- 172.21.15.49:0/519250421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403c0ad190 con 0x7f403c1508b0 2024-01-22T05:07:45.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.757+0000 7f4041000700 1 -- 172.21.15.49:0/519250421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f403c0ad670 con 0x7f403c1508b0 2024-01-22T05:07:45.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.757+0000 7f4031600700 1 -- 172.21.15.49:0/519250421 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f40340123f0 con 0x7f403c1508b0 2024-01-22T05:07:45.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.757+0000 7f4031600700 1 --2- 172.21.15.49:0/519250421 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f401405a4e0 0x7f401405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:45.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.757+0000 7f4031600700 1 -- 172.21.15.49:0/519250421 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f40340741d0 con 0x7f403c1508b0 2024-01-22T05:07:45.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.761+0000 7f4039e00700 1 --2- 172.21.15.49:0/519250421 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f401405a4e0 0x7f401405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:45.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.761+0000 7f4039e00700 1 --2- 172.21.15.49:0/519250421 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f401405a4e0 0x7f401405c9a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f402c009130 tx=0x7f402c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:45.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.765+0000 7f4031600700 1 -- 172.21.15.49:0/519250421 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f40340476c0 con 0x7f403c1508b0 2024-01-22T05:07:45.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.961+0000 7f4041000700 1 -- 172.21.15.49:0/519250421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f403c047060 con 0x7f403c1508b0 2024-01-22T05:07:45.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.961+0000 7f4031600700 1 -- 172.21.15.49:0/519250421 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f403404ace0 con 0x7f403c1508b0 2024-01-22T05:07:45.963 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:07:45.963 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":34,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4066204164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":4066204164},{"type":"v1","addr":"172.21.15.110:6835","nonce":4066204164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/3793850760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3793850760},{"type":"v1","addr":"172.21.15.110:6834","nonce":3793850760}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/331321155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":331321155},{"type":"v1","addr":"172.21.15.49:6837","nonce":331321155}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-01-22T05:05:42.747172+0000","modified":"2024-01-22T05:07:30.547619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":31,"addr":"172.21.15.49:6836/3211151680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3211151680},{"type":"v1","addr":"172.21.15.49:6836","nonce":3211151680}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-22T05:07:45.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.965+0000 7f4041000700 1 -- 172.21.15.49:0/519250421 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f401405a4e0 msgr2=0x7f401405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.965+0000 7f4041000700 1 --2- 172.21.15.49:0/519250421 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f401405a4e0 0x7f401405c9a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f402c009130 tx=0x7f402c017000).stop 2024-01-22T05:07:45.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.965+0000 7f4041000700 1 -- 172.21.15.49:0/519250421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f403c1508b0 msgr2=0x7f403c1518a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:45.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.965+0000 7f4041000700 1 --2- 172.21.15.49:0/519250421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f403c1508b0 0x7f403c1518a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f40340013d0 tx=0x7f4034001530).stop 2024-01-22T05:07:45.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.965+0000 7f4041000700 1 -- 172.21.15.49:0/519250421 shutdown_connections 2024-01-22T05:07:45.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.965+0000 7f4041000700 1 --2- 172.21.15.49:0/519250421 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f401405a4e0 0x7f401405c9a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.965+0000 7f4041000700 1 --2- 172.21.15.49:0/519250421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f403c1508b0 0x7f403c1518a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.965+0000 7f4041000700 1 --2- 172.21.15.49:0/519250421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f403c0c3cc0 0x7f403c14e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.965+0000 7f4041000700 1 --2- 172.21.15.49:0/519250421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f403c0bd650 0x7f403c0ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:45.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.965+0000 7f4041000700 1 -- 172.21.15.49:0/519250421 >> 172.21.15.49:0/519250421 conn(0x7f403c0c87f0 msgr2=0x7f403c0c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:45.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.965+0000 7f4041000700 1 -- 172.21.15.49:0/519250421 shutdown_connections 2024-01-22T05:07:45.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:45.965+0000 7f4041000700 1 -- 172.21.15.49:0/519250421 wait complete. 2024-01-22T05:07:45.971 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 34 2024-01-22T05:07:45.989 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:07:46.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.149+0000 7f2153c00700 1 Processor -- start 2024-01-22T05:07:46.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.153+0000 7f2153c00700 1 -- start start 2024-01-22T05:07:46.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.153+0000 7f2153c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f214c066fb0 0x7f214c0c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.153+0000 7f2153c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f214c0a8b10 0x7f214c157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f2153c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c0c1ee0 con 0x7f214c0a8f90 2024-01-22T05:07:46.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f2153c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214c0c12f0 con 0x7f214c066fb0 2024-01-22T05:07:46.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f2153c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0c15b0 con 0x7f214c0a8b10 2024-01-22T05:07:46.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f2151200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f214c066fb0 0x7f214c0c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f2151200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f214c066fb0 0x7f214c0c2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44986/0 (socket says 172.21.15.49:44986) 2024-01-22T05:07:46.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f2151200700 1 -- 172.21.15.49:0/1887794640 learned_addr learned my addr 172.21.15.49:0/1887794640 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:46.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f214be00700 1 --2- 172.21.15.49:0/1887794640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f214c0a8b10 0x7f214c157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f2151200700 1 -- 172.21.15.49:0/1887794640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f214c0a8b10 msgr2=0x7f214c157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:46.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f2151200700 1 --2- 172.21.15.49:0/1887794640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f214c0a8b10 0x7f214c157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f2151200700 1 -- 172.21.15.49:0/1887794640 >> v1:172.21.15.110:6789/0 conn(0x7f214c0a8f90 legacy=0x7f214c065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f2151200700 1 -- 172.21.15.49:0/1887794640 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0c1890 con 0x7f214c066fb0 2024-01-22T05:07:46.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f2151200700 1 --2- 172.21.15.49:0/1887794640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f214c066fb0 0x7f214c0c2370 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f213c006fd0 tx=0x7f213c0090f0).ready entity=mon.0 client_cookie=a3661141f65877e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:46.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f214b400700 1 -- 172.21.15.49:0/1887794640 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c00b600 con 0x7f214c066fb0 2024-01-22T05:07:46.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f214b400700 1 -- 172.21.15.49:0/1887794640 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c00b760 con 0x7f214c066fb0 2024-01-22T05:07:46.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f214b400700 1 -- 172.21.15.49:0/1887794640 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c00bae0 con 0x7f214c066fb0 2024-01-22T05:07:46.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f2153c00700 1 -- 172.21.15.49:0/1887794640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f214c066fb0 msgr2=0x7f214c0c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.157+0000 7f2153c00700 1 --2- 172.21.15.49:0/1887794640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f214c066fb0 0x7f214c0c2370 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f213c006fd0 tx=0x7f213c0090f0).stop 2024-01-22T05:07:46.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.161+0000 7f2153c00700 1 -- 172.21.15.49:0/1887794640 shutdown_connections 2024-01-22T05:07:46.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.161+0000 7f2153c00700 1 --2- 172.21.15.49:0/1887794640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f214c0a8b10 0x7f214c157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.161+0000 7f2153c00700 1 --2- 172.21.15.49:0/1887794640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f214c066fb0 0x7f214c0c2370 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.161+0000 7f2153c00700 1 -- 172.21.15.49:0/1887794640 >> 172.21.15.49:0/1887794640 conn(0x7f214c0c6540 msgr2=0x7f214c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:46.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.161+0000 7f2153c00700 1 -- 172.21.15.49:0/1887794640 shutdown_connections 2024-01-22T05:07:46.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.161+0000 7f2153c00700 1 -- 172.21.15.49:0/1887794640 wait complete. 2024-01-22T05:07:46.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.161+0000 7f2153c00700 1 Processor -- start 2024-01-22T05:07:46.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.165+0000 7f2153c00700 1 -- start start 2024-01-22T05:07:46.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.165+0000 7f2153c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f214c066fb0 0x7f214c139d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.165+0000 7f2153c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f214c0a8b10 0x7f214c0684f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.165+0000 7f2153c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f214c0a8f90 0x7f214c0689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.165+0000 7f2153c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c068ed0 con 0x7f214c0a8b10 2024-01-22T05:07:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.165+0000 7f2153c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c13a200 con 0x7f214c066fb0 2024-01-22T05:07:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.165+0000 7f2153c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0c03c0 con 0x7f214c0a8f90 2024-01-22T05:07:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.165+0000 7f214be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f214c0a8b10 0x7f214c0684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.165+0000 7f214be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f214c0a8b10 0x7f214c0684f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44998/0 (socket says 172.21.15.49:44998) 2024-01-22T05:07:46.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.165+0000 7f214be00700 1 -- 172.21.15.49:0/3996847028 learned_addr learned my addr 172.21.15.49:0/3996847028 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.169+0000 7f2151200700 1 --2- 172.21.15.49:0/3996847028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f214c066fb0 0x7f214c139d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.169+0000 7f2151c00700 1 --2- 172.21.15.49:0/3996847028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f214c0a8f90 0x7f214c0689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.169+0000 7f214be00700 1 -- 172.21.15.49:0/3996847028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f214c0a8f90 msgr2=0x7f214c0689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.169+0000 7f214be00700 1 --2- 172.21.15.49:0/3996847028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f214c0a8f90 0x7f214c0689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.169+0000 7f214be00700 1 -- 172.21.15.49:0/3996847028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f214c066fb0 msgr2=0x7f214c139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.169+0000 7f214be00700 1 --2- 172.21.15.49:0/3996847028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f214c066fb0 0x7f214c139d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.169+0000 7f214be00700 1 -- 172.21.15.49:0/3996847028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c009370 con 0x7f214c0a8b10 2024-01-22T05:07:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.169+0000 7f214be00700 1 --2- 172.21.15.49:0/3996847028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f214c0a8b10 0x7f214c0684f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f213400d890 tx=0x7f2134008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.169+0000 7f2143e00700 1 -- 172.21.15.49:0/3996847028 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21340125f0 con 0x7f214c0a8b10 2024-01-22T05:07:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.169+0000 7f2143e00700 1 -- 172.21.15.49:0/3996847028 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2134012750 con 0x7f214c0a8b10 2024-01-22T05:07:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.169+0000 7f2153c00700 1 -- 172.21.15.49:0/3996847028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c0c0850 con 0x7f214c0a8b10 2024-01-22T05:07:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.169+0000 7f2143e00700 1 -- 172.21.15.49:0/3996847028 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2134012ad0 con 0x7f214c0a8b10 2024-01-22T05:07:46.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.169+0000 7f2153c00700 1 -- 172.21.15.49:0/3996847028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c0bfd70 con 0x7f214c0a8b10 2024-01-22T05:07:46.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.173+0000 7f2153c00700 1 -- 172.21.15.49:0/3996847028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214c047060 con 0x7f214c0a8b10 2024-01-22T05:07:46.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.173+0000 7f2143e00700 1 -- 172.21.15.49:0/3996847028 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2134013480 con 0x7f214c0a8b10 2024-01-22T05:07:46.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.173+0000 7f2143e00700 1 --2- 172.21.15.49:0/3996847028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f212405a540 0x7f212405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.173+0000 7f2143e00700 1 -- 172.21.15.49:0/3996847028 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f21340746f0 con 0x7f214c0a8b10 2024-01-22T05:07:46.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.173+0000 7f2151200700 1 --2- 172.21.15.49:0/3996847028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f212405a540 0x7f212405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.177+0000 7f2151200700 1 --2- 172.21.15.49:0/3996847028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f212405a540 0x7f212405ca00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f213c009130 tx=0x7f213c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:46.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.177+0000 7f2143e00700 1 -- 172.21.15.49:0/3996847028 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2134047be0 con 0x7f214c0a8b10 2024-01-22T05:07:46.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.341+0000 7f2153c00700 1 -- 172.21.15.49:0/3996847028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f214c0c0500 con 0x7f214c0a8b10 2024-01-22T05:07:46.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.345+0000 7f2143e00700 1 -- 172.21.15.49:0/3996847028 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+17372 (secure 0 0 0) 0x7f213404b200 con 0x7f214c0a8b10 2024-01-22T05:07:46.348 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:07:46.348 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":44,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:07:21.104311+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:05:40.764447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-01-22T05:05:41.767543+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.35","mappings":[{"from":5,"to":0}]},{"pgid":"7.2a","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:07:46.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.349+0000 7f2153c00700 1 -- 172.21.15.49:0/3996847028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f212405a540 msgr2=0x7f212405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.349+0000 7f2153c00700 1 --2- 172.21.15.49:0/3996847028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f212405a540 0x7f212405ca00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f213c009130 tx=0x7f213c017000).stop 2024-01-22T05:07:46.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.349+0000 7f2153c00700 1 -- 172.21.15.49:0/3996847028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f214c0a8b10 msgr2=0x7f214c0684f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.349+0000 7f2153c00700 1 --2- 172.21.15.49:0/3996847028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f214c0a8b10 0x7f214c0684f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f213400d890 tx=0x7f2134008040).stop 2024-01-22T05:07:46.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.349+0000 7f2153c00700 1 -- 172.21.15.49:0/3996847028 shutdown_connections 2024-01-22T05:07:46.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.349+0000 7f2153c00700 1 --2- 172.21.15.49:0/3996847028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f212405a540 0x7f212405ca00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.349+0000 7f2153c00700 1 --2- 172.21.15.49:0/3996847028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f214c0a8f90 0x7f214c0689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.349+0000 7f2153c00700 1 --2- 172.21.15.49:0/3996847028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f214c0a8b10 0x7f214c0684f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.349+0000 7f2153c00700 1 --2- 172.21.15.49:0/3996847028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f214c066fb0 0x7f214c139d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.349+0000 7f2153c00700 1 -- 172.21.15.49:0/3996847028 >> 172.21.15.49:0/3996847028 conn(0x7f214c0c6540 msgr2=0x7f214c14cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:46.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.349+0000 7f2153c00700 1 -- 172.21.15.49:0/3996847028 shutdown_connections 2024-01-22T05:07:46.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.349+0000 7f2153c00700 1 -- 172.21.15.49:0/3996847028 wait complete. 2024-01-22T05:07:46.378 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:05:40.764447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:05:41.767543+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:07:46.378 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:07:46.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.537+0000 7f448b200700 1 Processor -- start 2024-01-22T05:07:46.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.541+0000 7f448b200700 1 -- start start 2024-01-22T05:07:46.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f448b200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f448c064470 0x7f448c069e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f448b200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f448c154ef0 0x7f448c0c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f448b200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448c154320 con 0x7f448c154a90 2024-01-22T05:07:46.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f448b200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448c154600 con 0x7f448c064470 2024-01-22T05:07:46.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f448b200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448c0c3790 con 0x7f448c154ef0 2024-01-22T05:07:46.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f4489400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f448c154a90 0x7f448c0c5180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48418/0 (socket says 172.21.15.49:48418) 2024-01-22T05:07:46.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f4489400700 1 -- 172.21.15.49:0/3590959515 learned_addr learned my addr 172.21.15.49:0/3590959515 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:46.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f4489e00700 1 --2- 172.21.15.49:0/3590959515 >> v2:172.21.15.49:3300/0 conn(0x7f448c064470 0x7f448c069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f448a800700 1 --2- 172.21.15.49:0/3590959515 >> v2:172.21.15.110:3300/0 conn(0x7f448c154ef0 0x7f448c0c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f4488a00700 1 -- 172.21.15.49:0/3590959515 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914789678 0 0) 0x7f448c154320 con 0x7f448c154a90 2024-01-22T05:07:46.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f4488a00700 1 -- 172.21.15.49:0/3590959515 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f446c0033f0 con 0x7f448c154a90 2024-01-22T05:07:46.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f4489e00700 1 -- 172.21.15.49:0/3590959515 >> v2:172.21.15.110:3300/0 conn(0x7f448c154ef0 msgr2=0x7f448c0c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:46.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f4489e00700 1 --2- 172.21.15.49:0/3590959515 >> v2:172.21.15.110:3300/0 conn(0x7f448c154ef0 0x7f448c0c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f4489e00700 1 -- 172.21.15.49:0/3590959515 >> v1:172.21.15.49:6789/0 conn(0x7f448c154a90 legacy=0x7f448c0c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f4489e00700 1 -- 172.21.15.49:0/3590959515 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c0c3a70 con 0x7f448c064470 2024-01-22T05:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f4489e00700 1 --2- 172.21.15.49:0/3590959515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448c064470 0x7f448c069e70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f448c0c1bb0 tx=0x7f447c009060).ready entity=mon.0 client_cookie=9236d4b0d2b26fb0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f4488a00700 1 -- 172.21.15.49:0/3590959515 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00d4a0 con 0x7f448c064470 2024-01-22T05:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f4488a00700 1 -- 172.21.15.49:0/3590959515 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c00d600 con 0x7f448c064470 2024-01-22T05:07:46.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.545+0000 7f4488a00700 1 -- 172.21.15.49:0/3590959515 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00d980 con 0x7f448c064470 2024-01-22T05:07:46.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.549+0000 7f448b200700 1 -- 172.21.15.49:0/3590959515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448c064470 msgr2=0x7f448c069e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.549+0000 7f448b200700 1 --2- 172.21.15.49:0/3590959515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448c064470 0x7f448c069e70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f448c0c1bb0 tx=0x7f447c009060).stop 2024-01-22T05:07:46.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.549+0000 7f448b200700 1 -- 172.21.15.49:0/3590959515 shutdown_connections 2024-01-22T05:07:46.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.549+0000 7f448b200700 1 --2- 172.21.15.49:0/3590959515 >> v2:172.21.15.110:3300/0 conn(0x7f448c154ef0 0x7f448c0c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.549+0000 7f448b200700 1 --2- 172.21.15.49:0/3590959515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448c064470 0x7f448c069e70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.549+0000 7f448b200700 1 -- 172.21.15.49:0/3590959515 >> 172.21.15.49:0/3590959515 conn(0x7f448c062760 msgr2=0x7f448c062b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:46.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.549+0000 7f448b200700 1 -- 172.21.15.49:0/3590959515 shutdown_connections 2024-01-22T05:07:46.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.549+0000 7f448b200700 1 -- 172.21.15.49:0/3590959515 wait complete. 2024-01-22T05:07:46.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.553+0000 7f448b200700 1 Processor -- start 2024-01-22T05:07:46.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.553+0000 7f448b200700 1 -- start start 2024-01-22T05:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.553+0000 7f448b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f448c064470 0x7f448c0ac940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.553+0000 7f448b200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448c154a90 0x7f448c0aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.553+0000 7f448b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f448c154ef0 0x7f448c162570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.553+0000 7f448b200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c163580 con 0x7f448c154a90 2024-01-22T05:07:46.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.553+0000 7f448b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c162fc0 con 0x7f448c154ef0 2024-01-22T05:07:46.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.553+0000 7f448b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c1632a0 con 0x7f448c064470 2024-01-22T05:07:46.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.553+0000 7f4489400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448c154a90 0x7f448c0aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.553+0000 7f4489400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448c154a90 0x7f448c0aaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45018/0 (socket says 172.21.15.49:45018) 2024-01-22T05:07:46.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.553+0000 7f4489400700 1 -- 172.21.15.49:0/2226411778 learned_addr learned my addr 172.21.15.49:0/2226411778 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:46.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f448a800700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f448c154ef0 0x7f448c162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f4489e00700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f448c064470 0x7f448c0ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f4489400700 1 -- 172.21.15.49:0/2226411778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f448c064470 msgr2=0x7f448c0ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f4489400700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f448c064470 0x7f448c0ac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f4489400700 1 -- 172.21.15.49:0/2226411778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f448c154ef0 msgr2=0x7f448c162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f4489400700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f448c154ef0 0x7f448c162570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f4489400700 1 -- 172.21.15.49:0/2226411778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c0092a0 con 0x7f448c154a90 2024-01-22T05:07:46.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f448a800700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f448c154ef0 0x7f448c162570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:07:46.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f4489e00700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f448c064470 0x7f448c0ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:07:46.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f4489400700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448c154a90 0x7f448c0aaf70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f447400c590 tx=0x7f4474007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:46.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f4481600700 1 -- 172.21.15.49:0/2226411778 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474007e40 con 0x7f448c154a90 2024-01-22T05:07:46.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f4481600700 1 -- 172.21.15.49:0/2226411778 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44740072e0 con 0x7f448c154a90 2024-01-22T05:07:46.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f448b200700 1 -- 172.21.15.49:0/2226411778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448c0aa770 con 0x7f448c154a90 2024-01-22T05:07:46.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f4481600700 1 -- 172.21.15.49:0/2226411778 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44740057a0 con 0x7f448c154a90 2024-01-22T05:07:46.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f448b200700 1 -- 172.21.15.49:0/2226411778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448c0ace30 con 0x7f448c154a90 2024-01-22T05:07:46.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.557+0000 7f448b200700 1 -- 172.21.15.49:0/2226411778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448c0aac70 con 0x7f448c154a90 2024-01-22T05:07:46.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.561+0000 7f4481600700 1 -- 172.21.15.49:0/2226411778 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4474005bd0 con 0x7f448c154a90 2024-01-22T05:07:46.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.561+0000 7f4481600700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f446405a540 0x7f446405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.561+0000 7f4481600700 1 -- 172.21.15.49:0/2226411778 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f4474073f00 con 0x7f448c154a90 2024-01-22T05:07:46.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.561+0000 7f4489e00700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f446405a540 0x7f446405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.561+0000 7f4489e00700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f446405a540 0x7f446405ca00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f447c009fd0 tx=0x7f447c016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:46.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.569+0000 7f4481600700 1 -- 172.21.15.49:0/2226411778 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4474047510 con 0x7f448c154a90 2024-01-22T05:07:46.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.741+0000 7f448b200700 1 -- 172.21.15.49:0/2226411778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f448c0c3d50 con 0x7f448c154a90 2024-01-22T05:07:46.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.741+0000 7f4481600700 1 -- 172.21.15.49:0/2226411778 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v44) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4474018070 con 0x7f448c154a90 2024-01-22T05:07:46.744 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:07:46.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.745+0000 7f448b200700 1 -- 172.21.15.49:0/2226411778 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f446405a540 msgr2=0x7f446405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.745+0000 7f448b200700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f446405a540 0x7f446405ca00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f447c009fd0 tx=0x7f447c016000).stop 2024-01-22T05:07:46.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.745+0000 7f448b200700 1 -- 172.21.15.49:0/2226411778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448c154a90 msgr2=0x7f448c0aaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.745+0000 7f448b200700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448c154a90 0x7f448c0aaf70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f447400c590 tx=0x7f4474007c80).stop 2024-01-22T05:07:46.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.745+0000 7f448b200700 1 -- 172.21.15.49:0/2226411778 shutdown_connections 2024-01-22T05:07:46.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.745+0000 7f448b200700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f446405a540 0x7f446405ca00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.745+0000 7f448b200700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f448c154ef0 0x7f448c162570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.745+0000 7f448b200700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f448c154a90 0x7f448c0aaf70 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.745+0000 7f448b200700 1 --2- 172.21.15.49:0/2226411778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f448c064470 0x7f448c0ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.745+0000 7f448b200700 1 -- 172.21.15.49:0/2226411778 >> 172.21.15.49:0/2226411778 conn(0x7f448c062760 msgr2=0x7f448c0c6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:46.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.745+0000 7f448b200700 1 -- 172.21.15.49:0/2226411778 shutdown_connections 2024-01-22T05:07:46.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.745+0000 7f448b200700 1 -- 172.21.15.49:0/2226411778 wait complete. 2024-01-22T05:07:46.770 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:07:46.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.929+0000 7f53ff200700 1 Processor -- start 2024-01-22T05:07:46.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.929+0000 7f53ff200700 1 -- start start 2024-01-22T05:07:46.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.933+0000 7f53ff200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54000c3720 0x7f54000c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.933+0000 7f53ff200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f54001554d0 0x7f5400155960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.933+0000 7f53ff200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54000bea80 con 0x7f5400151b30 2024-01-22T05:07:46.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53ff200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54001563e0 con 0x7f54001554d0 2024-01-22T05:07:46.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53ff200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54000c4070 con 0x7f54000c3720 2024-01-22T05:07:46.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53fd400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54000c3720 0x7f54000c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53fd400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54000c3720 0x7f54000c3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:60942/0 (socket says 172.21.15.49:60942) 2024-01-22T05:07:46.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53fd400700 1 -- 172.21.15.49:0/252675730 learned_addr learned my addr 172.21.15.49:0/252675730 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:46.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53fde00700 1 --1- 172.21.15.49:0/252675730 >> v1:172.21.15.110:6789/0 conn(0x7f5400151b30 0x7f54000bef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:45284/0 (socket says 172.21.15.49:45284) 2024-01-22T05:07:46.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53fe800700 1 --2- 172.21.15.49:0/252675730 >> v2:172.21.15.110:3300/0 conn(0x7f54001554d0 0x7f5400155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53fd400700 1 -- 172.21.15.49:0/252675730 >> v2:172.21.15.110:3300/0 conn(0x7f54001554d0 msgr2=0x7f5400155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:46.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53fd400700 1 --2- 172.21.15.49:0/252675730 >> v2:172.21.15.110:3300/0 conn(0x7f54001554d0 0x7f5400155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53fd400700 1 -- 172.21.15.49:0/252675730 >> v1:172.21.15.110:6789/0 conn(0x7f5400151b30 legacy=0x7f54000bef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53fd400700 1 -- 172.21.15.49:0/252675730 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5400155e50 con 0x7f54000c3720 2024-01-22T05:07:46.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53fd400700 1 --2- 172.21.15.49:0/252675730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54000c3720 0x7f54000c3b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f53e8006fd0 tx=0x7f53e80090f0).ready entity=mon.2 client_cookie=9741356a17325da server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:46.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53fca00700 1 -- 172.21.15.49:0/252675730 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e800b580 con 0x7f54000c3720 2024-01-22T05:07:46.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53fca00700 1 -- 172.21.15.49:0/252675730 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e800b6e0 con 0x7f54000c3720 2024-01-22T05:07:46.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53fca00700 1 -- 172.21.15.49:0/252675730 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e800ba60 con 0x7f54000c3720 2024-01-22T05:07:46.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53ff200700 1 -- 172.21.15.49:0/252675730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54000c3720 msgr2=0x7f54000c3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53ff200700 1 --2- 172.21.15.49:0/252675730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54000c3720 0x7f54000c3b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f53e8006fd0 tx=0x7f53e80090f0).stop 2024-01-22T05:07:46.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53ff200700 1 -- 172.21.15.49:0/252675730 shutdown_connections 2024-01-22T05:07:46.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53ff200700 1 --2- 172.21.15.49:0/252675730 >> v2:172.21.15.110:3300/0 conn(0x7f54001554d0 0x7f5400155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53ff200700 1 --2- 172.21.15.49:0/252675730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54000c3720 0x7f54000c3b80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53ff200700 1 -- 172.21.15.49:0/252675730 >> 172.21.15.49:0/252675730 conn(0x7f54000c8770 msgr2=0x7f54000c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:46.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53ff200700 1 -- 172.21.15.49:0/252675730 shutdown_connections 2024-01-22T05:07:46.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.937+0000 7f53ff200700 1 -- 172.21.15.49:0/252675730 wait complete. 2024-01-22T05:07:46.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.941+0000 7f53ff200700 1 Processor -- start 2024-01-22T05:07:46.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.941+0000 7f53ff200700 1 -- start start 2024-01-22T05:07:46.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.941+0000 7f53ff200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54000c3720 0x7f54000aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.941+0000 7f53ff200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5400151b30 0x7f540014d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.941+0000 7f53ff200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54001554d0 0x7f54000c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.941+0000 7f53ff200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54000ac5f0 con 0x7f54000c3720 2024-01-22T05:07:46.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.941+0000 7f53ff200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5400153000 con 0x7f54001554d0 2024-01-22T05:07:46.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.941+0000 7f53ff200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5400152d20 con 0x7f5400151b30 2024-01-22T05:07:46.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53fde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54000c3720 0x7f54000aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53fde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54000c3720 0x7f54000aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45024/0 (socket says 172.21.15.49:45024) 2024-01-22T05:07:46.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53fde00700 1 -- 172.21.15.49:0/1335541345 learned_addr learned my addr 172.21.15.49:0/1335541345 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:46.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53fe800700 1 --2- 172.21.15.49:0/1335541345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54001554d0 0x7f54000c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53fd400700 1 --2- 172.21.15.49:0/1335541345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5400151b30 0x7f540014d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53fde00700 1 -- 172.21.15.49:0/1335541345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5400151b30 msgr2=0x7f540014d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53fde00700 1 --2- 172.21.15.49:0/1335541345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5400151b30 0x7f540014d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53fde00700 1 -- 172.21.15.49:0/1335541345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54001554d0 msgr2=0x7f54000c0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:46.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53fde00700 1 --2- 172.21.15.49:0/1335541345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54001554d0 0x7f54000c0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:46.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53fde00700 1 -- 172.21.15.49:0/1335541345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e8009370 con 0x7f54000c3720 2024-01-22T05:07:46.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53fe800700 1 --2- 172.21.15.49:0/1335541345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54001554d0 0x7f54000c0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:46.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53fde00700 1 --2- 172.21.15.49:0/1335541345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54000c3720 0x7f54000aca10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f53f0007fd0 tx=0x7f53f0007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:46.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53f5600700 1 -- 172.21.15.49:0/1335541345 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f000ce10 con 0x7f54000c3720 2024-01-22T05:07:46.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53f5600700 1 -- 172.21.15.49:0/1335541345 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f00072e0 con 0x7f54000c3720 2024-01-22T05:07:46.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53f5600700 1 -- 172.21.15.49:0/1335541345 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f00056e0 con 0x7f54000c3720 2024-01-22T05:07:46.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53ff200700 1 -- 172.21.15.49:0/1335541345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54000abf30 con 0x7f54000c3720 2024-01-22T05:07:46.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.945+0000 7f53ff200700 1 -- 172.21.15.49:0/1335541345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54000acf00 con 0x7f54000c3720 2024-01-22T05:07:46.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.949+0000 7f53ff200700 1 -- 172.21.15.49:0/1335541345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54000abd90 con 0x7f54000c3720 2024-01-22T05:07:46.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.949+0000 7f53f5600700 1 -- 172.21.15.49:0/1335541345 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f53f0005ad0 con 0x7f54000c3720 2024-01-22T05:07:46.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.949+0000 7f53f5600700 1 --2- 172.21.15.49:0/1335541345 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53d805a510 0x7f53d805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:46.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.949+0000 7f53f5600700 1 -- 172.21.15.49:0/1335541345 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f53f0073fe0 con 0x7f54000c3720 2024-01-22T05:07:46.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.949+0000 7f53fd400700 1 --2- 172.21.15.49:0/1335541345 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53d805a510 0x7f53d805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:46.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.953+0000 7f53fd400700 1 --2- 172.21.15.49:0/1335541345 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53d805a510 0x7f53d805c9d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f53e8009130 tx=0x7f53e8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:46.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:46.957+0000 7f53f5600700 1 -- 172.21.15.49:0/1335541345 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f54000abd90 con 0x7f54000c3720 2024-01-22T05:07:47.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.121+0000 7f53ff200700 1 -- 172.21.15.49:0/1335541345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f54000abd90 con 0x7f54000c3720 2024-01-22T05:07:47.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.121+0000 7f53f5600700 1 -- 172.21.15.49:0/1335541345 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7f54000abd90 con 0x7f54000c3720 2024-01-22T05:07:47.123 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:07:47.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.125+0000 7f53ff200700 1 -- 172.21.15.49:0/1335541345 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53d805a510 msgr2=0x7f53d805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.125+0000 7f53ff200700 1 --2- 172.21.15.49:0/1335541345 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53d805a510 0x7f53d805c9d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f53e8009130 tx=0x7f53e8017000).stop 2024-01-22T05:07:47.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.125+0000 7f53ff200700 1 -- 172.21.15.49:0/1335541345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54000c3720 msgr2=0x7f54000aca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.125+0000 7f53ff200700 1 --2- 172.21.15.49:0/1335541345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54000c3720 0x7f54000aca10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f53f0007fd0 tx=0x7f53f0007df0).stop 2024-01-22T05:07:47.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.125+0000 7f53ff200700 1 -- 172.21.15.49:0/1335541345 shutdown_connections 2024-01-22T05:07:47.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.125+0000 7f53ff200700 1 --2- 172.21.15.49:0/1335541345 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53d805a510 0x7f53d805c9d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.125+0000 7f53ff200700 1 --2- 172.21.15.49:0/1335541345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54001554d0 0x7f54000c0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.125+0000 7f53ff200700 1 --2- 172.21.15.49:0/1335541345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5400151b30 0x7f540014d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.125+0000 7f53ff200700 1 --2- 172.21.15.49:0/1335541345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54000c3720 0x7f54000aca10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.125+0000 7f53ff200700 1 -- 172.21.15.49:0/1335541345 >> 172.21.15.49:0/1335541345 conn(0x7f54000c8770 msgr2=0x7f54000aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:47.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.125+0000 7f53ff200700 1 -- 172.21.15.49:0/1335541345 shutdown_connections 2024-01-22T05:07:47.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.125+0000 7f53ff200700 1 -- 172.21.15.49:0/1335541345 wait complete. 2024-01-22T05:07:47.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:07:47.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.321+0000 7faf82800700 1 Processor -- start 2024-01-22T05:07:47.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.321+0000 7faf82800700 1 -- start start 2024-01-22T05:07:47.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.321+0000 7faf82800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf7c0bcbe0 0x7faf7c068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:47.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.321+0000 7faf82800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7c158650 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.321+0000 7faf82800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7c0bd170 con 0x7faf7c0a8c20 2024-01-22T05:07:47.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.321+0000 7faf82800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7c067c30 con 0x7faf7c0bcbe0 2024-01-22T05:07:47.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf7aa00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faf7c0c1ce0 0x7faf7c0bc4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48422/0 (socket says 172.21.15.49:48422) 2024-01-22T05:07:47.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf7aa00700 1 -- 172.21.15.49:0/2685373162 learned_addr learned my addr 172.21.15.49:0/2685373162 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:47.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf7be00700 1 --2- 172.21.15.49:0/2685373162 >> v2:172.21.15.49:3300/0 conn(0x7faf7c0bcbe0 0x7faf7c068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:47.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf7a000700 1 -- 172.21.15.49:0/2685373162 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344208453 0 0) 0x7faf64001290 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf7a000700 1 -- 172.21.15.49:0/2685373162 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf5c0033f0 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf7a000700 1 -- 172.21.15.49:0/2685373162 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457910168 0 0) 0x7faf7c0bd170 con 0x7faf7c0a8c20 2024-01-22T05:07:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf7a000700 1 -- 172.21.15.49:0/2685373162 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf64001290 con 0x7faf7c0a8c20 2024-01-22T05:07:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf7be00700 1 -- 172.21.15.49:0/2685373162 >> v1:172.21.15.110:6789/0 conn(0x7faf7c0a8c20 legacy=0x7faf7c0c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf7be00700 1 -- 172.21.15.49:0/2685373162 >> v1:172.21.15.49:6789/0 conn(0x7faf7c0c1ce0 legacy=0x7faf7c0bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf7be00700 1 -- 172.21.15.49:0/2685373162 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c067f10 con 0x7faf7c0bcbe0 2024-01-22T05:07:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf7be00700 1 --2- 172.21.15.49:0/2685373162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0bcbe0 0x7faf7c068710 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7faf74009e60 tx=0x7faf74009780).ready entity=mon.0 client_cookie=85ed38ef1ab9e93 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf7a000700 1 -- 172.21.15.49:0/2685373162 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7400e070 con 0x7faf7c0bcbe0 2024-01-22T05:07:47.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf7a000700 1 -- 172.21.15.49:0/2685373162 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7400bab0 con 0x7faf7c0bcbe0 2024-01-22T05:07:47.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf7a000700 1 -- 172.21.15.49:0/2685373162 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7400be30 con 0x7faf7c0bcbe0 2024-01-22T05:07:47.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf82800700 1 -- 172.21.15.49:0/2685373162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0bcbe0 msgr2=0x7faf7c068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf82800700 1 --2- 172.21.15.49:0/2685373162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0bcbe0 0x7faf7c068710 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7faf74009e60 tx=0x7faf74009780).stop 2024-01-22T05:07:47.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf82800700 1 -- 172.21.15.49:0/2685373162 shutdown_connections 2024-01-22T05:07:47.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf82800700 1 --2- 172.21.15.49:0/2685373162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0bcbe0 0x7faf7c068710 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf82800700 1 -- 172.21.15.49:0/2685373162 >> 172.21.15.49:0/2685373162 conn(0x7faf7c062cb0 msgr2=0x7faf7c0c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:47.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.325+0000 7faf82800700 1 -- 172.21.15.49:0/2685373162 shutdown_connections 2024-01-22T05:07:47.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.329+0000 7faf82800700 1 -- 172.21.15.49:0/2685373162 wait complete. 2024-01-22T05:07:47.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.329+0000 7faf82800700 1 Processor -- start 2024-01-22T05:07:47.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.329+0000 7faf82800700 1 -- start start 2024-01-22T05:07:47.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf82800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf7c0a8c20 0x7faf7c0c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:47.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf82800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0bcbe0 0x7faf7c1497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:47.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf82800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0c1ce0 0x7faf7c0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:47.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf82800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c14ab00 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf82800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c149c90 con 0x7faf7c0bcbe0 2024-01-22T05:07:47.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf82800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c149ef0 con 0x7faf7c0a8c20 2024-01-22T05:07:47.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf7be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0c1ce0 0x7faf7c0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:47.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf7be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0c1ce0 0x7faf7c0c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45046/0 (socket says 172.21.15.49:45046) 2024-01-22T05:07:47.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf7be00700 1 -- 172.21.15.49:0/3813274945 learned_addr learned my addr 172.21.15.49:0/3813274945 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:47.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf7aa00700 1 --2- 172.21.15.49:0/3813274945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0bcbe0 0x7faf7c1497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:47.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf7b400700 1 --2- 172.21.15.49:0/3813274945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf7c0a8c20 0x7faf7c0c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:47.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf7be00700 1 -- 172.21.15.49:0/3813274945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf7c0a8c20 msgr2=0x7faf7c0c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf7be00700 1 --2- 172.21.15.49:0/3813274945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf7c0a8c20 0x7faf7c0c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf7be00700 1 -- 172.21.15.49:0/3813274945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0bcbe0 msgr2=0x7faf7c1497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf7be00700 1 --2- 172.21.15.49:0/3813274945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0bcbe0 0x7faf7c1497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf7be00700 1 -- 172.21.15.49:0/3813274945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf74009a20 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf7b400700 1 --2- 172.21.15.49:0/3813274945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf7c0a8c20 0x7faf7c0c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:07:47.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf7be00700 1 --2- 172.21.15.49:0/3813274945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0c1ce0 0x7faf7c0c5900 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7faf7400b610 tx=0x7faf74009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:47.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf72a00700 1 -- 172.21.15.49:0/3813274945 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7401d630 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf72a00700 1 -- 172.21.15.49:0/3813274945 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7401d790 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf82800700 1 -- 172.21.15.49:0/3813274945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c14a1d0 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf72a00700 1 -- 172.21.15.49:0/3813274945 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7401db10 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.333+0000 7faf82800700 1 -- 172.21.15.49:0/3813274945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c14a790 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.337+0000 7faf82800700 1 -- 172.21.15.49:0/3813274945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c0c0c00 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.337+0000 7faf72a00700 1 -- 172.21.15.49:0/3813274945 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7faf74026410 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.337+0000 7faf72a00700 1 --2- 172.21.15.49:0/3813274945 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faf5405a510 0x7faf5405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:47.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.341+0000 7faf72a00700 1 -- 172.21.15.49:0/3813274945 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7faf74076830 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.341+0000 7faf7b400700 1 --2- 172.21.15.49:0/3813274945 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faf5405a510 0x7faf5405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:47.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.341+0000 7faf7b400700 1 --2- 172.21.15.49:0/3813274945 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faf5405a510 0x7faf5405c9d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7faf6c007fd0 tx=0x7faf6c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:47.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.345+0000 7faf72a00700 1 -- 172.21.15.49:0/3813274945 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faf74049d20 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.517+0000 7faf82800700 1 -- 172.21.15.49:0/3813274945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf7c14ac40 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.521+0000 7faf72a00700 1 -- 172.21.15.49:0/3813274945 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf74009880 con 0x7faf7c0c1ce0 2024-01-22T05:07:47.521 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:07:47.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.525+0000 7faf82800700 1 -- 172.21.15.49:0/3813274945 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faf5405a510 msgr2=0x7faf5405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.525+0000 7faf82800700 1 --2- 172.21.15.49:0/3813274945 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faf5405a510 0x7faf5405c9d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7faf6c007fd0 tx=0x7faf6c009040).stop 2024-01-22T05:07:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.525+0000 7faf82800700 1 -- 172.21.15.49:0/3813274945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0c1ce0 msgr2=0x7faf7c0c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.525+0000 7faf82800700 1 --2- 172.21.15.49:0/3813274945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0c1ce0 0x7faf7c0c5900 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7faf7400b610 tx=0x7faf74009780).stop 2024-01-22T05:07:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.525+0000 7faf82800700 1 -- 172.21.15.49:0/3813274945 shutdown_connections 2024-01-22T05:07:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.525+0000 7faf82800700 1 --2- 172.21.15.49:0/3813274945 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faf5405a510 0x7faf5405c9d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.525+0000 7faf82800700 1 --2- 172.21.15.49:0/3813274945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0c1ce0 0x7faf7c0c5900 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.525+0000 7faf82800700 1 --2- 172.21.15.49:0/3813274945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0bcbe0 0x7faf7c1497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.525+0000 7faf82800700 1 --2- 172.21.15.49:0/3813274945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf7c0a8c20 0x7faf7c0c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.525+0000 7faf82800700 1 -- 172.21.15.49:0/3813274945 >> 172.21.15.49:0/3813274945 conn(0x7faf7c062cb0 msgr2=0x7faf7c0c4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.525+0000 7faf82800700 1 -- 172.21.15.49:0/3813274945 shutdown_connections 2024-01-22T05:07:47.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.525+0000 7faf82800700 1 -- 172.21.15.49:0/3813274945 wait complete. 2024-01-22T05:07:47.549 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:07:47.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.713+0000 7f50f8e00700 1 Processor -- start 2024-01-22T05:07:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.713+0000 7f50f8e00700 1 -- start start 2024-01-22T05:07:47.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.717+0000 7f50f8e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f50f4150d00 0x7f50f4063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:47.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.717+0000 7f50f8e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f40bc5b0 con 0x7f50f40642e0 2024-01-22T05:07:47.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.717+0000 7f50f8e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f4064730 con 0x7f50f40c3c80 2024-01-22T05:07:47.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.717+0000 7f50f8e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f4151160 con 0x7f50f4150d00 2024-01-22T05:07:47.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.717+0000 7f50f2800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f50f40642e0 0x7f50f40bca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48434/0 (socket says 172.21.15.49:48434) 2024-01-22T05:07:47.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.717+0000 7f50f2800700 1 -- 172.21.15.49:0/618627504 learned_addr learned my addr 172.21.15.49:0/618627504 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:47.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.717+0000 7f50f1400700 1 --2- 172.21.15.49:0/618627504 >> v2:172.21.15.110:3300/0 conn(0x7f50f4150d00 0x7f50f4063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:47.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.721+0000 7f50f0a00700 1 -- 172.21.15.49:0/618627504 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182155267 0 0) 0x7f50f4064730 con 0x7f50f40c3c80 2024-01-22T05:07:47.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.721+0000 7f50f0a00700 1 -- 172.21.15.49:0/618627504 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50d40033f0 con 0x7f50f40c3c80 2024-01-22T05:07:47.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.721+0000 7f50f0a00700 1 -- 172.21.15.49:0/618627504 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100008857 0 0) 0x7f50f40bc5b0 con 0x7f50f40642e0 2024-01-22T05:07:47.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.721+0000 7f50f0a00700 1 -- 172.21.15.49:0/618627504 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50f4064730 con 0x7f50f40642e0 2024-01-22T05:07:47.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.721+0000 7f50f1400700 1 -- 172.21.15.49:0/618627504 >> v1:172.21.15.110:6789/0 conn(0x7f50f40c3c80 legacy=0x7f50f40bddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.721+0000 7f50f1400700 1 -- 172.21.15.49:0/618627504 >> v1:172.21.15.49:6789/0 conn(0x7f50f40642e0 legacy=0x7f50f40bca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.721+0000 7f50f1400700 1 -- 172.21.15.49:0/618627504 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f4151340 con 0x7f50f4150d00 2024-01-22T05:07:47.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.721+0000 7f50f1400700 1 --2- 172.21.15.49:0/618627504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f4150d00 0x7f50f4063df0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f50dc009760 tx=0x7f50dc009060).ready entity=mon.1 client_cookie=494e6d6cd2ab78a7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:47.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.721+0000 7f50f0a00700 1 -- 172.21.15.49:0/618627504 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc009120 con 0x7f50f4150d00 2024-01-22T05:07:47.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.721+0000 7f50f0a00700 1 -- 172.21.15.49:0/618627504 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc00d4a0 con 0x7f50f4150d00 2024-01-22T05:07:47.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.721+0000 7f50f0a00700 1 -- 172.21.15.49:0/618627504 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc00d820 con 0x7f50f4150d00 2024-01-22T05:07:47.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.721+0000 7f50f8e00700 1 -- 172.21.15.49:0/618627504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f4150d00 msgr2=0x7f50f4063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.721+0000 7f50f8e00700 1 --2- 172.21.15.49:0/618627504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f4150d00 0x7f50f4063df0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f50dc009760 tx=0x7f50dc009060).stop 2024-01-22T05:07:47.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.725+0000 7f50f8e00700 1 -- 172.21.15.49:0/618627504 shutdown_connections 2024-01-22T05:07:47.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.725+0000 7f50f8e00700 1 --2- 172.21.15.49:0/618627504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f4150d00 0x7f50f4063df0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.725+0000 7f50f8e00700 1 -- 172.21.15.49:0/618627504 >> 172.21.15.49:0/618627504 conn(0x7f50f40c40f0 msgr2=0x7f50f40c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:47.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.725+0000 7f50f8e00700 1 -- 172.21.15.49:0/618627504 shutdown_connections 2024-01-22T05:07:47.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.725+0000 7f50f8e00700 1 -- 172.21.15.49:0/618627504 wait complete. 2024-01-22T05:07:47.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.729+0000 7f50f8e00700 1 Processor -- start 2024-01-22T05:07:47.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.729+0000 7f50f8e00700 1 -- start start 2024-01-22T05:07:47.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f8e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f40642e0 0x7f50f40c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:47.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f8e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f40c3c80 0x7f50f414f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:47.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f8e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50f4150d00 0x7f50f416c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:47.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f8e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40bf670 con 0x7f50f40642e0 2024-01-22T05:07:47.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f8e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40bea60 con 0x7f50f40c3c80 2024-01-22T05:07:47.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f8e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40bed40 con 0x7f50f4150d00 2024-01-22T05:07:47.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f1e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f40642e0 0x7f50f40c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:47.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f1e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f40642e0 0x7f50f40c0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45062/0 (socket says 172.21.15.49:45062) 2024-01-22T05:07:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f1e00700 1 -- 172.21.15.49:0/4080551148 learned_addr learned my addr 172.21.15.49:0/4080551148 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f1400700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f40c3c80 0x7f50f414f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f2800700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50f4150d00 0x7f50f416c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f1e00700 1 -- 172.21.15.49:0/4080551148 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50f4150d00 msgr2=0x7f50f416c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f1e00700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50f4150d00 0x7f50f416c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f1e00700 1 -- 172.21.15.49:0/4080551148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f40c3c80 msgr2=0x7f50f414f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f1e00700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f40c3c80 0x7f50f414f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f1e00700 1 -- 172.21.15.49:0/4080551148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc0092a0 con 0x7f50f40642e0 2024-01-22T05:07:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f1400700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f40c3c80 0x7f50f414f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:07:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f2800700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50f4150d00 0x7f50f416c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:07:47.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f1e00700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f40642e0 0x7f50f40c0d50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f50e400c590 tx=0x7f50e4007cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:47.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50e9600700 1 -- 172.21.15.49:0/4080551148 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4007e50 con 0x7f50f40642e0 2024-01-22T05:07:47.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50e9600700 1 -- 172.21.15.49:0/4080551148 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e400e4a0 con 0x7f50f40642e0 2024-01-22T05:07:47.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50e9600700 1 -- 172.21.15.49:0/4080551148 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e400e840 con 0x7f50f40642e0 2024-01-22T05:07:47.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f8e00700 1 -- 172.21.15.49:0/4080551148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f40bf020 con 0x7f50f40642e0 2024-01-22T05:07:47.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.733+0000 7f50f8e00700 1 -- 172.21.15.49:0/4080551148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f40c1240 con 0x7f50f40642e0 2024-01-22T05:07:47.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.737+0000 7f50f8e00700 1 -- 172.21.15.49:0/4080551148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f40be3f0 con 0x7f50f40642e0 2024-01-22T05:07:47.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.737+0000 7f50e9600700 1 -- 172.21.15.49:0/4080551148 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f50e400ec30 con 0x7f50f40642e0 2024-01-22T05:07:47.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.737+0000 7f50e9600700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f50cc05a540 0x7f50cc05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:47.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.737+0000 7f50e9600700 1 -- 172.21.15.49:0/4080551148 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f50e4073fe0 con 0x7f50f40642e0 2024-01-22T05:07:47.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.737+0000 7f50f1400700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f50cc05a540 0x7f50cc05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:47.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.741+0000 7f50f1400700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f50cc05a540 0x7f50cc05ca00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f50dc006d60 tx=0x7f50dc016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:47.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.745+0000 7f50e9600700 1 -- 172.21.15.49:0/4080551148 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f50e40475f0 con 0x7f50f40642e0 2024-01-22T05:07:47.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.913+0000 7f50f8e00700 1 -- 172.21.15.49:0/4080551148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50f4063df0 con 0x7f50f40642e0 2024-01-22T05:07:47.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.913+0000 7f50e9600700 1 -- 172.21.15.49:0/4080551148 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f50e4017030 con 0x7f50f40642e0 2024-01-22T05:07:47.916 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:07:47.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.917+0000 7f50f8e00700 1 -- 172.21.15.49:0/4080551148 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f50cc05a540 msgr2=0x7f50cc05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.917+0000 7f50f8e00700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f50cc05a540 0x7f50cc05ca00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f50dc006d60 tx=0x7f50dc016000).stop 2024-01-22T05:07:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.917+0000 7f50f8e00700 1 -- 172.21.15.49:0/4080551148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f40642e0 msgr2=0x7f50f40c0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.917+0000 7f50f8e00700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f40642e0 0x7f50f40c0d50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f50e400c590 tx=0x7f50e4007cb0).stop 2024-01-22T05:07:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.917+0000 7f50f8e00700 1 -- 172.21.15.49:0/4080551148 shutdown_connections 2024-01-22T05:07:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.917+0000 7f50f8e00700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f50cc05a540 0x7f50cc05ca00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.917+0000 7f50f8e00700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50f4150d00 0x7f50f416c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.917+0000 7f50f8e00700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f40c3c80 0x7f50f414f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.917+0000 7f50f8e00700 1 --2- 172.21.15.49:0/4080551148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50f40642e0 0x7f50f40c0d50 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:47.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.917+0000 7f50f8e00700 1 -- 172.21.15.49:0/4080551148 >> 172.21.15.49:0/4080551148 conn(0x7f50f40c40f0 msgr2=0x7f50f4068fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:47.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.917+0000 7f50f8e00700 1 -- 172.21.15.49:0/4080551148 shutdown_connections 2024-01-22T05:07:47.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:47.917+0000 7f50f8e00700 1 -- 172.21.15.49:0/4080551148 wait complete. 2024-01-22T05:07:47.944 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:07:48.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.109+0000 7f47dca00700 1 Processor -- start 2024-01-22T05:07:48.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.109+0000 7f47dca00700 1 -- start start 2024-01-22T05:07:48.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.113+0000 7f47dca00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f47d80c13f0 0x7f47d80bbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.113+0000 7f47dca00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d80638a0 con 0x7f47d8068aa0 2024-01-22T05:07:48.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.113+0000 7f47dca00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d8139c80 con 0x7f47d8064440 2024-01-22T05:07:48.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.113+0000 7f47dca00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d80648d0 con 0x7f47d80c13f0 2024-01-22T05:07:48.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.113+0000 7f47d6a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f47d8068aa0 0x7f47d8063d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48442/0 (socket says 172.21.15.49:48442) 2024-01-22T05:07:48.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.113+0000 7f47d6a00700 1 -- 172.21.15.49:0/3946563455 learned_addr learned my addr 172.21.15.49:0/3946563455 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:48.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.113+0000 7f47d7400700 1 --2- 172.21.15.49:0/3946563455 >> v2:172.21.15.110:3300/0 conn(0x7f47d80c13f0 0x7f47d80bbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.117+0000 7f47d6000700 1 -- 172.21.15.49:0/3946563455 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748309991 0 0) 0x7f47d80638a0 con 0x7f47d8068aa0 2024-01-22T05:07:48.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.117+0000 7f47d6000700 1 -- 172.21.15.49:0/3946563455 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47b80033f0 con 0x7f47d8068aa0 2024-01-22T05:07:48.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.117+0000 7f47d7400700 1 -- 172.21.15.49:0/3946563455 >> v1:172.21.15.110:6789/0 conn(0x7f47d8064440 legacy=0x7f47d815a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.117+0000 7f47d6000700 1 -- 172.21.15.49:0/3946563455 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2860643375 0 0) 0x7f47d8139c80 con 0x7f47d8064440 2024-01-22T05:07:48.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.117+0000 7f47d7400700 1 -- 172.21.15.49:0/3946563455 >> v1:172.21.15.49:6789/0 conn(0x7f47d8068aa0 legacy=0x7f47d8063d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.117+0000 7f47d7400700 1 -- 172.21.15.49:0/3946563455 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d80bc5b0 con 0x7f47d80c13f0 2024-01-22T05:07:48.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.117+0000 7f47d7400700 1 --2- 172.21.15.49:0/3946563455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d80c13f0 0x7f47d80bbcb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f47c8009760 tx=0x7f47c8009060).ready entity=mon.1 client_cookie=2fd2537df38650c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:48.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.117+0000 7f47d6000700 1 -- 172.21.15.49:0/3946563455 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c0001470 con 0x7f47d80c13f0 2024-01-22T05:07:48.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.117+0000 7f47d6000700 1 -- 172.21.15.49:0/3946563455 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c8012410 con 0x7f47d80c13f0 2024-01-22T05:07:48.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.117+0000 7f47d6000700 1 -- 172.21.15.49:0/3946563455 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c8012790 con 0x7f47d80c13f0 2024-01-22T05:07:48.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.117+0000 7f47dca00700 1 -- 172.21.15.49:0/3946563455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d80c13f0 msgr2=0x7f47d80bbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.117+0000 7f47dca00700 1 --2- 172.21.15.49:0/3946563455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d80c13f0 0x7f47d80bbcb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f47c8009760 tx=0x7f47c8009060).stop 2024-01-22T05:07:48.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.117+0000 7f47dca00700 1 -- 172.21.15.49:0/3946563455 shutdown_connections 2024-01-22T05:07:48.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.117+0000 7f47dca00700 1 --2- 172.21.15.49:0/3946563455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d80c13f0 0x7f47d80bbcb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.117+0000 7f47dca00700 1 -- 172.21.15.49:0/3946563455 >> 172.21.15.49:0/3946563455 conn(0x7f47d80c42c0 msgr2=0x7f47d8065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:48.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.121+0000 7f47dca00700 1 -- 172.21.15.49:0/3946563455 shutdown_connections 2024-01-22T05:07:48.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.121+0000 7f47dca00700 1 -- 172.21.15.49:0/3946563455 wait complete. 2024-01-22T05:07:48.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.121+0000 7f47dca00700 1 Processor -- start 2024-01-22T05:07:48.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.121+0000 7f47dca00700 1 -- start start 2024-01-22T05:07:48.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47dca00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d8064440 0x7f47d81528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47dca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47d8068aa0 0x7f47d8136050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47dca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47d80c13f0 0x7f47d8153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47dca00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80bfb30 con 0x7f47d80c13f0 2024-01-22T05:07:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47dca00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8152420 con 0x7f47d8064440 2024-01-22T05:07:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47dca00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8151810 con 0x7f47d8068aa0 2024-01-22T05:07:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47d7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47d80c13f0 0x7f47d8153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47d7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47d80c13f0 0x7f47d8153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45072/0 (socket says 172.21.15.49:45072) 2024-01-22T05:07:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47d7400700 1 --2- 172.21.15.49:0/3627489143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d8064440 0x7f47d81528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47d7e00700 1 -- 172.21.15.49:0/3627489143 learned_addr learned my addr 172.21.15.49:0/3627489143 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47d6a00700 1 --2- 172.21.15.49:0/3627489143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47d8068aa0 0x7f47d8136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47d7e00700 1 -- 172.21.15.49:0/3627489143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47d8068aa0 msgr2=0x7f47d8136050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47d7e00700 1 --2- 172.21.15.49:0/3627489143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47d8068aa0 0x7f47d8136050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47d7e00700 1 -- 172.21.15.49:0/3627489143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d8064440 msgr2=0x7f47d81528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47d7e00700 1 --2- 172.21.15.49:0/3627489143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d8064440 0x7f47d81528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47d7e00700 1 -- 172.21.15.49:0/3627489143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c80092a0 con 0x7f47d80c13f0 2024-01-22T05:07:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47d7400700 1 --2- 172.21.15.49:0/3627489143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d8064440 0x7f47d81528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47d7e00700 1 --2- 172.21.15.49:0/3627489143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47d80c13f0 0x7f47d8153280 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f47d0002230 tx=0x7f47d0007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47cea00700 1 -- 172.21.15.49:0/3627489143 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d000e4a0 con 0x7f47d80c13f0 2024-01-22T05:07:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47cea00700 1 -- 172.21.15.49:0/3627489143 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d000e600 con 0x7f47d80c13f0 2024-01-22T05:07:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47dca00700 1 -- 172.21.15.49:0/3627489143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d8151af0 con 0x7f47d80c13f0 2024-01-22T05:07:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47cea00700 1 -- 172.21.15.49:0/3627489143 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d000e9a0 con 0x7f47d80c13f0 2024-01-22T05:07:48.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.125+0000 7f47dca00700 1 -- 172.21.15.49:0/3627489143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d81520b0 con 0x7f47d80c13f0 2024-01-22T05:07:48.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.129+0000 7f47dca00700 1 -- 172.21.15.49:0/3627489143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d81525d0 con 0x7f47d80c13f0 2024-01-22T05:07:48.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.129+0000 7f47cea00700 1 -- 172.21.15.49:0/3627489143 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f47d0012400 con 0x7f47d80c13f0 2024-01-22T05:07:48.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.133+0000 7f47cea00700 1 --2- 172.21.15.49:0/3627489143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f47b005a510 0x7f47b005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.133+0000 7f47cea00700 1 -- 172.21.15.49:0/3627489143 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f47d0073fb0 con 0x7f47d80c13f0 2024-01-22T05:07:48.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.133+0000 7f47d7400700 1 --2- 172.21.15.49:0/3627489143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f47b005a510 0x7f47b005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.133+0000 7f47d7400700 1 --2- 172.21.15.49:0/3627489143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f47b005a510 0x7f47b005c9d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f47c8006be0 tx=0x7f47c8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:48.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.137+0000 7f47cea00700 1 -- 172.21.15.49:0/3627489143 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f47d00a2b00 con 0x7f47d80c13f0 2024-01-22T05:07:48.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.337+0000 7f47dca00700 1 -- 172.21.15.49:0/3627489143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47d80bc890 con 0x7f47d80c13f0 2024-01-22T05:07:48.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.337+0000 7f47cea00700 1 -- 172.21.15.49:0/3627489143 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f47d81525d0 con 0x7f47d80c13f0 2024-01-22T05:07:48.341 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:07:48.341 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":34,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4066204164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":4066204164},{"type":"v1","addr":"172.21.15.110:6835","nonce":4066204164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/3793850760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3793850760},{"type":"v1","addr":"172.21.15.110:6834","nonce":3793850760}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/331321155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":331321155},{"type":"v1","addr":"172.21.15.49:6837","nonce":331321155}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-01-22T05:05:42.747172+0000","modified":"2024-01-22T05:07:30.547619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":31,"addr":"172.21.15.49:6836/3211151680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3211151680},{"type":"v1","addr":"172.21.15.49:6836","nonce":3211151680}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-22T05:07:48.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.341+0000 7f47dca00700 1 -- 172.21.15.49:0/3627489143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f47b005a510 msgr2=0x7f47b005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.341+0000 7f47dca00700 1 --2- 172.21.15.49:0/3627489143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f47b005a510 0x7f47b005c9d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f47c8006be0 tx=0x7f47c8015000).stop 2024-01-22T05:07:48.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.341+0000 7f47dca00700 1 -- 172.21.15.49:0/3627489143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47d80c13f0 msgr2=0x7f47d8153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.341+0000 7f47dca00700 1 --2- 172.21.15.49:0/3627489143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47d80c13f0 0x7f47d8153280 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f47d0002230 tx=0x7f47d0007f70).stop 2024-01-22T05:07:48.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.345+0000 7f47dca00700 1 -- 172.21.15.49:0/3627489143 shutdown_connections 2024-01-22T05:07:48.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.345+0000 7f47dca00700 1 --2- 172.21.15.49:0/3627489143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f47b005a510 0x7f47b005c9d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.345+0000 7f47dca00700 1 --2- 172.21.15.49:0/3627489143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47d80c13f0 0x7f47d8153280 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.345+0000 7f47dca00700 1 --2- 172.21.15.49:0/3627489143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47d8068aa0 0x7f47d8136050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.345+0000 7f47dca00700 1 --2- 172.21.15.49:0/3627489143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d8064440 0x7f47d81528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.345+0000 7f47dca00700 1 -- 172.21.15.49:0/3627489143 >> 172.21.15.49:0/3627489143 conn(0x7f47d80c42c0 msgr2=0x7f47d80c4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:48.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.345+0000 7f47dca00700 1 -- 172.21.15.49:0/3627489143 shutdown_connections 2024-01-22T05:07:48.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.345+0000 7f47dca00700 1 -- 172.21.15.49:0/3627489143 wait complete. 2024-01-22T05:07:48.349 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 34 2024-01-22T05:07:48.367 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:07:48.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.537+0000 7f6fdcc00700 1 Processor -- start 2024-01-22T05:07:48.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.537+0000 7f6fdcc00700 1 -- start start 2024-01-22T05:07:48.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.541+0000 7f6fdcc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6fd815c1c0 0x7f6fd80bfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.541+0000 7f6fdcc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd80c0370 0x7f6fd8068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.541+0000 7f6fdcc00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd8062650 con 0x7f6fd80a9020 2024-01-22T05:07:48.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.541+0000 7f6fdcc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd80c0e90 con 0x7f6fd815c1c0 2024-01-22T05:07:48.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.541+0000 7f6fdcc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80c8bf0 con 0x7f6fd80c0370 2024-01-22T05:07:48.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.541+0000 7f6fd7200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd80c0370 0x7f6fd8068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.541+0000 7f6fd5400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6fd815c1c0 0x7f6fd80bfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.541+0000 7f6fd7200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd80c0370 0x7f6fd8068710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:60974/0 (socket says 172.21.15.49:60974) 2024-01-22T05:07:48.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.541+0000 7f6fd7200700 1 -- 172.21.15.49:0/340178163 learned_addr learned my addr 172.21.15.49:0/340178163 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:48.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.541+0000 7f6fd5400700 1 -- 172.21.15.49:0/340178163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd80c0370 msgr2=0x7f6fd8068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:48.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.541+0000 7f6fd5400700 1 --2- 172.21.15.49:0/340178163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd80c0370 0x7f6fd8068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.541+0000 7f6fd5400700 1 -- 172.21.15.49:0/340178163 >> v1:172.21.15.110:6789/0 conn(0x7f6fd80a9020 legacy=0x7f6fd815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.541+0000 7f6fd5400700 1 -- 172.21.15.49:0/340178163 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd8068280 con 0x7f6fd815c1c0 2024-01-22T05:07:48.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.545+0000 7f6fd5400700 1 --2- 172.21.15.49:0/340178163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd815c1c0 0x7f6fd80bfe80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f6fc0009760 tx=0x7f6fc0009060).ready entity=mon.1 client_cookie=3949a86c407af2ed server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:48.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.545+0000 7f6fd4a00700 1 -- 172.21.15.49:0/340178163 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000f510 con 0x7f6fd815c1c0 2024-01-22T05:07:48.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.545+0000 7f6fd4a00700 1 -- 172.21.15.49:0/340178163 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc000f670 con 0x7f6fd815c1c0 2024-01-22T05:07:48.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.545+0000 7f6fd4a00700 1 -- 172.21.15.49:0/340178163 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000f9f0 con 0x7f6fd815c1c0 2024-01-22T05:07:48.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.545+0000 7f6fdcc00700 1 -- 172.21.15.49:0/340178163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd815c1c0 msgr2=0x7f6fd80bfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.545+0000 7f6fdcc00700 1 --2- 172.21.15.49:0/340178163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd815c1c0 0x7f6fd80bfe80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f6fc0009760 tx=0x7f6fc0009060).stop 2024-01-22T05:07:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.545+0000 7f6fdcc00700 1 -- 172.21.15.49:0/340178163 shutdown_connections 2024-01-22T05:07:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.545+0000 7f6fdcc00700 1 --2- 172.21.15.49:0/340178163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd80c0370 0x7f6fd8068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.545+0000 7f6fdcc00700 1 --2- 172.21.15.49:0/340178163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd815c1c0 0x7f6fd80bfe80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.545+0000 7f6fdcc00700 1 -- 172.21.15.49:0/340178163 >> 172.21.15.49:0/340178163 conn(0x7f6fd80c9f50 msgr2=0x7f6fd80ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:48.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.545+0000 7f6fdcc00700 1 -- 172.21.15.49:0/340178163 shutdown_connections 2024-01-22T05:07:48.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.545+0000 7f6fdcc00700 1 -- 172.21.15.49:0/340178163 wait complete. 2024-01-22T05:07:48.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.549+0000 7f6fdcc00700 1 Processor -- start 2024-01-22T05:07:48.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.549+0000 7f6fdcc00700 1 -- start start 2024-01-22T05:07:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.549+0000 7f6fdcc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fd80a9020 0x7f6fd80aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fdcc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd80c0370 0x7f6fd813d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fdcc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd815c1c0 0x7f6fd80ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fdcc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80aefe0 con 0x7f6fd80a9020 2024-01-22T05:07:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fdcc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd813dd50 con 0x7f6fd815c1c0 2024-01-22T05:07:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fdcc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80adf60 con 0x7f6fd80c0370 2024-01-22T05:07:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fd5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fd80a9020 0x7f6fd80aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fd5400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd80c0370 0x7f6fd813d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fd7200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd815c1c0 0x7f6fd80ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fd5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fd80a9020 0x7f6fd80aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45086/0 (socket says 172.21.15.49:45086) 2024-01-22T05:07:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fd7200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd815c1c0 0x7f6fd80ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:58760/0 (socket says 172.21.15.49:58760) 2024-01-22T05:07:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fd5e00700 1 -- 172.21.15.49:0/1887326799 learned_addr learned my addr 172.21.15.49:0/1887326799 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fd7200700 1 -- 172.21.15.49:0/1887326799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd80c0370 msgr2=0x7f6fd813d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fd7200700 1 --2- 172.21.15.49:0/1887326799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd80c0370 0x7f6fd813d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fd7200700 1 -- 172.21.15.49:0/1887326799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fd80a9020 msgr2=0x7f6fd80aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fd7200700 1 --2- 172.21.15.49:0/1887326799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fd80a9020 0x7f6fd80aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fd7200700 1 -- 172.21.15.49:0/1887326799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc00092a0 con 0x7f6fd815c1c0 2024-01-22T05:07:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fd7200700 1 --2- 172.21.15.49:0/1887326799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd815c1c0 0x7f6fd80ada70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f6fd0009e50 tx=0x7f6fd000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fcd600700 1 -- 172.21.15.49:0/1887326799 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd000c890 con 0x7f6fd815c1c0 2024-01-22T05:07:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fcd600700 1 -- 172.21.15.49:0/1887326799 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd000f040 con 0x7f6fd815c1c0 2024-01-22T05:07:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fcd600700 1 -- 172.21.15.49:0/1887326799 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd000cc20 con 0x7f6fd815c1c0 2024-01-22T05:07:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fdcc00700 1 -- 172.21.15.49:0/1887326799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd80af240 con 0x7f6fd815c1c0 2024-01-22T05:07:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.553+0000 7f6fdcc00700 1 -- 172.21.15.49:0/1887326799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd80af800 con 0x7f6fd815c1c0 2024-01-22T05:07:48.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.557+0000 7f6fdcc00700 1 -- 172.21.15.49:0/1887326799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd8047060 con 0x7f6fd815c1c0 2024-01-22T05:07:48.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.557+0000 7f6fcd600700 1 -- 172.21.15.49:0/1887326799 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6fd0014410 con 0x7f6fd815c1c0 2024-01-22T05:07:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.557+0000 7f6fcd600700 1 --2- 172.21.15.49:0/1887326799 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6fb005a510 0x7f6fb005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.557+0000 7f6fcd600700 1 -- 172.21.15.49:0/1887326799 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f6fd0074af0 con 0x7f6fd815c1c0 2024-01-22T05:07:48.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.557+0000 7f6fd5e00700 1 --2- 172.21.15.49:0/1887326799 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6fb005a510 0x7f6fb005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.561+0000 7f6fd5e00700 1 --2- 172.21.15.49:0/1887326799 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6fb005a510 0x7f6fb005c9d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f6fc8007fd0 tx=0x7f6fc8007dd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:48.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.565+0000 7f6fcd600700 1 -- 172.21.15.49:0/1887326799 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6fd0047fe0 con 0x7f6fd815c1c0 2024-01-22T05:07:48.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.729+0000 7f6fdcc00700 1 -- 172.21.15.49:0/1887326799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fd80bfb80 con 0x7f6fd815c1c0 2024-01-22T05:07:48.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.733+0000 7f6fcd600700 1 -- 172.21.15.49:0/1887326799 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+17372 (secure 0 0 0) 0x7f6fd004b600 con 0x7f6fd815c1c0 2024-01-22T05:07:48.734 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:07:48.734 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":44,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:07:21.104311+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:05:40.764447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-01-22T05:05:41.767543+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.35","mappings":[{"from":5,"to":0}]},{"pgid":"7.2a","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:07:48.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.737+0000 7f6fdcc00700 1 -- 172.21.15.49:0/1887326799 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6fb005a510 msgr2=0x7f6fb005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.737+0000 7f6fdcc00700 1 --2- 172.21.15.49:0/1887326799 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6fb005a510 0x7f6fb005c9d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f6fc8007fd0 tx=0x7f6fc8007dd0).stop 2024-01-22T05:07:48.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.737+0000 7f6fdcc00700 1 -- 172.21.15.49:0/1887326799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd815c1c0 msgr2=0x7f6fd80ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.737+0000 7f6fdcc00700 1 --2- 172.21.15.49:0/1887326799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd815c1c0 0x7f6fd80ada70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f6fd0009e50 tx=0x7f6fd000b040).stop 2024-01-22T05:07:48.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.737+0000 7f6fdcc00700 1 -- 172.21.15.49:0/1887326799 shutdown_connections 2024-01-22T05:07:48.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.737+0000 7f6fdcc00700 1 --2- 172.21.15.49:0/1887326799 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6fb005a510 0x7f6fb005c9d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.737+0000 7f6fdcc00700 1 --2- 172.21.15.49:0/1887326799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd815c1c0 0x7f6fd80ada70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.737+0000 7f6fdcc00700 1 --2- 172.21.15.49:0/1887326799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd80c0370 0x7f6fd813d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.737+0000 7f6fdcc00700 1 --2- 172.21.15.49:0/1887326799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fd80a9020 0x7f6fd80aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.737+0000 7f6fdcc00700 1 -- 172.21.15.49:0/1887326799 >> 172.21.15.49:0/1887326799 conn(0x7f6fd80c9f50 msgr2=0x7f6fd80ca330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:48.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.737+0000 7f6fdcc00700 1 -- 172.21.15.49:0/1887326799 shutdown_connections 2024-01-22T05:07:48.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.737+0000 7f6fdcc00700 1 -- 172.21.15.49:0/1887326799 wait complete. 2024-01-22T05:07:48.767 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:07:48.767 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:07:48.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.925+0000 7f39c5600700 1 Processor -- start 2024-01-22T05:07:48.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.925+0000 7f39c5600700 1 -- start start 2024-01-22T05:07:48.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.929+0000 7f39c5600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f39c0155880 0x7f39c00a8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.929+0000 7f39c5600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c0068a60 con 0x7f39c0155c60 2024-01-22T05:07:48.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.929+0000 7f39c5600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c0067e50 con 0x7f39c00a7260 2024-01-22T05:07:48.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.929+0000 7f39c5600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c0068130 con 0x7f39c0155880 2024-01-22T05:07:48.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.929+0000 7f39bf400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f39c0155c60 0x7f39c00a6b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48450/0 (socket says 172.21.15.49:48450) 2024-01-22T05:07:48.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.929+0000 7f39bf400700 1 -- 172.21.15.49:0/819686363 learned_addr learned my addr 172.21.15.49:0/819686363 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:48.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.929+0000 7f39bfe00700 1 --2- 172.21.15.49:0/819686363 >> v2:172.21.15.110:3300/0 conn(0x7f39c0155880 0x7f39c00a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.929+0000 7f39bea00700 1 -- 172.21.15.49:0/819686363 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100150244 0 0) 0x7f39c0068a60 con 0x7f39c0155c60 2024-01-22T05:07:48.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.929+0000 7f39bea00700 1 -- 172.21.15.49:0/819686363 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39a00033f0 con 0x7f39c0155c60 2024-01-22T05:07:48.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.929+0000 7f39bea00700 1 -- 172.21.15.49:0/819686363 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479368189 0 0) 0x7f39c0067e50 con 0x7f39c00a7260 2024-01-22T05:07:48.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.933+0000 7f39bea00700 1 -- 172.21.15.49:0/819686363 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39c0068a60 con 0x7f39c00a7260 2024-01-22T05:07:48.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.933+0000 7f39bfe00700 1 -- 172.21.15.49:0/819686363 >> v1:172.21.15.110:6789/0 conn(0x7f39c00a7260 legacy=0x7f39c00659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.933+0000 7f39bfe00700 1 -- 172.21.15.49:0/819686363 >> v1:172.21.15.49:6789/0 conn(0x7f39c0155c60 legacy=0x7f39c00a6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.933+0000 7f39bfe00700 1 -- 172.21.15.49:0/819686363 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c0068410 con 0x7f39c0155880 2024-01-22T05:07:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.933+0000 7f39bfe00700 1 --2- 172.21.15.49:0/819686363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39c0155880 0x7f39c00a8990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f39c00a7700 tx=0x7f39b0009060).ready entity=mon.1 client_cookie=c9a8294dd7c1f83d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.933+0000 7f39bea00700 1 -- 172.21.15.49:0/819686363 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b000d4a0 con 0x7f39c0155880 2024-01-22T05:07:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.933+0000 7f39bea00700 1 -- 172.21.15.49:0/819686363 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b000d600 con 0x7f39c0155880 2024-01-22T05:07:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.933+0000 7f39bea00700 1 -- 172.21.15.49:0/819686363 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b000d980 con 0x7f39c0155880 2024-01-22T05:07:48.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.933+0000 7f39c5600700 1 -- 172.21.15.49:0/819686363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39c0155880 msgr2=0x7f39c00a8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.933+0000 7f39c5600700 1 --2- 172.21.15.49:0/819686363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39c0155880 0x7f39c00a8990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f39c00a7700 tx=0x7f39b0009060).stop 2024-01-22T05:07:48.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.933+0000 7f39c5600700 1 -- 172.21.15.49:0/819686363 shutdown_connections 2024-01-22T05:07:48.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.933+0000 7f39c5600700 1 --2- 172.21.15.49:0/819686363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39c0155880 0x7f39c00a8990 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.933+0000 7f39c5600700 1 -- 172.21.15.49:0/819686363 >> 172.21.15.49:0/819686363 conn(0x7f39c00c6530 msgr2=0x7f39c00c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:48.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.933+0000 7f39c5600700 1 -- 172.21.15.49:0/819686363 shutdown_connections 2024-01-22T05:07:48.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.933+0000 7f39c5600700 1 -- 172.21.15.49:0/819686363 wait complete. 2024-01-22T05:07:48.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.937+0000 7f39c5600700 1 Processor -- start 2024-01-22T05:07:48.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.937+0000 7f39c5600700 1 -- start start 2024-01-22T05:07:48.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.937+0000 7f39c5600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39c00a7260 0x7f39c00a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.937+0000 7f39c5600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c0155880 0x7f39c0169040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.937+0000 7f39c5600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39c0155c60 0x7f39c0169530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.937+0000 7f39c5600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00aaf80 con 0x7f39c0155880 2024-01-22T05:07:48.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.937+0000 7f39c5600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00aa370 con 0x7f39c00a7260 2024-01-22T05:07:48.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.937+0000 7f39c5600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00aa650 con 0x7f39c0155c60 2024-01-22T05:07:48.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39bf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c0155880 0x7f39c0169040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39bf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c0155880 0x7f39c0169040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45100/0 (socket says 172.21.15.49:45100) 2024-01-22T05:07:48.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39bf400700 1 -- 172.21.15.49:0/1889480737 learned_addr learned my addr 172.21.15.49:0/1889480737 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:48.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39bfe00700 1 --2- 172.21.15.49:0/1889480737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39c00a7260 0x7f39c00a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39c4c00700 1 --2- 172.21.15.49:0/1889480737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39c0155c60 0x7f39c0169530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39bf400700 1 -- 172.21.15.49:0/1889480737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39c0155c60 msgr2=0x7f39c0169530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39bf400700 1 --2- 172.21.15.49:0/1889480737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39c0155c60 0x7f39c0169530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39bf400700 1 -- 172.21.15.49:0/1889480737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39c00a7260 msgr2=0x7f39c00a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:48.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39bf400700 1 --2- 172.21.15.49:0/1889480737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39c00a7260 0x7f39c00a98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:48.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39bf400700 1 -- 172.21.15.49:0/1889480737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b00092a0 con 0x7f39c0155880 2024-01-22T05:07:48.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39bfe00700 1 --2- 172.21.15.49:0/1889480737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39c00a7260 0x7f39c00a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:07:48.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39bf400700 1 --2- 172.21.15.49:0/1889480737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c0155880 0x7f39c0169040 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f39a800c470 tx=0x7f39a8007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:48.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39b7400700 1 -- 172.21.15.49:0/1889480737 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a80072e0 con 0x7f39c0155880 2024-01-22T05:07:48.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39c5600700 1 -- 172.21.15.49:0/1889480737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c00aa930 con 0x7f39c0155880 2024-01-22T05:07:48.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39b7400700 1 -- 172.21.15.49:0/1889480737 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a8007440 con 0x7f39c0155880 2024-01-22T05:07:48.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39b7400700 1 -- 172.21.15.49:0/1889480737 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a80057a0 con 0x7f39c0155880 2024-01-22T05:07:48.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39c5600700 1 -- 172.21.15.49:0/1889480737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c00a9da0 con 0x7f39c0155880 2024-01-22T05:07:48.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.941+0000 7f39c5600700 1 -- 172.21.15.49:0/1889480737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c00aa020 con 0x7f39c0155880 2024-01-22T05:07:48.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.945+0000 7f39b7400700 1 -- 172.21.15.49:0/1889480737 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f39a8005b90 con 0x7f39c0155880 2024-01-22T05:07:48.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.945+0000 7f39b7400700 1 --2- 172.21.15.49:0/1889480737 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f399805a510 0x7f399805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:48.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.945+0000 7f39b7400700 1 -- 172.21.15.49:0/1889480737 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f39a80741a0 con 0x7f39c0155880 2024-01-22T05:07:48.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.945+0000 7f39bfe00700 1 --2- 172.21.15.49:0/1889480737 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f399805a510 0x7f399805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:48.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.945+0000 7f39bfe00700 1 --2- 172.21.15.49:0/1889480737 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f399805a510 0x7f399805c9d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f39c00abac0 tx=0x7f39b0016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:48.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:48.953+0000 7f39b7400700 1 -- 172.21.15.49:0/1889480737 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f39a80477b0 con 0x7f39c0155880 2024-01-22T05:07:49.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.153+0000 7f39c5600700 1 -- 172.21.15.49:0/1889480737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39c0046800 con 0x7f39c0155880 2024-01-22T05:07:49.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.157+0000 7f39b7400700 1 -- 172.21.15.49:0/1889480737 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f39a804add0 con 0x7f39c0155880 2024-01-22T05:07:49.157 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:07:49.157 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":34,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4066204164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":4066204164},{"type":"v1","addr":"172.21.15.110:6835","nonce":4066204164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/3793850760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3793850760},{"type":"v1","addr":"172.21.15.110:6834","nonce":3793850760}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/331321155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":331321155},{"type":"v1","addr":"172.21.15.49:6837","nonce":331321155}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-01-22T05:05:42.747172+0000","modified":"2024-01-22T05:07:30.547619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":31,"addr":"172.21.15.49:6836/3211151680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3211151680},{"type":"v1","addr":"172.21.15.49:6836","nonce":3211151680}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-22T05:07:49.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.157+0000 7f39c5600700 1 -- 172.21.15.49:0/1889480737 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f399805a510 msgr2=0x7f399805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:49.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.157+0000 7f39c5600700 1 --2- 172.21.15.49:0/1889480737 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f399805a510 0x7f399805c9d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f39c00abac0 tx=0x7f39b0016000).stop 2024-01-22T05:07:49.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.157+0000 7f39c5600700 1 -- 172.21.15.49:0/1889480737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c0155880 msgr2=0x7f39c0169040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:49.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.157+0000 7f39c5600700 1 --2- 172.21.15.49:0/1889480737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c0155880 0x7f39c0169040 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f39a800c470 tx=0x7f39a8007d20).stop 2024-01-22T05:07:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.157+0000 7f39c5600700 1 -- 172.21.15.49:0/1889480737 shutdown_connections 2024-01-22T05:07:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.157+0000 7f39c5600700 1 --2- 172.21.15.49:0/1889480737 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f399805a510 0x7f399805c9d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.157+0000 7f39c5600700 1 --2- 172.21.15.49:0/1889480737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39c0155c60 0x7f39c0169530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.157+0000 7f39c5600700 1 --2- 172.21.15.49:0/1889480737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c0155880 0x7f39c0169040 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.157+0000 7f39c5600700 1 --2- 172.21.15.49:0/1889480737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39c00a7260 0x7f39c00a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.157+0000 7f39c5600700 1 -- 172.21.15.49:0/1889480737 >> 172.21.15.49:0/1889480737 conn(0x7f39c00c6530 msgr2=0x7f39c00a6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.161+0000 7f39c5600700 1 -- 172.21.15.49:0/1889480737 shutdown_connections 2024-01-22T05:07:49.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.161+0000 7f39c5600700 1 -- 172.21.15.49:0/1889480737 wait complete. 2024-01-22T05:07:49.165 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 34 2024-01-22T05:07:49.183 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:07:49.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.341+0000 7fd217e00700 1 Processor -- start 2024-01-22T05:07:49.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.341+0000 7fd217e00700 1 -- start start 2024-01-22T05:07:49.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.345+0000 7fd217e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd210066fb0 0x7fd2100c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:49.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.345+0000 7fd217e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2100c1ee0 con 0x7fd2100a8f90 2024-01-22T05:07:49.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.345+0000 7fd217e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2100c12f0 con 0x7fd2100a8b10 2024-01-22T05:07:49.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.345+0000 7fd217e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2100c15b0 con 0x7fd210066fb0 2024-01-22T05:07:49.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.345+0000 7fd215e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd2100a8f90 0x7fd210065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48464/0 (socket says 172.21.15.49:48464) 2024-01-22T05:07:49.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.345+0000 7fd215e00700 1 -- 172.21.15.49:0/574245118 learned_addr learned my addr 172.21.15.49:0/574245118 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:49.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.345+0000 7fd215400700 1 --2- 172.21.15.49:0/574245118 >> v2:172.21.15.110:3300/0 conn(0x7fd210066fb0 0x7fd2100c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:49.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.349+0000 7fd20fe00700 1 -- 172.21.15.49:0/574245118 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901305359 0 0) 0x7fd2100c1ee0 con 0x7fd2100a8f90 2024-01-22T05:07:49.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.349+0000 7fd20fe00700 1 -- 172.21.15.49:0/574245118 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f00033f0 con 0x7fd2100a8f90 2024-01-22T05:07:49.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.349+0000 7fd215400700 1 -- 172.21.15.49:0/574245118 >> v1:172.21.15.110:6789/0 conn(0x7fd2100a8b10 legacy=0x7fd210157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:49.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.349+0000 7fd20fe00700 1 -- 172.21.15.49:0/574245118 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375883146 0 0) 0x7fd2100c12f0 con 0x7fd2100a8b10 2024-01-22T05:07:49.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.349+0000 7fd215400700 1 -- 172.21.15.49:0/574245118 >> v1:172.21.15.49:6789/0 conn(0x7fd2100a8f90 legacy=0x7fd210065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:49.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.349+0000 7fd215400700 1 -- 172.21.15.49:0/574245118 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2100c1890 con 0x7fd210066fb0 2024-01-22T05:07:49.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.349+0000 7fd215400700 1 --2- 172.21.15.49:0/574245118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd210066fb0 0x7fd2100c2370 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fd200009760 tx=0x7fd200009060).ready entity=mon.1 client_cookie=9f0a07c61ae3418f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:49.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.349+0000 7fd20fe00700 1 -- 172.21.15.49:0/574245118 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000f510 con 0x7fd210066fb0 2024-01-22T05:07:49.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.349+0000 7fd20fe00700 1 -- 172.21.15.49:0/574245118 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20000f670 con 0x7fd210066fb0 2024-01-22T05:07:49.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.349+0000 7fd20fe00700 1 -- 172.21.15.49:0/574245118 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000f9f0 con 0x7fd210066fb0 2024-01-22T05:07:49.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.349+0000 7fd217e00700 1 -- 172.21.15.49:0/574245118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd210066fb0 msgr2=0x7fd2100c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:49.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.349+0000 7fd217e00700 1 --2- 172.21.15.49:0/574245118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd210066fb0 0x7fd2100c2370 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fd200009760 tx=0x7fd200009060).stop 2024-01-22T05:07:49.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.349+0000 7fd217e00700 1 -- 172.21.15.49:0/574245118 shutdown_connections 2024-01-22T05:07:49.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.349+0000 7fd217e00700 1 --2- 172.21.15.49:0/574245118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd210066fb0 0x7fd2100c2370 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.349+0000 7fd217e00700 1 -- 172.21.15.49:0/574245118 >> 172.21.15.49:0/574245118 conn(0x7fd2100c6540 msgr2=0x7fd2100c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:49.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.353+0000 7fd217e00700 1 -- 172.21.15.49:0/574245118 shutdown_connections 2024-01-22T05:07:49.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.353+0000 7fd217e00700 1 -- 172.21.15.49:0/574245118 wait complete. 2024-01-22T05:07:49.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.353+0000 7fd217e00700 1 Processor -- start 2024-01-22T05:07:49.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.353+0000 7fd217e00700 1 -- start start 2024-01-22T05:07:49.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd217e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd210066fb0 0x7fd210167f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:49.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd217e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2100a8b10 0x7fd21014e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:49.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd217e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2100a8f90 0x7fd21014e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:49.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd217e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd210168c20 con 0x7fd2100a8f90 2024-01-22T05:07:49.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd217e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd210137e40 con 0x7fd2100a8b10 2024-01-22T05:07:49.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd217e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21014ed80 con 0x7fd210066fb0 2024-01-22T05:07:49.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd215e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2100a8f90 0x7fd21014e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:49.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd215e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2100a8f90 0x7fd21014e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45116/0 (socket says 172.21.15.49:45116) 2024-01-22T05:07:49.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd215e00700 1 -- 172.21.15.49:0/1920074215 learned_addr learned my addr 172.21.15.49:0/1920074215 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:49.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd215400700 1 --2- 172.21.15.49:0/1920074215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd210066fb0 0x7fd210167f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:49.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd214a00700 1 --2- 172.21.15.49:0/1920074215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2100a8b10 0x7fd21014e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:49.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd215e00700 1 -- 172.21.15.49:0/1920074215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd210066fb0 msgr2=0x7fd210167f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:49.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd215e00700 1 --2- 172.21.15.49:0/1920074215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd210066fb0 0x7fd210167f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd215e00700 1 -- 172.21.15.49:0/1920074215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2100a8b10 msgr2=0x7fd21014e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:49.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd215e00700 1 --2- 172.21.15.49:0/1920074215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2100a8b10 0x7fd21014e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd215e00700 1 -- 172.21.15.49:0/1920074215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000092a0 con 0x7fd2100a8f90 2024-01-22T05:07:49.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd215400700 1 --2- 172.21.15.49:0/1920074215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd210066fb0 0x7fd210167f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:07:49.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd215e00700 1 --2- 172.21.15.49:0/1920074215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2100a8f90 0x7fd21014e890 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fd20800c6e0 tx=0x7fd208007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:49.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd20cc00700 1 -- 172.21.15.49:0/1920074215 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208005d30 con 0x7fd2100a8f90 2024-01-22T05:07:49.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd20cc00700 1 -- 172.21.15.49:0/1920074215 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd208005e90 con 0x7fd2100a8f90 2024-01-22T05:07:49.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd217e00700 1 -- 172.21.15.49:0/1920074215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21014f070 con 0x7fd2100a8f90 2024-01-22T05:07:49.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd20cc00700 1 -- 172.21.15.49:0/1920074215 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208007320 con 0x7fd2100a8f90 2024-01-22T05:07:49.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.357+0000 7fd217e00700 1 -- 172.21.15.49:0/1920074215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd210137ad0 con 0x7fd2100a8f90 2024-01-22T05:07:49.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.361+0000 7fd217e00700 1 -- 172.21.15.49:0/1920074215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd210137fd0 con 0x7fd2100a8f90 2024-01-22T05:07:49.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.361+0000 7fd20cc00700 1 -- 172.21.15.49:0/1920074215 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd208007750 con 0x7fd2100a8f90 2024-01-22T05:07:49.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.361+0000 7fd20cc00700 1 --2- 172.21.15.49:0/1920074215 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd1e805a510 0x7fd1e805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:49.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.361+0000 7fd20cc00700 1 -- 172.21.15.49:0/1920074215 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7fd208074940 con 0x7fd2100a8f90 2024-01-22T05:07:49.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.365+0000 7fd215400700 1 --2- 172.21.15.49:0/1920074215 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd1e805a510 0x7fd1e805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.365+0000 7fd215400700 1 --2- 172.21.15.49:0/1920074215 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd1e805a510 0x7fd1e805c9d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fd200006e00 tx=0x7fd200017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:49.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.369+0000 7fd20cc00700 1 -- 172.21.15.49:0/1920074215 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd208047f50 con 0x7fd2100a8f90 2024-01-22T05:07:49.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.569+0000 7fd217e00700 1 -- 172.21.15.49:0/1920074215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd210047060 con 0x7fd2100a8f90 2024-01-22T05:07:49.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.569+0000 7fd20cc00700 1 -- 172.21.15.49:0/1920074215 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4493 (secure 0 0 0) 0x7fd20804b570 con 0x7fd2100a8f90 2024-01-22T05:07:49.572 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:07:49.572 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":34,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4066204164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":4066204164},{"type":"v1","addr":"172.21.15.110:6835","nonce":4066204164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/3793850760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3793850760},{"type":"v1","addr":"172.21.15.110:6834","nonce":3793850760}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/331321155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":331321155},{"type":"v1","addr":"172.21.15.49:6837","nonce":331321155}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-01-22T05:05:42.747172+0000","modified":"2024-01-22T05:07:30.547619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":31,"addr":"172.21.15.49:6836/3211151680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3211151680},{"type":"v1","addr":"172.21.15.49:6836","nonce":3211151680}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-22T05:07:49.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.573+0000 7fd217e00700 1 -- 172.21.15.49:0/1920074215 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd1e805a510 msgr2=0x7fd1e805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:49.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.573+0000 7fd217e00700 1 --2- 172.21.15.49:0/1920074215 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd1e805a510 0x7fd1e805c9d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fd200006e00 tx=0x7fd200017000).stop 2024-01-22T05:07:49.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.573+0000 7fd217e00700 1 -- 172.21.15.49:0/1920074215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2100a8f90 msgr2=0x7fd21014e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:49.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.573+0000 7fd217e00700 1 --2- 172.21.15.49:0/1920074215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2100a8f90 0x7fd21014e890 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fd20800c6e0 tx=0x7fd208007f90).stop 2024-01-22T05:07:49.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.573+0000 7fd217e00700 1 -- 172.21.15.49:0/1920074215 shutdown_connections 2024-01-22T05:07:49.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.573+0000 7fd217e00700 1 --2- 172.21.15.49:0/1920074215 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd1e805a510 0x7fd1e805c9d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.573+0000 7fd217e00700 1 --2- 172.21.15.49:0/1920074215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2100a8f90 0x7fd21014e890 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.573+0000 7fd217e00700 1 --2- 172.21.15.49:0/1920074215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2100a8b10 0x7fd21014e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.573+0000 7fd217e00700 1 --2- 172.21.15.49:0/1920074215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd210066fb0 0x7fd210167f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.573+0000 7fd217e00700 1 -- 172.21.15.49:0/1920074215 >> 172.21.15.49:0/1920074215 conn(0x7fd2100c6540 msgr2=0x7fd2100c32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:49.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.573+0000 7fd217e00700 1 -- 172.21.15.49:0/1920074215 shutdown_connections 2024-01-22T05:07:49.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.573+0000 7fd217e00700 1 -- 172.21.15.49:0/1920074215 wait complete. 2024-01-22T05:07:49.578 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 34 2024-01-22T05:07:49.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:07:49.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.761+0000 7f9e55c00700 1 Processor -- start 2024-01-22T05:07:49.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.761+0000 7f9e55c00700 1 -- start start 2024-01-22T05:07:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e55c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9e500c4a40 0x7f9e50062aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e55c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e50062f90 0x7f9e500bd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e55c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e500c41d0 con 0x7f9e500c4660 2024-01-22T05:07:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e55c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e50063420 con 0x7f9e500c4a40 2024-01-22T05:07:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e55c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e500c35c0 con 0x7f9e50062f90 2024-01-22T05:07:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4ea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9e500c4660 0x7f9e50068c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48476/0 (socket says 172.21.15.49:48476) 2024-01-22T05:07:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4ea00700 1 -- 172.21.15.49:0/2818708364 learned_addr learned my addr 172.21.15.49:0/2818708364 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4f400700 1 --2- 172.21.15.49:0/2818708364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e50062f90 0x7f9e500bd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4e000700 1 --2- 172.21.15.49:0/2818708364 >> v2:172.21.15.110:3300/0 conn(0x7f9e500c4a40 0x7f9e50062aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:49.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4d600700 1 -- 172.21.15.49:0/2818708364 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271842297 0 0) 0x7f9e500c41d0 con 0x7f9e500c4660 2024-01-22T05:07:49.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4d600700 1 -- 172.21.15.49:0/2818708364 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e300033f0 con 0x7f9e500c4660 2024-01-22T05:07:49.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4d600700 1 -- 172.21.15.49:0/2818708364 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 707693929 0 0) 0x7f9e300033f0 con 0x7f9e500c4660 2024-01-22T05:07:49.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4d600700 1 -- 172.21.15.49:0/2818708364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e50062f90 msgr2=0x7f9e500bd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:49.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4d600700 1 --2- 172.21.15.49:0/2818708364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e50062f90 0x7f9e500bd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4d600700 1 -- 172.21.15.49:0/2818708364 >> v2:172.21.15.110:3300/0 conn(0x7f9e500c4a40 msgr2=0x7f9e50062aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:49.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4d600700 1 --2- 172.21.15.49:0/2818708364 >> v2:172.21.15.110:3300/0 conn(0x7f9e500c4a40 0x7f9e50062aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4d600700 1 -- 172.21.15.49:0/2818708364 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e500c38a0 con 0x7f9e500c4660 2024-01-22T05:07:49.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4d600700 1 -- 172.21.15.49:0/2818708364 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f9e40001470 con 0x7f9e500c4660 2024-01-22T05:07:49.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4e000700 1 --2- 172.21.15.49:0/2818708364 >> v2:172.21.15.110:3300/0 conn(0x7f9e500c4a40 0x7f9e50062aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:49.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4d600700 1 -- 172.21.15.49:0/2818708364 >> v1:172.21.15.49:6789/0 conn(0x7f9e500c4660 legacy=0x7f9e50068c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:49.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4d600700 1 --2- 172.21.15.49:0/2818708364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e300038e0 0x7f9e30003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:49.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.765+0000 7f9e4d600700 1 --2- 172.21.15.49:0/2818708364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e50062f90 0x7f9e30004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:49.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4d600700 1 --2- 172.21.15.49:0/2818708364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e30004b80 0x7f9e30005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:49.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4d600700 1 -- 172.21.15.49:0/2818708364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e50063420 con 0x7f9e30004b80 2024-01-22T05:07:49.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4d600700 1 -- 172.21.15.49:0/2818708364 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e500c35c0 con 0x7f9e300038e0 2024-01-22T05:07:49.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4d600700 1 -- 172.21.15.49:0/2818708364 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3000b8e0 con 0x7f9e50062f90 2024-01-22T05:07:49.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4ea00700 1 --2- 172.21.15.49:0/2818708364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e300038e0 0x7f9e30003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:49.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4f400700 1 --2- 172.21.15.49:0/2818708364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e30004b80 0x7f9e30005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:49.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4e000700 1 --2- 172.21.15.49:0/2818708364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e50062f90 0x7f9e30004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:49.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4ea00700 1 -- 172.21.15.49:0/2818708364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e50062f90 msgr2=0x7f9e30004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:49.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4ea00700 1 --2- 172.21.15.49:0/2818708364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e50062f90 0x7f9e30004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4ea00700 1 -- 172.21.15.49:0/2818708364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e30004b80 msgr2=0x7f9e30005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:49.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4ea00700 1 --2- 172.21.15.49:0/2818708364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e30004b80 0x7f9e30005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4ea00700 1 -- 172.21.15.49:0/2818708364 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e300033f0 con 0x7f9e300038e0 2024-01-22T05:07:49.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4e000700 1 --2- 172.21.15.49:0/2818708364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e50062f90 0x7f9e30004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:07:49.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4ea00700 1 --2- 172.21.15.49:0/2818708364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e300038e0 0x7f9e30003d00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f9e4000c210 tx=0x7f9e40001e90).ready entity=mon.1 client_cookie=a2f392dabe90f6ff server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:49.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4d600700 1 -- 172.21.15.49:0/2818708364 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e40007a60 con 0x7f9e300038e0 2024-01-22T05:07:49.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4d600700 1 -- 172.21.15.49:0/2818708364 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4000cae0 con 0x7f9e300038e0 2024-01-22T05:07:49.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4d600700 1 -- 172.21.15.49:0/2818708364 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4000cea0 con 0x7f9e300038e0 2024-01-22T05:07:49.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e55c00700 1 -- 172.21.15.49:0/2818708364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e300038e0 msgr2=0x7f9e30003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:49.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e55c00700 1 --2- 172.21.15.49:0/2818708364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e300038e0 0x7f9e30003d00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f9e4000c210 tx=0x7f9e40001e90).stop 2024-01-22T05:07:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e4f400700 1 -- 172.21.15.49:0/2818708364 reap_dead start 2024-01-22T05:07:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e55c00700 1 -- 172.21.15.49:0/2818708364 shutdown_connections 2024-01-22T05:07:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.769+0000 7f9e55c00700 1 -- 172.21.15.49:0/2818708364 >> 172.21.15.49:0/2818708364 conn(0x7f9e500c51c0 msgr2=0x7f9e500c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.773+0000 7f9e55c00700 1 -- 172.21.15.49:0/2818708364 shutdown_connections 2024-01-22T05:07:49.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.773+0000 7f9e55c00700 1 -- 172.21.15.49:0/2818708364 wait complete. 2024-01-22T05:07:49.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.773+0000 7f9e55c00700 1 Processor -- start 2024-01-22T05:07:49.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.773+0000 7f9e55c00700 1 -- start start 2024-01-22T05:07:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e55c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e300038e0 0x7f9e50168010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e55c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e501520f0 0x7f9e50152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e55c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e500ac270 0x7f9e500ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e55c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e50159120 con 0x7f9e300038e0 2024-01-22T05:07:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e55c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e50158230 con 0x7f9e501520f0 2024-01-22T05:07:49.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e55c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e50158510 con 0x7f9e500ac270 2024-01-22T05:07:49.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e4ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e300038e0 0x7f9e50168010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:49.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e4ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e300038e0 0x7f9e50168010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45142/0 (socket says 172.21.15.49:45142) 2024-01-22T05:07:49.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e4ea00700 1 -- 172.21.15.49:0/92007560 learned_addr learned my addr 172.21.15.49:0/92007560 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:49.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e4e000700 1 --2- 172.21.15.49:0/92007560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e501520f0 0x7f9e50152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:49.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e4f400700 1 --2- 172.21.15.49:0/92007560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e500ac270 0x7f9e500ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:49.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e4ea00700 1 -- 172.21.15.49:0/92007560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e500ac270 msgr2=0x7f9e500ac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:49.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e4ea00700 1 --2- 172.21.15.49:0/92007560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e500ac270 0x7f9e500ac6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e4ea00700 1 -- 172.21.15.49:0/92007560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e501520f0 msgr2=0x7f9e50152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:49.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e4ea00700 1 --2- 172.21.15.49:0/92007560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e501520f0 0x7f9e50152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e4ea00700 1 -- 172.21.15.49:0/92007560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e501587f0 con 0x7f9e300038e0 2024-01-22T05:07:49.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e4ea00700 1 --2- 172.21.15.49:0/92007560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e300038e0 0x7f9e50168010 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f9e30004510 tx=0x7f9e40015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:49.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e46000700 1 -- 172.21.15.49:0/92007560 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e40001430 con 0x7f9e300038e0 2024-01-22T05:07:49.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e46000700 1 -- 172.21.15.49:0/92007560 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e400046b0 con 0x7f9e300038e0 2024-01-22T05:07:49.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e55c00700 1 -- 172.21.15.49:0/92007560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e50158ad0 con 0x7f9e300038e0 2024-01-22T05:07:49.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.777+0000 7f9e46000700 1 -- 172.21.15.49:0/92007560 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e40004a70 con 0x7f9e300038e0 2024-01-22T05:07:49.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.781+0000 7f9e55c00700 1 -- 172.21.15.49:0/92007560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e50168500 con 0x7f9e300038e0 2024-01-22T05:07:49.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.781+0000 7f9e55c00700 1 -- 172.21.15.49:0/92007560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e50168690 con 0x7f9e300038e0 2024-01-22T05:07:49.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.781+0000 7f9e46000700 1 -- 172.21.15.49:0/92007560 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9e40020450 con 0x7f9e300038e0 2024-01-22T05:07:49.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.785+0000 7f9e46000700 1 --2- 172.21.15.49:0/92007560 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9e2805a510 0x7f9e2805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:49.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.785+0000 7f9e46000700 1 -- 172.21.15.49:0/92007560 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f9e40075540 con 0x7f9e300038e0 2024-01-22T05:07:49.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.785+0000 7f9e4e000700 1 --2- 172.21.15.49:0/92007560 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9e2805a510 0x7f9e2805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:49.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.785+0000 7f9e4e000700 1 --2- 172.21.15.49:0/92007560 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9e2805a510 0x7f9e2805c9d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f9e50151260 tx=0x7f9e38008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:49.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.789+0000 7f9e46000700 1 -- 172.21.15.49:0/92007560 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9e50168690 con 0x7f9e300038e0 2024-01-22T05:07:49.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.953+0000 7f9e55c00700 1 -- 172.21.15.49:0/92007560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e50168690 con 0x7f9e300038e0 2024-01-22T05:07:49.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.953+0000 7f9e46000700 1 -- 172.21.15.49:0/92007560 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+17372 (secure 0 0 0) 0x7f9e50168690 con 0x7f9e300038e0 2024-01-22T05:07:49.957 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:07:49.957 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":44,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:07:21.104311+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:05:40.764447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-01-22T05:05:41.767543+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.35","mappings":[{"from":5,"to":0}]},{"pgid":"7.2a","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:07:49.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.961+0000 7f9e55c00700 1 -- 172.21.15.49:0/92007560 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9e2805a510 msgr2=0x7f9e2805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:49.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.961+0000 7f9e55c00700 1 --2- 172.21.15.49:0/92007560 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9e2805a510 0x7f9e2805c9d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f9e50151260 tx=0x7f9e38008040).stop 2024-01-22T05:07:49.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.961+0000 7f9e55c00700 1 -- 172.21.15.49:0/92007560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e300038e0 msgr2=0x7f9e50168010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:49.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.961+0000 7f9e55c00700 1 --2- 172.21.15.49:0/92007560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e300038e0 0x7f9e50168010 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f9e30004510 tx=0x7f9e40015000).stop 2024-01-22T05:07:49.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.961+0000 7f9e55c00700 1 -- 172.21.15.49:0/92007560 shutdown_connections 2024-01-22T05:07:49.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.961+0000 7f9e55c00700 1 --2- 172.21.15.49:0/92007560 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9e2805a510 0x7f9e2805c9d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.961+0000 7f9e55c00700 1 --2- 172.21.15.49:0/92007560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e500ac270 0x7f9e500ac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.961+0000 7f9e55c00700 1 --2- 172.21.15.49:0/92007560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e501520f0 0x7f9e50152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.961+0000 7f9e55c00700 1 --2- 172.21.15.49:0/92007560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e300038e0 0x7f9e50168010 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:49.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.961+0000 7f9e55c00700 1 -- 172.21.15.49:0/92007560 >> 172.21.15.49:0/92007560 conn(0x7f9e500c51c0 msgr2=0x7f9e500bd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:49.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.961+0000 7f9e55c00700 1 -- 172.21.15.49:0/92007560 shutdown_connections 2024-01-22T05:07:49.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:49.961+0000 7f9e55c00700 1 -- 172.21.15.49:0/92007560 wait complete. 2024-01-22T05:07:49.984 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:07:50.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.145+0000 7fa80c600700 1 Processor -- start 2024-01-22T05:07:50.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.145+0000 7fa80c600700 1 -- start start 2024-01-22T05:07:50.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.149+0000 7fa80c600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa804151d70 0x7fa8040be360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:50.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.149+0000 7fa80c600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8040bf4f0 con 0x7fa804151990 2024-01-22T05:07:50.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.149+0000 7fa80c600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa804067e00 con 0x7fa8040be850 2024-01-22T05:07:50.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.149+0000 7fa80c600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8040ab8b0 con 0x7fa804151d70 2024-01-22T05:07:50.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.149+0000 7fa809200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa804151d70 0x7fa8040be360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:50.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.149+0000 7fa809c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa804151990 0x7fa8040684a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48492/0 (socket says 172.21.15.49:48492) 2024-01-22T05:07:50.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.149+0000 7fa809c00700 1 -- 172.21.15.49:0/1393838182 learned_addr learned my addr 172.21.15.49:0/1393838182 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:50.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.153+0000 7fa803e00700 1 -- 172.21.15.49:0/1393838182 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058087204 0 0) 0x7fa804067e00 con 0x7fa8040be850 2024-01-22T05:07:50.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.153+0000 7fa803e00700 1 -- 172.21.15.49:0/1393838182 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7e40033f0 con 0x7fa8040be850 2024-01-22T05:07:50.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.153+0000 7fa809200700 1 -- 172.21.15.49:0/1393838182 >> v1:172.21.15.110:6789/0 conn(0x7fa8040be850 legacy=0x7fa8040a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:50.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.153+0000 7fa809200700 1 -- 172.21.15.49:0/1393838182 >> v1:172.21.15.49:6789/0 conn(0x7fa804151990 legacy=0x7fa8040684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:50.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.153+0000 7fa803e00700 1 -- 172.21.15.49:0/1393838182 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728933464 0 0) 0x7fa8040bf4f0 con 0x7fa804151990 2024-01-22T05:07:50.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.153+0000 7fa809200700 1 -- 172.21.15.49:0/1393838182 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8040680e0 con 0x7fa804151d70 2024-01-22T05:07:50.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.153+0000 7fa809200700 1 --2- 172.21.15.49:0/1393838182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa804151d70 0x7fa8040be360 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fa7ec009760 tx=0x7fa7ec009060).ready entity=mon.0 client_cookie=d12e921a4c3d3238 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:50.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.153+0000 7fa803e00700 1 -- 172.21.15.49:0/1393838182 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec00f510 con 0x7fa804151d70 2024-01-22T05:07:50.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.153+0000 7fa803e00700 1 -- 172.21.15.49:0/1393838182 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec00f670 con 0x7fa804151d70 2024-01-22T05:07:50.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.153+0000 7fa803e00700 1 -- 172.21.15.49:0/1393838182 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec00f9f0 con 0x7fa804151d70 2024-01-22T05:07:50.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.153+0000 7fa80c600700 1 -- 172.21.15.49:0/1393838182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa804151d70 msgr2=0x7fa8040be360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:50.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.153+0000 7fa80c600700 1 --2- 172.21.15.49:0/1393838182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa804151d70 0x7fa8040be360 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fa7ec009760 tx=0x7fa7ec009060).stop 2024-01-22T05:07:50.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.153+0000 7fa80c600700 1 -- 172.21.15.49:0/1393838182 shutdown_connections 2024-01-22T05:07:50.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.153+0000 7fa80c600700 1 --2- 172.21.15.49:0/1393838182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa804151d70 0x7fa8040be360 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:50.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.153+0000 7fa80c600700 1 -- 172.21.15.49:0/1393838182 >> 172.21.15.49:0/1393838182 conn(0x7fa8040c5860 msgr2=0x7fa8040c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:50.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.157+0000 7fa80c600700 1 -- 172.21.15.49:0/1393838182 shutdown_connections 2024-01-22T05:07:50.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.157+0000 7fa80c600700 1 -- 172.21.15.49:0/1393838182 wait complete. 2024-01-22T05:07:50.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.157+0000 7fa80c600700 1 Processor -- start 2024-01-22T05:07:50.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.157+0000 7fa80c600700 1 -- start start 2024-01-22T05:07:50.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa80c600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8040be850 0x7fa80414db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:50.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa80c600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa804151990 0x7fa8040ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:50.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa80c600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa804151d70 0x7fa8041542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:50.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa80c600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c1d80 con 0x7fa804151990 2024-01-22T05:07:50.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa80c600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c1170 con 0x7fa8040be850 2024-01-22T05:07:50.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa80c600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c1450 con 0x7fa804151d70 2024-01-22T05:07:50.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa809200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa804151990 0x7fa8040ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:50.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa809200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa804151990 0x7fa8040ae7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45150/0 (socket says 172.21.15.49:45150) 2024-01-22T05:07:50.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa809200700 1 -- 172.21.15.49:0/41607192 learned_addr learned my addr 172.21.15.49:0/41607192 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:50.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa809c00700 1 --2- 172.21.15.49:0/41607192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8040be850 0x7fa80414db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:50.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa80b000700 1 --2- 172.21.15.49:0/41607192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa804151d70 0x7fa8041542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:50.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa809200700 1 -- 172.21.15.49:0/41607192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa804151d70 msgr2=0x7fa8041542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:50.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa809200700 1 --2- 172.21.15.49:0/41607192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa804151d70 0x7fa8041542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:50.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa809200700 1 -- 172.21.15.49:0/41607192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8040be850 msgr2=0x7fa80414db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:50.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa809200700 1 --2- 172.21.15.49:0/41607192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8040be850 0x7fa80414db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:50.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa809200700 1 -- 172.21.15.49:0/41607192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec0092a0 con 0x7fa804151990 2024-01-22T05:07:50.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa809200700 1 --2- 172.21.15.49:0/41607192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa804151990 0x7fa8040ae7a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fa804067390 tx=0x7fa7ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:50.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa800c00700 1 -- 172.21.15.49:0/41607192 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec00fe80 con 0x7fa804151990 2024-01-22T05:07:50.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa800c00700 1 -- 172.21.15.49:0/41607192 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec00f7e0 con 0x7fa804151990 2024-01-22T05:07:50.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa80c600700 1 -- 172.21.15.49:0/41607192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8040c1730 con 0x7fa804151990 2024-01-22T05:07:50.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.161+0000 7fa800c00700 1 -- 172.21.15.49:0/41607192 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec01b670 con 0x7fa804151990 2024-01-22T05:07:50.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.165+0000 7fa80c600700 1 -- 172.21.15.49:0/41607192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80414e070 con 0x7fa804151990 2024-01-22T05:07:50.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.165+0000 7fa80c600700 1 -- 172.21.15.49:0/41607192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8040c1bb0 con 0x7fa804151990 2024-01-22T05:07:50.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.165+0000 7fa800c00700 1 -- 172.21.15.49:0/41607192 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa7ec01b9e0 con 0x7fa804151990 2024-01-22T05:07:50.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.169+0000 7fa800c00700 1 --2- 172.21.15.49:0/41607192 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7dc05a510 0x7fa7dc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:50.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.169+0000 7fa800c00700 1 -- 172.21.15.49:0/41607192 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6589+0+0 (secure 0 0 0) 0x7fa7ec076080 con 0x7fa804151990 2024-01-22T05:07:50.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.169+0000 7fa809c00700 1 --2- 172.21.15.49:0/41607192 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7dc05a510 0x7fa7dc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:50.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.169+0000 7fa809c00700 1 --2- 172.21.15.49:0/41607192 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7dc05a510 0x7fa7dc05c9d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fa7f40011e0 tx=0x7fa7f4007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:50.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.173+0000 7fa800c00700 1 -- 172.21.15.49:0/41607192 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa7ec049650 con 0x7fa804151990 2024-01-22T05:07:50.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.381+0000 7fa80c600700 1 -- 172.21.15.49:0/41607192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa8040bf180 con 0x7fa804151990 2024-01-22T05:07:50.427 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:07:50.425+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:07:50.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.437+0000 7fa800c00700 1 -- 172.21.15.49:0/41607192 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa7ec006b30 con 0x7fa804151990 2024-01-22T05:07:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.441+0000 7fa80c600700 1 -- 172.21.15.49:0/41607192 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7dc05a510 msgr2=0x7fa7dc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.441+0000 7fa80c600700 1 --2- 172.21.15.49:0/41607192 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7dc05a510 0x7fa7dc05c9d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fa7f40011e0 tx=0x7fa7f4007bb0).stop 2024-01-22T05:07:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.441+0000 7fa80c600700 1 -- 172.21.15.49:0/41607192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa804151990 msgr2=0x7fa8040ae7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.441+0000 7fa80c600700 1 --2- 172.21.15.49:0/41607192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa804151990 0x7fa8040ae7a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fa804067390 tx=0x7fa7ec017000).stop 2024-01-22T05:07:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.441+0000 7fa80c600700 1 -- 172.21.15.49:0/41607192 shutdown_connections 2024-01-22T05:07:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.441+0000 7fa80c600700 1 --2- 172.21.15.49:0/41607192 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7dc05a510 0x7fa7dc05c9d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.441+0000 7fa80c600700 1 --2- 172.21.15.49:0/41607192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa804151d70 0x7fa8041542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.441+0000 7fa80c600700 1 --2- 172.21.15.49:0/41607192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa804151990 0x7fa8040ae7a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.441+0000 7fa80c600700 1 --2- 172.21.15.49:0/41607192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8040be850 0x7fa80414db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.441+0000 7fa80c600700 1 -- 172.21.15.49:0/41607192 >> 172.21.15.49:0/41607192 conn(0x7fa8040c5860 msgr2=0x7fa804150980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.445+0000 7fa80c600700 1 -- 172.21.15.49:0/41607192 shutdown_connections 2024-01-22T05:07:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.445+0000 7fa80c600700 1 -- 172.21.15.49:0/41607192 wait complete. 2024-01-22T05:07:50.448 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:07:50.468 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:07:50.511 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:07:50.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.625+0000 7fbad9e00700 1 Processor -- start 2024-01-22T05:07:50.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.625+0000 7fbad9e00700 1 -- start start 2024-01-22T05:07:50.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.629+0000 7fbad9e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbad40c6720 0x7fbad40c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:50.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.629+0000 7fbad9e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbad4068ca0 0x7fbad40c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:50.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.629+0000 7fbad9e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbad4069100 0x7fbad40c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:50.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.629+0000 7fbad9e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad40c7530 con 0x7fbad4068ca0 2024-01-22T05:07:50.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.629+0000 7fbad9e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad4068810 con 0x7fbad40c6720 2024-01-22T05:07:50.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.629+0000 7fbad9e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40c3640 con 0x7fbad4069100 2024-01-22T05:07:50.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.629+0000 7fbad2000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbad4068ca0 0x7fbad40c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:50.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.629+0000 7fbad2000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbad4068ca0 0x7fbad40c6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45176/0 (socket says 172.21.15.49:45176) 2024-01-22T05:07:50.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.629+0000 7fbad2000700 1 -- 172.21.15.49:0/30864611 learned_addr learned my addr 172.21.15.49:0/30864611 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:50.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.629+0000 7fbad3400700 1 --2- 172.21.15.49:0/30864611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbad4069100 0x7fbad40c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:50.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.629+0000 7fbad2a00700 1 --2- 172.21.15.49:0/30864611 >> v2:172.21.15.110:3300/0 conn(0x7fbad40c6720 0x7fbad40c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:50.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad2000700 1 -- 172.21.15.49:0/30864611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbad4069100 msgr2=0x7fbad40c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:50.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad2000700 1 --2- 172.21.15.49:0/30864611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbad4069100 0x7fbad40c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:50.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad2000700 1 -- 172.21.15.49:0/30864611 >> v2:172.21.15.110:3300/0 conn(0x7fbad40c6720 msgr2=0x7fbad40c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:50.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad2000700 1 --2- 172.21.15.49:0/30864611 >> v2:172.21.15.110:3300/0 conn(0x7fbad40c6720 0x7fbad40c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:50.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad2000700 1 -- 172.21.15.49:0/30864611 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40c3920 con 0x7fbad4068ca0 2024-01-22T05:07:50.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad2000700 1 --2- 172.21.15.49:0/30864611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad4068ca0 0x7fbad40c6b50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fbad4066c40 tx=0x7fbabc0090f0).ready entity=mon.0 client_cookie=f743763bff04b11c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:50.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad1600700 1 -- 172.21.15.49:0/30864611 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc00f510 con 0x7fbad4068ca0 2024-01-22T05:07:50.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad1600700 1 -- 172.21.15.49:0/30864611 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc00f670 con 0x7fbad4068ca0 2024-01-22T05:07:50.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad1600700 1 -- 172.21.15.49:0/30864611 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc00f9f0 con 0x7fbad4068ca0 2024-01-22T05:07:50.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad9e00700 1 -- 172.21.15.49:0/30864611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad4068ca0 msgr2=0x7fbad40c6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:50.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad9e00700 1 --2- 172.21.15.49:0/30864611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad4068ca0 0x7fbad40c6b50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fbad4066c40 tx=0x7fbabc0090f0).stop 2024-01-22T05:07:50.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad9e00700 1 -- 172.21.15.49:0/30864611 shutdown_connections 2024-01-22T05:07:50.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad9e00700 1 --2- 172.21.15.49:0/30864611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbad4069100 0x7fbad40c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:50.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad9e00700 1 --2- 172.21.15.49:0/30864611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad4068ca0 0x7fbad40c6b50 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:50.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad9e00700 1 --2- 172.21.15.49:0/30864611 >> v2:172.21.15.110:3300/0 conn(0x7fbad40c6720 0x7fbad40c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:50.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad9e00700 1 -- 172.21.15.49:0/30864611 >> 172.21.15.49:0/30864611 conn(0x7fbad40c5160 msgr2=0x7fbad40c5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:50.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad9e00700 1 -- 172.21.15.49:0/30864611 shutdown_connections 2024-01-22T05:07:50.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.633+0000 7fbad9e00700 1 -- 172.21.15.49:0/30864611 wait complete. 2024-01-22T05:07:50.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.637+0000 7fbad9e00700 1 Processor -- start 2024-01-22T05:07:50.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad9e00700 1 -- start start 2024-01-22T05:07:50.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad9e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbad4068ca0 0x7fbad4164b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:50.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad9e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbad4069100 0x7fbad414dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:50.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad9e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad40c6720 0x7fbad414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:50.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad9e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad4165040 con 0x7fbad40c6720 2024-01-22T05:07:50.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad9e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad414e6b0 con 0x7fbad4068ca0 2024-01-22T05:07:50.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad9e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad413fa20 con 0x7fbad4069100 2024-01-22T05:07:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad40c6720 0x7fbad414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad40c6720 0x7fbad414e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45182/0 (socket says 172.21.15.49:45182) 2024-01-22T05:07:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad3400700 1 -- 172.21.15.49:0/3400484630 learned_addr learned my addr 172.21.15.49:0/3400484630 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad2000700 1 --2- 172.21.15.49:0/3400484630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbad4069100 0x7fbad414dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad2a00700 1 --2- 172.21.15.49:0/3400484630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbad4068ca0 0x7fbad4164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad3400700 1 -- 172.21.15.49:0/3400484630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbad4069100 msgr2=0x7fbad414dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:50.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad3400700 1 --2- 172.21.15.49:0/3400484630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbad4069100 0x7fbad414dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:50.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad3400700 1 -- 172.21.15.49:0/3400484630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbad4068ca0 msgr2=0x7fbad4164b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:50.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad3400700 1 --2- 172.21.15.49:0/3400484630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbad4068ca0 0x7fbad4164b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:50.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad3400700 1 -- 172.21.15.49:0/3400484630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc009370 con 0x7fbad40c6720 2024-01-22T05:07:50.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.641+0000 7fbad3400700 1 --2- 172.21.15.49:0/3400484630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad40c6720 0x7fbad414e1c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fbacc009ef0 tx=0x7fbacc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:50.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.645+0000 7fbaca000700 1 -- 172.21.15.49:0/3400484630 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc00cb70 con 0x7fbad40c6720 2024-01-22T05:07:50.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.645+0000 7fbaca000700 1 -- 172.21.15.49:0/3400484630 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc00f040 con 0x7fbad40c6720 2024-01-22T05:07:50.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.645+0000 7fbad9e00700 1 -- 172.21.15.49:0/3400484630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad40c0d60 con 0x7fbad40c6720 2024-01-22T05:07:50.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.645+0000 7fbaca000700 1 -- 172.21.15.49:0/3400484630 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc013400 con 0x7fbad40c6720 2024-01-22T05:07:50.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.645+0000 7fbad9e00700 1 -- 172.21.15.49:0/3400484630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad4150ce0 con 0x7fbad40c6720 2024-01-22T05:07:50.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.645+0000 7fbad9e00700 1 -- 172.21.15.49:0/3400484630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad40c0ef0 con 0x7fbad40c6720 2024-01-22T05:07:50.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.649+0000 7fbaca000700 1 -- 172.21.15.49:0/3400484630 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbacc0137b0 con 0x7fbad40c6720 2024-01-22T05:07:50.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.649+0000 7fbaca000700 1 --2- 172.21.15.49:0/3400484630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbaac05a510 0x7fbaac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:50.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.649+0000 7fbaca000700 1 -- 172.21.15.49:0/3400484630 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6647+0+0 (secure 0 0 0) 0x7fbacc0752a0 con 0x7fbad40c6720 2024-01-22T05:07:50.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.649+0000 7fbad2a00700 1 --2- 172.21.15.49:0/3400484630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbaac05a510 0x7fbaac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:50.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.649+0000 7fbad2a00700 1 --2- 172.21.15.49:0/3400484630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbaac05a510 0x7fbaac05c9d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fbac4009c30 tx=0x7fbac4009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:50.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.657+0000 7fbaca000700 1 -- 172.21.15.49:0/3400484630 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbacc0487b0 con 0x7fbad40c6720 2024-01-22T05:07:50.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:50.861+0000 7fbad9e00700 1 -- 172.21.15.49:0/3400484630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbad405f600 con 0x7fbad40c6720 2024-01-22T05:07:51.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.441+0000 7fbaca000700 1 -- 172.21.15.49:0/3400484630 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbacc04bdd0 con 0x7fbad40c6720 2024-01-22T05:07:51.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.445+0000 7fbad9e00700 1 -- 172.21.15.49:0/3400484630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbaac05a510 msgr2=0x7fbaac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.445+0000 7fbad9e00700 1 --2- 172.21.15.49:0/3400484630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbaac05a510 0x7fbaac05c9d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fbac4009c30 tx=0x7fbac4009060).stop 2024-01-22T05:07:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.445+0000 7fbad9e00700 1 -- 172.21.15.49:0/3400484630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad40c6720 msgr2=0x7fbad414e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.445+0000 7fbad9e00700 1 --2- 172.21.15.49:0/3400484630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad40c6720 0x7fbad414e1c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fbacc009ef0 tx=0x7fbacc00b040).stop 2024-01-22T05:07:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.449+0000 7fbad9e00700 1 -- 172.21.15.49:0/3400484630 shutdown_connections 2024-01-22T05:07:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.449+0000 7fbad9e00700 1 --2- 172.21.15.49:0/3400484630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbaac05a510 0x7fbaac05c9d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.449+0000 7fbad9e00700 1 --2- 172.21.15.49:0/3400484630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad40c6720 0x7fbad414e1c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.449+0000 7fbad9e00700 1 --2- 172.21.15.49:0/3400484630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbad4069100 0x7fbad414dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:51.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.449+0000 7fbad9e00700 1 --2- 172.21.15.49:0/3400484630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbad4068ca0 0x7fbad4164b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:51.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.449+0000 7fbad9e00700 1 -- 172.21.15.49:0/3400484630 >> 172.21.15.49:0/3400484630 conn(0x7fbad40c5160 msgr2=0x7fbad40bebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:51.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.449+0000 7fbad9e00700 1 -- 172.21.15.49:0/3400484630 shutdown_connections 2024-01-22T05:07:51.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.449+0000 7fbad9e00700 1 -- 172.21.15.49:0/3400484630 wait complete. 2024-01-22T05:07:51.474 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:07:51.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.689+0000 7f139e600700 1 Processor -- start 2024-01-22T05:07:51.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.689+0000 7f139e600700 1 -- start start 2024-01-22T05:07:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f139e600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1398069c70 0x7f13980bcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f139e600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f13980bd3d0 0x7f1398063cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f139e600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1398064690 con 0x7f13980641e0 2024-01-22T05:07:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f139e600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13980680b0 con 0x7f13980bd3d0 2024-01-22T05:07:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f139e600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13980697e0 con 0x7f1398069c70 2024-01-22T05:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f1397e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f13980bd3d0 0x7f1398063cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f1397e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f13980bd3d0 0x7f1398063cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45190/0 (socket says 172.21.15.49:45190) 2024-01-22T05:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f1397e00700 1 -- 172.21.15.49:0/3256006984 learned_addr learned my addr 172.21.15.49:0/3256006984 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f139d200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1398069c70 0x7f13980bcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f139d200700 1 -- 172.21.15.49:0/3256006984 >> v2:172.21.15.49:3300/0 conn(0x7f13980bd3d0 msgr2=0x7f1398063cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f139d200700 1 --2- 172.21.15.49:0/3256006984 >> v2:172.21.15.49:3300/0 conn(0x7f13980bd3d0 0x7f1398063cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f139d200700 1 -- 172.21.15.49:0/3256006984 >> v1:172.21.15.110:6789/0 conn(0x7f13980641e0 legacy=0x7f1398157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f139d200700 1 -- 172.21.15.49:0/3256006984 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13980bd830 con 0x7f1398069c70 2024-01-22T05:07:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f1397e00700 1 --2- 172.21.15.49:0/3256006984 >> v2:172.21.15.49:3300/0 conn(0x7f13980bd3d0 0x7f1398063cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f139d200700 1 --2- 172.21.15.49:0/3256006984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1398069c70 0x7f13980bcee0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f1388009760 tx=0x7f1388009060).ready entity=mon.2 client_cookie=6d6f079172f95d0e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:51.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f1397400700 1 -- 172.21.15.49:0/3256006984 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138800f510 con 0x7f1398069c70 2024-01-22T05:07:51.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.693+0000 7f1397400700 1 -- 172.21.15.49:0/3256006984 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138800f670 con 0x7f1398069c70 2024-01-22T05:07:51.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.697+0000 7f1397400700 1 -- 172.21.15.49:0/3256006984 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138800f9f0 con 0x7f1398069c70 2024-01-22T05:07:51.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.697+0000 7f139e600700 1 -- 172.21.15.49:0/3256006984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1398069c70 msgr2=0x7f13980bcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:51.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.697+0000 7f139e600700 1 --2- 172.21.15.49:0/3256006984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1398069c70 0x7f13980bcee0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f1388009760 tx=0x7f1388009060).stop 2024-01-22T05:07:51.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.697+0000 7f139e600700 1 -- 172.21.15.49:0/3256006984 shutdown_connections 2024-01-22T05:07:51.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.697+0000 7f139e600700 1 --2- 172.21.15.49:0/3256006984 >> v2:172.21.15.49:3300/0 conn(0x7f13980bd3d0 0x7f1398063cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.697+0000 7f139e600700 1 --2- 172.21.15.49:0/3256006984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1398069c70 0x7f13980bcee0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.697+0000 7f139e600700 1 -- 172.21.15.49:0/3256006984 >> 172.21.15.49:0/3256006984 conn(0x7f13980627d0 msgr2=0x7f1398062bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.697+0000 7f139e600700 1 -- 172.21.15.49:0/3256006984 shutdown_connections 2024-01-22T05:07:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.697+0000 7f139e600700 1 -- 172.21.15.49:0/3256006984 wait complete. 2024-01-22T05:07:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.697+0000 7f139e600700 1 Processor -- start 2024-01-22T05:07:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139e600700 1 -- start start 2024-01-22T05:07:51.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139e600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13980641e0 0x7f13980a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:51.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139e600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1398069c70 0x7f13980a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:51.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139e600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13980bd3d0 0x7f1398167130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:51.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139e600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13981689a0 con 0x7f13980641e0 2024-01-22T05:07:51.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139e600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13980a6e20 con 0x7f1398069c70 2024-01-22T05:07:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139e600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1398165630 con 0x7f13980bd3d0 2024-01-22T05:07:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139d200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13980641e0 0x7f13980a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139d200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13980641e0 0x7f13980a8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45198/0 (socket says 172.21.15.49:45198) 2024-01-22T05:07:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139d200700 1 -- 172.21.15.49:0/862574919 learned_addr learned my addr 172.21.15.49:0/862574919 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f1397e00700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1398069c70 0x7f13980a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139dc00700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13980bd3d0 0x7f1398167130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139d200700 1 -- 172.21.15.49:0/862574919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13980bd3d0 msgr2=0x7f1398167130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139d200700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13980bd3d0 0x7f1398167130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:51.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139d200700 1 -- 172.21.15.49:0/862574919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1398069c70 msgr2=0x7f13980a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:51.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139d200700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1398069c70 0x7f13980a6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:51.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139d200700 1 -- 172.21.15.49:0/862574919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1380009370 con 0x7f13980641e0 2024-01-22T05:07:51.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f1397e00700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1398069c70 0x7f13980a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:07:51.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139dc00700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13980bd3d0 0x7f1398167130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:07:51.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f139d200700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13980641e0 0x7f13980a8f50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f1398069920 tx=0x7f1388017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:51.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f138fe00700 1 -- 172.21.15.49:0/862574919 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138800f7e0 con 0x7f13980641e0 2024-01-22T05:07:51.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f138fe00700 1 -- 172.21.15.49:0/862574919 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138800f940 con 0x7f13980641e0 2024-01-22T05:07:51.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.701+0000 7f138fe00700 1 -- 172.21.15.49:0/862574919 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138801b660 con 0x7f13980641e0 2024-01-22T05:07:51.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.705+0000 7f139e600700 1 -- 172.21.15.49:0/862574919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13880092a0 con 0x7f13980641e0 2024-01-22T05:07:51.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.705+0000 7f139e600700 1 -- 172.21.15.49:0/862574919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13980a9870 con 0x7f13980641e0 2024-01-22T05:07:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.705+0000 7f139e600700 1 -- 172.21.15.49:0/862574919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13980655f0 con 0x7f13980641e0 2024-01-22T05:07:51.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.705+0000 7f138fe00700 1 -- 172.21.15.49:0/862574919 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f138801ba90 con 0x7f13980641e0 2024-01-22T05:07:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.705+0000 7f138fe00700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f137005a510 0x7f137005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.709+0000 7f138fe00700 1 -- 172.21.15.49:0/862574919 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6647+0+0 (secure 0 0 0) 0x7f1388076720 con 0x7f13980641e0 2024-01-22T05:07:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.709+0000 7f1397e00700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f137005a510 0x7f137005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.709+0000 7f1397e00700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f137005a510 0x7f137005c9d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f1380009340 tx=0x7f1380008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.717+0000 7f138fe00700 1 -- 172.21.15.49:0/862574919 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1388049c30 con 0x7f13980641e0 2024-01-22T05:07:51.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:51.885+0000 7f139e600700 1 -- 172.21.15.49:0/862574919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f13980ad5e0 con 0x7f13980641e0 2024-01-22T05:07:52.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.449+0000 7f138fe00700 1 -- 172.21.15.49:0/862574919 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v46) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1388028020 con 0x7f13980641e0 2024-01-22T05:07:52.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.453+0000 7f139e600700 1 -- 172.21.15.49:0/862574919 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f137005a510 msgr2=0x7f137005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:52.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.453+0000 7f139e600700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f137005a510 0x7f137005c9d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f1380009340 tx=0x7f1380008040).stop 2024-01-22T05:07:52.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.453+0000 7f139e600700 1 -- 172.21.15.49:0/862574919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13980641e0 msgr2=0x7f13980a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:52.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.453+0000 7f139e600700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13980641e0 0x7f13980a8f50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f1398069920 tx=0x7f1388017000).stop 2024-01-22T05:07:52.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.453+0000 7f139e600700 1 -- 172.21.15.49:0/862574919 shutdown_connections 2024-01-22T05:07:52.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.453+0000 7f139e600700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f137005a510 0x7f137005c9d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:52.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.453+0000 7f139e600700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13980bd3d0 0x7f1398167130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:52.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.453+0000 7f139e600700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1398069c70 0x7f13980a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:52.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.453+0000 7f139e600700 1 --2- 172.21.15.49:0/862574919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13980641e0 0x7f13980a8f50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:52.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.453+0000 7f139e600700 1 -- 172.21.15.49:0/862574919 >> 172.21.15.49:0/862574919 conn(0x7f13980627d0 msgr2=0x7f1398157ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:52.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.453+0000 7f139e600700 1 -- 172.21.15.49:0/862574919 shutdown_connections 2024-01-22T05:07:52.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.453+0000 7f139e600700 1 -- 172.21.15.49:0/862574919 wait complete. 2024-01-22T05:07:52.460 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:07:52.478 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:07:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.641+0000 7fa0c7000700 1 Processor -- start 2024-01-22T05:07:52.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.641+0000 7fa0c7000700 1 -- start start 2024-01-22T05:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.645+0000 7fa0c7000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa0c00c4df0 0x7fa0c00c5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.645+0000 7fa0c7000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0c00c1c00 0x7fa0c00c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.645+0000 7fa0c7000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c00c1770 con 0x7fa0c0068470 2024-01-22T05:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.645+0000 7fa0c7000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c0154100 con 0x7fa0c00c4df0 2024-01-22T05:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.645+0000 7fa0c7000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00c5740 con 0x7fa0c00c1c00 2024-01-22T05:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0bf400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa0c00c4df0 0x7fa0c00c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0bfe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa0c0068470 0x7fa0c01539f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48510/0 (socket says 172.21.15.49:48510) 2024-01-22T05:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0bfe00700 1 -- 172.21.15.49:0/2027330353 learned_addr learned my addr 172.21.15.49:0/2027330353 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0c5000700 1 --2- 172.21.15.49:0/2027330353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0c00c1c00 0x7fa0c00c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:52.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0bf400700 1 -- 172.21.15.49:0/2027330353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0c00c1c00 msgr2=0x7fa0c00c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:52.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0bf400700 1 --2- 172.21.15.49:0/2027330353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0c00c1c00 0x7fa0c00c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:52.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0bf400700 1 -- 172.21.15.49:0/2027330353 >> v1:172.21.15.49:6789/0 conn(0x7fa0c0068470 legacy=0x7fa0c01539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:52.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0bf400700 1 -- 172.21.15.49:0/2027330353 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c00c1440 con 0x7fa0c00c4df0 2024-01-22T05:07:52.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0bf400700 1 --2- 172.21.15.49:0/2027330353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0c00c4df0 0x7fa0c00c5250 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fa0a8009760 tx=0x7fa0a8009060).ready entity=mon.0 client_cookie=879945d1210a780c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:52.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0bea00700 1 -- 172.21.15.49:0/2027330353 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a800b520 con 0x7fa0c00c4df0 2024-01-22T05:07:52.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0bea00700 1 -- 172.21.15.49:0/2027330353 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a800b680 con 0x7fa0c00c4df0 2024-01-22T05:07:52.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0bea00700 1 -- 172.21.15.49:0/2027330353 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a800ba00 con 0x7fa0c00c4df0 2024-01-22T05:07:52.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0c7000700 1 -- 172.21.15.49:0/2027330353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0c00c4df0 msgr2=0x7fa0c00c5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:52.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0c7000700 1 --2- 172.21.15.49:0/2027330353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0c00c4df0 0x7fa0c00c5250 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fa0a8009760 tx=0x7fa0a8009060).stop 2024-01-22T05:07:52.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0c7000700 1 -- 172.21.15.49:0/2027330353 shutdown_connections 2024-01-22T05:07:52.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0c7000700 1 --2- 172.21.15.49:0/2027330353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0c00c1c00 0x7fa0c00c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:52.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0c7000700 1 --2- 172.21.15.49:0/2027330353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0c00c4df0 0x7fa0c00c5250 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:52.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0c7000700 1 -- 172.21.15.49:0/2027330353 >> 172.21.15.49:0/2027330353 conn(0x7fa0c00c3420 msgr2=0x7fa0c00c3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0c7000700 1 -- 172.21.15.49:0/2027330353 shutdown_connections 2024-01-22T05:07:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.649+0000 7fa0c7000700 1 -- 172.21.15.49:0/2027330353 wait complete. 2024-01-22T05:07:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.653+0000 7fa0c7000700 1 Processor -- start 2024-01-22T05:07:52.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.653+0000 7fa0c7000700 1 -- start start 2024-01-22T05:07:52.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.653+0000 7fa0c7000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0c0068470 0x7fa0c00beea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:52.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.653+0000 7fa0c7000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0c00c1c00 0x7fa0c0142af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:52.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.653+0000 7fa0c7000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0c00c4df0 0x7fa0c00ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:52.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.653+0000 7fa0c7000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00bea10 con 0x7fa0c00c4df0 2024-01-22T05:07:52.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.653+0000 7fa0c7000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00bde00 con 0x7fa0c00c1c00 2024-01-22T05:07:52.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.653+0000 7fa0c7000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00be0e0 con 0x7fa0c0068470 2024-01-22T05:07:52.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0c5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0c00c4df0 0x7fa0c00ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:52.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0c5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0c00c4df0 0x7fa0c00ac0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45218/0 (socket says 172.21.15.49:45218) 2024-01-22T05:07:52.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0c5000700 1 -- 172.21.15.49:0/2776791728 learned_addr learned my addr 172.21.15.49:0/2776791728 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:52.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0bf400700 1 --2- 172.21.15.49:0/2776791728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0c00c1c00 0x7fa0c0142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:52.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0bfe00700 1 --2- 172.21.15.49:0/2776791728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0c0068470 0x7fa0c00beea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:52.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0c5000700 1 -- 172.21.15.49:0/2776791728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0c0068470 msgr2=0x7fa0c00beea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:52.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0c5000700 1 --2- 172.21.15.49:0/2776791728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0c0068470 0x7fa0c00beea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:52.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0c5000700 1 -- 172.21.15.49:0/2776791728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0c00c1c00 msgr2=0x7fa0c0142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:52.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0c5000700 1 --2- 172.21.15.49:0/2776791728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0c00c1c00 0x7fa0c0142af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:52.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0c5000700 1 -- 172.21.15.49:0/2776791728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a80092a0 con 0x7fa0c00c4df0 2024-01-22T05:07:52.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0c5000700 1 --2- 172.21.15.49:0/2776791728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0c00c4df0 0x7fa0c00ac0c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fa0b8009fa0 tx=0x7fa0b8009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:52.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0b7400700 1 -- 172.21.15.49:0/2776791728 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b800ebc0 con 0x7fa0c00c4df0 2024-01-22T05:07:52.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0b7400700 1 -- 172.21.15.49:0/2776791728 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b800ed20 con 0x7fa0c00c4df0 2024-01-22T05:07:52.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0c7000700 1 -- 172.21.15.49:0/2776791728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c00be3c0 con 0x7fa0c00c4df0 2024-01-22T05:07:52.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0b7400700 1 -- 172.21.15.49:0/2776791728 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8014610 con 0x7fa0c00c4df0 2024-01-22T05:07:52.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.657+0000 7fa0c7000700 1 -- 172.21.15.49:0/2776791728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c0142fe0 con 0x7fa0c00c4df0 2024-01-22T05:07:52.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.661+0000 7fa0c7000700 1 -- 172.21.15.49:0/2776791728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c00bf390 con 0x7fa0c00c4df0 2024-01-22T05:07:52.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.661+0000 7fa0b7400700 1 -- 172.21.15.49:0/2776791728 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa0b801d3b0 con 0x7fa0c00c4df0 2024-01-22T05:07:52.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.661+0000 7fa0b7400700 1 --2- 172.21.15.49:0/2776791728 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa09805a540 0x7fa09805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:52.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.661+0000 7fa0b7400700 1 -- 172.21.15.49:0/2776791728 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fa0b8074db0 con 0x7fa0c00c4df0 2024-01-22T05:07:52.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.661+0000 7fa0bfe00700 1 --2- 172.21.15.49:0/2776791728 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa09805a540 0x7fa09805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:52.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.665+0000 7fa0bfe00700 1 --2- 172.21.15.49:0/2776791728 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa09805a540 0x7fa09805ca00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fa0b0006880 tx=0x7fa0b0007d00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:52.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.669+0000 7fa0b7400700 1 -- 172.21.15.49:0/2776791728 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa0b8079070 con 0x7fa0c00c4df0 2024-01-22T05:07:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:52.837+0000 7fa0c7000700 1 -- 172.21.15.49:0/2776791728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa0c0068bf0 con 0x7fa0c00c4df0 2024-01-22T05:07:53.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.461+0000 7fa0b7400700 1 -- 172.21.15.49:0/2776791728 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa0b8048430 con 0x7fa0c00c4df0 2024-01-22T05:07:53.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.465+0000 7fa0c7000700 1 -- 172.21.15.49:0/2776791728 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa09805a540 msgr2=0x7fa09805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:53.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.465+0000 7fa0c7000700 1 --2- 172.21.15.49:0/2776791728 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa09805a540 0x7fa09805ca00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fa0b0006880 tx=0x7fa0b0007d00).stop 2024-01-22T05:07:53.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.465+0000 7fa0c7000700 1 -- 172.21.15.49:0/2776791728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0c00c4df0 msgr2=0x7fa0c00ac0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:53.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.465+0000 7fa0c7000700 1 --2- 172.21.15.49:0/2776791728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0c00c4df0 0x7fa0c00ac0c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fa0b8009fa0 tx=0x7fa0b8009900).stop 2024-01-22T05:07:53.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.465+0000 7fa0c7000700 1 -- 172.21.15.49:0/2776791728 shutdown_connections 2024-01-22T05:07:53.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.465+0000 7fa0c7000700 1 --2- 172.21.15.49:0/2776791728 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa09805a540 0x7fa09805ca00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:53.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.465+0000 7fa0c7000700 1 --2- 172.21.15.49:0/2776791728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0c00c4df0 0x7fa0c00ac0c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:53.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.465+0000 7fa0c7000700 1 --2- 172.21.15.49:0/2776791728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0c00c1c00 0x7fa0c0142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:53.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.465+0000 7fa0c7000700 1 --2- 172.21.15.49:0/2776791728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0c0068470 0x7fa0c00beea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:53.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.465+0000 7fa0c7000700 1 -- 172.21.15.49:0/2776791728 >> 172.21.15.49:0/2776791728 conn(0x7fa0c00c3420 msgr2=0x7fa0c00bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:53.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.465+0000 7fa0c7000700 1 -- 172.21.15.49:0/2776791728 shutdown_connections 2024-01-22T05:07:53.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.465+0000 7fa0c7000700 1 -- 172.21.15.49:0/2776791728 wait complete. 2024-01-22T05:07:53.471 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-01-22T05:07:53.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-22T05:07:53.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.649+0000 7fe3ce000700 1 Processor -- start 2024-01-22T05:07:53.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.649+0000 7fe3ce000700 1 -- start start 2024-01-22T05:07:53.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.649+0000 7fe3ce000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe3c80691b0 0x7fe3c80c2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:53.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.649+0000 7fe3ce000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3c80c2b60 0x7fe3c80c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:53.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3ce000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c80c2200 con 0x7fe3c8151260 2024-01-22T05:07:53.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3ce000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c8150690 con 0x7fe3c80691b0 2024-01-22T05:07:53.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3ce000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c81541b0 con 0x7fe3c80c2b60 2024-01-22T05:07:53.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3cd600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3c80c2b60 0x7fe3c80c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:53.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3c7e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe3c80691b0 0x7fe3c80c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:53.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3cd600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3c80c2b60 0x7fe3c80c2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:60830/0 (socket says 172.21.15.49:60830) 2024-01-22T05:07:53.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3cd600700 1 -- 172.21.15.49:0/3672575936 learned_addr learned my addr 172.21.15.49:0/3672575936 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:53.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3cd600700 1 -- 172.21.15.49:0/3672575936 >> v2:172.21.15.49:3300/0 conn(0x7fe3c80691b0 msgr2=0x7fe3c80c2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:53.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3cd600700 1 --2- 172.21.15.49:0/3672575936 >> v2:172.21.15.49:3300/0 conn(0x7fe3c80691b0 0x7fe3c80c2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:53.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3cd600700 1 -- 172.21.15.49:0/3672575936 >> v1:172.21.15.110:6789/0 conn(0x7fe3c8151260 legacy=0x7fe3c8068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:53.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3cd600700 1 -- 172.21.15.49:0/3672575936 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8154490 con 0x7fe3c80c2b60 2024-01-22T05:07:53.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3cd600700 1 --2- 172.21.15.49:0/3672575936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c80c2b60 0x7fe3c80c2ff0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fe3c8063ae0 tx=0x7fe3c000ba50).ready entity=mon.1 client_cookie=c706192ba6a7e5b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:53.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3c7400700 1 -- 172.21.15.49:0/3672575936 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0010070 con 0x7fe3c80c2b60 2024-01-22T05:07:53.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3c7400700 1 -- 172.21.15.49:0/3672575936 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c000dde0 con 0x7fe3c80c2b60 2024-01-22T05:07:53.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3c7400700 1 -- 172.21.15.49:0/3672575936 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0015680 con 0x7fe3c80c2b60 2024-01-22T05:07:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3ce000700 1 -- 172.21.15.49:0/3672575936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c80c2b60 msgr2=0x7fe3c80c2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3ce000700 1 --2- 172.21.15.49:0/3672575936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c80c2b60 0x7fe3c80c2ff0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fe3c8063ae0 tx=0x7fe3c000ba50).stop 2024-01-22T05:07:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3ce000700 1 -- 172.21.15.49:0/3672575936 shutdown_connections 2024-01-22T05:07:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3ce000700 1 --2- 172.21.15.49:0/3672575936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c80c2b60 0x7fe3c80c2ff0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3ce000700 1 --2- 172.21.15.49:0/3672575936 >> v2:172.21.15.49:3300/0 conn(0x7fe3c80691b0 0x7fe3c80c2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.653+0000 7fe3ce000700 1 -- 172.21.15.49:0/3672575936 >> 172.21.15.49:0/3672575936 conn(0x7fe3c80c42e0 msgr2=0x7fe3c8065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.657+0000 7fe3ce000700 1 -- 172.21.15.49:0/3672575936 shutdown_connections 2024-01-22T05:07:53.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.657+0000 7fe3ce000700 1 -- 172.21.15.49:0/3672575936 wait complete. 2024-01-22T05:07:53.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.657+0000 7fe3ce000700 1 Processor -- start 2024-01-22T05:07:53.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.657+0000 7fe3ce000700 1 -- start start 2024-01-22T05:07:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3ce000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c80691b0 0x7fe3c8067a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3ce000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c80c2b60 0x7fe3c80a5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3ce000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c8151260 0x7fe3c80a41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3ce000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c80a3d30 con 0x7fe3c80c2b60 2024-01-22T05:07:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3ce000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c8068a60 con 0x7fe3c80691b0 2024-01-22T05:07:53.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3ce000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c80684a0 con 0x7fe3c8151260 2024-01-22T05:07:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3c7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c80c2b60 0x7fe3c80a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3c7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c80c2b60 0x7fe3c80a5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40226/0 (socket says 172.21.15.49:40226) 2024-01-22T05:07:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3c7e00700 1 -- 172.21.15.49:0/301055231 learned_addr learned my addr 172.21.15.49:0/301055231 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3ccc00700 1 --2- 172.21.15.49:0/301055231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c80691b0 0x7fe3c8067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3cd600700 1 --2- 172.21.15.49:0/301055231 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c8151260 0x7fe3c80a41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:53.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3c7e00700 1 -- 172.21.15.49:0/301055231 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c8151260 msgr2=0x7fe3c80a41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:53.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3c7e00700 1 --2- 172.21.15.49:0/301055231 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c8151260 0x7fe3c80a41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:53.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3c7e00700 1 -- 172.21.15.49:0/301055231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c80691b0 msgr2=0x7fe3c8067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:53.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3c7e00700 1 --2- 172.21.15.49:0/301055231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c80691b0 0x7fe3c8067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:53.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3c7e00700 1 -- 172.21.15.49:0/301055231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c000bcf0 con 0x7fe3c80c2b60 2024-01-22T05:07:53.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3ccc00700 1 --2- 172.21.15.49:0/301055231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c80691b0 0x7fe3c8067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:07:53.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3c7e00700 1 --2- 172.21.15.49:0/301055231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c80c2b60 0x7fe3c80a5570 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fe3b000e900 tx=0x7fe3b0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:53.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3bfe00700 1 -- 172.21.15.49:0/301055231 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b000c670 con 0x7fe3c80c2b60 2024-01-22T05:07:53.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3bfe00700 1 -- 172.21.15.49:0/301055231 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b000c7d0 con 0x7fe3c80c2b60 2024-01-22T05:07:53.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3bfe00700 1 -- 172.21.15.49:0/301055231 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b000cb50 con 0x7fe3c80c2b60 2024-01-22T05:07:53.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.661+0000 7fe3ce000700 1 -- 172.21.15.49:0/301055231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c8068780 con 0x7fe3c80c2b60 2024-01-22T05:07:53.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.665+0000 7fe3ce000700 1 -- 172.21.15.49:0/301055231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c81517d0 con 0x7fe3c80c2b60 2024-01-22T05:07:53.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.665+0000 7fe3ce000700 1 -- 172.21.15.49:0/301055231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c80a3ee0 con 0x7fe3c80c2b60 2024-01-22T05:07:53.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.665+0000 7fe3bfe00700 1 -- 172.21.15.49:0/301055231 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe3b001b400 con 0x7fe3c80c2b60 2024-01-22T05:07:53.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.665+0000 7fe3bfe00700 1 --2- 172.21.15.49:0/301055231 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe3a005a510 0x7fe3a005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:53.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.665+0000 7fe3bfe00700 1 -- 172.21.15.49:0/301055231 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fe3b0074a60 con 0x7fe3c80c2b60 2024-01-22T05:07:53.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.669+0000 7fe3ccc00700 1 --2- 172.21.15.49:0/301055231 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe3a005a510 0x7fe3a005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:53.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.669+0000 7fe3ccc00700 1 --2- 172.21.15.49:0/301055231 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe3a005a510 0x7fe3a005c9d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fe3b8001690 tx=0x7fe3b8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:53.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.673+0000 7fe3bfe00700 1 -- 172.21.15.49:0/301055231 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe3c80a3ee0 con 0x7fe3c80c2b60 2024-01-22T05:07:53.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.837+0000 7fe3ce000700 1 -- 172.21.15.49:0/301055231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe3c80a3e70 con 0x7fe3c80c2b60 2024-01-22T05:07:53.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.845+0000 7fe3bfe00700 1 -- 172.21.15.49:0/301055231 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe3b0016070 con 0x7fe3c80c2b60 2024-01-22T05:07:53.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.849+0000 7fe3ce000700 1 -- 172.21.15.49:0/301055231 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe3a005a510 msgr2=0x7fe3a005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:53.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.849+0000 7fe3ce000700 1 --2- 172.21.15.49:0/301055231 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe3a005a510 0x7fe3a005c9d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fe3b8001690 tx=0x7fe3b8009040).stop 2024-01-22T05:07:53.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.849+0000 7fe3ce000700 1 -- 172.21.15.49:0/301055231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c80c2b60 msgr2=0x7fe3c80a5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:53.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.849+0000 7fe3ce000700 1 --2- 172.21.15.49:0/301055231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c80c2b60 0x7fe3c80a5570 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fe3b000e900 tx=0x7fe3b0009060).stop 2024-01-22T05:07:53.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.853+0000 7fe3ce000700 1 -- 172.21.15.49:0/301055231 shutdown_connections 2024-01-22T05:07:53.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.853+0000 7fe3ce000700 1 --2- 172.21.15.49:0/301055231 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe3a005a510 0x7fe3a005c9d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:53.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.853+0000 7fe3ce000700 1 --2- 172.21.15.49:0/301055231 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c8151260 0x7fe3c80a41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.853+0000 7fe3ce000700 1 --2- 172.21.15.49:0/301055231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c80c2b60 0x7fe3c80a5570 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.853+0000 7fe3ce000700 1 --2- 172.21.15.49:0/301055231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c80691b0 0x7fe3c8067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.853+0000 7fe3ce000700 1 -- 172.21.15.49:0/301055231 >> 172.21.15.49:0/301055231 conn(0x7fe3c80c42e0 msgr2=0x7fe3c80c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.853+0000 7fe3ce000700 1 -- 172.21.15.49:0/301055231 shutdown_connections 2024-01-22T05:07:53.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:53.853+0000 7fe3ce000700 1 -- 172.21.15.49:0/301055231 wait complete. 2024-01-22T05:07:53.875 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-01-22T05:07:54.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.029+0000 7f4893400700 1 Processor -- start 2024-01-22T05:07:54.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.033+0000 7f4893400700 1 -- start start 2024-01-22T05:07:54.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f4893400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f488c0bc580 0x7f488c0bca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:54.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f4893400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c153930 0x7f488c153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:54.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f4893400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488c0c2130 con 0x7f488c0c2d90 2024-01-22T05:07:54.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f4893400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488c154c50 con 0x7f488c0bc580 2024-01-22T05:07:54.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f4893400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c154f30 con 0x7f488c153930 2024-01-22T05:07:54.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f4890a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f488c0c2d90 0x7f488c0c3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33582/0 (socket says 172.21.15.49:33582) 2024-01-22T05:07:54.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f4890a00700 1 -- 172.21.15.49:0/2638870816 learned_addr learned my addr 172.21.15.49:0/2638870816 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:54.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f4891400700 1 --2- 172.21.15.49:0/2638870816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c153930 0x7f488c153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:54.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488be00700 1 --2- 172.21.15.49:0/2638870816 >> v2:172.21.15.110:3300/0 conn(0x7f488c0bc580 0x7f488c0bca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:54.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 -- 172.21.15.49:0/2638870816 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411232052 0 0) 0x7f488c0c2130 con 0x7f488c0c2d90 2024-01-22T05:07:54.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 -- 172.21.15.49:0/2638870816 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f486c0033f0 con 0x7f488c0c2d90 2024-01-22T05:07:54.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 -- 172.21.15.49:0/2638870816 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2218436799 0 0) 0x7f486c0033f0 con 0x7f488c0c2d90 2024-01-22T05:07:54.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 -- 172.21.15.49:0/2638870816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c153930 msgr2=0x7f488c153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:54.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 --2- 172.21.15.49:0/2638870816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c153930 0x7f488c153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:54.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 -- 172.21.15.49:0/2638870816 >> v2:172.21.15.110:3300/0 conn(0x7f488c0bc580 msgr2=0x7f488c0bca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:54.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 --2- 172.21.15.49:0/2638870816 >> v2:172.21.15.110:3300/0 conn(0x7f488c0bc580 0x7f488c0bca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:54.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 -- 172.21.15.49:0/2638870816 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c0c1dc0 con 0x7f488c0c2d90 2024-01-22T05:07:54.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 -- 172.21.15.49:0/2638870816 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f487c001470 con 0x7f488c0c2d90 2024-01-22T05:07:54.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 -- 172.21.15.49:0/2638870816 >> v1:172.21.15.49:6789/0 conn(0x7f488c0c2d90 legacy=0x7f488c0c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:54.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 --2- 172.21.15.49:0/2638870816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c153930 0x7f486c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:54.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 --2- 172.21.15.49:0/2638870816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f486c003e10 0x7f486c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:54.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 --2- 172.21.15.49:0/2638870816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c004b80 0x7f486c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:54.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 -- 172.21.15.49:0/2638870816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c154c50 con 0x7f486c003e10 2024-01-22T05:07:54.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 -- 172.21.15.49:0/2638870816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c154f30 con 0x7f486c004b80 2024-01-22T05:07:54.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488b400700 1 -- 172.21.15.49:0/2638870816 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486c00b8e0 con 0x7f488c153930 2024-01-22T05:07:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488be00700 1 --2- 172.21.15.49:0/2638870816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f486c003e10 0x7f486c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f4890a00700 1 --2- 172.21.15.49:0/2638870816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c153930 0x7f486c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f4891400700 1 --2- 172.21.15.49:0/2638870816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c004b80 0x7f486c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488be00700 1 -- 172.21.15.49:0/2638870816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c153930 msgr2=0x7f486c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488be00700 1 --2- 172.21.15.49:0/2638870816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c153930 0x7f486c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488be00700 1 -- 172.21.15.49:0/2638870816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c004b80 msgr2=0x7f486c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488be00700 1 --2- 172.21.15.49:0/2638870816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c004b80 0x7f486c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488be00700 1 -- 172.21.15.49:0/2638870816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c0033f0 con 0x7f486c003e10 2024-01-22T05:07:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f4890a00700 1 --2- 172.21.15.49:0/2638870816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c153930 0x7f486c0038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:07:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.037+0000 7f488be00700 1 --2- 172.21.15.49:0/2638870816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f486c003e10 0x7f486c004690 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f4874009ab0 tx=0x7f4874009060).ready entity=mon.0 client_cookie=27497afdf52e3305 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.041+0000 7f488b400700 1 -- 172.21.15.49:0/2638870816 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4874009430 con 0x7f486c003e10 2024-01-22T05:07:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.041+0000 7f488b400700 1 -- 172.21.15.49:0/2638870816 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487400e640 con 0x7f486c003e10 2024-01-22T05:07:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.041+0000 7f488b400700 1 -- 172.21.15.49:0/2638870816 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487400e9c0 con 0x7f486c003e10 2024-01-22T05:07:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.041+0000 7f4893400700 1 -- 172.21.15.49:0/2638870816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f486c003e10 msgr2=0x7f486c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.041+0000 7f4893400700 1 --2- 172.21.15.49:0/2638870816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f486c003e10 0x7f486c004690 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f4874009ab0 tx=0x7f4874009060).stop 2024-01-22T05:07:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.041+0000 7f4891400700 1 -- 172.21.15.49:0/2638870816 reap_dead start 2024-01-22T05:07:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.041+0000 7f4893400700 1 -- 172.21.15.49:0/2638870816 shutdown_connections 2024-01-22T05:07:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.041+0000 7f4893400700 1 -- 172.21.15.49:0/2638870816 >> 172.21.15.49:0/2638870816 conn(0x7f488c066830 msgr2=0x7f488c066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.041+0000 7f4893400700 1 -- 172.21.15.49:0/2638870816 shutdown_connections 2024-01-22T05:07:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.041+0000 7f4893400700 1 -- 172.21.15.49:0/2638870816 wait complete. 2024-01-22T05:07:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.045+0000 7f4893400700 1 Processor -- start 2024-01-22T05:07:54.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.045+0000 7f4893400700 1 -- start start 2024-01-22T05:07:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.045+0000 7f4893400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c003e10 0x7f488c167910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.045+0000 7f4893400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c164420 0x7f488c1567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.045+0000 7f4893400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f488c156cb0 0x7f488c14bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.045+0000 7f4893400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c14ae00 con 0x7f488c156cb0 2024-01-22T05:07:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.045+0000 7f4893400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c14b310 con 0x7f486c003e10 2024-01-22T05:07:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.045+0000 7f4893400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c14b890 con 0x7f488c164420 2024-01-22T05:07:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4891400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f488c156cb0 0x7f488c14bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4890a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c003e10 0x7f488c167910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4891400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f488c156cb0 0x7f488c14bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40238/0 (socket says 172.21.15.49:40238) 2024-01-22T05:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4890a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c003e10 0x7f488c167910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:60854/0 (socket says 172.21.15.49:60854) 2024-01-22T05:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4891400700 1 -- 172.21.15.49:0/1906824353 learned_addr learned my addr 172.21.15.49:0/1906824353 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f488be00700 1 --2- 172.21.15.49:0/1906824353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c164420 0x7f488c1567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:54.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4891400700 1 -- 172.21.15.49:0/1906824353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c164420 msgr2=0x7f488c1567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:54.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4891400700 1 --2- 172.21.15.49:0/1906824353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c164420 0x7f488c1567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:54.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4891400700 1 -- 172.21.15.49:0/1906824353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c003e10 msgr2=0x7f488c167910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:54.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4891400700 1 --2- 172.21.15.49:0/1906824353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c003e10 0x7f488c167910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:54.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4891400700 1 -- 172.21.15.49:0/1906824353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c157130 con 0x7f488c156cb0 2024-01-22T05:07:54.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4890a00700 1 --2- 172.21.15.49:0/1906824353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c003e10 0x7f488c167910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:54.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4891400700 1 --2- 172.21.15.49:0/1906824353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f488c156cb0 0x7f488c14bd20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f488c155070 tx=0x7f488400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:54.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4883e00700 1 -- 172.21.15.49:0/1906824353 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488400e070 con 0x7f488c156cb0 2024-01-22T05:07:54.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4883e00700 1 -- 172.21.15.49:0/1906824353 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4884011b80 con 0x7f488c156cb0 2024-01-22T05:07:54.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4893400700 1 -- 172.21.15.49:0/1906824353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488c168210 con 0x7f488c156cb0 2024-01-22T05:07:54.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4883e00700 1 -- 172.21.15.49:0/1906824353 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884016450 con 0x7f488c156cb0 2024-01-22T05:07:54.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.049+0000 7f4893400700 1 -- 172.21.15.49:0/1906824353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488c14b5a0 con 0x7f488c156cb0 2024-01-22T05:07:54.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.053+0000 7f4893400700 1 -- 172.21.15.49:0/1906824353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488c14ba40 con 0x7f488c156cb0 2024-01-22T05:07:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.053+0000 7f4883e00700 1 -- 172.21.15.49:0/1906824353 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4884016840 con 0x7f488c156cb0 2024-01-22T05:07:54.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.053+0000 7f4883e00700 1 --2- 172.21.15.49:0/1906824353 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f486405a540 0x7f486405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:54.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.053+0000 7f4883e00700 1 -- 172.21.15.49:0/1906824353 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f4884074960 con 0x7f488c156cb0 2024-01-22T05:07:54.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.053+0000 7f4890a00700 1 --2- 172.21.15.49:0/1906824353 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f486405a540 0x7f486405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:54.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.057+0000 7f4890a00700 1 --2- 172.21.15.49:0/1906824353 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f486405a540 0x7f486405ca00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f488c0aa090 tx=0x7f487c007040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:54.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.061+0000 7f4883e00700 1 -- 172.21.15.49:0/1906824353 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f488c14ba40 con 0x7f488c156cb0 2024-01-22T05:07:54.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.281+0000 7f4893400700 1 -- 172.21.15.49:0/1906824353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) v1 -- 0x7f488c14ba40 con 0x7f488c156cb0 2024-01-22T05:07:54.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.465+0000 7f4883e00700 1 -- 172.21.15.49:0/1906824353 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v173) v1 ==== 148+0+0 (secure 0 0 0) 0x7f488c14ba40 con 0x7f488c156cb0 2024-01-22T05:07:54.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.469+0000 7f4893400700 1 -- 172.21.15.49:0/1906824353 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f486405a540 msgr2=0x7f486405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:54.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.469+0000 7f4893400700 1 --2- 172.21.15.49:0/1906824353 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f486405a540 0x7f486405ca00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f488c0aa090 tx=0x7f487c007040).stop 2024-01-22T05:07:54.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.469+0000 7f4893400700 1 -- 172.21.15.49:0/1906824353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f488c156cb0 msgr2=0x7f488c14bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:54.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.469+0000 7f4893400700 1 --2- 172.21.15.49:0/1906824353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f488c156cb0 0x7f488c14bd20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f488c155070 tx=0x7f488400b040).stop 2024-01-22T05:07:54.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.469+0000 7f4893400700 1 -- 172.21.15.49:0/1906824353 shutdown_connections 2024-01-22T05:07:54.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.469+0000 7f4893400700 1 --2- 172.21.15.49:0/1906824353 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f486405a540 0x7f486405ca00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:54.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.469+0000 7f4893400700 1 --2- 172.21.15.49:0/1906824353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f488c156cb0 0x7f488c14bd20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:54.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.469+0000 7f4893400700 1 --2- 172.21.15.49:0/1906824353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c164420 0x7f488c1567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:54.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.469+0000 7f4893400700 1 --2- 172.21.15.49:0/1906824353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c003e10 0x7f488c167910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:54.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.469+0000 7f4893400700 1 -- 172.21.15.49:0/1906824353 >> 172.21.15.49:0/1906824353 conn(0x7f488c066830 msgr2=0x7f488c0c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:54.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.469+0000 7f4893400700 1 -- 172.21.15.49:0/1906824353 shutdown_connections 2024-01-22T05:07:54.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.469+0000 7f4893400700 1 -- 172.21.15.49:0/1906824353 wait complete. 2024-01-22T05:07:54.496 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2024-01-22T05:07:54.496 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-01-22T05:07:54.496 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-01-22T05:07:54.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.653+0000 7fcdcd600700 1 Processor -- start 2024-01-22T05:07:54.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.653+0000 7fcdcd600700 1 -- start start 2024-01-22T05:07:54.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdcd600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcdc8062230 0x7fcdc8062610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:54.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdcd600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcdc8065930 0x7fcdc8065d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:54.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdcd600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc8067e30 con 0x7fcdc8066280 2024-01-22T05:07:54.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdcd600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc8068c90 con 0x7fcdc8065930 2024-01-22T05:07:54.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdcd600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc8069120 con 0x7fcdc8062230 2024-01-22T05:07:54.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdc6000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcdc8065930 0x7fcdc8065d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:54.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdc6000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcdc8065930 0x7fcdc8065d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40250/0 (socket says 172.21.15.49:40250) 2024-01-22T05:07:54.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdc6000700 1 -- 172.21.15.49:0/1911391277 learned_addr learned my addr 172.21.15.49:0/1911391277 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:54.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdc6a00700 1 --2- 172.21.15.49:0/1911391277 >> v2:172.21.15.110:3300/0 conn(0x7fcdc8062230 0x7fcdc8062610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:54.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdc6000700 1 -- 172.21.15.49:0/1911391277 >> v2:172.21.15.110:3300/0 conn(0x7fcdc8062230 msgr2=0x7fcdc8062610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:54.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdc6000700 1 --2- 172.21.15.49:0/1911391277 >> v2:172.21.15.110:3300/0 conn(0x7fcdc8062230 0x7fcdc8062610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:54.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdc6000700 1 -- 172.21.15.49:0/1911391277 >> v1:172.21.15.110:6789/0 conn(0x7fcdc8066280 legacy=0x7fcdc80c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:54.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdc6000700 1 -- 172.21.15.49:0/1911391277 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc8068080 con 0x7fcdc8065930 2024-01-22T05:07:54.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdc6000700 1 --2- 172.21.15.49:0/1911391277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc8065930 0x7fcdc8065d90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fcdc80bd900 tx=0x7fcdb00080e0).ready entity=mon.0 client_cookie=d063a9de3cbf1a6a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:54.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdc5600700 1 -- 172.21.15.49:0/1911391277 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb000b4f0 con 0x7fcdc8065930 2024-01-22T05:07:54.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdc5600700 1 -- 172.21.15.49:0/1911391277 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb000b650 con 0x7fcdc8065930 2024-01-22T05:07:54.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.657+0000 7fcdc5600700 1 -- 172.21.15.49:0/1911391277 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb000b9d0 con 0x7fcdc8065930 2024-01-22T05:07:54.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.661+0000 7fcdcd600700 1 -- 172.21.15.49:0/1911391277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc8065930 msgr2=0x7fcdc8065d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:54.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.661+0000 7fcdcd600700 1 --2- 172.21.15.49:0/1911391277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc8065930 0x7fcdc8065d90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fcdc80bd900 tx=0x7fcdb00080e0).stop 2024-01-22T05:07:54.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.661+0000 7fcdcd600700 1 -- 172.21.15.49:0/1911391277 shutdown_connections 2024-01-22T05:07:54.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.661+0000 7fcdcd600700 1 --2- 172.21.15.49:0/1911391277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc8065930 0x7fcdc8065d90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:54.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.661+0000 7fcdcd600700 1 --2- 172.21.15.49:0/1911391277 >> v2:172.21.15.110:3300/0 conn(0x7fcdc8062230 0x7fcdc8062610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:54.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.661+0000 7fcdcd600700 1 -- 172.21.15.49:0/1911391277 >> 172.21.15.49:0/1911391277 conn(0x7fcdc80c6920 msgr2=0x7fcdc80c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:54.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.661+0000 7fcdcd600700 1 -- 172.21.15.49:0/1911391277 shutdown_connections 2024-01-22T05:07:54.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.661+0000 7fcdcd600700 1 -- 172.21.15.49:0/1911391277 wait complete. 2024-01-22T05:07:54.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.661+0000 7fcdcd600700 1 Processor -- start 2024-01-22T05:07:54.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdcd600700 1 -- start start 2024-01-22T05:07:54.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdcd600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc8062230 0x7fcdc809f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:54.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdcd600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc8065930 0x7fcdc80a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:54.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdcd600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdc8066280 0x7fcdc814e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:54.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdcd600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80a2ee0 con 0x7fcdc8065930 2024-01-22T05:07:54.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdcd600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc809f990 con 0x7fcdc8066280 2024-01-22T05:07:54.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdcd600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc809fba0 con 0x7fcdc8062230 2024-01-22T05:07:54.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdc6a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc8062230 0x7fcdc809f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:54.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdc7400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdc8066280 0x7fcdc814e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:54.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdc6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc8065930 0x7fcdc80a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:54.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdc6a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc8062230 0x7fcdc809f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:45142/0 (socket says 172.21.15.49:45142) 2024-01-22T05:07:54.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdc6a00700 1 -- 172.21.15.49:0/830437217 learned_addr learned my addr 172.21.15.49:0/830437217 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdc6a00700 1 -- 172.21.15.49:0/830437217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdc8066280 msgr2=0x7fcdc814e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdc6a00700 1 --2- 172.21.15.49:0/830437217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdc8066280 0x7fcdc814e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdc6a00700 1 -- 172.21.15.49:0/830437217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc8065930 msgr2=0x7fcdc80a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdc6a00700 1 --2- 172.21.15.49:0/830437217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc8065930 0x7fcdc80a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdc6a00700 1 -- 172.21.15.49:0/830437217 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb000a410 con 0x7fcdc8062230 2024-01-22T05:07:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.665+0000 7fcdc6a00700 1 --2- 172.21.15.49:0/830437217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc8062230 0x7fcdc809f4a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fcdb800b7d0 tx=0x7fcdb800a040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:54.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.669+0000 7fcdbe000700 1 -- 172.21.15.49:0/830437217 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8005a90 con 0x7fcdc8062230 2024-01-22T05:07:54.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.669+0000 7fcdbe000700 1 -- 172.21.15.49:0/830437217 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb8005bf0 con 0x7fcdc8062230 2024-01-22T05:07:54.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.669+0000 7fcdbe000700 1 -- 172.21.15.49:0/830437217 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb80070d0 con 0x7fcdc8062230 2024-01-22T05:07:54.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.669+0000 7fcdcd600700 1 -- 172.21.15.49:0/830437217 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc809fee0 con 0x7fcdc8062230 2024-01-22T05:07:54.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.669+0000 7fcdcd600700 1 -- 172.21.15.49:0/830437217 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc80a0720 con 0x7fcdc8062230 2024-01-22T05:07:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.669+0000 7fcdbe000700 1 -- 172.21.15.49:0/830437217 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcdb80074c0 con 0x7fcdc8062230 2024-01-22T05:07:54.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.669+0000 7fcdcd600700 1 -- 172.21.15.49:0/830437217 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc8064f50 con 0x7fcdc8062230 2024-01-22T05:07:54.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.673+0000 7fcdbe000700 1 --2- 172.21.15.49:0/830437217 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcda005a510 0x7fcda005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:54.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.673+0000 7fcdbe000700 1 -- 172.21.15.49:0/830437217 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fcdb8074790 con 0x7fcdc8062230 2024-01-22T05:07:54.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.673+0000 7fcdc6000700 1 --2- 172.21.15.49:0/830437217 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcda005a510 0x7fcda005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:54.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.673+0000 7fcdc6000700 1 --2- 172.21.15.49:0/830437217 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcda005a510 0x7fcda005c9d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fcdc80ab860 tx=0x7fcdb00080e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.677+0000 7fcdbe000700 1 -- 172.21.15.49:0/830437217 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcdb8048050 con 0x7fcdc8062230 2024-01-22T05:07:54.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:54.901+0000 7fcdcd600700 1 -- 172.21.15.49:0/830437217 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) v1 -- 0x7fcdc8046800 con 0x7fcdc8062230 2024-01-22T05:07:55.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.473+0000 7fcdbe000700 1 -- 172.21.15.49:0/830437217 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v174) v1 ==== 146+0+0 (secure 0 0 0) 0x7fcdb804b670 con 0x7fcdc8062230 2024-01-22T05:07:55.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.477+0000 7fcdcd600700 1 -- 172.21.15.49:0/830437217 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcda005a510 msgr2=0x7fcda005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:55.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.477+0000 7fcdcd600700 1 --2- 172.21.15.49:0/830437217 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcda005a510 0x7fcda005c9d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fcdc80ab860 tx=0x7fcdb00080e0).stop 2024-01-22T05:07:55.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.477+0000 7fcdcd600700 1 -- 172.21.15.49:0/830437217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc8062230 msgr2=0x7fcdc809f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:55.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.477+0000 7fcdcd600700 1 --2- 172.21.15.49:0/830437217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc8062230 0x7fcdc809f4a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fcdb800b7d0 tx=0x7fcdb800a040).stop 2024-01-22T05:07:55.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.477+0000 7fcdcd600700 1 -- 172.21.15.49:0/830437217 shutdown_connections 2024-01-22T05:07:55.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.477+0000 7fcdcd600700 1 --2- 172.21.15.49:0/830437217 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcda005a510 0x7fcda005c9d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:55.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.477+0000 7fcdcd600700 1 --2- 172.21.15.49:0/830437217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdc8066280 0x7fcdc814e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:55.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.477+0000 7fcdcd600700 1 --2- 172.21.15.49:0/830437217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc8065930 0x7fcdc80a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:55.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.477+0000 7fcdcd600700 1 --2- 172.21.15.49:0/830437217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc8062230 0x7fcdc809f4a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:55.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.477+0000 7fcdcd600700 1 -- 172.21.15.49:0/830437217 >> 172.21.15.49:0/830437217 conn(0x7fcdc80c6920 msgr2=0x7fcdc8062610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:55.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.477+0000 7fcdcd600700 1 -- 172.21.15.49:0/830437217 shutdown_connections 2024-01-22T05:07:55.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.477+0000 7fcdcd600700 1 -- 172.21.15.49:0/830437217 wait complete. 2024-01-22T05:07:55.502 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-22T05:07:55.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.673+0000 7fd24be00700 1 Processor -- start 2024-01-22T05:07:55.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.673+0000 7fd24be00700 1 -- start start 2024-01-22T05:07:55.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.677+0000 7fd24be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd24c15c2d0 0x7fd24c065900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:55.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.677+0000 7fd24be00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24c069600 con 0x7fd24c065df0 2024-01-22T05:07:55.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.677+0000 7fd24be00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24c0a90f0 con 0x7fd24c067a90 2024-01-22T05:07:55.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.677+0000 7fd24be00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24c1561a0 con 0x7fd24c15c2d0 2024-01-22T05:07:55.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.677+0000 7fd24a000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd24c15c2d0 0x7fd24c065900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:55.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.677+0000 7fd24b400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd24c065df0 0x7fd24c066200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33596/0 (socket says 172.21.15.49:33596) 2024-01-22T05:07:55.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.677+0000 7fd24b400700 1 -- 172.21.15.49:0/1910727135 learned_addr learned my addr 172.21.15.49:0/1910727135 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:55.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.677+0000 7fd24a000700 1 -- 172.21.15.49:0/1910727135 >> v1:172.21.15.110:6789/0 conn(0x7fd24c067a90 legacy=0x7fd24c15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:55.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.677+0000 7fd24a000700 1 -- 172.21.15.49:0/1910727135 >> v1:172.21.15.49:6789/0 conn(0x7fd24c065df0 legacy=0x7fd24c066200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:55.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.677+0000 7fd24a000700 1 -- 172.21.15.49:0/1910727135 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c0681c0 con 0x7fd24c15c2d0 2024-01-22T05:07:55.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.677+0000 7fd249600700 1 -- 172.21.15.49:0/1910727135 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426741495 0 0) 0x7fd24c069600 con 0x7fd24c065df0 2024-01-22T05:07:55.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.677+0000 7fd24a000700 1 --2- 172.21.15.49:0/1910727135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd24c15c2d0 0x7fd24c065900 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fd234009760 tx=0x7fd234009060).ready entity=mon.0 client_cookie=dd9690eb19b1da5c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:55.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.677+0000 7fd249600700 1 -- 172.21.15.49:0/1910727135 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23400b580 con 0x7fd24c15c2d0 2024-01-22T05:07:55.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.677+0000 7fd249600700 1 -- 172.21.15.49:0/1910727135 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23400b6e0 con 0x7fd24c15c2d0 2024-01-22T05:07:55.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.677+0000 7fd249600700 1 -- 172.21.15.49:0/1910727135 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23400ba60 con 0x7fd24c15c2d0 2024-01-22T05:07:55.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.681+0000 7fd24be00700 1 -- 172.21.15.49:0/1910727135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd24c15c2d0 msgr2=0x7fd24c065900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:55.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.681+0000 7fd24be00700 1 --2- 172.21.15.49:0/1910727135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd24c15c2d0 0x7fd24c065900 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fd234009760 tx=0x7fd234009060).stop 2024-01-22T05:07:55.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.681+0000 7fd24be00700 1 -- 172.21.15.49:0/1910727135 shutdown_connections 2024-01-22T05:07:55.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.681+0000 7fd24be00700 1 --2- 172.21.15.49:0/1910727135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd24c15c2d0 0x7fd24c065900 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:55.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.681+0000 7fd24be00700 1 -- 172.21.15.49:0/1910727135 >> 172.21.15.49:0/1910727135 conn(0x7fd24c0c6fc0 msgr2=0x7fd24c0c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:55.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.681+0000 7fd24be00700 1 -- 172.21.15.49:0/1910727135 shutdown_connections 2024-01-22T05:07:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.681+0000 7fd24be00700 1 -- 172.21.15.49:0/1910727135 wait complete. 2024-01-22T05:07:55.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24be00700 1 Processor -- start 2024-01-22T05:07:55.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24be00700 1 -- start start 2024-01-22T05:07:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd24c065df0 0x7fd24c0aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd24c067a90 0x7fd24c0bffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd24c15c2d0 0x7fd24c1531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24be00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0aabf0 con 0x7fd24c065df0 2024-01-22T05:07:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24be00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c157930 con 0x7fd24c067a90 2024-01-22T05:07:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24be00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c157c10 con 0x7fd24c15c2d0 2024-01-22T05:07:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd24c065df0 0x7fd24c0aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd24c065df0 0x7fd24c0aa2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40286/0 (socket says 172.21.15.49:40286) 2024-01-22T05:07:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24aa00700 1 -- 172.21.15.49:0/2436079507 learned_addr learned my addr 172.21.15.49:0/2436079507 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24a000700 1 --2- 172.21.15.49:0/2436079507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd24c067a90 0x7fd24c0bffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24b400700 1 --2- 172.21.15.49:0/2436079507 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd24c15c2d0 0x7fd24c1531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24aa00700 1 -- 172.21.15.49:0/2436079507 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd24c15c2d0 msgr2=0x7fd24c1531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24aa00700 1 --2- 172.21.15.49:0/2436079507 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd24c15c2d0 0x7fd24c1531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24aa00700 1 -- 172.21.15.49:0/2436079507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd24c067a90 msgr2=0x7fd24c0bffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24aa00700 1 --2- 172.21.15.49:0/2436079507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd24c067a90 0x7fd24c0bffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24aa00700 1 -- 172.21.15.49:0/2436079507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2340092a0 con 0x7fd24c065df0 2024-01-22T05:07:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.685+0000 7fd24aa00700 1 --2- 172.21.15.49:0/2436079507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd24c065df0 0x7fd24c0aa2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fd23c00c4c0 tx=0x7fd23c007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.689+0000 7fd242000700 1 -- 172.21.15.49:0/2436079507 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c007020 con 0x7fd24c065df0 2024-01-22T05:07:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.689+0000 7fd242000700 1 -- 172.21.15.49:0/2436079507 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c007180 con 0x7fd24c065df0 2024-01-22T05:07:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.689+0000 7fd24be00700 1 -- 172.21.15.49:0/2436079507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24c157ef0 con 0x7fd24c065df0 2024-01-22T05:07:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.689+0000 7fd242000700 1 -- 172.21.15.49:0/2436079507 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c007520 con 0x7fd24c065df0 2024-01-22T05:07:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.689+0000 7fd24be00700 1 -- 172.21.15.49:0/2436079507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c0aa980 con 0x7fd24c065df0 2024-01-22T05:07:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.689+0000 7fd24be00700 1 -- 172.21.15.49:0/2436079507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24c047060 con 0x7fd24c065df0 2024-01-22T05:07:55.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.689+0000 7fd242000700 1 -- 172.21.15.49:0/2436079507 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd23c006900 con 0x7fd24c065df0 2024-01-22T05:07:55.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.693+0000 7fd242000700 1 --2- 172.21.15.49:0/2436079507 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd22405a4e0 0x7fd22405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:55.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.693+0000 7fd242000700 1 -- 172.21.15.49:0/2436079507 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fd23c0740c0 con 0x7fd24c065df0 2024-01-22T05:07:55.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.693+0000 7fd24a000700 1 --2- 172.21.15.49:0/2436079507 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd22405a4e0 0x7fd22405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:55.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.693+0000 7fd24a000700 1 --2- 172.21.15.49:0/2436079507 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd22405a4e0 0x7fd22405c9a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fd24c15c6d0 tx=0x7fd234017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:55.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.701+0000 7fd242000700 1 -- 172.21.15.49:0/2436079507 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd23c047a40 con 0x7fd24c065df0 2024-01-22T05:07:55.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.865+0000 7fd24be00700 1 -- 172.21.15.49:0/2436079507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd24c046800 con 0x7fd24c065df0 2024-01-22T05:07:55.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.873+0000 7fd242000700 1 -- 172.21.15.49:0/2436079507 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd23c04b060 con 0x7fd24c065df0 2024-01-22T05:07:55.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.877+0000 7fd24be00700 1 -- 172.21.15.49:0/2436079507 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd22405a4e0 msgr2=0x7fd22405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:55.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.877+0000 7fd24be00700 1 --2- 172.21.15.49:0/2436079507 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd22405a4e0 0x7fd22405c9a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fd24c15c6d0 tx=0x7fd234017000).stop 2024-01-22T05:07:55.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.877+0000 7fd24be00700 1 -- 172.21.15.49:0/2436079507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd24c065df0 msgr2=0x7fd24c0aa2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:55.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.877+0000 7fd24be00700 1 --2- 172.21.15.49:0/2436079507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd24c065df0 0x7fd24c0aa2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fd23c00c4c0 tx=0x7fd23c007df0).stop 2024-01-22T05:07:55.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.877+0000 7fd24be00700 1 -- 172.21.15.49:0/2436079507 shutdown_connections 2024-01-22T05:07:55.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.877+0000 7fd24be00700 1 --2- 172.21.15.49:0/2436079507 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd22405a4e0 0x7fd22405c9a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:55.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.877+0000 7fd24be00700 1 --2- 172.21.15.49:0/2436079507 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd24c15c2d0 0x7fd24c1531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:55.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.877+0000 7fd24be00700 1 --2- 172.21.15.49:0/2436079507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd24c067a90 0x7fd24c0bffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:55.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.877+0000 7fd24be00700 1 --2- 172.21.15.49:0/2436079507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd24c065df0 0x7fd24c0aa2f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:55.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.877+0000 7fd24be00700 1 -- 172.21.15.49:0/2436079507 >> 172.21.15.49:0/2436079507 conn(0x7fd24c0c6fc0 msgr2=0x7fd24c0c5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:55.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.877+0000 7fd24be00700 1 -- 172.21.15.49:0/2436079507 shutdown_connections 2024-01-22T05:07:55.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:55.877+0000 7fd24be00700 1 -- 172.21.15.49:0/2436079507 wait complete. 2024-01-22T05:07:55.901 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:07:55.901 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:07:55.944 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:07:55.987 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:07:55.987 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-22T05:07:55.987 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:07:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.149+0000 7f4c65e00700 1 Processor -- start 2024-01-22T05:07:56.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.149+0000 7f4c65e00700 1 -- start start 2024-01-22T05:07:56.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.153+0000 7f4c65e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c60064690 0x7f4c60064af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:56.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.153+0000 7f4c65e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c600be210 con 0x7f4c600be6a0 2024-01-22T05:07:56.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.153+0000 7f4c65e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c600bd650 con 0x7f4c60151370 2024-01-22T05:07:56.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.153+0000 7f4c65e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600bd8e0 con 0x7f4c60064690 2024-01-22T05:07:56.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.153+0000 7f4c5ea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4c600be6a0 0x7f4c600c2cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33612/0 (socket says 172.21.15.49:33612) 2024-01-22T05:07:56.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.153+0000 7f4c5ea00700 1 -- 172.21.15.49:0/589337036 learned_addr learned my addr 172.21.15.49:0/589337036 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:56.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.153+0000 7f4c5e000700 1 --2- 172.21.15.49:0/589337036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c60064690 0x7f4c60064af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:56.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.153+0000 7f4c5d600700 1 -- 172.21.15.49:0/589337036 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658761164 0 0) 0x7f4c600be210 con 0x7f4c600be6a0 2024-01-22T05:07:56.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.153+0000 7f4c5d600700 1 -- 172.21.15.49:0/589337036 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c400033f0 con 0x7f4c600be6a0 2024-01-22T05:07:56.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.153+0000 7f4c5e000700 1 -- 172.21.15.49:0/589337036 >> v1:172.21.15.110:6789/0 conn(0x7f4c60151370 legacy=0x7f4c60151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:56.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.153+0000 7f4c5e000700 1 -- 172.21.15.49:0/589337036 >> v1:172.21.15.49:6789/0 conn(0x7f4c600be6a0 legacy=0x7f4c600c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:56.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.153+0000 7f4c5e000700 1 -- 172.21.15.49:0/589337036 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c600bdbc0 con 0x7f4c60064690 2024-01-22T05:07:56.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.153+0000 7f4c5e000700 1 --2- 172.21.15.49:0/589337036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c60064690 0x7f4c60064af0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f4c48009790 tx=0x7f4c48009060).ready entity=mon.2 client_cookie=7b51419fba139efd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:56.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.157+0000 7f4c5d600700 1 -- 172.21.15.49:0/589337036 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800f510 con 0x7f4c60064690 2024-01-22T05:07:56.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.157+0000 7f4c5d600700 1 -- 172.21.15.49:0/589337036 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4800f670 con 0x7f4c60064690 2024-01-22T05:07:56.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.157+0000 7f4c5d600700 1 -- 172.21.15.49:0/589337036 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800f9f0 con 0x7f4c60064690 2024-01-22T05:07:56.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.157+0000 7f4c65e00700 1 -- 172.21.15.49:0/589337036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c60064690 msgr2=0x7f4c60064af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:56.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.157+0000 7f4c65e00700 1 --2- 172.21.15.49:0/589337036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c60064690 0x7f4c60064af0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f4c48009790 tx=0x7f4c48009060).stop 2024-01-22T05:07:56.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.157+0000 7f4c65e00700 1 -- 172.21.15.49:0/589337036 shutdown_connections 2024-01-22T05:07:56.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.157+0000 7f4c65e00700 1 --2- 172.21.15.49:0/589337036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c60064690 0x7f4c60064af0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:56.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.157+0000 7f4c65e00700 1 -- 172.21.15.49:0/589337036 >> 172.21.15.49:0/589337036 conn(0x7f4c600c87f0 msgr2=0x7f4c600c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:56.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.157+0000 7f4c65e00700 1 -- 172.21.15.49:0/589337036 shutdown_connections 2024-01-22T05:07:56.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.157+0000 7f4c65e00700 1 -- 172.21.15.49:0/589337036 wait complete. 2024-01-22T05:07:56.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.161+0000 7f4c65e00700 1 Processor -- start 2024-01-22T05:07:56.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.161+0000 7f4c65e00700 1 -- start start 2024-01-22T05:07:56.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.161+0000 7f4c65e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c60064690 0x7f4c60154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:56.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.161+0000 7f4c65e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c600be6a0 0x7f4c6014b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:56.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.161+0000 7f4c65e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c60151370 0x7f4c601658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:56.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.161+0000 7f4c65e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600bfa70 con 0x7f4c60151370 2024-01-22T05:07:56.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.161+0000 7f4c65e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600bee60 con 0x7f4c60064690 2024-01-22T05:07:56.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.161+0000 7f4c65e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600bf140 con 0x7f4c600be6a0 2024-01-22T05:07:56.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c5fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c60151370 0x7f4c601658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c5ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c60064690 0x7f4c60154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c5fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c60151370 0x7f4c601658a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40290/0 (socket says 172.21.15.49:40290) 2024-01-22T05:07:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c5fe00700 1 -- 172.21.15.49:0/2459677752 learned_addr learned my addr 172.21.15.49:0/2459677752 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c5e000700 1 --2- 172.21.15.49:0/2459677752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c600be6a0 0x7f4c6014b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c5ea00700 1 -- 172.21.15.49:0/2459677752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c600be6a0 msgr2=0x7f4c6014b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c5ea00700 1 --2- 172.21.15.49:0/2459677752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c600be6a0 0x7f4c6014b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c5ea00700 1 -- 172.21.15.49:0/2459677752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c60151370 msgr2=0x7f4c601658a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c5ea00700 1 --2- 172.21.15.49:0/2459677752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c60151370 0x7f4c601658a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c5ea00700 1 -- 172.21.15.49:0/2459677752 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c480092a0 con 0x7f4c60064690 2024-01-22T05:07:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c5fe00700 1 --2- 172.21.15.49:0/2459677752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c60151370 0x7f4c601658a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c5ea00700 1 --2- 172.21.15.49:0/2459677752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c60064690 0x7f4c60154940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f4c50001ed0 tx=0x7f4c50007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c56000700 1 -- 172.21.15.49:0/2459677752 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c500070d0 con 0x7f4c60064690 2024-01-22T05:07:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c56000700 1 -- 172.21.15.49:0/2459677752 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c50007230 con 0x7f4c60064690 2024-01-22T05:07:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c65e00700 1 -- 172.21.15.49:0/2459677752 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c600bf420 con 0x7f4c60064690 2024-01-22T05:07:56.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c56000700 1 -- 172.21.15.49:0/2459677752 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c500075f0 con 0x7f4c60064690 2024-01-22T05:07:56.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.165+0000 7f4c65e00700 1 -- 172.21.15.49:0/2459677752 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c60154e30 con 0x7f4c60064690 2024-01-22T05:07:56.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.169+0000 7f4c65e00700 1 -- 172.21.15.49:0/2459677752 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c60047060 con 0x7f4c60064690 2024-01-22T05:07:56.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.169+0000 7f4c56000700 1 -- 172.21.15.49:0/2459677752 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4c500059b0 con 0x7f4c60064690 2024-01-22T05:07:56.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.169+0000 7f4c56000700 1 --2- 172.21.15.49:0/2459677752 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c3805a510 0x7f4c3805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:56.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.169+0000 7f4c56000700 1 -- 172.21.15.49:0/2459677752 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f4c50073e00 con 0x7f4c60064690 2024-01-22T05:07:56.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.169+0000 7f4c5e000700 1 --2- 172.21.15.49:0/2459677752 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c3805a510 0x7f4c3805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:56.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.173+0000 7f4c5e000700 1 --2- 172.21.15.49:0/2459677752 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c3805a510 0x7f4c3805c9d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f4c480096e0 tx=0x7f4c48017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:56.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.177+0000 7f4c56000700 1 -- 172.21.15.49:0/2459677752 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c500476c0 con 0x7f4c60064690 2024-01-22T05:07:56.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.373+0000 7f4c65e00700 1 -- 172.21.15.49:0/2459677752 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c600bdea0 con 0x7f4c60064690 2024-01-22T05:07:56.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.377+0000 7f4c56000700 1 -- 172.21.15.49:0/2459677752 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f4c50018030 con 0x7f4c60064690 2024-01-22T05:07:56.378 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:07:56.378 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":36,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4066204164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":4066204164},{"type":"v1","addr":"172.21.15.110:6835","nonce":4066204164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/3793850760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3793850760},{"type":"v1","addr":"172.21.15.110:6834","nonce":3793850760}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/331321155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":331321155},{"type":"v1","addr":"172.21.15.49:6837","nonce":331321155}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5505,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2199921536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2199921536},{"type":"v1","addr":"172.21.15.49:6836","nonce":2199921536}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[]} 2024-01-22T05:07:56.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.377+0000 7f4c65e00700 1 -- 172.21.15.49:0/2459677752 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c3805a510 msgr2=0x7f4c3805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:56.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.377+0000 7f4c65e00700 1 --2- 172.21.15.49:0/2459677752 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c3805a510 0x7f4c3805c9d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f4c480096e0 tx=0x7f4c48017000).stop 2024-01-22T05:07:56.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.377+0000 7f4c65e00700 1 -- 172.21.15.49:0/2459677752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c60064690 msgr2=0x7f4c60154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:56.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.377+0000 7f4c65e00700 1 --2- 172.21.15.49:0/2459677752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c60064690 0x7f4c60154940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f4c50001ed0 tx=0x7f4c50007bd0).stop 2024-01-22T05:07:56.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.381+0000 7f4c65e00700 1 -- 172.21.15.49:0/2459677752 shutdown_connections 2024-01-22T05:07:56.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.381+0000 7f4c65e00700 1 --2- 172.21.15.49:0/2459677752 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c3805a510 0x7f4c3805c9d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:56.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.381+0000 7f4c65e00700 1 --2- 172.21.15.49:0/2459677752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c60151370 0x7f4c601658a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:56.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.381+0000 7f4c65e00700 1 --2- 172.21.15.49:0/2459677752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c600be6a0 0x7f4c6014b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:56.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.381+0000 7f4c65e00700 1 --2- 172.21.15.49:0/2459677752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c60064690 0x7f4c60154940 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:56.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.381+0000 7f4c65e00700 1 -- 172.21.15.49:0/2459677752 >> 172.21.15.49:0/2459677752 conn(0x7f4c600c87f0 msgr2=0x7f4c6014c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:56.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.381+0000 7f4c65e00700 1 -- 172.21.15.49:0/2459677752 shutdown_connections 2024-01-22T05:07:56.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.381+0000 7f4c65e00700 1 -- 172.21.15.49:0/2459677752 wait complete. 2024-01-22T05:07:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 36 2024-01-22T05:07:56.407 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:07:56.408 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-22T05:07:56.408 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:07:56.408 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:07:56.408 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:07:56.408 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-22T05:07:56.408 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:07:56.408 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:07:56.409 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:07:56.409 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-22T05:07:56.409 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:07:56.409 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:07:56.409 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:07:56.409 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-22T05:07:56.409 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:07:56.410 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:07:56.429 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:07:56.429 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:07:56.434 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:07:56.434 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:07:56.436 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:07:56.436 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:07:56.437 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:07:56.437 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:07:56.481 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:07:56.482 DEBUG:teuthology.parallel:result is None 2024-01-22T05:07:56.483 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:07:56.483 DEBUG:teuthology.parallel:result is None 2024-01-22T05:07:56.485 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:07:56.485 DEBUG:teuthology.parallel:result is None 2024-01-22T05:07:56.486 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:07:56.486 DEBUG:teuthology.parallel:result is None 2024-01-22T05:07:56.486 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-22T05:07:56.593 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:07:56.594 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-22T05:07:56.597 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:07:56.606 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:07:56.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.645+0000 7f939e800700 1 Processor -- start 2024-01-22T05:07:56.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.649+0000 7f939e800700 1 -- start start 2024-01-22T05:07:56.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.649+0000 7f939e800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93980c3690 0x7f93980c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:56.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.649+0000 7f939e800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f93980bf0b0 0x7f93981559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:56.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.649+0000 7f939e800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93980bdc10 con 0x7f9398155550 2024-01-22T05:07:56.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.649+0000 7f939e800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93980c3f60 con 0x7f93980c3690 2024-01-22T05:07:56.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.649+0000 7f939e800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9398155ea0 con 0x7f93980bf0b0 2024-01-22T05:07:56.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.649+0000 7f9397400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93980c3690 0x7f93980c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:56.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.649+0000 7f9397400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93980c3690 0x7f93980c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40318/0 (socket says 172.21.15.49:40318) 2024-01-22T05:07:56.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.649+0000 7f9397400700 1 -- 172.21.15.49:0/1171203934 learned_addr learned my addr 172.21.15.49:0/1171203934 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:56.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f9397e00700 1 --2- 172.21.15.49:0/1171203934 >> v2:172.21.15.110:3300/0 conn(0x7f93980bf0b0 0x7f93981559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:56.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f9397400700 1 -- 172.21.15.49:0/1171203934 >> v2:172.21.15.110:3300/0 conn(0x7f93980bf0b0 msgr2=0x7f93981559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:56.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f9397400700 1 --2- 172.21.15.49:0/1171203934 >> v2:172.21.15.110:3300/0 conn(0x7f93980bf0b0 0x7f93981559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:56.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f9397400700 1 -- 172.21.15.49:0/1171203934 >> v1:172.21.15.49:6789/0 conn(0x7f9398155550 legacy=0x7f9398067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:56.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f9397400700 1 -- 172.21.15.49:0/1171203934 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9398068e10 con 0x7f93980c3690 2024-01-22T05:07:56.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f9397e00700 1 --2- 172.21.15.49:0/1171203934 >> v2:172.21.15.110:3300/0 conn(0x7f93980bf0b0 0x7f93981559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:07:56.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f9397400700 1 --2- 172.21.15.49:0/1171203934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93980c3690 0x7f93980c3a70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f939805faf0 tx=0x7f93880090f0).ready entity=mon.0 client_cookie=bcc5a43e34304464 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:56.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f9396000700 1 -- 172.21.15.49:0/1171203934 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938800b600 con 0x7f93980c3690 2024-01-22T05:07:56.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f9396000700 1 -- 172.21.15.49:0/1171203934 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938800b760 con 0x7f93980c3690 2024-01-22T05:07:56.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f9396000700 1 -- 172.21.15.49:0/1171203934 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938800bae0 con 0x7f93980c3690 2024-01-22T05:07:56.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f939e800700 1 -- 172.21.15.49:0/1171203934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93980c3690 msgr2=0x7f93980c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:56.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f939e800700 1 --2- 172.21.15.49:0/1171203934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93980c3690 0x7f93980c3a70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f939805faf0 tx=0x7f93880090f0).stop 2024-01-22T05:07:56.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f939e800700 1 -- 172.21.15.49:0/1171203934 shutdown_connections 2024-01-22T05:07:56.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f939e800700 1 --2- 172.21.15.49:0/1171203934 >> v2:172.21.15.110:3300/0 conn(0x7f93980bf0b0 0x7f93981559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:56.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f939e800700 1 --2- 172.21.15.49:0/1171203934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93980c3690 0x7f93980c3a70 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:56.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f939e800700 1 -- 172.21.15.49:0/1171203934 >> 172.21.15.49:0/1171203934 conn(0x7f93980c51c0 msgr2=0x7f93980c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:56.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f939e800700 1 -- 172.21.15.49:0/1171203934 shutdown_connections 2024-01-22T05:07:56.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.653+0000 7f939e800700 1 -- 172.21.15.49:0/1171203934 wait complete. 2024-01-22T05:07:56.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.657+0000 7f939e800700 1 Processor -- start 2024-01-22T05:07:56.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.661+0000 7f939e800700 1 -- start start 2024-01-22T05:07:56.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.661+0000 7f939e800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93980bf0b0 0x7f93980ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:56.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.661+0000 7f939e800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93980c3690 0x7f93980ab900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:56.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.661+0000 7f939e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9398155550 0x7f93980a9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:56.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.661+0000 7f939e800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93980ad540 con 0x7f9398155550 2024-01-22T05:07:56.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.661+0000 7f939e800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93980addc0 con 0x7f93980bf0b0 2024-01-22T05:07:56.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.661+0000 7f939e800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93981689c0 con 0x7f93980c3690 2024-01-22T05:07:56.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.661+0000 7f9397e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9398155550 0x7f93980a9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:56.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.661+0000 7f9397e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9398155550 0x7f93980a9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40330/0 (socket says 172.21.15.49:40330) 2024-01-22T05:07:56.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.661+0000 7f9397e00700 1 -- 172.21.15.49:0/4090319079 learned_addr learned my addr 172.21.15.49:0/4090319079 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:56.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.661+0000 7f9397400700 1 --2- 172.21.15.49:0/4090319079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93980bf0b0 0x7f93980ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:56.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.661+0000 7f9396a00700 1 --2- 172.21.15.49:0/4090319079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93980c3690 0x7f93980ab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:56.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.665+0000 7f9397e00700 1 -- 172.21.15.49:0/4090319079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93980c3690 msgr2=0x7f93980ab900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:56.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.665+0000 7f9397e00700 1 --2- 172.21.15.49:0/4090319079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93980c3690 0x7f93980ab900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:56.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.665+0000 7f9397e00700 1 -- 172.21.15.49:0/4090319079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93980bf0b0 msgr2=0x7f93980ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:56.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.665+0000 7f9397e00700 1 --2- 172.21.15.49:0/4090319079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93980bf0b0 0x7f93980ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:56.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.665+0000 7f9397e00700 1 -- 172.21.15.49:0/4090319079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9388009370 con 0x7f9398155550 2024-01-22T05:07:56.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.665+0000 7f9397e00700 1 --2- 172.21.15.49:0/4090319079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9398155550 0x7f93980a9a40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f939000a380 tx=0x7f93900078f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:56.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.665+0000 7f938ea00700 1 -- 172.21.15.49:0/4090319079 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390016470 con 0x7f9398155550 2024-01-22T05:07:56.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.665+0000 7f938ea00700 1 -- 172.21.15.49:0/4090319079 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93900165d0 con 0x7f9398155550 2024-01-22T05:07:56.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.665+0000 7f938ea00700 1 -- 172.21.15.49:0/4090319079 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390016950 con 0x7f9398155550 2024-01-22T05:07:56.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.665+0000 7f939e800700 1 -- 172.21.15.49:0/4090319079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93980ad770 con 0x7f9398155550 2024-01-22T05:07:56.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.665+0000 7f939e800700 1 -- 172.21.15.49:0/4090319079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93980ae740 con 0x7f9398155550 2024-01-22T05:07:56.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.665+0000 7f939e800700 1 -- 172.21.15.49:0/4090319079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93980adf50 con 0x7f9398155550 2024-01-22T05:07:56.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.669+0000 7f938ea00700 1 -- 172.21.15.49:0/4090319079 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9390013070 con 0x7f9398155550 2024-01-22T05:07:56.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.669+0000 7f938ea00700 1 --2- 172.21.15.49:0/4090319079 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f937005a540 0x7f937005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:56.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.669+0000 7f938ea00700 1 -- 172.21.15.49:0/4090319079 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f9390074fc0 con 0x7f9398155550 2024-01-22T05:07:56.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.669+0000 7f9397400700 1 --2- 172.21.15.49:0/4090319079 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f937005a540 0x7f937005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:56.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.669+0000 7f9397400700 1 --2- 172.21.15.49:0/4090319079 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f937005a540 0x7f937005ca00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f9388009130 tx=0x7f9388017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:56.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.677+0000 7f938ea00700 1 -- 172.21.15.49:0/4090319079 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f93900a3b00 con 0x7f9398155550 2024-01-22T05:07:56.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:56.845+0000 7f939e800700 1 -- 172.21.15.49:0/4090319079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f93980690f0 con 0x7f9398155550 2024-01-22T05:07:57.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.640+0000 7f938ea00700 1 -- 172.21.15.49:0/4090319079 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v52) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9390048940 con 0x7f9398155550 2024-01-22T05:07:57.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.644+0000 7f939e800700 1 -- 172.21.15.49:0/4090319079 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f937005a540 msgr2=0x7f937005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:57.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.644+0000 7f939e800700 1 --2- 172.21.15.49:0/4090319079 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f937005a540 0x7f937005ca00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f9388009130 tx=0x7f9388017000).stop 2024-01-22T05:07:57.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.644+0000 7f939e800700 1 -- 172.21.15.49:0/4090319079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9398155550 msgr2=0x7f93980a9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:57.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.644+0000 7f939e800700 1 --2- 172.21.15.49:0/4090319079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9398155550 0x7f93980a9a40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f939000a380 tx=0x7f93900078f0).stop 2024-01-22T05:07:57.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.648+0000 7f939e800700 1 -- 172.21.15.49:0/4090319079 shutdown_connections 2024-01-22T05:07:57.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.648+0000 7f939e800700 1 --2- 172.21.15.49:0/4090319079 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f937005a540 0x7f937005ca00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:57.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.648+0000 7f939e800700 1 --2- 172.21.15.49:0/4090319079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9398155550 0x7f93980a9a40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:57.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.648+0000 7f939e800700 1 --2- 172.21.15.49:0/4090319079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93980c3690 0x7f93980ab900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:57.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.648+0000 7f939e800700 1 --2- 172.21.15.49:0/4090319079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93980bf0b0 0x7f93980ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:57.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.648+0000 7f939e800700 1 -- 172.21.15.49:0/4090319079 >> 172.21.15.49:0/4090319079 conn(0x7f93980c51c0 msgr2=0x7f939814d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:57.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.648+0000 7f939e800700 1 -- 172.21.15.49:0/4090319079 shutdown_connections 2024-01-22T05:07:57.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.648+0000 7f939e800700 1 -- 172.21.15.49:0/4090319079 wait complete. 2024-01-22T05:07:57.652 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-01-22T05:07:57.671 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-22T05:07:57.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.848+0000 7fa197600700 1 Processor -- start 2024-01-22T05:07:57.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.848+0000 7fa197600700 1 -- start start 2024-01-22T05:07:57.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa197600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1900bdfa0 0x7fa1900688f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:57.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa197600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa190153d60 0x7fa190064380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:57.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa197600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa190157b40 con 0x7fa190063f40 2024-01-22T05:07:57.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa197600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa190158610 con 0x7fa1900bdfa0 2024-01-22T05:07:57.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa197600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900bc740 con 0x7fa190153d60 2024-01-22T05:07:57.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa18fe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa190063f40 0x7fa190153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33632/0 (socket says 172.21.15.49:33632) 2024-01-22T05:07:57.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa18fe00700 1 -- 172.21.15.49:0/4002454989 learned_addr learned my addr 172.21.15.49:0/4002454989 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:57.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa194c00700 1 --2- 172.21.15.49:0/4002454989 >> v2:172.21.15.49:3300/0 conn(0x7fa1900bdfa0 0x7fa1900688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:57.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa195600700 1 --2- 172.21.15.49:0/4002454989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa190153d60 0x7fa190064380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:57.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa18f400700 1 -- 172.21.15.49:0/4002454989 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344069893 0 0) 0x7fa190157b40 con 0x7fa190063f40 2024-01-22T05:07:57.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa18f400700 1 -- 172.21.15.49:0/4002454989 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1700033f0 con 0x7fa190063f40 2024-01-22T05:07:57.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa195600700 1 -- 172.21.15.49:0/4002454989 >> v2:172.21.15.49:3300/0 conn(0x7fa1900bdfa0 msgr2=0x7fa1900688f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:57.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa195600700 1 --2- 172.21.15.49:0/4002454989 >> v2:172.21.15.49:3300/0 conn(0x7fa1900bdfa0 0x7fa1900688f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:57.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa195600700 1 -- 172.21.15.49:0/4002454989 >> v1:172.21.15.49:6789/0 conn(0x7fa190063f40 legacy=0x7fa190153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:57.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa195600700 1 -- 172.21.15.49:0/4002454989 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa190157d70 con 0x7fa190153d60 2024-01-22T05:07:57.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.852+0000 7fa195600700 1 --2- 172.21.15.49:0/4002454989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa190153d60 0x7fa190064380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa188009e60 tx=0x7fa188009780).ready entity=mon.2 client_cookie=cd4fcc3f2e98aa4c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:57.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.856+0000 7fa18f400700 1 -- 172.21.15.49:0/4002454989 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18800e070 con 0x7fa190153d60 2024-01-22T05:07:57.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.856+0000 7fa18f400700 1 -- 172.21.15.49:0/4002454989 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18800bab0 con 0x7fa190153d60 2024-01-22T05:07:57.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.856+0000 7fa18f400700 1 -- 172.21.15.49:0/4002454989 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18800be30 con 0x7fa190153d60 2024-01-22T05:07:57.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.856+0000 7fa197600700 1 -- 172.21.15.49:0/4002454989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa190153d60 msgr2=0x7fa190064380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:57.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.856+0000 7fa197600700 1 --2- 172.21.15.49:0/4002454989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa190153d60 0x7fa190064380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa188009e60 tx=0x7fa188009780).stop 2024-01-22T05:07:57.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.856+0000 7fa197600700 1 -- 172.21.15.49:0/4002454989 shutdown_connections 2024-01-22T05:07:57.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.856+0000 7fa197600700 1 --2- 172.21.15.49:0/4002454989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa190153d60 0x7fa190064380 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:57.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.856+0000 7fa197600700 1 --2- 172.21.15.49:0/4002454989 >> v2:172.21.15.49:3300/0 conn(0x7fa1900bdfa0 0x7fa1900688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:57.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.856+0000 7fa197600700 1 -- 172.21.15.49:0/4002454989 >> 172.21.15.49:0/4002454989 conn(0x7fa1900c40c0 msgr2=0x7fa1900c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:57.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.856+0000 7fa197600700 1 -- 172.21.15.49:0/4002454989 shutdown_connections 2024-01-22T05:07:57.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.856+0000 7fa197600700 1 -- 172.21.15.49:0/4002454989 wait complete. 2024-01-22T05:07:57.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.860+0000 7fa197600700 1 Processor -- start 2024-01-22T05:07:57.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.860+0000 7fa197600700 1 -- start start 2024-01-22T05:07:57.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa197600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa190063f40 0x7fa1900ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:57.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa197600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1900bdfa0 0x7fa190167940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:57.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa197600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa190153d60 0x7fa1900a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:57.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa197600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1901685e0 con 0x7fa1900bdfa0 2024-01-22T05:07:57.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa197600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900aab20 con 0x7fa190153d60 2024-01-22T05:07:57.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa197600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900aae00 con 0x7fa190063f40 2024-01-22T05:07:57.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa18fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1900bdfa0 0x7fa190167940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:57.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa194c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa190063f40 0x7fa1900ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:57.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa18fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1900bdfa0 0x7fa190167940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40342/0 (socket says 172.21.15.49:40342) 2024-01-22T05:07:57.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa18fe00700 1 -- 172.21.15.49:0/478469304 learned_addr learned my addr 172.21.15.49:0/478469304 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:57.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa195600700 1 --2- 172.21.15.49:0/478469304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa190153d60 0x7fa1900a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:57.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa18fe00700 1 -- 172.21.15.49:0/478469304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa190063f40 msgr2=0x7fa1900ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:57.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa18fe00700 1 --2- 172.21.15.49:0/478469304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa190063f40 0x7fa1900ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:57.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa18fe00700 1 -- 172.21.15.49:0/478469304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa190153d60 msgr2=0x7fa1900a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:57.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa18fe00700 1 --2- 172.21.15.49:0/478469304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa190153d60 0x7fa1900a7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:57.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa18fe00700 1 -- 172.21.15.49:0/478469304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa188009a20 con 0x7fa1900bdfa0 2024-01-22T05:07:57.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa194c00700 1 --2- 172.21.15.49:0/478469304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa190063f40 0x7fa1900ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:57.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa195600700 1 --2- 172.21.15.49:0/478469304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa190153d60 0x7fa1900a7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:07:57.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.864+0000 7fa18fe00700 1 --2- 172.21.15.49:0/478469304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1900bdfa0 0x7fa190167940 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fa17800c590 tx=0x7fa178007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:57.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.868+0000 7fa187e00700 1 -- 172.21.15.49:0/478469304 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1780072e0 con 0x7fa1900bdfa0 2024-01-22T05:07:57.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.868+0000 7fa187e00700 1 -- 172.21.15.49:0/478469304 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa178007440 con 0x7fa1900bdfa0 2024-01-22T05:07:57.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.868+0000 7fa197600700 1 -- 172.21.15.49:0/478469304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1900ab0e0 con 0x7fa1900bdfa0 2024-01-22T05:07:57.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.868+0000 7fa187e00700 1 -- 172.21.15.49:0/478469304 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1780057a0 con 0x7fa1900bdfa0 2024-01-22T05:07:57.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.868+0000 7fa197600700 1 -- 172.21.15.49:0/478469304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1900ab6a0 con 0x7fa1900bdfa0 2024-01-22T05:07:57.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.868+0000 7fa197600700 1 -- 172.21.15.49:0/478469304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1900ab8c0 con 0x7fa1900bdfa0 2024-01-22T05:07:57.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.872+0000 7fa187e00700 1 -- 172.21.15.49:0/478469304 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa178005bd0 con 0x7fa1900bdfa0 2024-01-22T05:07:57.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.872+0000 7fa187e00700 1 --2- 172.21.15.49:0/478469304 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa16805a510 0x7fa16805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:57.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.872+0000 7fa187e00700 1 -- 172.21.15.49:0/478469304 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fa178073ed0 con 0x7fa1900bdfa0 2024-01-22T05:07:57.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.872+0000 7fa194c00700 1 --2- 172.21.15.49:0/478469304 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa16805a510 0x7fa16805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:57.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.872+0000 7fa194c00700 1 --2- 172.21.15.49:0/478469304 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa16805a510 0x7fa16805c9d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fa180011310 tx=0x7fa180009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:57.876+0000 7fa187e00700 1 -- 172.21.15.49:0/478469304 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa1780477e0 con 0x7fa1900bdfa0 2024-01-22T05:07:58.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.096+0000 7fa197600700 1 -- 172.21.15.49:0/478469304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa190158050 con 0x7fa1900bdfa0 2024-01-22T05:07:58.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.096+0000 7fa187e00700 1 -- 172.21.15.49:0/478469304 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa17804ae00 con 0x7fa1900bdfa0 2024-01-22T05:07:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:07:58.099 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:07:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-01-22T05:07:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-01-22T05:07:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lTCfoJxAAxDGvXKXgooA9/f0J70s6AA==", 2024-01-22T05:07:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:07:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:07:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:07:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:07:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-01-22T05:07:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lHqV6ORAA1DwpPV2PyDBF/6/ePTdQJw==", 2024-01-22T05:07:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:07:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:07:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:07:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:07:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-01-22T05:07:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lPo86MhAAonfC3M+AkLldljODYNGzyA==", 2024-01-22T05:07:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:07:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:07:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:07:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:07:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-01-22T05:07:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lLwvMBxAAFm52HWeGbTH1gbWVm6r5zQ==", 2024-01-22T05:07:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:07:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:07:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:07:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:07:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAt961lH2F9NBAAHm8R9/Q5IuFUvb0o1GyD4Q==", 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAx961lS1lEIhAAuDm2OYfTYff1kVEq5vXvFw==", 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:07:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA1961limLvERAAv23crKrwjLIg84u48BHHbg==", 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA5961lShJiABAAnvyhz0ggDaITaMgwzi9kAA==", 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA9961lcopfNRAAAZgHzI1t7YHI5cAjaCMiNw==", 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBB961lX+nTIxAAtP3YQypuFWM5O/LADjvybA==", 2024-01-22T05:07:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBF961lQ4/XERAARZPqENsV3jokk2g3OXUI5w==", 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBI961luxnqOhAAGsV74DKQda5cetNA/woOnA==", 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lmrM6DhAAYU09HviWyrUIz4lio15wFw==", 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-01-22T05:07:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lIhYRGRAAFG+YtkDLFsra6zU44xKCHw==", 2024-01-22T05:07:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:07:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:07:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:07:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:07:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2024-01-22T05:07:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lRuyaExAAQO3a7ahOEcuE+WVfXYEBTg==", 2024-01-22T05:07:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:07:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:07:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:07:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:07:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2024-01-22T05:07:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lMiMkHhAAxPdKpcHdtqSphbc/2agq9Q==", 2024-01-22T05:07:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:07:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:07:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:07:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:07:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-01-22T05:07:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961ljsweARAAJrY3z/sBjayjB2BRQNrJew==", 2024-01-22T05:07:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:07:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:07:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:07:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:07:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-01-22T05:07:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961l0DwDIhAAeuCu79LxNMEJvWiW/BfDhA==", 2024-01-22T05:07:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:07:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:07:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:07:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2024-01-22T05:07:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lZlmPGxAA1KVZR+XzNdoFVo/980hD8w==", 2024-01-22T05:07:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:07:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:07:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:07:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:07:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-01-22T05:07:58.110 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:07:58.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.100+0000 7fa197600700 1 -- 172.21.15.49:0/478469304 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa16805a510 msgr2=0x7fa16805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:58.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.100+0000 7fa197600700 1 --2- 172.21.15.49:0/478469304 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa16805a510 0x7fa16805c9d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fa180011310 tx=0x7fa180009060).stop 2024-01-22T05:07:58.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.100+0000 7fa197600700 1 -- 172.21.15.49:0/478469304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1900bdfa0 msgr2=0x7fa190167940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:58.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.100+0000 7fa197600700 1 --2- 172.21.15.49:0/478469304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1900bdfa0 0x7fa190167940 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fa17800c590 tx=0x7fa178007c80).stop 2024-01-22T05:07:58.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.100+0000 7fa197600700 1 -- 172.21.15.49:0/478469304 shutdown_connections 2024-01-22T05:07:58.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.100+0000 7fa197600700 1 --2- 172.21.15.49:0/478469304 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa16805a510 0x7fa16805c9d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.100+0000 7fa197600700 1 --2- 172.21.15.49:0/478469304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa190153d60 0x7fa1900a7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.100+0000 7fa197600700 1 --2- 172.21.15.49:0/478469304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1900bdfa0 0x7fa190167940 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.100+0000 7fa197600700 1 --2- 172.21.15.49:0/478469304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa190063f40 0x7fa1900ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.100+0000 7fa197600700 1 -- 172.21.15.49:0/478469304 >> 172.21.15.49:0/478469304 conn(0x7fa1900c40c0 msgr2=0x7fa1900c6660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:58.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.100+0000 7fa197600700 1 -- 172.21.15.49:0/478469304 shutdown_connections 2024-01-22T05:07:58.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.100+0000 7fa197600700 1 -- 172.21.15.49:0/478469304 wait complete. 2024-01-22T05:07:58.125 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:07:58.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.284+0000 7f6e9d400700 1 Processor -- start 2024-01-22T05:07:58.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.288+0000 7f6e9d400700 1 -- start start 2024-01-22T05:07:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e9d400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6e980671d0 0x7f6e98153810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e9d400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e98157da0 0x7f6e98068570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e9d400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e980680e0 con 0x7f6e98153d00 2024-01-22T05:07:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e9d400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e98066c50 con 0x7f6e980671d0 2024-01-22T05:07:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e9d400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980a8df0 con 0x7f6e98157da0 2024-01-22T05:07:58.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e97e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6e980671d0 0x7f6e98153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:58.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e97e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6e980671d0 0x7f6e98153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40356/0 (socket says 172.21.15.49:40356) 2024-01-22T05:07:58.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e97e00700 1 -- 172.21.15.49:0/286050688 learned_addr learned my addr 172.21.15.49:0/286050688 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:58.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e9ca00700 1 --2- 172.21.15.49:0/286050688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e98157da0 0x7f6e98068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:58.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e97e00700 1 -- 172.21.15.49:0/286050688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e98157da0 msgr2=0x7f6e98068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:58.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e96a00700 1 -- 172.21.15.49:0/286050688 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1328509735 0 0) 0x7f6e980680e0 con 0x7f6e98153d00 2024-01-22T05:07:58.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e97e00700 1 --2- 172.21.15.49:0/286050688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e98157da0 0x7f6e98068570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e97e00700 1 -- 172.21.15.49:0/286050688 >> v1:172.21.15.110:6789/0 conn(0x7f6e98153d00 legacy=0x7f6e98157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:58.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e97e00700 1 -- 172.21.15.49:0/286050688 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e980a90d0 con 0x7f6e980671d0 2024-01-22T05:07:58.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e97e00700 1 --2- 172.21.15.49:0/286050688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e980671d0 0x7f6e98153810 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f6e88006fd0 tx=0x7f6e880090f0).ready entity=mon.0 client_cookie=8d3d74ddc6937cf2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:58.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e96a00700 1 -- 172.21.15.49:0/286050688 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8800b580 con 0x7f6e980671d0 2024-01-22T05:07:58.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e96a00700 1 -- 172.21.15.49:0/286050688 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8800b6e0 con 0x7f6e980671d0 2024-01-22T05:07:58.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.292+0000 7f6e96a00700 1 -- 172.21.15.49:0/286050688 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8800ba60 con 0x7f6e980671d0 2024-01-22T05:07:58.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.296+0000 7f6e9d400700 1 -- 172.21.15.49:0/286050688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e980671d0 msgr2=0x7f6e98153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:58.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.296+0000 7f6e9d400700 1 --2- 172.21.15.49:0/286050688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e980671d0 0x7f6e98153810 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f6e88006fd0 tx=0x7f6e880090f0).stop 2024-01-22T05:07:58.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.296+0000 7f6e9d400700 1 -- 172.21.15.49:0/286050688 shutdown_connections 2024-01-22T05:07:58.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.296+0000 7f6e9d400700 1 --2- 172.21.15.49:0/286050688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e98157da0 0x7f6e98068570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.296+0000 7f6e9d400700 1 --2- 172.21.15.49:0/286050688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e980671d0 0x7f6e98153810 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.296+0000 7f6e9d400700 1 -- 172.21.15.49:0/286050688 >> 172.21.15.49:0/286050688 conn(0x7f6e980c6530 msgr2=0x7f6e980c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:58.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.296+0000 7f6e9d400700 1 -- 172.21.15.49:0/286050688 shutdown_connections 2024-01-22T05:07:58.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.296+0000 7f6e9d400700 1 -- 172.21.15.49:0/286050688 wait complete. 2024-01-22T05:07:58.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.300+0000 7f6e9d400700 1 Processor -- start 2024-01-22T05:07:58.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.300+0000 7f6e9d400700 1 -- start start 2024-01-22T05:07:58.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.300+0000 7f6e9d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e980671d0 0x7f6e981680a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:58.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.300+0000 7f6e9d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e98153d00 0x7f6e980a7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:58.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e9d400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e98157da0 0x7f6e980a8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:58.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e9d400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980a8710 con 0x7f6e98153d00 2024-01-22T05:07:58.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e9d400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98153170 con 0x7f6e980671d0 2024-01-22T05:07:58.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e9d400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98168590 con 0x7f6e98157da0 2024-01-22T05:07:58.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e97400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e98153d00 0x7f6e980a7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:58.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e97400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e98153d00 0x7f6e980a7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40368/0 (socket says 172.21.15.49:40368) 2024-01-22T05:07:58.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e97400700 1 -- 172.21.15.49:0/3729575649 learned_addr learned my addr 172.21.15.49:0/3729575649 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:58.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e9ca00700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e98157da0 0x7f6e980a8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:58.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e97e00700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e980671d0 0x7f6e981680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e97400700 1 -- 172.21.15.49:0/3729575649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e98157da0 msgr2=0x7f6e980a8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e97400700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e98157da0 0x7f6e980a8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e97400700 1 -- 172.21.15.49:0/3729575649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e980671d0 msgr2=0x7f6e981680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e97400700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e980671d0 0x7f6e981680a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e97400700 1 -- 172.21.15.49:0/3729575649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e88009370 con 0x7f6e98153d00 2024-01-22T05:07:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e9ca00700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e98157da0 0x7f6e980a8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e97e00700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e980671d0 0x7f6e981680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e97400700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e98153d00 0x7f6e980a7d30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f6e80007fd0 tx=0x7f6e80007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e8f400700 1 -- 172.21.15.49:0/3729575649 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80012400 con 0x7f6e98153d00 2024-01-22T05:07:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e8f400700 1 -- 172.21.15.49:0/3729575649 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e80012580 con 0x7f6e98153d00 2024-01-22T05:07:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e8f400700 1 -- 172.21.15.49:0/3729575649 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80012940 con 0x7f6e98153d00 2024-01-22T05:07:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e9d400700 1 -- 172.21.15.49:0/3729575649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e98150eb0 con 0x7f6e98153d00 2024-01-22T05:07:58.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.304+0000 7f6e9d400700 1 -- 172.21.15.49:0/3729575649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e98151470 con 0x7f6e98153d00 2024-01-22T05:07:58.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.308+0000 7f6e9d400700 1 -- 172.21.15.49:0/3729575649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9805fd40 con 0x7f6e98153d00 2024-01-22T05:07:58.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.308+0000 7f6e8f400700 1 -- 172.21.15.49:0/3729575649 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6e80012cb0 con 0x7f6e98153d00 2024-01-22T05:07:58.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.308+0000 7f6e8f400700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e7005a510 0x7f6e7005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:58.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.312+0000 7f6e8f400700 1 -- 172.21.15.49:0/3729575649 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f6e800738a0 con 0x7f6e98153d00 2024-01-22T05:07:58.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.312+0000 7f6e97e00700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e7005a510 0x7f6e7005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:58.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.312+0000 7f6e97e00700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e7005a510 0x7f6e7005c9d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f6e88009fd0 tx=0x7f6e88017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:58.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.316+0000 7f6e8f400700 1 -- 172.21.15.49:0/3729575649 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6e80047320 con 0x7f6e98153d00 2024-01-22T05:07:58.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.484+0000 7f6e9d400700 1 -- 172.21.15.49:0/3729575649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e98067a90 con 0x7f6e98153d00 2024-01-22T05:07:58.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.484+0000 7f6e8f400700 1 -- 172.21.15.49:0/3729575649 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+13948 (secure 0 0 0) 0x7f6e8004a940 con 0x7f6e98153d00 2024-01-22T05:07:58.487 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:07:58.488 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":52,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:07:57.632731+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:07:58.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.488+0000 7f6e9d400700 1 -- 172.21.15.49:0/3729575649 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e7005a510 msgr2=0x7f6e7005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:58.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.488+0000 7f6e9d400700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e7005a510 0x7f6e7005c9d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f6e88009fd0 tx=0x7f6e88017000).stop 2024-01-22T05:07:58.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.488+0000 7f6e9d400700 1 -- 172.21.15.49:0/3729575649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e98153d00 msgr2=0x7f6e980a7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:58.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.488+0000 7f6e9d400700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e98153d00 0x7f6e980a7d30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f6e80007fd0 tx=0x7f6e80007c40).stop 2024-01-22T05:07:58.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.488+0000 7f6e9d400700 1 -- 172.21.15.49:0/3729575649 shutdown_connections 2024-01-22T05:07:58.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.488+0000 7f6e9d400700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e7005a510 0x7f6e7005c9d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.488+0000 7f6e9d400700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e98157da0 0x7f6e980a8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.488+0000 7f6e9d400700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e98153d00 0x7f6e980a7d30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.488+0000 7f6e9d400700 1 --2- 172.21.15.49:0/3729575649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e980671d0 0x7f6e981680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.488+0000 7f6e9d400700 1 -- 172.21.15.49:0/3729575649 >> 172.21.15.49:0/3729575649 conn(0x7f6e980c6530 msgr2=0x7f6e980c4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:58.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.488+0000 7f6e9d400700 1 -- 172.21.15.49:0/3729575649 shutdown_connections 2024-01-22T05:07:58.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.488+0000 7f6e9d400700 1 -- 172.21.15.49:0/3729575649 wait complete. 2024-01-22T05:07:58.513 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:07:58.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:07:58.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.700+0000 7f1b81a00700 1 Processor -- start 2024-01-22T05:07:58.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.700+0000 7f1b81a00700 1 -- start start 2024-01-22T05:07:58.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b81a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1b7c15c2d0 0x7f1b7c065900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:58.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b81a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b7c065df0 0x7f1b7c066200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:58.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b81a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7c069600 con 0x7f1b7c067a90 2024-01-22T05:07:58.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b81a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7c1561a0 con 0x7f1b7c065df0 2024-01-22T05:07:58.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b81a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7c068dd0 con 0x7f1b7c15c2d0 2024-01-22T05:07:58.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b7be00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1b7c067a90 0x7f1b7c15bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33638/0 (socket says 172.21.15.49:33638) 2024-01-22T05:07:58.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b7be00700 1 -- 172.21.15.49:0/3177209214 learned_addr learned my addr 172.21.15.49:0/3177209214 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:58.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b7b400700 1 --2- 172.21.15.49:0/3177209214 >> v2:172.21.15.110:3300/0 conn(0x7f1b7c15c2d0 0x7f1b7c065900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:58.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b81000700 1 --2- 172.21.15.49:0/3177209214 >> v2:172.21.15.49:3300/0 conn(0x7f1b7c065df0 0x7f1b7c066200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:58.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b7aa00700 1 -- 172.21.15.49:0/3177209214 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266851178 0 0) 0x7f1b7c069600 con 0x7f1b7c067a90 2024-01-22T05:07:58.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b7aa00700 1 -- 172.21.15.49:0/3177209214 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b5c0033f0 con 0x7f1b7c067a90 2024-01-22T05:07:58.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b81000700 1 -- 172.21.15.49:0/3177209214 >> v2:172.21.15.110:3300/0 conn(0x7f1b7c15c2d0 msgr2=0x7f1b7c065900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:58.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b81000700 1 --2- 172.21.15.49:0/3177209214 >> v2:172.21.15.110:3300/0 conn(0x7f1b7c15c2d0 0x7f1b7c065900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b81000700 1 -- 172.21.15.49:0/3177209214 >> v1:172.21.15.49:6789/0 conn(0x7f1b7c067a90 legacy=0x7f1b7c15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:58.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b81000700 1 -- 172.21.15.49:0/3177209214 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c0a90f0 con 0x7f1b7c065df0 2024-01-22T05:07:58.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.704+0000 7f1b7b400700 1 --2- 172.21.15.49:0/3177209214 >> v2:172.21.15.110:3300/0 conn(0x7f1b7c15c2d0 0x7f1b7c065900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:07:58.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.708+0000 7f1b81000700 1 --2- 172.21.15.49:0/3177209214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b7c065df0 0x7f1b7c066200 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f1b7c15ccb0 tx=0x7f1b74009780).ready entity=mon.0 client_cookie=3884e9e25a1b403f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:58.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.708+0000 7f1b7aa00700 1 -- 172.21.15.49:0/3177209214 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7400e070 con 0x7f1b7c065df0 2024-01-22T05:07:58.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.708+0000 7f1b7aa00700 1 -- 172.21.15.49:0/3177209214 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7400bab0 con 0x7f1b7c065df0 2024-01-22T05:07:58.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.708+0000 7f1b7aa00700 1 -- 172.21.15.49:0/3177209214 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7400be30 con 0x7f1b7c065df0 2024-01-22T05:07:58.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.708+0000 7f1b81a00700 1 -- 172.21.15.49:0/3177209214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b7c065df0 msgr2=0x7f1b7c066200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:58.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.708+0000 7f1b81a00700 1 --2- 172.21.15.49:0/3177209214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b7c065df0 0x7f1b7c066200 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f1b7c15ccb0 tx=0x7f1b74009780).stop 2024-01-22T05:07:58.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.708+0000 7f1b81a00700 1 -- 172.21.15.49:0/3177209214 shutdown_connections 2024-01-22T05:07:58.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.708+0000 7f1b81a00700 1 --2- 172.21.15.49:0/3177209214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b7c065df0 0x7f1b7c066200 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.708+0000 7f1b81a00700 1 --2- 172.21.15.49:0/3177209214 >> v2:172.21.15.110:3300/0 conn(0x7f1b7c15c2d0 0x7f1b7c065900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.708+0000 7f1b81a00700 1 -- 172.21.15.49:0/3177209214 >> 172.21.15.49:0/3177209214 conn(0x7f1b7c0c6fc0 msgr2=0x7f1b7c0c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:58.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.708+0000 7f1b81a00700 1 -- 172.21.15.49:0/3177209214 shutdown_connections 2024-01-22T05:07:58.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.708+0000 7f1b81a00700 1 -- 172.21.15.49:0/3177209214 wait complete. 2024-01-22T05:07:58.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.712+0000 7f1b81a00700 1 Processor -- start 2024-01-22T05:07:58.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81a00700 1 -- start start 2024-01-22T05:07:58.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b7c065df0 0x7f1b7c169750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:58.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b7c067a90 0x7f1b7c142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:58.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b7c15c2d0 0x7f1b7c0bf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:58.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c0aa510 con 0x7f1b7c15c2d0 2024-01-22T05:07:58.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c0bfed0 con 0x7f1b7c067a90 2024-01-22T05:07:58.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c0c01b0 con 0x7f1b7c065df0 2024-01-22T05:07:58.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b7c15c2d0 0x7f1b7c0bf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:58.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b7c15c2d0 0x7f1b7c0bf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40380/0 (socket says 172.21.15.49:40380) 2024-01-22T05:07:58.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81000700 1 -- 172.21.15.49:0/1580146643 learned_addr learned my addr 172.21.15.49:0/1580146643 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:58.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b7b400700 1 --2- 172.21.15.49:0/1580146643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b7c067a90 0x7f1b7c142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:58.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b7be00700 1 --2- 172.21.15.49:0/1580146643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b7c065df0 0x7f1b7c169750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:58.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81000700 1 -- 172.21.15.49:0/1580146643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b7c065df0 msgr2=0x7f1b7c169750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:58.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81000700 1 --2- 172.21.15.49:0/1580146643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b7c065df0 0x7f1b7c169750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81000700 1 -- 172.21.15.49:0/1580146643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b7c067a90 msgr2=0x7f1b7c142290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:58.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81000700 1 --2- 172.21.15.49:0/1580146643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b7c067a90 0x7f1b7c142290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81000700 1 -- 172.21.15.49:0/1580146643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640092a0 con 0x7f1b7c15c2d0 2024-01-22T05:07:58.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.716+0000 7f1b81000700 1 --2- 172.21.15.49:0/1580146643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b7c15c2d0 0x7f1b7c0bf580 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f1b7c1597b0 tx=0x7f1b74009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:58.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.720+0000 7f1b73400700 1 -- 172.21.15.49:0/1580146643 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b74012e70 con 0x7f1b7c15c2d0 2024-01-22T05:07:58.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.720+0000 7f1b73400700 1 -- 172.21.15.49:0/1580146643 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b74009440 con 0x7f1b7c15c2d0 2024-01-22T05:07:58.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.720+0000 7f1b81a00700 1 -- 172.21.15.49:0/1580146643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b74009a20 con 0x7f1b7c15c2d0 2024-01-22T05:07:58.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.720+0000 7f1b73400700 1 -- 172.21.15.49:0/1580146643 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7401d860 con 0x7f1b7c15c2d0 2024-01-22T05:07:58.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.720+0000 7f1b81a00700 1 -- 172.21.15.49:0/1580146643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7c0c0770 con 0x7f1b7c15c2d0 2024-01-22T05:07:58.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.720+0000 7f1b81a00700 1 -- 172.21.15.49:0/1580146643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7c0aa6c0 con 0x7f1b7c15c2d0 2024-01-22T05:07:58.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.724+0000 7f1b73400700 1 -- 172.21.15.49:0/1580146643 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1b7401dc90 con 0x7f1b7c15c2d0 2024-01-22T05:07:58.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.724+0000 7f1b73400700 1 --2- 172.21.15.49:0/1580146643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b5405a510 0x7f1b5405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:58.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.724+0000 7f1b73400700 1 -- 172.21.15.49:0/1580146643 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f1b74076360 con 0x7f1b7c15c2d0 2024-01-22T05:07:58.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.724+0000 7f1b7be00700 1 --2- 172.21.15.49:0/1580146643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b5405a510 0x7f1b5405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:58.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.728+0000 7f1b7be00700 1 --2- 172.21.15.49:0/1580146643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b5405a510 0x7f1b5405c9d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f1b6c007fd0 tx=0x7f1b6c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:58.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.732+0000 7f1b73400700 1 -- 172.21.15.49:0/1580146643 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1b7c0aa6c0 con 0x7f1b7c15c2d0 2024-01-22T05:07:58.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.904+0000 7f1b81a00700 1 -- 172.21.15.49:0/1580146643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1b7c0aa6c0 con 0x7f1b7c15c2d0 2024-01-22T05:07:58.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.904+0000 7f1b73400700 1 -- 172.21.15.49:0/1580146643 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v52) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1b7c0aa6c0 con 0x7f1b7c15c2d0 2024-01-22T05:07:58.909 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:07:58.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.908+0000 7f1b81a00700 1 -- 172.21.15.49:0/1580146643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b5405a510 msgr2=0x7f1b5405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:58.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.908+0000 7f1b81a00700 1 --2- 172.21.15.49:0/1580146643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b5405a510 0x7f1b5405c9d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f1b6c007fd0 tx=0x7f1b6c009040).stop 2024-01-22T05:07:58.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.908+0000 7f1b81a00700 1 -- 172.21.15.49:0/1580146643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b7c15c2d0 msgr2=0x7f1b7c0bf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:58.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.908+0000 7f1b81a00700 1 --2- 172.21.15.49:0/1580146643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b7c15c2d0 0x7f1b7c0bf580 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f1b7c1597b0 tx=0x7f1b74009780).stop 2024-01-22T05:07:58.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.908+0000 7f1b81a00700 1 -- 172.21.15.49:0/1580146643 shutdown_connections 2024-01-22T05:07:58.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.908+0000 7f1b81a00700 1 --2- 172.21.15.49:0/1580146643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b5405a510 0x7f1b5405c9d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.908+0000 7f1b81a00700 1 --2- 172.21.15.49:0/1580146643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b7c15c2d0 0x7f1b7c0bf580 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.908+0000 7f1b81a00700 1 --2- 172.21.15.49:0/1580146643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b7c067a90 0x7f1b7c142290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.908+0000 7f1b81a00700 1 --2- 172.21.15.49:0/1580146643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b7c065df0 0x7f1b7c169750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:58.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.908+0000 7f1b81a00700 1 -- 172.21.15.49:0/1580146643 >> 172.21.15.49:0/1580146643 conn(0x7f1b7c0c6fc0 msgr2=0x7f1b7c0c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:58.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.908+0000 7f1b81a00700 1 -- 172.21.15.49:0/1580146643 shutdown_connections 2024-01-22T05:07:58.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:58.908+0000 7f1b81a00700 1 -- 172.21.15.49:0/1580146643 wait complete. 2024-01-22T05:07:58.936 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:07:59.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.108+0000 7fcaa5800700 1 Processor -- start 2024-01-22T05:07:59.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.108+0000 7fcaa5800700 1 -- start start 2024-01-22T05:07:59.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.108+0000 7fcaa5800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcaa00a8c20 0x7fcaa00c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.108+0000 7fcaa5800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa0158650 con 0x7fcaa00bcbe0 2024-01-22T05:07:59.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.108+0000 7fcaa5800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa00c1f20 con 0x7fcaa00c1ac0 2024-01-22T05:07:59.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.108+0000 7fcaa5800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa00bd170 con 0x7fcaa00a8c20 2024-01-22T05:07:59.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.112+0000 7fca9ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcaa00a8c20 0x7fcaa00c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.112+0000 7fca9f400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcaa00bcbe0 0x7fcaa0068710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33646/0 (socket says 172.21.15.49:33646) 2024-01-22T05:07:59.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.112+0000 7fca9f400700 1 -- 172.21.15.49:0/2987252268 learned_addr learned my addr 172.21.15.49:0/2987252268 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:59.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.112+0000 7fca9ea00700 1 -- 172.21.15.49:0/2987252268 >> v1:172.21.15.110:6789/0 conn(0x7fcaa00c1ac0 legacy=0x7fcaa00bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.112+0000 7fca9ea00700 1 -- 172.21.15.49:0/2987252268 >> v1:172.21.15.49:6789/0 conn(0x7fcaa00bcbe0 legacy=0x7fcaa0068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.112+0000 7fca9ea00700 1 -- 172.21.15.49:0/2987252268 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa0067c30 con 0x7fcaa00a8c20 2024-01-22T05:07:59.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.112+0000 7fca9ea00700 1 --2- 172.21.15.49:0/2987252268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa00a8c20 0x7fcaa00c15d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fca90009760 tx=0x7fca90009060).ready entity=mon.0 client_cookie=7d857c80974dc94a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.112+0000 7fca9d600700 1 -- 172.21.15.49:0/2987252268 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9000b580 con 0x7fcaa00a8c20 2024-01-22T05:07:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.112+0000 7fca9d600700 1 -- 172.21.15.49:0/2987252268 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9000b6e0 con 0x7fcaa00a8c20 2024-01-22T05:07:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.112+0000 7fca9d600700 1 -- 172.21.15.49:0/2987252268 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9000ba60 con 0x7fcaa00a8c20 2024-01-22T05:07:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.112+0000 7fcaa5800700 1 -- 172.21.15.49:0/2987252268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa00a8c20 msgr2=0x7fcaa00c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.112+0000 7fcaa5800700 1 --2- 172.21.15.49:0/2987252268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa00a8c20 0x7fcaa00c15d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fca90009760 tx=0x7fca90009060).stop 2024-01-22T05:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.112+0000 7fcaa5800700 1 -- 172.21.15.49:0/2987252268 shutdown_connections 2024-01-22T05:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.112+0000 7fcaa5800700 1 --2- 172.21.15.49:0/2987252268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa00a8c20 0x7fcaa00c15d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.112+0000 7fcaa5800700 1 -- 172.21.15.49:0/2987252268 >> 172.21.15.49:0/2987252268 conn(0x7fcaa0062cb0 msgr2=0x7fcaa00c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.116+0000 7fcaa5800700 1 -- 172.21.15.49:0/2987252268 shutdown_connections 2024-01-22T05:07:59.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.116+0000 7fcaa5800700 1 -- 172.21.15.49:0/2987252268 wait complete. 2024-01-22T05:07:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.120+0000 7fcaa5800700 1 Processor -- start 2024-01-22T05:07:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.120+0000 7fcaa5800700 1 -- start start 2024-01-22T05:07:59.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.120+0000 7fcaa5800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa00a8c20 0x7fcaa0154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.120+0000 7fcaa5800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcaa00bcbe0 0x7fcaa00be090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.120+0000 7fcaa5800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaa00c1ac0 0x7fcaa00bf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.120+0000 7fcaa5800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00be9e0 con 0x7fcaa00a8c20 2024-01-22T05:07:59.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.120+0000 7fcaa5800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00becc0 con 0x7fcaa00c1ac0 2024-01-22T05:07:59.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.120+0000 7fcaa5800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00befa0 con 0x7fcaa00bcbe0 2024-01-22T05:07:59.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fca9ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa00a8c20 0x7fcaa0154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fca9ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa00a8c20 0x7fcaa0154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40400/0 (socket says 172.21.15.49:40400) 2024-01-22T05:07:59.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fca9ea00700 1 -- 172.21.15.49:0/1898226357 learned_addr learned my addr 172.21.15.49:0/1898226357 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:59.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fca9f400700 1 --2- 172.21.15.49:0/1898226357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaa00c1ac0 0x7fcaa00bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fca9e000700 1 --2- 172.21.15.49:0/1898226357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcaa00bcbe0 0x7fcaa00be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fca9ea00700 1 -- 172.21.15.49:0/1898226357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcaa00bcbe0 msgr2=0x7fcaa00be090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fca9ea00700 1 --2- 172.21.15.49:0/1898226357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcaa00bcbe0 0x7fcaa00be090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fca9ea00700 1 -- 172.21.15.49:0/1898226357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaa00c1ac0 msgr2=0x7fcaa00bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fca9ea00700 1 --2- 172.21.15.49:0/1898226357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaa00c1ac0 0x7fcaa00bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fca9ea00700 1 -- 172.21.15.49:0/1898226357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca900092a0 con 0x7fcaa00a8c20 2024-01-22T05:07:59.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fca9ea00700 1 --2- 172.21.15.49:0/1898226357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa00a8c20 0x7fcaa0154b40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fca90009eb0 tx=0x7fca90017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:59.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fca96000700 1 -- 172.21.15.49:0/1898226357 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9000ba60 con 0x7fcaa00a8c20 2024-01-22T05:07:59.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fca96000700 1 -- 172.21.15.49:0/1898226357 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca90000c90 con 0x7fcaa00a8c20 2024-01-22T05:07:59.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fcaa5800700 1 -- 172.21.15.49:0/1898226357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa0158890 con 0x7fcaa00a8c20 2024-01-22T05:07:59.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fca96000700 1 -- 172.21.15.49:0/1898226357 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9001b620 con 0x7fcaa00a8c20 2024-01-22T05:07:59.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fcaa5800700 1 -- 172.21.15.49:0/1898226357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa00be580 con 0x7fcaa00a8c20 2024-01-22T05:07:59.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.124+0000 7fcaa5800700 1 -- 172.21.15.49:0/1898226357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa0158ad0 con 0x7fcaa00a8c20 2024-01-22T05:07:59.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.128+0000 7fca96000700 1 -- 172.21.15.49:0/1898226357 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fca9001b9d0 con 0x7fcaa00a8c20 2024-01-22T05:07:59.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.132+0000 7fca96000700 1 --2- 172.21.15.49:0/1898226357 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca7805a510 0x7fca7805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.132+0000 7fca96000700 1 -- 172.21.15.49:0/1898226357 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fca900765b0 con 0x7fcaa00a8c20 2024-01-22T05:07:59.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.132+0000 7fca9e000700 1 --2- 172.21.15.49:0/1898226357 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca7805a510 0x7fca7805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.132+0000 7fca9e000700 1 --2- 172.21.15.49:0/1898226357 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca7805a510 0x7fca7805c9d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fca88007fd0 tx=0x7fca88009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:59.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.136+0000 7fca96000700 1 -- 172.21.15.49:0/1898226357 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fca9004a020 con 0x7fcaa00a8c20 2024-01-22T05:07:59.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.300+0000 7fcaa5800700 1 -- 172.21.15.49:0/1898226357 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcaa00be770 con 0x7fcaa00a8c20 2024-01-22T05:07:59.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.304+0000 7fca96000700 1 -- 172.21.15.49:0/1898226357 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v52) v1 ==== 92+0+10 (secure 0 0 0) 0x7fca90006c70 con 0x7fcaa00a8c20 2024-01-22T05:07:59.307 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:07:59.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.308+0000 7fcaa5800700 1 -- 172.21.15.49:0/1898226357 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca7805a510 msgr2=0x7fca7805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.308+0000 7fcaa5800700 1 --2- 172.21.15.49:0/1898226357 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca7805a510 0x7fca7805c9d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fca88007fd0 tx=0x7fca88009040).stop 2024-01-22T05:07:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.308+0000 7fcaa5800700 1 -- 172.21.15.49:0/1898226357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa00a8c20 msgr2=0x7fcaa0154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.308+0000 7fcaa5800700 1 --2- 172.21.15.49:0/1898226357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa00a8c20 0x7fcaa0154b40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fca90009eb0 tx=0x7fca90017000).stop 2024-01-22T05:07:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.308+0000 7fcaa5800700 1 -- 172.21.15.49:0/1898226357 shutdown_connections 2024-01-22T05:07:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.308+0000 7fcaa5800700 1 --2- 172.21.15.49:0/1898226357 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca7805a510 0x7fca7805c9d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.308+0000 7fcaa5800700 1 --2- 172.21.15.49:0/1898226357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaa00c1ac0 0x7fcaa00bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.308+0000 7fcaa5800700 1 --2- 172.21.15.49:0/1898226357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcaa00bcbe0 0x7fcaa00be090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.308+0000 7fcaa5800700 1 --2- 172.21.15.49:0/1898226357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa00a8c20 0x7fcaa0154b40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.308+0000 7fcaa5800700 1 -- 172.21.15.49:0/1898226357 >> 172.21.15.49:0/1898226357 conn(0x7fcaa0062cb0 msgr2=0x7fcaa00c4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:59.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.308+0000 7fcaa5800700 1 -- 172.21.15.49:0/1898226357 shutdown_connections 2024-01-22T05:07:59.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.308+0000 7fcaa5800700 1 -- 172.21.15.49:0/1898226357 wait complete. 2024-01-22T05:07:59.333 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:07:59.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.492+0000 7fe561600700 1 Processor -- start 2024-01-22T05:07:59.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.492+0000 7fe561600700 1 -- start start 2024-01-22T05:07:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.496+0000 7fe561600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c0bcc50 0x7fe55c0bd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.496+0000 7fe561600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe55c0a8740 0x7fe55c0a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.496+0000 7fe561600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe55c1544a0 0x7fe55c154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.496+0000 7fe561600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55c0bc960 con 0x7fe55c0a8740 2024-01-22T05:07:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.496+0000 7fe561600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55c0bc4d0 con 0x7fe55c1544a0 2024-01-22T05:07:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.496+0000 7fe561600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c0a9070 con 0x7fe55c0bcc50 2024-01-22T05:07:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.496+0000 7fe55a000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe55c0a8740 0x7fe55c0a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.496+0000 7fe55a000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe55c0a8740 0x7fe55c0a8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40406/0 (socket says 172.21.15.49:40406) 2024-01-22T05:07:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.496+0000 7fe55a000700 1 -- 172.21.15.49:0/2992183478 learned_addr learned my addr 172.21.15.49:0/2992183478 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.496+0000 7fe55b400700 1 --2- 172.21.15.49:0/2992183478 >> v2:172.21.15.110:3300/0 conn(0x7fe55c1544a0 0x7fe55c154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.496+0000 7fe55aa00700 1 --2- 172.21.15.49:0/2992183478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c0bcc50 0x7fe55c0bd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.496+0000 7fe55a000700 1 -- 172.21.15.49:0/2992183478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c0bcc50 msgr2=0x7fe55c0bd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.496+0000 7fe55a000700 1 --2- 172.21.15.49:0/2992183478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c0bcc50 0x7fe55c0bd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.496+0000 7fe55a000700 1 -- 172.21.15.49:0/2992183478 >> v2:172.21.15.110:3300/0 conn(0x7fe55c1544a0 msgr2=0x7fe55c154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:07:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.496+0000 7fe55a000700 1 --2- 172.21.15.49:0/2992183478 >> v2:172.21.15.110:3300/0 conn(0x7fe55c1544a0 0x7fe55c154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.500+0000 7fe55a000700 1 -- 172.21.15.49:0/2992183478 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c0bb8c0 con 0x7fe55c0a8740 2024-01-22T05:07:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.500+0000 7fe55a000700 1 --2- 172.21.15.49:0/2992183478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c0a8740 0x7fe55c0a8b80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fe55c067730 tx=0x7fe5440090f0).ready entity=mon.0 client_cookie=8b52c2729f6f270d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.500+0000 7fe559600700 1 -- 172.21.15.49:0/2992183478 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54400f510 con 0x7fe55c0a8740 2024-01-22T05:07:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.500+0000 7fe559600700 1 -- 172.21.15.49:0/2992183478 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54400f670 con 0x7fe55c0a8740 2024-01-22T05:07:59.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.500+0000 7fe559600700 1 -- 172.21.15.49:0/2992183478 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54400fa10 con 0x7fe55c0a8740 2024-01-22T05:07:59.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.500+0000 7fe561600700 1 -- 172.21.15.49:0/2992183478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c0a8740 msgr2=0x7fe55c0a8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.500+0000 7fe561600700 1 --2- 172.21.15.49:0/2992183478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c0a8740 0x7fe55c0a8b80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fe55c067730 tx=0x7fe5440090f0).stop 2024-01-22T05:07:59.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.500+0000 7fe561600700 1 -- 172.21.15.49:0/2992183478 shutdown_connections 2024-01-22T05:07:59.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.500+0000 7fe561600700 1 --2- 172.21.15.49:0/2992183478 >> v2:172.21.15.110:3300/0 conn(0x7fe55c1544a0 0x7fe55c154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.500+0000 7fe561600700 1 --2- 172.21.15.49:0/2992183478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c0a8740 0x7fe55c0a8b80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.500+0000 7fe561600700 1 --2- 172.21.15.49:0/2992183478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c0bcc50 0x7fe55c0bd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.500+0000 7fe561600700 1 -- 172.21.15.49:0/2992183478 >> 172.21.15.49:0/2992183478 conn(0x7fe55c0c6540 msgr2=0x7fe55c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.500+0000 7fe561600700 1 -- 172.21.15.49:0/2992183478 shutdown_connections 2024-01-22T05:07:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.500+0000 7fe561600700 1 -- 172.21.15.49:0/2992183478 wait complete. 2024-01-22T05:07:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.504+0000 7fe561600700 1 Processor -- start 2024-01-22T05:07:59.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.504+0000 7fe561600700 1 -- start start 2024-01-22T05:07:59.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.504+0000 7fe561600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe55c0a8740 0x7fe55c14d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.504+0000 7fe561600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c0bcc50 0x7fe55c0bef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.504+0000 7fe561600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c1544a0 0x7fe55c153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.504+0000 7fe561600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c0bff60 con 0x7fe55c0bcc50 2024-01-22T05:07:59.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.504+0000 7fe561600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c151160 con 0x7fe55c0a8740 2024-01-22T05:07:59.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.504+0000 7fe561600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c14dc40 con 0x7fe55c1544a0 2024-01-22T05:07:59.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe55a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c0bcc50 0x7fe55c0bef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe55a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c0bcc50 0x7fe55c0bef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40412/0 (socket says 172.21.15.49:40412) 2024-01-22T05:07:59.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe55a000700 1 -- 172.21.15.49:0/3878558428 learned_addr learned my addr 172.21.15.49:0/3878558428 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:59.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe55aa00700 1 --2- 172.21.15.49:0/3878558428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe55c0a8740 0x7fe55c14d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe55b400700 1 --2- 172.21.15.49:0/3878558428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c1544a0 0x7fe55c153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe55a000700 1 -- 172.21.15.49:0/3878558428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c1544a0 msgr2=0x7fe55c153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe55a000700 1 --2- 172.21.15.49:0/3878558428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c1544a0 0x7fe55c153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe55a000700 1 -- 172.21.15.49:0/3878558428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe55c0a8740 msgr2=0x7fe55c14d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe55a000700 1 --2- 172.21.15.49:0/3878558428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe55c0a8740 0x7fe55c14d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe55a000700 1 -- 172.21.15.49:0/3878558428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe544009370 con 0x7fe55c0bcc50 2024-01-22T05:07:59.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe55b400700 1 --2- 172.21.15.49:0/3878558428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c1544a0 0x7fe55c153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:07:59.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe55a000700 1 --2- 172.21.15.49:0/3878558428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c0bcc50 0x7fe55c0bef80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fe55c0647c0 tx=0x7fe544017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:59.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe552000700 1 -- 172.21.15.49:0/3878558428 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544000bc0 con 0x7fe55c0bcc50 2024-01-22T05:07:59.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe552000700 1 -- 172.21.15.49:0/3878558428 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54400f7e0 con 0x7fe55c0bcc50 2024-01-22T05:07:59.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe552000700 1 -- 172.21.15.49:0/3878558428 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544000d20 con 0x7fe55c0bcc50 2024-01-22T05:07:59.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe561600700 1 -- 172.21.15.49:0/3878558428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55c0bf9a0 con 0x7fe55c0bcc50 2024-01-22T05:07:59.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe561600700 1 -- 172.21.15.49:0/3878558428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55c150df0 con 0x7fe55c0bcc50 2024-01-22T05:07:59.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.508+0000 7fe561600700 1 -- 172.21.15.49:0/3878558428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55c150c50 con 0x7fe55c0bcc50 2024-01-22T05:07:59.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.512+0000 7fe552000700 1 -- 172.21.15.49:0/3878558428 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe544021070 con 0x7fe55c0bcc50 2024-01-22T05:07:59.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.512+0000 7fe552000700 1 --2- 172.21.15.49:0/3878558428 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe53405a510 0x7fe53405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.512+0000 7fe552000700 1 -- 172.21.15.49:0/3878558428 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fe544075f50 con 0x7fe55c0bcc50 2024-01-22T05:07:59.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.512+0000 7fe55aa00700 1 --2- 172.21.15.49:0/3878558428 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe53405a510 0x7fe53405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.512+0000 7fe55aa00700 1 --2- 172.21.15.49:0/3878558428 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe53405a510 0x7fe53405c9d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fe54c009b90 tx=0x7fe54c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:59.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.520+0000 7fe552000700 1 -- 172.21.15.49:0/3878558428 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe55c150c50 con 0x7fe55c0bcc50 2024-01-22T05:07:59.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.696+0000 7fe561600700 1 -- 172.21.15.49:0/3878558428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe55c1512f0 con 0x7fe55c0bcc50 2024-01-22T05:07:59.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.700+0000 7fe552000700 1 -- 172.21.15.49:0/3878558428 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v52) v1 ==== 84+0+143 (secure 0 0 0) 0x7fe544029070 con 0x7fe55c0bcc50 2024-01-22T05:07:59.701 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:07:59.702 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-22T05:07:59.702 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:59.702 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-01-22T05:07:59.702 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2024-01-22T05:07:59.702 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:07:59.702 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:07:59.702 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2024-01-22T05:07:59.702 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2024-01-22T05:07:59.702 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:07:59.702 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-22T05:07:59.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.700+0000 7fe561600700 1 -- 172.21.15.49:0/3878558428 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe53405a510 msgr2=0x7fe53405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.700+0000 7fe561600700 1 --2- 172.21.15.49:0/3878558428 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe53405a510 0x7fe53405c9d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fe54c009b90 tx=0x7fe54c009060).stop 2024-01-22T05:07:59.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.700+0000 7fe561600700 1 -- 172.21.15.49:0/3878558428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c0bcc50 msgr2=0x7fe55c0bef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.700+0000 7fe561600700 1 --2- 172.21.15.49:0/3878558428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c0bcc50 0x7fe55c0bef80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fe55c0647c0 tx=0x7fe544017000).stop 2024-01-22T05:07:59.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.704+0000 7fe561600700 1 -- 172.21.15.49:0/3878558428 shutdown_connections 2024-01-22T05:07:59.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.704+0000 7fe561600700 1 --2- 172.21.15.49:0/3878558428 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe53405a510 0x7fe53405c9d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.704+0000 7fe561600700 1 --2- 172.21.15.49:0/3878558428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c1544a0 0x7fe55c153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.704+0000 7fe561600700 1 --2- 172.21.15.49:0/3878558428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c0bcc50 0x7fe55c0bef80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.704+0000 7fe561600700 1 --2- 172.21.15.49:0/3878558428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe55c0a8740 0x7fe55c14d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.704+0000 7fe561600700 1 -- 172.21.15.49:0/3878558428 >> 172.21.15.49:0/3878558428 conn(0x7fe55c0c6540 msgr2=0x7fe55c150120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:59.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.704+0000 7fe561600700 1 -- 172.21.15.49:0/3878558428 shutdown_connections 2024-01-22T05:07:59.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.704+0000 7fe561600700 1 -- 172.21.15.49:0/3878558428 wait complete. 2024-01-22T05:07:59.728 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:07:59.728 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:07:59.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.892+0000 7f9151600700 1 Processor -- start 2024-01-22T05:07:59.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.892+0000 7f9151600700 1 -- start start 2024-01-22T05:07:59.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.896+0000 7f9151600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f914c153d80 0x7f914c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.896+0000 7f9151600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914c068740 con 0x7f914c0690c0 2024-01-22T05:07:59.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.896+0000 7f9151600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914c067b30 con 0x7f914c0c3980 2024-01-22T05:07:59.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.896+0000 7f9151600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c1585b0 con 0x7f914c153d80 2024-01-22T05:07:59.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.896+0000 7f914a000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f914c0690c0 0x7f914c0c3270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33654/0 (socket says 172.21.15.49:33654) 2024-01-22T05:07:59.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.896+0000 7f914a000700 1 -- 172.21.15.49:0/3599440581 learned_addr learned my addr 172.21.15.49:0/3599440581 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:07:59.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.896+0000 7f914aa00700 1 --2- 172.21.15.49:0/3599440581 >> v2:172.21.15.110:3300/0 conn(0x7f914c153d80 0x7f914c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.896+0000 7f9149600700 1 -- 172.21.15.49:0/3599440581 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262152190 0 0) 0x7f914c068740 con 0x7f914c0690c0 2024-01-22T05:07:59.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.896+0000 7f9149600700 1 -- 172.21.15.49:0/3599440581 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f912c0033f0 con 0x7f914c0690c0 2024-01-22T05:07:59.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.896+0000 7f9149600700 1 -- 172.21.15.49:0/3599440581 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747205181 0 0) 0x7f914c067b30 con 0x7f914c0c3980 2024-01-22T05:07:59.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.896+0000 7f9149600700 1 -- 172.21.15.49:0/3599440581 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f914c068740 con 0x7f914c0c3980 2024-01-22T05:07:59.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.896+0000 7f914aa00700 1 -- 172.21.15.49:0/3599440581 >> v1:172.21.15.110:6789/0 conn(0x7f914c0c3980 legacy=0x7f914c157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.896+0000 7f914aa00700 1 -- 172.21.15.49:0/3599440581 >> v1:172.21.15.49:6789/0 conn(0x7f914c0690c0 legacy=0x7f914c0c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.896+0000 7f914aa00700 1 -- 172.21.15.49:0/3599440581 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c067e10 con 0x7f914c153d80 2024-01-22T05:07:59.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.900+0000 7f914aa00700 1 --2- 172.21.15.49:0/3599440581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f914c153d80 0x7f914c068bd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f913c006fd0 tx=0x7f913c006f40).ready entity=mon.1 client_cookie=80b36e41054b7159 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:59.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.900+0000 7f9149600700 1 -- 172.21.15.49:0/3599440581 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c005880 con 0x7f914c153d80 2024-01-22T05:07:59.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.900+0000 7f9149600700 1 -- 172.21.15.49:0/3599440581 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c0059e0 con 0x7f914c153d80 2024-01-22T05:07:59.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.900+0000 7f9149600700 1 -- 172.21.15.49:0/3599440581 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c005d60 con 0x7f914c153d80 2024-01-22T05:07:59.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.900+0000 7f9151600700 1 -- 172.21.15.49:0/3599440581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f914c153d80 msgr2=0x7f914c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.900+0000 7f9151600700 1 --2- 172.21.15.49:0/3599440581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f914c153d80 0x7f914c068bd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f913c006fd0 tx=0x7f913c006f40).stop 2024-01-22T05:07:59.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.900+0000 7f9151600700 1 -- 172.21.15.49:0/3599440581 shutdown_connections 2024-01-22T05:07:59.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.900+0000 7f9151600700 1 --2- 172.21.15.49:0/3599440581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f914c153d80 0x7f914c068bd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.900+0000 7f9151600700 1 -- 172.21.15.49:0/3599440581 >> 172.21.15.49:0/3599440581 conn(0x7f914c0c8710 msgr2=0x7f914c0c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:07:59.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.900+0000 7f9151600700 1 -- 172.21.15.49:0/3599440581 shutdown_connections 2024-01-22T05:07:59.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.900+0000 7f9151600700 1 -- 172.21.15.49:0/3599440581 wait complete. 2024-01-22T05:07:59.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.904+0000 7f9151600700 1 Processor -- start 2024-01-22T05:07:59.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f9151600700 1 -- start start 2024-01-22T05:07:59.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f9151600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0690c0 0x7f914c0c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f9151600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f914c0c3980 0x7f914c150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f9151600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f914c153d80 0x7f914c151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f9151600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c150a90 con 0x7f914c0690c0 2024-01-22T05:07:59.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f9151600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c14fec0 con 0x7f914c0c3980 2024-01-22T05:07:59.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f9151600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c150160 con 0x7f914c153d80 2024-01-22T05:07:59.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f914aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0690c0 0x7f914c0c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f914aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0690c0 0x7f914c0c7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40424/0 (socket says 172.21.15.49:40424) 2024-01-22T05:07:59.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f914aa00700 1 -- 172.21.15.49:0/3423739120 learned_addr learned my addr 172.21.15.49:0/3423739120 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:07:59.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f914a000700 1 --2- 172.21.15.49:0/3423739120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f914c0c3980 0x7f914c150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f914b400700 1 --2- 172.21.15.49:0/3423739120 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f914c153d80 0x7f914c151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f914aa00700 1 -- 172.21.15.49:0/3423739120 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f914c153d80 msgr2=0x7f914c151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f914aa00700 1 --2- 172.21.15.49:0/3423739120 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f914c153d80 0x7f914c151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f914aa00700 1 -- 172.21.15.49:0/3423739120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f914c0c3980 msgr2=0x7f914c150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:07:59.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f914aa00700 1 --2- 172.21.15.49:0/3423739120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f914c0c3980 0x7f914c150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:07:59.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f914aa00700 1 -- 172.21.15.49:0/3423739120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c009250 con 0x7f914c0690c0 2024-01-22T05:07:59.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f914aa00700 1 --2- 172.21.15.49:0/3423739120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0690c0 0x7f914c0c7820 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f913c006fa0 tx=0x7f913c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:59.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f9142000700 1 -- 172.21.15.49:0/3423739120 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c00d6b0 con 0x7f914c0690c0 2024-01-22T05:07:59.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f9142000700 1 -- 172.21.15.49:0/3423739120 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c00d810 con 0x7f914c0690c0 2024-01-22T05:07:59.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f9142000700 1 -- 172.21.15.49:0/3423739120 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c00dbb0 con 0x7f914c0690c0 2024-01-22T05:07:59.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.908+0000 7f9151600700 1 -- 172.21.15.49:0/3423739120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c150440 con 0x7f914c0690c0 2024-01-22T05:07:59.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.912+0000 7f9151600700 1 -- 172.21.15.49:0/3423739120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c151860 con 0x7f914c0690c0 2024-01-22T05:07:59.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.912+0000 7f9151600700 1 -- 172.21.15.49:0/3423739120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c047060 con 0x7f914c0690c0 2024-01-22T05:07:59.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.912+0000 7f9142000700 1 -- 172.21.15.49:0/3423739120 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f913c0113f0 con 0x7f914c0690c0 2024-01-22T05:07:59.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.916+0000 7f9142000700 1 --2- 172.21.15.49:0/3423739120 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f912405a510 0x7f912405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:07:59.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.916+0000 7f9142000700 1 -- 172.21.15.49:0/3423739120 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f913c075be0 con 0x7f914c0690c0 2024-01-22T05:07:59.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.916+0000 7f914a000700 1 --2- 172.21.15.49:0/3423739120 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f912405a510 0x7f912405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:07:59.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.916+0000 7f914a000700 1 --2- 172.21.15.49:0/3423739120 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f912405a510 0x7f912405c9d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f914c0ab2f0 tx=0x7f9134009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:07:59.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:07:59.924+0000 7f9142000700 1 -- 172.21.15.49:0/3423739120 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f913c049490 con 0x7f914c0690c0 2024-01-22T05:08:00.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.088+0000 7f9151600700 1 -- 172.21.15.49:0/3423739120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f914c0be4a0 con 0x7f914c0690c0 2024-01-22T05:08:00.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.516+0000 7f9142000700 1 -- 172.21.15.49:0/3423739120 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v53) v1 ==== 152+0+0 (secure 0 0 0) 0x7f913c023030 con 0x7f914c0690c0 2024-01-22T05:08:00.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.520+0000 7f9151600700 1 -- 172.21.15.49:0/3423739120 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f912405a510 msgr2=0x7f912405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:00.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.520+0000 7f9151600700 1 --2- 172.21.15.49:0/3423739120 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f912405a510 0x7f912405c9d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f914c0ab2f0 tx=0x7f9134009040).stop 2024-01-22T05:08:00.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.520+0000 7f9151600700 1 -- 172.21.15.49:0/3423739120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0690c0 msgr2=0x7f914c0c7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:00.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.520+0000 7f9151600700 1 --2- 172.21.15.49:0/3423739120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0690c0 0x7f914c0c7820 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f913c006fa0 tx=0x7f913c015000).stop 2024-01-22T05:08:00.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.520+0000 7f9151600700 1 -- 172.21.15.49:0/3423739120 shutdown_connections 2024-01-22T05:08:00.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.520+0000 7f9151600700 1 --2- 172.21.15.49:0/3423739120 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f912405a510 0x7f912405c9d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:00.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.520+0000 7f9151600700 1 --2- 172.21.15.49:0/3423739120 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f914c153d80 0x7f914c151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:00.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.520+0000 7f9151600700 1 --2- 172.21.15.49:0/3423739120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f914c0c3980 0x7f914c150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:00.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.520+0000 7f9151600700 1 --2- 172.21.15.49:0/3423739120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f914c0690c0 0x7f914c0c7820 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:00.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.520+0000 7f9151600700 1 -- 172.21.15.49:0/3423739120 >> 172.21.15.49:0/3423739120 conn(0x7f914c0c8710 msgr2=0x7f914c14e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:00.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.520+0000 7f9151600700 1 -- 172.21.15.49:0/3423739120 shutdown_connections 2024-01-22T05:08:00.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.520+0000 7f9151600700 1 -- 172.21.15.49:0/3423739120 wait complete. 2024-01-22T05:08:00.536 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-01-22T05:08:00.549 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:08:00.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.716+0000 7f20b5e00700 1 Processor -- start 2024-01-22T05:08:00.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.716+0000 7f20b5e00700 1 -- start start 2024-01-22T05:08:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.716+0000 7f20b5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20b00c3660 0x7f20b00bc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.716+0000 7f20b5e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f20b00645d0 0x7f20b0155170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.716+0000 7f20b5e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b0068a80 con 0x7f20b00bcb10 2024-01-22T05:08:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.716+0000 7f20b5e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b00bd910 con 0x7f20b00645d0 2024-01-22T05:08:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.716+0000 7f20b5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0068750 con 0x7f20b00c3660 2024-01-22T05:08:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.720+0000 7f20ae000700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f20b00bcb10 0x7f20b0063ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:52006/0 (socket says 172.21.15.49:52006) 2024-01-22T05:08:00.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.720+0000 7f20ae000700 1 -- 172.21.15.49:0/217762089 learned_addr learned my addr 172.21.15.49:0/217762089 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:00.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.720+0000 7f20aea00700 1 --2- 172.21.15.49:0/217762089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20b00c3660 0x7f20b00bc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:00.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.720+0000 7f20af400700 1 --2- 172.21.15.49:0/217762089 >> v2:172.21.15.49:3300/0 conn(0x7f20b00645d0 0x7f20b0155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.720+0000 7f20ad600700 1 -- 172.21.15.49:0/217762089 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078414708 0 0) 0x7f20b0068a80 con 0x7f20b00bcb10 2024-01-22T05:08:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.720+0000 7f20ad600700 1 -- 172.21.15.49:0/217762089 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20900033f0 con 0x7f20b00bcb10 2024-01-22T05:08:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.720+0000 7f20aea00700 1 -- 172.21.15.49:0/217762089 >> v2:172.21.15.49:3300/0 conn(0x7f20b00645d0 msgr2=0x7f20b0155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.720+0000 7f20aea00700 1 --2- 172.21.15.49:0/217762089 >> v2:172.21.15.49:3300/0 conn(0x7f20b00645d0 0x7f20b0155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.720+0000 7f20aea00700 1 -- 172.21.15.49:0/217762089 >> v1:172.21.15.110:6789/0 conn(0x7f20b00bcb10 legacy=0x7f20b0063ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.720+0000 7f20aea00700 1 -- 172.21.15.49:0/217762089 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b00bd070 con 0x7f20b00c3660 2024-01-22T05:08:00.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.720+0000 7f20aea00700 1 --2- 172.21.15.49:0/217762089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20b00c3660 0x7f20b00bc620 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f20a0009760 tx=0x7f20a0009060).ready entity=mon.2 client_cookie=9f6e3f310036c63e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:00.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.720+0000 7f20ad600700 1 -- 172.21.15.49:0/217762089 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000d4a0 con 0x7f20b00c3660 2024-01-22T05:08:00.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.720+0000 7f20ad600700 1 -- 172.21.15.49:0/217762089 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a000d600 con 0x7f20b00c3660 2024-01-22T05:08:00.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.720+0000 7f20ad600700 1 -- 172.21.15.49:0/217762089 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000d980 con 0x7f20b00c3660 2024-01-22T05:08:00.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.724+0000 7f20b5e00700 1 -- 172.21.15.49:0/217762089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20b00c3660 msgr2=0x7f20b00bc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:00.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.724+0000 7f20b5e00700 1 --2- 172.21.15.49:0/217762089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20b00c3660 0x7f20b00bc620 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f20a0009760 tx=0x7f20a0009060).stop 2024-01-22T05:08:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.724+0000 7f20b5e00700 1 -- 172.21.15.49:0/217762089 shutdown_connections 2024-01-22T05:08:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.724+0000 7f20b5e00700 1 --2- 172.21.15.49:0/217762089 >> v2:172.21.15.49:3300/0 conn(0x7f20b00645d0 0x7f20b0155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.724+0000 7f20b5e00700 1 --2- 172.21.15.49:0/217762089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20b00c3660 0x7f20b00bc620 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.724+0000 7f20b5e00700 1 -- 172.21.15.49:0/217762089 >> 172.21.15.49:0/217762089 conn(0x7f20b00c8130 msgr2=0x7f20b00c4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:00.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.724+0000 7f20b5e00700 1 -- 172.21.15.49:0/217762089 shutdown_connections 2024-01-22T05:08:00.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.724+0000 7f20b5e00700 1 -- 172.21.15.49:0/217762089 wait complete. 2024-01-22T05:08:00.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.728+0000 7f20b5e00700 1 Processor -- start 2024-01-22T05:08:00.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.728+0000 7f20b5e00700 1 -- start start 2024-01-22T05:08:00.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.728+0000 7f20b5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20b00645d0 0x7f20b014a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:00.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.728+0000 7f20b5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b00bcb10 0x7f20b0159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:00.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.728+0000 7f20b5e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20b00c3660 0x7f20b015a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:00.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.728+0000 7f20b5e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00a9c70 con 0x7f20b00bcb10 2024-01-22T05:08:00.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.728+0000 7f20b5e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b015a900 con 0x7f20b00c3660 2024-01-22T05:08:00.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.728+0000 7f20b5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b015abe0 con 0x7f20b00645d0 2024-01-22T05:08:00.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20ae000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b00bcb10 0x7f20b0159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:00.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20ae000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b00bcb10 0x7f20b0159e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40446/0 (socket says 172.21.15.49:40446) 2024-01-22T05:08:00.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20ae000700 1 -- 172.21.15.49:0/519606329 learned_addr learned my addr 172.21.15.49:0/519606329 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:00.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20af400700 1 --2- 172.21.15.49:0/519606329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20b00c3660 0x7f20b015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:00.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20aea00700 1 --2- 172.21.15.49:0/519606329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20b00645d0 0x7f20b014a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:00.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20ae000700 1 -- 172.21.15.49:0/519606329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20b00645d0 msgr2=0x7f20b014a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:00.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20ae000700 1 --2- 172.21.15.49:0/519606329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20b00645d0 0x7f20b014a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:00.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20ae000700 1 -- 172.21.15.49:0/519606329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20b00c3660 msgr2=0x7f20b015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:00.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20ae000700 1 --2- 172.21.15.49:0/519606329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20b00c3660 0x7f20b015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:00.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20ae000700 1 -- 172.21.15.49:0/519606329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a00092a0 con 0x7f20b00bcb10 2024-01-22T05:08:00.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20af400700 1 --2- 172.21.15.49:0/519606329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20b00c3660 0x7f20b015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:00.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20ae000700 1 --2- 172.21.15.49:0/519606329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b00bcb10 0x7f20b0159e70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f209800c4c0 tx=0x7f2098007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:00.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20a6000700 1 -- 172.21.15.49:0/519606329 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209800ce30 con 0x7f20b00bcb10 2024-01-22T05:08:00.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20a6000700 1 -- 172.21.15.49:0/519606329 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20980072e0 con 0x7f20b00bcb10 2024-01-22T05:08:00.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20b5e00700 1 -- 172.21.15.49:0/519606329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b00bed80 con 0x7f20b00bcb10 2024-01-22T05:08:00.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20a6000700 1 -- 172.21.15.49:0/519606329 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20980057a0 con 0x7f20b00bcb10 2024-01-22T05:08:00.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.732+0000 7f20b5e00700 1 -- 172.21.15.49:0/519606329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b014a750 con 0x7f20b00bcb10 2024-01-22T05:08:00.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.736+0000 7f20b5e00700 1 -- 172.21.15.49:0/519606329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b00657d0 con 0x7f20b00bcb10 2024-01-22T05:08:00.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.736+0000 7f20a6000700 1 -- 172.21.15.49:0/519606329 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2098005b50 con 0x7f20b00bcb10 2024-01-22T05:08:00.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.740+0000 7f20a6000700 1 --2- 172.21.15.49:0/519606329 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f208805a510 0x7f208805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:00.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.740+0000 7f20a6000700 1 -- 172.21.15.49:0/519606329 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5992+0+0 (secure 0 0 0) 0x7f2098073e20 con 0x7f20b00bcb10 2024-01-22T05:08:00.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.740+0000 7f20aea00700 1 --2- 172.21.15.49:0/519606329 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f208805a510 0x7f208805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:00.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.740+0000 7f20aea00700 1 --2- 172.21.15.49:0/519606329 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f208805a510 0x7f208805c9d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f20a000d260 tx=0x7f20a0016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:00.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.744+0000 7f20a6000700 1 -- 172.21.15.49:0/519606329 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f20980475c0 con 0x7f20b00bcb10 2024-01-22T05:08:00.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:00.904+0000 7f20b5e00700 1 -- 172.21.15.49:0/519606329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f20b00bd350 con 0x7f20b00bcb10 2024-01-22T05:08:01.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.528+0000 7f20a6000700 1 -- 172.21.15.49:0/519606329 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v54) v1 ==== 170+0+0 (secure 0 0 0) 0x7f209804abe0 con 0x7f20b00bcb10 2024-01-22T05:08:01.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.536+0000 7f20b5e00700 1 -- 172.21.15.49:0/519606329 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f208805a510 msgr2=0x7f208805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:01.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.536+0000 7f20b5e00700 1 --2- 172.21.15.49:0/519606329 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f208805a510 0x7f208805c9d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f20a000d260 tx=0x7f20a0016000).stop 2024-01-22T05:08:01.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.536+0000 7f20b5e00700 1 -- 172.21.15.49:0/519606329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b00bcb10 msgr2=0x7f20b0159e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:01.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.536+0000 7f20b5e00700 1 --2- 172.21.15.49:0/519606329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b00bcb10 0x7f20b0159e70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f209800c4c0 tx=0x7f2098007c10).stop 2024-01-22T05:08:01.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.536+0000 7f20b5e00700 1 -- 172.21.15.49:0/519606329 shutdown_connections 2024-01-22T05:08:01.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.536+0000 7f20b5e00700 1 --2- 172.21.15.49:0/519606329 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f208805a510 0x7f208805c9d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:01.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.536+0000 7f20b5e00700 1 --2- 172.21.15.49:0/519606329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20b00c3660 0x7f20b015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:01.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.536+0000 7f20b5e00700 1 --2- 172.21.15.49:0/519606329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b00bcb10 0x7f20b0159e70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:01.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.536+0000 7f20b5e00700 1 --2- 172.21.15.49:0/519606329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20b00645d0 0x7f20b014a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:01.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.536+0000 7f20b5e00700 1 -- 172.21.15.49:0/519606329 >> 172.21.15.49:0/519606329 conn(0x7f20b00c8130 msgr2=0x7f20b00aa670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:01.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.536+0000 7f20b5e00700 1 -- 172.21.15.49:0/519606329 shutdown_connections 2024-01-22T05:08:01.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.540+0000 7f20b5e00700 1 -- 172.21.15.49:0/519606329 wait complete. 2024-01-22T05:08:01.548 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-01-22T05:08:01.575 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:08:01.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.736+0000 7fadeac00700 1 Processor -- start 2024-01-22T05:08:01.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.736+0000 7fadeac00700 1 -- start start 2024-01-22T05:08:01.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.740+0000 7fadeac00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fade40c3ab0 0x7fade4069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:01.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.740+0000 7fadeac00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade40bdba0 0x7fade40642b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:01.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.740+0000 7fadeac00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade40bc700 con 0x7fade4063e20 2024-01-22T05:08:01.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.740+0000 7fadeac00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade4150d20 con 0x7fade40c3ab0 2024-01-22T05:08:01.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.740+0000 7fadeac00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade40647a0 con 0x7fade40bdba0 2024-01-22T05:08:01.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.740+0000 7fade3400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fade4063e20 0x7fade41543a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33656/0 (socket says 172.21.15.49:33656) 2024-01-22T05:08:01.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.740+0000 7fade3400700 1 -- 172.21.15.49:0/3272738692 learned_addr learned my addr 172.21.15.49:0/3272738692 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:01.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.740+0000 7fade3e00700 1 --2- 172.21.15.49:0/3272738692 >> v2:172.21.15.49:3300/0 conn(0x7fade40c3ab0 0x7fade4069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:01.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.740+0000 7fade8c00700 1 --2- 172.21.15.49:0/3272738692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade40bdba0 0x7fade40642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:01.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fade2a00700 1 -- 172.21.15.49:0/3272738692 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611414313 0 0) 0x7fade40bc700 con 0x7fade4063e20 2024-01-22T05:08:01.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fade2a00700 1 -- 172.21.15.49:0/3272738692 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc40033f0 con 0x7fade4063e20 2024-01-22T05:08:01.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fade3e00700 1 -- 172.21.15.49:0/3272738692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade40bdba0 msgr2=0x7fade40642b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:01.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fade3e00700 1 --2- 172.21.15.49:0/3272738692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade40bdba0 0x7fade40642b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:01.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fade3e00700 1 -- 172.21.15.49:0/3272738692 >> v1:172.21.15.49:6789/0 conn(0x7fade4063e20 legacy=0x7fade41543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:01.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fade3e00700 1 -- 172.21.15.49:0/3272738692 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade406a420 con 0x7fade40c3ab0 2024-01-22T05:08:01.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fade8c00700 1 --2- 172.21.15.49:0/3272738692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade40bdba0 0x7fade40642b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:01.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fade3e00700 1 --2- 172.21.15.49:0/3272738692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade40c3ab0 0x7fade4069f30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fadd4009760 tx=0x7fadd4009060).ready entity=mon.0 client_cookie=c54004cbc6f8e024 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:01.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fade2a00700 1 -- 172.21.15.49:0/3272738692 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd400f510 con 0x7fade40c3ab0 2024-01-22T05:08:01.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fade2a00700 1 -- 172.21.15.49:0/3272738692 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd400f670 con 0x7fade40c3ab0 2024-01-22T05:08:01.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fade2a00700 1 -- 172.21.15.49:0/3272738692 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd400f9f0 con 0x7fade40c3ab0 2024-01-22T05:08:01.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fadeac00700 1 -- 172.21.15.49:0/3272738692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade40c3ab0 msgr2=0x7fade4069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:01.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fadeac00700 1 --2- 172.21.15.49:0/3272738692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade40c3ab0 0x7fade4069f30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fadd4009760 tx=0x7fadd4009060).stop 2024-01-22T05:08:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fadeac00700 1 -- 172.21.15.49:0/3272738692 shutdown_connections 2024-01-22T05:08:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fadeac00700 1 --2- 172.21.15.49:0/3272738692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade40bdba0 0x7fade40642b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fadeac00700 1 --2- 172.21.15.49:0/3272738692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade40c3ab0 0x7fade4069f30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fadeac00700 1 -- 172.21.15.49:0/3272738692 >> 172.21.15.49:0/3272738692 conn(0x7fade4066810 msgr2=0x7fade4066bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fadeac00700 1 -- 172.21.15.49:0/3272738692 shutdown_connections 2024-01-22T05:08:01.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.744+0000 7fadeac00700 1 -- 172.21.15.49:0/3272738692 wait complete. 2024-01-22T05:08:01.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.748+0000 7fadeac00700 1 Processor -- start 2024-01-22T05:08:01.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.748+0000 7fadeac00700 1 -- start start 2024-01-22T05:08:01.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.748+0000 7fadeac00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4063e20 0x7fade4167e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:01.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fadeac00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade40bdba0 0x7fade40acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:01.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fadeac00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade40c3ab0 0x7fade40ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:01.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fadeac00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade40ad650 con 0x7fade4063e20 2024-01-22T05:08:01.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fadeac00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade40aad90 con 0x7fade40c3ab0 2024-01-22T05:08:01.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fadeac00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade40a8be0 con 0x7fade40bdba0 2024-01-22T05:08:01.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fade3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4063e20 0x7fade4167e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:01.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fade8c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade40c3ab0 0x7fade40ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:01.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fade3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4063e20 0x7fade4167e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40460/0 (socket says 172.21.15.49:40460) 2024-01-22T05:08:01.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fade3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade40bdba0 0x7fade40acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:01.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fade3e00700 1 -- 172.21.15.49:0/3734745642 learned_addr learned my addr 172.21.15.49:0/3734745642 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:01.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fade3e00700 1 -- 172.21.15.49:0/3734745642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade40bdba0 msgr2=0x7fade40acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fade3e00700 1 --2- 172.21.15.49:0/3734745642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade40bdba0 0x7fade40acc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fade3e00700 1 -- 172.21.15.49:0/3734745642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade40c3ab0 msgr2=0x7fade40ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fade3e00700 1 --2- 172.21.15.49:0/3734745642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade40c3ab0 0x7fade40ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fade3e00700 1 -- 172.21.15.49:0/3734745642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd40092a0 con 0x7fade4063e20 2024-01-22T05:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fade3e00700 1 --2- 172.21.15.49:0/3734745642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4063e20 0x7fade4167e60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fadd4009fd0 tx=0x7fadd4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7faddb400700 1 -- 172.21.15.49:0/3734745642 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd400f7e0 con 0x7fade4063e20 2024-01-22T05:08:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7faddb400700 1 -- 172.21.15.49:0/3734745642 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd400f940 con 0x7fade4063e20 2024-01-22T05:08:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fadeac00700 1 -- 172.21.15.49:0/3734745642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade40a8ec0 con 0x7fade4063e20 2024-01-22T05:08:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7faddb400700 1 -- 172.21.15.49:0/3734745642 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd401b690 con 0x7fade4063e20 2024-01-22T05:08:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.752+0000 7fadeac00700 1 -- 172.21.15.49:0/3734745642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade40a9480 con 0x7fade4063e20 2024-01-22T05:08:01.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.756+0000 7fadeac00700 1 -- 172.21.15.49:0/3734745642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade4065790 con 0x7fade4063e20 2024-01-22T05:08:01.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.756+0000 7faddb400700 1 -- 172.21.15.49:0/3734745642 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fadd401ba00 con 0x7fade4063e20 2024-01-22T05:08:01.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.756+0000 7faddb400700 1 --2- 172.21.15.49:0/3734745642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadbc05a540 0x7fadbc05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:01.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.756+0000 7faddb400700 1 -- 172.21.15.49:0/3734745642 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6374+0+0 (secure 0 0 0) 0x7fadd4075e40 con 0x7fade4063e20 2024-01-22T05:08:01.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.760+0000 7fade3400700 1 --2- 172.21.15.49:0/3734745642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadbc05a540 0x7fadbc05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:01.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.760+0000 7fade3400700 1 --2- 172.21.15.49:0/3734745642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadbc05a540 0x7fadbc05ca00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fadcc007fd0 tx=0x7fadcc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:01.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.764+0000 7faddb400700 1 -- 172.21.15.49:0/3734745642 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fadd4049520 con 0x7fade4063e20 2024-01-22T05:08:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.964+0000 7fadeac00700 1 -- 172.21.15.49:0/3734745642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fade4046800 con 0x7fade4063e20 2024-01-22T05:08:01.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.976+0000 7faddb400700 1 -- 172.21.15.49:0/3734745642 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v38) v1 ==== 172+0+0 (secure 0 0 0) 0x7fadd40280c0 con 0x7fade4063e20 2024-01-22T05:08:01.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.984+0000 7fadeac00700 1 -- 172.21.15.49:0/3734745642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadbc05a540 msgr2=0x7fadbc05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:01.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.984+0000 7fadeac00700 1 --2- 172.21.15.49:0/3734745642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadbc05a540 0x7fadbc05ca00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fadcc007fd0 tx=0x7fadcc009040).stop 2024-01-22T05:08:01.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.984+0000 7fadeac00700 1 -- 172.21.15.49:0/3734745642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4063e20 msgr2=0x7fade4167e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:01.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.984+0000 7fadeac00700 1 --2- 172.21.15.49:0/3734745642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4063e20 0x7fade4167e60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fadd4009fd0 tx=0x7fadd4017000).stop 2024-01-22T05:08:01.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.984+0000 7fadeac00700 1 -- 172.21.15.49:0/3734745642 shutdown_connections 2024-01-22T05:08:01.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.984+0000 7fadeac00700 1 --2- 172.21.15.49:0/3734745642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadbc05a540 0x7fadbc05ca00 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0x7fadcc007fd0 tx=0x7fadcc009040).stop 2024-01-22T05:08:01.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.984+0000 7fadeac00700 1 --2- 172.21.15.49:0/3734745642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade40c3ab0 0x7fade40ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:01.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.984+0000 7fadeac00700 1 --2- 172.21.15.49:0/3734745642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade40bdba0 0x7fade40acc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:01.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.984+0000 7fadeac00700 1 --2- 172.21.15.49:0/3734745642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4063e20 0x7fade4167e60 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:01.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.988+0000 7fadeac00700 1 -- 172.21.15.49:0/3734745642 >> 172.21.15.49:0/3734745642 conn(0x7fade4066810 msgr2=0x7fade414b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:01.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.992+0000 7fadeac00700 1 -- 172.21.15.49:0/3734745642 shutdown_connections 2024-01-22T05:08:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:01.996+0000 7fadeac00700 1 -- 172.21.15.49:0/3734745642 wait complete. 2024-01-22T05:08:02.013 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 8 and data pool 9 2024-01-22T05:08:02.032 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:08:02.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.192+0000 7f3a36c00700 1 Processor -- start 2024-01-22T05:08:02.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.192+0000 7f3a36c00700 1 -- start start 2024-01-22T05:08:02.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a36c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3a300c3690 0x7f3a300c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a36c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3a300bf0b0 0x7f3a301559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a36c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a300bdc10 con 0x7f3a30155550 2024-01-22T05:08:02.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a36c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a300c3f60 con 0x7f3a300bf0b0 2024-01-22T05:08:02.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a36c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a30155ea0 con 0x7f3a300c3690 2024-01-22T05:08:02.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a34c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3a300bf0b0 0x7f3a301559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a34c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3a300bf0b0 0x7f3a301559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40474/0 (socket says 172.21.15.49:40474) 2024-01-22T05:08:02.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a2fe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3a300c3690 0x7f3a300c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a34c00700 1 -- 172.21.15.49:0/3774285872 learned_addr learned my addr 172.21.15.49:0/3774285872 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:02.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a34c00700 1 -- 172.21.15.49:0/3774285872 >> v2:172.21.15.110:3300/0 conn(0x7f3a300c3690 msgr2=0x7f3a300c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:02.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a34c00700 1 --2- 172.21.15.49:0/3774285872 >> v2:172.21.15.110:3300/0 conn(0x7f3a300c3690 0x7f3a300c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a34c00700 1 -- 172.21.15.49:0/3774285872 >> v1:172.21.15.110:6789/0 conn(0x7f3a30155550 legacy=0x7f3a30067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a34c00700 1 -- 172.21.15.49:0/3774285872 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a30068e10 con 0x7f3a300bf0b0 2024-01-22T05:08:02.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a34c00700 1 --2- 172.21.15.49:0/3774285872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a300bf0b0 0x7f3a301559b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f3a300c5e00 tx=0x7f3a28009840).ready entity=mon.0 client_cookie=5ac02c8d925aad16 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:02.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a2ea00700 1 -- 172.21.15.49:0/3774285872 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2800e070 con 0x7f3a300bf0b0 2024-01-22T05:08:02.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a2ea00700 1 -- 172.21.15.49:0/3774285872 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2800ba20 con 0x7f3a300bf0b0 2024-01-22T05:08:02.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.196+0000 7f3a2ea00700 1 -- 172.21.15.49:0/3774285872 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2800bda0 con 0x7f3a300bf0b0 2024-01-22T05:08:02.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.200+0000 7f3a36c00700 1 -- 172.21.15.49:0/3774285872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a300bf0b0 msgr2=0x7f3a301559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.200+0000 7f3a36c00700 1 --2- 172.21.15.49:0/3774285872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a300bf0b0 0x7f3a301559b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f3a300c5e00 tx=0x7f3a28009840).stop 2024-01-22T05:08:02.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.200+0000 7f3a36c00700 1 -- 172.21.15.49:0/3774285872 shutdown_connections 2024-01-22T05:08:02.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.200+0000 7f3a36c00700 1 --2- 172.21.15.49:0/3774285872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a300bf0b0 0x7f3a301559b0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.200+0000 7f3a36c00700 1 --2- 172.21.15.49:0/3774285872 >> v2:172.21.15.110:3300/0 conn(0x7f3a300c3690 0x7f3a300c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.200+0000 7f3a36c00700 1 -- 172.21.15.49:0/3774285872 >> 172.21.15.49:0/3774285872 conn(0x7f3a300c51c0 msgr2=0x7f3a300c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:02.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.200+0000 7f3a36c00700 1 -- 172.21.15.49:0/3774285872 shutdown_connections 2024-01-22T05:08:02.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.200+0000 7f3a36c00700 1 -- 172.21.15.49:0/3774285872 wait complete. 2024-01-22T05:08:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.200+0000 7f3a36c00700 1 Processor -- start 2024-01-22T05:08:02.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.200+0000 7f3a36c00700 1 -- start start 2024-01-22T05:08:02.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a36c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a300bf0b0 0x7f3a30168990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a36c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a300c3690 0x7f3a301629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a36c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a30155550 0x7f3a300c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a36c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300c6900 con 0x7f3a30155550 2024-01-22T05:08:02.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a36c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a30169b90 con 0x7f3a300bf0b0 2024-01-22T05:08:02.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a36c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300ac740 con 0x7f3a300c3690 2024-01-22T05:08:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a34c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a30155550 0x7f3a300c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a34c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a30155550 0x7f3a300c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40480/0 (socket says 172.21.15.49:40480) 2024-01-22T05:08:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a2fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a300bf0b0 0x7f3a30168990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a34c00700 1 -- 172.21.15.49:0/695525632 learned_addr learned my addr 172.21.15.49:0/695525632 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a2f400700 1 --2- 172.21.15.49:0/695525632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a300c3690 0x7f3a301629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a34c00700 1 -- 172.21.15.49:0/695525632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a300c3690 msgr2=0x7f3a301629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a34c00700 1 --2- 172.21.15.49:0/695525632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a300c3690 0x7f3a301629d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a34c00700 1 -- 172.21.15.49:0/695525632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a300bf0b0 msgr2=0x7f3a30168990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a34c00700 1 --2- 172.21.15.49:0/695525632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a300bf0b0 0x7f3a30168990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a34c00700 1 -- 172.21.15.49:0/695525632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a28009ae0 con 0x7f3a30155550 2024-01-22T05:08:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a2fe00700 1 --2- 172.21.15.49:0/695525632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a300bf0b0 0x7f3a30168990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a34c00700 1 --2- 172.21.15.49:0/695525632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a30155550 0x7f3a300c1cb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f3a2800b6c0 tx=0x7f3a28009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a27400700 1 -- 172.21.15.49:0/695525632 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a280092e0 con 0x7f3a30155550 2024-01-22T05:08:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a27400700 1 -- 172.21.15.49:0/695525632 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2801e470 con 0x7f3a30155550 2024-01-22T05:08:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a36c00700 1 -- 172.21.15.49:0/695525632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a30162ec0 con 0x7f3a30155550 2024-01-22T05:08:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.204+0000 7f3a27400700 1 -- 172.21.15.49:0/695525632 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2801e830 con 0x7f3a30155550 2024-01-22T05:08:02.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.208+0000 7f3a36c00700 1 -- 172.21.15.49:0/695525632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a30169310 con 0x7f3a30155550 2024-01-22T05:08:02.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.208+0000 7f3a36c00700 1 -- 172.21.15.49:0/695525632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a30047060 con 0x7f3a30155550 2024-01-22T05:08:02.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.208+0000 7f3a27400700 1 -- 172.21.15.49:0/695525632 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3a28003040 con 0x7f3a30155550 2024-01-22T05:08:02.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.212+0000 7f3a27400700 1 --2- 172.21.15.49:0/695525632 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3a0805a510 0x7f3a0805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.212+0000 7f3a27400700 1 -- 172.21.15.49:0/695525632 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3a28075d10 con 0x7f3a30155550 2024-01-22T05:08:02.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.212+0000 7f3a2fe00700 1 --2- 172.21.15.49:0/695525632 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3a0805a510 0x7f3a0805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.212+0000 7f3a2fe00700 1 --2- 172.21.15.49:0/695525632 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3a0805a510 0x7f3a0805c9d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f3a3014c1c0 tx=0x7f3a20009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:02.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.216+0000 7f3a27400700 1 -- 172.21.15.49:0/695525632 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3a280494e0 con 0x7f3a30155550 2024-01-22T05:08:02.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.384+0000 7f3a36c00700 1 -- 172.21.15.49:0/695525632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a30046800 con 0x7f3a30155550 2024-01-22T05:08:02.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.384+0000 7f3a27400700 1 -- 172.21.15.49:0/695525632 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17177 (secure 0 0 0) 0x7f3a28023030 con 0x7f3a30155550 2024-01-22T05:08:02.388 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:02.389 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":55,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:08:01.968477+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:08:00.161271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-22T05:08:00.977775+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:08:02.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.388+0000 7f3a36c00700 1 -- 172.21.15.49:0/695525632 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3a0805a510 msgr2=0x7f3a0805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.388+0000 7f3a36c00700 1 --2- 172.21.15.49:0/695525632 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3a0805a510 0x7f3a0805c9d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f3a3014c1c0 tx=0x7f3a20009060).stop 2024-01-22T05:08:02.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.388+0000 7f3a36c00700 1 -- 172.21.15.49:0/695525632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a30155550 msgr2=0x7f3a300c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.388+0000 7f3a36c00700 1 --2- 172.21.15.49:0/695525632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a30155550 0x7f3a300c1cb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f3a2800b6c0 tx=0x7f3a28009840).stop 2024-01-22T05:08:02.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.388+0000 7f3a36c00700 1 -- 172.21.15.49:0/695525632 shutdown_connections 2024-01-22T05:08:02.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.388+0000 7f3a36c00700 1 --2- 172.21.15.49:0/695525632 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3a0805a510 0x7f3a0805c9d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.388+0000 7f3a36c00700 1 --2- 172.21.15.49:0/695525632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a30155550 0x7f3a300c1cb0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.388+0000 7f3a36c00700 1 --2- 172.21.15.49:0/695525632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a300c3690 0x7f3a301629d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.388+0000 7f3a36c00700 1 --2- 172.21.15.49:0/695525632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a300bf0b0 0x7f3a30168990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.388+0000 7f3a36c00700 1 -- 172.21.15.49:0/695525632 >> 172.21.15.49:0/695525632 conn(0x7f3a300c51c0 msgr2=0x7f3a3014cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.388+0000 7f3a36c00700 1 -- 172.21.15.49:0/695525632 shutdown_connections 2024-01-22T05:08:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.388+0000 7f3a36c00700 1 -- 172.21.15.49:0/695525632 wait complete. 2024-01-22T05:08:02.414 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:08:02.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.568+0000 7f17f7c00700 1 Processor -- start 2024-01-22T05:08:02.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.568+0000 7f17f7c00700 1 -- start start 2024-01-22T05:08:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17f7c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17f0155d20 0x7f17f0065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17f7c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f17f0066070 0x7f17f00a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17f7c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f00a90e0 con 0x7f17f00a8c30 2024-01-22T05:08:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17f7c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f00c1a40 con 0x7f17f0066070 2024-01-22T05:08:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17f7c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0159310 con 0x7f17f0155d20 2024-01-22T05:08:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17f5c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f17f00a8c30 0x7f17f00c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33666/0 (socket says 172.21.15.49:33666) 2024-01-22T05:08:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17f5c00700 1 -- 172.21.15.49:0/3763438591 learned_addr learned my addr 172.21.15.49:0/3763438591 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17f5200700 1 --2- 172.21.15.49:0/3763438591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17f0155d20 0x7f17f0065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17efe00700 1 --2- 172.21.15.49:0/3763438591 >> v2:172.21.15.110:3300/0 conn(0x7f17f0066070 0x7f17f00a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 -- 172.21.15.49:0/3763438591 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855123270 0 0) 0x7f17e8001490 con 0x7f17f00a8c30 2024-01-22T05:08:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 -- 172.21.15.49:0/3763438591 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17d00033f0 con 0x7f17f00a8c30 2024-01-22T05:08:02.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 -- 172.21.15.49:0/3763438591 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 616045302 0 0) 0x7f17d00033f0 con 0x7f17f00a8c30 2024-01-22T05:08:02.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 -- 172.21.15.49:0/3763438591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17f0155d20 msgr2=0x7f17f0065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 --2- 172.21.15.49:0/3763438591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17f0155d20 0x7f17f0065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 -- 172.21.15.49:0/3763438591 >> v2:172.21.15.110:3300/0 conn(0x7f17f0066070 msgr2=0x7f17f00a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 --2- 172.21.15.49:0/3763438591 >> v2:172.21.15.110:3300/0 conn(0x7f17f0066070 0x7f17f00a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 -- 172.21.15.49:0/3763438591 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f00c13f0 con 0x7f17f00a8c30 2024-01-22T05:08:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 -- 172.21.15.49:0/3763438591 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f17e8001980 con 0x7f17f00a8c30 2024-01-22T05:08:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 -- 172.21.15.49:0/3763438591 >> v1:172.21.15.49:6789/0 conn(0x7f17f00a8c30 legacy=0x7f17f00c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 --2- 172.21.15.49:0/3763438591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17d00038e0 0x7f17d0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 --2- 172.21.15.49:0/3763438591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17f0155d20 0x7f17d0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 --2- 172.21.15.49:0/3763438591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17d0004b80 0x7f17d0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 -- 172.21.15.49:0/3763438591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00c1a40 con 0x7f17d00038e0 2024-01-22T05:08:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 -- 172.21.15.49:0/3763438591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0159310 con 0x7f17d0004b80 2024-01-22T05:08:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.572+0000 7f17ef400700 1 -- 172.21.15.49:0/3763438591 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d000b8e0 con 0x7f17f0155d20 2024-01-22T05:08:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17efe00700 1 --2- 172.21.15.49:0/3763438591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17f0155d20 0x7f17d0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17f5200700 1 --2- 172.21.15.49:0/3763438591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17d00038e0 0x7f17d0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17f5c00700 1 --2- 172.21.15.49:0/3763438591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17d0004b80 0x7f17d0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17efe00700 1 -- 172.21.15.49:0/3763438591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17d0004b80 msgr2=0x7f17d0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17efe00700 1 --2- 172.21.15.49:0/3763438591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17d0004b80 0x7f17d0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17efe00700 1 -- 172.21.15.49:0/3763438591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17d00038e0 msgr2=0x7f17d0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17efe00700 1 --2- 172.21.15.49:0/3763438591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17d00038e0 0x7f17d0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17efe00700 1 -- 172.21.15.49:0/3763438591 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d00033f0 con 0x7f17f0155d20 2024-01-22T05:08:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17efe00700 1 --2- 172.21.15.49:0/3763438591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17f0155d20 0x7f17d0004690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f17f0065450 tx=0x7f17d8009060).ready entity=mon.2 client_cookie=43386ae3cd029bcf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17ef400700 1 -- 172.21.15.49:0/3763438591 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8009e90 con 0x7f17f0155d20 2024-01-22T05:08:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17ef400700 1 -- 172.21.15.49:0/3763438591 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d8009430 con 0x7f17f0155d20 2024-01-22T05:08:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17ef400700 1 -- 172.21.15.49:0/3763438591 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d800e850 con 0x7f17f0155d20 2024-01-22T05:08:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17f7c00700 1 -- 172.21.15.49:0/3763438591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17f0155d20 msgr2=0x7f17d0004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17f7c00700 1 --2- 172.21.15.49:0/3763438591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17f0155d20 0x7f17d0004690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f17f0065450 tx=0x7f17d8009060).stop 2024-01-22T05:08:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17f5c00700 1 -- 172.21.15.49:0/3763438591 reap_dead start 2024-01-22T05:08:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17f7c00700 1 -- 172.21.15.49:0/3763438591 shutdown_connections 2024-01-22T05:08:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17f7c00700 1 -- 172.21.15.49:0/3763438591 >> 172.21.15.49:0/3763438591 conn(0x7f17f00c6540 msgr2=0x7f17f00c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17f7c00700 1 -- 172.21.15.49:0/3763438591 shutdown_connections 2024-01-22T05:08:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.576+0000 7f17f7c00700 1 -- 172.21.15.49:0/3763438591 wait complete. 2024-01-22T05:08:02.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.580+0000 7f17f7c00700 1 Processor -- start 2024-01-22T05:08:02.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.580+0000 7f17f7c00700 1 -- start start 2024-01-22T05:08:02.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17f7c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17f0155d20 0x7f17f016ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17f7c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f015ad80 0x7f17f00ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17f7c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17f00a95b0 0x7f17f00c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17f7c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f015a930 con 0x7f17f015ad80 2024-01-22T05:08:02.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17f7c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00c1f00 con 0x7f17f0155d20 2024-01-22T05:08:02.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17f7c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f015b200 con 0x7f17f00a95b0 2024-01-22T05:08:02.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17efe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f015ad80 0x7f17f00ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17efe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f015ad80 0x7f17f00ab750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40496/0 (socket says 172.21.15.49:40496) 2024-01-22T05:08:02.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17efe00700 1 -- 172.21.15.49:0/3648821478 learned_addr learned my addr 172.21.15.49:0/3648821478 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:02.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17f5200700 1 --2- 172.21.15.49:0/3648821478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17f0155d20 0x7f17f016ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17f5c00700 1 --2- 172.21.15.49:0/3648821478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17f00a95b0 0x7f17f00c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17efe00700 1 -- 172.21.15.49:0/3648821478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17f00a95b0 msgr2=0x7f17f00c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17efe00700 1 --2- 172.21.15.49:0/3648821478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17f00a95b0 0x7f17f00c33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17efe00700 1 -- 172.21.15.49:0/3648821478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17f0155d20 msgr2=0x7f17f016ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17efe00700 1 --2- 172.21.15.49:0/3648821478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17f0155d20 0x7f17f016ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17efe00700 1 -- 172.21.15.49:0/3648821478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f016c010 con 0x7f17f015ad80 2024-01-22T05:08:02.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17efe00700 1 --2- 172.21.15.49:0/3648821478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f015ad80 0x7f17f00ab750 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f17d80030b0 tx=0x7f17d801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:02.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17e7e00700 1 -- 172.21.15.49:0/3648821478 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d801d820 con 0x7f17f015ad80 2024-01-22T05:08:02.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17e7e00700 1 -- 172.21.15.49:0/3648821478 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d801d980 con 0x7f17f015ad80 2024-01-22T05:08:02.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17e7e00700 1 -- 172.21.15.49:0/3648821478 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d801dd40 con 0x7f17f015ad80 2024-01-22T05:08:02.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17f7c00700 1 -- 172.21.15.49:0/3648821478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f016c2f0 con 0x7f17f015ad80 2024-01-22T05:08:02.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.584+0000 7f17f7c00700 1 -- 172.21.15.49:0/3648821478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f016c8b0 con 0x7f17f015ad80 2024-01-22T05:08:02.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.588+0000 7f17f7c00700 1 -- 172.21.15.49:0/3648821478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f0047060 con 0x7f17f015ad80 2024-01-22T05:08:02.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.588+0000 7f17e7e00700 1 -- 172.21.15.49:0/3648821478 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f17d802f440 con 0x7f17f015ad80 2024-01-22T05:08:02.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.588+0000 7f17e7e00700 1 --2- 172.21.15.49:0/3648821478 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f17c805a510 0x7f17c805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.588+0000 7f17e7e00700 1 -- 172.21.15.49:0/3648821478 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f17d8076670 con 0x7f17f015ad80 2024-01-22T05:08:02.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.592+0000 7f17f5200700 1 --2- 172.21.15.49:0/3648821478 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f17c805a510 0x7f17c805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.592+0000 7f17f5200700 1 --2- 172.21.15.49:0/3648821478 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f17c805a510 0x7f17c805c9d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f17e0006d80 tx=0x7f17e0009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:02.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.596+0000 7f17e7e00700 1 -- 172.21.15.49:0/3648821478 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f17d8049bd0 con 0x7f17f015ad80 2024-01-22T05:08:02.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.760+0000 7f17f7c00700 1 -- 172.21.15.49:0/3648821478 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17f00c16d0 con 0x7f17f015ad80 2024-01-22T05:08:02.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.760+0000 7f17e7e00700 1 -- 172.21.15.49:0/3648821478 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17177 (secure 0 0 0) 0x7f17d8016020 con 0x7f17f015ad80 2024-01-22T05:08:02.764 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:02.765 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":55,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:08:01.968477+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:08:00.161271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-22T05:08:00.977775+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:08:02.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.764+0000 7f17f7c00700 1 -- 172.21.15.49:0/3648821478 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f17c805a510 msgr2=0x7f17c805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.764+0000 7f17f7c00700 1 --2- 172.21.15.49:0/3648821478 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f17c805a510 0x7f17c805c9d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f17e0006d80 tx=0x7f17e0009060).stop 2024-01-22T05:08:02.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.764+0000 7f17f7c00700 1 -- 172.21.15.49:0/3648821478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f015ad80 msgr2=0x7f17f00ab750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.764+0000 7f17f7c00700 1 --2- 172.21.15.49:0/3648821478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f015ad80 0x7f17f00ab750 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f17d80030b0 tx=0x7f17d801a000).stop 2024-01-22T05:08:02.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.764+0000 7f17f7c00700 1 -- 172.21.15.49:0/3648821478 shutdown_connections 2024-01-22T05:08:02.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.764+0000 7f17f7c00700 1 --2- 172.21.15.49:0/3648821478 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f17c805a510 0x7f17c805c9d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.764+0000 7f17f7c00700 1 --2- 172.21.15.49:0/3648821478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17f00a95b0 0x7f17f00c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.764+0000 7f17f7c00700 1 --2- 172.21.15.49:0/3648821478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f015ad80 0x7f17f00ab750 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.764+0000 7f17f7c00700 1 --2- 172.21.15.49:0/3648821478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17f0155d20 0x7f17f016ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.764+0000 7f17f7c00700 1 -- 172.21.15.49:0/3648821478 >> 172.21.15.49:0/3648821478 conn(0x7f17f00c6540 msgr2=0x7f17f0066540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:02.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.768+0000 7f17f7c00700 1 -- 172.21.15.49:0/3648821478 shutdown_connections 2024-01-22T05:08:02.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.768+0000 7f17f7c00700 1 -- 172.21.15.49:0/3648821478 wait complete. 2024-01-22T05:08:02.793 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:08:02.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.956+0000 7f553d600700 1 Processor -- start 2024-01-22T05:08:02.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.956+0000 7f553d600700 1 -- start start 2024-01-22T05:08:02.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.960+0000 7f553d600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5538150d00 0x7f5538063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.960+0000 7f553d600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55380bc5b0 con 0x7f55380c3c80 2024-01-22T05:08:02.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.960+0000 7f553d600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5538064730 con 0x7f55380642e0 2024-01-22T05:08:02.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.960+0000 7f553d600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5538151160 con 0x7f5538150d00 2024-01-22T05:08:02.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.960+0000 7f5536a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f55380c3c80 0x7f55380bddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33678/0 (socket says 172.21.15.49:33678) 2024-01-22T05:08:02.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.960+0000 7f5536a00700 1 -- 172.21.15.49:0/519900604 learned_addr learned my addr 172.21.15.49:0/519900604 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:02.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.960+0000 7f5536000700 1 --2- 172.21.15.49:0/519900604 >> v2:172.21.15.110:3300/0 conn(0x7f5538150d00 0x7f5538063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.960+0000 7f5535600700 1 -- 172.21.15.49:0/519900604 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103907535 0 0) 0x7f55380bc5b0 con 0x7f55380c3c80 2024-01-22T05:08:02.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.960+0000 7f5535600700 1 -- 172.21.15.49:0/519900604 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55180033f0 con 0x7f55380c3c80 2024-01-22T05:08:02.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.960+0000 7f5535600700 1 -- 172.21.15.49:0/519900604 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16362272 0 0) 0x7f5538064730 con 0x7f55380642e0 2024-01-22T05:08:02.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.960+0000 7f5535600700 1 -- 172.21.15.49:0/519900604 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55380bc5b0 con 0x7f55380642e0 2024-01-22T05:08:02.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.964+0000 7f5536000700 1 -- 172.21.15.49:0/519900604 >> v1:172.21.15.110:6789/0 conn(0x7f55380642e0 legacy=0x7f55380bca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.964+0000 7f5536000700 1 -- 172.21.15.49:0/519900604 >> v1:172.21.15.49:6789/0 conn(0x7f55380c3c80 legacy=0x7f55380bddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.964+0000 7f5535600700 1 -- 172.21.15.49:0/519900604 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 507191226 0 0) 0x7f55180033f0 con 0x7f55380c3c80 2024-01-22T05:08:02.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.964+0000 7f5536000700 1 -- 172.21.15.49:0/519900604 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5538151340 con 0x7f5538150d00 2024-01-22T05:08:02.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.964+0000 7f5536000700 1 --2- 172.21.15.49:0/519900604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5538150d00 0x7f5538063df0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f5520009760 tx=0x7f5520009060).ready entity=mon.1 client_cookie=dff3dbac05ea3b93 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:02.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.964+0000 7f5535600700 1 -- 172.21.15.49:0/519900604 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5528001470 con 0x7f5538150d00 2024-01-22T05:08:02.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.964+0000 7f5535600700 1 -- 172.21.15.49:0/519900604 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55200090d0 con 0x7f5538150d00 2024-01-22T05:08:02.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.964+0000 7f5535600700 1 -- 172.21.15.49:0/519900604 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520011610 con 0x7f5538150d00 2024-01-22T05:08:02.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.964+0000 7f553d600700 1 -- 172.21.15.49:0/519900604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5538150d00 msgr2=0x7f5538063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.964+0000 7f553d600700 1 --2- 172.21.15.49:0/519900604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5538150d00 0x7f5538063df0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f5520009760 tx=0x7f5520009060).stop 2024-01-22T05:08:02.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.964+0000 7f553d600700 1 -- 172.21.15.49:0/519900604 shutdown_connections 2024-01-22T05:08:02.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.964+0000 7f553d600700 1 --2- 172.21.15.49:0/519900604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5538150d00 0x7f5538063df0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.964+0000 7f553d600700 1 -- 172.21.15.49:0/519900604 >> 172.21.15.49:0/519900604 conn(0x7f55380c40f0 msgr2=0x7f55380c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.964+0000 7f553d600700 1 -- 172.21.15.49:0/519900604 shutdown_connections 2024-01-22T05:08:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.964+0000 7f553d600700 1 -- 172.21.15.49:0/519900604 wait complete. 2024-01-22T05:08:02.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.968+0000 7f553d600700 1 Processor -- start 2024-01-22T05:08:02.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.968+0000 7f553d600700 1 -- start start 2024-01-22T05:08:02.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f553d600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55380642e0 0x7f55380acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f553d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55380c3c80 0x7f55380be6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f553d600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5538150d00 0x7f55380bebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f553d600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55380ad490 con 0x7f55380c3c80 2024-01-22T05:08:02.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f553d600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553816bae0 con 0x7f5538150d00 2024-01-22T05:08:02.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f553d600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55381689e0 con 0x7f55380642e0 2024-01-22T05:08:02.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f5536000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55380c3c80 0x7f55380be6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f5536000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55380c3c80 0x7f55380be6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40510/0 (socket says 172.21.15.49:40510) 2024-01-22T05:08:02.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f5536000700 1 -- 172.21.15.49:0/4045003929 learned_addr learned my addr 172.21.15.49:0/4045003929 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:02.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f5536a00700 1 --2- 172.21.15.49:0/4045003929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55380642e0 0x7f55380acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f5537400700 1 --2- 172.21.15.49:0/4045003929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5538150d00 0x7f55380bebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f5536000700 1 -- 172.21.15.49:0/4045003929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55380642e0 msgr2=0x7f55380acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f5536000700 1 --2- 172.21.15.49:0/4045003929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55380642e0 0x7f55380acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f5536000700 1 -- 172.21.15.49:0/4045003929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5538150d00 msgr2=0x7f55380bebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:02.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f5536000700 1 --2- 172.21.15.49:0/4045003929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5538150d00 0x7f55380bebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:02.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f5536000700 1 -- 172.21.15.49:0/4045003929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55200092a0 con 0x7f55380c3c80 2024-01-22T05:08:02.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f5537400700 1 --2- 172.21.15.49:0/4045003929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5538150d00 0x7f55380bebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:02.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f5536000700 1 --2- 172.21.15.49:0/4045003929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55380c3c80 0x7f55380be6f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f5520009d50 tx=0x7f5520016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:02.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f552e000700 1 -- 172.21.15.49:0/4045003929 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520010740 con 0x7f55380c3c80 2024-01-22T05:08:02.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f552e000700 1 -- 172.21.15.49:0/4045003929 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55200108a0 con 0x7f55380c3c80 2024-01-22T05:08:02.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f553d600700 1 -- 172.21.15.49:0/4045003929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5538168cc0 con 0x7f55380c3c80 2024-01-22T05:08:02.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f552e000700 1 -- 172.21.15.49:0/4045003929 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520010c20 con 0x7f55380c3c80 2024-01-22T05:08:02.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.972+0000 7f553d600700 1 -- 172.21.15.49:0/4045003929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5538169280 con 0x7f55380c3c80 2024-01-22T05:08:02.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.976+0000 7f553d600700 1 -- 172.21.15.49:0/4045003929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55380656b0 con 0x7f55380c3c80 2024-01-22T05:08:02.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.976+0000 7f552e000700 1 -- 172.21.15.49:0/4045003929 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f552001d640 con 0x7f55380c3c80 2024-01-22T05:08:02.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.976+0000 7f552e000700 1 --2- 172.21.15.49:0/4045003929 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f551005a510 0x7f551005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:02.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.976+0000 7f552e000700 1 -- 172.21.15.49:0/4045003929 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f5520075d50 con 0x7f55380c3c80 2024-01-22T05:08:02.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.980+0000 7f5536a00700 1 --2- 172.21.15.49:0/4045003929 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f551005a510 0x7f551005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:02.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.980+0000 7f5536a00700 1 --2- 172.21.15.49:0/4045003929 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f551005a510 0x7f551005c9d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f55280015a0 tx=0x7f5528000bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:02.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:02.984+0000 7f552e000700 1 -- 172.21.15.49:0/4045003929 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5520079030 con 0x7f55380c3c80 2024-01-22T05:08:03.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:03.184+0000 7f553d600700 1 -- 172.21.15.49:0/4045003929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5538046800 con 0x7f55380c3c80 2024-01-22T05:08:04.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.000+0000 7f552e000700 1 -- 172.21.15.49:0/4045003929 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5520049410 con 0x7f55380c3c80 2024-01-22T05:08:04.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.004+0000 7f553d600700 1 -- 172.21.15.49:0/4045003929 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f551005a510 msgr2=0x7f551005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:04.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.004+0000 7f553d600700 1 --2- 172.21.15.49:0/4045003929 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f551005a510 0x7f551005c9d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f55280015a0 tx=0x7f5528000bc0).stop 2024-01-22T05:08:04.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.004+0000 7f553d600700 1 -- 172.21.15.49:0/4045003929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55380c3c80 msgr2=0x7f55380be6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:04.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.004+0000 7f553d600700 1 --2- 172.21.15.49:0/4045003929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55380c3c80 0x7f55380be6f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f5520009d50 tx=0x7f5520016000).stop 2024-01-22T05:08:04.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.004+0000 7f553d600700 1 -- 172.21.15.49:0/4045003929 shutdown_connections 2024-01-22T05:08:04.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.004+0000 7f553d600700 1 --2- 172.21.15.49:0/4045003929 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f551005a510 0x7f551005c9d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:04.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.004+0000 7f553d600700 1 --2- 172.21.15.49:0/4045003929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5538150d00 0x7f55380bebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:04.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.004+0000 7f553d600700 1 --2- 172.21.15.49:0/4045003929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55380c3c80 0x7f55380be6f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:04.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.004+0000 7f553d600700 1 --2- 172.21.15.49:0/4045003929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55380642e0 0x7f55380acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:04.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.004+0000 7f553d600700 1 -- 172.21.15.49:0/4045003929 >> 172.21.15.49:0/4045003929 conn(0x7f55380c40f0 msgr2=0x7f5538152730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:04.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.004+0000 7f553d600700 1 -- 172.21.15.49:0/4045003929 shutdown_connections 2024-01-22T05:08:04.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.004+0000 7f553d600700 1 -- 172.21.15.49:0/4045003929 wait complete. 2024-01-22T05:08:04.031 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T05:08:04.031 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:08:04.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.200+0000 7f94e9800700 1 Processor -- start 2024-01-22T05:08:04.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.200+0000 7f94e9800700 1 -- start start 2024-01-22T05:08:04.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.204+0000 7f94e9800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94e40ace60 0x7f94e4069960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:04.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.204+0000 7f94e9800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e40c5ad0 0x7f94e40c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:04.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.204+0000 7f94e9800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e40a6fd0 con 0x7f94e4069580 2024-01-22T05:08:04.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.204+0000 7f94e9800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e40c5640 con 0x7f94e40ace60 2024-01-22T05:08:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.204+0000 7f94e9800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4154170 con 0x7f94e40c5ad0 2024-01-22T05:08:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.204+0000 7f94e2a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f94e4069580 0x7f94e40ac750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42140/0 (socket says 172.21.15.49:42140) 2024-01-22T05:08:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.204+0000 7f94e2a00700 1 -- 172.21.15.49:0/645694438 learned_addr learned my addr 172.21.15.49:0/645694438 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.204+0000 7f94e2000700 1 --2- 172.21.15.49:0/645694438 >> v2:172.21.15.110:3300/0 conn(0x7f94e40ace60 0x7f94e4069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.204+0000 7f94e3400700 1 --2- 172.21.15.49:0/645694438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e40c5ad0 0x7f94e40c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.204+0000 7f94e1600700 1 -- 172.21.15.49:0/645694438 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346688854 0 0) 0x7f94e40a6fd0 con 0x7f94e4069580 2024-01-22T05:08:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.204+0000 7f94e1600700 1 -- 172.21.15.49:0/645694438 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c40033f0 con 0x7f94e4069580 2024-01-22T05:08:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e2000700 1 -- 172.21.15.49:0/645694438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e40c5ad0 msgr2=0x7f94e40c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e2000700 1 --2- 172.21.15.49:0/645694438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e40c5ad0 0x7f94e40c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e2000700 1 -- 172.21.15.49:0/645694438 >> v1:172.21.15.49:6789/0 conn(0x7f94e4069580 legacy=0x7f94e40ac750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e2000700 1 -- 172.21.15.49:0/645694438 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e40c5310 con 0x7f94e40ace60 2024-01-22T05:08:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e2000700 1 --2- 172.21.15.49:0/645694438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94e40ace60 0x7f94e4069960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f94cc006fd0 tx=0x7f94cc006f40).ready entity=mon.1 client_cookie=ba921216ad805cc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e1600700 1 -- 172.21.15.49:0/645694438 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc005880 con 0x7f94e40ace60 2024-01-22T05:08:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e1600700 1 -- 172.21.15.49:0/645694438 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc0059e0 con 0x7f94e40ace60 2024-01-22T05:08:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e1600700 1 -- 172.21.15.49:0/645694438 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc005d60 con 0x7f94e40ace60 2024-01-22T05:08:04.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e9800700 1 -- 172.21.15.49:0/645694438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94e40ace60 msgr2=0x7f94e4069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:04.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e9800700 1 --2- 172.21.15.49:0/645694438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94e40ace60 0x7f94e4069960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f94cc006fd0 tx=0x7f94cc006f40).stop 2024-01-22T05:08:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e9800700 1 -- 172.21.15.49:0/645694438 shutdown_connections 2024-01-22T05:08:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e9800700 1 --2- 172.21.15.49:0/645694438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e40c5ad0 0x7f94e40c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e9800700 1 --2- 172.21.15.49:0/645694438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94e40ace60 0x7f94e4069960 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e9800700 1 -- 172.21.15.49:0/645694438 >> 172.21.15.49:0/645694438 conn(0x7f94e40aa700 msgr2=0x7f94e40aab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e9800700 1 -- 172.21.15.49:0/645694438 shutdown_connections 2024-01-22T05:08:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.208+0000 7f94e9800700 1 -- 172.21.15.49:0/645694438 wait complete. 2024-01-22T05:08:04.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.212+0000 7f94e9800700 1 Processor -- start 2024-01-22T05:08:04.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.212+0000 7f94e9800700 1 -- start start 2024-01-22T05:08:04.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e9800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e4069580 0x7f94e4092630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:04.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e9800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e40ace60 0x7f94e40c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:04.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e9800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94e40c5ad0 0x7f94e40c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:04.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e9800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e40c4a80 con 0x7f94e4069580 2024-01-22T05:08:04.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e9800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4165010 con 0x7f94e40c5ad0 2024-01-22T05:08:04.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e9800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4094340 con 0x7f94e40ace60 2024-01-22T05:08:04.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e4069580 0x7f94e4092630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:04.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e4069580 0x7f94e4092630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34026/0 (socket says 172.21.15.49:34026) 2024-01-22T05:08:04.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e2a00700 1 -- 172.21.15.49:0/2858083786 learned_addr learned my addr 172.21.15.49:0/2858083786 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:04.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e2000700 1 --2- 172.21.15.49:0/2858083786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e40ace60 0x7f94e40c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:04.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e3400700 1 --2- 172.21.15.49:0/2858083786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94e40c5ad0 0x7f94e40c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:04.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e2a00700 1 -- 172.21.15.49:0/2858083786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e40ace60 msgr2=0x7f94e40c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:04.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e2a00700 1 --2- 172.21.15.49:0/2858083786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e40ace60 0x7f94e40c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:04.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e2a00700 1 -- 172.21.15.49:0/2858083786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94e40c5ad0 msgr2=0x7f94e40c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:04.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e2a00700 1 --2- 172.21.15.49:0/2858083786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94e40c5ad0 0x7f94e40c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:04.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e2a00700 1 -- 172.21.15.49:0/2858083786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc009250 con 0x7f94e4069580 2024-01-22T05:08:04.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e2a00700 1 --2- 172.21.15.49:0/2858083786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e4069580 0x7f94e4092630 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f94d4001ed0 tx=0x7f94d4007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:04.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94da000700 1 -- 172.21.15.49:0/2858083786 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d400ce10 con 0x7f94e4069580 2024-01-22T05:08:04.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94da000700 1 -- 172.21.15.49:0/2858083786 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d40072e0 con 0x7f94e4069580 2024-01-22T05:08:04.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e9800700 1 -- 172.21.15.49:0/2858083786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e4094620 con 0x7f94e4069580 2024-01-22T05:08:04.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94da000700 1 -- 172.21.15.49:0/2858083786 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40057a0 con 0x7f94e4069580 2024-01-22T05:08:04.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.216+0000 7f94e9800700 1 -- 172.21.15.49:0/2858083786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e4094be0 con 0x7f94e4069580 2024-01-22T05:08:04.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.220+0000 7f94e9800700 1 -- 172.21.15.49:0/2858083786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e4064990 con 0x7f94e4069580 2024-01-22T05:08:04.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.220+0000 7f94da000700 1 -- 172.21.15.49:0/2858083786 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f94d4005b50 con 0x7f94e4069580 2024-01-22T05:08:04.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.224+0000 7f94da000700 1 --2- 172.21.15.49:0/2858083786 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f94bc05a510 0x7f94bc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:04.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.224+0000 7f94da000700 1 -- 172.21.15.49:0/2858083786 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f94d4073e10 con 0x7f94e4069580 2024-01-22T05:08:04.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.224+0000 7f94e2000700 1 --2- 172.21.15.49:0/2858083786 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f94bc05a510 0x7f94bc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:04.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.224+0000 7f94e2000700 1 --2- 172.21.15.49:0/2858083786 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f94bc05a510 0x7f94bc05c9d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f94e40ad260 tx=0x7f94cc015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:04.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.228+0000 7f94da000700 1 -- 172.21.15.49:0/2858083786 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f94d4047430 con 0x7f94e4069580 2024-01-22T05:08:04.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:04.436+0000 7f94e9800700 1 -- 172.21.15.49:0/2858083786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f94e40bc780 con 0x7f94e4069580 2024-01-22T05:08:05.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.008+0000 7f94da000700 1 -- 172.21.15.49:0/2858083786 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v42) v1 ==== 122+0+0 (secure 0 0 0) 0x7f94d4018030 con 0x7f94e4069580 2024-01-22T05:08:05.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.012+0000 7f94e9800700 1 -- 172.21.15.49:0/2858083786 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f94bc05a510 msgr2=0x7f94bc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:05.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.012+0000 7f94e9800700 1 --2- 172.21.15.49:0/2858083786 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f94bc05a510 0x7f94bc05c9d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f94e40ad260 tx=0x7f94cc015000).stop 2024-01-22T05:08:05.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.012+0000 7f94e9800700 1 -- 172.21.15.49:0/2858083786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e4069580 msgr2=0x7f94e4092630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:05.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.012+0000 7f94e9800700 1 --2- 172.21.15.49:0/2858083786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e4069580 0x7f94e4092630 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f94d4001ed0 tx=0x7f94d4007c70).stop 2024-01-22T05:08:05.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.016+0000 7f94e9800700 1 -- 172.21.15.49:0/2858083786 shutdown_connections 2024-01-22T05:08:05.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.016+0000 7f94e9800700 1 --2- 172.21.15.49:0/2858083786 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f94bc05a510 0x7f94bc05c9d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.016+0000 7f94e9800700 1 --2- 172.21.15.49:0/2858083786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94e40c5ad0 0x7f94e40c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.016+0000 7f94e9800700 1 --2- 172.21.15.49:0/2858083786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e40ace60 0x7f94e40c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.016+0000 7f94e9800700 1 --2- 172.21.15.49:0/2858083786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e4069580 0x7f94e4092630 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.016+0000 7f94e9800700 1 -- 172.21.15.49:0/2858083786 >> 172.21.15.49:0/2858083786 conn(0x7f94e40aa700 msgr2=0x7f94e4067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:05.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.016+0000 7f94e9800700 1 -- 172.21.15.49:0/2858083786 shutdown_connections 2024-01-22T05:08:05.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.016+0000 7f94e9800700 1 -- 172.21.15.49:0/2858083786 wait complete. 2024-01-22T05:08:05.043 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:08:05.043 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:05.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.212+0000 7f4989e00700 1 Processor -- start 2024-01-22T05:08:05.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.212+0000 7f4989e00700 1 -- start start 2024-01-22T05:08:05.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4989e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4984155880 0x7f49840a8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:05.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4989e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4984155c60 0x7f49840a6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:05.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4989e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4984068a60 con 0x7f49840a8e80 2024-01-22T05:08:05.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4989e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4984067e50 con 0x7f4984155c60 2024-01-22T05:08:05.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4989e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4984068130 con 0x7f4984155880 2024-01-22T05:08:05.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4983e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4984155c60 0x7f49840a6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:05.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4983e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4984155c60 0x7f49840a6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34040/0 (socket says 172.21.15.49:34040) 2024-01-22T05:08:05.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4983e00700 1 -- 172.21.15.49:0/1399105050 learned_addr learned my addr 172.21.15.49:0/1399105050 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:05.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4988a00700 1 --2- 172.21.15.49:0/1399105050 >> v2:172.21.15.110:3300/0 conn(0x7f4984155880 0x7f49840a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:05.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4983e00700 1 -- 172.21.15.49:0/1399105050 >> v2:172.21.15.110:3300/0 conn(0x7f4984155880 msgr2=0x7f49840a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:05.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4983e00700 1 --2- 172.21.15.49:0/1399105050 >> v2:172.21.15.110:3300/0 conn(0x7f4984155880 0x7f49840a8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4983e00700 1 -- 172.21.15.49:0/1399105050 >> v1:172.21.15.110:6789/0 conn(0x7f49840a8e80 legacy=0x7f49840659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:05.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4983e00700 1 -- 172.21.15.49:0/1399105050 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4984068410 con 0x7f4984155c60 2024-01-22T05:08:05.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4983e00700 1 --2- 172.21.15.49:0/1399105050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4984155c60 0x7f49840a6b50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f4984064470 tx=0x7f496c0090f0).ready entity=mon.0 client_cookie=dd481fabdf119f30 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:05.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4983400700 1 -- 172.21.15.49:0/1399105050 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c00b520 con 0x7f4984155c60 2024-01-22T05:08:05.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4983400700 1 -- 172.21.15.49:0/1399105050 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c00b680 con 0x7f4984155c60 2024-01-22T05:08:05.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.216+0000 7f4983400700 1 -- 172.21.15.49:0/1399105050 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c00ba00 con 0x7f4984155c60 2024-01-22T05:08:05.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.220+0000 7f4989e00700 1 -- 172.21.15.49:0/1399105050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4984155c60 msgr2=0x7f49840a6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:05.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.220+0000 7f4989e00700 1 --2- 172.21.15.49:0/1399105050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4984155c60 0x7f49840a6b50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f4984064470 tx=0x7f496c0090f0).stop 2024-01-22T05:08:05.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.220+0000 7f4989e00700 1 -- 172.21.15.49:0/1399105050 shutdown_connections 2024-01-22T05:08:05.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.220+0000 7f4989e00700 1 --2- 172.21.15.49:0/1399105050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4984155c60 0x7f49840a6b50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.220+0000 7f4989e00700 1 --2- 172.21.15.49:0/1399105050 >> v2:172.21.15.110:3300/0 conn(0x7f4984155880 0x7f49840a8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.220+0000 7f4989e00700 1 -- 172.21.15.49:0/1399105050 >> 172.21.15.49:0/1399105050 conn(0x7f49840c6530 msgr2=0x7f49840c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:05.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.220+0000 7f4989e00700 1 -- 172.21.15.49:0/1399105050 shutdown_connections 2024-01-22T05:08:05.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.220+0000 7f4989e00700 1 -- 172.21.15.49:0/1399105050 wait complete. 2024-01-22T05:08:05.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.224+0000 7f4989e00700 1 Processor -- start 2024-01-22T05:08:05.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.224+0000 7f4989e00700 1 -- start start 2024-01-22T05:08:05.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.224+0000 7f4989e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49840a8e80 0x7f49840ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:05.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.224+0000 7f4989e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4984155880 0x7f498409f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:05.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.224+0000 7f4989e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4984155c60 0x7f498409fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:05.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.224+0000 7f4989e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49840ab400 con 0x7f49840a8e80 2024-01-22T05:08:05.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.224+0000 7f4989e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498415d3a0 con 0x7f4984155880 2024-01-22T05:08:05.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.224+0000 7f4989e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498415d680 con 0x7f4984155c60 2024-01-22T05:08:05.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.224+0000 7f4988a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49840a8e80 0x7f49840ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:05.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.224+0000 7f4988a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49840a8e80 0x7f49840ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34052/0 (socket says 172.21.15.49:34052) 2024-01-22T05:08:05.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.224+0000 7f4988a00700 1 -- 172.21.15.49:0/717995595 learned_addr learned my addr 172.21.15.49:0/717995595 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:05.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.224+0000 7f4983e00700 1 --2- 172.21.15.49:0/717995595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4984155880 0x7f498409f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:05.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.224+0000 7f4989400700 1 --2- 172.21.15.49:0/717995595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4984155c60 0x7f498409fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:05.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.228+0000 7f4988a00700 1 -- 172.21.15.49:0/717995595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4984155c60 msgr2=0x7f498409fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:05.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.228+0000 7f4988a00700 1 --2- 172.21.15.49:0/717995595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4984155c60 0x7f498409fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.228+0000 7f4988a00700 1 -- 172.21.15.49:0/717995595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4984155880 msgr2=0x7f498409f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:05.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.228+0000 7f4988a00700 1 --2- 172.21.15.49:0/717995595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4984155880 0x7f498409f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.228+0000 7f4988a00700 1 -- 172.21.15.49:0/717995595 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c009370 con 0x7f49840a8e80 2024-01-22T05:08:05.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.228+0000 7f4988a00700 1 --2- 172.21.15.49:0/717995595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49840a8e80 0x7f49840ab890 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f497400e930 tx=0x7f4974009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:05.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.228+0000 7f497be00700 1 -- 172.21.15.49:0/717995595 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974012600 con 0x7f49840a8e80 2024-01-22T05:08:05.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.228+0000 7f497be00700 1 -- 172.21.15.49:0/717995595 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4974012760 con 0x7f49840a8e80 2024-01-22T05:08:05.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.228+0000 7f4989e00700 1 -- 172.21.15.49:0/717995595 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498415d960 con 0x7f49840a8e80 2024-01-22T05:08:05.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.228+0000 7f497be00700 1 -- 172.21.15.49:0/717995595 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974012ae0 con 0x7f49840a8e80 2024-01-22T05:08:05.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.228+0000 7f4989e00700 1 -- 172.21.15.49:0/717995595 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49840abd80 con 0x7f49840a8e80 2024-01-22T05:08:05.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.228+0000 7f4989e00700 1 -- 172.21.15.49:0/717995595 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49840ab230 con 0x7f49840a8e80 2024-01-22T05:08:05.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.232+0000 7f497be00700 1 -- 172.21.15.49:0/717995595 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f497401b400 con 0x7f49840a8e80 2024-01-22T05:08:05.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.232+0000 7f497be00700 1 --2- 172.21.15.49:0/717995595 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f495c05a510 0x7f495c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:05.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.232+0000 7f497be00700 1 -- 172.21.15.49:0/717995595 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4974074d30 con 0x7f49840a8e80 2024-01-22T05:08:05.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.232+0000 7f4983e00700 1 --2- 172.21.15.49:0/717995595 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f495c05a510 0x7f495c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:05.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.236+0000 7f4983e00700 1 --2- 172.21.15.49:0/717995595 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f495c05a510 0x7f495c05c9d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f496c009130 tx=0x7f496c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:05.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.240+0000 7f497be00700 1 -- 172.21.15.49:0/717995595 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4974048350 con 0x7f49840a8e80 2024-01-22T05:08:05.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.440+0000 7f4989e00700 1 -- 172.21.15.49:0/717995595 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f498405fd40 con 0x7f49840a8e80 2024-01-22T05:08:05.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.440+0000 7f497be00700 1 -- 172.21.15.49:0/717995595 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f497404b970 con 0x7f49840a8e80 2024-01-22T05:08:05.443 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:05.443 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:05.000169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:05.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.444+0000 7f4989e00700 1 -- 172.21.15.49:0/717995595 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f495c05a510 msgr2=0x7f495c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:05.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.444+0000 7f4989e00700 1 --2- 172.21.15.49:0/717995595 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f495c05a510 0x7f495c05c9d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f496c009130 tx=0x7f496c017000).stop 2024-01-22T05:08:05.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.444+0000 7f4989e00700 1 -- 172.21.15.49:0/717995595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49840a8e80 msgr2=0x7f49840ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:05.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.444+0000 7f4989e00700 1 --2- 172.21.15.49:0/717995595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49840a8e80 0x7f49840ab890 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f497400e930 tx=0x7f4974009060).stop 2024-01-22T05:08:05.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.444+0000 7f4989e00700 1 -- 172.21.15.49:0/717995595 shutdown_connections 2024-01-22T05:08:05.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.444+0000 7f4989e00700 1 --2- 172.21.15.49:0/717995595 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f495c05a510 0x7f495c05c9d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.444+0000 7f4989e00700 1 --2- 172.21.15.49:0/717995595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4984155c60 0x7f498409fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.444+0000 7f4989e00700 1 --2- 172.21.15.49:0/717995595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4984155880 0x7f498409f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.444+0000 7f4989e00700 1 --2- 172.21.15.49:0/717995595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49840a8e80 0x7f49840ab890 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.444+0000 7f4989e00700 1 -- 172.21.15.49:0/717995595 >> 172.21.15.49:0/717995595 conn(0x7f49840c6530 msgr2=0x7f4984065c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:05.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.444+0000 7f4989e00700 1 -- 172.21.15.49:0/717995595 shutdown_connections 2024-01-22T05:08:05.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.444+0000 7f4989e00700 1 -- 172.21.15.49:0/717995595 wait complete. 2024-01-22T05:08:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 42 2024-01-22T05:08:05.472 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:08:05.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.640+0000 7f9fdd400700 1 Processor -- start 2024-01-22T05:08:05.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.644+0000 7f9fdd400700 1 -- start start 2024-01-22T05:08:05.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.644+0000 7f9fdd400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9fd8065660 0x7f9fd80a6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:05.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fdd400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fd8064950 0x7f9fd8157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:05.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fdd400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd80c2700 con 0x7f9fd80644f0 2024-01-22T05:08:05.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fdd400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd80bdc90 con 0x7f9fd8065660 2024-01-22T05:08:05.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fdd400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80c2930 con 0x7f9fd8064950 2024-01-22T05:08:05.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fd6800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9fd8065660 0x7f9fd80a6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:05.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fd6800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9fd8065660 0x7f9fd80a6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:52538/0 (socket says 172.21.15.49:52538) 2024-01-22T05:08:05.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fd6800700 1 -- 172.21.15.49:0/474639654 learned_addr learned my addr 172.21.15.49:0/474639654 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:05.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fdca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fd8064950 0x7f9fd8157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:05.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fd6800700 1 -- 172.21.15.49:0/474639654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fd8064950 msgr2=0x7f9fd8157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:05.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fd6800700 1 --2- 172.21.15.49:0/474639654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fd8064950 0x7f9fd8157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fd6800700 1 -- 172.21.15.49:0/474639654 >> v1:172.21.15.110:6789/0 conn(0x7f9fd80644f0 legacy=0x7f9fd81575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:05.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fd6800700 1 -- 172.21.15.49:0/474639654 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd80c2c10 con 0x7f9fd8065660 2024-01-22T05:08:05.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fd6800700 1 --2- 172.21.15.49:0/474639654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fd8065660 0x7f9fd80a6f40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f9fc8006fd0 tx=0x7f9fc80090f0).ready entity=mon.1 client_cookie=8fa0866ca932bfbb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:05.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fd5400700 1 -- 172.21.15.49:0/474639654 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc800b580 con 0x7f9fd8065660 2024-01-22T05:08:05.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fd5400700 1 -- 172.21.15.49:0/474639654 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc800b6e0 con 0x7f9fd8065660 2024-01-22T05:08:05.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fd5400700 1 -- 172.21.15.49:0/474639654 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc800ba60 con 0x7f9fd8065660 2024-01-22T05:08:05.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fdd400700 1 -- 172.21.15.49:0/474639654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fd8065660 msgr2=0x7f9fd80a6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:05.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.648+0000 7f9fdd400700 1 --2- 172.21.15.49:0/474639654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fd8065660 0x7f9fd80a6f40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f9fc8006fd0 tx=0x7f9fc80090f0).stop 2024-01-22T05:08:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.652+0000 7f9fdd400700 1 -- 172.21.15.49:0/474639654 shutdown_connections 2024-01-22T05:08:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.652+0000 7f9fdd400700 1 --2- 172.21.15.49:0/474639654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fd8064950 0x7f9fd8157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.652+0000 7f9fdd400700 1 --2- 172.21.15.49:0/474639654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fd8065660 0x7f9fd80a6f40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.652+0000 7f9fdd400700 1 -- 172.21.15.49:0/474639654 >> 172.21.15.49:0/474639654 conn(0x7f9fd80c87f0 msgr2=0x7f9fd80c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.652+0000 7f9fdd400700 1 -- 172.21.15.49:0/474639654 shutdown_connections 2024-01-22T05:08:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.652+0000 7f9fdd400700 1 -- 172.21.15.49:0/474639654 wait complete. 2024-01-22T05:08:05.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.652+0000 7f9fdd400700 1 Processor -- start 2024-01-22T05:08:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.656+0000 7f9fdd400700 1 -- start start 2024-01-22T05:08:05.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.656+0000 7f9fdd400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fd80644f0 0x7f9fd80a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:05.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.656+0000 7f9fdd400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fd8064950 0x7f9fd8154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:05.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.656+0000 7f9fdd400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fd8065660 0x7f9fd80ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:05.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.656+0000 7f9fdd400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80a87a0 con 0x7f9fd80644f0 2024-01-22T05:08:05.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.656+0000 7f9fdd400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80a8a40 con 0x7f9fd8065660 2024-01-22T05:08:05.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.656+0000 7f9fdd400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80a8d20 con 0x7f9fd8064950 2024-01-22T05:08:05.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.656+0000 7f9fdca00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fd8065660 0x7f9fd80ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:05.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.656+0000 7f9fd5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fd8064950 0x7f9fd8154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:05.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.656+0000 7f9fd6800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fd80644f0 0x7f9fd80a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:05.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.656+0000 7f9fdca00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fd8065660 0x7f9fd80ad160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:52546/0 (socket says 172.21.15.49:52546) 2024-01-22T05:08:05.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.656+0000 7f9fdca00700 1 -- 172.21.15.49:0/1904305160 learned_addr learned my addr 172.21.15.49:0/1904305160 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:05.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.660+0000 7f9fdca00700 1 -- 172.21.15.49:0/1904305160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fd8064950 msgr2=0x7f9fd8154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:05.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.660+0000 7f9fdca00700 1 --2- 172.21.15.49:0/1904305160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fd8064950 0x7f9fd8154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.660+0000 7f9fdca00700 1 -- 172.21.15.49:0/1904305160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fd80644f0 msgr2=0x7f9fd80a7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:05.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.660+0000 7f9fdca00700 1 --2- 172.21.15.49:0/1904305160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fd80644f0 0x7f9fd80a7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.660+0000 7f9fdca00700 1 -- 172.21.15.49:0/1904305160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8009370 con 0x7f9fd8065660 2024-01-22T05:08:05.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.660+0000 7f9fd5e00700 1 --2- 172.21.15.49:0/1904305160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fd8064950 0x7f9fd8154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:05.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.660+0000 7f9fd6800700 1 --2- 172.21.15.49:0/1904305160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fd80644f0 0x7f9fd80a7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:05.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.660+0000 7f9fdca00700 1 --2- 172.21.15.49:0/1904305160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fd8065660 0x7f9fd80ad160 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f9fd0009e90 tx=0x7f9fd000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:05.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.660+0000 7f9fce000700 1 -- 172.21.15.49:0/1904305160 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd000caa0 con 0x7f9fd8065660 2024-01-22T05:08:05.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.660+0000 7f9fce000700 1 -- 172.21.15.49:0/1904305160 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd000f040 con 0x7f9fd8065660 2024-01-22T05:08:05.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.660+0000 7f9fce000700 1 -- 172.21.15.49:0/1904305160 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd000ce10 con 0x7f9fd8065660 2024-01-22T05:08:05.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.660+0000 7f9fdd400700 1 -- 172.21.15.49:0/1904305160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd80a9000 con 0x7f9fd8065660 2024-01-22T05:08:05.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.660+0000 7f9fdd400700 1 -- 172.21.15.49:0/1904305160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd80a95c0 con 0x7f9fd8065660 2024-01-22T05:08:05.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.660+0000 7f9fdd400700 1 -- 172.21.15.49:0/1904305160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd8047060 con 0x7f9fd8065660 2024-01-22T05:08:05.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.664+0000 7f9fce000700 1 -- 172.21.15.49:0/1904305160 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9fd0013610 con 0x7f9fd8065660 2024-01-22T05:08:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.664+0000 7f9fce000700 1 --2- 172.21.15.49:0/1904305160 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9fb005a510 0x7f9fb005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.664+0000 7f9fce000700 1 -- 172.21.15.49:0/1904305160 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9fd0075250 con 0x7f9fd8065660 2024-01-22T05:08:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.664+0000 7f9fd6800700 1 --2- 172.21.15.49:0/1904305160 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9fb005a510 0x7f9fb005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:05.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.668+0000 7f9fd6800700 1 --2- 172.21.15.49:0/1904305160 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9fb005a510 0x7f9fb005c9d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f9fc8009130 tx=0x7f9fc8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.672+0000 7f9fce000700 1 -- 172.21.15.49:0/1904305160 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9fd0048810 con 0x7f9fd8065660 2024-01-22T05:08:05.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.848+0000 7f9fdd400700 1 -- 172.21.15.49:0/1904305160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fd80c2ef0 con 0x7f9fd8065660 2024-01-22T05:08:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.852+0000 7f9fce000700 1 -- 172.21.15.49:0/1904305160 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17164 (secure 0 0 0) 0x7f9fd004be30 con 0x7f9fd8065660 2024-01-22T05:08:05.855 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:05.856 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":56,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:08:02.974356+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:08:00.161271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-22T05:08:00.977775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:08:05.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.856+0000 7f9fdd400700 1 -- 172.21.15.49:0/1904305160 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9fb005a510 msgr2=0x7f9fb005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.856+0000 7f9fdd400700 1 --2- 172.21.15.49:0/1904305160 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9fb005a510 0x7f9fb005c9d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f9fc8009130 tx=0x7f9fc8017000).stop 2024-01-22T05:08:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.856+0000 7f9fdd400700 1 -- 172.21.15.49:0/1904305160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fd8065660 msgr2=0x7f9fd80ad160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.856+0000 7f9fdd400700 1 --2- 172.21.15.49:0/1904305160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fd8065660 0x7f9fd80ad160 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f9fd0009e90 tx=0x7f9fd000b040).stop 2024-01-22T05:08:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.856+0000 7f9fdd400700 1 -- 172.21.15.49:0/1904305160 shutdown_connections 2024-01-22T05:08:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.856+0000 7f9fdd400700 1 --2- 172.21.15.49:0/1904305160 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9fb005a510 0x7f9fb005c9d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.856+0000 7f9fdd400700 1 --2- 172.21.15.49:0/1904305160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fd8065660 0x7f9fd80ad160 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.856+0000 7f9fdd400700 1 --2- 172.21.15.49:0/1904305160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9fd8064950 0x7f9fd8154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.856+0000 7f9fdd400700 1 --2- 172.21.15.49:0/1904305160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fd80644f0 0x7f9fd80a7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.856+0000 7f9fdd400700 1 -- 172.21.15.49:0/1904305160 >> 172.21.15.49:0/1904305160 conn(0x7f9fd80c87f0 msgr2=0x7f9fd8155d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.856+0000 7f9fdd400700 1 -- 172.21.15.49:0/1904305160 shutdown_connections 2024-01-22T05:08:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:05.856+0000 7f9fdd400700 1 -- 172.21.15.49:0/1904305160 wait complete. 2024-01-22T05:08:05.883 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:08:05.883 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:08:06.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.056+0000 7fbb51c00700 1 Processor -- start 2024-01-22T05:08:06.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.060+0000 7fbb51c00700 1 -- start start 2024-01-22T05:08:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb51c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbb4c155d20 0x7fbb4c065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb51c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbb4c066070 0x7fbb4c0a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb51c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4c0c1a40 con 0x7fbb4c0a8c30 2024-01-22T05:08:06.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb51c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4c0a90c0 con 0x7fbb4c155d20 2024-01-22T05:08:06.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb51c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4c159310 con 0x7fbb4c066070 2024-01-22T05:08:06.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb4aa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbb4c155d20 0x7fbb4c065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb4aa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbb4c155d20 0x7fbb4c065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34078/0 (socket says 172.21.15.49:34078) 2024-01-22T05:08:06.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb4aa00700 1 -- 172.21.15.49:0/3137575309 learned_addr learned my addr 172.21.15.49:0/3137575309 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:06.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb4a000700 1 --2- 172.21.15.49:0/3137575309 >> v2:172.21.15.110:3300/0 conn(0x7fbb4c066070 0x7fbb4c0a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb4aa00700 1 -- 172.21.15.49:0/3137575309 >> v2:172.21.15.110:3300/0 conn(0x7fbb4c066070 msgr2=0x7fbb4c0a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:06.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb4aa00700 1 --2- 172.21.15.49:0/3137575309 >> v2:172.21.15.110:3300/0 conn(0x7fbb4c066070 0x7fbb4c0a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb4aa00700 1 -- 172.21.15.49:0/3137575309 >> v1:172.21.15.110:6789/0 conn(0x7fbb4c0a8c30 legacy=0x7fbb4c0c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb4aa00700 1 -- 172.21.15.49:0/3137575309 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c0c13f0 con 0x7fbb4c155d20 2024-01-22T05:08:06.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb4aa00700 1 --2- 172.21.15.49:0/3137575309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb4c155d20 0x7fbb4c065b80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fbb4c0c0ad0 tx=0x7fbb3c0090f0).ready entity=mon.0 client_cookie=88eb82ea1813eda1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:06.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb49600700 1 -- 172.21.15.49:0/3137575309 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c00b520 con 0x7fbb4c155d20 2024-01-22T05:08:06.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb49600700 1 -- 172.21.15.49:0/3137575309 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c00b680 con 0x7fbb4c155d20 2024-01-22T05:08:06.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb49600700 1 -- 172.21.15.49:0/3137575309 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c00ba00 con 0x7fbb4c155d20 2024-01-22T05:08:06.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb51c00700 1 -- 172.21.15.49:0/3137575309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb4c155d20 msgr2=0x7fbb4c065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.064+0000 7fbb51c00700 1 --2- 172.21.15.49:0/3137575309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb4c155d20 0x7fbb4c065b80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fbb4c0c0ad0 tx=0x7fbb3c0090f0).stop 2024-01-22T05:08:06.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.068+0000 7fbb51c00700 1 -- 172.21.15.49:0/3137575309 shutdown_connections 2024-01-22T05:08:06.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.068+0000 7fbb51c00700 1 --2- 172.21.15.49:0/3137575309 >> v2:172.21.15.110:3300/0 conn(0x7fbb4c066070 0x7fbb4c0a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.068+0000 7fbb51c00700 1 --2- 172.21.15.49:0/3137575309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb4c155d20 0x7fbb4c065b80 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.068+0000 7fbb51c00700 1 -- 172.21.15.49:0/3137575309 >> 172.21.15.49:0/3137575309 conn(0x7fbb4c0c6540 msgr2=0x7fbb4c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:06.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.068+0000 7fbb51c00700 1 -- 172.21.15.49:0/3137575309 shutdown_connections 2024-01-22T05:08:06.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.068+0000 7fbb51c00700 1 -- 172.21.15.49:0/3137575309 wait complete. 2024-01-22T05:08:06.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.068+0000 7fbb51c00700 1 Processor -- start 2024-01-22T05:08:06.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.068+0000 7fbb51c00700 1 -- start start 2024-01-22T05:08:06.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb51c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c066070 0x7fbb4c16c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb51c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb4c0a8c30 0x7fbb4c169840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb51c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb4c155d20 0x7fbb4c141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb51c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c169d30 con 0x7fbb4c155d20 2024-01-22T05:08:06.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb51c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c169f10 con 0x7fbb4c0a8c30 2024-01-22T05:08:06.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb51c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c0bf100 con 0x7fbb4c066070 2024-01-22T05:08:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb4b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb4c155d20 0x7fbb4c141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb4b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb4c155d20 0x7fbb4c141ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34088/0 (socket says 172.21.15.49:34088) 2024-01-22T05:08:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb4b400700 1 -- 172.21.15.49:0/2340374670 learned_addr learned my addr 172.21.15.49:0/2340374670 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb4a000700 1 --2- 172.21.15.49:0/2340374670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb4c0a8c30 0x7fbb4c169840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb4aa00700 1 --2- 172.21.15.49:0/2340374670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c066070 0x7fbb4c16c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb4b400700 1 -- 172.21.15.49:0/2340374670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c066070 msgr2=0x7fbb4c16c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb4b400700 1 --2- 172.21.15.49:0/2340374670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c066070 0x7fbb4c16c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb4b400700 1 -- 172.21.15.49:0/2340374670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb4c0a8c30 msgr2=0x7fbb4c169840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb4b400700 1 --2- 172.21.15.49:0/2340374670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb4c0a8c30 0x7fbb4c169840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb4b400700 1 -- 172.21.15.49:0/2340374670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c009370 con 0x7fbb4c155d20 2024-01-22T05:08:06.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb4b400700 1 --2- 172.21.15.49:0/2340374670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb4c155d20 0x7fbb4c141ed0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fbb44002230 tx=0x7fbb440015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:06.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb42000700 1 -- 172.21.15.49:0/2340374670 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44010510 con 0x7fbb4c155d20 2024-01-22T05:08:06.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb42000700 1 -- 172.21.15.49:0/2340374670 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb44010670 con 0x7fbb4c155d20 2024-01-22T05:08:06.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb42000700 1 -- 172.21.15.49:0/2340374670 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb440109f0 con 0x7fbb4c155d20 2024-01-22T05:08:06.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.072+0000 7fbb51c00700 1 -- 172.21.15.49:0/2340374670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4c0bedf0 con 0x7fbb4c155d20 2024-01-22T05:08:06.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.076+0000 7fbb51c00700 1 -- 172.21.15.49:0/2340374670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4c16ca60 con 0x7fbb4c155d20 2024-01-22T05:08:06.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.076+0000 7fbb51c00700 1 -- 172.21.15.49:0/2340374670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4c047060 con 0x7fbb4c155d20 2024-01-22T05:08:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.076+0000 7fbb42000700 1 -- 172.21.15.49:0/2340374670 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbb4401b400 con 0x7fbb4c155d20 2024-01-22T05:08:06.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.076+0000 7fbb42000700 1 --2- 172.21.15.49:0/2340374670 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbb2405a510 0x7fbb2405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.080+0000 7fbb42000700 1 -- 172.21.15.49:0/2340374670 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fbb44074660 con 0x7fbb4c155d20 2024-01-22T05:08:06.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.080+0000 7fbb4aa00700 1 --2- 172.21.15.49:0/2340374670 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbb2405a510 0x7fbb2405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.080+0000 7fbb4aa00700 1 --2- 172.21.15.49:0/2340374670 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbb2405a510 0x7fbb2405c9d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fbb3c009130 tx=0x7fbb3c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:06.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.084+0000 7fbb42000700 1 -- 172.21.15.49:0/2340374670 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbb44047c80 con 0x7fbb4c155d20 2024-01-22T05:08:06.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.252+0000 7fbb51c00700 1 -- 172.21.15.49:0/2340374670 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb4c0c4440 con 0x7fbb2405a510 2024-01-22T05:08:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.272+0000 7fbb42000700 1 -- 172.21.15.49:0/2340374670 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358746 (secure 0 0 0) 0x7fbb4c0c4440 con 0x7fbb2405a510 2024-01-22T05:08:06.280 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.280+0000 7fbb51c00700 1 -- 172.21.15.49:0/2340374670 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbb2405a510 msgr2=0x7fbb2405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.280+0000 7fbb51c00700 1 --2- 172.21.15.49:0/2340374670 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbb2405a510 0x7fbb2405c9d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fbb3c009130 tx=0x7fbb3c017000).stop 2024-01-22T05:08:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.280+0000 7fbb51c00700 1 -- 172.21.15.49:0/2340374670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb4c155d20 msgr2=0x7fbb4c141ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.280+0000 7fbb51c00700 1 --2- 172.21.15.49:0/2340374670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb4c155d20 0x7fbb4c141ed0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fbb44002230 tx=0x7fbb440015e0).stop 2024-01-22T05:08:06.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.284+0000 7fbb51c00700 1 -- 172.21.15.49:0/2340374670 shutdown_connections 2024-01-22T05:08:06.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.284+0000 7fbb51c00700 1 --2- 172.21.15.49:0/2340374670 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbb2405a510 0x7fbb2405c9d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.284+0000 7fbb51c00700 1 --2- 172.21.15.49:0/2340374670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb4c155d20 0x7fbb4c141ed0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.284+0000 7fbb51c00700 1 --2- 172.21.15.49:0/2340374670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb4c0a8c30 0x7fbb4c169840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.284+0000 7fbb51c00700 1 --2- 172.21.15.49:0/2340374670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c066070 0x7fbb4c16c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.284+0000 7fbb51c00700 1 -- 172.21.15.49:0/2340374670 >> 172.21.15.49:0/2340374670 conn(0x7fbb4c0c6540 msgr2=0x7fbb4c158680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:06.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.284+0000 7fbb51c00700 1 -- 172.21.15.49:0/2340374670 shutdown_connections 2024-01-22T05:08:06.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.284+0000 7fbb51c00700 1 -- 172.21.15.49:0/2340374670 wait complete. 2024-01-22T05:08:06.289 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:08:06.308 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-01-22T05:08:05.302847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2455544,"kb_used_data":5048,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752519176,"statfs":{"total":773094113280,"available":770579636224,"internally_reserved":0,"allocated":5169152,"data_stored":2426814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2800594,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1990,"num_read_kb":-2292,"num_write":-19172,"num_write_kb":-93473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-47,"num_bytes_recovered":-134,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.385030"},"pg_stats":[{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.015075+0000","last_change":"2024-01-22T05:08:02.015075+0000","last_active":"2024-01-22T05:08:02.015075+0000","last_peered":"2024-01-22T05:08:02.015075+0000","last_clean":"2024-01-22T05:08:02.015075+0000","last_became_active":"2024-01-22T05:08:02.014768+0000","last_became_peered":"2024-01-22T05:08:02.014768+0000","last_unstale":"2024-01-22T05:08:02.015075+0000","last_undegraded":"2024-01-22T05:08:02.015075+0000","last_fullsized":"2024-01-22T05:08:02.015075+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"55'3","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.011077+0000","last_change":"2024-01-22T05:08:01.557413+0000","last_active":"2024-01-22T05:08:02.011077+0000","last_peered":"2024-01-22T05:08:02.011077+0000","last_clean":"2024-01-22T05:08:02.011077+0000","last_became_active":"2024-01-22T05:08:01.556997+0000","last_became_peered":"2024-01-22T05:08:01.556997+0000","last_unstale":"2024-01-22T05:08:02.011077+0000","last_undegraded":"2024-01-22T05:08:02.011077+0000","last_fullsized":"2024-01-22T05:08:02.011077+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.007915+0000","last_change":"2024-01-22T05:08:02.007915+0000","last_active":"2024-01-22T05:08:02.007915+0000","last_peered":"2024-01-22T05:08:02.007915+0000","last_clean":"2024-01-22T05:08:02.007915+0000","last_became_active":"2024-01-22T05:08:02.007515+0000","last_became_peered":"2024-01-22T05:08:02.007515+0000","last_unstale":"2024-01-22T05:08:02.007915+0000","last_undegraded":"2024-01-22T05:08:02.007915+0000","last_fullsized":"2024-01-22T05:08:02.007915+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.567426+0000","last_change":"2024-01-22T05:08:01.563248+0000","last_active":"2024-01-22T05:08:01.567426+0000","last_peered":"2024-01-22T05:08:01.567426+0000","last_clean":"2024-01-22T05:08:01.567426+0000","last_became_active":"2024-01-22T05:08:01.562943+0000","last_became_peered":"2024-01-22T05:08:01.562943+0000","last_unstale":"2024-01-22T05:08:01.567426+0000","last_undegraded":"2024-01-22T05:08:01.567426+0000","last_fullsized":"2024-01-22T05:08:01.567426+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.010949+0000","last_change":"2024-01-22T05:08:02.010949+0000","last_active":"2024-01-22T05:08:02.010949+0000","last_peered":"2024-01-22T05:08:02.010949+0000","last_clean":"2024-01-22T05:08:02.010949+0000","last_became_active":"2024-01-22T05:08:02.010516+0000","last_became_peered":"2024-01-22T05:08:02.010516+0000","last_unstale":"2024-01-22T05:08:02.010949+0000","last_undegraded":"2024-01-22T05:08:02.010949+0000","last_fullsized":"2024-01-22T05:08:02.010949+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.586504+0000","last_change":"2024-01-22T05:08:01.576352+0000","last_active":"2024-01-22T05:08:01.586504+0000","last_peered":"2024-01-22T05:08:01.586504+0000","last_clean":"2024-01-22T05:08:01.586504+0000","last_became_active":"2024-01-22T05:08:01.575752+0000","last_became_peered":"2024-01-22T05:08:01.575752+0000","last_unstale":"2024-01-22T05:08:01.586504+0000","last_undegraded":"2024-01-22T05:08:01.586504+0000","last_fullsized":"2024-01-22T05:08:01.586504+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.005405+0000","last_change":"2024-01-22T05:08:02.005405+0000","last_active":"2024-01-22T05:08:02.005405+0000","last_peered":"2024-01-22T05:08:02.005405+0000","last_clean":"2024-01-22T05:08:02.005405+0000","last_became_active":"2024-01-22T05:08:02.005009+0000","last_became_peered":"2024-01-22T05:08:02.005009+0000","last_unstale":"2024-01-22T05:08:02.005405+0000","last_undegraded":"2024-01-22T05:08:02.005405+0000","last_fullsized":"2024-01-22T05:08:02.005405+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3c","version":"55'2","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.021907+0000","last_change":"2024-01-22T05:08:01.578386+0000","last_active":"2024-01-22T05:08:02.021907+0000","last_peered":"2024-01-22T05:08:02.021907+0000","last_clean":"2024-01-22T05:08:02.021907+0000","last_became_active":"2024-01-22T05:08:01.578131+0000","last_became_peered":"2024-01-22T05:08:01.578131+0000","last_unstale":"2024-01-22T05:08:02.021907+0000","last_undegraded":"2024-01-22T05:08:02.021907+0000","last_fullsized":"2024-01-22T05:08:02.021907+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.997313+0000","last_change":"2024-01-22T05:08:01.997313+0000","last_active":"2024-01-22T05:08:01.997313+0000","last_peered":"2024-01-22T05:08:01.997313+0000","last_clean":"2024-01-22T05:08:01.997313+0000","last_became_active":"2024-01-22T05:08:01.997096+0000","last_became_peered":"2024-01-22T05:08:01.997096+0000","last_unstale":"2024-01-22T05:08:01.997313+0000","last_undegraded":"2024-01-22T05:08:01.997313+0000","last_fullsized":"2024-01-22T05:08:01.997313+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.996156+0000","last_change":"2024-01-22T05:08:01.561776+0000","last_active":"2024-01-22T05:08:01.996156+0000","last_peered":"2024-01-22T05:08:01.996156+0000","last_clean":"2024-01-22T05:08:01.996156+0000","last_became_active":"2024-01-22T05:08:01.561557+0000","last_became_peered":"2024-01-22T05:08:01.561557+0000","last_unstale":"2024-01-22T05:08:01.996156+0000","last_undegraded":"2024-01-22T05:08:01.996156+0000","last_fullsized":"2024-01-22T05:08:01.996156+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.007790+0000","last_change":"2024-01-22T05:08:02.007790+0000","last_active":"2024-01-22T05:08:02.007790+0000","last_peered":"2024-01-22T05:08:02.007790+0000","last_clean":"2024-01-22T05:08:02.007790+0000","last_became_active":"2024-01-22T05:08:02.007427+0000","last_became_peered":"2024-01-22T05:08:02.007427+0000","last_unstale":"2024-01-22T05:08:02.007790+0000","last_undegraded":"2024-01-22T05:08:02.007790+0000","last_fullsized":"2024-01-22T05:08:02.007790+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.988462+0000","last_change":"2024-01-22T05:08:01.564406+0000","last_active":"2024-01-22T05:08:01.988462+0000","last_peered":"2024-01-22T05:08:01.988462+0000","last_clean":"2024-01-22T05:08:01.988462+0000","last_became_active":"2024-01-22T05:08:01.564116+0000","last_became_peered":"2024-01-22T05:08:01.564116+0000","last_unstale":"2024-01-22T05:08:01.988462+0000","last_undegraded":"2024-01-22T05:08:01.988462+0000","last_fullsized":"2024-01-22T05:08:01.988462+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.003703+0000","last_change":"2024-01-22T05:08:02.003703+0000","last_active":"2024-01-22T05:08:02.003703+0000","last_peered":"2024-01-22T05:08:02.003703+0000","last_clean":"2024-01-22T05:08:02.003703+0000","last_became_active":"2024-01-22T05:08:02.003384+0000","last_became_peered":"2024-01-22T05:08:02.003384+0000","last_unstale":"2024-01-22T05:08:02.003703+0000","last_undegraded":"2024-01-22T05:08:02.003703+0000","last_fullsized":"2024-01-22T05:08:02.003703+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.586314+0000","last_change":"2024-01-22T05:08:01.578974+0000","last_active":"2024-01-22T05:08:01.586314+0000","last_peered":"2024-01-22T05:08:01.586314+0000","last_clean":"2024-01-22T05:08:01.586314+0000","last_became_active":"2024-01-22T05:08:01.578535+0000","last_became_peered":"2024-01-22T05:08:01.578535+0000","last_unstale":"2024-01-22T05:08:01.586314+0000","last_undegraded":"2024-01-22T05:08:01.586314+0000","last_fullsized":"2024-01-22T05:08:01.586314+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.002122+0000","last_change":"2024-01-22T05:08:02.002122+0000","last_active":"2024-01-22T05:08:02.002122+0000","last_peered":"2024-01-22T05:08:02.002122+0000","last_clean":"2024-01-22T05:08:02.002122+0000","last_became_active":"2024-01-22T05:08:02.001796+0000","last_became_peered":"2024-01-22T05:08:02.001796+0000","last_unstale":"2024-01-22T05:08:02.002122+0000","last_undegraded":"2024-01-22T05:08:02.002122+0000","last_fullsized":"2024-01-22T05:08:02.002122+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.566705+0000","last_change":"2024-01-22T05:08:01.554224+0000","last_active":"2024-01-22T05:08:01.566705+0000","last_peered":"2024-01-22T05:08:01.566705+0000","last_clean":"2024-01-22T05:08:01.566705+0000","last_became_active":"2024-01-22T05:08:01.553943+0000","last_became_peered":"2024-01-22T05:08:01.553943+0000","last_unstale":"2024-01-22T05:08:01.566705+0000","last_undegraded":"2024-01-22T05:08:01.566705+0000","last_fullsized":"2024-01-22T05:08:01.566705+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.011921+0000","last_change":"2024-01-22T05:08:02.011921+0000","last_active":"2024-01-22T05:08:02.011921+0000","last_peered":"2024-01-22T05:08:02.011921+0000","last_clean":"2024-01-22T05:08:02.011921+0000","last_became_active":"2024-01-22T05:08:02.011766+0000","last_became_peered":"2024-01-22T05:08:02.011766+0000","last_unstale":"2024-01-22T05:08:02.011921+0000","last_undegraded":"2024-01-22T05:08:02.011921+0000","last_fullsized":"2024-01-22T05:08:02.011921+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.586666+0000","last_change":"2024-01-22T05:08:01.584904+0000","last_active":"2024-01-22T05:08:01.586666+0000","last_peered":"2024-01-22T05:08:01.586666+0000","last_clean":"2024-01-22T05:08:01.586666+0000","last_became_active":"2024-01-22T05:08:01.584390+0000","last_became_peered":"2024-01-22T05:08:01.584390+0000","last_unstale":"2024-01-22T05:08:01.586666+0000","last_undegraded":"2024-01-22T05:08:01.586666+0000","last_fullsized":"2024-01-22T05:08:01.586666+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.008705+0000","last_change":"2024-01-22T05:08:02.008705+0000","last_active":"2024-01-22T05:08:02.008705+0000","last_peered":"2024-01-22T05:08:02.008705+0000","last_clean":"2024-01-22T05:08:02.008705+0000","last_became_active":"2024-01-22T05:08:02.007039+0000","last_became_peered":"2024-01-22T05:08:02.007039+0000","last_unstale":"2024-01-22T05:08:02.008705+0000","last_undegraded":"2024-01-22T05:08:02.008705+0000","last_fullsized":"2024-01-22T05:08:02.008705+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.559217+0000","last_change":"2024-01-22T05:08:01.554362+0000","last_active":"2024-01-22T05:08:01.559217+0000","last_peered":"2024-01-22T05:08:01.559217+0000","last_clean":"2024-01-22T05:08:01.559217+0000","last_became_active":"2024-01-22T05:08:01.554104+0000","last_became_peered":"2024-01-22T05:08:01.554104+0000","last_unstale":"2024-01-22T05:08:01.559217+0000","last_undegraded":"2024-01-22T05:08:01.559217+0000","last_fullsized":"2024-01-22T05:08:01.559217+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.995300+0000","last_change":"2024-01-22T05:08:01.995300+0000","last_active":"2024-01-22T05:08:01.995300+0000","last_peered":"2024-01-22T05:08:01.995300+0000","last_clean":"2024-01-22T05:08:01.995300+0000","last_became_active":"2024-01-22T05:08:01.995020+0000","last_became_peered":"2024-01-22T05:08:01.995020+0000","last_unstale":"2024-01-22T05:08:01.995300+0000","last_undegraded":"2024-01-22T05:08:01.995300+0000","last_fullsized":"2024-01-22T05:08:01.995300+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.572829+0000","last_change":"2024-01-22T05:08:01.568300+0000","last_active":"2024-01-22T05:08:01.572829+0000","last_peered":"2024-01-22T05:08:01.572829+0000","last_clean":"2024-01-22T05:08:01.572829+0000","last_became_active":"2024-01-22T05:08:01.567984+0000","last_became_peered":"2024-01-22T05:08:01.567984+0000","last_unstale":"2024-01-22T05:08:01.572829+0000","last_undegraded":"2024-01-22T05:08:01.572829+0000","last_fullsized":"2024-01-22T05:08:01.572829+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.010302+0000","last_change":"2024-01-22T05:08:02.010302+0000","last_active":"2024-01-22T05:08:02.010302+0000","last_peered":"2024-01-22T05:08:02.010302+0000","last_clean":"2024-01-22T05:08:02.010302+0000","last_became_active":"2024-01-22T05:08:02.010048+0000","last_became_peered":"2024-01-22T05:08:02.010048+0000","last_unstale":"2024-01-22T05:08:02.010302+0000","last_undegraded":"2024-01-22T05:08:02.010302+0000","last_fullsized":"2024-01-22T05:08:02.010302+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.34","version":"55'4","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.019902+0000","last_change":"2024-01-22T05:08:01.561892+0000","last_active":"2024-01-22T05:08:02.019902+0000","last_peered":"2024-01-22T05:08:02.019902+0000","last_clean":"2024-01-22T05:08:02.019902+0000","last_became_active":"2024-01-22T05:08:01.561578+0000","last_became_peered":"2024-01-22T05:08:01.561578+0000","last_unstale":"2024-01-22T05:08:02.019902+0000","last_undegraded":"2024-01-22T05:08:02.019902+0000","last_fullsized":"2024-01-22T05:08:02.019902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.005871+0000","last_change":"2024-01-22T05:08:02.005871+0000","last_active":"2024-01-22T05:08:02.005871+0000","last_peered":"2024-01-22T05:08:02.005871+0000","last_clean":"2024-01-22T05:08:02.005871+0000","last_became_active":"2024-01-22T05:08:02.005534+0000","last_became_peered":"2024-01-22T05:08:02.005534+0000","last_unstale":"2024-01-22T05:08:02.005871+0000","last_undegraded":"2024-01-22T05:08:02.005871+0000","last_fullsized":"2024-01-22T05:08:02.005871+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.987144+0000","last_change":"2024-01-22T05:08:01.553847+0000","last_active":"2024-01-22T05:08:01.987144+0000","last_peered":"2024-01-22T05:08:01.987144+0000","last_clean":"2024-01-22T05:08:01.987144+0000","last_became_active":"2024-01-22T05:08:01.553502+0000","last_became_peered":"2024-01-22T05:08:01.553502+0000","last_unstale":"2024-01-22T05:08:01.987144+0000","last_undegraded":"2024-01-22T05:08:01.987144+0000","last_fullsized":"2024-01-22T05:08:01.987144+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.008496+0000","last_change":"2024-01-22T05:08:02.008496+0000","last_active":"2024-01-22T05:08:02.008496+0000","last_peered":"2024-01-22T05:08:02.008496+0000","last_clean":"2024-01-22T05:08:02.008496+0000","last_became_active":"2024-01-22T05:08:02.008186+0000","last_became_peered":"2024-01-22T05:08:02.008186+0000","last_unstale":"2024-01-22T05:08:02.008496+0000","last_undegraded":"2024-01-22T05:08:02.008496+0000","last_fullsized":"2024-01-22T05:08:02.008496+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.585809+0000","last_change":"2024-01-22T05:08:01.575074+0000","last_active":"2024-01-22T05:08:01.585809+0000","last_peered":"2024-01-22T05:08:01.585809+0000","last_clean":"2024-01-22T05:08:01.585809+0000","last_became_active":"2024-01-22T05:08:01.574796+0000","last_became_peered":"2024-01-22T05:08:01.574796+0000","last_unstale":"2024-01-22T05:08:01.585809+0000","last_undegraded":"2024-01-22T05:08:01.585809+0000","last_fullsized":"2024-01-22T05:08:01.585809+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.016497+0000","last_change":"2024-01-22T05:08:02.016497+0000","last_active":"2024-01-22T05:08:02.016497+0000","last_peered":"2024-01-22T05:08:02.016497+0000","last_clean":"2024-01-22T05:08:02.016497+0000","last_became_active":"2024-01-22T05:08:02.016201+0000","last_became_peered":"2024-01-22T05:08:02.016201+0000","last_unstale":"2024-01-22T05:08:02.016497+0000","last_undegraded":"2024-01-22T05:08:02.016497+0000","last_fullsized":"2024-01-22T05:08:02.016497+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.562356+0000","last_change":"2024-01-22T05:08:01.560328+0000","last_active":"2024-01-22T05:08:01.562356+0000","last_peered":"2024-01-22T05:08:01.562356+0000","last_clean":"2024-01-22T05:08:01.562356+0000","last_became_active":"2024-01-22T05:08:01.560104+0000","last_became_peered":"2024-01-22T05:08:01.560104+0000","last_unstale":"2024-01-22T05:08:01.562356+0000","last_undegraded":"2024-01-22T05:08:01.562356+0000","last_fullsized":"2024-01-22T05:08:01.562356+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.012274+0000","last_change":"2024-01-22T05:08:02.012274+0000","last_active":"2024-01-22T05:08:02.012274+0000","last_peered":"2024-01-22T05:08:02.012274+0000","last_clean":"2024-01-22T05:08:02.012274+0000","last_became_active":"2024-01-22T05:08:02.011983+0000","last_became_peered":"2024-01-22T05:08:02.011983+0000","last_unstale":"2024-01-22T05:08:02.012274+0000","last_undegraded":"2024-01-22T05:08:02.012274+0000","last_fullsized":"2024-01-22T05:08:02.012274+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.30","version":"55'4","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.010895+0000","last_change":"2024-01-22T05:08:01.553855+0000","last_active":"2024-01-22T05:08:02.010895+0000","last_peered":"2024-01-22T05:08:02.010895+0000","last_clean":"2024-01-22T05:08:02.010895+0000","last_became_active":"2024-01-22T05:08:01.553522+0000","last_became_peered":"2024-01-22T05:08:01.553522+0000","last_unstale":"2024-01-22T05:08:02.010895+0000","last_undegraded":"2024-01-22T05:08:02.010895+0000","last_fullsized":"2024-01-22T05:08:02.010895+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.988338+0000","last_change":"2024-01-22T05:08:01.988338+0000","last_active":"2024-01-22T05:08:01.988338+0000","last_peered":"2024-01-22T05:08:01.988338+0000","last_clean":"2024-01-22T05:08:01.988338+0000","last_became_active":"2024-01-22T05:08:01.988031+0000","last_became_peered":"2024-01-22T05:08:01.988031+0000","last_unstale":"2024-01-22T05:08:01.988338+0000","last_undegraded":"2024-01-22T05:08:01.988338+0000","last_fullsized":"2024-01-22T05:08:01.988338+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.588024+0000","last_change":"2024-01-22T05:08:01.583333+0000","last_active":"2024-01-22T05:08:01.588024+0000","last_peered":"2024-01-22T05:08:01.588024+0000","last_clean":"2024-01-22T05:08:01.588024+0000","last_became_active":"2024-01-22T05:08:01.582877+0000","last_became_peered":"2024-01-22T05:08:01.582877+0000","last_unstale":"2024-01-22T05:08:01.588024+0000","last_undegraded":"2024-01-22T05:08:01.588024+0000","last_fullsized":"2024-01-22T05:08:01.588024+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.015767+0000","last_change":"2024-01-22T05:08:02.015767+0000","last_active":"2024-01-22T05:08:02.015767+0000","last_peered":"2024-01-22T05:08:02.015767+0000","last_clean":"2024-01-22T05:08:02.015767+0000","last_became_active":"2024-01-22T05:08:02.015486+0000","last_became_peered":"2024-01-22T05:08:02.015486+0000","last_unstale":"2024-01-22T05:08:02.015767+0000","last_undegraded":"2024-01-22T05:08:02.015767+0000","last_fullsized":"2024-01-22T05:08:02.015767+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.568240+0000","last_change":"2024-01-22T05:08:01.564784+0000","last_active":"2024-01-22T05:08:01.568240+0000","last_peered":"2024-01-22T05:08:01.568240+0000","last_clean":"2024-01-22T05:08:01.568240+0000","last_became_active":"2024-01-22T05:08:01.564488+0000","last_became_peered":"2024-01-22T05:08:01.564488+0000","last_unstale":"2024-01-22T05:08:01.568240+0000","last_undegraded":"2024-01-22T05:08:01.568240+0000","last_fullsized":"2024-01-22T05:08:01.568240+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.997278+0000","last_change":"2024-01-22T05:08:01.997278+0000","last_active":"2024-01-22T05:08:01.997278+0000","last_peered":"2024-01-22T05:08:01.997278+0000","last_clean":"2024-01-22T05:08:01.997278+0000","last_became_active":"2024-01-22T05:08:01.997002+0000","last_became_peered":"2024-01-22T05:08:01.997002+0000","last_unstale":"2024-01-22T05:08:01.997278+0000","last_undegraded":"2024-01-22T05:08:01.997278+0000","last_fullsized":"2024-01-22T05:08:01.997278+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2d","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.985085+0000","last_change":"2024-01-22T05:08:01.574561+0000","last_active":"2024-01-22T05:08:01.985085+0000","last_peered":"2024-01-22T05:08:01.985085+0000","last_clean":"2024-01-22T05:08:01.985085+0000","last_became_active":"2024-01-22T05:08:01.574279+0000","last_became_peered":"2024-01-22T05:08:01.574279+0000","last_unstale":"2024-01-22T05:08:01.985085+0000","last_undegraded":"2024-01-22T05:08:01.985085+0000","last_fullsized":"2024-01-22T05:08:01.985085+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.009310+0000","last_change":"2024-01-22T05:08:02.009310+0000","last_active":"2024-01-22T05:08:02.009310+0000","last_peered":"2024-01-22T05:08:02.009310+0000","last_clean":"2024-01-22T05:08:02.009310+0000","last_became_active":"2024-01-22T05:08:02.009050+0000","last_became_peered":"2024-01-22T05:08:02.009050+0000","last_unstale":"2024-01-22T05:08:02.009310+0000","last_undegraded":"2024-01-22T05:08:02.009310+0000","last_fullsized":"2024-01-22T05:08:02.009310+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.557885+0000","last_change":"2024-01-22T05:08:01.554421+0000","last_active":"2024-01-22T05:08:01.557885+0000","last_peered":"2024-01-22T05:08:01.557885+0000","last_clean":"2024-01-22T05:08:01.557885+0000","last_became_active":"2024-01-22T05:08:01.554133+0000","last_became_peered":"2024-01-22T05:08:01.554133+0000","last_unstale":"2024-01-22T05:08:01.557885+0000","last_undegraded":"2024-01-22T05:08:01.557885+0000","last_fullsized":"2024-01-22T05:08:01.557885+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.010162+0000","last_change":"2024-01-22T05:08:02.010162+0000","last_active":"2024-01-22T05:08:02.010162+0000","last_peered":"2024-01-22T05:08:02.010162+0000","last_clean":"2024-01-22T05:08:02.010162+0000","last_became_active":"2024-01-22T05:08:02.009495+0000","last_became_peered":"2024-01-22T05:08:02.009495+0000","last_unstale":"2024-01-22T05:08:02.010162+0000","last_undegraded":"2024-01-22T05:08:02.010162+0000","last_fullsized":"2024-01-22T05:08:02.010162+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2b","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.999826+0000","last_change":"2024-01-22T05:08:01.559940+0000","last_active":"2024-01-22T05:08:01.999826+0000","last_peered":"2024-01-22T05:08:01.999826+0000","last_clean":"2024-01-22T05:08:01.999826+0000","last_became_active":"2024-01-22T05:08:01.559271+0000","last_became_peered":"2024-01-22T05:08:01.559271+0000","last_unstale":"2024-01-22T05:08:01.999826+0000","last_undegraded":"2024-01-22T05:08:01.999826+0000","last_fullsized":"2024-01-22T05:08:01.999826+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.991247+0000","last_change":"2024-01-22T05:08:01.991247+0000","last_active":"2024-01-22T05:08:01.991247+0000","last_peered":"2024-01-22T05:08:01.991247+0000","last_clean":"2024-01-22T05:08:01.991247+0000","last_became_active":"2024-01-22T05:08:01.990879+0000","last_became_peered":"2024-01-22T05:08:01.990879+0000","last_unstale":"2024-01-22T05:08:01.991247+0000","last_undegraded":"2024-01-22T05:08:01.991247+0000","last_fullsized":"2024-01-22T05:08:01.991247+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.578339+0000","last_change":"2024-01-22T05:08:01.572277+0000","last_active":"2024-01-22T05:08:01.578339+0000","last_peered":"2024-01-22T05:08:01.578339+0000","last_clean":"2024-01-22T05:08:01.578339+0000","last_became_active":"2024-01-22T05:08:01.571997+0000","last_became_peered":"2024-01-22T05:08:01.571997+0000","last_unstale":"2024-01-22T05:08:01.578339+0000","last_undegraded":"2024-01-22T05:08:01.578339+0000","last_fullsized":"2024-01-22T05:08:01.578339+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.011365+0000","last_change":"2024-01-22T05:08:02.011365+0000","last_active":"2024-01-22T05:08:02.011365+0000","last_peered":"2024-01-22T05:08:02.011365+0000","last_clean":"2024-01-22T05:08:02.011365+0000","last_became_active":"2024-01-22T05:08:02.010700+0000","last_became_peered":"2024-01-22T05:08:02.010700+0000","last_unstale":"2024-01-22T05:08:02.011365+0000","last_undegraded":"2024-01-22T05:08:02.011365+0000","last_fullsized":"2024-01-22T05:08:02.011365+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.573234+0000","last_change":"2024-01-22T05:08:01.564311+0000","last_active":"2024-01-22T05:08:01.573234+0000","last_peered":"2024-01-22T05:08:01.573234+0000","last_clean":"2024-01-22T05:08:01.573234+0000","last_became_active":"2024-01-22T05:08:01.564015+0000","last_became_peered":"2024-01-22T05:08:01.564015+0000","last_unstale":"2024-01-22T05:08:01.573234+0000","last_undegraded":"2024-01-22T05:08:01.573234+0000","last_fullsized":"2024-01-22T05:08:01.573234+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.012775+0000","last_change":"2024-01-22T05:08:02.012775+0000","last_active":"2024-01-22T05:08:02.012775+0000","last_peered":"2024-01-22T05:08:02.012775+0000","last_clean":"2024-01-22T05:08:02.012775+0000","last_became_active":"2024-01-22T05:08:02.012492+0000","last_became_peered":"2024-01-22T05:08:02.012492+0000","last_unstale":"2024-01-22T05:08:02.012775+0000","last_undegraded":"2024-01-22T05:08:02.012775+0000","last_fullsized":"2024-01-22T05:08:02.012775+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.586236+0000","last_change":"2024-01-22T05:08:01.573358+0000","last_active":"2024-01-22T05:08:01.586236+0000","last_peered":"2024-01-22T05:08:01.586236+0000","last_clean":"2024-01-22T05:08:01.586236+0000","last_became_active":"2024-01-22T05:08:01.573075+0000","last_became_peered":"2024-01-22T05:08:01.573075+0000","last_unstale":"2024-01-22T05:08:01.586236+0000","last_undegraded":"2024-01-22T05:08:01.586236+0000","last_fullsized":"2024-01-22T05:08:01.586236+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.001699+0000","last_change":"2024-01-22T05:08:02.001699+0000","last_active":"2024-01-22T05:08:02.001699+0000","last_peered":"2024-01-22T05:08:02.001699+0000","last_clean":"2024-01-22T05:08:02.001699+0000","last_became_active":"2024-01-22T05:08:02.001295+0000","last_became_peered":"2024-01-22T05:08:02.001295+0000","last_unstale":"2024-01-22T05:08:02.001699+0000","last_undegraded":"2024-01-22T05:08:02.001699+0000","last_fullsized":"2024-01-22T05:08:02.001699+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.588035+0000","last_change":"2024-01-22T05:08:01.583829+0000","last_active":"2024-01-22T05:08:01.588035+0000","last_peered":"2024-01-22T05:08:01.588035+0000","last_clean":"2024-01-22T05:08:01.588035+0000","last_became_active":"2024-01-22T05:08:01.583544+0000","last_became_peered":"2024-01-22T05:08:01.583544+0000","last_unstale":"2024-01-22T05:08:01.588035+0000","last_undegraded":"2024-01-22T05:08:01.588035+0000","last_fullsized":"2024-01-22T05:08:01.588035+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.010355+0000","last_change":"2024-01-22T05:08:02.010355+0000","last_active":"2024-01-22T05:08:02.010355+0000","last_peered":"2024-01-22T05:08:02.010355+0000","last_clean":"2024-01-22T05:08:02.010355+0000","last_became_active":"2024-01-22T05:08:02.010083+0000","last_became_peered":"2024-01-22T05:08:02.010083+0000","last_unstale":"2024-01-22T05:08:02.010355+0000","last_undegraded":"2024-01-22T05:08:02.010355+0000","last_fullsized":"2024-01-22T05:08:02.010355+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.581874+0000","last_change":"2024-01-22T05:08:01.579230+0000","last_active":"2024-01-22T05:08:01.581874+0000","last_peered":"2024-01-22T05:08:01.581874+0000","last_clean":"2024-01-22T05:08:01.581874+0000","last_became_active":"2024-01-22T05:08:01.577691+0000","last_became_peered":"2024-01-22T05:08:01.577691+0000","last_unstale":"2024-01-22T05:08:01.581874+0000","last_undegraded":"2024-01-22T05:08:01.581874+0000","last_fullsized":"2024-01-22T05:08:01.581874+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.006569+0000","last_change":"2024-01-22T05:08:02.006569+0000","last_active":"2024-01-22T05:08:02.006569+0000","last_peered":"2024-01-22T05:08:02.006569+0000","last_clean":"2024-01-22T05:08:02.006569+0000","last_became_active":"2024-01-22T05:08:02.006231+0000","last_became_peered":"2024-01-22T05:08:02.006231+0000","last_unstale":"2024-01-22T05:08:02.006569+0000","last_undegraded":"2024-01-22T05:08:02.006569+0000","last_fullsized":"2024-01-22T05:08:02.006569+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.582390+0000","last_change":"2024-01-22T05:08:01.581865+0000","last_active":"2024-01-22T05:08:01.582390+0000","last_peered":"2024-01-22T05:08:01.582390+0000","last_clean":"2024-01-22T05:08:01.582390+0000","last_became_active":"2024-01-22T05:08:01.577764+0000","last_became_peered":"2024-01-22T05:08:01.577764+0000","last_unstale":"2024-01-22T05:08:01.582390+0000","last_undegraded":"2024-01-22T05:08:01.582390+0000","last_fullsized":"2024-01-22T05:08:01.582390+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.012327+0000","last_change":"2024-01-22T05:08:02.012327+0000","last_active":"2024-01-22T05:08:02.012327+0000","last_peered":"2024-01-22T05:08:02.012327+0000","last_clean":"2024-01-22T05:08:02.012327+0000","last_became_active":"2024-01-22T05:08:02.012035+0000","last_became_peered":"2024-01-22T05:08:02.012035+0000","last_unstale":"2024-01-22T05:08:02.012327+0000","last_undegraded":"2024-01-22T05:08:02.012327+0000","last_fullsized":"2024-01-22T05:08:02.012327+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.567448+0000","last_change":"2024-01-22T05:08:01.565824+0000","last_active":"2024-01-22T05:08:01.567448+0000","last_peered":"2024-01-22T05:08:01.567448+0000","last_clean":"2024-01-22T05:08:01.567448+0000","last_became_active":"2024-01-22T05:08:01.565059+0000","last_became_peered":"2024-01-22T05:08:01.565059+0000","last_unstale":"2024-01-22T05:08:01.567448+0000","last_undegraded":"2024-01-22T05:08:01.567448+0000","last_fullsized":"2024-01-22T05:08:01.567448+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.004153+0000","last_change":"2024-01-22T05:08:02.004153+0000","last_active":"2024-01-22T05:08:02.004153+0000","last_peered":"2024-01-22T05:08:02.004153+0000","last_clean":"2024-01-22T05:08:02.004153+0000","last_became_active":"2024-01-22T05:08:02.003866+0000","last_became_peered":"2024-01-22T05:08:02.003866+0000","last_unstale":"2024-01-22T05:08:02.004153+0000","last_undegraded":"2024-01-22T05:08:02.004153+0000","last_fullsized":"2024-01-22T05:08:02.004153+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.585240+0000","last_change":"2024-01-22T05:08:01.572006+0000","last_active":"2024-01-22T05:08:01.585240+0000","last_peered":"2024-01-22T05:08:01.585240+0000","last_clean":"2024-01-22T05:08:01.585240+0000","last_became_active":"2024-01-22T05:08:01.570171+0000","last_became_peered":"2024-01-22T05:08:01.570171+0000","last_unstale":"2024-01-22T05:08:01.585240+0000","last_undegraded":"2024-01-22T05:08:01.585240+0000","last_fullsized":"2024-01-22T05:08:01.585240+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.997223+0000","last_change":"2024-01-22T05:08:01.997223+0000","last_active":"2024-01-22T05:08:01.997223+0000","last_peered":"2024-01-22T05:08:01.997223+0000","last_clean":"2024-01-22T05:08:01.997223+0000","last_became_active":"2024-01-22T05:08:01.996952+0000","last_became_peered":"2024-01-22T05:08:01.996952+0000","last_unstale":"2024-01-22T05:08:01.997223+0000","last_undegraded":"2024-01-22T05:08:01.997223+0000","last_fullsized":"2024-01-22T05:08:01.997223+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.569013+0000","last_change":"2024-01-22T05:08:01.566331+0000","last_active":"2024-01-22T05:08:01.569013+0000","last_peered":"2024-01-22T05:08:01.569013+0000","last_clean":"2024-01-22T05:08:01.569013+0000","last_became_active":"2024-01-22T05:08:01.566063+0000","last_became_peered":"2024-01-22T05:08:01.566063+0000","last_unstale":"2024-01-22T05:08:01.569013+0000","last_undegraded":"2024-01-22T05:08:01.569013+0000","last_fullsized":"2024-01-22T05:08:01.569013+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.010032+0000","last_change":"2024-01-22T05:08:02.010032+0000","last_active":"2024-01-22T05:08:02.010032+0000","last_peered":"2024-01-22T05:08:02.010032+0000","last_clean":"2024-01-22T05:08:02.010032+0000","last_became_active":"2024-01-22T05:08:02.009715+0000","last_became_peered":"2024-01-22T05:08:02.009715+0000","last_unstale":"2024-01-22T05:08:02.010032+0000","last_undegraded":"2024-01-22T05:08:02.010032+0000","last_fullsized":"2024-01-22T05:08:02.010032+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.586297+0000","last_change":"2024-01-22T05:08:01.578798+0000","last_active":"2024-01-22T05:08:01.586297+0000","last_peered":"2024-01-22T05:08:01.586297+0000","last_clean":"2024-01-22T05:08:01.586297+0000","last_became_active":"2024-01-22T05:08:01.578175+0000","last_became_peered":"2024-01-22T05:08:01.578175+0000","last_unstale":"2024-01-22T05:08:01.586297+0000","last_undegraded":"2024-01-22T05:08:01.586297+0000","last_fullsized":"2024-01-22T05:08:01.586297+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.014727+0000","last_change":"2024-01-22T05:08:02.014727+0000","last_active":"2024-01-22T05:08:02.014727+0000","last_peered":"2024-01-22T05:08:02.014727+0000","last_clean":"2024-01-22T05:08:02.014727+0000","last_became_active":"2024-01-22T05:08:02.014436+0000","last_became_peered":"2024-01-22T05:08:02.014436+0000","last_unstale":"2024-01-22T05:08:02.014727+0000","last_undegraded":"2024-01-22T05:08:02.014727+0000","last_fullsized":"2024-01-22T05:08:02.014727+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.571019+0000","last_change":"2024-01-22T05:08:01.569649+0000","last_active":"2024-01-22T05:08:01.571019+0000","last_peered":"2024-01-22T05:08:01.571019+0000","last_clean":"2024-01-22T05:08:01.571019+0000","last_became_active":"2024-01-22T05:08:01.569363+0000","last_became_peered":"2024-01-22T05:08:01.569363+0000","last_unstale":"2024-01-22T05:08:01.571019+0000","last_undegraded":"2024-01-22T05:08:01.571019+0000","last_fullsized":"2024-01-22T05:08:01.571019+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.993643+0000","last_change":"2024-01-22T05:08:01.993643+0000","last_active":"2024-01-22T05:08:01.993643+0000","last_peered":"2024-01-22T05:08:01.993643+0000","last_clean":"2024-01-22T05:08:01.993643+0000","last_became_active":"2024-01-22T05:08:01.993364+0000","last_became_peered":"2024-01-22T05:08:01.993364+0000","last_unstale":"2024-01-22T05:08:01.993643+0000","last_undegraded":"2024-01-22T05:08:01.993643+0000","last_fullsized":"2024-01-22T05:08:01.993643+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.983173+0000","last_change":"2024-01-22T05:08:01.583213+0000","last_active":"2024-01-22T05:08:01.983173+0000","last_peered":"2024-01-22T05:08:01.983173+0000","last_clean":"2024-01-22T05:08:01.983173+0000","last_became_active":"2024-01-22T05:08:01.582545+0000","last_became_peered":"2024-01-22T05:08:01.582545+0000","last_unstale":"2024-01-22T05:08:01.983173+0000","last_undegraded":"2024-01-22T05:08:01.983173+0000","last_fullsized":"2024-01-22T05:08:01.983173+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.004236+0000","last_change":"2024-01-22T05:08:02.004236+0000","last_active":"2024-01-22T05:08:02.004236+0000","last_peered":"2024-01-22T05:08:02.004236+0000","last_clean":"2024-01-22T05:08:02.004236+0000","last_became_active":"2024-01-22T05:08:02.003983+0000","last_became_peered":"2024-01-22T05:08:02.003983+0000","last_unstale":"2024-01-22T05:08:02.004236+0000","last_undegraded":"2024-01-22T05:08:02.004236+0000","last_fullsized":"2024-01-22T05:08:02.004236+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.997357+0000","last_change":"2024-01-22T05:08:01.565799+0000","last_active":"2024-01-22T05:08:01.997357+0000","last_peered":"2024-01-22T05:08:01.997357+0000","last_clean":"2024-01-22T05:08:01.997357+0000","last_became_active":"2024-01-22T05:08:01.565436+0000","last_became_peered":"2024-01-22T05:08:01.565436+0000","last_unstale":"2024-01-22T05:08:01.997357+0000","last_undegraded":"2024-01-22T05:08:01.997357+0000","last_fullsized":"2024-01-22T05:08:01.997357+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.015486+0000","last_change":"2024-01-22T05:08:02.015486+0000","last_active":"2024-01-22T05:08:02.015486+0000","last_peered":"2024-01-22T05:08:02.015486+0000","last_clean":"2024-01-22T05:08:02.015486+0000","last_became_active":"2024-01-22T05:08:02.015230+0000","last_became_peered":"2024-01-22T05:08:02.015230+0000","last_unstale":"2024-01-22T05:08:02.015486+0000","last_undegraded":"2024-01-22T05:08:02.015486+0000","last_fullsized":"2024-01-22T05:08:02.015486+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"55'2","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.013306+0000","last_change":"2024-01-22T05:08:01.576018+0000","last_active":"2024-01-22T05:08:02.013306+0000","last_peered":"2024-01-22T05:08:02.013306+0000","last_clean":"2024-01-22T05:08:02.013306+0000","last_became_active":"2024-01-22T05:08:01.574716+0000","last_became_peered":"2024-01-22T05:08:01.574716+0000","last_unstale":"2024-01-22T05:08:02.013306+0000","last_undegraded":"2024-01-22T05:08:02.013306+0000","last_fullsized":"2024-01-22T05:08:02.013306+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.996434+0000","last_change":"2024-01-22T05:08:01.996434+0000","last_active":"2024-01-22T05:08:01.996434+0000","last_peered":"2024-01-22T05:08:01.996434+0000","last_clean":"2024-01-22T05:08:01.996434+0000","last_became_active":"2024-01-22T05:08:01.996092+0000","last_became_peered":"2024-01-22T05:08:01.996092+0000","last_unstale":"2024-01-22T05:08:01.996434+0000","last_undegraded":"2024-01-22T05:08:01.996434+0000","last_fullsized":"2024-01-22T05:08:01.996434+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.563045+0000","last_change":"2024-01-22T05:08:01.561290+0000","last_active":"2024-01-22T05:08:01.563045+0000","last_peered":"2024-01-22T05:08:01.563045+0000","last_clean":"2024-01-22T05:08:01.563045+0000","last_became_active":"2024-01-22T05:08:01.559607+0000","last_became_peered":"2024-01-22T05:08:01.559607+0000","last_unstale":"2024-01-22T05:08:01.563045+0000","last_undegraded":"2024-01-22T05:08:01.563045+0000","last_fullsized":"2024-01-22T05:08:01.563045+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.009773+0000","last_change":"2024-01-22T05:08:02.009773+0000","last_active":"2024-01-22T05:08:02.009773+0000","last_peered":"2024-01-22T05:08:02.009773+0000","last_clean":"2024-01-22T05:08:02.009773+0000","last_became_active":"2024-01-22T05:08:02.009190+0000","last_became_peered":"2024-01-22T05:08:02.009190+0000","last_unstale":"2024-01-22T05:08:02.009773+0000","last_undegraded":"2024-01-22T05:08:02.009773+0000","last_fullsized":"2024-01-22T05:08:02.009773+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.573161+0000","last_change":"2024-01-22T05:08:01.572280+0000","last_active":"2024-01-22T05:08:01.573161+0000","last_peered":"2024-01-22T05:08:01.573161+0000","last_clean":"2024-01-22T05:08:01.573161+0000","last_became_active":"2024-01-22T05:08:01.572033+0000","last_became_peered":"2024-01-22T05:08:01.572033+0000","last_unstale":"2024-01-22T05:08:01.573161+0000","last_undegraded":"2024-01-22T05:08:01.573161+0000","last_fullsized":"2024-01-22T05:08:01.573161+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.003275+0000","last_change":"2024-01-22T05:08:02.003275+0000","last_active":"2024-01-22T05:08:02.003275+0000","last_peered":"2024-01-22T05:08:02.003275+0000","last_clean":"2024-01-22T05:08:02.003275+0000","last_became_active":"2024-01-22T05:08:02.002969+0000","last_became_peered":"2024-01-22T05:08:02.002969+0000","last_unstale":"2024-01-22T05:08:02.003275+0000","last_undegraded":"2024-01-22T05:08:02.003275+0000","last_fullsized":"2024-01-22T05:08:02.003275+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.583837+0000","last_change":"2024-01-22T05:08:01.568411+0000","last_active":"2024-01-22T05:08:01.583837+0000","last_peered":"2024-01-22T05:08:01.583837+0000","last_clean":"2024-01-22T05:08:01.583837+0000","last_became_active":"2024-01-22T05:08:01.568123+0000","last_became_peered":"2024-01-22T05:08:01.568123+0000","last_unstale":"2024-01-22T05:08:01.583837+0000","last_undegraded":"2024-01-22T05:08:01.583837+0000","last_fullsized":"2024-01-22T05:08:01.583837+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.000933+0000","last_change":"2024-01-22T05:08:02.000933+0000","last_active":"2024-01-22T05:08:02.000933+0000","last_peered":"2024-01-22T05:08:02.000933+0000","last_clean":"2024-01-22T05:08:02.000933+0000","last_became_active":"2024-01-22T05:08:02.000622+0000","last_became_peered":"2024-01-22T05:08:02.000622+0000","last_unstale":"2024-01-22T05:08:02.000933+0000","last_undegraded":"2024-01-22T05:08:02.000933+0000","last_fullsized":"2024-01-22T05:08:02.000933+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.556276+0000","last_change":"2024-01-22T05:08:01.552549+0000","last_active":"2024-01-22T05:08:01.556276+0000","last_peered":"2024-01-22T05:08:01.556276+0000","last_clean":"2024-01-22T05:08:01.556276+0000","last_became_active":"2024-01-22T05:08:01.552204+0000","last_became_peered":"2024-01-22T05:08:01.552204+0000","last_unstale":"2024-01-22T05:08:01.556276+0000","last_undegraded":"2024-01-22T05:08:01.556276+0000","last_fullsized":"2024-01-22T05:08:01.556276+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.015982+0000","last_change":"2024-01-22T05:08:02.015982+0000","last_active":"2024-01-22T05:08:02.015982+0000","last_peered":"2024-01-22T05:08:02.015982+0000","last_clean":"2024-01-22T05:08:02.015982+0000","last_became_active":"2024-01-22T05:08:02.015688+0000","last_became_peered":"2024-01-22T05:08:02.015688+0000","last_unstale":"2024-01-22T05:08:02.015982+0000","last_undegraded":"2024-01-22T05:08:02.015982+0000","last_fullsized":"2024-01-22T05:08:02.015982+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.571033+0000","last_change":"2024-01-22T05:08:01.569840+0000","last_active":"2024-01-22T05:08:01.571033+0000","last_peered":"2024-01-22T05:08:01.571033+0000","last_clean":"2024-01-22T05:08:01.571033+0000","last_became_active":"2024-01-22T05:08:01.569516+0000","last_became_peered":"2024-01-22T05:08:01.569516+0000","last_unstale":"2024-01-22T05:08:01.571033+0000","last_undegraded":"2024-01-22T05:08:01.571033+0000","last_fullsized":"2024-01-22T05:08:01.571033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.019854+0000","last_change":"2024-01-22T05:08:02.019854+0000","last_active":"2024-01-22T05:08:02.019854+0000","last_peered":"2024-01-22T05:08:02.019854+0000","last_clean":"2024-01-22T05:08:02.019854+0000","last_became_active":"2024-01-22T05:08:02.019599+0000","last_became_peered":"2024-01-22T05:08:02.019599+0000","last_unstale":"2024-01-22T05:08:02.019854+0000","last_undegraded":"2024-01-22T05:08:02.019854+0000","last_fullsized":"2024-01-22T05:08:02.019854+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.587828+0000","last_change":"2024-01-22T05:08:01.586606+0000","last_active":"2024-01-22T05:08:01.587828+0000","last_peered":"2024-01-22T05:08:01.587828+0000","last_clean":"2024-01-22T05:08:01.587828+0000","last_became_active":"2024-01-22T05:08:01.586039+0000","last_became_peered":"2024-01-22T05:08:01.586039+0000","last_unstale":"2024-01-22T05:08:01.587828+0000","last_undegraded":"2024-01-22T05:08:01.587828+0000","last_fullsized":"2024-01-22T05:08:01.587828+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.014561+0000","last_change":"2024-01-22T05:08:02.014561+0000","last_active":"2024-01-22T05:08:02.014561+0000","last_peered":"2024-01-22T05:08:02.014561+0000","last_clean":"2024-01-22T05:08:02.014561+0000","last_became_active":"2024-01-22T05:08:02.014249+0000","last_became_peered":"2024-01-22T05:08:02.014249+0000","last_unstale":"2024-01-22T05:08:02.014561+0000","last_undegraded":"2024-01-22T05:08:02.014561+0000","last_fullsized":"2024-01-22T05:08:02.014561+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.583867+0000","last_change":"2024-01-22T05:08:01.577957+0000","last_active":"2024-01-22T05:08:01.583867+0000","last_peered":"2024-01-22T05:08:01.583867+0000","last_clean":"2024-01-22T05:08:01.583867+0000","last_became_active":"2024-01-22T05:08:01.577303+0000","last_became_peered":"2024-01-22T05:08:01.577303+0000","last_unstale":"2024-01-22T05:08:01.583867+0000","last_undegraded":"2024-01-22T05:08:01.583867+0000","last_fullsized":"2024-01-22T05:08:01.583867+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.012876+0000","last_change":"2024-01-22T05:08:02.012876+0000","last_active":"2024-01-22T05:08:02.012876+0000","last_peered":"2024-01-22T05:08:02.012876+0000","last_clean":"2024-01-22T05:08:02.012876+0000","last_became_active":"2024-01-22T05:08:02.012591+0000","last_became_peered":"2024-01-22T05:08:02.012591+0000","last_unstale":"2024-01-22T05:08:02.012876+0000","last_undegraded":"2024-01-22T05:08:02.012876+0000","last_fullsized":"2024-01-22T05:08:02.012876+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"55'3","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.019095+0000","last_change":"2024-01-22T05:08:01.575090+0000","last_active":"2024-01-22T05:08:02.019095+0000","last_peered":"2024-01-22T05:08:02.019095+0000","last_clean":"2024-01-22T05:08:02.019095+0000","last_became_active":"2024-01-22T05:08:01.574730+0000","last_became_peered":"2024-01-22T05:08:01.574730+0000","last_unstale":"2024-01-22T05:08:02.019095+0000","last_undegraded":"2024-01-22T05:08:02.019095+0000","last_fullsized":"2024-01-22T05:08:02.019095+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.009580+0000","last_change":"2024-01-22T05:08:02.009580+0000","last_active":"2024-01-22T05:08:02.009580+0000","last_peered":"2024-01-22T05:08:02.009580+0000","last_clean":"2024-01-22T05:08:02.009580+0000","last_became_active":"2024-01-22T05:08:02.009265+0000","last_became_peered":"2024-01-22T05:08:02.009265+0000","last_unstale":"2024-01-22T05:08:02.009580+0000","last_undegraded":"2024-01-22T05:08:02.009580+0000","last_fullsized":"2024-01-22T05:08:02.009580+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"55'2","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.008555+0000","last_change":"2024-01-22T05:08:01.583831+0000","last_active":"2024-01-22T05:08:02.008555+0000","last_peered":"2024-01-22T05:08:02.008555+0000","last_clean":"2024-01-22T05:08:02.008555+0000","last_became_active":"2024-01-22T05:08:01.583311+0000","last_became_peered":"2024-01-22T05:08:01.583311+0000","last_unstale":"2024-01-22T05:08:02.008555+0000","last_undegraded":"2024-01-22T05:08:02.008555+0000","last_fullsized":"2024-01-22T05:08:02.008555+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.014891+0000","last_change":"2024-01-22T05:08:02.014891+0000","last_active":"2024-01-22T05:08:02.014891+0000","last_peered":"2024-01-22T05:08:02.014891+0000","last_clean":"2024-01-22T05:08:02.014891+0000","last_became_active":"2024-01-22T05:08:02.013918+0000","last_became_peered":"2024-01-22T05:08:02.013918+0000","last_unstale":"2024-01-22T05:08:02.014891+0000","last_undegraded":"2024-01-22T05:08:02.014891+0000","last_fullsized":"2024-01-22T05:08:02.014891+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.995526+0000","last_change":"2024-01-22T05:08:01.577507+0000","last_active":"2024-01-22T05:08:01.995526+0000","last_peered":"2024-01-22T05:08:01.995526+0000","last_clean":"2024-01-22T05:08:01.995526+0000","last_became_active":"2024-01-22T05:08:01.577188+0000","last_became_peered":"2024-01-22T05:08:01.577188+0000","last_unstale":"2024-01-22T05:08:01.995526+0000","last_undegraded":"2024-01-22T05:08:01.995526+0000","last_fullsized":"2024-01-22T05:08:01.995526+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.013868+0000","last_change":"2024-01-22T05:08:02.013868+0000","last_active":"2024-01-22T05:08:02.013868+0000","last_peered":"2024-01-22T05:08:02.013868+0000","last_clean":"2024-01-22T05:08:02.013868+0000","last_became_active":"2024-01-22T05:08:02.011915+0000","last_became_peered":"2024-01-22T05:08:02.011915+0000","last_unstale":"2024-01-22T05:08:02.013868+0000","last_undegraded":"2024-01-22T05:08:02.013868+0000","last_fullsized":"2024-01-22T05:08:02.013868+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.563035+0000","last_change":"2024-01-22T05:08:01.561683+0000","last_active":"2024-01-22T05:08:01.563035+0000","last_peered":"2024-01-22T05:08:01.563035+0000","last_clean":"2024-01-22T05:08:01.563035+0000","last_became_active":"2024-01-22T05:08:01.561433+0000","last_became_peered":"2024-01-22T05:08:01.561433+0000","last_unstale":"2024-01-22T05:08:01.563035+0000","last_undegraded":"2024-01-22T05:08:01.563035+0000","last_fullsized":"2024-01-22T05:08:01.563035+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.000626+0000","last_change":"2024-01-22T05:08:02.000626+0000","last_active":"2024-01-22T05:08:02.000626+0000","last_peered":"2024-01-22T05:08:02.000626+0000","last_clean":"2024-01-22T05:08:02.000626+0000","last_became_active":"2024-01-22T05:08:01.999227+0000","last_became_peered":"2024-01-22T05:08:01.999227+0000","last_unstale":"2024-01-22T05:08:02.000626+0000","last_undegraded":"2024-01-22T05:08:02.000626+0000","last_fullsized":"2024-01-22T05:08:02.000626+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.560602+0000","last_change":"2024-01-22T05:08:01.557605+0000","last_active":"2024-01-22T05:08:01.560602+0000","last_peered":"2024-01-22T05:08:01.560602+0000","last_clean":"2024-01-22T05:08:01.560602+0000","last_became_active":"2024-01-22T05:08:01.557357+0000","last_became_peered":"2024-01-22T05:08:01.557357+0000","last_unstale":"2024-01-22T05:08:01.560602+0000","last_undegraded":"2024-01-22T05:08:01.560602+0000","last_fullsized":"2024-01-22T05:08:01.560602+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.010873+0000","last_change":"2024-01-22T05:08:02.010873+0000","last_active":"2024-01-22T05:08:02.010873+0000","last_peered":"2024-01-22T05:08:02.010873+0000","last_clean":"2024-01-22T05:08:02.010873+0000","last_became_active":"2024-01-22T05:08:02.010607+0000","last_became_peered":"2024-01-22T05:08:02.010607+0000","last_unstale":"2024-01-22T05:08:02.010873+0000","last_undegraded":"2024-01-22T05:08:02.010873+0000","last_fullsized":"2024-01-22T05:08:02.010873+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"55'4","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.019060+0000","last_change":"2024-01-22T05:08:01.564758+0000","last_active":"2024-01-22T05:08:02.019060+0000","last_peered":"2024-01-22T05:08:02.019060+0000","last_clean":"2024-01-22T05:08:02.019060+0000","last_became_active":"2024-01-22T05:08:01.563305+0000","last_became_peered":"2024-01-22T05:08:01.563305+0000","last_unstale":"2024-01-22T05:08:02.019060+0000","last_undegraded":"2024-01-22T05:08:02.019060+0000","last_fullsized":"2024-01-22T05:08:02.019060+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.994329+0000","last_change":"2024-01-22T05:08:01.994329+0000","last_active":"2024-01-22T05:08:01.994329+0000","last_peered":"2024-01-22T05:08:01.994329+0000","last_clean":"2024-01-22T05:08:01.994329+0000","last_became_active":"2024-01-22T05:08:01.994043+0000","last_became_peered":"2024-01-22T05:08:01.994043+0000","last_unstale":"2024-01-22T05:08:01.994329+0000","last_undegraded":"2024-01-22T05:08:01.994329+0000","last_fullsized":"2024-01-22T05:08:01.994329+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"55'2","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.024622+0000","last_change":"2024-01-22T05:08:01.571650+0000","last_active":"2024-01-22T05:08:02.024622+0000","last_peered":"2024-01-22T05:08:02.024622+0000","last_clean":"2024-01-22T05:08:02.024622+0000","last_became_active":"2024-01-22T05:08:01.570426+0000","last_became_peered":"2024-01-22T05:08:01.570426+0000","last_unstale":"2024-01-22T05:08:02.024622+0000","last_undegraded":"2024-01-22T05:08:02.024622+0000","last_fullsized":"2024-01-22T05:08:02.024622+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.995570+0000","last_change":"2024-01-22T05:08:01.995570+0000","last_active":"2024-01-22T05:08:01.995570+0000","last_peered":"2024-01-22T05:08:01.995570+0000","last_clean":"2024-01-22T05:08:01.995570+0000","last_became_active":"2024-01-22T05:08:01.995286+0000","last_became_peered":"2024-01-22T05:08:01.995286+0000","last_unstale":"2024-01-22T05:08:01.995570+0000","last_undegraded":"2024-01-22T05:08:01.995570+0000","last_fullsized":"2024-01-22T05:08:01.995570+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.587335+0000","last_change":"2024-01-22T05:08:01.580898+0000","last_active":"2024-01-22T05:08:01.587335+0000","last_peered":"2024-01-22T05:08:01.587335+0000","last_clean":"2024-01-22T05:08:01.587335+0000","last_became_active":"2024-01-22T05:08:01.580588+0000","last_became_peered":"2024-01-22T05:08:01.580588+0000","last_unstale":"2024-01-22T05:08:01.587335+0000","last_undegraded":"2024-01-22T05:08:01.587335+0000","last_fullsized":"2024-01-22T05:08:01.587335+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.012839+0000","last_change":"2024-01-22T05:08:02.012839+0000","last_active":"2024-01-22T05:08:02.012839+0000","last_peered":"2024-01-22T05:08:02.012839+0000","last_clean":"2024-01-22T05:08:02.012839+0000","last_became_active":"2024-01-22T05:08:02.012438+0000","last_became_peered":"2024-01-22T05:08:02.012438+0000","last_unstale":"2024-01-22T05:08:02.012839+0000","last_undegraded":"2024-01-22T05:08:02.012839+0000","last_fullsized":"2024-01-22T05:08:02.012839+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.557877+0000","last_change":"2024-01-22T05:08:01.554688+0000","last_active":"2024-01-22T05:08:01.557877+0000","last_peered":"2024-01-22T05:08:01.557877+0000","last_clean":"2024-01-22T05:08:01.557877+0000","last_became_active":"2024-01-22T05:08:01.554421+0000","last_became_peered":"2024-01-22T05:08:01.554421+0000","last_unstale":"2024-01-22T05:08:01.557877+0000","last_undegraded":"2024-01-22T05:08:01.557877+0000","last_fullsized":"2024-01-22T05:08:01.557877+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.996293+0000","last_change":"2024-01-22T05:08:01.996293+0000","last_active":"2024-01-22T05:08:01.996293+0000","last_peered":"2024-01-22T05:08:01.996293+0000","last_clean":"2024-01-22T05:08:01.996293+0000","last_became_active":"2024-01-22T05:08:01.996014+0000","last_became_peered":"2024-01-22T05:08:01.996014+0000","last_unstale":"2024-01-22T05:08:01.996293+0000","last_undegraded":"2024-01-22T05:08:01.996293+0000","last_fullsized":"2024-01-22T05:08:01.996293+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.556115+0000","last_change":"2024-01-22T05:08:01.553432+0000","last_active":"2024-01-22T05:08:01.556115+0000","last_peered":"2024-01-22T05:08:01.556115+0000","last_clean":"2024-01-22T05:08:01.556115+0000","last_became_active":"2024-01-22T05:08:01.553160+0000","last_became_peered":"2024-01-22T05:08:01.553160+0000","last_unstale":"2024-01-22T05:08:01.556115+0000","last_undegraded":"2024-01-22T05:08:01.556115+0000","last_fullsized":"2024-01-22T05:08:01.556115+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.020065+0000","last_change":"2024-01-22T05:08:02.020065+0000","last_active":"2024-01-22T05:08:02.020065+0000","last_peered":"2024-01-22T05:08:02.020065+0000","last_clean":"2024-01-22T05:08:02.020065+0000","last_became_active":"2024-01-22T05:08:02.016498+0000","last_became_peered":"2024-01-22T05:08:02.016498+0000","last_unstale":"2024-01-22T05:08:02.020065+0000","last_undegraded":"2024-01-22T05:08:02.020065+0000","last_fullsized":"2024-01-22T05:08:02.020065+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.563506+0000","last_change":"2024-01-22T05:08:01.558571+0000","last_active":"2024-01-22T05:08:01.563506+0000","last_peered":"2024-01-22T05:08:01.563506+0000","last_clean":"2024-01-22T05:08:01.563506+0000","last_became_active":"2024-01-22T05:08:01.558271+0000","last_became_peered":"2024-01-22T05:08:01.558271+0000","last_unstale":"2024-01-22T05:08:01.563506+0000","last_undegraded":"2024-01-22T05:08:01.563506+0000","last_fullsized":"2024-01-22T05:08:01.563506+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.008903+0000","last_change":"2024-01-22T05:08:02.008903+0000","last_active":"2024-01-22T05:08:02.008903+0000","last_peered":"2024-01-22T05:08:02.008903+0000","last_clean":"2024-01-22T05:08:02.008903+0000","last_became_active":"2024-01-22T05:08:02.004893+0000","last_became_peered":"2024-01-22T05:08:02.004893+0000","last_unstale":"2024-01-22T05:08:02.008903+0000","last_undegraded":"2024-01-22T05:08:02.008903+0000","last_fullsized":"2024-01-22T05:08:02.008903+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.587222+0000","last_change":"2024-01-22T05:08:01.585680+0000","last_active":"2024-01-22T05:08:01.587222+0000","last_peered":"2024-01-22T05:08:01.587222+0000","last_clean":"2024-01-22T05:08:01.587222+0000","last_became_active":"2024-01-22T05:08:01.585228+0000","last_became_peered":"2024-01-22T05:08:01.585228+0000","last_unstale":"2024-01-22T05:08:01.587222+0000","last_undegraded":"2024-01-22T05:08:01.587222+0000","last_fullsized":"2024-01-22T05:08:01.587222+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.012298+0000","last_change":"2024-01-22T05:08:02.012298+0000","last_active":"2024-01-22T05:08:02.012298+0000","last_peered":"2024-01-22T05:08:02.012298+0000","last_clean":"2024-01-22T05:08:02.012298+0000","last_became_active":"2024-01-22T05:08:02.011918+0000","last_became_peered":"2024-01-22T05:08:02.011918+0000","last_unstale":"2024-01-22T05:08:02.012298+0000","last_undegraded":"2024-01-22T05:08:02.012298+0000","last_fullsized":"2024-01-22T05:08:02.012298+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.571388+0000","last_change":"2024-01-22T05:08:01.567179+0000","last_active":"2024-01-22T05:08:01.571388+0000","last_peered":"2024-01-22T05:08:01.571388+0000","last_clean":"2024-01-22T05:08:01.571388+0000","last_became_active":"2024-01-22T05:08:01.566829+0000","last_became_peered":"2024-01-22T05:08:01.566829+0000","last_unstale":"2024-01-22T05:08:01.571388+0000","last_undegraded":"2024-01-22T05:08:01.571388+0000","last_fullsized":"2024-01-22T05:08:01.571388+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.015852+0000","last_change":"2024-01-22T05:08:02.015852+0000","last_active":"2024-01-22T05:08:02.015852+0000","last_peered":"2024-01-22T05:08:02.015852+0000","last_clean":"2024-01-22T05:08:02.015852+0000","last_became_active":"2024-01-22T05:08:02.015565+0000","last_became_peered":"2024-01-22T05:08:02.015565+0000","last_unstale":"2024-01-22T05:08:02.015852+0000","last_undegraded":"2024-01-22T05:08:02.015852+0000","last_fullsized":"2024-01-22T05:08:02.015852+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.576215+0000","last_change":"2024-01-22T05:08:01.565663+0000","last_active":"2024-01-22T05:08:01.576215+0000","last_peered":"2024-01-22T05:08:01.576215+0000","last_clean":"2024-01-22T05:08:01.576215+0000","last_became_active":"2024-01-22T05:08:01.565280+0000","last_became_peered":"2024-01-22T05:08:01.565280+0000","last_unstale":"2024-01-22T05:08:01.576215+0000","last_undegraded":"2024-01-22T05:08:01.576215+0000","last_fullsized":"2024-01-22T05:08:01.576215+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.006440+0000","last_change":"2024-01-22T05:08:02.006440+0000","last_active":"2024-01-22T05:08:02.006440+0000","last_peered":"2024-01-22T05:08:02.006440+0000","last_clean":"2024-01-22T05:08:02.006440+0000","last_became_active":"2024-01-22T05:08:02.006158+0000","last_became_peered":"2024-01-22T05:08:02.006158+0000","last_unstale":"2024-01-22T05:08:02.006440+0000","last_undegraded":"2024-01-22T05:08:02.006440+0000","last_fullsized":"2024-01-22T05:08:02.006440+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.563014+0000","last_change":"2024-01-22T05:08:01.560393+0000","last_active":"2024-01-22T05:08:01.563014+0000","last_peered":"2024-01-22T05:08:01.563014+0000","last_clean":"2024-01-22T05:08:01.563014+0000","last_became_active":"2024-01-22T05:08:01.560100+0000","last_became_peered":"2024-01-22T05:08:01.560100+0000","last_unstale":"2024-01-22T05:08:01.563014+0000","last_undegraded":"2024-01-22T05:08:01.563014+0000","last_fullsized":"2024-01-22T05:08:01.563014+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.537015+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:08:01.537015+0000","last_peered":"2024-01-22T05:08:01.537015+0000","last_clean":"2024-01-22T05:08:01.537015+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:08:01.537015+0000","last_undegraded":"2024-01-22T05:08:01.537015+0000","last_fullsized":"2024-01-22T05:08:01.537015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.009628+0000","last_change":"2024-01-22T05:08:02.009628+0000","last_active":"2024-01-22T05:08:02.009628+0000","last_peered":"2024-01-22T05:08:02.009628+0000","last_clean":"2024-01-22T05:08:02.009628+0000","last_became_active":"2024-01-22T05:08:02.009305+0000","last_became_peered":"2024-01-22T05:08:02.009305+0000","last_unstale":"2024-01-22T05:08:02.009628+0000","last_undegraded":"2024-01-22T05:08:02.009628+0000","last_fullsized":"2024-01-22T05:08:02.009628+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.586353+0000","last_change":"2024-01-22T05:08:01.580851+0000","last_active":"2024-01-22T05:08:01.586353+0000","last_peered":"2024-01-22T05:08:01.586353+0000","last_clean":"2024-01-22T05:08:01.586353+0000","last_became_active":"2024-01-22T05:08:01.580488+0000","last_became_peered":"2024-01-22T05:08:01.580488+0000","last_unstale":"2024-01-22T05:08:01.586353+0000","last_undegraded":"2024-01-22T05:08:01.586353+0000","last_fullsized":"2024-01-22T05:08:01.586353+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.536342+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:08:01.536342+0000","last_peered":"2024-01-22T05:08:01.536342+0000","last_clean":"2024-01-22T05:08:01.536342+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:08:01.536342+0000","last_undegraded":"2024-01-22T05:08:01.536342+0000","last_fullsized":"2024-01-22T05:08:01.536342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.005255+0000","last_change":"2024-01-22T05:08:02.005255+0000","last_active":"2024-01-22T05:08:02.005255+0000","last_peered":"2024-01-22T05:08:02.005255+0000","last_clean":"2024-01-22T05:08:02.005255+0000","last_became_active":"2024-01-22T05:08:02.004853+0000","last_became_peered":"2024-01-22T05:08:02.004853+0000","last_unstale":"2024-01-22T05:08:02.005255+0000","last_undegraded":"2024-01-22T05:08:02.005255+0000","last_fullsized":"2024-01-22T05:08:02.005255+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.998655+0000","last_change":"2024-01-22T05:08:01.573280+0000","last_active":"2024-01-22T05:08:01.998655+0000","last_peered":"2024-01-22T05:08:01.998655+0000","last_clean":"2024-01-22T05:08:01.998655+0000","last_became_active":"2024-01-22T05:08:01.572823+0000","last_became_peered":"2024-01-22T05:08:01.572823+0000","last_unstale":"2024-01-22T05:08:01.998655+0000","last_undegraded":"2024-01-22T05:08:01.998655+0000","last_fullsized":"2024-01-22T05:08:01.998655+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.557221+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:08:01.557221+0000","last_peered":"2024-01-22T05:08:01.557221+0000","last_clean":"2024-01-22T05:08:01.557221+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:08:01.557221+0000","last_undegraded":"2024-01-22T05:08:01.557221+0000","last_fullsized":"2024-01-22T05:08:01.557221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.013787+0000","last_change":"2024-01-22T05:08:02.013787+0000","last_active":"2024-01-22T05:08:02.013787+0000","last_peered":"2024-01-22T05:08:02.013787+0000","last_clean":"2024-01-22T05:08:02.013787+0000","last_became_active":"2024-01-22T05:08:02.013468+0000","last_became_peered":"2024-01-22T05:08:02.013468+0000","last_unstale":"2024-01-22T05:08:02.013787+0000","last_undegraded":"2024-01-22T05:08:02.013787+0000","last_fullsized":"2024-01-22T05:08:02.013787+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"55'2","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.012652+0000","last_change":"2024-01-22T05:08:01.581441+0000","last_active":"2024-01-22T05:08:02.012652+0000","last_peered":"2024-01-22T05:08:02.012652+0000","last_clean":"2024-01-22T05:08:02.012652+0000","last_became_active":"2024-01-22T05:08:01.581144+0000","last_became_peered":"2024-01-22T05:08:01.581144+0000","last_unstale":"2024-01-22T05:08:02.012652+0000","last_undegraded":"2024-01-22T05:08:02.012652+0000","last_fullsized":"2024-01-22T05:08:02.012652+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.535216+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:08:01.535216+0000","last_peered":"2024-01-22T05:08:01.535216+0000","last_clean":"2024-01-22T05:08:01.535216+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:08:01.535216+0000","last_undegraded":"2024-01-22T05:08:01.535216+0000","last_fullsized":"2024-01-22T05:08:01.535216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.993888+0000","last_change":"2024-01-22T05:08:01.993888+0000","last_active":"2024-01-22T05:08:01.993888+0000","last_peered":"2024-01-22T05:08:01.993888+0000","last_clean":"2024-01-22T05:08:01.993888+0000","last_became_active":"2024-01-22T05:08:01.993544+0000","last_became_peered":"2024-01-22T05:08:01.993544+0000","last_unstale":"2024-01-22T05:08:01.993888+0000","last_undegraded":"2024-01-22T05:08:01.993888+0000","last_fullsized":"2024-01-22T05:08:01.993888+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.561989+0000","last_change":"2024-01-22T05:08:01.558302+0000","last_active":"2024-01-22T05:08:01.561989+0000","last_peered":"2024-01-22T05:08:01.561989+0000","last_clean":"2024-01-22T05:08:01.561989+0000","last_became_active":"2024-01-22T05:08:01.558025+0000","last_became_peered":"2024-01-22T05:08:01.558025+0000","last_unstale":"2024-01-22T05:08:01.561989+0000","last_undegraded":"2024-01-22T05:08:01.561989+0000","last_fullsized":"2024-01-22T05:08:01.561989+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.547066+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:08:01.547066+0000","last_peered":"2024-01-22T05:08:01.547066+0000","last_clean":"2024-01-22T05:08:01.547066+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:08:01.547066+0000","last_undegraded":"2024-01-22T05:08:01.547066+0000","last_fullsized":"2024-01-22T05:08:01.547066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.014813+0000","last_change":"2024-01-22T05:08:02.014813+0000","last_active":"2024-01-22T05:08:02.014813+0000","last_peered":"2024-01-22T05:08:02.014813+0000","last_clean":"2024-01-22T05:08:02.014813+0000","last_became_active":"2024-01-22T05:08:02.013550+0000","last_became_peered":"2024-01-22T05:08:02.013550+0000","last_unstale":"2024-01-22T05:08:02.014813+0000","last_undegraded":"2024-01-22T05:08:02.014813+0000","last_fullsized":"2024-01-22T05:08:02.014813+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.995636+0000","last_change":"2024-01-22T05:08:01.562189+0000","last_active":"2024-01-22T05:08:01.995636+0000","last_peered":"2024-01-22T05:08:01.995636+0000","last_clean":"2024-01-22T05:08:01.995636+0000","last_became_active":"2024-01-22T05:08:01.561881+0000","last_became_peered":"2024-01-22T05:08:01.561881+0000","last_unstale":"2024-01-22T05:08:01.995636+0000","last_undegraded":"2024-01-22T05:08:01.995636+0000","last_fullsized":"2024-01-22T05:08:01.995636+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.548796+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:08:01.548796+0000","last_peered":"2024-01-22T05:08:01.548796+0000","last_clean":"2024-01-22T05:08:01.548796+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:08:01.548796+0000","last_undegraded":"2024-01-22T05:08:01.548796+0000","last_fullsized":"2024-01-22T05:08:01.548796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.014398+0000","last_change":"2024-01-22T05:08:02.014398+0000","last_active":"2024-01-22T05:08:02.014398+0000","last_peered":"2024-01-22T05:08:02.014398+0000","last_clean":"2024-01-22T05:08:02.014398+0000","last_became_active":"2024-01-22T05:08:02.013331+0000","last_became_peered":"2024-01-22T05:08:02.013331+0000","last_unstale":"2024-01-22T05:08:02.014398+0000","last_undegraded":"2024-01-22T05:08:02.014398+0000","last_fullsized":"2024-01-22T05:08:02.014398+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.571740+0000","last_change":"2024-01-22T05:08:01.569046+0000","last_active":"2024-01-22T05:08:01.571740+0000","last_peered":"2024-01-22T05:08:01.571740+0000","last_clean":"2024-01-22T05:08:01.571740+0000","last_became_active":"2024-01-22T05:08:01.568738+0000","last_became_peered":"2024-01-22T05:08:01.568738+0000","last_unstale":"2024-01-22T05:08:01.571740+0000","last_undegraded":"2024-01-22T05:08:01.571740+0000","last_fullsized":"2024-01-22T05:08:01.571740+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.553565+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:08:01.553565+0000","last_peered":"2024-01-22T05:08:01.553565+0000","last_clean":"2024-01-22T05:08:01.553565+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:08:01.553565+0000","last_undegraded":"2024-01-22T05:08:01.553565+0000","last_fullsized":"2024-01-22T05:08:01.553565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.999170+0000","last_change":"2024-01-22T05:08:01.999170+0000","last_active":"2024-01-22T05:08:01.999170+0000","last_peered":"2024-01-22T05:08:01.999170+0000","last_clean":"2024-01-22T05:08:01.999170+0000","last_became_active":"2024-01-22T05:08:01.998869+0000","last_became_peered":"2024-01-22T05:08:01.998869+0000","last_unstale":"2024-01-22T05:08:01.999170+0000","last_undegraded":"2024-01-22T05:08:01.999170+0000","last_fullsized":"2024-01-22T05:08:01.999170+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.547151+0000","last_change":"2024-01-22T05:08:01.543813+0000","last_active":"2024-01-22T05:08:01.547151+0000","last_peered":"2024-01-22T05:08:01.547151+0000","last_clean":"2024-01-22T05:08:01.547151+0000","last_became_active":"2024-01-22T05:08:01.542706+0000","last_became_peered":"2024-01-22T05:08:01.542706+0000","last_unstale":"2024-01-22T05:08:01.547151+0000","last_undegraded":"2024-01-22T05:08:01.547151+0000","last_fullsized":"2024-01-22T05:08:01.547151+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.548672+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:08:01.548672+0000","last_peered":"2024-01-22T05:08:01.548672+0000","last_clean":"2024-01-22T05:08:01.548672+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:08:01.548672+0000","last_undegraded":"2024-01-22T05:08:01.548672+0000","last_fullsized":"2024-01-22T05:08:01.548672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.553657+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:08:01.553657+0000","last_peered":"2024-01-22T05:08:01.553657+0000","last_clean":"2024-01-22T05:08:01.553657+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:08:01.553657+0000","last_undegraded":"2024-01-22T05:08:01.553657+0000","last_fullsized":"2024-01-22T05:08:01.553657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305904,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065936,"statfs":{"total":96636764160,"available":96323518464,"internally_reserved":0,"allocated":630784,"data_stored":295177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:07:34 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.98499999999999999,"15min":1.04},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0649999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0309999999999999,"15min":1.0389999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.486,"5min":1.53,"15min":1.53},"last":0.98599999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:07:34 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.002,"15min":0.97599999999999998},"min":{"1min":0.67300000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3380000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1499999999999999,"15min":1.173},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3580000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.83399999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:07:34 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0920000000000001,"15min":1.0940000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.579,"5min":1.659,"15min":1.659},"last":1.173},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.147,"15min":1.165},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.492,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.014}]},{"osd":3,"last update":"Mon Jan 22 05:07:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.21,"15min":1.228},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.456,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.198,"15min":1.224},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4450000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.3660000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:07:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0760000000000001,"15min":1.0529999999999999},"min":{"1min":0.879,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4590000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.165,"15min":1.1599999999999999},"min":{"1min":0.84499999999999997,"5min":0.751,"15min":0.751},"max":{"1min":1.4770000000000001,"5min":1.8,"15min":1.8},"last":1.292}]},{"osd":5,"last update":"Mon Jan 22 05:07:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.196,"15min":1.1899999999999999},"min":{"1min":0.64500000000000002,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5149999999999999,"5min":1.736,"15min":1.736},"last":1.448},{"interface":"front","average":{"1min":1.266,"5min":1.2290000000000001,"15min":1.204},"min":{"1min":0.94199999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.5309999999999999,"5min":1.915,"15min":1.915},"last":1.399}]},{"osd":6,"last update":"Mon Jan 22 05:07:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2549999999999999,"15min":1.258},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.472,"5min":1.823,"15min":1.823},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.335,"15min":1.321},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.621,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.5620000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065912,"statfs":{"total":96636764160,"available":96323493888,"internally_reserved":0,"allocated":655360,"data_stored":309741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0649999999999999,"15min":1.091},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.046},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.03,"15min":1.046},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.4550000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0189999999999999,"15min":1.054},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.1910000000000001,"15min":1.2330000000000001},"min":{"1min":0.65700000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.4649999999999999,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":0.96399999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1459999999999999,"15min":1.1579999999999999},"min":{"1min":0.71399999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.206},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.081,"15min":1.103},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.575,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.2490000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1319999999999999,"15min":1.133},"min":{"1min":0.63500000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5369999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.089},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.161,"15min":1.198},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.4510000000000001,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.2869999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.109,"15min":1.089},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":2.4049999999999998,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":1.238},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1259999999999999,"15min":1.131},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.83499999999999996}]},{"osd":5,"last update":"Mon Jan 22 05:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1539999999999999,"15min":1.1799999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.276,"15min":1.2729999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.4390000000000001,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.159}]},{"osd":7,"last update":"Mon Jan 22 05:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3520000000000001,"15min":1.3759999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6679999999999999,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.355,"15min":1.4039999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.7470000000000001,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":1.3520000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310028,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061812,"statfs":{"total":96636764160,"available":96319295488,"internally_reserved":0,"allocated":659456,"data_stored":310295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.96799999999999997,"15min":0.98799999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.75},{"interface":"front","average":{"1min":0.93700000000000006,"5min":1.073,"15min":1.117},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.506,"5min":1.571,"15min":1.571},"last":0.92100000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.173,"15min":1.2210000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5669999999999999,"5min":1.821,"15min":1.821},"last":1.018},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.2549999999999999,"15min":1.319},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5189999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.391}]},{"osd":2,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1339999999999999,"15min":1.1539999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4350000000000001,"5min":1.629,"15min":1.629},"last":1.347},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.1120000000000001,"15min":1.147},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.54,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.1519999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1739999999999999,"15min":1.196},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4990000000000001,"5min":1.931,"15min":1.931},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.2549999999999999,"15min":1.3149999999999999},"min":{"1min":0.79300000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.569,"5min":2.266,"15min":2.266},"last":1.2929999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.175,"15min":1.2030000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.7749999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2749999999999999,"15min":1.3149999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.714,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.0940000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.3180000000000001,"15min":1.361},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.671,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.2},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2929999999999999,"15min":1.3169999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.899,"5min":1.909,"15min":1.909},"last":1.3160000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.4099999999999999,"15min":1.4410000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.881,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.448,"15min":1.496},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.0499999999999998,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.4450000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065924,"statfs":{"total":96636764160,"available":96323506176,"internally_reserved":0,"allocated":643072,"data_stored":302209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:07:29 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.1060000000000001,"15min":1.1399999999999999},"min":{"1min":0.69499999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.333,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0900000000000001,"15min":1.0880000000000001},"min":{"1min":0.55300000000000005,"5min":0.501,"15min":0.501},"max":{"1min":1.51,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.155}]},{"osd":1,"last update":"Mon Jan 22 05:07:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0629999999999999,"15min":1.0880000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3160000000000001,"5min":1.538,"15min":1.538},"last":1.4870000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.145,"15min":1.2070000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3520000000000001,"5min":2.194,"15min":2.194},"last":1.1879999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:07:29 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1100000000000001,"15min":1.095},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":5.3390000000000004,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.222,"15min":1.2869999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.278,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.4490000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:07:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.163,"15min":1.194},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.4450000000000001,"5min":1.589,"15min":1.589},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.1739999999999999,"15min":1.1639999999999999},"min":{"1min":0.82599999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":5.3029999999999999,"5min":5.3029999999999999,"15min":5.3029999999999999},"last":1.246}]},{"osd":5,"last update":"Mon Jan 22 05:07:29 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.202,"15min":1.23},"min":{"1min":0.68200000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.3480000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.149,"15min":1.167},"min":{"1min":0.628,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.429,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.03}]},{"osd":6,"last update":"Mon Jan 22 05:07:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2110000000000001,"15min":1.1970000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":5.3769999999999998,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":1.296},{"interface":"front","average":{"1min":1.361,"5min":1.409,"15min":1.4410000000000001},"min":{"1min":0.85499999999999998,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":4.4409999999999998,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":1.3260000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:07:29 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3480000000000001,"15min":1.3740000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6399999999999999,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.3919999999999999,"15min":1.3899999999999999},"min":{"1min":0.85099999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":5.2629999999999999,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.343}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310000,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061840,"statfs":{"total":96636764160,"available":96319324160,"internally_reserved":0,"allocated":630784,"data_stored":295177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.96699999999999997,"15min":0.91100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.22,"5min":14.859,"15min":14.859},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.91900000000000004,"15min":0.88},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":3.9860000000000002,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":1.599}]},{"osd":1,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84999999999999998,"15min":0.84799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2030000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.876,"5min":0.99299999999999999,"15min":0.98299999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.526,"5min":5.7519999999999998,"15min":5.7519999999999998},"last":0.97099999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.1120000000000001,"15min":1.1679999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.5029999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.165,"15min":1.1890000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.0209999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.292,"15min":1.2969999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.6419999999999999,"5min":5.016,"15min":5.016},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.339,"15min":1.337},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.621,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":1.095}]},{"osd":5,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.296,"15min":1.296},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.7130000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.3,"5min":1.319,"15min":1.2909999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.986,"5min":5.6740000000000004,"15min":5.6740000000000004},"last":1.3049999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.4039999999999999,"15min":1.4279999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.754,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":1.48},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.4259999999999999,"15min":1.419},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8680000000000001,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":1.337}]},{"osd":7,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.409,"15min":1.4039999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.921,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":1.417},{"interface":"front","average":{"1min":1.274,"5min":1.4279999999999999,"15min":1.4319999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.738,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":1.381}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305936,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065904,"statfs":{"total":96636764160,"available":96323485696,"internally_reserved":0,"allocated":663552,"data_stored":309797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72999999999999998,"15min":0.746},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0389999999999999,"5min":1.254,"15min":1.254},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.4370000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.90800000000000003,"15min":0.93799999999999994},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.0980000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.038,"15min":1.046},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.655},{"interface":"front","average":{"1min":1.103,"5min":1.1319999999999999,"15min":1.1559999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.2849999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2609999999999999,"15min":1.3089999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.8340000000000001,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.48},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.181,"15min":1.2090000000000001},"min":{"1min":0.69999999999999996,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.798,"5min":1.952,"15min":1.952},"last":1.042}]},{"osd":5,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.159,"15min":1.1779999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.732,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.742},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.276,"15min":1.3220000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.929,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.4159999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.222,"15min":1.254},"min":{"1min":0.754,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.875,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.2549999999999999,"15min":1.2789999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9710000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":2.1320000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.3180000000000001,"15min":1.3560000000000001},"min":{"1min":0.79600000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.6220000000000001,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.369,"15min":1.401},"min":{"1min":0.92400000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.899,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":2.0329999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065924,"statfs":{"total":96636764160,"available":96323506176,"internally_reserved":0,"allocated":643072,"data_stored":302209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:07:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.85899999999999999,"15min":0.83999999999999997},"min":{"1min":0.46200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.98399999999999999,"15min":0.999},"min":{"1min":0.51600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":2.101,"5min":2.101,"15min":2.101},"last":0.76500000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:07:35 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.97999999999999998,"15min":1.002},"min":{"1min":0.499,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.526,"5min":1.548,"15min":1.548},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.016,"15min":1.0209999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":0.997}]},{"osd":3,"last update":"Mon Jan 22 05:07:35 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.0229999999999999,"15min":0.99399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":1.129},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.876,"15min":0.874},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.88100000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:07:35 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1859999999999999,"15min":1.194},"min":{"1min":0.754,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6439999999999999,"5min":1.726,"15min":1.726},"last":1.149},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.256,"15min":1.244},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.3410000000000002,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":1.1890000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:07:35 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1699999999999999,"15min":1.1830000000000001},"min":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7070000000000001,"5min":1.776,"15min":1.776},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.2569999999999999,"15min":1.266},"min":{"1min":0.878,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.0409999999999999,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.0209999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:07:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.25,"15min":1.264},"min":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3200000000000001,"15min":1.3320000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.946,"5min":2.294,"15min":2.294},"last":1.0880000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:07:35 2024","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.3799999999999999,"15min":1.373},"min":{"1min":0.82299999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":4.4329999999999998,"5min":4.4329999999999998,"15min":4.4329999999999998},"last":1.327},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3460000000000001,"15min":1.3600000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":3.0099999999999998,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":1.0409999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065924,"statfs":{"total":96636764160,"available":96323506176,"internally_reserved":0,"allocated":643072,"data_stored":302209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.85899999999999999,"15min":0.92500000000000004},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.4810000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.92400000000000004,"15min":0.98499999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.395,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.81699999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.0169999999999999,"15min":1.0760000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.98699999999999999,"15min":1.0169999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.92600000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.032},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.7170000000000001,"5min":1.994,"15min":1.994},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.149,"15min":1.2150000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6910000000000001,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.171}]},{"osd":4,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.3109999999999999,"15min":1.389},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.667,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.056},{"interface":"front","average":{"1min":1.133,"5min":1.2250000000000001,"15min":1.256},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.651,"5min":1.782,"15min":1.782},"last":1.325}]},{"osd":5,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.319,"15min":1.389},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.6519999999999999,"5min":3.548,"15min":3.548},"last":1.214},{"interface":"front","average":{"1min":1.131,"5min":1.345,"15min":1.4239999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.623,"5min":2.613,"15min":2.613},"last":1.4910000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.387,"15min":1.446},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.619,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.367},{"interface":"front","average":{"1min":1.107,"5min":1.4159999999999999,"15min":1.514},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6279999999999999,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.1379999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.526,"15min":1.6539999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7070000000000001,"5min":5.29,"15min":5.29},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.377,"15min":1.4410000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.645,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.4359999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:08:06.314 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:08:06.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.516+0000 7fde7f400700 1 Processor -- start 2024-01-22T05:08:06.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.516+0000 7fde7f400700 1 -- start start 2024-01-22T05:08:06.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.516+0000 7fde7f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde78155d20 0x7fde78065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.516+0000 7fde7f400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde780c1a40 con 0x7fde78066070 2024-01-22T05:08:06.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.516+0000 7fde7f400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde78159310 con 0x7fde780a8e50 2024-01-22T05:08:06.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.516+0000 7fde7f400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde780c13f0 con 0x7fde78155d20 2024-01-22T05:08:06.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.516+0000 7fde77e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fde78066070 0x7fde780a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42148/0 (socket says 172.21.15.49:42148) 2024-01-22T05:08:06.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde77e00700 1 -- 172.21.15.49:0/2779855405 learned_addr learned my addr 172.21.15.49:0/2779855405 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:06.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde7ca00700 1 --2- 172.21.15.49:0/2779855405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde78155d20 0x7fde78065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde77400700 1 -- 172.21.15.49:0/2779855405 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105814086 0 0) 0x7fde780c1a40 con 0x7fde78066070 2024-01-22T05:08:06.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde77400700 1 -- 172.21.15.49:0/2779855405 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde580033f0 con 0x7fde78066070 2024-01-22T05:08:06.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde77400700 1 -- 172.21.15.49:0/2779855405 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808044105 0 0) 0x7fde78159310 con 0x7fde780a8e50 2024-01-22T05:08:06.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde77400700 1 -- 172.21.15.49:0/2779855405 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde780c1a40 con 0x7fde780a8e50 2024-01-22T05:08:06.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde7ca00700 1 -- 172.21.15.49:0/2779855405 >> v1:172.21.15.110:6789/0 conn(0x7fde780a8e50 legacy=0x7fde780c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde7ca00700 1 -- 172.21.15.49:0/2779855405 >> v1:172.21.15.49:6789/0 conn(0x7fde78066070 legacy=0x7fde780a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde7ca00700 1 -- 172.21.15.49:0/2779855405 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde780c16d0 con 0x7fde78155d20 2024-01-22T05:08:06.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde7ca00700 1 --2- 172.21.15.49:0/2779855405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde78155d20 0x7fde78065b80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fde68009790 tx=0x7fde68009060).ready entity=mon.2 client_cookie=2eb34570bc5b5738 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:06.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde77400700 1 -- 172.21.15.49:0/2779855405 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6800f510 con 0x7fde78155d20 2024-01-22T05:08:06.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde77400700 1 -- 172.21.15.49:0/2779855405 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6800f670 con 0x7fde78155d20 2024-01-22T05:08:06.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde77400700 1 -- 172.21.15.49:0/2779855405 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6800f9f0 con 0x7fde78155d20 2024-01-22T05:08:06.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde7f400700 1 -- 172.21.15.49:0/2779855405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde78155d20 msgr2=0x7fde78065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde7f400700 1 --2- 172.21.15.49:0/2779855405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde78155d20 0x7fde78065b80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fde68009790 tx=0x7fde68009060).stop 2024-01-22T05:08:06.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde7f400700 1 -- 172.21.15.49:0/2779855405 shutdown_connections 2024-01-22T05:08:06.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde7f400700 1 --2- 172.21.15.49:0/2779855405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde78155d20 0x7fde78065b80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.520+0000 7fde7f400700 1 -- 172.21.15.49:0/2779855405 >> 172.21.15.49:0/2779855405 conn(0x7fde780c6540 msgr2=0x7fde780c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:06.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.524+0000 7fde7f400700 1 -- 172.21.15.49:0/2779855405 shutdown_connections 2024-01-22T05:08:06.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.524+0000 7fde7f400700 1 -- 172.21.15.49:0/2779855405 wait complete. 2024-01-22T05:08:06.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.524+0000 7fde7f400700 1 Processor -- start 2024-01-22T05:08:06.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.524+0000 7fde7f400700 1 -- start start 2024-01-22T05:08:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde78066070 0x7fde7814bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde780a8e50 0x7fde780bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde78155d20 0x7fde78168660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7f400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde780ab0c0 con 0x7fde78155d20 2024-01-22T05:08:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7f400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde78169500 con 0x7fde78066070 2024-01-22T05:08:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7f400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde780ac190 con 0x7fde780a8e50 2024-01-22T05:08:06.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde78155d20 0x7fde78168660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde78155d20 0x7fde78168660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34096/0 (socket says 172.21.15.49:34096) 2024-01-22T05:08:06.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7d400700 1 -- 172.21.15.49:0/2946680588 learned_addr learned my addr 172.21.15.49:0/2946680588 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:06.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde77e00700 1 --2- 172.21.15.49:0/2946680588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde780a8e50 0x7fde780bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7ca00700 1 --2- 172.21.15.49:0/2946680588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde78066070 0x7fde7814bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7d400700 1 -- 172.21.15.49:0/2946680588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde780a8e50 msgr2=0x7fde780bd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7d400700 1 --2- 172.21.15.49:0/2946680588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde780a8e50 0x7fde780bd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7d400700 1 -- 172.21.15.49:0/2946680588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde78066070 msgr2=0x7fde7814bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7d400700 1 --2- 172.21.15.49:0/2946680588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde78066070 0x7fde7814bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7d400700 1 -- 172.21.15.49:0/2946680588 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde680092a0 con 0x7fde78155d20 2024-01-22T05:08:06.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7d400700 1 --2- 172.21.15.49:0/2946680588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde78155d20 0x7fde78168660 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fde7000c710 tx=0x7fde7000ca20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:06.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde6fe00700 1 -- 172.21.15.49:0/2946680588 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000e4a0 con 0x7fde78155d20 2024-01-22T05:08:06.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde6fe00700 1 -- 172.21.15.49:0/2946680588 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7000e600 con 0x7fde78155d20 2024-01-22T05:08:06.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde7f400700 1 -- 172.21.15.49:0/2946680588 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde780ac470 con 0x7fde78155d20 2024-01-22T05:08:06.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.528+0000 7fde6fe00700 1 -- 172.21.15.49:0/2946680588 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000e980 con 0x7fde78155d20 2024-01-22T05:08:06.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.532+0000 7fde7f400700 1 -- 172.21.15.49:0/2946680588 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde780aad50 con 0x7fde78155d20 2024-01-22T05:08:06.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.532+0000 7fde7f400700 1 -- 172.21.15.49:0/2946680588 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde780ab270 con 0x7fde78155d20 2024-01-22T05:08:06.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.532+0000 7fde6fe00700 1 -- 172.21.15.49:0/2946680588 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fde70012400 con 0x7fde78155d20 2024-01-22T05:08:06.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.532+0000 7fde6fe00700 1 --2- 172.21.15.49:0/2946680588 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde5005a510 0x7fde5005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.532+0000 7fde6fe00700 1 -- 172.21.15.49:0/2946680588 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fde70074130 con 0x7fde78155d20 2024-01-22T05:08:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.532+0000 7fde7ca00700 1 --2- 172.21.15.49:0/2946680588 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde5005a510 0x7fde5005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.536+0000 7fde7ca00700 1 --2- 172.21.15.49:0/2946680588 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde5005a510 0x7fde5005c9d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fde68009fd0 tx=0x7fde68017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.540+0000 7fde6fe00700 1 -- 172.21.15.49:0/2946680588 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fde780ab270 con 0x7fde78155d20 2024-01-22T05:08:06.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.704+0000 7fde7f400700 1 -- 172.21.15.49:0/2946680588 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde780ab200 con 0x7fde5005a510 2024-01-22T05:08:06.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.724+0000 7fde6fe00700 1 -- 172.21.15.49:0/2946680588 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358746 (secure 0 0 0) 0x7fde780ab200 con 0x7fde5005a510 2024-01-22T05:08:06.730 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:06.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.736+0000 7fde7f400700 1 -- 172.21.15.49:0/2946680588 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde5005a510 msgr2=0x7fde5005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.736+0000 7fde7f400700 1 --2- 172.21.15.49:0/2946680588 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde5005a510 0x7fde5005c9d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fde68009fd0 tx=0x7fde68017000).stop 2024-01-22T05:08:06.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.736+0000 7fde7f400700 1 -- 172.21.15.49:0/2946680588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde78155d20 msgr2=0x7fde78168660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.736+0000 7fde7f400700 1 --2- 172.21.15.49:0/2946680588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde78155d20 0x7fde78168660 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fde7000c710 tx=0x7fde7000ca20).stop 2024-01-22T05:08:06.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.736+0000 7fde7f400700 1 -- 172.21.15.49:0/2946680588 shutdown_connections 2024-01-22T05:08:06.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.736+0000 7fde7f400700 1 --2- 172.21.15.49:0/2946680588 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde5005a510 0x7fde5005c9d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.736+0000 7fde7f400700 1 --2- 172.21.15.49:0/2946680588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde78155d20 0x7fde78168660 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.736+0000 7fde7f400700 1 --2- 172.21.15.49:0/2946680588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde780a8e50 0x7fde780bd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.736+0000 7fde7f400700 1 --2- 172.21.15.49:0/2946680588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde78066070 0x7fde7814bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.736+0000 7fde7f400700 1 -- 172.21.15.49:0/2946680588 >> 172.21.15.49:0/2946680588 conn(0x7fde780c6540 msgr2=0x7fde780c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:06.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.736+0000 7fde7f400700 1 -- 172.21.15.49:0/2946680588 shutdown_connections 2024-01-22T05:08:06.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.736+0000 7fde7f400700 1 -- 172.21.15.49:0/2946680588 wait complete. 2024-01-22T05:08:06.743 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:08:06.764 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-01-22T05:08:05.302847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2455544,"kb_used_data":5048,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752519176,"statfs":{"total":773094113280,"available":770579636224,"internally_reserved":0,"allocated":5169152,"data_stored":2426814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2800594,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1990,"num_read_kb":-2292,"num_write":-19172,"num_write_kb":-93473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-47,"num_bytes_recovered":-134,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.385030"},"pg_stats":[{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.015075+0000","last_change":"2024-01-22T05:08:02.015075+0000","last_active":"2024-01-22T05:08:02.015075+0000","last_peered":"2024-01-22T05:08:02.015075+0000","last_clean":"2024-01-22T05:08:02.015075+0000","last_became_active":"2024-01-22T05:08:02.014768+0000","last_became_peered":"2024-01-22T05:08:02.014768+0000","last_unstale":"2024-01-22T05:08:02.015075+0000","last_undegraded":"2024-01-22T05:08:02.015075+0000","last_fullsized":"2024-01-22T05:08:02.015075+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"55'3","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.011077+0000","last_change":"2024-01-22T05:08:01.557413+0000","last_active":"2024-01-22T05:08:02.011077+0000","last_peered":"2024-01-22T05:08:02.011077+0000","last_clean":"2024-01-22T05:08:02.011077+0000","last_became_active":"2024-01-22T05:08:01.556997+0000","last_became_peered":"2024-01-22T05:08:01.556997+0000","last_unstale":"2024-01-22T05:08:02.011077+0000","last_undegraded":"2024-01-22T05:08:02.011077+0000","last_fullsized":"2024-01-22T05:08:02.011077+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.007915+0000","last_change":"2024-01-22T05:08:02.007915+0000","last_active":"2024-01-22T05:08:02.007915+0000","last_peered":"2024-01-22T05:08:02.007915+0000","last_clean":"2024-01-22T05:08:02.007915+0000","last_became_active":"2024-01-22T05:08:02.007515+0000","last_became_peered":"2024-01-22T05:08:02.007515+0000","last_unstale":"2024-01-22T05:08:02.007915+0000","last_undegraded":"2024-01-22T05:08:02.007915+0000","last_fullsized":"2024-01-22T05:08:02.007915+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.567426+0000","last_change":"2024-01-22T05:08:01.563248+0000","last_active":"2024-01-22T05:08:01.567426+0000","last_peered":"2024-01-22T05:08:01.567426+0000","last_clean":"2024-01-22T05:08:01.567426+0000","last_became_active":"2024-01-22T05:08:01.562943+0000","last_became_peered":"2024-01-22T05:08:01.562943+0000","last_unstale":"2024-01-22T05:08:01.567426+0000","last_undegraded":"2024-01-22T05:08:01.567426+0000","last_fullsized":"2024-01-22T05:08:01.567426+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.010949+0000","last_change":"2024-01-22T05:08:02.010949+0000","last_active":"2024-01-22T05:08:02.010949+0000","last_peered":"2024-01-22T05:08:02.010949+0000","last_clean":"2024-01-22T05:08:02.010949+0000","last_became_active":"2024-01-22T05:08:02.010516+0000","last_became_peered":"2024-01-22T05:08:02.010516+0000","last_unstale":"2024-01-22T05:08:02.010949+0000","last_undegraded":"2024-01-22T05:08:02.010949+0000","last_fullsized":"2024-01-22T05:08:02.010949+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.586504+0000","last_change":"2024-01-22T05:08:01.576352+0000","last_active":"2024-01-22T05:08:01.586504+0000","last_peered":"2024-01-22T05:08:01.586504+0000","last_clean":"2024-01-22T05:08:01.586504+0000","last_became_active":"2024-01-22T05:08:01.575752+0000","last_became_peered":"2024-01-22T05:08:01.575752+0000","last_unstale":"2024-01-22T05:08:01.586504+0000","last_undegraded":"2024-01-22T05:08:01.586504+0000","last_fullsized":"2024-01-22T05:08:01.586504+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.005405+0000","last_change":"2024-01-22T05:08:02.005405+0000","last_active":"2024-01-22T05:08:02.005405+0000","last_peered":"2024-01-22T05:08:02.005405+0000","last_clean":"2024-01-22T05:08:02.005405+0000","last_became_active":"2024-01-22T05:08:02.005009+0000","last_became_peered":"2024-01-22T05:08:02.005009+0000","last_unstale":"2024-01-22T05:08:02.005405+0000","last_undegraded":"2024-01-22T05:08:02.005405+0000","last_fullsized":"2024-01-22T05:08:02.005405+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3c","version":"55'2","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.021907+0000","last_change":"2024-01-22T05:08:01.578386+0000","last_active":"2024-01-22T05:08:02.021907+0000","last_peered":"2024-01-22T05:08:02.021907+0000","last_clean":"2024-01-22T05:08:02.021907+0000","last_became_active":"2024-01-22T05:08:01.578131+0000","last_became_peered":"2024-01-22T05:08:01.578131+0000","last_unstale":"2024-01-22T05:08:02.021907+0000","last_undegraded":"2024-01-22T05:08:02.021907+0000","last_fullsized":"2024-01-22T05:08:02.021907+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.997313+0000","last_change":"2024-01-22T05:08:01.997313+0000","last_active":"2024-01-22T05:08:01.997313+0000","last_peered":"2024-01-22T05:08:01.997313+0000","last_clean":"2024-01-22T05:08:01.997313+0000","last_became_active":"2024-01-22T05:08:01.997096+0000","last_became_peered":"2024-01-22T05:08:01.997096+0000","last_unstale":"2024-01-22T05:08:01.997313+0000","last_undegraded":"2024-01-22T05:08:01.997313+0000","last_fullsized":"2024-01-22T05:08:01.997313+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.996156+0000","last_change":"2024-01-22T05:08:01.561776+0000","last_active":"2024-01-22T05:08:01.996156+0000","last_peered":"2024-01-22T05:08:01.996156+0000","last_clean":"2024-01-22T05:08:01.996156+0000","last_became_active":"2024-01-22T05:08:01.561557+0000","last_became_peered":"2024-01-22T05:08:01.561557+0000","last_unstale":"2024-01-22T05:08:01.996156+0000","last_undegraded":"2024-01-22T05:08:01.996156+0000","last_fullsized":"2024-01-22T05:08:01.996156+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.007790+0000","last_change":"2024-01-22T05:08:02.007790+0000","last_active":"2024-01-22T05:08:02.007790+0000","last_peered":"2024-01-22T05:08:02.007790+0000","last_clean":"2024-01-22T05:08:02.007790+0000","last_became_active":"2024-01-22T05:08:02.007427+0000","last_became_peered":"2024-01-22T05:08:02.007427+0000","last_unstale":"2024-01-22T05:08:02.007790+0000","last_undegraded":"2024-01-22T05:08:02.007790+0000","last_fullsized":"2024-01-22T05:08:02.007790+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.988462+0000","last_change":"2024-01-22T05:08:01.564406+0000","last_active":"2024-01-22T05:08:01.988462+0000","last_peered":"2024-01-22T05:08:01.988462+0000","last_clean":"2024-01-22T05:08:01.988462+0000","last_became_active":"2024-01-22T05:08:01.564116+0000","last_became_peered":"2024-01-22T05:08:01.564116+0000","last_unstale":"2024-01-22T05:08:01.988462+0000","last_undegraded":"2024-01-22T05:08:01.988462+0000","last_fullsized":"2024-01-22T05:08:01.988462+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.003703+0000","last_change":"2024-01-22T05:08:02.003703+0000","last_active":"2024-01-22T05:08:02.003703+0000","last_peered":"2024-01-22T05:08:02.003703+0000","last_clean":"2024-01-22T05:08:02.003703+0000","last_became_active":"2024-01-22T05:08:02.003384+0000","last_became_peered":"2024-01-22T05:08:02.003384+0000","last_unstale":"2024-01-22T05:08:02.003703+0000","last_undegraded":"2024-01-22T05:08:02.003703+0000","last_fullsized":"2024-01-22T05:08:02.003703+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.586314+0000","last_change":"2024-01-22T05:08:01.578974+0000","last_active":"2024-01-22T05:08:01.586314+0000","last_peered":"2024-01-22T05:08:01.586314+0000","last_clean":"2024-01-22T05:08:01.586314+0000","last_became_active":"2024-01-22T05:08:01.578535+0000","last_became_peered":"2024-01-22T05:08:01.578535+0000","last_unstale":"2024-01-22T05:08:01.586314+0000","last_undegraded":"2024-01-22T05:08:01.586314+0000","last_fullsized":"2024-01-22T05:08:01.586314+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.002122+0000","last_change":"2024-01-22T05:08:02.002122+0000","last_active":"2024-01-22T05:08:02.002122+0000","last_peered":"2024-01-22T05:08:02.002122+0000","last_clean":"2024-01-22T05:08:02.002122+0000","last_became_active":"2024-01-22T05:08:02.001796+0000","last_became_peered":"2024-01-22T05:08:02.001796+0000","last_unstale":"2024-01-22T05:08:02.002122+0000","last_undegraded":"2024-01-22T05:08:02.002122+0000","last_fullsized":"2024-01-22T05:08:02.002122+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.566705+0000","last_change":"2024-01-22T05:08:01.554224+0000","last_active":"2024-01-22T05:08:01.566705+0000","last_peered":"2024-01-22T05:08:01.566705+0000","last_clean":"2024-01-22T05:08:01.566705+0000","last_became_active":"2024-01-22T05:08:01.553943+0000","last_became_peered":"2024-01-22T05:08:01.553943+0000","last_unstale":"2024-01-22T05:08:01.566705+0000","last_undegraded":"2024-01-22T05:08:01.566705+0000","last_fullsized":"2024-01-22T05:08:01.566705+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.011921+0000","last_change":"2024-01-22T05:08:02.011921+0000","last_active":"2024-01-22T05:08:02.011921+0000","last_peered":"2024-01-22T05:08:02.011921+0000","last_clean":"2024-01-22T05:08:02.011921+0000","last_became_active":"2024-01-22T05:08:02.011766+0000","last_became_peered":"2024-01-22T05:08:02.011766+0000","last_unstale":"2024-01-22T05:08:02.011921+0000","last_undegraded":"2024-01-22T05:08:02.011921+0000","last_fullsized":"2024-01-22T05:08:02.011921+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.586666+0000","last_change":"2024-01-22T05:08:01.584904+0000","last_active":"2024-01-22T05:08:01.586666+0000","last_peered":"2024-01-22T05:08:01.586666+0000","last_clean":"2024-01-22T05:08:01.586666+0000","last_became_active":"2024-01-22T05:08:01.584390+0000","last_became_peered":"2024-01-22T05:08:01.584390+0000","last_unstale":"2024-01-22T05:08:01.586666+0000","last_undegraded":"2024-01-22T05:08:01.586666+0000","last_fullsized":"2024-01-22T05:08:01.586666+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.008705+0000","last_change":"2024-01-22T05:08:02.008705+0000","last_active":"2024-01-22T05:08:02.008705+0000","last_peered":"2024-01-22T05:08:02.008705+0000","last_clean":"2024-01-22T05:08:02.008705+0000","last_became_active":"2024-01-22T05:08:02.007039+0000","last_became_peered":"2024-01-22T05:08:02.007039+0000","last_unstale":"2024-01-22T05:08:02.008705+0000","last_undegraded":"2024-01-22T05:08:02.008705+0000","last_fullsized":"2024-01-22T05:08:02.008705+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.559217+0000","last_change":"2024-01-22T05:08:01.554362+0000","last_active":"2024-01-22T05:08:01.559217+0000","last_peered":"2024-01-22T05:08:01.559217+0000","last_clean":"2024-01-22T05:08:01.559217+0000","last_became_active":"2024-01-22T05:08:01.554104+0000","last_became_peered":"2024-01-22T05:08:01.554104+0000","last_unstale":"2024-01-22T05:08:01.559217+0000","last_undegraded":"2024-01-22T05:08:01.559217+0000","last_fullsized":"2024-01-22T05:08:01.559217+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.995300+0000","last_change":"2024-01-22T05:08:01.995300+0000","last_active":"2024-01-22T05:08:01.995300+0000","last_peered":"2024-01-22T05:08:01.995300+0000","last_clean":"2024-01-22T05:08:01.995300+0000","last_became_active":"2024-01-22T05:08:01.995020+0000","last_became_peered":"2024-01-22T05:08:01.995020+0000","last_unstale":"2024-01-22T05:08:01.995300+0000","last_undegraded":"2024-01-22T05:08:01.995300+0000","last_fullsized":"2024-01-22T05:08:01.995300+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.572829+0000","last_change":"2024-01-22T05:08:01.568300+0000","last_active":"2024-01-22T05:08:01.572829+0000","last_peered":"2024-01-22T05:08:01.572829+0000","last_clean":"2024-01-22T05:08:01.572829+0000","last_became_active":"2024-01-22T05:08:01.567984+0000","last_became_peered":"2024-01-22T05:08:01.567984+0000","last_unstale":"2024-01-22T05:08:01.572829+0000","last_undegraded":"2024-01-22T05:08:01.572829+0000","last_fullsized":"2024-01-22T05:08:01.572829+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.010302+0000","last_change":"2024-01-22T05:08:02.010302+0000","last_active":"2024-01-22T05:08:02.010302+0000","last_peered":"2024-01-22T05:08:02.010302+0000","last_clean":"2024-01-22T05:08:02.010302+0000","last_became_active":"2024-01-22T05:08:02.010048+0000","last_became_peered":"2024-01-22T05:08:02.010048+0000","last_unstale":"2024-01-22T05:08:02.010302+0000","last_undegraded":"2024-01-22T05:08:02.010302+0000","last_fullsized":"2024-01-22T05:08:02.010302+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.34","version":"55'4","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.019902+0000","last_change":"2024-01-22T05:08:01.561892+0000","last_active":"2024-01-22T05:08:02.019902+0000","last_peered":"2024-01-22T05:08:02.019902+0000","last_clean":"2024-01-22T05:08:02.019902+0000","last_became_active":"2024-01-22T05:08:01.561578+0000","last_became_peered":"2024-01-22T05:08:01.561578+0000","last_unstale":"2024-01-22T05:08:02.019902+0000","last_undegraded":"2024-01-22T05:08:02.019902+0000","last_fullsized":"2024-01-22T05:08:02.019902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.005871+0000","last_change":"2024-01-22T05:08:02.005871+0000","last_active":"2024-01-22T05:08:02.005871+0000","last_peered":"2024-01-22T05:08:02.005871+0000","last_clean":"2024-01-22T05:08:02.005871+0000","last_became_active":"2024-01-22T05:08:02.005534+0000","last_became_peered":"2024-01-22T05:08:02.005534+0000","last_unstale":"2024-01-22T05:08:02.005871+0000","last_undegraded":"2024-01-22T05:08:02.005871+0000","last_fullsized":"2024-01-22T05:08:02.005871+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.987144+0000","last_change":"2024-01-22T05:08:01.553847+0000","last_active":"2024-01-22T05:08:01.987144+0000","last_peered":"2024-01-22T05:08:01.987144+0000","last_clean":"2024-01-22T05:08:01.987144+0000","last_became_active":"2024-01-22T05:08:01.553502+0000","last_became_peered":"2024-01-22T05:08:01.553502+0000","last_unstale":"2024-01-22T05:08:01.987144+0000","last_undegraded":"2024-01-22T05:08:01.987144+0000","last_fullsized":"2024-01-22T05:08:01.987144+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.008496+0000","last_change":"2024-01-22T05:08:02.008496+0000","last_active":"2024-01-22T05:08:02.008496+0000","last_peered":"2024-01-22T05:08:02.008496+0000","last_clean":"2024-01-22T05:08:02.008496+0000","last_became_active":"2024-01-22T05:08:02.008186+0000","last_became_peered":"2024-01-22T05:08:02.008186+0000","last_unstale":"2024-01-22T05:08:02.008496+0000","last_undegraded":"2024-01-22T05:08:02.008496+0000","last_fullsized":"2024-01-22T05:08:02.008496+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.585809+0000","last_change":"2024-01-22T05:08:01.575074+0000","last_active":"2024-01-22T05:08:01.585809+0000","last_peered":"2024-01-22T05:08:01.585809+0000","last_clean":"2024-01-22T05:08:01.585809+0000","last_became_active":"2024-01-22T05:08:01.574796+0000","last_became_peered":"2024-01-22T05:08:01.574796+0000","last_unstale":"2024-01-22T05:08:01.585809+0000","last_undegraded":"2024-01-22T05:08:01.585809+0000","last_fullsized":"2024-01-22T05:08:01.585809+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.016497+0000","last_change":"2024-01-22T05:08:02.016497+0000","last_active":"2024-01-22T05:08:02.016497+0000","last_peered":"2024-01-22T05:08:02.016497+0000","last_clean":"2024-01-22T05:08:02.016497+0000","last_became_active":"2024-01-22T05:08:02.016201+0000","last_became_peered":"2024-01-22T05:08:02.016201+0000","last_unstale":"2024-01-22T05:08:02.016497+0000","last_undegraded":"2024-01-22T05:08:02.016497+0000","last_fullsized":"2024-01-22T05:08:02.016497+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.562356+0000","last_change":"2024-01-22T05:08:01.560328+0000","last_active":"2024-01-22T05:08:01.562356+0000","last_peered":"2024-01-22T05:08:01.562356+0000","last_clean":"2024-01-22T05:08:01.562356+0000","last_became_active":"2024-01-22T05:08:01.560104+0000","last_became_peered":"2024-01-22T05:08:01.560104+0000","last_unstale":"2024-01-22T05:08:01.562356+0000","last_undegraded":"2024-01-22T05:08:01.562356+0000","last_fullsized":"2024-01-22T05:08:01.562356+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.012274+0000","last_change":"2024-01-22T05:08:02.012274+0000","last_active":"2024-01-22T05:08:02.012274+0000","last_peered":"2024-01-22T05:08:02.012274+0000","last_clean":"2024-01-22T05:08:02.012274+0000","last_became_active":"2024-01-22T05:08:02.011983+0000","last_became_peered":"2024-01-22T05:08:02.011983+0000","last_unstale":"2024-01-22T05:08:02.012274+0000","last_undegraded":"2024-01-22T05:08:02.012274+0000","last_fullsized":"2024-01-22T05:08:02.012274+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.30","version":"55'4","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.010895+0000","last_change":"2024-01-22T05:08:01.553855+0000","last_active":"2024-01-22T05:08:02.010895+0000","last_peered":"2024-01-22T05:08:02.010895+0000","last_clean":"2024-01-22T05:08:02.010895+0000","last_became_active":"2024-01-22T05:08:01.553522+0000","last_became_peered":"2024-01-22T05:08:01.553522+0000","last_unstale":"2024-01-22T05:08:02.010895+0000","last_undegraded":"2024-01-22T05:08:02.010895+0000","last_fullsized":"2024-01-22T05:08:02.010895+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.988338+0000","last_change":"2024-01-22T05:08:01.988338+0000","last_active":"2024-01-22T05:08:01.988338+0000","last_peered":"2024-01-22T05:08:01.988338+0000","last_clean":"2024-01-22T05:08:01.988338+0000","last_became_active":"2024-01-22T05:08:01.988031+0000","last_became_peered":"2024-01-22T05:08:01.988031+0000","last_unstale":"2024-01-22T05:08:01.988338+0000","last_undegraded":"2024-01-22T05:08:01.988338+0000","last_fullsized":"2024-01-22T05:08:01.988338+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.588024+0000","last_change":"2024-01-22T05:08:01.583333+0000","last_active":"2024-01-22T05:08:01.588024+0000","last_peered":"2024-01-22T05:08:01.588024+0000","last_clean":"2024-01-22T05:08:01.588024+0000","last_became_active":"2024-01-22T05:08:01.582877+0000","last_became_peered":"2024-01-22T05:08:01.582877+0000","last_unstale":"2024-01-22T05:08:01.588024+0000","last_undegraded":"2024-01-22T05:08:01.588024+0000","last_fullsized":"2024-01-22T05:08:01.588024+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.015767+0000","last_change":"2024-01-22T05:08:02.015767+0000","last_active":"2024-01-22T05:08:02.015767+0000","last_peered":"2024-01-22T05:08:02.015767+0000","last_clean":"2024-01-22T05:08:02.015767+0000","last_became_active":"2024-01-22T05:08:02.015486+0000","last_became_peered":"2024-01-22T05:08:02.015486+0000","last_unstale":"2024-01-22T05:08:02.015767+0000","last_undegraded":"2024-01-22T05:08:02.015767+0000","last_fullsized":"2024-01-22T05:08:02.015767+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.568240+0000","last_change":"2024-01-22T05:08:01.564784+0000","last_active":"2024-01-22T05:08:01.568240+0000","last_peered":"2024-01-22T05:08:01.568240+0000","last_clean":"2024-01-22T05:08:01.568240+0000","last_became_active":"2024-01-22T05:08:01.564488+0000","last_became_peered":"2024-01-22T05:08:01.564488+0000","last_unstale":"2024-01-22T05:08:01.568240+0000","last_undegraded":"2024-01-22T05:08:01.568240+0000","last_fullsized":"2024-01-22T05:08:01.568240+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.997278+0000","last_change":"2024-01-22T05:08:01.997278+0000","last_active":"2024-01-22T05:08:01.997278+0000","last_peered":"2024-01-22T05:08:01.997278+0000","last_clean":"2024-01-22T05:08:01.997278+0000","last_became_active":"2024-01-22T05:08:01.997002+0000","last_became_peered":"2024-01-22T05:08:01.997002+0000","last_unstale":"2024-01-22T05:08:01.997278+0000","last_undegraded":"2024-01-22T05:08:01.997278+0000","last_fullsized":"2024-01-22T05:08:01.997278+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2d","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.985085+0000","last_change":"2024-01-22T05:08:01.574561+0000","last_active":"2024-01-22T05:08:01.985085+0000","last_peered":"2024-01-22T05:08:01.985085+0000","last_clean":"2024-01-22T05:08:01.985085+0000","last_became_active":"2024-01-22T05:08:01.574279+0000","last_became_peered":"2024-01-22T05:08:01.574279+0000","last_unstale":"2024-01-22T05:08:01.985085+0000","last_undegraded":"2024-01-22T05:08:01.985085+0000","last_fullsized":"2024-01-22T05:08:01.985085+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.009310+0000","last_change":"2024-01-22T05:08:02.009310+0000","last_active":"2024-01-22T05:08:02.009310+0000","last_peered":"2024-01-22T05:08:02.009310+0000","last_clean":"2024-01-22T05:08:02.009310+0000","last_became_active":"2024-01-22T05:08:02.009050+0000","last_became_peered":"2024-01-22T05:08:02.009050+0000","last_unstale":"2024-01-22T05:08:02.009310+0000","last_undegraded":"2024-01-22T05:08:02.009310+0000","last_fullsized":"2024-01-22T05:08:02.009310+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.557885+0000","last_change":"2024-01-22T05:08:01.554421+0000","last_active":"2024-01-22T05:08:01.557885+0000","last_peered":"2024-01-22T05:08:01.557885+0000","last_clean":"2024-01-22T05:08:01.557885+0000","last_became_active":"2024-01-22T05:08:01.554133+0000","last_became_peered":"2024-01-22T05:08:01.554133+0000","last_unstale":"2024-01-22T05:08:01.557885+0000","last_undegraded":"2024-01-22T05:08:01.557885+0000","last_fullsized":"2024-01-22T05:08:01.557885+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.010162+0000","last_change":"2024-01-22T05:08:02.010162+0000","last_active":"2024-01-22T05:08:02.010162+0000","last_peered":"2024-01-22T05:08:02.010162+0000","last_clean":"2024-01-22T05:08:02.010162+0000","last_became_active":"2024-01-22T05:08:02.009495+0000","last_became_peered":"2024-01-22T05:08:02.009495+0000","last_unstale":"2024-01-22T05:08:02.010162+0000","last_undegraded":"2024-01-22T05:08:02.010162+0000","last_fullsized":"2024-01-22T05:08:02.010162+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2b","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.999826+0000","last_change":"2024-01-22T05:08:01.559940+0000","last_active":"2024-01-22T05:08:01.999826+0000","last_peered":"2024-01-22T05:08:01.999826+0000","last_clean":"2024-01-22T05:08:01.999826+0000","last_became_active":"2024-01-22T05:08:01.559271+0000","last_became_peered":"2024-01-22T05:08:01.559271+0000","last_unstale":"2024-01-22T05:08:01.999826+0000","last_undegraded":"2024-01-22T05:08:01.999826+0000","last_fullsized":"2024-01-22T05:08:01.999826+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.991247+0000","last_change":"2024-01-22T05:08:01.991247+0000","last_active":"2024-01-22T05:08:01.991247+0000","last_peered":"2024-01-22T05:08:01.991247+0000","last_clean":"2024-01-22T05:08:01.991247+0000","last_became_active":"2024-01-22T05:08:01.990879+0000","last_became_peered":"2024-01-22T05:08:01.990879+0000","last_unstale":"2024-01-22T05:08:01.991247+0000","last_undegraded":"2024-01-22T05:08:01.991247+0000","last_fullsized":"2024-01-22T05:08:01.991247+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.578339+0000","last_change":"2024-01-22T05:08:01.572277+0000","last_active":"2024-01-22T05:08:01.578339+0000","last_peered":"2024-01-22T05:08:01.578339+0000","last_clean":"2024-01-22T05:08:01.578339+0000","last_became_active":"2024-01-22T05:08:01.571997+0000","last_became_peered":"2024-01-22T05:08:01.571997+0000","last_unstale":"2024-01-22T05:08:01.578339+0000","last_undegraded":"2024-01-22T05:08:01.578339+0000","last_fullsized":"2024-01-22T05:08:01.578339+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.011365+0000","last_change":"2024-01-22T05:08:02.011365+0000","last_active":"2024-01-22T05:08:02.011365+0000","last_peered":"2024-01-22T05:08:02.011365+0000","last_clean":"2024-01-22T05:08:02.011365+0000","last_became_active":"2024-01-22T05:08:02.010700+0000","last_became_peered":"2024-01-22T05:08:02.010700+0000","last_unstale":"2024-01-22T05:08:02.011365+0000","last_undegraded":"2024-01-22T05:08:02.011365+0000","last_fullsized":"2024-01-22T05:08:02.011365+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.573234+0000","last_change":"2024-01-22T05:08:01.564311+0000","last_active":"2024-01-22T05:08:01.573234+0000","last_peered":"2024-01-22T05:08:01.573234+0000","last_clean":"2024-01-22T05:08:01.573234+0000","last_became_active":"2024-01-22T05:08:01.564015+0000","last_became_peered":"2024-01-22T05:08:01.564015+0000","last_unstale":"2024-01-22T05:08:01.573234+0000","last_undegraded":"2024-01-22T05:08:01.573234+0000","last_fullsized":"2024-01-22T05:08:01.573234+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.012775+0000","last_change":"2024-01-22T05:08:02.012775+0000","last_active":"2024-01-22T05:08:02.012775+0000","last_peered":"2024-01-22T05:08:02.012775+0000","last_clean":"2024-01-22T05:08:02.012775+0000","last_became_active":"2024-01-22T05:08:02.012492+0000","last_became_peered":"2024-01-22T05:08:02.012492+0000","last_unstale":"2024-01-22T05:08:02.012775+0000","last_undegraded":"2024-01-22T05:08:02.012775+0000","last_fullsized":"2024-01-22T05:08:02.012775+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.586236+0000","last_change":"2024-01-22T05:08:01.573358+0000","last_active":"2024-01-22T05:08:01.586236+0000","last_peered":"2024-01-22T05:08:01.586236+0000","last_clean":"2024-01-22T05:08:01.586236+0000","last_became_active":"2024-01-22T05:08:01.573075+0000","last_became_peered":"2024-01-22T05:08:01.573075+0000","last_unstale":"2024-01-22T05:08:01.586236+0000","last_undegraded":"2024-01-22T05:08:01.586236+0000","last_fullsized":"2024-01-22T05:08:01.586236+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.001699+0000","last_change":"2024-01-22T05:08:02.001699+0000","last_active":"2024-01-22T05:08:02.001699+0000","last_peered":"2024-01-22T05:08:02.001699+0000","last_clean":"2024-01-22T05:08:02.001699+0000","last_became_active":"2024-01-22T05:08:02.001295+0000","last_became_peered":"2024-01-22T05:08:02.001295+0000","last_unstale":"2024-01-22T05:08:02.001699+0000","last_undegraded":"2024-01-22T05:08:02.001699+0000","last_fullsized":"2024-01-22T05:08:02.001699+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.588035+0000","last_change":"2024-01-22T05:08:01.583829+0000","last_active":"2024-01-22T05:08:01.588035+0000","last_peered":"2024-01-22T05:08:01.588035+0000","last_clean":"2024-01-22T05:08:01.588035+0000","last_became_active":"2024-01-22T05:08:01.583544+0000","last_became_peered":"2024-01-22T05:08:01.583544+0000","last_unstale":"2024-01-22T05:08:01.588035+0000","last_undegraded":"2024-01-22T05:08:01.588035+0000","last_fullsized":"2024-01-22T05:08:01.588035+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.010355+0000","last_change":"2024-01-22T05:08:02.010355+0000","last_active":"2024-01-22T05:08:02.010355+0000","last_peered":"2024-01-22T05:08:02.010355+0000","last_clean":"2024-01-22T05:08:02.010355+0000","last_became_active":"2024-01-22T05:08:02.010083+0000","last_became_peered":"2024-01-22T05:08:02.010083+0000","last_unstale":"2024-01-22T05:08:02.010355+0000","last_undegraded":"2024-01-22T05:08:02.010355+0000","last_fullsized":"2024-01-22T05:08:02.010355+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.581874+0000","last_change":"2024-01-22T05:08:01.579230+0000","last_active":"2024-01-22T05:08:01.581874+0000","last_peered":"2024-01-22T05:08:01.581874+0000","last_clean":"2024-01-22T05:08:01.581874+0000","last_became_active":"2024-01-22T05:08:01.577691+0000","last_became_peered":"2024-01-22T05:08:01.577691+0000","last_unstale":"2024-01-22T05:08:01.581874+0000","last_undegraded":"2024-01-22T05:08:01.581874+0000","last_fullsized":"2024-01-22T05:08:01.581874+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.006569+0000","last_change":"2024-01-22T05:08:02.006569+0000","last_active":"2024-01-22T05:08:02.006569+0000","last_peered":"2024-01-22T05:08:02.006569+0000","last_clean":"2024-01-22T05:08:02.006569+0000","last_became_active":"2024-01-22T05:08:02.006231+0000","last_became_peered":"2024-01-22T05:08:02.006231+0000","last_unstale":"2024-01-22T05:08:02.006569+0000","last_undegraded":"2024-01-22T05:08:02.006569+0000","last_fullsized":"2024-01-22T05:08:02.006569+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.582390+0000","last_change":"2024-01-22T05:08:01.581865+0000","last_active":"2024-01-22T05:08:01.582390+0000","last_peered":"2024-01-22T05:08:01.582390+0000","last_clean":"2024-01-22T05:08:01.582390+0000","last_became_active":"2024-01-22T05:08:01.577764+0000","last_became_peered":"2024-01-22T05:08:01.577764+0000","last_unstale":"2024-01-22T05:08:01.582390+0000","last_undegraded":"2024-01-22T05:08:01.582390+0000","last_fullsized":"2024-01-22T05:08:01.582390+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.012327+0000","last_change":"2024-01-22T05:08:02.012327+0000","last_active":"2024-01-22T05:08:02.012327+0000","last_peered":"2024-01-22T05:08:02.012327+0000","last_clean":"2024-01-22T05:08:02.012327+0000","last_became_active":"2024-01-22T05:08:02.012035+0000","last_became_peered":"2024-01-22T05:08:02.012035+0000","last_unstale":"2024-01-22T05:08:02.012327+0000","last_undegraded":"2024-01-22T05:08:02.012327+0000","last_fullsized":"2024-01-22T05:08:02.012327+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.567448+0000","last_change":"2024-01-22T05:08:01.565824+0000","last_active":"2024-01-22T05:08:01.567448+0000","last_peered":"2024-01-22T05:08:01.567448+0000","last_clean":"2024-01-22T05:08:01.567448+0000","last_became_active":"2024-01-22T05:08:01.565059+0000","last_became_peered":"2024-01-22T05:08:01.565059+0000","last_unstale":"2024-01-22T05:08:01.567448+0000","last_undegraded":"2024-01-22T05:08:01.567448+0000","last_fullsized":"2024-01-22T05:08:01.567448+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.004153+0000","last_change":"2024-01-22T05:08:02.004153+0000","last_active":"2024-01-22T05:08:02.004153+0000","last_peered":"2024-01-22T05:08:02.004153+0000","last_clean":"2024-01-22T05:08:02.004153+0000","last_became_active":"2024-01-22T05:08:02.003866+0000","last_became_peered":"2024-01-22T05:08:02.003866+0000","last_unstale":"2024-01-22T05:08:02.004153+0000","last_undegraded":"2024-01-22T05:08:02.004153+0000","last_fullsized":"2024-01-22T05:08:02.004153+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.585240+0000","last_change":"2024-01-22T05:08:01.572006+0000","last_active":"2024-01-22T05:08:01.585240+0000","last_peered":"2024-01-22T05:08:01.585240+0000","last_clean":"2024-01-22T05:08:01.585240+0000","last_became_active":"2024-01-22T05:08:01.570171+0000","last_became_peered":"2024-01-22T05:08:01.570171+0000","last_unstale":"2024-01-22T05:08:01.585240+0000","last_undegraded":"2024-01-22T05:08:01.585240+0000","last_fullsized":"2024-01-22T05:08:01.585240+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.997223+0000","last_change":"2024-01-22T05:08:01.997223+0000","last_active":"2024-01-22T05:08:01.997223+0000","last_peered":"2024-01-22T05:08:01.997223+0000","last_clean":"2024-01-22T05:08:01.997223+0000","last_became_active":"2024-01-22T05:08:01.996952+0000","last_became_peered":"2024-01-22T05:08:01.996952+0000","last_unstale":"2024-01-22T05:08:01.997223+0000","last_undegraded":"2024-01-22T05:08:01.997223+0000","last_fullsized":"2024-01-22T05:08:01.997223+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.569013+0000","last_change":"2024-01-22T05:08:01.566331+0000","last_active":"2024-01-22T05:08:01.569013+0000","last_peered":"2024-01-22T05:08:01.569013+0000","last_clean":"2024-01-22T05:08:01.569013+0000","last_became_active":"2024-01-22T05:08:01.566063+0000","last_became_peered":"2024-01-22T05:08:01.566063+0000","last_unstale":"2024-01-22T05:08:01.569013+0000","last_undegraded":"2024-01-22T05:08:01.569013+0000","last_fullsized":"2024-01-22T05:08:01.569013+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.010032+0000","last_change":"2024-01-22T05:08:02.010032+0000","last_active":"2024-01-22T05:08:02.010032+0000","last_peered":"2024-01-22T05:08:02.010032+0000","last_clean":"2024-01-22T05:08:02.010032+0000","last_became_active":"2024-01-22T05:08:02.009715+0000","last_became_peered":"2024-01-22T05:08:02.009715+0000","last_unstale":"2024-01-22T05:08:02.010032+0000","last_undegraded":"2024-01-22T05:08:02.010032+0000","last_fullsized":"2024-01-22T05:08:02.010032+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.586297+0000","last_change":"2024-01-22T05:08:01.578798+0000","last_active":"2024-01-22T05:08:01.586297+0000","last_peered":"2024-01-22T05:08:01.586297+0000","last_clean":"2024-01-22T05:08:01.586297+0000","last_became_active":"2024-01-22T05:08:01.578175+0000","last_became_peered":"2024-01-22T05:08:01.578175+0000","last_unstale":"2024-01-22T05:08:01.586297+0000","last_undegraded":"2024-01-22T05:08:01.586297+0000","last_fullsized":"2024-01-22T05:08:01.586297+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.014727+0000","last_change":"2024-01-22T05:08:02.014727+0000","last_active":"2024-01-22T05:08:02.014727+0000","last_peered":"2024-01-22T05:08:02.014727+0000","last_clean":"2024-01-22T05:08:02.014727+0000","last_became_active":"2024-01-22T05:08:02.014436+0000","last_became_peered":"2024-01-22T05:08:02.014436+0000","last_unstale":"2024-01-22T05:08:02.014727+0000","last_undegraded":"2024-01-22T05:08:02.014727+0000","last_fullsized":"2024-01-22T05:08:02.014727+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.571019+0000","last_change":"2024-01-22T05:08:01.569649+0000","last_active":"2024-01-22T05:08:01.571019+0000","last_peered":"2024-01-22T05:08:01.571019+0000","last_clean":"2024-01-22T05:08:01.571019+0000","last_became_active":"2024-01-22T05:08:01.569363+0000","last_became_peered":"2024-01-22T05:08:01.569363+0000","last_unstale":"2024-01-22T05:08:01.571019+0000","last_undegraded":"2024-01-22T05:08:01.571019+0000","last_fullsized":"2024-01-22T05:08:01.571019+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.993643+0000","last_change":"2024-01-22T05:08:01.993643+0000","last_active":"2024-01-22T05:08:01.993643+0000","last_peered":"2024-01-22T05:08:01.993643+0000","last_clean":"2024-01-22T05:08:01.993643+0000","last_became_active":"2024-01-22T05:08:01.993364+0000","last_became_peered":"2024-01-22T05:08:01.993364+0000","last_unstale":"2024-01-22T05:08:01.993643+0000","last_undegraded":"2024-01-22T05:08:01.993643+0000","last_fullsized":"2024-01-22T05:08:01.993643+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.983173+0000","last_change":"2024-01-22T05:08:01.583213+0000","last_active":"2024-01-22T05:08:01.983173+0000","last_peered":"2024-01-22T05:08:01.983173+0000","last_clean":"2024-01-22T05:08:01.983173+0000","last_became_active":"2024-01-22T05:08:01.582545+0000","last_became_peered":"2024-01-22T05:08:01.582545+0000","last_unstale":"2024-01-22T05:08:01.983173+0000","last_undegraded":"2024-01-22T05:08:01.983173+0000","last_fullsized":"2024-01-22T05:08:01.983173+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.004236+0000","last_change":"2024-01-22T05:08:02.004236+0000","last_active":"2024-01-22T05:08:02.004236+0000","last_peered":"2024-01-22T05:08:02.004236+0000","last_clean":"2024-01-22T05:08:02.004236+0000","last_became_active":"2024-01-22T05:08:02.003983+0000","last_became_peered":"2024-01-22T05:08:02.003983+0000","last_unstale":"2024-01-22T05:08:02.004236+0000","last_undegraded":"2024-01-22T05:08:02.004236+0000","last_fullsized":"2024-01-22T05:08:02.004236+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.997357+0000","last_change":"2024-01-22T05:08:01.565799+0000","last_active":"2024-01-22T05:08:01.997357+0000","last_peered":"2024-01-22T05:08:01.997357+0000","last_clean":"2024-01-22T05:08:01.997357+0000","last_became_active":"2024-01-22T05:08:01.565436+0000","last_became_peered":"2024-01-22T05:08:01.565436+0000","last_unstale":"2024-01-22T05:08:01.997357+0000","last_undegraded":"2024-01-22T05:08:01.997357+0000","last_fullsized":"2024-01-22T05:08:01.997357+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.015486+0000","last_change":"2024-01-22T05:08:02.015486+0000","last_active":"2024-01-22T05:08:02.015486+0000","last_peered":"2024-01-22T05:08:02.015486+0000","last_clean":"2024-01-22T05:08:02.015486+0000","last_became_active":"2024-01-22T05:08:02.015230+0000","last_became_peered":"2024-01-22T05:08:02.015230+0000","last_unstale":"2024-01-22T05:08:02.015486+0000","last_undegraded":"2024-01-22T05:08:02.015486+0000","last_fullsized":"2024-01-22T05:08:02.015486+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"55'2","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.013306+0000","last_change":"2024-01-22T05:08:01.576018+0000","last_active":"2024-01-22T05:08:02.013306+0000","last_peered":"2024-01-22T05:08:02.013306+0000","last_clean":"2024-01-22T05:08:02.013306+0000","last_became_active":"2024-01-22T05:08:01.574716+0000","last_became_peered":"2024-01-22T05:08:01.574716+0000","last_unstale":"2024-01-22T05:08:02.013306+0000","last_undegraded":"2024-01-22T05:08:02.013306+0000","last_fullsized":"2024-01-22T05:08:02.013306+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.996434+0000","last_change":"2024-01-22T05:08:01.996434+0000","last_active":"2024-01-22T05:08:01.996434+0000","last_peered":"2024-01-22T05:08:01.996434+0000","last_clean":"2024-01-22T05:08:01.996434+0000","last_became_active":"2024-01-22T05:08:01.996092+0000","last_became_peered":"2024-01-22T05:08:01.996092+0000","last_unstale":"2024-01-22T05:08:01.996434+0000","last_undegraded":"2024-01-22T05:08:01.996434+0000","last_fullsized":"2024-01-22T05:08:01.996434+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.563045+0000","last_change":"2024-01-22T05:08:01.561290+0000","last_active":"2024-01-22T05:08:01.563045+0000","last_peered":"2024-01-22T05:08:01.563045+0000","last_clean":"2024-01-22T05:08:01.563045+0000","last_became_active":"2024-01-22T05:08:01.559607+0000","last_became_peered":"2024-01-22T05:08:01.559607+0000","last_unstale":"2024-01-22T05:08:01.563045+0000","last_undegraded":"2024-01-22T05:08:01.563045+0000","last_fullsized":"2024-01-22T05:08:01.563045+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.009773+0000","last_change":"2024-01-22T05:08:02.009773+0000","last_active":"2024-01-22T05:08:02.009773+0000","last_peered":"2024-01-22T05:08:02.009773+0000","last_clean":"2024-01-22T05:08:02.009773+0000","last_became_active":"2024-01-22T05:08:02.009190+0000","last_became_peered":"2024-01-22T05:08:02.009190+0000","last_unstale":"2024-01-22T05:08:02.009773+0000","last_undegraded":"2024-01-22T05:08:02.009773+0000","last_fullsized":"2024-01-22T05:08:02.009773+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.573161+0000","last_change":"2024-01-22T05:08:01.572280+0000","last_active":"2024-01-22T05:08:01.573161+0000","last_peered":"2024-01-22T05:08:01.573161+0000","last_clean":"2024-01-22T05:08:01.573161+0000","last_became_active":"2024-01-22T05:08:01.572033+0000","last_became_peered":"2024-01-22T05:08:01.572033+0000","last_unstale":"2024-01-22T05:08:01.573161+0000","last_undegraded":"2024-01-22T05:08:01.573161+0000","last_fullsized":"2024-01-22T05:08:01.573161+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.003275+0000","last_change":"2024-01-22T05:08:02.003275+0000","last_active":"2024-01-22T05:08:02.003275+0000","last_peered":"2024-01-22T05:08:02.003275+0000","last_clean":"2024-01-22T05:08:02.003275+0000","last_became_active":"2024-01-22T05:08:02.002969+0000","last_became_peered":"2024-01-22T05:08:02.002969+0000","last_unstale":"2024-01-22T05:08:02.003275+0000","last_undegraded":"2024-01-22T05:08:02.003275+0000","last_fullsized":"2024-01-22T05:08:02.003275+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.583837+0000","last_change":"2024-01-22T05:08:01.568411+0000","last_active":"2024-01-22T05:08:01.583837+0000","last_peered":"2024-01-22T05:08:01.583837+0000","last_clean":"2024-01-22T05:08:01.583837+0000","last_became_active":"2024-01-22T05:08:01.568123+0000","last_became_peered":"2024-01-22T05:08:01.568123+0000","last_unstale":"2024-01-22T05:08:01.583837+0000","last_undegraded":"2024-01-22T05:08:01.583837+0000","last_fullsized":"2024-01-22T05:08:01.583837+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.000933+0000","last_change":"2024-01-22T05:08:02.000933+0000","last_active":"2024-01-22T05:08:02.000933+0000","last_peered":"2024-01-22T05:08:02.000933+0000","last_clean":"2024-01-22T05:08:02.000933+0000","last_became_active":"2024-01-22T05:08:02.000622+0000","last_became_peered":"2024-01-22T05:08:02.000622+0000","last_unstale":"2024-01-22T05:08:02.000933+0000","last_undegraded":"2024-01-22T05:08:02.000933+0000","last_fullsized":"2024-01-22T05:08:02.000933+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.556276+0000","last_change":"2024-01-22T05:08:01.552549+0000","last_active":"2024-01-22T05:08:01.556276+0000","last_peered":"2024-01-22T05:08:01.556276+0000","last_clean":"2024-01-22T05:08:01.556276+0000","last_became_active":"2024-01-22T05:08:01.552204+0000","last_became_peered":"2024-01-22T05:08:01.552204+0000","last_unstale":"2024-01-22T05:08:01.556276+0000","last_undegraded":"2024-01-22T05:08:01.556276+0000","last_fullsized":"2024-01-22T05:08:01.556276+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.015982+0000","last_change":"2024-01-22T05:08:02.015982+0000","last_active":"2024-01-22T05:08:02.015982+0000","last_peered":"2024-01-22T05:08:02.015982+0000","last_clean":"2024-01-22T05:08:02.015982+0000","last_became_active":"2024-01-22T05:08:02.015688+0000","last_became_peered":"2024-01-22T05:08:02.015688+0000","last_unstale":"2024-01-22T05:08:02.015982+0000","last_undegraded":"2024-01-22T05:08:02.015982+0000","last_fullsized":"2024-01-22T05:08:02.015982+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.571033+0000","last_change":"2024-01-22T05:08:01.569840+0000","last_active":"2024-01-22T05:08:01.571033+0000","last_peered":"2024-01-22T05:08:01.571033+0000","last_clean":"2024-01-22T05:08:01.571033+0000","last_became_active":"2024-01-22T05:08:01.569516+0000","last_became_peered":"2024-01-22T05:08:01.569516+0000","last_unstale":"2024-01-22T05:08:01.571033+0000","last_undegraded":"2024-01-22T05:08:01.571033+0000","last_fullsized":"2024-01-22T05:08:01.571033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.019854+0000","last_change":"2024-01-22T05:08:02.019854+0000","last_active":"2024-01-22T05:08:02.019854+0000","last_peered":"2024-01-22T05:08:02.019854+0000","last_clean":"2024-01-22T05:08:02.019854+0000","last_became_active":"2024-01-22T05:08:02.019599+0000","last_became_peered":"2024-01-22T05:08:02.019599+0000","last_unstale":"2024-01-22T05:08:02.019854+0000","last_undegraded":"2024-01-22T05:08:02.019854+0000","last_fullsized":"2024-01-22T05:08:02.019854+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.587828+0000","last_change":"2024-01-22T05:08:01.586606+0000","last_active":"2024-01-22T05:08:01.587828+0000","last_peered":"2024-01-22T05:08:01.587828+0000","last_clean":"2024-01-22T05:08:01.587828+0000","last_became_active":"2024-01-22T05:08:01.586039+0000","last_became_peered":"2024-01-22T05:08:01.586039+0000","last_unstale":"2024-01-22T05:08:01.587828+0000","last_undegraded":"2024-01-22T05:08:01.587828+0000","last_fullsized":"2024-01-22T05:08:01.587828+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.014561+0000","last_change":"2024-01-22T05:08:02.014561+0000","last_active":"2024-01-22T05:08:02.014561+0000","last_peered":"2024-01-22T05:08:02.014561+0000","last_clean":"2024-01-22T05:08:02.014561+0000","last_became_active":"2024-01-22T05:08:02.014249+0000","last_became_peered":"2024-01-22T05:08:02.014249+0000","last_unstale":"2024-01-22T05:08:02.014561+0000","last_undegraded":"2024-01-22T05:08:02.014561+0000","last_fullsized":"2024-01-22T05:08:02.014561+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.583867+0000","last_change":"2024-01-22T05:08:01.577957+0000","last_active":"2024-01-22T05:08:01.583867+0000","last_peered":"2024-01-22T05:08:01.583867+0000","last_clean":"2024-01-22T05:08:01.583867+0000","last_became_active":"2024-01-22T05:08:01.577303+0000","last_became_peered":"2024-01-22T05:08:01.577303+0000","last_unstale":"2024-01-22T05:08:01.583867+0000","last_undegraded":"2024-01-22T05:08:01.583867+0000","last_fullsized":"2024-01-22T05:08:01.583867+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.012876+0000","last_change":"2024-01-22T05:08:02.012876+0000","last_active":"2024-01-22T05:08:02.012876+0000","last_peered":"2024-01-22T05:08:02.012876+0000","last_clean":"2024-01-22T05:08:02.012876+0000","last_became_active":"2024-01-22T05:08:02.012591+0000","last_became_peered":"2024-01-22T05:08:02.012591+0000","last_unstale":"2024-01-22T05:08:02.012876+0000","last_undegraded":"2024-01-22T05:08:02.012876+0000","last_fullsized":"2024-01-22T05:08:02.012876+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"55'3","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.019095+0000","last_change":"2024-01-22T05:08:01.575090+0000","last_active":"2024-01-22T05:08:02.019095+0000","last_peered":"2024-01-22T05:08:02.019095+0000","last_clean":"2024-01-22T05:08:02.019095+0000","last_became_active":"2024-01-22T05:08:01.574730+0000","last_became_peered":"2024-01-22T05:08:01.574730+0000","last_unstale":"2024-01-22T05:08:02.019095+0000","last_undegraded":"2024-01-22T05:08:02.019095+0000","last_fullsized":"2024-01-22T05:08:02.019095+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.009580+0000","last_change":"2024-01-22T05:08:02.009580+0000","last_active":"2024-01-22T05:08:02.009580+0000","last_peered":"2024-01-22T05:08:02.009580+0000","last_clean":"2024-01-22T05:08:02.009580+0000","last_became_active":"2024-01-22T05:08:02.009265+0000","last_became_peered":"2024-01-22T05:08:02.009265+0000","last_unstale":"2024-01-22T05:08:02.009580+0000","last_undegraded":"2024-01-22T05:08:02.009580+0000","last_fullsized":"2024-01-22T05:08:02.009580+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"55'2","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.008555+0000","last_change":"2024-01-22T05:08:01.583831+0000","last_active":"2024-01-22T05:08:02.008555+0000","last_peered":"2024-01-22T05:08:02.008555+0000","last_clean":"2024-01-22T05:08:02.008555+0000","last_became_active":"2024-01-22T05:08:01.583311+0000","last_became_peered":"2024-01-22T05:08:01.583311+0000","last_unstale":"2024-01-22T05:08:02.008555+0000","last_undegraded":"2024-01-22T05:08:02.008555+0000","last_fullsized":"2024-01-22T05:08:02.008555+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.014891+0000","last_change":"2024-01-22T05:08:02.014891+0000","last_active":"2024-01-22T05:08:02.014891+0000","last_peered":"2024-01-22T05:08:02.014891+0000","last_clean":"2024-01-22T05:08:02.014891+0000","last_became_active":"2024-01-22T05:08:02.013918+0000","last_became_peered":"2024-01-22T05:08:02.013918+0000","last_unstale":"2024-01-22T05:08:02.014891+0000","last_undegraded":"2024-01-22T05:08:02.014891+0000","last_fullsized":"2024-01-22T05:08:02.014891+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.995526+0000","last_change":"2024-01-22T05:08:01.577507+0000","last_active":"2024-01-22T05:08:01.995526+0000","last_peered":"2024-01-22T05:08:01.995526+0000","last_clean":"2024-01-22T05:08:01.995526+0000","last_became_active":"2024-01-22T05:08:01.577188+0000","last_became_peered":"2024-01-22T05:08:01.577188+0000","last_unstale":"2024-01-22T05:08:01.995526+0000","last_undegraded":"2024-01-22T05:08:01.995526+0000","last_fullsized":"2024-01-22T05:08:01.995526+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.013868+0000","last_change":"2024-01-22T05:08:02.013868+0000","last_active":"2024-01-22T05:08:02.013868+0000","last_peered":"2024-01-22T05:08:02.013868+0000","last_clean":"2024-01-22T05:08:02.013868+0000","last_became_active":"2024-01-22T05:08:02.011915+0000","last_became_peered":"2024-01-22T05:08:02.011915+0000","last_unstale":"2024-01-22T05:08:02.013868+0000","last_undegraded":"2024-01-22T05:08:02.013868+0000","last_fullsized":"2024-01-22T05:08:02.013868+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.563035+0000","last_change":"2024-01-22T05:08:01.561683+0000","last_active":"2024-01-22T05:08:01.563035+0000","last_peered":"2024-01-22T05:08:01.563035+0000","last_clean":"2024-01-22T05:08:01.563035+0000","last_became_active":"2024-01-22T05:08:01.561433+0000","last_became_peered":"2024-01-22T05:08:01.561433+0000","last_unstale":"2024-01-22T05:08:01.563035+0000","last_undegraded":"2024-01-22T05:08:01.563035+0000","last_fullsized":"2024-01-22T05:08:01.563035+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.000626+0000","last_change":"2024-01-22T05:08:02.000626+0000","last_active":"2024-01-22T05:08:02.000626+0000","last_peered":"2024-01-22T05:08:02.000626+0000","last_clean":"2024-01-22T05:08:02.000626+0000","last_became_active":"2024-01-22T05:08:01.999227+0000","last_became_peered":"2024-01-22T05:08:01.999227+0000","last_unstale":"2024-01-22T05:08:02.000626+0000","last_undegraded":"2024-01-22T05:08:02.000626+0000","last_fullsized":"2024-01-22T05:08:02.000626+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.560602+0000","last_change":"2024-01-22T05:08:01.557605+0000","last_active":"2024-01-22T05:08:01.560602+0000","last_peered":"2024-01-22T05:08:01.560602+0000","last_clean":"2024-01-22T05:08:01.560602+0000","last_became_active":"2024-01-22T05:08:01.557357+0000","last_became_peered":"2024-01-22T05:08:01.557357+0000","last_unstale":"2024-01-22T05:08:01.560602+0000","last_undegraded":"2024-01-22T05:08:01.560602+0000","last_fullsized":"2024-01-22T05:08:01.560602+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.010873+0000","last_change":"2024-01-22T05:08:02.010873+0000","last_active":"2024-01-22T05:08:02.010873+0000","last_peered":"2024-01-22T05:08:02.010873+0000","last_clean":"2024-01-22T05:08:02.010873+0000","last_became_active":"2024-01-22T05:08:02.010607+0000","last_became_peered":"2024-01-22T05:08:02.010607+0000","last_unstale":"2024-01-22T05:08:02.010873+0000","last_undegraded":"2024-01-22T05:08:02.010873+0000","last_fullsized":"2024-01-22T05:08:02.010873+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"55'4","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.019060+0000","last_change":"2024-01-22T05:08:01.564758+0000","last_active":"2024-01-22T05:08:02.019060+0000","last_peered":"2024-01-22T05:08:02.019060+0000","last_clean":"2024-01-22T05:08:02.019060+0000","last_became_active":"2024-01-22T05:08:01.563305+0000","last_became_peered":"2024-01-22T05:08:01.563305+0000","last_unstale":"2024-01-22T05:08:02.019060+0000","last_undegraded":"2024-01-22T05:08:02.019060+0000","last_fullsized":"2024-01-22T05:08:02.019060+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.994329+0000","last_change":"2024-01-22T05:08:01.994329+0000","last_active":"2024-01-22T05:08:01.994329+0000","last_peered":"2024-01-22T05:08:01.994329+0000","last_clean":"2024-01-22T05:08:01.994329+0000","last_became_active":"2024-01-22T05:08:01.994043+0000","last_became_peered":"2024-01-22T05:08:01.994043+0000","last_unstale":"2024-01-22T05:08:01.994329+0000","last_undegraded":"2024-01-22T05:08:01.994329+0000","last_fullsized":"2024-01-22T05:08:01.994329+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"55'2","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.024622+0000","last_change":"2024-01-22T05:08:01.571650+0000","last_active":"2024-01-22T05:08:02.024622+0000","last_peered":"2024-01-22T05:08:02.024622+0000","last_clean":"2024-01-22T05:08:02.024622+0000","last_became_active":"2024-01-22T05:08:01.570426+0000","last_became_peered":"2024-01-22T05:08:01.570426+0000","last_unstale":"2024-01-22T05:08:02.024622+0000","last_undegraded":"2024-01-22T05:08:02.024622+0000","last_fullsized":"2024-01-22T05:08:02.024622+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.995570+0000","last_change":"2024-01-22T05:08:01.995570+0000","last_active":"2024-01-22T05:08:01.995570+0000","last_peered":"2024-01-22T05:08:01.995570+0000","last_clean":"2024-01-22T05:08:01.995570+0000","last_became_active":"2024-01-22T05:08:01.995286+0000","last_became_peered":"2024-01-22T05:08:01.995286+0000","last_unstale":"2024-01-22T05:08:01.995570+0000","last_undegraded":"2024-01-22T05:08:01.995570+0000","last_fullsized":"2024-01-22T05:08:01.995570+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.587335+0000","last_change":"2024-01-22T05:08:01.580898+0000","last_active":"2024-01-22T05:08:01.587335+0000","last_peered":"2024-01-22T05:08:01.587335+0000","last_clean":"2024-01-22T05:08:01.587335+0000","last_became_active":"2024-01-22T05:08:01.580588+0000","last_became_peered":"2024-01-22T05:08:01.580588+0000","last_unstale":"2024-01-22T05:08:01.587335+0000","last_undegraded":"2024-01-22T05:08:01.587335+0000","last_fullsized":"2024-01-22T05:08:01.587335+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.012839+0000","last_change":"2024-01-22T05:08:02.012839+0000","last_active":"2024-01-22T05:08:02.012839+0000","last_peered":"2024-01-22T05:08:02.012839+0000","last_clean":"2024-01-22T05:08:02.012839+0000","last_became_active":"2024-01-22T05:08:02.012438+0000","last_became_peered":"2024-01-22T05:08:02.012438+0000","last_unstale":"2024-01-22T05:08:02.012839+0000","last_undegraded":"2024-01-22T05:08:02.012839+0000","last_fullsized":"2024-01-22T05:08:02.012839+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.557877+0000","last_change":"2024-01-22T05:08:01.554688+0000","last_active":"2024-01-22T05:08:01.557877+0000","last_peered":"2024-01-22T05:08:01.557877+0000","last_clean":"2024-01-22T05:08:01.557877+0000","last_became_active":"2024-01-22T05:08:01.554421+0000","last_became_peered":"2024-01-22T05:08:01.554421+0000","last_unstale":"2024-01-22T05:08:01.557877+0000","last_undegraded":"2024-01-22T05:08:01.557877+0000","last_fullsized":"2024-01-22T05:08:01.557877+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.996293+0000","last_change":"2024-01-22T05:08:01.996293+0000","last_active":"2024-01-22T05:08:01.996293+0000","last_peered":"2024-01-22T05:08:01.996293+0000","last_clean":"2024-01-22T05:08:01.996293+0000","last_became_active":"2024-01-22T05:08:01.996014+0000","last_became_peered":"2024-01-22T05:08:01.996014+0000","last_unstale":"2024-01-22T05:08:01.996293+0000","last_undegraded":"2024-01-22T05:08:01.996293+0000","last_fullsized":"2024-01-22T05:08:01.996293+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.556115+0000","last_change":"2024-01-22T05:08:01.553432+0000","last_active":"2024-01-22T05:08:01.556115+0000","last_peered":"2024-01-22T05:08:01.556115+0000","last_clean":"2024-01-22T05:08:01.556115+0000","last_became_active":"2024-01-22T05:08:01.553160+0000","last_became_peered":"2024-01-22T05:08:01.553160+0000","last_unstale":"2024-01-22T05:08:01.556115+0000","last_undegraded":"2024-01-22T05:08:01.556115+0000","last_fullsized":"2024-01-22T05:08:01.556115+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.020065+0000","last_change":"2024-01-22T05:08:02.020065+0000","last_active":"2024-01-22T05:08:02.020065+0000","last_peered":"2024-01-22T05:08:02.020065+0000","last_clean":"2024-01-22T05:08:02.020065+0000","last_became_active":"2024-01-22T05:08:02.016498+0000","last_became_peered":"2024-01-22T05:08:02.016498+0000","last_unstale":"2024-01-22T05:08:02.020065+0000","last_undegraded":"2024-01-22T05:08:02.020065+0000","last_fullsized":"2024-01-22T05:08:02.020065+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.563506+0000","last_change":"2024-01-22T05:08:01.558571+0000","last_active":"2024-01-22T05:08:01.563506+0000","last_peered":"2024-01-22T05:08:01.563506+0000","last_clean":"2024-01-22T05:08:01.563506+0000","last_became_active":"2024-01-22T05:08:01.558271+0000","last_became_peered":"2024-01-22T05:08:01.558271+0000","last_unstale":"2024-01-22T05:08:01.563506+0000","last_undegraded":"2024-01-22T05:08:01.563506+0000","last_fullsized":"2024-01-22T05:08:01.563506+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.008903+0000","last_change":"2024-01-22T05:08:02.008903+0000","last_active":"2024-01-22T05:08:02.008903+0000","last_peered":"2024-01-22T05:08:02.008903+0000","last_clean":"2024-01-22T05:08:02.008903+0000","last_became_active":"2024-01-22T05:08:02.004893+0000","last_became_peered":"2024-01-22T05:08:02.004893+0000","last_unstale":"2024-01-22T05:08:02.008903+0000","last_undegraded":"2024-01-22T05:08:02.008903+0000","last_fullsized":"2024-01-22T05:08:02.008903+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.587222+0000","last_change":"2024-01-22T05:08:01.585680+0000","last_active":"2024-01-22T05:08:01.587222+0000","last_peered":"2024-01-22T05:08:01.587222+0000","last_clean":"2024-01-22T05:08:01.587222+0000","last_became_active":"2024-01-22T05:08:01.585228+0000","last_became_peered":"2024-01-22T05:08:01.585228+0000","last_unstale":"2024-01-22T05:08:01.587222+0000","last_undegraded":"2024-01-22T05:08:01.587222+0000","last_fullsized":"2024-01-22T05:08:01.587222+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.012298+0000","last_change":"2024-01-22T05:08:02.012298+0000","last_active":"2024-01-22T05:08:02.012298+0000","last_peered":"2024-01-22T05:08:02.012298+0000","last_clean":"2024-01-22T05:08:02.012298+0000","last_became_active":"2024-01-22T05:08:02.011918+0000","last_became_peered":"2024-01-22T05:08:02.011918+0000","last_unstale":"2024-01-22T05:08:02.012298+0000","last_undegraded":"2024-01-22T05:08:02.012298+0000","last_fullsized":"2024-01-22T05:08:02.012298+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.571388+0000","last_change":"2024-01-22T05:08:01.567179+0000","last_active":"2024-01-22T05:08:01.571388+0000","last_peered":"2024-01-22T05:08:01.571388+0000","last_clean":"2024-01-22T05:08:01.571388+0000","last_became_active":"2024-01-22T05:08:01.566829+0000","last_became_peered":"2024-01-22T05:08:01.566829+0000","last_unstale":"2024-01-22T05:08:01.571388+0000","last_undegraded":"2024-01-22T05:08:01.571388+0000","last_fullsized":"2024-01-22T05:08:01.571388+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.015852+0000","last_change":"2024-01-22T05:08:02.015852+0000","last_active":"2024-01-22T05:08:02.015852+0000","last_peered":"2024-01-22T05:08:02.015852+0000","last_clean":"2024-01-22T05:08:02.015852+0000","last_became_active":"2024-01-22T05:08:02.015565+0000","last_became_peered":"2024-01-22T05:08:02.015565+0000","last_unstale":"2024-01-22T05:08:02.015852+0000","last_undegraded":"2024-01-22T05:08:02.015852+0000","last_fullsized":"2024-01-22T05:08:02.015852+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.576215+0000","last_change":"2024-01-22T05:08:01.565663+0000","last_active":"2024-01-22T05:08:01.576215+0000","last_peered":"2024-01-22T05:08:01.576215+0000","last_clean":"2024-01-22T05:08:01.576215+0000","last_became_active":"2024-01-22T05:08:01.565280+0000","last_became_peered":"2024-01-22T05:08:01.565280+0000","last_unstale":"2024-01-22T05:08:01.576215+0000","last_undegraded":"2024-01-22T05:08:01.576215+0000","last_fullsized":"2024-01-22T05:08:01.576215+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.006440+0000","last_change":"2024-01-22T05:08:02.006440+0000","last_active":"2024-01-22T05:08:02.006440+0000","last_peered":"2024-01-22T05:08:02.006440+0000","last_clean":"2024-01-22T05:08:02.006440+0000","last_became_active":"2024-01-22T05:08:02.006158+0000","last_became_peered":"2024-01-22T05:08:02.006158+0000","last_unstale":"2024-01-22T05:08:02.006440+0000","last_undegraded":"2024-01-22T05:08:02.006440+0000","last_fullsized":"2024-01-22T05:08:02.006440+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.563014+0000","last_change":"2024-01-22T05:08:01.560393+0000","last_active":"2024-01-22T05:08:01.563014+0000","last_peered":"2024-01-22T05:08:01.563014+0000","last_clean":"2024-01-22T05:08:01.563014+0000","last_became_active":"2024-01-22T05:08:01.560100+0000","last_became_peered":"2024-01-22T05:08:01.560100+0000","last_unstale":"2024-01-22T05:08:01.563014+0000","last_undegraded":"2024-01-22T05:08:01.563014+0000","last_fullsized":"2024-01-22T05:08:01.563014+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.537015+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:08:01.537015+0000","last_peered":"2024-01-22T05:08:01.537015+0000","last_clean":"2024-01-22T05:08:01.537015+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:08:01.537015+0000","last_undegraded":"2024-01-22T05:08:01.537015+0000","last_fullsized":"2024-01-22T05:08:01.537015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.009628+0000","last_change":"2024-01-22T05:08:02.009628+0000","last_active":"2024-01-22T05:08:02.009628+0000","last_peered":"2024-01-22T05:08:02.009628+0000","last_clean":"2024-01-22T05:08:02.009628+0000","last_became_active":"2024-01-22T05:08:02.009305+0000","last_became_peered":"2024-01-22T05:08:02.009305+0000","last_unstale":"2024-01-22T05:08:02.009628+0000","last_undegraded":"2024-01-22T05:08:02.009628+0000","last_fullsized":"2024-01-22T05:08:02.009628+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.586353+0000","last_change":"2024-01-22T05:08:01.580851+0000","last_active":"2024-01-22T05:08:01.586353+0000","last_peered":"2024-01-22T05:08:01.586353+0000","last_clean":"2024-01-22T05:08:01.586353+0000","last_became_active":"2024-01-22T05:08:01.580488+0000","last_became_peered":"2024-01-22T05:08:01.580488+0000","last_unstale":"2024-01-22T05:08:01.586353+0000","last_undegraded":"2024-01-22T05:08:01.586353+0000","last_fullsized":"2024-01-22T05:08:01.586353+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.536342+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:08:01.536342+0000","last_peered":"2024-01-22T05:08:01.536342+0000","last_clean":"2024-01-22T05:08:01.536342+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:08:01.536342+0000","last_undegraded":"2024-01-22T05:08:01.536342+0000","last_fullsized":"2024-01-22T05:08:01.536342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.005255+0000","last_change":"2024-01-22T05:08:02.005255+0000","last_active":"2024-01-22T05:08:02.005255+0000","last_peered":"2024-01-22T05:08:02.005255+0000","last_clean":"2024-01-22T05:08:02.005255+0000","last_became_active":"2024-01-22T05:08:02.004853+0000","last_became_peered":"2024-01-22T05:08:02.004853+0000","last_unstale":"2024-01-22T05:08:02.005255+0000","last_undegraded":"2024-01-22T05:08:02.005255+0000","last_fullsized":"2024-01-22T05:08:02.005255+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.998655+0000","last_change":"2024-01-22T05:08:01.573280+0000","last_active":"2024-01-22T05:08:01.998655+0000","last_peered":"2024-01-22T05:08:01.998655+0000","last_clean":"2024-01-22T05:08:01.998655+0000","last_became_active":"2024-01-22T05:08:01.572823+0000","last_became_peered":"2024-01-22T05:08:01.572823+0000","last_unstale":"2024-01-22T05:08:01.998655+0000","last_undegraded":"2024-01-22T05:08:01.998655+0000","last_fullsized":"2024-01-22T05:08:01.998655+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.557221+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:08:01.557221+0000","last_peered":"2024-01-22T05:08:01.557221+0000","last_clean":"2024-01-22T05:08:01.557221+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:08:01.557221+0000","last_undegraded":"2024-01-22T05:08:01.557221+0000","last_fullsized":"2024-01-22T05:08:01.557221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.013787+0000","last_change":"2024-01-22T05:08:02.013787+0000","last_active":"2024-01-22T05:08:02.013787+0000","last_peered":"2024-01-22T05:08:02.013787+0000","last_clean":"2024-01-22T05:08:02.013787+0000","last_became_active":"2024-01-22T05:08:02.013468+0000","last_became_peered":"2024-01-22T05:08:02.013468+0000","last_unstale":"2024-01-22T05:08:02.013787+0000","last_undegraded":"2024-01-22T05:08:02.013787+0000","last_fullsized":"2024-01-22T05:08:02.013787+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"55'2","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.012652+0000","last_change":"2024-01-22T05:08:01.581441+0000","last_active":"2024-01-22T05:08:02.012652+0000","last_peered":"2024-01-22T05:08:02.012652+0000","last_clean":"2024-01-22T05:08:02.012652+0000","last_became_active":"2024-01-22T05:08:01.581144+0000","last_became_peered":"2024-01-22T05:08:01.581144+0000","last_unstale":"2024-01-22T05:08:02.012652+0000","last_undegraded":"2024-01-22T05:08:02.012652+0000","last_fullsized":"2024-01-22T05:08:02.012652+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.535216+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:08:01.535216+0000","last_peered":"2024-01-22T05:08:01.535216+0000","last_clean":"2024-01-22T05:08:01.535216+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:08:01.535216+0000","last_undegraded":"2024-01-22T05:08:01.535216+0000","last_fullsized":"2024-01-22T05:08:01.535216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.993888+0000","last_change":"2024-01-22T05:08:01.993888+0000","last_active":"2024-01-22T05:08:01.993888+0000","last_peered":"2024-01-22T05:08:01.993888+0000","last_clean":"2024-01-22T05:08:01.993888+0000","last_became_active":"2024-01-22T05:08:01.993544+0000","last_became_peered":"2024-01-22T05:08:01.993544+0000","last_unstale":"2024-01-22T05:08:01.993888+0000","last_undegraded":"2024-01-22T05:08:01.993888+0000","last_fullsized":"2024-01-22T05:08:01.993888+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.561989+0000","last_change":"2024-01-22T05:08:01.558302+0000","last_active":"2024-01-22T05:08:01.561989+0000","last_peered":"2024-01-22T05:08:01.561989+0000","last_clean":"2024-01-22T05:08:01.561989+0000","last_became_active":"2024-01-22T05:08:01.558025+0000","last_became_peered":"2024-01-22T05:08:01.558025+0000","last_unstale":"2024-01-22T05:08:01.561989+0000","last_undegraded":"2024-01-22T05:08:01.561989+0000","last_fullsized":"2024-01-22T05:08:01.561989+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.547066+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:08:01.547066+0000","last_peered":"2024-01-22T05:08:01.547066+0000","last_clean":"2024-01-22T05:08:01.547066+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:08:01.547066+0000","last_undegraded":"2024-01-22T05:08:01.547066+0000","last_fullsized":"2024-01-22T05:08:01.547066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.014813+0000","last_change":"2024-01-22T05:08:02.014813+0000","last_active":"2024-01-22T05:08:02.014813+0000","last_peered":"2024-01-22T05:08:02.014813+0000","last_clean":"2024-01-22T05:08:02.014813+0000","last_became_active":"2024-01-22T05:08:02.013550+0000","last_became_peered":"2024-01-22T05:08:02.013550+0000","last_unstale":"2024-01-22T05:08:02.014813+0000","last_undegraded":"2024-01-22T05:08:02.014813+0000","last_fullsized":"2024-01-22T05:08:02.014813+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"55'1","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.995636+0000","last_change":"2024-01-22T05:08:01.562189+0000","last_active":"2024-01-22T05:08:01.995636+0000","last_peered":"2024-01-22T05:08:01.995636+0000","last_clean":"2024-01-22T05:08:01.995636+0000","last_became_active":"2024-01-22T05:08:01.561881+0000","last_became_peered":"2024-01-22T05:08:01.561881+0000","last_unstale":"2024-01-22T05:08:01.995636+0000","last_undegraded":"2024-01-22T05:08:01.995636+0000","last_fullsized":"2024-01-22T05:08:01.995636+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.548796+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:08:01.548796+0000","last_peered":"2024-01-22T05:08:01.548796+0000","last_clean":"2024-01-22T05:08:01.548796+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:08:01.548796+0000","last_undegraded":"2024-01-22T05:08:01.548796+0000","last_fullsized":"2024-01-22T05:08:01.548796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:02.014398+0000","last_change":"2024-01-22T05:08:02.014398+0000","last_active":"2024-01-22T05:08:02.014398+0000","last_peered":"2024-01-22T05:08:02.014398+0000","last_clean":"2024-01-22T05:08:02.014398+0000","last_became_active":"2024-01-22T05:08:02.013331+0000","last_became_peered":"2024-01-22T05:08:02.013331+0000","last_unstale":"2024-01-22T05:08:02.014398+0000","last_undegraded":"2024-01-22T05:08:02.014398+0000","last_fullsized":"2024-01-22T05:08:02.014398+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.571740+0000","last_change":"2024-01-22T05:08:01.569046+0000","last_active":"2024-01-22T05:08:01.571740+0000","last_peered":"2024-01-22T05:08:01.571740+0000","last_clean":"2024-01-22T05:08:01.571740+0000","last_became_active":"2024-01-22T05:08:01.568738+0000","last_became_peered":"2024-01-22T05:08:01.568738+0000","last_unstale":"2024-01-22T05:08:01.571740+0000","last_undegraded":"2024-01-22T05:08:01.571740+0000","last_fullsized":"2024-01-22T05:08:01.571740+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.553565+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:08:01.553565+0000","last_peered":"2024-01-22T05:08:01.553565+0000","last_clean":"2024-01-22T05:08:01.553565+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:08:01.553565+0000","last_undegraded":"2024-01-22T05:08:01.553565+0000","last_fullsized":"2024-01-22T05:08:01.553565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.999170+0000","last_change":"2024-01-22T05:08:01.999170+0000","last_active":"2024-01-22T05:08:01.999170+0000","last_peered":"2024-01-22T05:08:01.999170+0000","last_clean":"2024-01-22T05:08:01.999170+0000","last_became_active":"2024-01-22T05:08:01.998869+0000","last_became_peered":"2024-01-22T05:08:01.998869+0000","last_unstale":"2024-01-22T05:08:01.999170+0000","last_undegraded":"2024-01-22T05:08:01.999170+0000","last_fullsized":"2024-01-22T05:08:01.999170+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:01.516484+0000","last_clean_scrub_stamp":"2024-01-22T05:08:01.516484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.547151+0000","last_change":"2024-01-22T05:08:01.543813+0000","last_active":"2024-01-22T05:08:01.547151+0000","last_peered":"2024-01-22T05:08:01.547151+0000","last_clean":"2024-01-22T05:08:01.547151+0000","last_became_active":"2024-01-22T05:08:01.542706+0000","last_became_peered":"2024-01-22T05:08:01.542706+0000","last_unstale":"2024-01-22T05:08:01.547151+0000","last_undegraded":"2024-01-22T05:08:01.547151+0000","last_fullsized":"2024-01-22T05:08:01.547151+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:08:00.501370+0000","last_clean_scrub_stamp":"2024-01-22T05:08:00.501370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.548672+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:08:01.548672+0000","last_peered":"2024-01-22T05:08:01.548672+0000","last_clean":"2024-01-22T05:08:01.548672+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:08:01.548672+0000","last_undegraded":"2024-01-22T05:08:01.548672+0000","last_fullsized":"2024-01-22T05:08:01.548672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:08:01.553657+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:08:01.553657+0000","last_peered":"2024-01-22T05:08:01.553657+0000","last_clean":"2024-01-22T05:08:01.553657+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:08:01.553657+0000","last_undegraded":"2024-01-22T05:08:01.553657+0000","last_fullsized":"2024-01-22T05:08:01.553657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305904,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065936,"statfs":{"total":96636764160,"available":96323518464,"internally_reserved":0,"allocated":630784,"data_stored":295177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:07:34 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.98499999999999999,"15min":1.04},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0649999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0309999999999999,"15min":1.0389999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.486,"5min":1.53,"15min":1.53},"last":0.98599999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:07:34 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.002,"15min":0.97599999999999998},"min":{"1min":0.67300000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3380000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1499999999999999,"15min":1.173},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3580000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.83399999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:07:34 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0920000000000001,"15min":1.0940000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.579,"5min":1.659,"15min":1.659},"last":1.173},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.147,"15min":1.165},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.492,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.014}]},{"osd":3,"last update":"Mon Jan 22 05:07:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.21,"15min":1.228},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.456,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.198,"15min":1.224},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4450000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.3660000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:07:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0760000000000001,"15min":1.0529999999999999},"min":{"1min":0.879,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4590000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.165,"15min":1.1599999999999999},"min":{"1min":0.84499999999999997,"5min":0.751,"15min":0.751},"max":{"1min":1.4770000000000001,"5min":1.8,"15min":1.8},"last":1.292}]},{"osd":5,"last update":"Mon Jan 22 05:07:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.196,"15min":1.1899999999999999},"min":{"1min":0.64500000000000002,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5149999999999999,"5min":1.736,"15min":1.736},"last":1.448},{"interface":"front","average":{"1min":1.266,"5min":1.2290000000000001,"15min":1.204},"min":{"1min":0.94199999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.5309999999999999,"5min":1.915,"15min":1.915},"last":1.399}]},{"osd":6,"last update":"Mon Jan 22 05:07:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2549999999999999,"15min":1.258},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.472,"5min":1.823,"15min":1.823},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.335,"15min":1.321},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.621,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.5620000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065912,"statfs":{"total":96636764160,"available":96323493888,"internally_reserved":0,"allocated":655360,"data_stored":309741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0649999999999999,"15min":1.091},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.046},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.03,"15min":1.046},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.4550000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0189999999999999,"15min":1.054},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.1910000000000001,"15min":1.2330000000000001},"min":{"1min":0.65700000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.4649999999999999,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":0.96399999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1459999999999999,"15min":1.1579999999999999},"min":{"1min":0.71399999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.206},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.081,"15min":1.103},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.575,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.2490000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1319999999999999,"15min":1.133},"min":{"1min":0.63500000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5369999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.089},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.161,"15min":1.198},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.4510000000000001,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.2869999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.109,"15min":1.089},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":2.4049999999999998,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":1.238},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1259999999999999,"15min":1.131},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.83499999999999996}]},{"osd":5,"last update":"Mon Jan 22 05:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1539999999999999,"15min":1.1799999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.276,"15min":1.2729999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.4390000000000001,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.159}]},{"osd":7,"last update":"Mon Jan 22 05:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3520000000000001,"15min":1.3759999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6679999999999999,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.355,"15min":1.4039999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.7470000000000001,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":1.3520000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310028,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061812,"statfs":{"total":96636764160,"available":96319295488,"internally_reserved":0,"allocated":659456,"data_stored":310295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.96799999999999997,"15min":0.98799999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.75},{"interface":"front","average":{"1min":0.93700000000000006,"5min":1.073,"15min":1.117},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.506,"5min":1.571,"15min":1.571},"last":0.92100000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.173,"15min":1.2210000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5669999999999999,"5min":1.821,"15min":1.821},"last":1.018},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.2549999999999999,"15min":1.319},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5189999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.391}]},{"osd":2,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1339999999999999,"15min":1.1539999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4350000000000001,"5min":1.629,"15min":1.629},"last":1.347},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.1120000000000001,"15min":1.147},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.54,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.1519999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1739999999999999,"15min":1.196},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4990000000000001,"5min":1.931,"15min":1.931},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.2549999999999999,"15min":1.3149999999999999},"min":{"1min":0.79300000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.569,"5min":2.266,"15min":2.266},"last":1.2929999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.175,"15min":1.2030000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.7749999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2749999999999999,"15min":1.3149999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.714,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.0940000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.3180000000000001,"15min":1.361},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.671,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.2},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2929999999999999,"15min":1.3169999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.899,"5min":1.909,"15min":1.909},"last":1.3160000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.4099999999999999,"15min":1.4410000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.881,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.448,"15min":1.496},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.0499999999999998,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.4450000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065924,"statfs":{"total":96636764160,"available":96323506176,"internally_reserved":0,"allocated":643072,"data_stored":302209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:07:29 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.1060000000000001,"15min":1.1399999999999999},"min":{"1min":0.69499999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.333,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0900000000000001,"15min":1.0880000000000001},"min":{"1min":0.55300000000000005,"5min":0.501,"15min":0.501},"max":{"1min":1.51,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.155}]},{"osd":1,"last update":"Mon Jan 22 05:07:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0629999999999999,"15min":1.0880000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3160000000000001,"5min":1.538,"15min":1.538},"last":1.4870000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.145,"15min":1.2070000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3520000000000001,"5min":2.194,"15min":2.194},"last":1.1879999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:07:29 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1100000000000001,"15min":1.095},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":5.3390000000000004,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.222,"15min":1.2869999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.278,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.4490000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:07:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.163,"15min":1.194},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.4450000000000001,"5min":1.589,"15min":1.589},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.1739999999999999,"15min":1.1639999999999999},"min":{"1min":0.82599999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":5.3029999999999999,"5min":5.3029999999999999,"15min":5.3029999999999999},"last":1.246}]},{"osd":5,"last update":"Mon Jan 22 05:07:29 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.202,"15min":1.23},"min":{"1min":0.68200000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.3480000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.149,"15min":1.167},"min":{"1min":0.628,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.429,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.03}]},{"osd":6,"last update":"Mon Jan 22 05:07:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2110000000000001,"15min":1.1970000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":5.3769999999999998,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":1.296},{"interface":"front","average":{"1min":1.361,"5min":1.409,"15min":1.4410000000000001},"min":{"1min":0.85499999999999998,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":4.4409999999999998,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":1.3260000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:07:29 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3480000000000001,"15min":1.3740000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6399999999999999,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.3919999999999999,"15min":1.3899999999999999},"min":{"1min":0.85099999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":5.2629999999999999,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.343}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310000,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061840,"statfs":{"total":96636764160,"available":96319324160,"internally_reserved":0,"allocated":630784,"data_stored":295177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.96699999999999997,"15min":0.91100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.22,"5min":14.859,"15min":14.859},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.91900000000000004,"15min":0.88},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":3.9860000000000002,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":1.599}]},{"osd":1,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84999999999999998,"15min":0.84799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2030000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.876,"5min":0.99299999999999999,"15min":0.98299999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.526,"5min":5.7519999999999998,"15min":5.7519999999999998},"last":0.97099999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.1120000000000001,"15min":1.1679999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.5029999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.165,"15min":1.1890000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.0209999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.292,"15min":1.2969999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.6419999999999999,"5min":5.016,"15min":5.016},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.339,"15min":1.337},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.621,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":1.095}]},{"osd":5,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.296,"15min":1.296},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.7130000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.3,"5min":1.319,"15min":1.2909999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.986,"5min":5.6740000000000004,"15min":5.6740000000000004},"last":1.3049999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.4039999999999999,"15min":1.4279999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.754,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":1.48},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.4259999999999999,"15min":1.419},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8680000000000001,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":1.337}]},{"osd":7,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.409,"15min":1.4039999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.921,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":1.417},{"interface":"front","average":{"1min":1.274,"5min":1.4279999999999999,"15min":1.4319999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.738,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":1.381}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305936,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065904,"statfs":{"total":96636764160,"available":96323485696,"internally_reserved":0,"allocated":663552,"data_stored":309797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72999999999999998,"15min":0.746},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0389999999999999,"5min":1.254,"15min":1.254},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.4370000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.90800000000000003,"15min":0.93799999999999994},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.0980000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.038,"15min":1.046},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.655},{"interface":"front","average":{"1min":1.103,"5min":1.1319999999999999,"15min":1.1559999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.2849999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2609999999999999,"15min":1.3089999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.8340000000000001,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.48},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.181,"15min":1.2090000000000001},"min":{"1min":0.69999999999999996,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.798,"5min":1.952,"15min":1.952},"last":1.042}]},{"osd":5,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.159,"15min":1.1779999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.732,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.742},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.276,"15min":1.3220000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.929,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.4159999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.222,"15min":1.254},"min":{"1min":0.754,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.875,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.2549999999999999,"15min":1.2789999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9710000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":2.1320000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:07:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.3180000000000001,"15min":1.3560000000000001},"min":{"1min":0.79600000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.6220000000000001,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.369,"15min":1.401},"min":{"1min":0.92400000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.899,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":2.0329999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065924,"statfs":{"total":96636764160,"available":96323506176,"internally_reserved":0,"allocated":643072,"data_stored":302209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:07:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.85899999999999999,"15min":0.83999999999999997},"min":{"1min":0.46200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.98399999999999999,"15min":0.999},"min":{"1min":0.51600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":2.101,"5min":2.101,"15min":2.101},"last":0.76500000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:07:35 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.97999999999999998,"15min":1.002},"min":{"1min":0.499,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.526,"5min":1.548,"15min":1.548},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.016,"15min":1.0209999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":0.997}]},{"osd":3,"last update":"Mon Jan 22 05:07:35 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.0229999999999999,"15min":0.99399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":1.129},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.876,"15min":0.874},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.88100000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:07:35 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1859999999999999,"15min":1.194},"min":{"1min":0.754,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6439999999999999,"5min":1.726,"15min":1.726},"last":1.149},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.256,"15min":1.244},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.3410000000000002,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":1.1890000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:07:35 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1699999999999999,"15min":1.1830000000000001},"min":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7070000000000001,"5min":1.776,"15min":1.776},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.2569999999999999,"15min":1.266},"min":{"1min":0.878,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.0409999999999999,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.0209999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:07:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.25,"15min":1.264},"min":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3200000000000001,"15min":1.3320000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.946,"5min":2.294,"15min":2.294},"last":1.0880000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:07:35 2024","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.3799999999999999,"15min":1.373},"min":{"1min":0.82299999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":4.4329999999999998,"5min":4.4329999999999998,"15min":4.4329999999999998},"last":1.327},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3460000000000001,"15min":1.3600000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":3.0099999999999998,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":1.0409999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065924,"statfs":{"total":96636764160,"available":96323506176,"internally_reserved":0,"allocated":643072,"data_stored":302209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.85899999999999999,"15min":0.92500000000000004},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.4810000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.92400000000000004,"15min":0.98499999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.395,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.81699999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.0169999999999999,"15min":1.0760000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.98699999999999999,"15min":1.0169999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.92600000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.032},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.7170000000000001,"5min":1.994,"15min":1.994},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.149,"15min":1.2150000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6910000000000001,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.171}]},{"osd":4,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.3109999999999999,"15min":1.389},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.667,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.056},{"interface":"front","average":{"1min":1.133,"5min":1.2250000000000001,"15min":1.256},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.651,"5min":1.782,"15min":1.782},"last":1.325}]},{"osd":5,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.319,"15min":1.389},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.6519999999999999,"5min":3.548,"15min":3.548},"last":1.214},{"interface":"front","average":{"1min":1.131,"5min":1.345,"15min":1.4239999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.623,"5min":2.613,"15min":2.613},"last":1.4910000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.387,"15min":1.446},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.619,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.367},{"interface":"front","average":{"1min":1.107,"5min":1.4159999999999999,"15min":1.514},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6279999999999999,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.1379999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:07:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.526,"15min":1.6539999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7070000000000001,"5min":5.29,"15min":5.29},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.377,"15min":1.4410000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.645,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.4359999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:08:06.770 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:08:06.770 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-22T05:08:06.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.980+0000 7f48c0200700 1 Processor -- start 2024-01-22T05:08:06.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.980+0000 7f48c0200700 1 -- start start 2024-01-22T05:08:06.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.984+0000 7f48c0200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f48b80a8c20 0x7f48b80c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.984+0000 7f48c0200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80bcbe0 0x7f48b8068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.984+0000 7f48c0200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b8158650 con 0x7f48b80c1ac0 2024-01-22T05:08:06.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.984+0000 7f48c0200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b80c1f20 con 0x7f48b80a8c20 2024-01-22T05:08:06.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.984+0000 7f48c0200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80bd170 con 0x7f48b80bcbe0 2024-01-22T05:08:06.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.984+0000 7f48bce00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f48b80c1ac0 0x7f48b80bc4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42160/0 (socket says 172.21.15.49:42160) 2024-01-22T05:08:06.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.984+0000 7f48bce00700 1 -- 172.21.15.49:0/3049708996 learned_addr learned my addr 172.21.15.49:0/3049708996 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:06.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.984+0000 7f48bd800700 1 --2- 172.21.15.49:0/3049708996 >> v2:172.21.15.110:3300/0 conn(0x7f48b80a8c20 0x7f48b80c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.984+0000 7f48be200700 1 --2- 172.21.15.49:0/3049708996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80bcbe0 0x7f48b8068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.984+0000 7f48b7e00700 1 -- 172.21.15.49:0/3049708996 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167212603 0 0) 0x7f48a0001290 con 0x7f48b80c1ac0 2024-01-22T05:08:06.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.984+0000 7f48b7e00700 1 -- 172.21.15.49:0/3049708996 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48980033f0 con 0x7f48b80c1ac0 2024-01-22T05:08:06.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.984+0000 7f48bd800700 1 -- 172.21.15.49:0/3049708996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80bcbe0 msgr2=0x7f48b8068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:06.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.984+0000 7f48bd800700 1 --2- 172.21.15.49:0/3049708996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80bcbe0 0x7f48b8068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.984+0000 7f48bd800700 1 -- 172.21.15.49:0/3049708996 >> v1:172.21.15.49:6789/0 conn(0x7f48b80c1ac0 legacy=0x7f48b80bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.984+0000 7f48bd800700 1 -- 172.21.15.49:0/3049708996 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b8067c30 con 0x7f48b80a8c20 2024-01-22T05:08:06.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.988+0000 7f48bd800700 1 --2- 172.21.15.49:0/3049708996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80a8c20 0x7f48b80c15d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f48a8009760 tx=0x7f48a8009060).ready entity=mon.1 client_cookie=87a0cb6ffc97750a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:06.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.988+0000 7f48b7e00700 1 -- 172.21.15.49:0/3049708996 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a800d4a0 con 0x7f48b80a8c20 2024-01-22T05:08:06.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.988+0000 7f48b7e00700 1 -- 172.21.15.49:0/3049708996 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a800d600 con 0x7f48b80a8c20 2024-01-22T05:08:06.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.988+0000 7f48b7e00700 1 -- 172.21.15.49:0/3049708996 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a800d980 con 0x7f48b80a8c20 2024-01-22T05:08:06.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.988+0000 7f48c0200700 1 -- 172.21.15.49:0/3049708996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80a8c20 msgr2=0x7f48b80c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.988+0000 7f48c0200700 1 --2- 172.21.15.49:0/3049708996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80a8c20 0x7f48b80c15d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f48a8009760 tx=0x7f48a8009060).stop 2024-01-22T05:08:06.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.988+0000 7f48c0200700 1 -- 172.21.15.49:0/3049708996 shutdown_connections 2024-01-22T05:08:06.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.988+0000 7f48c0200700 1 --2- 172.21.15.49:0/3049708996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80bcbe0 0x7f48b8068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.988+0000 7f48c0200700 1 --2- 172.21.15.49:0/3049708996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80a8c20 0x7f48b80c15d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.988+0000 7f48c0200700 1 -- 172.21.15.49:0/3049708996 >> 172.21.15.49:0/3049708996 conn(0x7f48b8062cb0 msgr2=0x7f48b80c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:06.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.988+0000 7f48c0200700 1 -- 172.21.15.49:0/3049708996 shutdown_connections 2024-01-22T05:08:06.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.988+0000 7f48c0200700 1 -- 172.21.15.49:0/3049708996 wait complete. 2024-01-22T05:08:06.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.992+0000 7f48c0200700 1 Processor -- start 2024-01-22T05:08:06.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.992+0000 7f48c0200700 1 -- start start 2024-01-22T05:08:06.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48c0200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80a8c20 0x7f48b80c0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48c0200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b80bcbe0 0x7f48b80be090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48c0200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80c1ac0 0x7f48b8168570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:06.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48c0200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80be8c0 con 0x7f48b80bcbe0 2024-01-22T05:08:06.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48c0200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8159fa0 con 0x7f48b80c1ac0 2024-01-22T05:08:06.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48c0200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b816b910 con 0x7f48b80a8c20 2024-01-22T05:08:06.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48bce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b80bcbe0 0x7f48b80be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48bce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b80bcbe0 0x7f48b80be090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34104/0 (socket says 172.21.15.49:34104) 2024-01-22T05:08:06.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48bce00700 1 -- 172.21.15.49:0/455293939 learned_addr learned my addr 172.21.15.49:0/455293939 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:06.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48be200700 1 --2- 172.21.15.49:0/455293939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80c1ac0 0x7f48b8168570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48bd800700 1 --2- 172.21.15.49:0/455293939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80a8c20 0x7f48b80c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:06.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48bce00700 1 -- 172.21.15.49:0/455293939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80a8c20 msgr2=0x7f48b80c0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48bce00700 1 --2- 172.21.15.49:0/455293939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80a8c20 0x7f48b80c0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48bce00700 1 -- 172.21.15.49:0/455293939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80c1ac0 msgr2=0x7f48b8168570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:06.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48bce00700 1 --2- 172.21.15.49:0/455293939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80c1ac0 0x7f48b8168570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:06.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48bce00700 1 -- 172.21.15.49:0/455293939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80092a0 con 0x7f48b80bcbe0 2024-01-22T05:08:07.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48bce00700 1 --2- 172.21.15.49:0/455293939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b80bcbe0 0x7f48b80be090 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f48a000c440 tx=0x7f48a0007960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:07.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48b4c00700 1 -- 172.21.15.49:0/455293939 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a00070d0 con 0x7f48b80bcbe0 2024-01-22T05:08:07.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48b4c00700 1 -- 172.21.15.49:0/455293939 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a0007230 con 0x7f48b80bcbe0 2024-01-22T05:08:07.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48c0200700 1 -- 172.21.15.49:0/455293939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b8159670 con 0x7f48b80bcbe0 2024-01-22T05:08:07.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48b4c00700 1 -- 172.21.15.49:0/455293939 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0005670 con 0x7f48b80bcbe0 2024-01-22T05:08:07.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:06.996+0000 7f48c0200700 1 -- 172.21.15.49:0/455293939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b8159c30 con 0x7f48b80bcbe0 2024-01-22T05:08:07.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.000+0000 7f48c0200700 1 -- 172.21.15.49:0/455293939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b80c0c00 con 0x7f48b80bcbe0 2024-01-22T05:08:07.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.000+0000 7f48b4c00700 1 -- 172.21.15.49:0/455293939 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f48a0005aa0 con 0x7f48b80bcbe0 2024-01-22T05:08:07.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.000+0000 7f48b4c00700 1 --2- 172.21.15.49:0/455293939 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f489005a540 0x7f489005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:07.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.000+0000 7f48b4c00700 1 -- 172.21.15.49:0/455293939 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f48a0073e40 con 0x7f48b80bcbe0 2024-01-22T05:08:07.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.000+0000 7f48bd800700 1 --2- 172.21.15.49:0/455293939 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f489005a540 0x7f489005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:07.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.004+0000 7f48bd800700 1 --2- 172.21.15.49:0/455293939 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f489005a540 0x7f489005ca00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f48a800d260 tx=0x7f48a8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:07.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.008+0000 7f48b4c00700 1 -- 172.21.15.49:0/455293939 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f48a0047400 con 0x7f48b80bcbe0 2024-01-22T05:08:07.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.224+0000 7f48c0200700 1 -- 172.21.15.49:0/455293939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f48b8158650 con 0x7f48b80bcbe0 2024-01-22T05:08:07.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.232+0000 7f48b4c00700 1 -- 172.21.15.49:0/455293939 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f48b8158650 con 0x7f48b80bcbe0 2024-01-22T05:08:07.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.236+0000 7f48c0200700 1 -- 172.21.15.49:0/455293939 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f489005a540 msgr2=0x7f489005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:07.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.236+0000 7f48c0200700 1 --2- 172.21.15.49:0/455293939 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f489005a540 0x7f489005ca00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f48a800d260 tx=0x7f48a8016000).stop 2024-01-22T05:08:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.236+0000 7f48c0200700 1 -- 172.21.15.49:0/455293939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b80bcbe0 msgr2=0x7f48b80be090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.236+0000 7f48c0200700 1 --2- 172.21.15.49:0/455293939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b80bcbe0 0x7f48b80be090 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f48a000c440 tx=0x7f48a0007960).stop 2024-01-22T05:08:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.236+0000 7f48c0200700 1 -- 172.21.15.49:0/455293939 shutdown_connections 2024-01-22T05:08:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.236+0000 7f48c0200700 1 --2- 172.21.15.49:0/455293939 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f489005a540 0x7f489005ca00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.236+0000 7f48c0200700 1 --2- 172.21.15.49:0/455293939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b80c1ac0 0x7f48b8168570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.236+0000 7f48c0200700 1 --2- 172.21.15.49:0/455293939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b80bcbe0 0x7f48b80be090 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.236+0000 7f48c0200700 1 --2- 172.21.15.49:0/455293939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48b80a8c20 0x7f48b80c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.236+0000 7f48c0200700 1 -- 172.21.15.49:0/455293939 >> 172.21.15.49:0/455293939 conn(0x7f48b8062cb0 msgr2=0x7f48b80bc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.236+0000 7f48c0200700 1 -- 172.21.15.49:0/455293939 shutdown_connections 2024-01-22T05:08:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.236+0000 7f48c0200700 1 -- 172.21.15.49:0/455293939 wait complete. 2024-01-22T05:08:07.242 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-01-22T05:08:07.262 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:07.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.420+0000 7f2c9ca00700 1 Processor -- start 2024-01-22T05:08:07.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.424+0000 7f2c9ca00700 1 -- start start 2024-01-22T05:08:07.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.424+0000 7f2c9ca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c94155d20 0x7f2c94065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:07.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.424+0000 7f2c9ca00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2c940a8e50 0x7f2c940c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:07.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.424+0000 7f2c9ca00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c940c1a40 con 0x7f2c94066070 2024-01-22T05:08:07.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.424+0000 7f2c9ca00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c94159310 con 0x7f2c940a8e50 2024-01-22T05:08:07.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.424+0000 7f2c9ca00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940c13f0 con 0x7f2c94155d20 2024-01-22T05:08:07.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.424+0000 7f2c99600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2c94066070 0x7f2c940a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42174/0 (socket says 172.21.15.49:42174) 2024-01-22T05:08:07.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.424+0000 7f2c99600700 1 -- 172.21.15.49:0/198583055 learned_addr learned my addr 172.21.15.49:0/198583055 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:07.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.424+0000 7f2c9aa00700 1 --2- 172.21.15.49:0/198583055 >> v2:172.21.15.110:3300/0 conn(0x7f2c940a8e50 0x7f2c940c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:07.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.424+0000 7f2c9a000700 1 --2- 172.21.15.49:0/198583055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c94155d20 0x7f2c94065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:07.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c98c00700 1 -- 172.21.15.49:0/198583055 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248202839 0 0) 0x7f2c940c1a40 con 0x7f2c94066070 2024-01-22T05:08:07.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c98c00700 1 -- 172.21.15.49:0/198583055 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c740033f0 con 0x7f2c94066070 2024-01-22T05:08:07.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c9aa00700 1 -- 172.21.15.49:0/198583055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c94155d20 msgr2=0x7f2c94065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:07.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c9aa00700 1 --2- 172.21.15.49:0/198583055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c94155d20 0x7f2c94065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:07.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c9aa00700 1 -- 172.21.15.49:0/198583055 >> v1:172.21.15.49:6789/0 conn(0x7f2c94066070 legacy=0x7f2c940a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:07.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c9aa00700 1 -- 172.21.15.49:0/198583055 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940c16d0 con 0x7f2c940a8e50 2024-01-22T05:08:07.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c9aa00700 1 --2- 172.21.15.49:0/198583055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c940a8e50 0x7f2c940c1ed0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f2c8c009e60 tx=0x7f2c8c009780).ready entity=mon.1 client_cookie=4a193b02547e672e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:07.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c98c00700 1 -- 172.21.15.49:0/198583055 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c00e070 con 0x7f2c940a8e50 2024-01-22T05:08:07.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c98c00700 1 -- 172.21.15.49:0/198583055 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c00bab0 con 0x7f2c940a8e50 2024-01-22T05:08:07.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c98c00700 1 -- 172.21.15.49:0/198583055 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c00be30 con 0x7f2c940a8e50 2024-01-22T05:08:07.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c9ca00700 1 -- 172.21.15.49:0/198583055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c940a8e50 msgr2=0x7f2c940c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:07.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c9ca00700 1 --2- 172.21.15.49:0/198583055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c940a8e50 0x7f2c940c1ed0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f2c8c009e60 tx=0x7f2c8c009780).stop 2024-01-22T05:08:07.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c9ca00700 1 -- 172.21.15.49:0/198583055 shutdown_connections 2024-01-22T05:08:07.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c9ca00700 1 --2- 172.21.15.49:0/198583055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c940a8e50 0x7f2c940c1ed0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:07.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c9ca00700 1 --2- 172.21.15.49:0/198583055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c94155d20 0x7f2c94065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:07.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c9ca00700 1 -- 172.21.15.49:0/198583055 >> 172.21.15.49:0/198583055 conn(0x7f2c940c6540 msgr2=0x7f2c940c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:07.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.428+0000 7f2c9ca00700 1 -- 172.21.15.49:0/198583055 shutdown_connections 2024-01-22T05:08:07.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.432+0000 7f2c9ca00700 1 -- 172.21.15.49:0/198583055 wait complete. 2024-01-22T05:08:07.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.432+0000 7f2c9ca00700 1 Processor -- start 2024-01-22T05:08:07.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.432+0000 7f2c9ca00700 1 -- start start 2024-01-22T05:08:07.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c94066070 0x7f2c9414eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:07.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9ca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c940a8e50 0x7f2c94153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:07.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9ca00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c94155d20 0x7f2c940bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:07.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9ca00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940aad50 con 0x7f2c94066070 2024-01-22T05:08:07.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9ca00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940aa720 con 0x7f2c94155d20 2024-01-22T05:08:07.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9ca00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940be3d0 con 0x7f2c940a8e50 2024-01-22T05:08:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c94066070 0x7f2c9414eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c94066070 0x7f2c9414eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34108/0 (socket says 172.21.15.49:34108) 2024-01-22T05:08:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9a000700 1 -- 172.21.15.49:0/1454435910 learned_addr learned my addr 172.21.15.49:0/1454435910 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c99600700 1 --2- 172.21.15.49:0/1454435910 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c940a8e50 0x7f2c94153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9aa00700 1 --2- 172.21.15.49:0/1454435910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c94155d20 0x7f2c940bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:07.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9aa00700 1 -- 172.21.15.49:0/1454435910 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c940a8e50 msgr2=0x7f2c94153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:07.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9aa00700 1 --2- 172.21.15.49:0/1454435910 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c940a8e50 0x7f2c94153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:07.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9aa00700 1 -- 172.21.15.49:0/1454435910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c94066070 msgr2=0x7f2c9414eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:07.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9aa00700 1 --2- 172.21.15.49:0/1454435910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c94066070 0x7f2c9414eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:07.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9aa00700 1 -- 172.21.15.49:0/1454435910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c009a20 con 0x7f2c94155d20 2024-01-22T05:08:07.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9a000700 1 --2- 172.21.15.49:0/1454435910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c94066070 0x7f2c9414eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:07.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9aa00700 1 --2- 172.21.15.49:0/1454435910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c94155d20 0x7f2c940bfcd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f2c8c014000 tx=0x7f2c8c009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:07.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c91600700 1 -- 172.21.15.49:0/1454435910 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c013e40 con 0x7f2c94155d20 2024-01-22T05:08:07.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c91600700 1 -- 172.21.15.49:0/1454435910 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c01d630 con 0x7f2c94155d20 2024-01-22T05:08:07.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9ca00700 1 -- 172.21.15.49:0/1454435910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c940be6b0 con 0x7f2c94155d20 2024-01-22T05:08:07.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c91600700 1 -- 172.21.15.49:0/1454435910 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c01d9f0 con 0x7f2c94155d20 2024-01-22T05:08:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.436+0000 7f2c9ca00700 1 -- 172.21.15.49:0/1454435910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9414efb0 con 0x7f2c94155d20 2024-01-22T05:08:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.440+0000 7f2c9ca00700 1 -- 172.21.15.49:0/1454435910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c940aab80 con 0x7f2c94155d20 2024-01-22T05:08:07.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.440+0000 7f2c91600700 1 -- 172.21.15.49:0/1454435910 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2c8c003040 con 0x7f2c94155d20 2024-01-22T05:08:07.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.440+0000 7f2c91600700 1 --2- 172.21.15.49:0/1454435910 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c6c05a540 0x7f2c6c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:07.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.440+0000 7f2c91600700 1 -- 172.21.15.49:0/1454435910 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2c8c076560 con 0x7f2c94155d20 2024-01-22T05:08:07.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.440+0000 7f2c9a000700 1 --2- 172.21.15.49:0/1454435910 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c6c05a540 0x7f2c6c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:07.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.444+0000 7f2c9a000700 1 --2- 172.21.15.49:0/1454435910 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c6c05a540 0x7f2c6c05ca00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f2c84011310 tx=0x7f2c84009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:07.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.452+0000 7f2c91600700 1 -- 172.21.15.49:0/1454435910 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2c8c049b20 con 0x7f2c94155d20 2024-01-22T05:08:07.466 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:08:07.471 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:08:07.493 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-22T05:08:07.492+0000 7f2b17800700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:08:07.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.656+0000 7f2c9ca00700 1 -- 172.21.15.49:0/1454435910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c940aaec0 con 0x7f2c94155d20 2024-01-22T05:08:07.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.660+0000 7f2c91600700 1 -- 172.21.15.49:0/1454435910 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f2c8c04d140 con 0x7f2c94155d20 2024-01-22T05:08:07.663 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:07.663 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:05.000169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.664+0000 7f2c9ca00700 1 -- 172.21.15.49:0/1454435910 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c6c05a540 msgr2=0x7f2c6c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.664+0000 7f2c9ca00700 1 --2- 172.21.15.49:0/1454435910 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c6c05a540 0x7f2c6c05ca00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f2c84011310 tx=0x7f2c84009060).stop 2024-01-22T05:08:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.664+0000 7f2c9ca00700 1 -- 172.21.15.49:0/1454435910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c94155d20 msgr2=0x7f2c940bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.664+0000 7f2c9ca00700 1 --2- 172.21.15.49:0/1454435910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c94155d20 0x7f2c940bfcd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f2c8c014000 tx=0x7f2c8c009780).stop 2024-01-22T05:08:07.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.664+0000 7f2c9ca00700 1 -- 172.21.15.49:0/1454435910 shutdown_connections 2024-01-22T05:08:07.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.664+0000 7f2c9ca00700 1 --2- 172.21.15.49:0/1454435910 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c6c05a540 0x7f2c6c05ca00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:07.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.664+0000 7f2c9ca00700 1 --2- 172.21.15.49:0/1454435910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c94155d20 0x7f2c940bfcd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:07.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.664+0000 7f2c9ca00700 1 --2- 172.21.15.49:0/1454435910 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c940a8e50 0x7f2c94153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:07.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.664+0000 7f2c9ca00700 1 --2- 172.21.15.49:0/1454435910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c94066070 0x7f2c9414eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:07.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.664+0000 7f2c9ca00700 1 -- 172.21.15.49:0/1454435910 >> 172.21.15.49:0/1454435910 conn(0x7f2c940c6540 msgr2=0x7f2c940c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.664+0000 7f2c9ca00700 1 -- 172.21.15.49:0/1454435910 shutdown_connections 2024-01-22T05:08:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:07.664+0000 7f2c9ca00700 1 -- 172.21.15.49:0/1454435910 wait complete. 2024-01-22T05:08:07.672 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 42 2024-01-22T05:08:08.095 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:08:01.969356+0000', 'modified': '2024-01-22T05:08:05.000169+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5569}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5569': {'gid': 5569, 'name': 'c', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6837/3428263289', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6836', 'nonce': 3428263289}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 3428263289}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:08:08.096 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:08:08.096 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-22T05:08:08.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.272+0000 7f9f97600700 1 Processor -- start 2024-01-22T05:08:08.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.272+0000 7f9f97600700 1 -- start start 2024-01-22T05:08:08.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f97600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f90155d20 0x7f9f90065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f97600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f900a8e50 0x7f9f900c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f97600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f900c1a40 con 0x7f9f90066070 2024-01-22T05:08:08.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f97600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f90159310 con 0x7f9f90155d20 2024-01-22T05:08:08.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f97600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900c13f0 con 0x7f9f900a8e50 2024-01-22T05:08:08.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f94c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f90155d20 0x7f9f90065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f95600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f900a8e50 0x7f9f900c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f8fe00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9f90066070 0x7f9f900a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:59292/0 (socket says 172.21.15.49:59292) 2024-01-22T05:08:08.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f8fe00700 1 -- 172.21.15.49:0/1310339867 learned_addr learned my addr 172.21.15.49:0/1310339867 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:08.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f95600700 1 -- 172.21.15.49:0/1310339867 >> v2:172.21.15.110:3300/0 conn(0x7f9f90155d20 msgr2=0x7f9f90065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:08.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f95600700 1 --2- 172.21.15.49:0/1310339867 >> v2:172.21.15.110:3300/0 conn(0x7f9f90155d20 0x7f9f90065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f95600700 1 -- 172.21.15.49:0/1310339867 >> v1:172.21.15.110:6789/0 conn(0x7f9f90066070 legacy=0x7f9f900a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f95600700 1 -- 172.21.15.49:0/1310339867 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f900c16d0 con 0x7f9f900a8e50 2024-01-22T05:08:08.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f95600700 1 --2- 172.21.15.49:0/1310339867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f900a8e50 0x7f9f900c1ed0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9f88009e60 tx=0x7f9f88009780).ready entity=mon.2 client_cookie=cb35a67731b6719 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:08.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f8f400700 1 -- 172.21.15.49:0/1310339867 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8800e070 con 0x7f9f900a8e50 2024-01-22T05:08:08.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.276+0000 7f9f8f400700 1 -- 172.21.15.49:0/1310339867 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8800bb60 con 0x7f9f900a8e50 2024-01-22T05:08:08.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.280+0000 7f9f8f400700 1 -- 172.21.15.49:0/1310339867 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88012410 con 0x7f9f900a8e50 2024-01-22T05:08:08.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.280+0000 7f9f97600700 1 -- 172.21.15.49:0/1310339867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f900a8e50 msgr2=0x7f9f900c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.280+0000 7f9f97600700 1 --2- 172.21.15.49:0/1310339867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f900a8e50 0x7f9f900c1ed0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9f88009e60 tx=0x7f9f88009780).stop 2024-01-22T05:08:08.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.280+0000 7f9f97600700 1 -- 172.21.15.49:0/1310339867 shutdown_connections 2024-01-22T05:08:08.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.280+0000 7f9f97600700 1 --2- 172.21.15.49:0/1310339867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f900a8e50 0x7f9f900c1ed0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.280+0000 7f9f97600700 1 --2- 172.21.15.49:0/1310339867 >> v2:172.21.15.110:3300/0 conn(0x7f9f90155d20 0x7f9f90065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.280+0000 7f9f97600700 1 -- 172.21.15.49:0/1310339867 >> 172.21.15.49:0/1310339867 conn(0x7f9f900c6540 msgr2=0x7f9f900c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:08.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.280+0000 7f9f97600700 1 -- 172.21.15.49:0/1310339867 shutdown_connections 2024-01-22T05:08:08.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.280+0000 7f9f97600700 1 -- 172.21.15.49:0/1310339867 wait complete. 2024-01-22T05:08:08.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.284+0000 7f9f97600700 1 Processor -- start 2024-01-22T05:08:08.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.284+0000 7f9f97600700 1 -- start start 2024-01-22T05:08:08.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.284+0000 7f9f97600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f90066070 0x7f9f900aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.284+0000 7f9f97600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f900a8e50 0x7f9f900c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.284+0000 7f9f97600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f90155d20 0x7f9f900c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.284+0000 7f9f97600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900c08d0 con 0x7f9f90155d20 2024-01-22T05:08:08.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.284+0000 7f9f97600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f901594f0 con 0x7f9f90066070 2024-01-22T05:08:08.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.284+0000 7f9f97600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f901597d0 con 0x7f9f900a8e50 2024-01-22T05:08:08.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.284+0000 7f9f95600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f90155d20 0x7f9f900c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.284+0000 7f9f95600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f90155d20 0x7f9f900c4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34114/0 (socket says 172.21.15.49:34114) 2024-01-22T05:08:08.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.284+0000 7f9f95600700 1 -- 172.21.15.49:0/4033664374 learned_addr learned my addr 172.21.15.49:0/4033664374 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:08.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.284+0000 7f9f94c00700 1 --2- 172.21.15.49:0/4033664374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f90066070 0x7f9f900aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.284+0000 7f9f8fe00700 1 --2- 172.21.15.49:0/4033664374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f900a8e50 0x7f9f900c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.288+0000 7f9f95600700 1 -- 172.21.15.49:0/4033664374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f900a8e50 msgr2=0x7f9f900c03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.288+0000 7f9f95600700 1 --2- 172.21.15.49:0/4033664374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f900a8e50 0x7f9f900c03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.288+0000 7f9f95600700 1 -- 172.21.15.49:0/4033664374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f90066070 msgr2=0x7f9f900aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.288+0000 7f9f95600700 1 --2- 172.21.15.49:0/4033664374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f90066070 0x7f9f900aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.288+0000 7f9f95600700 1 -- 172.21.15.49:0/4033664374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f88009a20 con 0x7f9f90155d20 2024-01-22T05:08:08.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.288+0000 7f9f95600700 1 --2- 172.21.15.49:0/4033664374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f90155d20 0x7f9f900c4e10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f9f8800b6c0 tx=0x7f9f88009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:08.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.288+0000 7f9f87e00700 1 -- 172.21.15.49:0/4033664374 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88012410 con 0x7f9f90155d20 2024-01-22T05:08:08.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.288+0000 7f9f87e00700 1 -- 172.21.15.49:0/4033664374 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8801d630 con 0x7f9f90155d20 2024-01-22T05:08:08.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.288+0000 7f9f87e00700 1 -- 172.21.15.49:0/4033664374 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8801d9f0 con 0x7f9f90155d20 2024-01-22T05:08:08.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.288+0000 7f9f97600700 1 -- 172.21.15.49:0/4033664374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f90159ab0 con 0x7f9f90155d20 2024-01-22T05:08:08.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.288+0000 7f9f97600700 1 -- 172.21.15.49:0/4033664374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f900ab2d0 con 0x7f9f90155d20 2024-01-22T05:08:08.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.292+0000 7f9f87e00700 1 -- 172.21.15.49:0/4033664374 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9f88003040 con 0x7f9f90155d20 2024-01-22T05:08:08.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.292+0000 7f9f87e00700 1 --2- 172.21.15.49:0/4033664374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f6805a510 0x7f9f6805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.292+0000 7f9f87e00700 1 -- 172.21.15.49:0/4033664374 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9f88076740 con 0x7f9f90155d20 2024-01-22T05:08:08.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.292+0000 7f9f94c00700 1 --2- 172.21.15.49:0/4033664374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f6805a510 0x7f9f6805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.296+0000 7f9f94c00700 1 --2- 172.21.15.49:0/4033664374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f6805a510 0x7f9f6805c9d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f9f80009b90 tx=0x7f9f80009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:08.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.296+0000 7f9fa1a79740 1 Processor -- start 2024-01-22T05:08:08.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.296+0000 7f9fa1a79740 1 -- start start 2024-01-22T05:08:08.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.296+0000 7f9fa1a79740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 0x25ead10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.296+0000 7f9fa1a79740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25c5e40 0x25c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.296+0000 7f9fa1a79740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2606780 0x25bf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.296+0000 7f9fa1a79740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2545410 con 0x2606780 2024-01-22T05:08:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.296+0000 7f9fa1a79740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2545550 con 0x25c5e40 2024-01-22T05:08:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.296+0000 7f9fa1a79740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2545a00 con 0x26063a0 2024-01-22T05:08:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.296+0000 7f9f95600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2606780 0x25bf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.296+0000 7f9f95600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2606780 0x25bf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34124/0 (socket says 172.21.15.49:34124) 2024-01-22T05:08:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.296+0000 7f9f95600700 1 -- 172.21.15.49:0/3002869127 learned_addr learned my addr 172.21.15.49:0/3002869127 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.296+0000 7f9f94c00700 1 --2- 172.21.15.49:0/3002869127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 0x25ead10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.296+0000 7f9f8fe00700 1 --2- 172.21.15.49:0/3002869127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25c5e40 0x25c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9f95600700 1 -- 172.21.15.49:0/3002869127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 msgr2=0x25ead10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9f95600700 1 --2- 172.21.15.49:0/3002869127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 0x25ead10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9f95600700 1 -- 172.21.15.49:0/3002869127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25c5e40 msgr2=0x25c1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9f95600700 1 --2- 172.21.15.49:0/3002869127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25c5e40 0x25c1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9f95600700 1 -- 172.21.15.49:0/3002869127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x253e730 con 0x2606780 2024-01-22T05:08:08.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9f94c00700 1 --2- 172.21.15.49:0/3002869127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 0x25ead10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:08.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9f8fe00700 1 --2- 172.21.15.49:0/3002869127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25c5e40 0x25c1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:08.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9f95600700 1 --2- 172.21.15.49:0/3002869127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2606780 0x25bf3a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f9f8804d960 tx=0x7f9f8800e000).ready entity=mon.0 client_cookie=f9fa544bdb831485 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:08.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9f7fe00700 1 -- 172.21.15.49:0/3002869127 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8804bc90 con 0x2606780 2024-01-22T05:08:08.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9f7fe00700 1 -- 172.21.15.49:0/3002869127 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f88053170 con 0x2606780 2024-01-22T05:08:08.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9f7fe00700 1 -- 172.21.15.49:0/3002869127 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88024310 con 0x2606780 2024-01-22T05:08:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9fa1a79740 1 -- 172.21.15.49:0/3002869127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2606780 msgr2=0x25bf3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/3002869127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2606780 0x25bf3a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f9f8804d960 tx=0x7f9f8800e000).stop 2024-01-22T05:08:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9fa1a79740 1 -- 172.21.15.49:0/3002869127 shutdown_connections 2024-01-22T05:08:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/3002869127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2606780 0x25bf3a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/3002869127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25c5e40 0x25c1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/3002869127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 0x25ead10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9fa1a79740 1 -- 172.21.15.49:0/3002869127 >> 172.21.15.49:0/3002869127 conn(0x23a3550 msgr2=0x25c5730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9fa1a79740 1 -- 172.21.15.49:0/3002869127 shutdown_connections 2024-01-22T05:08:08.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.300+0000 7f9fa1a79740 1 -- 172.21.15.49:0/3002869127 wait complete. 2024-01-22T05:08:08.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.304+0000 7f9fa1a79740 1 -- start start 2024-01-22T05:08:08.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.304+0000 7f9fa1a79740 1 Processor -- start 2024-01-22T05:08:08.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.304+0000 7f9fa1a79740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c5e40 0x25e45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.304+0000 7f9fa1a79740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 0x260aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.304+0000 7f9fa1a79740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2606780 0x25c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.304+0000 7f9fa1a79740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2510650 con 0x25c5e40 2024-01-22T05:08:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.304+0000 7f9fa1a79740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x25f0fb0 con 0x2606780 2024-01-22T05:08:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.304+0000 7f9fa1a79740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x260a3d0 con 0x26063a0 2024-01-22T05:08:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.304+0000 7f9fa1a79740 10 client.0 ll_register_callbacks cb 0x257d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f94c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c5e40 0x25e45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f94c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c5e40 0x25e45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34130/0 (socket says 172.21.15.49:34130) 2024-01-22T05:08:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f94c00700 1 -- 172.21.15.49:0/1514282011 learned_addr learned my addr 172.21.15.49:0/1514282011 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f95600700 1 --2- 172.21.15.49:0/1514282011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2606780 0x25c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f8fe00700 1 --2- 172.21.15.49:0/1514282011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 0x260aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f94c00700 1 -- 172.21.15.49:0/1514282011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 msgr2=0x260aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f94c00700 1 --2- 172.21.15.49:0/1514282011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 0x260aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f94c00700 1 -- 172.21.15.49:0/1514282011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2606780 msgr2=0x25c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f94c00700 1 --2- 172.21.15.49:0/1514282011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2606780 0x25c24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f94c00700 1 -- 172.21.15.49:0/1514282011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f900ab2d0 con 0x25c5e40 2024-01-22T05:08:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f94c00700 1 --2- 172.21.15.49:0/1514282011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c5e40 0x25e45e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f9f80014740 tx=0x7f9f80017000).ready entity=mon.0 client_cookie=9d4f8e152eb67f9f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f7cc00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:08.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f7cc00700 1 -- 172.21.15.49:0/1514282011 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f80011890 con 0x25c5e40 2024-01-22T05:08:08.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f7cc00700 1 -- 172.21.15.49:0/1514282011 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9f80020680 con 0x25c5e40 2024-01-22T05:08:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9fa1a79740 1 -- 172.21.15.49:0/1514282011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x253b1a0 con 0x25c5e40 2024-01-22T05:08:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f7cc00700 1 -- 172.21.15.49:0/1514282011 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f80020a50 con 0x25c5e40 2024-01-22T05:08:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9fa1a79740 10 client.5718 fetch_fsmap learned FSMap version 42 2024-01-22T05:08:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9fa1a79740 1 -- 172.21.15.49:0/1514282011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x2539960 con 0x25c5e40 2024-01-22T05:08:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f7cc00700 1 -- 172.21.15.49:0/1514282011 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x253b1a0 con 0x25c5e40 2024-01-22T05:08:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f7cc00700 1 -- 172.21.15.49:0/1514282011 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9f80020bb0 con 0x25c5e40 2024-01-22T05:08:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9fa1a79740 10 client.5718 fetch_fsmap finished waiting for FSMap version 42 2024-01-22T05:08:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9fa1a79740 10 client.5718 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-22T05:08:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9fa1a79740 20 client.5718 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/1514282011 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25f0300 0x25f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9fa1a79740 4 client.5718 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9fa1a79740 1 -- 172.21.15.49:0/1514282011 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x25316f0 con 0x25f0300 2024-01-22T05:08:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.308+0000 7f9f8fe00700 1 --2- 172.21.15.49:0/1514282011 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25f0300 0x25f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9f8fe00700 1 --2- 172.21.15.49:0/1514282011 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25f0300 0x25f06e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=821f345014cc6024 server_cookie=720b0d989f28b4ce in_seq=0 out_seq=0 2024-01-22T05:08:08.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9f7cc00700 10 client.5718 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:08.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9f7cc00700 1 -- 172.21.15.49:0/1514282011 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x25316f0 con 0x25f0300 2024-01-22T05:08:08.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9f7cc00700 10 client.5718 handle_command_reply: tid=0 2024-01-22T05:08:08.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9fa1a79740 1 client.5718 shutdown 2024-01-22T05:08:08.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9fa1a79740 1 -- 172.21.15.49:0/1514282011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c5e40 msgr2=0x25e45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/1514282011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c5e40 0x25e45e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f9f80014740 tx=0x7f9f80017000).stop 2024-01-22T05:08:08.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9fa1a79740 1 -- 172.21.15.49:0/1514282011 shutdown_connections 2024-01-22T05:08:08.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/1514282011 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25f0300 0x25f06e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/1514282011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2606780 0x25c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9f7cc00700 0 client.5718 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:08.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/1514282011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 0x260aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/1514282011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c5e40 0x25e45e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9fa1a79740 1 -- 172.21.15.49:0/1514282011 >> 172.21.15.49:0/1514282011 conn(0x23a3550 msgr2=0x260c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:08.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9fa1a79740 1 -- 172.21.15.49:0/1514282011 shutdown_connections 2024-01-22T05:08:08.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.312+0000 7f9fa1a79740 1 -- 172.21.15.49:0/1514282011 wait complete. 2024-01-22T05:08:08.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.316+0000 7f9fa1a79740 20 client.5718 trim_cache size 0 max 16384 2024-01-22T05:08:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9fa1a79740 1 Processor -- start 2024-01-22T05:08:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9fa1a79740 1 -- start start 2024-01-22T05:08:08.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9fa1a79740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c5e40 0x25ea7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9fa1a79740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 0x25eeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9fa1a79740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2606780 0x25eefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9fa1a79740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2609320 con 0x25c5e40 2024-01-22T05:08:08.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9fa1a79740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x25f0af0 con 0x2606780 2024-01-22T05:08:08.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9fa1a79740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x25c04e0 con 0x26063a0 2024-01-22T05:08:08.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9f94c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c5e40 0x25ea7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9f94c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c5e40 0x25ea7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34132/0 (socket says 172.21.15.49:34132) 2024-01-22T05:08:08.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9f94c00700 1 -- 172.21.15.49:0/557797342 learned_addr learned my addr 172.21.15.49:0/557797342 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:08.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9f8fe00700 1 --2- 172.21.15.49:0/557797342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 0x25eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9f95600700 1 --2- 172.21.15.49:0/557797342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2606780 0x25eefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9f8fe00700 1 -- 172.21.15.49:0/557797342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2606780 msgr2=0x25eefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:08.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9f8fe00700 1 --2- 172.21.15.49:0/557797342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2606780 0x25eefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9f8fe00700 1 -- 172.21.15.49:0/557797342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c5e40 msgr2=0x25ea7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:08.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9f8fe00700 1 --2- 172.21.15.49:0/557797342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c5e40 0x25ea7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9f8fe00700 1 -- 172.21.15.49:0/557797342 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f90153950 con 0x26063a0 2024-01-22T05:08:08.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.336+0000 7f9f8fe00700 1 --2- 172.21.15.49:0/557797342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 0x25eeae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x25c0f30 tx=0x7f9f78007d30).ready entity=mon.2 client_cookie=7362c789e6ab0a7e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:08.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.340+0000 7f9f85200700 1 -- 172.21.15.49:0/557797342 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f78004da0 con 0x26063a0 2024-01-22T05:08:08.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.340+0000 7f9f85200700 1 -- 172.21.15.49:0/557797342 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7801c040 con 0x26063a0 2024-01-22T05:08:08.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.340+0000 7f9f85200700 1 -- 172.21.15.49:0/557797342 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f780169f0 con 0x26063a0 2024-01-22T05:08:08.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.340+0000 7f9fa1a79740 1 -- 172.21.15.49:0/557797342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 msgr2=0x25eeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.340+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/557797342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 0x25eeae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x25c0f30 tx=0x7f9f78007d30).stop 2024-01-22T05:08:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.340+0000 7f9fa1a79740 1 -- 172.21.15.49:0/557797342 shutdown_connections 2024-01-22T05:08:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.340+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/557797342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2606780 0x25eefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.340+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/557797342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26063a0 0x25eeae0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.340+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/557797342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c5e40 0x25ea7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.340+0000 7f9fa1a79740 1 -- 172.21.15.49:0/557797342 >> 172.21.15.49:0/557797342 conn(0x23a3550 msgr2=0x26058c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.340+0000 7f9fa1a79740 1 -- 172.21.15.49:0/557797342 shutdown_connections 2024-01-22T05:08:08.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.340+0000 7f9fa1a79740 1 -- 172.21.15.49:0/557797342 wait complete. 2024-01-22T05:08:08.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.340+0000 7f9fa1a79740 1 -- start start 2024-01-22T05:08:08.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.344+0000 7f9fa1a79740 1 Processor -- start 2024-01-22T05:08:08.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9fa1a79740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c5e40 0x266d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9fa1a79740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26063a0 0x25c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9fa1a79740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2606780 0x25c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9fa1a79740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x25c4f90 con 0x26063a0 2024-01-22T05:08:08.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9fa1a79740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x266dd40 con 0x2606780 2024-01-22T05:08:08.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9fa1a79740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2609c30 con 0x25c5e40 2024-01-22T05:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9fa1a79740 10 client.0 ll_register_callbacks cb 0x7f9f80011e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9f8fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26063a0 0x25c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9f8fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26063a0 0x25c45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34146/0 (socket says 172.21.15.49:34146) 2024-01-22T05:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9f8fe00700 1 -- 172.21.15.49:0/3887444692 learned_addr learned my addr 172.21.15.49:0/3887444692 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9f94c00700 1 --2- 172.21.15.49:0/3887444692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c5e40 0x266d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9f95600700 1 --2- 172.21.15.49:0/3887444692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2606780 0x25c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9f8fe00700 1 -- 172.21.15.49:0/3887444692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c5e40 msgr2=0x266d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:08.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9f8fe00700 1 --2- 172.21.15.49:0/3887444692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c5e40 0x266d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9f8fe00700 1 -- 172.21.15.49:0/3887444692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2606780 msgr2=0x25c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:08.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9f8fe00700 1 --2- 172.21.15.49:0/3887444692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2606780 0x25c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9f8fe00700 1 -- 172.21.15.49:0/3887444692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f900c1a40 con 0x26063a0 2024-01-22T05:08:08.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9f8fe00700 1 --2- 172.21.15.49:0/3887444692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26063a0 0x25c45b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x25c6280 tx=0x7f9f78020000).ready entity=mon.0 client_cookie=b70943af2653282c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:08.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9f7cc00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:08.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9f7cc00700 1 -- 172.21.15.49:0/3887444692 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f78027070 con 0x26063a0 2024-01-22T05:08:08.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9f7cc00700 1 -- 172.21.15.49:0/3887444692 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9f78024a00 con 0x26063a0 2024-01-22T05:08:08.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9fa1a79740 1 -- 172.21.15.49:0/3887444692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9f88053170 con 0x26063a0 2024-01-22T05:08:08.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9f7cc00700 1 -- 172.21.15.49:0/3887444692 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f780169f0 con 0x26063a0 2024-01-22T05:08:08.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9fa1a79740 10 client.5724 fetch_fsmap learned FSMap version 42 2024-01-22T05:08:08.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.348+0000 7f9fa1a79740 1 -- 172.21.15.49:0/3887444692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x25396b0 con 0x26063a0 2024-01-22T05:08:08.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9f7cc00700 1 -- 172.21.15.49:0/3887444692 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f88053170 con 0x26063a0 2024-01-22T05:08:08.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9f7cc00700 1 -- 172.21.15.49:0/3887444692 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9f78024020 con 0x26063a0 2024-01-22T05:08:08.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9fa1a79740 10 client.5724 fetch_fsmap finished waiting for FSMap version 42 2024-01-22T05:08:08.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9fa1a79740 10 client.5724 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-22T05:08:08.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9fa1a79740 20 client.5724 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:08.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/3887444692 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25e5090 0x25e5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9fa1a79740 4 client.5724 mds_command: new command op to 5569 tid=0[{"prefix": "status"}] 2024-01-22T05:08:08.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9fa1a79740 1 -- 172.21.15.49:0/3887444692 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "status"}) v1 -- 0x23fa4e0 con 0x25e5090 2024-01-22T05:08:08.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9f94c00700 1 --2- 172.21.15.49:0/3887444692 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25e5090 0x25e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9f7cc00700 10 client.5724 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:08.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9f94c00700 1 --2- 172.21.15.49:0/3887444692 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25e5090 0x25e5470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=79801a1e2c66ed31 server_cookie=d3c3e0a4f296c867 in_seq=0 out_seq=0 2024-01-22T05:08:08.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9f7cc00700 1 -- 172.21.15.49:0/3887444692 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x23fa4e0 con 0x25e5090 2024-01-22T05:08:08.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9f7cc00700 10 client.5724 handle_command_reply: tid=0 2024-01-22T05:08:08.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9fa1a79740 1 client.5724 shutdown 2024-01-22T05:08:08.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9fa1a79740 1 -- 172.21.15.49:0/3887444692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26063a0 msgr2=0x25c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/3887444692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26063a0 0x25c45b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x25c6280 tx=0x7f9f78020000).stop 2024-01-22T05:08:08.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9fa1a79740 1 -- 172.21.15.49:0/3887444692 shutdown_connections 2024-01-22T05:08:08.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/3887444692 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25e5090 0x25e5470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/3887444692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2606780 0x25c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.352+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/3887444692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26063a0 0x25c45b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9f7cc00700 0 client.5724 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:08.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9fa1a79740 1 --2- 172.21.15.49:0/3887444692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c5e40 0x266d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9fa1a79740 1 -- 172.21.15.49:0/3887444692 >> 172.21.15.49:0/3887444692 conn(0x23a3550 msgr2=0x2619380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:08.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9fa1a79740 1 -- 172.21.15.49:0/3887444692 shutdown_connections 2024-01-22T05:08:08.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9fa1a79740 1 -- 172.21.15.49:0/3887444692 wait complete. 2024-01-22T05:08:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9fa1a79740 20 client.5724 trim_cache size 0 max 16384 2024-01-22T05:08:08.360 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:08.360 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:08:08.360 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:08:08.360 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5569, 2024-01-22T05:08:08.360 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:08:08.361 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:08:08.361 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:08:08.361 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 6.3793320509999996, 2024-01-22T05:08:08.361 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 42, 2024-01-22T05:08:08.361 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 56, 2024-01-22T05:08:08.361 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 56, 2024-01-22T05:08:08.361 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 11.752429467000001 2024-01-22T05:08:08.362 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:08.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9f97600700 1 -- 172.21.15.49:0/4033664374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f6805a510 msgr2=0x7f9f6805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9f97600700 1 --2- 172.21.15.49:0/4033664374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f6805a510 0x7f9f6805c9d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f9f80009b90 tx=0x7f9f80009060).stop 2024-01-22T05:08:08.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9f97600700 1 -- 172.21.15.49:0/4033664374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f90155d20 msgr2=0x7f9f900c4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9f97600700 1 --2- 172.21.15.49:0/4033664374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f90155d20 0x7f9f900c4e10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f9f8800b6c0 tx=0x7f9f88009780).stop 2024-01-22T05:08:08.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9f97600700 1 -- 172.21.15.49:0/4033664374 shutdown_connections 2024-01-22T05:08:08.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9f97600700 1 --2- 172.21.15.49:0/4033664374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f6805a510 0x7f9f6805c9d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9f97600700 1 --2- 172.21.15.49:0/4033664374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f90155d20 0x7f9f900c4e10 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9f97600700 1 --2- 172.21.15.49:0/4033664374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f900a8e50 0x7f9f900c03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9f97600700 1 --2- 172.21.15.49:0/4033664374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f90066070 0x7f9f900aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9f97600700 1 -- 172.21.15.49:0/4033664374 >> 172.21.15.49:0/4033664374 conn(0x7f9f900c6540 msgr2=0x7f9f90067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:08.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9f97600700 1 -- 172.21.15.49:0/4033664374 shutdown_connections 2024-01-22T05:08:08.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.356+0000 7f9f97600700 1 -- 172.21.15.49:0/4033664374 wait complete. 2024-01-22T05:08:08.385 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:08:08.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.520+0000 7f0ecdc00700 1 Processor -- start 2024-01-22T05:08:08.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.524+0000 7f0ecdc00700 1 -- start start 2024-01-22T05:08:08.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ecdc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ec8153ab0 0x7f0ec80c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ecdc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ec8068720 0x7f0ec8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ecdc00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec8069070 con 0x7f0ec80c76e0 2024-01-22T05:08:08.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ecdc00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec80c3ba0 con 0x7f0ec8068720 2024-01-22T05:08:08.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ecdc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80c3e80 con 0x7f0ec8153ab0 2024-01-22T05:08:08.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ecd200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0ec80c76e0 0x7f0ec80c7b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42188/0 (socket says 172.21.15.49:42188) 2024-01-22T05:08:08.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ecd200700 1 -- 172.21.15.49:0/893859835 learned_addr learned my addr 172.21.15.49:0/893859835 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:08.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ec7400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ec8068720 0x7f0ec8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ec7e00700 1 --2- 172.21.15.49:0/893859835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ec8153ab0 0x7f0ec80c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ec6a00700 1 -- 172.21.15.49:0/893859835 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828208062 0 0) 0x7f0ec8069070 con 0x7f0ec80c76e0 2024-01-22T05:08:08.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ec6a00700 1 -- 172.21.15.49:0/893859835 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea80033f0 con 0x7f0ec80c76e0 2024-01-22T05:08:08.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ec7e00700 1 -- 172.21.15.49:0/893859835 >> v2:172.21.15.49:3300/0 conn(0x7f0ec8068720 msgr2=0x7f0ec8068b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:08.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ec7e00700 1 --2- 172.21.15.49:0/893859835 >> v2:172.21.15.49:3300/0 conn(0x7f0ec8068720 0x7f0ec8068b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ec7e00700 1 -- 172.21.15.49:0/893859835 >> v1:172.21.15.49:6789/0 conn(0x7f0ec80c76e0 legacy=0x7f0ec80c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ec7e00700 1 -- 172.21.15.49:0/893859835 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec80c4160 con 0x7f0ec8153ab0 2024-01-22T05:08:08.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ec7e00700 1 --2- 172.21.15.49:0/893859835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ec8153ab0 0x7f0ec80c3250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0eb8009760 tx=0x7f0eb8009060).ready entity=mon.2 client_cookie=acf8d6e7d5e995ae server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:08.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ec6a00700 1 -- 172.21.15.49:0/893859835 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb800d4a0 con 0x7f0ec8153ab0 2024-01-22T05:08:08.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ec6a00700 1 -- 172.21.15.49:0/893859835 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb800d600 con 0x7f0ec8153ab0 2024-01-22T05:08:08.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.528+0000 7f0ec6a00700 1 -- 172.21.15.49:0/893859835 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb800d980 con 0x7f0ec8153ab0 2024-01-22T05:08:08.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.532+0000 7f0ecdc00700 1 -- 172.21.15.49:0/893859835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ec8153ab0 msgr2=0x7f0ec80c3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.532+0000 7f0ecdc00700 1 --2- 172.21.15.49:0/893859835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ec8153ab0 0x7f0ec80c3250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0eb8009760 tx=0x7f0eb8009060).stop 2024-01-22T05:08:08.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.532+0000 7f0ecdc00700 1 -- 172.21.15.49:0/893859835 shutdown_connections 2024-01-22T05:08:08.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.532+0000 7f0ecdc00700 1 --2- 172.21.15.49:0/893859835 >> v2:172.21.15.49:3300/0 conn(0x7f0ec8068720 0x7f0ec8068b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.532+0000 7f0ecdc00700 1 --2- 172.21.15.49:0/893859835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ec8153ab0 0x7f0ec80c3250 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.532+0000 7f0ecdc00700 1 -- 172.21.15.49:0/893859835 >> 172.21.15.49:0/893859835 conn(0x7f0ec80c5d40 msgr2=0x7f0ec8068010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:08.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.532+0000 7f0ecdc00700 1 -- 172.21.15.49:0/893859835 shutdown_connections 2024-01-22T05:08:08.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.532+0000 7f0ecdc00700 1 -- 172.21.15.49:0/893859835 wait complete. 2024-01-22T05:08:08.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ecdc00700 1 Processor -- start 2024-01-22T05:08:08.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ecdc00700 1 -- start start 2024-01-22T05:08:08.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ecdc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ec8068720 0x7f0ec8168560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ecdc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ec80c76e0 0x7f0ec81485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ecdc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ec8153ab0 0x7f0ec8067160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ecdc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec8168a50 con 0x7f0ec80c76e0 2024-01-22T05:08:08.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ecdc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec8065de0 con 0x7f0ec8068720 2024-01-22T05:08:08.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ecdc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80660c0 con 0x7f0ec8153ab0 2024-01-22T05:08:08.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ec7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ec80c76e0 0x7f0ec81485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ec7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ec80c76e0 0x7f0ec81485a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34164/0 (socket says 172.21.15.49:34164) 2024-01-22T05:08:08.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ec7400700 1 -- 172.21.15.49:0/2386205662 learned_addr learned my addr 172.21.15.49:0/2386205662 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:08.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ecd200700 1 --2- 172.21.15.49:0/2386205662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ec8153ab0 0x7f0ec8067160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ec7e00700 1 --2- 172.21.15.49:0/2386205662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ec8068720 0x7f0ec8168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ec7400700 1 -- 172.21.15.49:0/2386205662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ec8153ab0 msgr2=0x7f0ec8067160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ec7400700 1 --2- 172.21.15.49:0/2386205662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ec8153ab0 0x7f0ec8067160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ec7400700 1 -- 172.21.15.49:0/2386205662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ec8068720 msgr2=0x7f0ec8168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ec7400700 1 --2- 172.21.15.49:0/2386205662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ec8068720 0x7f0ec8168560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.536+0000 7f0ec7400700 1 -- 172.21.15.49:0/2386205662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb80092a0 con 0x7f0ec80c76e0 2024-01-22T05:08:08.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.540+0000 7f0ec7400700 1 --2- 172.21.15.49:0/2386205662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ec80c76e0 0x7f0ec81485a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f0eb000e8d0 tx=0x7f0eb0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:08.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.540+0000 7f0ebf400700 1 -- 172.21.15.49:0/2386205662 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0012600 con 0x7f0ec80c76e0 2024-01-22T05:08:08.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.540+0000 7f0ebf400700 1 -- 172.21.15.49:0/2386205662 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb0012760 con 0x7f0ec80c76e0 2024-01-22T05:08:08.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.540+0000 7f0ecdc00700 1 -- 172.21.15.49:0/2386205662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec80663a0 con 0x7f0ec80c76e0 2024-01-22T05:08:08.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.540+0000 7f0ebf400700 1 -- 172.21.15.49:0/2386205662 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0012ae0 con 0x7f0ec80c76e0 2024-01-22T05:08:08.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.540+0000 7f0ecdc00700 1 -- 172.21.15.49:0/2386205662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec8066960 con 0x7f0ec80c76e0 2024-01-22T05:08:08.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.540+0000 7f0ecdc00700 1 -- 172.21.15.49:0/2386205662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec805ee90 con 0x7f0ec80c76e0 2024-01-22T05:08:08.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.540+0000 7f0ebf400700 1 -- 172.21.15.49:0/2386205662 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0eb001b400 con 0x7f0ec80c76e0 2024-01-22T05:08:08.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.544+0000 7f0ebf400700 1 --2- 172.21.15.49:0/2386205662 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0ea005a510 0x7f0ea005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:08.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.544+0000 7f0ebf400700 1 -- 172.21.15.49:0/2386205662 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f0eb0074c50 con 0x7f0ec80c76e0 2024-01-22T05:08:08.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.544+0000 7f0ec7e00700 1 --2- 172.21.15.49:0/2386205662 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0ea005a510 0x7f0ea005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:08.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.544+0000 7f0ec7e00700 1 --2- 172.21.15.49:0/2386205662 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0ea005a510 0x7f0ea005c9d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f0eb800d260 tx=0x7f0eb8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:08.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.552+0000 7f0ebf400700 1 -- 172.21.15.49:0/2386205662 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0eb007a020 con 0x7f0ec80c76e0 2024-01-22T05:08:08.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.752+0000 7f0ecdc00700 1 -- 172.21.15.49:0/2386205662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0ec80c4440 con 0x7f0ec80c76e0 2024-01-22T05:08:08.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.752+0000 7f0ebf400700 1 -- 172.21.15.49:0/2386205662 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0eb0048270 con 0x7f0ec80c76e0 2024-01-22T05:08:08.757 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:08:08.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.756+0000 7f0ecdc00700 1 -- 172.21.15.49:0/2386205662 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0ea005a510 msgr2=0x7f0ea005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.756+0000 7f0ecdc00700 1 --2- 172.21.15.49:0/2386205662 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0ea005a510 0x7f0ea005c9d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f0eb800d260 tx=0x7f0eb8016000).stop 2024-01-22T05:08:08.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.756+0000 7f0ecdc00700 1 -- 172.21.15.49:0/2386205662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ec80c76e0 msgr2=0x7f0ec81485a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:08.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.756+0000 7f0ecdc00700 1 --2- 172.21.15.49:0/2386205662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ec80c76e0 0x7f0ec81485a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f0eb000e8d0 tx=0x7f0eb0009060).stop 2024-01-22T05:08:08.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.756+0000 7f0ecdc00700 1 -- 172.21.15.49:0/2386205662 shutdown_connections 2024-01-22T05:08:08.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.756+0000 7f0ecdc00700 1 --2- 172.21.15.49:0/2386205662 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0ea005a510 0x7f0ea005c9d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.756+0000 7f0ecdc00700 1 --2- 172.21.15.49:0/2386205662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ec8153ab0 0x7f0ec8067160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.756+0000 7f0ecdc00700 1 --2- 172.21.15.49:0/2386205662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ec80c76e0 0x7f0ec81485a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.756+0000 7f0ecdc00700 1 --2- 172.21.15.49:0/2386205662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ec8068720 0x7f0ec8168560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:08.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.756+0000 7f0ecdc00700 1 -- 172.21.15.49:0/2386205662 >> 172.21.15.49:0/2386205662 conn(0x7f0ec80c5d40 msgr2=0x7f0ec80be040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:08.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.756+0000 7f0ecdc00700 1 -- 172.21.15.49:0/2386205662 shutdown_connections 2024-01-22T05:08:08.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:08.756+0000 7f0ecdc00700 1 -- 172.21.15.49:0/2386205662 wait complete. 2024-01-22T05:08:08.781 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-22T05:08:08.781 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:08:08.781 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:08:08.781 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:08:08.781 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:08:08.781 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-22T05:08:08.781 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-22T05:08:08.781 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:08:08.781 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:08:08.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:08:08.782 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:08:08.801 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:08:08.801 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:08:08.801 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:08:08.801 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:08:08.801 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:08:08.802 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:08:08.802 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:08:08.802 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:08:08.802 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:08:08.802 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:08:08.802 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:08:08.802 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:08:08.802 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:08:08.802 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42282sec preferred_lft 42282sec 2024-01-22T05:08:08.803 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:08:08.803 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:08:08.803 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:08:08.803 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:08:08.803 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:08:08.803 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:08:08.803 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:08:08.803 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:08:08.803 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:08:08.803 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:08:08.803 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:08:08.803 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:08:08.803 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:08:08.803 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:08:08.804 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:08:08.804 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:08:08.804 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::7ce7:e3ff:fed1:1e88/64 scope link 2024-01-22T05:08:08.804 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:08:08.804 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:08:08.804 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 82:c1:48:e7:c7:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:08:08.804 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::80c1:48ff:fee7:c731/64 scope link 2024-01-22T05:08:08.804 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:08:08.804 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:08:08.804 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:08:08.804 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3426:32ff:feee:c4c9/64 scope link 2024-01-22T05:08:08.804 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:08:08.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:08:08.805 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:08:08.878 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:08:08.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:08:08.881 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:08:08.949 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:08:08.949 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:08:08.949 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:08:08.949 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:08:08.949 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:08:08.949 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:08:08.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:08:08.950 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:08:08.950 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:08:08.950 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:08:08.950 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:08:08.950 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:08:08.950 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:08:09.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:08:09.083 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:08:09.100 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:08:09.100 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:08:09.101 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:08:09.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:08:09.101 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-22T05:08:09.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:08:09.182 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-22T05:08:09.245 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:08:09.245 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:08:09.366 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:08:09.366 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:08:09.387 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:08:09.388 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:08:09.393 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:08:09.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:08:09.394 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:08:09.424 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-01-22T05:08:09.424 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-01-22T05:08:09.425 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-01-22T05:08:09.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:08:09.425 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-01-22T05:08:09.499 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:08:09.499 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-01-22T05:08:09.499 DEBUG:teuthology.orchestra.run.smithi049:> import stat 2024-01-22T05:08:09.499 DEBUG:teuthology.orchestra.run.smithi049:> import json 2024-01-22T05:08:09.499 DEBUG:teuthology.orchestra.run.smithi049:> import sys 2024-01-22T05:08:09.499 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:08:09.499 DEBUG:teuthology.orchestra.run.smithi049:> try: 2024-01-22T05:08:09.500 DEBUG:teuthology.orchestra.run.smithi049:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-01-22T05:08:09.500 DEBUG:teuthology.orchestra.run.smithi049:> except OSError as e: 2024-01-22T05:08:09.500 DEBUG:teuthology.orchestra.run.smithi049:> sys.exit(e.errno) 2024-01-22T05:08:09.500 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:08:09.500 DEBUG:teuthology.orchestra.run.smithi049:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-01-22T05:08:09.500 DEBUG:teuthology.orchestra.run.smithi049:> print(json.dumps( 2024-01-22T05:08:09.500 DEBUG:teuthology.orchestra.run.smithi049:> dict([(a, getattr(s, a)) for a in attrs]), 2024-01-22T05:08:09.500 DEBUG:teuthology.orchestra.run.smithi049:> indent=2)) 2024-01-22T05:08:09.500 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-01-22T05:08:09.825 INFO:teuthology.orchestra.run.smithi049.stderr:daemon-helper: command failed with exit status 2 2024-01-22T05:08:09.839 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-01-22T05:08:09.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:08:09.839 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2024-01-22T05:08:09.912 INFO:teuthology.orchestra.run.smithi049.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2024-01-22T05:08:10.235 INFO:teuthology.orchestra.run.smithi049.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-01-22T05:08:14.839 INFO:teuthology.orchestra.run.smithi049.stderr:Updating files: 33% (474/1398) Updating files: 34% (476/1398) Updating files: 35% (490/1398) Updating files: 36% (504/1398) Updating files: 37% (518/1398) Updating files: 38% (532/1398) Updating files: 39% (546/1398) Updating files: 40% (560/1398) Updating files: 41% (574/1398) Updating files: 42% (588/1398) Updating files: 43% (602/1398) Updating files: 44% (616/1398) Updating files: 45% (630/1398) Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 54% (760/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 83% (1170/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-01-22T05:08:14.849 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2024-01-22T05:08:14.849 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-01-22T05:08:14.849 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:15.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.056+0000 7fe776a00700 1 Processor -- start 2024-01-22T05:08:15.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.056+0000 7fe776a00700 1 -- start start 2024-01-22T05:08:15.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.056+0000 7fe776a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe7700bc580 0x7fe7700bca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.056+0000 7fe776a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe770153930 0x7fe770153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.056+0000 7fe776a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7700c2130 con 0x7fe7700c2d90 2024-01-22T05:08:15.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.056+0000 7fe776a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe770154c50 con 0x7fe7700bc580 2024-01-22T05:08:15.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.056+0000 7fe776a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe770154f30 con 0x7fe770153930 2024-01-22T05:08:15.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe76f400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe7700bc580 0x7fe7700bca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe774a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe770153930 0x7fe770153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe76f400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe7700bc580 0x7fe7700bca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:46868/0 (socket says 172.21.15.49:46868) 2024-01-22T05:08:15.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe76f400700 1 -- 172.21.15.49:0/1837014817 learned_addr learned my addr 172.21.15.49:0/1837014817 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:15.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe76fe00700 1 --1- 172.21.15.49:0/1837014817 >> v1:172.21.15.110:6789/0 conn(0x7fe7700c2d90 0x7fe7700c3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:41222/0 (socket says 172.21.15.49:41222) 2024-01-22T05:08:15.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe76f400700 1 -- 172.21.15.49:0/1837014817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe770153930 msgr2=0x7fe770153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:15.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe76f400700 1 --2- 172.21.15.49:0/1837014817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe770153930 0x7fe770153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe76f400700 1 -- 172.21.15.49:0/1837014817 >> v1:172.21.15.110:6789/0 conn(0x7fe7700c2d90 legacy=0x7fe7700c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe76f400700 1 -- 172.21.15.49:0/1837014817 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7700c1dc0 con 0x7fe7700bc580 2024-01-22T05:08:15.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe774a00700 1 --2- 172.21.15.49:0/1837014817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe770153930 0x7fe770153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:15.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe76f400700 1 --2- 172.21.15.49:0/1837014817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7700bc580 0x7fe7700bca00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fe758006fd0 tx=0x7fe7580090f0).ready entity=mon.1 client_cookie=4f6d1ff1cce56a06 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:15.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe76ea00700 1 -- 172.21.15.49:0/1837014817 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75800b580 con 0x7fe7700bc580 2024-01-22T05:08:15.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe76ea00700 1 -- 172.21.15.49:0/1837014817 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75800b6e0 con 0x7fe7700bc580 2024-01-22T05:08:15.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe76ea00700 1 -- 172.21.15.49:0/1837014817 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75800ba60 con 0x7fe7700bc580 2024-01-22T05:08:15.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe776a00700 1 -- 172.21.15.49:0/1837014817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7700bc580 msgr2=0x7fe7700bca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe776a00700 1 --2- 172.21.15.49:0/1837014817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7700bc580 0x7fe7700bca00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fe758006fd0 tx=0x7fe7580090f0).stop 2024-01-22T05:08:15.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe776a00700 1 -- 172.21.15.49:0/1837014817 shutdown_connections 2024-01-22T05:08:15.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe776a00700 1 --2- 172.21.15.49:0/1837014817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe770153930 0x7fe770153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe776a00700 1 --2- 172.21.15.49:0/1837014817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7700bc580 0x7fe7700bca00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.060+0000 7fe776a00700 1 -- 172.21.15.49:0/1837014817 >> 172.21.15.49:0/1837014817 conn(0x7fe770066830 msgr2=0x7fe770066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:15.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.064+0000 7fe776a00700 1 -- 172.21.15.49:0/1837014817 shutdown_connections 2024-01-22T05:08:15.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.064+0000 7fe776a00700 1 -- 172.21.15.49:0/1837014817 wait complete. 2024-01-22T05:08:15.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.064+0000 7fe776a00700 1 Processor -- start 2024-01-22T05:08:15.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.064+0000 7fe776a00700 1 -- start start 2024-01-22T05:08:15.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe776a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7700bc580 0x7fe7701522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe776a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7700c2d90 0x7fe7700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe776a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe770153930 0x7fe7700a5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe776a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7700a5a20 con 0x7fe770153930 2024-01-22T05:08:15.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe776a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7700be860 con 0x7fe7700c2d90 2024-01-22T05:08:15.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe776a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7700a4da0 con 0x7fe7700bc580 2024-01-22T05:08:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe774a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe770153930 0x7fe7700a5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe774a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe770153930 0x7fe7700a5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35278/0 (socket says 172.21.15.49:35278) 2024-01-22T05:08:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe774a00700 1 -- 172.21.15.49:0/156287688 learned_addr learned my addr 172.21.15.49:0/156287688 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe76fe00700 1 --2- 172.21.15.49:0/156287688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7700bc580 0x7fe7701522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe76f400700 1 --2- 172.21.15.49:0/156287688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7700c2d90 0x7fe7700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe774a00700 1 -- 172.21.15.49:0/156287688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7700bc580 msgr2=0x7fe7701522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe774a00700 1 --2- 172.21.15.49:0/156287688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7700bc580 0x7fe7701522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe774a00700 1 -- 172.21.15.49:0/156287688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7700c2d90 msgr2=0x7fe7700a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe774a00700 1 --2- 172.21.15.49:0/156287688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7700c2d90 0x7fe7700a5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe774a00700 1 -- 172.21.15.49:0/156287688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe768009a20 con 0x7fe770153930 2024-01-22T05:08:15.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe774a00700 1 --2- 172.21.15.49:0/156287688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe770153930 0x7fe7700a5530 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fe76800c0f0 tx=0x7fe76800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:15.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe767400700 1 -- 172.21.15.49:0/156287688 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76800cc30 con 0x7fe770153930 2024-01-22T05:08:15.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe767400700 1 -- 172.21.15.49:0/156287688 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76800f040 con 0x7fe770153930 2024-01-22T05:08:15.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe776a00700 1 -- 172.21.15.49:0/156287688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe758009370 con 0x7fe770153930 2024-01-22T05:08:15.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe767400700 1 -- 172.21.15.49:0/156287688 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe768013400 con 0x7fe770153930 2024-01-22T05:08:15.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.068+0000 7fe776a00700 1 -- 172.21.15.49:0/156287688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7700a47e0 con 0x7fe770153930 2024-01-22T05:08:15.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.072+0000 7fe776a00700 1 -- 172.21.15.49:0/156287688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7700657b0 con 0x7fe770153930 2024-01-22T05:08:15.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.072+0000 7fe767400700 1 -- 172.21.15.49:0/156287688 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe7680137f0 con 0x7fe770153930 2024-01-22T05:08:15.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.072+0000 7fe767400700 1 --2- 172.21.15.49:0/156287688 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe74805a510 0x7fe74805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.072+0000 7fe767400700 1 -- 172.21.15.49:0/156287688 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe768075310 con 0x7fe770153930 2024-01-22T05:08:15.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.072+0000 7fe76fe00700 1 --2- 172.21.15.49:0/156287688 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe74805a510 0x7fe74805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.076+0000 7fe76fe00700 1 --2- 172.21.15.49:0/156287688 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe74805a510 0x7fe74805c9d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fe760007fd0 tx=0x7fe760007d30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:15.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.080+0000 7fe767400700 1 -- 172.21.15.49:0/156287688 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe7680488d0 con 0x7fe770153930 2024-01-22T05:08:15.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.276+0000 7fe776a00700 1 -- 172.21.15.49:0/156287688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7700bdf40 con 0x7fe770153930 2024-01-22T05:08:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.280+0000 7fe767400700 1 -- 172.21.15.49:0/156287688 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fe76804bef0 con 0x7fe770153930 2024-01-22T05:08:15.282 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:15.282 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:05.000169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:15.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.280+0000 7fe776a00700 1 -- 172.21.15.49:0/156287688 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe74805a510 msgr2=0x7fe74805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.280+0000 7fe776a00700 1 --2- 172.21.15.49:0/156287688 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe74805a510 0x7fe74805c9d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fe760007fd0 tx=0x7fe760007d30).stop 2024-01-22T05:08:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.280+0000 7fe776a00700 1 -- 172.21.15.49:0/156287688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe770153930 msgr2=0x7fe7700a5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.280+0000 7fe776a00700 1 --2- 172.21.15.49:0/156287688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe770153930 0x7fe7700a5530 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fe76800c0f0 tx=0x7fe76800b040).stop 2024-01-22T05:08:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.284+0000 7fe776a00700 1 -- 172.21.15.49:0/156287688 shutdown_connections 2024-01-22T05:08:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.284+0000 7fe776a00700 1 --2- 172.21.15.49:0/156287688 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe74805a510 0x7fe74805c9d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.284+0000 7fe776a00700 1 --2- 172.21.15.49:0/156287688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe770153930 0x7fe7700a5530 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.284+0000 7fe776a00700 1 --2- 172.21.15.49:0/156287688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7700c2d90 0x7fe7700a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.284+0000 7fe776a00700 1 --2- 172.21.15.49:0/156287688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7700bc580 0x7fe7701522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.284+0000 7fe776a00700 1 -- 172.21.15.49:0/156287688 >> 172.21.15.49:0/156287688 conn(0x7fe770066830 msgr2=0x7fe7700c5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.284+0000 7fe776a00700 1 -- 172.21.15.49:0/156287688 shutdown_connections 2024-01-22T05:08:15.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.284+0000 7fe776a00700 1 -- 172.21.15.49:0/156287688 wait complete. 2024-01-22T05:08:15.290 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 42 2024-01-22T05:08:15.309 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/i/dont/exist 2024-01-22T05:08:15.458 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:15.458 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": -2 2024-01-22T05:08:15.458 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:15.472 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' got response code '0' and stdout '{ "return_code": -2 } ' 2024-01-22T05:08:15.472 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-01-22T05:08:15.472 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-01-22T05:08:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.628+0000 7feaa7e00700 1 Processor -- start 2024-01-22T05:08:15.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.628+0000 7feaa7e00700 1 -- start start 2024-01-22T05:08:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa7e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feaa8157b30 0x7feaa8067b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa7e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feaa8154a20 0x7feaa80c2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa7e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa8068830 con 0x7feaa8067ff0 2024-01-22T05:08:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa7e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa8068b10 con 0x7feaa8157b30 2024-01-22T05:08:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa7e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa8068df0 con 0x7feaa8154a20 2024-01-22T05:08:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa6000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7feaa8067ff0 0x7feaa80c1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45896/0 (socket says 172.21.15.49:45896) 2024-01-22T05:08:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa6000700 1 -- 172.21.15.49:0/3612382266 learned_addr learned my addr 172.21.15.49:0/3612382266 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa6a00700 1 --2- 172.21.15.49:0/3612382266 >> v2:172.21.15.49:3300/0 conn(0x7feaa8157b30 0x7feaa8067b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa7400700 1 --2- 172.21.15.49:0/3612382266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feaa8154a20 0x7feaa80c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa5600700 1 -- 172.21.15.49:0/3612382266 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792339712 0 0) 0x7feaa8068830 con 0x7feaa8067ff0 2024-01-22T05:08:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa5600700 1 -- 172.21.15.49:0/3612382266 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea880033f0 con 0x7feaa8067ff0 2024-01-22T05:08:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa7400700 1 -- 172.21.15.49:0/3612382266 >> v2:172.21.15.49:3300/0 conn(0x7feaa8157b30 msgr2=0x7feaa8067b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa5600700 1 -- 172.21.15.49:0/3612382266 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2404566448 0 0) 0x7fea880033f0 con 0x7feaa8067ff0 2024-01-22T05:08:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa7400700 1 --2- 172.21.15.49:0/3612382266 >> v2:172.21.15.49:3300/0 conn(0x7feaa8157b30 0x7feaa8067b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa7400700 1 -- 172.21.15.49:0/3612382266 >> v1:172.21.15.49:6789/0 conn(0x7feaa8067ff0 legacy=0x7feaa80c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa7400700 1 -- 172.21.15.49:0/3612382266 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa80690d0 con 0x7feaa8154a20 2024-01-22T05:08:15.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa6a00700 1 --2- 172.21.15.49:0/3612382266 >> v2:172.21.15.49:3300/0 conn(0x7feaa8157b30 0x7feaa8067b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa7400700 1 --2- 172.21.15.49:0/3612382266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feaa8154a20 0x7feaa80c2400 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7feaa0009e60 tx=0x7feaa0009780).ready entity=mon.2 client_cookie=8c7074dc2450b731 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.632+0000 7feaa5600700 1 -- 172.21.15.49:0/3612382266 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000e070 con 0x7feaa8154a20 2024-01-22T05:08:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.636+0000 7feaa5600700 1 -- 172.21.15.49:0/3612382266 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa000b7a0 con 0x7feaa8154a20 2024-01-22T05:08:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.636+0000 7feaa5600700 1 -- 172.21.15.49:0/3612382266 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90001470 con 0x7feaa8154a20 2024-01-22T05:08:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.636+0000 7feaa7e00700 1 -- 172.21.15.49:0/3612382266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feaa8154a20 msgr2=0x7feaa80c2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.636+0000 7feaa7e00700 1 --2- 172.21.15.49:0/3612382266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feaa8154a20 0x7feaa80c2400 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7feaa0009e60 tx=0x7feaa0009780).stop 2024-01-22T05:08:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.636+0000 7feaa7e00700 1 -- 172.21.15.49:0/3612382266 shutdown_connections 2024-01-22T05:08:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.636+0000 7feaa7e00700 1 --2- 172.21.15.49:0/3612382266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feaa8154a20 0x7feaa80c2400 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.636+0000 7feaa7e00700 1 --2- 172.21.15.49:0/3612382266 >> v2:172.21.15.49:3300/0 conn(0x7feaa8157b30 0x7feaa8067b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.636+0000 7feaa7e00700 1 -- 172.21.15.49:0/3612382266 >> 172.21.15.49:0/3612382266 conn(0x7feaa80c3880 msgr2=0x7feaa80c3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.636+0000 7feaa7e00700 1 -- 172.21.15.49:0/3612382266 shutdown_connections 2024-01-22T05:08:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.636+0000 7feaa7e00700 1 -- 172.21.15.49:0/3612382266 wait complete. 2024-01-22T05:08:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa7e00700 1 Processor -- start 2024-01-22T05:08:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa7e00700 1 -- start start 2024-01-22T05:08:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feaa8067ff0 0x7feaa814f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaa8154a20 0x7feaa80a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa7e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feaa8157b30 0x7feaa80a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa7e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa80a3960 con 0x7feaa8154a20 2024-01-22T05:08:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa7e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa80a3f20 con 0x7feaa8067ff0 2024-01-22T05:08:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa7e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa80a67c0 con 0x7feaa8157b30 2024-01-22T05:08:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaa8154a20 0x7feaa80a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaa8154a20 0x7feaa80a8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35286/0 (socket says 172.21.15.49:35286) 2024-01-22T05:08:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa6000700 1 -- 172.21.15.49:0/3657845337 learned_addr learned my addr 172.21.15.49:0/3657845337 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa7400700 1 --2- 172.21.15.49:0/3657845337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feaa8157b30 0x7feaa80a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa6a00700 1 --2- 172.21.15.49:0/3657845337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feaa8067ff0 0x7feaa814f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa6000700 1 -- 172.21.15.49:0/3657845337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feaa8157b30 msgr2=0x7feaa80a62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa6000700 1 --2- 172.21.15.49:0/3657845337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feaa8157b30 0x7feaa80a62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa6000700 1 -- 172.21.15.49:0/3657845337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feaa8067ff0 msgr2=0x7feaa814f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa6000700 1 --2- 172.21.15.49:0/3657845337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feaa8067ff0 0x7feaa814f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.640+0000 7feaa6000700 1 -- 172.21.15.49:0/3657845337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea980092a0 con 0x7feaa8154a20 2024-01-22T05:08:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.644+0000 7feaa6000700 1 --2- 172.21.15.49:0/3657845337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaa8154a20 0x7feaa80a8df0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fea9000c840 tx=0x7fea90001ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.644+0000 7fea9e000700 1 -- 172.21.15.49:0/3657845337 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90007170 con 0x7feaa8154a20 2024-01-22T05:08:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.644+0000 7fea9e000700 1 -- 172.21.15.49:0/3657845337 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea900072d0 con 0x7feaa8154a20 2024-01-22T05:08:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.644+0000 7feaa7e00700 1 -- 172.21.15.49:0/3657845337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa0009a20 con 0x7feaa8154a20 2024-01-22T05:08:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.644+0000 7fea9e000700 1 -- 172.21.15.49:0/3657845337 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea900048c0 con 0x7feaa8154a20 2024-01-22T05:08:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.644+0000 7feaa7e00700 1 -- 172.21.15.49:0/3657845337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa80a96f0 con 0x7feaa8154a20 2024-01-22T05:08:15.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.644+0000 7fea9e000700 1 -- 172.21.15.49:0/3657845337 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fea90004c70 con 0x7feaa8154a20 2024-01-22T05:08:15.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.648+0000 7fea9e000700 1 --2- 172.21.15.49:0/3657845337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fea8005a510 0x7fea8005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.648+0000 7fea9e000700 1 -- 172.21.15.49:0/3657845337 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fea90074420 con 0x7feaa8154a20 2024-01-22T05:08:15.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.648+0000 7feaa6a00700 1 --2- 172.21.15.49:0/3657845337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fea8005a510 0x7fea8005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.648+0000 7feaa6a00700 1 --2- 172.21.15.49:0/3657845337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fea8005a510 0x7fea8005c9d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7feaa80bbf80 tx=0x7fea98009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.648+0000 7feab7c5b740 1 Processor -- start 2024-01-22T05:08:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.648+0000 7feab7c5b740 1 -- start start 2024-01-22T05:08:15.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feab7c5b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29b2a20 0x29f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feab7c5b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29d8100 0x29b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feab7c5b740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 0x29f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feab7c5b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x28ec3c0 con 0x29b2a20 2024-01-22T05:08:15.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feab7c5b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x290f5c0 con 0x29d8100 2024-01-22T05:08:15.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feab7c5b740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x28d8cf0 con 0x29f5930 2024-01-22T05:08:15.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feaa6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29b2a20 0x29f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feaa6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29b2a20 0x29f87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35302/0 (socket says 172.21.15.49:35302) 2024-01-22T05:08:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feaa6a00700 1 -- 172.21.15.49:0/1596055029 learned_addr learned my addr 172.21.15.49:0/1596055029 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feaa7400700 1 --2- 172.21.15.49:0/1596055029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 0x29f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feaa6000700 1 --2- 172.21.15.49:0/1596055029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29d8100 0x29b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feaa6a00700 1 -- 172.21.15.49:0/1596055029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 msgr2=0x29f5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feaa6a00700 1 --2- 172.21.15.49:0/1596055029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 0x29f5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feaa6a00700 1 -- 172.21.15.49:0/1596055029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29d8100 msgr2=0x29b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feaa6a00700 1 --2- 172.21.15.49:0/1596055029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29d8100 0x29b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feaa6a00700 1 -- 172.21.15.49:0/1596055029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x293da00 con 0x29b2a20 2024-01-22T05:08:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feaa7400700 1 --2- 172.21.15.49:0/1596055029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 0x29f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feaa6a00700 1 --2- 172.21.15.49:0/1596055029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29b2a20 0x29f87d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fea98011ec0 tx=0x7fea98017000).ready entity=mon.0 client_cookie=2af022c7cb36d382 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7fea96600700 1 -- 172.21.15.49:0/1596055029 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98014d30 con 0x29b2a20 2024-01-22T05:08:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7fea96600700 1 -- 172.21.15.49:0/1596055029 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea98014e90 con 0x29b2a20 2024-01-22T05:08:15.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7fea96600700 1 -- 172.21.15.49:0/1596055029 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9801e600 con 0x29b2a20 2024-01-22T05:08:15.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feab7c5b740 1 -- 172.21.15.49:0/1596055029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29b2a20 msgr2=0x29f87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.652+0000 7feab7c5b740 1 --2- 172.21.15.49:0/1596055029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29b2a20 0x29f87d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fea98011ec0 tx=0x7fea98017000).stop 2024-01-22T05:08:15.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.656+0000 7feab7c5b740 1 -- 172.21.15.49:0/1596055029 shutdown_connections 2024-01-22T05:08:15.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.656+0000 7feab7c5b740 1 --2- 172.21.15.49:0/1596055029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 0x29f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.656+0000 7feab7c5b740 1 --2- 172.21.15.49:0/1596055029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29d8100 0x29b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.656+0000 7feab7c5b740 1 --2- 172.21.15.49:0/1596055029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29b2a20 0x29f87d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.656+0000 7feab7c5b740 1 -- 172.21.15.49:0/1596055029 >> 172.21.15.49:0/1596055029 conn(0x2791890 msgr2=0x29b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:15.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.656+0000 7feab7c5b740 1 -- 172.21.15.49:0/1596055029 shutdown_connections 2024-01-22T05:08:15.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.656+0000 7feab7c5b740 1 -- 172.21.15.49:0/1596055029 wait complete. 2024-01-22T05:08:15.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.656+0000 7feab7c5b740 1 -- start start 2024-01-22T05:08:15.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.656+0000 7feab7c5b740 1 Processor -- start 2024-01-22T05:08:15.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29b2a20 0x29de6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 0x29f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x29f6790 con 0x29d8100 2024-01-22T05:08:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x29ddcf0 con 0x29b2a20 2024-01-22T05:08:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x29dd0e0 con 0x29f5930 2024-01-22T05:08:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 10 client.0 ll_register_callbacks cb 0x296a360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feaa6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feaa6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29f5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35308/0 (socket says 172.21.15.49:35308) 2024-01-22T05:08:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feaa6000700 1 -- 172.21.15.49:0/347317127 learned_addr learned my addr 172.21.15.49:0/347317127 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feaa7400700 1 --2- 172.21.15.49:0/347317127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 0x29f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feaa6a00700 1 --2- 172.21.15.49:0/347317127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29b2a20 0x29de6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feaa6000700 1 -- 172.21.15.49:0/347317127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 msgr2=0x29f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:15.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feaa6000700 1 --2- 172.21.15.49:0/347317127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 0x29f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feaa6000700 1 -- 172.21.15.49:0/347317127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29b2a20 msgr2=0x29de6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:15.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feaa6000700 1 --2- 172.21.15.49:0/347317127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29b2a20 0x29de6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feaa6000700 1 -- 172.21.15.49:0/347317127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea98011b10 con 0x29d8100 2024-01-22T05:08:15.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feaa7400700 1 --2- 172.21.15.49:0/347317127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 0x29f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:15.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feaa6000700 1 --2- 172.21.15.49:0/347317127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29f5db0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fea9000c810 tx=0x7fea9000f000).ready entity=mon.0 client_cookie=6ec45532fc5b739b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:15.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7fea8ea00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:15.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7fea8ea00700 1 -- 172.21.15.49:0/347317127 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9004ac50 con 0x29d8100 2024-01-22T05:08:15.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7fea8ea00700 1 -- 172.21.15.49:0/347317127 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fea9004adb0 con 0x29d8100 2024-01-22T05:08:15.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 1 -- 172.21.15.49:0/347317127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2929310 con 0x29d8100 2024-01-22T05:08:15.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7fea8ea00700 1 -- 172.21.15.49:0/347317127 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea90047760 con 0x29d8100 2024-01-22T05:08:15.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 10 client.5754 fetch_fsmap learned FSMap version 42 2024-01-22T05:08:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 1 -- 172.21.15.49:0/347317127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x292c8a0 con 0x29d8100 2024-01-22T05:08:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7fea8ea00700 1 -- 172.21.15.49:0/347317127 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2929310 con 0x29d8100 2024-01-22T05:08:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7fea8ea00700 1 -- 172.21.15.49:0/347317127 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fea9004a6c0 con 0x29d8100 2024-01-22T05:08:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 10 client.5754 fetch_fsmap finished waiting for FSMap version 42 2024-01-22T05:08:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 10 client.5754 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 20 client.5754 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 1 --2- 172.21.15.49:0/347317127 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x29d8f50 0x29d9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 4 client.5754 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feab7c5b740 1 -- 172.21.15.49:0/347317127 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x291f860 con 0x29d8f50 2024-01-22T05:08:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.660+0000 7feaa6a00700 1 --2- 172.21.15.49:0/347317127 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x29d8f50 0x29d9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7feaa6a00700 1 --2- 172.21.15.49:0/347317127 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x29d8f50 0x29d9330 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=60fc3bc31b7fbb18 server_cookie=8ed042d75a69f6d4 in_seq=0 out_seq=0 2024-01-22T05:08:15.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7fea8ea00700 10 client.5754 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7fea8ea00700 1 -- 172.21.15.49:0/347317127 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x291f860 con 0x29d8f50 2024-01-22T05:08:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7fea8ea00700 10 client.5754 handle_command_reply: tid=0 2024-01-22T05:08:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7feab7c5b740 1 client.5754 shutdown 2024-01-22T05:08:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7feab7c5b740 1 -- 172.21.15.49:0/347317127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 msgr2=0x29f5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7feab7c5b740 1 --2- 172.21.15.49:0/347317127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29f5db0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fea9000c810 tx=0x7fea9000f000).stop 2024-01-22T05:08:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7feab7c5b740 1 -- 172.21.15.49:0/347317127 shutdown_connections 2024-01-22T05:08:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7feab7c5b740 1 --2- 172.21.15.49:0/347317127 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x29d8f50 0x29d9330 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7feab7c5b740 1 --2- 172.21.15.49:0/347317127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 0x29f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7feab7c5b740 1 --2- 172.21.15.49:0/347317127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29f5db0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7feab7c5b740 1 --2- 172.21.15.49:0/347317127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29b2a20 0x29de6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7feab7c5b740 1 -- 172.21.15.49:0/347317127 >> 172.21.15.49:0/347317127 conn(0x2791890 msgr2=0x29f79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:15.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7fea8ea00700 0 client.5754 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:15.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7feab7c5b740 1 -- 172.21.15.49:0/347317127 shutdown_connections 2024-01-22T05:08:15.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7feab7c5b740 1 -- 172.21.15.49:0/347317127 wait complete. 2024-01-22T05:08:15.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.664+0000 7feab7c5b740 20 client.5754 trim_cache size 0 max 16384 2024-01-22T05:08:15.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.684+0000 7feab7c5b740 1 Processor -- start 2024-01-22T05:08:15.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.684+0000 7feab7c5b740 1 -- start start 2024-01-22T05:08:15.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.684+0000 7feab7c5b740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29b2a20 0x29f7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.684+0000 7feab7c5b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29de390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.684+0000 7feab7c5b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29f5930 0x29de880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.684+0000 7feab7c5b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2950fc0 con 0x29d8100 2024-01-22T05:08:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.684+0000 7feab7c5b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x29f2950 con 0x29f5930 2024-01-22T05:08:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.684+0000 7feab7c5b740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x29f2e20 con 0x29b2a20 2024-01-22T05:08:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feaa6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29de390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feaa6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29de390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35318/0 (socket says 172.21.15.49:35318) 2024-01-22T05:08:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feaa6000700 1 -- 172.21.15.49:0/1777727950 learned_addr learned my addr 172.21.15.49:0/1777727950 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:15.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feaa7400700 1 --2- 172.21.15.49:0/1777727950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29f5930 0x29de880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feaa6000700 1 -- 172.21.15.49:0/1777727950 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29b2a20 msgr2=0x29f7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:15.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feaa6000700 1 --2- 172.21.15.49:0/1777727950 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29b2a20 0x29f7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:15.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feaa6000700 1 -- 172.21.15.49:0/1777727950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29f5930 msgr2=0x29de880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:15.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feaa6000700 1 --2- 172.21.15.49:0/1777727950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29f5930 0x29de880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feaa6000700 1 -- 172.21.15.49:0/1777727950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29ae1c0 con 0x29d8100 2024-01-22T05:08:15.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feaa7400700 1 --2- 172.21.15.49:0/1777727950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29f5930 0x29de880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feaa6000700 1 --2- 172.21.15.49:0/1777727950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29de390 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fea90049ab0 tx=0x7fea90058000).ready entity=mon.0 client_cookie=6b7401f3ec8a22ff server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7fea97000700 1 -- 172.21.15.49:0/1777727950 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9000e040 con 0x29d8100 2024-01-22T05:08:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7fea97000700 1 -- 172.21.15.49:0/1777727950 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9004b0c0 con 0x29d8100 2024-01-22T05:08:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7fea97000700 1 -- 172.21.15.49:0/1777727950 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9004b700 con 0x29d8100 2024-01-22T05:08:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feab7c5b740 1 -- 172.21.15.49:0/1777727950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 msgr2=0x29de390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feab7c5b740 1 --2- 172.21.15.49:0/1777727950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29de390 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fea90049ab0 tx=0x7fea90058000).stop 2024-01-22T05:08:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feab7c5b740 1 -- 172.21.15.49:0/1777727950 shutdown_connections 2024-01-22T05:08:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feab7c5b740 1 --2- 172.21.15.49:0/1777727950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29f5930 0x29de880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feab7c5b740 1 --2- 172.21.15.49:0/1777727950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29de390 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feab7c5b740 1 --2- 172.21.15.49:0/1777727950 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29b2a20 0x29f7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:15.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feab7c5b740 1 -- 172.21.15.49:0/1777727950 >> 172.21.15.49:0/1777727950 conn(0x2791890 msgr2=0x29b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:15.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feab7c5b740 1 -- 172.21.15.49:0/1777727950 shutdown_connections 2024-01-22T05:08:15.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feab7c5b740 1 -- 172.21.15.49:0/1777727950 wait complete. 2024-01-22T05:08:15.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feab7c5b740 1 -- start start 2024-01-22T05:08:15.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.688+0000 7feab7c5b740 1 Processor -- start 2024-01-22T05:08:15.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feab7c5b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29b2a20 0x29de0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feab7c5b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29de5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feab7c5b740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 0x29fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feab7c5b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x29dea90 con 0x29d8100 2024-01-22T05:08:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feab7c5b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x29b1d60 con 0x29b2a20 2024-01-22T05:08:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feab7c5b740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x29f8d60 con 0x29f5930 2024-01-22T05:08:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feab7c5b740 10 client.0 ll_register_callbacks cb 0x29dba70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feaa6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29b2a20 0x29de0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feaa6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29de5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feaa7400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 0x29fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feaa6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29b2a20 0x29de0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:46922/0 (socket says 172.21.15.49:46922) 2024-01-22T05:08:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feaa6a00700 1 -- 172.21.15.49:0/3606184674 learned_addr learned my addr 172.21.15.49:0/3606184674 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:15.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feaa6a00700 1 -- 172.21.15.49:0/3606184674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 msgr2=0x29fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:15.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feaa6a00700 1 --2- 172.21.15.49:0/3606184674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 0x29fcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feaa6a00700 1 -- 172.21.15.49:0/3606184674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 msgr2=0x29de5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feaa6a00700 1 --2- 172.21.15.49:0/3606184674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29de5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feaa6a00700 1 -- 172.21.15.49:0/3606184674 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x292c8a0 con 0x29b2a20 2024-01-22T05:08:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7feaa6a00700 1 --2- 172.21.15.49:0/3606184674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29b2a20 0x29de0b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fea98011930 tx=0x7fea98021000).ready entity=mon.1 client_cookie=e5d23ff005820940 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.692+0000 7fea8ea00700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-01-22T05:08:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7fea8ea00700 1 -- 172.21.15.49:0/3606184674 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9802f040 con 0x29b2a20 2024-01-22T05:08:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7fea8ea00700 1 -- 172.21.15.49:0/3606184674 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fea9801e600 con 0x29b2a20 2024-01-22T05:08:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7feab7c5b740 1 -- 172.21.15.49:0/3606184674 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x29db580 con 0x29b2a20 2024-01-22T05:08:15.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7fea8ea00700 1 -- 172.21.15.49:0/3606184674 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea98033280 con 0x29b2a20 2024-01-22T05:08:15.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7feab7c5b740 10 client.5740 fetch_fsmap learned FSMap version 42 2024-01-22T05:08:15.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7feab7c5b740 1 -- 172.21.15.49:0/3606184674 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x7feaa8153d70 con 0x29b2a20 2024-01-22T05:08:15.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7fea8ea00700 1 -- 172.21.15.49:0/3606184674 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x29db580 con 0x29b2a20 2024-01-22T05:08:15.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7fea8ea00700 1 -- 172.21.15.49:0/3606184674 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fea9801ec40 con 0x29b2a20 2024-01-22T05:08:15.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7feab7c5b740 10 client.5740 fetch_fsmap finished waiting for FSMap version 42 2024-01-22T05:08:15.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7feab7c5b740 10 client.5740 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:15.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7feab7c5b740 20 client.5740 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:15.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7feab7c5b740 1 --2- 172.21.15.49:0/3606184674 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x29b0cf0 0x29fd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7feab7c5b740 4 client.5740 mds_command: new command op to 5569 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-01-22T05:08:15.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7feab7c5b740 1 -- 172.21.15.49:0/3606184674 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) v1 -- 0x7fea98014e90 con 0x29b0cf0 2024-01-22T05:08:15.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7feaa6000700 1 --2- 172.21.15.49:0/3606184674 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x29b0cf0 0x29fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7feaa6000700 1 --2- 172.21.15.49:0/3606184674 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x29b0cf0 0x29fd210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=559b9318db3faea3 server_cookie=11e9f060e3a17311 in_seq=0 out_seq=0 2024-01-22T05:08:15.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.696+0000 7fea8ea00700 10 client.5740 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:15.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7fea8ea00700 1 -- 172.21.15.49:0/3606184674 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+26 (crc 0 0 0) 0x7fea98014e90 con 0x29b0cf0 2024-01-22T05:08:15.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7fea8ea00700 10 client.5740 handle_command_reply: tid=0 2024-01-22T05:08:15.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feab7c5b740 1 client.5740 shutdown 2024-01-22T05:08:15.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feab7c5b740 1 -- 172.21.15.49:0/3606184674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29b2a20 msgr2=0x29de0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feab7c5b740 1 --2- 172.21.15.49:0/3606184674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29b2a20 0x29de0b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fea98011930 tx=0x7fea98021000).stop 2024-01-22T05:08:15.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feab7c5b740 1 -- 172.21.15.49:0/3606184674 shutdown_connections 2024-01-22T05:08:15.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feab7c5b740 1 --2- 172.21.15.49:0/3606184674 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x29b0cf0 0x29fd210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feab7c5b740 1 --2- 172.21.15.49:0/3606184674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29f5930 0x29fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feab7c5b740 1 --2- 172.21.15.49:0/3606184674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29d8100 0x29de5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feab7c5b740 1 --2- 172.21.15.49:0/3606184674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29b2a20 0x29de0b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7fea8ea00700 0 client.5740 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:15.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feab7c5b740 1 -- 172.21.15.49:0/3606184674 >> 172.21.15.49:0/3606184674 conn(0x2791890 msgr2=0x29b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:15.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feab7c5b740 1 -- 172.21.15.49:0/3606184674 shutdown_connections 2024-01-22T05:08:15.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feab7c5b740 1 -- 172.21.15.49:0/3606184674 wait complete. 2024-01-22T05:08:15.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feab7c5b740 20 client.5740 trim_cache size 0 max 16384 2024-01-22T05:08:15.703 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:15.704 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": -2 2024-01-22T05:08:15.704 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:15.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feaa7e00700 1 -- 172.21.15.49:0/3657845337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fea8005a510 msgr2=0x7fea8005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feaa7e00700 1 --2- 172.21.15.49:0/3657845337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fea8005a510 0x7fea8005c9d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7feaa80bbf80 tx=0x7fea98009060).stop 2024-01-22T05:08:15.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feaa7e00700 1 -- 172.21.15.49:0/3657845337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaa8154a20 msgr2=0x7feaa80a8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feaa7e00700 1 --2- 172.21.15.49:0/3657845337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaa8154a20 0x7feaa80a8df0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fea9000c840 tx=0x7fea90001ab0).stop 2024-01-22T05:08:15.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feaa7e00700 1 -- 172.21.15.49:0/3657845337 shutdown_connections 2024-01-22T05:08:15.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feaa7e00700 1 --2- 172.21.15.49:0/3657845337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fea8005a510 0x7fea8005c9d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feaa7e00700 1 --2- 172.21.15.49:0/3657845337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feaa8157b30 0x7feaa80a62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feaa7e00700 1 --2- 172.21.15.49:0/3657845337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaa8154a20 0x7feaa80a8df0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feaa7e00700 1 --2- 172.21.15.49:0/3657845337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feaa8067ff0 0x7feaa814f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feaa7e00700 1 -- 172.21.15.49:0/3657845337 >> 172.21.15.49:0/3657845337 conn(0x7feaa80c3880 msgr2=0x7feaa8062230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:15.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feaa7e00700 1 -- 172.21.15.49:0/3657845337 shutdown_connections 2024-01-22T05:08:15.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.700+0000 7feaa7e00700 1 -- 172.21.15.49:0/3657845337 wait complete. 2024-01-22T05:08:15.727 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-01-22T05:08:15.727 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2024-01-22T05:08:15.727 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2024-01-22T05:08:15.728 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:15.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.872+0000 7f014a400700 1 Processor -- start 2024-01-22T05:08:15.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.872+0000 7f014a400700 1 -- start start 2024-01-22T05:08:15.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.872+0000 7f014a400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f01440c3690 0x7f01440c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.872+0000 7f014a400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01440bdc10 con 0x7f01440bf0b0 2024-01-22T05:08:15.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.872+0000 7f014a400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0144068e10 con 0x7f0144155550 2024-01-22T05:08:15.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.872+0000 7f014a400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01440c3f60 con 0x7f01440c3690 2024-01-22T05:08:15.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.872+0000 7f0143e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f01440bf0b0 0x7f01440681a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45910/0 (socket says 172.21.15.49:45910) 2024-01-22T05:08:15.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0143e00700 1 -- 172.21.15.49:0/2863242402 learned_addr learned my addr 172.21.15.49:0/2863242402 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:15.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0143400700 1 --2- 172.21.15.49:0/2863242402 >> v2:172.21.15.110:3300/0 conn(0x7f01440c3690 0x7f01440c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 -- 172.21.15.49:0/2863242402 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300378648 0 0) 0x7f01440bdc10 con 0x7f01440bf0b0 2024-01-22T05:08:15.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 -- 172.21.15.49:0/2863242402 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01240033f0 con 0x7f01440bf0b0 2024-01-22T05:08:15.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 -- 172.21.15.49:0/2863242402 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2559104813 0 0) 0x7f01240033f0 con 0x7f01440bf0b0 2024-01-22T05:08:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 -- 172.21.15.49:0/2863242402 >> v2:172.21.15.110:3300/0 conn(0x7f01440c3690 msgr2=0x7f01440c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 --2- 172.21.15.49:0/2863242402 >> v2:172.21.15.110:3300/0 conn(0x7f01440c3690 0x7f01440c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 -- 172.21.15.49:0/2863242402 >> v1:172.21.15.110:6789/0 conn(0x7f0144155550 legacy=0x7f0144067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 -- 172.21.15.49:0/2863242402 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01440690f0 con 0x7f01440bf0b0 2024-01-22T05:08:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 -- 172.21.15.49:0/2863242402 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f013c0017f0 con 0x7f01440bf0b0 2024-01-22T05:08:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 -- 172.21.15.49:0/2863242402 >> v1:172.21.15.49:6789/0 conn(0x7f01440bf0b0 legacy=0x7f01440681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 --2- 172.21.15.49:0/2863242402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01240038e0 0x7f0124003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 --2- 172.21.15.49:0/2863242402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0124004690 0x7f0124004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 --2- 172.21.15.49:0/2863242402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0124005000 0x7f012400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 -- 172.21.15.49:0/2863242402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01440c3f60 con 0x7f0124004690 2024-01-22T05:08:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 -- 172.21.15.49:0/2863242402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012400beb0 con 0x7f01240038e0 2024-01-22T05:08:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 -- 172.21.15.49:0/2863242402 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012400c070 con 0x7f0124005000 2024-01-22T05:08:15.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142a00700 1 --2- 172.21.15.49:0/2863242402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0124004690 0x7f0124004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0143400700 1 --2- 172.21.15.49:0/2863242402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01240038e0 0x7f0124003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0143e00700 1 --2- 172.21.15.49:0/2863242402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0124005000 0x7f012400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142a00700 1 -- 172.21.15.49:0/2863242402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0124005000 msgr2=0x7f012400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:15.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142a00700 1 --2- 172.21.15.49:0/2863242402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0124005000 0x7f012400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142a00700 1 -- 172.21.15.49:0/2863242402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01240038e0 msgr2=0x7f0124003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:15.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142a00700 1 --2- 172.21.15.49:0/2863242402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01240038e0 0x7f0124003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142a00700 1 -- 172.21.15.49:0/2863242402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01240033f0 con 0x7f0124004690 2024-01-22T05:08:15.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0143e00700 1 --2- 172.21.15.49:0/2863242402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0124005000 0x7f012400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:15.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0143e00700 1 -- 172.21.15.49:0/2863242402 reap_dead start 2024-01-22T05:08:15.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142a00700 1 --2- 172.21.15.49:0/2863242402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0124004690 0x7f0124004b10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f012c001730 tx=0x7f012c007bb0).ready entity=mon.0 client_cookie=1a8c531d7b19829 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:15.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 -- 172.21.15.49:0/2863242402 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c007020 con 0x7f0124004690 2024-01-22T05:08:15.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 -- 172.21.15.49:0/2863242402 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c007180 con 0x7f0124004690 2024-01-22T05:08:15.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.876+0000 7f0142000700 1 -- 172.21.15.49:0/2863242402 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c007520 con 0x7f0124004690 2024-01-22T05:08:15.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.880+0000 7f014a400700 1 -- 172.21.15.49:0/2863242402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0124004690 msgr2=0x7f0124004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.880+0000 7f014a400700 1 --2- 172.21.15.49:0/2863242402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0124004690 0x7f0124004b10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f012c001730 tx=0x7f012c007bb0).stop 2024-01-22T05:08:15.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.880+0000 7f014a400700 1 -- 172.21.15.49:0/2863242402 shutdown_connections 2024-01-22T05:08:15.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.880+0000 7f014a400700 1 --2- 172.21.15.49:0/2863242402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0124004690 0x7f0124004b10 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.880+0000 7f014a400700 1 -- 172.21.15.49:0/2863242402 >> 172.21.15.49:0/2863242402 conn(0x7f01440c51c0 msgr2=0x7f01440c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:15.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.880+0000 7f014a400700 1 -- 172.21.15.49:0/2863242402 shutdown_connections 2024-01-22T05:08:15.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.880+0000 7f014a400700 1 -- 172.21.15.49:0/2863242402 wait complete. 2024-01-22T05:08:15.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.880+0000 7f014a400700 1 Processor -- start 2024-01-22T05:08:15.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.880+0000 7f014a400700 1 -- start start 2024-01-22T05:08:15.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f014a400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0124004690 0x7f0144142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f014a400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01440c0790 0x7f0144163190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f014a400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0144163680 0x7f01440c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f014a400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0144153100 con 0x7f0124004690 2024-01-22T05:08:15.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f014a400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0144153270 con 0x7f0144163680 2024-01-22T05:08:15.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f014a400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01440c0c10 con 0x7f01440c0790 2024-01-22T05:08:15.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f0143400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0124004690 0x7f0144142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f0143400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0124004690 0x7f0144142ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35332/0 (socket says 172.21.15.49:35332) 2024-01-22T05:08:15.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f0143400700 1 -- 172.21.15.49:0/3523694835 learned_addr learned my addr 172.21.15.49:0/3523694835 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:15.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f0142a00700 1 --2- 172.21.15.49:0/3523694835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01440c0790 0x7f0144163190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f0143e00700 1 --2- 172.21.15.49:0/3523694835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0144163680 0x7f01440c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f0143400700 1 -- 172.21.15.49:0/3523694835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01440c0790 msgr2=0x7f0144163190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f0143400700 1 --2- 172.21.15.49:0/3523694835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01440c0790 0x7f0144163190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f0143400700 1 -- 172.21.15.49:0/3523694835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0144163680 msgr2=0x7f01440c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:15.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f0143400700 1 --2- 172.21.15.49:0/3523694835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0144163680 0x7f01440c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:15.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f0143400700 1 -- 172.21.15.49:0/3523694835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01440c0ee0 con 0x7f0124004690 2024-01-22T05:08:15.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f0143400700 1 --2- 172.21.15.49:0/3523694835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0124004690 0x7f0144142ce0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f01340119f0 tx=0x7f0134009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:15.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f013aa00700 1 -- 172.21.15.49:0/3523694835 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400f790 con 0x7f0124004690 2024-01-22T05:08:15.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f013aa00700 1 -- 172.21.15.49:0/3523694835 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013400f8f0 con 0x7f0124004690 2024-01-22T05:08:15.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f014a400700 1 -- 172.21.15.49:0/3523694835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01440c11c0 con 0x7f0124004690 2024-01-22T05:08:15.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f013aa00700 1 -- 172.21.15.49:0/3523694835 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400fc70 con 0x7f0124004690 2024-01-22T05:08:15.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.884+0000 7f014a400700 1 -- 172.21.15.49:0/3523694835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01440c1780 con 0x7f0124004690 2024-01-22T05:08:15.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.888+0000 7f014a400700 1 -- 172.21.15.49:0/3523694835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0144163a60 con 0x7f0124004690 2024-01-22T05:08:15.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.888+0000 7f013aa00700 1 -- 172.21.15.49:0/3523694835 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0134014440 con 0x7f0124004690 2024-01-22T05:08:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.888+0000 7f013aa00700 1 --2- 172.21.15.49:0/3523694835 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f011c05a540 0x7f011c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.888+0000 7f013aa00700 1 -- 172.21.15.49:0/3523694835 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f01340754b0 con 0x7f0124004690 2024-01-22T05:08:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.888+0000 7f0142a00700 1 --2- 172.21.15.49:0/3523694835 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f011c05a540 0x7f011c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:15.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.892+0000 7f0142a00700 1 --2- 172.21.15.49:0/3523694835 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f011c05a540 0x7f011c05ca00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f012c000fd0 tx=0x7f012c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:15.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:15.896+0000 7f013aa00700 1 -- 172.21.15.49:0/3523694835 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0134048a10 con 0x7f0124004690 2024-01-22T05:08:16.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.096+0000 7f014a400700 1 -- 172.21.15.49:0/3523694835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01440c78c0 con 0x7f0124004690 2024-01-22T05:08:16.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.096+0000 7f013aa00700 1 -- 172.21.15.49:0/3523694835 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f013404c030 con 0x7f0124004690 2024-01-22T05:08:16.101 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:16.101 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:05.000169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:16.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.100+0000 7f014a400700 1 -- 172.21.15.49:0/3523694835 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f011c05a540 msgr2=0x7f011c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:16.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.100+0000 7f014a400700 1 --2- 172.21.15.49:0/3523694835 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f011c05a540 0x7f011c05ca00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f012c000fd0 tx=0x7f012c015000).stop 2024-01-22T05:08:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.100+0000 7f014a400700 1 -- 172.21.15.49:0/3523694835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0124004690 msgr2=0x7f0144142ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.100+0000 7f014a400700 1 --2- 172.21.15.49:0/3523694835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0124004690 0x7f0144142ce0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f01340119f0 tx=0x7f0134009060).stop 2024-01-22T05:08:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.100+0000 7f014a400700 1 -- 172.21.15.49:0/3523694835 shutdown_connections 2024-01-22T05:08:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.100+0000 7f014a400700 1 --2- 172.21.15.49:0/3523694835 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f011c05a540 0x7f011c05ca00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.100+0000 7f014a400700 1 --2- 172.21.15.49:0/3523694835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0144163680 0x7f01440c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.100+0000 7f014a400700 1 --2- 172.21.15.49:0/3523694835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01440c0790 0x7f0144163190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.100+0000 7f014a400700 1 --2- 172.21.15.49:0/3523694835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0124004690 0x7f0144142ce0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.100+0000 7f014a400700 1 -- 172.21.15.49:0/3523694835 >> 172.21.15.49:0/3523694835 conn(0x7f01440c51c0 msgr2=0x7f014414cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.100+0000 7f014a400700 1 -- 172.21.15.49:0/3523694835 shutdown_connections 2024-01-22T05:08:16.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.100+0000 7f014a400700 1 -- 172.21.15.49:0/3523694835 wait complete. 2024-01-22T05:08:16.108 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 42 2024-01-22T05:08:16.125 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/suites 2024-01-22T05:08:16.545 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:16.545 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:08:16.545 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:16.563 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' got response code '0' and stdout '{ "return_code": 0 } ' 2024-01-22T05:08:16.563 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-01-22T05:08:16.563 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-01-22T05:08:16.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.732+0000 7f9f43400700 1 Processor -- start 2024-01-22T05:08:16.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.732+0000 7f9f43400700 1 -- start start 2024-01-22T05:08:16.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.736+0000 7f9f43400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f3c0bcbd0 0x7f9f3c0c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.736+0000 7f9f43400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f3c067a90 0x7f9f3c067f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.736+0000 7f9f43400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3c066b20 con 0x7f9f3c0c0ed0 2024-01-22T05:08:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.736+0000 7f9f43400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f3c065f50 con 0x7f9f3c067a90 2024-01-22T05:08:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.736+0000 7f9f43400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c0661f0 con 0x7f9f3c0bcbd0 2024-01-22T05:08:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.736+0000 7f9f42a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f3c067a90 0x7f9f3c067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.736+0000 7f9f42a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f3c067a90 0x7f9f3c067f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:46974/0 (socket says 172.21.15.49:46974) 2024-01-22T05:08:16.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.736+0000 7f9f42a00700 1 -- 172.21.15.49:0/3220057026 learned_addr learned my addr 172.21.15.49:0/3220057026 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:16.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.736+0000 7f9f41600700 1 --2- 172.21.15.49:0/3220057026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f3c0bcbd0 0x7f9f3c0c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.740+0000 7f9f42a00700 1 -- 172.21.15.49:0/3220057026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f3c0bcbd0 msgr2=0x7f9f3c0c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:16.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.740+0000 7f9f42a00700 1 --2- 172.21.15.49:0/3220057026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f3c0bcbd0 0x7f9f3c0c19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.740+0000 7f9f42a00700 1 -- 172.21.15.49:0/3220057026 >> v1:172.21.15.110:6789/0 conn(0x7f9f3c0c0ed0 legacy=0x7f9f3c0c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:16.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.740+0000 7f9f42a00700 1 -- 172.21.15.49:0/3220057026 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c0664d0 con 0x7f9f3c067a90 2024-01-22T05:08:16.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.740+0000 7f9f40c00700 1 -- 172.21.15.49:0/3220057026 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709595909 0 0) 0x7f9f3c066b20 con 0x7f9f3c0c0ed0 2024-01-22T05:08:16.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.740+0000 7f9f42a00700 1 --2- 172.21.15.49:0/3220057026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3c067a90 0x7f9f3c067f00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f9f2c006fd0 tx=0x7f9f2c0090f0).ready entity=mon.1 client_cookie=ba497ad2f31a4644 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:16.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.740+0000 7f9f40c00700 1 -- 172.21.15.49:0/3220057026 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c00b580 con 0x7f9f3c067a90 2024-01-22T05:08:16.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.740+0000 7f9f40c00700 1 -- 172.21.15.49:0/3220057026 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c00b6e0 con 0x7f9f3c067a90 2024-01-22T05:08:16.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.740+0000 7f9f40c00700 1 -- 172.21.15.49:0/3220057026 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c00ba60 con 0x7f9f3c067a90 2024-01-22T05:08:16.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.740+0000 7f9f43400700 1 -- 172.21.15.49:0/3220057026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3c067a90 msgr2=0x7f9f3c067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:16.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.740+0000 7f9f43400700 1 --2- 172.21.15.49:0/3220057026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3c067a90 0x7f9f3c067f00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f9f2c006fd0 tx=0x7f9f2c0090f0).stop 2024-01-22T05:08:16.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.744+0000 7f9f43400700 1 -- 172.21.15.49:0/3220057026 shutdown_connections 2024-01-22T05:08:16.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.744+0000 7f9f43400700 1 --2- 172.21.15.49:0/3220057026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3c067a90 0x7f9f3c067f00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.744+0000 7f9f43400700 1 --2- 172.21.15.49:0/3220057026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f3c0bcbd0 0x7f9f3c0c19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.744+0000 7f9f43400700 1 -- 172.21.15.49:0/3220057026 >> 172.21.15.49:0/3220057026 conn(0x7f9f3c0c6fc0 msgr2=0x7f9f3c0c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:16.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.744+0000 7f9f43400700 1 -- 172.21.15.49:0/3220057026 shutdown_connections 2024-01-22T05:08:16.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.744+0000 7f9f43400700 1 -- 172.21.15.49:0/3220057026 wait complete. 2024-01-22T05:08:16.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.748+0000 7f9f43400700 1 Processor -- start 2024-01-22T05:08:16.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.748+0000 7f9f43400700 1 -- start start 2024-01-22T05:08:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.748+0000 7f9f43400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f3c067a90 0x7f9f3c14c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.748+0000 7f9f43400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3c0bcbd0 0x7f9f3c146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.748+0000 7f9f43400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f3c0c0ed0 0x7f9f3c146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.748+0000 7f9f43400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c0bfb00 con 0x7f9f3c067a90 2024-01-22T05:08:16.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.748+0000 7f9f43400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c146a50 con 0x7f9f3c0bcbd0 2024-01-22T05:08:16.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.748+0000 7f9f43400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c148fd0 con 0x7f9f3c0c0ed0 2024-01-22T05:08:16.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.752+0000 7f9f41600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3c0bcbd0 0x7f9f3c146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.752+0000 7f9f41600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3c0bcbd0 0x7f9f3c146070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:46984/0 (socket says 172.21.15.49:46984) 2024-01-22T05:08:16.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.752+0000 7f9f41600700 1 -- 172.21.15.49:0/131119488 learned_addr learned my addr 172.21.15.49:0/131119488 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:16.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.752+0000 7f9f42a00700 1 --2- 172.21.15.49:0/131119488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f3c0c0ed0 0x7f9f3c146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.752+0000 7f9f41600700 1 -- 172.21.15.49:0/131119488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f3c0c0ed0 msgr2=0x7f9f3c146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:16.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.752+0000 7f9f41600700 1 --2- 172.21.15.49:0/131119488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f3c0c0ed0 0x7f9f3c146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.752+0000 7f9f41600700 1 -- 172.21.15.49:0/131119488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f3c067a90 msgr2=0x7f9f3c14c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:16.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.752+0000 7f9f41600700 1 --2- 172.21.15.49:0/131119488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f3c067a90 0x7f9f3c14c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:16.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.752+0000 7f9f41600700 1 -- 172.21.15.49:0/131119488 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c009370 con 0x7f9f3c0bcbd0 2024-01-22T05:08:16.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.752+0000 7f9f41600700 1 --2- 172.21.15.49:0/131119488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3c0bcbd0 0x7f9f3c146070 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f9f2400e900 tx=0x7f9f24009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:16.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.752+0000 7f9f39600700 1 -- 172.21.15.49:0/131119488 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2400c640 con 0x7f9f3c0bcbd0 2024-01-22T05:08:16.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.752+0000 7f9f39600700 1 -- 172.21.15.49:0/131119488 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2400c7a0 con 0x7f9f3c0bcbd0 2024-01-22T05:08:16.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.752+0000 7f9f43400700 1 -- 172.21.15.49:0/131119488 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3c1492b0 con 0x7f9f3c0bcbd0 2024-01-22T05:08:16.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.752+0000 7f9f39600700 1 -- 172.21.15.49:0/131119488 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2400cb20 con 0x7f9f3c0bcbd0 2024-01-22T05:08:16.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.752+0000 7f9f43400700 1 -- 172.21.15.49:0/131119488 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3c149640 con 0x7f9f3c0bcbd0 2024-01-22T05:08:16.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.756+0000 7f9f39600700 1 -- 172.21.15.49:0/131119488 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9f2401b400 con 0x7f9f3c0bcbd0 2024-01-22T05:08:16.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.756+0000 7f9f39600700 1 --2- 172.21.15.49:0/131119488 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f1405a510 0x7f9f1405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.756+0000 7f9f39600700 1 -- 172.21.15.49:0/131119488 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9f24074dc0 con 0x7f9f3c0bcbd0 2024-01-22T05:08:16.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.760+0000 7f9f42000700 1 --2- 172.21.15.49:0/131119488 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f1405a510 0x7f9f1405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.760+0000 7f9f4edb7740 1 Processor -- start 2024-01-22T05:08:16.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.760+0000 7f9f42000700 1 --2- 172.21.15.49:0/131119488 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f1405a510 0x7f9f1405c9d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f9f34001bb0 tx=0x7f9f34007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:16.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.760+0000 7f9f4edb7740 1 -- start start 2024-01-22T05:08:16.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.760+0000 7f9f4edb7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1aeffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.760+0000 7f9f4edb7740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1ad4a50 0x1aa81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.760+0000 7f9f4edb7740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1aae6f0 0x1aa86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.760+0000 7f9f4edb7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x19e83f0 con 0x1aefbe0 2024-01-22T05:08:16.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.760+0000 7f9f4edb7740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a0b5f0 con 0x1aae6f0 2024-01-22T05:08:16.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.760+0000 7f9f4edb7740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x19d4cf0 con 0x1ad4a50 2024-01-22T05:08:16.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.760+0000 7f9f42000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1aeffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f42000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1aeffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35354/0 (socket says 172.21.15.49:35354) 2024-01-22T05:08:16.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f42000700 1 -- 172.21.15.49:0/2465650039 learned_addr learned my addr 172.21.15.49:0/2465650039 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:16.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f41600700 1 --2- 172.21.15.49:0/2465650039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1ad4a50 0x1aa81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f42a00700 1 --2- 172.21.15.49:0/2465650039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1aae6f0 0x1aa86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f41600700 1 -- 172.21.15.49:0/2465650039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1aae6f0 msgr2=0x1aa86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f41600700 1 --2- 172.21.15.49:0/2465650039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1aae6f0 0x1aa86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f41600700 1 -- 172.21.15.49:0/2465650039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 msgr2=0x1aeffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f41600700 1 --2- 172.21.15.49:0/2465650039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1aeffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f41600700 1 -- 172.21.15.49:0/2465650039 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a390c0 con 0x1ad4a50 2024-01-22T05:08:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f41600700 1 --2- 172.21.15.49:0/2465650039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1ad4a50 0x1aa81f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f9f2400e8d0 tx=0x7f9f24011000).ready entity=mon.2 client_cookie=d75a12695778bc62 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f31c00700 1 -- 172.21.15.49:0/2465650039 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2404bf80 con 0x1ad4a50 2024-01-22T05:08:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f31c00700 1 -- 172.21.15.49:0/2465650039 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f24051720 con 0x1ad4a50 2024-01-22T05:08:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f31c00700 1 -- 172.21.15.49:0/2465650039 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24072cf0 con 0x1ad4a50 2024-01-22T05:08:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f4edb7740 1 -- 172.21.15.49:0/2465650039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1ad4a50 msgr2=0x1aa81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/2465650039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1ad4a50 0x1aa81f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f9f2400e8d0 tx=0x7f9f24011000).stop 2024-01-22T05:08:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f4edb7740 1 -- 172.21.15.49:0/2465650039 shutdown_connections 2024-01-22T05:08:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/2465650039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1aae6f0 0x1aa86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/2465650039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1ad4a50 0x1aa81f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/2465650039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1aeffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.764+0000 7f9f4edb7740 1 -- 172.21.15.49:0/2465650039 >> 172.21.15.49:0/2465650039 conn(0x188d930 msgr2=0x1af5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.768+0000 7f9f4edb7740 1 -- 172.21.15.49:0/2465650039 shutdown_connections 2024-01-22T05:08:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.768+0000 7f9f4edb7740 1 -- 172.21.15.49:0/2465650039 wait complete. 2024-01-22T05:08:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.768+0000 7f9f4edb7740 1 -- start start 2024-01-22T05:08:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.768+0000 7f9f4edb7740 1 Processor -- start 2024-01-22T05:08:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f4edb7740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 0x1b00b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f4edb7740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1ad4a50 0x1ad5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f4edb7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1ada8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f4edb7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ad7800 con 0x1aefbe0 2024-01-22T05:08:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f4edb7740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ad6930 con 0x1ad4a50 2024-01-22T05:08:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f4edb7740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b013e0 con 0x1aae6f0 2024-01-22T05:08:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f4edb7740 10 client.0 ll_register_callbacks cb 0x1a65d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:16.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f42000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 0x1b00b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f41600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1ad4a50 0x1ad5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f42000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 0x1b00b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:33992/0 (socket says 172.21.15.49:33992) 2024-01-22T05:08:16.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f42a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1ada8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f42000700 1 -- 172.21.15.49:0/4238846329 learned_addr learned my addr 172.21.15.49:0/4238846329 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:16.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f42a00700 1 -- 172.21.15.49:0/4238846329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 msgr2=0x1b00b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:16.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f42a00700 1 --2- 172.21.15.49:0/4238846329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 0x1b00b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f42a00700 1 -- 172.21.15.49:0/4238846329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1ad4a50 msgr2=0x1ad5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:16.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f42a00700 1 --2- 172.21.15.49:0/4238846329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1ad4a50 0x1ad5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f42a00700 1 -- 172.21.15.49:0/4238846329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3c149640 con 0x1aefbe0 2024-01-22T05:08:16.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f41600700 1 --2- 172.21.15.49:0/4238846329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1ad4a50 0x1ad5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:16.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f42a00700 1 --2- 172.21.15.49:0/4238846329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1ada8f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f9f2c014000 tx=0x7f9f2c017000).ready entity=mon.0 client_cookie=8bb999abdd4bca96 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:16.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.772+0000 7f9f2a000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:16.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.776+0000 7f9f2a000700 1 -- 172.21.15.49:0/4238846329 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c021070 con 0x1aefbe0 2024-01-22T05:08:16.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.776+0000 7f9f2a000700 1 -- 172.21.15.49:0/4238846329 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9f2c01c780 con 0x1aefbe0 2024-01-22T05:08:16.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.776+0000 7f9f4edb7740 1 -- 172.21.15.49:0/4238846329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a25340 con 0x1aefbe0 2024-01-22T05:08:16.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.776+0000 7f9f2a000700 1 -- 172.21.15.49:0/4238846329 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f2c01cb90 con 0x1aefbe0 2024-01-22T05:08:16.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.776+0000 7f9f4edb7740 10 client.5772 fetch_fsmap learned FSMap version 42 2024-01-22T05:08:16.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.776+0000 7f9f4edb7740 1 -- 172.21.15.49:0/4238846329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x1a288d0 con 0x1aefbe0 2024-01-22T05:08:16.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.776+0000 7f9f2a000700 1 -- 172.21.15.49:0/4238846329 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a25340 con 0x1aefbe0 2024-01-22T05:08:16.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.776+0000 7f9f2a000700 1 -- 172.21.15.49:0/4238846329 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9f2c009830 con 0x1aefbe0 2024-01-22T05:08:16.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.776+0000 7f9f4edb7740 10 client.5772 fetch_fsmap finished waiting for FSMap version 42 2024-01-22T05:08:16.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.776+0000 7f9f4edb7740 10 client.5772 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:16.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.776+0000 7f9f4edb7740 20 client.5772 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:16.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.776+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/4238846329 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1af43f0 0x1aab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.776+0000 7f9f4edb7740 4 client.5772 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:16.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.776+0000 7f9f4edb7740 1 -- 172.21.15.49:0/4238846329 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a1b890 con 0x1af43f0 2024-01-22T05:08:16.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.776+0000 7f9f42000700 1 --2- 172.21.15.49:0/4238846329 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1af43f0 0x1aab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.780+0000 7f9f42000700 1 --2- 172.21.15.49:0/4238846329 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1af43f0 0x1aab780 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2206e8995f062d6d server_cookie=1584709b7de8772c in_seq=0 out_seq=0 2024-01-22T05:08:16.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.780+0000 7f9f2a000700 10 client.5772 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:16.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.784+0000 7f9f2a000700 1 -- 172.21.15.49:0/4238846329 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1a1b890 con 0x1af43f0 2024-01-22T05:08:16.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.784+0000 7f9f2a000700 10 client.5772 handle_command_reply: tid=0 2024-01-22T05:08:16.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.788+0000 7f9f4edb7740 1 client.5772 shutdown 2024-01-22T05:08:16.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.788+0000 7f9f4edb7740 1 -- 172.21.15.49:0/4238846329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 msgr2=0x1ada8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:16.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.788+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/4238846329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1ada8f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f9f2c014000 tx=0x7f9f2c017000).stop 2024-01-22T05:08:16.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.788+0000 7f9f4edb7740 1 -- 172.21.15.49:0/4238846329 shutdown_connections 2024-01-22T05:08:16.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.788+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/4238846329 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1af43f0 0x1aab780 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.788+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/4238846329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1ada8f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.788+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/4238846329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1ad4a50 0x1ad5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.788+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/4238846329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 0x1b00b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.788+0000 7f9f4edb7740 1 -- 172.21.15.49:0/4238846329 >> 172.21.15.49:0/4238846329 conn(0x188d930 msgr2=0x1acf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:16.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.788+0000 7f9f2a000700 0 client.5772 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:16.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.788+0000 7f9f4edb7740 1 -- 172.21.15.49:0/4238846329 shutdown_connections 2024-01-22T05:08:16.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.788+0000 7f9f4edb7740 1 -- 172.21.15.49:0/4238846329 wait complete. 2024-01-22T05:08:16.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.788+0000 7f9f4edb7740 20 client.5772 trim_cache size 0 max 16384 2024-01-22T05:08:16.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.812+0000 7f9f4edb7740 1 Processor -- start 2024-01-22T05:08:16.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.812+0000 7f9f4edb7740 1 -- start start 2024-01-22T05:08:16.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f4edb7740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 0x1ad5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f4edb7740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1ad4a50 0x1af3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f4edb7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1ad96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f4edb7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a718e0 con 0x1aefbe0 2024-01-22T05:08:16.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f4edb7740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a1b890 con 0x1ad4a50 2024-01-22T05:08:16.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f4edb7740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a25340 con 0x1aae6f0 2024-01-22T05:08:16.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f42a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1ad96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f42a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1ad96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35376/0 (socket says 172.21.15.49:35376) 2024-01-22T05:08:16.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f42a00700 1 -- 172.21.15.49:0/1868400033 learned_addr learned my addr 172.21.15.49:0/1868400033 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:16.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f42000700 1 --2- 172.21.15.49:0/1868400033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 0x1ad5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f42a00700 1 -- 172.21.15.49:0/1868400033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 msgr2=0x1ad5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:16.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f42a00700 1 --2- 172.21.15.49:0/1868400033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 0x1ad5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f42a00700 1 -- 172.21.15.49:0/1868400033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1ad4a50 msgr2=0x1af3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:16.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f42a00700 1 --2- 172.21.15.49:0/1868400033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1ad4a50 0x1af3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:16.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f42a00700 1 -- 172.21.15.49:0/1868400033 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c15a490 con 0x1aefbe0 2024-01-22T05:08:16.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f42000700 1 --2- 172.21.15.49:0/1868400033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 0x1ad5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:16.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f42a00700 1 --2- 172.21.15.49:0/1868400033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1ad96b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f9f2c008000 tx=0x7f9f2c021000).ready entity=mon.0 client_cookie=b8c18f24f4361a66 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:16.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f32600700 1 -- 172.21.15.49:0/1868400033 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c006d30 con 0x1aefbe0 2024-01-22T05:08:16.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f32600700 1 -- 172.21.15.49:0/1868400033 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c01c780 con 0x1aefbe0 2024-01-22T05:08:16.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.816+0000 7f9f32600700 1 -- 172.21.15.49:0/1868400033 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c00bbb0 con 0x1aefbe0 2024-01-22T05:08:16.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.820+0000 7f9f4edb7740 1 -- 172.21.15.49:0/1868400033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 msgr2=0x1ad96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:16.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.820+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/1868400033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1ad96b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f9f2c008000 tx=0x7f9f2c021000).stop 2024-01-22T05:08:16.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.820+0000 7f9f4edb7740 1 -- 172.21.15.49:0/1868400033 shutdown_connections 2024-01-22T05:08:16.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.820+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/1868400033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1aefbe0 0x1ad96b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.820+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/1868400033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1ad4a50 0x1af3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:16.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.820+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/1868400033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 0x1ad5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.820+0000 7f9f4edb7740 1 -- 172.21.15.49:0/1868400033 >> 172.21.15.49:0/1868400033 conn(0x188d930 msgr2=0x1aad650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:16.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.820+0000 7f9f4edb7740 1 -- 172.21.15.49:0/1868400033 shutdown_connections 2024-01-22T05:08:16.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.820+0000 7f9f4edb7740 1 -- 172.21.15.49:0/1868400033 wait complete. 2024-01-22T05:08:16.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.820+0000 7f9f4edb7740 1 -- start start 2024-01-22T05:08:16.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.820+0000 7f9f4edb7740 1 Processor -- start 2024-01-22T05:08:16.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.824+0000 7f9f4edb7740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 0x1aeffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.824+0000 7f9f4edb7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1ad4a50 0x1af04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.824+0000 7f9f4edb7740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1aefbe0 0x1b57590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.824+0000 7f9f4edb7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1af09a0 con 0x1ad4a50 2024-01-22T05:08:16.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.824+0000 7f9f4edb7740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b58900 con 0x1aefbe0 2024-01-22T05:08:16.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f4edb7740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ada0f0 con 0x1aae6f0 2024-01-22T05:08:16.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f42000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 0x1aeffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f42a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1aefbe0 0x1b57590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f42000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 0x1aeffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:34024/0 (socket says 172.21.15.49:34024) 2024-01-22T05:08:16.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f42a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1aefbe0 0x1b57590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:47020/0 (socket says 172.21.15.49:47020) 2024-01-22T05:08:16.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f42000700 1 -- 172.21.15.49:0/3511003611 learned_addr learned my addr 172.21.15.49:0/3511003611 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:16.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f4edb7740 10 client.0 ll_register_callbacks cb 0x7f9f24006e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:16.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f42a00700 1 -- 172.21.15.49:0/3511003611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 msgr2=0x1aeffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:16.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f42a00700 1 --2- 172.21.15.49:0/3511003611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 0x1aeffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f42a00700 1 -- 172.21.15.49:0/3511003611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1ad4a50 msgr2=0x1af04b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-22T05:08:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f42a00700 1 --2- 172.21.15.49:0/3511003611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1ad4a50 0x1af04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f42a00700 1 -- 172.21.15.49:0/3511003611 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1a288d0 con 0x1aefbe0 2024-01-22T05:08:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f42a00700 1 --2- 172.21.15.49:0/3511003611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1aefbe0 0x1b57590 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f9f2c009ea0 tx=0x7f9f2c02f000).ready entity=mon.1 client_cookie=aa8afe30ec43494a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f2a000700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-01-22T05:08:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f2a000700 1 -- 172.21.15.49:0/3511003611 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c03c070 con 0x1aefbe0 2024-01-22T05:08:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f2a000700 1 -- 172.21.15.49:0/3511003611 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9f2c006d30 con 0x1aefbe0 2024-01-22T05:08:16.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f4edb7740 1 -- 172.21.15.49:0/3511003611 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9f24051720 con 0x1aefbe0 2024-01-22T05:08:16.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f2a000700 1 -- 172.21.15.49:0/3511003611 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f2c021040 con 0x1aefbe0 2024-01-22T05:08:16.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f4edb7740 10 client.5767 fetch_fsmap learned FSMap version 42 2024-01-22T05:08:16.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.828+0000 7f9f4edb7740 1 -- 172.21.15.49:0/3511003611 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x1a23b00 con 0x1aefbe0 2024-01-22T05:08:16.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.832+0000 7f9f2a000700 1 -- 172.21.15.49:0/3511003611 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f24051720 con 0x1aefbe0 2024-01-22T05:08:16.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.832+0000 7f9f2a000700 1 -- 172.21.15.49:0/3511003611 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9f2c03f020 con 0x1aefbe0 2024-01-22T05:08:16.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.832+0000 7f9f4edb7740 10 client.5767 fetch_fsmap finished waiting for FSMap version 42 2024-01-22T05:08:16.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.832+0000 7f9f4edb7740 10 client.5767 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:16.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.832+0000 7f9f4edb7740 20 client.5767 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:16.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.832+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/3511003611 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1aaaa00 0x1b57a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:16.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.832+0000 7f9f4edb7740 4 client.5767 mds_command: new command op to 5569 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-01-22T05:08:16.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.832+0000 7f9f4edb7740 1 -- 172.21.15.49:0/3511003611 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) v1 -- 0x18e48c0 con 0x1aaaa00 2024-01-22T05:08:16.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.832+0000 7f9f42000700 1 --2- 172.21.15.49:0/3511003611 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1aaaa00 0x1b57a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:16.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.832+0000 7f9f42000700 1 --2- 172.21.15.49:0/3511003611 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1aaaa00 0x1b57a80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=102c648f644ad239 server_cookie=c8b27912578e938e in_seq=0 out_seq=0 2024-01-22T05:08:16.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:16.832+0000 7f9f2a000700 10 client.5767 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:17.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.012+0000 7f9f2a000700 1 -- 172.21.15.49:0/3511003611 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x18e48c0 con 0x1aaaa00 2024-01-22T05:08:17.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.012+0000 7f9f2a000700 10 client.5767 handle_command_reply: tid=0 2024-01-22T05:08:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.012+0000 7f9f4edb7740 1 client.5767 shutdown 2024-01-22T05:08:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.016+0000 7f9f4edb7740 1 -- 172.21.15.49:0/3511003611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1aefbe0 msgr2=0x1b57590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.016+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/3511003611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1aefbe0 0x1b57590 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f9f2c009ea0 tx=0x7f9f2c02f000).stop 2024-01-22T05:08:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.016+0000 7f9f4edb7740 1 -- 172.21.15.49:0/3511003611 shutdown_connections 2024-01-22T05:08:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.016+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/3511003611 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1aaaa00 0x1b57a80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.016+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/3511003611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1aefbe0 0x1b57590 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.016+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/3511003611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1ad4a50 0x1af04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.016+0000 7f9f4edb7740 1 --2- 172.21.15.49:0/3511003611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1aae6f0 0x1aeffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.016+0000 7f9f4edb7740 1 -- 172.21.15.49:0/3511003611 >> 172.21.15.49:0/3511003611 conn(0x188d930 msgr2=0x1af2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:17.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.016+0000 7f9f2a000700 0 client.5767 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:17.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.016+0000 7f9f4edb7740 1 -- 172.21.15.49:0/3511003611 shutdown_connections 2024-01-22T05:08:17.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.020+0000 7f9f4edb7740 1 -- 172.21.15.49:0/3511003611 wait complete. 2024-01-22T05:08:17.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.020+0000 7f9f4edb7740 20 client.5767 trim_cache size 0 max 16384 2024-01-22T05:08:17.023 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:17.023 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:08:17.023 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "1d1be5b8-58b4-4895-a860-edda6ca62310", 2024-01-22T05:08:17.023 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:08:17.023 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.020+0000 7f9f43400700 1 -- 172.21.15.49:0/131119488 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f1405a510 msgr2=0x7f9f1405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.020+0000 7f9f43400700 1 --2- 172.21.15.49:0/131119488 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f1405a510 0x7f9f1405c9d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f9f34001bb0 tx=0x7f9f34007d40).stop 2024-01-22T05:08:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.024+0000 7f9f43400700 1 -- 172.21.15.49:0/131119488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3c0bcbd0 msgr2=0x7f9f3c146070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.024+0000 7f9f43400700 1 --2- 172.21.15.49:0/131119488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3c0bcbd0 0x7f9f3c146070 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f9f2400e900 tx=0x7f9f24009060).stop 2024-01-22T05:08:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.024+0000 7f9f43400700 1 -- 172.21.15.49:0/131119488 shutdown_connections 2024-01-22T05:08:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.024+0000 7f9f43400700 1 --2- 172.21.15.49:0/131119488 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f1405a510 0x7f9f1405c9d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.024+0000 7f9f43400700 1 --2- 172.21.15.49:0/131119488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f3c0c0ed0 0x7f9f3c146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.024+0000 7f9f43400700 1 --2- 172.21.15.49:0/131119488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3c0bcbd0 0x7f9f3c146070 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.024+0000 7f9f43400700 1 --2- 172.21.15.49:0/131119488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f3c067a90 0x7f9f3c14c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:17.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.024+0000 7f9f43400700 1 -- 172.21.15.49:0/131119488 >> 172.21.15.49:0/131119488 conn(0x7f9f3c0c6fc0 msgr2=0x7f9f3c150cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:17.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.024+0000 7f9f43400700 1 -- 172.21.15.49:0/131119488 shutdown_connections 2024-01-22T05:08:17.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.024+0000 7f9f43400700 1 -- 172.21.15.49:0/131119488 wait complete. 2024-01-22T05:08:17.065 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '1d1be5b8-58b4-4895-a860-edda6ca62310', 'mode': 'asynchronous'}' 2024-01-22T05:08:17.065 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-01-22T05:08:17.065 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-01-22T05:08:17.065 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:17.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.240+0000 7f0cc4800700 1 Processor -- start 2024-01-22T05:08:17.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.240+0000 7f0cc4800700 1 -- start start 2024-01-22T05:08:17.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc4800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0cbc065240 0x7f0cbc0644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc4800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0cbc065620 0x7f0cbc0649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc4800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cbc0c2700 con 0x7f0cbc15b9b0 2024-01-22T05:08:17.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc4800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cbc064ed0 con 0x7f0cbc065240 2024-01-22T05:08:17.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc4800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cbc0c29a0 con 0x7f0cbc065620 2024-01-22T05:08:17.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc1e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0cbc065240 0x7f0cbc0644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc1e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0cbc065240 0x7f0cbc0644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35396/0 (socket says 172.21.15.49:35396) 2024-01-22T05:08:17.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc1e00700 1 -- 172.21.15.49:0/3785542898 learned_addr learned my addr 172.21.15.49:0/3785542898 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:17.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc1400700 1 --2- 172.21.15.49:0/3785542898 >> v2:172.21.15.110:3300/0 conn(0x7f0cbc065620 0x7f0cbc0649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc1e00700 1 -- 172.21.15.49:0/3785542898 >> v2:172.21.15.110:3300/0 conn(0x7f0cbc065620 msgr2=0x7f0cbc0649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:17.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc1e00700 1 --2- 172.21.15.49:0/3785542898 >> v2:172.21.15.110:3300/0 conn(0x7f0cbc065620 0x7f0cbc0649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc1e00700 1 -- 172.21.15.49:0/3785542898 >> v1:172.21.15.110:6789/0 conn(0x7f0cbc15b9b0 legacy=0x7f0cbc15bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc1e00700 1 -- 172.21.15.49:0/3785542898 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc0c2c80 con 0x7f0cbc065240 2024-01-22T05:08:17.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc1e00700 1 --2- 172.21.15.49:0/3785542898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cbc065240 0x7f0cbc0644f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f0cbc0c4770 tx=0x7f0cac0090f0).ready entity=mon.0 client_cookie=6a64c4c0d1d11685 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc0a00700 1 -- 172.21.15.49:0/3785542898 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac00b520 con 0x7f0cbc065240 2024-01-22T05:08:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc0a00700 1 -- 172.21.15.49:0/3785542898 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac00b680 con 0x7f0cbc065240 2024-01-22T05:08:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.244+0000 7f0cc0a00700 1 -- 172.21.15.49:0/3785542898 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac00ba00 con 0x7f0cbc065240 2024-01-22T05:08:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.248+0000 7f0cc4800700 1 -- 172.21.15.49:0/3785542898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cbc065240 msgr2=0x7f0cbc0644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.248+0000 7f0cc4800700 1 --2- 172.21.15.49:0/3785542898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cbc065240 0x7f0cbc0644f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f0cbc0c4770 tx=0x7f0cac0090f0).stop 2024-01-22T05:08:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.248+0000 7f0cc4800700 1 -- 172.21.15.49:0/3785542898 shutdown_connections 2024-01-22T05:08:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.248+0000 7f0cc4800700 1 --2- 172.21.15.49:0/3785542898 >> v2:172.21.15.110:3300/0 conn(0x7f0cbc065620 0x7f0cbc0649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.248+0000 7f0cc4800700 1 --2- 172.21.15.49:0/3785542898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cbc065240 0x7f0cbc0644f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.248+0000 7f0cc4800700 1 -- 172.21.15.49:0/3785542898 >> 172.21.15.49:0/3785542898 conn(0x7f0cbc0c87f0 msgr2=0x7f0cbc0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.248+0000 7f0cc4800700 1 -- 172.21.15.49:0/3785542898 shutdown_connections 2024-01-22T05:08:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.248+0000 7f0cc4800700 1 -- 172.21.15.49:0/3785542898 wait complete. 2024-01-22T05:08:17.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.252+0000 7f0cc4800700 1 Processor -- start 2024-01-22T05:08:17.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.252+0000 7f0cc4800700 1 -- start start 2024-01-22T05:08:17.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.252+0000 7f0cc4800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cbc065240 0x7f0cbc155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.252+0000 7f0cc4800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cbc065620 0x7f0cbc0c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.252+0000 7f0cc4800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0cbc15b9b0 0x7f0cbc0c1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.252+0000 7f0cc4800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc158490 con 0x7f0cbc065620 2024-01-22T05:08:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.252+0000 7f0cc4800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc156030 con 0x7f0cbc065240 2024-01-22T05:08:17.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.252+0000 7f0cc4800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc0c1950 con 0x7f0cbc15b9b0 2024-01-22T05:08:17.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cc1400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cbc065620 0x7f0cbc0c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cc1400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cbc065620 0x7f0cbc0c0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35408/0 (socket says 172.21.15.49:35408) 2024-01-22T05:08:17.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cc1400700 1 -- 172.21.15.49:0/1892380924 learned_addr learned my addr 172.21.15.49:0/1892380924 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:17.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cc1e00700 1 --2- 172.21.15.49:0/1892380924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cbc065240 0x7f0cbc155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cc3200700 1 --2- 172.21.15.49:0/1892380924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0cbc15b9b0 0x7f0cbc0c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cc1400700 1 -- 172.21.15.49:0/1892380924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0cbc15b9b0 msgr2=0x7f0cbc0c1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cc1400700 1 --2- 172.21.15.49:0/1892380924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0cbc15b9b0 0x7f0cbc0c1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cc1400700 1 -- 172.21.15.49:0/1892380924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cbc065240 msgr2=0x7f0cbc155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cc1400700 1 --2- 172.21.15.49:0/1892380924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cbc065240 0x7f0cbc155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cc1400700 1 -- 172.21.15.49:0/1892380924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cac009370 con 0x7f0cbc065620 2024-01-22T05:08:17.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cc1400700 1 --2- 172.21.15.49:0/1892380924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cbc065620 0x7f0cbc0c0e20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f0ca400e900 tx=0x7f0ca4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:17.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cb9600700 1 -- 172.21.15.49:0/1892380924 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4012600 con 0x7f0cbc065620 2024-01-22T05:08:17.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cb9600700 1 -- 172.21.15.49:0/1892380924 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca4012760 con 0x7f0cbc065620 2024-01-22T05:08:17.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cc4800700 1 -- 172.21.15.49:0/1892380924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cbc0c1c30 con 0x7f0cbc065620 2024-01-22T05:08:17.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cb9600700 1 -- 172.21.15.49:0/1892380924 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4012ae0 con 0x7f0cbc065620 2024-01-22T05:08:17.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.256+0000 7f0cc4800700 1 -- 172.21.15.49:0/1892380924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cbc158120 con 0x7f0cbc065620 2024-01-22T05:08:17.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.260+0000 7f0cc4800700 1 -- 172.21.15.49:0/1892380924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cbc158640 con 0x7f0cbc065620 2024-01-22T05:08:17.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.260+0000 7f0cb9600700 1 -- 172.21.15.49:0/1892380924 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0ca401b400 con 0x7f0cbc065620 2024-01-22T05:08:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.260+0000 7f0cb9600700 1 --2- 172.21.15.49:0/1892380924 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0c9405a510 0x7f0c9405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.260+0000 7f0cb9600700 1 -- 172.21.15.49:0/1892380924 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f0ca4074e70 con 0x7f0cbc065620 2024-01-22T05:08:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.260+0000 7f0cc1e00700 1 --2- 172.21.15.49:0/1892380924 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0c9405a510 0x7f0c9405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.260+0000 7f0cc1e00700 1 --2- 172.21.15.49:0/1892380924 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0c9405a510 0x7f0c9405c9d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f0cac009130 tx=0x7f0cac017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.268+0000 7f0cb9600700 1 -- 172.21.15.49:0/1892380924 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0cbc158640 con 0x7f0cbc065620 2024-01-22T05:08:17.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.464+0000 7f0cc4800700 1 -- 172.21.15.49:0/1892380924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cbc047060 con 0x7f0cbc065620 2024-01-22T05:08:17.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.468+0000 7f0cb9600700 1 -- 172.21.15.49:0/1892380924 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f0ca4016070 con 0x7f0cbc065620 2024-01-22T05:08:17.470 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:17.470 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:05.000169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:17.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.472+0000 7f0cc4800700 1 -- 172.21.15.49:0/1892380924 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0c9405a510 msgr2=0x7f0c9405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.472+0000 7f0cc4800700 1 --2- 172.21.15.49:0/1892380924 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0c9405a510 0x7f0c9405c9d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f0cac009130 tx=0x7f0cac017000).stop 2024-01-22T05:08:17.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.472+0000 7f0cc4800700 1 -- 172.21.15.49:0/1892380924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cbc065620 msgr2=0x7f0cbc0c0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.472+0000 7f0cc4800700 1 --2- 172.21.15.49:0/1892380924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cbc065620 0x7f0cbc0c0e20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f0ca400e900 tx=0x7f0ca4009060).stop 2024-01-22T05:08:17.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.472+0000 7f0cc4800700 1 -- 172.21.15.49:0/1892380924 shutdown_connections 2024-01-22T05:08:17.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.472+0000 7f0cc4800700 1 --2- 172.21.15.49:0/1892380924 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0c9405a510 0x7f0c9405c9d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.472+0000 7f0cc4800700 1 --2- 172.21.15.49:0/1892380924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0cbc15b9b0 0x7f0cbc0c1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.472+0000 7f0cc4800700 1 --2- 172.21.15.49:0/1892380924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cbc065620 0x7f0cbc0c0e20 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.472+0000 7f0cc4800700 1 --2- 172.21.15.49:0/1892380924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cbc065240 0x7f0cbc155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.472+0000 7f0cc4800700 1 -- 172.21.15.49:0/1892380924 >> 172.21.15.49:0/1892380924 conn(0x7f0cbc0c87f0 msgr2=0x7f0cbc0bcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:17.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.472+0000 7f0cc4800700 1 -- 172.21.15.49:0/1892380924 shutdown_connections 2024-01-22T05:08:17.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.472+0000 7f0cc4800700 1 -- 172.21.15.49:0/1892380924 wait complete. 2024-01-22T05:08:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 42 2024-01-22T05:08:17.496 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-01-22T05:08:17.646 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:17.646 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:08:17.646 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:17.669 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' got response code '0' and stdout '{ "return_code": 0 } ' 2024-01-22T05:08:17.669 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-01-22T05:08:17.670 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-01-22T05:08:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.832+0000 7f12d9e00700 1 Processor -- start 2024-01-22T05:08:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.832+0000 7f12d9e00700 1 -- start start 2024-01-22T05:08:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.836+0000 7f12d9e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f12d40c3c80 0x7f12d4150d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.836+0000 7f12d9e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f12d4064500 0x7f12d40bca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.836+0000 7f12d9e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d40bc5b0 con 0x7f12d40bddc0 2024-01-22T05:08:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.836+0000 7f12d9e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d4151340 con 0x7f12d40c3c80 2024-01-22T05:08:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.836+0000 7f12d9e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d4151620 con 0x7f12d4064500 2024-01-22T05:08:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.836+0000 7f12d2a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f12d40c3c80 0x7f12d4150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.836+0000 7f12d2000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f12d40bddc0 0x7f12d4063df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45920/0 (socket says 172.21.15.49:45920) 2024-01-22T05:08:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.836+0000 7f12d2000700 1 -- 172.21.15.49:0/186295660 learned_addr learned my addr 172.21.15.49:0/186295660 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.836+0000 7f12d3400700 1 --2- 172.21.15.49:0/186295660 >> v2:172.21.15.110:3300/0 conn(0x7f12d4064500 0x7f12d40bca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.836+0000 7f12d1600700 1 -- 172.21.15.49:0/186295660 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638070761 0 0) 0x7f12d40bc5b0 con 0x7f12d40bddc0 2024-01-22T05:08:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.836+0000 7f12d1600700 1 -- 172.21.15.49:0/186295660 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12b40033f0 con 0x7f12d40bddc0 2024-01-22T05:08:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 -- 172.21.15.49:0/186295660 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3901540091 0 0) 0x7f12b40033f0 con 0x7f12d40bddc0 2024-01-22T05:08:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 -- 172.21.15.49:0/186295660 >> v2:172.21.15.110:3300/0 conn(0x7f12d4064500 msgr2=0x7f12d40bca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 --2- 172.21.15.49:0/186295660 >> v2:172.21.15.110:3300/0 conn(0x7f12d4064500 0x7f12d40bca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 -- 172.21.15.49:0/186295660 >> v2:172.21.15.49:3300/0 conn(0x7f12d40c3c80 msgr2=0x7f12d4150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 --2- 172.21.15.49:0/186295660 >> v2:172.21.15.49:3300/0 conn(0x7f12d40c3c80 0x7f12d4150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 -- 172.21.15.49:0/186295660 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d4151900 con 0x7f12d40bddc0 2024-01-22T05:08:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 -- 172.21.15.49:0/186295660 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f12bc001470 con 0x7f12d40bddc0 2024-01-22T05:08:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 -- 172.21.15.49:0/186295660 >> v1:172.21.15.49:6789/0 conn(0x7f12d40bddc0 legacy=0x7f12d4063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 --2- 172.21.15.49:0/186295660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b40038e0 0x7f12b4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 --2- 172.21.15.49:0/186295660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12b4004690 0x7f12b4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 --2- 172.21.15.49:0/186295660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b4005000 0x7f12b400daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 -- 172.21.15.49:0/186295660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4151340 con 0x7f12b40038e0 2024-01-22T05:08:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 -- 172.21.15.49:0/186295660 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4151620 con 0x7f12b4004690 2024-01-22T05:08:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 -- 172.21.15.49:0/186295660 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b400e170 con 0x7f12b4005000 2024-01-22T05:08:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d2a00700 1 --2- 172.21.15.49:0/186295660 >> v2:172.21.15.49:3300/0 conn(0x7f12d40c3c80 0x7f12d4150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d2a00700 1 --2- 172.21.15.49:0/186295660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b40038e0 0x7f12b4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d2000700 1 --2- 172.21.15.49:0/186295660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12b4004690 0x7f12b4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d3400700 1 --2- 172.21.15.49:0/186295660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b4005000 0x7f12b400daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d2a00700 1 -- 172.21.15.49:0/186295660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b4005000 msgr2=0x7f12b400daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d2a00700 1 --2- 172.21.15.49:0/186295660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b4005000 0x7f12b400daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d2a00700 1 -- 172.21.15.49:0/186295660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12b4004690 msgr2=0x7f12b4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d2a00700 1 --2- 172.21.15.49:0/186295660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12b4004690 0x7f12b4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d3400700 1 -- 172.21.15.49:0/186295660 reap_dead start 2024-01-22T05:08:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d2a00700 1 -- 172.21.15.49:0/186295660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b40033f0 con 0x7f12b40038e0 2024-01-22T05:08:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d2a00700 1 --2- 172.21.15.49:0/186295660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b40038e0 0x7f12b4003d00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f12c4009c30 tx=0x7f12c4009060).ready entity=mon.0 client_cookie=3372d1cc208cc10a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 -- 172.21.15.49:0/186295660 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c40095c0 con 0x7f12b40038e0 2024-01-22T05:08:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 -- 172.21.15.49:0/186295660 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c400e710 con 0x7f12b40038e0 2024-01-22T05:08:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d1600700 1 -- 172.21.15.49:0/186295660 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c400ea90 con 0x7f12b40038e0 2024-01-22T05:08:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d9e00700 1 -- 172.21.15.49:0/186295660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b40038e0 msgr2=0x7f12b4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d9e00700 1 --2- 172.21.15.49:0/186295660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b40038e0 0x7f12b4003d00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f12c4009c30 tx=0x7f12c4009060).stop 2024-01-22T05:08:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d9e00700 1 -- 172.21.15.49:0/186295660 shutdown_connections 2024-01-22T05:08:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d9e00700 1 --2- 172.21.15.49:0/186295660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b40038e0 0x7f12b4003d00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.840+0000 7f12d9e00700 1 -- 172.21.15.49:0/186295660 >> 172.21.15.49:0/186295660 conn(0x7f12d40c40f0 msgr2=0x7f12d40c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.844+0000 7f12d9e00700 1 -- 172.21.15.49:0/186295660 shutdown_connections 2024-01-22T05:08:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.844+0000 7f12d9e00700 1 -- 172.21.15.49:0/186295660 wait complete. 2024-01-22T05:08:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.844+0000 7f12d9e00700 1 Processor -- start 2024-01-22T05:08:17.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.844+0000 7f12d9e00700 1 -- start start 2024-01-22T05:08:17.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d9e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b40038e0 0x7f12d414d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d9e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d416cb60 0x7f12d414f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d9e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12d416bf40 0x7f12d416c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d9e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d414eba0 con 0x7f12d416cb60 2024-01-22T05:08:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d9e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d414da60 con 0x7f12d416bf40 2024-01-22T05:08:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d9e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d416c890 con 0x7f12b40038e0 2024-01-22T05:08:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d416cb60 0x7f12d414f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d416cb60 0x7f12d414f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35434/0 (socket says 172.21.15.49:35434) 2024-01-22T05:08:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d2000700 1 -- 172.21.15.49:0/1854903027 learned_addr learned my addr 172.21.15.49:0/1854903027 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:17.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d3400700 1 --2- 172.21.15.49:0/1854903027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12d416bf40 0x7f12d416c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d2a00700 1 --2- 172.21.15.49:0/1854903027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b40038e0 0x7f12d414d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d2000700 1 -- 172.21.15.49:0/1854903027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b40038e0 msgr2=0x7f12d414d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d2000700 1 --2- 172.21.15.49:0/1854903027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b40038e0 0x7f12d414d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d2000700 1 -- 172.21.15.49:0/1854903027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12d416bf40 msgr2=0x7f12d416c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d2000700 1 --2- 172.21.15.49:0/1854903027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12d416bf40 0x7f12d416c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d2000700 1 -- 172.21.15.49:0/1854903027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d414df90 con 0x7f12d416cb60 2024-01-22T05:08:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d2a00700 1 --2- 172.21.15.49:0/1854903027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b40038e0 0x7f12d414d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d2000700 1 --2- 172.21.15.49:0/1854903027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d416cb60 0x7f12d414f030 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f12bc007fd0 tx=0x7f12bc001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12ca000700 1 -- 172.21.15.49:0/1854903027 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00f6c0 con 0x7f12d416cb60 2024-01-22T05:08:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12ca000700 1 -- 172.21.15.49:0/1854903027 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc00f820 con 0x7f12d416cb60 2024-01-22T05:08:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d9e00700 1 -- 172.21.15.49:0/1854903027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d414e270 con 0x7f12d416cb60 2024-01-22T05:08:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12ca000700 1 -- 172.21.15.49:0/1854903027 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00fba0 con 0x7f12d416cb60 2024-01-22T05:08:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.848+0000 7f12d9e00700 1 -- 172.21.15.49:0/1854903027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d414e830 con 0x7f12d416cb60 2024-01-22T05:08:17.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.852+0000 7f12ca000700 1 -- 172.21.15.49:0/1854903027 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f12bc01d3b0 con 0x7f12d416cb60 2024-01-22T05:08:17.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.852+0000 7f12ca000700 1 --2- 172.21.15.49:0/1854903027 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f12ac05a510 0x7f12ac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.852+0000 7f12ca000700 1 -- 172.21.15.49:0/1854903027 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f12bc0742f0 con 0x7f12d416cb60 2024-01-22T05:08:17.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.852+0000 7f12d2a00700 1 --2- 172.21.15.49:0/1854903027 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f12ac05a510 0x7f12ac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.856+0000 7f12d2a00700 1 --2- 172.21.15.49:0/1854903027 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f12ac05a510 0x7f12ac05c9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f12c4006d50 tx=0x7f12c4019000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:17.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.856+0000 7f12e438f740 1 Processor -- start 2024-01-22T05:08:17.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.856+0000 7f12e438f740 1 -- start start 2024-01-22T05:08:17.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.856+0000 7f12e438f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d29e0 0x27907c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.856+0000 7f12e438f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x278c610 0x27b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.856+0000 7f12e438f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27d2dc0 0x27dd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.856+0000 7f12e438f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x27118a0 con 0x27d2dc0 2024-01-22T05:08:17.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.856+0000 7f12e438f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x27119e0 con 0x278c610 2024-01-22T05:08:17.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.856+0000 7f12e438f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2711e90 con 0x27d29e0 2024-01-22T05:08:17.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.856+0000 7f12d3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27d2dc0 0x27dd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.856+0000 7f12d3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27d2dc0 0x27dd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35446/0 (socket says 172.21.15.49:35446) 2024-01-22T05:08:17.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.856+0000 7f12d3400700 1 -- 172.21.15.49:0/1915063545 learned_addr learned my addr 172.21.15.49:0/1915063545 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:17.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12d2a00700 1 --2- 172.21.15.49:0/1915063545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d29e0 0x27907c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12d2000700 1 --2- 172.21.15.49:0/1915063545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x278c610 0x27b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12d3400700 1 -- 172.21.15.49:0/1915063545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d29e0 msgr2=0x27907c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:17.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12d3400700 1 --2- 172.21.15.49:0/1915063545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d29e0 0x27907c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12d3400700 1 -- 172.21.15.49:0/1915063545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x278c610 msgr2=0x27b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:17.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12d3400700 1 --2- 172.21.15.49:0/1915063545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x278c610 0x27b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12d3400700 1 -- 172.21.15.49:0/1915063545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x270aa10 con 0x27d2dc0 2024-01-22T05:08:17.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12d2a00700 1 --2- 172.21.15.49:0/1915063545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d29e0 0x27907c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:17.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12d3400700 1 --2- 172.21.15.49:0/1915063545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27d2dc0 0x27dd010 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f12d4064900 tx=0x7f12cc00b040).ready entity=mon.0 client_cookie=407b69a64abdc4b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12c2a00700 1 -- 172.21.15.49:0/1915063545 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc007b10 con 0x27d2dc0 2024-01-22T05:08:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12c2a00700 1 -- 172.21.15.49:0/1915063545 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc00f070 con 0x27d2dc0 2024-01-22T05:08:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12c2a00700 1 -- 172.21.15.49:0/1915063545 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc007e80 con 0x27d2dc0 2024-01-22T05:08:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12e438f740 1 -- 172.21.15.49:0/1915063545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27d2dc0 msgr2=0x27dd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12e438f740 1 --2- 172.21.15.49:0/1915063545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27d2dc0 0x27dd010 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f12d4064900 tx=0x7f12cc00b040).stop 2024-01-22T05:08:17.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12e438f740 1 -- 172.21.15.49:0/1915063545 shutdown_connections 2024-01-22T05:08:17.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12e438f740 1 --2- 172.21.15.49:0/1915063545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27d2dc0 0x27dd010 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12e438f740 1 --2- 172.21.15.49:0/1915063545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x278c610 0x27b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12e438f740 1 --2- 172.21.15.49:0/1915063545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d29e0 0x27907c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12e438f740 1 -- 172.21.15.49:0/1915063545 >> 172.21.15.49:0/1915063545 conn(0x256fad0 msgr2=0x27916b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:17.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12e438f740 1 -- 172.21.15.49:0/1915063545 shutdown_connections 2024-01-22T05:08:17.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.860+0000 7f12e438f740 1 -- 172.21.15.49:0/1915063545 wait complete. 2024-01-22T05:08:17.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.864+0000 7f12e438f740 1 -- start start 2024-01-22T05:08:17.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.864+0000 7f12e438f740 1 Processor -- start 2024-01-22T05:08:17.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x278c610 0x27b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d29e0 0x27b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27d2dc0 0x27b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x27b79a0 con 0x27d2dc0 2024-01-22T05:08:17.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x27b7f20 con 0x278c610 2024-01-22T05:08:17.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x27b8200 con 0x27d29e0 2024-01-22T05:08:17.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 10 client.0 ll_register_callbacks cb 0x2707890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:17.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12d3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27d2dc0 0x27b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12d3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27d2dc0 0x27b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35450/0 (socket says 172.21.15.49:35450) 2024-01-22T05:08:17.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12d3400700 1 -- 172.21.15.49:0/2892438979 learned_addr learned my addr 172.21.15.49:0/2892438979 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:17.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12d2000700 1 --2- 172.21.15.49:0/2892438979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d29e0 0x27b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12d2a00700 1 --2- 172.21.15.49:0/2892438979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x278c610 0x27b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12d3400700 1 -- 172.21.15.49:0/2892438979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d29e0 msgr2=0x27b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:17.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12d3400700 1 --2- 172.21.15.49:0/2892438979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d29e0 0x27b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12d3400700 1 -- 172.21.15.49:0/2892438979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x278c610 msgr2=0x27b8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:17.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12d3400700 1 --2- 172.21.15.49:0/2892438979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x278c610 0x27b8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12d3400700 1 -- 172.21.15.49:0/2892438979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c40092a0 con 0x27d2dc0 2024-01-22T05:08:17.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12d2a00700 1 --2- 172.21.15.49:0/2892438979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x278c610 0x27b8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:17.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12d3400700 1 --2- 172.21.15.49:0/2892438979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27d2dc0 0x27b43e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f12cc015000 tx=0x7f12cc00b040).ready entity=mon.0 client_cookie=e0720e55be519d93 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12bb400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12bb400700 1 -- 172.21.15.49:0/2892438979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc025070 con 0x27d2dc0 2024-01-22T05:08:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12bb400700 1 -- 172.21.15.49:0/2892438979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f12cc021420 con 0x27d2dc0 2024-01-22T05:08:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 1 -- 172.21.15.49:0/2892438979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2707480 con 0x27d2dc0 2024-01-22T05:08:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12bb400700 1 -- 172.21.15.49:0/2892438979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12cc017e90 con 0x27d2dc0 2024-01-22T05:08:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 10 client.5796 fetch_fsmap learned FSMap version 42 2024-01-22T05:08:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 1 -- 172.21.15.49:0/2892438979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x2705c40 con 0x27d2dc0 2024-01-22T05:08:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12bb400700 1 -- 172.21.15.49:0/2892438979 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2707480 con 0x27d2dc0 2024-01-22T05:08:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12bb400700 1 -- 172.21.15.49:0/2892438979 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f12cc028020 con 0x27d2dc0 2024-01-22T05:08:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 10 client.5796 fetch_fsmap finished waiting for FSMap version 42 2024-01-22T05:08:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 10 client.5796 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 20 client.5796 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 1 --2- 172.21.15.49:0/2892438979 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x27bd980 0x278dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 4 client.5796 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12e438f740 1 -- 172.21.15.49:0/2892438979 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x26fd9d0 con 0x27bd980 2024-01-22T05:08:17.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12d2a00700 1 --2- 172.21.15.49:0/2892438979 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x27bd980 0x278dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12bb400700 10 client.5796 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:17.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.868+0000 7f12d2a00700 1 --2- 172.21.15.49:0/2892438979 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x27bd980 0x278dba0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c1b483ba5d9998f2 server_cookie=8fbaf17a359d9a3d in_seq=0 out_seq=0 2024-01-22T05:08:17.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.872+0000 7f12bb400700 1 -- 172.21.15.49:0/2892438979 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x26fd9d0 con 0x27bd980 2024-01-22T05:08:17.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.872+0000 7f12bb400700 10 client.5796 handle_command_reply: tid=0 2024-01-22T05:08:17.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.872+0000 7f12e438f740 1 client.5796 shutdown 2024-01-22T05:08:17.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.872+0000 7f12e438f740 1 -- 172.21.15.49:0/2892438979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27d2dc0 msgr2=0x27b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.872+0000 7f12e438f740 1 --2- 172.21.15.49:0/2892438979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27d2dc0 0x27b43e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f12cc015000 tx=0x7f12cc00b040).stop 2024-01-22T05:08:17.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.872+0000 7f12e438f740 1 -- 172.21.15.49:0/2892438979 shutdown_connections 2024-01-22T05:08:17.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.872+0000 7f12e438f740 1 --2- 172.21.15.49:0/2892438979 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x27bd980 0x278dba0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.872+0000 7f12e438f740 1 --2- 172.21.15.49:0/2892438979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27d2dc0 0x27b43e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.872+0000 7f12e438f740 1 --2- 172.21.15.49:0/2892438979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d29e0 0x27b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.872+0000 7f12bb400700 0 client.5796 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:17.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.872+0000 7f12e438f740 1 --2- 172.21.15.49:0/2892438979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x278c610 0x27b8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.872+0000 7f12e438f740 1 -- 172.21.15.49:0/2892438979 >> 172.21.15.49:0/2892438979 conn(0x256fad0 msgr2=0x27b5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:17.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.872+0000 7f12e438f740 1 -- 172.21.15.49:0/2892438979 shutdown_connections 2024-01-22T05:08:17.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.872+0000 7f12e438f740 1 -- 172.21.15.49:0/2892438979 wait complete. 2024-01-22T05:08:17.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.872+0000 7f12e438f740 20 client.5796 trim_cache size 0 max 16384 2024-01-22T05:08:17.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.888+0000 7f12e438f740 1 Processor -- start 2024-01-22T05:08:17.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.888+0000 7f12e438f740 1 -- start start 2024-01-22T05:08:17.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12e438f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x278c610 0x2790ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12e438f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27d29e0 0x27918d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12e438f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d2dc0 0x278fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12e438f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x27bb6e0 con 0x278c610 2024-01-22T05:08:17.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12e438f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x27361b0 con 0x27d29e0 2024-01-22T05:08:17.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12e438f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x26fd9d0 con 0x27d2dc0 2024-01-22T05:08:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12d2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x278c610 0x2790ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12d2000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27d29e0 0x27918d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12d2000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27d29e0 0x27918d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:47072/0 (socket says 172.21.15.49:47072) 2024-01-22T05:08:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12d2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x278c610 0x2790ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35456/0 (socket says 172.21.15.49:35456) 2024-01-22T05:08:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12d2000700 1 -- 172.21.15.49:0/2315617531 learned_addr learned my addr 172.21.15.49:0/2315617531 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12d3400700 1 --2- 172.21.15.49:0/2315617531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d2dc0 0x278fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12d2000700 1 -- 172.21.15.49:0/2315617531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d2dc0 msgr2=0x278fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12d2000700 1 --2- 172.21.15.49:0/2315617531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d2dc0 0x278fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12d2000700 1 -- 172.21.15.49:0/2315617531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x278c610 msgr2=0x2790ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12d2000700 1 --2- 172.21.15.49:0/2315617531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x278c610 0x2790ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12d2000700 1 -- 172.21.15.49:0/2315617531 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d40bd1b0 con 0x27d29e0 2024-01-22T05:08:17.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12d2000700 1 --2- 172.21.15.49:0/2315617531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27d29e0 0x27918d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f12bc007840 tx=0x7f12bc020040).ready entity=mon.1 client_cookie=8af938bb34147126 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:17.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12c3400700 1 -- 172.21.15.49:0/2315617531 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc04b3f0 con 0x27d29e0 2024-01-22T05:08:17.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12c3400700 1 -- 172.21.15.49:0/2315617531 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc0497c0 con 0x27d29e0 2024-01-22T05:08:17.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12c3400700 1 -- 172.21.15.49:0/2315617531 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0722e0 con 0x27d29e0 2024-01-22T05:08:17.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12e438f740 1 -- 172.21.15.49:0/2315617531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27d29e0 msgr2=0x27918d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12e438f740 1 --2- 172.21.15.49:0/2315617531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27d29e0 0x27918d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f12bc007840 tx=0x7f12bc020040).stop 2024-01-22T05:08:17.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12e438f740 1 -- 172.21.15.49:0/2315617531 shutdown_connections 2024-01-22T05:08:17.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12e438f740 1 --2- 172.21.15.49:0/2315617531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d2dc0 0x278fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12e438f740 1 --2- 172.21.15.49:0/2315617531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27d29e0 0x27918d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12e438f740 1 --2- 172.21.15.49:0/2315617531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x278c610 0x2790ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12e438f740 1 -- 172.21.15.49:0/2315617531 >> 172.21.15.49:0/2315617531 conn(0x256fad0 msgr2=0x27bc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:17.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12e438f740 1 -- 172.21.15.49:0/2315617531 shutdown_connections 2024-01-22T05:08:17.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.892+0000 7f12e438f740 1 -- 172.21.15.49:0/2315617531 wait complete. 2024-01-22T05:08:17.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.896+0000 7f12e438f740 1 -- start start 2024-01-22T05:08:17.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.896+0000 7f12e438f740 1 Processor -- start 2024-01-22T05:08:17.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.896+0000 7f12e438f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x278c610 0x278eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.896+0000 7f12e438f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27d29e0 0x278efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.896+0000 7f12e438f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d2dc0 0x27e71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.896+0000 7f12e438f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x27e6530 con 0x278c610 2024-01-22T05:08:17.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.896+0000 7f12e438f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x278f4a0 con 0x27d29e0 2024-01-22T05:08:17.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.896+0000 7f12e438f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x283a350 con 0x27d2dc0 2024-01-22T05:08:17.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.896+0000 7f12e438f740 10 client.0 ll_register_callbacks cb 0x7f12cc019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:17.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.896+0000 7f12d2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x278c610 0x278eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.896+0000 7f12d2000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27d29e0 0x278efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.896+0000 7f12d3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d2dc0 0x27e71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.896+0000 7f12d2000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27d29e0 0x278efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:47088/0 (socket says 172.21.15.49:47088) 2024-01-22T05:08:17.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.896+0000 7f12d2000700 1 -- 172.21.15.49:0/2219678858 learned_addr learned my addr 172.21.15.49:0/2219678858 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:17.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.896+0000 7f12d2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x278c610 0x278eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35458/0 (socket says 172.21.15.49:35458) 2024-01-22T05:08:17.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12d2000700 1 -- 172.21.15.49:0/2219678858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d2dc0 msgr2=0x27e71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:17.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12d2000700 1 --2- 172.21.15.49:0/2219678858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d2dc0 0x27e71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12d2000700 1 -- 172.21.15.49:0/2219678858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x278c610 msgr2=0x278eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:17.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12d2000700 1 --2- 172.21.15.49:0/2219678858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x278c610 0x278eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12d2000700 1 -- 172.21.15.49:0/2219678858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d414e830 con 0x27d29e0 2024-01-22T05:08:17.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12d2000700 1 --2- 172.21.15.49:0/2219678858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27d29e0 0x278efb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f12bc04b380 tx=0x7f12bc04c000).ready entity=mon.1 client_cookie=46059e5a1da92270 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:17.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12bb400700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-01-22T05:08:17.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12bb400700 1 -- 172.21.15.49:0/2219678858 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc04ad80 con 0x27d29e0 2024-01-22T05:08:17.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12bb400700 1 -- 172.21.15.49:0/2219678858 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f12bc01fe00 con 0x27d29e0 2024-01-22T05:08:17.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12e438f740 1 -- 172.21.15.49:0/2219678858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12cc00f070 con 0x27d29e0 2024-01-22T05:08:17.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12bb400700 1 -- 172.21.15.49:0/2219678858 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12bc047680 con 0x27d29e0 2024-01-22T05:08:17.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12e438f740 10 client.5788 fetch_fsmap learned FSMap version 42 2024-01-22T05:08:17.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12e438f740 1 -- 172.21.15.49:0/2219678858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x2705990 con 0x27d29e0 2024-01-22T05:08:17.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12bb400700 1 -- 172.21.15.49:0/2219678858 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc00f070 con 0x27d29e0 2024-01-22T05:08:17.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12bb400700 1 -- 172.21.15.49:0/2219678858 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f12bc04a5e0 con 0x27d29e0 2024-01-22T05:08:17.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12e438f740 10 client.5788 fetch_fsmap finished waiting for FSMap version 42 2024-01-22T05:08:17.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12e438f740 10 client.5788 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:17.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12e438f740 20 client.5788 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:17.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12e438f740 1 --2- 172.21.15.49:0/2219678858 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x27b6260 0x27e76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:17.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12e438f740 4 client.5788 mds_command: new command op to 5569 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-01-22T05:08:17.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12e438f740 1 -- 172.21.15.49:0/2219678858 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) v1 -- 0x25c6a60 con 0x27b6260 2024-01-22T05:08:17.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12d2a00700 1 --2- 172.21.15.49:0/2219678858 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x27b6260 0x27e76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:17.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12d2a00700 1 --2- 172.21.15.49:0/2219678858 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x27b6260 0x27e76e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5250d8b7aa45e693 server_cookie=3b27fc248f965007 in_seq=0 out_seq=0 2024-01-22T05:08:17.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.900+0000 7f12bb400700 10 client.5788 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:17.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12bb400700 1 -- 172.21.15.49:0/2219678858 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x25c6a60 con 0x27b6260 2024-01-22T05:08:17.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12bb400700 10 client.5788 handle_command_reply: tid=0 2024-01-22T05:08:17.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12e438f740 1 client.5788 shutdown 2024-01-22T05:08:17.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12e438f740 1 -- 172.21.15.49:0/2219678858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27d29e0 msgr2=0x278efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12e438f740 1 --2- 172.21.15.49:0/2219678858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27d29e0 0x278efb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f12bc04b380 tx=0x7f12bc04c000).stop 2024-01-22T05:08:17.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12e438f740 1 -- 172.21.15.49:0/2219678858 shutdown_connections 2024-01-22T05:08:17.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12e438f740 1 --2- 172.21.15.49:0/2219678858 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x27b6260 0x27e76e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12e438f740 1 --2- 172.21.15.49:0/2219678858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27d2dc0 0x27e71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12e438f740 1 --2- 172.21.15.49:0/2219678858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27d29e0 0x278efb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12e438f740 1 --2- 172.21.15.49:0/2219678858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x278c610 0x278eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12e438f740 1 -- 172.21.15.49:0/2219678858 >> 172.21.15.49:0/2219678858 conn(0x256fad0 msgr2=0x27b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:17.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12bb400700 0 client.5788 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:17.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12e438f740 1 -- 172.21.15.49:0/2219678858 shutdown_connections 2024-01-22T05:08:17.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12e438f740 1 -- 172.21.15.49:0/2219678858 wait complete. 2024-01-22T05:08:17.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12e438f740 20 client.5788 trim_cache size 0 max 16384 2024-01-22T05:08:17.908 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:17.908 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:08:17.909 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "2efb8e1e-cdfd-425d-b744-2775c09e95ac", 2024-01-22T05:08:17.909 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:08:17.909 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:17.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12d9e00700 1 -- 172.21.15.49:0/1854903027 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f12ac05a510 msgr2=0x7f12ac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12d9e00700 1 --2- 172.21.15.49:0/1854903027 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f12ac05a510 0x7f12ac05c9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f12c4006d50 tx=0x7f12c4019000).stop 2024-01-22T05:08:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12d9e00700 1 -- 172.21.15.49:0/1854903027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d416cb60 msgr2=0x7f12d414f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.904+0000 7f12d9e00700 1 --2- 172.21.15.49:0/1854903027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d416cb60 0x7f12d414f030 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f12bc007fd0 tx=0x7f12bc001e90).stop 2024-01-22T05:08:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.908+0000 7f12d9e00700 1 -- 172.21.15.49:0/1854903027 shutdown_connections 2024-01-22T05:08:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.908+0000 7f12d9e00700 1 --2- 172.21.15.49:0/1854903027 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f12ac05a510 0x7f12ac05c9d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.908+0000 7f12d9e00700 1 --2- 172.21.15.49:0/1854903027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12d416bf40 0x7f12d416c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.908+0000 7f12d9e00700 1 --2- 172.21.15.49:0/1854903027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12d416cb60 0x7f12d414f030 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.908+0000 7f12d9e00700 1 --2- 172.21.15.49:0/1854903027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b40038e0 0x7f12d414d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.908+0000 7f12d9e00700 1 -- 172.21.15.49:0/1854903027 >> 172.21.15.49:0/1854903027 conn(0x7f12d40c40f0 msgr2=0x7f12d4067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.908+0000 7f12d9e00700 1 -- 172.21.15.49:0/1854903027 shutdown_connections 2024-01-22T05:08:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:17.908+0000 7f12d9e00700 1 -- 172.21.15.49:0/1854903027 wait complete. 2024-01-22T05:08:17.929 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '2efb8e1e-cdfd-425d-b744-2775c09e95ac', 'mode': 'asynchronous'}' 2024-01-22T05:08:17.929 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2024-01-22T05:08:17.929 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-01-22T05:08:17.929 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:18.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.084+0000 7f7f58800700 1 Processor -- start 2024-01-22T05:08:18.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.088+0000 7f7f58800700 1 -- start start 2024-01-22T05:08:18.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f58800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f500bcfa0 0x7f7f50151700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f58800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7f50151bf0 0x7f7f500ab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f58800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f50068a60 con 0x7f7f500abd80 2024-01-22T05:08:18.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f58800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f500bb790 con 0x7f7f50151bf0 2024-01-22T05:08:18.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f58800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f500bd380 con 0x7f7f500bcfa0 2024-01-22T05:08:18.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f55400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7f50151bf0 0x7f7f500ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f56800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7f500abd80 0x7f7f501555c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45928/0 (socket says 172.21.15.49:45928) 2024-01-22T05:08:18.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f56800700 1 -- 172.21.15.49:0/2526561841 learned_addr learned my addr 172.21.15.49:0/2526561841 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:18.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f55e00700 1 --2- 172.21.15.49:0/2526561841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f500bcfa0 0x7f7f50151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f54a00700 1 -- 172.21.15.49:0/2526561841 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720502612 0 0) 0x7f7f50068a60 con 0x7f7f500abd80 2024-01-22T05:08:18.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f54a00700 1 -- 172.21.15.49:0/2526561841 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f300033f0 con 0x7f7f500abd80 2024-01-22T05:08:18.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f55e00700 1 -- 172.21.15.49:0/2526561841 >> v2:172.21.15.49:3300/0 conn(0x7f7f50151bf0 msgr2=0x7f7f500ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:18.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f55e00700 1 --2- 172.21.15.49:0/2526561841 >> v2:172.21.15.49:3300/0 conn(0x7f7f50151bf0 0x7f7f500ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f55e00700 1 -- 172.21.15.49:0/2526561841 >> v1:172.21.15.49:6789/0 conn(0x7f7f500abd80 legacy=0x7f7f501555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f55e00700 1 -- 172.21.15.49:0/2526561841 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f500ac210 con 0x7f7f500bcfa0 2024-01-22T05:08:18.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f55400700 1 --2- 172.21.15.49:0/2526561841 >> v2:172.21.15.49:3300/0 conn(0x7f7f50151bf0 0x7f7f500ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:18.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f55e00700 1 --2- 172.21.15.49:0/2526561841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f500bcfa0 0x7f7f50151700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f7f40009760 tx=0x7f7f40009060).ready entity=mon.2 client_cookie=10109b5d244f1a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:18.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f54a00700 1 -- 172.21.15.49:0/2526561841 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400090d0 con 0x7f7f500bcfa0 2024-01-22T05:08:18.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f54a00700 1 -- 172.21.15.49:0/2526561841 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4000d4a0 con 0x7f7f500bcfa0 2024-01-22T05:08:18.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.092+0000 7f7f54a00700 1 -- 172.21.15.49:0/2526561841 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000d820 con 0x7f7f500bcfa0 2024-01-22T05:08:18.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.096+0000 7f7f58800700 1 -- 172.21.15.49:0/2526561841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f500bcfa0 msgr2=0x7f7f50151700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.096+0000 7f7f58800700 1 --2- 172.21.15.49:0/2526561841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f500bcfa0 0x7f7f50151700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f7f40009760 tx=0x7f7f40009060).stop 2024-01-22T05:08:18.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.096+0000 7f7f58800700 1 -- 172.21.15.49:0/2526561841 shutdown_connections 2024-01-22T05:08:18.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.096+0000 7f7f58800700 1 --2- 172.21.15.49:0/2526561841 >> v2:172.21.15.49:3300/0 conn(0x7f7f50151bf0 0x7f7f500ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.096+0000 7f7f58800700 1 --2- 172.21.15.49:0/2526561841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f500bcfa0 0x7f7f50151700 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.096+0000 7f7f58800700 1 -- 172.21.15.49:0/2526561841 >> 172.21.15.49:0/2526561841 conn(0x7f7f500c6540 msgr2=0x7f7f500c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:18.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.096+0000 7f7f58800700 1 -- 172.21.15.49:0/2526561841 shutdown_connections 2024-01-22T05:08:18.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.096+0000 7f7f58800700 1 -- 172.21.15.49:0/2526561841 wait complete. 2024-01-22T05:08:18.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.096+0000 7f7f58800700 1 Processor -- start 2024-01-22T05:08:18.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f58800700 1 -- start start 2024-01-22T05:08:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f58800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f500abd80 0x7f7f501638e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f58800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f500bcfa0 0x7f7f500c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f58800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f50151bf0 0x7f7f500c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f58800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f500c3e70 con 0x7f7f50151bf0 2024-01-22T05:08:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f58800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f501485c0 con 0x7f7f500bcfa0 2024-01-22T05:08:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f58800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50168540 con 0x7f7f500abd80 2024-01-22T05:08:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f56800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f50151bf0 0x7f7f500c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f56800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f50151bf0 0x7f7f500c3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35488/0 (socket says 172.21.15.49:35488) 2024-01-22T05:08:18.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f56800700 1 -- 172.21.15.49:0/3490185049 learned_addr learned my addr 172.21.15.49:0/3490185049 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:18.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f55e00700 1 --2- 172.21.15.49:0/3490185049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f500abd80 0x7f7f501638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f55400700 1 --2- 172.21.15.49:0/3490185049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f500bcfa0 0x7f7f500c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f56800700 1 -- 172.21.15.49:0/3490185049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f500abd80 msgr2=0x7f7f501638e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f56800700 1 --2- 172.21.15.49:0/3490185049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f500abd80 0x7f7f501638e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f56800700 1 -- 172.21.15.49:0/3490185049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f500bcfa0 msgr2=0x7f7f500c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f56800700 1 --2- 172.21.15.49:0/3490185049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f500bcfa0 0x7f7f500c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f56800700 1 -- 172.21.15.49:0/3490185049 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f380092a0 con 0x7f7f50151bf0 2024-01-22T05:08:18.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f56800700 1 --2- 172.21.15.49:0/3490185049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f50151bf0 0x7f7f500c3980 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f7f48001460 tx=0x7f7f48001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:18.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f4d600700 1 -- 172.21.15.49:0/3490185049 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48005d30 con 0x7f7f50151bf0 2024-01-22T05:08:18.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f4d600700 1 -- 172.21.15.49:0/3490185049 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f48005e90 con 0x7f7f50151bf0 2024-01-22T05:08:18.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f4d600700 1 -- 172.21.15.49:0/3490185049 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48007320 con 0x7f7f50151bf0 2024-01-22T05:08:18.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.100+0000 7f7f58800700 1 -- 172.21.15.49:0/3490185049 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f400092a0 con 0x7f7f50151bf0 2024-01-22T05:08:18.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.104+0000 7f7f58800700 1 -- 172.21.15.49:0/3490185049 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f500a4f10 con 0x7f7f50151bf0 2024-01-22T05:08:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.104+0000 7f7f58800700 1 -- 172.21.15.49:0/3490185049 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f500a59f0 con 0x7f7f50151bf0 2024-01-22T05:08:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.104+0000 7f7f4d600700 1 -- 172.21.15.49:0/3490185049 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7f480076d0 con 0x7f7f50151bf0 2024-01-22T05:08:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.104+0000 7f7f4d600700 1 --2- 172.21.15.49:0/3490185049 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f2805a510 0x7f7f2805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.104+0000 7f7f4d600700 1 -- 172.21.15.49:0/3490185049 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7f48074840 con 0x7f7f50151bf0 2024-01-22T05:08:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.104+0000 7f7f55e00700 1 --2- 172.21.15.49:0/3490185049 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f2805a510 0x7f7f2805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.108+0000 7f7f55e00700 1 --2- 172.21.15.49:0/3490185049 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f2805a510 0x7f7f2805c9d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f7f4000d260 tx=0x7f7f40016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:18.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.112+0000 7f7f4d600700 1 -- 172.21.15.49:0/3490185049 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7f500a59f0 con 0x7f7f50151bf0 2024-01-22T05:08:18.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.312+0000 7f7f58800700 1 -- 172.21.15.49:0/3490185049 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f50047060 con 0x7f7f50151bf0 2024-01-22T05:08:18.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.312+0000 7f7f4d600700 1 -- 172.21.15.49:0/3490185049 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f7f48047e60 con 0x7f7f50151bf0 2024-01-22T05:08:18.317 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:18.317 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:05.000169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:18.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.316+0000 7f7f58800700 1 -- 172.21.15.49:0/3490185049 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f2805a510 msgr2=0x7f7f2805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.316+0000 7f7f58800700 1 --2- 172.21.15.49:0/3490185049 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f2805a510 0x7f7f2805c9d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f7f4000d260 tx=0x7f7f40016000).stop 2024-01-22T05:08:18.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.316+0000 7f7f58800700 1 -- 172.21.15.49:0/3490185049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f50151bf0 msgr2=0x7f7f500c3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.316+0000 7f7f58800700 1 --2- 172.21.15.49:0/3490185049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f50151bf0 0x7f7f500c3980 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f7f48001460 tx=0x7f7f48001650).stop 2024-01-22T05:08:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.316+0000 7f7f58800700 1 -- 172.21.15.49:0/3490185049 shutdown_connections 2024-01-22T05:08:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.316+0000 7f7f58800700 1 --2- 172.21.15.49:0/3490185049 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f2805a510 0x7f7f2805c9d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.316+0000 7f7f58800700 1 --2- 172.21.15.49:0/3490185049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f50151bf0 0x7f7f500c3980 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.316+0000 7f7f58800700 1 --2- 172.21.15.49:0/3490185049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f500bcfa0 0x7f7f500c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.316+0000 7f7f58800700 1 --2- 172.21.15.49:0/3490185049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f500abd80 0x7f7f501638e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.316+0000 7f7f58800700 1 -- 172.21.15.49:0/3490185049 >> 172.21.15.49:0/3490185049 conn(0x7f7f500c6540 msgr2=0x7f7f500bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:18.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.316+0000 7f7f58800700 1 -- 172.21.15.49:0/3490185049 shutdown_connections 2024-01-22T05:08:18.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.316+0000 7f7f58800700 1 -- 172.21.15.49:0/3490185049 wait complete. 2024-01-22T05:08:18.324 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 42 2024-01-22T05:08:18.341 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path / 2024-01-22T05:08:18.501 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:18.501 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:08:18.501 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:18.516 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2024-01-22T05:08:18.517 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-01-22T05:08:18.517 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-01-22T05:08:18.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.676+0000 7f28a5600700 1 Processor -- start 2024-01-22T05:08:18.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.676+0000 7f28a5600700 1 -- start start 2024-01-22T05:08:18.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.680+0000 7f28a5600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28a0063d80 0x7f28a0064160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.680+0000 7f28a5600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28a0154420 0x7f28a0154890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.680+0000 7f28a5600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a0151950 con 0x7f28a00c3310 2024-01-22T05:08:18.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.680+0000 7f28a5600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a00c3f60 con 0x7f28a0063d80 2024-01-22T05:08:18.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.680+0000 7f28a5600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a0151de0 con 0x7f28a0154420 2024-01-22T05:08:18.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.680+0000 7f289fe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28a0063d80 0x7f28a0064160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.680+0000 7f289fe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28a0063d80 0x7f28a0064160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:47104/0 (socket says 172.21.15.49:47104) 2024-01-22T05:08:18.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.680+0000 7f289fe00700 1 -- 172.21.15.49:0/1163874867 learned_addr learned my addr 172.21.15.49:0/1163874867 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:18.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.680+0000 7f289f400700 1 --1- 172.21.15.49:0/1163874867 >> v1:172.21.15.110:6789/0 conn(0x7f28a00c3310 0x7f28a00c37a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:41256/0 (socket says 172.21.15.49:41256) 2024-01-22T05:08:18.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.680+0000 7f28a4c00700 1 --2- 172.21.15.49:0/1163874867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28a0154420 0x7f28a0154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.684+0000 7f289fe00700 1 -- 172.21.15.49:0/1163874867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28a0154420 msgr2=0x7f28a0154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:18.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.684+0000 7f289fe00700 1 --2- 172.21.15.49:0/1163874867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28a0154420 0x7f28a0154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.684+0000 7f289fe00700 1 -- 172.21.15.49:0/1163874867 >> v1:172.21.15.110:6789/0 conn(0x7f28a00c3310 legacy=0x7f28a00c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.684+0000 7f289fe00700 1 -- 172.21.15.49:0/1163874867 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a006a0a0 con 0x7f28a0063d80 2024-01-22T05:08:18.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.684+0000 7f289fe00700 1 --2- 172.21.15.49:0/1163874867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28a0063d80 0x7f28a0064160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f2890006fd0 tx=0x7f28900090f0).ready entity=mon.1 client_cookie=6108ae00fd8e7b11 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:18.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.684+0000 7f289ea00700 1 -- 172.21.15.49:0/1163874867 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289000f6b0 con 0x7f28a0063d80 2024-01-22T05:08:18.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.684+0000 7f289ea00700 1 -- 172.21.15.49:0/1163874867 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289000f810 con 0x7f28a0063d80 2024-01-22T05:08:18.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.684+0000 7f289ea00700 1 -- 172.21.15.49:0/1163874867 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289000fb90 con 0x7f28a0063d80 2024-01-22T05:08:18.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.684+0000 7f28a5600700 1 -- 172.21.15.49:0/1163874867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28a0063d80 msgr2=0x7f28a0064160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.684+0000 7f28a5600700 1 --2- 172.21.15.49:0/1163874867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28a0063d80 0x7f28a0064160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f2890006fd0 tx=0x7f28900090f0).stop 2024-01-22T05:08:18.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.684+0000 7f28a5600700 1 -- 172.21.15.49:0/1163874867 shutdown_connections 2024-01-22T05:08:18.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.684+0000 7f28a5600700 1 --2- 172.21.15.49:0/1163874867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28a0154420 0x7f28a0154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.684+0000 7f28a5600700 1 --2- 172.21.15.49:0/1163874867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28a0063d80 0x7f28a0064160 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.684+0000 7f28a5600700 1 -- 172.21.15.49:0/1163874867 >> 172.21.15.49:0/1163874867 conn(0x7f28a00c40e0 msgr2=0x7f28a00c44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:18.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.688+0000 7f28a5600700 1 -- 172.21.15.49:0/1163874867 shutdown_connections 2024-01-22T05:08:18.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.688+0000 7f28a5600700 1 -- 172.21.15.49:0/1163874867 wait complete. 2024-01-22T05:08:18.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.688+0000 7f28a5600700 1 Processor -- start 2024-01-22T05:08:18.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.688+0000 7f28a5600700 1 -- start start 2024-01-22T05:08:18.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f28a5600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28a0063d80 0x7f28a00acf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f28a5600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28a00c3310 0x7f28a014b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f28a5600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28a0154420 0x7f28a00bd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f28a5600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a014c700 con 0x7f28a0063d80 2024-01-22T05:08:18.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f28a5600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a01643f0 con 0x7f28a00c3310 2024-01-22T05:08:18.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f28a5600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a01646d0 con 0x7f28a0154420 2024-01-22T05:08:18.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f289fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28a0063d80 0x7f28a00acf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f289fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28a0063d80 0x7f28a00acf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35500/0 (socket says 172.21.15.49:35500) 2024-01-22T05:08:18.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f289fe00700 1 -- 172.21.15.49:0/2927075629 learned_addr learned my addr 172.21.15.49:0/2927075629 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:18.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f289f400700 1 --2- 172.21.15.49:0/2927075629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28a00c3310 0x7f28a014b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f28a4c00700 1 --2- 172.21.15.49:0/2927075629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28a0154420 0x7f28a00bd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f289fe00700 1 -- 172.21.15.49:0/2927075629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28a0154420 msgr2=0x7f28a00bd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f289fe00700 1 --2- 172.21.15.49:0/2927075629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28a0154420 0x7f28a00bd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f289fe00700 1 -- 172.21.15.49:0/2927075629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28a00c3310 msgr2=0x7f28a014b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f289fe00700 1 --2- 172.21.15.49:0/2927075629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28a00c3310 0x7f28a014b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f289fe00700 1 -- 172.21.15.49:0/2927075629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2890009370 con 0x7f28a0063d80 2024-01-22T05:08:18.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f289f400700 1 --2- 172.21.15.49:0/2927075629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28a00c3310 0x7f28a014b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:18.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f289fe00700 1 --2- 172.21.15.49:0/2927075629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28a0063d80 0x7f28a00acf40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f2890009130 tx=0x7f2890019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:18.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f2897400700 1 -- 172.21.15.49:0/2927075629 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289001f070 con 0x7f28a0063d80 2024-01-22T05:08:18.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f2897400700 1 -- 172.21.15.49:0/2927075629 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2890000c90 con 0x7f28a0063d80 2024-01-22T05:08:18.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f28a5600700 1 -- 172.21.15.49:0/2927075629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a01649b0 con 0x7f28a0063d80 2024-01-22T05:08:18.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f2897400700 1 -- 172.21.15.49:0/2927075629 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289000fb90 con 0x7f28a0063d80 2024-01-22T05:08:18.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.692+0000 7f28a5600700 1 -- 172.21.15.49:0/2927075629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a00ad430 con 0x7f28a0063d80 2024-01-22T05:08:18.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.696+0000 7f2897400700 1 -- 172.21.15.49:0/2927075629 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2890024940 con 0x7f28a0063d80 2024-01-22T05:08:18.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.696+0000 7f2897400700 1 --2- 172.21.15.49:0/2927075629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f287805a540 0x7f287805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.696+0000 7f2897400700 1 -- 172.21.15.49:0/2927075629 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2890077ec0 con 0x7f28a0063d80 2024-01-22T05:08:18.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.696+0000 7f289f400700 1 --2- 172.21.15.49:0/2927075629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f287805a540 0x7f287805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.700+0000 7f289f400700 1 --2- 172.21.15.49:0/2927075629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f287805a540 0x7f287805ca00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f28a014fc70 tx=0x7f2888007c90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:18.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.700+0000 7f28b1181740 1 Processor -- start 2024-01-22T05:08:18.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.700+0000 7f28b1181740 1 -- start start 2024-01-22T05:08:18.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.700+0000 7f28b1181740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xcd4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.700+0000 7f28b1181740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 0xc8a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.700+0000 7f28b1181740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc8a780 0xcdc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.700+0000 7f28b1181740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xbc92f0 con 0xcd4850 2024-01-22T05:08:18.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.700+0000 7f28b1181740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xbec4f0 con 0xc8a780 2024-01-22T05:08:18.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.700+0000 7f28b1181740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xbb5d60 con 0xc89e10 2024-01-22T05:08:18.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.700+0000 7f289fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xcd4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.700+0000 7f289fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xcd4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35510/0 (socket says 172.21.15.49:35510) 2024-01-22T05:08:18.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.700+0000 7f289fe00700 1 -- 172.21.15.49:0/3072999068 learned_addr learned my addr 172.21.15.49:0/3072999068 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:18.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.700+0000 7f289f400700 1 --2- 172.21.15.49:0/3072999068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 0xc8a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.700+0000 7f28a4c00700 1 --2- 172.21.15.49:0/3072999068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc8a780 0xcdc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f289fe00700 1 -- 172.21.15.49:0/3072999068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 msgr2=0xc8a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:18.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f289fe00700 1 --2- 172.21.15.49:0/3072999068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 0xc8a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f289fe00700 1 -- 172.21.15.49:0/3072999068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc8a780 msgr2=0xcdc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:18.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f289fe00700 1 --2- 172.21.15.49:0/3072999068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc8a780 0xcdc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f289fe00700 1 -- 172.21.15.49:0/3072999068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc1ace0 con 0xcd4850 2024-01-22T05:08:18.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f289fe00700 1 --2- 172.21.15.49:0/3072999068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xcd4c30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f289004ee40 tx=0x7f2890010000).ready entity=mon.0 client_cookie=d974de9ca9b61fee server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:18.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f288f400700 1 -- 172.21.15.49:0/3072999068 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289004b480 con 0xcd4850 2024-01-22T05:08:18.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f288f400700 1 -- 172.21.15.49:0/3072999068 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289004d4e0 con 0xcd4850 2024-01-22T05:08:18.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f288f400700 1 -- 172.21.15.49:0/3072999068 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289004b850 con 0xcd4850 2024-01-22T05:08:18.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f28b1181740 1 -- 172.21.15.49:0/3072999068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 msgr2=0xcd4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f28b1181740 1 --2- 172.21.15.49:0/3072999068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xcd4c30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f289004ee40 tx=0x7f2890010000).stop 2024-01-22T05:08:18.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f28b1181740 1 -- 172.21.15.49:0/3072999068 shutdown_connections 2024-01-22T05:08:18.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f28b1181740 1 --2- 172.21.15.49:0/3072999068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc8a780 0xcdc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f28b1181740 1 --2- 172.21.15.49:0/3072999068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 0xc8a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f28b1181740 1 --2- 172.21.15.49:0/3072999068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xcd4c30 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f28b1181740 1 -- 172.21.15.49:0/3072999068 >> 172.21.15.49:0/3072999068 conn(0xa6e690 msgr2=0xc8e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:18.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f28b1181740 1 -- 172.21.15.49:0/3072999068 shutdown_connections 2024-01-22T05:08:18.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f28b1181740 1 -- 172.21.15.49:0/3072999068 wait complete. 2024-01-22T05:08:18.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.704+0000 7f28b1181740 1 -- start start 2024-01-22T05:08:18.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.708+0000 7f28b1181740 1 Processor -- start 2024-01-22T05:08:18.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.708+0000 7f28b1181740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 0xce7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.708+0000 7f28b1181740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc8a780 0xc8e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.708+0000 7f28b1181740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xc8ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.708+0000 7f28b1181740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xcd35e0 con 0xcd4850 2024-01-22T05:08:18.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.708+0000 7f28b1181740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xc8f100 con 0xc8a780 2024-01-22T05:08:18.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.708+0000 7f28b1181740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xcb8dd0 con 0xc89e10 2024-01-22T05:08:18.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.708+0000 7f28b1181740 10 client.0 ll_register_callbacks cb 0xc47970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.708+0000 7f28a4c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xc8ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.708+0000 7f289fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 0xce7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.708+0000 7f28a4c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xc8ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35526/0 (socket says 172.21.15.49:35526) 2024-01-22T05:08:18.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.708+0000 7f289f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc8a780 0xc8e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.708+0000 7f28a4c00700 1 -- 172.21.15.49:0/1747864772 learned_addr learned my addr 172.21.15.49:0/1747864772 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:18.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f289fe00700 1 -- 172.21.15.49:0/1747864772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc8a780 msgr2=0xc8e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:18.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f289fe00700 1 --2- 172.21.15.49:0/1747864772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc8a780 0xc8e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f289fe00700 1 -- 172.21.15.49:0/1747864772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 msgr2=0xc8ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:18.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f289fe00700 1 --2- 172.21.15.49:0/1747864772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xc8ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f289fe00700 1 -- 172.21.15.49:0/1747864772 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a00ad430 con 0xc89e10 2024-01-22T05:08:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f289fe00700 1 --2- 172.21.15.49:0/1747864772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 0xce7450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f2890031000 tx=0x7f2890032000).ready entity=mon.2 client_cookie=484d186ad9c8df0b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f2887e00700 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2024-01-22T05:08:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f2887e00700 1 -- 172.21.15.49:0/1747864772 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890024e00 con 0xc89e10 2024-01-22T05:08:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f2887e00700 1 -- 172.21.15.49:0/1747864772 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2890038e20 con 0xc89e10 2024-01-22T05:08:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f28b1181740 1 -- 172.21.15.49:0/1747864772 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xc06240 con 0xc89e10 2024-01-22T05:08:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f2887e00700 1 -- 172.21.15.49:0/1747864772 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f289004e840 con 0xc89e10 2024-01-22T05:08:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f28b1181740 10 client.5324 fetch_fsmap learned FSMap version 43 2024-01-22T05:08:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f28b1181740 1 -- 172.21.15.49:0/1747864772 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0xc097d0 con 0xc89e10 2024-01-22T05:08:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f2887e00700 1 -- 172.21.15.49:0/1747864772 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xc06240 con 0xc89e10 2024-01-22T05:08:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f2887e00700 1 -- 172.21.15.49:0/1747864772 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2890035040 con 0xc89e10 2024-01-22T05:08:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f28b1181740 10 client.5324 fetch_fsmap finished waiting for FSMap version 43 2024-01-22T05:08:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f28b1181740 10 client.5324 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f28b1181740 20 client.5324 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f28b1181740 1 --2- 172.21.15.49:0/1747864772 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xcb7f80 0xcb8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f28b1181740 4 client.5324 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f28b1181740 1 -- 172.21.15.49:0/1747864772 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xbfc790 con 0xcb7f80 2024-01-22T05:08:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f289f400700 1 --2- 172.21.15.49:0/1747864772 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xcb7f80 0xcb8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f2887e00700 10 client.5324 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:18.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.712+0000 7f289f400700 1 --2- 172.21.15.49:0/1747864772 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xcb7f80 0xcb8390 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=65940f91a0c5a4ff server_cookie=fdcf4deaf2cf9d69 in_seq=0 out_seq=0 2024-01-22T05:08:18.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.716+0000 7f2887e00700 1 -- 172.21.15.49:0/1747864772 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xbfc790 con 0xcb7f80 2024-01-22T05:08:18.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.716+0000 7f2887e00700 10 client.5324 handle_command_reply: tid=0 2024-01-22T05:08:18.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.716+0000 7f28b1181740 1 client.5324 shutdown 2024-01-22T05:08:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.716+0000 7f28b1181740 1 -- 172.21.15.49:0/1747864772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 msgr2=0xce7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.716+0000 7f28b1181740 1 --2- 172.21.15.49:0/1747864772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 0xce7450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f2890031000 tx=0x7f2890032000).stop 2024-01-22T05:08:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.716+0000 7f28b1181740 1 -- 172.21.15.49:0/1747864772 shutdown_connections 2024-01-22T05:08:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.716+0000 7f28b1181740 1 --2- 172.21.15.49:0/1747864772 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xcb7f80 0xcb8390 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.716+0000 7f28b1181740 1 --2- 172.21.15.49:0/1747864772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xc8ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.716+0000 7f28b1181740 1 --2- 172.21.15.49:0/1747864772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc8a780 0xc8e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.716+0000 7f28b1181740 1 --2- 172.21.15.49:0/1747864772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 0xce7450 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.716+0000 7f28b1181740 1 -- 172.21.15.49:0/1747864772 >> 172.21.15.49:0/1747864772 conn(0xa6e690 msgr2=0xcb5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.716+0000 7f2887e00700 0 client.5324 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.716+0000 7f28b1181740 1 -- 172.21.15.49:0/1747864772 shutdown_connections 2024-01-22T05:08:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.716+0000 7f28b1181740 1 -- 172.21.15.49:0/1747864772 wait complete. 2024-01-22T05:08:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.716+0000 7f28b1181740 20 client.5324 trim_cache size 0 max 16384 2024-01-22T05:08:18.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.736+0000 7f28b1181740 1 Processor -- start 2024-01-22T05:08:18.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.736+0000 7f28b1181740 1 -- start start 2024-01-22T05:08:18.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.736+0000 7f28b1181740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc89e10 0xcbbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.736+0000 7f28b1181740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc8a780 0xcbc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.736+0000 7f28b1181740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xc8ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.736+0000 7f28b1181740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xc53500 con 0xcd4850 2024-01-22T05:08:18.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.736+0000 7f28b1181740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xce6780 con 0xc89e10 2024-01-22T05:08:18.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.736+0000 7f28b1181740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xcd6130 con 0xc8a780 2024-01-22T05:08:18.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.736+0000 7f28a4c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xc8ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.736+0000 7f289fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc89e10 0xcbbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.736+0000 7f289f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc8a780 0xcbc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.736+0000 7f289fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc89e10 0xcbbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:47158/0 (socket says 172.21.15.49:47158) 2024-01-22T05:08:18.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.736+0000 7f28a4c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xc8ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35538/0 (socket says 172.21.15.49:35538) 2024-01-22T05:08:18.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f289fe00700 1 -- 172.21.15.49:0/189088984 learned_addr learned my addr 172.21.15.49:0/189088984 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:18.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f289fe00700 1 -- 172.21.15.49:0/189088984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc8a780 msgr2=0xcbc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f289fe00700 1 --2- 172.21.15.49:0/189088984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc8a780 0xcbc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f289fe00700 1 -- 172.21.15.49:0/189088984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 msgr2=0xc8ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f289fe00700 1 --2- 172.21.15.49:0/189088984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xc8ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f289fe00700 1 -- 172.21.15.49:0/189088984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a00be000 con 0xc89e10 2024-01-22T05:08:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f289fe00700 1 --2- 172.21.15.49:0/189088984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc89e10 0xcbbf50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f2890009fd0 tx=0x7f2890036000).ready entity=mon.1 client_cookie=6f7db81f8f911236 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f288fe00700 1 -- 172.21.15.49:0/189088984 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289000e1d0 con 0xc89e10 2024-01-22T05:08:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f288fe00700 1 -- 172.21.15.49:0/189088984 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289004eaa0 con 0xc89e10 2024-01-22T05:08:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f288fe00700 1 -- 172.21.15.49:0/189088984 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890024e00 con 0xc89e10 2024-01-22T05:08:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f28b1181740 1 -- 172.21.15.49:0/189088984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc89e10 msgr2=0xcbbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f28b1181740 1 --2- 172.21.15.49:0/189088984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc89e10 0xcbbf50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f2890009fd0 tx=0x7f2890036000).stop 2024-01-22T05:08:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f28b1181740 1 -- 172.21.15.49:0/189088984 shutdown_connections 2024-01-22T05:08:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f28b1181740 1 --2- 172.21.15.49:0/189088984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xcd4850 0xc8ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f28b1181740 1 --2- 172.21.15.49:0/189088984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc8a780 0xcbc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f28b1181740 1 --2- 172.21.15.49:0/189088984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xc89e10 0xcbbf50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f28b1181740 1 -- 172.21.15.49:0/189088984 >> 172.21.15.49:0/189088984 conn(0xa6e690 msgr2=0xc8e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f28b1181740 1 -- 172.21.15.49:0/189088984 shutdown_connections 2024-01-22T05:08:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.740+0000 7f28b1181740 1 -- 172.21.15.49:0/189088984 wait complete. 2024-01-22T05:08:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.744+0000 7f28b1181740 1 -- start start 2024-01-22T05:08:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.744+0000 7f28b1181740 1 Processor -- start 2024-01-22T05:08:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.744+0000 7f28b1181740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 0xcd1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.744+0000 7f28b1181740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xc8a780 0xc8ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.744+0000 7f28b1181740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xcd4850 0xc8b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.744+0000 7f28b1181740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xc8b800 con 0xc8a780 2024-01-22T05:08:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.744+0000 7f28b1181740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xc8eec0 con 0xcd4850 2024-01-22T05:08:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.744+0000 7f28b1181740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xd3d550 con 0xc89e10 2024-01-22T05:08:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.744+0000 7f28b1181740 10 client.0 ll_register_callbacks cb 0x7f289004ed30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:18.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f289f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xc8a780 0xc8ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f289f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xc8a780 0xc8ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35548/0 (socket says 172.21.15.49:35548) 2024-01-22T05:08:18.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f289f400700 1 -- 172.21.15.49:0/215557908 learned_addr learned my addr 172.21.15.49:0/215557908 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:18.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f289fe00700 1 --2- 172.21.15.49:0/215557908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 0xcd1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f28a4c00700 1 --2- 172.21.15.49:0/215557908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xcd4850 0xc8b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f289f400700 1 -- 172.21.15.49:0/215557908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 msgr2=0xcd1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:18.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f289f400700 1 --2- 172.21.15.49:0/215557908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 0xcd1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f289f400700 1 -- 172.21.15.49:0/215557908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xcd4850 msgr2=0xc8b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:18.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f289f400700 1 --2- 172.21.15.49:0/215557908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xcd4850 0xc8b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f289f400700 1 -- 172.21.15.49:0/215557908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xc097d0 con 0xc8a780 2024-01-22T05:08:18.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f289fe00700 1 --2- 172.21.15.49:0/215557908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 0xcd1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:18.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f289f400700 1 --2- 172.21.15.49:0/215557908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xc8a780 0xc8ae20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f28a0163e50 tx=0x7f288801a040).ready entity=mon.0 client_cookie=ad5bc61812ea573 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:18.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f2887e00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:18.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f2887e00700 1 -- 172.21.15.49:0/215557908 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288801d070 con 0xc8a780 2024-01-22T05:08:18.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f28b1181740 1 -- 172.21.15.49:0/215557908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f289004d4e0 con 0xc8a780 2024-01-22T05:08:18.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f2887e00700 1 -- 172.21.15.49:0/215557908 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2888017610 con 0xc8a780 2024-01-22T05:08:18.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f2887e00700 1 -- 172.21.15.49:0/215557908 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2888029070 con 0xc8a780 2024-01-22T05:08:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f28b1181740 10 client.5826 fetch_fsmap learned FSMap version 43 2024-01-22T05:08:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f28b1181740 1 -- 172.21.15.49:0/215557908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0xc04a00 con 0xc8a780 2024-01-22T05:08:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f2887e00700 1 -- 172.21.15.49:0/215557908 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289004d4e0 con 0xc8a780 2024-01-22T05:08:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f2887e00700 1 -- 172.21.15.49:0/215557908 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f28880179e0 con 0xc8a780 2024-01-22T05:08:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f28b1181740 10 client.5826 fetch_fsmap finished waiting for FSMap version 43 2024-01-22T05:08:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f28b1181740 10 client.5826 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f28b1181740 20 client.5826 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f28b1181740 1 --2- 172.21.15.49:0/215557908 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xcd1fe0 0xd3c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f28b1181740 4 client.5826 mds_command: new command op to 5569 tid=0[{"prefix": "scrub start", "path": "/"}] 2024-01-22T05:08:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f28b1181740 1 -- 172.21.15.49:0/215557908 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) v1 -- 0xac5620 con 0xcd1fe0 2024-01-22T05:08:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.748+0000 7f289fe00700 1 --2- 172.21.15.49:0/215557908 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xcd1fe0 0xd3c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f289fe00700 1 --2- 172.21.15.49:0/215557908 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xcd1fe0 0xd3c500 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2baea83c00940573 server_cookie=e83db63eb61c69ec in_seq=0 out_seq=0 2024-01-22T05:08:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f2887e00700 10 client.5826 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f2887e00700 1 -- 172.21.15.49:0/215557908 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0xac5620 con 0xcd1fe0 2024-01-22T05:08:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f2887e00700 10 client.5826 handle_command_reply: tid=0 2024-01-22T05:08:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f28b1181740 1 client.5826 shutdown 2024-01-22T05:08:18.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f28b1181740 1 -- 172.21.15.49:0/215557908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xc8a780 msgr2=0xc8ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f28b1181740 1 --2- 172.21.15.49:0/215557908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xc8a780 0xc8ae20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f28a0163e50 tx=0x7f288801a040).stop 2024-01-22T05:08:18.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f28b1181740 1 -- 172.21.15.49:0/215557908 shutdown_connections 2024-01-22T05:08:18.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f28b1181740 1 --2- 172.21.15.49:0/215557908 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xcd1fe0 0xd3c500 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f28b1181740 1 --2- 172.21.15.49:0/215557908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xcd4850 0xc8b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f28b1181740 1 --2- 172.21.15.49:0/215557908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xc8a780 0xc8ae20 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f28b1181740 1 --2- 172.21.15.49:0/215557908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xc89e10 0xcd1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f2887e00700 0 client.5826 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f28b1181740 1 -- 172.21.15.49:0/215557908 >> 172.21.15.49:0/215557908 conn(0xa6e690 msgr2=0xc8e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f28b1181740 1 -- 172.21.15.49:0/215557908 shutdown_connections 2024-01-22T05:08:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f28b1181740 1 -- 172.21.15.49:0/215557908 wait complete. 2024-01-22T05:08:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.752+0000 7f28b1181740 20 client.5826 trim_cache size 0 max 16384 2024-01-22T05:08:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:18.757 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:08:18.757 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "d59cc613-856c-42e8-83cf-d5d0485c945e", 2024-01-22T05:08:18.757 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:08:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:18.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.756+0000 7f28a5600700 1 -- 172.21.15.49:0/2927075629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f287805a540 msgr2=0x7f287805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.756+0000 7f28a5600700 1 --2- 172.21.15.49:0/2927075629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f287805a540 0x7f287805ca00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f28a014fc70 tx=0x7f2888007c90).stop 2024-01-22T05:08:18.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.756+0000 7f28a5600700 1 -- 172.21.15.49:0/2927075629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28a0063d80 msgr2=0x7f28a00acf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:18.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.756+0000 7f28a5600700 1 --2- 172.21.15.49:0/2927075629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28a0063d80 0x7f28a00acf40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f2890009130 tx=0x7f2890019000).stop 2024-01-22T05:08:18.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.756+0000 7f28a5600700 1 -- 172.21.15.49:0/2927075629 shutdown_connections 2024-01-22T05:08:18.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.756+0000 7f28a5600700 1 --2- 172.21.15.49:0/2927075629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f287805a540 0x7f287805ca00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.756+0000 7f28a5600700 1 --2- 172.21.15.49:0/2927075629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28a0154420 0x7f28a00bd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.756+0000 7f28a5600700 1 --2- 172.21.15.49:0/2927075629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28a00c3310 0x7f28a014b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.756+0000 7f28a5600700 1 --2- 172.21.15.49:0/2927075629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28a0063d80 0x7f28a00acf40 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:18.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.756+0000 7f28a5600700 1 -- 172.21.15.49:0/2927075629 >> 172.21.15.49:0/2927075629 conn(0x7f28a00c40e0 msgr2=0x7f28a014ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:18.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.756+0000 7f28a5600700 1 -- 172.21.15.49:0/2927075629 shutdown_connections 2024-01-22T05:08:18.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.756+0000 7f28a5600700 1 -- 172.21.15.49:0/2927075629 wait complete. 2024-01-22T05:08:18.779 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'd59cc613-856c-42e8-83cf-d5d0485c945e', 'mode': 'asynchronous'}' 2024-01-22T05:08:18.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:08:18.780 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2024-01-22T05:08:18.799 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2024-01-22T05:08:18.799 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:19.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:18.996+0000 7f6400800700 1 Processor -- start 2024-01-22T05:08:19.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f6400800700 1 -- start start 2024-01-22T05:08:19.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f6400800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63f80bc590 0x7f63f80bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:19.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f6400800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f63f80bcee0 0x7f63f815a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:19.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f6400800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f8069a90 con 0x7f63f80c5530 2024-01-22T05:08:19.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f6400800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f8150d70 con 0x7f63f80bcee0 2024-01-22T05:08:19.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f6400800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f8068ba0 con 0x7f63f80bc590 2024-01-22T05:08:19.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f63fde00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f63f80c5530 0x7f63f8069f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45930/0 (socket says 172.21.15.49:45930) 2024-01-22T05:08:19.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f63fde00700 1 -- 172.21.15.49:0/1751701781 learned_addr learned my addr 172.21.15.49:0/1751701781 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:19.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f63fd400700 1 --2- 172.21.15.49:0/1751701781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63f80bc590 0x7f63f80bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:19.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f63fe800700 1 --2- 172.21.15.49:0/1751701781 >> v2:172.21.15.110:3300/0 conn(0x7f63f80bcee0 0x7f63f815a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:19.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f63fca00700 1 -- 172.21.15.49:0/1751701781 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2981948901 0 0) 0x7f63f8069a90 con 0x7f63f80c5530 2024-01-22T05:08:19.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f63fca00700 1 -- 172.21.15.49:0/1751701781 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63d80033f0 con 0x7f63f80c5530 2024-01-22T05:08:19.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f63fd400700 1 -- 172.21.15.49:0/1751701781 >> v2:172.21.15.110:3300/0 conn(0x7f63f80bcee0 msgr2=0x7f63f815a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:19.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f63fd400700 1 --2- 172.21.15.49:0/1751701781 >> v2:172.21.15.110:3300/0 conn(0x7f63f80bcee0 0x7f63f815a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f63fd400700 1 -- 172.21.15.49:0/1751701781 >> v1:172.21.15.49:6789/0 conn(0x7f63f80c5530 legacy=0x7f63f8069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:19.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.000+0000 7f63fd400700 1 -- 172.21.15.49:0/1751701781 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8068e80 con 0x7f63f80bc590 2024-01-22T05:08:19.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.004+0000 7f63fd400700 1 --2- 172.21.15.49:0/1751701781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63f80bc590 0x7f63f80bc9f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f63e0009760 tx=0x7f63e0009060).ready entity=mon.2 client_cookie=eb3efd813bf20dba server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:19.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.004+0000 7f63fca00700 1 -- 172.21.15.49:0/1751701781 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000d4a0 con 0x7f63f80bc590 2024-01-22T05:08:19.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.004+0000 7f63fca00700 1 -- 172.21.15.49:0/1751701781 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e000d600 con 0x7f63f80bc590 2024-01-22T05:08:19.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.004+0000 7f63fca00700 1 -- 172.21.15.49:0/1751701781 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000d980 con 0x7f63f80bc590 2024-01-22T05:08:19.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.004+0000 7f6400800700 1 -- 172.21.15.49:0/1751701781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63f80bc590 msgr2=0x7f63f80bc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:19.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.004+0000 7f6400800700 1 --2- 172.21.15.49:0/1751701781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63f80bc590 0x7f63f80bc9f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f63e0009760 tx=0x7f63e0009060).stop 2024-01-22T05:08:19.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.004+0000 7f6400800700 1 -- 172.21.15.49:0/1751701781 shutdown_connections 2024-01-22T05:08:19.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.004+0000 7f6400800700 1 --2- 172.21.15.49:0/1751701781 >> v2:172.21.15.110:3300/0 conn(0x7f63f80bcee0 0x7f63f815a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.004+0000 7f6400800700 1 --2- 172.21.15.49:0/1751701781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63f80bc590 0x7f63f80bc9f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.004+0000 7f6400800700 1 -- 172.21.15.49:0/1751701781 >> 172.21.15.49:0/1751701781 conn(0x7f63f80aa6b0 msgr2=0x7f63f80aaac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:19.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.004+0000 7f6400800700 1 -- 172.21.15.49:0/1751701781 shutdown_connections 2024-01-22T05:08:19.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.004+0000 7f6400800700 1 -- 172.21.15.49:0/1751701781 wait complete. 2024-01-22T05:08:19.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.008+0000 7f6400800700 1 Processor -- start 2024-01-22T05:08:19.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.008+0000 7f6400800700 1 -- start start 2024-01-22T05:08:19.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f6400800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63f80bc590 0x7f63f815f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:19.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f6400800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63f80bcee0 0x7f63f81620a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:19.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f6400800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63f80c5530 0x7f63f8162590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:19.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f6400800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f8142b60 con 0x7f63f80c5530 2024-01-22T05:08:19.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f6400800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f81632b0 con 0x7f63f80bcee0 2024-01-22T05:08:19.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f6400800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f8163870 con 0x7f63f80bc590 2024-01-22T05:08:19.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f63fe800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63f80c5530 0x7f63f8162590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:19.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f63fe800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63f80c5530 0x7f63f8162590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35554/0 (socket says 172.21.15.49:35554) 2024-01-22T05:08:19.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f63fe800700 1 -- 172.21.15.49:0/2814191408 learned_addr learned my addr 172.21.15.49:0/2814191408 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:19.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f63fde00700 1 --2- 172.21.15.49:0/2814191408 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63f80bc590 0x7f63f815f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:19.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f63fd400700 1 --2- 172.21.15.49:0/2814191408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63f80bcee0 0x7f63f81620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:19.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f63fe800700 1 -- 172.21.15.49:0/2814191408 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63f80bc590 msgr2=0x7f63f815f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:19.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f63fe800700 1 --2- 172.21.15.49:0/2814191408 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63f80bc590 0x7f63f815f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f63fe800700 1 -- 172.21.15.49:0/2814191408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63f80bcee0 msgr2=0x7f63f81620a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:19.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f63fe800700 1 --2- 172.21.15.49:0/2814191408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63f80bcee0 0x7f63f81620a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f63fe800700 1 -- 172.21.15.49:0/2814191408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e00092a0 con 0x7f63f80c5530 2024-01-22T05:08:19.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f63fe800700 1 --2- 172.21.15.49:0/2814191408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63f80c5530 0x7f63f8162590 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f63f0009e90 tx=0x7f63f000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:19.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f63f5600700 1 -- 172.21.15.49:0/2814191408 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f000caa0 con 0x7f63f80c5530 2024-01-22T05:08:19.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f63f5600700 1 -- 172.21.15.49:0/2814191408 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f000f040 con 0x7f63f80c5530 2024-01-22T05:08:19.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f63f5600700 1 -- 172.21.15.49:0/2814191408 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f000ce10 con 0x7f63f80c5530 2024-01-22T05:08:19.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f6400800700 1 -- 172.21.15.49:0/2814191408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f8162bf0 con 0x7f63f80c5530 2024-01-22T05:08:19.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.012+0000 7f6400800700 1 -- 172.21.15.49:0/2814191408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f8163500 con 0x7f63f80c5530 2024-01-22T05:08:19.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.016+0000 7f6400800700 1 -- 172.21.15.49:0/2814191408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f81639e0 con 0x7f63f80c5530 2024-01-22T05:08:19.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.016+0000 7f63f5600700 1 -- 172.21.15.49:0/2814191408 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f63f0013610 con 0x7f63f80c5530 2024-01-22T05:08:19.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.016+0000 7f63f5600700 1 --2- 172.21.15.49:0/2814191408 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f63d005a510 0x7f63d005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:19.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.016+0000 7f63f5600700 1 -- 172.21.15.49:0/2814191408 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f63f0075190 con 0x7f63f80c5530 2024-01-22T05:08:19.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.016+0000 7f63fde00700 1 --2- 172.21.15.49:0/2814191408 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f63d005a510 0x7f63d005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.020+0000 7f63fde00700 1 --2- 172.21.15.49:0/2814191408 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f63d005a510 0x7f63d005c9d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f63e8005750 tx=0x7f63e8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:19.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.024+0000 7f63f5600700 1 -- 172.21.15.49:0/2814191408 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f63f0048810 con 0x7f63f80c5530 2024-01-22T05:08:19.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.224+0000 7f6400800700 1 -- 172.21.15.49:0/2814191408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63f8046800 con 0x7f63f80c5530 2024-01-22T05:08:19.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.224+0000 7f63f5600700 1 -- 172.21.15.49:0/2814191408 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f63f004be30 con 0x7f63f80c5530 2024-01-22T05:08:19.227 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:19.227 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":43,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:18.344316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:19.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.228+0000 7f6400800700 1 -- 172.21.15.49:0/2814191408 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f63d005a510 msgr2=0x7f63d005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:19.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.228+0000 7f6400800700 1 --2- 172.21.15.49:0/2814191408 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f63d005a510 0x7f63d005c9d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f63e8005750 tx=0x7f63e8009040).stop 2024-01-22T05:08:19.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.228+0000 7f6400800700 1 -- 172.21.15.49:0/2814191408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63f80c5530 msgr2=0x7f63f8162590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:19.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.228+0000 7f6400800700 1 --2- 172.21.15.49:0/2814191408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63f80c5530 0x7f63f8162590 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f63f0009e90 tx=0x7f63f000b040).stop 2024-01-22T05:08:19.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.228+0000 7f6400800700 1 -- 172.21.15.49:0/2814191408 shutdown_connections 2024-01-22T05:08:19.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.228+0000 7f6400800700 1 --2- 172.21.15.49:0/2814191408 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f63d005a510 0x7f63d005c9d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.228+0000 7f6400800700 1 --2- 172.21.15.49:0/2814191408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63f80c5530 0x7f63f8162590 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.228+0000 7f6400800700 1 --2- 172.21.15.49:0/2814191408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63f80bcee0 0x7f63f81620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.228+0000 7f6400800700 1 --2- 172.21.15.49:0/2814191408 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63f80bc590 0x7f63f815f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.228+0000 7f6400800700 1 -- 172.21.15.49:0/2814191408 >> 172.21.15.49:0/2814191408 conn(0x7f63f80aa6b0 msgr2=0x7f63f8063fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:19.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.228+0000 7f6400800700 1 -- 172.21.15.49:0/2814191408 shutdown_connections 2024-01-22T05:08:19.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.228+0000 7f6400800700 1 -- 172.21.15.49:0/2814191408 wait complete. 2024-01-22T05:08:19.236 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 43 2024-01-22T05:08:19.256 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2024-01-22T05:08:19.413 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:19.414 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:08:19.414 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:19.430 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' got response code '0' and stdout '{ "return_code": 0 } ' 2024-01-22T05:08:19.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:08:19.431 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2024-01-22T05:08:19.485 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:08:19.485 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:08:19.486 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0360107 s, 29.1 MB/s 2024-01-22T05:08:19.487 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2024-01-22T05:08:19.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:19.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.644+0000 7f3073600700 1 Processor -- start 2024-01-22T05:08:19.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.644+0000 7f3073600700 1 -- start start 2024-01-22T05:08:19.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3073600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f306c065240 0x7f306c0644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:19.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3073600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f306c0649e0 0x7f306c15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3073600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c0c2700 con 0x7f306c065620 2024-01-22T05:08:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3073600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c0c29a0 con 0x7f306c065240 2024-01-22T05:08:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3073600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c0c2c80 con 0x7f306c0649e0 2024-01-22T05:08:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3070c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f306c065240 0x7f306c0644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3070c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f306c065240 0x7f306c0644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35556/0 (socket says 172.21.15.49:35556) 2024-01-22T05:08:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3070c00700 1 -- 172.21.15.49:0/3549189637 learned_addr learned my addr 172.21.15.49:0/3549189637 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3072000700 1 --2- 172.21.15.49:0/3549189637 >> v2:172.21.15.110:3300/0 conn(0x7f306c0649e0 0x7f306c15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3070c00700 1 -- 172.21.15.49:0/3549189637 >> v2:172.21.15.110:3300/0 conn(0x7f306c0649e0 msgr2=0x7f306c15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3070c00700 1 --2- 172.21.15.49:0/3549189637 >> v2:172.21.15.110:3300/0 conn(0x7f306c0649e0 0x7f306c15c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3070c00700 1 -- 172.21.15.49:0/3549189637 >> v1:172.21.15.110:6789/0 conn(0x7f306c065620 legacy=0x7f306c15b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3070c00700 1 -- 172.21.15.49:0/3549189637 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c0c2f60 con 0x7f306c065240 2024-01-22T05:08:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3070c00700 1 --2- 172.21.15.49:0/3549189637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306c065240 0x7f306c0644f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f306c0665c0 tx=0x7f305c0090f0).ready entity=mon.0 client_cookie=b097062853d14389 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f306b400700 1 -- 172.21.15.49:0/3549189637 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00b600 con 0x7f306c065240 2024-01-22T05:08:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f306b400700 1 -- 172.21.15.49:0/3549189637 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c00b760 con 0x7f306c065240 2024-01-22T05:08:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f306b400700 1 -- 172.21.15.49:0/3549189637 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00bae0 con 0x7f306c065240 2024-01-22T05:08:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3073600700 1 -- 172.21.15.49:0/3549189637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306c065240 msgr2=0x7f306c0644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.648+0000 7f3073600700 1 --2- 172.21.15.49:0/3549189637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306c065240 0x7f306c0644f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f306c0665c0 tx=0x7f305c0090f0).stop 2024-01-22T05:08:19.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.652+0000 7f3073600700 1 -- 172.21.15.49:0/3549189637 shutdown_connections 2024-01-22T05:08:19.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.652+0000 7f3073600700 1 --2- 172.21.15.49:0/3549189637 >> v2:172.21.15.110:3300/0 conn(0x7f306c0649e0 0x7f306c15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.652+0000 7f3073600700 1 --2- 172.21.15.49:0/3549189637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306c065240 0x7f306c0644f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.652+0000 7f3073600700 1 -- 172.21.15.49:0/3549189637 >> 172.21.15.49:0/3549189637 conn(0x7f306c0c87f0 msgr2=0x7f306c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:19.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.652+0000 7f3073600700 1 -- 172.21.15.49:0/3549189637 shutdown_connections 2024-01-22T05:08:19.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.652+0000 7f3073600700 1 -- 172.21.15.49:0/3549189637 wait complete. 2024-01-22T05:08:19.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.652+0000 7f3073600700 1 Processor -- start 2024-01-22T05:08:19.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.652+0000 7f3073600700 1 -- start start 2024-01-22T05:08:19.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3073600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306c0649e0 0x7f306c169330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:19.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3073600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f306c065240 0x7f306c0aa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:19.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3073600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f306c065620 0x7f306c145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:19.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3073600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c169820 con 0x7f306c0649e0 2024-01-22T05:08:19.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3073600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0a7e90 con 0x7f306c065240 2024-01-22T05:08:19.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3073600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0bff90 con 0x7f306c065620 2024-01-22T05:08:19.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3070c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306c0649e0 0x7f306c169330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:19.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3070c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306c0649e0 0x7f306c169330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35562/0 (socket says 172.21.15.49:35562) 2024-01-22T05:08:19.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3070c00700 1 -- 172.21.15.49:0/1948671262 learned_addr learned my addr 172.21.15.49:0/1948671262 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:19.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f306be00700 1 --2- 172.21.15.49:0/1948671262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f306c065240 0x7f306c0aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:19.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3072000700 1 --2- 172.21.15.49:0/1948671262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f306c065620 0x7f306c145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:19.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3070c00700 1 -- 172.21.15.49:0/1948671262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f306c065620 msgr2=0x7f306c145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:19.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3070c00700 1 --2- 172.21.15.49:0/1948671262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f306c065620 0x7f306c145de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3070c00700 1 -- 172.21.15.49:0/1948671262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f306c065240 msgr2=0x7f306c0aa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:19.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3070c00700 1 --2- 172.21.15.49:0/1948671262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f306c065240 0x7f306c0aa170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3070c00700 1 -- 172.21.15.49:0/1948671262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c009370 con 0x7f306c0649e0 2024-01-22T05:08:19.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f306be00700 1 --2- 172.21.15.49:0/1948671262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f306c065240 0x7f306c0aa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:19.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3070c00700 1 --2- 172.21.15.49:0/1948671262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306c0649e0 0x7f306c169330 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f305c009130 tx=0x7f305c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:19.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3063e00700 1 -- 172.21.15.49:0/1948671262 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00b8d0 con 0x7f306c0649e0 2024-01-22T05:08:19.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3063e00700 1 -- 172.21.15.49:0/1948671262 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c00ba30 con 0x7f306c0649e0 2024-01-22T05:08:19.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3073600700 1 -- 172.21.15.49:0/1948671262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306c0a78d0 con 0x7f306c0649e0 2024-01-22T05:08:19.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.656+0000 7f3063e00700 1 -- 172.21.15.49:0/1948671262 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c01c670 con 0x7f306c0649e0 2024-01-22T05:08:19.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.660+0000 7f3073600700 1 -- 172.21.15.49:0/1948671262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c0aa660 con 0x7f306c0649e0 2024-01-22T05:08:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.660+0000 7f3073600700 1 -- 172.21.15.49:0/1948671262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c047060 con 0x7f306c0649e0 2024-01-22T05:08:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.660+0000 7f3063e00700 1 -- 172.21.15.49:0/1948671262 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f305c01c9e0 con 0x7f306c0649e0 2024-01-22T05:08:19.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.660+0000 7f3063e00700 1 --2- 172.21.15.49:0/1948671262 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f304405a510 0x7f304405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:19.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.660+0000 7f3063e00700 1 -- 172.21.15.49:0/1948671262 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f305c0766b0 con 0x7f306c0649e0 2024-01-22T05:08:19.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.664+0000 7f306be00700 1 --2- 172.21.15.49:0/1948671262 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f304405a510 0x7f304405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:19.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.664+0000 7f306be00700 1 --2- 172.21.15.49:0/1948671262 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f304405a510 0x7f304405c9d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f306c152000 tx=0x7f3054009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:19.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.668+0000 7f3063e00700 1 -- 172.21.15.49:0/1948671262 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f305c049d30 con 0x7f306c0649e0 2024-01-22T05:08:19.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.868+0000 7f3073600700 1 -- 172.21.15.49:0/1948671262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f306c0c3240 con 0x7f306c0649e0 2024-01-22T05:08:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.868+0000 7f3063e00700 1 -- 172.21.15.49:0/1948671262 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f305c020090 con 0x7f306c0649e0 2024-01-22T05:08:19.871 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:19.871 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":43,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:18.344316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:19.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.872+0000 7f3073600700 1 -- 172.21.15.49:0/1948671262 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f304405a510 msgr2=0x7f304405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.872+0000 7f3073600700 1 --2- 172.21.15.49:0/1948671262 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f304405a510 0x7f304405c9d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f306c152000 tx=0x7f3054009040).stop 2024-01-22T05:08:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.872+0000 7f3073600700 1 -- 172.21.15.49:0/1948671262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306c0649e0 msgr2=0x7f306c169330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.872+0000 7f3073600700 1 --2- 172.21.15.49:0/1948671262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306c0649e0 0x7f306c169330 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f305c009130 tx=0x7f305c017000).stop 2024-01-22T05:08:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.872+0000 7f3073600700 1 -- 172.21.15.49:0/1948671262 shutdown_connections 2024-01-22T05:08:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.872+0000 7f3073600700 1 --2- 172.21.15.49:0/1948671262 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f304405a510 0x7f304405c9d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.872+0000 7f3073600700 1 --2- 172.21.15.49:0/1948671262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f306c065620 0x7f306c145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.872+0000 7f3073600700 1 --2- 172.21.15.49:0/1948671262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f306c065240 0x7f306c0aa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.872+0000 7f3073600700 1 --2- 172.21.15.49:0/1948671262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306c0649e0 0x7f306c169330 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.872+0000 7f3073600700 1 -- 172.21.15.49:0/1948671262 >> 172.21.15.49:0/1948671262 conn(0x7f306c0c87f0 msgr2=0x7f306c0aacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:19.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.876+0000 7f3073600700 1 -- 172.21.15.49:0/1948671262 shutdown_connections 2024-01-22T05:08:19.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:19.876+0000 7f3073600700 1 -- 172.21.15.49:0/1948671262 wait complete. 2024-01-22T05:08:19.880 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 43 2024-01-22T05:08:19.897 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2024-01-22T05:08:20.060 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:20.060 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:08:20.060 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:20.079 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' got response code '0' and stdout '{ "return_code": 0 } ' 2024-01-22T05:08:20.080 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:08:20.080 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-01-22T05:08:20.080 DEBUG:teuthology.orchestra.run.smithi049:> import stat 2024-01-22T05:08:20.080 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:08:20.080 DEBUG:teuthology.orchestra.run.smithi049:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2024-01-22T05:08:20.080 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-01-22T05:08:20.174 INFO:teuthology.orchestra.run.smithi049.stdout:1099511630187 2024-01-22T05:08:20.363 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-01-22T05:08:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.580+0000 7f1b4dc00700 1 Processor -- start 2024-01-22T05:08:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.580+0000 7f1b4dc00700 1 -- start start 2024-01-22T05:08:20.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b4dc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b480bc3d0 0x7f1b481576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b4dc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b480bc7b0 0x7f1b48157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b4dc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1b4814d820 0x7f1b4814dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b4dc00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b481580b0 con 0x7f1b480bc3d0 2024-01-22T05:08:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b4dc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b480c1160 con 0x7f1b4814d820 2024-01-22T05:08:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b4dc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b48067a90 con 0x7f1b480bc7b0 2024-01-22T05:08:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b46a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b480bc3d0 0x7f1b481576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b46a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b480bc3d0 0x7f1b481576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35572/0 (socket says 172.21.15.49:35572) 2024-01-22T05:08:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b46a00700 1 -- 172.21.15.49:0/1360673259 learned_addr learned my addr 172.21.15.49:0/1360673259 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b46000700 1 --2- 172.21.15.49:0/1360673259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b480bc7b0 0x7f1b48157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b47400700 1 --2- 172.21.15.49:0/1360673259 >> v2:172.21.15.110:3300/0 conn(0x7f1b4814d820 0x7f1b4814dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b46a00700 1 -- 172.21.15.49:0/1360673259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b480bc7b0 msgr2=0x7f1b48157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b46a00700 1 --2- 172.21.15.49:0/1360673259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b480bc7b0 0x7f1b48157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b46a00700 1 -- 172.21.15.49:0/1360673259 >> v2:172.21.15.110:3300/0 conn(0x7f1b4814d820 msgr2=0x7f1b4814dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b46a00700 1 --2- 172.21.15.49:0/1360673259 >> v2:172.21.15.110:3300/0 conn(0x7f1b4814d820 0x7f1b4814dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.584+0000 7f1b46a00700 1 -- 172.21.15.49:0/1360673259 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b48067d70 con 0x7f1b480bc3d0 2024-01-22T05:08:20.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.588+0000 7f1b46a00700 1 --2- 172.21.15.49:0/1360673259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b480bc3d0 0x7f1b481576d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f1b48151d00 tx=0x7f1b380090f0).ready entity=mon.0 client_cookie=12fdfc1e756ed173 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.588+0000 7f1b45600700 1 -- 172.21.15.49:0/1360673259 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3800f510 con 0x7f1b480bc3d0 2024-01-22T05:08:20.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.588+0000 7f1b45600700 1 -- 172.21.15.49:0/1360673259 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3800f670 con 0x7f1b480bc3d0 2024-01-22T05:08:20.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.588+0000 7f1b45600700 1 -- 172.21.15.49:0/1360673259 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3800fa10 con 0x7f1b480bc3d0 2024-01-22T05:08:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.588+0000 7f1b4dc00700 1 -- 172.21.15.49:0/1360673259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b480bc3d0 msgr2=0x7f1b481576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.588+0000 7f1b4dc00700 1 --2- 172.21.15.49:0/1360673259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b480bc3d0 0x7f1b481576d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f1b48151d00 tx=0x7f1b380090f0).stop 2024-01-22T05:08:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.588+0000 7f1b4dc00700 1 -- 172.21.15.49:0/1360673259 shutdown_connections 2024-01-22T05:08:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.588+0000 7f1b4dc00700 1 --2- 172.21.15.49:0/1360673259 >> v2:172.21.15.110:3300/0 conn(0x7f1b4814d820 0x7f1b4814dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.588+0000 7f1b4dc00700 1 --2- 172.21.15.49:0/1360673259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b480bc7b0 0x7f1b48157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.588+0000 7f1b4dc00700 1 --2- 172.21.15.49:0/1360673259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b480bc3d0 0x7f1b481576d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.588+0000 7f1b4dc00700 1 -- 172.21.15.49:0/1360673259 >> 172.21.15.49:0/1360673259 conn(0x7f1b480c6560 msgr2=0x7f1b480c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.588+0000 7f1b4dc00700 1 -- 172.21.15.49:0/1360673259 shutdown_connections 2024-01-22T05:08:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.588+0000 7f1b4dc00700 1 -- 172.21.15.49:0/1360673259 wait complete. 2024-01-22T05:08:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.592+0000 7f1b4dc00700 1 Processor -- start 2024-01-22T05:08:20.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.592+0000 7f1b4dc00700 1 -- start start 2024-01-22T05:08:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b4dc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b480bc3d0 0x7f1b480bea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b4dc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b480bc7b0 0x7f1b480bd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b4dc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b4814d820 0x7f1b480bdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b4dc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480a9a80 con 0x7f1b4814d820 2024-01-22T05:08:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b4dc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480bef30 con 0x7f1b480bc3d0 2024-01-22T05:08:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b4dc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4814b010 con 0x7f1b480bc7b0 2024-01-22T05:08:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b4814d820 0x7f1b480bdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b4814d820 0x7f1b480bdaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35586/0 (socket says 172.21.15.49:35586) 2024-01-22T05:08:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b47400700 1 -- 172.21.15.49:0/627213271 learned_addr learned my addr 172.21.15.49:0/627213271 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b46a00700 1 --2- 172.21.15.49:0/627213271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b480bc3d0 0x7f1b480bea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b46000700 1 --2- 172.21.15.49:0/627213271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b480bc7b0 0x7f1b480bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b46a00700 1 -- 172.21.15.49:0/627213271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b480bc7b0 msgr2=0x7f1b480bd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b46a00700 1 --2- 172.21.15.49:0/627213271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b480bc7b0 0x7f1b480bd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b46a00700 1 -- 172.21.15.49:0/627213271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b4814d820 msgr2=0x7f1b480bdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b46a00700 1 --2- 172.21.15.49:0/627213271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b4814d820 0x7f1b480bdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b46a00700 1 -- 172.21.15.49:0/627213271 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b38009370 con 0x7f1b480bc3d0 2024-01-22T05:08:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b47400700 1 --2- 172.21.15.49:0/627213271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b4814d820 0x7f1b480bdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b46a00700 1 --2- 172.21.15.49:0/627213271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b480bc3d0 0x7f1b480bea40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f1b38014000 tx=0x7f1b38017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b3e000700 1 -- 172.21.15.49:0/627213271 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38006d90 con 0x7f1b480bc3d0 2024-01-22T05:08:20.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b3e000700 1 -- 172.21.15.49:0/627213271 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b38006950 con 0x7f1b480bc3d0 2024-01-22T05:08:20.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b4dc00700 1 -- 172.21.15.49:0/627213271 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4814b2f0 con 0x7f1b480bc3d0 2024-01-22T05:08:20.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.596+0000 7f1b3e000700 1 -- 172.21.15.49:0/627213271 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3800f7e0 con 0x7f1b480bc3d0 2024-01-22T05:08:20.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.600+0000 7f1b4dc00700 1 -- 172.21.15.49:0/627213271 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4814b8b0 con 0x7f1b480bc3d0 2024-01-22T05:08:20.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.600+0000 7f1b3e000700 1 -- 172.21.15.49:0/627213271 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1b38021070 con 0x7f1b480bc3d0 2024-01-22T05:08:20.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.604+0000 7f1b3e000700 1 --2- 172.21.15.49:0/627213271 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b2005a560 0x7f1b2005ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.604+0000 7f1b3e000700 1 -- 172.21.15.49:0/627213271 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f1b380761e0 con 0x7f1b480bc3d0 2024-01-22T05:08:20.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.604+0000 7f1b5800c740 1 Processor -- start 2024-01-22T05:08:20.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.604+0000 7f1b46000700 1 --2- 172.21.15.49:0/627213271 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b2005a560 0x7f1b2005ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.604+0000 7f1b5800c740 1 -- start start 2024-01-22T05:08:20.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.604+0000 7f1b46000700 1 --2- 172.21.15.49:0/627213271 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b2005a560 0x7f1b2005ca20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f1b480bfc30 tx=0x7f1b30009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.604+0000 7f1b5800c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2aee6a0 0x2aeea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.604+0000 7f1b5800c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2af37b0 0x2aa77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.604+0000 7f1b5800c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2ad2d60 0x2aa98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.604+0000 7f1b5800c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x29e7340 con 0x2af37b0 2024-01-22T05:08:20.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.604+0000 7f1b5800c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a0a4e0 con 0x2aee6a0 2024-01-22T05:08:20.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.604+0000 7f1b5800c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x29d3ce0 con 0x2ad2d60 2024-01-22T05:08:20.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b46000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2af37b0 0x2aa77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b46000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2af37b0 0x2aa77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35598/0 (socket says 172.21.15.49:35598) 2024-01-22T05:08:20.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b46000700 1 -- 172.21.15.49:0/3993117533 learned_addr learned my addr 172.21.15.49:0/3993117533 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:20.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b47400700 1 --2- 172.21.15.49:0/3993117533 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2ad2d60 0x2aa98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b46a00700 1 --2- 172.21.15.49:0/3993117533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2aee6a0 0x2aeea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b46000700 1 -- 172.21.15.49:0/3993117533 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2ad2d60 msgr2=0x2aa98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b46000700 1 --2- 172.21.15.49:0/3993117533 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2ad2d60 0x2aa98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b46000700 1 -- 172.21.15.49:0/3993117533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2aee6a0 msgr2=0x2aeea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b46000700 1 --2- 172.21.15.49:0/3993117533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2aee6a0 0x2aeea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b46000700 1 -- 172.21.15.49:0/3993117533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29daed0 con 0x2af37b0 2024-01-22T05:08:20.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b46a00700 1 --2- 172.21.15.49:0/3993117533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2aee6a0 0x2aeea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:20.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b46000700 1 --2- 172.21.15.49:0/3993117533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2af37b0 0x2aa77e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f1b30011c80 tx=0x7f1b30017000).ready entity=mon.0 client_cookie=d13911c1ae988d88 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b36a00700 1 -- 172.21.15.49:0/3993117533 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30014920 con 0x2af37b0 2024-01-22T05:08:20.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b36a00700 1 -- 172.21.15.49:0/3993117533 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b30014a80 con 0x2af37b0 2024-01-22T05:08:20.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b36a00700 1 -- 172.21.15.49:0/3993117533 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30014e00 con 0x2af37b0 2024-01-22T05:08:20.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b5800c740 1 -- 172.21.15.49:0/3993117533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2af37b0 msgr2=0x2aa77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b5800c740 1 --2- 172.21.15.49:0/3993117533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2af37b0 0x2aa77e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f1b30011c80 tx=0x7f1b30017000).stop 2024-01-22T05:08:20.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b5800c740 1 -- 172.21.15.49:0/3993117533 shutdown_connections 2024-01-22T05:08:20.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b5800c740 1 --2- 172.21.15.49:0/3993117533 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2ad2d60 0x2aa98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b5800c740 1 --2- 172.21.15.49:0/3993117533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2af37b0 0x2aa77e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b5800c740 1 --2- 172.21.15.49:0/3993117533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2aee6a0 0x2aeea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b5800c740 1 -- 172.21.15.49:0/3993117533 >> 172.21.15.49:0/3993117533 conn(0x288c680 msgr2=0x2aad620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:20.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b5800c740 1 -- 172.21.15.49:0/3993117533 shutdown_connections 2024-01-22T05:08:20.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.608+0000 7f1b5800c740 1 -- 172.21.15.49:0/3993117533 wait complete. 2024-01-22T05:08:20.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.612+0000 7f1b5800c740 1 -- start start 2024-01-22T05:08:20.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.612+0000 7f1b5800c740 1 Processor -- start 2024-01-22T05:08:20.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.612+0000 7f1b5800c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2ad2d60 0x2ad14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.612+0000 7f1b5800c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2aee6a0 0x2b03320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.612+0000 7f1b5800c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2af37b0 0x2af3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.612+0000 7f1b5800c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ad7aa0 con 0x2aee6a0 2024-01-22T05:08:20.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.612+0000 7f1b5800c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ad4a70 con 0x2af37b0 2024-01-22T05:08:20.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.612+0000 7f1b5800c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ad58d0 con 0x2ad2d60 2024-01-22T05:08:20.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.612+0000 7f1b5800c740 10 client.0 ll_register_callbacks cb 0x2a647c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:20.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b46000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2aee6a0 0x2b03320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b46000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2aee6a0 0x2b03320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35600/0 (socket says 172.21.15.49:35600) 2024-01-22T05:08:20.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b46000700 1 -- 172.21.15.49:0/3856588523 learned_addr learned my addr 172.21.15.49:0/3856588523 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:20.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b46a00700 1 --2- 172.21.15.49:0/3856588523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2ad2d60 0x2ad14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b47400700 1 --2- 172.21.15.49:0/3856588523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2af37b0 0x2af3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b46a00700 1 -- 172.21.15.49:0/3856588523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2af37b0 msgr2=0x2af3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b46a00700 1 --2- 172.21.15.49:0/3856588523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2af37b0 0x2af3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b46a00700 1 -- 172.21.15.49:0/3856588523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2aee6a0 msgr2=0x2b03320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b46a00700 1 --2- 172.21.15.49:0/3856588523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2aee6a0 0x2b03320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b46a00700 1 -- 172.21.15.49:0/3856588523 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b300118a0 con 0x2ad2d60 2024-01-22T05:08:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b46000700 1 --2- 172.21.15.49:0/3856588523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2aee6a0 0x2b03320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b46a00700 1 --2- 172.21.15.49:0/3856588523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2ad2d60 0x2ad14d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f1b38009340 tx=0x7f1b38076040).ready entity=mon.2 client_cookie=f572af3022d001c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b2f400700 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2024-01-22T05:08:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b2f400700 1 -- 172.21.15.49:0/3856588523 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38052070 con 0x2ad2d60 2024-01-22T05:08:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b2f400700 1 -- 172.21.15.49:0/3856588523 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f1b38049c30 con 0x2ad2d60 2024-01-22T05:08:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b5800c740 1 -- 172.21.15.49:0/3856588523 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2a24230 con 0x2ad2d60 2024-01-22T05:08:20.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b2f400700 1 -- 172.21.15.49:0/3856588523 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b38049df0 con 0x2ad2d60 2024-01-22T05:08:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b5800c740 10 client.5351 fetch_fsmap learned FSMap version 43 2024-01-22T05:08:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b5800c740 1 -- 172.21.15.49:0/3856588523 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x2a277c0 con 0x2ad2d60 2024-01-22T05:08:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b2f400700 1 -- 172.21.15.49:0/3856588523 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2a24230 con 0x2ad2d60 2024-01-22T05:08:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b2f400700 1 -- 172.21.15.49:0/3856588523 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1b3804c440 con 0x2ad2d60 2024-01-22T05:08:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b5800c740 10 client.5351 fetch_fsmap finished waiting for FSMap version 43 2024-01-22T05:08:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b5800c740 10 client.5351 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b5800c740 20 client.5351 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b5800c740 1 --2- 172.21.15.49:0/3856588523 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2ad5d60 0x2ad6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b5800c740 4 client.5351 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b5800c740 1 -- 172.21.15.49:0/3856588523 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2a1a780 con 0x2ad5d60 2024-01-22T05:08:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.616+0000 7f1b46000700 1 --2- 172.21.15.49:0/3856588523 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2ad5d60 0x2ad6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b46000700 1 --2- 172.21.15.49:0/3856588523 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2ad5d60 0x2ad6bf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9c2f9c3c02b84918 server_cookie=4cdcba2d2b142d72 in_seq=0 out_seq=0 2024-01-22T05:08:20.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b2f400700 10 client.5351 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:20.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b2f400700 1 -- 172.21.15.49:0/3856588523 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2a1a780 con 0x2ad5d60 2024-01-22T05:08:20.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b2f400700 10 client.5351 handle_command_reply: tid=0 2024-01-22T05:08:20.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b5800c740 1 client.5351 shutdown 2024-01-22T05:08:20.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b5800c740 1 -- 172.21.15.49:0/3856588523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2ad2d60 msgr2=0x2ad14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b5800c740 1 --2- 172.21.15.49:0/3856588523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2ad2d60 0x2ad14d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f1b38009340 tx=0x7f1b38076040).stop 2024-01-22T05:08:20.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b5800c740 1 -- 172.21.15.49:0/3856588523 shutdown_connections 2024-01-22T05:08:20.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b5800c740 1 --2- 172.21.15.49:0/3856588523 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2ad5d60 0x2ad6bf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b5800c740 1 --2- 172.21.15.49:0/3856588523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2af37b0 0x2af3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b5800c740 1 --2- 172.21.15.49:0/3856588523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2aee6a0 0x2b03320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b5800c740 1 --2- 172.21.15.49:0/3856588523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2ad2d60 0x2ad14d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b2f400700 0 client.5351 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:20.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b5800c740 1 -- 172.21.15.49:0/3856588523 >> 172.21.15.49:0/3856588523 conn(0x288c680 msgr2=0x2af2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:20.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b5800c740 1 -- 172.21.15.49:0/3856588523 shutdown_connections 2024-01-22T05:08:20.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.620+0000 7f1b5800c740 1 -- 172.21.15.49:0/3856588523 wait complete. 2024-01-22T05:08:20.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.624+0000 7f1b5800c740 20 client.5351 trim_cache size 0 max 16384 2024-01-22T05:08:20.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.636+0000 7f1b5800c740 1 Processor -- start 2024-01-22T05:08:20.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.636+0000 7f1b5800c740 1 -- start start 2024-01-22T05:08:20.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b5800c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2ad2d60 0x2aed800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b5800c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2aee6a0 0x2aedcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b5800c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2af37b0 0x2b08a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b5800c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2aef470 con 0x2ad2d60 2024-01-22T05:08:20.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b5800c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2aac5a0 con 0x2aee6a0 2024-01-22T05:08:20.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b5800c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2aa88e0 con 0x2af37b0 2024-01-22T05:08:20.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b46a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2ad2d60 0x2aed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b47400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2af37b0 0x2b08a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b47400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2af37b0 0x2b08a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:34236/0 (socket says 172.21.15.49:34236) 2024-01-22T05:08:20.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b47400700 1 -- 172.21.15.49:0/3018067418 learned_addr learned my addr 172.21.15.49:0/3018067418 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:20.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b46000700 1 --2- 172.21.15.49:0/3018067418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2aee6a0 0x2aedcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b47400700 1 -- 172.21.15.49:0/3018067418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2aee6a0 msgr2=0x2aedcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b47400700 1 --2- 172.21.15.49:0/3018067418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2aee6a0 0x2aedcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b47400700 1 -- 172.21.15.49:0/3018067418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2ad2d60 msgr2=0x2aed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b47400700 1 --2- 172.21.15.49:0/3018067418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2ad2d60 0x2aed800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b47400700 1 -- 172.21.15.49:0/3018067418 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b480be340 con 0x2af37b0 2024-01-22T05:08:20.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b46a00700 1 --2- 172.21.15.49:0/3018067418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2ad2d60 0x2aed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:20.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b47400700 1 --2- 172.21.15.49:0/3018067418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2af37b0 0x2b08a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f1b4000eb90 tx=0x7f1b4000b040).ready entity=mon.2 client_cookie=3bfaaeec1dfa56b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b37400700 1 -- 172.21.15.49:0/3018067418 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4000e720 con 0x2af37b0 2024-01-22T05:08:20.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b37400700 1 -- 172.21.15.49:0/3018067418 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4000f040 con 0x2af37b0 2024-01-22T05:08:20.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.640+0000 7f1b37400700 1 -- 172.21.15.49:0/3018067418 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40017ca0 con 0x2af37b0 2024-01-22T05:08:20.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.644+0000 7f1b5800c740 1 -- 172.21.15.49:0/3018067418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2af37b0 msgr2=0x2b08a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.644+0000 7f1b5800c740 1 --2- 172.21.15.49:0/3018067418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2af37b0 0x2b08a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f1b4000eb90 tx=0x7f1b4000b040).stop 2024-01-22T05:08:20.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.644+0000 7f1b5800c740 1 -- 172.21.15.49:0/3018067418 shutdown_connections 2024-01-22T05:08:20.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.644+0000 7f1b5800c740 1 --2- 172.21.15.49:0/3018067418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2af37b0 0x2b08a10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.644+0000 7f1b5800c740 1 --2- 172.21.15.49:0/3018067418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2aee6a0 0x2aedcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.644+0000 7f1b5800c740 1 --2- 172.21.15.49:0/3018067418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2ad2d60 0x2aed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.644+0000 7f1b5800c740 1 -- 172.21.15.49:0/3018067418 >> 172.21.15.49:0/3018067418 conn(0x288c680 msgr2=0x2aad490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:20.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.644+0000 7f1b5800c740 1 -- 172.21.15.49:0/3018067418 shutdown_connections 2024-01-22T05:08:20.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.644+0000 7f1b5800c740 1 -- 172.21.15.49:0/3018067418 wait complete. 2024-01-22T05:08:20.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.644+0000 7f1b5800c740 1 -- start start 2024-01-22T05:08:20.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.644+0000 7f1b5800c740 1 Processor -- start 2024-01-22T05:08:20.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2ad2d60 0x2aedd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2aee6a0 0x2aa7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2af37b0 0x2b069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2aa84b0 con 0x2af37b0 2024-01-22T05:08:20.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b076d0 con 0x2ad2d60 2024-01-22T05:08:20.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2aa7b30 con 0x2aee6a0 2024-01-22T05:08:20.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 10 client.0 ll_register_callbacks cb 0x7f1b3804d2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:20.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2af37b0 0x2b069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2af37b0 0x2b069f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35620/0 (socket says 172.21.15.49:35620) 2024-01-22T05:08:20.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b47400700 1 -- 172.21.15.49:0/1062971708 learned_addr learned my addr 172.21.15.49:0/1062971708 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:20.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b46a00700 1 --2- 172.21.15.49:0/1062971708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2ad2d60 0x2aedd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b46000700 1 --2- 172.21.15.49:0/1062971708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2aee6a0 0x2aa7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b47400700 1 -- 172.21.15.49:0/1062971708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2aee6a0 msgr2=0x2aa7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b47400700 1 --2- 172.21.15.49:0/1062971708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2aee6a0 0x2aa7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b47400700 1 -- 172.21.15.49:0/1062971708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2ad2d60 msgr2=0x2aedd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b47400700 1 --2- 172.21.15.49:0/1062971708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2ad2d60 0x2aedd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b47400700 1 -- 172.21.15.49:0/1062971708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2a277c0 con 0x2af37b0 2024-01-22T05:08:20.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b46000700 1 --2- 172.21.15.49:0/1062971708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2aee6a0 0x2aa7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:20.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b47400700 1 --2- 172.21.15.49:0/1062971708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2af37b0 0x2b069f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x2aa72e0 tx=0x7f1b40021000).ready entity=mon.0 client_cookie=b581f50f77fa8c5a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b2f400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:20.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b2f400700 1 -- 172.21.15.49:0/1062971708 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4000e690 con 0x2af37b0 2024-01-22T05:08:20.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b2f400700 1 -- 172.21.15.49:0/1062971708 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f1b40020dc0 con 0x2af37b0 2024-01-22T05:08:20.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 1 -- 172.21.15.49:0/1062971708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b30014a80 con 0x2af37b0 2024-01-22T05:08:20.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b2f400700 1 -- 172.21.15.49:0/1062971708 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b40028650 con 0x2af37b0 2024-01-22T05:08:20.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 10 client.5856 fetch_fsmap learned FSMap version 43 2024-01-22T05:08:20.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 1 -- 172.21.15.49:0/1062971708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x7f1b4000e890 con 0x2af37b0 2024-01-22T05:08:20.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b2f400700 1 -- 172.21.15.49:0/1062971708 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b30014a80 con 0x2af37b0 2024-01-22T05:08:20.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b2f400700 1 -- 172.21.15.49:0/1062971708 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1b400287b0 con 0x2af37b0 2024-01-22T05:08:20.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 10 client.5856 fetch_fsmap finished waiting for FSMap version 43 2024-01-22T05:08:20.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 10 client.5856 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:20.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 20 client.5856 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:20.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 1 --2- 172.21.15.49:0/1062971708 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2b06ee0 0x2af2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 4 client.5856 mds_command: new command op to 5569 tid=0[{"prefix": "damage ls"}] 2024-01-22T05:08:20.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.648+0000 7f1b5800c740 1 -- 172.21.15.49:0/1062971708 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x28e3610 con 0x2b06ee0 2024-01-22T05:08:20.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b46a00700 1 --2- 172.21.15.49:0/1062971708 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2b06ee0 0x2af2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b46a00700 1 --2- 172.21.15.49:0/1062971708 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2b06ee0 0x2af2430 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=be5a072317b00b35 server_cookie=992042734556b880 in_seq=0 out_seq=0 2024-01-22T05:08:20.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b2f400700 10 client.5856 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:20.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b2f400700 1 -- 172.21.15.49:0/1062971708 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x28e3610 con 0x2b06ee0 2024-01-22T05:08:20.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b2f400700 10 client.5856 handle_command_reply: tid=0 2024-01-22T05:08:20.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b5800c740 1 client.5856 shutdown 2024-01-22T05:08:20.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b5800c740 1 -- 172.21.15.49:0/1062971708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2af37b0 msgr2=0x2b069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b5800c740 1 --2- 172.21.15.49:0/1062971708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2af37b0 0x2b069f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x2aa72e0 tx=0x7f1b40021000).stop 2024-01-22T05:08:20.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b5800c740 1 -- 172.21.15.49:0/1062971708 shutdown_connections 2024-01-22T05:08:20.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b5800c740 1 --2- 172.21.15.49:0/1062971708 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2b06ee0 0x2af2430 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b5800c740 1 --2- 172.21.15.49:0/1062971708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2af37b0 0x2b069f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b5800c740 1 --2- 172.21.15.49:0/1062971708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2aee6a0 0x2aa7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b5800c740 1 --2- 172.21.15.49:0/1062971708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2ad2d60 0x2aedd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b2f400700 0 client.5856 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:20.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b5800c740 1 -- 172.21.15.49:0/1062971708 >> 172.21.15.49:0/1062971708 conn(0x288c680 msgr2=0x2aea1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:20.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b5800c740 1 -- 172.21.15.49:0/1062971708 shutdown_connections 2024-01-22T05:08:20.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b5800c740 1 -- 172.21.15.49:0/1062971708 wait complete. 2024-01-22T05:08:20.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b5800c740 20 client.5856 trim_cache size 0 max 16384 2024-01-22T05:08:20.657 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-01-22T05:08:20.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b4dc00700 1 -- 172.21.15.49:0/627213271 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b2005a560 msgr2=0x7f1b2005ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b4dc00700 1 --2- 172.21.15.49:0/627213271 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b2005a560 0x7f1b2005ca20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f1b480bfc30 tx=0x7f1b30009060).stop 2024-01-22T05:08:20.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b4dc00700 1 -- 172.21.15.49:0/627213271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b480bc3d0 msgr2=0x7f1b480bea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.652+0000 7f1b4dc00700 1 --2- 172.21.15.49:0/627213271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b480bc3d0 0x7f1b480bea40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f1b38014000 tx=0x7f1b38017000).stop 2024-01-22T05:08:20.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.656+0000 7f1b4dc00700 1 -- 172.21.15.49:0/627213271 shutdown_connections 2024-01-22T05:08:20.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.656+0000 7f1b4dc00700 1 --2- 172.21.15.49:0/627213271 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1b2005a560 0x7f1b2005ca20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.656+0000 7f1b4dc00700 1 --2- 172.21.15.49:0/627213271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b4814d820 0x7f1b480bdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.656+0000 7f1b4dc00700 1 --2- 172.21.15.49:0/627213271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b480bc7b0 0x7f1b480bd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.656+0000 7f1b4dc00700 1 --2- 172.21.15.49:0/627213271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b480bc3d0 0x7f1b480bea40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.656+0000 7f1b4dc00700 1 -- 172.21.15.49:0/627213271 >> 172.21.15.49:0/627213271 conn(0x7f1b480c6560 msgr2=0x7f1b48068200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:20.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.656+0000 7f1b4dc00700 1 -- 172.21.15.49:0/627213271 shutdown_connections 2024-01-22T05:08:20.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.656+0000 7f1b4dc00700 1 -- 172.21.15.49:0/627213271 wait complete. 2024-01-22T05:08:20.680 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 1000000096b.00000000 parent 2024-01-22T05:08:20.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.736+0000 7fd8f74f2d00 1 Processor -- start 2024-01-22T05:08:20.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.736+0000 7fd8f74f2d00 1 -- start start 2024-01-22T05:08:20.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f74f2d00 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e853d45300 0x55e853e029c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f74f2d00 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e853d759d0 0x55e853e15f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f74f2d00 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e853e1beb0 0x55e853e163f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f74f2d00 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e853cf1cc0 con 0x55e853e1beb0 2024-01-22T05:08:20.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f74f2d00 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e853cbc220 con 0x55e853d45300 2024-01-22T05:08:20.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f74f2d00 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e853e17a80 con 0x55e853d759d0 2024-01-22T05:08:20.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e853e1beb0 0x55e853e163f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e853e1beb0 0x55e853e163f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35626/0 (socket says 172.21.15.49:35626) 2024-01-22T05:08:20.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f5000700 1 -- 172.21.15.49:0/530790220 learned_addr learned my addr 172.21.15.49:0/530790220 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:20.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f3c00700 1 --2- 172.21.15.49:0/530790220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e853d759d0 0x55e853e15f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f4600700 1 --2- 172.21.15.49:0/530790220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e853d45300 0x55e853e029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f5000700 1 -- 172.21.15.49:0/530790220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e853d759d0 msgr2=0x55e853e15f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f5000700 1 --2- 172.21.15.49:0/530790220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e853d759d0 0x55e853e15f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f5000700 1 -- 172.21.15.49:0/530790220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e853d45300 msgr2=0x55e853e029c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f5000700 1 --2- 172.21.15.49:0/530790220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e853d45300 0x55e853e029c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f5000700 1 -- 172.21.15.49:0/530790220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec00a0e0 con 0x55e853e1beb0 2024-01-22T05:08:20.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f5000700 1 --2- 172.21.15.49:0/530790220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e853e1beb0 0x55e853e163f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fd8ec00f000 tx=0x7fd8ec015000).ready entity=mon.0 client_cookie=b2d2061d29d8dcc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f2800700 1 -- 172.21.15.49:0/530790220 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00d470 con 0x55e853e1beb0 2024-01-22T05:08:20.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f2800700 1 -- 172.21.15.49:0/530790220 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec00dcc0 con 0x55e853e1beb0 2024-01-22T05:08:20.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f2800700 1 -- 172.21.15.49:0/530790220 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00de30 con 0x55e853e1beb0 2024-01-22T05:08:20.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f74f2d00 1 -- 172.21.15.49:0/530790220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e853e1beb0 msgr2=0x55e853e163f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f74f2d00 1 --2- 172.21.15.49:0/530790220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e853e1beb0 0x55e853e163f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fd8ec00f000 tx=0x7fd8ec015000).stop 2024-01-22T05:08:20.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f74f2d00 1 -- 172.21.15.49:0/530790220 shutdown_connections 2024-01-22T05:08:20.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f74f2d00 1 --2- 172.21.15.49:0/530790220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e853e1beb0 0x55e853e163f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f74f2d00 1 --2- 172.21.15.49:0/530790220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e853d759d0 0x55e853e15f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f74f2d00 1 --2- 172.21.15.49:0/530790220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e853d45300 0x55e853e029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f74f2d00 1 -- 172.21.15.49:0/530790220 >> 172.21.15.49:0/530790220 conn(0x55e853d93b10 msgr2=0x55e853e1ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:20.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f74f2d00 1 -- 172.21.15.49:0/530790220 shutdown_connections 2024-01-22T05:08:20.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.740+0000 7fd8f74f2d00 1 -- 172.21.15.49:0/530790220 wait complete. 2024-01-22T05:08:20.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f74f2d00 1 Processor -- start 2024-01-22T05:08:20.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f74f2d00 1 -- start start 2024-01-22T05:08:20.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f74f2d00 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e853d45300 0x55e853e1b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f74f2d00 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e853d759d0 0x55e853e01bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f74f2d00 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e853e1beb0 0x55e853e02da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f74f2d00 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e853d8cf80 con 0x55e853d759d0 2024-01-22T05:08:20.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f74f2d00 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e853e02bc0 con 0x55e853d45300 2024-01-22T05:08:20.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f74f2d00 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e853d8c190 con 0x55e853e1beb0 2024-01-22T05:08:20.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f3c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e853d759d0 0x55e853e01bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f4600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e853d45300 0x55e853e1b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f3c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e853d759d0 0x55e853e01bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35628/0 (socket says 172.21.15.49:35628) 2024-01-22T05:08:20.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f3c00700 1 -- 172.21.15.49:0/3532652159 learned_addr learned my addr 172.21.15.49:0/3532652159 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:20.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f5000700 1 --2- 172.21.15.49:0/3532652159 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e853e1beb0 0x55e853e02da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f3c00700 1 -- 172.21.15.49:0/3532652159 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e853e1beb0 msgr2=0x55e853e02da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f3c00700 1 --2- 172.21.15.49:0/3532652159 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e853e1beb0 0x55e853e02da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f3c00700 1 -- 172.21.15.49:0/3532652159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e853d45300 msgr2=0x55e853e1b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f3c00700 1 --2- 172.21.15.49:0/3532652159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e853d45300 0x55e853e1b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f3c00700 1 -- 172.21.15.49:0/3532652159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e853ce5770 con 0x55e853d759d0 2024-01-22T05:08:20.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.744+0000 7fd8f5000700 1 --2- 172.21.15.49:0/3532652159 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e853e1beb0 0x55e853e02da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:20.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.748+0000 7fd8f3c00700 1 --2- 172.21.15.49:0/3532652159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e853d759d0 0x55e853e01bb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fd8dc004170 tx=0x7fd8dc001800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.748+0000 7fd8f0a00700 1 -- 172.21.15.49:0/3532652159 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc00bd20 con 0x55e853d759d0 2024-01-22T05:08:20.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.748+0000 7fd8f0a00700 1 -- 172.21.15.49:0/3532652159 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8dc00be80 con 0x55e853d759d0 2024-01-22T05:08:20.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.748+0000 7fd8f0a00700 1 -- 172.21.15.49:0/3532652159 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc00f6a0 con 0x55e853d759d0 2024-01-22T05:08:20.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.748+0000 7fd8f74f2d00 1 -- 172.21.15.49:0/3532652159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e853cb4a70 con 0x55e853d759d0 2024-01-22T05:08:20.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.748+0000 7fd8f74f2d00 1 -- 172.21.15.49:0/3532652159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e853cc0010 con 0x55e853d759d0 2024-01-22T05:08:20.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.748+0000 7fd8f0a00700 1 -- 172.21.15.49:0/3532652159 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd8dc00fa10 con 0x55e853d759d0 2024-01-22T05:08:20.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.752+0000 7fd8f0a00700 1 --2- 172.21.15.49:0/3532652159 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd8cc058ff0 0x7fd8cc05b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.752+0000 7fd8f0a00700 1 -- 172.21.15.49:0/3532652159 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd8dc073c90 con 0x55e853d759d0 2024-01-22T05:08:20.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.752+0000 7fd8f74f2d00 1 --2- 172.21.15.49:0/3532652159 >> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] conn(0x55e853d8da40 0x55e853d8de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.752+0000 7fd8f4600700 1 --2- 172.21.15.49:0/3532652159 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd8cc058ff0 0x7fd8cc05b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.752+0000 7fd8f74f2d00 1 -- 172.21.15.49:0/3532652159 --> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] -- osd_op(unknown.0.0:1 9.a 9:51f47cfd:::1000000096b.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected e56) v8 -- 0x55e853d8e370 con 0x55e853d8da40 2024-01-22T05:08:20.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.752+0000 7fd8f5000700 1 --2- 172.21.15.49:0/3532652159 >> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] conn(0x55e853d8da40 0x55e853d8de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.752+0000 7fd8f4600700 1 --2- 172.21.15.49:0/3532652159 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd8cc058ff0 0x7fd8cc05b4b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fd8e4000c00 tx=0x7fd8e40039b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.752+0000 7fd8f5000700 1 --2- 172.21.15.49:0/3532652159 >> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] conn(0x55e853d8da40 0x55e853d8de80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.756+0000 7fd8f5000700 1 -- 172.21.15.49:0/3532652159 <== osd.5 v2:172.21.15.110:6800/23253 1 ==== osd_op_reply(1 1000000096b.00000000 [rmxattr] v56'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd8ec00d260 con 0x55e853d8da40 2024-01-22T05:08:20.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.756+0000 7fd8f74f2d00 1 -- 172.21.15.49:0/3532652159 >> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] conn(0x55e853d8da40 msgr2=0x55e853d8de80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.756+0000 7fd8f74f2d00 1 --2- 172.21.15.49:0/3532652159 >> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] conn(0x55e853d8da40 0x55e853d8de80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.756+0000 7fd8f74f2d00 1 -- 172.21.15.49:0/3532652159 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd8cc058ff0 msgr2=0x7fd8cc05b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.756+0000 7fd8f74f2d00 1 --2- 172.21.15.49:0/3532652159 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd8cc058ff0 0x7fd8cc05b4b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fd8e4000c00 tx=0x7fd8e40039b0).stop 2024-01-22T05:08:20.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.756+0000 7fd8f74f2d00 1 -- 172.21.15.49:0/3532652159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e853d759d0 msgr2=0x55e853e01bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.756+0000 7fd8f74f2d00 1 --2- 172.21.15.49:0/3532652159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e853d759d0 0x55e853e01bb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fd8dc004170 tx=0x7fd8dc001800).stop 2024-01-22T05:08:20.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.756+0000 7fd8f5000700 1 -- 172.21.15.49:0/3532652159 reap_dead start 2024-01-22T05:08:20.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.756+0000 7fd8f74f2d00 1 -- 172.21.15.49:0/3532652159 shutdown_connections 2024-01-22T05:08:20.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.756+0000 7fd8f74f2d00 1 -- 172.21.15.49:0/3532652159 >> 172.21.15.49:0/3532652159 conn(0x55e853d93b10 msgr2=0x55e853d43b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:20.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.756+0000 7fd8f74f2d00 1 -- 172.21.15.49:0/3532652159 shutdown_connections 2024-01-22T05:08:20.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.756+0000 7fd8f74f2d00 1 -- 172.21.15.49:0/3532652159 wait complete. 2024-01-22T05:08:20.766 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2024-01-22T05:08:20.766 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2024-01-22T05:08:20.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.936+0000 7f79e4c00700 1 Processor -- start 2024-01-22T05:08:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.936+0000 7f79e4c00700 1 -- start start 2024-01-22T05:08:20.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.940+0000 7f79e4c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f79e0155c20 0x7f79e0063da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.940+0000 7f79e4c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e0064290 0x7f79e00c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.940+0000 7f79e4c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e00c3520 con 0x7f79e00c2110 2024-01-22T05:08:20.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.940+0000 7f79e4c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e00646f0 con 0x7f79e0155c20 2024-01-22T05:08:20.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.940+0000 7f79e4c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00c2910 con 0x7f79e0064290 2024-01-22T05:08:20.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.944+0000 7f79dea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e0064290 0x7f79e00c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.944+0000 7f79df400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f79e0155c20 0x7f79e0063da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.944+0000 7f79dea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e0064290 0x7f79e00c1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:34268/0 (socket says 172.21.15.49:34268) 2024-01-22T05:08:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.944+0000 7f79dea00700 1 -- 172.21.15.49:0/3001500729 learned_addr learned my addr 172.21.15.49:0/3001500729 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.944+0000 7f79dfe00700 1 --1- 172.21.15.49:0/3001500729 >> v1:172.21.15.110:6789/0 conn(0x7f79e00c2110 0x7f79e015ba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:41284/0 (socket says 172.21.15.49:41284) 2024-01-22T05:08:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.944+0000 7f79dea00700 1 -- 172.21.15.49:0/3001500729 >> v2:172.21.15.110:3300/0 conn(0x7f79e0155c20 msgr2=0x7f79e0063da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.944+0000 7f79dea00700 1 --2- 172.21.15.49:0/3001500729 >> v2:172.21.15.110:3300/0 conn(0x7f79e0155c20 0x7f79e0063da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.944+0000 7f79dea00700 1 -- 172.21.15.49:0/3001500729 >> v1:172.21.15.110:6789/0 conn(0x7f79e00c2110 legacy=0x7f79e015ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.944+0000 7f79dea00700 1 -- 172.21.15.49:0/3001500729 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00c2bf0 con 0x7f79e0064290 2024-01-22T05:08:20.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.944+0000 7f79dea00700 1 --2- 172.21.15.49:0/3001500729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e0064290 0x7f79e00c1c20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f79c8006fd0 tx=0x7f79c80090f0).ready entity=mon.2 client_cookie=fce30d754988da00 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.944+0000 7f79de000700 1 -- 172.21.15.49:0/3001500729 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c800b580 con 0x7f79e0064290 2024-01-22T05:08:20.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.944+0000 7f79de000700 1 -- 172.21.15.49:0/3001500729 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c800b6e0 con 0x7f79e0064290 2024-01-22T05:08:20.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.944+0000 7f79de000700 1 -- 172.21.15.49:0/3001500729 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c800ba60 con 0x7f79e0064290 2024-01-22T05:08:20.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.944+0000 7f79e4c00700 1 -- 172.21.15.49:0/3001500729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e0064290 msgr2=0x7f79e00c1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.944+0000 7f79e4c00700 1 --2- 172.21.15.49:0/3001500729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e0064290 0x7f79e00c1c20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f79c8006fd0 tx=0x7f79c80090f0).stop 2024-01-22T05:08:20.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.948+0000 7f79e4c00700 1 -- 172.21.15.49:0/3001500729 shutdown_connections 2024-01-22T05:08:20.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.948+0000 7f79e4c00700 1 --2- 172.21.15.49:0/3001500729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e0064290 0x7f79e00c1c20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.948+0000 7f79e4c00700 1 --2- 172.21.15.49:0/3001500729 >> v2:172.21.15.110:3300/0 conn(0x7f79e0155c20 0x7f79e0063da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.948+0000 7f79e4c00700 1 -- 172.21.15.49:0/3001500729 >> 172.21.15.49:0/3001500729 conn(0x7f79e0062760 msgr2=0x7f79e0062b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:20.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.948+0000 7f79e4c00700 1 -- 172.21.15.49:0/3001500729 shutdown_connections 2024-01-22T05:08:20.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.948+0000 7f79e4c00700 1 -- 172.21.15.49:0/3001500729 wait complete. 2024-01-22T05:08:20.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.948+0000 7f79e4c00700 1 Processor -- start 2024-01-22T05:08:20.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79e4c00700 1 -- start start 2024-01-22T05:08:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79e4c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e0064290 0x7f79e00aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79e4c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e00c2110 0x7f79e0169190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79e4c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e0155c20 0x7f79e0169680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79e4c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00ab850 con 0x7f79e00c2110 2024-01-22T05:08:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79e4c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0169b70 con 0x7f79e0155c20 2024-01-22T05:08:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79e4c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00aac40 con 0x7f79e0064290 2024-01-22T05:08:20.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79dea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e00c2110 0x7f79e0169190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79dea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e00c2110 0x7f79e0169190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35634/0 (socket says 172.21.15.49:35634) 2024-01-22T05:08:20.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79dea00700 1 -- 172.21.15.49:0/296043822 learned_addr learned my addr 172.21.15.49:0/296043822 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:20.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79df400700 1 --2- 172.21.15.49:0/296043822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e0064290 0x7f79e00aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79dfe00700 1 --2- 172.21.15.49:0/296043822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e0155c20 0x7f79e0169680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79dea00700 1 -- 172.21.15.49:0/296043822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e0064290 msgr2=0x7f79e00aa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79dea00700 1 --2- 172.21.15.49:0/296043822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e0064290 0x7f79e00aa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79dea00700 1 -- 172.21.15.49:0/296043822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e0155c20 msgr2=0x7f79e0169680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79dea00700 1 --2- 172.21.15.49:0/296043822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e0155c20 0x7f79e0169680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79dea00700 1 -- 172.21.15.49:0/296043822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c8009370 con 0x7f79e00c2110 2024-01-22T05:08:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.952+0000 7f79dea00700 1 --2- 172.21.15.49:0/296043822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e00c2110 0x7f79e0169190 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f79e00c2a50 tx=0x7f79c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.956+0000 7f79d6a00700 1 -- 172.21.15.49:0/296043822 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8000bc0 con 0x7f79e00c2110 2024-01-22T05:08:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.956+0000 7f79d6a00700 1 -- 172.21.15.49:0/296043822 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c800b850 con 0x7f79e00c2110 2024-01-22T05:08:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.956+0000 7f79e4c00700 1 -- 172.21.15.49:0/296043822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e00aaf20 con 0x7f79e00c2110 2024-01-22T05:08:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.956+0000 7f79d6a00700 1 -- 172.21.15.49:0/296043822 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8000d20 con 0x7f79e00c2110 2024-01-22T05:08:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.956+0000 7f79e4c00700 1 -- 172.21.15.49:0/296043822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e00ab4e0 con 0x7f79e00c2110 2024-01-22T05:08:20.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.956+0000 7f79d6a00700 1 -- 172.21.15.49:0/296043822 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f79c801bac0 con 0x7f79e00c2110 2024-01-22T05:08:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.960+0000 7f79d6a00700 1 --2- 172.21.15.49:0/296043822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79b805a510 0x7f79b805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.960+0000 7f79d6a00700 1 -- 172.21.15.49:0/296043822 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f79c8076330 con 0x7f79e00c2110 2024-01-22T05:08:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.960+0000 7f79df400700 1 --2- 172.21.15.49:0/296043822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79b805a510 0x7f79b805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.960+0000 7f79df400700 1 --2- 172.21.15.49:0/296043822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79b805a510 0x7f79b805c9d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f79d0009c30 tx=0x7f79d0009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.964+0000 7f79f06a1740 1 Processor -- start 2024-01-22T05:08:20.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.964+0000 7f79f06a1740 1 -- start start 2024-01-22T05:08:20.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.964+0000 7f79f06a1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x261e6c0 0x25dc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.964+0000 7f79f06a1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261dfe0 0x261eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.964+0000 7f79f06a1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25d96e0 0x25d9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.964+0000 7f79f06a1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x24fd720 con 0x261dfe0 2024-01-22T05:08:20.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.964+0000 7f79f06a1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x250c170 con 0x25d96e0 2024-01-22T05:08:20.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.964+0000 7f79f06a1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2539610 con 0x261e6c0 2024-01-22T05:08:20.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79dea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261dfe0 0x261eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79dea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261dfe0 0x261eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35646/0 (socket says 172.21.15.49:35646) 2024-01-22T05:08:20.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79dea00700 1 -- 172.21.15.49:0/1681551148 learned_addr learned my addr 172.21.15.49:0/1681551148 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:20.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79df400700 1 --2- 172.21.15.49:0/1681551148 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x261e6c0 0x25dc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79dfe00700 1 --2- 172.21.15.49:0/1681551148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25d96e0 0x25d9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79dea00700 1 -- 172.21.15.49:0/1681551148 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x261e6c0 msgr2=0x25dc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79dea00700 1 --2- 172.21.15.49:0/1681551148 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x261e6c0 0x25dc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79dea00700 1 -- 172.21.15.49:0/1681551148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25d96e0 msgr2=0x25d9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79dea00700 1 --2- 172.21.15.49:0/1681551148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25d96e0 0x25d9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79dea00700 1 -- 172.21.15.49:0/1681551148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2567490 con 0x261dfe0 2024-01-22T05:08:20.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79dea00700 1 --2- 172.21.15.49:0/1681551148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261dfe0 0x261eaa0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f79c8009fd0 tx=0x7f79c800e000).ready entity=mon.0 client_cookie=e8701da50f97c141 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79cf000700 1 -- 172.21.15.49:0/1681551148 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c800b9c0 con 0x261dfe0 2024-01-22T05:08:20.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79cf000700 1 -- 172.21.15.49:0/1681551148 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c804b6f0 con 0x261dfe0 2024-01-22T05:08:20.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79cf000700 1 -- 172.21.15.49:0/1681551148 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c801bd70 con 0x261dfe0 2024-01-22T05:08:20.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79f06a1740 1 -- 172.21.15.49:0/1681551148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261dfe0 msgr2=0x261eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79f06a1740 1 --2- 172.21.15.49:0/1681551148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261dfe0 0x261eaa0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f79c8009fd0 tx=0x7f79c800e000).stop 2024-01-22T05:08:20.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79f06a1740 1 -- 172.21.15.49:0/1681551148 shutdown_connections 2024-01-22T05:08:20.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79f06a1740 1 --2- 172.21.15.49:0/1681551148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25d96e0 0x25d9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79f06a1740 1 --2- 172.21.15.49:0/1681551148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261dfe0 0x261eaa0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79f06a1740 1 --2- 172.21.15.49:0/1681551148 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x261e6c0 0x25dc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79f06a1740 1 -- 172.21.15.49:0/1681551148 >> 172.21.15.49:0/1681551148 conn(0x23bb980 msgr2=0x26231e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:20.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79f06a1740 1 -- 172.21.15.49:0/1681551148 shutdown_connections 2024-01-22T05:08:20.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.968+0000 7f79f06a1740 1 -- 172.21.15.49:0/1681551148 wait complete. 2024-01-22T05:08:20.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.972+0000 7f79f06a1740 1 -- start start 2024-01-22T05:08:20.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.972+0000 7f79f06a1740 1 Processor -- start 2024-01-22T05:08:20.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79f06a1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25d96e0 0x26078d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79f06a1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x261dfe0 0x25fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79f06a1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261e6c0 0x2621ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79f06a1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2528120 con 0x261e6c0 2024-01-22T05:08:20.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79f06a1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x261ca10 con 0x25d96e0 2024-01-22T05:08:20.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79f06a1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2607dc0 con 0x261dfe0 2024-01-22T05:08:20.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79f06a1740 10 client.0 ll_register_callbacks cb 0x25935a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:20.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79dfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261e6c0 0x2621ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79dfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261e6c0 0x2621ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35652/0 (socket says 172.21.15.49:35652) 2024-01-22T05:08:20.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79dfe00700 1 -- 172.21.15.49:0/893170198 learned_addr learned my addr 172.21.15.49:0/893170198 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:20.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79df400700 1 --2- 172.21.15.49:0/893170198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25d96e0 0x26078d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79dea00700 1 --2- 172.21.15.49:0/893170198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x261dfe0 0x25fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79dfe00700 1 -- 172.21.15.49:0/893170198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x261dfe0 msgr2=0x25fccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79dfe00700 1 --2- 172.21.15.49:0/893170198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x261dfe0 0x25fccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79dfe00700 1 -- 172.21.15.49:0/893170198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25d96e0 msgr2=0x26078d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:20.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79dfe00700 1 --2- 172.21.15.49:0/893170198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25d96e0 0x26078d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79dfe00700 1 -- 172.21.15.49:0/893170198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e00ab4e0 con 0x261e6c0 2024-01-22T05:08:20.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79dfe00700 1 --2- 172.21.15.49:0/893170198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261e6c0 0x2621ee0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f79d8007a40 tx=0x7f79d8009040).ready entity=mon.0 client_cookie=880c4d849f3b8ce5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:20.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79c7400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:20.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79c7400700 1 -- 172.21.15.49:0/893170198 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d80020b0 con 0x261e6c0 2024-01-22T05:08:20.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79c7400700 1 -- 172.21.15.49:0/893170198 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f79d8016e30 con 0x261e6c0 2024-01-22T05:08:20.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79f06a1740 1 -- 172.21.15.49:0/893170198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2553360 con 0x261e6c0 2024-01-22T05:08:20.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79c7400700 1 -- 172.21.15.49:0/893170198 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79d8004d10 con 0x261e6c0 2024-01-22T05:08:20.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79f06a1740 10 client.5874 fetch_fsmap learned FSMap version 43 2024-01-22T05:08:20.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79f06a1740 1 -- 172.21.15.49:0/893170198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x25568f0 con 0x261e6c0 2024-01-22T05:08:20.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79c7400700 1 -- 172.21.15.49:0/893170198 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2553360 con 0x261e6c0 2024-01-22T05:08:20.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79c7400700 1 -- 172.21.15.49:0/893170198 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f79d8013750 con 0x261e6c0 2024-01-22T05:08:20.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.976+0000 7f79f06a1740 10 client.5874 fetch_fsmap finished waiting for FSMap version 43 2024-01-22T05:08:20.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79f06a1740 10 client.5874 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:20.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79f06a1740 20 client.5874 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:20.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79f06a1740 1 --2- 172.21.15.49:0/893170198 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2639140 0x263b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:20.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79f06a1740 4 client.5874 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:20.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79f06a1740 1 -- 172.21.15.49:0/893170198 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x25498b0 con 0x2639140 2024-01-22T05:08:20.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79df400700 1 --2- 172.21.15.49:0/893170198 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2639140 0x263b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:20.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79c7400700 10 client.5874 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:20.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79df400700 1 --2- 172.21.15.49:0/893170198 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2639140 0x263b530 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=62805b72a7e7b3e1 server_cookie=fc5379e7a788125 in_seq=0 out_seq=0 2024-01-22T05:08:20.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79c7400700 1 -- 172.21.15.49:0/893170198 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x25498b0 con 0x2639140 2024-01-22T05:08:20.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79c7400700 10 client.5874 handle_command_reply: tid=0 2024-01-22T05:08:20.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79f06a1740 1 client.5874 shutdown 2024-01-22T05:08:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79f06a1740 1 -- 172.21.15.49:0/893170198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261e6c0 msgr2=0x2621ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79f06a1740 1 --2- 172.21.15.49:0/893170198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261e6c0 0x2621ee0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f79d8007a40 tx=0x7f79d8009040).stop 2024-01-22T05:08:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79f06a1740 1 -- 172.21.15.49:0/893170198 shutdown_connections 2024-01-22T05:08:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79f06a1740 1 --2- 172.21.15.49:0/893170198 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2639140 0x263b530 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79f06a1740 1 --2- 172.21.15.49:0/893170198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261e6c0 0x2621ee0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79c7400700 0 client.5874 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79f06a1740 1 --2- 172.21.15.49:0/893170198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x261dfe0 0x25fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79f06a1740 1 --2- 172.21.15.49:0/893170198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25d96e0 0x26078d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.980+0000 7f79f06a1740 1 -- 172.21.15.49:0/893170198 >> 172.21.15.49:0/893170198 conn(0x23bb980 msgr2=0x2623a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.984+0000 7f79f06a1740 1 -- 172.21.15.49:0/893170198 shutdown_connections 2024-01-22T05:08:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.984+0000 7f79f06a1740 1 -- 172.21.15.49:0/893170198 wait complete. 2024-01-22T05:08:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:20.984+0000 7f79f06a1740 20 client.5874 trim_cache size 0 max 16384 2024-01-22T05:08:21.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.000+0000 7f79f06a1740 1 Processor -- start 2024-01-22T05:08:21.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.000+0000 7f79f06a1740 1 -- start start 2024-01-22T05:08:21.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79f06a1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25d96e0 0x261d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79f06a1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261dfe0 0x25dc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79f06a1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x261e6c0 0x2623160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79f06a1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x25d8a70 con 0x261dfe0 2024-01-22T05:08:21.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79f06a1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x263b530 con 0x261e6c0 2024-01-22T05:08:21.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79f06a1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x263b760 con 0x25d96e0 2024-01-22T05:08:21.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79dea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261dfe0 0x25dc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79dea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261dfe0 0x25dc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35666/0 (socket says 172.21.15.49:35666) 2024-01-22T05:08:21.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79dea00700 1 -- 172.21.15.49:0/2572619984 learned_addr learned my addr 172.21.15.49:0/2572619984 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:21.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79dfe00700 1 --2- 172.21.15.49:0/2572619984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x261e6c0 0x2623160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79df400700 1 --2- 172.21.15.49:0/2572619984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25d96e0 0x261d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79dea00700 1 -- 172.21.15.49:0/2572619984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25d96e0 msgr2=0x261d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:21.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79dea00700 1 --2- 172.21.15.49:0/2572619984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25d96e0 0x261d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79dea00700 1 -- 172.21.15.49:0/2572619984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x261e6c0 msgr2=0x2623160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:21.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79dea00700 1 --2- 172.21.15.49:0/2572619984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x261e6c0 0x2623160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79dea00700 1 -- 172.21.15.49:0/2572619984 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e0069b60 con 0x261dfe0 2024-01-22T05:08:21.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79dea00700 1 --2- 172.21.15.49:0/2572619984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261dfe0 0x25dc140 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f79c800b340 tx=0x7f79c804f000).ready entity=mon.0 client_cookie=1c79ccf50f173e54 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:21.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79cfa00700 1 -- 172.21.15.49:0/2572619984 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c804d550 con 0x261dfe0 2024-01-22T05:08:21.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79cfa00700 1 -- 172.21.15.49:0/2572619984 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c800b9c0 con 0x261dfe0 2024-01-22T05:08:21.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79cfa00700 1 -- 172.21.15.49:0/2572619984 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8049cc0 con 0x261dfe0 2024-01-22T05:08:21.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79f06a1740 1 -- 172.21.15.49:0/2572619984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261dfe0 msgr2=0x25dc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:21.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79f06a1740 1 --2- 172.21.15.49:0/2572619984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261dfe0 0x25dc140 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f79c800b340 tx=0x7f79c804f000).stop 2024-01-22T05:08:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79f06a1740 1 -- 172.21.15.49:0/2572619984 shutdown_connections 2024-01-22T05:08:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79f06a1740 1 --2- 172.21.15.49:0/2572619984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x261e6c0 0x2623160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79f06a1740 1 --2- 172.21.15.49:0/2572619984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x261dfe0 0x25dc140 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79f06a1740 1 --2- 172.21.15.49:0/2572619984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25d96e0 0x261d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79f06a1740 1 -- 172.21.15.49:0/2572619984 >> 172.21.15.49:0/2572619984 conn(0x23bb980 msgr2=0x26076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79f06a1740 1 -- 172.21.15.49:0/2572619984 shutdown_connections 2024-01-22T05:08:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.004+0000 7f79f06a1740 1 -- 172.21.15.49:0/2572619984 wait complete. 2024-01-22T05:08:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.008+0000 7f79f06a1740 1 -- start start 2024-01-22T05:08:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.008+0000 7f79f06a1740 1 Processor -- start 2024-01-22T05:08:21.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.008+0000 7f79f06a1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25d96e0 0x2684140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.008+0000 7f79f06a1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x261dfe0 0x25d57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.008+0000 7f79f06a1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x261e6c0 0x25d5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.008+0000 7f79f06a1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x26887c0 con 0x25d96e0 2024-01-22T05:08:21.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.008+0000 7f79f06a1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x261c330 con 0x261e6c0 2024-01-22T05:08:21.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.008+0000 7f79f06a1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x25d6180 con 0x261dfe0 2024-01-22T05:08:21.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.008+0000 7f79f06a1740 10 client.0 ll_register_callbacks cb 0x7f79d8004bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:21.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79df400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25d96e0 0x2684140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79dea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x261dfe0 0x25d57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79df400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25d96e0 0x2684140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35678/0 (socket says 172.21.15.49:35678) 2024-01-22T05:08:21.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79df400700 1 -- 172.21.15.49:0/3926539336 learned_addr learned my addr 172.21.15.49:0/3926539336 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79dfe00700 1 --2- 172.21.15.49:0/3926539336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x261e6c0 0x25d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79df400700 1 -- 172.21.15.49:0/3926539336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x261dfe0 msgr2=0x25d57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79df400700 1 --2- 172.21.15.49:0/3926539336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x261dfe0 0x25d57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79df400700 1 -- 172.21.15.49:0/3926539336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x261e6c0 msgr2=0x25d5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79df400700 1 --2- 172.21.15.49:0/3926539336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x261e6c0 0x25d5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79df400700 1 -- 172.21.15.49:0/3926539336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2567490 con 0x25d96e0 2024-01-22T05:08:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79df400700 1 --2- 172.21.15.49:0/3926539336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25d96e0 0x2684140 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f79d0011650 tx=0x7f79d0017000).ready entity=mon.0 client_cookie=b95acc190ab2958b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:21.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79c7400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79c7400700 1 -- 172.21.15.49:0/3926539336 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0021ea0 con 0x25d96e0 2024-01-22T05:08:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79f06a1740 1 -- 172.21.15.49:0/3926539336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79c804b6f0 con 0x25d96e0 2024-01-22T05:08:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79c7400700 1 -- 172.21.15.49:0/3926539336 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f79d002a440 con 0x25d96e0 2024-01-22T05:08:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79c7400700 1 -- 172.21.15.49:0/3926539336 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79d002a810 con 0x25d96e0 2024-01-22T05:08:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79f06a1740 10 client.5880 fetch_fsmap learned FSMap version 43 2024-01-22T05:08:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79f06a1740 1 -- 172.21.15.49:0/3926539336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x2551b20 con 0x25d96e0 2024-01-22T05:08:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79c7400700 1 -- 172.21.15.49:0/3926539336 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c804b6f0 con 0x25d96e0 2024-01-22T05:08:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79c7400700 1 -- 172.21.15.49:0/3926539336 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f79d002a970 con 0x25d96e0 2024-01-22T05:08:21.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79f06a1740 10 client.5880 fetch_fsmap finished waiting for FSMap version 43 2024-01-22T05:08:21.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79f06a1740 10 client.5880 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:21.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79f06a1740 20 client.5880 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:21.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79f06a1740 1 --2- 172.21.15.49:0/3926539336 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2637b20 0x2636360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79f06a1740 4 client.5880 mds_command: new command op to 5569 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-01-22T05:08:21.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79f06a1740 1 -- 172.21.15.49:0/3926539336 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) v1 -- 0x2412910 con 0x2637b20 2024-01-22T05:08:21.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.012+0000 7f79dea00700 1 --2- 172.21.15.49:0/3926539336 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2637b20 0x2636360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79c7400700 10 client.5880 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:21.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79dea00700 1 --2- 172.21.15.49:0/3926539336 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2637b20 0x2636360 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f3b1c75fea6d8ddb server_cookie=167737357fb6aea9 in_seq=0 out_seq=0 2024-01-22T05:08:21.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79c7400700 1 -- 172.21.15.49:0/3926539336 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x2412910 con 0x2637b20 2024-01-22T05:08:21.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79c7400700 10 client.5880 handle_command_reply: tid=0 2024-01-22T05:08:21.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79f06a1740 1 client.5880 shutdown 2024-01-22T05:08:21.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79f06a1740 1 -- 172.21.15.49:0/3926539336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25d96e0 msgr2=0x2684140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:21.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79f06a1740 1 --2- 172.21.15.49:0/3926539336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25d96e0 0x2684140 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f79d0011650 tx=0x7f79d0017000).stop 2024-01-22T05:08:21.019 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f2b13200700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096b [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v665 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5736=0-4194304@1} caps={5736=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@3},l=5736 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x558c7d833700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x1000000096b:[<0x10000000001/new_file_0 v665>,<0x10000000000/ceph-qa-suite v59>,<0x1/scrub_test_path v24>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-01-22T05:08:21.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79f06a1740 1 -- 172.21.15.49:0/3926539336 shutdown_connections 2024-01-22T05:08:21.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79f06a1740 1 --2- 172.21.15.49:0/3926539336 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2637b20 0x2636360 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79f06a1740 1 --2- 172.21.15.49:0/3926539336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x261e6c0 0x25d5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79f06a1740 1 --2- 172.21.15.49:0/3926539336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x261dfe0 0x25d57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79f06a1740 1 --2- 172.21.15.49:0/3926539336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25d96e0 0x2684140 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79f06a1740 1 -- 172.21.15.49:0/3926539336 >> 172.21.15.49:0/3926539336 conn(0x23bb980 msgr2=0x26076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79c7400700 0 client.5880 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79f06a1740 1 -- 172.21.15.49:0/3926539336 shutdown_connections 2024-01-22T05:08:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79f06a1740 1 -- 172.21.15.49:0/3926539336 wait complete. 2024-01-22T05:08:21.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.016+0000 7f79f06a1740 20 client.5880 trim_cache size 0 max 16384 2024-01-22T05:08:21.021 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:21.021 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:08:21.022 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "acd8d522-5895-41fe-87b4-3e53a92455c2", 2024-01-22T05:08:21.022 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:08:21.022 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:21.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.020+0000 7f79e4c00700 1 -- 172.21.15.49:0/296043822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79b805a510 msgr2=0x7f79b805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.020+0000 7f79e4c00700 1 --2- 172.21.15.49:0/296043822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79b805a510 0x7f79b805c9d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f79d0009c30 tx=0x7f79d0009060).stop 2024-01-22T05:08:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.020+0000 7f79e4c00700 1 -- 172.21.15.49:0/296043822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e00c2110 msgr2=0x7f79e0169190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.020+0000 7f79e4c00700 1 --2- 172.21.15.49:0/296043822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e00c2110 0x7f79e0169190 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f79e00c2a50 tx=0x7f79c8017000).stop 2024-01-22T05:08:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.020+0000 7f79e4c00700 1 -- 172.21.15.49:0/296043822 shutdown_connections 2024-01-22T05:08:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.020+0000 7f79e4c00700 1 --2- 172.21.15.49:0/296043822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79b805a510 0x7f79b805c9d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.020+0000 7f79e4c00700 1 --2- 172.21.15.49:0/296043822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e0155c20 0x7f79e0169680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.020+0000 7f79e4c00700 1 --2- 172.21.15.49:0/296043822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79e00c2110 0x7f79e0169190 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.020+0000 7f79e4c00700 1 --2- 172.21.15.49:0/296043822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e0064290 0x7f79e00aa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.020+0000 7f79e4c00700 1 -- 172.21.15.49:0/296043822 >> 172.21.15.49:0/296043822 conn(0x7f79e0062760 msgr2=0x7f79e0157380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.020+0000 7f79e4c00700 1 -- 172.21.15.49:0/296043822 shutdown_connections 2024-01-22T05:08:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.020+0000 7f79e4c00700 1 -- 172.21.15.49:0/296043822 wait complete. 2024-01-22T05:08:21.043 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': 'acd8d522-5895-41fe-87b4-3e53a92455c2', 'mode': 'asynchronous'}' 2024-01-22T05:08:21.043 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2024-01-22T05:08:21.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.212+0000 7f5265600700 1 Processor -- start 2024-01-22T05:08:21.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.212+0000 7f5265600700 1 -- start start 2024-01-22T05:08:21.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.216+0000 7f5265600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52600bc3d0 0x7f52601576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.216+0000 7f5265600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5260157bc0 0x7f526014df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.216+0000 7f5265600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5260067a90 con 0x7f52600bc7b0 2024-01-22T05:08:21.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.216+0000 7f5265600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52600c1160 con 0x7f5260157bc0 2024-01-22T05:08:21.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.216+0000 7f5265600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5260067d70 con 0x7f52600bc3d0 2024-01-22T05:08:21.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f525f400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5260157bc0 0x7f526014df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f525ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52600bc3d0 0x7f52601576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f525f400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5260157bc0 0x7f526014df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:47300/0 (socket says 172.21.15.49:47300) 2024-01-22T05:08:21.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f525f400700 1 -- 172.21.15.49:0/1223409661 learned_addr learned my addr 172.21.15.49:0/1223409661 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:21.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f525e000700 1 --1- 172.21.15.49:0/1223409661 >> v1:172.21.15.110:6789/0 conn(0x7f52600bc7b0 0x7f526014d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:41300/0 (socket says 172.21.15.49:41300) 2024-01-22T05:08:21.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f525f400700 1 -- 172.21.15.49:0/1223409661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52600bc3d0 msgr2=0x7f52601576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:21.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f525f400700 1 --2- 172.21.15.49:0/1223409661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52600bc3d0 0x7f52601576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f525f400700 1 -- 172.21.15.49:0/1223409661 >> v1:172.21.15.110:6789/0 conn(0x7f52600bc7b0 legacy=0x7f526014d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:21.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f525d600700 1 -- 172.21.15.49:0/1223409661 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165914573 0 0) 0x7f5260067a90 con 0x7f52600bc7b0 2024-01-22T05:08:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f525f400700 1 -- 172.21.15.49:0/1223409661 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5260157fe0 con 0x7f5260157bc0 2024-01-22T05:08:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f525f400700 1 --2- 172.21.15.49:0/1223409661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5260157bc0 0x7f526014df30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f5258009f20 tx=0x7f5258009840).ready entity=mon.1 client_cookie=f6d00c804e8d2df3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f525d600700 1 -- 172.21.15.49:0/1223409661 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525800e070 con 0x7f5260157bc0 2024-01-22T05:08:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f525d600700 1 -- 172.21.15.49:0/1223409661 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525800b9d0 con 0x7f5260157bc0 2024-01-22T05:08:21.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f525d600700 1 -- 172.21.15.49:0/1223409661 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525800bd50 con 0x7f5260157bc0 2024-01-22T05:08:21.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f5265600700 1 -- 172.21.15.49:0/1223409661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5260157bc0 msgr2=0x7f526014df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:21.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.220+0000 7f5265600700 1 --2- 172.21.15.49:0/1223409661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5260157bc0 0x7f526014df30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f5258009f20 tx=0x7f5258009840).stop 2024-01-22T05:08:21.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.224+0000 7f5265600700 1 -- 172.21.15.49:0/1223409661 shutdown_connections 2024-01-22T05:08:21.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.224+0000 7f5265600700 1 --2- 172.21.15.49:0/1223409661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5260157bc0 0x7f526014df30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.224+0000 7f5265600700 1 --2- 172.21.15.49:0/1223409661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52600bc3d0 0x7f52601576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.224+0000 7f5265600700 1 -- 172.21.15.49:0/1223409661 >> 172.21.15.49:0/1223409661 conn(0x7f52600c6560 msgr2=0x7f52600c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:21.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.224+0000 7f5265600700 1 -- 172.21.15.49:0/1223409661 shutdown_connections 2024-01-22T05:08:21.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.224+0000 7f5265600700 1 -- 172.21.15.49:0/1223409661 wait complete. 2024-01-22T05:08:21.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.224+0000 7f5265600700 1 Processor -- start 2024-01-22T05:08:21.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f5265600700 1 -- start start 2024-01-22T05:08:21.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f5265600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52600bc3d0 0x7f5260163650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f5265600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52600bc7b0 0x7f5260167560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f5265600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5260157bc0 0x7f5260167a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f5265600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5260167f40 con 0x7f52600bc3d0 2024-01-22T05:08:21.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f5265600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52601423d0 con 0x7f52600bc7b0 2024-01-22T05:08:21.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f5265600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52601417c0 con 0x7f5260157bc0 2024-01-22T05:08:21.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f525ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52600bc3d0 0x7f5260163650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f525ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52600bc3d0 0x7f5260163650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35680/0 (socket says 172.21.15.49:35680) 2024-01-22T05:08:21.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f525ea00700 1 -- 172.21.15.49:0/1738614393 learned_addr learned my addr 172.21.15.49:0/1738614393 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:21.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f525f400700 1 --2- 172.21.15.49:0/1738614393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5260157bc0 0x7f5260167a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f525e000700 1 --2- 172.21.15.49:0/1738614393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52600bc7b0 0x7f5260167560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f525ea00700 1 -- 172.21.15.49:0/1738614393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5260157bc0 msgr2=0x7f5260167a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:21.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f525ea00700 1 --2- 172.21.15.49:0/1738614393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5260157bc0 0x7f5260167a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f525ea00700 1 -- 172.21.15.49:0/1738614393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52600bc7b0 msgr2=0x7f5260167560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:21.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f525ea00700 1 --2- 172.21.15.49:0/1738614393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52600bc7b0 0x7f5260167560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f525ea00700 1 -- 172.21.15.49:0/1738614393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5258009ae0 con 0x7f52600bc3d0 2024-01-22T05:08:21.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f525f400700 1 --2- 172.21.15.49:0/1738614393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5260157bc0 0x7f5260167a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:21.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.228+0000 7f525ea00700 1 --2- 172.21.15.49:0/1738614393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52600bc3d0 0x7f5260163650 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f525000e930 tx=0x7f5250009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:21.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.232+0000 7f5256000700 1 -- 172.21.15.49:0/1738614393 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250012600 con 0x7f52600bc3d0 2024-01-22T05:08:21.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.232+0000 7f5256000700 1 -- 172.21.15.49:0/1738614393 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5250012760 con 0x7f52600bc3d0 2024-01-22T05:08:21.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.232+0000 7f5265600700 1 -- 172.21.15.49:0/1738614393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5260141aa0 con 0x7f52600bc3d0 2024-01-22T05:08:21.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.232+0000 7f5256000700 1 -- 172.21.15.49:0/1738614393 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250012ae0 con 0x7f52600bc3d0 2024-01-22T05:08:21.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.232+0000 7f5265600700 1 -- 172.21.15.49:0/1738614393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5260142060 con 0x7f52600bc3d0 2024-01-22T05:08:21.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.236+0000 7f5256000700 1 -- 172.21.15.49:0/1738614393 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f525001b400 con 0x7f52600bc3d0 2024-01-22T05:08:21.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.236+0000 7f5256000700 1 --2- 172.21.15.49:0/1738614393 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f523805a4e0 0x7f523805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.236+0000 7f5256000700 1 -- 172.21.15.49:0/1738614393 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f5250074c80 con 0x7f52600bc3d0 2024-01-22T05:08:21.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.236+0000 7f525e000700 1 --2- 172.21.15.49:0/1738614393 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f523805a4e0 0x7f523805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.236+0000 7f525e000700 1 --2- 172.21.15.49:0/1738614393 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f523805a4e0 0x7f523805c9a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f52600bf350 tx=0x7f5248007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:21.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f526fa03740 1 Processor -- start 2024-01-22T05:08:21.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f526fa03740 1 -- start start 2024-01-22T05:08:21.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f526fa03740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x212d4d0 0x212d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f526fa03740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134570 0x21349f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f526fa03740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2134ee0 0x21134f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f526fa03740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2045540 con 0x2134570 2024-01-22T05:08:21.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f526fa03740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2008e90 con 0x212d4d0 2024-01-22T05:08:21.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f526fa03740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x200ed90 con 0x2134ee0 2024-01-22T05:08:21.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f525e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134570 0x21349f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f525e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134570 0x21349f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35688/0 (socket says 172.21.15.49:35688) 2024-01-22T05:08:21.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f525e000700 1 -- 172.21.15.49:0/3954156131 learned_addr learned my addr 172.21.15.49:0/3954156131 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:21.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f525ea00700 1 --2- 172.21.15.49:0/3954156131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x212d4d0 0x212d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f525f400700 1 --2- 172.21.15.49:0/3954156131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2134ee0 0x21134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f525e000700 1 -- 172.21.15.49:0/3954156131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2134ee0 msgr2=0x21134f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:21.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f525e000700 1 --2- 172.21.15.49:0/3954156131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2134ee0 0x21134f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f525e000700 1 -- 172.21.15.49:0/3954156131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x212d4d0 msgr2=0x212d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:21.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f525e000700 1 --2- 172.21.15.49:0/3954156131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x212d4d0 0x212d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f525e000700 1 -- 172.21.15.49:0/3954156131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x20734c0 con 0x2134570 2024-01-22T05:08:21.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.240+0000 7f525f400700 1 --2- 172.21.15.49:0/3954156131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2134ee0 0x21134f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:21.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.244+0000 7f525e000700 1 --2- 172.21.15.49:0/3954156131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134570 0x21349f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f5260060200 tx=0x7f524800a000).ready entity=mon.0 client_cookie=bd6f7f40d05bdb4b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:21.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.244+0000 7f524e600700 1 -- 172.21.15.49:0/3954156131 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524801c070 con 0x2134570 2024-01-22T05:08:21.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.244+0000 7f524e600700 1 -- 172.21.15.49:0/3954156131 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5248016480 con 0x2134570 2024-01-22T05:08:21.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.244+0000 7f524e600700 1 -- 172.21.15.49:0/3954156131 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248016800 con 0x2134570 2024-01-22T05:08:21.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.244+0000 7f526fa03740 1 -- 172.21.15.49:0/3954156131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134570 msgr2=0x21349f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:21.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.244+0000 7f526fa03740 1 --2- 172.21.15.49:0/3954156131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134570 0x21349f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f5260060200 tx=0x7f524800a000).stop 2024-01-22T05:08:21.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.244+0000 7f526fa03740 1 -- 172.21.15.49:0/3954156131 shutdown_connections 2024-01-22T05:08:21.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.244+0000 7f526fa03740 1 --2- 172.21.15.49:0/3954156131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2134ee0 0x21134f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.244+0000 7f526fa03740 1 --2- 172.21.15.49:0/3954156131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134570 0x21349f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.244+0000 7f526fa03740 1 --2- 172.21.15.49:0/3954156131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x212d4d0 0x212d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.244+0000 7f526fa03740 1 -- 172.21.15.49:0/3954156131 >> 172.21.15.49:0/3954156131 conn(0x1ec7680 msgr2=0x20e6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:21.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.244+0000 7f526fa03740 1 -- 172.21.15.49:0/3954156131 shutdown_connections 2024-01-22T05:08:21.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.244+0000 7f526fa03740 1 -- 172.21.15.49:0/3954156131 wait complete. 2024-01-22T05:08:21.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.244+0000 7f526fa03740 1 -- start start 2024-01-22T05:08:21.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.248+0000 7f526fa03740 1 Processor -- start 2024-01-22T05:08:21.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.248+0000 7f526fa03740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x212d4d0 0x21289f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.248+0000 7f526fa03740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134570 0x213df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.248+0000 7f526fa03740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2134ee0 0x21114c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.248+0000 7f526fa03740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x213e940 con 0x2134570 2024-01-22T05:08:21.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.248+0000 7f526fa03740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x213acf0 con 0x2134ee0 2024-01-22T05:08:21.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.248+0000 7f526fa03740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2111cc0 con 0x212d4d0 2024-01-22T05:08:21.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.248+0000 7f526fa03740 10 client.0 ll_register_callbacks cb 0x209f5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f525e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134570 0x213df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f525e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134570 0x213df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35690/0 (socket says 172.21.15.49:35690) 2024-01-22T05:08:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f525ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x212d4d0 0x21289f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f525f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2134ee0 0x21114c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f525e000700 1 -- 172.21.15.49:0/2901894062 learned_addr learned my addr 172.21.15.49:0/2901894062 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f525f400700 1 -- 172.21.15.49:0/2901894062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x212d4d0 msgr2=0x21289f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f525f400700 1 --2- 172.21.15.49:0/2901894062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x212d4d0 0x21289f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f525f400700 1 -- 172.21.15.49:0/2901894062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134570 msgr2=0x213df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f525f400700 1 --2- 172.21.15.49:0/2901894062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134570 0x213df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f525f400700 1 -- 172.21.15.49:0/2901894062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5248001370 con 0x2134ee0 2024-01-22T05:08:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f525e000700 1 --2- 172.21.15.49:0/2901894062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134570 0x213df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:21.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f525f400700 1 --2- 172.21.15.49:0/2901894062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2134ee0 0x21114c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f526005f4c0 tx=0x7f5260067eb0).ready entity=mon.1 client_cookie=706e06914d2c1621 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:21.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f5246a00700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-01-22T05:08:21.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f5246a00700 1 -- 172.21.15.49:0/2901894062 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52580092e0 con 0x2134ee0 2024-01-22T05:08:21.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f526fa03740 1 -- 172.21.15.49:0/2901894062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x205f230 con 0x2134ee0 2024-01-22T05:08:21.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f5246a00700 1 -- 172.21.15.49:0/2901894062 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f5258021660 con 0x2134ee0 2024-01-22T05:08:21.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f5246a00700 1 -- 172.21.15.49:0/2901894062 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5258021a30 con 0x2134ee0 2024-01-22T05:08:21.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f526fa03740 10 client.5887 fetch_fsmap learned FSMap version 43 2024-01-22T05:08:21.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f526fa03740 1 -- 172.21.15.49:0/2901894062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x20627c0 con 0x2134ee0 2024-01-22T05:08:21.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f5246a00700 1 -- 172.21.15.49:0/2901894062 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x205f230 con 0x2134ee0 2024-01-22T05:08:21.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f5246a00700 1 -- 172.21.15.49:0/2901894062 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5258021b90 con 0x2134ee0 2024-01-22T05:08:21.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f526fa03740 10 client.5887 fetch_fsmap finished waiting for FSMap version 43 2024-01-22T05:08:21.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f526fa03740 10 client.5887 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:21.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f526fa03740 20 client.5887 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:21.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f526fa03740 1 --2- 172.21.15.49:0/2901894062 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x21129d0 0x20e59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f526fa03740 4 client.5887 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:21.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f526fa03740 1 -- 172.21.15.49:0/2901894062 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2055780 con 0x21129d0 2024-01-22T05:08:21.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.252+0000 7f525ea00700 1 --2- 172.21.15.49:0/2901894062 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x21129d0 0x20e59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f525ea00700 1 --2- 172.21.15.49:0/2901894062 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x21129d0 0x20e59c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1e0429c3ce93bf19 server_cookie=ecb9baee785bd966 in_seq=0 out_seq=0 2024-01-22T05:08:21.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f5246a00700 10 client.5887 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:21.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f5246a00700 1 -- 172.21.15.49:0/2901894062 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2055780 con 0x21129d0 2024-01-22T05:08:21.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f5246a00700 10 client.5887 handle_command_reply: tid=0 2024-01-22T05:08:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f526fa03740 1 client.5887 shutdown 2024-01-22T05:08:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f526fa03740 1 -- 172.21.15.49:0/2901894062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2134ee0 msgr2=0x21114c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f526fa03740 1 --2- 172.21.15.49:0/2901894062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2134ee0 0x21114c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f526005f4c0 tx=0x7f5260067eb0).stop 2024-01-22T05:08:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f526fa03740 1 -- 172.21.15.49:0/2901894062 shutdown_connections 2024-01-22T05:08:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f526fa03740 1 --2- 172.21.15.49:0/2901894062 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x21129d0 0x20e59c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f526fa03740 1 --2- 172.21.15.49:0/2901894062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2134ee0 0x21114c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f526fa03740 1 --2- 172.21.15.49:0/2901894062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134570 0x213df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f526fa03740 1 --2- 172.21.15.49:0/2901894062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x212d4d0 0x21289f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f5246a00700 0 client.5887 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f526fa03740 1 -- 172.21.15.49:0/2901894062 >> 172.21.15.49:0/2901894062 conn(0x1ec7680 msgr2=0x212d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f526fa03740 1 -- 172.21.15.49:0/2901894062 shutdown_connections 2024-01-22T05:08:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.256+0000 7f526fa03740 1 -- 172.21.15.49:0/2901894062 wait complete. 2024-01-22T05:08:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.260+0000 7f526fa03740 20 client.5887 trim_cache size 0 max 16384 2024-01-22T05:08:21.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.280+0000 7f526fa03740 1 Processor -- start 2024-01-22T05:08:21.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f526fa03740 1 -- start start 2024-01-22T05:08:21.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f526fa03740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x212d4d0 0x20ddd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f526fa03740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2134570 0x212faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f526fa03740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134ee0 0x212ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f526fa03740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x20dd320 con 0x2134ee0 2024-01-22T05:08:21.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f526fa03740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x20ab040 con 0x212d4d0 2024-01-22T05:08:21.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f526fa03740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x210d940 con 0x2134570 2024-01-22T05:08:21.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f525f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134ee0 0x212ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f525f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134ee0 0x212ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35700/0 (socket says 172.21.15.49:35700) 2024-01-22T05:08:21.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f525f400700 1 -- 172.21.15.49:0/2538654417 learned_addr learned my addr 172.21.15.49:0/2538654417 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:21.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f525ea00700 1 --2- 172.21.15.49:0/2538654417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x212d4d0 0x20ddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f525e000700 1 --2- 172.21.15.49:0/2538654417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2134570 0x212faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f525f400700 1 -- 172.21.15.49:0/2538654417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2134570 msgr2=0x212faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:21.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f525f400700 1 --2- 172.21.15.49:0/2538654417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2134570 0x212faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f525f400700 1 -- 172.21.15.49:0/2538654417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x212d4d0 msgr2=0x20ddd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:21.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f525f400700 1 --2- 172.21.15.49:0/2538654417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x212d4d0 0x20ddd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f525f400700 1 -- 172.21.15.49:0/2538654417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5260068560 con 0x2134ee0 2024-01-22T05:08:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f525f400700 1 --2- 172.21.15.49:0/2538654417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134ee0 0x212ef00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f525800b9a0 tx=0x7f5258022000).ready entity=mon.0 client_cookie=77a5426026be545e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f524f000700 1 -- 172.21.15.49:0/2538654417 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258038070 con 0x2134ee0 2024-01-22T05:08:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f524f000700 1 -- 172.21.15.49:0/2538654417 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5258013e50 con 0x2134ee0 2024-01-22T05:08:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.284+0000 7f524f000700 1 -- 172.21.15.49:0/2538654417 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258021660 con 0x2134ee0 2024-01-22T05:08:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.288+0000 7f526fa03740 1 -- 172.21.15.49:0/2538654417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134ee0 msgr2=0x212ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.288+0000 7f526fa03740 1 --2- 172.21.15.49:0/2538654417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134ee0 0x212ef00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f525800b9a0 tx=0x7f5258022000).stop 2024-01-22T05:08:21.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.288+0000 7f526fa03740 1 -- 172.21.15.49:0/2538654417 shutdown_connections 2024-01-22T05:08:21.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.288+0000 7f526fa03740 1 --2- 172.21.15.49:0/2538654417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134ee0 0x212ef00 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.288+0000 7f526fa03740 1 --2- 172.21.15.49:0/2538654417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2134570 0x212faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.288+0000 7f526fa03740 1 --2- 172.21.15.49:0/2538654417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x212d4d0 0x20ddd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.288+0000 7f526fa03740 1 -- 172.21.15.49:0/2538654417 >> 172.21.15.49:0/2538654417 conn(0x1ec7680 msgr2=0x210f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:21.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.288+0000 7f526fa03740 1 -- 172.21.15.49:0/2538654417 shutdown_connections 2024-01-22T05:08:21.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.288+0000 7f526fa03740 1 -- 172.21.15.49:0/2538654417 wait complete. 2024-01-22T05:08:21.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.288+0000 7f526fa03740 1 -- start start 2024-01-22T05:08:21.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.288+0000 7f526fa03740 1 Processor -- start 2024-01-22T05:08:21.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x212d4d0 0x218b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2134570 0x21321c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134ee0 0x212fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2132c80 con 0x2134ee0 2024-01-22T05:08:21.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x213a270 con 0x2134570 2024-01-22T05:08:21.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x210e510 con 0x212d4d0 2024-01-22T05:08:21.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 10 client.0 ll_register_callbacks cb 0x7f5250006e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:21.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f525f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134ee0 0x212fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f525f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134ee0 0x212fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35708/0 (socket says 172.21.15.49:35708) 2024-01-22T05:08:21.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f525f400700 1 -- 172.21.15.49:0/403552119 learned_addr learned my addr 172.21.15.49:0/403552119 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:21.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f525ea00700 1 --2- 172.21.15.49:0/403552119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x212d4d0 0x218b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f525e000700 1 --2- 172.21.15.49:0/403552119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2134570 0x21321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f525f400700 1 -- 172.21.15.49:0/403552119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x212d4d0 msgr2=0x218b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:21.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f525f400700 1 --2- 172.21.15.49:0/403552119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x212d4d0 0x218b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f525f400700 1 -- 172.21.15.49:0/403552119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2134570 msgr2=0x21321c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:21.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f525f400700 1 --2- 172.21.15.49:0/403552119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2134570 0x21321c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f525f400700 1 -- 172.21.15.49:0/403552119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x20627c0 con 0x2134ee0 2024-01-22T05:08:21.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f525f400700 1 --2- 172.21.15.49:0/403552119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134ee0 0x212fbd0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f525800b9a0 tx=0x7f5258038000).ready entity=mon.0 client_cookie=b028ba17c302d4d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:21.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f5246a00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:21.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f5246a00700 1 -- 172.21.15.49:0/403552119 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258021450 con 0x2134ee0 2024-01-22T05:08:21.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 1 -- 172.21.15.49:0/403552119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5248016480 con 0x2134ee0 2024-01-22T05:08:21.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f5246a00700 1 -- 172.21.15.49:0/403552119 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f52580215b0 con 0x2134ee0 2024-01-22T05:08:21.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f5246a00700 1 -- 172.21.15.49:0/403552119 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f525802a600 con 0x2134ee0 2024-01-22T05:08:21.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 10 client.5895 fetch_fsmap learned FSMap version 43 2024-01-22T05:08:21.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 1 -- 172.21.15.49:0/403552119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x205d9f0 con 0x2134ee0 2024-01-22T05:08:21.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f5246a00700 1 -- 172.21.15.49:0/403552119 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5248016480 con 0x2134ee0 2024-01-22T05:08:21.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f5246a00700 1 -- 172.21.15.49:0/403552119 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f525802a760 con 0x2134ee0 2024-01-22T05:08:21.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 10 client.5895 fetch_fsmap finished waiting for FSMap version 43 2024-01-22T05:08:21.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 10 client.5895 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:21.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 20 client.5895 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:21.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 1 --2- 172.21.15.49:0/403552119 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x21395a0 0x21399b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:21.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 4 client.5895 mds_command: new command op to 5569 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:08:21.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.292+0000 7f526fa03740 1 -- 172.21.15.49:0/403552119 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1f1e610 con 0x21395a0 2024-01-22T05:08:21.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f525ea00700 1 --2- 172.21.15.49:0/403552119 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x21395a0 0x21399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:21.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f525ea00700 1 --2- 172.21.15.49:0/403552119 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x21395a0 0x21399b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4a2b5d26a134f34e server_cookie=4a56663e334c9ac5 in_seq=0 out_seq=0 2024-01-22T05:08:21.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f5246a00700 10 client.5895 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:21.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f5246a00700 1 -- 172.21.15.49:0/403552119 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+903 (crc 0 0 0) 0x1f1e610 con 0x21395a0 2024-01-22T05:08:21.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f5246a00700 10 client.5895 handle_command_reply: tid=0 2024-01-22T05:08:21.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f526fa03740 1 client.5895 shutdown 2024-01-22T05:08:21.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f526fa03740 1 -- 172.21.15.49:0/403552119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134ee0 msgr2=0x212fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:21.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f526fa03740 1 --2- 172.21.15.49:0/403552119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134ee0 0x212fbd0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f525800b9a0 tx=0x7f5258038000).stop 2024-01-22T05:08:21.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f526fa03740 1 -- 172.21.15.49:0/403552119 shutdown_connections 2024-01-22T05:08:21.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f526fa03740 1 --2- 172.21.15.49:0/403552119 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x21395a0 0x21399b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f526fa03740 1 --2- 172.21.15.49:0/403552119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2134ee0 0x212fbd0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f5246a00700 0 client.5895 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:21.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f526fa03740 1 --2- 172.21.15.49:0/403552119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2134570 0x21321c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f526fa03740 1 --2- 172.21.15.49:0/403552119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x212d4d0 0x218b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f526fa03740 1 -- 172.21.15.49:0/403552119 >> 172.21.15.49:0/403552119 conn(0x1ec7680 msgr2=0x212e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:21.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f526fa03740 1 -- 172.21.15.49:0/403552119 shutdown_connections 2024-01-22T05:08:21.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f526fa03740 1 -- 172.21.15.49:0/403552119 wait complete. 2024-01-22T05:08:21.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.296+0000 7f526fa03740 20 client.5895 trim_cache size 0 max 16384 2024-01-22T05:08:21.301 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:21.301 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-01-22T05:08:21.301 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-01-22T05:08:21.302 INFO:teuthology.orchestra.run.smithi049.stdout: "1d1be5b8-58b4-4895-a860-edda6ca62310": { 2024-01-22T05:08:21.302 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-01-22T05:08:21.302 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "1d1be5b8-58b4-4895-a860-edda6ca62310", 2024-01-22T05:08:21.302 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "" 2024-01-22T05:08:21.302 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:21.302 INFO:teuthology.orchestra.run.smithi049.stdout: "2efb8e1e-cdfd-425d-b744-2775c09e95ac": { 2024-01-22T05:08:21.302 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-01-22T05:08:21.302 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "2efb8e1e-cdfd-425d-b744-2775c09e95ac", 2024-01-22T05:08:21.302 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "" 2024-01-22T05:08:21.302 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:21.302 INFO:teuthology.orchestra.run.smithi049.stdout: "acd8d522-5895-41fe-87b4-3e53a92455c2": { 2024-01-22T05:08:21.302 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-01-22T05:08:21.302 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "acd8d522-5895-41fe-87b4-3e53a92455c2", 2024-01-22T05:08:21.303 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "" 2024-01-22T05:08:21.303 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:21.303 INFO:teuthology.orchestra.run.smithi049.stdout: "d59cc613-856c-42e8-83cf-d5d0485c945e": { 2024-01-22T05:08:21.303 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-01-22T05:08:21.303 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "d59cc613-856c-42e8-83cf-d5d0485c945e", 2024-01-22T05:08:21.303 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "" 2024-01-22T05:08:21.303 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:21.303 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:21.303 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.300+0000 7f5265600700 1 -- 172.21.15.49:0/1738614393 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f523805a4e0 msgr2=0x7f523805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.300+0000 7f5265600700 1 --2- 172.21.15.49:0/1738614393 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f523805a4e0 0x7f523805c9a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f52600bf350 tx=0x7f5248007bb0).stop 2024-01-22T05:08:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.300+0000 7f5265600700 1 -- 172.21.15.49:0/1738614393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52600bc3d0 msgr2=0x7f5260163650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.300+0000 7f5265600700 1 --2- 172.21.15.49:0/1738614393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52600bc3d0 0x7f5260163650 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f525000e930 tx=0x7f5250009060).stop 2024-01-22T05:08:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.300+0000 7f5265600700 1 -- 172.21.15.49:0/1738614393 shutdown_connections 2024-01-22T05:08:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.300+0000 7f5265600700 1 --2- 172.21.15.49:0/1738614393 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f523805a4e0 0x7f523805c9a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.300+0000 7f5265600700 1 --2- 172.21.15.49:0/1738614393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5260157bc0 0x7f5260167a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.300+0000 7f5265600700 1 --2- 172.21.15.49:0/1738614393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52600bc7b0 0x7f5260167560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.300+0000 7f5265600700 1 --2- 172.21.15.49:0/1738614393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52600bc3d0 0x7f5260163650 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:21.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.300+0000 7f5265600700 1 -- 172.21.15.49:0/1738614393 >> 172.21.15.49:0/1738614393 conn(0x7f52600c6560 msgr2=0x7f52601562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:21.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.300+0000 7f5265600700 1 -- 172.21.15.49:0/1738614393 shutdown_connections 2024-01-22T05:08:21.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:21.300+0000 7f5265600700 1 -- 172.21.15.49:0/1738614393 wait complete. 2024-01-22T05:08:22.134 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:08:22.132+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-22T05:08:26.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2024-01-22T05:08:26.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.496+0000 7f94e5e00700 1 Processor -- start 2024-01-22T05:08:26.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.496+0000 7f94e5e00700 1 -- start start 2024-01-22T05:08:26.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.496+0000 7f94e5e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f94e0139550 0x7f94e01399e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.496+0000 7f94e5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e00c1730 0x7f94e00c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.496+0000 7f94e5e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e00648d0 con 0x7f94e0154660 2024-01-22T05:08:26.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.496+0000 7f94e5e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e0139ed0 con 0x7f94e0139550 2024-01-22T05:08:26.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.496+0000 7f94e5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0063d50 con 0x7f94e00c1730 2024-01-22T05:08:26.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.496+0000 7f94de000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f94e0139550 0x7f94e01399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.496+0000 7f94dea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f94e0154660 0x7f94e0068c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60032/0 (socket says 172.21.15.49:60032) 2024-01-22T05:08:26.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.496+0000 7f94dea00700 1 -- 172.21.15.49:0/2526527889 learned_addr learned my addr 172.21.15.49:0/2526527889 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:26.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.496+0000 7f94df400700 1 --2- 172.21.15.49:0/2526527889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e00c1730 0x7f94e00c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94dd600700 1 -- 172.21.15.49:0/2526527889 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872146680 0 0) 0x7f94e00648d0 con 0x7f94e0154660 2024-01-22T05:08:26.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94dd600700 1 -- 172.21.15.49:0/2526527889 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c00033f0 con 0x7f94e0154660 2024-01-22T05:08:26.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94de000700 1 -- 172.21.15.49:0/2526527889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e00c1730 msgr2=0x7f94e00c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94de000700 1 --2- 172.21.15.49:0/2526527889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e00c1730 0x7f94e00c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94de000700 1 -- 172.21.15.49:0/2526527889 >> v1:172.21.15.49:6789/0 conn(0x7f94e0154660 legacy=0x7f94e0068c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94dd600700 1 -- 172.21.15.49:0/2526527889 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 159174544 0 0) 0x7f94c00033f0 con 0x7f94e0154660 2024-01-22T05:08:26.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94de000700 1 -- 172.21.15.49:0/2526527889 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e0064030 con 0x7f94e0139550 2024-01-22T05:08:26.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94de000700 1 --2- 172.21.15.49:0/2526527889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e0139550 0x7f94e01399e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f94c8009790 tx=0x7f94c8009060).ready entity=mon.0 client_cookie=70d94f97d290582 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94dd600700 1 -- 172.21.15.49:0/2526527889 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0001470 con 0x7f94e0139550 2024-01-22T05:08:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94dd600700 1 -- 172.21.15.49:0/2526527889 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c8011400 con 0x7f94e0139550 2024-01-22T05:08:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94dd600700 1 -- 172.21.15.49:0/2526527889 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8011780 con 0x7f94e0139550 2024-01-22T05:08:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94e5e00700 1 -- 172.21.15.49:0/2526527889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e0139550 msgr2=0x7f94e01399e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94e5e00700 1 --2- 172.21.15.49:0/2526527889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e0139550 0x7f94e01399e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f94c8009790 tx=0x7f94c8009060).stop 2024-01-22T05:08:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94e5e00700 1 -- 172.21.15.49:0/2526527889 shutdown_connections 2024-01-22T05:08:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94e5e00700 1 --2- 172.21.15.49:0/2526527889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e00c1730 0x7f94e00c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94e5e00700 1 --2- 172.21.15.49:0/2526527889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e0139550 0x7f94e01399e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94e5e00700 1 -- 172.21.15.49:0/2526527889 >> 172.21.15.49:0/2526527889 conn(0x7f94e0065f30 msgr2=0x7f94e0066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:26.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94e5e00700 1 -- 172.21.15.49:0/2526527889 shutdown_connections 2024-01-22T05:08:26.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.500+0000 7f94e5e00700 1 -- 172.21.15.49:0/2526527889 wait complete. 2024-01-22T05:08:26.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.504+0000 7f94e5e00700 1 Processor -- start 2024-01-22T05:08:26.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.504+0000 7f94e5e00700 1 -- start start 2024-01-22T05:08:26.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94e5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e00c1730 0x7f94e01684a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94e5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e0139550 0x7f94e00a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94e5e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94e0154660 0x7f94e0153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94e5e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00a3e30 con 0x7f94e0139550 2024-01-22T05:08:26.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94e5e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00a9010 con 0x7f94e0154660 2024-01-22T05:08:26.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94e5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00a92f0 con 0x7f94e00c1730 2024-01-22T05:08:26.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94de000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e0139550 0x7f94e00a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94de000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e0139550 0x7f94e00a87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38660/0 (socket says 172.21.15.49:38660) 2024-01-22T05:08:26.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94de000700 1 -- 172.21.15.49:0/588674393 learned_addr learned my addr 172.21.15.49:0/588674393 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:26.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94df400700 1 --2- 172.21.15.49:0/588674393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94e0154660 0x7f94e0153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94dea00700 1 --2- 172.21.15.49:0/588674393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e00c1730 0x7f94e01684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94de000700 1 -- 172.21.15.49:0/588674393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e00c1730 msgr2=0x7f94e01684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94de000700 1 --2- 172.21.15.49:0/588674393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e00c1730 0x7f94e01684a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94de000700 1 -- 172.21.15.49:0/588674393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94e0154660 msgr2=0x7f94e0153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94de000700 1 --2- 172.21.15.49:0/588674393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94e0154660 0x7f94e0153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94de000700 1 -- 172.21.15.49:0/588674393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c80092a0 con 0x7f94e0139550 2024-01-22T05:08:26.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94df400700 1 --2- 172.21.15.49:0/588674393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94e0154660 0x7f94e0153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:26.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94de000700 1 --2- 172.21.15.49:0/588674393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e0139550 0x7f94e00a87c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f94c8009d80 tx=0x7f94c8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:26.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94d6000700 1 -- 172.21.15.49:0/588674393 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c80107c0 con 0x7f94e0139550 2024-01-22T05:08:26.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94d6000700 1 -- 172.21.15.49:0/588674393 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c8010920 con 0x7f94e0139550 2024-01-22T05:08:26.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94d6000700 1 -- 172.21.15.49:0/588674393 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8010ce0 con 0x7f94e0139550 2024-01-22T05:08:26.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.508+0000 7f94e5e00700 1 -- 172.21.15.49:0/588674393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e00a95d0 con 0x7f94e0139550 2024-01-22T05:08:26.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.512+0000 7f94e5e00700 1 -- 172.21.15.49:0/588674393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e00a8cb0 con 0x7f94e0139550 2024-01-22T05:08:26.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.512+0000 7f94d6000700 1 -- 172.21.15.49:0/588674393 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f94c801d640 con 0x7f94e0139550 2024-01-22T05:08:26.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.516+0000 7f94d6000700 1 --2- 172.21.15.49:0/588674393 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f94b805a510 0x7f94b805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.516+0000 7f94d6000700 1 -- 172.21.15.49:0/588674393 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f94c8075e40 con 0x7f94e0139550 2024-01-22T05:08:26.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.516+0000 7f94dea00700 1 --2- 172.21.15.49:0/588674393 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f94b805a510 0x7f94b805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.516+0000 7f94dea00700 1 --2- 172.21.15.49:0/588674393 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f94b805a510 0x7f94b805c9d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f94d00011e0 tx=0x7f94d0001560).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:26.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.516+0000 7f94f03a5740 1 Processor -- start 2024-01-22T05:08:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94f03a5740 1 -- start start 2024-01-22T05:08:26.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94f03a5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe264d0 0xe268b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94f03a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe2d570 0xe2d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94f03a5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 0xe0c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94f03a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xd3e540 con 0xe2d570 2024-01-22T05:08:26.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94f03a5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xd01e90 con 0xe264d0 2024-01-22T05:08:26.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94f03a5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xd07d90 con 0xe2dee0 2024-01-22T05:08:26.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94de000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe2d570 0xe2d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94de000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe2d570 0xe2d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38672/0 (socket says 172.21.15.49:38672) 2024-01-22T05:08:26.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94df400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 0xe0c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94de000700 1 -- 172.21.15.49:0/800449111 learned_addr learned my addr 172.21.15.49:0/800449111 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:26.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94dea00700 1 --2- 172.21.15.49:0/800449111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe264d0 0xe268b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94de000700 1 -- 172.21.15.49:0/800449111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 msgr2=0xe0c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94de000700 1 --2- 172.21.15.49:0/800449111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 0xe0c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94de000700 1 -- 172.21.15.49:0/800449111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe264d0 msgr2=0xe268b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94de000700 1 --2- 172.21.15.49:0/800449111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe264d0 0xe268b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94de000700 1 -- 172.21.15.49:0/800449111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd6c4c0 con 0xe2d570 2024-01-22T05:08:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94de000700 1 --2- 172.21.15.49:0/800449111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe2d570 0xe2d9f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f94c804cc20 tx=0x7f94c800e000).ready entity=mon.0 client_cookie=2ab55634a38877c8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94cea00700 1 -- 172.21.15.49:0/800449111 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c804d080 con 0xe2d570 2024-01-22T05:08:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94cea00700 1 -- 172.21.15.49:0/800449111 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c8052820 con 0xe2d570 2024-01-22T05:08:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.520+0000 7f94cea00700 1 -- 172.21.15.49:0/800449111 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8018e00 con 0xe2d570 2024-01-22T05:08:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.524+0000 7f94f03a5740 1 -- 172.21.15.49:0/800449111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe2d570 msgr2=0xe2d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.524+0000 7f94f03a5740 1 --2- 172.21.15.49:0/800449111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe2d570 0xe2d9f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f94c804cc20 tx=0x7f94c800e000).stop 2024-01-22T05:08:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.524+0000 7f94f03a5740 1 -- 172.21.15.49:0/800449111 shutdown_connections 2024-01-22T05:08:26.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.524+0000 7f94f03a5740 1 --2- 172.21.15.49:0/800449111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 0xe0c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.524+0000 7f94f03a5740 1 --2- 172.21.15.49:0/800449111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe2d570 0xe2d9f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.524+0000 7f94f03a5740 1 --2- 172.21.15.49:0/800449111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe264d0 0xe268b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.524+0000 7f94f03a5740 1 -- 172.21.15.49:0/800449111 >> 172.21.15.49:0/800449111 conn(0xbc0680 msgr2=0xddfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:26.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.524+0000 7f94f03a5740 1 -- 172.21.15.49:0/800449111 shutdown_connections 2024-01-22T05:08:26.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.524+0000 7f94f03a5740 1 -- 172.21.15.49:0/800449111 wait complete. 2024-01-22T05:08:26.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.524+0000 7f94f03a5740 1 -- start start 2024-01-22T05:08:26.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.524+0000 7f94f03a5740 1 Processor -- start 2024-01-22T05:08:26.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94f03a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe264d0 0xe001b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94f03a5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 0xe04d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94f03a5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 0xe02f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94f03a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xe07f60 con 0xe264d0 2024-01-22T05:08:26.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94f03a5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xdde7a0 con 0xe2d570 2024-01-22T05:08:26.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94f03a5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xdddb90 con 0xe2dee0 2024-01-22T05:08:26.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94f03a5740 10 client.0 ll_register_callbacks cb 0xd985d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:26.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94dea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe264d0 0xe001b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94dea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe264d0 0xe001b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38686/0 (socket says 172.21.15.49:38686) 2024-01-22T05:08:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94dea00700 1 -- 172.21.15.49:0/1850765183 learned_addr learned my addr 172.21.15.49:0/1850765183 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94de000700 1 --2- 172.21.15.49:0/1850765183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 0xe04d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94df400700 1 --2- 172.21.15.49:0/1850765183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 0xe02f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94dea00700 1 -- 172.21.15.49:0/1850765183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 msgr2=0xe02f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94dea00700 1 --2- 172.21.15.49:0/1850765183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 0xe02f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94dea00700 1 -- 172.21.15.49:0/1850765183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 msgr2=0xe04d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94dea00700 1 --2- 172.21.15.49:0/1850765183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 0xe04d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94dea00700 1 -- 172.21.15.49:0/1850765183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e00a8cb0 con 0xe264d0 2024-01-22T05:08:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94df400700 1 --2- 172.21.15.49:0/1850765183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 0xe02f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94dea00700 1 --2- 172.21.15.49:0/1850765183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe264d0 0xe001b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f94d00167f0 tx=0x7f94d000a000).ready entity=mon.0 client_cookie=5505ec479ba040fa server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94c7400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94c7400700 1 -- 172.21.15.49:0/1850765183 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d001c030 con 0xe264d0 2024-01-22T05:08:26.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94c7400700 1 -- 172.21.15.49:0/1850765183 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f94d0016e30 con 0xe264d0 2024-01-22T05:08:26.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94f03a5740 1 -- 172.21.15.49:0/1850765183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xd58230 con 0xe264d0 2024-01-22T05:08:26.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94c7400700 1 -- 172.21.15.49:0/1850765183 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94d0020310 con 0xe264d0 2024-01-22T05:08:26.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94f03a5740 10 client.5910 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:26.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.528+0000 7f94f03a5740 1 -- 172.21.15.49:0/1850765183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0xd5b7c0 con 0xe264d0 2024-01-22T05:08:26.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94c7400700 1 -- 172.21.15.49:0/1850765183 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xd58230 con 0xe264d0 2024-01-22T05:08:26.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94c7400700 1 -- 172.21.15.49:0/1850765183 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f94d0020470 con 0xe264d0 2024-01-22T05:08:26.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94f03a5740 10 client.5910 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:26.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94f03a5740 10 client.5910 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:26.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94f03a5740 20 client.5910 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:26.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94f03a5740 1 --2- 172.21.15.49:0/1850765183 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xe01800 0xe01c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94f03a5740 4 client.5910 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:26.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94f03a5740 1 -- 172.21.15.49:0/1850765183 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xd4e780 con 0xe01800 2024-01-22T05:08:26.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94de000700 1 --2- 172.21.15.49:0/1850765183 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xe01800 0xe01c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94c7400700 10 client.5910 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:26.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94de000700 1 --2- 172.21.15.49:0/1850765183 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xe01800 0xe01c10 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=73cd2c3f76f507e2 server_cookie=5fdb24d5d93390c8 in_seq=0 out_seq=0 2024-01-22T05:08:26.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94c7400700 1 -- 172.21.15.49:0/1850765183 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xd4e780 con 0xe01800 2024-01-22T05:08:26.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94c7400700 10 client.5910 handle_command_reply: tid=0 2024-01-22T05:08:26.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94f03a5740 1 client.5910 shutdown 2024-01-22T05:08:26.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94f03a5740 1 -- 172.21.15.49:0/1850765183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe264d0 msgr2=0xe001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.532+0000 7f94f03a5740 1 --2- 172.21.15.49:0/1850765183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe264d0 0xe001b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f94d00167f0 tx=0x7f94d000a000).stop 2024-01-22T05:08:26.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.536+0000 7f94f03a5740 1 -- 172.21.15.49:0/1850765183 shutdown_connections 2024-01-22T05:08:26.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.536+0000 7f94f03a5740 1 --2- 172.21.15.49:0/1850765183 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xe01800 0xe01c10 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.536+0000 7f94f03a5740 1 --2- 172.21.15.49:0/1850765183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 0xe02f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.536+0000 7f94f03a5740 1 --2- 172.21.15.49:0/1850765183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 0xe04d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.536+0000 7f94f03a5740 1 --2- 172.21.15.49:0/1850765183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe264d0 0xe001b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.536+0000 7f94c7400700 0 client.5910 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.536+0000 7f94f03a5740 1 -- 172.21.15.49:0/1850765183 >> 172.21.15.49:0/1850765183 conn(0xbc0680 msgr2=0xe0b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.536+0000 7f94f03a5740 1 -- 172.21.15.49:0/1850765183 shutdown_connections 2024-01-22T05:08:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.536+0000 7f94f03a5740 1 -- 172.21.15.49:0/1850765183 wait complete. 2024-01-22T05:08:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.536+0000 7f94f03a5740 20 client.5910 trim_cache size 0 max 16384 2024-01-22T05:08:26.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94f03a5740 1 Processor -- start 2024-01-22T05:08:26.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94f03a5740 1 -- start start 2024-01-22T05:08:26.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94f03a5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe264d0 0xe00d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94f03a5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 0xde1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94f03a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe2dee0 0xe05b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94f03a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xde0c10 con 0xe2dee0 2024-01-22T05:08:26.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94f03a5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xe0a170 con 0xe2d570 2024-01-22T05:08:26.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94f03a5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xd19e00 con 0xe264d0 2024-01-22T05:08:26.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94df400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe2dee0 0xe05b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94df400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe2dee0 0xe05b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38702/0 (socket says 172.21.15.49:38702) 2024-01-22T05:08:26.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94df400700 1 -- 172.21.15.49:0/1829680586 learned_addr learned my addr 172.21.15.49:0/1829680586 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:26.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94de000700 1 --2- 172.21.15.49:0/1829680586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 0xde1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94dea00700 1 --2- 172.21.15.49:0/1829680586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe264d0 0xe00d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94df400700 1 -- 172.21.15.49:0/1829680586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe264d0 msgr2=0xe00d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94df400700 1 --2- 172.21.15.49:0/1829680586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe264d0 0xe00d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94df400700 1 -- 172.21.15.49:0/1829680586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 msgr2=0xde1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94df400700 1 --2- 172.21.15.49:0/1829680586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 0xde1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94df400700 1 -- 172.21.15.49:0/1829680586 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe00510 con 0xe2dee0 2024-01-22T05:08:26.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94de000700 1 --2- 172.21.15.49:0/1829680586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 0xde1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:26.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94dea00700 1 --2- 172.21.15.49:0/1829680586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe264d0 0xe00d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:26.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94df400700 1 --2- 172.21.15.49:0/1829680586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe2dee0 0xe05b40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f94d80078d0 tx=0x7f94d800b040).ready entity=mon.0 client_cookie=4c45f9915af0ed65 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:26.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94cf400700 1 -- 172.21.15.49:0/1829680586 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d800e040 con 0xe2dee0 2024-01-22T05:08:26.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94cf400700 1 -- 172.21.15.49:0/1829680586 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d80073f0 con 0xe2dee0 2024-01-22T05:08:26.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94cf400700 1 -- 172.21.15.49:0/1829680586 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8016960 con 0xe2dee0 2024-01-22T05:08:26.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94f03a5740 1 -- 172.21.15.49:0/1829680586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe2dee0 msgr2=0xe05b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.556+0000 7f94f03a5740 1 --2- 172.21.15.49:0/1829680586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe2dee0 0xe05b40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f94d80078d0 tx=0x7f94d800b040).stop 2024-01-22T05:08:26.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.560+0000 7f94f03a5740 1 -- 172.21.15.49:0/1829680586 shutdown_connections 2024-01-22T05:08:26.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.560+0000 7f94f03a5740 1 --2- 172.21.15.49:0/1829680586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe2dee0 0xe05b40 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.560+0000 7f94f03a5740 1 --2- 172.21.15.49:0/1829680586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 0xde1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.560+0000 7f94f03a5740 1 --2- 172.21.15.49:0/1829680586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe264d0 0xe00d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.560+0000 7f94f03a5740 1 -- 172.21.15.49:0/1829680586 >> 172.21.15.49:0/1829680586 conn(0xbc0680 msgr2=0xe02cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:26.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.560+0000 7f94f03a5740 1 -- 172.21.15.49:0/1829680586 shutdown_connections 2024-01-22T05:08:26.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.560+0000 7f94f03a5740 1 -- 172.21.15.49:0/1829680586 wait complete. 2024-01-22T05:08:26.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.560+0000 7f94f03a5740 1 -- start start 2024-01-22T05:08:26.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.560+0000 7f94f03a5740 1 Processor -- start 2024-01-22T05:08:26.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe264d0 0xe919b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 0xe91ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 0xe24970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xe22460 con 0xe264d0 2024-01-22T05:08:26.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xddf490 con 0xe2d570 2024-01-22T05:08:26.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xddf770 con 0xe2dee0 2024-01-22T05:08:26.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 10 client.0 ll_register_callbacks cb 0x7f94d000fcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:26.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94dea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe264d0 0xe919b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94dea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe264d0 0xe919b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38704/0 (socket says 172.21.15.49:38704) 2024-01-22T05:08:26.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94dea00700 1 -- 172.21.15.49:0/782644766 learned_addr learned my addr 172.21.15.49:0/782644766 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:26.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94df400700 1 --2- 172.21.15.49:0/782644766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 0xe24970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94de000700 1 --2- 172.21.15.49:0/782644766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 0xe91ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94dea00700 1 -- 172.21.15.49:0/782644766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 msgr2=0xe24970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94dea00700 1 --2- 172.21.15.49:0/782644766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 0xe24970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94dea00700 1 -- 172.21.15.49:0/782644766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 msgr2=0xe91ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94dea00700 1 --2- 172.21.15.49:0/782644766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 0xe91ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94dea00700 1 -- 172.21.15.49:0/782644766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d8007630 con 0xe264d0 2024-01-22T05:08:26.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94de000700 1 --2- 172.21.15.49:0/782644766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 0xe91ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:26.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94dea00700 1 --2- 172.21.15.49:0/782644766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe264d0 0xe919b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f94d0001b70 tx=0x7f94d0019000).ready entity=mon.0 client_cookie=5e2e09b348470f97 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:26.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94c7400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:26.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94c7400700 1 -- 172.21.15.49:0/782644766 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d001c040 con 0xe264d0 2024-01-22T05:08:26.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94c7400700 1 -- 172.21.15.49:0/782644766 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f94d0020520 con 0xe264d0 2024-01-22T05:08:26.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 1 -- 172.21.15.49:0/782644766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f94c8052820 con 0xe264d0 2024-01-22T05:08:26.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94c7400700 1 -- 172.21.15.49:0/782644766 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94d0020b50 con 0xe264d0 2024-01-22T05:08:26.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 10 client.5916 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:26.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 1 -- 172.21.15.49:0/782644766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x7f94e00c6590 con 0xe264d0 2024-01-22T05:08:26.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94c7400700 1 -- 172.21.15.49:0/782644766 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c8052820 con 0xe264d0 2024-01-22T05:08:26.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94c7400700 1 -- 172.21.15.49:0/782644766 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f94d0036330 con 0xe264d0 2024-01-22T05:08:26.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 10 client.5916 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:26.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 10 client.5916 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:26.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 20 client.5916 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:26.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 1 --2- 172.21.15.49:0/782644766 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xe24fc0 0xdfe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 4 client.5916 mds_command: new command op to 5569 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:08:26.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.564+0000 7f94f03a5740 1 -- 172.21.15.49:0/782644766 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xc17610 con 0xe24fc0 2024-01-22T05:08:26.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94de000700 1 --2- 172.21.15.49:0/782644766 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xe24fc0 0xdfe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94de000700 1 --2- 172.21.15.49:0/782644766 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xe24fc0 0xdfe6a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fd54e8d1adb298b2 server_cookie=f508c48c51208398 in_seq=0 out_seq=0 2024-01-22T05:08:26.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94c7400700 10 client.5916 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:26.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94c7400700 1 -- 172.21.15.49:0/782644766 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0xc17610 con 0xe24fc0 2024-01-22T05:08:26.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94c7400700 10 client.5916 handle_command_reply: tid=0 2024-01-22T05:08:26.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94f03a5740 1 client.5916 shutdown 2024-01-22T05:08:26.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94f03a5740 1 -- 172.21.15.49:0/782644766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe264d0 msgr2=0xe919b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94f03a5740 1 --2- 172.21.15.49:0/782644766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe264d0 0xe919b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f94d0001b70 tx=0x7f94d0019000).stop 2024-01-22T05:08:26.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94f03a5740 1 -- 172.21.15.49:0/782644766 shutdown_connections 2024-01-22T05:08:26.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94f03a5740 1 --2- 172.21.15.49:0/782644766 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xe24fc0 0xdfe6a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94f03a5740 1 --2- 172.21.15.49:0/782644766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xe2dee0 0xe24970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94f03a5740 1 --2- 172.21.15.49:0/782644766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xe2d570 0xe91ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94f03a5740 1 --2- 172.21.15.49:0/782644766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xe264d0 0xe919b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94f03a5740 1 -- 172.21.15.49:0/782644766 >> 172.21.15.49:0/782644766 conn(0xbc0680 msgr2=0xe25730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:26.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94c7400700 0 client.5916 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:26.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94f03a5740 1 -- 172.21.15.49:0/782644766 shutdown_connections 2024-01-22T05:08:26.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94f03a5740 1 -- 172.21.15.49:0/782644766 wait complete. 2024-01-22T05:08:26.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.568+0000 7f94f03a5740 20 client.5916 trim_cache size 0 max 16384 2024-01-22T05:08:26.573 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:26.573 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-01-22T05:08:26.573 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-01-22T05:08:26.573 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:26.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.572+0000 7f94e5e00700 1 -- 172.21.15.49:0/588674393 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f94b805a510 msgr2=0x7f94b805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.572+0000 7f94e5e00700 1 --2- 172.21.15.49:0/588674393 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f94b805a510 0x7f94b805c9d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f94d00011e0 tx=0x7f94d0001560).stop 2024-01-22T05:08:26.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.572+0000 7f94e5e00700 1 -- 172.21.15.49:0/588674393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e0139550 msgr2=0x7f94e00a87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.572+0000 7f94e5e00700 1 --2- 172.21.15.49:0/588674393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e0139550 0x7f94e00a87c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f94c8009d80 tx=0x7f94c8016000).stop 2024-01-22T05:08:26.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.572+0000 7f94e5e00700 1 -- 172.21.15.49:0/588674393 shutdown_connections 2024-01-22T05:08:26.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.572+0000 7f94e5e00700 1 --2- 172.21.15.49:0/588674393 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f94b805a510 0x7f94b805c9d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.572+0000 7f94e5e00700 1 --2- 172.21.15.49:0/588674393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94e0154660 0x7f94e0153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.572+0000 7f94e5e00700 1 --2- 172.21.15.49:0/588674393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94e0139550 0x7f94e00a87c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.572+0000 7f94e5e00700 1 --2- 172.21.15.49:0/588674393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94e00c1730 0x7f94e01684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.572+0000 7f94e5e00700 1 -- 172.21.15.49:0/588674393 >> 172.21.15.49:0/588674393 conn(0x7f94e0065f30 msgr2=0x7f94e0138600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:26.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.572+0000 7f94e5e00700 1 -- 172.21.15.49:0/588674393 shutdown_connections 2024-01-22T05:08:26.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.572+0000 7f94e5e00700 1 -- 172.21.15.49:0/588674393 wait complete. 2024-01-22T05:08:26.599 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-22T05:08:26.600 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-01-22T05:08:26.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.792+0000 7fc7a1800700 1 Processor -- start 2024-01-22T05:08:26.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.792+0000 7fc7a1800700 1 -- start start 2024-01-22T05:08:26.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.796+0000 7fc7a1800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc79c14fe50 0x7fc79c1502b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.796+0000 7fc7a1800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc79c1507a0 0x7fc79c150c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.796+0000 7fc7a1800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c065820 con 0x7fc79c0c42c0 2024-01-22T05:08:26.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.796+0000 7fc7a1800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc79c065b00 con 0x7fc79c1507a0 2024-01-22T05:08:26.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.796+0000 7fc7a1800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc79c065de0 con 0x7fc79c14fe50 2024-01-22T05:08:26.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.796+0000 7fc79a000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc79c14fe50 0x7fc79c1502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.796+0000 7fc79a000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc79c14fe50 0x7fc79c1502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:44818/0 (socket says 172.21.15.49:44818) 2024-01-22T05:08:26.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.796+0000 7fc79a000700 1 -- 172.21.15.49:0/1571660962 learned_addr learned my addr 172.21.15.49:0/1571660962 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc79a000700 1 -- 172.21.15.49:0/1571660962 >> v2:172.21.15.49:3300/0 conn(0x7fc79c1507a0 msgr2=0x7fc79c150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc79a000700 1 --2- 172.21.15.49:0/1571660962 >> v2:172.21.15.49:3300/0 conn(0x7fc79c1507a0 0x7fc79c150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc79a000700 1 -- 172.21.15.49:0/1571660962 >> v1:172.21.15.49:6789/0 conn(0x7fc79c0c42c0 legacy=0x7fc79c0c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc79a000700 1 -- 172.21.15.49:0/1571660962 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c0660c0 con 0x7fc79c14fe50 2024-01-22T05:08:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc79a000700 1 --2- 172.21.15.49:0/1571660962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc79c14fe50 0x7fc79c1502b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fc79c065230 tx=0x7fc784008190).ready entity=mon.1 client_cookie=bb6849d689f0e8ed server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc799600700 1 -- 172.21.15.49:0/1571660962 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784010070 con 0x7fc79c14fe50 2024-01-22T05:08:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc799600700 1 -- 172.21.15.49:0/1571660962 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78400dbc0 con 0x7fc79c14fe50 2024-01-22T05:08:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc799600700 1 -- 172.21.15.49:0/1571660962 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784015470 con 0x7fc79c14fe50 2024-01-22T05:08:26.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc7a1800700 1 -- 172.21.15.49:0/1571660962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc79c14fe50 msgr2=0x7fc79c1502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc7a1800700 1 --2- 172.21.15.49:0/1571660962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc79c14fe50 0x7fc79c1502b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fc79c065230 tx=0x7fc784008190).stop 2024-01-22T05:08:26.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc7a1800700 1 -- 172.21.15.49:0/1571660962 shutdown_connections 2024-01-22T05:08:26.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc7a1800700 1 --2- 172.21.15.49:0/1571660962 >> v2:172.21.15.49:3300/0 conn(0x7fc79c1507a0 0x7fc79c150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:26.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc7a1800700 1 --2- 172.21.15.49:0/1571660962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc79c14fe50 0x7fc79c1502b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc7a1800700 1 -- 172.21.15.49:0/1571660962 >> 172.21.15.49:0/1571660962 conn(0x7fc79c062230 msgr2=0x7fc79c0ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:26.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc7a1800700 1 -- 172.21.15.49:0/1571660962 shutdown_connections 2024-01-22T05:08:26.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.800+0000 7fc7a1800700 1 -- 172.21.15.49:0/1571660962 wait complete. 2024-01-22T05:08:26.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.804+0000 7fc7a1800700 1 Processor -- start 2024-01-22T05:08:26.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.808+0000 7fc7a1800700 1 -- start start 2024-01-22T05:08:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.812+0000 7fc7a1800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc79c0c42c0 0x7fc79c146a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.812+0000 7fc7a1800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc79c14fe50 0x7fc79c1603c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.812+0000 7fc7a1800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc79c1507a0 0x7fc79c151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.812+0000 7fc7a1800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c146f60 con 0x7fc79c14fe50 2024-01-22T05:08:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.812+0000 7fc7a1800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c148950 con 0x7fc79c0c42c0 2024-01-22T05:08:26.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.812+0000 7fc7a1800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c1479f0 con 0x7fc79c1507a0 2024-01-22T05:08:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.812+0000 7fc79b400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc79c1507a0 0x7fc79c151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.812+0000 7fc79b400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc79c1507a0 0x7fc79c151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:38776/0 (socket says 172.21.15.49:38776) 2024-01-22T05:08:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.812+0000 7fc79b400700 1 -- 172.21.15.49:0/2136512943 learned_addr learned my addr 172.21.15.49:0/2136512943 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.812+0000 7fc79aa00700 1 --2- 172.21.15.49:0/2136512943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc79c0c42c0 0x7fc79c146a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.812+0000 7fc79aa00700 1 -- 172.21.15.49:0/2136512943 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc79c1507a0 msgr2=0x7fc79c151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.812+0000 7fc79aa00700 1 --2- 172.21.15.49:0/2136512943 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc79c1507a0 0x7fc79c151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.812+0000 7fc79aa00700 1 -- 172.21.15.49:0/2136512943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc79c14fe50 msgr2=0x7fc79c1603c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-22T05:08:26.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.812+0000 7fc79aa00700 1 --2- 172.21.15.49:0/2136512943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc79c14fe50 0x7fc79c1603c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:26.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.812+0000 7fc79aa00700 1 -- 172.21.15.49:0/2136512943 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840083f0 con 0x7fc79c0c42c0 2024-01-22T05:08:26.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.816+0000 7fc79aa00700 1 --2- 172.21.15.49:0/2136512943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc79c0c42c0 0x7fc79c146a70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fc78c009490 tx=0x7fc78c006ee0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:26.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.816+0000 7fc792000700 1 -- 172.21.15.49:0/2136512943 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c009e90 con 0x7fc79c0c42c0 2024-01-22T05:08:26.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.816+0000 7fc792000700 1 -- 172.21.15.49:0/2136512943 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c013460 con 0x7fc79c0c42c0 2024-01-22T05:08:26.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.816+0000 7fc792000700 1 -- 172.21.15.49:0/2136512943 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c013820 con 0x7fc79c0c42c0 2024-01-22T05:08:26.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.816+0000 7fc7a1800700 1 -- 172.21.15.49:0/2136512943 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79c147150 con 0x7fc79c0c42c0 2024-01-22T05:08:26.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.816+0000 7fc7a1800700 1 -- 172.21.15.49:0/2136512943 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79c147710 con 0x7fc79c0c42c0 2024-01-22T05:08:26.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.824+0000 7fc792000700 1 -- 172.21.15.49:0/2136512943 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc78c013c10 con 0x7fc79c0c42c0 2024-01-22T05:08:26.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.824+0000 7fc792000700 1 --2- 172.21.15.49:0/2136512943 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc77405a510 0x7fc77405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.824+0000 7fc792000700 1 -- 172.21.15.49:0/2136512943 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc78c074190 con 0x7fc79c0c42c0 2024-01-22T05:08:26.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.828+0000 7fc7abd98740 1 Processor -- start 2024-01-22T05:08:26.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.828+0000 7fc7abd98740 1 -- start start 2024-01-22T05:08:26.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.828+0000 7fc7abd98740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15cc640 0x15cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.828+0000 7fc7abd98740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1589b20 0x1583490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.828+0000 7fc7abd98740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cd100 0x1585590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.828+0000 7fc7abd98740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x14c3340 con 0x15cc640 2024-01-22T05:08:26.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.828+0000 7fc7abd98740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x14e64e0 con 0x1589b20 2024-01-22T05:08:26.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.828+0000 7fc7abd98740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x14afce0 con 0x15cd100 2024-01-22T05:08:26.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.828+0000 7fc79aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15cc640 0x15cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.828+0000 7fc79aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15cc640 0x15cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38726/0 (socket says 172.21.15.49:38726) 2024-01-22T05:08:26.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.828+0000 7fc79aa00700 1 -- 172.21.15.49:0/1010220718 learned_addr learned my addr 172.21.15.49:0/1010220718 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:26.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc79aa00700 1 -- 172.21.15.49:0/1010220718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cd100 msgr2=0x1585590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc79aa00700 1 --2- 172.21.15.49:0/1010220718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cd100 0x1585590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:26.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc79aa00700 1 -- 172.21.15.49:0/1010220718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1589b20 msgr2=0x1583490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-22T05:08:26.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc79aa00700 1 --2- 172.21.15.49:0/1010220718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1589b20 0x1583490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:26.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc79aa00700 1 -- 172.21.15.49:0/1010220718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x14b6ed0 con 0x15cc640 2024-01-22T05:08:26.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc79aa00700 1 --2- 172.21.15.49:0/1010220718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15cc640 0x15cca20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fc78c04b190 tx=0x7fc78c00e000).ready entity=mon.0 client_cookie=d41b49e046b4a674 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:26.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc78a600700 1 -- 172.21.15.49:0/1010220718 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c050ab0 con 0x15cc640 2024-01-22T05:08:26.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc78a600700 1 -- 172.21.15.49:0/1010220718 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c049710 con 0x15cc640 2024-01-22T05:08:26.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc78a600700 1 -- 172.21.15.49:0/1010220718 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c04a860 con 0x15cc640 2024-01-22T05:08:26.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc7abd98740 1 -- 172.21.15.49:0/1010220718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15cc640 msgr2=0x15cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc7abd98740 1 --2- 172.21.15.49:0/1010220718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15cc640 0x15cca20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fc78c04b190 tx=0x7fc78c00e000).stop 2024-01-22T05:08:26.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc7abd98740 1 -- 172.21.15.49:0/1010220718 shutdown_connections 2024-01-22T05:08:26.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc7abd98740 1 --2- 172.21.15.49:0/1010220718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cd100 0x1585590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:26.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc7abd98740 1 --2- 172.21.15.49:0/1010220718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1589b20 0x1583490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:26.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc7abd98740 1 --2- 172.21.15.49:0/1010220718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15cc640 0x15cca20 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.832+0000 7fc7abd98740 1 -- 172.21.15.49:0/1010220718 >> 172.21.15.49:0/1010220718 conn(0x1368680 msgr2=0x1589410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:26.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.836+0000 7fc79a000700 1 --2- 172.21.15.49:0/2136512943 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc77405a510 0x7fc77405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.836+0000 7fc79a000700 1 --2- 172.21.15.49:0/2136512943 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc77405a510 0x7fc77405c9d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fc79c0c3ea0 tx=0x7fc784008190).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:26.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.836+0000 7fc7abd98740 1 -- 172.21.15.49:0/1010220718 shutdown_connections 2024-01-22T05:08:26.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.836+0000 7fc7abd98740 1 -- 172.21.15.49:0/1010220718 wait complete. 2024-01-22T05:08:26.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.840+0000 7fc7abd98740 1 -- start start 2024-01-22T05:08:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.840+0000 7fc7abd98740 1 Processor -- start 2024-01-22T05:08:26.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.840+0000 7fc7abd98740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1589b20 0x15b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc7abd98740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cc640 0x15c9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc7abd98740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cd100 0x15c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc7abd98740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x15c9950 con 0x1589b20 2024-01-22T05:08:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc7abd98740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x15b4420 con 0x15cc640 2024-01-22T05:08:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc7abd98740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x15b2a40 con 0x15cd100 2024-01-22T05:08:26.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc7abd98740 10 client.0 ll_register_callbacks cb 0x15407c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:26.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc79a000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cc640 0x15c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc79a000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cc640 0x15c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:44836/0 (socket says 172.21.15.49:44836) 2024-01-22T05:08:26.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc79a000700 1 -- 172.21.15.49:0/1816066442 learned_addr learned my addr 172.21.15.49:0/1816066442 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:26.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc79aa00700 1 --2- 172.21.15.49:0/1816066442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1589b20 0x15b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc79b400700 1 --2- 172.21.15.49:0/1816066442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cd100 0x15c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc79b400700 1 -- 172.21.15.49:0/1816066442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cc640 msgr2=0x15c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc79b400700 1 --2- 172.21.15.49:0/1816066442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cc640 0x15c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc79b400700 1 -- 172.21.15.49:0/1816066442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1589b20 msgr2=0x15b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc79b400700 1 --2- 172.21.15.49:0/1816066442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1589b20 0x15b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.844+0000 7fc79b400700 1 -- 172.21.15.49:0/1816066442 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79c147710 con 0x15cd100 2024-01-22T05:08:26.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.848+0000 7fc79b400700 1 --2- 172.21.15.49:0/1816066442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cd100 0x15c8730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fc79c0bdfd0 tx=0x7fc794008040).ready entity=mon.2 client_cookie=c9c65c0ad47359fe server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:26.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.848+0000 7fc782a00700 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2024-01-22T05:08:26.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.848+0000 7fc782a00700 1 -- 172.21.15.49:0/1816066442 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794009680 con 0x15cd100 2024-01-22T05:08:26.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.848+0000 7fc782a00700 1 -- 172.21.15.49:0/1816066442 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc794011560 con 0x15cd100 2024-01-22T05:08:26.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.852+0000 7fc7abd98740 1 -- 172.21.15.49:0/1816066442 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1500230 con 0x15cd100 2024-01-22T05:08:26.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.852+0000 7fc782a00700 1 -- 172.21.15.49:0/1816066442 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc794011970 con 0x15cd100 2024-01-22T05:08:26.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.852+0000 7fc7abd98740 10 client.5423 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:26.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.852+0000 7fc7abd98740 1 -- 172.21.15.49:0/1816066442 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x15037c0 con 0x15cd100 2024-01-22T05:08:26.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.852+0000 7fc782a00700 1 -- 172.21.15.49:0/1816066442 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1500230 con 0x15cd100 2024-01-22T05:08:26.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.852+0000 7fc782a00700 1 -- 172.21.15.49:0/1816066442 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc794011070 con 0x15cd100 2024-01-22T05:08:26.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.856+0000 7fc7abd98740 10 client.5423 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:26.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.856+0000 7fc7abd98740 10 client.5423 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:26.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.856+0000 7fc7abd98740 20 client.5423 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:26.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.856+0000 7fc7abd98740 1 --2- 172.21.15.49:0/1816066442 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x15864e0 0x15868c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.856+0000 7fc7abd98740 4 client.5423 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:26.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.856+0000 7fc7abd98740 1 -- 172.21.15.49:0/1816066442 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x14f6780 con 0x15864e0 2024-01-22T05:08:26.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.856+0000 7fc79aa00700 1 --2- 172.21.15.49:0/1816066442 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x15864e0 0x15868c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.860+0000 7fc79aa00700 1 --2- 172.21.15.49:0/1816066442 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x15864e0 0x15868c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=36117e4694ad4ea3 server_cookie=9d76053468c9cbbc in_seq=0 out_seq=0 2024-01-22T05:08:26.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.860+0000 7fc782a00700 10 client.5423 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:26.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.860+0000 7fc782a00700 1 -- 172.21.15.49:0/1816066442 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x14f6780 con 0x15864e0 2024-01-22T05:08:26.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.860+0000 7fc782a00700 10 client.5423 handle_command_reply: tid=0 2024-01-22T05:08:26.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.860+0000 7fc7abd98740 1 client.5423 shutdown 2024-01-22T05:08:26.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.860+0000 7fc7abd98740 1 -- 172.21.15.49:0/1816066442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cd100 msgr2=0x15c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.860+0000 7fc7abd98740 1 --2- 172.21.15.49:0/1816066442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cd100 0x15c8730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fc79c0bdfd0 tx=0x7fc794008040).stop 2024-01-22T05:08:26.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.864+0000 7fc7abd98740 1 -- 172.21.15.49:0/1816066442 shutdown_connections 2024-01-22T05:08:26.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.864+0000 7fc7abd98740 1 --2- 172.21.15.49:0/1816066442 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x15864e0 0x15868c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.864+0000 7fc7abd98740 1 --2- 172.21.15.49:0/1816066442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cd100 0x15c8730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.864+0000 7fc7abd98740 1 --2- 172.21.15.49:0/1816066442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cc640 0x15c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.864+0000 7fc7abd98740 1 --2- 172.21.15.49:0/1816066442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1589b20 0x15b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.864+0000 7fc7abd98740 1 -- 172.21.15.49:0/1816066442 >> 172.21.15.49:0/1816066442 conn(0x1368680 msgr2=0x1588aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:26.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.864+0000 7fc782a00700 0 client.5423 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:26.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.864+0000 7fc7abd98740 1 -- 172.21.15.49:0/1816066442 shutdown_connections 2024-01-22T05:08:26.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.864+0000 7fc7abd98740 1 -- 172.21.15.49:0/1816066442 wait complete. 2024-01-22T05:08:26.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.864+0000 7fc7abd98740 20 client.5423 trim_cache size 0 max 16384 2024-01-22T05:08:26.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.884+0000 7fc7abd98740 1 Processor -- start 2024-01-22T05:08:26.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.884+0000 7fc7abd98740 1 -- start start 2024-01-22T05:08:26.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.884+0000 7fc7abd98740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1589b20 0x15cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.884+0000 7fc7abd98740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cc640 0x1588520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.884+0000 7fc7abd98740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cd100 0x1585b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.884+0000 7fc7abd98740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x154c600 con 0x1589b20 2024-01-22T05:08:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.884+0000 7fc7abd98740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x15ca8f0 con 0x15cd100 2024-01-22T05:08:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.884+0000 7fc7abd98740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x153c8c0 con 0x15cc640 2024-01-22T05:08:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.884+0000 7fc79aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1589b20 0x15cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.884+0000 7fc79aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1589b20 0x15cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38732/0 (socket says 172.21.15.49:38732) 2024-01-22T05:08:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.884+0000 7fc79aa00700 1 -- 172.21.15.49:0/1380324066 learned_addr learned my addr 172.21.15.49:0/1380324066 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.884+0000 7fc79a000700 1 --2- 172.21.15.49:0/1380324066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cc640 0x1588520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc79b400700 1 --2- 172.21.15.49:0/1380324066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cd100 0x1585b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc79aa00700 1 -- 172.21.15.49:0/1380324066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cc640 msgr2=0x1588520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc79aa00700 1 --2- 172.21.15.49:0/1380324066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cc640 0x1588520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc79aa00700 1 -- 172.21.15.49:0/1380324066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cd100 msgr2=0x1585b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc79aa00700 1 --2- 172.21.15.49:0/1380324066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cd100 0x1585b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc79aa00700 1 -- 172.21.15.49:0/1380324066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1586c20 con 0x1589b20 2024-01-22T05:08:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc79b400700 1 --2- 172.21.15.49:0/1380324066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cd100 0x1585b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc79a000700 1 --2- 172.21.15.49:0/1380324066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cc640 0x1588520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc79aa00700 1 --2- 172.21.15.49:0/1380324066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1589b20 0x15cca20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fc78c009460 tx=0x7fc78c074000).ready entity=mon.0 client_cookie=9e13a51e3f2ec402 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc78b000700 1 -- 172.21.15.49:0/1380324066 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c062070 con 0x1589b20 2024-01-22T05:08:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc78b000700 1 -- 172.21.15.49:0/1380324066 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c063040 con 0x1589b20 2024-01-22T05:08:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc78b000700 1 -- 172.21.15.49:0/1380324066 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c066280 con 0x1589b20 2024-01-22T05:08:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc7abd98740 1 -- 172.21.15.49:0/1380324066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1589b20 msgr2=0x15cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc7abd98740 1 --2- 172.21.15.49:0/1380324066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1589b20 0x15cca20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fc78c009460 tx=0x7fc78c074000).stop 2024-01-22T05:08:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc7abd98740 1 -- 172.21.15.49:0/1380324066 shutdown_connections 2024-01-22T05:08:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc7abd98740 1 --2- 172.21.15.49:0/1380324066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cd100 0x1585b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc7abd98740 1 --2- 172.21.15.49:0/1380324066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15cc640 0x1588520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc7abd98740 1 --2- 172.21.15.49:0/1380324066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1589b20 0x15cca20 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc7abd98740 1 -- 172.21.15.49:0/1380324066 >> 172.21.15.49:0/1380324066 conn(0x1368680 msgr2=0x15b0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc7abd98740 1 -- 172.21.15.49:0/1380324066 shutdown_connections 2024-01-22T05:08:26.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.888+0000 7fc7abd98740 1 -- 172.21.15.49:0/1380324066 wait complete. 2024-01-22T05:08:26.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.892+0000 7fc7abd98740 1 -- start start 2024-01-22T05:08:26.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.892+0000 7fc7abd98740 1 Processor -- start 2024-01-22T05:08:26.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc7abd98740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1589b20 0x15d9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc7abd98740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15cc640 0x1583ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc7abd98740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cd100 0x15843c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc7abd98740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x15ed0b0 con 0x15cc640 2024-01-22T05:08:26.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc7abd98740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x15848b0 con 0x15cd100 2024-01-22T05:08:26.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc7abd98740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x16328a0 con 0x1589b20 2024-01-22T05:08:26.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc7abd98740 10 client.0 ll_register_callbacks cb 0x7fc794009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:26.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc79a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15cc640 0x1583ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc79a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15cc640 0x1583ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38748/0 (socket says 172.21.15.49:38748) 2024-01-22T05:08:26.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc79aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1589b20 0x15d9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc79a000700 1 -- 172.21.15.49:0/192965111 learned_addr learned my addr 172.21.15.49:0/192965111 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:26.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc79b400700 1 --2- 172.21.15.49:0/192965111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cd100 0x15843c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc79a000700 1 -- 172.21.15.49:0/192965111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1589b20 msgr2=0x15d9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc79a000700 1 --2- 172.21.15.49:0/192965111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1589b20 0x15d9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc79a000700 1 -- 172.21.15.49:0/192965111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cd100 msgr2=0x15843c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:26.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc79a000700 1 --2- 172.21.15.49:0/192965111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cd100 0x15843c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc79a000700 1 -- 172.21.15.49:0/192965111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x14b6ed0 con 0x15cc640 2024-01-22T05:08:26.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc79b400700 1 --2- 172.21.15.49:0/192965111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cd100 0x15843c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc79a000700 1 --2- 172.21.15.49:0/192965111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15cc640 0x1583ed0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fc79c065f20 tx=0x7fc78401c000).ready entity=mon.0 client_cookie=2859d1199ff9fcc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc782a00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc782a00700 1 -- 172.21.15.49:0/192965111 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784015e50 con 0x15cc640 2024-01-22T05:08:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc7abd98740 1 -- 172.21.15.49:0/192965111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x15b1660 con 0x15cc640 2024-01-22T05:08:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc782a00700 1 -- 172.21.15.49:0/192965111 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc78400b0c0 con 0x15cc640 2024-01-22T05:08:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc782a00700 1 -- 172.21.15.49:0/192965111 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc78400b490 con 0x15cc640 2024-01-22T05:08:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc7abd98740 10 client.5928 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc7abd98740 1 -- 172.21.15.49:0/192965111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x7fc79c152820 con 0x15cc640 2024-01-22T05:08:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc782a00700 1 -- 172.21.15.49:0/192965111 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x15b1660 con 0x15cc640 2024-01-22T05:08:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.896+0000 7fc782a00700 1 -- 172.21.15.49:0/192965111 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc78400b5f0 con 0x15cc640 2024-01-22T05:08:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 10 client.5928 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 10 client.5928 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 20 client.5928 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 1 --2- 172.21.15.49:0/192965111 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x15b2b80 0x15ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 4 client.5928 mds_command: new command op to 5569 tid=0[{"prefix": "damage ls"}] 2024-01-22T05:08:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 1 -- 172.21.15.49:0/192965111 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7fc78c049710 con 0x15b2b80 2024-01-22T05:08:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc79aa00700 1 --2- 172.21.15.49:0/192965111 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x15b2b80 0x15ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc79aa00700 1 --2- 172.21.15.49:0/192965111 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x15b2b80 0x15ae610 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3360b9ca59090c09 server_cookie=f68e83b8329d4be0 in_seq=0 out_seq=0 2024-01-22T05:08:26.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc782a00700 10 client.5928 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:26.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc782a00700 1 -- 172.21.15.49:0/192965111 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+168 (crc 0 0 0) 0x7fc78c049710 con 0x15b2b80 2024-01-22T05:08:26.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc782a00700 10 client.5928 handle_command_reply: tid=0 2024-01-22T05:08:26.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 1 client.5928 shutdown 2024-01-22T05:08:26.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 1 -- 172.21.15.49:0/192965111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15cc640 msgr2=0x1583ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 1 --2- 172.21.15.49:0/192965111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15cc640 0x1583ed0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fc79c065f20 tx=0x7fc78401c000).stop 2024-01-22T05:08:26.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 1 -- 172.21.15.49:0/192965111 shutdown_connections 2024-01-22T05:08:26.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 1 --2- 172.21.15.49:0/192965111 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x15b2b80 0x15ae610 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 1 --2- 172.21.15.49:0/192965111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15cd100 0x15843c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc782a00700 0 client.5928 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:26.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 1 --2- 172.21.15.49:0/192965111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15cc640 0x1583ed0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 1 --2- 172.21.15.49:0/192965111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1589b20 0x15d9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 1 -- 172.21.15.49:0/192965111 >> 172.21.15.49:0/192965111 conn(0x1368680 msgr2=0x15adb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:26.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.900+0000 7fc7abd98740 1 -- 172.21.15.49:0/192965111 shutdown_connections 2024-01-22T05:08:26.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.904+0000 7fc7abd98740 1 -- 172.21.15.49:0/192965111 wait complete. 2024-01-22T05:08:26.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.904+0000 7fc7abd98740 20 client.5928 trim_cache size 0 max 16384 2024-01-22T05:08:26.905 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-22T05:08:26.905 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-01-22T05:08:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1699187118, 2024-01-22T05:08:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511630187, 2024-01-22T05:08:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2024-01-22T05:08:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:26.906 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-22T05:08:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.904+0000 7fc7a1800700 1 -- 172.21.15.49:0/2136512943 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc77405a510 msgr2=0x7fc77405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.904+0000 7fc7a1800700 1 --2- 172.21.15.49:0/2136512943 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc77405a510 0x7fc77405c9d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fc79c0c3ea0 tx=0x7fc784008190).stop 2024-01-22T05:08:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.904+0000 7fc7a1800700 1 -- 172.21.15.49:0/2136512943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc79c0c42c0 msgr2=0x7fc79c146a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.904+0000 7fc7a1800700 1 --2- 172.21.15.49:0/2136512943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc79c0c42c0 0x7fc79c146a70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fc78c009490 tx=0x7fc78c006ee0).stop 2024-01-22T05:08:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.904+0000 7fc7a1800700 1 -- 172.21.15.49:0/2136512943 shutdown_connections 2024-01-22T05:08:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.904+0000 7fc7a1800700 1 --2- 172.21.15.49:0/2136512943 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc77405a510 0x7fc77405c9d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.904+0000 7fc7a1800700 1 --2- 172.21.15.49:0/2136512943 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc79c1507a0 0x7fc79c151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.904+0000 7fc7a1800700 1 --2- 172.21.15.49:0/2136512943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc79c14fe50 0x7fc79c1603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.904+0000 7fc7a1800700 1 --2- 172.21.15.49:0/2136512943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc79c0c42c0 0x7fc79c146a70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:26.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.904+0000 7fc7a1800700 1 -- 172.21.15.49:0/2136512943 >> 172.21.15.49:0/2136512943 conn(0x7fc79c062230 msgr2=0x7fc79c0a8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:26.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.904+0000 7fc7a1800700 1 -- 172.21.15.49:0/2136512943 shutdown_connections 2024-01-22T05:08:26.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:26.904+0000 7fc7a1800700 1 -- 172.21.15.49:0/2136512943 wait complete. 2024-01-22T05:08:26.928 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:27.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.084+0000 7f9358e00700 1 Processor -- start 2024-01-22T05:08:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.084+0000 7f9358e00700 1 -- start start 2024-01-22T05:08:27.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9358e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93540bdd90 0x7f93540be170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9358e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9354159330 0x7f9354062330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9358e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9354068120 con 0x7f93541587c0 2024-01-22T05:08:27.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9358e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93540683e0 con 0x7f9354159330 2024-01-22T05:08:27.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9358e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93540686c0 con 0x7f93540bdd90 2024-01-22T05:08:27.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9353200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9354159330 0x7f9354062330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9353200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9354159330 0x7f9354062330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38752/0 (socket says 172.21.15.49:38752) 2024-01-22T05:08:27.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9353200700 1 -- 172.21.15.49:0/2628551919 learned_addr learned my addr 172.21.15.49:0/2628551919 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:27.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9351e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93540bdd90 0x7f93540be170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9353200700 1 -- 172.21.15.49:0/2628551919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93540bdd90 msgr2=0x7f93540be170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:27.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9353200700 1 --2- 172.21.15.49:0/2628551919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93540bdd90 0x7f93540be170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9353200700 1 -- 172.21.15.49:0/2628551919 >> v1:172.21.15.49:6789/0 conn(0x7f93541587c0 legacy=0x7f9354158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9350a00700 1 -- 172.21.15.49:0/2628551919 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499228914 0 0) 0x7f9354068120 con 0x7f93541587c0 2024-01-22T05:08:27.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9353200700 1 -- 172.21.15.49:0/2628551919 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93540689a0 con 0x7f9354159330 2024-01-22T05:08:27.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9353200700 1 --2- 172.21.15.49:0/2628551919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9354159330 0x7f9354062330 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f934c009f20 tx=0x7f934c009840).ready entity=mon.0 client_cookie=912b1a3504e112c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9350a00700 1 -- 172.21.15.49:0/2628551919 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c00e070 con 0x7f9354159330 2024-01-22T05:08:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9350a00700 1 -- 172.21.15.49:0/2628551919 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c00b9d0 con 0x7f9354159330 2024-01-22T05:08:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.088+0000 7f9350a00700 1 -- 172.21.15.49:0/2628551919 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c00bd50 con 0x7f9354159330 2024-01-22T05:08:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.092+0000 7f9358e00700 1 -- 172.21.15.49:0/2628551919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9354159330 msgr2=0x7f9354062330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.092+0000 7f9358e00700 1 --2- 172.21.15.49:0/2628551919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9354159330 0x7f9354062330 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f934c009f20 tx=0x7f934c009840).stop 2024-01-22T05:08:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.092+0000 7f9358e00700 1 -- 172.21.15.49:0/2628551919 shutdown_connections 2024-01-22T05:08:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.092+0000 7f9358e00700 1 --2- 172.21.15.49:0/2628551919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9354159330 0x7f9354062330 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.092+0000 7f9358e00700 1 --2- 172.21.15.49:0/2628551919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93540bdd90 0x7f93540be170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.092+0000 7f9358e00700 1 -- 172.21.15.49:0/2628551919 >> 172.21.15.49:0/2628551919 conn(0x7f9354064080 msgr2=0x7f9354064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.092+0000 7f9358e00700 1 -- 172.21.15.49:0/2628551919 shutdown_connections 2024-01-22T05:08:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.092+0000 7f9358e00700 1 -- 172.21.15.49:0/2628551919 wait complete. 2024-01-22T05:08:27.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.096+0000 7f9358e00700 1 Processor -- start 2024-01-22T05:08:27.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.096+0000 7f9358e00700 1 -- start start 2024-01-22T05:08:27.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.096+0000 7f9358e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93540bdd90 0x7f935414ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.096+0000 7f9358e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93541587c0 0x7f93540ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.096+0000 7f9358e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9354159330 0x7f9354062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.096+0000 7f9358e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935416b960 con 0x7f9354159330 2024-01-22T05:08:27.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.096+0000 7f9358e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935416bb70 con 0x7f93540bdd90 2024-01-22T05:08:27.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.096+0000 7f9358e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935416be50 con 0x7f93541587c0 2024-01-22T05:08:27.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9353200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9354159330 0x7f9354062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9353200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9354159330 0x7f9354062a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38758/0 (socket says 172.21.15.49:38758) 2024-01-22T05:08:27.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9353200700 1 -- 172.21.15.49:0/1464120617 learned_addr learned my addr 172.21.15.49:0/1464120617 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:27.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9351400700 1 --2- 172.21.15.49:0/1464120617 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93541587c0 0x7f93540ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9351e00700 1 --2- 172.21.15.49:0/1464120617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93540bdd90 0x7f935414ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9353200700 1 -- 172.21.15.49:0/1464120617 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93541587c0 msgr2=0x7f93540ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9353200700 1 --2- 172.21.15.49:0/1464120617 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93541587c0 0x7f93540ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9353200700 1 -- 172.21.15.49:0/1464120617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93540bdd90 msgr2=0x7f935414ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9353200700 1 --2- 172.21.15.49:0/1464120617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93540bdd90 0x7f935414ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9353200700 1 -- 172.21.15.49:0/1464120617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c009ae0 con 0x7f9354159330 2024-01-22T05:08:27.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9353200700 1 --2- 172.21.15.49:0/1464120617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9354159330 0x7f9354062a00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f934c010000 tx=0x7f93540650d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:27.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9349600700 1 -- 172.21.15.49:0/1464120617 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c00b640 con 0x7f9354159330 2024-01-22T05:08:27.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9349600700 1 -- 172.21.15.49:0/1464120617 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c0092e0 con 0x7f9354159330 2024-01-22T05:08:27.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9358e00700 1 -- 172.21.15.49:0/1464120617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935416c130 con 0x7f9354159330 2024-01-22T05:08:27.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9349600700 1 -- 172.21.15.49:0/1464120617 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c007840 con 0x7f9354159330 2024-01-22T05:08:27.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.100+0000 7f9358e00700 1 -- 172.21.15.49:0/1464120617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935416c6f0 con 0x7f9354159330 2024-01-22T05:08:27.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.104+0000 7f9358e00700 1 -- 172.21.15.49:0/1464120617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9354047060 con 0x7f9354159330 2024-01-22T05:08:27.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.104+0000 7f9349600700 1 -- 172.21.15.49:0/1464120617 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f934c003040 con 0x7f9354159330 2024-01-22T05:08:27.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.104+0000 7f9349600700 1 --2- 172.21.15.49:0/1464120617 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f932c05a510 0x7f932c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.104+0000 7f9349600700 1 -- 172.21.15.49:0/1464120617 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f934c076280 con 0x7f9354159330 2024-01-22T05:08:27.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.108+0000 7f9351e00700 1 --2- 172.21.15.49:0/1464120617 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f932c05a510 0x7f932c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.108+0000 7f9351e00700 1 --2- 172.21.15.49:0/1464120617 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f932c05a510 0x7f932c05c9d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f9344009c30 tx=0x7f9344009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.112+0000 7f9349600700 1 -- 172.21.15.49:0/1464120617 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f934c0498b0 con 0x7f9354159330 2024-01-22T05:08:27.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.312+0000 7f9358e00700 1 -- 172.21.15.49:0/1464120617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9354068c80 con 0x7f9354159330 2024-01-22T05:08:27.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.312+0000 7f9349600700 1 -- 172.21.15.49:0/1464120617 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f934c04ced0 con 0x7f9354159330 2024-01-22T05:08:27.315 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:27.316 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:22.134281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":8,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:27.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.316+0000 7f9358e00700 1 -- 172.21.15.49:0/1464120617 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f932c05a510 msgr2=0x7f932c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.316+0000 7f9358e00700 1 --2- 172.21.15.49:0/1464120617 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f932c05a510 0x7f932c05c9d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f9344009c30 tx=0x7f9344009060).stop 2024-01-22T05:08:27.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.316+0000 7f9358e00700 1 -- 172.21.15.49:0/1464120617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9354159330 msgr2=0x7f9354062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.316+0000 7f9358e00700 1 --2- 172.21.15.49:0/1464120617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9354159330 0x7f9354062a00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f934c010000 tx=0x7f93540650d0).stop 2024-01-22T05:08:27.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.316+0000 7f9358e00700 1 -- 172.21.15.49:0/1464120617 shutdown_connections 2024-01-22T05:08:27.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.316+0000 7f9358e00700 1 --2- 172.21.15.49:0/1464120617 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f932c05a510 0x7f932c05c9d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.316+0000 7f9358e00700 1 --2- 172.21.15.49:0/1464120617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9354159330 0x7f9354062a00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.316+0000 7f9358e00700 1 --2- 172.21.15.49:0/1464120617 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93541587c0 0x7f93540ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.316+0000 7f9358e00700 1 --2- 172.21.15.49:0/1464120617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93540bdd90 0x7f935414ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.316+0000 7f9358e00700 1 -- 172.21.15.49:0/1464120617 >> 172.21.15.49:0/1464120617 conn(0x7f9354064080 msgr2=0x7f93540be170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:27.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.316+0000 7f9358e00700 1 -- 172.21.15.49:0/1464120617 shutdown_connections 2024-01-22T05:08:27.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.316+0000 7f9358e00700 1 -- 172.21.15.49:0/1464120617 wait complete. 2024-01-22T05:08:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 44 2024-01-22T05:08:27.341 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 1699187118 2024-01-22T05:08:27.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.504+0000 7f9442e00700 1 Processor -- start 2024-01-22T05:08:27.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.508+0000 7f9442e00700 1 -- start start 2024-01-22T05:08:27.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.508+0000 7f9442e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f943c063e40 0x7f943c064220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.508+0000 7f9442e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f943c0a7520 0x7f943c0a7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.508+0000 7f9442e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943c068b10 con 0x7f943c0a7e70 2024-01-22T05:08:27.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f9442e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c0bdc20 con 0x7f943c0a7520 2024-01-22T05:08:27.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f9442e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c067f00 con 0x7f943c063e40 2024-01-22T05:08:27.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f943b400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f943c0a7520 0x7f943c0a7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f943b400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f943c0a7520 0x7f943c0a7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38768/0 (socket says 172.21.15.49:38768) 2024-01-22T05:08:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f943b400700 1 -- 172.21.15.49:0/3478534904 learned_addr learned my addr 172.21.15.49:0/3478534904 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f943be00700 1 --2- 172.21.15.49:0/3478534904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f943c063e40 0x7f943c064220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f943b400700 1 -- 172.21.15.49:0/3478534904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f943c063e40 msgr2=0x7f943c064220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f943b400700 1 --2- 172.21.15.49:0/3478534904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f943c063e40 0x7f943c064220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f943b400700 1 -- 172.21.15.49:0/3478534904 >> v1:172.21.15.110:6789/0 conn(0x7f943c0a7e70 legacy=0x7f943c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f943b400700 1 -- 172.21.15.49:0/3478534904 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c0681e0 con 0x7f943c0a7520 2024-01-22T05:08:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f943be00700 1 --2- 172.21.15.49:0/3478534904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f943c063e40 0x7f943c064220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f943b400700 1 --2- 172.21.15.49:0/3478534904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943c0a7520 0x7f943c0a7980 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f9424006fd0 tx=0x7f94240090f0).ready entity=mon.0 client_cookie=2d7fd49d90c1850 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f943aa00700 1 -- 172.21.15.49:0/3478534904 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942400b600 con 0x7f943c0a7520 2024-01-22T05:08:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f943aa00700 1 -- 172.21.15.49:0/3478534904 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942400b760 con 0x7f943c0a7520 2024-01-22T05:08:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f943aa00700 1 -- 172.21.15.49:0/3478534904 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942400bae0 con 0x7f943c0a7520 2024-01-22T05:08:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f9442e00700 1 -- 172.21.15.49:0/3478534904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943c0a7520 msgr2=0x7f943c0a7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.512+0000 7f9442e00700 1 --2- 172.21.15.49:0/3478534904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943c0a7520 0x7f943c0a7980 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f9424006fd0 tx=0x7f94240090f0).stop 2024-01-22T05:08:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.516+0000 7f9442e00700 1 -- 172.21.15.49:0/3478534904 shutdown_connections 2024-01-22T05:08:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.516+0000 7f9442e00700 1 --2- 172.21.15.49:0/3478534904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943c0a7520 0x7f943c0a7980 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.516+0000 7f9442e00700 1 --2- 172.21.15.49:0/3478534904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f943c063e40 0x7f943c064220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.516+0000 7f9442e00700 1 -- 172.21.15.49:0/3478534904 >> 172.21.15.49:0/3478534904 conn(0x7f943c0c4150 msgr2=0x7f943c0c4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.516+0000 7f9442e00700 1 -- 172.21.15.49:0/3478534904 shutdown_connections 2024-01-22T05:08:27.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.516+0000 7f9442e00700 1 -- 172.21.15.49:0/3478534904 wait complete. 2024-01-22T05:08:27.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.520+0000 7f9442e00700 1 Processor -- start 2024-01-22T05:08:27.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.520+0000 7f9442e00700 1 -- start start 2024-01-22T05:08:27.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.520+0000 7f9442e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f943c063e40 0x7f943c155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.520+0000 7f9442e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943c0a7520 0x7f943c150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.520+0000 7f9442e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943c0a7e70 0x7f943c0a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.520+0000 7f9442e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0a6cd0 con 0x7f943c0a7520 2024-01-22T05:08:27.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.520+0000 7f9442e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c155730 con 0x7f943c0a7e70 2024-01-22T05:08:27.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.520+0000 7f9442e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0a3950 con 0x7f943c063e40 2024-01-22T05:08:27.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.520+0000 7f943b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943c0a7520 0x7f943c150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.520+0000 7f943b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943c0a7520 0x7f943c150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38780/0 (socket says 172.21.15.49:38780) 2024-01-22T05:08:27.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.520+0000 7f943b400700 1 -- 172.21.15.49:0/116773103 learned_addr learned my addr 172.21.15.49:0/116773103 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.524+0000 7f9440e00700 1 --2- 172.21.15.49:0/116773103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943c0a7e70 0x7f943c0a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.524+0000 7f943be00700 1 --2- 172.21.15.49:0/116773103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f943c063e40 0x7f943c155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.524+0000 7f943b400700 1 -- 172.21.15.49:0/116773103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f943c063e40 msgr2=0x7f943c155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.524+0000 7f943b400700 1 --2- 172.21.15.49:0/116773103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f943c063e40 0x7f943c155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.524+0000 7f943b400700 1 -- 172.21.15.49:0/116773103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943c0a7e70 msgr2=0x7f943c0a6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.524+0000 7f943b400700 1 --2- 172.21.15.49:0/116773103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943c0a7e70 0x7f943c0a6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.524+0000 7f943b400700 1 -- 172.21.15.49:0/116773103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9424009370 con 0x7f943c0a7520 2024-01-22T05:08:27.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.524+0000 7f943be00700 1 --2- 172.21.15.49:0/116773103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f943c063e40 0x7f943c155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:27.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.524+0000 7f943b400700 1 --2- 172.21.15.49:0/116773103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943c0a7520 0x7f943c150e90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f943c0599d0 tx=0x7f9424017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:27.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.524+0000 7f9433400700 1 -- 172.21.15.49:0/116773103 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424006a40 con 0x7f943c0a7520 2024-01-22T05:08:27.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.524+0000 7f9433400700 1 -- 172.21.15.49:0/116773103 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942400b8d0 con 0x7f943c0a7520 2024-01-22T05:08:27.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.524+0000 7f9442e00700 1 -- 172.21.15.49:0/116773103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943c0a3c30 con 0x7f943c0a7520 2024-01-22T05:08:27.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.524+0000 7f9433400700 1 -- 172.21.15.49:0/116773103 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942401c670 con 0x7f943c0a7520 2024-01-22T05:08:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.524+0000 7f9442e00700 1 -- 172.21.15.49:0/116773103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c0a41f0 con 0x7f943c0a7520 2024-01-22T05:08:27.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.528+0000 7f9433400700 1 -- 172.21.15.49:0/116773103 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f942401ca60 con 0x7f943c0a7520 2024-01-22T05:08:27.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.528+0000 7f9433400700 1 --2- 172.21.15.49:0/116773103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f941405a540 0x7f941405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.528+0000 7f9433400700 1 -- 172.21.15.49:0/116773103 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f94240761b0 con 0x7f943c0a7520 2024-01-22T05:08:27.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.528+0000 7f943be00700 1 --2- 172.21.15.49:0/116773103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f941405a540 0x7f941405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.528+0000 7f944d2f0740 1 Processor -- start 2024-01-22T05:08:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f944d2f0740 1 -- start start 2024-01-22T05:08:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f943be00700 1 --2- 172.21.15.49:0/116773103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f941405a540 0x7f941405ca00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f942c006fd0 tx=0x7f942c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f944d2f0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2406660 0x2406a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f944d2f0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x23c1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f944d2f0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406f30 0x23c1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f944d2f0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x231f570 con 0x23bc9d0 2024-01-22T05:08:27.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f944d2f0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x22e2f20 con 0x2406f30 2024-01-22T05:08:27.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f944d2f0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x22e8db0 con 0x2406660 2024-01-22T05:08:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f943b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x23c1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f943b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x23c1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38784/0 (socket says 172.21.15.49:38784) 2024-01-22T05:08:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f943b400700 1 -- 172.21.15.49:0/3032617789 learned_addr learned my addr 172.21.15.49:0/3032617789 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f9440e00700 1 --2- 172.21.15.49:0/3032617789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406f30 0x23c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f943be00700 1 --2- 172.21.15.49:0/3032617789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2406660 0x2406a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f943b400700 1 -- 172.21.15.49:0/3032617789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2406660 msgr2=0x2406a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f943b400700 1 --2- 172.21.15.49:0/3032617789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2406660 0x2406a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f943b400700 1 -- 172.21.15.49:0/3032617789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406f30 msgr2=0x23c1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f943b400700 1 --2- 172.21.15.49:0/3032617789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406f30 0x23c1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f943b400700 1 -- 172.21.15.49:0/3032617789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x233c850 con 0x23bc9d0 2024-01-22T05:08:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f943b400700 1 --2- 172.21.15.49:0/3032617789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x23c1040 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f94240497b0 tx=0x7f942400e000).ready entity=mon.0 client_cookie=de158362b47717e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f942be00700 1 -- 172.21.15.49:0/3032617789 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424052070 con 0x23bc9d0 2024-01-22T05:08:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.532+0000 7f942be00700 1 -- 172.21.15.49:0/3032617789 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942404cd50 con 0x23bc9d0 2024-01-22T05:08:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.536+0000 7f942be00700 1 -- 172.21.15.49:0/3032617789 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942404d390 con 0x23bc9d0 2024-01-22T05:08:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.536+0000 7f944d2f0740 1 -- 172.21.15.49:0/3032617789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 msgr2=0x23c1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.536+0000 7f944d2f0740 1 --2- 172.21.15.49:0/3032617789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x23c1040 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f94240497b0 tx=0x7f942400e000).stop 2024-01-22T05:08:27.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.536+0000 7f944d2f0740 1 -- 172.21.15.49:0/3032617789 shutdown_connections 2024-01-22T05:08:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.536+0000 7f944d2f0740 1 --2- 172.21.15.49:0/3032617789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406f30 0x23c1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.536+0000 7f944d2f0740 1 --2- 172.21.15.49:0/3032617789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x23c1040 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.536+0000 7f944d2f0740 1 --2- 172.21.15.49:0/3032617789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2406660 0x2406a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.536+0000 7f944d2f0740 1 -- 172.21.15.49:0/3032617789 >> 172.21.15.49:0/3032617789 conn(0x21a1710 msgr2=0x23c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.536+0000 7f944d2f0740 1 -- 172.21.15.49:0/3032617789 shutdown_connections 2024-01-22T05:08:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.536+0000 7f944d2f0740 1 -- 172.21.15.49:0/3032617789 wait complete. 2024-01-22T05:08:27.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.536+0000 7f944d2f0740 1 -- start start 2024-01-22T05:08:27.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.536+0000 7f944d2f0740 1 Processor -- start 2024-01-22T05:08:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f944d2f0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x23e7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f944d2f0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406660 0x2413f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f944d2f0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2406f30 0x23e6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f944d2f0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x23e6fd0 con 0x23bc9d0 2024-01-22T05:08:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f944d2f0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2400a10 con 0x2406660 2024-01-22T05:08:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f944d2f0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2414560 con 0x2406f30 2024-01-22T05:08:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f944d2f0740 10 client.0 ll_register_callbacks cb 0x23396d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f943be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x23e7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f943be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x23e7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38788/0 (socket says 172.21.15.49:38788) 2024-01-22T05:08:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f943be00700 1 -- 172.21.15.49:0/525829267 learned_addr learned my addr 172.21.15.49:0/525829267 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f9440e00700 1 --2- 172.21.15.49:0/525829267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2406f30 0x23e6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f943b400700 1 --2- 172.21.15.49:0/525829267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406660 0x2413f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f943be00700 1 -- 172.21.15.49:0/525829267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2406f30 msgr2=0x23e6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f943be00700 1 --2- 172.21.15.49:0/525829267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2406f30 0x23e6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f943be00700 1 -- 172.21.15.49:0/525829267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406660 msgr2=0x2413f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f943be00700 1 --2- 172.21.15.49:0/525829267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406660 0x2413f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.540+0000 7f943be00700 1 -- 172.21.15.49:0/525829267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c0a41f0 con 0x23bc9d0 2024-01-22T05:08:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f943be00700 1 --2- 172.21.15.49:0/525829267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x23e7160 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f942c0137b0 tx=0x7f942c016040).ready entity=mon.0 client_cookie=b79d3c188936b21d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f9428c00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f9428c00700 1 -- 172.21.15.49:0/525829267 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c012640 con 0x23bc9d0 2024-01-22T05:08:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f9428c00700 1 -- 172.21.15.49:0/525829267 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f942c0127a0 con 0x23bc9d0 2024-01-22T05:08:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f944d2f0740 1 -- 172.21.15.49:0/525829267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x23392c0 con 0x23bc9d0 2024-01-22T05:08:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f9428c00700 1 -- 172.21.15.49:0/525829267 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f942c012b70 con 0x23bc9d0 2024-01-22T05:08:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f944d2f0740 10 client.5949 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f944d2f0740 1 -- 172.21.15.49:0/525829267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x2337a80 con 0x23bc9d0 2024-01-22T05:08:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f9428c00700 1 -- 172.21.15.49:0/525829267 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x23392c0 con 0x23bc9d0 2024-01-22T05:08:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f9428c00700 1 -- 172.21.15.49:0/525829267 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f942c012cd0 con 0x23bc9d0 2024-01-22T05:08:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f944d2f0740 10 client.5949 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f944d2f0740 10 client.5949 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-22T05:08:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f944d2f0740 20 client.5949 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f944d2f0740 1 --2- 172.21.15.49:0/525829267 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x23ee2a0 0x23ec760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f944d2f0740 4 client.5949 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f944d2f0740 1 -- 172.21.15.49:0/525829267 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x232f810 con 0x23ee2a0 2024-01-22T05:08:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f943b400700 1 --2- 172.21.15.49:0/525829267 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x23ee2a0 0x23ec760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f943b400700 1 --2- 172.21.15.49:0/525829267 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x23ee2a0 0x23ec760 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=cbad1457f1744ad9 server_cookie=2670038e6e339d6b in_seq=0 out_seq=0 2024-01-22T05:08:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f9428c00700 10 client.5949 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f9428c00700 1 -- 172.21.15.49:0/525829267 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x232f810 con 0x23ee2a0 2024-01-22T05:08:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.544+0000 7f9428c00700 10 client.5949 handle_command_reply: tid=0 2024-01-22T05:08:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.548+0000 7f944d2f0740 1 client.5949 shutdown 2024-01-22T05:08:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.548+0000 7f944d2f0740 1 -- 172.21.15.49:0/525829267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 msgr2=0x23e7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.548+0000 7f944d2f0740 1 --2- 172.21.15.49:0/525829267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x23e7160 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f942c0137b0 tx=0x7f942c016040).stop 2024-01-22T05:08:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.548+0000 7f944d2f0740 1 -- 172.21.15.49:0/525829267 shutdown_connections 2024-01-22T05:08:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.548+0000 7f944d2f0740 1 --2- 172.21.15.49:0/525829267 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x23ee2a0 0x23ec760 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.548+0000 7f944d2f0740 1 --2- 172.21.15.49:0/525829267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2406f30 0x23e6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.548+0000 7f944d2f0740 1 --2- 172.21.15.49:0/525829267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406660 0x2413f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.548+0000 7f944d2f0740 1 --2- 172.21.15.49:0/525829267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x23e7160 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.548+0000 7f944d2f0740 1 -- 172.21.15.49:0/525829267 >> 172.21.15.49:0/525829267 conn(0x21a1710 msgr2=0x23bb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.548+0000 7f9428c00700 0 client.5949 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.548+0000 7f944d2f0740 1 -- 172.21.15.49:0/525829267 shutdown_connections 2024-01-22T05:08:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.548+0000 7f944d2f0740 1 -- 172.21.15.49:0/525829267 wait complete. 2024-01-22T05:08:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.548+0000 7f944d2f0740 20 client.5949 trim_cache size 0 max 16384 2024-01-22T05:08:27.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.564+0000 7f944d2f0740 1 Processor -- start 2024-01-22T05:08:27.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.564+0000 7f944d2f0740 1 -- start start 2024-01-22T05:08:27.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f944d2f0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x23bc9d0 0x2403fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f944d2f0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406660 0x24084c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f944d2f0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2406f30 0x2402e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f944d2f0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x23c0a20 con 0x2406f30 2024-01-22T05:08:27.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f944d2f0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2404ad0 con 0x2406660 2024-01-22T05:08:27.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f944d2f0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x23bc500 con 0x23bc9d0 2024-01-22T05:08:27.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f9440e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2406f30 0x2402e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f9440e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2406f30 0x2402e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38798/0 (socket says 172.21.15.49:38798) 2024-01-22T05:08:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f9440e00700 1 -- 172.21.15.49:0/290234102 learned_addr learned my addr 172.21.15.49:0/290234102 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f943be00700 1 --2- 172.21.15.49:0/290234102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x23bc9d0 0x2403fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f9440e00700 1 -- 172.21.15.49:0/290234102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x23bc9d0 msgr2=0x2403fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f9440e00700 1 --2- 172.21.15.49:0/290234102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x23bc9d0 0x2403fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f9440e00700 1 -- 172.21.15.49:0/290234102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406660 msgr2=0x24084c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f9440e00700 1 --2- 172.21.15.49:0/290234102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406660 0x24084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f9440e00700 1 -- 172.21.15.49:0/290234102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23e6e40 con 0x2406f30 2024-01-22T05:08:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.568+0000 7f9440e00700 1 --2- 172.21.15.49:0/290234102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2406f30 0x2402e90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f9434002bb0 tx=0x7f9434001430).ready entity=mon.0 client_cookie=38d0f85b5b7f5a87 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.572+0000 7f9430c00700 1 -- 172.21.15.49:0/290234102 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434013ad0 con 0x2406f30 2024-01-22T05:08:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.572+0000 7f9430c00700 1 -- 172.21.15.49:0/290234102 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9434013c30 con 0x2406f30 2024-01-22T05:08:27.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.572+0000 7f9430c00700 1 -- 172.21.15.49:0/290234102 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434016450 con 0x2406f30 2024-01-22T05:08:27.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.572+0000 7f944d2f0740 1 -- 172.21.15.49:0/290234102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2406f30 msgr2=0x2402e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.572+0000 7f944d2f0740 1 --2- 172.21.15.49:0/290234102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2406f30 0x2402e90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f9434002bb0 tx=0x7f9434001430).stop 2024-01-22T05:08:27.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.572+0000 7f944d2f0740 1 -- 172.21.15.49:0/290234102 shutdown_connections 2024-01-22T05:08:27.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.572+0000 7f944d2f0740 1 --2- 172.21.15.49:0/290234102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2406f30 0x2402e90 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.572+0000 7f944d2f0740 1 --2- 172.21.15.49:0/290234102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406660 0x24084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:27.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.572+0000 7f944d2f0740 1 --2- 172.21.15.49:0/290234102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x23bc9d0 0x2403fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.572+0000 7f944d2f0740 1 -- 172.21.15.49:0/290234102 >> 172.21.15.49:0/290234102 conn(0x21a1710 msgr2=0x23e7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:27.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.572+0000 7f944d2f0740 1 -- 172.21.15.49:0/290234102 shutdown_connections 2024-01-22T05:08:27.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.572+0000 7f944d2f0740 1 -- 172.21.15.49:0/290234102 wait complete. 2024-01-22T05:08:27.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.572+0000 7f944d2f0740 1 -- start start 2024-01-22T05:08:27.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.572+0000 7f944d2f0740 1 Processor -- start 2024-01-22T05:08:27.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.576+0000 7f944d2f0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x2461db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.576+0000 7f944d2f0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406660 0x2402e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.576+0000 7f944d2f0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2406f30 0x2403310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.576+0000 7f944d2f0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2403cd0 con 0x23bc9d0 2024-01-22T05:08:27.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.576+0000 7f944d2f0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2401d80 con 0x2406660 2024-01-22T05:08:27.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.576+0000 7f944d2f0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2413f30 con 0x2406f30 2024-01-22T05:08:27.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.576+0000 7f944d2f0740 10 client.0 ll_register_callbacks cb 0x7f942c00fd00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:27.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.576+0000 7f943be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x2461db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.576+0000 7f943be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x2461db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38802/0 (socket says 172.21.15.49:38802) 2024-01-22T05:08:27.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.576+0000 7f943be00700 1 -- 172.21.15.49:0/758594820 learned_addr learned my addr 172.21.15.49:0/758594820 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:27.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.576+0000 7f943b400700 1 --2- 172.21.15.49:0/758594820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406660 0x2402e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.576+0000 7f9440e00700 1 --2- 172.21.15.49:0/758594820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2406f30 0x2403310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f943be00700 1 -- 172.21.15.49:0/758594820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2406f30 msgr2=0x2403310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:27.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f943be00700 1 --2- 172.21.15.49:0/758594820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2406f30 0x2403310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f943be00700 1 -- 172.21.15.49:0/758594820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406660 msgr2=0x2402e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:27.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f943be00700 1 --2- 172.21.15.49:0/758594820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406660 0x2402e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f943be00700 1 -- 172.21.15.49:0/758594820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943400f040 con 0x23bc9d0 2024-01-22T05:08:27.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f943be00700 1 --2- 172.21.15.49:0/758594820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x2461db0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f942c00b9b0 tx=0x7f942c020000).ready entity=mon.0 client_cookie=46e6759d6ccee75a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:27.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f9428c00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:27.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f9428c00700 1 -- 172.21.15.49:0/758594820 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c026250 con 0x23bc9d0 2024-01-22T05:08:27.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f9428c00700 1 -- 172.21.15.49:0/758594820 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f942c012b70 con 0x23bc9d0 2024-01-22T05:08:27.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f944d2f0740 1 -- 172.21.15.49:0/758594820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f942404cd50 con 0x23bc9d0 2024-01-22T05:08:27.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f9428c00700 1 -- 172.21.15.49:0/758594820 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f942c005880 con 0x23bc9d0 2024-01-22T05:08:27.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f944d2f0740 10 client.5955 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:27.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f944d2f0740 1 -- 172.21.15.49:0/758594820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x7f943c0bca40 con 0x23bc9d0 2024-01-22T05:08:27.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f9428c00700 1 -- 172.21.15.49:0/758594820 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942404cd50 con 0x23bc9d0 2024-01-22T05:08:27.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f9428c00700 1 -- 172.21.15.49:0/758594820 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f942c036060 con 0x23bc9d0 2024-01-22T05:08:27.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f944d2f0740 10 client.5955 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:27.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f944d2f0740 10 client.5955 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-22T05:08:27.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f944d2f0740 20 client.5955 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:27.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f944d2f0740 1 --2- 172.21.15.49:0/758594820 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2400dd0 0x24011b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f944d2f0740 4 client.5955 mds_command: new command op to 5569 tid=0[{"prefix": "damage rm", "damage_id": 1699187118}] 2024-01-22T05:08:27.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f944d2f0740 1 -- 172.21.15.49:0/758594820 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "damage rm", "damage_id": 1699187118}) v1 -- 0x21f86a0 con 0x2400dd0 2024-01-22T05:08:27.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f943b400700 1 --2- 172.21.15.49:0/758594820 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2400dd0 0x24011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f9428c00700 10 client.5955 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:27.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.580+0000 7f943b400700 1 --2- 172.21.15.49:0/758594820 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2400dd0 0x24011b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d555df541c1df599 server_cookie=ff7195b8f6778fa in_seq=0 out_seq=0 2024-01-22T05:08:27.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f9428c00700 1 -- 172.21.15.49:0/758594820 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x21f86a0 con 0x2400dd0 2024-01-22T05:08:27.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f9428c00700 10 client.5955 handle_command_reply: tid=0 2024-01-22T05:08:27.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f944d2f0740 1 client.5955 shutdown 2024-01-22T05:08:27.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f944d2f0740 1 -- 172.21.15.49:0/758594820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 msgr2=0x2461db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f944d2f0740 1 --2- 172.21.15.49:0/758594820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x2461db0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f942c00b9b0 tx=0x7f942c020000).stop 2024-01-22T05:08:27.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f944d2f0740 1 -- 172.21.15.49:0/758594820 shutdown_connections 2024-01-22T05:08:27.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f944d2f0740 1 --2- 172.21.15.49:0/758594820 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2400dd0 0x24011b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f944d2f0740 1 --2- 172.21.15.49:0/758594820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2406f30 0x2403310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f944d2f0740 1 --2- 172.21.15.49:0/758594820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2406660 0x2402e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f944d2f0740 1 --2- 172.21.15.49:0/758594820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x23bc9d0 0x2461db0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f9428c00700 0 client.5955 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:27.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f944d2f0740 1 -- 172.21.15.49:0/758594820 >> 172.21.15.49:0/758594820 conn(0x21a1710 msgr2=0x23bffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:27.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f944d2f0740 1 -- 172.21.15.49:0/758594820 shutdown_connections 2024-01-22T05:08:27.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f944d2f0740 1 -- 172.21.15.49:0/758594820 wait complete. 2024-01-22T05:08:27.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f944d2f0740 20 client.5955 trim_cache size 0 max 16384 2024-01-22T05:08:27.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f9442e00700 1 -- 172.21.15.49:0/116773103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f941405a540 msgr2=0x7f941405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f9442e00700 1 --2- 172.21.15.49:0/116773103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f941405a540 0x7f941405ca00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f942c006fd0 tx=0x7f942c008040).stop 2024-01-22T05:08:27.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f9442e00700 1 -- 172.21.15.49:0/116773103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943c0a7520 msgr2=0x7f943c150e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f9442e00700 1 --2- 172.21.15.49:0/116773103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943c0a7520 0x7f943c150e90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f943c0599d0 tx=0x7f9424017000).stop 2024-01-22T05:08:27.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f9442e00700 1 -- 172.21.15.49:0/116773103 shutdown_connections 2024-01-22T05:08:27.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f9442e00700 1 --2- 172.21.15.49:0/116773103 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f941405a540 0x7f941405ca00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f9442e00700 1 --2- 172.21.15.49:0/116773103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943c0a7e70 0x7f943c0a6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f9442e00700 1 --2- 172.21.15.49:0/116773103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943c0a7520 0x7f943c150e90 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f9442e00700 1 --2- 172.21.15.49:0/116773103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f943c063e40 0x7f943c155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.584+0000 7f9442e00700 1 -- 172.21.15.49:0/116773103 >> 172.21.15.49:0/116773103 conn(0x7f943c0c4150 msgr2=0x7f943c151fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:27.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.588+0000 7f9442e00700 1 -- 172.21.15.49:0/116773103 shutdown_connections 2024-01-22T05:08:27.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.588+0000 7f9442e00700 1 -- 172.21.15.49:0/116773103 wait complete. 2024-01-22T05:08:27.612 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-01-22T05:08:27.612 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:27.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.772+0000 7f9cd9e00700 1 Processor -- start 2024-01-22T05:08:27.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.772+0000 7f9cd9e00700 1 -- start start 2024-01-22T05:08:27.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.776+0000 7f9cd9e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9cd40681a0 0x7f9cd415b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.776+0000 7f9cd9e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd40c4db0 con 0x7f9cd40c37d0 2024-01-22T05:08:27.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.776+0000 7f9cd9e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd40c5240 con 0x7f9cd40c3bb0 2024-01-22T05:08:27.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.776+0000 7f9cd9e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd4062230 con 0x7f9cd40681a0 2024-01-22T05:08:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.776+0000 7f9cd3e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9cd40681a0 0x7f9cd415b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.776+0000 7f9cd3e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9cd40681a0 0x7f9cd415b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38816/0 (socket says 172.21.15.49:38816) 2024-01-22T05:08:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.776+0000 7f9cd3e00700 1 -- 172.21.15.49:0/3722369115 learned_addr learned my addr 172.21.15.49:0/3722369115 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.776+0000 7f9cd3e00700 1 -- 172.21.15.49:0/3722369115 >> v1:172.21.15.110:6789/0 conn(0x7f9cd40c3bb0 legacy=0x7f9cd4067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.776+0000 7f9cd3e00700 1 -- 172.21.15.49:0/3722369115 >> v1:172.21.15.49:6789/0 conn(0x7f9cd40c37d0 legacy=0x7f9cd4153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.776+0000 7f9cd3e00700 1 -- 172.21.15.49:0/3722369115 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd41542e0 con 0x7f9cd40681a0 2024-01-22T05:08:27.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.780+0000 7f9cd3e00700 1 --2- 172.21.15.49:0/3722369115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd40681a0 0x7f9cd415b8b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f9cd41544d0 tx=0x7f9ccc009840).ready entity=mon.0 client_cookie=aa494302367a2070 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:27.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.780+0000 7f9cd1600700 1 -- 172.21.15.49:0/3722369115 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc00e070 con 0x7f9cd40681a0 2024-01-22T05:08:27.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.780+0000 7f9cd1600700 1 -- 172.21.15.49:0/3722369115 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ccc00bae0 con 0x7f9cd40681a0 2024-01-22T05:08:27.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.780+0000 7f9cd1600700 1 -- 172.21.15.49:0/3722369115 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc00be60 con 0x7f9cd40681a0 2024-01-22T05:08:27.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.780+0000 7f9cd9e00700 1 -- 172.21.15.49:0/3722369115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd40681a0 msgr2=0x7f9cd415b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.780+0000 7f9cd9e00700 1 --2- 172.21.15.49:0/3722369115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd40681a0 0x7f9cd415b8b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f9cd41544d0 tx=0x7f9ccc009840).stop 2024-01-22T05:08:27.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.780+0000 7f9cd9e00700 1 -- 172.21.15.49:0/3722369115 shutdown_connections 2024-01-22T05:08:27.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.780+0000 7f9cd9e00700 1 --2- 172.21.15.49:0/3722369115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd40681a0 0x7f9cd415b8b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.780+0000 7f9cd9e00700 1 -- 172.21.15.49:0/3722369115 >> 172.21.15.49:0/3722369115 conn(0x7f9cd4064080 msgr2=0x7f9cd4064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:27.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.780+0000 7f9cd9e00700 1 -- 172.21.15.49:0/3722369115 shutdown_connections 2024-01-22T05:08:27.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.780+0000 7f9cd9e00700 1 -- 172.21.15.49:0/3722369115 wait complete. 2024-01-22T05:08:27.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.784+0000 7f9cd9e00700 1 Processor -- start 2024-01-22T05:08:27.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.784+0000 7f9cd9e00700 1 -- start start 2024-01-22T05:08:27.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.784+0000 7f9cd9e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cd40681a0 0x7f9cd40adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.784+0000 7f9cd9e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd40c37d0 0x7f9cd414cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.784+0000 7f9cd9e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cd40c3bb0 0x7f9cd4062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.784+0000 7f9cd9e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd40ae0d0 con 0x7f9cd40c37d0 2024-01-22T05:08:27.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.784+0000 7f9cd9e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd40ad750 con 0x7f9cd40681a0 2024-01-22T05:08:27.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.784+0000 7f9cd9e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd40acb40 con 0x7f9cd40c3bb0 2024-01-22T05:08:27.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.784+0000 7f9cd2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd40c37d0 0x7f9cd414cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.788+0000 7f9cd2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd40c37d0 0x7f9cd414cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38828/0 (socket says 172.21.15.49:38828) 2024-01-22T05:08:27.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.788+0000 7f9cd2000700 1 -- 172.21.15.49:0/288484072 learned_addr learned my addr 172.21.15.49:0/288484072 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:27.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.788+0000 7f9cd2a00700 1 --2- 172.21.15.49:0/288484072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cd40681a0 0x7f9cd40adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.788+0000 7f9cd3e00700 1 --2- 172.21.15.49:0/288484072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cd40c3bb0 0x7f9cd4062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.788+0000 7f9cd2000700 1 -- 172.21.15.49:0/288484072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cd40c3bb0 msgr2=0x7f9cd4062960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.788+0000 7f9cd2000700 1 --2- 172.21.15.49:0/288484072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cd40c3bb0 0x7f9cd4062960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.788+0000 7f9cd2000700 1 -- 172.21.15.49:0/288484072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cd40681a0 msgr2=0x7f9cd40adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:27.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.788+0000 7f9cd2000700 1 --2- 172.21.15.49:0/288484072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cd40681a0 0x7f9cd40adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:27.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.788+0000 7f9cd2000700 1 -- 172.21.15.49:0/288484072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ccc009ae0 con 0x7f9cd40c37d0 2024-01-22T05:08:27.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.788+0000 7f9cd2000700 1 --2- 172.21.15.49:0/288484072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd40c37d0 0x7f9cd414cee0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f9cbc00c440 tx=0x7f9cbc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:27.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.788+0000 7f9cca000700 1 -- 172.21.15.49:0/288484072 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc007020 con 0x7f9cd40c37d0 2024-01-22T05:08:27.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.788+0000 7f9cca000700 1 -- 172.21.15.49:0/288484072 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cbc007180 con 0x7f9cd40c37d0 2024-01-22T05:08:27.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.788+0000 7f9cd9e00700 1 -- 172.21.15.49:0/288484072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd40ace20 con 0x7f9cd40c37d0 2024-01-22T05:08:27.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.788+0000 7f9cca000700 1 -- 172.21.15.49:0/288484072 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc007520 con 0x7f9cd40c37d0 2024-01-22T05:08:27.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.788+0000 7f9cd9e00700 1 -- 172.21.15.49:0/288484072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd40ad460 con 0x7f9cd40c37d0 2024-01-22T05:08:27.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.792+0000 7f9cd9e00700 1 -- 172.21.15.49:0/288484072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd40ad900 con 0x7f9cd40c37d0 2024-01-22T05:08:27.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.792+0000 7f9cca000700 1 -- 172.21.15.49:0/288484072 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9cbc0068b0 con 0x7f9cd40c37d0 2024-01-22T05:08:27.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.792+0000 7f9cca000700 1 --2- 172.21.15.49:0/288484072 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9cac05a510 0x7f9cac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:27.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.792+0000 7f9cca000700 1 -- 172.21.15.49:0/288484072 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9cbc073b40 con 0x7f9cd40c37d0 2024-01-22T05:08:27.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.792+0000 7f9cd2a00700 1 --2- 172.21.15.49:0/288484072 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9cac05a510 0x7f9cac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:27.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.792+0000 7f9cd2a00700 1 --2- 172.21.15.49:0/288484072 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9cac05a510 0x7f9cac05c9d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f9cc4003900 tx=0x7f9cc4007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:27.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.796+0000 7f9cca000700 1 -- 172.21.15.49:0/288484072 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9cd40ad900 con 0x7f9cd40c37d0 2024-01-22T05:08:27.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.992+0000 7f9cd9e00700 1 -- 172.21.15.49:0/288484072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cd4047060 con 0x7f9cd40c37d0 2024-01-22T05:08:27.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.992+0000 7f9cca000700 1 -- 172.21.15.49:0/288484072 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f9cbc047180 con 0x7f9cd40c37d0 2024-01-22T05:08:27.997 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:27.997 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:22.134281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":8,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:27.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.996+0000 7f9cd9e00700 1 -- 172.21.15.49:0/288484072 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9cac05a510 msgr2=0x7f9cac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:28.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.996+0000 7f9cd9e00700 1 --2- 172.21.15.49:0/288484072 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9cac05a510 0x7f9cac05c9d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f9cc4003900 tx=0x7f9cc4007d40).stop 2024-01-22T05:08:28.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.996+0000 7f9cd9e00700 1 -- 172.21.15.49:0/288484072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd40c37d0 msgr2=0x7f9cd414cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:28.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.996+0000 7f9cd9e00700 1 --2- 172.21.15.49:0/288484072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd40c37d0 0x7f9cd414cee0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f9cbc00c440 tx=0x7f9cbc007e00).stop 2024-01-22T05:08:28.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.996+0000 7f9cd9e00700 1 -- 172.21.15.49:0/288484072 shutdown_connections 2024-01-22T05:08:28.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.996+0000 7f9cd9e00700 1 --2- 172.21.15.49:0/288484072 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9cac05a510 0x7f9cac05c9d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:28.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.996+0000 7f9cd9e00700 1 --2- 172.21.15.49:0/288484072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cd40c3bb0 0x7f9cd4062960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:28.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.996+0000 7f9cd9e00700 1 --2- 172.21.15.49:0/288484072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd40c37d0 0x7f9cd414cee0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:28.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.996+0000 7f9cd9e00700 1 --2- 172.21.15.49:0/288484072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cd40681a0 0x7f9cd40adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:28.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.996+0000 7f9cd9e00700 1 -- 172.21.15.49:0/288484072 >> 172.21.15.49:0/288484072 conn(0x7f9cd4064080 msgr2=0x7f9cd40685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:28.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.996+0000 7f9cd9e00700 1 -- 172.21.15.49:0/288484072 shutdown_connections 2024-01-22T05:08:28.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:27.996+0000 7f9cd9e00700 1 -- 172.21.15.49:0/288484072 wait complete. 2024-01-22T05:08:28.004 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 44 2024-01-22T05:08:28.023 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path / 2024-01-22T05:08:28.181 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:28.181 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:08:28.181 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:28.197 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2024-01-22T05:08:28.197 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-01-22T05:08:28.198 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-01-22T05:08:28.198 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-01-22T05:08:28.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:08:28.198 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-01-22T05:08:28.219 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:08:28.219 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-01-22T05:08:28.219 DEBUG:teuthology.orchestra.run.smithi049:> import stat 2024-01-22T05:08:28.219 DEBUG:teuthology.orchestra.run.smithi049:> import json 2024-01-22T05:08:28.219 DEBUG:teuthology.orchestra.run.smithi049:> import sys 2024-01-22T05:08:28.219 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:08:28.219 DEBUG:teuthology.orchestra.run.smithi049:> try: 2024-01-22T05:08:28.219 DEBUG:teuthology.orchestra.run.smithi049:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-01-22T05:08:28.219 DEBUG:teuthology.orchestra.run.smithi049:> except OSError as e: 2024-01-22T05:08:28.219 DEBUG:teuthology.orchestra.run.smithi049:> sys.exit(e.errno) 2024-01-22T05:08:28.220 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:08:28.220 DEBUG:teuthology.orchestra.run.smithi049:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-01-22T05:08:28.220 DEBUG:teuthology.orchestra.run.smithi049:> print(json.dumps( 2024-01-22T05:08:28.220 DEBUG:teuthology.orchestra.run.smithi049:> dict([(a, getattr(s, a)) for a in attrs]), 2024-01-22T05:08:28.220 DEBUG:teuthology.orchestra.run.smithi049:> indent=2)) 2024-01-22T05:08:28.220 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-01-22T05:08:28.364 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:28.364 INFO:teuthology.orchestra.run.smithi049.stdout: "st_mode": 16893, 2024-01-22T05:08:28.364 INFO:teuthology.orchestra.run.smithi049.stdout: "st_ino": 1099511627777, 2024-01-22T05:08:28.365 INFO:teuthology.orchestra.run.smithi049.stdout: "st_dev": 49, 2024-01-22T05:08:28.365 INFO:teuthology.orchestra.run.smithi049.stdout: "st_nlink": 16, 2024-01-22T05:08:28.365 INFO:teuthology.orchestra.run.smithi049.stdout: "st_uid": 1000, 2024-01-22T05:08:28.365 INFO:teuthology.orchestra.run.smithi049.stdout: "st_gid": 1267, 2024-01-22T05:08:28.365 INFO:teuthology.orchestra.run.smithi049.stdout: "st_size": 18, 2024-01-22T05:08:28.365 INFO:teuthology.orchestra.run.smithi049.stdout: "st_atime": 1705900089.908697, 2024-01-22T05:08:28.365 INFO:teuthology.orchestra.run.smithi049.stdout: "st_mtime": 1705900099.4444733, 2024-01-22T05:08:28.365 INFO:teuthology.orchestra.run.smithi049.stdout: "st_ctime": 1705900099.4444733 2024-01-22T05:08:28.366 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:28.547 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2024-01-22T05:08:28.547 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-01-22T05:08:28.547 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.764+0000 7fe246200700 1 Processor -- start 2024-01-22T05:08:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.764+0000 7fe246200700 1 -- start start 2024-01-22T05:08:28.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.768+0000 7fe246200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe240153cb0 0x7fe2400bda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:28.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.768+0000 7fe246200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2400693f0 con 0x7fe240154090 2024-01-22T05:08:28.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.768+0000 7fe246200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2400c3200 con 0x7fe2400be640 2024-01-22T05:08:28.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.768+0000 7fe246200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe240063b10 con 0x7fe240153cb0 2024-01-22T05:08:28.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.768+0000 7fe23ea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe240154090 0x7fe2400bdf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60072/0 (socket says 172.21.15.49:60072) 2024-01-22T05:08:28.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.768+0000 7fe23ea00700 1 -- 172.21.15.49:0/579670079 learned_addr learned my addr 172.21.15.49:0/579670079 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:28.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.768+0000 7fe23f400700 1 --2- 172.21.15.49:0/579670079 >> v2:172.21.15.110:3300/0 conn(0x7fe240153cb0 0x7fe2400bda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:28.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.768+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945526269 0 0) 0x7fe2400693f0 con 0x7fe240154090 2024-01-22T05:08:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.768+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2200033f0 con 0x7fe240154090 2024-01-22T05:08:28.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025008570 0 0) 0x7fe2400c3200 con 0x7fe2400be640 2024-01-22T05:08:28.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2400693f0 con 0x7fe2400be640 2024-01-22T05:08:28.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4180534766 0 0) 0x7fe2200033f0 con 0x7fe240154090 2024-01-22T05:08:28.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 >> v2:172.21.15.110:3300/0 conn(0x7fe240153cb0 msgr2=0x7fe2400bda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:28.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 --2- 172.21.15.49:0/579670079 >> v2:172.21.15.110:3300/0 conn(0x7fe240153cb0 0x7fe2400bda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:28.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 >> v1:172.21.15.110:6789/0 conn(0x7fe2400be640 legacy=0x7fe2400c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:28.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe240068b50 con 0x7fe240154090 2024-01-22T05:08:28.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fe228001470 con 0x7fe240154090 2024-01-22T05:08:28.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 >> v1:172.21.15.49:6789/0 conn(0x7fe240154090 legacy=0x7fe2400bdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:28.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 --2- 172.21.15.49:0/579670079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe220003a70 0x7fe220003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:28.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 --2- 172.21.15.49:0/579670079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe220004690 0x7fe220004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:28.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 --2- 172.21.15.49:0/579670079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe220005050 0x7fe22000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe240063b10 con 0x7fe220003a70 2024-01-22T05:08:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22000bfc0 con 0x7fe220005050 2024-01-22T05:08:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22000c180 con 0x7fe220004690 2024-01-22T05:08:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23f400700 1 --2- 172.21.15.49:0/579670079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe220003a70 0x7fe220003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23ea00700 1 --2- 172.21.15.49:0/579670079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe220004690 0x7fe220004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23fe00700 1 --2- 172.21.15.49:0/579670079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe220005050 0x7fe22000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23f400700 1 -- 172.21.15.49:0/579670079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe220004690 msgr2=0x7fe220004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23f400700 1 --2- 172.21.15.49:0/579670079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe220004690 0x7fe220004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23f400700 1 -- 172.21.15.49:0/579670079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe220005050 msgr2=0x7fe22000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23f400700 1 --2- 172.21.15.49:0/579670079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe220005050 0x7fe22000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23f400700 1 -- 172.21.15.49:0/579670079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2200033f0 con 0x7fe220003a70 2024-01-22T05:08:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23fe00700 1 --2- 172.21.15.49:0/579670079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe220005050 0x7fe22000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23fe00700 1 -- 172.21.15.49:0/579670079 reap_dead start 2024-01-22T05:08:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23f400700 1 --2- 172.21.15.49:0/579670079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe220003a70 0x7fe220003e70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fe230009a80 tx=0x7fe230009060).ready entity=mon.0 client_cookie=19928e816349d1d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230009430 con 0x7fe220003a70 2024-01-22T05:08:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23000e640 con 0x7fe220003a70 2024-01-22T05:08:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe23e000700 1 -- 172.21.15.49:0/579670079 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23000e9c0 con 0x7fe220003a70 2024-01-22T05:08:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe246200700 1 -- 172.21.15.49:0/579670079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe220003a70 msgr2=0x7fe220003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.772+0000 7fe246200700 1 --2- 172.21.15.49:0/579670079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe220003a70 0x7fe220003e70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fe230009a80 tx=0x7fe230009060).stop 2024-01-22T05:08:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.776+0000 7fe246200700 1 -- 172.21.15.49:0/579670079 shutdown_connections 2024-01-22T05:08:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.776+0000 7fe246200700 1 --2- 172.21.15.49:0/579670079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe220003a70 0x7fe220003e70 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.776+0000 7fe246200700 1 -- 172.21.15.49:0/579670079 >> 172.21.15.49:0/579670079 conn(0x7fe2400c8730 msgr2=0x7fe2400c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.776+0000 7fe246200700 1 -- 172.21.15.49:0/579670079 shutdown_connections 2024-01-22T05:08:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.776+0000 7fe246200700 1 -- 172.21.15.49:0/579670079 wait complete. 2024-01-22T05:08:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.776+0000 7fe246200700 1 Processor -- start 2024-01-22T05:08:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe246200700 1 -- start start 2024-01-22T05:08:28.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe246200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe220003a70 0x7fe2401550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:28.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe246200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe240143220 0x7fe2400ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:28.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe246200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400ad900 0x7fe2400ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:28.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe246200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2400bf7d0 con 0x7fe2400ad900 2024-01-22T05:08:28.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe246200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2400c0070 con 0x7fe240143220 2024-01-22T05:08:28.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe246200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2400add80 con 0x7fe220003a70 2024-01-22T05:08:28.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe23fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400ad900 0x7fe2400ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:28.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe23fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400ad900 0x7fe2400ac0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38858/0 (socket says 172.21.15.49:38858) 2024-01-22T05:08:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe23fe00700 1 -- 172.21.15.49:0/640819270 learned_addr learned my addr 172.21.15.49:0/640819270 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe23ea00700 1 --2- 172.21.15.49:0/640819270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe240143220 0x7fe2400ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe23f400700 1 --2- 172.21.15.49:0/640819270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe220003a70 0x7fe2401550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe23fe00700 1 -- 172.21.15.49:0/640819270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe220003a70 msgr2=0x7fe2401550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe23fe00700 1 --2- 172.21.15.49:0/640819270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe220003a70 0x7fe2401550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe23fe00700 1 -- 172.21.15.49:0/640819270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe240143220 msgr2=0x7fe2400ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe23fe00700 1 --2- 172.21.15.49:0/640819270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe240143220 0x7fe2400ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe23fe00700 1 -- 172.21.15.49:0/640819270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2400ace20 con 0x7fe2400ad900 2024-01-22T05:08:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe23f400700 1 --2- 172.21.15.49:0/640819270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe220003a70 0x7fe2401550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:28.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.780+0000 7fe23fe00700 1 --2- 172.21.15.49:0/640819270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400ad900 0x7fe2400ac0d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fe23800e5e0 tx=0x7fe238009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:28.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.784+0000 7fe236a00700 1 -- 172.21.15.49:0/640819270 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238003030 con 0x7fe2400ad900 2024-01-22T05:08:28.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.784+0000 7fe236a00700 1 -- 172.21.15.49:0/640819270 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe238003190 con 0x7fe2400ad900 2024-01-22T05:08:28.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.784+0000 7fe246200700 1 -- 172.21.15.49:0/640819270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2400bfa20 con 0x7fe2400ad900 2024-01-22T05:08:28.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.784+0000 7fe236a00700 1 -- 172.21.15.49:0/640819270 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238003530 con 0x7fe2400ad900 2024-01-22T05:08:28.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.784+0000 7fe246200700 1 -- 172.21.15.49:0/640819270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe240143680 con 0x7fe2400ad900 2024-01-22T05:08:28.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.784+0000 7fe246200700 1 -- 172.21.15.49:0/640819270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2400bfea0 con 0x7fe2400ad900 2024-01-22T05:08:28.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.788+0000 7fe236a00700 1 -- 172.21.15.49:0/640819270 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe238001b00 con 0x7fe2400ad900 2024-01-22T05:08:28.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.788+0000 7fe236a00700 1 --2- 172.21.15.49:0/640819270 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe21805a540 0x7fe21805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:28.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.788+0000 7fe236a00700 1 -- 172.21.15.49:0/640819270 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe238073eb0 con 0x7fe2400ad900 2024-01-22T05:08:28.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.788+0000 7fe23f400700 1 --2- 172.21.15.49:0/640819270 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe21805a540 0x7fe21805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:28.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.788+0000 7fe23f400700 1 --2- 172.21.15.49:0/640819270 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe21805a540 0x7fe21805ca00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fe230006d50 tx=0x7fe23001a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:28.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:28.796+0000 7fe236a00700 1 -- 172.21.15.49:0/640819270 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe2380474e0 con 0x7fe2400ad900 2024-01-22T05:08:29.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.004+0000 7fe246200700 1 -- 172.21.15.49:0/640819270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2400c01b0 con 0x7fe2400ad900 2024-01-22T05:08:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.004+0000 7fe236a00700 1 -- 172.21.15.49:0/640819270 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fe238001db0 con 0x7fe2400ad900 2024-01-22T05:08:29.008 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:29.009 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:22.134281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":8,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:29.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.008+0000 7fe246200700 1 -- 172.21.15.49:0/640819270 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe21805a540 msgr2=0x7fe21805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.008+0000 7fe246200700 1 --2- 172.21.15.49:0/640819270 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe21805a540 0x7fe21805ca00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fe230006d50 tx=0x7fe23001a000).stop 2024-01-22T05:08:29.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.008+0000 7fe246200700 1 -- 172.21.15.49:0/640819270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400ad900 msgr2=0x7fe2400ac0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.008+0000 7fe246200700 1 --2- 172.21.15.49:0/640819270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400ad900 0x7fe2400ac0d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fe23800e5e0 tx=0x7fe238009040).stop 2024-01-22T05:08:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.008+0000 7fe246200700 1 -- 172.21.15.49:0/640819270 shutdown_connections 2024-01-22T05:08:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.008+0000 7fe246200700 1 --2- 172.21.15.49:0/640819270 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe21805a540 0x7fe21805ca00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.008+0000 7fe246200700 1 --2- 172.21.15.49:0/640819270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2400ad900 0x7fe2400ac0d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.008+0000 7fe246200700 1 --2- 172.21.15.49:0/640819270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe240143220 0x7fe2400ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.008+0000 7fe246200700 1 --2- 172.21.15.49:0/640819270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe220003a70 0x7fe2401550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.008+0000 7fe246200700 1 -- 172.21.15.49:0/640819270 >> 172.21.15.49:0/640819270 conn(0x7fe2400c8730 msgr2=0x7fe2400bd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.008+0000 7fe246200700 1 -- 172.21.15.49:0/640819270 shutdown_connections 2024-01-22T05:08:29.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.008+0000 7fe246200700 1 -- 172.21.15.49:0/640819270 wait complete. 2024-01-22T05:08:29.016 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 44 2024-01-22T05:08:29.036 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/i/dont/exist 2024-01-22T05:08:29.183 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:29.183 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": -2 2024-01-22T05:08:29.183 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:29.195 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' got response code '0' and stdout '{ "return_code": -2 } ' 2024-01-22T05:08:29.195 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-01-22T05:08:29.195 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-01-22T05:08:29.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.364+0000 7f4476e00700 1 Processor -- start 2024-01-22T05:08:29.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.364+0000 7f4476e00700 1 -- start start 2024-01-22T05:08:29.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.368+0000 7f4476e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4470064250 0x7f44700c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.368+0000 7f4476e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4470068bd0 con 0x7f4470069c70 2024-01-22T05:08:29.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.368+0000 7f4476e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4470068eb0 con 0x7f4470063df0 2024-01-22T05:08:29.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.368+0000 7f4476e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4470069190 con 0x7f4470064250 2024-01-22T05:08:29.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.368+0000 7f446fe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4470069c70 0x7f44700bcfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60074/0 (socket says 172.21.15.49:60074) 2024-01-22T05:08:29.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.368+0000 7f446fe00700 1 -- 172.21.15.49:0/3086995092 learned_addr learned my addr 172.21.15.49:0/3086995092 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:29.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.368+0000 7f4474e00700 1 --2- 172.21.15.49:0/3086995092 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4470064250 0x7f44700c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f446ea00700 1 -- 172.21.15.49:0/3086995092 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33357832 0 0) 0x7f4470068bd0 con 0x7f4470069c70 2024-01-22T05:08:29.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f446ea00700 1 -- 172.21.15.49:0/3086995092 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44500033f0 con 0x7f4470069c70 2024-01-22T05:08:29.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f446ea00700 1 -- 172.21.15.49:0/3086995092 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998386035 0 0) 0x7f4470068eb0 con 0x7f4470063df0 2024-01-22T05:08:29.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f446ea00700 1 -- 172.21.15.49:0/3086995092 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4470068bd0 con 0x7f4470063df0 2024-01-22T05:08:29.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f446ea00700 1 -- 172.21.15.49:0/3086995092 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2234351122 0 0) 0x7f44500033f0 con 0x7f4470069c70 2024-01-22T05:08:29.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f4474e00700 1 -- 172.21.15.49:0/3086995092 >> v1:172.21.15.110:6789/0 conn(0x7f4470063df0 legacy=0x7f44700c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f4474e00700 1 -- 172.21.15.49:0/3086995092 >> v1:172.21.15.49:6789/0 conn(0x7f4470069c70 legacy=0x7f44700bcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f4474e00700 1 -- 172.21.15.49:0/3086995092 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4470069470 con 0x7f4470064250 2024-01-22T05:08:29.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f4474e00700 1 --2- 172.21.15.49:0/3086995092 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4470064250 0x7f44700c2360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f4468009e90 tx=0x7f4468009780).ready entity=mon.2 client_cookie=b067c1991612035d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f446ea00700 1 -- 172.21.15.49:0/3086995092 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446800e070 con 0x7f4470064250 2024-01-22T05:08:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f446ea00700 1 -- 172.21.15.49:0/3086995092 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446800b7a0 con 0x7f4470064250 2024-01-22T05:08:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f446ea00700 1 -- 172.21.15.49:0/3086995092 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460001470 con 0x7f4470064250 2024-01-22T05:08:29.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f4476e00700 1 -- 172.21.15.49:0/3086995092 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4470064250 msgr2=0x7f44700c2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f4476e00700 1 --2- 172.21.15.49:0/3086995092 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4470064250 0x7f44700c2360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f4468009e90 tx=0x7f4468009780).stop 2024-01-22T05:08:29.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f4476e00700 1 -- 172.21.15.49:0/3086995092 shutdown_connections 2024-01-22T05:08:29.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f4476e00700 1 --2- 172.21.15.49:0/3086995092 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4470064250 0x7f44700c2360 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.372+0000 7f4476e00700 1 -- 172.21.15.49:0/3086995092 >> 172.21.15.49:0/3086995092 conn(0x7f44700c40f0 msgr2=0x7f44700c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.376+0000 7f4476e00700 1 -- 172.21.15.49:0/3086995092 shutdown_connections 2024-01-22T05:08:29.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.376+0000 7f4476e00700 1 -- 172.21.15.49:0/3086995092 wait complete. 2024-01-22T05:08:29.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.376+0000 7f4476e00700 1 Processor -- start 2024-01-22T05:08:29.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.376+0000 7f4476e00700 1 -- start start 2024-01-22T05:08:29.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f4476e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4470063df0 0x7f4470163c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f4476e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4470064250 0x7f44701529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f4476e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4470069c70 0x7f4470150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f4476e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44700be6f0 con 0x7f4470063df0 2024-01-22T05:08:29.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f4476e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4470153440 con 0x7f4470064250 2024-01-22T05:08:29.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f4476e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4470153720 con 0x7f4470069c70 2024-01-22T05:08:29.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f446fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4470063df0 0x7f4470163c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f446fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4470063df0 0x7f4470163c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38870/0 (socket says 172.21.15.49:38870) 2024-01-22T05:08:29.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f446fe00700 1 -- 172.21.15.49:0/1800300561 learned_addr learned my addr 172.21.15.49:0/1800300561 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f4474e00700 1 --2- 172.21.15.49:0/1800300561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4470069c70 0x7f4470150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f446f400700 1 --2- 172.21.15.49:0/1800300561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4470064250 0x7f44701529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f446fe00700 1 -- 172.21.15.49:0/1800300561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4470069c70 msgr2=0x7f4470150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f446fe00700 1 --2- 172.21.15.49:0/1800300561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4470069c70 0x7f4470150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f446fe00700 1 -- 172.21.15.49:0/1800300561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4470064250 msgr2=0x7f44701529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f446fe00700 1 --2- 172.21.15.49:0/1800300561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4470064250 0x7f44701529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f446fe00700 1 -- 172.21.15.49:0/1800300561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4468009a20 con 0x7f4470063df0 2024-01-22T05:08:29.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.380+0000 7f446fe00700 1 --2- 172.21.15.49:0/1800300561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4470063df0 0x7f4470163c70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f446000c800 tx=0x7f4460001ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.384+0000 7f4467400700 1 -- 172.21.15.49:0/1800300561 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460007170 con 0x7f4470063df0 2024-01-22T05:08:29.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.384+0000 7f4467400700 1 -- 172.21.15.49:0/1800300561 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4460007310 con 0x7f4470063df0 2024-01-22T05:08:29.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.384+0000 7f4467400700 1 -- 172.21.15.49:0/1800300561 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44600048c0 con 0x7f4470063df0 2024-01-22T05:08:29.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.384+0000 7f4476e00700 1 -- 172.21.15.49:0/1800300561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4470153a00 con 0x7f4470063df0 2024-01-22T05:08:29.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.384+0000 7f4476e00700 1 -- 172.21.15.49:0/1800300561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4470164160 con 0x7f4470063df0 2024-01-22T05:08:29.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.388+0000 7f4467400700 1 -- 172.21.15.49:0/1800300561 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4460004c30 con 0x7f4470063df0 2024-01-22T05:08:29.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.388+0000 7f4467400700 1 --2- 172.21.15.49:0/1800300561 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f444805a4e0 0x7f444805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.388+0000 7f4467400700 1 -- 172.21.15.49:0/1800300561 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4460074370 con 0x7f4470063df0 2024-01-22T05:08:29.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.388+0000 7f446f400700 1 --2- 172.21.15.49:0/1800300561 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f444805a4e0 0x7f444805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.392+0000 7f446f400700 1 --2- 172.21.15.49:0/1800300561 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f444805a4e0 0x7f444805c9a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f44700a7040 tx=0x7f4458009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.392+0000 7f4481382740 1 Processor -- start 2024-01-22T05:08:29.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.392+0000 7f4481382740 1 -- start start 2024-01-22T05:08:29.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.392+0000 7f4481382740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2583a20 0x25c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.392+0000 7f4481382740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a9100 0x2583e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.392+0000 7f4481382740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c6930 0x25c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.392+0000 7f4481382740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x24bd3c0 con 0x25a9100 2024-01-22T05:08:29.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.392+0000 7f4481382740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x24e05c0 con 0x2583a20 2024-01-22T05:08:29.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.392+0000 7f4481382740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x24a9cf0 con 0x25c6930 2024-01-22T05:08:29.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.392+0000 7f446f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a9100 0x2583e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.392+0000 7f446f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a9100 0x2583e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38886/0 (socket says 172.21.15.49:38886) 2024-01-22T05:08:29.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.392+0000 7f446f400700 1 -- 172.21.15.49:0/1740241909 learned_addr learned my addr 172.21.15.49:0/1740241909 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f446fe00700 1 --2- 172.21.15.49:0/1740241909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2583a20 0x25c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f4474e00700 1 --2- 172.21.15.49:0/1740241909 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c6930 0x25c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f446f400700 1 -- 172.21.15.49:0/1740241909 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c6930 msgr2=0x25c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f446f400700 1 --2- 172.21.15.49:0/1740241909 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c6930 0x25c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f446f400700 1 -- 172.21.15.49:0/1740241909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2583a20 msgr2=0x25c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f446f400700 1 --2- 172.21.15.49:0/1740241909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2583a20 0x25c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f446f400700 1 -- 172.21.15.49:0/1740241909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x250ea00 con 0x25a9100 2024-01-22T05:08:29.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f446fe00700 1 --2- 172.21.15.49:0/1740241909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2583a20 0x25c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:29.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f446f400700 1 --2- 172.21.15.49:0/1740241909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a9100 0x2583e00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f4458017610 tx=0x7f4458012000).ready entity=mon.0 client_cookie=5113efaaa368e08c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f445fe00700 1 -- 172.21.15.49:0/1740241909 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445801c070 con 0x25a9100 2024-01-22T05:08:29.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f445fe00700 1 -- 172.21.15.49:0/1740241909 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4458014480 con 0x25a9100 2024-01-22T05:08:29.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f445fe00700 1 -- 172.21.15.49:0/1740241909 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44580145f0 con 0x25a9100 2024-01-22T05:08:29.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f4481382740 1 -- 172.21.15.49:0/1740241909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a9100 msgr2=0x2583e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f4481382740 1 --2- 172.21.15.49:0/1740241909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a9100 0x2583e00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f4458017610 tx=0x7f4458012000).stop 2024-01-22T05:08:29.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f4481382740 1 -- 172.21.15.49:0/1740241909 shutdown_connections 2024-01-22T05:08:29.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f4481382740 1 --2- 172.21.15.49:0/1740241909 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c6930 0x25c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f4481382740 1 --2- 172.21.15.49:0/1740241909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a9100 0x2583e00 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f4481382740 1 --2- 172.21.15.49:0/1740241909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2583a20 0x25c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f4481382740 1 -- 172.21.15.49:0/1740241909 >> 172.21.15.49:0/1740241909 conn(0x2362890 msgr2=0x2581b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f4481382740 1 -- 172.21.15.49:0/1740241909 shutdown_connections 2024-01-22T05:08:29.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f4481382740 1 -- 172.21.15.49:0/1740241909 wait complete. 2024-01-22T05:08:29.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.396+0000 7f4481382740 1 -- start start 2024-01-22T05:08:29.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f4481382740 1 Processor -- start 2024-01-22T05:08:29.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f4481382740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2583a20 0x25a89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f4481382740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a9100 0x25ae010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f4481382740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c6930 0x25c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f4481382740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x25cc310 con 0x25a9100 2024-01-22T05:08:29.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f4481382740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x25ae840 con 0x2583a20 2024-01-22T05:08:29.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f4481382740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x25a9a60 con 0x25c6930 2024-01-22T05:08:29.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f4481382740 10 client.0 ll_register_callbacks cb 0x253b360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:29.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f446f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a9100 0x25ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f446f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a9100 0x25ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38898/0 (socket says 172.21.15.49:38898) 2024-01-22T05:08:29.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f446f400700 1 -- 172.21.15.49:0/3798405057 learned_addr learned my addr 172.21.15.49:0/3798405057 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f446fe00700 1 --2- 172.21.15.49:0/3798405057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2583a20 0x25a89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f4474e00700 1 --2- 172.21.15.49:0/3798405057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c6930 0x25c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f446f400700 1 -- 172.21.15.49:0/3798405057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c6930 msgr2=0x25c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f446f400700 1 --2- 172.21.15.49:0/3798405057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c6930 0x25c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f446f400700 1 -- 172.21.15.49:0/3798405057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2583a20 msgr2=0x25a89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f446f400700 1 --2- 172.21.15.49:0/3798405057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2583a20 0x25a89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.400+0000 7f446f400700 1 -- 172.21.15.49:0/3798405057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445800f040 con 0x25a9100 2024-01-22T05:08:29.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f446f400700 1 --2- 172.21.15.49:0/3798405057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a9100 0x25ae010 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x24efc60 tx=0x7f4458014000).ready entity=mon.0 client_cookie=1f77d7b4ec065b40 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f445cc00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:29.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f445cc00700 1 -- 172.21.15.49:0/3798405057 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44580145f0 con 0x25a9100 2024-01-22T05:08:29.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f445cc00700 1 -- 172.21.15.49:0/3798405057 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f445801ead0 con 0x25a9100 2024-01-22T05:08:29.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f4481382740 1 -- 172.21.15.49:0/3798405057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x24fa310 con 0x25a9100 2024-01-22T05:08:29.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f445cc00700 1 -- 172.21.15.49:0/3798405057 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4458007980 con 0x25a9100 2024-01-22T05:08:29.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f4481382740 10 client.5982 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:29.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f4481382740 1 -- 172.21.15.49:0/3798405057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x24fd8a0 con 0x25a9100 2024-01-22T05:08:29.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f445cc00700 1 -- 172.21.15.49:0/3798405057 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4458032070 con 0x25a9100 2024-01-22T05:08:29.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f445cc00700 1 -- 172.21.15.49:0/3798405057 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f445802c060 con 0x25a9100 2024-01-22T05:08:29.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f4481382740 10 client.5982 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:29.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f4481382740 10 client.5982 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:29.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f4481382740 20 client.5982 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:29.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f4481382740 1 --2- 172.21.15.49:0/3798405057 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25cb3f0 0x25cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f4481382740 4 client.5982 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:29.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f4481382740 1 -- 172.21.15.49:0/3798405057 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x24f0860 con 0x25cb3f0 2024-01-22T05:08:29.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f446fe00700 1 --2- 172.21.15.49:0/3798405057 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25cb3f0 0x25cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f446fe00700 1 --2- 172.21.15.49:0/3798405057 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25cb3f0 0x25cb7d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3fec33a1d8b397b2 server_cookie=11b91dab59b1a9e8 in_seq=0 out_seq=0 2024-01-22T05:08:29.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f445cc00700 10 client.5982 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:29.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f445cc00700 1 -- 172.21.15.49:0/3798405057 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x24f0860 con 0x25cb3f0 2024-01-22T05:08:29.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f445cc00700 10 client.5982 handle_command_reply: tid=0 2024-01-22T05:08:29.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.404+0000 7f4481382740 1 client.5982 shutdown 2024-01-22T05:08:29.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.408+0000 7f4481382740 1 -- 172.21.15.49:0/3798405057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a9100 msgr2=0x25ae010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.408+0000 7f4481382740 1 --2- 172.21.15.49:0/3798405057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a9100 0x25ae010 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x24efc60 tx=0x7f4458014000).stop 2024-01-22T05:08:29.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.408+0000 7f4481382740 1 -- 172.21.15.49:0/3798405057 shutdown_connections 2024-01-22T05:08:29.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.408+0000 7f4481382740 1 --2- 172.21.15.49:0/3798405057 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25cb3f0 0x25cb7d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.408+0000 7f4481382740 1 --2- 172.21.15.49:0/3798405057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c6930 0x25c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.408+0000 7f4481382740 1 --2- 172.21.15.49:0/3798405057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a9100 0x25ae010 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.408+0000 7f4481382740 1 --2- 172.21.15.49:0/3798405057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2583a20 0x25a89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.408+0000 7f445cc00700 0 client.5982 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:29.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.408+0000 7f4481382740 1 -- 172.21.15.49:0/3798405057 >> 172.21.15.49:0/3798405057 conn(0x2362890 msgr2=0x25c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.408+0000 7f4481382740 1 -- 172.21.15.49:0/3798405057 shutdown_connections 2024-01-22T05:08:29.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.408+0000 7f4481382740 1 -- 172.21.15.49:0/3798405057 wait complete. 2024-01-22T05:08:29.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.408+0000 7f4481382740 20 client.5982 trim_cache size 0 max 16384 2024-01-22T05:08:29.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.428+0000 7f4481382740 1 Processor -- start 2024-01-22T05:08:29.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.428+0000 7f4481382740 1 -- start start 2024-01-22T05:08:29.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.428+0000 7f4481382740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2583a20 0x25af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.428+0000 7f4481382740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25a9100 0x25aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.428+0000 7f4481382740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25c6930 0x25abf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.428+0000 7f4481382740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2582830 con 0x2583a20 2024-01-22T05:08:29.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.428+0000 7f4481382740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x25ac3f0 con 0x25c6930 2024-01-22T05:08:29.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.428+0000 7f4481382740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x25af1e0 con 0x25a9100 2024-01-22T05:08:29.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f446fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2583a20 0x25af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4474e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25c6930 0x25abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4474e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25c6930 0x25abf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:44984/0 (socket says 172.21.15.49:44984) 2024-01-22T05:08:29.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4474e00700 1 -- 172.21.15.49:0/2884616091 learned_addr learned my addr 172.21.15.49:0/2884616091 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f446f400700 1 --2- 172.21.15.49:0/2884616091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25a9100 0x25aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f446f400700 1 -- 172.21.15.49:0/2884616091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25c6930 msgr2=0x25abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f446f400700 1 --2- 172.21.15.49:0/2884616091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25c6930 0x25abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f446f400700 1 -- 172.21.15.49:0/2884616091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2583a20 msgr2=0x25af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f446f400700 1 --2- 172.21.15.49:0/2884616091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2583a20 0x25af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f446f400700 1 -- 172.21.15.49:0/2884616091 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44701513b0 con 0x25a9100 2024-01-22T05:08:29.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f446f400700 1 --2- 172.21.15.49:0/2884616091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25a9100 0x25aba10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f4458017cb0 tx=0x7f445802a000).ready entity=mon.2 client_cookie=29a74bd4a62b9f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4464c00700 1 -- 172.21.15.49:0/2884616091 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458007980 con 0x25a9100 2024-01-22T05:08:29.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4464c00700 1 -- 172.21.15.49:0/2884616091 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4458032070 con 0x25a9100 2024-01-22T05:08:29.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4464c00700 1 -- 172.21.15.49:0/2884616091 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44580145f0 con 0x25a9100 2024-01-22T05:08:29.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4481382740 1 -- 172.21.15.49:0/2884616091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25a9100 msgr2=0x25aba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4481382740 1 --2- 172.21.15.49:0/2884616091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25a9100 0x25aba10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f4458017cb0 tx=0x7f445802a000).stop 2024-01-22T05:08:29.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4481382740 1 -- 172.21.15.49:0/2884616091 shutdown_connections 2024-01-22T05:08:29.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4481382740 1 --2- 172.21.15.49:0/2884616091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25c6930 0x25abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4481382740 1 --2- 172.21.15.49:0/2884616091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25a9100 0x25aba10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4481382740 1 --2- 172.21.15.49:0/2884616091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2583a20 0x25af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4481382740 1 -- 172.21.15.49:0/2884616091 >> 172.21.15.49:0/2884616091 conn(0x2362890 msgr2=0x257c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4481382740 1 -- 172.21.15.49:0/2884616091 shutdown_connections 2024-01-22T05:08:29.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4481382740 1 -- 172.21.15.49:0/2884616091 wait complete. 2024-01-22T05:08:29.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.432+0000 7f4481382740 1 -- start start 2024-01-22T05:08:29.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4481382740 1 Processor -- start 2024-01-22T05:08:29.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4481382740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2583a20 0x262bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4481382740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25a9100 0x25c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4481382740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c6930 0x25c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4481382740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x25dede0 con 0x25c6930 2024-01-22T05:08:29.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4481382740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x262c050 con 0x25a9100 2024-01-22T05:08:29.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4481382740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x25afab0 con 0x2583a20 2024-01-22T05:08:29.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4481382740 10 client.0 ll_register_callbacks cb 0x2584420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:29.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4474e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c6930 0x25c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4474e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c6930 0x25c4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38914/0 (socket says 172.21.15.49:38914) 2024-01-22T05:08:29.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4474e00700 1 -- 172.21.15.49:0/2292202303 learned_addr learned my addr 172.21.15.49:0/2292202303 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f446f400700 1 --2- 172.21.15.49:0/2292202303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25a9100 0x25c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f446fe00700 1 --2- 172.21.15.49:0/2292202303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2583a20 0x262bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4474e00700 1 -- 172.21.15.49:0/2292202303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2583a20 msgr2=0x262bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4474e00700 1 --2- 172.21.15.49:0/2292202303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2583a20 0x262bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4474e00700 1 -- 172.21.15.49:0/2292202303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25a9100 msgr2=0x25c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4474e00700 1 --2- 172.21.15.49:0/2292202303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25a9100 0x25c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.436+0000 7f4474e00700 1 -- 172.21.15.49:0/2292202303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x24fd8a0 con 0x25c6930 2024-01-22T05:08:29.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f4474e00700 1 --2- 172.21.15.49:0/2292202303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c6930 0x25c4de0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f4468009e90 tx=0x7f4468009780).ready entity=mon.0 client_cookie=26f45e5d4eed8923 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f445cc00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:29.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f445cc00700 1 -- 172.21.15.49:0/2292202303 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446800be60 con 0x25c6930 2024-01-22T05:08:29.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f445cc00700 1 -- 172.21.15.49:0/2292202303 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f446802be40 con 0x25c6930 2024-01-22T05:08:29.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f4481382740 1 -- 172.21.15.49:0/2292202303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4458014480 con 0x25c6930 2024-01-22T05:08:29.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f445cc00700 1 -- 172.21.15.49:0/2292202303 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f446801e840 con 0x25c6930 2024-01-22T05:08:29.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f4481382740 10 client.5988 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:29.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f4481382740 1 -- 172.21.15.49:0/2292202303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x24f8ad0 con 0x25c6930 2024-01-22T05:08:29.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f445cc00700 1 -- 172.21.15.49:0/2292202303 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4458014480 con 0x25c6930 2024-01-22T05:08:29.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f445cc00700 1 -- 172.21.15.49:0/2292202303 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f446801a030 con 0x25c6930 2024-01-22T05:08:29.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f4481382740 10 client.5988 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:29.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f4481382740 10 client.5988 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:29.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f4481382740 20 client.5988 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:29.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f4481382740 1 --2- 172.21.15.49:0/2292202303 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25c89d0 0x25c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f4481382740 4 client.5988 mds_command: new command op to 5569 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-01-22T05:08:29.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f4481382740 1 -- 172.21.15.49:0/2292202303 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) v1 -- 0x23b9820 con 0x25c89d0 2024-01-22T05:08:29.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f446fe00700 1 --2- 172.21.15.49:0/2292202303 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25c89d0 0x25c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f445cc00700 10 client.5988 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:29.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f446fe00700 1 --2- 172.21.15.49:0/2292202303 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25c89d0 0x25c52d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ac523cf2e4f8b531 server_cookie=e931fb9cfc37d3b8 in_seq=0 out_seq=0 2024-01-22T05:08:29.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f445cc00700 1 -- 172.21.15.49:0/2292202303 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+26 (crc 0 0 0) 0x23b9820 con 0x25c89d0 2024-01-22T05:08:29.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f445cc00700 10 client.5988 handle_command_reply: tid=0 2024-01-22T05:08:29.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.440+0000 7f4481382740 1 client.5988 shutdown 2024-01-22T05:08:29.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4481382740 1 -- 172.21.15.49:0/2292202303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c6930 msgr2=0x25c4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4481382740 1 --2- 172.21.15.49:0/2292202303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c6930 0x25c4de0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f4468009e90 tx=0x7f4468009780).stop 2024-01-22T05:08:29.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4481382740 1 -- 172.21.15.49:0/2292202303 shutdown_connections 2024-01-22T05:08:29.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4481382740 1 --2- 172.21.15.49:0/2292202303 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25c89d0 0x25c52d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4481382740 1 --2- 172.21.15.49:0/2292202303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c6930 0x25c4de0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f445cc00700 0 client.5988 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:29.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4481382740 1 --2- 172.21.15.49:0/2292202303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25a9100 0x25c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4481382740 1 --2- 172.21.15.49:0/2292202303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2583a20 0x262bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4481382740 1 -- 172.21.15.49:0/2292202303 >> 172.21.15.49:0/2292202303 conn(0x2362890 msgr2=0x25c58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4481382740 1 -- 172.21.15.49:0/2292202303 shutdown_connections 2024-01-22T05:08:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4481382740 1 -- 172.21.15.49:0/2292202303 wait complete. 2024-01-22T05:08:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4481382740 20 client.5988 trim_cache size 0 max 16384 2024-01-22T05:08:29.447 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:29.447 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": -2 2024-01-22T05:08:29.447 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4476e00700 1 -- 172.21.15.49:0/1800300561 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f444805a4e0 msgr2=0x7f444805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4476e00700 1 --2- 172.21.15.49:0/1800300561 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f444805a4e0 0x7f444805c9a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f44700a7040 tx=0x7f4458009040).stop 2024-01-22T05:08:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4476e00700 1 -- 172.21.15.49:0/1800300561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4470063df0 msgr2=0x7f4470163c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4476e00700 1 --2- 172.21.15.49:0/1800300561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4470063df0 0x7f4470163c70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f446000c800 tx=0x7f4460001ab0).stop 2024-01-22T05:08:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4476e00700 1 -- 172.21.15.49:0/1800300561 shutdown_connections 2024-01-22T05:08:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4476e00700 1 --2- 172.21.15.49:0/1800300561 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f444805a4e0 0x7f444805c9a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4476e00700 1 --2- 172.21.15.49:0/1800300561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4470069c70 0x7f4470150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4476e00700 1 --2- 172.21.15.49:0/1800300561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4470064250 0x7f44701529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4476e00700 1 --2- 172.21.15.49:0/1800300561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4470063df0 0x7f4470163c70 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4476e00700 1 -- 172.21.15.49:0/1800300561 >> 172.21.15.49:0/1800300561 conn(0x7f44700c40f0 msgr2=0x7f44700aacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4476e00700 1 -- 172.21.15.49:0/1800300561 shutdown_connections 2024-01-22T05:08:29.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.444+0000 7f4476e00700 1 -- 172.21.15.49:0/1800300561 wait complete. 2024-01-22T05:08:29.471 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-01-22T05:08:29.471 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-01-22T05:08:29.471 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-01-22T05:08:29.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.636+0000 7ff7a0800700 1 Processor -- start 2024-01-22T05:08:29.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.640+0000 7ff7a0800700 1 -- start start 2024-01-22T05:08:29.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff7a0800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff7980c4330 0x7ff7980c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff7a0800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7980a6fd0 con 0x7ff798157150 2024-01-22T05:08:29.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff7a0800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7980c3bc0 con 0x7ff7980c68a0 2024-01-22T05:08:29.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff7a0800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7980c3ea0 con 0x7ff7980c4330 2024-01-22T05:08:29.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff79de00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff798157150 0x7ff7980bdd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60076/0 (socket says 172.21.15.49:60076) 2024-01-22T05:08:29.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff79de00700 1 -- 172.21.15.49:0/2438099737 learned_addr learned my addr 172.21.15.49:0/2438099737 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:29.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff79e800700 1 --2- 172.21.15.49:0/2438099737 >> v2:172.21.15.110:3300/0 conn(0x7ff7980c4330 0x7ff7980c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff79ca00700 1 -- 172.21.15.49:0/2438099737 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55831650 0 0) 0x7ff7980a6fd0 con 0x7ff798157150 2024-01-22T05:08:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff79ca00700 1 -- 172.21.15.49:0/2438099737 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7780033f0 con 0x7ff798157150 2024-01-22T05:08:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff79e800700 1 -- 172.21.15.49:0/2438099737 >> v1:172.21.15.110:6789/0 conn(0x7ff7980c68a0 legacy=0x7ff7980c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff79ca00700 1 -- 172.21.15.49:0/2438099737 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712762846 0 0) 0x7ff7980c3bc0 con 0x7ff7980c68a0 2024-01-22T05:08:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff79e800700 1 -- 172.21.15.49:0/2438099737 >> v1:172.21.15.49:6789/0 conn(0x7ff798157150 legacy=0x7ff7980bdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff79e800700 1 -- 172.21.15.49:0/2438099737 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7980ab580 con 0x7ff7980c4330 2024-01-22T05:08:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff79e800700 1 --2- 172.21.15.49:0/2438099737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7980c4330 0x7ff7980c4760 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7ff790009e60 tx=0x7ff790009780).ready entity=mon.1 client_cookie=b69f49444c8c03d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff79ca00700 1 -- 172.21.15.49:0/2438099737 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79000e070 con 0x7ff7980c4330 2024-01-22T05:08:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff79ca00700 1 -- 172.21.15.49:0/2438099737 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79000bb60 con 0x7ff7980c4330 2024-01-22T05:08:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.644+0000 7ff79ca00700 1 -- 172.21.15.49:0/2438099737 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79000bee0 con 0x7ff7980c4330 2024-01-22T05:08:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.648+0000 7ff7a0800700 1 -- 172.21.15.49:0/2438099737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7980c4330 msgr2=0x7ff7980c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.648+0000 7ff7a0800700 1 --2- 172.21.15.49:0/2438099737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7980c4330 0x7ff7980c4760 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7ff790009e60 tx=0x7ff790009780).stop 2024-01-22T05:08:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.648+0000 7ff7a0800700 1 -- 172.21.15.49:0/2438099737 shutdown_connections 2024-01-22T05:08:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.648+0000 7ff7a0800700 1 --2- 172.21.15.49:0/2438099737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7980c4330 0x7ff7980c4760 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.648+0000 7ff7a0800700 1 -- 172.21.15.49:0/2438099737 >> 172.21.15.49:0/2438099737 conn(0x7ff7980aa700 msgr2=0x7ff7980aab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.648+0000 7ff7a0800700 1 -- 172.21.15.49:0/2438099737 shutdown_connections 2024-01-22T05:08:29.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.648+0000 7ff7a0800700 1 -- 172.21.15.49:0/2438099737 wait complete. 2024-01-22T05:08:29.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.652+0000 7ff7a0800700 1 Processor -- start 2024-01-22T05:08:29.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.652+0000 7ff7a0800700 1 -- start start 2024-01-22T05:08:29.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.652+0000 7ff7a0800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7980c4330 0x7ff798148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.652+0000 7ff7a0800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7980c68a0 0x7ff7980a8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.652+0000 7ff7a0800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff798157150 0x7ff7980a8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.652+0000 7ff7a0800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980a8b40 con 0x7ff7980c68a0 2024-01-22T05:08:29.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.652+0000 7ff7a0800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980a4fb0 con 0x7ff7980c4330 2024-01-22T05:08:29.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.652+0000 7ff7a0800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980a5290 con 0x7ff798157150 2024-01-22T05:08:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff79d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7980c68a0 0x7ff7980a8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff79d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7980c68a0 0x7ff7980a8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38916/0 (socket says 172.21.15.49:38916) 2024-01-22T05:08:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff79d400700 1 -- 172.21.15.49:0/3060846619 learned_addr learned my addr 172.21.15.49:0/3060846619 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff79de00700 1 --2- 172.21.15.49:0/3060846619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7980c4330 0x7ff798148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff79e800700 1 --2- 172.21.15.49:0/3060846619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff798157150 0x7ff7980a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff79d400700 1 -- 172.21.15.49:0/3060846619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff798157150 msgr2=0x7ff7980a8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff79d400700 1 --2- 172.21.15.49:0/3060846619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff798157150 0x7ff7980a8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff79d400700 1 -- 172.21.15.49:0/3060846619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7980c4330 msgr2=0x7ff798148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff79d400700 1 --2- 172.21.15.49:0/3060846619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7980c4330 0x7ff798148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff79d400700 1 -- 172.21.15.49:0/3060846619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff790009a20 con 0x7ff7980c68a0 2024-01-22T05:08:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff79de00700 1 --2- 172.21.15.49:0/3060846619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7980c4330 0x7ff798148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:29.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff79d400700 1 --2- 172.21.15.49:0/3060846619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7980c68a0 0x7ff7980a8050 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7ff780001eb0 tx=0x7ff780007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff795600700 1 -- 172.21.15.49:0/3060846619 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78000f470 con 0x7ff7980c68a0 2024-01-22T05:08:29.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff795600700 1 -- 172.21.15.49:0/3060846619 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78000f5f0 con 0x7ff7980c68a0 2024-01-22T05:08:29.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff7a0800700 1 -- 172.21.15.49:0/3060846619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7980a5570 con 0x7ff7980c68a0 2024-01-22T05:08:29.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff795600700 1 -- 172.21.15.49:0/3060846619 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78000f9b0 con 0x7ff7980c68a0 2024-01-22T05:08:29.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.656+0000 7ff7a0800700 1 -- 172.21.15.49:0/3060846619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7980a7d50 con 0x7ff7980c68a0 2024-01-22T05:08:29.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.660+0000 7ff795600700 1 -- 172.21.15.49:0/3060846619 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff78000fd20 con 0x7ff7980c68a0 2024-01-22T05:08:29.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.664+0000 7ff795600700 1 --2- 172.21.15.49:0/3060846619 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff77005a4e0 0x7ff77005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.664+0000 7ff795600700 1 -- 172.21.15.49:0/3060846619 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff780073ff0 con 0x7ff7980c68a0 2024-01-22T05:08:29.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.664+0000 7ff79de00700 1 --2- 172.21.15.49:0/3060846619 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff77005a4e0 0x7ff77005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.664+0000 7ff79de00700 1 --2- 172.21.15.49:0/3060846619 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff77005a4e0 0x7ff77005c9a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7ff788005750 tx=0x7ff788009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.664+0000 7ff7aabb5740 1 Processor -- start 2024-01-22T05:08:29.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.664+0000 7ff7aabb5740 1 -- start start 2024-01-22T05:08:29.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff7aabb5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6dbe0 0x1f6dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff7aabb5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f52a50 0x1f261f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff7aabb5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2c6f0 0x1f266e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff7aabb5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e663f0 con 0x1f2c6f0 2024-01-22T05:08:29.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff7aabb5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e895f0 con 0x1f6dbe0 2024-01-22T05:08:29.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff7aabb5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e52cf0 con 0x1f52a50 2024-01-22T05:08:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff79e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2c6f0 0x1f266e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff79e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2c6f0 0x1f266e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38930/0 (socket says 172.21.15.49:38930) 2024-01-22T05:08:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff79e800700 1 -- 172.21.15.49:0/3797496224 learned_addr learned my addr 172.21.15.49:0/3797496224 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff79de00700 1 --2- 172.21.15.49:0/3797496224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6dbe0 0x1f6dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff79d400700 1 --2- 172.21.15.49:0/3797496224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f52a50 0x1f261f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff79e800700 1 -- 172.21.15.49:0/3797496224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f52a50 msgr2=0x1f261f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff79e800700 1 --2- 172.21.15.49:0/3797496224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f52a50 0x1f261f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff79e800700 1 -- 172.21.15.49:0/3797496224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6dbe0 msgr2=0x1f6dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff79e800700 1 --2- 172.21.15.49:0/3797496224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6dbe0 0x1f6dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff79e800700 1 -- 172.21.15.49:0/3797496224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1eb70c0 con 0x1f2c6f0 2024-01-22T05:08:29.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff79e800700 1 --2- 172.21.15.49:0/3797496224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2c6f0 0x1f266e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7ff79000b6c0 tx=0x7ff790009780).ready entity=mon.0 client_cookie=f103f8833354a839 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff78dc00700 1 -- 172.21.15.49:0/3797496224 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790012620 con 0x1f2c6f0 2024-01-22T05:08:29.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff78dc00700 1 -- 172.21.15.49:0/3797496224 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff790012780 con 0x1f2c6f0 2024-01-22T05:08:29.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff78dc00700 1 -- 172.21.15.49:0/3797496224 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790012b00 con 0x1f2c6f0 2024-01-22T05:08:29.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff7aabb5740 1 -- 172.21.15.49:0/3797496224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2c6f0 msgr2=0x1f266e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.668+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/3797496224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2c6f0 0x1f266e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7ff79000b6c0 tx=0x7ff790009780).stop 2024-01-22T05:08:29.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.672+0000 7ff7aabb5740 1 -- 172.21.15.49:0/3797496224 shutdown_connections 2024-01-22T05:08:29.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.672+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/3797496224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2c6f0 0x1f266e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.672+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/3797496224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f52a50 0x1f261f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.672+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/3797496224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6dbe0 0x1f6dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.672+0000 7ff7aabb5740 1 -- 172.21.15.49:0/3797496224 >> 172.21.15.49:0/3797496224 conn(0x1d0b930 msgr2=0x1f73390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.672+0000 7ff7aabb5740 1 -- 172.21.15.49:0/3797496224 shutdown_connections 2024-01-22T05:08:29.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.672+0000 7ff7aabb5740 1 -- 172.21.15.49:0/3797496224 wait complete. 2024-01-22T05:08:29.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.672+0000 7ff7aabb5740 1 -- start start 2024-01-22T05:08:29.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.672+0000 7ff7aabb5740 1 Processor -- start 2024-01-22T05:08:29.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff7aabb5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2c6f0 0x1f6d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff7aabb5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f52a50 0x1f57dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff7aabb5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6dbe0 0x1f269a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff7aabb5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f54140 con 0x1f2c6f0 2024-01-22T05:08:29.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff7aabb5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f542e0 con 0x1f52a50 2024-01-22T05:08:29.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff7aabb5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f83230 con 0x1f6dbe0 2024-01-22T05:08:29.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff7aabb5740 10 client.0 ll_register_callbacks cb 0x1ee3d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:29.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff79de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2c6f0 0x1f6d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff79de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2c6f0 0x1f6d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38940/0 (socket says 172.21.15.49:38940) 2024-01-22T05:08:29.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff79de00700 1 -- 172.21.15.49:0/3442687106 learned_addr learned my addr 172.21.15.49:0/3442687106 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff79d400700 1 --2- 172.21.15.49:0/3442687106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f52a50 0x1f57dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff79e800700 1 --2- 172.21.15.49:0/3442687106 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6dbe0 0x1f269a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff79de00700 1 -- 172.21.15.49:0/3442687106 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6dbe0 msgr2=0x1f269a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff79de00700 1 --2- 172.21.15.49:0/3442687106 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6dbe0 0x1f269a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff79de00700 1 -- 172.21.15.49:0/3442687106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f52a50 msgr2=0x1f57dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff79de00700 1 --2- 172.21.15.49:0/3442687106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f52a50 0x1f57dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff79de00700 1 -- 172.21.15.49:0/3442687106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7980ab580 con 0x1f2c6f0 2024-01-22T05:08:29.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff79de00700 1 --2- 172.21.15.49:0/3442687106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2c6f0 0x1f6d3b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7ff788005ee0 tx=0x7ff78801a040).ready entity=mon.0 client_cookie=967b5c8ca0070c03 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff786000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:29.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff786000700 1 -- 172.21.15.49:0/3442687106 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78801d040 con 0x1f2c6f0 2024-01-22T05:08:29.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff786000700 1 -- 172.21.15.49:0/3442687106 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff788018e40 con 0x1f2c6f0 2024-01-22T05:08:29.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff7aabb5740 1 -- 172.21.15.49:0/3442687106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1ea3340 con 0x1f2c6f0 2024-01-22T05:08:29.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff786000700 1 -- 172.21.15.49:0/3442687106 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff788005240 con 0x1f2c6f0 2024-01-22T05:08:29.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff7aabb5740 10 client.6000 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:29.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff7aabb5740 1 -- 172.21.15.49:0/3442687106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x1ea68d0 con 0x1f2c6f0 2024-01-22T05:08:29.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.676+0000 7ff786000700 1 -- 172.21.15.49:0/3442687106 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1ea3340 con 0x1f2c6f0 2024-01-22T05:08:29.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff786000700 1 -- 172.21.15.49:0/3442687106 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff7880053a0 con 0x1f2c6f0 2024-01-22T05:08:29.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff7aabb5740 10 client.6000 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:29.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff7aabb5740 10 client.6000 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:29.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff7aabb5740 20 client.6000 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:29.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/3442687106 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1f56dd0 0x1f571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff7aabb5740 4 client.6000 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:29.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff7aabb5740 1 -- 172.21.15.49:0/3442687106 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1e99890 con 0x1f56dd0 2024-01-22T05:08:29.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff79d400700 1 --2- 172.21.15.49:0/3442687106 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1f56dd0 0x1f571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff79d400700 1 --2- 172.21.15.49:0/3442687106 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1f56dd0 0x1f571b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a29a3054e74fe9e7 server_cookie=bfe56c12dea1c885 in_seq=0 out_seq=0 2024-01-22T05:08:29.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff786000700 10 client.6000 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:29.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff786000700 1 -- 172.21.15.49:0/3442687106 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1e99890 con 0x1f56dd0 2024-01-22T05:08:29.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff786000700 10 client.6000 handle_command_reply: tid=0 2024-01-22T05:08:29.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff7aabb5740 1 client.6000 shutdown 2024-01-22T05:08:29.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff7aabb5740 1 -- 172.21.15.49:0/3442687106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2c6f0 msgr2=0x1f6d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/3442687106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2c6f0 0x1f6d3b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7ff788005ee0 tx=0x7ff78801a040).stop 2024-01-22T05:08:29.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff7aabb5740 1 -- 172.21.15.49:0/3442687106 shutdown_connections 2024-01-22T05:08:29.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/3442687106 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1f56dd0 0x1f571b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/3442687106 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6dbe0 0x1f269a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/3442687106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f52a50 0x1f57dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/3442687106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2c6f0 0x1f6d3b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff786000700 0 client.6000 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:29.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.680+0000 7ff7aabb5740 1 -- 172.21.15.49:0/3442687106 >> 172.21.15.49:0/3442687106 conn(0x1d0b930 msgr2=0x1f4d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.684+0000 7ff7aabb5740 1 -- 172.21.15.49:0/3442687106 shutdown_connections 2024-01-22T05:08:29.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.684+0000 7ff7aabb5740 1 -- 172.21.15.49:0/3442687106 wait complete. 2024-01-22T05:08:29.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.684+0000 7ff7aabb5740 20 client.6000 trim_cache size 0 max 16384 2024-01-22T05:08:29.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.700+0000 7ff7aabb5740 1 Processor -- start 2024-01-22T05:08:29.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.700+0000 7ff7aabb5740 1 -- start start 2024-01-22T05:08:29.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff7aabb5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2c6f0 0x1f6e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff7aabb5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f52a50 0x1f53320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff7aabb5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6dbe0 0x1f53810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff7aabb5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f57520 con 0x1f6dbe0 2024-01-22T05:08:29.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff7aabb5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f27840 con 0x1f2c6f0 2024-01-22T05:08:29.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff7aabb5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f53d00 con 0x1f52a50 2024-01-22T05:08:29.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff79e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6dbe0 0x1f53810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff79e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6dbe0 0x1f53810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38950/0 (socket says 172.21.15.49:38950) 2024-01-22T05:08:29.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff79e800700 1 -- 172.21.15.49:0/1361843872 learned_addr learned my addr 172.21.15.49:0/1361843872 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff79de00700 1 --2- 172.21.15.49:0/1361843872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2c6f0 0x1f6e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff79d400700 1 --2- 172.21.15.49:0/1361843872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f52a50 0x1f53320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff79e800700 1 -- 172.21.15.49:0/1361843872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f52a50 msgr2=0x1f53320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff79e800700 1 --2- 172.21.15.49:0/1361843872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f52a50 0x1f53320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff79e800700 1 -- 172.21.15.49:0/1361843872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2c6f0 msgr2=0x1f6e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff79e800700 1 --2- 172.21.15.49:0/1361843872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2c6f0 0x1f6e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff79e800700 1 -- 172.21.15.49:0/1361843872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1f6d710 con 0x1f6dbe0 2024-01-22T05:08:29.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff79d400700 1 --2- 172.21.15.49:0/1361843872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f52a50 0x1f53320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:29.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff79e800700 1 --2- 172.21.15.49:0/1361843872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6dbe0 0x1f53810 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x1f6eb20 tx=0x7ff79001f000).ready entity=mon.0 client_cookie=8e95ae2dcf684119 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff78e600700 1 -- 172.21.15.49:0/1361843872 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79002d070 con 0x1f6dbe0 2024-01-22T05:08:29.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff78e600700 1 -- 172.21.15.49:0/1361843872 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79000be50 con 0x1f6dbe0 2024-01-22T05:08:29.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff78e600700 1 -- 172.21.15.49:0/1361843872 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7900128f0 con 0x1f6dbe0 2024-01-22T05:08:29.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff7aabb5740 1 -- 172.21.15.49:0/1361843872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6dbe0 msgr2=0x1f53810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/1361843872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6dbe0 0x1f53810 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x1f6eb20 tx=0x7ff79001f000).stop 2024-01-22T05:08:29.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff7aabb5740 1 -- 172.21.15.49:0/1361843872 shutdown_connections 2024-01-22T05:08:29.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/1361843872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6dbe0 0x1f53810 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/1361843872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f52a50 0x1f53320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/1361843872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2c6f0 0x1f6e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.704+0000 7ff7aabb5740 1 -- 172.21.15.49:0/1361843872 >> 172.21.15.49:0/1361843872 conn(0x1d0b930 msgr2=0x1f50f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.708+0000 7ff7aabb5740 1 -- 172.21.15.49:0/1361843872 shutdown_connections 2024-01-22T05:08:29.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.708+0000 7ff7aabb5740 1 -- 172.21.15.49:0/1361843872 wait complete. 2024-01-22T05:08:29.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.708+0000 7ff7aabb5740 1 -- start start 2024-01-22T05:08:29.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.708+0000 7ff7aabb5740 1 Processor -- start 2024-01-22T05:08:29.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.708+0000 7ff7aabb5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2c6f0 0x1fd4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.708+0000 7ff7aabb5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f52a50 0x1f54ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.708+0000 7ff7aabb5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6dbe0 0x1f55190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.708+0000 7ff7aabb5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f2a2c0 con 0x1f52a50 2024-01-22T05:08:29.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.708+0000 7ff7aabb5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f55680 con 0x1f2c6f0 2024-01-22T05:08:29.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.708+0000 7ff7aabb5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f80520 con 0x1f6dbe0 2024-01-22T05:08:29.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.708+0000 7ff7aabb5740 10 client.0 ll_register_callbacks cb 0x1f526e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:29.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff79d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f52a50 0x1f54ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff79d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f52a50 0x1f54ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38954/0 (socket says 172.21.15.49:38954) 2024-01-22T05:08:29.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff79d400700 1 -- 172.21.15.49:0/2176239467 learned_addr learned my addr 172.21.15.49:0/2176239467 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff79e800700 1 --2- 172.21.15.49:0/2176239467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6dbe0 0x1f55190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff79de00700 1 --2- 172.21.15.49:0/2176239467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2c6f0 0x1fd4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff79d400700 1 -- 172.21.15.49:0/2176239467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6dbe0 msgr2=0x1f55190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff79d400700 1 --2- 172.21.15.49:0/2176239467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6dbe0 0x1f55190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff79d400700 1 -- 172.21.15.49:0/2176239467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2c6f0 msgr2=0x1fd4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff79d400700 1 --2- 172.21.15.49:0/2176239467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2c6f0 0x1fd4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff79d400700 1 -- 172.21.15.49:0/2176239467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1eb70c0 con 0x1f52a50 2024-01-22T05:08:29.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff79d400700 1 --2- 172.21.15.49:0/2176239467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f52a50 0x1f54ca0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7ff7800011e0 tx=0x7ff78001e040).ready entity=mon.0 client_cookie=894e91d9e55b0f67 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff786000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff786000700 1 -- 172.21.15.49:0/2176239467 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780056070 con 0x1f52a50 2024-01-22T05:08:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff786000700 1 -- 172.21.15.49:0/2176239467 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff78004a740 con 0x1f52a50 2024-01-22T05:08:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff7aabb5740 1 -- 172.21.15.49:0/2176239467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff790012780 con 0x1f52a50 2024-01-22T05:08:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff786000700 1 -- 172.21.15.49:0/2176239467 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff780050040 con 0x1f52a50 2024-01-22T05:08:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff7aabb5740 10 client.6006 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff7aabb5740 1 -- 172.21.15.49:0/2176239467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x7ff7980c7ca0 con 0x1f52a50 2024-01-22T05:08:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff786000700 1 -- 172.21.15.49:0/2176239467 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff790012780 con 0x1f52a50 2024-01-22T05:08:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff786000700 1 -- 172.21.15.49:0/2176239467 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff780050b80 con 0x1f52a50 2024-01-22T05:08:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff7aabb5740 10 client.6006 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff7aabb5740 10 client.6006 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff7aabb5740 20 client.6006 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/2176239467 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1f81e40 0x1f4bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff7aabb5740 4 client.6006 mds_command: new command op to 5569 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-01-22T05:08:29.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff7aabb5740 1 -- 172.21.15.49:0/2176239467 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) v1 -- 0x1d628c0 con 0x1f81e40 2024-01-22T05:08:29.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.712+0000 7ff79de00700 1 --2- 172.21.15.49:0/2176239467 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1f81e40 0x1f4bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff786000700 10 client.6006 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:29.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff79de00700 1 --2- 172.21.15.49:0/2176239467 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1f81e40 0x1f4bb80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4d66ab0d6936b065 server_cookie=38881b35fd45c04 in_seq=0 out_seq=0 2024-01-22T05:08:29.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff786000700 1 -- 172.21.15.49:0/2176239467 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1d628c0 con 0x1f81e40 2024-01-22T05:08:29.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff786000700 10 client.6006 handle_command_reply: tid=0 2024-01-22T05:08:29.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff7aabb5740 1 client.6006 shutdown 2024-01-22T05:08:29.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff7aabb5740 1 -- 172.21.15.49:0/2176239467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f52a50 msgr2=0x1f54ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/2176239467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f52a50 0x1f54ca0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7ff7800011e0 tx=0x7ff78001e040).stop 2024-01-22T05:08:29.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff7aabb5740 1 -- 172.21.15.49:0/2176239467 shutdown_connections 2024-01-22T05:08:29.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/2176239467 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1f81e40 0x1f4bb80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/2176239467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6dbe0 0x1f55190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/2176239467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f52a50 0x1f54ca0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff7aabb5740 1 --2- 172.21.15.49:0/2176239467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2c6f0 0x1fd4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff7aabb5740 1 -- 172.21.15.49:0/2176239467 >> 172.21.15.49:0/2176239467 conn(0x1d0b930 msgr2=0x1f53320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff786000700 0 client.6006 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:29.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff7aabb5740 1 -- 172.21.15.49:0/2176239467 shutdown_connections 2024-01-22T05:08:29.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff7aabb5740 1 -- 172.21.15.49:0/2176239467 wait complete. 2024-01-22T05:08:29.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.716+0000 7ff7aabb5740 20 client.6006 trim_cache size 0 max 16384 2024-01-22T05:08:29.721 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:29.721 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:08:29.721 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "9fa16d2c-6146-4e99-a5fc-ad8e7394f436", 2024-01-22T05:08:29.721 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:08:29.721 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:29.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.720+0000 7ff7a0800700 1 -- 172.21.15.49:0/3060846619 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff77005a4e0 msgr2=0x7ff77005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.720+0000 7ff7a0800700 1 --2- 172.21.15.49:0/3060846619 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff77005a4e0 0x7ff77005c9a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7ff788005750 tx=0x7ff788009040).stop 2024-01-22T05:08:29.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.720+0000 7ff7a0800700 1 -- 172.21.15.49:0/3060846619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7980c68a0 msgr2=0x7ff7980a8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.720+0000 7ff7a0800700 1 --2- 172.21.15.49:0/3060846619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7980c68a0 0x7ff7980a8050 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7ff780001eb0 tx=0x7ff780007c70).stop 2024-01-22T05:08:29.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.720+0000 7ff7a0800700 1 -- 172.21.15.49:0/3060846619 shutdown_connections 2024-01-22T05:08:29.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.720+0000 7ff7a0800700 1 --2- 172.21.15.49:0/3060846619 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff77005a4e0 0x7ff77005c9a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.720+0000 7ff7a0800700 1 --2- 172.21.15.49:0/3060846619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff798157150 0x7ff7980a8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.720+0000 7ff7a0800700 1 --2- 172.21.15.49:0/3060846619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7980c68a0 0x7ff7980a8050 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.720+0000 7ff7a0800700 1 --2- 172.21.15.49:0/3060846619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7980c4330 0x7ff798148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.720+0000 7ff7a0800700 1 -- 172.21.15.49:0/3060846619 >> 172.21.15.49:0/3060846619 conn(0x7ff7980aa700 msgr2=0x7ff7980c7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.720+0000 7ff7a0800700 1 -- 172.21.15.49:0/3060846619 shutdown_connections 2024-01-22T05:08:29.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.720+0000 7ff7a0800700 1 -- 172.21.15.49:0/3060846619 wait complete. 2024-01-22T05:08:29.741 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '9fa16d2c-6146-4e99-a5fc-ad8e7394f436', 'mode': 'asynchronous'}' 2024-01-22T05:08:29.741 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-01-22T05:08:29.742 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-01-22T05:08:29.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.920+0000 7fcd1e600700 1 Processor -- start 2024-01-22T05:08:29.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.920+0000 7fcd1e600700 1 -- start start 2024-01-22T05:08:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.924+0000 7fcd1e600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcd18068710 0x7fcd181577d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.924+0000 7fcd1e600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd18068af0 0x7fcd18157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.924+0000 7fcd1e600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd18068280 con 0x7fcd18065590 2024-01-22T05:08:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.924+0000 7fcd1e600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd181581b0 con 0x7fcd18068af0 2024-01-22T05:08:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.924+0000 7fcd1e600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd18069600 con 0x7fcd18068710 2024-01-22T05:08:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.924+0000 7fcd17e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd18068af0 0x7fcd18157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.924+0000 7fcd17e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd18068af0 0x7fcd18157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38962/0 (socket says 172.21.15.49:38962) 2024-01-22T05:08:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.924+0000 7fcd17e00700 1 -- 172.21.15.49:0/66269344 learned_addr learned my addr 172.21.15.49:0/66269344 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.924+0000 7fcd1d200700 1 --2- 172.21.15.49:0/66269344 >> v2:172.21.15.110:3300/0 conn(0x7fcd18068710 0x7fcd181577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.924+0000 7fcd17e00700 1 -- 172.21.15.49:0/66269344 >> v2:172.21.15.110:3300/0 conn(0x7fcd18068710 msgr2=0x7fcd181577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.924+0000 7fcd17e00700 1 --2- 172.21.15.49:0/66269344 >> v2:172.21.15.110:3300/0 conn(0x7fcd18068710 0x7fcd181577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.924+0000 7fcd17e00700 1 -- 172.21.15.49:0/66269344 >> v1:172.21.15.110:6789/0 conn(0x7fcd18065590 legacy=0x7fcd180659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.924+0000 7fcd17e00700 1 -- 172.21.15.49:0/66269344 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd180c1cc0 con 0x7fcd18068af0 2024-01-22T05:08:29.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.928+0000 7fcd17e00700 1 --2- 172.21.15.49:0/66269344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd18068af0 0x7fcd18157cc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fcd18065490 tx=0x7fcd000090f0).ready entity=mon.0 client_cookie=1b9f3cb8781a54d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.928+0000 7fcd17400700 1 -- 172.21.15.49:0/66269344 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000b520 con 0x7fcd18068af0 2024-01-22T05:08:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.928+0000 7fcd17400700 1 -- 172.21.15.49:0/66269344 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0000b680 con 0x7fcd18068af0 2024-01-22T05:08:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.928+0000 7fcd17400700 1 -- 172.21.15.49:0/66269344 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000ba00 con 0x7fcd18068af0 2024-01-22T05:08:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.928+0000 7fcd1e600700 1 -- 172.21.15.49:0/66269344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd18068af0 msgr2=0x7fcd18157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.928+0000 7fcd1e600700 1 --2- 172.21.15.49:0/66269344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd18068af0 0x7fcd18157cc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fcd18065490 tx=0x7fcd000090f0).stop 2024-01-22T05:08:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.928+0000 7fcd1e600700 1 -- 172.21.15.49:0/66269344 shutdown_connections 2024-01-22T05:08:29.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.928+0000 7fcd1e600700 1 --2- 172.21.15.49:0/66269344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd18068af0 0x7fcd18157cc0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.928+0000 7fcd1e600700 1 --2- 172.21.15.49:0/66269344 >> v2:172.21.15.110:3300/0 conn(0x7fcd18068710 0x7fcd181577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.928+0000 7fcd1e600700 1 -- 172.21.15.49:0/66269344 >> 172.21.15.49:0/66269344 conn(0x7fcd180c6fc0 msgr2=0x7fcd180c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.928+0000 7fcd1e600700 1 -- 172.21.15.49:0/66269344 shutdown_connections 2024-01-22T05:08:29.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.928+0000 7fcd1e600700 1 -- 172.21.15.49:0/66269344 wait complete. 2024-01-22T05:08:29.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.932+0000 7fcd1e600700 1 Processor -- start 2024-01-22T05:08:29.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.932+0000 7fcd1e600700 1 -- start start 2024-01-22T05:08:29.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1e600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18065590 0x7fcd18143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1e600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd18068710 0x7fcd18164210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1e600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd18068af0 0x7fcd181543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1e600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd18152810 con 0x7fcd18068af0 2024-01-22T05:08:29.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1e600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd18151c00 con 0x7fcd18068710 2024-01-22T05:08:29.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1e600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd18151ee0 con 0x7fcd18065590 2024-01-22T05:08:29.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1dc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd18068af0 0x7fcd181543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1d200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18065590 0x7fcd18143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1dc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd18068af0 0x7fcd181543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38972/0 (socket says 172.21.15.49:38972) 2024-01-22T05:08:29.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1dc00700 1 -- 172.21.15.49:0/1054718468 learned_addr learned my addr 172.21.15.49:0/1054718468 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd17e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd18068710 0x7fcd18164210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1dc00700 1 -- 172.21.15.49:0/1054718468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18065590 msgr2=0x7fcd18143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1dc00700 1 --2- 172.21.15.49:0/1054718468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18065590 0x7fcd18143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1dc00700 1 -- 172.21.15.49:0/1054718468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd18068710 msgr2=0x7fcd18164210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1dc00700 1 --2- 172.21.15.49:0/1054718468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd18068710 0x7fcd18164210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1dc00700 1 -- 172.21.15.49:0/1054718468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd00009370 con 0x7fcd18068af0 2024-01-22T05:08:29.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1d200700 1 --2- 172.21.15.49:0/1054718468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18065590 0x7fcd18143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:29.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1dc00700 1 --2- 172.21.15.49:0/1054718468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd18068af0 0x7fcd181543b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fcd1000c7c0 tx=0x7fcd10001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd0fe00700 1 -- 172.21.15.49:0/1054718468 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1000e4a0 con 0x7fcd18068af0 2024-01-22T05:08:29.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd0fe00700 1 -- 172.21.15.49:0/1054718468 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1000e600 con 0x7fcd18068af0 2024-01-22T05:08:29.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1e600700 1 -- 172.21.15.49:0/1054718468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd181521c0 con 0x7fcd18068af0 2024-01-22T05:08:29.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd0fe00700 1 -- 172.21.15.49:0/1054718468 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1000e980 con 0x7fcd18068af0 2024-01-22T05:08:29.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.936+0000 7fcd1e600700 1 -- 172.21.15.49:0/1054718468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd18143e50 con 0x7fcd18068af0 2024-01-22T05:08:29.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.940+0000 7fcd0fe00700 1 -- 172.21.15.49:0/1054718468 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcd100123f0 con 0x7fcd18068af0 2024-01-22T05:08:29.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.944+0000 7fcd0fe00700 1 --2- 172.21.15.49:0/1054718468 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccf005a590 0x7fccf005ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.944+0000 7fcd0fe00700 1 -- 172.21.15.49:0/1054718468 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcd100741b0 con 0x7fcd18068af0 2024-01-22T05:08:29.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.944+0000 7fcd1d200700 1 --2- 172.21.15.49:0/1054718468 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccf005a590 0x7fccf005ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.944+0000 7fcd1d200700 1 --2- 172.21.15.49:0/1054718468 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccf005a590 0x7fccf005ca50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fcd08006fd0 tx=0x7fcd08006f40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.944+0000 7fcd2a08c740 1 Processor -- start 2024-01-22T05:08:29.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.944+0000 7fcd2a08c740 1 -- start start 2024-01-22T05:08:29.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd2a08c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x15e37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd2a08c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 0x1609e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd2a08c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1625dc0 0x1630010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd2a08c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x15648a0 con 0x16259e0 2024-01-22T05:08:29.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd2a08c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x15649e0 con 0x15df610 2024-01-22T05:08:29.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd2a08c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1564e90 con 0x1625dc0 2024-01-22T05:08:29.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd1d200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x15e37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd1d200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x15e37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38988/0 (socket says 172.21.15.49:38988) 2024-01-22T05:08:29.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd1d200700 1 -- 172.21.15.49:0/4187755792 learned_addr learned my addr 172.21.15.49:0/4187755792 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd17e00700 1 --2- 172.21.15.49:0/4187755792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 0x1609e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd1dc00700 1 --2- 172.21.15.49:0/4187755792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1625dc0 0x1630010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd1d200700 1 -- 172.21.15.49:0/4187755792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1625dc0 msgr2=0x1630010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd1d200700 1 --2- 172.21.15.49:0/4187755792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1625dc0 0x1630010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd1d200700 1 -- 172.21.15.49:0/4187755792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 msgr2=0x1609e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd1d200700 1 --2- 172.21.15.49:0/4187755792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 0x1609e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd1d200700 1 -- 172.21.15.49:0/4187755792 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x155da10 con 0x16259e0 2024-01-22T05:08:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd1dc00700 1 --2- 172.21.15.49:0/4187755792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1625dc0 0x1630010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd1d200700 1 --2- 172.21.15.49:0/4187755792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x15e37c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fcd080144f0 tx=0x7fcd08017000).ready entity=mon.0 client_cookie=c7dfdaa7d39c486d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd0cc00700 1 -- 172.21.15.49:0/4187755792 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd080135b0 con 0x16259e0 2024-01-22T05:08:29.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd0cc00700 1 -- 172.21.15.49:0/4187755792 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd08013710 con 0x16259e0 2024-01-22T05:08:29.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd0cc00700 1 -- 172.21.15.49:0/4187755792 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08013a90 con 0x16259e0 2024-01-22T05:08:29.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd2a08c740 1 -- 172.21.15.49:0/4187755792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 msgr2=0x15e37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.948+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/4187755792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x15e37c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fcd080144f0 tx=0x7fcd08017000).stop 2024-01-22T05:08:29.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.952+0000 7fcd2a08c740 1 -- 172.21.15.49:0/4187755792 shutdown_connections 2024-01-22T05:08:29.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.952+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/4187755792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1625dc0 0x1630010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.952+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/4187755792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 0x1609e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.952+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/4187755792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x15e37c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.952+0000 7fcd2a08c740 1 -- 172.21.15.49:0/4187755792 >> 172.21.15.49:0/4187755792 conn(0x13c2ad0 msgr2=0x15e46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.952+0000 7fcd2a08c740 1 -- 172.21.15.49:0/4187755792 shutdown_connections 2024-01-22T05:08:29.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.952+0000 7fcd2a08c740 1 -- 172.21.15.49:0/4187755792 wait complete. 2024-01-22T05:08:29.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.952+0000 7fcd2a08c740 1 -- start start 2024-01-22T05:08:29.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.952+0000 7fcd2a08c740 1 Processor -- start 2024-01-22T05:08:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd2a08c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 0x15fb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd2a08c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16259e0 0x160a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd2a08c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1625dc0 0x160e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd2a08c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x15e1570 con 0x1625dc0 2024-01-22T05:08:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd2a08c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x160af30 con 0x15df610 2024-01-22T05:08:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd2a08c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x15e2510 con 0x16259e0 2024-01-22T05:08:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd2a08c740 10 client.0 ll_register_callbacks cb 0x155a890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd1dc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1625dc0 0x160e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd1dc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1625dc0 0x160e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38996/0 (socket says 172.21.15.49:38996) 2024-01-22T05:08:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd1dc00700 1 -- 172.21.15.49:0/2574917290 learned_addr learned my addr 172.21.15.49:0/2574917290 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd17e00700 1 --2- 172.21.15.49:0/2574917290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16259e0 0x160a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd1d200700 1 --2- 172.21.15.49:0/2574917290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 0x15fb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd1dc00700 1 -- 172.21.15.49:0/2574917290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16259e0 msgr2=0x160a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd1dc00700 1 --2- 172.21.15.49:0/2574917290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16259e0 0x160a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd1dc00700 1 -- 172.21.15.49:0/2574917290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 msgr2=0x15fb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd1dc00700 1 --2- 172.21.15.49:0/2574917290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 0x15fb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd1dc00700 1 -- 172.21.15.49:0/2574917290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd08011d20 con 0x1625dc0 2024-01-22T05:08:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd17e00700 1 --2- 172.21.15.49:0/2574917290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16259e0 0x160a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd1d200700 1 --2- 172.21.15.49:0/2574917290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 0x15fb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd1dc00700 1 --2- 172.21.15.49:0/2574917290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1625dc0 0x160e030 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fcd10047910 tx=0x7fcd1000f000).ready entity=mon.0 client_cookie=76d1103e53c06fb0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd05600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd05600700 1 -- 172.21.15.49:0/2574917290 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1004a900 con 0x1625dc0 2024-01-22T05:08:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd2a08c740 1 -- 172.21.15.49:0/2574917290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x155a480 con 0x1625dc0 2024-01-22T05:08:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd05600700 1 -- 172.21.15.49:0/2574917290 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcd1004aa60 con 0x1625dc0 2024-01-22T05:08:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd05600700 1 -- 172.21.15.49:0/2574917290 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd10047410 con 0x1625dc0 2024-01-22T05:08:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd2a08c740 10 client.6018 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.956+0000 7fcd2a08c740 1 -- 172.21.15.49:0/2574917290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x1558c40 con 0x1625dc0 2024-01-22T05:08:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.960+0000 7fcd05600700 1 -- 172.21.15.49:0/2574917290 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x155a480 con 0x1625dc0 2024-01-22T05:08:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.960+0000 7fcd05600700 1 -- 172.21.15.49:0/2574917290 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcd1004a370 con 0x1625dc0 2024-01-22T05:08:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.960+0000 7fcd2a08c740 10 client.6018 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.960+0000 7fcd2a08c740 10 client.6018 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.960+0000 7fcd2a08c740 20 client.6018 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.960+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/2574917290 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x160ca30 0x160ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.960+0000 7fcd2a08c740 4 client.6018 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.960+0000 7fcd2a08c740 1 -- 172.21.15.49:0/2574917290 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x15509d0 con 0x160ca30 2024-01-22T05:08:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.960+0000 7fcd1d200700 1 --2- 172.21.15.49:0/2574917290 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x160ca30 0x160ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.960+0000 7fcd1d200700 1 --2- 172.21.15.49:0/2574917290 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x160ca30 0x160ce10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6c027629fb2f5d2d server_cookie=bfd67e5736aa1dc3 in_seq=0 out_seq=0 2024-01-22T05:08:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.960+0000 7fcd05600700 10 client.6018 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.960+0000 7fcd05600700 1 -- 172.21.15.49:0/2574917290 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x15509d0 con 0x160ca30 2024-01-22T05:08:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.960+0000 7fcd05600700 10 client.6018 handle_command_reply: tid=0 2024-01-22T05:08:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.960+0000 7fcd2a08c740 1 client.6018 shutdown 2024-01-22T05:08:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.964+0000 7fcd2a08c740 1 -- 172.21.15.49:0/2574917290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1625dc0 msgr2=0x160e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.964+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/2574917290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1625dc0 0x160e030 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fcd10047910 tx=0x7fcd1000f000).stop 2024-01-22T05:08:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.964+0000 7fcd2a08c740 1 -- 172.21.15.49:0/2574917290 shutdown_connections 2024-01-22T05:08:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.964+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/2574917290 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x160ca30 0x160ce10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.964+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/2574917290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1625dc0 0x160e030 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.964+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/2574917290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16259e0 0x160a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.964+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/2574917290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 0x15fb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.964+0000 7fcd2a08c740 1 -- 172.21.15.49:0/2574917290 >> 172.21.15.49:0/2574917290 conn(0x13c2ad0 msgr2=0x162b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.964+0000 7fcd05600700 0 client.6018 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.964+0000 7fcd2a08c740 1 -- 172.21.15.49:0/2574917290 shutdown_connections 2024-01-22T05:08:29.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.964+0000 7fcd2a08c740 1 -- 172.21.15.49:0/2574917290 wait complete. 2024-01-22T05:08:29.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.964+0000 7fcd2a08c740 20 client.6018 trim_cache size 0 max 16384 2024-01-22T05:08:29.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.984+0000 7fcd2a08c740 1 Processor -- start 2024-01-22T05:08:29.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.984+0000 7fcd2a08c740 1 -- start start 2024-01-22T05:08:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.984+0000 7fcd2a08c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15df610 0x160ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.984+0000 7fcd2a08c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x160f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.984+0000 7fcd2a08c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1625dc0 0x1606630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.984+0000 7fcd2a08c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1639800 con 0x16259e0 2024-01-22T05:08:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.984+0000 7fcd2a08c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x16097b0 con 0x1625dc0 2024-01-22T05:08:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.984+0000 7fcd2a08c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1635ef0 con 0x15df610 2024-01-22T05:08:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.984+0000 7fcd17e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x160f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.984+0000 7fcd17e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x160f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39008/0 (socket says 172.21.15.49:39008) 2024-01-22T05:08:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.984+0000 7fcd17e00700 1 -- 172.21.15.49:0/481794972 learned_addr learned my addr 172.21.15.49:0/481794972 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.984+0000 7fcd1dc00700 1 --2- 172.21.15.49:0/481794972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1625dc0 0x1606630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.984+0000 7fcd1d200700 1 --2- 172.21.15.49:0/481794972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15df610 0x160ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd1d200700 1 -- 172.21.15.49:0/481794972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1625dc0 msgr2=0x1606630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd1d200700 1 --2- 172.21.15.49:0/481794972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1625dc0 0x1606630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd1d200700 1 -- 172.21.15.49:0/481794972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 msgr2=0x160f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd1d200700 1 --2- 172.21.15.49:0/481794972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x160f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd1d200700 1 -- 172.21.15.49:0/481794972 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x15e09c0 con 0x15df610 2024-01-22T05:08:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd1d200700 1 --2- 172.21.15.49:0/481794972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15df610 0x160ce10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fcd08021000 tx=0x7fcd0801f000).ready entity=mon.2 client_cookie=353f8a56e8293c11 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd0d600700 1 -- 172.21.15.49:0/481794972 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08030070 con 0x15df610 2024-01-22T05:08:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd0d600700 1 -- 172.21.15.49:0/481794972 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd08013e80 con 0x15df610 2024-01-22T05:08:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd0d600700 1 -- 172.21.15.49:0/481794972 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd080135b0 con 0x15df610 2024-01-22T05:08:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd2a08c740 1 -- 172.21.15.49:0/481794972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15df610 msgr2=0x160ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/481794972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15df610 0x160ce10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fcd08021000 tx=0x7fcd0801f000).stop 2024-01-22T05:08:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd2a08c740 1 -- 172.21.15.49:0/481794972 shutdown_connections 2024-01-22T05:08:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/481794972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1625dc0 0x1606630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/481794972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x160f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/481794972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15df610 0x160ce10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd2a08c740 1 -- 172.21.15.49:0/481794972 >> 172.21.15.49:0/481794972 conn(0x13c2ad0 msgr2=0x15e46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd2a08c740 1 -- 172.21.15.49:0/481794972 shutdown_connections 2024-01-22T05:08:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd2a08c740 1 -- 172.21.15.49:0/481794972 wait complete. 2024-01-22T05:08:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.988+0000 7fcd2a08c740 1 -- start start 2024-01-22T05:08:29.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.992+0000 7fcd2a08c740 1 Processor -- start 2024-01-22T05:08:29.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.992+0000 7fcd2a08c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 0x168c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.992+0000 7fcd2a08c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x1638290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.992+0000 7fcd2a08c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1625dc0 0x1638780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:29.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.992+0000 7fcd2a08c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1638c70 con 0x16259e0 2024-01-22T05:08:29.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.992+0000 7fcd2a08c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x16063b0 con 0x15df610 2024-01-22T05:08:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.992+0000 7fcd2a08c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1607eb0 con 0x1625dc0 2024-01-22T05:08:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.992+0000 7fcd2a08c740 10 client.0 ll_register_callbacks cb 0x7fcd1004b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.992+0000 7fcd17e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x1638290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.992+0000 7fcd17e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x1638290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39012/0 (socket says 172.21.15.49:39012) 2024-01-22T05:08:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.992+0000 7fcd17e00700 1 -- 172.21.15.49:0/584073471 learned_addr learned my addr 172.21.15.49:0/584073471 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:29.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.992+0000 7fcd1dc00700 1 --2- 172.21.15.49:0/584073471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1625dc0 0x1638780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.992+0000 7fcd1d200700 1 --2- 172.21.15.49:0/584073471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 0x168c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:29.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd1dc00700 1 -- 172.21.15.49:0/584073471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 msgr2=0x168c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd1dc00700 1 --2- 172.21.15.49:0/584073471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 0x168c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd1dc00700 1 -- 172.21.15.49:0/584073471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 msgr2=0x1638290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:29.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd1dc00700 1 --2- 172.21.15.49:0/584073471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x1638290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:29.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd1dc00700 1 -- 172.21.15.49:0/584073471 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x155da10 con 0x1625dc0 2024-01-22T05:08:29.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd17e00700 1 --2- 172.21.15.49:0/584073471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x1638290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:29.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd1dc00700 1 --2- 172.21.15.49:0/584073471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1625dc0 0x1638780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fcd10001330 tx=0x7fcd10051000).ready entity=mon.2 client_cookie=cf1c63ac65397a4c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:29.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd05600700 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2024-01-22T05:08:29.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd05600700 1 -- 172.21.15.49:0/584073471 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1004ab10 con 0x1625dc0 2024-01-22T05:08:29.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd05600700 1 -- 172.21.15.49:0/584073471 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcd10061df0 con 0x1625dc0 2024-01-22T05:08:29.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd2a08c740 1 -- 172.21.15.49:0/584073471 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1419a60 con 0x1625dc0 2024-01-22T05:08:29.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd05600700 1 -- 172.21.15.49:0/584073471 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd1000e250 con 0x1625dc0 2024-01-22T05:08:29.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd2a08c740 10 client.5498 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:29.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd2a08c740 1 -- 172.21.15.49:0/584073471 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x7fcd18154c00 con 0x1625dc0 2024-01-22T05:08:29.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd05600700 1 -- 172.21.15.49:0/584073471 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1419a60 con 0x1625dc0 2024-01-22T05:08:29.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd05600700 1 -- 172.21.15.49:0/584073471 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcd10050290 con 0x1625dc0 2024-01-22T05:08:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd2a08c740 10 client.5498 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd2a08c740 10 client.5498 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd2a08c740 20 client.5498 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/584073471 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x15dec50 0x15dd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd2a08c740 4 client.5498 mds_command: new command op to 5569 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-01-22T05:08:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd2a08c740 1 -- 172.21.15.49:0/584073471 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) v1 -- 0x13cf7e0 con 0x15dec50 2024-01-22T05:08:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd1d200700 1 --2- 172.21.15.49:0/584073471 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x15dec50 0x15dd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd05600700 10 client.5498 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:29.996+0000 7fcd1d200700 1 --2- 172.21.15.49:0/584073471 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x15dec50 0x15dd860 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=df2bc4fa68769551 server_cookie=ae133c0629492b7b in_seq=0 out_seq=0 2024-01-22T05:08:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd05600700 1 -- 172.21.15.49:0/584073471 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x13cf7e0 con 0x15dec50 2024-01-22T05:08:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd05600700 10 client.5498 handle_command_reply: tid=0 2024-01-22T05:08:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd2a08c740 1 client.5498 shutdown 2024-01-22T05:08:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd2a08c740 1 -- 172.21.15.49:0/584073471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1625dc0 msgr2=0x1638780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/584073471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1625dc0 0x1638780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fcd10001330 tx=0x7fcd10051000).stop 2024-01-22T05:08:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd2a08c740 1 -- 172.21.15.49:0/584073471 shutdown_connections 2024-01-22T05:08:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/584073471 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x15dec50 0x15dd860 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/584073471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1625dc0 0x1638780 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/584073471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16259e0 0x1638290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd2a08c740 1 --2- 172.21.15.49:0/584073471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15df610 0x168c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd2a08c740 1 -- 172.21.15.49:0/584073471 >> 172.21.15.49:0/584073471 conn(0x13c2ad0 msgr2=0x160dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd05600700 0 client.5498 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd2a08c740 1 -- 172.21.15.49:0/584073471 shutdown_connections 2024-01-22T05:08:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd2a08c740 1 -- 172.21.15.49:0/584073471 wait complete. 2024-01-22T05:08:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd2a08c740 20 client.5498 trim_cache size 0 max 16384 2024-01-22T05:08:30.004 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:30.004 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:08:30.004 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "53572566-3af2-4293-8c06-e984ce1114ae", 2024-01-22T05:08:30.004 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:08:30.004 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd1e600700 1 -- 172.21.15.49:0/1054718468 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccf005a590 msgr2=0x7fccf005ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd1e600700 1 --2- 172.21.15.49:0/1054718468 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccf005a590 0x7fccf005ca50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fcd08006fd0 tx=0x7fcd08006f40).stop 2024-01-22T05:08:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd1e600700 1 -- 172.21.15.49:0/1054718468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd18068af0 msgr2=0x7fcd181543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.000+0000 7fcd1e600700 1 --2- 172.21.15.49:0/1054718468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd18068af0 0x7fcd181543b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fcd1000c7c0 tx=0x7fcd10001510).stop 2024-01-22T05:08:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.004+0000 7fcd1e600700 1 -- 172.21.15.49:0/1054718468 shutdown_connections 2024-01-22T05:08:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.004+0000 7fcd1e600700 1 --2- 172.21.15.49:0/1054718468 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fccf005a590 0x7fccf005ca50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.004+0000 7fcd1e600700 1 --2- 172.21.15.49:0/1054718468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd18068af0 0x7fcd181543b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.004+0000 7fcd1e600700 1 --2- 172.21.15.49:0/1054718468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd18068710 0x7fcd18164210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.004+0000 7fcd1e600700 1 --2- 172.21.15.49:0/1054718468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18065590 0x7fcd18143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.004+0000 7fcd1e600700 1 -- 172.21.15.49:0/1054718468 >> 172.21.15.49:0/1054718468 conn(0x7fcd180c6fc0 msgr2=0x7fcd180659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:30.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.004+0000 7fcd1e600700 1 -- 172.21.15.49:0/1054718468 shutdown_connections 2024-01-22T05:08:30.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.004+0000 7fcd1e600700 1 -- 172.21.15.49:0/1054718468 wait complete. 2024-01-22T05:08:30.028 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '53572566-3af2-4293-8c06-e984ce1114ae', 'mode': 'asynchronous'}' 2024-01-22T05:08:30.028 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-01-22T05:08:30.028 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-01-22T05:08:30.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.192+0000 7fe652c00700 1 Processor -- start 2024-01-22T05:08:30.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.192+0000 7fe652c00700 1 -- start start 2024-01-22T05:08:30.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.196+0000 7fe652c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe64c067a90 0x7fe64c0c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.196+0000 7fe652c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64c068cf0 con 0x7fe64c0aac80 2024-01-22T05:08:30.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.196+0000 7fe652c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64c151e10 con 0x7fe64c0ab0e0 2024-01-22T05:08:30.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.196+0000 7fe652c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64c067e70 con 0x7fe64c067a90 2024-01-22T05:08:30.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.196+0000 7fe64b400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe64c0aac80 0x7fe64c1554c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60090/0 (socket says 172.21.15.49:60090) 2024-01-22T05:08:30.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.196+0000 7fe64b400700 1 -- 172.21.15.49:0/1470712573 learned_addr learned my addr 172.21.15.49:0/1470712573 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:30.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.196+0000 7fe64be00700 1 --2- 172.21.15.49:0/1470712573 >> v2:172.21.15.110:3300/0 conn(0x7fe64c067a90 0x7fe64c0c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe64aa00700 1 -- 172.21.15.49:0/1470712573 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844578412 0 0) 0x7fe64c068cf0 con 0x7fe64c0aac80 2024-01-22T05:08:30.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe64aa00700 1 -- 172.21.15.49:0/1470712573 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe62c0033f0 con 0x7fe64c0aac80 2024-01-22T05:08:30.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe64aa00700 1 -- 172.21.15.49:0/1470712573 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385063747 0 0) 0x7fe64c151e10 con 0x7fe64c0ab0e0 2024-01-22T05:08:30.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe64aa00700 1 -- 172.21.15.49:0/1470712573 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe64c068cf0 con 0x7fe64c0ab0e0 2024-01-22T05:08:30.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe64be00700 1 -- 172.21.15.49:0/1470712573 >> v1:172.21.15.110:6789/0 conn(0x7fe64c0ab0e0 legacy=0x7fe64c0a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe64be00700 1 -- 172.21.15.49:0/1470712573 >> v1:172.21.15.49:6789/0 conn(0x7fe64c0aac80 legacy=0x7fe64c1554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe64aa00700 1 -- 172.21.15.49:0/1470712573 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2339164810 0 0) 0x7fe62c0033f0 con 0x7fe64c0aac80 2024-01-22T05:08:30.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe64be00700 1 -- 172.21.15.49:0/1470712573 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c0680e0 con 0x7fe64c067a90 2024-01-22T05:08:30.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe64be00700 1 --2- 172.21.15.49:0/1470712573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe64c067a90 0x7fe64c0c38d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fe63c009760 tx=0x7fe63c009060).ready entity=mon.1 client_cookie=3a0e2d5f8951baf4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:30.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe64aa00700 1 -- 172.21.15.49:0/1470712573 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634001470 con 0x7fe64c067a90 2024-01-22T05:08:30.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe64aa00700 1 -- 172.21.15.49:0/1470712573 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c011400 con 0x7fe64c067a90 2024-01-22T05:08:30.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe64aa00700 1 -- 172.21.15.49:0/1470712573 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c011780 con 0x7fe64c067a90 2024-01-22T05:08:30.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe652c00700 1 -- 172.21.15.49:0/1470712573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe64c067a90 msgr2=0x7fe64c0c38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe652c00700 1 --2- 172.21.15.49:0/1470712573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe64c067a90 0x7fe64c0c38d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fe63c009760 tx=0x7fe63c009060).stop 2024-01-22T05:08:30.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe652c00700 1 -- 172.21.15.49:0/1470712573 shutdown_connections 2024-01-22T05:08:30.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe652c00700 1 --2- 172.21.15.49:0/1470712573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe64c067a90 0x7fe64c0c38d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.200+0000 7fe652c00700 1 -- 172.21.15.49:0/1470712573 >> 172.21.15.49:0/1470712573 conn(0x7fe64c064f10 msgr2=0x7fe64c0c8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:30.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.204+0000 7fe652c00700 1 -- 172.21.15.49:0/1470712573 shutdown_connections 2024-01-22T05:08:30.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.204+0000 7fe652c00700 1 -- 172.21.15.49:0/1470712573 wait complete. 2024-01-22T05:08:30.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.204+0000 7fe652c00700 1 Processor -- start 2024-01-22T05:08:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.204+0000 7fe652c00700 1 -- start start 2024-01-22T05:08:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe652c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe64c067a90 0x7fe64c0637d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe652c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe64c0aac80 0x7fe64c167ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe652c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe64c0ab0e0 0x7fe64c168190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe652c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c168680 con 0x7fe64c067a90 2024-01-22T05:08:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe652c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c13de00 con 0x7fe64c0ab0e0 2024-01-22T05:08:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe652c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c063340 con 0x7fe64c0aac80 2024-01-22T05:08:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe64be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe64c067a90 0x7fe64c0637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe64be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe64c067a90 0x7fe64c0637d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39026/0 (socket says 172.21.15.49:39026) 2024-01-22T05:08:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe64be00700 1 -- 172.21.15.49:0/47025828 learned_addr learned my addr 172.21.15.49:0/47025828 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe64b400700 1 --2- 172.21.15.49:0/47025828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe64c0aac80 0x7fe64c167ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe650c00700 1 --2- 172.21.15.49:0/47025828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe64c0ab0e0 0x7fe64c168190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe64be00700 1 -- 172.21.15.49:0/47025828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe64c0aac80 msgr2=0x7fe64c167ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe64be00700 1 --2- 172.21.15.49:0/47025828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe64c0aac80 0x7fe64c167ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe64be00700 1 -- 172.21.15.49:0/47025828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe64c0ab0e0 msgr2=0x7fe64c168190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe64be00700 1 --2- 172.21.15.49:0/47025828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe64c0ab0e0 0x7fe64c168190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe64be00700 1 -- 172.21.15.49:0/47025828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c0092a0 con 0x7fe64c067a90 2024-01-22T05:08:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe64be00700 1 --2- 172.21.15.49:0/47025828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe64c067a90 0x7fe64c0637d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fe63c009d50 tx=0x7fe63c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:30.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe643400700 1 -- 172.21.15.49:0/47025828 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c010770 con 0x7fe64c067a90 2024-01-22T05:08:30.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe643400700 1 -- 172.21.15.49:0/47025828 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c0108d0 con 0x7fe64c067a90 2024-01-22T05:08:30.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe652c00700 1 -- 172.21.15.49:0/47025828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64c062730 con 0x7fe64c067a90 2024-01-22T05:08:30.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe643400700 1 -- 172.21.15.49:0/47025828 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c010c50 con 0x7fe64c067a90 2024-01-22T05:08:30.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.208+0000 7fe652c00700 1 -- 172.21.15.49:0/47025828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64c062cf0 con 0x7fe64c067a90 2024-01-22T05:08:30.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.212+0000 7fe643400700 1 -- 172.21.15.49:0/47025828 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe63c01d430 con 0x7fe64c067a90 2024-01-22T05:08:30.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.212+0000 7fe643400700 1 --2- 172.21.15.49:0/47025828 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe62405a540 0x7fe62405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.212+0000 7fe643400700 1 -- 172.21.15.49:0/47025828 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe63c075520 con 0x7fe64c067a90 2024-01-22T05:08:30.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.216+0000 7fe64b400700 1 --2- 172.21.15.49:0/47025828 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe62405a540 0x7fe62405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.216+0000 7fe64b400700 1 --2- 172.21.15.49:0/47025828 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe62405a540 0x7fe62405ca00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fe64c0a9a70 tx=0x7fe634000bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.216+0000 7fe65d10c740 1 Processor -- start 2024-01-22T05:08:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.216+0000 7fe65d10c740 1 -- start start 2024-01-22T05:08:30.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe65d10c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x116e850 0x116ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe65d10c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1123e10 0x1124290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe65d10c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1124780 0x1176170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe65d10c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x10632f0 con 0x1124780 2024-01-22T05:08:30.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe65d10c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x10864f0 con 0x1123e10 2024-01-22T05:08:30.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe65d10c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x104fd60 con 0x116e850 2024-01-22T05:08:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe650c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1124780 0x1176170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe650c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1124780 0x1176170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39042/0 (socket says 172.21.15.49:39042) 2024-01-22T05:08:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe650c00700 1 -- 172.21.15.49:0/2207923189 learned_addr learned my addr 172.21.15.49:0/2207923189 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe64b400700 1 --2- 172.21.15.49:0/2207923189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1123e10 0x1124290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe64be00700 1 --2- 172.21.15.49:0/2207923189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x116e850 0x116ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe650c00700 1 -- 172.21.15.49:0/2207923189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x116e850 msgr2=0x116ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe650c00700 1 --2- 172.21.15.49:0/2207923189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x116e850 0x116ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe650c00700 1 -- 172.21.15.49:0/2207923189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1123e10 msgr2=0x1124290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe650c00700 1 --2- 172.21.15.49:0/2207923189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1123e10 0x1124290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe650c00700 1 -- 172.21.15.49:0/2207923189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10b4ce0 con 0x1124780 2024-01-22T05:08:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe64b400700 1 --2- 172.21.15.49:0/2207923189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1123e10 0x1124290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe650c00700 1 --2- 172.21.15.49:0/2207923189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1124780 0x1176170 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fe644003db0 tx=0x7fe644007ef0).ready entity=mon.0 client_cookie=2af4f691c4fc69eb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe63b400700 1 -- 172.21.15.49:0/2207923189 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe644003970 con 0x1124780 2024-01-22T05:08:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe63b400700 1 -- 172.21.15.49:0/2207923189 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe644002a20 con 0x1124780 2024-01-22T05:08:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe63b400700 1 -- 172.21.15.49:0/2207923189 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe644002da0 con 0x1124780 2024-01-22T05:08:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe65d10c740 1 -- 172.21.15.49:0/2207923189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1124780 msgr2=0x1176170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.220+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2207923189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1124780 0x1176170 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fe644003db0 tx=0x7fe644007ef0).stop 2024-01-22T05:08:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.224+0000 7fe65d10c740 1 -- 172.21.15.49:0/2207923189 shutdown_connections 2024-01-22T05:08:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.224+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2207923189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1124780 0x1176170 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.224+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2207923189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1123e10 0x1124290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.224+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2207923189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x116e850 0x116ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.224+0000 7fe65d10c740 1 -- 172.21.15.49:0/2207923189 >> 172.21.15.49:0/2207923189 conn(0xf08690 msgr2=0x1128750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:30.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.224+0000 7fe65d10c740 1 -- 172.21.15.49:0/2207923189 shutdown_connections 2024-01-22T05:08:30.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.224+0000 7fe65d10c740 1 -- 172.21.15.49:0/2207923189 wait complete. 2024-01-22T05:08:30.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.224+0000 7fe65d10c740 1 -- start start 2024-01-22T05:08:30.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.224+0000 7fe65d10c740 1 Processor -- start 2024-01-22T05:08:30.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe65d10c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x114ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe65d10c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1124780 0x116dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe65d10c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x116e850 0x1124b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe65d10c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1180b30 con 0x1123e10 2024-01-22T05:08:30.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe65d10c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1153fa0 con 0x116e850 2024-01-22T05:08:30.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe65d10c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x117fcd0 con 0x1124780 2024-01-22T05:08:30.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe65d10c740 10 client.0 ll_register_callbacks cb 0x10e1970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:30.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe64be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x114ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe64be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x114ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39050/0 (socket says 172.21.15.49:39050) 2024-01-22T05:08:30.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe64be00700 1 -- 172.21.15.49:0/2351536688 learned_addr learned my addr 172.21.15.49:0/2351536688 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:30.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe650c00700 1 --2- 172.21.15.49:0/2351536688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x116e850 0x1124b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe64b400700 1 --2- 172.21.15.49:0/2351536688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1124780 0x116dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe64be00700 1 -- 172.21.15.49:0/2351536688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1124780 msgr2=0x116dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:30.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe64be00700 1 --2- 172.21.15.49:0/2351536688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1124780 0x116dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe64be00700 1 -- 172.21.15.49:0/2351536688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x116e850 msgr2=0x1124b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:30.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe64be00700 1 --2- 172.21.15.49:0/2351536688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x116e850 0x1124b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe64be00700 1 -- 172.21.15.49:0/2351536688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64c068cf0 con 0x1123e10 2024-01-22T05:08:30.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe64b400700 1 --2- 172.21.15.49:0/2351536688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1124780 0x116dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:30.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe64be00700 1 --2- 172.21.15.49:0/2351536688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x114ced0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fe63c010530 tx=0x7fe63c00e000).ready entity=mon.0 client_cookie=533d5786f386be01 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:30.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe633e00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:30.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe633e00700 1 -- 172.21.15.49:0/2351536688 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0750a0 con 0x1123e10 2024-01-22T05:08:30.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe633e00700 1 -- 172.21.15.49:0/2351536688 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe63c075200 con 0x1123e10 2024-01-22T05:08:30.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe65d10c740 1 -- 172.21.15.49:0/2351536688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x10a0240 con 0x1123e10 2024-01-22T05:08:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe633e00700 1 -- 172.21.15.49:0/2351536688 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe63c04beb0 con 0x1123e10 2024-01-22T05:08:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe65d10c740 10 client.6036 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe65d10c740 1 -- 172.21.15.49:0/2351536688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x10a37d0 con 0x1123e10 2024-01-22T05:08:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe633e00700 1 -- 172.21.15.49:0/2351536688 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x10a0240 con 0x1123e10 2024-01-22T05:08:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe633e00700 1 -- 172.21.15.49:0/2351536688 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe63c0485a0 con 0x1123e10 2024-01-22T05:08:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.228+0000 7fe65d10c740 10 client.6036 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe65d10c740 10 client.6036 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe65d10c740 20 client.6036 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2351536688 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1155d80 0x1156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe65d10c740 4 client.6036 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe65d10c740 1 -- 172.21.15.49:0/2351536688 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1096790 con 0x1155d80 2024-01-22T05:08:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe64b400700 1 --2- 172.21.15.49:0/2351536688 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1155d80 0x1156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe633e00700 10 client.6036 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe64b400700 1 --2- 172.21.15.49:0/2351536688 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1155d80 0x1156160 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=12483731bd1ededc server_cookie=a952d40e547730eb in_seq=0 out_seq=0 2024-01-22T05:08:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe633e00700 1 -- 172.21.15.49:0/2351536688 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1096790 con 0x1155d80 2024-01-22T05:08:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe633e00700 10 client.6036 handle_command_reply: tid=0 2024-01-22T05:08:30.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe65d10c740 1 client.6036 shutdown 2024-01-22T05:08:30.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe65d10c740 1 -- 172.21.15.49:0/2351536688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 msgr2=0x114ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2351536688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x114ced0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fe63c010530 tx=0x7fe63c00e000).stop 2024-01-22T05:08:30.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe65d10c740 1 -- 172.21.15.49:0/2351536688 shutdown_connections 2024-01-22T05:08:30.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2351536688 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x1155d80 0x1156160 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2351536688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x116e850 0x1124b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2351536688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1124780 0x116dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2351536688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x114ced0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe65d10c740 1 -- 172.21.15.49:0/2351536688 >> 172.21.15.49:0/2351536688 conn(0xf08690 msgr2=0x116a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:30.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.232+0000 7fe633e00700 0 client.6036 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:30.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.236+0000 7fe65d10c740 1 -- 172.21.15.49:0/2351536688 shutdown_connections 2024-01-22T05:08:30.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.236+0000 7fe65d10c740 1 -- 172.21.15.49:0/2351536688 wait complete. 2024-01-22T05:08:30.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.236+0000 7fe65d10c740 20 client.6036 trim_cache size 0 max 16384 2024-01-22T05:08:30.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe65d10c740 1 Processor -- start 2024-01-22T05:08:30.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe65d10c740 1 -- start start 2024-01-22T05:08:30.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe65d10c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x1171250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe65d10c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1124780 0x117bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe65d10c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x116e850 0x1185d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe65d10c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x11513d0 con 0x1123e10 2024-01-22T05:08:30.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe65d10c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x10c85d0 con 0x1124780 2024-01-22T05:08:30.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe65d10c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1125b20 con 0x116e850 2024-01-22T05:08:30.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe64be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x1171250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe64be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x1171250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39052/0 (socket says 172.21.15.49:39052) 2024-01-22T05:08:30.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe64be00700 1 -- 172.21.15.49:0/450437794 learned_addr learned my addr 172.21.15.49:0/450437794 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:30.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe650c00700 1 --2- 172.21.15.49:0/450437794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x116e850 0x1185d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe64b400700 1 --2- 172.21.15.49:0/450437794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1124780 0x117bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe64be00700 1 -- 172.21.15.49:0/450437794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x116e850 msgr2=0x1185d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:30.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe64be00700 1 --2- 172.21.15.49:0/450437794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x116e850 0x1185d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe64be00700 1 -- 172.21.15.49:0/450437794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1124780 msgr2=0x117bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:30.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe64be00700 1 --2- 172.21.15.49:0/450437794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1124780 0x117bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe64be00700 1 -- 172.21.15.49:0/450437794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1124ec0 con 0x1123e10 2024-01-22T05:08:30.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe64b400700 1 --2- 172.21.15.49:0/450437794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1124780 0x117bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:30.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.256+0000 7fe64be00700 1 --2- 172.21.15.49:0/450437794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x1171250 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fe63c006e00 tx=0x7fe63c050000).ready entity=mon.0 client_cookie=dfe6ed4de432f8b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:30.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.260+0000 7fe63be00700 1 -- 172.21.15.49:0/450437794 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c03d030 con 0x1123e10 2024-01-22T05:08:30.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.260+0000 7fe63be00700 1 -- 172.21.15.49:0/450437794 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c0734c0 con 0x1123e10 2024-01-22T05:08:30.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.260+0000 7fe63be00700 1 -- 172.21.15.49:0/450437794 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c04c2f0 con 0x1123e10 2024-01-22T05:08:30.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.260+0000 7fe65d10c740 1 -- 172.21.15.49:0/450437794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 msgr2=0x1171250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.260+0000 7fe65d10c740 1 --2- 172.21.15.49:0/450437794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x1171250 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fe63c006e00 tx=0x7fe63c050000).stop 2024-01-22T05:08:30.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.260+0000 7fe65d10c740 1 -- 172.21.15.49:0/450437794 shutdown_connections 2024-01-22T05:08:30.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.260+0000 7fe65d10c740 1 --2- 172.21.15.49:0/450437794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x116e850 0x1185d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.260+0000 7fe65d10c740 1 --2- 172.21.15.49:0/450437794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1124780 0x117bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.260+0000 7fe65d10c740 1 --2- 172.21.15.49:0/450437794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x1171250 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.260+0000 7fe65d10c740 1 -- 172.21.15.49:0/450437794 >> 172.21.15.49:0/450437794 conn(0xf08690 msgr2=0x1150c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:30.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.260+0000 7fe65d10c740 1 -- 172.21.15.49:0/450437794 shutdown_connections 2024-01-22T05:08:30.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.260+0000 7fe65d10c740 1 -- 172.21.15.49:0/450437794 wait complete. 2024-01-22T05:08:30.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.260+0000 7fe65d10c740 1 -- start start 2024-01-22T05:08:30.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.260+0000 7fe65d10c740 1 Processor -- start 2024-01-22T05:08:30.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe65d10c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x11db510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe65d10c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1124780 0x1150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe65d10c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x116e850 0x1150e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe65d10c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x11dba00 con 0x1123e10 2024-01-22T05:08:30.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe65d10c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1151360 con 0x116e850 2024-01-22T05:08:30.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe65d10c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1155ba0 con 0x1124780 2024-01-22T05:08:30.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe65d10c740 10 client.0 ll_register_callbacks cb 0x7fe63c04c540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:30.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe64be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x11db510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe64be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x11db510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39054/0 (socket says 172.21.15.49:39054) 2024-01-22T05:08:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe64be00700 1 -- 172.21.15.49:0/2475042475 learned_addr learned my addr 172.21.15.49:0/2475042475 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe650c00700 1 --2- 172.21.15.49:0/2475042475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x116e850 0x1150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe64b400700 1 --2- 172.21.15.49:0/2475042475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1124780 0x1150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe64be00700 1 -- 172.21.15.49:0/2475042475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1124780 msgr2=0x1150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe64be00700 1 --2- 172.21.15.49:0/2475042475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1124780 0x1150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe64be00700 1 -- 172.21.15.49:0/2475042475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x116e850 msgr2=0x1150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe64be00700 1 --2- 172.21.15.49:0/2475042475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x116e850 0x1150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe64be00700 1 -- 172.21.15.49:0/2475042475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x10a37d0 con 0x1123e10 2024-01-22T05:08:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe64b400700 1 --2- 172.21.15.49:0/2475042475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1124780 0x1150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe650c00700 1 --2- 172.21.15.49:0/2475042475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x116e850 0x1150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:30.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe64be00700 1 --2- 172.21.15.49:0/2475042475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x11db510 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fe63c006e00 tx=0x7fe63c03b070).ready entity=mon.0 client_cookie=8ab62f69d2ef0ad2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:30.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe633e00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:30.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe633e00700 1 -- 172.21.15.49:0/2475042475 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c03d070 con 0x1123e10 2024-01-22T05:08:30.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe633e00700 1 -- 172.21.15.49:0/2475042475 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe63c03e070 con 0x1123e10 2024-01-22T05:08:30.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.264+0000 7fe65d10c740 1 -- 172.21.15.49:0/2475042475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xf5f620 con 0x1123e10 2024-01-22T05:08:30.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe633e00700 1 -- 172.21.15.49:0/2475042475 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe63c048020 con 0x1123e10 2024-01-22T05:08:30.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 10 client.6042 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:30.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 1 -- 172.21.15.49:0/2475042475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x116ef90 con 0x1123e10 2024-01-22T05:08:30.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe633e00700 1 -- 172.21.15.49:0/2475042475 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xf5f620 con 0x1123e10 2024-01-22T05:08:30.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe633e00700 1 -- 172.21.15.49:0/2475042475 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe63c048180 con 0x1123e10 2024-01-22T05:08:30.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 10 client.6042 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:30.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 10 client.6042 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:30.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 20 client.6042 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:30.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2475042475 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x114f260 0x11dbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 4 client.6042 mds_command: new command op to 5569 tid=0[{"prefix": "scrub start", "path": "/"}] 2024-01-22T05:08:30.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 1 -- 172.21.15.49:0/2475042475 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) v1 -- 0xf153a0 con 0x114f260 2024-01-22T05:08:30.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe64b400700 1 --2- 172.21.15.49:0/2475042475 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x114f260 0x11dbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe64b400700 1 --2- 172.21.15.49:0/2475042475 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x114f260 0x11dbe20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b7369d1de8328dcb server_cookie=c680f35bddd1870d in_seq=0 out_seq=0 2024-01-22T05:08:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe633e00700 10 client.6042 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe633e00700 1 -- 172.21.15.49:0/2475042475 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0xf153a0 con 0x114f260 2024-01-22T05:08:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe633e00700 10 client.6042 handle_command_reply: tid=0 2024-01-22T05:08:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 1 client.6042 shutdown 2024-01-22T05:08:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 1 -- 172.21.15.49:0/2475042475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 msgr2=0x11db510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2475042475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x11db510 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fe63c006e00 tx=0x7fe63c03b070).stop 2024-01-22T05:08:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 1 -- 172.21.15.49:0/2475042475 shutdown_connections 2024-01-22T05:08:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2475042475 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x114f260 0x11dbe20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2475042475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x116e850 0x1150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2475042475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1124780 0x1150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 1 --2- 172.21.15.49:0/2475042475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1123e10 0x11db510 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe633e00700 0 client.6042 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.268+0000 7fe65d10c740 1 -- 172.21.15.49:0/2475042475 >> 172.21.15.49:0/2475042475 conn(0xf08690 msgr2=0x11285b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:30.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.272+0000 7fe65d10c740 1 -- 172.21.15.49:0/2475042475 shutdown_connections 2024-01-22T05:08:30.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.272+0000 7fe65d10c740 1 -- 172.21.15.49:0/2475042475 wait complete. 2024-01-22T05:08:30.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.272+0000 7fe65d10c740 20 client.6042 trim_cache size 0 max 16384 2024-01-22T05:08:30.274 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:30.274 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:08:30.274 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "683b1314-989e-46bc-9dff-9dc9bc9627e6", 2024-01-22T05:08:30.274 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:08:30.275 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:30.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.272+0000 7fe652c00700 1 -- 172.21.15.49:0/47025828 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe62405a540 msgr2=0x7fe62405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.272+0000 7fe652c00700 1 --2- 172.21.15.49:0/47025828 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe62405a540 0x7fe62405ca00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fe64c0a9a70 tx=0x7fe634000bc0).stop 2024-01-22T05:08:30.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.272+0000 7fe652c00700 1 -- 172.21.15.49:0/47025828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe64c067a90 msgr2=0x7fe64c0637d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.272+0000 7fe652c00700 1 --2- 172.21.15.49:0/47025828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe64c067a90 0x7fe64c0637d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fe63c009d50 tx=0x7fe63c016000).stop 2024-01-22T05:08:30.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.272+0000 7fe652c00700 1 -- 172.21.15.49:0/47025828 shutdown_connections 2024-01-22T05:08:30.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.272+0000 7fe652c00700 1 --2- 172.21.15.49:0/47025828 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe62405a540 0x7fe62405ca00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.272+0000 7fe652c00700 1 --2- 172.21.15.49:0/47025828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe64c0ab0e0 0x7fe64c168190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.272+0000 7fe652c00700 1 --2- 172.21.15.49:0/47025828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe64c0aac80 0x7fe64c167ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.272+0000 7fe652c00700 1 --2- 172.21.15.49:0/47025828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe64c067a90 0x7fe64c0637d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.272+0000 7fe652c00700 1 -- 172.21.15.49:0/47025828 >> 172.21.15.49:0/47025828 conn(0x7fe64c064f10 msgr2=0x7fe64c0c7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:30.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.272+0000 7fe652c00700 1 -- 172.21.15.49:0/47025828 shutdown_connections 2024-01-22T05:08:30.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.272+0000 7fe652c00700 1 -- 172.21.15.49:0/47025828 wait complete. 2024-01-22T05:08:30.299 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': '683b1314-989e-46bc-9dff-9dc9bc9627e6', 'mode': 'asynchronous'}' 2024-01-22T05:08:30.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:08:30.299 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2024-01-22T05:08:30.323 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2024-01-22T05:08:30.323 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:30.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.532+0000 7f3c87a00700 1 Processor -- start 2024-01-22T05:08:30.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.532+0000 7f3c87a00700 1 -- start start 2024-01-22T05:08:30.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.532+0000 7f3c87a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3c80155d20 0x7f3c80065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.532+0000 7f3c87a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c800a8e50 0x7f3c800c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.532+0000 7f3c87a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c800c1a40 con 0x7f3c80066070 2024-01-22T05:08:30.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.532+0000 7f3c87a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c80159310 con 0x7f3c80155d20 2024-01-22T05:08:30.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.532+0000 7f3c87a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c800c13f0 con 0x7f3c800a8e50 2024-01-22T05:08:30.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c85000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3c80155d20 0x7f3c80065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c85a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c800a8e50 0x7f3c800c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c85000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3c80155d20 0x7f3c80065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:45158/0 (socket says 172.21.15.49:45158) 2024-01-22T05:08:30.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c85000700 1 -- 172.21.15.49:0/3365846396 learned_addr learned my addr 172.21.15.49:0/3365846396 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:30.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c85000700 1 -- 172.21.15.49:0/3365846396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c800a8e50 msgr2=0x7f3c800c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:30.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c85000700 1 --2- 172.21.15.49:0/3365846396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c800a8e50 0x7f3c800c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c85000700 1 -- 172.21.15.49:0/3365846396 >> v1:172.21.15.110:6789/0 conn(0x7f3c80066070 legacy=0x7f3c800a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c85000700 1 -- 172.21.15.49:0/3365846396 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c800c16d0 con 0x7f3c80155d20 2024-01-22T05:08:30.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c85000700 1 --2- 172.21.15.49:0/3365846396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c80155d20 0x7f3c80065b80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f3c70006fd0 tx=0x7f3c700090f0).ready entity=mon.1 client_cookie=a683088d2f4357bf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:30.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c7f400700 1 -- 172.21.15.49:0/3365846396 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7000b580 con 0x7f3c80155d20 2024-01-22T05:08:30.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c7f400700 1 -- 172.21.15.49:0/3365846396 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7000b6e0 con 0x7f3c80155d20 2024-01-22T05:08:30.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c7f400700 1 -- 172.21.15.49:0/3365846396 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7000ba60 con 0x7f3c80155d20 2024-01-22T05:08:30.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c87a00700 1 -- 172.21.15.49:0/3365846396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c80155d20 msgr2=0x7f3c80065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c87a00700 1 --2- 172.21.15.49:0/3365846396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c80155d20 0x7f3c80065b80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f3c70006fd0 tx=0x7f3c700090f0).stop 2024-01-22T05:08:30.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c87a00700 1 -- 172.21.15.49:0/3365846396 shutdown_connections 2024-01-22T05:08:30.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c87a00700 1 --2- 172.21.15.49:0/3365846396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c800a8e50 0x7f3c800c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c87a00700 1 --2- 172.21.15.49:0/3365846396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c80155d20 0x7f3c80065b80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.536+0000 7f3c87a00700 1 -- 172.21.15.49:0/3365846396 >> 172.21.15.49:0/3365846396 conn(0x7f3c800c6540 msgr2=0x7f3c800c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:30.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.540+0000 7f3c87a00700 1 -- 172.21.15.49:0/3365846396 shutdown_connections 2024-01-22T05:08:30.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.540+0000 7f3c87a00700 1 -- 172.21.15.49:0/3365846396 wait complete. 2024-01-22T05:08:30.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.540+0000 7f3c87a00700 1 Processor -- start 2024-01-22T05:08:30.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c87a00700 1 -- start start 2024-01-22T05:08:30.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c87a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c80066070 0x7f3c80145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c87a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c800a8e50 0x7f3c801561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c87a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c80155d20 0x7f3c801684a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c87a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c80157160 con 0x7f3c80066070 2024-01-22T05:08:30.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c87a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c801566b0 con 0x7f3c800a8e50 2024-01-22T05:08:30.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c87a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c80159610 con 0x7f3c80155d20 2024-01-22T05:08:30.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c85000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c80066070 0x7f3c80145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c85000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c80066070 0x7f3c80145e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39056/0 (socket says 172.21.15.49:39056) 2024-01-22T05:08:30.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c85000700 1 -- 172.21.15.49:0/2522201437 learned_addr learned my addr 172.21.15.49:0/2522201437 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:30.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c7fe00700 1 --2- 172.21.15.49:0/2522201437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c800a8e50 0x7f3c801561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c85a00700 1 --2- 172.21.15.49:0/2522201437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c80155d20 0x7f3c801684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c85000700 1 -- 172.21.15.49:0/2522201437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c80155d20 msgr2=0x7f3c801684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c85000700 1 --2- 172.21.15.49:0/2522201437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c80155d20 0x7f3c801684a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c85000700 1 -- 172.21.15.49:0/2522201437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c800a8e50 msgr2=0x7f3c801561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c85000700 1 --2- 172.21.15.49:0/2522201437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c800a8e50 0x7f3c801561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.544+0000 7f3c85000700 1 -- 172.21.15.49:0/2522201437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c70009370 con 0x7f3c80066070 2024-01-22T05:08:30.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.548+0000 7f3c85000700 1 --2- 172.21.15.49:0/2522201437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c80066070 0x7f3c80145e50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f3c70009fd0 tx=0x7f3c70017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:30.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.548+0000 7f3c77e00700 1 -- 172.21.15.49:0/2522201437 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7000b850 con 0x7f3c80066070 2024-01-22T05:08:30.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.548+0000 7f3c77e00700 1 -- 172.21.15.49:0/2522201437 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7000b9b0 con 0x7f3c80066070 2024-01-22T05:08:30.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.548+0000 7f3c87a00700 1 -- 172.21.15.49:0/2522201437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c80168990 con 0x7f3c80066070 2024-01-22T05:08:30.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.548+0000 7f3c77e00700 1 -- 172.21.15.49:0/2522201437 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7001b660 con 0x7f3c80066070 2024-01-22T05:08:30.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.548+0000 7f3c87a00700 1 -- 172.21.15.49:0/2522201437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c80156ba0 con 0x7f3c80066070 2024-01-22T05:08:30.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.548+0000 7f3c87a00700 1 -- 172.21.15.49:0/2522201437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c80047060 con 0x7f3c80066070 2024-01-22T05:08:30.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.548+0000 7f3c77e00700 1 -- 172.21.15.49:0/2522201437 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3c7001ba10 con 0x7f3c80066070 2024-01-22T05:08:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.552+0000 7f3c77e00700 1 --2- 172.21.15.49:0/2522201437 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c5805a510 0x7f3c5805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.552+0000 7f3c77e00700 1 -- 172.21.15.49:0/2522201437 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3c700762e0 con 0x7f3c80066070 2024-01-22T05:08:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.552+0000 7f3c7fe00700 1 --2- 172.21.15.49:0/2522201437 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c5805a510 0x7f3c5805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:30.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.552+0000 7f3c7fe00700 1 --2- 172.21.15.49:0/2522201437 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c5805a510 0x7f3c5805c9d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f3c80145a00 tx=0x7f3c68007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.556+0000 7f3c77e00700 1 -- 172.21.15.49:0/2522201437 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3c70049860 con 0x7f3c80066070 2024-01-22T05:08:30.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.756+0000 7f3c87a00700 1 -- 172.21.15.49:0/2522201437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c800c23c0 con 0x7f3c80066070 2024-01-22T05:08:30.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.756+0000 7f3c77e00700 1 -- 172.21.15.49:0/2522201437 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f3c70029020 con 0x7f3c80066070 2024-01-22T05:08:30.760 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:30.760 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:22.134281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":8,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:30.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.760+0000 7f3c87a00700 1 -- 172.21.15.49:0/2522201437 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c5805a510 msgr2=0x7f3c5805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.760+0000 7f3c87a00700 1 --2- 172.21.15.49:0/2522201437 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c5805a510 0x7f3c5805c9d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f3c80145a00 tx=0x7f3c68007d40).stop 2024-01-22T05:08:30.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.760+0000 7f3c87a00700 1 -- 172.21.15.49:0/2522201437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c80066070 msgr2=0x7f3c80145e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:30.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.760+0000 7f3c87a00700 1 --2- 172.21.15.49:0/2522201437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c80066070 0x7f3c80145e50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f3c70009fd0 tx=0x7f3c70017000).stop 2024-01-22T05:08:30.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.764+0000 7f3c87a00700 1 -- 172.21.15.49:0/2522201437 shutdown_connections 2024-01-22T05:08:30.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.764+0000 7f3c87a00700 1 --2- 172.21.15.49:0/2522201437 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c5805a510 0x7f3c5805c9d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.764+0000 7f3c87a00700 1 --2- 172.21.15.49:0/2522201437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c80155d20 0x7f3c801684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.764+0000 7f3c87a00700 1 --2- 172.21.15.49:0/2522201437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c800a8e50 0x7f3c801561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.764+0000 7f3c87a00700 1 --2- 172.21.15.49:0/2522201437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c80066070 0x7f3c80145e50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:30.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.764+0000 7f3c87a00700 1 -- 172.21.15.49:0/2522201437 >> 172.21.15.49:0/2522201437 conn(0x7f3c800c6540 msgr2=0x7f3c80067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:30.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.764+0000 7f3c87a00700 1 -- 172.21.15.49:0/2522201437 shutdown_connections 2024-01-22T05:08:30.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:30.764+0000 7f3c87a00700 1 -- 172.21.15.49:0/2522201437 wait complete. 2024-01-22T05:08:30.769 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 44 2024-01-22T05:08:30.786 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2024-01-22T05:08:30.955 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:30.955 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:08:30.955 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:30.976 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' got response code '0' and stdout '{ "return_code": 0 } ' 2024-01-22T05:08:30.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:08:30.976 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2024-01-22T05:08:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:08:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:08:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0431317 s, 24.3 MB/s 2024-01-22T05:08:31.038 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2024-01-22T05:08:31.038 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:31.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.204+0000 7f4c92a00700 1 Processor -- start 2024-01-22T05:08:31.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.204+0000 7f4c92a00700 1 -- start start 2024-01-22T05:08:31.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.208+0000 7f4c92a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c8c065240 0x7f4c8c0644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:31.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.208+0000 7f4c92a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8c064e90 con 0x7f4c8c0649e0 2024-01-22T05:08:31.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.208+0000 7f4c92a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8c15c7d0 con 0x7f4c8c065620 2024-01-22T05:08:31.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.208+0000 7f4c92a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c0c2700 con 0x7f4c8c065240 2024-01-22T05:08:31.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.208+0000 7f4c91400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4c8c0649e0 0x7f4c8c15c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60104/0 (socket says 172.21.15.49:60104) 2024-01-22T05:08:31.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.208+0000 7f4c91400700 1 -- 172.21.15.49:0/2603946658 learned_addr learned my addr 172.21.15.49:0/2603946658 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:31.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.208+0000 7f4c8be00700 1 --2- 172.21.15.49:0/2603946658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c8c065240 0x7f4c8c0644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:31.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c8aa00700 1 -- 172.21.15.49:0/2603946658 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357422901 0 0) 0x7f4c84001490 con 0x7f4c8c0649e0 2024-01-22T05:08:31.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c8aa00700 1 -- 172.21.15.49:0/2603946658 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c6c0033f0 con 0x7f4c8c0649e0 2024-01-22T05:08:31.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c8aa00700 1 -- 172.21.15.49:0/2603946658 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707532225 0 0) 0x7f4c8c15c7d0 con 0x7f4c8c065620 2024-01-22T05:08:31.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c8aa00700 1 -- 172.21.15.49:0/2603946658 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c84001490 con 0x7f4c8c065620 2024-01-22T05:08:31.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c8be00700 1 -- 172.21.15.49:0/2603946658 >> v1:172.21.15.110:6789/0 conn(0x7f4c8c065620 legacy=0x7f4c8c15b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:31.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c8be00700 1 -- 172.21.15.49:0/2603946658 >> v1:172.21.15.49:6789/0 conn(0x7f4c8c0649e0 legacy=0x7f4c8c15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:31.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c8aa00700 1 -- 172.21.15.49:0/2603946658 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 568479605 0 0) 0x7f4c6c0033f0 con 0x7f4c8c0649e0 2024-01-22T05:08:31.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c8be00700 1 -- 172.21.15.49:0/2603946658 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c0c29a0 con 0x7f4c8c065240 2024-01-22T05:08:31.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c8be00700 1 --2- 172.21.15.49:0/2603946658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c8c065240 0x7f4c8c0644f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f4c7c009790 tx=0x7f4c7c009060).ready entity=mon.2 client_cookie=4b139723ba022e5e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:31.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c8aa00700 1 -- 172.21.15.49:0/2603946658 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84001980 con 0x7f4c8c065240 2024-01-22T05:08:31.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c8aa00700 1 -- 172.21.15.49:0/2603946658 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c011400 con 0x7f4c8c065240 2024-01-22T05:08:31.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c8aa00700 1 -- 172.21.15.49:0/2603946658 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c011780 con 0x7f4c8c065240 2024-01-22T05:08:31.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c92a00700 1 -- 172.21.15.49:0/2603946658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c8c065240 msgr2=0x7f4c8c0644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:31.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c92a00700 1 --2- 172.21.15.49:0/2603946658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c8c065240 0x7f4c8c0644f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f4c7c009790 tx=0x7f4c7c009060).stop 2024-01-22T05:08:31.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c92a00700 1 -- 172.21.15.49:0/2603946658 shutdown_connections 2024-01-22T05:08:31.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c92a00700 1 --2- 172.21.15.49:0/2603946658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c8c065240 0x7f4c8c0644f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:31.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c92a00700 1 -- 172.21.15.49:0/2603946658 >> 172.21.15.49:0/2603946658 conn(0x7f4c8c0c87f0 msgr2=0x7f4c8c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:31.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c92a00700 1 -- 172.21.15.49:0/2603946658 shutdown_connections 2024-01-22T05:08:31.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.212+0000 7f4c92a00700 1 -- 172.21.15.49:0/2603946658 wait complete. 2024-01-22T05:08:31.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.216+0000 7f4c92a00700 1 Processor -- start 2024-01-22T05:08:31.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c92a00700 1 -- start start 2024-01-22T05:08:31.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c92a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c8c0649e0 0x7f4c8c0bf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:31.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c92a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c8c065240 0x7f4c8c16c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:31.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c92a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c8c065620 0x7f4c8c0ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:31.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c92a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c168600 con 0x7f4c8c065620 2024-01-22T05:08:31.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c92a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c1688a0 con 0x7f4c8c065240 2024-01-22T05:08:31.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c92a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c168b80 con 0x7f4c8c0649e0 2024-01-22T05:08:31.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c91400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c8c065620 0x7f4c8c0ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:31.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c91400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c8c065620 0x7f4c8c0ac960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39062/0 (socket says 172.21.15.49:39062) 2024-01-22T05:08:31.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c91400700 1 -- 172.21.15.49:0/1776043735 learned_addr learned my addr 172.21.15.49:0/1776043735 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:31.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c8be00700 1 --2- 172.21.15.49:0/1776043735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c8c0649e0 0x7f4c8c0bf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:31.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c8b400700 1 --2- 172.21.15.49:0/1776043735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c8c065240 0x7f4c8c16c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:31.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c91400700 1 -- 172.21.15.49:0/1776043735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c8c0649e0 msgr2=0x7f4c8c0bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:31.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c91400700 1 --2- 172.21.15.49:0/1776043735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c8c0649e0 0x7f4c8c0bf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c91400700 1 -- 172.21.15.49:0/1776043735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c8c065240 msgr2=0x7f4c8c16c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c91400700 1 --2- 172.21.15.49:0/1776043735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c8c065240 0x7f4c8c16c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.220+0000 7f4c91400700 1 -- 172.21.15.49:0/1776043735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c0092a0 con 0x7f4c8c065620 2024-01-22T05:08:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.224+0000 7f4c91400700 1 --2- 172.21.15.49:0/1776043735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c8c065620 0x7f4c8c0ac960 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f4c8400cc70 tx=0x7f4c84001f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.224+0000 7f4c83400700 1 -- 172.21.15.49:0/1776043735 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84004c40 con 0x7f4c8c065620 2024-01-22T05:08:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.224+0000 7f4c83400700 1 -- 172.21.15.49:0/1776043735 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c84004da0 con 0x7f4c8c065620 2024-01-22T05:08:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.224+0000 7f4c92a00700 1 -- 172.21.15.49:0/1776043735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8c168e60 con 0x7f4c8c065620 2024-01-22T05:08:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.224+0000 7f4c83400700 1 -- 172.21.15.49:0/1776043735 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84007380 con 0x7f4c8c065620 2024-01-22T05:08:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.224+0000 7f4c92a00700 1 -- 172.21.15.49:0/1776043735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8c169380 con 0x7f4c8c065620 2024-01-22T05:08:31.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.224+0000 7f4c92a00700 1 -- 172.21.15.49:0/1776043735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8c1690a0 con 0x7f4c8c065620 2024-01-22T05:08:31.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.224+0000 7f4c83400700 1 -- 172.21.15.49:0/1776043735 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4c84007730 con 0x7f4c8c065620 2024-01-22T05:08:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.228+0000 7f4c83400700 1 --2- 172.21.15.49:0/1776043735 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c6405a510 0x7f4c6405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.228+0000 7f4c83400700 1 -- 172.21.15.49:0/1776043735 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4c84074810 con 0x7f4c8c065620 2024-01-22T05:08:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.228+0000 7f4c8be00700 1 --2- 172.21.15.49:0/1776043735 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c6405a510 0x7f4c6405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:31.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.228+0000 7f4c8be00700 1 --2- 172.21.15.49:0/1776043735 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c6405a510 0x7f4c6405c9d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f4c7c00a010 tx=0x7f4c7c016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.236+0000 7f4c83400700 1 -- 172.21.15.49:0/1776043735 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c8c1690a0 con 0x7f4c8c065620 2024-01-22T05:08:31.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.432+0000 7f4c92a00700 1 -- 172.21.15.49:0/1776043735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c8c064e90 con 0x7f4c8c065620 2024-01-22T05:08:31.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.436+0000 7f4c83400700 1 -- 172.21.15.49:0/1776043735 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f4c8c064e90 con 0x7f4c8c065620 2024-01-22T05:08:31.438 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:31.438 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:22.134281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":8,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.440+0000 7f4c92a00700 1 -- 172.21.15.49:0/1776043735 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c6405a510 msgr2=0x7f4c6405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.440+0000 7f4c92a00700 1 --2- 172.21.15.49:0/1776043735 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c6405a510 0x7f4c6405c9d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f4c7c00a010 tx=0x7f4c7c016000).stop 2024-01-22T05:08:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.440+0000 7f4c92a00700 1 -- 172.21.15.49:0/1776043735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c8c065620 msgr2=0x7f4c8c0ac960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.440+0000 7f4c92a00700 1 --2- 172.21.15.49:0/1776043735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c8c065620 0x7f4c8c0ac960 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f4c8400cc70 tx=0x7f4c84001f70).stop 2024-01-22T05:08:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.440+0000 7f4c92a00700 1 -- 172.21.15.49:0/1776043735 shutdown_connections 2024-01-22T05:08:31.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.440+0000 7f4c92a00700 1 --2- 172.21.15.49:0/1776043735 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4c6405a510 0x7f4c6405c9d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:31.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.440+0000 7f4c92a00700 1 --2- 172.21.15.49:0/1776043735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c8c065620 0x7f4c8c0ac960 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:31.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.440+0000 7f4c92a00700 1 --2- 172.21.15.49:0/1776043735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c8c065240 0x7f4c8c16c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:31.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.440+0000 7f4c92a00700 1 --2- 172.21.15.49:0/1776043735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c8c0649e0 0x7f4c8c0bf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:31.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.440+0000 7f4c92a00700 1 -- 172.21.15.49:0/1776043735 >> 172.21.15.49:0/1776043735 conn(0x7f4c8c0c87f0 msgr2=0x7f4c8c156120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:31.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.440+0000 7f4c92a00700 1 -- 172.21.15.49:0/1776043735 shutdown_connections 2024-01-22T05:08:31.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:31.440+0000 7f4c92a00700 1 -- 172.21.15.49:0/1776043735 wait complete. 2024-01-22T05:08:31.446 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 44 2024-01-22T05:08:31.464 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2024-01-22T05:08:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:31.628 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:08:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:31.642 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' got response code '0' and stdout '{ "return_code": 0 } ' 2024-01-22T05:08:31.643 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:08:31.643 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-01-22T05:08:31.643 DEBUG:teuthology.orchestra.run.smithi049:> import stat 2024-01-22T05:08:31.643 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:08:31.643 DEBUG:teuthology.orchestra.run.smithi049:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2024-01-22T05:08:31.643 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-01-22T05:08:31.735 INFO:teuthology.orchestra.run.smithi049.stdout:1099511630189 2024-01-22T05:08:31.923 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-01-22T05:08:32.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.140+0000 7f8120c00700 1 Processor -- start 2024-01-22T05:08:32.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.140+0000 7f8120c00700 1 -- start start 2024-01-22T05:08:32.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.144+0000 7f8120c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f811c152970 0x7f811c0a8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.144+0000 7f8120c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811c066d80 con 0x7f811c0691b0 2024-01-22T05:08:32.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.144+0000 7f8120c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811c155a00 con 0x7f811c0a9460 2024-01-22T05:08:32.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.144+0000 7f8120c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811c155ce0 con 0x7f811c152970 2024-01-22T05:08:32.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.144+0000 7f811a800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f811c0691b0 0x7f811c0bc230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60118/0 (socket says 172.21.15.49:60118) 2024-01-22T05:08:32.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.144+0000 7f811a800700 1 -- 172.21.15.49:0/2109102652 learned_addr learned my addr 172.21.15.49:0/2109102652 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:32.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.144+0000 7f8119e00700 1 --2- 172.21.15.49:0/2109102652 >> v2:172.21.15.110:3300/0 conn(0x7f811c152970 0x7f811c0a8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 -- 172.21.15.49:0/2109102652 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369259188 0 0) 0x7f811c066d80 con 0x7f811c0691b0 2024-01-22T05:08:32.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 -- 172.21.15.49:0/2109102652 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80fc0033f0 con 0x7f811c0691b0 2024-01-22T05:08:32.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 -- 172.21.15.49:0/2109102652 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3433767408 0 0) 0x7f80fc0033f0 con 0x7f811c0691b0 2024-01-22T05:08:32.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 -- 172.21.15.49:0/2109102652 >> v2:172.21.15.110:3300/0 conn(0x7f811c152970 msgr2=0x7f811c0a8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 --2- 172.21.15.49:0/2109102652 >> v2:172.21.15.110:3300/0 conn(0x7f811c152970 0x7f811c0a8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 -- 172.21.15.49:0/2109102652 >> v1:172.21.15.110:6789/0 conn(0x7f811c0a9460 legacy=0x7f811c068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 -- 172.21.15.49:0/2109102652 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c155fc0 con 0x7f811c0691b0 2024-01-22T05:08:32.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 -- 172.21.15.49:0/2109102652 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f81140017f0 con 0x7f811c0691b0 2024-01-22T05:08:32.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8119e00700 1 --2- 172.21.15.49:0/2109102652 >> v2:172.21.15.110:3300/0 conn(0x7f811c152970 0x7f811c0a8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:32.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 -- 172.21.15.49:0/2109102652 >> v1:172.21.15.49:6789/0 conn(0x7f811c0691b0 legacy=0x7f811c0bc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 --2- 172.21.15.49:0/2109102652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80fc0038e0 0x7f80fc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 --2- 172.21.15.49:0/2109102652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80fc004690 0x7f80fc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 --2- 172.21.15.49:0/2109102652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80fc005000 0x7f80fc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 -- 172.21.15.49:0/2109102652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c155ce0 con 0x7f80fc005000 2024-01-22T05:08:32.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 -- 172.21.15.49:0/2109102652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc00bf60 con 0x7f80fc0038e0 2024-01-22T05:08:32.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 -- 172.21.15.49:0/2109102652 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc00c0f0 con 0x7f80fc004690 2024-01-22T05:08:32.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f811a800700 1 --2- 172.21.15.49:0/2109102652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80fc005000 0x7f80fc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8119e00700 1 --2- 172.21.15.49:0/2109102652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80fc0038e0 0x7f80fc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8119400700 1 --2- 172.21.15.49:0/2109102652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80fc004690 0x7f80fc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f811a800700 1 -- 172.21.15.49:0/2109102652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80fc004690 msgr2=0x7f80fc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f811a800700 1 --2- 172.21.15.49:0/2109102652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80fc004690 0x7f80fc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f811a800700 1 -- 172.21.15.49:0/2109102652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80fc0038e0 msgr2=0x7f80fc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f811a800700 1 --2- 172.21.15.49:0/2109102652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80fc0038e0 0x7f80fc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f811a800700 1 -- 172.21.15.49:0/2109102652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc0033f0 con 0x7f80fc005000 2024-01-22T05:08:32.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f811a800700 1 -- 172.21.15.49:0/2109102652 reap_dead start 2024-01-22T05:08:32.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f811a800700 1 --2- 172.21.15.49:0/2109102652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80fc005000 0x7f80fc00b8e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f811400c450 tx=0x7f811400c760).ready entity=mon.0 client_cookie=1c500b4ca4ec09f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 -- 172.21.15.49:0/2109102652 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114002030 con 0x7f80fc005000 2024-01-22T05:08:32.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 -- 172.21.15.49:0/2109102652 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811400cdf0 con 0x7f80fc005000 2024-01-22T05:08:32.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.148+0000 7f8118a00700 1 -- 172.21.15.49:0/2109102652 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114005d30 con 0x7f80fc005000 2024-01-22T05:08:32.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.152+0000 7f8120c00700 1 -- 172.21.15.49:0/2109102652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80fc005000 msgr2=0x7f80fc00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.152+0000 7f8120c00700 1 --2- 172.21.15.49:0/2109102652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80fc005000 0x7f80fc00b8e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f811400c450 tx=0x7f811400c760).stop 2024-01-22T05:08:32.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.152+0000 7f8120c00700 1 -- 172.21.15.49:0/2109102652 shutdown_connections 2024-01-22T05:08:32.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.152+0000 7f8120c00700 1 --2- 172.21.15.49:0/2109102652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80fc005000 0x7f80fc00b8e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.152+0000 7f8120c00700 1 -- 172.21.15.49:0/2109102652 >> 172.21.15.49:0/2109102652 conn(0x7f811c0c4310 msgr2=0x7f811c065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.152+0000 7f8120c00700 1 -- 172.21.15.49:0/2109102652 shutdown_connections 2024-01-22T05:08:32.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.152+0000 7f8120c00700 1 -- 172.21.15.49:0/2109102652 wait complete. 2024-01-22T05:08:32.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.152+0000 7f8120c00700 1 Processor -- start 2024-01-22T05:08:32.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.156+0000 7f8120c00700 1 -- start start 2024-01-22T05:08:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.156+0000 7f8120c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80fc005000 0x7f811c152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.156+0000 7f8120c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f811c1631e0 0x7f811c164f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.156+0000 7f8120c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f811c162a70 0x7f811c154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.156+0000 7f8120c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c165400 con 0x7f80fc005000 2024-01-22T05:08:32.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.156+0000 7f8120c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c0ab3a0 con 0x7f811c162a70 2024-01-22T05:08:32.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.156+0000 7f8120c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811c153330 con 0x7f811c1631e0 2024-01-22T05:08:32.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.156+0000 7f8119e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80fc005000 0x7f811c152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.156+0000 7f8119e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80fc005000 0x7f811c152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39082/0 (socket says 172.21.15.49:39082) 2024-01-22T05:08:32.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.156+0000 7f8119e00700 1 -- 172.21.15.49:0/1374482037 learned_addr learned my addr 172.21.15.49:0/1374482037 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.160+0000 7f811a800700 1 --2- 172.21.15.49:0/1374482037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f811c162a70 0x7f811c154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.160+0000 7f8119400700 1 --2- 172.21.15.49:0/1374482037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f811c1631e0 0x7f811c164f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.160+0000 7f8119e00700 1 -- 172.21.15.49:0/1374482037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f811c1631e0 msgr2=0x7f811c164f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.160+0000 7f8119e00700 1 --2- 172.21.15.49:0/1374482037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f811c1631e0 0x7f811c164f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.160+0000 7f8119e00700 1 -- 172.21.15.49:0/1374482037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f811c162a70 msgr2=0x7f811c154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.160+0000 7f8119e00700 1 --2- 172.21.15.49:0/1374482037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f811c162a70 0x7f811c154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.160+0000 7f8119e00700 1 -- 172.21.15.49:0/1374482037 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c153610 con 0x7f80fc005000 2024-01-22T05:08:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.160+0000 7f8119e00700 1 --2- 172.21.15.49:0/1374482037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80fc005000 0x7f811c152d50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f810c011b10 tx=0x7f810c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.160+0000 7f8111600700 1 -- 172.21.15.49:0/1374482037 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c00f9f0 con 0x7f80fc005000 2024-01-22T05:08:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.160+0000 7f8111600700 1 -- 172.21.15.49:0/1374482037 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c00fb50 con 0x7f80fc005000 2024-01-22T05:08:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.160+0000 7f8111600700 1 -- 172.21.15.49:0/1374482037 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c00fed0 con 0x7f80fc005000 2024-01-22T05:08:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.160+0000 7f8120c00700 1 -- 172.21.15.49:0/1374482037 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811c1538f0 con 0x7f80fc005000 2024-01-22T05:08:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.160+0000 7f8120c00700 1 -- 172.21.15.49:0/1374482037 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c162ef0 con 0x7f80fc005000 2024-01-22T05:08:32.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.160+0000 7f8111600700 1 -- 172.21.15.49:0/1374482037 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f810c014650 con 0x7f80fc005000 2024-01-22T05:08:32.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.164+0000 7f8111600700 1 --2- 172.21.15.49:0/1374482037 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f80f405a510 0x7f80f405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.164+0000 7f8111600700 1 -- 172.21.15.49:0/1374482037 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f810c075760 con 0x7f80fc005000 2024-01-22T05:08:32.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.164+0000 7f8119400700 1 --2- 172.21.15.49:0/1374482037 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f80f405a510 0x7f80f405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.164+0000 7f8119400700 1 --2- 172.21.15.49:0/1374482037 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f80f405a510 0x7f80f405c9d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f811c150090 tx=0x7f8104009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.168+0000 7f812b045740 1 Processor -- start 2024-01-22T05:08:32.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.168+0000 7f812b045740 1 -- start start 2024-01-22T05:08:32.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.168+0000 7f812b045740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292a820 0x290d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.168+0000 7f812b045740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292d840 0x28e14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.168+0000 7f812b045740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28e19b0 0x292ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.168+0000 7f812b045740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2821340 con 0x292a820 2024-01-22T05:08:32.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.168+0000 7f812b045740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x28444e0 con 0x292d840 2024-01-22T05:08:32.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.168+0000 7f812b045740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x280dce0 con 0x28e19b0 2024-01-22T05:08:32.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.168+0000 7f8119e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292a820 0x290d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.168+0000 7f8119e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292a820 0x290d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39084/0 (socket says 172.21.15.49:39084) 2024-01-22T05:08:32.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.168+0000 7f8119e00700 1 -- 172.21.15.49:0/2792507257 learned_addr learned my addr 172.21.15.49:0/2792507257 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.168+0000 7f8119400700 1 --2- 172.21.15.49:0/2792507257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292d840 0x28e14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f811a800700 1 --2- 172.21.15.49:0/2792507257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28e19b0 0x292ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f8119e00700 1 -- 172.21.15.49:0/2792507257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28e19b0 msgr2=0x292ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f8119e00700 1 --2- 172.21.15.49:0/2792507257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28e19b0 0x292ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f8119e00700 1 -- 172.21.15.49:0/2792507257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292d840 msgr2=0x28e14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f8119e00700 1 --2- 172.21.15.49:0/2792507257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292d840 0x28e14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f8119e00700 1 -- 172.21.15.49:0/2792507257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2814ed0 con 0x292a820 2024-01-22T05:08:32.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f8119e00700 1 --2- 172.21.15.49:0/2792507257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292a820 0x290d0a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f810c04c6a0 tx=0x7f810c014000).ready entity=mon.0 client_cookie=6fda6286958d095b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f8109c00700 1 -- 172.21.15.49:0/2792507257 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c04aba0 con 0x292a820 2024-01-22T05:08:32.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f8109c00700 1 -- 172.21.15.49:0/2792507257 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c04ae00 con 0x292a820 2024-01-22T05:08:32.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f8109c00700 1 -- 172.21.15.49:0/2792507257 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c04bf50 con 0x292a820 2024-01-22T05:08:32.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f812b045740 1 -- 172.21.15.49:0/2792507257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292a820 msgr2=0x290d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f812b045740 1 --2- 172.21.15.49:0/2792507257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292a820 0x290d0a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f810c04c6a0 tx=0x7f810c014000).stop 2024-01-22T05:08:32.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f812b045740 1 -- 172.21.15.49:0/2792507257 shutdown_connections 2024-01-22T05:08:32.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f812b045740 1 --2- 172.21.15.49:0/2792507257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28e19b0 0x292ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f812b045740 1 --2- 172.21.15.49:0/2792507257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292d840 0x28e14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f812b045740 1 --2- 172.21.15.49:0/2792507257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292a820 0x290d0a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f812b045740 1 -- 172.21.15.49:0/2792507257 >> 172.21.15.49:0/2792507257 conn(0x26c6680 msgr2=0x28e7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f812b045740 1 -- 172.21.15.49:0/2792507257 shutdown_connections 2024-01-22T05:08:32.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.172+0000 7f812b045740 1 -- 172.21.15.49:0/2792507257 wait complete. 2024-01-22T05:08:32.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.176+0000 7f812b045740 1 -- start start 2024-01-22T05:08:32.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.176+0000 7f812b045740 1 Processor -- start 2024-01-22T05:08:32.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28e19b0 0x29115c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 0x2927890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292d840 0x29065a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2912740 con 0x292d840 2024-01-22T05:08:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2911ea0 con 0x292a820 2024-01-22T05:08:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2912180 con 0x28e19b0 2024-01-22T05:08:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 10 client.0 ll_register_callbacks cb 0x289e7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f811a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292d840 0x29065a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f811a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292d840 0x29065a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39090/0 (socket says 172.21.15.49:39090) 2024-01-22T05:08:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f811a800700 1 -- 172.21.15.49:0/1267422500 learned_addr learned my addr 172.21.15.49:0/1267422500 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f8119e00700 1 --2- 172.21.15.49:0/1267422500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28e19b0 0x29115c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f811a800700 1 -- 172.21.15.49:0/1267422500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28e19b0 msgr2=0x29115c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f811a800700 1 --2- 172.21.15.49:0/1267422500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28e19b0 0x29115c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f811a800700 1 -- 172.21.15.49:0/1267422500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 msgr2=0x2927890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f8119400700 1 --2- 172.21.15.49:0/1267422500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 0x2927890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f811a800700 1 --2- 172.21.15.49:0/1267422500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 0x2927890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f811a800700 1 -- 172.21.15.49:0/1267422500 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c162ef0 con 0x292d840 2024-01-22T05:08:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f8119400700 1 --2- 172.21.15.49:0/1267422500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 0x2927890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f811a800700 1 --2- 172.21.15.49:0/1267422500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292d840 0x29065a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f8114006000 tx=0x7f8114015000).ready entity=mon.0 client_cookie=b1d241c4fe719589 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f8102000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f8102000700 1 -- 172.21.15.49:0/1267422500 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140017b0 con 0x292d840 2024-01-22T05:08:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f8102000700 1 -- 172.21.15.49:0/1267422500 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8114005e40 con 0x292d840 2024-01-22T05:08:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 1 -- 172.21.15.49:0/1267422500 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x285e230 con 0x292d840 2024-01-22T05:08:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f8102000700 1 -- 172.21.15.49:0/1267422500 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8114007700 con 0x292d840 2024-01-22T05:08:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 10 client.6063 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 1 -- 172.21.15.49:0/1267422500 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x28617c0 con 0x292d840 2024-01-22T05:08:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f8102000700 1 -- 172.21.15.49:0/1267422500 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x285e230 con 0x292d840 2024-01-22T05:08:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f8102000700 1 -- 172.21.15.49:0/1267422500 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f811402b070 con 0x292d840 2024-01-22T05:08:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 10 client.6063 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 10 client.6063 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 20 client.6063 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 1 --2- 172.21.15.49:0/1267422500 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2947ec0 0x294a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 4 client.6063 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.180+0000 7f812b045740 1 -- 172.21.15.49:0/1267422500 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2854780 con 0x2947ec0 2024-01-22T05:08:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f8119e00700 1 --2- 172.21.15.49:0/1267422500 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2947ec0 0x294a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f8119e00700 1 --2- 172.21.15.49:0/1267422500 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2947ec0 0x294a2b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2ec4dd4b42260bf3 server_cookie=e6cc31b8b47b87b5 in_seq=0 out_seq=0 2024-01-22T05:08:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f8102000700 10 client.6063 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f8102000700 1 -- 172.21.15.49:0/1267422500 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2854780 con 0x2947ec0 2024-01-22T05:08:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f8102000700 10 client.6063 handle_command_reply: tid=0 2024-01-22T05:08:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f812b045740 1 client.6063 shutdown 2024-01-22T05:08:32.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f812b045740 1 -- 172.21.15.49:0/1267422500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292d840 msgr2=0x29065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f812b045740 1 --2- 172.21.15.49:0/1267422500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292d840 0x29065a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f8114006000 tx=0x7f8114015000).stop 2024-01-22T05:08:32.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f812b045740 1 -- 172.21.15.49:0/1267422500 shutdown_connections 2024-01-22T05:08:32.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f812b045740 1 --2- 172.21.15.49:0/1267422500 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2947ec0 0x294a2b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f812b045740 1 --2- 172.21.15.49:0/1267422500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292d840 0x29065a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f812b045740 1 --2- 172.21.15.49:0/1267422500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 0x2927890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f812b045740 1 --2- 172.21.15.49:0/1267422500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28e19b0 0x29115c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f812b045740 1 -- 172.21.15.49:0/1267422500 >> 172.21.15.49:0/1267422500 conn(0x26c6680 msgr2=0x28e07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f8102000700 0 client.6063 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:32.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f812b045740 1 -- 172.21.15.49:0/1267422500 shutdown_connections 2024-01-22T05:08:32.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.184+0000 7f812b045740 1 -- 172.21.15.49:0/1267422500 wait complete. 2024-01-22T05:08:32.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.188+0000 7f812b045740 20 client.6063 trim_cache size 0 max 16384 2024-01-22T05:08:32.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.200+0000 7f812b045740 1 Processor -- start 2024-01-22T05:08:32.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.200+0000 7f812b045740 1 -- start start 2024-01-22T05:08:32.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f812b045740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28e19b0 0x290ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f812b045740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 0x28e0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f812b045740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x292d840 0x28e0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f812b045740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2910a40 con 0x28e19b0 2024-01-22T05:08:32.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f812b045740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x294a7f0 con 0x292a820 2024-01-22T05:08:32.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f812b045740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x292a060 con 0x292d840 2024-01-22T05:08:32.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f8119e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28e19b0 0x290ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f8119e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28e19b0 0x290ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39100/0 (socket says 172.21.15.49:39100) 2024-01-22T05:08:32.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f8119e00700 1 -- 172.21.15.49:0/493179040 learned_addr learned my addr 172.21.15.49:0/493179040 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f811a800700 1 --2- 172.21.15.49:0/493179040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x292d840 0x28e0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f8119400700 1 --2- 172.21.15.49:0/493179040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 0x28e0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f8119e00700 1 -- 172.21.15.49:0/493179040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x292d840 msgr2=0x28e0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f8119e00700 1 --2- 172.21.15.49:0/493179040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x292d840 0x28e0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f8119e00700 1 -- 172.21.15.49:0/493179040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 msgr2=0x28e0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f8119e00700 1 --2- 172.21.15.49:0/493179040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 0x28e0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f8119e00700 1 -- 172.21.15.49:0/493179040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c155160 con 0x28e19b0 2024-01-22T05:08:32.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f8119e00700 1 --2- 172.21.15.49:0/493179040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28e19b0 0x290ee30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f810c009fd0 tx=0x7f810c055040).ready entity=mon.0 client_cookie=b8452ceda9ff9101 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f810a600700 1 -- 172.21.15.49:0/493179040 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c04bf50 con 0x28e19b0 2024-01-22T05:08:32.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f810a600700 1 -- 172.21.15.49:0/493179040 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c04aba0 con 0x28e19b0 2024-01-22T05:08:32.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f810a600700 1 -- 172.21.15.49:0/493179040 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c048850 con 0x28e19b0 2024-01-22T05:08:32.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f812b045740 1 -- 172.21.15.49:0/493179040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28e19b0 msgr2=0x290ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.204+0000 7f812b045740 1 --2- 172.21.15.49:0/493179040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28e19b0 0x290ee30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f810c009fd0 tx=0x7f810c055040).stop 2024-01-22T05:08:32.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.208+0000 7f812b045740 1 -- 172.21.15.49:0/493179040 shutdown_connections 2024-01-22T05:08:32.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.208+0000 7f812b045740 1 --2- 172.21.15.49:0/493179040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x292d840 0x28e0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.208+0000 7f812b045740 1 --2- 172.21.15.49:0/493179040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 0x28e0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.208+0000 7f812b045740 1 --2- 172.21.15.49:0/493179040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28e19b0 0x290ee30 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.208+0000 7f812b045740 1 -- 172.21.15.49:0/493179040 >> 172.21.15.49:0/493179040 conn(0x26c6680 msgr2=0x290cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.208+0000 7f812b045740 1 -- 172.21.15.49:0/493179040 shutdown_connections 2024-01-22T05:08:32.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.208+0000 7f812b045740 1 -- 172.21.15.49:0/493179040 wait complete. 2024-01-22T05:08:32.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.208+0000 7f812b045740 1 -- start start 2024-01-22T05:08:32.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.208+0000 7f812b045740 1 Processor -- start 2024-01-22T05:08:32.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28e19b0 0x28e6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 0x2908e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292d840 0x2993920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x29279f0 con 0x292d840 2024-01-22T05:08:32.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2906e20 con 0x292a820 2024-01-22T05:08:32.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2909320 con 0x28e19b0 2024-01-22T05:08:32.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 10 client.0 ll_register_callbacks cb 0x7f8114005d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f811a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292d840 0x2993920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f811a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292d840 0x2993920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39112/0 (socket says 172.21.15.49:39112) 2024-01-22T05:08:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f811a800700 1 -- 172.21.15.49:0/1853243948 learned_addr learned my addr 172.21.15.49:0/1853243948 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f8119400700 1 --2- 172.21.15.49:0/1853243948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 0x2908e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f8119e00700 1 --2- 172.21.15.49:0/1853243948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28e19b0 0x28e6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f811a800700 1 -- 172.21.15.49:0/1853243948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28e19b0 msgr2=0x28e6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f811a800700 1 --2- 172.21.15.49:0/1853243948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28e19b0 0x28e6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f811a800700 1 -- 172.21.15.49:0/1853243948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 msgr2=0x2908e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f811a800700 1 --2- 172.21.15.49:0/1853243948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 0x2908e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f811a800700 1 -- 172.21.15.49:0/1853243948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c057040 con 0x292d840 2024-01-22T05:08:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f811a800700 1 --2- 172.21.15.49:0/1853243948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292d840 0x2993920 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f8114022a00 tx=0x7f8114022000).ready entity=mon.0 client_cookie=bb6486e99c1b8b0d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f8102000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f8102000700 1 -- 172.21.15.49:0/1853243948 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114005e20 con 0x292d840 2024-01-22T05:08:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f8102000700 1 -- 172.21.15.49:0/1853243948 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8114007070 con 0x292d840 2024-01-22T05:08:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 1 -- 172.21.15.49:0/1853243948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f810c04ae00 con 0x292d840 2024-01-22T05:08:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f8102000700 1 -- 172.21.15.49:0/1853243948 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8114022680 con 0x292d840 2024-01-22T05:08:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 10 client.6069 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 1 -- 172.21.15.49:0/1853243948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x294a610 con 0x292d840 2024-01-22T05:08:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f8102000700 1 -- 172.21.15.49:0/1853243948 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c04ae00 con 0x292d840 2024-01-22T05:08:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f8102000700 1 -- 172.21.15.49:0/1853243948 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f811400c7d0 con 0x292d840 2024-01-22T05:08:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 10 client.6069 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 10 client.6069 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 20 client.6069 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 1 --2- 172.21.15.49:0/1853243948 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x29274f0 0x2907590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 4 client.6069 mds_command: new command op to 5569 tid=0[{"prefix": "damage ls"}] 2024-01-22T05:08:32.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f812b045740 1 -- 172.21.15.49:0/1853243948 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x271d610 con 0x29274f0 2024-01-22T05:08:32.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f8119e00700 1 --2- 172.21.15.49:0/1853243948 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x29274f0 0x2907590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f8119e00700 1 --2- 172.21.15.49:0/1853243948 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x29274f0 0x2907590 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d90ffe8d6de56c8b server_cookie=91b826f1db2b78f8 in_seq=0 out_seq=0 2024-01-22T05:08:32.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.212+0000 7f8102000700 10 client.6069 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:32.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f8102000700 1 -- 172.21.15.49:0/1853243948 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x271d610 con 0x29274f0 2024-01-22T05:08:32.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f8102000700 10 client.6069 handle_command_reply: tid=0 2024-01-22T05:08:32.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f812b045740 1 client.6069 shutdown 2024-01-22T05:08:32.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f812b045740 1 -- 172.21.15.49:0/1853243948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292d840 msgr2=0x2993920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f812b045740 1 --2- 172.21.15.49:0/1853243948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292d840 0x2993920 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f8114022a00 tx=0x7f8114022000).stop 2024-01-22T05:08:32.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f812b045740 1 -- 172.21.15.49:0/1853243948 shutdown_connections 2024-01-22T05:08:32.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f812b045740 1 --2- 172.21.15.49:0/1853243948 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x29274f0 0x2907590 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f812b045740 1 --2- 172.21.15.49:0/1853243948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292d840 0x2993920 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f8102000700 0 client.6069 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:32.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f812b045740 1 --2- 172.21.15.49:0/1853243948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292a820 0x2908e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f812b045740 1 --2- 172.21.15.49:0/1853243948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28e19b0 0x28e6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f812b045740 1 -- 172.21.15.49:0/1853243948 >> 172.21.15.49:0/1853243948 conn(0x26c6680 msgr2=0x29297f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f812b045740 1 -- 172.21.15.49:0/1853243948 shutdown_connections 2024-01-22T05:08:32.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f812b045740 1 -- 172.21.15.49:0/1853243948 wait complete. 2024-01-22T05:08:32.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f812b045740 20 client.6069 trim_cache size 0 max 16384 2024-01-22T05:08:32.220 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-01-22T05:08:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f8120c00700 1 -- 172.21.15.49:0/1374482037 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f80f405a510 msgr2=0x7f80f405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f8120c00700 1 --2- 172.21.15.49:0/1374482037 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f80f405a510 0x7f80f405c9d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f811c150090 tx=0x7f8104009040).stop 2024-01-22T05:08:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f8120c00700 1 -- 172.21.15.49:0/1374482037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80fc005000 msgr2=0x7f811c152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.216+0000 7f8120c00700 1 --2- 172.21.15.49:0/1374482037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80fc005000 0x7f811c152d50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f810c011b10 tx=0x7f810c009060).stop 2024-01-22T05:08:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.220+0000 7f8120c00700 1 -- 172.21.15.49:0/1374482037 shutdown_connections 2024-01-22T05:08:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.220+0000 7f8120c00700 1 --2- 172.21.15.49:0/1374482037 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f80f405a510 0x7f80f405c9d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.220+0000 7f8120c00700 1 --2- 172.21.15.49:0/1374482037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f811c162a70 0x7f811c154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.220+0000 7f8120c00700 1 --2- 172.21.15.49:0/1374482037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f811c1631e0 0x7f811c164f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.220+0000 7f8120c00700 1 --2- 172.21.15.49:0/1374482037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80fc005000 0x7f811c152d50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.220+0000 7f8120c00700 1 -- 172.21.15.49:0/1374482037 >> 172.21.15.49:0/1374482037 conn(0x7f811c0c4310 msgr2=0x7f811c0bcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.220+0000 7f8120c00700 1 -- 172.21.15.49:0/1374482037 shutdown_connections 2024-01-22T05:08:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.220+0000 7f8120c00700 1 -- 172.21.15.49:0/1374482037 wait complete. 2024-01-22T05:08:32.243 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 1000000096d.00000000 parent 2024-01-22T05:08:32.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.300+0000 7fb8f9affd00 1 Processor -- start 2024-01-22T05:08:32.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.300+0000 7fb8f9affd00 1 -- start start 2024-01-22T05:08:32.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.300+0000 7fb8f9affd00 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564042e889d0 0x564042f2aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.300+0000 7fb8f9affd00 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564042e89690 0x564042ea4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.300+0000 7fb8f9affd00 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564042f2eeb0 0x564042ea50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.300+0000 7fb8f9affd00 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x564042dcf220 con 0x564042f2eeb0 2024-01-22T05:08:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.300+0000 7fb8f9affd00 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x564042e9e740 con 0x564042e89690 2024-01-22T05:08:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.300+0000 7fb8f9affd00 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x564042f2e7c0 con 0x564042e889d0 2024-01-22T05:08:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f7600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564042f2eeb0 0x564042ea50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f6c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564042e889d0 0x564042f2aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f7600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564042f2eeb0 0x564042ea50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39120/0 (socket says 172.21.15.49:39120) 2024-01-22T05:08:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f7600700 1 -- 172.21.15.49:0/2988477932 learned_addr learned my addr 172.21.15.49:0/2988477932 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f6200700 1 --2- 172.21.15.49:0/2988477932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564042e89690 0x564042ea4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f7600700 1 -- 172.21.15.49:0/2988477932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564042e889d0 msgr2=0x564042f2aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f7600700 1 --2- 172.21.15.49:0/2988477932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564042e889d0 0x564042f2aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f7600700 1 -- 172.21.15.49:0/2988477932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564042e89690 msgr2=0x564042ea4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f7600700 1 --2- 172.21.15.49:0/2988477932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564042e89690 0x564042ea4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f7600700 1 -- 172.21.15.49:0/2988477932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e8005db0 con 0x564042f2eeb0 2024-01-22T05:08:32.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f6200700 1 --2- 172.21.15.49:0/2988477932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564042e89690 0x564042ea4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:32.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f7600700 1 --2- 172.21.15.49:0/2988477932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564042f2eeb0 0x564042ea50f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fb8f0006fa0 tx=0x7fb8f0006a90).ready entity=mon.0 client_cookie=d083f8b7ce6f7390 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f4e00700 1 -- 172.21.15.49:0/2988477932 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f00030d0 con 0x564042f2eeb0 2024-01-22T05:08:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f4e00700 1 -- 172.21.15.49:0/2988477932 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f0012400 con 0x564042f2eeb0 2024-01-22T05:08:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f4e00700 1 -- 172.21.15.49:0/2988477932 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0012780 con 0x564042f2eeb0 2024-01-22T05:08:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f9affd00 1 -- 172.21.15.49:0/2988477932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564042f2eeb0 msgr2=0x564042ea50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f9affd00 1 --2- 172.21.15.49:0/2988477932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564042f2eeb0 0x564042ea50f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fb8f0006fa0 tx=0x7fb8f0006a90).stop 2024-01-22T05:08:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f9affd00 1 -- 172.21.15.49:0/2988477932 shutdown_connections 2024-01-22T05:08:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f9affd00 1 --2- 172.21.15.49:0/2988477932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564042f2eeb0 0x564042ea50f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f9affd00 1 --2- 172.21.15.49:0/2988477932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564042e89690 0x564042ea4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f9affd00 1 --2- 172.21.15.49:0/2988477932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564042e889d0 0x564042f2aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f9affd00 1 -- 172.21.15.49:0/2988477932 >> 172.21.15.49:0/2988477932 conn(0x564042ea6b10 msgr2=0x564042ea1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f9affd00 1 -- 172.21.15.49:0/2988477932 shutdown_connections 2024-01-22T05:08:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.304+0000 7fb8f9affd00 1 -- 172.21.15.49:0/2988477932 wait complete. 2024-01-22T05:08:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f9affd00 1 Processor -- start 2024-01-22T05:08:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f9affd00 1 -- start start 2024-01-22T05:08:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f9affd00 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564042e889d0 0x564042e9b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f9affd00 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564042e89690 0x564042f25340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f9affd00 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564042f2eeb0 0x564042f43630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f9affd00 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x564042f2c9b0 con 0x564042f2eeb0 2024-01-22T05:08:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f9affd00 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x564042f443c0 con 0x564042e889d0 2024-01-22T05:08:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f9affd00 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x564042f2c640 con 0x564042e89690 2024-01-22T05:08:32.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f7600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564042f2eeb0 0x564042f43630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f7600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564042f2eeb0 0x564042f43630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39134/0 (socket says 172.21.15.49:39134) 2024-01-22T05:08:32.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f7600700 1 -- 172.21.15.49:0/890756107 learned_addr learned my addr 172.21.15.49:0/890756107 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f6c00700 1 --2- 172.21.15.49:0/890756107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564042e889d0 0x564042e9b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f6200700 1 --2- 172.21.15.49:0/890756107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564042e89690 0x564042f25340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f7600700 1 -- 172.21.15.49:0/890756107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564042e89690 msgr2=0x564042f25340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f7600700 1 --2- 172.21.15.49:0/890756107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564042e89690 0x564042f25340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f7600700 1 -- 172.21.15.49:0/890756107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564042e889d0 msgr2=0x564042e9b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f7600700 1 --2- 172.21.15.49:0/890756107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564042e889d0 0x564042e9b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.308+0000 7fb8f7600700 1 -- 172.21.15.49:0/890756107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564042dfd7f0 con 0x564042f2eeb0 2024-01-22T05:08:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.312+0000 7fb8f7600700 1 --2- 172.21.15.49:0/890756107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564042f2eeb0 0x564042f43630 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fb8f0006fd0 tx=0x7fb8f0013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.312+0000 7fb8eea00700 1 -- 172.21.15.49:0/890756107 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f000d5e0 con 0x564042f2eeb0 2024-01-22T05:08:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.312+0000 7fb8eea00700 1 -- 172.21.15.49:0/890756107 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f000d740 con 0x564042f2eeb0 2024-01-22T05:08:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.312+0000 7fb8f9affd00 1 -- 172.21.15.49:0/890756107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564042df8770 con 0x564042f2eeb0 2024-01-22T05:08:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.312+0000 7fb8eea00700 1 -- 172.21.15.49:0/890756107 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f000dae0 con 0x564042f2eeb0 2024-01-22T05:08:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.312+0000 7fb8f9affd00 1 -- 172.21.15.49:0/890756107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564042dc7a70 con 0x564042f2eeb0 2024-01-22T05:08:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.312+0000 7fb8eea00700 1 -- 172.21.15.49:0/890756107 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb8f001e400 con 0x564042f2eeb0 2024-01-22T05:08:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.316+0000 7fb8eea00700 1 --2- 172.21.15.49:0/890756107 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8d0058ff0 0x7fb8d005b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.316+0000 7fb8eea00700 1 -- 172.21.15.49:0/890756107 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb8f0017030 con 0x564042f2eeb0 2024-01-22T05:08:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.316+0000 7fb8f6c00700 1 --2- 172.21.15.49:0/890756107 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8d0058ff0 0x7fb8d005b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.316+0000 7fb8f9affd00 1 --2- 172.21.15.49:0/890756107 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x564042f40080 0x564042f2b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.316+0000 7fb8f9affd00 1 -- 172.21.15.49:0/890756107 --> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] -- osd_op(unknown.0.0:1 9.21 9:844f785e:::1000000096d.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected e58) v8 -- 0x564042f25830 con 0x564042f40080 2024-01-22T05:08:32.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.316+0000 7fb8f6200700 1 --2- 172.21.15.49:0/890756107 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x564042f40080 0x564042f2b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.316+0000 7fb8f6c00700 1 --2- 172.21.15.49:0/890756107 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8d0058ff0 0x7fb8d005b4b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fb8e800a650 tx=0x7fb8e8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.316+0000 7fb8f6200700 1 --2- 172.21.15.49:0/890756107 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x564042f40080 0x564042f2b930 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.320+0000 7fb8f6200700 1 -- 172.21.15.49:0/890756107 <== osd.2 v2:172.21.15.49:6800/22974 1 ==== osd_op_reply(1 1000000096d.00000000 [rmxattr] v58'35 uv35 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb8e0009b90 con 0x564042f40080 2024-01-22T05:08:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.320+0000 7fb8f9affd00 1 -- 172.21.15.49:0/890756107 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x564042f40080 msgr2=0x564042f2b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.320+0000 7fb8f9affd00 1 --2- 172.21.15.49:0/890756107 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x564042f40080 0x564042f2b930 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.320+0000 7fb8f9affd00 1 -- 172.21.15.49:0/890756107 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8d0058ff0 msgr2=0x7fb8d005b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.320+0000 7fb8f9affd00 1 --2- 172.21.15.49:0/890756107 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8d0058ff0 0x7fb8d005b4b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fb8e800a650 tx=0x7fb8e8016000).stop 2024-01-22T05:08:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.320+0000 7fb8f9affd00 1 -- 172.21.15.49:0/890756107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564042f2eeb0 msgr2=0x564042f43630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.320+0000 7fb8f9affd00 1 --2- 172.21.15.49:0/890756107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564042f2eeb0 0x564042f43630 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fb8f0006fd0 tx=0x7fb8f0013000).stop 2024-01-22T05:08:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.320+0000 7fb8f7600700 1 -- 172.21.15.49:0/890756107 reap_dead start 2024-01-22T05:08:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.320+0000 7fb8f9affd00 1 -- 172.21.15.49:0/890756107 shutdown_connections 2024-01-22T05:08:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.320+0000 7fb8f9affd00 1 -- 172.21.15.49:0/890756107 >> 172.21.15.49:0/890756107 conn(0x564042ea6b10 msgr2=0x564042e56b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.320+0000 7fb8f9affd00 1 -- 172.21.15.49:0/890756107 shutdown_connections 2024-01-22T05:08:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.320+0000 7fb8f9affd00 1 -- 172.21.15.49:0/890756107 wait complete. 2024-01-22T05:08:32.330 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2024-01-22T05:08:32.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2024-01-22T05:08:32.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.496+0000 7f091a400700 1 Processor -- start 2024-01-22T05:08:32.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.496+0000 7f091a400700 1 -- start start 2024-01-22T05:08:32.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.500+0000 7f091a400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0914063840 0x7f0914063c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.500+0000 7f091a400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09140c7540 con 0x7f09140c31b0 2024-01-22T05:08:32.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.500+0000 7f091a400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0914067ba0 con 0x7f09140c7160 2024-01-22T05:08:32.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.500+0000 7f091a400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0914067e80 con 0x7f0914063840 2024-01-22T05:08:32.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.500+0000 7f0912a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f09140c31b0 0x7f09140c3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60120/0 (socket says 172.21.15.49:60120) 2024-01-22T05:08:32.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.500+0000 7f0912a00700 1 -- 172.21.15.49:0/2382578160 learned_addr learned my addr 172.21.15.49:0/2382578160 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:32.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.500+0000 7f0913e00700 1 --2- 172.21.15.49:0/2382578160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0914063840 0x7f0914063c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.500+0000 7f0912000700 1 -- 172.21.15.49:0/2382578160 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023488698 0 0) 0x7f08fc001110 con 0x7f09140c31b0 2024-01-22T05:08:32.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.500+0000 7f0912000700 1 -- 172.21.15.49:0/2382578160 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08f40033f0 con 0x7f09140c31b0 2024-01-22T05:08:32.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.500+0000 7f0912000700 1 -- 172.21.15.49:0/2382578160 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283899770 0 0) 0x7f0914067ba0 con 0x7f09140c7160 2024-01-22T05:08:32.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.500+0000 7f0912000700 1 -- 172.21.15.49:0/2382578160 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08fc001110 con 0x7f09140c7160 2024-01-22T05:08:32.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.500+0000 7f0913e00700 1 -- 172.21.15.49:0/2382578160 >> v1:172.21.15.110:6789/0 conn(0x7f09140c7160 legacy=0x7f0914068c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.500+0000 7f0913e00700 1 -- 172.21.15.49:0/2382578160 >> v1:172.21.15.49:6789/0 conn(0x7f09140c31b0 legacy=0x7f09140c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.500+0000 7f0913e00700 1 -- 172.21.15.49:0/2382578160 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0914068160 con 0x7f0914063840 2024-01-22T05:08:32.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.500+0000 7f0913e00700 1 --2- 172.21.15.49:0/2382578160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0914063840 0x7f0914063c90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f090c009e90 tx=0x7f090c009780).ready entity=mon.2 client_cookie=b275d485e1d5d8d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.504+0000 7f0912000700 1 -- 172.21.15.49:0/2382578160 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c00e070 con 0x7f0914063840 2024-01-22T05:08:32.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.504+0000 7f0912000700 1 -- 172.21.15.49:0/2382578160 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c00bab0 con 0x7f0914063840 2024-01-22T05:08:32.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.504+0000 7f0912000700 1 -- 172.21.15.49:0/2382578160 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c00be30 con 0x7f0914063840 2024-01-22T05:08:32.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.504+0000 7f091a400700 1 -- 172.21.15.49:0/2382578160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0914063840 msgr2=0x7f0914063c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.504+0000 7f091a400700 1 --2- 172.21.15.49:0/2382578160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0914063840 0x7f0914063c90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f090c009e90 tx=0x7f090c009780).stop 2024-01-22T05:08:32.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.504+0000 7f091a400700 1 -- 172.21.15.49:0/2382578160 shutdown_connections 2024-01-22T05:08:32.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.504+0000 7f091a400700 1 --2- 172.21.15.49:0/2382578160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0914063840 0x7f0914063c90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.504+0000 7f091a400700 1 -- 172.21.15.49:0/2382578160 >> 172.21.15.49:0/2382578160 conn(0x7f0914064f10 msgr2=0x7f09140c8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.504+0000 7f091a400700 1 -- 172.21.15.49:0/2382578160 shutdown_connections 2024-01-22T05:08:32.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.504+0000 7f091a400700 1 -- 172.21.15.49:0/2382578160 wait complete. 2024-01-22T05:08:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.508+0000 7f091a400700 1 Processor -- start 2024-01-22T05:08:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.508+0000 7f091a400700 1 -- start start 2024-01-22T05:08:32.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.508+0000 7f091a400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0914063840 0x7f0914156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.508+0000 7f091a400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09140c31b0 0x7f091414f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.508+0000 7f091a400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09140c7160 0x7f09140ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.508+0000 7f091a400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0914156a40 con 0x7f0914063840 2024-01-22T05:08:32.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.508+0000 7f091a400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091414f920 con 0x7f09140c7160 2024-01-22T05:08:32.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.508+0000 7f091a400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0914164d80 con 0x7f09140c31b0 2024-01-22T05:08:32.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.508+0000 7f0913400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0914063840 0x7f0914156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.508+0000 7f0913400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0914063840 0x7f0914156550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39146/0 (socket says 172.21.15.49:39146) 2024-01-22T05:08:32.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.508+0000 7f0913400700 1 -- 172.21.15.49:0/775949606 learned_addr learned my addr 172.21.15.49:0/775949606 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.512+0000 7f0912a00700 1 --2- 172.21.15.49:0/775949606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09140c31b0 0x7f091414f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.512+0000 7f0913e00700 1 --2- 172.21.15.49:0/775949606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09140c7160 0x7f09140ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.512+0000 7f0913400700 1 -- 172.21.15.49:0/775949606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09140c31b0 msgr2=0x7f091414f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.512+0000 7f0913400700 1 --2- 172.21.15.49:0/775949606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09140c31b0 0x7f091414f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.512+0000 7f0913400700 1 -- 172.21.15.49:0/775949606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09140c7160 msgr2=0x7f09140ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.512+0000 7f0913400700 1 --2- 172.21.15.49:0/775949606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09140c7160 0x7f09140ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.512+0000 7f0913400700 1 -- 172.21.15.49:0/775949606 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c009a20 con 0x7f0914063840 2024-01-22T05:08:32.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.512+0000 7f0913e00700 1 --2- 172.21.15.49:0/775949606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09140c7160 0x7f09140ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:32.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.512+0000 7f0913400700 1 --2- 172.21.15.49:0/775949606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0914063840 0x7f0914156550 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f090400c440 tx=0x7f0904007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.512+0000 7f090aa00700 1 -- 172.21.15.49:0/775949606 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090400cea0 con 0x7f0914063840 2024-01-22T05:08:32.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.512+0000 7f090aa00700 1 -- 172.21.15.49:0/775949606 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090400f470 con 0x7f0914063840 2024-01-22T05:08:32.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.512+0000 7f090aa00700 1 -- 172.21.15.49:0/775949606 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090400f830 con 0x7f0914063840 2024-01-22T05:08:32.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.512+0000 7f091a400700 1 -- 172.21.15.49:0/775949606 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09140ae7b0 con 0x7f0914063840 2024-01-22T05:08:32.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.512+0000 7f091a400700 1 -- 172.21.15.49:0/775949606 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0914165210 con 0x7f0914063840 2024-01-22T05:08:32.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.516+0000 7f090aa00700 1 -- 172.21.15.49:0/775949606 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f090400fbe0 con 0x7f0914063840 2024-01-22T05:08:32.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.516+0000 7f090aa00700 1 --2- 172.21.15.49:0/775949606 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08ec05a510 0x7f08ec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.516+0000 7f090aa00700 1 -- 172.21.15.49:0/775949606 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0904073e90 con 0x7f0914063840 2024-01-22T05:08:32.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.516+0000 7f0912a00700 1 --2- 172.21.15.49:0/775949606 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08ec05a510 0x7f08ec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.520+0000 7f0912a00700 1 --2- 172.21.15.49:0/775949606 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08ec05a510 0x7f08ec05c9d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f09140ade20 tx=0x7f08fc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.520+0000 7f09248e2740 1 Processor -- start 2024-01-22T05:08:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.520+0000 7f09248e2740 1 -- start start 2024-01-22T05:08:32.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.520+0000 7f09248e2740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x131a6c0 0x12d85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.520+0000 7f09248e2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1319fe0 0x131aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.520+0000 7f09248e2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12d56e0 0x12d5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.520+0000 7f09248e2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x11f9720 con 0x12d56e0 2024-01-22T05:08:32.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.520+0000 7f09248e2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1208170 con 0x1319fe0 2024-01-22T05:08:32.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.520+0000 7f09248e2740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1235610 con 0x131a6c0 2024-01-22T05:08:32.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f0913e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12d56e0 0x12d5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f0913e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12d56e0 0x12d5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39150/0 (socket says 172.21.15.49:39150) 2024-01-22T05:08:32.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f0913e00700 1 -- 172.21.15.49:0/2628858555 learned_addr learned my addr 172.21.15.49:0/2628858555 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f0913400700 1 --2- 172.21.15.49:0/2628858555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x131a6c0 0x12d85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f0912a00700 1 --2- 172.21.15.49:0/2628858555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1319fe0 0x131aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f0913e00700 1 -- 172.21.15.49:0/2628858555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x131a6c0 msgr2=0x12d85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f0913e00700 1 --2- 172.21.15.49:0/2628858555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x131a6c0 0x12d85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f0913e00700 1 -- 172.21.15.49:0/2628858555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1319fe0 msgr2=0x131aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f0913e00700 1 --2- 172.21.15.49:0/2628858555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1319fe0 0x131aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f0913e00700 1 -- 172.21.15.49:0/2628858555 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1263490 con 0x12d56e0 2024-01-22T05:08:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f0913e00700 1 --2- 172.21.15.49:0/2628858555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12d56e0 0x12d5b60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f0914067040 tx=0x7f090c009780).ready entity=mon.0 client_cookie=33358765b1c2cbaa server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f0903400700 1 -- 172.21.15.49:0/2628858555 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c00bdf0 con 0x12d56e0 2024-01-22T05:08:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f0903400700 1 -- 172.21.15.49:0/2628858555 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c012620 con 0x12d56e0 2024-01-22T05:08:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f0903400700 1 -- 172.21.15.49:0/2628858555 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0129a0 con 0x12d56e0 2024-01-22T05:08:32.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f09248e2740 1 -- 172.21.15.49:0/2628858555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12d56e0 msgr2=0x12d5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f09248e2740 1 --2- 172.21.15.49:0/2628858555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12d56e0 0x12d5b60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f0914067040 tx=0x7f090c009780).stop 2024-01-22T05:08:32.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f09248e2740 1 -- 172.21.15.49:0/2628858555 shutdown_connections 2024-01-22T05:08:32.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f09248e2740 1 --2- 172.21.15.49:0/2628858555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12d56e0 0x12d5b60 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f09248e2740 1 --2- 172.21.15.49:0/2628858555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1319fe0 0x131aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f09248e2740 1 --2- 172.21.15.49:0/2628858555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x131a6c0 0x12d85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f09248e2740 1 -- 172.21.15.49:0/2628858555 >> 172.21.15.49:0/2628858555 conn(0x10b7980 msgr2=0x131f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f09248e2740 1 -- 172.21.15.49:0/2628858555 shutdown_connections 2024-01-22T05:08:32.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.524+0000 7f09248e2740 1 -- 172.21.15.49:0/2628858555 wait complete. 2024-01-22T05:08:32.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.528+0000 7f09248e2740 1 -- start start 2024-01-22T05:08:32.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.528+0000 7f09248e2740 1 Processor -- start 2024-01-22T05:08:32.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.528+0000 7f09248e2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12d56e0 0x1316300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.528+0000 7f09248e2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1319fe0 0x12ff3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.528+0000 7f09248e2740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x131a6c0 0x12ff8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.528+0000 7f09248e2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1224120 con 0x1319fe0 2024-01-22T05:08:32.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.528+0000 7f09248e2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1304f20 con 0x12d56e0 2024-01-22T05:08:32.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.528+0000 7f09248e2740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x12ffdb0 con 0x131a6c0 2024-01-22T05:08:32.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.528+0000 7f09248e2740 10 client.0 ll_register_callbacks cb 0x128f5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:32.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.528+0000 7f0912a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1319fe0 0x12ff3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f0912a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1319fe0 0x12ff3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39164/0 (socket says 172.21.15.49:39164) 2024-01-22T05:08:32.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f0912a00700 1 -- 172.21.15.49:0/2553634042 learned_addr learned my addr 172.21.15.49:0/2553634042 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f0913e00700 1 --2- 172.21.15.49:0/2553634042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x131a6c0 0x12ff8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f0913400700 1 --2- 172.21.15.49:0/2553634042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12d56e0 0x1316300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f0912a00700 1 -- 172.21.15.49:0/2553634042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x131a6c0 msgr2=0x12ff8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f0912a00700 1 --2- 172.21.15.49:0/2553634042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x131a6c0 0x12ff8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f0912a00700 1 -- 172.21.15.49:0/2553634042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12d56e0 msgr2=0x1316300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f0912a00700 1 --2- 172.21.15.49:0/2553634042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12d56e0 0x1316300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f0912a00700 1 -- 172.21.15.49:0/2553634042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0914068160 con 0x1319fe0 2024-01-22T05:08:32.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f0913400700 1 --2- 172.21.15.49:0/2553634042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12d56e0 0x1316300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:32.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f0912a00700 1 --2- 172.21.15.49:0/2553634042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1319fe0 0x12ff3d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f08fc0147e0 tx=0x7f08fc016040).ready entity=mon.0 client_cookie=c7de2f9ff89c01c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f08fbe00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:32.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f08fbe00700 1 -- 172.21.15.49:0/2553634042 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc005030 con 0x1319fe0 2024-01-22T05:08:32.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f08fbe00700 1 -- 172.21.15.49:0/2553634042 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f08fc022e30 con 0x1319fe0 2024-01-22T05:08:32.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f09248e2740 1 -- 172.21.15.49:0/2553634042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x124f360 con 0x1319fe0 2024-01-22T05:08:32.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f08fbe00700 1 -- 172.21.15.49:0/2553634042 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08fc0053a0 con 0x1319fe0 2024-01-22T05:08:32.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f09248e2740 10 client.6087 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:32.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f09248e2740 1 -- 172.21.15.49:0/2553634042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x12528f0 con 0x1319fe0 2024-01-22T05:08:32.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f08fbe00700 1 -- 172.21.15.49:0/2553634042 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x124f360 con 0x1319fe0 2024-01-22T05:08:32.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f08fbe00700 1 -- 172.21.15.49:0/2553634042 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f08fc0046b0 con 0x1319fe0 2024-01-22T05:08:32.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f09248e2740 10 client.6087 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:32.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f09248e2740 10 client.6087 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f09248e2740 20 client.6087 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f09248e2740 1 --2- 172.21.15.49:0/2553634042 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x13022d0 0x13026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f09248e2740 4 client.6087 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f09248e2740 1 -- 172.21.15.49:0/2553634042 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x12458b0 con 0x13022d0 2024-01-22T05:08:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.532+0000 7f0913400700 1 --2- 172.21.15.49:0/2553634042 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x13022d0 0x13026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f08fbe00700 10 client.6087 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f0913400700 1 --2- 172.21.15.49:0/2553634042 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x13022d0 0x13026e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=60a7b84543c83e55 server_cookie=96dfaf5c13672ae5 in_seq=0 out_seq=0 2024-01-22T05:08:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f08fbe00700 1 -- 172.21.15.49:0/2553634042 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x12458b0 con 0x13022d0 2024-01-22T05:08:32.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f08fbe00700 10 client.6087 handle_command_reply: tid=0 2024-01-22T05:08:32.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f09248e2740 1 client.6087 shutdown 2024-01-22T05:08:32.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f09248e2740 1 -- 172.21.15.49:0/2553634042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1319fe0 msgr2=0x12ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f09248e2740 1 --2- 172.21.15.49:0/2553634042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1319fe0 0x12ff3d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f08fc0147e0 tx=0x7f08fc016040).stop 2024-01-22T05:08:32.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f09248e2740 1 -- 172.21.15.49:0/2553634042 shutdown_connections 2024-01-22T05:08:32.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f09248e2740 1 --2- 172.21.15.49:0/2553634042 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x13022d0 0x13026e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f09248e2740 1 --2- 172.21.15.49:0/2553634042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x131a6c0 0x12ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f09248e2740 1 --2- 172.21.15.49:0/2553634042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1319fe0 0x12ff3d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f09248e2740 1 --2- 172.21.15.49:0/2553634042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12d56e0 0x1316300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f08fbe00700 0 client.6087 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:32.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f09248e2740 1 -- 172.21.15.49:0/2553634042 >> 172.21.15.49:0/2553634042 conn(0x10b7980 msgr2=0x131fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f09248e2740 1 -- 172.21.15.49:0/2553634042 shutdown_connections 2024-01-22T05:08:32.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f09248e2740 1 -- 172.21.15.49:0/2553634042 wait complete. 2024-01-22T05:08:32.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.536+0000 7f09248e2740 20 client.6087 trim_cache size 0 max 16384 2024-01-22T05:08:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f09248e2740 1 Processor -- start 2024-01-22T05:08:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f09248e2740 1 -- start start 2024-01-22T05:08:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f09248e2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12d56e0 0x12d48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f09248e2740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1319fe0 0x12d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f09248e2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x131a6c0 0x1315ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f09248e2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1303c10 con 0x12d56e0 2024-01-22T05:08:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f09248e2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x12d7b30 con 0x131a6c0 2024-01-22T05:08:32.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f09248e2740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x125f940 con 0x1319fe0 2024-01-22T05:08:32.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f0913400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12d56e0 0x12d48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f0913400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12d56e0 0x12d48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39170/0 (socket says 172.21.15.49:39170) 2024-01-22T05:08:32.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f0913400700 1 -- 172.21.15.49:0/1111455490 learned_addr learned my addr 172.21.15.49:0/1111455490 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f0913e00700 1 --2- 172.21.15.49:0/1111455490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x131a6c0 0x1315ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f0912a00700 1 --2- 172.21.15.49:0/1111455490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1319fe0 0x12d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f0913400700 1 -- 172.21.15.49:0/1111455490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1319fe0 msgr2=0x12d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f0913400700 1 --2- 172.21.15.49:0/1111455490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1319fe0 0x12d29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f0913400700 1 -- 172.21.15.49:0/1111455490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x131a6c0 msgr2=0x1315ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f0913400700 1 --2- 172.21.15.49:0/1111455490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x131a6c0 0x1315ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.560+0000 7f0913400700 1 -- 172.21.15.49:0/1111455490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1304cc0 con 0x12d56e0 2024-01-22T05:08:32.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.564+0000 7f0913400700 1 --2- 172.21.15.49:0/1111455490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12d56e0 0x12d48f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f090404ae30 tx=0x7f0904014040).ready entity=mon.0 client_cookie=cecbb836862a87dd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.564+0000 7f0903e00700 1 -- 172.21.15.49:0/1111455490 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904050870 con 0x12d56e0 2024-01-22T05:08:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.564+0000 7f0903e00700 1 -- 172.21.15.49:0/1111455490 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0904049270 con 0x12d56e0 2024-01-22T05:08:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.564+0000 7f0903e00700 1 -- 172.21.15.49:0/1111455490 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904047840 con 0x12d56e0 2024-01-22T05:08:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.564+0000 7f09248e2740 1 -- 172.21.15.49:0/1111455490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12d56e0 msgr2=0x12d48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.564+0000 7f09248e2740 1 --2- 172.21.15.49:0/1111455490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12d56e0 0x12d48f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f090404ae30 tx=0x7f0904014040).stop 2024-01-22T05:08:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.564+0000 7f09248e2740 1 -- 172.21.15.49:0/1111455490 shutdown_connections 2024-01-22T05:08:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.564+0000 7f09248e2740 1 --2- 172.21.15.49:0/1111455490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x131a6c0 0x1315ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.564+0000 7f09248e2740 1 --2- 172.21.15.49:0/1111455490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1319fe0 0x12d29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.564+0000 7f09248e2740 1 --2- 172.21.15.49:0/1111455490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x12d56e0 0x12d48f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.564+0000 7f09248e2740 1 -- 172.21.15.49:0/1111455490 >> 172.21.15.49:0/1111455490 conn(0x10b7980 msgr2=0x12d2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.564+0000 7f09248e2740 1 -- 172.21.15.49:0/1111455490 shutdown_connections 2024-01-22T05:08:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.564+0000 7f09248e2740 1 -- 172.21.15.49:0/1111455490 wait complete. 2024-01-22T05:08:32.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.564+0000 7f09248e2740 1 -- start start 2024-01-22T05:08:32.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.568+0000 7f09248e2740 1 Processor -- start 2024-01-22T05:08:32.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.568+0000 7f09248e2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12d56e0 0x1386fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.568+0000 7f09248e2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1319fe0 0x12d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.568+0000 7f09248e2740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x131a6c0 0x12d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.568+0000 7f09248e2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1301d10 con 0x1319fe0 2024-01-22T05:08:32.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.568+0000 7f09248e2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x12d2b90 con 0x12d56e0 2024-01-22T05:08:32.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.568+0000 7f09248e2740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x12fc500 con 0x131a6c0 2024-01-22T05:08:32.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.568+0000 7f09248e2740 10 client.0 ll_register_callbacks cb 0x7f08fc00fd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:32.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f0912a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1319fe0 0x12d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f0912a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1319fe0 0x12d21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39182/0 (socket says 172.21.15.49:39182) 2024-01-22T05:08:32.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f0912a00700 1 -- 172.21.15.49:0/3922251392 learned_addr learned my addr 172.21.15.49:0/3922251392 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f0913e00700 1 --2- 172.21.15.49:0/3922251392 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x131a6c0 0x12d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f0913400700 1 --2- 172.21.15.49:0/3922251392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12d56e0 0x1386fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f0912a00700 1 -- 172.21.15.49:0/3922251392 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x131a6c0 msgr2=0x12d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f0912a00700 1 --2- 172.21.15.49:0/3922251392 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x131a6c0 0x12d26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f0912a00700 1 -- 172.21.15.49:0/3922251392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12d56e0 msgr2=0x1386fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f0912a00700 1 --2- 172.21.15.49:0/3922251392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12d56e0 0x1386fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f0912a00700 1 -- 172.21.15.49:0/3922251392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0914165210 con 0x1319fe0 2024-01-22T05:08:32.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f0913400700 1 --2- 172.21.15.49:0/3922251392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12d56e0 0x1386fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:32.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f0912a00700 1 --2- 172.21.15.49:0/3922251392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1319fe0 0x12d21b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x132df90 tx=0x7f08fc017000).ready entity=mon.0 client_cookie=a1794517bb6e010 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f08fbe00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:32.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f08fbe00700 1 -- 172.21.15.49:0/3922251392 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc0046b0 con 0x1319fe0 2024-01-22T05:08:32.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f08fbe00700 1 -- 172.21.15.49:0/3922251392 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f08fc004b70 con 0x1319fe0 2024-01-22T05:08:32.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f09248e2740 1 -- 172.21.15.49:0/3922251392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f090c012620 con 0x1319fe0 2024-01-22T05:08:32.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f08fbe00700 1 -- 172.21.15.49:0/3922251392 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08fc004810 con 0x1319fe0 2024-01-22T05:08:32.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f09248e2740 10 client.6093 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:32.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f09248e2740 1 -- 172.21.15.49:0/3922251392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x7f09140c4d60 con 0x1319fe0 2024-01-22T05:08:32.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f08fbe00700 1 -- 172.21.15.49:0/3922251392 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c012620 con 0x1319fe0 2024-01-22T05:08:32.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f08fbe00700 1 -- 172.21.15.49:0/3922251392 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f08fc006400 con 0x1319fe0 2024-01-22T05:08:32.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f09248e2740 10 client.6093 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:32.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f09248e2740 10 client.6093 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:32.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f09248e2740 20 client.6093 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:32.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f09248e2740 1 --2- 172.21.15.49:0/3922251392 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x132d7e0 0x12d5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f09248e2740 4 client.6093 mds_command: new command op to 5569 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-01-22T05:08:32.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f09248e2740 1 -- 172.21.15.49:0/3922251392 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) v1 -- 0x110e910 con 0x132d7e0 2024-01-22T05:08:32.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f0913400700 1 --2- 172.21.15.49:0/3922251392 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x132d7e0 0x12d5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f0913400700 1 --2- 172.21.15.49:0/3922251392 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x132d7e0 0x12d5d30 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c9412d1886edf182 server_cookie=8cb495009474af84 in_seq=0 out_seq=0 2024-01-22T05:08:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.572+0000 7f08fbe00700 10 client.6093 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f08fbe00700 1 -- 172.21.15.49:0/3922251392 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x110e910 con 0x132d7e0 2024-01-22T05:08:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f08fbe00700 10 client.6093 handle_command_reply: tid=0 2024-01-22T05:08:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f09248e2740 1 client.6093 shutdown 2024-01-22T05:08:32.579 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f2b13200700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096d [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v730 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5736=0-4194304@1} caps={5736=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@3},l=5736 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x558c7c42eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x1000000096d:[<0x10000000001/new_file_1 v730>,<0x10000000000/ceph-qa-suite v78>,<0x1/scrub_test_path v34>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-01-22T05:08:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f09248e2740 1 -- 172.21.15.49:0/3922251392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1319fe0 msgr2=0x12d21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f09248e2740 1 --2- 172.21.15.49:0/3922251392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1319fe0 0x12d21b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x132df90 tx=0x7f08fc017000).stop 2024-01-22T05:08:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f09248e2740 1 -- 172.21.15.49:0/3922251392 shutdown_connections 2024-01-22T05:08:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f09248e2740 1 --2- 172.21.15.49:0/3922251392 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x132d7e0 0x12d5d30 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f09248e2740 1 --2- 172.21.15.49:0/3922251392 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x131a6c0 0x12d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f09248e2740 1 --2- 172.21.15.49:0/3922251392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1319fe0 0x12d21b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f09248e2740 1 --2- 172.21.15.49:0/3922251392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x12d56e0 0x1386fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f08fbe00700 0 client.6093 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f09248e2740 1 -- 172.21.15.49:0/3922251392 >> 172.21.15.49:0/3922251392 conn(0x10b7980 msgr2=0x12d8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f09248e2740 1 -- 172.21.15.49:0/3922251392 shutdown_connections 2024-01-22T05:08:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f09248e2740 1 -- 172.21.15.49:0/3922251392 wait complete. 2024-01-22T05:08:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f09248e2740 20 client.6093 trim_cache size 0 max 16384 2024-01-22T05:08:32.581 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:32.581 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:08:32.581 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "1d3eaa22-5cc5-4c2e-bb1d-c398a0153cec", 2024-01-22T05:08:32.581 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:08:32.581 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:32.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f091a400700 1 -- 172.21.15.49:0/775949606 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08ec05a510 msgr2=0x7f08ec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f091a400700 1 --2- 172.21.15.49:0/775949606 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08ec05a510 0x7f08ec05c9d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f09140ade20 tx=0x7f08fc009040).stop 2024-01-22T05:08:32.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f091a400700 1 -- 172.21.15.49:0/775949606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0914063840 msgr2=0x7f0914156550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f091a400700 1 --2- 172.21.15.49:0/775949606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0914063840 0x7f0914156550 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f090400c440 tx=0x7f0904007c90).stop 2024-01-22T05:08:32.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f091a400700 1 -- 172.21.15.49:0/775949606 shutdown_connections 2024-01-22T05:08:32.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f091a400700 1 --2- 172.21.15.49:0/775949606 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08ec05a510 0x7f08ec05c9d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f091a400700 1 --2- 172.21.15.49:0/775949606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09140c7160 0x7f09140ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f091a400700 1 --2- 172.21.15.49:0/775949606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09140c31b0 0x7f091414f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f091a400700 1 --2- 172.21.15.49:0/775949606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0914063840 0x7f0914156550 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f091a400700 1 -- 172.21.15.49:0/775949606 >> 172.21.15.49:0/775949606 conn(0x7f0914064f10 msgr2=0x7f09140c8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f091a400700 1 -- 172.21.15.49:0/775949606 shutdown_connections 2024-01-22T05:08:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.576+0000 7f091a400700 1 -- 172.21.15.49:0/775949606 wait complete. 2024-01-22T05:08:32.604 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': '1d3eaa22-5cc5-4c2e-bb1d-c398a0153cec', 'mode': 'asynchronous'}' 2024-01-22T05:08:32.604 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2024-01-22T05:08:32.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.768+0000 7f24b7e00700 1 Processor -- start 2024-01-22T05:08:32.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.772+0000 7f24b7e00700 1 -- start start 2024-01-22T05:08:32.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.772+0000 7f24b7e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24b81562a0 0x7f24b8068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.772+0000 7f24b7e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f24b80691a0 0x7f24b8151690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.772+0000 7f24b7e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b81559f0 con 0x7f24b8151b80 2024-01-22T05:08:32.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.772+0000 7f24b7e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b80c2d90 con 0x7f24b80691a0 2024-01-22T05:08:32.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.772+0000 7f24b7e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80c27d0 con 0x7f24b81562a0 2024-01-22T05:08:32.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.772+0000 7f24b6a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24b81562a0 0x7f24b8068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.772+0000 7f24b6000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f24b80691a0 0x7f24b8151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.772+0000 7f24b6a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24b81562a0 0x7f24b8068cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:39286/0 (socket says 172.21.15.49:39286) 2024-01-22T05:08:32.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.772+0000 7f24b6a00700 1 -- 172.21.15.49:0/1079227853 learned_addr learned my addr 172.21.15.49:0/1079227853 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.772+0000 7f24b7400700 1 --1- 172.21.15.49:0/1079227853 >> v1:172.21.15.110:6789/0 conn(0x7f24b8151b80 0x7f24b80ab890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:45874/0 (socket says 172.21.15.49:45874) 2024-01-22T05:08:32.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.776+0000 7f24b6a00700 1 -- 172.21.15.49:0/1079227853 >> v2:172.21.15.110:3300/0 conn(0x7f24b80691a0 msgr2=0x7f24b8151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.776+0000 7f24b6a00700 1 --2- 172.21.15.49:0/1079227853 >> v2:172.21.15.110:3300/0 conn(0x7f24b80691a0 0x7f24b8151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.776+0000 7f24b6a00700 1 -- 172.21.15.49:0/1079227853 >> v1:172.21.15.110:6789/0 conn(0x7f24b8151b80 legacy=0x7f24b80ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.776+0000 7f24b6a00700 1 -- 172.21.15.49:0/1079227853 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b80c2ab0 con 0x7f24b81562a0 2024-01-22T05:08:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.776+0000 7f24b6a00700 1 --2- 172.21.15.49:0/1079227853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24b81562a0 0x7f24b8068cb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f24a8006fd0 tx=0x7f24a80090f0).ready entity=mon.2 client_cookie=b4b56e95940b3e44 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.776+0000 7f24b5600700 1 -- 172.21.15.49:0/1079227853 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a800b580 con 0x7f24b81562a0 2024-01-22T05:08:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.776+0000 7f24b5600700 1 -- 172.21.15.49:0/1079227853 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a800b6e0 con 0x7f24b81562a0 2024-01-22T05:08:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.776+0000 7f24b5600700 1 -- 172.21.15.49:0/1079227853 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a800ba60 con 0x7f24b81562a0 2024-01-22T05:08:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.776+0000 7f24b7e00700 1 -- 172.21.15.49:0/1079227853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24b81562a0 msgr2=0x7f24b8068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.776+0000 7f24b7e00700 1 --2- 172.21.15.49:0/1079227853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24b81562a0 0x7f24b8068cb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f24a8006fd0 tx=0x7f24a80090f0).stop 2024-01-22T05:08:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.776+0000 7f24b7e00700 1 -- 172.21.15.49:0/1079227853 shutdown_connections 2024-01-22T05:08:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.776+0000 7f24b7e00700 1 --2- 172.21.15.49:0/1079227853 >> v2:172.21.15.110:3300/0 conn(0x7f24b80691a0 0x7f24b8151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.776+0000 7f24b7e00700 1 --2- 172.21.15.49:0/1079227853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24b81562a0 0x7f24b8068cb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.776+0000 7f24b7e00700 1 -- 172.21.15.49:0/1079227853 >> 172.21.15.49:0/1079227853 conn(0x7f24b80c6540 msgr2=0x7f24b80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.780+0000 7f24b7e00700 1 -- 172.21.15.49:0/1079227853 shutdown_connections 2024-01-22T05:08:32.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.780+0000 7f24b7e00700 1 -- 172.21.15.49:0/1079227853 wait complete. 2024-01-22T05:08:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.780+0000 7f24b7e00700 1 Processor -- start 2024-01-22T05:08:32.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.784+0000 7f24b7e00700 1 -- start start 2024-01-22T05:08:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.784+0000 7f24b7e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24b8151b80 0x7f24b81655e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.784+0000 7f24b7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b81562a0 0x7f24b81679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.784+0000 7f24b7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24b8167ed0 0x7f24b8166de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.784+0000 7f24b7e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b813a770 con 0x7f24b81562a0 2024-01-22T05:08:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.784+0000 7f24b7e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80aa010 con 0x7f24b8167ed0 2024-01-22T05:08:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.784+0000 7f24b7e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b8168330 con 0x7f24b8151b80 2024-01-22T05:08:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.784+0000 7f24b6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b81562a0 0x7f24b81679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.784+0000 7f24b6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b81562a0 0x7f24b81679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39186/0 (socket says 172.21.15.49:39186) 2024-01-22T05:08:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.784+0000 7f24b6000700 1 -- 172.21.15.49:0/116580497 learned_addr learned my addr 172.21.15.49:0/116580497 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.784+0000 7f24b6a00700 1 --2- 172.21.15.49:0/116580497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24b8151b80 0x7f24b81655e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.784+0000 7f24b7400700 1 --2- 172.21.15.49:0/116580497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24b8167ed0 0x7f24b8166de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.788+0000 7f24b6000700 1 -- 172.21.15.49:0/116580497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24b8151b80 msgr2=0x7f24b81655e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.788+0000 7f24b6000700 1 --2- 172.21.15.49:0/116580497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24b8151b80 0x7f24b81655e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.788+0000 7f24b6000700 1 -- 172.21.15.49:0/116580497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24b8167ed0 msgr2=0x7f24b8166de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.788+0000 7f24b6000700 1 --2- 172.21.15.49:0/116580497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24b8167ed0 0x7f24b8166de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.788+0000 7f24b6000700 1 -- 172.21.15.49:0/116580497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a8009370 con 0x7f24b81562a0 2024-01-22T05:08:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.788+0000 7f24b6000700 1 --2- 172.21.15.49:0/116580497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b81562a0 0x7f24b81679e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f24a000e8d0 tx=0x7f24a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.788+0000 7f24ae000700 1 -- 172.21.15.49:0/116580497 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a00094b0 con 0x7f24b81562a0 2024-01-22T05:08:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.788+0000 7f24ae000700 1 -- 172.21.15.49:0/116580497 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a0012600 con 0x7f24b81562a0 2024-01-22T05:08:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.788+0000 7f24b7e00700 1 -- 172.21.15.49:0/116580497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b80a9720 con 0x7f24b81562a0 2024-01-22T05:08:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.788+0000 7f24ae000700 1 -- 172.21.15.49:0/116580497 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0012980 con 0x7f24b81562a0 2024-01-22T05:08:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.788+0000 7f24b7e00700 1 -- 172.21.15.49:0/116580497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b80a9ca0 con 0x7f24b81562a0 2024-01-22T05:08:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.792+0000 7f24ae000700 1 -- 172.21.15.49:0/116580497 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f24a0012d30 con 0x7f24b81562a0 2024-01-22T05:08:32.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.796+0000 7f24ae000700 1 --2- 172.21.15.49:0/116580497 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249005a510 0x7f249005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.796+0000 7f24ae000700 1 -- 172.21.15.49:0/116580497 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f24a0074e00 con 0x7f24b81562a0 2024-01-22T05:08:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.796+0000 7f24b6a00700 1 --2- 172.21.15.49:0/116580497 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249005a510 0x7f249005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.796+0000 7f24b6a00700 1 --2- 172.21.15.49:0/116580497 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249005a510 0x7f249005c9d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f24a8009130 tx=0x7f24a8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.796+0000 7f24c820f740 1 Processor -- start 2024-01-22T05:08:32.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.796+0000 7f24c820f740 1 -- start start 2024-01-22T05:08:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24c820f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x262c4d0 0x262c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24c820f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2633570 0x26339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24c820f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633ee0 0x26124f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24c820f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2544540 con 0x262c4d0 2024-01-22T05:08:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24c820f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2507e90 con 0x2633570 2024-01-22T05:08:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24c820f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x250dd90 con 0x2633ee0 2024-01-22T05:08:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24b6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x262c4d0 0x262c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24b6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x262c4d0 0x262c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39192/0 (socket says 172.21.15.49:39192) 2024-01-22T05:08:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24b6a00700 1 -- 172.21.15.49:0/2889303031 learned_addr learned my addr 172.21.15.49:0/2889303031 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24b7400700 1 --2- 172.21.15.49:0/2889303031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633ee0 0x26124f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24b6000700 1 --2- 172.21.15.49:0/2889303031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2633570 0x26339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24b6a00700 1 -- 172.21.15.49:0/2889303031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633ee0 msgr2=0x26124f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24b6a00700 1 --2- 172.21.15.49:0/2889303031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633ee0 0x26124f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24b6a00700 1 -- 172.21.15.49:0/2889303031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2633570 msgr2=0x26339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24b6a00700 1 --2- 172.21.15.49:0/2889303031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2633570 0x26339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24b6a00700 1 -- 172.21.15.49:0/2889303031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x25724c0 con 0x262c4d0 2024-01-22T05:08:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.800+0000 7f24b6a00700 1 --2- 172.21.15.49:0/2889303031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x262c4d0 0x262c8b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f24b80c2910 tx=0x7f24a801f040).ready entity=mon.0 client_cookie=e23fda1e93166287 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.804+0000 7f24a6a00700 1 -- 172.21.15.49:0/2889303031 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a801d8e0 con 0x262c4d0 2024-01-22T05:08:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.804+0000 7f24a6a00700 1 -- 172.21.15.49:0/2889303031 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a801da40 con 0x262c4d0 2024-01-22T05:08:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.804+0000 7f24a6a00700 1 -- 172.21.15.49:0/2889303031 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a801ddc0 con 0x262c4d0 2024-01-22T05:08:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.804+0000 7f24c820f740 1 -- 172.21.15.49:0/2889303031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x262c4d0 msgr2=0x262c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.804+0000 7f24c820f740 1 --2- 172.21.15.49:0/2889303031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x262c4d0 0x262c8b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f24b80c2910 tx=0x7f24a801f040).stop 2024-01-22T05:08:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.804+0000 7f24c820f740 1 -- 172.21.15.49:0/2889303031 shutdown_connections 2024-01-22T05:08:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.804+0000 7f24c820f740 1 --2- 172.21.15.49:0/2889303031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633ee0 0x26124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.804+0000 7f24c820f740 1 --2- 172.21.15.49:0/2889303031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2633570 0x26339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.804+0000 7f24c820f740 1 --2- 172.21.15.49:0/2889303031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x262c4d0 0x262c8b0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.804+0000 7f24c820f740 1 -- 172.21.15.49:0/2889303031 >> 172.21.15.49:0/2889303031 conn(0x23c6680 msgr2=0x25e5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.804+0000 7f24c820f740 1 -- 172.21.15.49:0/2889303031 shutdown_connections 2024-01-22T05:08:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.804+0000 7f24c820f740 1 -- 172.21.15.49:0/2889303031 wait complete. 2024-01-22T05:08:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.804+0000 7f24c820f740 1 -- start start 2024-01-22T05:08:32.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.804+0000 7f24c820f740 1 Processor -- start 2024-01-22T05:08:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24c820f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x262c4d0 0x263a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24c820f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633570 0x260dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24c820f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633ee0 0x25e5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24c820f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x260e790 con 0x2633570 2024-01-22T05:08:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24c820f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x25e3f80 con 0x262c4d0 2024-01-22T05:08:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24c820f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x25e41d0 con 0x2633ee0 2024-01-22T05:08:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24c820f740 10 client.0 ll_register_callbacks cb 0x259e5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24b6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633570 0x260dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24b6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633570 0x260dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39202/0 (socket says 172.21.15.49:39202) 2024-01-22T05:08:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24b6000700 1 -- 172.21.15.49:0/2317922056 learned_addr learned my addr 172.21.15.49:0/2317922056 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24b6a00700 1 --2- 172.21.15.49:0/2317922056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x262c4d0 0x263a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24b7400700 1 --2- 172.21.15.49:0/2317922056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633ee0 0x25e5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24b6000700 1 -- 172.21.15.49:0/2317922056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633ee0 msgr2=0x25e5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24b6000700 1 --2- 172.21.15.49:0/2317922056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633ee0 0x25e5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24b6000700 1 -- 172.21.15.49:0/2317922056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x262c4d0 msgr2=0x263a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24b6000700 1 --2- 172.21.15.49:0/2317922056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x262c4d0 0x263a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24b6000700 1 -- 172.21.15.49:0/2317922056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b80c2ab0 con 0x2633570 2024-01-22T05:08:32.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24b6a00700 1 --2- 172.21.15.49:0/2317922056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x262c4d0 0x263a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:32.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f24b6000700 1 --2- 172.21.15.49:0/2317922056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633570 0x260dca0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f24a000eec0 tx=0x7f24a0000bc0).ready entity=mon.0 client_cookie=7d04819ef1a39d71 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.808+0000 7f249f400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:32.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f249f400700 1 -- 172.21.15.49:0/2317922056 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a004bb80 con 0x2633570 2024-01-22T05:08:32.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f249f400700 1 -- 172.21.15.49:0/2317922056 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f24a0019df0 con 0x2633570 2024-01-22T05:08:32.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f24c820f740 1 -- 172.21.15.49:0/2317922056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x255e230 con 0x2633570 2024-01-22T05:08:32.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f249f400700 1 -- 172.21.15.49:0/2317922056 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24a004b740 con 0x2633570 2024-01-22T05:08:32.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f24c820f740 10 client.6102 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:32.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f24c820f740 1 -- 172.21.15.49:0/2317922056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x25617c0 con 0x2633570 2024-01-22T05:08:32.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f249f400700 1 -- 172.21.15.49:0/2317922056 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x255e230 con 0x2633570 2024-01-22T05:08:32.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f249f400700 1 -- 172.21.15.49:0/2317922056 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f24a0047e30 con 0x2633570 2024-01-22T05:08:32.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f24c820f740 10 client.6102 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:32.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f24c820f740 10 client.6102 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:32.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f24c820f740 20 client.6102 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:32.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f24c820f740 1 --2- 172.21.15.49:0/2317922056 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2606640 0x260ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f24c820f740 4 client.6102 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:32.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f24c820f740 1 -- 172.21.15.49:0/2317922056 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2554780 con 0x2606640 2024-01-22T05:08:32.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f24b6a00700 1 --2- 172.21.15.49:0/2317922056 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2606640 0x260ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f249f400700 10 client.6102 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:32.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.812+0000 7f24b6a00700 1 --2- 172.21.15.49:0/2317922056 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2606640 0x260ca80 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c960a4e92a564567 server_cookie=95e58557c79947a in_seq=0 out_seq=0 2024-01-22T05:08:32.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.816+0000 7f249f400700 1 -- 172.21.15.49:0/2317922056 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2554780 con 0x2606640 2024-01-22T05:08:32.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.816+0000 7f249f400700 10 client.6102 handle_command_reply: tid=0 2024-01-22T05:08:32.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.816+0000 7f24c820f740 1 client.6102 shutdown 2024-01-22T05:08:32.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.816+0000 7f24c820f740 1 -- 172.21.15.49:0/2317922056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633570 msgr2=0x260dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.816+0000 7f24c820f740 1 --2- 172.21.15.49:0/2317922056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633570 0x260dca0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f24a000eec0 tx=0x7f24a0000bc0).stop 2024-01-22T05:08:32.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.816+0000 7f24c820f740 1 -- 172.21.15.49:0/2317922056 shutdown_connections 2024-01-22T05:08:32.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.816+0000 7f24c820f740 1 --2- 172.21.15.49:0/2317922056 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2606640 0x260ca80 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.816+0000 7f24c820f740 1 --2- 172.21.15.49:0/2317922056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633ee0 0x25e5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.816+0000 7f24c820f740 1 --2- 172.21.15.49:0/2317922056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633570 0x260dca0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.816+0000 7f24c820f740 1 --2- 172.21.15.49:0/2317922056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x262c4d0 0x263a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.816+0000 7f249f400700 0 client.6102 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:32.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.816+0000 7f24c820f740 1 -- 172.21.15.49:0/2317922056 >> 172.21.15.49:0/2317922056 conn(0x23c6680 msgr2=0x262c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.816+0000 7f24c820f740 1 -- 172.21.15.49:0/2317922056 shutdown_connections 2024-01-22T05:08:32.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.816+0000 7f24c820f740 1 -- 172.21.15.49:0/2317922056 wait complete. 2024-01-22T05:08:32.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.816+0000 7f24c820f740 20 client.6102 trim_cache size 0 max 16384 2024-01-22T05:08:32.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.836+0000 7f24c820f740 1 Processor -- start 2024-01-22T05:08:32.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.836+0000 7f24c820f740 1 -- start start 2024-01-22T05:08:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.836+0000 7f24c820f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x262c4d0 0x2624d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.836+0000 7f24c820f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2633570 0x25e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.836+0000 7f24c820f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633ee0 0x25e5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.836+0000 7f24c820f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2605b10 con 0x2633ee0 2024-01-22T05:08:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.836+0000 7f24c820f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x25e5a80 con 0x2633570 2024-01-22T05:08:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.836+0000 7f24c820f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x25aa040 con 0x262c4d0 2024-01-22T05:08:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.836+0000 7f24b7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633ee0 0x25e5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.836+0000 7f24b7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633ee0 0x25e5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39206/0 (socket says 172.21.15.49:39206) 2024-01-22T05:08:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.836+0000 7f24b7400700 1 -- 172.21.15.49:0/3559704540 learned_addr learned my addr 172.21.15.49:0/3559704540 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.836+0000 7f24b7400700 1 -- 172.21.15.49:0/3559704540 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x262c4d0 msgr2=0x2624d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.836+0000 7f24b6a00700 1 --2- 172.21.15.49:0/3559704540 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x262c4d0 0x2624d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.836+0000 7f24b7400700 1 --2- 172.21.15.49:0/3559704540 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x262c4d0 0x2624d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24b7400700 1 -- 172.21.15.49:0/3559704540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2633570 msgr2=0x25e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.836+0000 7f24b6000700 1 --2- 172.21.15.49:0/3559704540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2633570 0x25e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24b7400700 1 --2- 172.21.15.49:0/3559704540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2633570 0x25e50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24b7400700 1 -- 172.21.15.49:0/3559704540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b8167630 con 0x2633ee0 2024-01-22T05:08:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24b6a00700 1 --2- 172.21.15.49:0/3559704540 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x262c4d0 0x2624d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24b7400700 1 --2- 172.21.15.49:0/3559704540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633ee0 0x25e5590 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f24b00071e0 tx=0x7f24b0009040).ready entity=mon.0 client_cookie=7e7446b40dcc97a2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24a7400700 1 -- 172.21.15.49:0/3559704540 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b001b070 con 0x2633ee0 2024-01-22T05:08:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24a7400700 1 -- 172.21.15.49:0/3559704540 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b0004d60 con 0x2633ee0 2024-01-22T05:08:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24a7400700 1 -- 172.21.15.49:0/3559704540 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0001ca0 con 0x2633ee0 2024-01-22T05:08:32.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24c820f740 1 -- 172.21.15.49:0/3559704540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633ee0 msgr2=0x25e5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24c820f740 1 --2- 172.21.15.49:0/3559704540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633ee0 0x25e5590 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f24b00071e0 tx=0x7f24b0009040).stop 2024-01-22T05:08:32.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24c820f740 1 -- 172.21.15.49:0/3559704540 shutdown_connections 2024-01-22T05:08:32.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24c820f740 1 --2- 172.21.15.49:0/3559704540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633ee0 0x25e5590 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24c820f740 1 --2- 172.21.15.49:0/3559704540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2633570 0x25e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24c820f740 1 --2- 172.21.15.49:0/3559704540 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x262c4d0 0x2624d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24c820f740 1 -- 172.21.15.49:0/3559704540 >> 172.21.15.49:0/3559704540 conn(0x23c6680 msgr2=0x260b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24c820f740 1 -- 172.21.15.49:0/3559704540 shutdown_connections 2024-01-22T05:08:32.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24c820f740 1 -- 172.21.15.49:0/3559704540 wait complete. 2024-01-22T05:08:32.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24c820f740 1 -- start start 2024-01-22T05:08:32.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.840+0000 7f24c820f740 1 Processor -- start 2024-01-22T05:08:32.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24c820f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x262c4d0 0x2692ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24c820f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633570 0x25e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24c820f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633ee0 0x260f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24c820f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x269a3b0 con 0x2633ee0 2024-01-22T05:08:32.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24c820f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x25e6390 con 0x262c4d0 2024-01-22T05:08:32.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24c820f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x26096e0 con 0x2633570 2024-01-22T05:08:32.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24c820f740 10 client.0 ll_register_callbacks cb 0x7f24a004bfe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:32.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24b7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633ee0 0x260f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24b7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633ee0 0x260f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39222/0 (socket says 172.21.15.49:39222) 2024-01-22T05:08:32.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24b7400700 1 -- 172.21.15.49:0/3910524707 learned_addr learned my addr 172.21.15.49:0/3910524707 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:32.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24b6000700 1 --2- 172.21.15.49:0/3910524707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633570 0x25e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24b6a00700 1 --2- 172.21.15.49:0/3910524707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x262c4d0 0x2692ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24b7400700 1 -- 172.21.15.49:0/3910524707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633570 msgr2=0x25e5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24b7400700 1 --2- 172.21.15.49:0/3910524707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633570 0x25e5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24b7400700 1 -- 172.21.15.49:0/3910524707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x262c4d0 msgr2=0x2692ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:32.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24b7400700 1 --2- 172.21.15.49:0/3910524707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x262c4d0 0x2692ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24b7400700 1 -- 172.21.15.49:0/3910524707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b81559f0 con 0x2633ee0 2024-01-22T05:08:32.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24b6000700 1 --2- 172.21.15.49:0/3910524707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633570 0x25e5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:32.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24b6a00700 1 --2- 172.21.15.49:0/3910524707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x262c4d0 0x2692ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:32.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24b7400700 1 --2- 172.21.15.49:0/3910524707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633ee0 0x260f2a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f24b000a000 tx=0x7f24b0006000).ready entity=mon.0 client_cookie=9f65fdf64472fbcd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:32.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f249f400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:32.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f249f400700 1 -- 172.21.15.49:0/3910524707 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b001b070 con 0x2633ee0 2024-01-22T05:08:32.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f249f400700 1 -- 172.21.15.49:0/3910524707 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f24b0020d40 con 0x2633ee0 2024-01-22T05:08:32.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24c820f740 1 -- 172.21.15.49:0/3910524707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24a801da40 con 0x2633ee0 2024-01-22T05:08:32.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f249f400700 1 -- 172.21.15.49:0/3910524707 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24b0016b00 con 0x2633ee0 2024-01-22T05:08:32.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24c820f740 10 client.6108 fetch_fsmap learned FSMap version 44 2024-01-22T05:08:32.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.844+0000 7f24c820f740 1 -- 172.21.15.49:0/3910524707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x255c9f0 con 0x2633ee0 2024-01-22T05:08:32.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f249f400700 1 -- 172.21.15.49:0/3910524707 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a801da40 con 0x2633ee0 2024-01-22T05:08:32.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f249f400700 1 -- 172.21.15.49:0/3910524707 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f24b002a020 con 0x2633ee0 2024-01-22T05:08:32.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 10 client.6108 fetch_fsmap finished waiting for FSMap version 44 2024-01-22T05:08:32.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 10 client.6108 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:32.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 20 client.6108 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:32.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 1 --2- 172.21.15.49:0/3910524707 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x260f790 0x2699000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:32.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 4 client.6108 mds_command: new command op to 5569 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:08:32.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 1 -- 172.21.15.49:0/3910524707 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x241d610 con 0x260f790 2024-01-22T05:08:32.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24b6a00700 1 --2- 172.21.15.49:0/3910524707 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x260f790 0x2699000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:32.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24b6a00700 1 --2- 172.21.15.49:0/3910524707 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x260f790 0x2699000 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=60072989ec5508fd server_cookie=c0e0dca951ed9a2f in_seq=0 out_seq=0 2024-01-22T05:08:32.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f249f400700 10 client.6108 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:32.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f249f400700 1 -- 172.21.15.49:0/3910524707 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+284 (crc 0 0 0) 0x241d610 con 0x260f790 2024-01-22T05:08:32.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f249f400700 10 client.6108 handle_command_reply: tid=0 2024-01-22T05:08:32.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 1 client.6108 shutdown 2024-01-22T05:08:32.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 1 -- 172.21.15.49:0/3910524707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633ee0 msgr2=0x260f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 1 --2- 172.21.15.49:0/3910524707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633ee0 0x260f2a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f24b000a000 tx=0x7f24b0006000).stop 2024-01-22T05:08:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 1 -- 172.21.15.49:0/3910524707 shutdown_connections 2024-01-22T05:08:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 1 --2- 172.21.15.49:0/3910524707 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x260f790 0x2699000 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 1 --2- 172.21.15.49:0/3910524707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2633ee0 0x260f2a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 1 --2- 172.21.15.49:0/3910524707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2633570 0x25e5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 1 --2- 172.21.15.49:0/3910524707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x262c4d0 0x2692ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 1 -- 172.21.15.49:0/3910524707 >> 172.21.15.49:0/3910524707 conn(0x23c6680 msgr2=0x25e6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f249f400700 0 client.6108 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 1 -- 172.21.15.49:0/3910524707 shutdown_connections 2024-01-22T05:08:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.848+0000 7f24c820f740 1 -- 172.21.15.49:0/3910524707 wait complete. 2024-01-22T05:08:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.852+0000 7f24c820f740 20 client.6108 trim_cache size 0 max 16384 2024-01-22T05:08:32.854 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:32.854 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-01-22T05:08:32.854 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-01-22T05:08:32.854 INFO:teuthology.orchestra.run.smithi049.stdout: "1d3eaa22-5cc5-4c2e-bb1d-c398a0153cec": { 2024-01-22T05:08:32.854 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-01-22T05:08:32.854 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "1d3eaa22-5cc5-4c2e-bb1d-c398a0153cec", 2024-01-22T05:08:32.854 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "" 2024-01-22T05:08:32.854 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:32.854 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:32.854 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:32.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.852+0000 7f24b7e00700 1 -- 172.21.15.49:0/116580497 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249005a510 msgr2=0x7f249005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.852+0000 7f24b7e00700 1 --2- 172.21.15.49:0/116580497 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249005a510 0x7f249005c9d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f24a8009130 tx=0x7f24a8017000).stop 2024-01-22T05:08:32.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.852+0000 7f24b7e00700 1 -- 172.21.15.49:0/116580497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b81562a0 msgr2=0x7f24b81679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:32.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.852+0000 7f24b7e00700 1 --2- 172.21.15.49:0/116580497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b81562a0 0x7f24b81679e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f24a000e8d0 tx=0x7f24a0009060).stop 2024-01-22T05:08:32.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.852+0000 7f24b7e00700 1 -- 172.21.15.49:0/116580497 shutdown_connections 2024-01-22T05:08:32.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.852+0000 7f24b7e00700 1 --2- 172.21.15.49:0/116580497 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249005a510 0x7f249005c9d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.852+0000 7f24b7e00700 1 --2- 172.21.15.49:0/116580497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24b8167ed0 0x7f24b8166de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.852+0000 7f24b7e00700 1 --2- 172.21.15.49:0/116580497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b81562a0 0x7f24b81679e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.852+0000 7f24b7e00700 1 --2- 172.21.15.49:0/116580497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24b8151b80 0x7f24b81655e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:32.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.852+0000 7f24b7e00700 1 -- 172.21.15.49:0/116580497 >> 172.21.15.49:0/116580497 conn(0x7f24b80c6540 msgr2=0x7f24b8065550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:32.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.852+0000 7f24b7e00700 1 -- 172.21.15.49:0/116580497 shutdown_connections 2024-01-22T05:08:32.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:32.852+0000 7f24b7e00700 1 -- 172.21.15.49:0/116580497 wait complete. 2024-01-22T05:08:37.547 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:08:37.554 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:08:37.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2024-01-22T05:08:38.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.056+0000 7f7a31e00700 1 Processor -- start 2024-01-22T05:08:38.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.056+0000 7f7a31e00700 1 -- start start 2024-01-22T05:08:38.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.060+0000 7f7a31e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7a2c064540 0x7f7a2c0bca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.060+0000 7f7a31e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2c154920 con 0x7f7a2c154380 2024-01-22T05:08:38.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.060+0000 7f7a31e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2c154c00 con 0x7f7a2c068ba0 2024-01-22T05:08:38.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.060+0000 7f7a31e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2c151d10 con 0x7f7a2c064540 2024-01-22T05:08:38.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.060+0000 7f7a2a000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7a2c154380 0x7f7a2c063e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53788/0 (socket says 172.21.15.49:53788) 2024-01-22T05:08:38.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.060+0000 7f7a2a000700 1 -- 172.21.15.49:0/2565710536 learned_addr learned my addr 172.21.15.49:0/2565710536 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:38.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.060+0000 7f7a2b400700 1 --2- 172.21.15.49:0/2565710536 >> v2:172.21.15.110:3300/0 conn(0x7f7a2c064540 0x7f7a2c0bca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a29600700 1 -- 172.21.15.49:0/2565710536 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728852471 0 0) 0x7f7a2c154920 con 0x7f7a2c154380 2024-01-22T05:08:38.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a29600700 1 -- 172.21.15.49:0/2565710536 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a0c0033f0 con 0x7f7a2c154380 2024-01-22T05:08:38.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a29600700 1 -- 172.21.15.49:0/2565710536 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348328116 0 0) 0x7f7a2c154c00 con 0x7f7a2c068ba0 2024-01-22T05:08:38.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a29600700 1 -- 172.21.15.49:0/2565710536 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a2c154920 con 0x7f7a2c068ba0 2024-01-22T05:08:38.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a2b400700 1 -- 172.21.15.49:0/2565710536 >> v1:172.21.15.110:6789/0 conn(0x7f7a2c068ba0 legacy=0x7f7a2c0bdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a2b400700 1 -- 172.21.15.49:0/2565710536 >> v1:172.21.15.49:6789/0 conn(0x7f7a2c154380 legacy=0x7f7a2c063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a2b400700 1 -- 172.21.15.49:0/2565710536 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c154ee0 con 0x7f7a2c064540 2024-01-22T05:08:38.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a2b400700 1 --2- 172.21.15.49:0/2565710536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a2c064540 0x7f7a2c0bca90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f7a24009e60 tx=0x7f7a24009780).ready entity=mon.1 client_cookie=7ef2e136fb76095c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a29600700 1 -- 172.21.15.49:0/2565710536 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c064540 2024-01-22T05:08:38.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a29600700 1 -- 172.21.15.49:0/2565710536 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bab0 con 0x7f7a2c064540 2024-01-22T05:08:38.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a29600700 1 -- 172.21.15.49:0/2565710536 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400be30 con 0x7f7a2c064540 2024-01-22T05:08:38.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a31e00700 1 -- 172.21.15.49:0/2565710536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a2c064540 msgr2=0x7f7a2c0bca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a31e00700 1 --2- 172.21.15.49:0/2565710536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a2c064540 0x7f7a2c0bca90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f7a24009e60 tx=0x7f7a24009780).stop 2024-01-22T05:08:38.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a31e00700 1 -- 172.21.15.49:0/2565710536 shutdown_connections 2024-01-22T05:08:38.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a31e00700 1 --2- 172.21.15.49:0/2565710536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a2c064540 0x7f7a2c0bca90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.064+0000 7f7a31e00700 1 -- 172.21.15.49:0/2565710536 >> 172.21.15.49:0/2565710536 conn(0x7f7a2c0c40f0 msgr2=0x7f7a2c0c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:38.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.068+0000 7f7a31e00700 1 -- 172.21.15.49:0/2565710536 shutdown_connections 2024-01-22T05:08:38.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.068+0000 7f7a31e00700 1 -- 172.21.15.49:0/2565710536 wait complete. 2024-01-22T05:08:38.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.068+0000 7f7a31e00700 1 Processor -- start 2024-01-22T05:08:38.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a31e00700 1 -- start start 2024-01-22T05:08:38.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a31e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a2c064540 0x7f7a2c140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a31e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a2c068ba0 0x7f7a2c09f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a31e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a2c154380 0x7f7a2c09f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a31e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0accf0 con 0x7f7a2c064540 2024-01-22T05:08:38.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a31e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c09fe80 con 0x7f7a2c154380 2024-01-22T05:08:38.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a31e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c1417e0 con 0x7f7a2c068ba0 2024-01-22T05:08:38.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a2aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a2c064540 0x7f7a2c140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a2aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a2c064540 0x7f7a2c140180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55136/0 (socket says 172.21.15.49:55136) 2024-01-22T05:08:38.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a2aa00700 1 -- 172.21.15.49:0/1888479007 learned_addr learned my addr 172.21.15.49:0/1888479007 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:38.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a2b400700 1 --2- 172.21.15.49:0/1888479007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a2c154380 0x7f7a2c09f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a2a000700 1 --2- 172.21.15.49:0/1888479007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a2c068ba0 0x7f7a2c09f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a2aa00700 1 -- 172.21.15.49:0/1888479007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a2c068ba0 msgr2=0x7f7a2c09f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a2aa00700 1 --2- 172.21.15.49:0/1888479007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a2c068ba0 0x7f7a2c09f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a2aa00700 1 -- 172.21.15.49:0/1888479007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a2c154380 msgr2=0x7f7a2c09f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a2aa00700 1 --2- 172.21.15.49:0/1888479007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a2c154380 0x7f7a2c09f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a2aa00700 1 -- 172.21.15.49:0/1888479007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a24009a20 con 0x7f7a2c064540 2024-01-22T05:08:38.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a2b400700 1 --2- 172.21.15.49:0/1888479007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a2c154380 0x7f7a2c09f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:38.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.072+0000 7f7a2aa00700 1 --2- 172.21.15.49:0/1888479007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a2c064540 0x7f7a2c140180 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f7a1c00c490 tx=0x7f7a1c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.076+0000 7f7a22000700 1 -- 172.21.15.49:0/1888479007 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c00ce40 con 0x7f7a2c064540 2024-01-22T05:08:38.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.076+0000 7f7a22000700 1 -- 172.21.15.49:0/1888479007 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c00f470 con 0x7f7a2c064540 2024-01-22T05:08:38.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.076+0000 7f7a31e00700 1 -- 172.21.15.49:0/1888479007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c140bd0 con 0x7f7a2c064540 2024-01-22T05:08:38.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.076+0000 7f7a22000700 1 -- 172.21.15.49:0/1888479007 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c00f810 con 0x7f7a2c064540 2024-01-22T05:08:38.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.076+0000 7f7a31e00700 1 -- 172.21.15.49:0/1888479007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2c141190 con 0x7f7a2c064540 2024-01-22T05:08:38.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.076+0000 7f7a22000700 1 -- 172.21.15.49:0/1888479007 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7a1c00fbc0 con 0x7f7a2c064540 2024-01-22T05:08:38.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.080+0000 7f7a22000700 1 --2- 172.21.15.49:0/1888479007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7a0405a510 0x7f7a0405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.080+0000 7f7a22000700 1 -- 172.21.15.49:0/1888479007 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7a1c073f30 con 0x7f7a2c064540 2024-01-22T05:08:38.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.080+0000 7f7a2a000700 1 --2- 172.21.15.49:0/1888479007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7a0405a510 0x7f7a0405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.080+0000 7f7a2a000700 1 --2- 172.21.15.49:0/1888479007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7a0405a510 0x7f7a0405c9d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f7a14007fd0 tx=0x7f7a14009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.084+0000 7f7a3c3a1740 1 Processor -- start 2024-01-22T05:08:38.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.084+0000 7f7a3c3a1740 1 -- start start 2024-01-22T05:08:38.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.084+0000 7f7a3c3a1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 0xd198b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.084+0000 7f7a3c3a1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20570 0xd209f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.084+0000 7f7a3c3a1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20ee0 0xcff4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.084+0000 7f7a3c3a1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xc31540 con 0xd20570 2024-01-22T05:08:38.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.084+0000 7f7a3c3a1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xbf4e90 con 0xd20ee0 2024-01-22T05:08:38.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.084+0000 7f7a3c3a1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xbfad90 con 0xd194d0 2024-01-22T05:08:38.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.084+0000 7f7a2a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20570 0xd209f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.084+0000 7f7a2a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20570 0xd209f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55144/0 (socket says 172.21.15.49:55144) 2024-01-22T05:08:38.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.084+0000 7f7a2a000700 1 -- 172.21.15.49:0/663396815 learned_addr learned my addr 172.21.15.49:0/663396815 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:38.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.084+0000 7f7a2b400700 1 --2- 172.21.15.49:0/663396815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20ee0 0xcff4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.084+0000 7f7a2aa00700 1 --2- 172.21.15.49:0/663396815 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 0xd198b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a2a000700 1 -- 172.21.15.49:0/663396815 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 msgr2=0xd198b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a2a000700 1 --2- 172.21.15.49:0/663396815 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 0xd198b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a2a000700 1 -- 172.21.15.49:0/663396815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20ee0 msgr2=0xcff4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a2a000700 1 --2- 172.21.15.49:0/663396815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20ee0 0xcff4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a2a000700 1 -- 172.21.15.49:0/663396815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc5f4c0 con 0xd20570 2024-01-22T05:08:38.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a2a000700 1 --2- 172.21.15.49:0/663396815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20570 0xd209f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f7a1400f800 tx=0x7f7a14013000).ready entity=mon.0 client_cookie=52b51fb69796e9b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a1aa00700 1 -- 172.21.15.49:0/663396815 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14020400 con 0xd20570 2024-01-22T05:08:38.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a1aa00700 1 -- 172.21.15.49:0/663396815 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14020560 con 0xd20570 2024-01-22T05:08:38.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a1aa00700 1 -- 172.21.15.49:0/663396815 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a140206d0 con 0xd20570 2024-01-22T05:08:38.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/663396815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20570 msgr2=0xd209f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/663396815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20570 0xd209f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f7a1400f800 tx=0x7f7a14013000).stop 2024-01-22T05:08:38.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/663396815 shutdown_connections 2024-01-22T05:08:38.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/663396815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20ee0 0xcff4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/663396815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20570 0xd209f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/663396815 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 0xd198b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/663396815 >> 172.21.15.49:0/663396815 conn(0xab3680 msgr2=0xcd2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:38.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/663396815 shutdown_connections 2024-01-22T05:08:38.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.088+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/663396815 wait complete. 2024-01-22T05:08:38.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.092+0000 7f7a3c3a1740 1 -- start start 2024-01-22T05:08:38.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.092+0000 7f7a3c3a1740 1 Processor -- start 2024-01-22T05:08:38.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a3c3a1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 0xcd13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a3c3a1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20570 0xcfc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a3c3a1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20ee0 0xd2a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a3c3a1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xcd1990 con 0xd20ee0 2024-01-22T05:08:38.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a3c3a1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xcf8a90 con 0xd20570 2024-01-22T05:08:38.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a3c3a1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xd2a6d0 con 0xd194d0 2024-01-22T05:08:38.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a3c3a1740 10 client.0 ll_register_callbacks cb 0xc8b5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a2b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20ee0 0xd2a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a2b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20ee0 0xd2a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55152/0 (socket says 172.21.15.49:55152) 2024-01-22T05:08:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a2b400700 1 -- 172.21.15.49:0/3452298846 learned_addr learned my addr 172.21.15.49:0/3452298846 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a2aa00700 1 --2- 172.21.15.49:0/3452298846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 0xcd13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a2a000700 1 --2- 172.21.15.49:0/3452298846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20570 0xcfc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a2b400700 1 -- 172.21.15.49:0/3452298846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 msgr2=0xcd13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a2b400700 1 --2- 172.21.15.49:0/3452298846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 0xcd13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a2b400700 1 -- 172.21.15.49:0/3452298846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20570 msgr2=0xcfc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a2b400700 1 --2- 172.21.15.49:0/3452298846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20570 0xcfc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a2b400700 1 -- 172.21.15.49:0/3452298846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0c0033f0 con 0xd20ee0 2024-01-22T05:08:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a2b400700 1 --2- 172.21.15.49:0/3452298846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20ee0 0xd2a1e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f7a24011000 tx=0x7f7a24009780).ready entity=mon.0 client_cookie=ce89fb1fcf675b99 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a13400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:38.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a13400700 1 -- 172.21.15.49:0/3452298846 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2401e6e0 con 0xd20ee0 2024-01-22T05:08:38.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a13400700 1 -- 172.21.15.49:0/3452298846 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7a2401e840 con 0xd20ee0 2024-01-22T05:08:38.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/3452298846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xc4b230 con 0xd20ee0 2024-01-22T05:08:38.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a13400700 1 -- 172.21.15.49:0/3452298846 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a2401ec10 con 0xd20ee0 2024-01-22T05:08:38.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a3c3a1740 10 client.6120 fetch_fsmap learned FSMap version 45 2024-01-22T05:08:38.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/3452298846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0xc4e7c0 con 0xd20ee0 2024-01-22T05:08:38.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.096+0000 7f7a13400700 1 -- 172.21.15.49:0/3452298846 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xc4b230 con 0xd20ee0 2024-01-22T05:08:38.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.100+0000 7f7a13400700 1 -- 172.21.15.49:0/3452298846 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 45) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7a24027420 con 0xd20ee0 2024-01-22T05:08:38.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.100+0000 7f7a3c3a1740 10 client.6120 fetch_fsmap finished waiting for FSMap version 45 2024-01-22T05:08:38.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.100+0000 7f7a3c3a1740 10 client.6120 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:38.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.100+0000 7f7a3c3a1740 20 client.6120 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:38.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.100+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/3452298846 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xcfb3a0 0xcfb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.100+0000 7f7a3c3a1740 4 client.6120 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:38.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.100+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/3452298846 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xc41780 con 0xcfb3a0 2024-01-22T05:08:38.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.100+0000 7f7a2aa00700 1 --2- 172.21.15.49:0/3452298846 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xcfb3a0 0xcfb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.100+0000 7f7a13400700 10 client.6120 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:38.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.100+0000 7f7a2aa00700 1 --2- 172.21.15.49:0/3452298846 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xcfb3a0 0xcfb780 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7c138199d8f70c08 server_cookie=249ba12eb8780bca in_seq=0 out_seq=0 2024-01-22T05:08:38.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.100+0000 7f7a13400700 1 -- 172.21.15.49:0/3452298846 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xc41780 con 0xcfb3a0 2024-01-22T05:08:38.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.100+0000 7f7a13400700 10 client.6120 handle_command_reply: tid=0 2024-01-22T05:08:38.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.100+0000 7f7a3c3a1740 1 client.6120 shutdown 2024-01-22T05:08:38.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.100+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/3452298846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20ee0 msgr2=0xd2a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.100+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/3452298846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20ee0 0xd2a1e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f7a24011000 tx=0x7f7a24009780).stop 2024-01-22T05:08:38.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.104+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/3452298846 shutdown_connections 2024-01-22T05:08:38.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.104+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/3452298846 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xcfb3a0 0xcfb780 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.104+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/3452298846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20ee0 0xd2a1e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.104+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/3452298846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20570 0xcfc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.104+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/3452298846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 0xcd13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.104+0000 7f7a13400700 0 client.6120 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:38.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.104+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/3452298846 >> 172.21.15.49:0/3452298846 conn(0xab3680 msgr2=0xcfe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:38.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.104+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/3452298846 shutdown_connections 2024-01-22T05:08:38.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.104+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/3452298846 wait complete. 2024-01-22T05:08:38.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.104+0000 7f7a3c3a1740 20 client.6120 trim_cache size 0 max 16384 2024-01-22T05:08:38.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a3c3a1740 1 Processor -- start 2024-01-22T05:08:38.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a3c3a1740 1 -- start start 2024-01-22T05:08:38.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a3c3a1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd194d0 0xcd09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a3c3a1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20570 0xcd0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a3c3a1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd20ee0 0xd1a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a3c3a1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xc0ce00 con 0xd20570 2024-01-22T05:08:38.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a3c3a1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xc97040 con 0xd194d0 2024-01-22T05:08:38.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a3c3a1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xbfbf00 con 0xd20ee0 2024-01-22T05:08:38.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a2a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20570 0xcd0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a2a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20570 0xcd0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55162/0 (socket says 172.21.15.49:55162) 2024-01-22T05:08:38.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a2a000700 1 -- 172.21.15.49:0/3245473930 learned_addr learned my addr 172.21.15.49:0/3245473930 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:38.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a2aa00700 1 --2- 172.21.15.49:0/3245473930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd194d0 0xcd09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a2b400700 1 --2- 172.21.15.49:0/3245473930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd20ee0 0xd1a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a2a000700 1 -- 172.21.15.49:0/3245473930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd20ee0 msgr2=0xd1a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a2a000700 1 --2- 172.21.15.49:0/3245473930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd20ee0 0xd1a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a2a000700 1 -- 172.21.15.49:0/3245473930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd194d0 msgr2=0xcd09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a2a000700 1 --2- 172.21.15.49:0/3245473930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd194d0 0xcd09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a2a000700 1 -- 172.21.15.49:0/3245473930 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd2a540 con 0xd20570 2024-01-22T05:08:38.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a2aa00700 1 --2- 172.21.15.49:0/3245473930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd194d0 0xcd09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:38.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a2b400700 1 --2- 172.21.15.49:0/3245473930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd20ee0 0xd1a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:38.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.124+0000 7f7a2a000700 1 --2- 172.21.15.49:0/3245473930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20570 0xcd0ee0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f7a14018000 tx=0x7f7a14017000).ready entity=mon.0 client_cookie=f0b3754de8ea9b95 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.128+0000 7f7a1b400700 1 -- 172.21.15.49:0/3245473930 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14026070 con 0xd20570 2024-01-22T05:08:38.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.128+0000 7f7a1b400700 1 -- 172.21.15.49:0/3245473930 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14027040 con 0xd20570 2024-01-22T05:08:38.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.128+0000 7f7a1b400700 1 -- 172.21.15.49:0/3245473930 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a140078a0 con 0xd20570 2024-01-22T05:08:38.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.128+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/3245473930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20570 msgr2=0xcd0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.128+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/3245473930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20570 0xcd0ee0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f7a14018000 tx=0x7f7a14017000).stop 2024-01-22T05:08:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.128+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/3245473930 shutdown_connections 2024-01-22T05:08:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.128+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/3245473930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd20ee0 0xd1a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.128+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/3245473930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20570 0xcd0ee0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.128+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/3245473930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd194d0 0xcd09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.128+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/3245473930 >> 172.21.15.49:0/3245473930 conn(0xab3680 msgr2=0xd295c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.128+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/3245473930 shutdown_connections 2024-01-22T05:08:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.128+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/3245473930 wait complete. 2024-01-22T05:08:38.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.128+0000 7f7a3c3a1740 1 -- start start 2024-01-22T05:08:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.132+0000 7f7a3c3a1740 1 Processor -- start 2024-01-22T05:08:38.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 0xd806a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20570 0xd1a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20ee0 0xd1a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xd1aa40 con 0xd20ee0 2024-01-22T05:08:38.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xd823f0 con 0xd20570 2024-01-22T05:08:38.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xd00980 con 0xd194d0 2024-01-22T05:08:38.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 10 client.0 ll_register_callbacks cb 0x7f7a24012ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a2b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20ee0 0xd1a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a2aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 0xd806a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a2a000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20570 0xd1a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a2aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 0xd806a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:58980/0 (socket says 172.21.15.49:58980) 2024-01-22T05:08:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a2a000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20570 0xd1a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:39734/0 (socket says 172.21.15.49:39734) 2024-01-22T05:08:38.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a2aa00700 1 -- 172.21.15.49:0/4288906008 learned_addr learned my addr 172.21.15.49:0/4288906008 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:38.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a2aa00700 1 -- 172.21.15.49:0/4288906008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20570 msgr2=0xd1a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a2aa00700 1 --2- 172.21.15.49:0/4288906008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20570 0xd1a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a2aa00700 1 -- 172.21.15.49:0/4288906008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20ee0 msgr2=0xd1a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a2aa00700 1 --2- 172.21.15.49:0/4288906008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20ee0 0xd1a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a2aa00700 1 -- 172.21.15.49:0/4288906008 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0xc5f4c0 con 0xd194d0 2024-01-22T05:08:38.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a2a000700 1 --2- 172.21.15.49:0/4288906008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20570 0xd1a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:38.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a2b400700 1 --2- 172.21.15.49:0/4288906008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20ee0 0xd1a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:38.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a2aa00700 1 --2- 172.21.15.49:0/4288906008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 0xd806a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f7a1c00ca80 tx=0x7f7a1c01e040).ready entity=mon.2 client_cookie=4e7270993cb42e4a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a13400700 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2024-01-22T05:08:38.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a13400700 1 -- 172.21.15.49:0/4288906008 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c055070 con 0xd194d0 2024-01-22T05:08:38.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a13400700 1 -- 172.21.15.49:0/4288906008 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7a1c04a660 con 0xd194d0 2024-01-22T05:08:38.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/4288906008 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7a14020560 con 0xd194d0 2024-01-22T05:08:38.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a13400700 1 -- 172.21.15.49:0/4288906008 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a1c04b170 con 0xd194d0 2024-01-22T05:08:38.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 10 client.5591 fetch_fsmap learned FSMap version 45 2024-01-22T05:08:38.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/4288906008 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0xd19c10 con 0xd194d0 2024-01-22T05:08:38.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a13400700 1 -- 172.21.15.49:0/4288906008 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14020560 con 0xd194d0 2024-01-22T05:08:38.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a13400700 1 -- 172.21.15.49:0/4288906008 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 45) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7a1c046f60 con 0xd194d0 2024-01-22T05:08:38.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 10 client.5591 fetch_fsmap finished waiting for FSMap version 45 2024-01-22T05:08:38.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 10 client.5591 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:38.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 20 client.5591 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:38.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/4288906008 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xd20950 0xcf67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 4 client.5591 mds_command: new command op to 5569 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:08:38.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.136+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/4288906008 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xb0a610 con 0xd20950 2024-01-22T05:08:38.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a2a000700 1 --2- 172.21.15.49:0/4288906008 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xd20950 0xcf67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a2a000700 1 --2- 172.21.15.49:0/4288906008 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xd20950 0xcf67e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f4c5e9b287cfb24f server_cookie=62d9344cb88df140 in_seq=0 out_seq=0 2024-01-22T05:08:38.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a13400700 10 client.5591 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:38.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a13400700 1 -- 172.21.15.49:0/4288906008 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0xb0a610 con 0xd20950 2024-01-22T05:08:38.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a13400700 10 client.5591 handle_command_reply: tid=0 2024-01-22T05:08:38.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a3c3a1740 1 client.5591 shutdown 2024-01-22T05:08:38.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/4288906008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 msgr2=0xd806a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/4288906008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 0xd806a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f7a1c00ca80 tx=0x7f7a1c01e040).stop 2024-01-22T05:08:38.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/4288906008 shutdown_connections 2024-01-22T05:08:38.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/4288906008 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0xd20950 0xcf67e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/4288906008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd20ee0 0xd1a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/4288906008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd20570 0xd1a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a3c3a1740 1 --2- 172.21.15.49:0/4288906008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd194d0 0xd806a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a13400700 0 client.5591 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:38.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/4288906008 >> 172.21.15.49:0/4288906008 conn(0xab3680 msgr2=0xcd3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:38.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/4288906008 shutdown_connections 2024-01-22T05:08:38.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a3c3a1740 1 -- 172.21.15.49:0/4288906008 wait complete. 2024-01-22T05:08:38.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.140+0000 7f7a3c3a1740 20 client.5591 trim_cache size 0 max 16384 2024-01-22T05:08:38.145 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:38.145 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-01-22T05:08:38.145 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-01-22T05:08:38.145 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:38.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.144+0000 7f7a31e00700 1 -- 172.21.15.49:0/1888479007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7a0405a510 msgr2=0x7f7a0405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.144+0000 7f7a31e00700 1 --2- 172.21.15.49:0/1888479007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7a0405a510 0x7f7a0405c9d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f7a14007fd0 tx=0x7f7a14009040).stop 2024-01-22T05:08:38.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.144+0000 7f7a31e00700 1 -- 172.21.15.49:0/1888479007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a2c064540 msgr2=0x7f7a2c140180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.144+0000 7f7a31e00700 1 --2- 172.21.15.49:0/1888479007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a2c064540 0x7f7a2c140180 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f7a1c00c490 tx=0x7f7a1c007c90).stop 2024-01-22T05:08:38.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.144+0000 7f7a31e00700 1 -- 172.21.15.49:0/1888479007 shutdown_connections 2024-01-22T05:08:38.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.144+0000 7f7a31e00700 1 --2- 172.21.15.49:0/1888479007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7a0405a510 0x7f7a0405c9d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.144+0000 7f7a31e00700 1 --2- 172.21.15.49:0/1888479007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a2c154380 0x7f7a2c09f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.144+0000 7f7a31e00700 1 --2- 172.21.15.49:0/1888479007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a2c068ba0 0x7f7a2c09f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.144+0000 7f7a31e00700 1 --2- 172.21.15.49:0/1888479007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a2c064540 0x7f7a2c140180 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.144+0000 7f7a31e00700 1 -- 172.21.15.49:0/1888479007 >> 172.21.15.49:0/1888479007 conn(0x7f7a2c0c40f0 msgr2=0x7f7a2c150ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:38.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.144+0000 7f7a31e00700 1 -- 172.21.15.49:0/1888479007 shutdown_connections 2024-01-22T05:08:38.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.144+0000 7f7a31e00700 1 -- 172.21.15.49:0/1888479007 wait complete. 2024-01-22T05:08:38.171 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-22T05:08:38.171 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-01-22T05:08:38.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.344+0000 7fe704400700 1 Processor -- start 2024-01-22T05:08:38.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.344+0000 7fe704400700 1 -- start start 2024-01-22T05:08:38.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.348+0000 7fe704400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe6fc153960 0x7fe6fc153d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.348+0000 7fe704400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6fc0bcf70 0x7fe6fc0bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.348+0000 7fe704400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6fc069710 con 0x7fe6fc063d10 2024-01-22T05:08:38.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.348+0000 7fe704400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6fc068880 con 0x7fe6fc153960 2024-01-22T05:08:38.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.348+0000 7fe704400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6fc0bd8f0 con 0x7fe6fc0bcf70 2024-01-22T05:08:38.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.348+0000 7fe701000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe6fc063d10 0x7fe6fc064110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53796/0 (socket says 172.21.15.49:53796) 2024-01-22T05:08:38.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.348+0000 7fe701000700 1 -- 172.21.15.49:0/4098960697 learned_addr learned my addr 172.21.15.49:0/4098960697 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:38.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.348+0000 7fe701a00700 1 --2- 172.21.15.49:0/4098960697 >> v2:172.21.15.49:3300/0 conn(0x7fe6fc153960 0x7fe6fc153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.348+0000 7fe702400700 1 --2- 172.21.15.49:0/4098960697 >> v2:172.21.15.110:3300/0 conn(0x7fe6fc0bcf70 0x7fe6fc0bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.348+0000 7fe6fbe00700 1 -- 172.21.15.49:0/4098960697 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594695868 0 0) 0x7fe6fc069710 con 0x7fe6fc063d10 2024-01-22T05:08:38.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.348+0000 7fe6fbe00700 1 -- 172.21.15.49:0/4098960697 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6dc0033f0 con 0x7fe6fc063d10 2024-01-22T05:08:38.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.348+0000 7fe701a00700 1 -- 172.21.15.49:0/4098960697 >> v2:172.21.15.110:3300/0 conn(0x7fe6fc0bcf70 msgr2=0x7fe6fc0bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.348+0000 7fe701a00700 1 --2- 172.21.15.49:0/4098960697 >> v2:172.21.15.110:3300/0 conn(0x7fe6fc0bcf70 0x7fe6fc0bd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.348+0000 7fe701a00700 1 -- 172.21.15.49:0/4098960697 >> v1:172.21.15.49:6789/0 conn(0x7fe6fc063d10 legacy=0x7fe6fc064110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.348+0000 7fe701a00700 1 -- 172.21.15.49:0/4098960697 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc068b00 con 0x7fe6fc153960 2024-01-22T05:08:38.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.352+0000 7fe701a00700 1 --2- 172.21.15.49:0/4098960697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6fc153960 0x7fe6fc153d40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fe6fc066690 tx=0x7fe6ec009060).ready entity=mon.0 client_cookie=202c27bbe51912ff server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.352+0000 7fe6fbe00700 1 -- 172.21.15.49:0/4098960697 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec00d4a0 con 0x7fe6fc153960 2024-01-22T05:08:38.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.352+0000 7fe6fbe00700 1 -- 172.21.15.49:0/4098960697 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec00d600 con 0x7fe6fc153960 2024-01-22T05:08:38.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.352+0000 7fe6fbe00700 1 -- 172.21.15.49:0/4098960697 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec00d980 con 0x7fe6fc153960 2024-01-22T05:08:38.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.352+0000 7fe704400700 1 -- 172.21.15.49:0/4098960697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6fc153960 msgr2=0x7fe6fc153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.352+0000 7fe704400700 1 --2- 172.21.15.49:0/4098960697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6fc153960 0x7fe6fc153d40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fe6fc066690 tx=0x7fe6ec009060).stop 2024-01-22T05:08:38.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.352+0000 7fe704400700 1 -- 172.21.15.49:0/4098960697 shutdown_connections 2024-01-22T05:08:38.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.352+0000 7fe704400700 1 --2- 172.21.15.49:0/4098960697 >> v2:172.21.15.110:3300/0 conn(0x7fe6fc0bcf70 0x7fe6fc0bd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.352+0000 7fe704400700 1 --2- 172.21.15.49:0/4098960697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6fc153960 0x7fe6fc153d40 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.352+0000 7fe704400700 1 -- 172.21.15.49:0/4098960697 >> 172.21.15.49:0/4098960697 conn(0x7fe6fc062720 msgr2=0x7fe6fc062b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.352+0000 7fe704400700 1 -- 172.21.15.49:0/4098960697 shutdown_connections 2024-01-22T05:08:38.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.352+0000 7fe704400700 1 -- 172.21.15.49:0/4098960697 wait complete. 2024-01-22T05:08:38.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.356+0000 7fe704400700 1 Processor -- start 2024-01-22T05:08:38.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.356+0000 7fe704400700 1 -- start start 2024-01-22T05:08:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe704400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6fc063d10 0x7fe6fc13f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe704400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6fc0bcf70 0x7fe6fc0c02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe704400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6fc153960 0x7fe6fc156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe704400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc0c0cf0 con 0x7fe6fc153960 2024-01-22T05:08:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe704400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc0c0fd0 con 0x7fe6fc0bcf70 2024-01-22T05:08:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe704400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc0c12b0 con 0x7fe6fc063d10 2024-01-22T05:08:38.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe702400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6fc153960 0x7fe6fc156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe702400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6fc153960 0x7fe6fc156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55194/0 (socket says 172.21.15.49:55194) 2024-01-22T05:08:38.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe702400700 1 -- 172.21.15.49:0/68242333 learned_addr learned my addr 172.21.15.49:0/68242333 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:38.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe701000700 1 --2- 172.21.15.49:0/68242333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6fc0bcf70 0x7fe6fc0c02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe701a00700 1 --2- 172.21.15.49:0/68242333 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6fc063d10 0x7fe6fc13f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe702400700 1 -- 172.21.15.49:0/68242333 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6fc063d10 msgr2=0x7fe6fc13f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe702400700 1 --2- 172.21.15.49:0/68242333 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6fc063d10 0x7fe6fc13f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe702400700 1 -- 172.21.15.49:0/68242333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6fc0bcf70 msgr2=0x7fe6fc0c02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe702400700 1 --2- 172.21.15.49:0/68242333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6fc0bcf70 0x7fe6fc0c02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe702400700 1 -- 172.21.15.49:0/68242333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec0092a0 con 0x7fe6fc153960 2024-01-22T05:08:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe702400700 1 --2- 172.21.15.49:0/68242333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6fc153960 0x7fe6fc156d20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fe6f4009e90 tx=0x7fe6f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe6f8c00700 1 -- 172.21.15.49:0/68242333 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f400caa0 con 0x7fe6fc153960 2024-01-22T05:08:38.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.360+0000 7fe6f8c00700 1 -- 172.21.15.49:0/68242333 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f400f040 con 0x7fe6fc153960 2024-01-22T05:08:38.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.364+0000 7fe704400700 1 -- 172.21.15.49:0/68242333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6fc0c1590 con 0x7fe6fc153960 2024-01-22T05:08:38.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.364+0000 7fe6f8c00700 1 -- 172.21.15.49:0/68242333 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f400ce10 con 0x7fe6fc153960 2024-01-22T05:08:38.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.364+0000 7fe704400700 1 -- 172.21.15.49:0/68242333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6fc0be8b0 con 0x7fe6fc153960 2024-01-22T05:08:38.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.364+0000 7fe6f8c00700 1 -- 172.21.15.49:0/68242333 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe6f4013610 con 0x7fe6fc153960 2024-01-22T05:08:38.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.368+0000 7fe6f8c00700 1 --2- 172.21.15.49:0/68242333 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe6d405a510 0x7fe6d405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.368+0000 7fe6f8c00700 1 -- 172.21.15.49:0/68242333 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe6f40752e0 con 0x7fe6fc153960 2024-01-22T05:08:38.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.368+0000 7fe701a00700 1 --2- 172.21.15.49:0/68242333 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe6d405a510 0x7fe6d405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.368+0000 7fe70e8d5740 1 Processor -- start 2024-01-22T05:08:38.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.368+0000 7fe701a00700 1 --2- 172.21.15.49:0/68242333 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe6d405a510 0x7fe6d405c9d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fe6ec00d260 tx=0x7fe6ec016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.368+0000 7fe70e8d5740 1 -- start start 2024-01-22T05:08:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe70e8d5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a0a6a0 0x2a0aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe70e8d5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0f7b0 0x29c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe70e8d5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29eed60 0x29c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe70e8d5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2903340 con 0x29eed60 2024-01-22T05:08:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe70e8d5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x29264e0 con 0x2a0f7b0 2024-01-22T05:08:38.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe70e8d5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x28efce0 con 0x2a0a6a0 2024-01-22T05:08:38.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe702400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29eed60 0x29c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe702400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29eed60 0x29c58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55198/0 (socket says 172.21.15.49:55198) 2024-01-22T05:08:38.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe702400700 1 -- 172.21.15.49:0/504442626 learned_addr learned my addr 172.21.15.49:0/504442626 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:38.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe701a00700 1 --2- 172.21.15.49:0/504442626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a0a6a0 0x2a0aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe701000700 1 --2- 172.21.15.49:0/504442626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0f7b0 0x29c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe701a00700 1 -- 172.21.15.49:0/504442626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0f7b0 msgr2=0x29c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe701a00700 1 --2- 172.21.15.49:0/504442626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0f7b0 0x29c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe701a00700 1 -- 172.21.15.49:0/504442626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29eed60 msgr2=0x29c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe701a00700 1 --2- 172.21.15.49:0/504442626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29eed60 0x29c58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe701a00700 1 -- 172.21.15.49:0/504442626 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28f6ed0 con 0x2a0a6a0 2024-01-22T05:08:38.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe702400700 1 --2- 172.21.15.49:0/504442626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29eed60 0x29c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:38.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe701a00700 1 --2- 172.21.15.49:0/504442626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a0a6a0 0x2a0aa80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fe6ec013000 tx=0x7fe6ec020070).ready entity=mon.2 client_cookie=e7a24c3581ed27b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe6f1600700 1 -- 172.21.15.49:0/504442626 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec01e410 con 0x2a0a6a0 2024-01-22T05:08:38.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe6f1600700 1 -- 172.21.15.49:0/504442626 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec01e570 con 0x2a0a6a0 2024-01-22T05:08:38.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.372+0000 7fe6f1600700 1 -- 172.21.15.49:0/504442626 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec01e930 con 0x2a0a6a0 2024-01-22T05:08:38.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.376+0000 7fe70e8d5740 1 -- 172.21.15.49:0/504442626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a0a6a0 msgr2=0x2a0aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.376+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/504442626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a0a6a0 0x2a0aa80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fe6ec013000 tx=0x7fe6ec020070).stop 2024-01-22T05:08:38.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.376+0000 7fe70e8d5740 1 -- 172.21.15.49:0/504442626 shutdown_connections 2024-01-22T05:08:38.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.376+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/504442626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29eed60 0x29c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.376+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/504442626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0f7b0 0x29c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.376+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/504442626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a0a6a0 0x2a0aa80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.376+0000 7fe70e8d5740 1 -- 172.21.15.49:0/504442626 >> 172.21.15.49:0/504442626 conn(0x27a8680 msgr2=0x29c9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:38.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.376+0000 7fe70e8d5740 1 -- 172.21.15.49:0/504442626 shutdown_connections 2024-01-22T05:08:38.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.376+0000 7fe70e8d5740 1 -- 172.21.15.49:0/504442626 wait complete. 2024-01-22T05:08:38.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.376+0000 7fe70e8d5740 1 -- start start 2024-01-22T05:08:38.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.376+0000 7fe70e8d5740 1 Processor -- start 2024-01-22T05:08:38.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe70e8d5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29eed60 0x29ed820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe70e8d5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0a6a0 0x29f4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe70e8d5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0f7b0 0x29c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe70e8d5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x29f2e40 con 0x2a0a6a0 2024-01-22T05:08:38.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe70e8d5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x29f3120 con 0x2a0f7b0 2024-01-22T05:08:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe70e8d5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x29f3400 con 0x29eed60 2024-01-22T05:08:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe70e8d5740 10 client.0 ll_register_callbacks cb 0x29807c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe701000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0a6a0 0x29f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe701000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0a6a0 0x29f4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55212/0 (socket says 172.21.15.49:55212) 2024-01-22T05:08:38.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe701000700 1 -- 172.21.15.49:0/775211545 learned_addr learned my addr 172.21.15.49:0/775211545 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:38.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe702400700 1 --2- 172.21.15.49:0/775211545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0f7b0 0x29c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe701a00700 1 --2- 172.21.15.49:0/775211545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29eed60 0x29ed820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe701000700 1 -- 172.21.15.49:0/775211545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29eed60 msgr2=0x29ed820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe701000700 1 --2- 172.21.15.49:0/775211545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29eed60 0x29ed820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe701000700 1 -- 172.21.15.49:0/775211545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0f7b0 msgr2=0x29c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe701000700 1 --2- 172.21.15.49:0/775211545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0f7b0 0x29c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe701000700 1 -- 172.21.15.49:0/775211545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6fc0be8b0 con 0x2a0a6a0 2024-01-22T05:08:38.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe701000700 1 --2- 172.21.15.49:0/775211545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0a6a0 0x29f4880 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fe6fc1587a0 tx=0x7fe6e4009040).ready entity=mon.0 client_cookie=23394d3181114c3d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe6ea000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe6ea000700 1 -- 172.21.15.49:0/775211545 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4012ea0 con 0x2a0a6a0 2024-01-22T05:08:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe70e8d5740 1 -- 172.21.15.49:0/775211545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2940230 con 0x2a0a6a0 2024-01-22T05:08:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.380+0000 7fe6ea000700 1 -- 172.21.15.49:0/775211545 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe6e40070d0 con 0x2a0a6a0 2024-01-22T05:08:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe6ea000700 1 -- 172.21.15.49:0/775211545 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6e40074a0 con 0x2a0a6a0 2024-01-22T05:08:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe70e8d5740 10 client.6141 fetch_fsmap learned FSMap version 45 2024-01-22T05:08:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe70e8d5740 1 -- 172.21.15.49:0/775211545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x7fe6fc068b00 con 0x2a0a6a0 2024-01-22T05:08:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe6ea000700 1 -- 172.21.15.49:0/775211545 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2940230 con 0x2a0a6a0 2024-01-22T05:08:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe6ea000700 1 -- 172.21.15.49:0/775211545 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 45) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe6e4005780 con 0x2a0a6a0 2024-01-22T05:08:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe70e8d5740 10 client.6141 fetch_fsmap finished waiting for FSMap version 45 2024-01-22T05:08:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe70e8d5740 10 client.6141 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe70e8d5740 20 client.6141 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/775211545 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2a25d50 0x2a28170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe70e8d5740 4 client.6141 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:38.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe70e8d5740 1 -- 172.21.15.49:0/775211545 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2936780 con 0x2a25d50 2024-01-22T05:08:38.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe701a00700 1 --2- 172.21.15.49:0/775211545 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2a25d50 0x2a28170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe6ea000700 10 client.6141 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:38.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe701a00700 1 --2- 172.21.15.49:0/775211545 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2a25d50 0x2a28170 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9bcfb446534c9b3f server_cookie=86796de302574219 in_seq=0 out_seq=0 2024-01-22T05:08:38.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe6ea000700 1 -- 172.21.15.49:0/775211545 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2936780 con 0x2a25d50 2024-01-22T05:08:38.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe6ea000700 10 client.6141 handle_command_reply: tid=0 2024-01-22T05:08:38.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.384+0000 7fe70e8d5740 1 client.6141 shutdown 2024-01-22T05:08:38.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.388+0000 7fe70e8d5740 1 -- 172.21.15.49:0/775211545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0a6a0 msgr2=0x29f4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.388+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/775211545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0a6a0 0x29f4880 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fe6fc1587a0 tx=0x7fe6e4009040).stop 2024-01-22T05:08:38.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.388+0000 7fe70e8d5740 1 -- 172.21.15.49:0/775211545 shutdown_connections 2024-01-22T05:08:38.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.388+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/775211545 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2a25d50 0x2a28170 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.388+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/775211545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0f7b0 0x29c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.388+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/775211545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0a6a0 0x29f4880 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.388+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/775211545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29eed60 0x29ed820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.388+0000 7fe6ea000700 0 client.6141 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:38.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.388+0000 7fe70e8d5740 1 -- 172.21.15.49:0/775211545 >> 172.21.15.49:0/775211545 conn(0x27a8680 msgr2=0x2a0eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:38.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.388+0000 7fe70e8d5740 1 -- 172.21.15.49:0/775211545 shutdown_connections 2024-01-22T05:08:38.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.388+0000 7fe70e8d5740 1 -- 172.21.15.49:0/775211545 wait complete. 2024-01-22T05:08:38.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.388+0000 7fe70e8d5740 20 client.6141 trim_cache size 0 max 16384 2024-01-22T05:08:38.404 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:08:38.400+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-22T05:08:38.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe70e8d5740 1 Processor -- start 2024-01-22T05:08:38.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe70e8d5740 1 -- start start 2024-01-22T05:08:38.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe70e8d5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27a8680 0x2a09a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe70e8d5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29eed60 0x29f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe70e8d5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0a6a0 0x2a0ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe70e8d5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a1b440 con 0x29eed60 2024-01-22T05:08:38.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe70e8d5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a1bee0 con 0x2a0a6a0 2024-01-22T05:08:38.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe70e8d5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x29edea0 con 0x27a8680 2024-01-22T05:08:38.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe701000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29eed60 0x29f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe701000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29eed60 0x29f3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55214/0 (socket says 172.21.15.49:55214) 2024-01-22T05:08:38.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe701000700 1 -- 172.21.15.49:0/3544550591 learned_addr learned my addr 172.21.15.49:0/3544550591 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:38.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe702400700 1 --2- 172.21.15.49:0/3544550591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0a6a0 0x2a0ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe701a00700 1 --2- 172.21.15.49:0/3544550591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27a8680 0x2a09a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe701000700 1 -- 172.21.15.49:0/3544550591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27a8680 msgr2=0x2a09a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe701000700 1 --2- 172.21.15.49:0/3544550591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27a8680 0x2a09a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe701000700 1 -- 172.21.15.49:0/3544550591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0a6a0 msgr2=0x2a0ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe701000700 1 --2- 172.21.15.49:0/3544550591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0a6a0 0x2a0ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe701000700 1 -- 172.21.15.49:0/3544550591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc05ed80 con 0x29eed60 2024-01-22T05:08:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.404+0000 7fe701000700 1 --2- 172.21.15.49:0/3544550591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29eed60 0x29f3f40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fe6e4000f80 tx=0x7fe6e401f000).ready entity=mon.0 client_cookie=ad66bc363204c8aa server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.412+0000 7fe6f2000700 1 -- 172.21.15.49:0/3544550591 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4029070 con 0x29eed60 2024-01-22T05:08:38.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.412+0000 7fe6f2000700 1 -- 172.21.15.49:0/3544550591 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e4012ea0 con 0x29eed60 2024-01-22T05:08:38.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.412+0000 7fe6f2000700 1 -- 172.21.15.49:0/3544550591 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40012d0 con 0x29eed60 2024-01-22T05:08:38.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.412+0000 7fe70e8d5740 1 -- 172.21.15.49:0/3544550591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29eed60 msgr2=0x29f3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.412+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/3544550591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29eed60 0x29f3f40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fe6e4000f80 tx=0x7fe6e401f000).stop 2024-01-22T05:08:38.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.412+0000 7fe70e8d5740 1 -- 172.21.15.49:0/3544550591 shutdown_connections 2024-01-22T05:08:38.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.412+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/3544550591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0a6a0 0x2a0ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.412+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/3544550591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29eed60 0x29f3f40 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.412+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/3544550591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27a8680 0x2a09a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.412+0000 7fe70e8d5740 1 -- 172.21.15.49:0/3544550591 >> 172.21.15.49:0/3544550591 conn(0x29f5b40 msgr2=0x2a1b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:38.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.412+0000 7fe70e8d5740 1 -- 172.21.15.49:0/3544550591 shutdown_connections 2024-01-22T05:08:38.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.412+0000 7fe70e8d5740 1 -- 172.21.15.49:0/3544550591 wait complete. 2024-01-22T05:08:38.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.416+0000 7fe70e8d5740 1 -- start start 2024-01-22T05:08:38.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.416+0000 7fe70e8d5740 1 Processor -- start 2024-01-22T05:08:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe70e8d5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27a8680 0x2a66910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe70e8d5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29eed60 0x2a656a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe70e8d5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0a6a0 0x2a65b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe70e8d5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a73a30 con 0x27a8680 2024-01-22T05:08:38.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe70e8d5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a1acf0 con 0x2a0a6a0 2024-01-22T05:08:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe70e8d5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x29f46e0 con 0x29eed60 2024-01-22T05:08:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe70e8d5740 10 client.0 ll_register_callbacks cb 0x7fe6e4001b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe701a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27a8680 0x2a66910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe701000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29eed60 0x2a656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe701a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27a8680 0x2a66910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55226/0 (socket says 172.21.15.49:55226) 2024-01-22T05:08:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe702400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0a6a0 0x2a65b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe701a00700 1 -- 172.21.15.49:0/2276146253 learned_addr learned my addr 172.21.15.49:0/2276146253 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe701000700 1 -- 172.21.15.49:0/2276146253 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0a6a0 msgr2=0x2a65b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe701000700 1 --2- 172.21.15.49:0/2276146253 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0a6a0 0x2a65b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe701000700 1 -- 172.21.15.49:0/2276146253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27a8680 msgr2=0x2a66910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe701000700 1 --2- 172.21.15.49:0/2276146253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27a8680 0x2a66910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe701000700 1 -- 172.21.15.49:0/2276146253 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6fc068b00 con 0x29eed60 2024-01-22T05:08:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe702400700 1 --2- 172.21.15.49:0/2276146253 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0a6a0 0x2a65b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe701a00700 1 --2- 172.21.15.49:0/2276146253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27a8680 0x2a66910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe701000700 1 --2- 172.21.15.49:0/2276146253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29eed60 0x2a656a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x2a07f60 tx=0x7fe6e4027070).ready entity=mon.2 client_cookie=1be033aec941dbd5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe6ea000700 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2024-01-22T05:08:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe6ea000700 1 -- 172.21.15.49:0/2276146253 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4029070 con 0x29eed60 2024-01-22T05:08:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe6ea000700 1 -- 172.21.15.49:0/2276146253 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe6e4012bc0 con 0x29eed60 2024-01-22T05:08:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe70e8d5740 1 -- 172.21.15.49:0/2276146253 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe6ec01e570 con 0x29eed60 2024-01-22T05:08:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe6ea000700 1 -- 172.21.15.49:0/2276146253 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6e4005240 con 0x29eed60 2024-01-22T05:08:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe70e8d5740 10 client.5606 fetch_fsmap learned FSMap version 46 2024-01-22T05:08:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe70e8d5740 1 -- 172.21.15.49:0/2276146253 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x7fe6fc1415c0 con 0x29eed60 2024-01-22T05:08:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.420+0000 7fe6ea000700 1 -- 172.21.15.49:0/2276146253 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec01e570 con 0x29eed60 2024-01-22T05:08:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe6ea000700 1 -- 172.21.15.49:0/2276146253 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 46) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe6e4012020 con 0x29eed60 2024-01-22T05:08:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 10 client.5606 fetch_fsmap finished waiting for FSMap version 46 2024-01-22T05:08:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 10 client.5606 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-01-22T05:08:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 20 client.5606 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/2276146253 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2a0f7b0 0x2a0da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 4 client.5606 mds_command: new command op to 5569 tid=0[{"prefix": "damage ls"}] 2024-01-22T05:08:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 1 -- 172.21.15.49:0/2276146253 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x27ff610 con 0x2a0f7b0 2024-01-22T05:08:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe701a00700 1 --2- 172.21.15.49:0/2276146253 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2a0f7b0 0x2a0da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe701a00700 1 --2- 172.21.15.49:0/2276146253 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2a0f7b0 0x2a0da00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4da5a54bb578c091 server_cookie=e1fcd22f32a68887 in_seq=0 out_seq=0 2024-01-22T05:08:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe6ea000700 10 client.5606 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe6ea000700 1 -- 172.21.15.49:0/2276146253 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+168 (crc 0 0 0) 0x27ff610 con 0x2a0f7b0 2024-01-22T05:08:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe6ea000700 10 client.5606 handle_command_reply: tid=0 2024-01-22T05:08:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 1 client.5606 shutdown 2024-01-22T05:08:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 1 -- 172.21.15.49:0/2276146253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29eed60 msgr2=0x2a656a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/2276146253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29eed60 0x2a656a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x2a07f60 tx=0x7fe6e4027070).stop 2024-01-22T05:08:38.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 1 -- 172.21.15.49:0/2276146253 shutdown_connections 2024-01-22T05:08:38.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/2276146253 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x2a0f7b0 0x2a0da00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/2276146253 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0a6a0 0x2a65b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/2276146253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29eed60 0x2a656a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe6ea000700 0 client.5606 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:38.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 1 --2- 172.21.15.49:0/2276146253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27a8680 0x2a66910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 1 -- 172.21.15.49:0/2276146253 >> 172.21.15.49:0/2276146253 conn(0x29f5b40 msgr2=0x2a0ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:38.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 1 -- 172.21.15.49:0/2276146253 shutdown_connections 2024-01-22T05:08:38.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 1 -- 172.21.15.49:0/2276146253 wait complete. 2024-01-22T05:08:38.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.424+0000 7fe70e8d5740 20 client.5606 trim_cache size 0 max 16384 2024-01-22T05:08:38.429 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-22T05:08:38.429 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:38.429 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-01-22T05:08:38.429 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2737223471, 2024-01-22T05:08:38.430 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511630189, 2024-01-22T05:08:38.430 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2024-01-22T05:08:38.430 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:38.430 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-22T05:08:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.428+0000 7fe704400700 1 -- 172.21.15.49:0/68242333 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe6d405a510 msgr2=0x7fe6d405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.428+0000 7fe704400700 1 --2- 172.21.15.49:0/68242333 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe6d405a510 0x7fe6d405c9d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fe6ec00d260 tx=0x7fe6ec016000).stop 2024-01-22T05:08:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.428+0000 7fe704400700 1 -- 172.21.15.49:0/68242333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6fc153960 msgr2=0x7fe6fc156d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.428+0000 7fe704400700 1 --2- 172.21.15.49:0/68242333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6fc153960 0x7fe6fc156d20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fe6f4009e90 tx=0x7fe6f400b040).stop 2024-01-22T05:08:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.428+0000 7fe704400700 1 -- 172.21.15.49:0/68242333 shutdown_connections 2024-01-22T05:08:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.428+0000 7fe704400700 1 --2- 172.21.15.49:0/68242333 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe6d405a510 0x7fe6d405c9d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.428+0000 7fe704400700 1 --2- 172.21.15.49:0/68242333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6fc153960 0x7fe6fc156d20 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.428+0000 7fe704400700 1 --2- 172.21.15.49:0/68242333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6fc0bcf70 0x7fe6fc0c02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.428+0000 7fe704400700 1 --2- 172.21.15.49:0/68242333 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6fc063d10 0x7fe6fc13f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.428+0000 7fe704400700 1 -- 172.21.15.49:0/68242333 >> 172.21.15.49:0/68242333 conn(0x7fe6fc062720 msgr2=0x7fe6fc064110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.428+0000 7fe704400700 1 -- 172.21.15.49:0/68242333 shutdown_connections 2024-01-22T05:08:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.428+0000 7fe704400700 1 -- 172.21.15.49:0/68242333 wait complete. 2024-01-22T05:08:38.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:38.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.612+0000 7fadc6800700 1 Processor -- start 2024-01-22T05:08:38.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.616+0000 7fadc6800700 1 -- start start 2024-01-22T05:08:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.616+0000 7fadc6800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadc00a8740 0x7fadc00a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.616+0000 7fadc6800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fadc00c1ed0 0x7fadc00c2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.616+0000 7fadc6800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc00c1a40 con 0x7fadc0155d20 2024-01-22T05:08:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.616+0000 7fadc6800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc00a90b0 con 0x7fadc00c1ed0 2024-01-22T05:08:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.616+0000 7fadc6800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc0159310 con 0x7fadc00a8740 2024-01-22T05:08:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.616+0000 7fadbfe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fadc00c1ed0 0x7fadc00c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.616+0000 7fadbea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadc00a8740 0x7fadc00a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.616+0000 7fadbf400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fadc0155d20 0x7fadc0065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:46386/0 (socket says 172.21.15.49:46386) 2024-01-22T05:08:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.616+0000 7fadbf400700 1 -- 172.21.15.49:0/2325755539 learned_addr learned my addr 172.21.15.49:0/2325755539 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:38.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadbe000700 1 -- 172.21.15.49:0/2325755539 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378823932 0 0) 0x7fadc00c1a40 con 0x7fadc0155d20 2024-01-22T05:08:38.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadbe000700 1 -- 172.21.15.49:0/2325755539 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fada00033f0 con 0x7fadc0155d20 2024-01-22T05:08:38.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadbfe00700 1 -- 172.21.15.49:0/2325755539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadc00a8740 msgr2=0x7fadc00a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:38.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadbfe00700 1 --2- 172.21.15.49:0/2325755539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadc00a8740 0x7fadc00a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadbfe00700 1 -- 172.21.15.49:0/2325755539 >> v1:172.21.15.110:6789/0 conn(0x7fadc0155d20 legacy=0x7fadc0065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadbfe00700 1 -- 172.21.15.49:0/2325755539 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00c13f0 con 0x7fadc00c1ed0 2024-01-22T05:08:38.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadbfe00700 1 --2- 172.21.15.49:0/2325755539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc00c1ed0 0x7fadc00c2330 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fadb8009e60 tx=0x7fadb8009780).ready entity=mon.0 client_cookie=f0b098fc71593783 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadbe000700 1 -- 172.21.15.49:0/2325755539 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb800e070 con 0x7fadc00c1ed0 2024-01-22T05:08:38.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadbe000700 1 -- 172.21.15.49:0/2325755539 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb800bab0 con 0x7fadc00c1ed0 2024-01-22T05:08:38.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadbe000700 1 -- 172.21.15.49:0/2325755539 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb800be30 con 0x7fadc00c1ed0 2024-01-22T05:08:38.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadc6800700 1 -- 172.21.15.49:0/2325755539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc00c1ed0 msgr2=0x7fadc00c2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadc6800700 1 --2- 172.21.15.49:0/2325755539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc00c1ed0 0x7fadc00c2330 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fadb8009e60 tx=0x7fadb8009780).stop 2024-01-22T05:08:38.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadc6800700 1 -- 172.21.15.49:0/2325755539 shutdown_connections 2024-01-22T05:08:38.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadc6800700 1 --2- 172.21.15.49:0/2325755539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc00c1ed0 0x7fadc00c2330 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadc6800700 1 --2- 172.21.15.49:0/2325755539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadc00a8740 0x7fadc00a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadc6800700 1 -- 172.21.15.49:0/2325755539 >> 172.21.15.49:0/2325755539 conn(0x7fadc00c6540 msgr2=0x7fadc00c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:38.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadc6800700 1 -- 172.21.15.49:0/2325755539 shutdown_connections 2024-01-22T05:08:38.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.620+0000 7fadc6800700 1 -- 172.21.15.49:0/2325755539 wait complete. 2024-01-22T05:08:38.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.624+0000 7fadc6800700 1 Processor -- start 2024-01-22T05:08:38.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.624+0000 7fadc6800700 1 -- start start 2024-01-22T05:08:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadc6800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadc00a8740 0x7fadc0150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadc6800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadc00c1ed0 0x7fadc0150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadc6800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc0155d20 0x7fadc0151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadc6800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc0066550 con 0x7fadc0155d20 2024-01-22T05:08:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadc6800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc0066830 con 0x7fadc00a8740 2024-01-22T05:08:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadc6800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc0066b10 con 0x7fadc00c1ed0 2024-01-22T05:08:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadbfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc0155d20 0x7fadc0151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadbfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc0155d20 0x7fadc0151230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55242/0 (socket says 172.21.15.49:55242) 2024-01-22T05:08:38.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadbfe00700 1 -- 172.21.15.49:0/3992915642 learned_addr learned my addr 172.21.15.49:0/3992915642 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:38.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadbf400700 1 --2- 172.21.15.49:0/3992915642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadc00a8740 0x7fadc0150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadbea00700 1 --2- 172.21.15.49:0/3992915642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadc00c1ed0 0x7fadc0150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadbfe00700 1 -- 172.21.15.49:0/3992915642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadc00c1ed0 msgr2=0x7fadc0150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadbfe00700 1 --2- 172.21.15.49:0/3992915642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadc00c1ed0 0x7fadc0150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadbfe00700 1 -- 172.21.15.49:0/3992915642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadc00a8740 msgr2=0x7fadc0150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadbfe00700 1 --2- 172.21.15.49:0/3992915642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadc00a8740 0x7fadc0150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadbfe00700 1 -- 172.21.15.49:0/3992915642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb8009a20 con 0x7fadc0155d20 2024-01-22T05:08:38.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadbf400700 1 --2- 172.21.15.49:0/3992915642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadc00a8740 0x7fadc0150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:38.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadbfe00700 1 --2- 172.21.15.49:0/3992915642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc0155d20 0x7fadc0151230 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fadb800b610 tx=0x7fadb8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadb6a00700 1 -- 172.21.15.49:0/3992915642 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb801d630 con 0x7fadc0155d20 2024-01-22T05:08:38.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadb6a00700 1 -- 172.21.15.49:0/3992915642 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb801d790 con 0x7fadc0155d20 2024-01-22T05:08:38.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.628+0000 7fadb6a00700 1 -- 172.21.15.49:0/3992915642 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb801db50 con 0x7fadc0155d20 2024-01-22T05:08:38.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.632+0000 7fadc6800700 1 -- 172.21.15.49:0/3992915642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc0066df0 con 0x7fadc0155d20 2024-01-22T05:08:38.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.632+0000 7fadc6800700 1 -- 172.21.15.49:0/3992915642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc00673b0 con 0x7fadc0155d20 2024-01-22T05:08:38.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.632+0000 7fadc6800700 1 -- 172.21.15.49:0/3992915642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc0047060 con 0x7fadc0155d20 2024-01-22T05:08:38.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.632+0000 7fadb6a00700 1 -- 172.21.15.49:0/3992915642 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fadb8003040 con 0x7fadc0155d20 2024-01-22T05:08:38.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.636+0000 7fadb6a00700 1 --2- 172.21.15.49:0/3992915642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad9805a510 0x7fad9805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:38.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.636+0000 7fadb6a00700 1 -- 172.21.15.49:0/3992915642 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fadb80768f0 con 0x7fadc0155d20 2024-01-22T05:08:38.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.636+0000 7fadbf400700 1 --2- 172.21.15.49:0/3992915642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad9805a510 0x7fad9805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:38.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.636+0000 7fadbf400700 1 --2- 172.21.15.49:0/3992915642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad9805a510 0x7fad9805c9d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fadb0007fd0 tx=0x7fadb0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:38.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.640+0000 7fadb6a00700 1 -- 172.21.15.49:0/3992915642 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fadb8049e70 con 0x7fadc0155d20 2024-01-22T05:08:38.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.836+0000 7fadc6800700 1 -- 172.21.15.49:0/3992915642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadc00c16d0 con 0x7fadc0155d20 2024-01-22T05:08:38.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.840+0000 7fadb6a00700 1 -- 172.21.15.49:0/3992915642 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4493 (secure 0 0 0) 0x7fadb804d490 con 0x7fadc0155d20 2024-01-22T05:08:38.842 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:38.842 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":46,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:38.404800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":12,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:38.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.840+0000 7fadc6800700 1 -- 172.21.15.49:0/3992915642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad9805a510 msgr2=0x7fad9805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.840+0000 7fadc6800700 1 --2- 172.21.15.49:0/3992915642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad9805a510 0x7fad9805c9d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fadb0007fd0 tx=0x7fadb0009040).stop 2024-01-22T05:08:38.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.840+0000 7fadc6800700 1 -- 172.21.15.49:0/3992915642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc0155d20 msgr2=0x7fadc0151230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:38.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.840+0000 7fadc6800700 1 --2- 172.21.15.49:0/3992915642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc0155d20 0x7fadc0151230 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fadb800b610 tx=0x7fadb8009780).stop 2024-01-22T05:08:38.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.844+0000 7fadc6800700 1 -- 172.21.15.49:0/3992915642 shutdown_connections 2024-01-22T05:08:38.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.844+0000 7fadc6800700 1 --2- 172.21.15.49:0/3992915642 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad9805a510 0x7fad9805c9d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.844+0000 7fadc6800700 1 --2- 172.21.15.49:0/3992915642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc0155d20 0x7fadc0151230 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.844+0000 7fadc6800700 1 --2- 172.21.15.49:0/3992915642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadc00c1ed0 0x7fadc0150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.844+0000 7fadc6800700 1 --2- 172.21.15.49:0/3992915642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadc00a8740 0x7fadc0150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:38.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.844+0000 7fadc6800700 1 -- 172.21.15.49:0/3992915642 >> 172.21.15.49:0/3992915642 conn(0x7fadc00c6540 msgr2=0x7fadc01589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:38.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.844+0000 7fadc6800700 1 -- 172.21.15.49:0/3992915642 shutdown_connections 2024-01-22T05:08:38.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:38.844+0000 7fadc6800700 1 -- 172.21.15.49:0/3992915642 wait complete. 2024-01-22T05:08:38.850 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 46 2024-01-22T05:08:38.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 2737223471 2024-01-22T05:08:39.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.028+0000 7f3a01e00700 1 Processor -- start 2024-01-22T05:08:39.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.028+0000 7f3a01e00700 1 -- start start 2024-01-22T05:08:39.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.032+0000 7f3a01e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f39fc0bcbe0 0x7f39fc068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.032+0000 7f3a01e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39fc158650 con 0x7f39fc0c1ce0 2024-01-22T05:08:39.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.032+0000 7f3a01e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39fc0bd170 con 0x7f39fc0a8c20 2024-01-22T05:08:39.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.032+0000 7f3a01e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39fc067c30 con 0x7f39fc0bcbe0 2024-01-22T05:08:39.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.032+0000 7f39fa000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f39fc0c1ce0 0x7f39fc0bc4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53810/0 (socket says 172.21.15.49:53810) 2024-01-22T05:08:39.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.032+0000 7f39fa000700 1 -- 172.21.15.49:0/4263173966 learned_addr learned my addr 172.21.15.49:0/4263173966 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:39.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.032+0000 7f39fb400700 1 --2- 172.21.15.49:0/4263173966 >> v2:172.21.15.49:3300/0 conn(0x7f39fc0bcbe0 0x7f39fc068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.032+0000 7f39f9600700 1 -- 172.21.15.49:0/4263173966 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055878394 0 0) 0x7f39e4001290 con 0x7f39fc0c1ce0 2024-01-22T05:08:39.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.032+0000 7f39f9600700 1 -- 172.21.15.49:0/4263173966 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39dc0033f0 con 0x7f39fc0c1ce0 2024-01-22T05:08:39.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.032+0000 7f39f9600700 1 -- 172.21.15.49:0/4263173966 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851528198 0 0) 0x7f39fc0bd170 con 0x7f39fc0a8c20 2024-01-22T05:08:39.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.032+0000 7f39f9600700 1 -- 172.21.15.49:0/4263173966 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39e4001290 con 0x7f39fc0a8c20 2024-01-22T05:08:39.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.036+0000 7f39fb400700 1 -- 172.21.15.49:0/4263173966 >> v1:172.21.15.110:6789/0 conn(0x7f39fc0a8c20 legacy=0x7f39fc0c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.036+0000 7f39fb400700 1 -- 172.21.15.49:0/4263173966 >> v1:172.21.15.49:6789/0 conn(0x7f39fc0c1ce0 legacy=0x7f39fc0bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.036+0000 7f39fb400700 1 -- 172.21.15.49:0/4263173966 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39fc067f10 con 0x7f39fc0bcbe0 2024-01-22T05:08:39.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.036+0000 7f39fb400700 1 --2- 172.21.15.49:0/4263173966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39fc0bcbe0 0x7f39fc068710 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f39f4009e60 tx=0x7f39f4009780).ready entity=mon.0 client_cookie=6ce4a9d67d039372 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:39.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.036+0000 7f39f9600700 1 -- 172.21.15.49:0/4263173966 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f400e070 con 0x7f39fc0bcbe0 2024-01-22T05:08:39.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.036+0000 7f39f9600700 1 -- 172.21.15.49:0/4263173966 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f400bab0 con 0x7f39fc0bcbe0 2024-01-22T05:08:39.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.036+0000 7f39f9600700 1 -- 172.21.15.49:0/4263173966 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f400be30 con 0x7f39fc0bcbe0 2024-01-22T05:08:39.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.036+0000 7f3a01e00700 1 -- 172.21.15.49:0/4263173966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39fc0bcbe0 msgr2=0x7f39fc068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.036+0000 7f3a01e00700 1 --2- 172.21.15.49:0/4263173966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39fc0bcbe0 0x7f39fc068710 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f39f4009e60 tx=0x7f39f4009780).stop 2024-01-22T05:08:39.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.036+0000 7f3a01e00700 1 -- 172.21.15.49:0/4263173966 shutdown_connections 2024-01-22T05:08:39.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.036+0000 7f3a01e00700 1 --2- 172.21.15.49:0/4263173966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39fc0bcbe0 0x7f39fc068710 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.036+0000 7f3a01e00700 1 -- 172.21.15.49:0/4263173966 >> 172.21.15.49:0/4263173966 conn(0x7f39fc062cb0 msgr2=0x7f39fc0c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:39.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.036+0000 7f3a01e00700 1 -- 172.21.15.49:0/4263173966 shutdown_connections 2024-01-22T05:08:39.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.036+0000 7f3a01e00700 1 -- 172.21.15.49:0/4263173966 wait complete. 2024-01-22T05:08:39.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.040+0000 7f3a01e00700 1 Processor -- start 2024-01-22T05:08:39.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.040+0000 7f3a01e00700 1 -- start start 2024-01-22T05:08:39.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.040+0000 7f3a01e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39fc0a8c20 0x7f39fc0c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.040+0000 7f3a01e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39fc0bcbe0 0x7f39fc1497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.040+0000 7f3a01e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39fc0c1ce0 0x7f39fc0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.040+0000 7f3a01e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc14ab00 con 0x7f39fc0a8c20 2024-01-22T05:08:39.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.040+0000 7f3a01e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc149c90 con 0x7f39fc0c1ce0 2024-01-22T05:08:39.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.040+0000 7f3a01e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc149ef0 con 0x7f39fc0bcbe0 2024-01-22T05:08:39.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.040+0000 7f39faa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39fc0a8c20 0x7f39fc0c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.040+0000 7f39fb400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39fc0c1ce0 0x7f39fc0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.040+0000 7f39faa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39fc0a8c20 0x7f39fc0c37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55268/0 (socket says 172.21.15.49:55268) 2024-01-22T05:08:39.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.040+0000 7f39faa00700 1 -- 172.21.15.49:0/135769241 learned_addr learned my addr 172.21.15.49:0/135769241 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:39.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.040+0000 7f39fa000700 1 --2- 172.21.15.49:0/135769241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39fc0bcbe0 0x7f39fc1497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.044+0000 7f39faa00700 1 -- 172.21.15.49:0/135769241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39fc0bcbe0 msgr2=0x7f39fc1497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.044+0000 7f39faa00700 1 --2- 172.21.15.49:0/135769241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39fc0bcbe0 0x7f39fc1497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.044+0000 7f39faa00700 1 -- 172.21.15.49:0/135769241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39fc0c1ce0 msgr2=0x7f39fc0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.044+0000 7f39faa00700 1 --2- 172.21.15.49:0/135769241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39fc0c1ce0 0x7f39fc0c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.044+0000 7f39faa00700 1 -- 172.21.15.49:0/135769241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f4009a20 con 0x7f39fc0a8c20 2024-01-22T05:08:39.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.044+0000 7f39fb400700 1 --2- 172.21.15.49:0/135769241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39fc0c1ce0 0x7f39fc0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:39.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.044+0000 7f39faa00700 1 --2- 172.21.15.49:0/135769241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39fc0a8c20 0x7f39fc0c37a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f39ec00c490 tx=0x7f39ec007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:39.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.044+0000 7f39f2000700 1 -- 172.21.15.49:0/135769241 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec00ce40 con 0x7f39fc0a8c20 2024-01-22T05:08:39.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.044+0000 7f39f2000700 1 -- 172.21.15.49:0/135769241 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec00f470 con 0x7f39fc0a8c20 2024-01-22T05:08:39.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.044+0000 7f3a01e00700 1 -- 172.21.15.49:0/135769241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39fc14a1d0 con 0x7f39fc0a8c20 2024-01-22T05:08:39.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.044+0000 7f39f2000700 1 -- 172.21.15.49:0/135769241 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec00f830 con 0x7f39fc0a8c20 2024-01-22T05:08:39.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.044+0000 7f3a01e00700 1 -- 172.21.15.49:0/135769241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39fc14a790 con 0x7f39fc0a8c20 2024-01-22T05:08:39.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.044+0000 7f39f2000700 1 -- 172.21.15.49:0/135769241 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f39ec00fba0 con 0x7f39fc0a8c20 2024-01-22T05:08:39.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.048+0000 7f39f2000700 1 --2- 172.21.15.49:0/135769241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f39d405a510 0x7f39d405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.048+0000 7f39f2000700 1 -- 172.21.15.49:0/135769241 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f39ec073ea0 con 0x7f39fc0a8c20 2024-01-22T05:08:39.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.048+0000 7f39fa000700 1 --2- 172.21.15.49:0/135769241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f39d405a510 0x7f39d405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.048+0000 7f39fa000700 1 --2- 172.21.15.49:0/135769241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f39d405a510 0x7f39d405c9d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f39fc05fb10 tx=0x7f39e4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:39.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.052+0000 7f3a0c39e740 1 Processor -- start 2024-01-22T05:08:39.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.052+0000 7f3a0c39e740 1 -- start start 2024-01-22T05:08:39.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.052+0000 7f3a0c39e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 0x25f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.052+0000 7f3a0c39e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x25ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.052+0000 7f3a0c39e740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 0x25ae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.052+0000 7f3a0c39e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x250c570 con 0x25a99d0 2024-01-22T05:08:39.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.052+0000 7f3a0c39e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x24cff20 con 0x25f3660 2024-01-22T05:08:39.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.052+0000 7f3a0c39e740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x24d5db0 con 0x25f3f30 2024-01-22T05:08:39.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f39fa000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x25ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f39fa000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x25ae040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55270/0 (socket says 172.21.15.49:55270) 2024-01-22T05:08:39.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f39fa000700 1 -- 172.21.15.49:0/3400314922 learned_addr learned my addr 172.21.15.49:0/3400314922 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:39.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f39faa00700 1 --2- 172.21.15.49:0/3400314922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 0x25f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f39fb400700 1 --2- 172.21.15.49:0/3400314922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 0x25ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f39fa000700 1 -- 172.21.15.49:0/3400314922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 msgr2=0x25ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:39.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f39fa000700 1 --2- 172.21.15.49:0/3400314922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 0x25ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f39fa000700 1 -- 172.21.15.49:0/3400314922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 msgr2=0x25f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:39.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f39fa000700 1 --2- 172.21.15.49:0/3400314922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 0x25f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f39fa000700 1 -- 172.21.15.49:0/3400314922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2529850 con 0x25a99d0 2024-01-22T05:08:39.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f39faa00700 1 --2- 172.21.15.49:0/3400314922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 0x25f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:39.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f39fa000700 1 --2- 172.21.15.49:0/3400314922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x25ae040 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f39fc0c20e0 tx=0x7f39e4013000).ready entity=mon.0 client_cookie=55d4717d057d23c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:39.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f39eaa00700 1 -- 172.21.15.49:0/3400314922 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4013600 con 0x25a99d0 2024-01-22T05:08:39.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f39eaa00700 1 -- 172.21.15.49:0/3400314922 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e4013760 con 0x25a99d0 2024-01-22T05:08:39.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f39eaa00700 1 -- 172.21.15.49:0/3400314922 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e40138f0 con 0x25a99d0 2024-01-22T05:08:39.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f3a0c39e740 1 -- 172.21.15.49:0/3400314922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 msgr2=0x25ae040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/3400314922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x25ae040 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f39fc0c20e0 tx=0x7f39e4013000).stop 2024-01-22T05:08:39.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f3a0c39e740 1 -- 172.21.15.49:0/3400314922 shutdown_connections 2024-01-22T05:08:39.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/3400314922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 0x25ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/3400314922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x25ae040 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/3400314922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 0x25f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f3a0c39e740 1 -- 172.21.15.49:0/3400314922 >> 172.21.15.49:0/3400314922 conn(0x238e710 msgr2=0x25ad1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:39.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f3a0c39e740 1 -- 172.21.15.49:0/3400314922 shutdown_connections 2024-01-22T05:08:39.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.056+0000 7f3a0c39e740 1 -- 172.21.15.49:0/3400314922 wait complete. 2024-01-22T05:08:39.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.060+0000 7f3a0c39e740 1 -- start start 2024-01-22T05:08:39.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.060+0000 7f3a0c39e740 1 Processor -- start 2024-01-22T05:08:39.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.060+0000 7f3a0c39e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x25d4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.060+0000 7f3a0c39e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 0x25ee610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.060+0000 7f3a0c39e740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 0x25f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.060+0000 7f3a0c39e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x25ef3d0 con 0x25a99d0 2024-01-22T05:08:39.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.060+0000 7f3a0c39e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x25db730 con 0x25f3660 2024-01-22T05:08:39.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.060+0000 7f3a0c39e740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x25daaa0 con 0x25f3f30 2024-01-22T05:08:39.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f3a0c39e740 10 client.0 ll_register_callbacks cb 0x25266d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:39.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39faa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x25d4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39faa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x25d4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55282/0 (socket says 172.21.15.49:55282) 2024-01-22T05:08:39.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39faa00700 1 -- 172.21.15.49:0/4012163982 learned_addr learned my addr 172.21.15.49:0/4012163982 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:39.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39fb400700 1 --2- 172.21.15.49:0/4012163982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 0x25f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39fa000700 1 --2- 172.21.15.49:0/4012163982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 0x25ee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39faa00700 1 -- 172.21.15.49:0/4012163982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 msgr2=0x25f0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:39.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39faa00700 1 --2- 172.21.15.49:0/4012163982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 0x25f0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39faa00700 1 -- 172.21.15.49:0/4012163982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 msgr2=0x25ee610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:39.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39faa00700 1 --2- 172.21.15.49:0/4012163982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 0x25ee610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39faa00700 1 -- 172.21.15.49:0/4012163982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39dc0033f0 con 0x25a99d0 2024-01-22T05:08:39.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39fb400700 1 --2- 172.21.15.49:0/4012163982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 0x25f0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:39.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39fa000700 1 --2- 172.21.15.49:0/4012163982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 0x25ee610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:39.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39faa00700 1 --2- 172.21.15.49:0/4012163982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x25d4350 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f39ec072240 tx=0x7f39ec00f000).ready entity=mon.0 client_cookie=9676615592094918 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:39.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39e3400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:39.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39e3400700 1 -- 172.21.15.49:0/4012163982 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec047a40 con 0x25a99d0 2024-01-22T05:08:39.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39e3400700 1 -- 172.21.15.49:0/4012163982 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f39ec0471a0 con 0x25a99d0 2024-01-22T05:08:39.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f3a0c39e740 1 -- 172.21.15.49:0/4012163982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x25262c0 con 0x25a99d0 2024-01-22T05:08:39.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39e3400700 1 -- 172.21.15.49:0/4012163982 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39ec050ce0 con 0x25a99d0 2024-01-22T05:08:39.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f3a0c39e740 10 client.6168 fetch_fsmap learned FSMap version 46 2024-01-22T05:08:39.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f3a0c39e740 1 -- 172.21.15.49:0/4012163982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x2524a80 con 0x25a99d0 2024-01-22T05:08:39.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39e3400700 1 -- 172.21.15.49:0/4012163982 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x25262c0 con 0x25a99d0 2024-01-22T05:08:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39e3400700 1 -- 172.21.15.49:0/4012163982 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 46) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f39ec04a100 con 0x25a99d0 2024-01-22T05:08:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f3a0c39e740 10 client.6168 fetch_fsmap finished waiting for FSMap version 46 2024-01-22T05:08:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f3a0c39e740 10 client.6168 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-22T05:08:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f3a0c39e740 20 client.6168 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/4012163982 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25d6f00 0x260e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f3a0c39e740 4 client.6168 mds_command: new command op to 5569 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:08:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f3a0c39e740 1 -- 172.21.15.49:0/4012163982 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x251c810 con 0x25d6f00 2024-01-22T05:08:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.064+0000 7f39fa000700 1 --2- 172.21.15.49:0/4012163982 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25d6f00 0x260e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f39fa000700 1 --2- 172.21.15.49:0/4012163982 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25d6f00 0x260e8b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3ff907666cc65c0c server_cookie=8ad2dac406e7e299 in_seq=0 out_seq=0 2024-01-22T05:08:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f39e3400700 10 client.6168 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:39.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f39e3400700 1 -- 172.21.15.49:0/4012163982 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x251c810 con 0x25d6f00 2024-01-22T05:08:39.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f39e3400700 10 client.6168 handle_command_reply: tid=0 2024-01-22T05:08:39.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f3a0c39e740 1 client.6168 shutdown 2024-01-22T05:08:39.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f3a0c39e740 1 -- 172.21.15.49:0/4012163982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 msgr2=0x25d4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/4012163982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x25d4350 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f39ec072240 tx=0x7f39ec00f000).stop 2024-01-22T05:08:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f3a0c39e740 1 -- 172.21.15.49:0/4012163982 shutdown_connections 2024-01-22T05:08:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/4012163982 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25d6f00 0x260e8b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/4012163982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 0x25f0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f39e3400700 0 client.6168 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/4012163982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 0x25ee610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/4012163982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x25d4350 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f3a0c39e740 1 -- 172.21.15.49:0/4012163982 >> 172.21.15.49:0/4012163982 conn(0x238e710 msgr2=0x25a86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f3a0c39e740 1 -- 172.21.15.49:0/4012163982 shutdown_connections 2024-01-22T05:08:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f3a0c39e740 1 -- 172.21.15.49:0/4012163982 wait complete. 2024-01-22T05:08:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.068+0000 7f3a0c39e740 20 client.6168 trim_cache size 0 max 16384 2024-01-22T05:08:39.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f3a0c39e740 1 Processor -- start 2024-01-22T05:08:39.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f3a0c39e740 1 -- start start 2024-01-22T05:08:39.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f3a0c39e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25a99d0 0x25d7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f3a0c39e740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3660 0x25a7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f3a0c39e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25f3f30 0x25a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f3a0c39e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x25d7710 con 0x25f3f30 2024-01-22T05:08:39.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f3a0c39e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x25d8f60 con 0x25a99d0 2024-01-22T05:08:39.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f3a0c39e740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x25262c0 con 0x25f3660 2024-01-22T05:08:39.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f39fb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25f3f30 0x25a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f39fb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25f3f30 0x25a81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55296/0 (socket says 172.21.15.49:55296) 2024-01-22T05:08:39.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f39fb400700 1 -- 172.21.15.49:0/2783130662 learned_addr learned my addr 172.21.15.49:0/2783130662 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:39.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f39fb400700 1 -- 172.21.15.49:0/2783130662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3660 msgr2=0x25a7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:39.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f39fb400700 1 --2- 172.21.15.49:0/2783130662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3660 0x25a7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:39.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f39fb400700 1 -- 172.21.15.49:0/2783130662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25a99d0 msgr2=0x25d7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:39.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f39faa00700 1 --2- 172.21.15.49:0/2783130662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25a99d0 0x25d7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f39fb400700 1 --2- 172.21.15.49:0/2783130662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25a99d0 0x25d7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f39fb400700 1 -- 172.21.15.49:0/2783130662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39fc0c6150 con 0x25f3f30 2024-01-22T05:08:39.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f39faa00700 1 --2- 172.21.15.49:0/2783130662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25a99d0 0x25d7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:39.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.088+0000 7f39fb400700 1 --2- 172.21.15.49:0/2783130662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25f3f30 0x25a81c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f39fc059c20 tx=0x7f39f4009780).ready entity=mon.0 client_cookie=f80672f3feb3e714 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:39.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.092+0000 7f39eb400700 1 -- 172.21.15.49:0/2783130662 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f4022070 con 0x25f3f30 2024-01-22T05:08:39.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.092+0000 7f39eb400700 1 -- 172.21.15.49:0/2783130662 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f4012a40 con 0x25f3f30 2024-01-22T05:08:39.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.092+0000 7f39eb400700 1 -- 172.21.15.49:0/2783130662 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f4012dc0 con 0x25f3f30 2024-01-22T05:08:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.092+0000 7f3a0c39e740 1 -- 172.21.15.49:0/2783130662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25f3f30 msgr2=0x25a81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.092+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/2783130662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25f3f30 0x25a81c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f39fc059c20 tx=0x7f39f4009780).stop 2024-01-22T05:08:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.092+0000 7f3a0c39e740 1 -- 172.21.15.49:0/2783130662 shutdown_connections 2024-01-22T05:08:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.092+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/2783130662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25f3f30 0x25a81c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.092+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/2783130662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3660 0x25a7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:08:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.092+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/2783130662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25a99d0 0x25d7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.092+0000 7f3a0c39e740 1 -- 172.21.15.49:0/2783130662 >> 172.21.15.49:0/2783130662 conn(0x238e710 msgr2=0x2603370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.092+0000 7f3a0c39e740 1 -- 172.21.15.49:0/2783130662 shutdown_connections 2024-01-22T05:08:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.092+0000 7f3a0c39e740 1 -- 172.21.15.49:0/2783130662 wait complete. 2024-01-22T05:08:39.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.092+0000 7f3a0c39e740 1 -- start start 2024-01-22T05:08:39.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.096+0000 7f3a0c39e740 1 Processor -- start 2024-01-22T05:08:39.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.096+0000 7f3a0c39e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x2649fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.096+0000 7f3a0c39e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 0x25d5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.096+0000 7f3a0c39e740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 0x25d5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.096+0000 7f3a0c39e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2653460 con 0x25a99d0 2024-01-22T05:08:39.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.096+0000 7f3a0c39e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x264b690 con 0x25f3660 2024-01-22T05:08:39.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.096+0000 7f3a0c39e740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x25d8170 con 0x25f3f30 2024-01-22T05:08:39.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.096+0000 7f3a0c39e740 10 client.0 ll_register_callbacks cb 0x7f39ec04ab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:08:39.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.096+0000 7f39faa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x2649fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.096+0000 7f39faa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x2649fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55310/0 (socket says 172.21.15.49:55310) 2024-01-22T05:08:39.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.096+0000 7f39faa00700 1 -- 172.21.15.49:0/81076505 learned_addr learned my addr 172.21.15.49:0/81076505 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:39.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.096+0000 7f39fb400700 1 --2- 172.21.15.49:0/81076505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 0x25d5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.096+0000 7f39fa000700 1 --2- 172.21.15.49:0/81076505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 0x25d5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39faa00700 1 -- 172.21.15.49:0/81076505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 msgr2=0x25d5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:39.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39faa00700 1 --2- 172.21.15.49:0/81076505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 0x25d5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39faa00700 1 -- 172.21.15.49:0/81076505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 msgr2=0x25d5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:39.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39faa00700 1 --2- 172.21.15.49:0/81076505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 0x25d5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39faa00700 1 -- 172.21.15.49:0/81076505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39fc067f10 con 0x25a99d0 2024-01-22T05:08:39.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39fa000700 1 --2- 172.21.15.49:0/81076505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 0x25d5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:39.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39faa00700 1 --2- 172.21.15.49:0/81076505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x2649fb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f39ec0494f0 tx=0x7f39ec055000).ready entity=mon.0 client_cookie=63c786fe71c2efa9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39e3400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:08:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39e3400700 1 -- 172.21.15.49:0/81076505 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec047a40 con 0x25a99d0 2024-01-22T05:08:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f3a0c39e740 1 -- 172.21.15.49:0/81076505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39e4013760 con 0x25a99d0 2024-01-22T05:08:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39e3400700 1 -- 172.21.15.49:0/81076505 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f39ec049800 con 0x25a99d0 2024-01-22T05:08:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39e3400700 1 -- 172.21.15.49:0/81076505 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39ec04a4d0 con 0x25a99d0 2024-01-22T05:08:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f3a0c39e740 10 client.6174 fetch_fsmap learned FSMap version 46 2024-01-22T05:08:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f3a0c39e740 1 -- 172.21.15.49:0/81076505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x25247d0 con 0x25a99d0 2024-01-22T05:08:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39e3400700 1 -- 172.21.15.49:0/81076505 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e4013760 con 0x25a99d0 2024-01-22T05:08:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39e3400700 1 -- 172.21.15.49:0/81076505 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 46) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f39ec049bd0 con 0x25a99d0 2024-01-22T05:08:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f3a0c39e740 10 client.6174 fetch_fsmap finished waiting for FSMap version 46 2024-01-22T05:08:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f3a0c39e740 10 client.6174 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-22T05:08:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f3a0c39e740 20 client.6174 populate_metadata read hostname 'smithi049' 2024-01-22T05:08:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/81076505 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25ed960 0x25edd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f3a0c39e740 4 client.6174 mds_command: new command op to 5569 tid=0[{"prefix": "damage rm", "damage_id": 2737223471}] 2024-01-22T05:08:39.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f3a0c39e740 1 -- 172.21.15.49:0/81076505 --> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] -- command(tid 0: {"prefix": "damage rm", "damage_id": 2737223471}) v1 -- 0x23e56a0 con 0x25ed960 2024-01-22T05:08:39.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39fa000700 1 --2- 172.21.15.49:0/81076505 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25ed960 0x25edd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39fa000700 1 --2- 172.21.15.49:0/81076505 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25ed960 0x25edd40 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5663e2b295e23e4f server_cookie=b53b5617c037f207 in_seq=0 out_seq=0 2024-01-22T05:08:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39e3400700 10 client.6174 ms_handle_connect on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39e3400700 1 -- 172.21.15.49:0/81076505 <== mds.0 v2:172.21.15.49:6836/3428263289 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x23e56a0 con 0x25ed960 2024-01-22T05:08:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f39e3400700 10 client.6174 handle_command_reply: tid=0 2024-01-22T05:08:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.100+0000 7f3a0c39e740 1 client.6174 shutdown 2024-01-22T05:08:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a0c39e740 1 -- 172.21.15.49:0/81076505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 msgr2=0x2649fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/81076505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x2649fb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f39ec0494f0 tx=0x7f39ec055000).stop 2024-01-22T05:08:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a0c39e740 1 -- 172.21.15.49:0/81076505 shutdown_connections 2024-01-22T05:08:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/81076505 >> [v2:172.21.15.49:6836/3428263289,v1:172.21.15.49:6837/3428263289] conn(0x25ed960 0x25edd40 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/81076505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25f3f30 0x25d5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/81076505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25f3660 0x25d5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a0c39e740 1 --2- 172.21.15.49:0/81076505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25a99d0 0x2649fb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f39e3400700 0 client.6174 ms_handle_reset on v2:172.21.15.49:6836/3428263289 2024-01-22T05:08:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a0c39e740 1 -- 172.21.15.49:0/81076505 >> 172.21.15.49:0/81076505 conn(0x238e710 msgr2=0x2603370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a0c39e740 1 -- 172.21.15.49:0/81076505 shutdown_connections 2024-01-22T05:08:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a0c39e740 1 -- 172.21.15.49:0/81076505 wait complete. 2024-01-22T05:08:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a0c39e740 20 client.6174 trim_cache size 0 max 16384 2024-01-22T05:08:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a01e00700 1 -- 172.21.15.49:0/135769241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f39d405a510 msgr2=0x7f39d405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a01e00700 1 --2- 172.21.15.49:0/135769241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f39d405a510 0x7f39d405c9d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f39fc05fb10 tx=0x7f39e4009040).stop 2024-01-22T05:08:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a01e00700 1 -- 172.21.15.49:0/135769241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39fc0a8c20 msgr2=0x7f39fc0c37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a01e00700 1 --2- 172.21.15.49:0/135769241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39fc0a8c20 0x7f39fc0c37a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f39ec00c490 tx=0x7f39ec007d20).stop 2024-01-22T05:08:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a01e00700 1 -- 172.21.15.49:0/135769241 shutdown_connections 2024-01-22T05:08:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a01e00700 1 --2- 172.21.15.49:0/135769241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f39d405a510 0x7f39d405c9d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a01e00700 1 --2- 172.21.15.49:0/135769241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39fc0c1ce0 0x7f39fc0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a01e00700 1 --2- 172.21.15.49:0/135769241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39fc0bcbe0 0x7f39fc1497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a01e00700 1 --2- 172.21.15.49:0/135769241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39fc0a8c20 0x7f39fc0c37a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a01e00700 1 -- 172.21.15.49:0/135769241 >> 172.21.15.49:0/135769241 conn(0x7f39fc062cb0 msgr2=0x7f39fc0c4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a01e00700 1 -- 172.21.15.49:0/135769241 shutdown_connections 2024-01-22T05:08:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.104+0000 7f3a01e00700 1 -- 172.21.15.49:0/135769241 wait complete. 2024-01-22T05:08:39.131 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-01-22T05:08:39.131 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:39.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.308+0000 7ff97de00700 1 Processor -- start 2024-01-22T05:08:39.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.308+0000 7ff97de00700 1 -- start start 2024-01-22T05:08:39.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.312+0000 7ff97de00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9780644f0 0x7ff978064950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.312+0000 7ff97de00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff9780bcc80 0x7ff9780bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.312+0000 7ff97de00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9780c2700 con 0x7ff978065660 2024-01-22T05:08:39.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.312+0000 7ff97de00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9780a7650 con 0x7ff9780bcc80 2024-01-22T05:08:39.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.312+0000 7ff97de00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff978064e40 con 0x7ff9780644f0 2024-01-22T05:08:39.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.312+0000 7ff976a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff978065660 0x7ff9780a6f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53816/0 (socket says 172.21.15.49:53816) 2024-01-22T05:08:39.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.312+0000 7ff976a00700 1 -- 172.21.15.49:0/2617618070 learned_addr learned my addr 172.21.15.49:0/2617618070 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.312+0000 7ff977e00700 1 --2- 172.21.15.49:0/2617618070 >> v2:172.21.15.49:3300/0 conn(0x7ff9780bcc80 0x7ff9780bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.312+0000 7ff976000700 1 --2- 172.21.15.49:0/2617618070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9780644f0 0x7ff978064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.312+0000 7ff975600700 1 -- 172.21.15.49:0/2617618070 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236061349 0 0) 0x7ff9780c2700 con 0x7ff978065660 2024-01-22T05:08:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.312+0000 7ff975600700 1 -- 172.21.15.49:0/2617618070 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9580033f0 con 0x7ff978065660 2024-01-22T05:08:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff977e00700 1 -- 172.21.15.49:0/2617618070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9780644f0 msgr2=0x7ff978064950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff977e00700 1 --2- 172.21.15.49:0/2617618070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9780644f0 0x7ff978064950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff975600700 1 -- 172.21.15.49:0/2617618070 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3908647306 0 0) 0x7ff9580033f0 con 0x7ff978065660 2024-01-22T05:08:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff977e00700 1 -- 172.21.15.49:0/2617618070 >> v1:172.21.15.49:6789/0 conn(0x7ff978065660 legacy=0x7ff9780a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff977e00700 1 -- 172.21.15.49:0/2617618070 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9780c2930 con 0x7ff9780bcc80 2024-01-22T05:08:39.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff977e00700 1 --2- 172.21.15.49:0/2617618070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9780bcc80 0x7ff9780bd110 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7ff970009e90 tx=0x7ff970009780).ready entity=mon.0 client_cookie=846984d8457d41cd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:39.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff975600700 1 -- 172.21.15.49:0/2617618070 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97000e070 con 0x7ff9780bcc80 2024-01-22T05:08:39.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff975600700 1 -- 172.21.15.49:0/2617618070 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97000b7a0 con 0x7ff9780bcc80 2024-01-22T05:08:39.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff975600700 1 -- 172.21.15.49:0/2617618070 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff968001470 con 0x7ff9780bcc80 2024-01-22T05:08:39.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff97de00700 1 -- 172.21.15.49:0/2617618070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9780bcc80 msgr2=0x7ff9780bd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff97de00700 1 --2- 172.21.15.49:0/2617618070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9780bcc80 0x7ff9780bd110 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7ff970009e90 tx=0x7ff970009780).stop 2024-01-22T05:08:39.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff97de00700 1 -- 172.21.15.49:0/2617618070 shutdown_connections 2024-01-22T05:08:39.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff97de00700 1 --2- 172.21.15.49:0/2617618070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9780bcc80 0x7ff9780bd110 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff97de00700 1 --2- 172.21.15.49:0/2617618070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9780644f0 0x7ff978064950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff97de00700 1 -- 172.21.15.49:0/2617618070 >> 172.21.15.49:0/2617618070 conn(0x7ff9780c87f0 msgr2=0x7ff9780c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:39.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff97de00700 1 -- 172.21.15.49:0/2617618070 shutdown_connections 2024-01-22T05:08:39.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.316+0000 7ff97de00700 1 -- 172.21.15.49:0/2617618070 wait complete. 2024-01-22T05:08:39.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.320+0000 7ff97de00700 1 Processor -- start 2024-01-22T05:08:39.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.320+0000 7ff97de00700 1 -- start start 2024-01-22T05:08:39.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff97de00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9780644f0 0x7ff9780a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff97de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff978065660 0x7ff978152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff97de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9780bcc80 0x7ff9780c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff97de00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97816c100 con 0x7ff9780bcc80 2024-01-22T05:08:39.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff97de00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97816b4f0 con 0x7ff978065660 2024-01-22T05:08:39.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff97de00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97816b7d0 con 0x7ff9780644f0 2024-01-22T05:08:39.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff977e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9780bcc80 0x7ff9780c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff977e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9780bcc80 0x7ff9780c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55334/0 (socket says 172.21.15.49:55334) 2024-01-22T05:08:39.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff977e00700 1 -- 172.21.15.49:0/2311134548 learned_addr learned my addr 172.21.15.49:0/2311134548 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:39.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff976a00700 1 --2- 172.21.15.49:0/2311134548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9780644f0 0x7ff9780a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff976000700 1 --2- 172.21.15.49:0/2311134548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff978065660 0x7ff978152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff977e00700 1 -- 172.21.15.49:0/2311134548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9780644f0 msgr2=0x7ff9780a42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff977e00700 1 --2- 172.21.15.49:0/2311134548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9780644f0 0x7ff9780a42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff977e00700 1 -- 172.21.15.49:0/2311134548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff978065660 msgr2=0x7ff978152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff977e00700 1 --2- 172.21.15.49:0/2311134548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff978065660 0x7ff978152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff977e00700 1 -- 172.21.15.49:0/2311134548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff970009a20 con 0x7ff9780bcc80 2024-01-22T05:08:39.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff976a00700 1 --2- 172.21.15.49:0/2311134548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9780644f0 0x7ff9780a42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:39.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff977e00700 1 --2- 172.21.15.49:0/2311134548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9780bcc80 0x7ff9780c4780 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7ff978066be0 tx=0x7ff9780a7790).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:39.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff96e000700 1 -- 172.21.15.49:0/2311134548 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97001d440 con 0x7ff9780bcc80 2024-01-22T05:08:39.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff96e000700 1 -- 172.21.15.49:0/2311134548 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97001d5a0 con 0x7ff9780bcc80 2024-01-22T05:08:39.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff96e000700 1 -- 172.21.15.49:0/2311134548 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97001d940 con 0x7ff9780bcc80 2024-01-22T05:08:39.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.324+0000 7ff97de00700 1 -- 172.21.15.49:0/2311134548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97816bab0 con 0x7ff9780bcc80 2024-01-22T05:08:39.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.328+0000 7ff97de00700 1 -- 172.21.15.49:0/2311134548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9780aa410 con 0x7ff9780bcc80 2024-01-22T05:08:39.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.328+0000 7ff96e000700 1 -- 172.21.15.49:0/2311134548 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff97001dd30 con 0x7ff9780bcc80 2024-01-22T05:08:39.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.328+0000 7ff97de00700 1 -- 172.21.15.49:0/2311134548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97816c270 con 0x7ff9780bcc80 2024-01-22T05:08:39.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.328+0000 7ff96e000700 1 --2- 172.21.15.49:0/2311134548 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff95005a4e0 0x7ff95005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:39.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.328+0000 7ff96e000700 1 -- 172.21.15.49:0/2311134548 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff970076900 con 0x7ff9780bcc80 2024-01-22T05:08:39.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.328+0000 7ff976a00700 1 --2- 172.21.15.49:0/2311134548 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff95005a4e0 0x7ff95005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:39.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.332+0000 7ff976a00700 1 --2- 172.21.15.49:0/2311134548 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff95005a4e0 0x7ff95005c9a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7ff9680011e0 tx=0x7ff968001aa0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.336+0000 7ff96e000700 1 -- 172.21.15.49:0/2311134548 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff970049f40 con 0x7ff9780bcc80 2024-01-22T05:08:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.540+0000 7ff97de00700 1 -- 172.21.15.49:0/2311134548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff978047060 con 0x7ff9780bcc80 2024-01-22T05:08:39.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.544+0000 7ff96e000700 1 -- 172.21.15.49:0/2311134548 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4493 (secure 0 0 0) 0x7ff97004d560 con 0x7ff9780bcc80 2024-01-22T05:08:39.546 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:39.546 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":46,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:38.404800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":12,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:39.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.548+0000 7ff97de00700 1 -- 172.21.15.49:0/2311134548 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff95005a4e0 msgr2=0x7ff95005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.548+0000 7ff97de00700 1 --2- 172.21.15.49:0/2311134548 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff95005a4e0 0x7ff95005c9a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7ff9680011e0 tx=0x7ff968001aa0).stop 2024-01-22T05:08:39.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.548+0000 7ff97de00700 1 -- 172.21.15.49:0/2311134548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9780bcc80 msgr2=0x7ff9780c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:39.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.548+0000 7ff97de00700 1 --2- 172.21.15.49:0/2311134548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9780bcc80 0x7ff9780c4780 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7ff978066be0 tx=0x7ff9780a7790).stop 2024-01-22T05:08:39.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.548+0000 7ff97de00700 1 -- 172.21.15.49:0/2311134548 shutdown_connections 2024-01-22T05:08:39.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.548+0000 7ff97de00700 1 --2- 172.21.15.49:0/2311134548 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff95005a4e0 0x7ff95005c9a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.548+0000 7ff97de00700 1 --2- 172.21.15.49:0/2311134548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9780bcc80 0x7ff9780c4780 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.548+0000 7ff97de00700 1 --2- 172.21.15.49:0/2311134548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff978065660 0x7ff978152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.548+0000 7ff97de00700 1 --2- 172.21.15.49:0/2311134548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9780644f0 0x7ff9780a42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:39.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.548+0000 7ff97de00700 1 -- 172.21.15.49:0/2311134548 >> 172.21.15.49:0/2311134548 conn(0x7ff9780c87f0 msgr2=0x7ff9781535f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:39.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.548+0000 7ff97de00700 1 -- 172.21.15.49:0/2311134548 shutdown_connections 2024-01-22T05:08:39.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:39.548+0000 7ff97de00700 1 -- 172.21.15.49:0/2311134548 wait complete. 2024-01-22T05:08:39.553 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 46 2024-01-22T05:08:39.572 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path / 2024-01-22T05:08:39.736 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:39.736 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:08:39.736 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:39.754 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2024-01-22T05:08:39.755 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:08:39.755 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:08:39.798 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:08:39.841 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:08:39.841 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T05:08:39.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:08:39.841 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-22T05:08:41.204 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:08:41.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:08:41.204 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:08:41.218 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:41.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.419+0000 7fd19c200700 1 Processor -- start 2024-01-22T05:08:41.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.419+0000 7fd19c200700 1 -- start start 2024-01-22T05:08:41.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd19c200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd1940be6a0 0x7fd1940c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:41.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd19c200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd194151a80 0x7fd194064af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:41.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd19c200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1940be210 con 0x7fd194064690 2024-01-22T05:08:41.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd19c200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1940bd650 con 0x7fd194151a80 2024-01-22T05:08:41.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd19c200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1940bd8e0 con 0x7fd1940be6a0 2024-01-22T05:08:41.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd198e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd194064690 0x7fd194151370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53830/0 (socket says 172.21.15.49:53830) 2024-01-22T05:08:41.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd198e00700 1 -- 172.21.15.49:0/1890577855 learned_addr learned my addr 172.21.15.49:0/1890577855 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:41.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd19ac00700 1 --2- 172.21.15.49:0/1890577855 >> v2:172.21.15.49:3300/0 conn(0x7fd194151a80 0x7fd194064af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:41.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd199800700 1 --2- 172.21.15.49:0/1890577855 >> v2:172.21.15.110:3300/0 conn(0x7fd1940be6a0 0x7fd1940c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:41.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd193e00700 1 -- 172.21.15.49:0/1890577855 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841864244 0 0) 0x7fd1940be210 con 0x7fd194064690 2024-01-22T05:08:41.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd193e00700 1 -- 172.21.15.49:0/1890577855 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1740033f0 con 0x7fd194064690 2024-01-22T05:08:41.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd19ac00700 1 -- 172.21.15.49:0/1890577855 >> v2:172.21.15.110:3300/0 conn(0x7fd1940be6a0 msgr2=0x7fd1940c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:41.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd19ac00700 1 --2- 172.21.15.49:0/1890577855 >> v2:172.21.15.110:3300/0 conn(0x7fd1940be6a0 0x7fd1940c2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:41.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd19ac00700 1 -- 172.21.15.49:0/1890577855 >> v1:172.21.15.49:6789/0 conn(0x7fd194064690 legacy=0x7fd194151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:41.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd19ac00700 1 -- 172.21.15.49:0/1890577855 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1940bdbc0 con 0x7fd194151a80 2024-01-22T05:08:41.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd19ac00700 1 --2- 172.21.15.49:0/1890577855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194151a80 0x7fd194064af0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fd1940c7a90 tx=0x7fd18c009780).ready entity=mon.0 client_cookie=18e3e37b4f484f62 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:41.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd193e00700 1 -- 172.21.15.49:0/1890577855 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00e070 con 0x7fd194151a80 2024-01-22T05:08:41.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd193e00700 1 -- 172.21.15.49:0/1890577855 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c00bab0 con 0x7fd194151a80 2024-01-22T05:08:41.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd193e00700 1 -- 172.21.15.49:0/1890577855 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00be30 con 0x7fd194151a80 2024-01-22T05:08:41.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd19c200700 1 -- 172.21.15.49:0/1890577855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194151a80 msgr2=0x7fd194064af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:41.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.423+0000 7fd19c200700 1 --2- 172.21.15.49:0/1890577855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194151a80 0x7fd194064af0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fd1940c7a90 tx=0x7fd18c009780).stop 2024-01-22T05:08:41.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.427+0000 7fd19c200700 1 -- 172.21.15.49:0/1890577855 shutdown_connections 2024-01-22T05:08:41.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.427+0000 7fd19c200700 1 --2- 172.21.15.49:0/1890577855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194151a80 0x7fd194064af0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:41.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.427+0000 7fd19c200700 1 --2- 172.21.15.49:0/1890577855 >> v2:172.21.15.110:3300/0 conn(0x7fd1940be6a0 0x7fd1940c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:41.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.427+0000 7fd19c200700 1 -- 172.21.15.49:0/1890577855 >> 172.21.15.49:0/1890577855 conn(0x7fd1940c87f0 msgr2=0x7fd1940c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:41.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.427+0000 7fd19c200700 1 -- 172.21.15.49:0/1890577855 shutdown_connections 2024-01-22T05:08:41.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.427+0000 7fd19c200700 1 -- 172.21.15.49:0/1890577855 wait complete. 2024-01-22T05:08:41.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.427+0000 7fd19c200700 1 Processor -- start 2024-01-22T05:08:41.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.427+0000 7fd19c200700 1 -- start start 2024-01-22T05:08:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd19c200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194064690 0x7fd19414dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd19c200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1940be6a0 0x7fd19414e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd19c200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd194151a80 0x7fd194161920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd19c200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19414d750 con 0x7fd194064690 2024-01-22T05:08:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd19c200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd194154d00 con 0x7fd194151a80 2024-01-22T05:08:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd19c200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd194154a20 con 0x7fd1940be6a0 2024-01-22T05:08:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd199800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194064690 0x7fd19414dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd199800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194064690 0x7fd19414dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55358/0 (socket says 172.21.15.49:55358) 2024-01-22T05:08:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd199800700 1 -- 172.21.15.49:0/1612457782 learned_addr learned my addr 172.21.15.49:0/1612457782 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd19ac00700 1 --2- 172.21.15.49:0/1612457782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd194151a80 0x7fd194161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd198e00700 1 --2- 172.21.15.49:0/1612457782 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1940be6a0 0x7fd19414e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd199800700 1 -- 172.21.15.49:0/1612457782 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1940be6a0 msgr2=0x7fd19414e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd199800700 1 --2- 172.21.15.49:0/1612457782 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1940be6a0 0x7fd19414e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd199800700 1 -- 172.21.15.49:0/1612457782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd194151a80 msgr2=0x7fd194161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:41.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd199800700 1 --2- 172.21.15.49:0/1612457782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd194151a80 0x7fd194161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:41.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd199800700 1 -- 172.21.15.49:0/1612457782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c009a20 con 0x7fd194064690 2024-01-22T05:08:41.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd199800700 1 --2- 172.21.15.49:0/1612457782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194064690 0x7fd19414dbe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fd18400e930 tx=0x7fd184009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:41.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd190c00700 1 -- 172.21.15.49:0/1612457782 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18400c670 con 0x7fd194064690 2024-01-22T05:08:41.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd190c00700 1 -- 172.21.15.49:0/1612457782 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18400c7d0 con 0x7fd194064690 2024-01-22T05:08:41.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd19c200700 1 -- 172.21.15.49:0/1612457782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19414d100 con 0x7fd194064690 2024-01-22T05:08:41.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd190c00700 1 -- 172.21.15.49:0/1612457782 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18400cb50 con 0x7fd194064690 2024-01-22T05:08:41.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.431+0000 7fd19c200700 1 -- 172.21.15.49:0/1612457782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19414e0d0 con 0x7fd194064690 2024-01-22T05:08:41.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.435+0000 7fd19c200700 1 -- 172.21.15.49:0/1612457782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd194047060 con 0x7fd194064690 2024-01-22T05:08:41.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.435+0000 7fd190c00700 1 -- 172.21.15.49:0/1612457782 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd18401b400 con 0x7fd194064690 2024-01-22T05:08:41.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.435+0000 7fd190c00700 1 --2- 172.21.15.49:0/1612457782 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd16c05a540 0x7fd16c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:41.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.435+0000 7fd190c00700 1 -- 172.21.15.49:0/1612457782 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd184074ea0 con 0x7fd194064690 2024-01-22T05:08:41.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.435+0000 7fd198e00700 1 --2- 172.21.15.49:0/1612457782 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd16c05a540 0x7fd16c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.439+0000 7fd198e00700 1 --2- 172.21.15.49:0/1612457782 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd16c05a540 0x7fd16c05ca00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fd1940a6ac0 tx=0x7fd17c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:41.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.443+0000 7fd190c00700 1 -- 172.21.15.49:0/1612457782 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd1840483c0 con 0x7fd194064690 2024-01-22T05:08:41.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.667+0000 7fd19c200700 1 -- 172.21.15.49:0/1612457782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1940bdea0 con 0x7fd194064690 2024-01-22T05:08:41.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.691+0000 7fd190c00700 1 -- 172.21.15.49:0/1612457782 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4493 (secure 0 0 0) 0x7fd18404b9e0 con 0x7fd194064690 2024-01-22T05:08:41.707 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:41.707 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":46,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:38.404800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":12,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.707+0000 7fd19c200700 1 -- 172.21.15.49:0/1612457782 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd16c05a540 msgr2=0x7fd16c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.707+0000 7fd19c200700 1 --2- 172.21.15.49:0/1612457782 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd16c05a540 0x7fd16c05ca00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fd1940a6ac0 tx=0x7fd17c009040).stop 2024-01-22T05:08:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.707+0000 7fd19c200700 1 -- 172.21.15.49:0/1612457782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194064690 msgr2=0x7fd19414dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.707+0000 7fd19c200700 1 --2- 172.21.15.49:0/1612457782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194064690 0x7fd19414dbe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fd18400e930 tx=0x7fd184009060).stop 2024-01-22T05:08:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.707+0000 7fd19c200700 1 -- 172.21.15.49:0/1612457782 shutdown_connections 2024-01-22T05:08:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.707+0000 7fd19c200700 1 --2- 172.21.15.49:0/1612457782 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd16c05a540 0x7fd16c05ca00 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0x7fd1940a6ac0 tx=0x7fd17c009040).stop 2024-01-22T05:08:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.707+0000 7fd19c200700 1 --2- 172.21.15.49:0/1612457782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd194151a80 0x7fd194161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.707+0000 7fd19c200700 1 --2- 172.21.15.49:0/1612457782 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1940be6a0 0x7fd19414e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.707+0000 7fd19c200700 1 --2- 172.21.15.49:0/1612457782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194064690 0x7fd19414dbe0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:41.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.707+0000 7fd19c200700 1 -- 172.21.15.49:0/1612457782 >> 172.21.15.49:0/1612457782 conn(0x7fd1940c87f0 msgr2=0x7fd194151240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:41.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.711+0000 7fd19c200700 1 -- 172.21.15.49:0/1612457782 shutdown_connections 2024-01-22T05:08:41.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.711+0000 7fd19c200700 1 -- 172.21.15.49:0/1612457782 wait complete. 2024-01-22T05:08:41.721 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 46 2024-01-22T05:08:41.740 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:08:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.891+0000 7fbdc7a00700 1 Processor -- start 2024-01-22T05:08:41.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.895+0000 7fbdc7a00700 1 -- start start 2024-01-22T05:08:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.895+0000 7fbdc7a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc00a8e50 0x7fbdc00bd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.895+0000 7fbdc7a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbdc00c0ee0 0x7fbdc00c1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.895+0000 7fbdc7a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc00bc4d0 con 0x7fbdc00bcc50 2024-01-22T05:08:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.895+0000 7fbdc7a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc00bc960 con 0x7fbdc00c0ee0 2024-01-22T05:08:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.895+0000 7fbdc7a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc00bb8c0 con 0x7fbdc00a8e50 2024-01-22T05:08:41.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdbfe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc00a8e50 0x7fbdc00bd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:41.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdc5000700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbdc00bcc50 0x7fbdc00a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:46406/0 (socket says 172.21.15.49:46406) 2024-01-22T05:08:41.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdc5000700 1 -- 172.21.15.49:0/3738550367 learned_addr learned my addr 172.21.15.49:0/3738550367 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:41.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdc5a00700 1 --2- 172.21.15.49:0/3738550367 >> v2:172.21.15.110:3300/0 conn(0x7fbdc00c0ee0 0x7fbdc00c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:41.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdbf400700 1 -- 172.21.15.49:0/3738550367 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450257615 0 0) 0x7fbdc00bc4d0 con 0x7fbdc00bcc50 2024-01-22T05:08:41.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdbf400700 1 -- 172.21.15.49:0/3738550367 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbda00033f0 con 0x7fbdc00bcc50 2024-01-22T05:08:41.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdc5a00700 1 -- 172.21.15.49:0/3738550367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc00a8e50 msgr2=0x7fbdc00bd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:41.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdc5a00700 1 --2- 172.21.15.49:0/3738550367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc00a8e50 0x7fbdc00bd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:41.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdc5a00700 1 -- 172.21.15.49:0/3738550367 >> v1:172.21.15.110:6789/0 conn(0x7fbdc00bcc50 legacy=0x7fbdc00a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdc5a00700 1 -- 172.21.15.49:0/3738550367 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc00bbba0 con 0x7fbdc00c0ee0 2024-01-22T05:08:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdbfe00700 1 --2- 172.21.15.49:0/3738550367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc00a8e50 0x7fbdc00bd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdc5a00700 1 --2- 172.21.15.49:0/3738550367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdc00c0ee0 0x7fbdc00c1390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fbdb8009e60 tx=0x7fbdb8009780).ready entity=mon.1 client_cookie=c3dc22d5c378ab9b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdbf400700 1 -- 172.21.15.49:0/3738550367 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb800bab0 con 0x7fbdc00c0ee0 2024-01-22T05:08:41.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdbf400700 1 -- 172.21.15.49:0/3738550367 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb800bc10 con 0x7fbdc00c0ee0 2024-01-22T05:08:41.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdbf400700 1 -- 172.21.15.49:0/3738550367 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8011480 con 0x7fbdc00c0ee0 2024-01-22T05:08:41.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdc7a00700 1 -- 172.21.15.49:0/3738550367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdc00c0ee0 msgr2=0x7fbdc00c1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:41.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdc7a00700 1 --2- 172.21.15.49:0/3738550367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdc00c0ee0 0x7fbdc00c1390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fbdb8009e60 tx=0x7fbdb8009780).stop 2024-01-22T05:08:41.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdc7a00700 1 -- 172.21.15.49:0/3738550367 shutdown_connections 2024-01-22T05:08:41.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdc7a00700 1 --2- 172.21.15.49:0/3738550367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdc00c0ee0 0x7fbdc00c1390 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:41.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdc7a00700 1 --2- 172.21.15.49:0/3738550367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc00a8e50 0x7fbdc00bd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:41.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.899+0000 7fbdc7a00700 1 -- 172.21.15.49:0/3738550367 >> 172.21.15.49:0/3738550367 conn(0x7fbdc00c6540 msgr2=0x7fbdc00c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:41.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.903+0000 7fbdc7a00700 1 -- 172.21.15.49:0/3738550367 shutdown_connections 2024-01-22T05:08:41.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.903+0000 7fbdc7a00700 1 -- 172.21.15.49:0/3738550367 wait complete. 2024-01-22T05:08:41.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.903+0000 7fbdc7a00700 1 Processor -- start 2024-01-22T05:08:41.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.903+0000 7fbdc7a00700 1 -- start start 2024-01-22T05:08:41.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc7a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdc00a8e50 0x7fbdc00a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:41.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc7a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc00bcc50 0x7fbdc0155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:41.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc7a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdc00c0ee0 0x7fbdc0155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:41.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc7a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc0155a40 con 0x7fbdc00a8e50 2024-01-22T05:08:41.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc7a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc0164c10 con 0x7fbdc00c0ee0 2024-01-22T05:08:41.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc7a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc01642e0 con 0x7fbdc00bcc50 2024-01-22T05:08:41.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdc00a8e50 0x7fbdc00a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:41.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdc00a8e50 0x7fbdc00a1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55362/0 (socket says 172.21.15.49:55362) 2024-01-22T05:08:41.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc5000700 1 -- 172.21.15.49:0/569759384 learned_addr learned my addr 172.21.15.49:0/569759384 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:41.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc5a00700 1 --2- 172.21.15.49:0/569759384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdc00c0ee0 0x7fbdc0155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:41.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdbfe00700 1 --2- 172.21.15.49:0/569759384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc00bcc50 0x7fbdc0155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:41.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc5000700 1 -- 172.21.15.49:0/569759384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc00bcc50 msgr2=0x7fbdc0155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:41.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc5000700 1 --2- 172.21.15.49:0/569759384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc00bcc50 0x7fbdc0155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:41.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc5000700 1 -- 172.21.15.49:0/569759384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdc00c0ee0 msgr2=0x7fbdc0155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:41.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc5000700 1 --2- 172.21.15.49:0/569759384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdc00c0ee0 0x7fbdc0155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:41.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc5000700 1 -- 172.21.15.49:0/569759384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80092a0 con 0x7fbdc00a8e50 2024-01-22T05:08:41.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc5000700 1 --2- 172.21.15.49:0/569759384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdc00a8e50 0x7fbdc00a1c70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fbdb000c590 tx=0x7fbdb0007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdb7e00700 1 -- 172.21.15.49:0/569759384 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00072e0 con 0x7fbdc00a8e50 2024-01-22T05:08:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdb7e00700 1 -- 172.21.15.49:0/569759384 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb0007440 con 0x7fbdc00a8e50 2024-01-22T05:08:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc7a00700 1 -- 172.21.15.49:0/569759384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb8009a20 con 0x7fbdc00a8e50 2024-01-22T05:08:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdb7e00700 1 -- 172.21.15.49:0/569759384 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00057a0 con 0x7fbdc00a8e50 2024-01-22T05:08:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.907+0000 7fbdc7a00700 1 -- 172.21.15.49:0/569759384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc0164920 con 0x7fbdc00a8e50 2024-01-22T05:08:41.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.911+0000 7fbdc7a00700 1 -- 172.21.15.49:0/569759384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc00abed0 con 0x7fbdc00a8e50 2024-01-22T05:08:41.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.911+0000 7fbdb7e00700 1 -- 172.21.15.49:0/569759384 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbdb0005bd0 con 0x7fbdc00a8e50 2024-01-22T05:08:41.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.911+0000 7fbdb7e00700 1 --2- 172.21.15.49:0/569759384 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbd9805a510 0x7fbd9805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:41.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.911+0000 7fbdb7e00700 1 -- 172.21.15.49:0/569759384 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbdb00740a0 con 0x7fbdc00a8e50 2024-01-22T05:08:41.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.915+0000 7fbdbfe00700 1 --2- 172.21.15.49:0/569759384 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbd9805a510 0x7fbd9805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:41.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.915+0000 7fbdbfe00700 1 --2- 172.21.15.49:0/569759384 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbd9805a510 0x7fbd9805c9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fbdc0161b30 tx=0x7fbda8009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:41.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:41.919+0000 7fbdb7e00700 1 -- 172.21.15.49:0/569759384 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbdc00abed0 con 0x7fbdc00a8e50 2024-01-22T05:08:42.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.091+0000 7fbdc7a00700 1 -- 172.21.15.49:0/569759384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdc00abed0 con 0x7fbdc00a8e50 2024-01-22T05:08:42.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.095+0000 7fbdb7e00700 1 -- 172.21.15.49:0/569759384 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+17260 (secure 0 0 0) 0x7fbdc00abed0 con 0x7fbdc00a8e50 2024-01-22T05:08:42.099 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:42.100 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":58,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:08:24.158652+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:08:00.161271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-22T05:08:00.977775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.23","mappings":[{"from":0,"to":1}]},{"pgid":"8.2f","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:08:42.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.099+0000 7fbdc7a00700 1 -- 172.21.15.49:0/569759384 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbd9805a510 msgr2=0x7fbd9805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.099+0000 7fbdc7a00700 1 --2- 172.21.15.49:0/569759384 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbd9805a510 0x7fbd9805c9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fbdc0161b30 tx=0x7fbda8009060).stop 2024-01-22T05:08:42.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.099+0000 7fbdc7a00700 1 -- 172.21.15.49:0/569759384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdc00a8e50 msgr2=0x7fbdc00a1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.099+0000 7fbdc7a00700 1 --2- 172.21.15.49:0/569759384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdc00a8e50 0x7fbdc00a1c70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fbdb000c590 tx=0x7fbdb0007c80).stop 2024-01-22T05:08:42.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.099+0000 7fbdc7a00700 1 -- 172.21.15.49:0/569759384 shutdown_connections 2024-01-22T05:08:42.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.099+0000 7fbdc7a00700 1 --2- 172.21.15.49:0/569759384 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbd9805a510 0x7fbd9805c9d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.099+0000 7fbdc7a00700 1 --2- 172.21.15.49:0/569759384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdc00c0ee0 0x7fbdc0155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.099+0000 7fbdc7a00700 1 --2- 172.21.15.49:0/569759384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc00bcc50 0x7fbdc0155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.099+0000 7fbdc7a00700 1 --2- 172.21.15.49:0/569759384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdc00a8e50 0x7fbdc00a1c70 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.099+0000 7fbdc7a00700 1 -- 172.21.15.49:0/569759384 >> 172.21.15.49:0/569759384 conn(0x7fbdc00c6540 msgr2=0x7fbdc00680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:42.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.099+0000 7fbdc7a00700 1 -- 172.21.15.49:0/569759384 shutdown_connections 2024-01-22T05:08:42.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.099+0000 7fbdc7a00700 1 -- 172.21.15.49:0/569759384 wait complete. 2024-01-22T05:08:42.125 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:08:00.161271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:08:00.977775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:08:42.125 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:08:42.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.279+0000 7fd837e00700 1 Processor -- start 2024-01-22T05:08:42.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.279+0000 7fd837e00700 1 -- start start 2024-01-22T05:08:42.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.283+0000 7fd837e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd8380691b0 0x7fd838062230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:42.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.283+0000 7fd837e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd838059920 con 0x7fd8380bd3a0 2024-01-22T05:08:42.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.283+0000 7fd837e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8380bcc10 con 0x7fd838066de0 2024-01-22T05:08:42.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.283+0000 7fd837e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8380c1fb0 con 0x7fd8380691b0 2024-01-22T05:08:42.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.283+0000 7fd836000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd8380bd3a0 0x7fd838068aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53834/0 (socket says 172.21.15.49:53834) 2024-01-22T05:08:42.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.283+0000 7fd836000700 1 -- 172.21.15.49:0/3935216920 learned_addr learned my addr 172.21.15.49:0/3935216920 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:42.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.283+0000 7fd837400700 1 --2- 172.21.15.49:0/3935216920 >> v2:172.21.15.49:3300/0 conn(0x7fd8380691b0 0x7fd838062230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:42.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd835600700 1 -- 172.21.15.49:0/3935216920 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957781808 0 0) 0x7fd838059920 con 0x7fd8380bd3a0 2024-01-22T05:08:42.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd835600700 1 -- 172.21.15.49:0/3935216920 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8180033f0 con 0x7fd8380bd3a0 2024-01-22T05:08:42.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd835600700 1 -- 172.21.15.49:0/3935216920 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545237366 0 0) 0x7fd8380bcc10 con 0x7fd838066de0 2024-01-22T05:08:42.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd835600700 1 -- 172.21.15.49:0/3935216920 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd838059920 con 0x7fd838066de0 2024-01-22T05:08:42.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd837400700 1 -- 172.21.15.49:0/3935216920 >> v1:172.21.15.110:6789/0 conn(0x7fd838066de0 legacy=0x7fd838158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd837400700 1 -- 172.21.15.49:0/3935216920 >> v1:172.21.15.49:6789/0 conn(0x7fd8380bd3a0 legacy=0x7fd838068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd837400700 1 -- 172.21.15.49:0/3935216920 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8380c2290 con 0x7fd8380691b0 2024-01-22T05:08:42.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd837400700 1 --2- 172.21.15.49:0/3935216920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8380691b0 0x7fd838062230 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fd830009e60 tx=0x7fd830009780).ready entity=mon.0 client_cookie=533ee1313d9206 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:42.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd835600700 1 -- 172.21.15.49:0/3935216920 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000e070 con 0x7fd8380691b0 2024-01-22T05:08:42.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd835600700 1 -- 172.21.15.49:0/3935216920 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83000bab0 con 0x7fd8380691b0 2024-01-22T05:08:42.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd835600700 1 -- 172.21.15.49:0/3935216920 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000be30 con 0x7fd8380691b0 2024-01-22T05:08:42.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd837e00700 1 -- 172.21.15.49:0/3935216920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8380691b0 msgr2=0x7fd838062230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd837e00700 1 --2- 172.21.15.49:0/3935216920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8380691b0 0x7fd838062230 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fd830009e60 tx=0x7fd830009780).stop 2024-01-22T05:08:42.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd837e00700 1 -- 172.21.15.49:0/3935216920 shutdown_connections 2024-01-22T05:08:42.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd837e00700 1 --2- 172.21.15.49:0/3935216920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8380691b0 0x7fd838062230 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd837e00700 1 -- 172.21.15.49:0/3935216920 >> 172.21.15.49:0/3935216920 conn(0x7fd8380c4370 msgr2=0x7fd838065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:42.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd837e00700 1 -- 172.21.15.49:0/3935216920 shutdown_connections 2024-01-22T05:08:42.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.287+0000 7fd837e00700 1 -- 172.21.15.49:0/3935216920 wait complete. 2024-01-22T05:08:42.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.291+0000 7fd837e00700 1 Processor -- start 2024-01-22T05:08:42.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.291+0000 7fd837e00700 1 -- start start 2024-01-22T05:08:42.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd837e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd838066de0 0x7fd83814d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:42.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd837e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8380691b0 0x7fd8380aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:42.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd837e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8380bd3a0 0x7fd8380abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:42.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd837e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd838169360 con 0x7fd838066de0 2024-01-22T05:08:42.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd837e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83814dac0 con 0x7fd8380691b0 2024-01-22T05:08:42.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd837e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8381686e0 con 0x7fd8380bd3a0 2024-01-22T05:08:42.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd836a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd838066de0 0x7fd83814d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:42.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd836a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd838066de0 0x7fd83814d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55388/0 (socket says 172.21.15.49:55388) 2024-01-22T05:08:42.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd836a00700 1 -- 172.21.15.49:0/3600648113 learned_addr learned my addr 172.21.15.49:0/3600648113 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:42.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd836000700 1 --2- 172.21.15.49:0/3600648113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8380691b0 0x7fd8380aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:42.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd837400700 1 --2- 172.21.15.49:0/3600648113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8380bd3a0 0x7fd8380abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:42.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd836a00700 1 -- 172.21.15.49:0/3600648113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8380bd3a0 msgr2=0x7fd8380abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd836a00700 1 --2- 172.21.15.49:0/3600648113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8380bd3a0 0x7fd8380abf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd836a00700 1 -- 172.21.15.49:0/3600648113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8380691b0 msgr2=0x7fd8380aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd836a00700 1 --2- 172.21.15.49:0/3600648113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8380691b0 0x7fd8380aba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd836a00700 1 -- 172.21.15.49:0/3600648113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd830009a20 con 0x7fd838066de0 2024-01-22T05:08:42.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd836000700 1 --2- 172.21.15.49:0/3600648113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8380691b0 0x7fd8380aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:42.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd836a00700 1 --2- 172.21.15.49:0/3600648113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd838066de0 0x7fd83814d5d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fd82800c4c0 tx=0x7fd828007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:42.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd82e000700 1 -- 172.21.15.49:0/3600648113 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82800f470 con 0x7fd838066de0 2024-01-22T05:08:42.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd82e000700 1 -- 172.21.15.49:0/3600648113 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82800f5d0 con 0x7fd838066de0 2024-01-22T05:08:42.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd837e00700 1 -- 172.21.15.49:0/3600648113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8381689c0 con 0x7fd838066de0 2024-01-22T05:08:42.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd82e000700 1 -- 172.21.15.49:0/3600648113 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82800f970 con 0x7fd838066de0 2024-01-22T05:08:42.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.295+0000 7fd837e00700 1 -- 172.21.15.49:0/3600648113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd838168f80 con 0x7fd838066de0 2024-01-22T05:08:42.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.299+0000 7fd837e00700 1 -- 172.21.15.49:0/3600648113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd838046800 con 0x7fd838066de0 2024-01-22T05:08:42.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.299+0000 7fd82e000700 1 -- 172.21.15.49:0/3600648113 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd82800fce0 con 0x7fd838066de0 2024-01-22T05:08:42.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.299+0000 7fd82e000700 1 --2- 172.21.15.49:0/3600648113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd81005a510 0x7fd81005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:42.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.299+0000 7fd82e000700 1 -- 172.21.15.49:0/3600648113 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd828073fb0 con 0x7fd838066de0 2024-01-22T05:08:42.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.299+0000 7fd836000700 1 --2- 172.21.15.49:0/3600648113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd81005a510 0x7fd81005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:42.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.303+0000 7fd836000700 1 --2- 172.21.15.49:0/3600648113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd81005a510 0x7fd81005c9d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fd838151ea0 tx=0x7fd820009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:42.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.307+0000 7fd82e000700 1 -- 172.21.15.49:0/3600648113 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd8280a2b00 con 0x7fd838066de0 2024-01-22T05:08:42.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.483+0000 7fd837e00700 1 -- 172.21.15.49:0/3600648113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd83806a0c0 con 0x7fd838066de0 2024-01-22T05:08:42.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.483+0000 7fd82e000700 1 -- 172.21.15.49:0/3600648113 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v58) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd8280475f0 con 0x7fd838066de0 2024-01-22T05:08:42.487 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:08:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.487+0000 7fd837e00700 1 -- 172.21.15.49:0/3600648113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd81005a510 msgr2=0x7fd81005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.487+0000 7fd837e00700 1 --2- 172.21.15.49:0/3600648113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd81005a510 0x7fd81005c9d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fd838151ea0 tx=0x7fd820009040).stop 2024-01-22T05:08:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.487+0000 7fd837e00700 1 -- 172.21.15.49:0/3600648113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd838066de0 msgr2=0x7fd83814d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.487+0000 7fd837e00700 1 --2- 172.21.15.49:0/3600648113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd838066de0 0x7fd83814d5d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fd82800c4c0 tx=0x7fd828007c90).stop 2024-01-22T05:08:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.487+0000 7fd837e00700 1 -- 172.21.15.49:0/3600648113 shutdown_connections 2024-01-22T05:08:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.487+0000 7fd837e00700 1 --2- 172.21.15.49:0/3600648113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd81005a510 0x7fd81005c9d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.487+0000 7fd837e00700 1 --2- 172.21.15.49:0/3600648113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8380bd3a0 0x7fd8380abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.487+0000 7fd837e00700 1 --2- 172.21.15.49:0/3600648113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8380691b0 0x7fd8380aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.487+0000 7fd837e00700 1 --2- 172.21.15.49:0/3600648113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd838066de0 0x7fd83814d5d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.487+0000 7fd837e00700 1 -- 172.21.15.49:0/3600648113 >> 172.21.15.49:0/3600648113 conn(0x7fd8380c4370 msgr2=0x7fd838065ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:42.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.487+0000 7fd837e00700 1 -- 172.21.15.49:0/3600648113 shutdown_connections 2024-01-22T05:08:42.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.487+0000 7fd837e00700 1 -- 172.21.15.49:0/3600648113 wait complete. 2024-01-22T05:08:42.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:08:42.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.695+0000 7f9330600700 1 Processor -- start 2024-01-22T05:08:42.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.695+0000 7f9330600700 1 -- start start 2024-01-22T05:08:42.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f9330600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f93280c4a10 0x7f93280c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:42.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f9330600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93280c5a20 con 0x7f93281395f0 2024-01-22T05:08:42.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f9330600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93280c5740 con 0x7f93280c2450 2024-01-22T05:08:42.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f9330600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93280c1550 con 0x7f93280c4a10 2024-01-22T05:08:42.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f932d200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f93281395f0 0x7f9328139a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53840/0 (socket says 172.21.15.49:53840) 2024-01-22T05:08:42.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f932d200700 1 -- 172.21.15.49:0/973935776 learned_addr learned my addr 172.21.15.49:0/973935776 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:42.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f932e600700 1 --2- 172.21.15.49:0/973935776 >> v2:172.21.15.110:3300/0 conn(0x7f93280c4a10 0x7f93280c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:42.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f9327e00700 1 -- 172.21.15.49:0/973935776 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377735806 0 0) 0x7f93280c5a20 con 0x7f93281395f0 2024-01-22T05:08:42.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f9327e00700 1 -- 172.21.15.49:0/973935776 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93080033f0 con 0x7f93281395f0 2024-01-22T05:08:42.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f9327e00700 1 -- 172.21.15.49:0/973935776 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230299646 0 0) 0x7f93280c5740 con 0x7f93280c2450 2024-01-22T05:08:42.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f9327e00700 1 -- 172.21.15.49:0/973935776 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93280c5a20 con 0x7f93280c2450 2024-01-22T05:08:42.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f932e600700 1 -- 172.21.15.49:0/973935776 >> v1:172.21.15.110:6789/0 conn(0x7f93280c2450 legacy=0x7f9328068c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f932e600700 1 -- 172.21.15.49:0/973935776 >> v1:172.21.15.49:6789/0 conn(0x7f93281395f0 legacy=0x7f9328139a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f932e600700 1 -- 172.21.15.49:0/973935776 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93280c1830 con 0x7f93280c4a10 2024-01-22T05:08:42.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f932e600700 1 --2- 172.21.15.49:0/973935776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93280c4a10 0x7f93280c4e40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f9320009e60 tx=0x7f9320009780).ready entity=mon.1 client_cookie=e5e465be541960de server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:42.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f9327e00700 1 -- 172.21.15.49:0/973935776 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932000e070 con 0x7f93280c4a10 2024-01-22T05:08:42.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.699+0000 7f9327e00700 1 -- 172.21.15.49:0/973935776 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932000bab0 con 0x7f93280c4a10 2024-01-22T05:08:42.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.703+0000 7f9327e00700 1 -- 172.21.15.49:0/973935776 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932000be30 con 0x7f93280c4a10 2024-01-22T05:08:42.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.703+0000 7f9330600700 1 -- 172.21.15.49:0/973935776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93280c4a10 msgr2=0x7f93280c4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.703+0000 7f9330600700 1 --2- 172.21.15.49:0/973935776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93280c4a10 0x7f93280c4e40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f9320009e60 tx=0x7f9320009780).stop 2024-01-22T05:08:42.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.703+0000 7f9330600700 1 -- 172.21.15.49:0/973935776 shutdown_connections 2024-01-22T05:08:42.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.703+0000 7f9330600700 1 --2- 172.21.15.49:0/973935776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93280c4a10 0x7f93280c4e40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.703+0000 7f9330600700 1 -- 172.21.15.49:0/973935776 >> 172.21.15.49:0/973935776 conn(0x7f9328065f90 msgr2=0x7f93280663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:42.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.703+0000 7f9330600700 1 -- 172.21.15.49:0/973935776 shutdown_connections 2024-01-22T05:08:42.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.703+0000 7f9330600700 1 -- 172.21.15.49:0/973935776 wait complete. 2024-01-22T05:08:42.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.707+0000 7f9330600700 1 Processor -- start 2024-01-22T05:08:42.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.707+0000 7f9330600700 1 -- start start 2024-01-22T05:08:42.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.707+0000 7f9330600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93280c2450 0x7f93280a7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:42.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.707+0000 7f9330600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93280c4a10 0x7f932816bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:42.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.707+0000 7f9330600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93281395f0 0x7f932816c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:42.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.707+0000 7f9330600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93280a94f0 con 0x7f93281395f0 2024-01-22T05:08:42.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.707+0000 7f9330600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93280ab5f0 con 0x7f93280c4a10 2024-01-22T05:08:42.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.707+0000 7f9330600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93280aaa60 con 0x7f93280c2450 2024-01-22T05:08:42.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.707+0000 7f932e600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93281395f0 0x7f932816c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:42.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.711+0000 7f932e600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93281395f0 0x7f932816c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55400/0 (socket says 172.21.15.49:55400) 2024-01-22T05:08:42.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.711+0000 7f932e600700 1 -- 172.21.15.49:0/3339194796 learned_addr learned my addr 172.21.15.49:0/3339194796 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:42.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.711+0000 7f932d200700 1 --2- 172.21.15.49:0/3339194796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93280c4a10 0x7f932816bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:42.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.711+0000 7f932dc00700 1 --2- 172.21.15.49:0/3339194796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93280c2450 0x7f93280a7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:42.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.711+0000 7f932e600700 1 -- 172.21.15.49:0/3339194796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93280c2450 msgr2=0x7f93280a7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.711+0000 7f932e600700 1 --2- 172.21.15.49:0/3339194796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93280c2450 0x7f93280a7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.711+0000 7f932e600700 1 -- 172.21.15.49:0/3339194796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93280c4a10 msgr2=0x7f932816bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.711+0000 7f932e600700 1 --2- 172.21.15.49:0/3339194796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93280c4a10 0x7f932816bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.711+0000 7f932e600700 1 -- 172.21.15.49:0/3339194796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9320009a20 con 0x7f93281395f0 2024-01-22T05:08:42.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.711+0000 7f932e600700 1 --2- 172.21.15.49:0/3339194796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93281395f0 0x7f932816c3f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f9328069e40 tx=0x7f9320009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:42.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.711+0000 7f9324c00700 1 -- 172.21.15.49:0/3339194796 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320012e10 con 0x7f93281395f0 2024-01-22T05:08:42.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.711+0000 7f9324c00700 1 -- 172.21.15.49:0/3339194796 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932001d630 con 0x7f93281395f0 2024-01-22T05:08:42.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.711+0000 7f9330600700 1 -- 172.21.15.49:0/3339194796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93280aad00 con 0x7f93281395f0 2024-01-22T05:08:42.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.711+0000 7f9324c00700 1 -- 172.21.15.49:0/3339194796 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932001d9b0 con 0x7f93281395f0 2024-01-22T05:08:42.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.711+0000 7f9330600700 1 -- 172.21.15.49:0/3339194796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93280ab280 con 0x7f93281395f0 2024-01-22T05:08:42.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.715+0000 7f9330600700 1 -- 172.21.15.49:0/3339194796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93280ab7a0 con 0x7f93281395f0 2024-01-22T05:08:42.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.715+0000 7f9324c00700 1 -- 172.21.15.49:0/3339194796 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f932001dd20 con 0x7f93281395f0 2024-01-22T05:08:42.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.715+0000 7f9324c00700 1 --2- 172.21.15.49:0/3339194796 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f930005a510 0x7f930005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:42.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.715+0000 7f9324c00700 1 -- 172.21.15.49:0/3339194796 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9320076650 con 0x7f93281395f0 2024-01-22T05:08:42.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.715+0000 7f932dc00700 1 --2- 172.21.15.49:0/3339194796 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f930005a510 0x7f930005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:42.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.715+0000 7f932dc00700 1 --2- 172.21.15.49:0/3339194796 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f930005a510 0x7f930005c9d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f9318003960 tx=0x7f9318007bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:42.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.719+0000 7f9324c00700 1 -- 172.21.15.49:0/3339194796 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9320049c30 con 0x7f93281395f0 2024-01-22T05:08:42.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.883+0000 7f9330600700 1 -- 172.21.15.49:0/3339194796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f93280c1b10 con 0x7f93281395f0 2024-01-22T05:08:42.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.883+0000 7f9324c00700 1 -- 172.21.15.49:0/3339194796 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7f932004d250 con 0x7f93281395f0 2024-01-22T05:08:42.888 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:08:42.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.887+0000 7f9330600700 1 -- 172.21.15.49:0/3339194796 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f930005a510 msgr2=0x7f930005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.887+0000 7f9330600700 1 --2- 172.21.15.49:0/3339194796 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f930005a510 0x7f930005c9d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f9318003960 tx=0x7f9318007bc0).stop 2024-01-22T05:08:42.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.887+0000 7f9330600700 1 -- 172.21.15.49:0/3339194796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93281395f0 msgr2=0x7f932816c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:42.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.887+0000 7f9330600700 1 --2- 172.21.15.49:0/3339194796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93281395f0 0x7f932816c3f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f9328069e40 tx=0x7f9320009780).stop 2024-01-22T05:08:42.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.887+0000 7f9330600700 1 -- 172.21.15.49:0/3339194796 shutdown_connections 2024-01-22T05:08:42.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.887+0000 7f9330600700 1 --2- 172.21.15.49:0/3339194796 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f930005a510 0x7f930005c9d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.887+0000 7f9330600700 1 --2- 172.21.15.49:0/3339194796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93281395f0 0x7f932816c3f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.887+0000 7f9330600700 1 --2- 172.21.15.49:0/3339194796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93280c4a10 0x7f932816bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.887+0000 7f9330600700 1 --2- 172.21.15.49:0/3339194796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93280c2450 0x7f93280a7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:42.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.887+0000 7f9330600700 1 -- 172.21.15.49:0/3339194796 >> 172.21.15.49:0/3339194796 conn(0x7f9328065f90 msgr2=0x7f9328068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:42.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.887+0000 7f9330600700 1 -- 172.21.15.49:0/3339194796 shutdown_connections 2024-01-22T05:08:42.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:42.887+0000 7f9330600700 1 -- 172.21.15.49:0/3339194796 wait complete. 2024-01-22T05:08:42.915 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:08:43.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.079+0000 7f54f4e00700 1 Processor -- start 2024-01-22T05:08:43.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.079+0000 7f54f4e00700 1 -- start start 2024-01-22T05:08:43.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.083+0000 7f54f4e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f54f01510b0 0x7f54f0062ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.083+0000 7f54f4e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54f0063090 0x7f54f00c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.083+0000 7f54f4e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f00c36d0 con 0x7f54f00c26d0 2024-01-22T05:08:43.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.083+0000 7f54f4e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f0067c50 con 0x7f54f01510b0 2024-01-22T05:08:43.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.083+0000 7f54f4e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f0063510 con 0x7f54f0063090 2024-01-22T05:08:43.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.083+0000 7f54eea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54f0063090 0x7f54f00c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.083+0000 7f54ef400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f54f01510b0 0x7f54f0062ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.083+0000 7f54efe00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f54f00c26d0 0x7f54f00c59f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:46438/0 (socket says 172.21.15.49:46438) 2024-01-22T05:08:43.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.083+0000 7f54efe00700 1 -- 172.21.15.49:0/3487413278 learned_addr learned my addr 172.21.15.49:0/3487413278 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:43.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.087+0000 7f54eea00700 1 -- 172.21.15.49:0/3487413278 >> v2:172.21.15.110:3300/0 conn(0x7f54f01510b0 msgr2=0x7f54f0062ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:43.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.087+0000 7f54eea00700 1 --2- 172.21.15.49:0/3487413278 >> v2:172.21.15.110:3300/0 conn(0x7f54f01510b0 0x7f54f0062ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.087+0000 7f54eea00700 1 -- 172.21.15.49:0/3487413278 >> v1:172.21.15.110:6789/0 conn(0x7f54f00c26d0 legacy=0x7f54f00c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.087+0000 7f54ee000700 1 -- 172.21.15.49:0/3487413278 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823451117 0 0) 0x7f54f00c36d0 con 0x7f54f00c26d0 2024-01-22T05:08:43.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.087+0000 7f54eea00700 1 -- 172.21.15.49:0/3487413278 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f0150790 con 0x7f54f0063090 2024-01-22T05:08:43.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.087+0000 7f54ef400700 1 --2- 172.21.15.49:0/3487413278 >> v2:172.21.15.110:3300/0 conn(0x7f54f01510b0 0x7f54f0062ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:43.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.087+0000 7f54eea00700 1 --2- 172.21.15.49:0/3487413278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54f0063090 0x7f54f00c21e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f54d8009760 tx=0x7f54d8009060).ready entity=mon.2 client_cookie=7535d925efb0f775 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:43.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.087+0000 7f54ee000700 1 -- 172.21.15.49:0/3487413278 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d800f510 con 0x7f54f0063090 2024-01-22T05:08:43.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.087+0000 7f54ee000700 1 -- 172.21.15.49:0/3487413278 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d800f670 con 0x7f54f0063090 2024-01-22T05:08:43.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.087+0000 7f54ee000700 1 -- 172.21.15.49:0/3487413278 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d800f9f0 con 0x7f54f0063090 2024-01-22T05:08:43.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.087+0000 7f54f4e00700 1 -- 172.21.15.49:0/3487413278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54f0063090 msgr2=0x7f54f00c21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.087+0000 7f54f4e00700 1 --2- 172.21.15.49:0/3487413278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54f0063090 0x7f54f00c21e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f54d8009760 tx=0x7f54d8009060).stop 2024-01-22T05:08:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.091+0000 7f54f4e00700 1 -- 172.21.15.49:0/3487413278 shutdown_connections 2024-01-22T05:08:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.091+0000 7f54f4e00700 1 --2- 172.21.15.49:0/3487413278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54f0063090 0x7f54f00c21e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.091+0000 7f54f4e00700 1 --2- 172.21.15.49:0/3487413278 >> v2:172.21.15.110:3300/0 conn(0x7f54f01510b0 0x7f54f0062ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.091+0000 7f54f4e00700 1 -- 172.21.15.49:0/3487413278 >> 172.21.15.49:0/3487413278 conn(0x7f54f00c3880 msgr2=0x7f54f00c3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.091+0000 7f54f4e00700 1 -- 172.21.15.49:0/3487413278 shutdown_connections 2024-01-22T05:08:43.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.091+0000 7f54f4e00700 1 -- 172.21.15.49:0/3487413278 wait complete. 2024-01-22T05:08:43.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.091+0000 7f54f4e00700 1 Processor -- start 2024-01-22T05:08:43.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54f4e00700 1 -- start start 2024-01-22T05:08:43.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54f4e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f0063090 0x7f54f0149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54f4e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54f00c26d0 0x7f54f0134dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54f4e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f01510b0 0x7f54f01352b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54f4e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f01357a0 con 0x7f54f0063090 2024-01-22T05:08:43.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54f4e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f00abac0 con 0x7f54f01510b0 2024-01-22T05:08:43.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54f4e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f00aaeb0 con 0x7f54f00c26d0 2024-01-22T05:08:43.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54ef400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f0063090 0x7f54f0149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54ef400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f0063090 0x7f54f0149670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55402/0 (socket says 172.21.15.49:55402) 2024-01-22T05:08:43.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54ef400700 1 -- 172.21.15.49:0/2813851055 learned_addr learned my addr 172.21.15.49:0/2813851055 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54efe00700 1 --2- 172.21.15.49:0/2813851055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f01510b0 0x7f54f01352b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54eea00700 1 --2- 172.21.15.49:0/2813851055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54f00c26d0 0x7f54f0134dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54ef400700 1 -- 172.21.15.49:0/2813851055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54f00c26d0 msgr2=0x7f54f0134dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54ef400700 1 --2- 172.21.15.49:0/2813851055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54f00c26d0 0x7f54f0134dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54ef400700 1 -- 172.21.15.49:0/2813851055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f01510b0 msgr2=0x7f54f01352b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54ef400700 1 --2- 172.21.15.49:0/2813851055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f01510b0 0x7f54f01352b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54ef400700 1 -- 172.21.15.49:0/2813851055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e000a440 con 0x7f54f0063090 2024-01-22T05:08:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54efe00700 1 --2- 172.21.15.49:0/2813851055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f01510b0 0x7f54f01352b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54ef400700 1 --2- 172.21.15.49:0/2813851055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f0063090 0x7f54f0149670 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f54e000e920 tx=0x7f54e000a200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.095+0000 7f54e6a00700 1 -- 172.21.15.49:0/2813851055 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e000c7a0 con 0x7f54f0063090 2024-01-22T05:08:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.099+0000 7f54e6a00700 1 -- 172.21.15.49:0/2813851055 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e000c900 con 0x7f54f0063090 2024-01-22T05:08:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.099+0000 7f54f4e00700 1 -- 172.21.15.49:0/2813851055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d80092a0 con 0x7f54f0063090 2024-01-22T05:08:43.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.099+0000 7f54e6a00700 1 -- 172.21.15.49:0/2813851055 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e000cc80 con 0x7f54f0063090 2024-01-22T05:08:43.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.099+0000 7f54f4e00700 1 -- 172.21.15.49:0/2813851055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f00ab470 con 0x7f54f0063090 2024-01-22T05:08:43.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.099+0000 7f54f4e00700 1 -- 172.21.15.49:0/2813851055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f00654b0 con 0x7f54f0063090 2024-01-22T05:08:43.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.099+0000 7f54e6a00700 1 -- 172.21.15.49:0/2813851055 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f54e001a400 con 0x7f54f0063090 2024-01-22T05:08:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.103+0000 7f54e6a00700 1 --2- 172.21.15.49:0/2813851055 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54c805a510 0x7f54c805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.103+0000 7f54e6a00700 1 -- 172.21.15.49:0/2813851055 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f54e0074d20 con 0x7f54f0063090 2024-01-22T05:08:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.103+0000 7f54eea00700 1 --2- 172.21.15.49:0/2813851055 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54c805a510 0x7f54c805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.103+0000 7f54eea00700 1 --2- 172.21.15.49:0/2813851055 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54c805a510 0x7f54c805c9d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f54d8009fd0 tx=0x7f54d8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:43.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.107+0000 7f54e6a00700 1 -- 172.21.15.49:0/2813851055 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f54e0048280 con 0x7f54f0063090 2024-01-22T05:08:43.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.275+0000 7f54f4e00700 1 -- 172.21.15.49:0/2813851055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54f0046800 con 0x7f54f0063090 2024-01-22T05:08:43.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.275+0000 7f54e6a00700 1 -- 172.21.15.49:0/2813851055 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f54e0015020 con 0x7f54f0063090 2024-01-22T05:08:43.280 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:08:43.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.279+0000 7f54f4e00700 1 -- 172.21.15.49:0/2813851055 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54c805a510 msgr2=0x7f54c805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.279+0000 7f54f4e00700 1 --2- 172.21.15.49:0/2813851055 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54c805a510 0x7f54c805c9d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f54d8009fd0 tx=0x7f54d8017000).stop 2024-01-22T05:08:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.279+0000 7f54f4e00700 1 -- 172.21.15.49:0/2813851055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f0063090 msgr2=0x7f54f0149670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.279+0000 7f54f4e00700 1 --2- 172.21.15.49:0/2813851055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f0063090 0x7f54f0149670 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f54e000e920 tx=0x7f54e000a200).stop 2024-01-22T05:08:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.279+0000 7f54f4e00700 1 -- 172.21.15.49:0/2813851055 shutdown_connections 2024-01-22T05:08:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.279+0000 7f54f4e00700 1 --2- 172.21.15.49:0/2813851055 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54c805a510 0x7f54c805c9d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.279+0000 7f54f4e00700 1 --2- 172.21.15.49:0/2813851055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f01510b0 0x7f54f01352b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.279+0000 7f54f4e00700 1 --2- 172.21.15.49:0/2813851055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54f00c26d0 0x7f54f0134dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.279+0000 7f54f4e00700 1 --2- 172.21.15.49:0/2813851055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54f0063090 0x7f54f0149670 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.279+0000 7f54f4e00700 1 -- 172.21.15.49:0/2813851055 >> 172.21.15.49:0/2813851055 conn(0x7f54f00c3880 msgr2=0x7f54f00680e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.279+0000 7f54f4e00700 1 -- 172.21.15.49:0/2813851055 shutdown_connections 2024-01-22T05:08:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.279+0000 7f54f4e00700 1 -- 172.21.15.49:0/2813851055 wait complete. 2024-01-22T05:08:43.305 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:08:43.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.463+0000 7fb2f7600700 1 Processor -- start 2024-01-22T05:08:43.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.463+0000 7fb2f7600700 1 -- start start 2024-01-22T05:08:43.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.467+0000 7fb2f7600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb2f0063df0 0x7fb2f00642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.467+0000 7fb2f7600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2f00c1c50 0x7fb2f00c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.467+0000 7fb2f7600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f0064790 con 0x7fb2f01582a0 2024-01-22T05:08:43.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.467+0000 7fb2f7600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f006a400 con 0x7fb2f0063df0 2024-01-22T05:08:43.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.467+0000 7fb2f7600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0069f70 con 0x7fb2f00c1c50 2024-01-22T05:08:43.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.467+0000 7fb2efe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb2f0063df0 0x7fb2f00642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.467+0000 7fb2efe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb2f0063df0 0x7fb2f00642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48338/0 (socket says 172.21.15.49:48338) 2024-01-22T05:08:43.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.467+0000 7fb2efe00700 1 -- 172.21.15.49:0/176930446 learned_addr learned my addr 172.21.15.49:0/176930446 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:43.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.467+0000 7fb2f5600700 1 --2- 172.21.15.49:0/176930446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2f00c1c50 0x7fb2f00c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.467+0000 7fb2efe00700 1 -- 172.21.15.49:0/176930446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2f00c1c50 msgr2=0x7fb2f00c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:43.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.467+0000 7fb2efe00700 1 --2- 172.21.15.49:0/176930446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2f00c1c50 0x7fb2f00c20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.467+0000 7fb2efe00700 1 -- 172.21.15.49:0/176930446 >> v1:172.21.15.110:6789/0 conn(0x7fb2f01582a0 legacy=0x7fb2f0068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.467+0000 7fb2efe00700 1 -- 172.21.15.49:0/176930446 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0069360 con 0x7fb2f0063df0 2024-01-22T05:08:43.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.471+0000 7fb2efe00700 1 --2- 172.21.15.49:0/176930446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0063df0 0x7fb2f00642a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fb2d8006fd0 tx=0x7fb2d80090f0).ready entity=mon.0 client_cookie=a071174dbfa016aa server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:43.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.471+0000 7fb2ef400700 1 -- 172.21.15.49:0/176930446 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800b580 con 0x7fb2f0063df0 2024-01-22T05:08:43.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.471+0000 7fb2ef400700 1 -- 172.21.15.49:0/176930446 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d800b6e0 con 0x7fb2f0063df0 2024-01-22T05:08:43.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.471+0000 7fb2ef400700 1 -- 172.21.15.49:0/176930446 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800ba60 con 0x7fb2f0063df0 2024-01-22T05:08:43.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.471+0000 7fb2f7600700 1 -- 172.21.15.49:0/176930446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0063df0 msgr2=0x7fb2f00642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.471+0000 7fb2f7600700 1 --2- 172.21.15.49:0/176930446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0063df0 0x7fb2f00642a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fb2d8006fd0 tx=0x7fb2d80090f0).stop 2024-01-22T05:08:43.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.471+0000 7fb2f7600700 1 -- 172.21.15.49:0/176930446 shutdown_connections 2024-01-22T05:08:43.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.471+0000 7fb2f7600700 1 --2- 172.21.15.49:0/176930446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2f00c1c50 0x7fb2f00c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.471+0000 7fb2f7600700 1 --2- 172.21.15.49:0/176930446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0063df0 0x7fb2f00642a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.471+0000 7fb2f7600700 1 -- 172.21.15.49:0/176930446 >> 172.21.15.49:0/176930446 conn(0x7fb2f00c40f0 msgr2=0x7fb2f00c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:43.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.471+0000 7fb2f7600700 1 -- 172.21.15.49:0/176930446 shutdown_connections 2024-01-22T05:08:43.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.471+0000 7fb2f7600700 1 -- 172.21.15.49:0/176930446 wait complete. 2024-01-22T05:08:43.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.475+0000 7fb2f7600700 1 Processor -- start 2024-01-22T05:08:43.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.475+0000 7fb2f7600700 1 -- start start 2024-01-22T05:08:43.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.475+0000 7fb2f7600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0063df0 0x7fb2f00c1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.475+0000 7fb2f7600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2f00c1c50 0x7fb2f00bf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.475+0000 7fb2f7600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2f01582a0 0x7fb2f015bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.475+0000 7fb2f7600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00c0370 con 0x7fb2f0063df0 2024-01-22T05:08:43.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.475+0000 7fb2f7600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00c05c0 con 0x7fb2f00c1c50 2024-01-22T05:08:43.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.475+0000 7fb2f7600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00c08a0 con 0x7fb2f01582a0 2024-01-22T05:08:43.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2f5600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2f01582a0 0x7fb2f015bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2f5600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2f01582a0 0x7fb2f015bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:57504/0 (socket says 172.21.15.49:57504) 2024-01-22T05:08:43.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2f4c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0063df0 0x7fb2f00c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2f5600700 1 -- 172.21.15.49:0/166357874 learned_addr learned my addr 172.21.15.49:0/166357874 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:43.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2efe00700 1 --2- 172.21.15.49:0/166357874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2f00c1c50 0x7fb2f00bf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2f5600700 1 -- 172.21.15.49:0/166357874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2f00c1c50 msgr2=0x7fb2f00bf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2f5600700 1 --2- 172.21.15.49:0/166357874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2f00c1c50 0x7fb2f00bf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2f5600700 1 -- 172.21.15.49:0/166357874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0063df0 msgr2=0x7fb2f00c1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2f5600700 1 --2- 172.21.15.49:0/166357874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0063df0 0x7fb2f00c1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2f5600700 1 -- 172.21.15.49:0/166357874 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8009370 con 0x7fb2f01582a0 2024-01-22T05:08:43.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2f5600700 1 --2- 172.21.15.49:0/166357874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2f01582a0 0x7fb2f015bc90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb2e8009e90 tx=0x7fb2e800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:43.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2e7e00700 1 -- 172.21.15.49:0/166357874 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800caa0 con 0x7fb2f01582a0 2024-01-22T05:08:43.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2e7e00700 1 -- 172.21.15.49:0/166357874 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e800f040 con 0x7fb2f01582a0 2024-01-22T05:08:43.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2e7e00700 1 -- 172.21.15.49:0/166357874 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800ce10 con 0x7fb2f01582a0 2024-01-22T05:08:43.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2f7600700 1 -- 172.21.15.49:0/166357874 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f00c0b80 con 0x7fb2f01582a0 2024-01-22T05:08:43.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.479+0000 7fb2f7600700 1 -- 172.21.15.49:0/166357874 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f00c1870 con 0x7fb2f01582a0 2024-01-22T05:08:43.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.483+0000 7fb2f7600700 1 -- 172.21.15.49:0/166357874 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f00656b0 con 0x7fb2f01582a0 2024-01-22T05:08:43.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.483+0000 7fb2e7e00700 1 -- 172.21.15.49:0/166357874 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb2e8013610 con 0x7fb2f01582a0 2024-01-22T05:08:43.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.483+0000 7fb2e7e00700 1 --2- 172.21.15.49:0/166357874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb2c805a510 0x7fb2c805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.483+0000 7fb2e7e00700 1 -- 172.21.15.49:0/166357874 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb2e8075140 con 0x7fb2f01582a0 2024-01-22T05:08:43.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.483+0000 7fb2f4c00700 1 --2- 172.21.15.49:0/166357874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb2c805a510 0x7fb2c805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.483+0000 7fb2f4c00700 1 --2- 172.21.15.49:0/166357874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb2c805a510 0x7fb2c805c9d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fb2f00c70a0 tx=0x7fb2e0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:43.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.491+0000 7fb2e7e00700 1 -- 172.21.15.49:0/166357874 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb2e8048780 con 0x7fb2f01582a0 2024-01-22T05:08:43.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.663+0000 7fb2f7600700 1 -- 172.21.15.49:0/166357874 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2f0069640 con 0x7fb2f01582a0 2024-01-22T05:08:43.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.663+0000 7fb2e7e00700 1 -- 172.21.15.49:0/166357874 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2e804bda0 con 0x7fb2f01582a0 2024-01-22T05:08:43.668 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:08:43.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.667+0000 7fb2f7600700 1 -- 172.21.15.49:0/166357874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb2c805a510 msgr2=0x7fb2c805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.667+0000 7fb2f7600700 1 --2- 172.21.15.49:0/166357874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb2c805a510 0x7fb2c805c9d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fb2f00c70a0 tx=0x7fb2e0009040).stop 2024-01-22T05:08:43.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.667+0000 7fb2f7600700 1 -- 172.21.15.49:0/166357874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2f01582a0 msgr2=0x7fb2f015bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.667+0000 7fb2f7600700 1 --2- 172.21.15.49:0/166357874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2f01582a0 0x7fb2f015bc90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb2e8009e90 tx=0x7fb2e800b040).stop 2024-01-22T05:08:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.671+0000 7fb2f7600700 1 -- 172.21.15.49:0/166357874 shutdown_connections 2024-01-22T05:08:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.671+0000 7fb2f7600700 1 --2- 172.21.15.49:0/166357874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb2c805a510 0x7fb2c805c9d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.671+0000 7fb2f7600700 1 --2- 172.21.15.49:0/166357874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2f01582a0 0x7fb2f015bc90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.671+0000 7fb2f7600700 1 --2- 172.21.15.49:0/166357874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2f00c1c50 0x7fb2f00bf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.671+0000 7fb2f7600700 1 --2- 172.21.15.49:0/166357874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f0063df0 0x7fb2f00c1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.671+0000 7fb2f7600700 1 -- 172.21.15.49:0/166357874 >> 172.21.15.49:0/166357874 conn(0x7fb2f00c40f0 msgr2=0x7fb2f00a9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.671+0000 7fb2f7600700 1 -- 172.21.15.49:0/166357874 shutdown_connections 2024-01-22T05:08:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.671+0000 7fb2f7600700 1 -- 172.21.15.49:0/166357874 wait complete. 2024-01-22T05:08:43.693 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:43.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.851+0000 7f1abc200700 1 Processor -- start 2024-01-22T05:08:43.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.851+0000 7f1abc200700 1 -- start start 2024-01-22T05:08:43.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1abc200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ab40c2ff0 0x7f1ab40c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1abc200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1ab40c5330 0x7f1ab40be580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1abc200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab40bd570 con 0x7f1ab40c2c10 2024-01-22T05:08:43.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1abc200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab41542c0 con 0x7f1ab40c5330 2024-01-22T05:08:43.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1abc200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40be0f0 con 0x7f1ab40c2ff0 2024-01-22T05:08:43.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1ab9800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1ab40c2c10 0x7f1ab40c7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36338/0 (socket says 172.21.15.49:36338) 2024-01-22T05:08:43.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1ab9800700 1 -- 172.21.15.49:0/3508736449 learned_addr learned my addr 172.21.15.49:0/3508736449 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:43.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1abac00700 1 --2- 172.21.15.49:0/3508736449 >> v2:172.21.15.110:3300/0 conn(0x7f1ab40c5330 0x7f1ab40be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1ab8e00700 1 --2- 172.21.15.49:0/3508736449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ab40c2ff0 0x7f1ab40c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1ab3e00700 1 -- 172.21.15.49:0/3508736449 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267381645 0 0) 0x7f1ab40bd570 con 0x7f1ab40c2c10 2024-01-22T05:08:43.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1ab3e00700 1 -- 172.21.15.49:0/3508736449 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a940033f0 con 0x7f1ab40c2c10 2024-01-22T05:08:43.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1abac00700 1 -- 172.21.15.49:0/3508736449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ab40c2ff0 msgr2=0x7f1ab40c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:43.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1abac00700 1 --2- 172.21.15.49:0/3508736449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ab40c2ff0 0x7f1ab40c4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1abac00700 1 -- 172.21.15.49:0/3508736449 >> v1:172.21.15.49:6789/0 conn(0x7f1ab40c2c10 legacy=0x7f1ab40c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1abac00700 1 -- 172.21.15.49:0/3508736449 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab40c57c0 con 0x7f1ab40c5330 2024-01-22T05:08:43.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.855+0000 7f1abac00700 1 --2- 172.21.15.49:0/3508736449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab40c5330 0x7f1ab40be580 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f1aac009e60 tx=0x7f1aac009780).ready entity=mon.1 client_cookie=d2af2b5609d2f175 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:43.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.859+0000 7f1ab3e00700 1 -- 172.21.15.49:0/3508736449 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac00e070 con 0x7f1ab40c5330 2024-01-22T05:08:43.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.859+0000 7f1ab3e00700 1 -- 172.21.15.49:0/3508736449 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac00bab0 con 0x7f1ab40c5330 2024-01-22T05:08:43.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.859+0000 7f1ab3e00700 1 -- 172.21.15.49:0/3508736449 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac00be30 con 0x7f1ab40c5330 2024-01-22T05:08:43.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.859+0000 7f1abc200700 1 -- 172.21.15.49:0/3508736449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab40c5330 msgr2=0x7f1ab40be580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.859+0000 7f1abc200700 1 --2- 172.21.15.49:0/3508736449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab40c5330 0x7f1ab40be580 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f1aac009e60 tx=0x7f1aac009780).stop 2024-01-22T05:08:43.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.859+0000 7f1abc200700 1 -- 172.21.15.49:0/3508736449 shutdown_connections 2024-01-22T05:08:43.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.859+0000 7f1abc200700 1 --2- 172.21.15.49:0/3508736449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab40c5330 0x7f1ab40be580 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.859+0000 7f1abc200700 1 --2- 172.21.15.49:0/3508736449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ab40c2ff0 0x7f1ab40c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.859+0000 7f1abc200700 1 -- 172.21.15.49:0/3508736449 >> 172.21.15.49:0/3508736449 conn(0x7f1ab4062a10 msgr2=0x7f1ab4081fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:43.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.859+0000 7f1abc200700 1 -- 172.21.15.49:0/3508736449 shutdown_connections 2024-01-22T05:08:43.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.859+0000 7f1abc200700 1 -- 172.21.15.49:0/3508736449 wait complete. 2024-01-22T05:08:43.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.863+0000 7f1abc200700 1 Processor -- start 2024-01-22T05:08:43.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.863+0000 7f1abc200700 1 -- start start 2024-01-22T05:08:43.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.863+0000 7f1abc200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab40c2c10 0x7f1ab4151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.863+0000 7f1abc200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ab40c2ff0 0x7f1ab40a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.863+0000 7f1abc200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab40c5330 0x7f1ab40c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.863+0000 7f1abc200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40a57c0 con 0x7f1ab40c5330 2024-01-22T05:08:43.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.863+0000 7f1abc200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40aac40 con 0x7f1ab40c2c10 2024-01-22T05:08:43.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.863+0000 7f1abc200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4151830 con 0x7f1ab40c2ff0 2024-01-22T05:08:43.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.863+0000 7f1abac00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab40c5330 0x7f1ab40c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1ab8e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ab40c2ff0 0x7f1ab40a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1abac00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab40c5330 0x7f1ab40c1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48352/0 (socket says 172.21.15.49:48352) 2024-01-22T05:08:43.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1ab9800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab40c2c10 0x7f1ab4151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1abac00700 1 -- 172.21.15.49:0/3768542854 learned_addr learned my addr 172.21.15.49:0/3768542854 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1ab8e00700 1 -- 172.21.15.49:0/3768542854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab40c2c10 msgr2=0x7f1ab4151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1ab8e00700 1 --2- 172.21.15.49:0/3768542854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab40c2c10 0x7f1ab4151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1ab8e00700 1 -- 172.21.15.49:0/3768542854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab40c5330 msgr2=0x7f1ab40c1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1ab8e00700 1 --2- 172.21.15.49:0/3768542854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab40c5330 0x7f1ab40c1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1ab8e00700 1 -- 172.21.15.49:0/3768542854 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac009a20 con 0x7f1ab40c2ff0 2024-01-22T05:08:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1abac00700 1 --2- 172.21.15.49:0/3768542854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab40c5330 0x7f1ab40c1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:43.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1ab8e00700 1 --2- 172.21.15.49:0/3768542854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ab40c2ff0 0x7f1ab40a9d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1a9c00e720 tx=0x7f1a9c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:43.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1ab0c00700 1 -- 172.21.15.49:0/3768542854 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c012600 con 0x7f1ab40c2ff0 2024-01-22T05:08:43.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1ab0c00700 1 -- 172.21.15.49:0/3768542854 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c012760 con 0x7f1ab40c2ff0 2024-01-22T05:08:43.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1ab0c00700 1 -- 172.21.15.49:0/3768542854 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c012ae0 con 0x7f1ab40c2ff0 2024-01-22T05:08:43.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1abc200700 1 -- 172.21.15.49:0/3768542854 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab40aa680 con 0x7f1ab40c2ff0 2024-01-22T05:08:43.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.867+0000 7f1abc200700 1 -- 172.21.15.49:0/3768542854 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab40a5450 con 0x7f1ab40c2ff0 2024-01-22T05:08:43.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.871+0000 7f1abc200700 1 -- 172.21.15.49:0/3768542854 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab4047060 con 0x7f1ab40c2ff0 2024-01-22T05:08:43.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.871+0000 7f1ab0c00700 1 -- 172.21.15.49:0/3768542854 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1a9c01b400 con 0x7f1ab40c2ff0 2024-01-22T05:08:43.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.871+0000 7f1ab0c00700 1 --2- 172.21.15.49:0/3768542854 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a8c05a540 0x7f1a8c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:43.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.871+0000 7f1ab0c00700 1 -- 172.21.15.49:0/3768542854 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1a9c074b30 con 0x7f1ab40c2ff0 2024-01-22T05:08:43.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.871+0000 7f1ab9800700 1 --2- 172.21.15.49:0/3768542854 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a8c05a540 0x7f1a8c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:43.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.871+0000 7f1ab9800700 1 --2- 172.21.15.49:0/3768542854 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a8c05a540 0x7f1a8c05ca00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f1aa4000c00 tx=0x7f1aa4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:43.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:43.883+0000 7f1ab0c00700 1 -- 172.21.15.49:0/3768542854 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1a9c048110 con 0x7f1ab40c2ff0 2024-01-22T05:08:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.083+0000 7f1abc200700 1 -- 172.21.15.49:0/3768542854 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ab4068c60 con 0x7f1ab40c2ff0 2024-01-22T05:08:44.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.083+0000 7f1ab0c00700 1 -- 172.21.15.49:0/3768542854 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f1a9c04b730 con 0x7f1ab40c2ff0 2024-01-22T05:08:44.088 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:44.088 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":47,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:42.141162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:44.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.087+0000 7f1abc200700 1 -- 172.21.15.49:0/3768542854 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a8c05a540 msgr2=0x7f1a8c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:44.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.087+0000 7f1abc200700 1 --2- 172.21.15.49:0/3768542854 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a8c05a540 0x7f1a8c05ca00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f1aa4000c00 tx=0x7f1aa4009040).stop 2024-01-22T05:08:44.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.087+0000 7f1abc200700 1 -- 172.21.15.49:0/3768542854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ab40c2ff0 msgr2=0x7f1ab40a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:44.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.087+0000 7f1abc200700 1 --2- 172.21.15.49:0/3768542854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ab40c2ff0 0x7f1ab40a9d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1a9c00e720 tx=0x7f1a9c009060).stop 2024-01-22T05:08:44.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.087+0000 7f1abc200700 1 -- 172.21.15.49:0/3768542854 shutdown_connections 2024-01-22T05:08:44.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.087+0000 7f1abc200700 1 --2- 172.21.15.49:0/3768542854 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a8c05a540 0x7f1a8c05ca00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.087+0000 7f1abc200700 1 --2- 172.21.15.49:0/3768542854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ab40c5330 0x7f1ab40c1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.087+0000 7f1abc200700 1 --2- 172.21.15.49:0/3768542854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ab40c2ff0 0x7f1ab40a9d10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.087+0000 7f1abc200700 1 --2- 172.21.15.49:0/3768542854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab40c2c10 0x7f1ab4151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.087+0000 7f1abc200700 1 -- 172.21.15.49:0/3768542854 >> 172.21.15.49:0/3768542854 conn(0x7f1ab4062a10 msgr2=0x7f1ab4153210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:44.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.091+0000 7f1abc200700 1 -- 172.21.15.49:0/3768542854 shutdown_connections 2024-01-22T05:08:44.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.091+0000 7f1abc200700 1 -- 172.21.15.49:0/3768542854 wait complete. 2024-01-22T05:08:44.096 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 47 2024-01-22T05:08:44.115 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:08:44.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.271+0000 7f43bde00700 1 Processor -- start 2024-01-22T05:08:44.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.275+0000 7f43bde00700 1 -- start start 2024-01-22T05:08:44.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.275+0000 7f43bde00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f43b8063eb0 0x7f43b8064290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:44.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.275+0000 7f43bde00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43b80c1db0 0x7f43b80c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:44.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.275+0000 7f43bde00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b80c3790 con 0x7f43b815bac0 2024-01-22T05:08:44.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.275+0000 7f43bde00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b80c2b80 con 0x7f43b8063eb0 2024-01-22T05:08:44.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.275+0000 7f43bde00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b80c2e60 con 0x7f43b80c1db0 2024-01-22T05:08:44.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43b6a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f43b8063eb0 0x7f43b8064290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:44.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43b7400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f43b815bac0 0x7f43b815bf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36346/0 (socket says 172.21.15.49:36346) 2024-01-22T05:08:44.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43b7400700 1 -- 172.21.15.49:0/1777503063 learned_addr learned my addr 172.21.15.49:0/1777503063 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:44.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43b6000700 1 --2- 172.21.15.49:0/1777503063 >> v2:172.21.15.110:3300/0 conn(0x7f43b80c1db0 0x7f43b80c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:44.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43b5600700 1 -- 172.21.15.49:0/1777503063 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255011697 0 0) 0x7f43b80c3790 con 0x7f43b815bac0 2024-01-22T05:08:44.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43b5600700 1 -- 172.21.15.49:0/1777503063 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43980033f0 con 0x7f43b815bac0 2024-01-22T05:08:44.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43b6a00700 1 -- 172.21.15.49:0/1777503063 >> v2:172.21.15.110:3300/0 conn(0x7f43b80c1db0 msgr2=0x7f43b80c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:44.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43b6a00700 1 --2- 172.21.15.49:0/1777503063 >> v2:172.21.15.110:3300/0 conn(0x7f43b80c1db0 0x7f43b80c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43b6a00700 1 -- 172.21.15.49:0/1777503063 >> v1:172.21.15.49:6789/0 conn(0x7f43b815bac0 legacy=0x7f43b815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:44.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43b6a00700 1 -- 172.21.15.49:0/1777503063 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b80c3140 con 0x7f43b8063eb0 2024-01-22T05:08:44.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43b6a00700 1 --2- 172.21.15.49:0/1777503063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43b8063eb0 0x7f43b8064290 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f43b80685a0 tx=0x7f43a8009060).ready entity=mon.0 client_cookie=ee9c56177942b02f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:44.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43b5600700 1 -- 172.21.15.49:0/1777503063 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a800d4a0 con 0x7f43b8063eb0 2024-01-22T05:08:44.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43b5600700 1 -- 172.21.15.49:0/1777503063 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a800d600 con 0x7f43b8063eb0 2024-01-22T05:08:44.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43b5600700 1 -- 172.21.15.49:0/1777503063 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a800d980 con 0x7f43b8063eb0 2024-01-22T05:08:44.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43bde00700 1 -- 172.21.15.49:0/1777503063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43b8063eb0 msgr2=0x7f43b8064290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:44.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.279+0000 7f43bde00700 1 --2- 172.21.15.49:0/1777503063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43b8063eb0 0x7f43b8064290 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f43b80685a0 tx=0x7f43a8009060).stop 2024-01-22T05:08:44.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.283+0000 7f43bde00700 1 -- 172.21.15.49:0/1777503063 shutdown_connections 2024-01-22T05:08:44.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.283+0000 7f43bde00700 1 --2- 172.21.15.49:0/1777503063 >> v2:172.21.15.110:3300/0 conn(0x7f43b80c1db0 0x7f43b80c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.283+0000 7f43bde00700 1 --2- 172.21.15.49:0/1777503063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43b8063eb0 0x7f43b8064290 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.283+0000 7f43bde00700 1 -- 172.21.15.49:0/1777503063 >> 172.21.15.49:0/1777503063 conn(0x7f43b80c8120 msgr2=0x7f43b8062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:44.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.283+0000 7f43bde00700 1 -- 172.21.15.49:0/1777503063 shutdown_connections 2024-01-22T05:08:44.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.283+0000 7f43bde00700 1 -- 172.21.15.49:0/1777503063 wait complete. 2024-01-22T05:08:44.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.287+0000 7f43bde00700 1 Processor -- start 2024-01-22T05:08:44.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.287+0000 7f43bde00700 1 -- start start 2024-01-22T05:08:44.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.287+0000 7f43bde00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43b8063eb0 0x7f43b80a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:44.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.287+0000 7f43bde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43b80c1db0 0x7f43b80aa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:44.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.287+0000 7f43bde00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43b815bac0 0x7f43b816c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:44.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.287+0000 7f43bde00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80bf870 con 0x7f43b80c1db0 2024-01-22T05:08:44.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.287+0000 7f43bde00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80bfb50 con 0x7f43b815bac0 2024-01-22T05:08:44.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.287+0000 7f43bde00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80acf70 con 0x7f43b8063eb0 2024-01-22T05:08:44.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.287+0000 7f43b6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43b80c1db0 0x7f43b80aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:44.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.287+0000 7f43b6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43b80c1db0 0x7f43b80aa620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48380/0 (socket says 172.21.15.49:48380) 2024-01-22T05:08:44.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.287+0000 7f43b6000700 1 -- 172.21.15.49:0/3909119348 learned_addr learned my addr 172.21.15.49:0/3909119348 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:44.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.287+0000 7f43b6a00700 1 --2- 172.21.15.49:0/3909119348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43b8063eb0 0x7f43b80a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:44.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.287+0000 7f43b7400700 1 --2- 172.21.15.49:0/3909119348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43b815bac0 0x7f43b816c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:44.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.291+0000 7f43b6000700 1 -- 172.21.15.49:0/3909119348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43b8063eb0 msgr2=0x7f43b80a91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:44.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.291+0000 7f43b6000700 1 --2- 172.21.15.49:0/3909119348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43b8063eb0 0x7f43b80a91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.291+0000 7f43b6000700 1 -- 172.21.15.49:0/3909119348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43b815bac0 msgr2=0x7f43b816c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:44.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.291+0000 7f43b6000700 1 --2- 172.21.15.49:0/3909119348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43b815bac0 0x7f43b816c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.291+0000 7f43b6000700 1 -- 172.21.15.49:0/3909119348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a80092a0 con 0x7f43b80c1db0 2024-01-22T05:08:44.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.291+0000 7f43b6000700 1 --2- 172.21.15.49:0/3909119348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43b80c1db0 0x7f43b80aa620 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f43a000e960 tx=0x7f43a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:44.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.291+0000 7f43ae000700 1 -- 172.21.15.49:0/3909119348 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0012600 con 0x7f43b80c1db0 2024-01-22T05:08:44.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.291+0000 7f43ae000700 1 -- 172.21.15.49:0/3909119348 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a0012760 con 0x7f43b80c1db0 2024-01-22T05:08:44.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.291+0000 7f43bde00700 1 -- 172.21.15.49:0/3909119348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b80ad250 con 0x7f43b80c1db0 2024-01-22T05:08:44.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.291+0000 7f43ae000700 1 -- 172.21.15.49:0/3909119348 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0012ae0 con 0x7f43b80c1db0 2024-01-22T05:08:44.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.291+0000 7f43bde00700 1 -- 172.21.15.49:0/3909119348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b80acc40 con 0x7f43b80c1db0 2024-01-22T05:08:44.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.291+0000 7f43bde00700 1 -- 172.21.15.49:0/3909119348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b8065450 con 0x7f43b80c1db0 2024-01-22T05:08:44.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.295+0000 7f43ae000700 1 -- 172.21.15.49:0/3909119348 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f43a001b400 con 0x7f43b80c1db0 2024-01-22T05:08:44.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.295+0000 7f43ae000700 1 --2- 172.21.15.49:0/3909119348 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f439005a510 0x7f439005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:44.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.295+0000 7f43ae000700 1 -- 172.21.15.49:0/3909119348 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f43a0074e50 con 0x7f43b80c1db0 2024-01-22T05:08:44.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.295+0000 7f43b6a00700 1 --2- 172.21.15.49:0/3909119348 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f439005a510 0x7f439005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:44.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.295+0000 7f43b6a00700 1 --2- 172.21.15.49:0/3909119348 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f439005a510 0x7f439005c9d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f43a800d260 tx=0x7f43a8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:44.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.299+0000 7f43ae000700 1 -- 172.21.15.49:0/3909119348 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f43a0048370 con 0x7f43b80c1db0 2024-01-22T05:08:44.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.471+0000 7f43bde00700 1 -- 172.21.15.49:0/3909119348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43b80c3420 con 0x7f43b80c1db0 2024-01-22T05:08:44.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.471+0000 7f43ae000700 1 -- 172.21.15.49:0/3909119348 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+17260 (secure 0 0 0) 0x7f43a004b990 con 0x7f43b80c1db0 2024-01-22T05:08:44.477 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:44.477 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":58,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:08:24.158652+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:08:00.161271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-22T05:08:00.977775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.23","mappings":[{"from":0,"to":1}]},{"pgid":"8.2f","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:08:44.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.479+0000 7f43bde00700 1 -- 172.21.15.49:0/3909119348 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f439005a510 msgr2=0x7f439005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:44.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.479+0000 7f43bde00700 1 --2- 172.21.15.49:0/3909119348 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f439005a510 0x7f439005c9d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f43a800d260 tx=0x7f43a8016000).stop 2024-01-22T05:08:44.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.479+0000 7f43bde00700 1 -- 172.21.15.49:0/3909119348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43b80c1db0 msgr2=0x7f43b80aa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:44.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.479+0000 7f43bde00700 1 --2- 172.21.15.49:0/3909119348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43b80c1db0 0x7f43b80aa620 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f43a000e960 tx=0x7f43a0009060).stop 2024-01-22T05:08:44.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.479+0000 7f43bde00700 1 -- 172.21.15.49:0/3909119348 shutdown_connections 2024-01-22T05:08:44.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.479+0000 7f43bde00700 1 --2- 172.21.15.49:0/3909119348 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f439005a510 0x7f439005c9d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.479+0000 7f43bde00700 1 --2- 172.21.15.49:0/3909119348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43b815bac0 0x7f43b816c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.479+0000 7f43bde00700 1 --2- 172.21.15.49:0/3909119348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43b80c1db0 0x7f43b80aa620 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.479+0000 7f43bde00700 1 --2- 172.21.15.49:0/3909119348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43b8063eb0 0x7f43b80a91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.479+0000 7f43bde00700 1 -- 172.21.15.49:0/3909119348 >> 172.21.15.49:0/3909119348 conn(0x7f43b80c8120 msgr2=0x7f43b80bc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:44.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.479+0000 7f43bde00700 1 -- 172.21.15.49:0/3909119348 shutdown_connections 2024-01-22T05:08:44.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.479+0000 7f43bde00700 1 -- 172.21.15.49:0/3909119348 wait complete. 2024-01-22T05:08:44.507 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:08:44.507 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:44.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.655+0000 7fd4ca800700 1 Processor -- start 2024-01-22T05:08:44.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.655+0000 7fd4ca800700 1 -- start start 2024-01-22T05:08:44.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.659+0000 7fd4ca800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4c4155d20 0x7fd4c4065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:44.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.659+0000 7fd4ca800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c40c1a40 con 0x7fd4c4066070 2024-01-22T05:08:44.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.659+0000 7fd4ca800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c4159310 con 0x7fd4c40a8e50 2024-01-22T05:08:44.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.659+0000 7fd4ca800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c40c13f0 con 0x7fd4c4155d20 2024-01-22T05:08:44.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.659+0000 7fd4c3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4c4155d20 0x7fd4c4065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:44.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.659+0000 7fd4c2a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd4c4066070 0x7fd4c40a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36360/0 (socket says 172.21.15.49:36360) 2024-01-22T05:08:44.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.659+0000 7fd4c2a00700 1 -- 172.21.15.49:0/1757679755 learned_addr learned my addr 172.21.15.49:0/1757679755 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:44.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.659+0000 7fd4c2000700 1 -- 172.21.15.49:0/1757679755 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940149883 0 0) 0x7fd4c40c1a40 con 0x7fd4c4066070 2024-01-22T05:08:44.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.659+0000 7fd4c3400700 1 -- 172.21.15.49:0/1757679755 >> v1:172.21.15.110:6789/0 conn(0x7fd4c40a8e50 legacy=0x7fd4c40c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:44.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.659+0000 7fd4c3400700 1 -- 172.21.15.49:0/1757679755 >> v1:172.21.15.49:6789/0 conn(0x7fd4c4066070 legacy=0x7fd4c40a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:44.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.659+0000 7fd4c3400700 1 -- 172.21.15.49:0/1757679755 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c40c16d0 con 0x7fd4c4155d20 2024-01-22T05:08:44.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.659+0000 7fd4c3400700 1 --2- 172.21.15.49:0/1757679755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4c4155d20 0x7fd4c4065b80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd4b4009790 tx=0x7fd4b4009060).ready entity=mon.2 client_cookie=7eca2ec51c625fe4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:44.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.663+0000 7fd4c2000700 1 -- 172.21.15.49:0/1757679755 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b400b5a0 con 0x7fd4c4155d20 2024-01-22T05:08:44.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.663+0000 7fd4c2000700 1 -- 172.21.15.49:0/1757679755 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b400b700 con 0x7fd4c4155d20 2024-01-22T05:08:44.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.663+0000 7fd4c2000700 1 -- 172.21.15.49:0/1757679755 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b400ba80 con 0x7fd4c4155d20 2024-01-22T05:08:44.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.663+0000 7fd4ca800700 1 -- 172.21.15.49:0/1757679755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4c4155d20 msgr2=0x7fd4c4065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:44.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.663+0000 7fd4ca800700 1 --2- 172.21.15.49:0/1757679755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4c4155d20 0x7fd4c4065b80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd4b4009790 tx=0x7fd4b4009060).stop 2024-01-22T05:08:44.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.663+0000 7fd4ca800700 1 -- 172.21.15.49:0/1757679755 shutdown_connections 2024-01-22T05:08:44.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.663+0000 7fd4ca800700 1 --2- 172.21.15.49:0/1757679755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4c4155d20 0x7fd4c4065b80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.663+0000 7fd4ca800700 1 -- 172.21.15.49:0/1757679755 >> 172.21.15.49:0/1757679755 conn(0x7fd4c40c6540 msgr2=0x7fd4c40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:44.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.663+0000 7fd4ca800700 1 -- 172.21.15.49:0/1757679755 shutdown_connections 2024-01-22T05:08:44.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.663+0000 7fd4ca800700 1 -- 172.21.15.49:0/1757679755 wait complete. 2024-01-22T05:08:44.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.667+0000 7fd4ca800700 1 Processor -- start 2024-01-22T05:08:44.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.667+0000 7fd4ca800700 1 -- start start 2024-01-22T05:08:44.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4ca800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4c4066070 0x7fd4c4152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:44.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4ca800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4c40a8e50 0x7fd4c41685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:44.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4ca800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4c4155d20 0x7fd4c40be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:44.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4ca800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c40ab1a0 con 0x7fd4c4155d20 2024-01-22T05:08:44.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4ca800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4168e70 con 0x7fd4c40a8e50 2024-01-22T05:08:44.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4ca800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4169150 con 0x7fd4c4066070 2024-01-22T05:08:44.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4c3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4c4155d20 0x7fd4c40be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:44.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4c3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4c4155d20 0x7fd4c40be3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48386/0 (socket says 172.21.15.49:48386) 2024-01-22T05:08:44.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4c3e00700 1 -- 172.21.15.49:0/2750504618 learned_addr learned my addr 172.21.15.49:0/2750504618 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:44.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4c2a00700 1 --2- 172.21.15.49:0/2750504618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4c40a8e50 0x7fd4c41685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:44.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4c3400700 1 --2- 172.21.15.49:0/2750504618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4c4066070 0x7fd4c4152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:44.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4c3e00700 1 -- 172.21.15.49:0/2750504618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4c4066070 msgr2=0x7fd4c4152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:44.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4c3e00700 1 --2- 172.21.15.49:0/2750504618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4c4066070 0x7fd4c4152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4c3e00700 1 -- 172.21.15.49:0/2750504618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4c40a8e50 msgr2=0x7fd4c41685b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:44.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4c3e00700 1 --2- 172.21.15.49:0/2750504618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4c40a8e50 0x7fd4c41685b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4c3e00700 1 -- 172.21.15.49:0/2750504618 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b40092a0 con 0x7fd4c4155d20 2024-01-22T05:08:44.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4c3e00700 1 --2- 172.21.15.49:0/2750504618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4c4155d20 0x7fd4c40be3d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fd4bc002230 tx=0x7fd4bc0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:44.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4baa00700 1 -- 172.21.15.49:0/2750504618 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc00e4a0 con 0x7fd4c4155d20 2024-01-22T05:08:44.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4baa00700 1 -- 172.21.15.49:0/2750504618 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc00e600 con 0x7fd4c4155d20 2024-01-22T05:08:44.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4baa00700 1 -- 172.21.15.49:0/2750504618 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc00e980 con 0x7fd4c4155d20 2024-01-22T05:08:44.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.671+0000 7fd4ca800700 1 -- 172.21.15.49:0/2750504618 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c4169430 con 0x7fd4c4155d20 2024-01-22T05:08:44.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.675+0000 7fd4ca800700 1 -- 172.21.15.49:0/2750504618 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c4153120 con 0x7fd4c4155d20 2024-01-22T05:08:44.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.675+0000 7fd4ca800700 1 -- 172.21.15.49:0/2750504618 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c40ab310 con 0x7fd4c4155d20 2024-01-22T05:08:44.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.675+0000 7fd4baa00700 1 -- 172.21.15.49:0/2750504618 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd4bc01b3b0 con 0x7fd4c4155d20 2024-01-22T05:08:44.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.679+0000 7fd4baa00700 1 --2- 172.21.15.49:0/2750504618 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd49c05a510 0x7fd49c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:44.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.679+0000 7fd4baa00700 1 -- 172.21.15.49:0/2750504618 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd4bc073fe0 con 0x7fd4c4155d20 2024-01-22T05:08:44.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.679+0000 7fd4c3400700 1 --2- 172.21.15.49:0/2750504618 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd49c05a510 0x7fd49c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.679+0000 7fd4c3400700 1 --2- 172.21.15.49:0/2750504618 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd49c05a510 0x7fd49c05c9d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fd4b400b360 tx=0x7fd4b4015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:44.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.687+0000 7fd4baa00700 1 -- 172.21.15.49:0/2750504618 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd4bc0a2b00 con 0x7fd4c4155d20 2024-01-22T05:08:44.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.883+0000 7fd4ca800700 1 -- 172.21.15.49:0/2750504618 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4c4047060 con 0x7fd4c4155d20 2024-01-22T05:08:44.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.883+0000 7fd4baa00700 1 -- 172.21.15.49:0/2750504618 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4493 (secure 0 0 0) 0x7fd4bc047610 con 0x7fd4c4155d20 2024-01-22T05:08:44.887 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:44.888 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":47,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:42.141162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.887+0000 7fd4ca800700 1 -- 172.21.15.49:0/2750504618 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd49c05a510 msgr2=0x7fd49c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.887+0000 7fd4ca800700 1 --2- 172.21.15.49:0/2750504618 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd49c05a510 0x7fd49c05c9d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fd4b400b360 tx=0x7fd4b4015000).stop 2024-01-22T05:08:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.887+0000 7fd4ca800700 1 -- 172.21.15.49:0/2750504618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4c4155d20 msgr2=0x7fd4c40be3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.887+0000 7fd4ca800700 1 --2- 172.21.15.49:0/2750504618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4c4155d20 0x7fd4c40be3d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fd4bc002230 tx=0x7fd4bc0015e0).stop 2024-01-22T05:08:44.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.887+0000 7fd4ca800700 1 -- 172.21.15.49:0/2750504618 shutdown_connections 2024-01-22T05:08:44.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.887+0000 7fd4ca800700 1 --2- 172.21.15.49:0/2750504618 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd49c05a510 0x7fd49c05c9d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.887+0000 7fd4ca800700 1 --2- 172.21.15.49:0/2750504618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4c4155d20 0x7fd4c40be3d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.887+0000 7fd4ca800700 1 --2- 172.21.15.49:0/2750504618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4c40a8e50 0x7fd4c41685b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.887+0000 7fd4ca800700 1 --2- 172.21.15.49:0/2750504618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4c4066070 0x7fd4c4152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:44.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.887+0000 7fd4ca800700 1 -- 172.21.15.49:0/2750504618 >> 172.21.15.49:0/2750504618 conn(0x7fd4c40c6540 msgr2=0x7fd4c41543c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.887+0000 7fd4ca800700 1 -- 172.21.15.49:0/2750504618 shutdown_connections 2024-01-22T05:08:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:44.887+0000 7fd4ca800700 1 -- 172.21.15.49:0/2750504618 wait complete. 2024-01-22T05:08:44.896 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 47 2024-01-22T05:08:44.915 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:45.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.067+0000 7ff439c00700 1 Processor -- start 2024-01-22T05:08:45.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.067+0000 7ff439c00700 1 -- start start 2024-01-22T05:08:45.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff439c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff434155d20 0x7ff434065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff439c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff4340a8e50 0x7ff4340c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff439c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4340c1a40 con 0x7ff434066070 2024-01-22T05:08:45.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff439c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff434159310 con 0x7ff434155d20 2024-01-22T05:08:45.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff439c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4340c13f0 con 0x7ff4340a8e50 2024-01-22T05:08:45.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff432000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff434066070 0x7ff4340a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36370/0 (socket says 172.21.15.49:36370) 2024-01-22T05:08:45.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff432000700 1 -- 172.21.15.49:0/2290547686 learned_addr learned my addr 172.21.15.49:0/2290547686 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:45.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff432a00700 1 --2- 172.21.15.49:0/2290547686 >> v2:172.21.15.49:3300/0 conn(0x7ff434155d20 0x7ff434065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff433400700 1 --2- 172.21.15.49:0/2290547686 >> v2:172.21.15.110:3300/0 conn(0x7ff4340a8e50 0x7ff4340c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff431600700 1 -- 172.21.15.49:0/2290547686 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2630982699 0 0) 0x7ff4340c1a40 con 0x7ff434066070 2024-01-22T05:08:45.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff431600700 1 -- 172.21.15.49:0/2290547686 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4140033f0 con 0x7ff434066070 2024-01-22T05:08:45.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff432a00700 1 -- 172.21.15.49:0/2290547686 >> v2:172.21.15.110:3300/0 conn(0x7ff4340a8e50 msgr2=0x7ff4340c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:45.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff432a00700 1 --2- 172.21.15.49:0/2290547686 >> v2:172.21.15.110:3300/0 conn(0x7ff4340a8e50 0x7ff4340c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff432a00700 1 -- 172.21.15.49:0/2290547686 >> v1:172.21.15.49:6789/0 conn(0x7ff434066070 legacy=0x7ff4340a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff432a00700 1 -- 172.21.15.49:0/2290547686 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4340c16d0 con 0x7ff434155d20 2024-01-22T05:08:45.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff432a00700 1 --2- 172.21.15.49:0/2290547686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff434155d20 0x7ff434065b80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7ff4340c19b0 tx=0x7ff424009060).ready entity=mon.0 client_cookie=dd1ade8229a48c83 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:45.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff431600700 1 -- 172.21.15.49:0/2290547686 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42400f510 con 0x7ff434155d20 2024-01-22T05:08:45.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff431600700 1 -- 172.21.15.49:0/2290547686 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42400f670 con 0x7ff434155d20 2024-01-22T05:08:45.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff431600700 1 -- 172.21.15.49:0/2290547686 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42400f9f0 con 0x7ff434155d20 2024-01-22T05:08:45.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.071+0000 7ff439c00700 1 -- 172.21.15.49:0/2290547686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff434155d20 msgr2=0x7ff434065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.075+0000 7ff439c00700 1 --2- 172.21.15.49:0/2290547686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff434155d20 0x7ff434065b80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7ff4340c19b0 tx=0x7ff424009060).stop 2024-01-22T05:08:45.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.075+0000 7ff439c00700 1 -- 172.21.15.49:0/2290547686 shutdown_connections 2024-01-22T05:08:45.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.075+0000 7ff439c00700 1 --2- 172.21.15.49:0/2290547686 >> v2:172.21.15.110:3300/0 conn(0x7ff4340a8e50 0x7ff4340c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.075+0000 7ff439c00700 1 --2- 172.21.15.49:0/2290547686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff434155d20 0x7ff434065b80 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.075+0000 7ff439c00700 1 -- 172.21.15.49:0/2290547686 >> 172.21.15.49:0/2290547686 conn(0x7ff4340c6540 msgr2=0x7ff4340c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:45.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.075+0000 7ff439c00700 1 -- 172.21.15.49:0/2290547686 shutdown_connections 2024-01-22T05:08:45.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.075+0000 7ff439c00700 1 -- 172.21.15.49:0/2290547686 wait complete. 2024-01-22T05:08:45.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.075+0000 7ff439c00700 1 Processor -- start 2024-01-22T05:08:45.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff439c00700 1 -- start start 2024-01-22T05:08:45.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff439c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff434066070 0x7ff43415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff439c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4340a8e50 0x7ff4340a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff439c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff434155d20 0x7ff4340aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff439c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff434168f20 con 0x7ff434155d20 2024-01-22T05:08:45.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff439c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff434169200 con 0x7ff434066070 2024-01-22T05:08:45.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff439c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4341694e0 con 0x7ff4340a8e50 2024-01-22T05:08:45.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff433400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff434155d20 0x7ff4340aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff433400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff434155d20 0x7ff4340aa3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48410/0 (socket says 172.21.15.49:48410) 2024-01-22T05:08:45.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff433400700 1 -- 172.21.15.49:0/1643946763 learned_addr learned my addr 172.21.15.49:0/1643946763 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:45.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff432000700 1 --2- 172.21.15.49:0/1643946763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4340a8e50 0x7ff4340a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff432a00700 1 --2- 172.21.15.49:0/1643946763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff434066070 0x7ff43415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff433400700 1 -- 172.21.15.49:0/1643946763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4340a8e50 msgr2=0x7ff4340a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff433400700 1 --2- 172.21.15.49:0/1643946763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4340a8e50 0x7ff4340a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff433400700 1 -- 172.21.15.49:0/1643946763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff434066070 msgr2=0x7ff43415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff433400700 1 --2- 172.21.15.49:0/1643946763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff434066070 0x7ff43415b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff433400700 1 -- 172.21.15.49:0/1643946763 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4240092a0 con 0x7ff434155d20 2024-01-22T05:08:45.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.079+0000 7ff433400700 1 --2- 172.21.15.49:0/1643946763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff434155d20 0x7ff4340aa3a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7ff42c007f20 tx=0x7ff42c0098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:45.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.083+0000 7ff42a000700 1 -- 172.21.15.49:0/1643946763 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c00eca0 con 0x7ff434155d20 2024-01-22T05:08:45.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.083+0000 7ff42a000700 1 -- 172.21.15.49:0/1643946763 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c00ee00 con 0x7ff434155d20 2024-01-22T05:08:45.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.083+0000 7ff439c00700 1 -- 172.21.15.49:0/1643946763 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4341697c0 con 0x7ff434155d20 2024-01-22T05:08:45.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.083+0000 7ff42a000700 1 -- 172.21.15.49:0/1643946763 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c014610 con 0x7ff434155d20 2024-01-22T05:08:45.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.083+0000 7ff439c00700 1 -- 172.21.15.49:0/1643946763 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43415b560 con 0x7ff434155d20 2024-01-22T05:08:45.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.083+0000 7ff439c00700 1 -- 172.21.15.49:0/1643946763 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff434064b70 con 0x7ff434155d20 2024-01-22T05:08:45.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.083+0000 7ff42a000700 1 -- 172.21.15.49:0/1643946763 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff42c01d3b0 con 0x7ff434155d20 2024-01-22T05:08:45.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.087+0000 7ff42a000700 1 --2- 172.21.15.49:0/1643946763 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff40c05a510 0x7ff40c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.087+0000 7ff42a000700 1 -- 172.21.15.49:0/1643946763 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff42c074e90 con 0x7ff434155d20 2024-01-22T05:08:45.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.087+0000 7ff432a00700 1 --2- 172.21.15.49:0/1643946763 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff40c05a510 0x7ff40c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.087+0000 7ff432a00700 1 --2- 172.21.15.49:0/1643946763 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff40c05a510 0x7ff40c05c9d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7ff43416c090 tx=0x7ff424017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:45.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.095+0000 7ff42a000700 1 -- 172.21.15.49:0/1643946763 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff434064b70 con 0x7ff434155d20 2024-01-22T05:08:45.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.291+0000 7ff439c00700 1 -- 172.21.15.49:0/1643946763 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff434064b70 con 0x7ff434155d20 2024-01-22T05:08:45.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.291+0000 7ff42a000700 1 -- 172.21.15.49:0/1643946763 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4493 (secure 0 0 0) 0x7ff434064b70 con 0x7ff434155d20 2024-01-22T05:08:45.295 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:45.295 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":47,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:08:01.969356+0000","modified":"2024-01-22T05:08:42.141162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5569},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5569":{"gid":5569,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":13,"addr":"172.21.15.49:6837/3428263289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3428263289},{"type":"v1","addr":"172.21.15.49:6837","nonce":3428263289}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:08:45.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.295+0000 7ff439c00700 1 -- 172.21.15.49:0/1643946763 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff40c05a510 msgr2=0x7ff40c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.295+0000 7ff439c00700 1 --2- 172.21.15.49:0/1643946763 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff40c05a510 0x7ff40c05c9d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7ff43416c090 tx=0x7ff424017000).stop 2024-01-22T05:08:45.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.295+0000 7ff439c00700 1 -- 172.21.15.49:0/1643946763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff434155d20 msgr2=0x7ff4340aa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.295+0000 7ff439c00700 1 --2- 172.21.15.49:0/1643946763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff434155d20 0x7ff4340aa3a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7ff42c007f20 tx=0x7ff42c0098a0).stop 2024-01-22T05:08:45.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.295+0000 7ff439c00700 1 -- 172.21.15.49:0/1643946763 shutdown_connections 2024-01-22T05:08:45.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.295+0000 7ff439c00700 1 --2- 172.21.15.49:0/1643946763 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff40c05a510 0x7ff40c05c9d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.295+0000 7ff439c00700 1 --2- 172.21.15.49:0/1643946763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff434155d20 0x7ff4340aa3a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.295+0000 7ff439c00700 1 --2- 172.21.15.49:0/1643946763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4340a8e50 0x7ff4340a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.295+0000 7ff439c00700 1 --2- 172.21.15.49:0/1643946763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff434066070 0x7ff43415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.295+0000 7ff439c00700 1 -- 172.21.15.49:0/1643946763 >> 172.21.15.49:0/1643946763 conn(0x7ff4340c6540 msgr2=0x7ff434067c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.295+0000 7ff439c00700 1 -- 172.21.15.49:0/1643946763 shutdown_connections 2024-01-22T05:08:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.295+0000 7ff439c00700 1 -- 172.21.15.49:0/1643946763 wait complete. 2024-01-22T05:08:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 47 2024-01-22T05:08:45.324 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:08:45.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.479+0000 7fa1c0200700 1 Processor -- start 2024-01-22T05:08:45.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.479+0000 7fa1c0200700 1 -- start start 2024-01-22T05:08:45.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.483+0000 7fa1c0200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1b80bcc50 0x7fa1b80bd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.483+0000 7fa1c0200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa1b80a8b80 0x7fa1b8154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.483+0000 7fa1c0200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b80bc4d0 con 0x7fa1b80a8740 2024-01-22T05:08:45.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.483+0000 7fa1c0200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b80bc960 con 0x7fa1b80bcc50 2024-01-22T05:08:45.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.483+0000 7fa1c0200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b80bb8c0 con 0x7fa1b80a8b80 2024-01-22T05:08:45.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.483+0000 7fa1bd800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1b80bcc50 0x7fa1b80bd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.483+0000 7fa1bce00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa1b80a8740 0x7fa1b81544a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36376/0 (socket says 172.21.15.49:36376) 2024-01-22T05:08:45.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.483+0000 7fa1bce00700 1 -- 172.21.15.49:0/2151278892 learned_addr learned my addr 172.21.15.49:0/2151278892 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:45.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.483+0000 7fa1be200700 1 --2- 172.21.15.49:0/2151278892 >> v2:172.21.15.110:3300/0 conn(0x7fa1b80a8b80 0x7fa1b8154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.487+0000 7fa1bd800700 1 -- 172.21.15.49:0/2151278892 >> v2:172.21.15.110:3300/0 conn(0x7fa1b80a8b80 msgr2=0x7fa1b8154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:45.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.487+0000 7fa1bd800700 1 --2- 172.21.15.49:0/2151278892 >> v2:172.21.15.110:3300/0 conn(0x7fa1b80a8b80 0x7fa1b8154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.487+0000 7fa1b7e00700 1 -- 172.21.15.49:0/2151278892 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304613579 0 0) 0x7fa1b80bc4d0 con 0x7fa1b80a8740 2024-01-22T05:08:45.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.487+0000 7fa1bd800700 1 -- 172.21.15.49:0/2151278892 >> v1:172.21.15.49:6789/0 conn(0x7fa1b80a8740 legacy=0x7fa1b81544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.487+0000 7fa1bd800700 1 -- 172.21.15.49:0/2151278892 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b80bbba0 con 0x7fa1b80bcc50 2024-01-22T05:08:45.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.487+0000 7fa1bd800700 1 --2- 172.21.15.49:0/2151278892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b80bcc50 0x7fa1b80bd030 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fa1b806c130 tx=0x7fa1a8009060).ready entity=mon.0 client_cookie=83b4d4e99b3b5aa3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:45.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.487+0000 7fa1b7e00700 1 -- 172.21.15.49:0/2151278892 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a800b580 con 0x7fa1b80bcc50 2024-01-22T05:08:45.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.487+0000 7fa1b7e00700 1 -- 172.21.15.49:0/2151278892 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a800b6e0 con 0x7fa1b80bcc50 2024-01-22T05:08:45.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.487+0000 7fa1b7e00700 1 -- 172.21.15.49:0/2151278892 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a800ba60 con 0x7fa1b80bcc50 2024-01-22T05:08:45.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.487+0000 7fa1c0200700 1 -- 172.21.15.49:0/2151278892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b80bcc50 msgr2=0x7fa1b80bd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.487+0000 7fa1c0200700 1 --2- 172.21.15.49:0/2151278892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b80bcc50 0x7fa1b80bd030 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fa1b806c130 tx=0x7fa1a8009060).stop 2024-01-22T05:08:45.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.487+0000 7fa1c0200700 1 -- 172.21.15.49:0/2151278892 shutdown_connections 2024-01-22T05:08:45.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.487+0000 7fa1c0200700 1 --2- 172.21.15.49:0/2151278892 >> v2:172.21.15.110:3300/0 conn(0x7fa1b80a8b80 0x7fa1b8154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.487+0000 7fa1c0200700 1 --2- 172.21.15.49:0/2151278892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b80bcc50 0x7fa1b80bd030 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.487+0000 7fa1c0200700 1 -- 172.21.15.49:0/2151278892 >> 172.21.15.49:0/2151278892 conn(0x7fa1b80c6540 msgr2=0x7fa1b80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:45.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.491+0000 7fa1c0200700 1 -- 172.21.15.49:0/2151278892 shutdown_connections 2024-01-22T05:08:45.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.491+0000 7fa1c0200700 1 -- 172.21.15.49:0/2151278892 wait complete. 2024-01-22T05:08:45.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.491+0000 7fa1c0200700 1 Processor -- start 2024-01-22T05:08:45.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1c0200700 1 -- start start 2024-01-22T05:08:45.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1c0200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b80a8740 0x7fa1b814dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1c0200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1b80a8b80 0x7fa1b8168df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1c0200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b80bcc50 0x7fa1b80c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1c0200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b81516f0 con 0x7fa1b80bcc50 2024-01-22T05:08:45.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1c0200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b8169760 con 0x7fa1b80a8b80 2024-01-22T05:08:45.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1c0200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b8169a40 con 0x7fa1b80a8740 2024-01-22T05:08:45.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1be200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b80bcc50 0x7fa1b80c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1be200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b80bcc50 0x7fa1b80c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48436/0 (socket says 172.21.15.49:48436) 2024-01-22T05:08:45.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1be200700 1 -- 172.21.15.49:0/3838416911 learned_addr learned my addr 172.21.15.49:0/3838416911 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:45.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1bd800700 1 --2- 172.21.15.49:0/3838416911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b80a8740 0x7fa1b814dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1bce00700 1 --2- 172.21.15.49:0/3838416911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1b80a8b80 0x7fa1b8168df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1be200700 1 -- 172.21.15.49:0/3838416911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b80a8740 msgr2=0x7fa1b814dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1be200700 1 --2- 172.21.15.49:0/3838416911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b80a8740 0x7fa1b814dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1be200700 1 -- 172.21.15.49:0/3838416911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1b80a8b80 msgr2=0x7fa1b8168df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1be200700 1 --2- 172.21.15.49:0/3838416911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1b80a8b80 0x7fa1b8168df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1be200700 1 -- 172.21.15.49:0/3838416911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a80092a0 con 0x7fa1b80bcc50 2024-01-22T05:08:45.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.495+0000 7fa1be200700 1 --2- 172.21.15.49:0/3838416911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b80bcc50 0x7fa1b80c4440 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fa1b0009fa0 tx=0x7fa1b0009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.499+0000 7fa1b4c00700 1 -- 172.21.15.49:0/3838416911 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b000ed20 con 0x7fa1b80bcc50 2024-01-22T05:08:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.499+0000 7fa1b4c00700 1 -- 172.21.15.49:0/3838416911 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b000ee80 con 0x7fa1b80bcc50 2024-01-22T05:08:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.499+0000 7fa1c0200700 1 -- 172.21.15.49:0/3838416911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b8151990 con 0x7fa1b80bcc50 2024-01-22T05:08:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.499+0000 7fa1b4c00700 1 -- 172.21.15.49:0/3838416911 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0014610 con 0x7fa1b80bcc50 2024-01-22T05:08:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.499+0000 7fa1c0200700 1 -- 172.21.15.49:0/3838416911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b814e230 con 0x7fa1b80bcc50 2024-01-22T05:08:45.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.499+0000 7fa1c0200700 1 -- 172.21.15.49:0/3838416911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b814e450 con 0x7fa1b80bcc50 2024-01-22T05:08:45.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.503+0000 7fa1b4c00700 1 -- 172.21.15.49:0/3838416911 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa1b001d3b0 con 0x7fa1b80bcc50 2024-01-22T05:08:45.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.503+0000 7fa1b4c00700 1 --2- 172.21.15.49:0/3838416911 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa19005a540 0x7fa19005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.503+0000 7fa1b4c00700 1 -- 172.21.15.49:0/3838416911 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa1b0074eb0 con 0x7fa1b80bcc50 2024-01-22T05:08:45.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.503+0000 7fa1bd800700 1 --2- 172.21.15.49:0/3838416911 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa19005a540 0x7fa19005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.503+0000 7fa1bd800700 1 --2- 172.21.15.49:0/3838416911 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa19005a540 0x7fa19005ca00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fa1a8009fd0 tx=0x7fa1a8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:45.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.507+0000 7fa1b4c00700 1 -- 172.21.15.49:0/3838416911 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa1b814e450 con 0x7fa1b80bcc50 2024-01-22T05:08:45.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.675+0000 7fa1c0200700 1 -- 172.21.15.49:0/3838416911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1b814e450 con 0x7fa1b80bcc50 2024-01-22T05:08:45.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.675+0000 7fa1b4c00700 1 -- 172.21.15.49:0/3838416911 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+17260 (secure 0 0 0) 0x7fa1b814e450 con 0x7fa1b80bcc50 2024-01-22T05:08:45.681 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:45.681 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":58,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:08:24.158652+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:08:00.161271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-22T05:08:00.977775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.23","mappings":[{"from":0,"to":1}]},{"pgid":"8.2f","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:08:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.679+0000 7fa1c0200700 1 -- 172.21.15.49:0/3838416911 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa19005a540 msgr2=0x7fa19005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.679+0000 7fa1c0200700 1 --2- 172.21.15.49:0/3838416911 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa19005a540 0x7fa19005ca00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fa1a8009fd0 tx=0x7fa1a8017000).stop 2024-01-22T05:08:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.679+0000 7fa1c0200700 1 -- 172.21.15.49:0/3838416911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b80bcc50 msgr2=0x7fa1b80c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.679+0000 7fa1c0200700 1 --2- 172.21.15.49:0/3838416911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b80bcc50 0x7fa1b80c4440 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fa1b0009fa0 tx=0x7fa1b0009900).stop 2024-01-22T05:08:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.683+0000 7fa1c0200700 1 -- 172.21.15.49:0/3838416911 shutdown_connections 2024-01-22T05:08:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.683+0000 7fa1c0200700 1 --2- 172.21.15.49:0/3838416911 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa19005a540 0x7fa19005ca00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.683+0000 7fa1c0200700 1 --2- 172.21.15.49:0/3838416911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1b80bcc50 0x7fa1b80c4440 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.683+0000 7fa1c0200700 1 --2- 172.21.15.49:0/3838416911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1b80a8b80 0x7fa1b8168df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.683+0000 7fa1c0200700 1 --2- 172.21.15.49:0/3838416911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b80a8740 0x7fa1b814dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.683+0000 7fa1c0200700 1 -- 172.21.15.49:0/3838416911 >> 172.21.15.49:0/3838416911 conn(0x7fa1b80c6540 msgr2=0x7fa1b80c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.683+0000 7fa1c0200700 1 -- 172.21.15.49:0/3838416911 shutdown_connections 2024-01-22T05:08:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.683+0000 7fa1c0200700 1 -- 172.21.15.49:0/3838416911 wait complete. 2024-01-22T05:08:45.709 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:08:45.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.867+0000 7f7628400700 1 Processor -- start 2024-01-22T05:08:45.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.867+0000 7f7628400700 1 -- start start 2024-01-22T05:08:45.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.871+0000 7f7628400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76200a8740 0x7f76200a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.871+0000 7f7628400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76200c1a40 con 0x7f7620155d20 2024-01-22T05:08:45.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.871+0000 7f7628400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76200a90b0 con 0x7f76200c1ed0 2024-01-22T05:08:45.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.871+0000 7f7628400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7620159310 con 0x7f76200a8740 2024-01-22T05:08:45.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.871+0000 7f7625a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7620155d20 0x7f7620065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36378/0 (socket says 172.21.15.49:36378) 2024-01-22T05:08:45.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.871+0000 7f7625a00700 1 -- 172.21.15.49:0/2314480067 learned_addr learned my addr 172.21.15.49:0/2314480067 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:45.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.871+0000 7f7625000700 1 --2- 172.21.15.49:0/2314480067 >> v2:172.21.15.49:3300/0 conn(0x7f76200a8740 0x7f76200a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.871+0000 7f761fe00700 1 -- 172.21.15.49:0/2314480067 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161768632 0 0) 0x7f76200c1a40 con 0x7f7620155d20 2024-01-22T05:08:45.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.871+0000 7f761fe00700 1 -- 172.21.15.49:0/2314480067 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76000033f0 con 0x7f7620155d20 2024-01-22T05:08:45.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.871+0000 7f761fe00700 1 -- 172.21.15.49:0/2314480067 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749577926 0 0) 0x7f76200a90b0 con 0x7f76200c1ed0 2024-01-22T05:08:45.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.871+0000 7f761fe00700 1 -- 172.21.15.49:0/2314480067 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76200c1a40 con 0x7f76200c1ed0 2024-01-22T05:08:45.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.871+0000 7f7625000700 1 -- 172.21.15.49:0/2314480067 >> v1:172.21.15.110:6789/0 conn(0x7f76200c1ed0 legacy=0x7f76200c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.871+0000 7f7625000700 1 -- 172.21.15.49:0/2314480067 >> v1:172.21.15.49:6789/0 conn(0x7f7620155d20 legacy=0x7f7620065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.871+0000 7f7625000700 1 -- 172.21.15.49:0/2314480067 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76200c13f0 con 0x7f76200a8740 2024-01-22T05:08:45.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.871+0000 7f7625000700 1 --2- 172.21.15.49:0/2314480067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76200a8740 0x7f76200a8bc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f7608009760 tx=0x7f7608009060).ready entity=mon.0 client_cookie=83c7381b094e5b85 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:45.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.875+0000 7f761fe00700 1 -- 172.21.15.49:0/2314480067 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760800d4a0 con 0x7f76200a8740 2024-01-22T05:08:45.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.875+0000 7f761fe00700 1 -- 172.21.15.49:0/2314480067 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760800d600 con 0x7f76200a8740 2024-01-22T05:08:45.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.875+0000 7f761fe00700 1 -- 172.21.15.49:0/2314480067 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760800d980 con 0x7f76200a8740 2024-01-22T05:08:45.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.875+0000 7f7628400700 1 -- 172.21.15.49:0/2314480067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76200a8740 msgr2=0x7f76200a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.875+0000 7f7628400700 1 --2- 172.21.15.49:0/2314480067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76200a8740 0x7f76200a8bc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f7608009760 tx=0x7f7608009060).stop 2024-01-22T05:08:45.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.875+0000 7f7628400700 1 -- 172.21.15.49:0/2314480067 shutdown_connections 2024-01-22T05:08:45.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.875+0000 7f7628400700 1 --2- 172.21.15.49:0/2314480067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76200a8740 0x7f76200a8bc0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.875+0000 7f7628400700 1 -- 172.21.15.49:0/2314480067 >> 172.21.15.49:0/2314480067 conn(0x7f76200c6540 msgr2=0x7f76200c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:45.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.875+0000 7f7628400700 1 -- 172.21.15.49:0/2314480067 shutdown_connections 2024-01-22T05:08:45.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.875+0000 7f7628400700 1 -- 172.21.15.49:0/2314480067 wait complete. 2024-01-22T05:08:45.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.879+0000 7f7628400700 1 Processor -- start 2024-01-22T05:08:45.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.879+0000 7f7628400700 1 -- start start 2024-01-22T05:08:45.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.879+0000 7f7628400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76200a8740 0x7f7620152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.879+0000 7f7628400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76200c1ed0 0x7f76200ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7628400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7620155d20 0x7f76200ab900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7628400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7620152d10 con 0x7f76200c1ed0 2024-01-22T05:08:45.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7628400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7620152ff0 con 0x7f76200a8740 2024-01-22T05:08:45.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7628400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76201532d0 con 0x7f7620155d20 2024-01-22T05:08:45.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7625000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76200c1ed0 0x7f76200ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7625000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76200c1ed0 0x7f76200ab410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48466/0 (socket says 172.21.15.49:48466) 2024-01-22T05:08:45.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7625000700 1 -- 172.21.15.49:0/966968596 learned_addr learned my addr 172.21.15.49:0/966968596 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:45.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7625a00700 1 --2- 172.21.15.49:0/966968596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76200a8740 0x7f7620152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7626400700 1 --2- 172.21.15.49:0/966968596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7620155d20 0x7f76200ab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7625000700 1 -- 172.21.15.49:0/966968596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7620155d20 msgr2=0x7f76200ab900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7625000700 1 --2- 172.21.15.49:0/966968596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7620155d20 0x7f76200ab900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7625000700 1 -- 172.21.15.49:0/966968596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76200a8740 msgr2=0x7f7620152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7625000700 1 --2- 172.21.15.49:0/966968596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76200a8740 0x7f7620152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7625000700 1 -- 172.21.15.49:0/966968596 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76080092a0 con 0x7f76200c1ed0 2024-01-22T05:08:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7625000700 1 --2- 172.21.15.49:0/966968596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76200c1ed0 0x7f76200ab410 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f7620059c60 tx=0x7f7608016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f761cc00700 1 -- 172.21.15.49:0/966968596 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760800dcf0 con 0x7f76200c1ed0 2024-01-22T05:08:45.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f761cc00700 1 -- 172.21.15.49:0/966968596 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760800de50 con 0x7f76200c1ed0 2024-01-22T05:08:45.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7628400700 1 -- 172.21.15.49:0/966968596 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76201535b0 con 0x7f76200c1ed0 2024-01-22T05:08:45.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f761cc00700 1 -- 172.21.15.49:0/966968596 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760801d430 con 0x7f76200c1ed0 2024-01-22T05:08:45.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.883+0000 7f7628400700 1 -- 172.21.15.49:0/966968596 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7620152900 con 0x7f76200c1ed0 2024-01-22T05:08:45.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.887+0000 7f7628400700 1 -- 172.21.15.49:0/966968596 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76200be0f0 con 0x7f76200c1ed0 2024-01-22T05:08:45.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.887+0000 7f761cc00700 1 -- 172.21.15.49:0/966968596 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f760801d7a0 con 0x7f76200c1ed0 2024-01-22T05:08:45.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.887+0000 7f761cc00700 1 --2- 172.21.15.49:0/966968596 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f75f805a510 0x7f75f805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.887+0000 7f761cc00700 1 -- 172.21.15.49:0/966968596 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f76080761a0 con 0x7f76200c1ed0 2024-01-22T05:08:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.887+0000 7f7625a00700 1 --2- 172.21.15.49:0/966968596 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f75f805a510 0x7f75f805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.887+0000 7f7625a00700 1 --2- 172.21.15.49:0/966968596 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f75f805a510 0x7f75f805c9d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7610005750 tx=0x7f7610009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:45.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:45.895+0000 7f761cc00700 1 -- 172.21.15.49:0/966968596 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f76200be0f0 con 0x7f76200c1ed0 2024-01-22T05:08:46.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.091+0000 7f7628400700 1 -- 172.21.15.49:0/966968596 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f76200be0f0 con 0x7f76200c1ed0 2024-01-22T05:08:46.173 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:08:46.171+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:08:46.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.179+0000 7f761cc00700 1 -- 172.21.15.49:0/966968596 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7f76200be0f0 con 0x7f76200c1ed0 2024-01-22T05:08:46.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.183+0000 7f7628400700 1 -- 172.21.15.49:0/966968596 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f75f805a510 msgr2=0x7f75f805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:46.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.183+0000 7f7628400700 1 --2- 172.21.15.49:0/966968596 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f75f805a510 0x7f75f805c9d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7610005750 tx=0x7f7610009040).stop 2024-01-22T05:08:46.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.183+0000 7f7628400700 1 -- 172.21.15.49:0/966968596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76200c1ed0 msgr2=0x7f76200ab410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:46.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.183+0000 7f7628400700 1 --2- 172.21.15.49:0/966968596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76200c1ed0 0x7f76200ab410 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f7620059c60 tx=0x7f7608016000).stop 2024-01-22T05:08:46.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.187+0000 7f7628400700 1 -- 172.21.15.49:0/966968596 shutdown_connections 2024-01-22T05:08:46.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.187+0000 7f7628400700 1 --2- 172.21.15.49:0/966968596 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f75f805a510 0x7f75f805c9d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:46.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.187+0000 7f7628400700 1 --2- 172.21.15.49:0/966968596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7620155d20 0x7f76200ab900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:46.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.187+0000 7f7628400700 1 --2- 172.21.15.49:0/966968596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76200c1ed0 0x7f76200ab410 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:46.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.187+0000 7f7628400700 1 --2- 172.21.15.49:0/966968596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76200a8740 0x7f7620152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:46.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.187+0000 7f7628400700 1 -- 172.21.15.49:0/966968596 >> 172.21.15.49:0/966968596 conn(0x7f76200c6540 msgr2=0x7f7620066fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:46.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.187+0000 7f7628400700 1 -- 172.21.15.49:0/966968596 shutdown_connections 2024-01-22T05:08:46.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.187+0000 7f7628400700 1 -- 172.21.15.49:0/966968596 wait complete. 2024-01-22T05:08:46.193 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:08:46.210 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:08:46.267 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:08:46.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.367+0000 7f53ef400700 1 Processor -- start 2024-01-22T05:08:46.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.367+0000 7f53ef400700 1 -- start start 2024-01-22T05:08:46.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.371+0000 7f53ef400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f53e8153960 0x7f53e8153d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:46.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.371+0000 7f53ef400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f53e80bcf70 0x7f53e80bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:46.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.371+0000 7f53ef400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e8069710 con 0x7f53e8063d10 2024-01-22T05:08:46.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.371+0000 7f53ef400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e8068880 con 0x7f53e8153960 2024-01-22T05:08:46.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.371+0000 7f53ef400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e80bd8f0 con 0x7f53e80bcf70 2024-01-22T05:08:46.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.371+0000 7f53e7e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f53e8063d10 0x7f53e8064110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36382/0 (socket says 172.21.15.49:36382) 2024-01-22T05:08:46.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.371+0000 7f53e7e00700 1 -- 172.21.15.49:0/4029759711 learned_addr learned my addr 172.21.15.49:0/4029759711 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:46.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.371+0000 7f53eca00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f53e8153960 0x7f53e8153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:46.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.371+0000 7f53ed400700 1 --2- 172.21.15.49:0/4029759711 >> v2:172.21.15.110:3300/0 conn(0x7f53e80bcf70 0x7f53e80bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:46.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.371+0000 7f53e7400700 1 -- 172.21.15.49:0/4029759711 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626916532 0 0) 0x7f53e8069710 con 0x7f53e8063d10 2024-01-22T05:08:46.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.371+0000 7f53e7400700 1 -- 172.21.15.49:0/4029759711 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53c80033f0 con 0x7f53e8063d10 2024-01-22T05:08:46.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53eca00700 1 -- 172.21.15.49:0/4029759711 >> v2:172.21.15.110:3300/0 conn(0x7f53e80bcf70 msgr2=0x7f53e80bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:46.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53eca00700 1 --2- 172.21.15.49:0/4029759711 >> v2:172.21.15.110:3300/0 conn(0x7f53e80bcf70 0x7f53e80bd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:46.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53eca00700 1 -- 172.21.15.49:0/4029759711 >> v1:172.21.15.49:6789/0 conn(0x7f53e8063d10 legacy=0x7f53e8064110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:46.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53eca00700 1 -- 172.21.15.49:0/4029759711 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e8068b00 con 0x7f53e8153960 2024-01-22T05:08:46.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53ed400700 1 --2- 172.21.15.49:0/4029759711 >> v2:172.21.15.110:3300/0 conn(0x7f53e80bcf70 0x7f53e80bd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:46.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53eca00700 1 --2- 172.21.15.49:0/4029759711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53e8153960 0x7f53e8153d40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f53e8066690 tx=0x7f53d8009060).ready entity=mon.0 client_cookie=a43a8140690fd225 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:46.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53e7400700 1 -- 172.21.15.49:0/4029759711 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d800d4a0 con 0x7f53e8153960 2024-01-22T05:08:46.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53e7400700 1 -- 172.21.15.49:0/4029759711 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d800d600 con 0x7f53e8153960 2024-01-22T05:08:46.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53e7400700 1 -- 172.21.15.49:0/4029759711 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d800d980 con 0x7f53e8153960 2024-01-22T05:08:46.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53ef400700 1 -- 172.21.15.49:0/4029759711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53e8153960 msgr2=0x7f53e8153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:46.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53ef400700 1 --2- 172.21.15.49:0/4029759711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53e8153960 0x7f53e8153d40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f53e8066690 tx=0x7f53d8009060).stop 2024-01-22T05:08:46.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53ef400700 1 -- 172.21.15.49:0/4029759711 shutdown_connections 2024-01-22T05:08:46.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53ef400700 1 --2- 172.21.15.49:0/4029759711 >> v2:172.21.15.110:3300/0 conn(0x7f53e80bcf70 0x7f53e80bd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:46.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53ef400700 1 --2- 172.21.15.49:0/4029759711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53e8153960 0x7f53e8153d40 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:46.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53ef400700 1 -- 172.21.15.49:0/4029759711 >> 172.21.15.49:0/4029759711 conn(0x7f53e8062720 msgr2=0x7f53e8062b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:46.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53ef400700 1 -- 172.21.15.49:0/4029759711 shutdown_connections 2024-01-22T05:08:46.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.375+0000 7f53ef400700 1 -- 172.21.15.49:0/4029759711 wait complete. 2024-01-22T05:08:46.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.379+0000 7f53ef400700 1 Processor -- start 2024-01-22T05:08:46.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.379+0000 7f53ef400700 1 -- start start 2024-01-22T05:08:46.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.379+0000 7f53ef400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53e8063d10 0x7f53e81579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:46.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.379+0000 7f53ef400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53e80bcf70 0x7f53e813faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:46.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.379+0000 7f53ef400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53e8153960 0x7f53e813ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:46.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.379+0000 7f53ef400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e81404d0 con 0x7f53e8153960 2024-01-22T05:08:46.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.379+0000 7f53ef400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e81554f0 con 0x7f53e80bcf70 2024-01-22T05:08:46.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.379+0000 7f53ef400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e8155860 con 0x7f53e8063d10 2024-01-22T05:08:46.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53ed400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53e8153960 0x7f53e813ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:46.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53ed400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53e8153960 0x7f53e813ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48500/0 (socket says 172.21.15.49:48500) 2024-01-22T05:08:46.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53ed400700 1 -- 172.21.15.49:0/1045954334 learned_addr learned my addr 172.21.15.49:0/1045954334 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:46.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53e7e00700 1 --2- 172.21.15.49:0/1045954334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53e80bcf70 0x7f53e813faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:46.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53eca00700 1 --2- 172.21.15.49:0/1045954334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53e8063d10 0x7f53e81579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:46.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53ed400700 1 -- 172.21.15.49:0/1045954334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53e8063d10 msgr2=0x7f53e81579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:46.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53ed400700 1 --2- 172.21.15.49:0/1045954334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53e8063d10 0x7f53e81579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:46.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53ed400700 1 -- 172.21.15.49:0/1045954334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53e80bcf70 msgr2=0x7f53e813faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:46.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53ed400700 1 --2- 172.21.15.49:0/1045954334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53e80bcf70 0x7f53e813faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:46.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53ed400700 1 -- 172.21.15.49:0/1045954334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e0009a20 con 0x7f53e8153960 2024-01-22T05:08:46.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53ed400700 1 --2- 172.21.15.49:0/1045954334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53e8153960 0x7f53e813ffe0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f53e0009fc0 tx=0x7f53e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:46.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53dfe00700 1 -- 172.21.15.49:0/1045954334 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e000cd30 con 0x7f53e8153960 2024-01-22T05:08:46.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53dfe00700 1 -- 172.21.15.49:0/1045954334 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e000f040 con 0x7f53e8153960 2024-01-22T05:08:46.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53ef400700 1 -- 172.21.15.49:0/1045954334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d80092a0 con 0x7f53e8153960 2024-01-22T05:08:46.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53dfe00700 1 -- 172.21.15.49:0/1045954334 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e0013610 con 0x7f53e8153960 2024-01-22T05:08:46.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53ef400700 1 -- 172.21.15.49:0/1045954334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e8155e20 con 0x7f53e8153960 2024-01-22T05:08:46.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53dfe00700 1 -- 172.21.15.49:0/1045954334 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f53e0013a00 con 0x7f53e8153960 2024-01-22T05:08:46.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.383+0000 7f53ef400700 1 -- 172.21.15.49:0/1045954334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e8065940 con 0x7f53e8153960 2024-01-22T05:08:46.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.387+0000 7f53dfe00700 1 --2- 172.21.15.49:0/1045954334 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53c005a540 0x7f53c005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:46.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.387+0000 7f53dfe00700 1 -- 172.21.15.49:0/1045954334 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f53e00754c0 con 0x7f53e8153960 2024-01-22T05:08:46.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.387+0000 7f53eca00700 1 --2- 172.21.15.49:0/1045954334 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53c005a540 0x7f53c005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:46.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.387+0000 7f53eca00700 1 --2- 172.21.15.49:0/1045954334 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53c005a540 0x7f53c005ca00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f53d8009fd0 tx=0x7f53d8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:46.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.395+0000 7f53dfe00700 1 -- 172.21.15.49:0/1045954334 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f53e00489f0 con 0x7f53e8153960 2024-01-22T05:08:46.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:46.595+0000 7f53ef400700 1 -- 172.21.15.49:0/1045954334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f53e8068de0 con 0x7f53e8153960 2024-01-22T05:08:47.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.187+0000 7f53dfe00700 1 -- 172.21.15.49:0/1045954334 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7f53e0013cb0 con 0x7f53e8153960 2024-01-22T05:08:47.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.191+0000 7f53ef400700 1 -- 172.21.15.49:0/1045954334 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53c005a540 msgr2=0x7f53c005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:47.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.191+0000 7f53ef400700 1 --2- 172.21.15.49:0/1045954334 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53c005a540 0x7f53c005ca00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f53d8009fd0 tx=0x7f53d8016000).stop 2024-01-22T05:08:47.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.191+0000 7f53ef400700 1 -- 172.21.15.49:0/1045954334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53e8153960 msgr2=0x7f53e813ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:47.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.191+0000 7f53ef400700 1 --2- 172.21.15.49:0/1045954334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53e8153960 0x7f53e813ffe0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f53e0009fc0 tx=0x7f53e000b040).stop 2024-01-22T05:08:47.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.191+0000 7f53ef400700 1 -- 172.21.15.49:0/1045954334 shutdown_connections 2024-01-22T05:08:47.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.191+0000 7f53ef400700 1 --2- 172.21.15.49:0/1045954334 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53c005a540 0x7f53c005ca00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:47.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.191+0000 7f53ef400700 1 --2- 172.21.15.49:0/1045954334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53e8153960 0x7f53e813ffe0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:47.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.191+0000 7f53ef400700 1 --2- 172.21.15.49:0/1045954334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53e80bcf70 0x7f53e813faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:47.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.191+0000 7f53ef400700 1 --2- 172.21.15.49:0/1045954334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53e8063d10 0x7f53e81579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:47.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.191+0000 7f53ef400700 1 -- 172.21.15.49:0/1045954334 >> 172.21.15.49:0/1045954334 conn(0x7f53e8062720 msgr2=0x7f53e80abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:47.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.191+0000 7f53ef400700 1 -- 172.21.15.49:0/1045954334 shutdown_connections 2024-01-22T05:08:47.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.195+0000 7f53ef400700 1 -- 172.21.15.49:0/1045954334 wait complete. 2024-01-22T05:08:47.221 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:08:47.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.379+0000 7fa56d600700 1 Processor -- start 2024-01-22T05:08:47.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.379+0000 7fa56d600700 1 -- start start 2024-01-22T05:08:47.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.383+0000 7fa56d600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa568066690 0x7fa568066af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:47.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.383+0000 7fa56d600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5680a7cb0 con 0x7fa5680ac3b0 2024-01-22T05:08:47.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.383+0000 7fa56d600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5680a8b10 con 0x7fa56815fbc0 2024-01-22T05:08:47.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.383+0000 7fa56d600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5680a7f00 con 0x7fa568066690 2024-01-22T05:08:47.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.383+0000 7fa566000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa568066690 0x7fa568066af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:47.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.383+0000 7fa566000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa568066690 0x7fa568066af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48516/0 (socket says 172.21.15.49:48516) 2024-01-22T05:08:47.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.383+0000 7fa566000700 1 -- 172.21.15.49:0/2570543816 learned_addr learned my addr 172.21.15.49:0/2570543816 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:47.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.383+0000 7fa566000700 1 -- 172.21.15.49:0/2570543816 >> v1:172.21.15.110:6789/0 conn(0x7fa56815fbc0 legacy=0x7fa568161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:47.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.383+0000 7fa566000700 1 -- 172.21.15.49:0/2570543816 >> v1:172.21.15.49:6789/0 conn(0x7fa5680ac3b0 legacy=0x7fa568159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:47.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.383+0000 7fa566000700 1 -- 172.21.15.49:0/2570543816 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5680a81e0 con 0x7fa568066690 2024-01-22T05:08:47.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.383+0000 7fa566000700 1 --2- 172.21.15.49:0/2570543816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa568066690 0x7fa568066af0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fa550006fd0 tx=0x7fa5500090f0).ready entity=mon.0 client_cookie=96bc1eed5636df50 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:47.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.383+0000 7fa565600700 1 -- 172.21.15.49:0/2570543816 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55000b600 con 0x7fa568066690 2024-01-22T05:08:47.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.383+0000 7fa565600700 1 -- 172.21.15.49:0/2570543816 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55000b760 con 0x7fa568066690 2024-01-22T05:08:47.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.383+0000 7fa565600700 1 -- 172.21.15.49:0/2570543816 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55000bae0 con 0x7fa568066690 2024-01-22T05:08:47.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.387+0000 7fa56d600700 1 -- 172.21.15.49:0/2570543816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa568066690 msgr2=0x7fa568066af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.387+0000 7fa56d600700 1 --2- 172.21.15.49:0/2570543816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa568066690 0x7fa568066af0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fa550006fd0 tx=0x7fa5500090f0).stop 2024-01-22T05:08:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.387+0000 7fa56d600700 1 -- 172.21.15.49:0/2570543816 shutdown_connections 2024-01-22T05:08:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.387+0000 7fa56d600700 1 --2- 172.21.15.49:0/2570543816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa568066690 0x7fa568066af0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.387+0000 7fa56d600700 1 -- 172.21.15.49:0/2570543816 >> 172.21.15.49:0/2570543816 conn(0x7fa5680c6500 msgr2=0x7fa5680c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:47.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.387+0000 7fa56d600700 1 -- 172.21.15.49:0/2570543816 shutdown_connections 2024-01-22T05:08:47.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.387+0000 7fa56d600700 1 -- 172.21.15.49:0/2570543816 wait complete. 2024-01-22T05:08:47.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.391+0000 7fa56d600700 1 Processor -- start 2024-01-22T05:08:47.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.391+0000 7fa56d600700 1 -- start start 2024-01-22T05:08:47.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.391+0000 7fa56d600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa568066690 0x7fa568147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:47.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.391+0000 7fa56d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680ac3b0 0x7fa568147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:47.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.391+0000 7fa56d600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa56815fbc0 0x7fa568149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:47.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.391+0000 7fa56d600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56814b590 con 0x7fa5680ac3b0 2024-01-22T05:08:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.391+0000 7fa56d600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56814b7a0 con 0x7fa56815fbc0 2024-01-22T05:08:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.391+0000 7fa56d600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680c4dd0 con 0x7fa568066690 2024-01-22T05:08:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.391+0000 7fa566000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680ac3b0 0x7fa568147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:47.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.391+0000 7fa566000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680ac3b0 0x7fa568147c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48518/0 (socket says 172.21.15.49:48518) 2024-01-22T05:08:47.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.391+0000 7fa566000700 1 -- 172.21.15.49:0/3707964885 learned_addr learned my addr 172.21.15.49:0/3707964885 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:47.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.391+0000 7fa566a00700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa568066690 0x7fa568147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:47.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.391+0000 7fa567400700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa56815fbc0 0x7fa568149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:47.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.395+0000 7fa566000700 1 -- 172.21.15.49:0/3707964885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa568066690 msgr2=0x7fa568147440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:47.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.395+0000 7fa566000700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa568066690 0x7fa568147440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:47.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.395+0000 7fa566000700 1 -- 172.21.15.49:0/3707964885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa56815fbc0 msgr2=0x7fa568149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:47.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.395+0000 7fa566000700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa56815fbc0 0x7fa568149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:47.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.395+0000 7fa566000700 1 -- 172.21.15.49:0/3707964885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa550009370 con 0x7fa5680ac3b0 2024-01-22T05:08:47.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.395+0000 7fa567400700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa56815fbc0 0x7fa568149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:47.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.395+0000 7fa566a00700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa568066690 0x7fa568147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:47.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.395+0000 7fa566000700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680ac3b0 0x7fa568147c00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fa550009f50 tx=0x7fa550017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:47.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.395+0000 7fa55e000700 1 -- 172.21.15.49:0/3707964885 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55000bae0 con 0x7fa5680ac3b0 2024-01-22T05:08:47.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.395+0000 7fa55e000700 1 -- 172.21.15.49:0/3707964885 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa550000c90 con 0x7fa5680ac3b0 2024-01-22T05:08:47.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.395+0000 7fa56d600700 1 -- 172.21.15.49:0/3707964885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa568150cd0 con 0x7fa5680ac3b0 2024-01-22T05:08:47.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.395+0000 7fa55e000700 1 -- 172.21.15.49:0/3707964885 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55001b640 con 0x7fa5680ac3b0 2024-01-22T05:08:47.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.395+0000 7fa56d600700 1 -- 172.21.15.49:0/3707964885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5680c5340 con 0x7fa5680ac3b0 2024-01-22T05:08:47.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.395+0000 7fa56d600700 1 -- 172.21.15.49:0/3707964885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56814b970 con 0x7fa5680ac3b0 2024-01-22T05:08:47.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.395+0000 7fa55e000700 1 -- 172.21.15.49:0/3707964885 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa55001b9b0 con 0x7fa5680ac3b0 2024-01-22T05:08:47.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.399+0000 7fa55e000700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa54005a510 0x7fa54005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:47.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.399+0000 7fa55e000700 1 -- 172.21.15.49:0/3707964885 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fa550076560 con 0x7fa5680ac3b0 2024-01-22T05:08:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.399+0000 7fa566a00700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa54005a510 0x7fa54005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.399+0000 7fa566a00700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa54005a510 0x7fa54005c9d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fa568059340 tx=0x7fa558009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.403+0000 7fa55e000700 1 -- 172.21.15.49:0/3707964885 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa56814b970 con 0x7fa5680ac3b0 2024-01-22T05:08:47.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:47.571+0000 7fa56d600700 1 -- 172.21.15.49:0/3707964885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa56814b970 con 0x7fa5680ac3b0 2024-01-22T05:08:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.195+0000 7fa55e000700 1 -- 172.21.15.49:0/3707964885 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa56814b970 con 0x7fa5680ac3b0 2024-01-22T05:08:48.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.199+0000 7fa56d600700 1 -- 172.21.15.49:0/3707964885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa54005a510 msgr2=0x7fa54005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:48.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.199+0000 7fa56d600700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa54005a510 0x7fa54005c9d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fa568059340 tx=0x7fa558009040).stop 2024-01-22T05:08:48.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.199+0000 7fa56d600700 1 -- 172.21.15.49:0/3707964885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680ac3b0 msgr2=0x7fa568147c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:48.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.199+0000 7fa56d600700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680ac3b0 0x7fa568147c00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fa550009f50 tx=0x7fa550017000).stop 2024-01-22T05:08:48.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.203+0000 7fa56d600700 1 -- 172.21.15.49:0/3707964885 shutdown_connections 2024-01-22T05:08:48.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.203+0000 7fa56d600700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa54005a510 0x7fa54005c9d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:48.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.203+0000 7fa56d600700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa56815fbc0 0x7fa568149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:48.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.203+0000 7fa56d600700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680ac3b0 0x7fa568147c00 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:48.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.203+0000 7fa56d600700 1 --2- 172.21.15.49:0/3707964885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa568066690 0x7fa568147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:48.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.203+0000 7fa56d600700 1 -- 172.21.15.49:0/3707964885 >> 172.21.15.49:0/3707964885 conn(0x7fa5680c6500 msgr2=0x7fa568066a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:48.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.203+0000 7fa56d600700 1 -- 172.21.15.49:0/3707964885 shutdown_connections 2024-01-22T05:08:48.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.203+0000 7fa56d600700 1 -- 172.21.15.49:0/3707964885 wait complete. 2024-01-22T05:08:48.209 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:08:48.230 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:08:48.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.391+0000 7fe089e00700 1 Processor -- start 2024-01-22T05:08:48.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.395+0000 7fe089e00700 1 -- start start 2024-01-22T05:08:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.395+0000 7fe089e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe084156260 0x7fe0840c2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.395+0000 7fe089e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe0840ab890 0x7fe0840abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.395+0000 7fe089e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe084066d80 con 0x7fe0840c2b40 2024-01-22T05:08:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.395+0000 7fe089e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0840675e0 con 0x7fe0840ab890 2024-01-22T05:08:48.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.395+0000 7fe089e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0840ac1b0 con 0x7fe084156260 2024-01-22T05:08:48.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.395+0000 7fe083400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe0840ab890 0x7fe0840abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:48.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.395+0000 7fe082000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe0840c2b40 0x7fe0841516a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36398/0 (socket says 172.21.15.49:36398) 2024-01-22T05:08:48.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.395+0000 7fe082000700 1 -- 172.21.15.49:0/715012395 learned_addr learned my addr 172.21.15.49:0/715012395 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:48.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.399+0000 7fe082a00700 1 --2- 172.21.15.49:0/715012395 >> v2:172.21.15.110:3300/0 conn(0x7fe084156260 0x7fe0840c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:48.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.399+0000 7fe083400700 1 -- 172.21.15.49:0/715012395 >> v2:172.21.15.110:3300/0 conn(0x7fe084156260 msgr2=0x7fe0840c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:48.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.399+0000 7fe083400700 1 --2- 172.21.15.49:0/715012395 >> v2:172.21.15.110:3300/0 conn(0x7fe084156260 0x7fe0840c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:48.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.399+0000 7fe083400700 1 -- 172.21.15.49:0/715012395 >> v1:172.21.15.49:6789/0 conn(0x7fe0840c2b40 legacy=0x7fe0841516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:48.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.399+0000 7fe083400700 1 -- 172.21.15.49:0/715012395 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe084067020 con 0x7fe0840ab890 2024-01-22T05:08:48.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.399+0000 7fe083400700 1 --2- 172.21.15.49:0/715012395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0840ab890 0x7fe0840abcc0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fe084064350 tx=0x7fe07c009780).ready entity=mon.0 client_cookie=9606b278cb47b30 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:48.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.399+0000 7fe081600700 1 -- 172.21.15.49:0/715012395 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c00e070 con 0x7fe0840ab890 2024-01-22T05:08:48.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.399+0000 7fe081600700 1 -- 172.21.15.49:0/715012395 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c00bc30 con 0x7fe0840ab890 2024-01-22T05:08:48.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.399+0000 7fe081600700 1 -- 172.21.15.49:0/715012395 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c012410 con 0x7fe0840ab890 2024-01-22T05:08:48.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.399+0000 7fe089e00700 1 -- 172.21.15.49:0/715012395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0840ab890 msgr2=0x7fe0840abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:48.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.399+0000 7fe089e00700 1 --2- 172.21.15.49:0/715012395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0840ab890 0x7fe0840abcc0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fe084064350 tx=0x7fe07c009780).stop 2024-01-22T05:08:48.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.399+0000 7fe089e00700 1 -- 172.21.15.49:0/715012395 shutdown_connections 2024-01-22T05:08:48.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.399+0000 7fe089e00700 1 --2- 172.21.15.49:0/715012395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0840ab890 0x7fe0840abcc0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:48.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.399+0000 7fe089e00700 1 --2- 172.21.15.49:0/715012395 >> v2:172.21.15.110:3300/0 conn(0x7fe084156260 0x7fe0840c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:48.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.399+0000 7fe089e00700 1 -- 172.21.15.49:0/715012395 >> 172.21.15.49:0/715012395 conn(0x7fe0840c6500 msgr2=0x7fe0840c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:48.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.403+0000 7fe089e00700 1 -- 172.21.15.49:0/715012395 shutdown_connections 2024-01-22T05:08:48.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.403+0000 7fe089e00700 1 -- 172.21.15.49:0/715012395 wait complete. 2024-01-22T05:08:48.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.403+0000 7fe089e00700 1 Processor -- start 2024-01-22T05:08:48.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.407+0000 7fe089e00700 1 -- start start 2024-01-22T05:08:48.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.407+0000 7fe089e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0840ab890 0x7fe08414a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:48.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.407+0000 7fe089e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0840c2b40 0x7fe084146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:48.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.407+0000 7fe089e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe084156260 0x7fe08416c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:48.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.407+0000 7fe089e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08416c400 con 0x7fe084156260 2024-01-22T05:08:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.407+0000 7fe089e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe084146550 con 0x7fe0840ab890 2024-01-22T05:08:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.407+0000 7fe089e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08414c840 con 0x7fe0840c2b40 2024-01-22T05:08:48.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.407+0000 7fe083400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe084156260 0x7fe08416c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:48.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.407+0000 7fe083400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe084156260 0x7fe08416c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48530/0 (socket says 172.21.15.49:48530) 2024-01-22T05:08:48.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.407+0000 7fe083400700 1 -- 172.21.15.49:0/2785220733 learned_addr learned my addr 172.21.15.49:0/2785220733 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:48.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.407+0000 7fe082a00700 1 --2- 172.21.15.49:0/2785220733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0840ab890 0x7fe08414a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:48.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.407+0000 7fe082000700 1 --2- 172.21.15.49:0/2785220733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0840c2b40 0x7fe084146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.411+0000 7fe083400700 1 -- 172.21.15.49:0/2785220733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0840c2b40 msgr2=0x7fe084146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.411+0000 7fe083400700 1 --2- 172.21.15.49:0/2785220733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0840c2b40 0x7fe084146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.411+0000 7fe083400700 1 -- 172.21.15.49:0/2785220733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0840ab890 msgr2=0x7fe08414a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.411+0000 7fe083400700 1 --2- 172.21.15.49:0/2785220733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0840ab890 0x7fe08414a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.411+0000 7fe083400700 1 -- 172.21.15.49:0/2785220733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c009a20 con 0x7fe084156260 2024-01-22T05:08:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.411+0000 7fe082a00700 1 --2- 172.21.15.49:0/2785220733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0840ab890 0x7fe08414a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.411+0000 7fe083400700 1 --2- 172.21.15.49:0/2785220733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe084156260 0x7fe08416c890 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fe084064d80 tx=0x7fe07c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:48.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.411+0000 7fe07a000700 1 -- 172.21.15.49:0/2785220733 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0116d0 con 0x7fe084156260 2024-01-22T05:08:48.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.411+0000 7fe07a000700 1 -- 172.21.15.49:0/2785220733 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c011830 con 0x7fe084156260 2024-01-22T05:08:48.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.411+0000 7fe089e00700 1 -- 172.21.15.49:0/2785220733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08414c280 con 0x7fe084156260 2024-01-22T05:08:48.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.411+0000 7fe07a000700 1 -- 172.21.15.49:0/2785220733 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c011bd0 con 0x7fe084156260 2024-01-22T05:08:48.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.411+0000 7fe089e00700 1 -- 172.21.15.49:0/2785220733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08416c090 con 0x7fe084156260 2024-01-22T05:08:48.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.411+0000 7fe089e00700 1 -- 172.21.15.49:0/2785220733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08416c570 con 0x7fe084156260 2024-01-22T05:08:48.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.415+0000 7fe07a000700 1 -- 172.21.15.49:0/2785220733 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe07c003040 con 0x7fe084156260 2024-01-22T05:08:48.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.415+0000 7fe07a000700 1 --2- 172.21.15.49:0/2785220733 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05c05a510 0x7fe05c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:48.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.415+0000 7fe07a000700 1 -- 172.21.15.49:0/2785220733 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6122+0+0 (secure 0 0 0) 0x7fe07c076770 con 0x7fe084156260 2024-01-22T05:08:48.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.415+0000 7fe082a00700 1 --2- 172.21.15.49:0/2785220733 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05c05a510 0x7fe05c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:48.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.415+0000 7fe082a00700 1 --2- 172.21.15.49:0/2785220733 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05c05a510 0x7fe05c05c9d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fe074006fd0 tx=0x7fe074008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:48.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.423+0000 7fe07a000700 1 -- 172.21.15.49:0/2785220733 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe07c049e70 con 0x7fe084156260 2024-01-22T05:08:48.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:48.595+0000 7fe089e00700 1 -- 172.21.15.49:0/2785220733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe0840c0ba0 con 0x7fe084156260 2024-01-22T05:08:49.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.203+0000 7fe07a000700 1 -- 172.21.15.49:0/2785220733 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe07c04d490 con 0x7fe084156260 2024-01-22T05:08:49.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.207+0000 7fe089e00700 1 -- 172.21.15.49:0/2785220733 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05c05a510 msgr2=0x7fe05c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:49.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.207+0000 7fe089e00700 1 --2- 172.21.15.49:0/2785220733 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05c05a510 0x7fe05c05c9d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fe074006fd0 tx=0x7fe074008040).stop 2024-01-22T05:08:49.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.207+0000 7fe089e00700 1 -- 172.21.15.49:0/2785220733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe084156260 msgr2=0x7fe08416c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:49.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.207+0000 7fe089e00700 1 --2- 172.21.15.49:0/2785220733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe084156260 0x7fe08416c890 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fe084064d80 tx=0x7fe07c009780).stop 2024-01-22T05:08:49.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.207+0000 7fe089e00700 1 -- 172.21.15.49:0/2785220733 shutdown_connections 2024-01-22T05:08:49.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.207+0000 7fe089e00700 1 --2- 172.21.15.49:0/2785220733 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05c05a510 0x7fe05c05c9d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.207+0000 7fe089e00700 1 --2- 172.21.15.49:0/2785220733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe084156260 0x7fe08416c890 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.207+0000 7fe089e00700 1 --2- 172.21.15.49:0/2785220733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0840c2b40 0x7fe084146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.207+0000 7fe089e00700 1 --2- 172.21.15.49:0/2785220733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0840ab890 0x7fe08414a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.207+0000 7fe089e00700 1 -- 172.21.15.49:0/2785220733 >> 172.21.15.49:0/2785220733 conn(0x7fe0840c6500 msgr2=0x7fe0840c11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:49.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.207+0000 7fe089e00700 1 -- 172.21.15.49:0/2785220733 shutdown_connections 2024-01-22T05:08:49.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.207+0000 7fe089e00700 1 -- 172.21.15.49:0/2785220733 wait complete. 2024-01-22T05:08:49.218 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-01-22T05:08:49.241 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-22T05:08:49.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.415+0000 7f0e51000700 1 Processor -- start 2024-01-22T05:08:49.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.415+0000 7f0e51000700 1 -- start start 2024-01-22T05:08:49.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.419+0000 7f0e51000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0e4c15bad0 0x7f0e4c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:49.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.419+0000 7f0e51000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e4c0a8760 0x7f0e4c0a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:49.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.419+0000 7f0e51000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c0bd3e0 con 0x7f0e4c1524f0 2024-01-22T05:08:49.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.419+0000 7f0e51000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4c067c50 con 0x7f0e4c15bad0 2024-01-22T05:08:49.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.419+0000 7f0e51000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c15c420 con 0x7f0e4c0a8760 2024-01-22T05:08:49.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.419+0000 7f0e4a800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e4c0a8760 0x7f0e4c0a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:49.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.419+0000 7f0e4a800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e4c0a8760 0x7f0e4c0a8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:57642/0 (socket says 172.21.15.49:57642) 2024-01-22T05:08:49.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.419+0000 7f0e4a800700 1 -- 172.21.15.49:0/3655338734 learned_addr learned my addr 172.21.15.49:0/3655338734 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:49.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.419+0000 7f0e49400700 1 --2- 172.21.15.49:0/3655338734 >> v2:172.21.15.110:3300/0 conn(0x7f0e4c15bad0 0x7f0e4c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:49.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.419+0000 7f0e48a00700 1 -- 172.21.15.49:0/3655338734 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676131260 0 0) 0x7f0e4c0bd3e0 con 0x7f0e4c1524f0 2024-01-22T05:08:49.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.419+0000 7f0e49400700 1 -- 172.21.15.49:0/3655338734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e4c0a8760 msgr2=0x7f0e4c0a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:49.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.419+0000 7f0e49400700 1 --2- 172.21.15.49:0/3655338734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e4c0a8760 0x7f0e4c0a8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.419+0000 7f0e49400700 1 -- 172.21.15.49:0/3655338734 >> v1:172.21.15.110:6789/0 conn(0x7f0e4c1524f0 legacy=0x7f0e4c066400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:49.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.419+0000 7f0e49400700 1 -- 172.21.15.49:0/3655338734 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c0bcb40 con 0x7f0e4c15bad0 2024-01-22T05:08:49.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.423+0000 7f0e4a800700 1 --2- 172.21.15.49:0/3655338734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e4c0a8760 0x7f0e4c0a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:49.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.423+0000 7f0e49400700 1 --2- 172.21.15.49:0/3655338734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e4c15bad0 0x7f0e4c15bf30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f0e34009760 tx=0x7f0e34009060).ready entity=mon.1 client_cookie=2163b97aaebdf275 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:49.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.423+0000 7f0e48a00700 1 -- 172.21.15.49:0/3655338734 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400f510 con 0x7f0e4c15bad0 2024-01-22T05:08:49.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.423+0000 7f0e48a00700 1 -- 172.21.15.49:0/3655338734 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3400f670 con 0x7f0e4c15bad0 2024-01-22T05:08:49.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.423+0000 7f0e48a00700 1 -- 172.21.15.49:0/3655338734 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400f9f0 con 0x7f0e4c15bad0 2024-01-22T05:08:49.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.423+0000 7f0e51000700 1 -- 172.21.15.49:0/3655338734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e4c15bad0 msgr2=0x7f0e4c15bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:49.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.423+0000 7f0e51000700 1 --2- 172.21.15.49:0/3655338734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e4c15bad0 0x7f0e4c15bf30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f0e34009760 tx=0x7f0e34009060).stop 2024-01-22T05:08:49.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.423+0000 7f0e51000700 1 -- 172.21.15.49:0/3655338734 shutdown_connections 2024-01-22T05:08:49.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.423+0000 7f0e51000700 1 --2- 172.21.15.49:0/3655338734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e4c0a8760 0x7f0e4c0a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.423+0000 7f0e51000700 1 --2- 172.21.15.49:0/3655338734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e4c15bad0 0x7f0e4c15bf30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.423+0000 7f0e51000700 1 -- 172.21.15.49:0/3655338734 >> 172.21.15.49:0/3655338734 conn(0x7f0e4c0c6560 msgr2=0x7f0e4c0c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:49.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.423+0000 7f0e51000700 1 -- 172.21.15.49:0/3655338734 shutdown_connections 2024-01-22T05:08:49.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.423+0000 7f0e51000700 1 -- 172.21.15.49:0/3655338734 wait complete. 2024-01-22T05:08:49.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.427+0000 7f0e51000700 1 Processor -- start 2024-01-22T05:08:49.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e51000700 1 -- start start 2024-01-22T05:08:49.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e51000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e4c0a8760 0x7f0e4c0bfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:49.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e51000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e4c1524f0 0x7f0e4c0aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:49.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e51000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e4c15bad0 0x7f0e4c150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:49.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e51000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c168c40 con 0x7f0e4c15bad0 2024-01-22T05:08:49.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e51000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0bda10 con 0x7f0e4c0a8760 2024-01-22T05:08:49.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e51000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0aa3a0 con 0x7f0e4c1524f0 2024-01-22T05:08:49.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e4a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e4c15bad0 0x7f0e4c150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:49.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e4a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e4c15bad0 0x7f0e4c150f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48538/0 (socket says 172.21.15.49:48538) 2024-01-22T05:08:49.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e4a800700 1 -- 172.21.15.49:0/2262033867 learned_addr learned my addr 172.21.15.49:0/2262033867 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:49.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e49e00700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e4c0a8760 0x7f0e4c0bfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:49.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e49400700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e4c1524f0 0x7f0e4c0aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:49.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e4a800700 1 -- 172.21.15.49:0/2262033867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e4c1524f0 msgr2=0x7f0e4c0aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:49.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e4a800700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e4c1524f0 0x7f0e4c0aaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e4a800700 1 -- 172.21.15.49:0/2262033867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e4c0a8760 msgr2=0x7f0e4c0bfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:49.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e4a800700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e4c0a8760 0x7f0e4c0bfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e4a800700 1 -- 172.21.15.49:0/2262033867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e44009ae0 con 0x7f0e4c15bad0 2024-01-22T05:08:49.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e49e00700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e4c0a8760 0x7f0e4c0bfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:49.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e49400700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e4c1524f0 0x7f0e4c0aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:49.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.431+0000 7f0e4a800700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e4c15bad0 0x7f0e4c150f60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f0e44009fd0 tx=0x7f0e4400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.435+0000 7f0e41600700 1 -- 172.21.15.49:0/2262033867 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e440092e0 con 0x7f0e4c15bad0 2024-01-22T05:08:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.435+0000 7f0e41600700 1 -- 172.21.15.49:0/2262033867 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4400f040 con 0x7f0e4c15bad0 2024-01-22T05:08:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.435+0000 7f0e51000700 1 -- 172.21.15.49:0/2262033867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e340092a0 con 0x7f0e4c15bad0 2024-01-22T05:08:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.435+0000 7f0e41600700 1 -- 172.21.15.49:0/2262033867 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4400cd30 con 0x7f0e4c15bad0 2024-01-22T05:08:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.435+0000 7f0e51000700 1 -- 172.21.15.49:0/2262033867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4c0aa730 con 0x7f0e4c15bad0 2024-01-22T05:08:49.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.435+0000 7f0e51000700 1 -- 172.21.15.49:0/2262033867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4c0a85c0 con 0x7f0e4c15bad0 2024-01-22T05:08:49.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.439+0000 7f0e41600700 1 -- 172.21.15.49:0/2262033867 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0e44007400 con 0x7f0e4c15bad0 2024-01-22T05:08:49.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.439+0000 7f0e41600700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0e2405a510 0x7f0e2405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:49.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.439+0000 7f0e41600700 1 -- 172.21.15.49:0/2262033867 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f0e44074700 con 0x7f0e4c15bad0 2024-01-22T05:08:49.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.439+0000 7f0e49e00700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0e2405a510 0x7f0e2405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:49.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.439+0000 7f0e49e00700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0e2405a510 0x7f0e2405c9d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f0e3c0011e0 tx=0x7f0e3c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:49.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.447+0000 7f0e41600700 1 -- 172.21.15.49:0/2262033867 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0e4c0a85c0 con 0x7f0e4c15bad0 2024-01-22T05:08:49.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.627+0000 7f0e51000700 1 -- 172.21.15.49:0/2262033867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0e4c0a85c0 con 0x7f0e4c15bad0 2024-01-22T05:08:49.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.631+0000 7f0e41600700 1 -- 172.21.15.49:0/2262033867 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0e4c0a85c0 con 0x7f0e4c15bad0 2024-01-22T05:08:49.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.635+0000 7f0e51000700 1 -- 172.21.15.49:0/2262033867 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0e2405a510 msgr2=0x7f0e2405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:49.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.635+0000 7f0e51000700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0e2405a510 0x7f0e2405c9d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f0e3c0011e0 tx=0x7f0e3c009040).stop 2024-01-22T05:08:49.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.635+0000 7f0e51000700 1 -- 172.21.15.49:0/2262033867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e4c15bad0 msgr2=0x7f0e4c150f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:49.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.635+0000 7f0e51000700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e4c15bad0 0x7f0e4c150f60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f0e44009fd0 tx=0x7f0e4400b040).stop 2024-01-22T05:08:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.635+0000 7f0e51000700 1 -- 172.21.15.49:0/2262033867 shutdown_connections 2024-01-22T05:08:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.635+0000 7f0e51000700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0e2405a510 0x7f0e2405c9d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.635+0000 7f0e51000700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e4c15bad0 0x7f0e4c150f60 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.635+0000 7f0e51000700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e4c1524f0 0x7f0e4c0aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.635+0000 7f0e51000700 1 --2- 172.21.15.49:0/2262033867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e4c0a8760 0x7f0e4c0bfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.635+0000 7f0e51000700 1 -- 172.21.15.49:0/2262033867 >> 172.21.15.49:0/2262033867 conn(0x7f0e4c0c6560 msgr2=0x7f0e4c0c5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.635+0000 7f0e51000700 1 -- 172.21.15.49:0/2262033867 shutdown_connections 2024-01-22T05:08:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.635+0000 7f0e51000700 1 -- 172.21.15.49:0/2262033867 wait complete. 2024-01-22T05:08:49.664 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-01-22T05:08:49.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.823+0000 7fa3de600700 1 Processor -- start 2024-01-22T05:08:49.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.823+0000 7fa3de600700 1 -- start start 2024-01-22T05:08:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.823+0000 7fa3de600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa3d8068450 0x7fa3d815c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.823+0000 7fa3de600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d80648a0 con 0x7fa3d80a9f90 2024-01-22T05:08:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.823+0000 7fa3de600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d81523c0 con 0x7fa3d80a9bb0 2024-01-22T05:08:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.823+0000 7fa3de600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d81526a0 con 0x7fa3d8068450 2024-01-22T05:08:49.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.827+0000 7fa3d7400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa3d80a9bb0 0x7fa3d8064190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:56382/0 (socket says 172.21.15.49:56382) 2024-01-22T05:08:49.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.827+0000 7fa3d7400700 1 -- 172.21.15.49:0/3593756501 learned_addr learned my addr 172.21.15.49:0/3593756501 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:49.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.827+0000 7fa3d7e00700 1 --2- 172.21.15.49:0/3593756501 >> v2:172.21.15.110:3300/0 conn(0x7fa3d8068450 0x7fa3d815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:49.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.831+0000 7fa3d7e00700 1 -- 172.21.15.49:0/3593756501 >> v1:172.21.15.110:6789/0 conn(0x7fa3d80a9bb0 legacy=0x7fa3d8064190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:49.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.831+0000 7fa3d7e00700 1 -- 172.21.15.49:0/3593756501 >> v1:172.21.15.49:6789/0 conn(0x7fa3d80a9f90 legacy=0x7fa3d8067d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:49.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.831+0000 7fa3d7e00700 1 -- 172.21.15.49:0/3593756501 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d8152980 con 0x7fa3d8068450 2024-01-22T05:08:49.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.831+0000 7fa3d7e00700 1 --2- 172.21.15.49:0/3593756501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3d8068450 0x7fa3d815c830 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fa3c8009e60 tx=0x7fa3c8009780).ready entity=mon.1 client_cookie=aeed7f7c98e6501c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:49.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.831+0000 7fa3d6000700 1 -- 172.21.15.49:0/3593756501 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c800e070 con 0x7fa3d8068450 2024-01-22T05:08:49.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.831+0000 7fa3d6000700 1 -- 172.21.15.49:0/3593756501 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c800bc30 con 0x7fa3d8068450 2024-01-22T05:08:49.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.831+0000 7fa3d6000700 1 -- 172.21.15.49:0/3593756501 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8012410 con 0x7fa3d8068450 2024-01-22T05:08:49.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.835+0000 7fa3de600700 1 -- 172.21.15.49:0/3593756501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3d8068450 msgr2=0x7fa3d815c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:49.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.835+0000 7fa3de600700 1 --2- 172.21.15.49:0/3593756501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3d8068450 0x7fa3d815c830 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fa3c8009e60 tx=0x7fa3c8009780).stop 2024-01-22T05:08:49.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.835+0000 7fa3de600700 1 -- 172.21.15.49:0/3593756501 shutdown_connections 2024-01-22T05:08:49.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.835+0000 7fa3de600700 1 --2- 172.21.15.49:0/3593756501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3d8068450 0x7fa3d815c830 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.835+0000 7fa3de600700 1 -- 172.21.15.49:0/3593756501 >> 172.21.15.49:0/3593756501 conn(0x7fa3d8066830 msgr2=0x7fa3d8066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:49.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.835+0000 7fa3de600700 1 -- 172.21.15.49:0/3593756501 shutdown_connections 2024-01-22T05:08:49.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.835+0000 7fa3de600700 1 -- 172.21.15.49:0/3593756501 wait complete. 2024-01-22T05:08:49.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.839+0000 7fa3de600700 1 Processor -- start 2024-01-22T05:08:49.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.839+0000 7fa3de600700 1 -- start start 2024-01-22T05:08:49.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.839+0000 7fa3de600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d8068450 0x7fa3d80c0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:49.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.839+0000 7fa3de600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3d80a9bb0 0x7fa3d80bca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:49.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.839+0000 7fa3de600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3d80c32d0 0x7fa3d80ac720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:49.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.839+0000 7fa3de600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d814ef70 con 0x7fa3d8068450 2024-01-22T05:08:49.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.839+0000 7fa3de600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80c2e40 con 0x7fa3d80a9bb0 2024-01-22T05:08:49.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.839+0000 7fa3de600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d8145fe0 con 0x7fa3d80c32d0 2024-01-22T05:08:49.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.839+0000 7fa3d7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d8068450 0x7fa3d80c0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.839+0000 7fa3d7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d8068450 0x7fa3d80c0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48554/0 (socket says 172.21.15.49:48554) 2024-01-22T05:08:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.839+0000 7fa3d7400700 1 -- 172.21.15.49:0/3952161792 learned_addr learned my addr 172.21.15.49:0/3952161792 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.839+0000 7fa3d6a00700 1 --2- 172.21.15.49:0/3952161792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3d80a9bb0 0x7fa3d80bca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.839+0000 7fa3d7e00700 1 --2- 172.21.15.49:0/3952161792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3d80c32d0 0x7fa3d80ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.843+0000 7fa3d7e00700 1 -- 172.21.15.49:0/3952161792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3d80a9bb0 msgr2=0x7fa3d80bca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.843+0000 7fa3d7e00700 1 --2- 172.21.15.49:0/3952161792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3d80a9bb0 0x7fa3d80bca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.843+0000 7fa3d7e00700 1 -- 172.21.15.49:0/3952161792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d8068450 msgr2=0x7fa3d80c0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.843+0000 7fa3d7e00700 1 --2- 172.21.15.49:0/3952161792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d8068450 0x7fa3d80c0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.843+0000 7fa3d7e00700 1 -- 172.21.15.49:0/3952161792 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c8009a20 con 0x7fa3d80c32d0 2024-01-22T05:08:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.843+0000 7fa3d6a00700 1 --2- 172.21.15.49:0/3952161792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3d80a9bb0 0x7fa3d80bca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.843+0000 7fa3d7e00700 1 --2- 172.21.15.49:0/3952161792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3d80c32d0 0x7fa3d80ac720 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa3c8014000 tx=0x7fa3d8152fd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.843+0000 7fa3cea00700 1 -- 172.21.15.49:0/3952161792 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c801c660 con 0x7fa3d80c32d0 2024-01-22T05:08:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.843+0000 7fa3cea00700 1 -- 172.21.15.49:0/3952161792 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c801c7c0 con 0x7fa3d80c32d0 2024-01-22T05:08:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.843+0000 7fa3de600700 1 -- 172.21.15.49:0/3952161792 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d814f1c0 con 0x7fa3d80c32d0 2024-01-22T05:08:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.843+0000 7fa3cea00700 1 -- 172.21.15.49:0/3952161792 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c801cb40 con 0x7fa3d80c32d0 2024-01-22T05:08:49.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.843+0000 7fa3de600700 1 -- 172.21.15.49:0/3952161792 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d80c27f0 con 0x7fa3d80c32d0 2024-01-22T05:08:49.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.843+0000 7fa3de600700 1 -- 172.21.15.49:0/3952161792 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d80657b0 con 0x7fa3d80c32d0 2024-01-22T05:08:49.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.843+0000 7fa3cea00700 1 -- 172.21.15.49:0/3952161792 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa3c801d420 con 0x7fa3d80c32d0 2024-01-22T05:08:49.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.847+0000 7fa3cea00700 1 --2- 172.21.15.49:0/3952161792 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa3b005a510 0x7fa3b005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:49.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.847+0000 7fa3cea00700 1 -- 172.21.15.49:0/3952161792 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fa3c8076ad0 con 0x7fa3d80c32d0 2024-01-22T05:08:49.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.847+0000 7fa3d7400700 1 --2- 172.21.15.49:0/3952161792 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa3b005a510 0x7fa3b005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:49.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.847+0000 7fa3d7400700 1 --2- 172.21.15.49:0/3952161792 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa3b005a510 0x7fa3b005c9d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fa3d0007fd0 tx=0x7fa3d0007df0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:49.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:49.851+0000 7fa3cea00700 1 -- 172.21.15.49:0/3952161792 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa3c804a4d0 con 0x7fa3d80c32d0 2024-01-22T05:08:50.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.115+0000 7fa3de600700 1 -- 172.21.15.49:0/3952161792 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) v1 -- 0x7fa3d80c2f80 con 0x7fa3d80c32d0 2024-01-22T05:08:50.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.231+0000 7fa3cea00700 1 -- 172.21.15.49:0/3952161792 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v222) v1 ==== 143+0+0 (secure 0 0 0) 0x7fa3c804dab0 con 0x7fa3d80c32d0 2024-01-22T05:08:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.235+0000 7fa3de600700 1 -- 172.21.15.49:0/3952161792 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa3b005a510 msgr2=0x7fa3b005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.235+0000 7fa3de600700 1 --2- 172.21.15.49:0/3952161792 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa3b005a510 0x7fa3b005c9d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fa3d0007fd0 tx=0x7fa3d0007df0).stop 2024-01-22T05:08:50.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.235+0000 7fa3de600700 1 -- 172.21.15.49:0/3952161792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3d80c32d0 msgr2=0x7fa3d80ac720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:50.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.235+0000 7fa3de600700 1 --2- 172.21.15.49:0/3952161792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3d80c32d0 0x7fa3d80ac720 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa3c8014000 tx=0x7fa3d8152fd0).stop 2024-01-22T05:08:50.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.235+0000 7fa3de600700 1 -- 172.21.15.49:0/3952161792 shutdown_connections 2024-01-22T05:08:50.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.235+0000 7fa3de600700 1 --2- 172.21.15.49:0/3952161792 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa3b005a510 0x7fa3b005c9d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:50.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.235+0000 7fa3de600700 1 --2- 172.21.15.49:0/3952161792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3d80c32d0 0x7fa3d80ac720 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:50.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.235+0000 7fa3de600700 1 --2- 172.21.15.49:0/3952161792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3d80a9bb0 0x7fa3d80bca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:50.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.235+0000 7fa3de600700 1 --2- 172.21.15.49:0/3952161792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d8068450 0x7fa3d80c0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:50.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.235+0000 7fa3de600700 1 -- 172.21.15.49:0/3952161792 >> 172.21.15.49:0/3952161792 conn(0x7fa3d8066830 msgr2=0x7fa3d80c5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:50.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.235+0000 7fa3de600700 1 -- 172.21.15.49:0/3952161792 shutdown_connections 2024-01-22T05:08:50.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.235+0000 7fa3de600700 1 -- 172.21.15.49:0/3952161792 wait complete. 2024-01-22T05:08:50.260 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-01-22T05:08:50.260 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-01-22T05:08:50.261 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-01-22T05:08:50.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.423+0000 7f9a53a00700 1 Processor -- start 2024-01-22T05:08:50.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.423+0000 7f9a53a00700 1 -- start start 2024-01-22T05:08:50.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.427+0000 7f9a53a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4c064c00 0x7f9a4c0bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.427+0000 7f9a53a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9a4c065620 0x7f9a4c0bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.427+0000 7f9a53a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4c0c2700 con 0x7f9a4c065240 2024-01-22T05:08:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.427+0000 7f9a53a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4c0c29a0 con 0x7f9a4c065620 2024-01-22T05:08:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.427+0000 7f9a53a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0c2c80 con 0x7f9a4c064c00 2024-01-22T05:08:50.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.427+0000 7f9a52400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9a4c065620 0x7f9a4c0bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:50.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.427+0000 7f9a51000700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9a4c065240 0x7f9a4c0644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:56396/0 (socket says 172.21.15.49:56396) 2024-01-22T05:08:50.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.427+0000 7f9a4be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4c064c00 0x7f9a4c0bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:50.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.427+0000 7f9a51000700 1 -- 172.21.15.49:0/1941086672 learned_addr learned my addr 172.21.15.49:0/1941086672 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:50.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.427+0000 7f9a4b400700 1 -- 172.21.15.49:0/1941086672 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348013624 0 0) 0x7f9a4c0c2700 con 0x7f9a4c065240 2024-01-22T05:08:50.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.427+0000 7f9a4b400700 1 -- 172.21.15.49:0/1941086672 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a2c0033f0 con 0x7f9a4c065240 2024-01-22T05:08:50.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a52400700 1 -- 172.21.15.49:0/1941086672 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4c064c00 msgr2=0x7f9a4c0bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:50.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a52400700 1 --2- 172.21.15.49:0/1941086672 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4c064c00 0x7f9a4c0bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:50.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a52400700 1 -- 172.21.15.49:0/1941086672 >> v1:172.21.15.110:6789/0 conn(0x7f9a4c065240 legacy=0x7f9a4c0644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:50.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a52400700 1 -- 172.21.15.49:0/1941086672 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c0c2f60 con 0x7f9a4c065620 2024-01-22T05:08:50.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a52400700 1 --2- 172.21.15.49:0/1941086672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a4c065620 0x7f9a4c0bd170 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f9a44009e60 tx=0x7f9a44009780).ready entity=mon.1 client_cookie=ea4453d22ea87323 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:50.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a4b400700 1 -- 172.21.15.49:0/1941086672 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4400e070 con 0x7f9a4c065620 2024-01-22T05:08:50.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a4b400700 1 -- 172.21.15.49:0/1941086672 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4400bab0 con 0x7f9a4c065620 2024-01-22T05:08:50.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a4b400700 1 -- 172.21.15.49:0/1941086672 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4400be30 con 0x7f9a4c065620 2024-01-22T05:08:50.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a53a00700 1 -- 172.21.15.49:0/1941086672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a4c065620 msgr2=0x7f9a4c0bd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:50.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a53a00700 1 --2- 172.21.15.49:0/1941086672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a4c065620 0x7f9a4c0bd170 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f9a44009e60 tx=0x7f9a44009780).stop 2024-01-22T05:08:50.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a53a00700 1 -- 172.21.15.49:0/1941086672 shutdown_connections 2024-01-22T05:08:50.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a53a00700 1 --2- 172.21.15.49:0/1941086672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a4c065620 0x7f9a4c0bd170 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:50.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a53a00700 1 --2- 172.21.15.49:0/1941086672 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4c064c00 0x7f9a4c0bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:50.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a53a00700 1 -- 172.21.15.49:0/1941086672 >> 172.21.15.49:0/1941086672 conn(0x7f9a4c0c87f0 msgr2=0x7f9a4c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:50.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a53a00700 1 -- 172.21.15.49:0/1941086672 shutdown_connections 2024-01-22T05:08:50.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.431+0000 7f9a53a00700 1 -- 172.21.15.49:0/1941086672 wait complete. 2024-01-22T05:08:50.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.435+0000 7f9a53a00700 1 Processor -- start 2024-01-22T05:08:50.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.435+0000 7f9a53a00700 1 -- start start 2024-01-22T05:08:50.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a53a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a4c064c00 0x7f9a4c1694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:50.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a53a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4c065240 0x7f9a4c0c1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:50.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a53a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a4c065620 0x7f9a4c0a8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:50.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a53a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c15d340 con 0x7f9a4c064c00 2024-01-22T05:08:50.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a53a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0a9810 con 0x7f9a4c065620 2024-01-22T05:08:50.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a53a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c168750 con 0x7f9a4c065240 2024-01-22T05:08:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a51000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a4c064c00 0x7f9a4c1694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a51000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a4c064c00 0x7f9a4c1694d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48556/0 (socket says 172.21.15.49:48556) 2024-01-22T05:08:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a51000700 1 -- 172.21.15.49:0/3637481118 learned_addr learned my addr 172.21.15.49:0/3637481118 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a4be00700 1 --2- 172.21.15.49:0/3637481118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4c065240 0x7f9a4c0c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a52400700 1 --2- 172.21.15.49:0/3637481118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a4c065620 0x7f9a4c0a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a51000700 1 -- 172.21.15.49:0/3637481118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4c065240 msgr2=0x7f9a4c0c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a51000700 1 --2- 172.21.15.49:0/3637481118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4c065240 0x7f9a4c0c1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a51000700 1 -- 172.21.15.49:0/3637481118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a4c065620 msgr2=0x7f9a4c0a8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a51000700 1 --2- 172.21.15.49:0/3637481118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a4c065620 0x7f9a4c0a8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a51000700 1 -- 172.21.15.49:0/3637481118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a44009a20 con 0x7f9a4c064c00 2024-01-22T05:08:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a51000700 1 --2- 172.21.15.49:0/3637481118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a4c064c00 0x7f9a4c1694d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f9a3c00c590 tx=0x7f9a3c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.439+0000 7f9a43e00700 1 -- 172.21.15.49:0/3637481118 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0072e0 con 0x7f9a4c064c00 2024-01-22T05:08:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.443+0000 7f9a53a00700 1 -- 172.21.15.49:0/3637481118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4c0a9250 con 0x7f9a4c064c00 2024-01-22T05:08:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.443+0000 7f9a43e00700 1 -- 172.21.15.49:0/3637481118 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c007440 con 0x7f9a4c064c00 2024-01-22T05:08:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.443+0000 7f9a43e00700 1 -- 172.21.15.49:0/3637481118 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0057a0 con 0x7f9a4c064c00 2024-01-22T05:08:50.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.443+0000 7f9a53a00700 1 -- 172.21.15.49:0/3637481118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4c15d550 con 0x7f9a4c064c00 2024-01-22T05:08:50.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.443+0000 7f9a53a00700 1 -- 172.21.15.49:0/3637481118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4c0ad8e0 con 0x7f9a4c064c00 2024-01-22T05:08:50.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.447+0000 7f9a43e00700 1 -- 172.21.15.49:0/3637481118 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9a3c005bd0 con 0x7f9a4c064c00 2024-01-22T05:08:50.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.447+0000 7f9a43e00700 1 --2- 172.21.15.49:0/3637481118 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a2405a510 0x7f9a2405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:50.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.447+0000 7f9a43e00700 1 -- 172.21.15.49:0/3637481118 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f9a3c073e90 con 0x7f9a4c064c00 2024-01-22T05:08:50.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.447+0000 7f9a4be00700 1 --2- 172.21.15.49:0/3637481118 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a2405a510 0x7f9a2405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:50.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.451+0000 7f9a4be00700 1 --2- 172.21.15.49:0/3637481118 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a2405a510 0x7f9a2405c9d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f9a4c064870 tx=0x7f9a34009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:50.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.455+0000 7f9a43e00700 1 -- 172.21.15.49:0/3637481118 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9a4c0ad8e0 con 0x7f9a4c064c00 2024-01-22T05:08:50.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:50.675+0000 7f9a53a00700 1 -- 172.21.15.49:0/3637481118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) v1 -- 0x7f9a4c0ad8e0 con 0x7f9a4c064c00 2024-01-22T05:08:51.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.231+0000 7f9a43e00700 1 -- 172.21.15.49:0/3637481118 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v223) v1 ==== 146+0+0 (secure 0 0 0) 0x7f9a4c0ad8e0 con 0x7f9a4c064c00 2024-01-22T05:08:51.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.239+0000 7f9a53a00700 1 -- 172.21.15.49:0/3637481118 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a2405a510 msgr2=0x7f9a2405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:51.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.239+0000 7f9a53a00700 1 --2- 172.21.15.49:0/3637481118 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a2405a510 0x7f9a2405c9d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f9a4c064870 tx=0x7f9a34009060).stop 2024-01-22T05:08:51.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.239+0000 7f9a53a00700 1 -- 172.21.15.49:0/3637481118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a4c064c00 msgr2=0x7f9a4c1694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:51.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.239+0000 7f9a53a00700 1 --2- 172.21.15.49:0/3637481118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a4c064c00 0x7f9a4c1694d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f9a3c00c590 tx=0x7f9a3c007c80).stop 2024-01-22T05:08:51.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.239+0000 7f9a53a00700 1 -- 172.21.15.49:0/3637481118 shutdown_connections 2024-01-22T05:08:51.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.239+0000 7f9a53a00700 1 --2- 172.21.15.49:0/3637481118 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a2405a510 0x7f9a2405c9d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.239+0000 7f9a53a00700 1 --2- 172.21.15.49:0/3637481118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a4c065620 0x7f9a4c0a8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.239+0000 7f9a53a00700 1 --2- 172.21.15.49:0/3637481118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4c065240 0x7f9a4c0c1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.239+0000 7f9a53a00700 1 --2- 172.21.15.49:0/3637481118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a4c064c00 0x7f9a4c1694d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.239+0000 7f9a53a00700 1 -- 172.21.15.49:0/3637481118 >> 172.21.15.49:0/3637481118 conn(0x7f9a4c0c87f0 msgr2=0x7f9a4c063970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:51.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.239+0000 7f9a53a00700 1 -- 172.21.15.49:0/3637481118 shutdown_connections 2024-01-22T05:08:51.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.239+0000 7f9a53a00700 1 -- 172.21.15.49:0/3637481118 wait complete. 2024-01-22T05:08:51.266 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-22T05:08:51.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.443+0000 7f7735800700 1 Processor -- start 2024-01-22T05:08:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.447+0000 7f7735800700 1 -- start start 2024-01-22T05:08:51.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.447+0000 7f7735800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7730067a90 0x7f7730067ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:51.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.447+0000 7f7735800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7730155c00 0x7f7730156050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:51.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.447+0000 7f7735800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7730155770 con 0x7f77300c0760 2024-01-22T05:08:51.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.447+0000 7f7735800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77300c2e40 con 0x7f7730155c00 2024-01-22T05:08:51.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.447+0000 7f7735800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7730156540 con 0x7f7730067a90 2024-01-22T05:08:51.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.447+0000 7f772f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7730155c00 0x7f7730156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:51.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.447+0000 7f772f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7730155c00 0x7f7730156050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48572/0 (socket says 172.21.15.49:48572) 2024-01-22T05:08:51.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.447+0000 7f772f400700 1 -- 172.21.15.49:0/1497615169 learned_addr learned my addr 172.21.15.49:0/1497615169 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:51.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f772e000700 1 --2- 172.21.15.49:0/1497615169 >> v2:172.21.15.110:3300/0 conn(0x7f7730067a90 0x7f7730067ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:51.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f772f400700 1 -- 172.21.15.49:0/1497615169 >> v2:172.21.15.110:3300/0 conn(0x7f7730067a90 msgr2=0x7f7730067ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:51.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f772f400700 1 --2- 172.21.15.49:0/1497615169 >> v2:172.21.15.110:3300/0 conn(0x7f7730067a90 0x7f7730067ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f772f400700 1 -- 172.21.15.49:0/1497615169 >> v1:172.21.15.110:6789/0 conn(0x7f77300c0760 legacy=0x7f77301516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:51.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f772f400700 1 -- 172.21.15.49:0/1497615169 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77300c2880 con 0x7f7730155c00 2024-01-22T05:08:51.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f772e000700 1 --2- 172.21.15.49:0/1497615169 >> v2:172.21.15.110:3300/0 conn(0x7f7730067a90 0x7f7730067ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:08:51.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f772f400700 1 --2- 172.21.15.49:0/1497615169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7730155c00 0x7f7730156050 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f7730065680 tx=0x7f7728009840).ready entity=mon.0 client_cookie=deecc8bb9b2d2c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:51.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f772d600700 1 -- 172.21.15.49:0/1497615169 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772800e070 con 0x7f7730155c00 2024-01-22T05:08:51.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f772d600700 1 -- 172.21.15.49:0/1497615169 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772800ba50 con 0x7f7730155c00 2024-01-22T05:08:51.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f772d600700 1 -- 172.21.15.49:0/1497615169 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772800bdd0 con 0x7f7730155c00 2024-01-22T05:08:51.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f7735800700 1 -- 172.21.15.49:0/1497615169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7730155c00 msgr2=0x7f7730156050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:51.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f7735800700 1 --2- 172.21.15.49:0/1497615169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7730155c00 0x7f7730156050 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f7730065680 tx=0x7f7728009840).stop 2024-01-22T05:08:51.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f7735800700 1 -- 172.21.15.49:0/1497615169 shutdown_connections 2024-01-22T05:08:51.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f7735800700 1 --2- 172.21.15.49:0/1497615169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7730155c00 0x7f7730156050 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f7735800700 1 --2- 172.21.15.49:0/1497615169 >> v2:172.21.15.110:3300/0 conn(0x7f7730067a90 0x7f7730067ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f7735800700 1 -- 172.21.15.49:0/1497615169 >> 172.21.15.49:0/1497615169 conn(0x7f7730062cb0 msgr2=0x7f77300c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.451+0000 7f7735800700 1 -- 172.21.15.49:0/1497615169 shutdown_connections 2024-01-22T05:08:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.455+0000 7f7735800700 1 -- 172.21.15.49:0/1497615169 wait complete. 2024-01-22T05:08:51.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.455+0000 7f7735800700 1 Processor -- start 2024-01-22T05:08:51.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.455+0000 7f7735800700 1 -- start start 2024-01-22T05:08:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f7735800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7730067a90 0x7f773013c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f7735800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77300c0760 0x7f773014fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f7735800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7730155c00 0x7f77301503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f7735800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77301508c0 con 0x7f7730155c00 2024-01-22T05:08:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f7735800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773013c590 con 0x7f7730067a90 2024-01-22T05:08:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f7735800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77300bfed0 con 0x7f77300c0760 2024-01-22T05:08:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f772f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7730155c00 0x7f77301503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f772f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7730155c00 0x7f77301503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48586/0 (socket says 172.21.15.49:48586) 2024-01-22T05:08:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f772f400700 1 -- 172.21.15.49:0/2162895886 learned_addr learned my addr 172.21.15.49:0/2162895886 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f772ea00700 1 --2- 172.21.15.49:0/2162895886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7730067a90 0x7f773013c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f772e000700 1 --2- 172.21.15.49:0/2162895886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77300c0760 0x7f773014fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f772f400700 1 -- 172.21.15.49:0/2162895886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77300c0760 msgr2=0x7f773014fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f772f400700 1 --2- 172.21.15.49:0/2162895886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77300c0760 0x7f773014fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f772f400700 1 -- 172.21.15.49:0/2162895886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7730067a90 msgr2=0x7f773013c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:51.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f772f400700 1 --2- 172.21.15.49:0/2162895886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7730067a90 0x7f773013c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f772f400700 1 -- 172.21.15.49:0/2162895886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7728009ae0 con 0x7f7730155c00 2024-01-22T05:08:51.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f772e000700 1 --2- 172.21.15.49:0/2162895886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77300c0760 0x7f773014fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:51.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f772f400700 1 --2- 172.21.15.49:0/2162895886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7730155c00 0x7f77301503d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f7728009fd0 tx=0x7f7728009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:51.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f7726000700 1 -- 172.21.15.49:0/2162895886 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77280092e0 con 0x7f7730155c00 2024-01-22T05:08:51.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f7726000700 1 -- 172.21.15.49:0/2162895886 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772801e470 con 0x7f7730155c00 2024-01-22T05:08:51.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.459+0000 7f7726000700 1 -- 172.21.15.49:0/2162895886 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772801e810 con 0x7f7730155c00 2024-01-22T05:08:51.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.463+0000 7f7735800700 1 -- 172.21.15.49:0/2162895886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773014da60 con 0x7f7730155c00 2024-01-22T05:08:51.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.463+0000 7f7735800700 1 -- 172.21.15.49:0/2162895886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773014e020 con 0x7f7730155c00 2024-01-22T05:08:51.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.463+0000 7f7735800700 1 -- 172.21.15.49:0/2162895886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773014e270 con 0x7f7730155c00 2024-01-22T05:08:51.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.463+0000 7f7726000700 1 -- 172.21.15.49:0/2162895886 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7728003040 con 0x7f7730155c00 2024-01-22T05:08:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.467+0000 7f7726000700 1 --2- 172.21.15.49:0/2162895886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f770805a560 0x7f770805ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.467+0000 7f7726000700 1 -- 172.21.15.49:0/2162895886 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f7728075ca0 con 0x7f7730155c00 2024-01-22T05:08:51.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.467+0000 7f772ea00700 1 --2- 172.21.15.49:0/2162895886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f770805a560 0x7f770805ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:51.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.467+0000 7f772ea00700 1 --2- 172.21.15.49:0/2162895886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f770805a560 0x7f770805ca20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f77300bbc30 tx=0x7f7720009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:51.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.471+0000 7f7726000700 1 -- 172.21.15.49:0/2162895886 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7728049690 con 0x7f7730155c00 2024-01-22T05:08:51.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.639+0000 7f7735800700 1 -- 172.21.15.49:0/2162895886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f773014d8c0 con 0x7f7730155c00 2024-01-22T05:08:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.647+0000 7f7726000700 1 -- 172.21.15.49:0/2162895886 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f773014d8c0 con 0x7f7730155c00 2024-01-22T05:08:51.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.651+0000 7f7735800700 1 -- 172.21.15.49:0/2162895886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f770805a560 msgr2=0x7f770805ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:51.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.651+0000 7f7735800700 1 --2- 172.21.15.49:0/2162895886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f770805a560 0x7f770805ca20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f77300bbc30 tx=0x7f7720009040).stop 2024-01-22T05:08:51.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.651+0000 7f7735800700 1 -- 172.21.15.49:0/2162895886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7730155c00 msgr2=0x7f77301503d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.651+0000 7f7735800700 1 --2- 172.21.15.49:0/2162895886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7730155c00 0x7f77301503d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f7728009fd0 tx=0x7f7728009840).stop 2024-01-22T05:08:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.651+0000 7f7735800700 1 -- 172.21.15.49:0/2162895886 shutdown_connections 2024-01-22T05:08:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.651+0000 7f7735800700 1 --2- 172.21.15.49:0/2162895886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f770805a560 0x7f770805ca20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.651+0000 7f7735800700 1 --2- 172.21.15.49:0/2162895886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7730155c00 0x7f77301503d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.651+0000 7f7735800700 1 --2- 172.21.15.49:0/2162895886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77300c0760 0x7f773014fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.651+0000 7f7735800700 1 --2- 172.21.15.49:0/2162895886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7730067a90 0x7f773013c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.651+0000 7f7735800700 1 -- 172.21.15.49:0/2162895886 >> 172.21.15.49:0/2162895886 conn(0x7f7730062cb0 msgr2=0x7f77300ab890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:51.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.655+0000 7f7735800700 1 -- 172.21.15.49:0/2162895886 shutdown_connections 2024-01-22T05:08:51.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.655+0000 7f7735800700 1 -- 172.21.15.49:0/2162895886 wait complete. 2024-01-22T05:08:51.679 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:08:51.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:08:51.721 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:08:51.761 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:08:51.761 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-22T05:08:51.761 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:08:51.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.931+0000 7fe2a1e00700 1 Processor -- start 2024-01-22T05:08:51.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.931+0000 7fe2a1e00700 1 -- start start 2024-01-22T05:08:51.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe2a1e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29c0a8740 0x7fe29c0a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:51.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe2a1e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c0c1a40 con 0x7fe29c0c1ed0 2024-01-22T05:08:51.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe2a1e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c0a90b0 con 0x7fe29c155d20 2024-01-22T05:08:51.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe2a1e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c159310 con 0x7fe29c0a8740 2024-01-22T05:08:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe29b400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe29c0c1ed0 0x7fe29c0c2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36410/0 (socket says 172.21.15.49:36410) 2024-01-22T05:08:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe29b400700 1 -- 172.21.15.49:0/1085587818 learned_addr learned my addr 172.21.15.49:0/1085587818 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe29a000700 1 --2- 172.21.15.49:0/1085587818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29c0a8740 0x7fe29c0a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:51.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe299600700 1 -- 172.21.15.49:0/1085587818 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761221836 0 0) 0x7fe29c0c1a40 con 0x7fe29c0c1ed0 2024-01-22T05:08:51.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe299600700 1 -- 172.21.15.49:0/1085587818 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe27c0033f0 con 0x7fe29c0c1ed0 2024-01-22T05:08:51.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe299600700 1 -- 172.21.15.49:0/1085587818 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999428253 0 0) 0x7fe29c0a90b0 con 0x7fe29c155d20 2024-01-22T05:08:51.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe299600700 1 -- 172.21.15.49:0/1085587818 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe29c0c1a40 con 0x7fe29c155d20 2024-01-22T05:08:51.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe29a000700 1 -- 172.21.15.49:0/1085587818 >> v1:172.21.15.110:6789/0 conn(0x7fe29c155d20 legacy=0x7fe29c065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:51.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe29a000700 1 -- 172.21.15.49:0/1085587818 >> v1:172.21.15.49:6789/0 conn(0x7fe29c0c1ed0 legacy=0x7fe29c0c2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:51.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe29a000700 1 -- 172.21.15.49:0/1085587818 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c0c13f0 con 0x7fe29c0a8740 2024-01-22T05:08:51.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe29a000700 1 --2- 172.21.15.49:0/1085587818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29c0a8740 0x7fe29c0a8bc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fe284009790 tx=0x7fe284009060).ready entity=mon.2 client_cookie=2a0271c6e4ee66ea server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:51.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe299600700 1 -- 172.21.15.49:0/1085587818 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28400f510 con 0x7fe29c0a8740 2024-01-22T05:08:51.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe299600700 1 -- 172.21.15.49:0/1085587818 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28400f670 con 0x7fe29c0a8740 2024-01-22T05:08:51.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.935+0000 7fe299600700 1 -- 172.21.15.49:0/1085587818 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28400f9f0 con 0x7fe29c0a8740 2024-01-22T05:08:51.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.939+0000 7fe2a1e00700 1 -- 172.21.15.49:0/1085587818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29c0a8740 msgr2=0x7fe29c0a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:51.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.939+0000 7fe2a1e00700 1 --2- 172.21.15.49:0/1085587818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29c0a8740 0x7fe29c0a8bc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fe284009790 tx=0x7fe284009060).stop 2024-01-22T05:08:51.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.939+0000 7fe2a1e00700 1 -- 172.21.15.49:0/1085587818 shutdown_connections 2024-01-22T05:08:51.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.939+0000 7fe2a1e00700 1 --2- 172.21.15.49:0/1085587818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29c0a8740 0x7fe29c0a8bc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.939+0000 7fe2a1e00700 1 -- 172.21.15.49:0/1085587818 >> 172.21.15.49:0/1085587818 conn(0x7fe29c0c6540 msgr2=0x7fe29c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:51.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.939+0000 7fe2a1e00700 1 -- 172.21.15.49:0/1085587818 shutdown_connections 2024-01-22T05:08:51.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.939+0000 7fe2a1e00700 1 -- 172.21.15.49:0/1085587818 wait complete. 2024-01-22T05:08:51.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.943+0000 7fe2a1e00700 1 Processor -- start 2024-01-22T05:08:51.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.943+0000 7fe2a1e00700 1 -- start start 2024-01-22T05:08:51.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.943+0000 7fe2a1e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29c0a8740 0x7fe29c152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:51.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.943+0000 7fe2a1e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe29c0c1ed0 0x7fe29c1687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:51.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.943+0000 7fe2a1e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29c155d20 0x7fe29c0aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:51.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.943+0000 7fe2a1e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c169770 con 0x7fe29c0c1ed0 2024-01-22T05:08:51.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.943+0000 7fe2a1e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c168cc0 con 0x7fe29c155d20 2024-01-22T05:08:51.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.943+0000 7fe2a1e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c0bd810 con 0x7fe29c0a8740 2024-01-22T05:08:51.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.943+0000 7fe29aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29c0a8740 0x7fe29c152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:51.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.943+0000 7fe29aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29c0a8740 0x7fe29c152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:57714/0 (socket says 172.21.15.49:57714) 2024-01-22T05:08:51.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.943+0000 7fe29aa00700 1 -- 172.21.15.49:0/1030110220 learned_addr learned my addr 172.21.15.49:0/1030110220 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:51.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.943+0000 7fe29a000700 1 --2- 172.21.15.49:0/1030110220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe29c0c1ed0 0x7fe29c1687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:51.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.943+0000 7fe29b400700 1 --2- 172.21.15.49:0/1030110220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29c155d20 0x7fe29c0aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:51.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.947+0000 7fe29aa00700 1 -- 172.21.15.49:0/1030110220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29c155d20 msgr2=0x7fe29c0aa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:51.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.947+0000 7fe29aa00700 1 --2- 172.21.15.49:0/1030110220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29c155d20 0x7fe29c0aa6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.947+0000 7fe29aa00700 1 -- 172.21.15.49:0/1030110220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe29c0c1ed0 msgr2=0x7fe29c1687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:51.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.947+0000 7fe29aa00700 1 --2- 172.21.15.49:0/1030110220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe29c0c1ed0 0x7fe29c1687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:51.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.947+0000 7fe29aa00700 1 -- 172.21.15.49:0/1030110220 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2840092a0 con 0x7fe29c0a8740 2024-01-22T05:08:51.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.947+0000 7fe29a000700 1 --2- 172.21.15.49:0/1030110220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe29c0c1ed0 0x7fe29c1687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:51.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.947+0000 7fe29aa00700 1 --2- 172.21.15.49:0/1030110220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29c0a8740 0x7fe29c152b00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe28c00c440 tx=0x7fe28c007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:51.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.947+0000 7fe292000700 1 -- 172.21.15.49:0/1030110220 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c012400 con 0x7fe29c0a8740 2024-01-22T05:08:51.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.947+0000 7fe292000700 1 -- 172.21.15.49:0/1030110220 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c012560 con 0x7fe29c0a8740 2024-01-22T05:08:51.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.947+0000 7fe292000700 1 -- 172.21.15.49:0/1030110220 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c012920 con 0x7fe29c0a8740 2024-01-22T05:08:51.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.947+0000 7fe2a1e00700 1 -- 172.21.15.49:0/1030110220 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29c0bf5b0 con 0x7fe29c0a8740 2024-01-22T05:08:51.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.947+0000 7fe2a1e00700 1 -- 172.21.15.49:0/1030110220 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29c1691b0 con 0x7fe29c0a8740 2024-01-22T05:08:51.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.947+0000 7fe2a1e00700 1 -- 172.21.15.49:0/1030110220 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29c0bd5c0 con 0x7fe29c0a8740 2024-01-22T05:08:51.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.951+0000 7fe292000700 1 -- 172.21.15.49:0/1030110220 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe28c01b3b0 con 0x7fe29c0a8740 2024-01-22T05:08:51.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.951+0000 7fe292000700 1 --2- 172.21.15.49:0/1030110220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe27405a510 0x7fe27405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:51.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.951+0000 7fe292000700 1 -- 172.21.15.49:0/1030110220 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fe28c073e30 con 0x7fe29c0a8740 2024-01-22T05:08:51.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.951+0000 7fe29a000700 1 --2- 172.21.15.49:0/1030110220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe27405a510 0x7fe27405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:51.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.951+0000 7fe29a000700 1 --2- 172.21.15.49:0/1030110220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe27405a510 0x7fe27405c9d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fe284009fd0 tx=0x7fe284017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:51.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:51.959+0000 7fe292000700 1 -- 172.21.15.49:0/1030110220 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe28c047750 con 0x7fe29c0a8740 2024-01-22T05:08:52.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:52.159+0000 7fe2a1e00700 1 -- 172.21.15.49:0/1030110220 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe29c047060 con 0x7fe29c0a8740 2024-01-22T05:08:52.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:52.159+0000 7fe292000700 1 -- 172.21.15.49:0/1030110220 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fe28c04ad70 con 0x7fe29c0a8740 2024-01-22T05:08:52.163 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:52.163 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":49,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4189231199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4189231199},{"type":"v1","addr":"172.21.15.110:6833","nonce":4189231199}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3670263543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3670263543},{"type":"v1","addr":"172.21.15.110:6835","nonce":3670263543}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/426231573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":426231573},{"type":"v1","addr":"172.21.15.49:6835","nonce":426231573}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3338928402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3338928402},{"type":"v1","addr":"172.21.15.49:6837","nonce":3338928402}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[]} 2024-01-22T05:08:52.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:52.163+0000 7fe2a1e00700 1 -- 172.21.15.49:0/1030110220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe27405a510 msgr2=0x7fe27405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:52.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:52.163+0000 7fe2a1e00700 1 --2- 172.21.15.49:0/1030110220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe27405a510 0x7fe27405c9d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fe284009fd0 tx=0x7fe284017000).stop 2024-01-22T05:08:52.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:52.163+0000 7fe2a1e00700 1 -- 172.21.15.49:0/1030110220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29c0a8740 msgr2=0x7fe29c152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:52.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:52.163+0000 7fe2a1e00700 1 --2- 172.21.15.49:0/1030110220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29c0a8740 0x7fe29c152b00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe28c00c440 tx=0x7fe28c007c90).stop 2024-01-22T05:08:52.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:52.163+0000 7fe2a1e00700 1 -- 172.21.15.49:0/1030110220 shutdown_connections 2024-01-22T05:08:52.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:52.163+0000 7fe2a1e00700 1 --2- 172.21.15.49:0/1030110220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe27405a510 0x7fe27405c9d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:52.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:52.163+0000 7fe2a1e00700 1 --2- 172.21.15.49:0/1030110220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29c155d20 0x7fe29c0aa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:52.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:52.163+0000 7fe2a1e00700 1 --2- 172.21.15.49:0/1030110220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe29c0c1ed0 0x7fe29c1687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:52.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:52.163+0000 7fe2a1e00700 1 --2- 172.21.15.49:0/1030110220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29c0a8740 0x7fe29c152b00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:52.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:52.163+0000 7fe2a1e00700 1 -- 172.21.15.49:0/1030110220 >> 172.21.15.49:0/1030110220 conn(0x7fe29c0c6540 msgr2=0x7fe29c0c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:52.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:52.163+0000 7fe2a1e00700 1 -- 172.21.15.49:0/1030110220 shutdown_connections 2024-01-22T05:08:52.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:52.163+0000 7fe2a1e00700 1 -- 172.21.15.49:0/1030110220 wait complete. 2024-01-22T05:08:52.172 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 49 2024-01-22T05:08:52.191 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:08:52.192 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-22T05:08:52.192 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:08:52.192 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:08:52.192 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:08:52.192 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-22T05:08:52.192 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:08:52.192 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:08:52.193 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:08:52.193 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-22T05:08:52.193 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:08:52.193 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:08:52.193 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:08:52.193 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-22T05:08:52.193 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:08:52.193 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:08:52.211 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:08:52.211 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:08:52.212 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:08:52.213 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:08:52.218 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:08:52.218 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:08:52.262 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:08:52.262 DEBUG:teuthology.parallel:result is None 2024-01-22T05:08:52.268 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:08:52.268 DEBUG:teuthology.parallel:result is None 2024-01-22T05:08:52.271 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:08:52.272 DEBUG:teuthology.parallel:result is None 2024-01-22T05:08:52.371 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:08:52.382 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:08:52.382 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-22T05:08:54.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-01-22T05:08:58.211 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:08:58.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:08:58.218 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:08:58.219 DEBUG:teuthology.parallel:result is None 2024-01-22T05:08:58.219 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-22T05:08:58.339 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:08:58.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.367+0000 7ff5b8c00700 1 Processor -- start 2024-01-22T05:08:58.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.371+0000 7ff5b8c00700 1 -- start start 2024-01-22T05:08:58.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.371+0000 7ff5b8c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5b4155d20 0x7ff5b4065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:58.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.371+0000 7ff5b8c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff5b40a8e50 0x7ff5b40c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:58.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.371+0000 7ff5b8c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b40c1a40 con 0x7ff5b4066070 2024-01-22T05:08:58.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.371+0000 7ff5b8c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b4159310 con 0x7ff5b40a8e50 2024-01-22T05:08:58.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.371+0000 7ff5b8c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b40c13f0 con 0x7ff5b4155d20 2024-01-22T05:08:58.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.371+0000 7ff5b1400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff5b4066070 0x7ff5b40a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37500/0 (socket says 172.21.15.49:37500) 2024-01-22T05:08:58.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.371+0000 7ff5b1400700 1 -- 172.21.15.49:0/1992667790 learned_addr learned my addr 172.21.15.49:0/1992667790 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:58.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.371+0000 7ff5b1e00700 1 --2- 172.21.15.49:0/1992667790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5b4155d20 0x7ff5b4065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:58.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.371+0000 7ff5b2800700 1 --2- 172.21.15.49:0/1992667790 >> v2:172.21.15.49:3300/0 conn(0x7ff5b40a8e50 0x7ff5b40c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:58.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.371+0000 7ff5b0a00700 1 -- 172.21.15.49:0/1992667790 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703401548 0 0) 0x7ff5b40c1a40 con 0x7ff5b4066070 2024-01-22T05:08:58.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.371+0000 7ff5b0a00700 1 -- 172.21.15.49:0/1992667790 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5940033f0 con 0x7ff5b4066070 2024-01-22T05:08:58.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.371+0000 7ff5b1e00700 1 -- 172.21.15.49:0/1992667790 >> v2:172.21.15.49:3300/0 conn(0x7ff5b40a8e50 msgr2=0x7ff5b40c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:58.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.371+0000 7ff5b1e00700 1 --2- 172.21.15.49:0/1992667790 >> v2:172.21.15.49:3300/0 conn(0x7ff5b40a8e50 0x7ff5b40c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:58.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.375+0000 7ff5b1e00700 1 -- 172.21.15.49:0/1992667790 >> v1:172.21.15.49:6789/0 conn(0x7ff5b4066070 legacy=0x7ff5b40a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:58.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.375+0000 7ff5b1e00700 1 -- 172.21.15.49:0/1992667790 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b40c16d0 con 0x7ff5b4155d20 2024-01-22T05:08:58.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.375+0000 7ff5b2800700 1 --2- 172.21.15.49:0/1992667790 >> v2:172.21.15.49:3300/0 conn(0x7ff5b40a8e50 0x7ff5b40c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:08:58.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.375+0000 7ff5b1e00700 1 --2- 172.21.15.49:0/1992667790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5b4155d20 0x7ff5b4065b80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff5a4009760 tx=0x7ff5a4009060).ready entity=mon.2 client_cookie=e96b5c426942744a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:58.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.375+0000 7ff5b0a00700 1 -- 172.21.15.49:0/1992667790 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400d4a0 con 0x7ff5b4155d20 2024-01-22T05:08:58.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.375+0000 7ff5b0a00700 1 -- 172.21.15.49:0/1992667790 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a400d600 con 0x7ff5b4155d20 2024-01-22T05:08:58.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.375+0000 7ff5b0a00700 1 -- 172.21.15.49:0/1992667790 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400d980 con 0x7ff5b4155d20 2024-01-22T05:08:58.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.375+0000 7ff5b8c00700 1 -- 172.21.15.49:0/1992667790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5b4155d20 msgr2=0x7ff5b4065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:58.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.375+0000 7ff5b8c00700 1 --2- 172.21.15.49:0/1992667790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5b4155d20 0x7ff5b4065b80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff5a4009760 tx=0x7ff5a4009060).stop 2024-01-22T05:08:58.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.375+0000 7ff5b8c00700 1 -- 172.21.15.49:0/1992667790 shutdown_connections 2024-01-22T05:08:58.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.375+0000 7ff5b8c00700 1 --2- 172.21.15.49:0/1992667790 >> v2:172.21.15.49:3300/0 conn(0x7ff5b40a8e50 0x7ff5b40c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:58.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.375+0000 7ff5b8c00700 1 --2- 172.21.15.49:0/1992667790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5b4155d20 0x7ff5b4065b80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:58.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.375+0000 7ff5b8c00700 1 -- 172.21.15.49:0/1992667790 >> 172.21.15.49:0/1992667790 conn(0x7ff5b40c6540 msgr2=0x7ff5b40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:58.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.375+0000 7ff5b8c00700 1 -- 172.21.15.49:0/1992667790 shutdown_connections 2024-01-22T05:08:58.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.375+0000 7ff5b8c00700 1 -- 172.21.15.49:0/1992667790 wait complete. 2024-01-22T05:08:58.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.379+0000 7ff5b8c00700 1 Processor -- start 2024-01-22T05:08:58.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.379+0000 7ff5b8c00700 1 -- start start 2024-01-22T05:08:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b8c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b4066070 0x7ff5b41535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b8c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b40a8e50 0x7ff5b40ab020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b8c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5b4155d20 0x7ff5b40c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b8c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b40a9920 con 0x7ff5b4066070 2024-01-22T05:08:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b8c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b40a9c00 con 0x7ff5b40a8e50 2024-01-22T05:08:58.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b8c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b40a9ee0 con 0x7ff5b4155d20 2024-01-22T05:08:58.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b1e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b4066070 0x7ff5b41535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:58.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b1e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b4066070 0x7ff5b41535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42488/0 (socket says 172.21.15.49:42488) 2024-01-22T05:08:58.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b1e00700 1 -- 172.21.15.49:0/384305668 learned_addr learned my addr 172.21.15.49:0/384305668 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b2800700 1 --2- 172.21.15.49:0/384305668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5b4155d20 0x7ff5b40c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b1400700 1 --2- 172.21.15.49:0/384305668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b40a8e50 0x7ff5b40ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b1e00700 1 -- 172.21.15.49:0/384305668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5b4155d20 msgr2=0x7ff5b40c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b1e00700 1 --2- 172.21.15.49:0/384305668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5b4155d20 0x7ff5b40c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b1e00700 1 -- 172.21.15.49:0/384305668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b40a8e50 msgr2=0x7ff5b40ab020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b1e00700 1 --2- 172.21.15.49:0/384305668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b40a8e50 0x7ff5b40ab020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:58.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b1e00700 1 -- 172.21.15.49:0/384305668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac009a20 con 0x7ff5b4066070 2024-01-22T05:08:58.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b1400700 1 --2- 172.21.15.49:0/384305668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b40a8e50 0x7ff5b40ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:58.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b1e00700 1 --2- 172.21.15.49:0/384305668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b4066070 0x7ff5b41535c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7ff5a4009d50 tx=0x7ff5a4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:58.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5a9600700 1 -- 172.21.15.49:0/384305668 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4000d10 con 0x7ff5b4066070 2024-01-22T05:08:58.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5a9600700 1 -- 172.21.15.49:0/384305668 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a400d770 con 0x7ff5b4066070 2024-01-22T05:08:58.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b8c00700 1 -- 172.21.15.49:0/384305668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a40092a0 con 0x7ff5b4066070 2024-01-22T05:08:58.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5a9600700 1 -- 172.21.15.49:0/384305668 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a401d640 con 0x7ff5b4066070 2024-01-22T05:08:58.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.383+0000 7ff5b8c00700 1 -- 172.21.15.49:0/384305668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b40a95b0 con 0x7ff5b4066070 2024-01-22T05:08:58.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.387+0000 7ff5b8c00700 1 -- 172.21.15.49:0/384305668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b40aa360 con 0x7ff5b4066070 2024-01-22T05:08:58.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.387+0000 7ff5a9600700 1 -- 172.21.15.49:0/384305668 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff5a401da70 con 0x7ff5b4066070 2024-01-22T05:08:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.387+0000 7ff5a9600700 1 --2- 172.21.15.49:0/384305668 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff58c05a510 0x7ff58c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:58.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.387+0000 7ff5a9600700 1 -- 172.21.15.49:0/384305668 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5708+0+0 (secure 0 0 0) 0x7ff5a4075f70 con 0x7ff5b4066070 2024-01-22T05:08:58.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.387+0000 7ff5b1400700 1 --2- 172.21.15.49:0/384305668 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff58c05a510 0x7ff58c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:58.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.391+0000 7ff5b1400700 1 --2- 172.21.15.49:0/384305668 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff58c05a510 0x7ff58c05c9d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7ff59c007fd0 tx=0x7ff59c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:58.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.395+0000 7ff5a9600700 1 -- 172.21.15.49:0/384305668 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff5a4049830 con 0x7ff5b4066070 2024-01-22T05:08:58.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:58.579+0000 7ff5b8c00700 1 -- 172.21.15.49:0/384305668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff5b40c23c0 con 0x7ff5b4066070 2024-01-22T05:08:59.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.431+0000 7ff5a9600700 1 -- 172.21.15.49:0/384305668 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v66) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff5a404ce50 con 0x7ff5b4066070 2024-01-22T05:08:59.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.435+0000 7ff5b8c00700 1 -- 172.21.15.49:0/384305668 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff58c05a510 msgr2=0x7ff58c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:59.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.435+0000 7ff5b8c00700 1 --2- 172.21.15.49:0/384305668 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff58c05a510 0x7ff58c05c9d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7ff59c007fd0 tx=0x7ff59c009040).stop 2024-01-22T05:08:59.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.435+0000 7ff5b8c00700 1 -- 172.21.15.49:0/384305668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b4066070 msgr2=0x7ff5b41535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:59.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.435+0000 7ff5b8c00700 1 --2- 172.21.15.49:0/384305668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b4066070 0x7ff5b41535c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7ff5a4009d50 tx=0x7ff5a4016000).stop 2024-01-22T05:08:59.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.435+0000 7ff5b8c00700 1 -- 172.21.15.49:0/384305668 shutdown_connections 2024-01-22T05:08:59.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.435+0000 7ff5b8c00700 1 --2- 172.21.15.49:0/384305668 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff58c05a510 0x7ff58c05c9d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:59.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.435+0000 7ff5b8c00700 1 --2- 172.21.15.49:0/384305668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5b4155d20 0x7ff5b40c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:59.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.435+0000 7ff5b8c00700 1 --2- 172.21.15.49:0/384305668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b40a8e50 0x7ff5b40ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:59.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.435+0000 7ff5b8c00700 1 --2- 172.21.15.49:0/384305668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5b4066070 0x7ff5b41535c0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:59.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.435+0000 7ff5b8c00700 1 -- 172.21.15.49:0/384305668 >> 172.21.15.49:0/384305668 conn(0x7ff5b40c6540 msgr2=0x7ff5b40c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:59.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.435+0000 7ff5b8c00700 1 -- 172.21.15.49:0/384305668 shutdown_connections 2024-01-22T05:08:59.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.435+0000 7ff5b8c00700 1 -- 172.21.15.49:0/384305668 wait complete. 2024-01-22T05:08:59.441 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-01-22T05:08:59.462 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-22T05:08:59.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.619+0000 7f6b28200700 1 Processor -- start 2024-01-22T05:08:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.619+0000 7f6b28200700 1 -- start start 2024-01-22T05:08:59.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.619+0000 7f6b28200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6b20155d20 0x7f6b20065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:59.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b28200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b200a8e50 0x7f6b200c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:59.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b28200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b200c1a40 con 0x7f6b20066070 2024-01-22T05:08:59.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b28200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b20159310 con 0x7f6b20155d20 2024-01-22T05:08:59.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b28200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b200c13f0 con 0x7f6b200a8e50 2024-01-22T05:08:59.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b25800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6b20155d20 0x7f6b20065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:59.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b24e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6b20066070 0x7f6b200a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37514/0 (socket says 172.21.15.49:37514) 2024-01-22T05:08:59.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b24e00700 1 -- 172.21.15.49:0/933499620 learned_addr learned my addr 172.21.15.49:0/933499620 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:08:59.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b26200700 1 --2- 172.21.15.49:0/933499620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b200a8e50 0x7f6b200c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b25800700 1 -- 172.21.15.49:0/933499620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b200a8e50 msgr2=0x7f6b200c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:08:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b25800700 1 --2- 172.21.15.49:0/933499620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b200a8e50 0x7f6b200c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b25800700 1 -- 172.21.15.49:0/933499620 >> v1:172.21.15.49:6789/0 conn(0x7f6b20066070 legacy=0x7f6b200a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b25800700 1 -- 172.21.15.49:0/933499620 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b200c16d0 con 0x7f6b20155d20 2024-01-22T05:08:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b1fe00700 1 -- 172.21.15.49:0/933499620 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185840954 0 0) 0x7f6b200c1a40 con 0x7f6b20066070 2024-01-22T05:08:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b25800700 1 --2- 172.21.15.49:0/933499620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b20155d20 0x7f6b20065b80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f6b10009760 tx=0x7f6b10009060).ready entity=mon.0 client_cookie=2c65cd9deda5fa83 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:59.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b1fe00700 1 -- 172.21.15.49:0/933499620 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000f510 con 0x7f6b20155d20 2024-01-22T05:08:59.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b1fe00700 1 -- 172.21.15.49:0/933499620 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1000f670 con 0x7f6b20155d20 2024-01-22T05:08:59.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.623+0000 7f6b1fe00700 1 -- 172.21.15.49:0/933499620 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000f9f0 con 0x7f6b20155d20 2024-01-22T05:08:59.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.627+0000 7f6b28200700 1 -- 172.21.15.49:0/933499620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b20155d20 msgr2=0x7f6b20065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:59.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.627+0000 7f6b28200700 1 --2- 172.21.15.49:0/933499620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b20155d20 0x7f6b20065b80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f6b10009760 tx=0x7f6b10009060).stop 2024-01-22T05:08:59.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.627+0000 7f6b28200700 1 -- 172.21.15.49:0/933499620 shutdown_connections 2024-01-22T05:08:59.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.627+0000 7f6b28200700 1 --2- 172.21.15.49:0/933499620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b200a8e50 0x7f6b200c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:59.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.627+0000 7f6b28200700 1 --2- 172.21.15.49:0/933499620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b20155d20 0x7f6b20065b80 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:59.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.627+0000 7f6b28200700 1 -- 172.21.15.49:0/933499620 >> 172.21.15.49:0/933499620 conn(0x7f6b200c6540 msgr2=0x7f6b200c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:59.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.627+0000 7f6b28200700 1 -- 172.21.15.49:0/933499620 shutdown_connections 2024-01-22T05:08:59.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.627+0000 7f6b28200700 1 -- 172.21.15.49:0/933499620 wait complete. 2024-01-22T05:08:59.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.631+0000 7f6b28200700 1 Processor -- start 2024-01-22T05:08:59.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.631+0000 7f6b28200700 1 -- start start 2024-01-22T05:08:59.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.631+0000 7f6b28200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b20066070 0x7f6b20150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:59.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.631+0000 7f6b28200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b200a8e50 0x7f6b20159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:59.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b28200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b20155d20 0x7f6b200bc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:59.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b28200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b201504f0 con 0x7f6b20155d20 2024-01-22T05:08:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b28200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b20159dc0 con 0x7f6b20066070 2024-01-22T05:08:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b28200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2015a0a0 con 0x7f6b200a8e50 2024-01-22T05:08:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b26200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b20155d20 0x7f6b200bc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b26200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b20155d20 0x7f6b200bc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42508/0 (socket says 172.21.15.49:42508) 2024-01-22T05:08:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b26200700 1 -- 172.21.15.49:0/2970905686 learned_addr learned my addr 172.21.15.49:0/2970905686 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:08:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b24e00700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b200a8e50 0x7f6b20159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b25800700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b20066070 0x7f6b20150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b26200700 1 -- 172.21.15.49:0/2970905686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b200a8e50 msgr2=0x7f6b20159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b26200700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b200a8e50 0x7f6b20159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b26200700 1 -- 172.21.15.49:0/2970905686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b20066070 msgr2=0x7f6b20150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b26200700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b20066070 0x7f6b20150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b26200700 1 -- 172.21.15.49:0/2970905686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b100092a0 con 0x7f6b20155d20 2024-01-22T05:08:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b24e00700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b200a8e50 0x7f6b20159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b25800700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b20066070 0x7f6b20150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:08:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b26200700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b20155d20 0x7f6b200bc530 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f6b18009e90 tx=0x7f6b1800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:59.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b1cc00700 1 -- 172.21.15.49:0/2970905686 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1800cc20 con 0x7f6b20155d20 2024-01-22T05:08:59.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b1cc00700 1 -- 172.21.15.49:0/2970905686 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1800f040 con 0x7f6b20155d20 2024-01-22T05:08:59.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b1cc00700 1 -- 172.21.15.49:0/2970905686 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b18013400 con 0x7f6b20155d20 2024-01-22T05:08:59.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b28200700 1 -- 172.21.15.49:0/2970905686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2015a380 con 0x7f6b20155d20 2024-01-22T05:08:59.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.635+0000 7f6b28200700 1 -- 172.21.15.49:0/2970905686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b200be4b0 con 0x7f6b20155d20 2024-01-22T05:08:59.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.639+0000 7f6b28200700 1 -- 172.21.15.49:0/2970905686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b20047060 con 0x7f6b20155d20 2024-01-22T05:08:59.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.639+0000 7f6b1cc00700 1 -- 172.21.15.49:0/2970905686 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6b180137b0 con 0x7f6b20155d20 2024-01-22T05:08:59.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.639+0000 7f6b1cc00700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6af805a510 0x7f6af805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:08:59.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.639+0000 7f6b1cc00700 1 -- 172.21.15.49:0/2970905686 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f6b18074f50 con 0x7f6b20155d20 2024-01-22T05:08:59.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.639+0000 7f6b25800700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6af805a510 0x7f6af805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:08:59.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.643+0000 7f6b25800700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6af805a510 0x7f6af805c9d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f6b200685b0 tx=0x7f6b10017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:08:59.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.647+0000 7f6b1cc00700 1 -- 172.21.15.49:0/2970905686 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6b18048860 con 0x7f6b20155d20 2024-01-22T05:08:59.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.871+0000 7f6b28200700 1 -- 172.21.15.49:0/2970905686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6b20067a90 con 0x7f6b20155d20 2024-01-22T05:08:59.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.871+0000 7f6b1cc00700 1 -- 172.21.15.49:0/2970905686 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6b1804be80 con 0x7f6b20155d20 2024-01-22T05:08:59.876 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:08:59.876 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:08:59.876 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-01-22T05:08:59.876 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.876 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-01-22T05:08:59.876 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lTCfoJxAAxDGvXKXgooA9/f0J70s6AA==", 2024-01-22T05:08:59.876 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.876 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:08:59.876 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:08:59.876 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:08:59.876 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:08:59.876 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.877 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.877 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.877 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-01-22T05:08:59.877 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lHqV6ORAA1DwpPV2PyDBF/6/ePTdQJw==", 2024-01-22T05:08:59.877 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.877 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:08:59.877 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:08:59.877 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:08:59.877 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:08:59.877 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.877 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.877 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.877 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-01-22T05:08:59.877 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lPo86MhAAonfC3M+AkLldljODYNGzyA==", 2024-01-22T05:08:59.878 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.878 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:08:59.878 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:08:59.878 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:08:59.878 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:08:59.878 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.878 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.878 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.878 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-01-22T05:08:59.878 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lLwvMBxAAFm52HWeGbTH1gbWVm6r5zQ==", 2024-01-22T05:08:59.878 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.879 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:08:59.879 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:08:59.879 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:08:59.879 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:08:59.879 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.879 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.879 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.879 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-01-22T05:08:59.879 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAt961lH2F9NBAAHm8R9/Q5IuFUvb0o1GyD4Q==", 2024-01-22T05:08:59.879 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.879 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:08:59.879 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:08:59.880 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:08:59.880 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.880 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.880 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.880 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-01-22T05:08:59.880 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAx961lS1lEIhAAuDm2OYfTYff1kVEq5vXvFw==", 2024-01-22T05:08:59.880 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.880 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:08:59.880 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:08:59.880 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:08:59.880 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.880 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.880 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.880 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-01-22T05:08:59.881 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA1961limLvERAAv23crKrwjLIg84u48BHHbg==", 2024-01-22T05:08:59.881 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.881 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:08:59.881 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:08:59.881 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:08:59.881 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.881 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.881 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.881 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2024-01-22T05:08:59.881 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA5961lShJiABAAnvyhz0ggDaITaMgwzi9kAA==", 2024-01-22T05:08:59.881 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.881 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:08:59.881 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:08:59.881 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:08:59.881 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.882 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.882 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.882 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2024-01-22T05:08:59.882 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA9961lcopfNRAAAZgHzI1t7YHI5cAjaCMiNw==", 2024-01-22T05:08:59.882 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.882 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:08:59.882 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:08:59.882 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:08:59.882 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.882 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.882 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.882 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2024-01-22T05:08:59.882 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBB961lX+nTIxAAtP3YQypuFWM5O/LADjvybA==", 2024-01-22T05:08:59.882 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.882 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:08:59.883 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:08:59.883 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:08:59.883 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.883 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.883 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.883 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2024-01-22T05:08:59.883 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBF961lQ4/XERAARZPqENsV3jokk2g3OXUI5w==", 2024-01-22T05:08:59.883 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.883 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:08:59.883 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:08:59.883 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:08:59.883 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.883 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.883 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.883 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2024-01-22T05:08:59.884 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBI961luxnqOhAAGsV74DKQda5cetNA/woOnA==", 2024-01-22T05:08:59.884 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.884 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:08:59.884 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:08:59.884 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:08:59.884 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.884 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.884 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.884 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-01-22T05:08:59.884 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lmrM6DhAAYU09HviWyrUIz4lio15wFw==", 2024-01-22T05:08:59.884 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.884 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:08:59.884 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-01-22T05:08:59.884 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-22T05:08:59.884 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.885 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.885 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.885 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-01-22T05:08:59.885 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lIhYRGRAAFG+YtkDLFsra6zU44xKCHw==", 2024-01-22T05:08:59.885 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.885 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:08:59.885 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:08:59.885 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:08:59.885 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:08:59.885 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.885 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.885 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.885 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2024-01-22T05:08:59.885 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lRuyaExAAQO3a7ahOEcuE+WVfXYEBTg==", 2024-01-22T05:08:59.885 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lMiMkHhAAxPdKpcHdtqSphbc/2agq9Q==", 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.887 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.887 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-01-22T05:08:59.887 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961ljsweARAAJrY3z/sBjayjB2BRQNrJew==", 2024-01-22T05:08:59.887 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.887 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:08:59.887 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:08:59.887 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:08:59.887 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:08:59.887 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.887 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.887 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.887 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-01-22T05:08:59.887 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961l0DwDIhAAeuCu79LxNMEJvWiW/BfDhA==", 2024-01-22T05:08:59.887 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.887 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:08:59.888 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:08:59.888 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:08:59.888 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.888 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:08:59.888 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:08:59.888 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2024-01-22T05:08:59.888 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lZlmPGxAA1KVZR+XzNdoFVo/980hD8w==", 2024-01-22T05:08:59.888 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:08:59.888 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:08:59.888 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:08:59.888 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:08:59.888 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.888 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:08:59.888 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-01-22T05:08:59.889 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:08:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.875+0000 7f6b28200700 1 -- 172.21.15.49:0/2970905686 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6af805a510 msgr2=0x7f6af805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.875+0000 7f6b28200700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6af805a510 0x7f6af805c9d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f6b200685b0 tx=0x7f6b10017000).stop 2024-01-22T05:08:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.875+0000 7f6b28200700 1 -- 172.21.15.49:0/2970905686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b20155d20 msgr2=0x7f6b200bc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:08:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.875+0000 7f6b28200700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b20155d20 0x7f6b200bc530 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f6b18009e90 tx=0x7f6b1800b040).stop 2024-01-22T05:08:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.875+0000 7f6b28200700 1 -- 172.21.15.49:0/2970905686 shutdown_connections 2024-01-22T05:08:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.875+0000 7f6b28200700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6af805a510 0x7f6af805c9d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.875+0000 7f6b28200700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b20155d20 0x7f6b200bc530 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.875+0000 7f6b28200700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b200a8e50 0x7f6b20159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.875+0000 7f6b28200700 1 --2- 172.21.15.49:0/2970905686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b20066070 0x7f6b20150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:08:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.875+0000 7f6b28200700 1 -- 172.21.15.49:0/2970905686 >> 172.21.15.49:0/2970905686 conn(0x7f6b200c6540 msgr2=0x7f6b20066520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:08:59.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.875+0000 7f6b28200700 1 -- 172.21.15.49:0/2970905686 shutdown_connections 2024-01-22T05:08:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:08:59.875+0000 7f6b28200700 1 -- 172.21.15.49:0/2970905686 wait complete. 2024-01-22T05:08:59.903 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:09:00.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.059+0000 7f45cc800700 1 Processor -- start 2024-01-22T05:09:00.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.059+0000 7f45cc800700 1 -- start start 2024-01-22T05:09:00.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.059+0000 7f45cc800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45c4064c00 0x7f45c40bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.059+0000 7f45cc800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f45c4065620 0x7f45c40bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.059+0000 7f45cc800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c40c2700 con 0x7f45c4065240 2024-01-22T05:09:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.059+0000 7f45cc800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c40c29a0 con 0x7f45c4065620 2024-01-22T05:09:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.059+0000 7f45cc800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40c2c80 con 0x7f45c4064c00 2024-01-22T05:09:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.059+0000 7f45cb200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f45c4065620 0x7f45c40bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.059+0000 7f45cb200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f45c4065620 0x7f45c40bd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:57218/0 (socket says 172.21.15.49:57218) 2024-01-22T05:09:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.059+0000 7f45cb200700 1 -- 172.21.15.49:0/2561203630 learned_addr learned my addr 172.21.15.49:0/2561203630 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:00.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.059+0000 7f45c9400700 1 --2- 172.21.15.49:0/2561203630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45c4064c00 0x7f45c40bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45cb200700 1 -- 172.21.15.49:0/2561203630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45c4064c00 msgr2=0x7f45c40bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:00.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45cb200700 1 --2- 172.21.15.49:0/2561203630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45c4064c00 0x7f45c40bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45cb200700 1 -- 172.21.15.49:0/2561203630 >> v1:172.21.15.110:6789/0 conn(0x7f45c4065240 legacy=0x7f45c40644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45cb200700 1 -- 172.21.15.49:0/2561203630 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c40c2f60 con 0x7f45c4065620 2024-01-22T05:09:00.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45cb200700 1 --2- 172.21.15.49:0/2561203630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c4065620 0x7f45c40bd170 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f45bc009f20 tx=0x7f45bc009840).ready entity=mon.1 client_cookie=219316c8792d938c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:00.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45c8a00700 1 -- 172.21.15.49:0/2561203630 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc00e070 con 0x7f45c4065620 2024-01-22T05:09:00.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45c8a00700 1 -- 172.21.15.49:0/2561203630 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc00b9d0 con 0x7f45c4065620 2024-01-22T05:09:00.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45c8a00700 1 -- 172.21.15.49:0/2561203630 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc00bd50 con 0x7f45c4065620 2024-01-22T05:09:00.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45cc800700 1 -- 172.21.15.49:0/2561203630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c4065620 msgr2=0x7f45c40bd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45cc800700 1 --2- 172.21.15.49:0/2561203630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c4065620 0x7f45c40bd170 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f45bc009f20 tx=0x7f45bc009840).stop 2024-01-22T05:09:00.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45cc800700 1 -- 172.21.15.49:0/2561203630 shutdown_connections 2024-01-22T05:09:00.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45cc800700 1 --2- 172.21.15.49:0/2561203630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c4065620 0x7f45c40bd170 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45cc800700 1 --2- 172.21.15.49:0/2561203630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45c4064c00 0x7f45c40bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45cc800700 1 -- 172.21.15.49:0/2561203630 >> 172.21.15.49:0/2561203630 conn(0x7f45c40c87f0 msgr2=0x7f45c40c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:00.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45cc800700 1 -- 172.21.15.49:0/2561203630 shutdown_connections 2024-01-22T05:09:00.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.063+0000 7f45cc800700 1 -- 172.21.15.49:0/2561203630 wait complete. 2024-01-22T05:09:00.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.067+0000 7f45cc800700 1 Processor -- start 2024-01-22T05:09:00.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.067+0000 7f45cc800700 1 -- start start 2024-01-22T05:09:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cc800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45c4064c00 0x7f45c416b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cc800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c4065240 0x7f45c40aa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cc800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c4065620 0x7f45c4148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cc800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c416c7a0 con 0x7f45c4065620 2024-01-22T05:09:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cc800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c416bcf0 con 0x7f45c4065240 2024-01-22T05:09:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cc800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40aa4f0 con 0x7f45c4064c00 2024-01-22T05:09:00.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cb200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c4065620 0x7f45c4148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cb200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c4065620 0x7f45c4148ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42512/0 (socket says 172.21.15.49:42512) 2024-01-22T05:09:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cb200700 1 -- 172.21.15.49:0/1169691401 learned_addr learned my addr 172.21.15.49:0/1169691401 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45c9400700 1 --2- 172.21.15.49:0/1169691401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c4065240 0x7f45c40aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45c9e00700 1 --2- 172.21.15.49:0/1169691401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45c4064c00 0x7f45c416b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cb200700 1 -- 172.21.15.49:0/1169691401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45c4064c00 msgr2=0x7f45c416b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cb200700 1 --2- 172.21.15.49:0/1169691401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45c4064c00 0x7f45c416b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cb200700 1 -- 172.21.15.49:0/1169691401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c4065240 msgr2=0x7f45c40aa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cb200700 1 --2- 172.21.15.49:0/1169691401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c4065240 0x7f45c40aa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cb200700 1 -- 172.21.15.49:0/1169691401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc009ae0 con 0x7f45c4065620 2024-01-22T05:09:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cb200700 1 --2- 172.21.15.49:0/1169691401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c4065620 0x7f45c4148ec0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f45bc010000 tx=0x7f45c40c2890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45c1600700 1 -- 172.21.15.49:0/1169691401 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc00bd50 con 0x7f45c4065620 2024-01-22T05:09:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45c1600700 1 -- 172.21.15.49:0/1169691401 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc0092e0 con 0x7f45c4065620 2024-01-22T05:09:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45c1600700 1 -- 172.21.15.49:0/1169691401 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc01d6b0 con 0x7f45c4065620 2024-01-22T05:09:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cc800700 1 -- 172.21.15.49:0/1169691401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c41681f0 con 0x7f45c4065620 2024-01-22T05:09:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.071+0000 7f45cc800700 1 -- 172.21.15.49:0/1169691401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c416bf00 con 0x7f45c4065620 2024-01-22T05:09:00.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.075+0000 7f45cc800700 1 -- 172.21.15.49:0/1169691401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c4168680 con 0x7f45c4065620 2024-01-22T05:09:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.075+0000 7f45c1600700 1 -- 172.21.15.49:0/1169691401 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f45bc003040 con 0x7f45c4065620 2024-01-22T05:09:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.075+0000 7f45c1600700 1 --2- 172.21.15.49:0/1169691401 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f459c05a540 0x7f459c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.075+0000 7f45c1600700 1 -- 172.21.15.49:0/1169691401 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f45bc0758d0 con 0x7f45c4065620 2024-01-22T05:09:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.079+0000 7f45c9e00700 1 --2- 172.21.15.49:0/1169691401 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f459c05a540 0x7f459c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.079+0000 7f45c9e00700 1 --2- 172.21.15.49:0/1169691401 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f459c05a540 0x7f459c05ca00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f45b40036d0 tx=0x7f45b4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:00.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.083+0000 7f45c1600700 1 -- 172.21.15.49:0/1169691401 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f45c4168680 con 0x7f45c4065620 2024-01-22T05:09:00.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.251+0000 7f45cc800700 1 -- 172.21.15.49:0/1169691401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45c4168680 con 0x7f45c4065620 2024-01-22T05:09:00.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.251+0000 7f45c1600700 1 -- 172.21.15.49:0/1169691401 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+13948 (secure 0 0 0) 0x7f45c4168680 con 0x7f45c4065620 2024-01-22T05:09:00.256 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:00.256 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":66,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:08:59.420684+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:09:00.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.255+0000 7f45cc800700 1 -- 172.21.15.49:0/1169691401 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f459c05a540 msgr2=0x7f459c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.255+0000 7f45cc800700 1 --2- 172.21.15.49:0/1169691401 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f459c05a540 0x7f459c05ca00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f45b40036d0 tx=0x7f45b4009040).stop 2024-01-22T05:09:00.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.255+0000 7f45cc800700 1 -- 172.21.15.49:0/1169691401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c4065620 msgr2=0x7f45c4148ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.255+0000 7f45cc800700 1 --2- 172.21.15.49:0/1169691401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c4065620 0x7f45c4148ec0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f45bc010000 tx=0x7f45c40c2890).stop 2024-01-22T05:09:00.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.255+0000 7f45cc800700 1 -- 172.21.15.49:0/1169691401 shutdown_connections 2024-01-22T05:09:00.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.255+0000 7f45cc800700 1 --2- 172.21.15.49:0/1169691401 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f459c05a540 0x7f459c05ca00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.255+0000 7f45cc800700 1 --2- 172.21.15.49:0/1169691401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45c4065620 0x7f45c4148ec0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.255+0000 7f45cc800700 1 --2- 172.21.15.49:0/1169691401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c4065240 0x7f45c40aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.255+0000 7f45cc800700 1 --2- 172.21.15.49:0/1169691401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45c4064c00 0x7f45c416b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.255+0000 7f45cc800700 1 -- 172.21.15.49:0/1169691401 >> 172.21.15.49:0/1169691401 conn(0x7f45c40c87f0 msgr2=0x7f45c40ad650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:00.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.255+0000 7f45cc800700 1 -- 172.21.15.49:0/1169691401 shutdown_connections 2024-01-22T05:09:00.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.255+0000 7f45cc800700 1 -- 172.21.15.49:0/1169691401 wait complete. 2024-01-22T05:09:00.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:09:00.285 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:09:00.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.451+0000 7fb792600700 1 Processor -- start 2024-01-22T05:09:00.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.451+0000 7fb792600700 1 -- start start 2024-01-22T05:09:00.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.455+0000 7fb792600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb78c157b00 0x7fb78c157f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.455+0000 7fb792600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb78c0c15b0 0x7fb78c0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.455+0000 7fb792600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78c0c60d0 con 0x7fb78c063cd0 2024-01-22T05:09:00.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.455+0000 7fb792600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78c0c5270 con 0x7fb78c0c15b0 2024-01-22T05:09:00.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.455+0000 7fb792600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78c0c54c0 con 0x7fb78c157b00 2024-01-22T05:09:00.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.455+0000 7fb78be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb78c0c15b0 0x7fb78c0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.455+0000 7fb78be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb78c0c15b0 0x7fb78c0c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42524/0 (socket says 172.21.15.49:42524) 2024-01-22T05:09:00.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.455+0000 7fb78be00700 1 -- 172.21.15.49:0/362011632 learned_addr learned my addr 172.21.15.49:0/362011632 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:00.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.455+0000 7fb78b400700 1 --1- 172.21.15.49:0/362011632 >> v1:172.21.15.49:6789/0 conn(0x7fb78c063cd0 0x7fb78c068c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37528/0 (socket says 172.21.15.49:37528) 2024-01-22T05:09:00.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.455+0000 7fb78aa00700 1 --2- 172.21.15.49:0/362011632 >> v2:172.21.15.110:3300/0 conn(0x7fb78c157b00 0x7fb78c157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.455+0000 7fb78be00700 1 -- 172.21.15.49:0/362011632 >> v2:172.21.15.110:3300/0 conn(0x7fb78c157b00 msgr2=0x7fb78c157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:00.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.455+0000 7fb78be00700 1 --2- 172.21.15.49:0/362011632 >> v2:172.21.15.110:3300/0 conn(0x7fb78c157b00 0x7fb78c157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.455+0000 7fb78be00700 1 -- 172.21.15.49:0/362011632 >> v1:172.21.15.49:6789/0 conn(0x7fb78c063cd0 legacy=0x7fb78c068c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.455+0000 7fb78be00700 1 -- 172.21.15.49:0/362011632 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c0c57a0 con 0x7fb78c0c15b0 2024-01-22T05:09:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.455+0000 7fb78a000700 1 -- 172.21.15.49:0/362011632 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032108165 0 0) 0x7fb78c0c60d0 con 0x7fb78c063cd0 2024-01-22T05:09:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.459+0000 7fb78be00700 1 --2- 172.21.15.49:0/362011632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78c0c15b0 0x7fb78c0c19e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fb78c066eb0 tx=0x7fb784009840).ready entity=mon.0 client_cookie=ebac9df3f4bd4869 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.459+0000 7fb78a000700 1 -- 172.21.15.49:0/362011632 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78400e070 con 0x7fb78c0c15b0 2024-01-22T05:09:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.459+0000 7fb78a000700 1 -- 172.21.15.49:0/362011632 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78400ba20 con 0x7fb78c0c15b0 2024-01-22T05:09:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.459+0000 7fb78a000700 1 -- 172.21.15.49:0/362011632 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78400bda0 con 0x7fb78c0c15b0 2024-01-22T05:09:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.459+0000 7fb792600700 1 -- 172.21.15.49:0/362011632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78c0c15b0 msgr2=0x7fb78c0c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.459+0000 7fb792600700 1 --2- 172.21.15.49:0/362011632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78c0c15b0 0x7fb78c0c19e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fb78c066eb0 tx=0x7fb784009840).stop 2024-01-22T05:09:00.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.459+0000 7fb792600700 1 -- 172.21.15.49:0/362011632 shutdown_connections 2024-01-22T05:09:00.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.459+0000 7fb792600700 1 --2- 172.21.15.49:0/362011632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78c0c15b0 0x7fb78c0c19e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.459+0000 7fb792600700 1 --2- 172.21.15.49:0/362011632 >> v2:172.21.15.110:3300/0 conn(0x7fb78c157b00 0x7fb78c157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.459+0000 7fb792600700 1 -- 172.21.15.49:0/362011632 >> 172.21.15.49:0/362011632 conn(0x7fb78c065f90 msgr2=0x7fb78c0663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:00.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.459+0000 7fb792600700 1 -- 172.21.15.49:0/362011632 shutdown_connections 2024-01-22T05:09:00.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.459+0000 7fb792600700 1 -- 172.21.15.49:0/362011632 wait complete. 2024-01-22T05:09:00.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.463+0000 7fb792600700 1 Processor -- start 2024-01-22T05:09:00.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.463+0000 7fb792600700 1 -- start start 2024-01-22T05:09:00.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb792600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78c063cd0 0x7fb78c16c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb792600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb78c0c15b0 0x7fb78c09fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb792600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c157b00 0x7fb78c0bcf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb792600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c0a0550 con 0x7fb78c063cd0 2024-01-22T05:09:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb792600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c0a0340 con 0x7fb78c0c15b0 2024-01-22T05:09:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb792600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c15a9c0 con 0x7fb78c157b00 2024-01-22T05:09:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb78b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78c063cd0 0x7fb78c16c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb78b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78c063cd0 0x7fb78c16c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42536/0 (socket says 172.21.15.49:42536) 2024-01-22T05:09:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb78b400700 1 -- 172.21.15.49:0/1359291679 learned_addr learned my addr 172.21.15.49:0/1359291679 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb78aa00700 1 --2- 172.21.15.49:0/1359291679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb78c0c15b0 0x7fb78c09fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb78be00700 1 --2- 172.21.15.49:0/1359291679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c157b00 0x7fb78c0bcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb78b400700 1 -- 172.21.15.49:0/1359291679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c157b00 msgr2=0x7fb78c0bcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb78b400700 1 --2- 172.21.15.49:0/1359291679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c157b00 0x7fb78c0bcf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb78b400700 1 -- 172.21.15.49:0/1359291679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb78c0c15b0 msgr2=0x7fb78c09fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb78b400700 1 --2- 172.21.15.49:0/1359291679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb78c0c15b0 0x7fb78c09fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb78b400700 1 -- 172.21.15.49:0/1359291679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb784009ae0 con 0x7fb78c063cd0 2024-01-22T05:09:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb78b400700 1 --2- 172.21.15.49:0/1359291679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78c063cd0 0x7fb78c16c9c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fb77c00c810 tx=0x7fb77c007ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb782a00700 1 -- 172.21.15.49:0/1359291679 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c0072e0 con 0x7fb78c063cd0 2024-01-22T05:09:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb782a00700 1 -- 172.21.15.49:0/1359291679 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c007440 con 0x7fb78c063cd0 2024-01-22T05:09:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb782a00700 1 -- 172.21.15.49:0/1359291679 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c0058a0 con 0x7fb78c063cd0 2024-01-22T05:09:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb792600700 1 -- 172.21.15.49:0/1359291679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78c15a090 con 0x7fb78c063cd0 2024-01-22T05:09:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.467+0000 7fb792600700 1 -- 172.21.15.49:0/1359291679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78c15a650 con 0x7fb78c063cd0 2024-01-22T05:09:00.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.471+0000 7fb792600700 1 -- 172.21.15.49:0/1359291679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78c0bdc00 con 0x7fb78c063cd0 2024-01-22T05:09:00.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.471+0000 7fb782a00700 1 -- 172.21.15.49:0/1359291679 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb77c005c50 con 0x7fb78c063cd0 2024-01-22T05:09:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.471+0000 7fb782a00700 1 --2- 172.21.15.49:0/1359291679 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb76405a510 0x7fb76405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.471+0000 7fb782a00700 1 -- 172.21.15.49:0/1359291679 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fb77c073e80 con 0x7fb78c063cd0 2024-01-22T05:09:00.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.471+0000 7fb78aa00700 1 --2- 172.21.15.49:0/1359291679 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb76405a510 0x7fb76405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.475+0000 7fb78aa00700 1 --2- 172.21.15.49:0/1359291679 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb76405a510 0x7fb76405c9d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fb78c0c2b50 tx=0x7fb774008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:00.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.479+0000 7fb782a00700 1 -- 172.21.15.49:0/1359291679 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb78c0bdc00 con 0x7fb78c063cd0 2024-01-22T05:09:00.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.651+0000 7fb792600700 1 -- 172.21.15.49:0/1359291679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb78c0bdc00 con 0x7fb78c063cd0 2024-01-22T05:09:00.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.651+0000 7fb782a00700 1 -- 172.21.15.49:0/1359291679 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v66) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb78c0bdc00 con 0x7fb78c063cd0 2024-01-22T05:09:00.656 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:09:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.659+0000 7fb792600700 1 -- 172.21.15.49:0/1359291679 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb76405a510 msgr2=0x7fb76405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.659+0000 7fb792600700 1 --2- 172.21.15.49:0/1359291679 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb76405a510 0x7fb76405c9d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fb78c0c2b50 tx=0x7fb774008040).stop 2024-01-22T05:09:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.659+0000 7fb792600700 1 -- 172.21.15.49:0/1359291679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78c063cd0 msgr2=0x7fb78c16c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.659+0000 7fb792600700 1 --2- 172.21.15.49:0/1359291679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78c063cd0 0x7fb78c16c9c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fb77c00c810 tx=0x7fb77c007ba0).stop 2024-01-22T05:09:00.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.659+0000 7fb792600700 1 -- 172.21.15.49:0/1359291679 shutdown_connections 2024-01-22T05:09:00.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.659+0000 7fb792600700 1 --2- 172.21.15.49:0/1359291679 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb76405a510 0x7fb76405c9d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.659+0000 7fb792600700 1 --2- 172.21.15.49:0/1359291679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb78c157b00 0x7fb78c0bcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.659+0000 7fb792600700 1 --2- 172.21.15.49:0/1359291679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb78c0c15b0 0x7fb78c09fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.659+0000 7fb792600700 1 --2- 172.21.15.49:0/1359291679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78c063cd0 0x7fb78c16c9c0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.659+0000 7fb792600700 1 -- 172.21.15.49:0/1359291679 >> 172.21.15.49:0/1359291679 conn(0x7fb78c065f90 msgr2=0x7fb78c068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:00.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.659+0000 7fb792600700 1 -- 172.21.15.49:0/1359291679 shutdown_connections 2024-01-22T05:09:00.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.659+0000 7fb792600700 1 -- 172.21.15.49:0/1359291679 wait complete. 2024-01-22T05:09:00.683 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:09:00.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.847+0000 7f8f00a00700 1 Processor -- start 2024-01-22T05:09:00.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.847+0000 7f8f00a00700 1 -- start start 2024-01-22T05:09:00.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.851+0000 7f8f00a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc15c2d0 0x7f8efc065900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.851+0000 7f8f00a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc069600 con 0x7f8efc067a90 2024-01-22T05:09:00.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.851+0000 7f8f00a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc0a90f0 con 0x7f8efc065df0 2024-01-22T05:09:00.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.851+0000 7f8f00a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc1561a0 con 0x7f8efc15c2d0 2024-01-22T05:09:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.851+0000 7f8efb400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8efc067a90 0x7f8efc15bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37536/0 (socket says 172.21.15.49:37536) 2024-01-22T05:09:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.851+0000 7f8efb400700 1 -- 172.21.15.49:0/2324829951 learned_addr learned my addr 172.21.15.49:0/2324829951 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.851+0000 7f8efaa00700 1 --2- 172.21.15.49:0/2324829951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc15c2d0 0x7f8efc065900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.851+0000 7f8efa000700 1 -- 172.21.15.49:0/2324829951 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222783299 0 0) 0x7f8efc069600 con 0x7f8efc067a90 2024-01-22T05:09:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.851+0000 7f8efa000700 1 -- 172.21.15.49:0/2324829951 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8edc0033f0 con 0x7f8efc067a90 2024-01-22T05:09:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.851+0000 7f8efa000700 1 -- 172.21.15.49:0/2324829951 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240362530 0 0) 0x7f8efc0a90f0 con 0x7f8efc065df0 2024-01-22T05:09:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.851+0000 7f8efa000700 1 -- 172.21.15.49:0/2324829951 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8efc069600 con 0x7f8efc065df0 2024-01-22T05:09:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.851+0000 7f8efaa00700 1 -- 172.21.15.49:0/2324829951 >> v1:172.21.15.110:6789/0 conn(0x7f8efc065df0 legacy=0x7f8efc066260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.851+0000 7f8efaa00700 1 -- 172.21.15.49:0/2324829951 >> v1:172.21.15.49:6789/0 conn(0x7f8efc067a90 legacy=0x7f8efc15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.851+0000 7f8efaa00700 1 -- 172.21.15.49:0/2324829951 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc0681c0 con 0x7f8efc15c2d0 2024-01-22T05:09:00.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.855+0000 7f8efaa00700 1 --2- 172.21.15.49:0/2324829951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc15c2d0 0x7f8efc065900 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f8ee4009790 tx=0x7f8ee4009060).ready entity=mon.2 client_cookie=f7a05a99a2bacea8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:00.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.855+0000 7f8efa000700 1 -- 172.21.15.49:0/2324829951 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee400f510 con 0x7f8efc15c2d0 2024-01-22T05:09:00.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.855+0000 7f8efa000700 1 -- 172.21.15.49:0/2324829951 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee400f670 con 0x7f8efc15c2d0 2024-01-22T05:09:00.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.855+0000 7f8efa000700 1 -- 172.21.15.49:0/2324829951 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee400f9f0 con 0x7f8efc15c2d0 2024-01-22T05:09:00.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.855+0000 7f8f00a00700 1 -- 172.21.15.49:0/2324829951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc15c2d0 msgr2=0x7f8efc065900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.855+0000 7f8f00a00700 1 --2- 172.21.15.49:0/2324829951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc15c2d0 0x7f8efc065900 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f8ee4009790 tx=0x7f8ee4009060).stop 2024-01-22T05:09:00.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.855+0000 7f8f00a00700 1 -- 172.21.15.49:0/2324829951 shutdown_connections 2024-01-22T05:09:00.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.855+0000 7f8f00a00700 1 --2- 172.21.15.49:0/2324829951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc15c2d0 0x7f8efc065900 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.855+0000 7f8f00a00700 1 -- 172.21.15.49:0/2324829951 >> 172.21.15.49:0/2324829951 conn(0x7f8efc0c6fc0 msgr2=0x7f8efc0c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:00.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.855+0000 7f8f00a00700 1 -- 172.21.15.49:0/2324829951 shutdown_connections 2024-01-22T05:09:00.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.855+0000 7f8f00a00700 1 -- 172.21.15.49:0/2324829951 wait complete. 2024-01-22T05:09:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8f00a00700 1 Processor -- start 2024-01-22T05:09:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8f00a00700 1 -- start start 2024-01-22T05:09:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8f00a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc065df0 0x7f8efc1562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8f00a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8efc067a90 0x7f8efc16c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8f00a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8efc15c2d0 0x7f8efc16c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8f00a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc16ce60 con 0x7f8efc067a90 2024-01-22T05:09:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8f00a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc0a98b0 con 0x7f8efc15c2d0 2024-01-22T05:09:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8f00a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc0ac530 con 0x7f8efc065df0 2024-01-22T05:09:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8efaa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8efc067a90 0x7f8efc16c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8efaa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8efc067a90 0x7f8efc16c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42544/0 (socket says 172.21.15.49:42544) 2024-01-22T05:09:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8efaa00700 1 -- 172.21.15.49:0/3474553571 learned_addr learned my addr 172.21.15.49:0/3474553571 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8efb400700 1 --2- 172.21.15.49:0/3474553571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc065df0 0x7f8efc1562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8efbe00700 1 --2- 172.21.15.49:0/3474553571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8efc15c2d0 0x7f8efc16c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8efaa00700 1 -- 172.21.15.49:0/3474553571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc065df0 msgr2=0x7f8efc1562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8efaa00700 1 --2- 172.21.15.49:0/3474553571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc065df0 0x7f8efc1562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8efaa00700 1 -- 172.21.15.49:0/3474553571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8efc15c2d0 msgr2=0x7f8efc16c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:00.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8efaa00700 1 --2- 172.21.15.49:0/3474553571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8efc15c2d0 0x7f8efc16c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:00.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.859+0000 7f8efaa00700 1 -- 172.21.15.49:0/3474553571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee40092a0 con 0x7f8efc067a90 2024-01-22T05:09:00.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.863+0000 7f8efaa00700 1 --2- 172.21.15.49:0/3474553571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8efc067a90 0x7f8efc16c480 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f8ee4011000 tx=0x7f8ee4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:00.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.863+0000 7f8ef2a00700 1 -- 172.21.15.49:0/3474553571 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee400f7e0 con 0x7f8efc067a90 2024-01-22T05:09:00.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.863+0000 7f8ef2a00700 1 -- 172.21.15.49:0/3474553571 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee400f940 con 0x7f8efc067a90 2024-01-22T05:09:00.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.863+0000 7f8f00a00700 1 -- 172.21.15.49:0/3474553571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8efc156cc0 con 0x7f8efc067a90 2024-01-22T05:09:00.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.863+0000 7f8ef2a00700 1 -- 172.21.15.49:0/3474553571 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee401b660 con 0x7f8efc067a90 2024-01-22T05:09:00.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.863+0000 7f8f00a00700 1 -- 172.21.15.49:0/3474553571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8efc157280 con 0x7f8efc067a90 2024-01-22T05:09:00.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.863+0000 7f8f00a00700 1 -- 172.21.15.49:0/3474553571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8efc1595f0 con 0x7f8efc067a90 2024-01-22T05:09:00.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.867+0000 7f8ef2a00700 1 -- 172.21.15.49:0/3474553571 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8ee401b9d0 con 0x7f8efc067a90 2024-01-22T05:09:00.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.867+0000 7f8ef2a00700 1 --2- 172.21.15.49:0/3474553571 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8ed405a510 0x7f8ed405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:00.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.867+0000 7f8ef2a00700 1 -- 172.21.15.49:0/3474553571 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f8ee4075ff0 con 0x7f8efc067a90 2024-01-22T05:09:00.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.871+0000 7f8efb400700 1 --2- 172.21.15.49:0/3474553571 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8ed405a510 0x7f8ed405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:00.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.871+0000 7f8efb400700 1 --2- 172.21.15.49:0/3474553571 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8ed405a510 0x7f8ed405c9d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f8eec007fd0 tx=0x7f8eec009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:00.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:00.875+0000 7f8ef2a00700 1 -- 172.21.15.49:0/3474553571 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8ee40a4b00 con 0x7f8efc067a90 2024-01-22T05:09:00.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-01-22T05:09:01.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.035+0000 7f8f00a00700 1 -- 172.21.15.49:0/3474553571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8efc0a9a20 con 0x7f8efc067a90 2024-01-22T05:09:01.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.035+0000 7f8ef2a00700 1 -- 172.21.15.49:0/3474553571 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v66) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8ee401f020 con 0x7f8efc067a90 2024-01-22T05:09:01.039 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:09:01.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.039+0000 7f8f00a00700 1 -- 172.21.15.49:0/3474553571 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8ed405a510 msgr2=0x7f8ed405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:01.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.039+0000 7f8f00a00700 1 --2- 172.21.15.49:0/3474553571 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8ed405a510 0x7f8ed405c9d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f8eec007fd0 tx=0x7f8eec009040).stop 2024-01-22T05:09:01.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.039+0000 7f8f00a00700 1 -- 172.21.15.49:0/3474553571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8efc067a90 msgr2=0x7f8efc16c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:01.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.039+0000 7f8f00a00700 1 --2- 172.21.15.49:0/3474553571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8efc067a90 0x7f8efc16c480 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f8ee4011000 tx=0x7f8ee4017000).stop 2024-01-22T05:09:01.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.039+0000 7f8f00a00700 1 -- 172.21.15.49:0/3474553571 shutdown_connections 2024-01-22T05:09:01.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.039+0000 7f8f00a00700 1 --2- 172.21.15.49:0/3474553571 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8ed405a510 0x7f8ed405c9d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.039+0000 7f8f00a00700 1 --2- 172.21.15.49:0/3474553571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8efc15c2d0 0x7f8efc16c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.039+0000 7f8f00a00700 1 --2- 172.21.15.49:0/3474553571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8efc067a90 0x7f8efc16c480 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.039+0000 7f8f00a00700 1 --2- 172.21.15.49:0/3474553571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc065df0 0x7f8efc1562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.039+0000 7f8f00a00700 1 -- 172.21.15.49:0/3474553571 >> 172.21.15.49:0/3474553571 conn(0x7f8efc0c6fc0 msgr2=0x7f8efc0bccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:01.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.039+0000 7f8f00a00700 1 -- 172.21.15.49:0/3474553571 shutdown_connections 2024-01-22T05:09:01.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.039+0000 7f8f00a00700 1 -- 172.21.15.49:0/3474553571 wait complete. 2024-01-22T05:09:01.066 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:09:01.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.223+0000 7f3436200700 1 Processor -- start 2024-01-22T05:09:01.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.223+0000 7f3436200700 1 -- start start 2024-01-22T05:09:01.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.227+0000 7f3436200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f34301547c0 0x7f34300c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:01.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.227+0000 7f3436200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34300691b0 0x7f34300bbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:01.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.227+0000 7f3436200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34300c2330 con 0x7f34301500b0 2024-01-22T05:09:01.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.227+0000 7f3436200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3430066950 con 0x7f34301547c0 2024-01-22T05:09:01.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.227+0000 7f3436200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34300c2610 con 0x7f34300691b0 2024-01-22T05:09:01.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.227+0000 7f342fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34300691b0 0x7f34300bbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:01.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.227+0000 7f342fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34300691b0 0x7f34300bbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:60140/0 (socket says 172.21.15.49:60140) 2024-01-22T05:09:01.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.227+0000 7f342fe00700 1 -- 172.21.15.49:0/1292805786 learned_addr learned my addr 172.21.15.49:0/1292805786 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:01.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.227+0000 7f342f400700 1 --2- 172.21.15.49:0/1292805786 >> v2:172.21.15.110:3300/0 conn(0x7f34301547c0 0x7f34300c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:01.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.227+0000 7f342fe00700 1 -- 172.21.15.49:0/1292805786 >> v2:172.21.15.110:3300/0 conn(0x7f34301547c0 msgr2=0x7f34300c30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:01.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.227+0000 7f342fe00700 1 --2- 172.21.15.49:0/1292805786 >> v2:172.21.15.110:3300/0 conn(0x7f34301547c0 0x7f34300c30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.227+0000 7f342fe00700 1 -- 172.21.15.49:0/1292805786 >> v1:172.21.15.110:6789/0 conn(0x7f34301500b0 legacy=0x7f3430068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:01.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.227+0000 7f342fe00700 1 -- 172.21.15.49:0/1292805786 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34300c28f0 con 0x7f34300691b0 2024-01-22T05:09:01.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.231+0000 7f342fe00700 1 --2- 172.21.15.49:0/1292805786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34300691b0 0x7f34300bbf10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f3428009f20 tx=0x7f3428009840).ready entity=mon.2 client_cookie=17b1f6d46ac070e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:01.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.231+0000 7f342e000700 1 -- 172.21.15.49:0/1292805786 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342800e070 con 0x7f34300691b0 2024-01-22T05:09:01.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.231+0000 7f342e000700 1 -- 172.21.15.49:0/1292805786 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342800b9d0 con 0x7f34300691b0 2024-01-22T05:09:01.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.231+0000 7f342e000700 1 -- 172.21.15.49:0/1292805786 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342800bd50 con 0x7f34300691b0 2024-01-22T05:09:01.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.231+0000 7f3436200700 1 -- 172.21.15.49:0/1292805786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34300691b0 msgr2=0x7f34300bbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:01.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.231+0000 7f3436200700 1 --2- 172.21.15.49:0/1292805786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34300691b0 0x7f34300bbf10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f3428009f20 tx=0x7f3428009840).stop 2024-01-22T05:09:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.231+0000 7f3436200700 1 -- 172.21.15.49:0/1292805786 shutdown_connections 2024-01-22T05:09:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.231+0000 7f3436200700 1 --2- 172.21.15.49:0/1292805786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34300691b0 0x7f34300bbf10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.231+0000 7f3436200700 1 --2- 172.21.15.49:0/1292805786 >> v2:172.21.15.110:3300/0 conn(0x7f34301547c0 0x7f34300c30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.231+0000 7f3436200700 1 -- 172.21.15.49:0/1292805786 >> 172.21.15.49:0/1292805786 conn(0x7f34300c4300 msgr2=0x7f3430065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.231+0000 7f3436200700 1 -- 172.21.15.49:0/1292805786 shutdown_connections 2024-01-22T05:09:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.231+0000 7f3436200700 1 -- 172.21.15.49:0/1292805786 wait complete. 2024-01-22T05:09:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.235+0000 7f3436200700 1 Processor -- start 2024-01-22T05:09:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.235+0000 7f3436200700 1 -- start start 2024-01-22T05:09:01.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.235+0000 7f3436200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34300691b0 0x7f343014bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:01.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.235+0000 7f3436200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34301500b0 0x7f34300a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:01.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.235+0000 7f3436200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34301547c0 0x7f34300a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:01.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.235+0000 7f3436200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34300a6260 con 0x7f34301500b0 2024-01-22T05:09:01.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.235+0000 7f3436200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34300a9f50 con 0x7f34301547c0 2024-01-22T05:09:01.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.235+0000 7f3436200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34300aa230 con 0x7f34300691b0 2024-01-22T05:09:01.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f342ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34301500b0 0x7f34300a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:01.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f342fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34301547c0 0x7f34300a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:01.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f342f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34300691b0 0x7f343014bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:01.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f342f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34300691b0 0x7f343014bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:60156/0 (socket says 172.21.15.49:60156) 2024-01-22T05:09:01.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f342ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34301500b0 0x7f34300a5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42554/0 (socket says 172.21.15.49:42554) 2024-01-22T05:09:01.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f342f400700 1 -- 172.21.15.49:0/2050680529 learned_addr learned my addr 172.21.15.49:0/2050680529 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:01.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f342fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34301547c0 0x7f34300a5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:57284/0 (socket says 172.21.15.49:57284) 2024-01-22T05:09:01.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f342f400700 1 -- 172.21.15.49:0/2050680529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34301547c0 msgr2=0x7f34300a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:01.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f342f400700 1 --2- 172.21.15.49:0/2050680529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34301547c0 0x7f34300a5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f342f400700 1 -- 172.21.15.49:0/2050680529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34301500b0 msgr2=0x7f34300a5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:01.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f342f400700 1 --2- 172.21.15.49:0/2050680529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34301500b0 0x7f34300a5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f342f400700 1 -- 172.21.15.49:0/2050680529 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3428009ae0 con 0x7f34300691b0 2024-01-22T05:09:01.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f342f400700 1 --2- 172.21.15.49:0/2050680529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34300691b0 0x7f343014bb40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f342000e900 tx=0x7f3420009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:01.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f3426a00700 1 -- 172.21.15.49:0/2050680529 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420012600 con 0x7f34300691b0 2024-01-22T05:09:01.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f3426a00700 1 -- 172.21.15.49:0/2050680529 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420012760 con 0x7f34300691b0 2024-01-22T05:09:01.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f3426a00700 1 -- 172.21.15.49:0/2050680529 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420012ae0 con 0x7f34300691b0 2024-01-22T05:09:01.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f3436200700 1 -- 172.21.15.49:0/2050680529 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34300aa510 con 0x7f34300691b0 2024-01-22T05:09:01.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.239+0000 7f3436200700 1 -- 172.21.15.49:0/2050680529 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34300a6c60 con 0x7f34300691b0 2024-01-22T05:09:01.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.243+0000 7f3436200700 1 -- 172.21.15.49:0/2050680529 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34300a6eb0 con 0x7f34300691b0 2024-01-22T05:09:01.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.243+0000 7f3426a00700 1 -- 172.21.15.49:0/2050680529 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f342001b400 con 0x7f34300691b0 2024-01-22T05:09:01.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.243+0000 7f3426a00700 1 --2- 172.21.15.49:0/2050680529 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f340805a510 0x7f340805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:01.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.243+0000 7f3426a00700 1 -- 172.21.15.49:0/2050680529 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f3420074980 con 0x7f34300691b0 2024-01-22T05:09:01.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.243+0000 7f342ea00700 1 --2- 172.21.15.49:0/2050680529 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f340805a510 0x7f340805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:01.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.243+0000 7f342ea00700 1 --2- 172.21.15.49:0/2050680529 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f340805a510 0x7f340805c9d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f34300bf890 tx=0x7f3418007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:01.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.251+0000 7f3426a00700 1 -- 172.21.15.49:0/2050680529 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f34300a6eb0 con 0x7f34300691b0 2024-01-22T05:09:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.415+0000 7f3436200700 1 -- 172.21.15.49:0/2050680529 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3430064b90 con 0x7f34300691b0 2024-01-22T05:09:01.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.419+0000 7f3426a00700 1 -- 172.21.15.49:0/2050680529 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v66) v1 ==== 84+0+143 (secure 0 0 0) 0x7f3420048230 con 0x7f34300691b0 2024-01-22T05:09:01.421 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:01.421 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-22T05:09:01.421 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:01.421 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-01-22T05:09:01.421 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2024-01-22T05:09:01.421 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:01.421 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:01.422 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2024-01-22T05:09:01.422 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2024-01-22T05:09:01.422 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:01.422 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-22T05:09:01.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.423+0000 7f3436200700 1 -- 172.21.15.49:0/2050680529 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f340805a510 msgr2=0x7f340805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:01.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.423+0000 7f3436200700 1 --2- 172.21.15.49:0/2050680529 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f340805a510 0x7f340805c9d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f34300bf890 tx=0x7f3418007d40).stop 2024-01-22T05:09:01.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.423+0000 7f3436200700 1 -- 172.21.15.49:0/2050680529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34300691b0 msgr2=0x7f343014bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:01.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.423+0000 7f3436200700 1 --2- 172.21.15.49:0/2050680529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34300691b0 0x7f343014bb40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f342000e900 tx=0x7f3420009060).stop 2024-01-22T05:09:01.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.423+0000 7f3436200700 1 -- 172.21.15.49:0/2050680529 shutdown_connections 2024-01-22T05:09:01.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.423+0000 7f3436200700 1 --2- 172.21.15.49:0/2050680529 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f340805a510 0x7f340805c9d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.423+0000 7f3436200700 1 --2- 172.21.15.49:0/2050680529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34301547c0 0x7f34300a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.423+0000 7f3436200700 1 --2- 172.21.15.49:0/2050680529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34301500b0 0x7f34300a5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.423+0000 7f3436200700 1 --2- 172.21.15.49:0/2050680529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34300691b0 0x7f343014bb40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.423+0000 7f3436200700 1 -- 172.21.15.49:0/2050680529 >> 172.21.15.49:0/2050680529 conn(0x7f34300c4300 msgr2=0x7f34300c4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:01.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.423+0000 7f3436200700 1 -- 172.21.15.49:0/2050680529 shutdown_connections 2024-01-22T05:09:01.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.423+0000 7f3436200700 1 -- 172.21.15.49:0/2050680529 wait complete. 2024-01-22T05:09:01.448 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:09:01.448 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:09:01.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.615+0000 7fd381400700 1 Processor -- start 2024-01-22T05:09:01.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.615+0000 7fd381400700 1 -- start start 2024-01-22T05:09:01.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd381400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd37c0beaa0 0x7fd37c0c3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:01.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd381400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c3a20 0x7fd37c15b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:01.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd381400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37c0693e0 con 0x7fd37c151be0 2024-01-22T05:09:01.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd381400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c0c3e70 con 0x7fd37c0beaa0 2024-01-22T05:09:01.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd381400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0687d0 con 0x7fd37c0c3a20 2024-01-22T05:09:01.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd37b400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd37c0beaa0 0x7fd37c0c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:01.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd37be00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd37c151be0 0x7fd37c0a77a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37550/0 (socket says 172.21.15.49:37550) 2024-01-22T05:09:01.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd37be00700 1 -- 172.21.15.49:0/868101980 learned_addr learned my addr 172.21.15.49:0/868101980 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:01.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd380a00700 1 --2- 172.21.15.49:0/868101980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c3a20 0x7fd37c15b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:01.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd37b400700 1 -- 172.21.15.49:0/868101980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c3a20 msgr2=0x7fd37c15b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:01.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd37b400700 1 --2- 172.21.15.49:0/868101980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c3a20 0x7fd37c15b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd37b400700 1 -- 172.21.15.49:0/868101980 >> v1:172.21.15.49:6789/0 conn(0x7fd37c151be0 legacy=0x7fd37c0a77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:01.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd37b400700 1 -- 172.21.15.49:0/868101980 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c068ab0 con 0x7fd37c0beaa0 2024-01-22T05:09:01.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd37aa00700 1 -- 172.21.15.49:0/868101980 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729323516 0 0) 0x7fd37c0693e0 con 0x7fd37c151be0 2024-01-22T05:09:01.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd37b400700 1 --2- 172.21.15.49:0/868101980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd37c0beaa0 0x7fd37c0c3530 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fd364009760 tx=0x7fd364009060).ready entity=mon.0 client_cookie=86068d4f9836dc80 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:01.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd37aa00700 1 -- 172.21.15.49:0/868101980 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36400f510 con 0x7fd37c0beaa0 2024-01-22T05:09:01.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd37aa00700 1 -- 172.21.15.49:0/868101980 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36400f670 con 0x7fd37c0beaa0 2024-01-22T05:09:01.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.619+0000 7fd37aa00700 1 -- 172.21.15.49:0/868101980 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36400f9f0 con 0x7fd37c0beaa0 2024-01-22T05:09:01.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.623+0000 7fd381400700 1 -- 172.21.15.49:0/868101980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd37c0beaa0 msgr2=0x7fd37c0c3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:01.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.623+0000 7fd381400700 1 --2- 172.21.15.49:0/868101980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd37c0beaa0 0x7fd37c0c3530 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fd364009760 tx=0x7fd364009060).stop 2024-01-22T05:09:01.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.623+0000 7fd381400700 1 -- 172.21.15.49:0/868101980 shutdown_connections 2024-01-22T05:09:01.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.623+0000 7fd381400700 1 --2- 172.21.15.49:0/868101980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c3a20 0x7fd37c15b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.623+0000 7fd381400700 1 --2- 172.21.15.49:0/868101980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd37c0beaa0 0x7fd37c0c3530 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.623+0000 7fd381400700 1 -- 172.21.15.49:0/868101980 >> 172.21.15.49:0/868101980 conn(0x7fd37c0c86e0 msgr2=0x7fd37c0c8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:01.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.623+0000 7fd381400700 1 -- 172.21.15.49:0/868101980 shutdown_connections 2024-01-22T05:09:01.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.623+0000 7fd381400700 1 -- 172.21.15.49:0/868101980 wait complete. 2024-01-22T05:09:01.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.623+0000 7fd381400700 1 Processor -- start 2024-01-22T05:09:01.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd381400700 1 -- start start 2024-01-22T05:09:01.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd381400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd37c0beaa0 0x7fd37c0ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:01.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd381400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c3a20 0x7fd37c0ad520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:01.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd381400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd37c151be0 0x7fd37c161ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:01.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd381400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c14e980 con 0x7fd37c0beaa0 2024-01-22T05:09:01.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd381400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0adac0 con 0x7fd37c151be0 2024-01-22T05:09:01.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd381400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0adda0 con 0x7fd37c0c3a20 2024-01-22T05:09:01.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd37be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd37c0beaa0 0x7fd37c0ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:01.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd37be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd37c0beaa0 0x7fd37c0ad030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42576/0 (socket says 172.21.15.49:42576) 2024-01-22T05:09:01.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd37be00700 1 -- 172.21.15.49:0/1589123028 learned_addr learned my addr 172.21.15.49:0/1589123028 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:01.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd37b400700 1 --2- 172.21.15.49:0/1589123028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c3a20 0x7fd37c0ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:01.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd380a00700 1 --2- 172.21.15.49:0/1589123028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd37c151be0 0x7fd37c161ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:01.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd37be00700 1 -- 172.21.15.49:0/1589123028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c3a20 msgr2=0x7fd37c0ad520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:01.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd37be00700 1 --2- 172.21.15.49:0/1589123028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c3a20 0x7fd37c0ad520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd37be00700 1 -- 172.21.15.49:0/1589123028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd37c151be0 msgr2=0x7fd37c161ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:01.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd37be00700 1 --2- 172.21.15.49:0/1589123028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd37c151be0 0x7fd37c161ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:01.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd37be00700 1 -- 172.21.15.49:0/1589123028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3640092a0 con 0x7fd37c0beaa0 2024-01-22T05:09:01.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.627+0000 7fd37be00700 1 --2- 172.21.15.49:0/1589123028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd37c0beaa0 0x7fd37c0ad030 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fd36c001eb0 tx=0x7fd36c007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:01.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.631+0000 7fd373400700 1 -- 172.21.15.49:0/1589123028 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0070d0 con 0x7fd37c0beaa0 2024-01-22T05:09:01.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.631+0000 7fd373400700 1 -- 172.21.15.49:0/1589123028 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c007230 con 0x7fd37c0beaa0 2024-01-22T05:09:01.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.631+0000 7fd381400700 1 -- 172.21.15.49:0/1589123028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c14e610 con 0x7fd37c0beaa0 2024-01-22T05:09:01.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.631+0000 7fd373400700 1 -- 172.21.15.49:0/1589123028 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0075d0 con 0x7fd37c0beaa0 2024-01-22T05:09:01.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.631+0000 7fd381400700 1 -- 172.21.15.49:0/1589123028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c1624e0 con 0x7fd37c0beaa0 2024-01-22T05:09:01.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.631+0000 7fd373400700 1 -- 172.21.15.49:0/1589123028 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd36c005bc0 con 0x7fd37c0beaa0 2024-01-22T05:09:01.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.631+0000 7fd381400700 1 -- 172.21.15.49:0/1589123028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c14e470 con 0x7fd37c0beaa0 2024-01-22T05:09:01.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.631+0000 7fd373400700 1 --2- 172.21.15.49:0/1589123028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd35405a510 0x7fd35405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:01.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.635+0000 7fd373400700 1 -- 172.21.15.49:0/1589123028 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fd36c073ef0 con 0x7fd37c0beaa0 2024-01-22T05:09:01.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.635+0000 7fd37b400700 1 --2- 172.21.15.49:0/1589123028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd35405a510 0x7fd35405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:01.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.635+0000 7fd37b400700 1 --2- 172.21.15.49:0/1589123028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd35405a510 0x7fd35405c9d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fd364009fd0 tx=0x7fd364017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:01.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.639+0000 7fd373400700 1 -- 172.21.15.49:0/1589123028 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd37c14e470 con 0x7fd37c0beaa0 2024-01-22T05:09:01.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:01.803+0000 7fd381400700 1 -- 172.21.15.49:0/1589123028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fd37c14e470 con 0x7fd37c0beaa0 2024-01-22T05:09:02.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.455+0000 7fd373400700 1 -- 172.21.15.49:0/1589123028 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v67) v1 ==== 152+0+0 (secure 0 0 0) 0x7fd37c14e470 con 0x7fd37c0beaa0 2024-01-22T05:09:02.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.463+0000 7fd381400700 1 -- 172.21.15.49:0/1589123028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd35405a510 msgr2=0x7fd35405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.463+0000 7fd381400700 1 --2- 172.21.15.49:0/1589123028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd35405a510 0x7fd35405c9d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fd364009fd0 tx=0x7fd364017000).stop 2024-01-22T05:09:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.463+0000 7fd381400700 1 -- 172.21.15.49:0/1589123028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd37c0beaa0 msgr2=0x7fd37c0ad030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.463+0000 7fd381400700 1 --2- 172.21.15.49:0/1589123028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd37c0beaa0 0x7fd37c0ad030 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fd36c001eb0 tx=0x7fd36c007e90).stop 2024-01-22T05:09:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.463+0000 7fd381400700 1 -- 172.21.15.49:0/1589123028 shutdown_connections 2024-01-22T05:09:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.463+0000 7fd381400700 1 --2- 172.21.15.49:0/1589123028 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd35405a510 0x7fd35405c9d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.463+0000 7fd381400700 1 --2- 172.21.15.49:0/1589123028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd37c151be0 0x7fd37c161ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.463+0000 7fd381400700 1 --2- 172.21.15.49:0/1589123028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c3a20 0x7fd37c0ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.463+0000 7fd381400700 1 --2- 172.21.15.49:0/1589123028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd37c0beaa0 0x7fd37c0ad030 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:02.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.463+0000 7fd381400700 1 -- 172.21.15.49:0/1589123028 >> 172.21.15.49:0/1589123028 conn(0x7fd37c0c86e0 msgr2=0x7fd37c0c1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.463+0000 7fd381400700 1 -- 172.21.15.49:0/1589123028 shutdown_connections 2024-01-22T05:09:02.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.463+0000 7fd381400700 1 -- 172.21.15.49:0/1589123028 wait complete. 2024-01-22T05:09:02.474 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-01-22T05:09:02.490 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:09:02.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.667+0000 7f8b2dc00700 1 Processor -- start 2024-01-22T05:09:02.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.671+0000 7f8b2dc00700 1 -- start start 2024-01-22T05:09:02.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.671+0000 7f8b2dc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8b28157ee0 0x7f8b28065590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:02.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.671+0000 7f8b2dc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28068af0 0x7f8b28065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:02.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.671+0000 7f8b2dc00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b28068280 con 0x7f8b28068710 2024-01-22T05:09:02.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.671+0000 7f8b2dc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b28069600 con 0x7f8b28157ee0 2024-01-22T05:09:02.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.671+0000 7f8b2dc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280c1cc0 con 0x7f8b28068af0 2024-01-22T05:09:02.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.671+0000 7f8b27e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8b28068710 0x7f8b281577d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37564/0 (socket says 172.21.15.49:37564) 2024-01-22T05:09:02.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.671+0000 7f8b27e00700 1 -- 172.21.15.49:0/1723788464 learned_addr learned my addr 172.21.15.49:0/1723788464 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:02.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b27400700 1 --2- 172.21.15.49:0/1723788464 >> v2:172.21.15.110:3300/0 conn(0x7f8b28157ee0 0x7f8b28065590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:02.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b2d200700 1 --2- 172.21.15.49:0/1723788464 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28068af0 0x7f8b28065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:02.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b26a00700 1 -- 172.21.15.49:0/1723788464 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504341943 0 0) 0x7f8b28068280 con 0x7f8b28068710 2024-01-22T05:09:02.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b26a00700 1 -- 172.21.15.49:0/1723788464 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b080033f0 con 0x7f8b28068710 2024-01-22T05:09:02.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b2d200700 1 -- 172.21.15.49:0/1723788464 >> v2:172.21.15.110:3300/0 conn(0x7f8b28157ee0 msgr2=0x7f8b28065590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:02.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b2d200700 1 --2- 172.21.15.49:0/1723788464 >> v2:172.21.15.110:3300/0 conn(0x7f8b28157ee0 0x7f8b28065590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:02.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b2d200700 1 -- 172.21.15.49:0/1723788464 >> v1:172.21.15.49:6789/0 conn(0x7f8b28068710 legacy=0x7f8b281577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:02.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b2d200700 1 -- 172.21.15.49:0/1723788464 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b28067c30 con 0x7f8b28068af0 2024-01-22T05:09:02.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b27400700 1 --2- 172.21.15.49:0/1723788464 >> v2:172.21.15.110:3300/0 conn(0x7f8b28157ee0 0x7f8b28065590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:02.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b2d200700 1 --2- 172.21.15.49:0/1723788464 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28068af0 0x7f8b28065a80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8b20009e60 tx=0x7f8b20009780).ready entity=mon.2 client_cookie=2ed1e9d873581568 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:02.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b26a00700 1 -- 172.21.15.49:0/1723788464 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000e070 con 0x7f8b28068af0 2024-01-22T05:09:02.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b26a00700 1 -- 172.21.15.49:0/1723788464 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2000bab0 con 0x7f8b28068af0 2024-01-22T05:09:02.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b26a00700 1 -- 172.21.15.49:0/1723788464 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000be30 con 0x7f8b28068af0 2024-01-22T05:09:02.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b2dc00700 1 -- 172.21.15.49:0/1723788464 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28068af0 msgr2=0x7f8b28065a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:02.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b2dc00700 1 --2- 172.21.15.49:0/1723788464 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28068af0 0x7f8b28065a80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8b20009e60 tx=0x7f8b20009780).stop 2024-01-22T05:09:02.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b2dc00700 1 -- 172.21.15.49:0/1723788464 shutdown_connections 2024-01-22T05:09:02.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b2dc00700 1 --2- 172.21.15.49:0/1723788464 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28068af0 0x7f8b28065a80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:02.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b2dc00700 1 --2- 172.21.15.49:0/1723788464 >> v2:172.21.15.110:3300/0 conn(0x7f8b28157ee0 0x7f8b28065590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:02.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.675+0000 7f8b2dc00700 1 -- 172.21.15.49:0/1723788464 >> 172.21.15.49:0/1723788464 conn(0x7f8b280c6fc0 msgr2=0x7f8b280c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:02.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.679+0000 7f8b2dc00700 1 -- 172.21.15.49:0/1723788464 shutdown_connections 2024-01-22T05:09:02.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.679+0000 7f8b2dc00700 1 -- 172.21.15.49:0/1723788464 wait complete. 2024-01-22T05:09:02.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.679+0000 7f8b2dc00700 1 Processor -- start 2024-01-22T05:09:02.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2dc00700 1 -- start start 2024-01-22T05:09:02.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2dc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28068710 0x7f8b28164420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:02.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2dc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b28068af0 0x7f8b28154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:02.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2dc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b28157ee0 0x7f8b28165080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:02.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2dc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b28153730 con 0x7f8b28157ee0 2024-01-22T05:09:02.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2dc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b281542b0 con 0x7f8b28068af0 2024-01-22T05:09:02.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2dc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b28153980 con 0x7f8b28068710 2024-01-22T05:09:02.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2d200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b28157ee0 0x7f8b28165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:02.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b27e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28068710 0x7f8b28164420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:02.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2d200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b28157ee0 0x7f8b28165080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42592/0 (socket says 172.21.15.49:42592) 2024-01-22T05:09:02.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2d200700 1 -- 172.21.15.49:0/2543501827 learned_addr learned my addr 172.21.15.49:0/2543501827 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:02.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b27400700 1 --2- 172.21.15.49:0/2543501827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b28068af0 0x7f8b28154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:02.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2d200700 1 -- 172.21.15.49:0/2543501827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28068710 msgr2=0x7f8b28164420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:02.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2d200700 1 --2- 172.21.15.49:0/2543501827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28068710 0x7f8b28164420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:02.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2d200700 1 -- 172.21.15.49:0/2543501827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b28068af0 msgr2=0x7f8b28154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:02.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2d200700 1 --2- 172.21.15.49:0/2543501827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b28068af0 0x7f8b28154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:02.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2d200700 1 -- 172.21.15.49:0/2543501827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100092a0 con 0x7f8b28157ee0 2024-01-22T05:09:02.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b27e00700 1 --2- 172.21.15.49:0/2543501827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28068710 0x7f8b28164420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:02.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b27400700 1 --2- 172.21.15.49:0/2543501827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b28068af0 0x7f8b28154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:02.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.683+0000 7f8b2d200700 1 --2- 172.21.15.49:0/2543501827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b28157ee0 0x7f8b28165080 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f8b280c1e00 tx=0x7f8b20009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:02.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.687+0000 7f8b1f400700 1 -- 172.21.15.49:0/2543501827 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20013e40 con 0x7f8b28157ee0 2024-01-22T05:09:02.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.687+0000 7f8b1f400700 1 -- 172.21.15.49:0/2543501827 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2001d630 con 0x7f8b28157ee0 2024-01-22T05:09:02.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.687+0000 7f8b2dc00700 1 -- 172.21.15.49:0/2543501827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b20009a20 con 0x7f8b28157ee0 2024-01-22T05:09:02.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.687+0000 7f8b1f400700 1 -- 172.21.15.49:0/2543501827 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2001d9f0 con 0x7f8b28157ee0 2024-01-22T05:09:02.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.687+0000 7f8b2dc00700 1 -- 172.21.15.49:0/2543501827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b28153f40 con 0x7f8b28157ee0 2024-01-22T05:09:02.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.687+0000 7f8b2dc00700 1 -- 172.21.15.49:0/2543501827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b28154420 con 0x7f8b28157ee0 2024-01-22T05:09:02.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.691+0000 7f8b1f400700 1 -- 172.21.15.49:0/2543501827 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8b20003040 con 0x7f8b28157ee0 2024-01-22T05:09:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.691+0000 7f8b1f400700 1 --2- 172.21.15.49:0/2543501827 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8b0005a510 0x7f8b0005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.691+0000 7f8b1f400700 1 -- 172.21.15.49:0/2543501827 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5992+0+0 (secure 0 0 0) 0x7f8b20076460 con 0x7f8b28157ee0 2024-01-22T05:09:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.691+0000 7f8b27e00700 1 --2- 172.21.15.49:0/2543501827 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8b0005a510 0x7f8b0005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.695+0000 7f8b27e00700 1 --2- 172.21.15.49:0/2543501827 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8b0005a510 0x7f8b0005c9d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f8b280c55a0 tx=0x7f8b18009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:02.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.699+0000 7f8b1f400700 1 -- 172.21.15.49:0/2543501827 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8b20049c00 con 0x7f8b28157ee0 2024-01-22T05:09:02.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:02.863+0000 7f8b2dc00700 1 -- 172.21.15.49:0/2543501827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8b28047060 con 0x7f8b28157ee0 2024-01-22T05:09:03.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.471+0000 7f8b1f400700 1 -- 172.21.15.49:0/2543501827 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v68) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8b2004d220 con 0x7f8b28157ee0 2024-01-22T05:09:03.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.483+0000 7f8b2dc00700 1 -- 172.21.15.49:0/2543501827 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8b0005a510 msgr2=0x7f8b0005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:03.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.483+0000 7f8b2dc00700 1 --2- 172.21.15.49:0/2543501827 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8b0005a510 0x7f8b0005c9d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f8b280c55a0 tx=0x7f8b18009040).stop 2024-01-22T05:09:03.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.483+0000 7f8b2dc00700 1 -- 172.21.15.49:0/2543501827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b28157ee0 msgr2=0x7f8b28165080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:03.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.483+0000 7f8b2dc00700 1 --2- 172.21.15.49:0/2543501827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b28157ee0 0x7f8b28165080 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f8b280c1e00 tx=0x7f8b20009780).stop 2024-01-22T05:09:03.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.483+0000 7f8b2dc00700 1 -- 172.21.15.49:0/2543501827 shutdown_connections 2024-01-22T05:09:03.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.483+0000 7f8b2dc00700 1 --2- 172.21.15.49:0/2543501827 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8b0005a510 0x7f8b0005c9d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:03.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.483+0000 7f8b2dc00700 1 --2- 172.21.15.49:0/2543501827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b28157ee0 0x7f8b28165080 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:03.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.483+0000 7f8b2dc00700 1 --2- 172.21.15.49:0/2543501827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b28068af0 0x7f8b28154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:03.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.483+0000 7f8b2dc00700 1 --2- 172.21.15.49:0/2543501827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28068710 0x7f8b28164420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:03.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.483+0000 7f8b2dc00700 1 -- 172.21.15.49:0/2543501827 >> 172.21.15.49:0/2543501827 conn(0x7f8b280c6fc0 msgr2=0x7f8b280c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:03.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.487+0000 7f8b2dc00700 1 -- 172.21.15.49:0/2543501827 shutdown_connections 2024-01-22T05:09:03.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.491+0000 7f8b2dc00700 1 -- 172.21.15.49:0/2543501827 wait complete. 2024-01-22T05:09:03.504 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-01-22T05:09:03.526 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:09:03.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.687+0000 7fe311600700 1 Processor -- start 2024-01-22T05:09:03.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.691+0000 7fe311600700 1 -- start start 2024-01-22T05:09:03.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe311600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe30c062d20 0x7fe30c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:03.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe311600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe30c068410 0x7fe30c068880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:03.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe311600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30c067a90 con 0x7fe30c153620 2024-01-22T05:09:03.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe311600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30c1399d0 con 0x7fe30c068410 2024-01-22T05:09:03.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe311600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30c063620 con 0x7fe30c062d20 2024-01-22T05:09:03.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe310c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe30c068410 0x7fe30c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:03.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe310c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe30c068410 0x7fe30c068880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55506/0 (socket says 172.21.15.49:55506) 2024-01-22T05:09:03.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe310c00700 1 -- 172.21.15.49:0/1539921218 learned_addr learned my addr 172.21.15.49:0/1539921218 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:03.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe30b400700 1 --2- 172.21.15.49:0/1539921218 >> v2:172.21.15.110:3300/0 conn(0x7fe30c062d20 0x7fe30c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:03.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe310c00700 1 -- 172.21.15.49:0/1539921218 >> v2:172.21.15.110:3300/0 conn(0x7fe30c062d20 msgr2=0x7fe30c067f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:03.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe310c00700 1 --2- 172.21.15.49:0/1539921218 >> v2:172.21.15.110:3300/0 conn(0x7fe30c062d20 0x7fe30c067f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:03.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe310c00700 1 -- 172.21.15.49:0/1539921218 >> v1:172.21.15.110:6789/0 conn(0x7fe30c153620 legacy=0x7fe30c1392c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:03.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe310c00700 1 -- 172.21.15.49:0/1539921218 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c063900 con 0x7fe30c068410 2024-01-22T05:09:03.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe310c00700 1 --2- 172.21.15.49:0/1539921218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30c068410 0x7fe30c068880 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fe30c05f4b0 tx=0x7fe304009840).ready entity=mon.0 client_cookie=73d7d604eeea2b84 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:03.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe30aa00700 1 -- 172.21.15.49:0/1539921218 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30400e070 con 0x7fe30c068410 2024-01-22T05:09:03.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe30aa00700 1 -- 172.21.15.49:0/1539921218 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30400ba50 con 0x7fe30c068410 2024-01-22T05:09:03.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.695+0000 7fe30aa00700 1 -- 172.21.15.49:0/1539921218 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30400bdd0 con 0x7fe30c068410 2024-01-22T05:09:03.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.699+0000 7fe311600700 1 -- 172.21.15.49:0/1539921218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30c068410 msgr2=0x7fe30c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:03.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.699+0000 7fe311600700 1 --2- 172.21.15.49:0/1539921218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30c068410 0x7fe30c068880 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fe30c05f4b0 tx=0x7fe304009840).stop 2024-01-22T05:09:03.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.699+0000 7fe311600700 1 -- 172.21.15.49:0/1539921218 shutdown_connections 2024-01-22T05:09:03.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.699+0000 7fe311600700 1 --2- 172.21.15.49:0/1539921218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30c068410 0x7fe30c068880 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:03.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.699+0000 7fe311600700 1 --2- 172.21.15.49:0/1539921218 >> v2:172.21.15.110:3300/0 conn(0x7fe30c062d20 0x7fe30c067f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:03.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.699+0000 7fe311600700 1 -- 172.21.15.49:0/1539921218 >> 172.21.15.49:0/1539921218 conn(0x7fe30c0c3f00 msgr2=0x7fe30c065a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:03.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.699+0000 7fe311600700 1 -- 172.21.15.49:0/1539921218 shutdown_connections 2024-01-22T05:09:03.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.699+0000 7fe311600700 1 -- 172.21.15.49:0/1539921218 wait complete. 2024-01-22T05:09:03.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.699+0000 7fe311600700 1 Processor -- start 2024-01-22T05:09:03.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe311600700 1 -- start start 2024-01-22T05:09:03.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe311600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c062d20 0x7fe30c14f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:03.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe311600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30c068410 0x7fe30c159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:03.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe311600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c153620 0x7fe30c15a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:03.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe311600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c153090 con 0x7fe30c068410 2024-01-22T05:09:03.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe311600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c152480 con 0x7fe30c153620 2024-01-22T05:09:03.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe311600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c152760 con 0x7fe30c062d20 2024-01-22T05:09:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe30b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30c068410 0x7fe30c159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe30b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30c068410 0x7fe30c159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55510/0 (socket says 172.21.15.49:55510) 2024-01-22T05:09:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe30b400700 1 -- 172.21.15.49:0/556174248 learned_addr learned my addr 172.21.15.49:0/556174248 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe310c00700 1 --2- 172.21.15.49:0/556174248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c153620 0x7fe30c15a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe30be00700 1 --2- 172.21.15.49:0/556174248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c062d20 0x7fe30c14f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe30b400700 1 -- 172.21.15.49:0/556174248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c062d20 msgr2=0x7fe30c14f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe30b400700 1 --2- 172.21.15.49:0/556174248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c062d20 0x7fe30c14f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe30b400700 1 -- 172.21.15.49:0/556174248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c153620 msgr2=0x7fe30c15a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe30b400700 1 --2- 172.21.15.49:0/556174248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c153620 0x7fe30c15a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe30b400700 1 -- 172.21.15.49:0/556174248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe304009ae0 con 0x7fe30c068410 2024-01-22T05:09:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe30be00700 1 --2- 172.21.15.49:0/556174248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c062d20 0x7fe30c14f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:09:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe30b400700 1 --2- 172.21.15.49:0/556174248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30c068410 0x7fe30c159b70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fe2f400d860 tx=0x7fe2f4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe303400700 1 -- 172.21.15.49:0/556174248 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4011590 con 0x7fe30c068410 2024-01-22T05:09:03.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe303400700 1 -- 172.21.15.49:0/556174248 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f40116f0 con 0x7fe30c068410 2024-01-22T05:09:03.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe303400700 1 -- 172.21.15.49:0/556174248 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4011a70 con 0x7fe30c068410 2024-01-22T05:09:03.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.703+0000 7fe311600700 1 -- 172.21.15.49:0/556174248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c152a40 con 0x7fe30c068410 2024-01-22T05:09:03.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.707+0000 7fe311600700 1 -- 172.21.15.49:0/556174248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c14fa50 con 0x7fe30c068410 2024-01-22T05:09:03.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.707+0000 7fe311600700 1 -- 172.21.15.49:0/556174248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c153200 con 0x7fe30c068410 2024-01-22T05:09:03.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.707+0000 7fe303400700 1 -- 172.21.15.49:0/556174248 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe2f4012420 con 0x7fe30c068410 2024-01-22T05:09:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.711+0000 7fe303400700 1 --2- 172.21.15.49:0/556174248 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe2e405a510 0x7fe2e405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.711+0000 7fe303400700 1 -- 172.21.15.49:0/556174248 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6374+0+0 (secure 0 0 0) 0x7fe2f4074460 con 0x7fe30c068410 2024-01-22T05:09:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.711+0000 7fe30be00700 1 --2- 172.21.15.49:0/556174248 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe2e405a510 0x7fe2e405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.711+0000 7fe30be00700 1 --2- 172.21.15.49:0/556174248 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe2e405a510 0x7fe2e405c9d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fe2fc0016d0 tx=0x7fe2fc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:03.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.719+0000 7fe303400700 1 -- 172.21.15.49:0/556174248 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe2f4047aa0 con 0x7fe30c068410 2024-01-22T05:09:03.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.923+0000 7fe311600700 1 -- 172.21.15.49:0/556174248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe30c063be0 con 0x7fe30c068410 2024-01-22T05:09:03.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.935+0000 7fe303400700 1 -- 172.21.15.49:0/556174248 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v52) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe2f4011e60 con 0x7fe30c068410 2024-01-22T05:09:03.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.951+0000 7fe311600700 1 -- 172.21.15.49:0/556174248 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe2e405a510 msgr2=0x7fe2e405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:03.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.951+0000 7fe311600700 1 --2- 172.21.15.49:0/556174248 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe2e405a510 0x7fe2e405c9d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fe2fc0016d0 tx=0x7fe2fc009040).stop 2024-01-22T05:09:03.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.951+0000 7fe311600700 1 -- 172.21.15.49:0/556174248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30c068410 msgr2=0x7fe30c159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:03.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.951+0000 7fe311600700 1 --2- 172.21.15.49:0/556174248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30c068410 0x7fe30c159b70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fe2f400d860 tx=0x7fe2f4008040).stop 2024-01-22T05:09:03.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.955+0000 7fe311600700 1 -- 172.21.15.49:0/556174248 shutdown_connections 2024-01-22T05:09:03.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.955+0000 7fe311600700 1 --2- 172.21.15.49:0/556174248 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe2e405a510 0x7fe2e405c9d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:03.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.955+0000 7fe311600700 1 --2- 172.21.15.49:0/556174248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c153620 0x7fe30c15a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:03.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.955+0000 7fe311600700 1 --2- 172.21.15.49:0/556174248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe30c068410 0x7fe30c159b70 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:03.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.955+0000 7fe311600700 1 --2- 172.21.15.49:0/556174248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c062d20 0x7fe30c14f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:03.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.955+0000 7fe311600700 1 -- 172.21.15.49:0/556174248 >> 172.21.15.49:0/556174248 conn(0x7fe30c0c3f00 msgr2=0x7fe30c0c5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:03.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.955+0000 7fe311600700 1 -- 172.21.15.49:0/556174248 shutdown_connections 2024-01-22T05:09:03.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:03.955+0000 7fe311600700 1 -- 172.21.15.49:0/556174248 wait complete. 2024-01-22T05:09:03.968 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 10 and data pool 11 2024-01-22T05:09:03.986 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:09:04.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.139+0000 7fd7c0e00700 1 Processor -- start 2024-01-22T05:09:04.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.139+0000 7fd7c0e00700 1 -- start start 2024-01-22T05:09:04.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7c0e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd7bc155880 0x7fd7bc0a8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7c0e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7bc0a7260 0x7fd7bc0659b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7c0e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7bc068a60 con 0x7fd7bc155c60 2024-01-22T05:09:04.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7c0e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7bc067e50 con 0x7fd7bc155880 2024-01-22T05:09:04.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7c0e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc068130 con 0x7fd7bc0a7260 2024-01-22T05:09:04.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7bb400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd7bc155880 0x7fd7bc0a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7bb400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd7bc155880 0x7fd7bc0a8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55522/0 (socket says 172.21.15.49:55522) 2024-01-22T05:09:04.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7bb400700 1 -- 172.21.15.49:0/826918581 learned_addr learned my addr 172.21.15.49:0/826918581 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:04.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7bbe00700 1 --2- 172.21.15.49:0/826918581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7bc0a7260 0x7fd7bc0659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7bb400700 1 -- 172.21.15.49:0/826918581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7bc0a7260 msgr2=0x7fd7bc0659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:04.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7bb400700 1 --2- 172.21.15.49:0/826918581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7bc0a7260 0x7fd7bc0659b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7bb400700 1 -- 172.21.15.49:0/826918581 >> v1:172.21.15.110:6789/0 conn(0x7fd7bc155c60 legacy=0x7fd7bc0a6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7bb400700 1 -- 172.21.15.49:0/826918581 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc068410 con 0x7fd7bc155880 2024-01-22T05:09:04.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7bb400700 1 --2- 172.21.15.49:0/826918581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc155880 0x7fd7bc0a8990 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fd7ac006fd0 tx=0x7fd7ac0090f0).ready entity=mon.0 client_cookie=63cb2009ca1dcdda server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:04.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7ba000700 1 -- 172.21.15.49:0/826918581 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac00b600 con 0x7fd7bc155880 2024-01-22T05:09:04.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7ba000700 1 -- 172.21.15.49:0/826918581 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac00b760 con 0x7fd7bc155880 2024-01-22T05:09:04.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.143+0000 7fd7ba000700 1 -- 172.21.15.49:0/826918581 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac00bae0 con 0x7fd7bc155880 2024-01-22T05:09:04.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.147+0000 7fd7c0e00700 1 -- 172.21.15.49:0/826918581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc155880 msgr2=0x7fd7bc0a8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.147+0000 7fd7c0e00700 1 --2- 172.21.15.49:0/826918581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc155880 0x7fd7bc0a8990 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fd7ac006fd0 tx=0x7fd7ac0090f0).stop 2024-01-22T05:09:04.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.147+0000 7fd7c0e00700 1 -- 172.21.15.49:0/826918581 shutdown_connections 2024-01-22T05:09:04.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.147+0000 7fd7c0e00700 1 --2- 172.21.15.49:0/826918581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7bc0a7260 0x7fd7bc0659b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.147+0000 7fd7c0e00700 1 --2- 172.21.15.49:0/826918581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc155880 0x7fd7bc0a8990 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.147+0000 7fd7c0e00700 1 -- 172.21.15.49:0/826918581 >> 172.21.15.49:0/826918581 conn(0x7fd7bc0c6530 msgr2=0x7fd7bc0c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:04.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.147+0000 7fd7c0e00700 1 -- 172.21.15.49:0/826918581 shutdown_connections 2024-01-22T05:09:04.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.147+0000 7fd7c0e00700 1 -- 172.21.15.49:0/826918581 wait complete. 2024-01-22T05:09:04.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.147+0000 7fd7c0e00700 1 Processor -- start 2024-01-22T05:09:04.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7c0e00700 1 -- start start 2024-01-22T05:09:04.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7c0e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7bc0a7260 0x7fd7bc154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7c0e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc155880 0x7fd7bc169b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7c0e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7bc155c60 0x7fd7bc157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7c0e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc0a43e0 con 0x7fd7bc155880 2024-01-22T05:09:04.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7c0e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc0a3550 con 0x7fd7bc0a7260 2024-01-22T05:09:04.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7c0e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc0a37d0 con 0x7fd7bc155c60 2024-01-22T05:09:04.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7baa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc155880 0x7fd7bc169b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7baa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc155880 0x7fd7bc169b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55526/0 (socket says 172.21.15.49:55526) 2024-01-22T05:09:04.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7baa00700 1 -- 172.21.15.49:0/2792426464 learned_addr learned my addr 172.21.15.49:0/2792426464 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:04.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7bb400700 1 --2- 172.21.15.49:0/2792426464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7bc0a7260 0x7fd7bc154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7bbe00700 1 --2- 172.21.15.49:0/2792426464 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7bc155c60 0x7fd7bc157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7baa00700 1 -- 172.21.15.49:0/2792426464 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7bc155c60 msgr2=0x7fd7bc157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7baa00700 1 --2- 172.21.15.49:0/2792426464 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7bc155c60 0x7fd7bc157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7baa00700 1 -- 172.21.15.49:0/2792426464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7bc0a7260 msgr2=0x7fd7bc154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7baa00700 1 --2- 172.21.15.49:0/2792426464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7bc0a7260 0x7fd7bc154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7baa00700 1 -- 172.21.15.49:0/2792426464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac009370 con 0x7fd7bc155880 2024-01-22T05:09:04.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7baa00700 1 --2- 172.21.15.49:0/2792426464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc155880 0x7fd7bc169b60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fd7a400c4f0 tx=0x7fd7a4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:04.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7b2a00700 1 -- 172.21.15.49:0/2792426464 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4007020 con 0x7fd7bc155880 2024-01-22T05:09:04.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7b2a00700 1 -- 172.21.15.49:0/2792426464 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a4001e90 con 0x7fd7bc155880 2024-01-22T05:09:04.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.151+0000 7fd7c0e00700 1 -- 172.21.15.49:0/2792426464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7bc0a3ab0 con 0x7fd7bc155880 2024-01-22T05:09:04.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.155+0000 7fd7b2a00700 1 -- 172.21.15.49:0/2792426464 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a40073b0 con 0x7fd7bc155880 2024-01-22T05:09:04.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.155+0000 7fd7c0e00700 1 -- 172.21.15.49:0/2792426464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7bc0a4070 con 0x7fd7bc155880 2024-01-22T05:09:04.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.155+0000 7fd7c0e00700 1 -- 172.21.15.49:0/2792426464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7bc0a4590 con 0x7fd7bc155880 2024-01-22T05:09:04.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.155+0000 7fd7b2a00700 1 -- 172.21.15.49:0/2792426464 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd7a40068b0 con 0x7fd7bc155880 2024-01-22T05:09:04.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.159+0000 7fd7b2a00700 1 --2- 172.21.15.49:0/2792426464 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd79405a510 0x7fd79405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.159+0000 7fd7b2a00700 1 -- 172.21.15.49:0/2792426464 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd7a4074390 con 0x7fd7bc155880 2024-01-22T05:09:04.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.159+0000 7fd7bb400700 1 --2- 172.21.15.49:0/2792426464 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd79405a510 0x7fd79405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.159+0000 7fd7bb400700 1 --2- 172.21.15.49:0/2792426464 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd79405a510 0x7fd79405c9d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fd7ac009130 tx=0x7fd7ac017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:04.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.163+0000 7fd7b2a00700 1 -- 172.21.15.49:0/2792426464 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd7bc0a4590 con 0x7fd7bc155880 2024-01-22T05:09:04.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.327+0000 7fd7c0e00700 1 -- 172.21.15.49:0/2792426464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7bc0a4590 con 0x7fd7bc155880 2024-01-22T05:09:04.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.331+0000 7fd7b2a00700 1 -- 172.21.15.49:0/2792426464 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+17180 (secure 0 0 0) 0x7fd7bc0a4590 con 0x7fd7bc155880 2024-01-22T05:09:04.334 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:04.335 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":69,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:09:03.929093+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:09:01.882090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-01-22T05:09:02.934332+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:09:04.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.335+0000 7fd7c0e00700 1 -- 172.21.15.49:0/2792426464 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd79405a510 msgr2=0x7fd79405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.335+0000 7fd7c0e00700 1 --2- 172.21.15.49:0/2792426464 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd79405a510 0x7fd79405c9d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fd7ac009130 tx=0x7fd7ac017000).stop 2024-01-22T05:09:04.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.335+0000 7fd7c0e00700 1 -- 172.21.15.49:0/2792426464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc155880 msgr2=0x7fd7bc169b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.335+0000 7fd7c0e00700 1 --2- 172.21.15.49:0/2792426464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc155880 0x7fd7bc169b60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fd7a400c4f0 tx=0x7fd7a4007e00).stop 2024-01-22T05:09:04.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.335+0000 7fd7c0e00700 1 -- 172.21.15.49:0/2792426464 shutdown_connections 2024-01-22T05:09:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.335+0000 7fd7c0e00700 1 --2- 172.21.15.49:0/2792426464 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd79405a510 0x7fd79405c9d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.335+0000 7fd7c0e00700 1 --2- 172.21.15.49:0/2792426464 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7bc155c60 0x7fd7bc157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.335+0000 7fd7c0e00700 1 --2- 172.21.15.49:0/2792426464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc155880 0x7fd7bc169b60 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.335+0000 7fd7c0e00700 1 --2- 172.21.15.49:0/2792426464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7bc0a7260 0x7fd7bc154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.335+0000 7fd7c0e00700 1 -- 172.21.15.49:0/2792426464 >> 172.21.15.49:0/2792426464 conn(0x7fd7bc0c6530 msgr2=0x7fd7bc0a6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.335+0000 7fd7c0e00700 1 -- 172.21.15.49:0/2792426464 shutdown_connections 2024-01-22T05:09:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.335+0000 7fd7c0e00700 1 -- 172.21.15.49:0/2792426464 wait complete. 2024-01-22T05:09:04.362 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:09:04.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.523+0000 7fd02d600700 1 Processor -- start 2024-01-22T05:09:04.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.523+0000 7fd02d600700 1 -- start start 2024-01-22T05:09:04.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.527+0000 7fd02d600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0280a8740 0x7fd0280a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.527+0000 7fd02d600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd0280c1ed0 0x7fd0280c2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.527+0000 7fd02d600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0280c1a40 con 0x7fd028155d20 2024-01-22T05:09:04.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.527+0000 7fd02d600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0280a90b0 con 0x7fd0280c1ed0 2024-01-22T05:09:04.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.527+0000 7fd02d600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd028159310 con 0x7fd0280a8740 2024-01-22T05:09:04.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.527+0000 7fd027400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd0280c1ed0 0x7fd0280c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.527+0000 7fd027400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd0280c1ed0 0x7fd0280c2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55536/0 (socket says 172.21.15.49:55536) 2024-01-22T05:09:04.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.527+0000 7fd027400700 1 -- 172.21.15.49:0/2794564130 learned_addr learned my addr 172.21.15.49:0/2794564130 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:04.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.527+0000 7fd026000700 1 --2- 172.21.15.49:0/2794564130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0280a8740 0x7fd0280a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.527+0000 7fd027400700 1 -- 172.21.15.49:0/2794564130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0280a8740 msgr2=0x7fd0280a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:04.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.527+0000 7fd027400700 1 --2- 172.21.15.49:0/2794564130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0280a8740 0x7fd0280a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.527+0000 7fd027400700 1 -- 172.21.15.49:0/2794564130 >> v1:172.21.15.110:6789/0 conn(0x7fd028155d20 legacy=0x7fd028065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.527+0000 7fd027400700 1 -- 172.21.15.49:0/2794564130 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0280c13f0 con 0x7fd0280c1ed0 2024-01-22T05:09:04.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.527+0000 7fd025600700 1 -- 172.21.15.49:0/2794564130 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743656455 0 0) 0x7fd0280c1a40 con 0x7fd028155d20 2024-01-22T05:09:04.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.531+0000 7fd027400700 1 --2- 172.21.15.49:0/2794564130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0280c1ed0 0x7fd0280c2330 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fd020009f20 tx=0x7fd020009840).ready entity=mon.0 client_cookie=5615d2d80d34d956 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:04.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.531+0000 7fd025600700 1 -- 172.21.15.49:0/2794564130 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02000e070 con 0x7fd0280c1ed0 2024-01-22T05:09:04.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.531+0000 7fd025600700 1 -- 172.21.15.49:0/2794564130 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02000b9d0 con 0x7fd0280c1ed0 2024-01-22T05:09:04.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.531+0000 7fd025600700 1 -- 172.21.15.49:0/2794564130 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02000bd50 con 0x7fd0280c1ed0 2024-01-22T05:09:04.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.531+0000 7fd02d600700 1 -- 172.21.15.49:0/2794564130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0280c1ed0 msgr2=0x7fd0280c2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.531+0000 7fd02d600700 1 --2- 172.21.15.49:0/2794564130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0280c1ed0 0x7fd0280c2330 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fd020009f20 tx=0x7fd020009840).stop 2024-01-22T05:09:04.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.531+0000 7fd02d600700 1 -- 172.21.15.49:0/2794564130 shutdown_connections 2024-01-22T05:09:04.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.531+0000 7fd02d600700 1 --2- 172.21.15.49:0/2794564130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0280c1ed0 0x7fd0280c2330 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.531+0000 7fd02d600700 1 --2- 172.21.15.49:0/2794564130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0280a8740 0x7fd0280a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.531+0000 7fd02d600700 1 -- 172.21.15.49:0/2794564130 >> 172.21.15.49:0/2794564130 conn(0x7fd0280c6540 msgr2=0x7fd0280c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:04.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.531+0000 7fd02d600700 1 -- 172.21.15.49:0/2794564130 shutdown_connections 2024-01-22T05:09:04.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.531+0000 7fd02d600700 1 -- 172.21.15.49:0/2794564130 wait complete. 2024-01-22T05:09:04.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.535+0000 7fd02d600700 1 Processor -- start 2024-01-22T05:09:04.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.535+0000 7fd02d600700 1 -- start start 2024-01-22T05:09:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd02d600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0280a8740 0x7fd02815a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd02d600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0280c1ed0 0x7fd0280a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd02d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd028155d20 0x7fd0281520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd02d600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0280aa9f0 con 0x7fd028155d20 2024-01-22T05:09:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd02d600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0280a9de0 con 0x7fd0280c1ed0 2024-01-22T05:09:04.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd02d600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0280aa0c0 con 0x7fd0280a8740 2024-01-22T05:09:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd027400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd028155d20 0x7fd0281520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd027400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd028155d20 0x7fd0281520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55544/0 (socket says 172.21.15.49:55544) 2024-01-22T05:09:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd027400700 1 -- 172.21.15.49:0/3337394605 learned_addr learned my addr 172.21.15.49:0/3337394605 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd026a00700 1 --2- 172.21.15.49:0/3337394605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0280a8740 0x7fd02815a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd026000700 1 --2- 172.21.15.49:0/3337394605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0280c1ed0 0x7fd0280a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd027400700 1 -- 172.21.15.49:0/3337394605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0280a8740 msgr2=0x7fd02815a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd027400700 1 --2- 172.21.15.49:0/3337394605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0280a8740 0x7fd02815a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd027400700 1 -- 172.21.15.49:0/3337394605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0280c1ed0 msgr2=0x7fd0280a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd027400700 1 --2- 172.21.15.49:0/3337394605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0280c1ed0 0x7fd0280a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd027400700 1 -- 172.21.15.49:0/3337394605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd020009ae0 con 0x7fd028155d20 2024-01-22T05:09:04.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd027400700 1 --2- 172.21.15.49:0/3337394605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd028155d20 0x7fd0281520f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fd02000b610 tx=0x7fd020009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:04.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd01e000700 1 -- 172.21.15.49:0/3337394605 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0200092e0 con 0x7fd028155d20 2024-01-22T05:09:04.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd01e000700 1 -- 172.21.15.49:0/3337394605 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02001e470 con 0x7fd028155d20 2024-01-22T05:09:04.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd02d600700 1 -- 172.21.15.49:0/3337394605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0280aa3a0 con 0x7fd028155d20 2024-01-22T05:09:04.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd01e000700 1 -- 172.21.15.49:0/3337394605 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02001e830 con 0x7fd028155d20 2024-01-22T05:09:04.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.539+0000 7fd02d600700 1 -- 172.21.15.49:0/3337394605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0280a9aa0 con 0x7fd028155d20 2024-01-22T05:09:04.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.543+0000 7fd02d600700 1 -- 172.21.15.49:0/3337394605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0280aaba0 con 0x7fd028155d20 2024-01-22T05:09:04.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.543+0000 7fd01e000700 1 -- 172.21.15.49:0/3337394605 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd020003040 con 0x7fd028155d20 2024-01-22T05:09:04.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.543+0000 7fd01e000700 1 --2- 172.21.15.49:0/3337394605 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd00005a510 0x7fd00005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.547+0000 7fd01e000700 1 -- 172.21.15.49:0/3337394605 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd020075ee0 con 0x7fd028155d20 2024-01-22T05:09:04.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.547+0000 7fd026a00700 1 --2- 172.21.15.49:0/3337394605 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd00005a510 0x7fd00005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.547+0000 7fd026a00700 1 --2- 172.21.15.49:0/3337394605 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd00005a510 0x7fd00005c9d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fd018003870 tx=0x7fd018007d20).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.551+0000 7fd01e000700 1 -- 172.21.15.49:0/3337394605 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd0280aaba0 con 0x7fd028155d20 2024-01-22T05:09:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.715+0000 7fd02d600700 1 -- 172.21.15.49:0/3337394605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd028047060 con 0x7fd028155d20 2024-01-22T05:09:04.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.715+0000 7fd01e000700 1 -- 172.21.15.49:0/3337394605 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+17180 (secure 0 0 0) 0x7fd020023030 con 0x7fd028155d20 2024-01-22T05:09:04.721 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:04.721 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":69,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:09:03.929093+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:09:01.882090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-01-22T05:09:02.934332+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:09:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.719+0000 7fd02d600700 1 -- 172.21.15.49:0/3337394605 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd00005a510 msgr2=0x7fd00005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.719+0000 7fd02d600700 1 --2- 172.21.15.49:0/3337394605 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd00005a510 0x7fd00005c9d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fd018003870 tx=0x7fd018007d20).stop 2024-01-22T05:09:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.719+0000 7fd02d600700 1 -- 172.21.15.49:0/3337394605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd028155d20 msgr2=0x7fd0281520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.719+0000 7fd02d600700 1 --2- 172.21.15.49:0/3337394605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd028155d20 0x7fd0281520f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fd02000b610 tx=0x7fd020009840).stop 2024-01-22T05:09:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.719+0000 7fd02d600700 1 -- 172.21.15.49:0/3337394605 shutdown_connections 2024-01-22T05:09:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.719+0000 7fd02d600700 1 --2- 172.21.15.49:0/3337394605 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd00005a510 0x7fd00005c9d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.719+0000 7fd02d600700 1 --2- 172.21.15.49:0/3337394605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd028155d20 0x7fd0281520f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.719+0000 7fd02d600700 1 --2- 172.21.15.49:0/3337394605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0280c1ed0 0x7fd0280a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.719+0000 7fd02d600700 1 --2- 172.21.15.49:0/3337394605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0280a8740 0x7fd02815a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.719+0000 7fd02d600700 1 -- 172.21.15.49:0/3337394605 >> 172.21.15.49:0/3337394605 conn(0x7fd0280c6540 msgr2=0x7fd0280c22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:04.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.719+0000 7fd02d600700 1 -- 172.21.15.49:0/3337394605 shutdown_connections 2024-01-22T05:09:04.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.719+0000 7fd02d600700 1 -- 172.21.15.49:0/3337394605 wait complete. 2024-01-22T05:09:04.746 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:09:04.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.911+0000 7fcdbc600700 1 Processor -- start 2024-01-22T05:09:04.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.911+0000 7fcdbc600700 1 -- start start 2024-01-22T05:09:04.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdbc600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcdb40a8c20 0x7fcdb40c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdbc600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcdb40c1ac0 0x7fcdb40bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdbc600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb4158650 con 0x7fcdb40bc9c0 2024-01-22T05:09:04.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdbc600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb40c1f20 con 0x7fcdb40c1ac0 2024-01-22T05:09:04.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdbc600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb40bd170 con 0x7fcdb40a8c20 2024-01-22T05:09:04.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdb9200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcdb40c1ac0 0x7fcdb40bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdba600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcdb40bc9c0 0x7fcdb4068710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40248/0 (socket says 172.21.15.49:40248) 2024-01-22T05:09:04.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdba600700 1 -- 172.21.15.49:0/1962025189 learned_addr learned my addr 172.21.15.49:0/1962025189 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:04.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdb9c00700 1 --2- 172.21.15.49:0/1962025189 >> v2:172.21.15.110:3300/0 conn(0x7fcdb40a8c20 0x7fcdb40c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdb3e00700 1 -- 172.21.15.49:0/1962025189 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090388047 0 0) 0x7fcdac001490 con 0x7fcdb40bc9c0 2024-01-22T05:09:04.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdb3e00700 1 -- 172.21.15.49:0/1962025189 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd940033f0 con 0x7fcdb40bc9c0 2024-01-22T05:09:04.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdb9200700 1 -- 172.21.15.49:0/1962025189 >> v2:172.21.15.110:3300/0 conn(0x7fcdb40a8c20 msgr2=0x7fcdb40c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:04.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdb9200700 1 --2- 172.21.15.49:0/1962025189 >> v2:172.21.15.110:3300/0 conn(0x7fcdb40a8c20 0x7fcdb40c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdb9200700 1 -- 172.21.15.49:0/1962025189 >> v1:172.21.15.49:6789/0 conn(0x7fcdb40bc9c0 legacy=0x7fcdb4068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdb9200700 1 -- 172.21.15.49:0/1962025189 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb4067c30 con 0x7fcdb40c1ac0 2024-01-22T05:09:04.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdb9200700 1 --2- 172.21.15.49:0/1962025189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb40c1ac0 0x7fcdb40bc4d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fcdb40c4300 tx=0x7fcd9c006f40).ready entity=mon.0 client_cookie=1274ffe034c1eb55 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:04.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdb3e00700 1 -- 172.21.15.49:0/1962025189 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c005880 con 0x7fcdb40c1ac0 2024-01-22T05:09:04.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdb3e00700 1 -- 172.21.15.49:0/1962025189 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c0059e0 con 0x7fcdb40c1ac0 2024-01-22T05:09:04.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdb3e00700 1 -- 172.21.15.49:0/1962025189 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c005d60 con 0x7fcdb40c1ac0 2024-01-22T05:09:04.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.915+0000 7fcdbc600700 1 -- 172.21.15.49:0/1962025189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb40c1ac0 msgr2=0x7fcdb40bc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.919+0000 7fcdbc600700 1 --2- 172.21.15.49:0/1962025189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb40c1ac0 0x7fcdb40bc4d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fcdb40c4300 tx=0x7fcd9c006f40).stop 2024-01-22T05:09:04.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.919+0000 7fcdbc600700 1 -- 172.21.15.49:0/1962025189 shutdown_connections 2024-01-22T05:09:04.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.919+0000 7fcdbc600700 1 --2- 172.21.15.49:0/1962025189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb40c1ac0 0x7fcdb40bc4d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.919+0000 7fcdbc600700 1 --2- 172.21.15.49:0/1962025189 >> v2:172.21.15.110:3300/0 conn(0x7fcdb40a8c20 0x7fcdb40c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.919+0000 7fcdbc600700 1 -- 172.21.15.49:0/1962025189 >> 172.21.15.49:0/1962025189 conn(0x7fcdb4062cb0 msgr2=0x7fcdb40c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:04.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.919+0000 7fcdbc600700 1 -- 172.21.15.49:0/1962025189 shutdown_connections 2024-01-22T05:09:04.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.919+0000 7fcdbc600700 1 -- 172.21.15.49:0/1962025189 wait complete. 2024-01-22T05:09:04.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.919+0000 7fcdbc600700 1 Processor -- start 2024-01-22T05:09:04.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdbc600700 1 -- start start 2024-01-22T05:09:04.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdbc600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdb40a8c20 0x7fcdb409ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdbc600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb40bc9c0 0x7fcdb40be050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdbc600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb40c1ac0 0x7fcdb4168200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdbc600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb40a0420 con 0x7fcdb40c1ac0 2024-01-22T05:09:04.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdbc600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb40be540 con 0x7fcdb40a8c20 2024-01-22T05:09:04.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdbc600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb40be790 con 0x7fcdb40bc9c0 2024-01-22T05:09:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdba600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb40c1ac0 0x7fcdb4168200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdba600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb40c1ac0 0x7fcdb4168200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55560/0 (socket says 172.21.15.49:55560) 2024-01-22T05:09:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdba600700 1 -- 172.21.15.49:0/1752732300 learned_addr learned my addr 172.21.15.49:0/1752732300 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdb9200700 1 --2- 172.21.15.49:0/1752732300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb40bc9c0 0x7fcdb40be050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdb9c00700 1 --2- 172.21.15.49:0/1752732300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdb40a8c20 0x7fcdb409ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdba600700 1 -- 172.21.15.49:0/1752732300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb40bc9c0 msgr2=0x7fcdb40be050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdba600700 1 --2- 172.21.15.49:0/1752732300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb40bc9c0 0x7fcdb40be050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdba600700 1 -- 172.21.15.49:0/1752732300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdb40a8c20 msgr2=0x7fcdb409ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdba600700 1 --2- 172.21.15.49:0/1752732300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdb40a8c20 0x7fcdb409ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdba600700 1 -- 172.21.15.49:0/1752732300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c009250 con 0x7fcdb40c1ac0 2024-01-22T05:09:04.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.923+0000 7fcdba600700 1 --2- 172.21.15.49:0/1752732300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb40c1ac0 0x7fcdb4168200 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fcdac00c810 tx=0x7fcdac007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:04.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.927+0000 7fcdb0c00700 1 -- 172.21.15.49:0/1752732300 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac005d30 con 0x7fcdb40c1ac0 2024-01-22T05:09:04.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.927+0000 7fcdb0c00700 1 -- 172.21.15.49:0/1752732300 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac005e90 con 0x7fcdb40c1ac0 2024-01-22T05:09:04.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.927+0000 7fcdbc600700 1 -- 172.21.15.49:0/1752732300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb40beaf0 con 0x7fcdb40c1ac0 2024-01-22T05:09:04.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.927+0000 7fcdb0c00700 1 -- 172.21.15.49:0/1752732300 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac007320 con 0x7fcdb40c1ac0 2024-01-22T05:09:04.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.927+0000 7fcdbc600700 1 -- 172.21.15.49:0/1752732300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb40bf0b0 con 0x7fcdb40c1ac0 2024-01-22T05:09:04.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.927+0000 7fcdbc600700 1 -- 172.21.15.49:0/1752732300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb40c0c00 con 0x7fcdb40c1ac0 2024-01-22T05:09:04.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.927+0000 7fcdb0c00700 1 -- 172.21.15.49:0/1752732300 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcdac007710 con 0x7fcdb40c1ac0 2024-01-22T05:09:04.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.931+0000 7fcdb0c00700 1 --2- 172.21.15.49:0/1752732300 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd8c05a510 0x7fcd8c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:04.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.931+0000 7fcdb0c00700 1 -- 172.21.15.49:0/1752732300 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fcdac0747c0 con 0x7fcdb40c1ac0 2024-01-22T05:09:04.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.931+0000 7fcdb9c00700 1 --2- 172.21.15.49:0/1752732300 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd8c05a510 0x7fcd8c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:04.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.931+0000 7fcdb9c00700 1 --2- 172.21.15.49:0/1752732300 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd8c05a510 0x7fcd8c05c9d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fcda4009c30 tx=0x7fcda4009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:04.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:04.935+0000 7fcdb0c00700 1 -- 172.21.15.49:0/1752732300 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcdac047d80 con 0x7fcdb40c1ac0 2024-01-22T05:09:05.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:05.147+0000 7fcdbc600700 1 -- 172.21.15.49:0/1752732300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcdb41597d0 con 0x7fcdb40c1ac0 2024-01-22T05:09:05.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:05.959+0000 7fcdb0c00700 1 -- 172.21.15.49:0/1752732300 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcdb41597d0 con 0x7fcdb40c1ac0 2024-01-22T05:09:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:05.963+0000 7fcdbc600700 1 -- 172.21.15.49:0/1752732300 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd8c05a510 msgr2=0x7fcd8c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:05.963+0000 7fcdbc600700 1 --2- 172.21.15.49:0/1752732300 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd8c05a510 0x7fcd8c05c9d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fcda4009c30 tx=0x7fcda4009060).stop 2024-01-22T05:09:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:05.963+0000 7fcdbc600700 1 -- 172.21.15.49:0/1752732300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb40c1ac0 msgr2=0x7fcdb4168200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:05.963+0000 7fcdbc600700 1 --2- 172.21.15.49:0/1752732300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb40c1ac0 0x7fcdb4168200 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fcdac00c810 tx=0x7fcdac007e30).stop 2024-01-22T05:09:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:05.963+0000 7fcdbc600700 1 -- 172.21.15.49:0/1752732300 shutdown_connections 2024-01-22T05:09:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:05.963+0000 7fcdbc600700 1 --2- 172.21.15.49:0/1752732300 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd8c05a510 0x7fcd8c05c9d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:05.963+0000 7fcdbc600700 1 --2- 172.21.15.49:0/1752732300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb40c1ac0 0x7fcdb4168200 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:05.963+0000 7fcdbc600700 1 --2- 172.21.15.49:0/1752732300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb40bc9c0 0x7fcdb40be050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:05.963+0000 7fcdbc600700 1 --2- 172.21.15.49:0/1752732300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdb40a8c20 0x7fcdb409ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:05.963+0000 7fcdbc600700 1 -- 172.21.15.49:0/1752732300 >> 172.21.15.49:0/1752732300 conn(0x7fcdb4062cb0 msgr2=0x7fcdb40c4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:05.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:05.963+0000 7fcdbc600700 1 -- 172.21.15.49:0/1752732300 shutdown_connections 2024-01-22T05:09:05.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:05.963+0000 7fcdbc600700 1 -- 172.21.15.49:0/1752732300 wait complete. 2024-01-22T05:09:05.994 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T05:09:05.994 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:09:06.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.163+0000 7fc03d000700 1 Processor -- start 2024-01-22T05:09:06.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.167+0000 7fc03d000700 1 -- start start 2024-01-22T05:09:06.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.171+0000 7fc03d000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc0380bcc10 0x7fc0380c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:06.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.171+0000 7fc03d000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc038067a90 con 0x7fc0380c2190 2024-01-22T05:09:06.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.171+0000 7fc03d000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0380c2a30 con 0x7fc03814e570 2024-01-22T05:09:06.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.171+0000 7fc03d000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0380c2d10 con 0x7fc0380bcc10 2024-01-22T05:09:06.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.171+0000 7fc036800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc0380c2190 0x7fc038067f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40256/0 (socket says 172.21.15.49:40256) 2024-01-22T05:09:06.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.171+0000 7fc036800700 1 -- 172.21.15.49:0/3107839233 learned_addr learned my addr 172.21.15.49:0/3107839233 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:06.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.171+0000 7fc035400700 1 --2- 172.21.15.49:0/3107839233 >> v2:172.21.15.110:3300/0 conn(0x7fc0380bcc10 0x7fc0380c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:06.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.171+0000 7fc034a00700 1 -- 172.21.15.49:0/3107839233 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560395119 0 0) 0x7fc038067a90 con 0x7fc0380c2190 2024-01-22T05:09:06.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.171+0000 7fc034a00700 1 -- 172.21.15.49:0/3107839233 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0180033f0 con 0x7fc0380c2190 2024-01-22T05:09:06.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.171+0000 7fc035400700 1 -- 172.21.15.49:0/3107839233 >> v1:172.21.15.110:6789/0 conn(0x7fc03814e570 legacy=0x7fc0380bc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:06.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.171+0000 7fc034a00700 1 -- 172.21.15.49:0/3107839233 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926059167 0 0) 0x7fc0380c2a30 con 0x7fc03814e570 2024-01-22T05:09:06.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.171+0000 7fc035400700 1 -- 172.21.15.49:0/3107839233 >> v1:172.21.15.49:6789/0 conn(0x7fc0380c2190 legacy=0x7fc038067f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:06.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.171+0000 7fc035400700 1 -- 172.21.15.49:0/3107839233 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0380c2ff0 con 0x7fc0380bcc10 2024-01-22T05:09:06.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.171+0000 7fc035400700 1 --2- 172.21.15.49:0/3107839233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0380bcc10 0x7fc0380c1ca0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fc020009760 tx=0x7fc020009060).ready entity=mon.1 client_cookie=8530f6f30e880f68 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:06.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.175+0000 7fc034a00700 1 -- 172.21.15.49:0/3107839233 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0300017f0 con 0x7fc0380bcc10 2024-01-22T05:09:06.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.175+0000 7fc034a00700 1 -- 172.21.15.49:0/3107839233 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc020012410 con 0x7fc0380bcc10 2024-01-22T05:09:06.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.175+0000 7fc034a00700 1 -- 172.21.15.49:0/3107839233 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020012790 con 0x7fc0380bcc10 2024-01-22T05:09:06.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.175+0000 7fc03d000700 1 -- 172.21.15.49:0/3107839233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0380bcc10 msgr2=0x7fc0380c1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:06.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.175+0000 7fc03d000700 1 --2- 172.21.15.49:0/3107839233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0380bcc10 0x7fc0380c1ca0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fc020009760 tx=0x7fc020009060).stop 2024-01-22T05:09:06.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.175+0000 7fc03d000700 1 -- 172.21.15.49:0/3107839233 shutdown_connections 2024-01-22T05:09:06.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.175+0000 7fc03d000700 1 --2- 172.21.15.49:0/3107839233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0380bcc10 0x7fc0380c1ca0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:06.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.175+0000 7fc03d000700 1 -- 172.21.15.49:0/3107839233 >> 172.21.15.49:0/3107839233 conn(0x7fc0380c3900 msgr2=0x7fc0380c3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:06.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.175+0000 7fc03d000700 1 -- 172.21.15.49:0/3107839233 shutdown_connections 2024-01-22T05:09:06.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.175+0000 7fc03d000700 1 -- 172.21.15.49:0/3107839233 wait complete. 2024-01-22T05:09:06.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.179+0000 7fc03d000700 1 Processor -- start 2024-01-22T05:09:06.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.179+0000 7fc03d000700 1 -- start start 2024-01-22T05:09:06.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc03d000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0380bcc10 0x7fc038150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:06.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc03d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0380c2190 0x7fc0380682f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:06.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc03d000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc03814e570 0x7fc0380c07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:06.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc03d000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0380be980 con 0x7fc0380c2190 2024-01-22T05:09:06.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc03d000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0380687e0 con 0x7fc0380bcc10 2024-01-22T05:09:06.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc03d000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0380c0cb0 con 0x7fc03814e570 2024-01-22T05:09:06.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc035400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0380c2190 0x7fc0380682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:06.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc035e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0380bcc10 0x7fc038150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:06.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc035e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0380bcc10 0x7fc038150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:54734/0 (socket says 172.21.15.49:54734) 2024-01-22T05:09:06.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc035e00700 1 -- 172.21.15.49:0/1389959034 learned_addr learned my addr 172.21.15.49:0/1389959034 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:06.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc036800700 1 --2- 172.21.15.49:0/1389959034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc03814e570 0x7fc0380c07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:06.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc035e00700 1 -- 172.21.15.49:0/1389959034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc03814e570 msgr2=0x7fc0380c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:06.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc035e00700 1 --2- 172.21.15.49:0/1389959034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc03814e570 0x7fc0380c07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:06.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc035e00700 1 -- 172.21.15.49:0/1389959034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0380c2190 msgr2=0x7fc0380682f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:06.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc035e00700 1 --2- 172.21.15.49:0/1389959034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0380c2190 0x7fc0380682f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:06.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc035e00700 1 -- 172.21.15.49:0/1389959034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0200092a0 con 0x7fc0380bcc10 2024-01-22T05:09:06.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc035e00700 1 --2- 172.21.15.49:0/1389959034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0380bcc10 0x7fc038150c50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fc02800c410 tx=0x7fc028007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:06.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc02d600700 1 -- 172.21.15.49:0/1389959034 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028007020 con 0x7fc0380bcc10 2024-01-22T05:09:06.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc02d600700 1 -- 172.21.15.49:0/1389959034 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0280071a0 con 0x7fc0380bcc10 2024-01-22T05:09:06.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc03d000700 1 -- 172.21.15.49:0/1389959034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc038151270 con 0x7fc0380bcc10 2024-01-22T05:09:06.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc02d600700 1 -- 172.21.15.49:0/1389959034 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028007560 con 0x7fc0380bcc10 2024-01-22T05:09:06.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.183+0000 7fc03d000700 1 -- 172.21.15.49:0/1389959034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc038151830 con 0x7fc0380bcc10 2024-01-22T05:09:06.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.187+0000 7fc03d000700 1 -- 172.21.15.49:0/1389959034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc038065280 con 0x7fc0380bcc10 2024-01-22T05:09:06.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.187+0000 7fc02d600700 1 -- 172.21.15.49:0/1389959034 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc0280068b0 con 0x7fc0380bcc10 2024-01-22T05:09:06.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.191+0000 7fc02d600700 1 --2- 172.21.15.49:0/1389959034 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc01005a540 0x7fc01005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:06.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.191+0000 7fc02d600700 1 -- 172.21.15.49:0/1389959034 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc028073ba0 con 0x7fc0380bcc10 2024-01-22T05:09:06.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.191+0000 7fc035400700 1 --2- 172.21.15.49:0/1389959034 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc01005a540 0x7fc01005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:06.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.191+0000 7fc035400700 1 --2- 172.21.15.49:0/1389959034 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc01005a540 0x7fc01005ca00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fc0380bd010 tx=0x7fc020015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:06.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.199+0000 7fc02d600700 1 -- 172.21.15.49:0/1389959034 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc028047160 con 0x7fc0380bcc10 2024-01-22T05:09:06.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:06.403+0000 7fc03d000700 1 -- 172.21.15.49:0/1389959034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc038069490 con 0x7fc0380bcc10 2024-01-22T05:09:07.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.155+0000 7fc02d600700 1 -- 172.21.15.49:0/1389959034 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc02804a780 con 0x7fc0380bcc10 2024-01-22T05:09:07.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.159+0000 7fc03d000700 1 -- 172.21.15.49:0/1389959034 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc01005a540 msgr2=0x7fc01005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:07.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.159+0000 7fc03d000700 1 --2- 172.21.15.49:0/1389959034 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc01005a540 0x7fc01005ca00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fc0380bd010 tx=0x7fc020015000).stop 2024-01-22T05:09:07.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.159+0000 7fc03d000700 1 -- 172.21.15.49:0/1389959034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0380bcc10 msgr2=0x7fc038150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:07.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.159+0000 7fc03d000700 1 --2- 172.21.15.49:0/1389959034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0380bcc10 0x7fc038150c50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fc02800c410 tx=0x7fc028007e00).stop 2024-01-22T05:09:07.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.159+0000 7fc03d000700 1 -- 172.21.15.49:0/1389959034 shutdown_connections 2024-01-22T05:09:07.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.159+0000 7fc03d000700 1 --2- 172.21.15.49:0/1389959034 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc01005a540 0x7fc01005ca00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.159+0000 7fc03d000700 1 --2- 172.21.15.49:0/1389959034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc03814e570 0x7fc0380c07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.159+0000 7fc03d000700 1 --2- 172.21.15.49:0/1389959034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0380c2190 0x7fc0380682f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.159+0000 7fc03d000700 1 --2- 172.21.15.49:0/1389959034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0380bcc10 0x7fc038150c50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.159+0000 7fc03d000700 1 -- 172.21.15.49:0/1389959034 >> 172.21.15.49:0/1389959034 conn(0x7fc0380c3900 msgr2=0x7fc0380c57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:07.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.159+0000 7fc03d000700 1 -- 172.21.15.49:0/1389959034 shutdown_connections 2024-01-22T05:09:07.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.159+0000 7fc03d000700 1 -- 172.21.15.49:0/1389959034 wait complete. 2024-01-22T05:09:07.189 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:09:07.190 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:09:07.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.343+0000 7f3e9e800700 1 Processor -- start 2024-01-22T05:09:07.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.343+0000 7f3e9e800700 1 -- start start 2024-01-22T05:09:07.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e9e800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3e98064c00 0x7f3e980bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:07.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e9e800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e980c2700 con 0x7f3e98065620 2024-01-22T05:09:07.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e9e800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e980c29a0 con 0x7f3e98065240 2024-01-22T05:09:07.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e9e800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e980c2c80 con 0x7f3e98064c00 2024-01-22T05:09:07.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e96a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3e98064c00 0x7f3e980bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:07.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e97400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3e98065240 0x7f3e980644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:54960/0 (socket says 172.21.15.49:54960) 2024-01-22T05:09:07.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e97400700 1 -- 172.21.15.49:0/474748777 learned_addr learned my addr 172.21.15.49:0/474748777 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:07.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e9d200700 1 --1- 172.21.15.49:0/474748777 >> v1:172.21.15.49:6789/0 conn(0x7f3e98065620 0x7f3e980bd170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40264/0 (socket says 172.21.15.49:40264) 2024-01-22T05:09:07.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e96000700 1 -- 172.21.15.49:0/474748777 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422361795 0 0) 0x7f3e980c29a0 con 0x7f3e98065240 2024-01-22T05:09:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e96000700 1 -- 172.21.15.49:0/474748777 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e780033f0 con 0x7f3e98065240 2024-01-22T05:09:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e96000700 1 -- 172.21.15.49:0/474748777 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636908369 0 0) 0x7f3e980c2700 con 0x7f3e98065620 2024-01-22T05:09:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e96000700 1 -- 172.21.15.49:0/474748777 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e980c29a0 con 0x7f3e98065620 2024-01-22T05:09:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e96a00700 1 -- 172.21.15.49:0/474748777 >> v1:172.21.15.110:6789/0 conn(0x7f3e98065240 legacy=0x7f3e980644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e96a00700 1 -- 172.21.15.49:0/474748777 >> v1:172.21.15.49:6789/0 conn(0x7f3e98065620 legacy=0x7f3e980bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:07.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e96a00700 1 -- 172.21.15.49:0/474748777 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e980c2f60 con 0x7f3e98064c00 2024-01-22T05:09:07.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.347+0000 7f3e96a00700 1 --2- 172.21.15.49:0/474748777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e98064c00 0x7f3e980bcc80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f3e80009760 tx=0x7f3e80009060).ready entity=mon.1 client_cookie=2817431cfe11e9ce server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:07.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.351+0000 7f3e96000700 1 -- 172.21.15.49:0/474748777 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8000d4a0 con 0x7f3e98064c00 2024-01-22T05:09:07.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.351+0000 7f3e96000700 1 -- 172.21.15.49:0/474748777 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8000d600 con 0x7f3e98064c00 2024-01-22T05:09:07.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.351+0000 7f3e96000700 1 -- 172.21.15.49:0/474748777 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8000d980 con 0x7f3e98064c00 2024-01-22T05:09:07.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.351+0000 7f3e9e800700 1 -- 172.21.15.49:0/474748777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e98064c00 msgr2=0x7f3e980bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:07.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.351+0000 7f3e9e800700 1 --2- 172.21.15.49:0/474748777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e98064c00 0x7f3e980bcc80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f3e80009760 tx=0x7f3e80009060).stop 2024-01-22T05:09:07.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.351+0000 7f3e9e800700 1 -- 172.21.15.49:0/474748777 shutdown_connections 2024-01-22T05:09:07.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.351+0000 7f3e9e800700 1 --2- 172.21.15.49:0/474748777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e98064c00 0x7f3e980bcc80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.351+0000 7f3e9e800700 1 -- 172.21.15.49:0/474748777 >> 172.21.15.49:0/474748777 conn(0x7f3e980c87f0 msgr2=0x7f3e980c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:07.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.351+0000 7f3e9e800700 1 -- 172.21.15.49:0/474748777 shutdown_connections 2024-01-22T05:09:07.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.351+0000 7f3e9e800700 1 -- 172.21.15.49:0/474748777 wait complete. 2024-01-22T05:09:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.355+0000 7f3e9e800700 1 Processor -- start 2024-01-22T05:09:07.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.355+0000 7f3e9e800700 1 -- start start 2024-01-22T05:09:07.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.355+0000 7f3e9e800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e98064c00 0x7f3e98145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:07.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.355+0000 7f3e9e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e98065240 0x7f3e980a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:07.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.355+0000 7f3e9e800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e98065620 0x7f3e980ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:07.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.355+0000 7f3e9e800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980a9b10 con 0x7f3e98065240 2024-01-22T05:09:07.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.355+0000 7f3e9e800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980a8f00 con 0x7f3e98065620 2024-01-22T05:09:07.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.355+0000 7f3e9e800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980a91e0 con 0x7f3e98064c00 2024-01-22T05:09:07.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.355+0000 7f3e96a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e98065240 0x7f3e980a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:07.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.359+0000 7f3e96a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e98065240 0x7f3e980a9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55570/0 (socket says 172.21.15.49:55570) 2024-01-22T05:09:07.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.359+0000 7f3e96a00700 1 -- 172.21.15.49:0/1683442053 learned_addr learned my addr 172.21.15.49:0/1683442053 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:07.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.359+0000 7f3e97400700 1 --2- 172.21.15.49:0/1683442053 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e98064c00 0x7f3e98145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:07.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.359+0000 7f3e9d200700 1 --2- 172.21.15.49:0/1683442053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e98065620 0x7f3e980ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.359+0000 7f3e96a00700 1 -- 172.21.15.49:0/1683442053 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e98064c00 msgr2=0x7f3e98145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.359+0000 7f3e96a00700 1 --2- 172.21.15.49:0/1683442053 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e98064c00 0x7f3e98145f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.359+0000 7f3e96a00700 1 -- 172.21.15.49:0/1683442053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e98065620 msgr2=0x7f3e980ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.359+0000 7f3e96a00700 1 --2- 172.21.15.49:0/1683442053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e98065620 0x7f3e980ac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.359+0000 7f3e96a00700 1 -- 172.21.15.49:0/1683442053 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e800092a0 con 0x7f3e98065240 2024-01-22T05:09:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.359+0000 7f3e96a00700 1 --2- 172.21.15.49:0/1683442053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e98065240 0x7f3e980a9fa0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f3e80009630 tx=0x7f3e80016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.359+0000 7f3e8ea00700 1 -- 172.21.15.49:0/1683442053 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8000dcf0 con 0x7f3e98065240 2024-01-22T05:09:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.359+0000 7f3e8ea00700 1 -- 172.21.15.49:0/1683442053 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8000de50 con 0x7f3e98065240 2024-01-22T05:09:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.359+0000 7f3e8ea00700 1 -- 172.21.15.49:0/1683442053 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8001d430 con 0x7f3e98065240 2024-01-22T05:09:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.359+0000 7f3e9e800700 1 -- 172.21.15.49:0/1683442053 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e980a94c0 con 0x7f3e98065240 2024-01-22T05:09:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.359+0000 7f3e9e800700 1 -- 172.21.15.49:0/1683442053 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e98146460 con 0x7f3e98065240 2024-01-22T05:09:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.363+0000 7f3e9e800700 1 -- 172.21.15.49:0/1683442053 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e980a9cc0 con 0x7f3e98065240 2024-01-22T05:09:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.363+0000 7f3e8ea00700 1 -- 172.21.15.49:0/1683442053 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3e8001d7e0 con 0x7f3e98065240 2024-01-22T05:09:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.363+0000 7f3e8ea00700 1 --2- 172.21.15.49:0/1683442053 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e7005a510 0x7f3e7005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.363+0000 7f3e8ea00700 1 -- 172.21.15.49:0/1683442053 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3e80075ff0 con 0x7f3e98065240 2024-01-22T05:09:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.363+0000 7f3e97400700 1 --2- 172.21.15.49:0/1683442053 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e7005a510 0x7f3e7005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.363+0000 7f3e97400700 1 --2- 172.21.15.49:0/1683442053 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e7005a510 0x7f3e7005c9d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f3e88005750 tx=0x7f3e88009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:07.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.371+0000 7f3e8ea00700 1 -- 172.21.15.49:0/1683442053 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3e800a4b00 con 0x7f3e98065240 2024-01-22T05:09:07.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.567+0000 7f3e9e800700 1 -- 172.21.15.49:0/1683442053 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e980a9940 con 0x7f3e98065240 2024-01-22T05:09:07.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.571+0000 7f3e8ea00700 1 -- 172.21.15.49:0/1683442053 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f3e980a9cc0 con 0x7f3e98065240 2024-01-22T05:09:07.573 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:07.573 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":56,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5729,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2604306838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2604306838},{"type":"v1","addr":"172.21.15.49:6835","nonce":2604306838}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2092666136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2092666136},{"type":"v1","addr":"172.21.15.110:6833","nonce":2092666136}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1078192149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1078192149},{"type":"v1","addr":"172.21.15.110:6835","nonce":1078192149}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:09:03.929962+0000","modified":"2024-01-22T05:09:07.150662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6348":{"gid":6348,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/2817241041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2817241041},{"type":"v1","addr":"172.21.15.49:6837","nonce":2817241041}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-22T05:09:07.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.575+0000 7f3e9e800700 1 -- 172.21.15.49:0/1683442053 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e7005a510 msgr2=0x7f3e7005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:07.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.575+0000 7f3e9e800700 1 --2- 172.21.15.49:0/1683442053 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e7005a510 0x7f3e7005c9d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f3e88005750 tx=0x7f3e88009040).stop 2024-01-22T05:09:07.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.575+0000 7f3e9e800700 1 -- 172.21.15.49:0/1683442053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e98065240 msgr2=0x7f3e980a9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:07.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.575+0000 7f3e9e800700 1 --2- 172.21.15.49:0/1683442053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e98065240 0x7f3e980a9fa0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f3e80009630 tx=0x7f3e80016000).stop 2024-01-22T05:09:07.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.575+0000 7f3e9e800700 1 -- 172.21.15.49:0/1683442053 shutdown_connections 2024-01-22T05:09:07.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.575+0000 7f3e9e800700 1 --2- 172.21.15.49:0/1683442053 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e7005a510 0x7f3e7005c9d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.575+0000 7f3e9e800700 1 --2- 172.21.15.49:0/1683442053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e98065620 0x7f3e980ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.575+0000 7f3e9e800700 1 --2- 172.21.15.49:0/1683442053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e98065240 0x7f3e980a9fa0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.575+0000 7f3e9e800700 1 --2- 172.21.15.49:0/1683442053 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e98064c00 0x7f3e98145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.575+0000 7f3e9e800700 1 -- 172.21.15.49:0/1683442053 >> 172.21.15.49:0/1683442053 conn(0x7f3e980c87f0 msgr2=0x7f3e98153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:07.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.575+0000 7f3e9e800700 1 -- 172.21.15.49:0/1683442053 shutdown_connections 2024-01-22T05:09:07.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.575+0000 7f3e9e800700 1 -- 172.21.15.49:0/1683442053 wait complete. 2024-01-22T05:09:07.583 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 56 2024-01-22T05:09:07.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:09:07.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:09:07.753 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:09:07.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.763+0000 7f86e7200700 1 Processor -- start 2024-01-22T05:09:07.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.763+0000 7f86e7200700 1 -- start start 2024-01-22T05:09:07.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.767+0000 7f86e7200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f86e0065240 0x7f86e00644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:07.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.767+0000 7f86e7200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e00649e0 0x7f86e015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:07.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.767+0000 7f86e7200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e00c2700 con 0x7f86e0065620 2024-01-22T05:09:07.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.767+0000 7f86e7200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e0064e30 con 0x7f86e0065240 2024-01-22T05:09:07.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.767+0000 7f86e7200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00c29a0 con 0x7f86e00649e0 2024-01-22T05:09:07.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.767+0000 7f86e5c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e00649e0 0x7f86e015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:07.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.767+0000 7f86dfe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f86e0065240 0x7f86e00644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:07.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.767+0000 7f86e5c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e00649e0 0x7f86e015c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:55756/0 (socket says 172.21.15.49:55756) 2024-01-22T05:09:07.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.767+0000 7f86e5c00700 1 -- 172.21.15.49:0/943112715 learned_addr learned my addr 172.21.15.49:0/943112715 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:07.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.767+0000 7f86e5c00700 1 -- 172.21.15.49:0/943112715 >> v2:172.21.15.110:3300/0 conn(0x7f86e0065240 msgr2=0x7f86e00644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:07.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.767+0000 7f86e5c00700 1 --2- 172.21.15.49:0/943112715 >> v2:172.21.15.110:3300/0 conn(0x7f86e0065240 0x7f86e00644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.767+0000 7f86e5c00700 1 -- 172.21.15.49:0/943112715 >> v1:172.21.15.110:6789/0 conn(0x7f86e0065620 legacy=0x7f86e015b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:07.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.767+0000 7f86e5c00700 1 -- 172.21.15.49:0/943112715 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e00c2c80 con 0x7f86e00649e0 2024-01-22T05:09:07.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.771+0000 7f86e5c00700 1 --2- 172.21.15.49:0/943112715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e00649e0 0x7f86e015c0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f86d8009f20 tx=0x7f86d8009840).ready entity=mon.2 client_cookie=b996468b0b8c50bc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:07.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.771+0000 7f86dea00700 1 -- 172.21.15.49:0/943112715 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d800e070 con 0x7f86e00649e0 2024-01-22T05:09:07.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.771+0000 7f86dea00700 1 -- 172.21.15.49:0/943112715 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d800b9d0 con 0x7f86e00649e0 2024-01-22T05:09:07.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.771+0000 7f86dea00700 1 -- 172.21.15.49:0/943112715 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d800bd50 con 0x7f86e00649e0 2024-01-22T05:09:07.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.771+0000 7f86e7200700 1 -- 172.21.15.49:0/943112715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e00649e0 msgr2=0x7f86e015c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:07.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.771+0000 7f86e7200700 1 --2- 172.21.15.49:0/943112715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e00649e0 0x7f86e015c0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f86d8009f20 tx=0x7f86d8009840).stop 2024-01-22T05:09:07.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.771+0000 7f86e7200700 1 -- 172.21.15.49:0/943112715 shutdown_connections 2024-01-22T05:09:07.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.771+0000 7f86e7200700 1 --2- 172.21.15.49:0/943112715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e00649e0 0x7f86e015c0c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.771+0000 7f86e7200700 1 --2- 172.21.15.49:0/943112715 >> v2:172.21.15.110:3300/0 conn(0x7f86e0065240 0x7f86e00644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.771+0000 7f86e7200700 1 -- 172.21.15.49:0/943112715 >> 172.21.15.49:0/943112715 conn(0x7f86e00c87f0 msgr2=0x7f86e00c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:07.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.771+0000 7f86e7200700 1 -- 172.21.15.49:0/943112715 shutdown_connections 2024-01-22T05:09:07.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.771+0000 7f86e7200700 1 -- 172.21.15.49:0/943112715 wait complete. 2024-01-22T05:09:07.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.775+0000 7f86e7200700 1 Processor -- start 2024-01-22T05:09:07.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.775+0000 7f86e7200700 1 -- start start 2024-01-22T05:09:07.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.775+0000 7f86e7200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e00649e0 0x7f86e00a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:07.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86e7200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e0065240 0x7f86e0159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:07.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86e7200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e0065620 0x7f86e0145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:07.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86e7200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e0158bc0 con 0x7f86e0065240 2024-01-22T05:09:07.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86e7200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e0158ea0 con 0x7f86e00649e0 2024-01-22T05:09:07.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86e7200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e0159180 con 0x7f86e0065620 2024-01-22T05:09:07.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86df400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e0065240 0x7f86e0159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:07.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86df400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e0065240 0x7f86e0159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55576/0 (socket says 172.21.15.49:55576) 2024-01-22T05:09:07.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86df400700 1 -- 172.21.15.49:0/2851330707 learned_addr learned my addr 172.21.15.49:0/2851330707 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:07.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86e5c00700 1 --2- 172.21.15.49:0/2851330707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e0065620 0x7f86e0145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:07.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86dfe00700 1 --2- 172.21.15.49:0/2851330707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e00649e0 0x7f86e00a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:07.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86df400700 1 -- 172.21.15.49:0/2851330707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e0065620 msgr2=0x7f86e0145aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:07.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86df400700 1 --2- 172.21.15.49:0/2851330707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e0065620 0x7f86e0145aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86df400700 1 -- 172.21.15.49:0/2851330707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e00649e0 msgr2=0x7f86e00a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:07.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86df400700 1 --2- 172.21.15.49:0/2851330707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e00649e0 0x7f86e00a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86df400700 1 -- 172.21.15.49:0/2851330707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d8009ae0 con 0x7f86e0065240 2024-01-22T05:09:07.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86df400700 1 --2- 172.21.15.49:0/2851330707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e0065240 0x7f86e0159ba0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f86c800c440 tx=0x7f86c8007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:07.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86d7400700 1 -- 172.21.15.49:0/2851330707 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8007020 con 0x7f86e0065240 2024-01-22T05:09:07.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86d7400700 1 -- 172.21.15.49:0/2851330707 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c8007180 con 0x7f86e0065240 2024-01-22T05:09:07.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86e7200700 1 -- 172.21.15.49:0/2851330707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e0159460 con 0x7f86e0065240 2024-01-22T05:09:07.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86d7400700 1 -- 172.21.15.49:0/2851330707 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8007520 con 0x7f86e0065240 2024-01-22T05:09:07.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.779+0000 7f86e7200700 1 -- 172.21.15.49:0/2851330707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e00aa4e0 con 0x7f86e0065240 2024-01-22T05:09:07.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.783+0000 7f86e7200700 1 -- 172.21.15.49:0/2851330707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e0047060 con 0x7f86e0065240 2024-01-22T05:09:07.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.783+0000 7f86d7400700 1 -- 172.21.15.49:0/2851330707 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f86c80068b0 con 0x7f86e0065240 2024-01-22T05:09:07.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.783+0000 7f86d7400700 1 --2- 172.21.15.49:0/2851330707 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86b805a510 0x7f86b805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:07.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.783+0000 7f86d7400700 1 -- 172.21.15.49:0/2851330707 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f86c8074210 con 0x7f86e0065240 2024-01-22T05:09:07.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.783+0000 7f86dfe00700 1 --2- 172.21.15.49:0/2851330707 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86b805a510 0x7f86b805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:07.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.783+0000 7f86dfe00700 1 --2- 172.21.15.49:0/2851330707 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86b805a510 0x7f86b805c9d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f86d0009c30 tx=0x7f86d0009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:07.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.791+0000 7f86d7400700 1 -- 172.21.15.49:0/2851330707 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f86c8047890 con 0x7f86e0065240 2024-01-22T05:09:07.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.955+0000 7f86e7200700 1 -- 172.21.15.49:0/2851330707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86e00c2f60 con 0x7f86e0065240 2024-01-22T05:09:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.955+0000 7f86d7400700 1 -- 172.21.15.49:0/2851330707 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+17167 (secure 0 0 0) 0x7f86c804aeb0 con 0x7f86e0065240 2024-01-22T05:09:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:07.961 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":70,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:09:04.939957+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:09:01.882090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-01-22T05:09:02.934332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:09:07.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.963+0000 7f86e7200700 1 -- 172.21.15.49:0/2851330707 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86b805a510 msgr2=0x7f86b805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:07.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.963+0000 7f86e7200700 1 --2- 172.21.15.49:0/2851330707 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86b805a510 0x7f86b805c9d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f86d0009c30 tx=0x7f86d0009060).stop 2024-01-22T05:09:07.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.963+0000 7f86e7200700 1 -- 172.21.15.49:0/2851330707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e0065240 msgr2=0x7f86e0159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:07.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.963+0000 7f86e7200700 1 --2- 172.21.15.49:0/2851330707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e0065240 0x7f86e0159ba0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f86c800c440 tx=0x7f86c8007da0).stop 2024-01-22T05:09:07.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.963+0000 7f86e7200700 1 -- 172.21.15.49:0/2851330707 shutdown_connections 2024-01-22T05:09:07.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.963+0000 7f86e7200700 1 --2- 172.21.15.49:0/2851330707 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f86b805a510 0x7f86b805c9d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.963+0000 7f86e7200700 1 --2- 172.21.15.49:0/2851330707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e0065620 0x7f86e0145aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.963+0000 7f86e7200700 1 --2- 172.21.15.49:0/2851330707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86e0065240 0x7f86e0159ba0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.963+0000 7f86e7200700 1 --2- 172.21.15.49:0/2851330707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e00649e0 0x7f86e00a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:07.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.963+0000 7f86e7200700 1 -- 172.21.15.49:0/2851330707 >> 172.21.15.49:0/2851330707 conn(0x7f86e00c87f0 msgr2=0x7f86e00c47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:07.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.963+0000 7f86e7200700 1 -- 172.21.15.49:0/2851330707 shutdown_connections 2024-01-22T05:09:07.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:07.963+0000 7f86e7200700 1 -- 172.21.15.49:0/2851330707 wait complete. 2024-01-22T05:09:07.990 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:09:07.991 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:09:08.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.155+0000 7fb479400700 1 Processor -- start 2024-01-22T05:09:08.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.155+0000 7fb479400700 1 -- start start 2024-01-22T05:09:08.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.155+0000 7fb479400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb474068aa0 0x7fb4740c4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.155+0000 7fb479400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4740c3b90 con 0x7fb4740a7a40 2024-01-22T05:09:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb479400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb474069060 con 0x7fb4740c4c20 2024-01-22T05:09:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb479400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4740c3540 con 0x7fb474068aa0 2024-01-22T05:09:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb473400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb474068aa0 0x7fb4740c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb473e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb4740a7a40 0x7fb4740c4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40266/0 (socket says 172.21.15.49:40266) 2024-01-22T05:09:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb473e00700 1 -- 172.21.15.49:0/1827020601 learned_addr learned my addr 172.21.15.49:0/1827020601 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb473400700 1 -- 172.21.15.49:0/1827020601 >> v1:172.21.15.110:6789/0 conn(0x7fb4740c4c20 legacy=0x7fb47415b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb473400700 1 -- 172.21.15.49:0/1827020601 >> v1:172.21.15.49:6789/0 conn(0x7fb4740a7a40 legacy=0x7fb4740c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb473400700 1 -- 172.21.15.49:0/1827020601 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4740c3820 con 0x7fb474068aa0 2024-01-22T05:09:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb472a00700 1 -- 172.21.15.49:0/1827020601 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619106360 0 0) 0x7fb4740c3b90 con 0x7fb4740a7a40 2024-01-22T05:09:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb473400700 1 --2- 172.21.15.49:0/1827020601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb474068aa0 0x7fb4740c4730 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fb45c009760 tx=0x7fb45c009060).ready entity=mon.0 client_cookie=fc816653b4c8656d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb472a00700 1 -- 172.21.15.49:0/1827020601 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c00b580 con 0x7fb474068aa0 2024-01-22T05:09:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb472a00700 1 -- 172.21.15.49:0/1827020601 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c00b6e0 con 0x7fb474068aa0 2024-01-22T05:09:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb472a00700 1 -- 172.21.15.49:0/1827020601 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c00ba60 con 0x7fb474068aa0 2024-01-22T05:09:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb479400700 1 -- 172.21.15.49:0/1827020601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb474068aa0 msgr2=0x7fb4740c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:08.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb479400700 1 --2- 172.21.15.49:0/1827020601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb474068aa0 0x7fb4740c4730 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fb45c009760 tx=0x7fb45c009060).stop 2024-01-22T05:09:08.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb479400700 1 -- 172.21.15.49:0/1827020601 shutdown_connections 2024-01-22T05:09:08.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb479400700 1 --2- 172.21.15.49:0/1827020601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb474068aa0 0x7fb4740c4730 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.159+0000 7fb479400700 1 -- 172.21.15.49:0/1827020601 >> 172.21.15.49:0/1827020601 conn(0x7fb4740c86e0 msgr2=0x7fb4740c8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:08.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.163+0000 7fb479400700 1 -- 172.21.15.49:0/1827020601 shutdown_connections 2024-01-22T05:09:08.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.163+0000 7fb479400700 1 -- 172.21.15.49:0/1827020601 wait complete. 2024-01-22T05:09:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.163+0000 7fb479400700 1 Processor -- start 2024-01-22T05:09:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb479400700 1 -- start start 2024-01-22T05:09:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb479400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb474068aa0 0x7fb47414d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:08.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb479400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4740a7a40 0x7fb47414ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:08.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb479400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4740c4c20 0x7fb4741504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:08.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb479400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb474152450 con 0x7fb474068aa0 2024-01-22T05:09:08.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb479400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb474151740 con 0x7fb4740a7a40 2024-01-22T05:09:08.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb479400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb474150b30 con 0x7fb4740c4c20 2024-01-22T05:09:08.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb473e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb474068aa0 0x7fb47414d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb473e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb474068aa0 0x7fb47414d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55586/0 (socket says 172.21.15.49:55586) 2024-01-22T05:09:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb473e00700 1 -- 172.21.15.49:0/2785487591 learned_addr learned my addr 172.21.15.49:0/2785487591 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb478a00700 1 --2- 172.21.15.49:0/2785487591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4740c4c20 0x7fb4741504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb473400700 1 --2- 172.21.15.49:0/2785487591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4740a7a40 0x7fb47414ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb473e00700 1 -- 172.21.15.49:0/2785487591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4740c4c20 msgr2=0x7fb4741504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb473e00700 1 --2- 172.21.15.49:0/2785487591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4740c4c20 0x7fb4741504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb473e00700 1 -- 172.21.15.49:0/2785487591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4740a7a40 msgr2=0x7fb47414ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb473e00700 1 --2- 172.21.15.49:0/2785487591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4740a7a40 0x7fb47414ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb473e00700 1 -- 172.21.15.49:0/2785487591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c0092a0 con 0x7fb474068aa0 2024-01-22T05:09:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb478a00700 1 --2- 172.21.15.49:0/2785487591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4740c4c20 0x7fb4741504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb473e00700 1 --2- 172.21.15.49:0/2785487591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb474068aa0 0x7fb47414d550 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fb46400c4c0 tx=0x7fb464007ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.167+0000 7fb46b400700 1 -- 172.21.15.49:0/2785487591 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4640072e0 con 0x7fb474068aa0 2024-01-22T05:09:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.171+0000 7fb46b400700 1 -- 172.21.15.49:0/2785487591 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb464007440 con 0x7fb474068aa0 2024-01-22T05:09:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.171+0000 7fb46b400700 1 -- 172.21.15.49:0/2785487591 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4640057a0 con 0x7fb474068aa0 2024-01-22T05:09:08.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.171+0000 7fb479400700 1 -- 172.21.15.49:0/2785487591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb474150e10 con 0x7fb474068aa0 2024-01-22T05:09:08.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.171+0000 7fb479400700 1 -- 172.21.15.49:0/2785487591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4741513d0 con 0x7fb474068aa0 2024-01-22T05:09:08.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.171+0000 7fb479400700 1 -- 172.21.15.49:0/2785487591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4740c25d0 con 0x7fb474068aa0 2024-01-22T05:09:08.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.171+0000 7fb46b400700 1 -- 172.21.15.49:0/2785487591 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb464005b90 con 0x7fb474068aa0 2024-01-22T05:09:08.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.171+0000 7fb46b400700 1 --2- 172.21.15.49:0/2785487591 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb44c05a510 0x7fb44c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:08.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.171+0000 7fb46b400700 1 -- 172.21.15.49:0/2785487591 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb464074080 con 0x7fb474068aa0 2024-01-22T05:09:08.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.175+0000 7fb473400700 1 --2- 172.21.15.49:0/2785487591 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb44c05a510 0x7fb44c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:08.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.175+0000 7fb473400700 1 --2- 172.21.15.49:0/2785487591 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb44c05a510 0x7fb44c05c9d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fb45c009630 tx=0x7fb45c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:08.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.179+0000 7fb46b400700 1 -- 172.21.15.49:0/2785487591 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb4740c25d0 con 0x7fb474068aa0 2024-01-22T05:09:08.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.355+0000 7fb479400700 1 -- 172.21.15.49:0/2785487591 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4740a8410 con 0x7fb44c05a510 2024-01-22T05:09:08.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.371+0000 7fb46b400700 1 -- 172.21.15.49:0/2785487591 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+347668 (secure 0 0 0) 0x7fb4740a8410 con 0x7fb44c05a510 2024-01-22T05:09:08.381 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.379+0000 7fb479400700 1 -- 172.21.15.49:0/2785487591 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb44c05a510 msgr2=0x7fb44c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.379+0000 7fb479400700 1 --2- 172.21.15.49:0/2785487591 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb44c05a510 0x7fb44c05c9d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fb45c009630 tx=0x7fb45c017000).stop 2024-01-22T05:09:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.379+0000 7fb479400700 1 -- 172.21.15.49:0/2785487591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb474068aa0 msgr2=0x7fb47414d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.379+0000 7fb479400700 1 --2- 172.21.15.49:0/2785487591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb474068aa0 0x7fb47414d550 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fb46400c4c0 tx=0x7fb464007ce0).stop 2024-01-22T05:09:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.379+0000 7fb479400700 1 -- 172.21.15.49:0/2785487591 shutdown_connections 2024-01-22T05:09:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.379+0000 7fb479400700 1 --2- 172.21.15.49:0/2785487591 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb44c05a510 0x7fb44c05c9d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.379+0000 7fb479400700 1 --2- 172.21.15.49:0/2785487591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4740c4c20 0x7fb4741504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.379+0000 7fb479400700 1 --2- 172.21.15.49:0/2785487591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4740a7a40 0x7fb47414ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.379+0000 7fb479400700 1 --2- 172.21.15.49:0/2785487591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb474068aa0 0x7fb47414d550 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.379+0000 7fb479400700 1 -- 172.21.15.49:0/2785487591 >> 172.21.15.49:0/2785487591 conn(0x7fb4740c86e0 msgr2=0x7fb4740c1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:08.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.379+0000 7fb479400700 1 -- 172.21.15.49:0/2785487591 shutdown_connections 2024-01-22T05:09:08.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.379+0000 7fb479400700 1 -- 172.21.15.49:0/2785487591 wait complete. 2024-01-22T05:09:08.387 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:09:08.408 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-01-22T05:09:07.324889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2469024,"kb_used_data":6240,"kb_used_omap":0,"kb_used_meta":2462720,"kb_avail":752505696,"statfs":{"total":773094113280,"available":770565832704,"internally_reserved":0,"allocated":6389760,"data_stored":3038528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2521825280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13245269,"num_objects":-2153,"num_object_clones":0,"num_object_copies":-4306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2153,"num_whiteouts":0,"num_read":-137,"num_read_kb":-7406,"num_write":-6191,"num_write_kb":-18989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-17,"num_bytes_recovered":0,"num_keys_recovered":-41,"num_objects_omap":-708,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.885978"},"pg_stats":[{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.173419+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:08:59.173419+0000","last_peered":"2024-01-22T05:08:59.173419+0000","last_clean":"2024-01-22T05:08:59.173419+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:08:59.173419+0000","last_undegraded":"2024-01-22T05:08:59.173419+0000","last_fullsized":"2024-01-22T05:08:59.173419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.174935+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:08:59.174935+0000","last_peered":"2024-01-22T05:08:59.174935+0000","last_clean":"2024-01-22T05:08:59.174935+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:08:59.174935+0000","last_undegraded":"2024-01-22T05:08:59.174935+0000","last_fullsized":"2024-01-22T05:08:59.174935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.173352+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:08:59.173352+0000","last_peered":"2024-01-22T05:08:59.173352+0000","last_clean":"2024-01-22T05:08:59.173352+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:08:59.173352+0000","last_undegraded":"2024-01-22T05:08:59.173352+0000","last_fullsized":"2024-01-22T05:08:59.173352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.174828+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:08:59.174828+0000","last_peered":"2024-01-22T05:08:59.174828+0000","last_clean":"2024-01-22T05:08:59.174828+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:08:59.174828+0000","last_undegraded":"2024-01-22T05:08:59.174828+0000","last_fullsized":"2024-01-22T05:08:59.174828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":58,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:58.357995+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:08:58.357995+0000","last_peered":"2024-01-22T05:08:58.357995+0000","last_clean":"2024-01-22T05:08:58.357995+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:08:58.357995+0000","last_undegraded":"2024-01-22T05:08:58.357995+0000","last_fullsized":"2024-01-22T05:08:58.357995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.174647+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:08:59.174647+0000","last_peered":"2024-01-22T05:08:59.174647+0000","last_clean":"2024-01-22T05:08:59.174647+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:08:59.174647+0000","last_undegraded":"2024-01-22T05:08:59.174647+0000","last_fullsized":"2024-01-22T05:08:59.174647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.173278+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:08:59.173278+0000","last_peered":"2024-01-22T05:08:59.173278+0000","last_clean":"2024-01-22T05:08:59.173278+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:08:59.173278+0000","last_undegraded":"2024-01-22T05:08:59.173278+0000","last_fullsized":"2024-01-22T05:08:59.173278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":58,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:58.358019+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:08:58.358019+0000","last_peered":"2024-01-22T05:08:58.358019+0000","last_clean":"2024-01-22T05:08:58.358019+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:08:58.358019+0000","last_undegraded":"2024-01-22T05:08:58.358019+0000","last_fullsized":"2024-01-22T05:08:58.358019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":50,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.173274+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:08:59.173274+0000","last_peered":"2024-01-22T05:08:59.173274+0000","last_clean":"2024-01-22T05:08:59.173274+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:08:59.173274+0000","last_undegraded":"2024-01-22T05:08:59.173274+0000","last_fullsized":"2024-01-22T05:08:59.173274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065772,"statfs":{"total":96636764160,"available":96323350528,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.97499999999999998,"15min":1.0369999999999999},"min":{"1min":0.755,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.0529999999999999,"15min":1.0469999999999999},"min":{"1min":0.73399999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.462,"5min":1.53,"15min":1.53},"last":0.95199999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.024,"15min":0.98299999999999998},"min":{"1min":0.69199999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.048},{"interface":"front","average":{"1min":1.119,"5min":1.137,"15min":1.169},"min":{"1min":0.746,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3700000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.2330000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1100000000000001,"15min":1.1000000000000001},"min":{"1min":0.85299999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.3919999999999999,"5min":1.659,"15min":1.659},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.147,"15min":1.165},"min":{"1min":0.88600000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.4399999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.2490000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.2230000000000001,"15min":1.2330000000000001},"min":{"1min":1.018,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5129999999999999,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.198,"15min":1.224},"min":{"1min":0.97899999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4730000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.1859999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.097,"15min":1.0600000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5589999999999999,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.163,"15min":1.159},"min":{"1min":0.90900000000000003,"5min":0.751,"15min":0.751},"max":{"1min":1.4790000000000001,"5min":1.8,"15min":1.8},"last":1.1100000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.206,"15min":1.194},"min":{"1min":0.97399999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.4710000000000001,"5min":1.736,"15min":1.736},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.2529999999999999,"15min":1.212},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.659,"5min":1.915,"15min":1.915},"last":1.292}]},{"osd":6,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2390000000000001,"15min":1.2529999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4570000000000001,"5min":1.823,"15min":1.823},"last":1.155},{"interface":"front","average":{"1min":1.403,"5min":1.353,"15min":1.327},"min":{"1min":1.056,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.605,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.3620000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061676,"statfs":{"total":96636764160,"available":96319156224,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":4.7039999999999997,"5min":1.7849999999999999,"15min":1.331},"min":{"1min":0.69099999999999995,"5min":0.372,"15min":0.372},"max":{"1min":77.745000000000005,"5min":77.745000000000005,"15min":77.745000000000005},"last":1.139},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.1559999999999999,"15min":1.0880000000000001},"min":{"1min":0.71299999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":13.555999999999999,"5min":13.555999999999999,"15min":13.555999999999999},"last":1.5189999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.728,"5min":1.1499999999999999,"15min":1.0980000000000001},"min":{"1min":0.79300000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":15.499000000000001,"5min":15.499000000000001,"15min":15.499000000000001},"last":1.202},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.2450000000000001,"15min":1.2509999999999999},"min":{"1min":0.89400000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":7.7629999999999999,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":1.2969999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1459999999999999,"15min":1.1579999999999999},"min":{"1min":0.80000000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.0960000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.125,"15min":1.117},"min":{"1min":0.89400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.9649999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.3660000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":5.9720000000000004,"5min":2.0990000000000002,"15min":1.4550000000000001},"min":{"1min":0.81399999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":102.08199999999999,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.706},{"interface":"front","average":{"1min":1.859,"5min":1.2889999999999999,"15min":1.2410000000000001},"min":{"1min":0.86499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":15.468,"5min":15.468,"15min":15.468},"last":1.335}]},{"osd":4,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1339999999999999,"15min":1.0980000000000001},"min":{"1min":0.628,"5min":0.495,"15min":0.495},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.123,"15min":1.1299999999999999},"min":{"1min":0.66600000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.526,"5min":1.649,"15min":1.649},"last":1.2190000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":2.5680000000000001,"5min":1.429,"15min":1.2709999999999999},"min":{"1min":0.92000000000000004,"5min":0.624,"15min":0.624},"max":{"1min":30.533000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":1.087},{"interface":"front","average":{"1min":1.399,"5min":1.302,"15min":1.282},"min":{"1min":1.04,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":3.875,"5min":3.875,"15min":3.875},"last":0.99299999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":2.3719999999999999,"5min":1.548,"15min":1.4419999999999999},"min":{"1min":1.008,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":23.547999999999998,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.607},{"interface":"front","average":{"1min":4.3090000000000002,"5min":1.931,"15min":1.5960000000000001},"min":{"1min":1.1060000000000001,"5min":0.495,"15min":0.495},"max":{"1min":63.737000000000002,"5min":63.737000000000002,"15min":63.737000000000002},"last":1.284}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061676,"statfs":{"total":96636764160,"available":96319156224,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95999999999999996,"15min":0.98599999999999999},"min":{"1min":0.66700000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2709999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0569999999999999,"15min":1.1120000000000001},"min":{"1min":0.72199999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.387,"5min":1.571,"15min":1.571},"last":0.97599999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.153,"15min":1.214},"min":{"1min":0.79800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3859999999999999,"5min":1.821,"15min":1.821},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.216,"15min":1.306},"min":{"1min":0.76000000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4159999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.4570000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.139,"15min":1.155},"min":{"1min":0.85799999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4670000000000001,"5min":1.629,"15min":1.629},"last":1.381},{"interface":"front","average":{"1min":1.085,"5min":1.0960000000000001,"15min":1.1419999999999999},"min":{"1min":0.80900000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.339,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.99399999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1499999999999999,"15min":1.1879999999999999},"min":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4450000000000001,"5min":1.931,"15min":1.931},"last":1.109},{"interface":"front","average":{"1min":1.218,"5min":1.23,"15min":1.306},"min":{"1min":0.97799999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4670000000000001,"5min":2.266,"15min":2.266},"last":1.5389999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1419999999999999,"15min":1.1919999999999999},"min":{"1min":0.80300000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.524,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.2450000000000001,"15min":1.3049999999999999},"min":{"1min":0.83799999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.6240000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.052}]},{"osd":6,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.282,"15min":1.349},"min":{"1min":0.755,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4410000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.29},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2649999999999999,"15min":1.3069999999999999},"min":{"1min":0.94799999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4339999999999999,"5min":1.909,"15min":1.909},"last":1.163}]},{"osd":7,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.369,"15min":1.427},"min":{"1min":1.0069999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.544,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.234},{"interface":"front","average":{"1min":1.363,"5min":1.417,"15min":1.4850000000000001},"min":{"1min":0.93999999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.5740000000000001,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.1990000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061676,"statfs":{"total":96636764160,"available":96319156224,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1000000000000001,"15min":1.1379999999999999},"min":{"1min":0.68999999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7490000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.107,"15min":1.0940000000000001},"min":{"1min":0.78900000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.6599999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.347}]},{"osd":1,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0529999999999999,"15min":1.085},"min":{"1min":0.64000000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.1160000000000001,"15min":1.198},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5009999999999999,"5min":2.194,"15min":2.194},"last":1.0680000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.097,"15min":1.091},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3620000000000001,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1950000000000001,"15min":1.278},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.5289999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.1639999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1379999999999999,"15min":1.1859999999999999},"min":{"1min":0.75900000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.462,"5min":1.589,"15min":1.589},"last":1.228},{"interface":"front","average":{"1min":1.198,"5min":1.1819999999999999,"15min":1.167},"min":{"1min":0.753,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4950000000000001,"5min":5.3029999999999999,"15min":5.3029999999999999},"last":1.3089999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.181,"15min":1.2230000000000001},"min":{"1min":0.70899999999999996,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.597,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.27},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1319999999999999,"15min":1.1619999999999999},"min":{"1min":0.73599999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.48,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.96399999999999997}]},{"osd":6,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1950000000000001,"15min":1.1910000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6080000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.367,"15min":1.427},"min":{"1min":0.79000000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6379999999999999,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":1.4770000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3260000000000001,"15min":1.367},"min":{"1min":0.874,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.5649999999999999,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.377,"15min":1.385},"min":{"1min":0.86899999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.712,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.45}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061676,"statfs":{"total":96636764160,"available":96319156224,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.94999999999999996,"15min":0.90500000000000003},"min":{"1min":0.55600000000000005,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2090000000000001,"5min":14.859,"15min":14.859},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.93000000000000005,"15min":0.88400000000000001},"min":{"1min":0.66000000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.599,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":1.1639999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.57899999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.266,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.99399999999999999,"15min":0.98399999999999999},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.278,"5min":5.7519999999999998,"15min":5.7519999999999998},"last":0.93799999999999994}]},{"osd":2,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0960000000000001,"15min":1.1619999999999999},"min":{"1min":0.65400000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.714,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.175,"15min":1.1930000000000001},"min":{"1min":0.72199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.377}]},{"osd":4,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2849999999999999,"15min":1.2949999999999999},"min":{"1min":0.91100000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5600000000000001,"5min":5.016,"15min":5.016},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.3440000000000001,"15min":1.339},"min":{"1min":0.85399999999999998,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.647,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":1.3160000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.95599999999999996,"5min":0.505,"15min":0.505},"max":{"1min":1.7509999999999999,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":2.0459999999999998,"5min":1.4730000000000001,"15min":1.3420000000000001},"min":{"1min":0.95499999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":14.523999999999999,"5min":14.523999999999999,"15min":14.523999999999999},"last":1.28}]},{"osd":6,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3839999999999999,"15min":1.4219999999999999},"min":{"1min":1,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.698,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.472,"5min":1.4370000000000001,"15min":1.423},"min":{"1min":0.89600000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.79,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":1.4890000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.401,"15min":1.401},"min":{"1min":1.022,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.8200000000000001,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.4159999999999999,"15min":1.4279999999999999},"min":{"1min":0.85399999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7490000000000001,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":1.6220000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065772,"statfs":{"total":96636764160,"available":96323350528,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.46100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.54300000000000004,"5min":0.373,"15min":0.373},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.72399999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.5,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.91100000000000003,"15min":0.93899999999999995},"min":{"1min":0.57499999999999996,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.93100000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.071,"15min":1.0569999999999999},"min":{"1min":0.83699999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.677,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.145,"15min":1.161},"min":{"1min":0.79500000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.6899999999999999,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.4350000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2470000000000001,"15min":1.304},"min":{"1min":0.85699999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6439999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.347},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.179,"15min":1.208},"min":{"1min":0.77300000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.837,"5min":1.952,"15min":1.952},"last":1.02}]},{"osd":5,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.202,"15min":1.1919999999999999},"min":{"1min":0.93700000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.0510000000000002,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.214},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.276,"15min":1.3220000000000001},"min":{"1min":1.0149999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8600000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.264}]},{"osd":6,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2210000000000001,"15min":1.254},"min":{"1min":0.83999999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5449999999999999,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.46,"5min":1.2889999999999999,"15min":1.29},"min":{"1min":1.095,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.1320000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.3009999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3140000000000001,"15min":1.355},"min":{"1min":0.92900000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.764,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.081},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.395,"15min":1.4099999999999999},"min":{"1min":1.01,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.0329999999999999,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.4770000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061676,"statfs":{"total":96636764160,"available":96319156224,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.873,"15min":0.84499999999999997},"min":{"1min":0.54800000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.248,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.98399999999999999,"15min":0.999},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.3540000000000001,"5min":2.101,"15min":2.101},"last":0.98999999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.97899999999999998,"15min":1.0009999999999999},"min":{"1min":0.63900000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.032,"15min":1.026},"min":{"1min":0.71499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.71,"5min":2.008,"15min":2.008},"last":0.745}]},{"osd":3,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0349999999999999,"15min":0.998},"min":{"1min":0.54800000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5720000000000001,"5min":4.665,"15min":4.665},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89300000000000002,"15min":0.88},"min":{"1min":0.56399999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.84899999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2050000000000001,"15min":1.2010000000000001},"min":{"1min":0.82899999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.036},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.276,"15min":1.25},"min":{"1min":0.95999999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.786,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":1.0800000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.1759999999999999,"15min":1.1850000000000001},"min":{"1min":0.78600000000000003,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.774,"5min":1.776,"15min":1.776},"last":1.288},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.266,"15min":1.2689999999999999},"min":{"1min":0.89400000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6599999999999999,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.25}]},{"osd":6,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.93999999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.712,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.145},{"interface":"front","average":{"1min":1.381,"5min":1.3280000000000001,"15min":1.335},"min":{"1min":1.0369999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.722,"5min":2.294,"15min":2.294},"last":1.391}]},{"osd":7,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.387,"15min":1.375},"min":{"1min":1.036,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8640000000000001,"5min":4.4329999999999998,"15min":4.4329999999999998},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3480000000000001,"15min":1.3600000000000001},"min":{"1min":0.85599999999999998,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.9359999999999999,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":1.421}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065772,"statfs":{"total":96636764160,"available":96323350528,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83899999999999997,"15min":0.91900000000000004},"min":{"1min":0.499,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.1659999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.91600000000000004,"15min":0.98199999999999998},"min":{"1min":0.59399999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5349999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.94699999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.01,"15min":1.0740000000000001},"min":{"1min":0.61499999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.5600000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1,"15min":1.0209999999999999},"min":{"1min":0.73399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.83899999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.95599999999999996,"15min":1.022},"min":{"1min":0.51500000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2270000000000001,"5min":1.994,"15min":1.994},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1200000000000001,"15min":1.2050000000000001},"min":{"1min":0.70199999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.569,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.0840000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.292,"15min":1.383},"min":{"1min":0.89600000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.696,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2250000000000001,"15min":1.256},"min":{"1min":1.0029999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6299999999999999,"5min":1.782,"15min":1.782},"last":1.3340000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2889999999999999,"15min":1.379},"min":{"1min":0.93300000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.698,"5min":3.548,"15min":3.548},"last":1.173},{"interface":"front","average":{"1min":1.355,"5min":1.323,"15min":1.417},"min":{"1min":0.82799999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8660000000000001,"5min":2.613,"15min":2.613},"last":1.194}]},{"osd":6,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.375,"15min":1.4419999999999999},"min":{"1min":0.92000000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9370000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.3859999999999999,"15min":1.504},"min":{"1min":0.97599999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8700000000000001,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.0489999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.482,"15min":1.639},"min":{"1min":1.111,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.925,"5min":5.29,"15min":5.29},"last":1.244},{"interface":"front","average":{"1min":1.444,"5min":1.3720000000000001,"15min":1.4390000000000001},"min":{"1min":1.0880000000000001,"5min":0.752,"15min":0.752},"max":{"1min":1.76,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.2689999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:09:08.414 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:09:08.428 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-22T05:09:08.423+0000 7f4a86c00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:09:08.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.587+0000 7f2ebc200700 1 Processor -- start 2024-01-22T05:09:08.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.591+0000 7f2ebc200700 1 -- start start 2024-01-22T05:09:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.591+0000 7f2ebc200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2eb40a8740 0x7f2eb40a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.591+0000 7f2ebc200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2eb40c1ed0 0x7f2eb40c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.591+0000 7f2ebc200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb40c1a40 con 0x7f2eb4155d20 2024-01-22T05:09:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.591+0000 7f2ebc200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb40a90b0 con 0x7f2eb40c1ed0 2024-01-22T05:09:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.591+0000 7f2ebc200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb4159310 con 0x7f2eb40a8740 2024-01-22T05:09:08.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.591+0000 7f2eba200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2eb40c1ed0 0x7f2eb40c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:08.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.591+0000 7f2eba200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2eb40c1ed0 0x7f2eb40c2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55588/0 (socket says 172.21.15.49:55588) 2024-01-22T05:09:08.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.591+0000 7f2eba200700 1 -- 172.21.15.49:0/3111175376 learned_addr learned my addr 172.21.15.49:0/3111175376 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:08.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.591+0000 7f2eb8e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2eb40a8740 0x7f2eb40a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:08.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2eba200700 1 -- 172.21.15.49:0/3111175376 >> v2:172.21.15.110:3300/0 conn(0x7f2eb40a8740 msgr2=0x7f2eb40a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:08.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2eba200700 1 --2- 172.21.15.49:0/3111175376 >> v2:172.21.15.110:3300/0 conn(0x7f2eb40a8740 0x7f2eb40a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2eba200700 1 -- 172.21.15.49:0/3111175376 >> v1:172.21.15.110:6789/0 conn(0x7f2eb4155d20 legacy=0x7f2eb4065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:08.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2eb3e00700 1 -- 172.21.15.49:0/3111175376 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19927045 0 0) 0x7f2eb40c1a40 con 0x7f2eb4155d20 2024-01-22T05:09:08.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2eba200700 1 -- 172.21.15.49:0/3111175376 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb40c13f0 con 0x7f2eb40c1ed0 2024-01-22T05:09:08.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2eba200700 1 --2- 172.21.15.49:0/3111175376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2eb40c1ed0 0x7f2eb40c2360 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f2eb40c0ad0 tx=0x7f2eac009840).ready entity=mon.0 client_cookie=22fd5b8b43153e5e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:08.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2eb3e00700 1 -- 172.21.15.49:0/3111175376 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac00e070 con 0x7f2eb40c1ed0 2024-01-22T05:09:08.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2eb3e00700 1 -- 172.21.15.49:0/3111175376 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac00ba20 con 0x7f2eb40c1ed0 2024-01-22T05:09:08.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2eb3e00700 1 -- 172.21.15.49:0/3111175376 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac00bda0 con 0x7f2eb40c1ed0 2024-01-22T05:09:08.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2ebc200700 1 -- 172.21.15.49:0/3111175376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2eb40c1ed0 msgr2=0x7f2eb40c2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:08.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2ebc200700 1 --2- 172.21.15.49:0/3111175376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2eb40c1ed0 0x7f2eb40c2360 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f2eb40c0ad0 tx=0x7f2eac009840).stop 2024-01-22T05:09:08.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2ebc200700 1 -- 172.21.15.49:0/3111175376 shutdown_connections 2024-01-22T05:09:08.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2ebc200700 1 --2- 172.21.15.49:0/3111175376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2eb40c1ed0 0x7f2eb40c2360 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2ebc200700 1 --2- 172.21.15.49:0/3111175376 >> v2:172.21.15.110:3300/0 conn(0x7f2eb40a8740 0x7f2eb40a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2ebc200700 1 -- 172.21.15.49:0/3111175376 >> 172.21.15.49:0/3111175376 conn(0x7f2eb40c6540 msgr2=0x7f2eb40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:08.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2ebc200700 1 -- 172.21.15.49:0/3111175376 shutdown_connections 2024-01-22T05:09:08.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.595+0000 7f2ebc200700 1 -- 172.21.15.49:0/3111175376 wait complete. 2024-01-22T05:09:08.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.599+0000 7f2ebc200700 1 Processor -- start 2024-01-22T05:09:08.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.599+0000 7f2ebc200700 1 -- start start 2024-01-22T05:09:08.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2ebc200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2eb40a8740 0x7f2eb41527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:08.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2ebc200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb40c1ed0 0x7f2eb4152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:08.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2ebc200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2eb4155d20 0x7f2eb40a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:08.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2ebc200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb4152070 con 0x7f2eb4155d20 2024-01-22T05:09:08.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2ebc200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb4152350 con 0x7f2eb40c1ed0 2024-01-22T05:09:08.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2ebc200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb41692f0 con 0x7f2eb40a8740 2024-01-22T05:09:08.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2eba200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2eb4155d20 0x7f2eb40a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:08.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2eba200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2eb4155d20 0x7f2eb40a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55596/0 (socket says 172.21.15.49:55596) 2024-01-22T05:09:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2eba200700 1 -- 172.21.15.49:0/115220688 learned_addr learned my addr 172.21.15.49:0/115220688 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2eb8e00700 1 --2- 172.21.15.49:0/115220688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb40c1ed0 0x7f2eb4152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2eb9800700 1 --2- 172.21.15.49:0/115220688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2eb40a8740 0x7f2eb41527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2eba200700 1 -- 172.21.15.49:0/115220688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2eb40a8740 msgr2=0x7f2eb41527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2eba200700 1 --2- 172.21.15.49:0/115220688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2eb40a8740 0x7f2eb41527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2eba200700 1 -- 172.21.15.49:0/115220688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb40c1ed0 msgr2=0x7f2eb4152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2eba200700 1 --2- 172.21.15.49:0/115220688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb40c1ed0 0x7f2eb4152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2eba200700 1 -- 172.21.15.49:0/115220688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac009ae0 con 0x7f2eb4155d20 2024-01-22T05:09:08.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2eba200700 1 --2- 172.21.15.49:0/115220688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2eb4155d20 0x7f2eb40a95b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f2eac00bec0 tx=0x7f2eac009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:08.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2eb0c00700 1 -- 172.21.15.49:0/115220688 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac009500 con 0x7f2eb4155d20 2024-01-22T05:09:08.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2eb0c00700 1 -- 172.21.15.49:0/115220688 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac0092e0 con 0x7f2eb4155d20 2024-01-22T05:09:08.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2eb0c00700 1 -- 172.21.15.49:0/115220688 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac01d660 con 0x7f2eb4155d20 2024-01-22T05:09:08.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2ebc200700 1 -- 172.21.15.49:0/115220688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb41695d0 con 0x7f2eb4155d20 2024-01-22T05:09:08.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.603+0000 7f2ebc200700 1 -- 172.21.15.49:0/115220688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb40ab1e0 con 0x7f2eb4155d20 2024-01-22T05:09:08.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.607+0000 7f2ebc200700 1 -- 172.21.15.49:0/115220688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb4047060 con 0x7f2eb4155d20 2024-01-22T05:09:08.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.607+0000 7f2eb0c00700 1 -- 172.21.15.49:0/115220688 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2eac01da90 con 0x7f2eb4155d20 2024-01-22T05:09:08.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.607+0000 7f2eb0c00700 1 --2- 172.21.15.49:0/115220688 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2e8c05a510 0x7f2e8c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:08.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.607+0000 7f2eb0c00700 1 -- 172.21.15.49:0/115220688 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2eac0763a0 con 0x7f2eb4155d20 2024-01-22T05:09:08.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.611+0000 7f2eb9800700 1 --2- 172.21.15.49:0/115220688 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2e8c05a510 0x7f2e8c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:08.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.611+0000 7f2eb9800700 1 --2- 172.21.15.49:0/115220688 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2e8c05a510 0x7f2e8c05c9d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f2ea40038c0 tx=0x7f2ea4007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:08.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.615+0000 7f2eb0c00700 1 -- 172.21.15.49:0/115220688 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2eac049ac0 con 0x7f2eb4155d20 2024-01-22T05:09:08.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.783+0000 7f2ebc200700 1 -- 172.21.15.49:0/115220688 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2eb4152490 con 0x7f2e8c05a510 2024-01-22T05:09:08.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.799+0000 7f2eb0c00700 1 -- 172.21.15.49:0/115220688 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+347668 (secure 0 0 0) 0x7f2eb4152490 con 0x7f2e8c05a510 2024-01-22T05:09:08.808 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.807+0000 7f2ebc200700 1 -- 172.21.15.49:0/115220688 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2e8c05a510 msgr2=0x7f2e8c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.807+0000 7f2ebc200700 1 --2- 172.21.15.49:0/115220688 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2e8c05a510 0x7f2e8c05c9d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f2ea40038c0 tx=0x7f2ea4007d40).stop 2024-01-22T05:09:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.807+0000 7f2ebc200700 1 -- 172.21.15.49:0/115220688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2eb4155d20 msgr2=0x7f2eb40a95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.807+0000 7f2ebc200700 1 --2- 172.21.15.49:0/115220688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2eb4155d20 0x7f2eb40a95b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f2eac00bec0 tx=0x7f2eac009840).stop 2024-01-22T05:09:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.807+0000 7f2ebc200700 1 -- 172.21.15.49:0/115220688 shutdown_connections 2024-01-22T05:09:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.807+0000 7f2ebc200700 1 --2- 172.21.15.49:0/115220688 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2e8c05a510 0x7f2e8c05c9d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.807+0000 7f2ebc200700 1 --2- 172.21.15.49:0/115220688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2eb4155d20 0x7f2eb40a95b0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.807+0000 7f2ebc200700 1 --2- 172.21.15.49:0/115220688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb40c1ed0 0x7f2eb4152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.807+0000 7f2ebc200700 1 --2- 172.21.15.49:0/115220688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2eb40a8740 0x7f2eb41527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:08.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.807+0000 7f2ebc200700 1 -- 172.21.15.49:0/115220688 >> 172.21.15.49:0/115220688 conn(0x7f2eb40c6540 msgr2=0x7f2eb40c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:08.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.811+0000 7f2ebc200700 1 -- 172.21.15.49:0/115220688 shutdown_connections 2024-01-22T05:09:08.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:08.811+0000 7f2ebc200700 1 -- 172.21.15.49:0/115220688 wait complete. 2024-01-22T05:09:08.815 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:09:08.835 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-01-22T05:09:07.324889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2469024,"kb_used_data":6240,"kb_used_omap":0,"kb_used_meta":2462720,"kb_avail":752505696,"statfs":{"total":773094113280,"available":770565832704,"internally_reserved":0,"allocated":6389760,"data_stored":3038528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2521825280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13245269,"num_objects":-2153,"num_object_clones":0,"num_object_copies":-4306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2153,"num_whiteouts":0,"num_read":-137,"num_read_kb":-7406,"num_write":-6191,"num_write_kb":-18989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-17,"num_bytes_recovered":0,"num_keys_recovered":-41,"num_objects_omap":-708,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.885978"},"pg_stats":[{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.173419+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:08:59.173419+0000","last_peered":"2024-01-22T05:08:59.173419+0000","last_clean":"2024-01-22T05:08:59.173419+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:08:59.173419+0000","last_undegraded":"2024-01-22T05:08:59.173419+0000","last_fullsized":"2024-01-22T05:08:59.173419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.174935+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:08:59.174935+0000","last_peered":"2024-01-22T05:08:59.174935+0000","last_clean":"2024-01-22T05:08:59.174935+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:08:59.174935+0000","last_undegraded":"2024-01-22T05:08:59.174935+0000","last_fullsized":"2024-01-22T05:08:59.174935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.173352+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:08:59.173352+0000","last_peered":"2024-01-22T05:08:59.173352+0000","last_clean":"2024-01-22T05:08:59.173352+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:08:59.173352+0000","last_undegraded":"2024-01-22T05:08:59.173352+0000","last_fullsized":"2024-01-22T05:08:59.173352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.174828+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:08:59.174828+0000","last_peered":"2024-01-22T05:08:59.174828+0000","last_clean":"2024-01-22T05:08:59.174828+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:08:59.174828+0000","last_undegraded":"2024-01-22T05:08:59.174828+0000","last_fullsized":"2024-01-22T05:08:59.174828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":58,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:58.357995+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:08:58.357995+0000","last_peered":"2024-01-22T05:08:58.357995+0000","last_clean":"2024-01-22T05:08:58.357995+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:08:58.357995+0000","last_undegraded":"2024-01-22T05:08:58.357995+0000","last_fullsized":"2024-01-22T05:08:58.357995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.174647+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:08:59.174647+0000","last_peered":"2024-01-22T05:08:59.174647+0000","last_clean":"2024-01-22T05:08:59.174647+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:08:59.174647+0000","last_undegraded":"2024-01-22T05:08:59.174647+0000","last_fullsized":"2024-01-22T05:08:59.174647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.173278+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:08:59.173278+0000","last_peered":"2024-01-22T05:08:59.173278+0000","last_clean":"2024-01-22T05:08:59.173278+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:08:59.173278+0000","last_undegraded":"2024-01-22T05:08:59.173278+0000","last_fullsized":"2024-01-22T05:08:59.173278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":58,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:58.358019+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:08:58.358019+0000","last_peered":"2024-01-22T05:08:58.358019+0000","last_clean":"2024-01-22T05:08:58.358019+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:08:58.358019+0000","last_undegraded":"2024-01-22T05:08:58.358019+0000","last_fullsized":"2024-01-22T05:08:58.358019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":50,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.173274+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:08:59.173274+0000","last_peered":"2024-01-22T05:08:59.173274+0000","last_clean":"2024-01-22T05:08:59.173274+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:08:59.173274+0000","last_undegraded":"2024-01-22T05:08:59.173274+0000","last_fullsized":"2024-01-22T05:08:59.173274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065772,"statfs":{"total":96636764160,"available":96323350528,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.97499999999999998,"15min":1.0369999999999999},"min":{"1min":0.755,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.0529999999999999,"15min":1.0469999999999999},"min":{"1min":0.73399999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.462,"5min":1.53,"15min":1.53},"last":0.95199999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.024,"15min":0.98299999999999998},"min":{"1min":0.69199999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.048},{"interface":"front","average":{"1min":1.119,"5min":1.137,"15min":1.169},"min":{"1min":0.746,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3700000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.2330000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1100000000000001,"15min":1.1000000000000001},"min":{"1min":0.85299999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.3919999999999999,"5min":1.659,"15min":1.659},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.147,"15min":1.165},"min":{"1min":0.88600000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.4399999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.2490000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.2230000000000001,"15min":1.2330000000000001},"min":{"1min":1.018,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5129999999999999,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.198,"15min":1.224},"min":{"1min":0.97899999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4730000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.1859999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.097,"15min":1.0600000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5589999999999999,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.163,"15min":1.159},"min":{"1min":0.90900000000000003,"5min":0.751,"15min":0.751},"max":{"1min":1.4790000000000001,"5min":1.8,"15min":1.8},"last":1.1100000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.206,"15min":1.194},"min":{"1min":0.97399999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.4710000000000001,"5min":1.736,"15min":1.736},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.2529999999999999,"15min":1.212},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.659,"5min":1.915,"15min":1.915},"last":1.292}]},{"osd":6,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2390000000000001,"15min":1.2529999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4570000000000001,"5min":1.823,"15min":1.823},"last":1.155},{"interface":"front","average":{"1min":1.403,"5min":1.353,"15min":1.327},"min":{"1min":1.056,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.605,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.3620000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061676,"statfs":{"total":96636764160,"available":96319156224,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":4.7039999999999997,"5min":1.7849999999999999,"15min":1.331},"min":{"1min":0.69099999999999995,"5min":0.372,"15min":0.372},"max":{"1min":77.745000000000005,"5min":77.745000000000005,"15min":77.745000000000005},"last":1.139},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.1559999999999999,"15min":1.0880000000000001},"min":{"1min":0.71299999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":13.555999999999999,"5min":13.555999999999999,"15min":13.555999999999999},"last":1.5189999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.728,"5min":1.1499999999999999,"15min":1.0980000000000001},"min":{"1min":0.79300000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":15.499000000000001,"5min":15.499000000000001,"15min":15.499000000000001},"last":1.202},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.2450000000000001,"15min":1.2509999999999999},"min":{"1min":0.89400000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":7.7629999999999999,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":1.2969999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1459999999999999,"15min":1.1579999999999999},"min":{"1min":0.80000000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.0960000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.125,"15min":1.117},"min":{"1min":0.89400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.9649999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.3660000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":5.9720000000000004,"5min":2.0990000000000002,"15min":1.4550000000000001},"min":{"1min":0.81399999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":102.08199999999999,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.706},{"interface":"front","average":{"1min":1.859,"5min":1.2889999999999999,"15min":1.2410000000000001},"min":{"1min":0.86499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":15.468,"5min":15.468,"15min":15.468},"last":1.335}]},{"osd":4,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1339999999999999,"15min":1.0980000000000001},"min":{"1min":0.628,"5min":0.495,"15min":0.495},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.123,"15min":1.1299999999999999},"min":{"1min":0.66600000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.526,"5min":1.649,"15min":1.649},"last":1.2190000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":2.5680000000000001,"5min":1.429,"15min":1.2709999999999999},"min":{"1min":0.92000000000000004,"5min":0.624,"15min":0.624},"max":{"1min":30.533000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":1.087},{"interface":"front","average":{"1min":1.399,"5min":1.302,"15min":1.282},"min":{"1min":1.04,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":3.875,"5min":3.875,"15min":3.875},"last":0.99299999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":2.3719999999999999,"5min":1.548,"15min":1.4419999999999999},"min":{"1min":1.008,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":23.547999999999998,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.607},{"interface":"front","average":{"1min":4.3090000000000002,"5min":1.931,"15min":1.5960000000000001},"min":{"1min":1.1060000000000001,"5min":0.495,"15min":0.495},"max":{"1min":63.737000000000002,"5min":63.737000000000002,"15min":63.737000000000002},"last":1.284}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061676,"statfs":{"total":96636764160,"available":96319156224,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95999999999999996,"15min":0.98599999999999999},"min":{"1min":0.66700000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2709999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0569999999999999,"15min":1.1120000000000001},"min":{"1min":0.72199999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.387,"5min":1.571,"15min":1.571},"last":0.97599999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.153,"15min":1.214},"min":{"1min":0.79800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3859999999999999,"5min":1.821,"15min":1.821},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.216,"15min":1.306},"min":{"1min":0.76000000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4159999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.4570000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.139,"15min":1.155},"min":{"1min":0.85799999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4670000000000001,"5min":1.629,"15min":1.629},"last":1.381},{"interface":"front","average":{"1min":1.085,"5min":1.0960000000000001,"15min":1.1419999999999999},"min":{"1min":0.80900000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.339,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.99399999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1499999999999999,"15min":1.1879999999999999},"min":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4450000000000001,"5min":1.931,"15min":1.931},"last":1.109},{"interface":"front","average":{"1min":1.218,"5min":1.23,"15min":1.306},"min":{"1min":0.97799999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4670000000000001,"5min":2.266,"15min":2.266},"last":1.5389999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1419999999999999,"15min":1.1919999999999999},"min":{"1min":0.80300000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.524,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.2450000000000001,"15min":1.3049999999999999},"min":{"1min":0.83799999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.6240000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.052}]},{"osd":6,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.282,"15min":1.349},"min":{"1min":0.755,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4410000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.29},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2649999999999999,"15min":1.3069999999999999},"min":{"1min":0.94799999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4339999999999999,"5min":1.909,"15min":1.909},"last":1.163}]},{"osd":7,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.369,"15min":1.427},"min":{"1min":1.0069999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.544,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.234},{"interface":"front","average":{"1min":1.363,"5min":1.417,"15min":1.4850000000000001},"min":{"1min":0.93999999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.5740000000000001,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.1990000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061676,"statfs":{"total":96636764160,"available":96319156224,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1000000000000001,"15min":1.1379999999999999},"min":{"1min":0.68999999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7490000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.107,"15min":1.0940000000000001},"min":{"1min":0.78900000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.6599999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.347}]},{"osd":1,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0529999999999999,"15min":1.085},"min":{"1min":0.64000000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.1160000000000001,"15min":1.198},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5009999999999999,"5min":2.194,"15min":2.194},"last":1.0680000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.097,"15min":1.091},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3620000000000001,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1950000000000001,"15min":1.278},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.5289999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.1639999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1379999999999999,"15min":1.1859999999999999},"min":{"1min":0.75900000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.462,"5min":1.589,"15min":1.589},"last":1.228},{"interface":"front","average":{"1min":1.198,"5min":1.1819999999999999,"15min":1.167},"min":{"1min":0.753,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4950000000000001,"5min":5.3029999999999999,"15min":5.3029999999999999},"last":1.3089999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.181,"15min":1.2230000000000001},"min":{"1min":0.70899999999999996,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.597,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.27},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1319999999999999,"15min":1.1619999999999999},"min":{"1min":0.73599999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.48,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.96399999999999997}]},{"osd":6,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1950000000000001,"15min":1.1910000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6080000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.367,"15min":1.427},"min":{"1min":0.79000000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6379999999999999,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":1.4770000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3260000000000001,"15min":1.367},"min":{"1min":0.874,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.5649999999999999,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.377,"15min":1.385},"min":{"1min":0.86899999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.712,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.45}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061676,"statfs":{"total":96636764160,"available":96319156224,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.94999999999999996,"15min":0.90500000000000003},"min":{"1min":0.55600000000000005,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2090000000000001,"5min":14.859,"15min":14.859},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.93000000000000005,"15min":0.88400000000000001},"min":{"1min":0.66000000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.599,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":1.1639999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.57899999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.266,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.99399999999999999,"15min":0.98399999999999999},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.278,"5min":5.7519999999999998,"15min":5.7519999999999998},"last":0.93799999999999994}]},{"osd":2,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0960000000000001,"15min":1.1619999999999999},"min":{"1min":0.65400000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.714,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.175,"15min":1.1930000000000001},"min":{"1min":0.72199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.377}]},{"osd":4,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2849999999999999,"15min":1.2949999999999999},"min":{"1min":0.91100000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5600000000000001,"5min":5.016,"15min":5.016},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.3440000000000001,"15min":1.339},"min":{"1min":0.85399999999999998,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.647,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":1.3160000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.95599999999999996,"5min":0.505,"15min":0.505},"max":{"1min":1.7509999999999999,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":2.0459999999999998,"5min":1.4730000000000001,"15min":1.3420000000000001},"min":{"1min":0.95499999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":14.523999999999999,"5min":14.523999999999999,"15min":14.523999999999999},"last":1.28}]},{"osd":6,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3839999999999999,"15min":1.4219999999999999},"min":{"1min":1,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.698,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.472,"5min":1.4370000000000001,"15min":1.423},"min":{"1min":0.89600000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.79,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":1.4890000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.401,"15min":1.401},"min":{"1min":1.022,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.8200000000000001,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.4159999999999999,"15min":1.4279999999999999},"min":{"1min":0.85399999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7490000000000001,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":1.6220000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065772,"statfs":{"total":96636764160,"available":96323350528,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.46100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.54300000000000004,"5min":0.373,"15min":0.373},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.72399999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.5,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.91100000000000003,"15min":0.93899999999999995},"min":{"1min":0.57499999999999996,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.93100000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.071,"15min":1.0569999999999999},"min":{"1min":0.83699999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.677,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.145,"15min":1.161},"min":{"1min":0.79500000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.6899999999999999,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.4350000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2470000000000001,"15min":1.304},"min":{"1min":0.85699999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6439999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.347},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.179,"15min":1.208},"min":{"1min":0.77300000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.837,"5min":1.952,"15min":1.952},"last":1.02}]},{"osd":5,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.202,"15min":1.1919999999999999},"min":{"1min":0.93700000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.0510000000000002,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.214},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.276,"15min":1.3220000000000001},"min":{"1min":1.0149999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8600000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.264}]},{"osd":6,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2210000000000001,"15min":1.254},"min":{"1min":0.83999999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5449999999999999,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.46,"5min":1.2889999999999999,"15min":1.29},"min":{"1min":1.095,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.1320000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.3009999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3140000000000001,"15min":1.355},"min":{"1min":0.92900000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.764,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.081},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.395,"15min":1.4099999999999999},"min":{"1min":1.01,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.0329999999999999,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.4770000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061676,"statfs":{"total":96636764160,"available":96319156224,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.873,"15min":0.84499999999999997},"min":{"1min":0.54800000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.248,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.98399999999999999,"15min":0.999},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.3540000000000001,"5min":2.101,"15min":2.101},"last":0.98999999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.97899999999999998,"15min":1.0009999999999999},"min":{"1min":0.63900000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.032,"15min":1.026},"min":{"1min":0.71499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.71,"5min":2.008,"15min":2.008},"last":0.745}]},{"osd":3,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0349999999999999,"15min":0.998},"min":{"1min":0.54800000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5720000000000001,"5min":4.665,"15min":4.665},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89300000000000002,"15min":0.88},"min":{"1min":0.56399999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.84899999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2050000000000001,"15min":1.2010000000000001},"min":{"1min":0.82899999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.036},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.276,"15min":1.25},"min":{"1min":0.95999999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.786,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":1.0800000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.1759999999999999,"15min":1.1850000000000001},"min":{"1min":0.78600000000000003,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.774,"5min":1.776,"15min":1.776},"last":1.288},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.266,"15min":1.2689999999999999},"min":{"1min":0.89400000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6599999999999999,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.25}]},{"osd":6,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.93999999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.712,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.145},{"interface":"front","average":{"1min":1.381,"5min":1.3280000000000001,"15min":1.335},"min":{"1min":1.0369999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.722,"5min":2.294,"15min":2.294},"last":1.391}]},{"osd":7,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.387,"15min":1.375},"min":{"1min":1.036,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8640000000000001,"5min":4.4329999999999998,"15min":4.4329999999999998},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3480000000000001,"15min":1.3600000000000001},"min":{"1min":0.85599999999999998,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.9359999999999999,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":1.421}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065772,"statfs":{"total":96636764160,"available":96323350528,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83899999999999997,"15min":0.91900000000000004},"min":{"1min":0.499,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.1659999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.91600000000000004,"15min":0.98199999999999998},"min":{"1min":0.59399999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5349999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.94699999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.01,"15min":1.0740000000000001},"min":{"1min":0.61499999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.5600000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1,"15min":1.0209999999999999},"min":{"1min":0.73399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.83899999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.95599999999999996,"15min":1.022},"min":{"1min":0.51500000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2270000000000001,"5min":1.994,"15min":1.994},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1200000000000001,"15min":1.2050000000000001},"min":{"1min":0.70199999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.569,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.0840000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.292,"15min":1.383},"min":{"1min":0.89600000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.696,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2250000000000001,"15min":1.256},"min":{"1min":1.0029999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6299999999999999,"5min":1.782,"15min":1.782},"last":1.3340000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2889999999999999,"15min":1.379},"min":{"1min":0.93300000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.698,"5min":3.548,"15min":3.548},"last":1.173},{"interface":"front","average":{"1min":1.355,"5min":1.323,"15min":1.417},"min":{"1min":0.82799999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8660000000000001,"5min":2.613,"15min":2.613},"last":1.194}]},{"osd":6,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.375,"15min":1.4419999999999999},"min":{"1min":0.92000000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9370000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.3859999999999999,"15min":1.504},"min":{"1min":0.97599999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8700000000000001,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.0489999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.482,"15min":1.639},"min":{"1min":1.111,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.925,"5min":5.29,"15min":5.29},"last":1.244},{"interface":"front","average":{"1min":1.444,"5min":1.3720000000000001,"15min":1.4390000000000001},"min":{"1min":1.0880000000000001,"5min":0.752,"15min":0.752},"max":{"1min":1.76,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.2689999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:09:08.841 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:09:09.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.043+0000 7ff98de00700 1 Processor -- start 2024-01-22T05:09:09.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.047+0000 7ff98de00700 1 -- start start 2024-01-22T05:09:09.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.047+0000 7ff98de00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff988155d20 0x7ff988065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.047+0000 7ff98de00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff9880a8e50 0x7ff9880c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.047+0000 7ff98de00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9880c1a40 con 0x7ff988066070 2024-01-22T05:09:09.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.047+0000 7ff98de00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff988159310 con 0x7ff9880a8e50 2024-01-22T05:09:09.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.047+0000 7ff98de00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9880c13f0 con 0x7ff988155d20 2024-01-22T05:09:09.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.047+0000 7ff986000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff988066070 0x7ff9880a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40274/0 (socket says 172.21.15.49:40274) 2024-01-22T05:09:09.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.047+0000 7ff986000700 1 -- 172.21.15.49:0/2771637704 learned_addr learned my addr 172.21.15.49:0/2771637704 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:09.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.047+0000 7ff987400700 1 --2- 172.21.15.49:0/2771637704 >> v2:172.21.15.49:3300/0 conn(0x7ff9880a8e50 0x7ff9880c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.047+0000 7ff986a00700 1 --2- 172.21.15.49:0/2771637704 >> v2:172.21.15.110:3300/0 conn(0x7ff988155d20 0x7ff988065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.047+0000 7ff985600700 1 -- 172.21.15.49:0/2771637704 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294375416 0 0) 0x7ff9880c1a40 con 0x7ff988066070 2024-01-22T05:09:09.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.047+0000 7ff985600700 1 -- 172.21.15.49:0/2771637704 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9680033f0 con 0x7ff988066070 2024-01-22T05:09:09.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.047+0000 7ff987400700 1 -- 172.21.15.49:0/2771637704 >> v2:172.21.15.110:3300/0 conn(0x7ff988155d20 msgr2=0x7ff988065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:09.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.047+0000 7ff987400700 1 --2- 172.21.15.49:0/2771637704 >> v2:172.21.15.110:3300/0 conn(0x7ff988155d20 0x7ff988065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.051+0000 7ff987400700 1 -- 172.21.15.49:0/2771637704 >> v1:172.21.15.49:6789/0 conn(0x7ff988066070 legacy=0x7ff9880a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.051+0000 7ff987400700 1 -- 172.21.15.49:0/2771637704 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9880c16d0 con 0x7ff9880a8e50 2024-01-22T05:09:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.051+0000 7ff987400700 1 --2- 172.21.15.49:0/2771637704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9880a8e50 0x7ff9880c1ed0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7ff98805ff40 tx=0x7ff980009780).ready entity=mon.0 client_cookie=4b8e71bf3b62f24f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.051+0000 7ff985600700 1 -- 172.21.15.49:0/2771637704 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000e070 con 0x7ff9880a8e50 2024-01-22T05:09:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.051+0000 7ff985600700 1 -- 172.21.15.49:0/2771637704 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98000bab0 con 0x7ff9880a8e50 2024-01-22T05:09:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.051+0000 7ff985600700 1 -- 172.21.15.49:0/2771637704 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000be30 con 0x7ff9880a8e50 2024-01-22T05:09:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.051+0000 7ff98de00700 1 -- 172.21.15.49:0/2771637704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9880a8e50 msgr2=0x7ff9880c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.051+0000 7ff98de00700 1 --2- 172.21.15.49:0/2771637704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9880a8e50 0x7ff9880c1ed0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7ff98805ff40 tx=0x7ff980009780).stop 2024-01-22T05:09:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.051+0000 7ff98de00700 1 -- 172.21.15.49:0/2771637704 shutdown_connections 2024-01-22T05:09:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.051+0000 7ff98de00700 1 --2- 172.21.15.49:0/2771637704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9880a8e50 0x7ff9880c1ed0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.051+0000 7ff98de00700 1 --2- 172.21.15.49:0/2771637704 >> v2:172.21.15.110:3300/0 conn(0x7ff988155d20 0x7ff988065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.051+0000 7ff98de00700 1 -- 172.21.15.49:0/2771637704 >> 172.21.15.49:0/2771637704 conn(0x7ff9880c6540 msgr2=0x7ff9880c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.051+0000 7ff98de00700 1 -- 172.21.15.49:0/2771637704 shutdown_connections 2024-01-22T05:09:09.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.051+0000 7ff98de00700 1 -- 172.21.15.49:0/2771637704 wait complete. 2024-01-22T05:09:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.055+0000 7ff98de00700 1 Processor -- start 2024-01-22T05:09:09.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.055+0000 7ff98de00700 1 -- start start 2024-01-22T05:09:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff98de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff988066070 0x7ff9881497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff98de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9880a8e50 0x7ff988067a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff98de00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff988155d20 0x7ff988067f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff98de00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff988068470 con 0x7ff988066070 2024-01-22T05:09:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff98de00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880bf280 con 0x7ff9880a8e50 2024-01-22T05:09:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff98de00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880bf560 con 0x7ff988155d20 2024-01-22T05:09:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff986a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff988066070 0x7ff9881497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff986a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff988066070 0x7ff9881497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55612/0 (socket says 172.21.15.49:55612) 2024-01-22T05:09:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff986a00700 1 -- 172.21.15.49:0/3828467100 learned_addr learned my addr 172.21.15.49:0/3828467100 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff986000700 1 --2- 172.21.15.49:0/3828467100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9880a8e50 0x7ff988067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff987400700 1 --2- 172.21.15.49:0/3828467100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff988155d20 0x7ff988067f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff986a00700 1 -- 172.21.15.49:0/3828467100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff988155d20 msgr2=0x7ff988067f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff986a00700 1 --2- 172.21.15.49:0/3828467100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff988155d20 0x7ff988067f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff986a00700 1 -- 172.21.15.49:0/3828467100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9880a8e50 msgr2=0x7ff988067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff986a00700 1 --2- 172.21.15.49:0/3828467100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9880a8e50 0x7ff988067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff986a00700 1 -- 172.21.15.49:0/3828467100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff980009a20 con 0x7ff988066070 2024-01-22T05:09:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff986a00700 1 --2- 172.21.15.49:0/3828467100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff988066070 0x7ff9881497d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7ff97800e900 tx=0x7ff978009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff97e000700 1 -- 172.21.15.49:0/3828467100 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97800c640 con 0x7ff988066070 2024-01-22T05:09:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff97e000700 1 -- 172.21.15.49:0/3828467100 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97800c7a0 con 0x7ff988066070 2024-01-22T05:09:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff97e000700 1 -- 172.21.15.49:0/3828467100 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97800cb20 con 0x7ff988066070 2024-01-22T05:09:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff98de00700 1 -- 172.21.15.49:0/3828467100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9880bf840 con 0x7ff988066070 2024-01-22T05:09:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.059+0000 7ff98de00700 1 -- 172.21.15.49:0/3828467100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9880bfe00 con 0x7ff988066070 2024-01-22T05:09:09.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.063+0000 7ff98de00700 1 -- 172.21.15.49:0/3828467100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff988047060 con 0x7ff988066070 2024-01-22T05:09:09.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.063+0000 7ff97e000700 1 -- 172.21.15.49:0/3828467100 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff97801b400 con 0x7ff988066070 2024-01-22T05:09:09.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.063+0000 7ff97e000700 1 --2- 172.21.15.49:0/3828467100 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff96005a510 0x7ff96005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.063+0000 7ff97e000700 1 -- 172.21.15.49:0/3828467100 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff978074dc0 con 0x7ff988066070 2024-01-22T05:09:09.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.063+0000 7ff986000700 1 --2- 172.21.15.49:0/3828467100 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff96005a510 0x7ff96005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.063+0000 7ff986000700 1 --2- 172.21.15.49:0/3828467100 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff96005a510 0x7ff96005c9d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7ff988154980 tx=0x7ff970009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:09.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.071+0000 7ff97e000700 1 -- 172.21.15.49:0/3828467100 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff978048320 con 0x7ff988066070 2024-01-22T05:09:09.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.239+0000 7ff98de00700 1 -- 172.21.15.49:0/3828467100 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff988046800 con 0x7ff96005a510 2024-01-22T05:09:09.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.255+0000 7ff97e000700 1 -- 172.21.15.49:0/3828467100 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+347668 (secure 0 0 0) 0x7ff988046800 con 0x7ff96005a510 2024-01-22T05:09:09.264 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:09.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.263+0000 7ff98de00700 1 -- 172.21.15.49:0/3828467100 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff96005a510 msgr2=0x7ff96005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.263+0000 7ff98de00700 1 --2- 172.21.15.49:0/3828467100 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff96005a510 0x7ff96005c9d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7ff988154980 tx=0x7ff970009040).stop 2024-01-22T05:09:09.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.263+0000 7ff98de00700 1 -- 172.21.15.49:0/3828467100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff988066070 msgr2=0x7ff9881497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.263+0000 7ff98de00700 1 --2- 172.21.15.49:0/3828467100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff988066070 0x7ff9881497d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7ff97800e900 tx=0x7ff978009060).stop 2024-01-22T05:09:09.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.263+0000 7ff98de00700 1 -- 172.21.15.49:0/3828467100 shutdown_connections 2024-01-22T05:09:09.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.263+0000 7ff98de00700 1 --2- 172.21.15.49:0/3828467100 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff96005a510 0x7ff96005c9d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.263+0000 7ff98de00700 1 --2- 172.21.15.49:0/3828467100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff988155d20 0x7ff988067f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.263+0000 7ff98de00700 1 --2- 172.21.15.49:0/3828467100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9880a8e50 0x7ff988067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.263+0000 7ff98de00700 1 --2- 172.21.15.49:0/3828467100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff988066070 0x7ff9881497d0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.263+0000 7ff98de00700 1 -- 172.21.15.49:0/3828467100 >> 172.21.15.49:0/3828467100 conn(0x7ff9880c6540 msgr2=0x7ff9880c5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:09.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.263+0000 7ff98de00700 1 -- 172.21.15.49:0/3828467100 shutdown_connections 2024-01-22T05:09:09.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.263+0000 7ff98de00700 1 -- 172.21.15.49:0/3828467100 wait complete. 2024-01-22T05:09:09.270 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:09:09.289 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-01-22T05:09:07.324889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2469024,"kb_used_data":6240,"kb_used_omap":0,"kb_used_meta":2462720,"kb_avail":752505696,"statfs":{"total":773094113280,"available":770565832704,"internally_reserved":0,"allocated":6389760,"data_stored":3038528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2521825280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13245269,"num_objects":-2153,"num_object_clones":0,"num_object_copies":-4306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2153,"num_whiteouts":0,"num_read":-137,"num_read_kb":-7406,"num_write":-6191,"num_write_kb":-18989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-17,"num_bytes_recovered":0,"num_keys_recovered":-41,"num_objects_omap":-708,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.885978"},"pg_stats":[{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.173419+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:08:59.173419+0000","last_peered":"2024-01-22T05:08:59.173419+0000","last_clean":"2024-01-22T05:08:59.173419+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:08:59.173419+0000","last_undegraded":"2024-01-22T05:08:59.173419+0000","last_fullsized":"2024-01-22T05:08:59.173419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.174935+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:08:59.174935+0000","last_peered":"2024-01-22T05:08:59.174935+0000","last_clean":"2024-01-22T05:08:59.174935+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:08:59.174935+0000","last_undegraded":"2024-01-22T05:08:59.174935+0000","last_fullsized":"2024-01-22T05:08:59.174935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.173352+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:08:59.173352+0000","last_peered":"2024-01-22T05:08:59.173352+0000","last_clean":"2024-01-22T05:08:59.173352+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:08:59.173352+0000","last_undegraded":"2024-01-22T05:08:59.173352+0000","last_fullsized":"2024-01-22T05:08:59.173352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.174828+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:08:59.174828+0000","last_peered":"2024-01-22T05:08:59.174828+0000","last_clean":"2024-01-22T05:08:59.174828+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:08:59.174828+0000","last_undegraded":"2024-01-22T05:08:59.174828+0000","last_fullsized":"2024-01-22T05:08:59.174828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":58,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:58.357995+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:08:58.357995+0000","last_peered":"2024-01-22T05:08:58.357995+0000","last_clean":"2024-01-22T05:08:58.357995+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:08:58.357995+0000","last_undegraded":"2024-01-22T05:08:58.357995+0000","last_fullsized":"2024-01-22T05:08:58.357995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.174647+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:08:59.174647+0000","last_peered":"2024-01-22T05:08:59.174647+0000","last_clean":"2024-01-22T05:08:59.174647+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:08:59.174647+0000","last_undegraded":"2024-01-22T05:08:59.174647+0000","last_fullsized":"2024-01-22T05:08:59.174647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.173278+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:08:59.173278+0000","last_peered":"2024-01-22T05:08:59.173278+0000","last_clean":"2024-01-22T05:08:59.173278+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:08:59.173278+0000","last_undegraded":"2024-01-22T05:08:59.173278+0000","last_fullsized":"2024-01-22T05:08:59.173278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:03.456932+0000","last_change":"2024-01-22T05:09:03.456932+0000","last_active":"2024-01-22T05:09:03.456932+0000","last_peered":"2024-01-22T05:09:03.456932+0000","last_clean":"2024-01-22T05:09:03.456932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:03.456932+0000","last_undegraded":"2024-01-22T05:09:03.456932+0000","last_fullsized":"2024-01-22T05:09:03.456932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:09:02.441249+0000","last_change":"2024-01-22T05:09:02.441249+0000","last_active":"2024-01-22T05:09:02.441249+0000","last_peered":"2024-01-22T05:09:02.441249+0000","last_clean":"2024-01-22T05:09:02.441249+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:02.441249+0000","last_undegraded":"2024-01-22T05:09:02.441249+0000","last_fullsized":"2024-01-22T05:09:02.441249+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":58,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:58.358019+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:08:58.358019+0000","last_peered":"2024-01-22T05:08:58.358019+0000","last_clean":"2024-01-22T05:08:58.358019+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:08:58.358019+0000","last_undegraded":"2024-01-22T05:08:58.358019+0000","last_fullsized":"2024-01-22T05:08:58.358019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":50,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-01-22T05:08:59.173274+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:08:59.173274+0000","last_peered":"2024-01-22T05:08:59.173274+0000","last_clean":"2024-01-22T05:08:59.173274+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:08:59.173274+0000","last_undegraded":"2024-01-22T05:08:59.173274+0000","last_fullsized":"2024-01-22T05:08:59.173274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065772,"statfs":{"total":96636764160,"available":96323350528,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.97499999999999998,"15min":1.0369999999999999},"min":{"1min":0.755,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.0529999999999999,"15min":1.0469999999999999},"min":{"1min":0.73399999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.462,"5min":1.53,"15min":1.53},"last":0.95199999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.024,"15min":0.98299999999999998},"min":{"1min":0.69199999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.048},{"interface":"front","average":{"1min":1.119,"5min":1.137,"15min":1.169},"min":{"1min":0.746,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3700000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.2330000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1100000000000001,"15min":1.1000000000000001},"min":{"1min":0.85299999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.3919999999999999,"5min":1.659,"15min":1.659},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.147,"15min":1.165},"min":{"1min":0.88600000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.4399999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.2490000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.2230000000000001,"15min":1.2330000000000001},"min":{"1min":1.018,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5129999999999999,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.198,"15min":1.224},"min":{"1min":0.97899999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4730000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.1859999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.097,"15min":1.0600000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5589999999999999,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.163,"15min":1.159},"min":{"1min":0.90900000000000003,"5min":0.751,"15min":0.751},"max":{"1min":1.4790000000000001,"5min":1.8,"15min":1.8},"last":1.1100000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.206,"15min":1.194},"min":{"1min":0.97399999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.4710000000000001,"5min":1.736,"15min":1.736},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.2529999999999999,"15min":1.212},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.659,"5min":1.915,"15min":1.915},"last":1.292}]},{"osd":6,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2390000000000001,"15min":1.2529999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4570000000000001,"5min":1.823,"15min":1.823},"last":1.155},{"interface":"front","average":{"1min":1.403,"5min":1.353,"15min":1.327},"min":{"1min":1.056,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.605,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.3620000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061676,"statfs":{"total":96636764160,"available":96319156224,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":4.7039999999999997,"5min":1.7849999999999999,"15min":1.331},"min":{"1min":0.69099999999999995,"5min":0.372,"15min":0.372},"max":{"1min":77.745000000000005,"5min":77.745000000000005,"15min":77.745000000000005},"last":1.139},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.1559999999999999,"15min":1.0880000000000001},"min":{"1min":0.71299999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":13.555999999999999,"5min":13.555999999999999,"15min":13.555999999999999},"last":1.5189999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.728,"5min":1.1499999999999999,"15min":1.0980000000000001},"min":{"1min":0.79300000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":15.499000000000001,"5min":15.499000000000001,"15min":15.499000000000001},"last":1.202},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.2450000000000001,"15min":1.2509999999999999},"min":{"1min":0.89400000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":7.7629999999999999,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":1.2969999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1459999999999999,"15min":1.1579999999999999},"min":{"1min":0.80000000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.0960000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.125,"15min":1.117},"min":{"1min":0.89400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.9649999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.3660000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":5.9720000000000004,"5min":2.0990000000000002,"15min":1.4550000000000001},"min":{"1min":0.81399999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":102.08199999999999,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.706},{"interface":"front","average":{"1min":1.859,"5min":1.2889999999999999,"15min":1.2410000000000001},"min":{"1min":0.86499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":15.468,"5min":15.468,"15min":15.468},"last":1.335}]},{"osd":4,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1339999999999999,"15min":1.0980000000000001},"min":{"1min":0.628,"5min":0.495,"15min":0.495},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.123,"15min":1.1299999999999999},"min":{"1min":0.66600000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.526,"5min":1.649,"15min":1.649},"last":1.2190000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":2.5680000000000001,"5min":1.429,"15min":1.2709999999999999},"min":{"1min":0.92000000000000004,"5min":0.624,"15min":0.624},"max":{"1min":30.533000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":1.087},{"interface":"front","average":{"1min":1.399,"5min":1.302,"15min":1.282},"min":{"1min":1.04,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":3.875,"5min":3.875,"15min":3.875},"last":0.99299999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":2.3719999999999999,"5min":1.548,"15min":1.4419999999999999},"min":{"1min":1.008,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":23.547999999999998,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.607},{"interface":"front","average":{"1min":4.3090000000000002,"5min":1.931,"15min":1.5960000000000001},"min":{"1min":1.1060000000000001,"5min":0.495,"15min":0.495},"max":{"1min":63.737000000000002,"5min":63.737000000000002,"15min":63.737000000000002},"last":1.284}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061676,"statfs":{"total":96636764160,"available":96319156224,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95999999999999996,"15min":0.98599999999999999},"min":{"1min":0.66700000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2709999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0569999999999999,"15min":1.1120000000000001},"min":{"1min":0.72199999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.387,"5min":1.571,"15min":1.571},"last":0.97599999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.153,"15min":1.214},"min":{"1min":0.79800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3859999999999999,"5min":1.821,"15min":1.821},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.216,"15min":1.306},"min":{"1min":0.76000000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4159999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.4570000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.139,"15min":1.155},"min":{"1min":0.85799999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4670000000000001,"5min":1.629,"15min":1.629},"last":1.381},{"interface":"front","average":{"1min":1.085,"5min":1.0960000000000001,"15min":1.1419999999999999},"min":{"1min":0.80900000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.339,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.99399999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1499999999999999,"15min":1.1879999999999999},"min":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4450000000000001,"5min":1.931,"15min":1.931},"last":1.109},{"interface":"front","average":{"1min":1.218,"5min":1.23,"15min":1.306},"min":{"1min":0.97799999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4670000000000001,"5min":2.266,"15min":2.266},"last":1.5389999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1419999999999999,"15min":1.1919999999999999},"min":{"1min":0.80300000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.524,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.2450000000000001,"15min":1.3049999999999999},"min":{"1min":0.83799999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.6240000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.052}]},{"osd":6,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.282,"15min":1.349},"min":{"1min":0.755,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4410000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.29},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2649999999999999,"15min":1.3069999999999999},"min":{"1min":0.94799999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4339999999999999,"5min":1.909,"15min":1.909},"last":1.163}]},{"osd":7,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.369,"15min":1.427},"min":{"1min":1.0069999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.544,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.234},{"interface":"front","average":{"1min":1.363,"5min":1.417,"15min":1.4850000000000001},"min":{"1min":0.93999999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.5740000000000001,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.1990000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061676,"statfs":{"total":96636764160,"available":96319156224,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1000000000000001,"15min":1.1379999999999999},"min":{"1min":0.68999999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7490000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.107,"15min":1.0940000000000001},"min":{"1min":0.78900000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.6599999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.347}]},{"osd":1,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0529999999999999,"15min":1.085},"min":{"1min":0.64000000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.1160000000000001,"15min":1.198},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5009999999999999,"5min":2.194,"15min":2.194},"last":1.0680000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.097,"15min":1.091},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3620000000000001,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1950000000000001,"15min":1.278},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.5289999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.1639999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1379999999999999,"15min":1.1859999999999999},"min":{"1min":0.75900000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.462,"5min":1.589,"15min":1.589},"last":1.228},{"interface":"front","average":{"1min":1.198,"5min":1.1819999999999999,"15min":1.167},"min":{"1min":0.753,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4950000000000001,"5min":5.3029999999999999,"15min":5.3029999999999999},"last":1.3089999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.181,"15min":1.2230000000000001},"min":{"1min":0.70899999999999996,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.597,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.27},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1319999999999999,"15min":1.1619999999999999},"min":{"1min":0.73599999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.48,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.96399999999999997}]},{"osd":6,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1950000000000001,"15min":1.1910000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6080000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.367,"15min":1.427},"min":{"1min":0.79000000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6379999999999999,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":1.4770000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3260000000000001,"15min":1.367},"min":{"1min":0.874,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.5649999999999999,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.377,"15min":1.385},"min":{"1min":0.86899999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.712,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.45}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061676,"statfs":{"total":96636764160,"available":96319156224,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.94999999999999996,"15min":0.90500000000000003},"min":{"1min":0.55600000000000005,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2090000000000001,"5min":14.859,"15min":14.859},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.93000000000000005,"15min":0.88400000000000001},"min":{"1min":0.66000000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.599,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":1.1639999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.57899999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.266,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.99399999999999999,"15min":0.98399999999999999},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.278,"5min":5.7519999999999998,"15min":5.7519999999999998},"last":0.93799999999999994}]},{"osd":2,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0960000000000001,"15min":1.1619999999999999},"min":{"1min":0.65400000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.714,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.175,"15min":1.1930000000000001},"min":{"1min":0.72199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.377}]},{"osd":4,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2849999999999999,"15min":1.2949999999999999},"min":{"1min":0.91100000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5600000000000001,"5min":5.016,"15min":5.016},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.3440000000000001,"15min":1.339},"min":{"1min":0.85399999999999998,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.647,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":1.3160000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.95599999999999996,"5min":0.505,"15min":0.505},"max":{"1min":1.7509999999999999,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":2.0459999999999998,"5min":1.4730000000000001,"15min":1.3420000000000001},"min":{"1min":0.95499999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":14.523999999999999,"5min":14.523999999999999,"15min":14.523999999999999},"last":1.28}]},{"osd":6,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3839999999999999,"15min":1.4219999999999999},"min":{"1min":1,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.698,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.472,"5min":1.4370000000000001,"15min":1.423},"min":{"1min":0.89600000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.79,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":1.4890000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.401,"15min":1.401},"min":{"1min":1.022,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.8200000000000001,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.4159999999999999,"15min":1.4279999999999999},"min":{"1min":0.85399999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7490000000000001,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":1.6220000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065772,"statfs":{"total":96636764160,"available":96323350528,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.46100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.54300000000000004,"5min":0.373,"15min":0.373},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.72399999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.5,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.91100000000000003,"15min":0.93899999999999995},"min":{"1min":0.57499999999999996,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.93100000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.071,"15min":1.0569999999999999},"min":{"1min":0.83699999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.677,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.145,"15min":1.161},"min":{"1min":0.79500000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.6899999999999999,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.4350000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2470000000000001,"15min":1.304},"min":{"1min":0.85699999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6439999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.347},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.179,"15min":1.208},"min":{"1min":0.77300000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.837,"5min":1.952,"15min":1.952},"last":1.02}]},{"osd":5,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.202,"15min":1.1919999999999999},"min":{"1min":0.93700000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.0510000000000002,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.214},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.276,"15min":1.3220000000000001},"min":{"1min":1.0149999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8600000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.264}]},{"osd":6,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2210000000000001,"15min":1.254},"min":{"1min":0.83999999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5449999999999999,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.46,"5min":1.2889999999999999,"15min":1.29},"min":{"1min":1.095,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.1320000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.3009999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3140000000000001,"15min":1.355},"min":{"1min":0.92900000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.764,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.081},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.395,"15min":1.4099999999999999},"min":{"1min":1.01,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.0329999999999999,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.4770000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061676,"statfs":{"total":96636764160,"available":96319156224,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.873,"15min":0.84499999999999997},"min":{"1min":0.54800000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.248,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.98399999999999999,"15min":0.999},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.3540000000000001,"5min":2.101,"15min":2.101},"last":0.98999999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.97899999999999998,"15min":1.0009999999999999},"min":{"1min":0.63900000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.032,"15min":1.026},"min":{"1min":0.71499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.71,"5min":2.008,"15min":2.008},"last":0.745}]},{"osd":3,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0349999999999999,"15min":0.998},"min":{"1min":0.54800000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5720000000000001,"5min":4.665,"15min":4.665},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89300000000000002,"15min":0.88},"min":{"1min":0.56399999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.84899999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2050000000000001,"15min":1.2010000000000001},"min":{"1min":0.82899999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.036},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.276,"15min":1.25},"min":{"1min":0.95999999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.786,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":1.0800000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.1759999999999999,"15min":1.1850000000000001},"min":{"1min":0.78600000000000003,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.774,"5min":1.776,"15min":1.776},"last":1.288},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.266,"15min":1.2689999999999999},"min":{"1min":0.89400000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6599999999999999,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.25}]},{"osd":6,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.93999999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.712,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.145},{"interface":"front","average":{"1min":1.381,"5min":1.3280000000000001,"15min":1.335},"min":{"1min":1.0369999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.722,"5min":2.294,"15min":2.294},"last":1.391}]},{"osd":7,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.387,"15min":1.375},"min":{"1min":1.036,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8640000000000001,"5min":4.4329999999999998,"15min":4.4329999999999998},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3480000000000001,"15min":1.3600000000000001},"min":{"1min":0.85599999999999998,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.9359999999999999,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":1.421}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065772,"statfs":{"total":96636764160,"available":96323350528,"internally_reserved":0,"allocated":798720,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83899999999999997,"15min":0.91900000000000004},"min":{"1min":0.499,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.1659999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.91600000000000004,"15min":0.98199999999999998},"min":{"1min":0.59399999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5349999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.94699999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.01,"15min":1.0740000000000001},"min":{"1min":0.61499999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.5600000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1,"15min":1.0209999999999999},"min":{"1min":0.73399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.83899999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.95599999999999996,"15min":1.022},"min":{"1min":0.51500000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2270000000000001,"5min":1.994,"15min":1.994},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1200000000000001,"15min":1.2050000000000001},"min":{"1min":0.70199999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.569,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.0840000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.292,"15min":1.383},"min":{"1min":0.89600000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.696,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2250000000000001,"15min":1.256},"min":{"1min":1.0029999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6299999999999999,"5min":1.782,"15min":1.782},"last":1.3340000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2889999999999999,"15min":1.379},"min":{"1min":0.93300000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.698,"5min":3.548,"15min":3.548},"last":1.173},{"interface":"front","average":{"1min":1.355,"5min":1.323,"15min":1.417},"min":{"1min":0.82799999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8660000000000001,"5min":2.613,"15min":2.613},"last":1.194}]},{"osd":6,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.375,"15min":1.4419999999999999},"min":{"1min":0.92000000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9370000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.3859999999999999,"15min":1.504},"min":{"1min":0.97599999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8700000000000001,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.0489999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.482,"15min":1.639},"min":{"1min":1.111,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.925,"5min":5.29,"15min":5.29},"last":1.244},{"interface":"front","average":{"1min":1.444,"5min":1.3720000000000001,"15min":1.4390000000000001},"min":{"1min":1.0880000000000001,"5min":0.752,"15min":0.752},"max":{"1min":1.76,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.2689999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:09:09.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2024-01-22T05:09:09.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2024-01-22T05:09:09.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2024-01-22T05:09:09.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2024-01-22T05:09:09.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2024-01-22T05:09:09.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2024-01-22T05:09:09.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2024-01-22T05:09:09.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2024-01-22T05:09:09.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2024-01-22T05:09:09.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2024-01-22T05:09:09.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2024-01-22T05:09:09.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2024-01-22T05:09:09.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2024-01-22T05:09:09.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2024-01-22T05:09:09.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2024-01-22T05:09:09.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2024-01-22T05:09:09.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2024-01-22T05:09:09.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2024-01-22T05:09:09.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2024-01-22T05:09:09.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2024-01-22T05:09:09.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2024-01-22T05:09:09.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2024-01-22T05:09:09.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2024-01-22T05:09:09.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2024-01-22T05:09:09.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2024-01-22T05:09:09.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2024-01-22T05:09:09.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2024-01-22T05:09:09.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2024-01-22T05:09:09.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2024-01-22T05:09:09.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2024-01-22T05:09:09.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2024-01-22T05:09:09.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2024-01-22T05:09:09.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2024-01-22T05:09:09.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2024-01-22T05:09:09.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2024-01-22T05:09:09.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2024-01-22T05:09:09.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2024-01-22T05:09:09.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2024-01-22T05:09:09.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2024-01-22T05:09:09.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2024-01-22T05:09:09.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2024-01-22T05:09:09.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2024-01-22T05:09:09.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2024-01-22T05:09:09.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2024-01-22T05:09:09.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2024-01-22T05:09:09.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2024-01-22T05:09:09.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2024-01-22T05:09:09.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2024-01-22T05:09:09.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2024-01-22T05:09:09.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2024-01-22T05:09:09.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2024-01-22T05:09:09.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2024-01-22T05:09:09.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2024-01-22T05:09:09.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2024-01-22T05:09:09.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2024-01-22T05:09:09.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2024-01-22T05:09:09.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2024-01-22T05:09:09.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2024-01-22T05:09:09.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2024-01-22T05:09:09.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2024-01-22T05:09:09.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2024-01-22T05:09:09.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2024-01-22T05:09:09.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2024-01-22T05:09:09.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2024-01-22T05:09:09.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2024-01-22T05:09:09.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2024-01-22T05:09:09.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2024-01-22T05:09:09.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2024-01-22T05:09:09.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2024-01-22T05:09:09.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2024-01-22T05:09:09.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2024-01-22T05:09:09.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2024-01-22T05:09:09.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2024-01-22T05:09:09.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2024-01-22T05:09:09.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2024-01-22T05:09:09.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2024-01-22T05:09:09.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2024-01-22T05:09:09.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2024-01-22T05:09:09.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2024-01-22T05:09:09.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2024-01-22T05:09:09.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2024-01-22T05:09:09.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2024-01-22T05:09:09.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2024-01-22T05:09:09.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2024-01-22T05:09:09.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2024-01-22T05:09:09.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2024-01-22T05:09:09.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2024-01-22T05:09:09.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2024-01-22T05:09:09.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2024-01-22T05:09:09.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2024-01-22T05:09:09.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2024-01-22T05:09:09.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2024-01-22T05:09:09.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2024-01-22T05:09:09.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2024-01-22T05:09:09.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2024-01-22T05:09:09.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2024-01-22T05:09:09.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2024-01-22T05:09:09.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2024-01-22T05:09:09.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2024-01-22T05:09:09.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2024-01-22T05:09:09.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2024-01-22T05:09:09.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2024-01-22T05:09:09.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2024-01-22T05:09:09.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2024-01-22T05:09:09.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2024-01-22T05:09:09.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2024-01-22T05:09:09.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2024-01-22T05:09:09.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2024-01-22T05:09:09.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2024-01-22T05:09:09.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2024-01-22T05:09:09.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2024-01-22T05:09:09.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2024-01-22T05:09:09.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2024-01-22T05:09:09.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2024-01-22T05:09:09.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2024-01-22T05:09:09.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2024-01-22T05:09:09.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2024-01-22T05:09:09.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2024-01-22T05:09:09.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2024-01-22T05:09:09.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2024-01-22T05:09:09.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2024-01-22T05:09:09.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2024-01-22T05:09:09.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2024-01-22T05:09:09.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2024-01-22T05:09:09.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2024-01-22T05:09:09.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2024-01-22T05:09:09.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2024-01-22T05:09:09.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:03.456932+0000', 'last_change': '2024-01-22T05:09:03.456932+0000', 'last_active': '2024-01-22T05:09:03.456932+0000', 'last_peered': '2024-01-22T05:09:03.456932+0000', 'last_clean': '2024-01-22T05:09:03.456932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:03.456932+0000', 'last_undegraded': '2024-01-22T05:09:03.456932+0000', 'last_fullsized': '2024-01-22T05:09:03.456932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:03.456932+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2024-01-22T05:09:09.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:09:02.441249+0000', 'last_change': '2024-01-22T05:09:02.441249+0000', 'last_active': '2024-01-22T05:09:02.441249+0000', 'last_peered': '2024-01-22T05:09:02.441249+0000', 'last_clean': '2024-01-22T05:09:02.441249+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:02.441249+0000', 'last_undegraded': '2024-01-22T05:09:02.441249+0000', 'last_fullsized': '2024-01-22T05:09:02.441249+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:02.441249+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:09:09.322 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:09:09.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.491+0000 7f633e600700 1 Processor -- start 2024-01-22T05:09:09.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.491+0000 7f633e600700 1 -- start start 2024-01-22T05:09:09.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.495+0000 7f633e600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6338065240 0x7f63380644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.495+0000 7f633e600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633815c7d0 con 0x7f63380649e0 2024-01-22T05:09:09.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.495+0000 7f633e600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63380c2700 con 0x7f6338065620 2024-01-22T05:09:09.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.495+0000 7f633e600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63380c29a0 con 0x7f6338065240 2024-01-22T05:09:09.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.495+0000 7f633d000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f63380649e0 0x7f633815c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40290/0 (socket says 172.21.15.49:40290) 2024-01-22T05:09:09.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.495+0000 7f6337400700 1 --2- 172.21.15.49:0/3073368401 >> v2:172.21.15.49:3300/0 conn(0x7f6338065240 0x7f63380644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.495+0000 7f633d000700 1 -- 172.21.15.49:0/3073368401 learned_addr learned my addr 172.21.15.49:0/3073368401 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:09.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.495+0000 7f6337400700 1 -- 172.21.15.49:0/3073368401 >> v1:172.21.15.110:6789/0 conn(0x7f6338065620 legacy=0x7f633815b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.495+0000 7f6336000700 1 -- 172.21.15.49:0/3073368401 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19379469 0 0) 0x7f63380c2700 con 0x7f6338065620 2024-01-22T05:09:09.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.495+0000 7f6337400700 1 -- 172.21.15.49:0/3073368401 >> v1:172.21.15.49:6789/0 conn(0x7f63380649e0 legacy=0x7f633815c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.495+0000 7f6337400700 1 -- 172.21.15.49:0/3073368401 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63380c2c80 con 0x7f6338065240 2024-01-22T05:09:09.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.495+0000 7f6337400700 1 --2- 172.21.15.49:0/3073368401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6338065240 0x7f63380644f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f6328009760 tx=0x7f6328009060).ready entity=mon.0 client_cookie=47bf835cbd959e6e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:09.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.499+0000 7f6336000700 1 -- 172.21.15.49:0/3073368401 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800b580 con 0x7f6338065240 2024-01-22T05:09:09.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.499+0000 7f6336000700 1 -- 172.21.15.49:0/3073368401 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632800b6e0 con 0x7f6338065240 2024-01-22T05:09:09.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.499+0000 7f6336000700 1 -- 172.21.15.49:0/3073368401 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800ba60 con 0x7f6338065240 2024-01-22T05:09:09.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.499+0000 7f633e600700 1 -- 172.21.15.49:0/3073368401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6338065240 msgr2=0x7f63380644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.499+0000 7f633e600700 1 --2- 172.21.15.49:0/3073368401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6338065240 0x7f63380644f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f6328009760 tx=0x7f6328009060).stop 2024-01-22T05:09:09.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.499+0000 7f633e600700 1 -- 172.21.15.49:0/3073368401 shutdown_connections 2024-01-22T05:09:09.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.499+0000 7f633e600700 1 --2- 172.21.15.49:0/3073368401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6338065240 0x7f63380644f0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.499+0000 7f633e600700 1 -- 172.21.15.49:0/3073368401 >> 172.21.15.49:0/3073368401 conn(0x7f63380c87f0 msgr2=0x7f63380c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:09.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.499+0000 7f633e600700 1 -- 172.21.15.49:0/3073368401 shutdown_connections 2024-01-22T05:09:09.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.499+0000 7f633e600700 1 -- 172.21.15.49:0/3073368401 wait complete. 2024-01-22T05:09:09.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f633e600700 1 Processor -- start 2024-01-22T05:09:09.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f633e600700 1 -- start start 2024-01-22T05:09:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f633e600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63380649e0 0x7f63381691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f633e600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6338065240 0x7f633816b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f633e600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6338065620 0x7f6338169940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f633e600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63380c18b0 con 0x7f63380649e0 2024-01-22T05:09:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f633e600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63380bfed0 con 0x7f6338065240 2024-01-22T05:09:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f633e600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63381696a0 con 0x7f6338065620 2024-01-22T05:09:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f6337400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63380649e0 0x7f63381691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f6337400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63380649e0 0x7f63381691b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55630/0 (socket says 172.21.15.49:55630) 2024-01-22T05:09:09.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f6337400700 1 -- 172.21.15.49:0/197320624 learned_addr learned my addr 172.21.15.49:0/197320624 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:09.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f6336a00700 1 --2- 172.21.15.49:0/197320624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6338065240 0x7f633816b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f633d000700 1 --2- 172.21.15.49:0/197320624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6338065620 0x7f6338169940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f6337400700 1 -- 172.21.15.49:0/197320624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6338065620 msgr2=0x7f6338169940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f6337400700 1 --2- 172.21.15.49:0/197320624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6338065620 0x7f6338169940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f6337400700 1 -- 172.21.15.49:0/197320624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6338065240 msgr2=0x7f633816b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f6337400700 1 --2- 172.21.15.49:0/197320624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6338065240 0x7f633816b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.503+0000 7f6337400700 1 -- 172.21.15.49:0/197320624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63280092a0 con 0x7f63380649e0 2024-01-22T05:09:09.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.507+0000 7f6337400700 1 --2- 172.21.15.49:0/197320624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63380649e0 0x7f63381691b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f6328009eb0 tx=0x7f6328017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:09.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.507+0000 7f632ea00700 1 -- 172.21.15.49:0/197320624 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800ba60 con 0x7f63380649e0 2024-01-22T05:09:09.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.507+0000 7f632ea00700 1 -- 172.21.15.49:0/197320624 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6328000c90 con 0x7f63380649e0 2024-01-22T05:09:09.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.507+0000 7f633e600700 1 -- 172.21.15.49:0/197320624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633816baa0 con 0x7f63380649e0 2024-01-22T05:09:09.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.507+0000 7f632ea00700 1 -- 172.21.15.49:0/197320624 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632801b660 con 0x7f63380649e0 2024-01-22T05:09:09.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.507+0000 7f633e600700 1 -- 172.21.15.49:0/197320624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63380bf5a0 con 0x7f63380649e0 2024-01-22T05:09:09.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.507+0000 7f633e600700 1 -- 172.21.15.49:0/197320624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6338047060 con 0x7f63380649e0 2024-01-22T05:09:09.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.507+0000 7f632ea00700 1 -- 172.21.15.49:0/197320624 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f632801ba50 con 0x7f63380649e0 2024-01-22T05:09:09.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.511+0000 7f632ea00700 1 --2- 172.21.15.49:0/197320624 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f631005a510 0x7f631005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.511+0000 7f632ea00700 1 -- 172.21.15.49:0/197320624 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f6328076660 con 0x7f63380649e0 2024-01-22T05:09:09.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.511+0000 7f6336a00700 1 --2- 172.21.15.49:0/197320624 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f631005a510 0x7f631005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.511+0000 7f6336a00700 1 --2- 172.21.15.49:0/197320624 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f631005a510 0x7f631005c9d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f633815c280 tx=0x7f6320009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.519+0000 7f632ea00700 1 -- 172.21.15.49:0/197320624 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6328049ce0 con 0x7f63380649e0 2024-01-22T05:09:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.731+0000 7f633e600700 1 -- 172.21.15.49:0/197320624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f63380c2f60 con 0x7f63380649e0 2024-01-22T05:09:09.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.731+0000 7f632ea00700 1 -- 172.21.15.49:0/197320624 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1501 (secure 0 0 0) 0x7f632804d300 con 0x7f63380649e0 2024-01-22T05:09:09.736 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:09.736 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":293,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":70,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":2528727040,"bytes_avail":770565386240,"bytes_total":773094113280},"fsmap":{"epoch":56,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6348}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-01-22T05:08:43.318180+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:09:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.735+0000 7f633e600700 1 -- 172.21.15.49:0/197320624 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f631005a510 msgr2=0x7f631005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.735+0000 7f633e600700 1 --2- 172.21.15.49:0/197320624 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f631005a510 0x7f631005c9d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f633815c280 tx=0x7f6320009040).stop 2024-01-22T05:09:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.735+0000 7f633e600700 1 -- 172.21.15.49:0/197320624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63380649e0 msgr2=0x7f63381691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.735+0000 7f633e600700 1 --2- 172.21.15.49:0/197320624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63380649e0 0x7f63381691b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f6328009eb0 tx=0x7f6328017000).stop 2024-01-22T05:09:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.735+0000 7f633e600700 1 -- 172.21.15.49:0/197320624 shutdown_connections 2024-01-22T05:09:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.735+0000 7f633e600700 1 --2- 172.21.15.49:0/197320624 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f631005a510 0x7f631005c9d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.735+0000 7f633e600700 1 --2- 172.21.15.49:0/197320624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6338065620 0x7f6338169940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.735+0000 7f633e600700 1 --2- 172.21.15.49:0/197320624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6338065240 0x7f633816b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.735+0000 7f633e600700 1 --2- 172.21.15.49:0/197320624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63380649e0 0x7f63381691b0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.735+0000 7f633e600700 1 -- 172.21.15.49:0/197320624 >> 172.21.15.49:0/197320624 conn(0x7f63380c87f0 msgr2=0x7f63380ad430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.735+0000 7f633e600700 1 -- 172.21.15.49:0/197320624 shutdown_connections 2024-01-22T05:09:09.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.735+0000 7f633e600700 1 -- 172.21.15.49:0/197320624 wait complete. 2024-01-22T05:09:09.762 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-22T05:09:09.762 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:09:09.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.915+0000 7f62e2600700 1 Processor -- start 2024-01-22T05:09:09.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.915+0000 7f62e2600700 1 -- start start 2024-01-22T05:09:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.919+0000 7f62e2600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f62dc0c4990 0x7f62dc0bda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.919+0000 7f62e2600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62dc0bdf30 0x7f62dc15d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.919+0000 7f62e2600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62dc0c2dc0 con 0x7f62dc0c45b0 2024-01-22T05:09:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.919+0000 7f62e2600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62dc0a6f40 con 0x7f62dc0c4990 2024-01-22T05:09:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.919+0000 7f62e2600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc0c21b0 con 0x7f62dc0bdf30 2024-01-22T05:09:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.919+0000 7f62e1200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f62dc0c45b0 0x7f62dc0a6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40306/0 (socket says 172.21.15.49:40306) 2024-01-22T05:09:09.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.919+0000 7f62e1200700 1 -- 172.21.15.49:0/2686257562 learned_addr learned my addr 172.21.15.49:0/2686257562 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.919+0000 7f62dbe00700 1 --2- 172.21.15.49:0/2686257562 >> v2:172.21.15.110:3300/0 conn(0x7f62dc0c4990 0x7f62dc0bda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.919+0000 7f62e1c00700 1 --2- 172.21.15.49:0/2686257562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62dc0bdf30 0x7f62dc15d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 -- 172.21.15.49:0/2686257562 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289896893 0 0) 0x7f62dc0c2dc0 con 0x7f62dc0c45b0 2024-01-22T05:09:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 -- 172.21.15.49:0/2686257562 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62bc0033f0 con 0x7f62dc0c45b0 2024-01-22T05:09:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 -- 172.21.15.49:0/2686257562 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2208038097 0 0) 0x7f62bc0033f0 con 0x7f62dc0c45b0 2024-01-22T05:09:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 -- 172.21.15.49:0/2686257562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62dc0bdf30 msgr2=0x7f62dc15d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 --2- 172.21.15.49:0/2686257562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62dc0bdf30 0x7f62dc15d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 -- 172.21.15.49:0/2686257562 >> v2:172.21.15.110:3300/0 conn(0x7f62dc0c4990 msgr2=0x7f62dc0bda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 --2- 172.21.15.49:0/2686257562 >> v2:172.21.15.110:3300/0 conn(0x7f62dc0c4990 0x7f62dc0bda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 -- 172.21.15.49:0/2686257562 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc0c2490 con 0x7f62dc0c45b0 2024-01-22T05:09:09.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 -- 172.21.15.49:0/2686257562 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f62cc001470 con 0x7f62dc0c45b0 2024-01-22T05:09:09.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 -- 172.21.15.49:0/2686257562 >> v1:172.21.15.49:6789/0 conn(0x7f62dc0c45b0 legacy=0x7f62dc0a6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 --2- 172.21.15.49:0/2686257562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62bc0038e0 0x7f62bc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 --2- 172.21.15.49:0/2686257562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62bc004690 0x7f62bc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 --2- 172.21.15.49:0/2686257562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62bc005000 0x7f62bc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 -- 172.21.15.49:0/2686257562 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc0a6f40 con 0x7f62bc005000 2024-01-22T05:09:09.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 -- 172.21.15.49:0/2686257562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc0c21b0 con 0x7f62bc004690 2024-01-22T05:09:09.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 -- 172.21.15.49:0/2686257562 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc00bdd0 con 0x7f62bc0038e0 2024-01-22T05:09:09.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62e1c00700 1 --2- 172.21.15.49:0/2686257562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62dc0bdf30 0x7f62dc15d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62e1c00700 1 --2- 172.21.15.49:0/2686257562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62bc005000 0x7f62bc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62dbe00700 1 --2- 172.21.15.49:0/2686257562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62bc004690 0x7f62bc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62e1200700 1 --2- 172.21.15.49:0/2686257562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62bc0038e0 0x7f62bc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62e1c00700 1 -- 172.21.15.49:0/2686257562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62bc0038e0 msgr2=0x7f62bc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62e1c00700 1 --2- 172.21.15.49:0/2686257562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62bc0038e0 0x7f62bc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62e1c00700 1 -- 172.21.15.49:0/2686257562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62bc004690 msgr2=0x7f62bc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62e1c00700 1 --2- 172.21.15.49:0/2686257562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62bc004690 0x7f62bc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62e1c00700 1 -- 172.21.15.49:0/2686257562 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc0033f0 con 0x7f62bc005000 2024-01-22T05:09:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62dbe00700 1 --2- 172.21.15.49:0/2686257562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62bc004690 0x7f62bc004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62e1c00700 1 --2- 172.21.15.49:0/2686257562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62bc005000 0x7f62bc00b8e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f62d400e2b0 tx=0x7f62d400b040).ready entity=mon.0 client_cookie=a8697ff5aafc5767 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 -- 172.21.15.49:0/2686257562 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d400eb00 con 0x7f62bc005000 2024-01-22T05:09:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 -- 172.21.15.49:0/2686257562 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d400f040 con 0x7f62bc005000 2024-01-22T05:09:09.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.923+0000 7f62db400700 1 -- 172.21.15.49:0/2686257562 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d400ee90 con 0x7f62bc005000 2024-01-22T05:09:09.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.927+0000 7f62e2600700 1 -- 172.21.15.49:0/2686257562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62bc005000 msgr2=0x7f62bc00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.927+0000 7f62e2600700 1 --2- 172.21.15.49:0/2686257562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62bc005000 0x7f62bc00b8e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f62d400e2b0 tx=0x7f62d400b040).stop 2024-01-22T05:09:09.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.927+0000 7f62e1c00700 1 -- 172.21.15.49:0/2686257562 reap_dead start 2024-01-22T05:09:09.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.927+0000 7f62e2600700 1 -- 172.21.15.49:0/2686257562 shutdown_connections 2024-01-22T05:09:09.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.927+0000 7f62e2600700 1 -- 172.21.15.49:0/2686257562 >> 172.21.15.49:0/2686257562 conn(0x7f62dc0aa6b0 msgr2=0x7f62dc0aaac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.927+0000 7f62e2600700 1 -- 172.21.15.49:0/2686257562 shutdown_connections 2024-01-22T05:09:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.927+0000 7f62e2600700 1 -- 172.21.15.49:0/2686257562 wait complete. 2024-01-22T05:09:09.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.931+0000 7f62e2600700 1 Processor -- start 2024-01-22T05:09:09.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.931+0000 7f62e2600700 1 -- start start 2024-01-22T05:09:09.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.931+0000 7f62e2600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62bc005000 0x7f62dc1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.931+0000 7f62e2600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62dc0a86a0 0x7f62dc0a8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.931+0000 7f62e2600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62dc0a7350 0x7f62dc0a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.931+0000 7f62e2600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc165bf0 con 0x7f62bc005000 2024-01-22T05:09:09.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.931+0000 7f62e2600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc0a9010 con 0x7f62dc0a86a0 2024-01-22T05:09:09.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.931+0000 7f62e2600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc152ec0 con 0x7f62dc0a7350 2024-01-22T05:09:09.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.931+0000 7f62e1200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62bc005000 0x7f62dc1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.931+0000 7f62e1200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62bc005000 0x7f62dc1529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55650/0 (socket says 172.21.15.49:55650) 2024-01-22T05:09:09.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.931+0000 7f62e1200700 1 -- 172.21.15.49:0/4201801960 learned_addr learned my addr 172.21.15.49:0/4201801960 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:09.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.935+0000 7f62dbe00700 1 --2- 172.21.15.49:0/4201801960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62dc0a86a0 0x7f62dc0a8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.935+0000 7f62e1c00700 1 --2- 172.21.15.49:0/4201801960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62dc0a7350 0x7f62dc0a77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.935+0000 7f62e1200700 1 -- 172.21.15.49:0/4201801960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62dc0a7350 msgr2=0x7f62dc0a77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.935+0000 7f62e1200700 1 --2- 172.21.15.49:0/4201801960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62dc0a7350 0x7f62dc0a77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.935+0000 7f62e1200700 1 -- 172.21.15.49:0/4201801960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62dc0a86a0 msgr2=0x7f62dc0a8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:09.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.935+0000 7f62e1200700 1 --2- 172.21.15.49:0/4201801960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62dc0a86a0 0x7f62dc0a8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:09.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.935+0000 7f62e1200700 1 -- 172.21.15.49:0/4201801960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc0a8120 con 0x7f62bc005000 2024-01-22T05:09:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.935+0000 7f62e1200700 1 --2- 172.21.15.49:0/4201801960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62bc005000 0x7f62dc1529d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f62cc0049e0 tx=0x7f62cc001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.935+0000 7f62d3e00700 1 -- 172.21.15.49:0/4201801960 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc00f870 con 0x7f62bc005000 2024-01-22T05:09:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.935+0000 7f62d3e00700 1 -- 172.21.15.49:0/4201801960 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62cc00f9d0 con 0x7f62bc005000 2024-01-22T05:09:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.935+0000 7f62e2600700 1 -- 172.21.15.49:0/4201801960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62dc0a8400 con 0x7f62bc005000 2024-01-22T05:09:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.935+0000 7f62d3e00700 1 -- 172.21.15.49:0/4201801960 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc00fd50 con 0x7f62bc005000 2024-01-22T05:09:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.935+0000 7f62e2600700 1 -- 172.21.15.49:0/4201801960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62dc165880 con 0x7f62bc005000 2024-01-22T05:09:09.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.935+0000 7f62e2600700 1 -- 172.21.15.49:0/4201801960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62dc0c2770 con 0x7f62bc005000 2024-01-22T05:09:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.939+0000 7f62d3e00700 1 -- 172.21.15.49:0/4201801960 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f62cc015620 con 0x7f62bc005000 2024-01-22T05:09:09.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.939+0000 7f62d3e00700 1 --2- 172.21.15.49:0/4201801960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f62b405a540 0x7f62b405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:09.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.939+0000 7f62d3e00700 1 -- 172.21.15.49:0/4201801960 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f62cc074e30 con 0x7f62bc005000 2024-01-22T05:09:09.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.939+0000 7f62dbe00700 1 --2- 172.21.15.49:0/4201801960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f62b405a540 0x7f62b405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:09.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.943+0000 7f62dbe00700 1 --2- 172.21.15.49:0/4201801960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f62b405a540 0x7f62b405ca00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f62c4006d30 tx=0x7f62c4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:09.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:09.947+0000 7f62d3e00700 1 -- 172.21.15.49:0/4201801960 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f62cc048390 con 0x7f62bc005000 2024-01-22T05:09:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:10.111+0000 7f62e2600700 1 -- 172.21.15.49:0/4201801960 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62dc153f80 con 0x7f62b405a540 2024-01-22T05:09:10.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:10.131+0000 7f62d3e00700 1 -- 172.21.15.49:0/4201801960 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358812 (secure 0 0 0) 0x7f62dc153f80 con 0x7f62b405a540 2024-01-22T05:09:10.140 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:10.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:10.139+0000 7f62e2600700 1 -- 172.21.15.49:0/4201801960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f62b405a540 msgr2=0x7f62b405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:10.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:10.139+0000 7f62e2600700 1 --2- 172.21.15.49:0/4201801960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f62b405a540 0x7f62b405ca00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f62c4006d30 tx=0x7f62c4008040).stop 2024-01-22T05:09:10.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:10.139+0000 7f62e2600700 1 -- 172.21.15.49:0/4201801960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62bc005000 msgr2=0x7f62dc1529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:10.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:10.139+0000 7f62e2600700 1 --2- 172.21.15.49:0/4201801960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62bc005000 0x7f62dc1529d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f62cc0049e0 tx=0x7f62cc001e90).stop 2024-01-22T05:09:10.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:10.139+0000 7f62e2600700 1 -- 172.21.15.49:0/4201801960 shutdown_connections 2024-01-22T05:09:10.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:10.139+0000 7f62e2600700 1 --2- 172.21.15.49:0/4201801960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f62b405a540 0x7f62b405ca00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:10.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:10.139+0000 7f62e2600700 1 --2- 172.21.15.49:0/4201801960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62dc0a7350 0x7f62dc0a77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:10.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:10.139+0000 7f62e2600700 1 --2- 172.21.15.49:0/4201801960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62dc0a86a0 0x7f62dc0a8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:10.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:10.139+0000 7f62e2600700 1 --2- 172.21.15.49:0/4201801960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62bc005000 0x7f62dc1529d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:10.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:10.139+0000 7f62e2600700 1 -- 172.21.15.49:0/4201801960 >> 172.21.15.49:0/4201801960 conn(0x7f62dc0aa6b0 msgr2=0x7f62dc0a5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:10.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:10.139+0000 7f62e2600700 1 -- 172.21.15.49:0/4201801960 shutdown_connections 2024-01-22T05:09:10.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:10.139+0000 7f62e2600700 1 -- 172.21.15.49:0/4201801960 wait complete. 2024-01-22T05:09:10.148 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:09:10.167 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-01-22T05:09:09.325518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":207,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2469460,"kb_used_data":6676,"kb_used_omap":0,"kb_used_meta":2462720,"kb_avail":752505260,"statfs":{"total":773094113280,"available":770565386240,"internally_reserved":0,"allocated":6836224,"data_stored":3261643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2521825280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13245269,"num_objects":-2153,"num_object_clones":0,"num_object_copies":-4306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2153,"num_whiteouts":0,"num_read":-137,"num_read_kb":-7406,"num_write":-6191,"num_write_kb":-18989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-17,"num_bytes_recovered":0,"num_keys_recovered":-41,"num_objects_omap":-708,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.885978"},"pg_stats":[{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.975223+0000","last_change":"2024-01-22T05:09:03.964724+0000","last_active":"2024-01-22T05:09:03.975223+0000","last_peered":"2024-01-22T05:09:03.975223+0000","last_clean":"2024-01-22T05:09:03.975223+0000","last_became_active":"2024-01-22T05:09:03.963836+0000","last_became_peered":"2024-01-22T05:09:03.963836+0000","last_unstale":"2024-01-22T05:09:03.975223+0000","last_undegraded":"2024-01-22T05:09:03.975223+0000","last_fullsized":"2024-01-22T05:09:03.975223+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"69'3","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.975505+0000","last_change":"2024-01-22T05:09:03.498657+0000","last_active":"2024-01-22T05:09:03.975505+0000","last_peered":"2024-01-22T05:09:03.975505+0000","last_clean":"2024-01-22T05:09:03.975505+0000","last_became_active":"2024-01-22T05:09:03.498403+0000","last_became_peered":"2024-01-22T05:09:03.498403+0000","last_unstale":"2024-01-22T05:09:03.975505+0000","last_undegraded":"2024-01-22T05:09:03.975505+0000","last_fullsized":"2024-01-22T05:09:03.975505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.976472+0000","last_change":"2024-01-22T05:09:03.966347+0000","last_active":"2024-01-22T05:09:03.976472+0000","last_peered":"2024-01-22T05:09:03.976472+0000","last_clean":"2024-01-22T05:09:03.976472+0000","last_became_active":"2024-01-22T05:09:03.966043+0000","last_became_peered":"2024-01-22T05:09:03.966043+0000","last_unstale":"2024-01-22T05:09:03.976472+0000","last_undegraded":"2024-01-22T05:09:03.976472+0000","last_fullsized":"2024-01-22T05:09:03.976472+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.948702+0000","last_change":"2024-01-22T05:09:03.502076+0000","last_active":"2024-01-22T05:09:03.948702+0000","last_peered":"2024-01-22T05:09:03.948702+0000","last_clean":"2024-01-22T05:09:03.948702+0000","last_became_active":"2024-01-22T05:09:03.501009+0000","last_became_peered":"2024-01-22T05:09:03.501009+0000","last_unstale":"2024-01-22T05:09:03.948702+0000","last_undegraded":"2024-01-22T05:09:03.948702+0000","last_fullsized":"2024-01-22T05:09:03.948702+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.973156+0000","last_change":"2024-01-22T05:09:03.967899+0000","last_active":"2024-01-22T05:09:03.973156+0000","last_peered":"2024-01-22T05:09:03.973156+0000","last_clean":"2024-01-22T05:09:03.973156+0000","last_became_active":"2024-01-22T05:09:03.967208+0000","last_became_peered":"2024-01-22T05:09:03.967208+0000","last_unstale":"2024-01-22T05:09:03.973156+0000","last_undegraded":"2024-01-22T05:09:03.973156+0000","last_fullsized":"2024-01-22T05:09:03.973156+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.953921+0000","last_change":"2024-01-22T05:09:03.505761+0000","last_active":"2024-01-22T05:09:03.953921+0000","last_peered":"2024-01-22T05:09:03.953921+0000","last_clean":"2024-01-22T05:09:03.953921+0000","last_became_active":"2024-01-22T05:09:03.505470+0000","last_became_peered":"2024-01-22T05:09:03.505470+0000","last_unstale":"2024-01-22T05:09:03.953921+0000","last_undegraded":"2024-01-22T05:09:03.953921+0000","last_fullsized":"2024-01-22T05:09:03.953921+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.976783+0000","last_change":"2024-01-22T05:09:03.970751+0000","last_active":"2024-01-22T05:09:03.976783+0000","last_peered":"2024-01-22T05:09:03.976783+0000","last_clean":"2024-01-22T05:09:03.976783+0000","last_became_active":"2024-01-22T05:09:03.970492+0000","last_became_peered":"2024-01-22T05:09:03.970492+0000","last_unstale":"2024-01-22T05:09:03.976783+0000","last_undegraded":"2024-01-22T05:09:03.976783+0000","last_fullsized":"2024-01-22T05:09:03.976783+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982923+0000","last_change":"2024-01-22T05:09:03.507225+0000","last_active":"2024-01-22T05:09:03.982923+0000","last_peered":"2024-01-22T05:09:03.982923+0000","last_clean":"2024-01-22T05:09:03.982923+0000","last_became_active":"2024-01-22T05:09:03.506934+0000","last_became_peered":"2024-01-22T05:09:03.506934+0000","last_unstale":"2024-01-22T05:09:03.982923+0000","last_undegraded":"2024-01-22T05:09:03.982923+0000","last_fullsized":"2024-01-22T05:09:03.982923+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.980072+0000","last_change":"2024-01-22T05:09:03.976483+0000","last_active":"2024-01-22T05:09:03.980072+0000","last_peered":"2024-01-22T05:09:03.980072+0000","last_clean":"2024-01-22T05:09:03.980072+0000","last_became_active":"2024-01-22T05:09:03.976186+0000","last_became_peered":"2024-01-22T05:09:03.976186+0000","last_unstale":"2024-01-22T05:09:03.980072+0000","last_undegraded":"2024-01-22T05:09:03.980072+0000","last_fullsized":"2024-01-22T05:09:03.980072+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3b","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.976303+0000","last_change":"2024-01-22T05:09:03.509436+0000","last_active":"2024-01-22T05:09:03.976303+0000","last_peered":"2024-01-22T05:09:03.976303+0000","last_clean":"2024-01-22T05:09:03.976303+0000","last_became_active":"2024-01-22T05:09:03.509164+0000","last_became_peered":"2024-01-22T05:09:03.509164+0000","last_unstale":"2024-01-22T05:09:03.976303+0000","last_undegraded":"2024-01-22T05:09:03.976303+0000","last_fullsized":"2024-01-22T05:09:03.976303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982497+0000","last_change":"2024-01-22T05:09:03.973411+0000","last_active":"2024-01-22T05:09:03.982497+0000","last_peered":"2024-01-22T05:09:03.982497+0000","last_clean":"2024-01-22T05:09:03.982497+0000","last_became_active":"2024-01-22T05:09:03.973122+0000","last_became_peered":"2024-01-22T05:09:03.973122+0000","last_unstale":"2024-01-22T05:09:03.982497+0000","last_undegraded":"2024-01-22T05:09:03.982497+0000","last_fullsized":"2024-01-22T05:09:03.982497+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3a","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.978300+0000","last_change":"2024-01-22T05:09:03.501069+0000","last_active":"2024-01-22T05:09:03.978300+0000","last_peered":"2024-01-22T05:09:03.978300+0000","last_clean":"2024-01-22T05:09:03.978300+0000","last_became_active":"2024-01-22T05:09:03.500772+0000","last_became_peered":"2024-01-22T05:09:03.500772+0000","last_unstale":"2024-01-22T05:09:03.978300+0000","last_undegraded":"2024-01-22T05:09:03.978300+0000","last_fullsized":"2024-01-22T05:09:03.978300+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981064+0000","last_change":"2024-01-22T05:09:03.977745+0000","last_active":"2024-01-22T05:09:03.981064+0000","last_peered":"2024-01-22T05:09:03.981064+0000","last_clean":"2024-01-22T05:09:03.981064+0000","last_became_active":"2024-01-22T05:09:03.975823+0000","last_became_peered":"2024-01-22T05:09:03.975823+0000","last_unstale":"2024-01-22T05:09:03.981064+0000","last_undegraded":"2024-01-22T05:09:03.981064+0000","last_fullsized":"2024-01-22T05:09:03.981064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.943010+0000","last_change":"2024-01-22T05:09:03.497153+0000","last_active":"2024-01-22T05:09:03.943010+0000","last_peered":"2024-01-22T05:09:03.943010+0000","last_clean":"2024-01-22T05:09:03.943010+0000","last_became_active":"2024-01-22T05:09:03.496881+0000","last_became_peered":"2024-01-22T05:09:03.496881+0000","last_unstale":"2024-01-22T05:09:03.943010+0000","last_undegraded":"2024-01-22T05:09:03.943010+0000","last_fullsized":"2024-01-22T05:09:03.943010+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.973260+0000","last_change":"2024-01-22T05:09:03.966375+0000","last_active":"2024-01-22T05:09:03.973260+0000","last_peered":"2024-01-22T05:09:03.973260+0000","last_clean":"2024-01-22T05:09:03.973260+0000","last_became_active":"2024-01-22T05:09:03.966074+0000","last_became_peered":"2024-01-22T05:09:03.966074+0000","last_unstale":"2024-01-22T05:09:03.973260+0000","last_undegraded":"2024-01-22T05:09:03.973260+0000","last_fullsized":"2024-01-22T05:09:03.973260+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.942997+0000","last_change":"2024-01-22T05:09:03.494154+0000","last_active":"2024-01-22T05:09:03.942997+0000","last_peered":"2024-01-22T05:09:03.942997+0000","last_clean":"2024-01-22T05:09:03.942997+0000","last_became_active":"2024-01-22T05:09:03.493867+0000","last_became_peered":"2024-01-22T05:09:03.493867+0000","last_unstale":"2024-01-22T05:09:03.942997+0000","last_undegraded":"2024-01-22T05:09:03.942997+0000","last_fullsized":"2024-01-22T05:09:03.942997+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.970970+0000","last_change":"2024-01-22T05:09:03.963030+0000","last_active":"2024-01-22T05:09:03.970970+0000","last_peered":"2024-01-22T05:09:03.970970+0000","last_clean":"2024-01-22T05:09:03.970970+0000","last_became_active":"2024-01-22T05:09:03.960231+0000","last_became_peered":"2024-01-22T05:09:03.960231+0000","last_unstale":"2024-01-22T05:09:03.970970+0000","last_undegraded":"2024-01-22T05:09:03.970970+0000","last_fullsized":"2024-01-22T05:09:03.970970+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.952407+0000","last_change":"2024-01-22T05:09:03.515573+0000","last_active":"2024-01-22T05:09:03.952407+0000","last_peered":"2024-01-22T05:09:03.952407+0000","last_clean":"2024-01-22T05:09:03.952407+0000","last_became_active":"2024-01-22T05:09:03.515283+0000","last_became_peered":"2024-01-22T05:09:03.515283+0000","last_unstale":"2024-01-22T05:09:03.952407+0000","last_undegraded":"2024-01-22T05:09:03.952407+0000","last_fullsized":"2024-01-22T05:09:03.952407+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.978033+0000","last_change":"2024-01-22T05:09:03.967133+0000","last_active":"2024-01-22T05:09:03.978033+0000","last_peered":"2024-01-22T05:09:03.978033+0000","last_clean":"2024-01-22T05:09:03.978033+0000","last_became_active":"2024-01-22T05:09:03.966502+0000","last_became_peered":"2024-01-22T05:09:03.966502+0000","last_unstale":"2024-01-22T05:09:03.978033+0000","last_undegraded":"2024-01-22T05:09:03.978033+0000","last_fullsized":"2024-01-22T05:09:03.978033+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.952408+0000","last_change":"2024-01-22T05:09:03.514236+0000","last_active":"2024-01-22T05:09:03.952408+0000","last_peered":"2024-01-22T05:09:03.952408+0000","last_clean":"2024-01-22T05:09:03.952408+0000","last_became_active":"2024-01-22T05:09:03.513981+0000","last_became_peered":"2024-01-22T05:09:03.513981+0000","last_unstale":"2024-01-22T05:09:03.952408+0000","last_undegraded":"2024-01-22T05:09:03.952408+0000","last_fullsized":"2024-01-22T05:09:03.952408+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971829+0000","last_change":"2024-01-22T05:09:03.967428+0000","last_active":"2024-01-22T05:09:03.971829+0000","last_peered":"2024-01-22T05:09:03.971829+0000","last_clean":"2024-01-22T05:09:03.971829+0000","last_became_active":"2024-01-22T05:09:03.967030+0000","last_became_peered":"2024-01-22T05:09:03.967030+0000","last_unstale":"2024-01-22T05:09:03.971829+0000","last_undegraded":"2024-01-22T05:09:03.971829+0000","last_fullsized":"2024-01-22T05:09:03.971829+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.944981+0000","last_change":"2024-01-22T05:09:03.504508+0000","last_active":"2024-01-22T05:09:03.944981+0000","last_peered":"2024-01-22T05:09:03.944981+0000","last_clean":"2024-01-22T05:09:03.944981+0000","last_became_active":"2024-01-22T05:09:03.504238+0000","last_became_peered":"2024-01-22T05:09:03.504238+0000","last_unstale":"2024-01-22T05:09:03.944981+0000","last_undegraded":"2024-01-22T05:09:03.944981+0000","last_fullsized":"2024-01-22T05:09:03.944981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981462+0000","last_change":"2024-01-22T05:09:03.968371+0000","last_active":"2024-01-22T05:09:03.981462+0000","last_peered":"2024-01-22T05:09:03.981462+0000","last_clean":"2024-01-22T05:09:03.981462+0000","last_became_active":"2024-01-22T05:09:03.967725+0000","last_became_peered":"2024-01-22T05:09:03.967725+0000","last_unstale":"2024-01-22T05:09:03.981462+0000","last_undegraded":"2024-01-22T05:09:03.981462+0000","last_fullsized":"2024-01-22T05:09:03.981462+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.34","version":"69'4","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.985295+0000","last_change":"2024-01-22T05:09:03.505540+0000","last_active":"2024-01-22T05:09:03.985295+0000","last_peered":"2024-01-22T05:09:03.985295+0000","last_clean":"2024-01-22T05:09:03.985295+0000","last_became_active":"2024-01-22T05:09:03.505212+0000","last_became_peered":"2024-01-22T05:09:03.505212+0000","last_unstale":"2024-01-22T05:09:03.985295+0000","last_undegraded":"2024-01-22T05:09:03.985295+0000","last_fullsized":"2024-01-22T05:09:03.985295+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.961201+0000","last_change":"2024-01-22T05:09:03.956080+0000","last_active":"2024-01-22T05:09:03.961201+0000","last_peered":"2024-01-22T05:09:03.961201+0000","last_clean":"2024-01-22T05:09:03.961201+0000","last_became_active":"2024-01-22T05:09:03.955814+0000","last_became_peered":"2024-01-22T05:09:03.955814+0000","last_unstale":"2024-01-22T05:09:03.961201+0000","last_undegraded":"2024-01-22T05:09:03.961201+0000","last_fullsized":"2024-01-22T05:09:03.961201+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.979410+0000","last_change":"2024-01-22T05:09:03.493804+0000","last_active":"2024-01-22T05:09:03.979410+0000","last_peered":"2024-01-22T05:09:03.979410+0000","last_clean":"2024-01-22T05:09:03.979410+0000","last_became_active":"2024-01-22T05:09:03.493509+0000","last_became_peered":"2024-01-22T05:09:03.493509+0000","last_unstale":"2024-01-22T05:09:03.979410+0000","last_undegraded":"2024-01-22T05:09:03.979410+0000","last_fullsized":"2024-01-22T05:09:03.979410+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982705+0000","last_change":"2024-01-22T05:09:03.978970+0000","last_active":"2024-01-22T05:09:03.982705+0000","last_peered":"2024-01-22T05:09:03.982705+0000","last_clean":"2024-01-22T05:09:03.982705+0000","last_became_active":"2024-01-22T05:09:03.978675+0000","last_became_peered":"2024-01-22T05:09:03.978675+0000","last_unstale":"2024-01-22T05:09:03.982705+0000","last_undegraded":"2024-01-22T05:09:03.982705+0000","last_fullsized":"2024-01-22T05:09:03.982705+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.956219+0000","last_change":"2024-01-22T05:09:03.502717+0000","last_active":"2024-01-22T05:09:03.956219+0000","last_peered":"2024-01-22T05:09:03.956219+0000","last_clean":"2024-01-22T05:09:03.956219+0000","last_became_active":"2024-01-22T05:09:03.502441+0000","last_became_peered":"2024-01-22T05:09:03.502441+0000","last_unstale":"2024-01-22T05:09:03.956219+0000","last_undegraded":"2024-01-22T05:09:03.956219+0000","last_fullsized":"2024-01-22T05:09:03.956219+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.974789+0000","last_change":"2024-01-22T05:09:03.965177+0000","last_active":"2024-01-22T05:09:03.974789+0000","last_peered":"2024-01-22T05:09:03.974789+0000","last_clean":"2024-01-22T05:09:03.974789+0000","last_became_active":"2024-01-22T05:09:03.964846+0000","last_became_peered":"2024-01-22T05:09:03.964846+0000","last_unstale":"2024-01-22T05:09:03.974789+0000","last_undegraded":"2024-01-22T05:09:03.974789+0000","last_fullsized":"2024-01-22T05:09:03.974789+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.957253+0000","last_change":"2024-01-22T05:09:03.507523+0000","last_active":"2024-01-22T05:09:03.957253+0000","last_peered":"2024-01-22T05:09:03.957253+0000","last_clean":"2024-01-22T05:09:03.957253+0000","last_became_active":"2024-01-22T05:09:03.507190+0000","last_became_peered":"2024-01-22T05:09:03.507190+0000","last_unstale":"2024-01-22T05:09:03.957253+0000","last_undegraded":"2024-01-22T05:09:03.957253+0000","last_fullsized":"2024-01-22T05:09:03.957253+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982758+0000","last_change":"2024-01-22T05:09:03.979172+0000","last_active":"2024-01-22T05:09:03.982758+0000","last_peered":"2024-01-22T05:09:03.982758+0000","last_clean":"2024-01-22T05:09:03.982758+0000","last_became_active":"2024-01-22T05:09:03.978899+0000","last_became_peered":"2024-01-22T05:09:03.978899+0000","last_unstale":"2024-01-22T05:09:03.982758+0000","last_undegraded":"2024-01-22T05:09:03.982758+0000","last_fullsized":"2024-01-22T05:09:03.982758+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.30","version":"69'4","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.985688+0000","last_change":"2024-01-22T05:09:03.491444+0000","last_active":"2024-01-22T05:09:03.985688+0000","last_peered":"2024-01-22T05:09:03.985688+0000","last_clean":"2024-01-22T05:09:03.985688+0000","last_became_active":"2024-01-22T05:09:03.491120+0000","last_became_peered":"2024-01-22T05:09:03.491120+0000","last_unstale":"2024-01-22T05:09:03.985688+0000","last_undegraded":"2024-01-22T05:09:03.985688+0000","last_fullsized":"2024-01-22T05:09:03.985688+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971762+0000","last_change":"2024-01-22T05:09:03.964493+0000","last_active":"2024-01-22T05:09:03.971762+0000","last_peered":"2024-01-22T05:09:03.971762+0000","last_clean":"2024-01-22T05:09:03.971762+0000","last_became_active":"2024-01-22T05:09:03.964213+0000","last_became_peered":"2024-01-22T05:09:03.964213+0000","last_unstale":"2024-01-22T05:09:03.971762+0000","last_undegraded":"2024-01-22T05:09:03.971762+0000","last_fullsized":"2024-01-22T05:09:03.971762+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.949139+0000","last_change":"2024-01-22T05:09:03.513162+0000","last_active":"2024-01-22T05:09:03.949139+0000","last_peered":"2024-01-22T05:09:03.949139+0000","last_clean":"2024-01-22T05:09:03.949139+0000","last_became_active":"2024-01-22T05:09:03.512438+0000","last_became_peered":"2024-01-22T05:09:03.512438+0000","last_unstale":"2024-01-22T05:09:03.949139+0000","last_undegraded":"2024-01-22T05:09:03.949139+0000","last_fullsized":"2024-01-22T05:09:03.949139+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.978017+0000","last_change":"2024-01-22T05:09:03.966920+0000","last_active":"2024-01-22T05:09:03.978017+0000","last_peered":"2024-01-22T05:09:03.978017+0000","last_clean":"2024-01-22T05:09:03.978017+0000","last_became_active":"2024-01-22T05:09:03.966176+0000","last_became_peered":"2024-01-22T05:09:03.966176+0000","last_unstale":"2024-01-22T05:09:03.978017+0000","last_undegraded":"2024-01-22T05:09:03.978017+0000","last_fullsized":"2024-01-22T05:09:03.978017+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.948120+0000","last_change":"2024-01-22T05:09:03.505468+0000","last_active":"2024-01-22T05:09:03.948120+0000","last_peered":"2024-01-22T05:09:03.948120+0000","last_clean":"2024-01-22T05:09:03.948120+0000","last_became_active":"2024-01-22T05:09:03.505170+0000","last_became_peered":"2024-01-22T05:09:03.505170+0000","last_unstale":"2024-01-22T05:09:03.948120+0000","last_undegraded":"2024-01-22T05:09:03.948120+0000","last_fullsized":"2024-01-22T05:09:03.948120+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971043+0000","last_change":"2024-01-22T05:09:03.963641+0000","last_active":"2024-01-22T05:09:03.971043+0000","last_peered":"2024-01-22T05:09:03.971043+0000","last_clean":"2024-01-22T05:09:03.971043+0000","last_became_active":"2024-01-22T05:09:03.963355+0000","last_became_peered":"2024-01-22T05:09:03.963355+0000","last_unstale":"2024-01-22T05:09:03.971043+0000","last_undegraded":"2024-01-22T05:09:03.971043+0000","last_fullsized":"2024-01-22T05:09:03.971043+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2d","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982958+0000","last_change":"2024-01-22T05:09:03.496651+0000","last_active":"2024-01-22T05:09:03.982958+0000","last_peered":"2024-01-22T05:09:03.982958+0000","last_clean":"2024-01-22T05:09:03.982958+0000","last_became_active":"2024-01-22T05:09:03.496364+0000","last_became_peered":"2024-01-22T05:09:03.496364+0000","last_unstale":"2024-01-22T05:09:03.982958+0000","last_undegraded":"2024-01-22T05:09:03.982958+0000","last_fullsized":"2024-01-22T05:09:03.982958+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.980150+0000","last_change":"2024-01-22T05:09:03.976739+0000","last_active":"2024-01-22T05:09:03.980150+0000","last_peered":"2024-01-22T05:09:03.980150+0000","last_clean":"2024-01-22T05:09:03.980150+0000","last_became_active":"2024-01-22T05:09:03.975806+0000","last_became_peered":"2024-01-22T05:09:03.975806+0000","last_unstale":"2024-01-22T05:09:03.980150+0000","last_undegraded":"2024-01-22T05:09:03.980150+0000","last_fullsized":"2024-01-22T05:09:03.980150+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.961151+0000","last_change":"2024-01-22T05:09:03.514515+0000","last_active":"2024-01-22T05:09:03.961151+0000","last_peered":"2024-01-22T05:09:03.961151+0000","last_clean":"2024-01-22T05:09:03.961151+0000","last_became_active":"2024-01-22T05:09:03.514221+0000","last_became_peered":"2024-01-22T05:09:03.514221+0000","last_unstale":"2024-01-22T05:09:03.961151+0000","last_undegraded":"2024-01-22T05:09:03.961151+0000","last_fullsized":"2024-01-22T05:09:03.961151+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.963762+0000","last_change":"2024-01-22T05:09:03.958013+0000","last_active":"2024-01-22T05:09:03.963762+0000","last_peered":"2024-01-22T05:09:03.963762+0000","last_clean":"2024-01-22T05:09:03.963762+0000","last_became_active":"2024-01-22T05:09:03.957720+0000","last_became_peered":"2024-01-22T05:09:03.957720+0000","last_unstale":"2024-01-22T05:09:03.963762+0000","last_undegraded":"2024-01-22T05:09:03.963762+0000","last_fullsized":"2024-01-22T05:09:03.963762+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.970678+0000","last_change":"2024-01-22T05:09:03.496421+0000","last_active":"2024-01-22T05:09:03.970678+0000","last_peered":"2024-01-22T05:09:03.970678+0000","last_clean":"2024-01-22T05:09:03.970678+0000","last_became_active":"2024-01-22T05:09:03.495961+0000","last_became_peered":"2024-01-22T05:09:03.495961+0000","last_unstale":"2024-01-22T05:09:03.970678+0000","last_undegraded":"2024-01-22T05:09:03.970678+0000","last_fullsized":"2024-01-22T05:09:03.970678+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.963731+0000","last_change":"2024-01-22T05:09:03.957900+0000","last_active":"2024-01-22T05:09:03.963731+0000","last_peered":"2024-01-22T05:09:03.963731+0000","last_clean":"2024-01-22T05:09:03.963731+0000","last_became_active":"2024-01-22T05:09:03.953229+0000","last_became_peered":"2024-01-22T05:09:03.953229+0000","last_unstale":"2024-01-22T05:09:03.963731+0000","last_undegraded":"2024-01-22T05:09:03.963731+0000","last_fullsized":"2024-01-22T05:09:03.963731+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.962962+0000","last_change":"2024-01-22T05:09:03.509134+0000","last_active":"2024-01-22T05:09:03.962962+0000","last_peered":"2024-01-22T05:09:03.962962+0000","last_clean":"2024-01-22T05:09:03.962962+0000","last_became_active":"2024-01-22T05:09:03.508843+0000","last_became_peered":"2024-01-22T05:09:03.508843+0000","last_unstale":"2024-01-22T05:09:03.962962+0000","last_undegraded":"2024-01-22T05:09:03.962962+0000","last_fullsized":"2024-01-22T05:09:03.962962+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.984370+0000","last_change":"2024-01-22T05:09:03.980375+0000","last_active":"2024-01-22T05:09:03.984370+0000","last_peered":"2024-01-22T05:09:03.984370+0000","last_clean":"2024-01-22T05:09:03.984370+0000","last_became_active":"2024-01-22T05:09:03.980075+0000","last_became_peered":"2024-01-22T05:09:03.980075+0000","last_unstale":"2024-01-22T05:09:03.984370+0000","last_undegraded":"2024-01-22T05:09:03.984370+0000","last_fullsized":"2024-01-22T05:09:03.984370+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.961269+0000","last_change":"2024-01-22T05:09:03.508096+0000","last_active":"2024-01-22T05:09:03.961269+0000","last_peered":"2024-01-22T05:09:03.961269+0000","last_clean":"2024-01-22T05:09:03.961269+0000","last_became_active":"2024-01-22T05:09:03.507815+0000","last_became_peered":"2024-01-22T05:09:03.507815+0000","last_unstale":"2024-01-22T05:09:03.961269+0000","last_undegraded":"2024-01-22T05:09:03.961269+0000","last_fullsized":"2024-01-22T05:09:03.961269+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.984305+0000","last_change":"2024-01-22T05:09:03.977690+0000","last_active":"2024-01-22T05:09:03.984305+0000","last_peered":"2024-01-22T05:09:03.984305+0000","last_clean":"2024-01-22T05:09:03.984305+0000","last_became_active":"2024-01-22T05:09:03.977406+0000","last_became_peered":"2024-01-22T05:09:03.977406+0000","last_unstale":"2024-01-22T05:09:03.984305+0000","last_undegraded":"2024-01-22T05:09:03.984305+0000","last_fullsized":"2024-01-22T05:09:03.984305+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.955496+0000","last_change":"2024-01-22T05:09:03.504031+0000","last_active":"2024-01-22T05:09:03.955496+0000","last_peered":"2024-01-22T05:09:03.955496+0000","last_clean":"2024-01-22T05:09:03.955496+0000","last_became_active":"2024-01-22T05:09:03.503714+0000","last_became_peered":"2024-01-22T05:09:03.503714+0000","last_unstale":"2024-01-22T05:09:03.955496+0000","last_undegraded":"2024-01-22T05:09:03.955496+0000","last_fullsized":"2024-01-22T05:09:03.955496+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971277+0000","last_change":"2024-01-22T05:09:03.964332+0000","last_active":"2024-01-22T05:09:03.971277+0000","last_peered":"2024-01-22T05:09:03.971277+0000","last_clean":"2024-01-22T05:09:03.971277+0000","last_became_active":"2024-01-22T05:09:03.963998+0000","last_became_peered":"2024-01-22T05:09:03.963998+0000","last_unstale":"2024-01-22T05:09:03.971277+0000","last_undegraded":"2024-01-22T05:09:03.971277+0000","last_fullsized":"2024-01-22T05:09:03.971277+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.947510+0000","last_change":"2024-01-22T05:09:03.496201+0000","last_active":"2024-01-22T05:09:03.947510+0000","last_peered":"2024-01-22T05:09:03.947510+0000","last_clean":"2024-01-22T05:09:03.947510+0000","last_became_active":"2024-01-22T05:09:03.495878+0000","last_became_peered":"2024-01-22T05:09:03.495878+0000","last_unstale":"2024-01-22T05:09:03.947510+0000","last_undegraded":"2024-01-22T05:09:03.947510+0000","last_fullsized":"2024-01-22T05:09:03.947510+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.974907+0000","last_change":"2024-01-22T05:09:03.972417+0000","last_active":"2024-01-22T05:09:03.974907+0000","last_peered":"2024-01-22T05:09:03.974907+0000","last_clean":"2024-01-22T05:09:03.974907+0000","last_became_active":"2024-01-22T05:09:03.972094+0000","last_became_peered":"2024-01-22T05:09:03.972094+0000","last_unstale":"2024-01-22T05:09:03.974907+0000","last_undegraded":"2024-01-22T05:09:03.974907+0000","last_fullsized":"2024-01-22T05:09:03.974907+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.951153+0000","last_change":"2024-01-22T05:09:03.488075+0000","last_active":"2024-01-22T05:09:03.951153+0000","last_peered":"2024-01-22T05:09:03.951153+0000","last_clean":"2024-01-22T05:09:03.951153+0000","last_became_active":"2024-01-22T05:09:03.487800+0000","last_became_peered":"2024-01-22T05:09:03.487800+0000","last_unstale":"2024-01-22T05:09:03.951153+0000","last_undegraded":"2024-01-22T05:09:03.951153+0000","last_fullsized":"2024-01-22T05:09:03.951153+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.970783+0000","last_change":"2024-01-22T05:09:03.962856+0000","last_active":"2024-01-22T05:09:03.970783+0000","last_peered":"2024-01-22T05:09:03.970783+0000","last_clean":"2024-01-22T05:09:03.970783+0000","last_became_active":"2024-01-22T05:09:03.962269+0000","last_became_peered":"2024-01-22T05:09:03.962269+0000","last_unstale":"2024-01-22T05:09:03.970783+0000","last_undegraded":"2024-01-22T05:09:03.970783+0000","last_fullsized":"2024-01-22T05:09:03.970783+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.945307+0000","last_change":"2024-01-22T05:09:03.509483+0000","last_active":"2024-01-22T05:09:03.945307+0000","last_peered":"2024-01-22T05:09:03.945307+0000","last_clean":"2024-01-22T05:09:03.945307+0000","last_became_active":"2024-01-22T05:09:03.508479+0000","last_became_peered":"2024-01-22T05:09:03.508479+0000","last_unstale":"2024-01-22T05:09:03.945307+0000","last_undegraded":"2024-01-22T05:09:03.945307+0000","last_fullsized":"2024-01-22T05:09:03.945307+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981615+0000","last_change":"2024-01-22T05:09:03.974606+0000","last_active":"2024-01-22T05:09:03.981615+0000","last_peered":"2024-01-22T05:09:03.981615+0000","last_clean":"2024-01-22T05:09:03.981615+0000","last_became_active":"2024-01-22T05:09:03.973176+0000","last_became_peered":"2024-01-22T05:09:03.973176+0000","last_unstale":"2024-01-22T05:09:03.981615+0000","last_undegraded":"2024-01-22T05:09:03.981615+0000","last_fullsized":"2024-01-22T05:09:03.981615+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.950346+0000","last_change":"2024-01-22T05:09:03.500528+0000","last_active":"2024-01-22T05:09:03.950346+0000","last_peered":"2024-01-22T05:09:03.950346+0000","last_clean":"2024-01-22T05:09:03.950346+0000","last_became_active":"2024-01-22T05:09:03.500217+0000","last_became_peered":"2024-01-22T05:09:03.500217+0000","last_unstale":"2024-01-22T05:09:03.950346+0000","last_undegraded":"2024-01-22T05:09:03.950346+0000","last_fullsized":"2024-01-22T05:09:03.950346+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.966556+0000","last_change":"2024-01-22T05:09:03.964286+0000","last_active":"2024-01-22T05:09:03.966556+0000","last_peered":"2024-01-22T05:09:03.966556+0000","last_clean":"2024-01-22T05:09:03.966556+0000","last_became_active":"2024-01-22T05:09:03.964007+0000","last_became_peered":"2024-01-22T05:09:03.964007+0000","last_unstale":"2024-01-22T05:09:03.966556+0000","last_undegraded":"2024-01-22T05:09:03.966556+0000","last_fullsized":"2024-01-22T05:09:03.966556+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.957032+0000","last_change":"2024-01-22T05:09:03.513699+0000","last_active":"2024-01-22T05:09:03.957032+0000","last_peered":"2024-01-22T05:09:03.957032+0000","last_clean":"2024-01-22T05:09:03.957032+0000","last_became_active":"2024-01-22T05:09:03.513406+0000","last_became_peered":"2024-01-22T05:09:03.513406+0000","last_unstale":"2024-01-22T05:09:03.957032+0000","last_undegraded":"2024-01-22T05:09:03.957032+0000","last_fullsized":"2024-01-22T05:09:03.957032+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.964147+0000","last_change":"2024-01-22T05:09:03.961297+0000","last_active":"2024-01-22T05:09:03.964147+0000","last_peered":"2024-01-22T05:09:03.964147+0000","last_clean":"2024-01-22T05:09:03.964147+0000","last_became_active":"2024-01-22T05:09:03.960909+0000","last_became_peered":"2024-01-22T05:09:03.960909+0000","last_unstale":"2024-01-22T05:09:03.964147+0000","last_undegraded":"2024-01-22T05:09:03.964147+0000","last_fullsized":"2024-01-22T05:09:03.964147+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.945037+0000","last_change":"2024-01-22T05:09:03.496139+0000","last_active":"2024-01-22T05:09:03.945037+0000","last_peered":"2024-01-22T05:09:03.945037+0000","last_clean":"2024-01-22T05:09:03.945037+0000","last_became_active":"2024-01-22T05:09:03.495809+0000","last_became_peered":"2024-01-22T05:09:03.495809+0000","last_unstale":"2024-01-22T05:09:03.945037+0000","last_undegraded":"2024-01-22T05:09:03.945037+0000","last_fullsized":"2024-01-22T05:09:03.945037+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.974665+0000","last_change":"2024-01-22T05:09:03.961741+0000","last_active":"2024-01-22T05:09:03.974665+0000","last_peered":"2024-01-22T05:09:03.974665+0000","last_clean":"2024-01-22T05:09:03.974665+0000","last_became_active":"2024-01-22T05:09:03.961425+0000","last_became_peered":"2024-01-22T05:09:03.961425+0000","last_unstale":"2024-01-22T05:09:03.974665+0000","last_undegraded":"2024-01-22T05:09:03.974665+0000","last_fullsized":"2024-01-22T05:09:03.974665+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.945096+0000","last_change":"2024-01-22T05:09:03.502585+0000","last_active":"2024-01-22T05:09:03.945096+0000","last_peered":"2024-01-22T05:09:03.945096+0000","last_clean":"2024-01-22T05:09:03.945096+0000","last_became_active":"2024-01-22T05:09:03.501407+0000","last_became_peered":"2024-01-22T05:09:03.501407+0000","last_unstale":"2024-01-22T05:09:03.945096+0000","last_undegraded":"2024-01-22T05:09:03.945096+0000","last_fullsized":"2024-01-22T05:09:03.945096+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.956188+0000","last_change":"2024-01-22T05:09:03.955140+0000","last_active":"2024-01-22T05:09:03.956188+0000","last_peered":"2024-01-22T05:09:03.956188+0000","last_clean":"2024-01-22T05:09:03.956188+0000","last_became_active":"2024-01-22T05:09:03.954860+0000","last_became_peered":"2024-01-22T05:09:03.954860+0000","last_unstale":"2024-01-22T05:09:03.956188+0000","last_undegraded":"2024-01-22T05:09:03.956188+0000","last_fullsized":"2024-01-22T05:09:03.956188+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.950223+0000","last_change":"2024-01-22T05:09:03.492222+0000","last_active":"2024-01-22T05:09:03.950223+0000","last_peered":"2024-01-22T05:09:03.950223+0000","last_clean":"2024-01-22T05:09:03.950223+0000","last_became_active":"2024-01-22T05:09:03.491952+0000","last_became_peered":"2024-01-22T05:09:03.491952+0000","last_unstale":"2024-01-22T05:09:03.950223+0000","last_undegraded":"2024-01-22T05:09:03.950223+0000","last_fullsized":"2024-01-22T05:09:03.950223+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.980876+0000","last_change":"2024-01-22T05:09:03.967468+0000","last_active":"2024-01-22T05:09:03.980876+0000","last_peered":"2024-01-22T05:09:03.980876+0000","last_clean":"2024-01-22T05:09:03.980876+0000","last_became_active":"2024-01-22T05:09:03.967140+0000","last_became_peered":"2024-01-22T05:09:03.967140+0000","last_unstale":"2024-01-22T05:09:03.980876+0000","last_undegraded":"2024-01-22T05:09:03.980876+0000","last_fullsized":"2024-01-22T05:09:03.980876+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.979683+0000","last_change":"2024-01-22T05:09:03.513919+0000","last_active":"2024-01-22T05:09:03.979683+0000","last_peered":"2024-01-22T05:09:03.979683+0000","last_clean":"2024-01-22T05:09:03.979683+0000","last_became_active":"2024-01-22T05:09:03.513010+0000","last_became_peered":"2024-01-22T05:09:03.513010+0000","last_unstale":"2024-01-22T05:09:03.979683+0000","last_undegraded":"2024-01-22T05:09:03.979683+0000","last_fullsized":"2024-01-22T05:09:03.979683+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.977992+0000","last_change":"2024-01-22T05:09:03.966750+0000","last_active":"2024-01-22T05:09:03.977992+0000","last_peered":"2024-01-22T05:09:03.977992+0000","last_clean":"2024-01-22T05:09:03.977992+0000","last_became_active":"2024-01-22T05:09:03.965849+0000","last_became_peered":"2024-01-22T05:09:03.965849+0000","last_unstale":"2024-01-22T05:09:03.977992+0000","last_undegraded":"2024-01-22T05:09:03.977992+0000","last_fullsized":"2024-01-22T05:09:03.977992+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971108+0000","last_change":"2024-01-22T05:09:03.492307+0000","last_active":"2024-01-22T05:09:03.971108+0000","last_peered":"2024-01-22T05:09:03.971108+0000","last_clean":"2024-01-22T05:09:03.971108+0000","last_became_active":"2024-01-22T05:09:03.492028+0000","last_became_peered":"2024-01-22T05:09:03.492028+0000","last_unstale":"2024-01-22T05:09:03.971108+0000","last_undegraded":"2024-01-22T05:09:03.971108+0000","last_fullsized":"2024-01-22T05:09:03.971108+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.978668+0000","last_change":"2024-01-22T05:09:03.974559+0000","last_active":"2024-01-22T05:09:03.978668+0000","last_peered":"2024-01-22T05:09:03.978668+0000","last_clean":"2024-01-22T05:09:03.978668+0000","last_became_active":"2024-01-22T05:09:03.974277+0000","last_became_peered":"2024-01-22T05:09:03.974277+0000","last_unstale":"2024-01-22T05:09:03.978668+0000","last_undegraded":"2024-01-22T05:09:03.978668+0000","last_fullsized":"2024-01-22T05:09:03.978668+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982766+0000","last_change":"2024-01-22T05:09:03.501234+0000","last_active":"2024-01-22T05:09:03.982766+0000","last_peered":"2024-01-22T05:09:03.982766+0000","last_clean":"2024-01-22T05:09:03.982766+0000","last_became_active":"2024-01-22T05:09:03.500947+0000","last_became_peered":"2024-01-22T05:09:03.500947+0000","last_unstale":"2024-01-22T05:09:03.982766+0000","last_undegraded":"2024-01-22T05:09:03.982766+0000","last_fullsized":"2024-01-22T05:09:03.982766+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981484+0000","last_change":"2024-01-22T05:09:03.968555+0000","last_active":"2024-01-22T05:09:03.981484+0000","last_peered":"2024-01-22T05:09:03.981484+0000","last_clean":"2024-01-22T05:09:03.981484+0000","last_became_active":"2024-01-22T05:09:03.968045+0000","last_became_peered":"2024-01-22T05:09:03.968045+0000","last_unstale":"2024-01-22T05:09:03.981484+0000","last_undegraded":"2024-01-22T05:09:03.981484+0000","last_fullsized":"2024-01-22T05:09:03.981484+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.965128+0000","last_change":"2024-01-22T05:09:03.503233+0000","last_active":"2024-01-22T05:09:03.965128+0000","last_peered":"2024-01-22T05:09:03.965128+0000","last_clean":"2024-01-22T05:09:03.965128+0000","last_became_active":"2024-01-22T05:09:03.502708+0000","last_became_peered":"2024-01-22T05:09:03.502708+0000","last_unstale":"2024-01-22T05:09:03.965128+0000","last_undegraded":"2024-01-22T05:09:03.965128+0000","last_fullsized":"2024-01-22T05:09:03.965128+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.966286+0000","last_change":"2024-01-22T05:09:03.962737+0000","last_active":"2024-01-22T05:09:03.966286+0000","last_peered":"2024-01-22T05:09:03.966286+0000","last_clean":"2024-01-22T05:09:03.966286+0000","last_became_active":"2024-01-22T05:09:03.962446+0000","last_became_peered":"2024-01-22T05:09:03.962446+0000","last_unstale":"2024-01-22T05:09:03.966286+0000","last_undegraded":"2024-01-22T05:09:03.966286+0000","last_fullsized":"2024-01-22T05:09:03.966286+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.961501+0000","last_change":"2024-01-22T05:09:03.510449+0000","last_active":"2024-01-22T05:09:03.961501+0000","last_peered":"2024-01-22T05:09:03.961501+0000","last_clean":"2024-01-22T05:09:03.961501+0000","last_became_active":"2024-01-22T05:09:03.510173+0000","last_became_peered":"2024-01-22T05:09:03.510173+0000","last_unstale":"2024-01-22T05:09:03.961501+0000","last_undegraded":"2024-01-22T05:09:03.961501+0000","last_fullsized":"2024-01-22T05:09:03.961501+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981698+0000","last_change":"2024-01-22T05:09:03.974199+0000","last_active":"2024-01-22T05:09:03.981698+0000","last_peered":"2024-01-22T05:09:03.981698+0000","last_clean":"2024-01-22T05:09:03.981698+0000","last_became_active":"2024-01-22T05:09:03.973936+0000","last_became_peered":"2024-01-22T05:09:03.973936+0000","last_unstale":"2024-01-22T05:09:03.981698+0000","last_undegraded":"2024-01-22T05:09:03.981698+0000","last_fullsized":"2024-01-22T05:09:03.981698+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.961862+0000","last_change":"2024-01-22T05:09:03.496943+0000","last_active":"2024-01-22T05:09:03.961862+0000","last_peered":"2024-01-22T05:09:03.961862+0000","last_clean":"2024-01-22T05:09:03.961862+0000","last_became_active":"2024-01-22T05:09:03.493443+0000","last_became_peered":"2024-01-22T05:09:03.493443+0000","last_unstale":"2024-01-22T05:09:03.961862+0000","last_undegraded":"2024-01-22T05:09:03.961862+0000","last_fullsized":"2024-01-22T05:09:03.961862+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.974614+0000","last_change":"2024-01-22T05:09:03.962568+0000","last_active":"2024-01-22T05:09:03.974614+0000","last_peered":"2024-01-22T05:09:03.974614+0000","last_clean":"2024-01-22T05:09:03.974614+0000","last_became_active":"2024-01-22T05:09:03.962307+0000","last_became_peered":"2024-01-22T05:09:03.962307+0000","last_unstale":"2024-01-22T05:09:03.974614+0000","last_undegraded":"2024-01-22T05:09:03.974614+0000","last_fullsized":"2024-01-22T05:09:03.974614+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.949185+0000","last_change":"2024-01-22T05:09:03.512553+0000","last_active":"2024-01-22T05:09:03.949185+0000","last_peered":"2024-01-22T05:09:03.949185+0000","last_clean":"2024-01-22T05:09:03.949185+0000","last_became_active":"2024-01-22T05:09:03.512231+0000","last_became_peered":"2024-01-22T05:09:03.512231+0000","last_unstale":"2024-01-22T05:09:03.949185+0000","last_undegraded":"2024-01-22T05:09:03.949185+0000","last_fullsized":"2024-01-22T05:09:03.949185+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981792+0000","last_change":"2024-01-22T05:09:03.972637+0000","last_active":"2024-01-22T05:09:03.981792+0000","last_peered":"2024-01-22T05:09:03.981792+0000","last_clean":"2024-01-22T05:09:03.981792+0000","last_became_active":"2024-01-22T05:09:03.972310+0000","last_became_peered":"2024-01-22T05:09:03.972310+0000","last_unstale":"2024-01-22T05:09:03.981792+0000","last_undegraded":"2024-01-22T05:09:03.981792+0000","last_fullsized":"2024-01-22T05:09:03.981792+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.944144+0000","last_change":"2024-01-22T05:09:03.493665+0000","last_active":"2024-01-22T05:09:03.944144+0000","last_peered":"2024-01-22T05:09:03.944144+0000","last_clean":"2024-01-22T05:09:03.944144+0000","last_became_active":"2024-01-22T05:09:03.492894+0000","last_became_peered":"2024-01-22T05:09:03.492894+0000","last_unstale":"2024-01-22T05:09:03.944144+0000","last_undegraded":"2024-01-22T05:09:03.944144+0000","last_fullsized":"2024-01-22T05:09:03.944144+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.975465+0000","last_change":"2024-01-22T05:09:03.971579+0000","last_active":"2024-01-22T05:09:03.975465+0000","last_peered":"2024-01-22T05:09:03.975465+0000","last_clean":"2024-01-22T05:09:03.975465+0000","last_became_active":"2024-01-22T05:09:03.971233+0000","last_became_peered":"2024-01-22T05:09:03.971233+0000","last_unstale":"2024-01-22T05:09:03.975465+0000","last_undegraded":"2024-01-22T05:09:03.975465+0000","last_fullsized":"2024-01-22T05:09:03.975465+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.947051+0000","last_change":"2024-01-22T05:09:03.511882+0000","last_active":"2024-01-22T05:09:03.947051+0000","last_peered":"2024-01-22T05:09:03.947051+0000","last_clean":"2024-01-22T05:09:03.947051+0000","last_became_active":"2024-01-22T05:09:03.511591+0000","last_became_peered":"2024-01-22T05:09:03.511591+0000","last_unstale":"2024-01-22T05:09:03.947051+0000","last_undegraded":"2024-01-22T05:09:03.947051+0000","last_fullsized":"2024-01-22T05:09:03.947051+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982723+0000","last_change":"2024-01-22T05:09:03.977147+0000","last_active":"2024-01-22T05:09:03.982723+0000","last_peered":"2024-01-22T05:09:03.982723+0000","last_clean":"2024-01-22T05:09:03.982723+0000","last_became_active":"2024-01-22T05:09:03.976820+0000","last_became_peered":"2024-01-22T05:09:03.976820+0000","last_unstale":"2024-01-22T05:09:03.982723+0000","last_undegraded":"2024-01-22T05:09:03.982723+0000","last_fullsized":"2024-01-22T05:09:03.982723+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.965487+0000","last_change":"2024-01-22T05:09:03.501775+0000","last_active":"2024-01-22T05:09:03.965487+0000","last_peered":"2024-01-22T05:09:03.965487+0000","last_clean":"2024-01-22T05:09:03.965487+0000","last_became_active":"2024-01-22T05:09:03.495377+0000","last_became_peered":"2024-01-22T05:09:03.495377+0000","last_unstale":"2024-01-22T05:09:03.965487+0000","last_undegraded":"2024-01-22T05:09:03.965487+0000","last_fullsized":"2024-01-22T05:09:03.965487+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.976409+0000","last_change":"2024-01-22T05:09:03.964456+0000","last_active":"2024-01-22T05:09:03.976409+0000","last_peered":"2024-01-22T05:09:03.976409+0000","last_clean":"2024-01-22T05:09:03.976409+0000","last_became_active":"2024-01-22T05:09:03.964217+0000","last_became_peered":"2024-01-22T05:09:03.964217+0000","last_unstale":"2024-01-22T05:09:03.976409+0000","last_undegraded":"2024-01-22T05:09:03.976409+0000","last_fullsized":"2024-01-22T05:09:03.976409+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"69'3","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.976818+0000","last_change":"2024-01-22T05:09:03.507874+0000","last_active":"2024-01-22T05:09:03.976818+0000","last_peered":"2024-01-22T05:09:03.976818+0000","last_clean":"2024-01-22T05:09:03.976818+0000","last_became_active":"2024-01-22T05:09:03.507573+0000","last_became_peered":"2024-01-22T05:09:03.507573+0000","last_unstale":"2024-01-22T05:09:03.976818+0000","last_undegraded":"2024-01-22T05:09:03.976818+0000","last_fullsized":"2024-01-22T05:09:03.976818+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.975892+0000","last_change":"2024-01-22T05:09:03.965647+0000","last_active":"2024-01-22T05:09:03.975892+0000","last_peered":"2024-01-22T05:09:03.975892+0000","last_clean":"2024-01-22T05:09:03.975892+0000","last_became_active":"2024-01-22T05:09:03.965352+0000","last_became_peered":"2024-01-22T05:09:03.965352+0000","last_unstale":"2024-01-22T05:09:03.975892+0000","last_undegraded":"2024-01-22T05:09:03.975892+0000","last_fullsized":"2024-01-22T05:09:03.975892+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.979423+0000","last_change":"2024-01-22T05:09:03.492972+0000","last_active":"2024-01-22T05:09:03.979423+0000","last_peered":"2024-01-22T05:09:03.979423+0000","last_clean":"2024-01-22T05:09:03.979423+0000","last_became_active":"2024-01-22T05:09:03.492662+0000","last_became_peered":"2024-01-22T05:09:03.492662+0000","last_unstale":"2024-01-22T05:09:03.979423+0000","last_undegraded":"2024-01-22T05:09:03.979423+0000","last_fullsized":"2024-01-22T05:09:03.979423+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.984296+0000","last_change":"2024-01-22T05:09:03.977025+0000","last_active":"2024-01-22T05:09:03.984296+0000","last_peered":"2024-01-22T05:09:03.984296+0000","last_clean":"2024-01-22T05:09:03.984296+0000","last_became_active":"2024-01-22T05:09:03.976717+0000","last_became_peered":"2024-01-22T05:09:03.976717+0000","last_unstale":"2024-01-22T05:09:03.984296+0000","last_undegraded":"2024-01-22T05:09:03.984296+0000","last_fullsized":"2024-01-22T05:09:03.984296+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.983254+0000","last_change":"2024-01-22T05:09:03.500353+0000","last_active":"2024-01-22T05:09:03.983254+0000","last_peered":"2024-01-22T05:09:03.983254+0000","last_clean":"2024-01-22T05:09:03.983254+0000","last_became_active":"2024-01-22T05:09:03.497957+0000","last_became_peered":"2024-01-22T05:09:03.497957+0000","last_unstale":"2024-01-22T05:09:03.983254+0000","last_undegraded":"2024-01-22T05:09:03.983254+0000","last_fullsized":"2024-01-22T05:09:03.983254+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.974349+0000","last_change":"2024-01-22T05:09:03.970537+0000","last_active":"2024-01-22T05:09:03.974349+0000","last_peered":"2024-01-22T05:09:03.974349+0000","last_clean":"2024-01-22T05:09:03.974349+0000","last_became_active":"2024-01-22T05:09:03.970213+0000","last_became_peered":"2024-01-22T05:09:03.970213+0000","last_unstale":"2024-01-22T05:09:03.974349+0000","last_undegraded":"2024-01-22T05:09:03.974349+0000","last_fullsized":"2024-01-22T05:09:03.974349+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.970611+0000","last_change":"2024-01-22T05:09:03.503541+0000","last_active":"2024-01-22T05:09:03.970611+0000","last_peered":"2024-01-22T05:09:03.970611+0000","last_clean":"2024-01-22T05:09:03.970611+0000","last_became_active":"2024-01-22T05:09:03.497220+0000","last_became_peered":"2024-01-22T05:09:03.497220+0000","last_unstale":"2024-01-22T05:09:03.970611+0000","last_undegraded":"2024-01-22T05:09:03.970611+0000","last_fullsized":"2024-01-22T05:09:03.970611+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971088+0000","last_change":"2024-01-22T05:09:03.963854+0000","last_active":"2024-01-22T05:09:03.971088+0000","last_peered":"2024-01-22T05:09:03.971088+0000","last_clean":"2024-01-22T05:09:03.971088+0000","last_became_active":"2024-01-22T05:09:03.963603+0000","last_became_peered":"2024-01-22T05:09:03.963603+0000","last_unstale":"2024-01-22T05:09:03.971088+0000","last_undegraded":"2024-01-22T05:09:03.971088+0000","last_fullsized":"2024-01-22T05:09:03.971088+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.947454+0000","last_change":"2024-01-22T05:09:03.490868+0000","last_active":"2024-01-22T05:09:03.947454+0000","last_peered":"2024-01-22T05:09:03.947454+0000","last_clean":"2024-01-22T05:09:03.947454+0000","last_became_active":"2024-01-22T05:09:03.490570+0000","last_became_peered":"2024-01-22T05:09:03.490570+0000","last_unstale":"2024-01-22T05:09:03.947454+0000","last_undegraded":"2024-01-22T05:09:03.947454+0000","last_fullsized":"2024-01-22T05:09:03.947454+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.975313+0000","last_change":"2024-01-22T05:09:03.965503+0000","last_active":"2024-01-22T05:09:03.975313+0000","last_peered":"2024-01-22T05:09:03.975313+0000","last_clean":"2024-01-22T05:09:03.975313+0000","last_became_active":"2024-01-22T05:09:03.965233+0000","last_became_peered":"2024-01-22T05:09:03.965233+0000","last_unstale":"2024-01-22T05:09:03.975313+0000","last_undegraded":"2024-01-22T05:09:03.975313+0000","last_fullsized":"2024-01-22T05:09:03.975313+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"69'4","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982035+0000","last_change":"2024-01-22T05:09:03.509564+0000","last_active":"2024-01-22T05:09:03.982035+0000","last_peered":"2024-01-22T05:09:03.982035+0000","last_clean":"2024-01-22T05:09:03.982035+0000","last_became_active":"2024-01-22T05:09:03.506921+0000","last_became_peered":"2024-01-22T05:09:03.506921+0000","last_unstale":"2024-01-22T05:09:03.982035+0000","last_undegraded":"2024-01-22T05:09:03.982035+0000","last_fullsized":"2024-01-22T05:09:03.982035+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981752+0000","last_change":"2024-01-22T05:09:03.971662+0000","last_active":"2024-01-22T05:09:03.981752+0000","last_peered":"2024-01-22T05:09:03.981752+0000","last_clean":"2024-01-22T05:09:03.981752+0000","last_became_active":"2024-01-22T05:09:03.971348+0000","last_became_peered":"2024-01-22T05:09:03.971348+0000","last_unstale":"2024-01-22T05:09:03.981752+0000","last_undegraded":"2024-01-22T05:09:03.981752+0000","last_fullsized":"2024-01-22T05:09:03.981752+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.984057+0000","last_change":"2024-01-22T05:09:03.513276+0000","last_active":"2024-01-22T05:09:03.984057+0000","last_peered":"2024-01-22T05:09:03.984057+0000","last_clean":"2024-01-22T05:09:03.984057+0000","last_became_active":"2024-01-22T05:09:03.512823+0000","last_became_peered":"2024-01-22T05:09:03.512823+0000","last_unstale":"2024-01-22T05:09:03.984057+0000","last_undegraded":"2024-01-22T05:09:03.984057+0000","last_fullsized":"2024-01-22T05:09:03.984057+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.973289+0000","last_change":"2024-01-22T05:09:03.966322+0000","last_active":"2024-01-22T05:09:03.973289+0000","last_peered":"2024-01-22T05:09:03.973289+0000","last_clean":"2024-01-22T05:09:03.973289+0000","last_became_active":"2024-01-22T05:09:03.966013+0000","last_became_peered":"2024-01-22T05:09:03.966013+0000","last_unstale":"2024-01-22T05:09:03.973289+0000","last_undegraded":"2024-01-22T05:09:03.973289+0000","last_fullsized":"2024-01-22T05:09:03.973289+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.951273+0000","last_change":"2024-01-22T05:09:03.502186+0000","last_active":"2024-01-22T05:09:03.951273+0000","last_peered":"2024-01-22T05:09:03.951273+0000","last_clean":"2024-01-22T05:09:03.951273+0000","last_became_active":"2024-01-22T05:09:03.500679+0000","last_became_peered":"2024-01-22T05:09:03.500679+0000","last_unstale":"2024-01-22T05:09:03.951273+0000","last_undegraded":"2024-01-22T05:09:03.951273+0000","last_fullsized":"2024-01-22T05:09:03.951273+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981979+0000","last_change":"2024-01-22T05:09:03.969381+0000","last_active":"2024-01-22T05:09:03.981979+0000","last_peered":"2024-01-22T05:09:03.981979+0000","last_clean":"2024-01-22T05:09:03.981979+0000","last_became_active":"2024-01-22T05:09:03.969116+0000","last_became_peered":"2024-01-22T05:09:03.969116+0000","last_unstale":"2024-01-22T05:09:03.981979+0000","last_undegraded":"2024-01-22T05:09:03.981979+0000","last_fullsized":"2024-01-22T05:09:03.981979+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.945814+0000","last_change":"2024-01-22T05:09:03.491582+0000","last_active":"2024-01-22T05:09:03.945814+0000","last_peered":"2024-01-22T05:09:03.945814+0000","last_clean":"2024-01-22T05:09:03.945814+0000","last_became_active":"2024-01-22T05:09:03.491337+0000","last_became_peered":"2024-01-22T05:09:03.491337+0000","last_unstale":"2024-01-22T05:09:03.945814+0000","last_undegraded":"2024-01-22T05:09:03.945814+0000","last_fullsized":"2024-01-22T05:09:03.945814+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981634+0000","last_change":"2024-01-22T05:09:03.969714+0000","last_active":"2024-01-22T05:09:03.981634+0000","last_peered":"2024-01-22T05:09:03.981634+0000","last_clean":"2024-01-22T05:09:03.981634+0000","last_became_active":"2024-01-22T05:09:03.969447+0000","last_became_peered":"2024-01-22T05:09:03.969447+0000","last_unstale":"2024-01-22T05:09:03.981634+0000","last_undegraded":"2024-01-22T05:09:03.981634+0000","last_fullsized":"2024-01-22T05:09:03.981634+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.951156+0000","last_change":"2024-01-22T05:09:03.513889+0000","last_active":"2024-01-22T05:09:03.951156+0000","last_peered":"2024-01-22T05:09:03.951156+0000","last_clean":"2024-01-22T05:09:03.951156+0000","last_became_active":"2024-01-22T05:09:03.513611+0000","last_became_peered":"2024-01-22T05:09:03.513611+0000","last_unstale":"2024-01-22T05:09:03.951156+0000","last_undegraded":"2024-01-22T05:09:03.951156+0000","last_fullsized":"2024-01-22T05:09:03.951156+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982501+0000","last_change":"2024-01-22T05:09:03.973098+0000","last_active":"2024-01-22T05:09:03.982501+0000","last_peered":"2024-01-22T05:09:03.982501+0000","last_clean":"2024-01-22T05:09:03.982501+0000","last_became_active":"2024-01-22T05:09:03.972819+0000","last_became_peered":"2024-01-22T05:09:03.972819+0000","last_unstale":"2024-01-22T05:09:03.982501+0000","last_undegraded":"2024-01-22T05:09:03.982501+0000","last_fullsized":"2024-01-22T05:09:03.982501+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.943823+0000","last_change":"2024-01-22T05:09:03.489443+0000","last_active":"2024-01-22T05:09:03.943823+0000","last_peered":"2024-01-22T05:09:03.943823+0000","last_clean":"2024-01-22T05:09:03.943823+0000","last_became_active":"2024-01-22T05:09:03.489084+0000","last_became_peered":"2024-01-22T05:09:03.489084+0000","last_unstale":"2024-01-22T05:09:03.943823+0000","last_undegraded":"2024-01-22T05:09:03.943823+0000","last_fullsized":"2024-01-22T05:09:03.943823+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.985002+0000","last_change":"2024-01-22T05:09:03.983555+0000","last_active":"2024-01-22T05:09:03.985002+0000","last_peered":"2024-01-22T05:09:03.985002+0000","last_clean":"2024-01-22T05:09:03.985002+0000","last_became_active":"2024-01-22T05:09:03.982590+0000","last_became_peered":"2024-01-22T05:09:03.982590+0000","last_unstale":"2024-01-22T05:09:03.985002+0000","last_undegraded":"2024-01-22T05:09:03.985002+0000","last_fullsized":"2024-01-22T05:09:03.985002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.948077+0000","last_change":"2024-01-22T05:09:03.511120+0000","last_active":"2024-01-22T05:09:03.948077+0000","last_peered":"2024-01-22T05:09:03.948077+0000","last_clean":"2024-01-22T05:09:03.948077+0000","last_became_active":"2024-01-22T05:09:03.510621+0000","last_became_peered":"2024-01-22T05:09:03.510621+0000","last_unstale":"2024-01-22T05:09:03.948077+0000","last_undegraded":"2024-01-22T05:09:03.948077+0000","last_fullsized":"2024-01-22T05:09:03.948077+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971859+0000","last_change":"2024-01-22T05:09:03.965062+0000","last_active":"2024-01-22T05:09:03.971859+0000","last_peered":"2024-01-22T05:09:03.971859+0000","last_clean":"2024-01-22T05:09:03.971859+0000","last_became_active":"2024-01-22T05:09:03.964779+0000","last_became_peered":"2024-01-22T05:09:03.964779+0000","last_unstale":"2024-01-22T05:09:03.971859+0000","last_undegraded":"2024-01-22T05:09:03.971859+0000","last_fullsized":"2024-01-22T05:09:03.971859+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.945240+0000","last_change":"2024-01-22T05:09:03.498001+0000","last_active":"2024-01-22T05:09:03.945240+0000","last_peered":"2024-01-22T05:09:03.945240+0000","last_clean":"2024-01-22T05:09:03.945240+0000","last_became_active":"2024-01-22T05:09:03.497675+0000","last_became_peered":"2024-01-22T05:09:03.497675+0000","last_unstale":"2024-01-22T05:09:03.945240+0000","last_undegraded":"2024-01-22T05:09:03.945240+0000","last_fullsized":"2024-01-22T05:09:03.945240+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.975284+0000","last_change":"2024-01-22T05:09:03.971131+0000","last_active":"2024-01-22T05:09:03.975284+0000","last_peered":"2024-01-22T05:09:03.975284+0000","last_clean":"2024-01-22T05:09:03.975284+0000","last_became_active":"2024-01-22T05:09:03.963465+0000","last_became_peered":"2024-01-22T05:09:03.963465+0000","last_unstale":"2024-01-22T05:09:03.975284+0000","last_undegraded":"2024-01-22T05:09:03.975284+0000","last_fullsized":"2024-01-22T05:09:03.975284+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.970988+0000","last_change":"2024-01-22T05:09:03.502754+0000","last_active":"2024-01-22T05:09:03.970988+0000","last_peered":"2024-01-22T05:09:03.970988+0000","last_clean":"2024-01-22T05:09:03.970988+0000","last_became_active":"2024-01-22T05:09:03.502483+0000","last_became_peered":"2024-01-22T05:09:03.502483+0000","last_unstale":"2024-01-22T05:09:03.970988+0000","last_undegraded":"2024-01-22T05:09:03.970988+0000","last_fullsized":"2024-01-22T05:09:03.970988+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.975303+0000","last_change":"2024-01-22T05:09:03.970146+0000","last_active":"2024-01-22T05:09:03.975303+0000","last_peered":"2024-01-22T05:09:03.975303+0000","last_clean":"2024-01-22T05:09:03.975303+0000","last_became_active":"2024-01-22T05:09:03.969877+0000","last_became_peered":"2024-01-22T05:09:03.969877+0000","last_unstale":"2024-01-22T05:09:03.975303+0000","last_undegraded":"2024-01-22T05:09:03.975303+0000","last_fullsized":"2024-01-22T05:09:03.975303+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982614+0000","last_change":"2024-01-22T05:09:03.513079+0000","last_active":"2024-01-22T05:09:03.982614+0000","last_peered":"2024-01-22T05:09:03.982614+0000","last_clean":"2024-01-22T05:09:03.982614+0000","last_became_active":"2024-01-22T05:09:03.512405+0000","last_became_peered":"2024-01-22T05:09:03.512405+0000","last_unstale":"2024-01-22T05:09:03.982614+0000","last_undegraded":"2024-01-22T05:09:03.982614+0000","last_fullsized":"2024-01-22T05:09:03.982614+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.965608+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:09:03.965608+0000","last_peered":"2024-01-22T05:09:03.965608+0000","last_clean":"2024-01-22T05:09:03.965608+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:09:03.965608+0000","last_undegraded":"2024-01-22T05:09:03.965608+0000","last_fullsized":"2024-01-22T05:09:03.965608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982295+0000","last_change":"2024-01-22T05:09:03.976842+0000","last_active":"2024-01-22T05:09:03.982295+0000","last_peered":"2024-01-22T05:09:03.982295+0000","last_clean":"2024-01-22T05:09:03.982295+0000","last_became_active":"2024-01-22T05:09:03.976499+0000","last_became_peered":"2024-01-22T05:09:03.976499+0000","last_unstale":"2024-01-22T05:09:03.982295+0000","last_undegraded":"2024-01-22T05:09:03.982295+0000","last_fullsized":"2024-01-22T05:09:03.982295+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982563+0000","last_change":"2024-01-22T05:09:03.506372+0000","last_active":"2024-01-22T05:09:03.982563+0000","last_peered":"2024-01-22T05:09:03.982563+0000","last_clean":"2024-01-22T05:09:03.982563+0000","last_became_active":"2024-01-22T05:09:03.506112+0000","last_became_peered":"2024-01-22T05:09:03.506112+0000","last_unstale":"2024-01-22T05:09:03.982563+0000","last_undegraded":"2024-01-22T05:09:03.982563+0000","last_fullsized":"2024-01-22T05:09:03.982563+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.948781+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:09:03.948781+0000","last_peered":"2024-01-22T05:09:03.948781+0000","last_clean":"2024-01-22T05:09:03.948781+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:09:03.948781+0000","last_undegraded":"2024-01-22T05:09:03.948781+0000","last_fullsized":"2024-01-22T05:09:03.948781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971811+0000","last_change":"2024-01-22T05:09:03.967267+0000","last_active":"2024-01-22T05:09:03.971811+0000","last_peered":"2024-01-22T05:09:03.971811+0000","last_clean":"2024-01-22T05:09:03.971811+0000","last_became_active":"2024-01-22T05:09:03.966361+0000","last_became_peered":"2024-01-22T05:09:03.966361+0000","last_unstale":"2024-01-22T05:09:03.971811+0000","last_undegraded":"2024-01-22T05:09:03.971811+0000","last_fullsized":"2024-01-22T05:09:03.971811+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971715+0000","last_change":"2024-01-22T05:09:03.512597+0000","last_active":"2024-01-22T05:09:03.971715+0000","last_peered":"2024-01-22T05:09:03.971715+0000","last_clean":"2024-01-22T05:09:03.971715+0000","last_became_active":"2024-01-22T05:09:03.512327+0000","last_became_peered":"2024-01-22T05:09:03.512327+0000","last_unstale":"2024-01-22T05:09:03.971715+0000","last_undegraded":"2024-01-22T05:09:03.971715+0000","last_fullsized":"2024-01-22T05:09:03.971715+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.953999+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:09:03.953999+0000","last_peered":"2024-01-22T05:09:03.953999+0000","last_clean":"2024-01-22T05:09:03.953999+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:09:03.953999+0000","last_undegraded":"2024-01-22T05:09:03.953999+0000","last_fullsized":"2024-01-22T05:09:03.953999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.983737+0000","last_change":"2024-01-22T05:09:03.976354+0000","last_active":"2024-01-22T05:09:03.983737+0000","last_peered":"2024-01-22T05:09:03.983737+0000","last_clean":"2024-01-22T05:09:03.983737+0000","last_became_active":"2024-01-22T05:09:03.976060+0000","last_became_peered":"2024-01-22T05:09:03.976060+0000","last_unstale":"2024-01-22T05:09:03.983737+0000","last_undegraded":"2024-01-22T05:09:03.983737+0000","last_fullsized":"2024-01-22T05:09:03.983737+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.953804+0000","last_change":"2024-01-22T05:09:03.515140+0000","last_active":"2024-01-22T05:09:03.953804+0000","last_peered":"2024-01-22T05:09:03.953804+0000","last_clean":"2024-01-22T05:09:03.953804+0000","last_became_active":"2024-01-22T05:09:03.514839+0000","last_became_peered":"2024-01-22T05:09:03.514839+0000","last_unstale":"2024-01-22T05:09:03.953804+0000","last_undegraded":"2024-01-22T05:09:03.953804+0000","last_fullsized":"2024-01-22T05:09:03.953804+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.950501+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:09:03.950501+0000","last_peered":"2024-01-22T05:09:03.950501+0000","last_clean":"2024-01-22T05:09:03.950501+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:09:03.950501+0000","last_undegraded":"2024-01-22T05:09:03.950501+0000","last_fullsized":"2024-01-22T05:09:03.950501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.977062+0000","last_change":"2024-01-22T05:09:03.971597+0000","last_active":"2024-01-22T05:09:03.977062+0000","last_peered":"2024-01-22T05:09:03.977062+0000","last_clean":"2024-01-22T05:09:03.977062+0000","last_became_active":"2024-01-22T05:09:03.971327+0000","last_became_peered":"2024-01-22T05:09:03.971327+0000","last_unstale":"2024-01-22T05:09:03.977062+0000","last_undegraded":"2024-01-22T05:09:03.977062+0000","last_fullsized":"2024-01-22T05:09:03.977062+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.963193+0000","last_change":"2024-01-22T05:09:03.493988+0000","last_active":"2024-01-22T05:09:03.963193+0000","last_peered":"2024-01-22T05:09:03.963193+0000","last_clean":"2024-01-22T05:09:03.963193+0000","last_became_active":"2024-01-22T05:09:03.492431+0000","last_became_peered":"2024-01-22T05:09:03.492431+0000","last_unstale":"2024-01-22T05:09:03.963193+0000","last_undegraded":"2024-01-22T05:09:03.963193+0000","last_fullsized":"2024-01-22T05:09:03.963193+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.945140+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:09:03.945140+0000","last_peered":"2024-01-22T05:09:03.945140+0000","last_clean":"2024-01-22T05:09:03.945140+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:09:03.945140+0000","last_undegraded":"2024-01-22T05:09:03.945140+0000","last_fullsized":"2024-01-22T05:09:03.945140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.972134+0000","last_change":"2024-01-22T05:09:03.968441+0000","last_active":"2024-01-22T05:09:03.972134+0000","last_peered":"2024-01-22T05:09:03.972134+0000","last_clean":"2024-01-22T05:09:03.972134+0000","last_became_active":"2024-01-22T05:09:03.967678+0000","last_became_peered":"2024-01-22T05:09:03.967678+0000","last_unstale":"2024-01-22T05:09:03.972134+0000","last_undegraded":"2024-01-22T05:09:03.972134+0000","last_fullsized":"2024-01-22T05:09:03.972134+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.947625+0000","last_change":"2024-01-22T05:09:03.487797+0000","last_active":"2024-01-22T05:09:03.947625+0000","last_peered":"2024-01-22T05:09:03.947625+0000","last_clean":"2024-01-22T05:09:03.947625+0000","last_became_active":"2024-01-22T05:09:03.487488+0000","last_became_peered":"2024-01-22T05:09:03.487488+0000","last_unstale":"2024-01-22T05:09:03.947625+0000","last_undegraded":"2024-01-22T05:09:03.947625+0000","last_fullsized":"2024-01-22T05:09:03.947625+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.943214+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:09:03.943214+0000","last_peered":"2024-01-22T05:09:03.943214+0000","last_clean":"2024-01-22T05:09:03.943214+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:09:03.943214+0000","last_undegraded":"2024-01-22T05:09:03.943214+0000","last_fullsized":"2024-01-22T05:09:03.943214+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.983320+0000","last_change":"2024-01-22T05:09:03.977320+0000","last_active":"2024-01-22T05:09:03.983320+0000","last_peered":"2024-01-22T05:09:03.983320+0000","last_clean":"2024-01-22T05:09:03.983320+0000","last_became_active":"2024-01-22T05:09:03.977036+0000","last_became_peered":"2024-01-22T05:09:03.977036+0000","last_unstale":"2024-01-22T05:09:03.983320+0000","last_undegraded":"2024-01-22T05:09:03.983320+0000","last_fullsized":"2024-01-22T05:09:03.983320+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.950769+0000","last_change":"2024-01-22T05:09:03.492145+0000","last_active":"2024-01-22T05:09:03.950769+0000","last_peered":"2024-01-22T05:09:03.950769+0000","last_clean":"2024-01-22T05:09:03.950769+0000","last_became_active":"2024-01-22T05:09:03.490328+0000","last_became_peered":"2024-01-22T05:09:03.490328+0000","last_unstale":"2024-01-22T05:09:03.950769+0000","last_undegraded":"2024-01-22T05:09:03.950769+0000","last_fullsized":"2024-01-22T05:09:03.950769+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.955628+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:09:03.955628+0000","last_peered":"2024-01-22T05:09:03.955628+0000","last_clean":"2024-01-22T05:09:03.955628+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:09:03.955628+0000","last_undegraded":"2024-01-22T05:09:03.955628+0000","last_fullsized":"2024-01-22T05:09:03.955628+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.983860+0000","last_change":"2024-01-22T05:09:03.979606+0000","last_active":"2024-01-22T05:09:03.983860+0000","last_peered":"2024-01-22T05:09:03.983860+0000","last_clean":"2024-01-22T05:09:03.983860+0000","last_became_active":"2024-01-22T05:09:03.979342+0000","last_became_peered":"2024-01-22T05:09:03.979342+0000","last_unstale":"2024-01-22T05:09:03.983860+0000","last_undegraded":"2024-01-22T05:09:03.983860+0000","last_fullsized":"2024-01-22T05:09:03.983860+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.983709+0000","last_change":"2024-01-22T05:09:03.503825+0000","last_active":"2024-01-22T05:09:03.983709+0000","last_peered":"2024-01-22T05:09:03.983709+0000","last_clean":"2024-01-22T05:09:03.983709+0000","last_became_active":"2024-01-22T05:09:03.503510+0000","last_became_peered":"2024-01-22T05:09:03.503510+0000","last_unstale":"2024-01-22T05:09:03.983709+0000","last_undegraded":"2024-01-22T05:09:03.983709+0000","last_fullsized":"2024-01-22T05:09:03.983709+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.947957+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:09:03.947957+0000","last_peered":"2024-01-22T05:09:03.947957+0000","last_clean":"2024-01-22T05:09:03.947957+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:09:03.947957+0000","last_undegraded":"2024-01-22T05:09:03.947957+0000","last_fullsized":"2024-01-22T05:09:03.947957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":54,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.955713+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:09:03.955713+0000","last_peered":"2024-01-22T05:09:03.955713+0000","last_clean":"2024-01-22T05:09:03.955713+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:09:03.955713+0000","last_undegraded":"2024-01-22T05:09:03.955713+0000","last_fullsized":"2024-01-22T05:09:03.955713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065716,"statfs":{"total":96636764160,"available":96323293184,"internally_reserved":0,"allocated":856064,"data_stored":408937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.97499999999999998,"15min":1.0369999999999999},"min":{"1min":0.755,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.0529999999999999,"15min":1.0469999999999999},"min":{"1min":0.73399999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.462,"5min":1.53,"15min":1.53},"last":0.80800000000000005}]},{"osd":1,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.024,"15min":0.98299999999999998},"min":{"1min":0.69199999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.093},{"interface":"front","average":{"1min":1.119,"5min":1.137,"15min":1.169},"min":{"1min":0.746,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3700000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.0509999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1100000000000001,"15min":1.1000000000000001},"min":{"1min":0.85299999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.3919999999999999,"5min":1.659,"15min":1.659},"last":0.998},{"interface":"front","average":{"1min":1.175,"5min":1.147,"15min":1.165},"min":{"1min":0.88600000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.4399999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.83599999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.2230000000000001,"15min":1.2330000000000001},"min":{"1min":1.018,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5129999999999999,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.278},{"interface":"front","average":{"1min":1.238,"5min":1.198,"15min":1.224},"min":{"1min":0.97899999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4730000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.94199999999999995}]},{"osd":4,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.097,"15min":1.0600000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5589999999999999,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.163,"15min":1.159},"min":{"1min":0.90900000000000003,"5min":0.751,"15min":0.751},"max":{"1min":1.4790000000000001,"5min":1.8,"15min":1.8},"last":1.2170000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.206,"15min":1.194},"min":{"1min":0.97399999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.4710000000000001,"5min":1.736,"15min":1.736},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.2529999999999999,"15min":1.212},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.659,"5min":1.915,"15min":1.915},"last":1.3280000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2390000000000001,"15min":1.2529999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4570000000000001,"5min":1.823,"15min":1.823},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.353,"15min":1.327},"min":{"1min":1.056,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.605,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.4359999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310220,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061620,"statfs":{"total":96636764160,"available":96319098880,"internally_reserved":0,"allocated":856064,"data_stored":408103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":4.7039999999999997,"5min":1.7849999999999999,"15min":1.331},"min":{"1min":0.69099999999999995,"5min":0.372,"15min":0.372},"max":{"1min":77.745000000000005,"5min":77.745000000000005,"15min":77.745000000000005},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.1559999999999999,"15min":1.0880000000000001},"min":{"1min":0.71299999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":13.555999999999999,"5min":13.555999999999999,"15min":13.555999999999999},"last":1.1879999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.728,"5min":1.1499999999999999,"15min":1.0980000000000001},"min":{"1min":0.79300000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":15.499000000000001,"5min":15.499000000000001,"15min":15.499000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.2450000000000001,"15min":1.2509999999999999},"min":{"1min":0.89400000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":7.7629999999999999,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":1.2829999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1459999999999999,"15min":1.1579999999999999},"min":{"1min":0.80000000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.0960000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.125,"15min":1.117},"min":{"1min":0.89400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.9649999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.091}]},{"osd":3,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":5.9720000000000004,"5min":2.0990000000000002,"15min":1.4550000000000001},"min":{"1min":0.81399999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":102.08199999999999,"5min":102.08199999999999,"15min":102.08199999999999},"last":0.749},{"interface":"front","average":{"1min":1.859,"5min":1.2889999999999999,"15min":1.2410000000000001},"min":{"1min":0.86499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":15.468,"5min":15.468,"15min":15.468},"last":0.78100000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1339999999999999,"15min":1.0980000000000001},"min":{"1min":0.628,"5min":0.495,"15min":0.495},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.123,"15min":1.1299999999999999},"min":{"1min":0.66600000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.526,"5min":1.649,"15min":1.649},"last":0.65000000000000002}]},{"osd":5,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":2.5680000000000001,"5min":1.429,"15min":1.2709999999999999},"min":{"1min":0.92000000000000004,"5min":0.624,"15min":0.624},"max":{"1min":30.533000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.399,"5min":1.302,"15min":1.282},"min":{"1min":1.04,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":3.875,"5min":3.875,"15min":3.875},"last":0.88300000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":2.3719999999999999,"5min":1.548,"15min":1.4419999999999999},"min":{"1min":1.008,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":23.547999999999998,"5min":23.547999999999998,"15min":23.547999999999998},"last":0.91400000000000003},{"interface":"front","average":{"1min":4.3090000000000002,"5min":1.931,"15min":1.5960000000000001},"min":{"1min":1.1060000000000001,"5min":0.495,"15min":0.495},"max":{"1min":63.737000000000002,"5min":63.737000000000002,"15min":63.737000000000002},"last":1.206}]}]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310224,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061616,"statfs":{"total":96636764160,"available":96319094784,"internally_reserved":0,"allocated":860160,"data_stored":409547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95999999999999996,"15min":0.98599999999999999},"min":{"1min":0.66700000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2709999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0569999999999999,"15min":1.1120000000000001},"min":{"1min":0.72199999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.387,"5min":1.571,"15min":1.571},"last":0.97599999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.153,"15min":1.214},"min":{"1min":0.79800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3859999999999999,"5min":1.821,"15min":1.821},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.216,"15min":1.306},"min":{"1min":0.76000000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4159999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.4570000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.139,"15min":1.155},"min":{"1min":0.85799999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4670000000000001,"5min":1.629,"15min":1.629},"last":1.381},{"interface":"front","average":{"1min":1.085,"5min":1.0960000000000001,"15min":1.1419999999999999},"min":{"1min":0.80900000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.339,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.99399999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1499999999999999,"15min":1.1879999999999999},"min":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4450000000000001,"5min":1.931,"15min":1.931},"last":1.109},{"interface":"front","average":{"1min":1.218,"5min":1.23,"15min":1.306},"min":{"1min":0.97799999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4670000000000001,"5min":2.266,"15min":2.266},"last":1.5389999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1419999999999999,"15min":1.1919999999999999},"min":{"1min":0.80300000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.524,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.2450000000000001,"15min":1.3049999999999999},"min":{"1min":0.83799999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.6240000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.052}]},{"osd":6,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.282,"15min":1.349},"min":{"1min":0.755,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4410000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.29},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2649999999999999,"15min":1.3069999999999999},"min":{"1min":0.94799999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4339999999999999,"5min":1.909,"15min":1.909},"last":1.163}]},{"osd":7,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.369,"15min":1.427},"min":{"1min":1.0069999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.544,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.234},{"interface":"front","average":{"1min":1.363,"5min":1.417,"15min":1.4850000000000001},"min":{"1min":0.93999999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.5740000000000001,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.1990000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310212,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061628,"statfs":{"total":96636764160,"available":96319107072,"internally_reserved":0,"allocated":847872,"data_stored":408011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1000000000000001,"15min":1.1379999999999999},"min":{"1min":0.68999999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7490000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.115},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.107,"15min":1.0940000000000001},"min":{"1min":0.78900000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.6599999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.1910000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0529999999999999,"15min":1.085},"min":{"1min":0.64000000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.091,"5min":1.1160000000000001,"15min":1.198},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5009999999999999,"5min":2.194,"15min":2.194},"last":0.84099999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.097,"15min":1.091},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3620000000000001,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1950000000000001,"15min":1.278},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.5289999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.996}]},{"osd":3,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1379999999999999,"15min":1.1859999999999999},"min":{"1min":0.75900000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.462,"5min":1.589,"15min":1.589},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.1819999999999999,"15min":1.167},"min":{"1min":0.753,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4950000000000001,"5min":5.3029999999999999,"15min":5.3029999999999999},"last":1.1579999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.181,"15min":1.2230000000000001},"min":{"1min":0.70899999999999996,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.597,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1319999999999999,"15min":1.1619999999999999},"min":{"1min":0.73599999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.48,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.871}]},{"osd":6,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1950000000000001,"15min":1.1910000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6080000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.367,"15min":1.427},"min":{"1min":0.79000000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6379999999999999,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":1.2090000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3260000000000001,"15min":1.367},"min":{"1min":0.874,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.5649999999999999,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.264},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.377,"15min":1.385},"min":{"1min":0.86899999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.712,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.246}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310220,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061620,"statfs":{"total":96636764160,"available":96319098880,"internally_reserved":0,"allocated":856064,"data_stored":408123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.94999999999999996,"15min":0.90500000000000003},"min":{"1min":0.55600000000000005,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2090000000000001,"5min":14.859,"15min":14.859},"last":1.036},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.93000000000000005,"15min":0.88400000000000001},"min":{"1min":0.66000000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.599,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":1.085}]},{"osd":1,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.57899999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.266,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.99399999999999999,"15min":0.98399999999999999},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.278,"5min":5.7519999999999998,"15min":5.7519999999999998},"last":0.92100000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0960000000000001,"15min":1.1619999999999999},"min":{"1min":0.65400000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.714,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.321},{"interface":"front","average":{"1min":1.254,"5min":1.175,"15min":1.1930000000000001},"min":{"1min":0.72199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.629}]},{"osd":4,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2849999999999999,"15min":1.2949999999999999},"min":{"1min":0.91100000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5600000000000001,"5min":5.016,"15min":5.016},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.3440000000000001,"15min":1.339},"min":{"1min":0.85399999999999998,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.647,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":1.4370000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.95599999999999996,"5min":0.505,"15min":0.505},"max":{"1min":1.7509999999999999,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":1.53},{"interface":"front","average":{"1min":2.0459999999999998,"5min":1.4730000000000001,"15min":1.3420000000000001},"min":{"1min":0.95499999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":14.523999999999999,"5min":14.523999999999999,"15min":14.523999999999999},"last":1.756}]},{"osd":6,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3839999999999999,"15min":1.4219999999999999},"min":{"1min":1,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.698,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":1.667},{"interface":"front","average":{"1min":1.472,"5min":1.4370000000000001,"15min":1.423},"min":{"1min":0.89600000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.79,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":1.7370000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.401,"15min":1.401},"min":{"1min":1.022,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.8200000000000001,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":1.861},{"interface":"front","average":{"1min":1.375,"5min":1.4159999999999999,"15min":1.4279999999999999},"min":{"1min":0.85399999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7490000000000001,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":1.5089999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306128,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065712,"statfs":{"total":96636764160,"available":96323289088,"internally_reserved":0,"allocated":860160,"data_stored":408725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.46100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.87},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.54300000000000004,"5min":0.373,"15min":0.373},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.236}]},{"osd":1,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.5,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.91100000000000003,"15min":0.93899999999999995},"min":{"1min":0.57499999999999996,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.119}]},{"osd":3,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.071,"15min":1.0569999999999999},"min":{"1min":0.83699999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.677,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.736},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.145,"15min":1.161},"min":{"1min":0.79500000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.6899999999999999,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.5369999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2470000000000001,"15min":1.304},"min":{"1min":0.85699999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6439999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.179,"15min":1.208},"min":{"1min":0.77300000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.837,"5min":1.952,"15min":1.952},"last":1.577}]},{"osd":5,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.202,"15min":1.1919999999999999},"min":{"1min":0.93700000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.0510000000000002,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.468},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.276,"15min":1.3220000000000001},"min":{"1min":1.0149999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8600000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.304}]},{"osd":6,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2210000000000001,"15min":1.254},"min":{"1min":0.83999999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5449999999999999,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.8360000000000001},{"interface":"front","average":{"1min":1.46,"5min":1.2889999999999999,"15min":1.29},"min":{"1min":1.095,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.1320000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.353}]},{"osd":7,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3140000000000001,"15min":1.355},"min":{"1min":0.92900000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.764,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.395,"15min":1.4099999999999999},"min":{"1min":1.01,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.0329999999999999,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.802}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310216,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061624,"statfs":{"total":96636764160,"available":96319102976,"internally_reserved":0,"allocated":851968,"data_stored":402186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.873,"15min":0.84499999999999997},"min":{"1min":0.54800000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.248,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.98399999999999999,"15min":0.999},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.3540000000000001,"5min":2.101,"15min":2.101},"last":1.157}]},{"osd":2,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.97899999999999998,"15min":1.0009999999999999},"min":{"1min":0.63900000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.032,"15min":1.026},"min":{"1min":0.71499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.71,"5min":2.008,"15min":2.008},"last":1.3180000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0349999999999999,"15min":0.998},"min":{"1min":0.54800000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5720000000000001,"5min":4.665,"15min":4.665},"last":1.5},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89300000000000002,"15min":0.88},"min":{"1min":0.56399999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.1220000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2050000000000001,"15min":1.2010000000000001},"min":{"1min":0.82899999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.276,"15min":1.25},"min":{"1min":0.95999999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.786,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":1.419}]},{"osd":5,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.1759999999999999,"15min":1.1850000000000001},"min":{"1min":0.78600000000000003,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.774,"5min":1.776,"15min":1.776},"last":1.927},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.266,"15min":1.2689999999999999},"min":{"1min":0.89400000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6599999999999999,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.796}]},{"osd":6,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.93999999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.712,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.74},{"interface":"front","average":{"1min":1.381,"5min":1.3280000000000001,"15min":1.335},"min":{"1min":1.0369999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.722,"5min":2.294,"15min":2.294},"last":1.887}]},{"osd":7,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.387,"15min":1.375},"min":{"1min":1.036,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8640000000000001,"5min":4.4329999999999998,"15min":4.4329999999999998},"last":1.764},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3480000000000001,"15min":1.3600000000000001},"min":{"1min":0.85599999999999998,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.9359999999999999,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":2.0329999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065724,"statfs":{"total":96636764160,"available":96323301376,"internally_reserved":0,"allocated":847872,"data_stored":408011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83899999999999997,"15min":0.91900000000000004},"min":{"1min":0.499,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.1659999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.91600000000000004,"15min":0.98199999999999998},"min":{"1min":0.59399999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5349999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.67800000000000005}]},{"osd":2,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.01,"15min":1.0740000000000001},"min":{"1min":0.61499999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.5600000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1,"15min":1.0209999999999999},"min":{"1min":0.73399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.75}]},{"osd":3,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.95599999999999996,"15min":1.022},"min":{"1min":0.51500000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2270000000000001,"5min":1.994,"15min":1.994},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1200000000000001,"15min":1.2050000000000001},"min":{"1min":0.70199999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.569,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.292,"15min":1.383},"min":{"1min":0.89600000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.696,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.044},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2250000000000001,"15min":1.256},"min":{"1min":1.0029999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6299999999999999,"5min":1.782,"15min":1.782},"last":0.94699999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2889999999999999,"15min":1.379},"min":{"1min":0.93300000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.698,"5min":3.548,"15min":3.548},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.323,"15min":1.417},"min":{"1min":0.82799999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8660000000000001,"5min":2.613,"15min":2.613},"last":1.345}]},{"osd":6,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.375,"15min":1.4419999999999999},"min":{"1min":0.92000000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9370000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.3859999999999999,"15min":1.504},"min":{"1min":0.97599999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8700000000000001,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.0980000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.482,"15min":1.639},"min":{"1min":1.111,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.925,"5min":5.29,"15min":5.29},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.3720000000000001,"15min":1.4390000000000001},"min":{"1min":1.0880000000000001,"5min":0.752,"15min":0.752},"max":{"1min":1.76,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.1679999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:09:13.207 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:09:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.367+0000 7f515ea00700 1 Processor -- start 2024-01-22T05:09:13.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.371+0000 7f515ea00700 1 -- start start 2024-01-22T05:09:13.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f515ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51580c1ce0 0x7f51580c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:13.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f515ea00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51580626f0 con 0x7f515814e000 2024-01-22T05:09:13.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f515ea00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51580c5c70 con 0x7f51580c53f0 2024-01-22T05:09:13.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f515ea00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51580c5f50 con 0x7f51580c1ce0 2024-01-22T05:09:13.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f515d600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f515814e000 0x7f51580c15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53026/0 (socket says 172.21.15.49:53026) 2024-01-22T05:09:13.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f515d600700 1 -- 172.21.15.49:0/1452284742 learned_addr learned my addr 172.21.15.49:0/1452284742 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:13.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f515cc00700 1 --2- 172.21.15.49:0/1452284742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51580c1ce0 0x7f51580c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:13.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329981927 0 0) 0x7f51580626f0 con 0x7f515814e000 2024-01-22T05:09:13.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51380033f0 con 0x7f515814e000 2024-01-22T05:09:13.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022271649 0 0) 0x7f51580c5c70 con 0x7f51580c53f0 2024-01-22T05:09:13.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51580626f0 con 0x7f51580c53f0 2024-01-22T05:09:13.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1708379447 0 0) 0x7f51380033f0 con 0x7f515814e000 2024-01-22T05:09:13.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51580c1ce0 msgr2=0x7f51580c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:13.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 --2- 172.21.15.49:0/1452284742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51580c1ce0 0x7f51580c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:13.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 >> v1:172.21.15.110:6789/0 conn(0x7f51580c53f0 legacy=0x7f5158062bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:13.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51580c6230 con 0x7f515814e000 2024-01-22T05:09:13.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f51480015f0 con 0x7f515814e000 2024-01-22T05:09:13.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 >> v1:172.21.15.49:6789/0 conn(0x7f515814e000 legacy=0x7f51580c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:13.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 --2- 172.21.15.49:0/1452284742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5138003aa0 0x7f5138003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:13.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 --2- 172.21.15.49:0/1452284742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5138004690 0x7f5138004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:13.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 --2- 172.21.15.49:0/1452284742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51580c1ce0 0x7f5138005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:13.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51580c5f50 con 0x7f5138004690 2024-01-22T05:09:13.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513800b8e0 con 0x7f5138003aa0 2024-01-22T05:09:13.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513800ba50 con 0x7f51580c1ce0 2024-01-22T05:09:13.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f515cc00700 1 --2- 172.21.15.49:0/1452284742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5138004690 0x7f5138004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:13.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.375+0000 7f515d600700 1 --2- 172.21.15.49:0/1452284742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5138003aa0 0x7f5138003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:13.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f515e000700 1 --2- 172.21.15.49:0/1452284742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51580c1ce0 0x7f5138005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:13.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f515cc00700 1 -- 172.21.15.49:0/1452284742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51580c1ce0 msgr2=0x7f5138005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:13.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f515cc00700 1 --2- 172.21.15.49:0/1452284742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51580c1ce0 0x7f5138005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:13.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f515cc00700 1 -- 172.21.15.49:0/1452284742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5138003aa0 msgr2=0x7f5138003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:13.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f515cc00700 1 --2- 172.21.15.49:0/1452284742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5138003aa0 0x7f5138003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:13.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f515cc00700 1 -- 172.21.15.49:0/1452284742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51380033f0 con 0x7f5138004690 2024-01-22T05:09:13.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f515cc00700 1 --2- 172.21.15.49:0/1452284742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5138004690 0x7f5138004b10 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f51580c20e0 tx=0x7f5140009060).ready entity=mon.0 client_cookie=71958fb75dc82e4c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:13.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140009e90 con 0x7f5138004690 2024-01-22T05:09:13.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5140009430 con 0x7f5138004690 2024-01-22T05:09:13.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f5157e00700 1 -- 172.21.15.49:0/1452284742 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514000e7f0 con 0x7f5138004690 2024-01-22T05:09:13.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f515ea00700 1 -- 172.21.15.49:0/1452284742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5138004690 msgr2=0x7f5138004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:13.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f515ea00700 1 --2- 172.21.15.49:0/1452284742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5138004690 0x7f5138004b10 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f51580c20e0 tx=0x7f5140009060).stop 2024-01-22T05:09:13.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f515e000700 1 -- 172.21.15.49:0/1452284742 reap_dead start 2024-01-22T05:09:13.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f515ea00700 1 -- 172.21.15.49:0/1452284742 shutdown_connections 2024-01-22T05:09:13.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f515ea00700 1 -- 172.21.15.49:0/1452284742 >> 172.21.15.49:0/1452284742 conn(0x7f5158067a90 msgr2=0x7f5158067ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:13.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f515ea00700 1 -- 172.21.15.49:0/1452284742 shutdown_connections 2024-01-22T05:09:13.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.379+0000 7f515ea00700 1 -- 172.21.15.49:0/1452284742 wait complete. 2024-01-22T05:09:13.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515ea00700 1 Processor -- start 2024-01-22T05:09:13.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515ea00700 1 -- start start 2024-01-22T05:09:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5138004690 0x7f515813cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f515813c1d0 0x7f51580ab6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515813c650 0x7f51580abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515ea00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51580ac0d0 con 0x7f515813c650 2024-01-22T05:09:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515ea00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515813d090 con 0x7f5138004690 2024-01-22T05:09:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515ea00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51580ab030 con 0x7f515813c1d0 2024-01-22T05:09:13.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515813c650 0x7f51580abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:13.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515813c650 0x7f51580abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35698/0 (socket says 172.21.15.49:35698) 2024-01-22T05:09:13.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515e000700 1 -- 172.21.15.49:0/3907059151 learned_addr learned my addr 172.21.15.49:0/3907059151 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:13.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515d600700 1 --2- 172.21.15.49:0/3907059151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5138004690 0x7f515813cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515cc00700 1 --2- 172.21.15.49:0/3907059151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f515813c1d0 0x7f51580ab6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515e000700 1 -- 172.21.15.49:0/3907059151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f515813c1d0 msgr2=0x7f51580ab6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515e000700 1 --2- 172.21.15.49:0/3907059151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f515813c1d0 0x7f51580ab6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515e000700 1 -- 172.21.15.49:0/3907059151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5138004690 msgr2=0x7f515813cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515e000700 1 --2- 172.21.15.49:0/3907059151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5138004690 0x7f515813cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.387+0000 7f515e000700 1 -- 172.21.15.49:0/3907059151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51580bda60 con 0x7f515813c650 2024-01-22T05:09:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.391+0000 7f515e000700 1 --2- 172.21.15.49:0/3907059151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515813c650 0x7f51580abbe0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f5158065330 tx=0x7f5150009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:13.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.391+0000 7f5154c00700 1 -- 172.21.15.49:0/3907059151 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500018f0 con 0x7f515813c650 2024-01-22T05:09:13.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.391+0000 7f5154c00700 1 -- 172.21.15.49:0/3907059151 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5150001a50 con 0x7f515813c650 2024-01-22T05:09:13.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.391+0000 7f515ea00700 1 -- 172.21.15.49:0/3907059151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51580bdd40 con 0x7f515813c650 2024-01-22T05:09:13.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.391+0000 7f5154c00700 1 -- 172.21.15.49:0/3907059151 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150001e10 con 0x7f515813c650 2024-01-22T05:09:13.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.391+0000 7f515ea00700 1 -- 172.21.15.49:0/3907059151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51580be300 con 0x7f515813c650 2024-01-22T05:09:13.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.391+0000 7f515ea00700 1 -- 172.21.15.49:0/3907059151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5158059470 con 0x7f515813c650 2024-01-22T05:09:13.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.391+0000 7f5154c00700 1 -- 172.21.15.49:0/3907059151 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5150003240 con 0x7f515813c650 2024-01-22T05:09:13.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.395+0000 7f5154c00700 1 --2- 172.21.15.49:0/3907059151 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f513005a540 0x7f513005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:13.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.395+0000 7f5154c00700 1 -- 172.21.15.49:0/3907059151 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f5150073e10 con 0x7f515813c650 2024-01-22T05:09:13.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.395+0000 7f515d600700 1 --2- 172.21.15.49:0/3907059151 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f513005a540 0x7f513005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:13.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.395+0000 7f515d600700 1 --2- 172.21.15.49:0/3907059151 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f513005a540 0x7f513005ca00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f5148000ef0 tx=0x7f5148008ac0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:13.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.399+0000 7f5154c00700 1 -- 172.21.15.49:0/3907059151 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5158059470 con 0x7f515813c650 2024-01-22T05:09:13.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.563+0000 7f515ea00700 1 -- 172.21.15.49:0/3907059151 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5158059470 con 0x7f513005a540 2024-01-22T05:09:13.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.579+0000 7f5154c00700 1 -- 172.21.15.49:0/3907059151 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358860 (secure 0 0 0) 0x7f5158059470 con 0x7f513005a540 2024-01-22T05:09:13.591 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.591+0000 7f515ea00700 1 -- 172.21.15.49:0/3907059151 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f513005a540 msgr2=0x7f513005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.591+0000 7f515ea00700 1 --2- 172.21.15.49:0/3907059151 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f513005a540 0x7f513005ca00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f5148000ef0 tx=0x7f5148008ac0).stop 2024-01-22T05:09:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.591+0000 7f515ea00700 1 -- 172.21.15.49:0/3907059151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515813c650 msgr2=0x7f51580abbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.591+0000 7f515ea00700 1 --2- 172.21.15.49:0/3907059151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515813c650 0x7f51580abbe0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f5158065330 tx=0x7f5150009040).stop 2024-01-22T05:09:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.591+0000 7f515ea00700 1 -- 172.21.15.49:0/3907059151 shutdown_connections 2024-01-22T05:09:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.591+0000 7f515ea00700 1 --2- 172.21.15.49:0/3907059151 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f513005a540 0x7f513005ca00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.591+0000 7f515ea00700 1 --2- 172.21.15.49:0/3907059151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515813c650 0x7f51580abbe0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:13.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.591+0000 7f515ea00700 1 --2- 172.21.15.49:0/3907059151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f515813c1d0 0x7f51580ab6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:13.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.591+0000 7f515ea00700 1 --2- 172.21.15.49:0/3907059151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5138004690 0x7f515813cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:13.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.591+0000 7f515ea00700 1 -- 172.21.15.49:0/3907059151 >> 172.21.15.49:0/3907059151 conn(0x7f5158067a90 msgr2=0x7f5158067ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:13.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.591+0000 7f515ea00700 1 -- 172.21.15.49:0/3907059151 shutdown_connections 2024-01-22T05:09:13.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.591+0000 7f515ea00700 1 -- 172.21.15.49:0/3907059151 wait complete. 2024-01-22T05:09:13.597 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:09:13.616 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-01-22T05:09:13.327076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2469472,"kb_used_data":6688,"kb_used_omap":0,"kb_used_meta":2462720,"kb_avail":752505248,"statfs":{"total":773094113280,"available":770565373952,"internally_reserved":0,"allocated":6848512,"data_stored":3268700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2521825280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17990300,"num_objects":-2144,"num_object_clones":0,"num_object_copies":-4288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2144,"num_whiteouts":0,"num_read":-484,"num_read_kb":-7408,"num_write":-8073,"num_write_kb":-25438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-17,"num_bytes_recovered":0,"num_keys_recovered":-41,"num_objects_omap":-708,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.885924"},"pg_stats":[{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.975223+0000","last_change":"2024-01-22T05:09:03.964724+0000","last_active":"2024-01-22T05:09:03.975223+0000","last_peered":"2024-01-22T05:09:03.975223+0000","last_clean":"2024-01-22T05:09:03.975223+0000","last_became_active":"2024-01-22T05:09:03.963836+0000","last_became_peered":"2024-01-22T05:09:03.963836+0000","last_unstale":"2024-01-22T05:09:03.975223+0000","last_undegraded":"2024-01-22T05:09:03.975223+0000","last_fullsized":"2024-01-22T05:09:03.975223+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"69'3","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.975505+0000","last_change":"2024-01-22T05:09:03.498657+0000","last_active":"2024-01-22T05:09:03.975505+0000","last_peered":"2024-01-22T05:09:03.975505+0000","last_clean":"2024-01-22T05:09:03.975505+0000","last_became_active":"2024-01-22T05:09:03.498403+0000","last_became_peered":"2024-01-22T05:09:03.498403+0000","last_unstale":"2024-01-22T05:09:03.975505+0000","last_undegraded":"2024-01-22T05:09:03.975505+0000","last_fullsized":"2024-01-22T05:09:03.975505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.976472+0000","last_change":"2024-01-22T05:09:03.966347+0000","last_active":"2024-01-22T05:09:03.976472+0000","last_peered":"2024-01-22T05:09:03.976472+0000","last_clean":"2024-01-22T05:09:03.976472+0000","last_became_active":"2024-01-22T05:09:03.966043+0000","last_became_peered":"2024-01-22T05:09:03.966043+0000","last_unstale":"2024-01-22T05:09:03.976472+0000","last_undegraded":"2024-01-22T05:09:03.976472+0000","last_fullsized":"2024-01-22T05:09:03.976472+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.948702+0000","last_change":"2024-01-22T05:09:03.502076+0000","last_active":"2024-01-22T05:09:03.948702+0000","last_peered":"2024-01-22T05:09:03.948702+0000","last_clean":"2024-01-22T05:09:03.948702+0000","last_became_active":"2024-01-22T05:09:03.501009+0000","last_became_peered":"2024-01-22T05:09:03.501009+0000","last_unstale":"2024-01-22T05:09:03.948702+0000","last_undegraded":"2024-01-22T05:09:03.948702+0000","last_fullsized":"2024-01-22T05:09:03.948702+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.973156+0000","last_change":"2024-01-22T05:09:03.967899+0000","last_active":"2024-01-22T05:09:03.973156+0000","last_peered":"2024-01-22T05:09:03.973156+0000","last_clean":"2024-01-22T05:09:03.973156+0000","last_became_active":"2024-01-22T05:09:03.967208+0000","last_became_peered":"2024-01-22T05:09:03.967208+0000","last_unstale":"2024-01-22T05:09:03.973156+0000","last_undegraded":"2024-01-22T05:09:03.973156+0000","last_fullsized":"2024-01-22T05:09:03.973156+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.953921+0000","last_change":"2024-01-22T05:09:03.505761+0000","last_active":"2024-01-22T05:09:03.953921+0000","last_peered":"2024-01-22T05:09:03.953921+0000","last_clean":"2024-01-22T05:09:03.953921+0000","last_became_active":"2024-01-22T05:09:03.505470+0000","last_became_peered":"2024-01-22T05:09:03.505470+0000","last_unstale":"2024-01-22T05:09:03.953921+0000","last_undegraded":"2024-01-22T05:09:03.953921+0000","last_fullsized":"2024-01-22T05:09:03.953921+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.976783+0000","last_change":"2024-01-22T05:09:03.970751+0000","last_active":"2024-01-22T05:09:03.976783+0000","last_peered":"2024-01-22T05:09:03.976783+0000","last_clean":"2024-01-22T05:09:03.976783+0000","last_became_active":"2024-01-22T05:09:03.970492+0000","last_became_peered":"2024-01-22T05:09:03.970492+0000","last_unstale":"2024-01-22T05:09:03.976783+0000","last_undegraded":"2024-01-22T05:09:03.976783+0000","last_fullsized":"2024-01-22T05:09:03.976783+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982923+0000","last_change":"2024-01-22T05:09:03.507225+0000","last_active":"2024-01-22T05:09:03.982923+0000","last_peered":"2024-01-22T05:09:03.982923+0000","last_clean":"2024-01-22T05:09:03.982923+0000","last_became_active":"2024-01-22T05:09:03.506934+0000","last_became_peered":"2024-01-22T05:09:03.506934+0000","last_unstale":"2024-01-22T05:09:03.982923+0000","last_undegraded":"2024-01-22T05:09:03.982923+0000","last_fullsized":"2024-01-22T05:09:03.982923+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.980072+0000","last_change":"2024-01-22T05:09:03.976483+0000","last_active":"2024-01-22T05:09:03.980072+0000","last_peered":"2024-01-22T05:09:03.980072+0000","last_clean":"2024-01-22T05:09:03.980072+0000","last_became_active":"2024-01-22T05:09:03.976186+0000","last_became_peered":"2024-01-22T05:09:03.976186+0000","last_unstale":"2024-01-22T05:09:03.980072+0000","last_undegraded":"2024-01-22T05:09:03.980072+0000","last_fullsized":"2024-01-22T05:09:03.980072+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3b","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.976303+0000","last_change":"2024-01-22T05:09:03.509436+0000","last_active":"2024-01-22T05:09:03.976303+0000","last_peered":"2024-01-22T05:09:03.976303+0000","last_clean":"2024-01-22T05:09:03.976303+0000","last_became_active":"2024-01-22T05:09:03.509164+0000","last_became_peered":"2024-01-22T05:09:03.509164+0000","last_unstale":"2024-01-22T05:09:03.976303+0000","last_undegraded":"2024-01-22T05:09:03.976303+0000","last_fullsized":"2024-01-22T05:09:03.976303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982497+0000","last_change":"2024-01-22T05:09:03.973411+0000","last_active":"2024-01-22T05:09:03.982497+0000","last_peered":"2024-01-22T05:09:03.982497+0000","last_clean":"2024-01-22T05:09:03.982497+0000","last_became_active":"2024-01-22T05:09:03.973122+0000","last_became_peered":"2024-01-22T05:09:03.973122+0000","last_unstale":"2024-01-22T05:09:03.982497+0000","last_undegraded":"2024-01-22T05:09:03.982497+0000","last_fullsized":"2024-01-22T05:09:03.982497+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3a","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.978300+0000","last_change":"2024-01-22T05:09:03.501069+0000","last_active":"2024-01-22T05:09:03.978300+0000","last_peered":"2024-01-22T05:09:03.978300+0000","last_clean":"2024-01-22T05:09:03.978300+0000","last_became_active":"2024-01-22T05:09:03.500772+0000","last_became_peered":"2024-01-22T05:09:03.500772+0000","last_unstale":"2024-01-22T05:09:03.978300+0000","last_undegraded":"2024-01-22T05:09:03.978300+0000","last_fullsized":"2024-01-22T05:09:03.978300+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981064+0000","last_change":"2024-01-22T05:09:03.977745+0000","last_active":"2024-01-22T05:09:03.981064+0000","last_peered":"2024-01-22T05:09:03.981064+0000","last_clean":"2024-01-22T05:09:03.981064+0000","last_became_active":"2024-01-22T05:09:03.975823+0000","last_became_peered":"2024-01-22T05:09:03.975823+0000","last_unstale":"2024-01-22T05:09:03.981064+0000","last_undegraded":"2024-01-22T05:09:03.981064+0000","last_fullsized":"2024-01-22T05:09:03.981064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.943010+0000","last_change":"2024-01-22T05:09:03.497153+0000","last_active":"2024-01-22T05:09:03.943010+0000","last_peered":"2024-01-22T05:09:03.943010+0000","last_clean":"2024-01-22T05:09:03.943010+0000","last_became_active":"2024-01-22T05:09:03.496881+0000","last_became_peered":"2024-01-22T05:09:03.496881+0000","last_unstale":"2024-01-22T05:09:03.943010+0000","last_undegraded":"2024-01-22T05:09:03.943010+0000","last_fullsized":"2024-01-22T05:09:03.943010+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.973260+0000","last_change":"2024-01-22T05:09:03.966375+0000","last_active":"2024-01-22T05:09:03.973260+0000","last_peered":"2024-01-22T05:09:03.973260+0000","last_clean":"2024-01-22T05:09:03.973260+0000","last_became_active":"2024-01-22T05:09:03.966074+0000","last_became_peered":"2024-01-22T05:09:03.966074+0000","last_unstale":"2024-01-22T05:09:03.973260+0000","last_undegraded":"2024-01-22T05:09:03.973260+0000","last_fullsized":"2024-01-22T05:09:03.973260+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.942997+0000","last_change":"2024-01-22T05:09:03.494154+0000","last_active":"2024-01-22T05:09:03.942997+0000","last_peered":"2024-01-22T05:09:03.942997+0000","last_clean":"2024-01-22T05:09:03.942997+0000","last_became_active":"2024-01-22T05:09:03.493867+0000","last_became_peered":"2024-01-22T05:09:03.493867+0000","last_unstale":"2024-01-22T05:09:03.942997+0000","last_undegraded":"2024-01-22T05:09:03.942997+0000","last_fullsized":"2024-01-22T05:09:03.942997+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.970970+0000","last_change":"2024-01-22T05:09:03.963030+0000","last_active":"2024-01-22T05:09:03.970970+0000","last_peered":"2024-01-22T05:09:03.970970+0000","last_clean":"2024-01-22T05:09:03.970970+0000","last_became_active":"2024-01-22T05:09:03.960231+0000","last_became_peered":"2024-01-22T05:09:03.960231+0000","last_unstale":"2024-01-22T05:09:03.970970+0000","last_undegraded":"2024-01-22T05:09:03.970970+0000","last_fullsized":"2024-01-22T05:09:03.970970+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.952407+0000","last_change":"2024-01-22T05:09:03.515573+0000","last_active":"2024-01-22T05:09:03.952407+0000","last_peered":"2024-01-22T05:09:03.952407+0000","last_clean":"2024-01-22T05:09:03.952407+0000","last_became_active":"2024-01-22T05:09:03.515283+0000","last_became_peered":"2024-01-22T05:09:03.515283+0000","last_unstale":"2024-01-22T05:09:03.952407+0000","last_undegraded":"2024-01-22T05:09:03.952407+0000","last_fullsized":"2024-01-22T05:09:03.952407+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.978033+0000","last_change":"2024-01-22T05:09:03.967133+0000","last_active":"2024-01-22T05:09:03.978033+0000","last_peered":"2024-01-22T05:09:03.978033+0000","last_clean":"2024-01-22T05:09:03.978033+0000","last_became_active":"2024-01-22T05:09:03.966502+0000","last_became_peered":"2024-01-22T05:09:03.966502+0000","last_unstale":"2024-01-22T05:09:03.978033+0000","last_undegraded":"2024-01-22T05:09:03.978033+0000","last_fullsized":"2024-01-22T05:09:03.978033+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.952408+0000","last_change":"2024-01-22T05:09:03.514236+0000","last_active":"2024-01-22T05:09:03.952408+0000","last_peered":"2024-01-22T05:09:03.952408+0000","last_clean":"2024-01-22T05:09:03.952408+0000","last_became_active":"2024-01-22T05:09:03.513981+0000","last_became_peered":"2024-01-22T05:09:03.513981+0000","last_unstale":"2024-01-22T05:09:03.952408+0000","last_undegraded":"2024-01-22T05:09:03.952408+0000","last_fullsized":"2024-01-22T05:09:03.952408+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971829+0000","last_change":"2024-01-22T05:09:03.967428+0000","last_active":"2024-01-22T05:09:03.971829+0000","last_peered":"2024-01-22T05:09:03.971829+0000","last_clean":"2024-01-22T05:09:03.971829+0000","last_became_active":"2024-01-22T05:09:03.967030+0000","last_became_peered":"2024-01-22T05:09:03.967030+0000","last_unstale":"2024-01-22T05:09:03.971829+0000","last_undegraded":"2024-01-22T05:09:03.971829+0000","last_fullsized":"2024-01-22T05:09:03.971829+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.944981+0000","last_change":"2024-01-22T05:09:03.504508+0000","last_active":"2024-01-22T05:09:03.944981+0000","last_peered":"2024-01-22T05:09:03.944981+0000","last_clean":"2024-01-22T05:09:03.944981+0000","last_became_active":"2024-01-22T05:09:03.504238+0000","last_became_peered":"2024-01-22T05:09:03.504238+0000","last_unstale":"2024-01-22T05:09:03.944981+0000","last_undegraded":"2024-01-22T05:09:03.944981+0000","last_fullsized":"2024-01-22T05:09:03.944981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981462+0000","last_change":"2024-01-22T05:09:03.968371+0000","last_active":"2024-01-22T05:09:03.981462+0000","last_peered":"2024-01-22T05:09:03.981462+0000","last_clean":"2024-01-22T05:09:03.981462+0000","last_became_active":"2024-01-22T05:09:03.967725+0000","last_became_peered":"2024-01-22T05:09:03.967725+0000","last_unstale":"2024-01-22T05:09:03.981462+0000","last_undegraded":"2024-01-22T05:09:03.981462+0000","last_fullsized":"2024-01-22T05:09:03.981462+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.34","version":"69'4","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.985295+0000","last_change":"2024-01-22T05:09:03.505540+0000","last_active":"2024-01-22T05:09:03.985295+0000","last_peered":"2024-01-22T05:09:03.985295+0000","last_clean":"2024-01-22T05:09:03.985295+0000","last_became_active":"2024-01-22T05:09:03.505212+0000","last_became_peered":"2024-01-22T05:09:03.505212+0000","last_unstale":"2024-01-22T05:09:03.985295+0000","last_undegraded":"2024-01-22T05:09:03.985295+0000","last_fullsized":"2024-01-22T05:09:03.985295+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.961201+0000","last_change":"2024-01-22T05:09:03.956080+0000","last_active":"2024-01-22T05:09:03.961201+0000","last_peered":"2024-01-22T05:09:03.961201+0000","last_clean":"2024-01-22T05:09:03.961201+0000","last_became_active":"2024-01-22T05:09:03.955814+0000","last_became_peered":"2024-01-22T05:09:03.955814+0000","last_unstale":"2024-01-22T05:09:03.961201+0000","last_undegraded":"2024-01-22T05:09:03.961201+0000","last_fullsized":"2024-01-22T05:09:03.961201+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.979410+0000","last_change":"2024-01-22T05:09:03.493804+0000","last_active":"2024-01-22T05:09:03.979410+0000","last_peered":"2024-01-22T05:09:03.979410+0000","last_clean":"2024-01-22T05:09:03.979410+0000","last_became_active":"2024-01-22T05:09:03.493509+0000","last_became_peered":"2024-01-22T05:09:03.493509+0000","last_unstale":"2024-01-22T05:09:03.979410+0000","last_undegraded":"2024-01-22T05:09:03.979410+0000","last_fullsized":"2024-01-22T05:09:03.979410+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982705+0000","last_change":"2024-01-22T05:09:03.978970+0000","last_active":"2024-01-22T05:09:03.982705+0000","last_peered":"2024-01-22T05:09:03.982705+0000","last_clean":"2024-01-22T05:09:03.982705+0000","last_became_active":"2024-01-22T05:09:03.978675+0000","last_became_peered":"2024-01-22T05:09:03.978675+0000","last_unstale":"2024-01-22T05:09:03.982705+0000","last_undegraded":"2024-01-22T05:09:03.982705+0000","last_fullsized":"2024-01-22T05:09:03.982705+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.956219+0000","last_change":"2024-01-22T05:09:03.502717+0000","last_active":"2024-01-22T05:09:03.956219+0000","last_peered":"2024-01-22T05:09:03.956219+0000","last_clean":"2024-01-22T05:09:03.956219+0000","last_became_active":"2024-01-22T05:09:03.502441+0000","last_became_peered":"2024-01-22T05:09:03.502441+0000","last_unstale":"2024-01-22T05:09:03.956219+0000","last_undegraded":"2024-01-22T05:09:03.956219+0000","last_fullsized":"2024-01-22T05:09:03.956219+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.974789+0000","last_change":"2024-01-22T05:09:03.965177+0000","last_active":"2024-01-22T05:09:03.974789+0000","last_peered":"2024-01-22T05:09:03.974789+0000","last_clean":"2024-01-22T05:09:03.974789+0000","last_became_active":"2024-01-22T05:09:03.964846+0000","last_became_peered":"2024-01-22T05:09:03.964846+0000","last_unstale":"2024-01-22T05:09:03.974789+0000","last_undegraded":"2024-01-22T05:09:03.974789+0000","last_fullsized":"2024-01-22T05:09:03.974789+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.957253+0000","last_change":"2024-01-22T05:09:03.507523+0000","last_active":"2024-01-22T05:09:03.957253+0000","last_peered":"2024-01-22T05:09:03.957253+0000","last_clean":"2024-01-22T05:09:03.957253+0000","last_became_active":"2024-01-22T05:09:03.507190+0000","last_became_peered":"2024-01-22T05:09:03.507190+0000","last_unstale":"2024-01-22T05:09:03.957253+0000","last_undegraded":"2024-01-22T05:09:03.957253+0000","last_fullsized":"2024-01-22T05:09:03.957253+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982758+0000","last_change":"2024-01-22T05:09:03.979172+0000","last_active":"2024-01-22T05:09:03.982758+0000","last_peered":"2024-01-22T05:09:03.982758+0000","last_clean":"2024-01-22T05:09:03.982758+0000","last_became_active":"2024-01-22T05:09:03.978899+0000","last_became_peered":"2024-01-22T05:09:03.978899+0000","last_unstale":"2024-01-22T05:09:03.982758+0000","last_undegraded":"2024-01-22T05:09:03.982758+0000","last_fullsized":"2024-01-22T05:09:03.982758+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.30","version":"69'4","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.985688+0000","last_change":"2024-01-22T05:09:03.491444+0000","last_active":"2024-01-22T05:09:03.985688+0000","last_peered":"2024-01-22T05:09:03.985688+0000","last_clean":"2024-01-22T05:09:03.985688+0000","last_became_active":"2024-01-22T05:09:03.491120+0000","last_became_peered":"2024-01-22T05:09:03.491120+0000","last_unstale":"2024-01-22T05:09:03.985688+0000","last_undegraded":"2024-01-22T05:09:03.985688+0000","last_fullsized":"2024-01-22T05:09:03.985688+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971762+0000","last_change":"2024-01-22T05:09:03.964493+0000","last_active":"2024-01-22T05:09:03.971762+0000","last_peered":"2024-01-22T05:09:03.971762+0000","last_clean":"2024-01-22T05:09:03.971762+0000","last_became_active":"2024-01-22T05:09:03.964213+0000","last_became_peered":"2024-01-22T05:09:03.964213+0000","last_unstale":"2024-01-22T05:09:03.971762+0000","last_undegraded":"2024-01-22T05:09:03.971762+0000","last_fullsized":"2024-01-22T05:09:03.971762+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.949139+0000","last_change":"2024-01-22T05:09:03.513162+0000","last_active":"2024-01-22T05:09:03.949139+0000","last_peered":"2024-01-22T05:09:03.949139+0000","last_clean":"2024-01-22T05:09:03.949139+0000","last_became_active":"2024-01-22T05:09:03.512438+0000","last_became_peered":"2024-01-22T05:09:03.512438+0000","last_unstale":"2024-01-22T05:09:03.949139+0000","last_undegraded":"2024-01-22T05:09:03.949139+0000","last_fullsized":"2024-01-22T05:09:03.949139+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.978017+0000","last_change":"2024-01-22T05:09:03.966920+0000","last_active":"2024-01-22T05:09:03.978017+0000","last_peered":"2024-01-22T05:09:03.978017+0000","last_clean":"2024-01-22T05:09:03.978017+0000","last_became_active":"2024-01-22T05:09:03.966176+0000","last_became_peered":"2024-01-22T05:09:03.966176+0000","last_unstale":"2024-01-22T05:09:03.978017+0000","last_undegraded":"2024-01-22T05:09:03.978017+0000","last_fullsized":"2024-01-22T05:09:03.978017+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.948120+0000","last_change":"2024-01-22T05:09:03.505468+0000","last_active":"2024-01-22T05:09:03.948120+0000","last_peered":"2024-01-22T05:09:03.948120+0000","last_clean":"2024-01-22T05:09:03.948120+0000","last_became_active":"2024-01-22T05:09:03.505170+0000","last_became_peered":"2024-01-22T05:09:03.505170+0000","last_unstale":"2024-01-22T05:09:03.948120+0000","last_undegraded":"2024-01-22T05:09:03.948120+0000","last_fullsized":"2024-01-22T05:09:03.948120+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971043+0000","last_change":"2024-01-22T05:09:03.963641+0000","last_active":"2024-01-22T05:09:03.971043+0000","last_peered":"2024-01-22T05:09:03.971043+0000","last_clean":"2024-01-22T05:09:03.971043+0000","last_became_active":"2024-01-22T05:09:03.963355+0000","last_became_peered":"2024-01-22T05:09:03.963355+0000","last_unstale":"2024-01-22T05:09:03.971043+0000","last_undegraded":"2024-01-22T05:09:03.971043+0000","last_fullsized":"2024-01-22T05:09:03.971043+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2d","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982958+0000","last_change":"2024-01-22T05:09:03.496651+0000","last_active":"2024-01-22T05:09:03.982958+0000","last_peered":"2024-01-22T05:09:03.982958+0000","last_clean":"2024-01-22T05:09:03.982958+0000","last_became_active":"2024-01-22T05:09:03.496364+0000","last_became_peered":"2024-01-22T05:09:03.496364+0000","last_unstale":"2024-01-22T05:09:03.982958+0000","last_undegraded":"2024-01-22T05:09:03.982958+0000","last_fullsized":"2024-01-22T05:09:03.982958+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.980150+0000","last_change":"2024-01-22T05:09:03.976739+0000","last_active":"2024-01-22T05:09:03.980150+0000","last_peered":"2024-01-22T05:09:03.980150+0000","last_clean":"2024-01-22T05:09:03.980150+0000","last_became_active":"2024-01-22T05:09:03.975806+0000","last_became_peered":"2024-01-22T05:09:03.975806+0000","last_unstale":"2024-01-22T05:09:03.980150+0000","last_undegraded":"2024-01-22T05:09:03.980150+0000","last_fullsized":"2024-01-22T05:09:03.980150+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.961151+0000","last_change":"2024-01-22T05:09:03.514515+0000","last_active":"2024-01-22T05:09:03.961151+0000","last_peered":"2024-01-22T05:09:03.961151+0000","last_clean":"2024-01-22T05:09:03.961151+0000","last_became_active":"2024-01-22T05:09:03.514221+0000","last_became_peered":"2024-01-22T05:09:03.514221+0000","last_unstale":"2024-01-22T05:09:03.961151+0000","last_undegraded":"2024-01-22T05:09:03.961151+0000","last_fullsized":"2024-01-22T05:09:03.961151+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.963762+0000","last_change":"2024-01-22T05:09:03.958013+0000","last_active":"2024-01-22T05:09:03.963762+0000","last_peered":"2024-01-22T05:09:03.963762+0000","last_clean":"2024-01-22T05:09:03.963762+0000","last_became_active":"2024-01-22T05:09:03.957720+0000","last_became_peered":"2024-01-22T05:09:03.957720+0000","last_unstale":"2024-01-22T05:09:03.963762+0000","last_undegraded":"2024-01-22T05:09:03.963762+0000","last_fullsized":"2024-01-22T05:09:03.963762+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.970678+0000","last_change":"2024-01-22T05:09:03.496421+0000","last_active":"2024-01-22T05:09:03.970678+0000","last_peered":"2024-01-22T05:09:03.970678+0000","last_clean":"2024-01-22T05:09:03.970678+0000","last_became_active":"2024-01-22T05:09:03.495961+0000","last_became_peered":"2024-01-22T05:09:03.495961+0000","last_unstale":"2024-01-22T05:09:03.970678+0000","last_undegraded":"2024-01-22T05:09:03.970678+0000","last_fullsized":"2024-01-22T05:09:03.970678+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.963731+0000","last_change":"2024-01-22T05:09:03.957900+0000","last_active":"2024-01-22T05:09:03.963731+0000","last_peered":"2024-01-22T05:09:03.963731+0000","last_clean":"2024-01-22T05:09:03.963731+0000","last_became_active":"2024-01-22T05:09:03.953229+0000","last_became_peered":"2024-01-22T05:09:03.953229+0000","last_unstale":"2024-01-22T05:09:03.963731+0000","last_undegraded":"2024-01-22T05:09:03.963731+0000","last_fullsized":"2024-01-22T05:09:03.963731+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.962962+0000","last_change":"2024-01-22T05:09:03.509134+0000","last_active":"2024-01-22T05:09:03.962962+0000","last_peered":"2024-01-22T05:09:03.962962+0000","last_clean":"2024-01-22T05:09:03.962962+0000","last_became_active":"2024-01-22T05:09:03.508843+0000","last_became_peered":"2024-01-22T05:09:03.508843+0000","last_unstale":"2024-01-22T05:09:03.962962+0000","last_undegraded":"2024-01-22T05:09:03.962962+0000","last_fullsized":"2024-01-22T05:09:03.962962+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.984370+0000","last_change":"2024-01-22T05:09:03.980375+0000","last_active":"2024-01-22T05:09:03.984370+0000","last_peered":"2024-01-22T05:09:03.984370+0000","last_clean":"2024-01-22T05:09:03.984370+0000","last_became_active":"2024-01-22T05:09:03.980075+0000","last_became_peered":"2024-01-22T05:09:03.980075+0000","last_unstale":"2024-01-22T05:09:03.984370+0000","last_undegraded":"2024-01-22T05:09:03.984370+0000","last_fullsized":"2024-01-22T05:09:03.984370+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.961269+0000","last_change":"2024-01-22T05:09:03.508096+0000","last_active":"2024-01-22T05:09:03.961269+0000","last_peered":"2024-01-22T05:09:03.961269+0000","last_clean":"2024-01-22T05:09:03.961269+0000","last_became_active":"2024-01-22T05:09:03.507815+0000","last_became_peered":"2024-01-22T05:09:03.507815+0000","last_unstale":"2024-01-22T05:09:03.961269+0000","last_undegraded":"2024-01-22T05:09:03.961269+0000","last_fullsized":"2024-01-22T05:09:03.961269+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.984305+0000","last_change":"2024-01-22T05:09:03.977690+0000","last_active":"2024-01-22T05:09:03.984305+0000","last_peered":"2024-01-22T05:09:03.984305+0000","last_clean":"2024-01-22T05:09:03.984305+0000","last_became_active":"2024-01-22T05:09:03.977406+0000","last_became_peered":"2024-01-22T05:09:03.977406+0000","last_unstale":"2024-01-22T05:09:03.984305+0000","last_undegraded":"2024-01-22T05:09:03.984305+0000","last_fullsized":"2024-01-22T05:09:03.984305+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.955496+0000","last_change":"2024-01-22T05:09:03.504031+0000","last_active":"2024-01-22T05:09:03.955496+0000","last_peered":"2024-01-22T05:09:03.955496+0000","last_clean":"2024-01-22T05:09:03.955496+0000","last_became_active":"2024-01-22T05:09:03.503714+0000","last_became_peered":"2024-01-22T05:09:03.503714+0000","last_unstale":"2024-01-22T05:09:03.955496+0000","last_undegraded":"2024-01-22T05:09:03.955496+0000","last_fullsized":"2024-01-22T05:09:03.955496+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971277+0000","last_change":"2024-01-22T05:09:03.964332+0000","last_active":"2024-01-22T05:09:03.971277+0000","last_peered":"2024-01-22T05:09:03.971277+0000","last_clean":"2024-01-22T05:09:03.971277+0000","last_became_active":"2024-01-22T05:09:03.963998+0000","last_became_peered":"2024-01-22T05:09:03.963998+0000","last_unstale":"2024-01-22T05:09:03.971277+0000","last_undegraded":"2024-01-22T05:09:03.971277+0000","last_fullsized":"2024-01-22T05:09:03.971277+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.947510+0000","last_change":"2024-01-22T05:09:03.496201+0000","last_active":"2024-01-22T05:09:03.947510+0000","last_peered":"2024-01-22T05:09:03.947510+0000","last_clean":"2024-01-22T05:09:03.947510+0000","last_became_active":"2024-01-22T05:09:03.495878+0000","last_became_peered":"2024-01-22T05:09:03.495878+0000","last_unstale":"2024-01-22T05:09:03.947510+0000","last_undegraded":"2024-01-22T05:09:03.947510+0000","last_fullsized":"2024-01-22T05:09:03.947510+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.974907+0000","last_change":"2024-01-22T05:09:03.972417+0000","last_active":"2024-01-22T05:09:03.974907+0000","last_peered":"2024-01-22T05:09:03.974907+0000","last_clean":"2024-01-22T05:09:03.974907+0000","last_became_active":"2024-01-22T05:09:03.972094+0000","last_became_peered":"2024-01-22T05:09:03.972094+0000","last_unstale":"2024-01-22T05:09:03.974907+0000","last_undegraded":"2024-01-22T05:09:03.974907+0000","last_fullsized":"2024-01-22T05:09:03.974907+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.26","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-22T05:09:04.953727+0000","last_change":"2024-01-22T05:09:03.488075+0000","last_active":"2024-01-22T05:09:04.953727+0000","last_peered":"2024-01-22T05:09:04.953727+0000","last_clean":"2024-01-22T05:09:04.953727+0000","last_became_active":"2024-01-22T05:09:03.487800+0000","last_became_peered":"2024-01-22T05:09:03.487800+0000","last_unstale":"2024-01-22T05:09:04.953727+0000","last_undegraded":"2024-01-22T05:09:04.953727+0000","last_fullsized":"2024-01-22T05:09:04.953727+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.970783+0000","last_change":"2024-01-22T05:09:03.962856+0000","last_active":"2024-01-22T05:09:03.970783+0000","last_peered":"2024-01-22T05:09:03.970783+0000","last_clean":"2024-01-22T05:09:03.970783+0000","last_became_active":"2024-01-22T05:09:03.962269+0000","last_became_peered":"2024-01-22T05:09:03.962269+0000","last_unstale":"2024-01-22T05:09:03.970783+0000","last_undegraded":"2024-01-22T05:09:03.970783+0000","last_fullsized":"2024-01-22T05:09:03.970783+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.945307+0000","last_change":"2024-01-22T05:09:03.509483+0000","last_active":"2024-01-22T05:09:03.945307+0000","last_peered":"2024-01-22T05:09:03.945307+0000","last_clean":"2024-01-22T05:09:03.945307+0000","last_became_active":"2024-01-22T05:09:03.508479+0000","last_became_peered":"2024-01-22T05:09:03.508479+0000","last_unstale":"2024-01-22T05:09:03.945307+0000","last_undegraded":"2024-01-22T05:09:03.945307+0000","last_fullsized":"2024-01-22T05:09:03.945307+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981615+0000","last_change":"2024-01-22T05:09:03.974606+0000","last_active":"2024-01-22T05:09:03.981615+0000","last_peered":"2024-01-22T05:09:03.981615+0000","last_clean":"2024-01-22T05:09:03.981615+0000","last_became_active":"2024-01-22T05:09:03.973176+0000","last_became_peered":"2024-01-22T05:09:03.973176+0000","last_unstale":"2024-01-22T05:09:03.981615+0000","last_undegraded":"2024-01-22T05:09:03.981615+0000","last_fullsized":"2024-01-22T05:09:03.981615+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.950346+0000","last_change":"2024-01-22T05:09:03.500528+0000","last_active":"2024-01-22T05:09:03.950346+0000","last_peered":"2024-01-22T05:09:03.950346+0000","last_clean":"2024-01-22T05:09:03.950346+0000","last_became_active":"2024-01-22T05:09:03.500217+0000","last_became_peered":"2024-01-22T05:09:03.500217+0000","last_unstale":"2024-01-22T05:09:03.950346+0000","last_undegraded":"2024-01-22T05:09:03.950346+0000","last_fullsized":"2024-01-22T05:09:03.950346+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.966556+0000","last_change":"2024-01-22T05:09:03.964286+0000","last_active":"2024-01-22T05:09:03.966556+0000","last_peered":"2024-01-22T05:09:03.966556+0000","last_clean":"2024-01-22T05:09:03.966556+0000","last_became_active":"2024-01-22T05:09:03.964007+0000","last_became_peered":"2024-01-22T05:09:03.964007+0000","last_unstale":"2024-01-22T05:09:03.966556+0000","last_undegraded":"2024-01-22T05:09:03.966556+0000","last_fullsized":"2024-01-22T05:09:03.966556+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.957032+0000","last_change":"2024-01-22T05:09:03.513699+0000","last_active":"2024-01-22T05:09:03.957032+0000","last_peered":"2024-01-22T05:09:03.957032+0000","last_clean":"2024-01-22T05:09:03.957032+0000","last_became_active":"2024-01-22T05:09:03.513406+0000","last_became_peered":"2024-01-22T05:09:03.513406+0000","last_unstale":"2024-01-22T05:09:03.957032+0000","last_undegraded":"2024-01-22T05:09:03.957032+0000","last_fullsized":"2024-01-22T05:09:03.957032+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.964147+0000","last_change":"2024-01-22T05:09:03.961297+0000","last_active":"2024-01-22T05:09:03.964147+0000","last_peered":"2024-01-22T05:09:03.964147+0000","last_clean":"2024-01-22T05:09:03.964147+0000","last_became_active":"2024-01-22T05:09:03.960909+0000","last_became_peered":"2024-01-22T05:09:03.960909+0000","last_unstale":"2024-01-22T05:09:03.964147+0000","last_undegraded":"2024-01-22T05:09:03.964147+0000","last_fullsized":"2024-01-22T05:09:03.964147+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.945037+0000","last_change":"2024-01-22T05:09:03.496139+0000","last_active":"2024-01-22T05:09:03.945037+0000","last_peered":"2024-01-22T05:09:03.945037+0000","last_clean":"2024-01-22T05:09:03.945037+0000","last_became_active":"2024-01-22T05:09:03.495809+0000","last_became_peered":"2024-01-22T05:09:03.495809+0000","last_unstale":"2024-01-22T05:09:03.945037+0000","last_undegraded":"2024-01-22T05:09:03.945037+0000","last_fullsized":"2024-01-22T05:09:03.945037+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.974665+0000","last_change":"2024-01-22T05:09:03.961741+0000","last_active":"2024-01-22T05:09:03.974665+0000","last_peered":"2024-01-22T05:09:03.974665+0000","last_clean":"2024-01-22T05:09:03.974665+0000","last_became_active":"2024-01-22T05:09:03.961425+0000","last_became_peered":"2024-01-22T05:09:03.961425+0000","last_unstale":"2024-01-22T05:09:03.974665+0000","last_undegraded":"2024-01-22T05:09:03.974665+0000","last_fullsized":"2024-01-22T05:09:03.974665+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.945096+0000","last_change":"2024-01-22T05:09:03.502585+0000","last_active":"2024-01-22T05:09:03.945096+0000","last_peered":"2024-01-22T05:09:03.945096+0000","last_clean":"2024-01-22T05:09:03.945096+0000","last_became_active":"2024-01-22T05:09:03.501407+0000","last_became_peered":"2024-01-22T05:09:03.501407+0000","last_unstale":"2024-01-22T05:09:03.945096+0000","last_undegraded":"2024-01-22T05:09:03.945096+0000","last_fullsized":"2024-01-22T05:09:03.945096+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.956188+0000","last_change":"2024-01-22T05:09:03.955140+0000","last_active":"2024-01-22T05:09:03.956188+0000","last_peered":"2024-01-22T05:09:03.956188+0000","last_clean":"2024-01-22T05:09:03.956188+0000","last_became_active":"2024-01-22T05:09:03.954860+0000","last_became_peered":"2024-01-22T05:09:03.954860+0000","last_unstale":"2024-01-22T05:09:03.956188+0000","last_undegraded":"2024-01-22T05:09:03.956188+0000","last_fullsized":"2024-01-22T05:09:03.956188+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.950223+0000","last_change":"2024-01-22T05:09:03.492222+0000","last_active":"2024-01-22T05:09:03.950223+0000","last_peered":"2024-01-22T05:09:03.950223+0000","last_clean":"2024-01-22T05:09:03.950223+0000","last_became_active":"2024-01-22T05:09:03.491952+0000","last_became_peered":"2024-01-22T05:09:03.491952+0000","last_unstale":"2024-01-22T05:09:03.950223+0000","last_undegraded":"2024-01-22T05:09:03.950223+0000","last_fullsized":"2024-01-22T05:09:03.950223+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.980876+0000","last_change":"2024-01-22T05:09:03.967468+0000","last_active":"2024-01-22T05:09:03.980876+0000","last_peered":"2024-01-22T05:09:03.980876+0000","last_clean":"2024-01-22T05:09:03.980876+0000","last_became_active":"2024-01-22T05:09:03.967140+0000","last_became_peered":"2024-01-22T05:09:03.967140+0000","last_unstale":"2024-01-22T05:09:03.980876+0000","last_undegraded":"2024-01-22T05:09:03.980876+0000","last_fullsized":"2024-01-22T05:09:03.980876+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.979683+0000","last_change":"2024-01-22T05:09:03.513919+0000","last_active":"2024-01-22T05:09:03.979683+0000","last_peered":"2024-01-22T05:09:03.979683+0000","last_clean":"2024-01-22T05:09:03.979683+0000","last_became_active":"2024-01-22T05:09:03.513010+0000","last_became_peered":"2024-01-22T05:09:03.513010+0000","last_unstale":"2024-01-22T05:09:03.979683+0000","last_undegraded":"2024-01-22T05:09:03.979683+0000","last_fullsized":"2024-01-22T05:09:03.979683+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.977992+0000","last_change":"2024-01-22T05:09:03.966750+0000","last_active":"2024-01-22T05:09:03.977992+0000","last_peered":"2024-01-22T05:09:03.977992+0000","last_clean":"2024-01-22T05:09:03.977992+0000","last_became_active":"2024-01-22T05:09:03.965849+0000","last_became_peered":"2024-01-22T05:09:03.965849+0000","last_unstale":"2024-01-22T05:09:03.977992+0000","last_undegraded":"2024-01-22T05:09:03.977992+0000","last_fullsized":"2024-01-22T05:09:03.977992+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971108+0000","last_change":"2024-01-22T05:09:03.492307+0000","last_active":"2024-01-22T05:09:03.971108+0000","last_peered":"2024-01-22T05:09:03.971108+0000","last_clean":"2024-01-22T05:09:03.971108+0000","last_became_active":"2024-01-22T05:09:03.492028+0000","last_became_peered":"2024-01-22T05:09:03.492028+0000","last_unstale":"2024-01-22T05:09:03.971108+0000","last_undegraded":"2024-01-22T05:09:03.971108+0000","last_fullsized":"2024-01-22T05:09:03.971108+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.978668+0000","last_change":"2024-01-22T05:09:03.974559+0000","last_active":"2024-01-22T05:09:03.978668+0000","last_peered":"2024-01-22T05:09:03.978668+0000","last_clean":"2024-01-22T05:09:03.978668+0000","last_became_active":"2024-01-22T05:09:03.974277+0000","last_became_peered":"2024-01-22T05:09:03.974277+0000","last_unstale":"2024-01-22T05:09:03.978668+0000","last_undegraded":"2024-01-22T05:09:03.978668+0000","last_fullsized":"2024-01-22T05:09:03.978668+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982766+0000","last_change":"2024-01-22T05:09:03.501234+0000","last_active":"2024-01-22T05:09:03.982766+0000","last_peered":"2024-01-22T05:09:03.982766+0000","last_clean":"2024-01-22T05:09:03.982766+0000","last_became_active":"2024-01-22T05:09:03.500947+0000","last_became_peered":"2024-01-22T05:09:03.500947+0000","last_unstale":"2024-01-22T05:09:03.982766+0000","last_undegraded":"2024-01-22T05:09:03.982766+0000","last_fullsized":"2024-01-22T05:09:03.982766+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981484+0000","last_change":"2024-01-22T05:09:03.968555+0000","last_active":"2024-01-22T05:09:03.981484+0000","last_peered":"2024-01-22T05:09:03.981484+0000","last_clean":"2024-01-22T05:09:03.981484+0000","last_became_active":"2024-01-22T05:09:03.968045+0000","last_became_peered":"2024-01-22T05:09:03.968045+0000","last_unstale":"2024-01-22T05:09:03.981484+0000","last_undegraded":"2024-01-22T05:09:03.981484+0000","last_fullsized":"2024-01-22T05:09:03.981484+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.965128+0000","last_change":"2024-01-22T05:09:03.503233+0000","last_active":"2024-01-22T05:09:03.965128+0000","last_peered":"2024-01-22T05:09:03.965128+0000","last_clean":"2024-01-22T05:09:03.965128+0000","last_became_active":"2024-01-22T05:09:03.502708+0000","last_became_peered":"2024-01-22T05:09:03.502708+0000","last_unstale":"2024-01-22T05:09:03.965128+0000","last_undegraded":"2024-01-22T05:09:03.965128+0000","last_fullsized":"2024-01-22T05:09:03.965128+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.966286+0000","last_change":"2024-01-22T05:09:03.962737+0000","last_active":"2024-01-22T05:09:03.966286+0000","last_peered":"2024-01-22T05:09:03.966286+0000","last_clean":"2024-01-22T05:09:03.966286+0000","last_became_active":"2024-01-22T05:09:03.962446+0000","last_became_peered":"2024-01-22T05:09:03.962446+0000","last_unstale":"2024-01-22T05:09:03.966286+0000","last_undegraded":"2024-01-22T05:09:03.966286+0000","last_fullsized":"2024-01-22T05:09:03.966286+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.961501+0000","last_change":"2024-01-22T05:09:03.510449+0000","last_active":"2024-01-22T05:09:03.961501+0000","last_peered":"2024-01-22T05:09:03.961501+0000","last_clean":"2024-01-22T05:09:03.961501+0000","last_became_active":"2024-01-22T05:09:03.510173+0000","last_became_peered":"2024-01-22T05:09:03.510173+0000","last_unstale":"2024-01-22T05:09:03.961501+0000","last_undegraded":"2024-01-22T05:09:03.961501+0000","last_fullsized":"2024-01-22T05:09:03.961501+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981698+0000","last_change":"2024-01-22T05:09:03.974199+0000","last_active":"2024-01-22T05:09:03.981698+0000","last_peered":"2024-01-22T05:09:03.981698+0000","last_clean":"2024-01-22T05:09:03.981698+0000","last_became_active":"2024-01-22T05:09:03.973936+0000","last_became_peered":"2024-01-22T05:09:03.973936+0000","last_unstale":"2024-01-22T05:09:03.981698+0000","last_undegraded":"2024-01-22T05:09:03.981698+0000","last_fullsized":"2024-01-22T05:09:03.981698+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.961862+0000","last_change":"2024-01-22T05:09:03.496943+0000","last_active":"2024-01-22T05:09:03.961862+0000","last_peered":"2024-01-22T05:09:03.961862+0000","last_clean":"2024-01-22T05:09:03.961862+0000","last_became_active":"2024-01-22T05:09:03.493443+0000","last_became_peered":"2024-01-22T05:09:03.493443+0000","last_unstale":"2024-01-22T05:09:03.961862+0000","last_undegraded":"2024-01-22T05:09:03.961862+0000","last_fullsized":"2024-01-22T05:09:03.961862+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.974614+0000","last_change":"2024-01-22T05:09:03.962568+0000","last_active":"2024-01-22T05:09:03.974614+0000","last_peered":"2024-01-22T05:09:03.974614+0000","last_clean":"2024-01-22T05:09:03.974614+0000","last_became_active":"2024-01-22T05:09:03.962307+0000","last_became_peered":"2024-01-22T05:09:03.962307+0000","last_unstale":"2024-01-22T05:09:03.974614+0000","last_undegraded":"2024-01-22T05:09:03.974614+0000","last_fullsized":"2024-01-22T05:09:03.974614+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.949185+0000","last_change":"2024-01-22T05:09:03.512553+0000","last_active":"2024-01-22T05:09:03.949185+0000","last_peered":"2024-01-22T05:09:03.949185+0000","last_clean":"2024-01-22T05:09:03.949185+0000","last_became_active":"2024-01-22T05:09:03.512231+0000","last_became_peered":"2024-01-22T05:09:03.512231+0000","last_unstale":"2024-01-22T05:09:03.949185+0000","last_undegraded":"2024-01-22T05:09:03.949185+0000","last_fullsized":"2024-01-22T05:09:03.949185+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981792+0000","last_change":"2024-01-22T05:09:03.972637+0000","last_active":"2024-01-22T05:09:03.981792+0000","last_peered":"2024-01-22T05:09:03.981792+0000","last_clean":"2024-01-22T05:09:03.981792+0000","last_became_active":"2024-01-22T05:09:03.972310+0000","last_became_peered":"2024-01-22T05:09:03.972310+0000","last_unstale":"2024-01-22T05:09:03.981792+0000","last_undegraded":"2024-01-22T05:09:03.981792+0000","last_fullsized":"2024-01-22T05:09:03.981792+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.944144+0000","last_change":"2024-01-22T05:09:03.493665+0000","last_active":"2024-01-22T05:09:03.944144+0000","last_peered":"2024-01-22T05:09:03.944144+0000","last_clean":"2024-01-22T05:09:03.944144+0000","last_became_active":"2024-01-22T05:09:03.492894+0000","last_became_peered":"2024-01-22T05:09:03.492894+0000","last_unstale":"2024-01-22T05:09:03.944144+0000","last_undegraded":"2024-01-22T05:09:03.944144+0000","last_fullsized":"2024-01-22T05:09:03.944144+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.975465+0000","last_change":"2024-01-22T05:09:03.971579+0000","last_active":"2024-01-22T05:09:03.975465+0000","last_peered":"2024-01-22T05:09:03.975465+0000","last_clean":"2024-01-22T05:09:03.975465+0000","last_became_active":"2024-01-22T05:09:03.971233+0000","last_became_peered":"2024-01-22T05:09:03.971233+0000","last_unstale":"2024-01-22T05:09:03.975465+0000","last_undegraded":"2024-01-22T05:09:03.975465+0000","last_fullsized":"2024-01-22T05:09:03.975465+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.947051+0000","last_change":"2024-01-22T05:09:03.511882+0000","last_active":"2024-01-22T05:09:03.947051+0000","last_peered":"2024-01-22T05:09:03.947051+0000","last_clean":"2024-01-22T05:09:03.947051+0000","last_became_active":"2024-01-22T05:09:03.511591+0000","last_became_peered":"2024-01-22T05:09:03.511591+0000","last_unstale":"2024-01-22T05:09:03.947051+0000","last_undegraded":"2024-01-22T05:09:03.947051+0000","last_fullsized":"2024-01-22T05:09:03.947051+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982723+0000","last_change":"2024-01-22T05:09:03.977147+0000","last_active":"2024-01-22T05:09:03.982723+0000","last_peered":"2024-01-22T05:09:03.982723+0000","last_clean":"2024-01-22T05:09:03.982723+0000","last_became_active":"2024-01-22T05:09:03.976820+0000","last_became_peered":"2024-01-22T05:09:03.976820+0000","last_unstale":"2024-01-22T05:09:03.982723+0000","last_undegraded":"2024-01-22T05:09:03.982723+0000","last_fullsized":"2024-01-22T05:09:03.982723+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.965487+0000","last_change":"2024-01-22T05:09:03.501775+0000","last_active":"2024-01-22T05:09:03.965487+0000","last_peered":"2024-01-22T05:09:03.965487+0000","last_clean":"2024-01-22T05:09:03.965487+0000","last_became_active":"2024-01-22T05:09:03.495377+0000","last_became_peered":"2024-01-22T05:09:03.495377+0000","last_unstale":"2024-01-22T05:09:03.965487+0000","last_undegraded":"2024-01-22T05:09:03.965487+0000","last_fullsized":"2024-01-22T05:09:03.965487+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.976409+0000","last_change":"2024-01-22T05:09:03.964456+0000","last_active":"2024-01-22T05:09:03.976409+0000","last_peered":"2024-01-22T05:09:03.976409+0000","last_clean":"2024-01-22T05:09:03.976409+0000","last_became_active":"2024-01-22T05:09:03.964217+0000","last_became_peered":"2024-01-22T05:09:03.964217+0000","last_unstale":"2024-01-22T05:09:03.976409+0000","last_undegraded":"2024-01-22T05:09:03.976409+0000","last_fullsized":"2024-01-22T05:09:03.976409+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"69'3","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.976818+0000","last_change":"2024-01-22T05:09:03.507874+0000","last_active":"2024-01-22T05:09:03.976818+0000","last_peered":"2024-01-22T05:09:03.976818+0000","last_clean":"2024-01-22T05:09:03.976818+0000","last_became_active":"2024-01-22T05:09:03.507573+0000","last_became_peered":"2024-01-22T05:09:03.507573+0000","last_unstale":"2024-01-22T05:09:03.976818+0000","last_undegraded":"2024-01-22T05:09:03.976818+0000","last_fullsized":"2024-01-22T05:09:03.976818+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.975892+0000","last_change":"2024-01-22T05:09:03.965647+0000","last_active":"2024-01-22T05:09:03.975892+0000","last_peered":"2024-01-22T05:09:03.975892+0000","last_clean":"2024-01-22T05:09:03.975892+0000","last_became_active":"2024-01-22T05:09:03.965352+0000","last_became_peered":"2024-01-22T05:09:03.965352+0000","last_unstale":"2024-01-22T05:09:03.975892+0000","last_undegraded":"2024-01-22T05:09:03.975892+0000","last_fullsized":"2024-01-22T05:09:03.975892+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.979423+0000","last_change":"2024-01-22T05:09:03.492972+0000","last_active":"2024-01-22T05:09:03.979423+0000","last_peered":"2024-01-22T05:09:03.979423+0000","last_clean":"2024-01-22T05:09:03.979423+0000","last_became_active":"2024-01-22T05:09:03.492662+0000","last_became_peered":"2024-01-22T05:09:03.492662+0000","last_unstale":"2024-01-22T05:09:03.979423+0000","last_undegraded":"2024-01-22T05:09:03.979423+0000","last_fullsized":"2024-01-22T05:09:03.979423+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.984296+0000","last_change":"2024-01-22T05:09:03.977025+0000","last_active":"2024-01-22T05:09:03.984296+0000","last_peered":"2024-01-22T05:09:03.984296+0000","last_clean":"2024-01-22T05:09:03.984296+0000","last_became_active":"2024-01-22T05:09:03.976717+0000","last_became_peered":"2024-01-22T05:09:03.976717+0000","last_unstale":"2024-01-22T05:09:03.984296+0000","last_undegraded":"2024-01-22T05:09:03.984296+0000","last_fullsized":"2024-01-22T05:09:03.984296+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.983254+0000","last_change":"2024-01-22T05:09:03.500353+0000","last_active":"2024-01-22T05:09:03.983254+0000","last_peered":"2024-01-22T05:09:03.983254+0000","last_clean":"2024-01-22T05:09:03.983254+0000","last_became_active":"2024-01-22T05:09:03.497957+0000","last_became_peered":"2024-01-22T05:09:03.497957+0000","last_unstale":"2024-01-22T05:09:03.983254+0000","last_undegraded":"2024-01-22T05:09:03.983254+0000","last_fullsized":"2024-01-22T05:09:03.983254+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.974349+0000","last_change":"2024-01-22T05:09:03.970537+0000","last_active":"2024-01-22T05:09:03.974349+0000","last_peered":"2024-01-22T05:09:03.974349+0000","last_clean":"2024-01-22T05:09:03.974349+0000","last_became_active":"2024-01-22T05:09:03.970213+0000","last_became_peered":"2024-01-22T05:09:03.970213+0000","last_unstale":"2024-01-22T05:09:03.974349+0000","last_undegraded":"2024-01-22T05:09:03.974349+0000","last_fullsized":"2024-01-22T05:09:03.974349+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.970611+0000","last_change":"2024-01-22T05:09:03.503541+0000","last_active":"2024-01-22T05:09:03.970611+0000","last_peered":"2024-01-22T05:09:03.970611+0000","last_clean":"2024-01-22T05:09:03.970611+0000","last_became_active":"2024-01-22T05:09:03.497220+0000","last_became_peered":"2024-01-22T05:09:03.497220+0000","last_unstale":"2024-01-22T05:09:03.970611+0000","last_undegraded":"2024-01-22T05:09:03.970611+0000","last_fullsized":"2024-01-22T05:09:03.970611+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971088+0000","last_change":"2024-01-22T05:09:03.963854+0000","last_active":"2024-01-22T05:09:03.971088+0000","last_peered":"2024-01-22T05:09:03.971088+0000","last_clean":"2024-01-22T05:09:03.971088+0000","last_became_active":"2024-01-22T05:09:03.963603+0000","last_became_peered":"2024-01-22T05:09:03.963603+0000","last_unstale":"2024-01-22T05:09:03.971088+0000","last_undegraded":"2024-01-22T05:09:03.971088+0000","last_fullsized":"2024-01-22T05:09:03.971088+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.947454+0000","last_change":"2024-01-22T05:09:03.490868+0000","last_active":"2024-01-22T05:09:03.947454+0000","last_peered":"2024-01-22T05:09:03.947454+0000","last_clean":"2024-01-22T05:09:03.947454+0000","last_became_active":"2024-01-22T05:09:03.490570+0000","last_became_peered":"2024-01-22T05:09:03.490570+0000","last_unstale":"2024-01-22T05:09:03.947454+0000","last_undegraded":"2024-01-22T05:09:03.947454+0000","last_fullsized":"2024-01-22T05:09:03.947454+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.975313+0000","last_change":"2024-01-22T05:09:03.965503+0000","last_active":"2024-01-22T05:09:03.975313+0000","last_peered":"2024-01-22T05:09:03.975313+0000","last_clean":"2024-01-22T05:09:03.975313+0000","last_became_active":"2024-01-22T05:09:03.965233+0000","last_became_peered":"2024-01-22T05:09:03.965233+0000","last_unstale":"2024-01-22T05:09:03.975313+0000","last_undegraded":"2024-01-22T05:09:03.975313+0000","last_fullsized":"2024-01-22T05:09:03.975313+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"69'4","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982035+0000","last_change":"2024-01-22T05:09:03.509564+0000","last_active":"2024-01-22T05:09:03.982035+0000","last_peered":"2024-01-22T05:09:03.982035+0000","last_clean":"2024-01-22T05:09:03.982035+0000","last_became_active":"2024-01-22T05:09:03.506921+0000","last_became_peered":"2024-01-22T05:09:03.506921+0000","last_unstale":"2024-01-22T05:09:03.982035+0000","last_undegraded":"2024-01-22T05:09:03.982035+0000","last_fullsized":"2024-01-22T05:09:03.982035+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981752+0000","last_change":"2024-01-22T05:09:03.971662+0000","last_active":"2024-01-22T05:09:03.981752+0000","last_peered":"2024-01-22T05:09:03.981752+0000","last_clean":"2024-01-22T05:09:03.981752+0000","last_became_active":"2024-01-22T05:09:03.971348+0000","last_became_peered":"2024-01-22T05:09:03.971348+0000","last_unstale":"2024-01-22T05:09:03.981752+0000","last_undegraded":"2024-01-22T05:09:03.981752+0000","last_fullsized":"2024-01-22T05:09:03.981752+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.984057+0000","last_change":"2024-01-22T05:09:03.513276+0000","last_active":"2024-01-22T05:09:03.984057+0000","last_peered":"2024-01-22T05:09:03.984057+0000","last_clean":"2024-01-22T05:09:03.984057+0000","last_became_active":"2024-01-22T05:09:03.512823+0000","last_became_peered":"2024-01-22T05:09:03.512823+0000","last_unstale":"2024-01-22T05:09:03.984057+0000","last_undegraded":"2024-01-22T05:09:03.984057+0000","last_fullsized":"2024-01-22T05:09:03.984057+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.973289+0000","last_change":"2024-01-22T05:09:03.966322+0000","last_active":"2024-01-22T05:09:03.973289+0000","last_peered":"2024-01-22T05:09:03.973289+0000","last_clean":"2024-01-22T05:09:03.973289+0000","last_became_active":"2024-01-22T05:09:03.966013+0000","last_became_peered":"2024-01-22T05:09:03.966013+0000","last_unstale":"2024-01-22T05:09:03.973289+0000","last_undegraded":"2024-01-22T05:09:03.973289+0000","last_fullsized":"2024-01-22T05:09:03.973289+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.951273+0000","last_change":"2024-01-22T05:09:03.502186+0000","last_active":"2024-01-22T05:09:03.951273+0000","last_peered":"2024-01-22T05:09:03.951273+0000","last_clean":"2024-01-22T05:09:03.951273+0000","last_became_active":"2024-01-22T05:09:03.500679+0000","last_became_peered":"2024-01-22T05:09:03.500679+0000","last_unstale":"2024-01-22T05:09:03.951273+0000","last_undegraded":"2024-01-22T05:09:03.951273+0000","last_fullsized":"2024-01-22T05:09:03.951273+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981979+0000","last_change":"2024-01-22T05:09:03.969381+0000","last_active":"2024-01-22T05:09:03.981979+0000","last_peered":"2024-01-22T05:09:03.981979+0000","last_clean":"2024-01-22T05:09:03.981979+0000","last_became_active":"2024-01-22T05:09:03.969116+0000","last_became_peered":"2024-01-22T05:09:03.969116+0000","last_unstale":"2024-01-22T05:09:03.981979+0000","last_undegraded":"2024-01-22T05:09:03.981979+0000","last_fullsized":"2024-01-22T05:09:03.981979+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.945814+0000","last_change":"2024-01-22T05:09:03.491582+0000","last_active":"2024-01-22T05:09:03.945814+0000","last_peered":"2024-01-22T05:09:03.945814+0000","last_clean":"2024-01-22T05:09:03.945814+0000","last_became_active":"2024-01-22T05:09:03.491337+0000","last_became_peered":"2024-01-22T05:09:03.491337+0000","last_unstale":"2024-01-22T05:09:03.945814+0000","last_undegraded":"2024-01-22T05:09:03.945814+0000","last_fullsized":"2024-01-22T05:09:03.945814+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.981634+0000","last_change":"2024-01-22T05:09:03.969714+0000","last_active":"2024-01-22T05:09:03.981634+0000","last_peered":"2024-01-22T05:09:03.981634+0000","last_clean":"2024-01-22T05:09:03.981634+0000","last_became_active":"2024-01-22T05:09:03.969447+0000","last_became_peered":"2024-01-22T05:09:03.969447+0000","last_unstale":"2024-01-22T05:09:03.981634+0000","last_undegraded":"2024-01-22T05:09:03.981634+0000","last_fullsized":"2024-01-22T05:09:03.981634+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.951156+0000","last_change":"2024-01-22T05:09:03.513889+0000","last_active":"2024-01-22T05:09:03.951156+0000","last_peered":"2024-01-22T05:09:03.951156+0000","last_clean":"2024-01-22T05:09:03.951156+0000","last_became_active":"2024-01-22T05:09:03.513611+0000","last_became_peered":"2024-01-22T05:09:03.513611+0000","last_unstale":"2024-01-22T05:09:03.951156+0000","last_undegraded":"2024-01-22T05:09:03.951156+0000","last_fullsized":"2024-01-22T05:09:03.951156+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982501+0000","last_change":"2024-01-22T05:09:03.973098+0000","last_active":"2024-01-22T05:09:03.982501+0000","last_peered":"2024-01-22T05:09:03.982501+0000","last_clean":"2024-01-22T05:09:03.982501+0000","last_became_active":"2024-01-22T05:09:03.972819+0000","last_became_peered":"2024-01-22T05:09:03.972819+0000","last_unstale":"2024-01-22T05:09:03.982501+0000","last_undegraded":"2024-01-22T05:09:03.982501+0000","last_fullsized":"2024-01-22T05:09:03.982501+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.943823+0000","last_change":"2024-01-22T05:09:03.489443+0000","last_active":"2024-01-22T05:09:03.943823+0000","last_peered":"2024-01-22T05:09:03.943823+0000","last_clean":"2024-01-22T05:09:03.943823+0000","last_became_active":"2024-01-22T05:09:03.489084+0000","last_became_peered":"2024-01-22T05:09:03.489084+0000","last_unstale":"2024-01-22T05:09:03.943823+0000","last_undegraded":"2024-01-22T05:09:03.943823+0000","last_fullsized":"2024-01-22T05:09:03.943823+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.985002+0000","last_change":"2024-01-22T05:09:03.983555+0000","last_active":"2024-01-22T05:09:03.985002+0000","last_peered":"2024-01-22T05:09:03.985002+0000","last_clean":"2024-01-22T05:09:03.985002+0000","last_became_active":"2024-01-22T05:09:03.982590+0000","last_became_peered":"2024-01-22T05:09:03.982590+0000","last_unstale":"2024-01-22T05:09:03.985002+0000","last_undegraded":"2024-01-22T05:09:03.985002+0000","last_fullsized":"2024-01-22T05:09:03.985002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.948077+0000","last_change":"2024-01-22T05:09:03.511120+0000","last_active":"2024-01-22T05:09:03.948077+0000","last_peered":"2024-01-22T05:09:03.948077+0000","last_clean":"2024-01-22T05:09:03.948077+0000","last_became_active":"2024-01-22T05:09:03.510621+0000","last_became_peered":"2024-01-22T05:09:03.510621+0000","last_unstale":"2024-01-22T05:09:03.948077+0000","last_undegraded":"2024-01-22T05:09:03.948077+0000","last_fullsized":"2024-01-22T05:09:03.948077+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971859+0000","last_change":"2024-01-22T05:09:03.965062+0000","last_active":"2024-01-22T05:09:03.971859+0000","last_peered":"2024-01-22T05:09:03.971859+0000","last_clean":"2024-01-22T05:09:03.971859+0000","last_became_active":"2024-01-22T05:09:03.964779+0000","last_became_peered":"2024-01-22T05:09:03.964779+0000","last_unstale":"2024-01-22T05:09:03.971859+0000","last_undegraded":"2024-01-22T05:09:03.971859+0000","last_fullsized":"2024-01-22T05:09:03.971859+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.945240+0000","last_change":"2024-01-22T05:09:03.498001+0000","last_active":"2024-01-22T05:09:03.945240+0000","last_peered":"2024-01-22T05:09:03.945240+0000","last_clean":"2024-01-22T05:09:03.945240+0000","last_became_active":"2024-01-22T05:09:03.497675+0000","last_became_peered":"2024-01-22T05:09:03.497675+0000","last_unstale":"2024-01-22T05:09:03.945240+0000","last_undegraded":"2024-01-22T05:09:03.945240+0000","last_fullsized":"2024-01-22T05:09:03.945240+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.975284+0000","last_change":"2024-01-22T05:09:03.971131+0000","last_active":"2024-01-22T05:09:03.975284+0000","last_peered":"2024-01-22T05:09:03.975284+0000","last_clean":"2024-01-22T05:09:03.975284+0000","last_became_active":"2024-01-22T05:09:03.963465+0000","last_became_peered":"2024-01-22T05:09:03.963465+0000","last_unstale":"2024-01-22T05:09:03.975284+0000","last_undegraded":"2024-01-22T05:09:03.975284+0000","last_fullsized":"2024-01-22T05:09:03.975284+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.970988+0000","last_change":"2024-01-22T05:09:03.502754+0000","last_active":"2024-01-22T05:09:03.970988+0000","last_peered":"2024-01-22T05:09:03.970988+0000","last_clean":"2024-01-22T05:09:03.970988+0000","last_became_active":"2024-01-22T05:09:03.502483+0000","last_became_peered":"2024-01-22T05:09:03.502483+0000","last_unstale":"2024-01-22T05:09:03.970988+0000","last_undegraded":"2024-01-22T05:09:03.970988+0000","last_fullsized":"2024-01-22T05:09:03.970988+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.975303+0000","last_change":"2024-01-22T05:09:03.970146+0000","last_active":"2024-01-22T05:09:03.975303+0000","last_peered":"2024-01-22T05:09:03.975303+0000","last_clean":"2024-01-22T05:09:03.975303+0000","last_became_active":"2024-01-22T05:09:03.969877+0000","last_became_peered":"2024-01-22T05:09:03.969877+0000","last_unstale":"2024-01-22T05:09:03.975303+0000","last_undegraded":"2024-01-22T05:09:03.975303+0000","last_fullsized":"2024-01-22T05:09:03.975303+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982614+0000","last_change":"2024-01-22T05:09:03.513079+0000","last_active":"2024-01-22T05:09:03.982614+0000","last_peered":"2024-01-22T05:09:03.982614+0000","last_clean":"2024-01-22T05:09:03.982614+0000","last_became_active":"2024-01-22T05:09:03.512405+0000","last_became_peered":"2024-01-22T05:09:03.512405+0000","last_unstale":"2024-01-22T05:09:03.982614+0000","last_undegraded":"2024-01-22T05:09:03.982614+0000","last_fullsized":"2024-01-22T05:09:03.982614+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.965608+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:09:03.965608+0000","last_peered":"2024-01-22T05:09:03.965608+0000","last_clean":"2024-01-22T05:09:03.965608+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:09:03.965608+0000","last_undegraded":"2024-01-22T05:09:03.965608+0000","last_fullsized":"2024-01-22T05:09:03.965608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982295+0000","last_change":"2024-01-22T05:09:03.976842+0000","last_active":"2024-01-22T05:09:03.982295+0000","last_peered":"2024-01-22T05:09:03.982295+0000","last_clean":"2024-01-22T05:09:03.982295+0000","last_became_active":"2024-01-22T05:09:03.976499+0000","last_became_peered":"2024-01-22T05:09:03.976499+0000","last_unstale":"2024-01-22T05:09:03.982295+0000","last_undegraded":"2024-01-22T05:09:03.982295+0000","last_fullsized":"2024-01-22T05:09:03.982295+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.982563+0000","last_change":"2024-01-22T05:09:03.506372+0000","last_active":"2024-01-22T05:09:03.982563+0000","last_peered":"2024-01-22T05:09:03.982563+0000","last_clean":"2024-01-22T05:09:03.982563+0000","last_became_active":"2024-01-22T05:09:03.506112+0000","last_became_peered":"2024-01-22T05:09:03.506112+0000","last_unstale":"2024-01-22T05:09:03.982563+0000","last_undegraded":"2024-01-22T05:09:03.982563+0000","last_fullsized":"2024-01-22T05:09:03.982563+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.948781+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:09:03.948781+0000","last_peered":"2024-01-22T05:09:03.948781+0000","last_clean":"2024-01-22T05:09:03.948781+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:09:03.948781+0000","last_undegraded":"2024-01-22T05:09:03.948781+0000","last_fullsized":"2024-01-22T05:09:03.948781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971811+0000","last_change":"2024-01-22T05:09:03.967267+0000","last_active":"2024-01-22T05:09:03.971811+0000","last_peered":"2024-01-22T05:09:03.971811+0000","last_clean":"2024-01-22T05:09:03.971811+0000","last_became_active":"2024-01-22T05:09:03.966361+0000","last_became_peered":"2024-01-22T05:09:03.966361+0000","last_unstale":"2024-01-22T05:09:03.971811+0000","last_undegraded":"2024-01-22T05:09:03.971811+0000","last_fullsized":"2024-01-22T05:09:03.971811+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.971715+0000","last_change":"2024-01-22T05:09:03.512597+0000","last_active":"2024-01-22T05:09:03.971715+0000","last_peered":"2024-01-22T05:09:03.971715+0000","last_clean":"2024-01-22T05:09:03.971715+0000","last_became_active":"2024-01-22T05:09:03.512327+0000","last_became_peered":"2024-01-22T05:09:03.512327+0000","last_unstale":"2024-01-22T05:09:03.971715+0000","last_undegraded":"2024-01-22T05:09:03.971715+0000","last_fullsized":"2024-01-22T05:09:03.971715+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.953999+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:09:03.953999+0000","last_peered":"2024-01-22T05:09:03.953999+0000","last_clean":"2024-01-22T05:09:03.953999+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:09:03.953999+0000","last_undegraded":"2024-01-22T05:09:03.953999+0000","last_fullsized":"2024-01-22T05:09:03.953999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.983737+0000","last_change":"2024-01-22T05:09:03.976354+0000","last_active":"2024-01-22T05:09:03.983737+0000","last_peered":"2024-01-22T05:09:03.983737+0000","last_clean":"2024-01-22T05:09:03.983737+0000","last_became_active":"2024-01-22T05:09:03.976060+0000","last_became_peered":"2024-01-22T05:09:03.976060+0000","last_unstale":"2024-01-22T05:09:03.983737+0000","last_undegraded":"2024-01-22T05:09:03.983737+0000","last_fullsized":"2024-01-22T05:09:03.983737+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.953804+0000","last_change":"2024-01-22T05:09:03.515140+0000","last_active":"2024-01-22T05:09:03.953804+0000","last_peered":"2024-01-22T05:09:03.953804+0000","last_clean":"2024-01-22T05:09:03.953804+0000","last_became_active":"2024-01-22T05:09:03.514839+0000","last_became_peered":"2024-01-22T05:09:03.514839+0000","last_unstale":"2024-01-22T05:09:03.953804+0000","last_undegraded":"2024-01-22T05:09:03.953804+0000","last_fullsized":"2024-01-22T05:09:03.953804+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.950501+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:09:03.950501+0000","last_peered":"2024-01-22T05:09:03.950501+0000","last_clean":"2024-01-22T05:09:03.950501+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:09:03.950501+0000","last_undegraded":"2024-01-22T05:09:03.950501+0000","last_fullsized":"2024-01-22T05:09:03.950501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.977062+0000","last_change":"2024-01-22T05:09:03.971597+0000","last_active":"2024-01-22T05:09:03.977062+0000","last_peered":"2024-01-22T05:09:03.977062+0000","last_clean":"2024-01-22T05:09:03.977062+0000","last_became_active":"2024-01-22T05:09:03.971327+0000","last_became_peered":"2024-01-22T05:09:03.971327+0000","last_unstale":"2024-01-22T05:09:03.977062+0000","last_undegraded":"2024-01-22T05:09:03.977062+0000","last_fullsized":"2024-01-22T05:09:03.977062+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.963193+0000","last_change":"2024-01-22T05:09:03.493988+0000","last_active":"2024-01-22T05:09:03.963193+0000","last_peered":"2024-01-22T05:09:03.963193+0000","last_clean":"2024-01-22T05:09:03.963193+0000","last_became_active":"2024-01-22T05:09:03.492431+0000","last_became_peered":"2024-01-22T05:09:03.492431+0000","last_unstale":"2024-01-22T05:09:03.963193+0000","last_undegraded":"2024-01-22T05:09:03.963193+0000","last_fullsized":"2024-01-22T05:09:03.963193+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.945140+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:09:03.945140+0000","last_peered":"2024-01-22T05:09:03.945140+0000","last_clean":"2024-01-22T05:09:03.945140+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:09:03.945140+0000","last_undegraded":"2024-01-22T05:09:03.945140+0000","last_fullsized":"2024-01-22T05:09:03.945140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.972134+0000","last_change":"2024-01-22T05:09:03.968441+0000","last_active":"2024-01-22T05:09:03.972134+0000","last_peered":"2024-01-22T05:09:03.972134+0000","last_clean":"2024-01-22T05:09:03.972134+0000","last_became_active":"2024-01-22T05:09:03.967678+0000","last_became_peered":"2024-01-22T05:09:03.967678+0000","last_unstale":"2024-01-22T05:09:03.972134+0000","last_undegraded":"2024-01-22T05:09:03.972134+0000","last_fullsized":"2024-01-22T05:09:03.972134+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.947625+0000","last_change":"2024-01-22T05:09:03.487797+0000","last_active":"2024-01-22T05:09:03.947625+0000","last_peered":"2024-01-22T05:09:03.947625+0000","last_clean":"2024-01-22T05:09:03.947625+0000","last_became_active":"2024-01-22T05:09:03.487488+0000","last_became_peered":"2024-01-22T05:09:03.487488+0000","last_unstale":"2024-01-22T05:09:03.947625+0000","last_undegraded":"2024-01-22T05:09:03.947625+0000","last_fullsized":"2024-01-22T05:09:03.947625+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.943214+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:09:03.943214+0000","last_peered":"2024-01-22T05:09:03.943214+0000","last_clean":"2024-01-22T05:09:03.943214+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:09:03.943214+0000","last_undegraded":"2024-01-22T05:09:03.943214+0000","last_fullsized":"2024-01-22T05:09:03.943214+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.983320+0000","last_change":"2024-01-22T05:09:03.977320+0000","last_active":"2024-01-22T05:09:03.983320+0000","last_peered":"2024-01-22T05:09:03.983320+0000","last_clean":"2024-01-22T05:09:03.983320+0000","last_became_active":"2024-01-22T05:09:03.977036+0000","last_became_peered":"2024-01-22T05:09:03.977036+0000","last_unstale":"2024-01-22T05:09:03.983320+0000","last_undegraded":"2024-01-22T05:09:03.983320+0000","last_fullsized":"2024-01-22T05:09:03.983320+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.950769+0000","last_change":"2024-01-22T05:09:03.492145+0000","last_active":"2024-01-22T05:09:03.950769+0000","last_peered":"2024-01-22T05:09:03.950769+0000","last_clean":"2024-01-22T05:09:03.950769+0000","last_became_active":"2024-01-22T05:09:03.490328+0000","last_became_peered":"2024-01-22T05:09:03.490328+0000","last_unstale":"2024-01-22T05:09:03.950769+0000","last_undegraded":"2024-01-22T05:09:03.950769+0000","last_fullsized":"2024-01-22T05:09:03.950769+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.955628+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:09:03.955628+0000","last_peered":"2024-01-22T05:09:03.955628+0000","last_clean":"2024-01-22T05:09:03.955628+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:09:03.955628+0000","last_undegraded":"2024-01-22T05:09:03.955628+0000","last_fullsized":"2024-01-22T05:09:03.955628+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.983860+0000","last_change":"2024-01-22T05:09:03.979606+0000","last_active":"2024-01-22T05:09:03.983860+0000","last_peered":"2024-01-22T05:09:03.983860+0000","last_clean":"2024-01-22T05:09:03.983860+0000","last_became_active":"2024-01-22T05:09:03.979342+0000","last_became_peered":"2024-01-22T05:09:03.979342+0000","last_unstale":"2024-01-22T05:09:03.983860+0000","last_undegraded":"2024-01-22T05:09:03.983860+0000","last_fullsized":"2024-01-22T05:09:03.983860+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:03.456932+0000","last_clean_scrub_stamp":"2024-01-22T05:09:03.456932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.983709+0000","last_change":"2024-01-22T05:09:03.503825+0000","last_active":"2024-01-22T05:09:03.983709+0000","last_peered":"2024-01-22T05:09:03.983709+0000","last_clean":"2024-01-22T05:09:03.983709+0000","last_became_active":"2024-01-22T05:09:03.503510+0000","last_became_peered":"2024-01-22T05:09:03.503510+0000","last_unstale":"2024-01-22T05:09:03.983709+0000","last_undegraded":"2024-01-22T05:09:03.983709+0000","last_fullsized":"2024-01-22T05:09:03.983709+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:02.441249+0000","last_clean_scrub_stamp":"2024-01-22T05:09:02.441249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.947957+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:09:03.947957+0000","last_peered":"2024-01-22T05:09:03.947957+0000","last_clean":"2024-01-22T05:09:03.947957+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:09:03.947957+0000","last_undegraded":"2024-01-22T05:09:03.947957+0000","last_fullsized":"2024-01-22T05:09:03.947957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":54,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-22T05:09:03.955713+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:09:03.955713+0000","last_peered":"2024-01-22T05:09:03.955713+0000","last_clean":"2024-01-22T05:09:03.955713+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:09:03.955713+0000","last_undegraded":"2024-01-22T05:09:03.955713+0000","last_fullsized":"2024-01-22T05:09:03.955713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065716,"statfs":{"total":96636764160,"available":96323293184,"internally_reserved":0,"allocated":856064,"data_stored":408937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.97499999999999998,"15min":1.0369999999999999},"min":{"1min":0.755,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.292},{"interface":"front","average":{"1min":1.155,"5min":1.0529999999999999,"15min":1.0469999999999999},"min":{"1min":0.73399999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.462,"5min":1.53,"15min":1.53},"last":0.96899999999999997}]},{"osd":1,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.024,"15min":0.98299999999999998},"min":{"1min":0.69199999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.119,"5min":1.137,"15min":1.169},"min":{"1min":0.746,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3700000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.159}]},{"osd":2,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1100000000000001,"15min":1.1000000000000001},"min":{"1min":0.85299999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.3919999999999999,"5min":1.659,"15min":1.659},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.147,"15min":1.165},"min":{"1min":0.88600000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.4399999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.6080000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.2230000000000001,"15min":1.2330000000000001},"min":{"1min":1.018,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5129999999999999,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.198,"15min":1.224},"min":{"1min":0.97899999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4730000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.472}]},{"osd":4,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.097,"15min":1.0600000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5589999999999999,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.391},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.163,"15min":1.159},"min":{"1min":0.90900000000000003,"5min":0.751,"15min":0.751},"max":{"1min":1.4790000000000001,"5min":1.8,"15min":1.8},"last":1.431}]},{"osd":5,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.206,"15min":1.194},"min":{"1min":0.97399999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.4710000000000001,"5min":1.736,"15min":1.736},"last":1.536},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.2529999999999999,"15min":1.212},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.659,"5min":1.915,"15min":1.915},"last":1.7589999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2390000000000001,"15min":1.2529999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4570000000000001,"5min":1.823,"15min":1.823},"last":1.55},{"interface":"front","average":{"1min":1.403,"5min":1.353,"15min":1.327},"min":{"1min":1.056,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.605,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.5740000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310220,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061620,"statfs":{"total":96636764160,"available":96319098880,"internally_reserved":0,"allocated":856064,"data_stored":408103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":4.7039999999999997,"5min":1.7849999999999999,"15min":1.331},"min":{"1min":0.69099999999999995,"5min":0.372,"15min":0.372},"max":{"1min":77.745000000000005,"5min":77.745000000000005,"15min":77.745000000000005},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.1559999999999999,"15min":1.0880000000000001},"min":{"1min":0.71299999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":13.555999999999999,"5min":13.555999999999999,"15min":13.555999999999999},"last":1.248}]},{"osd":1,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.728,"5min":1.1499999999999999,"15min":1.0980000000000001},"min":{"1min":0.79300000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":15.499000000000001,"5min":15.499000000000001,"15min":15.499000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.2450000000000001,"15min":1.2509999999999999},"min":{"1min":0.89400000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":7.7629999999999999,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":1.49}]},{"osd":2,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1459999999999999,"15min":1.1579999999999999},"min":{"1min":0.80000000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.0960000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.125,"15min":1.117},"min":{"1min":0.89400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.9649999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.0189999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":5.9720000000000004,"5min":2.0990000000000002,"15min":1.4550000000000001},"min":{"1min":0.81399999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":102.08199999999999,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.351},{"interface":"front","average":{"1min":1.859,"5min":1.2889999999999999,"15min":1.2410000000000001},"min":{"1min":0.86499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":15.468,"5min":15.468,"15min":15.468},"last":1.105}]},{"osd":4,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1339999999999999,"15min":1.0980000000000001},"min":{"1min":0.628,"5min":0.495,"15min":0.495},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.123,"15min":1.1299999999999999},"min":{"1min":0.66600000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.526,"5min":1.649,"15min":1.649},"last":1.4490000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":2.5680000000000001,"5min":1.429,"15min":1.2709999999999999},"min":{"1min":0.92000000000000004,"5min":0.624,"15min":0.624},"max":{"1min":30.533000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.302,"15min":1.282},"min":{"1min":1.04,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":3.875,"5min":3.875,"15min":3.875},"last":1.613}]},{"osd":7,"last update":"Mon Jan 22 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":2.3719999999999999,"5min":1.548,"15min":1.4419999999999999},"min":{"1min":1.008,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":23.547999999999998,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.5429999999999999},{"interface":"front","average":{"1min":4.3090000000000002,"5min":1.931,"15min":1.5960000000000001},"min":{"1min":1.1060000000000001,"5min":0.495,"15min":0.495},"max":{"1min":63.737000000000002,"5min":63.737000000000002,"15min":63.737000000000002},"last":1.4199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310224,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061616,"statfs":{"total":96636764160,"available":96319094784,"internally_reserved":0,"allocated":860160,"data_stored":409547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95999999999999996,"15min":0.98599999999999999},"min":{"1min":0.66700000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2709999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.091},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0569999999999999,"15min":1.1120000000000001},"min":{"1min":0.72199999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.387,"5min":1.571,"15min":1.571},"last":1.3460000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.153,"15min":1.214},"min":{"1min":0.79800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3859999999999999,"5min":1.821,"15min":1.821},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.216,"15min":1.306},"min":{"1min":0.76000000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4159999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.4570000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.139,"15min":1.155},"min":{"1min":0.85799999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4670000000000001,"5min":1.629,"15min":1.629},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.0960000000000001,"15min":1.1419999999999999},"min":{"1min":0.80900000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.339,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.1779999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1499999999999999,"15min":1.1879999999999999},"min":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4450000000000001,"5min":1.931,"15min":1.931},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.218,"5min":1.23,"15min":1.306},"min":{"1min":0.97799999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4670000000000001,"5min":2.266,"15min":2.266},"last":1.5189999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1419999999999999,"15min":1.1919999999999999},"min":{"1min":0.80300000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.524,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.2450000000000001,"15min":1.3049999999999999},"min":{"1min":0.83799999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.6240000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.1240000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.282,"15min":1.349},"min":{"1min":0.755,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4410000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2649999999999999,"15min":1.3069999999999999},"min":{"1min":0.94799999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4339999999999999,"5min":1.909,"15min":1.909},"last":1.284}]},{"osd":7,"last update":"Mon Jan 22 05:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.369,"15min":1.427},"min":{"1min":1.0069999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.544,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.417,"15min":1.4850000000000001},"min":{"1min":0.93999999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.5740000000000001,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.6140000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310212,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061628,"statfs":{"total":96636764160,"available":96319107072,"internally_reserved":0,"allocated":847872,"data_stored":408011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1000000000000001,"15min":1.1379999999999999},"min":{"1min":0.68999999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7490000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.107,"15min":1.0940000000000001},"min":{"1min":0.78900000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.6599999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.76200000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0529999999999999,"15min":1.085},"min":{"1min":0.64000000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.091,"5min":1.1160000000000001,"15min":1.198},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5009999999999999,"5min":2.194,"15min":2.194},"last":0.66400000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.097,"15min":1.091},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3620000000000001,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1950000000000001,"15min":1.278},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.5289999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1379999999999999,"15min":1.1859999999999999},"min":{"1min":0.75900000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.462,"5min":1.589,"15min":1.589},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.198,"5min":1.1819999999999999,"15min":1.167},"min":{"1min":0.753,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4950000000000001,"5min":5.3029999999999999,"15min":5.3029999999999999},"last":0.81599999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.181,"15min":1.2230000000000001},"min":{"1min":0.70899999999999996,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.597,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1319999999999999,"15min":1.1619999999999999},"min":{"1min":0.73599999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.48,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.008}]},{"osd":6,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1950000000000001,"15min":1.1910000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6080000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.367,"15min":1.427},"min":{"1min":0.79000000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6379999999999999,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.91200000000000003}]},{"osd":7,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3260000000000001,"15min":1.367},"min":{"1min":0.874,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.5649999999999999,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.377,"15min":1.385},"min":{"1min":0.86899999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.712,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.0740000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310220,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061620,"statfs":{"total":96636764160,"available":96319098880,"internally_reserved":0,"allocated":856064,"data_stored":408123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.94999999999999996,"15min":0.90500000000000003},"min":{"1min":0.55600000000000005,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2090000000000001,"5min":14.859,"15min":14.859},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.93000000000000005,"15min":0.88400000000000001},"min":{"1min":0.66000000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.599,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":0.82099999999999995}]},{"osd":1,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.57899999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.266,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.99399999999999999,"15min":0.98399999999999999},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.278,"5min":5.7519999999999998,"15min":5.7519999999999998},"last":1.2549999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0960000000000001,"15min":1.1619999999999999},"min":{"1min":0.65400000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.714,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.175,"15min":1.1930000000000001},"min":{"1min":0.72199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.24}]},{"osd":4,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2849999999999999,"15min":1.2949999999999999},"min":{"1min":0.91100000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5600000000000001,"5min":5.016,"15min":5.016},"last":1.448},{"interface":"front","average":{"1min":1.363,"5min":1.3440000000000001,"15min":1.339},"min":{"1min":0.85399999999999998,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.647,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":1.4670000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.95599999999999996,"5min":0.505,"15min":0.505},"max":{"1min":1.7509999999999999,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":1.534},{"interface":"front","average":{"1min":2.0459999999999998,"5min":1.4730000000000001,"15min":1.3420000000000001},"min":{"1min":0.95499999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":14.523999999999999,"5min":14.523999999999999,"15min":14.523999999999999},"last":1.1639999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3839999999999999,"15min":1.4219999999999999},"min":{"1min":1,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.698,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":1.204},{"interface":"front","average":{"1min":1.472,"5min":1.4370000000000001,"15min":1.423},"min":{"1min":0.89600000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.79,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":1.3740000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.401,"15min":1.401},"min":{"1min":1.022,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.8200000000000001,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.4159999999999999,"15min":1.4279999999999999},"min":{"1min":0.85399999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7490000000000001,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":1.554}]}]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306128,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065712,"statfs":{"total":96636764160,"available":96323289088,"internally_reserved":0,"allocated":860160,"data_stored":408725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.46100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.54300000000000004,"5min":0.373,"15min":0.373},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.95299999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.5,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.91100000000000003,"15min":0.93899999999999995},"min":{"1min":0.57499999999999996,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.91100000000000003}]},{"osd":3,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.071,"15min":1.0569999999999999},"min":{"1min":0.83699999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.677,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.145,"15min":1.161},"min":{"1min":0.79500000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.6899999999999999,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.4179999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2470000000000001,"15min":1.304},"min":{"1min":0.85699999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6439999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.179,"15min":1.208},"min":{"1min":0.77300000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.837,"5min":1.952,"15min":1.952},"last":1.089}]},{"osd":5,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.202,"15min":1.1919999999999999},"min":{"1min":0.93700000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.0510000000000002,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.276,"15min":1.3220000000000001},"min":{"1min":1.0149999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8600000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.2310000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2210000000000001,"15min":1.254},"min":{"1min":0.83999999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5449999999999999,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.282},{"interface":"front","average":{"1min":1.46,"5min":1.2889999999999999,"15min":1.29},"min":{"1min":1.095,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.1320000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.2609999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3140000000000001,"15min":1.355},"min":{"1min":0.92900000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.764,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.395,"15min":1.4099999999999999},"min":{"1min":1.01,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.0329999999999999,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.3740000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310228,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061612,"statfs":{"total":96636764160,"available":96319090688,"internally_reserved":0,"allocated":864256,"data_stored":409243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.873,"15min":0.84499999999999997},"min":{"1min":0.54800000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.248,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":1.05},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.98399999999999999,"15min":0.999},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.3540000000000001,"5min":2.101,"15min":2.101},"last":0.90500000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.97899999999999998,"15min":1.0009999999999999},"min":{"1min":0.63900000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.998},{"interface":"front","average":{"1min":1.103,"5min":1.032,"15min":1.026},"min":{"1min":0.71499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.71,"5min":2.008,"15min":2.008},"last":1.327}]},{"osd":3,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0349999999999999,"15min":0.998},"min":{"1min":0.54800000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5720000000000001,"5min":4.665,"15min":4.665},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89300000000000002,"15min":0.88},"min":{"1min":0.56399999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.85999999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2050000000000001,"15min":1.2010000000000001},"min":{"1min":0.82899999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.276,"15min":1.25},"min":{"1min":0.95999999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.786,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":1.157}]},{"osd":5,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.1759999999999999,"15min":1.1850000000000001},"min":{"1min":0.78600000000000003,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.774,"5min":1.776,"15min":1.776},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.266,"15min":1.2689999999999999},"min":{"1min":0.89400000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6599999999999999,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.1040000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.93999999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.712,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.381,"5min":1.3280000000000001,"15min":1.335},"min":{"1min":1.0369999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.722,"5min":2.294,"15min":2.294},"last":1.145}]},{"osd":7,"last update":"Mon Jan 22 05:08:35 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.387,"15min":1.375},"min":{"1min":1.036,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8640000000000001,"5min":4.4329999999999998,"15min":4.4329999999999998},"last":1.242},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3480000000000001,"15min":1.3600000000000001},"min":{"1min":0.85599999999999998,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.9359999999999999,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":1.0740000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065724,"statfs":{"total":96636764160,"available":96323301376,"internally_reserved":0,"allocated":847872,"data_stored":408011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83899999999999997,"15min":0.91900000000000004},"min":{"1min":0.499,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.1659999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.91600000000000004,"15min":0.98199999999999998},"min":{"1min":0.59399999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5349999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.83599999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.01,"15min":1.0740000000000001},"min":{"1min":0.61499999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.5600000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.204},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1,"15min":1.0209999999999999},"min":{"1min":0.73399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.167}]},{"osd":3,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.95599999999999996,"15min":1.022},"min":{"1min":0.51500000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2270000000000001,"5min":1.994,"15min":1.994},"last":1.357},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1200000000000001,"15min":1.2050000000000001},"min":{"1min":0.70199999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.569,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.3380000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.292,"15min":1.383},"min":{"1min":0.89600000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.696,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2250000000000001,"15min":1.256},"min":{"1min":1.0029999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6299999999999999,"5min":1.782,"15min":1.782},"last":1.286}]},{"osd":5,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2889999999999999,"15min":1.379},"min":{"1min":0.93300000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.698,"5min":3.548,"15min":3.548},"last":1.101},{"interface":"front","average":{"1min":1.355,"5min":1.323,"15min":1.417},"min":{"1min":0.82799999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8660000000000001,"5min":2.613,"15min":2.613},"last":1.452}]},{"osd":6,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.375,"15min":1.4419999999999999},"min":{"1min":0.92000000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9370000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.3859999999999999,"15min":1.504},"min":{"1min":0.97599999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8700000000000001,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.4770000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.482,"15min":1.639},"min":{"1min":1.111,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.925,"5min":5.29,"15min":5.29},"last":1.548},{"interface":"front","average":{"1min":1.444,"5min":1.3720000000000001,"15min":1.4390000000000001},"min":{"1min":1.0880000000000001,"5min":0.752,"15min":0.752},"max":{"1min":1.76,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.421}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:09:13.622 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:09:13.622 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-22T05:09:13.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.823+0000 7f176f200700 1 Processor -- start 2024-01-22T05:09:13.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.823+0000 7f176f200700 1 -- start start 2024-01-22T05:09:13.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.827+0000 7f176f200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1770068710 0x7f17701577d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:13.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.827+0000 7f176f200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1770065ca0 0x7f1770157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:13.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.827+0000 7f176f200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1770068280 con 0x7f1770068af0 2024-01-22T05:09:13.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.827+0000 7f176f200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17701581b0 con 0x7f1770065ca0 2024-01-22T05:09:13.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.827+0000 7f176f200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1770069600 con 0x7f1770068710 2024-01-22T05:09:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.827+0000 7f176d400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1770068af0 0x7f1770065590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53032/0 (socket says 172.21.15.49:53032) 2024-01-22T05:09:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.827+0000 7f176d400700 1 -- 172.21.15.49:0/2100226439 learned_addr learned my addr 172.21.15.49:0/2100226439 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.827+0000 7f176de00700 1 --2- 172.21.15.49:0/2100226439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1770068710 0x7f17701577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.827+0000 7f176e800700 1 --2- 172.21.15.49:0/2100226439 >> v2:172.21.15.49:3300/0 conn(0x7f1770065ca0 0x7f1770157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.827+0000 7f176ca00700 1 -- 172.21.15.49:0/2100226439 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797404070 0 0) 0x7f1770068280 con 0x7f1770068af0 2024-01-22T05:09:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.827+0000 7f176ca00700 1 -- 172.21.15.49:0/2100226439 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17500033f0 con 0x7f1770068af0 2024-01-22T05:09:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176e800700 1 -- 172.21.15.49:0/2100226439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1770068710 msgr2=0x7f17701577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176e800700 1 --2- 172.21.15.49:0/2100226439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1770068710 0x7f17701577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176ca00700 1 -- 172.21.15.49:0/2100226439 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1396514356 0 0) 0x7f17500033f0 con 0x7f1770068af0 2024-01-22T05:09:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176e800700 1 -- 172.21.15.49:0/2100226439 >> v1:172.21.15.49:6789/0 conn(0x7f1770068af0 legacy=0x7f1770065590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176e800700 1 -- 172.21.15.49:0/2100226439 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17700c1cc0 con 0x7f1770065ca0 2024-01-22T05:09:13.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176e800700 1 --2- 172.21.15.49:0/2100226439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1770065ca0 0x7f1770157cc0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f1768009e60 tx=0x7f1768009780).ready entity=mon.0 client_cookie=b7a9040293eb39cd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:13.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176ca00700 1 -- 172.21.15.49:0/2100226439 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176800e070 con 0x7f1770065ca0 2024-01-22T05:09:13.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176ca00700 1 -- 172.21.15.49:0/2100226439 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176800b7a0 con 0x7f1770065ca0 2024-01-22T05:09:13.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176ca00700 1 -- 172.21.15.49:0/2100226439 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758001470 con 0x7f1770065ca0 2024-01-22T05:09:13.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176f200700 1 -- 172.21.15.49:0/2100226439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1770065ca0 msgr2=0x7f1770157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:13.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176f200700 1 --2- 172.21.15.49:0/2100226439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1770065ca0 0x7f1770157cc0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f1768009e60 tx=0x7f1768009780).stop 2024-01-22T05:09:13.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176f200700 1 -- 172.21.15.49:0/2100226439 shutdown_connections 2024-01-22T05:09:13.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176f200700 1 --2- 172.21.15.49:0/2100226439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1770065ca0 0x7f1770157cc0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:13.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176f200700 1 --2- 172.21.15.49:0/2100226439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1770068710 0x7f17701577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:13.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176f200700 1 -- 172.21.15.49:0/2100226439 >> 172.21.15.49:0/2100226439 conn(0x7f17700c6fc0 msgr2=0x7f17700c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176f200700 1 -- 172.21.15.49:0/2100226439 shutdown_connections 2024-01-22T05:09:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.831+0000 7f176f200700 1 -- 172.21.15.49:0/2100226439 wait complete. 2024-01-22T05:09:13.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.835+0000 7f176f200700 1 Processor -- start 2024-01-22T05:09:13.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.835+0000 7f176f200700 1 -- start start 2024-01-22T05:09:13.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176f200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1770065ca0 0x7f17701642e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:13.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176f200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1770068710 0x7f17700a9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:13.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176f200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1770068af0 0x7f177014cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:13.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176f200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17700aa7a0 con 0x7f1770068710 2024-01-22T05:09:13.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176f200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17700aaa80 con 0x7f1770065ca0 2024-01-22T05:09:13.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176f200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17700aad60 con 0x7f1770068af0 2024-01-22T05:09:13.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1770068710 0x7f17700a9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:13.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1770068710 0x7f17700a9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35716/0 (socket says 172.21.15.49:35716) 2024-01-22T05:09:13.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176d400700 1 -- 172.21.15.49:0/250519168 learned_addr learned my addr 172.21.15.49:0/250519168 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:13.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176e800700 1 --2- 172.21.15.49:0/250519168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1770068af0 0x7f177014cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:13.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176de00700 1 --2- 172.21.15.49:0/250519168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1770065ca0 0x7f17701642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:13.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176d400700 1 -- 172.21.15.49:0/250519168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1770068af0 msgr2=0x7f177014cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:13.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176d400700 1 --2- 172.21.15.49:0/250519168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1770068af0 0x7f177014cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:13.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176d400700 1 -- 172.21.15.49:0/250519168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1770065ca0 msgr2=0x7f17701642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:13.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176d400700 1 --2- 172.21.15.49:0/250519168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1770065ca0 0x7f17701642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:13.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176d400700 1 -- 172.21.15.49:0/250519168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1768009a20 con 0x7f1770068710 2024-01-22T05:09:13.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176d400700 1 --2- 172.21.15.49:0/250519168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1770068710 0x7f17700a9f20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f1758001ed0 tx=0x7f1758001a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:13.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f1765600700 1 -- 172.21.15.49:0/250519168 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758007320 con 0x7f1770068710 2024-01-22T05:09:13.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f1765600700 1 -- 172.21.15.49:0/250519168 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1758007480 con 0x7f1770068710 2024-01-22T05:09:13.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176f200700 1 -- 172.21.15.49:0/250519168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17700ab040 con 0x7f1770068710 2024-01-22T05:09:13.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f1765600700 1 -- 172.21.15.49:0/250519168 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17580059d0 con 0x7f1770068710 2024-01-22T05:09:13.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.839+0000 7f176f200700 1 -- 172.21.15.49:0/250519168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17700aa410 con 0x7f1770068710 2024-01-22T05:09:13.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.843+0000 7f176f200700 1 -- 172.21.15.49:0/250519168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17700ab4c0 con 0x7f1770068710 2024-01-22T05:09:13.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.843+0000 7f1765600700 1 -- 172.21.15.49:0/250519168 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1758005d40 con 0x7f1770068710 2024-01-22T05:09:13.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.847+0000 7f1765600700 1 --2- 172.21.15.49:0/250519168 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f174805a510 0x7f174805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:13.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.847+0000 7f1765600700 1 -- 172.21.15.49:0/250519168 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f1758074910 con 0x7f1770068710 2024-01-22T05:09:13.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.847+0000 7f176de00700 1 --2- 172.21.15.49:0/250519168 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f174805a510 0x7f174805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:13.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.847+0000 7f176de00700 1 --2- 172.21.15.49:0/250519168 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f174805a510 0x7f174805c9d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f1760006fd0 tx=0x7f1760006f40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:13.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:13.851+0000 7f1765600700 1 -- 172.21.15.49:0/250519168 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1758047ed0 con 0x7f1770068710 2024-01-22T05:09:14.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.067+0000 7f176f200700 1 -- 172.21.15.49:0/250519168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1770047060 con 0x7f1770068710 2024-01-22T05:09:14.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.075+0000 7f1765600700 1 -- 172.21.15.49:0/250519168 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f175804b4f0 con 0x7f1770068710 2024-01-22T05:09:14.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.079+0000 7f176f200700 1 -- 172.21.15.49:0/250519168 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f174805a510 msgr2=0x7f174805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:14.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.079+0000 7f176f200700 1 --2- 172.21.15.49:0/250519168 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f174805a510 0x7f174805c9d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f1760006fd0 tx=0x7f1760006f40).stop 2024-01-22T05:09:14.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.079+0000 7f176f200700 1 -- 172.21.15.49:0/250519168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1770068710 msgr2=0x7f17700a9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:14.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.079+0000 7f176f200700 1 --2- 172.21.15.49:0/250519168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1770068710 0x7f17700a9f20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f1758001ed0 tx=0x7f1758001a10).stop 2024-01-22T05:09:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.079+0000 7f176f200700 1 -- 172.21.15.49:0/250519168 shutdown_connections 2024-01-22T05:09:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.079+0000 7f176f200700 1 --2- 172.21.15.49:0/250519168 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f174805a510 0x7f174805c9d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.079+0000 7f176f200700 1 --2- 172.21.15.49:0/250519168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1770068af0 0x7f177014cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.079+0000 7f176f200700 1 --2- 172.21.15.49:0/250519168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1770068710 0x7f17700a9f20 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.079+0000 7f176f200700 1 --2- 172.21.15.49:0/250519168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1770065ca0 0x7f17701642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:14.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.079+0000 7f176f200700 1 -- 172.21.15.49:0/250519168 >> 172.21.15.49:0/250519168 conn(0x7f17700c6fc0 msgr2=0x7f1770065590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:14.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.079+0000 7f176f200700 1 -- 172.21.15.49:0/250519168 shutdown_connections 2024-01-22T05:09:14.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.079+0000 7f176f200700 1 -- 172.21.15.49:0/250519168 wait complete. 2024-01-22T05:09:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-01-22T05:09:14.104 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:09:14.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.263+0000 7ff141200700 1 Processor -- start 2024-01-22T05:09:14.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.263+0000 7ff141200700 1 -- start start 2024-01-22T05:09:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.267+0000 7ff141200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff13c0bdf60 0x7ff13c150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.267+0000 7ff141200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff13c068ba0 0x7ff13c069020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.267+0000 7ff141200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c151db0 con 0x7ff13c1549d0 2024-01-22T05:09:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.267+0000 7ff141200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c0a9f10 con 0x7ff13c068ba0 2024-01-22T05:09:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.267+0000 7ff141200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c154580 con 0x7ff13c0bdf60 2024-01-22T05:09:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.267+0000 7ff139400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff13c068ba0 0x7ff13c069020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.267+0000 7ff139400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff13c068ba0 0x7ff13c069020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35728/0 (socket says 172.21.15.49:35728) 2024-01-22T05:09:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.267+0000 7ff139400700 1 -- 172.21.15.49:0/1757164356 learned_addr learned my addr 172.21.15.49:0/1757164356 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.267+0000 7ff139e00700 1 --2- 172.21.15.49:0/1757164356 >> v2:172.21.15.110:3300/0 conn(0x7ff13c0bdf60 0x7ff13c150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.267+0000 7ff139400700 1 -- 172.21.15.49:0/1757164356 >> v2:172.21.15.110:3300/0 conn(0x7ff13c0bdf60 msgr2=0x7ff13c150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.267+0000 7ff139400700 1 --2- 172.21.15.49:0/1757164356 >> v2:172.21.15.110:3300/0 conn(0x7ff13c0bdf60 0x7ff13c150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.267+0000 7ff139400700 1 -- 172.21.15.49:0/1757164356 >> v1:172.21.15.110:6789/0 conn(0x7ff13c1549d0 legacy=0x7ff13c0c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.267+0000 7ff139400700 1 -- 172.21.15.49:0/1757164356 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c151510 con 0x7ff13c068ba0 2024-01-22T05:09:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.271+0000 7ff139400700 1 --2- 172.21.15.49:0/1757164356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c068ba0 0x7ff13c069020 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7ff13c065b50 tx=0x7ff1240090f0).ready entity=mon.0 client_cookie=45dea542a0ee1afd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.271+0000 7ff138a00700 1 -- 172.21.15.49:0/1757164356 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400b520 con 0x7ff13c068ba0 2024-01-22T05:09:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.271+0000 7ff138a00700 1 -- 172.21.15.49:0/1757164356 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12400b680 con 0x7ff13c068ba0 2024-01-22T05:09:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.271+0000 7ff138a00700 1 -- 172.21.15.49:0/1757164356 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400ba20 con 0x7ff13c068ba0 2024-01-22T05:09:14.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.271+0000 7ff141200700 1 -- 172.21.15.49:0/1757164356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c068ba0 msgr2=0x7ff13c069020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:14.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.271+0000 7ff141200700 1 --2- 172.21.15.49:0/1757164356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c068ba0 0x7ff13c069020 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7ff13c065b50 tx=0x7ff1240090f0).stop 2024-01-22T05:09:14.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.271+0000 7ff141200700 1 -- 172.21.15.49:0/1757164356 shutdown_connections 2024-01-22T05:09:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.271+0000 7ff141200700 1 --2- 172.21.15.49:0/1757164356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c068ba0 0x7ff13c069020 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.271+0000 7ff141200700 1 --2- 172.21.15.49:0/1757164356 >> v2:172.21.15.110:3300/0 conn(0x7ff13c0bdf60 0x7ff13c150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.271+0000 7ff141200700 1 -- 172.21.15.49:0/1757164356 >> 172.21.15.49:0/1757164356 conn(0x7ff13c0c40c0 msgr2=0x7ff13c0c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.271+0000 7ff141200700 1 -- 172.21.15.49:0/1757164356 shutdown_connections 2024-01-22T05:09:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.271+0000 7ff141200700 1 -- 172.21.15.49:0/1757164356 wait complete. 2024-01-22T05:09:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.275+0000 7ff141200700 1 Processor -- start 2024-01-22T05:09:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.275+0000 7ff141200700 1 -- start start 2024-01-22T05:09:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.275+0000 7ff141200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff13c068ba0 0x7ff13c0ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:14.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.275+0000 7ff141200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c0bdf60 0x7ff13c0c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:14.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.275+0000 7ff141200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff13c1549d0 0x7ff13c0c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:14.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff141200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0c3d70 con 0x7ff13c0bdf60 2024-01-22T05:09:14.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff141200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0ac700 con 0x7ff13c1549d0 2024-01-22T05:09:14.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff141200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0abaf0 con 0x7ff13c068ba0 2024-01-22T05:09:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff139400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c0bdf60 0x7ff13c0c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff139400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c0bdf60 0x7ff13c0c3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35738/0 (socket says 172.21.15.49:35738) 2024-01-22T05:09:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff139400700 1 -- 172.21.15.49:0/3980999654 learned_addr learned my addr 172.21.15.49:0/3980999654 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff139e00700 1 --2- 172.21.15.49:0/3980999654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff13c068ba0 0x7ff13c0ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff13a800700 1 --2- 172.21.15.49:0/3980999654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff13c1549d0 0x7ff13c0c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff139400700 1 -- 172.21.15.49:0/3980999654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff13c068ba0 msgr2=0x7ff13c0ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff139400700 1 --2- 172.21.15.49:0/3980999654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff13c068ba0 0x7ff13c0ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff139400700 1 -- 172.21.15.49:0/3980999654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff13c1549d0 msgr2=0x7ff13c0c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff139400700 1 --2- 172.21.15.49:0/3980999654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff13c1549d0 0x7ff13c0c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff139400700 1 -- 172.21.15.49:0/3980999654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff124009370 con 0x7ff13c0bdf60 2024-01-22T05:09:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff139400700 1 --2- 172.21.15.49:0/3980999654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c0bdf60 0x7ff13c0c3390 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7ff124006fd0 tx=0x7ff124017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff131600700 1 -- 172.21.15.49:0/3980999654 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124006d90 con 0x7ff13c0bdf60 2024-01-22T05:09:14.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff131600700 1 -- 172.21.15.49:0/3980999654 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff124000bc0 con 0x7ff13c0bdf60 2024-01-22T05:09:14.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff131600700 1 -- 172.21.15.49:0/3980999654 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124024470 con 0x7ff13c0bdf60 2024-01-22T05:09:14.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff141200700 1 -- 172.21.15.49:0/3980999654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c0abdd0 con 0x7ff13c0bdf60 2024-01-22T05:09:14.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.279+0000 7ff141200700 1 -- 172.21.15.49:0/3980999654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c0ac390 con 0x7ff13c0bdf60 2024-01-22T05:09:14.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.283+0000 7ff141200700 1 -- 172.21.15.49:0/3980999654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c0ac870 con 0x7ff13c0bdf60 2024-01-22T05:09:14.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.283+0000 7ff131600700 1 -- 172.21.15.49:0/3980999654 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff124021070 con 0x7ff13c0bdf60 2024-01-22T05:09:14.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.283+0000 7ff131600700 1 --2- 172.21.15.49:0/3980999654 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff11405a510 0x7ff11405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:14.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.283+0000 7ff131600700 1 -- 172.21.15.49:0/3980999654 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff124076160 con 0x7ff13c0bdf60 2024-01-22T05:09:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.283+0000 7ff139e00700 1 --2- 172.21.15.49:0/3980999654 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff11405a510 0x7ff11405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.283+0000 7ff139e00700 1 --2- 172.21.15.49:0/3980999654 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff11405a510 0x7ff11405c9d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7ff12c009c30 tx=0x7ff12c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.291+0000 7ff131600700 1 -- 172.21.15.49:0/3980999654 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff1240497e0 con 0x7ff13c0bdf60 2024-01-22T05:09:14.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.487+0000 7ff141200700 1 -- 172.21.15.49:0/3980999654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff13c1517f0 con 0x7ff13c0bdf60 2024-01-22T05:09:14.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.487+0000 7ff131600700 1 -- 172.21.15.49:0/3980999654 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4497 (secure 0 0 0) 0x7ff124029070 con 0x7ff13c0bdf60 2024-01-22T05:09:14.491 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:14.491 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":56,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5729,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2604306838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2604306838},{"type":"v1","addr":"172.21.15.49:6835","nonce":2604306838}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2092666136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2092666136},{"type":"v1","addr":"172.21.15.110:6833","nonce":2092666136}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1078192149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1078192149},{"type":"v1","addr":"172.21.15.110:6835","nonce":1078192149}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:09:03.929962+0000","modified":"2024-01-22T05:09:07.150662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6348":{"gid":6348,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/2817241041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2817241041},{"type":"v1","addr":"172.21.15.49:6837","nonce":2817241041}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-22T05:09:14.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.491+0000 7ff141200700 1 -- 172.21.15.49:0/3980999654 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff11405a510 msgr2=0x7ff11405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:14.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.491+0000 7ff141200700 1 --2- 172.21.15.49:0/3980999654 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff11405a510 0x7ff11405c9d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7ff12c009c30 tx=0x7ff12c009060).stop 2024-01-22T05:09:14.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.491+0000 7ff141200700 1 -- 172.21.15.49:0/3980999654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c0bdf60 msgr2=0x7ff13c0c3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:14.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.491+0000 7ff141200700 1 --2- 172.21.15.49:0/3980999654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c0bdf60 0x7ff13c0c3390 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7ff124006fd0 tx=0x7ff124017000).stop 2024-01-22T05:09:14.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.491+0000 7ff141200700 1 -- 172.21.15.49:0/3980999654 shutdown_connections 2024-01-22T05:09:14.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.491+0000 7ff141200700 1 --2- 172.21.15.49:0/3980999654 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff11405a510 0x7ff11405c9d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:14.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.491+0000 7ff141200700 1 --2- 172.21.15.49:0/3980999654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff13c1549d0 0x7ff13c0c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:14.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.491+0000 7ff141200700 1 --2- 172.21.15.49:0/3980999654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff13c0bdf60 0x7ff13c0c3390 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:14.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.491+0000 7ff141200700 1 --2- 172.21.15.49:0/3980999654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff13c068ba0 0x7ff13c0ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:14.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.491+0000 7ff141200700 1 -- 172.21.15.49:0/3980999654 >> 172.21.15.49:0/3980999654 conn(0x7ff13c0c40c0 msgr2=0x7ff13c151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:14.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.491+0000 7ff141200700 1 -- 172.21.15.49:0/3980999654 shutdown_connections 2024-01-22T05:09:14.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:14.491+0000 7ff141200700 1 -- 172.21.15.49:0/3980999654 wait complete. 2024-01-22T05:09:14.501 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 56 2024-01-22T05:09:14.923 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:09:03.929962+0000', 'modified': '2024-01-22T05:09:07.150662+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6348}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6348': {'gid': 6348, 'name': 'a', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6837/2817241041', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6836', 'nonce': 2817241041}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 2817241041}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:09:14.924 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:09:14.924 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-22T05:09:15.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.095+0000 7f43e2000700 1 Processor -- start 2024-01-22T05:09:15.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.095+0000 7f43e2000700 1 -- start start 2024-01-22T05:09:15.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43e2000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43dc155d20 0x7f43dc065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43e2000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc066070 0x7f43dc0a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43e2000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43dc0c1a40 con 0x7f43dc0a8c30 2024-01-22T05:09:15.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43e2000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc0a9090 con 0x7f43dc155d20 2024-01-22T05:09:15.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43e2000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc159310 con 0x7f43dc066070 2024-01-22T05:09:15.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43db400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43dc155d20 0x7f43dc065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43daa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc066070 0x7f43dc0a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43dbe00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f43dc0a8c30 0x7f43dc0c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:48964/0 (socket says 172.21.15.49:48964) 2024-01-22T05:09:15.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43dbe00700 1 -- 172.21.15.49:0/2527628854 learned_addr learned my addr 172.21.15.49:0/2527628854 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:15.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43da000700 1 -- 172.21.15.49:0/2527628854 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247983116 0 0) 0x7f43dc0c1a40 con 0x7f43dc0a8c30 2024-01-22T05:09:15.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43daa00700 1 -- 172.21.15.49:0/2527628854 >> v2:172.21.15.110:3300/0 conn(0x7f43dc155d20 msgr2=0x7f43dc065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:15.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43daa00700 1 --2- 172.21.15.49:0/2527628854 >> v2:172.21.15.110:3300/0 conn(0x7f43dc155d20 0x7f43dc065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43daa00700 1 -- 172.21.15.49:0/2527628854 >> v1:172.21.15.110:6789/0 conn(0x7f43dc0a8c30 legacy=0x7f43dc0c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43daa00700 1 -- 172.21.15.49:0/2527628854 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc0c13f0 con 0x7f43dc066070 2024-01-22T05:09:15.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43db400700 1 --2- 172.21.15.49:0/2527628854 >> v2:172.21.15.110:3300/0 conn(0x7f43dc155d20 0x7f43dc065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:15.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43daa00700 1 --2- 172.21.15.49:0/2527628854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc066070 0x7f43dc0a8740 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f43c4009760 tx=0x7f43c4009060).ready entity=mon.2 client_cookie=ca12fb4ea0192ff5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:15.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43da000700 1 -- 172.21.15.49:0/2527628854 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c400f510 con 0x7f43dc066070 2024-01-22T05:09:15.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43da000700 1 -- 172.21.15.49:0/2527628854 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c400f670 con 0x7f43dc066070 2024-01-22T05:09:15.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.099+0000 7f43da000700 1 -- 172.21.15.49:0/2527628854 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c400f9f0 con 0x7f43dc066070 2024-01-22T05:09:15.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.103+0000 7f43e2000700 1 -- 172.21.15.49:0/2527628854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc066070 msgr2=0x7f43dc0a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.103+0000 7f43e2000700 1 --2- 172.21.15.49:0/2527628854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc066070 0x7f43dc0a8740 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f43c4009760 tx=0x7f43c4009060).stop 2024-01-22T05:09:15.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.103+0000 7f43e2000700 1 -- 172.21.15.49:0/2527628854 shutdown_connections 2024-01-22T05:09:15.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.103+0000 7f43e2000700 1 --2- 172.21.15.49:0/2527628854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc066070 0x7f43dc0a8740 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.103+0000 7f43e2000700 1 --2- 172.21.15.49:0/2527628854 >> v2:172.21.15.110:3300/0 conn(0x7f43dc155d20 0x7f43dc065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.103+0000 7f43e2000700 1 -- 172.21.15.49:0/2527628854 >> 172.21.15.49:0/2527628854 conn(0x7f43dc0c6540 msgr2=0x7f43dc0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:15.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.103+0000 7f43e2000700 1 -- 172.21.15.49:0/2527628854 shutdown_connections 2024-01-22T05:09:15.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.103+0000 7f43e2000700 1 -- 172.21.15.49:0/2527628854 wait complete. 2024-01-22T05:09:15.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.107+0000 7f43e2000700 1 Processor -- start 2024-01-22T05:09:15.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.107+0000 7f43e2000700 1 -- start start 2024-01-22T05:09:15.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43e2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43dc066070 0x7f43dc0aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43e2000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0a8c30 0x7f43dc144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43e2000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43dc155d20 0x7f43dc1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43e2000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc144d80 con 0x7f43dc066070 2024-01-22T05:09:15.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43e2000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0bd9f0 con 0x7f43dc155d20 2024-01-22T05:09:15.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43e2000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc156ac0 con 0x7f43dc0a8c30 2024-01-22T05:09:15.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43db400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43dc066070 0x7f43dc0aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43db400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43dc066070 0x7f43dc0aa130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35740/0 (socket says 172.21.15.49:35740) 2024-01-22T05:09:15.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43db400700 1 -- 172.21.15.49:0/1185977459 learned_addr learned my addr 172.21.15.49:0/1185977459 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:15.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43dbe00700 1 --2- 172.21.15.49:0/1185977459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43dc155d20 0x7f43dc1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43daa00700 1 --2- 172.21.15.49:0/1185977459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0a8c30 0x7f43dc144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43db400700 1 -- 172.21.15.49:0/1185977459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0a8c30 msgr2=0x7f43dc144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43db400700 1 --2- 172.21.15.49:0/1185977459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0a8c30 0x7f43dc144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43db400700 1 -- 172.21.15.49:0/1185977459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43dc155d20 msgr2=0x7f43dc1561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43db400700 1 --2- 172.21.15.49:0/1185977459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43dc155d20 0x7f43dc1561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43db400700 1 -- 172.21.15.49:0/1185977459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc0092a0 con 0x7f43dc066070 2024-01-22T05:09:15.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43daa00700 1 --2- 172.21.15.49:0/1185977459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0a8c30 0x7f43dc144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:15.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43db400700 1 --2- 172.21.15.49:0/1185977459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43dc066070 0x7f43dc0aa130 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f43cc00e980 tx=0x7f43cc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:15.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43d2a00700 1 -- 172.21.15.49:0/1185977459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00ee70 con 0x7f43dc066070 2024-01-22T05:09:15.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43d2a00700 1 -- 172.21.15.49:0/1185977459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc00c850 con 0x7f43dc066070 2024-01-22T05:09:15.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43e2000700 1 -- 172.21.15.49:0/1185977459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c40092a0 con 0x7f43dc066070 2024-01-22T05:09:15.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43d2a00700 1 -- 172.21.15.49:0/1185977459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00cbd0 con 0x7f43dc066070 2024-01-22T05:09:15.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.111+0000 7f43e2000700 1 -- 172.21.15.49:0/1185977459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc157080 con 0x7f43dc066070 2024-01-22T05:09:15.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.119+0000 7f43d2a00700 1 -- 172.21.15.49:0/1185977459 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f43cc01b400 con 0x7f43dc066070 2024-01-22T05:09:15.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.119+0000 7f43d2a00700 1 --2- 172.21.15.49:0/1185977459 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f43b405a4e0 0x7f43b405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.119+0000 7f43d2a00700 1 -- 172.21.15.49:0/1185977459 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f43cc074e30 con 0x7f43dc066070 2024-01-22T05:09:15.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.119+0000 7f43daa00700 1 --2- 172.21.15.49:0/1185977459 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f43b405a4e0 0x7f43b405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.119+0000 7f43ec3d3740 1 Processor -- start 2024-01-22T05:09:15.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43daa00700 1 --2- 172.21.15.49:0/1185977459 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f43b405a4e0 0x7f43b405c9a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f43dc152d90 tx=0x7f43c4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:15.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43ec3d3740 1 -- start start 2024-01-22T05:09:15.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43ec3d3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x225dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43ec3d3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2238e40 0x2234af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43ec3d3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279780 0x22323a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43ec3d3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x21b8410 con 0x2279780 2024-01-22T05:09:15.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43ec3d3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x21b8550 con 0x2238e40 2024-01-22T05:09:15.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43ec3d3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x21b8a00 con 0x22793a0 2024-01-22T05:09:15.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43dbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279780 0x22323a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43dbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279780 0x22323a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35752/0 (socket says 172.21.15.49:35752) 2024-01-22T05:09:15.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43dbe00700 1 -- 172.21.15.49:0/2672908096 learned_addr learned my addr 172.21.15.49:0/2672908096 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:15.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43db400700 1 --2- 172.21.15.49:0/2672908096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x225dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43daa00700 1 --2- 172.21.15.49:0/2672908096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2238e40 0x2234af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43dbe00700 1 -- 172.21.15.49:0/2672908096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 msgr2=0x225dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:15.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43dbe00700 1 --2- 172.21.15.49:0/2672908096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x225dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43dbe00700 1 -- 172.21.15.49:0/2672908096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2238e40 msgr2=0x2234af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:15.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43dbe00700 1 --2- 172.21.15.49:0/2672908096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2238e40 0x2234af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43dbe00700 1 -- 172.21.15.49:0/2672908096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21b1730 con 0x2279780 2024-01-22T05:09:15.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43daa00700 1 --2- 172.21.15.49:0/2672908096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2238e40 0x2234af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:15.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43dbe00700 1 --2- 172.21.15.49:0/2672908096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279780 0x22323a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f43d4001c60 tx=0x7f43d4007eb0).ready entity=mon.0 client_cookie=7ea4117a1060870f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:15.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43cb000700 1 -- 172.21.15.49:0/2672908096 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4004ca0 con 0x2279780 2024-01-22T05:09:15.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43cb000700 1 -- 172.21.15.49:0/2672908096 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d40074f0 con 0x2279780 2024-01-22T05:09:15.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.123+0000 7f43cb000700 1 -- 172.21.15.49:0/2672908096 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4007890 con 0x2279780 2024-01-22T05:09:15.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.127+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2672908096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279780 msgr2=0x22323a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.127+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2672908096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279780 0x22323a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f43d4001c60 tx=0x7f43d4007eb0).stop 2024-01-22T05:09:15.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.127+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2672908096 shutdown_connections 2024-01-22T05:09:15.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.127+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2672908096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279780 0x22323a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.127+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2672908096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2238e40 0x2234af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.127+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2672908096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x225dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.127+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2672908096 >> 172.21.15.49:0/2672908096 conn(0x2016550 msgr2=0x2238730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:15.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.127+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2672908096 shutdown_connections 2024-01-22T05:09:15.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.127+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2672908096 wait complete. 2024-01-22T05:09:15.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.127+0000 7f43ec3d3740 1 -- start start 2024-01-22T05:09:15.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.131+0000 7f43ec3d3740 1 Processor -- start 2024-01-22T05:09:15.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.131+0000 7f43ec3d3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2238e40 0x225ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.131+0000 7f43ec3d3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x227c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.131+0000 7f43ec3d3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279780 0x225c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.131+0000 7f43ec3d3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2183650 con 0x2238e40 2024-01-22T05:09:15.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.131+0000 7f43ec3d3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x22611f0 con 0x2279780 2024-01-22T05:09:15.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.131+0000 7f43ec3d3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x225fa20 con 0x22793a0 2024-01-22T05:09:15.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.131+0000 7f43ec3d3740 10 client.0 ll_register_callbacks cb 0x21f0020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:09:15.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.131+0000 7f43db400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2238e40 0x225ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.131+0000 7f43db400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2238e40 0x225ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35754/0 (socket says 172.21.15.49:35754) 2024-01-22T05:09:15.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.131+0000 7f43db400700 1 -- 172.21.15.49:0/2796241871 learned_addr learned my addr 172.21.15.49:0/2796241871 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:15.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.131+0000 7f43dbe00700 1 --2- 172.21.15.49:0/2796241871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279780 0x225c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.131+0000 7f43daa00700 1 --2- 172.21.15.49:0/2796241871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x227c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43db400700 1 -- 172.21.15.49:0/2796241871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 msgr2=0x227c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:15.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43db400700 1 --2- 172.21.15.49:0/2796241871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x227c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43db400700 1 -- 172.21.15.49:0/2796241871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279780 msgr2=0x225c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:15.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43db400700 1 --2- 172.21.15.49:0/2796241871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279780 0x225c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43db400700 1 -- 172.21.15.49:0/2796241871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d4001860 con 0x2238e40 2024-01-22T05:09:15.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43db400700 1 --2- 172.21.15.49:0/2796241871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2238e40 0x225ad40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f43cc00c430 tx=0x7f43cc01d040).ready entity=mon.0 client_cookie=19fa99793ef9e5ec server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:15.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43c3400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:09:15.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43c3400700 1 -- 172.21.15.49:0/2796241871 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc04b600 con 0x2238e40 2024-01-22T05:09:15.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43c3400700 1 -- 172.21.15.49:0/2796241871 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f43cc04b760 con 0x2238e40 2024-01-22T05:09:15.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2796241871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x21ae1a0 con 0x2238e40 2024-01-22T05:09:15.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43c3400700 1 -- 172.21.15.49:0/2796241871 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43cc048110 con 0x2238e40 2024-01-22T05:09:15.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43ec3d3740 10 client.6513 fetch_fsmap learned FSMap version 56 2024-01-22T05:09:15.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2796241871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x21ac960 con 0x2238e40 2024-01-22T05:09:15.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43c3400700 1 -- 172.21.15.49:0/2796241871 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x21ae1a0 con 0x2238e40 2024-01-22T05:09:15.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43c3400700 1 -- 172.21.15.49:0/2796241871 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f43cc04b070 con 0x2238e40 2024-01-22T05:09:15.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43ec3d3740 10 client.6513 fetch_fsmap finished waiting for FSMap version 56 2024-01-22T05:09:15.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43ec3d3740 10 client.6513 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:09:15.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43ec3d3740 20 client.6513 populate_metadata read hostname 'smithi049' 2024-01-22T05:09:15.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2796241871 >> [v2:172.21.15.49:6836/2817241041,v1:172.21.15.49:6837/2817241041] conn(0x2263f90 0x2264370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43ec3d3740 4 client.6513 mds_command: new command op to 6348 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:09:15.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2796241871 --> [v2:172.21.15.49:6836/2817241041,v1:172.21.15.49:6837/2817241041] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x21a46f0 con 0x2263f90 2024-01-22T05:09:15.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43daa00700 1 --2- 172.21.15.49:0/2796241871 >> [v2:172.21.15.49:6836/2817241041,v1:172.21.15.49:6837/2817241041] conn(0x2263f90 0x2264370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43daa00700 1 --2- 172.21.15.49:0/2796241871 >> [v2:172.21.15.49:6836/2817241041,v1:172.21.15.49:6837/2817241041] conn(0x2263f90 0x2264370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=bb0d6d78f0e95d09 server_cookie=91ba23e760303871 in_seq=0 out_seq=0 2024-01-22T05:09:15.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.135+0000 7f43c3400700 10 client.6513 ms_handle_connect on v2:172.21.15.49:6836/2817241041 2024-01-22T05:09:15.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.139+0000 7f43c3400700 1 -- 172.21.15.49:0/2796241871 <== mds.0 v2:172.21.15.49:6836/2817241041 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x21a46f0 con 0x2263f90 2024-01-22T05:09:15.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.139+0000 7f43c3400700 10 client.6513 handle_command_reply: tid=0 2024-01-22T05:09:15.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.139+0000 7f43ec3d3740 1 client.6513 shutdown 2024-01-22T05:09:15.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.139+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2796241871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2238e40 msgr2=0x225ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.139+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2796241871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2238e40 0x225ad40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f43cc00c430 tx=0x7f43cc01d040).stop 2024-01-22T05:09:15.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.139+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2796241871 shutdown_connections 2024-01-22T05:09:15.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.139+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2796241871 >> [v2:172.21.15.49:6836/2817241041,v1:172.21.15.49:6837/2817241041] conn(0x2263f90 0x2264370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.139+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2796241871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279780 0x225c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.139+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2796241871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x227c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.139+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2796241871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2238e40 0x225ad40 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.139+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2796241871 >> 172.21.15.49:0/2796241871 conn(0x2016550 msgr2=0x227f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:15.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.139+0000 7f43c3400700 0 client.6513 ms_handle_reset on v2:172.21.15.49:6836/2817241041 2024-01-22T05:09:15.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.139+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2796241871 shutdown_connections 2024-01-22T05:09:15.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.139+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2796241871 wait complete. 2024-01-22T05:09:15.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.143+0000 7f43ec3d3740 20 client.6513 trim_cache size 0 max 16384 2024-01-22T05:09:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43ec3d3740 1 Processor -- start 2024-01-22T05:09:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43ec3d3740 1 -- start start 2024-01-22T05:09:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43ec3d3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2238e40 0x2259c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43ec3d3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x2235070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43ec3d3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279780 0x2235560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43ec3d3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x22639f0 con 0x2238e40 2024-01-22T05:09:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43ec3d3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x227d600 con 0x2279780 2024-01-22T05:09:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43ec3d3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x22342b0 con 0x22793a0 2024-01-22T05:09:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43db400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2238e40 0x2259c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43db400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2238e40 0x2259c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35756/0 (socket says 172.21.15.49:35756) 2024-01-22T05:09:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43db400700 1 -- 172.21.15.49:0/1186059161 learned_addr learned my addr 172.21.15.49:0/1186059161 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43daa00700 1 --2- 172.21.15.49:0/1186059161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x2235070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43dbe00700 1 --2- 172.21.15.49:0/1186059161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279780 0x2235560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43daa00700 1 -- 172.21.15.49:0/1186059161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279780 msgr2=0x2235560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43daa00700 1 --2- 172.21.15.49:0/1186059161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279780 0x2235560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43daa00700 1 -- 172.21.15.49:0/1186059161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2238e40 msgr2=0x2259c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43daa00700 1 --2- 172.21.15.49:0/1186059161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2238e40 0x2259c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43daa00700 1 -- 172.21.15.49:0/1186059161 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc0c6c80 con 0x22793a0 2024-01-22T05:09:15.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43daa00700 1 --2- 172.21.15.49:0/1186059161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x2235070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f43dc0c2fb0 tx=0x7f43c402e280).ready entity=mon.2 client_cookie=b79cefee62272ff9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43cba00700 1 -- 172.21.15.49:0/1186059161 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4026870 con 0x22793a0 2024-01-22T05:09:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43cba00700 1 -- 172.21.15.49:0/1186059161 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c40269d0 con 0x22793a0 2024-01-22T05:09:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.163+0000 7f43cba00700 1 -- 172.21.15.49:0/1186059161 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4026b40 con 0x22793a0 2024-01-22T05:09:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.167+0000 7f43ec3d3740 1 -- 172.21.15.49:0/1186059161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 msgr2=0x2235070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.167+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/1186059161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x2235070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f43dc0c2fb0 tx=0x7f43c402e280).stop 2024-01-22T05:09:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.167+0000 7f43ec3d3740 1 -- 172.21.15.49:0/1186059161 shutdown_connections 2024-01-22T05:09:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.167+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/1186059161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279780 0x2235560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.167+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/1186059161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x2235070 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.167+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/1186059161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2238e40 0x2259c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.167+0000 7f43ec3d3740 1 -- 172.21.15.49:0/1186059161 >> 172.21.15.49:0/1186059161 conn(0x2016550 msgr2=0x2238730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.167+0000 7f43ec3d3740 1 -- 172.21.15.49:0/1186059161 shutdown_connections 2024-01-22T05:09:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.167+0000 7f43ec3d3740 1 -- 172.21.15.49:0/1186059161 wait complete. 2024-01-22T05:09:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.167+0000 7f43ec3d3740 1 -- start start 2024-01-22T05:09:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.167+0000 7f43ec3d3740 1 Processor -- start 2024-01-22T05:09:15.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43ec3d3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2238e40 0x2277520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43ec3d3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x2277a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43ec3d3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279780 0x2235070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43ec3d3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2277f00 con 0x2279780 2024-01-22T05:09:15.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43ec3d3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x22e17a0 con 0x2238e40 2024-01-22T05:09:15.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43ec3d3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x227f120 con 0x22793a0 2024-01-22T05:09:15.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43ec3d3740 10 client.0 ll_register_callbacks cb 0x7f43cc04ba70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:09:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43dbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279780 0x2235070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43dbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279780 0x2235070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35758/0 (socket says 172.21.15.49:35758) 2024-01-22T05:09:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43dbe00700 1 -- 172.21.15.49:0/2101452650 learned_addr learned my addr 172.21.15.49:0/2101452650 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43db400700 1 --2- 172.21.15.49:0/2101452650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2238e40 0x2277520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43daa00700 1 --2- 172.21.15.49:0/2101452650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x2277a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43dbe00700 1 -- 172.21.15.49:0/2101452650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 msgr2=0x2277a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43dbe00700 1 --2- 172.21.15.49:0/2101452650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x2277a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43dbe00700 1 -- 172.21.15.49:0/2101452650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2238e40 msgr2=0x2277520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43dbe00700 1 --2- 172.21.15.49:0/2101452650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2238e40 0x2277520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.171+0000 7f43dbe00700 1 -- 172.21.15.49:0/2101452650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc0c13f0 con 0x2279780 2024-01-22T05:09:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43dbe00700 1 --2- 172.21.15.49:0/2101452650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279780 0x2235070 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f43d4002250 tx=0x7f43d4017000).ready entity=mon.0 client_cookie=40ea33de9c3f2300 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43c3400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:09:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43c3400700 1 -- 172.21.15.49:0/2101452650 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4012770 con 0x2279780 2024-01-22T05:09:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43c3400700 1 -- 172.21.15.49:0/2101452650 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f43d4022dd0 con 0x2279780 2024-01-22T05:09:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2101452650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f43d40074f0 con 0x2279780 2024-01-22T05:09:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43c3400700 1 -- 172.21.15.49:0/2101452650 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43d4012ae0 con 0x2279780 2024-01-22T05:09:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43ec3d3740 10 client.6519 fetch_fsmap learned FSMap version 56 2024-01-22T05:09:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2101452650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x21ac6b0 con 0x2279780 2024-01-22T05:09:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43c3400700 1 -- 172.21.15.49:0/2101452650 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d40074f0 con 0x2279780 2024-01-22T05:09:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43c3400700 1 -- 172.21.15.49:0/2101452650 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f43d4012070 con 0x2279780 2024-01-22T05:09:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43ec3d3740 10 client.6519 fetch_fsmap finished waiting for FSMap version 56 2024-01-22T05:09:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43ec3d3740 10 client.6519 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:09:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43ec3d3740 20 client.6519 populate_metadata read hostname 'smithi049' 2024-01-22T05:09:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2101452650 >> [v2:172.21.15.49:6836/2817241041,v1:172.21.15.49:6837/2817241041] conn(0x2235560 0x2235940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43ec3d3740 4 client.6519 mds_command: new command op to 6348 tid=0[{"prefix": "status"}] 2024-01-22T05:09:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2101452650 --> [v2:172.21.15.49:6836/2817241041,v1:172.21.15.49:6837/2817241041] -- command(tid 0: {"prefix": "status"}) v1 -- 0x206d4e0 con 0x2235560 2024-01-22T05:09:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43db400700 1 --2- 172.21.15.49:0/2101452650 >> [v2:172.21.15.49:6836/2817241041,v1:172.21.15.49:6837/2817241041] conn(0x2235560 0x2235940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43db400700 1 --2- 172.21.15.49:0/2101452650 >> [v2:172.21.15.49:6836/2817241041,v1:172.21.15.49:6837/2817241041] conn(0x2235560 0x2235940 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=cb374b5c898f7f2d server_cookie=92040e07c85c87a2 in_seq=0 out_seq=0 2024-01-22T05:09:15.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43c3400700 10 client.6519 ms_handle_connect on v2:172.21.15.49:6836/2817241041 2024-01-22T05:09:15.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43c3400700 1 -- 172.21.15.49:0/2101452650 <== mds.0 v2:172.21.15.49:6836/2817241041 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x206d4e0 con 0x2235560 2024-01-22T05:09:15.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43c3400700 10 client.6519 handle_command_reply: tid=0 2024-01-22T05:09:15.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.175+0000 7f43ec3d3740 1 client.6519 shutdown 2024-01-22T05:09:15.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2101452650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279780 msgr2=0x2235070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2101452650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279780 0x2235070 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f43d4002250 tx=0x7f43d4017000).stop 2024-01-22T05:09:15.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2101452650 shutdown_connections 2024-01-22T05:09:15.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2101452650 >> [v2:172.21.15.49:6836/2817241041,v1:172.21.15.49:6837/2817241041] conn(0x2235560 0x2235940 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2101452650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279780 0x2235070 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2101452650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22793a0 0x2277a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43ec3d3740 1 --2- 172.21.15.49:0/2101452650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2238e40 0x2277520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2101452650 >> 172.21.15.49:0/2101452650 conn(0x2016550 msgr2=0x2259c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:15.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43c3400700 0 client.6519 ms_handle_reset on v2:172.21.15.49:6836/2817241041 2024-01-22T05:09:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2101452650 shutdown_connections 2024-01-22T05:09:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43ec3d3740 1 -- 172.21.15.49:0/2101452650 wait complete. 2024-01-22T05:09:15.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43ec3d3740 20 client.6519 trim_cache size 0 max 16384 2024-01-22T05:09:15.182 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:09:15.183 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:09:15.183 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:09:15.183 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6348, 2024-01-22T05:09:15.183 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:09:15.183 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:09:15.183 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:09:15.183 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 11.244347869, 2024-01-22T05:09:15.183 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 56, 2024-01-22T05:09:15.183 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 70, 2024-01-22T05:09:15.183 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 70, 2024-01-22T05:09:15.183 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 16.833989032000002 2024-01-22T05:09:15.183 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:09:15.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43e2000700 1 -- 172.21.15.49:0/1185977459 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f43b405a4e0 msgr2=0x7f43b405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43e2000700 1 --2- 172.21.15.49:0/1185977459 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f43b405a4e0 0x7f43b405c9a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f43dc152d90 tx=0x7f43c4017000).stop 2024-01-22T05:09:15.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43e2000700 1 -- 172.21.15.49:0/1185977459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43dc066070 msgr2=0x7f43dc0aa130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43e2000700 1 --2- 172.21.15.49:0/1185977459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43dc066070 0x7f43dc0aa130 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f43cc00e980 tx=0x7f43cc009060).stop 2024-01-22T05:09:15.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43e2000700 1 -- 172.21.15.49:0/1185977459 shutdown_connections 2024-01-22T05:09:15.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43e2000700 1 --2- 172.21.15.49:0/1185977459 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f43b405a4e0 0x7f43b405c9a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43e2000700 1 --2- 172.21.15.49:0/1185977459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43dc155d20 0x7f43dc1561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43e2000700 1 --2- 172.21.15.49:0/1185977459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0a8c30 0x7f43dc144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43e2000700 1 --2- 172.21.15.49:0/1185977459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43dc066070 0x7f43dc0aa130 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43e2000700 1 -- 172.21.15.49:0/1185977459 >> 172.21.15.49:0/1185977459 conn(0x7f43dc0c6540 msgr2=0x7f43dc15c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:15.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43e2000700 1 -- 172.21.15.49:0/1185977459 shutdown_connections 2024-01-22T05:09:15.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.179+0000 7f43e2000700 1 -- 172.21.15.49:0/1185977459 wait complete. 2024-01-22T05:09:15.207 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:09:15.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.339+0000 7f8354c00700 1 Processor -- start 2024-01-22T05:09:15.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.339+0000 7f8354c00700 1 -- start start 2024-01-22T05:09:15.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f8354c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8350067d30 0x7f8350063710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f8354c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83500bde10 0x7f8350063c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f8354c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8350063180 con 0x7f83500aa810 2024-01-22T05:09:15.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f8354c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8350062570 con 0x7f8350067d30 2024-01-22T05:09:15.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f8354c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8350062850 con 0x7f83500bde10 2024-01-22T05:09:15.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f834d400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8350067d30 0x7f8350063710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f834de00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f83500aa810 0x7f8350067620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53040/0 (socket says 172.21.15.49:53040) 2024-01-22T05:09:15.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f834de00700 1 -- 172.21.15.49:0/3838686098 learned_addr learned my addr 172.21.15.49:0/3838686098 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:15.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f834f200700 1 --2- 172.21.15.49:0/3838686098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83500bde10 0x7f8350063c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f834d400700 1 -- 172.21.15.49:0/3838686098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83500bde10 msgr2=0x7f8350063c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:15.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f834d400700 1 --2- 172.21.15.49:0/3838686098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83500bde10 0x7f8350063c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f834d400700 1 -- 172.21.15.49:0/3838686098 >> v1:172.21.15.49:6789/0 conn(0x7f83500aa810 legacy=0x7f8350067620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f834d400700 1 -- 172.21.15.49:0/3838686098 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8350062b30 con 0x7f8350067d30 2024-01-22T05:09:15.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f834ca00700 1 -- 172.21.15.49:0/3838686098 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519755760 0 0) 0x7f8350063180 con 0x7f83500aa810 2024-01-22T05:09:15.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f834d400700 1 --2- 172.21.15.49:0/3838686098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8350067d30 0x7f8350063710 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f8338009760 tx=0x7f8338009060).ready entity=mon.0 client_cookie=37f860734727b899 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:15.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f834ca00700 1 -- 172.21.15.49:0/3838686098 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83380090d0 con 0x7f8350067d30 2024-01-22T05:09:15.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f834ca00700 1 -- 172.21.15.49:0/3838686098 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833800f510 con 0x7f8350067d30 2024-01-22T05:09:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f834ca00700 1 -- 172.21.15.49:0/3838686098 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800f890 con 0x7f8350067d30 2024-01-22T05:09:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f8354c00700 1 -- 172.21.15.49:0/3838686098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8350067d30 msgr2=0x7f8350063710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.343+0000 7f8354c00700 1 --2- 172.21.15.49:0/3838686098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8350067d30 0x7f8350063710 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f8338009760 tx=0x7f8338009060).stop 2024-01-22T05:09:15.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.347+0000 7f8354c00700 1 -- 172.21.15.49:0/3838686098 shutdown_connections 2024-01-22T05:09:15.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.347+0000 7f8354c00700 1 --2- 172.21.15.49:0/3838686098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83500bde10 0x7f8350063c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.347+0000 7f8354c00700 1 --2- 172.21.15.49:0/3838686098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8350067d30 0x7f8350063710 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.347+0000 7f8354c00700 1 -- 172.21.15.49:0/3838686098 >> 172.21.15.49:0/3838686098 conn(0x7f83500c4940 msgr2=0x7f83500c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:15.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.347+0000 7f8354c00700 1 -- 172.21.15.49:0/3838686098 shutdown_connections 2024-01-22T05:09:15.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.347+0000 7f8354c00700 1 -- 172.21.15.49:0/3838686098 wait complete. 2024-01-22T05:09:15.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.347+0000 7f8354c00700 1 Processor -- start 2024-01-22T05:09:15.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.351+0000 7f8354c00700 1 -- start start 2024-01-22T05:09:15.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.351+0000 7f8354c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8350067d30 0x7f83500c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.351+0000 7f8354c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83500aa810 0x7f83500c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.351+0000 7f8354c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83500bde10 0x7f83500bf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.351+0000 7f8354c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8350136890 con 0x7f8350067d30 2024-01-22T05:09:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.351+0000 7f8354c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83500c3d00 con 0x7f83500bde10 2024-01-22T05:09:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.351+0000 7f8354c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83500c2e80 con 0x7f83500aa810 2024-01-22T05:09:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.351+0000 7f834de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8350067d30 0x7f83500c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.351+0000 7f834de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8350067d30 0x7f83500c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35780/0 (socket says 172.21.15.49:35780) 2024-01-22T05:09:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.351+0000 7f834de00700 1 -- 172.21.15.49:0/1182844874 learned_addr learned my addr 172.21.15.49:0/1182844874 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.351+0000 7f834d400700 1 --2- 172.21.15.49:0/1182844874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83500aa810 0x7f83500c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.351+0000 7f834f200700 1 --2- 172.21.15.49:0/1182844874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83500bde10 0x7f83500bf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.355+0000 7f834d400700 1 -- 172.21.15.49:0/1182844874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83500bde10 msgr2=0x7f83500bf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.355+0000 7f834d400700 1 --2- 172.21.15.49:0/1182844874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83500bde10 0x7f83500bf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.355+0000 7f834d400700 1 -- 172.21.15.49:0/1182844874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8350067d30 msgr2=0x7f83500c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.355+0000 7f834d400700 1 --2- 172.21.15.49:0/1182844874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8350067d30 0x7f83500c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.355+0000 7f834d400700 1 -- 172.21.15.49:0/1182844874 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83380092a0 con 0x7f83500aa810 2024-01-22T05:09:15.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.355+0000 7f834d400700 1 --2- 172.21.15.49:0/1182844874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83500aa810 0x7f83500c2990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f8338014000 tx=0x7f8338017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:15.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.355+0000 7f8345600700 1 -- 172.21.15.49:0/1182844874 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800f890 con 0x7f83500aa810 2024-01-22T05:09:15.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.355+0000 7f8345600700 1 -- 172.21.15.49:0/1182844874 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8338000d10 con 0x7f83500aa810 2024-01-22T05:09:15.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.355+0000 7f8354c00700 1 -- 172.21.15.49:0/1182844874 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83500c30f0 con 0x7f83500aa810 2024-01-22T05:09:15.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.355+0000 7f8345600700 1 -- 172.21.15.49:0/1182844874 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800fea0 con 0x7f83500aa810 2024-01-22T05:09:15.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.355+0000 7f8354c00700 1 -- 172.21.15.49:0/1182844874 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83500c36b0 con 0x7f83500aa810 2024-01-22T05:09:15.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.355+0000 7f8354c00700 1 -- 172.21.15.49:0/1182844874 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8350069ab0 con 0x7f83500aa810 2024-01-22T05:09:15.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.359+0000 7f8345600700 1 -- 172.21.15.49:0/1182844874 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f833801b620 con 0x7f83500aa810 2024-01-22T05:09:15.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.359+0000 7f8345600700 1 --2- 172.21.15.49:0/1182844874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f832805a510 0x7f832805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.359+0000 7f8345600700 1 -- 172.21.15.49:0/1182844874 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f8338076220 con 0x7f83500aa810 2024-01-22T05:09:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.359+0000 7f834de00700 1 --2- 172.21.15.49:0/1182844874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f832805a510 0x7f832805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:15.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.359+0000 7f834de00700 1 --2- 172.21.15.49:0/1182844874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f832805a510 0x7f832805c9d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f8340007fd0 tx=0x7f8340007c70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.371+0000 7f8345600700 1 -- 172.21.15.49:0/1182844874 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f83380497e0 con 0x7f83500aa810 2024-01-22T05:09:15.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.571+0000 7f8354c00700 1 -- 172.21.15.49:0/1182844874 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8350062e10 con 0x7f83500aa810 2024-01-22T05:09:15.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.571+0000 7f8345600700 1 -- 172.21.15.49:0/1182844874 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8338028020 con 0x7f83500aa810 2024-01-22T05:09:15.574 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:09:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.575+0000 7f8354c00700 1 -- 172.21.15.49:0/1182844874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f832805a510 msgr2=0x7f832805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.575+0000 7f8354c00700 1 --2- 172.21.15.49:0/1182844874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f832805a510 0x7f832805c9d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f8340007fd0 tx=0x7f8340007c70).stop 2024-01-22T05:09:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.575+0000 7f8354c00700 1 -- 172.21.15.49:0/1182844874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83500aa810 msgr2=0x7f83500c2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.575+0000 7f8354c00700 1 --2- 172.21.15.49:0/1182844874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83500aa810 0x7f83500c2990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f8338014000 tx=0x7f8338017000).stop 2024-01-22T05:09:15.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.575+0000 7f8354c00700 1 -- 172.21.15.49:0/1182844874 shutdown_connections 2024-01-22T05:09:15.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.575+0000 7f8354c00700 1 --2- 172.21.15.49:0/1182844874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f832805a510 0x7f832805c9d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.575+0000 7f8354c00700 1 --2- 172.21.15.49:0/1182844874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83500bde10 0x7f83500bf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.575+0000 7f8354c00700 1 --2- 172.21.15.49:0/1182844874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83500aa810 0x7f83500c2990 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.575+0000 7f8354c00700 1 --2- 172.21.15.49:0/1182844874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8350067d30 0x7f83500c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:15.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.575+0000 7f8354c00700 1 -- 172.21.15.49:0/1182844874 >> 172.21.15.49:0/1182844874 conn(0x7f83500c4940 msgr2=0x7f83500c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.575+0000 7f8354c00700 1 -- 172.21.15.49:0/1182844874 shutdown_connections 2024-01-22T05:09:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:15.575+0000 7f8354c00700 1 -- 172.21.15.49:0/1182844874 wait complete. 2024-01-22T05:09:15.598 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-22T05:09:15.598 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:09:15.598 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:09:15.598 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:09:15.598 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:09:15.598 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-22T05:09:15.598 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-22T05:09:15.598 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:09:15.598 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:09:15.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:15.599 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:09:15.615 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:09:15.615 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:09:15.615 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:09:15.615 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:15.615 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:09:15.615 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:15.615 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:09:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:09:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:09:15.616 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:09:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:09:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:09:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:09:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42215sec preferred_lft 42215sec 2024-01-22T05:09:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:09:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:15.616 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:09:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:09:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:09:15.616 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:09:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:09:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:09:15.617 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:09:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:09:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:09:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:15.617 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:09:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:09:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:09:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::7ce7:e3ff:fed1:1e88/64 scope link 2024-01-22T05:09:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:15.617 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:09:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 82:c1:48:e7:c7:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:09:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::80c1:48ff:fee7:c731/64 scope link 2024-01-22T05:09:15.618 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:15.618 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:09:15.618 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:09:15.618 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3426:32ff:feee:c4c9/64 scope link 2024-01-22T05:09:15.618 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:15.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:15.619 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:09:15.698 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:09:15.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:15.701 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:09:15.763 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:09:15.763 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:09:15.763 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:09:15.763 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:09:15.763 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:09:15.763 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:09:15.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:15.764 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:09:15.764 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:09:15.764 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:09:15.764 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:09:15.764 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:09:15.765 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:09:15.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:15.900 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:09:15.912 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:09:15.912 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:09:15.913 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:09:15.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:15.913 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-22T05:09:15.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:15.994 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-22T05:09:16.056 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:09:16.057 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:09:16.174 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:09:16.174 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:09:16.198 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:09:16.198 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:09:16.204 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:09:16.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:16.204 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:09:16.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:09:16.238 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2024-01-22T05:09:16.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:09:16.314 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2024-01-22T05:09:16.380 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:09:16.380 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-01-22T05:09:16.380 DEBUG:teuthology.orchestra.run.smithi049:> import stat 2024-01-22T05:09:16.381 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:09:16.381 DEBUG:teuthology.orchestra.run.smithi049:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2024-01-22T05:09:16.381 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-01-22T05:09:16.533 INFO:teuthology.orchestra.run.smithi049.stdout:1099511627776 2024-01-22T05:09:16.723 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T05:09:16.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:09:16.723 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-22T05:09:16.852 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:09:16.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:16.852 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:09:16.875 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:09:17.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.079+0000 7f33a0a00700 1 Processor -- start 2024-01-22T05:09:17.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.079+0000 7f33a0a00700 1 -- start start 2024-01-22T05:09:17.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.083+0000 7f33a0a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f33980bcfa0 0x7f3398151700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.083+0000 7f33a0a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3398151bf0 0x7f33980ab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.083+0000 7f33a0a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3398068a60 con 0x7f33980abd80 2024-01-22T05:09:17.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.083+0000 7f33a0a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33980bb790 con 0x7f33980bcfa0 2024-01-22T05:09:17.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.083+0000 7f33a0a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33980bd380 con 0x7f3398151bf0 2024-01-22T05:09:17.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.083+0000 7f339ea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f33980abd80 0x7f33981555c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53050/0 (socket says 172.21.15.49:53050) 2024-01-22T05:09:17.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.083+0000 7f339ea00700 1 -- 172.21.15.49:0/970651228 learned_addr learned my addr 172.21.15.49:0/970651228 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:17.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.083+0000 7f339e000700 1 --2- 172.21.15.49:0/970651228 >> v2:172.21.15.49:3300/0 conn(0x7f33980bcfa0 0x7f3398151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.083+0000 7f339d600700 1 --2- 172.21.15.49:0/970651228 >> v2:172.21.15.110:3300/0 conn(0x7f3398151bf0 0x7f33980ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.083+0000 7f339e000700 1 -- 172.21.15.49:0/970651228 >> v2:172.21.15.110:3300/0 conn(0x7f3398151bf0 msgr2=0x7f33980ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:17.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.083+0000 7f339cc00700 1 -- 172.21.15.49:0/970651228 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514649140 0 0) 0x7f3398068a60 con 0x7f33980abd80 2024-01-22T05:09:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.083+0000 7f339e000700 1 --2- 172.21.15.49:0/970651228 >> v2:172.21.15.110:3300/0 conn(0x7f3398151bf0 0x7f33980ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.083+0000 7f339e000700 1 -- 172.21.15.49:0/970651228 >> v1:172.21.15.49:6789/0 conn(0x7f33980abd80 legacy=0x7f33981555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.083+0000 7f339e000700 1 -- 172.21.15.49:0/970651228 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3398068460 con 0x7f33980bcfa0 2024-01-22T05:09:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.087+0000 7f339e000700 1 --2- 172.21.15.49:0/970651228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980bcfa0 0x7f3398151700 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f33980c75b0 tx=0x7f3388009060).ready entity=mon.0 client_cookie=5eef653b72021dad server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.087+0000 7f339cc00700 1 -- 172.21.15.49:0/970651228 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338800f510 con 0x7f33980bcfa0 2024-01-22T05:09:17.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.087+0000 7f339cc00700 1 -- 172.21.15.49:0/970651228 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338800f670 con 0x7f33980bcfa0 2024-01-22T05:09:17.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.087+0000 7f339cc00700 1 -- 172.21.15.49:0/970651228 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338800f9f0 con 0x7f33980bcfa0 2024-01-22T05:09:17.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.087+0000 7f33a0a00700 1 -- 172.21.15.49:0/970651228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980bcfa0 msgr2=0x7f3398151700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.087+0000 7f33a0a00700 1 --2- 172.21.15.49:0/970651228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980bcfa0 0x7f3398151700 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f33980c75b0 tx=0x7f3388009060).stop 2024-01-22T05:09:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.087+0000 7f33a0a00700 1 -- 172.21.15.49:0/970651228 shutdown_connections 2024-01-22T05:09:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.087+0000 7f33a0a00700 1 --2- 172.21.15.49:0/970651228 >> v2:172.21.15.110:3300/0 conn(0x7f3398151bf0 0x7f33980ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.087+0000 7f33a0a00700 1 --2- 172.21.15.49:0/970651228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980bcfa0 0x7f3398151700 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.087+0000 7f33a0a00700 1 -- 172.21.15.49:0/970651228 >> 172.21.15.49:0/970651228 conn(0x7f33980c6540 msgr2=0x7f33980c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.087+0000 7f33a0a00700 1 -- 172.21.15.49:0/970651228 shutdown_connections 2024-01-22T05:09:17.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.087+0000 7f33a0a00700 1 -- 172.21.15.49:0/970651228 wait complete. 2024-01-22T05:09:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.091+0000 7f33a0a00700 1 Processor -- start 2024-01-22T05:09:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.091+0000 7f33a0a00700 1 -- start start 2024-01-22T05:09:17.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f33a0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980abd80 0x7f33980a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f33a0a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33980bcfa0 0x7f3398066850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f33a0a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3398151bf0 0x7f3398066d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f33a0a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33981632a0 con 0x7f33980abd80 2024-01-22T05:09:17.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f33a0a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398067230 con 0x7f33980bcfa0 2024-01-22T05:09:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f33a0a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33980a22f0 con 0x7f3398151bf0 2024-01-22T05:09:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f339e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980abd80 0x7f33980a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f339e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980abd80 0x7f33980a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35808/0 (socket says 172.21.15.49:35808) 2024-01-22T05:09:17.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f339e000700 1 -- 172.21.15.49:0/153538132 learned_addr learned my addr 172.21.15.49:0/153538132 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:17.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f339d600700 1 --2- 172.21.15.49:0/153538132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33980bcfa0 0x7f3398066850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f339ea00700 1 --2- 172.21.15.49:0/153538132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3398151bf0 0x7f3398066d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f339e000700 1 -- 172.21.15.49:0/153538132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3398151bf0 msgr2=0x7f3398066d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f339e000700 1 --2- 172.21.15.49:0/153538132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3398151bf0 0x7f3398066d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f339e000700 1 -- 172.21.15.49:0/153538132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33980bcfa0 msgr2=0x7f3398066850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f339e000700 1 --2- 172.21.15.49:0/153538132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33980bcfa0 0x7f3398066850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f339e000700 1 -- 172.21.15.49:0/153538132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33880092a0 con 0x7f33980abd80 2024-01-22T05:09:17.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f339d600700 1 --2- 172.21.15.49:0/153538132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33980bcfa0 0x7f3398066850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:17.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f339e000700 1 --2- 172.21.15.49:0/153538132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980abd80 0x7f33980a1e00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f3388009dd0 tx=0x7f3388017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f3395600700 1 -- 172.21.15.49:0/153538132 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338800f7e0 con 0x7f33980abd80 2024-01-22T05:09:17.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f3395600700 1 -- 172.21.15.49:0/153538132 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338800f940 con 0x7f33980abd80 2024-01-22T05:09:17.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f3395600700 1 -- 172.21.15.49:0/153538132 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338801b660 con 0x7f33980abd80 2024-01-22T05:09:17.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.095+0000 7f33a0a00700 1 -- 172.21.15.49:0/153538132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3398162fc0 con 0x7f33980abd80 2024-01-22T05:09:17.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.099+0000 7f33a0a00700 1 -- 172.21.15.49:0/153538132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33981638b0 con 0x7f33980abd80 2024-01-22T05:09:17.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.099+0000 7f33a0a00700 1 -- 172.21.15.49:0/153538132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3398163430 con 0x7f33980abd80 2024-01-22T05:09:17.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.099+0000 7f3395600700 1 -- 172.21.15.49:0/153538132 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f338801ba10 con 0x7f33980abd80 2024-01-22T05:09:17.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.103+0000 7f3395600700 1 --2- 172.21.15.49:0/153538132 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f337005a510 0x7f337005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.103+0000 7f3395600700 1 -- 172.21.15.49:0/153538132 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3388076210 con 0x7f33980abd80 2024-01-22T05:09:17.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.103+0000 7f339d600700 1 --2- 172.21.15.49:0/153538132 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f337005a510 0x7f337005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.103+0000 7f339d600700 1 --2- 172.21.15.49:0/153538132 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f337005a510 0x7f337005c9d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f33981502d0 tx=0x7f3380008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.107+0000 7f3395600700 1 -- 172.21.15.49:0/153538132 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3398163430 con 0x7f33980abd80 2024-01-22T05:09:17.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.303+0000 7f33a0a00700 1 -- 172.21.15.49:0/153538132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3398163430 con 0x7f33980abd80 2024-01-22T05:09:17.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.303+0000 7f3395600700 1 -- 172.21.15.49:0/153538132 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f3398163430 con 0x7f33980abd80 2024-01-22T05:09:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:17.307 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":56,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5729,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2604306838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2604306838},{"type":"v1","addr":"172.21.15.49:6835","nonce":2604306838}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2092666136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2092666136},{"type":"v1","addr":"172.21.15.110:6833","nonce":2092666136}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1078192149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1078192149},{"type":"v1","addr":"172.21.15.110:6835","nonce":1078192149}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:09:03.929962+0000","modified":"2024-01-22T05:09:07.150662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6348":{"gid":6348,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/2817241041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2817241041},{"type":"v1","addr":"172.21.15.49:6837","nonce":2817241041}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-22T05:09:17.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.307+0000 7f33a0a00700 1 -- 172.21.15.49:0/153538132 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f337005a510 msgr2=0x7f337005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.307+0000 7f33a0a00700 1 --2- 172.21.15.49:0/153538132 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f337005a510 0x7f337005c9d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f33981502d0 tx=0x7f3380008040).stop 2024-01-22T05:09:17.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.307+0000 7f33a0a00700 1 -- 172.21.15.49:0/153538132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980abd80 msgr2=0x7f33980a1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.307+0000 7f33a0a00700 1 --2- 172.21.15.49:0/153538132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980abd80 0x7f33980a1e00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f3388009dd0 tx=0x7f3388017000).stop 2024-01-22T05:09:17.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.307+0000 7f33a0a00700 1 -- 172.21.15.49:0/153538132 shutdown_connections 2024-01-22T05:09:17.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.307+0000 7f33a0a00700 1 --2- 172.21.15.49:0/153538132 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f337005a510 0x7f337005c9d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.307+0000 7f33a0a00700 1 --2- 172.21.15.49:0/153538132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3398151bf0 0x7f3398066d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.307+0000 7f33a0a00700 1 --2- 172.21.15.49:0/153538132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33980bcfa0 0x7f3398066850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.307+0000 7f33a0a00700 1 --2- 172.21.15.49:0/153538132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33980abd80 0x7f33980a1e00 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.307+0000 7f33a0a00700 1 -- 172.21.15.49:0/153538132 >> 172.21.15.49:0/153538132 conn(0x7f33980c6540 msgr2=0x7f33980bd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:17.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.311+0000 7f33a0a00700 1 -- 172.21.15.49:0/153538132 shutdown_connections 2024-01-22T05:09:17.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.311+0000 7f33a0a00700 1 -- 172.21.15.49:0/153538132 wait complete. 2024-01-22T05:09:17.316 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 56 2024-01-22T05:09:17.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-01-22T05:09:17.516 INFO:teuthology.orchestra.run.smithi049.stdout:{"message":"","return_code":0} 2024-01-22T05:09:17.517 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-01-22T05:09:17.517 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:09:17.517 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:09:17.518 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:09:17.518 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:09:17.518 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:09:17.518 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:09:17.518 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:09:17.518 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:09:17.536 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:09:17.536 DEBUG:teuthology.parallel:result is None 2024-01-22T05:09:17.537 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:09:17.537 DEBUG:teuthology.parallel:result is None 2024-01-22T05:09:17.542 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:09:17.542 DEBUG:teuthology.parallel:result is None 2024-01-22T05:09:17.544 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:09:17.544 DEBUG:teuthology.parallel:result is None 2024-01-22T05:09:17.544 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2024-01-22T05:09:17.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.639+0000 7f221cd61d00 1 Processor -- start 2024-01-22T05:09:17.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.639+0000 7f221cd61d00 1 -- start start 2024-01-22T05:09:17.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.639+0000 7f221cd61d00 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x561a4710e9f0 0x561a4710edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.639+0000 7f221cd61d00 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a4711e080 0x561a47122610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.639+0000 7f221cd61d00 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561a4704dbf0 0x561a4704e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.639+0000 7f221cd61d00 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a46fc5220 con 0x561a4704dbf0 2024-01-22T05:09:17.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.639+0000 7f221cd61d00 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a471243c0 con 0x561a4711e080 2024-01-22T05:09:17.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.639+0000 7f221cd61d00 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a4711ec30 con 0x561a4710e9f0 2024-01-22T05:09:17.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f2211400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561a4704dbf0 0x561a4704e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f2211400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561a4704dbf0 0x561a4704e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35820/0 (socket says 172.21.15.49:35820) 2024-01-22T05:09:17.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f2211400700 1 -- 172.21.15.49:0/2718606126 learned_addr learned my addr 172.21.15.49:0/2718606126 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:17.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f2207e00700 1 --2- 172.21.15.49:0/2718606126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a4711e080 0x561a47122610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f2210a00700 1 --2- 172.21.15.49:0/2718606126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x561a4710e9f0 0x561a4710edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f2211400700 1 -- 172.21.15.49:0/2718606126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x561a4710e9f0 msgr2=0x561a4710edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:17.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f2211400700 1 --2- 172.21.15.49:0/2718606126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x561a4710e9f0 0x561a4710edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f2211400700 1 -- 172.21.15.49:0/2718606126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a4711e080 msgr2=0x561a47122610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:17.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f2211400700 1 --2- 172.21.15.49:0/2718606126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a4711e080 0x561a47122610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f2211400700 1 -- 172.21.15.49:0/2718606126 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a46fee770 con 0x561a4704dbf0 2024-01-22T05:09:17.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f2211400700 1 --2- 172.21.15.49:0/2718606126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561a4704dbf0 0x561a4704e070 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f2208002660 tx=0x7f2208005d40).ready entity=mon.0 client_cookie=1664fc23a6376562 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f2206a00700 1 -- 172.21.15.49:0/2718606126 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220800f4c0 con 0x561a4704dbf0 2024-01-22T05:09:17.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f2206a00700 1 -- 172.21.15.49:0/2718606126 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220800f620 con 0x561a4704dbf0 2024-01-22T05:09:17.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f2206a00700 1 -- 172.21.15.49:0/2718606126 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220800f9c0 con 0x561a4704dbf0 2024-01-22T05:09:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f221cd61d00 1 -- 172.21.15.49:0/2718606126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561a4704dbf0 msgr2=0x561a4704e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f221cd61d00 1 --2- 172.21.15.49:0/2718606126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561a4704dbf0 0x561a4704e070 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f2208002660 tx=0x7f2208005d40).stop 2024-01-22T05:09:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f221cd61d00 1 -- 172.21.15.49:0/2718606126 shutdown_connections 2024-01-22T05:09:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f221cd61d00 1 --2- 172.21.15.49:0/2718606126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561a4704dbf0 0x561a4704e070 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f221cd61d00 1 --2- 172.21.15.49:0/2718606126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a4711e080 0x561a47122610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f221cd61d00 1 --2- 172.21.15.49:0/2718606126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x561a4710e9f0 0x561a4710edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f221cd61d00 1 -- 172.21.15.49:0/2718606126 >> 172.21.15.49:0/2718606126 conn(0x561a4709cb10 msgr2=0x561a47121420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f221cd61d00 1 -- 172.21.15.49:0/2718606126 shutdown_connections 2024-01-22T05:09:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f221cd61d00 1 -- 172.21.15.49:0/2718606126 wait complete. 2024-01-22T05:09:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f221cd61d00 1 Processor -- start 2024-01-22T05:09:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.643+0000 7f221cd61d00 1 -- start start 2024-01-22T05:09:17.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f221cd61d00 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a4704dbf0 0x561a4710dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f221cd61d00 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561a4710e9f0 0x561a47095430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f221cd61d00 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x561a4711e080 0x561a47095920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f221cd61d00 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a47095e10 con 0x561a4710e9f0 2024-01-22T05:09:17.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f221cd61d00 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a47098010 con 0x561a4704dbf0 2024-01-22T05:09:17.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f221cd61d00 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a47092500 con 0x561a4711e080 2024-01-22T05:09:17.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2207e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561a4710e9f0 0x561a47095430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2207e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561a4710e9f0 0x561a47095430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35824/0 (socket says 172.21.15.49:35824) 2024-01-22T05:09:17.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2207e00700 1 -- 172.21.15.49:0/2077932634 learned_addr learned my addr 172.21.15.49:0/2077932634 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:17.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2211400700 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x561a4711e080 0x561a47095920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2210a00700 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a4704dbf0 0x561a4710dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2207e00700 1 -- 172.21.15.49:0/2077932634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x561a4711e080 msgr2=0x561a47095920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2207e00700 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x561a4711e080 0x561a47095920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2207e00700 1 -- 172.21.15.49:0/2077932634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a4704dbf0 msgr2=0x561a4710dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2207e00700 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a4704dbf0 0x561a4710dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2207e00700 1 -- 172.21.15.49:0/2077932634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2208002410 con 0x561a4710e9f0 2024-01-22T05:09:17.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2211400700 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x561a4711e080 0x561a47095920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:17.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2210a00700 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a4704dbf0 0x561a4710dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:17.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2207e00700 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561a4710e9f0 0x561a47095430 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f2200009e00 tx=0x7f2200016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2204c00700 1 -- 172.21.15.49:0/2077932634 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220000f040 con 0x561a4710e9f0 2024-01-22T05:09:17.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2204c00700 1 -- 172.21.15.49:0/2077932634 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22000146c0 con 0x561a4710e9f0 2024-01-22T05:09:17.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f221cd61d00 1 -- 172.21.15.49:0/2077932634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561a46fbda70 con 0x561a4710e9f0 2024-01-22T05:09:17.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f2204c00700 1 -- 172.21.15.49:0/2077932634 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2200014a80 con 0x561a4710e9f0 2024-01-22T05:09:17.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.647+0000 7f221cd61d00 1 -- 172.21.15.49:0/2077932634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a46fc9010 con 0x561a4710e9f0 2024-01-22T05:09:17.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.651+0000 7f2204c00700 1 -- 172.21.15.49:0/2077932634 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f220001f410 con 0x561a4710e9f0 2024-01-22T05:09:17.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.651+0000 7f2204c00700 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f21f0058ff0 0x7f21f005b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.651+0000 7f2204c00700 1 -- 172.21.15.49:0/2077932634 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2200074d30 con 0x561a4710e9f0 2024-01-22T05:09:17.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.651+0000 7f2210a00700 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f21f0058ff0 0x7f21f005b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.655+0000 7f221cd61d00 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x561a4704cb60 0x561a4713a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.655+0000 7f221cd61d00 1 -- 172.21.15.49:0/2077932634 --> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] -- osd_op(unknown.0.0:1 10.30 10:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected e70) v8 -- 0x561a4709b7a0 con 0x561a4704cb60 2024-01-22T05:09:17.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.655+0000 7f2211400700 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x561a4704cb60 0x561a4713a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.655+0000 7f2210a00700 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f21f0058ff0 0x7f21f005b4b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f220c00faf0 tx=0x7f220c000d70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.655+0000 7f2211400700 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x561a4704cb60 0x561a4713a810 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.659+0000 7f2211400700 1 -- 172.21.15.49:0/2077932634 <== osd.2 v2:172.21.15.49:6800/22974 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v70'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2208018040 con 0x561a4704cb60 2024-01-22T05:09:17.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.659+0000 7f221cd61d00 1 -- 172.21.15.49:0/2077932634 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x561a4704cb60 msgr2=0x561a4713a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.659+0000 7f221cd61d00 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x561a4704cb60 0x561a4713a810 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.659+0000 7f221cd61d00 1 -- 172.21.15.49:0/2077932634 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f21f0058ff0 msgr2=0x7f21f005b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.659+0000 7f221cd61d00 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f21f0058ff0 0x7f21f005b4b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f220c00faf0 tx=0x7f220c000d70).stop 2024-01-22T05:09:17.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.659+0000 7f221cd61d00 1 -- 172.21.15.49:0/2077932634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561a4710e9f0 msgr2=0x561a47095430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.659+0000 7f221cd61d00 1 --2- 172.21.15.49:0/2077932634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561a4710e9f0 0x561a47095430 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f2200009e00 tx=0x7f2200016000).stop 2024-01-22T05:09:17.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.659+0000 7f2211400700 1 -- 172.21.15.49:0/2077932634 reap_dead start 2024-01-22T05:09:17.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.659+0000 7f221cd61d00 1 -- 172.21.15.49:0/2077932634 shutdown_connections 2024-01-22T05:09:17.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.659+0000 7f221cd61d00 1 -- 172.21.15.49:0/2077932634 >> 172.21.15.49:0/2077932634 conn(0x561a4709cb10 msgr2=0x561a4704dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:17.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.659+0000 7f221cd61d00 1 -- 172.21.15.49:0/2077932634 shutdown_connections 2024-01-22T05:09:17.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.659+0000 7f221cd61d00 1 -- 172.21.15.49:0/2077932634 wait complete. 2024-01-22T05:09:17.667 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-01-22T05:09:17.668 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-01-22T05:09:17.668 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-01-22T05:09:17.668 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-01-22T05:09:17.669 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-01-22T05:09:17.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-01-22T05:09:17.669 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2024-01-22T05:09:17.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-01-22T05:09:17.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.811+0000 7fb9efe00700 1 Processor -- start 2024-01-22T05:09:17.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.811+0000 7fb9efe00700 1 -- start start 2024-01-22T05:09:17.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.811+0000 7f7df3600700 1 Processor -- start 2024-01-22T05:09:17.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.811+0000 7fb9efe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb9e80c4990 0x7fb9e80bda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.811+0000 7fb9efe00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e80c2dc0 con 0x7fb9e80bdf30 2024-01-22T05:09:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.811+0000 7fb9efe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e80a6f40 con 0x7fb9e80c45b0 2024-01-22T05:09:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.811+0000 7fb9efe00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e80c21b0 con 0x7fb9e80c4990 2024-01-22T05:09:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.811+0000 7fb9ede00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb9e80bdf30 0x7fb9e815d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53074/0 (socket says 172.21.15.49:53074) 2024-01-22T05:09:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.811+0000 7fb9ede00700 1 -- 172.21.15.49:0/279668321 learned_addr learned my addr 172.21.15.49:0/279668321 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.811+0000 7f7df3600700 1 -- start start 2024-01-22T05:09:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.811+0000 7fb9eca00700 1 --2- 172.21.15.49:0/279668321 >> v2:172.21.15.110:3300/0 conn(0x7fb9e80c4990 0x7fb9e80bda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.811+0000 7fb9e7e00700 1 -- 172.21.15.49:0/279668321 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387989873 0 0) 0x7fb9e80c2dc0 con 0x7fb9e80bdf30 2024-01-22T05:09:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.811+0000 7fb9e7e00700 1 -- 172.21.15.49:0/279668321 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c80033f0 con 0x7fb9e80bdf30 2024-01-22T05:09:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7fb9eca00700 1 -- 172.21.15.49:0/279668321 >> v1:172.21.15.110:6789/0 conn(0x7fb9e80c45b0 legacy=0x7fb9e80a6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7fb9e7e00700 1 -- 172.21.15.49:0/279668321 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2380925087 0 0) 0x7fb9c80033f0 con 0x7fb9e80bdf30 2024-01-22T05:09:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7fb9eca00700 1 -- 172.21.15.49:0/279668321 >> v1:172.21.15.49:6789/0 conn(0x7fb9e80bdf30 legacy=0x7fb9e815d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7fb9eca00700 1 -- 172.21.15.49:0/279668321 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e80c2490 con 0x7fb9e80c4990 2024-01-22T05:09:17.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7fb9eca00700 1 --2- 172.21.15.49:0/279668321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9e80c4990 0x7fb9e80bda40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fb9d0009760 tx=0x7fb9d0009060).ready entity=mon.1 client_cookie=38e21ced262aa2cd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7fb9e7e00700 1 -- 172.21.15.49:0/279668321 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00017f0 con 0x7fb9e80c4990 2024-01-22T05:09:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7fb9e7e00700 1 -- 172.21.15.49:0/279668321 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d0011400 con 0x7fb9e80c4990 2024-01-22T05:09:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7fb9e7e00700 1 -- 172.21.15.49:0/279668321 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0011780 con 0x7fb9e80c4990 2024-01-22T05:09:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7df3600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7dec063940 0x7f7dec068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7df3600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dec153d60 0x7f7dec0be540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7df3600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dec062230 con 0x7f7dec0be0e0 2024-01-22T05:09:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7df3600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dec068090 con 0x7f7dec063940 2024-01-22T05:09:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7df3600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec062480 con 0x7f7dec153d60 2024-01-22T05:09:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7debe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7dec0be0e0 0x7f7dec153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53082/0 (socket says 172.21.15.49:53082) 2024-01-22T05:09:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7debe00700 1 -- 172.21.15.49:0/4166820409 learned_addr learned my addr 172.21.15.49:0/4166820409 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7df0c00700 1 --2- 172.21.15.49:0/4166820409 >> v2:172.21.15.49:3300/0 conn(0x7f7dec063940 0x7f7dec068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7fb9efe00700 1 -- 172.21.15.49:0/279668321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9e80c4990 msgr2=0x7fb9e80bda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7fb9efe00700 1 --2- 172.21.15.49:0/279668321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9e80c4990 0x7fb9e80bda40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fb9d0009760 tx=0x7fb9d0009060).stop 2024-01-22T05:09:17.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7df2000700 1 --2- 172.21.15.49:0/4166820409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dec153d60 0x7f7dec0be540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7deb400700 1 -- 172.21.15.49:0/4166820409 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42475506 0 0) 0x7f7dec062230 con 0x7f7dec0be0e0 2024-01-22T05:09:17.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7deb400700 1 -- 172.21.15.49:0/4166820409 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dcc0033f0 con 0x7f7dec0be0e0 2024-01-22T05:09:17.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7fb9efe00700 1 -- 172.21.15.49:0/279668321 shutdown_connections 2024-01-22T05:09:17.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7fb9efe00700 1 --2- 172.21.15.49:0/279668321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9e80c4990 0x7fb9e80bda40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7fb9efe00700 1 -- 172.21.15.49:0/279668321 >> 172.21.15.49:0/279668321 conn(0x7fb9e80aa6b0 msgr2=0x7fb9e80aaac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7df0c00700 1 -- 172.21.15.49:0/4166820409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dec153d60 msgr2=0x7f7dec0be540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7df0c00700 1 --2- 172.21.15.49:0/4166820409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dec153d60 0x7f7dec0be540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7df0c00700 1 -- 172.21.15.49:0/4166820409 >> v1:172.21.15.49:6789/0 conn(0x7f7dec0be0e0 legacy=0x7f7dec153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7df0c00700 1 -- 172.21.15.49:0/4166820409 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec062760 con 0x7f7dec063940 2024-01-22T05:09:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7df0c00700 1 --2- 172.21.15.49:0/4166820409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dec063940 0x7f7dec068d20 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f7ddc009760 tx=0x7f7ddc009060).ready entity=mon.0 client_cookie=bf12e812683b5e08 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7fb9efe00700 1 -- 172.21.15.49:0/279668321 shutdown_connections 2024-01-22T05:09:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7fb9efe00700 1 -- 172.21.15.49:0/279668321 wait complete. 2024-01-22T05:09:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7deb400700 1 -- 172.21.15.49:0/4166820409 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc00d4a0 con 0x7f7dec063940 2024-01-22T05:09:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7deb400700 1 -- 172.21.15.49:0/4166820409 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc00d600 con 0x7f7dec063940 2024-01-22T05:09:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.815+0000 7f7deb400700 1 -- 172.21.15.49:0/4166820409 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc00d980 con 0x7f7dec063940 2024-01-22T05:09:17.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.819+0000 7f7df3600700 1 -- 172.21.15.49:0/4166820409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dec063940 msgr2=0x7f7dec068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.819+0000 7f7df3600700 1 --2- 172.21.15.49:0/4166820409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dec063940 0x7f7dec068d20 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f7ddc009760 tx=0x7f7ddc009060).stop 2024-01-22T05:09:17.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.819+0000 7fd5fb200700 1 Processor -- start 2024-01-22T05:09:17.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.819+0000 7f7df3600700 1 -- 172.21.15.49:0/4166820409 shutdown_connections 2024-01-22T05:09:17.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.819+0000 7f7df3600700 1 --2- 172.21.15.49:0/4166820409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dec153d60 0x7f7dec0be540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.819+0000 7f7df3600700 1 --2- 172.21.15.49:0/4166820409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dec063940 0x7f7dec068d20 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.819+0000 7f7df3600700 1 -- 172.21.15.49:0/4166820409 >> 172.21.15.49:0/4166820409 conn(0x7f7dec064080 msgr2=0x7f7dec064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:17.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.819+0000 7f7df3600700 1 -- 172.21.15.49:0/4166820409 shutdown_connections 2024-01-22T05:09:17.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.819+0000 7f7df3600700 1 -- 172.21.15.49:0/4166820409 wait complete. 2024-01-22T05:09:17.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.819+0000 7fbb84a00700 1 Processor -- start 2024-01-22T05:09:17.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.819+0000 7fd5fb200700 1 -- start start 2024-01-22T05:09:17.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.819+0000 7fb9efe00700 1 Processor -- start 2024-01-22T05:09:17.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.819+0000 7fbb84a00700 1 -- start start 2024-01-22T05:09:17.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.819+0000 7fb9efe00700 1 -- start start 2024-01-22T05:09:17.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb84a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb80065650 0x7fbb80153b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb84a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbb800681a0 0x7fbb80154060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9efe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9e80bdf30 0x7fb9e80683c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9efe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9e80c45b0 0x7fb9e80688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9efe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e80c4990 0x7fb9e81644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9efe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80c0950 con 0x7fb9e80c4990 2024-01-22T05:09:17.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9efe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80aa250 con 0x7fb9e80bdf30 2024-01-22T05:09:17.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9efe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e8068da0 con 0x7fb9e80c45b0 2024-01-22T05:09:17.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb84a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb801577e0 con 0x7fbb80065a30 2024-01-22T05:09:17.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb84a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb800ac6c0 con 0x7fbb800681a0 2024-01-22T05:09:17.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb84a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb80154550 con 0x7fbb80065650 2024-01-22T05:09:17.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7f7df3600700 1 Processor -- start 2024-01-22T05:09:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb7ea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbb80065a30 0x7fbb80067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53088/0 (socket says 172.21.15.49:53088) 2024-01-22T05:09:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb7ea00700 1 -- 172.21.15.49:0/154060892 learned_addr learned my addr 172.21.15.49:0/154060892 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5fb200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd5f40c37d0 0x7fd5f40c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5fb200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f40c4db0 con 0x7fd5f40681a0 2024-01-22T05:09:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5fb200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f40c5240 con 0x7fd5f4153bd0 2024-01-22T05:09:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5fb200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f4062230 con 0x7fd5f40c37d0 2024-01-22T05:09:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb7fe00700 1 --2- 172.21.15.49:0/154060892 >> v2:172.21.15.110:3300/0 conn(0x7fbb800681a0 0x7fbb80154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb7f400700 1 --2- 172.21.15.49:0/154060892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb80065650 0x7fbb80153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5f3400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd5f4153bd0 0x7fd5f4067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:48978/0 (socket says 172.21.15.49:48978) 2024-01-22T05:09:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5f3400700 1 -- 172.21.15.49:0/701361718 learned_addr learned my addr 172.21.15.49:0/701361718 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5f3e00700 1 --2- 172.21.15.49:0/701361718 >> v2:172.21.15.49:3300/0 conn(0x7fd5f40c37d0 0x7fd5f40c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9ed400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9e80bdf30 0x7fb9e80683c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9ed400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9e80bdf30 0x7fb9e80683c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:51470/0 (socket says 172.21.15.49:51470) 2024-01-22T05:09:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9ed400700 1 -- 172.21.15.49:0/2761102051 learned_addr learned my addr 172.21.15.49:0/2761102051 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9ede00700 1 --2- 172.21.15.49:0/2761102051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e80c4990 0x7fb9e81644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb7fe00700 1 -- 172.21.15.49:0/154060892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb80065650 msgr2=0x7fbb80153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb7fe00700 1 --2- 172.21.15.49:0/154060892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb80065650 0x7fbb80153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb7fe00700 1 -- 172.21.15.49:0/154060892 >> v1:172.21.15.49:6789/0 conn(0x7fbb80065a30 legacy=0x7fbb80067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb7fe00700 1 -- 172.21.15.49:0/154060892 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb800ad2b0 con 0x7fbb800681a0 2024-01-22T05:09:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9eca00700 1 --2- 172.21.15.49:0/2761102051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9e80c45b0 0x7fb9e80688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5f2a00700 1 -- 172.21.15.49:0/701361718 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836311475 0 0) 0x7fd5f40c5240 con 0x7fd5f4153bd0 2024-01-22T05:09:17.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5f2a00700 1 -- 172.21.15.49:0/701361718 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5d40033f0 con 0x7fd5f4153bd0 2024-01-22T05:09:17.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb7fe00700 1 --2- 172.21.15.49:0/154060892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb800681a0 0x7fbb80154060 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fbb78009e60 tx=0x7fbb78009780).ready entity=mon.1 client_cookie=9ab7c4b8c2cbf2b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9ede00700 1 -- 172.21.15.49:0/2761102051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9e80c45b0 msgr2=0x7fb9e80688b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9ede00700 1 --2- 172.21.15.49:0/2761102051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9e80c45b0 0x7fb9e80688b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9ede00700 1 -- 172.21.15.49:0/2761102051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9e80bdf30 msgr2=0x7fb9e80683c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9ede00700 1 --2- 172.21.15.49:0/2761102051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9e80bdf30 0x7fb9e80683c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9ede00700 1 -- 172.21.15.49:0/2761102051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d00092a0 con 0x7fb9e80c4990 2024-01-22T05:09:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5f2a00700 1 -- 172.21.15.49:0/701361718 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168291407 0 0) 0x7fd5f40c4db0 con 0x7fd5f40681a0 2024-01-22T05:09:17.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5f2a00700 1 -- 172.21.15.49:0/701361718 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f40c5240 con 0x7fd5f40681a0 2024-01-22T05:09:17.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7f7df3600700 1 -- start start 2024-01-22T05:09:17.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb7e000700 1 -- 172.21.15.49:0/154060892 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7800e070 con 0x7fbb800681a0 2024-01-22T05:09:17.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5f3e00700 1 -- 172.21.15.49:0/701361718 >> v1:172.21.15.110:6789/0 conn(0x7fd5f4153bd0 legacy=0x7fd5f4067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5f2a00700 1 -- 172.21.15.49:0/701361718 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3869652886 0 0) 0x7fd5d40033f0 con 0x7fd5f4153bd0 2024-01-22T05:09:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb7e000700 1 -- 172.21.15.49:0/154060892 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7800bc30 con 0x7fbb800681a0 2024-01-22T05:09:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fbb7e000700 1 -- 172.21.15.49:0/154060892 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78012410 con 0x7fbb800681a0 2024-01-22T05:09:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9ed400700 1 --2- 172.21.15.49:0/2761102051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9e80bdf30 0x7fb9e80683c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fb9ede00700 1 --2- 172.21.15.49:0/2761102051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e80c4990 0x7fb9e81644a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fb9e000cb60 tx=0x7fb9e0007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5f3e00700 1 -- 172.21.15.49:0/701361718 >> v1:172.21.15.49:6789/0 conn(0x7fd5f40681a0 legacy=0x7fd5f40bebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5f3e00700 1 -- 172.21.15.49:0/701361718 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f40c4140 con 0x7fd5f40c37d0 2024-01-22T05:09:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7f7df3600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dec0be0e0 0x7f7dec169490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7f7df3600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dec153d60 0x7f7dec150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7f7df3600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dec151140 0x7f7dec0adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7fd5f3e00700 1 --2- 172.21.15.49:0/701361718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5f40c37d0 0x7fd5f40c3bb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fd5e40096e0 tx=0x7fd5e4009060).ready entity=mon.0 client_cookie=604c42125bdbfa39 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7f7df3600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec169980 con 0x7f7dec153d60 2024-01-22T05:09:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7f7df3600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0a2bf0 con 0x7f7dec0be0e0 2024-01-22T05:09:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.823+0000 7f7df3600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0a2320 con 0x7f7dec151140 2024-01-22T05:09:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7df0c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dec0be0e0 0x7f7dec169490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7df0c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dec0be0e0 0x7f7dec169490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:51486/0 (socket says 172.21.15.49:51486) 2024-01-22T05:09:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7df0c00700 1 -- 172.21.15.49:0/868590916 learned_addr learned my addr 172.21.15.49:0/868590916 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7debe00700 1 --2- 172.21.15.49:0/868590916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dec153d60 0x7f7dec150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7df2000700 1 --2- 172.21.15.49:0/868590916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dec151140 0x7f7dec0adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fd5f2a00700 1 -- 172.21.15.49:0/701361718 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc001470 con 0x7fd5f40c37d0 2024-01-22T05:09:17.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fd5f2a00700 1 -- 172.21.15.49:0/701361718 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e4011400 con 0x7fd5f40c37d0 2024-01-22T05:09:17.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fd5f2a00700 1 -- 172.21.15.49:0/701361718 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4011780 con 0x7fd5f40c37d0 2024-01-22T05:09:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fb9e4c00700 1 -- 172.21.15.49:0/2761102051 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e000ce70 con 0x7fb9e80c4990 2024-01-22T05:09:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fb9e4c00700 1 -- 172.21.15.49:0/2761102051 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e0004c40 con 0x7fb9e80c4990 2024-01-22T05:09:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fb9e4c00700 1 -- 172.21.15.49:0/2761102051 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0007170 con 0x7fb9e80c4990 2024-01-22T05:09:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fbb84a00700 1 -- 172.21.15.49:0/154060892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb800681a0 msgr2=0x7fbb80154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fbb84a00700 1 --2- 172.21.15.49:0/154060892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb800681a0 0x7fbb80154060 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fbb78009e60 tx=0x7fbb78009780).stop 2024-01-22T05:09:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fb9efe00700 1 -- 172.21.15.49:0/2761102051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e80be760 con 0x7fb9e80c4990 2024-01-22T05:09:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7df0c00700 1 -- 172.21.15.49:0/868590916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dec151140 msgr2=0x7f7dec0adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7df0c00700 1 --2- 172.21.15.49:0/868590916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dec151140 0x7f7dec0adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7df0c00700 1 -- 172.21.15.49:0/868590916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dec153d60 msgr2=0x7f7dec150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7df0c00700 1 --2- 172.21.15.49:0/868590916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dec153d60 0x7f7dec150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7df0c00700 1 -- 172.21.15.49:0/868590916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc0092a0 con 0x7f7dec0be0e0 2024-01-22T05:09:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fbb84a00700 1 -- 172.21.15.49:0/154060892 shutdown_connections 2024-01-22T05:09:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fbb84a00700 1 --2- 172.21.15.49:0/154060892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb800681a0 0x7fbb80154060 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fbb84a00700 1 --2- 172.21.15.49:0/154060892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb80065650 0x7fbb80153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fbb84a00700 1 -- 172.21.15.49:0/154060892 >> 172.21.15.49:0/154060892 conn(0x7fbb80062d00 msgr2=0x7fbb800ca940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7df0c00700 1 --2- 172.21.15.49:0/868590916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dec0be0e0 0x7f7dec169490 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f7ddc009d50 tx=0x7f7ddc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fd5fb200700 1 -- 172.21.15.49:0/701361718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5f40c37d0 msgr2=0x7fd5f40c3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fd5fb200700 1 --2- 172.21.15.49:0/701361718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5f40c37d0 0x7fd5f40c3bb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fd5e40096e0 tx=0x7fd5e4009060).stop 2024-01-22T05:09:17.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fb9efe00700 1 -- 172.21.15.49:0/2761102051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e80bed20 con 0x7fb9e80c4990 2024-01-22T05:09:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7de3e00700 1 -- 172.21.15.49:0/868590916 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc000c90 con 0x7f7dec0be0e0 2024-01-22T05:09:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7de3e00700 1 -- 172.21.15.49:0/868590916 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc00d770 con 0x7f7dec0be0e0 2024-01-22T05:09:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7de3e00700 1 -- 172.21.15.49:0/868590916 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc01d430 con 0x7f7dec0be0e0 2024-01-22T05:09:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fd5fb200700 1 -- 172.21.15.49:0/701361718 shutdown_connections 2024-01-22T05:09:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fd5fb200700 1 --2- 172.21.15.49:0/701361718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5f40c37d0 0x7fd5f40c3bb0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fd5fb200700 1 -- 172.21.15.49:0/701361718 >> 172.21.15.49:0/701361718 conn(0x7fd5f4064080 msgr2=0x7fd5f4064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:17.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fbb84a00700 1 -- 172.21.15.49:0/154060892 shutdown_connections 2024-01-22T05:09:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fd5fb200700 1 -- 172.21.15.49:0/701361718 shutdown_connections 2024-01-22T05:09:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fd5fb200700 1 -- 172.21.15.49:0/701361718 wait complete. 2024-01-22T05:09:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7df3600700 1 -- 172.21.15.49:0/868590916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dec169060 con 0x7f7dec0be0e0 2024-01-22T05:09:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7df3600700 1 -- 172.21.15.49:0/868590916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dec0a2880 con 0x7f7dec0be0e0 2024-01-22T05:09:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fbb84a00700 1 -- 172.21.15.49:0/154060892 wait complete. 2024-01-22T05:09:17.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fb9efe00700 1 -- 172.21.15.49:0/2761102051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e80c2770 con 0x7fb9e80c4990 2024-01-22T05:09:17.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7f7df3600700 1 -- 172.21.15.49:0/868590916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dec047060 con 0x7f7dec0be0e0 2024-01-22T05:09:17.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.827+0000 7fb9e4c00700 1 -- 172.21.15.49:0/2761102051 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb9e0007520 con 0x7fb9e80c4990 2024-01-22T05:09:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fd5fb200700 1 Processor -- start 2024-01-22T05:09:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fd5fb200700 1 -- start start 2024-01-22T05:09:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fbb84a00700 1 Processor -- start 2024-01-22T05:09:17.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fb9e4c00700 1 --2- 172.21.15.49:0/2761102051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9c005a560 0x7fb9c005ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fb9e4c00700 1 -- 172.21.15.49:0/2761102051 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb9e00746c0 con 0x7fb9e80c4990 2024-01-22T05:09:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fb9ed400700 1 --2- 172.21.15.49:0/2761102051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9c005a560 0x7fb9c005ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7f7de3e00700 1 -- 172.21.15.49:0/868590916 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7ddc01d7a0 con 0x7f7dec0be0e0 2024-01-22T05:09:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fbb84a00700 1 -- start start 2024-01-22T05:09:17.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fd5fb200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5f40681a0 0x7fd5f41312e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fb9ed400700 1 --2- 172.21.15.49:0/2761102051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9c005a560 0x7fb9c005ca20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fb9d8001d00 tx=0x7fb9d8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fd5fb200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5f40c37d0 0x7fd5f413ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fd5fb200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5f4153bd0 0x7fd5f40aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fd5fb200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f4130e50 con 0x7fd5f4153bd0 2024-01-22T05:09:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fd5fb200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f4130560 con 0x7fd5f40c37d0 2024-01-22T05:09:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fd5fb200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f4130800 con 0x7fd5f40681a0 2024-01-22T05:09:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fd5f9c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5f4153bd0 0x7fd5f40aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fd5f3400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5f40c37d0 0x7fd5f413ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fd5f3400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5f40c37d0 0x7fd5f413ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:51498/0 (socket says 172.21.15.49:51498) 2024-01-22T05:09:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fd5f3400700 1 -- 172.21.15.49:0/796759604 learned_addr learned my addr 172.21.15.49:0/796759604 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fd5f3e00700 1 --2- 172.21.15.49:0/796759604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5f40681a0 0x7fd5f41312e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7fd5f9c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5f4153bd0 0x7fd5f40aac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35880/0 (socket says 172.21.15.49:35880) 2024-01-22T05:09:17.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.831+0000 7f7de3e00700 1 --2- 172.21.15.49:0/868590916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7dc405a560 0x7f7dc405ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7f7de3e00700 1 -- 172.21.15.49:0/868590916 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7ddc076dc0 con 0x7f7dec0be0e0 2024-01-22T05:09:17.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fd5f3400700 1 -- 172.21.15.49:0/796759604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5f40681a0 msgr2=0x7fd5f41312e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fd5f3400700 1 --2- 172.21.15.49:0/796759604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5f40681a0 0x7fd5f41312e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fd5f3400700 1 -- 172.21.15.49:0/796759604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5f4153bd0 msgr2=0x7fd5f40aac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fd5f3400700 1 --2- 172.21.15.49:0/796759604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5f4153bd0 0x7fd5f40aac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fd5f3400700 1 -- 172.21.15.49:0/796759604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e40092a0 con 0x7fd5f40c37d0 2024-01-22T05:09:17.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fd5f3400700 1 --2- 172.21.15.49:0/796759604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5f40c37d0 0x7fd5f413ee60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fd5dc00c800 tx=0x7fd5dc001a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7f7debe00700 1 --2- 172.21.15.49:0/868590916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7dc405a560 0x7f7dc405ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb84a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb80065650 0x7fbb80141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb84a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb80065a30 0x7fbb801413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb84a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb800681a0 0x7fbb80152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb84a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800a38b0 con 0x7fbb80065650 2024-01-22T05:09:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb84a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800a4710 con 0x7fbb80065a30 2024-01-22T05:09:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb84a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb801418e0 con 0x7fbb800681a0 2024-01-22T05:09:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb7f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb80065650 0x7fbb80141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb7f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb80065650 0x7fbb80141bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35884/0 (socket says 172.21.15.49:35884) 2024-01-22T05:09:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb7f400700 1 -- 172.21.15.49:0/3014384761 learned_addr learned my addr 172.21.15.49:0/3014384761 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb7ea00700 1 --2- 172.21.15.49:0/3014384761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb80065a30 0x7fbb801413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb7fe00700 1 --2- 172.21.15.49:0/3014384761 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb800681a0 0x7fbb80152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb7f400700 1 -- 172.21.15.49:0/3014384761 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb800681a0 msgr2=0x7fbb80152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb7f400700 1 --2- 172.21.15.49:0/3014384761 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb800681a0 0x7fbb80152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb7f400700 1 -- 172.21.15.49:0/3014384761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb80065a30 msgr2=0x7fbb801413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:17.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb7f400700 1 --2- 172.21.15.49:0/3014384761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb80065a30 0x7fbb801413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:17.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb7f400700 1 -- 172.21.15.49:0/3014384761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb78009a20 con 0x7fbb80065650 2024-01-22T05:09:17.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7f7debe00700 1 --2- 172.21.15.49:0/868590916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7dc405a560 0x7f7dc405ca20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f7dec0ad8f0 tx=0x7f7dd4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb7ea00700 1 --2- 172.21.15.49:0/3014384761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb80065a30 0x7fbb801413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb7f400700 1 --2- 172.21.15.49:0/3014384761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb80065650 0x7fbb80141bd0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fbb7000d8c0 tx=0x7fbb70008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb76a00700 1 -- 172.21.15.49:0/3014384761 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700095b0 con 0x7fbb80065650 2024-01-22T05:09:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb76a00700 1 -- 172.21.15.49:0/3014384761 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb70009710 con 0x7fbb80065650 2024-01-22T05:09:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb84a00700 1 -- 172.21.15.49:0/3014384761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb800a3b00 con 0x7fbb80065650 2024-01-22T05:09:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb76a00700 1 -- 172.21.15.49:0/3014384761 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70009a90 con 0x7fbb80065650 2024-01-22T05:09:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fb9e4c00700 1 -- 172.21.15.49:0/2761102051 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb9e0047de0 con 0x7fb9e80c4990 2024-01-22T05:09:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.835+0000 7fbb84a00700 1 -- 172.21.15.49:0/3014384761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb800a40c0 con 0x7fbb80065650 2024-01-22T05:09:17.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.839+0000 7fd5eb400700 1 -- 172.21.15.49:0/796759604 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc007170 con 0x7fd5f40c37d0 2024-01-22T05:09:17.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.839+0000 7fbb84a00700 1 -- 172.21.15.49:0/3014384761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb80157230 con 0x7fbb80065650 2024-01-22T05:09:17.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.839+0000 7fbb76a00700 1 -- 172.21.15.49:0/3014384761 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbb70013480 con 0x7fbb80065650 2024-01-22T05:09:17.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.839+0000 7fd5eb400700 1 -- 172.21.15.49:0/796759604 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5dc0072d0 con 0x7fd5f40c37d0 2024-01-22T05:09:17.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.839+0000 7fd5eb400700 1 -- 172.21.15.49:0/796759604 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc0048c0 con 0x7fd5f40c37d0 2024-01-22T05:09:17.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.839+0000 7fd5fb200700 1 -- 172.21.15.49:0/796759604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f4130ae0 con 0x7fd5f40c37d0 2024-01-22T05:09:17.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.839+0000 7fd5fb200700 1 -- 172.21.15.49:0/796759604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f40c2210 con 0x7fd5f40c37d0 2024-01-22T05:09:17.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.839+0000 7f7de3e00700 1 -- 172.21.15.49:0/868590916 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7ddc04a400 con 0x7f7dec0be0e0 2024-01-22T05:09:17.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.839+0000 7fbb76a00700 1 --2- 172.21.15.49:0/3014384761 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbb5805a510 0x7fbb5805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.839+0000 7fbb76a00700 1 -- 172.21.15.49:0/3014384761 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fbb70074aa0 con 0x7fbb80065650 2024-01-22T05:09:17.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.839+0000 7fd5fb200700 1 -- 172.21.15.49:0/796759604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f4131000 con 0x7fd5f40c37d0 2024-01-22T05:09:17.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.839+0000 7fbb7ea00700 1 --2- 172.21.15.49:0/3014384761 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbb5805a510 0x7fbb5805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.839+0000 7fd5eb400700 1 -- 172.21.15.49:0/796759604 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd5dc004cb0 con 0x7fd5f40c37d0 2024-01-22T05:09:17.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.843+0000 7fbb7ea00700 1 --2- 172.21.15.49:0/3014384761 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbb5805a510 0x7fbb5805c9d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fbb80144cf0 tx=0x7fbb68009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.843+0000 7fd5eb400700 1 --2- 172.21.15.49:0/796759604 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd5cc05a590 0x7fd5cc05ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:17.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.843+0000 7fd5eb400700 1 -- 172.21.15.49:0/796759604 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd5dc0742c0 con 0x7fd5f40c37d0 2024-01-22T05:09:17.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.843+0000 7fd5f3e00700 1 --2- 172.21.15.49:0/796759604 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd5cc05a590 0x7fd5cc05ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:17.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.843+0000 7fbb76a00700 1 -- 172.21.15.49:0/3014384761 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbb80157230 con 0x7fbb80065650 2024-01-22T05:09:17.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.843+0000 7fd5f3e00700 1 --2- 172.21.15.49:0/796759604 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd5cc05a590 0x7fd5cc05ca50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fd5e400a010 tx=0x7fd5e4016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:17.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:17.847+0000 7fd5eb400700 1 -- 172.21.15.49:0/796759604 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd5f4131000 con 0x7fd5f40c37d0 2024-01-22T05:09:18.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.059+0000 7fb9efe00700 1 -- 172.21.15.49:0/2761102051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7fb9e8046800 con 0x7fb9e80c4990 2024-01-22T05:09:18.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.063+0000 7f7df3600700 1 -- 172.21.15.49:0/868590916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f7dec062a40 con 0x7f7dec0be0e0 2024-01-22T05:09:18.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.063+0000 7fbb84a00700 1 -- 172.21.15.49:0/3014384761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fbb80157230 con 0x7fbb80065650 2024-01-22T05:09:18.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.075+0000 7fd5fb200700 1 -- 172.21.15.49:0/796759604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) v1 -- 0x7fd5f4130c70 con 0x7fd5f40c37d0 2024-01-22T05:09:18.445 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:09:18.443+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:09:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.455+0000 7fb9e4c00700 1 -- 172.21.15.49:0/2761102051 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 5729 v57) v1 ==== 95+0+0 (secure 0 0 0) 0x7fb9e0019030 con 0x7fb9e80c4990 2024-01-22T05:09:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.455+0000 7fbb76a00700 1 -- 172.21.15.49:0/3014384761 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6310 v57) v1 ==== 95+0+0 (secure 0 0 0) 0x7fbb80157230 con 0x7fbb80065650 2024-01-22T05:09:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.459+0000 7fd5eb400700 1 -- 172.21.15.49:0/796759604 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6316 v57) v1 ==== 95+0+0 (secure 0 0 0) 0x7fd5dc047a30 con 0x7fd5f40c37d0 2024-01-22T05:09:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.459+0000 7f7de3e00700 1 -- 172.21.15.49:0/868590916 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6348 v57) v1 ==== 95+0+0 (secure 0 0 0) 0x7f7ddc04da20 con 0x7f7dec0be0e0 2024-01-22T05:09:18.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.459+0000 7fbb84a00700 1 -- 172.21.15.49:0/3014384761 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbb5805a510 msgr2=0x7fbb5805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:18.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.459+0000 7fbb84a00700 1 --2- 172.21.15.49:0/3014384761 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbb5805a510 0x7fbb5805c9d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fbb80144cf0 tx=0x7fbb68009040).stop 2024-01-22T05:09:18.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.459+0000 7fbb84a00700 1 -- 172.21.15.49:0/3014384761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb80065650 msgr2=0x7fbb80141bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:18.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.459+0000 7fbb84a00700 1 --2- 172.21.15.49:0/3014384761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb80065650 0x7fbb80141bd0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fbb7000d8c0 tx=0x7fbb70008040).stop 2024-01-22T05:09:18.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fb9efe00700 1 -- 172.21.15.49:0/2761102051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9c005a560 msgr2=0x7fb9c005ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:18.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fb9efe00700 1 --2- 172.21.15.49:0/2761102051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9c005a560 0x7fb9c005ca20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fb9d8001d00 tx=0x7fb9d8009040).stop 2024-01-22T05:09:18.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fb9efe00700 1 -- 172.21.15.49:0/2761102051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e80c4990 msgr2=0x7fb9e81644a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:18.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fb9efe00700 1 --2- 172.21.15.49:0/2761102051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e80c4990 0x7fb9e81644a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fb9e000cb60 tx=0x7fb9e0007af0).stop 2024-01-22T05:09:18.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fbb84a00700 1 -- 172.21.15.49:0/3014384761 shutdown_connections 2024-01-22T05:09:18.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fbb84a00700 1 --2- 172.21.15.49:0/3014384761 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbb5805a510 0x7fbb5805c9d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fbb84a00700 1 --2- 172.21.15.49:0/3014384761 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb800681a0 0x7fbb80152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fbb84a00700 1 --2- 172.21.15.49:0/3014384761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb80065a30 0x7fbb801413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fbb84a00700 1 --2- 172.21.15.49:0/3014384761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb80065650 0x7fbb80141bd0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fbb84a00700 1 -- 172.21.15.49:0/3014384761 >> 172.21.15.49:0/3014384761 conn(0x7fbb80062d00 msgr2=0x7fbb8014f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fd5fb200700 1 -- 172.21.15.49:0/796759604 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd5cc05a590 msgr2=0x7fd5cc05ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fd5fb200700 1 --2- 172.21.15.49:0/796759604 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd5cc05a590 0x7fd5cc05ca50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fd5e400a010 tx=0x7fd5e4016000).stop 2024-01-22T05:09:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fd5fb200700 1 -- 172.21.15.49:0/796759604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5f40c37d0 msgr2=0x7fd5f413ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fd5fb200700 1 --2- 172.21.15.49:0/796759604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5f40c37d0 0x7fd5f413ee60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fd5dc00c800 tx=0x7fd5dc001a60).stop 2024-01-22T05:09:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fb9efe00700 1 -- 172.21.15.49:0/2761102051 shutdown_connections 2024-01-22T05:09:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fb9efe00700 1 --2- 172.21.15.49:0/2761102051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9c005a560 0x7fb9c005ca20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fb9efe00700 1 --2- 172.21.15.49:0/2761102051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e80c4990 0x7fb9e81644a0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fb9efe00700 1 --2- 172.21.15.49:0/2761102051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9e80c45b0 0x7fb9e80688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fb9efe00700 1 --2- 172.21.15.49:0/2761102051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9e80bdf30 0x7fb9e80683c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fb9efe00700 1 -- 172.21.15.49:0/2761102051 >> 172.21.15.49:0/2761102051 conn(0x7fb9e80aa6b0 msgr2=0x7fb9e80698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fd5fb200700 1 -- 172.21.15.49:0/796759604 shutdown_connections 2024-01-22T05:09:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fd5fb200700 1 --2- 172.21.15.49:0/796759604 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd5cc05a590 0x7fd5cc05ca50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fd5fb200700 1 --2- 172.21.15.49:0/796759604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5f4153bd0 0x7fd5f40aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fd5fb200700 1 --2- 172.21.15.49:0/796759604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5f40c37d0 0x7fd5f413ee60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fd5fb200700 1 --2- 172.21.15.49:0/796759604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5f40681a0 0x7fd5f41312e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fd5fb200700 1 -- 172.21.15.49:0/796759604 >> 172.21.15.49:0/796759604 conn(0x7fd5f4064080 msgr2=0x7fd5f40c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:18.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fbb84a00700 1 -- 172.21.15.49:0/3014384761 shutdown_connections 2024-01-22T05:09:18.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fb9efe00700 1 -- 172.21.15.49:0/2761102051 shutdown_connections 2024-01-22T05:09:18.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fbb84a00700 1 -- 172.21.15.49:0/3014384761 wait complete. 2024-01-22T05:09:18.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fd5fb200700 1 -- 172.21.15.49:0/796759604 shutdown_connections 2024-01-22T05:09:18.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fb9efe00700 1 -- 172.21.15.49:0/2761102051 wait complete. 2024-01-22T05:09:18.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7fd5fb200700 1 -- 172.21.15.49:0/796759604 wait complete. 2024-01-22T05:09:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7f7df3600700 1 -- 172.21.15.49:0/868590916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7dc405a560 msgr2=0x7f7dc405ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7f7df3600700 1 --2- 172.21.15.49:0/868590916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7dc405a560 0x7f7dc405ca20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f7dec0ad8f0 tx=0x7f7dd4009040).stop 2024-01-22T05:09:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7f7df3600700 1 -- 172.21.15.49:0/868590916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dec0be0e0 msgr2=0x7f7dec169490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7f7df3600700 1 --2- 172.21.15.49:0/868590916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dec0be0e0 0x7f7dec169490 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f7ddc009d50 tx=0x7f7ddc016000).stop 2024-01-22T05:09:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7f7df3600700 1 -- 172.21.15.49:0/868590916 shutdown_connections 2024-01-22T05:09:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7f7df3600700 1 --2- 172.21.15.49:0/868590916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7dc405a560 0x7f7dc405ca20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7f7df3600700 1 --2- 172.21.15.49:0/868590916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dec151140 0x7f7dec0adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7f7df3600700 1 --2- 172.21.15.49:0/868590916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dec153d60 0x7f7dec150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7f7df3600700 1 --2- 172.21.15.49:0/868590916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dec0be0e0 0x7f7dec169490 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7f7df3600700 1 -- 172.21.15.49:0/868590916 >> 172.21.15.49:0/868590916 conn(0x7f7dec064080 msgr2=0x7f7dec153630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:18.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7f7df3600700 1 -- 172.21.15.49:0/868590916 shutdown_connections 2024-01-22T05:09:18.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.463+0000 7f7df3600700 1 -- 172.21.15.49:0/868590916 wait complete. 2024-01-22T05:09:18.471 INFO:teuthology.orchestra.run.smithi049.stderr:failed mds gid 6310 2024-01-22T05:09:18.471 INFO:teuthology.orchestra.run.smithi049.stderr:failed mds gid 6316 2024-01-22T05:09:18.471 INFO:teuthology.orchestra.run.smithi049.stderr:failed mds gid 5729 2024-01-22T05:09:18.472 INFO:teuthology.orchestra.run.smithi049.stderr:failed mds gid 6348 2024-01-22T05:09:18.489 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:09:18.489 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:09:18.490 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:09:18.490 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:09:18.497 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:09:18.497 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:09:18.498 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:09:18.498 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:09:18.499 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:09:18.499 DEBUG:teuthology.parallel:result is None 2024-01-22T05:09:18.502 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:09:18.503 DEBUG:teuthology.parallel:result is None 2024-01-22T05:09:18.545 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:09:18.546 DEBUG:teuthology.parallel:result is None 2024-01-22T05:09:18.548 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:09:18.549 DEBUG:teuthology.parallel:result is None 2024-01-22T05:09:18.549 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:09:18.606 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-22T05:09:18.608 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:09:18.659 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:09:18.670 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:09:18.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.707+0000 7f56d5e00700 1 Processor -- start 2024-01-22T05:09:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.711+0000 7f56d5e00700 1 -- start start 2024-01-22T05:09:18.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.711+0000 7f56d5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d00be6a0 0x7f56d00c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:18.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.711+0000 7f56d5e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f56d0151a80 0x7f56d0064af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:18.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.711+0000 7f56d5e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d00be210 con 0x7f56d0064690 2024-01-22T05:09:18.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.711+0000 7f56d5e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d00bd650 con 0x7f56d0151a80 2024-01-22T05:09:18.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.711+0000 7f56d5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d00bd8e0 con 0x7f56d00be6a0 2024-01-22T05:09:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.715+0000 7f56cea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d00be6a0 0x7f56d00c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.715+0000 7f56cfe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f56d0151a80 0x7f56d0064af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.715+0000 7f56cea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d00be6a0 0x7f56d00c2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:48566/0 (socket says 172.21.15.49:48566) 2024-01-22T05:09:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.715+0000 7f56cea00700 1 -- 172.21.15.49:0/1491312301 learned_addr learned my addr 172.21.15.49:0/1491312301 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.715+0000 7f56cea00700 1 -- 172.21.15.49:0/1491312301 >> v2:172.21.15.49:3300/0 conn(0x7f56d0151a80 msgr2=0x7f56d0064af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.715+0000 7f56cea00700 1 --2- 172.21.15.49:0/1491312301 >> v2:172.21.15.49:3300/0 conn(0x7f56d0151a80 0x7f56d0064af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.715+0000 7f56cea00700 1 -- 172.21.15.49:0/1491312301 >> v1:172.21.15.110:6789/0 conn(0x7f56d0064690 legacy=0x7f56d0151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.715+0000 7f56cea00700 1 -- 172.21.15.49:0/1491312301 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d00bdbc0 con 0x7f56d00be6a0 2024-01-22T05:09:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.715+0000 7f56cea00700 1 --2- 172.21.15.49:0/1491312301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d00be6a0 0x7f56d00c2cf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f56c0006fd0 tx=0x7f56c00090f0).ready entity=mon.2 client_cookie=1c3a9505233142b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:18.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.715+0000 7f56cd600700 1 -- 172.21.15.49:0/1491312301 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c000b580 con 0x7f56d00be6a0 2024-01-22T05:09:18.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.715+0000 7f56cd600700 1 -- 172.21.15.49:0/1491312301 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c000b6e0 con 0x7f56d00be6a0 2024-01-22T05:09:18.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.715+0000 7f56cd600700 1 -- 172.21.15.49:0/1491312301 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c000ba80 con 0x7f56d00be6a0 2024-01-22T05:09:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.715+0000 7f56d5e00700 1 -- 172.21.15.49:0/1491312301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d00be6a0 msgr2=0x7f56d00c2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.715+0000 7f56d5e00700 1 --2- 172.21.15.49:0/1491312301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d00be6a0 0x7f56d00c2cf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f56c0006fd0 tx=0x7f56c00090f0).stop 2024-01-22T05:09:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.719+0000 7f56d5e00700 1 -- 172.21.15.49:0/1491312301 shutdown_connections 2024-01-22T05:09:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.719+0000 7f56d5e00700 1 --2- 172.21.15.49:0/1491312301 >> v2:172.21.15.49:3300/0 conn(0x7f56d0151a80 0x7f56d0064af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.719+0000 7f56d5e00700 1 --2- 172.21.15.49:0/1491312301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d00be6a0 0x7f56d00c2cf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.719+0000 7f56d5e00700 1 -- 172.21.15.49:0/1491312301 >> 172.21.15.49:0/1491312301 conn(0x7f56d00c87f0 msgr2=0x7f56d00c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.719+0000 7f56d5e00700 1 -- 172.21.15.49:0/1491312301 shutdown_connections 2024-01-22T05:09:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.719+0000 7f56d5e00700 1 -- 172.21.15.49:0/1491312301 wait complete. 2024-01-22T05:09:18.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.723+0000 7f56d5e00700 1 Processor -- start 2024-01-22T05:09:18.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.723+0000 7f56d5e00700 1 -- start start 2024-01-22T05:09:18.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.723+0000 7f56d5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d0064690 0x7f56d00bfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:18.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.723+0000 7f56d5e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d00be6a0 0x7f56d013e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:18.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.723+0000 7f56d5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d0151a80 0x7f56d00c1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:18.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56d5e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d013ecc0 con 0x7f56d0064690 2024-01-22T05:09:18.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56d5e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d00c0370 con 0x7f56d00be6a0 2024-01-22T05:09:18.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56d5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d00c0650 con 0x7f56d0151a80 2024-01-22T05:09:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56cea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d0064690 0x7f56d00bfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56cea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d0064690 0x7f56d00bfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35942/0 (socket says 172.21.15.49:35942) 2024-01-22T05:09:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56cea00700 1 -- 172.21.15.49:0/3276956844 learned_addr learned my addr 172.21.15.49:0/3276956844 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56cfe00700 1 --2- 172.21.15.49:0/3276956844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d0151a80 0x7f56d00c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56ce000700 1 --2- 172.21.15.49:0/3276956844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d00be6a0 0x7f56d013e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56cea00700 1 -- 172.21.15.49:0/3276956844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d0151a80 msgr2=0x7f56d00c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56cea00700 1 --2- 172.21.15.49:0/3276956844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d0151a80 0x7f56d00c1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56cea00700 1 -- 172.21.15.49:0/3276956844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d00be6a0 msgr2=0x7f56d013e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56cea00700 1 --2- 172.21.15.49:0/3276956844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d00be6a0 0x7f56d013e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56cea00700 1 -- 172.21.15.49:0/3276956844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c0009370 con 0x7f56d0064690 2024-01-22T05:09:18.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56cea00700 1 --2- 172.21.15.49:0/3276956844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d0064690 0x7f56d00bfd90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f56c0009ea0 tx=0x7f56c0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:18.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56c6000700 1 -- 172.21.15.49:0/3276956844 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0006970 con 0x7f56d0064690 2024-01-22T05:09:18.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56c6000700 1 -- 172.21.15.49:0/3276956844 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c000be40 con 0x7f56d0064690 2024-01-22T05:09:18.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56d5e00700 1 -- 172.21.15.49:0/3276956844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d00c0930 con 0x7f56d0064690 2024-01-22T05:09:18.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56c6000700 1 -- 172.21.15.49:0/3276956844 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c001c420 con 0x7f56d0064690 2024-01-22T05:09:18.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.727+0000 7f56d5e00700 1 -- 172.21.15.49:0/3276956844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d00c0ef0 con 0x7f56d0064690 2024-01-22T05:09:18.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.731+0000 7f56d5e00700 1 -- 172.21.15.49:0/3276956844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d0047060 con 0x7f56d0064690 2024-01-22T05:09:18.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.731+0000 7f56c6000700 1 -- 172.21.15.49:0/3276956844 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f56c001c7d0 con 0x7f56d0064690 2024-01-22T05:09:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.731+0000 7f56c6000700 1 --2- 172.21.15.49:0/3276956844 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56a805a510 0x7f56a805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.731+0000 7f56c6000700 1 -- 172.21.15.49:0/3276956844 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f56c0076590 con 0x7f56d0064690 2024-01-22T05:09:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.735+0000 7f56ce000700 1 --2- 172.21.15.49:0/3276956844 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56a805a510 0x7f56a805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.735+0000 7f56ce000700 1 --2- 172.21.15.49:0/3276956844 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56a805a510 0x7f56a805c9d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f56d014a050 tx=0x7f56b8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.739+0000 7f56c6000700 1 -- 172.21.15.49:0/3276956844 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f56c0049b20 con 0x7f56d0064690 2024-01-22T05:09:18.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.939+0000 7f56d5e00700 1 -- 172.21.15.49:0/3276956844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56d00bdea0 con 0x7f56d0064690 2024-01-22T05:09:18.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.939+0000 7f56c6000700 1 -- 172.21.15.49:0/3276956844 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+1456 (secure 0 0 0) 0x7f56c0020020 con 0x7f56d0064690 2024-01-22T05:09:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:18.945 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":57,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:09:03.929962+0000","modified":"2024-01-22T05:09:18.444972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-22T05:09:18.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.943+0000 7f56d5e00700 1 -- 172.21.15.49:0/3276956844 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56a805a510 msgr2=0x7f56a805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:18.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.943+0000 7f56d5e00700 1 --2- 172.21.15.49:0/3276956844 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56a805a510 0x7f56a805c9d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f56d014a050 tx=0x7f56b8009040).stop 2024-01-22T05:09:18.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.943+0000 7f56d5e00700 1 -- 172.21.15.49:0/3276956844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d0064690 msgr2=0x7f56d00bfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:18.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.943+0000 7f56d5e00700 1 --2- 172.21.15.49:0/3276956844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d0064690 0x7f56d00bfd90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f56c0009ea0 tx=0x7f56c0017000).stop 2024-01-22T05:09:18.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.943+0000 7f56d5e00700 1 -- 172.21.15.49:0/3276956844 shutdown_connections 2024-01-22T05:09:18.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.943+0000 7f56d5e00700 1 --2- 172.21.15.49:0/3276956844 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56a805a510 0x7f56a805c9d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.943+0000 7f56d5e00700 1 --2- 172.21.15.49:0/3276956844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d0151a80 0x7f56d00c1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.943+0000 7f56d5e00700 1 --2- 172.21.15.49:0/3276956844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d00be6a0 0x7f56d013e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.943+0000 7f56d5e00700 1 --2- 172.21.15.49:0/3276956844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d0064690 0x7f56d00bfd90 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:18.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.943+0000 7f56d5e00700 1 -- 172.21.15.49:0/3276956844 >> 172.21.15.49:0/3276956844 conn(0x7f56d00c87f0 msgr2=0x7f56d0063b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.943+0000 7f56d5e00700 1 -- 172.21.15.49:0/3276956844 shutdown_connections 2024-01-22T05:09:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:18.943+0000 7f56d5e00700 1 -- 172.21.15.49:0/3276956844 wait complete. 2024-01-22T05:09:18.952 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 57 2024-01-22T05:09:19.371 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:09:03.929962+0000', 'modified': '2024-01-22T05:09:18.444972+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 73, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:09:19.372 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2024-01-22T05:09:20.372 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:09:20.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.539+0000 7f5ec5800700 1 Processor -- start 2024-01-22T05:09:20.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.539+0000 7f5ec5800700 1 -- start start 2024-01-22T05:09:20.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ec5800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ec00bdd90 0x7f5ec00be170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:20.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ec5800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5ec0159330 0x7f5ec0062330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:20.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ec5800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec0068120 con 0x7f5ec01587c0 2024-01-22T05:09:20.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ec5800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec00683e0 con 0x7f5ec0159330 2024-01-22T05:09:20.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ec5800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00686c0 con 0x7f5ec00bdd90 2024-01-22T05:09:20.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebe000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5ec01587c0 0x7f5ec0158c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53112/0 (socket says 172.21.15.49:53112) 2024-01-22T05:09:20.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebe000700 1 -- 172.21.15.49:0/750690332 learned_addr learned my addr 172.21.15.49:0/750690332 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:20.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebea00700 1 --2- 172.21.15.49:0/750690332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ec00bdd90 0x7f5ec00be170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:20.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebfe00700 1 --2- 172.21.15.49:0/750690332 >> v2:172.21.15.110:3300/0 conn(0x7f5ec0159330 0x7f5ec0062330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:20.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 -- 172.21.15.49:0/750690332 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451441044 0 0) 0x7f5ec0068120 con 0x7f5ec01587c0 2024-01-22T05:09:20.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 -- 172.21.15.49:0/750690332 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ea00033f0 con 0x7f5ec01587c0 2024-01-22T05:09:20.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 -- 172.21.15.49:0/750690332 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1144076340 0 0) 0x7f5ea00033f0 con 0x7f5ec01587c0 2024-01-22T05:09:20.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 -- 172.21.15.49:0/750690332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ec00bdd90 msgr2=0x7f5ec00be170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:20.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 --2- 172.21.15.49:0/750690332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ec00bdd90 0x7f5ec00be170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:20.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 -- 172.21.15.49:0/750690332 >> v2:172.21.15.110:3300/0 conn(0x7f5ec0159330 msgr2=0x7f5ec0062330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:20.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 --2- 172.21.15.49:0/750690332 >> v2:172.21.15.110:3300/0 conn(0x7f5ec0159330 0x7f5ec0062330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:20.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 -- 172.21.15.49:0/750690332 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec00689a0 con 0x7f5ec01587c0 2024-01-22T05:09:20.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 -- 172.21.15.49:0/750690332 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f5ea8001470 con 0x7f5ec01587c0 2024-01-22T05:09:20.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 -- 172.21.15.49:0/750690332 >> v1:172.21.15.49:6789/0 conn(0x7f5ec01587c0 legacy=0x7f5ec0158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:20.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 --2- 172.21.15.49:0/750690332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea00038e0 0x7f5ea0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:20.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 --2- 172.21.15.49:0/750690332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ec00bdd90 0x7f5ea0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:20.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 --2- 172.21.15.49:0/750690332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ea0004b80 0x7f5ea0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:20.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 -- 172.21.15.49:0/750690332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00683e0 con 0x7f5ea00038e0 2024-01-22T05:09:20.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 -- 172.21.15.49:0/750690332 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00686c0 con 0x7f5ea0004b80 2024-01-22T05:09:20.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.543+0000 7f5ebd600700 1 -- 172.21.15.49:0/750690332 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea000b8e0 con 0x7f5ec00bdd90 2024-01-22T05:09:20.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ebfe00700 1 --2- 172.21.15.49:0/750690332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ea0004b80 0x7f5ea0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:20.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ebe000700 1 --2- 172.21.15.49:0/750690332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ec00bdd90 0x7f5ea0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:20.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ebea00700 1 --2- 172.21.15.49:0/750690332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea00038e0 0x7f5ea0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:20.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ebfe00700 1 -- 172.21.15.49:0/750690332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ec00bdd90 msgr2=0x7f5ea0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:20.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ebfe00700 1 --2- 172.21.15.49:0/750690332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ec00bdd90 0x7f5ea0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:20.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ebfe00700 1 -- 172.21.15.49:0/750690332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea00038e0 msgr2=0x7f5ea0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:20.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ebfe00700 1 --2- 172.21.15.49:0/750690332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea00038e0 0x7f5ea0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:20.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ebfe00700 1 -- 172.21.15.49:0/750690332 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea00033f0 con 0x7f5ea0004b80 2024-01-22T05:09:20.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ebfe00700 1 --2- 172.21.15.49:0/750690332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ea0004b80 0x7f5ea0005000 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f5ec0066af0 tx=0x7f5eb800b040).ready entity=mon.1 client_cookie=acc42bdbd3290000 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:20.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ebd600700 1 -- 172.21.15.49:0/750690332 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8009ac0 con 0x7f5ea0004b80 2024-01-22T05:09:20.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ebd600700 1 -- 172.21.15.49:0/750690332 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb800f040 con 0x7f5ea0004b80 2024-01-22T05:09:20.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ebd600700 1 -- 172.21.15.49:0/750690332 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb800eca0 con 0x7f5ea0004b80 2024-01-22T05:09:20.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ec5800700 1 -- 172.21.15.49:0/750690332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ea0004b80 msgr2=0x7f5ea0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:20.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ec5800700 1 --2- 172.21.15.49:0/750690332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ea0004b80 0x7f5ea0005000 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f5ec0066af0 tx=0x7f5eb800b040).stop 2024-01-22T05:09:20.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ebfe00700 1 -- 172.21.15.49:0/750690332 reap_dead start 2024-01-22T05:09:20.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.547+0000 7f5ec5800700 1 -- 172.21.15.49:0/750690332 shutdown_connections 2024-01-22T05:09:20.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.551+0000 7f5ec5800700 1 -- 172.21.15.49:0/750690332 >> 172.21.15.49:0/750690332 conn(0x7f5ec0064080 msgr2=0x7f5ec0064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:20.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.551+0000 7f5ec5800700 1 -- 172.21.15.49:0/750690332 shutdown_connections 2024-01-22T05:09:20.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.551+0000 7f5ec5800700 1 -- 172.21.15.49:0/750690332 wait complete. 2024-01-22T05:09:20.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.551+0000 7f5ec5800700 1 Processor -- start 2024-01-22T05:09:20.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ec5800700 1 -- start start 2024-01-22T05:09:20.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ec5800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0004b80 0x7f5ec01510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:20.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ec5800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ec01515a0 0x7f5ec00acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:20.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ec5800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ec00ad1f0 0x7f5ec0062bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:20.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ec5800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00ad670 con 0x7f5ea0004b80 2024-01-22T05:09:20.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ec5800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec0169290 con 0x7f5ec00ad1f0 2024-01-22T05:09:20.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ec5800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00c17b0 con 0x7f5ec01515a0 2024-01-22T05:09:20.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ebea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0004b80 0x7f5ec01510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:20.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ebea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0004b80 0x7f5ec01510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35956/0 (socket says 172.21.15.49:35956) 2024-01-22T05:09:20.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ebea00700 1 -- 172.21.15.49:0/765980101 learned_addr learned my addr 172.21.15.49:0/765980101 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:20.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ebfe00700 1 --2- 172.21.15.49:0/765980101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ec00ad1f0 0x7f5ec0062bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:20.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ebe000700 1 --2- 172.21.15.49:0/765980101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ec01515a0 0x7f5ec00acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:20.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ebea00700 1 -- 172.21.15.49:0/765980101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ec01515a0 msgr2=0x7f5ec00acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:20.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ebea00700 1 --2- 172.21.15.49:0/765980101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ec01515a0 0x7f5ec00acd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:20.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ebea00700 1 -- 172.21.15.49:0/765980101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ec00ad1f0 msgr2=0x7f5ec0062bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:20.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ebea00700 1 --2- 172.21.15.49:0/765980101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ec00ad1f0 0x7f5ec0062bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:20.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ebea00700 1 -- 172.21.15.49:0/765980101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec01682a0 con 0x7f5ea0004b80 2024-01-22T05:09:20.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ebe000700 1 --2- 172.21.15.49:0/765980101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ec01515a0 0x7f5ec00acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:20.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.555+0000 7f5ebea00700 1 --2- 172.21.15.49:0/765980101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0004b80 0x7f5ec01510b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f5eb00119f0 tx=0x7f5eb0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:20.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.559+0000 7f5eb6000700 1 -- 172.21.15.49:0/765980101 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0011ee0 con 0x7f5ea0004b80 2024-01-22T05:09:20.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.559+0000 7f5eb6000700 1 -- 172.21.15.49:0/765980101 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb000f8e0 con 0x7f5ea0004b80 2024-01-22T05:09:20.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.559+0000 7f5ec5800700 1 -- 172.21.15.49:0/765980101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec0168e00 con 0x7f5ea0004b80 2024-01-22T05:09:20.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.559+0000 7f5eb6000700 1 -- 172.21.15.49:0/765980101 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb000fc60 con 0x7f5ea0004b80 2024-01-22T05:09:20.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.559+0000 7f5ec5800700 1 -- 172.21.15.49:0/765980101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec01687b0 con 0x7f5ea0004b80 2024-01-22T05:09:20.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.559+0000 7f5ec5800700 1 -- 172.21.15.49:0/765980101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec0047060 con 0x7f5ea0004b80 2024-01-22T05:09:20.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.563+0000 7f5eb6000700 1 -- 172.21.15.49:0/765980101 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5eb0014650 con 0x7f5ea0004b80 2024-01-22T05:09:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.563+0000 7f5eb6000700 1 --2- 172.21.15.49:0/765980101 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e9805a4e0 0x7f5e9805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.563+0000 7f5eb6000700 1 -- 172.21.15.49:0/765980101 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f5eb00754e0 con 0x7f5ea0004b80 2024-01-22T05:09:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.563+0000 7f5ebe000700 1 --2- 172.21.15.49:0/765980101 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e9805a4e0 0x7f5e9805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:20.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.563+0000 7f5ebe000700 1 --2- 172.21.15.49:0/765980101 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e9805a4e0 0x7f5e9805c9a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f5ea8001c40 tx=0x7f5ea8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:20.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.567+0000 7f5eb6000700 1 -- 172.21.15.49:0/765980101 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5eb0048b10 con 0x7f5ea0004b80 2024-01-22T05:09:20.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.763+0000 7f5ec5800700 1 -- 172.21.15.49:0/765980101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ec0068c80 con 0x7f5ea0004b80 2024-01-22T05:09:20.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.763+0000 7f5eb6000700 1 -- 172.21.15.49:0/765980101 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f5eb004c130 con 0x7f5ea0004b80 2024-01-22T05:09:20.767 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:20.768 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":60,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4087795616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4087795616},{"type":"v1","addr":"172.21.15.110:6833","nonce":4087795616}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3220435249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3220435249},{"type":"v1","addr":"172.21.15.110:6835","nonce":3220435249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3927178750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3927178750},{"type":"v1","addr":"172.21.15.49:6835","nonce":3927178750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:09:03.929962+0000","modified":"2024-01-22T05:09:20.477702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6609},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6609":{"gid":6609,"name":"a","rank":0,"incarnation":59,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.49:6837/2814482810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2814482810},{"type":"v1","addr":"172.21.15.49:6837","nonce":2814482810}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-22T05:09:20.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.767+0000 7f5ec5800700 1 -- 172.21.15.49:0/765980101 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e9805a4e0 msgr2=0x7f5e9805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:20.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.767+0000 7f5ec5800700 1 --2- 172.21.15.49:0/765980101 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e9805a4e0 0x7f5e9805c9a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f5ea8001c40 tx=0x7f5ea8009040).stop 2024-01-22T05:09:20.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.767+0000 7f5ec5800700 1 -- 172.21.15.49:0/765980101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0004b80 msgr2=0x7f5ec01510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:20.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.767+0000 7f5ec5800700 1 --2- 172.21.15.49:0/765980101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0004b80 0x7f5ec01510b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f5eb00119f0 tx=0x7f5eb0009060).stop 2024-01-22T05:09:20.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.767+0000 7f5ec5800700 1 -- 172.21.15.49:0/765980101 shutdown_connections 2024-01-22T05:09:20.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.767+0000 7f5ec5800700 1 --2- 172.21.15.49:0/765980101 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e9805a4e0 0x7f5e9805c9a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:20.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.767+0000 7f5ec5800700 1 --2- 172.21.15.49:0/765980101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ec00ad1f0 0x7f5ec0062bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:20.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.767+0000 7f5ec5800700 1 --2- 172.21.15.49:0/765980101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ec01515a0 0x7f5ec00acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:20.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.767+0000 7f5ec5800700 1 --2- 172.21.15.49:0/765980101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0004b80 0x7f5ec01510b0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:20.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.767+0000 7f5ec5800700 1 -- 172.21.15.49:0/765980101 >> 172.21.15.49:0/765980101 conn(0x7f5ec0064080 msgr2=0x7f5ec00c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:20.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.767+0000 7f5ec5800700 1 -- 172.21.15.49:0/765980101 shutdown_connections 2024-01-22T05:09:20.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:20.767+0000 7f5ec5800700 1 -- 172.21.15.49:0/765980101 wait complete. 2024-01-22T05:09:20.774 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 60 2024-01-22T05:09:21.199 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:09:03.929962+0000', 'modified': '2024-01-22T05:09:20.477702+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 73, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6609}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6609': {'gid': 6609, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.49:6837/2814482810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6836', 'nonce': 2814482810}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 2814482810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:09:21.200 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6609:up:reconnect 2024-01-22T05:09:22.200 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:09:22.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.359+0000 7f9dc0e00700 1 Processor -- start 2024-01-22T05:09:22.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.363+0000 7f9dc0e00700 1 -- start start 2024-01-22T05:09:22.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.363+0000 7f9dc0e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dbc0c2560 0x7f9dbc162b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:22.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.363+0000 7f9dc0e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dbc066a10 con 0x7f9dbc068e80 2024-01-22T05:09:22.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.363+0000 7f9dc0e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dbc0a8140 con 0x7f9dbc0a7cb0 2024-01-22T05:09:22.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.363+0000 7f9dc0e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc0a8420 con 0x7f9dbc0c2560 2024-01-22T05:09:22.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.363+0000 7f9db9400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9dbc068e80 0x7f9dbc0c0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53118/0 (socket says 172.21.15.49:53118) 2024-01-22T05:09:22.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.363+0000 7f9db9400700 1 -- 172.21.15.49:0/1942998862 learned_addr learned my addr 172.21.15.49:0/1942998862 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:22.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.363+0000 7f9dba800700 1 --2- 172.21.15.49:0/1942998862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dbc0c2560 0x7f9dbc162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9db8a00700 1 -- 172.21.15.49:0/1942998862 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720579980 0 0) 0x7f9dbc066a10 con 0x7f9dbc068e80 2024-01-22T05:09:22.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9db8a00700 1 -- 172.21.15.49:0/1942998862 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d9c0033f0 con 0x7f9dbc068e80 2024-01-22T05:09:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9db8a00700 1 -- 172.21.15.49:0/1942998862 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943050806 0 0) 0x7f9dbc0a8140 con 0x7f9dbc0a7cb0 2024-01-22T05:09:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9db8a00700 1 -- 172.21.15.49:0/1942998862 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dbc066a10 con 0x7f9dbc0a7cb0 2024-01-22T05:09:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9dba800700 1 -- 172.21.15.49:0/1942998862 >> v1:172.21.15.110:6789/0 conn(0x7f9dbc0a7cb0 legacy=0x7f9dbc157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9dba800700 1 -- 172.21.15.49:0/1942998862 >> v1:172.21.15.49:6789/0 conn(0x7f9dbc068e80 legacy=0x7f9dbc0c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9db8a00700 1 -- 172.21.15.49:0/1942998862 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3927277987 0 0) 0x7f9d9c0033f0 con 0x7f9dbc068e80 2024-01-22T05:09:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9dba800700 1 -- 172.21.15.49:0/1942998862 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc0a8700 con 0x7f9dbc0c2560 2024-01-22T05:09:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9dba800700 1 --2- 172.21.15.49:0/1942998862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dbc0c2560 0x7f9dbc162b70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f9db4009e90 tx=0x7f9db4009780).ready entity=mon.2 client_cookie=c5bce598d21c0b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:22.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9db8a00700 1 -- 172.21.15.49:0/1942998862 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db400e070 con 0x7f9dbc0c2560 2024-01-22T05:09:22.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9db8a00700 1 -- 172.21.15.49:0/1942998862 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db400b7a0 con 0x7f9dbc0c2560 2024-01-22T05:09:22.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9db8a00700 1 -- 172.21.15.49:0/1942998862 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da4001470 con 0x7f9dbc0c2560 2024-01-22T05:09:22.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9dc0e00700 1 -- 172.21.15.49:0/1942998862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dbc0c2560 msgr2=0x7f9dbc162b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:22.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9dc0e00700 1 --2- 172.21.15.49:0/1942998862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dbc0c2560 0x7f9dbc162b70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f9db4009e90 tx=0x7f9db4009780).stop 2024-01-22T05:09:22.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9dc0e00700 1 -- 172.21.15.49:0/1942998862 shutdown_connections 2024-01-22T05:09:22.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9dc0e00700 1 --2- 172.21.15.49:0/1942998862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dbc0c2560 0x7f9dbc162b70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:22.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.367+0000 7f9dc0e00700 1 -- 172.21.15.49:0/1942998862 >> 172.21.15.49:0/1942998862 conn(0x7f9dbc0c64a0 msgr2=0x7f9dbc0c68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.371+0000 7f9dc0e00700 1 -- 172.21.15.49:0/1942998862 shutdown_connections 2024-01-22T05:09:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.371+0000 7f9dc0e00700 1 -- 172.21.15.49:0/1942998862 wait complete. 2024-01-22T05:09:22.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.371+0000 7f9dc0e00700 1 Processor -- start 2024-01-22T05:09:22.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.371+0000 7f9dc0e00700 1 -- start start 2024-01-22T05:09:22.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9dc0e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dbc068e80 0x7f9dbc159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:22.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9dc0e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc0c2560 0x7f9dbc142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:22.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9dc0e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dbc158460 0x7f9dbc0c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:22.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9dc0e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc168150 con 0x7f9dbc0c2560 2024-01-22T05:09:22.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9dc0e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc168fb0 con 0x7f9dbc158460 2024-01-22T05:09:22.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9dc0e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc1683a0 con 0x7f9dbc068e80 2024-01-22T05:09:22.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9db9400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc0c2560 0x7f9dbc142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:22.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9db9400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc0c2560 0x7f9dbc142d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35964/0 (socket says 172.21.15.49:35964) 2024-01-22T05:09:22.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9db9400700 1 -- 172.21.15.49:0/3015983826 learned_addr learned my addr 172.21.15.49:0/3015983826 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:22.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9dba800700 1 --2- 172.21.15.49:0/3015983826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dbc158460 0x7f9dbc0c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:22.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9db9e00700 1 --2- 172.21.15.49:0/3015983826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dbc068e80 0x7f9dbc159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:22.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9db9400700 1 -- 172.21.15.49:0/3015983826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dbc068e80 msgr2=0x7f9dbc159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:22.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9db9400700 1 --2- 172.21.15.49:0/3015983826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dbc068e80 0x7f9dbc159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:22.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9db9400700 1 -- 172.21.15.49:0/3015983826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dbc158460 msgr2=0x7f9dbc0c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:22.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9db9400700 1 --2- 172.21.15.49:0/3015983826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dbc158460 0x7f9dbc0c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:22.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9db9400700 1 -- 172.21.15.49:0/3015983826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4009a20 con 0x7f9dbc0c2560 2024-01-22T05:09:22.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9dba800700 1 --2- 172.21.15.49:0/3015983826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dbc158460 0x7f9dbc0c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:22.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9db9400700 1 --2- 172.21.15.49:0/3015983826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc0c2560 0x7f9dbc142d80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f9da400c840 tx=0x7f9da4001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:22.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9db1600700 1 -- 172.21.15.49:0/3015983826 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da4007170 con 0x7f9dbc0c2560 2024-01-22T05:09:22.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9dc0e00700 1 -- 172.21.15.49:0/3015983826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dbc168680 con 0x7f9dbc0c2560 2024-01-22T05:09:22.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.375+0000 7f9db1600700 1 -- 172.21.15.49:0/3015983826 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da40072d0 con 0x7f9dbc0c2560 2024-01-22T05:09:22.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.379+0000 7f9db1600700 1 -- 172.21.15.49:0/3015983826 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da40048c0 con 0x7f9dbc0c2560 2024-01-22T05:09:22.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.379+0000 7f9dc0e00700 1 -- 172.21.15.49:0/3015983826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dbc168c40 con 0x7f9dbc0c2560 2024-01-22T05:09:22.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.379+0000 7f9dc0e00700 1 -- 172.21.15.49:0/3015983826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dbc169140 con 0x7f9dbc0c2560 2024-01-22T05:09:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.379+0000 7f9db1600700 1 -- 172.21.15.49:0/3015983826 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9da4004c70 con 0x7f9dbc0c2560 2024-01-22T05:09:22.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.383+0000 7f9db1600700 1 --2- 172.21.15.49:0/3015983826 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d9405a4e0 0x7f9d9405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.383+0000 7f9db1600700 1 -- 172.21.15.49:0/3015983826 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f9da40742e0 con 0x7f9dbc0c2560 2024-01-22T05:09:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.383+0000 7f9db9e00700 1 --2- 172.21.15.49:0/3015983826 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d9405a4e0 0x7f9d9405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.383+0000 7f9db9e00700 1 --2- 172.21.15.49:0/3015983826 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d9405a4e0 0x7f9d9405c9a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f9dac003930 tx=0x7f9dac007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:22.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.387+0000 7f9db1600700 1 -- 172.21.15.49:0/3015983826 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9da4047910 con 0x7f9dbc0c2560 2024-01-22T05:09:22.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.590+0000 7f9dc0e00700 1 -- 172.21.15.49:0/3015983826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9dbc046800 con 0x7f9dbc0c2560 2024-01-22T05:09:22.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.590+0000 7f9db1600700 1 -- 172.21.15.49:0/3015983826 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4498 (secure 0 0 0) 0x7f9da4019070 con 0x7f9dbc0c2560 2024-01-22T05:09:22.596 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:22.596 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":62,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4087795616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4087795616},{"type":"v1","addr":"172.21.15.110:6833","nonce":4087795616}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3220435249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3220435249},{"type":"v1","addr":"172.21.15.110:6835","nonce":3220435249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3927178750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3927178750},{"type":"v1","addr":"172.21.15.49:6835","nonce":3927178750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:09:03.929962+0000","modified":"2024-01-22T05:09:22.494561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6609},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6609":{"gid":6609,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/2814482810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2814482810},{"type":"v1","addr":"172.21.15.49:6837","nonce":2814482810}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-22T05:09:22.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.594+0000 7f9dc0e00700 1 -- 172.21.15.49:0/3015983826 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d9405a4e0 msgr2=0x7f9d9405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:22.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.594+0000 7f9dc0e00700 1 --2- 172.21.15.49:0/3015983826 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d9405a4e0 0x7f9d9405c9a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f9dac003930 tx=0x7f9dac007bd0).stop 2024-01-22T05:09:22.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.594+0000 7f9dc0e00700 1 -- 172.21.15.49:0/3015983826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc0c2560 msgr2=0x7f9dbc142d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:22.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.594+0000 7f9dc0e00700 1 --2- 172.21.15.49:0/3015983826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc0c2560 0x7f9dbc142d80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f9da400c840 tx=0x7f9da4001b50).stop 2024-01-22T05:09:22.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.594+0000 7f9dc0e00700 1 -- 172.21.15.49:0/3015983826 shutdown_connections 2024-01-22T05:09:22.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.594+0000 7f9dc0e00700 1 --2- 172.21.15.49:0/3015983826 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d9405a4e0 0x7f9d9405c9a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:22.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.594+0000 7f9dc0e00700 1 --2- 172.21.15.49:0/3015983826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dbc158460 0x7f9dbc0c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:22.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.594+0000 7f9dc0e00700 1 --2- 172.21.15.49:0/3015983826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc0c2560 0x7f9dbc142d80 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:22.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.594+0000 7f9dc0e00700 1 --2- 172.21.15.49:0/3015983826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dbc068e80 0x7f9dbc159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:22.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.594+0000 7f9dc0e00700 1 -- 172.21.15.49:0/3015983826 >> 172.21.15.49:0/3015983826 conn(0x7f9dbc0c64a0 msgr2=0x7f9dbc0c1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:22.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.598+0000 7f9dc0e00700 1 -- 172.21.15.49:0/3015983826 shutdown_connections 2024-01-22T05:09:22.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:22.598+0000 7f9dc0e00700 1 -- 172.21.15.49:0/3015983826 wait complete. 2024-01-22T05:09:22.605 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 62 2024-01-22T05:09:23.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:09:03.929962+0000', 'modified': '2024-01-22T05:09:22.494561+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 73, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6609}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6609': {'gid': 6609, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.49:6837/2814482810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6836', 'nonce': 2814482810}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 2814482810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:09:23.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:09:23.027 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-22T05:09:23.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.194+0000 7f4a39400700 1 Processor -- start 2024-01-22T05:09:23.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.194+0000 7f4a39400700 1 -- start start 2024-01-22T05:09:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a39400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a340c3690 0x7f4a340c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a39400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4a34155550 0x7f4a341559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a39400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a340bdc10 con 0x7f4a34067a90 2024-01-22T05:09:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a39400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a340c3f60 con 0x7f4a34155550 2024-01-22T05:09:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a39400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a34155ea0 con 0x7f4a340c3690 2024-01-22T05:09:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a31e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4a34155550 0x7f4a341559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a31e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4a34155550 0x7f4a341559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35972/0 (socket says 172.21.15.49:35972) 2024-01-22T05:09:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a31e00700 1 -- 172.21.15.49:0/3430449654 learned_addr learned my addr 172.21.15.49:0/3430449654 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a32800700 1 --2- 172.21.15.49:0/3430449654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a340c3690 0x7f4a340c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a31e00700 1 -- 172.21.15.49:0/3430449654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a340c3690 msgr2=0x7f4a340c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a31e00700 1 --2- 172.21.15.49:0/3430449654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a340c3690 0x7f4a340c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a31e00700 1 -- 172.21.15.49:0/3430449654 >> v1:172.21.15.49:6789/0 conn(0x7f4a34067a90 legacy=0x7f4a34067f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a31e00700 1 -- 172.21.15.49:0/3430449654 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a34068e10 con 0x7f4a34155550 2024-01-22T05:09:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a31e00700 1 --2- 172.21.15.49:0/3430449654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a34155550 0x7f4a341559b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f4a1c006fd0 tx=0x7f4a1c0090f0).ready entity=mon.0 client_cookie=3d601f21edbab8a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a31400700 1 -- 172.21.15.49:0/3430449654 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c00b580 con 0x7f4a34155550 2024-01-22T05:09:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a31400700 1 -- 172.21.15.49:0/3430449654 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c00b6e0 con 0x7f4a34155550 2024-01-22T05:09:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.198+0000 7f4a31400700 1 -- 172.21.15.49:0/3430449654 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c00ba60 con 0x7f4a34155550 2024-01-22T05:09:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.202+0000 7f4a39400700 1 -- 172.21.15.49:0/3430449654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a34155550 msgr2=0x7f4a341559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.202+0000 7f4a39400700 1 --2- 172.21.15.49:0/3430449654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a34155550 0x7f4a341559b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f4a1c006fd0 tx=0x7f4a1c0090f0).stop 2024-01-22T05:09:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.202+0000 7f4a39400700 1 -- 172.21.15.49:0/3430449654 shutdown_connections 2024-01-22T05:09:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.202+0000 7f4a39400700 1 --2- 172.21.15.49:0/3430449654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a34155550 0x7f4a341559b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.202+0000 7f4a39400700 1 --2- 172.21.15.49:0/3430449654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a340c3690 0x7f4a340c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.202+0000 7f4a39400700 1 -- 172.21.15.49:0/3430449654 >> 172.21.15.49:0/3430449654 conn(0x7f4a340c51c0 msgr2=0x7f4a340c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.202+0000 7f4a39400700 1 -- 172.21.15.49:0/3430449654 shutdown_connections 2024-01-22T05:09:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.202+0000 7f4a39400700 1 -- 172.21.15.49:0/3430449654 wait complete. 2024-01-22T05:09:23.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.202+0000 7f4a39400700 1 Processor -- start 2024-01-22T05:09:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.202+0000 7f4a39400700 1 -- start start 2024-01-22T05:09:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a39400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a34067a90 0x7f4a34154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a39400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a340c3690 0x7f4a34062ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a39400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a34155550 0x7f4a34063d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a39400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a34064240 con 0x7f4a34155550 2024-01-22T05:09:23.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a39400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a34063570 con 0x7f4a340c3690 2024-01-22T05:09:23.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a39400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a340c0930 con 0x7f4a34067a90 2024-01-22T05:09:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a33200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a34155550 0x7f4a34063d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a33200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a34155550 0x7f4a34063d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35976/0 (socket says 172.21.15.49:35976) 2024-01-22T05:09:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a33200700 1 -- 172.21.15.49:0/3282336491 learned_addr learned my addr 172.21.15.49:0/3282336491 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a31e00700 1 --2- 172.21.15.49:0/3282336491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a340c3690 0x7f4a34062ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a32800700 1 --2- 172.21.15.49:0/3282336491 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a34067a90 0x7f4a34154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a33200700 1 -- 172.21.15.49:0/3282336491 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a34067a90 msgr2=0x7f4a34154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a33200700 1 --2- 172.21.15.49:0/3282336491 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a34067a90 0x7f4a34154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a33200700 1 -- 172.21.15.49:0/3282336491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a340c3690 msgr2=0x7f4a34062ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a33200700 1 --2- 172.21.15.49:0/3282336491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a340c3690 0x7f4a34062ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a33200700 1 -- 172.21.15.49:0/3282336491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c009370 con 0x7f4a34155550 2024-01-22T05:09:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a31e00700 1 --2- 172.21.15.49:0/3282336491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a340c3690 0x7f4a34062ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a33200700 1 --2- 172.21.15.49:0/3282336491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a34155550 0x7f4a34063d50 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f4a2c002230 tx=0x7f4a2c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a2a000700 1 -- 172.21.15.49:0/3282336491 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00e4a0 con 0x7f4a34155550 2024-01-22T05:09:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a2a000700 1 -- 172.21.15.49:0/3282336491 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c00e600 con 0x7f4a34155550 2024-01-22T05:09:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a39400700 1 -- 172.21.15.49:0/3282336491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a340c0c10 con 0x7f4a34155550 2024-01-22T05:09:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.206+0000 7f4a2a000700 1 -- 172.21.15.49:0/3282336491 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00e980 con 0x7f4a34155550 2024-01-22T05:09:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.210+0000 7f4a39400700 1 -- 172.21.15.49:0/3282336491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a34151ce0 con 0x7f4a34155550 2024-01-22T05:09:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.210+0000 7f4a2a000700 1 -- 172.21.15.49:0/3282336491 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4a2c01b3b0 con 0x7f4a34155550 2024-01-22T05:09:23.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.214+0000 7f4a2a000700 1 --2- 172.21.15.49:0/3282336491 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4a0c05a560 0x7f4a0c05ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.214+0000 7f4a2a000700 1 -- 172.21.15.49:0/3282336491 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f4a2c073ff0 con 0x7f4a34155550 2024-01-22T05:09:23.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.214+0000 7f4a32800700 1 --2- 172.21.15.49:0/3282336491 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4a0c05a560 0x7f4a0c05ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.214+0000 7f4a32800700 1 --2- 172.21.15.49:0/3282336491 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4a0c05a560 0x7f4a0c05ca20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f4a24009c30 tx=0x7f4a24009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:23.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.214+0000 7f4a437d7740 1 Processor -- start 2024-01-22T05:09:23.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.214+0000 7f4a437d7740 1 -- start start 2024-01-22T05:09:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a437d7740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a2e3a0 0x2a12d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a437d7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ede40 0x29e9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a437d7740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e780 0x29e73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a437d7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x296d410 con 0x29ede40 2024-01-22T05:09:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a437d7740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x296d550 con 0x2a2e780 2024-01-22T05:09:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a437d7740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x296da00 con 0x2a2e3a0 2024-01-22T05:09:23.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a31e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ede40 0x29e9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a31e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ede40 0x29e9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35988/0 (socket says 172.21.15.49:35988) 2024-01-22T05:09:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a31e00700 1 -- 172.21.15.49:0/3904567547 learned_addr learned my addr 172.21.15.49:0/3904567547 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a32800700 1 --2- 172.21.15.49:0/3904567547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a2e3a0 0x2a12d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a33200700 1 --2- 172.21.15.49:0/3904567547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e780 0x29e73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a31e00700 1 -- 172.21.15.49:0/3904567547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a2e3a0 msgr2=0x2a12d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a31e00700 1 --2- 172.21.15.49:0/3904567547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a2e3a0 0x2a12d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a31e00700 1 -- 172.21.15.49:0/3904567547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e780 msgr2=0x29e73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a31e00700 1 --2- 172.21.15.49:0/3904567547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e780 0x29e73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a31e00700 1 -- 172.21.15.49:0/3904567547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2966730 con 0x29ede40 2024-01-22T05:09:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a31e00700 1 --2- 172.21.15.49:0/3904567547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ede40 0x29e9af0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f4a1c009ea0 tx=0x7f4a1c017000).ready entity=mon.0 client_cookie=c674a1400c3db88e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a22600700 1 -- 172.21.15.49:0/3904567547 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c000bc0 con 0x29ede40 2024-01-22T05:09:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a22600700 1 -- 172.21.15.49:0/3904567547 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c00b850 con 0x29ede40 2024-01-22T05:09:23.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a22600700 1 -- 172.21.15.49:0/3904567547 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c000d20 con 0x29ede40 2024-01-22T05:09:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a437d7740 1 -- 172.21.15.49:0/3904567547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ede40 msgr2=0x29e9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.218+0000 7f4a437d7740 1 --2- 172.21.15.49:0/3904567547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ede40 0x29e9af0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f4a1c009ea0 tx=0x7f4a1c017000).stop 2024-01-22T05:09:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.222+0000 7f4a437d7740 1 -- 172.21.15.49:0/3904567547 shutdown_connections 2024-01-22T05:09:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.222+0000 7f4a437d7740 1 --2- 172.21.15.49:0/3904567547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e780 0x29e73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.222+0000 7f4a437d7740 1 --2- 172.21.15.49:0/3904567547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ede40 0x29e9af0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.222+0000 7f4a437d7740 1 --2- 172.21.15.49:0/3904567547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a2e3a0 0x2a12d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.222+0000 7f4a437d7740 1 -- 172.21.15.49:0/3904567547 >> 172.21.15.49:0/3904567547 conn(0x27cb550 msgr2=0x29ed730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.222+0000 7f4a437d7740 1 -- 172.21.15.49:0/3904567547 shutdown_connections 2024-01-22T05:09:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.222+0000 7f4a437d7740 1 -- 172.21.15.49:0/3904567547 wait complete. 2024-01-22T05:09:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.222+0000 7f4a437d7740 1 -- start start 2024-01-22T05:09:23.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.222+0000 7f4a437d7740 1 Processor -- start 2024-01-22T05:09:23.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a437d7740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ede40 0x2a34000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a437d7740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e3a0 0x2a18ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a437d7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a2e780 0x2a193d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a437d7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2938650 con 0x2a2e780 2024-01-22T05:09:23.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a437d7740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a143d0 con 0x2a2e3a0 2024-01-22T05:09:23.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a437d7740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a198c0 con 0x29ede40 2024-01-22T05:09:23.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a437d7740 10 client.0 ll_register_callbacks cb 0x29a5020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:09:23.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a33200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a2e780 0x2a193d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a33200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a2e780 0x2a193d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36004/0 (socket says 172.21.15.49:36004) 2024-01-22T05:09:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a33200700 1 -- 172.21.15.49:0/2397428375 learned_addr learned my addr 172.21.15.49:0/2397428375 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a31e00700 1 --2- 172.21.15.49:0/2397428375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e3a0 0x2a18ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a32800700 1 --2- 172.21.15.49:0/2397428375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ede40 0x2a34000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a33200700 1 -- 172.21.15.49:0/2397428375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ede40 msgr2=0x2a34000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a33200700 1 --2- 172.21.15.49:0/2397428375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ede40 0x2a34000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a33200700 1 -- 172.21.15.49:0/2397428375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e3a0 msgr2=0x2a18ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a33200700 1 --2- 172.21.15.49:0/2397428375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e3a0 0x2a18ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a33200700 1 -- 172.21.15.49:0/2397428375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a34068e10 con 0x2a2e780 2024-01-22T05:09:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a31e00700 1 --2- 172.21.15.49:0/2397428375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e3a0 0x2a18ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a33200700 1 --2- 172.21.15.49:0/2397428375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a2e780 0x2a193d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f4a2c04b2a0 tx=0x7f4a2c00f000).ready entity=mon.0 client_cookie=b6ea3474388d8ffe server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a1aa00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:09:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a1aa00700 1 -- 172.21.15.49:0/2397428375 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c04a860 con 0x2a2e780 2024-01-22T05:09:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a437d7740 1 -- 172.21.15.49:0/2397428375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x29631a0 con 0x2a2e780 2024-01-22T05:09:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a1aa00700 1 -- 172.21.15.49:0/2397428375 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f4a2c04a9c0 con 0x2a2e780 2024-01-22T05:09:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a1aa00700 1 -- 172.21.15.49:0/2397428375 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a2c047370 con 0x2a2e780 2024-01-22T05:09:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a437d7740 10 client.6642 fetch_fsmap learned FSMap version 62 2024-01-22T05:09:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.226+0000 7f4a437d7740 1 -- 172.21.15.49:0/2397428375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x2961960 con 0x2a2e780 2024-01-22T05:09:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.230+0000 7f4a1aa00700 1 -- 172.21.15.49:0/2397428375 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x29631a0 con 0x2a2e780 2024-01-22T05:09:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.230+0000 7f4a1aa00700 1 -- 172.21.15.49:0/2397428375 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4a2c04a2d0 con 0x2a2e780 2024-01-22T05:09:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.230+0000 7f4a437d7740 10 client.6642 fetch_fsmap finished waiting for FSMap version 62 2024-01-22T05:09:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.230+0000 7f4a437d7740 10 client.6642 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:09:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.230+0000 7f4a437d7740 20 client.6642 populate_metadata read hostname 'smithi049' 2024-01-22T05:09:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.230+0000 7f4a437d7740 1 --2- 172.21.15.49:0/2397428375 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x2a18390 0x2a42b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.230+0000 7f4a437d7740 4 client.6642 mds_command: new command op to 6609 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:09:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.230+0000 7f4a437d7740 1 -- 172.21.15.49:0/2397428375 --> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x29596f0 con 0x2a18390 2024-01-22T05:09:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.230+0000 7f4a32800700 1 --2- 172.21.15.49:0/2397428375 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x2a18390 0x2a42b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.230+0000 7f4a1aa00700 10 client.6642 ms_handle_connect on v2:172.21.15.49:6836/2814482810 2024-01-22T05:09:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.230+0000 7f4a32800700 1 --2- 172.21.15.49:0/2397428375 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x2a18390 0x2a42b40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d71ef86608136ca2 server_cookie=90d06fb6056cccb2 in_seq=0 out_seq=0 2024-01-22T05:09:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.230+0000 7f4a1aa00700 1 -- 172.21.15.49:0/2397428375 <== mds.0 v2:172.21.15.49:6836/2814482810 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x29596f0 con 0x2a18390 2024-01-22T05:09:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.230+0000 7f4a1aa00700 10 client.6642 handle_command_reply: tid=0 2024-01-22T05:09:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.230+0000 7f4a437d7740 1 client.6642 shutdown 2024-01-22T05:09:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.234+0000 7f4a437d7740 1 -- 172.21.15.49:0/2397428375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a2e780 msgr2=0x2a193d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.234+0000 7f4a437d7740 1 --2- 172.21.15.49:0/2397428375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a2e780 0x2a193d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f4a2c04b2a0 tx=0x7f4a2c00f000).stop 2024-01-22T05:09:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.234+0000 7f4a437d7740 1 -- 172.21.15.49:0/2397428375 shutdown_connections 2024-01-22T05:09:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.234+0000 7f4a437d7740 1 --2- 172.21.15.49:0/2397428375 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x2a18390 0x2a42b40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.234+0000 7f4a437d7740 1 --2- 172.21.15.49:0/2397428375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a2e780 0x2a193d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.234+0000 7f4a437d7740 1 --2- 172.21.15.49:0/2397428375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e3a0 0x2a18ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.234+0000 7f4a437d7740 1 --2- 172.21.15.49:0/2397428375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ede40 0x2a34000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.234+0000 7f4a437d7740 1 -- 172.21.15.49:0/2397428375 >> 172.21.15.49:0/2397428375 conn(0x27cb550 msgr2=0x29ec690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.234+0000 7f4a1aa00700 0 client.6642 ms_handle_reset on v2:172.21.15.49:6836/2814482810 2024-01-22T05:09:23.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.234+0000 7f4a437d7740 1 -- 172.21.15.49:0/2397428375 shutdown_connections 2024-01-22T05:09:23.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.234+0000 7f4a437d7740 1 -- 172.21.15.49:0/2397428375 wait complete. 2024-01-22T05:09:23.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.234+0000 7f4a437d7740 20 client.6642 trim_cache size 0 max 16384 2024-01-22T05:09:23.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.254+0000 7f4a437d7740 1 Processor -- start 2024-01-22T05:09:23.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.254+0000 7f4a437d7740 1 -- start start 2024-01-22T05:09:23.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a437d7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ede40 0x2a30730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a437d7740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a2e3a0 0x2a12a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a437d7740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e780 0x2a33ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a437d7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a17260 con 0x29ede40 2024-01-22T05:09:23.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a437d7740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x29b0e60 con 0x2a2e780 2024-01-22T05:09:23.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a437d7740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a2f160 con 0x2a2e3a0 2024-01-22T05:09:23.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a32800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ede40 0x2a30730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a32800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ede40 0x2a30730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51956/0 (socket says 172.21.15.49:51956) 2024-01-22T05:09:23.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a32800700 1 -- 172.21.15.49:0/853216967 learned_addr learned my addr 172.21.15.49:0/853216967 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:23.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a31e00700 1 --2- 172.21.15.49:0/853216967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a2e3a0 0x2a12a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a33200700 1 --2- 172.21.15.49:0/853216967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e780 0x2a33ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a32800700 1 -- 172.21.15.49:0/853216967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a2e3a0 msgr2=0x2a12a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:23.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a32800700 1 --2- 172.21.15.49:0/853216967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a2e3a0 0x2a12a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a32800700 1 -- 172.21.15.49:0/853216967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e780 msgr2=0x2a33ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:23.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a32800700 1 --2- 172.21.15.49:0/853216967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e780 0x2a33ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a32800700 1 -- 172.21.15.49:0/853216967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3414c0d0 con 0x29ede40 2024-01-22T05:09:23.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.258+0000 7f4a32800700 1 --2- 172.21.15.49:0/853216967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ede40 0x2a30730 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f4a24011650 tx=0x7f4a24027280).ready entity=mon.0 client_cookie=4336fa440ff66f33 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:23.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.262+0000 7f4a23000700 1 -- 172.21.15.49:0/853216967 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24021b40 con 0x29ede40 2024-01-22T05:09:23.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.262+0000 7f4a23000700 1 -- 172.21.15.49:0/853216967 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a24027040 con 0x29ede40 2024-01-22T05:09:23.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.262+0000 7f4a23000700 1 -- 172.21.15.49:0/853216967 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24021ca0 con 0x29ede40 2024-01-22T05:09:23.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.262+0000 7f4a437d7740 1 -- 172.21.15.49:0/853216967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ede40 msgr2=0x2a30730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.262+0000 7f4a437d7740 1 --2- 172.21.15.49:0/853216967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ede40 0x2a30730 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f4a24011650 tx=0x7f4a24027280).stop 2024-01-22T05:09:23.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.262+0000 7f4a437d7740 1 -- 172.21.15.49:0/853216967 shutdown_connections 2024-01-22T05:09:23.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.262+0000 7f4a437d7740 1 --2- 172.21.15.49:0/853216967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a2e780 0x2a33ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.262+0000 7f4a437d7740 1 --2- 172.21.15.49:0/853216967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a2e3a0 0x2a12a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.262+0000 7f4a437d7740 1 --2- 172.21.15.49:0/853216967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ede40 0x2a30730 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.262+0000 7f4a437d7740 1 -- 172.21.15.49:0/853216967 >> 172.21.15.49:0/853216967 conn(0x27cb550 msgr2=0x2a33290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:23.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.262+0000 7f4a437d7740 1 -- 172.21.15.49:0/853216967 shutdown_connections 2024-01-22T05:09:23.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.262+0000 7f4a437d7740 1 -- 172.21.15.49:0/853216967 wait complete. 2024-01-22T05:09:23.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.262+0000 7f4a437d7740 1 -- start start 2024-01-22T05:09:23.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.266+0000 7f4a437d7740 1 Processor -- start 2024-01-22T05:09:23.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.266+0000 7f4a437d7740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ede40 0x2a119a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.266+0000 7f4a437d7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a2e3a0 0x2a33ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.266+0000 7f4a437d7740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a2e780 0x2a33fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.266+0000 7f4a437d7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a34490 con 0x2a2e3a0 2024-01-22T05:09:23.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.266+0000 7f4a437d7740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a9e5a0 con 0x29ede40 2024-01-22T05:09:23.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.266+0000 7f4a437d7740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a3feb0 con 0x2a2e780 2024-01-22T05:09:23.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.266+0000 7f4a437d7740 10 client.0 ll_register_callbacks cb 0x7f4a2c04b190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:09:23.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.266+0000 7f4a31e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a2e3a0 0x2a33ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a31e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a2e3a0 0x2a33ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51970/0 (socket says 172.21.15.49:51970) 2024-01-22T05:09:23.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a33200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a2e780 0x2a33fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a31e00700 1 -- 172.21.15.49:0/4263803161 learned_addr learned my addr 172.21.15.49:0/4263803161 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:23.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a32800700 1 --2- 172.21.15.49:0/4263803161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ede40 0x2a119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a31e00700 1 -- 172.21.15.49:0/4263803161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a2e780 msgr2=0x2a33fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:23.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a31e00700 1 --2- 172.21.15.49:0/4263803161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a2e780 0x2a33fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a31e00700 1 -- 172.21.15.49:0/4263803161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ede40 msgr2=0x2a119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:23.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a31e00700 1 --2- 172.21.15.49:0/4263803161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ede40 0x2a119a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a31e00700 1 -- 172.21.15.49:0/4263803161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a24011dd0 con 0x2a2e3a0 2024-01-22T05:09:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a31e00700 1 --2- 172.21.15.49:0/4263803161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a2e3a0 0x2a33ab0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f4a1c00b6b0 tx=0x7f4a1c01f040).ready entity=mon.0 client_cookie=b20a675149e355e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a1aa00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:09:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a1aa00700 1 -- 172.21.15.49:0/4263803161 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c00b9c0 con 0x2a2e3a0 2024-01-22T05:09:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a437d7740 1 -- 172.21.15.49:0/4263803161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a1c00b850 con 0x2a2e3a0 2024-01-22T05:09:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a1aa00700 1 -- 172.21.15.49:0/4263803161 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f4a1c011c00 con 0x2a2e3a0 2024-01-22T05:09:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a1aa00700 1 -- 172.21.15.49:0/4263803161 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a1c011e10 con 0x2a2e3a0 2024-01-22T05:09:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a437d7740 10 client.6648 fetch_fsmap learned FSMap version 62 2024-01-22T05:09:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a437d7740 1 -- 172.21.15.49:0/4263803161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x29616b0 con 0x2a2e3a0 2024-01-22T05:09:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a1aa00700 1 -- 172.21.15.49:0/4263803161 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c00b850 con 0x2a2e3a0 2024-01-22T05:09:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a1aa00700 1 -- 172.21.15.49:0/4263803161 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4a1c018030 con 0x2a2e3a0 2024-01-22T05:09:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a437d7740 10 client.6648 fetch_fsmap finished waiting for FSMap version 62 2024-01-22T05:09:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a437d7740 10 client.6648 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:09:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a437d7740 20 client.6648 populate_metadata read hostname 'smithi049' 2024-01-22T05:09:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a437d7740 1 --2- 172.21.15.49:0/4263803161 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x29ec840 0x29ecc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a437d7740 4 client.6648 mds_command: new command op to 6609 tid=0[{"prefix": "status"}] 2024-01-22T05:09:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a437d7740 1 -- 172.21.15.49:0/4263803161 --> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] -- command(tid 0: {"prefix": "status"}) v1 -- 0x28224e0 con 0x29ec840 2024-01-22T05:09:23.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.270+0000 7f4a32800700 1 --2- 172.21.15.49:0/4263803161 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x29ec840 0x29ecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a32800700 1 --2- 172.21.15.49:0/4263803161 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x29ec840 0x29ecc20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=686ec2e2ddbff056 server_cookie=a6c5f79182ebbcd1 in_seq=0 out_seq=0 2024-01-22T05:09:23.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a1aa00700 10 client.6648 ms_handle_connect on v2:172.21.15.49:6836/2814482810 2024-01-22T05:09:23.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a1aa00700 1 -- 172.21.15.49:0/4263803161 <== mds.0 v2:172.21.15.49:6836/2814482810 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x28224e0 con 0x29ec840 2024-01-22T05:09:23.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a1aa00700 10 client.6648 handle_command_reply: tid=0 2024-01-22T05:09:23.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a437d7740 1 client.6648 shutdown 2024-01-22T05:09:23.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a437d7740 1 -- 172.21.15.49:0/4263803161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a2e3a0 msgr2=0x2a33ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a437d7740 1 --2- 172.21.15.49:0/4263803161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a2e3a0 0x2a33ab0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f4a1c00b6b0 tx=0x7f4a1c01f040).stop 2024-01-22T05:09:23.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a437d7740 1 -- 172.21.15.49:0/4263803161 shutdown_connections 2024-01-22T05:09:23.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a437d7740 1 --2- 172.21.15.49:0/4263803161 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x29ec840 0x29ecc20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a437d7740 1 --2- 172.21.15.49:0/4263803161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a2e780 0x2a33fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a437d7740 1 --2- 172.21.15.49:0/4263803161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a2e3a0 0x2a33ab0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a437d7740 1 --2- 172.21.15.49:0/4263803161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ede40 0x2a119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a1aa00700 0 client.6648 ms_handle_reset on v2:172.21.15.49:6836/2814482810 2024-01-22T05:09:23.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a437d7740 1 -- 172.21.15.49:0/4263803161 >> 172.21.15.49:0/4263803161 conn(0x27cb550 msgr2=0x2a30490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:23.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a437d7740 1 -- 172.21.15.49:0/4263803161 shutdown_connections 2024-01-22T05:09:23.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a437d7740 1 -- 172.21.15.49:0/4263803161 wait complete. 2024-01-22T05:09:23.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.274+0000 7f4a437d7740 20 client.6648 trim_cache size 0 max 16384 2024-01-22T05:09:23.280 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:09:23.280 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:09:23.280 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:09:23.280 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6609, 2024-01-22T05:09:23.280 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:09:23.280 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:09:23.281 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:09:23.281 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 3.794844205, 2024-01-22T05:09:23.281 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 62, 2024-01-22T05:09:23.281 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 74, 2024-01-22T05:09:23.281 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 74, 2024-01-22T05:09:23.281 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 4.603713827 2024-01-22T05:09:23.281 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:09:23.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.278+0000 7f4a39400700 1 -- 172.21.15.49:0/3282336491 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4a0c05a560 msgr2=0x7f4a0c05ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.278+0000 7f4a39400700 1 --2- 172.21.15.49:0/3282336491 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4a0c05a560 0x7f4a0c05ca20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f4a24009c30 tx=0x7f4a24009060).stop 2024-01-22T05:09:23.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.278+0000 7f4a39400700 1 -- 172.21.15.49:0/3282336491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a34155550 msgr2=0x7f4a34063d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.278+0000 7f4a39400700 1 --2- 172.21.15.49:0/3282336491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a34155550 0x7f4a34063d50 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f4a2c002230 tx=0x7f4a2c0015e0).stop 2024-01-22T05:09:23.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.278+0000 7f4a39400700 1 -- 172.21.15.49:0/3282336491 shutdown_connections 2024-01-22T05:09:23.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.278+0000 7f4a39400700 1 --2- 172.21.15.49:0/3282336491 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4a0c05a560 0x7f4a0c05ca20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.278+0000 7f4a39400700 1 --2- 172.21.15.49:0/3282336491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a34155550 0x7f4a34063d50 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.278+0000 7f4a39400700 1 --2- 172.21.15.49:0/3282336491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a340c3690 0x7f4a34062ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.278+0000 7f4a39400700 1 --2- 172.21.15.49:0/3282336491 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a34067a90 0x7f4a34154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.278+0000 7f4a39400700 1 -- 172.21.15.49:0/3282336491 >> 172.21.15.49:0/3282336491 conn(0x7f4a340c51c0 msgr2=0x7f4a3414cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:23.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.278+0000 7f4a39400700 1 -- 172.21.15.49:0/3282336491 shutdown_connections 2024-01-22T05:09:23.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.278+0000 7f4a39400700 1 -- 172.21.15.49:0/3282336491 wait complete. 2024-01-22T05:09:23.305 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:09:23.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.458+0000 7fdd4ec00700 1 Processor -- start 2024-01-22T05:09:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.458+0000 7fdd4ec00700 1 -- start start 2024-01-22T05:09:23.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd4ec00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdd48064ab0 0x7fdd48064f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd4ec00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdd480c10e0 0x7fdd480c1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd4ec00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd48062e70 con 0x7fdd48158090 2024-01-22T05:09:23.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd4ec00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd48158470 con 0x7fdd480c10e0 2024-01-22T05:09:23.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd4ec00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd48065430 con 0x7fdd48064ab0 2024-01-22T05:09:23.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd47e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdd48158090 0x7fdd48063300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56746/0 (socket says 172.21.15.49:56746) 2024-01-22T05:09:23.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd47e00700 1 -- 172.21.15.49:0/2605089516 learned_addr learned my addr 172.21.15.49:0/2605089516 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:23.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd4cc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdd480c10e0 0x7fdd480c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd47400700 1 --2- 172.21.15.49:0/2605089516 >> v2:172.21.15.110:3300/0 conn(0x7fdd48064ab0 0x7fdd48064f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd46a00700 1 -- 172.21.15.49:0/2605089516 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782350823 0 0) 0x7fdd48062e70 con 0x7fdd48158090 2024-01-22T05:09:23.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd47400700 1 -- 172.21.15.49:0/2605089516 >> v2:172.21.15.49:3300/0 conn(0x7fdd480c10e0 msgr2=0x7fdd480c1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:23.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd47400700 1 --2- 172.21.15.49:0/2605089516 >> v2:172.21.15.49:3300/0 conn(0x7fdd480c10e0 0x7fdd480c1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd47400700 1 -- 172.21.15.49:0/2605089516 >> v1:172.21.15.49:6789/0 conn(0x7fdd48158090 legacy=0x7fdd48063300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd47400700 1 -- 172.21.15.49:0/2605089516 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd480622d0 con 0x7fdd48064ab0 2024-01-22T05:09:23.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd47400700 1 --2- 172.21.15.49:0/2605089516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd48064ab0 0x7fdd48064f40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fdd48068060 tx=0x7fdd30009060).ready entity=mon.1 client_cookie=13a0e34100cc4993 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:23.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd46a00700 1 -- 172.21.15.49:0/2605089516 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3000f510 con 0x7fdd48064ab0 2024-01-22T05:09:23.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd46a00700 1 -- 172.21.15.49:0/2605089516 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3000f670 con 0x7fdd48064ab0 2024-01-22T05:09:23.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.462+0000 7fdd46a00700 1 -- 172.21.15.49:0/2605089516 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3000f9f0 con 0x7fdd48064ab0 2024-01-22T05:09:23.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.466+0000 7fdd4ec00700 1 -- 172.21.15.49:0/2605089516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd48064ab0 msgr2=0x7fdd48064f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.466+0000 7fdd4ec00700 1 --2- 172.21.15.49:0/2605089516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd48064ab0 0x7fdd48064f40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fdd48068060 tx=0x7fdd30009060).stop 2024-01-22T05:09:23.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.466+0000 7fdd4ec00700 1 -- 172.21.15.49:0/2605089516 shutdown_connections 2024-01-22T05:09:23.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.466+0000 7fdd4ec00700 1 --2- 172.21.15.49:0/2605089516 >> v2:172.21.15.49:3300/0 conn(0x7fdd480c10e0 0x7fdd480c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.466+0000 7fdd4ec00700 1 --2- 172.21.15.49:0/2605089516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd48064ab0 0x7fdd48064f40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.466+0000 7fdd4ec00700 1 -- 172.21.15.49:0/2605089516 >> 172.21.15.49:0/2605089516 conn(0x7fdd480c30c0 msgr2=0x7fdd480c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.466+0000 7fdd4ec00700 1 -- 172.21.15.49:0/2605089516 shutdown_connections 2024-01-22T05:09:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.466+0000 7fdd4ec00700 1 -- 172.21.15.49:0/2605089516 wait complete. 2024-01-22T05:09:23.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.466+0000 7fdd4ec00700 1 Processor -- start 2024-01-22T05:09:23.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd4ec00700 1 -- start start 2024-01-22T05:09:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd4ec00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd48064ab0 0x7fdd4814b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd4ec00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd480c10e0 0x7fdd480bfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd4ec00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd48158090 0x7fdd481523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd4ec00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd48158c30 con 0x7fdd480c10e0 2024-01-22T05:09:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd4ec00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480bebe0 con 0x7fdd48158090 2024-01-22T05:09:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd4ec00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480beec0 con 0x7fdd48064ab0 2024-01-22T05:09:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd480c10e0 0x7fdd480bfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd480c10e0 0x7fdd480bfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51976/0 (socket says 172.21.15.49:51976) 2024-01-22T05:09:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd47400700 1 -- 172.21.15.49:0/1085786323 learned_addr learned my addr 172.21.15.49:0/1085786323 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd4cc00700 1 --2- 172.21.15.49:0/1085786323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd48158090 0x7fdd481523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd47e00700 1 --2- 172.21.15.49:0/1085786323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd48064ab0 0x7fdd4814b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd47400700 1 -- 172.21.15.49:0/1085786323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd48064ab0 msgr2=0x7fdd4814b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd47400700 1 --2- 172.21.15.49:0/1085786323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd48064ab0 0x7fdd4814b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd47400700 1 -- 172.21.15.49:0/1085786323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd48158090 msgr2=0x7fdd481523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd47400700 1 --2- 172.21.15.49:0/1085786323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd48158090 0x7fdd481523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd47400700 1 -- 172.21.15.49:0/1085786323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd300092a0 con 0x7fdd480c10e0 2024-01-22T05:09:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.470+0000 7fdd47400700 1 --2- 172.21.15.49:0/1085786323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd480c10e0 0x7fdd480bfd20 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fdd30009dd0 tx=0x7fdd30017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.474+0000 7fdd3f400700 1 -- 172.21.15.49:0/1085786323 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3000f7e0 con 0x7fdd480c10e0 2024-01-22T05:09:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.474+0000 7fdd3f400700 1 -- 172.21.15.49:0/1085786323 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3000f940 con 0x7fdd480c10e0 2024-01-22T05:09:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.474+0000 7fdd4ec00700 1 -- 172.21.15.49:0/1085786323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd480bf1a0 con 0x7fdd480c10e0 2024-01-22T05:09:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.474+0000 7fdd3f400700 1 -- 172.21.15.49:0/1085786323 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3001b660 con 0x7fdd480c10e0 2024-01-22T05:09:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.474+0000 7fdd4ec00700 1 -- 172.21.15.49:0/1085786323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd480bf7f0 con 0x7fdd480c10e0 2024-01-22T05:09:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.474+0000 7fdd4ec00700 1 -- 172.21.15.49:0/1085786323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd480a95b0 con 0x7fdd480c10e0 2024-01-22T05:09:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.474+0000 7fdd3f400700 1 -- 172.21.15.49:0/1085786323 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdd3001ba10 con 0x7fdd480c10e0 2024-01-22T05:09:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.478+0000 7fdd3f400700 1 --2- 172.21.15.49:0/1085786323 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd2005a4e0 0x7fdd2005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:23.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.478+0000 7fdd3f400700 1 -- 172.21.15.49:0/1085786323 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fdd30076170 con 0x7fdd480c10e0 2024-01-22T05:09:23.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.478+0000 7fdd47e00700 1 --2- 172.21.15.49:0/1085786323 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd2005a4e0 0x7fdd2005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:23.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.478+0000 7fdd47e00700 1 --2- 172.21.15.49:0/1085786323 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd2005a4e0 0x7fdd2005c9a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fdd38007fd0 tx=0x7fdd38007dd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:23.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.482+0000 7fdd3f400700 1 -- 172.21.15.49:0/1085786323 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdd480a95b0 con 0x7fdd480c10e0 2024-01-22T05:09:23.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.694+0000 7fdd4ec00700 1 -- 172.21.15.49:0/1085786323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdd480a95b0 con 0x7fdd480c10e0 2024-01-22T05:09:23.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.694+0000 7fdd3f400700 1 -- 172.21.15.49:0/1085786323 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdd480a95b0 con 0x7fdd480c10e0 2024-01-22T05:09:23.700 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:09:23.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.698+0000 7fdd4ec00700 1 -- 172.21.15.49:0/1085786323 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd2005a4e0 msgr2=0x7fdd2005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.698+0000 7fdd4ec00700 1 --2- 172.21.15.49:0/1085786323 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd2005a4e0 0x7fdd2005c9a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fdd38007fd0 tx=0x7fdd38007dd0).stop 2024-01-22T05:09:23.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.698+0000 7fdd4ec00700 1 -- 172.21.15.49:0/1085786323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd480c10e0 msgr2=0x7fdd480bfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:23.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.698+0000 7fdd4ec00700 1 --2- 172.21.15.49:0/1085786323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd480c10e0 0x7fdd480bfd20 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fdd30009dd0 tx=0x7fdd30017000).stop 2024-01-22T05:09:23.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.698+0000 7fdd4ec00700 1 -- 172.21.15.49:0/1085786323 shutdown_connections 2024-01-22T05:09:23.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.698+0000 7fdd4ec00700 1 --2- 172.21.15.49:0/1085786323 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd2005a4e0 0x7fdd2005c9a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.698+0000 7fdd4ec00700 1 --2- 172.21.15.49:0/1085786323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd48158090 0x7fdd481523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.698+0000 7fdd4ec00700 1 --2- 172.21.15.49:0/1085786323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd480c10e0 0x7fdd480bfd20 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.698+0000 7fdd4ec00700 1 --2- 172.21.15.49:0/1085786323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd48064ab0 0x7fdd4814b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:23.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.698+0000 7fdd4ec00700 1 -- 172.21.15.49:0/1085786323 >> 172.21.15.49:0/1085786323 conn(0x7fdd480c30c0 msgr2=0x7fdd480c5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.698+0000 7fdd4ec00700 1 -- 172.21.15.49:0/1085786323 shutdown_connections 2024-01-22T05:09:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:23.698+0000 7fdd4ec00700 1 -- 172.21.15.49:0/1085786323 wait complete. 2024-01-22T05:09:23.721 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-22T05:09:23.722 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:09:23.722 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:09:23.722 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:09:23.722 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:09:23.722 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-22T05:09:23.722 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-22T05:09:23.722 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:09:23.722 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:09:23.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:23.722 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:09:23.740 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:09:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:09:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:09:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:09:23.740 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:23.740 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42207sec preferred_lft 42207sec 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:09:23.741 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:09:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:09:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:09:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:23.742 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:09:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:09:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:09:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::7ce7:e3ff:fed1:1e88/64 scope link 2024-01-22T05:09:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:23.742 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:09:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 82:c1:48:e7:c7:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:09:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::80c1:48ff:fee7:c731/64 scope link 2024-01-22T05:09:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:23.742 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:09:23.742 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:09:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3426:32ff:feee:c4c9/64 scope link 2024-01-22T05:09:23.743 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:09:23.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:23.744 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:09:23.825 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:09:23.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:23.825 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:09:23.887 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:09:23.887 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:09:23.887 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:09:23.887 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:09:23.887 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:09:23.887 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:09:23.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:23.888 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:09:23.888 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:09:23.888 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:09:23.888 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:09:23.888 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:09:23.889 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:09:24.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:24.021 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:09:24.038 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:09:24.038 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:09:24.039 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:09:24.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:24.040 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-22T05:09:24.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:24.120 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-22T05:09:24.180 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:09:24.180 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:09:24.301 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:09:24.302 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:09:24.323 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:09:24.323 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:09:24.328 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:09:24.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:24.328 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:09:24.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:09:24.356 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-01-22T05:09:24.419 INFO:teuthology.orchestra.run.smithi049.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2024-01-22T05:09:24.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:09:24.421 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2024-01-22T05:09:24.421 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start /scrub_repair_path repair 2024-01-22T05:09:24.485 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-22T05:09:24.482+0000 7f0f5b800700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:09:24.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.650+0000 7fbfff800700 1 Processor -- start 2024-01-22T05:09:24.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.650+0000 7fbfff800700 1 -- start start 2024-01-22T05:09:24.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.654+0000 7fbfff800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbff80c2520 0x7fbff8139560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.654+0000 7fbfff800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff8067a90 con 0x7fbff8154ab0 2024-01-22T05:09:24.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.654+0000 7fbfff800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff80c2b30 con 0x7fbff8139a50 2024-01-22T05:09:24.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.654+0000 7fbfff800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff80c36b0 con 0x7fbff80c2520 2024-01-22T05:09:24.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.654+0000 7fbffce00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbff8154ab0 0x7fbff80bcb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56758/0 (socket says 172.21.15.49:56758) 2024-01-22T05:09:24.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.654+0000 7fbffce00700 1 -- 172.21.15.49:0/3444353020 learned_addr learned my addr 172.21.15.49:0/3444353020 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:24.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.654+0000 7fbff7e00700 1 --2- 172.21.15.49:0/3444353020 >> v2:172.21.15.110:3300/0 conn(0x7fbff80c2520 0x7fbff8139560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.658+0000 7fbff7400700 1 -- 172.21.15.49:0/3444353020 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895111936 0 0) 0x7fbff8067a90 con 0x7fbff8154ab0 2024-01-22T05:09:24.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.658+0000 7fbff7400700 1 -- 172.21.15.49:0/3444353020 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfd8004500 con 0x7fbff8154ab0 2024-01-22T05:09:24.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.658+0000 7fbff7400700 1 -- 172.21.15.49:0/3444353020 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771281086 0 0) 0x7fbff80c2b30 con 0x7fbff8139a50 2024-01-22T05:09:24.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.658+0000 7fbff7400700 1 -- 172.21.15.49:0/3444353020 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff8067a90 con 0x7fbff8139a50 2024-01-22T05:09:24.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.658+0000 7fbff7e00700 1 -- 172.21.15.49:0/3444353020 >> v1:172.21.15.110:6789/0 conn(0x7fbff8139a50 legacy=0x7fbff8062b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:24.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.658+0000 7fbff7e00700 1 -- 172.21.15.49:0/3444353020 >> v1:172.21.15.49:6789/0 conn(0x7fbff8154ab0 legacy=0x7fbff80bcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:24.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.658+0000 7fbff7e00700 1 -- 172.21.15.49:0/3444353020 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff80c2e10 con 0x7fbff80c2520 2024-01-22T05:09:24.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.658+0000 7fbff7e00700 1 --2- 172.21.15.49:0/3444353020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbff80c2520 0x7fbff8139560 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fbfe0009760 tx=0x7fbfe0009060).ready entity=mon.1 client_cookie=69baf489bb2ec0f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:24.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.658+0000 7fbff7400700 1 -- 172.21.15.49:0/3444353020 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe000d4a0 con 0x7fbff80c2520 2024-01-22T05:09:24.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.658+0000 7fbff7400700 1 -- 172.21.15.49:0/3444353020 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe000d600 con 0x7fbff80c2520 2024-01-22T05:09:24.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.658+0000 7fbff7400700 1 -- 172.21.15.49:0/3444353020 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe000d980 con 0x7fbff80c2520 2024-01-22T05:09:24.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.658+0000 7fbfff800700 1 -- 172.21.15.49:0/3444353020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbff80c2520 msgr2=0x7fbff8139560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:24.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.658+0000 7fbfff800700 1 --2- 172.21.15.49:0/3444353020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbff80c2520 0x7fbff8139560 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fbfe0009760 tx=0x7fbfe0009060).stop 2024-01-22T05:09:24.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.662+0000 7fbfff800700 1 -- 172.21.15.49:0/3444353020 shutdown_connections 2024-01-22T05:09:24.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.662+0000 7fbfff800700 1 --2- 172.21.15.49:0/3444353020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbff80c2520 0x7fbff8139560 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.662+0000 7fbfff800700 1 -- 172.21.15.49:0/3444353020 >> 172.21.15.49:0/3444353020 conn(0x7fbff80c7830 msgr2=0x7fbff80c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:24.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.662+0000 7fbfff800700 1 -- 172.21.15.49:0/3444353020 shutdown_connections 2024-01-22T05:09:24.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.662+0000 7fbfff800700 1 -- 172.21.15.49:0/3444353020 wait complete. 2024-01-22T05:09:24.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.666+0000 7fbfff800700 1 Processor -- start 2024-01-22T05:09:24.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.666+0000 7fbfff800700 1 -- start start 2024-01-22T05:09:24.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.666+0000 7fbfff800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbff80c2520 0x7fbff814fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.666+0000 7fbfff800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff8139a50 0x7fbff80629e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.666+0000 7fbfff800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff8154ab0 0x7fbff8062ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.666+0000 7fbfff800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff80633c0 con 0x7fbff8139a50 2024-01-22T05:09:24.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.666+0000 7fbfff800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff80abd80 con 0x7fbff80c2520 2024-01-22T05:09:24.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.666+0000 7fbfff800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff8150240 con 0x7fbff8154ab0 2024-01-22T05:09:24.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.666+0000 7fbff7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff8139a50 0x7fbff80629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.666+0000 7fbff7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff8139a50 0x7fbff80629e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51992/0 (socket says 172.21.15.49:51992) 2024-01-22T05:09:24.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.666+0000 7fbff7e00700 1 -- 172.21.15.49:0/2742814293 learned_addr learned my addr 172.21.15.49:0/2742814293 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:24.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.666+0000 7fbffce00700 1 --2- 172.21.15.49:0/2742814293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbff80c2520 0x7fbff814fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.666+0000 7fbffd800700 1 --2- 172.21.15.49:0/2742814293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff8154ab0 0x7fbff8062ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.670+0000 7fbff7e00700 1 -- 172.21.15.49:0/2742814293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff8154ab0 msgr2=0x7fbff8062ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:24.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.670+0000 7fbff7e00700 1 --2- 172.21.15.49:0/2742814293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff8154ab0 0x7fbff8062ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.670+0000 7fbff7e00700 1 -- 172.21.15.49:0/2742814293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbff80c2520 msgr2=0x7fbff814fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:24.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.670+0000 7fbff7e00700 1 --2- 172.21.15.49:0/2742814293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbff80c2520 0x7fbff814fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.670+0000 7fbff7e00700 1 -- 172.21.15.49:0/2742814293 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe00092a0 con 0x7fbff8139a50 2024-01-22T05:09:24.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.670+0000 7fbff7e00700 1 --2- 172.21.15.49:0/2742814293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff8139a50 0x7fbff80629e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fbff80656e0 tx=0x7fbfe0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:24.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.670+0000 7fbfefe00700 1 -- 172.21.15.49:0/2742814293 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0021070 con 0x7fbff8139a50 2024-01-22T05:09:24.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.670+0000 7fbfefe00700 1 -- 172.21.15.49:0/2742814293 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe000dcf0 con 0x7fbff8139a50 2024-01-22T05:09:24.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.670+0000 7fbfff800700 1 -- 172.21.15.49:0/2742814293 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff80ab170 con 0x7fbff8139a50 2024-01-22T05:09:24.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.670+0000 7fbfefe00700 1 -- 172.21.15.49:0/2742814293 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe000d980 con 0x7fbff8139a50 2024-01-22T05:09:24.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.670+0000 7fbfff800700 1 -- 172.21.15.49:0/2742814293 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff80ab730 con 0x7fbff8139a50 2024-01-22T05:09:24.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.674+0000 7fbfefe00700 1 -- 172.21.15.49:0/2742814293 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbfe001d640 con 0x7fbff8139a50 2024-01-22T05:09:24.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.674+0000 7fbfefe00700 1 --2- 172.21.15.49:0/2742814293 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbfd005a540 0x7fbfd005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.674+0000 7fbfefe00700 1 -- 172.21.15.49:0/2742814293 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fbfe0075e30 con 0x7fbff8139a50 2024-01-22T05:09:24.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.674+0000 7fbffce00700 1 --2- 172.21.15.49:0/2742814293 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbfd005a540 0x7fbfd005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.674+0000 7fbffce00700 1 --2- 172.21.15.49:0/2742814293 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbfd005a540 0x7fbfd005ca00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fbfe80010e0 tx=0x7fbfe8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:24.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.678+0000 7fc009c31740 1 Processor -- start 2024-01-22T05:09:24.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.678+0000 7fc009c31740 1 -- start start 2024-01-22T05:09:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.678+0000 7fc009c31740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c19150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.678+0000 7fc009c31740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c14440 0x1c5e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.678+0000 7fc009c31740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c12e90 0x1c13310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.678+0000 7fc009c31740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b76610 con 0x1c18d70 2024-01-22T05:09:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.678+0000 7fc009c31740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b39fc0 con 0x1c12e90 2024-01-22T05:09:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.678+0000 7fc009c31740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b652c0 con 0x1c14440 2024-01-22T05:09:24.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.678+0000 7fbffce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c19150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fbffd800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c12e90 0x1c13310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fbffce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c19150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52004/0 (socket says 172.21.15.49:52004) 2024-01-22T05:09:24.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fbffce00700 1 -- 172.21.15.49:0/3190785764 learned_addr learned my addr 172.21.15.49:0/3190785764 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:24.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fbff7e00700 1 --2- 172.21.15.49:0/3190785764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c14440 0x1c5e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fbffce00700 1 -- 172.21.15.49:0/3190785764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c14440 msgr2=0x1c5e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fbffce00700 1 --2- 172.21.15.49:0/3190785764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c14440 0x1c5e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fbffce00700 1 -- 172.21.15.49:0/3190785764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c12e90 msgr2=0x1c13310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fbffce00700 1 --2- 172.21.15.49:0/3190785764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c12e90 0x1c13310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fbffce00700 1 -- 172.21.15.49:0/3190785764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1ba4710 con 0x1c18d70 2024-01-22T05:09:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fbffd800700 1 --2- 172.21.15.49:0/3190785764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c12e90 0x1c13310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fbffce00700 1 --2- 172.21.15.49:0/3190785764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c19150 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7fbfe800f860 tx=0x7fbfe8013000).ready entity=mon.0 client_cookie=dad2038fb88b2892 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fbfecc00700 1 -- 172.21.15.49:0/3190785764 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8020400 con 0x1c18d70 2024-01-22T05:09:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fbfecc00700 1 -- 172.21.15.49:0/3190785764 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe8020560 con 0x1c18d70 2024-01-22T05:09:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fbfecc00700 1 -- 172.21.15.49:0/3190785764 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe80206f0 con 0x1c18d70 2024-01-22T05:09:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fc009c31740 1 -- 172.21.15.49:0/3190785764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 msgr2=0x1c19150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fc009c31740 1 --2- 172.21.15.49:0/3190785764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c19150 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7fbfe800f860 tx=0x7fbfe8013000).stop 2024-01-22T05:09:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fc009c31740 1 -- 172.21.15.49:0/3190785764 shutdown_connections 2024-01-22T05:09:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fc009c31740 1 --2- 172.21.15.49:0/3190785764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c12e90 0x1c13310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fc009c31740 1 --2- 172.21.15.49:0/3190785764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c14440 0x1c5e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fc009c31740 1 --2- 172.21.15.49:0/3190785764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c19150 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fc009c31740 1 -- 172.21.15.49:0/3190785764 >> 172.21.15.49:0/3190785764 conn(0x19f8870 msgr2=0x1c177c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fc009c31740 1 -- 172.21.15.49:0/3190785764 shutdown_connections 2024-01-22T05:09:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.682+0000 7fc009c31740 1 -- 172.21.15.49:0/3190785764 wait complete. 2024-01-22T05:09:24.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.686+0000 7fc009c31740 1 -- start start 2024-01-22T05:09:24.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.686+0000 7fc009c31740 1 Processor -- start 2024-01-22T05:09:24.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fc009c31740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c12e90 0x1c2c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fc009c31740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c14440 0x1c13310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fc009c31740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c13800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fc009c31740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c13cf0 con 0x1c18d70 2024-01-22T05:09:24.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fc009c31740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c625c0 con 0x1c14440 2024-01-22T05:09:24.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fc009c31740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c40b80 con 0x1c12e90 2024-01-22T05:09:24.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fc009c31740 10 client.0 ll_register_callbacks cb 0x1bd0820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:09:24.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fbffd800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c13800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fbff7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c14440 0x1c13310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fbffd800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c13800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52012/0 (socket says 172.21.15.49:52012) 2024-01-22T05:09:24.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fbffd800700 1 -- 172.21.15.49:0/4237646670 learned_addr learned my addr 172.21.15.49:0/4237646670 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:24.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fbffce00700 1 --2- 172.21.15.49:0/4237646670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c12e90 0x1c2c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fbffd800700 1 -- 172.21.15.49:0/4237646670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c12e90 msgr2=0x1c2c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fbffd800700 1 --2- 172.21.15.49:0/4237646670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c12e90 0x1c2c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fbffd800700 1 -- 172.21.15.49:0/4237646670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c14440 msgr2=0x1c13310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fbffd800700 1 --2- 172.21.15.49:0/4237646670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c14440 0x1c13310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fbffd800700 1 -- 172.21.15.49:0/4237646670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff000f040 con 0x1c18d70 2024-01-22T05:09:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fbffd800700 1 --2- 172.21.15.49:0/4237646670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c13800 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fbff00115e0 tx=0x7fbff0009040).ready entity=mon.0 client_cookie=68be096e05c3b77b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fbfe5600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:09:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fbfe5600700 1 -- 172.21.15.49:0/4237646670 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0003900 con 0x1c18d70 2024-01-22T05:09:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fbfe5600700 1 -- 172.21.15.49:0/4237646670 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fbff00030d0 con 0x1c18d70 2024-01-22T05:09:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.690+0000 7fc009c31740 1 -- 172.21.15.49:0/4237646670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1b90360 con 0x1c18d70 2024-01-22T05:09:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fbfe5600700 1 -- 172.21.15.49:0/4237646670 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbff00034a0 con 0x1c18d70 2024-01-22T05:09:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fc009c31740 10 client.6672 fetch_fsmap learned FSMap version 62 2024-01-22T05:09:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fc009c31740 1 -- 172.21.15.49:0/4237646670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x7fbfd8004500 con 0x1c18d70 2024-01-22T05:09:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fbfe5600700 1 -- 172.21.15.49:0/4237646670 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1b90360 con 0x1c18d70 2024-01-22T05:09:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fbfe5600700 1 -- 172.21.15.49:0/4237646670 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbff0001860 con 0x1c18d70 2024-01-22T05:09:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fc009c31740 10 client.6672 fetch_fsmap finished waiting for FSMap version 62 2024-01-22T05:09:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fc009c31740 10 client.6672 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-01-22T05:09:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fc009c31740 20 client.6672 populate_metadata read hostname 'smithi049' 2024-01-22T05:09:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fc009c31740 1 --2- 172.21.15.49:0/4237646670 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x1c44350 0x1c44760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fc009c31740 4 client.6672 mds_command: new command op to 6609 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:09:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fc009c31740 1 -- 172.21.15.49:0/4237646670 --> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1b868b0 con 0x1c44350 2024-01-22T05:09:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fbffce00700 1 --2- 172.21.15.49:0/4237646670 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x1c44350 0x1c44760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fbffce00700 1 --2- 172.21.15.49:0/4237646670 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x1c44350 0x1c44760 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b4350b903c430f4f server_cookie=5b0dd1a7e448f68f in_seq=0 out_seq=0 2024-01-22T05:09:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fbfe5600700 10 client.6672 ms_handle_connect on v2:172.21.15.49:6836/2814482810 2024-01-22T05:09:24.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fbfe5600700 1 -- 172.21.15.49:0/4237646670 <== mds.0 v2:172.21.15.49:6836/2814482810 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1b868b0 con 0x1c44350 2024-01-22T05:09:24.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.694+0000 7fbfe5600700 10 client.6672 handle_command_reply: tid=0 2024-01-22T05:09:24.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.698+0000 7fc009c31740 1 client.6672 shutdown 2024-01-22T05:09:24.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.698+0000 7fc009c31740 1 -- 172.21.15.49:0/4237646670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 msgr2=0x1c13800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:24.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.698+0000 7fc009c31740 1 --2- 172.21.15.49:0/4237646670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c13800 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fbff00115e0 tx=0x7fbff0009040).stop 2024-01-22T05:09:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.698+0000 7fc009c31740 1 -- 172.21.15.49:0/4237646670 shutdown_connections 2024-01-22T05:09:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.698+0000 7fc009c31740 1 --2- 172.21.15.49:0/4237646670 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x1c44350 0x1c44760 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.698+0000 7fc009c31740 1 --2- 172.21.15.49:0/4237646670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c13800 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.698+0000 7fc009c31740 1 --2- 172.21.15.49:0/4237646670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c14440 0x1c13310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.698+0000 7fc009c31740 1 --2- 172.21.15.49:0/4237646670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c12e90 0x1c2c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.698+0000 7fbfe5600700 0 client.6672 ms_handle_reset on v2:172.21.15.49:6836/2814482810 2024-01-22T05:09:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.698+0000 7fc009c31740 1 -- 172.21.15.49:0/4237646670 >> 172.21.15.49:0/4237646670 conn(0x19f8870 msgr2=0x1c5d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:24.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.698+0000 7fc009c31740 1 -- 172.21.15.49:0/4237646670 shutdown_connections 2024-01-22T05:09:24.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.698+0000 7fc009c31740 1 -- 172.21.15.49:0/4237646670 wait complete. 2024-01-22T05:09:24.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.698+0000 7fc009c31740 20 client.6672 trim_cache size 0 max 16384 2024-01-22T05:09:24.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.718+0000 7fc009c31740 1 Processor -- start 2024-01-22T05:09:24.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.718+0000 7fc009c31740 1 -- start start 2024-01-22T05:09:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fc009c31740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c12e90 0x1c17710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fc009c31740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c14440 0x1c58780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fc009c31740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c58c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fc009c31740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c5a050 con 0x1c18d70 2024-01-22T05:09:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fc009c31740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b521a0 con 0x1c12e90 2024-01-22T05:09:24.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fc009c31740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c19740 con 0x1c14440 2024-01-22T05:09:24.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fbffd800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c58c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fbffd800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c58c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52022/0 (socket says 172.21.15.49:52022) 2024-01-22T05:09:24.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fbffd800700 1 -- 172.21.15.49:0/3249722060 learned_addr learned my addr 172.21.15.49:0/3249722060 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:24.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fbff7e00700 1 --2- 172.21.15.49:0/3249722060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c14440 0x1c58780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fbffd800700 1 -- 172.21.15.49:0/3249722060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c14440 msgr2=0x1c58780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:24.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fbffd800700 1 --2- 172.21.15.49:0/3249722060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c14440 0x1c58780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fbffd800700 1 -- 172.21.15.49:0/3249722060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c12e90 msgr2=0x1c17710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:24.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fbffd800700 1 --2- 172.21.15.49:0/3249722060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c12e90 0x1c17710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:09:24.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fbffd800700 1 -- 172.21.15.49:0/3249722060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c2c5b0 con 0x1c18d70 2024-01-22T05:09:24.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fbff7e00700 1 --2- 172.21.15.49:0/3249722060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c14440 0x1c58780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:09:24.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fbffd800700 1 --2- 172.21.15.49:0/3249722060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c58c70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fbff0001fd0 tx=0x7fbff0021000).ready entity=mon.0 client_cookie=c6135ade291b39d6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:24.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fbfed600700 1 -- 172.21.15.49:0/3249722060 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0028070 con 0x1c18d70 2024-01-22T05:09:24.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fbfed600700 1 -- 172.21.15.49:0/3249722060 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff0011bd0 con 0x1c18d70 2024-01-22T05:09:24.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fbfed600700 1 -- 172.21.15.49:0/3249722060 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0001dc0 con 0x1c18d70 2024-01-22T05:09:24.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fc009c31740 1 -- 172.21.15.49:0/3249722060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 msgr2=0x1c58c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:24.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.722+0000 7fc009c31740 1 --2- 172.21.15.49:0/3249722060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c58c70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fbff0001fd0 tx=0x7fbff0021000).stop 2024-01-22T05:09:24.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.726+0000 7fc009c31740 1 -- 172.21.15.49:0/3249722060 shutdown_connections 2024-01-22T05:09:24.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.726+0000 7fc009c31740 1 --2- 172.21.15.49:0/3249722060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c18d70 0x1c58c70 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.726+0000 7fc009c31740 1 --2- 172.21.15.49:0/3249722060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c14440 0x1c58780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.726+0000 7fc009c31740 1 --2- 172.21.15.49:0/3249722060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c12e90 0x1c17710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:09:24.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.726+0000 7fc009c31740 1 -- 172.21.15.49:0/3249722060 >> 172.21.15.49:0/3249722060 conn(0x19f8870 msgr2=0x1c59940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:24.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.726+0000 7fc009c31740 1 -- 172.21.15.49:0/3249722060 shutdown_connections 2024-01-22T05:09:24.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.726+0000 7fc009c31740 1 -- 172.21.15.49:0/3249722060 wait complete. 2024-01-22T05:09:24.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.726+0000 7fc009c31740 1 -- start start 2024-01-22T05:09:24.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.726+0000 7fc009c31740 1 Processor -- start 2024-01-22T05:09:24.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fc009c31740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c12e90 0x1cbdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fc009c31740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c14440 0x1c42400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fc009c31740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c18d70 0x1c428f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fc009c31740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c5af00 con 0x1c14440 2024-01-22T05:09:24.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fc009c31740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c42de0 con 0x1c18d70 2024-01-22T05:09:24.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fc009c31740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1cbe050 con 0x1c12e90 2024-01-22T05:09:24.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fc009c31740 10 client.0 ll_register_callbacks cb 0x7fbff0004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:09:24.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fbffce00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c12e90 0x1cbdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fbff7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c14440 0x1c42400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fbffce00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c12e90 0x1cbdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:40570/0 (socket says 172.21.15.49:40570) 2024-01-22T05:09:24.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fbffce00700 1 -- 172.21.15.49:0/1362694083 learned_addr learned my addr 172.21.15.49:0/1362694083 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:24.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fbffd800700 1 --2- 172.21.15.49:0/1362694083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c18d70 0x1c428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fbffce00700 1 -- 172.21.15.49:0/1362694083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c18d70 msgr2=0x1c428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:24.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fbffce00700 1 --2- 172.21.15.49:0/1362694083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c18d70 0x1c428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fbffce00700 1 -- 172.21.15.49:0/1362694083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c14440 msgr2=0x1c42400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:24.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fbffce00700 1 --2- 172.21.15.49:0/1362694083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c14440 0x1c42400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fbffce00700 1 -- 172.21.15.49:0/1362694083 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd8004500 con 0x1c12e90 2024-01-22T05:09:24.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fbffce00700 1 --2- 172.21.15.49:0/1362694083 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c12e90 0x1cbdb60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fbfe800f590 tx=0x7fbfe8016000).ready entity=mon.2 client_cookie=23350873d0a8334c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:24.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fbfe5600700 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2024-01-22T05:09:24.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fbfe5600700 1 -- 172.21.15.49:0/1362694083 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8026040 con 0x1c12e90 2024-01-22T05:09:24.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fbfe5600700 1 -- 172.21.15.49:0/1362694083 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fbfe8000c30 con 0x1c12e90 2024-01-22T05:09:24.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.730+0000 7fc009c31740 1 -- 172.21.15.49:0/1362694083 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbfe8020560 con 0x1c12e90 2024-01-22T05:09:24.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fbfe5600700 1 -- 172.21.15.49:0/1362694083 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfe8020cb0 con 0x1c12e90 2024-01-22T05:09:24.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fc009c31740 10 client.5963 fetch_fsmap learned FSMap version 62 2024-01-22T05:09:24.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fc009c31740 1 -- 172.21.15.49:0/1362694083 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x7fbff8066750 con 0x1c12e90 2024-01-22T05:09:24.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fbfe5600700 1 -- 172.21.15.49:0/1362694083 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe8020560 con 0x1c12e90 2024-01-22T05:09:24.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fbfe5600700 1 -- 172.21.15.49:0/1362694083 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbfe801e030 con 0x1c12e90 2024-01-22T05:09:24.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fc009c31740 10 client.5963 fetch_fsmap finished waiting for FSMap version 62 2024-01-22T05:09:24.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fc009c31740 10 client.5963 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-01-22T05:09:24.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fc009c31740 20 client.5963 populate_metadata read hostname 'smithi049' 2024-01-22T05:09:24.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fc009c31740 1 --2- 172.21.15.49:0/1362694083 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x1cbe230 0x1c61780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:24.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fc009c31740 4 client.5963 mds_command: new command op to 6609 tid=0[{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2024-01-22T05:09:24.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fc009c31740 1 -- 172.21.15.49:0/1362694083 --> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) v1 -- 0x1a4f800 con 0x1cbe230 2024-01-22T05:09:24.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fbff7e00700 1 --2- 172.21.15.49:0/1362694083 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x1cbe230 0x1c61780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:24.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fbff7e00700 1 --2- 172.21.15.49:0/1362694083 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x1cbe230 0x1c61780 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=af77f90d9d22a794 server_cookie=1ce7f70f8e7af9ee in_seq=0 out_seq=0 2024-01-22T05:09:24.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fbfe5600700 10 client.5963 ms_handle_connect on v2:172.21.15.49:6836/2814482810 2024-01-22T05:09:24.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fbfe5600700 1 -- 172.21.15.49:0/1362694083 <== mds.0 v2:172.21.15.49:6836/2814482810 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1a4f800 con 0x1cbe230 2024-01-22T05:09:24.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fbfe5600700 10 client.5963 handle_command_reply: tid=0 2024-01-22T05:09:24.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fc009c31740 1 client.5963 shutdown 2024-01-22T05:09:24.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.734+0000 7fc009c31740 1 -- 172.21.15.49:0/1362694083 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c12e90 msgr2=0x1cbdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:24.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fc009c31740 1 --2- 172.21.15.49:0/1362694083 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c12e90 0x1cbdb60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fbfe800f590 tx=0x7fbfe8016000).stop 2024-01-22T05:09:24.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fc009c31740 1 -- 172.21.15.49:0/1362694083 shutdown_connections 2024-01-22T05:09:24.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fc009c31740 1 --2- 172.21.15.49:0/1362694083 >> [v2:172.21.15.49:6836/2814482810,v1:172.21.15.49:6837/2814482810] conn(0x1cbe230 0x1c61780 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fc009c31740 1 --2- 172.21.15.49:0/1362694083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1c18d70 0x1c428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fc009c31740 1 --2- 172.21.15.49:0/1362694083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1c14440 0x1c42400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fc009c31740 1 --2- 172.21.15.49:0/1362694083 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1c12e90 0x1cbdb60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fbfe5600700 0 client.5963 ms_handle_reset on v2:172.21.15.49:6836/2814482810 2024-01-22T05:09:24.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fc009c31740 1 -- 172.21.15.49:0/1362694083 >> 172.21.15.49:0/1362694083 conn(0x19f8870 msgr2=0x1c5d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:24.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fc009c31740 1 -- 172.21.15.49:0/1362694083 shutdown_connections 2024-01-22T05:09:24.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fc009c31740 1 -- 172.21.15.49:0/1362694083 wait complete. 2024-01-22T05:09:24.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fc009c31740 20 client.5963 trim_cache size 0 max 16384 2024-01-22T05:09:24.742 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:09:24.742 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:09:24.742 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "991bbc05-2a63-4073-a2f6-236e6dfcc339", 2024-01-22T05:09:24.743 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:09:24.743 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:09:24.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fbfff800700 1 -- 172.21.15.49:0/2742814293 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbfd005a540 msgr2=0x7fbfd005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:24.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fbfff800700 1 --2- 172.21.15.49:0/2742814293 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbfd005a540 0x7fbfd005ca00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fbfe80010e0 tx=0x7fbfe8009040).stop 2024-01-22T05:09:24.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fbfff800700 1 -- 172.21.15.49:0/2742814293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff8139a50 msgr2=0x7fbff80629e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:24.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fbfff800700 1 --2- 172.21.15.49:0/2742814293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff8139a50 0x7fbff80629e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fbff80656e0 tx=0x7fbfe0016000).stop 2024-01-22T05:09:24.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fbfff800700 1 -- 172.21.15.49:0/2742814293 shutdown_connections 2024-01-22T05:09:24.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fbfff800700 1 --2- 172.21.15.49:0/2742814293 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbfd005a540 0x7fbfd005ca00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fbfff800700 1 --2- 172.21.15.49:0/2742814293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbff8154ab0 0x7fbff8062ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fbfff800700 1 --2- 172.21.15.49:0/2742814293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff8139a50 0x7fbff80629e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fbfff800700 1 --2- 172.21.15.49:0/2742814293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbff80c2520 0x7fbff814fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:24.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fbfff800700 1 -- 172.21.15.49:0/2742814293 >> 172.21.15.49:0/2742814293 conn(0x7fbff80c7830 msgr2=0x7fbff8067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:24.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fbfff800700 1 -- 172.21.15.49:0/2742814293 shutdown_connections 2024-01-22T05:09:24.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:24.738+0000 7fbfff800700 1 -- 172.21.15.49:0/2742814293 wait complete. 2024-01-22T05:09:24.768 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': '991bbc05-2a63-4073-a2f6-236e6dfcc339', 'mode': 'asynchronous'}' 2024-01-22T05:09:34.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:09:34.769 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-01-22T05:09:34.796 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:09:34.796 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:09:34.879 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:09:34.919 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:09:34.919 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T05:09:34.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:09:34.919 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-22T05:09:34.971 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:09:34.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:09:34.971 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:09:34.987 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:09:35.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.198+0000 7f5f75800700 1 Processor -- start 2024-01-22T05:09:35.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.198+0000 7f5f75800700 1 -- start start 2024-01-22T05:09:35.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f75800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5f701547c0 0x7f5f700c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:35.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f75800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f701500b0 0x7f5f70068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:35.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f75800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f70069400 con 0x7f5f70068f90 2024-01-22T05:09:35.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f75800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f70066950 con 0x7f5f701547c0 2024-01-22T05:09:35.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f75800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f700c2330 con 0x7f5f701500b0 2024-01-22T05:09:35.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f6ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5f701547c0 0x7f5f700c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:35.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f6ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5f701547c0 0x7f5f700c30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51852/0 (socket says 172.21.15.49:51852) 2024-01-22T05:09:35.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f6ea00700 1 -- 172.21.15.49:0/1150256999 learned_addr learned my addr 172.21.15.49:0/1150256999 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:35.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f6e000700 1 --2- 172.21.15.49:0/1150256999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f701500b0 0x7f5f70068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:35.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f6d600700 1 -- 172.21.15.49:0/1150256999 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022545755 0 0) 0x7f5f70069400 con 0x7f5f70068f90 2024-01-22T05:09:35.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f6d600700 1 -- 172.21.15.49:0/1150256999 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f500033f0 con 0x7f5f70068f90 2024-01-22T05:09:35.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f6ea00700 1 -- 172.21.15.49:0/1150256999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f701500b0 msgr2=0x7f5f70068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:35.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f6ea00700 1 --2- 172.21.15.49:0/1150256999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f701500b0 0x7f5f70068aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f6ea00700 1 -- 172.21.15.49:0/1150256999 >> v1:172.21.15.110:6789/0 conn(0x7f5f70068f90 legacy=0x7f5f700bbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:35.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f6ea00700 1 -- 172.21.15.49:0/1150256999 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f700c2610 con 0x7f5f701547c0 2024-01-22T05:09:35.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.202+0000 7f5f6e000700 1 --2- 172.21.15.49:0/1150256999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f701500b0 0x7f5f70068aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:35.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.206+0000 7f5f6ea00700 1 --2- 172.21.15.49:0/1150256999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f701547c0 0x7f5f700c30f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f5f60006fd0 tx=0x7f5f600090f0).ready entity=mon.0 client_cookie=e433a76ae59da07f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:35.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.206+0000 7f5f6d600700 1 -- 172.21.15.49:0/1150256999 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000f510 con 0x7f5f701547c0 2024-01-22T05:09:35.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.206+0000 7f5f6d600700 1 -- 172.21.15.49:0/1150256999 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6000f670 con 0x7f5f701547c0 2024-01-22T05:09:35.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.206+0000 7f5f6d600700 1 -- 172.21.15.49:0/1150256999 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000f9f0 con 0x7f5f701547c0 2024-01-22T05:09:35.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.206+0000 7f5f75800700 1 -- 172.21.15.49:0/1150256999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f701547c0 msgr2=0x7f5f700c30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:35.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.206+0000 7f5f75800700 1 --2- 172.21.15.49:0/1150256999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f701547c0 0x7f5f700c30f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f5f60006fd0 tx=0x7f5f600090f0).stop 2024-01-22T05:09:35.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.206+0000 7f5f75800700 1 -- 172.21.15.49:0/1150256999 shutdown_connections 2024-01-22T05:09:35.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.206+0000 7f5f75800700 1 --2- 172.21.15.49:0/1150256999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f701500b0 0x7f5f70068aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.206+0000 7f5f75800700 1 --2- 172.21.15.49:0/1150256999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f701547c0 0x7f5f700c30f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.206+0000 7f5f75800700 1 -- 172.21.15.49:0/1150256999 >> 172.21.15.49:0/1150256999 conn(0x7f5f700c4300 msgr2=0x7f5f70065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:35.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.206+0000 7f5f75800700 1 -- 172.21.15.49:0/1150256999 shutdown_connections 2024-01-22T05:09:35.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.206+0000 7f5f75800700 1 -- 172.21.15.49:0/1150256999 wait complete. 2024-01-22T05:09:35.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.210+0000 7f5f75800700 1 Processor -- start 2024-01-22T05:09:35.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f75800700 1 -- start start 2024-01-22T05:09:35.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f75800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f70068f90 0x7f5f70136c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:35.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f75800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f701500b0 0x7f5f7013eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:35.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f75800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f701547c0 0x7f5f7013f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:35.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f75800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f70145640 con 0x7f5f701500b0 2024-01-22T05:09:35.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f75800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7013f9d0 con 0x7f5f70068f90 2024-01-22T05:09:35.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f75800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f70137140 con 0x7f5f701547c0 2024-01-22T05:09:35.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f6e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f701500b0 0x7f5f7013eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:35.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f6e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f701500b0 0x7f5f7013eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51868/0 (socket says 172.21.15.49:51868) 2024-01-22T05:09:35.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f6e000700 1 -- 172.21.15.49:0/3729468792 learned_addr learned my addr 172.21.15.49:0/3729468792 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:35.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f6ea00700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f70068f90 0x7f5f70136c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:35.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f6f400700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f701547c0 0x7f5f7013f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:35.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f6e000700 1 -- 172.21.15.49:0/3729468792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f701547c0 msgr2=0x7f5f7013f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:35.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f6e000700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f701547c0 0x7f5f7013f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f6e000700 1 -- 172.21.15.49:0/3729468792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f70068f90 msgr2=0x7f5f70136c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:35.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f6e000700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f70068f90 0x7f5f70136c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f6e000700 1 -- 172.21.15.49:0/3729468792 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5800a440 con 0x7f5f701500b0 2024-01-22T05:09:35.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f6f400700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f701547c0 0x7f5f7013f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:35.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f6ea00700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f70068f90 0x7f5f70136c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:35.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.214+0000 7f5f6e000700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f701500b0 0x7f5f7013eff0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f5f5800e980 tx=0x7f5f5800a200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:35.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.218+0000 7f5f66000700 1 -- 172.21.15.49:0/3729468792 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800c950 con 0x7f5f701500b0 2024-01-22T05:09:35.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.218+0000 7f5f66000700 1 -- 172.21.15.49:0/3729468792 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5800cab0 con 0x7f5f701500b0 2024-01-22T05:09:35.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.218+0000 7f5f75800700 1 -- 172.21.15.49:0/3729468792 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f60009370 con 0x7f5f701500b0 2024-01-22T05:09:35.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.218+0000 7f5f66000700 1 -- 172.21.15.49:0/3729468792 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800ce30 con 0x7f5f701500b0 2024-01-22T05:09:35.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.218+0000 7f5f75800700 1 -- 172.21.15.49:0/3729468792 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f70144d10 con 0x7f5f701500b0 2024-01-22T05:09:35.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.218+0000 7f5f75800700 1 -- 172.21.15.49:0/3729468792 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f70064b90 con 0x7f5f701500b0 2024-01-22T05:09:35.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.222+0000 7f5f66000700 1 -- 172.21.15.49:0/3729468792 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5f58011600 con 0x7f5f701500b0 2024-01-22T05:09:35.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.222+0000 7f5f66000700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f4805a590 0x7f5f4805ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:35.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.222+0000 7f5f66000700 1 -- 172.21.15.49:0/3729468792 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f5f58074ce0 con 0x7f5f701500b0 2024-01-22T05:09:35.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.222+0000 7f5f6ea00700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f4805a590 0x7f5f4805ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:35.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.222+0000 7f5f6ea00700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f4805a590 0x7f5f4805ca50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f5f60009130 tx=0x7f5f60017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:35.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.230+0000 7f5f66000700 1 -- 172.21.15.49:0/3729468792 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5f58048310 con 0x7f5f701500b0 2024-01-22T05:09:35.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.430+0000 7f5f75800700 1 -- 172.21.15.49:0/3729468792 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f700a6720 con 0x7f5f701500b0 2024-01-22T05:09:35.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.434+0000 7f5f66000700 1 -- 172.21.15.49:0/3729468792 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4498 (secure 0 0 0) 0x7f5f58015020 con 0x7f5f701500b0 2024-01-22T05:09:35.438 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:35.438 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":62,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4087795616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4087795616},{"type":"v1","addr":"172.21.15.110:6833","nonce":4087795616}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3220435249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3220435249},{"type":"v1","addr":"172.21.15.110:6835","nonce":3220435249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3927178750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3927178750},{"type":"v1","addr":"172.21.15.49:6835","nonce":3927178750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:09:03.929962+0000","modified":"2024-01-22T05:09:22.494561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6609},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6609":{"gid":6609,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/2814482810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2814482810},{"type":"v1","addr":"172.21.15.49:6837","nonce":2814482810}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-22T05:09:35.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.434+0000 7f5f75800700 1 -- 172.21.15.49:0/3729468792 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f4805a590 msgr2=0x7f5f4805ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:35.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.434+0000 7f5f75800700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f4805a590 0x7f5f4805ca50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f5f60009130 tx=0x7f5f60017000).stop 2024-01-22T05:09:35.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.434+0000 7f5f75800700 1 -- 172.21.15.49:0/3729468792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f701500b0 msgr2=0x7f5f7013eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:35.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.434+0000 7f5f75800700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f701500b0 0x7f5f7013eff0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f5f5800e980 tx=0x7f5f5800a200).stop 2024-01-22T05:09:35.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.434+0000 7f5f75800700 1 -- 172.21.15.49:0/3729468792 shutdown_connections 2024-01-22T05:09:35.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.434+0000 7f5f75800700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f4805a590 0x7f5f4805ca50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.434+0000 7f5f75800700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f701547c0 0x7f5f7013f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.434+0000 7f5f75800700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f701500b0 0x7f5f7013eff0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.434+0000 7f5f75800700 1 --2- 172.21.15.49:0/3729468792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f70068f90 0x7f5f70136c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.434+0000 7f5f75800700 1 -- 172.21.15.49:0/3729468792 >> 172.21.15.49:0/3729468792 conn(0x7f5f700c4300 msgr2=0x7f5f701474a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:35.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.438+0000 7f5f75800700 1 -- 172.21.15.49:0/3729468792 shutdown_connections 2024-01-22T05:09:35.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.438+0000 7f5f75800700 1 -- 172.21.15.49:0/3729468792 wait complete. 2024-01-22T05:09:35.444 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 62 2024-01-22T05:09:35.462 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:09:35.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.626+0000 7f32b7200700 1 Processor -- start 2024-01-22T05:09:35.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.626+0000 7f32b7200700 1 -- start start 2024-01-22T05:09:35.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.630+0000 7f32b7200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32b00c37d0 0x7f32b00c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:35.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.630+0000 7f32b7200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b00c4db0 con 0x7f32b00681a0 2024-01-22T05:09:35.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.630+0000 7f32b7200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b00c5240 con 0x7f32b0153bd0 2024-01-22T05:09:35.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.630+0000 7f32b7200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b0062230 con 0x7f32b00c37d0 2024-01-22T05:09:35.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.630+0000 7f32afe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32b00c37d0 0x7f32b00c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:35.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.630+0000 7f32b5c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f32b00681a0 0x7f32b00bebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60418/0 (socket says 172.21.15.49:60418) 2024-01-22T05:09:35.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.630+0000 7f32b5c00700 1 -- 172.21.15.49:0/2610771056 learned_addr learned my addr 172.21.15.49:0/2610771056 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:35.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.630+0000 7f32afe00700 1 -- 172.21.15.49:0/2610771056 >> v1:172.21.15.110:6789/0 conn(0x7f32b0153bd0 legacy=0x7f32b0067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:35.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.630+0000 7f32afe00700 1 -- 172.21.15.49:0/2610771056 >> v1:172.21.15.49:6789/0 conn(0x7f32b00681a0 legacy=0x7f32b00bebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:35.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.630+0000 7f32aea00700 1 -- 172.21.15.49:0/2610771056 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518114686 0 0) 0x7f32b00c4db0 con 0x7f32b00681a0 2024-01-22T05:09:35.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.630+0000 7f32afe00700 1 -- 172.21.15.49:0/2610771056 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b00c4140 con 0x7f32b00c37d0 2024-01-22T05:09:35.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.630+0000 7f32afe00700 1 --2- 172.21.15.49:0/2610771056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32b00c37d0 0x7f32b00c3bb0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f32a00096e0 tx=0x7f32a0009060).ready entity=mon.0 client_cookie=19825b14944a2d3e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:35.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.630+0000 7f32aea00700 1 -- 172.21.15.49:0/2610771056 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000f6b0 con 0x7f32b00c37d0 2024-01-22T05:09:35.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.630+0000 7f32aea00700 1 -- 172.21.15.49:0/2610771056 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a000f810 con 0x7f32b00c37d0 2024-01-22T05:09:35.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.630+0000 7f32aea00700 1 -- 172.21.15.49:0/2610771056 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000fb90 con 0x7f32b00c37d0 2024-01-22T05:09:35.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.634+0000 7f32b7200700 1 -- 172.21.15.49:0/2610771056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32b00c37d0 msgr2=0x7f32b00c3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:35.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.634+0000 7f32b7200700 1 --2- 172.21.15.49:0/2610771056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32b00c37d0 0x7f32b00c3bb0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f32a00096e0 tx=0x7f32a0009060).stop 2024-01-22T05:09:35.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.634+0000 7f32b7200700 1 -- 172.21.15.49:0/2610771056 shutdown_connections 2024-01-22T05:09:35.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.634+0000 7f32b7200700 1 --2- 172.21.15.49:0/2610771056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32b00c37d0 0x7f32b00c3bb0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.634+0000 7f32b7200700 1 -- 172.21.15.49:0/2610771056 >> 172.21.15.49:0/2610771056 conn(0x7f32b0064080 msgr2=0x7f32b0064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:35.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.634+0000 7f32b7200700 1 -- 172.21.15.49:0/2610771056 shutdown_connections 2024-01-22T05:09:35.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.634+0000 7f32b7200700 1 -- 172.21.15.49:0/2610771056 wait complete. 2024-01-22T05:09:35.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.634+0000 7f32b7200700 1 Processor -- start 2024-01-22T05:09:35.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b7200700 1 -- start start 2024-01-22T05:09:35.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b7200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b00681a0 0x7f32b014ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:35.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b7200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32b00c37d0 0x7f32b01436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:35.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b7200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32b0153bd0 0x7f32b00aca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:35.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b7200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00ac8b0 con 0x7f32b0153bd0 2024-01-22T05:09:35.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b7200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00aee00 con 0x7f32b00681a0 2024-01-22T05:09:35.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b7200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b0150490 con 0x7f32b00c37d0 2024-01-22T05:09:35.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b5c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32b0153bd0 0x7f32b00aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:35.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b5c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32b0153bd0 0x7f32b00aca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51894/0 (socket says 172.21.15.49:51894) 2024-01-22T05:09:35.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b5c00700 1 -- 172.21.15.49:0/1459282089 learned_addr learned my addr 172.21.15.49:0/1459282089 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:35.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32afe00700 1 --2- 172.21.15.49:0/1459282089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b00681a0 0x7f32b014ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:35.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32af400700 1 --2- 172.21.15.49:0/1459282089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32b00c37d0 0x7f32b01436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:35.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b5c00700 1 -- 172.21.15.49:0/1459282089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32b00c37d0 msgr2=0x7f32b01436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:35.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b5c00700 1 --2- 172.21.15.49:0/1459282089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32b00c37d0 0x7f32b01436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b5c00700 1 -- 172.21.15.49:0/1459282089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b00681a0 msgr2=0x7f32b014ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:35.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b5c00700 1 --2- 172.21.15.49:0/1459282089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b00681a0 0x7f32b014ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b5c00700 1 -- 172.21.15.49:0/1459282089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a00092a0 con 0x7f32b0153bd0 2024-01-22T05:09:35.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32afe00700 1 --2- 172.21.15.49:0/1459282089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b00681a0 0x7f32b014ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:35.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b5c00700 1 --2- 172.21.15.49:0/1459282089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32b0153bd0 0x7f32b00aca90 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f32a800c960 tx=0x7f32a8001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:35.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32a7400700 1 -- 172.21.15.49:0/1459282089 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8005d30 con 0x7f32b0153bd0 2024-01-22T05:09:35.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32a7400700 1 -- 172.21.15.49:0/1459282089 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a8005e90 con 0x7f32b0153bd0 2024-01-22T05:09:35.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32b7200700 1 -- 172.21.15.49:0/1459282089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b00ac5d0 con 0x7f32b0153bd0 2024-01-22T05:09:35.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.638+0000 7f32a7400700 1 -- 172.21.15.49:0/1459282089 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8007320 con 0x7f32b0153bd0 2024-01-22T05:09:35.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.642+0000 7f32b7200700 1 -- 172.21.15.49:0/1459282089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b00ad7b0 con 0x7f32b0153bd0 2024-01-22T05:09:35.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.642+0000 7f32b7200700 1 -- 172.21.15.49:0/1459282089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b0047060 con 0x7f32b0153bd0 2024-01-22T05:09:35.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.642+0000 7f32a7400700 1 -- 172.21.15.49:0/1459282089 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f32a8007750 con 0x7f32b0153bd0 2024-01-22T05:09:35.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.646+0000 7f32a7400700 1 --2- 172.21.15.49:0/1459282089 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f328805a510 0x7f328805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:35.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.646+0000 7f32a7400700 1 -- 172.21.15.49:0/1459282089 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f32a8074c10 con 0x7f32b0153bd0 2024-01-22T05:09:35.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.646+0000 7f32afe00700 1 --2- 172.21.15.49:0/1459282089 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f328805a510 0x7f328805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:35.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.646+0000 7f32afe00700 1 --2- 172.21.15.49:0/1459282089 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f328805a510 0x7f328805c9d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f32a000ffd0 tx=0x7f32a0019000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:35.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.650+0000 7f32a7400700 1 -- 172.21.15.49:0/1459282089 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f32a8048080 con 0x7f32b0153bd0 2024-01-22T05:09:35.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.822+0000 7f32b7200700 1 -- 172.21.15.49:0/1459282089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32b0064f20 con 0x7f32b0153bd0 2024-01-22T05:09:35.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.822+0000 7f32a7400700 1 -- 172.21.15.49:0/1459282089 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+17538 (secure 0 0 0) 0x7f32a804b6a0 con 0x7f32b0153bd0 2024-01-22T05:09:35.828 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:35.828 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":76,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:09:24.515280+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:09:01.882090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-01-22T05:09:02.934332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.2e","mappings":[{"from":4,"to":3}]},{"pgid":"10.33","mappings":[{"from":4,"to":3}]},{"pgid":"10.3a","mappings":[{"from":7,"to":3}]},{"pgid":"11.2d","mappings":[{"from":6,"to":0}]},{"pgid":"11.3c","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6837/2817241041":"2024-01-23T05:09:18.080863+0000","172.21.15.49:6836/2817241041":"2024-01-23T05:09:18.080863+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:09:35.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.826+0000 7f32b7200700 1 -- 172.21.15.49:0/1459282089 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f328805a510 msgr2=0x7f328805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:35.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.826+0000 7f32b7200700 1 --2- 172.21.15.49:0/1459282089 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f328805a510 0x7f328805c9d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f32a000ffd0 tx=0x7f32a0019000).stop 2024-01-22T05:09:35.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.826+0000 7f32b7200700 1 -- 172.21.15.49:0/1459282089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32b0153bd0 msgr2=0x7f32b00aca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:35.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.826+0000 7f32b7200700 1 --2- 172.21.15.49:0/1459282089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32b0153bd0 0x7f32b00aca90 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f32a800c960 tx=0x7f32a8001630).stop 2024-01-22T05:09:35.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.826+0000 7f32b7200700 1 -- 172.21.15.49:0/1459282089 shutdown_connections 2024-01-22T05:09:35.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.826+0000 7f32b7200700 1 --2- 172.21.15.49:0/1459282089 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f328805a510 0x7f328805c9d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.826+0000 7f32b7200700 1 --2- 172.21.15.49:0/1459282089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32b0153bd0 0x7f32b00aca90 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.826+0000 7f32b7200700 1 --2- 172.21.15.49:0/1459282089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32b00c37d0 0x7f32b01436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.826+0000 7f32b7200700 1 --2- 172.21.15.49:0/1459282089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b00681a0 0x7f32b014ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.826+0000 7f32b7200700 1 -- 172.21.15.49:0/1459282089 >> 172.21.15.49:0/1459282089 conn(0x7f32b0064080 msgr2=0x7f32b0067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.826+0000 7f32b7200700 1 -- 172.21.15.49:0/1459282089 shutdown_connections 2024-01-22T05:09:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:35.826+0000 7f32b7200700 1 -- 172.21.15.49:0/1459282089 wait complete. 2024-01-22T05:09:35.856 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:09:01.882090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:09:02.934332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:09:35.857 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:09:36.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.022+0000 7f4653a00700 1 Processor -- start 2024-01-22T05:09:36.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.022+0000 7f4653a00700 1 -- start start 2024-01-22T05:09:36.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f4653a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0c2120 0x7f464c0c2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f4653a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f464c063bd0 0x7f464c0bce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f4653a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c0bd370 con 0x7f464c0bca00 2024-01-22T05:09:36.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f4653a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c0c29f0 con 0x7f464c063bd0 2024-01-22T05:09:36.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f4653a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0c3780 con 0x7f464c0c2120 2024-01-22T05:09:36.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f464be00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f464c0bca00 0x7f464c153ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60434/0 (socket says 172.21.15.49:60434) 2024-01-22T05:09:36.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f464be00700 1 -- 172.21.15.49:0/3348569017 learned_addr learned my addr 172.21.15.49:0/3348569017 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:36.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f4651000700 1 --2- 172.21.15.49:0/3348569017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0c2120 0x7f464c0c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f4651a00700 1 --2- 172.21.15.49:0/3348569017 >> v2:172.21.15.49:3300/0 conn(0x7f464c063bd0 0x7f464c0bce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f464b400700 1 -- 172.21.15.49:0/3348569017 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750609167 0 0) 0x7f464c0bd370 con 0x7f464c0bca00 2024-01-22T05:09:36.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f464b400700 1 -- 172.21.15.49:0/3348569017 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f462c0033f0 con 0x7f464c0bca00 2024-01-22T05:09:36.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f4651000700 1 -- 172.21.15.49:0/3348569017 >> v2:172.21.15.49:3300/0 conn(0x7f464c063bd0 msgr2=0x7f464c0bce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:36.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f4651000700 1 --2- 172.21.15.49:0/3348569017 >> v2:172.21.15.49:3300/0 conn(0x7f464c063bd0 0x7f464c0bce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f4651000700 1 -- 172.21.15.49:0/3348569017 >> v1:172.21.15.49:6789/0 conn(0x7f464c0bca00 legacy=0x7f464c153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f4651000700 1 -- 172.21.15.49:0/3348569017 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c0c2c00 con 0x7f464c0c2120 2024-01-22T05:09:36.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f4651000700 1 --2- 172.21.15.49:0/3348569017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0c2120 0x7f464c0c2500 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f463c009760 tx=0x7f463c009060).ready entity=mon.2 client_cookie=b293d2c1c396f672 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:36.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f464b400700 1 -- 172.21.15.49:0/3348569017 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c00d4a0 con 0x7f464c0c2120 2024-01-22T05:09:36.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f464b400700 1 -- 172.21.15.49:0/3348569017 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c00d600 con 0x7f464c0c2120 2024-01-22T05:09:36.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f464b400700 1 -- 172.21.15.49:0/3348569017 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c00d980 con 0x7f464c0c2120 2024-01-22T05:09:36.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f4653a00700 1 -- 172.21.15.49:0/3348569017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0c2120 msgr2=0x7f464c0c2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.026+0000 7f4653a00700 1 --2- 172.21.15.49:0/3348569017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0c2120 0x7f464c0c2500 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f463c009760 tx=0x7f463c009060).stop 2024-01-22T05:09:36.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.030+0000 7f4653a00700 1 -- 172.21.15.49:0/3348569017 shutdown_connections 2024-01-22T05:09:36.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.030+0000 7f4653a00700 1 --2- 172.21.15.49:0/3348569017 >> v2:172.21.15.49:3300/0 conn(0x7f464c063bd0 0x7f464c0bce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.030+0000 7f4653a00700 1 --2- 172.21.15.49:0/3348569017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0c2120 0x7f464c0c2500 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.030+0000 7f4653a00700 1 -- 172.21.15.49:0/3348569017 >> 172.21.15.49:0/3348569017 conn(0x7f464c0c3900 msgr2=0x7f464c0c3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:36.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.030+0000 7f4653a00700 1 -- 172.21.15.49:0/3348569017 shutdown_connections 2024-01-22T05:09:36.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.030+0000 7f4653a00700 1 -- 172.21.15.49:0/3348569017 wait complete. 2024-01-22T05:09:36.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.030+0000 7f4653a00700 1 Processor -- start 2024-01-22T05:09:36.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4653a00700 1 -- start start 2024-01-22T05:09:36.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4653a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c0bca00 0x7f464c068050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4653a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0c2120 0x7f464c14f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4653a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f464c141220 0x7f464c0a8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4653a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0bed40 con 0x7f464c0bca00 2024-01-22T05:09:36.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4653a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0bea10 con 0x7f464c141220 2024-01-22T05:09:36.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4653a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c150150 con 0x7f464c0c2120 2024-01-22T05:09:36.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4651000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c0bca00 0x7f464c068050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4651000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c0bca00 0x7f464c068050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51910/0 (socket says 172.21.15.49:51910) 2024-01-22T05:09:36.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4651000700 1 -- 172.21.15.49:0/3015316549 learned_addr learned my addr 172.21.15.49:0/3015316549 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:36.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4651a00700 1 --2- 172.21.15.49:0/3015316549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f464c141220 0x7f464c0a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f464be00700 1 --2- 172.21.15.49:0/3015316549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0c2120 0x7f464c14f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4651000700 1 -- 172.21.15.49:0/3015316549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0c2120 msgr2=0x7f464c14f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4651000700 1 --2- 172.21.15.49:0/3015316549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0c2120 0x7f464c14f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4651000700 1 -- 172.21.15.49:0/3015316549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f464c141220 msgr2=0x7f464c0a8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4651000700 1 --2- 172.21.15.49:0/3015316549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f464c141220 0x7f464c0a8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4651000700 1 -- 172.21.15.49:0/3015316549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c0092a0 con 0x7f464c0bca00 2024-01-22T05:09:36.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4651a00700 1 --2- 172.21.15.49:0/3015316549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f464c141220 0x7f464c0a8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:36.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4651000700 1 --2- 172.21.15.49:0/3015316549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c0bca00 0x7f464c068050 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f463c009d50 tx=0x7f463c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:36.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4643e00700 1 -- 172.21.15.49:0/3015316549 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c000c90 con 0x7f464c0bca00 2024-01-22T05:09:36.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4643e00700 1 -- 172.21.15.49:0/3015316549 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c00d770 con 0x7f464c0bca00 2024-01-22T05:09:36.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4653a00700 1 -- 172.21.15.49:0/3015316549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464c150430 con 0x7f464c0bca00 2024-01-22T05:09:36.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.034+0000 7f4643e00700 1 -- 172.21.15.49:0/3015316549 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c01d640 con 0x7f464c0bca00 2024-01-22T05:09:36.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.038+0000 7f4653a00700 1 -- 172.21.15.49:0/3015316549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c14fe30 con 0x7f464c0bca00 2024-01-22T05:09:36.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.038+0000 7f4653a00700 1 -- 172.21.15.49:0/3015316549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464c150930 con 0x7f464c0bca00 2024-01-22T05:09:36.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.038+0000 7f4643e00700 1 -- 172.21.15.49:0/3015316549 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f463c01da70 con 0x7f464c0bca00 2024-01-22T05:09:36.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.042+0000 7f4643e00700 1 --2- 172.21.15.49:0/3015316549 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f462405a540 0x7f462405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.042+0000 7f4643e00700 1 -- 172.21.15.49:0/3015316549 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f463c0761e0 con 0x7f464c0bca00 2024-01-22T05:09:36.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.042+0000 7f464be00700 1 --2- 172.21.15.49:0/3015316549 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f462405a540 0x7f462405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.042+0000 7f464be00700 1 --2- 172.21.15.49:0/3015316549 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f462405a540 0x7f462405ca00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f464c153120 tx=0x7f4634009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:36.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.046+0000 7f4643e00700 1 -- 172.21.15.49:0/3015316549 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f463c049810 con 0x7f464c0bca00 2024-01-22T05:09:36.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.214+0000 7f4653a00700 1 -- 172.21.15.49:0/3015316549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f464c0c2ee0 con 0x7f464c0bca00 2024-01-22T05:09:36.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.218+0000 7f4643e00700 1 -- 172.21.15.49:0/3015316549 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v76) v1 ==== 110+0+10 (secure 0 0 0) 0x7f463c04ce30 con 0x7f464c0bca00 2024-01-22T05:09:36.221 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:09:36.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.218+0000 7f4653a00700 1 -- 172.21.15.49:0/3015316549 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f462405a540 msgr2=0x7f462405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.218+0000 7f4653a00700 1 --2- 172.21.15.49:0/3015316549 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f462405a540 0x7f462405ca00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f464c153120 tx=0x7f4634009040).stop 2024-01-22T05:09:36.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.218+0000 7f4653a00700 1 -- 172.21.15.49:0/3015316549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c0bca00 msgr2=0x7f464c068050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.218+0000 7f4653a00700 1 --2- 172.21.15.49:0/3015316549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c0bca00 0x7f464c068050 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f463c009d50 tx=0x7f463c016000).stop 2024-01-22T05:09:36.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.222+0000 7f4653a00700 1 -- 172.21.15.49:0/3015316549 shutdown_connections 2024-01-22T05:09:36.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.222+0000 7f4653a00700 1 --2- 172.21.15.49:0/3015316549 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f462405a540 0x7f462405ca00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.222+0000 7f4653a00700 1 --2- 172.21.15.49:0/3015316549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f464c141220 0x7f464c0a8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.222+0000 7f4653a00700 1 --2- 172.21.15.49:0/3015316549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0c2120 0x7f464c14f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.222+0000 7f4653a00700 1 --2- 172.21.15.49:0/3015316549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c0bca00 0x7f464c068050 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.222+0000 7f4653a00700 1 -- 172.21.15.49:0/3015316549 >> 172.21.15.49:0/3015316549 conn(0x7f464c0c3900 msgr2=0x7f464c0c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:36.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.222+0000 7f4653a00700 1 -- 172.21.15.49:0/3015316549 shutdown_connections 2024-01-22T05:09:36.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.222+0000 7f4653a00700 1 -- 172.21.15.49:0/3015316549 wait complete. 2024-01-22T05:09:36.245 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:09:36.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.402+0000 7f1961a00700 1 Processor -- start 2024-01-22T05:09:36.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.402+0000 7f1961a00700 1 -- start start 2024-01-22T05:09:36.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f1961a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f195c064470 0x7f195c069e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f1961a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f195c154ef0 0x7f195c0c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f1961a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c154320 con 0x7f195c154a90 2024-01-22T05:09:36.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f1961a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c154600 con 0x7f195c064470 2024-01-22T05:09:36.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f1961a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c0c3790 con 0x7f195c154ef0 2024-01-22T05:09:36.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f195b400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f195c154a90 0x7f195c0c5180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60450/0 (socket says 172.21.15.49:60450) 2024-01-22T05:09:36.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f195b400700 1 -- 172.21.15.49:0/680384187 learned_addr learned my addr 172.21.15.49:0/680384187 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:36.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f195be00700 1 --2- 172.21.15.49:0/680384187 >> v2:172.21.15.49:3300/0 conn(0x7f195c064470 0x7f195c069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f1961000700 1 --2- 172.21.15.49:0/680384187 >> v2:172.21.15.110:3300/0 conn(0x7f195c154ef0 0x7f195c0c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f195aa00700 1 -- 172.21.15.49:0/680384187 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114768263 0 0) 0x7f195c154320 con 0x7f195c154a90 2024-01-22T05:09:36.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f195aa00700 1 -- 172.21.15.49:0/680384187 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f193c0033f0 con 0x7f195c154a90 2024-01-22T05:09:36.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f195be00700 1 -- 172.21.15.49:0/680384187 >> v2:172.21.15.110:3300/0 conn(0x7f195c154ef0 msgr2=0x7f195c0c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:36.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f195be00700 1 --2- 172.21.15.49:0/680384187 >> v2:172.21.15.110:3300/0 conn(0x7f195c154ef0 0x7f195c0c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f195be00700 1 -- 172.21.15.49:0/680384187 >> v1:172.21.15.49:6789/0 conn(0x7f195c154a90 legacy=0x7f195c0c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f195be00700 1 -- 172.21.15.49:0/680384187 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c0c3a70 con 0x7f195c064470 2024-01-22T05:09:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.406+0000 7f195be00700 1 --2- 172.21.15.49:0/680384187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f195c064470 0x7f195c069e70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f195c0c1bb0 tx=0x7f194c009060).ready entity=mon.0 client_cookie=7ddfe275f39ba178 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.410+0000 7f195aa00700 1 -- 172.21.15.49:0/680384187 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c00d4a0 con 0x7f195c064470 2024-01-22T05:09:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.410+0000 7f195aa00700 1 -- 172.21.15.49:0/680384187 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c00d600 con 0x7f195c064470 2024-01-22T05:09:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.410+0000 7f195aa00700 1 -- 172.21.15.49:0/680384187 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c00d980 con 0x7f195c064470 2024-01-22T05:09:36.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.410+0000 7f1961a00700 1 -- 172.21.15.49:0/680384187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f195c064470 msgr2=0x7f195c069e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.410+0000 7f1961a00700 1 --2- 172.21.15.49:0/680384187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f195c064470 0x7f195c069e70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f195c0c1bb0 tx=0x7f194c009060).stop 2024-01-22T05:09:36.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.410+0000 7f1961a00700 1 -- 172.21.15.49:0/680384187 shutdown_connections 2024-01-22T05:09:36.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.410+0000 7f1961a00700 1 --2- 172.21.15.49:0/680384187 >> v2:172.21.15.110:3300/0 conn(0x7f195c154ef0 0x7f195c0c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.410+0000 7f1961a00700 1 --2- 172.21.15.49:0/680384187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f195c064470 0x7f195c069e70 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.410+0000 7f1961a00700 1 -- 172.21.15.49:0/680384187 >> 172.21.15.49:0/680384187 conn(0x7f195c062760 msgr2=0x7f195c062b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:36.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.410+0000 7f1961a00700 1 -- 172.21.15.49:0/680384187 shutdown_connections 2024-01-22T05:09:36.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.410+0000 7f1961a00700 1 -- 172.21.15.49:0/680384187 wait complete. 2024-01-22T05:09:36.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f1961a00700 1 Processor -- start 2024-01-22T05:09:36.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f1961a00700 1 -- start start 2024-01-22T05:09:36.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f1961a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f195c064470 0x7f195c0a9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f1961a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f195c154a90 0x7f195c0acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f1961a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f195c154ef0 0x7f195c0ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f1961a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0ad730 con 0x7f195c064470 2024-01-22T05:09:36.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f1961a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0c0000 con 0x7f195c154ef0 2024-01-22T05:09:36.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f1961a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0a9650 con 0x7f195c154a90 2024-01-22T05:09:36.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f195be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f195c064470 0x7f195c0a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f195be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f195c064470 0x7f195c0a9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51932/0 (socket says 172.21.15.49:51932) 2024-01-22T05:09:36.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f195be00700 1 -- 172.21.15.49:0/73213822 learned_addr learned my addr 172.21.15.49:0/73213822 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:36.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f1961000700 1 --2- 172.21.15.49:0/73213822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f195c154ef0 0x7f195c0ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f195b400700 1 --2- 172.21.15.49:0/73213822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f195c154a90 0x7f195c0acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f195be00700 1 -- 172.21.15.49:0/73213822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f195c154a90 msgr2=0x7f195c0acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f195be00700 1 --2- 172.21.15.49:0/73213822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f195c154a90 0x7f195c0acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f195be00700 1 -- 172.21.15.49:0/73213822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f195c154ef0 msgr2=0x7f195c0ad240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f195be00700 1 --2- 172.21.15.49:0/73213822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f195c154ef0 0x7f195c0ad240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f195be00700 1 -- 172.21.15.49:0/73213822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c0092a0 con 0x7f195c064470 2024-01-22T05:09:36.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.414+0000 7f195b400700 1 --2- 172.21.15.49:0/73213822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f195c154a90 0x7f195c0acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:36.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.418+0000 7f195be00700 1 --2- 172.21.15.49:0/73213822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f195c064470 0x7f195c0a9160 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f194c009fd0 tx=0x7f194c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:36.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.418+0000 7f1953400700 1 -- 172.21.15.49:0/73213822 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c000c90 con 0x7f195c064470 2024-01-22T05:09:36.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.418+0000 7f1953400700 1 -- 172.21.15.49:0/73213822 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c00d770 con 0x7f195c064470 2024-01-22T05:09:36.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.418+0000 7f1961a00700 1 -- 172.21.15.49:0/73213822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c0aa700 con 0x7f195c064470 2024-01-22T05:09:36.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.418+0000 7f1953400700 1 -- 172.21.15.49:0/73213822 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c01d430 con 0x7f195c064470 2024-01-22T05:09:36.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.418+0000 7f1961a00700 1 -- 172.21.15.49:0/73213822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c0aacc0 con 0x7f195c064470 2024-01-22T05:09:36.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.418+0000 7f1961a00700 1 -- 172.21.15.49:0/73213822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c0656d0 con 0x7f195c064470 2024-01-22T05:09:36.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.418+0000 7f1953400700 1 -- 172.21.15.49:0/73213822 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f194c01d7e0 con 0x7f195c064470 2024-01-22T05:09:36.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.422+0000 7f1953400700 1 --2- 172.21.15.49:0/73213822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f193405a510 0x7f193405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.422+0000 7f1953400700 1 -- 172.21.15.49:0/73213822 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f194c076150 con 0x7f195c064470 2024-01-22T05:09:36.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.422+0000 7f195b400700 1 --2- 172.21.15.49:0/73213822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f193405a510 0x7f193405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.422+0000 7f195b400700 1 --2- 172.21.15.49:0/73213822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f193405a510 0x7f193405c9d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f1944007fd0 tx=0x7f1944009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:36.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.430+0000 7f1953400700 1 -- 172.21.15.49:0/73213822 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f194c0496e0 con 0x7f195c064470 2024-01-22T05:09:36.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.590+0000 7f1961a00700 1 -- 172.21.15.49:0/73213822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f195c0c3d50 con 0x7f195c064470 2024-01-22T05:09:36.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.590+0000 7f1953400700 1 -- 172.21.15.49:0/73213822 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v76) v1 ==== 92+0+10 (secure 0 0 0) 0x7f194c04cd00 con 0x7f195c064470 2024-01-22T05:09:36.596 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:09:36.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.594+0000 7f1961a00700 1 -- 172.21.15.49:0/73213822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f193405a510 msgr2=0x7f193405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.594+0000 7f1961a00700 1 --2- 172.21.15.49:0/73213822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f193405a510 0x7f193405c9d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f1944007fd0 tx=0x7f1944009040).stop 2024-01-22T05:09:36.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.594+0000 7f1961a00700 1 -- 172.21.15.49:0/73213822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f195c064470 msgr2=0x7f195c0a9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.594+0000 7f1961a00700 1 --2- 172.21.15.49:0/73213822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f195c064470 0x7f195c0a9160 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f194c009fd0 tx=0x7f194c016000).stop 2024-01-22T05:09:36.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.594+0000 7f1961a00700 1 -- 172.21.15.49:0/73213822 shutdown_connections 2024-01-22T05:09:36.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.594+0000 7f1961a00700 1 --2- 172.21.15.49:0/73213822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f193405a510 0x7f193405c9d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.594+0000 7f1961a00700 1 --2- 172.21.15.49:0/73213822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f195c154ef0 0x7f195c0ad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.594+0000 7f1961a00700 1 --2- 172.21.15.49:0/73213822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f195c154a90 0x7f195c0acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.594+0000 7f1961a00700 1 --2- 172.21.15.49:0/73213822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f195c064470 0x7f195c0a9160 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.594+0000 7f1961a00700 1 -- 172.21.15.49:0/73213822 >> 172.21.15.49:0/73213822 conn(0x7f195c062760 msgr2=0x7f195c0bc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:36.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.594+0000 7f1961a00700 1 -- 172.21.15.49:0/73213822 shutdown_connections 2024-01-22T05:09:36.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.594+0000 7f1961a00700 1 -- 172.21.15.49:0/73213822 wait complete. 2024-01-22T05:09:36.622 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:09:36.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.778+0000 7f759b600700 1 Processor -- start 2024-01-22T05:09:36.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.778+0000 7f759b600700 1 -- start start 2024-01-22T05:09:36.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.782+0000 7f759b600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75940a6da0 0x7f759406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.782+0000 7f759b600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75940c6920 0x7f75940c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f759b600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75940ab5a0 con 0x7f75940ac780 2024-01-22T05:09:36.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f759b600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75940bd7a0 con 0x7f75940c6920 2024-01-22T05:09:36.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f759b600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75940c7250 con 0x7f75940a6da0 2024-01-22T05:09:36.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f7593e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75940c6920 0x7f75940c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f7593e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75940c6920 0x7f75940c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51948/0 (socket says 172.21.15.49:51948) 2024-01-22T05:09:36.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f7593e00700 1 -- 172.21.15.49:0/158887269 learned_addr learned my addr 172.21.15.49:0/158887269 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:36.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f7598c00700 1 --2- 172.21.15.49:0/158887269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75940a6da0 0x7f759406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f7593e00700 1 -- 172.21.15.49:0/158887269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75940a6da0 msgr2=0x7f759406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:36.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f7593e00700 1 --2- 172.21.15.49:0/158887269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75940a6da0 0x7f759406a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f7593e00700 1 -- 172.21.15.49:0/158887269 >> v1:172.21.15.110:6789/0 conn(0x7f75940ac780 legacy=0x7f75940acc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f7593e00700 1 -- 172.21.15.49:0/158887269 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75940bcb90 con 0x7f75940c6920 2024-01-22T05:09:36.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f7598c00700 1 --2- 172.21.15.49:0/158887269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75940a6da0 0x7f759406a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:09:36.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f7593e00700 1 --2- 172.21.15.49:0/158887269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75940c6920 0x7f75940c6d60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f757c006fd0 tx=0x7f757c0090f0).ready entity=mon.0 client_cookie=bc36bd12ea962ebe server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:36.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f7593400700 1 -- 172.21.15.49:0/158887269 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c00b690 con 0x7f75940c6920 2024-01-22T05:09:36.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f7593400700 1 -- 172.21.15.49:0/158887269 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c00b7f0 con 0x7f75940c6920 2024-01-22T05:09:36.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f7593400700 1 -- 172.21.15.49:0/158887269 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c00bb70 con 0x7f75940c6920 2024-01-22T05:09:36.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f759b600700 1 -- 172.21.15.49:0/158887269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75940c6920 msgr2=0x7f75940c6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f759b600700 1 --2- 172.21.15.49:0/158887269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75940c6920 0x7f75940c6d60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f757c006fd0 tx=0x7f757c0090f0).stop 2024-01-22T05:09:36.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f759b600700 1 -- 172.21.15.49:0/158887269 shutdown_connections 2024-01-22T05:09:36.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f759b600700 1 --2- 172.21.15.49:0/158887269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75940c6920 0x7f75940c6d60 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f759b600700 1 --2- 172.21.15.49:0/158887269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75940a6da0 0x7f759406a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.786+0000 7f759b600700 1 -- 172.21.15.49:0/158887269 >> 172.21.15.49:0/158887269 conn(0x7f75940aa730 msgr2=0x7f75940aab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:36.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.790+0000 7f759b600700 1 -- 172.21.15.49:0/158887269 shutdown_connections 2024-01-22T05:09:36.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.790+0000 7f759b600700 1 -- 172.21.15.49:0/158887269 wait complete. 2024-01-22T05:09:36.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.790+0000 7f759b600700 1 Processor -- start 2024-01-22T05:09:36.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.790+0000 7f759b600700 1 -- start start 2024-01-22T05:09:36.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f759b600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75940ac780 0x7f75940bf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f759b600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75940c6920 0x7f7594163c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f759b600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7594151e80 0x7f75940c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f759b600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75940a8590 con 0x7f75940ac780 2024-01-22T05:09:36.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f759b600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75940a8810 con 0x7f7594151e80 2024-01-22T05:09:36.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f759b600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7594164410 con 0x7f75940c6920 2024-01-22T05:09:36.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f7598c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75940ac780 0x7f75940bf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f7598c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75940ac780 0x7f75940bf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51960/0 (socket says 172.21.15.49:51960) 2024-01-22T05:09:36.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f7598c00700 1 -- 172.21.15.49:0/2855785168 learned_addr learned my addr 172.21.15.49:0/2855785168 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:36.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f7593e00700 1 --2- 172.21.15.49:0/2855785168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75940c6920 0x7f7594163c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f7599600700 1 --2- 172.21.15.49:0/2855785168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7594151e80 0x7f75940c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f7598c00700 1 -- 172.21.15.49:0/2855785168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75940c6920 msgr2=0x7f7594163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f7598c00700 1 --2- 172.21.15.49:0/2855785168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75940c6920 0x7f7594163c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f7598c00700 1 -- 172.21.15.49:0/2855785168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7594151e80 msgr2=0x7f75940c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f7598c00700 1 --2- 172.21.15.49:0/2855785168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7594151e80 0x7f75940c0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f7598c00700 1 -- 172.21.15.49:0/2855785168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c009370 con 0x7f75940ac780 2024-01-22T05:09:36.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f7598c00700 1 --2- 172.21.15.49:0/2855785168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75940ac780 0x7f75940bf510 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f758400c880 tx=0x7f7584008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:36.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f758be00700 1 -- 172.21.15.49:0/2855785168 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584010580 con 0x7f75940ac780 2024-01-22T05:09:36.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f758be00700 1 -- 172.21.15.49:0/2855785168 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75840106e0 con 0x7f75940ac780 2024-01-22T05:09:36.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f758be00700 1 -- 172.21.15.49:0/2855785168 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584010a60 con 0x7f75940ac780 2024-01-22T05:09:36.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f759b600700 1 -- 172.21.15.49:0/2855785168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75941646f0 con 0x7f75940ac780 2024-01-22T05:09:36.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.794+0000 7f759b600700 1 -- 172.21.15.49:0/2855785168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7594164120 con 0x7f75940ac780 2024-01-22T05:09:36.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.798+0000 7f759b600700 1 -- 172.21.15.49:0/2855785168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7594064990 con 0x7f75940ac780 2024-01-22T05:09:36.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.798+0000 7f758be00700 1 -- 172.21.15.49:0/2855785168 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f758401b460 con 0x7f75940ac780 2024-01-22T05:09:36.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.802+0000 7f758be00700 1 --2- 172.21.15.49:0/2855785168 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f756c05a510 0x7f756c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:36.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.802+0000 7f758be00700 1 -- 172.21.15.49:0/2855785168 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f75840749d0 con 0x7f75940ac780 2024-01-22T05:09:36.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.802+0000 7f7593e00700 1 --2- 172.21.15.49:0/2855785168 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f756c05a510 0x7f756c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:36.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.802+0000 7f7593e00700 1 --2- 172.21.15.49:0/2855785168 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f756c05a510 0x7f756c05c9d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f757c006fd0 tx=0x7f757c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:36.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.806+0000 7f758be00700 1 -- 172.21.15.49:0/2855785168 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7584047e80 con 0x7f75940ac780 2024-01-22T05:09:36.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.970+0000 7f759b600700 1 -- 172.21.15.49:0/2855785168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75940bce70 con 0x7f75940ac780 2024-01-22T05:09:36.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.970+0000 7f758be00700 1 -- 172.21.15.49:0/2855785168 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7f758404b4a0 con 0x7f75940ac780 2024-01-22T05:09:36.974 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:09:36.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.974+0000 7f759b600700 1 -- 172.21.15.49:0/2855785168 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f756c05a510 msgr2=0x7f756c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.974+0000 7f759b600700 1 --2- 172.21.15.49:0/2855785168 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f756c05a510 0x7f756c05c9d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f757c006fd0 tx=0x7f757c017000).stop 2024-01-22T05:09:36.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.974+0000 7f759b600700 1 -- 172.21.15.49:0/2855785168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75940ac780 msgr2=0x7f75940bf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:36.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.974+0000 7f759b600700 1 --2- 172.21.15.49:0/2855785168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75940ac780 0x7f75940bf510 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f758400c880 tx=0x7f7584008040).stop 2024-01-22T05:09:36.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.974+0000 7f759b600700 1 -- 172.21.15.49:0/2855785168 shutdown_connections 2024-01-22T05:09:36.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.974+0000 7f759b600700 1 --2- 172.21.15.49:0/2855785168 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f756c05a510 0x7f756c05c9d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.974+0000 7f759b600700 1 --2- 172.21.15.49:0/2855785168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7594151e80 0x7f75940c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.974+0000 7f759b600700 1 --2- 172.21.15.49:0/2855785168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75940c6920 0x7f7594163c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.974+0000 7f759b600700 1 --2- 172.21.15.49:0/2855785168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75940ac780 0x7f75940bf510 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:36.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.974+0000 7f759b600700 1 -- 172.21.15.49:0/2855785168 >> 172.21.15.49:0/2855785168 conn(0x7f75940aa730 msgr2=0x7f7594063160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:36.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.978+0000 7f759b600700 1 -- 172.21.15.49:0/2855785168 shutdown_connections 2024-01-22T05:09:36.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:36.978+0000 7f759b600700 1 -- 172.21.15.49:0/2855785168 wait complete. 2024-01-22T05:09:37.005 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:09:37.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.166+0000 7f1aca200700 1 Processor -- start 2024-01-22T05:09:37.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.166+0000 7f1aca200700 1 -- start start 2024-01-22T05:09:37.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.170+0000 7f1aca200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ac4063d80 0x7f1ac40641a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.170+0000 7f1aca200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac40a6f80 con 0x7f1ac4154470 2024-01-22T05:09:37.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.170+0000 7f1aca200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac40c3c00 con 0x7f1ac4069f50 2024-01-22T05:09:37.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.170+0000 7f1aca200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac4150de0 con 0x7f1ac4063d80 2024-01-22T05:09:37.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.170+0000 7f1ac9800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1ac4154470 0x7f1ac4154900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60464/0 (socket says 172.21.15.49:60464) 2024-01-22T05:09:37.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.170+0000 7f1ac9800700 1 -- 172.21.15.49:0/1972215219 learned_addr learned my addr 172.21.15.49:0/1972215219 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:37.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.170+0000 7f1ac3e00700 1 --2- 172.21.15.49:0/1972215219 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ac4063d80 0x7f1ac40641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.170+0000 7f1ac3400700 1 -- 172.21.15.49:0/1972215219 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522845778 0 0) 0x7f1abc001490 con 0x7f1ac4154470 2024-01-22T05:09:37.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.170+0000 7f1ac3400700 1 -- 172.21.15.49:0/1972215219 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa40033f0 con 0x7f1ac4154470 2024-01-22T05:09:37.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.170+0000 7f1ac3400700 1 -- 172.21.15.49:0/1972215219 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271914591 0 0) 0x7f1ac40c3c00 con 0x7f1ac4069f50 2024-01-22T05:09:37.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.170+0000 7f1ac3e00700 1 -- 172.21.15.49:0/1972215219 >> v1:172.21.15.110:6789/0 conn(0x7f1ac4069f50 legacy=0x7f1ac41506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.170+0000 7f1ac3e00700 1 -- 172.21.15.49:0/1972215219 >> v1:172.21.15.49:6789/0 conn(0x7f1ac4154470 legacy=0x7f1ac4154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.170+0000 7f1ac3e00700 1 -- 172.21.15.49:0/1972215219 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac40c3310 con 0x7f1ac4063d80 2024-01-22T05:09:37.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.174+0000 7f1ac3e00700 1 --2- 172.21.15.49:0/1972215219 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ac4063d80 0x7f1ac40641a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f1aac009790 tx=0x7f1aac009060).ready entity=mon.2 client_cookie=ee18d82c89d108ba server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:37.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.174+0000 7f1ac3400700 1 -- 172.21.15.49:0/1972215219 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac00f510 con 0x7f1ac4063d80 2024-01-22T05:09:37.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.174+0000 7f1ac3400700 1 -- 172.21.15.49:0/1972215219 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac00f670 con 0x7f1ac4063d80 2024-01-22T05:09:37.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.174+0000 7f1ac3400700 1 -- 172.21.15.49:0/1972215219 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac00f9f0 con 0x7f1ac4063d80 2024-01-22T05:09:37.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.174+0000 7f1aca200700 1 -- 172.21.15.49:0/1972215219 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ac4063d80 msgr2=0x7f1ac40641a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.174+0000 7f1aca200700 1 --2- 172.21.15.49:0/1972215219 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ac4063d80 0x7f1ac40641a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f1aac009790 tx=0x7f1aac009060).stop 2024-01-22T05:09:37.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.174+0000 7f1aca200700 1 -- 172.21.15.49:0/1972215219 shutdown_connections 2024-01-22T05:09:37.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.174+0000 7f1aca200700 1 --2- 172.21.15.49:0/1972215219 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ac4063d80 0x7f1ac40641a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.174+0000 7f1aca200700 1 -- 172.21.15.49:0/1972215219 >> 172.21.15.49:0/1972215219 conn(0x7f1ac40c40e0 msgr2=0x7f1ac40c44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:37.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.174+0000 7f1aca200700 1 -- 172.21.15.49:0/1972215219 shutdown_connections 2024-01-22T05:09:37.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.174+0000 7f1aca200700 1 -- 172.21.15.49:0/1972215219 wait complete. 2024-01-22T05:09:37.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.178+0000 7f1aca200700 1 Processor -- start 2024-01-22T05:09:37.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.178+0000 7f1aca200700 1 -- start start 2024-01-22T05:09:37.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1aca200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac4063d80 0x7f1ac414b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1aca200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ac4069f50 0x7f1ac40bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1aca200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ac4154470 0x7f1ac40bffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1aca200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac40c04b0 con 0x7f1ac4063d80 2024-01-22T05:09:37.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1aca200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac40aaf20 con 0x7f1ac4069f50 2024-01-22T05:09:37.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1aca200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac40bf720 con 0x7f1ac4154470 2024-01-22T05:09:37.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1ac8e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac4063d80 0x7f1ac414b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1ac8e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac4063d80 0x7f1ac414b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51964/0 (socket says 172.21.15.49:51964) 2024-01-22T05:09:37.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1ac8e00700 1 -- 172.21.15.49:0/3080328644 learned_addr learned my addr 172.21.15.49:0/3080328644 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:37.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1ac3e00700 1 --2- 172.21.15.49:0/3080328644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ac4069f50 0x7f1ac40bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1ac9800700 1 --2- 172.21.15.49:0/3080328644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ac4154470 0x7f1ac40bffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1ac8e00700 1 -- 172.21.15.49:0/3080328644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ac4154470 msgr2=0x7f1ac40bffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1ac8e00700 1 --2- 172.21.15.49:0/3080328644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ac4154470 0x7f1ac40bffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1ac8e00700 1 -- 172.21.15.49:0/3080328644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ac4069f50 msgr2=0x7f1ac40bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1ac8e00700 1 --2- 172.21.15.49:0/3080328644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ac4069f50 0x7f1ac40bfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1ac8e00700 1 -- 172.21.15.49:0/3080328644 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac0092a0 con 0x7f1ac4063d80 2024-01-22T05:09:37.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1ac9800700 1 --2- 172.21.15.49:0/3080328644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ac4154470 0x7f1ac40bffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:37.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1ac8e00700 1 --2- 172.21.15.49:0/3080328644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac4063d80 0x7f1ac414b790 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f1ab4001eb0 tx=0x7f1ab4007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:37.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1abbe00700 1 -- 172.21.15.49:0/3080328644 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab400f470 con 0x7f1ac4063d80 2024-01-22T05:09:37.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1abbe00700 1 -- 172.21.15.49:0/3080328644 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab400f5f0 con 0x7f1ac4063d80 2024-01-22T05:09:37.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1aca200700 1 -- 172.21.15.49:0/3080328644 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac40aa5f0 con 0x7f1ac4063d80 2024-01-22T05:09:37.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1abbe00700 1 -- 172.21.15.49:0/3080328644 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab400f9b0 con 0x7f1ac4063d80 2024-01-22T05:09:37.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.182+0000 7f1aca200700 1 -- 172.21.15.49:0/3080328644 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac40aabb0 con 0x7f1ac4063d80 2024-01-22T05:09:37.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.186+0000 7f1aca200700 1 -- 172.21.15.49:0/3080328644 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac4046800 con 0x7f1ac4063d80 2024-01-22T05:09:37.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.186+0000 7f1abbe00700 1 -- 172.21.15.49:0/3080328644 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1ab400fd20 con 0x7f1ac4063d80 2024-01-22T05:09:37.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.186+0000 7f1abbe00700 1 --2- 172.21.15.49:0/3080328644 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a9c05a510 0x7f1a9c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.186+0000 7f1abbe00700 1 -- 172.21.15.49:0/3080328644 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f1ab4074080 con 0x7f1ac4063d80 2024-01-22T05:09:37.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.186+0000 7f1ac3e00700 1 --2- 172.21.15.49:0/3080328644 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a9c05a510 0x7f1a9c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.190+0000 7f1ac3e00700 1 --2- 172.21.15.49:0/3080328644 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a9c05a510 0x7f1a9c05c9d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f1aac0096e0 tx=0x7f1aac017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:37.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.194+0000 7f1abbe00700 1 -- 172.21.15.49:0/3080328644 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1ab4047590 con 0x7f1ac4063d80 2024-01-22T05:09:37.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.366+0000 7f1aca200700 1 -- 172.21.15.49:0/3080328644 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ac4064dd0 con 0x7f1ac4063d80 2024-01-22T05:09:37.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.366+0000 7f1abbe00700 1 -- 172.21.15.49:0/3080328644 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1ab404abb0 con 0x7f1ac4063d80 2024-01-22T05:09:37.372 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:09:37.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.370+0000 7f1aca200700 1 -- 172.21.15.49:0/3080328644 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a9c05a510 msgr2=0x7f1a9c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.370+0000 7f1aca200700 1 --2- 172.21.15.49:0/3080328644 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a9c05a510 0x7f1a9c05c9d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f1aac0096e0 tx=0x7f1aac017000).stop 2024-01-22T05:09:37.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.370+0000 7f1aca200700 1 -- 172.21.15.49:0/3080328644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac4063d80 msgr2=0x7f1ac414b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.370+0000 7f1aca200700 1 --2- 172.21.15.49:0/3080328644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac4063d80 0x7f1ac414b790 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f1ab4001eb0 tx=0x7f1ab4007c70).stop 2024-01-22T05:09:37.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.370+0000 7f1aca200700 1 -- 172.21.15.49:0/3080328644 shutdown_connections 2024-01-22T05:09:37.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.370+0000 7f1aca200700 1 --2- 172.21.15.49:0/3080328644 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a9c05a510 0x7f1a9c05c9d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.370+0000 7f1aca200700 1 --2- 172.21.15.49:0/3080328644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ac4154470 0x7f1ac40bffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.370+0000 7f1aca200700 1 --2- 172.21.15.49:0/3080328644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ac4069f50 0x7f1ac40bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.370+0000 7f1aca200700 1 --2- 172.21.15.49:0/3080328644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ac4063d80 0x7f1ac414b790 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.370+0000 7f1aca200700 1 -- 172.21.15.49:0/3080328644 >> 172.21.15.49:0/3080328644 conn(0x7f1ac40c40e0 msgr2=0x7f1ac4067df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:37.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.374+0000 7f1aca200700 1 -- 172.21.15.49:0/3080328644 shutdown_connections 2024-01-22T05:09:37.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.374+0000 7f1aca200700 1 -- 172.21.15.49:0/3080328644 wait complete. 2024-01-22T05:09:37.399 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:09:37.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.550+0000 7f3309400700 1 Processor -- start 2024-01-22T05:09:37.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.554+0000 7f3309400700 1 -- start start 2024-01-22T05:09:37.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3309400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3304068aa0 0x7f3304068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3309400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f33040bbf10 0x7f33040bc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3309400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33040c3240 con 0x7f3304062c40 2024-01-22T05:09:37.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3309400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33040c36d0 con 0x7f33040bbf10 2024-01-22T05:09:37.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3309400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33041503b0 con 0x7f3304068aa0 2024-01-22T05:09:37.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3303e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3304062c40 0x7f330414fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60478/0 (socket says 172.21.15.49:60478) 2024-01-22T05:09:37.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3303e00700 1 -- 172.21.15.49:0/1435101468 learned_addr learned my addr 172.21.15.49:0/1435101468 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:37.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3303400700 1 --2- 172.21.15.49:0/1435101468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3304068aa0 0x7f3304068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3308a00700 1 --2- 172.21.15.49:0/1435101468 >> v2:172.21.15.110:3300/0 conn(0x7f33040bbf10 0x7f33040bc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 -- 172.21.15.49:0/1435101468 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242878706 0 0) 0x7f33040c3240 con 0x7f3304062c40 2024-01-22T05:09:37.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 -- 172.21.15.49:0/1435101468 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e40033f0 con 0x7f3304062c40 2024-01-22T05:09:37.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 -- 172.21.15.49:0/1435101468 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3788279641 0 0) 0x7f32e40033f0 con 0x7f3304062c40 2024-01-22T05:09:37.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 -- 172.21.15.49:0/1435101468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3304068aa0 msgr2=0x7f3304068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:37.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 --2- 172.21.15.49:0/1435101468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3304068aa0 0x7f3304068ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 -- 172.21.15.49:0/1435101468 >> v2:172.21.15.110:3300/0 conn(0x7f33040bbf10 msgr2=0x7f33040bc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 --2- 172.21.15.49:0/1435101468 >> v2:172.21.15.110:3300/0 conn(0x7f33040bbf10 0x7f33040bc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 -- 172.21.15.49:0/1435101468 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33040693d0 con 0x7f3304062c40 2024-01-22T05:09:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 -- 172.21.15.49:0/1435101468 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f32f4001470 con 0x7f3304062c40 2024-01-22T05:09:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 -- 172.21.15.49:0/1435101468 >> v1:172.21.15.49:6789/0 conn(0x7f3304062c40 legacy=0x7f330414fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 --2- 172.21.15.49:0/1435101468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32e40038e0 0x7f32e4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 --2- 172.21.15.49:0/1435101468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e4004690 0x7f32e4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 --2- 172.21.15.49:0/1435101468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3304068aa0 0x7f32e4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 -- 172.21.15.49:0/1435101468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33041503b0 con 0x7f32e4004690 2024-01-22T05:09:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 -- 172.21.15.49:0/1435101468 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e40044b0 con 0x7f32e40038e0 2024-01-22T05:09:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3302a00700 1 -- 172.21.15.49:0/1435101468 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e400b910 con 0x7f3304068aa0 2024-01-22T05:09:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3303e00700 1 --2- 172.21.15.49:0/1435101468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32e40038e0 0x7f32e4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.558+0000 7f3303400700 1 --2- 172.21.15.49:0/1435101468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e4004690 0x7f32e4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3308a00700 1 --2- 172.21.15.49:0/1435101468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3304068aa0 0x7f32e4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3303e00700 1 -- 172.21.15.49:0/1435101468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3304068aa0 msgr2=0x7f32e4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:37.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3303e00700 1 --2- 172.21.15.49:0/1435101468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3304068aa0 0x7f32e4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3303e00700 1 -- 172.21.15.49:0/1435101468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e4004690 msgr2=0x7f32e4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:37.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3303e00700 1 --2- 172.21.15.49:0/1435101468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e4004690 0x7f32e4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3303e00700 1 -- 172.21.15.49:0/1435101468 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e40033f0 con 0x7f32e40038e0 2024-01-22T05:09:37.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3303e00700 1 --2- 172.21.15.49:0/1435101468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32e40038e0 0x7f32e4003d00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f32f400c210 tx=0x7f32f4001e90).ready entity=mon.1 client_cookie=a4aba85c70c8b657 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:37.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3302a00700 1 -- 172.21.15.49:0/1435101468 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4007a60 con 0x7f32e40038e0 2024-01-22T05:09:37.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3302a00700 1 -- 172.21.15.49:0/1435101468 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f400cae0 con 0x7f32e40038e0 2024-01-22T05:09:37.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3302a00700 1 -- 172.21.15.49:0/1435101468 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f400ce80 con 0x7f32e40038e0 2024-01-22T05:09:37.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3309400700 1 -- 172.21.15.49:0/1435101468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32e40038e0 msgr2=0x7f32e4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3309400700 1 --2- 172.21.15.49:0/1435101468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32e40038e0 0x7f32e4003d00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f32f400c210 tx=0x7f32f4001e90).stop 2024-01-22T05:09:37.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3308a00700 1 -- 172.21.15.49:0/1435101468 reap_dead start 2024-01-22T05:09:37.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3309400700 1 -- 172.21.15.49:0/1435101468 shutdown_connections 2024-01-22T05:09:37.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3309400700 1 -- 172.21.15.49:0/1435101468 >> 172.21.15.49:0/1435101468 conn(0x7f33040c42a0 msgr2=0x7f3304065f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:37.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3309400700 1 -- 172.21.15.49:0/1435101468 shutdown_connections 2024-01-22T05:09:37.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.562+0000 7f3309400700 1 -- 172.21.15.49:0/1435101468 wait complete. 2024-01-22T05:09:37.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.566+0000 7f3309400700 1 Processor -- start 2024-01-22T05:09:37.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3309400700 1 -- start start 2024-01-22T05:09:37.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3309400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e40038e0 0x7f33040ab640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3309400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33041416a0 0x7f3304141b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3309400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3304146550 0x7f33041469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3309400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33040abb30 con 0x7f32e40038e0 2024-01-22T05:09:37.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3309400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3304165000 con 0x7f33041416a0 2024-01-22T05:09:37.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3309400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3304146ec0 con 0x7f3304146550 2024-01-22T05:09:37.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3303e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e40038e0 0x7f33040ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3303e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e40038e0 0x7f33040ab640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51972/0 (socket says 172.21.15.49:51972) 2024-01-22T05:09:37.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3303e00700 1 -- 172.21.15.49:0/2813756065 learned_addr learned my addr 172.21.15.49:0/2813756065 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:37.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3308a00700 1 --2- 172.21.15.49:0/2813756065 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3304146550 0x7f33041469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3303400700 1 --2- 172.21.15.49:0/2813756065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33041416a0 0x7f3304141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3303e00700 1 -- 172.21.15.49:0/2813756065 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3304146550 msgr2=0x7f33041469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3303e00700 1 --2- 172.21.15.49:0/2813756065 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3304146550 0x7f33041469d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3303e00700 1 -- 172.21.15.49:0/2813756065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33041416a0 msgr2=0x7f3304141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3303e00700 1 --2- 172.21.15.49:0/2813756065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33041416a0 0x7f3304141b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3303e00700 1 -- 172.21.15.49:0/2813756065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33041643f0 con 0x7f32e40038e0 2024-01-22T05:09:37.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3303400700 1 --2- 172.21.15.49:0/2813756065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33041416a0 0x7f3304141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:37.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.570+0000 7f3303e00700 1 --2- 172.21.15.49:0/2813756065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e40038e0 0x7f33040ab640 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f32e400b8e0 tx=0x7f32f4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:37.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.574+0000 7f32fb400700 1 -- 172.21.15.49:0/2813756065 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4000d00 con 0x7f32e40038e0 2024-01-22T05:09:37.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.574+0000 7f32fb400700 1 -- 172.21.15.49:0/2813756065 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f4018070 con 0x7f32e40038e0 2024-01-22T05:09:37.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.574+0000 7f32fb400700 1 -- 172.21.15.49:0/2813756065 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4007720 con 0x7f32e40038e0 2024-01-22T05:09:37.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.574+0000 7f3309400700 1 -- 172.21.15.49:0/2813756065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33041646d0 con 0x7f32e40038e0 2024-01-22T05:09:37.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.574+0000 7f3309400700 1 -- 172.21.15.49:0/2813756065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3304164c90 con 0x7f32e40038e0 2024-01-22T05:09:37.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.574+0000 7f3309400700 1 -- 172.21.15.49:0/2813756065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33040c46b0 con 0x7f32e40038e0 2024-01-22T05:09:37.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.574+0000 7f32fb400700 1 -- 172.21.15.49:0/2813756065 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f32f40048c0 con 0x7f32e40038e0 2024-01-22T05:09:37.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.578+0000 7f32fb400700 1 --2- 172.21.15.49:0/2813756065 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f32dc05a510 0x7f32dc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.578+0000 7f32fb400700 1 -- 172.21.15.49:0/2813756065 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f32f4075bb0 con 0x7f32e40038e0 2024-01-22T05:09:37.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.578+0000 7f3303400700 1 --2- 172.21.15.49:0/2813756065 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f32dc05a510 0x7f32dc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.578+0000 7f3303400700 1 --2- 172.21.15.49:0/2813756065 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f32dc05a510 0x7f32dc05c9d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f33040c12a0 tx=0x7f32ec008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:37.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.582+0000 7f32fb400700 1 -- 172.21.15.49:0/2813756065 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f32f4049130 con 0x7f32e40038e0 2024-01-22T05:09:37.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.782+0000 7f3309400700 1 -- 172.21.15.49:0/2813756065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33040c46b0 con 0x7f32e40038e0 2024-01-22T05:09:37.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.782+0000 7f32fb400700 1 -- 172.21.15.49:0/2813756065 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4498 (secure 0 0 0) 0x7f32f404c750 con 0x7f32e40038e0 2024-01-22T05:09:37.788 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:37.788 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":62,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4087795616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4087795616},{"type":"v1","addr":"172.21.15.110:6833","nonce":4087795616}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3220435249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3220435249},{"type":"v1","addr":"172.21.15.110:6835","nonce":3220435249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3927178750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3927178750},{"type":"v1","addr":"172.21.15.49:6835","nonce":3927178750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:09:03.929962+0000","modified":"2024-01-22T05:09:22.494561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6609},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6609":{"gid":6609,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/2814482810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2814482810},{"type":"v1","addr":"172.21.15.49:6837","nonce":2814482810}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-22T05:09:37.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.786+0000 7f3309400700 1 -- 172.21.15.49:0/2813756065 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f32dc05a510 msgr2=0x7f32dc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.786+0000 7f3309400700 1 --2- 172.21.15.49:0/2813756065 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f32dc05a510 0x7f32dc05c9d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f33040c12a0 tx=0x7f32ec008040).stop 2024-01-22T05:09:37.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.786+0000 7f3309400700 1 -- 172.21.15.49:0/2813756065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e40038e0 msgr2=0x7f33040ab640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.786+0000 7f3309400700 1 --2- 172.21.15.49:0/2813756065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e40038e0 0x7f33040ab640 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f32e400b8e0 tx=0x7f32f4015000).stop 2024-01-22T05:09:37.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.786+0000 7f3309400700 1 -- 172.21.15.49:0/2813756065 shutdown_connections 2024-01-22T05:09:37.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.786+0000 7f3309400700 1 --2- 172.21.15.49:0/2813756065 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f32dc05a510 0x7f32dc05c9d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.786+0000 7f3309400700 1 --2- 172.21.15.49:0/2813756065 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3304146550 0x7f33041469d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.786+0000 7f3309400700 1 --2- 172.21.15.49:0/2813756065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33041416a0 0x7f3304141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.786+0000 7f3309400700 1 --2- 172.21.15.49:0/2813756065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32e40038e0 0x7f33040ab640 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.786+0000 7f3309400700 1 -- 172.21.15.49:0/2813756065 >> 172.21.15.49:0/2813756065 conn(0x7f33040c42a0 msgr2=0x7f33040c5510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:37.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.786+0000 7f3309400700 1 -- 172.21.15.49:0/2813756065 shutdown_connections 2024-01-22T05:09:37.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.786+0000 7f3309400700 1 -- 172.21.15.49:0/2813756065 wait complete. 2024-01-22T05:09:37.794 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 62 2024-01-22T05:09:37.812 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:09:37.870 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:09:37.876 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:09:37.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.974+0000 7fa03be00700 1 Processor -- start 2024-01-22T05:09:37.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.974+0000 7fa03be00700 1 -- start start 2024-01-22T05:09:37.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.978+0000 7fa03be00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0340bd7d0 0x7fa03414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.978+0000 7fa03be00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa034154680 con 0x7fa034153e30 2024-01-22T05:09:37.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.978+0000 7fa03be00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa034154960 con 0x7fa0340bd340 2024-01-22T05:09:37.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.978+0000 7fa03be00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa034154c40 con 0x7fa0340bd7d0 2024-01-22T05:09:37.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.978+0000 7fa039400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa034153e30 0x7fa0340a90e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60492/0 (socket says 172.21.15.49:60492) 2024-01-22T05:09:37.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.978+0000 7fa039400700 1 -- 172.21.15.49:0/3075696432 learned_addr learned my addr 172.21.15.49:0/3075696432 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:37.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.978+0000 7fa039e00700 1 --2- 172.21.15.49:0/3075696432 >> v2:172.21.15.110:3300/0 conn(0x7fa0340bd7d0 0x7fa03414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.978+0000 7fa033e00700 1 -- 172.21.15.49:0/3075696432 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639472701 0 0) 0x7fa034154680 con 0x7fa034153e30 2024-01-22T05:09:37.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.978+0000 7fa033e00700 1 -- 172.21.15.49:0/3075696432 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0140033f0 con 0x7fa034153e30 2024-01-22T05:09:37.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.978+0000 7fa033e00700 1 -- 172.21.15.49:0/3075696432 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2782801547 0 0) 0x7fa0140033f0 con 0x7fa034153e30 2024-01-22T05:09:37.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.978+0000 7fa033e00700 1 -- 172.21.15.49:0/3075696432 >> v2:172.21.15.110:3300/0 conn(0x7fa0340bd7d0 msgr2=0x7fa03414fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:37.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.978+0000 7fa033e00700 1 --2- 172.21.15.49:0/3075696432 >> v2:172.21.15.110:3300/0 conn(0x7fa0340bd7d0 0x7fa03414fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.978+0000 7fa033e00700 1 -- 172.21.15.49:0/3075696432 >> v1:172.21.15.110:6789/0 conn(0x7fa0340bd340 legacy=0x7fa034062230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa033e00700 1 -- 172.21.15.49:0/3075696432 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0340bce20 con 0x7fa034153e30 2024-01-22T05:09:37.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa033e00700 1 -- 172.21.15.49:0/3075696432 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fa024001470 con 0x7fa034153e30 2024-01-22T05:09:37.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa039e00700 1 --2- 172.21.15.49:0/3075696432 >> v2:172.21.15.110:3300/0 conn(0x7fa0340bd7d0 0x7fa03414fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:37.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa033e00700 1 -- 172.21.15.49:0/3075696432 >> v1:172.21.15.49:6789/0 conn(0x7fa034153e30 legacy=0x7fa0340a90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa033e00700 1 --2- 172.21.15.49:0/3075696432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0140038e0 0x7fa014003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa033e00700 1 --2- 172.21.15.49:0/3075696432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa014004690 0x7fa014004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa033e00700 1 --2- 172.21.15.49:0/3075696432 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa014005000 0x7fa01400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa033e00700 1 -- 172.21.15.49:0/3075696432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa034154c40 con 0x7fa0140038e0 2024-01-22T05:09:37.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa033e00700 1 -- 172.21.15.49:0/3075696432 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01400beb0 con 0x7fa014004690 2024-01-22T05:09:37.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa033e00700 1 -- 172.21.15.49:0/3075696432 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01400c070 con 0x7fa014005000 2024-01-22T05:09:37.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa039400700 1 --2- 172.21.15.49:0/3075696432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0140038e0 0x7fa014003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa038a00700 1 --2- 172.21.15.49:0/3075696432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa014004690 0x7fa014004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa039e00700 1 --2- 172.21.15.49:0/3075696432 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa014005000 0x7fa01400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa039400700 1 -- 172.21.15.49:0/3075696432 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa014005000 msgr2=0x7fa01400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:37.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa039400700 1 --2- 172.21.15.49:0/3075696432 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa014005000 0x7fa01400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa039400700 1 -- 172.21.15.49:0/3075696432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa014004690 msgr2=0x7fa014004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:37.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa039400700 1 --2- 172.21.15.49:0/3075696432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa014004690 0x7fa014004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa039400700 1 -- 172.21.15.49:0/3075696432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0140033f0 con 0x7fa0140038e0 2024-01-22T05:09:37.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa039e00700 1 --2- 172.21.15.49:0/3075696432 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa014005000 0x7fa01400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:37.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa039e00700 1 -- 172.21.15.49:0/3075696432 reap_dead start 2024-01-22T05:09:37.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa039400700 1 --2- 172.21.15.49:0/3075696432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0140038e0 0x7fa014003d00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fa02400c190 tx=0x7fa024001e50).ready entity=mon.0 client_cookie=d602cd4acbe024b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:37.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa033e00700 1 -- 172.21.15.49:0/3075696432 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024007a20 con 0x7fa0140038e0 2024-01-22T05:09:37.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa033e00700 1 -- 172.21.15.49:0/3075696432 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02400cac0 con 0x7fa0140038e0 2024-01-22T05:09:37.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa033e00700 1 -- 172.21.15.49:0/3075696432 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02400ce60 con 0x7fa0140038e0 2024-01-22T05:09:37.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa03be00700 1 -- 172.21.15.49:0/3075696432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0140038e0 msgr2=0x7fa014003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa03be00700 1 --2- 172.21.15.49:0/3075696432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0140038e0 0x7fa014003d00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fa02400c190 tx=0x7fa024001e50).stop 2024-01-22T05:09:37.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa03be00700 1 -- 172.21.15.49:0/3075696432 shutdown_connections 2024-01-22T05:09:37.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa03be00700 1 --2- 172.21.15.49:0/3075696432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0140038e0 0x7fa014003d00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.982+0000 7fa03be00700 1 -- 172.21.15.49:0/3075696432 >> 172.21.15.49:0/3075696432 conn(0x7fa0340c7850 msgr2=0x7fa0340c3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:37.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.986+0000 7fa03be00700 1 -- 172.21.15.49:0/3075696432 shutdown_connections 2024-01-22T05:09:37.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.986+0000 7fa03be00700 1 -- 172.21.15.49:0/3075696432 wait complete. 2024-01-22T05:09:37.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.986+0000 7fa03be00700 1 Processor -- start 2024-01-22T05:09:37.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.986+0000 7fa03be00700 1 -- start start 2024-01-22T05:09:37.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa03be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0140038e0 0x7fa03413f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa03be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03413f7d0 0x7fa0340bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa03be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0340c0260 0x7fa0340a8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:37.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa03be00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340aa940 con 0x7fa0340c0260 2024-01-22T05:09:37.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa03be00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340a6c20 con 0x7fa0140038e0 2024-01-22T05:09:37.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa03be00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340a6f00 con 0x7fa03413f7d0 2024-01-22T05:09:37.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa039e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0340c0260 0x7fa0340a8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa039400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0140038e0 0x7fa03413f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa039400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0140038e0 0x7fa03413f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:51532/0 (socket says 172.21.15.49:51532) 2024-01-22T05:09:37.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa039400700 1 -- 172.21.15.49:0/2022590673 learned_addr learned my addr 172.21.15.49:0/2022590673 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:37.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa038a00700 1 --2- 172.21.15.49:0/2022590673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03413f7d0 0x7fa0340bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:37.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa039400700 1 -- 172.21.15.49:0/2022590673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03413f7d0 msgr2=0x7fa0340bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa039400700 1 --2- 172.21.15.49:0/2022590673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03413f7d0 0x7fa0340bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa039400700 1 -- 172.21.15.49:0/2022590673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0340c0260 msgr2=0x7fa0340a8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:37.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa039400700 1 --2- 172.21.15.49:0/2022590673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0340c0260 0x7fa0340a8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:37.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa039400700 1 -- 172.21.15.49:0/2022590673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0340a71e0 con 0x7fa0140038e0 2024-01-22T05:09:37.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.990+0000 7fa039400700 1 --2- 172.21.15.49:0/2022590673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0140038e0 0x7fa03413f2e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fa02400c780 tx=0x7fa024015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:37.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.994+0000 7fa030c00700 1 -- 172.21.15.49:0/2022590673 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0240075c0 con 0x7fa0140038e0 2024-01-22T05:09:37.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.994+0000 7fa030c00700 1 -- 172.21.15.49:0/2022590673 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0240046b0 con 0x7fa0140038e0 2024-01-22T05:09:37.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.994+0000 7fa03be00700 1 -- 172.21.15.49:0/2022590673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0340a74c0 con 0x7fa0140038e0 2024-01-22T05:09:37.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.994+0000 7fa030c00700 1 -- 172.21.15.49:0/2022590673 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024004a70 con 0x7fa0140038e0 2024-01-22T05:09:37.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.994+0000 7fa03be00700 1 -- 172.21.15.49:0/2022590673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0340a88f0 con 0x7fa0140038e0 2024-01-22T05:09:37.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.994+0000 7fa03be00700 1 -- 172.21.15.49:0/2022590673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0340a6c20 con 0x7fa0140038e0 2024-01-22T05:09:37.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.994+0000 7fa030c00700 1 -- 172.21.15.49:0/2022590673 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa024013450 con 0x7fa0140038e0 2024-01-22T05:09:38.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.998+0000 7fa030c00700 1 --2- 172.21.15.49:0/2022590673 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa00c05a500 0x7fa00c05c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:38.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.998+0000 7fa030c00700 1 -- 172.21.15.49:0/2022590673 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fa0240755a0 con 0x7fa0140038e0 2024-01-22T05:09:38.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.998+0000 7fa038a00700 1 --2- 172.21.15.49:0/2022590673 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa00c05a500 0x7fa00c05c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:38.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:37.998+0000 7fa038a00700 1 --2- 172.21.15.49:0/2022590673 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa00c05a500 0x7fa00c05c9c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fa01c007fd0 tx=0x7fa01c007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:38.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.006+0000 7fa030c00700 1 -- 172.21.15.49:0/2022590673 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa024048a10 con 0x7fa0140038e0 2024-01-22T05:09:38.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.174+0000 7fa03be00700 1 -- 172.21.15.49:0/2022590673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0340c0640 con 0x7fa0140038e0 2024-01-22T05:09:38.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.178+0000 7fa030c00700 1 -- 172.21.15.49:0/2022590673 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+17538 (secure 0 0 0) 0x7fa0340c0640 con 0x7fa0140038e0 2024-01-22T05:09:38.183 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:38.183 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":76,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:09:24.515280+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:09:01.882090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-01-22T05:09:02.934332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.2e","mappings":[{"from":4,"to":3}]},{"pgid":"10.33","mappings":[{"from":4,"to":3}]},{"pgid":"10.3a","mappings":[{"from":7,"to":3}]},{"pgid":"11.2d","mappings":[{"from":6,"to":0}]},{"pgid":"11.3c","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6837/2817241041":"2024-01-23T05:09:18.080863+0000","172.21.15.49:6836/2817241041":"2024-01-23T05:09:18.080863+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:09:38.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.182+0000 7fa03be00700 1 -- 172.21.15.49:0/2022590673 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa00c05a500 msgr2=0x7fa00c05c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:38.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.182+0000 7fa03be00700 1 --2- 172.21.15.49:0/2022590673 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa00c05a500 0x7fa00c05c9c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fa01c007fd0 tx=0x7fa01c007bb0).stop 2024-01-22T05:09:38.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.182+0000 7fa03be00700 1 -- 172.21.15.49:0/2022590673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0140038e0 msgr2=0x7fa03413f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:38.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.182+0000 7fa03be00700 1 --2- 172.21.15.49:0/2022590673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0140038e0 0x7fa03413f2e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fa02400c780 tx=0x7fa024015000).stop 2024-01-22T05:09:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.182+0000 7fa03be00700 1 -- 172.21.15.49:0/2022590673 shutdown_connections 2024-01-22T05:09:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.182+0000 7fa03be00700 1 --2- 172.21.15.49:0/2022590673 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa00c05a500 0x7fa00c05c9c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.182+0000 7fa03be00700 1 --2- 172.21.15.49:0/2022590673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0340c0260 0x7fa0340a8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.182+0000 7fa03be00700 1 --2- 172.21.15.49:0/2022590673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03413f7d0 0x7fa0340bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.182+0000 7fa03be00700 1 --2- 172.21.15.49:0/2022590673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0140038e0 0x7fa03413f2e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.182+0000 7fa03be00700 1 -- 172.21.15.49:0/2022590673 >> 172.21.15.49:0/2022590673 conn(0x7fa0340c7850 msgr2=0x7fa034140bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.182+0000 7fa03be00700 1 -- 172.21.15.49:0/2022590673 shutdown_connections 2024-01-22T05:09:38.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.182+0000 7fa03be00700 1 -- 172.21.15.49:0/2022590673 wait complete. 2024-01-22T05:09:38.210 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:09:38.210 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:09:38.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.374+0000 7fdcf7a00700 1 Processor -- start 2024-01-22T05:09:38.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.374+0000 7fdcf7a00700 1 -- start start 2024-01-22T05:09:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.378+0000 7fdcf7a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdcf0064fc0 0x7fdcf00653a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.378+0000 7fdcf7a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcf0153860 0x7fdcf0153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.378+0000 7fdcf7a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf00c7d00 con 0x7fdcf00c1230 2024-01-22T05:09:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.378+0000 7fdcf7a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf00cafd0 con 0x7fdcf0064fc0 2024-01-22T05:09:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.378+0000 7fdcf7a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf00c70f0 con 0x7fdcf0153860 2024-01-22T05:09:38.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.378+0000 7fdcefe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcf0153860 0x7fdcf0153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:38.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.378+0000 7fdcf5000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdcf0064fc0 0x7fdcf00653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:38.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.378+0000 7fdcefe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcf0153860 0x7fdcf0153ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:42592/0 (socket says 172.21.15.49:42592) 2024-01-22T05:09:38.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.378+0000 7fdcefe00700 1 -- 172.21.15.49:0/457752669 learned_addr learned my addr 172.21.15.49:0/457752669 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:38.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.378+0000 7fdcf6400700 1 --1- 172.21.15.49:0/457752669 >> v1:172.21.15.110:6789/0 conn(0x7fdcf00c1230 0x7fdcf01576e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:34542/0 (socket says 172.21.15.49:34542) 2024-01-22T05:09:38.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcef400700 1 -- 172.21.15.49:0/457752669 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153335368 0 0) 0x7fdcf00c7d00 con 0x7fdcf00c1230 2024-01-22T05:09:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcef400700 1 -- 172.21.15.49:0/457752669 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcd00033f0 con 0x7fdcf00c1230 2024-01-22T05:09:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcefe00700 1 -- 172.21.15.49:0/457752669 >> v2:172.21.15.110:3300/0 conn(0x7fdcf0064fc0 msgr2=0x7fdcf00653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcefe00700 1 --2- 172.21.15.49:0/457752669 >> v2:172.21.15.110:3300/0 conn(0x7fdcf0064fc0 0x7fdcf00653a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcefe00700 1 -- 172.21.15.49:0/457752669 >> v1:172.21.15.110:6789/0 conn(0x7fdcf00c1230 legacy=0x7fdcf01576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcefe00700 1 -- 172.21.15.49:0/457752669 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf00c73d0 con 0x7fdcf0153860 2024-01-22T05:09:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcf5000700 1 --2- 172.21.15.49:0/457752669 >> v2:172.21.15.110:3300/0 conn(0x7fdcf0064fc0 0x7fdcf00653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcefe00700 1 --2- 172.21.15.49:0/457752669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcf0153860 0x7fdcf0153ca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fdcd8006fd0 tx=0x7fdcd80090f0).ready entity=mon.2 client_cookie=7b092976c0dfa7d9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcef400700 1 -- 172.21.15.49:0/457752669 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800f510 con 0x7fdcf0153860 2024-01-22T05:09:38.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcef400700 1 -- 172.21.15.49:0/457752669 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd800f670 con 0x7fdcf0153860 2024-01-22T05:09:38.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcef400700 1 -- 172.21.15.49:0/457752669 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800f9f0 con 0x7fdcf0153860 2024-01-22T05:09:38.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcf7a00700 1 -- 172.21.15.49:0/457752669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcf0153860 msgr2=0x7fdcf0153ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:38.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcf7a00700 1 --2- 172.21.15.49:0/457752669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcf0153860 0x7fdcf0153ca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fdcd8006fd0 tx=0x7fdcd80090f0).stop 2024-01-22T05:09:38.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcf7a00700 1 -- 172.21.15.49:0/457752669 shutdown_connections 2024-01-22T05:09:38.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcf7a00700 1 --2- 172.21.15.49:0/457752669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcf0153860 0x7fdcf0153ca0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcf7a00700 1 --2- 172.21.15.49:0/457752669 >> v2:172.21.15.110:3300/0 conn(0x7fdcf0064fc0 0x7fdcf00653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.382+0000 7fdcf7a00700 1 -- 172.21.15.49:0/457752669 >> 172.21.15.49:0/457752669 conn(0x7fdcf00ccb90 msgr2=0x7fdcf00c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:38.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.386+0000 7fdcf7a00700 1 -- 172.21.15.49:0/457752669 shutdown_connections 2024-01-22T05:09:38.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.386+0000 7fdcf7a00700 1 -- 172.21.15.49:0/457752669 wait complete. 2024-01-22T05:09:38.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.386+0000 7fdcf7a00700 1 Processor -- start 2024-01-22T05:09:38.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.390+0000 7fdcf7a00700 1 -- start start 2024-01-22T05:09:38.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.390+0000 7fdcf7a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcf0064fc0 0x7fdcf00ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:38.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.390+0000 7fdcf7a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcf00c1230 0x7fdcf00c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:38.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.390+0000 7fdcf7a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcf0153860 0x7fdcf016bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:38.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.390+0000 7fdcf7a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf00c34c0 con 0x7fdcf00c1230 2024-01-22T05:09:38.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.390+0000 7fdcf7a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf00adbf0 con 0x7fdcf0153860 2024-01-22T05:09:38.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.390+0000 7fdcf7a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf00ae570 con 0x7fdcf0064fc0 2024-01-22T05:09:38.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.390+0000 7fdcefe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcf00c1230 0x7fdcf00c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:38.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.390+0000 7fdcefe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcf00c1230 0x7fdcf00c4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52000/0 (socket says 172.21.15.49:52000) 2024-01-22T05:09:38.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.390+0000 7fdcf5000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcf0064fc0 0x7fdcf00ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:38.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.390+0000 7fdcefe00700 1 -- 172.21.15.49:0/2555024673 learned_addr learned my addr 172.21.15.49:0/2555024673 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:38.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.394+0000 7fdcf6400700 1 --2- 172.21.15.49:0/2555024673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcf0153860 0x7fdcf016bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:38.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.394+0000 7fdcf5000700 1 -- 172.21.15.49:0/2555024673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcf0153860 msgr2=0x7fdcf016bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:38.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.394+0000 7fdcf5000700 1 --2- 172.21.15.49:0/2555024673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcf0153860 0x7fdcf016bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.394+0000 7fdcf5000700 1 -- 172.21.15.49:0/2555024673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcf00c1230 msgr2=0x7fdcf00c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:38.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.394+0000 7fdcf5000700 1 --2- 172.21.15.49:0/2555024673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcf00c1230 0x7fdcf00c4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.394+0000 7fdcf5000700 1 -- 172.21.15.49:0/2555024673 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce00092a0 con 0x7fdcf0064fc0 2024-01-22T05:09:38.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.394+0000 7fdcf6400700 1 --2- 172.21.15.49:0/2555024673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcf0153860 0x7fdcf016bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:38.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.394+0000 7fdcf5000700 1 --2- 172.21.15.49:0/2555024673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcf0064fc0 0x7fdcf00ae080 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fdce000e9b0 tx=0x7fdce0009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:38.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.394+0000 7fdce7e00700 1 -- 172.21.15.49:0/2555024673 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce000eea0 con 0x7fdcf0064fc0 2024-01-22T05:09:38.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.394+0000 7fdce7e00700 1 -- 172.21.15.49:0/2555024673 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce000c7f0 con 0x7fdcf0064fc0 2024-01-22T05:09:38.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.394+0000 7fdce7e00700 1 -- 172.21.15.49:0/2555024673 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce000cb70 con 0x7fdcf0064fc0 2024-01-22T05:09:38.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.394+0000 7fdcf7a00700 1 -- 172.21.15.49:0/2555024673 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd8009370 con 0x7fdcf0064fc0 2024-01-22T05:09:38.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.394+0000 7fdcf7a00700 1 -- 172.21.15.49:0/2555024673 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf00ad2c0 con 0x7fdcf0064fc0 2024-01-22T05:09:38.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.394+0000 7fdcf7a00700 1 -- 172.21.15.49:0/2555024673 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf00c63a0 con 0x7fdcf0064fc0 2024-01-22T05:09:38.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.398+0000 7fdce7e00700 1 -- 172.21.15.49:0/2555024673 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdce001b400 con 0x7fdcf0064fc0 2024-01-22T05:09:38.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.398+0000 7fdce7e00700 1 --2- 172.21.15.49:0/2555024673 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdcc805a540 0x7fdcc805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:38.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.398+0000 7fdce7e00700 1 -- 172.21.15.49:0/2555024673 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fdce0074e90 con 0x7fdcf0064fc0 2024-01-22T05:09:38.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.398+0000 7fdcefe00700 1 --2- 172.21.15.49:0/2555024673 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdcc805a540 0x7fdcc805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:38.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.398+0000 7fdcefe00700 1 --2- 172.21.15.49:0/2555024673 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdcc805a540 0x7fdcc805ca00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fdcd8006ec0 tx=0x7fdcd8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:38.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.406+0000 7fdce7e00700 1 -- 172.21.15.49:0/2555024673 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdce00483c0 con 0x7fdcf0064fc0 2024-01-22T05:09:38.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.610+0000 7fdcf7a00700 1 -- 172.21.15.49:0/2555024673 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcf0047060 con 0x7fdcf0064fc0 2024-01-22T05:09:38.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.614+0000 7fdce7e00700 1 -- 172.21.15.49:0/2555024673 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4498 (secure 0 0 0) 0x7fdce0016070 con 0x7fdcf0064fc0 2024-01-22T05:09:38.618 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:38.618 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":62,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4087795616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4087795616},{"type":"v1","addr":"172.21.15.110:6833","nonce":4087795616}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3220435249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3220435249},{"type":"v1","addr":"172.21.15.110:6835","nonce":3220435249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3927178750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3927178750},{"type":"v1","addr":"172.21.15.49:6835","nonce":3927178750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:09:03.929962+0000","modified":"2024-01-22T05:09:22.494561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6609},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6609":{"gid":6609,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/2814482810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2814482810},{"type":"v1","addr":"172.21.15.49:6837","nonce":2814482810}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-22T05:09:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.618+0000 7fdcf7a00700 1 -- 172.21.15.49:0/2555024673 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdcc805a540 msgr2=0x7fdcc805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.618+0000 7fdcf7a00700 1 --2- 172.21.15.49:0/2555024673 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdcc805a540 0x7fdcc805ca00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fdcd8006ec0 tx=0x7fdcd8017000).stop 2024-01-22T05:09:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.618+0000 7fdcf7a00700 1 -- 172.21.15.49:0/2555024673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcf0064fc0 msgr2=0x7fdcf00ae080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.618+0000 7fdcf7a00700 1 --2- 172.21.15.49:0/2555024673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcf0064fc0 0x7fdcf00ae080 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fdce000e9b0 tx=0x7fdce0009060).stop 2024-01-22T05:09:38.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.618+0000 7fdcf7a00700 1 -- 172.21.15.49:0/2555024673 shutdown_connections 2024-01-22T05:09:38.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.618+0000 7fdcf7a00700 1 --2- 172.21.15.49:0/2555024673 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdcc805a540 0x7fdcc805ca00 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.618+0000 7fdcf7a00700 1 --2- 172.21.15.49:0/2555024673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcf0153860 0x7fdcf016bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.618+0000 7fdcf7a00700 1 --2- 172.21.15.49:0/2555024673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcf00c1230 0x7fdcf00c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.618+0000 7fdcf7a00700 1 --2- 172.21.15.49:0/2555024673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcf0064fc0 0x7fdcf00ae080 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.618+0000 7fdcf7a00700 1 -- 172.21.15.49:0/2555024673 >> 172.21.15.49:0/2555024673 conn(0x7fdcf00ccb90 msgr2=0x7fdcf0150b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:38.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.618+0000 7fdcf7a00700 1 -- 172.21.15.49:0/2555024673 shutdown_connections 2024-01-22T05:09:38.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.618+0000 7fdcf7a00700 1 -- 172.21.15.49:0/2555024673 wait complete. 2024-01-22T05:09:38.625 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 62 2024-01-22T05:09:38.644 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:09:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.802+0000 7f28dc400700 1 Processor -- start 2024-01-22T05:09:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.802+0000 7f28dc400700 1 -- start start 2024-01-22T05:09:38.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28dc400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d4155d20 0x7f28d4065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:38.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28dc400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28d40a8e50 0x7f28d40c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:38.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28dc400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d40c1a40 con 0x7f28d4066070 2024-01-22T05:09:38.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28dc400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d4159310 con 0x7f28d40a8e50 2024-01-22T05:09:38.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28dc400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40c13f0 con 0x7f28d4155d20 2024-01-22T05:09:38.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28d9a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d4155d20 0x7f28d4065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:38.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28d9000700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f28d4066070 0x7f28d40a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:34552/0 (socket says 172.21.15.49:34552) 2024-01-22T05:09:38.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28d9000700 1 -- 172.21.15.49:0/1300170228 learned_addr learned my addr 172.21.15.49:0/1300170228 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:38.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28da400700 1 --2- 172.21.15.49:0/1300170228 >> v2:172.21.15.110:3300/0 conn(0x7f28d40a8e50 0x7f28d40c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:38.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28d3e00700 1 -- 172.21.15.49:0/1300170228 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754595390 0 0) 0x7f28d40c1a40 con 0x7f28d4066070 2024-01-22T05:09:38.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28d3e00700 1 -- 172.21.15.49:0/1300170228 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28b40033f0 con 0x7f28d4066070 2024-01-22T05:09:38.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28d9a00700 1 -- 172.21.15.49:0/1300170228 >> v2:172.21.15.110:3300/0 conn(0x7f28d40a8e50 msgr2=0x7f28d40c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:38.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28d9a00700 1 --2- 172.21.15.49:0/1300170228 >> v2:172.21.15.110:3300/0 conn(0x7f28d40a8e50 0x7f28d40c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28d9a00700 1 -- 172.21.15.49:0/1300170228 >> v1:172.21.15.110:6789/0 conn(0x7f28d4066070 legacy=0x7f28d40a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:38.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28d9a00700 1 -- 172.21.15.49:0/1300170228 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d40c16d0 con 0x7f28d4155d20 2024-01-22T05:09:38.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28d9a00700 1 --2- 172.21.15.49:0/1300170228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d4155d20 0x7f28d4065b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f28c4009760 tx=0x7f28c4009060).ready entity=mon.2 client_cookie=647e7bed45fbc8d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:38.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28d3e00700 1 -- 172.21.15.49:0/1300170228 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400d4a0 con 0x7f28d4155d20 2024-01-22T05:09:38.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28d3e00700 1 -- 172.21.15.49:0/1300170228 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c400d600 con 0x7f28d4155d20 2024-01-22T05:09:38.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.806+0000 7f28d3e00700 1 -- 172.21.15.49:0/1300170228 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400d980 con 0x7f28d4155d20 2024-01-22T05:09:38.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.810+0000 7f28dc400700 1 -- 172.21.15.49:0/1300170228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d4155d20 msgr2=0x7f28d4065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:38.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.810+0000 7f28dc400700 1 --2- 172.21.15.49:0/1300170228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d4155d20 0x7f28d4065b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f28c4009760 tx=0x7f28c4009060).stop 2024-01-22T05:09:38.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.810+0000 7f28dc400700 1 -- 172.21.15.49:0/1300170228 shutdown_connections 2024-01-22T05:09:38.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.810+0000 7f28dc400700 1 --2- 172.21.15.49:0/1300170228 >> v2:172.21.15.110:3300/0 conn(0x7f28d40a8e50 0x7f28d40c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.810+0000 7f28dc400700 1 --2- 172.21.15.49:0/1300170228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d4155d20 0x7f28d4065b80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.810+0000 7f28dc400700 1 -- 172.21.15.49:0/1300170228 >> 172.21.15.49:0/1300170228 conn(0x7f28d40c6540 msgr2=0x7f28d40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:38.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.810+0000 7f28dc400700 1 -- 172.21.15.49:0/1300170228 shutdown_connections 2024-01-22T05:09:38.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.810+0000 7f28dc400700 1 -- 172.21.15.49:0/1300170228 wait complete. 2024-01-22T05:09:38.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28dc400700 1 Processor -- start 2024-01-22T05:09:38.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28dc400700 1 -- start start 2024-01-22T05:09:38.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28dc400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d4066070 0x7f28d41561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:38.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28dc400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28d40a8e50 0x7f28d416bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:38.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28dc400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28d4155d20 0x7f28d416c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:38.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28dc400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d416c710 con 0x7f28d40a8e50 2024-01-22T05:09:38.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28dc400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41566b0 con 0x7f28d4155d20 2024-01-22T05:09:38.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28dc400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41574d0 con 0x7f28d4066070 2024-01-22T05:09:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28d9000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28d40a8e50 0x7f28d416bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28da400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28d4155d20 0x7f28d416c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28d9a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d4066070 0x7f28d41561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28d9a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d4066070 0x7f28d41561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:42628/0 (socket says 172.21.15.49:42628) 2024-01-22T05:09:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28d9000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28d40a8e50 0x7f28d416bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52016/0 (socket says 172.21.15.49:52016) 2024-01-22T05:09:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28da400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28d4155d20 0x7f28d416c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:51572/0 (socket says 172.21.15.49:51572) 2024-01-22T05:09:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28d9000700 1 -- 172.21.15.49:0/3130720426 learned_addr learned my addr 172.21.15.49:0/3130720426 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:38.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28d9a00700 1 -- 172.21.15.49:0/3130720426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28d4155d20 msgr2=0x7f28d416c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:38.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28d9a00700 1 --2- 172.21.15.49:0/3130720426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28d4155d20 0x7f28d416c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28d9a00700 1 -- 172.21.15.49:0/3130720426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28d40a8e50 msgr2=0x7f28d416bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:38.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.814+0000 7f28d9a00700 1 --2- 172.21.15.49:0/3130720426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28d40a8e50 0x7f28d416bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:38.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.818+0000 7f28d9a00700 1 -- 172.21.15.49:0/3130720426 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c40092a0 con 0x7f28d4066070 2024-01-22T05:09:38.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.818+0000 7f28d9000700 1 --2- 172.21.15.49:0/3130720426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28d40a8e50 0x7f28d416bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:38.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.818+0000 7f28d9a00700 1 --2- 172.21.15.49:0/3130720426 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d4066070 0x7f28d41561c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f28c4013000 tx=0x7f28c4016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:38.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.818+0000 7f28d0c00700 1 -- 172.21.15.49:0/3130720426 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400dd30 con 0x7f28d4066070 2024-01-22T05:09:38.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.818+0000 7f28d0c00700 1 -- 172.21.15.49:0/3130720426 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c400de90 con 0x7f28d4066070 2024-01-22T05:09:38.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.818+0000 7f28dc400700 1 -- 172.21.15.49:0/3130720426 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d41568c0 con 0x7f28d4066070 2024-01-22T05:09:38.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.818+0000 7f28d0c00700 1 -- 172.21.15.49:0/3130720426 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400d980 con 0x7f28d4066070 2024-01-22T05:09:38.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.818+0000 7f28dc400700 1 -- 172.21.15.49:0/3130720426 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d4156e80 con 0x7f28d4066070 2024-01-22T05:09:38.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.818+0000 7f28dc400700 1 -- 172.21.15.49:0/3130720426 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d4047060 con 0x7f28d4066070 2024-01-22T05:09:38.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.822+0000 7f28d0c00700 1 -- 172.21.15.49:0/3130720426 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f28c401d640 con 0x7f28d4066070 2024-01-22T05:09:38.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.822+0000 7f28d0c00700 1 --2- 172.21.15.49:0/3130720426 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f28ac05a510 0x7f28ac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:38.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.822+0000 7f28d0c00700 1 -- 172.21.15.49:0/3130720426 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f28c4076180 con 0x7f28d4066070 2024-01-22T05:09:38.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.822+0000 7f28d9000700 1 --2- 172.21.15.49:0/3130720426 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f28ac05a510 0x7f28ac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:38.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.822+0000 7f28d9000700 1 --2- 172.21.15.49:0/3130720426 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f28ac05a510 0x7f28ac05c9d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f28d4166380 tx=0x7f28bc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:38.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:38.830+0000 7f28d0c00700 1 -- 172.21.15.49:0/3130720426 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f28c4049650 con 0x7f28d4066070 2024-01-22T05:09:39.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.026+0000 7f28dc400700 1 -- 172.21.15.49:0/3130720426 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28d40c23c0 con 0x7f28d4066070 2024-01-22T05:09:39.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.026+0000 7f28d0c00700 1 -- 172.21.15.49:0/3130720426 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4498 (secure 0 0 0) 0x7f28c404cc70 con 0x7f28d4066070 2024-01-22T05:09:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:39.033 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":62,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4087795616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4087795616},{"type":"v1","addr":"172.21.15.110:6833","nonce":4087795616}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3220435249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3220435249},{"type":"v1","addr":"172.21.15.110:6835","nonce":3220435249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3927178750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3927178750},{"type":"v1","addr":"172.21.15.49:6835","nonce":3927178750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:09:03.929962+0000","modified":"2024-01-22T05:09:22.494561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6609},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6609":{"gid":6609,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/2814482810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2814482810},{"type":"v1","addr":"172.21.15.49:6837","nonce":2814482810}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-22T05:09:39.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.030+0000 7f28dc400700 1 -- 172.21.15.49:0/3130720426 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f28ac05a510 msgr2=0x7f28ac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:39.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.030+0000 7f28dc400700 1 --2- 172.21.15.49:0/3130720426 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f28ac05a510 0x7f28ac05c9d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f28d4166380 tx=0x7f28bc009040).stop 2024-01-22T05:09:39.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.030+0000 7f28dc400700 1 -- 172.21.15.49:0/3130720426 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d4066070 msgr2=0x7f28d41561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:39.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.030+0000 7f28dc400700 1 --2- 172.21.15.49:0/3130720426 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d4066070 0x7f28d41561c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f28c4013000 tx=0x7f28c4016000).stop 2024-01-22T05:09:39.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.030+0000 7f28dc400700 1 -- 172.21.15.49:0/3130720426 shutdown_connections 2024-01-22T05:09:39.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.030+0000 7f28dc400700 1 --2- 172.21.15.49:0/3130720426 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f28ac05a510 0x7f28ac05c9d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.030+0000 7f28dc400700 1 --2- 172.21.15.49:0/3130720426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28d4155d20 0x7f28d416c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.030+0000 7f28dc400700 1 --2- 172.21.15.49:0/3130720426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28d40a8e50 0x7f28d416bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.030+0000 7f28dc400700 1 --2- 172.21.15.49:0/3130720426 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d4066070 0x7f28d41561c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.030+0000 7f28dc400700 1 -- 172.21.15.49:0/3130720426 >> 172.21.15.49:0/3130720426 conn(0x7f28d40c6540 msgr2=0x7f28d40c4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:39.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.030+0000 7f28dc400700 1 -- 172.21.15.49:0/3130720426 shutdown_connections 2024-01-22T05:09:39.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.030+0000 7f28dc400700 1 -- 172.21.15.49:0/3130720426 wait complete. 2024-01-22T05:09:39.040 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 62 2024-01-22T05:09:39.059 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:09:39.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.214+0000 7f800b800700 1 Processor -- start 2024-01-22T05:09:39.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.214+0000 7f800b800700 1 -- start start 2024-01-22T05:09:39.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f800b800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f80040a8740 0x7f80040a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:39.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f800b800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f80040c1ed0 0x7f80040c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:39.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f800b800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80040c1a40 con 0x7f8004155d20 2024-01-22T05:09:39.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f800b800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80040a90b0 con 0x7f80040c1ed0 2024-01-22T05:09:39.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f800b800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8004159310 con 0x7f80040a8740 2024-01-22T05:09:39.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f8009800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f80040c1ed0 0x7f80040c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:39.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f8009800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f80040c1ed0 0x7f80040c2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52030/0 (socket says 172.21.15.49:52030) 2024-01-22T05:09:39.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f8009800700 1 -- 172.21.15.49:0/3761592955 learned_addr learned my addr 172.21.15.49:0/3761592955 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:39.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f8003e00700 1 --2- 172.21.15.49:0/3761592955 >> v2:172.21.15.110:3300/0 conn(0x7f80040a8740 0x7f80040a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:39.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f8009800700 1 -- 172.21.15.49:0/3761592955 >> v2:172.21.15.110:3300/0 conn(0x7f80040a8740 msgr2=0x7f80040a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:39.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f8009800700 1 --2- 172.21.15.49:0/3761592955 >> v2:172.21.15.110:3300/0 conn(0x7f80040a8740 0x7f80040a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f8009800700 1 -- 172.21.15.49:0/3761592955 >> v1:172.21.15.110:6789/0 conn(0x7f8004155d20 legacy=0x7f8004065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:39.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f8009800700 1 -- 172.21.15.49:0/3761592955 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80040c13f0 con 0x7f80040c1ed0 2024-01-22T05:09:39.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f8009800700 1 --2- 172.21.15.49:0/3761592955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80040c1ed0 0x7f80040c2360 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f80040c0ad0 tx=0x7f7ffc009840).ready entity=mon.0 client_cookie=71fbeb18dc217d64 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:39.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f8003400700 1 -- 172.21.15.49:0/3761592955 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00e070 con 0x7f80040c1ed0 2024-01-22T05:09:39.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f8003400700 1 -- 172.21.15.49:0/3761592955 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc00ba50 con 0x7f80040c1ed0 2024-01-22T05:09:39.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.218+0000 7f8003400700 1 -- 172.21.15.49:0/3761592955 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00bdd0 con 0x7f80040c1ed0 2024-01-22T05:09:39.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.222+0000 7f800b800700 1 -- 172.21.15.49:0/3761592955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80040c1ed0 msgr2=0x7f80040c2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:39.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.222+0000 7f800b800700 1 --2- 172.21.15.49:0/3761592955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80040c1ed0 0x7f80040c2360 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f80040c0ad0 tx=0x7f7ffc009840).stop 2024-01-22T05:09:39.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.222+0000 7f800b800700 1 -- 172.21.15.49:0/3761592955 shutdown_connections 2024-01-22T05:09:39.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.222+0000 7f800b800700 1 --2- 172.21.15.49:0/3761592955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80040c1ed0 0x7f80040c2360 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.222+0000 7f800b800700 1 --2- 172.21.15.49:0/3761592955 >> v2:172.21.15.110:3300/0 conn(0x7f80040a8740 0x7f80040a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.222+0000 7f800b800700 1 -- 172.21.15.49:0/3761592955 >> 172.21.15.49:0/3761592955 conn(0x7f80040c6540 msgr2=0x7f80040c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:39.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.222+0000 7f800b800700 1 -- 172.21.15.49:0/3761592955 shutdown_connections 2024-01-22T05:09:39.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.222+0000 7f800b800700 1 -- 172.21.15.49:0/3761592955 wait complete. 2024-01-22T05:09:39.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.226+0000 7f800b800700 1 Processor -- start 2024-01-22T05:09:39.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.226+0000 7f800b800700 1 -- start start 2024-01-22T05:09:39.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.226+0000 7f800b800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80040a8740 0x7f80041680a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:39.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.226+0000 7f800b800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80040c1ed0 0x7f8004169120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:39.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.226+0000 7f800b800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8004155d20 0x7f80040a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:39.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.226+0000 7f800b800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80040abb20 con 0x7f8004155d20 2024-01-22T05:09:39.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.226+0000 7f800b800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8004168590 con 0x7f80040a8740 2024-01-22T05:09:39.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.226+0000 7f800b800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8004169610 con 0x7f80040c1ed0 2024-01-22T05:09:39.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f8009800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8004155d20 0x7f80040a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:39.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f8008e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80040a8740 0x7f80041680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:39.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f8009800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8004155d20 0x7f80040a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52034/0 (socket says 172.21.15.49:52034) 2024-01-22T05:09:39.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f8008e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80040a8740 0x7f80041680a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:51594/0 (socket says 172.21.15.49:51594) 2024-01-22T05:09:39.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f8009800700 1 -- 172.21.15.49:0/2996302955 learned_addr learned my addr 172.21.15.49:0/2996302955 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:39.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f8003e00700 1 --2- 172.21.15.49:0/2996302955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80040c1ed0 0x7f8004169120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:39.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f8009800700 1 -- 172.21.15.49:0/2996302955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80040c1ed0 msgr2=0x7f8004169120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:39.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f8009800700 1 --2- 172.21.15.49:0/2996302955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80040c1ed0 0x7f8004169120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f8009800700 1 -- 172.21.15.49:0/2996302955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80040a8740 msgr2=0x7f80041680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:39.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f8009800700 1 --2- 172.21.15.49:0/2996302955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80040a8740 0x7f80041680a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f8009800700 1 -- 172.21.15.49:0/2996302955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc009ae0 con 0x7f8004155d20 2024-01-22T05:09:39.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f8009800700 1 --2- 172.21.15.49:0/2996302955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8004155d20 0x7f80040a95b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f7ffc009fd0 tx=0x7f7ffc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:39.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f7ffbe00700 1 -- 172.21.15.49:0/2996302955 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc013e60 con 0x7f8004155d20 2024-01-22T05:09:39.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f7ffbe00700 1 -- 172.21.15.49:0/2996302955 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc0092e0 con 0x7f8004155d20 2024-01-22T05:09:39.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f800b800700 1 -- 172.21.15.49:0/2996302955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80040aaf10 con 0x7f8004155d20 2024-01-22T05:09:39.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f7ffbe00700 1 -- 172.21.15.49:0/2996302955 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc01d640 con 0x7f8004155d20 2024-01-22T05:09:39.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.230+0000 7f800b800700 1 -- 172.21.15.49:0/2996302955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80040ab4d0 con 0x7f8004155d20 2024-01-22T05:09:39.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.234+0000 7f800b800700 1 -- 172.21.15.49:0/2996302955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8004047060 con 0x7f8004155d20 2024-01-22T05:09:39.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.234+0000 7f7ffbe00700 1 -- 172.21.15.49:0/2996302955 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7ffc01d9b0 con 0x7f8004155d20 2024-01-22T05:09:39.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.234+0000 7f7ffbe00700 1 --2- 172.21.15.49:0/2996302955 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7fdc05a510 0x7f7fdc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:39.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.234+0000 7f7ffbe00700 1 -- 172.21.15.49:0/2996302955 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f7ffc0765d0 con 0x7f8004155d20 2024-01-22T05:09:39.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.234+0000 7f8008e00700 1 --2- 172.21.15.49:0/2996302955 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7fdc05a510 0x7f7fdc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:39.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.238+0000 7f8008e00700 1 --2- 172.21.15.49:0/2996302955 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7fdc05a510 0x7f7fdc05c9d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f7ff4003860 tx=0x7f7ff4007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:39.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.242+0000 7f7ffbe00700 1 -- 172.21.15.49:0/2996302955 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7ffc049aa0 con 0x7f8004155d20 2024-01-22T05:09:39.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.406+0000 7f800b800700 1 -- 172.21.15.49:0/2996302955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80040c16d0 con 0x7f8004155d20 2024-01-22T05:09:39.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.406+0000 7f7ffbe00700 1 -- 172.21.15.49:0/2996302955 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+17538 (secure 0 0 0) 0x7f7ffc04d0c0 con 0x7f8004155d20 2024-01-22T05:09:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:39.412 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":76,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:09:24.515280+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:09:01.882090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-01-22T05:09:02.934332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.2e","mappings":[{"from":4,"to":3}]},{"pgid":"10.33","mappings":[{"from":4,"to":3}]},{"pgid":"10.3a","mappings":[{"from":7,"to":3}]},{"pgid":"11.2d","mappings":[{"from":6,"to":0}]},{"pgid":"11.3c","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6837/2817241041":"2024-01-23T05:09:18.080863+0000","172.21.15.49:6836/2817241041":"2024-01-23T05:09:18.080863+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:09:39.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.410+0000 7f800b800700 1 -- 172.21.15.49:0/2996302955 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7fdc05a510 msgr2=0x7f7fdc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:39.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.410+0000 7f800b800700 1 --2- 172.21.15.49:0/2996302955 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7fdc05a510 0x7f7fdc05c9d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f7ff4003860 tx=0x7f7ff4007d40).stop 2024-01-22T05:09:39.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.410+0000 7f800b800700 1 -- 172.21.15.49:0/2996302955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8004155d20 msgr2=0x7f80040a95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:39.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.410+0000 7f800b800700 1 --2- 172.21.15.49:0/2996302955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8004155d20 0x7f80040a95b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f7ffc009fd0 tx=0x7f7ffc009840).stop 2024-01-22T05:09:39.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.410+0000 7f800b800700 1 -- 172.21.15.49:0/2996302955 shutdown_connections 2024-01-22T05:09:39.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.410+0000 7f800b800700 1 --2- 172.21.15.49:0/2996302955 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7fdc05a510 0x7f7fdc05c9d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.410+0000 7f800b800700 1 --2- 172.21.15.49:0/2996302955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8004155d20 0x7f80040a95b0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.410+0000 7f800b800700 1 --2- 172.21.15.49:0/2996302955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80040c1ed0 0x7f8004169120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.410+0000 7f800b800700 1 --2- 172.21.15.49:0/2996302955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80040a8740 0x7f80041680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.410+0000 7f800b800700 1 -- 172.21.15.49:0/2996302955 >> 172.21.15.49:0/2996302955 conn(0x7f80040c6540 msgr2=0x7f80041583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:39.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.410+0000 7f800b800700 1 -- 172.21.15.49:0/2996302955 shutdown_connections 2024-01-22T05:09:39.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.410+0000 7f800b800700 1 -- 172.21.15.49:0/2996302955 wait complete. 2024-01-22T05:09:39.439 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:09:39.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.598+0000 7fb8e1400700 1 Processor -- start 2024-01-22T05:09:39.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.598+0000 7fb8e1400700 1 -- start start 2024-01-22T05:09:39.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.598+0000 7fb8e1400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8dc068fa0 0x7fb8dc0bee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:39.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.598+0000 7fb8e1400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb8dc063120 0x7fb8dc0c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:39.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.598+0000 7fb8e1400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8dc068b10 con 0x7fb8dc0bf380 2024-01-22T05:09:39.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.598+0000 7fb8e1400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8dc1583b0 con 0x7fb8dc068fa0 2024-01-22T05:09:39.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.598+0000 7fb8e1400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8dc0c4d30 con 0x7fb8dc063120 2024-01-22T05:09:39.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8dbe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8dc068fa0 0x7fb8dc0bee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:39.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8db400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb8dc0bf380 0x7fb8dc062a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60506/0 (socket says 172.21.15.49:60506) 2024-01-22T05:09:39.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8db400700 1 -- 172.21.15.49:0/1144762603 learned_addr learned my addr 172.21.15.49:0/1144762603 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:39.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8e0a00700 1 --2- 172.21.15.49:0/1144762603 >> v2:172.21.15.110:3300/0 conn(0x7fb8dc063120 0x7fb8dc0c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:39.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8daa00700 1 -- 172.21.15.49:0/1144762603 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302975902 0 0) 0x7fb8dc068b10 con 0x7fb8dc0bf380 2024-01-22T05:09:39.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8daa00700 1 -- 172.21.15.49:0/1144762603 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8bc0033f0 con 0x7fb8dc0bf380 2024-01-22T05:09:39.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8dbe00700 1 -- 172.21.15.49:0/1144762603 >> v2:172.21.15.110:3300/0 conn(0x7fb8dc063120 msgr2=0x7fb8dc0c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:39.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8dbe00700 1 --2- 172.21.15.49:0/1144762603 >> v2:172.21.15.110:3300/0 conn(0x7fb8dc063120 0x7fb8dc0c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8dbe00700 1 -- 172.21.15.49:0/1144762603 >> v1:172.21.15.49:6789/0 conn(0x7fb8dc0bf380 legacy=0x7fb8dc062a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:39.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8dbe00700 1 -- 172.21.15.49:0/1144762603 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc067f00 con 0x7fb8dc068fa0 2024-01-22T05:09:39.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8dbe00700 1 --2- 172.21.15.49:0/1144762603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8dc068fa0 0x7fb8dc0bee90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fb8dc059c60 tx=0x7fb8cc009060).ready entity=mon.0 client_cookie=3aca0570df2f2544 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:39.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8daa00700 1 -- 172.21.15.49:0/1144762603 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc00d4a0 con 0x7fb8dc068fa0 2024-01-22T05:09:39.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8daa00700 1 -- 172.21.15.49:0/1144762603 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc00d600 con 0x7fb8dc068fa0 2024-01-22T05:09:39.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8daa00700 1 -- 172.21.15.49:0/1144762603 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc00d980 con 0x7fb8dc068fa0 2024-01-22T05:09:39.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8e1400700 1 -- 172.21.15.49:0/1144762603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8dc068fa0 msgr2=0x7fb8dc0bee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:39.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.602+0000 7fb8e1400700 1 --2- 172.21.15.49:0/1144762603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8dc068fa0 0x7fb8dc0bee90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fb8dc059c60 tx=0x7fb8cc009060).stop 2024-01-22T05:09:39.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.606+0000 7fb8e1400700 1 -- 172.21.15.49:0/1144762603 shutdown_connections 2024-01-22T05:09:39.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.606+0000 7fb8e1400700 1 --2- 172.21.15.49:0/1144762603 >> v2:172.21.15.110:3300/0 conn(0x7fb8dc063120 0x7fb8dc0c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.606+0000 7fb8e1400700 1 --2- 172.21.15.49:0/1144762603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8dc068fa0 0x7fb8dc0bee90 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.606+0000 7fb8e1400700 1 -- 172.21.15.49:0/1144762603 >> 172.21.15.49:0/1144762603 conn(0x7fb8dc0c8740 msgr2=0x7fb8dc0c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:39.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.606+0000 7fb8e1400700 1 -- 172.21.15.49:0/1144762603 shutdown_connections 2024-01-22T05:09:39.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.606+0000 7fb8e1400700 1 -- 172.21.15.49:0/1144762603 wait complete. 2024-01-22T05:09:39.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.610+0000 7fb8e1400700 1 Processor -- start 2024-01-22T05:09:39.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.610+0000 7fb8e1400700 1 -- start start 2024-01-22T05:09:39.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.610+0000 7fb8e1400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8dc063120 0x7fb8dc0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.610+0000 7fb8e1400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8dc068fa0 0x7fb8dc154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.610+0000 7fb8e1400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8dc0c17e0 0x7fb8dc0c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.610+0000 7fb8e1400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0c2150 con 0x7fb8dc063120 2024-01-22T05:09:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.610+0000 7fb8e1400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0a9970 con 0x7fb8dc068fa0 2024-01-22T05:09:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.610+0000 7fb8e1400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0a9c50 con 0x7fb8dc0c17e0 2024-01-22T05:09:39.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.610+0000 7fb8dbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8dc063120 0x7fb8dc0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:39.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.610+0000 7fb8dbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8dc063120 0x7fb8dc0c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52050/0 (socket says 172.21.15.49:52050) 2024-01-22T05:09:39.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.610+0000 7fb8dbe00700 1 -- 172.21.15.49:0/4220727224 learned_addr learned my addr 172.21.15.49:0/4220727224 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:39.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.610+0000 7fb8db400700 1 --2- 172.21.15.49:0/4220727224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8dc068fa0 0x7fb8dc154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:39.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.610+0000 7fb8e0a00700 1 --2- 172.21.15.49:0/4220727224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8dc0c17e0 0x7fb8dc0c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:39.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.614+0000 7fb8dbe00700 1 -- 172.21.15.49:0/4220727224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8dc0c17e0 msgr2=0x7fb8dc0c1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:39.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.614+0000 7fb8dbe00700 1 --2- 172.21.15.49:0/4220727224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8dc0c17e0 0x7fb8dc0c1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.614+0000 7fb8dbe00700 1 -- 172.21.15.49:0/4220727224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8dc068fa0 msgr2=0x7fb8dc154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:39.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.614+0000 7fb8dbe00700 1 --2- 172.21.15.49:0/4220727224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8dc068fa0 0x7fb8dc154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:39.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.614+0000 7fb8dbe00700 1 -- 172.21.15.49:0/4220727224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc0092a0 con 0x7fb8dc063120 2024-01-22T05:09:39.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.614+0000 7fb8dbe00700 1 --2- 172.21.15.49:0/4220727224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8dc063120 0x7fb8dc0c7f30 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7fb8dc067270 tx=0x7fb8cc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:39.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.614+0000 7fb8d3400700 1 -- 172.21.15.49:0/4220727224 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc00dd30 con 0x7fb8dc063120 2024-01-22T05:09:39.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.614+0000 7fb8d3400700 1 -- 172.21.15.49:0/4220727224 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc00de90 con 0x7fb8dc063120 2024-01-22T05:09:39.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.614+0000 7fb8e1400700 1 -- 172.21.15.49:0/4220727224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8dc0a9f30 con 0x7fb8dc063120 2024-01-22T05:09:39.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.614+0000 7fb8d3400700 1 -- 172.21.15.49:0/4220727224 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc00d9c0 con 0x7fb8dc063120 2024-01-22T05:09:39.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.614+0000 7fb8e1400700 1 -- 172.21.15.49:0/4220727224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8dc0aa4f0 con 0x7fb8dc063120 2024-01-22T05:09:39.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.614+0000 7fb8e1400700 1 -- 172.21.15.49:0/4220727224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8dc0664e0 con 0x7fb8dc063120 2024-01-22T05:09:39.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.618+0000 7fb8d3400700 1 -- 172.21.15.49:0/4220727224 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb8cc0263b0 con 0x7fb8dc063120 2024-01-22T05:09:39.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.618+0000 7fb8d3400700 1 --2- 172.21.15.49:0/4220727224 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8b405a510 0x7fb8b405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:39.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.618+0000 7fb8d3400700 1 -- 172.21.15.49:0/4220727224 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fb8cc0758c0 con 0x7fb8dc063120 2024-01-22T05:09:39.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.618+0000 7fb8db400700 1 --2- 172.21.15.49:0/4220727224 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8b405a510 0x7fb8b405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:39.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.618+0000 7fb8db400700 1 --2- 172.21.15.49:0/4220727224 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8b405a510 0x7fb8b405c9d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fb8c4007fd0 tx=0x7fb8c4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:39.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.622+0000 7fb8d3400700 1 -- 172.21.15.49:0/4220727224 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb8cc048d30 con 0x7fb8dc063120 2024-01-22T05:09:39.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:39.834+0000 7fb8e1400700 1 -- 172.21.15.49:0/4220727224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb8dc0681e0 con 0x7fb8dc063120 2024-01-22T05:09:40.776 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:09:40.774+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:09:40.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.786+0000 7fb8d3400700 1 -- 172.21.15.49:0/4220727224 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb8cc022020 con 0x7fb8dc063120 2024-01-22T05:09:40.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.790+0000 7fb8e1400700 1 -- 172.21.15.49:0/4220727224 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8b405a510 msgr2=0x7fb8b405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:40.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.790+0000 7fb8e1400700 1 --2- 172.21.15.49:0/4220727224 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8b405a510 0x7fb8b405c9d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fb8c4007fd0 tx=0x7fb8c4009040).stop 2024-01-22T05:09:40.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.790+0000 7fb8e1400700 1 -- 172.21.15.49:0/4220727224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8dc063120 msgr2=0x7fb8dc0c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.790+0000 7fb8e1400700 1 --2- 172.21.15.49:0/4220727224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8dc063120 0x7fb8dc0c7f30 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7fb8dc067270 tx=0x7fb8cc016000).stop 2024-01-22T05:09:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.790+0000 7fb8e1400700 1 -- 172.21.15.49:0/4220727224 shutdown_connections 2024-01-22T05:09:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.790+0000 7fb8e1400700 1 --2- 172.21.15.49:0/4220727224 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8b405a510 0x7fb8b405c9d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.790+0000 7fb8e1400700 1 --2- 172.21.15.49:0/4220727224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8dc0c17e0 0x7fb8dc0c1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.790+0000 7fb8e1400700 1 --2- 172.21.15.49:0/4220727224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8dc068fa0 0x7fb8dc154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:40.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.790+0000 7fb8e1400700 1 --2- 172.21.15.49:0/4220727224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8dc063120 0x7fb8dc0c7f30 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:40.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.790+0000 7fb8e1400700 1 -- 172.21.15.49:0/4220727224 >> 172.21.15.49:0/4220727224 conn(0x7fb8dc0c8740 msgr2=0x7fb8dc0c6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:40.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.790+0000 7fb8e1400700 1 -- 172.21.15.49:0/4220727224 shutdown_connections 2024-01-22T05:09:40.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.790+0000 7fb8e1400700 1 -- 172.21.15.49:0/4220727224 wait complete. 2024-01-22T05:09:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:09:40.802 INFO:tasks.ceph.mds.a.smithi049.stderr: -1712> 2024-01-22T05:09:24.482+0000 7f0f5b800700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:09:40.819 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:09:40.845 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:09:40.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.978+0000 7f6b9a200700 1 Processor -- start 2024-01-22T05:09:40.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.978+0000 7f6b9a200700 1 -- start start 2024-01-22T05:09:40.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.982+0000 7f6b9a200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b94152970 0x7f6b940a8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:40.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.982+0000 7f6b9a200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6b940691b0 0x7f6b940bc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.982+0000 7f6b9a200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b94066d80 con 0x7f6b940a9460 2024-01-22T05:09:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.982+0000 7f6b9a200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b94155a00 con 0x7f6b940691b0 2024-01-22T05:09:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.982+0000 7f6b9a200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94155ce0 con 0x7f6b94152970 2024-01-22T05:09:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.982+0000 7f6b93400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b94152970 0x7f6b940a8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.982+0000 7f6b93400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b94152970 0x7f6b940a8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:42676/0 (socket says 172.21.15.49:42676) 2024-01-22T05:09:40.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.982+0000 7f6b93400700 1 -- 172.21.15.49:0/180434332 learned_addr learned my addr 172.21.15.49:0/180434332 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:40.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.982+0000 7f6b93e00700 1 --2- 172.21.15.49:0/180434332 >> v2:172.21.15.110:3300/0 conn(0x7f6b940691b0 0x7f6b940bc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:40.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b93400700 1 -- 172.21.15.49:0/180434332 >> v2:172.21.15.110:3300/0 conn(0x7f6b940691b0 msgr2=0x7f6b940bc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:40.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b93400700 1 --2- 172.21.15.49:0/180434332 >> v2:172.21.15.110:3300/0 conn(0x7f6b940691b0 0x7f6b940bc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:40.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b93400700 1 -- 172.21.15.49:0/180434332 >> v1:172.21.15.110:6789/0 conn(0x7f6b940a9460 legacy=0x7f6b94068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:40.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b93400700 1 -- 172.21.15.49:0/180434332 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b94155fc0 con 0x7f6b94152970 2024-01-22T05:09:40.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b93400700 1 --2- 172.21.15.49:0/180434332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b94152970 0x7f6b940a8f70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f6b84006fd0 tx=0x7f6b840090f0).ready entity=mon.2 client_cookie=11dd887a86e076e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:40.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b92000700 1 -- 172.21.15.49:0/180434332 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8400b580 con 0x7f6b94152970 2024-01-22T05:09:40.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b92000700 1 -- 172.21.15.49:0/180434332 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8400b6e0 con 0x7f6b94152970 2024-01-22T05:09:40.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b92000700 1 -- 172.21.15.49:0/180434332 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8400ba60 con 0x7f6b94152970 2024-01-22T05:09:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b9a200700 1 -- 172.21.15.49:0/180434332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b94152970 msgr2=0x7f6b940a8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b9a200700 1 --2- 172.21.15.49:0/180434332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b94152970 0x7f6b940a8f70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f6b84006fd0 tx=0x7f6b840090f0).stop 2024-01-22T05:09:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b9a200700 1 -- 172.21.15.49:0/180434332 shutdown_connections 2024-01-22T05:09:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b9a200700 1 --2- 172.21.15.49:0/180434332 >> v2:172.21.15.110:3300/0 conn(0x7f6b940691b0 0x7f6b940bc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:40.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b9a200700 1 --2- 172.21.15.49:0/180434332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b94152970 0x7f6b940a8f70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:40.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b9a200700 1 -- 172.21.15.49:0/180434332 >> 172.21.15.49:0/180434332 conn(0x7f6b940c4310 msgr2=0x7f6b94065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:40.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b9a200700 1 -- 172.21.15.49:0/180434332 shutdown_connections 2024-01-22T05:09:40.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.986+0000 7f6b9a200700 1 -- 172.21.15.49:0/180434332 wait complete. 2024-01-22T05:09:40.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.990+0000 7f6b9a200700 1 Processor -- start 2024-01-22T05:09:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.990+0000 7f6b9a200700 1 -- start start 2024-01-22T05:09:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b9a200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b940691b0 0x7f6b94147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b9a200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b940a9460 0x7f6b940bed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b9a200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b94152970 0x7f6b940bf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b9a200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b940bf8a0 con 0x7f6b94152970 2024-01-22T05:09:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b9a200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b940bfb80 con 0x7f6b940a9460 2024-01-22T05:09:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b9a200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b940bfe60 con 0x7f6b940691b0 2024-01-22T05:09:40.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b93e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b94152970 0x7f6b940bf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:41.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b93e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b94152970 0x7f6b940bf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52094/0 (socket says 172.21.15.49:52094) 2024-01-22T05:09:41.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b93e00700 1 -- 172.21.15.49:0/1595658545 learned_addr learned my addr 172.21.15.49:0/1595658545 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:41.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b93400700 1 --2- 172.21.15.49:0/1595658545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b940691b0 0x7f6b94147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:41.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b92a00700 1 --2- 172.21.15.49:0/1595658545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b940a9460 0x7f6b940bed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:41.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b93e00700 1 -- 172.21.15.49:0/1595658545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b940691b0 msgr2=0x7f6b94147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:41.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b93e00700 1 --2- 172.21.15.49:0/1595658545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b940691b0 0x7f6b94147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:41.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b93e00700 1 -- 172.21.15.49:0/1595658545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b940a9460 msgr2=0x7f6b940bed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:41.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b93e00700 1 --2- 172.21.15.49:0/1595658545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b940a9460 0x7f6b940bed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:41.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b93e00700 1 -- 172.21.15.49:0/1595658545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b84009370 con 0x7f6b94152970 2024-01-22T05:09:41.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b93e00700 1 --2- 172.21.15.49:0/1595658545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b94152970 0x7f6b940bf240 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f6b8c009ef0 tx=0x7f6b8c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:41.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b8aa00700 1 -- 172.21.15.49:0/1595658545 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c00cb70 con 0x7f6b94152970 2024-01-22T05:09:41.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b8aa00700 1 -- 172.21.15.49:0/1595658545 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c00f040 con 0x7f6b94152970 2024-01-22T05:09:41.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b9a200700 1 -- 172.21.15.49:0/1595658545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b940c0140 con 0x7f6b94152970 2024-01-22T05:09:41.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.994+0000 7f6b8aa00700 1 -- 172.21.15.49:0/1595658545 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c013400 con 0x7f6b94152970 2024-01-22T05:09:41.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.998+0000 7f6b9a200700 1 -- 172.21.15.49:0/1595658545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b940c0940 con 0x7f6b94152970 2024-01-22T05:09:41.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.998+0000 7f6b9a200700 1 -- 172.21.15.49:0/1595658545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b940c54e0 con 0x7f6b94152970 2024-01-22T05:09:41.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:40.998+0000 7f6b8aa00700 1 -- 172.21.15.49:0/1595658545 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6b8c0137b0 con 0x7f6b94152970 2024-01-22T05:09:41.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.002+0000 7f6b8aa00700 1 --2- 172.21.15.49:0/1595658545 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b6c05a510 0x7f6b6c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:41.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.002+0000 7f6b8aa00700 1 -- 172.21.15.49:0/1595658545 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f6b8c075280 con 0x7f6b94152970 2024-01-22T05:09:41.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.002+0000 7f6b93400700 1 --2- 172.21.15.49:0/1595658545 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b6c05a510 0x7f6b6c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:41.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.002+0000 7f6b93400700 1 --2- 172.21.15.49:0/1595658545 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b6c05a510 0x7f6b6c05c9d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f6b84009130 tx=0x7f6b84017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:41.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.006+0000 7f6b8aa00700 1 -- 172.21.15.49:0/1595658545 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6b940c54e0 con 0x7f6b94152970 2024-01-22T05:09:41.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.206+0000 7f6b9a200700 1 -- 172.21.15.49:0/1595658545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6b940c54e0 con 0x7f6b94152970 2024-01-22T05:09:41.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.790+0000 7f6b8aa00700 1 -- 172.21.15.49:0/1595658545 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6b940c54e0 con 0x7f6b94152970 2024-01-22T05:09:41.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.794+0000 7f6b9a200700 1 -- 172.21.15.49:0/1595658545 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b6c05a510 msgr2=0x7f6b6c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:41.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.794+0000 7f6b9a200700 1 --2- 172.21.15.49:0/1595658545 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b6c05a510 0x7f6b6c05c9d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f6b84009130 tx=0x7f6b84017000).stop 2024-01-22T05:09:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.794+0000 7f6b9a200700 1 -- 172.21.15.49:0/1595658545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b94152970 msgr2=0x7f6b940bf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.794+0000 7f6b9a200700 1 --2- 172.21.15.49:0/1595658545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b94152970 0x7f6b940bf240 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f6b8c009ef0 tx=0x7f6b8c00b040).stop 2024-01-22T05:09:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.794+0000 7f6b9a200700 1 -- 172.21.15.49:0/1595658545 shutdown_connections 2024-01-22T05:09:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.794+0000 7f6b9a200700 1 --2- 172.21.15.49:0/1595658545 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b6c05a510 0x7f6b6c05c9d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.794+0000 7f6b9a200700 1 --2- 172.21.15.49:0/1595658545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b94152970 0x7f6b940bf240 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.794+0000 7f6b9a200700 1 --2- 172.21.15.49:0/1595658545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b940a9460 0x7f6b940bed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.794+0000 7f6b9a200700 1 --2- 172.21.15.49:0/1595658545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b940691b0 0x7f6b94147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.794+0000 7f6b9a200700 1 -- 172.21.15.49:0/1595658545 >> 172.21.15.49:0/1595658545 conn(0x7f6b940c4310 msgr2=0x7f6b9414fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.794+0000 7f6b9a200700 1 -- 172.21.15.49:0/1595658545 shutdown_connections 2024-01-22T05:09:41.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:41.794+0000 7f6b9a200700 1 -- 172.21.15.49:0/1595658545 wait complete. 2024-01-22T05:09:41.824 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:09:42.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.050+0000 7f9a47800700 1 Processor -- start 2024-01-22T05:09:42.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.050+0000 7f9a47800700 1 -- start start 2024-01-22T05:09:42.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.054+0000 7f9a47800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a40160bd0 0x7f9a40162fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:42.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.054+0000 7f9a47800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a400a7cb0 con 0x7f9a40066690 2024-01-22T05:09:42.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.054+0000 7f9a47800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a400a8b10 con 0x7f9a400ac3b0 2024-01-22T05:09:42.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.054+0000 7f9a47800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a400a7f00 con 0x7f9a40160bd0 2024-01-22T05:09:42.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.054+0000 7f9a45800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a40160bd0 0x7f9a40162fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:42.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a45800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a40160bd0 0x7f9a40162fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52098/0 (socket says 172.21.15.49:52098) 2024-01-22T05:09:42.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a45800700 1 -- 172.21.15.49:0/2263662460 learned_addr learned my addr 172.21.15.49:0/2263662460 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:42.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a45800700 1 -- 172.21.15.49:0/2263662460 >> v1:172.21.15.110:6789/0 conn(0x7f9a400ac3b0 legacy=0x7f9a40159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:42.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a45800700 1 -- 172.21.15.49:0/2263662460 >> v1:172.21.15.49:6789/0 conn(0x7f9a40066690 legacy=0x7f9a40066af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:42.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a45800700 1 -- 172.21.15.49:0/2263662460 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a400a81e0 con 0x7f9a40160bd0 2024-01-22T05:09:42.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a3f400700 1 -- 172.21.15.49:0/2263662460 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494286480 0 0) 0x7f9a400a7cb0 con 0x7f9a40066690 2024-01-22T05:09:42.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a45800700 1 --2- 172.21.15.49:0/2263662460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a40160bd0 0x7f9a40162fc0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f9a38009f20 tx=0x7f9a38009840).ready entity=mon.0 client_cookie=a9a37a05b0b4d149 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:42.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a3f400700 1 -- 172.21.15.49:0/2263662460 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3800e070 con 0x7f9a40160bd0 2024-01-22T05:09:42.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a3f400700 1 -- 172.21.15.49:0/2263662460 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3800ba80 con 0x7f9a40160bd0 2024-01-22T05:09:42.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a3f400700 1 -- 172.21.15.49:0/2263662460 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3800be00 con 0x7f9a40160bd0 2024-01-22T05:09:42.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a47800700 1 -- 172.21.15.49:0/2263662460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a40160bd0 msgr2=0x7f9a40162fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:42.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a47800700 1 --2- 172.21.15.49:0/2263662460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a40160bd0 0x7f9a40162fc0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f9a38009f20 tx=0x7f9a38009840).stop 2024-01-22T05:09:42.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a47800700 1 -- 172.21.15.49:0/2263662460 shutdown_connections 2024-01-22T05:09:42.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a47800700 1 --2- 172.21.15.49:0/2263662460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a40160bd0 0x7f9a40162fc0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:42.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a47800700 1 -- 172.21.15.49:0/2263662460 >> 172.21.15.49:0/2263662460 conn(0x7f9a400c6500 msgr2=0x7f9a400c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:42.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a47800700 1 -- 172.21.15.49:0/2263662460 shutdown_connections 2024-01-22T05:09:42.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.058+0000 7f9a47800700 1 -- 172.21.15.49:0/2263662460 wait complete. 2024-01-22T05:09:42.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.062+0000 7f9a47800700 1 Processor -- start 2024-01-22T05:09:42.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.062+0000 7f9a47800700 1 -- start start 2024-01-22T05:09:42.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a47800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a40066690 0x7f9a401401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:42.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a47800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a400ac3b0 0x7f9a400bd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:42.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a47800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a40160bd0 0x7f9a4016be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:42.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a47800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400bec30 con 0x7f9a40160bd0 2024-01-22T05:09:42.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a47800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4013d8d0 con 0x7f9a400ac3b0 2024-01-22T05:09:42.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a47800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400be020 con 0x7f9a40066690 2024-01-22T05:09:42.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a45800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a40160bd0 0x7f9a4016be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:42.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a45800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a40160bd0 0x7f9a4016be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52104/0 (socket says 172.21.15.49:52104) 2024-01-22T05:09:42.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a45800700 1 -- 172.21.15.49:0/2257502650 learned_addr learned my addr 172.21.15.49:0/2257502650 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:42.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a44e00700 1 --2- 172.21.15.49:0/2257502650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a40066690 0x7f9a401401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:42.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a3fe00700 1 --2- 172.21.15.49:0/2257502650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a400ac3b0 0x7f9a400bd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:42.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a45800700 1 -- 172.21.15.49:0/2257502650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a40066690 msgr2=0x7f9a401401e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:42.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a45800700 1 --2- 172.21.15.49:0/2257502650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a40066690 0x7f9a401401e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:42.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a45800700 1 -- 172.21.15.49:0/2257502650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a400ac3b0 msgr2=0x7f9a400bd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:42.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a45800700 1 --2- 172.21.15.49:0/2257502650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a400ac3b0 0x7f9a400bd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:42.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a45800700 1 -- 172.21.15.49:0/2257502650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a38009ae0 con 0x7f9a40160bd0 2024-01-22T05:09:42.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a44e00700 1 --2- 172.21.15.49:0/2257502650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a40066690 0x7f9a401401e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:42.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a45800700 1 --2- 172.21.15.49:0/2257502650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a40160bd0 0x7f9a4016be50 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f9a40064350 tx=0x7f9a400a8a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:42.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a37e00700 1 -- 172.21.15.49:0/2257502650 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a380092e0 con 0x7f9a40160bd0 2024-01-22T05:09:42.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a37e00700 1 -- 172.21.15.49:0/2257502650 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3801d410 con 0x7f9a40160bd0 2024-01-22T05:09:42.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a37e00700 1 -- 172.21.15.49:0/2257502650 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3801d7b0 con 0x7f9a40160bd0 2024-01-22T05:09:42.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a47800700 1 -- 172.21.15.49:0/2257502650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a400be300 con 0x7f9a40160bd0 2024-01-22T05:09:42.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.066+0000 7f9a47800700 1 -- 172.21.15.49:0/2257502650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a400be8c0 con 0x7f9a40160bd0 2024-01-22T05:09:42.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.070+0000 7f9a47800700 1 -- 172.21.15.49:0/2257502650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a400beda0 con 0x7f9a40160bd0 2024-01-22T05:09:42.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.070+0000 7f9a37e00700 1 -- 172.21.15.49:0/2257502650 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9a3801db20 con 0x7f9a40160bd0 2024-01-22T05:09:42.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.070+0000 7f9a37e00700 1 --2- 172.21.15.49:0/2257502650 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a1805a4e0 0x7f9a1805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:42.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.070+0000 7f9a37e00700 1 -- 172.21.15.49:0/2257502650 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f9a38076590 con 0x7f9a40160bd0 2024-01-22T05:09:42.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.070+0000 7f9a44e00700 1 --2- 172.21.15.49:0/2257502650 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a1805a4e0 0x7f9a1805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:42.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.074+0000 7f9a44e00700 1 --2- 172.21.15.49:0/2257502650 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a1805a4e0 0x7f9a1805c9a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f9a30001c40 tx=0x7f9a30009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:42.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.078+0000 7f9a37e00700 1 -- 172.21.15.49:0/2257502650 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9a38049ad0 con 0x7f9a40160bd0 2024-01-22T05:09:42.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:42.242+0000 7f9a47800700 1 -- 172.21.15.49:0/2257502650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9a400c0ba0 con 0x7f9a40160bd0 2024-01-22T05:09:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.174+0000 7f9a37e00700 1 -- 172.21.15.49:0/2257502650 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9a3804d0f0 con 0x7f9a40160bd0 2024-01-22T05:09:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.182+0000 7f9a47800700 1 -- 172.21.15.49:0/2257502650 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a1805a4e0 msgr2=0x7f9a1805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.182+0000 7f9a47800700 1 --2- 172.21.15.49:0/2257502650 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a1805a4e0 0x7f9a1805c9a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f9a30001c40 tx=0x7f9a30009040).stop 2024-01-22T05:09:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.182+0000 7f9a47800700 1 -- 172.21.15.49:0/2257502650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a40160bd0 msgr2=0x7f9a4016be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.182+0000 7f9a47800700 1 --2- 172.21.15.49:0/2257502650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a40160bd0 0x7f9a4016be50 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f9a40064350 tx=0x7f9a400a8a80).stop 2024-01-22T05:09:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.182+0000 7f9a47800700 1 -- 172.21.15.49:0/2257502650 shutdown_connections 2024-01-22T05:09:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.182+0000 7f9a47800700 1 --2- 172.21.15.49:0/2257502650 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a1805a4e0 0x7f9a1805c9a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.182+0000 7f9a47800700 1 --2- 172.21.15.49:0/2257502650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a40160bd0 0x7f9a4016be50 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.182+0000 7f9a47800700 1 --2- 172.21.15.49:0/2257502650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a400ac3b0 0x7f9a400bd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.182+0000 7f9a47800700 1 --2- 172.21.15.49:0/2257502650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a40066690 0x7f9a401401e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.182+0000 7f9a47800700 1 -- 172.21.15.49:0/2257502650 >> 172.21.15.49:0/2257502650 conn(0x7f9a400c6500 msgr2=0x7f9a400ab5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:43.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.182+0000 7f9a47800700 1 -- 172.21.15.49:0/2257502650 shutdown_connections 2024-01-22T05:09:43.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.182+0000 7f9a47800700 1 -- 172.21.15.49:0/2257502650 wait complete. 2024-01-22T05:09:43.190 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:09:43.209 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:09:43.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.370+0000 7f6bace00700 1 Processor -- start 2024-01-22T05:09:43.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.374+0000 7f6bace00700 1 -- start start 2024-01-22T05:09:43.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6bace00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6ba8066690 0x7f6ba8066af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:43.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6bace00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba815fbc0 0x7f6ba8161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6bace00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba80a7cb0 con 0x7f6ba80ac3b0 2024-01-22T05:09:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6bace00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba80a8b10 con 0x7f6ba8066690 2024-01-22T05:09:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6bace00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80a7f00 con 0x7f6ba815fbc0 2024-01-22T05:09:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6ba5400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6ba8066690 0x7f6ba8066af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6ba5400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6ba8066690 0x7f6ba8066af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46686/0 (socket says 172.21.15.49:46686) 2024-01-22T05:09:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6ba5e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6ba80ac3b0 0x7f6ba8159000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:58240/0 (socket says 172.21.15.49:58240) 2024-01-22T05:09:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6ba5400700 1 -- 172.21.15.49:0/751489284 learned_addr learned my addr 172.21.15.49:0/751489284 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6ba6800700 1 --2- 172.21.15.49:0/751489284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba815fbc0 0x7f6ba8161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6ba4a00700 1 -- 172.21.15.49:0/751489284 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128779892 0 0) 0x7f6ba80a7cb0 con 0x7f6ba80ac3b0 2024-01-22T05:09:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6ba4a00700 1 -- 172.21.15.49:0/751489284 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b880033f0 con 0x7f6ba80ac3b0 2024-01-22T05:09:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6ba5400700 1 -- 172.21.15.49:0/751489284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba815fbc0 msgr2=0x7f6ba8161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6ba5400700 1 --2- 172.21.15.49:0/751489284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba815fbc0 0x7f6ba8161fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6ba5400700 1 -- 172.21.15.49:0/751489284 >> v1:172.21.15.110:6789/0 conn(0x7f6ba80ac3b0 legacy=0x7f6ba8159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6ba5400700 1 -- 172.21.15.49:0/751489284 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba80a81e0 con 0x7f6ba8066690 2024-01-22T05:09:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6ba5400700 1 --2- 172.21.15.49:0/751489284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ba8066690 0x7f6ba8066af0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f6b90006fd0 tx=0x7f6b900090f0).ready entity=mon.0 client_cookie=ad80b3c3033401e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6ba4a00700 1 -- 172.21.15.49:0/751489284 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9000f510 con 0x7f6ba8066690 2024-01-22T05:09:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6ba4a00700 1 -- 172.21.15.49:0/751489284 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9000f670 con 0x7f6ba8066690 2024-01-22T05:09:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.378+0000 7f6ba4a00700 1 -- 172.21.15.49:0/751489284 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9000f9f0 con 0x7f6ba8066690 2024-01-22T05:09:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.382+0000 7f6bace00700 1 -- 172.21.15.49:0/751489284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ba8066690 msgr2=0x7f6ba8066af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.382+0000 7f6bace00700 1 --2- 172.21.15.49:0/751489284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ba8066690 0x7f6ba8066af0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f6b90006fd0 tx=0x7f6b900090f0).stop 2024-01-22T05:09:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.382+0000 7f6bace00700 1 -- 172.21.15.49:0/751489284 shutdown_connections 2024-01-22T05:09:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.382+0000 7f6bace00700 1 --2- 172.21.15.49:0/751489284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba815fbc0 0x7f6ba8161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.382+0000 7f6bace00700 1 --2- 172.21.15.49:0/751489284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ba8066690 0x7f6ba8066af0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.382+0000 7f6bace00700 1 -- 172.21.15.49:0/751489284 >> 172.21.15.49:0/751489284 conn(0x7f6ba80c6500 msgr2=0x7f6ba80c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.382+0000 7f6bace00700 1 -- 172.21.15.49:0/751489284 shutdown_connections 2024-01-22T05:09:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.382+0000 7f6bace00700 1 -- 172.21.15.49:0/751489284 wait complete. 2024-01-22T05:09:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.386+0000 7f6bace00700 1 Processor -- start 2024-01-22T05:09:43.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.386+0000 7f6bace00700 1 -- start start 2024-01-22T05:09:43.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6bace00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ba8066690 0x7f6ba814c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:43.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6bace00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba80ac3b0 0x7f6ba814a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:43.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6bace00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ba815fbc0 0x7f6ba8150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:43.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6bace00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba814b020 con 0x7f6ba815fbc0 2024-01-22T05:09:43.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6bace00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba814ae10 con 0x7f6ba8066690 2024-01-22T05:09:43.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6bace00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba814b370 con 0x7f6ba80ac3b0 2024-01-22T05:09:43.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6ba5e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ba8066690 0x7f6ba814c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:43.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6ba5400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba80ac3b0 0x7f6ba814a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:43.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6ba6800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ba815fbc0 0x7f6ba8150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:43.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6ba5400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba80ac3b0 0x7f6ba814a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:50986/0 (socket says 172.21.15.49:50986) 2024-01-22T05:09:43.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6ba5400700 1 -- 172.21.15.49:0/2735244724 learned_addr learned my addr 172.21.15.49:0/2735244724 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:43.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6ba5400700 1 -- 172.21.15.49:0/2735244724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ba8066690 msgr2=0x7f6ba814c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:43.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6ba5400700 1 --2- 172.21.15.49:0/2735244724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ba8066690 0x7f6ba814c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:43.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6ba5400700 1 -- 172.21.15.49:0/2735244724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ba815fbc0 msgr2=0x7f6ba8150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:43.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6ba5400700 1 --2- 172.21.15.49:0/2735244724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ba815fbc0 0x7f6ba8150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:43.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6ba5400700 1 -- 172.21.15.49:0/2735244724 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b90009370 con 0x7f6ba80ac3b0 2024-01-22T05:09:43.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6ba5400700 1 --2- 172.21.15.49:0/2735244724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba80ac3b0 0x7f6ba814a920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f6ba8064350 tx=0x7f6b90017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:43.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6b9d600700 1 -- 172.21.15.49:0/2735244724 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9000fe80 con 0x7f6ba80ac3b0 2024-01-22T05:09:43.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.390+0000 7f6b9d600700 1 -- 172.21.15.49:0/2735244724 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9000f7e0 con 0x7f6ba80ac3b0 2024-01-22T05:09:43.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.394+0000 7f6bace00700 1 -- 172.21.15.49:0/2735244724 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba814b650 con 0x7f6ba80ac3b0 2024-01-22T05:09:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.394+0000 7f6b9d600700 1 -- 172.21.15.49:0/2735244724 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9001c650 con 0x7f6ba80ac3b0 2024-01-22T05:09:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.394+0000 7f6bace00700 1 -- 172.21.15.49:0/2735244724 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba814bc10 con 0x7f6ba80ac3b0 2024-01-22T05:09:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.394+0000 7f6bace00700 1 -- 172.21.15.49:0/2735244724 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba80c0ba0 con 0x7f6ba80ac3b0 2024-01-22T05:09:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.394+0000 7f6b9d600700 1 -- 172.21.15.49:0/2735244724 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6b9001ca40 con 0x7f6ba80ac3b0 2024-01-22T05:09:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.398+0000 7f6b9d600700 1 --2- 172.21.15.49:0/2735244724 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b8005a510 0x7f6b8005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.398+0000 7f6b9d600700 1 -- 172.21.15.49:0/2735244724 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6266+0+0 (secure 0 0 0) 0x7f6b90076380 con 0x7f6ba80ac3b0 2024-01-22T05:09:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.398+0000 7f6ba5e00700 1 --2- 172.21.15.49:0/2735244724 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b8005a510 0x7f6b8005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:43.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.398+0000 7f6ba5e00700 1 --2- 172.21.15.49:0/2735244724 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b8005a510 0x7f6b8005c9d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f6b98007640 tx=0x7f6b98007bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:43.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.406+0000 7f6b9d600700 1 -- 172.21.15.49:0/2735244724 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6b90049a10 con 0x7f6ba80ac3b0 2024-01-22T05:09:43.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:43.578+0000 7f6bace00700 1 -- 172.21.15.49:0/2735244724 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ba8046800 con 0x7f6ba80ac3b0 2024-01-22T05:09:44.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.186+0000 7f6b9d600700 1 -- 172.21.15.49:0/2735244724 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6b9002a020 con 0x7f6ba80ac3b0 2024-01-22T05:09:44.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.190+0000 7f6bace00700 1 -- 172.21.15.49:0/2735244724 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b8005a510 msgr2=0x7f6b8005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:44.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.190+0000 7f6bace00700 1 --2- 172.21.15.49:0/2735244724 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b8005a510 0x7f6b8005c9d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f6b98007640 tx=0x7f6b98007bc0).stop 2024-01-22T05:09:44.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.190+0000 7f6bace00700 1 -- 172.21.15.49:0/2735244724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba80ac3b0 msgr2=0x7f6ba814a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:44.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.190+0000 7f6bace00700 1 --2- 172.21.15.49:0/2735244724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba80ac3b0 0x7f6ba814a920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f6ba8064350 tx=0x7f6b90017000).stop 2024-01-22T05:09:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.190+0000 7f6bace00700 1 -- 172.21.15.49:0/2735244724 shutdown_connections 2024-01-22T05:09:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.190+0000 7f6bace00700 1 --2- 172.21.15.49:0/2735244724 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b8005a510 0x7f6b8005c9d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.190+0000 7f6bace00700 1 --2- 172.21.15.49:0/2735244724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ba815fbc0 0x7f6ba8150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.190+0000 7f6bace00700 1 --2- 172.21.15.49:0/2735244724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba80ac3b0 0x7f6ba814a920 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.190+0000 7f6bace00700 1 --2- 172.21.15.49:0/2735244724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ba8066690 0x7f6ba814c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.190+0000 7f6bace00700 1 -- 172.21.15.49:0/2735244724 >> 172.21.15.49:0/2735244724 conn(0x7f6ba80c6500 msgr2=0x7f6ba8159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:44.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.190+0000 7f6bace00700 1 -- 172.21.15.49:0/2735244724 shutdown_connections 2024-01-22T05:09:44.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.190+0000 7f6bace00700 1 -- 172.21.15.49:0/2735244724 wait complete. 2024-01-22T05:09:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-01-22T05:09:44.218 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-22T05:09:44.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.386+0000 7f1552a00700 1 Processor -- start 2024-01-22T05:09:44.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.390+0000 7f1552a00700 1 -- start start 2024-01-22T05:09:44.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.390+0000 7f1552a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f154c1524f0 0x7f154c066400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:44.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.390+0000 7f1552a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154c0bd3e0 con 0x7f154c0a8e70 2024-01-22T05:09:44.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f1552a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154c067c50 con 0x7f154c15bad0 2024-01-22T05:09:44.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f1552a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154c0bcb40 con 0x7f154c1524f0 2024-01-22T05:09:44.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f1550a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f154c0a8e70 0x7f154c0680e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41786/0 (socket says 172.21.15.49:41786) 2024-01-22T05:09:44.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f1550a00700 1 -- 172.21.15.49:0/3343347301 learned_addr learned my addr 172.21.15.49:0/3343347301 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:44.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f154be00700 1 --2- 172.21.15.49:0/3343347301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f154c1524f0 0x7f154c066400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:44.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f154aa00700 1 -- 172.21.15.49:0/3343347301 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028117511 0 0) 0x7f154c067c50 con 0x7f154c15bad0 2024-01-22T05:09:44.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f154aa00700 1 -- 172.21.15.49:0/3343347301 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f152c0033f0 con 0x7f154c15bad0 2024-01-22T05:09:44.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f154aa00700 1 -- 172.21.15.49:0/3343347301 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005850889 0 0) 0x7f154c0bd3e0 con 0x7f154c0a8e70 2024-01-22T05:09:44.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f154aa00700 1 -- 172.21.15.49:0/3343347301 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f154c067c50 con 0x7f154c0a8e70 2024-01-22T05:09:44.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f154aa00700 1 -- 172.21.15.49:0/3343347301 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3388010460 0 0) 0x7f152c0033f0 con 0x7f154c15bad0 2024-01-22T05:09:44.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f154be00700 1 -- 172.21.15.49:0/3343347301 >> v1:172.21.15.110:6789/0 conn(0x7f154c15bad0 legacy=0x7f154c0a8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:44.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f154be00700 1 -- 172.21.15.49:0/3343347301 >> v1:172.21.15.49:6789/0 conn(0x7f154c0a8e70 legacy=0x7f154c0680e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:44.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f154be00700 1 -- 172.21.15.49:0/3343347301 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c0bce20 con 0x7f154c1524f0 2024-01-22T05:09:44.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f154be00700 1 --2- 172.21.15.49:0/3343347301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f154c1524f0 0x7f154c066400 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f153c009790 tx=0x7f153c009060).ready entity=mon.2 client_cookie=2fe1862d3eda846b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:44.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f154aa00700 1 -- 172.21.15.49:0/3343347301 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544001620 con 0x7f154c1524f0 2024-01-22T05:09:44.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f154aa00700 1 -- 172.21.15.49:0/3343347301 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c012410 con 0x7f154c1524f0 2024-01-22T05:09:44.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.394+0000 7f154aa00700 1 -- 172.21.15.49:0/3343347301 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1534001470 con 0x7f154c1524f0 2024-01-22T05:09:44.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.398+0000 7f1552a00700 1 -- 172.21.15.49:0/3343347301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f154c1524f0 msgr2=0x7f154c066400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:44.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.398+0000 7f1552a00700 1 --2- 172.21.15.49:0/3343347301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f154c1524f0 0x7f154c066400 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f153c009790 tx=0x7f153c009060).stop 2024-01-22T05:09:44.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.398+0000 7f1552a00700 1 -- 172.21.15.49:0/3343347301 shutdown_connections 2024-01-22T05:09:44.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.398+0000 7f1552a00700 1 --2- 172.21.15.49:0/3343347301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f154c1524f0 0x7f154c066400 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.398+0000 7f1552a00700 1 -- 172.21.15.49:0/3343347301 >> 172.21.15.49:0/3343347301 conn(0x7f154c0c6560 msgr2=0x7f154c0c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:44.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.398+0000 7f1552a00700 1 -- 172.21.15.49:0/3343347301 shutdown_connections 2024-01-22T05:09:44.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.398+0000 7f1552a00700 1 -- 172.21.15.49:0/3343347301 wait complete. 2024-01-22T05:09:44.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.398+0000 7f1552a00700 1 Processor -- start 2024-01-22T05:09:44.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.402+0000 7f1552a00700 1 -- start start 2024-01-22T05:09:44.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.402+0000 7f1552a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0a8e70 0x7f154c0689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:44.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.402+0000 7f1552a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f154c1524f0 0x7f154c14f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:44.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.402+0000 7f1552a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c15bad0 0x7f154c150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:44.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.402+0000 7f1552a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c0c0320 con 0x7f154c0a8e70 2024-01-22T05:09:44.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.402+0000 7f1552a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c0bf710 con 0x7f154c15bad0 2024-01-22T05:09:44.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.402+0000 7f1552a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154c0bf9f0 con 0x7f154c1524f0 2024-01-22T05:09:44.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.402+0000 7f154be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0a8e70 0x7f154c0689a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:44.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.402+0000 7f154be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0a8e70 0x7f154c0689a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46714/0 (socket says 172.21.15.49:46714) 2024-01-22T05:09:44.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.402+0000 7f154be00700 1 -- 172.21.15.49:0/2251352722 learned_addr learned my addr 172.21.15.49:0/2251352722 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:44.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.402+0000 7f1550a00700 1 --2- 172.21.15.49:0/2251352722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c15bad0 0x7f154c150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:44.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.406+0000 7f154b400700 1 --2- 172.21.15.49:0/2251352722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f154c1524f0 0x7f154c14f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:44.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.406+0000 7f154be00700 1 -- 172.21.15.49:0/2251352722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f154c1524f0 msgr2=0x7f154c14f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:44.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.406+0000 7f154be00700 1 --2- 172.21.15.49:0/2251352722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f154c1524f0 0x7f154c14f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.406+0000 7f154be00700 1 -- 172.21.15.49:0/2251352722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c15bad0 msgr2=0x7f154c150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:44.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.406+0000 7f154be00700 1 --2- 172.21.15.49:0/2251352722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c15bad0 0x7f154c150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.406+0000 7f154be00700 1 -- 172.21.15.49:0/2251352722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c0092a0 con 0x7f154c0a8e70 2024-01-22T05:09:44.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.406+0000 7f154be00700 1 --2- 172.21.15.49:0/2251352722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0a8e70 0x7f154c0689a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f153c009d80 tx=0x7f154c159510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:44.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.406+0000 7f1543400700 1 -- 172.21.15.49:0/2251352722 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c012e10 con 0x7f154c0a8e70 2024-01-22T05:09:44.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.406+0000 7f1543400700 1 -- 172.21.15.49:0/2251352722 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c011ba0 con 0x7f154c0a8e70 2024-01-22T05:09:44.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.406+0000 7f1552a00700 1 -- 172.21.15.49:0/2251352722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154c0bfcd0 con 0x7f154c0a8e70 2024-01-22T05:09:44.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.406+0000 7f1543400700 1 -- 172.21.15.49:0/2251352722 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c01d3f0 con 0x7f154c0a8e70 2024-01-22T05:09:44.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.406+0000 7f1552a00700 1 -- 172.21.15.49:0/2251352722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154c068e90 con 0x7f154c0a8e70 2024-01-22T05:09:44.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.410+0000 7f1552a00700 1 -- 172.21.15.49:0/2251352722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154c047060 con 0x7f154c0a8e70 2024-01-22T05:09:44.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.410+0000 7f1543400700 1 -- 172.21.15.49:0/2251352722 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f153c01d7a0 con 0x7f154c0a8e70 2024-01-22T05:09:44.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.410+0000 7f1543400700 1 --2- 172.21.15.49:0/2251352722 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f152405a510 0x7f152405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:44.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.410+0000 7f1543400700 1 -- 172.21.15.49:0/2251352722 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f153c075fe0 con 0x7f154c0a8e70 2024-01-22T05:09:44.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.410+0000 7f154b400700 1 --2- 172.21.15.49:0/2251352722 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f152405a510 0x7f152405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:44.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.414+0000 7f154b400700 1 --2- 172.21.15.49:0/2251352722 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f152405a510 0x7f152405c9d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f154c1594e0 tx=0x7f1534002910).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:44.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.418+0000 7f1543400700 1 -- 172.21.15.49:0/2251352722 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f153c0a4b00 con 0x7f154c0a8e70 2024-01-22T05:09:44.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.574+0000 7f1552a00700 1 -- 172.21.15.49:0/2251352722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f154c047060 con 0x7f154c0a8e70 2024-01-22T05:09:44.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.582+0000 7f1543400700 1 -- 172.21.15.49:0/2251352722 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f153c0498c0 con 0x7f154c0a8e70 2024-01-22T05:09:44.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.586+0000 7f1552a00700 1 -- 172.21.15.49:0/2251352722 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f152405a510 msgr2=0x7f152405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:44.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.586+0000 7f1552a00700 1 --2- 172.21.15.49:0/2251352722 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f152405a510 0x7f152405c9d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f154c1594e0 tx=0x7f1534002910).stop 2024-01-22T05:09:44.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.586+0000 7f1552a00700 1 -- 172.21.15.49:0/2251352722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0a8e70 msgr2=0x7f154c0689a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:44.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.586+0000 7f1552a00700 1 --2- 172.21.15.49:0/2251352722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0a8e70 0x7f154c0689a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f153c009d80 tx=0x7f154c159510).stop 2024-01-22T05:09:44.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.586+0000 7f1552a00700 1 -- 172.21.15.49:0/2251352722 shutdown_connections 2024-01-22T05:09:44.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.586+0000 7f1552a00700 1 --2- 172.21.15.49:0/2251352722 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f152405a510 0x7f152405c9d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.586+0000 7f1552a00700 1 --2- 172.21.15.49:0/2251352722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c15bad0 0x7f154c150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.586+0000 7f1552a00700 1 --2- 172.21.15.49:0/2251352722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f154c1524f0 0x7f154c14f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.586+0000 7f1552a00700 1 --2- 172.21.15.49:0/2251352722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154c0a8e70 0x7f154c0689a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.586+0000 7f1552a00700 1 -- 172.21.15.49:0/2251352722 >> 172.21.15.49:0/2251352722 conn(0x7f154c0c6560 msgr2=0x7f154c0c2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.586+0000 7f1552a00700 1 -- 172.21.15.49:0/2251352722 shutdown_connections 2024-01-22T05:09:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.586+0000 7f1552a00700 1 -- 172.21.15.49:0/2251352722 wait complete. 2024-01-22T05:09:44.613 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-01-22T05:09:44.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.770+0000 7f57d3400700 1 Processor -- start 2024-01-22T05:09:44.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.770+0000 7f57d3400700 1 -- start start 2024-01-22T05:09:44.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d3400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57cc065660 0x7f57cc0a6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:44.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57cc0644f0 0x7f57cc064950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:44.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f57cc1575b0 0x7f57cc157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:44.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d3400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57cc0c2700 con 0x7f57cc1575b0 2024-01-22T05:09:44.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d3400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57cc064e40 con 0x7f57cc065660 2024-01-22T05:09:44.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d3400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc0c2930 con 0x7f57cc0644f0 2024-01-22T05:09:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d1e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f57cc1575b0 0x7f57cc157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d1e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f57cc1575b0 0x7f57cc157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46716/0 (socket says 172.21.15.49:46716) 2024-01-22T05:09:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d1e00700 1 -- 172.21.15.49:0/547297207 learned_addr learned my addr 172.21.15.49:0/547297207 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57cbe00700 1 --2- 172.21.15.49:0/547297207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57cc0644f0 0x7f57cc064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d0a00700 1 --2- 172.21.15.49:0/547297207 >> v2:172.21.15.110:3300/0 conn(0x7f57cc065660 0x7f57cc0a6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d1e00700 1 -- 172.21.15.49:0/547297207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57cc0644f0 msgr2=0x7f57cc064950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d1e00700 1 --2- 172.21.15.49:0/547297207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57cc0644f0 0x7f57cc064950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d1e00700 1 -- 172.21.15.49:0/547297207 >> v2:172.21.15.110:3300/0 conn(0x7f57cc065660 msgr2=0x7f57cc0a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d1e00700 1 --2- 172.21.15.49:0/547297207 >> v2:172.21.15.110:3300/0 conn(0x7f57cc065660 0x7f57cc0a6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d1e00700 1 -- 172.21.15.49:0/547297207 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc0c2c10 con 0x7f57cc1575b0 2024-01-22T05:09:44.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57d1e00700 1 --2- 172.21.15.49:0/547297207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57cc1575b0 0x7f57cc157a40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f57c4009f20 tx=0x7f57c4009840).ready entity=mon.0 client_cookie=ab40c41d2516443c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:44.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57cb400700 1 -- 172.21.15.49:0/547297207 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c400e070 con 0x7f57cc1575b0 2024-01-22T05:09:44.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57cb400700 1 -- 172.21.15.49:0/547297207 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c400b930 con 0x7f57cc1575b0 2024-01-22T05:09:44.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.774+0000 7f57cb400700 1 -- 172.21.15.49:0/547297207 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c400bcb0 con 0x7f57cc1575b0 2024-01-22T05:09:44.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.778+0000 7f57d3400700 1 -- 172.21.15.49:0/547297207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57cc1575b0 msgr2=0x7f57cc157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:44.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.778+0000 7f57d3400700 1 --2- 172.21.15.49:0/547297207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57cc1575b0 0x7f57cc157a40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f57c4009f20 tx=0x7f57c4009840).stop 2024-01-22T05:09:44.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.778+0000 7f57d3400700 1 -- 172.21.15.49:0/547297207 shutdown_connections 2024-01-22T05:09:44.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.778+0000 7f57d3400700 1 --2- 172.21.15.49:0/547297207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57cc1575b0 0x7f57cc157a40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.778+0000 7f57d3400700 1 --2- 172.21.15.49:0/547297207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57cc0644f0 0x7f57cc064950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.778+0000 7f57d3400700 1 --2- 172.21.15.49:0/547297207 >> v2:172.21.15.110:3300/0 conn(0x7f57cc065660 0x7f57cc0a6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.778+0000 7f57d3400700 1 -- 172.21.15.49:0/547297207 >> 172.21.15.49:0/547297207 conn(0x7f57cc0c87f0 msgr2=0x7f57cc0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:44.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.778+0000 7f57d3400700 1 -- 172.21.15.49:0/547297207 shutdown_connections 2024-01-22T05:09:44.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.778+0000 7f57d3400700 1 -- 172.21.15.49:0/547297207 wait complete. 2024-01-22T05:09:44.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.782+0000 7f57d3400700 1 Processor -- start 2024-01-22T05:09:44.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.782+0000 7f57d3400700 1 -- start start 2024-01-22T05:09:44.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.782+0000 7f57d3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57cc0644f0 0x7f57cc154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:44.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57d3400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57cc065660 0x7f57cc0ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:44.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57d3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57cc1575b0 0x7f57cc1528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:44.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57d3400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc168010 con 0x7f57cc1575b0 2024-01-22T05:09:44.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57d3400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc154f70 con 0x7f57cc065660 2024-01-22T05:09:44.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57d3400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc0c17c0 con 0x7f57cc0644f0 2024-01-22T05:09:44.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57d0a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57cc0644f0 0x7f57cc154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:44.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57d0a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57cc0644f0 0x7f57cc154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:51024/0 (socket says 172.21.15.49:51024) 2024-01-22T05:09:44.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57d0a00700 1 -- 172.21.15.49:0/3599336093 learned_addr learned my addr 172.21.15.49:0/3599336093 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:44.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57cbe00700 1 --2- 172.21.15.49:0/3599336093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57cc065660 0x7f57cc0ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:44.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57d1e00700 1 --2- 172.21.15.49:0/3599336093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57cc1575b0 0x7f57cc1528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:44.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57d0a00700 1 -- 172.21.15.49:0/3599336093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57cc065660 msgr2=0x7f57cc0ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:44.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57d0a00700 1 --2- 172.21.15.49:0/3599336093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57cc065660 0x7f57cc0ab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57d0a00700 1 -- 172.21.15.49:0/3599336093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57cc1575b0 msgr2=0x7f57cc1528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:44.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57d0a00700 1 --2- 172.21.15.49:0/3599336093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57cc1575b0 0x7f57cc1528a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:44.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57d0a00700 1 -- 172.21.15.49:0/3599336093 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4009ae0 con 0x7f57cc0644f0 2024-01-22T05:09:44.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.786+0000 7f57d0a00700 1 --2- 172.21.15.49:0/3599336093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57cc0644f0 0x7f57cc154a80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f57bc00e930 tx=0x7f57bc009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:44.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.790+0000 7f57c3e00700 1 -- 172.21.15.49:0/3599336093 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc00eed0 con 0x7f57cc0644f0 2024-01-22T05:09:44.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.790+0000 7f57c3e00700 1 -- 172.21.15.49:0/3599336093 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc00c850 con 0x7f57cc0644f0 2024-01-22T05:09:44.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.790+0000 7f57c3e00700 1 -- 172.21.15.49:0/3599336093 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc00cbd0 con 0x7f57cc0644f0 2024-01-22T05:09:44.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.790+0000 7f57d3400700 1 -- 172.21.15.49:0/3599336093 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57cc167400 con 0x7f57cc0644f0 2024-01-22T05:09:44.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.790+0000 7f57d3400700 1 -- 172.21.15.49:0/3599336093 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57cc1679c0 con 0x7f57cc0644f0 2024-01-22T05:09:44.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.790+0000 7f57d3400700 1 -- 172.21.15.49:0/3599336093 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57cc047060 con 0x7f57cc0644f0 2024-01-22T05:09:44.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.794+0000 7f57c3e00700 1 -- 172.21.15.49:0/3599336093 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f57bc01b400 con 0x7f57cc0644f0 2024-01-22T05:09:44.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.794+0000 7f57c3e00700 1 --2- 172.21.15.49:0/3599336093 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f57a405a560 0x7f57a405ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:44.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.794+0000 7f57c3e00700 1 -- 172.21.15.49:0/3599336093 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f57bc074ca0 con 0x7f57cc0644f0 2024-01-22T05:09:44.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.794+0000 7f57cbe00700 1 --2- 172.21.15.49:0/3599336093 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f57a405a560 0x7f57a405ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:44.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.794+0000 7f57cbe00700 1 --2- 172.21.15.49:0/3599336093 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f57a405a560 0x7f57a405ca20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f57cc0adb70 tx=0x7f57b4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:44.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:44.798+0000 7f57c3e00700 1 -- 172.21.15.49:0/3599336093 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f57bc048520 con 0x7f57cc0644f0 2024-01-22T05:09:45.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.018+0000 7f57d3400700 1 -- 172.21.15.49:0/3599336093 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) v1 -- 0x7f57cc0c2ef0 con 0x7f57cc0644f0 2024-01-22T05:09:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.190+0000 7f57c3e00700 1 -- 172.21.15.49:0/3599336093 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v270) v1 ==== 143+0+0 (secure 0 0 0) 0x7f57bc04bb40 con 0x7f57cc0644f0 2024-01-22T05:09:45.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.194+0000 7f57d3400700 1 -- 172.21.15.49:0/3599336093 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f57a405a560 msgr2=0x7f57a405ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:45.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.194+0000 7f57d3400700 1 --2- 172.21.15.49:0/3599336093 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f57a405a560 0x7f57a405ca20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f57cc0adb70 tx=0x7f57b4008040).stop 2024-01-22T05:09:45.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.194+0000 7f57d3400700 1 -- 172.21.15.49:0/3599336093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57cc0644f0 msgr2=0x7f57cc154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:45.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.194+0000 7f57d3400700 1 --2- 172.21.15.49:0/3599336093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57cc0644f0 0x7f57cc154a80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f57bc00e930 tx=0x7f57bc009060).stop 2024-01-22T05:09:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.194+0000 7f57d3400700 1 -- 172.21.15.49:0/3599336093 shutdown_connections 2024-01-22T05:09:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.194+0000 7f57d3400700 1 --2- 172.21.15.49:0/3599336093 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f57a405a560 0x7f57a405ca20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.194+0000 7f57d3400700 1 --2- 172.21.15.49:0/3599336093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57cc1575b0 0x7f57cc1528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.194+0000 7f57d3400700 1 --2- 172.21.15.49:0/3599336093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57cc065660 0x7f57cc0ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.194+0000 7f57d3400700 1 --2- 172.21.15.49:0/3599336093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57cc0644f0 0x7f57cc154a80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.194+0000 7f57d3400700 1 -- 172.21.15.49:0/3599336093 >> 172.21.15.49:0/3599336093 conn(0x7f57cc0c87f0 msgr2=0x7f57cc0a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.194+0000 7f57d3400700 1 -- 172.21.15.49:0/3599336093 shutdown_connections 2024-01-22T05:09:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.194+0000 7f57d3400700 1 -- 172.21.15.49:0/3599336093 wait complete. 2024-01-22T05:09:45.225 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-01-22T05:09:45.225 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) test that scrub can iterate over ~mdsdir and evaluate strays 2024-01-22T05:09:45.226 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-01-22T05:09:45.226 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-01-22T05:09:45.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.390+0000 7f4869800700 1 Processor -- start 2024-01-22T05:09:45.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.394+0000 7f4869800700 1 -- start start 2024-01-22T05:09:45.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.394+0000 7f4869800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f48640a9770 0x7f48640be450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:45.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.394+0000 7f4869800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4864069250 con 0x7f48640be940 2024-01-22T05:09:45.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.394+0000 7f4869800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48640bf140 con 0x7f48640c3b30 2024-01-22T05:09:45.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.394+0000 7f4869800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4864068460 con 0x7f48640a9770 2024-01-22T05:09:45.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4863e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f48640c3b30 0x7f48640bdd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:58268/0 (socket says 172.21.15.49:58268) 2024-01-22T05:09:45.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4863400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f48640a9770 0x7f48640be450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:45.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4863e00700 1 -- 172.21.15.49:0/4051995672 learned_addr learned my addr 172.21.15.49:0/4051995672 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:45.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4863400700 1 -- 172.21.15.49:0/4051995672 >> v1:172.21.15.110:6789/0 conn(0x7f48640c3b30 legacy=0x7f48640bdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:45.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4862a00700 1 -- 172.21.15.49:0/4051995672 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729682315 0 0) 0x7f48640bf140 con 0x7f48640c3b30 2024-01-22T05:09:45.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4863400700 1 -- 172.21.15.49:0/4051995672 >> v1:172.21.15.49:6789/0 conn(0x7f48640be940 legacy=0x7f486415b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:45.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4863400700 1 -- 172.21.15.49:0/4051995672 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4864068640 con 0x7f48640a9770 2024-01-22T05:09:45.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4863400700 1 --2- 172.21.15.49:0/4051995672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48640a9770 0x7f48640be450 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f484c009760 tx=0x7f484c009060).ready entity=mon.0 client_cookie=d7665db7258f6afb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:45.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4862a00700 1 -- 172.21.15.49:0/4051995672 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c00b580 con 0x7f48640a9770 2024-01-22T05:09:45.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4862a00700 1 -- 172.21.15.49:0/4051995672 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484c00b6e0 con 0x7f48640a9770 2024-01-22T05:09:45.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4862a00700 1 -- 172.21.15.49:0/4051995672 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c00ba60 con 0x7f48640a9770 2024-01-22T05:09:45.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4869800700 1 -- 172.21.15.49:0/4051995672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48640a9770 msgr2=0x7f48640be450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:45.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4869800700 1 --2- 172.21.15.49:0/4051995672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48640a9770 0x7f48640be450 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f484c009760 tx=0x7f484c009060).stop 2024-01-22T05:09:45.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4869800700 1 -- 172.21.15.49:0/4051995672 shutdown_connections 2024-01-22T05:09:45.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4869800700 1 --2- 172.21.15.49:0/4051995672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48640a9770 0x7f48640be450 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:45.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4869800700 1 -- 172.21.15.49:0/4051995672 >> 172.21.15.49:0/4051995672 conn(0x7f48640c8740 msgr2=0x7f48640c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:45.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4869800700 1 -- 172.21.15.49:0/4051995672 shutdown_connections 2024-01-22T05:09:45.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.398+0000 7f4869800700 1 -- 172.21.15.49:0/4051995672 wait complete. 2024-01-22T05:09:45.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.402+0000 7f4869800700 1 Processor -- start 2024-01-22T05:09:45.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.402+0000 7f4869800700 1 -- start start 2024-01-22T05:09:45.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.402+0000 7f4869800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48640a9770 0x7f4864149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:45.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.402+0000 7f4869800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48640be940 0x7f4864063a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:45.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.402+0000 7f4869800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48640c3b30 0x7f4864167f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:45.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.402+0000 7f4869800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4864158da0 con 0x7f48640a9770 2024-01-22T05:09:45.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.402+0000 7f4869800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4864167ae0 con 0x7f48640c3b30 2024-01-22T05:09:45.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.402+0000 7f4869800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4864158500 con 0x7f48640be940 2024-01-22T05:09:45.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f4863e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48640a9770 0x7f4864149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:45.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f4863e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48640a9770 0x7f4864149d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46732/0 (socket says 172.21.15.49:46732) 2024-01-22T05:09:45.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f4863e00700 1 -- 172.21.15.49:0/2592391396 learned_addr learned my addr 172.21.15.49:0/2592391396 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:45.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f4863400700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48640be940 0x7f4864063a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:45.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f4868e00700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48640c3b30 0x7f4864167f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:45.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f4863e00700 1 -- 172.21.15.49:0/2592391396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48640be940 msgr2=0x7f4864063a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:45.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f4863e00700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48640be940 0x7f4864063a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:45.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f4863e00700 1 -- 172.21.15.49:0/2592391396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48640c3b30 msgr2=0x7f4864167f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:45.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f4863e00700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48640c3b30 0x7f4864167f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:45.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f4863e00700 1 -- 172.21.15.49:0/2592391396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c0092a0 con 0x7f48640a9770 2024-01-22T05:09:45.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f4863400700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48640be940 0x7f4864063a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:45.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f4868e00700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48640c3b30 0x7f4864167f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:45.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f4863e00700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48640a9770 0x7f4864149d70 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f4854001eb0 tx=0x7f4854007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:45.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f485b400700 1 -- 172.21.15.49:0/2592391396 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48540072e0 con 0x7f48640a9770 2024-01-22T05:09:45.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f485b400700 1 -- 172.21.15.49:0/2592391396 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4854007440 con 0x7f48640a9770 2024-01-22T05:09:45.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f485b400700 1 -- 172.21.15.49:0/2592391396 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48540057a0 con 0x7f48640a9770 2024-01-22T05:09:45.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f4869800700 1 -- 172.21.15.49:0/2592391396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48641587e0 con 0x7f48640a9770 2024-01-22T05:09:45.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.406+0000 7f4869800700 1 -- 172.21.15.49:0/2592391396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486414a260 con 0x7f48640a9770 2024-01-22T05:09:45.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.410+0000 7f4869800700 1 -- 172.21.15.49:0/2592391396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48640c2f30 con 0x7f48640a9770 2024-01-22T05:09:45.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.410+0000 7f485b400700 1 -- 172.21.15.49:0/2592391396 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4854005b90 con 0x7f48640a9770 2024-01-22T05:09:45.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.410+0000 7f485b400700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f483c05a510 0x7f483c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:45.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.410+0000 7f485b400700 1 -- 172.21.15.49:0/2592391396 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f4854073f20 con 0x7f48640a9770 2024-01-22T05:09:45.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.410+0000 7f4863400700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f483c05a510 0x7f483c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:45.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.414+0000 7f4863400700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f483c05a510 0x7f483c05c9d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f484c009760 tx=0x7f484c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:45.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.418+0000 7f485b400700 1 -- 172.21.15.49:0/2592391396 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f48640c2f30 con 0x7f48640a9770 2024-01-22T05:09:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:45.642+0000 7f4869800700 1 -- 172.21.15.49:0/2592391396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) v1 -- 0x7f48640c2f30 con 0x7f48640a9770 2024-01-22T05:09:46.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.194+0000 7f485b400700 1 -- 172.21.15.49:0/2592391396 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v271) v1 ==== 161+0+0 (secure 0 0 0) 0x7f48640c2f30 con 0x7f48640a9770 2024-01-22T05:09:46.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.202+0000 7f4869800700 1 -- 172.21.15.49:0/2592391396 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f483c05a510 msgr2=0x7f483c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:46.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.202+0000 7f4869800700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f483c05a510 0x7f483c05c9d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f484c009760 tx=0x7f484c017000).stop 2024-01-22T05:09:46.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.202+0000 7f4869800700 1 -- 172.21.15.49:0/2592391396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48640a9770 msgr2=0x7f4864149d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:46.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.202+0000 7f4869800700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48640a9770 0x7f4864149d70 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f4854001eb0 tx=0x7f4854007e90).stop 2024-01-22T05:09:46.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.202+0000 7f4869800700 1 -- 172.21.15.49:0/2592391396 shutdown_connections 2024-01-22T05:09:46.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.202+0000 7f4869800700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f483c05a510 0x7f483c05c9d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.202+0000 7f4869800700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48640c3b30 0x7f4864167f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.202+0000 7f4869800700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48640be940 0x7f4864063a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.202+0000 7f4869800700 1 --2- 172.21.15.49:0/2592391396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48640a9770 0x7f4864149d70 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.202+0000 7f4869800700 1 -- 172.21.15.49:0/2592391396 >> 172.21.15.49:0/2592391396 conn(0x7f48640c8740 msgr2=0x7f48640aac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:46.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.202+0000 7f4869800700 1 -- 172.21.15.49:0/2592391396 shutdown_connections 2024-01-22T05:09:46.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.202+0000 7f4869800700 1 -- 172.21.15.49:0/2592391396 wait complete. 2024-01-22T05:09:46.231 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-22T05:09:46.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.394+0000 7f07f2e00700 1 Processor -- start 2024-01-22T05:09:46.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.398+0000 7f07f2e00700 1 -- start start 2024-01-22T05:09:46.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07f2e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07ec155a90 0x7f07ec0688c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:46.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07f2e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07ec14ea50 0x7f07ec14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:46.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07f2e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ec0c6ad0 con 0x7f07ec0a7e90 2024-01-22T05:09:46.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07f2e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ec068f00 con 0x7f07ec155a90 2024-01-22T05:09:46.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07f2e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec0691e0 con 0x7f07ec14ea50 2024-01-22T05:09:46.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07eb400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07ec155a90 0x7f07ec0688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:46.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07eb400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07ec155a90 0x7f07ec0688c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46734/0 (socket says 172.21.15.49:46734) 2024-01-22T05:09:46.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07eb400700 1 -- 172.21.15.49:0/4016070230 learned_addr learned my addr 172.21.15.49:0/4016070230 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:46.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07f0e00700 1 --2- 172.21.15.49:0/4016070230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07ec14ea50 0x7f07ec14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:46.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07eaa00700 1 -- 172.21.15.49:0/4016070230 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791014351 0 0) 0x7f07ec0c6ad0 con 0x7f07ec0a7e90 2024-01-22T05:09:46.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07eb400700 1 -- 172.21.15.49:0/4016070230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07ec14ea50 msgr2=0x7f07ec14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:46.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07eb400700 1 --2- 172.21.15.49:0/4016070230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07ec14ea50 0x7f07ec14eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07eb400700 1 -- 172.21.15.49:0/4016070230 >> v1:172.21.15.110:6789/0 conn(0x7f07ec0a7e90 legacy=0x7f07ec155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:46.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07eb400700 1 -- 172.21.15.49:0/4016070230 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec0c6d90 con 0x7f07ec155a90 2024-01-22T05:09:46.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07eb400700 1 --2- 172.21.15.49:0/4016070230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ec155a90 0x7f07ec0688c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f07d4006fd0 tx=0x7f07d40090f0).ready entity=mon.0 client_cookie=5dc0c8bf40756c9f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:46.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07eaa00700 1 -- 172.21.15.49:0/4016070230 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400b580 con 0x7f07ec155a90 2024-01-22T05:09:46.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07eaa00700 1 -- 172.21.15.49:0/4016070230 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d400b6e0 con 0x7f07ec155a90 2024-01-22T05:09:46.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.402+0000 7f07eaa00700 1 -- 172.21.15.49:0/4016070230 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400ba60 con 0x7f07ec155a90 2024-01-22T05:09:46.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.406+0000 7f07f2e00700 1 -- 172.21.15.49:0/4016070230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ec155a90 msgr2=0x7f07ec0688c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:46.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.406+0000 7f07f2e00700 1 --2- 172.21.15.49:0/4016070230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ec155a90 0x7f07ec0688c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f07d4006fd0 tx=0x7f07d40090f0).stop 2024-01-22T05:09:46.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.406+0000 7f07f2e00700 1 -- 172.21.15.49:0/4016070230 shutdown_connections 2024-01-22T05:09:46.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.406+0000 7f07f2e00700 1 --2- 172.21.15.49:0/4016070230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07ec14ea50 0x7f07ec14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.406+0000 7f07f2e00700 1 --2- 172.21.15.49:0/4016070230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ec155a90 0x7f07ec0688c0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.406+0000 7f07f2e00700 1 -- 172.21.15.49:0/4016070230 >> 172.21.15.49:0/4016070230 conn(0x7f07ec0c9270 msgr2=0x7f07ec0c5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:46.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.406+0000 7f07f2e00700 1 -- 172.21.15.49:0/4016070230 shutdown_connections 2024-01-22T05:09:46.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.406+0000 7f07f2e00700 1 -- 172.21.15.49:0/4016070230 wait complete. 2024-01-22T05:09:46.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.410+0000 7f07f2e00700 1 Processor -- start 2024-01-22T05:09:46.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.410+0000 7f07f2e00700 1 -- start start 2024-01-22T05:09:46.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.410+0000 7f07f2e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ec14ea50 0x7f07ec13d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:46.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.410+0000 7f07f2e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07ec155a90 0x7f07ec13dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.410+0000 7f07f2e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07ec13e130 0x7f07ec0ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.410+0000 7f07f2e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec0c1880 con 0x7f07ec14ea50 2024-01-22T05:09:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.410+0000 7f07f2e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec0c0f90 con 0x7f07ec155a90 2024-01-22T05:09:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.410+0000 7f07f2e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec0c1230 con 0x7f07ec13e130 2024-01-22T05:09:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07ebe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ec14ea50 0x7f07ec13d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07ebe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ec14ea50 0x7f07ec13d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46746/0 (socket says 172.21.15.49:46746) 2024-01-22T05:09:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07ebe00700 1 -- 172.21.15.49:0/1638425585 learned_addr learned my addr 172.21.15.49:0/1638425585 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07f0e00700 1 --2- 172.21.15.49:0/1638425585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07ec13e130 0x7f07ec0ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07eb400700 1 --2- 172.21.15.49:0/1638425585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07ec155a90 0x7f07ec13dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07ebe00700 1 -- 172.21.15.49:0/1638425585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07ec13e130 msgr2=0x7f07ec0ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:46.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07ebe00700 1 --2- 172.21.15.49:0/1638425585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07ec13e130 0x7f07ec0ac6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07ebe00700 1 -- 172.21.15.49:0/1638425585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07ec155a90 msgr2=0x7f07ec13dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:46.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07ebe00700 1 --2- 172.21.15.49:0/1638425585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07ec155a90 0x7f07ec13dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07ebe00700 1 -- 172.21.15.49:0/1638425585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d4009370 con 0x7f07ec14ea50 2024-01-22T05:09:46.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07ebe00700 1 --2- 172.21.15.49:0/1638425585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ec14ea50 0x7f07ec13d0f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f07dc001eb0 tx=0x7f07dc007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:46.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07e3400700 1 -- 172.21.15.49:0/1638425585 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc00ce60 con 0x7f07ec14ea50 2024-01-22T05:09:46.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07e3400700 1 -- 172.21.15.49:0/1638425585 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc00f470 con 0x7f07ec14ea50 2024-01-22T05:09:46.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07e3400700 1 -- 172.21.15.49:0/1638425585 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc00f810 con 0x7f07ec14ea50 2024-01-22T05:09:46.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07f2e00700 1 -- 172.21.15.49:0/1638425585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ec0c1510 con 0x7f07ec14ea50 2024-01-22T05:09:46.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.414+0000 7f07f2e00700 1 -- 172.21.15.49:0/1638425585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ec0ad180 con 0x7f07ec14ea50 2024-01-22T05:09:46.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.418+0000 7f07e3400700 1 -- 172.21.15.49:0/1638425585 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f07dc00fb80 con 0x7f07ec14ea50 2024-01-22T05:09:46.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.418+0000 7f07f2e00700 1 -- 172.21.15.49:0/1638425585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ec0c4ef0 con 0x7f07ec14ea50 2024-01-22T05:09:46.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.418+0000 7f07e3400700 1 --2- 172.21.15.49:0/1638425585 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07c405a540 0x7f07c405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:46.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.418+0000 7f07e3400700 1 -- 172.21.15.49:0/1638425585 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f07dc073b40 con 0x7f07ec14ea50 2024-01-22T05:09:46.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.418+0000 7f07eb400700 1 --2- 172.21.15.49:0/1638425585 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07c405a540 0x7f07c405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:46.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.418+0000 7f07eb400700 1 --2- 172.21.15.49:0/1638425585 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07c405a540 0x7f07c405ca00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f07ec155e90 tx=0x7f07d4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:46.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.422+0000 7f07e3400700 1 -- 172.21.15.49:0/1638425585 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f07ec0c4ef0 con 0x7f07ec14ea50 2024-01-22T05:09:46.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.586+0000 7f07f2e00700 1 -- 172.21.15.49:0/1638425585 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f07ec0c4ef0 con 0x7f07ec14ea50 2024-01-22T05:09:46.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.594+0000 7f07e3400700 1 -- 172.21.15.49:0/1638425585 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f07ec0c4ef0 con 0x7f07ec14ea50 2024-01-22T05:09:46.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.598+0000 7f07f2e00700 1 -- 172.21.15.49:0/1638425585 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07c405a540 msgr2=0x7f07c405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:46.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.598+0000 7f07f2e00700 1 --2- 172.21.15.49:0/1638425585 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07c405a540 0x7f07c405ca00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f07ec155e90 tx=0x7f07d4017000).stop 2024-01-22T05:09:46.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.598+0000 7f07f2e00700 1 -- 172.21.15.49:0/1638425585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ec14ea50 msgr2=0x7f07ec13d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:46.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.598+0000 7f07f2e00700 1 --2- 172.21.15.49:0/1638425585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ec14ea50 0x7f07ec13d0f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f07dc001eb0 tx=0x7f07dc007c70).stop 2024-01-22T05:09:46.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.598+0000 7f07f2e00700 1 -- 172.21.15.49:0/1638425585 shutdown_connections 2024-01-22T05:09:46.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.598+0000 7f07f2e00700 1 --2- 172.21.15.49:0/1638425585 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07c405a540 0x7f07c405ca00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.598+0000 7f07f2e00700 1 --2- 172.21.15.49:0/1638425585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07ec13e130 0x7f07ec0ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.598+0000 7f07f2e00700 1 --2- 172.21.15.49:0/1638425585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07ec155a90 0x7f07ec13dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.598+0000 7f07f2e00700 1 --2- 172.21.15.49:0/1638425585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07ec14ea50 0x7f07ec13d0f0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.598+0000 7f07f2e00700 1 -- 172.21.15.49:0/1638425585 >> 172.21.15.49:0/1638425585 conn(0x7f07ec0c9270 msgr2=0x7f07ec0c5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:46.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.598+0000 7f07f2e00700 1 -- 172.21.15.49:0/1638425585 shutdown_connections 2024-01-22T05:09:46.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.598+0000 7f07f2e00700 1 -- 172.21.15.49:0/1638425585 wait complete. 2024-01-22T05:09:46.627 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:09:46.627 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:09:46.670 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:09:46.713 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:09:46.713 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-22T05:09:46.713 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:09:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.870+0000 7feda4a00700 1 Processor -- start 2024-01-22T05:09:46.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.874+0000 7feda4a00700 1 -- start start 2024-01-22T05:09:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda4a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed9c066fb0 0x7fed9c0c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda4a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fed9c0a8f90 0x7fed9c065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda4a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9c0c1ee0 con 0x7fed9c0a8b10 2024-01-22T05:09:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda4a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c0c12f0 con 0x7fed9c0a8f90 2024-01-22T05:09:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda4a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0c15b0 con 0x7fed9c066fb0 2024-01-22T05:09:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda2a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fed9c0a8f90 0x7fed9c065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda2000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed9c066fb0 0x7fed9c0c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda1600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fed9c0a8b10 0x7fed9c157740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41804/0 (socket says 172.21.15.49:41804) 2024-01-22T05:09:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda1600700 1 -- 172.21.15.49:0/7482448 learned_addr learned my addr 172.21.15.49:0/7482448 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda2a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fed9c0a8f90 0x7fed9c065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46762/0 (socket says 172.21.15.49:46762) 2024-01-22T05:09:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda0c00700 1 -- 172.21.15.49:0/7482448 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149933443 0 0) 0x7fed9c0c1ee0 con 0x7fed9c0a8b10 2024-01-22T05:09:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda2a00700 1 -- 172.21.15.49:0/7482448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed9c066fb0 msgr2=0x7fed9c0c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda2a00700 1 --2- 172.21.15.49:0/7482448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed9c066fb0 0x7fed9c0c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda2a00700 1 -- 172.21.15.49:0/7482448 >> v1:172.21.15.49:6789/0 conn(0x7fed9c0a8b10 legacy=0x7fed9c157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda2a00700 1 -- 172.21.15.49:0/7482448 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c0c1890 con 0x7fed9c0a8f90 2024-01-22T05:09:46.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda2a00700 1 --2- 172.21.15.49:0/7482448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed9c0a8f90 0x7fed9c065b80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fed94009e90 tx=0x7fed94009780).ready entity=mon.0 client_cookie=4f7ede36e663b90a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:46.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda0c00700 1 -- 172.21.15.49:0/7482448 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400e070 con 0x7fed9c0a8f90 2024-01-22T05:09:46.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda0c00700 1 -- 172.21.15.49:0/7482448 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400bb20 con 0x7fed9c0a8f90 2024-01-22T05:09:46.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.878+0000 7feda0c00700 1 -- 172.21.15.49:0/7482448 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400bea0 con 0x7fed9c0a8f90 2024-01-22T05:09:46.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.882+0000 7feda4a00700 1 -- 172.21.15.49:0/7482448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed9c0a8f90 msgr2=0x7fed9c065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:46.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.882+0000 7feda4a00700 1 --2- 172.21.15.49:0/7482448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed9c0a8f90 0x7fed9c065b80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fed94009e90 tx=0x7fed94009780).stop 2024-01-22T05:09:46.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.882+0000 7feda4a00700 1 -- 172.21.15.49:0/7482448 shutdown_connections 2024-01-22T05:09:46.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.882+0000 7feda4a00700 1 --2- 172.21.15.49:0/7482448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed9c0a8f90 0x7fed9c065b80 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.882+0000 7feda4a00700 1 --2- 172.21.15.49:0/7482448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed9c066fb0 0x7fed9c0c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.882+0000 7feda4a00700 1 -- 172.21.15.49:0/7482448 >> 172.21.15.49:0/7482448 conn(0x7fed9c0c6540 msgr2=0x7fed9c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:46.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.882+0000 7feda4a00700 1 -- 172.21.15.49:0/7482448 shutdown_connections 2024-01-22T05:09:46.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.882+0000 7feda4a00700 1 -- 172.21.15.49:0/7482448 wait complete. 2024-01-22T05:09:46.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.886+0000 7feda4a00700 1 Processor -- start 2024-01-22T05:09:46.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.886+0000 7feda4a00700 1 -- start start 2024-01-22T05:09:46.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.886+0000 7feda4a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed9c066fb0 0x7fed9c0bdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:46.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.886+0000 7feda4a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed9c0a8b10 0x7fed9c157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:46.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.886+0000 7feda4a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed9c0a8f90 0x7fed9c13cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:46.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.886+0000 7feda4a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0ab0e0 con 0x7fed9c0a8f90 2024-01-22T05:09:46.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.886+0000 7feda4a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0a9b20 con 0x7fed9c0a8b10 2024-01-22T05:09:46.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.886+0000 7feda4a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0a9e00 con 0x7fed9c066fb0 2024-01-22T05:09:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.886+0000 7feda2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed9c0a8f90 0x7fed9c13cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.886+0000 7feda2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed9c0a8f90 0x7fed9c13cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46776/0 (socket says 172.21.15.49:46776) 2024-01-22T05:09:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.886+0000 7feda2a00700 1 -- 172.21.15.49:0/2328958340 learned_addr learned my addr 172.21.15.49:0/2328958340 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.886+0000 7feda2000700 1 --2- 172.21.15.49:0/2328958340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed9c066fb0 0x7fed9c0bdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.886+0000 7feda1600700 1 --2- 172.21.15.49:0/2328958340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed9c0a8b10 0x7fed9c157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.890+0000 7feda2a00700 1 -- 172.21.15.49:0/2328958340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed9c066fb0 msgr2=0x7fed9c0bdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.890+0000 7feda2a00700 1 --2- 172.21.15.49:0/2328958340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed9c066fb0 0x7fed9c0bdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.890+0000 7feda2a00700 1 -- 172.21.15.49:0/2328958340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed9c0a8b10 msgr2=0x7fed9c157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.890+0000 7feda2a00700 1 --2- 172.21.15.49:0/2328958340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed9c0a8b10 0x7fed9c157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.890+0000 7feda2a00700 1 -- 172.21.15.49:0/2328958340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed94009a20 con 0x7fed9c0a8f90 2024-01-22T05:09:46.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.890+0000 7feda2a00700 1 --2- 172.21.15.49:0/2328958340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed9c0a8f90 0x7fed9c13cf50 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fed9c059c60 tx=0x7fed94009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:46.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.890+0000 7fed99600700 1 -- 172.21.15.49:0/2328958340 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9401d630 con 0x7fed9c0a8f90 2024-01-22T05:09:46.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.890+0000 7fed99600700 1 -- 172.21.15.49:0/2328958340 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9401d790 con 0x7fed9c0a8f90 2024-01-22T05:09:46.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.890+0000 7feda4a00700 1 -- 172.21.15.49:0/2328958340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c0aa0e0 con 0x7fed9c0a8f90 2024-01-22T05:09:46.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.890+0000 7fed99600700 1 -- 172.21.15.49:0/2328958340 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9401db50 con 0x7fed9c0a8f90 2024-01-22T05:09:46.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.890+0000 7feda4a00700 1 -- 172.21.15.49:0/2328958340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c0be4a0 con 0x7fed9c0a8f90 2024-01-22T05:09:46.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.890+0000 7feda4a00700 1 -- 172.21.15.49:0/2328958340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c047060 con 0x7fed9c0a8f90 2024-01-22T05:09:46.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.894+0000 7fed99600700 1 -- 172.21.15.49:0/2328958340 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fed94003040 con 0x7fed9c0a8f90 2024-01-22T05:09:46.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.894+0000 7fed99600700 1 --2- 172.21.15.49:0/2328958340 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fed7405a510 0x7fed7405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:46.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.894+0000 7fed99600700 1 -- 172.21.15.49:0/2328958340 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5794+0+0 (secure 0 0 0) 0x7fed94076600 con 0x7fed9c0a8f90 2024-01-22T05:09:46.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.894+0000 7feda2000700 1 --2- 172.21.15.49:0/2328958340 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fed7405a510 0x7fed7405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:46.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.894+0000 7feda2000700 1 --2- 172.21.15.49:0/2328958340 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fed7405a510 0x7fed7405c9d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fed8c009c30 tx=0x7fed8c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:46.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:46.902+0000 7fed99600700 1 -- 172.21.15.49:0/2328958340 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fed94049e00 con 0x7fed9c0a8f90 2024-01-22T05:09:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.102+0000 7feda4a00700 1 -- 172.21.15.49:0/2328958340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed9c0c1b70 con 0x7fed9c0a8f90 2024-01-22T05:09:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.102+0000 7fed99600700 1 -- 172.21.15.49:0/2328958340 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fed9404d420 con 0x7fed9c0a8f90 2024-01-22T05:09:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:47.108 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/4087795616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4087795616},{"type":"v1","addr":"172.21.15.110:6833","nonce":4087795616}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3220435249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3220435249},{"type":"v1","addr":"172.21.15.110:6835","nonce":3220435249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3927178750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3927178750},{"type":"v1","addr":"172.21.15.49:6835","nonce":3927178750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6765,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3521207335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3521207335},{"type":"v1","addr":"172.21.15.49:6837","nonce":3521207335}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[]} 2024-01-22T05:09:47.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.106+0000 7feda4a00700 1 -- 172.21.15.49:0/2328958340 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fed7405a510 msgr2=0x7fed7405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:47.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.106+0000 7feda4a00700 1 --2- 172.21.15.49:0/2328958340 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fed7405a510 0x7fed7405c9d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fed8c009c30 tx=0x7fed8c009060).stop 2024-01-22T05:09:47.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.106+0000 7feda4a00700 1 -- 172.21.15.49:0/2328958340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed9c0a8f90 msgr2=0x7fed9c13cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:47.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.106+0000 7feda4a00700 1 --2- 172.21.15.49:0/2328958340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed9c0a8f90 0x7fed9c13cf50 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fed9c059c60 tx=0x7fed94009780).stop 2024-01-22T05:09:47.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.106+0000 7feda4a00700 1 -- 172.21.15.49:0/2328958340 shutdown_connections 2024-01-22T05:09:47.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.106+0000 7feda4a00700 1 --2- 172.21.15.49:0/2328958340 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fed7405a510 0x7fed7405c9d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:47.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.106+0000 7feda4a00700 1 --2- 172.21.15.49:0/2328958340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed9c0a8f90 0x7fed9c13cf50 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:47.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.106+0000 7feda4a00700 1 --2- 172.21.15.49:0/2328958340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed9c0a8b10 0x7fed9c157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:47.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.106+0000 7feda4a00700 1 --2- 172.21.15.49:0/2328958340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed9c066fb0 0x7fed9c0bdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:47.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.106+0000 7feda4a00700 1 -- 172.21.15.49:0/2328958340 >> 172.21.15.49:0/2328958340 conn(0x7fed9c0c6540 msgr2=0x7fed9c14c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:47.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.106+0000 7feda4a00700 1 -- 172.21.15.49:0/2328958340 shutdown_connections 2024-01-22T05:09:47.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.106+0000 7feda4a00700 1 -- 172.21.15.49:0/2328958340 wait complete. 2024-01-22T05:09:47.114 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 64 2024-01-22T05:09:47.134 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:09:47.134 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-22T05:09:47.134 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:09:47.135 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:09:47.135 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:09:47.135 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-22T05:09:47.135 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:09:47.135 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:09:47.135 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:09:47.135 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-22T05:09:47.136 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:09:47.136 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:09:47.136 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:09:47.136 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-22T05:09:47.136 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:09:47.136 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:09:47.155 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:09:47.156 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:09:47.157 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:09:47.158 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:09:47.158 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:09:47.158 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:09:47.159 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:09:47.159 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:09:47.206 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:09:47.206 DEBUG:teuthology.parallel:result is None 2024-01-22T05:09:47.209 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:09:47.209 DEBUG:teuthology.parallel:result is None 2024-01-22T05:09:47.210 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:09:47.210 DEBUG:teuthology.parallel:result is None 2024-01-22T05:09:47.214 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:09:47.214 DEBUG:teuthology.parallel:result is None 2024-01-22T05:09:47.214 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-22T05:09:47.308 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:09:47.320 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:09:47.321 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-22T05:09:47.321 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:09:47.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.370+0000 7f54bb000700 1 Processor -- start 2024-01-22T05:09:47.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.370+0000 7f54bb000700 1 -- start start 2024-01-22T05:09:47.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.374+0000 7f54bb000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54b40bd8a0 0x7f54b40bdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:47.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.374+0000 7f54bb000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b4068840 con 0x7f54b4062810 2024-01-22T05:09:47.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.374+0000 7f54bb000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b40be1f0 con 0x7f54b4153d90 2024-01-22T05:09:47.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.374+0000 7f54bb000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b40693e0 con 0x7f54b40bd8a0 2024-01-22T05:09:47.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.374+0000 7f54b3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54b40bd8a0 0x7f54b40bdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:47.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.374+0000 7f54b9000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f54b4062810 0x7f54b4062c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41826/0 (socket says 172.21.15.49:41826) 2024-01-22T05:09:47.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.374+0000 7f54b3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54b40bd8a0 0x7f54b40bdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46814/0 (socket says 172.21.15.49:46814) 2024-01-22T05:09:47.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.374+0000 7f54b9000700 1 -- 172.21.15.49:0/247774497 learned_addr learned my addr 172.21.15.49:0/247774497 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:47.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.374+0000 7f54b3400700 1 -- 172.21.15.49:0/247774497 >> v1:172.21.15.110:6789/0 conn(0x7f54b4153d90 legacy=0x7f54b4068cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:47.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.374+0000 7f54b3400700 1 -- 172.21.15.49:0/247774497 >> v1:172.21.15.49:6789/0 conn(0x7f54b4062810 legacy=0x7f54b4062c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:47.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.374+0000 7f54b3400700 1 -- 172.21.15.49:0/247774497 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b4067c30 con 0x7f54b40bd8a0 2024-01-22T05:09:47.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.374+0000 7f54b3400700 1 --2- 172.21.15.49:0/247774497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b40bd8a0 0x7f54b40bdd00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f549c009760 tx=0x7f549c009060).ready entity=mon.0 client_cookie=db5265a88fda0daa server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:47.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.374+0000 7f54b2a00700 1 -- 172.21.15.49:0/247774497 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c00b580 con 0x7f54b40bd8a0 2024-01-22T05:09:47.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.374+0000 7f54b2a00700 1 -- 172.21.15.49:0/247774497 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c00b6e0 con 0x7f54b40bd8a0 2024-01-22T05:09:47.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.374+0000 7f54b2a00700 1 -- 172.21.15.49:0/247774497 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c00ba60 con 0x7f54b40bd8a0 2024-01-22T05:09:47.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.378+0000 7f54bb000700 1 -- 172.21.15.49:0/247774497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b40bd8a0 msgr2=0x7f54b40bdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:47.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.378+0000 7f54bb000700 1 --2- 172.21.15.49:0/247774497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b40bd8a0 0x7f54b40bdd00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f549c009760 tx=0x7f549c009060).stop 2024-01-22T05:09:47.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.378+0000 7f54bb000700 1 -- 172.21.15.49:0/247774497 shutdown_connections 2024-01-22T05:09:47.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.378+0000 7f54bb000700 1 --2- 172.21.15.49:0/247774497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b40bd8a0 0x7f54b40bdd00 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:47.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.378+0000 7f54bb000700 1 -- 172.21.15.49:0/247774497 >> 172.21.15.49:0/247774497 conn(0x7f54b40c51c0 msgr2=0x7f54b40c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:47.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.378+0000 7f54bb000700 1 -- 172.21.15.49:0/247774497 shutdown_connections 2024-01-22T05:09:47.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.378+0000 7f54bb000700 1 -- 172.21.15.49:0/247774497 wait complete. 2024-01-22T05:09:47.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.382+0000 7f54bb000700 1 Processor -- start 2024-01-22T05:09:47.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.382+0000 7f54bb000700 1 -- start start 2024-01-22T05:09:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.382+0000 7f54bb000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54b4062810 0x7f54b41528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.382+0000 7f54bb000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54b40bd8a0 0x7f54b40acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.382+0000 7f54bb000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b40c17d0 0x7f54b40c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.382+0000 7f54bb000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40c2140 con 0x7f54b40c17d0 2024-01-22T05:09:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.382+0000 7f54bb000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4151850 con 0x7f54b4062810 2024-01-22T05:09:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.382+0000 7f54bb000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4151b30 con 0x7f54b40bd8a0 2024-01-22T05:09:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54b9000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b40c17d0 0x7f54b40c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54b9000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b40c17d0 0x7f54b40c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46822/0 (socket says 172.21.15.49:46822) 2024-01-22T05:09:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54b9000700 1 -- 172.21.15.49:0/3896669448 learned_addr learned my addr 172.21.15.49:0/3896669448 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:47.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54b3400700 1 --2- 172.21.15.49:0/3896669448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54b40bd8a0 0x7f54b40acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:47.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54b3e00700 1 --2- 172.21.15.49:0/3896669448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54b4062810 0x7f54b41528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:47.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54b9000700 1 -- 172.21.15.49:0/3896669448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54b40bd8a0 msgr2=0x7f54b40acc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:47.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54b9000700 1 --2- 172.21.15.49:0/3896669448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54b40bd8a0 0x7f54b40acc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:47.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54b9000700 1 -- 172.21.15.49:0/3896669448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54b4062810 msgr2=0x7f54b41528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:47.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54b9000700 1 --2- 172.21.15.49:0/3896669448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54b4062810 0x7f54b41528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:47.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54b9000700 1 -- 172.21.15.49:0/3896669448 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c0092a0 con 0x7f54b40c17d0 2024-01-22T05:09:47.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54b3400700 1 --2- 172.21.15.49:0/3896669448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54b40bd8a0 0x7f54b40acc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:47.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54b9000700 1 --2- 172.21.15.49:0/3896669448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b40c17d0 0x7f54b40c1c50 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f54ac00c790 tx=0x7f54ac0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:47.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54ab400700 1 -- 172.21.15.49:0/3896669448 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac005d30 con 0x7f54b40c17d0 2024-01-22T05:09:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54ab400700 1 -- 172.21.15.49:0/3896669448 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac005e90 con 0x7f54b40c17d0 2024-01-22T05:09:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54bb000700 1 -- 172.21.15.49:0/3896669448 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b4151e10 con 0x7f54b40c17d0 2024-01-22T05:09:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54ab400700 1 -- 172.21.15.49:0/3896669448 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac007320 con 0x7f54b40c17d0 2024-01-22T05:09:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54bb000700 1 -- 172.21.15.49:0/3896669448 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b41523d0 con 0x7f54b40c17d0 2024-01-22T05:09:47.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.386+0000 7f54bb000700 1 -- 172.21.15.49:0/3896669448 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b4047060 con 0x7f54b40c17d0 2024-01-22T05:09:47.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.390+0000 7f54ab400700 1 -- 172.21.15.49:0/3896669448 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f54ac0076d0 con 0x7f54b40c17d0 2024-01-22T05:09:47.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.390+0000 7f54ab400700 1 --2- 172.21.15.49:0/3896669448 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f548c05a510 0x7f548c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.390+0000 7f54ab400700 1 -- 172.21.15.49:0/3896669448 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f54ac0745f0 con 0x7f54b40c17d0 2024-01-22T05:09:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.390+0000 7f54b3e00700 1 --2- 172.21.15.49:0/3896669448 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f548c05a510 0x7f548c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.390+0000 7f54b3e00700 1 --2- 172.21.15.49:0/3896669448 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f548c05a510 0x7f548c05c9d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f54a4003860 tx=0x7f54a4007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.398+0000 7f54ab400700 1 -- 172.21.15.49:0/3896669448 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f54ac047e50 con 0x7f54b40c17d0 2024-01-22T05:09:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:47.582+0000 7f54bb000700 1 -- 172.21.15.49:0/3896669448 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f54b4046800 con 0x7f54b40c17d0 2024-01-22T05:09:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.350+0000 7f54ab400700 1 -- 172.21.15.49:0/3896669448 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v84) v1 ==== 97+0+0 (secure 0 0 0) 0x7f54ac04b470 con 0x7f54b40c17d0 2024-01-22T05:09:48.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.354+0000 7f54bb000700 1 -- 172.21.15.49:0/3896669448 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f548c05a510 msgr2=0x7f548c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:48.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.354+0000 7f54bb000700 1 --2- 172.21.15.49:0/3896669448 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f548c05a510 0x7f548c05c9d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f54a4003860 tx=0x7f54a4007d40).stop 2024-01-22T05:09:48.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.354+0000 7f54bb000700 1 -- 172.21.15.49:0/3896669448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b40c17d0 msgr2=0x7f54b40c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:48.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.354+0000 7f54bb000700 1 --2- 172.21.15.49:0/3896669448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b40c17d0 0x7f54b40c1c50 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f54ac00c790 tx=0x7f54ac0015e0).stop 2024-01-22T05:09:48.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.354+0000 7f54bb000700 1 -- 172.21.15.49:0/3896669448 shutdown_connections 2024-01-22T05:09:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.354+0000 7f54bb000700 1 --2- 172.21.15.49:0/3896669448 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f548c05a510 0x7f548c05c9d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.354+0000 7f54bb000700 1 --2- 172.21.15.49:0/3896669448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54b40c17d0 0x7f54b40c1c50 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.354+0000 7f54bb000700 1 --2- 172.21.15.49:0/3896669448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54b40bd8a0 0x7f54b40acc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.354+0000 7f54bb000700 1 --2- 172.21.15.49:0/3896669448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54b4062810 0x7f54b41528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.354+0000 7f54bb000700 1 -- 172.21.15.49:0/3896669448 >> 172.21.15.49:0/3896669448 conn(0x7f54b40c51c0 msgr2=0x7f54b40c3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.354+0000 7f54bb000700 1 -- 172.21.15.49:0/3896669448 shutdown_connections 2024-01-22T05:09:48.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.354+0000 7f54bb000700 1 -- 172.21.15.49:0/3896669448 wait complete. 2024-01-22T05:09:48.363 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-01-22T05:09:48.384 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-22T05:09:48.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.542+0000 7fab6e600700 1 Processor -- start 2024-01-22T05:09:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.542+0000 7fab6e600700 1 -- start start 2024-01-22T05:09:48.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab6e600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fab680c25e0 0x7fab680a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:48.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab6e600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab680c1a40 con 0x7fab68155d20 2024-01-22T05:09:48.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab6e600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab680a90b0 con 0x7fab680a8740 2024-01-22T05:09:48.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab6e600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab68159310 con 0x7fab680c25e0 2024-01-22T05:09:48.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab67400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fab68155d20 0x7fab68065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41836/0 (socket says 172.21.15.49:41836) 2024-01-22T05:09:48.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab67400700 1 -- 172.21.15.49:0/3811945958 learned_addr learned my addr 172.21.15.49:0/3811945958 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:48.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab67e00700 1 --2- 172.21.15.49:0/3811945958 >> v2:172.21.15.110:3300/0 conn(0x7fab680c25e0 0x7fab680a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:48.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66000700 1 -- 172.21.15.49:0/3811945958 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290155135 0 0) 0x7fab680c1a40 con 0x7fab68155d20 2024-01-22T05:09:48.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66000700 1 -- 172.21.15.49:0/3811945958 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab480033f0 con 0x7fab68155d20 2024-01-22T05:09:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66000700 1 -- 172.21.15.49:0/3811945958 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1092724993 0 0) 0x7fab480033f0 con 0x7fab68155d20 2024-01-22T05:09:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66000700 1 -- 172.21.15.49:0/3811945958 >> v2:172.21.15.110:3300/0 conn(0x7fab680c25e0 msgr2=0x7fab680a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66000700 1 --2- 172.21.15.49:0/3811945958 >> v2:172.21.15.110:3300/0 conn(0x7fab680c25e0 0x7fab680a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66000700 1 -- 172.21.15.49:0/3811945958 >> v1:172.21.15.110:6789/0 conn(0x7fab680a8740 legacy=0x7fab680c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66000700 1 -- 172.21.15.49:0/3811945958 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab680c13f0 con 0x7fab68155d20 2024-01-22T05:09:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66000700 1 -- 172.21.15.49:0/3811945958 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fab58001470 con 0x7fab68155d20 2024-01-22T05:09:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66000700 1 -- 172.21.15.49:0/3811945958 >> v1:172.21.15.49:6789/0 conn(0x7fab68155d20 legacy=0x7fab68065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66000700 1 --2- 172.21.15.49:0/3811945958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480038e0 0x7fab48003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:48.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66000700 1 --2- 172.21.15.49:0/3811945958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab48004690 0x7fab48004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66000700 1 --2- 172.21.15.49:0/3811945958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab48005000 0x7fab4800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66000700 1 -- 172.21.15.49:0/3811945958 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab68159310 con 0x7fab48004690 2024-01-22T05:09:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66000700 1 -- 172.21.15.49:0/3811945958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4800beb0 con 0x7fab480038e0 2024-01-22T05:09:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66000700 1 -- 172.21.15.49:0/3811945958 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4800c070 con 0x7fab48005000 2024-01-22T05:09:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab67400700 1 --2- 172.21.15.49:0/3811945958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480038e0 0x7fab48003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:48.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab66a00700 1 --2- 172.21.15.49:0/3811945958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab48004690 0x7fab48004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.546+0000 7fab67e00700 1 --2- 172.21.15.49:0/3811945958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab48005000 0x7fab4800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab67400700 1 -- 172.21.15.49:0/3811945958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab48005000 msgr2=0x7fab4800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab67400700 1 --2- 172.21.15.49:0/3811945958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab48005000 0x7fab4800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab67400700 1 -- 172.21.15.49:0/3811945958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab48004690 msgr2=0x7fab48004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab67400700 1 --2- 172.21.15.49:0/3811945958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab48004690 0x7fab48004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab67400700 1 -- 172.21.15.49:0/3811945958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab480033f0 con 0x7fab480038e0 2024-01-22T05:09:48.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab67e00700 1 --2- 172.21.15.49:0/3811945958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab48005000 0x7fab4800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab67e00700 1 -- 172.21.15.49:0/3811945958 reap_dead start 2024-01-22T05:09:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab67400700 1 --2- 172.21.15.49:0/3811945958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480038e0 0x7fab48003cc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fab5800c190 tx=0x7fab58001e70).ready entity=mon.1 client_cookie=56d9791b63d77422 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab66000700 1 -- 172.21.15.49:0/3811945958 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58007a40 con 0x7fab480038e0 2024-01-22T05:09:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab66000700 1 -- 172.21.15.49:0/3811945958 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5800cac0 con 0x7fab480038e0 2024-01-22T05:09:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab66000700 1 -- 172.21.15.49:0/3811945958 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5800ce60 con 0x7fab480038e0 2024-01-22T05:09:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab6e600700 1 -- 172.21.15.49:0/3811945958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480038e0 msgr2=0x7fab48003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:48.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab6e600700 1 --2- 172.21.15.49:0/3811945958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480038e0 0x7fab48003cc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fab5800c190 tx=0x7fab58001e70).stop 2024-01-22T05:09:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab6e600700 1 -- 172.21.15.49:0/3811945958 shutdown_connections 2024-01-22T05:09:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab6e600700 1 --2- 172.21.15.49:0/3811945958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480038e0 0x7fab48003cc0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.550+0000 7fab6e600700 1 -- 172.21.15.49:0/3811945958 >> 172.21.15.49:0/3811945958 conn(0x7fab680c6540 msgr2=0x7fab680c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.554+0000 7fab6e600700 1 -- 172.21.15.49:0/3811945958 shutdown_connections 2024-01-22T05:09:48.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.554+0000 7fab6e600700 1 -- 172.21.15.49:0/3811945958 wait complete. 2024-01-22T05:09:48.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.554+0000 7fab6e600700 1 Processor -- start 2024-01-22T05:09:48.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab6e600700 1 -- start start 2024-01-22T05:09:48.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab6e600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab480038e0 0x7fab680bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:48.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab6e600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab680c0390 0x7fab6815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:48.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab6e600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab6815aab0 0x7fab680ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:48.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab6e600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab68151060 con 0x7fab480038e0 2024-01-22T05:09:48.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab6e600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6815af30 con 0x7fab6815aab0 2024-01-22T05:09:48.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab6e600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab680ac370 con 0x7fab680c0390 2024-01-22T05:09:48.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab67400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab480038e0 0x7fab680bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:48.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab67400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab480038e0 0x7fab680bd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46834/0 (socket says 172.21.15.49:46834) 2024-01-22T05:09:48.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab67400700 1 -- 172.21.15.49:0/2612706517 learned_addr learned my addr 172.21.15.49:0/2612706517 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:48.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab67e00700 1 --2- 172.21.15.49:0/2612706517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab6815aab0 0x7fab680ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:48.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab66a00700 1 --2- 172.21.15.49:0/2612706517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab680c0390 0x7fab6815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:48.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab67400700 1 -- 172.21.15.49:0/2612706517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab680c0390 msgr2=0x7fab6815a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:48.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab67400700 1 --2- 172.21.15.49:0/2612706517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab680c0390 0x7fab6815a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:48.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab67400700 1 -- 172.21.15.49:0/2612706517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab6815aab0 msgr2=0x7fab680ab600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:48.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab67400700 1 --2- 172.21.15.49:0/2612706517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab6815aab0 0x7fab680ab600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:48.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab67400700 1 -- 172.21.15.49:0/2612706517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab681512b0 con 0x7fab480038e0 2024-01-22T05:09:48.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab67e00700 1 --2- 172.21.15.49:0/2612706517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab6815aab0 0x7fab680ab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:48.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab67400700 1 --2- 172.21.15.49:0/2612706517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab480038e0 0x7fab680bd5e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fab58001120 tx=0x7fab58015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:48.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.558+0000 7fab5ea00700 1 -- 172.21.15.49:0/2612706517 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580074f0 con 0x7fab480038e0 2024-01-22T05:09:48.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.562+0000 7fab6e600700 1 -- 172.21.15.49:0/2612706517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab68151590 con 0x7fab480038e0 2024-01-22T05:09:48.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.562+0000 7fab5ea00700 1 -- 172.21.15.49:0/2612706517 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab58018070 con 0x7fab480038e0 2024-01-22T05:09:48.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.562+0000 7fab5ea00700 1 -- 172.21.15.49:0/2612706517 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580046b0 con 0x7fab480038e0 2024-01-22T05:09:48.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.562+0000 7fab6e600700 1 -- 172.21.15.49:0/2612706517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab680c0810 con 0x7fab480038e0 2024-01-22T05:09:48.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.562+0000 7fab6e600700 1 -- 172.21.15.49:0/2612706517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab68047060 con 0x7fab480038e0 2024-01-22T05:09:48.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.562+0000 7fab5ea00700 1 -- 172.21.15.49:0/2612706517 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fab58004a60 con 0x7fab480038e0 2024-01-22T05:09:48.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.566+0000 7fab5ea00700 1 --2- 172.21.15.49:0/2612706517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fab4005a540 0x7fab4005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:48.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.566+0000 7fab5ea00700 1 -- 172.21.15.49:0/2612706517 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fab58074e00 con 0x7fab480038e0 2024-01-22T05:09:48.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.566+0000 7fab66a00700 1 --2- 172.21.15.49:0/2612706517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fab4005a540 0x7fab4005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:48.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.566+0000 7fab66a00700 1 --2- 172.21.15.49:0/2612706517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fab4005a540 0x7fab4005ca00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fab680bcb50 tx=0x7fab50007b90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:48.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.574+0000 7fab5ea00700 1 -- 172.21.15.49:0/2612706517 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fab580487d0 con 0x7fab480038e0 2024-01-22T05:09:48.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.790+0000 7fab6e600700 1 -- 172.21.15.49:0/2612706517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fab680c16d0 con 0x7fab480038e0 2024-01-22T05:09:48.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.790+0000 7fab5ea00700 1 -- 172.21.15.49:0/2612706517 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fab58024030 con 0x7fab480038e0 2024-01-22T05:09:48.796 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:48.796 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:09:48.796 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-01-22T05:09:48.797 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.797 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-01-22T05:09:48.797 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lTCfoJxAAxDGvXKXgooA9/f0J70s6AA==", 2024-01-22T05:09:48.797 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.797 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:09:48.797 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:09:48.797 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:09:48.797 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:09:48.797 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.797 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.797 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.797 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-01-22T05:09:48.797 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lHqV6ORAA1DwpPV2PyDBF/6/ePTdQJw==", 2024-01-22T05:09:48.798 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.798 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:09:48.798 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:09:48.798 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:09:48.798 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:09:48.798 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.798 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.798 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.798 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-01-22T05:09:48.798 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lPo86MhAAonfC3M+AkLldljODYNGzyA==", 2024-01-22T05:09:48.798 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.798 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:09:48.798 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:09:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:09:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:09:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-01-22T05:09:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lLwvMBxAAFm52HWeGbTH1gbWVm6r5zQ==", 2024-01-22T05:09:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:09:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:09:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:09:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:09:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.800 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-01-22T05:09:48.800 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAt961lH2F9NBAAHm8R9/Q5IuFUvb0o1GyD4Q==", 2024-01-22T05:09:48.800 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.800 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:09:48.800 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:09:48.800 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:09:48.800 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.800 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.800 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.800 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-01-22T05:09:48.800 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAx961lS1lEIhAAuDm2OYfTYff1kVEq5vXvFw==", 2024-01-22T05:09:48.800 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.800 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:09:48.800 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:09:48.801 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:09:48.801 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.801 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.801 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.801 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-01-22T05:09:48.801 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA1961limLvERAAv23crKrwjLIg84u48BHHbg==", 2024-01-22T05:09:48.801 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.801 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:09:48.801 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:09:48.801 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:09:48.801 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.801 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.801 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.802 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2024-01-22T05:09:48.802 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA5961lShJiABAAnvyhz0ggDaITaMgwzi9kAA==", 2024-01-22T05:09:48.802 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.802 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:09:48.802 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:09:48.802 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:09:48.802 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.802 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.802 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.802 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2024-01-22T05:09:48.802 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA9961lcopfNRAAAZgHzI1t7YHI5cAjaCMiNw==", 2024-01-22T05:09:48.802 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.802 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:09:48.802 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:09:48.802 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBB961lX+nTIxAAtP3YQypuFWM5O/LADjvybA==", 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBF961lQ4/XERAARZPqENsV3jokk2g3OXUI5w==", 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.803 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:09:48.804 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:09:48.804 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:09:48.804 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.804 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.804 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.804 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2024-01-22T05:09:48.804 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBI961luxnqOhAAGsV74DKQda5cetNA/woOnA==", 2024-01-22T05:09:48.804 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.804 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:09:48.804 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:09:48.804 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:09:48.804 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.804 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.804 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.804 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-01-22T05:09:48.805 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lmrM6DhAAYU09HviWyrUIz4lio15wFw==", 2024-01-22T05:09:48.805 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.805 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:09:48.805 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-01-22T05:09:48.805 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-22T05:09:48.805 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.805 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.805 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.805 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-01-22T05:09:48.805 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lIhYRGRAAFG+YtkDLFsra6zU44xKCHw==", 2024-01-22T05:09:48.805 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.805 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:09:48.805 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:09:48.805 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:09:48.806 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:09:48.806 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.806 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.806 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2024-01-22T05:09:48.806 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lRuyaExAAQO3a7ahOEcuE+WVfXYEBTg==", 2024-01-22T05:09:48.806 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.806 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:09:48.806 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:09:48.806 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:09:48.806 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:09:48.806 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.806 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.806 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lMiMkHhAAxPdKpcHdtqSphbc/2agq9Q==", 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961ljsweARAAJrY3z/sBjayjB2BRQNrJew==", 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:09:48.807 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:09:48.808 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.808 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.808 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.808 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-01-22T05:09:48.808 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961l0DwDIhAAeuCu79LxNMEJvWiW/BfDhA==", 2024-01-22T05:09:48.808 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.808 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:09:48.808 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:09:48.808 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:09:48.808 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.808 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:48.808 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:48.808 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2024-01-22T05:09:48.809 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lZlmPGxAA1KVZR+XzNdoFVo/980hD8w==", 2024-01-22T05:09:48.809 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:09:48.809 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:09:48.809 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:09:48.809 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:09:48.809 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.809 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:48.809 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-01-22T05:09:48.809 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:09:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.794+0000 7fab6e600700 1 -- 172.21.15.49:0/2612706517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fab4005a540 msgr2=0x7fab4005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.794+0000 7fab6e600700 1 --2- 172.21.15.49:0/2612706517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fab4005a540 0x7fab4005ca00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fab680bcb50 tx=0x7fab50007b90).stop 2024-01-22T05:09:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.794+0000 7fab6e600700 1 -- 172.21.15.49:0/2612706517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab480038e0 msgr2=0x7fab680bd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.794+0000 7fab6e600700 1 --2- 172.21.15.49:0/2612706517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab480038e0 0x7fab680bd5e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fab58001120 tx=0x7fab58015000).stop 2024-01-22T05:09:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.794+0000 7fab6e600700 1 -- 172.21.15.49:0/2612706517 shutdown_connections 2024-01-22T05:09:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.794+0000 7fab6e600700 1 --2- 172.21.15.49:0/2612706517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fab4005a540 0x7fab4005ca00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.794+0000 7fab6e600700 1 --2- 172.21.15.49:0/2612706517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab6815aab0 0x7fab680ab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.794+0000 7fab6e600700 1 --2- 172.21.15.49:0/2612706517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab680c0390 0x7fab6815a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.794+0000 7fab6e600700 1 --2- 172.21.15.49:0/2612706517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab480038e0 0x7fab680bd5e0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.794+0000 7fab6e600700 1 -- 172.21.15.49:0/2612706517 >> 172.21.15.49:0/2612706517 conn(0x7fab680c6540 msgr2=0x7fab68153e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.794+0000 7fab6e600700 1 -- 172.21.15.49:0/2612706517 shutdown_connections 2024-01-22T05:09:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:48.794+0000 7fab6e600700 1 -- 172.21.15.49:0/2612706517 wait complete. 2024-01-22T05:09:48.825 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:09:49.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.034+0000 7f5d5d400700 1 Processor -- start 2024-01-22T05:09:49.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.034+0000 7f5d5d400700 1 -- start start 2024-01-22T05:09:49.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.034+0000 7f5d5d400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d58064c00 0x7f5d580bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.038+0000 7f5d5d400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d580c2700 con 0x7f5d58065240 2024-01-22T05:09:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.038+0000 7f5d5d400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d580c29a0 con 0x7f5d58065620 2024-01-22T05:09:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.038+0000 7f5d5d400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d580c2c80 con 0x7f5d58064c00 2024-01-22T05:09:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.038+0000 7f5d56800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5d58065240 0x7f5d580644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41840/0 (socket says 172.21.15.49:41840) 2024-01-22T05:09:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.038+0000 7f5d56800700 1 -- 172.21.15.49:0/408982881 learned_addr learned my addr 172.21.15.49:0/408982881 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.038+0000 7f5d55e00700 1 --2- 172.21.15.49:0/408982881 >> v2:172.21.15.110:3300/0 conn(0x7f5d58064c00 0x7f5d580bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.038+0000 7f5d55400700 1 -- 172.21.15.49:0/408982881 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062232746 0 0) 0x7f5d580c2700 con 0x7f5d58065240 2024-01-22T05:09:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.038+0000 7f5d55400700 1 -- 172.21.15.49:0/408982881 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d380033f0 con 0x7f5d58065240 2024-01-22T05:09:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.038+0000 7f5d55400700 1 -- 172.21.15.49:0/408982881 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942856938 0 0) 0x7f5d580c29a0 con 0x7f5d58065620 2024-01-22T05:09:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.038+0000 7f5d55400700 1 -- 172.21.15.49:0/408982881 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d580c2700 con 0x7f5d58065620 2024-01-22T05:09:49.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.038+0000 7f5d55e00700 1 -- 172.21.15.49:0/408982881 >> v1:172.21.15.110:6789/0 conn(0x7f5d58065620 legacy=0x7f5d580bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.038+0000 7f5d55e00700 1 -- 172.21.15.49:0/408982881 >> v1:172.21.15.49:6789/0 conn(0x7f5d58065240 legacy=0x7f5d580644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.038+0000 7f5d55e00700 1 -- 172.21.15.49:0/408982881 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d580c2f60 con 0x7f5d58064c00 2024-01-22T05:09:49.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.038+0000 7f5d55e00700 1 --2- 172.21.15.49:0/408982881 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d58064c00 0x7f5d580bcc80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f5d40009760 tx=0x7f5d40009060).ready entity=mon.1 client_cookie=ad490e717985003f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:49.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.042+0000 7f5d55400700 1 -- 172.21.15.49:0/408982881 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000d4a0 con 0x7f5d58064c00 2024-01-22T05:09:49.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.042+0000 7f5d55400700 1 -- 172.21.15.49:0/408982881 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4000d600 con 0x7f5d58064c00 2024-01-22T05:09:49.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.042+0000 7f5d55400700 1 -- 172.21.15.49:0/408982881 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000d980 con 0x7f5d58064c00 2024-01-22T05:09:49.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.042+0000 7f5d5d400700 1 -- 172.21.15.49:0/408982881 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d58064c00 msgr2=0x7f5d580bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.042+0000 7f5d5d400700 1 --2- 172.21.15.49:0/408982881 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d58064c00 0x7f5d580bcc80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f5d40009760 tx=0x7f5d40009060).stop 2024-01-22T05:09:49.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.042+0000 7f5d5d400700 1 -- 172.21.15.49:0/408982881 shutdown_connections 2024-01-22T05:09:49.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.042+0000 7f5d5d400700 1 --2- 172.21.15.49:0/408982881 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d58064c00 0x7f5d580bcc80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.042+0000 7f5d5d400700 1 -- 172.21.15.49:0/408982881 >> 172.21.15.49:0/408982881 conn(0x7f5d580c87f0 msgr2=0x7f5d580c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:49.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.042+0000 7f5d5d400700 1 -- 172.21.15.49:0/408982881 shutdown_connections 2024-01-22T05:09:49.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.042+0000 7f5d5d400700 1 -- 172.21.15.49:0/408982881 wait complete. 2024-01-22T05:09:49.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.046+0000 7f5d5d400700 1 Processor -- start 2024-01-22T05:09:49.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.046+0000 7f5d5d400700 1 -- start start 2024-01-22T05:09:49.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d5d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d58064c00 0x7f5d58145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d5d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d58065240 0x7f5d580a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d5d400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d58065620 0x7f5d580ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d5d400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d580a9b10 con 0x7f5d58065240 2024-01-22T05:09:49.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d5d400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d580a8f00 con 0x7f5d58064c00 2024-01-22T05:09:49.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d5d400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d580a91e0 con 0x7f5d58065620 2024-01-22T05:09:49.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d55e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d58065240 0x7f5d580a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d55e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d58065240 0x7f5d580a9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46850/0 (socket says 172.21.15.49:46850) 2024-01-22T05:09:49.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d55e00700 1 -- 172.21.15.49:0/3752488766 learned_addr learned my addr 172.21.15.49:0/3752488766 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d56800700 1 --2- 172.21.15.49:0/3752488766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d58064c00 0x7f5d58145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d5ca00700 1 --2- 172.21.15.49:0/3752488766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d58065620 0x7f5d580ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d55e00700 1 -- 172.21.15.49:0/3752488766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d58065620 msgr2=0x7f5d580ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d55e00700 1 --2- 172.21.15.49:0/3752488766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d58065620 0x7f5d580ac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d55e00700 1 -- 172.21.15.49:0/3752488766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d58064c00 msgr2=0x7f5d58145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d55e00700 1 --2- 172.21.15.49:0/3752488766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d58064c00 0x7f5d58145f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d55e00700 1 -- 172.21.15.49:0/3752488766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d400092a0 con 0x7f5d58065240 2024-01-22T05:09:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d56800700 1 --2- 172.21.15.49:0/3752488766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d58064c00 0x7f5d58145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d55e00700 1 --2- 172.21.15.49:0/3752488766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d58065240 0x7f5d580a9fa0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f5d40009630 tx=0x7f5d40016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d4e000700 1 -- 172.21.15.49:0/3752488766 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000d770 con 0x7f5d58065240 2024-01-22T05:09:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d4e000700 1 -- 172.21.15.49:0/3752488766 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4000d8d0 con 0x7f5d58065240 2024-01-22T05:09:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d5d400700 1 -- 172.21.15.49:0/3752488766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d580a94c0 con 0x7f5d58065240 2024-01-22T05:09:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d4e000700 1 -- 172.21.15.49:0/3752488766 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4001d660 con 0x7f5d58065240 2024-01-22T05:09:49.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.050+0000 7f5d5d400700 1 -- 172.21.15.49:0/3752488766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d58146460 con 0x7f5d58065240 2024-01-22T05:09:49.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.054+0000 7f5d5d400700 1 -- 172.21.15.49:0/3752488766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d580a9cc0 con 0x7f5d58065240 2024-01-22T05:09:49.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.054+0000 7f5d4e000700 1 -- 172.21.15.49:0/3752488766 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5d4001da10 con 0x7f5d58065240 2024-01-22T05:09:49.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.058+0000 7f5d4e000700 1 --2- 172.21.15.49:0/3752488766 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d3005a510 0x7f5d3005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.058+0000 7f5d4e000700 1 -- 172.21.15.49:0/3752488766 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f5d40075e30 con 0x7f5d58065240 2024-01-22T05:09:49.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.058+0000 7f5d56800700 1 --2- 172.21.15.49:0/3752488766 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d3005a510 0x7f5d3005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.058+0000 7f5d56800700 1 --2- 172.21.15.49:0/3752488766 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d3005a510 0x7f5d3005c9d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f5d48005750 tx=0x7f5d48009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:49.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.066+0000 7f5d4e000700 1 -- 172.21.15.49:0/3752488766 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5d580a9cc0 con 0x7f5d58065240 2024-01-22T05:09:49.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.238+0000 7f5d5d400700 1 -- 172.21.15.49:0/3752488766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d580a9940 con 0x7f5d58065240 2024-01-22T05:09:49.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.242+0000 7f5d4e000700 1 -- 172.21.15.49:0/3752488766 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+13949 (secure 0 0 0) 0x7f5d40049740 con 0x7f5d58065240 2024-01-22T05:09:49.246 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:49.246 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":84,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:09:48.350475+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:09:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.246+0000 7f5d5d400700 1 -- 172.21.15.49:0/3752488766 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d3005a510 msgr2=0x7f5d3005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.246+0000 7f5d5d400700 1 --2- 172.21.15.49:0/3752488766 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d3005a510 0x7f5d3005c9d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f5d48005750 tx=0x7f5d48009040).stop 2024-01-22T05:09:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.246+0000 7f5d5d400700 1 -- 172.21.15.49:0/3752488766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d58065240 msgr2=0x7f5d580a9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.246+0000 7f5d5d400700 1 --2- 172.21.15.49:0/3752488766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d58065240 0x7f5d580a9fa0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f5d40009630 tx=0x7f5d40016000).stop 2024-01-22T05:09:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.246+0000 7f5d5d400700 1 -- 172.21.15.49:0/3752488766 shutdown_connections 2024-01-22T05:09:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.246+0000 7f5d5d400700 1 --2- 172.21.15.49:0/3752488766 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d3005a510 0x7f5d3005c9d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.246+0000 7f5d5d400700 1 --2- 172.21.15.49:0/3752488766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d58065620 0x7f5d580ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.246+0000 7f5d5d400700 1 --2- 172.21.15.49:0/3752488766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d58065240 0x7f5d580a9fa0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.246+0000 7f5d5d400700 1 --2- 172.21.15.49:0/3752488766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d58064c00 0x7f5d58145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.246+0000 7f5d5d400700 1 -- 172.21.15.49:0/3752488766 >> 172.21.15.49:0/3752488766 conn(0x7f5d580c87f0 msgr2=0x7f5d58153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:49.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.246+0000 7f5d5d400700 1 -- 172.21.15.49:0/3752488766 shutdown_connections 2024-01-22T05:09:49.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.246+0000 7f5d5d400700 1 -- 172.21.15.49:0/3752488766 wait complete. 2024-01-22T05:09:49.277 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:09:49.277 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:09:49.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.446+0000 7f4f3c600700 1 Processor -- start 2024-01-22T05:09:49.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.446+0000 7f4f3c600700 1 -- start start 2024-01-22T05:09:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.450+0000 7f4f3c600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f340690f0 0x7f4f34155f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.450+0000 7f4f3c600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4f34151960 0x7f4f34063e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.450+0000 7f4f3c600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f34064310 0x7f4f340bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.450+0000 7f4f3c600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f340694d0 con 0x7f4f34064310 2024-01-22T05:09:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.450+0000 7f4f3c600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f340647c0 con 0x7f4f34151960 2024-01-22T05:09:49.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.450+0000 7f4f3c600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f34068c60 con 0x7f4f340690f0 2024-01-22T05:09:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.450+0000 7f4f3a600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f34064310 0x7f4f340bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f39200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4f34151960 0x7f4f34063e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3a600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f34064310 0x7f4f340bc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46852/0 (socket says 172.21.15.49:46852) 2024-01-22T05:09:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3a600700 1 -- 172.21.15.49:0/225999652 learned_addr learned my addr 172.21.15.49:0/225999652 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f39c00700 1 --2- 172.21.15.49:0/225999652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f340690f0 0x7f4f34155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3a600700 1 -- 172.21.15.49:0/225999652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f340690f0 msgr2=0x7f4f34155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:49.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3a600700 1 --2- 172.21.15.49:0/225999652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f340690f0 0x7f4f34155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3a600700 1 -- 172.21.15.49:0/225999652 >> v2:172.21.15.110:3300/0 conn(0x7f4f34151960 msgr2=0x7f4f34063e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:49.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3a600700 1 --2- 172.21.15.49:0/225999652 >> v2:172.21.15.110:3300/0 conn(0x7f4f34151960 0x7f4f34063e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3a600700 1 -- 172.21.15.49:0/225999652 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f34068050 con 0x7f4f34064310 2024-01-22T05:09:49.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f39200700 1 --2- 172.21.15.49:0/225999652 >> v2:172.21.15.110:3300/0 conn(0x7f4f34151960 0x7f4f34063e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:49.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3a600700 1 --2- 172.21.15.49:0/225999652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f34064310 0x7f4f340bc5d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f4f34060260 tx=0x7f4f2c009840).ready entity=mon.0 client_cookie=d3434d9d822f7138 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:49.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f33e00700 1 -- 172.21.15.49:0/225999652 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c00e070 con 0x7f4f34064310 2024-01-22T05:09:49.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f33e00700 1 -- 172.21.15.49:0/225999652 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c00b970 con 0x7f4f34064310 2024-01-22T05:09:49.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f33e00700 1 -- 172.21.15.49:0/225999652 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c00bcf0 con 0x7f4f34064310 2024-01-22T05:09:49.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3c600700 1 -- 172.21.15.49:0/225999652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f34064310 msgr2=0x7f4f340bc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3c600700 1 --2- 172.21.15.49:0/225999652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f34064310 0x7f4f340bc5d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f4f34060260 tx=0x7f4f2c009840).stop 2024-01-22T05:09:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3c600700 1 -- 172.21.15.49:0/225999652 shutdown_connections 2024-01-22T05:09:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3c600700 1 --2- 172.21.15.49:0/225999652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f34064310 0x7f4f340bc5d0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3c600700 1 --2- 172.21.15.49:0/225999652 >> v2:172.21.15.110:3300/0 conn(0x7f4f34151960 0x7f4f34063e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3c600700 1 --2- 172.21.15.49:0/225999652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f340690f0 0x7f4f34155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3c600700 1 -- 172.21.15.49:0/225999652 >> 172.21.15.49:0/225999652 conn(0x7f4f34066810 msgr2=0x7f4f34066bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.454+0000 7f4f3c600700 1 -- 172.21.15.49:0/225999652 shutdown_connections 2024-01-22T05:09:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.458+0000 7f4f3c600700 1 -- 172.21.15.49:0/225999652 wait complete. 2024-01-22T05:09:49.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f3c600700 1 Processor -- start 2024-01-22T05:09:49.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f3c600700 1 -- start start 2024-01-22T05:09:49.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f3c600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f34064310 0x7f4f341440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f3c600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f340690f0 0x7f4f340a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f3c600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f34151960 0x7f4f340be710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f3c600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f34154880 con 0x7f4f340690f0 2024-01-22T05:09:49.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f3c600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f34153c70 con 0x7f4f34151960 2024-01-22T05:09:49.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f3c600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f34153f50 con 0x7f4f34064310 2024-01-22T05:09:49.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f39200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f340690f0 0x7f4f340a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f39200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f340690f0 0x7f4f340a43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46868/0 (socket says 172.21.15.49:46868) 2024-01-22T05:09:49.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f3a600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f34151960 0x7f4f340be710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f39200700 1 -- 172.21.15.49:0/2847944591 learned_addr learned my addr 172.21.15.49:0/2847944591 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:49.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f39c00700 1 --2- 172.21.15.49:0/2847944591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f34064310 0x7f4f341440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f39200700 1 -- 172.21.15.49:0/2847944591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f34064310 msgr2=0x7f4f341440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f39200700 1 --2- 172.21.15.49:0/2847944591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f34064310 0x7f4f341440b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f39200700 1 -- 172.21.15.49:0/2847944591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f34151960 msgr2=0x7f4f340be710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f39200700 1 --2- 172.21.15.49:0/2847944591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f34151960 0x7f4f340be710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.462+0000 7f4f39200700 1 -- 172.21.15.49:0/2847944591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c0092a0 con 0x7f4f340690f0 2024-01-22T05:09:49.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.466+0000 7f4f39200700 1 --2- 172.21.15.49:0/2847944591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f340690f0 0x7f4f340a43f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f4f1c00e930 tx=0x7f4f1c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:49.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.466+0000 7f4f30c00700 1 -- 172.21.15.49:0/2847944591 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c012600 con 0x7f4f340690f0 2024-01-22T05:09:49.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.466+0000 7f4f30c00700 1 -- 172.21.15.49:0/2847944591 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c012760 con 0x7f4f340690f0 2024-01-22T05:09:49.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.466+0000 7f4f30c00700 1 -- 172.21.15.49:0/2847944591 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c012ae0 con 0x7f4f340690f0 2024-01-22T05:09:49.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.466+0000 7f4f3c600700 1 -- 172.21.15.49:0/2847944591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c009ae0 con 0x7f4f340690f0 2024-01-22T05:09:49.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.466+0000 7f4f3c600700 1 -- 172.21.15.49:0/2847944591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f34154510 con 0x7f4f340690f0 2024-01-22T05:09:49.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.466+0000 7f4f3c600700 1 -- 172.21.15.49:0/2847944591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f341549f0 con 0x7f4f340690f0 2024-01-22T05:09:49.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.470+0000 7f4f30c00700 1 -- 172.21.15.49:0/2847944591 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4f1c01b400 con 0x7f4f340690f0 2024-01-22T05:09:49.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.470+0000 7f4f30c00700 1 --2- 172.21.15.49:0/2847944591 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f0c05a510 0x7f4f0c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.470+0000 7f4f30c00700 1 -- 172.21.15.49:0/2847944591 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f4f1c074ae0 con 0x7f4f340690f0 2024-01-22T05:09:49.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.470+0000 7f4f39c00700 1 --2- 172.21.15.49:0/2847944591 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f0c05a510 0x7f4f0c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.470+0000 7f4f39c00700 1 --2- 172.21.15.49:0/2847944591 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f0c05a510 0x7f4f0c05c9d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f4f340a96d0 tx=0x7f4f24009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:49.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.474+0000 7f4f30c00700 1 -- 172.21.15.49:0/2847944591 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4f1c048390 con 0x7f4f340690f0 2024-01-22T05:09:49.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.642+0000 7f4f3c600700 1 -- 172.21.15.49:0/2847944591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4f34068330 con 0x7f4f340690f0 2024-01-22T05:09:49.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.642+0000 7f4f30c00700 1 -- 172.21.15.49:0/2847944591 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v84) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4f1c016070 con 0x7f4f340690f0 2024-01-22T05:09:49.647 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:09:49.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.646+0000 7f4f3c600700 1 -- 172.21.15.49:0/2847944591 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f0c05a510 msgr2=0x7f4f0c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.646+0000 7f4f3c600700 1 --2- 172.21.15.49:0/2847944591 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f0c05a510 0x7f4f0c05c9d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f4f340a96d0 tx=0x7f4f24009060).stop 2024-01-22T05:09:49.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.646+0000 7f4f3c600700 1 -- 172.21.15.49:0/2847944591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f340690f0 msgr2=0x7f4f340a43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.646+0000 7f4f3c600700 1 --2- 172.21.15.49:0/2847944591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f340690f0 0x7f4f340a43f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f4f1c00e930 tx=0x7f4f1c009060).stop 2024-01-22T05:09:49.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.646+0000 7f4f3c600700 1 -- 172.21.15.49:0/2847944591 shutdown_connections 2024-01-22T05:09:49.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.646+0000 7f4f3c600700 1 --2- 172.21.15.49:0/2847944591 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f0c05a510 0x7f4f0c05c9d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.646+0000 7f4f3c600700 1 --2- 172.21.15.49:0/2847944591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f34151960 0x7f4f340be710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.646+0000 7f4f3c600700 1 --2- 172.21.15.49:0/2847944591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f340690f0 0x7f4f340a43f0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.646+0000 7f4f3c600700 1 --2- 172.21.15.49:0/2847944591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f34064310 0x7f4f341440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.646+0000 7f4f3c600700 1 -- 172.21.15.49:0/2847944591 >> 172.21.15.49:0/2847944591 conn(0x7f4f34066810 msgr2=0x7f4f340a8640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:49.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.650+0000 7f4f3c600700 1 -- 172.21.15.49:0/2847944591 shutdown_connections 2024-01-22T05:09:49.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.650+0000 7f4f3c600700 1 -- 172.21.15.49:0/2847944591 wait complete. 2024-01-22T05:09:49.681 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:09:49.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.834+0000 7f5cdcc00700 1 Processor -- start 2024-01-22T05:09:49.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.834+0000 7f5cdcc00700 1 -- start start 2024-01-22T05:09:49.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cdcc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd80a8c20 0x7f5cd80c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cdcc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5cd80c1ac0 0x7f5cd80bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cdcc00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd8158650 con 0x7f5cd80bc9c0 2024-01-22T05:09:49.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cdcc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd80c1f20 con 0x7f5cd80c1ac0 2024-01-22T05:09:49.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cdcc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80bd170 con 0x7f5cd80a8c20 2024-01-22T05:09:49.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cd5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd80a8c20 0x7f5cd80c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cd6800700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5cd80bc9c0 0x7f5cd8068710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:58326/0 (socket says 172.21.15.49:58326) 2024-01-22T05:09:49.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cd6800700 1 -- 172.21.15.49:0/125771933 learned_addr learned my addr 172.21.15.49:0/125771933 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:49.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cd5400700 1 --2- 172.21.15.49:0/125771933 >> v2:172.21.15.110:3300/0 conn(0x7f5cd80c1ac0 0x7f5cd80bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cd5e00700 1 -- 172.21.15.49:0/125771933 >> v2:172.21.15.110:3300/0 conn(0x7f5cd80c1ac0 msgr2=0x7f5cd80bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:49.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cd5e00700 1 --2- 172.21.15.49:0/125771933 >> v2:172.21.15.110:3300/0 conn(0x7f5cd80c1ac0 0x7f5cd80bc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cd5e00700 1 -- 172.21.15.49:0/125771933 >> v1:172.21.15.110:6789/0 conn(0x7f5cd80bc9c0 legacy=0x7f5cd8068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cd5e00700 1 -- 172.21.15.49:0/125771933 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8067c30 con 0x7f5cd80a8c20 2024-01-22T05:09:49.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cd5e00700 1 --2- 172.21.15.49:0/125771933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd80a8c20 0x7f5cd80c15d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f5cc8009760 tx=0x7f5cc8009060).ready entity=mon.2 client_cookie=11df8d188fd2a691 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:49.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cd4a00700 1 -- 172.21.15.49:0/125771933 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800f510 con 0x7f5cd80a8c20 2024-01-22T05:09:49.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cd4a00700 1 -- 172.21.15.49:0/125771933 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc800f670 con 0x7f5cd80a8c20 2024-01-22T05:09:49.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.838+0000 7f5cd4a00700 1 -- 172.21.15.49:0/125771933 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800f9f0 con 0x7f5cd80a8c20 2024-01-22T05:09:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.842+0000 7f5cdcc00700 1 -- 172.21.15.49:0/125771933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd80a8c20 msgr2=0x7f5cd80c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.842+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/125771933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd80a8c20 0x7f5cd80c15d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f5cc8009760 tx=0x7f5cc8009060).stop 2024-01-22T05:09:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.842+0000 7f5cdcc00700 1 -- 172.21.15.49:0/125771933 shutdown_connections 2024-01-22T05:09:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.842+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/125771933 >> v2:172.21.15.110:3300/0 conn(0x7f5cd80c1ac0 0x7f5cd80bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.842+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/125771933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd80a8c20 0x7f5cd80c15d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.842+0000 7f5cdcc00700 1 -- 172.21.15.49:0/125771933 >> 172.21.15.49:0/125771933 conn(0x7f5cd8062cb0 msgr2=0x7f5cd80c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.842+0000 7f5cdcc00700 1 -- 172.21.15.49:0/125771933 shutdown_connections 2024-01-22T05:09:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.842+0000 7f5cdcc00700 1 -- 172.21.15.49:0/125771933 wait complete. 2024-01-22T05:09:49.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.846+0000 7f5cdcc00700 1 Processor -- start 2024-01-22T05:09:49.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.846+0000 7f5cdcc00700 1 -- start start 2024-01-22T05:09:49.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.846+0000 7f5cdcc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cd80a8c20 0x7f5cd8168f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.846+0000 7f5cdcc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd80bc9c0 0x7f5cd8159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.846+0000 7f5cdcc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd80c1ac0 0x7f5cd80bf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.846+0000 7f5cdcc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80bd9d0 con 0x7f5cd80a8c20 2024-01-22T05:09:49.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.846+0000 7f5cdcc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80bdcb0 con 0x7f5cd80bc9c0 2024-01-22T05:09:49.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.846+0000 7f5cdcc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80bdf90 con 0x7f5cd80c1ac0 2024-01-22T05:09:49.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.846+0000 7f5cd5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cd80a8c20 0x7f5cd8168f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.846+0000 7f5cd5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cd80a8c20 0x7f5cd8168f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46870/0 (socket says 172.21.15.49:46870) 2024-01-22T05:09:49.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.846+0000 7f5cd5e00700 1 -- 172.21.15.49:0/289240158 learned_addr learned my addr 172.21.15.49:0/289240158 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:49.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.850+0000 7f5cd6800700 1 --2- 172.21.15.49:0/289240158 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd80c1ac0 0x7f5cd80bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.850+0000 7f5cd5400700 1 --2- 172.21.15.49:0/289240158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd80bc9c0 0x7f5cd8159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.850+0000 7f5cd5e00700 1 -- 172.21.15.49:0/289240158 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd80c1ac0 msgr2=0x7f5cd80bf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.850+0000 7f5cd5e00700 1 --2- 172.21.15.49:0/289240158 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd80c1ac0 0x7f5cd80bf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.850+0000 7f5cd5e00700 1 -- 172.21.15.49:0/289240158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd80bc9c0 msgr2=0x7f5cd8159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:49.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.850+0000 7f5cd5e00700 1 --2- 172.21.15.49:0/289240158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd80bc9c0 0x7f5cd8159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:49.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.850+0000 7f5cd5e00700 1 -- 172.21.15.49:0/289240158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc80092a0 con 0x7f5cd80a8c20 2024-01-22T05:09:49.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.850+0000 7f5cd5e00700 1 --2- 172.21.15.49:0/289240158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cd80a8c20 0x7f5cd8168f90 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f5cd80bd2b0 tx=0x7f5cc8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:49.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.850+0000 7f5ccd600700 1 -- 172.21.15.49:0/289240158 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800f7e0 con 0x7f5cd80a8c20 2024-01-22T05:09:49.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.850+0000 7f5ccd600700 1 -- 172.21.15.49:0/289240158 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc800f940 con 0x7f5cd80a8c20 2024-01-22T05:09:49.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.850+0000 7f5cdcc00700 1 -- 172.21.15.49:0/289240158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd80be270 con 0x7f5cd80a8c20 2024-01-22T05:09:49.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.850+0000 7f5ccd600700 1 -- 172.21.15.49:0/289240158 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc801b660 con 0x7f5cd80a8c20 2024-01-22T05:09:49.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.850+0000 7f5cdcc00700 1 -- 172.21.15.49:0/289240158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd80bd680 con 0x7f5cd80a8c20 2024-01-22T05:09:49.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.854+0000 7f5cdcc00700 1 -- 172.21.15.49:0/289240158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd80c0c00 con 0x7f5cd80a8c20 2024-01-22T05:09:49.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.854+0000 7f5ccd600700 1 -- 172.21.15.49:0/289240158 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5cc801ba90 con 0x7f5cd80a8c20 2024-01-22T05:09:49.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.854+0000 7f5ccd600700 1 --2- 172.21.15.49:0/289240158 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5cb005a510 0x7f5cb005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:49.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.854+0000 7f5ccd600700 1 -- 172.21.15.49:0/289240158 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f5cc8076230 con 0x7f5cd80a8c20 2024-01-22T05:09:49.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.854+0000 7f5cd5400700 1 --2- 172.21.15.49:0/289240158 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5cb005a510 0x7f5cb005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:49.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.858+0000 7f5cd5400700 1 --2- 172.21.15.49:0/289240158 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5cb005a510 0x7f5cb005c9d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f5cc0009200 tx=0x7f5cc0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:49.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:49.862+0000 7f5ccd600700 1 -- 172.21.15.49:0/289240158 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5cc8049c00 con 0x7f5cd80a8c20 2024-01-22T05:09:50.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.034+0000 7f5cdcc00700 1 -- 172.21.15.49:0/289240158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5cd8067f10 con 0x7f5cd80a8c20 2024-01-22T05:09:50.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.034+0000 7f5ccd600700 1 -- 172.21.15.49:0/289240158 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5cc804d220 con 0x7f5cd80a8c20 2024-01-22T05:09:50.040 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:09:50.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.038+0000 7f5cdcc00700 1 -- 172.21.15.49:0/289240158 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5cb005a510 msgr2=0x7f5cb005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:50.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.038+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/289240158 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5cb005a510 0x7f5cb005c9d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f5cc0009200 tx=0x7f5cc0008040).stop 2024-01-22T05:09:50.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.038+0000 7f5cdcc00700 1 -- 172.21.15.49:0/289240158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cd80a8c20 msgr2=0x7f5cd8168f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:50.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.038+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/289240158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cd80a8c20 0x7f5cd8168f90 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f5cd80bd2b0 tx=0x7f5cc8017000).stop 2024-01-22T05:09:50.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.038+0000 7f5cdcc00700 1 -- 172.21.15.49:0/289240158 shutdown_connections 2024-01-22T05:09:50.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.038+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/289240158 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5cb005a510 0x7f5cb005c9d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.038+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/289240158 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd80c1ac0 0x7f5cd80bf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.038+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/289240158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd80bc9c0 0x7f5cd8159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.038+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/289240158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cd80a8c20 0x7f5cd8168f90 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.038+0000 7f5cdcc00700 1 -- 172.21.15.49:0/289240158 >> 172.21.15.49:0/289240158 conn(0x7f5cd8062cb0 msgr2=0x7f5cd80bc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:50.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.042+0000 7f5cdcc00700 1 -- 172.21.15.49:0/289240158 shutdown_connections 2024-01-22T05:09:50.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.042+0000 7f5cdcc00700 1 -- 172.21.15.49:0/289240158 wait complete. 2024-01-22T05:09:50.066 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:09:50.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.222+0000 7f45fdc00700 1 Processor -- start 2024-01-22T05:09:50.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.226+0000 7f45fdc00700 1 -- start start 2024-01-22T05:09:50.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.226+0000 7f45fdc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f45f8062230 0x7f45f80626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:50.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.226+0000 7f45fdc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f8067a90 0x7f45f8067ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:50.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.226+0000 7f45fdc00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f8062bb0 con 0x7f45f80aaa40 2024-01-22T05:09:50.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.226+0000 7f45fdc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f8064dd0 con 0x7f45f8062230 2024-01-22T05:09:50.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.226+0000 7f45fdc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8152e30 con 0x7f45f8067a90 2024-01-22T05:09:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.226+0000 7f45f7e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f8067a90 0x7f45f8067ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.226+0000 7f45f6000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f45f8062230 0x7f45f80626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.226+0000 7f45f6a00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f45f80aaa40 0x7f45f8059470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:58342/0 (socket says 172.21.15.49:58342) 2024-01-22T05:09:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.226+0000 7f45f6a00700 1 -- 172.21.15.49:0/2379732957 learned_addr learned my addr 172.21.15.49:0/2379732957 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.226+0000 7f45f7e00700 1 -- 172.21.15.49:0/2379732957 >> v2:172.21.15.110:3300/0 conn(0x7f45f8062230 msgr2=0x7f45f80626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.226+0000 7f45f7e00700 1 --2- 172.21.15.49:0/2379732957 >> v2:172.21.15.110:3300/0 conn(0x7f45f8062230 0x7f45f80626c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.226+0000 7f45f7e00700 1 -- 172.21.15.49:0/2379732957 >> v1:172.21.15.110:6789/0 conn(0x7f45f80aaa40 legacy=0x7f45f8059470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.226+0000 7f45f7e00700 1 -- 172.21.15.49:0/2379732957 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8064fe0 con 0x7f45f8067a90 2024-01-22T05:09:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.230+0000 7f45f7e00700 1 --2- 172.21.15.49:0/2379732957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f8067a90 0x7f45f8067ee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f45f0009e60 tx=0x7f45f0009780).ready entity=mon.2 client_cookie=dab5ac34afa65727 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.230+0000 7f45f5600700 1 -- 172.21.15.49:0/2379732957 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f000e070 con 0x7f45f8067a90 2024-01-22T05:09:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.230+0000 7f45f5600700 1 -- 172.21.15.49:0/2379732957 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f000bb60 con 0x7f45f8067a90 2024-01-22T05:09:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.230+0000 7f45f5600700 1 -- 172.21.15.49:0/2379732957 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0012410 con 0x7f45f8067a90 2024-01-22T05:09:50.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.230+0000 7f45fdc00700 1 -- 172.21.15.49:0/2379732957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f8067a90 msgr2=0x7f45f8067ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:50.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.230+0000 7f45fdc00700 1 --2- 172.21.15.49:0/2379732957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f8067a90 0x7f45f8067ee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f45f0009e60 tx=0x7f45f0009780).stop 2024-01-22T05:09:50.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.230+0000 7f45fdc00700 1 -- 172.21.15.49:0/2379732957 shutdown_connections 2024-01-22T05:09:50.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.230+0000 7f45fdc00700 1 --2- 172.21.15.49:0/2379732957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f8067a90 0x7f45f8067ee0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.230+0000 7f45fdc00700 1 --2- 172.21.15.49:0/2379732957 >> v2:172.21.15.110:3300/0 conn(0x7f45f8062230 0x7f45f80626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.230+0000 7f45fdc00700 1 -- 172.21.15.49:0/2379732957 >> 172.21.15.49:0/2379732957 conn(0x7f45f80c8560 msgr2=0x7f45f80c8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:50.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.230+0000 7f45fdc00700 1 -- 172.21.15.49:0/2379732957 shutdown_connections 2024-01-22T05:09:50.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.230+0000 7f45fdc00700 1 -- 172.21.15.49:0/2379732957 wait complete. 2024-01-22T05:09:50.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.234+0000 7f45fdc00700 1 Processor -- start 2024-01-22T05:09:50.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.234+0000 7f45fdc00700 1 -- start start 2024-01-22T05:09:50.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45fdc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f8062230 0x7f45f814c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:50.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45fdc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45f8067a90 0x7f45f814d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:50.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45fdc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f80aaa40 0x7f45f8163c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:50.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45fdc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f814e700 con 0x7f45f80aaa40 2024-01-22T05:09:50.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45fdc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f814d870 con 0x7f45f8067a90 2024-01-22T05:09:50.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45fdc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f814daf0 con 0x7f45f8062230 2024-01-22T05:09:50.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45f7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f80aaa40 0x7f45f8163c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:50.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45f7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f80aaa40 0x7f45f8163c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46874/0 (socket says 172.21.15.49:46874) 2024-01-22T05:09:50.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45f7e00700 1 -- 172.21.15.49:0/335159772 learned_addr learned my addr 172.21.15.49:0/335159772 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:50.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45f6000700 1 --2- 172.21.15.49:0/335159772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45f8067a90 0x7f45f814d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:50.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45f6a00700 1 --2- 172.21.15.49:0/335159772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f8062230 0x7f45f814c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:50.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45f7e00700 1 -- 172.21.15.49:0/335159772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f8062230 msgr2=0x7f45f814c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:50.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45f7e00700 1 --2- 172.21.15.49:0/335159772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f8062230 0x7f45f814c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45f7e00700 1 -- 172.21.15.49:0/335159772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45f8067a90 msgr2=0x7f45f814d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:50.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45f7e00700 1 --2- 172.21.15.49:0/335159772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45f8067a90 0x7f45f814d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45f7e00700 1 -- 172.21.15.49:0/335159772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f0009a20 con 0x7f45f80aaa40 2024-01-22T05:09:50.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45f7e00700 1 --2- 172.21.15.49:0/335159772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f80aaa40 0x7f45f8163c10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f45f000c000 tx=0x7f45f0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:50.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45ee000700 1 -- 172.21.15.49:0/335159772 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f001d630 con 0x7f45f80aaa40 2024-01-22T05:09:50.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45ee000700 1 -- 172.21.15.49:0/335159772 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f001d790 con 0x7f45f80aaa40 2024-01-22T05:09:50.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45fdc00700 1 -- 172.21.15.49:0/335159772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f814ddd0 con 0x7f45f80aaa40 2024-01-22T05:09:50.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45ee000700 1 -- 172.21.15.49:0/335159772 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f001db50 con 0x7f45f80aaa40 2024-01-22T05:09:50.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.238+0000 7f45fdc00700 1 -- 172.21.15.49:0/335159772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f814e390 con 0x7f45f80aaa40 2024-01-22T05:09:50.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.242+0000 7f45fdc00700 1 -- 172.21.15.49:0/335159772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f814e8b0 con 0x7f45f80aaa40 2024-01-22T05:09:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.242+0000 7f45ee000700 1 -- 172.21.15.49:0/335159772 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f45f0003040 con 0x7f45f80aaa40 2024-01-22T05:09:50.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.242+0000 7f45ee000700 1 --2- 172.21.15.49:0/335159772 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45d005a540 0x7f45d005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:50.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.242+0000 7f45ee000700 1 -- 172.21.15.49:0/335159772 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f45f00764c0 con 0x7f45f80aaa40 2024-01-22T05:09:50.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.242+0000 7f45f6a00700 1 --2- 172.21.15.49:0/335159772 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45d005a540 0x7f45d005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.246+0000 7f45f6a00700 1 --2- 172.21.15.49:0/335159772 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45d005a540 0x7f45d005ca00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f45e80016a0 tx=0x7f45e8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:50.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.254+0000 7f45ee000700 1 -- 172.21.15.49:0/335159772 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f45f814e8b0 con 0x7f45f80aaa40 2024-01-22T05:09:50.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.422+0000 7f45fdc00700 1 -- 172.21.15.49:0/335159772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f45f814e8b0 con 0x7f45f80aaa40 2024-01-22T05:09:50.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.422+0000 7f45ee000700 1 -- 172.21.15.49:0/335159772 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) v1 ==== 84+0+143 (secure 0 0 0) 0x7f45f814e8b0 con 0x7f45f80aaa40 2024-01-22T05:09:50.427 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:50.427 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-22T05:09:50.427 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:50.427 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-01-22T05:09:50.427 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2024-01-22T05:09:50.427 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:09:50.427 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:09:50.428 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2024-01-22T05:09:50.428 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2024-01-22T05:09:50.428 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:09:50.428 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-22T05:09:50.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.426+0000 7f45fdc00700 1 -- 172.21.15.49:0/335159772 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45d005a540 msgr2=0x7f45d005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:50.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.426+0000 7f45fdc00700 1 --2- 172.21.15.49:0/335159772 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45d005a540 0x7f45d005ca00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f45e80016a0 tx=0x7f45e8009040).stop 2024-01-22T05:09:50.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.426+0000 7f45fdc00700 1 -- 172.21.15.49:0/335159772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f80aaa40 msgr2=0x7f45f8163c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:50.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.426+0000 7f45fdc00700 1 --2- 172.21.15.49:0/335159772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f80aaa40 0x7f45f8163c10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f45f000c000 tx=0x7f45f0009780).stop 2024-01-22T05:09:50.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.426+0000 7f45fdc00700 1 -- 172.21.15.49:0/335159772 shutdown_connections 2024-01-22T05:09:50.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.426+0000 7f45fdc00700 1 --2- 172.21.15.49:0/335159772 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45d005a540 0x7f45d005ca00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.426+0000 7f45fdc00700 1 --2- 172.21.15.49:0/335159772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f80aaa40 0x7f45f8163c10 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.426+0000 7f45fdc00700 1 --2- 172.21.15.49:0/335159772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45f8067a90 0x7f45f814d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.426+0000 7f45fdc00700 1 --2- 172.21.15.49:0/335159772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f8062230 0x7f45f814c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.426+0000 7f45fdc00700 1 -- 172.21.15.49:0/335159772 >> 172.21.15.49:0/335159772 conn(0x7f45f80c8560 msgr2=0x7f45f80a8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.426+0000 7f45fdc00700 1 -- 172.21.15.49:0/335159772 shutdown_connections 2024-01-22T05:09:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.426+0000 7f45fdc00700 1 -- 172.21.15.49:0/335159772 wait complete. 2024-01-22T05:09:50.456 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:09:50.456 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:09:50.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.626+0000 7f8bd9200700 1 Processor -- start 2024-01-22T05:09:50.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.626+0000 7f8bd9200700 1 -- start start 2024-01-22T05:09:50.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.626+0000 7f8bd9200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8bd4068460 0x7f8bd4151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:50.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.626+0000 7f8bd9200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd4068ba0 con 0x7f8bd40be640 2024-01-22T05:09:50.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.626+0000 7f8bd9200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd4068e80 con 0x7f8bd4152030 2024-01-22T05:09:50.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.626+0000 7f8bd9200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd4069440 con 0x7f8bd4068460 2024-01-22T05:09:50.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.626+0000 7f8bd1e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8bd4068460 0x7f8bd4151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:50.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.626+0000 7f8bd1400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8bd4152030 0x7f8bd40bdf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:58346/0 (socket says 172.21.15.49:58346) 2024-01-22T05:09:50.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.626+0000 7f8bd1400700 1 -- 172.21.15.49:0/1907340301 learned_addr learned my addr 172.21.15.49:0/1907340301 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:50.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.626+0000 7f8bd2800700 1 --1- 172.21.15.49:0/1907340301 >> v1:172.21.15.49:6789/0 conn(0x7f8bd40be640 0x7f8bd40c3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41846/0 (socket says 172.21.15.49:41846) 2024-01-22T05:09:50.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd0a00700 1 -- 172.21.15.49:0/1907340301 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388951432 0 0) 0x7f8bd4068e80 con 0x7f8bd4152030 2024-01-22T05:09:50.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd0a00700 1 -- 172.21.15.49:0/1907340301 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bb40033f0 con 0x7f8bd4152030 2024-01-22T05:09:50.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd1e00700 1 -- 172.21.15.49:0/1907340301 >> v1:172.21.15.110:6789/0 conn(0x7f8bd4152030 legacy=0x7f8bd40bdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:50.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd1e00700 1 -- 172.21.15.49:0/1907340301 >> v1:172.21.15.49:6789/0 conn(0x7f8bd40be640 legacy=0x7f8bd40c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:50.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd0a00700 1 -- 172.21.15.49:0/1907340301 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740579813 0 0) 0x7f8bd4068ba0 con 0x7f8bd40be640 2024-01-22T05:09:50.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd1e00700 1 -- 172.21.15.49:0/1907340301 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd4069160 con 0x7f8bd4068460 2024-01-22T05:09:50.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd1e00700 1 --2- 172.21.15.49:0/1907340301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd4068460 0x7f8bd4151b40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f8bc4009760 tx=0x7f8bc4009060).ready entity=mon.0 client_cookie=d00b93448fb80531 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:50.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd0a00700 1 -- 172.21.15.49:0/1907340301 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400f510 con 0x7f8bd4068460 2024-01-22T05:09:50.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd0a00700 1 -- 172.21.15.49:0/1907340301 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc400f670 con 0x7f8bd4068460 2024-01-22T05:09:50.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd0a00700 1 -- 172.21.15.49:0/1907340301 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400f9f0 con 0x7f8bd4068460 2024-01-22T05:09:50.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd9200700 1 -- 172.21.15.49:0/1907340301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd4068460 msgr2=0x7f8bd4151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:50.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd9200700 1 --2- 172.21.15.49:0/1907340301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd4068460 0x7f8bd4151b40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f8bc4009760 tx=0x7f8bc4009060).stop 2024-01-22T05:09:50.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd9200700 1 -- 172.21.15.49:0/1907340301 shutdown_connections 2024-01-22T05:09:50.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd9200700 1 --2- 172.21.15.49:0/1907340301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd4068460 0x7f8bd4151b40 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd9200700 1 -- 172.21.15.49:0/1907340301 >> 172.21.15.49:0/1907340301 conn(0x7f8bd40c8700 msgr2=0x7f8bd40c8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:50.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd9200700 1 -- 172.21.15.49:0/1907340301 shutdown_connections 2024-01-22T05:09:50.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.630+0000 7f8bd9200700 1 -- 172.21.15.49:0/1907340301 wait complete. 2024-01-22T05:09:50.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.634+0000 7f8bd9200700 1 Processor -- start 2024-01-22T05:09:50.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.634+0000 7f8bd9200700 1 -- start start 2024-01-22T05:09:50.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd9200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd4068460 0x7f8bd4142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:50.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd9200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd40be640 0x7f8bd4153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:50.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd9200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd4152030 0x7f8bd4150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:50.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd9200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd414e7b0 con 0x7f8bd4152030 2024-01-22T05:09:50.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd9200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4168840 con 0x7f8bd40be640 2024-01-22T05:09:50.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd9200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd414de80 con 0x7f8bd4068460 2024-01-22T05:09:50.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd2800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd4152030 0x7f8bd4150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:50.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd2800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd4152030 0x7f8bd4150100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46894/0 (socket says 172.21.15.49:46894) 2024-01-22T05:09:50.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd2800700 1 -- 172.21.15.49:0/727131143 learned_addr learned my addr 172.21.15.49:0/727131143 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:50.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd1e00700 1 --2- 172.21.15.49:0/727131143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd4068460 0x7f8bd4142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:50.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd1400700 1 --2- 172.21.15.49:0/727131143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd40be640 0x7f8bd4153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:50.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd2800700 1 -- 172.21.15.49:0/727131143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd4068460 msgr2=0x7f8bd4142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:50.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd2800700 1 --2- 172.21.15.49:0/727131143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd4068460 0x7f8bd4142d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd2800700 1 -- 172.21.15.49:0/727131143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd40be640 msgr2=0x7f8bd4153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd2800700 1 --2- 172.21.15.49:0/727131143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd40be640 0x7f8bd4153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd2800700 1 -- 172.21.15.49:0/727131143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc40092a0 con 0x7f8bd4152030 2024-01-22T05:09:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd1400700 1 --2- 172.21.15.49:0/727131143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd40be640 0x7f8bd4153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd2800700 1 --2- 172.21.15.49:0/727131143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd4152030 0x7f8bd4150100 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f8bcc00c7e0 tx=0x7f8bcc007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bc9600700 1 -- 172.21.15.49:0/727131143 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc005c70 con 0x7f8bd4152030 2024-01-22T05:09:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bc9600700 1 -- 172.21.15.49:0/727131143 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc005dd0 con 0x7f8bd4152030 2024-01-22T05:09:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd9200700 1 -- 172.21.15.49:0/727131143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd414e160 con 0x7f8bd4152030 2024-01-22T05:09:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bc9600700 1 -- 172.21.15.49:0/727131143 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc007320 con 0x7f8bd4152030 2024-01-22T05:09:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.638+0000 7f8bd9200700 1 -- 172.21.15.49:0/727131143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd4154450 con 0x7f8bd4152030 2024-01-22T05:09:50.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.642+0000 7f8bd9200700 1 -- 172.21.15.49:0/727131143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd414e960 con 0x7f8bd4152030 2024-01-22T05:09:50.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.642+0000 7f8bc9600700 1 -- 172.21.15.49:0/727131143 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8bcc007710 con 0x7f8bd4152030 2024-01-22T05:09:50.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.642+0000 7f8bc9600700 1 --2- 172.21.15.49:0/727131143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8bac05a540 0x7f8bac05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:50.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.642+0000 7f8bc9600700 1 -- 172.21.15.49:0/727131143 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f8bcc074620 con 0x7f8bd4152030 2024-01-22T05:09:50.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.646+0000 7f8bd1e00700 1 --2- 172.21.15.49:0/727131143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8bac05a540 0x7f8bac05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:50.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.646+0000 7f8bd1e00700 1 --2- 172.21.15.49:0/727131143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8bac05a540 0x7f8bac05ca00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f8bc4009630 tx=0x7f8bc4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:50.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.650+0000 7f8bc9600700 1 -- 172.21.15.49:0/727131143 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8bd414e960 con 0x7f8bd4152030 2024-01-22T05:09:50.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:50.822+0000 7f8bd9200700 1 -- 172.21.15.49:0/727131143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f8bd414e960 con 0x7f8bd4152030 2024-01-22T05:09:51.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.242+0000 7f8bc9600700 1 -- 172.21.15.49:0/727131143 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v85) v1 ==== 152+0+0 (secure 0 0 0) 0x7f8bd414e960 con 0x7f8bd4152030 2024-01-22T05:09:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.250+0000 7f8bd9200700 1 -- 172.21.15.49:0/727131143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8bac05a540 msgr2=0x7f8bac05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.250+0000 7f8bd9200700 1 --2- 172.21.15.49:0/727131143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8bac05a540 0x7f8bac05ca00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f8bc4009630 tx=0x7f8bc4017000).stop 2024-01-22T05:09:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.250+0000 7f8bd9200700 1 -- 172.21.15.49:0/727131143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd4152030 msgr2=0x7f8bd4150100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.250+0000 7f8bd9200700 1 --2- 172.21.15.49:0/727131143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd4152030 0x7f8bd4150100 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f8bcc00c7e0 tx=0x7f8bcc007f60).stop 2024-01-22T05:09:51.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.254+0000 7f8bd9200700 1 -- 172.21.15.49:0/727131143 shutdown_connections 2024-01-22T05:09:51.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.254+0000 7f8bd9200700 1 --2- 172.21.15.49:0/727131143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8bac05a540 0x7f8bac05ca00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:51.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.254+0000 7f8bd9200700 1 --2- 172.21.15.49:0/727131143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd4152030 0x7f8bd4150100 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:51.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.254+0000 7f8bd9200700 1 --2- 172.21.15.49:0/727131143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd40be640 0x7f8bd4153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:51.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.254+0000 7f8bd9200700 1 --2- 172.21.15.49:0/727131143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd4068460 0x7f8bd4142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:51.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.254+0000 7f8bd9200700 1 -- 172.21.15.49:0/727131143 >> 172.21.15.49:0/727131143 conn(0x7f8bd40c8700 msgr2=0x7f8bd40bdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:51.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.254+0000 7f8bd9200700 1 -- 172.21.15.49:0/727131143 shutdown_connections 2024-01-22T05:09:51.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.254+0000 7f8bd9200700 1 -- 172.21.15.49:0/727131143 wait complete. 2024-01-22T05:09:51.266 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-01-22T05:09:51.281 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:09:51.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.450+0000 7fb84ae00700 1 Processor -- start 2024-01-22T05:09:51.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.450+0000 7fb84ae00700 1 -- start start 2024-01-22T05:09:51.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb84ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8441510b0 0x7fb844062ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:51.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb84ae00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb844063090 0x7fb8440c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:51.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb84ae00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8440c26d0 0x7fb844059470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:51.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb84ae00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8440c36d0 con 0x7fb8440c26d0 2024-01-22T05:09:51.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb84ae00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb844067c50 con 0x7fb844063090 2024-01-22T05:09:51.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb84ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb844063510 con 0x7fb8441510b0 2024-01-22T05:09:51.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb84a400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8440c26d0 0x7fb844059470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:51.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb84a400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb8440c26d0 0x7fb844059470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46906/0 (socket says 172.21.15.49:46906) 2024-01-22T05:09:51.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb84a400700 1 -- 172.21.15.49:0/3959128104 learned_addr learned my addr 172.21.15.49:0/3959128104 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:51.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb849000700 1 --2- 172.21.15.49:0/3959128104 >> v2:172.21.15.110:3300/0 conn(0x7fb844063090 0x7fb8440c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:51.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb849a00700 1 --2- 172.21.15.49:0/3959128104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8441510b0 0x7fb844062ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:51.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb84a400700 1 -- 172.21.15.49:0/3959128104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8441510b0 msgr2=0x7fb844062ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb84a400700 1 --2- 172.21.15.49:0/3959128104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8441510b0 0x7fb844062ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb84a400700 1 -- 172.21.15.49:0/3959128104 >> v2:172.21.15.110:3300/0 conn(0x7fb844063090 msgr2=0x7fb8440c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb84a400700 1 --2- 172.21.15.49:0/3959128104 >> v2:172.21.15.110:3300/0 conn(0x7fb844063090 0x7fb8440c21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb84a400700 1 -- 172.21.15.49:0/3959128104 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb844150790 con 0x7fb8440c26d0 2024-01-22T05:09:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.454+0000 7fb849000700 1 --2- 172.21.15.49:0/3959128104 >> v2:172.21.15.110:3300/0 conn(0x7fb844063090 0x7fb8440c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.458+0000 7fb84a400700 1 --2- 172.21.15.49:0/3959128104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8440c26d0 0x7fb844059470 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7fb844069fa0 tx=0x7fb83c009840).ready entity=mon.0 client_cookie=2ffa9610993a86c8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.458+0000 7fb843e00700 1 -- 172.21.15.49:0/3959128104 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00e070 con 0x7fb8440c26d0 2024-01-22T05:09:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.458+0000 7fb843e00700 1 -- 172.21.15.49:0/3959128104 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c00ba20 con 0x7fb8440c26d0 2024-01-22T05:09:51.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.458+0000 7fb843e00700 1 -- 172.21.15.49:0/3959128104 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00bda0 con 0x7fb8440c26d0 2024-01-22T05:09:51.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.458+0000 7fb84ae00700 1 -- 172.21.15.49:0/3959128104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8440c26d0 msgr2=0x7fb844059470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:51.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.458+0000 7fb84ae00700 1 --2- 172.21.15.49:0/3959128104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8440c26d0 0x7fb844059470 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7fb844069fa0 tx=0x7fb83c009840).stop 2024-01-22T05:09:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.458+0000 7fb84ae00700 1 -- 172.21.15.49:0/3959128104 shutdown_connections 2024-01-22T05:09:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.458+0000 7fb84ae00700 1 --2- 172.21.15.49:0/3959128104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8440c26d0 0x7fb844059470 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.458+0000 7fb84ae00700 1 --2- 172.21.15.49:0/3959128104 >> v2:172.21.15.110:3300/0 conn(0x7fb844063090 0x7fb8440c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.458+0000 7fb84ae00700 1 --2- 172.21.15.49:0/3959128104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8441510b0 0x7fb844062ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.458+0000 7fb84ae00700 1 -- 172.21.15.49:0/3959128104 >> 172.21.15.49:0/3959128104 conn(0x7fb8440c3880 msgr2=0x7fb8440c3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.458+0000 7fb84ae00700 1 -- 172.21.15.49:0/3959128104 shutdown_connections 2024-01-22T05:09:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.458+0000 7fb84ae00700 1 -- 172.21.15.49:0/3959128104 wait complete. 2024-01-22T05:09:51.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.462+0000 7fb84ae00700 1 Processor -- start 2024-01-22T05:09:51.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84ae00700 1 -- start start 2024-01-22T05:09:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb844063090 0x7fb84414c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8440c26d0 0x7fb844168260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:51.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84ae00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8441510b0 0x7fb84414bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:51.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84ae00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb844154400 con 0x7fb8441510b0 2024-01-22T05:09:51.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb844134580 con 0x7fb844063090 2024-01-22T05:09:51.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440a9330 con 0x7fb8440c26d0 2024-01-22T05:09:51.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84a400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8441510b0 0x7fb84414bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:51.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84a400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8441510b0 0x7fb84414bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46916/0 (socket says 172.21.15.49:46916) 2024-01-22T05:09:51.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84a400700 1 -- 172.21.15.49:0/2936716227 learned_addr learned my addr 172.21.15.49:0/2936716227 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb849a00700 1 --2- 172.21.15.49:0/2936716227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb844063090 0x7fb84414c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb849000700 1 --2- 172.21.15.49:0/2936716227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8440c26d0 0x7fb844168260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84a400700 1 -- 172.21.15.49:0/2936716227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8440c26d0 msgr2=0x7fb844168260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84a400700 1 --2- 172.21.15.49:0/2936716227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8440c26d0 0x7fb844168260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84a400700 1 -- 172.21.15.49:0/2936716227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb844063090 msgr2=0x7fb84414c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84a400700 1 --2- 172.21.15.49:0/2936716227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb844063090 0x7fb84414c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84a400700 1 -- 172.21.15.49:0/2936716227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c0092a0 con 0x7fb8441510b0 2024-01-22T05:09:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84a400700 1 --2- 172.21.15.49:0/2936716227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8441510b0 0x7fb84414bb70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7fb84406a000 tx=0x7fb8440624e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb840c00700 1 -- 172.21.15.49:0/2936716227 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0092e0 con 0x7fb8441510b0 2024-01-22T05:09:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb840c00700 1 -- 172.21.15.49:0/2936716227 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c01e470 con 0x7fb8441510b0 2024-01-22T05:09:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb84ae00700 1 -- 172.21.15.49:0/2936716227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83c009ae0 con 0x7fb8441510b0 2024-01-22T05:09:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.466+0000 7fb840c00700 1 -- 172.21.15.49:0/2936716227 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c01e830 con 0x7fb8441510b0 2024-01-22T05:09:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.470+0000 7fb84ae00700 1 -- 172.21.15.49:0/2936716227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb844134b00 con 0x7fb8441510b0 2024-01-22T05:09:51.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.470+0000 7fb84ae00700 1 -- 172.21.15.49:0/2936716227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8440654b0 con 0x7fb8441510b0 2024-01-22T05:09:51.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.470+0000 7fb840c00700 1 -- 172.21.15.49:0/2936716227 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb83c003040 con 0x7fb8441510b0 2024-01-22T05:09:51.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.474+0000 7fb840c00700 1 --2- 172.21.15.49:0/2936716227 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb81c05a510 0x7fb81c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:51.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.474+0000 7fb840c00700 1 -- 172.21.15.49:0/2936716227 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5992+0+0 (secure 0 0 0) 0x7fb83c075d60 con 0x7fb8441510b0 2024-01-22T05:09:51.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.474+0000 7fb849a00700 1 --2- 172.21.15.49:0/2936716227 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb81c05a510 0x7fb81c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:51.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.474+0000 7fb849a00700 1 --2- 172.21.15.49:0/2936716227 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb81c05a510 0x7fb81c05c9d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fb83400bbc0 tx=0x7fb834008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:51.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.482+0000 7fb840c00700 1 -- 172.21.15.49:0/2936716227 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb83c049500 con 0x7fb8441510b0 2024-01-22T05:09:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:51.646+0000 7fb84ae00700 1 -- 172.21.15.49:0/2936716227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb8440c4420 con 0x7fb8441510b0 2024-01-22T05:09:52.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.262+0000 7fb840c00700 1 -- 172.21.15.49:0/2936716227 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb83c023030 con 0x7fb8441510b0 2024-01-22T05:09:52.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.274+0000 7fb84ae00700 1 -- 172.21.15.49:0/2936716227 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb81c05a510 msgr2=0x7fb81c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:52.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.274+0000 7fb84ae00700 1 --2- 172.21.15.49:0/2936716227 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb81c05a510 0x7fb81c05c9d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fb83400bbc0 tx=0x7fb834008040).stop 2024-01-22T05:09:52.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.274+0000 7fb84ae00700 1 -- 172.21.15.49:0/2936716227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8441510b0 msgr2=0x7fb84414bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:52.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.274+0000 7fb84ae00700 1 --2- 172.21.15.49:0/2936716227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8441510b0 0x7fb84414bb70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7fb84406a000 tx=0x7fb8440624e0).stop 2024-01-22T05:09:52.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.274+0000 7fb84ae00700 1 -- 172.21.15.49:0/2936716227 shutdown_connections 2024-01-22T05:09:52.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.274+0000 7fb84ae00700 1 --2- 172.21.15.49:0/2936716227 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb81c05a510 0x7fb81c05c9d0 secure :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0x7fb83400bbc0 tx=0x7fb834008040).stop 2024-01-22T05:09:52.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.274+0000 7fb84ae00700 1 --2- 172.21.15.49:0/2936716227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8441510b0 0x7fb84414bb70 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:52.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.274+0000 7fb84ae00700 1 --2- 172.21.15.49:0/2936716227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8440c26d0 0x7fb844168260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:52.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.274+0000 7fb84ae00700 1 --2- 172.21.15.49:0/2936716227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb844063090 0x7fb84414c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:52.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.274+0000 7fb84ae00700 1 -- 172.21.15.49:0/2936716227 >> 172.21.15.49:0/2936716227 conn(0x7fb8440c3880 msgr2=0x7fb8440680e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:52.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.278+0000 7fb84ae00700 1 -- 172.21.15.49:0/2936716227 shutdown_connections 2024-01-22T05:09:52.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.278+0000 7fb84ae00700 1 -- 172.21.15.49:0/2936716227 wait complete. 2024-01-22T05:09:52.294 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-01-22T05:09:52.315 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:09:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.474+0000 7fe232200700 1 Processor -- start 2024-01-22T05:09:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.474+0000 7fe232200700 1 -- start start 2024-01-22T05:09:52.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.474+0000 7fe232200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe22c0a8c20 0x7fe22c0c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:52.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.474+0000 7fe232200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe22c0bcbe0 0x7fe22c068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:52.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe232200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c158650 con 0x7fe22c0c1ac0 2024-01-22T05:09:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe232200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22c0c1f20 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe232200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0bd170 con 0x7fe22c0a8c20 2024-01-22T05:09:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe22be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe22c0bcbe0 0x7fe22c068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe22be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe22c0bcbe0 0x7fe22c068710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46924/0 (socket says 172.21.15.49:46924) 2024-01-22T05:09:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe22be00700 1 -- 172.21.15.49:0/2258752641 learned_addr learned my addr 172.21.15.49:0/2258752641 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe22b400700 1 --2- 172.21.15.49:0/2258752641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe22c0a8c20 0x7fe22c0c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe22be00700 1 -- 172.21.15.49:0/2258752641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe22c0a8c20 msgr2=0x7fe22c0c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe22be00700 1 --2- 172.21.15.49:0/2258752641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe22c0a8c20 0x7fe22c0c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe22be00700 1 -- 172.21.15.49:0/2258752641 >> v1:172.21.15.49:6789/0 conn(0x7fe22c0c1ac0 legacy=0x7fe22c0bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe22be00700 1 -- 172.21.15.49:0/2258752641 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c067c30 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe22be00700 1 --2- 172.21.15.49:0/2258752641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe22c0bcbe0 0x7fe22c068710 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7fe224009f20 tx=0x7fe224009840).ready entity=mon.0 client_cookie=cd7d8b63a4a19888 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:52.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe22a000700 1 -- 172.21.15.49:0/2258752641 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22400e070 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe22a000700 1 -- 172.21.15.49:0/2258752641 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22400ba80 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe22a000700 1 -- 172.21.15.49:0/2258752641 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22400be00 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe232200700 1 -- 172.21.15.49:0/2258752641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe22c0bcbe0 msgr2=0x7fe22c068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:52.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe232200700 1 --2- 172.21.15.49:0/2258752641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe22c0bcbe0 0x7fe22c068710 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7fe224009f20 tx=0x7fe224009840).stop 2024-01-22T05:09:52.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe232200700 1 -- 172.21.15.49:0/2258752641 shutdown_connections 2024-01-22T05:09:52.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe232200700 1 --2- 172.21.15.49:0/2258752641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe22c0bcbe0 0x7fe22c068710 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:52.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe232200700 1 --2- 172.21.15.49:0/2258752641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe22c0a8c20 0x7fe22c0c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:52.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.478+0000 7fe232200700 1 -- 172.21.15.49:0/2258752641 >> 172.21.15.49:0/2258752641 conn(0x7fe22c062cb0 msgr2=0x7fe22c0c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:52.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.482+0000 7fe232200700 1 -- 172.21.15.49:0/2258752641 shutdown_connections 2024-01-22T05:09:52.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.482+0000 7fe232200700 1 -- 172.21.15.49:0/2258752641 wait complete. 2024-01-22T05:09:52.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.482+0000 7fe232200700 1 Processor -- start 2024-01-22T05:09:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.482+0000 7fe232200700 1 -- start start 2024-01-22T05:09:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe232200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe22c0a8c20 0x7fe22c0a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe232200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe22c0bcbe0 0x7fe22c168220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe232200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe22c0c1ac0 0x7fe22c0be090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe232200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0bf560 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe232200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c168710 con 0x7fe22c0a8c20 2024-01-22T05:09:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe232200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0be8e0 con 0x7fe22c0c1ac0 2024-01-22T05:09:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe22aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe22c0bcbe0 0x7fe22c168220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:52.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe22aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe22c0bcbe0 0x7fe22c168220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46934/0 (socket says 172.21.15.49:46934) 2024-01-22T05:09:52.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe22aa00700 1 -- 172.21.15.49:0/1658823675 learned_addr learned my addr 172.21.15.49:0/1658823675 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:52.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe22be00700 1 --2- 172.21.15.49:0/1658823675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe22c0c1ac0 0x7fe22c0be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:52.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe22b400700 1 --2- 172.21.15.49:0/1658823675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe22c0a8c20 0x7fe22c0a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:52.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe22aa00700 1 -- 172.21.15.49:0/1658823675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe22c0c1ac0 msgr2=0x7fe22c0be090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:52.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe22aa00700 1 --2- 172.21.15.49:0/1658823675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe22c0c1ac0 0x7fe22c0be090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:52.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe22aa00700 1 -- 172.21.15.49:0/1658823675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe22c0a8c20 msgr2=0x7fe22c0a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:52.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe22aa00700 1 --2- 172.21.15.49:0/1658823675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe22c0a8c20 0x7fe22c0a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:52.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe22aa00700 1 -- 172.21.15.49:0/1658823675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe224009ae0 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe22aa00700 1 --2- 172.21.15.49:0/1658823675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe22c0bcbe0 0x7fe22c168220 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fe21400c440 tx=0x7fe214007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:52.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe222a00700 1 -- 172.21.15.49:0/1658823675 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214013450 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe222a00700 1 -- 172.21.15.49:0/1658823675 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2140135b0 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe232200700 1 -- 172.21.15.49:0/1658823675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c0bebc0 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe222a00700 1 -- 172.21.15.49:0/1658823675 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214013970 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.486+0000 7fe232200700 1 -- 172.21.15.49:0/1658823675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c0bf180 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.490+0000 7fe232200700 1 -- 172.21.15.49:0/1658823675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c158260 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.490+0000 7fe222a00700 1 -- 172.21.15.49:0/1658823675 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe21401d440 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.494+0000 7fe222a00700 1 --2- 172.21.15.49:0/1658823675 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe20405a510 0x7fe20405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:52.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.494+0000 7fe222a00700 1 -- 172.21.15.49:0/1658823675 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6374+0+0 (secure 0 0 0) 0x7fe214073e90 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.494+0000 7fe22b400700 1 --2- 172.21.15.49:0/1658823675 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe20405a510 0x7fe20405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:52.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.494+0000 7fe22b400700 1 --2- 172.21.15.49:0/1658823675 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe20405a510 0x7fe20405c9d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fe21c00bbc0 tx=0x7fe21c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:52.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.502+0000 7fe222a00700 1 -- 172.21.15.49:0/1658823675 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe214047450 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.702+0000 7fe232200700 1 -- 172.21.15.49:0/1658823675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe22c1597d0 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.714+0000 7fe222a00700 1 -- 172.21.15.49:0/1658823675 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v66) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe22c1597d0 con 0x7fe22c0bcbe0 2024-01-22T05:09:52.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.722+0000 7fe232200700 1 -- 172.21.15.49:0/1658823675 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe20405a510 msgr2=0x7fe20405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:52.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.722+0000 7fe232200700 1 --2- 172.21.15.49:0/1658823675 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe20405a510 0x7fe20405c9d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fe21c00bbc0 tx=0x7fe21c008040).stop 2024-01-22T05:09:52.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.722+0000 7fe232200700 1 -- 172.21.15.49:0/1658823675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe22c0bcbe0 msgr2=0x7fe22c168220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:52.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.722+0000 7fe232200700 1 --2- 172.21.15.49:0/1658823675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe22c0bcbe0 0x7fe22c168220 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fe21400c440 tx=0x7fe214007db0).stop 2024-01-22T05:09:52.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.726+0000 7fe232200700 1 -- 172.21.15.49:0/1658823675 shutdown_connections 2024-01-22T05:09:52.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.726+0000 7fe232200700 1 --2- 172.21.15.49:0/1658823675 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe20405a510 0x7fe20405c9d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:52.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.726+0000 7fe232200700 1 --2- 172.21.15.49:0/1658823675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe22c0c1ac0 0x7fe22c0be090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.726+0000 7fe232200700 1 --2- 172.21.15.49:0/1658823675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe22c0bcbe0 0x7fe22c168220 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.726+0000 7fe232200700 1 --2- 172.21.15.49:0/1658823675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe22c0a8c20 0x7fe22c0a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.726+0000 7fe232200700 1 -- 172.21.15.49:0/1658823675 >> 172.21.15.49:0/1658823675 conn(0x7fe22c062cb0 msgr2=0x7fe22c0bc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:52.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.730+0000 7fe232200700 1 -- 172.21.15.49:0/1658823675 shutdown_connections 2024-01-22T05:09:52.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.730+0000 7fe232200700 1 -- 172.21.15.49:0/1658823675 wait complete. 2024-01-22T05:09:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 12 and data pool 13 2024-01-22T05:09:52.766 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:09:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.926+0000 7f420da00700 1 Processor -- start 2024-01-22T05:09:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.926+0000 7f420da00700 1 -- start start 2024-01-22T05:09:52.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.926+0000 7f420da00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42080c25e0 0x7f42080a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:52.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.926+0000 7f420da00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42080c1a40 con 0x7f4208155d20 2024-01-22T05:09:52.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.926+0000 7f420da00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42080a90b0 con 0x7f42080a8740 2024-01-22T05:09:52.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.926+0000 7f420da00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4208159310 con 0x7f42080c25e0 2024-01-22T05:09:52.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f4206a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4208155d20 0x7f4208065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41872/0 (socket says 172.21.15.49:41872) 2024-01-22T05:09:52.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f4206a00700 1 -- 172.21.15.49:0/3639141467 learned_addr learned my addr 172.21.15.49:0/3639141467 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:52.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f4207400700 1 --2- 172.21.15.49:0/3639141467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42080c25e0 0x7f42080a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:52.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f4205600700 1 -- 172.21.15.49:0/3639141467 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523875822 0 0) 0x7f42080a90b0 con 0x7f42080a8740 2024-01-22T05:09:52.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f4205600700 1 -- 172.21.15.49:0/3639141467 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41e80033f0 con 0x7f42080a8740 2024-01-22T05:09:52.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f4205600700 1 -- 172.21.15.49:0/3639141467 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658429056 0 0) 0x7f42080c1a40 con 0x7f4208155d20 2024-01-22T05:09:52.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f4205600700 1 -- 172.21.15.49:0/3639141467 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42080a90b0 con 0x7f4208155d20 2024-01-22T05:09:52.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f4207400700 1 -- 172.21.15.49:0/3639141467 >> v1:172.21.15.110:6789/0 conn(0x7f42080a8740 legacy=0x7f42080c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:52.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f4207400700 1 -- 172.21.15.49:0/3639141467 >> v1:172.21.15.49:6789/0 conn(0x7f4208155d20 legacy=0x7f4208065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:52.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f4207400700 1 -- 172.21.15.49:0/3639141467 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42080c13f0 con 0x7f42080c25e0 2024-01-22T05:09:52.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f4207400700 1 --2- 172.21.15.49:0/3639141467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42080c25e0 0x7f42080a8bc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f4200009e90 tx=0x7f4200009780).ready entity=mon.2 client_cookie=ea9adb400ef8e348 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:52.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f4205600700 1 -- 172.21.15.49:0/3639141467 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420000e070 con 0x7f42080c25e0 2024-01-22T05:09:52.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f4205600700 1 -- 172.21.15.49:0/3639141467 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420000bab0 con 0x7f42080c25e0 2024-01-22T05:09:52.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f4205600700 1 -- 172.21.15.49:0/3639141467 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420000be30 con 0x7f42080c25e0 2024-01-22T05:09:52.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f420da00700 1 -- 172.21.15.49:0/3639141467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42080c25e0 msgr2=0x7f42080a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:52.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.930+0000 7f420da00700 1 --2- 172.21.15.49:0/3639141467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42080c25e0 0x7f42080a8bc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f4200009e90 tx=0x7f4200009780).stop 2024-01-22T05:09:52.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.934+0000 7f420da00700 1 -- 172.21.15.49:0/3639141467 shutdown_connections 2024-01-22T05:09:52.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.934+0000 7f420da00700 1 --2- 172.21.15.49:0/3639141467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42080c25e0 0x7f42080a8bc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:52.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.934+0000 7f420da00700 1 -- 172.21.15.49:0/3639141467 >> 172.21.15.49:0/3639141467 conn(0x7f42080c6540 msgr2=0x7f42080c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:52.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.934+0000 7f420da00700 1 -- 172.21.15.49:0/3639141467 shutdown_connections 2024-01-22T05:09:52.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.934+0000 7f420da00700 1 -- 172.21.15.49:0/3639141467 wait complete. 2024-01-22T05:09:52.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.934+0000 7f420da00700 1 Processor -- start 2024-01-22T05:09:52.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.938+0000 7f420da00700 1 -- start start 2024-01-22T05:09:52.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.938+0000 7f420da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42080a8740 0x7f420815b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:52.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.938+0000 7f420da00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42080c25e0 0x7f42081518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.938+0000 7f420da00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4208155d20 0x7f420815a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.938+0000 7f420da00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4208151dd0 con 0x7f42080a8740 2024-01-22T05:09:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.938+0000 7f420da00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4208169180 con 0x7f42080c25e0 2024-01-22T05:09:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.938+0000 7f420da00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4208159ee0 con 0x7f4208155d20 2024-01-22T05:09:52.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.938+0000 7f4206a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42080a8740 0x7f420815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.938+0000 7f4206a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42080a8740 0x7f420815b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46946/0 (socket says 172.21.15.49:46946) 2024-01-22T05:09:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.938+0000 7f4206a00700 1 -- 172.21.15.49:0/2951034097 learned_addr learned my addr 172.21.15.49:0/2951034097 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.938+0000 7f4207400700 1 --2- 172.21.15.49:0/2951034097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4208155d20 0x7f420815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.938+0000 7f4206000700 1 --2- 172.21.15.49:0/2951034097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42080c25e0 0x7f42081518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.942+0000 7f4206a00700 1 -- 172.21.15.49:0/2951034097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4208155d20 msgr2=0x7f420815a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.942+0000 7f4206a00700 1 --2- 172.21.15.49:0/2951034097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4208155d20 0x7f420815a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.942+0000 7f4206a00700 1 -- 172.21.15.49:0/2951034097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42080c25e0 msgr2=0x7f42081518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.942+0000 7f4206a00700 1 --2- 172.21.15.49:0/2951034097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42080c25e0 0x7f42081518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.942+0000 7f4206a00700 1 -- 172.21.15.49:0/2951034097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4200009a20 con 0x7f42080a8740 2024-01-22T05:09:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.942+0000 7f4206000700 1 --2- 172.21.15.49:0/2951034097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42080c25e0 0x7f42081518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:52.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.942+0000 7f4206a00700 1 --2- 172.21.15.49:0/2951034097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42080a8740 0x7f420815b260 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f41f800c450 tx=0x7f41f8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.942+0000 7f41fe000700 1 -- 172.21.15.49:0/2951034097 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f800ce10 con 0x7f42080a8740 2024-01-22T05:09:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.942+0000 7f41fe000700 1 -- 172.21.15.49:0/2951034097 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f80072e0 con 0x7f42080a8740 2024-01-22T05:09:52.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.942+0000 7f420da00700 1 -- 172.21.15.49:0/2951034097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42081595f0 con 0x7f42080a8740 2024-01-22T05:09:52.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.942+0000 7f41fe000700 1 -- 172.21.15.49:0/2951034097 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8007660 con 0x7f42080a8740 2024-01-22T05:09:52.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.942+0000 7f420da00700 1 -- 172.21.15.49:0/2951034097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4208159b70 con 0x7f42080a8740 2024-01-22T05:09:52.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.942+0000 7f420da00700 1 -- 172.21.15.49:0/2951034097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4208065800 con 0x7f42080a8740 2024-01-22T05:09:52.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.946+0000 7f41fe000700 1 -- 172.21.15.49:0/2951034097 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f41f80059b0 con 0x7f42080a8740 2024-01-22T05:09:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.946+0000 7f41fe000700 1 --2- 172.21.15.49:0/2951034097 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f41e005a510 0x7f41e005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.946+0000 7f41fe000700 1 -- 172.21.15.49:0/2951034097 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f41f80740c0 con 0x7f42080a8740 2024-01-22T05:09:52.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.946+0000 7f4206000700 1 --2- 172.21.15.49:0/2951034097 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f41e005a510 0x7f41e005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:52.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.950+0000 7f4206000700 1 --2- 172.21.15.49:0/2951034097 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f41e005a510 0x7f41e005c9d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f41f0007fd0 tx=0x7f41f0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:52.954+0000 7f41fe000700 1 -- 172.21.15.49:0/2951034097 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4208065800 con 0x7f42080a8740 2024-01-22T05:09:53.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.118+0000 7f420da00700 1 -- 172.21.15.49:0/2951034097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4208047060 con 0x7f42080a8740 2024-01-22T05:09:53.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.122+0000 7f41fe000700 1 -- 172.21.15.49:0/2951034097 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+17180 (secure 0 0 0) 0x7f41f8047680 con 0x7f42080a8740 2024-01-22T05:09:53.126 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:53.126 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":87,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:09:52.706781+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:09:50.901052+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-22T05:09:51.722128+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:09:53.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.122+0000 7f420da00700 1 -- 172.21.15.49:0/2951034097 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f41e005a510 msgr2=0x7f41e005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:53.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.122+0000 7f420da00700 1 --2- 172.21.15.49:0/2951034097 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f41e005a510 0x7f41e005c9d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f41f0007fd0 tx=0x7f41f0009040).stop 2024-01-22T05:09:53.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.126+0000 7f420da00700 1 -- 172.21.15.49:0/2951034097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42080a8740 msgr2=0x7f420815b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:53.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.126+0000 7f420da00700 1 --2- 172.21.15.49:0/2951034097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42080a8740 0x7f420815b260 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f41f800c450 tx=0x7f41f8007c80).stop 2024-01-22T05:09:53.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.126+0000 7f420da00700 1 -- 172.21.15.49:0/2951034097 shutdown_connections 2024-01-22T05:09:53.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.126+0000 7f420da00700 1 --2- 172.21.15.49:0/2951034097 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f41e005a510 0x7f41e005c9d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.126+0000 7f420da00700 1 --2- 172.21.15.49:0/2951034097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4208155d20 0x7f420815a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.126+0000 7f420da00700 1 --2- 172.21.15.49:0/2951034097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42080c25e0 0x7f42081518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.126+0000 7f420da00700 1 --2- 172.21.15.49:0/2951034097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42080a8740 0x7f420815b260 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.126+0000 7f420da00700 1 -- 172.21.15.49:0/2951034097 >> 172.21.15.49:0/2951034097 conn(0x7f42080c6540 msgr2=0x7f4208065b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:53.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.126+0000 7f420da00700 1 -- 172.21.15.49:0/2951034097 shutdown_connections 2024-01-22T05:09:53.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.126+0000 7f420da00700 1 -- 172.21.15.49:0/2951034097 wait complete. 2024-01-22T05:09:53.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:09:53.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.306+0000 7fb442200700 1 Processor -- start 2024-01-22T05:09:53.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.306+0000 7fb442200700 1 -- start start 2024-01-22T05:09:53.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.306+0000 7fb442200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb43c068ba0 0x7fb43c0a6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:53.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.306+0000 7fb442200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c0ad520 con 0x7fb43c0a5a30 2024-01-22T05:09:53.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.306+0000 7fb442200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c069480 con 0x7fb43c068f80 2024-01-22T05:09:53.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.306+0000 7fb442200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c069d20 con 0x7fb43c068ba0 2024-01-22T05:09:53.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.306+0000 7fb43b400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb43c068ba0 0x7fb43c0a6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:53.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.306+0000 7fb43b400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb43c068ba0 0x7fb43c0a6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54414/0 (socket says 172.21.15.49:54414) 2024-01-22T05:09:53.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.306+0000 7fb43b400700 1 -- 172.21.15.49:0/1615448089 learned_addr learned my addr 172.21.15.49:0/1615448089 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:53.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.310+0000 7fb43b400700 1 -- 172.21.15.49:0/1615448089 >> v1:172.21.15.110:6789/0 conn(0x7fb43c068f80 legacy=0x7fb43c0ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:53.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.310+0000 7fb43b400700 1 -- 172.21.15.49:0/1615448089 >> v1:172.21.15.49:6789/0 conn(0x7fb43c0a5a30 legacy=0x7fb43c0ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:53.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.310+0000 7fb43b400700 1 -- 172.21.15.49:0/1615448089 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c069760 con 0x7fb43c068ba0 2024-01-22T05:09:53.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.310+0000 7fb43b400700 1 --2- 172.21.15.49:0/1615448089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb43c068ba0 0x7fb43c0a6590 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fb42c009810 tx=0x7fb42c009060).ready entity=mon.0 client_cookie=dbd834342f3966ac server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:53.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.310+0000 7fb43a000700 1 -- 172.21.15.49:0/1615448089 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c005880 con 0x7fb43c068ba0 2024-01-22T05:09:53.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.310+0000 7fb43a000700 1 -- 172.21.15.49:0/1615448089 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c0059e0 con 0x7fb43c068ba0 2024-01-22T05:09:53.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.310+0000 7fb43a000700 1 -- 172.21.15.49:0/1615448089 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c005d60 con 0x7fb43c068ba0 2024-01-22T05:09:53.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.310+0000 7fb442200700 1 -- 172.21.15.49:0/1615448089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb43c068ba0 msgr2=0x7fb43c0a6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:53.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.310+0000 7fb442200700 1 --2- 172.21.15.49:0/1615448089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb43c068ba0 0x7fb43c0a6590 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fb42c009810 tx=0x7fb42c009060).stop 2024-01-22T05:09:53.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.310+0000 7fb442200700 1 -- 172.21.15.49:0/1615448089 shutdown_connections 2024-01-22T05:09:53.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.310+0000 7fb442200700 1 --2- 172.21.15.49:0/1615448089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb43c068ba0 0x7fb43c0a6590 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.310+0000 7fb442200700 1 -- 172.21.15.49:0/1615448089 >> 172.21.15.49:0/1615448089 conn(0x7fb43c0aa670 msgr2=0x7fb43c0aaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:53.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.310+0000 7fb442200700 1 -- 172.21.15.49:0/1615448089 shutdown_connections 2024-01-22T05:09:53.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.310+0000 7fb442200700 1 -- 172.21.15.49:0/1615448089 wait complete. 2024-01-22T05:09:53.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.314+0000 7fb442200700 1 Processor -- start 2024-01-22T05:09:53.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.314+0000 7fb442200700 1 -- start start 2024-01-22T05:09:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.314+0000 7fb442200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb43c068ba0 0x7fb43c16b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb442200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb43c068f80 0x7fb43c142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:53.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb442200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb43c0a5a30 0x7fb43c142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb442200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c16b980 con 0x7fb43c0a5a30 2024-01-22T05:09:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb442200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c1420b0 con 0x7fb43c068f80 2024-01-22T05:09:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb442200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c1414a0 con 0x7fb43c068ba0 2024-01-22T05:09:53.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb43be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb43c0a5a30 0x7fb43c142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:53.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb43be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb43c0a5a30 0x7fb43c142a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54420/0 (socket says 172.21.15.49:54420) 2024-01-22T05:09:53.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb43be00700 1 -- 172.21.15.49:0/525196731 learned_addr learned my addr 172.21.15.49:0/525196731 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:53.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb43aa00700 1 --2- 172.21.15.49:0/525196731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb43c068f80 0x7fb43c142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:53.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb43b400700 1 --2- 172.21.15.49:0/525196731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb43c068ba0 0x7fb43c16b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:53.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb43be00700 1 -- 172.21.15.49:0/525196731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb43c068ba0 msgr2=0x7fb43c16b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:53.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb43be00700 1 --2- 172.21.15.49:0/525196731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb43c068ba0 0x7fb43c16b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb43be00700 1 -- 172.21.15.49:0/525196731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb43c068f80 msgr2=0x7fb43c142540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:53.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb43be00700 1 --2- 172.21.15.49:0/525196731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb43c068f80 0x7fb43c142540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb43be00700 1 -- 172.21.15.49:0/525196731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c009300 con 0x7fb43c0a5a30 2024-01-22T05:09:53.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb43be00700 1 --2- 172.21.15.49:0/525196731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb43c0a5a30 0x7fb43c142a30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7fb43400c7c0 tx=0x7fb4340014e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:53.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb432a00700 1 -- 172.21.15.49:0/525196731 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434010510 con 0x7fb43c0a5a30 2024-01-22T05:09:53.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb432a00700 1 -- 172.21.15.49:0/525196731 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb434010670 con 0x7fb43c0a5a30 2024-01-22T05:09:53.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb442200700 1 -- 172.21.15.49:0/525196731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43c141780 con 0x7fb43c0a5a30 2024-01-22T05:09:53.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb432a00700 1 -- 172.21.15.49:0/525196731 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434010a10 con 0x7fb43c0a5a30 2024-01-22T05:09:53.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.318+0000 7fb442200700 1 -- 172.21.15.49:0/525196731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c141d40 con 0x7fb43c0a5a30 2024-01-22T05:09:53.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.322+0000 7fb442200700 1 -- 172.21.15.49:0/525196731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c142240 con 0x7fb43c0a5a30 2024-01-22T05:09:53.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.322+0000 7fb432a00700 1 -- 172.21.15.49:0/525196731 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb43401b3b0 con 0x7fb43c0a5a30 2024-01-22T05:09:53.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.322+0000 7fb432a00700 1 --2- 172.21.15.49:0/525196731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb41405a510 0x7fb41405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:53.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.322+0000 7fb432a00700 1 -- 172.21.15.49:0/525196731 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb4340742a0 con 0x7fb43c0a5a30 2024-01-22T05:09:53.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.322+0000 7fb43b400700 1 --2- 172.21.15.49:0/525196731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb41405a510 0x7fb41405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:53.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.326+0000 7fb43b400700 1 --2- 172.21.15.49:0/525196731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb41405a510 0x7fb41405c9d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fb42c009fd0 tx=0x7fb42c016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:53.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.330+0000 7fb432a00700 1 -- 172.21.15.49:0/525196731 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb4340478b0 con 0x7fb43c0a5a30 2024-01-22T05:09:53.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.494+0000 7fb442200700 1 -- 172.21.15.49:0/525196731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb43c0647e0 con 0x7fb43c0a5a30 2024-01-22T05:09:53.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.498+0000 7fb432a00700 1 -- 172.21.15.49:0/525196731 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+17180 (secure 0 0 0) 0x7fb43404aed0 con 0x7fb43c0a5a30 2024-01-22T05:09:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:53.502 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":87,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:09:52.706781+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:09:50.901052+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-22T05:09:51.722128+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:09:53.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.498+0000 7fb442200700 1 -- 172.21.15.49:0/525196731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb41405a510 msgr2=0x7fb41405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:53.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.498+0000 7fb442200700 1 --2- 172.21.15.49:0/525196731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb41405a510 0x7fb41405c9d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fb42c009fd0 tx=0x7fb42c016000).stop 2024-01-22T05:09:53.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.498+0000 7fb442200700 1 -- 172.21.15.49:0/525196731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb43c0a5a30 msgr2=0x7fb43c142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:53.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.498+0000 7fb442200700 1 --2- 172.21.15.49:0/525196731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb43c0a5a30 0x7fb43c142a30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7fb43400c7c0 tx=0x7fb4340014e0).stop 2024-01-22T05:09:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.502+0000 7fb442200700 1 -- 172.21.15.49:0/525196731 shutdown_connections 2024-01-22T05:09:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.502+0000 7fb442200700 1 --2- 172.21.15.49:0/525196731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb41405a510 0x7fb41405c9d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.502+0000 7fb442200700 1 --2- 172.21.15.49:0/525196731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb43c0a5a30 0x7fb43c142a30 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.502+0000 7fb442200700 1 --2- 172.21.15.49:0/525196731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb43c068f80 0x7fb43c142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.502+0000 7fb442200700 1 --2- 172.21.15.49:0/525196731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb43c068ba0 0x7fb43c16b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.502+0000 7fb442200700 1 -- 172.21.15.49:0/525196731 >> 172.21.15.49:0/525196731 conn(0x7fb43c0aa670 msgr2=0x7fb43c150770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.502+0000 7fb442200700 1 -- 172.21.15.49:0/525196731 shutdown_connections 2024-01-22T05:09:53.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.502+0000 7fb442200700 1 -- 172.21.15.49:0/525196731 wait complete. 2024-01-22T05:09:53.527 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:09:53.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.698+0000 7f7796400700 1 Processor -- start 2024-01-22T05:09:53.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.698+0000 7f7796400700 1 -- start start 2024-01-22T05:09:53.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.702+0000 7f7796400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7790153cf0 0x7f77900c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:53.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.702+0000 7f7796400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f77900bcba0 0x7f7790068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:53.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.702+0000 7f7796400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7790068280 con 0x7f77900c1ac0 2024-01-22T05:09:53.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.702+0000 7f7796400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77900c1f30 con 0x7f77900bcba0 2024-01-22T05:09:53.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.702+0000 7f7796400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77900bd190 con 0x7f7790153cf0 2024-01-22T05:09:53.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.702+0000 7f778ea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f77900c1ac0 0x7f77900bc490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45702/0 (socket says 172.21.15.49:45702) 2024-01-22T05:09:53.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.702+0000 7f778ea00700 1 -- 172.21.15.49:0/2683747550 learned_addr learned my addr 172.21.15.49:0/2683747550 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:53.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.702+0000 7f778fe00700 1 --2- 172.21.15.49:0/2683747550 >> v2:172.21.15.49:3300/0 conn(0x7f77900bcba0 0x7f7790068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:53.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.702+0000 7f778f400700 1 --2- 172.21.15.49:0/2683747550 >> v2:172.21.15.110:3300/0 conn(0x7f7790153cf0 0x7f77900c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:53.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 -- 172.21.15.49:0/2683747550 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884950947 0 0) 0x7f7790068280 con 0x7f77900c1ac0 2024-01-22T05:09:53.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 -- 172.21.15.49:0/2683747550 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77700033f0 con 0x7f77900c1ac0 2024-01-22T05:09:53.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 -- 172.21.15.49:0/2683747550 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 683351263 0 0) 0x7f77700033f0 con 0x7f77900c1ac0 2024-01-22T05:09:53.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 -- 172.21.15.49:0/2683747550 >> v2:172.21.15.110:3300/0 conn(0x7f7790153cf0 msgr2=0x7f77900c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:53.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 --2- 172.21.15.49:0/2683747550 >> v2:172.21.15.110:3300/0 conn(0x7f7790153cf0 0x7f77900c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 -- 172.21.15.49:0/2683747550 >> v2:172.21.15.49:3300/0 conn(0x7f77900bcba0 msgr2=0x7f7790068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:53.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 --2- 172.21.15.49:0/2683747550 >> v2:172.21.15.49:3300/0 conn(0x7f77900bcba0 0x7f7790068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 -- 172.21.15.49:0/2683747550 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7790067c30 con 0x7f77900c1ac0 2024-01-22T05:09:53.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 -- 172.21.15.49:0/2683747550 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f77780015f0 con 0x7f77900c1ac0 2024-01-22T05:09:53.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 -- 172.21.15.49:0/2683747550 >> v1:172.21.15.49:6789/0 conn(0x7f77900c1ac0 legacy=0x7f77900bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:53.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 --2- 172.21.15.49:0/2683747550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77700038e0 0x7f7770003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:53.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 --2- 172.21.15.49:0/2683747550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7770004690 0x7f7770004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:53.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 --2- 172.21.15.49:0/2683747550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7770005000 0x7f777000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:53.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 -- 172.21.15.49:0/2683747550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77900c1f30 con 0x7f7770005000 2024-01-22T05:09:53.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 -- 172.21.15.49:0/2683747550 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77900bd190 con 0x7f7770004690 2024-01-22T05:09:53.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778e000700 1 -- 172.21.15.49:0/2683747550 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777000bdd0 con 0x7f77700038e0 2024-01-22T05:09:53.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778f400700 1 --2- 172.21.15.49:0/2683747550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77700038e0 0x7f7770003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:53.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778fe00700 1 --2- 172.21.15.49:0/2683747550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7770005000 0x7f777000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778ea00700 1 --2- 172.21.15.49:0/2683747550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7770004690 0x7f7770004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778f400700 1 -- 172.21.15.49:0/2683747550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7770004690 msgr2=0x7f7770004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778f400700 1 --2- 172.21.15.49:0/2683747550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7770004690 0x7f7770004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778f400700 1 -- 172.21.15.49:0/2683747550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7770005000 msgr2=0x7f777000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778f400700 1 --2- 172.21.15.49:0/2683747550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7770005000 0x7f777000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778f400700 1 -- 172.21.15.49:0/2683747550 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77700033f0 con 0x7f77700038e0 2024-01-22T05:09:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778ea00700 1 --2- 172.21.15.49:0/2683747550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7770004690 0x7f7770004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778fe00700 1 --2- 172.21.15.49:0/2683747550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7770005000 0x7f777000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778fe00700 1 -- 172.21.15.49:0/2683747550 reap_dead start 2024-01-22T05:09:53.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.706+0000 7f778f400700 1 --2- 172.21.15.49:0/2683747550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77700038e0 0x7f7770003d00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f7780009a80 tx=0x7f7780009060).ready entity=mon.2 client_cookie=386ee6658ff54706 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:53.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.710+0000 7f778e000700 1 -- 172.21.15.49:0/2683747550 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780009430 con 0x7f77700038e0 2024-01-22T05:09:53.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.710+0000 7f778e000700 1 -- 172.21.15.49:0/2683747550 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778000e640 con 0x7f77700038e0 2024-01-22T05:09:53.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.710+0000 7f778e000700 1 -- 172.21.15.49:0/2683747550 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778000e9c0 con 0x7f77700038e0 2024-01-22T05:09:53.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.710+0000 7f7796400700 1 -- 172.21.15.49:0/2683747550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77700038e0 msgr2=0x7f7770003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:53.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.710+0000 7f7796400700 1 --2- 172.21.15.49:0/2683747550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77700038e0 0x7f7770003d00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f7780009a80 tx=0x7f7780009060).stop 2024-01-22T05:09:53.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.710+0000 7f7796400700 1 -- 172.21.15.49:0/2683747550 shutdown_connections 2024-01-22T05:09:53.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.710+0000 7f7796400700 1 --2- 172.21.15.49:0/2683747550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77700038e0 0x7f7770003d00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.710+0000 7f7796400700 1 -- 172.21.15.49:0/2683747550 >> 172.21.15.49:0/2683747550 conn(0x7f7790062cb0 msgr2=0x7f77900c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:53.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.710+0000 7f7796400700 1 -- 172.21.15.49:0/2683747550 shutdown_connections 2024-01-22T05:09:53.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.710+0000 7f7796400700 1 -- 172.21.15.49:0/2683747550 wait complete. 2024-01-22T05:09:53.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.714+0000 7f7796400700 1 Processor -- start 2024-01-22T05:09:53.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.714+0000 7f7796400700 1 -- start start 2024-01-22T05:09:53.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f7796400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77700038e0 0x7f77900a56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:53.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f7796400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77900a38b0 0x7f77900a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:53.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f7796400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77901647d0 0x7f7790164c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:53.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f7796400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77900a60b0 con 0x7f77900a38b0 2024-01-22T05:09:53.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f7796400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77900a49a0 con 0x7f77901647d0 2024-01-22T05:09:53.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f7796400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7790156c90 con 0x7f77700038e0 2024-01-22T05:09:53.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f778ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77900a38b0 0x7f77900a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:53.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f778ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77900a38b0 0x7f77900a5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54436/0 (socket says 172.21.15.49:54436) 2024-01-22T05:09:53.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f778ea00700 1 -- 172.21.15.49:0/1496088309 learned_addr learned my addr 172.21.15.49:0/1496088309 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:53.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f778f400700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77700038e0 0x7f77900a56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:53.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f778fe00700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77901647d0 0x7f7790164c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:53.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f778ea00700 1 -- 172.21.15.49:0/1496088309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77700038e0 msgr2=0x7f77900a56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:53.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f778ea00700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77700038e0 0x7f77900a56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f778ea00700 1 -- 172.21.15.49:0/1496088309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77901647d0 msgr2=0x7f7790164c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:53.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f778ea00700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77901647d0 0x7f7790164c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:53.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f778ea00700 1 -- 172.21.15.49:0/1496088309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77900a3d90 con 0x7f77900a38b0 2024-01-22T05:09:53.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f778f400700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77700038e0 0x7f77900a56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:53.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f778fe00700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77901647d0 0x7f7790164c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:53.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.718+0000 7f778ea00700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77900a38b0 0x7f77900a5bc0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f7778001190 tx=0x7f7778009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:53.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.722+0000 7f7786a00700 1 -- 172.21.15.49:0/1496088309 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77780015b0 con 0x7f77900a38b0 2024-01-22T05:09:53.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.722+0000 7f7786a00700 1 -- 172.21.15.49:0/1496088309 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77780070d0 con 0x7f77900a38b0 2024-01-22T05:09:53.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.722+0000 7f7786a00700 1 -- 172.21.15.49:0/1496088309 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778007470 con 0x7f77900a38b0 2024-01-22T05:09:53.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.722+0000 7f7796400700 1 -- 172.21.15.49:0/1496088309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77900a4070 con 0x7f77900a38b0 2024-01-22T05:09:53.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.722+0000 7f7796400700 1 -- 172.21.15.49:0/1496088309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77900a46b0 con 0x7f77900a38b0 2024-01-22T05:09:53.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.722+0000 7f7796400700 1 -- 172.21.15.49:0/1496088309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7790153920 con 0x7f77900a38b0 2024-01-22T05:09:53.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.726+0000 7f7786a00700 1 -- 172.21.15.49:0/1496088309 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f777800db00 con 0x7f77900a38b0 2024-01-22T05:09:53.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.726+0000 7f7786a00700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f776805a560 0x7f776805ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:53.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.726+0000 7f7786a00700 1 -- 172.21.15.49:0/1496088309 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7778074350 con 0x7f77900a38b0 2024-01-22T05:09:53.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.726+0000 7f778f400700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f776805a560 0x7f776805ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:53.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.726+0000 7f778f400700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f776805a560 0x7f776805ca20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f7780006d50 tx=0x7f778001a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:53.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.734+0000 7f7786a00700 1 -- 172.21.15.49:0/1496088309 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7790153920 con 0x7f77900a38b0 2024-01-22T05:09:53.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:53.942+0000 7f7796400700 1 -- 172.21.15.49:0/1496088309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7790153920 con 0x7f77900a38b0 2024-01-22T05:09:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.726+0000 7f7786a00700 1 -- 172.21.15.49:0/1496088309 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7790153920 con 0x7f77900a38b0 2024-01-22T05:09:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.730+0000 7f7796400700 1 -- 172.21.15.49:0/1496088309 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f776805a560 msgr2=0x7f776805ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.730+0000 7f7796400700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f776805a560 0x7f776805ca20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f7780006d50 tx=0x7f778001a000).stop 2024-01-22T05:09:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.730+0000 7f7796400700 1 -- 172.21.15.49:0/1496088309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77900a38b0 msgr2=0x7f77900a5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.730+0000 7f7796400700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77900a38b0 0x7f77900a5bc0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f7778001190 tx=0x7f7778009040).stop 2024-01-22T05:09:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.730+0000 7f7796400700 1 -- 172.21.15.49:0/1496088309 shutdown_connections 2024-01-22T05:09:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.730+0000 7f7796400700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f776805a560 0x7f776805ca20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.730+0000 7f7796400700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77901647d0 0x7f7790164c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.730+0000 7f7796400700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77900a38b0 0x7f77900a5bc0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.730+0000 7f7796400700 1 --2- 172.21.15.49:0/1496088309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77700038e0 0x7f77900a56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.730+0000 7f7796400700 1 -- 172.21.15.49:0/1496088309 >> 172.21.15.49:0/1496088309 conn(0x7f7790062cb0 msgr2=0x7f77900c5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.730+0000 7f7796400700 1 -- 172.21.15.49:0/1496088309 shutdown_connections 2024-01-22T05:09:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.730+0000 7f7796400700 1 -- 172.21.15.49:0/1496088309 wait complete. 2024-01-22T05:09:54.760 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T05:09:54.761 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:09:54.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.926+0000 7f6fd5e00700 1 Processor -- start 2024-01-22T05:09:54.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.926+0000 7f6fd5e00700 1 -- start start 2024-01-22T05:09:54.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.926+0000 7f6fd5e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6fd0062f20 0x7f6fd00bdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:54.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.926+0000 7f6fd5e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd0067bc0 con 0x7f6fd01571a0 2024-01-22T05:09:54.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.926+0000 7f6fd5e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd0067ea0 con 0x7f6fd00bd8f0 2024-01-22T05:09:54.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.926+0000 7f6fd5e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd00be270 con 0x7f6fd0062f20 2024-01-22T05:09:54.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.926+0000 7f6fd4a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6fd01571a0 0x7f6fd0068c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45704/0 (socket says 172.21.15.49:45704) 2024-01-22T05:09:54.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.926+0000 7f6fd4a00700 1 -- 172.21.15.49:0/275519685 learned_addr learned my addr 172.21.15.49:0/275519685 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:54.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fd5400700 1 --2- 172.21.15.49:0/275519685 >> v2:172.21.15.110:3300/0 conn(0x7f6fd0062f20 0x7f6fd00bdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:54.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fcf400700 1 -- 172.21.15.49:0/275519685 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103121286 0 0) 0x7f6fd0067bc0 con 0x7f6fd01571a0 2024-01-22T05:09:54.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fcf400700 1 -- 172.21.15.49:0/275519685 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb00033f0 con 0x7f6fd01571a0 2024-01-22T05:09:54.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fcf400700 1 -- 172.21.15.49:0/275519685 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590368216 0 0) 0x7f6fd0067ea0 con 0x7f6fd00bd8f0 2024-01-22T05:09:54.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fcf400700 1 -- 172.21.15.49:0/275519685 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fd0067bc0 con 0x7f6fd00bd8f0 2024-01-22T05:09:54.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fd5400700 1 -- 172.21.15.49:0/275519685 >> v1:172.21.15.110:6789/0 conn(0x7f6fd00bd8f0 legacy=0x7f6fd0062810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:54.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fcf400700 1 -- 172.21.15.49:0/275519685 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1863297442 0 0) 0x7f6fb00033f0 con 0x7f6fd01571a0 2024-01-22T05:09:54.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fd5400700 1 -- 172.21.15.49:0/275519685 >> v1:172.21.15.49:6789/0 conn(0x7f6fd01571a0 legacy=0x7f6fd0068c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:54.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fd5400700 1 -- 172.21.15.49:0/275519685 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd0068180 con 0x7f6fd0062f20 2024-01-22T05:09:54.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fd5400700 1 --2- 172.21.15.49:0/275519685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd0062f20 0x7f6fd00bdd80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f6fc8009e60 tx=0x7f6fc8009780).ready entity=mon.1 client_cookie=8149cede2433b655 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:54.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fcf400700 1 -- 172.21.15.49:0/275519685 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc800e070 con 0x7f6fd0062f20 2024-01-22T05:09:54.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fcf400700 1 -- 172.21.15.49:0/275519685 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc800b7a0 con 0x7f6fd0062f20 2024-01-22T05:09:54.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fcf400700 1 -- 172.21.15.49:0/275519685 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0001470 con 0x7f6fd0062f20 2024-01-22T05:09:54.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fd5e00700 1 -- 172.21.15.49:0/275519685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd0062f20 msgr2=0x7f6fd00bdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:54.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fd5e00700 1 --2- 172.21.15.49:0/275519685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd0062f20 0x7f6fd00bdd80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f6fc8009e60 tx=0x7f6fc8009780).stop 2024-01-22T05:09:54.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fd5e00700 1 -- 172.21.15.49:0/275519685 shutdown_connections 2024-01-22T05:09:54.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fd5e00700 1 --2- 172.21.15.49:0/275519685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd0062f20 0x7f6fd00bdd80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:54.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.930+0000 7f6fd5e00700 1 -- 172.21.15.49:0/275519685 >> 172.21.15.49:0/275519685 conn(0x7f6fd00c8770 msgr2=0x7f6fd00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:54.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.934+0000 7f6fd5e00700 1 -- 172.21.15.49:0/275519685 shutdown_connections 2024-01-22T05:09:54.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.934+0000 7f6fd5e00700 1 -- 172.21.15.49:0/275519685 wait complete. 2024-01-22T05:09:54.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.934+0000 7f6fd5e00700 1 Processor -- start 2024-01-22T05:09:54.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.934+0000 7f6fd5e00700 1 -- start start 2024-01-22T05:09:54.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fd0062f20 0x7f6fd0151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:54.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd5e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd00bd8f0 0x7f6fd0153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:54.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd01571a0 0x7f6fd00c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:54.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd5e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd0167530 con 0x7f6fd0062f20 2024-01-22T05:09:54.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd5e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd0167810 con 0x7f6fd00bd8f0 2024-01-22T05:09:54.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd0167af0 con 0x7f6fd01571a0 2024-01-22T05:09:54.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd4a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fd0062f20 0x7f6fd0151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:54.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd4a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fd0062f20 0x7f6fd0151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54444/0 (socket says 172.21.15.49:54444) 2024-01-22T05:09:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd4a00700 1 -- 172.21.15.49:0/1716796874 learned_addr learned my addr 172.21.15.49:0/1716796874 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd5400700 1 --2- 172.21.15.49:0/1716796874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd01571a0 0x7f6fd00c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fcfe00700 1 --2- 172.21.15.49:0/1716796874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd00bd8f0 0x7f6fd0153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd4a00700 1 -- 172.21.15.49:0/1716796874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd01571a0 msgr2=0x7f6fd00c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd4a00700 1 --2- 172.21.15.49:0/1716796874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd01571a0 0x7f6fd00c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd4a00700 1 -- 172.21.15.49:0/1716796874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd00bd8f0 msgr2=0x7f6fd0153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd4a00700 1 --2- 172.21.15.49:0/1716796874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd00bd8f0 0x7f6fd0153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd4a00700 1 -- 172.21.15.49:0/1716796874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc8009a20 con 0x7f6fd0062f20 2024-01-22T05:09:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd5400700 1 --2- 172.21.15.49:0/1716796874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd01571a0 0x7f6fd00c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:09:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd4a00700 1 --2- 172.21.15.49:0/1716796874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fd0062f20 0x7f6fd0151880 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f6fc000c810 tx=0x7f6fc0001ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:54.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fc7e00700 1 -- 172.21.15.49:0/1716796874 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0007170 con 0x7f6fd0062f20 2024-01-22T05:09:54.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fc7e00700 1 -- 172.21.15.49:0/1716796874 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc00072d0 con 0x7f6fd0062f20 2024-01-22T05:09:54.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fc7e00700 1 -- 172.21.15.49:0/1716796874 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc00048c0 con 0x7f6fd0062f20 2024-01-22T05:09:54.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd5e00700 1 -- 172.21.15.49:0/1716796874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd0167dd0 con 0x7f6fd0062f20 2024-01-22T05:09:54.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.938+0000 7f6fd5e00700 1 -- 172.21.15.49:0/1716796874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd0151d70 con 0x7f6fd0062f20 2024-01-22T05:09:54.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.942+0000 7f6fc7e00700 1 -- 172.21.15.49:0/1716796874 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6fc0004c70 con 0x7f6fd0062f20 2024-01-22T05:09:54.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.942+0000 7f6fd5e00700 1 -- 172.21.15.49:0/1716796874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd01682d0 con 0x7f6fd0062f20 2024-01-22T05:09:54.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.942+0000 7f6fc7e00700 1 --2- 172.21.15.49:0/1716796874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6fa805a510 0x7f6fa805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:54.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.942+0000 7f6fc7e00700 1 -- 172.21.15.49:0/1716796874 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f6fc0074400 con 0x7f6fd0062f20 2024-01-22T05:09:54.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.946+0000 7f6fcfe00700 1 --2- 172.21.15.49:0/1716796874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6fa805a510 0x7f6fa805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:54.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.946+0000 7f6fcfe00700 1 --2- 172.21.15.49:0/1716796874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6fa805a510 0x7f6fa805c9d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f6fd01673f0 tx=0x7f6fb8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:54.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:54.950+0000 7f6fc7e00700 1 -- 172.21.15.49:0/1716796874 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6fc0047960 con 0x7f6fd0062f20 2024-01-22T05:09:55.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.150+0000 7f6fd5e00700 1 -- 172.21.15.49:0/1716796874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6fd0068460 con 0x7f6fd0062f20 2024-01-22T05:09:55.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.734+0000 7f6fc7e00700 1 -- 172.21.15.49:0/1716796874 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6fc004af80 con 0x7f6fd0062f20 2024-01-22T05:09:55.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.738+0000 7f6fd5e00700 1 -- 172.21.15.49:0/1716796874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6fa805a510 msgr2=0x7f6fa805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:55.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.738+0000 7f6fd5e00700 1 --2- 172.21.15.49:0/1716796874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6fa805a510 0x7f6fa805c9d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f6fd01673f0 tx=0x7f6fb8009040).stop 2024-01-22T05:09:55.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.738+0000 7f6fd5e00700 1 -- 172.21.15.49:0/1716796874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fd0062f20 msgr2=0x7f6fd0151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:55.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.738+0000 7f6fd5e00700 1 --2- 172.21.15.49:0/1716796874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fd0062f20 0x7f6fd0151880 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f6fc000c810 tx=0x7f6fc0001ab0).stop 2024-01-22T05:09:55.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.738+0000 7f6fd5e00700 1 -- 172.21.15.49:0/1716796874 shutdown_connections 2024-01-22T05:09:55.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.738+0000 7f6fd5e00700 1 --2- 172.21.15.49:0/1716796874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6fa805a510 0x7f6fa805c9d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:55.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.738+0000 7f6fd5e00700 1 --2- 172.21.15.49:0/1716796874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd01571a0 0x7f6fd00c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:55.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.738+0000 7f6fd5e00700 1 --2- 172.21.15.49:0/1716796874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fd00bd8f0 0x7f6fd0153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:55.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.738+0000 7f6fd5e00700 1 --2- 172.21.15.49:0/1716796874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fd0062f20 0x7f6fd0151880 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:55.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.738+0000 7f6fd5e00700 1 -- 172.21.15.49:0/1716796874 >> 172.21.15.49:0/1716796874 conn(0x7f6fd00c8770 msgr2=0x7f6fd0156110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:55.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.738+0000 7f6fd5e00700 1 -- 172.21.15.49:0/1716796874 shutdown_connections 2024-01-22T05:09:55.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.738+0000 7f6fd5e00700 1 -- 172.21.15.49:0/1716796874 wait complete. 2024-01-22T05:09:55.767 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:09:55.767 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:09:55.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.926+0000 7f44b5000700 1 Processor -- start 2024-01-22T05:09:55.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.926+0000 7f44b5000700 1 -- start start 2024-01-22T05:09:55.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44b5000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f44b00644f0 0x7f44b0064950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:55.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44b5000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b00bcc80 0x7f44b00bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:55.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44b5000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b00c2700 con 0x7f44b0065660 2024-01-22T05:09:55.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44b5000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b00a7650 con 0x7f44b00644f0 2024-01-22T05:09:55.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44b5000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b0064e40 con 0x7f44b00bcc80 2024-01-22T05:09:55.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44ad400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f44b00644f0 0x7f44b0064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:55.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44ad400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f44b00644f0 0x7f44b0064950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54454/0 (socket says 172.21.15.49:54454) 2024-01-22T05:09:55.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44ad400700 1 -- 172.21.15.49:0/4072963680 learned_addr learned my addr 172.21.15.49:0/4072963680 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:55.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44af200700 1 --2- 172.21.15.49:0/4072963680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b00bcc80 0x7f44b00bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:55.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44ad400700 1 -- 172.21.15.49:0/4072963680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b00bcc80 msgr2=0x7f44b00bd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:55.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44ad400700 1 --2- 172.21.15.49:0/4072963680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b00bcc80 0x7f44b00bd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:55.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44ad400700 1 -- 172.21.15.49:0/4072963680 >> v1:172.21.15.110:6789/0 conn(0x7f44b0065660 legacy=0x7f44b00a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:55.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44ad400700 1 -- 172.21.15.49:0/4072963680 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b00c2930 con 0x7f44b00644f0 2024-01-22T05:09:55.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44ad400700 1 --2- 172.21.15.49:0/4072963680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b00644f0 0x7f44b0064950 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f4498006fd0 tx=0x7f44980090f0).ready entity=mon.0 client_cookie=2ef69d0345a2e0fc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:55.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44aca00700 1 -- 172.21.15.49:0/4072963680 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449800b600 con 0x7f44b00644f0 2024-01-22T05:09:55.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44aca00700 1 -- 172.21.15.49:0/4072963680 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449800b760 con 0x7f44b00644f0 2024-01-22T05:09:55.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.930+0000 7f44aca00700 1 -- 172.21.15.49:0/4072963680 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449800bae0 con 0x7f44b00644f0 2024-01-22T05:09:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.934+0000 7f44b5000700 1 -- 172.21.15.49:0/4072963680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b00644f0 msgr2=0x7f44b0064950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.934+0000 7f44b5000700 1 --2- 172.21.15.49:0/4072963680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b00644f0 0x7f44b0064950 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f4498006fd0 tx=0x7f44980090f0).stop 2024-01-22T05:09:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.934+0000 7f44b5000700 1 -- 172.21.15.49:0/4072963680 shutdown_connections 2024-01-22T05:09:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.934+0000 7f44b5000700 1 --2- 172.21.15.49:0/4072963680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b00bcc80 0x7f44b00bd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.934+0000 7f44b5000700 1 --2- 172.21.15.49:0/4072963680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b00644f0 0x7f44b0064950 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.934+0000 7f44b5000700 1 -- 172.21.15.49:0/4072963680 >> 172.21.15.49:0/4072963680 conn(0x7f44b00c87f0 msgr2=0x7f44b00c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.934+0000 7f44b5000700 1 -- 172.21.15.49:0/4072963680 shutdown_connections 2024-01-22T05:09:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.934+0000 7f44b5000700 1 -- 172.21.15.49:0/4072963680 wait complete. 2024-01-22T05:09:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.938+0000 7f44b5000700 1 Processor -- start 2024-01-22T05:09:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.938+0000 7f44b5000700 1 -- start start 2024-01-22T05:09:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.938+0000 7f44b5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b00644f0 0x7f44b00a7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.938+0000 7f44b5000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b0065660 0x7f44b00a8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.938+0000 7f44b5000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44b00bcc80 0x7f44b0152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.938+0000 7f44b5000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00a9060 con 0x7f44b00644f0 2024-01-22T05:09:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.938+0000 7f44b5000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00c0070 con 0x7f44b00bcc80 2024-01-22T05:09:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.938+0000 7f44b5000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00aacd0 con 0x7f44b0065660 2024-01-22T05:09:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44ade00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b00644f0 0x7f44b00a7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44ad400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b0065660 0x7f44b00a8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44ade00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b00644f0 0x7f44b00a7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54468/0 (socket says 172.21.15.49:54468) 2024-01-22T05:09:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44ade00700 1 -- 172.21.15.49:0/3110098019 learned_addr learned my addr 172.21.15.49:0/3110098019 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44af200700 1 --2- 172.21.15.49:0/3110098019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44b00bcc80 0x7f44b0152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44ad400700 1 -- 172.21.15.49:0/3110098019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44b00bcc80 msgr2=0x7f44b0152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44ad400700 1 --2- 172.21.15.49:0/3110098019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44b00bcc80 0x7f44b0152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44ad400700 1 -- 172.21.15.49:0/3110098019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b00644f0 msgr2=0x7f44b00a7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44ad400700 1 --2- 172.21.15.49:0/3110098019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b00644f0 0x7f44b00a7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44ad400700 1 -- 172.21.15.49:0/3110098019 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4498009370 con 0x7f44b0065660 2024-01-22T05:09:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44ade00700 1 --2- 172.21.15.49:0/3110098019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b00644f0 0x7f44b00a7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44ad400700 1 --2- 172.21.15.49:0/3110098019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b0065660 0x7f44b00a8330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f4498014000 tx=0x7f4498017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44a5600700 1 -- 172.21.15.49:0/3110098019 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449800bea0 con 0x7f44b0065660 2024-01-22T05:09:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44a5600700 1 -- 172.21.15.49:0/3110098019 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449800b8d0 con 0x7f44b0065660 2024-01-22T05:09:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44b5000700 1 -- 172.21.15.49:0/3110098019 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b00a8820 con 0x7f44b0065660 2024-01-22T05:09:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44a5600700 1 -- 172.21.15.49:0/3110098019 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449801c670 con 0x7f44b0065660 2024-01-22T05:09:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.942+0000 7f44b5000700 1 -- 172.21.15.49:0/3110098019 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b00a8d80 con 0x7f44b0065660 2024-01-22T05:09:55.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.946+0000 7f44b5000700 1 -- 172.21.15.49:0/3110098019 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b0047060 con 0x7f44b0065660 2024-01-22T05:09:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.946+0000 7f44a5600700 1 -- 172.21.15.49:0/3110098019 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f449801ca20 con 0x7f44b0065660 2024-01-22T05:09:55.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.946+0000 7f44a5600700 1 --2- 172.21.15.49:0/3110098019 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f448805a510 0x7f448805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:55.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.946+0000 7f44a5600700 1 -- 172.21.15.49:0/3110098019 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4498076630 con 0x7f44b0065660 2024-01-22T05:09:55.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.950+0000 7f44ade00700 1 --2- 172.21.15.49:0/3110098019 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f448805a510 0x7f448805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:55.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.950+0000 7f44ade00700 1 --2- 172.21.15.49:0/3110098019 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f448805a510 0x7f448805c9d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f44b00a6340 tx=0x7f44a0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:55.958+0000 7f44a5600700 1 -- 172.21.15.49:0/3110098019 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4498049bf0 con 0x7f44b0065660 2024-01-22T05:09:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.162+0000 7f44b5000700 1 -- 172.21.15.49:0/3110098019 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44b00c2c10 con 0x7f44b0065660 2024-01-22T05:09:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.162+0000 7f44a5600700 1 -- 172.21.15.49:0/3110098019 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f4498020020 con 0x7f44b0065660 2024-01-22T05:09:56.168 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:56.168 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":70,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6080,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/948258971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":948258971},{"type":"v1","addr":"172.21.15.110:6835","nonce":948258971}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6828,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/304005498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":304005498},{"type":"v1","addr":"172.21.15.49:6835","nonce":304005498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6843,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1613189666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1613189666},{"type":"v1","addr":"172.21.15.49:6837","nonce":1613189666}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:09:52.708060+0000","modified":"2024-01-22T05:09:55.726778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6846},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6846":{"gid":6846,"name":"b","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6834/1072346524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1072346524},{"type":"v1","addr":"172.21.15.110:6834","nonce":1072346524}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2024-01-22T05:09:56.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.170+0000 7f44b5000700 1 -- 172.21.15.49:0/3110098019 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f448805a510 msgr2=0x7f448805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:56.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.170+0000 7f44b5000700 1 --2- 172.21.15.49:0/3110098019 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f448805a510 0x7f448805c9d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f44b00a6340 tx=0x7f44a0009040).stop 2024-01-22T05:09:56.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.170+0000 7f44b5000700 1 -- 172.21.15.49:0/3110098019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b0065660 msgr2=0x7f44b00a8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:56.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.170+0000 7f44b5000700 1 --2- 172.21.15.49:0/3110098019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b0065660 0x7f44b00a8330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f4498014000 tx=0x7f4498017000).stop 2024-01-22T05:09:56.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.170+0000 7f44b5000700 1 -- 172.21.15.49:0/3110098019 shutdown_connections 2024-01-22T05:09:56.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.170+0000 7f44b5000700 1 --2- 172.21.15.49:0/3110098019 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f448805a510 0x7f448805c9d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.170+0000 7f44b5000700 1 --2- 172.21.15.49:0/3110098019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44b00bcc80 0x7f44b0152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.170+0000 7f44b5000700 1 --2- 172.21.15.49:0/3110098019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b0065660 0x7f44b00a8330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.170+0000 7f44b5000700 1 --2- 172.21.15.49:0/3110098019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b00644f0 0x7f44b00a7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.170+0000 7f44b5000700 1 -- 172.21.15.49:0/3110098019 >> 172.21.15.49:0/3110098019 conn(0x7f44b00c87f0 msgr2=0x7f44b0159eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:56.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.170+0000 7f44b5000700 1 -- 172.21.15.49:0/3110098019 shutdown_connections 2024-01-22T05:09:56.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.170+0000 7f44b5000700 1 -- 172.21.15.49:0/3110098019 wait complete. 2024-01-22T05:09:56.177 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 70 2024-01-22T05:09:56.196 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:09:56.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.358+0000 7f485a400700 1 Processor -- start 2024-01-22T05:09:56.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.358+0000 7f485a400700 1 -- start start 2024-01-22T05:09:56.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f485a400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4854151c30 0x7f4854155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:56.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f485a400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48540bdfd0 con 0x7f4854151850 2024-01-22T05:09:56.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f485a400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4854063240 con 0x7f4854156270 2024-01-22T05:09:56.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f485a400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4854063490 con 0x7f4854151c30 2024-01-22T05:09:56.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f4853400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4854151850 0x7f4854155670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45720/0 (socket says 172.21.15.49:45720) 2024-01-22T05:09:56.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f4853400700 1 -- 172.21.15.49:0/3087183508 learned_addr learned my addr 172.21.15.49:0/3087183508 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:56.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f4852a00700 1 --2- 172.21.15.49:0/3087183508 >> v2:172.21.15.110:3300/0 conn(0x7f4854151c30 0x7f4854155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f4852000700 1 -- 172.21.15.49:0/3087183508 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976808990 0 0) 0x7f48540bdfd0 con 0x7f4854151850 2024-01-22T05:09:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f4852000700 1 -- 172.21.15.49:0/3087183508 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48340033f0 con 0x7f4854151850 2024-01-22T05:09:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f4852000700 1 -- 172.21.15.49:0/3087183508 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374468737 0 0) 0x7f4854063240 con 0x7f4854156270 2024-01-22T05:09:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f4852000700 1 -- 172.21.15.49:0/3087183508 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48540bdfd0 con 0x7f4854156270 2024-01-22T05:09:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f4852a00700 1 -- 172.21.15.49:0/3087183508 >> v1:172.21.15.110:6789/0 conn(0x7f4854156270 legacy=0x7f48540be460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f4852a00700 1 -- 172.21.15.49:0/3087183508 >> v1:172.21.15.49:6789/0 conn(0x7f4854151850 legacy=0x7f4854155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f4852a00700 1 -- 172.21.15.49:0/3087183508 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854063770 con 0x7f4854151c30 2024-01-22T05:09:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f4852a00700 1 --2- 172.21.15.49:0/3087183508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4854151c30 0x7f4854155d80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f483c009760 tx=0x7f483c009060).ready entity=mon.1 client_cookie=e2e9d3e5bf096bbb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f4852000700 1 -- 172.21.15.49:0/3087183508 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c00d4a0 con 0x7f4854151c30 2024-01-22T05:09:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f4852000700 1 -- 172.21.15.49:0/3087183508 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c00d600 con 0x7f4854151c30 2024-01-22T05:09:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.362+0000 7f4852000700 1 -- 172.21.15.49:0/3087183508 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c00d980 con 0x7f4854151c30 2024-01-22T05:09:56.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.366+0000 7f485a400700 1 -- 172.21.15.49:0/3087183508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4854151c30 msgr2=0x7f4854155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:56.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.366+0000 7f485a400700 1 --2- 172.21.15.49:0/3087183508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4854151c30 0x7f4854155d80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f483c009760 tx=0x7f483c009060).stop 2024-01-22T05:09:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.366+0000 7f485a400700 1 -- 172.21.15.49:0/3087183508 shutdown_connections 2024-01-22T05:09:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.366+0000 7f485a400700 1 --2- 172.21.15.49:0/3087183508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4854151c30 0x7f4854155d80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.366+0000 7f485a400700 1 -- 172.21.15.49:0/3087183508 >> 172.21.15.49:0/3087183508 conn(0x7f48540c5860 msgr2=0x7f48540c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.366+0000 7f485a400700 1 -- 172.21.15.49:0/3087183508 shutdown_connections 2024-01-22T05:09:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.366+0000 7f485a400700 1 -- 172.21.15.49:0/3087183508 wait complete. 2024-01-22T05:09:56.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.370+0000 7f485a400700 1 Processor -- start 2024-01-22T05:09:56.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.370+0000 7f485a400700 1 -- start start 2024-01-22T05:09:56.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.370+0000 7f485a400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4854151850 0x7f4854155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:56.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.370+0000 7f485a400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4854151c30 0x7f48540c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:56.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.370+0000 7f485a400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4854156270 0x7f485416c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:56.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.370+0000 7f485a400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48540c7ec0 con 0x7f4854151c30 2024-01-22T05:09:56.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.370+0000 7f485a400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48540c81a0 con 0x7f4854156270 2024-01-22T05:09:56.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.370+0000 7f485a400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48540c8480 con 0x7f4854151850 2024-01-22T05:09:56.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.370+0000 7f4852a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4854151c30 0x7f48540c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:56.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f4852a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4854151c30 0x7f48540c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54474/0 (socket says 172.21.15.49:54474) 2024-01-22T05:09:56.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f4852a00700 1 -- 172.21.15.49:0/1940150780 learned_addr learned my addr 172.21.15.49:0/1940150780 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:56.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f4858e00700 1 --2- 172.21.15.49:0/1940150780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4854156270 0x7f485416c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:56.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f4853400700 1 --2- 172.21.15.49:0/1940150780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4854151850 0x7f4854155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:56.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f4852a00700 1 -- 172.21.15.49:0/1940150780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4854151850 msgr2=0x7f4854155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:56.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f4852a00700 1 --2- 172.21.15.49:0/1940150780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4854151850 0x7f4854155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f4852a00700 1 -- 172.21.15.49:0/1940150780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4854156270 msgr2=0x7f485416c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:56.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f4852a00700 1 --2- 172.21.15.49:0/1940150780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4854156270 0x7f485416c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f4852a00700 1 -- 172.21.15.49:0/1940150780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c0092a0 con 0x7f4854151c30 2024-01-22T05:09:56.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f4858e00700 1 --2- 172.21.15.49:0/1940150780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4854156270 0x7f485416c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:56.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f4852a00700 1 --2- 172.21.15.49:0/1940150780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4854151c30 0x7f48540c75a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f4854067390 tx=0x7f483c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:56.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f484aa00700 1 -- 172.21.15.49:0/1940150780 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c00dcf0 con 0x7f4854151c30 2024-01-22T05:09:56.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f484aa00700 1 -- 172.21.15.49:0/1940150780 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c00de50 con 0x7f4854151c30 2024-01-22T05:09:56.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f484aa00700 1 -- 172.21.15.49:0/1940150780 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c00d980 con 0x7f4854151c30 2024-01-22T05:09:56.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f485a400700 1 -- 172.21.15.49:0/1940150780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48540bff00 con 0x7f4854151c30 2024-01-22T05:09:56.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.374+0000 7f485a400700 1 -- 172.21.15.49:0/1940150780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4854155e60 con 0x7f4854151c30 2024-01-22T05:09:56.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.378+0000 7f485a400700 1 -- 172.21.15.49:0/1940150780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48540c0400 con 0x7f4854151c30 2024-01-22T05:09:56.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.378+0000 7f484aa00700 1 -- 172.21.15.49:0/1940150780 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f483c01d640 con 0x7f4854151c30 2024-01-22T05:09:56.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.378+0000 7f484aa00700 1 --2- 172.21.15.49:0/1940150780 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f482c05a510 0x7f482c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:56.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.378+0000 7f484aa00700 1 -- 172.21.15.49:0/1940150780 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f483c075680 con 0x7f4854151c30 2024-01-22T05:09:56.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.378+0000 7f4853400700 1 --2- 172.21.15.49:0/1940150780 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f482c05a510 0x7f482c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:56.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.378+0000 7f4853400700 1 --2- 172.21.15.49:0/1940150780 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f482c05a510 0x7f482c05c9d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f4844005750 tx=0x7f4844009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:56.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.386+0000 7f484aa00700 1 -- 172.21.15.49:0/1940150780 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f483c048d90 con 0x7f4854151c30 2024-01-22T05:09:56.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.550+0000 7f485a400700 1 -- 172.21.15.49:0/1940150780 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4854069d80 con 0x7f4854151c30 2024-01-22T05:09:56.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.554+0000 7f484aa00700 1 -- 172.21.15.49:0/1940150780 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+17167 (secure 0 0 0) 0x7f483c022070 con 0x7f4854151c30 2024-01-22T05:09:56.557 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:56.557 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":88,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:09:53.713230+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:09:50.901052+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-22T05:09:51.722128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:09:56.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.554+0000 7f485a400700 1 -- 172.21.15.49:0/1940150780 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f482c05a510 msgr2=0x7f482c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:56.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.554+0000 7f485a400700 1 --2- 172.21.15.49:0/1940150780 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f482c05a510 0x7f482c05c9d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f4844005750 tx=0x7f4844009040).stop 2024-01-22T05:09:56.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.554+0000 7f485a400700 1 -- 172.21.15.49:0/1940150780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4854151c30 msgr2=0x7f48540c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:56.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.554+0000 7f485a400700 1 --2- 172.21.15.49:0/1940150780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4854151c30 0x7f48540c75a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f4854067390 tx=0x7f483c016000).stop 2024-01-22T05:09:56.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.554+0000 7f485a400700 1 -- 172.21.15.49:0/1940150780 shutdown_connections 2024-01-22T05:09:56.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.554+0000 7f485a400700 1 --2- 172.21.15.49:0/1940150780 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f482c05a510 0x7f482c05c9d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.554+0000 7f485a400700 1 --2- 172.21.15.49:0/1940150780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4854156270 0x7f485416c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.554+0000 7f485a400700 1 --2- 172.21.15.49:0/1940150780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4854151c30 0x7f48540c75a0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.554+0000 7f485a400700 1 --2- 172.21.15.49:0/1940150780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4854151850 0x7f4854155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.554+0000 7f485a400700 1 -- 172.21.15.49:0/1940150780 >> 172.21.15.49:0/1940150780 conn(0x7f48540c5860 msgr2=0x7f48541500d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:56.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.558+0000 7f485a400700 1 -- 172.21.15.49:0/1940150780 shutdown_connections 2024-01-22T05:09:56.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.558+0000 7f485a400700 1 -- 172.21.15.49:0/1940150780 wait complete. 2024-01-22T05:09:56.583 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:09:56.583 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:09:56.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.738+0000 7f2e11a00700 1 Processor -- start 2024-01-22T05:09:56.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.738+0000 7f2e11a00700 1 -- start start 2024-01-22T05:09:56.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.742+0000 7f2e11a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2e0c063940 0x7f2e0c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:56.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.742+0000 7f2e11a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2e0c0be0e0 0x7f2e0c0be540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:56.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.742+0000 7f2e11a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0c062230 con 0x7f2e0c153650 2024-01-22T05:09:56.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.742+0000 7f2e11a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0c068090 con 0x7f2e0c0be0e0 2024-01-22T05:09:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.742+0000 7f2e11a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0c062480 con 0x7f2e0c063940 2024-01-22T05:09:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.742+0000 7f2e0a000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2e0c0be0e0 0x7f2e0c0be540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.742+0000 7f2e0a000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2e0c0be0e0 0x7f2e0c0be540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54476/0 (socket says 172.21.15.49:54476) 2024-01-22T05:09:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.742+0000 7f2e0a000700 1 -- 172.21.15.49:0/2906860389 learned_addr learned my addr 172.21.15.49:0/2906860389 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.742+0000 7f2e0aa00700 1 --2- 172.21.15.49:0/2906860389 >> v2:172.21.15.110:3300/0 conn(0x7f2e0c063940 0x7f2e0c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:56.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.742+0000 7f2e0a000700 1 -- 172.21.15.49:0/2906860389 >> v2:172.21.15.110:3300/0 conn(0x7f2e0c063940 msgr2=0x7f2e0c068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:56.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.742+0000 7f2e0a000700 1 --2- 172.21.15.49:0/2906860389 >> v2:172.21.15.110:3300/0 conn(0x7f2e0c063940 0x7f2e0c068d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.742+0000 7f2e0a000700 1 -- 172.21.15.49:0/2906860389 >> v1:172.21.15.110:6789/0 conn(0x7f2e0c153650 legacy=0x7f2e0c153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:56.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.742+0000 7f2e0a000700 1 -- 172.21.15.49:0/2906860389 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c062760 con 0x7f2e0c0be0e0 2024-01-22T05:09:56.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.746+0000 7f2e0a000700 1 --2- 172.21.15.49:0/2906860389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0c0be0e0 0x7f2e0c0be540 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f2e0c05ff70 tx=0x7f2df40090f0).ready entity=mon.0 client_cookie=e8b556618fa29d85 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:56.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.746+0000 7f2e09600700 1 -- 172.21.15.49:0/2906860389 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df400b520 con 0x7f2e0c0be0e0 2024-01-22T05:09:56.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.746+0000 7f2e09600700 1 -- 172.21.15.49:0/2906860389 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df400b680 con 0x7f2e0c0be0e0 2024-01-22T05:09:56.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.746+0000 7f2e09600700 1 -- 172.21.15.49:0/2906860389 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df400ba00 con 0x7f2e0c0be0e0 2024-01-22T05:09:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.746+0000 7f2e11a00700 1 -- 172.21.15.49:0/2906860389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0c0be0e0 msgr2=0x7f2e0c0be540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.746+0000 7f2e11a00700 1 --2- 172.21.15.49:0/2906860389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0c0be0e0 0x7f2e0c0be540 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f2e0c05ff70 tx=0x7f2df40090f0).stop 2024-01-22T05:09:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.746+0000 7f2e11a00700 1 -- 172.21.15.49:0/2906860389 shutdown_connections 2024-01-22T05:09:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.746+0000 7f2e11a00700 1 --2- 172.21.15.49:0/2906860389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0c0be0e0 0x7f2e0c0be540 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.746+0000 7f2e11a00700 1 --2- 172.21.15.49:0/2906860389 >> v2:172.21.15.110:3300/0 conn(0x7f2e0c063940 0x7f2e0c068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.746+0000 7f2e11a00700 1 -- 172.21.15.49:0/2906860389 >> 172.21.15.49:0/2906860389 conn(0x7f2e0c064080 msgr2=0x7f2e0c064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.746+0000 7f2e11a00700 1 -- 172.21.15.49:0/2906860389 shutdown_connections 2024-01-22T05:09:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.746+0000 7f2e11a00700 1 -- 172.21.15.49:0/2906860389 wait complete. 2024-01-22T05:09:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.750+0000 7f2e11a00700 1 Processor -- start 2024-01-22T05:09:56.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.750+0000 7f2e11a00700 1 -- start start 2024-01-22T05:09:56.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.750+0000 7f2e11a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e0c0be0e0 0x7f2e0c13a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:56.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.750+0000 7f2e11a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e0c153650 0x7f2e0c13b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:56.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.750+0000 7f2e11a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0c13b830 0x7f2e0c0aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:56.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.750+0000 7f2e11a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c14ec20 con 0x7f2e0c13b830 2024-01-22T05:09:56.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.750+0000 7f2e11a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0a9c10 con 0x7f2e0c0be0e0 2024-01-22T05:09:56.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.750+0000 7f2e11a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0a9e90 con 0x7f2e0c153650 2024-01-22T05:09:56.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e0be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0c13b830 0x7f2e0c0aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:56.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e0be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0c13b830 0x7f2e0c0aaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54490/0 (socket says 172.21.15.49:54490) 2024-01-22T05:09:56.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e0be00700 1 -- 172.21.15.49:0/3209770964 learned_addr learned my addr 172.21.15.49:0/3209770964 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:56.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e0aa00700 1 --2- 172.21.15.49:0/3209770964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e0c0be0e0 0x7f2e0c13a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:56.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e0a000700 1 --2- 172.21.15.49:0/3209770964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e0c153650 0x7f2e0c13b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:56.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e0be00700 1 -- 172.21.15.49:0/3209770964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e0c153650 msgr2=0x7f2e0c13b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:56.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e0be00700 1 --2- 172.21.15.49:0/3209770964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e0c153650 0x7f2e0c13b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e0be00700 1 -- 172.21.15.49:0/3209770964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e0c0be0e0 msgr2=0x7f2e0c13a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:56.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e0be00700 1 --2- 172.21.15.49:0/3209770964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e0c0be0e0 0x7f2e0c13a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e0be00700 1 -- 172.21.15.49:0/3209770964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df4009370 con 0x7f2e0c13b830 2024-01-22T05:09:56.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e0be00700 1 --2- 172.21.15.49:0/3209770964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0c13b830 0x7f2e0c0aaef0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f2e0400c7c0 tx=0x7f2e04001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:56.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e02000700 1 -- 172.21.15.49:0/3209770964 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0400e4a0 con 0x7f2e0c13b830 2024-01-22T05:09:56.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e02000700 1 -- 172.21.15.49:0/3209770964 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0400e600 con 0x7f2e0c13b830 2024-01-22T05:09:56.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e11a00700 1 -- 172.21.15.49:0/3209770964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0c0aa130 con 0x7f2e0c13b830 2024-01-22T05:09:56.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e02000700 1 -- 172.21.15.49:0/3209770964 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0400e980 con 0x7f2e0c13b830 2024-01-22T05:09:56.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e11a00700 1 -- 172.21.15.49:0/3209770964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0c0aa6f0 con 0x7f2e0c13b830 2024-01-22T05:09:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e11a00700 1 -- 172.21.15.49:0/3209770964 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0c047060 con 0x7f2e0c13b830 2024-01-22T05:09:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.754+0000 7f2e02000700 1 -- 172.21.15.49:0/3209770964 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2e040123f0 con 0x7f2e0c13b830 2024-01-22T05:09:56.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.758+0000 7f2e02000700 1 --2- 172.21.15.49:0/3209770964 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2de405a510 0x7f2de405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:56.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.758+0000 7f2e02000700 1 -- 172.21.15.49:0/3209770964 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2e04074130 con 0x7f2e0c13b830 2024-01-22T05:09:56.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.758+0000 7f2e0aa00700 1 --2- 172.21.15.49:0/3209770964 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2de405a510 0x7f2de405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:56.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.758+0000 7f2e0aa00700 1 --2- 172.21.15.49:0/3209770964 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2de405a510 0x7f2de405c9d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f2dfc009c30 tx=0x7f2dfc009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:56.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.766+0000 7f2e02000700 1 -- 172.21.15.49:0/3209770964 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2e04047750 con 0x7f2e0c13b830 2024-01-22T05:09:56.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.930+0000 7f2e11a00700 1 -- 172.21.15.49:0/3209770964 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e0c062a40 con 0x7f2de405a510 2024-01-22T05:09:56.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.942+0000 7f2e02000700 1 -- 172.21.15.49:0/3209770964 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355771 (secure 0 0 0) 0x7f2e0c062a40 con 0x7f2de405a510 2024-01-22T05:09:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:56.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.950+0000 7f2e11a00700 1 -- 172.21.15.49:0/3209770964 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2de405a510 msgr2=0x7f2de405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.950+0000 7f2e11a00700 1 --2- 172.21.15.49:0/3209770964 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2de405a510 0x7f2de405c9d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f2dfc009c30 tx=0x7f2dfc009060).stop 2024-01-22T05:09:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.950+0000 7f2e11a00700 1 -- 172.21.15.49:0/3209770964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0c13b830 msgr2=0x7f2e0c0aaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.950+0000 7f2e11a00700 1 --2- 172.21.15.49:0/3209770964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0c13b830 0x7f2e0c0aaef0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f2e0400c7c0 tx=0x7f2e04001510).stop 2024-01-22T05:09:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.950+0000 7f2e11a00700 1 -- 172.21.15.49:0/3209770964 shutdown_connections 2024-01-22T05:09:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.950+0000 7f2e11a00700 1 --2- 172.21.15.49:0/3209770964 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2de405a510 0x7f2de405c9d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.950+0000 7f2e11a00700 1 --2- 172.21.15.49:0/3209770964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e0c13b830 0x7f2e0c0aaef0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.950+0000 7f2e11a00700 1 --2- 172.21.15.49:0/3209770964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e0c153650 0x7f2e0c13b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.950+0000 7f2e11a00700 1 --2- 172.21.15.49:0/3209770964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e0c0be0e0 0x7f2e0c13a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.950+0000 7f2e11a00700 1 -- 172.21.15.49:0/3209770964 >> 172.21.15.49:0/3209770964 conn(0x7f2e0c064080 msgr2=0x7f2e0c0c4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.950+0000 7f2e11a00700 1 -- 172.21.15.49:0/3209770964 shutdown_connections 2024-01-22T05:09:56.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:56.950+0000 7f2e11a00700 1 -- 172.21.15.49:0/3209770964 wait complete. 2024-01-22T05:09:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:09:56.976 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-01-22T05:09:55.341947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470936,"kb_used_data":8152,"kb_used_omap":0,"kb_used_meta":2462720,"kb_avail":752503784,"statfs":{"total":773094113280,"available":770563874816,"internally_reserved":0,"allocated":8347648,"data_stored":4060800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2521825280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-15864,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-51,"num_read_kb":-50,"num_write":-77,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":-10,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.849627"},"pg_stats":[{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277016+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297569+0000","last_change":"2024-01-22T05:09:52.297569+0000","last_active":"2024-01-22T05:09:52.297569+0000","last_peered":"2024-01-22T05:09:52.297569+0000","last_clean":"2024-01-22T05:09:52.297569+0000","last_became_active":"2024-01-22T05:09:52.297023+0000","last_became_peered":"2024-01-22T05:09:52.297023+0000","last_unstale":"2024-01-22T05:09:52.297569+0000","last_undegraded":"2024-01-22T05:09:52.297569+0000","last_fullsized":"2024-01-22T05:09:52.297569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271591+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305592+0000","last_change":"2024-01-22T05:09:52.305592+0000","last_active":"2024-01-22T05:09:52.305592+0000","last_peered":"2024-01-22T05:09:52.305592+0000","last_clean":"2024-01-22T05:09:52.305592+0000","last_became_active":"2024-01-22T05:09:52.305284+0000","last_became_peered":"2024-01-22T05:09:52.305284+0000","last_unstale":"2024-01-22T05:09:52.305592+0000","last_undegraded":"2024-01-22T05:09:52.305592+0000","last_fullsized":"2024-01-22T05:09:52.305592+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279637+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303731+0000","last_change":"2024-01-22T05:09:52.303731+0000","last_active":"2024-01-22T05:09:52.303731+0000","last_peered":"2024-01-22T05:09:52.303731+0000","last_clean":"2024-01-22T05:09:52.303731+0000","last_became_active":"2024-01-22T05:09:52.303433+0000","last_became_peered":"2024-01-22T05:09:52.303433+0000","last_unstale":"2024-01-22T05:09:52.303731+0000","last_undegraded":"2024-01-22T05:09:52.303731+0000","last_fullsized":"2024-01-22T05:09:52.303731+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274093+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297327+0000","last_change":"2024-01-22T05:09:52.297327+0000","last_active":"2024-01-22T05:09:52.297327+0000","last_peered":"2024-01-22T05:09:52.297327+0000","last_clean":"2024-01-22T05:09:52.297327+0000","last_became_active":"2024-01-22T05:09:52.295607+0000","last_became_peered":"2024-01-22T05:09:52.295607+0000","last_unstale":"2024-01-22T05:09:52.297327+0000","last_undegraded":"2024-01-22T05:09:52.297327+0000","last_fullsized":"2024-01-22T05:09:52.297327+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.270677+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.291300+0000","last_change":"2024-01-22T05:09:52.291300+0000","last_active":"2024-01-22T05:09:52.291300+0000","last_peered":"2024-01-22T05:09:52.291300+0000","last_clean":"2024-01-22T05:09:52.291300+0000","last_became_active":"2024-01-22T05:09:52.291020+0000","last_became_peered":"2024-01-22T05:09:52.291020+0000","last_unstale":"2024-01-22T05:09:52.291300+0000","last_undegraded":"2024-01-22T05:09:52.291300+0000","last_fullsized":"2024-01-22T05:09:52.291300+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.281395+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.306892+0000","last_change":"2024-01-22T05:09:52.306892+0000","last_active":"2024-01-22T05:09:52.306892+0000","last_peered":"2024-01-22T05:09:52.306892+0000","last_clean":"2024-01-22T05:09:52.306892+0000","last_became_active":"2024-01-22T05:09:52.305890+0000","last_became_peered":"2024-01-22T05:09:52.305890+0000","last_unstale":"2024-01-22T05:09:52.306892+0000","last_undegraded":"2024-01-22T05:09:52.306892+0000","last_fullsized":"2024-01-22T05:09:52.306892+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.268616+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.286515+0000","last_change":"2024-01-22T05:09:52.286515+0000","last_active":"2024-01-22T05:09:52.286515+0000","last_peered":"2024-01-22T05:09:52.286515+0000","last_clean":"2024-01-22T05:09:52.286515+0000","last_became_active":"2024-01-22T05:09:52.286243+0000","last_became_peered":"2024-01-22T05:09:52.286243+0000","last_unstale":"2024-01-22T05:09:52.286515+0000","last_undegraded":"2024-01-22T05:09:52.286515+0000","last_fullsized":"2024-01-22T05:09:52.286515+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.282349+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.286766+0000","last_change":"2024-01-22T05:09:52.286766+0000","last_active":"2024-01-22T05:09:52.286766+0000","last_peered":"2024-01-22T05:09:52.286766+0000","last_clean":"2024-01-22T05:09:52.286766+0000","last_became_active":"2024-01-22T05:09:52.286407+0000","last_became_peered":"2024-01-22T05:09:52.286407+0000","last_unstale":"2024-01-22T05:09:52.286766+0000","last_undegraded":"2024-01-22T05:09:52.286766+0000","last_fullsized":"2024-01-22T05:09:52.286766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269001+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.304066+0000","last_change":"2024-01-22T05:09:52.304066+0000","last_active":"2024-01-22T05:09:52.304066+0000","last_peered":"2024-01-22T05:09:52.304066+0000","last_clean":"2024-01-22T05:09:52.304066+0000","last_became_active":"2024-01-22T05:09:52.303591+0000","last_became_peered":"2024-01-22T05:09:52.303591+0000","last_unstale":"2024-01-22T05:09:52.304066+0000","last_undegraded":"2024-01-22T05:09:52.304066+0000","last_fullsized":"2024-01-22T05:09:52.304066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271327+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.286587+0000","last_change":"2024-01-22T05:09:52.286587+0000","last_active":"2024-01-22T05:09:52.286587+0000","last_peered":"2024-01-22T05:09:52.286587+0000","last_clean":"2024-01-22T05:09:52.286587+0000","last_became_active":"2024-01-22T05:09:52.286312+0000","last_became_peered":"2024-01-22T05:09:52.286312+0000","last_unstale":"2024-01-22T05:09:52.286587+0000","last_undegraded":"2024-01-22T05:09:52.286587+0000","last_fullsized":"2024-01-22T05:09:52.286587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266270+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.308814+0000","last_change":"2024-01-22T05:09:52.308814+0000","last_active":"2024-01-22T05:09:52.308814+0000","last_peered":"2024-01-22T05:09:52.308814+0000","last_clean":"2024-01-22T05:09:52.308814+0000","last_became_active":"2024-01-22T05:09:52.307354+0000","last_became_peered":"2024-01-22T05:09:52.307354+0000","last_unstale":"2024-01-22T05:09:52.308814+0000","last_undegraded":"2024-01-22T05:09:52.308814+0000","last_fullsized":"2024-01-22T05:09:52.308814+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274514+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.312051+0000","last_change":"2024-01-22T05:09:52.312051+0000","last_active":"2024-01-22T05:09:52.312051+0000","last_peered":"2024-01-22T05:09:52.312051+0000","last_clean":"2024-01-22T05:09:52.312051+0000","last_became_active":"2024-01-22T05:09:52.311745+0000","last_became_peered":"2024-01-22T05:09:52.311745+0000","last_unstale":"2024-01-22T05:09:52.312051+0000","last_undegraded":"2024-01-22T05:09:52.312051+0000","last_fullsized":"2024-01-22T05:09:52.312051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279455+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.291159+0000","last_change":"2024-01-22T05:09:52.291159+0000","last_active":"2024-01-22T05:09:52.291159+0000","last_peered":"2024-01-22T05:09:52.291159+0000","last_clean":"2024-01-22T05:09:52.291159+0000","last_became_active":"2024-01-22T05:09:52.289670+0000","last_became_peered":"2024-01-22T05:09:52.289670+0000","last_unstale":"2024-01-22T05:09:52.291159+0000","last_undegraded":"2024-01-22T05:09:52.291159+0000","last_fullsized":"2024-01-22T05:09:52.291159+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280256+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.307125+0000","last_change":"2024-01-22T05:09:52.307125+0000","last_active":"2024-01-22T05:09:52.307125+0000","last_peered":"2024-01-22T05:09:52.307125+0000","last_clean":"2024-01-22T05:09:52.307125+0000","last_became_active":"2024-01-22T05:09:52.306261+0000","last_became_peered":"2024-01-22T05:09:52.306261+0000","last_unstale":"2024-01-22T05:09:52.307125+0000","last_undegraded":"2024-01-22T05:09:52.307125+0000","last_fullsized":"2024-01-22T05:09:52.307125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271529+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295635+0000","last_change":"2024-01-22T05:09:52.295635+0000","last_active":"2024-01-22T05:09:52.295635+0000","last_peered":"2024-01-22T05:09:52.295635+0000","last_clean":"2024-01-22T05:09:52.295635+0000","last_became_active":"2024-01-22T05:09:52.295121+0000","last_became_peered":"2024-01-22T05:09:52.295121+0000","last_unstale":"2024-01-22T05:09:52.295635+0000","last_undegraded":"2024-01-22T05:09:52.295635+0000","last_fullsized":"2024-01-22T05:09:52.295635+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279817+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.291201+0000","last_change":"2024-01-22T05:09:52.291201+0000","last_active":"2024-01-22T05:09:52.291201+0000","last_peered":"2024-01-22T05:09:52.291201+0000","last_clean":"2024-01-22T05:09:52.291201+0000","last_became_active":"2024-01-22T05:09:52.290840+0000","last_became_peered":"2024-01-22T05:09:52.290840+0000","last_unstale":"2024-01-22T05:09:52.291201+0000","last_undegraded":"2024-01-22T05:09:52.291201+0000","last_fullsized":"2024-01-22T05:09:52.291201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277451+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.282950+0000","last_change":"2024-01-22T05:09:52.282950+0000","last_active":"2024-01-22T05:09:52.282950+0000","last_peered":"2024-01-22T05:09:52.282950+0000","last_clean":"2024-01-22T05:09:52.282950+0000","last_became_active":"2024-01-22T05:09:52.279776+0000","last_became_peered":"2024-01-22T05:09:52.279776+0000","last_unstale":"2024-01-22T05:09:52.282950+0000","last_undegraded":"2024-01-22T05:09:52.282950+0000","last_fullsized":"2024-01-22T05:09:52.282950+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.275271+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.298678+0000","last_change":"2024-01-22T05:09:52.298678+0000","last_active":"2024-01-22T05:09:52.298678+0000","last_peered":"2024-01-22T05:09:52.298678+0000","last_clean":"2024-01-22T05:09:52.298678+0000","last_became_active":"2024-01-22T05:09:52.298186+0000","last_became_peered":"2024-01-22T05:09:52.298186+0000","last_unstale":"2024-01-22T05:09:52.298678+0000","last_undegraded":"2024-01-22T05:09:52.298678+0000","last_fullsized":"2024-01-22T05:09:52.298678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276211+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285820+0000","last_change":"2024-01-22T05:09:52.285820+0000","last_active":"2024-01-22T05:09:52.285820+0000","last_peered":"2024-01-22T05:09:52.285820+0000","last_clean":"2024-01-22T05:09:52.285820+0000","last_became_active":"2024-01-22T05:09:52.285492+0000","last_became_peered":"2024-01-22T05:09:52.285492+0000","last_unstale":"2024-01-22T05:09:52.285820+0000","last_undegraded":"2024-01-22T05:09:52.285820+0000","last_fullsized":"2024-01-22T05:09:52.285820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.290731+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.284575+0000","last_change":"2024-01-22T05:09:52.284575+0000","last_active":"2024-01-22T05:09:52.284575+0000","last_peered":"2024-01-22T05:09:52.284575+0000","last_clean":"2024-01-22T05:09:52.284575+0000","last_became_active":"2024-01-22T05:09:52.284312+0000","last_became_peered":"2024-01-22T05:09:52.284312+0000","last_unstale":"2024-01-22T05:09:52.284575+0000","last_undegraded":"2024-01-22T05:09:52.284575+0000","last_fullsized":"2024-01-22T05:09:52.284575+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.272857+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.298825+0000","last_change":"2024-01-22T05:09:52.298825+0000","last_active":"2024-01-22T05:09:52.298825+0000","last_peered":"2024-01-22T05:09:52.298825+0000","last_clean":"2024-01-22T05:09:52.298825+0000","last_became_active":"2024-01-22T05:09:52.298494+0000","last_became_peered":"2024-01-22T05:09:52.298494+0000","last_unstale":"2024-01-22T05:09:52.298825+0000","last_undegraded":"2024-01-22T05:09:52.298825+0000","last_fullsized":"2024-01-22T05:09:52.298825+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276479+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.290456+0000","last_change":"2024-01-22T05:09:52.290456+0000","last_active":"2024-01-22T05:09:52.290456+0000","last_peered":"2024-01-22T05:09:52.290456+0000","last_clean":"2024-01-22T05:09:52.290456+0000","last_became_active":"2024-01-22T05:09:52.288359+0000","last_became_peered":"2024-01-22T05:09:52.288359+0000","last_unstale":"2024-01-22T05:09:52.290456+0000","last_undegraded":"2024-01-22T05:09:52.290456+0000","last_fullsized":"2024-01-22T05:09:52.290456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.278044+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297963+0000","last_change":"2024-01-22T05:09:52.297963+0000","last_active":"2024-01-22T05:09:52.297963+0000","last_peered":"2024-01-22T05:09:52.297963+0000","last_clean":"2024-01-22T05:09:52.297963+0000","last_became_active":"2024-01-22T05:09:52.295129+0000","last_became_peered":"2024-01-22T05:09:52.295129+0000","last_unstale":"2024-01-22T05:09:52.297963+0000","last_undegraded":"2024-01-22T05:09:52.297963+0000","last_fullsized":"2024-01-22T05:09:52.297963+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266650+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.312269+0000","last_change":"2024-01-22T05:09:52.312269+0000","last_active":"2024-01-22T05:09:52.312269+0000","last_peered":"2024-01-22T05:09:52.312269+0000","last_clean":"2024-01-22T05:09:52.312269+0000","last_became_active":"2024-01-22T05:09:52.312009+0000","last_became_peered":"2024-01-22T05:09:52.312009+0000","last_unstale":"2024-01-22T05:09:52.312269+0000","last_undegraded":"2024-01-22T05:09:52.312269+0000","last_fullsized":"2024-01-22T05:09:52.312269+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.275125+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.304546+0000","last_change":"2024-01-22T05:09:52.304546+0000","last_active":"2024-01-22T05:09:52.304546+0000","last_peered":"2024-01-22T05:09:52.304546+0000","last_clean":"2024-01-22T05:09:52.304546+0000","last_became_active":"2024-01-22T05:09:52.302485+0000","last_became_peered":"2024-01-22T05:09:52.302485+0000","last_unstale":"2024-01-22T05:09:52.304546+0000","last_undegraded":"2024-01-22T05:09:52.304546+0000","last_fullsized":"2024-01-22T05:09:52.304546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273801+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305020+0000","last_change":"2024-01-22T05:09:52.305020+0000","last_active":"2024-01-22T05:09:52.305020+0000","last_peered":"2024-01-22T05:09:52.305020+0000","last_clean":"2024-01-22T05:09:52.305020+0000","last_became_active":"2024-01-22T05:09:52.304708+0000","last_became_peered":"2024-01-22T05:09:52.304708+0000","last_unstale":"2024-01-22T05:09:52.305020+0000","last_undegraded":"2024-01-22T05:09:52.305020+0000","last_fullsized":"2024-01-22T05:09:52.305020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.267911+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.293808+0000","last_change":"2024-01-22T05:09:52.293808+0000","last_active":"2024-01-22T05:09:52.293808+0000","last_peered":"2024-01-22T05:09:52.293808+0000","last_clean":"2024-01-22T05:09:52.293808+0000","last_became_active":"2024-01-22T05:09:52.293536+0000","last_became_peered":"2024-01-22T05:09:52.293536+0000","last_unstale":"2024-01-22T05:09:52.293808+0000","last_undegraded":"2024-01-22T05:09:52.293808+0000","last_fullsized":"2024-01-22T05:09:52.293808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.286676+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.296831+0000","last_change":"2024-01-22T05:09:52.296831+0000","last_active":"2024-01-22T05:09:52.296831+0000","last_peered":"2024-01-22T05:09:52.296831+0000","last_clean":"2024-01-22T05:09:52.296831+0000","last_became_active":"2024-01-22T05:09:52.295639+0000","last_became_peered":"2024-01-22T05:09:52.295639+0000","last_unstale":"2024-01-22T05:09:52.296831+0000","last_undegraded":"2024-01-22T05:09:52.296831+0000","last_fullsized":"2024-01-22T05:09:52.296831+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273600+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303111+0000","last_change":"2024-01-22T05:09:52.303111+0000","last_active":"2024-01-22T05:09:52.303111+0000","last_peered":"2024-01-22T05:09:52.303111+0000","last_clean":"2024-01-22T05:09:52.303111+0000","last_became_active":"2024-01-22T05:09:52.302809+0000","last_became_peered":"2024-01-22T05:09:52.302809+0000","last_unstale":"2024-01-22T05:09:52.303111+0000","last_undegraded":"2024-01-22T05:09:52.303111+0000","last_fullsized":"2024-01-22T05:09:52.303111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.275160+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.304360+0000","last_change":"2024-01-22T05:09:52.304360+0000","last_active":"2024-01-22T05:09:52.304360+0000","last_peered":"2024-01-22T05:09:52.304360+0000","last_clean":"2024-01-22T05:09:52.304360+0000","last_became_active":"2024-01-22T05:09:52.304061+0000","last_became_peered":"2024-01-22T05:09:52.304061+0000","last_unstale":"2024-01-22T05:09:52.304360+0000","last_undegraded":"2024-01-22T05:09:52.304360+0000","last_fullsized":"2024-01-22T05:09:52.304360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266055+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287508+0000","last_change":"2024-01-22T05:09:52.287508+0000","last_active":"2024-01-22T05:09:52.287508+0000","last_peered":"2024-01-22T05:09:52.287508+0000","last_clean":"2024-01-22T05:09:52.287508+0000","last_became_active":"2024-01-22T05:09:52.287047+0000","last_became_peered":"2024-01-22T05:09:52.287047+0000","last_unstale":"2024-01-22T05:09:52.287508+0000","last_undegraded":"2024-01-22T05:09:52.287508+0000","last_fullsized":"2024-01-22T05:09:52.287508+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271032+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297212+0000","last_change":"2024-01-22T05:09:52.297212+0000","last_active":"2024-01-22T05:09:52.297212+0000","last_peered":"2024-01-22T05:09:52.297212+0000","last_clean":"2024-01-22T05:09:52.297212+0000","last_became_active":"2024-01-22T05:09:52.296894+0000","last_became_peered":"2024-01-22T05:09:52.296894+0000","last_unstale":"2024-01-22T05:09:52.297212+0000","last_undegraded":"2024-01-22T05:09:52.297212+0000","last_fullsized":"2024-01-22T05:09:52.297212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.283716+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285779+0000","last_change":"2024-01-22T05:09:52.285779+0000","last_active":"2024-01-22T05:09:52.285779+0000","last_peered":"2024-01-22T05:09:52.285779+0000","last_clean":"2024-01-22T05:09:52.285779+0000","last_became_active":"2024-01-22T05:09:52.285085+0000","last_became_peered":"2024-01-22T05:09:52.285085+0000","last_unstale":"2024-01-22T05:09:52.285779+0000","last_undegraded":"2024-01-22T05:09:52.285779+0000","last_fullsized":"2024-01-22T05:09:52.285779+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.268712+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.293180+0000","last_change":"2024-01-22T05:09:52.293180+0000","last_active":"2024-01-22T05:09:52.293180+0000","last_peered":"2024-01-22T05:09:52.293180+0000","last_clean":"2024-01-22T05:09:52.293180+0000","last_became_active":"2024-01-22T05:09:52.292510+0000","last_became_peered":"2024-01-22T05:09:52.292510+0000","last_unstale":"2024-01-22T05:09:52.293180+0000","last_undegraded":"2024-01-22T05:09:52.293180+0000","last_fullsized":"2024-01-22T05:09:52.293180+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.267373+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.306492+0000","last_change":"2024-01-22T05:09:52.306492+0000","last_active":"2024-01-22T05:09:52.306492+0000","last_peered":"2024-01-22T05:09:52.306492+0000","last_clean":"2024-01-22T05:09:52.306492+0000","last_became_active":"2024-01-22T05:09:52.306048+0000","last_became_peered":"2024-01-22T05:09:52.306048+0000","last_unstale":"2024-01-22T05:09:52.306492+0000","last_undegraded":"2024-01-22T05:09:52.306492+0000","last_fullsized":"2024-01-22T05:09:52.306492+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273484+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.311553+0000","last_change":"2024-01-22T05:09:52.311553+0000","last_active":"2024-01-22T05:09:52.311553+0000","last_peered":"2024-01-22T05:09:52.311553+0000","last_clean":"2024-01-22T05:09:52.311553+0000","last_became_active":"2024-01-22T05:09:52.307278+0000","last_became_peered":"2024-01-22T05:09:52.307278+0000","last_unstale":"2024-01-22T05:09:52.311553+0000","last_undegraded":"2024-01-22T05:09:52.311553+0000","last_fullsized":"2024-01-22T05:09:52.311553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274110+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295147+0000","last_change":"2024-01-22T05:09:52.295147+0000","last_active":"2024-01-22T05:09:52.295147+0000","last_peered":"2024-01-22T05:09:52.295147+0000","last_clean":"2024-01-22T05:09:52.295147+0000","last_became_active":"2024-01-22T05:09:52.294863+0000","last_became_peered":"2024-01-22T05:09:52.294863+0000","last_unstale":"2024-01-22T05:09:52.295147+0000","last_undegraded":"2024-01-22T05:09:52.295147+0000","last_fullsized":"2024-01-22T05:09:52.295147+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280924+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.293685+0000","last_change":"2024-01-22T05:09:52.293685+0000","last_active":"2024-01-22T05:09:52.293685+0000","last_peered":"2024-01-22T05:09:52.293685+0000","last_clean":"2024-01-22T05:09:52.293685+0000","last_became_active":"2024-01-22T05:09:52.292089+0000","last_became_peered":"2024-01-22T05:09:52.292089+0000","last_unstale":"2024-01-22T05:09:52.293685+0000","last_undegraded":"2024-01-22T05:09:52.293685+0000","last_fullsized":"2024-01-22T05:09:52.293685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273548+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305465+0000","last_change":"2024-01-22T05:09:52.305465+0000","last_active":"2024-01-22T05:09:52.305465+0000","last_peered":"2024-01-22T05:09:52.305465+0000","last_clean":"2024-01-22T05:09:52.305465+0000","last_became_active":"2024-01-22T05:09:52.305188+0000","last_became_peered":"2024-01-22T05:09:52.305188+0000","last_unstale":"2024-01-22T05:09:52.305465+0000","last_undegraded":"2024-01-22T05:09:52.305465+0000","last_fullsized":"2024-01-22T05:09:52.305465+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277473+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.299261+0000","last_change":"2024-01-22T05:09:52.299261+0000","last_active":"2024-01-22T05:09:52.299261+0000","last_peered":"2024-01-22T05:09:52.299261+0000","last_clean":"2024-01-22T05:09:52.299261+0000","last_became_active":"2024-01-22T05:09:52.298981+0000","last_became_peered":"2024-01-22T05:09:52.298981+0000","last_unstale":"2024-01-22T05:09:52.299261+0000","last_undegraded":"2024-01-22T05:09:52.299261+0000","last_fullsized":"2024-01-22T05:09:52.299261+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277585+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295858+0000","last_change":"2024-01-22T05:09:52.295858+0000","last_active":"2024-01-22T05:09:52.295858+0000","last_peered":"2024-01-22T05:09:52.295858+0000","last_clean":"2024-01-22T05:09:52.295858+0000","last_became_active":"2024-01-22T05:09:52.295611+0000","last_became_peered":"2024-01-22T05:09:52.295611+0000","last_unstale":"2024-01-22T05:09:52.295858+0000","last_undegraded":"2024-01-22T05:09:52.295858+0000","last_fullsized":"2024-01-22T05:09:52.295858+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269623+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.290933+0000","last_change":"2024-01-22T05:09:52.290933+0000","last_active":"2024-01-22T05:09:52.290933+0000","last_peered":"2024-01-22T05:09:52.290933+0000","last_clean":"2024-01-22T05:09:52.290933+0000","last_became_active":"2024-01-22T05:09:52.290628+0000","last_became_peered":"2024-01-22T05:09:52.290628+0000","last_unstale":"2024-01-22T05:09:52.290933+0000","last_undegraded":"2024-01-22T05:09:52.290933+0000","last_fullsized":"2024-01-22T05:09:52.290933+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.285033+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.292061+0000","last_change":"2024-01-22T05:09:52.292061+0000","last_active":"2024-01-22T05:09:52.292061+0000","last_peered":"2024-01-22T05:09:52.292061+0000","last_clean":"2024-01-22T05:09:52.292061+0000","last_became_active":"2024-01-22T05:09:52.291734+0000","last_became_peered":"2024-01-22T05:09:52.291734+0000","last_unstale":"2024-01-22T05:09:52.292061+0000","last_undegraded":"2024-01-22T05:09:52.292061+0000","last_fullsized":"2024-01-22T05:09:52.292061+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280058+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303771+0000","last_change":"2024-01-22T05:09:52.303771+0000","last_active":"2024-01-22T05:09:52.303771+0000","last_peered":"2024-01-22T05:09:52.303771+0000","last_clean":"2024-01-22T05:09:52.303771+0000","last_became_active":"2024-01-22T05:09:52.303433+0000","last_became_peered":"2024-01-22T05:09:52.303433+0000","last_unstale":"2024-01-22T05:09:52.303771+0000","last_undegraded":"2024-01-22T05:09:52.303771+0000","last_fullsized":"2024-01-22T05:09:52.303771+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274421+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303933+0000","last_change":"2024-01-22T05:09:52.303933+0000","last_active":"2024-01-22T05:09:52.303933+0000","last_peered":"2024-01-22T05:09:52.303933+0000","last_clean":"2024-01-22T05:09:52.303933+0000","last_became_active":"2024-01-22T05:09:52.303636+0000","last_became_peered":"2024-01-22T05:09:52.303636+0000","last_unstale":"2024-01-22T05:09:52.303933+0000","last_undegraded":"2024-01-22T05:09:52.303933+0000","last_fullsized":"2024-01-22T05:09:52.303933+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279808+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.307313+0000","last_change":"2024-01-22T05:09:52.307313+0000","last_active":"2024-01-22T05:09:52.307313+0000","last_peered":"2024-01-22T05:09:52.307313+0000","last_clean":"2024-01-22T05:09:52.307313+0000","last_became_active":"2024-01-22T05:09:52.306595+0000","last_became_peered":"2024-01-22T05:09:52.306595+0000","last_unstale":"2024-01-22T05:09:52.307313+0000","last_undegraded":"2024-01-22T05:09:52.307313+0000","last_fullsized":"2024-01-22T05:09:52.307313+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.272936+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295140+0000","last_change":"2024-01-22T05:09:52.295140+0000","last_active":"2024-01-22T05:09:52.295140+0000","last_peered":"2024-01-22T05:09:52.295140+0000","last_clean":"2024-01-22T05:09:52.295140+0000","last_became_active":"2024-01-22T05:09:52.294851+0000","last_became_peered":"2024-01-22T05:09:52.294851+0000","last_unstale":"2024-01-22T05:09:52.295140+0000","last_undegraded":"2024-01-22T05:09:52.295140+0000","last_fullsized":"2024-01-22T05:09:52.295140+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273378+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.301225+0000","last_change":"2024-01-22T05:09:52.301225+0000","last_active":"2024-01-22T05:09:52.301225+0000","last_peered":"2024-01-22T05:09:52.301225+0000","last_clean":"2024-01-22T05:09:52.301225+0000","last_became_active":"2024-01-22T05:09:52.300908+0000","last_became_peered":"2024-01-22T05:09:52.300908+0000","last_unstale":"2024-01-22T05:09:52.301225+0000","last_undegraded":"2024-01-22T05:09:52.301225+0000","last_fullsized":"2024-01-22T05:09:52.301225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271848+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287231+0000","last_change":"2024-01-22T05:09:52.287231+0000","last_active":"2024-01-22T05:09:52.287231+0000","last_peered":"2024-01-22T05:09:52.287231+0000","last_clean":"2024-01-22T05:09:52.287231+0000","last_became_active":"2024-01-22T05:09:52.286426+0000","last_became_peered":"2024-01-22T05:09:52.286426+0000","last_unstale":"2024-01-22T05:09:52.287231+0000","last_undegraded":"2024-01-22T05:09:52.287231+0000","last_fullsized":"2024-01-22T05:09:52.287231+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274230+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305843+0000","last_change":"2024-01-22T05:09:52.305843+0000","last_active":"2024-01-22T05:09:52.305843+0000","last_peered":"2024-01-22T05:09:52.305843+0000","last_clean":"2024-01-22T05:09:52.305843+0000","last_became_active":"2024-01-22T05:09:52.305568+0000","last_became_peered":"2024-01-22T05:09:52.305568+0000","last_unstale":"2024-01-22T05:09:52.305843+0000","last_undegraded":"2024-01-22T05:09:52.305843+0000","last_fullsized":"2024-01-22T05:09:52.305843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266819+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285803+0000","last_change":"2024-01-22T05:09:52.285803+0000","last_active":"2024-01-22T05:09:52.285803+0000","last_peered":"2024-01-22T05:09:52.285803+0000","last_clean":"2024-01-22T05:09:52.285803+0000","last_became_active":"2024-01-22T05:09:52.285448+0000","last_became_peered":"2024-01-22T05:09:52.285448+0000","last_unstale":"2024-01-22T05:09:52.285803+0000","last_undegraded":"2024-01-22T05:09:52.285803+0000","last_fullsized":"2024-01-22T05:09:52.285803+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280591+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287765+0000","last_change":"2024-01-22T05:09:52.287765+0000","last_active":"2024-01-22T05:09:52.287765+0000","last_peered":"2024-01-22T05:09:52.287765+0000","last_clean":"2024-01-22T05:09:52.287765+0000","last_became_active":"2024-01-22T05:09:52.287495+0000","last_became_peered":"2024-01-22T05:09:52.287495+0000","last_unstale":"2024-01-22T05:09:52.287765+0000","last_undegraded":"2024-01-22T05:09:52.287765+0000","last_fullsized":"2024-01-22T05:09:52.287765+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269526+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303069+0000","last_change":"2024-01-22T05:09:52.303069+0000","last_active":"2024-01-22T05:09:52.303069+0000","last_peered":"2024-01-22T05:09:52.303069+0000","last_clean":"2024-01-22T05:09:52.303069+0000","last_became_active":"2024-01-22T05:09:52.302706+0000","last_became_peered":"2024-01-22T05:09:52.302706+0000","last_unstale":"2024-01-22T05:09:52.303069+0000","last_undegraded":"2024-01-22T05:09:52.303069+0000","last_fullsized":"2024-01-22T05:09:52.303069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.284777+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295007+0000","last_change":"2024-01-22T05:09:52.295007+0000","last_active":"2024-01-22T05:09:52.295007+0000","last_peered":"2024-01-22T05:09:52.295007+0000","last_clean":"2024-01-22T05:09:52.295007+0000","last_became_active":"2024-01-22T05:09:52.293628+0000","last_became_peered":"2024-01-22T05:09:52.293628+0000","last_unstale":"2024-01-22T05:09:52.295007+0000","last_undegraded":"2024-01-22T05:09:52.295007+0000","last_fullsized":"2024-01-22T05:09:52.295007+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274617+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287832+0000","last_change":"2024-01-22T05:09:52.287832+0000","last_active":"2024-01-22T05:09:52.287832+0000","last_peered":"2024-01-22T05:09:52.287832+0000","last_clean":"2024-01-22T05:09:52.287832+0000","last_became_active":"2024-01-22T05:09:52.287276+0000","last_became_peered":"2024-01-22T05:09:52.287276+0000","last_unstale":"2024-01-22T05:09:52.287832+0000","last_undegraded":"2024-01-22T05:09:52.287832+0000","last_fullsized":"2024-01-22T05:09:52.287832+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.267332+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.282595+0000","last_change":"2024-01-22T05:09:52.282595+0000","last_active":"2024-01-22T05:09:52.282595+0000","last_peered":"2024-01-22T05:09:52.282595+0000","last_clean":"2024-01-22T05:09:52.282595+0000","last_became_active":"2024-01-22T05:09:52.282317+0000","last_became_peered":"2024-01-22T05:09:52.282317+0000","last_unstale":"2024-01-22T05:09:52.282595+0000","last_undegraded":"2024-01-22T05:09:52.282595+0000","last_fullsized":"2024-01-22T05:09:52.282595+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276297+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.278471+0000","last_change":"2024-01-22T05:09:52.278471+0000","last_active":"2024-01-22T05:09:52.278471+0000","last_peered":"2024-01-22T05:09:52.278471+0000","last_clean":"2024-01-22T05:09:52.278471+0000","last_became_active":"2024-01-22T05:09:52.278138+0000","last_became_peered":"2024-01-22T05:09:52.278138+0000","last_unstale":"2024-01-22T05:09:52.278471+0000","last_undegraded":"2024-01-22T05:09:52.278471+0000","last_fullsized":"2024-01-22T05:09:52.278471+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.259071+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:09:51.259071+0000","last_peered":"2024-01-22T05:09:51.259071+0000","last_clean":"2024-01-22T05:09:51.259071+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:09:51.259071+0000","last_undegraded":"2024-01-22T05:09:51.259071+0000","last_fullsized":"2024-01-22T05:09:51.259071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.270273+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.283612+0000","last_change":"2024-01-22T05:09:52.283612+0000","last_active":"2024-01-22T05:09:52.283612+0000","last_peered":"2024-01-22T05:09:52.283612+0000","last_clean":"2024-01-22T05:09:52.283612+0000","last_became_active":"2024-01-22T05:09:52.283314+0000","last_became_peered":"2024-01-22T05:09:52.283314+0000","last_unstale":"2024-01-22T05:09:52.283612+0000","last_undegraded":"2024-01-22T05:09:52.283612+0000","last_fullsized":"2024-01-22T05:09:52.283612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252669+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:09:51.252669+0000","last_peered":"2024-01-22T05:09:51.252669+0000","last_clean":"2024-01-22T05:09:51.252669+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:09:51.252669+0000","last_undegraded":"2024-01-22T05:09:51.252669+0000","last_fullsized":"2024-01-22T05:09:51.252669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276907+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.288015+0000","last_change":"2024-01-22T05:09:52.288015+0000","last_active":"2024-01-22T05:09:52.288015+0000","last_peered":"2024-01-22T05:09:52.288015+0000","last_clean":"2024-01-22T05:09:52.288015+0000","last_became_active":"2024-01-22T05:09:52.285604+0000","last_became_peered":"2024-01-22T05:09:52.285604+0000","last_unstale":"2024-01-22T05:09:52.288015+0000","last_undegraded":"2024-01-22T05:09:52.288015+0000","last_fullsized":"2024-01-22T05:09:52.288015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.256904+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:09:51.256904+0000","last_peered":"2024-01-22T05:09:51.256904+0000","last_clean":"2024-01-22T05:09:51.256904+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:09:51.256904+0000","last_undegraded":"2024-01-22T05:09:51.256904+0000","last_fullsized":"2024-01-22T05:09:51.256904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269848+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.292815+0000","last_change":"2024-01-22T05:09:52.292815+0000","last_active":"2024-01-22T05:09:52.292815+0000","last_peered":"2024-01-22T05:09:52.292815+0000","last_clean":"2024-01-22T05:09:52.292815+0000","last_became_active":"2024-01-22T05:09:52.292500+0000","last_became_peered":"2024-01-22T05:09:52.292500+0000","last_unstale":"2024-01-22T05:09:52.292815+0000","last_undegraded":"2024-01-22T05:09:52.292815+0000","last_fullsized":"2024-01-22T05:09:52.292815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252447+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:09:51.252447+0000","last_peered":"2024-01-22T05:09:51.252447+0000","last_clean":"2024-01-22T05:09:51.252447+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:09:51.252447+0000","last_undegraded":"2024-01-22T05:09:51.252447+0000","last_fullsized":"2024-01-22T05:09:51.252447+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.281075+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.309505+0000","last_change":"2024-01-22T05:09:52.309505+0000","last_active":"2024-01-22T05:09:52.309505+0000","last_peered":"2024-01-22T05:09:52.309505+0000","last_clean":"2024-01-22T05:09:52.309505+0000","last_became_active":"2024-01-22T05:09:52.305992+0000","last_became_peered":"2024-01-22T05:09:52.305992+0000","last_unstale":"2024-01-22T05:09:52.309505+0000","last_undegraded":"2024-01-22T05:09:52.309505+0000","last_fullsized":"2024-01-22T05:09:52.309505+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252035+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:09:51.252035+0000","last_peered":"2024-01-22T05:09:51.252035+0000","last_clean":"2024-01-22T05:09:51.252035+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:09:51.252035+0000","last_undegraded":"2024-01-22T05:09:51.252035+0000","last_fullsized":"2024-01-22T05:09:51.252035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273491+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285964+0000","last_change":"2024-01-22T05:09:52.285964+0000","last_active":"2024-01-22T05:09:52.285964+0000","last_peered":"2024-01-22T05:09:52.285964+0000","last_clean":"2024-01-22T05:09:52.285964+0000","last_became_active":"2024-01-22T05:09:52.285512+0000","last_became_peered":"2024-01-22T05:09:52.285512+0000","last_unstale":"2024-01-22T05:09:52.285964+0000","last_undegraded":"2024-01-22T05:09:52.285964+0000","last_fullsized":"2024-01-22T05:09:52.285964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.264655+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:09:51.264655+0000","last_peered":"2024-01-22T05:09:51.264655+0000","last_clean":"2024-01-22T05:09:51.264655+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:09:51.264655+0000","last_undegraded":"2024-01-22T05:09:51.264655+0000","last_fullsized":"2024-01-22T05:09:51.264655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271035+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.302187+0000","last_change":"2024-01-22T05:09:52.302187+0000","last_active":"2024-01-22T05:09:52.302187+0000","last_peered":"2024-01-22T05:09:52.302187+0000","last_clean":"2024-01-22T05:09:52.302187+0000","last_became_active":"2024-01-22T05:09:52.301852+0000","last_became_peered":"2024-01-22T05:09:52.301852+0000","last_unstale":"2024-01-22T05:09:52.302187+0000","last_undegraded":"2024-01-22T05:09:52.302187+0000","last_fullsized":"2024-01-22T05:09:52.302187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.256651+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:09:51.256651+0000","last_peered":"2024-01-22T05:09:51.256651+0000","last_clean":"2024-01-22T05:09:51.256651+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:09:51.256651+0000","last_undegraded":"2024-01-22T05:09:51.256651+0000","last_fullsized":"2024-01-22T05:09:51.256651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274572+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295705+0000","last_change":"2024-01-22T05:09:52.295705+0000","last_active":"2024-01-22T05:09:52.295705+0000","last_peered":"2024-01-22T05:09:52.295705+0000","last_clean":"2024-01-22T05:09:52.295705+0000","last_became_active":"2024-01-22T05:09:52.295379+0000","last_became_peered":"2024-01-22T05:09:52.295379+0000","last_unstale":"2024-01-22T05:09:52.295705+0000","last_undegraded":"2024-01-22T05:09:52.295705+0000","last_fullsized":"2024-01-22T05:09:52.295705+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252037+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:09:51.252037+0000","last_peered":"2024-01-22T05:09:51.252037+0000","last_clean":"2024-01-22T05:09:51.252037+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:09:51.252037+0000","last_undegraded":"2024-01-22T05:09:51.252037+0000","last_fullsized":"2024-01-22T05:09:51.252037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":64,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.256760+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:09:51.256760+0000","last_peered":"2024-01-22T05:09:51.256760+0000","last_clean":"2024-01-22T05:09:51.256760+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:09:51.256760+0000","last_undegraded":"2024-01-22T05:09:51.256760+0000","last_fullsized":"2024-01-22T05:09:51.256760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065536,"statfs":{"total":96636764160,"available":96323108864,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.98699999999999999,"15min":1.0409999999999999},"min":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.548},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.71499999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.873}]},{"osd":1,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.04,"15min":0.98799999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.141,"15min":1.1699999999999999},"min":{"1min":0.78400000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5309999999999999,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.2649999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1279999999999999,"15min":1.1060000000000001},"min":{"1min":0.81399999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":2.5150000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.169,"15min":1.173},"min":{"1min":0.79700000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.6719999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.234,"15min":1.236},"min":{"1min":0.90300000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5720000000000001,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.8620000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.21,"15min":1.228},"min":{"1min":0.93999999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.4039999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.1299999999999999,"15min":1.071},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.1879999999999999,"15min":1.1679999999999999},"min":{"1min":1.01,"5min":0.751,"15min":0.751},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":2.077}]},{"osd":5,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.2290000000000001,"15min":1.2010000000000001},"min":{"1min":0.61199999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":2.0110000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.3169999999999999,"15min":1.2330000000000001},"min":{"1min":1.0860000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":3.625,"5min":3.625,"15min":3.625},"last":2.1819999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.256,"15min":1.258},"min":{"1min":0.999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.732,"5min":1.823,"15min":1.823},"last":1.9430000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.379,"15min":1.335},"min":{"1min":1.1140000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.8129999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":2.262}]}]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310412,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061428,"statfs":{"total":96636764160,"available":96318902272,"internally_reserved":0,"allocated":1052672,"data_stored":512874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.794,"15min":1.3340000000000001},"min":{"1min":0.74299999999999999,"5min":0.372,"15min":0.372},"max":{"1min":2.0219999999999998,"5min":77.745000000000005,"15min":77.745000000000005},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1659999999999999,"15min":1.091},"min":{"1min":0.60799999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.7509999999999999,"5min":13.555999999999999,"15min":13.555999999999999},"last":0.71199999999999997}]},{"osd":1,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1499999999999999,"15min":1.0980000000000001},"min":{"1min":0.66000000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3899999999999999,"5min":15.499000000000001,"15min":15.499000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.141,"5min":1.222,"15min":1.2430000000000001},"min":{"1min":0.63600000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.177,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":1.117}]},{"osd":2,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1499999999999999,"15min":1.1599999999999999},"min":{"1min":0.79300000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.9470000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1379999999999999,"15min":1.1220000000000001},"min":{"1min":0.77300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6040000000000001,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.0369999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":2.113,"15min":1.46},"min":{"1min":0.749,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.706,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.2689999999999999,"15min":1.234},"min":{"1min":0.75800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.367,"5min":15.468,"15min":15.468},"last":0.876}]},{"osd":4,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1439999999999999,"15min":1.101},"min":{"1min":0.85499999999999998,"5min":0.495,"15min":0.495},"max":{"1min":1.8200000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":1.29},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.1299999999999999},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.619,"5min":1.649,"15min":1.649},"last":1.149}]},{"osd":5,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.4139999999999999,"15min":1.266},"min":{"1min":0.84599999999999997,"5min":0.624,"15min":0.624},"max":{"1min":1.5800000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.3109999999999999,"15min":1.2849999999999999},"min":{"1min":0.88300000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.4239999999999999,"5min":3.875,"15min":3.875},"last":1.214}]},{"osd":7,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.536,"15min":1.4379999999999999},"min":{"1min":0.89200000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.905,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.895,"15min":1.5840000000000001},"min":{"1min":0.93799999999999994,"5min":0.495,"15min":0.495},"max":{"1min":1.6140000000000001,"5min":63.737000000000002,"15min":63.737000000000002},"last":1.2410000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310400,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061440,"statfs":{"total":96636764160,"available":96318914560,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":0.998,"15min":0.998},"min":{"1min":0.80300000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":2.0609999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.036,"15min":1.105},"min":{"1min":0.70799999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.5680000000000001,"5min":1.571,"15min":1.571},"last":1.377}]},{"osd":1,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.163,"15min":1.2170000000000001},"min":{"1min":1.119,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.516,"5min":1.821,"15min":1.821},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2030000000000001,"15min":1.302},"min":{"1min":0.96599999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5329999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":2.0209999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.1539999999999999,"15min":1.1599999999999999},"min":{"1min":0.86899999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.617,"5min":1.629,"15min":1.629},"last":1.925},{"interface":"front","average":{"1min":1.163,"5min":1.0960000000000001,"15min":1.1419999999999999},"min":{"1min":0.90500000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3680000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.859}]},{"osd":3,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.143,"15min":1.1850000000000001},"min":{"1min":0.83199999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.49,"5min":1.931,"15min":1.931},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.298,"5min":1.22,"15min":1.3029999999999999},"min":{"1min":0.79900000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5509999999999999,"5min":2.266,"15min":2.266},"last":1.506}]},{"osd":4,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1220000000000001,"15min":1.1859999999999999},"min":{"1min":0.82599999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.518,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.226,"15min":1.298},"min":{"1min":0.85499999999999998,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8300000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.798}]},{"osd":6,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.264,"15min":1.343},"min":{"1min":0.879,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6699999999999999,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.8129999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.2749999999999999,"15min":1.3109999999999999},"min":{"1min":0.99299999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7829999999999999,"5min":1.909,"15min":1.909},"last":1.323}]},{"osd":7,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3560000000000001,"15min":1.423},"min":{"1min":0.91100000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.766,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3899999999999999,"15min":1.476},"min":{"1min":1.0589999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.671,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.2290000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310400,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061440,"statfs":{"total":96636764160,"available":96318914560,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.1140000000000001,"15min":1.143},"min":{"1min":0.65800000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6719999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.018},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.133,"15min":1.103},"min":{"1min":0.63400000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.042}]},{"osd":1,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.0569999999999999,"15min":1.0860000000000001},"min":{"1min":0.69399999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.159},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.083,"15min":1.1870000000000001},"min":{"1min":0.66400000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5329999999999999,"5min":2.194,"15min":2.194},"last":1.1819999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.099,"15min":1.091},"min":{"1min":0.68300000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4470000000000001,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":0.876},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.177,"15min":1.272},"min":{"1min":0.78400000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.536,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.099}]},{"osd":3,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.133,"15min":1.1839999999999999},"min":{"1min":0.89100000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.514,"5min":1.589,"15min":1.589},"last":1.01},{"interface":"front","average":{"1min":1.175,"5min":1.1850000000000001,"15min":1.1679999999999999},"min":{"1min":0.81599999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.54,"5min":5.3029999999999999,"15min":5.3029999999999999},"last":0.91100000000000003}]},{"osd":5,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1639999999999999,"15min":1.2170000000000001},"min":{"1min":0.85099999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.667,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.129,"5min":1.1220000000000001,"15min":1.1579999999999999},"min":{"1min":0.84599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.597,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.97299999999999998}]},{"osd":6,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.196,"15min":1.1919999999999999},"min":{"1min":0.85299999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6160000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.278,"5min":1.331,"15min":1.415},"min":{"1min":0.89700000000000002,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.7270000000000001,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.73499999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3220000000000001,"15min":1.3660000000000001},"min":{"1min":0.878,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.833,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.119},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.363,"15min":1.3799999999999999},"min":{"1min":1.0089999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6359999999999999,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":0.83599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310412,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061428,"statfs":{"total":96636764160,"available":96318902272,"internally_reserved":0,"allocated":1052672,"data_stored":512874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.95099999999999996,"15min":0.90500000000000003},"min":{"1min":0.55300000000000005,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4179999999999999,"5min":14.859,"15min":14.859},"last":0.752},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.94399999999999995,"15min":0.88800000000000001},"min":{"1min":0.55700000000000005,"5min":0.317,"15min":0.317},"max":{"1min":1.4119999999999999,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":0.51500000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.874,"15min":0.85599999999999998},"min":{"1min":0.66900000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2110000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.872},{"interface":"front","average":{"1min":1.01,"5min":1,"15min":0.98599999999999999},"min":{"1min":0.63300000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4079999999999999,"5min":5.7519999999999998,"15min":5.7519999999999998},"last":0.85199999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.085,"15min":1.159},"min":{"1min":0.64000000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1799999999999999,"15min":1.194},"min":{"1min":0.72999999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2,"5min":2,"15min":2},"last":1.0589999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.2889999999999999,"15min":1.296},"min":{"1min":0.71299999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.718,"5min":5.016,"15min":5.016},"last":1.23},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3420000000000001,"15min":1.3380000000000001},"min":{"1min":1.0469999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.633,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":1.3089999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3,"15min":1.298},"min":{"1min":1.0169999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.7090000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":1.149},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4830000000000001,"15min":1.345},"min":{"1min":0.94699999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.851,"5min":14.523999999999999,"15min":14.523999999999999},"last":1.1970000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.365,"15min":1.415},"min":{"1min":0.90500000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.752,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.4350000000000001,"15min":1.4219999999999999},"min":{"1min":0.95399999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.7370000000000001,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":1.369}]},{"osd":7,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.405,"15min":1.403},"min":{"1min":0.995,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.861,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":1.27},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.411,"15min":1.427},"min":{"1min":0.97799999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1139999999999999,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":1.2829999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574915,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065536,"statfs":{"total":96636764160,"available":96323108864,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.76000000000000001,"15min":0.75600000000000001},"min":{"1min":0.63600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2709999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.995,"5min":0.85799999999999998,"15min":0.83499999999999996},"min":{"1min":0.62,"5min":0.373,"15min":0.373},"max":{"1min":1.6559999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.99299999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.83199999999999996,"15min":0.80600000000000005},"min":{"1min":0.59399999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.995,"5min":0.91900000000000004,"15min":0.94199999999999995},"min":{"1min":0.755,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2569999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.95899999999999996}]},{"osd":3,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1000000000000001,"15min":1.0669999999999999},"min":{"1min":0.63300000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.79,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.1819999999999999,"15min":1.173},"min":{"1min":0.76600000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.73,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.357}]},{"osd":4,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.254,"15min":1.306},"min":{"1min":1.1890000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5940000000000001,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.1819999999999999,"15min":1.2090000000000001},"min":{"1min":0.93300000000000005,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.694,"5min":1.952,"15min":1.952},"last":1.389}]},{"osd":5,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2130000000000001,"15min":1.196},"min":{"1min":0.88300000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.597,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.266,"15min":1.319},"min":{"1min":1.022,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5629999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.2010000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.2350000000000001,"15min":1.2589999999999999},"min":{"1min":0.97499999999999998,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8360000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.292,"15min":1.2909999999999999},"min":{"1min":1.0389999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.6990000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.224}]},{"osd":7,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.3200000000000001,"15min":1.357},"min":{"1min":1.081,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.867,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.468,"5min":1.405,"15min":1.413},"min":{"1min":1.2050000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.877,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.518}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310400,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061440,"statfs":{"total":96636764160,"available":96318914560,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.90500000000000003,"15min":0.85499999999999998},"min":{"1min":0.69899999999999995,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2230000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.749},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.98899999999999999,"15min":1.0009999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.873,"5min":2.101,"15min":2.101},"last":0.94499999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.98499999999999999,"15min":1.0029999999999999},"min":{"1min":0.63200000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4390000000000001,"5min":1.722,"15min":1.722},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.071,"5min":1.042,"15min":1.03},"min":{"1min":0.64200000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.494,"5min":2.008,"15min":2.008},"last":1.1759999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0569999999999999,"15min":1.0049999999999999},"min":{"1min":0.71699999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":4.665,"15min":4.665},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.89600000000000002,"15min":0.88100000000000001},"min":{"1min":0.58499999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.333,"5min":1.867,"15min":1.867},"last":0.77400000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2210000000000001,"15min":1.206},"min":{"1min":0.92800000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.605,"5min":1.788,"15min":1.788},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2949999999999999,"15min":1.2569999999999999},"min":{"1min":0.96199999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6439999999999999,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":1.1080000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.1930000000000001,"15min":1.1910000000000001},"min":{"1min":0.80000000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.048},{"interface":"front","average":{"1min":1.401,"5min":1.292,"15min":1.278},"min":{"1min":1.0349999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.9430000000000001,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.871}]},{"osd":6,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.83899999999999997,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.74,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.349,"15min":1.3420000000000001},"min":{"1min":0.98599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.893,"5min":2.294,"15min":2.294},"last":1.1579999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.397,"15min":1.379},"min":{"1min":0.92700000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.764,"5min":4.4329999999999998,"15min":4.4329999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":1.0149999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.0329999999999999,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":1.1970000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574915,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065536,"statfs":{"total":96636764160,"available":96323108864,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.6419999999999999,"5min":0.97499999999999998,"15min":0.96399999999999997},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":15.273,"5min":15.273,"15min":15.273},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.91800000000000004,"15min":0.98299999999999998},"min":{"1min":0.51800000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.3149999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.716,"5min":1.1319999999999999,"15min":1.1140000000000001},"min":{"1min":0.56499999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":15.473000000000001,"5min":15.473000000000001,"15min":15.473000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.008,"15min":1.024},"min":{"1min":0.68700000000000006,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.589,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.1259999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":0.99399999999999999,"15min":1.0349999999999999},"min":{"1min":0.59499999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.3970000000000002,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.931,"5min":1.256,"15min":1.25},"min":{"1min":0.71699999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":15.439,"5min":15.439,"15min":15.439},"last":1.375}]},{"osd":4,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2509999999999999,"15min":1.369},"min":{"1min":0.751,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6200000000000001,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.405},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.23,"15min":1.258},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":1.149}]},{"osd":5,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.272,"15min":1.373},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.891,"5min":3.548,"15min":3.548},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.3220000000000001,"15min":1.4159999999999999},"min":{"1min":0.80500000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.2769999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":2.149,"5min":1.51,"15min":1.4870000000000001},"min":{"1min":0.89100000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":15.4,"5min":15.4,"15min":15.4},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.6899999999999999,"5min":1.411,"15min":1.512},"min":{"1min":1.0489999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":7.1349999999999998,"5min":7.1349999999999998,"15min":7.1349999999999998},"last":1.2370000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4279999999999999,"15min":1.621},"min":{"1min":1.1040000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.1080000000000001,"5min":5.29,"15min":5.29},"last":1.486},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.361,"15min":1.4350000000000001},"min":{"1min":0.93400000000000005,"5min":0.752,"15min":0.752},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.4259999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:09:56.982 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:09:57.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.190+0000 7fada0c00700 1 Processor -- start 2024-01-22T05:09:57.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.190+0000 7fada0c00700 1 -- start start 2024-01-22T05:09:57.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.194+0000 7fada0c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c1517e0 0x7fad9c154c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:57.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.194+0000 7fada0c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fad9c0c4010 0x7fad9c0c4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:57.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.194+0000 7fada0c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c154770 con 0x7fad9c068ba0 2024-01-22T05:09:57.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.194+0000 7fada0c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9c0c4960 con 0x7fad9c0c4010 2024-01-22T05:09:57.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.194+0000 7fada0c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c062bd0 con 0x7fad9c1517e0 2024-01-22T05:09:57.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.194+0000 7fad99400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fad9c0c4010 0x7fad9c0c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:57.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.194+0000 7fad99400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fad9c0c4010 0x7fad9c0c4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54494/0 (socket says 172.21.15.49:54494) 2024-01-22T05:09:57.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.194+0000 7fad9a800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fad9c068ba0 0x7fad9c069050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45724/0 (socket says 172.21.15.49:45724) 2024-01-22T05:09:57.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.194+0000 7fad99400700 1 -- 172.21.15.49:0/975345957 learned_addr learned my addr 172.21.15.49:0/975345957 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:57.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.194+0000 7fad99e00700 1 --2- 172.21.15.49:0/975345957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c1517e0 0x7fad9c154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:57.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fad99400700 1 -- 172.21.15.49:0/975345957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c1517e0 msgr2=0x7fad9c154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:57.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fad99400700 1 --2- 172.21.15.49:0/975345957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c1517e0 0x7fad9c154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fad99400700 1 -- 172.21.15.49:0/975345957 >> v1:172.21.15.49:6789/0 conn(0x7fad9c068ba0 legacy=0x7fad9c069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:57.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fad99400700 1 -- 172.21.15.49:0/975345957 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c062610 con 0x7fad9c0c4010 2024-01-22T05:09:57.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fad99e00700 1 --2- 172.21.15.49:0/975345957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c1517e0 0x7fad9c154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:57.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fad99400700 1 --2- 172.21.15.49:0/975345957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad9c0c4010 0x7fad9c0c4470 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7fad84006fd0 tx=0x7fad840090f0).ready entity=mon.0 client_cookie=aac3d22a91293c23 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:57.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fad98a00700 1 -- 172.21.15.49:0/975345957 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8400f510 con 0x7fad9c0c4010 2024-01-22T05:09:57.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fad98a00700 1 -- 172.21.15.49:0/975345957 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8400f670 con 0x7fad9c0c4010 2024-01-22T05:09:57.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fad98a00700 1 -- 172.21.15.49:0/975345957 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8400fa10 con 0x7fad9c0c4010 2024-01-22T05:09:57.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fada0c00700 1 -- 172.21.15.49:0/975345957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad9c0c4010 msgr2=0x7fad9c0c4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:57.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fada0c00700 1 --2- 172.21.15.49:0/975345957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad9c0c4010 0x7fad9c0c4470 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7fad84006fd0 tx=0x7fad840090f0).stop 2024-01-22T05:09:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fada0c00700 1 -- 172.21.15.49:0/975345957 shutdown_connections 2024-01-22T05:09:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fada0c00700 1 --2- 172.21.15.49:0/975345957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad9c0c4010 0x7fad9c0c4470 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fada0c00700 1 --2- 172.21.15.49:0/975345957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c1517e0 0x7fad9c154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fada0c00700 1 -- 172.21.15.49:0/975345957 >> 172.21.15.49:0/975345957 conn(0x7fad9c0aa660 msgr2=0x7fad9c0aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.198+0000 7fada0c00700 1 -- 172.21.15.49:0/975345957 shutdown_connections 2024-01-22T05:09:57.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.202+0000 7fada0c00700 1 -- 172.21.15.49:0/975345957 wait complete. 2024-01-22T05:09:57.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.202+0000 7fada0c00700 1 Processor -- start 2024-01-22T05:09:57.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.206+0000 7fada0c00700 1 -- start start 2024-01-22T05:09:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.206+0000 7fada0c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c068ba0 0x7fad9c1506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.206+0000 7fada0c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad9c0c4010 0x7fad9c1608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.206+0000 7fada0c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad9c1517e0 0x7fad9c0c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.206+0000 7fada0c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c150be0 con 0x7fad9c1517e0 2024-01-22T05:09:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.206+0000 7fada0c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c152b20 con 0x7fad9c0c4010 2024-01-22T05:09:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.206+0000 7fada0c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c160db0 con 0x7fad9c068ba0 2024-01-22T05:09:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.206+0000 7fad9a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad9c1517e0 0x7fad9c0c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.206+0000 7fad9a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad9c1517e0 0x7fad9c0c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54500/0 (socket says 172.21.15.49:54500) 2024-01-22T05:09:57.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.206+0000 7fad9a800700 1 -- 172.21.15.49:0/3772115580 learned_addr learned my addr 172.21.15.49:0/3772115580 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:57.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.206+0000 7fad99e00700 1 --2- 172.21.15.49:0/3772115580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c068ba0 0x7fad9c1506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:57.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.206+0000 7fad99400700 1 --2- 172.21.15.49:0/3772115580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad9c0c4010 0x7fad9c1608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:57.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.210+0000 7fad9a800700 1 -- 172.21.15.49:0/3772115580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c068ba0 msgr2=0x7fad9c1506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:57.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.210+0000 7fad9a800700 1 --2- 172.21.15.49:0/3772115580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c068ba0 0x7fad9c1506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.210+0000 7fad9a800700 1 -- 172.21.15.49:0/3772115580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad9c0c4010 msgr2=0x7fad9c1608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:57.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.210+0000 7fad9a800700 1 --2- 172.21.15.49:0/3772115580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad9c0c4010 0x7fad9c1608c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.210+0000 7fad9a800700 1 -- 172.21.15.49:0/3772115580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c009250 con 0x7fad9c1517e0 2024-01-22T05:09:57.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.210+0000 7fad9a800700 1 --2- 172.21.15.49:0/3772115580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad9c1517e0 0x7fad9c0c60f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fad9400c890 tx=0x7fad94001610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:57.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.210+0000 7fad91600700 1 -- 172.21.15.49:0/3772115580 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94005c70 con 0x7fad9c1517e0 2024-01-22T05:09:57.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.210+0000 7fad91600700 1 -- 172.21.15.49:0/3772115580 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad94005dd0 con 0x7fad9c1517e0 2024-01-22T05:09:57.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.210+0000 7fada0c00700 1 -- 172.21.15.49:0/3772115580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad84009370 con 0x7fad9c1517e0 2024-01-22T05:09:57.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.210+0000 7fad91600700 1 -- 172.21.15.49:0/3772115580 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94007320 con 0x7fad9c1517e0 2024-01-22T05:09:57.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.210+0000 7fada0c00700 1 -- 172.21.15.49:0/3772115580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c1521f0 con 0x7fad9c1517e0 2024-01-22T05:09:57.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.210+0000 7fada0c00700 1 -- 172.21.15.49:0/3772115580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9c0a70c0 con 0x7fad9c1517e0 2024-01-22T05:09:57.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.214+0000 7fad91600700 1 -- 172.21.15.49:0/3772115580 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fad940076d0 con 0x7fad9c1517e0 2024-01-22T05:09:57.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.214+0000 7fad91600700 1 --2- 172.21.15.49:0/3772115580 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad7405a540 0x7fad7405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:57.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.214+0000 7fad91600700 1 -- 172.21.15.49:0/3772115580 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fad94074b90 con 0x7fad9c1517e0 2024-01-22T05:09:57.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.214+0000 7fad99e00700 1 --2- 172.21.15.49:0/3772115580 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad7405a540 0x7fad7405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:57.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.218+0000 7fad99e00700 1 --2- 172.21.15.49:0/3772115580 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad7405a540 0x7fad7405ca00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fad9c0ab330 tx=0x7fad8c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:57.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.222+0000 7fad91600700 1 -- 172.21.15.49:0/3772115580 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fad9c0a70c0 con 0x7fad9c1517e0 2024-01-22T05:09:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.386+0000 7fada0c00700 1 -- 172.21.15.49:0/3772115580 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad9c0a70c0 con 0x7fad7405a540 2024-01-22T05:09:57.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.406+0000 7fad91600700 1 -- 172.21.15.49:0/3772115580 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355771 (secure 0 0 0) 0x7fad9c0a70c0 con 0x7fad7405a540 2024-01-22T05:09:57.414 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:57.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.414+0000 7fada0c00700 1 -- 172.21.15.49:0/3772115580 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad7405a540 msgr2=0x7fad7405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:57.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.414+0000 7fada0c00700 1 --2- 172.21.15.49:0/3772115580 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad7405a540 0x7fad7405ca00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fad9c0ab330 tx=0x7fad8c008040).stop 2024-01-22T05:09:57.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.414+0000 7fada0c00700 1 -- 172.21.15.49:0/3772115580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad9c1517e0 msgr2=0x7fad9c0c60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:57.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.414+0000 7fada0c00700 1 --2- 172.21.15.49:0/3772115580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad9c1517e0 0x7fad9c0c60f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fad9400c890 tx=0x7fad94001610).stop 2024-01-22T05:09:57.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.418+0000 7fada0c00700 1 -- 172.21.15.49:0/3772115580 shutdown_connections 2024-01-22T05:09:57.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.418+0000 7fada0c00700 1 --2- 172.21.15.49:0/3772115580 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad7405a540 0x7fad7405ca00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.418+0000 7fada0c00700 1 --2- 172.21.15.49:0/3772115580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad9c1517e0 0x7fad9c0c60f0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.418+0000 7fada0c00700 1 --2- 172.21.15.49:0/3772115580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad9c0c4010 0x7fad9c1608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.418+0000 7fada0c00700 1 --2- 172.21.15.49:0/3772115580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c068ba0 0x7fad9c1506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.418+0000 7fada0c00700 1 -- 172.21.15.49:0/3772115580 >> 172.21.15.49:0/3772115580 conn(0x7fad9c0aa660 msgr2=0x7fad9c0aaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.418+0000 7fada0c00700 1 -- 172.21.15.49:0/3772115580 shutdown_connections 2024-01-22T05:09:57.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.418+0000 7fada0c00700 1 -- 172.21.15.49:0/3772115580 wait complete. 2024-01-22T05:09:57.425 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:09:57.448 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2024-01-22T05:09:57.342634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470936,"kb_used_data":8152,"kb_used_omap":0,"kb_used_meta":2462720,"kb_avail":752503784,"statfs":{"total":773094113280,"available":770563874816,"internally_reserved":0,"allocated":8347648,"data_stored":4060800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2521825280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-15864,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-51,"num_read_kb":-50,"num_write":-77,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":-10,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.849627"},"pg_stats":[{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277016+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297569+0000","last_change":"2024-01-22T05:09:52.297569+0000","last_active":"2024-01-22T05:09:52.297569+0000","last_peered":"2024-01-22T05:09:52.297569+0000","last_clean":"2024-01-22T05:09:52.297569+0000","last_became_active":"2024-01-22T05:09:52.297023+0000","last_became_peered":"2024-01-22T05:09:52.297023+0000","last_unstale":"2024-01-22T05:09:52.297569+0000","last_undegraded":"2024-01-22T05:09:52.297569+0000","last_fullsized":"2024-01-22T05:09:52.297569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271591+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305592+0000","last_change":"2024-01-22T05:09:52.305592+0000","last_active":"2024-01-22T05:09:52.305592+0000","last_peered":"2024-01-22T05:09:52.305592+0000","last_clean":"2024-01-22T05:09:52.305592+0000","last_became_active":"2024-01-22T05:09:52.305284+0000","last_became_peered":"2024-01-22T05:09:52.305284+0000","last_unstale":"2024-01-22T05:09:52.305592+0000","last_undegraded":"2024-01-22T05:09:52.305592+0000","last_fullsized":"2024-01-22T05:09:52.305592+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279637+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303731+0000","last_change":"2024-01-22T05:09:52.303731+0000","last_active":"2024-01-22T05:09:52.303731+0000","last_peered":"2024-01-22T05:09:52.303731+0000","last_clean":"2024-01-22T05:09:52.303731+0000","last_became_active":"2024-01-22T05:09:52.303433+0000","last_became_peered":"2024-01-22T05:09:52.303433+0000","last_unstale":"2024-01-22T05:09:52.303731+0000","last_undegraded":"2024-01-22T05:09:52.303731+0000","last_fullsized":"2024-01-22T05:09:52.303731+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274093+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297327+0000","last_change":"2024-01-22T05:09:52.297327+0000","last_active":"2024-01-22T05:09:52.297327+0000","last_peered":"2024-01-22T05:09:52.297327+0000","last_clean":"2024-01-22T05:09:52.297327+0000","last_became_active":"2024-01-22T05:09:52.295607+0000","last_became_peered":"2024-01-22T05:09:52.295607+0000","last_unstale":"2024-01-22T05:09:52.297327+0000","last_undegraded":"2024-01-22T05:09:52.297327+0000","last_fullsized":"2024-01-22T05:09:52.297327+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.270677+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.291300+0000","last_change":"2024-01-22T05:09:52.291300+0000","last_active":"2024-01-22T05:09:52.291300+0000","last_peered":"2024-01-22T05:09:52.291300+0000","last_clean":"2024-01-22T05:09:52.291300+0000","last_became_active":"2024-01-22T05:09:52.291020+0000","last_became_peered":"2024-01-22T05:09:52.291020+0000","last_unstale":"2024-01-22T05:09:52.291300+0000","last_undegraded":"2024-01-22T05:09:52.291300+0000","last_fullsized":"2024-01-22T05:09:52.291300+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.281395+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.306892+0000","last_change":"2024-01-22T05:09:52.306892+0000","last_active":"2024-01-22T05:09:52.306892+0000","last_peered":"2024-01-22T05:09:52.306892+0000","last_clean":"2024-01-22T05:09:52.306892+0000","last_became_active":"2024-01-22T05:09:52.305890+0000","last_became_peered":"2024-01-22T05:09:52.305890+0000","last_unstale":"2024-01-22T05:09:52.306892+0000","last_undegraded":"2024-01-22T05:09:52.306892+0000","last_fullsized":"2024-01-22T05:09:52.306892+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.268616+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.286515+0000","last_change":"2024-01-22T05:09:52.286515+0000","last_active":"2024-01-22T05:09:52.286515+0000","last_peered":"2024-01-22T05:09:52.286515+0000","last_clean":"2024-01-22T05:09:52.286515+0000","last_became_active":"2024-01-22T05:09:52.286243+0000","last_became_peered":"2024-01-22T05:09:52.286243+0000","last_unstale":"2024-01-22T05:09:52.286515+0000","last_undegraded":"2024-01-22T05:09:52.286515+0000","last_fullsized":"2024-01-22T05:09:52.286515+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.282349+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.286766+0000","last_change":"2024-01-22T05:09:52.286766+0000","last_active":"2024-01-22T05:09:52.286766+0000","last_peered":"2024-01-22T05:09:52.286766+0000","last_clean":"2024-01-22T05:09:52.286766+0000","last_became_active":"2024-01-22T05:09:52.286407+0000","last_became_peered":"2024-01-22T05:09:52.286407+0000","last_unstale":"2024-01-22T05:09:52.286766+0000","last_undegraded":"2024-01-22T05:09:52.286766+0000","last_fullsized":"2024-01-22T05:09:52.286766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269001+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.304066+0000","last_change":"2024-01-22T05:09:52.304066+0000","last_active":"2024-01-22T05:09:52.304066+0000","last_peered":"2024-01-22T05:09:52.304066+0000","last_clean":"2024-01-22T05:09:52.304066+0000","last_became_active":"2024-01-22T05:09:52.303591+0000","last_became_peered":"2024-01-22T05:09:52.303591+0000","last_unstale":"2024-01-22T05:09:52.304066+0000","last_undegraded":"2024-01-22T05:09:52.304066+0000","last_fullsized":"2024-01-22T05:09:52.304066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271327+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.286587+0000","last_change":"2024-01-22T05:09:52.286587+0000","last_active":"2024-01-22T05:09:52.286587+0000","last_peered":"2024-01-22T05:09:52.286587+0000","last_clean":"2024-01-22T05:09:52.286587+0000","last_became_active":"2024-01-22T05:09:52.286312+0000","last_became_peered":"2024-01-22T05:09:52.286312+0000","last_unstale":"2024-01-22T05:09:52.286587+0000","last_undegraded":"2024-01-22T05:09:52.286587+0000","last_fullsized":"2024-01-22T05:09:52.286587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266270+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.308814+0000","last_change":"2024-01-22T05:09:52.308814+0000","last_active":"2024-01-22T05:09:52.308814+0000","last_peered":"2024-01-22T05:09:52.308814+0000","last_clean":"2024-01-22T05:09:52.308814+0000","last_became_active":"2024-01-22T05:09:52.307354+0000","last_became_peered":"2024-01-22T05:09:52.307354+0000","last_unstale":"2024-01-22T05:09:52.308814+0000","last_undegraded":"2024-01-22T05:09:52.308814+0000","last_fullsized":"2024-01-22T05:09:52.308814+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274514+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.312051+0000","last_change":"2024-01-22T05:09:52.312051+0000","last_active":"2024-01-22T05:09:52.312051+0000","last_peered":"2024-01-22T05:09:52.312051+0000","last_clean":"2024-01-22T05:09:52.312051+0000","last_became_active":"2024-01-22T05:09:52.311745+0000","last_became_peered":"2024-01-22T05:09:52.311745+0000","last_unstale":"2024-01-22T05:09:52.312051+0000","last_undegraded":"2024-01-22T05:09:52.312051+0000","last_fullsized":"2024-01-22T05:09:52.312051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279455+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.291159+0000","last_change":"2024-01-22T05:09:52.291159+0000","last_active":"2024-01-22T05:09:52.291159+0000","last_peered":"2024-01-22T05:09:52.291159+0000","last_clean":"2024-01-22T05:09:52.291159+0000","last_became_active":"2024-01-22T05:09:52.289670+0000","last_became_peered":"2024-01-22T05:09:52.289670+0000","last_unstale":"2024-01-22T05:09:52.291159+0000","last_undegraded":"2024-01-22T05:09:52.291159+0000","last_fullsized":"2024-01-22T05:09:52.291159+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280256+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.307125+0000","last_change":"2024-01-22T05:09:52.307125+0000","last_active":"2024-01-22T05:09:52.307125+0000","last_peered":"2024-01-22T05:09:52.307125+0000","last_clean":"2024-01-22T05:09:52.307125+0000","last_became_active":"2024-01-22T05:09:52.306261+0000","last_became_peered":"2024-01-22T05:09:52.306261+0000","last_unstale":"2024-01-22T05:09:52.307125+0000","last_undegraded":"2024-01-22T05:09:52.307125+0000","last_fullsized":"2024-01-22T05:09:52.307125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271529+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295635+0000","last_change":"2024-01-22T05:09:52.295635+0000","last_active":"2024-01-22T05:09:52.295635+0000","last_peered":"2024-01-22T05:09:52.295635+0000","last_clean":"2024-01-22T05:09:52.295635+0000","last_became_active":"2024-01-22T05:09:52.295121+0000","last_became_peered":"2024-01-22T05:09:52.295121+0000","last_unstale":"2024-01-22T05:09:52.295635+0000","last_undegraded":"2024-01-22T05:09:52.295635+0000","last_fullsized":"2024-01-22T05:09:52.295635+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279817+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.291201+0000","last_change":"2024-01-22T05:09:52.291201+0000","last_active":"2024-01-22T05:09:52.291201+0000","last_peered":"2024-01-22T05:09:52.291201+0000","last_clean":"2024-01-22T05:09:52.291201+0000","last_became_active":"2024-01-22T05:09:52.290840+0000","last_became_peered":"2024-01-22T05:09:52.290840+0000","last_unstale":"2024-01-22T05:09:52.291201+0000","last_undegraded":"2024-01-22T05:09:52.291201+0000","last_fullsized":"2024-01-22T05:09:52.291201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277451+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.282950+0000","last_change":"2024-01-22T05:09:52.282950+0000","last_active":"2024-01-22T05:09:52.282950+0000","last_peered":"2024-01-22T05:09:52.282950+0000","last_clean":"2024-01-22T05:09:52.282950+0000","last_became_active":"2024-01-22T05:09:52.279776+0000","last_became_peered":"2024-01-22T05:09:52.279776+0000","last_unstale":"2024-01-22T05:09:52.282950+0000","last_undegraded":"2024-01-22T05:09:52.282950+0000","last_fullsized":"2024-01-22T05:09:52.282950+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.275271+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.298678+0000","last_change":"2024-01-22T05:09:52.298678+0000","last_active":"2024-01-22T05:09:52.298678+0000","last_peered":"2024-01-22T05:09:52.298678+0000","last_clean":"2024-01-22T05:09:52.298678+0000","last_became_active":"2024-01-22T05:09:52.298186+0000","last_became_peered":"2024-01-22T05:09:52.298186+0000","last_unstale":"2024-01-22T05:09:52.298678+0000","last_undegraded":"2024-01-22T05:09:52.298678+0000","last_fullsized":"2024-01-22T05:09:52.298678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276211+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285820+0000","last_change":"2024-01-22T05:09:52.285820+0000","last_active":"2024-01-22T05:09:52.285820+0000","last_peered":"2024-01-22T05:09:52.285820+0000","last_clean":"2024-01-22T05:09:52.285820+0000","last_became_active":"2024-01-22T05:09:52.285492+0000","last_became_peered":"2024-01-22T05:09:52.285492+0000","last_unstale":"2024-01-22T05:09:52.285820+0000","last_undegraded":"2024-01-22T05:09:52.285820+0000","last_fullsized":"2024-01-22T05:09:52.285820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.290731+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.284575+0000","last_change":"2024-01-22T05:09:52.284575+0000","last_active":"2024-01-22T05:09:52.284575+0000","last_peered":"2024-01-22T05:09:52.284575+0000","last_clean":"2024-01-22T05:09:52.284575+0000","last_became_active":"2024-01-22T05:09:52.284312+0000","last_became_peered":"2024-01-22T05:09:52.284312+0000","last_unstale":"2024-01-22T05:09:52.284575+0000","last_undegraded":"2024-01-22T05:09:52.284575+0000","last_fullsized":"2024-01-22T05:09:52.284575+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.272857+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.298825+0000","last_change":"2024-01-22T05:09:52.298825+0000","last_active":"2024-01-22T05:09:52.298825+0000","last_peered":"2024-01-22T05:09:52.298825+0000","last_clean":"2024-01-22T05:09:52.298825+0000","last_became_active":"2024-01-22T05:09:52.298494+0000","last_became_peered":"2024-01-22T05:09:52.298494+0000","last_unstale":"2024-01-22T05:09:52.298825+0000","last_undegraded":"2024-01-22T05:09:52.298825+0000","last_fullsized":"2024-01-22T05:09:52.298825+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276479+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.290456+0000","last_change":"2024-01-22T05:09:52.290456+0000","last_active":"2024-01-22T05:09:52.290456+0000","last_peered":"2024-01-22T05:09:52.290456+0000","last_clean":"2024-01-22T05:09:52.290456+0000","last_became_active":"2024-01-22T05:09:52.288359+0000","last_became_peered":"2024-01-22T05:09:52.288359+0000","last_unstale":"2024-01-22T05:09:52.290456+0000","last_undegraded":"2024-01-22T05:09:52.290456+0000","last_fullsized":"2024-01-22T05:09:52.290456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.278044+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297963+0000","last_change":"2024-01-22T05:09:52.297963+0000","last_active":"2024-01-22T05:09:52.297963+0000","last_peered":"2024-01-22T05:09:52.297963+0000","last_clean":"2024-01-22T05:09:52.297963+0000","last_became_active":"2024-01-22T05:09:52.295129+0000","last_became_peered":"2024-01-22T05:09:52.295129+0000","last_unstale":"2024-01-22T05:09:52.297963+0000","last_undegraded":"2024-01-22T05:09:52.297963+0000","last_fullsized":"2024-01-22T05:09:52.297963+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266650+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.312269+0000","last_change":"2024-01-22T05:09:52.312269+0000","last_active":"2024-01-22T05:09:52.312269+0000","last_peered":"2024-01-22T05:09:52.312269+0000","last_clean":"2024-01-22T05:09:52.312269+0000","last_became_active":"2024-01-22T05:09:52.312009+0000","last_became_peered":"2024-01-22T05:09:52.312009+0000","last_unstale":"2024-01-22T05:09:52.312269+0000","last_undegraded":"2024-01-22T05:09:52.312269+0000","last_fullsized":"2024-01-22T05:09:52.312269+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.275125+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.304546+0000","last_change":"2024-01-22T05:09:52.304546+0000","last_active":"2024-01-22T05:09:52.304546+0000","last_peered":"2024-01-22T05:09:52.304546+0000","last_clean":"2024-01-22T05:09:52.304546+0000","last_became_active":"2024-01-22T05:09:52.302485+0000","last_became_peered":"2024-01-22T05:09:52.302485+0000","last_unstale":"2024-01-22T05:09:52.304546+0000","last_undegraded":"2024-01-22T05:09:52.304546+0000","last_fullsized":"2024-01-22T05:09:52.304546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273801+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305020+0000","last_change":"2024-01-22T05:09:52.305020+0000","last_active":"2024-01-22T05:09:52.305020+0000","last_peered":"2024-01-22T05:09:52.305020+0000","last_clean":"2024-01-22T05:09:52.305020+0000","last_became_active":"2024-01-22T05:09:52.304708+0000","last_became_peered":"2024-01-22T05:09:52.304708+0000","last_unstale":"2024-01-22T05:09:52.305020+0000","last_undegraded":"2024-01-22T05:09:52.305020+0000","last_fullsized":"2024-01-22T05:09:52.305020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.267911+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.293808+0000","last_change":"2024-01-22T05:09:52.293808+0000","last_active":"2024-01-22T05:09:52.293808+0000","last_peered":"2024-01-22T05:09:52.293808+0000","last_clean":"2024-01-22T05:09:52.293808+0000","last_became_active":"2024-01-22T05:09:52.293536+0000","last_became_peered":"2024-01-22T05:09:52.293536+0000","last_unstale":"2024-01-22T05:09:52.293808+0000","last_undegraded":"2024-01-22T05:09:52.293808+0000","last_fullsized":"2024-01-22T05:09:52.293808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.286676+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.296831+0000","last_change":"2024-01-22T05:09:52.296831+0000","last_active":"2024-01-22T05:09:52.296831+0000","last_peered":"2024-01-22T05:09:52.296831+0000","last_clean":"2024-01-22T05:09:52.296831+0000","last_became_active":"2024-01-22T05:09:52.295639+0000","last_became_peered":"2024-01-22T05:09:52.295639+0000","last_unstale":"2024-01-22T05:09:52.296831+0000","last_undegraded":"2024-01-22T05:09:52.296831+0000","last_fullsized":"2024-01-22T05:09:52.296831+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273600+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303111+0000","last_change":"2024-01-22T05:09:52.303111+0000","last_active":"2024-01-22T05:09:52.303111+0000","last_peered":"2024-01-22T05:09:52.303111+0000","last_clean":"2024-01-22T05:09:52.303111+0000","last_became_active":"2024-01-22T05:09:52.302809+0000","last_became_peered":"2024-01-22T05:09:52.302809+0000","last_unstale":"2024-01-22T05:09:52.303111+0000","last_undegraded":"2024-01-22T05:09:52.303111+0000","last_fullsized":"2024-01-22T05:09:52.303111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.275160+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.304360+0000","last_change":"2024-01-22T05:09:52.304360+0000","last_active":"2024-01-22T05:09:52.304360+0000","last_peered":"2024-01-22T05:09:52.304360+0000","last_clean":"2024-01-22T05:09:52.304360+0000","last_became_active":"2024-01-22T05:09:52.304061+0000","last_became_peered":"2024-01-22T05:09:52.304061+0000","last_unstale":"2024-01-22T05:09:52.304360+0000","last_undegraded":"2024-01-22T05:09:52.304360+0000","last_fullsized":"2024-01-22T05:09:52.304360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266055+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287508+0000","last_change":"2024-01-22T05:09:52.287508+0000","last_active":"2024-01-22T05:09:52.287508+0000","last_peered":"2024-01-22T05:09:52.287508+0000","last_clean":"2024-01-22T05:09:52.287508+0000","last_became_active":"2024-01-22T05:09:52.287047+0000","last_became_peered":"2024-01-22T05:09:52.287047+0000","last_unstale":"2024-01-22T05:09:52.287508+0000","last_undegraded":"2024-01-22T05:09:52.287508+0000","last_fullsized":"2024-01-22T05:09:52.287508+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271032+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297212+0000","last_change":"2024-01-22T05:09:52.297212+0000","last_active":"2024-01-22T05:09:52.297212+0000","last_peered":"2024-01-22T05:09:52.297212+0000","last_clean":"2024-01-22T05:09:52.297212+0000","last_became_active":"2024-01-22T05:09:52.296894+0000","last_became_peered":"2024-01-22T05:09:52.296894+0000","last_unstale":"2024-01-22T05:09:52.297212+0000","last_undegraded":"2024-01-22T05:09:52.297212+0000","last_fullsized":"2024-01-22T05:09:52.297212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.283716+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285779+0000","last_change":"2024-01-22T05:09:52.285779+0000","last_active":"2024-01-22T05:09:52.285779+0000","last_peered":"2024-01-22T05:09:52.285779+0000","last_clean":"2024-01-22T05:09:52.285779+0000","last_became_active":"2024-01-22T05:09:52.285085+0000","last_became_peered":"2024-01-22T05:09:52.285085+0000","last_unstale":"2024-01-22T05:09:52.285779+0000","last_undegraded":"2024-01-22T05:09:52.285779+0000","last_fullsized":"2024-01-22T05:09:52.285779+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.268712+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.293180+0000","last_change":"2024-01-22T05:09:52.293180+0000","last_active":"2024-01-22T05:09:52.293180+0000","last_peered":"2024-01-22T05:09:52.293180+0000","last_clean":"2024-01-22T05:09:52.293180+0000","last_became_active":"2024-01-22T05:09:52.292510+0000","last_became_peered":"2024-01-22T05:09:52.292510+0000","last_unstale":"2024-01-22T05:09:52.293180+0000","last_undegraded":"2024-01-22T05:09:52.293180+0000","last_fullsized":"2024-01-22T05:09:52.293180+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.267373+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.306492+0000","last_change":"2024-01-22T05:09:52.306492+0000","last_active":"2024-01-22T05:09:52.306492+0000","last_peered":"2024-01-22T05:09:52.306492+0000","last_clean":"2024-01-22T05:09:52.306492+0000","last_became_active":"2024-01-22T05:09:52.306048+0000","last_became_peered":"2024-01-22T05:09:52.306048+0000","last_unstale":"2024-01-22T05:09:52.306492+0000","last_undegraded":"2024-01-22T05:09:52.306492+0000","last_fullsized":"2024-01-22T05:09:52.306492+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273484+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.311553+0000","last_change":"2024-01-22T05:09:52.311553+0000","last_active":"2024-01-22T05:09:52.311553+0000","last_peered":"2024-01-22T05:09:52.311553+0000","last_clean":"2024-01-22T05:09:52.311553+0000","last_became_active":"2024-01-22T05:09:52.307278+0000","last_became_peered":"2024-01-22T05:09:52.307278+0000","last_unstale":"2024-01-22T05:09:52.311553+0000","last_undegraded":"2024-01-22T05:09:52.311553+0000","last_fullsized":"2024-01-22T05:09:52.311553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274110+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295147+0000","last_change":"2024-01-22T05:09:52.295147+0000","last_active":"2024-01-22T05:09:52.295147+0000","last_peered":"2024-01-22T05:09:52.295147+0000","last_clean":"2024-01-22T05:09:52.295147+0000","last_became_active":"2024-01-22T05:09:52.294863+0000","last_became_peered":"2024-01-22T05:09:52.294863+0000","last_unstale":"2024-01-22T05:09:52.295147+0000","last_undegraded":"2024-01-22T05:09:52.295147+0000","last_fullsized":"2024-01-22T05:09:52.295147+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280924+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.293685+0000","last_change":"2024-01-22T05:09:52.293685+0000","last_active":"2024-01-22T05:09:52.293685+0000","last_peered":"2024-01-22T05:09:52.293685+0000","last_clean":"2024-01-22T05:09:52.293685+0000","last_became_active":"2024-01-22T05:09:52.292089+0000","last_became_peered":"2024-01-22T05:09:52.292089+0000","last_unstale":"2024-01-22T05:09:52.293685+0000","last_undegraded":"2024-01-22T05:09:52.293685+0000","last_fullsized":"2024-01-22T05:09:52.293685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273548+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305465+0000","last_change":"2024-01-22T05:09:52.305465+0000","last_active":"2024-01-22T05:09:52.305465+0000","last_peered":"2024-01-22T05:09:52.305465+0000","last_clean":"2024-01-22T05:09:52.305465+0000","last_became_active":"2024-01-22T05:09:52.305188+0000","last_became_peered":"2024-01-22T05:09:52.305188+0000","last_unstale":"2024-01-22T05:09:52.305465+0000","last_undegraded":"2024-01-22T05:09:52.305465+0000","last_fullsized":"2024-01-22T05:09:52.305465+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277473+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.299261+0000","last_change":"2024-01-22T05:09:52.299261+0000","last_active":"2024-01-22T05:09:52.299261+0000","last_peered":"2024-01-22T05:09:52.299261+0000","last_clean":"2024-01-22T05:09:52.299261+0000","last_became_active":"2024-01-22T05:09:52.298981+0000","last_became_peered":"2024-01-22T05:09:52.298981+0000","last_unstale":"2024-01-22T05:09:52.299261+0000","last_undegraded":"2024-01-22T05:09:52.299261+0000","last_fullsized":"2024-01-22T05:09:52.299261+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277585+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295858+0000","last_change":"2024-01-22T05:09:52.295858+0000","last_active":"2024-01-22T05:09:52.295858+0000","last_peered":"2024-01-22T05:09:52.295858+0000","last_clean":"2024-01-22T05:09:52.295858+0000","last_became_active":"2024-01-22T05:09:52.295611+0000","last_became_peered":"2024-01-22T05:09:52.295611+0000","last_unstale":"2024-01-22T05:09:52.295858+0000","last_undegraded":"2024-01-22T05:09:52.295858+0000","last_fullsized":"2024-01-22T05:09:52.295858+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269623+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.290933+0000","last_change":"2024-01-22T05:09:52.290933+0000","last_active":"2024-01-22T05:09:52.290933+0000","last_peered":"2024-01-22T05:09:52.290933+0000","last_clean":"2024-01-22T05:09:52.290933+0000","last_became_active":"2024-01-22T05:09:52.290628+0000","last_became_peered":"2024-01-22T05:09:52.290628+0000","last_unstale":"2024-01-22T05:09:52.290933+0000","last_undegraded":"2024-01-22T05:09:52.290933+0000","last_fullsized":"2024-01-22T05:09:52.290933+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.285033+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.292061+0000","last_change":"2024-01-22T05:09:52.292061+0000","last_active":"2024-01-22T05:09:52.292061+0000","last_peered":"2024-01-22T05:09:52.292061+0000","last_clean":"2024-01-22T05:09:52.292061+0000","last_became_active":"2024-01-22T05:09:52.291734+0000","last_became_peered":"2024-01-22T05:09:52.291734+0000","last_unstale":"2024-01-22T05:09:52.292061+0000","last_undegraded":"2024-01-22T05:09:52.292061+0000","last_fullsized":"2024-01-22T05:09:52.292061+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280058+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303771+0000","last_change":"2024-01-22T05:09:52.303771+0000","last_active":"2024-01-22T05:09:52.303771+0000","last_peered":"2024-01-22T05:09:52.303771+0000","last_clean":"2024-01-22T05:09:52.303771+0000","last_became_active":"2024-01-22T05:09:52.303433+0000","last_became_peered":"2024-01-22T05:09:52.303433+0000","last_unstale":"2024-01-22T05:09:52.303771+0000","last_undegraded":"2024-01-22T05:09:52.303771+0000","last_fullsized":"2024-01-22T05:09:52.303771+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274421+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303933+0000","last_change":"2024-01-22T05:09:52.303933+0000","last_active":"2024-01-22T05:09:52.303933+0000","last_peered":"2024-01-22T05:09:52.303933+0000","last_clean":"2024-01-22T05:09:52.303933+0000","last_became_active":"2024-01-22T05:09:52.303636+0000","last_became_peered":"2024-01-22T05:09:52.303636+0000","last_unstale":"2024-01-22T05:09:52.303933+0000","last_undegraded":"2024-01-22T05:09:52.303933+0000","last_fullsized":"2024-01-22T05:09:52.303933+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279808+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.307313+0000","last_change":"2024-01-22T05:09:52.307313+0000","last_active":"2024-01-22T05:09:52.307313+0000","last_peered":"2024-01-22T05:09:52.307313+0000","last_clean":"2024-01-22T05:09:52.307313+0000","last_became_active":"2024-01-22T05:09:52.306595+0000","last_became_peered":"2024-01-22T05:09:52.306595+0000","last_unstale":"2024-01-22T05:09:52.307313+0000","last_undegraded":"2024-01-22T05:09:52.307313+0000","last_fullsized":"2024-01-22T05:09:52.307313+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.272936+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295140+0000","last_change":"2024-01-22T05:09:52.295140+0000","last_active":"2024-01-22T05:09:52.295140+0000","last_peered":"2024-01-22T05:09:52.295140+0000","last_clean":"2024-01-22T05:09:52.295140+0000","last_became_active":"2024-01-22T05:09:52.294851+0000","last_became_peered":"2024-01-22T05:09:52.294851+0000","last_unstale":"2024-01-22T05:09:52.295140+0000","last_undegraded":"2024-01-22T05:09:52.295140+0000","last_fullsized":"2024-01-22T05:09:52.295140+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273378+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.301225+0000","last_change":"2024-01-22T05:09:52.301225+0000","last_active":"2024-01-22T05:09:52.301225+0000","last_peered":"2024-01-22T05:09:52.301225+0000","last_clean":"2024-01-22T05:09:52.301225+0000","last_became_active":"2024-01-22T05:09:52.300908+0000","last_became_peered":"2024-01-22T05:09:52.300908+0000","last_unstale":"2024-01-22T05:09:52.301225+0000","last_undegraded":"2024-01-22T05:09:52.301225+0000","last_fullsized":"2024-01-22T05:09:52.301225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271848+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287231+0000","last_change":"2024-01-22T05:09:52.287231+0000","last_active":"2024-01-22T05:09:52.287231+0000","last_peered":"2024-01-22T05:09:52.287231+0000","last_clean":"2024-01-22T05:09:52.287231+0000","last_became_active":"2024-01-22T05:09:52.286426+0000","last_became_peered":"2024-01-22T05:09:52.286426+0000","last_unstale":"2024-01-22T05:09:52.287231+0000","last_undegraded":"2024-01-22T05:09:52.287231+0000","last_fullsized":"2024-01-22T05:09:52.287231+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274230+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305843+0000","last_change":"2024-01-22T05:09:52.305843+0000","last_active":"2024-01-22T05:09:52.305843+0000","last_peered":"2024-01-22T05:09:52.305843+0000","last_clean":"2024-01-22T05:09:52.305843+0000","last_became_active":"2024-01-22T05:09:52.305568+0000","last_became_peered":"2024-01-22T05:09:52.305568+0000","last_unstale":"2024-01-22T05:09:52.305843+0000","last_undegraded":"2024-01-22T05:09:52.305843+0000","last_fullsized":"2024-01-22T05:09:52.305843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266819+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285803+0000","last_change":"2024-01-22T05:09:52.285803+0000","last_active":"2024-01-22T05:09:52.285803+0000","last_peered":"2024-01-22T05:09:52.285803+0000","last_clean":"2024-01-22T05:09:52.285803+0000","last_became_active":"2024-01-22T05:09:52.285448+0000","last_became_peered":"2024-01-22T05:09:52.285448+0000","last_unstale":"2024-01-22T05:09:52.285803+0000","last_undegraded":"2024-01-22T05:09:52.285803+0000","last_fullsized":"2024-01-22T05:09:52.285803+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280591+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287765+0000","last_change":"2024-01-22T05:09:52.287765+0000","last_active":"2024-01-22T05:09:52.287765+0000","last_peered":"2024-01-22T05:09:52.287765+0000","last_clean":"2024-01-22T05:09:52.287765+0000","last_became_active":"2024-01-22T05:09:52.287495+0000","last_became_peered":"2024-01-22T05:09:52.287495+0000","last_unstale":"2024-01-22T05:09:52.287765+0000","last_undegraded":"2024-01-22T05:09:52.287765+0000","last_fullsized":"2024-01-22T05:09:52.287765+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269526+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303069+0000","last_change":"2024-01-22T05:09:52.303069+0000","last_active":"2024-01-22T05:09:52.303069+0000","last_peered":"2024-01-22T05:09:52.303069+0000","last_clean":"2024-01-22T05:09:52.303069+0000","last_became_active":"2024-01-22T05:09:52.302706+0000","last_became_peered":"2024-01-22T05:09:52.302706+0000","last_unstale":"2024-01-22T05:09:52.303069+0000","last_undegraded":"2024-01-22T05:09:52.303069+0000","last_fullsized":"2024-01-22T05:09:52.303069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.284777+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295007+0000","last_change":"2024-01-22T05:09:52.295007+0000","last_active":"2024-01-22T05:09:52.295007+0000","last_peered":"2024-01-22T05:09:52.295007+0000","last_clean":"2024-01-22T05:09:52.295007+0000","last_became_active":"2024-01-22T05:09:52.293628+0000","last_became_peered":"2024-01-22T05:09:52.293628+0000","last_unstale":"2024-01-22T05:09:52.295007+0000","last_undegraded":"2024-01-22T05:09:52.295007+0000","last_fullsized":"2024-01-22T05:09:52.295007+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274617+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287832+0000","last_change":"2024-01-22T05:09:52.287832+0000","last_active":"2024-01-22T05:09:52.287832+0000","last_peered":"2024-01-22T05:09:52.287832+0000","last_clean":"2024-01-22T05:09:52.287832+0000","last_became_active":"2024-01-22T05:09:52.287276+0000","last_became_peered":"2024-01-22T05:09:52.287276+0000","last_unstale":"2024-01-22T05:09:52.287832+0000","last_undegraded":"2024-01-22T05:09:52.287832+0000","last_fullsized":"2024-01-22T05:09:52.287832+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.267332+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.282595+0000","last_change":"2024-01-22T05:09:52.282595+0000","last_active":"2024-01-22T05:09:52.282595+0000","last_peered":"2024-01-22T05:09:52.282595+0000","last_clean":"2024-01-22T05:09:52.282595+0000","last_became_active":"2024-01-22T05:09:52.282317+0000","last_became_peered":"2024-01-22T05:09:52.282317+0000","last_unstale":"2024-01-22T05:09:52.282595+0000","last_undegraded":"2024-01-22T05:09:52.282595+0000","last_fullsized":"2024-01-22T05:09:52.282595+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276297+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.278471+0000","last_change":"2024-01-22T05:09:52.278471+0000","last_active":"2024-01-22T05:09:52.278471+0000","last_peered":"2024-01-22T05:09:52.278471+0000","last_clean":"2024-01-22T05:09:52.278471+0000","last_became_active":"2024-01-22T05:09:52.278138+0000","last_became_peered":"2024-01-22T05:09:52.278138+0000","last_unstale":"2024-01-22T05:09:52.278471+0000","last_undegraded":"2024-01-22T05:09:52.278471+0000","last_fullsized":"2024-01-22T05:09:52.278471+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.259071+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:09:51.259071+0000","last_peered":"2024-01-22T05:09:51.259071+0000","last_clean":"2024-01-22T05:09:51.259071+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:09:51.259071+0000","last_undegraded":"2024-01-22T05:09:51.259071+0000","last_fullsized":"2024-01-22T05:09:51.259071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.270273+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.283612+0000","last_change":"2024-01-22T05:09:52.283612+0000","last_active":"2024-01-22T05:09:52.283612+0000","last_peered":"2024-01-22T05:09:52.283612+0000","last_clean":"2024-01-22T05:09:52.283612+0000","last_became_active":"2024-01-22T05:09:52.283314+0000","last_became_peered":"2024-01-22T05:09:52.283314+0000","last_unstale":"2024-01-22T05:09:52.283612+0000","last_undegraded":"2024-01-22T05:09:52.283612+0000","last_fullsized":"2024-01-22T05:09:52.283612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252669+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:09:51.252669+0000","last_peered":"2024-01-22T05:09:51.252669+0000","last_clean":"2024-01-22T05:09:51.252669+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:09:51.252669+0000","last_undegraded":"2024-01-22T05:09:51.252669+0000","last_fullsized":"2024-01-22T05:09:51.252669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276907+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.288015+0000","last_change":"2024-01-22T05:09:52.288015+0000","last_active":"2024-01-22T05:09:52.288015+0000","last_peered":"2024-01-22T05:09:52.288015+0000","last_clean":"2024-01-22T05:09:52.288015+0000","last_became_active":"2024-01-22T05:09:52.285604+0000","last_became_peered":"2024-01-22T05:09:52.285604+0000","last_unstale":"2024-01-22T05:09:52.288015+0000","last_undegraded":"2024-01-22T05:09:52.288015+0000","last_fullsized":"2024-01-22T05:09:52.288015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.256904+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:09:51.256904+0000","last_peered":"2024-01-22T05:09:51.256904+0000","last_clean":"2024-01-22T05:09:51.256904+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:09:51.256904+0000","last_undegraded":"2024-01-22T05:09:51.256904+0000","last_fullsized":"2024-01-22T05:09:51.256904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269848+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.292815+0000","last_change":"2024-01-22T05:09:52.292815+0000","last_active":"2024-01-22T05:09:52.292815+0000","last_peered":"2024-01-22T05:09:52.292815+0000","last_clean":"2024-01-22T05:09:52.292815+0000","last_became_active":"2024-01-22T05:09:52.292500+0000","last_became_peered":"2024-01-22T05:09:52.292500+0000","last_unstale":"2024-01-22T05:09:52.292815+0000","last_undegraded":"2024-01-22T05:09:52.292815+0000","last_fullsized":"2024-01-22T05:09:52.292815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252447+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:09:51.252447+0000","last_peered":"2024-01-22T05:09:51.252447+0000","last_clean":"2024-01-22T05:09:51.252447+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:09:51.252447+0000","last_undegraded":"2024-01-22T05:09:51.252447+0000","last_fullsized":"2024-01-22T05:09:51.252447+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.281075+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.309505+0000","last_change":"2024-01-22T05:09:52.309505+0000","last_active":"2024-01-22T05:09:52.309505+0000","last_peered":"2024-01-22T05:09:52.309505+0000","last_clean":"2024-01-22T05:09:52.309505+0000","last_became_active":"2024-01-22T05:09:52.305992+0000","last_became_peered":"2024-01-22T05:09:52.305992+0000","last_unstale":"2024-01-22T05:09:52.309505+0000","last_undegraded":"2024-01-22T05:09:52.309505+0000","last_fullsized":"2024-01-22T05:09:52.309505+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252035+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:09:51.252035+0000","last_peered":"2024-01-22T05:09:51.252035+0000","last_clean":"2024-01-22T05:09:51.252035+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:09:51.252035+0000","last_undegraded":"2024-01-22T05:09:51.252035+0000","last_fullsized":"2024-01-22T05:09:51.252035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273491+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285964+0000","last_change":"2024-01-22T05:09:52.285964+0000","last_active":"2024-01-22T05:09:52.285964+0000","last_peered":"2024-01-22T05:09:52.285964+0000","last_clean":"2024-01-22T05:09:52.285964+0000","last_became_active":"2024-01-22T05:09:52.285512+0000","last_became_peered":"2024-01-22T05:09:52.285512+0000","last_unstale":"2024-01-22T05:09:52.285964+0000","last_undegraded":"2024-01-22T05:09:52.285964+0000","last_fullsized":"2024-01-22T05:09:52.285964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.264655+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:09:51.264655+0000","last_peered":"2024-01-22T05:09:51.264655+0000","last_clean":"2024-01-22T05:09:51.264655+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:09:51.264655+0000","last_undegraded":"2024-01-22T05:09:51.264655+0000","last_fullsized":"2024-01-22T05:09:51.264655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271035+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.302187+0000","last_change":"2024-01-22T05:09:52.302187+0000","last_active":"2024-01-22T05:09:52.302187+0000","last_peered":"2024-01-22T05:09:52.302187+0000","last_clean":"2024-01-22T05:09:52.302187+0000","last_became_active":"2024-01-22T05:09:52.301852+0000","last_became_peered":"2024-01-22T05:09:52.301852+0000","last_unstale":"2024-01-22T05:09:52.302187+0000","last_undegraded":"2024-01-22T05:09:52.302187+0000","last_fullsized":"2024-01-22T05:09:52.302187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.256651+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:09:51.256651+0000","last_peered":"2024-01-22T05:09:51.256651+0000","last_clean":"2024-01-22T05:09:51.256651+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:09:51.256651+0000","last_undegraded":"2024-01-22T05:09:51.256651+0000","last_fullsized":"2024-01-22T05:09:51.256651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274572+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295705+0000","last_change":"2024-01-22T05:09:52.295705+0000","last_active":"2024-01-22T05:09:52.295705+0000","last_peered":"2024-01-22T05:09:52.295705+0000","last_clean":"2024-01-22T05:09:52.295705+0000","last_became_active":"2024-01-22T05:09:52.295379+0000","last_became_peered":"2024-01-22T05:09:52.295379+0000","last_unstale":"2024-01-22T05:09:52.295705+0000","last_undegraded":"2024-01-22T05:09:52.295705+0000","last_fullsized":"2024-01-22T05:09:52.295705+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252037+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:09:51.252037+0000","last_peered":"2024-01-22T05:09:51.252037+0000","last_clean":"2024-01-22T05:09:51.252037+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:09:51.252037+0000","last_undegraded":"2024-01-22T05:09:51.252037+0000","last_fullsized":"2024-01-22T05:09:51.252037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":64,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.256760+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:09:51.256760+0000","last_peered":"2024-01-22T05:09:51.256760+0000","last_clean":"2024-01-22T05:09:51.256760+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:09:51.256760+0000","last_undegraded":"2024-01-22T05:09:51.256760+0000","last_fullsized":"2024-01-22T05:09:51.256760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065536,"statfs":{"total":96636764160,"available":96323108864,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.98699999999999999,"15min":1.0409999999999999},"min":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.548},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.71499999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.873}]},{"osd":1,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.04,"15min":0.98799999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.141,"15min":1.1699999999999999},"min":{"1min":0.78400000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5309999999999999,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.2649999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1279999999999999,"15min":1.1060000000000001},"min":{"1min":0.81399999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":2.5150000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.169,"15min":1.173},"min":{"1min":0.79700000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.6719999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.234,"15min":1.236},"min":{"1min":0.90300000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5720000000000001,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.8620000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.21,"15min":1.228},"min":{"1min":0.93999999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.4039999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.1299999999999999,"15min":1.071},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.1879999999999999,"15min":1.1679999999999999},"min":{"1min":1.01,"5min":0.751,"15min":0.751},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":2.077}]},{"osd":5,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.2290000000000001,"15min":1.2010000000000001},"min":{"1min":0.61199999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":2.0110000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.3169999999999999,"15min":1.2330000000000001},"min":{"1min":1.0860000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":3.625,"5min":3.625,"15min":3.625},"last":2.1819999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.256,"15min":1.258},"min":{"1min":0.999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.732,"5min":1.823,"15min":1.823},"last":1.9430000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.379,"15min":1.335},"min":{"1min":1.1140000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.8129999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":2.262}]}]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310412,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061428,"statfs":{"total":96636764160,"available":96318902272,"internally_reserved":0,"allocated":1052672,"data_stored":512874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.794,"15min":1.3340000000000001},"min":{"1min":0.74299999999999999,"5min":0.372,"15min":0.372},"max":{"1min":2.0219999999999998,"5min":77.745000000000005,"15min":77.745000000000005},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1659999999999999,"15min":1.091},"min":{"1min":0.60799999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.7509999999999999,"5min":13.555999999999999,"15min":13.555999999999999},"last":0.71199999999999997}]},{"osd":1,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1499999999999999,"15min":1.0980000000000001},"min":{"1min":0.66000000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3899999999999999,"5min":15.499000000000001,"15min":15.499000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.141,"5min":1.222,"15min":1.2430000000000001},"min":{"1min":0.63600000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.177,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":1.117}]},{"osd":2,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1499999999999999,"15min":1.1599999999999999},"min":{"1min":0.79300000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.9470000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1379999999999999,"15min":1.1220000000000001},"min":{"1min":0.77300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6040000000000001,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.0369999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":2.113,"15min":1.46},"min":{"1min":0.749,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.706,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.2689999999999999,"15min":1.234},"min":{"1min":0.75800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.367,"5min":15.468,"15min":15.468},"last":0.876}]},{"osd":4,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1439999999999999,"15min":1.101},"min":{"1min":0.85499999999999998,"5min":0.495,"15min":0.495},"max":{"1min":1.8200000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":1.29},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.1299999999999999},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.619,"5min":1.649,"15min":1.649},"last":1.149}]},{"osd":5,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.4139999999999999,"15min":1.266},"min":{"1min":0.84599999999999997,"5min":0.624,"15min":0.624},"max":{"1min":1.5800000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.3109999999999999,"15min":1.2849999999999999},"min":{"1min":0.88300000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.4239999999999999,"5min":3.875,"15min":3.875},"last":1.214}]},{"osd":7,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.536,"15min":1.4379999999999999},"min":{"1min":0.89200000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.905,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.895,"15min":1.5840000000000001},"min":{"1min":0.93799999999999994,"5min":0.495,"15min":0.495},"max":{"1min":1.6140000000000001,"5min":63.737000000000002,"15min":63.737000000000002},"last":1.2410000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310400,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061440,"statfs":{"total":96636764160,"available":96318914560,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":0.998,"15min":0.998},"min":{"1min":0.80300000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":2.0609999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.036,"15min":1.105},"min":{"1min":0.70799999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.5680000000000001,"5min":1.571,"15min":1.571},"last":1.377}]},{"osd":1,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.163,"15min":1.2170000000000001},"min":{"1min":1.119,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.516,"5min":1.821,"15min":1.821},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2030000000000001,"15min":1.302},"min":{"1min":0.96599999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5329999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":2.0209999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.1539999999999999,"15min":1.1599999999999999},"min":{"1min":0.86899999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.617,"5min":1.629,"15min":1.629},"last":1.925},{"interface":"front","average":{"1min":1.163,"5min":1.0960000000000001,"15min":1.1419999999999999},"min":{"1min":0.90500000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3680000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.859}]},{"osd":3,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.143,"15min":1.1850000000000001},"min":{"1min":0.83199999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.49,"5min":1.931,"15min":1.931},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.298,"5min":1.22,"15min":1.3029999999999999},"min":{"1min":0.79900000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5509999999999999,"5min":2.266,"15min":2.266},"last":1.506}]},{"osd":4,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1220000000000001,"15min":1.1859999999999999},"min":{"1min":0.82599999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.518,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.226,"15min":1.298},"min":{"1min":0.85499999999999998,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8300000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.798}]},{"osd":6,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.264,"15min":1.343},"min":{"1min":0.879,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6699999999999999,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.8129999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.2749999999999999,"15min":1.3109999999999999},"min":{"1min":0.99299999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7829999999999999,"5min":1.909,"15min":1.909},"last":1.323}]},{"osd":7,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3560000000000001,"15min":1.423},"min":{"1min":0.91100000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.766,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3899999999999999,"15min":1.476},"min":{"1min":1.0589999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.671,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.2290000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310400,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061440,"statfs":{"total":96636764160,"available":96318914560,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.1140000000000001,"15min":1.143},"min":{"1min":0.65800000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6719999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.018},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.133,"15min":1.103},"min":{"1min":0.63400000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.042}]},{"osd":1,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.0569999999999999,"15min":1.0860000000000001},"min":{"1min":0.69399999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.159},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.083,"15min":1.1870000000000001},"min":{"1min":0.66400000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5329999999999999,"5min":2.194,"15min":2.194},"last":1.1819999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.099,"15min":1.091},"min":{"1min":0.68300000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4470000000000001,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":0.876},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.177,"15min":1.272},"min":{"1min":0.78400000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.536,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.099}]},{"osd":3,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.133,"15min":1.1839999999999999},"min":{"1min":0.89100000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.514,"5min":1.589,"15min":1.589},"last":1.01},{"interface":"front","average":{"1min":1.175,"5min":1.1850000000000001,"15min":1.1679999999999999},"min":{"1min":0.81599999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.54,"5min":5.3029999999999999,"15min":5.3029999999999999},"last":0.91100000000000003}]},{"osd":5,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1639999999999999,"15min":1.2170000000000001},"min":{"1min":0.85099999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.667,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.129,"5min":1.1220000000000001,"15min":1.1579999999999999},"min":{"1min":0.84599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.597,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.97299999999999998}]},{"osd":6,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.196,"15min":1.1919999999999999},"min":{"1min":0.85299999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6160000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.278,"5min":1.331,"15min":1.415},"min":{"1min":0.89700000000000002,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.7270000000000001,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.73499999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3220000000000001,"15min":1.3660000000000001},"min":{"1min":0.878,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.833,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.119},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.363,"15min":1.3799999999999999},"min":{"1min":1.0089999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6359999999999999,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":0.83599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310412,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061428,"statfs":{"total":96636764160,"available":96318902272,"internally_reserved":0,"allocated":1052672,"data_stored":512874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.95099999999999996,"15min":0.90500000000000003},"min":{"1min":0.55300000000000005,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4179999999999999,"5min":14.859,"15min":14.859},"last":0.752},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.94399999999999995,"15min":0.88800000000000001},"min":{"1min":0.55700000000000005,"5min":0.317,"15min":0.317},"max":{"1min":1.4119999999999999,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":0.51500000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.874,"15min":0.85599999999999998},"min":{"1min":0.66900000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2110000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.872},{"interface":"front","average":{"1min":1.01,"5min":1,"15min":0.98599999999999999},"min":{"1min":0.63300000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4079999999999999,"5min":5.7519999999999998,"15min":5.7519999999999998},"last":0.85199999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.085,"15min":1.159},"min":{"1min":0.64000000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1799999999999999,"15min":1.194},"min":{"1min":0.72999999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2,"5min":2,"15min":2},"last":1.0589999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.2889999999999999,"15min":1.296},"min":{"1min":0.71299999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.718,"5min":5.016,"15min":5.016},"last":1.23},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3420000000000001,"15min":1.3380000000000001},"min":{"1min":1.0469999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.633,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":1.3089999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3,"15min":1.298},"min":{"1min":1.0169999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.7090000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":1.149},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4830000000000001,"15min":1.345},"min":{"1min":0.94699999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.851,"5min":14.523999999999999,"15min":14.523999999999999},"last":1.1970000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.365,"15min":1.415},"min":{"1min":0.90500000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.752,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.4350000000000001,"15min":1.4219999999999999},"min":{"1min":0.95399999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.7370000000000001,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":1.369}]},{"osd":7,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.405,"15min":1.403},"min":{"1min":0.995,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.861,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":1.27},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.411,"15min":1.427},"min":{"1min":0.97799999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1139999999999999,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":1.2829999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574915,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065536,"statfs":{"total":96636764160,"available":96323108864,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.76000000000000001,"15min":0.75600000000000001},"min":{"1min":0.63600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2709999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.995,"5min":0.85799999999999998,"15min":0.83499999999999996},"min":{"1min":0.62,"5min":0.373,"15min":0.373},"max":{"1min":1.6559999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.99299999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.83199999999999996,"15min":0.80600000000000005},"min":{"1min":0.59399999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.995,"5min":0.91900000000000004,"15min":0.94199999999999995},"min":{"1min":0.755,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2569999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.95899999999999996}]},{"osd":3,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1000000000000001,"15min":1.0669999999999999},"min":{"1min":0.63300000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.79,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.1819999999999999,"15min":1.173},"min":{"1min":0.76600000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.73,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.357}]},{"osd":4,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.254,"15min":1.306},"min":{"1min":1.1890000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5940000000000001,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.1819999999999999,"15min":1.2090000000000001},"min":{"1min":0.93300000000000005,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.694,"5min":1.952,"15min":1.952},"last":1.389}]},{"osd":5,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2130000000000001,"15min":1.196},"min":{"1min":0.88300000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.597,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.266,"15min":1.319},"min":{"1min":1.022,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5629999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.2010000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.2350000000000001,"15min":1.2589999999999999},"min":{"1min":0.97499999999999998,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8360000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.292,"15min":1.2909999999999999},"min":{"1min":1.0389999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.6990000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.224}]},{"osd":7,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.3200000000000001,"15min":1.357},"min":{"1min":1.081,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.867,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.468,"5min":1.405,"15min":1.413},"min":{"1min":1.2050000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.877,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.518}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310400,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061440,"statfs":{"total":96636764160,"available":96318914560,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.90500000000000003,"15min":0.85499999999999998},"min":{"1min":0.69899999999999995,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2230000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.749},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.98899999999999999,"15min":1.0009999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.873,"5min":2.101,"15min":2.101},"last":0.94499999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.98499999999999999,"15min":1.0029999999999999},"min":{"1min":0.63200000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4390000000000001,"5min":1.722,"15min":1.722},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.071,"5min":1.042,"15min":1.03},"min":{"1min":0.64200000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.494,"5min":2.008,"15min":2.008},"last":1.1759999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0569999999999999,"15min":1.0049999999999999},"min":{"1min":0.71699999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":4.665,"15min":4.665},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.89600000000000002,"15min":0.88100000000000001},"min":{"1min":0.58499999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.333,"5min":1.867,"15min":1.867},"last":0.77400000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2210000000000001,"15min":1.206},"min":{"1min":0.92800000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.605,"5min":1.788,"15min":1.788},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2949999999999999,"15min":1.2569999999999999},"min":{"1min":0.96199999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6439999999999999,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":1.1080000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.1930000000000001,"15min":1.1910000000000001},"min":{"1min":0.80000000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.048},{"interface":"front","average":{"1min":1.401,"5min":1.292,"15min":1.278},"min":{"1min":1.0349999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.9430000000000001,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.871}]},{"osd":6,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.83899999999999997,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.74,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.349,"15min":1.3420000000000001},"min":{"1min":0.98599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.893,"5min":2.294,"15min":2.294},"last":1.1579999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.397,"15min":1.379},"min":{"1min":0.92700000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.764,"5min":4.4329999999999998,"15min":4.4329999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":1.0149999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.0329999999999999,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":1.1970000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574915,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065536,"statfs":{"total":96636764160,"available":96323108864,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.6419999999999999,"5min":0.97499999999999998,"15min":0.96399999999999997},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":15.273,"5min":15.273,"15min":15.273},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.91800000000000004,"15min":0.98299999999999998},"min":{"1min":0.51800000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.3149999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.716,"5min":1.1319999999999999,"15min":1.1140000000000001},"min":{"1min":0.56499999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":15.473000000000001,"5min":15.473000000000001,"15min":15.473000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.008,"15min":1.024},"min":{"1min":0.68700000000000006,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.589,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.1259999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":0.99399999999999999,"15min":1.0349999999999999},"min":{"1min":0.59499999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.3970000000000002,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.931,"5min":1.256,"15min":1.25},"min":{"1min":0.71699999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":15.439,"5min":15.439,"15min":15.439},"last":1.375}]},{"osd":4,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2509999999999999,"15min":1.369},"min":{"1min":0.751,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6200000000000001,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.405},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.23,"15min":1.258},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":1.149}]},{"osd":5,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.272,"15min":1.373},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.891,"5min":3.548,"15min":3.548},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.3220000000000001,"15min":1.4159999999999999},"min":{"1min":0.80500000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.2769999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":2.149,"5min":1.51,"15min":1.4870000000000001},"min":{"1min":0.89100000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":15.4,"5min":15.4,"15min":15.4},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.6899999999999999,"5min":1.411,"15min":1.512},"min":{"1min":1.0489999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":7.1349999999999998,"5min":7.1349999999999998,"15min":7.1349999999999998},"last":1.2370000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4279999999999999,"15min":1.621},"min":{"1min":1.1040000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.1080000000000001,"5min":5.29,"15min":5.29},"last":1.486},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.361,"15min":1.4350000000000001},"min":{"1min":0.93400000000000005,"5min":0.752,"15min":0.752},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.4259999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:09:57.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:09:57.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.654+0000 7faf7cc00700 1 Processor -- start 2024-01-22T05:09:57.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.654+0000 7faf7cc00700 1 -- start start 2024-01-22T05:09:57.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.658+0000 7faf7cc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faf78065240 0x7faf780644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:57.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.658+0000 7faf7cc00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7815c7d0 con 0x7faf78065620 2024-01-22T05:09:57.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.658+0000 7faf7cc00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf780c2700 con 0x7faf780649e0 2024-01-22T05:09:57.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.658+0000 7faf7cc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf780c29a0 con 0x7faf78065240 2024-01-22T05:09:57.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.658+0000 7faf75400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faf78065620 0x7faf7815b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45726/0 (socket says 172.21.15.49:45726) 2024-01-22T05:09:57.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.658+0000 7faf75400700 1 -- 172.21.15.49:0/1008727094 learned_addr learned my addr 172.21.15.49:0/1008727094 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:57.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.658+0000 7faf75e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faf78065240 0x7faf780644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:57.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.658+0000 7faf75e00700 1 -- 172.21.15.49:0/1008727094 >> v1:172.21.15.110:6789/0 conn(0x7faf780649e0 legacy=0x7faf7815c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:57.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.658+0000 7faf75e00700 1 -- 172.21.15.49:0/1008727094 >> v1:172.21.15.49:6789/0 conn(0x7faf78065620 legacy=0x7faf7815b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:57.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.658+0000 7faf74a00700 1 -- 172.21.15.49:0/1008727094 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035407656 0 0) 0x7faf780c2700 con 0x7faf780649e0 2024-01-22T05:09:57.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.658+0000 7faf75e00700 1 -- 172.21.15.49:0/1008727094 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf780c2c80 con 0x7faf78065240 2024-01-22T05:09:57.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.658+0000 7faf75e00700 1 --2- 172.21.15.49:0/1008727094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf78065240 0x7faf780644f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7faf68009760 tx=0x7faf68009060).ready entity=mon.1 client_cookie=cf902820c437e1f0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:57.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.662+0000 7faf74a00700 1 -- 172.21.15.49:0/1008727094 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6800f510 con 0x7faf78065240 2024-01-22T05:09:57.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.662+0000 7faf74a00700 1 -- 172.21.15.49:0/1008727094 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6800f670 con 0x7faf78065240 2024-01-22T05:09:57.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.662+0000 7faf74a00700 1 -- 172.21.15.49:0/1008727094 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6800f9f0 con 0x7faf78065240 2024-01-22T05:09:57.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.662+0000 7faf7cc00700 1 -- 172.21.15.49:0/1008727094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf78065240 msgr2=0x7faf780644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:57.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.662+0000 7faf7cc00700 1 --2- 172.21.15.49:0/1008727094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf78065240 0x7faf780644f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7faf68009760 tx=0x7faf68009060).stop 2024-01-22T05:09:57.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.662+0000 7faf7cc00700 1 -- 172.21.15.49:0/1008727094 shutdown_connections 2024-01-22T05:09:57.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.662+0000 7faf7cc00700 1 --2- 172.21.15.49:0/1008727094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf78065240 0x7faf780644f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.662+0000 7faf7cc00700 1 -- 172.21.15.49:0/1008727094 >> 172.21.15.49:0/1008727094 conn(0x7faf780c87f0 msgr2=0x7faf780c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:57.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.662+0000 7faf7cc00700 1 -- 172.21.15.49:0/1008727094 shutdown_connections 2024-01-22T05:09:57.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.662+0000 7faf7cc00700 1 -- 172.21.15.49:0/1008727094 wait complete. 2024-01-22T05:09:57.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.666+0000 7faf7cc00700 1 Processor -- start 2024-01-22T05:09:57.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.666+0000 7faf7cc00700 1 -- start start 2024-01-22T05:09:57.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf7cc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf780649e0 0x7faf78168520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:57.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf7cc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf78065240 0x7faf7816b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:57.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf7cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf78065620 0x7faf780bf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:57.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf7cc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf780a8fc0 con 0x7faf78065620 2024-01-22T05:09:57.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf7cc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf78168a10 con 0x7faf780649e0 2024-01-22T05:09:57.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf7cc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7816b8a0 con 0x7faf78065240 2024-01-22T05:09:57.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf77200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf78065620 0x7faf780bf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:57.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf77200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf78065620 0x7faf780bf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54508/0 (socket says 172.21.15.49:54508) 2024-01-22T05:09:57.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf75e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf780649e0 0x7faf78168520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:57.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf77200700 1 -- 172.21.15.49:0/2678366211 learned_addr learned my addr 172.21.15.49:0/2678366211 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:57.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf75400700 1 --2- 172.21.15.49:0/2678366211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf78065240 0x7faf7816b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:57.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf75e00700 1 -- 172.21.15.49:0/2678366211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf78065240 msgr2=0x7faf7816b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:57.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf75e00700 1 --2- 172.21.15.49:0/2678366211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf78065240 0x7faf7816b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf75e00700 1 -- 172.21.15.49:0/2678366211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf78065620 msgr2=0x7faf780bf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:57.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf75e00700 1 --2- 172.21.15.49:0/2678366211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf78065620 0x7faf780bf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf75e00700 1 -- 172.21.15.49:0/2678366211 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf680092a0 con 0x7faf780649e0 2024-01-22T05:09:57.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf77200700 1 --2- 172.21.15.49:0/2678366211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf78065620 0x7faf780bf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:57.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf75e00700 1 --2- 172.21.15.49:0/2678366211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf780649e0 0x7faf78168520 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7faf780c4770 tx=0x7faf68017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:57.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf6d600700 1 -- 172.21.15.49:0/2678366211 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6800f7e0 con 0x7faf780649e0 2024-01-22T05:09:57.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf6d600700 1 -- 172.21.15.49:0/2678366211 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6800f940 con 0x7faf780649e0 2024-01-22T05:09:57.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf7cc00700 1 -- 172.21.15.49:0/2678366211 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf780c1cc0 con 0x7faf780649e0 2024-01-22T05:09:57.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.670+0000 7faf6d600700 1 -- 172.21.15.49:0/2678366211 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6801a430 con 0x7faf780649e0 2024-01-22T05:09:57.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.674+0000 7faf7cc00700 1 -- 172.21.15.49:0/2678366211 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf780a8970 con 0x7faf780649e0 2024-01-22T05:09:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.674+0000 7faf7cc00700 1 -- 172.21.15.49:0/2678366211 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf78066a10 con 0x7faf780649e0 2024-01-22T05:09:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.674+0000 7faf6d600700 1 -- 172.21.15.49:0/2678366211 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7faf68021020 con 0x7faf780649e0 2024-01-22T05:09:57.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.674+0000 7faf6d600700 1 --2- 172.21.15.49:0/2678366211 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faf5005a540 0x7faf5005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:57.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.674+0000 7faf6d600700 1 -- 172.21.15.49:0/2678366211 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7faf68075d30 con 0x7faf780649e0 2024-01-22T05:09:57.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.678+0000 7faf75400700 1 --2- 172.21.15.49:0/2678366211 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faf5005a540 0x7faf5005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:57.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.678+0000 7faf75400700 1 --2- 172.21.15.49:0/2678366211 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faf5005a540 0x7faf5005ca00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7faf78063560 tx=0x7faf60009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:57.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.682+0000 7faf6d600700 1 -- 172.21.15.49:0/2678366211 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faf78066a10 con 0x7faf780649e0 2024-01-22T05:09:57.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.854+0000 7faf7cc00700 1 -- 172.21.15.49:0/2678366211 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf78066a10 con 0x7faf5005a540 2024-01-22T05:09:57.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.870+0000 7faf6d600700 1 -- 172.21.15.49:0/2678366211 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355771 (secure 0 0 0) 0x7faf78066a10 con 0x7faf5005a540 2024-01-22T05:09:57.878 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:57.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.874+0000 7faf7cc00700 1 -- 172.21.15.49:0/2678366211 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faf5005a540 msgr2=0x7faf5005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.874+0000 7faf7cc00700 1 --2- 172.21.15.49:0/2678366211 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faf5005a540 0x7faf5005ca00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7faf78063560 tx=0x7faf60009040).stop 2024-01-22T05:09:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.874+0000 7faf7cc00700 1 -- 172.21.15.49:0/2678366211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf780649e0 msgr2=0x7faf78168520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.874+0000 7faf7cc00700 1 --2- 172.21.15.49:0/2678366211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf780649e0 0x7faf78168520 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7faf780c4770 tx=0x7faf68017000).stop 2024-01-22T05:09:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.874+0000 7faf7cc00700 1 -- 172.21.15.49:0/2678366211 shutdown_connections 2024-01-22T05:09:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.874+0000 7faf7cc00700 1 --2- 172.21.15.49:0/2678366211 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faf5005a540 0x7faf5005ca00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.874+0000 7faf7cc00700 1 --2- 172.21.15.49:0/2678366211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf78065620 0x7faf780bf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.874+0000 7faf7cc00700 1 --2- 172.21.15.49:0/2678366211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf78065240 0x7faf7816b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.874+0000 7faf7cc00700 1 --2- 172.21.15.49:0/2678366211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf780649e0 0x7faf78168520 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.874+0000 7faf7cc00700 1 -- 172.21.15.49:0/2678366211 >> 172.21.15.49:0/2678366211 conn(0x7faf780c87f0 msgr2=0x7faf780635c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.874+0000 7faf7cc00700 1 -- 172.21.15.49:0/2678366211 shutdown_connections 2024-01-22T05:09:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:57.874+0000 7faf7cc00700 1 -- 172.21.15.49:0/2678366211 wait complete. 2024-01-22T05:09:57.883 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:09:57.901 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2024-01-22T05:09:57.342634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470936,"kb_used_data":8152,"kb_used_omap":0,"kb_used_meta":2462720,"kb_avail":752503784,"statfs":{"total":773094113280,"available":770563874816,"internally_reserved":0,"allocated":8347648,"data_stored":4060800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2521825280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-15864,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-51,"num_read_kb":-50,"num_write":-77,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":-10,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.849627"},"pg_stats":[{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277016+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297569+0000","last_change":"2024-01-22T05:09:52.297569+0000","last_active":"2024-01-22T05:09:52.297569+0000","last_peered":"2024-01-22T05:09:52.297569+0000","last_clean":"2024-01-22T05:09:52.297569+0000","last_became_active":"2024-01-22T05:09:52.297023+0000","last_became_peered":"2024-01-22T05:09:52.297023+0000","last_unstale":"2024-01-22T05:09:52.297569+0000","last_undegraded":"2024-01-22T05:09:52.297569+0000","last_fullsized":"2024-01-22T05:09:52.297569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271591+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305592+0000","last_change":"2024-01-22T05:09:52.305592+0000","last_active":"2024-01-22T05:09:52.305592+0000","last_peered":"2024-01-22T05:09:52.305592+0000","last_clean":"2024-01-22T05:09:52.305592+0000","last_became_active":"2024-01-22T05:09:52.305284+0000","last_became_peered":"2024-01-22T05:09:52.305284+0000","last_unstale":"2024-01-22T05:09:52.305592+0000","last_undegraded":"2024-01-22T05:09:52.305592+0000","last_fullsized":"2024-01-22T05:09:52.305592+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279637+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303731+0000","last_change":"2024-01-22T05:09:52.303731+0000","last_active":"2024-01-22T05:09:52.303731+0000","last_peered":"2024-01-22T05:09:52.303731+0000","last_clean":"2024-01-22T05:09:52.303731+0000","last_became_active":"2024-01-22T05:09:52.303433+0000","last_became_peered":"2024-01-22T05:09:52.303433+0000","last_unstale":"2024-01-22T05:09:52.303731+0000","last_undegraded":"2024-01-22T05:09:52.303731+0000","last_fullsized":"2024-01-22T05:09:52.303731+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274093+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297327+0000","last_change":"2024-01-22T05:09:52.297327+0000","last_active":"2024-01-22T05:09:52.297327+0000","last_peered":"2024-01-22T05:09:52.297327+0000","last_clean":"2024-01-22T05:09:52.297327+0000","last_became_active":"2024-01-22T05:09:52.295607+0000","last_became_peered":"2024-01-22T05:09:52.295607+0000","last_unstale":"2024-01-22T05:09:52.297327+0000","last_undegraded":"2024-01-22T05:09:52.297327+0000","last_fullsized":"2024-01-22T05:09:52.297327+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.270677+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.291300+0000","last_change":"2024-01-22T05:09:52.291300+0000","last_active":"2024-01-22T05:09:52.291300+0000","last_peered":"2024-01-22T05:09:52.291300+0000","last_clean":"2024-01-22T05:09:52.291300+0000","last_became_active":"2024-01-22T05:09:52.291020+0000","last_became_peered":"2024-01-22T05:09:52.291020+0000","last_unstale":"2024-01-22T05:09:52.291300+0000","last_undegraded":"2024-01-22T05:09:52.291300+0000","last_fullsized":"2024-01-22T05:09:52.291300+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.281395+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.306892+0000","last_change":"2024-01-22T05:09:52.306892+0000","last_active":"2024-01-22T05:09:52.306892+0000","last_peered":"2024-01-22T05:09:52.306892+0000","last_clean":"2024-01-22T05:09:52.306892+0000","last_became_active":"2024-01-22T05:09:52.305890+0000","last_became_peered":"2024-01-22T05:09:52.305890+0000","last_unstale":"2024-01-22T05:09:52.306892+0000","last_undegraded":"2024-01-22T05:09:52.306892+0000","last_fullsized":"2024-01-22T05:09:52.306892+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.268616+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.286515+0000","last_change":"2024-01-22T05:09:52.286515+0000","last_active":"2024-01-22T05:09:52.286515+0000","last_peered":"2024-01-22T05:09:52.286515+0000","last_clean":"2024-01-22T05:09:52.286515+0000","last_became_active":"2024-01-22T05:09:52.286243+0000","last_became_peered":"2024-01-22T05:09:52.286243+0000","last_unstale":"2024-01-22T05:09:52.286515+0000","last_undegraded":"2024-01-22T05:09:52.286515+0000","last_fullsized":"2024-01-22T05:09:52.286515+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.282349+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.286766+0000","last_change":"2024-01-22T05:09:52.286766+0000","last_active":"2024-01-22T05:09:52.286766+0000","last_peered":"2024-01-22T05:09:52.286766+0000","last_clean":"2024-01-22T05:09:52.286766+0000","last_became_active":"2024-01-22T05:09:52.286407+0000","last_became_peered":"2024-01-22T05:09:52.286407+0000","last_unstale":"2024-01-22T05:09:52.286766+0000","last_undegraded":"2024-01-22T05:09:52.286766+0000","last_fullsized":"2024-01-22T05:09:52.286766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269001+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.304066+0000","last_change":"2024-01-22T05:09:52.304066+0000","last_active":"2024-01-22T05:09:52.304066+0000","last_peered":"2024-01-22T05:09:52.304066+0000","last_clean":"2024-01-22T05:09:52.304066+0000","last_became_active":"2024-01-22T05:09:52.303591+0000","last_became_peered":"2024-01-22T05:09:52.303591+0000","last_unstale":"2024-01-22T05:09:52.304066+0000","last_undegraded":"2024-01-22T05:09:52.304066+0000","last_fullsized":"2024-01-22T05:09:52.304066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271327+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.286587+0000","last_change":"2024-01-22T05:09:52.286587+0000","last_active":"2024-01-22T05:09:52.286587+0000","last_peered":"2024-01-22T05:09:52.286587+0000","last_clean":"2024-01-22T05:09:52.286587+0000","last_became_active":"2024-01-22T05:09:52.286312+0000","last_became_peered":"2024-01-22T05:09:52.286312+0000","last_unstale":"2024-01-22T05:09:52.286587+0000","last_undegraded":"2024-01-22T05:09:52.286587+0000","last_fullsized":"2024-01-22T05:09:52.286587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266270+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.308814+0000","last_change":"2024-01-22T05:09:52.308814+0000","last_active":"2024-01-22T05:09:52.308814+0000","last_peered":"2024-01-22T05:09:52.308814+0000","last_clean":"2024-01-22T05:09:52.308814+0000","last_became_active":"2024-01-22T05:09:52.307354+0000","last_became_peered":"2024-01-22T05:09:52.307354+0000","last_unstale":"2024-01-22T05:09:52.308814+0000","last_undegraded":"2024-01-22T05:09:52.308814+0000","last_fullsized":"2024-01-22T05:09:52.308814+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274514+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.312051+0000","last_change":"2024-01-22T05:09:52.312051+0000","last_active":"2024-01-22T05:09:52.312051+0000","last_peered":"2024-01-22T05:09:52.312051+0000","last_clean":"2024-01-22T05:09:52.312051+0000","last_became_active":"2024-01-22T05:09:52.311745+0000","last_became_peered":"2024-01-22T05:09:52.311745+0000","last_unstale":"2024-01-22T05:09:52.312051+0000","last_undegraded":"2024-01-22T05:09:52.312051+0000","last_fullsized":"2024-01-22T05:09:52.312051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279455+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.291159+0000","last_change":"2024-01-22T05:09:52.291159+0000","last_active":"2024-01-22T05:09:52.291159+0000","last_peered":"2024-01-22T05:09:52.291159+0000","last_clean":"2024-01-22T05:09:52.291159+0000","last_became_active":"2024-01-22T05:09:52.289670+0000","last_became_peered":"2024-01-22T05:09:52.289670+0000","last_unstale":"2024-01-22T05:09:52.291159+0000","last_undegraded":"2024-01-22T05:09:52.291159+0000","last_fullsized":"2024-01-22T05:09:52.291159+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280256+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.307125+0000","last_change":"2024-01-22T05:09:52.307125+0000","last_active":"2024-01-22T05:09:52.307125+0000","last_peered":"2024-01-22T05:09:52.307125+0000","last_clean":"2024-01-22T05:09:52.307125+0000","last_became_active":"2024-01-22T05:09:52.306261+0000","last_became_peered":"2024-01-22T05:09:52.306261+0000","last_unstale":"2024-01-22T05:09:52.307125+0000","last_undegraded":"2024-01-22T05:09:52.307125+0000","last_fullsized":"2024-01-22T05:09:52.307125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271529+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295635+0000","last_change":"2024-01-22T05:09:52.295635+0000","last_active":"2024-01-22T05:09:52.295635+0000","last_peered":"2024-01-22T05:09:52.295635+0000","last_clean":"2024-01-22T05:09:52.295635+0000","last_became_active":"2024-01-22T05:09:52.295121+0000","last_became_peered":"2024-01-22T05:09:52.295121+0000","last_unstale":"2024-01-22T05:09:52.295635+0000","last_undegraded":"2024-01-22T05:09:52.295635+0000","last_fullsized":"2024-01-22T05:09:52.295635+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279817+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.291201+0000","last_change":"2024-01-22T05:09:52.291201+0000","last_active":"2024-01-22T05:09:52.291201+0000","last_peered":"2024-01-22T05:09:52.291201+0000","last_clean":"2024-01-22T05:09:52.291201+0000","last_became_active":"2024-01-22T05:09:52.290840+0000","last_became_peered":"2024-01-22T05:09:52.290840+0000","last_unstale":"2024-01-22T05:09:52.291201+0000","last_undegraded":"2024-01-22T05:09:52.291201+0000","last_fullsized":"2024-01-22T05:09:52.291201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277451+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.282950+0000","last_change":"2024-01-22T05:09:52.282950+0000","last_active":"2024-01-22T05:09:52.282950+0000","last_peered":"2024-01-22T05:09:52.282950+0000","last_clean":"2024-01-22T05:09:52.282950+0000","last_became_active":"2024-01-22T05:09:52.279776+0000","last_became_peered":"2024-01-22T05:09:52.279776+0000","last_unstale":"2024-01-22T05:09:52.282950+0000","last_undegraded":"2024-01-22T05:09:52.282950+0000","last_fullsized":"2024-01-22T05:09:52.282950+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.275271+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.298678+0000","last_change":"2024-01-22T05:09:52.298678+0000","last_active":"2024-01-22T05:09:52.298678+0000","last_peered":"2024-01-22T05:09:52.298678+0000","last_clean":"2024-01-22T05:09:52.298678+0000","last_became_active":"2024-01-22T05:09:52.298186+0000","last_became_peered":"2024-01-22T05:09:52.298186+0000","last_unstale":"2024-01-22T05:09:52.298678+0000","last_undegraded":"2024-01-22T05:09:52.298678+0000","last_fullsized":"2024-01-22T05:09:52.298678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276211+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285820+0000","last_change":"2024-01-22T05:09:52.285820+0000","last_active":"2024-01-22T05:09:52.285820+0000","last_peered":"2024-01-22T05:09:52.285820+0000","last_clean":"2024-01-22T05:09:52.285820+0000","last_became_active":"2024-01-22T05:09:52.285492+0000","last_became_peered":"2024-01-22T05:09:52.285492+0000","last_unstale":"2024-01-22T05:09:52.285820+0000","last_undegraded":"2024-01-22T05:09:52.285820+0000","last_fullsized":"2024-01-22T05:09:52.285820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.290731+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.284575+0000","last_change":"2024-01-22T05:09:52.284575+0000","last_active":"2024-01-22T05:09:52.284575+0000","last_peered":"2024-01-22T05:09:52.284575+0000","last_clean":"2024-01-22T05:09:52.284575+0000","last_became_active":"2024-01-22T05:09:52.284312+0000","last_became_peered":"2024-01-22T05:09:52.284312+0000","last_unstale":"2024-01-22T05:09:52.284575+0000","last_undegraded":"2024-01-22T05:09:52.284575+0000","last_fullsized":"2024-01-22T05:09:52.284575+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.272857+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.298825+0000","last_change":"2024-01-22T05:09:52.298825+0000","last_active":"2024-01-22T05:09:52.298825+0000","last_peered":"2024-01-22T05:09:52.298825+0000","last_clean":"2024-01-22T05:09:52.298825+0000","last_became_active":"2024-01-22T05:09:52.298494+0000","last_became_peered":"2024-01-22T05:09:52.298494+0000","last_unstale":"2024-01-22T05:09:52.298825+0000","last_undegraded":"2024-01-22T05:09:52.298825+0000","last_fullsized":"2024-01-22T05:09:52.298825+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276479+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.290456+0000","last_change":"2024-01-22T05:09:52.290456+0000","last_active":"2024-01-22T05:09:52.290456+0000","last_peered":"2024-01-22T05:09:52.290456+0000","last_clean":"2024-01-22T05:09:52.290456+0000","last_became_active":"2024-01-22T05:09:52.288359+0000","last_became_peered":"2024-01-22T05:09:52.288359+0000","last_unstale":"2024-01-22T05:09:52.290456+0000","last_undegraded":"2024-01-22T05:09:52.290456+0000","last_fullsized":"2024-01-22T05:09:52.290456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.278044+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297963+0000","last_change":"2024-01-22T05:09:52.297963+0000","last_active":"2024-01-22T05:09:52.297963+0000","last_peered":"2024-01-22T05:09:52.297963+0000","last_clean":"2024-01-22T05:09:52.297963+0000","last_became_active":"2024-01-22T05:09:52.295129+0000","last_became_peered":"2024-01-22T05:09:52.295129+0000","last_unstale":"2024-01-22T05:09:52.297963+0000","last_undegraded":"2024-01-22T05:09:52.297963+0000","last_fullsized":"2024-01-22T05:09:52.297963+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266650+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.312269+0000","last_change":"2024-01-22T05:09:52.312269+0000","last_active":"2024-01-22T05:09:52.312269+0000","last_peered":"2024-01-22T05:09:52.312269+0000","last_clean":"2024-01-22T05:09:52.312269+0000","last_became_active":"2024-01-22T05:09:52.312009+0000","last_became_peered":"2024-01-22T05:09:52.312009+0000","last_unstale":"2024-01-22T05:09:52.312269+0000","last_undegraded":"2024-01-22T05:09:52.312269+0000","last_fullsized":"2024-01-22T05:09:52.312269+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.275125+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.304546+0000","last_change":"2024-01-22T05:09:52.304546+0000","last_active":"2024-01-22T05:09:52.304546+0000","last_peered":"2024-01-22T05:09:52.304546+0000","last_clean":"2024-01-22T05:09:52.304546+0000","last_became_active":"2024-01-22T05:09:52.302485+0000","last_became_peered":"2024-01-22T05:09:52.302485+0000","last_unstale":"2024-01-22T05:09:52.304546+0000","last_undegraded":"2024-01-22T05:09:52.304546+0000","last_fullsized":"2024-01-22T05:09:52.304546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273801+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305020+0000","last_change":"2024-01-22T05:09:52.305020+0000","last_active":"2024-01-22T05:09:52.305020+0000","last_peered":"2024-01-22T05:09:52.305020+0000","last_clean":"2024-01-22T05:09:52.305020+0000","last_became_active":"2024-01-22T05:09:52.304708+0000","last_became_peered":"2024-01-22T05:09:52.304708+0000","last_unstale":"2024-01-22T05:09:52.305020+0000","last_undegraded":"2024-01-22T05:09:52.305020+0000","last_fullsized":"2024-01-22T05:09:52.305020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.267911+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.293808+0000","last_change":"2024-01-22T05:09:52.293808+0000","last_active":"2024-01-22T05:09:52.293808+0000","last_peered":"2024-01-22T05:09:52.293808+0000","last_clean":"2024-01-22T05:09:52.293808+0000","last_became_active":"2024-01-22T05:09:52.293536+0000","last_became_peered":"2024-01-22T05:09:52.293536+0000","last_unstale":"2024-01-22T05:09:52.293808+0000","last_undegraded":"2024-01-22T05:09:52.293808+0000","last_fullsized":"2024-01-22T05:09:52.293808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.286676+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.296831+0000","last_change":"2024-01-22T05:09:52.296831+0000","last_active":"2024-01-22T05:09:52.296831+0000","last_peered":"2024-01-22T05:09:52.296831+0000","last_clean":"2024-01-22T05:09:52.296831+0000","last_became_active":"2024-01-22T05:09:52.295639+0000","last_became_peered":"2024-01-22T05:09:52.295639+0000","last_unstale":"2024-01-22T05:09:52.296831+0000","last_undegraded":"2024-01-22T05:09:52.296831+0000","last_fullsized":"2024-01-22T05:09:52.296831+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273600+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303111+0000","last_change":"2024-01-22T05:09:52.303111+0000","last_active":"2024-01-22T05:09:52.303111+0000","last_peered":"2024-01-22T05:09:52.303111+0000","last_clean":"2024-01-22T05:09:52.303111+0000","last_became_active":"2024-01-22T05:09:52.302809+0000","last_became_peered":"2024-01-22T05:09:52.302809+0000","last_unstale":"2024-01-22T05:09:52.303111+0000","last_undegraded":"2024-01-22T05:09:52.303111+0000","last_fullsized":"2024-01-22T05:09:52.303111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.275160+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.304360+0000","last_change":"2024-01-22T05:09:52.304360+0000","last_active":"2024-01-22T05:09:52.304360+0000","last_peered":"2024-01-22T05:09:52.304360+0000","last_clean":"2024-01-22T05:09:52.304360+0000","last_became_active":"2024-01-22T05:09:52.304061+0000","last_became_peered":"2024-01-22T05:09:52.304061+0000","last_unstale":"2024-01-22T05:09:52.304360+0000","last_undegraded":"2024-01-22T05:09:52.304360+0000","last_fullsized":"2024-01-22T05:09:52.304360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266055+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287508+0000","last_change":"2024-01-22T05:09:52.287508+0000","last_active":"2024-01-22T05:09:52.287508+0000","last_peered":"2024-01-22T05:09:52.287508+0000","last_clean":"2024-01-22T05:09:52.287508+0000","last_became_active":"2024-01-22T05:09:52.287047+0000","last_became_peered":"2024-01-22T05:09:52.287047+0000","last_unstale":"2024-01-22T05:09:52.287508+0000","last_undegraded":"2024-01-22T05:09:52.287508+0000","last_fullsized":"2024-01-22T05:09:52.287508+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271032+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297212+0000","last_change":"2024-01-22T05:09:52.297212+0000","last_active":"2024-01-22T05:09:52.297212+0000","last_peered":"2024-01-22T05:09:52.297212+0000","last_clean":"2024-01-22T05:09:52.297212+0000","last_became_active":"2024-01-22T05:09:52.296894+0000","last_became_peered":"2024-01-22T05:09:52.296894+0000","last_unstale":"2024-01-22T05:09:52.297212+0000","last_undegraded":"2024-01-22T05:09:52.297212+0000","last_fullsized":"2024-01-22T05:09:52.297212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.283716+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285779+0000","last_change":"2024-01-22T05:09:52.285779+0000","last_active":"2024-01-22T05:09:52.285779+0000","last_peered":"2024-01-22T05:09:52.285779+0000","last_clean":"2024-01-22T05:09:52.285779+0000","last_became_active":"2024-01-22T05:09:52.285085+0000","last_became_peered":"2024-01-22T05:09:52.285085+0000","last_unstale":"2024-01-22T05:09:52.285779+0000","last_undegraded":"2024-01-22T05:09:52.285779+0000","last_fullsized":"2024-01-22T05:09:52.285779+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.268712+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.293180+0000","last_change":"2024-01-22T05:09:52.293180+0000","last_active":"2024-01-22T05:09:52.293180+0000","last_peered":"2024-01-22T05:09:52.293180+0000","last_clean":"2024-01-22T05:09:52.293180+0000","last_became_active":"2024-01-22T05:09:52.292510+0000","last_became_peered":"2024-01-22T05:09:52.292510+0000","last_unstale":"2024-01-22T05:09:52.293180+0000","last_undegraded":"2024-01-22T05:09:52.293180+0000","last_fullsized":"2024-01-22T05:09:52.293180+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.267373+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.306492+0000","last_change":"2024-01-22T05:09:52.306492+0000","last_active":"2024-01-22T05:09:52.306492+0000","last_peered":"2024-01-22T05:09:52.306492+0000","last_clean":"2024-01-22T05:09:52.306492+0000","last_became_active":"2024-01-22T05:09:52.306048+0000","last_became_peered":"2024-01-22T05:09:52.306048+0000","last_unstale":"2024-01-22T05:09:52.306492+0000","last_undegraded":"2024-01-22T05:09:52.306492+0000","last_fullsized":"2024-01-22T05:09:52.306492+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273484+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.311553+0000","last_change":"2024-01-22T05:09:52.311553+0000","last_active":"2024-01-22T05:09:52.311553+0000","last_peered":"2024-01-22T05:09:52.311553+0000","last_clean":"2024-01-22T05:09:52.311553+0000","last_became_active":"2024-01-22T05:09:52.307278+0000","last_became_peered":"2024-01-22T05:09:52.307278+0000","last_unstale":"2024-01-22T05:09:52.311553+0000","last_undegraded":"2024-01-22T05:09:52.311553+0000","last_fullsized":"2024-01-22T05:09:52.311553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274110+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295147+0000","last_change":"2024-01-22T05:09:52.295147+0000","last_active":"2024-01-22T05:09:52.295147+0000","last_peered":"2024-01-22T05:09:52.295147+0000","last_clean":"2024-01-22T05:09:52.295147+0000","last_became_active":"2024-01-22T05:09:52.294863+0000","last_became_peered":"2024-01-22T05:09:52.294863+0000","last_unstale":"2024-01-22T05:09:52.295147+0000","last_undegraded":"2024-01-22T05:09:52.295147+0000","last_fullsized":"2024-01-22T05:09:52.295147+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280924+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.293685+0000","last_change":"2024-01-22T05:09:52.293685+0000","last_active":"2024-01-22T05:09:52.293685+0000","last_peered":"2024-01-22T05:09:52.293685+0000","last_clean":"2024-01-22T05:09:52.293685+0000","last_became_active":"2024-01-22T05:09:52.292089+0000","last_became_peered":"2024-01-22T05:09:52.292089+0000","last_unstale":"2024-01-22T05:09:52.293685+0000","last_undegraded":"2024-01-22T05:09:52.293685+0000","last_fullsized":"2024-01-22T05:09:52.293685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273548+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305465+0000","last_change":"2024-01-22T05:09:52.305465+0000","last_active":"2024-01-22T05:09:52.305465+0000","last_peered":"2024-01-22T05:09:52.305465+0000","last_clean":"2024-01-22T05:09:52.305465+0000","last_became_active":"2024-01-22T05:09:52.305188+0000","last_became_peered":"2024-01-22T05:09:52.305188+0000","last_unstale":"2024-01-22T05:09:52.305465+0000","last_undegraded":"2024-01-22T05:09:52.305465+0000","last_fullsized":"2024-01-22T05:09:52.305465+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277473+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.299261+0000","last_change":"2024-01-22T05:09:52.299261+0000","last_active":"2024-01-22T05:09:52.299261+0000","last_peered":"2024-01-22T05:09:52.299261+0000","last_clean":"2024-01-22T05:09:52.299261+0000","last_became_active":"2024-01-22T05:09:52.298981+0000","last_became_peered":"2024-01-22T05:09:52.298981+0000","last_unstale":"2024-01-22T05:09:52.299261+0000","last_undegraded":"2024-01-22T05:09:52.299261+0000","last_fullsized":"2024-01-22T05:09:52.299261+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277585+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295858+0000","last_change":"2024-01-22T05:09:52.295858+0000","last_active":"2024-01-22T05:09:52.295858+0000","last_peered":"2024-01-22T05:09:52.295858+0000","last_clean":"2024-01-22T05:09:52.295858+0000","last_became_active":"2024-01-22T05:09:52.295611+0000","last_became_peered":"2024-01-22T05:09:52.295611+0000","last_unstale":"2024-01-22T05:09:52.295858+0000","last_undegraded":"2024-01-22T05:09:52.295858+0000","last_fullsized":"2024-01-22T05:09:52.295858+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269623+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.290933+0000","last_change":"2024-01-22T05:09:52.290933+0000","last_active":"2024-01-22T05:09:52.290933+0000","last_peered":"2024-01-22T05:09:52.290933+0000","last_clean":"2024-01-22T05:09:52.290933+0000","last_became_active":"2024-01-22T05:09:52.290628+0000","last_became_peered":"2024-01-22T05:09:52.290628+0000","last_unstale":"2024-01-22T05:09:52.290933+0000","last_undegraded":"2024-01-22T05:09:52.290933+0000","last_fullsized":"2024-01-22T05:09:52.290933+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.285033+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.292061+0000","last_change":"2024-01-22T05:09:52.292061+0000","last_active":"2024-01-22T05:09:52.292061+0000","last_peered":"2024-01-22T05:09:52.292061+0000","last_clean":"2024-01-22T05:09:52.292061+0000","last_became_active":"2024-01-22T05:09:52.291734+0000","last_became_peered":"2024-01-22T05:09:52.291734+0000","last_unstale":"2024-01-22T05:09:52.292061+0000","last_undegraded":"2024-01-22T05:09:52.292061+0000","last_fullsized":"2024-01-22T05:09:52.292061+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280058+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303771+0000","last_change":"2024-01-22T05:09:52.303771+0000","last_active":"2024-01-22T05:09:52.303771+0000","last_peered":"2024-01-22T05:09:52.303771+0000","last_clean":"2024-01-22T05:09:52.303771+0000","last_became_active":"2024-01-22T05:09:52.303433+0000","last_became_peered":"2024-01-22T05:09:52.303433+0000","last_unstale":"2024-01-22T05:09:52.303771+0000","last_undegraded":"2024-01-22T05:09:52.303771+0000","last_fullsized":"2024-01-22T05:09:52.303771+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274421+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303933+0000","last_change":"2024-01-22T05:09:52.303933+0000","last_active":"2024-01-22T05:09:52.303933+0000","last_peered":"2024-01-22T05:09:52.303933+0000","last_clean":"2024-01-22T05:09:52.303933+0000","last_became_active":"2024-01-22T05:09:52.303636+0000","last_became_peered":"2024-01-22T05:09:52.303636+0000","last_unstale":"2024-01-22T05:09:52.303933+0000","last_undegraded":"2024-01-22T05:09:52.303933+0000","last_fullsized":"2024-01-22T05:09:52.303933+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279808+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.307313+0000","last_change":"2024-01-22T05:09:52.307313+0000","last_active":"2024-01-22T05:09:52.307313+0000","last_peered":"2024-01-22T05:09:52.307313+0000","last_clean":"2024-01-22T05:09:52.307313+0000","last_became_active":"2024-01-22T05:09:52.306595+0000","last_became_peered":"2024-01-22T05:09:52.306595+0000","last_unstale":"2024-01-22T05:09:52.307313+0000","last_undegraded":"2024-01-22T05:09:52.307313+0000","last_fullsized":"2024-01-22T05:09:52.307313+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.272936+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295140+0000","last_change":"2024-01-22T05:09:52.295140+0000","last_active":"2024-01-22T05:09:52.295140+0000","last_peered":"2024-01-22T05:09:52.295140+0000","last_clean":"2024-01-22T05:09:52.295140+0000","last_became_active":"2024-01-22T05:09:52.294851+0000","last_became_peered":"2024-01-22T05:09:52.294851+0000","last_unstale":"2024-01-22T05:09:52.295140+0000","last_undegraded":"2024-01-22T05:09:52.295140+0000","last_fullsized":"2024-01-22T05:09:52.295140+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273378+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.301225+0000","last_change":"2024-01-22T05:09:52.301225+0000","last_active":"2024-01-22T05:09:52.301225+0000","last_peered":"2024-01-22T05:09:52.301225+0000","last_clean":"2024-01-22T05:09:52.301225+0000","last_became_active":"2024-01-22T05:09:52.300908+0000","last_became_peered":"2024-01-22T05:09:52.300908+0000","last_unstale":"2024-01-22T05:09:52.301225+0000","last_undegraded":"2024-01-22T05:09:52.301225+0000","last_fullsized":"2024-01-22T05:09:52.301225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271848+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287231+0000","last_change":"2024-01-22T05:09:52.287231+0000","last_active":"2024-01-22T05:09:52.287231+0000","last_peered":"2024-01-22T05:09:52.287231+0000","last_clean":"2024-01-22T05:09:52.287231+0000","last_became_active":"2024-01-22T05:09:52.286426+0000","last_became_peered":"2024-01-22T05:09:52.286426+0000","last_unstale":"2024-01-22T05:09:52.287231+0000","last_undegraded":"2024-01-22T05:09:52.287231+0000","last_fullsized":"2024-01-22T05:09:52.287231+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274230+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305843+0000","last_change":"2024-01-22T05:09:52.305843+0000","last_active":"2024-01-22T05:09:52.305843+0000","last_peered":"2024-01-22T05:09:52.305843+0000","last_clean":"2024-01-22T05:09:52.305843+0000","last_became_active":"2024-01-22T05:09:52.305568+0000","last_became_peered":"2024-01-22T05:09:52.305568+0000","last_unstale":"2024-01-22T05:09:52.305843+0000","last_undegraded":"2024-01-22T05:09:52.305843+0000","last_fullsized":"2024-01-22T05:09:52.305843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266819+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285803+0000","last_change":"2024-01-22T05:09:52.285803+0000","last_active":"2024-01-22T05:09:52.285803+0000","last_peered":"2024-01-22T05:09:52.285803+0000","last_clean":"2024-01-22T05:09:52.285803+0000","last_became_active":"2024-01-22T05:09:52.285448+0000","last_became_peered":"2024-01-22T05:09:52.285448+0000","last_unstale":"2024-01-22T05:09:52.285803+0000","last_undegraded":"2024-01-22T05:09:52.285803+0000","last_fullsized":"2024-01-22T05:09:52.285803+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280591+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287765+0000","last_change":"2024-01-22T05:09:52.287765+0000","last_active":"2024-01-22T05:09:52.287765+0000","last_peered":"2024-01-22T05:09:52.287765+0000","last_clean":"2024-01-22T05:09:52.287765+0000","last_became_active":"2024-01-22T05:09:52.287495+0000","last_became_peered":"2024-01-22T05:09:52.287495+0000","last_unstale":"2024-01-22T05:09:52.287765+0000","last_undegraded":"2024-01-22T05:09:52.287765+0000","last_fullsized":"2024-01-22T05:09:52.287765+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269526+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303069+0000","last_change":"2024-01-22T05:09:52.303069+0000","last_active":"2024-01-22T05:09:52.303069+0000","last_peered":"2024-01-22T05:09:52.303069+0000","last_clean":"2024-01-22T05:09:52.303069+0000","last_became_active":"2024-01-22T05:09:52.302706+0000","last_became_peered":"2024-01-22T05:09:52.302706+0000","last_unstale":"2024-01-22T05:09:52.303069+0000","last_undegraded":"2024-01-22T05:09:52.303069+0000","last_fullsized":"2024-01-22T05:09:52.303069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.284777+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295007+0000","last_change":"2024-01-22T05:09:52.295007+0000","last_active":"2024-01-22T05:09:52.295007+0000","last_peered":"2024-01-22T05:09:52.295007+0000","last_clean":"2024-01-22T05:09:52.295007+0000","last_became_active":"2024-01-22T05:09:52.293628+0000","last_became_peered":"2024-01-22T05:09:52.293628+0000","last_unstale":"2024-01-22T05:09:52.295007+0000","last_undegraded":"2024-01-22T05:09:52.295007+0000","last_fullsized":"2024-01-22T05:09:52.295007+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274617+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287832+0000","last_change":"2024-01-22T05:09:52.287832+0000","last_active":"2024-01-22T05:09:52.287832+0000","last_peered":"2024-01-22T05:09:52.287832+0000","last_clean":"2024-01-22T05:09:52.287832+0000","last_became_active":"2024-01-22T05:09:52.287276+0000","last_became_peered":"2024-01-22T05:09:52.287276+0000","last_unstale":"2024-01-22T05:09:52.287832+0000","last_undegraded":"2024-01-22T05:09:52.287832+0000","last_fullsized":"2024-01-22T05:09:52.287832+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.267332+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.282595+0000","last_change":"2024-01-22T05:09:52.282595+0000","last_active":"2024-01-22T05:09:52.282595+0000","last_peered":"2024-01-22T05:09:52.282595+0000","last_clean":"2024-01-22T05:09:52.282595+0000","last_became_active":"2024-01-22T05:09:52.282317+0000","last_became_peered":"2024-01-22T05:09:52.282317+0000","last_unstale":"2024-01-22T05:09:52.282595+0000","last_undegraded":"2024-01-22T05:09:52.282595+0000","last_fullsized":"2024-01-22T05:09:52.282595+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276297+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.278471+0000","last_change":"2024-01-22T05:09:52.278471+0000","last_active":"2024-01-22T05:09:52.278471+0000","last_peered":"2024-01-22T05:09:52.278471+0000","last_clean":"2024-01-22T05:09:52.278471+0000","last_became_active":"2024-01-22T05:09:52.278138+0000","last_became_peered":"2024-01-22T05:09:52.278138+0000","last_unstale":"2024-01-22T05:09:52.278471+0000","last_undegraded":"2024-01-22T05:09:52.278471+0000","last_fullsized":"2024-01-22T05:09:52.278471+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.259071+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:09:51.259071+0000","last_peered":"2024-01-22T05:09:51.259071+0000","last_clean":"2024-01-22T05:09:51.259071+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:09:51.259071+0000","last_undegraded":"2024-01-22T05:09:51.259071+0000","last_fullsized":"2024-01-22T05:09:51.259071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.270273+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.283612+0000","last_change":"2024-01-22T05:09:52.283612+0000","last_active":"2024-01-22T05:09:52.283612+0000","last_peered":"2024-01-22T05:09:52.283612+0000","last_clean":"2024-01-22T05:09:52.283612+0000","last_became_active":"2024-01-22T05:09:52.283314+0000","last_became_peered":"2024-01-22T05:09:52.283314+0000","last_unstale":"2024-01-22T05:09:52.283612+0000","last_undegraded":"2024-01-22T05:09:52.283612+0000","last_fullsized":"2024-01-22T05:09:52.283612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252669+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:09:51.252669+0000","last_peered":"2024-01-22T05:09:51.252669+0000","last_clean":"2024-01-22T05:09:51.252669+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:09:51.252669+0000","last_undegraded":"2024-01-22T05:09:51.252669+0000","last_fullsized":"2024-01-22T05:09:51.252669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276907+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.288015+0000","last_change":"2024-01-22T05:09:52.288015+0000","last_active":"2024-01-22T05:09:52.288015+0000","last_peered":"2024-01-22T05:09:52.288015+0000","last_clean":"2024-01-22T05:09:52.288015+0000","last_became_active":"2024-01-22T05:09:52.285604+0000","last_became_peered":"2024-01-22T05:09:52.285604+0000","last_unstale":"2024-01-22T05:09:52.288015+0000","last_undegraded":"2024-01-22T05:09:52.288015+0000","last_fullsized":"2024-01-22T05:09:52.288015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.256904+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:09:51.256904+0000","last_peered":"2024-01-22T05:09:51.256904+0000","last_clean":"2024-01-22T05:09:51.256904+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:09:51.256904+0000","last_undegraded":"2024-01-22T05:09:51.256904+0000","last_fullsized":"2024-01-22T05:09:51.256904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269848+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.292815+0000","last_change":"2024-01-22T05:09:52.292815+0000","last_active":"2024-01-22T05:09:52.292815+0000","last_peered":"2024-01-22T05:09:52.292815+0000","last_clean":"2024-01-22T05:09:52.292815+0000","last_became_active":"2024-01-22T05:09:52.292500+0000","last_became_peered":"2024-01-22T05:09:52.292500+0000","last_unstale":"2024-01-22T05:09:52.292815+0000","last_undegraded":"2024-01-22T05:09:52.292815+0000","last_fullsized":"2024-01-22T05:09:52.292815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252447+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:09:51.252447+0000","last_peered":"2024-01-22T05:09:51.252447+0000","last_clean":"2024-01-22T05:09:51.252447+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:09:51.252447+0000","last_undegraded":"2024-01-22T05:09:51.252447+0000","last_fullsized":"2024-01-22T05:09:51.252447+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.281075+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.309505+0000","last_change":"2024-01-22T05:09:52.309505+0000","last_active":"2024-01-22T05:09:52.309505+0000","last_peered":"2024-01-22T05:09:52.309505+0000","last_clean":"2024-01-22T05:09:52.309505+0000","last_became_active":"2024-01-22T05:09:52.305992+0000","last_became_peered":"2024-01-22T05:09:52.305992+0000","last_unstale":"2024-01-22T05:09:52.309505+0000","last_undegraded":"2024-01-22T05:09:52.309505+0000","last_fullsized":"2024-01-22T05:09:52.309505+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252035+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:09:51.252035+0000","last_peered":"2024-01-22T05:09:51.252035+0000","last_clean":"2024-01-22T05:09:51.252035+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:09:51.252035+0000","last_undegraded":"2024-01-22T05:09:51.252035+0000","last_fullsized":"2024-01-22T05:09:51.252035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273491+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285964+0000","last_change":"2024-01-22T05:09:52.285964+0000","last_active":"2024-01-22T05:09:52.285964+0000","last_peered":"2024-01-22T05:09:52.285964+0000","last_clean":"2024-01-22T05:09:52.285964+0000","last_became_active":"2024-01-22T05:09:52.285512+0000","last_became_peered":"2024-01-22T05:09:52.285512+0000","last_unstale":"2024-01-22T05:09:52.285964+0000","last_undegraded":"2024-01-22T05:09:52.285964+0000","last_fullsized":"2024-01-22T05:09:52.285964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.264655+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:09:51.264655+0000","last_peered":"2024-01-22T05:09:51.264655+0000","last_clean":"2024-01-22T05:09:51.264655+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:09:51.264655+0000","last_undegraded":"2024-01-22T05:09:51.264655+0000","last_fullsized":"2024-01-22T05:09:51.264655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271035+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.302187+0000","last_change":"2024-01-22T05:09:52.302187+0000","last_active":"2024-01-22T05:09:52.302187+0000","last_peered":"2024-01-22T05:09:52.302187+0000","last_clean":"2024-01-22T05:09:52.302187+0000","last_became_active":"2024-01-22T05:09:52.301852+0000","last_became_peered":"2024-01-22T05:09:52.301852+0000","last_unstale":"2024-01-22T05:09:52.302187+0000","last_undegraded":"2024-01-22T05:09:52.302187+0000","last_fullsized":"2024-01-22T05:09:52.302187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.256651+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:09:51.256651+0000","last_peered":"2024-01-22T05:09:51.256651+0000","last_clean":"2024-01-22T05:09:51.256651+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:09:51.256651+0000","last_undegraded":"2024-01-22T05:09:51.256651+0000","last_fullsized":"2024-01-22T05:09:51.256651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274572+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295705+0000","last_change":"2024-01-22T05:09:52.295705+0000","last_active":"2024-01-22T05:09:52.295705+0000","last_peered":"2024-01-22T05:09:52.295705+0000","last_clean":"2024-01-22T05:09:52.295705+0000","last_became_active":"2024-01-22T05:09:52.295379+0000","last_became_peered":"2024-01-22T05:09:52.295379+0000","last_unstale":"2024-01-22T05:09:52.295705+0000","last_undegraded":"2024-01-22T05:09:52.295705+0000","last_fullsized":"2024-01-22T05:09:52.295705+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252037+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:09:51.252037+0000","last_peered":"2024-01-22T05:09:51.252037+0000","last_clean":"2024-01-22T05:09:51.252037+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:09:51.252037+0000","last_undegraded":"2024-01-22T05:09:51.252037+0000","last_fullsized":"2024-01-22T05:09:51.252037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":64,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.256760+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:09:51.256760+0000","last_peered":"2024-01-22T05:09:51.256760+0000","last_clean":"2024-01-22T05:09:51.256760+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:09:51.256760+0000","last_undegraded":"2024-01-22T05:09:51.256760+0000","last_fullsized":"2024-01-22T05:09:51.256760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065536,"statfs":{"total":96636764160,"available":96323108864,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.98699999999999999,"15min":1.0409999999999999},"min":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.548},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.71499999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.873}]},{"osd":1,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.04,"15min":0.98799999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.141,"15min":1.1699999999999999},"min":{"1min":0.78400000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5309999999999999,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.2649999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1279999999999999,"15min":1.1060000000000001},"min":{"1min":0.81399999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":2.5150000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.169,"15min":1.173},"min":{"1min":0.79700000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.6719999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.234,"15min":1.236},"min":{"1min":0.90300000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5720000000000001,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.8620000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.21,"15min":1.228},"min":{"1min":0.93999999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.4039999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.1299999999999999,"15min":1.071},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.1879999999999999,"15min":1.1679999999999999},"min":{"1min":1.01,"5min":0.751,"15min":0.751},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":2.077}]},{"osd":5,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.2290000000000001,"15min":1.2010000000000001},"min":{"1min":0.61199999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":2.0110000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.3169999999999999,"15min":1.2330000000000001},"min":{"1min":1.0860000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":3.625,"5min":3.625,"15min":3.625},"last":2.1819999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.256,"15min":1.258},"min":{"1min":0.999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.732,"5min":1.823,"15min":1.823},"last":1.9430000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.379,"15min":1.335},"min":{"1min":1.1140000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.8129999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":2.262}]}]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310412,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061428,"statfs":{"total":96636764160,"available":96318902272,"internally_reserved":0,"allocated":1052672,"data_stored":512874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.794,"15min":1.3340000000000001},"min":{"1min":0.74299999999999999,"5min":0.372,"15min":0.372},"max":{"1min":2.0219999999999998,"5min":77.745000000000005,"15min":77.745000000000005},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1659999999999999,"15min":1.091},"min":{"1min":0.60799999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.7509999999999999,"5min":13.555999999999999,"15min":13.555999999999999},"last":0.71199999999999997}]},{"osd":1,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1499999999999999,"15min":1.0980000000000001},"min":{"1min":0.66000000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3899999999999999,"5min":15.499000000000001,"15min":15.499000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.141,"5min":1.222,"15min":1.2430000000000001},"min":{"1min":0.63600000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.177,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":1.117}]},{"osd":2,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1499999999999999,"15min":1.1599999999999999},"min":{"1min":0.79300000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.9470000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1379999999999999,"15min":1.1220000000000001},"min":{"1min":0.77300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6040000000000001,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.0369999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":2.113,"15min":1.46},"min":{"1min":0.749,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.706,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.2689999999999999,"15min":1.234},"min":{"1min":0.75800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.367,"5min":15.468,"15min":15.468},"last":0.876}]},{"osd":4,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1439999999999999,"15min":1.101},"min":{"1min":0.85499999999999998,"5min":0.495,"15min":0.495},"max":{"1min":1.8200000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":1.29},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.1299999999999999},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.619,"5min":1.649,"15min":1.649},"last":1.149}]},{"osd":5,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.4139999999999999,"15min":1.266},"min":{"1min":0.84599999999999997,"5min":0.624,"15min":0.624},"max":{"1min":1.5800000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.3109999999999999,"15min":1.2849999999999999},"min":{"1min":0.88300000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.4239999999999999,"5min":3.875,"15min":3.875},"last":1.214}]},{"osd":7,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.536,"15min":1.4379999999999999},"min":{"1min":0.89200000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.905,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.895,"15min":1.5840000000000001},"min":{"1min":0.93799999999999994,"5min":0.495,"15min":0.495},"max":{"1min":1.6140000000000001,"5min":63.737000000000002,"15min":63.737000000000002},"last":1.2410000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310400,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061440,"statfs":{"total":96636764160,"available":96318914560,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":0.998,"15min":0.998},"min":{"1min":0.80300000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":2.0609999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.036,"15min":1.105},"min":{"1min":0.70799999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.5680000000000001,"5min":1.571,"15min":1.571},"last":1.377}]},{"osd":1,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.163,"15min":1.2170000000000001},"min":{"1min":1.119,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.516,"5min":1.821,"15min":1.821},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2030000000000001,"15min":1.302},"min":{"1min":0.96599999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5329999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":2.0209999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.1539999999999999,"15min":1.1599999999999999},"min":{"1min":0.86899999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.617,"5min":1.629,"15min":1.629},"last":1.925},{"interface":"front","average":{"1min":1.163,"5min":1.0960000000000001,"15min":1.1419999999999999},"min":{"1min":0.90500000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3680000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.859}]},{"osd":3,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.143,"15min":1.1850000000000001},"min":{"1min":0.83199999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.49,"5min":1.931,"15min":1.931},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.298,"5min":1.22,"15min":1.3029999999999999},"min":{"1min":0.79900000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5509999999999999,"5min":2.266,"15min":2.266},"last":1.506}]},{"osd":4,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1220000000000001,"15min":1.1859999999999999},"min":{"1min":0.82599999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.518,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.226,"15min":1.298},"min":{"1min":0.85499999999999998,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8300000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.798}]},{"osd":6,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.264,"15min":1.343},"min":{"1min":0.879,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6699999999999999,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.8129999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.2749999999999999,"15min":1.3109999999999999},"min":{"1min":0.99299999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7829999999999999,"5min":1.909,"15min":1.909},"last":1.323}]},{"osd":7,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3560000000000001,"15min":1.423},"min":{"1min":0.91100000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.766,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3899999999999999,"15min":1.476},"min":{"1min":1.0589999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.671,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.2290000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310400,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061440,"statfs":{"total":96636764160,"available":96318914560,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.1140000000000001,"15min":1.143},"min":{"1min":0.65800000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6719999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.018},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.133,"15min":1.103},"min":{"1min":0.63400000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.042}]},{"osd":1,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.0569999999999999,"15min":1.0860000000000001},"min":{"1min":0.69399999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.159},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.083,"15min":1.1870000000000001},"min":{"1min":0.66400000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5329999999999999,"5min":2.194,"15min":2.194},"last":1.1819999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.099,"15min":1.091},"min":{"1min":0.68300000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4470000000000001,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":0.876},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.177,"15min":1.272},"min":{"1min":0.78400000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.536,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.099}]},{"osd":3,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.133,"15min":1.1839999999999999},"min":{"1min":0.89100000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.514,"5min":1.589,"15min":1.589},"last":1.01},{"interface":"front","average":{"1min":1.175,"5min":1.1850000000000001,"15min":1.1679999999999999},"min":{"1min":0.81599999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.54,"5min":5.3029999999999999,"15min":5.3029999999999999},"last":0.91100000000000003}]},{"osd":5,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1639999999999999,"15min":1.2170000000000001},"min":{"1min":0.85099999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.667,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.129,"5min":1.1220000000000001,"15min":1.1579999999999999},"min":{"1min":0.84599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.597,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.97299999999999998}]},{"osd":6,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.196,"15min":1.1919999999999999},"min":{"1min":0.85299999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6160000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.278,"5min":1.331,"15min":1.415},"min":{"1min":0.89700000000000002,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.7270000000000001,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.73499999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3220000000000001,"15min":1.3660000000000001},"min":{"1min":0.878,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.833,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.119},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.363,"15min":1.3799999999999999},"min":{"1min":1.0089999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6359999999999999,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":0.83599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310412,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061428,"statfs":{"total":96636764160,"available":96318902272,"internally_reserved":0,"allocated":1052672,"data_stored":512874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.95099999999999996,"15min":0.90500000000000003},"min":{"1min":0.55300000000000005,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4179999999999999,"5min":14.859,"15min":14.859},"last":0.752},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.94399999999999995,"15min":0.88800000000000001},"min":{"1min":0.55700000000000005,"5min":0.317,"15min":0.317},"max":{"1min":1.4119999999999999,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":0.51500000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.874,"15min":0.85599999999999998},"min":{"1min":0.66900000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2110000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.872},{"interface":"front","average":{"1min":1.01,"5min":1,"15min":0.98599999999999999},"min":{"1min":0.63300000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4079999999999999,"5min":5.7519999999999998,"15min":5.7519999999999998},"last":0.85199999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.085,"15min":1.159},"min":{"1min":0.64000000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1799999999999999,"15min":1.194},"min":{"1min":0.72999999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2,"5min":2,"15min":2},"last":1.0589999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.2889999999999999,"15min":1.296},"min":{"1min":0.71299999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.718,"5min":5.016,"15min":5.016},"last":1.23},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3420000000000001,"15min":1.3380000000000001},"min":{"1min":1.0469999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.633,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":1.3089999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3,"15min":1.298},"min":{"1min":1.0169999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.7090000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":1.149},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4830000000000001,"15min":1.345},"min":{"1min":0.94699999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.851,"5min":14.523999999999999,"15min":14.523999999999999},"last":1.1970000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.365,"15min":1.415},"min":{"1min":0.90500000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.752,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.4350000000000001,"15min":1.4219999999999999},"min":{"1min":0.95399999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.7370000000000001,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":1.369}]},{"osd":7,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.405,"15min":1.403},"min":{"1min":0.995,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.861,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":1.27},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.411,"15min":1.427},"min":{"1min":0.97799999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1139999999999999,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":1.2829999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574915,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065536,"statfs":{"total":96636764160,"available":96323108864,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.76000000000000001,"15min":0.75600000000000001},"min":{"1min":0.63600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2709999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.995,"5min":0.85799999999999998,"15min":0.83499999999999996},"min":{"1min":0.62,"5min":0.373,"15min":0.373},"max":{"1min":1.6559999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.99299999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.83199999999999996,"15min":0.80600000000000005},"min":{"1min":0.59399999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.995,"5min":0.91900000000000004,"15min":0.94199999999999995},"min":{"1min":0.755,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2569999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.95899999999999996}]},{"osd":3,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1000000000000001,"15min":1.0669999999999999},"min":{"1min":0.63300000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.79,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.1819999999999999,"15min":1.173},"min":{"1min":0.76600000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.73,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.357}]},{"osd":4,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.254,"15min":1.306},"min":{"1min":1.1890000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5940000000000001,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.1819999999999999,"15min":1.2090000000000001},"min":{"1min":0.93300000000000005,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.694,"5min":1.952,"15min":1.952},"last":1.389}]},{"osd":5,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2130000000000001,"15min":1.196},"min":{"1min":0.88300000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.597,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.266,"15min":1.319},"min":{"1min":1.022,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5629999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.2010000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.2350000000000001,"15min":1.2589999999999999},"min":{"1min":0.97499999999999998,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8360000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.292,"15min":1.2909999999999999},"min":{"1min":1.0389999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.6990000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.224}]},{"osd":7,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.3200000000000001,"15min":1.357},"min":{"1min":1.081,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.867,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.468,"5min":1.405,"15min":1.413},"min":{"1min":1.2050000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.877,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.518}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310400,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061440,"statfs":{"total":96636764160,"available":96318914560,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.90500000000000003,"15min":0.85499999999999998},"min":{"1min":0.69899999999999995,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2230000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.749},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.98899999999999999,"15min":1.0009999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.873,"5min":2.101,"15min":2.101},"last":0.94499999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.98499999999999999,"15min":1.0029999999999999},"min":{"1min":0.63200000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4390000000000001,"5min":1.722,"15min":1.722},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.071,"5min":1.042,"15min":1.03},"min":{"1min":0.64200000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.494,"5min":2.008,"15min":2.008},"last":1.1759999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0569999999999999,"15min":1.0049999999999999},"min":{"1min":0.71699999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":4.665,"15min":4.665},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.89600000000000002,"15min":0.88100000000000001},"min":{"1min":0.58499999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.333,"5min":1.867,"15min":1.867},"last":0.77400000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2210000000000001,"15min":1.206},"min":{"1min":0.92800000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.605,"5min":1.788,"15min":1.788},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2949999999999999,"15min":1.2569999999999999},"min":{"1min":0.96199999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6439999999999999,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":1.1080000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.1930000000000001,"15min":1.1910000000000001},"min":{"1min":0.80000000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.048},{"interface":"front","average":{"1min":1.401,"5min":1.292,"15min":1.278},"min":{"1min":1.0349999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.9430000000000001,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.871}]},{"osd":6,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.83899999999999997,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.74,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.349,"15min":1.3420000000000001},"min":{"1min":0.98599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.893,"5min":2.294,"15min":2.294},"last":1.1579999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.397,"15min":1.379},"min":{"1min":0.92700000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.764,"5min":4.4329999999999998,"15min":4.4329999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":1.0149999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.0329999999999999,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":1.1970000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574915,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065536,"statfs":{"total":96636764160,"available":96323108864,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.6419999999999999,"5min":0.97499999999999998,"15min":0.96399999999999997},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":15.273,"5min":15.273,"15min":15.273},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.91800000000000004,"15min":0.98299999999999998},"min":{"1min":0.51800000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.3149999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.716,"5min":1.1319999999999999,"15min":1.1140000000000001},"min":{"1min":0.56499999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":15.473000000000001,"5min":15.473000000000001,"15min":15.473000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.008,"15min":1.024},"min":{"1min":0.68700000000000006,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.589,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.1259999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":0.99399999999999999,"15min":1.0349999999999999},"min":{"1min":0.59499999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.3970000000000002,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.931,"5min":1.256,"15min":1.25},"min":{"1min":0.71699999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":15.439,"5min":15.439,"15min":15.439},"last":1.375}]},{"osd":4,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2509999999999999,"15min":1.369},"min":{"1min":0.751,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6200000000000001,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.405},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.23,"15min":1.258},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":1.149}]},{"osd":5,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.272,"15min":1.373},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.891,"5min":3.548,"15min":3.548},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.3220000000000001,"15min":1.4159999999999999},"min":{"1min":0.80500000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.2769999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":2.149,"5min":1.51,"15min":1.4870000000000001},"min":{"1min":0.89100000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":15.4,"5min":15.4,"15min":15.4},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.6899999999999999,"5min":1.411,"15min":1.512},"min":{"1min":1.0489999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":7.1349999999999998,"5min":7.1349999999999998,"15min":7.1349999999999998},"last":1.2370000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4279999999999999,"15min":1.621},"min":{"1min":1.1040000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.1080000000000001,"5min":5.29,"15min":5.29},"last":1.486},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.361,"15min":1.4350000000000001},"min":{"1min":0.93400000000000005,"5min":0.752,"15min":0.752},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.4259999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:09:57.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2024-01-22T05:09:57.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.277016+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:09:57.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2024-01-22T05:09:57.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.271591+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:09:57.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2024-01-22T05:09:57.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.279637+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:09:57.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2024-01-22T05:09:57.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.274093+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:09:57.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2024-01-22T05:09:57.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.270677+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:09:57.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2024-01-22T05:09:57.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.281395+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:09:57.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2024-01-22T05:09:57.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.268616+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:09:57.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2024-01-22T05:09:57.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.282349+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:09:57.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2024-01-22T05:09:57.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.269001+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:09:57.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2024-01-22T05:09:57.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.271327+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:09:57.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2024-01-22T05:09:57.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.266270+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:09:57.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2024-01-22T05:09:57.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.274514+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:09:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2024-01-22T05:09:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.279455+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:09:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2024-01-22T05:09:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.280256+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:09:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2024-01-22T05:09:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.271529+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:09:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2024-01-22T05:09:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.279817+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:09:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2024-01-22T05:09:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.277451+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:09:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2024-01-22T05:09:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.275271+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:09:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2024-01-22T05:09:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.276211+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:09:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2024-01-22T05:09:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.290731+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:09:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2024-01-22T05:09:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.272857+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:09:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2024-01-22T05:09:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.276479+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:09:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2024-01-22T05:09:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.278044+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:09:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2024-01-22T05:09:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.266650+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:09:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2024-01-22T05:09:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.275125+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:09:57.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2024-01-22T05:09:57.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.273801+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:09:57.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2024-01-22T05:09:57.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.267911+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:09:57.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2024-01-22T05:09:57.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.286676+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:09:57.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2024-01-22T05:09:57.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.273600+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:09:57.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2024-01-22T05:09:57.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.275160+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:09:57.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2024-01-22T05:09:57.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.266055+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:09:57.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2024-01-22T05:09:57.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.271032+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:09:57.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2024-01-22T05:09:57.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.283716+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:09:57.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2024-01-22T05:09:57.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.268712+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:09:57.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2024-01-22T05:09:57.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.267373+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:09:57.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2024-01-22T05:09:57.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.273484+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:09:57.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2024-01-22T05:09:57.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.274110+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:09:57.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2024-01-22T05:09:57.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.280924+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:09:57.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2024-01-22T05:09:57.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.273548+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:09:57.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2024-01-22T05:09:57.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.277473+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:09:57.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2024-01-22T05:09:57.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.277585+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:09:57.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2024-01-22T05:09:57.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.269623+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:09:57.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2024-01-22T05:09:57.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.285033+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:09:57.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2024-01-22T05:09:57.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.280058+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:09:57.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2024-01-22T05:09:57.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.274421+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:09:57.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2024-01-22T05:09:57.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.279808+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:09:57.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2024-01-22T05:09:57.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.272936+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:09:57.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2024-01-22T05:09:57.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.273378+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:09:57.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2024-01-22T05:09:57.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.271848+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:09:57.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2024-01-22T05:09:57.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.274230+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:09:57.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2024-01-22T05:09:57.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.266819+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:09:57.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2024-01-22T05:09:57.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.280591+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:09:57.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2024-01-22T05:09:57.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.269526+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:09:57.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2024-01-22T05:09:57.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.284777+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:09:57.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2024-01-22T05:09:57.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.274617+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:09:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2024-01-22T05:09:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.267332+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:09:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2024-01-22T05:09:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.276297+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:09:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2024-01-22T05:09:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.270273+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:09:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2024-01-22T05:09:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.276907+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:09:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2024-01-22T05:09:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.269848+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:09:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2024-01-22T05:09:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.281075+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:09:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2024-01-22T05:09:57.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.273491+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:09:57.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2024-01-22T05:09:57.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.271035+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:09:57.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2024-01-22T05:09:57.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:09:52.246134+0000', 'last_change': '2024-01-22T05:09:52.274572+0000', 'last_active': '2024-01-22T05:09:52.246134+0000', 'last_peered': '2024-01-22T05:09:52.246134+0000', 'last_clean': '2024-01-22T05:09:52.246134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:09:52.246134+0000', 'last_undegraded': '2024-01-22T05:09:52.246134+0000', 'last_fullsized': '2024-01-22T05:09:52.246134+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'last_clean_scrub_stamp': '2024-01-22T05:09:52.246134+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:09:57.918 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:09:58.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.098+0000 7f9b06600700 1 Processor -- start 2024-01-22T05:09:58.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.098+0000 7f9b06600700 1 -- start start 2024-01-22T05:09:58.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.098+0000 7f9b06600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9b00065240 0x7f9b000644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:58.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.098+0000 7f9b06600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b000649e0 0x7f9b0015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:58.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.098+0000 7f9b06600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b000c2700 con 0x7f9b00065620 2024-01-22T05:09:58.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.098+0000 7f9b06600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b00064e30 con 0x7f9b00065240 2024-01-22T05:09:58.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.098+0000 7f9b06600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000c29a0 con 0x7f9b000649e0 2024-01-22T05:09:58.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.098+0000 7f9aff400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9b00065240 0x7f9b000644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:58.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.098+0000 7f9aff400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9b00065240 0x7f9b000644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54514/0 (socket says 172.21.15.49:54514) 2024-01-22T05:09:58.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.098+0000 7f9aff400700 1 -- 172.21.15.49:0/525946639 learned_addr learned my addr 172.21.15.49:0/525946639 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:58.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.098+0000 7f9b05000700 1 --2- 172.21.15.49:0/525946639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b000649e0 0x7f9b0015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:58.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9aff400700 1 -- 172.21.15.49:0/525946639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b000649e0 msgr2=0x7f9b0015c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:58.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9aff400700 1 --2- 172.21.15.49:0/525946639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b000649e0 0x7f9b0015c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9aff400700 1 -- 172.21.15.49:0/525946639 >> v1:172.21.15.110:6789/0 conn(0x7f9b00065620 legacy=0x7f9b0015b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:58.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9aff400700 1 -- 172.21.15.49:0/525946639 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b000c2c80 con 0x7f9b00065240 2024-01-22T05:09:58.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9aff400700 1 --2- 172.21.15.49:0/525946639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b00065240 0x7f9b000644f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f9af0006fd0 tx=0x7f9af00090f0).ready entity=mon.0 client_cookie=6579722e7a8a7d46 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:58.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9afe000700 1 -- 172.21.15.49:0/525946639 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af000b580 con 0x7f9b00065240 2024-01-22T05:09:58.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9afe000700 1 -- 172.21.15.49:0/525946639 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af000b6e0 con 0x7f9b00065240 2024-01-22T05:09:58.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9afe000700 1 -- 172.21.15.49:0/525946639 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af000ba60 con 0x7f9b00065240 2024-01-22T05:09:58.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9b06600700 1 -- 172.21.15.49:0/525946639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b00065240 msgr2=0x7f9b000644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:58.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9b06600700 1 --2- 172.21.15.49:0/525946639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b00065240 0x7f9b000644f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f9af0006fd0 tx=0x7f9af00090f0).stop 2024-01-22T05:09:58.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9b06600700 1 -- 172.21.15.49:0/525946639 shutdown_connections 2024-01-22T05:09:58.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9b06600700 1 --2- 172.21.15.49:0/525946639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b000649e0 0x7f9b0015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9b06600700 1 --2- 172.21.15.49:0/525946639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b00065240 0x7f9b000644f0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9b06600700 1 -- 172.21.15.49:0/525946639 >> 172.21.15.49:0/525946639 conn(0x7f9b000c87f0 msgr2=0x7f9b000c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:58.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9b06600700 1 -- 172.21.15.49:0/525946639 shutdown_connections 2024-01-22T05:09:58.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.102+0000 7f9b06600700 1 -- 172.21.15.49:0/525946639 wait complete. 2024-01-22T05:09:58.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.106+0000 7f9b06600700 1 Processor -- start 2024-01-22T05:09:58.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b06600700 1 -- start start 2024-01-22T05:09:58.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b06600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b000649e0 0x7f9b000accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:58.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b06600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b00065240 0x7f9b00150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:58.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b06600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b00065620 0x7f9b00150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:58.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b06600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000c0040 con 0x7f9b00065620 2024-01-22T05:09:58.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b06600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000ad560 con 0x7f9b00065240 2024-01-22T05:09:58.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b06600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000ad840 con 0x7f9b000649e0 2024-01-22T05:09:58.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b05000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b00065620 0x7f9b00150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:58.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b05000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b00065620 0x7f9b00150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54520/0 (socket says 172.21.15.49:54520) 2024-01-22T05:09:58.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b05000700 1 -- 172.21.15.49:0/231454040 learned_addr learned my addr 172.21.15.49:0/231454040 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:58.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9aff400700 1 --2- 172.21.15.49:0/231454040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b000649e0 0x7f9b000accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:58.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9afea00700 1 --2- 172.21.15.49:0/231454040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b00065240 0x7f9b00150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:58.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b05000700 1 -- 172.21.15.49:0/231454040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b000649e0 msgr2=0x7f9b000accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:58.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b05000700 1 --2- 172.21.15.49:0/231454040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b000649e0 0x7f9b000accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b05000700 1 -- 172.21.15.49:0/231454040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b00065240 msgr2=0x7f9b00150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:58.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b05000700 1 --2- 172.21.15.49:0/231454040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b00065240 0x7f9b00150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b05000700 1 -- 172.21.15.49:0/231454040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af0009370 con 0x7f9b00065620 2024-01-22T05:09:58.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9aff400700 1 --2- 172.21.15.49:0/231454040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b000649e0 0x7f9b000accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:09:58.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.110+0000 7f9b05000700 1 --2- 172.21.15.49:0/231454040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b00065620 0x7f9b00150e70 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f9af8009e90 tx=0x7f9af800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:58.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.114+0000 7f9af6a00700 1 -- 172.21.15.49:0/231454040 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af800caa0 con 0x7f9b00065620 2024-01-22T05:09:58.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.114+0000 7f9af6a00700 1 -- 172.21.15.49:0/231454040 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af800f040 con 0x7f9b00065620 2024-01-22T05:09:58.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.114+0000 7f9b06600700 1 -- 172.21.15.49:0/231454040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b000adb20 con 0x7f9b00065620 2024-01-22T05:09:58.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.114+0000 7f9af6a00700 1 -- 172.21.15.49:0/231454040 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af800ce10 con 0x7f9b00065620 2024-01-22T05:09:58.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.114+0000 7f9b06600700 1 -- 172.21.15.49:0/231454040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b000ad1b0 con 0x7f9b00065620 2024-01-22T05:09:58.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.114+0000 7f9b06600700 1 -- 172.21.15.49:0/231454040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b000c01f0 con 0x7f9b00065620 2024-01-22T05:09:58.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.118+0000 7f9af6a00700 1 -- 172.21.15.49:0/231454040 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9af8013610 con 0x7f9b00065620 2024-01-22T05:09:58.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.118+0000 7f9af6a00700 1 --2- 172.21.15.49:0/231454040 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9ad805a510 0x7f9ad805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:58.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.118+0000 7f9af6a00700 1 -- 172.21.15.49:0/231454040 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9af80752a0 con 0x7f9b00065620 2024-01-22T05:09:58.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.118+0000 7f9aff400700 1 --2- 172.21.15.49:0/231454040 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9ad805a510 0x7f9ad805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:58.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.118+0000 7f9aff400700 1 --2- 172.21.15.49:0/231454040 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9ad805a510 0x7f9ad805c9d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f9af0009130 tx=0x7f9af0017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:58.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.122+0000 7f9af6a00700 1 -- 172.21.15.49:0/231454040 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9b000c01f0 con 0x7f9b00065620 2024-01-22T05:09:58.226 INFO:tasks.ceph.mds.b.smithi110.stderr:2024-01-22T05:09:58.222+0000 7fd390400700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:09:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.342+0000 7f9b06600700 1 -- 172.21.15.49:0/231454040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9b00047060 con 0x7f9b00065620 2024-01-22T05:09:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.342+0000 7f9af6a00700 1 -- 172.21.15.49:0/231454040 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1453 (secure 0 0 0) 0x7f9af8048860 con 0x7f9b00065620 2024-01-22T05:09:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:58.348 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":342,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":88,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":73},{"state_name":"creating+peering","count":64}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2530238464,"bytes_avail":770563874816,"bytes_total":773094113280,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":70,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"b","status":"up:active","gid":6846}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2024-01-22T05:09:41.338645+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:09:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.346+0000 7f9b06600700 1 -- 172.21.15.49:0/231454040 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9ad805a510 msgr2=0x7f9ad805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.346+0000 7f9b06600700 1 --2- 172.21.15.49:0/231454040 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9ad805a510 0x7f9ad805c9d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f9af0009130 tx=0x7f9af0017000).stop 2024-01-22T05:09:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.346+0000 7f9b06600700 1 -- 172.21.15.49:0/231454040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b00065620 msgr2=0x7f9b00150e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.346+0000 7f9b06600700 1 --2- 172.21.15.49:0/231454040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b00065620 0x7f9b00150e70 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f9af8009e90 tx=0x7f9af800b040).stop 2024-01-22T05:09:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.346+0000 7f9b06600700 1 -- 172.21.15.49:0/231454040 shutdown_connections 2024-01-22T05:09:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.346+0000 7f9b06600700 1 --2- 172.21.15.49:0/231454040 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9ad805a510 0x7f9ad805c9d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.346+0000 7f9b06600700 1 --2- 172.21.15.49:0/231454040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b00065620 0x7f9b00150e70 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.346+0000 7f9b06600700 1 --2- 172.21.15.49:0/231454040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b00065240 0x7f9b00150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.346+0000 7f9b06600700 1 --2- 172.21.15.49:0/231454040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b000649e0 0x7f9b000accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.346+0000 7f9b06600700 1 -- 172.21.15.49:0/231454040 >> 172.21.15.49:0/231454040 conn(0x7f9b000c87f0 msgr2=0x7f9b00063930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.346+0000 7f9b06600700 1 -- 172.21.15.49:0/231454040 shutdown_connections 2024-01-22T05:09:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.346+0000 7f9b06600700 1 -- 172.21.15.49:0/231454040 wait complete. 2024-01-22T05:09:58.374 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-22T05:09:58.374 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:09:58.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.530+0000 7f26a2c00700 1 Processor -- start 2024-01-22T05:09:58.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.530+0000 7f26a2c00700 1 -- start start 2024-01-22T05:09:58.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.534+0000 7f26a2c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f269c0a8740 0x7f269c0a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:58.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.534+0000 7f26a2c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f269c0c1ed0 0x7f269c0c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:58.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.534+0000 7f26a2c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269c0c1a40 con 0x7f269c155d20 2024-01-22T05:09:58.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.534+0000 7f26a2c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f269c0a90b0 con 0x7f269c0a8740 2024-01-22T05:09:58.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.534+0000 7f26a2c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c159310 con 0x7f269c0c1ed0 2024-01-22T05:09:58.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.534+0000 7f269be00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f269c155d20 0x7f269c065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45730/0 (socket says 172.21.15.49:45730) 2024-01-22T05:09:58.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.534+0000 7f269be00700 1 -- 172.21.15.49:0/203660682 learned_addr learned my addr 172.21.15.49:0/203660682 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:09:58.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.534+0000 7f269b400700 1 --2- 172.21.15.49:0/203660682 >> v2:172.21.15.110:3300/0 conn(0x7f269c0a8740 0x7f269c0a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:58.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.534+0000 7f26a0c00700 1 --2- 172.21.15.49:0/203660682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f269c0c1ed0 0x7f269c0c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:58.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.534+0000 7f269aa00700 1 -- 172.21.15.49:0/203660682 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616160052 0 0) 0x7f269c0c1a40 con 0x7f269c155d20 2024-01-22T05:09:58.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f269aa00700 1 -- 172.21.15.49:0/203660682 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f267c0033f0 con 0x7f269c155d20 2024-01-22T05:09:58.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f269b400700 1 -- 172.21.15.49:0/203660682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f269c0c1ed0 msgr2=0x7f269c0c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:09:58.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f269b400700 1 --2- 172.21.15.49:0/203660682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f269c0c1ed0 0x7f269c0c2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f269b400700 1 -- 172.21.15.49:0/203660682 >> v1:172.21.15.49:6789/0 conn(0x7f269c155d20 legacy=0x7f269c065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:58.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f269b400700 1 -- 172.21.15.49:0/203660682 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c0c13f0 con 0x7f269c0a8740 2024-01-22T05:09:58.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f269b400700 1 --2- 172.21.15.49:0/203660682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f269c0a8740 0x7f269c0a8bc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f2684009760 tx=0x7f2684009060).ready entity=mon.1 client_cookie=f71e80e60acac41a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:58.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f269aa00700 1 -- 172.21.15.49:0/203660682 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268400d4a0 con 0x7f269c0a8740 2024-01-22T05:09:58.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f269aa00700 1 -- 172.21.15.49:0/203660682 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268400d600 con 0x7f269c0a8740 2024-01-22T05:09:58.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f269aa00700 1 -- 172.21.15.49:0/203660682 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268400d980 con 0x7f269c0a8740 2024-01-22T05:09:58.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f26a2c00700 1 -- 172.21.15.49:0/203660682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f269c0a8740 msgr2=0x7f269c0a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:58.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f26a2c00700 1 --2- 172.21.15.49:0/203660682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f269c0a8740 0x7f269c0a8bc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f2684009760 tx=0x7f2684009060).stop 2024-01-22T05:09:58.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f26a2c00700 1 -- 172.21.15.49:0/203660682 shutdown_connections 2024-01-22T05:09:58.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f26a2c00700 1 --2- 172.21.15.49:0/203660682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f269c0c1ed0 0x7f269c0c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f26a2c00700 1 --2- 172.21.15.49:0/203660682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f269c0a8740 0x7f269c0a8bc0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f26a2c00700 1 -- 172.21.15.49:0/203660682 >> 172.21.15.49:0/203660682 conn(0x7f269c0c6540 msgr2=0x7f269c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:58.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f26a2c00700 1 -- 172.21.15.49:0/203660682 shutdown_connections 2024-01-22T05:09:58.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.538+0000 7f26a2c00700 1 -- 172.21.15.49:0/203660682 wait complete. 2024-01-22T05:09:58.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.542+0000 7f26a2c00700 1 Processor -- start 2024-01-22T05:09:58.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.542+0000 7f26a2c00700 1 -- start start 2024-01-22T05:09:58.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.542+0000 7f26a2c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f269c0a8740 0x7f269c0ab680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:58.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.542+0000 7f26a2c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f269c0c1ed0 0x7f269c153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:58.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.542+0000 7f26a2c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f269c155d20 0x7f269c151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:58.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.542+0000 7f26a2c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c16bf20 con 0x7f269c0a8740 2024-01-22T05:09:58.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.542+0000 7f26a2c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c0abc20 con 0x7f269c155d20 2024-01-22T05:09:58.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.542+0000 7f26a2c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c0abf00 con 0x7f269c0c1ed0 2024-01-22T05:09:58.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f269be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f269c0a8740 0x7f269c0ab680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:58.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f269be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f269c0a8740 0x7f269c0ab680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54536/0 (socket says 172.21.15.49:54536) 2024-01-22T05:09:58.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f269be00700 1 -- 172.21.15.49:0/987578289 learned_addr learned my addr 172.21.15.49:0/987578289 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:09:58.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f269b400700 1 --2- 172.21.15.49:0/987578289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f269c0c1ed0 0x7f269c153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:58.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f26a0c00700 1 --2- 172.21.15.49:0/987578289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f269c155d20 0x7f269c151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:58.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f269be00700 1 -- 172.21.15.49:0/987578289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f269c0c1ed0 msgr2=0x7f269c153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:58.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f269be00700 1 --2- 172.21.15.49:0/987578289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f269c0c1ed0 0x7f269c153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f269be00700 1 -- 172.21.15.49:0/987578289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f269c155d20 msgr2=0x7f269c151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:58.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f269be00700 1 --2- 172.21.15.49:0/987578289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f269c155d20 0x7f269c151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f269be00700 1 -- 172.21.15.49:0/987578289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26840092a0 con 0x7f269c0a8740 2024-01-22T05:09:58.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f269be00700 1 --2- 172.21.15.49:0/987578289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f269c0a8740 0x7f269c0ab680 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f268c00c420 tx=0x7f268c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:58.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f2693400700 1 -- 172.21.15.49:0/987578289 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c0070d0 con 0x7f269c0a8740 2024-01-22T05:09:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f2693400700 1 -- 172.21.15.49:0/987578289 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268c007230 con 0x7f269c0a8740 2024-01-22T05:09:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f26a2c00700 1 -- 172.21.15.49:0/987578289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269c0ac1e0 con 0x7f269c0a8740 2024-01-22T05:09:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f2693400700 1 -- 172.21.15.49:0/987578289 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c0075b0 con 0x7f269c0a8740 2024-01-22T05:09:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f26a2c00700 1 -- 172.21.15.49:0/987578289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c153500 con 0x7f269c0a8740 2024-01-22T05:09:58.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.546+0000 7f26a2c00700 1 -- 172.21.15.49:0/987578289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269c0bb500 con 0x7f269c0a8740 2024-01-22T05:09:58.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.550+0000 7f2693400700 1 -- 172.21.15.49:0/987578289 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f268c0059b0 con 0x7f269c0a8740 2024-01-22T05:09:58.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.550+0000 7f2693400700 1 --2- 172.21.15.49:0/987578289 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f267405a510 0x7f267405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:09:58.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.550+0000 7f2693400700 1 -- 172.21.15.49:0/987578289 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f268c074100 con 0x7f269c0a8740 2024-01-22T05:09:58.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.550+0000 7f269b400700 1 --2- 172.21.15.49:0/987578289 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f267405a510 0x7f267405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:09:58.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.550+0000 7f269b400700 1 --2- 172.21.15.49:0/987578289 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f267405a510 0x7f267405c9d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f268400d260 tx=0x7f2684016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:09:58.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.558+0000 7f2693400700 1 -- 172.21.15.49:0/987578289 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f269c0bb500 con 0x7f269c0a8740 2024-01-22T05:09:58.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.722+0000 7f26a2c00700 1 -- 172.21.15.49:0/987578289 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f269c0bb500 con 0x7f267405a510 2024-01-22T05:09:58.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.734+0000 7f2693400700 1 -- 172.21.15.49:0/987578289 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355771 (secure 0 0 0) 0x7f269c0bb500 con 0x7f267405a510 2024-01-22T05:09:58.744 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:09:58.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.746+0000 7f26a2c00700 1 -- 172.21.15.49:0/987578289 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f267405a510 msgr2=0x7f267405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:58.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.746+0000 7f26a2c00700 1 --2- 172.21.15.49:0/987578289 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f267405a510 0x7f267405c9d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f268400d260 tx=0x7f2684016000).stop 2024-01-22T05:09:58.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.746+0000 7f26a2c00700 1 -- 172.21.15.49:0/987578289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f269c0a8740 msgr2=0x7f269c0ab680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:09:58.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.746+0000 7f26a2c00700 1 --2- 172.21.15.49:0/987578289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f269c0a8740 0x7f269c0ab680 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f268c00c420 tx=0x7f268c007c80).stop 2024-01-22T05:09:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.750+0000 7f26a2c00700 1 -- 172.21.15.49:0/987578289 shutdown_connections 2024-01-22T05:09:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.750+0000 7f26a2c00700 1 --2- 172.21.15.49:0/987578289 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f267405a510 0x7f267405c9d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.750+0000 7f26a2c00700 1 --2- 172.21.15.49:0/987578289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f269c155d20 0x7f269c151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.750+0000 7f26a2c00700 1 --2- 172.21.15.49:0/987578289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f269c0c1ed0 0x7f269c153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.750+0000 7f26a2c00700 1 --2- 172.21.15.49:0/987578289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f269c0a8740 0x7f269c0ab680 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:09:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.750+0000 7f26a2c00700 1 -- 172.21.15.49:0/987578289 >> 172.21.15.49:0/987578289 conn(0x7f269c0c6540 msgr2=0x7f269c067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:09:58.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.750+0000 7f26a2c00700 1 -- 172.21.15.49:0/987578289 shutdown_connections 2024-01-22T05:09:58.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:09:58.750+0000 7f26a2c00700 1 -- 172.21.15.49:0/987578289 wait complete. 2024-01-22T05:09:58.757 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:09:58.776 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2024-01-22T05:09:57.342634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470936,"kb_used_data":8152,"kb_used_omap":0,"kb_used_meta":2462720,"kb_avail":752503784,"statfs":{"total":773094113280,"available":770563874816,"internally_reserved":0,"allocated":8347648,"data_stored":4060800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2521825280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-15864,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-51,"num_read_kb":-50,"num_write":-77,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":-10,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.849627"},"pg_stats":[{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277016+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297569+0000","last_change":"2024-01-22T05:09:52.297569+0000","last_active":"2024-01-22T05:09:52.297569+0000","last_peered":"2024-01-22T05:09:52.297569+0000","last_clean":"2024-01-22T05:09:52.297569+0000","last_became_active":"2024-01-22T05:09:52.297023+0000","last_became_peered":"2024-01-22T05:09:52.297023+0000","last_unstale":"2024-01-22T05:09:52.297569+0000","last_undegraded":"2024-01-22T05:09:52.297569+0000","last_fullsized":"2024-01-22T05:09:52.297569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271591+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305592+0000","last_change":"2024-01-22T05:09:52.305592+0000","last_active":"2024-01-22T05:09:52.305592+0000","last_peered":"2024-01-22T05:09:52.305592+0000","last_clean":"2024-01-22T05:09:52.305592+0000","last_became_active":"2024-01-22T05:09:52.305284+0000","last_became_peered":"2024-01-22T05:09:52.305284+0000","last_unstale":"2024-01-22T05:09:52.305592+0000","last_undegraded":"2024-01-22T05:09:52.305592+0000","last_fullsized":"2024-01-22T05:09:52.305592+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279637+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303731+0000","last_change":"2024-01-22T05:09:52.303731+0000","last_active":"2024-01-22T05:09:52.303731+0000","last_peered":"2024-01-22T05:09:52.303731+0000","last_clean":"2024-01-22T05:09:52.303731+0000","last_became_active":"2024-01-22T05:09:52.303433+0000","last_became_peered":"2024-01-22T05:09:52.303433+0000","last_unstale":"2024-01-22T05:09:52.303731+0000","last_undegraded":"2024-01-22T05:09:52.303731+0000","last_fullsized":"2024-01-22T05:09:52.303731+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274093+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297327+0000","last_change":"2024-01-22T05:09:52.297327+0000","last_active":"2024-01-22T05:09:52.297327+0000","last_peered":"2024-01-22T05:09:52.297327+0000","last_clean":"2024-01-22T05:09:52.297327+0000","last_became_active":"2024-01-22T05:09:52.295607+0000","last_became_peered":"2024-01-22T05:09:52.295607+0000","last_unstale":"2024-01-22T05:09:52.297327+0000","last_undegraded":"2024-01-22T05:09:52.297327+0000","last_fullsized":"2024-01-22T05:09:52.297327+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.270677+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.291300+0000","last_change":"2024-01-22T05:09:52.291300+0000","last_active":"2024-01-22T05:09:52.291300+0000","last_peered":"2024-01-22T05:09:52.291300+0000","last_clean":"2024-01-22T05:09:52.291300+0000","last_became_active":"2024-01-22T05:09:52.291020+0000","last_became_peered":"2024-01-22T05:09:52.291020+0000","last_unstale":"2024-01-22T05:09:52.291300+0000","last_undegraded":"2024-01-22T05:09:52.291300+0000","last_fullsized":"2024-01-22T05:09:52.291300+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.281395+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.306892+0000","last_change":"2024-01-22T05:09:52.306892+0000","last_active":"2024-01-22T05:09:52.306892+0000","last_peered":"2024-01-22T05:09:52.306892+0000","last_clean":"2024-01-22T05:09:52.306892+0000","last_became_active":"2024-01-22T05:09:52.305890+0000","last_became_peered":"2024-01-22T05:09:52.305890+0000","last_unstale":"2024-01-22T05:09:52.306892+0000","last_undegraded":"2024-01-22T05:09:52.306892+0000","last_fullsized":"2024-01-22T05:09:52.306892+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.268616+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.286515+0000","last_change":"2024-01-22T05:09:52.286515+0000","last_active":"2024-01-22T05:09:52.286515+0000","last_peered":"2024-01-22T05:09:52.286515+0000","last_clean":"2024-01-22T05:09:52.286515+0000","last_became_active":"2024-01-22T05:09:52.286243+0000","last_became_peered":"2024-01-22T05:09:52.286243+0000","last_unstale":"2024-01-22T05:09:52.286515+0000","last_undegraded":"2024-01-22T05:09:52.286515+0000","last_fullsized":"2024-01-22T05:09:52.286515+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.282349+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.286766+0000","last_change":"2024-01-22T05:09:52.286766+0000","last_active":"2024-01-22T05:09:52.286766+0000","last_peered":"2024-01-22T05:09:52.286766+0000","last_clean":"2024-01-22T05:09:52.286766+0000","last_became_active":"2024-01-22T05:09:52.286407+0000","last_became_peered":"2024-01-22T05:09:52.286407+0000","last_unstale":"2024-01-22T05:09:52.286766+0000","last_undegraded":"2024-01-22T05:09:52.286766+0000","last_fullsized":"2024-01-22T05:09:52.286766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269001+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.304066+0000","last_change":"2024-01-22T05:09:52.304066+0000","last_active":"2024-01-22T05:09:52.304066+0000","last_peered":"2024-01-22T05:09:52.304066+0000","last_clean":"2024-01-22T05:09:52.304066+0000","last_became_active":"2024-01-22T05:09:52.303591+0000","last_became_peered":"2024-01-22T05:09:52.303591+0000","last_unstale":"2024-01-22T05:09:52.304066+0000","last_undegraded":"2024-01-22T05:09:52.304066+0000","last_fullsized":"2024-01-22T05:09:52.304066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271327+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.286587+0000","last_change":"2024-01-22T05:09:52.286587+0000","last_active":"2024-01-22T05:09:52.286587+0000","last_peered":"2024-01-22T05:09:52.286587+0000","last_clean":"2024-01-22T05:09:52.286587+0000","last_became_active":"2024-01-22T05:09:52.286312+0000","last_became_peered":"2024-01-22T05:09:52.286312+0000","last_unstale":"2024-01-22T05:09:52.286587+0000","last_undegraded":"2024-01-22T05:09:52.286587+0000","last_fullsized":"2024-01-22T05:09:52.286587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266270+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.308814+0000","last_change":"2024-01-22T05:09:52.308814+0000","last_active":"2024-01-22T05:09:52.308814+0000","last_peered":"2024-01-22T05:09:52.308814+0000","last_clean":"2024-01-22T05:09:52.308814+0000","last_became_active":"2024-01-22T05:09:52.307354+0000","last_became_peered":"2024-01-22T05:09:52.307354+0000","last_unstale":"2024-01-22T05:09:52.308814+0000","last_undegraded":"2024-01-22T05:09:52.308814+0000","last_fullsized":"2024-01-22T05:09:52.308814+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274514+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.312051+0000","last_change":"2024-01-22T05:09:52.312051+0000","last_active":"2024-01-22T05:09:52.312051+0000","last_peered":"2024-01-22T05:09:52.312051+0000","last_clean":"2024-01-22T05:09:52.312051+0000","last_became_active":"2024-01-22T05:09:52.311745+0000","last_became_peered":"2024-01-22T05:09:52.311745+0000","last_unstale":"2024-01-22T05:09:52.312051+0000","last_undegraded":"2024-01-22T05:09:52.312051+0000","last_fullsized":"2024-01-22T05:09:52.312051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279455+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.291159+0000","last_change":"2024-01-22T05:09:52.291159+0000","last_active":"2024-01-22T05:09:52.291159+0000","last_peered":"2024-01-22T05:09:52.291159+0000","last_clean":"2024-01-22T05:09:52.291159+0000","last_became_active":"2024-01-22T05:09:52.289670+0000","last_became_peered":"2024-01-22T05:09:52.289670+0000","last_unstale":"2024-01-22T05:09:52.291159+0000","last_undegraded":"2024-01-22T05:09:52.291159+0000","last_fullsized":"2024-01-22T05:09:52.291159+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280256+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.307125+0000","last_change":"2024-01-22T05:09:52.307125+0000","last_active":"2024-01-22T05:09:52.307125+0000","last_peered":"2024-01-22T05:09:52.307125+0000","last_clean":"2024-01-22T05:09:52.307125+0000","last_became_active":"2024-01-22T05:09:52.306261+0000","last_became_peered":"2024-01-22T05:09:52.306261+0000","last_unstale":"2024-01-22T05:09:52.307125+0000","last_undegraded":"2024-01-22T05:09:52.307125+0000","last_fullsized":"2024-01-22T05:09:52.307125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271529+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295635+0000","last_change":"2024-01-22T05:09:52.295635+0000","last_active":"2024-01-22T05:09:52.295635+0000","last_peered":"2024-01-22T05:09:52.295635+0000","last_clean":"2024-01-22T05:09:52.295635+0000","last_became_active":"2024-01-22T05:09:52.295121+0000","last_became_peered":"2024-01-22T05:09:52.295121+0000","last_unstale":"2024-01-22T05:09:52.295635+0000","last_undegraded":"2024-01-22T05:09:52.295635+0000","last_fullsized":"2024-01-22T05:09:52.295635+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279817+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.291201+0000","last_change":"2024-01-22T05:09:52.291201+0000","last_active":"2024-01-22T05:09:52.291201+0000","last_peered":"2024-01-22T05:09:52.291201+0000","last_clean":"2024-01-22T05:09:52.291201+0000","last_became_active":"2024-01-22T05:09:52.290840+0000","last_became_peered":"2024-01-22T05:09:52.290840+0000","last_unstale":"2024-01-22T05:09:52.291201+0000","last_undegraded":"2024-01-22T05:09:52.291201+0000","last_fullsized":"2024-01-22T05:09:52.291201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277451+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.282950+0000","last_change":"2024-01-22T05:09:52.282950+0000","last_active":"2024-01-22T05:09:52.282950+0000","last_peered":"2024-01-22T05:09:52.282950+0000","last_clean":"2024-01-22T05:09:52.282950+0000","last_became_active":"2024-01-22T05:09:52.279776+0000","last_became_peered":"2024-01-22T05:09:52.279776+0000","last_unstale":"2024-01-22T05:09:52.282950+0000","last_undegraded":"2024-01-22T05:09:52.282950+0000","last_fullsized":"2024-01-22T05:09:52.282950+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.275271+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.298678+0000","last_change":"2024-01-22T05:09:52.298678+0000","last_active":"2024-01-22T05:09:52.298678+0000","last_peered":"2024-01-22T05:09:52.298678+0000","last_clean":"2024-01-22T05:09:52.298678+0000","last_became_active":"2024-01-22T05:09:52.298186+0000","last_became_peered":"2024-01-22T05:09:52.298186+0000","last_unstale":"2024-01-22T05:09:52.298678+0000","last_undegraded":"2024-01-22T05:09:52.298678+0000","last_fullsized":"2024-01-22T05:09:52.298678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276211+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285820+0000","last_change":"2024-01-22T05:09:52.285820+0000","last_active":"2024-01-22T05:09:52.285820+0000","last_peered":"2024-01-22T05:09:52.285820+0000","last_clean":"2024-01-22T05:09:52.285820+0000","last_became_active":"2024-01-22T05:09:52.285492+0000","last_became_peered":"2024-01-22T05:09:52.285492+0000","last_unstale":"2024-01-22T05:09:52.285820+0000","last_undegraded":"2024-01-22T05:09:52.285820+0000","last_fullsized":"2024-01-22T05:09:52.285820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.290731+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.284575+0000","last_change":"2024-01-22T05:09:52.284575+0000","last_active":"2024-01-22T05:09:52.284575+0000","last_peered":"2024-01-22T05:09:52.284575+0000","last_clean":"2024-01-22T05:09:52.284575+0000","last_became_active":"2024-01-22T05:09:52.284312+0000","last_became_peered":"2024-01-22T05:09:52.284312+0000","last_unstale":"2024-01-22T05:09:52.284575+0000","last_undegraded":"2024-01-22T05:09:52.284575+0000","last_fullsized":"2024-01-22T05:09:52.284575+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.272857+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.298825+0000","last_change":"2024-01-22T05:09:52.298825+0000","last_active":"2024-01-22T05:09:52.298825+0000","last_peered":"2024-01-22T05:09:52.298825+0000","last_clean":"2024-01-22T05:09:52.298825+0000","last_became_active":"2024-01-22T05:09:52.298494+0000","last_became_peered":"2024-01-22T05:09:52.298494+0000","last_unstale":"2024-01-22T05:09:52.298825+0000","last_undegraded":"2024-01-22T05:09:52.298825+0000","last_fullsized":"2024-01-22T05:09:52.298825+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276479+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.290456+0000","last_change":"2024-01-22T05:09:52.290456+0000","last_active":"2024-01-22T05:09:52.290456+0000","last_peered":"2024-01-22T05:09:52.290456+0000","last_clean":"2024-01-22T05:09:52.290456+0000","last_became_active":"2024-01-22T05:09:52.288359+0000","last_became_peered":"2024-01-22T05:09:52.288359+0000","last_unstale":"2024-01-22T05:09:52.290456+0000","last_undegraded":"2024-01-22T05:09:52.290456+0000","last_fullsized":"2024-01-22T05:09:52.290456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.278044+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297963+0000","last_change":"2024-01-22T05:09:52.297963+0000","last_active":"2024-01-22T05:09:52.297963+0000","last_peered":"2024-01-22T05:09:52.297963+0000","last_clean":"2024-01-22T05:09:52.297963+0000","last_became_active":"2024-01-22T05:09:52.295129+0000","last_became_peered":"2024-01-22T05:09:52.295129+0000","last_unstale":"2024-01-22T05:09:52.297963+0000","last_undegraded":"2024-01-22T05:09:52.297963+0000","last_fullsized":"2024-01-22T05:09:52.297963+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266650+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.312269+0000","last_change":"2024-01-22T05:09:52.312269+0000","last_active":"2024-01-22T05:09:52.312269+0000","last_peered":"2024-01-22T05:09:52.312269+0000","last_clean":"2024-01-22T05:09:52.312269+0000","last_became_active":"2024-01-22T05:09:52.312009+0000","last_became_peered":"2024-01-22T05:09:52.312009+0000","last_unstale":"2024-01-22T05:09:52.312269+0000","last_undegraded":"2024-01-22T05:09:52.312269+0000","last_fullsized":"2024-01-22T05:09:52.312269+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.275125+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.304546+0000","last_change":"2024-01-22T05:09:52.304546+0000","last_active":"2024-01-22T05:09:52.304546+0000","last_peered":"2024-01-22T05:09:52.304546+0000","last_clean":"2024-01-22T05:09:52.304546+0000","last_became_active":"2024-01-22T05:09:52.302485+0000","last_became_peered":"2024-01-22T05:09:52.302485+0000","last_unstale":"2024-01-22T05:09:52.304546+0000","last_undegraded":"2024-01-22T05:09:52.304546+0000","last_fullsized":"2024-01-22T05:09:52.304546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273801+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305020+0000","last_change":"2024-01-22T05:09:52.305020+0000","last_active":"2024-01-22T05:09:52.305020+0000","last_peered":"2024-01-22T05:09:52.305020+0000","last_clean":"2024-01-22T05:09:52.305020+0000","last_became_active":"2024-01-22T05:09:52.304708+0000","last_became_peered":"2024-01-22T05:09:52.304708+0000","last_unstale":"2024-01-22T05:09:52.305020+0000","last_undegraded":"2024-01-22T05:09:52.305020+0000","last_fullsized":"2024-01-22T05:09:52.305020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.267911+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.293808+0000","last_change":"2024-01-22T05:09:52.293808+0000","last_active":"2024-01-22T05:09:52.293808+0000","last_peered":"2024-01-22T05:09:52.293808+0000","last_clean":"2024-01-22T05:09:52.293808+0000","last_became_active":"2024-01-22T05:09:52.293536+0000","last_became_peered":"2024-01-22T05:09:52.293536+0000","last_unstale":"2024-01-22T05:09:52.293808+0000","last_undegraded":"2024-01-22T05:09:52.293808+0000","last_fullsized":"2024-01-22T05:09:52.293808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.286676+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.296831+0000","last_change":"2024-01-22T05:09:52.296831+0000","last_active":"2024-01-22T05:09:52.296831+0000","last_peered":"2024-01-22T05:09:52.296831+0000","last_clean":"2024-01-22T05:09:52.296831+0000","last_became_active":"2024-01-22T05:09:52.295639+0000","last_became_peered":"2024-01-22T05:09:52.295639+0000","last_unstale":"2024-01-22T05:09:52.296831+0000","last_undegraded":"2024-01-22T05:09:52.296831+0000","last_fullsized":"2024-01-22T05:09:52.296831+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273600+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303111+0000","last_change":"2024-01-22T05:09:52.303111+0000","last_active":"2024-01-22T05:09:52.303111+0000","last_peered":"2024-01-22T05:09:52.303111+0000","last_clean":"2024-01-22T05:09:52.303111+0000","last_became_active":"2024-01-22T05:09:52.302809+0000","last_became_peered":"2024-01-22T05:09:52.302809+0000","last_unstale":"2024-01-22T05:09:52.303111+0000","last_undegraded":"2024-01-22T05:09:52.303111+0000","last_fullsized":"2024-01-22T05:09:52.303111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.275160+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.304360+0000","last_change":"2024-01-22T05:09:52.304360+0000","last_active":"2024-01-22T05:09:52.304360+0000","last_peered":"2024-01-22T05:09:52.304360+0000","last_clean":"2024-01-22T05:09:52.304360+0000","last_became_active":"2024-01-22T05:09:52.304061+0000","last_became_peered":"2024-01-22T05:09:52.304061+0000","last_unstale":"2024-01-22T05:09:52.304360+0000","last_undegraded":"2024-01-22T05:09:52.304360+0000","last_fullsized":"2024-01-22T05:09:52.304360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266055+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287508+0000","last_change":"2024-01-22T05:09:52.287508+0000","last_active":"2024-01-22T05:09:52.287508+0000","last_peered":"2024-01-22T05:09:52.287508+0000","last_clean":"2024-01-22T05:09:52.287508+0000","last_became_active":"2024-01-22T05:09:52.287047+0000","last_became_peered":"2024-01-22T05:09:52.287047+0000","last_unstale":"2024-01-22T05:09:52.287508+0000","last_undegraded":"2024-01-22T05:09:52.287508+0000","last_fullsized":"2024-01-22T05:09:52.287508+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271032+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.297212+0000","last_change":"2024-01-22T05:09:52.297212+0000","last_active":"2024-01-22T05:09:52.297212+0000","last_peered":"2024-01-22T05:09:52.297212+0000","last_clean":"2024-01-22T05:09:52.297212+0000","last_became_active":"2024-01-22T05:09:52.296894+0000","last_became_peered":"2024-01-22T05:09:52.296894+0000","last_unstale":"2024-01-22T05:09:52.297212+0000","last_undegraded":"2024-01-22T05:09:52.297212+0000","last_fullsized":"2024-01-22T05:09:52.297212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.283716+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285779+0000","last_change":"2024-01-22T05:09:52.285779+0000","last_active":"2024-01-22T05:09:52.285779+0000","last_peered":"2024-01-22T05:09:52.285779+0000","last_clean":"2024-01-22T05:09:52.285779+0000","last_became_active":"2024-01-22T05:09:52.285085+0000","last_became_peered":"2024-01-22T05:09:52.285085+0000","last_unstale":"2024-01-22T05:09:52.285779+0000","last_undegraded":"2024-01-22T05:09:52.285779+0000","last_fullsized":"2024-01-22T05:09:52.285779+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.268712+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.293180+0000","last_change":"2024-01-22T05:09:52.293180+0000","last_active":"2024-01-22T05:09:52.293180+0000","last_peered":"2024-01-22T05:09:52.293180+0000","last_clean":"2024-01-22T05:09:52.293180+0000","last_became_active":"2024-01-22T05:09:52.292510+0000","last_became_peered":"2024-01-22T05:09:52.292510+0000","last_unstale":"2024-01-22T05:09:52.293180+0000","last_undegraded":"2024-01-22T05:09:52.293180+0000","last_fullsized":"2024-01-22T05:09:52.293180+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.267373+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.306492+0000","last_change":"2024-01-22T05:09:52.306492+0000","last_active":"2024-01-22T05:09:52.306492+0000","last_peered":"2024-01-22T05:09:52.306492+0000","last_clean":"2024-01-22T05:09:52.306492+0000","last_became_active":"2024-01-22T05:09:52.306048+0000","last_became_peered":"2024-01-22T05:09:52.306048+0000","last_unstale":"2024-01-22T05:09:52.306492+0000","last_undegraded":"2024-01-22T05:09:52.306492+0000","last_fullsized":"2024-01-22T05:09:52.306492+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273484+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.311553+0000","last_change":"2024-01-22T05:09:52.311553+0000","last_active":"2024-01-22T05:09:52.311553+0000","last_peered":"2024-01-22T05:09:52.311553+0000","last_clean":"2024-01-22T05:09:52.311553+0000","last_became_active":"2024-01-22T05:09:52.307278+0000","last_became_peered":"2024-01-22T05:09:52.307278+0000","last_unstale":"2024-01-22T05:09:52.311553+0000","last_undegraded":"2024-01-22T05:09:52.311553+0000","last_fullsized":"2024-01-22T05:09:52.311553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274110+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295147+0000","last_change":"2024-01-22T05:09:52.295147+0000","last_active":"2024-01-22T05:09:52.295147+0000","last_peered":"2024-01-22T05:09:52.295147+0000","last_clean":"2024-01-22T05:09:52.295147+0000","last_became_active":"2024-01-22T05:09:52.294863+0000","last_became_peered":"2024-01-22T05:09:52.294863+0000","last_unstale":"2024-01-22T05:09:52.295147+0000","last_undegraded":"2024-01-22T05:09:52.295147+0000","last_fullsized":"2024-01-22T05:09:52.295147+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280924+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.293685+0000","last_change":"2024-01-22T05:09:52.293685+0000","last_active":"2024-01-22T05:09:52.293685+0000","last_peered":"2024-01-22T05:09:52.293685+0000","last_clean":"2024-01-22T05:09:52.293685+0000","last_became_active":"2024-01-22T05:09:52.292089+0000","last_became_peered":"2024-01-22T05:09:52.292089+0000","last_unstale":"2024-01-22T05:09:52.293685+0000","last_undegraded":"2024-01-22T05:09:52.293685+0000","last_fullsized":"2024-01-22T05:09:52.293685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273548+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305465+0000","last_change":"2024-01-22T05:09:52.305465+0000","last_active":"2024-01-22T05:09:52.305465+0000","last_peered":"2024-01-22T05:09:52.305465+0000","last_clean":"2024-01-22T05:09:52.305465+0000","last_became_active":"2024-01-22T05:09:52.305188+0000","last_became_peered":"2024-01-22T05:09:52.305188+0000","last_unstale":"2024-01-22T05:09:52.305465+0000","last_undegraded":"2024-01-22T05:09:52.305465+0000","last_fullsized":"2024-01-22T05:09:52.305465+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277473+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.299261+0000","last_change":"2024-01-22T05:09:52.299261+0000","last_active":"2024-01-22T05:09:52.299261+0000","last_peered":"2024-01-22T05:09:52.299261+0000","last_clean":"2024-01-22T05:09:52.299261+0000","last_became_active":"2024-01-22T05:09:52.298981+0000","last_became_peered":"2024-01-22T05:09:52.298981+0000","last_unstale":"2024-01-22T05:09:52.299261+0000","last_undegraded":"2024-01-22T05:09:52.299261+0000","last_fullsized":"2024-01-22T05:09:52.299261+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.277585+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295858+0000","last_change":"2024-01-22T05:09:52.295858+0000","last_active":"2024-01-22T05:09:52.295858+0000","last_peered":"2024-01-22T05:09:52.295858+0000","last_clean":"2024-01-22T05:09:52.295858+0000","last_became_active":"2024-01-22T05:09:52.295611+0000","last_became_peered":"2024-01-22T05:09:52.295611+0000","last_unstale":"2024-01-22T05:09:52.295858+0000","last_undegraded":"2024-01-22T05:09:52.295858+0000","last_fullsized":"2024-01-22T05:09:52.295858+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269623+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.290933+0000","last_change":"2024-01-22T05:09:52.290933+0000","last_active":"2024-01-22T05:09:52.290933+0000","last_peered":"2024-01-22T05:09:52.290933+0000","last_clean":"2024-01-22T05:09:52.290933+0000","last_became_active":"2024-01-22T05:09:52.290628+0000","last_became_peered":"2024-01-22T05:09:52.290628+0000","last_unstale":"2024-01-22T05:09:52.290933+0000","last_undegraded":"2024-01-22T05:09:52.290933+0000","last_fullsized":"2024-01-22T05:09:52.290933+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.285033+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.292061+0000","last_change":"2024-01-22T05:09:52.292061+0000","last_active":"2024-01-22T05:09:52.292061+0000","last_peered":"2024-01-22T05:09:52.292061+0000","last_clean":"2024-01-22T05:09:52.292061+0000","last_became_active":"2024-01-22T05:09:52.291734+0000","last_became_peered":"2024-01-22T05:09:52.291734+0000","last_unstale":"2024-01-22T05:09:52.292061+0000","last_undegraded":"2024-01-22T05:09:52.292061+0000","last_fullsized":"2024-01-22T05:09:52.292061+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280058+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303771+0000","last_change":"2024-01-22T05:09:52.303771+0000","last_active":"2024-01-22T05:09:52.303771+0000","last_peered":"2024-01-22T05:09:52.303771+0000","last_clean":"2024-01-22T05:09:52.303771+0000","last_became_active":"2024-01-22T05:09:52.303433+0000","last_became_peered":"2024-01-22T05:09:52.303433+0000","last_unstale":"2024-01-22T05:09:52.303771+0000","last_undegraded":"2024-01-22T05:09:52.303771+0000","last_fullsized":"2024-01-22T05:09:52.303771+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274421+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303933+0000","last_change":"2024-01-22T05:09:52.303933+0000","last_active":"2024-01-22T05:09:52.303933+0000","last_peered":"2024-01-22T05:09:52.303933+0000","last_clean":"2024-01-22T05:09:52.303933+0000","last_became_active":"2024-01-22T05:09:52.303636+0000","last_became_peered":"2024-01-22T05:09:52.303636+0000","last_unstale":"2024-01-22T05:09:52.303933+0000","last_undegraded":"2024-01-22T05:09:52.303933+0000","last_fullsized":"2024-01-22T05:09:52.303933+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.279808+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.307313+0000","last_change":"2024-01-22T05:09:52.307313+0000","last_active":"2024-01-22T05:09:52.307313+0000","last_peered":"2024-01-22T05:09:52.307313+0000","last_clean":"2024-01-22T05:09:52.307313+0000","last_became_active":"2024-01-22T05:09:52.306595+0000","last_became_peered":"2024-01-22T05:09:52.306595+0000","last_unstale":"2024-01-22T05:09:52.307313+0000","last_undegraded":"2024-01-22T05:09:52.307313+0000","last_fullsized":"2024-01-22T05:09:52.307313+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.272936+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295140+0000","last_change":"2024-01-22T05:09:52.295140+0000","last_active":"2024-01-22T05:09:52.295140+0000","last_peered":"2024-01-22T05:09:52.295140+0000","last_clean":"2024-01-22T05:09:52.295140+0000","last_became_active":"2024-01-22T05:09:52.294851+0000","last_became_peered":"2024-01-22T05:09:52.294851+0000","last_unstale":"2024-01-22T05:09:52.295140+0000","last_undegraded":"2024-01-22T05:09:52.295140+0000","last_fullsized":"2024-01-22T05:09:52.295140+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273378+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.301225+0000","last_change":"2024-01-22T05:09:52.301225+0000","last_active":"2024-01-22T05:09:52.301225+0000","last_peered":"2024-01-22T05:09:52.301225+0000","last_clean":"2024-01-22T05:09:52.301225+0000","last_became_active":"2024-01-22T05:09:52.300908+0000","last_became_peered":"2024-01-22T05:09:52.300908+0000","last_unstale":"2024-01-22T05:09:52.301225+0000","last_undegraded":"2024-01-22T05:09:52.301225+0000","last_fullsized":"2024-01-22T05:09:52.301225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271848+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287231+0000","last_change":"2024-01-22T05:09:52.287231+0000","last_active":"2024-01-22T05:09:52.287231+0000","last_peered":"2024-01-22T05:09:52.287231+0000","last_clean":"2024-01-22T05:09:52.287231+0000","last_became_active":"2024-01-22T05:09:52.286426+0000","last_became_peered":"2024-01-22T05:09:52.286426+0000","last_unstale":"2024-01-22T05:09:52.287231+0000","last_undegraded":"2024-01-22T05:09:52.287231+0000","last_fullsized":"2024-01-22T05:09:52.287231+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274230+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.305843+0000","last_change":"2024-01-22T05:09:52.305843+0000","last_active":"2024-01-22T05:09:52.305843+0000","last_peered":"2024-01-22T05:09:52.305843+0000","last_clean":"2024-01-22T05:09:52.305843+0000","last_became_active":"2024-01-22T05:09:52.305568+0000","last_became_peered":"2024-01-22T05:09:52.305568+0000","last_unstale":"2024-01-22T05:09:52.305843+0000","last_undegraded":"2024-01-22T05:09:52.305843+0000","last_fullsized":"2024-01-22T05:09:52.305843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.266819+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285803+0000","last_change":"2024-01-22T05:09:52.285803+0000","last_active":"2024-01-22T05:09:52.285803+0000","last_peered":"2024-01-22T05:09:52.285803+0000","last_clean":"2024-01-22T05:09:52.285803+0000","last_became_active":"2024-01-22T05:09:52.285448+0000","last_became_peered":"2024-01-22T05:09:52.285448+0000","last_unstale":"2024-01-22T05:09:52.285803+0000","last_undegraded":"2024-01-22T05:09:52.285803+0000","last_fullsized":"2024-01-22T05:09:52.285803+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.280591+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287765+0000","last_change":"2024-01-22T05:09:52.287765+0000","last_active":"2024-01-22T05:09:52.287765+0000","last_peered":"2024-01-22T05:09:52.287765+0000","last_clean":"2024-01-22T05:09:52.287765+0000","last_became_active":"2024-01-22T05:09:52.287495+0000","last_became_peered":"2024-01-22T05:09:52.287495+0000","last_unstale":"2024-01-22T05:09:52.287765+0000","last_undegraded":"2024-01-22T05:09:52.287765+0000","last_fullsized":"2024-01-22T05:09:52.287765+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269526+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.303069+0000","last_change":"2024-01-22T05:09:52.303069+0000","last_active":"2024-01-22T05:09:52.303069+0000","last_peered":"2024-01-22T05:09:52.303069+0000","last_clean":"2024-01-22T05:09:52.303069+0000","last_became_active":"2024-01-22T05:09:52.302706+0000","last_became_peered":"2024-01-22T05:09:52.302706+0000","last_unstale":"2024-01-22T05:09:52.303069+0000","last_undegraded":"2024-01-22T05:09:52.303069+0000","last_fullsized":"2024-01-22T05:09:52.303069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.284777+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295007+0000","last_change":"2024-01-22T05:09:52.295007+0000","last_active":"2024-01-22T05:09:52.295007+0000","last_peered":"2024-01-22T05:09:52.295007+0000","last_clean":"2024-01-22T05:09:52.295007+0000","last_became_active":"2024-01-22T05:09:52.293628+0000","last_became_peered":"2024-01-22T05:09:52.293628+0000","last_unstale":"2024-01-22T05:09:52.295007+0000","last_undegraded":"2024-01-22T05:09:52.295007+0000","last_fullsized":"2024-01-22T05:09:52.295007+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274617+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.287832+0000","last_change":"2024-01-22T05:09:52.287832+0000","last_active":"2024-01-22T05:09:52.287832+0000","last_peered":"2024-01-22T05:09:52.287832+0000","last_clean":"2024-01-22T05:09:52.287832+0000","last_became_active":"2024-01-22T05:09:52.287276+0000","last_became_peered":"2024-01-22T05:09:52.287276+0000","last_unstale":"2024-01-22T05:09:52.287832+0000","last_undegraded":"2024-01-22T05:09:52.287832+0000","last_fullsized":"2024-01-22T05:09:52.287832+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.267332+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.282595+0000","last_change":"2024-01-22T05:09:52.282595+0000","last_active":"2024-01-22T05:09:52.282595+0000","last_peered":"2024-01-22T05:09:52.282595+0000","last_clean":"2024-01-22T05:09:52.282595+0000","last_became_active":"2024-01-22T05:09:52.282317+0000","last_became_peered":"2024-01-22T05:09:52.282317+0000","last_unstale":"2024-01-22T05:09:52.282595+0000","last_undegraded":"2024-01-22T05:09:52.282595+0000","last_fullsized":"2024-01-22T05:09:52.282595+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276297+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.278471+0000","last_change":"2024-01-22T05:09:52.278471+0000","last_active":"2024-01-22T05:09:52.278471+0000","last_peered":"2024-01-22T05:09:52.278471+0000","last_clean":"2024-01-22T05:09:52.278471+0000","last_became_active":"2024-01-22T05:09:52.278138+0000","last_became_peered":"2024-01-22T05:09:52.278138+0000","last_unstale":"2024-01-22T05:09:52.278471+0000","last_undegraded":"2024-01-22T05:09:52.278471+0000","last_fullsized":"2024-01-22T05:09:52.278471+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.259071+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:09:51.259071+0000","last_peered":"2024-01-22T05:09:51.259071+0000","last_clean":"2024-01-22T05:09:51.259071+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:09:51.259071+0000","last_undegraded":"2024-01-22T05:09:51.259071+0000","last_fullsized":"2024-01-22T05:09:51.259071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.270273+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.283612+0000","last_change":"2024-01-22T05:09:52.283612+0000","last_active":"2024-01-22T05:09:52.283612+0000","last_peered":"2024-01-22T05:09:52.283612+0000","last_clean":"2024-01-22T05:09:52.283612+0000","last_became_active":"2024-01-22T05:09:52.283314+0000","last_became_peered":"2024-01-22T05:09:52.283314+0000","last_unstale":"2024-01-22T05:09:52.283612+0000","last_undegraded":"2024-01-22T05:09:52.283612+0000","last_fullsized":"2024-01-22T05:09:52.283612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252669+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:09:51.252669+0000","last_peered":"2024-01-22T05:09:51.252669+0000","last_clean":"2024-01-22T05:09:51.252669+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:09:51.252669+0000","last_undegraded":"2024-01-22T05:09:51.252669+0000","last_fullsized":"2024-01-22T05:09:51.252669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.276907+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.288015+0000","last_change":"2024-01-22T05:09:52.288015+0000","last_active":"2024-01-22T05:09:52.288015+0000","last_peered":"2024-01-22T05:09:52.288015+0000","last_clean":"2024-01-22T05:09:52.288015+0000","last_became_active":"2024-01-22T05:09:52.285604+0000","last_became_peered":"2024-01-22T05:09:52.285604+0000","last_unstale":"2024-01-22T05:09:52.288015+0000","last_undegraded":"2024-01-22T05:09:52.288015+0000","last_fullsized":"2024-01-22T05:09:52.288015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.256904+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:09:51.256904+0000","last_peered":"2024-01-22T05:09:51.256904+0000","last_clean":"2024-01-22T05:09:51.256904+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:09:51.256904+0000","last_undegraded":"2024-01-22T05:09:51.256904+0000","last_fullsized":"2024-01-22T05:09:51.256904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.269848+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.292815+0000","last_change":"2024-01-22T05:09:52.292815+0000","last_active":"2024-01-22T05:09:52.292815+0000","last_peered":"2024-01-22T05:09:52.292815+0000","last_clean":"2024-01-22T05:09:52.292815+0000","last_became_active":"2024-01-22T05:09:52.292500+0000","last_became_peered":"2024-01-22T05:09:52.292500+0000","last_unstale":"2024-01-22T05:09:52.292815+0000","last_undegraded":"2024-01-22T05:09:52.292815+0000","last_fullsized":"2024-01-22T05:09:52.292815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252447+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:09:51.252447+0000","last_peered":"2024-01-22T05:09:51.252447+0000","last_clean":"2024-01-22T05:09:51.252447+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:09:51.252447+0000","last_undegraded":"2024-01-22T05:09:51.252447+0000","last_fullsized":"2024-01-22T05:09:51.252447+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.281075+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.309505+0000","last_change":"2024-01-22T05:09:52.309505+0000","last_active":"2024-01-22T05:09:52.309505+0000","last_peered":"2024-01-22T05:09:52.309505+0000","last_clean":"2024-01-22T05:09:52.309505+0000","last_became_active":"2024-01-22T05:09:52.305992+0000","last_became_peered":"2024-01-22T05:09:52.305992+0000","last_unstale":"2024-01-22T05:09:52.309505+0000","last_undegraded":"2024-01-22T05:09:52.309505+0000","last_fullsized":"2024-01-22T05:09:52.309505+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252035+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:09:51.252035+0000","last_peered":"2024-01-22T05:09:51.252035+0000","last_clean":"2024-01-22T05:09:51.252035+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:09:51.252035+0000","last_undegraded":"2024-01-22T05:09:51.252035+0000","last_fullsized":"2024-01-22T05:09:51.252035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.273491+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.285964+0000","last_change":"2024-01-22T05:09:52.285964+0000","last_active":"2024-01-22T05:09:52.285964+0000","last_peered":"2024-01-22T05:09:52.285964+0000","last_clean":"2024-01-22T05:09:52.285964+0000","last_became_active":"2024-01-22T05:09:52.285512+0000","last_became_peered":"2024-01-22T05:09:52.285512+0000","last_unstale":"2024-01-22T05:09:52.285964+0000","last_undegraded":"2024-01-22T05:09:52.285964+0000","last_fullsized":"2024-01-22T05:09:52.285964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.264655+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:09:51.264655+0000","last_peered":"2024-01-22T05:09:51.264655+0000","last_clean":"2024-01-22T05:09:51.264655+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:09:51.264655+0000","last_undegraded":"2024-01-22T05:09:51.264655+0000","last_fullsized":"2024-01-22T05:09:51.264655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.271035+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.302187+0000","last_change":"2024-01-22T05:09:52.302187+0000","last_active":"2024-01-22T05:09:52.302187+0000","last_peered":"2024-01-22T05:09:52.302187+0000","last_clean":"2024-01-22T05:09:52.302187+0000","last_became_active":"2024-01-22T05:09:52.301852+0000","last_became_peered":"2024-01-22T05:09:52.301852+0000","last_unstale":"2024-01-22T05:09:52.302187+0000","last_undegraded":"2024-01-22T05:09:52.302187+0000","last_fullsized":"2024-01-22T05:09:52.302187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.256651+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:09:51.256651+0000","last_peered":"2024-01-22T05:09:51.256651+0000","last_clean":"2024-01-22T05:09:51.256651+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:09:51.256651+0000","last_undegraded":"2024-01-22T05:09:51.256651+0000","last_fullsized":"2024-01-22T05:09:51.256651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:09:52.246134+0000","last_change":"2024-01-22T05:09:52.274572+0000","last_active":"2024-01-22T05:09:52.246134+0000","last_peered":"2024-01-22T05:09:52.246134+0000","last_clean":"2024-01-22T05:09:52.246134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:09:52.246134+0000","last_undegraded":"2024-01-22T05:09:52.246134+0000","last_fullsized":"2024-01-22T05:09:52.246134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.295705+0000","last_change":"2024-01-22T05:09:52.295705+0000","last_active":"2024-01-22T05:09:52.295705+0000","last_peered":"2024-01-22T05:09:52.295705+0000","last_clean":"2024-01-22T05:09:52.295705+0000","last_became_active":"2024-01-22T05:09:52.295379+0000","last_became_peered":"2024-01-22T05:09:52.295379+0000","last_unstale":"2024-01-22T05:09:52.295705+0000","last_undegraded":"2024-01-22T05:09:52.295705+0000","last_fullsized":"2024-01-22T05:09:52.295705+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.252037+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:09:51.252037+0000","last_peered":"2024-01-22T05:09:51.252037+0000","last_clean":"2024-01-22T05:09:51.252037+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:09:51.252037+0000","last_undegraded":"2024-01-22T05:09:51.252037+0000","last_fullsized":"2024-01-22T05:09:51.252037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":64,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-22T05:09:51.256760+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:09:51.256760+0000","last_peered":"2024-01-22T05:09:51.256760+0000","last_clean":"2024-01-22T05:09:51.256760+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:09:51.256760+0000","last_undegraded":"2024-01-22T05:09:51.256760+0000","last_fullsized":"2024-01-22T05:09:51.256760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065536,"statfs":{"total":96636764160,"available":96323108864,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.98699999999999999,"15min":1.0409999999999999},"min":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.548},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.71499999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.873}]},{"osd":1,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.04,"15min":0.98799999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.141,"15min":1.1699999999999999},"min":{"1min":0.78400000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5309999999999999,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.2649999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1279999999999999,"15min":1.1060000000000001},"min":{"1min":0.81399999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":2.5150000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.169,"15min":1.173},"min":{"1min":0.79700000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.6719999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.234,"15min":1.236},"min":{"1min":0.90300000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5720000000000001,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.8620000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.21,"15min":1.228},"min":{"1min":0.93999999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.4039999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.1299999999999999,"15min":1.071},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.1879999999999999,"15min":1.1679999999999999},"min":{"1min":1.01,"5min":0.751,"15min":0.751},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":2.077}]},{"osd":5,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.2290000000000001,"15min":1.2010000000000001},"min":{"1min":0.61199999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":2.0110000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.3169999999999999,"15min":1.2330000000000001},"min":{"1min":1.0860000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":3.625,"5min":3.625,"15min":3.625},"last":2.1819999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.256,"15min":1.258},"min":{"1min":0.999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.732,"5min":1.823,"15min":1.823},"last":1.9430000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.379,"15min":1.335},"min":{"1min":1.1140000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.8129999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":2.262}]}]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310412,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061428,"statfs":{"total":96636764160,"available":96318902272,"internally_reserved":0,"allocated":1052672,"data_stored":512874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.794,"15min":1.3340000000000001},"min":{"1min":0.74299999999999999,"5min":0.372,"15min":0.372},"max":{"1min":2.0219999999999998,"5min":77.745000000000005,"15min":77.745000000000005},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1659999999999999,"15min":1.091},"min":{"1min":0.60799999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.7509999999999999,"5min":13.555999999999999,"15min":13.555999999999999},"last":0.71199999999999997}]},{"osd":1,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1499999999999999,"15min":1.0980000000000001},"min":{"1min":0.66000000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3899999999999999,"5min":15.499000000000001,"15min":15.499000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.141,"5min":1.222,"15min":1.2430000000000001},"min":{"1min":0.63600000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.177,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":1.117}]},{"osd":2,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1499999999999999,"15min":1.1599999999999999},"min":{"1min":0.79300000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.9470000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1379999999999999,"15min":1.1220000000000001},"min":{"1min":0.77300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6040000000000001,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.0369999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":2.113,"15min":1.46},"min":{"1min":0.749,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.706,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.2689999999999999,"15min":1.234},"min":{"1min":0.75800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.367,"5min":15.468,"15min":15.468},"last":0.876}]},{"osd":4,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1439999999999999,"15min":1.101},"min":{"1min":0.85499999999999998,"5min":0.495,"15min":0.495},"max":{"1min":1.8200000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":1.29},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.1299999999999999},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.619,"5min":1.649,"15min":1.649},"last":1.149}]},{"osd":5,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.4139999999999999,"15min":1.266},"min":{"1min":0.84599999999999997,"5min":0.624,"15min":0.624},"max":{"1min":1.5800000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.3109999999999999,"15min":1.2849999999999999},"min":{"1min":0.88300000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.4239999999999999,"5min":3.875,"15min":3.875},"last":1.214}]},{"osd":7,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.536,"15min":1.4379999999999999},"min":{"1min":0.89200000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.905,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.895,"15min":1.5840000000000001},"min":{"1min":0.93799999999999994,"5min":0.495,"15min":0.495},"max":{"1min":1.6140000000000001,"5min":63.737000000000002,"15min":63.737000000000002},"last":1.2410000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310400,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061440,"statfs":{"total":96636764160,"available":96318914560,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":0.998,"15min":0.998},"min":{"1min":0.80300000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":2.0609999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.036,"15min":1.105},"min":{"1min":0.70799999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.5680000000000001,"5min":1.571,"15min":1.571},"last":1.377}]},{"osd":1,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.163,"15min":1.2170000000000001},"min":{"1min":1.119,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.516,"5min":1.821,"15min":1.821},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2030000000000001,"15min":1.302},"min":{"1min":0.96599999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5329999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":2.0209999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.1539999999999999,"15min":1.1599999999999999},"min":{"1min":0.86899999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.617,"5min":1.629,"15min":1.629},"last":1.925},{"interface":"front","average":{"1min":1.163,"5min":1.0960000000000001,"15min":1.1419999999999999},"min":{"1min":0.90500000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3680000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.859}]},{"osd":3,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.143,"15min":1.1850000000000001},"min":{"1min":0.83199999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.49,"5min":1.931,"15min":1.931},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.298,"5min":1.22,"15min":1.3029999999999999},"min":{"1min":0.79900000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5509999999999999,"5min":2.266,"15min":2.266},"last":1.506}]},{"osd":4,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1220000000000001,"15min":1.1859999999999999},"min":{"1min":0.82599999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.518,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.226,"15min":1.298},"min":{"1min":0.85499999999999998,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8300000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.798}]},{"osd":6,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.264,"15min":1.343},"min":{"1min":0.879,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6699999999999999,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.8129999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.2749999999999999,"15min":1.3109999999999999},"min":{"1min":0.99299999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7829999999999999,"5min":1.909,"15min":1.909},"last":1.323}]},{"osd":7,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3560000000000001,"15min":1.423},"min":{"1min":0.91100000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.766,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3899999999999999,"15min":1.476},"min":{"1min":1.0589999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.671,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.2290000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310400,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061440,"statfs":{"total":96636764160,"available":96318914560,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.1140000000000001,"15min":1.143},"min":{"1min":0.65800000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6719999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.018},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.133,"15min":1.103},"min":{"1min":0.63400000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.042}]},{"osd":1,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.0569999999999999,"15min":1.0860000000000001},"min":{"1min":0.69399999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.159},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.083,"15min":1.1870000000000001},"min":{"1min":0.66400000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5329999999999999,"5min":2.194,"15min":2.194},"last":1.1819999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.099,"15min":1.091},"min":{"1min":0.68300000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4470000000000001,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":0.876},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.177,"15min":1.272},"min":{"1min":0.78400000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.536,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.099}]},{"osd":3,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.133,"15min":1.1839999999999999},"min":{"1min":0.89100000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.514,"5min":1.589,"15min":1.589},"last":1.01},{"interface":"front","average":{"1min":1.175,"5min":1.1850000000000001,"15min":1.1679999999999999},"min":{"1min":0.81599999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.54,"5min":5.3029999999999999,"15min":5.3029999999999999},"last":0.91100000000000003}]},{"osd":5,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1639999999999999,"15min":1.2170000000000001},"min":{"1min":0.85099999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.667,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.129,"5min":1.1220000000000001,"15min":1.1579999999999999},"min":{"1min":0.84599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.597,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.97299999999999998}]},{"osd":6,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.196,"15min":1.1919999999999999},"min":{"1min":0.85299999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6160000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.278,"5min":1.331,"15min":1.415},"min":{"1min":0.89700000000000002,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.7270000000000001,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.73499999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3220000000000001,"15min":1.3660000000000001},"min":{"1min":0.878,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.833,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.119},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.363,"15min":1.3799999999999999},"min":{"1min":1.0089999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6359999999999999,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":0.83599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310412,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061428,"statfs":{"total":96636764160,"available":96318902272,"internally_reserved":0,"allocated":1052672,"data_stored":512874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.95099999999999996,"15min":0.90500000000000003},"min":{"1min":0.55300000000000005,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4179999999999999,"5min":14.859,"15min":14.859},"last":0.752},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.94399999999999995,"15min":0.88800000000000001},"min":{"1min":0.55700000000000005,"5min":0.317,"15min":0.317},"max":{"1min":1.4119999999999999,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":0.51500000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.874,"15min":0.85599999999999998},"min":{"1min":0.66900000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2110000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.872},{"interface":"front","average":{"1min":1.01,"5min":1,"15min":0.98599999999999999},"min":{"1min":0.63300000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4079999999999999,"5min":5.7519999999999998,"15min":5.7519999999999998},"last":0.85199999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.085,"15min":1.159},"min":{"1min":0.64000000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1799999999999999,"15min":1.194},"min":{"1min":0.72999999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2,"5min":2,"15min":2},"last":1.0589999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.2889999999999999,"15min":1.296},"min":{"1min":0.71299999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.718,"5min":5.016,"15min":5.016},"last":1.23},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3420000000000001,"15min":1.3380000000000001},"min":{"1min":1.0469999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.633,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":1.3089999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3,"15min":1.298},"min":{"1min":1.0169999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.7090000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":1.149},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4830000000000001,"15min":1.345},"min":{"1min":0.94699999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.851,"5min":14.523999999999999,"15min":14.523999999999999},"last":1.1970000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.365,"15min":1.415},"min":{"1min":0.90500000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.752,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.4350000000000001,"15min":1.4219999999999999},"min":{"1min":0.95399999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.7370000000000001,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":1.369}]},{"osd":7,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.405,"15min":1.403},"min":{"1min":0.995,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.861,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":1.27},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.411,"15min":1.427},"min":{"1min":0.97799999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1139999999999999,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":1.2829999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574915,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065536,"statfs":{"total":96636764160,"available":96323108864,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.76000000000000001,"15min":0.75600000000000001},"min":{"1min":0.63600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2709999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.995,"5min":0.85799999999999998,"15min":0.83499999999999996},"min":{"1min":0.62,"5min":0.373,"15min":0.373},"max":{"1min":1.6559999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.99299999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.83199999999999996,"15min":0.80600000000000005},"min":{"1min":0.59399999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.995,"5min":0.91900000000000004,"15min":0.94199999999999995},"min":{"1min":0.755,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2569999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.95899999999999996}]},{"osd":3,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1000000000000001,"15min":1.0669999999999999},"min":{"1min":0.63300000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.79,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.1819999999999999,"15min":1.173},"min":{"1min":0.76600000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.73,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.357}]},{"osd":4,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.254,"15min":1.306},"min":{"1min":1.1890000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5940000000000001,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.1819999999999999,"15min":1.2090000000000001},"min":{"1min":0.93300000000000005,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.694,"5min":1.952,"15min":1.952},"last":1.389}]},{"osd":5,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2130000000000001,"15min":1.196},"min":{"1min":0.88300000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.597,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.266,"15min":1.319},"min":{"1min":1.022,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5629999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.2010000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.2350000000000001,"15min":1.2589999999999999},"min":{"1min":0.97499999999999998,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8360000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.292,"15min":1.2909999999999999},"min":{"1min":1.0389999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.6990000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.224}]},{"osd":7,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.3200000000000001,"15min":1.357},"min":{"1min":1.081,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.867,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.468,"5min":1.405,"15min":1.413},"min":{"1min":1.2050000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.877,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.518}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310400,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061440,"statfs":{"total":96636764160,"available":96318914560,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.90500000000000003,"15min":0.85499999999999998},"min":{"1min":0.69899999999999995,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2230000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.749},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.98899999999999999,"15min":1.0009999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.873,"5min":2.101,"15min":2.101},"last":0.94499999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.98499999999999999,"15min":1.0029999999999999},"min":{"1min":0.63200000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4390000000000001,"5min":1.722,"15min":1.722},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.071,"5min":1.042,"15min":1.03},"min":{"1min":0.64200000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.494,"5min":2.008,"15min":2.008},"last":1.1759999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0569999999999999,"15min":1.0049999999999999},"min":{"1min":0.71699999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":4.665,"15min":4.665},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.89600000000000002,"15min":0.88100000000000001},"min":{"1min":0.58499999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.333,"5min":1.867,"15min":1.867},"last":0.77400000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2210000000000001,"15min":1.206},"min":{"1min":0.92800000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.605,"5min":1.788,"15min":1.788},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2949999999999999,"15min":1.2569999999999999},"min":{"1min":0.96199999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6439999999999999,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":1.1080000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.1930000000000001,"15min":1.1910000000000001},"min":{"1min":0.80000000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.048},{"interface":"front","average":{"1min":1.401,"5min":1.292,"15min":1.278},"min":{"1min":1.0349999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.9430000000000001,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.871}]},{"osd":6,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.83899999999999997,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.74,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.349,"15min":1.3420000000000001},"min":{"1min":0.98599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.893,"5min":2.294,"15min":2.294},"last":1.1579999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.397,"15min":1.379},"min":{"1min":0.92700000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.764,"5min":4.4329999999999998,"15min":4.4329999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":1.0149999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.0329999999999999,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":1.1970000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574915,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065536,"statfs":{"total":96636764160,"available":96323108864,"internally_reserved":0,"allocated":1040384,"data_stored":505842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.6419999999999999,"5min":0.97499999999999998,"15min":0.96399999999999997},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":15.273,"5min":15.273,"15min":15.273},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.91800000000000004,"15min":0.98299999999999998},"min":{"1min":0.51800000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.3149999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.716,"5min":1.1319999999999999,"15min":1.1140000000000001},"min":{"1min":0.56499999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":15.473000000000001,"5min":15.473000000000001,"15min":15.473000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.008,"15min":1.024},"min":{"1min":0.68700000000000006,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.589,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.1259999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":0.99399999999999999,"15min":1.0349999999999999},"min":{"1min":0.59499999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.3970000000000002,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.931,"5min":1.256,"15min":1.25},"min":{"1min":0.71699999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":15.439,"5min":15.439,"15min":15.439},"last":1.375}]},{"osd":4,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2509999999999999,"15min":1.369},"min":{"1min":0.751,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6200000000000001,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.405},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.23,"15min":1.258},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":1.149}]},{"osd":5,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.272,"15min":1.373},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.891,"5min":3.548,"15min":3.548},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.3220000000000001,"15min":1.4159999999999999},"min":{"1min":0.80500000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.2769999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":2.149,"5min":1.51,"15min":1.4870000000000001},"min":{"1min":0.89100000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":15.4,"5min":15.4,"15min":15.4},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.6899999999999999,"5min":1.411,"15min":1.512},"min":{"1min":1.0489999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":7.1349999999999998,"5min":7.1349999999999998,"15min":7.1349999999999998},"last":1.2370000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4279999999999999,"15min":1.621},"min":{"1min":1.1040000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.1080000000000001,"5min":5.29,"15min":5.29},"last":1.486},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.361,"15min":1.4350000000000001},"min":{"1min":0.93400000000000005,"5min":0.752,"15min":0.752},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.4259999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:10:01.783 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:10:01.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.946+0000 7fd507400700 1 Processor -- start 2024-01-22T05:10:01.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.946+0000 7fd507400700 1 -- start start 2024-01-22T05:10:01.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd507400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd500065240 0x7fd5000644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:01.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd507400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd500065620 0x7fd5000649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:01.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd507400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd50015b9b0 0x7fd50015be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:01.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd507400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd500064ed0 con 0x7fd500065240 2024-01-22T05:10:01.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd507400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5000c2700 con 0x7fd500065620 2024-01-22T05:10:01.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd507400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5000c29a0 con 0x7fd50015b9b0 2024-01-22T05:10:01.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd504a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd500065240 0x7fd5000644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:01.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd504a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd500065240 0x7fd5000644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54542/0 (socket says 172.21.15.49:54542) 2024-01-22T05:10:01.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd504a00700 1 -- 172.21.15.49:0/3819056281 learned_addr learned my addr 172.21.15.49:0/3819056281 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:10:01.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd4ffe00700 1 --2- 172.21.15.49:0/3819056281 >> v2:172.21.15.110:3300/0 conn(0x7fd500065620 0x7fd5000649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:01.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd505e00700 1 --2- 172.21.15.49:0/3819056281 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd50015b9b0 0x7fd50015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:01.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd504a00700 1 -- 172.21.15.49:0/3819056281 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd50015b9b0 msgr2=0x7fd50015be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:10:01.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd504a00700 1 --2- 172.21.15.49:0/3819056281 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd50015b9b0 0x7fd50015be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:01.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd504a00700 1 -- 172.21.15.49:0/3819056281 >> v2:172.21.15.110:3300/0 conn(0x7fd500065620 msgr2=0x7fd5000649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:10:01.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd504a00700 1 --2- 172.21.15.49:0/3819056281 >> v2:172.21.15.110:3300/0 conn(0x7fd500065620 0x7fd5000649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:01.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd504a00700 1 -- 172.21.15.49:0/3819056281 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5000c2c80 con 0x7fd500065240 2024-01-22T05:10:01.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd4ffe00700 1 --2- 172.21.15.49:0/3819056281 >> v2:172.21.15.110:3300/0 conn(0x7fd500065620 0x7fd5000649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:10:01.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd504a00700 1 --2- 172.21.15.49:0/3819056281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd500065240 0x7fd5000644f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7fd5000c4770 tx=0x7fd4f00090f0).ready entity=mon.0 client_cookie=88846df1ba8cb3e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:01.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd4ff400700 1 -- 172.21.15.49:0/3819056281 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f000b600 con 0x7fd500065240 2024-01-22T05:10:01.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd4ff400700 1 -- 172.21.15.49:0/3819056281 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f000b760 con 0x7fd500065240 2024-01-22T05:10:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd4ff400700 1 -- 172.21.15.49:0/3819056281 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f000bae0 con 0x7fd500065240 2024-01-22T05:10:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd507400700 1 -- 172.21.15.49:0/3819056281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd500065240 msgr2=0x7fd5000644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.950+0000 7fd507400700 1 --2- 172.21.15.49:0/3819056281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd500065240 0x7fd5000644f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7fd5000c4770 tx=0x7fd4f00090f0).stop 2024-01-22T05:10:01.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.954+0000 7fd507400700 1 -- 172.21.15.49:0/3819056281 shutdown_connections 2024-01-22T05:10:01.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.954+0000 7fd507400700 1 --2- 172.21.15.49:0/3819056281 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd50015b9b0 0x7fd50015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:01.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.954+0000 7fd507400700 1 --2- 172.21.15.49:0/3819056281 >> v2:172.21.15.110:3300/0 conn(0x7fd500065620 0x7fd5000649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:01.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.954+0000 7fd507400700 1 --2- 172.21.15.49:0/3819056281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd500065240 0x7fd5000644f0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:01.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.954+0000 7fd507400700 1 -- 172.21.15.49:0/3819056281 >> 172.21.15.49:0/3819056281 conn(0x7fd5000c87f0 msgr2=0x7fd5000c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:01.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.954+0000 7fd507400700 1 -- 172.21.15.49:0/3819056281 shutdown_connections 2024-01-22T05:10:01.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.954+0000 7fd507400700 1 -- 172.21.15.49:0/3819056281 wait complete. 2024-01-22T05:10:01.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.958+0000 7fd507400700 1 Processor -- start 2024-01-22T05:10:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.958+0000 7fd507400700 1 -- start start 2024-01-22T05:10:01.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.958+0000 7fd507400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd500065240 0x7fd50015b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.958+0000 7fd507400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd500065620 0x7fd5000a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.958+0000 7fd507400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd50015b9b0 0x7fd5000c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.958+0000 7fd507400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50015a230 con 0x7fd500065240 2024-01-22T05:10:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.958+0000 7fd507400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd500169690 con 0x7fd500065620 2024-01-22T05:10:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.958+0000 7fd507400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50015a460 con 0x7fd50015b9b0 2024-01-22T05:10:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.958+0000 7fd504a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd500065240 0x7fd50015b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.958+0000 7fd504a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd500065240 0x7fd50015b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54546/0 (socket says 172.21.15.49:54546) 2024-01-22T05:10:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.958+0000 7fd504a00700 1 -- 172.21.15.49:0/900127201 learned_addr learned my addr 172.21.15.49:0/900127201 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:10:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.962+0000 7fd4ffe00700 1 --2- 172.21.15.49:0/900127201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd500065620 0x7fd5000a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.962+0000 7fd505e00700 1 --2- 172.21.15.49:0/900127201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd50015b9b0 0x7fd5000c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.962+0000 7fd504a00700 1 -- 172.21.15.49:0/900127201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd50015b9b0 msgr2=0x7fd5000c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.962+0000 7fd504a00700 1 --2- 172.21.15.49:0/900127201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd50015b9b0 0x7fd5000c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.962+0000 7fd504a00700 1 -- 172.21.15.49:0/900127201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd500065620 msgr2=0x7fd5000a9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:01.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.962+0000 7fd504a00700 1 --2- 172.21.15.49:0/900127201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd500065620 0x7fd5000a9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:01.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.962+0000 7fd504a00700 1 -- 172.21.15.49:0/900127201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f0009370 con 0x7fd500065240 2024-01-22T05:10:01.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.962+0000 7fd4ffe00700 1 --2- 172.21.15.49:0/900127201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd500065620 0x7fd5000a9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:10:01.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.962+0000 7fd504a00700 1 --2- 172.21.15.49:0/900127201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd500065240 0x7fd50015b220 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7fd4f0009130 tx=0x7fd4f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:01.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.962+0000 7fd4f7e00700 1 -- 172.21.15.49:0/900127201 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f000bae0 con 0x7fd500065240 2024-01-22T05:10:01.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.962+0000 7fd4f7e00700 1 -- 172.21.15.49:0/900127201 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f0000c90 con 0x7fd500065240 2024-01-22T05:10:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.962+0000 7fd507400700 1 -- 172.21.15.49:0/900127201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50015a740 con 0x7fd500065240 2024-01-22T05:10:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.962+0000 7fd4f7e00700 1 -- 172.21.15.49:0/900127201 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f001c670 con 0x7fd500065240 2024-01-22T05:10:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.962+0000 7fd507400700 1 -- 172.21.15.49:0/900127201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50015ad00 con 0x7fd500065240 2024-01-22T05:10:01.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.962+0000 7fd507400700 1 -- 172.21.15.49:0/900127201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd500047060 con 0x7fd500065240 2024-01-22T05:10:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.966+0000 7fd4f7e00700 1 -- 172.21.15.49:0/900127201 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd4f001ca20 con 0x7fd500065240 2024-01-22T05:10:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.966+0000 7fd4f7e00700 1 --2- 172.21.15.49:0/900127201 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd4d805a510 0x7fd4d805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.966+0000 7fd4f7e00700 1 -- 172.21.15.49:0/900127201 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd4f0076700 con 0x7fd500065240 2024-01-22T05:10:01.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.966+0000 7fd4ffe00700 1 --2- 172.21.15.49:0/900127201 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd4d805a510 0x7fd4d805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.970+0000 7fd4ffe00700 1 --2- 172.21.15.49:0/900127201 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd4d805a510 0x7fd4d805c9d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fd5001558b0 tx=0x7fd4e8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:01.974+0000 7fd4f7e00700 1 -- 172.21.15.49:0/900127201 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd4f0049d80 con 0x7fd500065240 2024-01-22T05:10:02.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.134+0000 7fd507400700 1 -- 172.21.15.49:0/900127201 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5000c2f60 con 0x7fd4d805a510 2024-01-22T05:10:02.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.150+0000 7fd4f7e00700 1 -- 172.21.15.49:0/900127201 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358895 (secure 0 0 0) 0x7fd5000c2f60 con 0x7fd4d805a510 2024-01-22T05:10:02.159 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:10:02.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.162+0000 7fd507400700 1 -- 172.21.15.49:0/900127201 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd4d805a510 msgr2=0x7fd4d805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:02.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.162+0000 7fd507400700 1 --2- 172.21.15.49:0/900127201 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd4d805a510 0x7fd4d805c9d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fd5001558b0 tx=0x7fd4e8008040).stop 2024-01-22T05:10:02.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.162+0000 7fd507400700 1 -- 172.21.15.49:0/900127201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd500065240 msgr2=0x7fd50015b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:02.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.162+0000 7fd507400700 1 --2- 172.21.15.49:0/900127201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd500065240 0x7fd50015b220 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7fd4f0009130 tx=0x7fd4f0017000).stop 2024-01-22T05:10:02.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.162+0000 7fd507400700 1 -- 172.21.15.49:0/900127201 shutdown_connections 2024-01-22T05:10:02.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.162+0000 7fd507400700 1 --2- 172.21.15.49:0/900127201 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd4d805a510 0x7fd4d805c9d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.162+0000 7fd507400700 1 --2- 172.21.15.49:0/900127201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd50015b9b0 0x7fd5000c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.162+0000 7fd507400700 1 --2- 172.21.15.49:0/900127201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd500065620 0x7fd5000a9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.162+0000 7fd507400700 1 --2- 172.21.15.49:0/900127201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd500065240 0x7fd50015b220 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.162+0000 7fd507400700 1 -- 172.21.15.49:0/900127201 >> 172.21.15.49:0/900127201 conn(0x7fd5000c87f0 msgr2=0x7fd500155e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:02.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.162+0000 7fd507400700 1 -- 172.21.15.49:0/900127201 shutdown_connections 2024-01-22T05:10:02.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.162+0000 7fd507400700 1 -- 172.21.15.49:0/900127201 wait complete. 2024-01-22T05:10:02.169 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:10:02.189 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-01-22T05:10:01.344403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":250,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2475360,"kb_used_data":8480,"kb_used_omap":0,"kb_used_meta":2466816,"kb_avail":752499360,"statfs":{"total":773094113280,"available":770559344640,"internally_reserved":0,"allocated":8683520,"data_stored":4224316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2526019584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-22899,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-52,"num_read_kb":-51,"num_write":-87,"num_write_kb":-51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":-10,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.850112"},"pg_stats":[{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.760029+0000","last_change":"2024-01-22T05:09:52.747937+0000","last_active":"2024-01-22T05:09:52.760029+0000","last_peered":"2024-01-22T05:09:52.760029+0000","last_clean":"2024-01-22T05:09:52.760029+0000","last_became_active":"2024-01-22T05:09:52.747633+0000","last_became_peered":"2024-01-22T05:09:52.747633+0000","last_unstale":"2024-01-22T05:09:52.760029+0000","last_undegraded":"2024-01-22T05:09:52.760029+0000","last_fullsized":"2024-01-22T05:09:52.760029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3f","version":"87'3","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.741284+0000","last_change":"2024-01-22T05:09:52.297569+0000","last_active":"2024-01-22T05:09:52.741284+0000","last_peered":"2024-01-22T05:09:52.741284+0000","last_clean":"2024-01-22T05:09:52.741284+0000","last_became_active":"2024-01-22T05:09:52.297023+0000","last_became_peered":"2024-01-22T05:09:52.297023+0000","last_unstale":"2024-01-22T05:09:52.741284+0000","last_undegraded":"2024-01-22T05:09:52.741284+0000","last_fullsized":"2024-01-22T05:09:52.741284+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.759502+0000","last_change":"2024-01-22T05:09:52.757840+0000","last_active":"2024-01-22T05:09:52.759502+0000","last_peered":"2024-01-22T05:09:52.759502+0000","last_clean":"2024-01-22T05:09:52.759502+0000","last_became_active":"2024-01-22T05:09:52.757571+0000","last_became_peered":"2024-01-22T05:09:52.757571+0000","last_unstale":"2024-01-22T05:09:52.759502+0000","last_undegraded":"2024-01-22T05:09:52.759502+0000","last_fullsized":"2024-01-22T05:09:52.759502+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.727605+0000","last_change":"2024-01-22T05:09:52.305592+0000","last_active":"2024-01-22T05:09:52.727605+0000","last_peered":"2024-01-22T05:09:52.727605+0000","last_clean":"2024-01-22T05:09:52.727605+0000","last_became_active":"2024-01-22T05:09:52.305284+0000","last_became_peered":"2024-01-22T05:09:52.305284+0000","last_unstale":"2024-01-22T05:09:52.727605+0000","last_undegraded":"2024-01-22T05:09:52.727605+0000","last_fullsized":"2024-01-22T05:09:52.727605+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.759707+0000","last_change":"2024-01-22T05:09:52.757078+0000","last_active":"2024-01-22T05:09:52.759707+0000","last_peered":"2024-01-22T05:09:52.759707+0000","last_clean":"2024-01-22T05:09:52.759707+0000","last_became_active":"2024-01-22T05:09:52.756822+0000","last_became_peered":"2024-01-22T05:09:52.756822+0000","last_unstale":"2024-01-22T05:09:52.759707+0000","last_undegraded":"2024-01-22T05:09:52.759707+0000","last_fullsized":"2024-01-22T05:09:52.759707+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.736301+0000","last_change":"2024-01-22T05:09:52.303731+0000","last_active":"2024-01-22T05:09:52.736301+0000","last_peered":"2024-01-22T05:09:52.736301+0000","last_clean":"2024-01-22T05:09:52.736301+0000","last_became_active":"2024-01-22T05:09:52.303433+0000","last_became_peered":"2024-01-22T05:09:52.303433+0000","last_unstale":"2024-01-22T05:09:52.736301+0000","last_undegraded":"2024-01-22T05:09:52.736301+0000","last_fullsized":"2024-01-22T05:09:52.736301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.755706+0000","last_change":"2024-01-22T05:09:52.748151+0000","last_active":"2024-01-22T05:09:52.755706+0000","last_peered":"2024-01-22T05:09:52.755706+0000","last_clean":"2024-01-22T05:09:52.755706+0000","last_became_active":"2024-01-22T05:09:52.747775+0000","last_became_peered":"2024-01-22T05:09:52.747775+0000","last_unstale":"2024-01-22T05:09:52.755706+0000","last_undegraded":"2024-01-22T05:09:52.755706+0000","last_fullsized":"2024-01-22T05:09:52.755706+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3c","version":"87'2","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.733140+0000","last_change":"2024-01-22T05:09:52.297327+0000","last_active":"2024-01-22T05:09:52.733140+0000","last_peered":"2024-01-22T05:09:52.733140+0000","last_clean":"2024-01-22T05:09:52.733140+0000","last_became_active":"2024-01-22T05:09:52.295607+0000","last_became_peered":"2024-01-22T05:09:52.295607+0000","last_unstale":"2024-01-22T05:09:52.733140+0000","last_undegraded":"2024-01-22T05:09:52.733140+0000","last_fullsized":"2024-01-22T05:09:52.733140+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.740906+0000","last_change":"2024-01-22T05:09:52.738830+0000","last_active":"2024-01-22T05:09:52.740906+0000","last_peered":"2024-01-22T05:09:52.740906+0000","last_clean":"2024-01-22T05:09:52.740906+0000","last_became_active":"2024-01-22T05:09:52.738442+0000","last_became_peered":"2024-01-22T05:09:52.738442+0000","last_unstale":"2024-01-22T05:09:52.740906+0000","last_undegraded":"2024-01-22T05:09:52.740906+0000","last_fullsized":"2024-01-22T05:09:52.740906+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.747507+0000","last_change":"2024-01-22T05:09:52.291300+0000","last_active":"2024-01-22T05:09:52.747507+0000","last_peered":"2024-01-22T05:09:52.747507+0000","last_clean":"2024-01-22T05:09:52.747507+0000","last_became_active":"2024-01-22T05:09:52.291020+0000","last_became_peered":"2024-01-22T05:09:52.291020+0000","last_unstale":"2024-01-22T05:09:52.747507+0000","last_undegraded":"2024-01-22T05:09:52.747507+0000","last_fullsized":"2024-01-22T05:09:52.747507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.753307+0000","last_change":"2024-01-22T05:09:52.750658+0000","last_active":"2024-01-22T05:09:52.753307+0000","last_peered":"2024-01-22T05:09:52.753307+0000","last_clean":"2024-01-22T05:09:52.753307+0000","last_became_active":"2024-01-22T05:09:52.750302+0000","last_became_peered":"2024-01-22T05:09:52.750302+0000","last_unstale":"2024-01-22T05:09:52.753307+0000","last_undegraded":"2024-01-22T05:09:52.753307+0000","last_fullsized":"2024-01-22T05:09:52.753307+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3a","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.755795+0000","last_change":"2024-01-22T05:09:52.306892+0000","last_active":"2024-01-22T05:09:52.755795+0000","last_peered":"2024-01-22T05:09:52.755795+0000","last_clean":"2024-01-22T05:09:52.755795+0000","last_became_active":"2024-01-22T05:09:52.305890+0000","last_became_peered":"2024-01-22T05:09:52.305890+0000","last_unstale":"2024-01-22T05:09:52.755795+0000","last_undegraded":"2024-01-22T05:09:52.755795+0000","last_fullsized":"2024-01-22T05:09:52.755795+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.747075+0000","last_change":"2024-01-22T05:09:52.745260+0000","last_active":"2024-01-22T05:09:52.747075+0000","last_peered":"2024-01-22T05:09:52.747075+0000","last_clean":"2024-01-22T05:09:52.747075+0000","last_became_active":"2024-01-22T05:09:52.744921+0000","last_became_peered":"2024-01-22T05:09:52.744921+0000","last_unstale":"2024-01-22T05:09:52.747075+0000","last_undegraded":"2024-01-22T05:09:52.747075+0000","last_fullsized":"2024-01-22T05:09:52.747075+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.737285+0000","last_change":"2024-01-22T05:09:52.286515+0000","last_active":"2024-01-22T05:09:52.737285+0000","last_peered":"2024-01-22T05:09:52.737285+0000","last_clean":"2024-01-22T05:09:52.737285+0000","last_became_active":"2024-01-22T05:09:52.286243+0000","last_became_peered":"2024-01-22T05:09:52.286243+0000","last_unstale":"2024-01-22T05:09:52.737285+0000","last_undegraded":"2024-01-22T05:09:52.737285+0000","last_fullsized":"2024-01-22T05:09:52.737285+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.749795+0000","last_change":"2024-01-22T05:09:52.740231+0000","last_active":"2024-01-22T05:09:52.749795+0000","last_peered":"2024-01-22T05:09:52.749795+0000","last_clean":"2024-01-22T05:09:52.749795+0000","last_became_active":"2024-01-22T05:09:52.739974+0000","last_became_peered":"2024-01-22T05:09:52.739974+0000","last_unstale":"2024-01-22T05:09:52.749795+0000","last_undegraded":"2024-01-22T05:09:52.749795+0000","last_fullsized":"2024-01-22T05:09:52.749795+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.725357+0000","last_change":"2024-01-22T05:09:52.286766+0000","last_active":"2024-01-22T05:09:52.725357+0000","last_peered":"2024-01-22T05:09:52.725357+0000","last_clean":"2024-01-22T05:09:52.725357+0000","last_became_active":"2024-01-22T05:09:52.286407+0000","last_became_peered":"2024-01-22T05:09:52.286407+0000","last_unstale":"2024-01-22T05:09:52.725357+0000","last_undegraded":"2024-01-22T05:09:52.725357+0000","last_fullsized":"2024-01-22T05:09:52.725357+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.757862+0000","last_change":"2024-01-22T05:09:52.752763+0000","last_active":"2024-01-22T05:09:52.757862+0000","last_peered":"2024-01-22T05:09:52.757862+0000","last_clean":"2024-01-22T05:09:52.757862+0000","last_became_active":"2024-01-22T05:09:52.752490+0000","last_became_peered":"2024-01-22T05:09:52.752490+0000","last_unstale":"2024-01-22T05:09:52.757862+0000","last_undegraded":"2024-01-22T05:09:52.757862+0000","last_fullsized":"2024-01-22T05:09:52.757862+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.749696+0000","last_change":"2024-01-22T05:09:52.304066+0000","last_active":"2024-01-22T05:09:52.749696+0000","last_peered":"2024-01-22T05:09:52.749696+0000","last_clean":"2024-01-22T05:09:52.749696+0000","last_became_active":"2024-01-22T05:09:52.303591+0000","last_became_peered":"2024-01-22T05:09:52.303591+0000","last_unstale":"2024-01-22T05:09:52.749696+0000","last_undegraded":"2024-01-22T05:09:52.749696+0000","last_fullsized":"2024-01-22T05:09:52.749696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.745954+0000","last_change":"2024-01-22T05:09:52.742603+0000","last_active":"2024-01-22T05:09:52.745954+0000","last_peered":"2024-01-22T05:09:52.745954+0000","last_clean":"2024-01-22T05:09:52.745954+0000","last_became_active":"2024-01-22T05:09:52.742337+0000","last_became_peered":"2024-01-22T05:09:52.742337+0000","last_unstale":"2024-01-22T05:09:52.745954+0000","last_undegraded":"2024-01-22T05:09:52.745954+0000","last_fullsized":"2024-01-22T05:09:52.745954+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.721274+0000","last_change":"2024-01-22T05:09:52.286587+0000","last_active":"2024-01-22T05:09:52.721274+0000","last_peered":"2024-01-22T05:09:52.721274+0000","last_clean":"2024-01-22T05:09:52.721274+0000","last_became_active":"2024-01-22T05:09:52.286312+0000","last_became_peered":"2024-01-22T05:09:52.286312+0000","last_unstale":"2024-01-22T05:09:52.721274+0000","last_undegraded":"2024-01-22T05:09:52.721274+0000","last_fullsized":"2024-01-22T05:09:52.721274+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.746694+0000","last_change":"2024-01-22T05:09:52.745254+0000","last_active":"2024-01-22T05:09:52.746694+0000","last_peered":"2024-01-22T05:09:52.746694+0000","last_clean":"2024-01-22T05:09:52.746694+0000","last_became_active":"2024-01-22T05:09:52.744717+0000","last_became_peered":"2024-01-22T05:09:52.744717+0000","last_unstale":"2024-01-22T05:09:52.746694+0000","last_undegraded":"2024-01-22T05:09:52.746694+0000","last_fullsized":"2024-01-22T05:09:52.746694+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.727362+0000","last_change":"2024-01-22T05:09:52.308814+0000","last_active":"2024-01-22T05:09:52.727362+0000","last_peered":"2024-01-22T05:09:52.727362+0000","last_clean":"2024-01-22T05:09:52.727362+0000","last_became_active":"2024-01-22T05:09:52.307354+0000","last_became_peered":"2024-01-22T05:09:52.307354+0000","last_unstale":"2024-01-22T05:09:52.727362+0000","last_undegraded":"2024-01-22T05:09:52.727362+0000","last_fullsized":"2024-01-22T05:09:52.727362+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.760458+0000","last_change":"2024-01-22T05:09:52.749456+0000","last_active":"2024-01-22T05:09:52.760458+0000","last_peered":"2024-01-22T05:09:52.760458+0000","last_clean":"2024-01-22T05:09:52.760458+0000","last_became_active":"2024-01-22T05:09:52.749168+0000","last_became_peered":"2024-01-22T05:09:52.749168+0000","last_unstale":"2024-01-22T05:09:52.760458+0000","last_undegraded":"2024-01-22T05:09:52.760458+0000","last_fullsized":"2024-01-22T05:09:52.760458+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"87'4","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.753990+0000","last_change":"2024-01-22T05:09:52.312051+0000","last_active":"2024-01-22T05:09:52.753990+0000","last_peered":"2024-01-22T05:09:52.753990+0000","last_clean":"2024-01-22T05:09:52.753990+0000","last_became_active":"2024-01-22T05:09:52.311745+0000","last_became_peered":"2024-01-22T05:09:52.311745+0000","last_unstale":"2024-01-22T05:09:52.753990+0000","last_undegraded":"2024-01-22T05:09:52.753990+0000","last_fullsized":"2024-01-22T05:09:52.753990+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.754393+0000","last_change":"2024-01-22T05:09:52.750806+0000","last_active":"2024-01-22T05:09:52.754393+0000","last_peered":"2024-01-22T05:09:52.754393+0000","last_clean":"2024-01-22T05:09:52.754393+0000","last_became_active":"2024-01-22T05:09:52.750230+0000","last_became_peered":"2024-01-22T05:09:52.750230+0000","last_unstale":"2024-01-22T05:09:52.754393+0000","last_undegraded":"2024-01-22T05:09:52.754393+0000","last_fullsized":"2024-01-22T05:09:52.754393+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.736560+0000","last_change":"2024-01-22T05:09:52.291159+0000","last_active":"2024-01-22T05:09:52.736560+0000","last_peered":"2024-01-22T05:09:52.736560+0000","last_clean":"2024-01-22T05:09:52.736560+0000","last_became_active":"2024-01-22T05:09:52.289670+0000","last_became_peered":"2024-01-22T05:09:52.289670+0000","last_unstale":"2024-01-22T05:09:52.736560+0000","last_undegraded":"2024-01-22T05:09:52.736560+0000","last_fullsized":"2024-01-22T05:09:52.736560+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.756453+0000","last_change":"2024-01-22T05:09:52.752800+0000","last_active":"2024-01-22T05:09:52.756453+0000","last_peered":"2024-01-22T05:09:52.756453+0000","last_clean":"2024-01-22T05:09:52.756453+0000","last_became_active":"2024-01-22T05:09:52.752534+0000","last_became_peered":"2024-01-22T05:09:52.752534+0000","last_unstale":"2024-01-22T05:09:52.756453+0000","last_undegraded":"2024-01-22T05:09:52.756453+0000","last_fullsized":"2024-01-22T05:09:52.756453+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.718481+0000","last_change":"2024-01-22T05:09:52.307125+0000","last_active":"2024-01-22T05:09:52.718481+0000","last_peered":"2024-01-22T05:09:52.718481+0000","last_clean":"2024-01-22T05:09:52.718481+0000","last_became_active":"2024-01-22T05:09:52.306261+0000","last_became_peered":"2024-01-22T05:09:52.306261+0000","last_unstale":"2024-01-22T05:09:52.718481+0000","last_undegraded":"2024-01-22T05:09:52.718481+0000","last_fullsized":"2024-01-22T05:09:52.718481+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.753001+0000","last_change":"2024-01-22T05:09:52.750217+0000","last_active":"2024-01-22T05:09:52.753001+0000","last_peered":"2024-01-22T05:09:52.753001+0000","last_clean":"2024-01-22T05:09:52.753001+0000","last_became_active":"2024-01-22T05:09:52.749982+0000","last_became_peered":"2024-01-22T05:09:52.749982+0000","last_unstale":"2024-01-22T05:09:52.753001+0000","last_undegraded":"2024-01-22T05:09:52.753001+0000","last_fullsized":"2024-01-22T05:09:52.753001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.724068+0000","last_change":"2024-01-22T05:09:52.295635+0000","last_active":"2024-01-22T05:09:52.724068+0000","last_peered":"2024-01-22T05:09:52.724068+0000","last_clean":"2024-01-22T05:09:52.724068+0000","last_became_active":"2024-01-22T05:09:52.295121+0000","last_became_peered":"2024-01-22T05:09:52.295121+0000","last_unstale":"2024-01-22T05:09:52.724068+0000","last_undegraded":"2024-01-22T05:09:52.724068+0000","last_fullsized":"2024-01-22T05:09:52.724068+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.749936+0000","last_change":"2024-01-22T05:09:52.737345+0000","last_active":"2024-01-22T05:09:52.749936+0000","last_peered":"2024-01-22T05:09:52.749936+0000","last_clean":"2024-01-22T05:09:52.749936+0000","last_became_active":"2024-01-22T05:09:52.735127+0000","last_became_peered":"2024-01-22T05:09:52.735127+0000","last_unstale":"2024-01-22T05:09:52.749936+0000","last_undegraded":"2024-01-22T05:09:52.749936+0000","last_fullsized":"2024-01-22T05:09:52.749936+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.30","version":"87'4","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.739524+0000","last_change":"2024-01-22T05:09:52.291201+0000","last_active":"2024-01-22T05:09:52.739524+0000","last_peered":"2024-01-22T05:09:52.739524+0000","last_clean":"2024-01-22T05:09:52.739524+0000","last_became_active":"2024-01-22T05:09:52.290840+0000","last_became_peered":"2024-01-22T05:09:52.290840+0000","last_unstale":"2024-01-22T05:09:52.739524+0000","last_undegraded":"2024-01-22T05:09:52.739524+0000","last_fullsized":"2024-01-22T05:09:52.739524+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.754614+0000","last_change":"2024-01-22T05:09:52.748629+0000","last_active":"2024-01-22T05:09:52.754614+0000","last_peered":"2024-01-22T05:09:52.754614+0000","last_clean":"2024-01-22T05:09:52.754614+0000","last_became_active":"2024-01-22T05:09:52.748338+0000","last_became_peered":"2024-01-22T05:09:52.748338+0000","last_unstale":"2024-01-22T05:09:52.754614+0000","last_undegraded":"2024-01-22T05:09:52.754614+0000","last_fullsized":"2024-01-22T05:09:52.754614+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.730234+0000","last_change":"2024-01-22T05:09:52.282950+0000","last_active":"2024-01-22T05:09:52.730234+0000","last_peered":"2024-01-22T05:09:52.730234+0000","last_clean":"2024-01-22T05:09:52.730234+0000","last_became_active":"2024-01-22T05:09:52.279776+0000","last_became_peered":"2024-01-22T05:09:52.279776+0000","last_unstale":"2024-01-22T05:09:52.730234+0000","last_undegraded":"2024-01-22T05:09:52.730234+0000","last_fullsized":"2024-01-22T05:09:52.730234+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.757586+0000","last_change":"2024-01-22T05:09:52.753593+0000","last_active":"2024-01-22T05:09:52.757586+0000","last_peered":"2024-01-22T05:09:52.757586+0000","last_clean":"2024-01-22T05:09:52.757586+0000","last_became_active":"2024-01-22T05:09:52.753278+0000","last_became_peered":"2024-01-22T05:09:52.753278+0000","last_unstale":"2024-01-22T05:09:52.757586+0000","last_undegraded":"2024-01-22T05:09:52.757586+0000","last_fullsized":"2024-01-22T05:09:52.757586+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.742252+0000","last_change":"2024-01-22T05:09:52.298678+0000","last_active":"2024-01-22T05:09:52.742252+0000","last_peered":"2024-01-22T05:09:52.742252+0000","last_clean":"2024-01-22T05:09:52.742252+0000","last_became_active":"2024-01-22T05:09:52.298186+0000","last_became_peered":"2024-01-22T05:09:52.298186+0000","last_unstale":"2024-01-22T05:09:52.742252+0000","last_undegraded":"2024-01-22T05:09:52.742252+0000","last_fullsized":"2024-01-22T05:09:52.742252+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.750062+0000","last_change":"2024-01-22T05:09:52.743076+0000","last_active":"2024-01-22T05:09:52.750062+0000","last_peered":"2024-01-22T05:09:52.750062+0000","last_clean":"2024-01-22T05:09:52.750062+0000","last_became_active":"2024-01-22T05:09:52.742423+0000","last_became_peered":"2024-01-22T05:09:52.742423+0000","last_unstale":"2024-01-22T05:09:52.750062+0000","last_undegraded":"2024-01-22T05:09:52.750062+0000","last_fullsized":"2024-01-22T05:09:52.750062+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2d","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.754304+0000","last_change":"2024-01-22T05:09:52.285820+0000","last_active":"2024-01-22T05:09:52.754304+0000","last_peered":"2024-01-22T05:09:52.754304+0000","last_clean":"2024-01-22T05:09:52.754304+0000","last_became_active":"2024-01-22T05:09:52.285492+0000","last_became_peered":"2024-01-22T05:09:52.285492+0000","last_unstale":"2024-01-22T05:09:52.754304+0000","last_undegraded":"2024-01-22T05:09:52.754304+0000","last_fullsized":"2024-01-22T05:09:52.754304+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.741806+0000","last_change":"2024-01-22T05:09:52.737589+0000","last_active":"2024-01-22T05:09:52.741806+0000","last_peered":"2024-01-22T05:09:52.741806+0000","last_clean":"2024-01-22T05:09:52.741806+0000","last_became_active":"2024-01-22T05:09:52.734319+0000","last_became_peered":"2024-01-22T05:09:52.734319+0000","last_unstale":"2024-01-22T05:09:52.741806+0000","last_undegraded":"2024-01-22T05:09:52.741806+0000","last_fullsized":"2024-01-22T05:09:52.741806+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.730278+0000","last_change":"2024-01-22T05:09:52.284575+0000","last_active":"2024-01-22T05:09:52.730278+0000","last_peered":"2024-01-22T05:09:52.730278+0000","last_clean":"2024-01-22T05:09:52.730278+0000","last_became_active":"2024-01-22T05:09:52.284312+0000","last_became_peered":"2024-01-22T05:09:52.284312+0000","last_unstale":"2024-01-22T05:09:52.730278+0000","last_undegraded":"2024-01-22T05:09:52.730278+0000","last_fullsized":"2024-01-22T05:09:52.730278+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.757944+0000","last_change":"2024-01-22T05:09:52.745278+0000","last_active":"2024-01-22T05:09:52.757944+0000","last_peered":"2024-01-22T05:09:52.757944+0000","last_clean":"2024-01-22T05:09:52.757944+0000","last_became_active":"2024-01-22T05:09:52.744931+0000","last_became_peered":"2024-01-22T05:09:52.744931+0000","last_unstale":"2024-01-22T05:09:52.757944+0000","last_undegraded":"2024-01-22T05:09:52.757944+0000","last_fullsized":"2024-01-22T05:09:52.757944+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2b","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.759252+0000","last_change":"2024-01-22T05:09:52.298825+0000","last_active":"2024-01-22T05:09:52.759252+0000","last_peered":"2024-01-22T05:09:52.759252+0000","last_clean":"2024-01-22T05:09:52.759252+0000","last_became_active":"2024-01-22T05:09:52.298494+0000","last_became_peered":"2024-01-22T05:09:52.298494+0000","last_unstale":"2024-01-22T05:09:52.759252+0000","last_undegraded":"2024-01-22T05:09:52.759252+0000","last_fullsized":"2024-01-22T05:09:52.759252+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.747251+0000","last_change":"2024-01-22T05:09:52.735727+0000","last_active":"2024-01-22T05:09:52.747251+0000","last_peered":"2024-01-22T05:09:52.747251+0000","last_clean":"2024-01-22T05:09:52.747251+0000","last_became_active":"2024-01-22T05:09:52.735455+0000","last_became_peered":"2024-01-22T05:09:52.735455+0000","last_unstale":"2024-01-22T05:09:52.747251+0000","last_undegraded":"2024-01-22T05:09:52.747251+0000","last_fullsized":"2024-01-22T05:09:52.747251+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.729300+0000","last_change":"2024-01-22T05:09:52.290456+0000","last_active":"2024-01-22T05:09:52.729300+0000","last_peered":"2024-01-22T05:09:52.729300+0000","last_clean":"2024-01-22T05:09:52.729300+0000","last_became_active":"2024-01-22T05:09:52.288359+0000","last_became_peered":"2024-01-22T05:09:52.288359+0000","last_unstale":"2024-01-22T05:09:52.729300+0000","last_undegraded":"2024-01-22T05:09:52.729300+0000","last_fullsized":"2024-01-22T05:09:52.729300+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.750009+0000","last_change":"2024-01-22T05:09:52.736252+0000","last_active":"2024-01-22T05:09:52.750009+0000","last_peered":"2024-01-22T05:09:52.750009+0000","last_clean":"2024-01-22T05:09:52.750009+0000","last_became_active":"2024-01-22T05:09:52.735994+0000","last_became_peered":"2024-01-22T05:09:52.735994+0000","last_unstale":"2024-01-22T05:09:52.750009+0000","last_undegraded":"2024-01-22T05:09:52.750009+0000","last_fullsized":"2024-01-22T05:09:52.750009+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.740990+0000","last_change":"2024-01-22T05:09:52.297963+0000","last_active":"2024-01-22T05:09:52.740990+0000","last_peered":"2024-01-22T05:09:52.740990+0000","last_clean":"2024-01-22T05:09:52.740990+0000","last_became_active":"2024-01-22T05:09:52.295129+0000","last_became_peered":"2024-01-22T05:09:52.295129+0000","last_unstale":"2024-01-22T05:09:52.740990+0000","last_undegraded":"2024-01-22T05:09:52.740990+0000","last_fullsized":"2024-01-22T05:09:52.740990+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.747413+0000","last_change":"2024-01-22T05:09:52.746213+0000","last_active":"2024-01-22T05:09:52.747413+0000","last_peered":"2024-01-22T05:09:52.747413+0000","last_clean":"2024-01-22T05:09:52.747413+0000","last_became_active":"2024-01-22T05:09:52.745873+0000","last_became_peered":"2024-01-22T05:09:52.745873+0000","last_unstale":"2024-01-22T05:09:52.747413+0000","last_undegraded":"2024-01-22T05:09:52.747413+0000","last_fullsized":"2024-01-22T05:09:52.747413+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.724686+0000","last_change":"2024-01-22T05:09:52.312269+0000","last_active":"2024-01-22T05:09:52.724686+0000","last_peered":"2024-01-22T05:09:52.724686+0000","last_clean":"2024-01-22T05:09:52.724686+0000","last_became_active":"2024-01-22T05:09:52.312009+0000","last_became_peered":"2024-01-22T05:09:52.312009+0000","last_unstale":"2024-01-22T05:09:52.724686+0000","last_undegraded":"2024-01-22T05:09:52.724686+0000","last_fullsized":"2024-01-22T05:09:52.724686+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.755412+0000","last_change":"2024-01-22T05:09:52.747456+0000","last_active":"2024-01-22T05:09:52.755412+0000","last_peered":"2024-01-22T05:09:52.755412+0000","last_clean":"2024-01-22T05:09:52.755412+0000","last_became_active":"2024-01-22T05:09:52.746597+0000","last_became_peered":"2024-01-22T05:09:52.746597+0000","last_unstale":"2024-01-22T05:09:52.755412+0000","last_undegraded":"2024-01-22T05:09:52.755412+0000","last_fullsized":"2024-01-22T05:09:52.755412+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.727250+0000","last_change":"2024-01-22T05:09:52.304546+0000","last_active":"2024-01-22T05:09:52.727250+0000","last_peered":"2024-01-22T05:09:52.727250+0000","last_clean":"2024-01-22T05:09:52.727250+0000","last_became_active":"2024-01-22T05:09:52.302485+0000","last_became_peered":"2024-01-22T05:09:52.302485+0000","last_unstale":"2024-01-22T05:09:52.727250+0000","last_undegraded":"2024-01-22T05:09:52.727250+0000","last_fullsized":"2024-01-22T05:09:52.727250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.760995+0000","last_change":"2024-01-22T05:09:52.752877+0000","last_active":"2024-01-22T05:09:52.760995+0000","last_peered":"2024-01-22T05:09:52.760995+0000","last_clean":"2024-01-22T05:09:52.760995+0000","last_became_active":"2024-01-22T05:09:52.752607+0000","last_became_peered":"2024-01-22T05:09:52.752607+0000","last_unstale":"2024-01-22T05:09:52.760995+0000","last_undegraded":"2024-01-22T05:09:52.760995+0000","last_fullsized":"2024-01-22T05:09:52.760995+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.26","version":"88'1","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-22T05:09:53.726028+0000","last_change":"2024-01-22T05:09:52.305020+0000","last_active":"2024-01-22T05:09:53.726028+0000","last_peered":"2024-01-22T05:09:53.726028+0000","last_clean":"2024-01-22T05:09:53.726028+0000","last_became_active":"2024-01-22T05:09:52.304708+0000","last_became_peered":"2024-01-22T05:09:52.304708+0000","last_unstale":"2024-01-22T05:09:53.726028+0000","last_undegraded":"2024-01-22T05:09:53.726028+0000","last_fullsized":"2024-01-22T05:09:53.726028+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.758259+0000","last_change":"2024-01-22T05:09:52.756600+0000","last_active":"2024-01-22T05:09:52.758259+0000","last_peered":"2024-01-22T05:09:52.758259+0000","last_clean":"2024-01-22T05:09:52.758259+0000","last_became_active":"2024-01-22T05:09:52.755937+0000","last_became_peered":"2024-01-22T05:09:52.755937+0000","last_unstale":"2024-01-22T05:09:52.758259+0000","last_undegraded":"2024-01-22T05:09:52.758259+0000","last_fullsized":"2024-01-22T05:09:52.758259+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.723881+0000","last_change":"2024-01-22T05:09:52.293808+0000","last_active":"2024-01-22T05:09:52.723881+0000","last_peered":"2024-01-22T05:09:52.723881+0000","last_clean":"2024-01-22T05:09:52.723881+0000","last_became_active":"2024-01-22T05:09:52.293536+0000","last_became_peered":"2024-01-22T05:09:52.293536+0000","last_unstale":"2024-01-22T05:09:52.723881+0000","last_undegraded":"2024-01-22T05:09:52.723881+0000","last_fullsized":"2024-01-22T05:09:52.723881+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.758772+0000","last_change":"2024-01-22T05:09:52.754120+0000","last_active":"2024-01-22T05:09:52.758772+0000","last_peered":"2024-01-22T05:09:52.758772+0000","last_clean":"2024-01-22T05:09:52.758772+0000","last_became_active":"2024-01-22T05:09:52.753083+0000","last_became_peered":"2024-01-22T05:09:52.753083+0000","last_unstale":"2024-01-22T05:09:52.758772+0000","last_undegraded":"2024-01-22T05:09:52.758772+0000","last_fullsized":"2024-01-22T05:09:52.758772+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.730375+0000","last_change":"2024-01-22T05:09:52.296831+0000","last_active":"2024-01-22T05:09:52.730375+0000","last_peered":"2024-01-22T05:09:52.730375+0000","last_clean":"2024-01-22T05:09:52.730375+0000","last_became_active":"2024-01-22T05:09:52.295639+0000","last_became_peered":"2024-01-22T05:09:52.295639+0000","last_unstale":"2024-01-22T05:09:52.730375+0000","last_undegraded":"2024-01-22T05:09:52.730375+0000","last_fullsized":"2024-01-22T05:09:52.730375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.757664+0000","last_change":"2024-01-22T05:09:52.743130+0000","last_active":"2024-01-22T05:09:52.757664+0000","last_peered":"2024-01-22T05:09:52.757664+0000","last_clean":"2024-01-22T05:09:52.757664+0000","last_became_active":"2024-01-22T05:09:52.742767+0000","last_became_peered":"2024-01-22T05:09:52.742767+0000","last_unstale":"2024-01-22T05:09:52.757664+0000","last_undegraded":"2024-01-22T05:09:52.757664+0000","last_fullsized":"2024-01-22T05:09:52.757664+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.725267+0000","last_change":"2024-01-22T05:09:52.303111+0000","last_active":"2024-01-22T05:09:52.725267+0000","last_peered":"2024-01-22T05:09:52.725267+0000","last_clean":"2024-01-22T05:09:52.725267+0000","last_became_active":"2024-01-22T05:09:52.302809+0000","last_became_peered":"2024-01-22T05:09:52.302809+0000","last_unstale":"2024-01-22T05:09:52.725267+0000","last_undegraded":"2024-01-22T05:09:52.725267+0000","last_fullsized":"2024-01-22T05:09:52.725267+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.760084+0000","last_change":"2024-01-22T05:09:52.747297+0000","last_active":"2024-01-22T05:09:52.760084+0000","last_peered":"2024-01-22T05:09:52.760084+0000","last_clean":"2024-01-22T05:09:52.760084+0000","last_became_active":"2024-01-22T05:09:52.747008+0000","last_became_peered":"2024-01-22T05:09:52.747008+0000","last_unstale":"2024-01-22T05:09:52.760084+0000","last_undegraded":"2024-01-22T05:09:52.760084+0000","last_fullsized":"2024-01-22T05:09:52.760084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.724041+0000","last_change":"2024-01-22T05:09:52.304360+0000","last_active":"2024-01-22T05:09:52.724041+0000","last_peered":"2024-01-22T05:09:52.724041+0000","last_clean":"2024-01-22T05:09:52.724041+0000","last_became_active":"2024-01-22T05:09:52.304061+0000","last_became_peered":"2024-01-22T05:09:52.304061+0000","last_unstale":"2024-01-22T05:09:52.724041+0000","last_undegraded":"2024-01-22T05:09:52.724041+0000","last_fullsized":"2024-01-22T05:09:52.724041+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.758206+0000","last_change":"2024-01-22T05:09:52.756385+0000","last_active":"2024-01-22T05:09:52.758206+0000","last_peered":"2024-01-22T05:09:52.758206+0000","last_clean":"2024-01-22T05:09:52.758206+0000","last_became_active":"2024-01-22T05:09:52.755764+0000","last_became_peered":"2024-01-22T05:09:52.755764+0000","last_unstale":"2024-01-22T05:09:52.758206+0000","last_undegraded":"2024-01-22T05:09:52.758206+0000","last_fullsized":"2024-01-22T05:09:52.758206+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.735281+0000","last_change":"2024-01-22T05:09:52.287508+0000","last_active":"2024-01-22T05:09:52.735281+0000","last_peered":"2024-01-22T05:09:52.735281+0000","last_clean":"2024-01-22T05:09:52.735281+0000","last_became_active":"2024-01-22T05:09:52.287047+0000","last_became_peered":"2024-01-22T05:09:52.287047+0000","last_unstale":"2024-01-22T05:09:52.735281+0000","last_undegraded":"2024-01-22T05:09:52.735281+0000","last_fullsized":"2024-01-22T05:09:52.735281+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.757614+0000","last_change":"2024-01-22T05:09:52.753710+0000","last_active":"2024-01-22T05:09:52.757614+0000","last_peered":"2024-01-22T05:09:52.757614+0000","last_clean":"2024-01-22T05:09:52.757614+0000","last_became_active":"2024-01-22T05:09:52.753419+0000","last_became_peered":"2024-01-22T05:09:52.753419+0000","last_unstale":"2024-01-22T05:09:52.757614+0000","last_undegraded":"2024-01-22T05:09:52.757614+0000","last_fullsized":"2024-01-22T05:09:52.757614+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.721591+0000","last_change":"2024-01-22T05:09:52.297212+0000","last_active":"2024-01-22T05:09:52.721591+0000","last_peered":"2024-01-22T05:09:52.721591+0000","last_clean":"2024-01-22T05:09:52.721591+0000","last_became_active":"2024-01-22T05:09:52.296894+0000","last_became_peered":"2024-01-22T05:09:52.296894+0000","last_unstale":"2024-01-22T05:09:52.721591+0000","last_undegraded":"2024-01-22T05:09:52.721591+0000","last_fullsized":"2024-01-22T05:09:52.721591+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.759355+0000","last_change":"2024-01-22T05:09:52.757978+0000","last_active":"2024-01-22T05:09:52.759355+0000","last_peered":"2024-01-22T05:09:52.759355+0000","last_clean":"2024-01-22T05:09:52.759355+0000","last_became_active":"2024-01-22T05:09:52.757702+0000","last_became_peered":"2024-01-22T05:09:52.757702+0000","last_unstale":"2024-01-22T05:09:52.759355+0000","last_undegraded":"2024-01-22T05:09:52.759355+0000","last_fullsized":"2024-01-22T05:09:52.759355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.754886+0000","last_change":"2024-01-22T05:09:52.285779+0000","last_active":"2024-01-22T05:09:52.754886+0000","last_peered":"2024-01-22T05:09:52.754886+0000","last_clean":"2024-01-22T05:09:52.754886+0000","last_became_active":"2024-01-22T05:09:52.285085+0000","last_became_peered":"2024-01-22T05:09:52.285085+0000","last_unstale":"2024-01-22T05:09:52.754886+0000","last_undegraded":"2024-01-22T05:09:52.754886+0000","last_fullsized":"2024-01-22T05:09:52.754886+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.759483+0000","last_change":"2024-01-22T05:09:52.757315+0000","last_active":"2024-01-22T05:09:52.759483+0000","last_peered":"2024-01-22T05:09:52.759483+0000","last_clean":"2024-01-22T05:09:52.759483+0000","last_became_active":"2024-01-22T05:09:52.755076+0000","last_became_peered":"2024-01-22T05:09:52.755076+0000","last_unstale":"2024-01-22T05:09:52.759483+0000","last_undegraded":"2024-01-22T05:09:52.759483+0000","last_fullsized":"2024-01-22T05:09:52.759483+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.758114+0000","last_change":"2024-01-22T05:09:52.293180+0000","last_active":"2024-01-22T05:09:52.758114+0000","last_peered":"2024-01-22T05:09:52.758114+0000","last_clean":"2024-01-22T05:09:52.758114+0000","last_became_active":"2024-01-22T05:09:52.292510+0000","last_became_peered":"2024-01-22T05:09:52.292510+0000","last_unstale":"2024-01-22T05:09:52.758114+0000","last_undegraded":"2024-01-22T05:09:52.758114+0000","last_fullsized":"2024-01-22T05:09:52.758114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.759094+0000","last_change":"2024-01-22T05:09:52.757215+0000","last_active":"2024-01-22T05:09:52.759094+0000","last_peered":"2024-01-22T05:09:52.759094+0000","last_clean":"2024-01-22T05:09:52.759094+0000","last_became_active":"2024-01-22T05:09:52.756958+0000","last_became_peered":"2024-01-22T05:09:52.756958+0000","last_unstale":"2024-01-22T05:09:52.759094+0000","last_undegraded":"2024-01-22T05:09:52.759094+0000","last_fullsized":"2024-01-22T05:09:52.759094+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"87'2","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.753131+0000","last_change":"2024-01-22T05:09:52.306492+0000","last_active":"2024-01-22T05:09:52.753131+0000","last_peered":"2024-01-22T05:09:52.753131+0000","last_clean":"2024-01-22T05:09:52.753131+0000","last_became_active":"2024-01-22T05:09:52.306048+0000","last_became_peered":"2024-01-22T05:09:52.306048+0000","last_unstale":"2024-01-22T05:09:52.753131+0000","last_undegraded":"2024-01-22T05:09:52.753131+0000","last_fullsized":"2024-01-22T05:09:52.753131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.740297+0000","last_change":"2024-01-22T05:09:52.737335+0000","last_active":"2024-01-22T05:09:52.740297+0000","last_peered":"2024-01-22T05:09:52.740297+0000","last_clean":"2024-01-22T05:09:52.740297+0000","last_became_active":"2024-01-22T05:09:52.737053+0000","last_became_peered":"2024-01-22T05:09:52.737053+0000","last_unstale":"2024-01-22T05:09:52.740297+0000","last_undegraded":"2024-01-22T05:09:52.740297+0000","last_fullsized":"2024-01-22T05:09:52.740297+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.727170+0000","last_change":"2024-01-22T05:09:52.311553+0000","last_active":"2024-01-22T05:09:52.727170+0000","last_peered":"2024-01-22T05:09:52.727170+0000","last_clean":"2024-01-22T05:09:52.727170+0000","last_became_active":"2024-01-22T05:09:52.307278+0000","last_became_peered":"2024-01-22T05:09:52.307278+0000","last_unstale":"2024-01-22T05:09:52.727170+0000","last_undegraded":"2024-01-22T05:09:52.727170+0000","last_fullsized":"2024-01-22T05:09:52.727170+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.760120+0000","last_change":"2024-01-22T05:09:52.748970+0000","last_active":"2024-01-22T05:09:52.760120+0000","last_peered":"2024-01-22T05:09:52.760120+0000","last_clean":"2024-01-22T05:09:52.760120+0000","last_became_active":"2024-01-22T05:09:52.748541+0000","last_became_peered":"2024-01-22T05:09:52.748541+0000","last_unstale":"2024-01-22T05:09:52.760120+0000","last_undegraded":"2024-01-22T05:09:52.760120+0000","last_fullsized":"2024-01-22T05:09:52.760120+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.743454+0000","last_change":"2024-01-22T05:09:52.295147+0000","last_active":"2024-01-22T05:09:52.743454+0000","last_peered":"2024-01-22T05:09:52.743454+0000","last_clean":"2024-01-22T05:09:52.743454+0000","last_became_active":"2024-01-22T05:09:52.294863+0000","last_became_peered":"2024-01-22T05:09:52.294863+0000","last_unstale":"2024-01-22T05:09:52.743454+0000","last_undegraded":"2024-01-22T05:09:52.743454+0000","last_fullsized":"2024-01-22T05:09:52.743454+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.759345+0000","last_change":"2024-01-22T05:09:52.755870+0000","last_active":"2024-01-22T05:09:52.759345+0000","last_peered":"2024-01-22T05:09:52.759345+0000","last_clean":"2024-01-22T05:09:52.759345+0000","last_became_active":"2024-01-22T05:09:52.753522+0000","last_became_peered":"2024-01-22T05:09:52.753522+0000","last_unstale":"2024-01-22T05:09:52.759345+0000","last_undegraded":"2024-01-22T05:09:52.759345+0000","last_fullsized":"2024-01-22T05:09:52.759345+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.743014+0000","last_change":"2024-01-22T05:09:52.293685+0000","last_active":"2024-01-22T05:09:52.743014+0000","last_peered":"2024-01-22T05:09:52.743014+0000","last_clean":"2024-01-22T05:09:52.743014+0000","last_became_active":"2024-01-22T05:09:52.292089+0000","last_became_peered":"2024-01-22T05:09:52.292089+0000","last_unstale":"2024-01-22T05:09:52.743014+0000","last_undegraded":"2024-01-22T05:09:52.743014+0000","last_fullsized":"2024-01-22T05:09:52.743014+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.740261+0000","last_change":"2024-01-22T05:09:52.734804+0000","last_active":"2024-01-22T05:09:52.740261+0000","last_peered":"2024-01-22T05:09:52.740261+0000","last_clean":"2024-01-22T05:09:52.740261+0000","last_became_active":"2024-01-22T05:09:52.734210+0000","last_became_peered":"2024-01-22T05:09:52.734210+0000","last_unstale":"2024-01-22T05:09:52.740261+0000","last_undegraded":"2024-01-22T05:09:52.740261+0000","last_fullsized":"2024-01-22T05:09:52.740261+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.724192+0000","last_change":"2024-01-22T05:09:52.305465+0000","last_active":"2024-01-22T05:09:52.724192+0000","last_peered":"2024-01-22T05:09:52.724192+0000","last_clean":"2024-01-22T05:09:52.724192+0000","last_became_active":"2024-01-22T05:09:52.305188+0000","last_became_peered":"2024-01-22T05:09:52.305188+0000","last_unstale":"2024-01-22T05:09:52.724192+0000","last_undegraded":"2024-01-22T05:09:52.724192+0000","last_fullsized":"2024-01-22T05:09:52.724192+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.749914+0000","last_change":"2024-01-22T05:09:52.736238+0000","last_active":"2024-01-22T05:09:52.749914+0000","last_peered":"2024-01-22T05:09:52.749914+0000","last_clean":"2024-01-22T05:09:52.749914+0000","last_became_active":"2024-01-22T05:09:52.735945+0000","last_became_peered":"2024-01-22T05:09:52.735945+0000","last_unstale":"2024-01-22T05:09:52.749914+0000","last_undegraded":"2024-01-22T05:09:52.749914+0000","last_fullsized":"2024-01-22T05:09:52.749914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.733695+0000","last_change":"2024-01-22T05:09:52.299261+0000","last_active":"2024-01-22T05:09:52.733695+0000","last_peered":"2024-01-22T05:09:52.733695+0000","last_clean":"2024-01-22T05:09:52.733695+0000","last_became_active":"2024-01-22T05:09:52.298981+0000","last_became_peered":"2024-01-22T05:09:52.298981+0000","last_unstale":"2024-01-22T05:09:52.733695+0000","last_undegraded":"2024-01-22T05:09:52.733695+0000","last_fullsized":"2024-01-22T05:09:52.733695+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.760070+0000","last_change":"2024-01-22T05:09:52.758668+0000","last_active":"2024-01-22T05:09:52.760070+0000","last_peered":"2024-01-22T05:09:52.760070+0000","last_clean":"2024-01-22T05:09:52.760070+0000","last_became_active":"2024-01-22T05:09:52.758370+0000","last_became_peered":"2024-01-22T05:09:52.758370+0000","last_unstale":"2024-01-22T05:09:52.760070+0000","last_undegraded":"2024-01-22T05:09:52.760070+0000","last_fullsized":"2024-01-22T05:09:52.760070+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.741675+0000","last_change":"2024-01-22T05:09:52.295858+0000","last_active":"2024-01-22T05:09:52.741675+0000","last_peered":"2024-01-22T05:09:52.741675+0000","last_clean":"2024-01-22T05:09:52.741675+0000","last_became_active":"2024-01-22T05:09:52.295611+0000","last_became_peered":"2024-01-22T05:09:52.295611+0000","last_unstale":"2024-01-22T05:09:52.741675+0000","last_undegraded":"2024-01-22T05:09:52.741675+0000","last_fullsized":"2024-01-22T05:09:52.741675+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.745678+0000","last_change":"2024-01-22T05:09:52.742076+0000","last_active":"2024-01-22T05:09:52.745678+0000","last_peered":"2024-01-22T05:09:52.745678+0000","last_clean":"2024-01-22T05:09:52.745678+0000","last_became_active":"2024-01-22T05:09:52.741403+0000","last_became_peered":"2024-01-22T05:09:52.741403+0000","last_unstale":"2024-01-22T05:09:52.745678+0000","last_undegraded":"2024-01-22T05:09:52.745678+0000","last_fullsized":"2024-01-22T05:09:52.745678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.742292+0000","last_change":"2024-01-22T05:09:52.290933+0000","last_active":"2024-01-22T05:09:52.742292+0000","last_peered":"2024-01-22T05:09:52.742292+0000","last_clean":"2024-01-22T05:09:52.742292+0000","last_became_active":"2024-01-22T05:09:52.290628+0000","last_became_peered":"2024-01-22T05:09:52.290628+0000","last_unstale":"2024-01-22T05:09:52.742292+0000","last_undegraded":"2024-01-22T05:09:52.742292+0000","last_fullsized":"2024-01-22T05:09:52.742292+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.753424+0000","last_change":"2024-01-22T05:09:52.745590+0000","last_active":"2024-01-22T05:09:52.753424+0000","last_peered":"2024-01-22T05:09:52.753424+0000","last_clean":"2024-01-22T05:09:52.753424+0000","last_became_active":"2024-01-22T05:09:52.745274+0000","last_became_peered":"2024-01-22T05:09:52.745274+0000","last_unstale":"2024-01-22T05:09:52.753424+0000","last_undegraded":"2024-01-22T05:09:52.753424+0000","last_fullsized":"2024-01-22T05:09:52.753424+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"87'3","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.758051+0000","last_change":"2024-01-22T05:09:52.292061+0000","last_active":"2024-01-22T05:09:52.758051+0000","last_peered":"2024-01-22T05:09:52.758051+0000","last_clean":"2024-01-22T05:09:52.758051+0000","last_became_active":"2024-01-22T05:09:52.291734+0000","last_became_peered":"2024-01-22T05:09:52.291734+0000","last_unstale":"2024-01-22T05:09:52.758051+0000","last_undegraded":"2024-01-22T05:09:52.758051+0000","last_fullsized":"2024-01-22T05:09:52.758051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.758833+0000","last_change":"2024-01-22T05:09:52.754531+0000","last_active":"2024-01-22T05:09:52.758833+0000","last_peered":"2024-01-22T05:09:52.758833+0000","last_clean":"2024-01-22T05:09:52.758833+0000","last_became_active":"2024-01-22T05:09:52.754249+0000","last_became_peered":"2024-01-22T05:09:52.754249+0000","last_unstale":"2024-01-22T05:09:52.758833+0000","last_undegraded":"2024-01-22T05:09:52.758833+0000","last_fullsized":"2024-01-22T05:09:52.758833+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"87'2","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.743888+0000","last_change":"2024-01-22T05:09:52.303771+0000","last_active":"2024-01-22T05:09:52.743888+0000","last_peered":"2024-01-22T05:09:52.743888+0000","last_clean":"2024-01-22T05:09:52.743888+0000","last_became_active":"2024-01-22T05:09:52.303433+0000","last_became_peered":"2024-01-22T05:09:52.303433+0000","last_unstale":"2024-01-22T05:09:52.743888+0000","last_undegraded":"2024-01-22T05:09:52.743888+0000","last_fullsized":"2024-01-22T05:09:52.743888+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.756021+0000","last_change":"2024-01-22T05:09:52.753981+0000","last_active":"2024-01-22T05:09:52.756021+0000","last_peered":"2024-01-22T05:09:52.756021+0000","last_clean":"2024-01-22T05:09:52.756021+0000","last_became_active":"2024-01-22T05:09:52.753705+0000","last_became_peered":"2024-01-22T05:09:52.753705+0000","last_unstale":"2024-01-22T05:09:52.756021+0000","last_undegraded":"2024-01-22T05:09:52.756021+0000","last_fullsized":"2024-01-22T05:09:52.756021+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.757485+0000","last_change":"2024-01-22T05:09:52.303933+0000","last_active":"2024-01-22T05:09:52.757485+0000","last_peered":"2024-01-22T05:09:52.757485+0000","last_clean":"2024-01-22T05:09:52.757485+0000","last_became_active":"2024-01-22T05:09:52.303636+0000","last_became_peered":"2024-01-22T05:09:52.303636+0000","last_unstale":"2024-01-22T05:09:52.757485+0000","last_undegraded":"2024-01-22T05:09:52.757485+0000","last_fullsized":"2024-01-22T05:09:52.757485+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.741997+0000","last_change":"2024-01-22T05:09:52.738020+0000","last_active":"2024-01-22T05:09:52.741997+0000","last_peered":"2024-01-22T05:09:52.741997+0000","last_clean":"2024-01-22T05:09:52.741997+0000","last_became_active":"2024-01-22T05:09:52.737828+0000","last_became_peered":"2024-01-22T05:09:52.737828+0000","last_unstale":"2024-01-22T05:09:52.741997+0000","last_undegraded":"2024-01-22T05:09:52.741997+0000","last_fullsized":"2024-01-22T05:09:52.741997+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.718624+0000","last_change":"2024-01-22T05:09:52.307313+0000","last_active":"2024-01-22T05:09:52.718624+0000","last_peered":"2024-01-22T05:09:52.718624+0000","last_clean":"2024-01-22T05:09:52.718624+0000","last_became_active":"2024-01-22T05:09:52.306595+0000","last_became_peered":"2024-01-22T05:09:52.306595+0000","last_unstale":"2024-01-22T05:09:52.718624+0000","last_undegraded":"2024-01-22T05:09:52.718624+0000","last_fullsized":"2024-01-22T05:09:52.718624+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.757193+0000","last_change":"2024-01-22T05:09:52.742331+0000","last_active":"2024-01-22T05:09:52.757193+0000","last_peered":"2024-01-22T05:09:52.757193+0000","last_clean":"2024-01-22T05:09:52.757193+0000","last_became_active":"2024-01-22T05:09:52.742052+0000","last_became_peered":"2024-01-22T05:09:52.742052+0000","last_unstale":"2024-01-22T05:09:52.757193+0000","last_undegraded":"2024-01-22T05:09:52.757193+0000","last_fullsized":"2024-01-22T05:09:52.757193+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.721209+0000","last_change":"2024-01-22T05:09:52.295140+0000","last_active":"2024-01-22T05:09:52.721209+0000","last_peered":"2024-01-22T05:09:52.721209+0000","last_clean":"2024-01-22T05:09:52.721209+0000","last_became_active":"2024-01-22T05:09:52.294851+0000","last_became_peered":"2024-01-22T05:09:52.294851+0000","last_unstale":"2024-01-22T05:09:52.721209+0000","last_undegraded":"2024-01-22T05:09:52.721209+0000","last_fullsized":"2024-01-22T05:09:52.721209+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.759984+0000","last_change":"2024-01-22T05:09:52.747310+0000","last_active":"2024-01-22T05:09:52.759984+0000","last_peered":"2024-01-22T05:09:52.759984+0000","last_clean":"2024-01-22T05:09:52.759984+0000","last_became_active":"2024-01-22T05:09:52.746880+0000","last_became_peered":"2024-01-22T05:09:52.746880+0000","last_unstale":"2024-01-22T05:09:52.759984+0000","last_undegraded":"2024-01-22T05:09:52.759984+0000","last_fullsized":"2024-01-22T05:09:52.759984+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"87'4","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.743971+0000","last_change":"2024-01-22T05:09:52.301225+0000","last_active":"2024-01-22T05:09:52.743971+0000","last_peered":"2024-01-22T05:09:52.743971+0000","last_clean":"2024-01-22T05:09:52.743971+0000","last_became_active":"2024-01-22T05:09:52.300908+0000","last_became_peered":"2024-01-22T05:09:52.300908+0000","last_unstale":"2024-01-22T05:09:52.743971+0000","last_undegraded":"2024-01-22T05:09:52.743971+0000","last_fullsized":"2024-01-22T05:09:52.743971+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.759335+0000","last_change":"2024-01-22T05:09:52.757711+0000","last_active":"2024-01-22T05:09:52.759335+0000","last_peered":"2024-01-22T05:09:52.759335+0000","last_clean":"2024-01-22T05:09:52.759335+0000","last_became_active":"2024-01-22T05:09:52.752920+0000","last_became_peered":"2024-01-22T05:09:52.752920+0000","last_unstale":"2024-01-22T05:09:52.759335+0000","last_undegraded":"2024-01-22T05:09:52.759335+0000","last_fullsized":"2024-01-22T05:09:52.759335+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"87'2","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.760940+0000","last_change":"2024-01-22T05:09:52.287231+0000","last_active":"2024-01-22T05:09:52.760940+0000","last_peered":"2024-01-22T05:09:52.760940+0000","last_clean":"2024-01-22T05:09:52.760940+0000","last_became_active":"2024-01-22T05:09:52.286426+0000","last_became_peered":"2024-01-22T05:09:52.286426+0000","last_unstale":"2024-01-22T05:09:52.760940+0000","last_undegraded":"2024-01-22T05:09:52.760940+0000","last_fullsized":"2024-01-22T05:09:52.760940+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.758570+0000","last_change":"2024-01-22T05:09:52.748261+0000","last_active":"2024-01-22T05:09:52.758570+0000","last_peered":"2024-01-22T05:09:52.758570+0000","last_clean":"2024-01-22T05:09:52.758570+0000","last_became_active":"2024-01-22T05:09:52.747961+0000","last_became_peered":"2024-01-22T05:09:52.747961+0000","last_unstale":"2024-01-22T05:09:52.758570+0000","last_undegraded":"2024-01-22T05:09:52.758570+0000","last_fullsized":"2024-01-22T05:09:52.758570+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.742349+0000","last_change":"2024-01-22T05:09:52.305843+0000","last_active":"2024-01-22T05:09:52.742349+0000","last_peered":"2024-01-22T05:09:52.742349+0000","last_clean":"2024-01-22T05:09:52.742349+0000","last_became_active":"2024-01-22T05:09:52.305568+0000","last_became_peered":"2024-01-22T05:09:52.305568+0000","last_unstale":"2024-01-22T05:09:52.742349+0000","last_undegraded":"2024-01-22T05:09:52.742349+0000","last_fullsized":"2024-01-22T05:09:52.742349+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.748586+0000","last_change":"2024-01-22T05:09:52.746555+0000","last_active":"2024-01-22T05:09:52.748586+0000","last_peered":"2024-01-22T05:09:52.748586+0000","last_clean":"2024-01-22T05:09:52.748586+0000","last_became_active":"2024-01-22T05:09:52.746271+0000","last_became_peered":"2024-01-22T05:09:52.746271+0000","last_unstale":"2024-01-22T05:09:52.748586+0000","last_undegraded":"2024-01-22T05:09:52.748586+0000","last_fullsized":"2024-01-22T05:09:52.748586+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.741364+0000","last_change":"2024-01-22T05:09:52.285803+0000","last_active":"2024-01-22T05:09:52.741364+0000","last_peered":"2024-01-22T05:09:52.741364+0000","last_clean":"2024-01-22T05:09:52.741364+0000","last_became_active":"2024-01-22T05:09:52.285448+0000","last_became_peered":"2024-01-22T05:09:52.285448+0000","last_unstale":"2024-01-22T05:09:52.741364+0000","last_undegraded":"2024-01-22T05:09:52.741364+0000","last_fullsized":"2024-01-22T05:09:52.741364+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.758850+0000","last_change":"2024-01-22T05:09:52.754883+0000","last_active":"2024-01-22T05:09:52.758850+0000","last_peered":"2024-01-22T05:09:52.758850+0000","last_clean":"2024-01-22T05:09:52.758850+0000","last_became_active":"2024-01-22T05:09:52.754599+0000","last_became_peered":"2024-01-22T05:09:52.754599+0000","last_unstale":"2024-01-22T05:09:52.758850+0000","last_undegraded":"2024-01-22T05:09:52.758850+0000","last_fullsized":"2024-01-22T05:09:52.758850+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.741078+0000","last_change":"2024-01-22T05:09:52.287765+0000","last_active":"2024-01-22T05:09:52.741078+0000","last_peered":"2024-01-22T05:09:52.741078+0000","last_clean":"2024-01-22T05:09:52.741078+0000","last_became_active":"2024-01-22T05:09:52.287495+0000","last_became_peered":"2024-01-22T05:09:52.287495+0000","last_unstale":"2024-01-22T05:09:52.741078+0000","last_undegraded":"2024-01-22T05:09:52.741078+0000","last_fullsized":"2024-01-22T05:09:52.741078+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.736024+0000","last_change":"2024-01-22T05:09:52.729422+0000","last_active":"2024-01-22T05:09:52.736024+0000","last_peered":"2024-01-22T05:09:52.736024+0000","last_clean":"2024-01-22T05:09:52.736024+0000","last_became_active":"2024-01-22T05:09:52.729123+0000","last_became_peered":"2024-01-22T05:09:52.729123+0000","last_unstale":"2024-01-22T05:09:52.736024+0000","last_undegraded":"2024-01-22T05:09:52.736024+0000","last_fullsized":"2024-01-22T05:09:52.736024+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.725389+0000","last_change":"2024-01-22T05:09:52.303069+0000","last_active":"2024-01-22T05:09:52.725389+0000","last_peered":"2024-01-22T05:09:52.725389+0000","last_clean":"2024-01-22T05:09:52.725389+0000","last_became_active":"2024-01-22T05:09:52.302706+0000","last_became_peered":"2024-01-22T05:09:52.302706+0000","last_unstale":"2024-01-22T05:09:52.725389+0000","last_undegraded":"2024-01-22T05:09:52.725389+0000","last_fullsized":"2024-01-22T05:09:52.725389+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.756068+0000","last_change":"2024-01-22T05:09:52.754784+0000","last_active":"2024-01-22T05:09:52.756068+0000","last_peered":"2024-01-22T05:09:52.756068+0000","last_clean":"2024-01-22T05:09:52.756068+0000","last_became_active":"2024-01-22T05:09:52.754531+0000","last_became_peered":"2024-01-22T05:09:52.754531+0000","last_unstale":"2024-01-22T05:09:52.756068+0000","last_undegraded":"2024-01-22T05:09:52.756068+0000","last_fullsized":"2024-01-22T05:09:52.756068+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.743220+0000","last_change":"2024-01-22T05:09:52.295007+0000","last_active":"2024-01-22T05:09:52.743220+0000","last_peered":"2024-01-22T05:09:52.743220+0000","last_clean":"2024-01-22T05:09:52.743220+0000","last_became_active":"2024-01-22T05:09:52.293628+0000","last_became_peered":"2024-01-22T05:09:52.293628+0000","last_unstale":"2024-01-22T05:09:52.743220+0000","last_undegraded":"2024-01-22T05:09:52.743220+0000","last_fullsized":"2024-01-22T05:09:52.743220+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.755475+0000","last_change":"2024-01-22T05:09:52.745775+0000","last_active":"2024-01-22T05:09:52.755475+0000","last_peered":"2024-01-22T05:09:52.755475+0000","last_clean":"2024-01-22T05:09:52.755475+0000","last_became_active":"2024-01-22T05:09:52.745454+0000","last_became_peered":"2024-01-22T05:09:52.745454+0000","last_unstale":"2024-01-22T05:09:52.755475+0000","last_undegraded":"2024-01-22T05:09:52.755475+0000","last_fullsized":"2024-01-22T05:09:52.755475+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.737409+0000","last_change":"2024-01-22T05:09:52.287832+0000","last_active":"2024-01-22T05:09:52.737409+0000","last_peered":"2024-01-22T05:09:52.737409+0000","last_clean":"2024-01-22T05:09:52.737409+0000","last_became_active":"2024-01-22T05:09:52.287276+0000","last_became_peered":"2024-01-22T05:09:52.287276+0000","last_unstale":"2024-01-22T05:09:52.737409+0000","last_undegraded":"2024-01-22T05:09:52.737409+0000","last_fullsized":"2024-01-22T05:09:52.737409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.754120+0000","last_change":"2024-01-22T05:09:52.749469+0000","last_active":"2024-01-22T05:09:52.754120+0000","last_peered":"2024-01-22T05:09:52.754120+0000","last_clean":"2024-01-22T05:09:52.754120+0000","last_became_active":"2024-01-22T05:09:52.749055+0000","last_became_peered":"2024-01-22T05:09:52.749055+0000","last_unstale":"2024-01-22T05:09:52.754120+0000","last_undegraded":"2024-01-22T05:09:52.754120+0000","last_fullsized":"2024-01-22T05:09:52.754120+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.740866+0000","last_change":"2024-01-22T05:09:52.282595+0000","last_active":"2024-01-22T05:09:52.740866+0000","last_peered":"2024-01-22T05:09:52.740866+0000","last_clean":"2024-01-22T05:09:52.740866+0000","last_became_active":"2024-01-22T05:09:52.282317+0000","last_became_peered":"2024-01-22T05:09:52.282317+0000","last_unstale":"2024-01-22T05:09:52.740866+0000","last_undegraded":"2024-01-22T05:09:52.740866+0000","last_fullsized":"2024-01-22T05:09:52.740866+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.750031+0000","last_change":"2024-01-22T05:09:52.738362+0000","last_active":"2024-01-22T05:09:52.750031+0000","last_peered":"2024-01-22T05:09:52.750031+0000","last_clean":"2024-01-22T05:09:52.750031+0000","last_became_active":"2024-01-22T05:09:52.738073+0000","last_became_peered":"2024-01-22T05:09:52.738073+0000","last_unstale":"2024-01-22T05:09:52.750031+0000","last_undegraded":"2024-01-22T05:09:52.750031+0000","last_fullsized":"2024-01-22T05:09:52.750031+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.729443+0000","last_change":"2024-01-22T05:09:52.278471+0000","last_active":"2024-01-22T05:09:52.729443+0000","last_peered":"2024-01-22T05:09:52.729443+0000","last_clean":"2024-01-22T05:09:52.729443+0000","last_became_active":"2024-01-22T05:09:52.278138+0000","last_became_peered":"2024-01-22T05:09:52.278138+0000","last_unstale":"2024-01-22T05:09:52.729443+0000","last_undegraded":"2024-01-22T05:09:52.729443+0000","last_fullsized":"2024-01-22T05:09:52.729443+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.741897+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:09:52.741897+0000","last_peered":"2024-01-22T05:09:52.741897+0000","last_clean":"2024-01-22T05:09:52.741897+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:09:52.741897+0000","last_undegraded":"2024-01-22T05:09:52.741897+0000","last_fullsized":"2024-01-22T05:09:52.741897+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.738693+0000","last_change":"2024-01-22T05:09:52.736003+0000","last_active":"2024-01-22T05:09:52.738693+0000","last_peered":"2024-01-22T05:09:52.738693+0000","last_clean":"2024-01-22T05:09:52.738693+0000","last_became_active":"2024-01-22T05:09:52.735686+0000","last_became_peered":"2024-01-22T05:09:52.735686+0000","last_unstale":"2024-01-22T05:09:52.738693+0000","last_undegraded":"2024-01-22T05:09:52.738693+0000","last_fullsized":"2024-01-22T05:09:52.738693+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.717893+0000","last_change":"2024-01-22T05:09:52.283612+0000","last_active":"2024-01-22T05:09:52.717893+0000","last_peered":"2024-01-22T05:09:52.717893+0000","last_clean":"2024-01-22T05:09:52.717893+0000","last_became_active":"2024-01-22T05:09:52.283314+0000","last_became_peered":"2024-01-22T05:09:52.283314+0000","last_unstale":"2024-01-22T05:09:52.717893+0000","last_undegraded":"2024-01-22T05:09:52.717893+0000","last_fullsized":"2024-01-22T05:09:52.717893+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.742425+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:09:52.742425+0000","last_peered":"2024-01-22T05:09:52.742425+0000","last_clean":"2024-01-22T05:09:52.742425+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:09:52.742425+0000","last_undegraded":"2024-01-22T05:09:52.742425+0000","last_fullsized":"2024-01-22T05:09:52.742425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.754371+0000","last_change":"2024-01-22T05:09:52.750606+0000","last_active":"2024-01-22T05:09:52.754371+0000","last_peered":"2024-01-22T05:09:52.754371+0000","last_clean":"2024-01-22T05:09:52.754371+0000","last_became_active":"2024-01-22T05:09:52.749886+0000","last_became_peered":"2024-01-22T05:09:52.749886+0000","last_unstale":"2024-01-22T05:09:52.754371+0000","last_undegraded":"2024-01-22T05:09:52.754371+0000","last_fullsized":"2024-01-22T05:09:52.754371+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.752118+0000","last_change":"2024-01-22T05:09:52.288015+0000","last_active":"2024-01-22T05:09:52.752118+0000","last_peered":"2024-01-22T05:09:52.752118+0000","last_clean":"2024-01-22T05:09:52.752118+0000","last_became_active":"2024-01-22T05:09:52.285604+0000","last_became_peered":"2024-01-22T05:09:52.285604+0000","last_unstale":"2024-01-22T05:09:52.752118+0000","last_undegraded":"2024-01-22T05:09:52.752118+0000","last_fullsized":"2024-01-22T05:09:52.752118+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.727756+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:09:52.727756+0000","last_peered":"2024-01-22T05:09:52.727756+0000","last_clean":"2024-01-22T05:09:52.727756+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:09:52.727756+0000","last_undegraded":"2024-01-22T05:09:52.727756+0000","last_fullsized":"2024-01-22T05:09:52.727756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.742851+0000","last_change":"2024-01-22T05:09:52.730606+0000","last_active":"2024-01-22T05:09:52.742851+0000","last_peered":"2024-01-22T05:09:52.742851+0000","last_clean":"2024-01-22T05:09:52.742851+0000","last_became_active":"2024-01-22T05:09:52.730191+0000","last_became_peered":"2024-01-22T05:09:52.730191+0000","last_unstale":"2024-01-22T05:09:52.742851+0000","last_undegraded":"2024-01-22T05:09:52.742851+0000","last_fullsized":"2024-01-22T05:09:52.742851+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.729392+0000","last_change":"2024-01-22T05:09:52.292815+0000","last_active":"2024-01-22T05:09:52.729392+0000","last_peered":"2024-01-22T05:09:52.729392+0000","last_clean":"2024-01-22T05:09:52.729392+0000","last_became_active":"2024-01-22T05:09:52.292500+0000","last_became_peered":"2024-01-22T05:09:52.292500+0000","last_unstale":"2024-01-22T05:09:52.729392+0000","last_undegraded":"2024-01-22T05:09:52.729392+0000","last_fullsized":"2024-01-22T05:09:52.729392+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.736752+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:09:52.736752+0000","last_peered":"2024-01-22T05:09:52.736752+0000","last_clean":"2024-01-22T05:09:52.736752+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:09:52.736752+0000","last_undegraded":"2024-01-22T05:09:52.736752+0000","last_fullsized":"2024-01-22T05:09:52.736752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.759059+0000","last_change":"2024-01-22T05:09:52.756047+0000","last_active":"2024-01-22T05:09:52.759059+0000","last_peered":"2024-01-22T05:09:52.759059+0000","last_clean":"2024-01-22T05:09:52.759059+0000","last_became_active":"2024-01-22T05:09:52.755756+0000","last_became_peered":"2024-01-22T05:09:52.755756+0000","last_unstale":"2024-01-22T05:09:52.759059+0000","last_undegraded":"2024-01-22T05:09:52.759059+0000","last_fullsized":"2024-01-22T05:09:52.759059+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.727333+0000","last_change":"2024-01-22T05:09:52.309505+0000","last_active":"2024-01-22T05:09:52.727333+0000","last_peered":"2024-01-22T05:09:52.727333+0000","last_clean":"2024-01-22T05:09:52.727333+0000","last_became_active":"2024-01-22T05:09:52.305992+0000","last_became_peered":"2024-01-22T05:09:52.305992+0000","last_unstale":"2024-01-22T05:09:52.727333+0000","last_undegraded":"2024-01-22T05:09:52.727333+0000","last_fullsized":"2024-01-22T05:09:52.727333+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":80,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.721491+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:09:52.721491+0000","last_peered":"2024-01-22T05:09:52.721491+0000","last_clean":"2024-01-22T05:09:52.721491+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:09:52.721491+0000","last_undegraded":"2024-01-22T05:09:52.721491+0000","last_fullsized":"2024-01-22T05:09:52.721491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.745390+0000","last_change":"2024-01-22T05:09:52.739535+0000","last_active":"2024-01-22T05:09:52.745390+0000","last_peered":"2024-01-22T05:09:52.745390+0000","last_clean":"2024-01-22T05:09:52.745390+0000","last_became_active":"2024-01-22T05:09:52.739196+0000","last_became_peered":"2024-01-22T05:09:52.739196+0000","last_unstale":"2024-01-22T05:09:52.745390+0000","last_undegraded":"2024-01-22T05:09:52.745390+0000","last_fullsized":"2024-01-22T05:09:52.745390+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.746912+0000","last_change":"2024-01-22T05:09:52.285964+0000","last_active":"2024-01-22T05:09:52.746912+0000","last_peered":"2024-01-22T05:09:52.746912+0000","last_clean":"2024-01-22T05:09:52.746912+0000","last_became_active":"2024-01-22T05:09:52.285512+0000","last_became_peered":"2024-01-22T05:09:52.285512+0000","last_unstale":"2024-01-22T05:09:52.746912+0000","last_undegraded":"2024-01-22T05:09:52.746912+0000","last_fullsized":"2024-01-22T05:09:52.746912+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.729521+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:09:52.729521+0000","last_peered":"2024-01-22T05:09:52.729521+0000","last_clean":"2024-01-22T05:09:52.729521+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:09:52.729521+0000","last_undegraded":"2024-01-22T05:09:52.729521+0000","last_fullsized":"2024-01-22T05:09:52.729521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.761141+0000","last_change":"2024-01-22T05:09:52.760288+0000","last_active":"2024-01-22T05:09:52.761141+0000","last_peered":"2024-01-22T05:09:52.761141+0000","last_clean":"2024-01-22T05:09:52.761141+0000","last_became_active":"2024-01-22T05:09:52.759942+0000","last_became_peered":"2024-01-22T05:09:52.759942+0000","last_unstale":"2024-01-22T05:09:52.761141+0000","last_undegraded":"2024-01-22T05:09:52.761141+0000","last_fullsized":"2024-01-22T05:09:52.761141+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"87'2","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.762252+0000","last_change":"2024-01-22T05:09:52.302187+0000","last_active":"2024-01-22T05:09:52.762252+0000","last_peered":"2024-01-22T05:09:52.762252+0000","last_clean":"2024-01-22T05:09:52.762252+0000","last_became_active":"2024-01-22T05:09:52.301852+0000","last_became_peered":"2024-01-22T05:09:52.301852+0000","last_unstale":"2024-01-22T05:09:52.762252+0000","last_undegraded":"2024-01-22T05:09:52.762252+0000","last_fullsized":"2024-01-22T05:09:52.762252+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.721759+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:09:52.721759+0000","last_peered":"2024-01-22T05:09:52.721759+0000","last_clean":"2024-01-22T05:09:52.721759+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:09:52.721759+0000","last_undegraded":"2024-01-22T05:09:52.721759+0000","last_fullsized":"2024-01-22T05:09:52.721759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.760242+0000","last_change":"2024-01-22T05:09:52.749413+0000","last_active":"2024-01-22T05:09:52.760242+0000","last_peered":"2024-01-22T05:09:52.760242+0000","last_clean":"2024-01-22T05:09:52.760242+0000","last_became_active":"2024-01-22T05:09:52.749123+0000","last_became_peered":"2024-01-22T05:09:52.749123+0000","last_unstale":"2024-01-22T05:09:52.760242+0000","last_undegraded":"2024-01-22T05:09:52.760242+0000","last_fullsized":"2024-01-22T05:09:52.760242+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:52.246134+0000","last_clean_scrub_stamp":"2024-01-22T05:09:52.246134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.724083+0000","last_change":"2024-01-22T05:09:52.295705+0000","last_active":"2024-01-22T05:09:52.724083+0000","last_peered":"2024-01-22T05:09:52.724083+0000","last_clean":"2024-01-22T05:09:52.724083+0000","last_became_active":"2024-01-22T05:09:52.295379+0000","last_became_peered":"2024-01-22T05:09:52.295379+0000","last_unstale":"2024-01-22T05:09:52.724083+0000","last_undegraded":"2024-01-22T05:09:52.724083+0000","last_fullsized":"2024-01-22T05:09:52.724083+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:09:51.233031+0000","last_clean_scrub_stamp":"2024-01-22T05:09:51.233031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":80,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.721361+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:09:52.721361+0000","last_peered":"2024-01-22T05:09:52.721361+0000","last_clean":"2024-01-22T05:09:52.721361+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:09:52.721361+0000","last_undegraded":"2024-01-22T05:09:52.721361+0000","last_fullsized":"2024-01-22T05:09:52.721361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-22T05:09:52.721850+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:09:52.721850+0000","last_peered":"2024-01-22T05:09:52.721850+0000","last_clean":"2024-01-22T05:09:52.721850+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:09:52.721850+0000","last_undegraded":"2024-01-22T05:09:52.721850+0000","last_fullsized":"2024-01-22T05:09:52.721850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306344,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065496,"statfs":{"total":96636764160,"available":96323067904,"internally_reserved":0,"allocated":1081344,"data_stored":528017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.98699999999999999,"15min":1.0409999999999999},"min":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.71499999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.63400000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.04,"15min":0.98799999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.141,"15min":1.1699999999999999},"min":{"1min":0.78400000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5309999999999999,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1279999999999999,"15min":1.1060000000000001},"min":{"1min":0.81399999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.284,"5min":1.169,"15min":1.173},"min":{"1min":0.79700000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.78500000000000003}]},{"osd":3,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.234,"15min":1.236},"min":{"1min":0.90300000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5720000000000001,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.296,"5min":1.21,"15min":1.228},"min":{"1min":0.93999999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.91100000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.1299999999999999,"15min":1.071},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.022},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.1879999999999999,"15min":1.1679999999999999},"min":{"1min":1.01,"5min":0.751,"15min":0.751},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":1.0129999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.2290000000000001,"15min":1.2010000000000001},"min":{"1min":0.61199999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.3169999999999999,"15min":1.2330000000000001},"min":{"1min":1.0860000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":3.625,"5min":3.625,"15min":3.625},"last":0.98199999999999998}]},{"osd":6,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.256,"15min":1.258},"min":{"1min":0.999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.732,"5min":1.823,"15min":1.823},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.379,"15min":1.335},"min":{"1min":1.1140000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.8129999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.94399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310444,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061396,"statfs":{"total":96636764160,"available":96318869504,"internally_reserved":0,"allocated":1085440,"data_stored":527575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.794,"15min":1.3340000000000001},"min":{"1min":0.74299999999999999,"5min":0.372,"15min":0.372},"max":{"1min":2.0219999999999998,"5min":77.745000000000005,"15min":77.745000000000005},"last":1.133},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1659999999999999,"15min":1.091},"min":{"1min":0.60799999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.7509999999999999,"5min":13.555999999999999,"15min":13.555999999999999},"last":1.0640000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1499999999999999,"15min":1.0980000000000001},"min":{"1min":0.66000000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3899999999999999,"5min":15.499000000000001,"15min":15.499000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.222,"15min":1.2430000000000001},"min":{"1min":0.63600000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.177,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":0.93100000000000005}]},{"osd":2,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1499999999999999,"15min":1.1599999999999999},"min":{"1min":0.79300000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.9470000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1379999999999999,"15min":1.1220000000000001},"min":{"1min":0.77300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6040000000000001,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.97099999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":2.113,"15min":1.46},"min":{"1min":0.749,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.706,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.028},{"interface":"front","average":{"1min":1.117,"5min":1.2689999999999999,"15min":1.234},"min":{"1min":0.75800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.367,"5min":15.468,"15min":15.468},"last":1.2310000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1439999999999999,"15min":1.101},"min":{"1min":0.85499999999999998,"5min":0.495,"15min":0.495},"max":{"1min":1.8200000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.1299999999999999},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.619,"5min":1.649,"15min":1.649},"last":1.109}]},{"osd":5,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.4139999999999999,"15min":1.266},"min":{"1min":0.84599999999999997,"5min":0.624,"15min":0.624},"max":{"1min":1.5800000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.3109999999999999,"15min":1.2849999999999999},"min":{"1min":0.88300000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.4239999999999999,"5min":3.875,"15min":3.875},"last":0.99399999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.536,"15min":1.4379999999999999},"min":{"1min":0.89200000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.905,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.895,"15min":1.5840000000000001},"min":{"1min":0.93799999999999994,"5min":0.495,"15min":0.495},"max":{"1min":1.6140000000000001,"5min":63.737000000000002,"15min":63.737000000000002},"last":1.3939999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310452,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061388,"statfs":{"total":96636764160,"available":96318861312,"internally_reserved":0,"allocated":1093632,"data_stored":529021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":0.998,"15min":0.998},"min":{"1min":0.80300000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.284},{"interface":"front","average":{"1min":1.034,"5min":1.036,"15min":1.105},"min":{"1min":0.70799999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.5680000000000001,"5min":1.571,"15min":1.571},"last":1.1990000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.163,"15min":1.2170000000000001},"min":{"1min":1.119,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.516,"5min":1.821,"15min":1.821},"last":1.359},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2030000000000001,"15min":1.302},"min":{"1min":0.96599999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5329999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.2729999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.1539999999999999,"15min":1.1599999999999999},"min":{"1min":0.86899999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.617,"5min":1.629,"15min":1.629},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.163,"5min":1.0960000000000001,"15min":1.1419999999999999},"min":{"1min":0.90500000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3680000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.1759999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.143,"15min":1.1850000000000001},"min":{"1min":0.83199999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.49,"5min":1.931,"15min":1.931},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.22,"15min":1.3029999999999999},"min":{"1min":0.79900000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5509999999999999,"5min":2.266,"15min":2.266},"last":1.111}]},{"osd":4,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1220000000000001,"15min":1.1859999999999999},"min":{"1min":0.82599999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.518,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.347},{"interface":"front","average":{"1min":1.238,"5min":1.226,"15min":1.298},"min":{"1min":0.85499999999999998,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8300000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.137}]},{"osd":6,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.264,"15min":1.343},"min":{"1min":0.879,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6699999999999999,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.2749999999999999,"15min":1.3109999999999999},"min":{"1min":0.99299999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7829999999999999,"5min":1.909,"15min":1.909},"last":1.056}]},{"osd":7,"last update":"Mon Jan 22 05:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3560000000000001,"15min":1.423},"min":{"1min":0.91100000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.766,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3899999999999999,"15min":1.476},"min":{"1min":1.0589999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.671,"5min":3.1840000000000002,"15min":3.1840000000000002},"last":1.216}]}]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310440,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061400,"statfs":{"total":96636764160,"available":96318873600,"internally_reserved":0,"allocated":1081344,"data_stored":528017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.1140000000000001,"15min":1.143},"min":{"1min":0.65800000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6719999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.133,"15min":1.103},"min":{"1min":0.63400000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.474}]},{"osd":1,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.0569999999999999,"15min":1.0860000000000001},"min":{"1min":0.69399999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.389},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.083,"15min":1.1870000000000001},"min":{"1min":0.66400000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5329999999999999,"5min":2.194,"15min":2.194},"last":1.3240000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.099,"15min":1.091},"min":{"1min":0.68300000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4470000000000001,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.177,"15min":1.272},"min":{"1min":0.78400000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.536,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.6180000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.133,"15min":1.1839999999999999},"min":{"1min":0.89100000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.514,"5min":1.589,"15min":1.589},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.1850000000000001,"15min":1.1679999999999999},"min":{"1min":0.81599999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.54,"5min":5.3029999999999999,"15min":5.3029999999999999},"last":1.55}]},{"osd":5,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1639999999999999,"15min":1.2170000000000001},"min":{"1min":0.85099999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.667,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.1220000000000001,"15min":1.1579999999999999},"min":{"1min":0.84599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.597,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.0629999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.196,"15min":1.1919999999999999},"min":{"1min":0.85299999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6160000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.331,"15min":1.415},"min":{"1min":0.89700000000000002,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.7270000000000001,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.93200000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3220000000000001,"15min":1.3660000000000001},"min":{"1min":0.878,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.833,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.363,"15min":1.3799999999999999},"min":{"1min":1.0089999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6359999999999999,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.6719999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061392,"statfs":{"total":96636764160,"available":96318865408,"internally_reserved":0,"allocated":1089536,"data_stored":528177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.95099999999999996,"15min":0.90500000000000003},"min":{"1min":0.55300000000000005,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4179999999999999,"5min":14.859,"15min":14.859},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.94399999999999995,"15min":0.88800000000000001},"min":{"1min":0.55700000000000005,"5min":0.317,"15min":0.317},"max":{"1min":1.4119999999999999,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":0.60299999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.874,"15min":0.85599999999999998},"min":{"1min":0.66900000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2110000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.01,"5min":1,"15min":0.98599999999999999},"min":{"1min":0.63300000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4079999999999999,"5min":5.7519999999999998,"15min":5.7519999999999998},"last":1.0780000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.085,"15min":1.159},"min":{"1min":0.64000000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1799999999999999,"15min":1.194},"min":{"1min":0.72999999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2,"5min":2,"15min":2},"last":1.1950000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.2889999999999999,"15min":1.296},"min":{"1min":0.71299999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.718,"5min":5.016,"15min":5.016},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3420000000000001,"15min":1.3380000000000001},"min":{"1min":1.0469999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.633,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":1.4119999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3,"15min":1.298},"min":{"1min":1.0169999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.7090000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":1.107},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4830000000000001,"15min":1.345},"min":{"1min":0.94699999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.851,"5min":14.523999999999999,"15min":14.523999999999999},"last":0.95699999999999996}]},{"osd":6,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.365,"15min":1.415},"min":{"1min":0.90500000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.752,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.4350000000000001,"15min":1.4219999999999999},"min":{"1min":0.95399999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.7370000000000001,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":1.159}]},{"osd":7,"last update":"Mon Jan 22 05:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.405,"15min":1.403},"min":{"1min":0.995,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.861,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.411,"15min":1.427},"min":{"1min":0.97799999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1139999999999999,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":1.514}]}]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310440,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061400,"statfs":{"total":96636764160,"available":96318873600,"internally_reserved":0,"allocated":1081344,"data_stored":527533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.76000000000000001,"15min":0.75600000000000001},"min":{"1min":0.63600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2709999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.995,"5min":0.85799999999999998,"15min":0.83499999999999996},"min":{"1min":0.62,"5min":0.373,"15min":0.373},"max":{"1min":1.6559999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.98899999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.83199999999999996,"15min":0.80600000000000005},"min":{"1min":0.59399999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.91900000000000004,"15min":0.94199999999999995},"min":{"1min":0.755,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2569999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.95899999999999996}]},{"osd":3,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1000000000000001,"15min":1.0669999999999999},"min":{"1min":0.63300000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.79,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.552},{"interface":"front","average":{"1min":1.355,"5min":1.1819999999999999,"15min":1.173},"min":{"1min":0.76600000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.73,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.0840000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.254,"15min":1.306},"min":{"1min":1.1890000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5940000000000001,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.1819999999999999,"15min":1.2090000000000001},"min":{"1min":0.93300000000000005,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.694,"5min":1.952,"15min":1.952},"last":1.387}]},{"osd":5,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2130000000000001,"15min":1.196},"min":{"1min":0.88300000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.597,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.6679999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.266,"15min":1.319},"min":{"1min":1.022,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5629999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.2629999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.2350000000000001,"15min":1.2589999999999999},"min":{"1min":0.97499999999999998,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8360000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.292,"15min":1.2909999999999999},"min":{"1min":1.0389999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.6990000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.6160000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:09:35 2024","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.3200000000000001,"15min":1.357},"min":{"1min":1.081,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.867,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.405,"15min":1.413},"min":{"1min":1.2050000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.877,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.8109999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310444,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061396,"statfs":{"total":96636764160,"available":96318869504,"internally_reserved":0,"allocated":1085440,"data_stored":527587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.90500000000000003,"15min":0.85499999999999998},"min":{"1min":0.69899999999999995,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2230000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.98899999999999999,"15min":1.0009999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.873,"5min":2.101,"15min":2.101},"last":0.78800000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.98499999999999999,"15min":1.0029999999999999},"min":{"1min":0.63200000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4390000000000001,"5min":1.722,"15min":1.722},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.042,"15min":1.03},"min":{"1min":0.64200000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.494,"5min":2.008,"15min":2.008},"last":0.71499999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0569999999999999,"15min":1.0049999999999999},"min":{"1min":0.71699999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":4.665,"15min":4.665},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.89600000000000002,"15min":0.88100000000000001},"min":{"1min":0.58499999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.333,"5min":1.867,"15min":1.867},"last":0.81299999999999994}]},{"osd":4,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2210000000000001,"15min":1.206},"min":{"1min":0.92800000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.605,"5min":1.788,"15min":1.788},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2949999999999999,"15min":1.2569999999999999},"min":{"1min":0.96199999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6439999999999999,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":0.99099999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.1930000000000001,"15min":1.1910000000000001},"min":{"1min":0.80000000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.292,"15min":1.278},"min":{"1min":1.0349999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.9430000000000001,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.0169999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.83899999999999997,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.74,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.349,"15min":1.3420000000000001},"min":{"1min":0.98599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.893,"5min":2.294,"15min":2.294},"last":1.204}]},{"osd":7,"last update":"Mon Jan 22 05:09:37 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.397,"15min":1.379},"min":{"1min":0.92700000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.764,"5min":4.4329999999999998,"15min":4.4329999999999998},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":1.0149999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.0329999999999999,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":1.004}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306348,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065492,"statfs":{"total":96636764160,"available":96323063808,"internally_reserved":0,"allocated":1085440,"data_stored":528389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.6419999999999999,"5min":0.97499999999999998,"15min":0.96399999999999997},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":15.273,"5min":15.273,"15min":15.273},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.91800000000000004,"15min":0.98299999999999998},"min":{"1min":0.51800000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.3149999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.716,"5min":1.1319999999999999,"15min":1.1140000000000001},"min":{"1min":0.56499999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":15.473000000000001,"5min":15.473000000000001,"15min":15.473000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.008,"15min":1.024},"min":{"1min":0.68700000000000006,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.589,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.1259999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":0.99399999999999999,"15min":1.0349999999999999},"min":{"1min":0.59499999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.3970000000000002,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.931,"5min":1.256,"15min":1.25},"min":{"1min":0.71699999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":15.439,"5min":15.439,"15min":15.439},"last":1.375}]},{"osd":4,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2509999999999999,"15min":1.369},"min":{"1min":0.751,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6200000000000001,"5min":5.1799999999999997,"15min":5.1799999999999997},"last":1.405},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.23,"15min":1.258},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":1.149}]},{"osd":5,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.272,"15min":1.373},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.891,"5min":3.548,"15min":3.548},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.3220000000000001,"15min":1.4159999999999999},"min":{"1min":0.80500000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.2769999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":2.149,"5min":1.51,"15min":1.4870000000000001},"min":{"1min":0.89100000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":15.4,"5min":15.4,"15min":15.4},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.6899999999999999,"5min":1.411,"15min":1.512},"min":{"1min":1.0489999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":7.1349999999999998,"5min":7.1349999999999998,"15min":7.1349999999999998},"last":1.2370000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4279999999999999,"15min":1.621},"min":{"1min":1.1040000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.1080000000000001,"5min":5.29,"15min":5.29},"last":1.486},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.361,"15min":1.4350000000000001},"min":{"1min":0.93400000000000005,"5min":0.752,"15min":0.752},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.4259999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:10:02.195 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:10:02.196 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-22T05:10:02.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.402+0000 7ff973a00700 1 Processor -- start 2024-01-22T05:10:02.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.402+0000 7ff973a00700 1 -- start start 2024-01-22T05:10:02.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.406+0000 7ff973a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0bcbe0 0x7ff96c068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:02.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.406+0000 7ff973a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c158650 con 0x7ff96c0a8c20 2024-01-22T05:10:02.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.406+0000 7ff973a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c0bd170 con 0x7ff96c0c1ce0 2024-01-22T05:10:02.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.406+0000 7ff973a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c067c30 con 0x7ff96c0bcbe0 2024-01-22T05:10:02.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff971000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff96c0a8c20 0x7ff96c0c15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45740/0 (socket says 172.21.15.49:45740) 2024-01-22T05:10:02.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff971000700 1 -- 172.21.15.49:0/2213761262 learned_addr learned my addr 172.21.15.49:0/2213761262 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:10:02.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff971a00700 1 --2- 172.21.15.49:0/2213761262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0bcbe0 0x7ff96c068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:02.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff96b400700 1 -- 172.21.15.49:0/2213761262 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909464678 0 0) 0x7ff95c001110 con 0x7ff96c0a8c20 2024-01-22T05:10:02.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff96b400700 1 -- 172.21.15.49:0/2213761262 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff94c0033f0 con 0x7ff96c0a8c20 2024-01-22T05:10:02.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff96b400700 1 -- 172.21.15.49:0/2213761262 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592189197 0 0) 0x7ff96c0bd170 con 0x7ff96c0c1ce0 2024-01-22T05:10:02.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff96b400700 1 -- 172.21.15.49:0/2213761262 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff95c001110 con 0x7ff96c0c1ce0 2024-01-22T05:10:02.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff971a00700 1 -- 172.21.15.49:0/2213761262 >> v1:172.21.15.110:6789/0 conn(0x7ff96c0c1ce0 legacy=0x7ff96c0bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:02.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff971a00700 1 -- 172.21.15.49:0/2213761262 >> v1:172.21.15.49:6789/0 conn(0x7ff96c0a8c20 legacy=0x7ff96c0c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:02.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff971a00700 1 -- 172.21.15.49:0/2213761262 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c067f10 con 0x7ff96c0bcbe0 2024-01-22T05:10:02.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff971a00700 1 --2- 172.21.15.49:0/2213761262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0bcbe0 0x7ff96c068710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7ff964009e90 tx=0x7ff964009780).ready entity=mon.2 client_cookie=cad9fdbf2fdf76c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:02.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff96b400700 1 -- 172.21.15.49:0/2213761262 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96400e070 con 0x7ff96c0bcbe0 2024-01-22T05:10:02.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff96b400700 1 -- 172.21.15.49:0/2213761262 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96400bab0 con 0x7ff96c0bcbe0 2024-01-22T05:10:02.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff96b400700 1 -- 172.21.15.49:0/2213761262 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96400be30 con 0x7ff96c0bcbe0 2024-01-22T05:10:02.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff973a00700 1 -- 172.21.15.49:0/2213761262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0bcbe0 msgr2=0x7ff96c068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:02.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff973a00700 1 --2- 172.21.15.49:0/2213761262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0bcbe0 0x7ff96c068710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7ff964009e90 tx=0x7ff964009780).stop 2024-01-22T05:10:02.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff973a00700 1 -- 172.21.15.49:0/2213761262 shutdown_connections 2024-01-22T05:10:02.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff973a00700 1 --2- 172.21.15.49:0/2213761262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0bcbe0 0x7ff96c068710 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.410+0000 7ff973a00700 1 -- 172.21.15.49:0/2213761262 >> 172.21.15.49:0/2213761262 conn(0x7ff96c062cb0 msgr2=0x7ff96c0c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:02.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.414+0000 7ff973a00700 1 -- 172.21.15.49:0/2213761262 shutdown_connections 2024-01-22T05:10:02.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.414+0000 7ff973a00700 1 -- 172.21.15.49:0/2213761262 wait complete. 2024-01-22T05:10:02.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.414+0000 7ff973a00700 1 Processor -- start 2024-01-22T05:10:02.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.414+0000 7ff973a00700 1 -- start start 2024-01-22T05:10:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff973a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff96c0a8c20 0x7ff96c0a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff973a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0bcbe0 0x7ff96c16c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff973a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c0c1ce0 0x7ff96c0c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff973a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0be850 con 0x7ff96c0a8c20 2024-01-22T05:10:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff973a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0be3c0 con 0x7ff96c0c1ce0 2024-01-22T05:10:02.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff973a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c16ca10 con 0x7ff96c0bcbe0 2024-01-22T05:10:02.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff971000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff96c0a8c20 0x7ff96c0a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:02.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff971000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff96c0a8c20 0x7ff96c0a7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54556/0 (socket says 172.21.15.49:54556) 2024-01-22T05:10:02.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff971000700 1 -- 172.21.15.49:0/3982097811 learned_addr learned my addr 172.21.15.49:0/3982097811 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:10:02.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff96be00700 1 --2- 172.21.15.49:0/3982097811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0bcbe0 0x7ff96c16c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:02.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff971a00700 1 --2- 172.21.15.49:0/3982097811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c0c1ce0 0x7ff96c0c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:02.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff971000700 1 -- 172.21.15.49:0/3982097811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0bcbe0 msgr2=0x7ff96c16c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:02.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff971000700 1 --2- 172.21.15.49:0/3982097811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0bcbe0 0x7ff96c16c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff971000700 1 -- 172.21.15.49:0/3982097811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c0c1ce0 msgr2=0x7ff96c0c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:02.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff971000700 1 --2- 172.21.15.49:0/3982097811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c0c1ce0 0x7ff96c0c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff971000700 1 -- 172.21.15.49:0/3982097811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff964009a20 con 0x7ff96c0a8c20 2024-01-22T05:10:02.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff971000700 1 --2- 172.21.15.49:0/3982097811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff96c0a8c20 0x7ff96c0a7fc0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7ff95c00c7c0 tx=0x7ff95c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:02.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff963e00700 1 -- 172.21.15.49:0/3982097811 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c007320 con 0x7ff96c0a8c20 2024-01-22T05:10:02.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff963e00700 1 -- 172.21.15.49:0/3982097811 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c007480 con 0x7ff96c0a8c20 2024-01-22T05:10:02.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff973a00700 1 -- 172.21.15.49:0/3982097811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c0bd7b0 con 0x7ff96c0a8c20 2024-01-22T05:10:02.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff963e00700 1 -- 172.21.15.49:0/3982097811 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0059b0 con 0x7ff96c0a8c20 2024-01-22T05:10:02.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.418+0000 7ff973a00700 1 -- 172.21.15.49:0/3982097811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c0bdd70 con 0x7ff96c0a8c20 2024-01-22T05:10:02.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.422+0000 7ff973a00700 1 -- 172.21.15.49:0/3982097811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c0c0c00 con 0x7ff96c0a8c20 2024-01-22T05:10:02.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.422+0000 7ff963e00700 1 -- 172.21.15.49:0/3982097811 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff95c005d20 con 0x7ff96c0a8c20 2024-01-22T05:10:02.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.422+0000 7ff963e00700 1 --2- 172.21.15.49:0/3982097811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff94405a540 0x7ff94405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:02.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.422+0000 7ff963e00700 1 -- 172.21.15.49:0/3982097811 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff95c0745b0 con 0x7ff96c0a8c20 2024-01-22T05:10:02.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.422+0000 7ff96be00700 1 --2- 172.21.15.49:0/3982097811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff94405a540 0x7ff94405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:02.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.426+0000 7ff96be00700 1 --2- 172.21.15.49:0/3982097811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff94405a540 0x7ff94405ca00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7ff96c1566c0 tx=0x7ff954009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:02.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.430+0000 7ff963e00700 1 -- 172.21.15.49:0/3982097811 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff95c047c30 con 0x7ff96c0a8c20 2024-01-22T05:10:02.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.650+0000 7ff973a00700 1 -- 172.21.15.49:0/3982097811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff96c158650 con 0x7ff96c0a8c20 2024-01-22T05:10:02.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.658+0000 7ff963e00700 1 -- 172.21.15.49:0/3982097811 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff96c158650 con 0x7ff96c0a8c20 2024-01-22T05:10:02.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.662+0000 7ff973a00700 1 -- 172.21.15.49:0/3982097811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff94405a540 msgr2=0x7ff94405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:02.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.662+0000 7ff973a00700 1 --2- 172.21.15.49:0/3982097811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff94405a540 0x7ff94405ca00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7ff96c1566c0 tx=0x7ff954009040).stop 2024-01-22T05:10:02.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.662+0000 7ff973a00700 1 -- 172.21.15.49:0/3982097811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff96c0a8c20 msgr2=0x7ff96c0a7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:02.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.662+0000 7ff973a00700 1 --2- 172.21.15.49:0/3982097811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff96c0a8c20 0x7ff96c0a7fc0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7ff95c00c7c0 tx=0x7ff95c007c80).stop 2024-01-22T05:10:02.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.662+0000 7ff973a00700 1 -- 172.21.15.49:0/3982097811 shutdown_connections 2024-01-22T05:10:02.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.662+0000 7ff973a00700 1 --2- 172.21.15.49:0/3982097811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff94405a540 0x7ff94405ca00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.662+0000 7ff973a00700 1 --2- 172.21.15.49:0/3982097811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c0c1ce0 0x7ff96c0c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.662+0000 7ff973a00700 1 --2- 172.21.15.49:0/3982097811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff96c0bcbe0 0x7ff96c16c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.662+0000 7ff973a00700 1 --2- 172.21.15.49:0/3982097811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff96c0a8c20 0x7ff96c0a7fc0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.662+0000 7ff973a00700 1 -- 172.21.15.49:0/3982097811 >> 172.21.15.49:0/3982097811 conn(0x7ff96c062cb0 msgr2=0x7ff96c157940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:02.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.662+0000 7ff973a00700 1 -- 172.21.15.49:0/3982097811 shutdown_connections 2024-01-22T05:10:02.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.662+0000 7ff973a00700 1 -- 172.21.15.49:0/3982097811 wait complete. 2024-01-22T05:10:02.669 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-01-22T05:10:02.686 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:10:02.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.850+0000 7f0ab6a00700 1 Processor -- start 2024-01-22T05:10:02.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.850+0000 7f0ab6a00700 1 -- start start 2024-01-22T05:10:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.854+0000 7f0ab6a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ab00be6a0 0x7f0ab00c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.854+0000 7f0ab6a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ab0064690 0x7f0ab0064af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.854+0000 7f0ab6a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab00be210 con 0x7f0ab0151370 2024-01-22T05:10:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.854+0000 7f0ab6a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab00bd650 con 0x7f0ab00be6a0 2024-01-22T05:10:02.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.854+0000 7f0ab6a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab00bd8e0 con 0x7f0ab0064690 2024-01-22T05:10:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.854+0000 7f0aafe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ab00be6a0 0x7f0ab00c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.854+0000 7f0aafe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ab00be6a0 0x7f0ab00c2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54568/0 (socket says 172.21.15.49:54568) 2024-01-22T05:10:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.854+0000 7f0aafe00700 1 -- 172.21.15.49:0/1465760718 learned_addr learned my addr 172.21.15.49:0/1465760718 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:10:02.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.854+0000 7f0aaf400700 1 --2- 172.21.15.49:0/1465760718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ab0064690 0x7f0ab0064af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:02.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0aafe00700 1 -- 172.21.15.49:0/1465760718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ab0064690 msgr2=0x7f0ab0064af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:10:02.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0aafe00700 1 --2- 172.21.15.49:0/1465760718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ab0064690 0x7f0ab0064af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0aafe00700 1 -- 172.21.15.49:0/1465760718 >> v1:172.21.15.110:6789/0 conn(0x7f0ab0151370 legacy=0x7f0ab0151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:02.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0aaea00700 1 -- 172.21.15.49:0/1465760718 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615841600 0 0) 0x7f0ab00be210 con 0x7f0ab0151370 2024-01-22T05:10:02.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0aafe00700 1 -- 172.21.15.49:0/1465760718 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab00bdbc0 con 0x7f0ab00be6a0 2024-01-22T05:10:02.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0aafe00700 1 --2- 172.21.15.49:0/1465760718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ab00be6a0 0x7f0ab00c2cf0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f0aa0006fd0 tx=0x7f0aa00090f0).ready entity=mon.0 client_cookie=6c8175d29cb87de4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:02.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0aaea00700 1 -- 172.21.15.49:0/1465760718 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa000b580 con 0x7f0ab00be6a0 2024-01-22T05:10:02.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0aaea00700 1 -- 172.21.15.49:0/1465760718 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa000b6e0 con 0x7f0ab00be6a0 2024-01-22T05:10:02.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0aaea00700 1 -- 172.21.15.49:0/1465760718 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa000ba60 con 0x7f0ab00be6a0 2024-01-22T05:10:02.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0ab6a00700 1 -- 172.21.15.49:0/1465760718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ab00be6a0 msgr2=0x7f0ab00c2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:02.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0ab6a00700 1 --2- 172.21.15.49:0/1465760718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ab00be6a0 0x7f0ab00c2cf0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f0aa0006fd0 tx=0x7f0aa00090f0).stop 2024-01-22T05:10:02.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0ab6a00700 1 -- 172.21.15.49:0/1465760718 shutdown_connections 2024-01-22T05:10:02.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0ab6a00700 1 --2- 172.21.15.49:0/1465760718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ab0064690 0x7f0ab0064af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0ab6a00700 1 --2- 172.21.15.49:0/1465760718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ab00be6a0 0x7f0ab00c2cf0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0ab6a00700 1 -- 172.21.15.49:0/1465760718 >> 172.21.15.49:0/1465760718 conn(0x7f0ab00c87f0 msgr2=0x7f0ab00c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:02.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0ab6a00700 1 -- 172.21.15.49:0/1465760718 shutdown_connections 2024-01-22T05:10:02.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.858+0000 7f0ab6a00700 1 -- 172.21.15.49:0/1465760718 wait complete. 2024-01-22T05:10:02.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.862+0000 7f0ab6a00700 1 Processor -- start 2024-01-22T05:10:02.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.862+0000 7f0ab6a00700 1 -- start start 2024-01-22T05:10:02.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0ab6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ab0064690 0x7f0ab00ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:02.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0ab6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ab00be6a0 0x7f0ab0163be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:02.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0ab6a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ab0151370 0x7f0ab00aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:02.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0ab6a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab00c6b20 con 0x7f0ab00be6a0 2024-01-22T05:10:02.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0ab6a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab00c5f10 con 0x7f0ab0064690 2024-01-22T05:10:02.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0ab6a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab00c61f0 con 0x7f0ab0151370 2024-01-22T05:10:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0aaf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ab00be6a0 0x7f0ab0163be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0aaf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ab00be6a0 0x7f0ab0163be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54574/0 (socket says 172.21.15.49:54574) 2024-01-22T05:10:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0aaf400700 1 -- 172.21.15.49:0/3946722571 learned_addr learned my addr 172.21.15.49:0/3946722571 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:10:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0aafe00700 1 --2- 172.21.15.49:0/3946722571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ab0064690 0x7f0ab00ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0ab5400700 1 --2- 172.21.15.49:0/3946722571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ab0151370 0x7f0ab00aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0aaf400700 1 -- 172.21.15.49:0/3946722571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ab0151370 msgr2=0x7f0ab00aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0aaf400700 1 --2- 172.21.15.49:0/3946722571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ab0151370 0x7f0ab00aacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0aaf400700 1 -- 172.21.15.49:0/3946722571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ab0064690 msgr2=0x7f0ab00ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0aaf400700 1 --2- 172.21.15.49:0/3946722571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ab0064690 0x7f0ab00ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:02.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0aaf400700 1 -- 172.21.15.49:0/3946722571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa0009370 con 0x7f0ab00be6a0 2024-01-22T05:10:02.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0aaf400700 1 --2- 172.21.15.49:0/3946722571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ab00be6a0 0x7f0ab0163be0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f0a9800e930 tx=0x7f0a98009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:02.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0aa7400700 1 -- 172.21.15.49:0/3946722571 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800eed0 con 0x7f0ab00be6a0 2024-01-22T05:10:02.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0aa7400700 1 -- 172.21.15.49:0/3946722571 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a98009510 con 0x7f0ab00be6a0 2024-01-22T05:10:02.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0aa7400700 1 -- 172.21.15.49:0/3946722571 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800ca60 con 0x7f0ab00be6a0 2024-01-22T05:10:02.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0ab6a00700 1 -- 172.21.15.49:0/3946722571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab00c64d0 con 0x7f0ab00be6a0 2024-01-22T05:10:02.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.866+0000 7f0ab6a00700 1 -- 172.21.15.49:0/3946722571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab0063bd0 con 0x7f0ab00be6a0 2024-01-22T05:10:02.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.870+0000 7f0aa7400700 1 -- 172.21.15.49:0/3946722571 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0a9801b400 con 0x7f0ab00be6a0 2024-01-22T05:10:02.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.870+0000 7f0ab6a00700 1 -- 172.21.15.49:0/3946722571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab00c6c90 con 0x7f0ab00be6a0 2024-01-22T05:10:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.870+0000 7f0aa7400700 1 --2- 172.21.15.49:0/3946722571 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a8805a510 0x7f0a8805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.870+0000 7f0aa7400700 1 -- 172.21.15.49:0/3946722571 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f0a98074ea0 con 0x7f0ab00be6a0 2024-01-22T05:10:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.870+0000 7f0aafe00700 1 --2- 172.21.15.49:0/3946722571 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a8805a510 0x7f0a8805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.874+0000 7f0aafe00700 1 --2- 172.21.15.49:0/3946722571 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a8805a510 0x7f0a8805c9d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f0aa0009130 tx=0x7f0aa0017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:02.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:02.878+0000 7f0aa7400700 1 -- 172.21.15.49:0/3946722571 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0a98048400 con 0x7f0ab00be6a0 2024-01-22T05:10:03.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.070+0000 7f0ab6a00700 1 -- 172.21.15.49:0/3946722571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ab0047060 con 0x7f0ab00be6a0 2024-01-22T05:10:03.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.070+0000 7f0aa7400700 1 -- 172.21.15.49:0/3946722571 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f0a9804ba20 con 0x7f0ab00be6a0 2024-01-22T05:10:03.076 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:10:03.076 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":70,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6080,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/948258971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":948258971},{"type":"v1","addr":"172.21.15.110:6835","nonce":948258971}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6828,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/304005498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":304005498},{"type":"v1","addr":"172.21.15.49:6835","nonce":304005498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6843,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1613189666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1613189666},{"type":"v1","addr":"172.21.15.49:6837","nonce":1613189666}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:09:52.708060+0000","modified":"2024-01-22T05:09:55.726778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6846},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6846":{"gid":6846,"name":"b","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6834/1072346524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1072346524},{"type":"v1","addr":"172.21.15.110:6834","nonce":1072346524}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2024-01-22T05:10:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.074+0000 7f0ab6a00700 1 -- 172.21.15.49:0/3946722571 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a8805a510 msgr2=0x7f0a8805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.074+0000 7f0ab6a00700 1 --2- 172.21.15.49:0/3946722571 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a8805a510 0x7f0a8805c9d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f0aa0009130 tx=0x7f0aa0017000).stop 2024-01-22T05:10:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.074+0000 7f0ab6a00700 1 -- 172.21.15.49:0/3946722571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ab00be6a0 msgr2=0x7f0ab0163be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.074+0000 7f0ab6a00700 1 --2- 172.21.15.49:0/3946722571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ab00be6a0 0x7f0ab0163be0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f0a9800e930 tx=0x7f0a98009060).stop 2024-01-22T05:10:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.074+0000 7f0ab6a00700 1 -- 172.21.15.49:0/3946722571 shutdown_connections 2024-01-22T05:10:03.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.074+0000 7f0ab6a00700 1 --2- 172.21.15.49:0/3946722571 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a8805a510 0x7f0a8805c9d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.074+0000 7f0ab6a00700 1 --2- 172.21.15.49:0/3946722571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ab0151370 0x7f0ab00aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.074+0000 7f0ab6a00700 1 --2- 172.21.15.49:0/3946722571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ab00be6a0 0x7f0ab0163be0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.074+0000 7f0ab6a00700 1 --2- 172.21.15.49:0/3946722571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ab0064690 0x7f0ab00ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.074+0000 7f0ab6a00700 1 -- 172.21.15.49:0/3946722571 >> 172.21.15.49:0/3946722571 conn(0x7f0ab00c87f0 msgr2=0x7f0ab0067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:03.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.074+0000 7f0ab6a00700 1 -- 172.21.15.49:0/3946722571 shutdown_connections 2024-01-22T05:10:03.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.074+0000 7f0ab6a00700 1 -- 172.21.15.49:0/3946722571 wait complete. 2024-01-22T05:10:03.084 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 70 2024-01-22T05:10:03.507 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:09:52.708060+0000', 'modified': '2024-01-22T05:09:55.726778+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6846}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6846': {'gid': 6846, 'name': 'b', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.110:6834/1072346524', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6832', 'nonce': 1072346524}, {'type': 'v1', 'addr': '172.21.15.110:6834', 'nonce': 1072346524}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:10:03.507 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:10:03.507 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-22T05:10:03.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.682+0000 7fa07f000700 1 Processor -- start 2024-01-22T05:10:03.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.682+0000 7fa07f000700 1 -- start start 2024-01-22T05:10:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.686+0000 7fa07f000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa078066fb0 0x7fa0780c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.686+0000 7fa07f000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0780c1ee0 con 0x7fa0780a8b10 2024-01-22T05:10:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.686+0000 7fa07f000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0780c12f0 con 0x7fa0780a8f90 2024-01-22T05:10:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.686+0000 7fa07f000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0780c15b0 con 0x7fa078066fb0 2024-01-22T05:10:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.686+0000 7fa077400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa0780a8b10 0x7fa078157740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50910/0 (socket says 172.21.15.49:50910) 2024-01-22T05:10:03.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.686+0000 7fa077400700 1 -- 172.21.15.49:0/3512016132 learned_addr learned my addr 172.21.15.49:0/3512016132 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:10:03.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.686+0000 7fa077e00700 1 --2- 172.21.15.49:0/3512016132 >> v2:172.21.15.110:3300/0 conn(0x7fa078066fb0 0x7fa0780c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa076a00700 1 -- 172.21.15.49:0/3512016132 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432864380 0 0) 0x7fa0780c1ee0 con 0x7fa0780a8b10 2024-01-22T05:10:03.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa076a00700 1 -- 172.21.15.49:0/3512016132 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0580033f0 con 0x7fa0780a8b10 2024-01-22T05:10:03.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa077e00700 1 -- 172.21.15.49:0/3512016132 >> v1:172.21.15.110:6789/0 conn(0x7fa0780a8f90 legacy=0x7fa078065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa077e00700 1 -- 172.21.15.49:0/3512016132 >> v1:172.21.15.49:6789/0 conn(0x7fa0780a8b10 legacy=0x7fa078157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa077e00700 1 -- 172.21.15.49:0/3512016132 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780c1890 con 0x7fa078066fb0 2024-01-22T05:10:03.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa077e00700 1 --2- 172.21.15.49:0/3512016132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078066fb0 0x7fa0780c2370 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fa068009760 tx=0x7fa068009060).ready entity=mon.1 client_cookie=9b7f552b9b668dc4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:03.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa076a00700 1 -- 172.21.15.49:0/3512016132 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800f510 con 0x7fa078066fb0 2024-01-22T05:10:03.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa076a00700 1 -- 172.21.15.49:0/3512016132 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06800f670 con 0x7fa078066fb0 2024-01-22T05:10:03.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa076a00700 1 -- 172.21.15.49:0/3512016132 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800f9f0 con 0x7fa078066fb0 2024-01-22T05:10:03.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa07f000700 1 -- 172.21.15.49:0/3512016132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078066fb0 msgr2=0x7fa0780c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa07f000700 1 --2- 172.21.15.49:0/3512016132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078066fb0 0x7fa0780c2370 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fa068009760 tx=0x7fa068009060).stop 2024-01-22T05:10:03.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa07f000700 1 -- 172.21.15.49:0/3512016132 shutdown_connections 2024-01-22T05:10:03.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa07f000700 1 --2- 172.21.15.49:0/3512016132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078066fb0 0x7fa0780c2370 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa07f000700 1 -- 172.21.15.49:0/3512016132 >> 172.21.15.49:0/3512016132 conn(0x7fa0780c6540 msgr2=0x7fa0780c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:03.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa07f000700 1 -- 172.21.15.49:0/3512016132 shutdown_connections 2024-01-22T05:10:03.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.690+0000 7fa07f000700 1 -- 172.21.15.49:0/3512016132 wait complete. 2024-01-22T05:10:03.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.694+0000 7fa07f000700 1 Processor -- start 2024-01-22T05:10:03.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.694+0000 7fa07f000700 1 -- start start 2024-01-22T05:10:03.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa07f000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078066fb0 0x7fa0781483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa07f000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0780a8b10 0x7fa0781505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa07f000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0780a8f90 0x7fa078150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa07f000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa078150150 con 0x7fa0780a8f90 2024-01-22T05:10:03.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa07f000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07814f540 con 0x7fa078066fb0 2024-01-22T05:10:03.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa07f000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07814f820 con 0x7fa0780a8b10 2024-01-22T05:10:03.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa07d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0780a8f90 0x7fa078150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa07d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0780a8f90 0x7fa078150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41092/0 (socket says 172.21.15.49:41092) 2024-01-22T05:10:03.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa07d000700 1 -- 172.21.15.49:0/3634974956 learned_addr learned my addr 172.21.15.49:0/3634974956 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:10:03.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa077e00700 1 --2- 172.21.15.49:0/3634974956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078066fb0 0x7fa0781483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa077400700 1 --2- 172.21.15.49:0/3634974956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0780a8b10 0x7fa0781505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa077e00700 1 -- 172.21.15.49:0/3634974956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0780a8b10 msgr2=0x7fa0781505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa077e00700 1 --2- 172.21.15.49:0/3634974956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0780a8b10 0x7fa0781505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa077e00700 1 -- 172.21.15.49:0/3634974956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0780a8f90 msgr2=0x7fa078150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa077e00700 1 --2- 172.21.15.49:0/3634974956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0780a8f90 0x7fa078150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa077e00700 1 -- 172.21.15.49:0/3634974956 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0680092a0 con 0x7fa078066fb0 2024-01-22T05:10:03.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa07d000700 1 --2- 172.21.15.49:0/3634974956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0780a8f90 0x7fa078150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:10:03.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa077e00700 1 --2- 172.21.15.49:0/3634974956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078066fb0 0x7fa0781483f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fa068014000 tx=0x7fa068017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:03.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa06f400700 1 -- 172.21.15.49:0/3634974956 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800f7e0 con 0x7fa078066fb0 2024-01-22T05:10:03.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa06f400700 1 -- 172.21.15.49:0/3634974956 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06800f940 con 0x7fa078066fb0 2024-01-22T05:10:03.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa07f000700 1 -- 172.21.15.49:0/3634974956 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07814fb00 con 0x7fa078066fb0 2024-01-22T05:10:03.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa06f400700 1 -- 172.21.15.49:0/3634974956 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06801b660 con 0x7fa078066fb0 2024-01-22T05:10:03.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.698+0000 7fa07f000700 1 -- 172.21.15.49:0/3634974956 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0780be440 con 0x7fa078066fb0 2024-01-22T05:10:03.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.706+0000 7fa06f400700 1 -- 172.21.15.49:0/3634974956 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa06801b9d0 con 0x7fa078066fb0 2024-01-22T05:10:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.706+0000 7fa06f400700 1 --2- 172.21.15.49:0/3634974956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa05005a4e0 0x7fa05005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.706+0000 7fa06f400700 1 -- 172.21.15.49:0/3634974956 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa068076310 con 0x7fa078066fb0 2024-01-22T05:10:03.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.706+0000 7fa077400700 1 --2- 172.21.15.49:0/3634974956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa05005a4e0 0x7fa05005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.706+0000 7fa077400700 1 --2- 172.21.15.49:0/3634974956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa05005a4e0 0x7fa05005c9a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fa078067570 tx=0x7fa060009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:03.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa089521740 1 Processor -- start 2024-01-22T05:10:03.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa089521740 1 -- start start 2024-01-22T05:10:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa089521740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f23a0 0x11d6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa089521740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11b1e40 0x11adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa089521740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11f2780 0x11ab3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa089521740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1131410 con 0x11b1e40 2024-01-22T05:10:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa089521740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1131550 con 0x11f23a0 2024-01-22T05:10:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa089521740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1131a00 con 0x11f2780 2024-01-22T05:10:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa07d000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11f2780 0x11ab3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa077e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f23a0 0x11d6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa07d000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11f2780 0x11ab3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:39454/0 (socket says 172.21.15.49:39454) 2024-01-22T05:10:03.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa07d000700 1 -- 172.21.15.49:0/1720292703 learned_addr learned my addr 172.21.15.49:0/1720292703 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:10:03.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa077400700 1 --2- 172.21.15.49:0/1720292703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11b1e40 0x11adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa077e00700 1 -- 172.21.15.49:0/1720292703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11f2780 msgr2=0x11ab3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:10:03.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa077e00700 1 --2- 172.21.15.49:0/1720292703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11f2780 0x11ab3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.710+0000 7fa077e00700 1 -- 172.21.15.49:0/1720292703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11b1e40 msgr2=0x11adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:10:03.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa077e00700 1 --2- 172.21.15.49:0/1720292703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11b1e40 0x11adaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa077e00700 1 -- 172.21.15.49:0/1720292703 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x112a730 con 0x11f23a0 2024-01-22T05:10:03.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa077e00700 1 --2- 172.21.15.49:0/1720292703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f23a0 0x11d6d10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fa068074630 tx=0x7fa06800e000).ready entity=mon.1 client_cookie=dcc8907373e84ed8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:03.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa067e00700 1 -- 172.21.15.49:0/1720292703 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06804d0d0 con 0x11f23a0 2024-01-22T05:10:03.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa067e00700 1 -- 172.21.15.49:0/1720292703 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06804cef0 con 0x11f23a0 2024-01-22T05:10:03.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa067e00700 1 -- 172.21.15.49:0/1720292703 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680760d0 con 0x11f23a0 2024-01-22T05:10:03.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa089521740 1 -- 172.21.15.49:0/1720292703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f23a0 msgr2=0x11d6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa089521740 1 --2- 172.21.15.49:0/1720292703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f23a0 0x11d6d10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fa068074630 tx=0x7fa06800e000).stop 2024-01-22T05:10:03.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa089521740 1 -- 172.21.15.49:0/1720292703 shutdown_connections 2024-01-22T05:10:03.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa089521740 1 --2- 172.21.15.49:0/1720292703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11f2780 0x11ab3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa089521740 1 --2- 172.21.15.49:0/1720292703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11b1e40 0x11adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa089521740 1 --2- 172.21.15.49:0/1720292703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f23a0 0x11d6d10 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa089521740 1 -- 172.21.15.49:0/1720292703 >> 172.21.15.49:0/1720292703 conn(0xf8f550 msgr2=0x11b1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa089521740 1 -- 172.21.15.49:0/1720292703 shutdown_connections 2024-01-22T05:10:03.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa089521740 1 -- 172.21.15.49:0/1720292703 wait complete. 2024-01-22T05:10:03.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.714+0000 7fa089521740 1 -- start start 2024-01-22T05:10:03.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.718+0000 7fa089521740 1 Processor -- start 2024-01-22T05:10:03.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.718+0000 7fa089521740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11b1e40 0x11d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.718+0000 7fa089521740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f23a0 0x11dcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.718+0000 7fa089521740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f2780 0x11d5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.718+0000 7fa089521740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x10fc650 con 0x11f2780 2024-01-22T05:10:03.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.718+0000 7fa089521740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x11d30a0 con 0x11f23a0 2024-01-22T05:10:03.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.718+0000 7fa089521740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x11dd730 con 0x11b1e40 2024-01-22T05:10:03.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.718+0000 7fa089521740 10 client.0 ll_register_callbacks cb 0x1169020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:10:03.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.718+0000 7fa07d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f2780 0x11d5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.718+0000 7fa077400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f23a0 0x11dcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.718+0000 7fa07d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f2780 0x11d5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41100/0 (socket says 172.21.15.49:41100) 2024-01-22T05:10:03.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.718+0000 7fa07d000700 1 -- 172.21.15.49:0/3695862072 learned_addr learned my addr 172.21.15.49:0/3695862072 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:10:03.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.718+0000 7fa077e00700 1 --2- 172.21.15.49:0/3695862072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11b1e40 0x11d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa07d000700 1 -- 172.21.15.49:0/3695862072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11b1e40 msgr2=0x11d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:10:03.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa07d000700 1 --2- 172.21.15.49:0/3695862072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11b1e40 0x11d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa07d000700 1 -- 172.21.15.49:0/3695862072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f23a0 msgr2=0x11dcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:10:03.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa07d000700 1 --2- 172.21.15.49:0/3695862072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f23a0 0x11dcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa07d000700 1 -- 172.21.15.49:0/3695862072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0780be440 con 0x11f2780 2024-01-22T05:10:03.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa07d000700 1 --2- 172.21.15.49:0/3695862072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f2780 0x11d5ed0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7fa070012a60 tx=0x7fa070009040).ready entity=mon.0 client_cookie=db53614310e2d7e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa064c00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:10:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa064c00700 1 -- 172.21.15.49:0/3695862072 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070012ea0 con 0x11f2780 2024-01-22T05:10:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa064c00700 1 -- 172.21.15.49:0/3695862072 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa070010940 con 0x11f2780 2024-01-22T05:10:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa089521740 1 -- 172.21.15.49:0/3695862072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x11271a0 con 0x11f2780 2024-01-22T05:10:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa064c00700 1 -- 172.21.15.49:0/3695862072 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa070010d10 con 0x11f2780 2024-01-22T05:10:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa089521740 10 client.7011 fetch_fsmap learned FSMap version 70 2024-01-22T05:10:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa089521740 1 -- 172.21.15.49:0/3695862072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x1125960 con 0x11f2780 2024-01-22T05:10:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa064c00700 1 -- 172.21.15.49:0/3695862072 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x11271a0 con 0x11f2780 2024-01-22T05:10:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa064c00700 1 -- 172.21.15.49:0/3695862072 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 70) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa07001c2f0 con 0x11f2780 2024-01-22T05:10:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa089521740 10 client.7011 fetch_fsmap finished waiting for FSMap version 70 2024-01-22T05:10:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa089521740 10 client.7011 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-22T05:10:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa089521740 20 client.7011 populate_metadata read hostname 'smithi049' 2024-01-22T05:10:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa089521740 1 --2- 172.21.15.49:0/3695862072 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x11d2660 0x11aa170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa089521740 4 client.7011 mds_command: new command op to 6846 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:10:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa089521740 1 -- 172.21.15.49:0/3695862072 --> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x111d6f0 con 0x11d2660 2024-01-22T05:10:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa077e00700 1 --2- 172.21.15.49:0/3695862072 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x11d2660 0x11aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa077e00700 1 --2- 172.21.15.49:0/3695862072 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x11d2660 0x11aa170 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=69a4b4f152355545 server_cookie=c6e31b3cb499317c in_seq=0 out_seq=0 2024-01-22T05:10:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.722+0000 7fa064c00700 10 client.7011 ms_handle_connect on v2:172.21.15.110:6832/1072346524 2024-01-22T05:10:03.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.726+0000 7fa064c00700 1 -- 172.21.15.49:0/3695862072 <== mds.0 v2:172.21.15.110:6832/1072346524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x111d6f0 con 0x11d2660 2024-01-22T05:10:03.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.726+0000 7fa064c00700 10 client.7011 handle_command_reply: tid=0 2024-01-22T05:10:03.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.726+0000 7fa089521740 1 client.7011 shutdown 2024-01-22T05:10:03.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.726+0000 7fa089521740 1 -- 172.21.15.49:0/3695862072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f2780 msgr2=0x11d5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.726+0000 7fa089521740 1 --2- 172.21.15.49:0/3695862072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f2780 0x11d5ed0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7fa070012a60 tx=0x7fa070009040).stop 2024-01-22T05:10:03.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.726+0000 7fa089521740 1 -- 172.21.15.49:0/3695862072 shutdown_connections 2024-01-22T05:10:03.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.726+0000 7fa089521740 1 --2- 172.21.15.49:0/3695862072 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x11d2660 0x11aa170 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.726+0000 7fa089521740 1 --2- 172.21.15.49:0/3695862072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f2780 0x11d5ed0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.726+0000 7fa089521740 1 --2- 172.21.15.49:0/3695862072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f23a0 0x11dcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.726+0000 7fa064c00700 0 client.7011 ms_handle_reset on v2:172.21.15.110:6832/1072346524 2024-01-22T05:10:03.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.726+0000 7fa089521740 1 --2- 172.21.15.49:0/3695862072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11b1e40 0x11d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.726+0000 7fa089521740 1 -- 172.21.15.49:0/3695862072 >> 172.21.15.49:0/3695862072 conn(0xf8f550 msgr2=0x11f8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:03.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.726+0000 7fa089521740 1 -- 172.21.15.49:0/3695862072 shutdown_connections 2024-01-22T05:10:03.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.726+0000 7fa089521740 1 -- 172.21.15.49:0/3695862072 wait complete. 2024-01-22T05:10:03.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.730+0000 7fa089521740 20 client.7011 trim_cache size 0 max 16384 2024-01-22T05:10:03.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.750+0000 7fa089521740 1 Processor -- start 2024-01-22T05:10:03.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.750+0000 7fa089521740 1 -- start start 2024-01-22T05:10:03.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.750+0000 7fa089521740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11b1e40 0x11d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.750+0000 7fa089521740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f23a0 0x11b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.750+0000 7fa089521740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11f2780 0x11b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.750+0000 7fa089521740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x11ade60 con 0x11f23a0 2024-01-22T05:10:03.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.750+0000 7fa089521740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1204470 con 0x11b1e40 2024-01-22T05:10:03.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.750+0000 7fa089521740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x11d52e0 con 0x11f2780 2024-01-22T05:10:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa077400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f23a0 0x11b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa077400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f23a0 0x11b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41114/0 (socket says 172.21.15.49:41114) 2024-01-22T05:10:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa077400700 1 -- 172.21.15.49:0/3606788567 learned_addr learned my addr 172.21.15.49:0/3606788567 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:10:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa07d000700 1 --2- 172.21.15.49:0/3606788567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11f2780 0x11b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa077e00700 1 --2- 172.21.15.49:0/3606788567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11b1e40 0x11d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa077400700 1 -- 172.21.15.49:0/3606788567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11f2780 msgr2=0x11b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:10:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa077400700 1 --2- 172.21.15.49:0/3606788567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11f2780 0x11b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa077400700 1 -- 172.21.15.49:0/3606788567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11b1e40 msgr2=0x11d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:10:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa077400700 1 --2- 172.21.15.49:0/3606788567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11b1e40 0x11d09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa077400700 1 -- 172.21.15.49:0/3606788567 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780c4fa0 con 0x11f23a0 2024-01-22T05:10:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa077400700 1 --2- 172.21.15.49:0/3606788567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f23a0 0x11b0840 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7fa078151890 tx=0x7fa060013000).ready entity=mon.0 client_cookie=c59762a2153ec3ff server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:03.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa06cc00700 1 -- 172.21.15.49:0/3606788567 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06000f6f0 con 0x11f23a0 2024-01-22T05:10:03.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa06cc00700 1 -- 172.21.15.49:0/3606788567 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa060022440 con 0x11f23a0 2024-01-22T05:10:03.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa06cc00700 1 -- 172.21.15.49:0/3606788567 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600227c0 con 0x11f23a0 2024-01-22T05:10:03.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa089521740 1 -- 172.21.15.49:0/3606788567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f23a0 msgr2=0x11b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa089521740 1 --2- 172.21.15.49:0/3606788567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f23a0 0x11b0840 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7fa078151890 tx=0x7fa060013000).stop 2024-01-22T05:10:03.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa089521740 1 -- 172.21.15.49:0/3606788567 shutdown_connections 2024-01-22T05:10:03.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa089521740 1 --2- 172.21.15.49:0/3606788567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11f2780 0x11b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa089521740 1 --2- 172.21.15.49:0/3606788567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f23a0 0x11b0840 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa089521740 1 --2- 172.21.15.49:0/3606788567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11b1e40 0x11d09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.754+0000 7fa089521740 1 -- 172.21.15.49:0/3606788567 >> 172.21.15.49:0/3606788567 conn(0xf8f550 msgr2=0x11d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:03.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.758+0000 7fa089521740 1 -- 172.21.15.49:0/3606788567 shutdown_connections 2024-01-22T05:10:03.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.758+0000 7fa089521740 1 -- 172.21.15.49:0/3606788567 wait complete. 2024-01-22T05:10:03.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.758+0000 7fa089521740 1 -- start start 2024-01-22T05:10:03.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.758+0000 7fa089521740 1 Processor -- start 2024-01-22T05:10:03.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11b1e40 0x124dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f23a0 0x11b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f2780 0x11b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x11b1220 con 0x11f23a0 2024-01-22T05:10:03.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x11af110 con 0x11f2780 2024-01-22T05:10:03.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x11ce8c0 con 0x11b1e40 2024-01-22T05:10:03.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 10 client.0 ll_register_callbacks cb 0x7fa070012660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:10:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa077400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f23a0 0x11b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa077400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f23a0 0x11b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41128/0 (socket says 172.21.15.49:41128) 2024-01-22T05:10:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa077400700 1 -- 172.21.15.49:0/2555791848 learned_addr learned my addr 172.21.15.49:0/2555791848 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:10:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa07d000700 1 --2- 172.21.15.49:0/2555791848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f2780 0x11b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa077e00700 1 --2- 172.21.15.49:0/2555791848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11b1e40 0x124dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa077400700 1 -- 172.21.15.49:0/2555791848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11b1e40 msgr2=0x124dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:10:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa077400700 1 --2- 172.21.15.49:0/2555791848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11b1e40 0x124dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa077400700 1 -- 172.21.15.49:0/2555791848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f2780 msgr2=0x11b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:10:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa077400700 1 --2- 172.21.15.49:0/2555791848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f2780 0x11b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa077400700 1 -- 172.21.15.49:0/2555791848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0580033f0 con 0x11f23a0 2024-01-22T05:10:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa07d000700 1 --2- 172.21.15.49:0/2555791848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f2780 0x11b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:10:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa077e00700 1 --2- 172.21.15.49:0/2555791848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11b1e40 0x124dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:10:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa077400700 1 --2- 172.21.15.49:0/2555791848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f23a0 0x11b0840 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x11d6c10 tx=0x7fa060016030).ready entity=mon.0 client_cookie=7e32073a942b11bf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:03.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa064c00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:10:03.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa064c00700 1 -- 172.21.15.49:0/2555791848 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa060022e90 con 0x11f23a0 2024-01-22T05:10:03.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 1 -- 172.21.15.49:0/2555791848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa06804cef0 con 0x11f23a0 2024-01-22T05:10:03.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa064c00700 1 -- 172.21.15.49:0/2555791848 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa060005240 con 0x11f23a0 2024-01-22T05:10:03.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa064c00700 1 -- 172.21.15.49:0/2555791848 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0600046b0 con 0x11f23a0 2024-01-22T05:10:03.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 10 client.7017 fetch_fsmap learned FSMap version 70 2024-01-22T05:10:03.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 1 -- 172.21.15.49:0/2555791848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x11256b0 con 0x11f23a0 2024-01-22T05:10:03.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa064c00700 1 -- 172.21.15.49:0/2555791848 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06804cef0 con 0x11f23a0 2024-01-22T05:10:03.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa064c00700 1 -- 172.21.15.49:0/2555791848 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 70) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa060029030 con 0x11f23a0 2024-01-22T05:10:03.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 10 client.7017 fetch_fsmap finished waiting for FSMap version 70 2024-01-22T05:10:03.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 10 client.7017 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-22T05:10:03.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 20 client.7017 populate_metadata read hostname 'smithi049' 2024-01-22T05:10:03.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 1 --2- 172.21.15.49:0/2555791848 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x11d43c0 0x11d47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 4 client.7017 mds_command: new command op to 6846 tid=0[{"prefix": "status"}] 2024-01-22T05:10:03.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.762+0000 7fa089521740 1 -- 172.21.15.49:0/2555791848 --> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] -- command(tid 0: {"prefix": "status"}) v1 -- 0xfe64e0 con 0x11d43c0 2024-01-22T05:10:03.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa077e00700 1 --2- 172.21.15.49:0/2555791848 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x11d43c0 0x11d47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa064c00700 10 client.7017 ms_handle_connect on v2:172.21.15.110:6832/1072346524 2024-01-22T05:10:03.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa077e00700 1 --2- 172.21.15.49:0/2555791848 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x11d43c0 0x11d47a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c19b6914fdb57627 server_cookie=ceec5634c0712d6a in_seq=0 out_seq=0 2024-01-22T05:10:03.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa064c00700 1 -- 172.21.15.49:0/2555791848 <== mds.0 v2:172.21.15.110:6832/1072346524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0xfe64e0 con 0x11d43c0 2024-01-22T05:10:03.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa064c00700 10 client.7017 handle_command_reply: tid=0 2024-01-22T05:10:03.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa089521740 1 client.7017 shutdown 2024-01-22T05:10:03.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa089521740 1 -- 172.21.15.49:0/2555791848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f23a0 msgr2=0x11b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa089521740 1 --2- 172.21.15.49:0/2555791848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f23a0 0x11b0840 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x11d6c10 tx=0x7fa060016030).stop 2024-01-22T05:10:03.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa089521740 1 -- 172.21.15.49:0/2555791848 shutdown_connections 2024-01-22T05:10:03.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa089521740 1 --2- 172.21.15.49:0/2555791848 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x11d43c0 0x11d47a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa089521740 1 --2- 172.21.15.49:0/2555791848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11f2780 0x11b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa064c00700 0 client.7017 ms_handle_reset on v2:172.21.15.110:6832/1072346524 2024-01-22T05:10:03.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa089521740 1 --2- 172.21.15.49:0/2555791848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11f23a0 0x11b0840 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa089521740 1 --2- 172.21.15.49:0/2555791848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11b1e40 0x124dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa089521740 1 -- 172.21.15.49:0/2555791848 >> 172.21.15.49:0/2555791848 conn(0xf8f550 msgr2=0x12020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:03.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa089521740 1 -- 172.21.15.49:0/2555791848 shutdown_connections 2024-01-22T05:10:03.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa089521740 1 -- 172.21.15.49:0/2555791848 wait complete. 2024-01-22T05:10:03.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.766+0000 7fa089521740 20 client.7017 trim_cache size 0 max 16384 2024-01-22T05:10:03.773 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:10:03.773 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:10:03.773 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:10:03.773 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6846, 2024-01-22T05:10:03.773 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:10:03.773 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:10:03.773 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:10:03.773 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 11.056846223000001, 2024-01-22T05:10:03.774 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 70, 2024-01-22T05:10:03.774 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 88, 2024-01-22T05:10:03.774 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 88, 2024-01-22T05:10:03.774 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 16.442716763 2024-01-22T05:10:03.774 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:10:03.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.770+0000 7fa07f000700 1 -- 172.21.15.49:0/3634974956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa05005a4e0 msgr2=0x7fa05005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.770+0000 7fa07f000700 1 --2- 172.21.15.49:0/3634974956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa05005a4e0 0x7fa05005c9a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fa078067570 tx=0x7fa060009040).stop 2024-01-22T05:10:03.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.770+0000 7fa07f000700 1 -- 172.21.15.49:0/3634974956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078066fb0 msgr2=0x7fa0781483f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.770+0000 7fa07f000700 1 --2- 172.21.15.49:0/3634974956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078066fb0 0x7fa0781483f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fa068014000 tx=0x7fa068017000).stop 2024-01-22T05:10:03.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.770+0000 7fa07f000700 1 -- 172.21.15.49:0/3634974956 shutdown_connections 2024-01-22T05:10:03.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.770+0000 7fa07f000700 1 --2- 172.21.15.49:0/3634974956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa05005a4e0 0x7fa05005c9a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.770+0000 7fa07f000700 1 --2- 172.21.15.49:0/3634974956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0780a8f90 0x7fa078150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.770+0000 7fa07f000700 1 --2- 172.21.15.49:0/3634974956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0780a8b10 0x7fa0781505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.770+0000 7fa07f000700 1 --2- 172.21.15.49:0/3634974956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078066fb0 0x7fa0781483f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.770+0000 7fa07f000700 1 -- 172.21.15.49:0/3634974956 >> 172.21.15.49:0/3634974956 conn(0x7fa0780c6540 msgr2=0x7fa078152220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:03.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.770+0000 7fa07f000700 1 -- 172.21.15.49:0/3634974956 shutdown_connections 2024-01-22T05:10:03.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.770+0000 7fa07f000700 1 -- 172.21.15.49:0/3634974956 wait complete. 2024-01-22T05:10:03.795 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:10:03.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.926+0000 7fcbda400700 1 Processor -- start 2024-01-22T05:10:03.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.926+0000 7fcbda400700 1 -- start start 2024-01-22T05:10:03.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbda400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcbd40bc3d0 0x7fcbd414d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbda400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbd414db00 0x7fcbd40bc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbda400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd40bc7b0 con 0x7fcbd40bce90 2024-01-22T05:10:03.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbda400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd4062940 con 0x7fcbd40bc3d0 2024-01-22T05:10:03.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbda400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40c2170 con 0x7fcbd414db00 2024-01-22T05:10:03.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbd2a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbd414db00 0x7fcbd40bc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbd3400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcbd40bc3d0 0x7fcbd414d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbd3e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fcbd40bce90 0x7fcbd4062230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:37188/0 (socket says 172.21.15.49:37188) 2024-01-22T05:10:03.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbd3e00700 1 -- 172.21.15.49:0/3640467872 learned_addr learned my addr 172.21.15.49:0/3640467872 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:10:03.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbd2000700 1 -- 172.21.15.49:0/3640467872 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385223614 0 0) 0x7fcbcc001490 con 0x7fcbd40bce90 2024-01-22T05:10:03.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbd2000700 1 -- 172.21.15.49:0/3640467872 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbb40033f0 con 0x7fcbd40bce90 2024-01-22T05:10:03.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbd3400700 1 -- 172.21.15.49:0/3640467872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbd414db00 msgr2=0x7fcbd40bc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:10:03.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbd3400700 1 --2- 172.21.15.49:0/3640467872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbd414db00 0x7fcbd40bc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbd3400700 1 -- 172.21.15.49:0/3640467872 >> v1:172.21.15.110:6789/0 conn(0x7fcbd40bce90 legacy=0x7fcbd4062230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbd3400700 1 -- 172.21.15.49:0/3640467872 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd40c2450 con 0x7fcbd40bc3d0 2024-01-22T05:10:03.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.930+0000 7fcbd3400700 1 --2- 172.21.15.49:0/3640467872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbd40bc3d0 0x7fcbd414d610 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fcbc4009760 tx=0x7fcbc4009060).ready entity=mon.1 client_cookie=3ffe8d6e41f53262 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:03.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.934+0000 7fcbd2000700 1 -- 172.21.15.49:0/3640467872 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc400d4a0 con 0x7fcbd40bc3d0 2024-01-22T05:10:03.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.934+0000 7fcbd2000700 1 -- 172.21.15.49:0/3640467872 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc400d600 con 0x7fcbd40bc3d0 2024-01-22T05:10:03.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.934+0000 7fcbd2000700 1 -- 172.21.15.49:0/3640467872 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc400d980 con 0x7fcbd40bc3d0 2024-01-22T05:10:03.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.934+0000 7fcbda400700 1 -- 172.21.15.49:0/3640467872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbd40bc3d0 msgr2=0x7fcbd414d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.934+0000 7fcbda400700 1 --2- 172.21.15.49:0/3640467872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbd40bc3d0 0x7fcbd414d610 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fcbc4009760 tx=0x7fcbc4009060).stop 2024-01-22T05:10:03.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.934+0000 7fcbda400700 1 -- 172.21.15.49:0/3640467872 shutdown_connections 2024-01-22T05:10:03.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.934+0000 7fcbda400700 1 --2- 172.21.15.49:0/3640467872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbd414db00 0x7fcbd40bc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.934+0000 7fcbda400700 1 --2- 172.21.15.49:0/3640467872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbd40bc3d0 0x7fcbd414d610 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.934+0000 7fcbda400700 1 -- 172.21.15.49:0/3640467872 >> 172.21.15.49:0/3640467872 conn(0x7fcbd40c3950 msgr2=0x7fcbd40c3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:03.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.934+0000 7fcbda400700 1 -- 172.21.15.49:0/3640467872 shutdown_connections 2024-01-22T05:10:03.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.934+0000 7fcbda400700 1 -- 172.21.15.49:0/3640467872 wait complete. 2024-01-22T05:10:03.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.938+0000 7fcbda400700 1 Processor -- start 2024-01-22T05:10:03.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.938+0000 7fcbda400700 1 -- start start 2024-01-22T05:10:03.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbda400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbd40bc3d0 0x7fcbd40be8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbda400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbd40bce90 0x7fcbd40a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbda400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbd414db00 0x7fcbd40a63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbda400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40bffe0 con 0x7fcbd40bce90 2024-01-22T05:10:03.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbda400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40bef40 con 0x7fcbd414db00 2024-01-22T05:10:03.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbda400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40bf220 con 0x7fcbd40bc3d0 2024-01-22T05:10:03.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbd2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbd40bce90 0x7fcbd40a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbd2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbd40bce90 0x7fcbd40a9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41134/0 (socket says 172.21.15.49:41134) 2024-01-22T05:10:03.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbd2a00700 1 -- 172.21.15.49:0/207041083 learned_addr learned my addr 172.21.15.49:0/207041083 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:10:03.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbd3e00700 1 --2- 172.21.15.49:0/207041083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbd414db00 0x7fcbd40a63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbd3400700 1 --2- 172.21.15.49:0/207041083 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbd40bc3d0 0x7fcbd40be8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbd2a00700 1 -- 172.21.15.49:0/207041083 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbd40bc3d0 msgr2=0x7fcbd40be8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbd2a00700 1 --2- 172.21.15.49:0/207041083 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbd40bc3d0 0x7fcbd40be8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbd2a00700 1 -- 172.21.15.49:0/207041083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbd414db00 msgr2=0x7fcbd40a63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:03.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbd2a00700 1 --2- 172.21.15.49:0/207041083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbd414db00 0x7fcbd40a63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:03.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbd2a00700 1 -- 172.21.15.49:0/207041083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc40092a0 con 0x7fcbd40bce90 2024-01-22T05:10:03.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbd3400700 1 --2- 172.21.15.49:0/207041083 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbd40bc3d0 0x7fcbd40be8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:10:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbd2a00700 1 --2- 172.21.15.49:0/207041083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbd40bce90 0x7fcbd40a9560 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fcbbc00e900 tx=0x7fcbbc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbcaa00700 1 -- 172.21.15.49:0/207041083 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc00c640 con 0x7fcbd40bce90 2024-01-22T05:10:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbcaa00700 1 -- 172.21.15.49:0/207041083 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc00c7a0 con 0x7fcbd40bce90 2024-01-22T05:10:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbda400700 1 -- 172.21.15.49:0/207041083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd40bf500 con 0x7fcbd40bce90 2024-01-22T05:10:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbcaa00700 1 -- 172.21.15.49:0/207041083 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc00cb20 con 0x7fcbd40bce90 2024-01-22T05:10:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.942+0000 7fcbda400700 1 -- 172.21.15.49:0/207041083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd40bfac0 con 0x7fcbd40bce90 2024-01-22T05:10:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.946+0000 7fcbda400700 1 -- 172.21.15.49:0/207041083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd4067f90 con 0x7fcbd40bce90 2024-01-22T05:10:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.946+0000 7fcbcaa00700 1 -- 172.21.15.49:0/207041083 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcbbc01b400 con 0x7fcbd40bce90 2024-01-22T05:10:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.946+0000 7fcbcaa00700 1 --2- 172.21.15.49:0/207041083 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcbac05a510 0x7fcbac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.946+0000 7fcbcaa00700 1 -- 172.21.15.49:0/207041083 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fcbbc074d20 con 0x7fcbd40bce90 2024-01-22T05:10:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.946+0000 7fcbd3400700 1 --2- 172.21.15.49:0/207041083 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcbac05a510 0x7fcbac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:03.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.950+0000 7fcbd3400700 1 --2- 172.21.15.49:0/207041083 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcbac05a510 0x7fcbac05c9d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fcbc400d260 tx=0x7fcbc4016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:03.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:03.954+0000 7fcbcaa00700 1 -- 172.21.15.49:0/207041083 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcbbc048340 con 0x7fcbd40bce90 2024-01-22T05:10:04.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:04.150+0000 7fcbda400700 1 -- 172.21.15.49:0/207041083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcbd40c2730 con 0x7fcbd40bce90 2024-01-22T05:10:04.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:04.150+0000 7fcbcaa00700 1 -- 172.21.15.49:0/207041083 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcbbc016030 con 0x7fcbd40bce90 2024-01-22T05:10:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:10:04.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:04.154+0000 7fcbda400700 1 -- 172.21.15.49:0/207041083 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcbac05a510 msgr2=0x7fcbac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:04.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:04.154+0000 7fcbda400700 1 --2- 172.21.15.49:0/207041083 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcbac05a510 0x7fcbac05c9d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fcbc400d260 tx=0x7fcbc4016000).stop 2024-01-22T05:10:04.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:04.154+0000 7fcbda400700 1 -- 172.21.15.49:0/207041083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbd40bce90 msgr2=0x7fcbd40a9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:04.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:04.154+0000 7fcbda400700 1 --2- 172.21.15.49:0/207041083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbd40bce90 0x7fcbd40a9560 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fcbbc00e900 tx=0x7fcbbc009060).stop 2024-01-22T05:10:04.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:04.154+0000 7fcbda400700 1 -- 172.21.15.49:0/207041083 shutdown_connections 2024-01-22T05:10:04.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:04.154+0000 7fcbda400700 1 --2- 172.21.15.49:0/207041083 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcbac05a510 0x7fcbac05c9d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:04.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:04.154+0000 7fcbda400700 1 --2- 172.21.15.49:0/207041083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbd414db00 0x7fcbd40a63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:04.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:04.154+0000 7fcbda400700 1 --2- 172.21.15.49:0/207041083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbd40bce90 0x7fcbd40a9560 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:04.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:04.154+0000 7fcbda400700 1 --2- 172.21.15.49:0/207041083 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbd40bc3d0 0x7fcbd40be8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:04.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:04.154+0000 7fcbda400700 1 -- 172.21.15.49:0/207041083 >> 172.21.15.49:0/207041083 conn(0x7fcbd40c3950 msgr2=0x7fcbd414d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:04.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:04.154+0000 7fcbda400700 1 -- 172.21.15.49:0/207041083 shutdown_connections 2024-01-22T05:10:04.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:04.154+0000 7fcbda400700 1 -- 172.21.15.49:0/207041083 wait complete. 2024-01-22T05:10:04.177 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-22T05:10:04.178 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:10:04.178 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:10:04.178 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:10:04.178 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:10:04.178 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-22T05:10:04.178 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-22T05:10:04.179 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:10:04.179 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:10:04.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:10:04.179 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:10:04.199 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:10:04.199 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:10:04.199 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:10:04.199 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:10:04.199 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:10:04.199 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:10:04.199 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:10:04.199 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:10:04.199 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:10:04.199 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:10:04.199 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:10:04.200 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:10:04.200 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:10:04.200 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42167sec preferred_lft 42167sec 2024-01-22T05:10:04.200 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:10:04.200 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:10:04.200 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:10:04.200 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:10:04.200 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:10:04.200 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:10:04.200 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:10:04.200 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:10:04.200 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:10:04.200 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:10:04.201 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:10:04.201 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:10:04.201 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:10:04.201 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:10:04.201 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:10:04.201 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:10:04.201 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::7ce7:e3ff:fed1:1e88/64 scope link 2024-01-22T05:10:04.201 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:10:04.201 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:10:04.201 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 82:c1:48:e7:c7:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:10:04.201 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::80c1:48ff:fee7:c731/64 scope link 2024-01-22T05:10:04.201 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:10:04.201 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:10:04.201 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:10:04.201 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3426:32ff:feee:c4c9/64 scope link 2024-01-22T05:10:04.202 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:10:04.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:10:04.203 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:10:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:10:04.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:10:04.285 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:10:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:10:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:10:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:10:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:10:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:10:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:10:04.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:10:04.354 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:10:04.354 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:10:04.354 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:10:04.354 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:10:04.354 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:10:04.354 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:10:04.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:10:04.493 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:10:04.511 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:10:04.511 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:10:04.512 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:10:04.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:10:04.512 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-22T05:10:04.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:10:04.600 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-22T05:10:04.658 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:10:04.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:10:04.779 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:10:04.779 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:10:04.805 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:10:04.805 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:10:04.811 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:10:04.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:10:04.811 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:10:04.842 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-01-22T05:10:05.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.049+0000 7f97dca00700 1 Processor -- start 2024-01-22T05:10:05.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.053+0000 7f97dca00700 1 -- start start 2024-01-22T05:10:05.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.057+0000 7f97dca00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f97d4153d60 0x7f97d4064380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:05.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.057+0000 7f97dca00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d4157b40 con 0x7f97d4063f40 2024-01-22T05:10:05.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.057+0000 7f97dca00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d4158610 con 0x7f97d40bdfa0 2024-01-22T05:10:05.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.057+0000 7f97dca00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d4069000 con 0x7f97d4153d60 2024-01-22T05:10:05.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.057+0000 7f97d9600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f97d4063f40 0x7f97d4153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50926/0 (socket says 172.21.15.49:50926) 2024-01-22T05:10:05.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.057+0000 7f97d9600700 1 -- 172.21.15.49:0/2174806181 learned_addr learned my addr 172.21.15.49:0/2174806181 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:10:05.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.057+0000 7f97daa00700 1 --2- 172.21.15.49:0/2174806181 >> v2:172.21.15.110:3300/0 conn(0x7f97d4153d60 0x7f97d4064380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:05.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.057+0000 7f97d8c00700 1 -- 172.21.15.49:0/2174806181 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174250490 0 0) 0x7f97d4157b40 con 0x7f97d4063f40 2024-01-22T05:10:05.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.057+0000 7f97d8c00700 1 -- 172.21.15.49:0/2174806181 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b40033f0 con 0x7f97d4063f40 2024-01-22T05:10:05.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.057+0000 7f97d8c00700 1 -- 172.21.15.49:0/2174806181 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071759178 0 0) 0x7f97d4158610 con 0x7f97d40bdfa0 2024-01-22T05:10:05.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.057+0000 7f97d8c00700 1 -- 172.21.15.49:0/2174806181 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d4157b40 con 0x7f97d40bdfa0 2024-01-22T05:10:05.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.057+0000 7f97daa00700 1 -- 172.21.15.49:0/2174806181 >> v1:172.21.15.110:6789/0 conn(0x7f97d40bdfa0 legacy=0x7f97d40688f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:05.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.057+0000 7f97daa00700 1 -- 172.21.15.49:0/2174806181 >> v1:172.21.15.49:6789/0 conn(0x7f97d4063f40 legacy=0x7f97d4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:05.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.057+0000 7f97daa00700 1 -- 172.21.15.49:0/2174806181 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d40bc740 con 0x7f97d4153d60 2024-01-22T05:10:05.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.057+0000 7f97daa00700 1 --2- 172.21.15.49:0/2174806181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97d4153d60 0x7f97d4064380 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f97cc009e60 tx=0x7f97cc009780).ready entity=mon.1 client_cookie=f408a6a577caa8cb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:05.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.061+0000 7f97d8c00700 1 -- 172.21.15.49:0/2174806181 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc00e070 con 0x7f97d4153d60 2024-01-22T05:10:05.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.061+0000 7f97d8c00700 1 -- 172.21.15.49:0/2174806181 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc00bab0 con 0x7f97d4153d60 2024-01-22T05:10:05.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.061+0000 7f97d8c00700 1 -- 172.21.15.49:0/2174806181 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc00be30 con 0x7f97d4153d60 2024-01-22T05:10:05.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.061+0000 7f97dca00700 1 -- 172.21.15.49:0/2174806181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97d4153d60 msgr2=0x7f97d4064380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:05.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.061+0000 7f97dca00700 1 --2- 172.21.15.49:0/2174806181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97d4153d60 0x7f97d4064380 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f97cc009e60 tx=0x7f97cc009780).stop 2024-01-22T05:10:05.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.061+0000 7f97dca00700 1 -- 172.21.15.49:0/2174806181 shutdown_connections 2024-01-22T05:10:05.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.061+0000 7f97dca00700 1 --2- 172.21.15.49:0/2174806181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97d4153d60 0x7f97d4064380 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:05.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.061+0000 7f97dca00700 1 -- 172.21.15.49:0/2174806181 >> 172.21.15.49:0/2174806181 conn(0x7f97d40c40c0 msgr2=0x7f97d40c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:05.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.061+0000 7f97dca00700 1 -- 172.21.15.49:0/2174806181 shutdown_connections 2024-01-22T05:10:05.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.061+0000 7f97dca00700 1 -- 172.21.15.49:0/2174806181 wait complete. 2024-01-22T05:10:05.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.065+0000 7f97dca00700 1 Processor -- start 2024-01-22T05:10:05.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.065+0000 7f97dca00700 1 -- start start 2024-01-22T05:10:05.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.065+0000 7f97dca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97d4063f40 0x7f97d414f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:05.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.065+0000 7f97dca00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97d40bdfa0 0x7f97d40ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:05.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.065+0000 7f97dca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97d4153d60 0x7f97d40acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:05.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.065+0000 7f97dca00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40acfc0 con 0x7f97d4063f40 2024-01-22T05:10:05.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.065+0000 7f97dca00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d41649c0 con 0x7f97d40bdfa0 2024-01-22T05:10:05.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.065+0000 7f97dca00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40a9d10 con 0x7f97d4153d60 2024-01-22T05:10:05.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.065+0000 7f97da000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97d4063f40 0x7f97d414f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:05.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.065+0000 7f97da000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97d4063f40 0x7f97d414f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41140/0 (socket says 172.21.15.49:41140) 2024-01-22T05:10:05.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.065+0000 7f97da000700 1 -- 172.21.15.49:0/3280883082 learned_addr learned my addr 172.21.15.49:0/3280883082 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:10:05.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.065+0000 7f97daa00700 1 --2- 172.21.15.49:0/3280883082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97d4153d60 0x7f97d40acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:05.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.065+0000 7f97d9600700 1 --2- 172.21.15.49:0/3280883082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97d40bdfa0 0x7f97d40ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:05.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.069+0000 7f97daa00700 1 -- 172.21.15.49:0/3280883082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97d40bdfa0 msgr2=0x7f97d40ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:05.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.069+0000 7f97daa00700 1 --2- 172.21.15.49:0/3280883082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97d40bdfa0 0x7f97d40ac5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:05.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.069+0000 7f97daa00700 1 -- 172.21.15.49:0/3280883082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97d4063f40 msgr2=0x7f97d414f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:05.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.069+0000 7f97daa00700 1 --2- 172.21.15.49:0/3280883082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97d4063f40 0x7f97d414f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:05.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.069+0000 7f97daa00700 1 -- 172.21.15.49:0/3280883082 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc009a20 con 0x7f97d4153d60 2024-01-22T05:10:05.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.069+0000 7f97da000700 1 --2- 172.21.15.49:0/3280883082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97d4063f40 0x7f97d414f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:10:05.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.069+0000 7f97daa00700 1 --2- 172.21.15.49:0/3280883082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97d4153d60 0x7f97d40acad0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f97cc014000 tx=0x7f97cc009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:05.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.069+0000 7f97d1600700 1 -- 172.21.15.49:0/3280883082 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0070e0 con 0x7f97d4153d60 2024-01-22T05:10:05.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.069+0000 7f97d1600700 1 -- 172.21.15.49:0/3280883082 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc013e40 con 0x7f97d4153d60 2024-01-22T05:10:05.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.069+0000 7f97dca00700 1 -- 172.21.15.49:0/3280883082 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d4164370 con 0x7f97d4153d60 2024-01-22T05:10:05.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.069+0000 7f97d1600700 1 -- 172.21.15.49:0/3280883082 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc01d880 con 0x7f97d4153d60 2024-01-22T05:10:05.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.069+0000 7f97dca00700 1 -- 172.21.15.49:0/3280883082 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d4164070 con 0x7f97d4153d60 2024-01-22T05:10:05.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.073+0000 7f97dca00700 1 -- 172.21.15.49:0/3280883082 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d4065660 con 0x7f97d4153d60 2024-01-22T05:10:05.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.073+0000 7f97d1600700 1 -- 172.21.15.49:0/3280883082 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f97cc003040 con 0x7f97d4153d60 2024-01-22T05:10:05.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.073+0000 7f97d1600700 1 --2- 172.21.15.49:0/3280883082 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f97ac05a510 0x7f97ac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:10:05.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.073+0000 7f97d1600700 1 -- 172.21.15.49:0/3280883082 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f97cc076440 con 0x7f97d4153d60 2024-01-22T05:10:05.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.073+0000 7f97da000700 1 --2- 172.21.15.49:0/3280883082 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f97ac05a510 0x7f97ac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:10:05.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.073+0000 7f97da000700 1 --2- 172.21.15.49:0/3280883082 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f97ac05a510 0x7f97ac05c9d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f97c4007fd0 tx=0x7f97c4007c90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:10:05.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.085+0000 7f97d1600700 1 -- 172.21.15.49:0/3280883082 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f97cc049ac0 con 0x7f97d4153d60 2024-01-22T05:10:05.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.289+0000 7f97dca00700 1 -- 172.21.15.49:0/3280883082 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f97d4157d70 con 0x7f97d4153d60 2024-01-22T05:10:05.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.349+0000 7f97d1600700 1 -- 172.21.15.49:0/3280883082 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v71) v1 ==== 167+0+0 (secure 0 0 0) 0x7f97cc04d0e0 con 0x7f97d4153d60 2024-01-22T05:10:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.357+0000 7f97dca00700 1 -- 172.21.15.49:0/3280883082 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f97ac05a510 msgr2=0x7f97ac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.357+0000 7f97dca00700 1 --2- 172.21.15.49:0/3280883082 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f97ac05a510 0x7f97ac05c9d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f97c4007fd0 tx=0x7f97c4007c90).stop 2024-01-22T05:10:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.357+0000 7f97dca00700 1 -- 172.21.15.49:0/3280883082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97d4153d60 msgr2=0x7f97d40acad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:10:05.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.357+0000 7f97dca00700 1 --2- 172.21.15.49:0/3280883082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97d4153d60 0x7f97d40acad0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f97cc014000 tx=0x7f97cc009780).stop 2024-01-22T05:10:05.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.357+0000 7f97dca00700 1 -- 172.21.15.49:0/3280883082 shutdown_connections 2024-01-22T05:10:05.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.357+0000 7f97dca00700 1 --2- 172.21.15.49:0/3280883082 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f97ac05a510 0x7f97ac05c9d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:05.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.357+0000 7f97dca00700 1 --2- 172.21.15.49:0/3280883082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97d4153d60 0x7f97d40acad0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:05.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.357+0000 7f97dca00700 1 --2- 172.21.15.49:0/3280883082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97d40bdfa0 0x7f97d40ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:05.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.357+0000 7f97dca00700 1 --2- 172.21.15.49:0/3280883082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97d4063f40 0x7f97d414f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:10:05.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.357+0000 7f97dca00700 1 -- 172.21.15.49:0/3280883082 >> 172.21.15.49:0/3280883082 conn(0x7f97d40c40c0 msgr2=0x7f97d40c2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:10:05.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.357+0000 7f97dca00700 1 -- 172.21.15.49:0/3280883082 shutdown_connections 2024-01-22T05:10:05.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:10:05.357+0000 7f97dca00700 1 -- 172.21.15.49:0/3280883082 wait complete. 2024-01-22T05:10:05.365 INFO:teuthology.orchestra.run.smithi049.stderr:enabled new snapshots 2024-01-22T05:10:05.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:10:05.385 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-01-22T05:10:05.414 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:10:05.414 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-01-22T05:10:05.414 DEBUG:teuthology.orchestra.run.smithi049:> import uuid 2024-01-22T05:10:05.414 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:10:05.414 DEBUG:teuthology.orchestra.run.smithi049:> n = 2000 2024-01-22T05:10:05.414 DEBUG:teuthology.orchestra.run.smithi049:> create_hard_links = False 2024-01-22T05:10:05.414 DEBUG:teuthology.orchestra.run.smithi049:> if 3 > 0: 2024-01-22T05:10:05.414 DEBUG:teuthology.orchestra.run.smithi049:> create_hard_links = True 2024-01-22T05:10:05.414 DEBUG:teuthology.orchestra.run.smithi049:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-01-22T05:10:05.414 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:10:05.414 DEBUG:teuthology.orchestra.run.smithi049:> dpath = os.path.dirname(path) 2024-01-22T05:10:05.414 DEBUG:teuthology.orchestra.run.smithi049:> fnameprefix = os.path.basename(path) 2024-01-22T05:10:05.414 DEBUG:teuthology.orchestra.run.smithi049:> os.makedirs(dpath, exist_ok=True) 2024-01-22T05:10:05.415 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:10:05.415 DEBUG:teuthology.orchestra.run.smithi049:> try: 2024-01-22T05:10:05.415 DEBUG:teuthology.orchestra.run.smithi049:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-01-22T05:10:05.415 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:10:05.415 DEBUG:teuthology.orchestra.run.smithi049:> for i in range(n): 2024-01-22T05:10:05.415 DEBUG:teuthology.orchestra.run.smithi049:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-01-22T05:10:05.415 DEBUG:teuthology.orchestra.run.smithi049:> with open(fpath, '"'"'w'"'"') as f: 2024-01-22T05:10:05.415 DEBUG:teuthology.orchestra.run.smithi049:> f.write(f"{i}") 2024-01-22T05:10:05.415 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-01-22T05:10:05.415 DEBUG:teuthology.orchestra.run.smithi049:> f.flush() 2024-01-22T05:10:05.415 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(f.fileno()) 2024-01-22T05:10:05.415 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-01-22T05:10:05.415 DEBUG:teuthology.orchestra.run.smithi049:> os.unlink(fpath) 2024-01-22T05:10:05.415 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-01-22T05:10:05.415 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(dirfd) 2024-01-22T05:10:05.416 DEBUG:teuthology.orchestra.run.smithi049:> if create_hard_links: 2024-01-22T05:10:05.416 DEBUG:teuthology.orchestra.run.smithi049:> for j in range(3): 2024-01-22T05:10:05.416 DEBUG:teuthology.orchestra.run.smithi049:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-01-22T05:10:05.416 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-01-22T05:10:05.416 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(dirfd) 2024-01-22T05:10:05.416 DEBUG:teuthology.orchestra.run.smithi049:> finally: 2024-01-22T05:10:05.416 DEBUG:teuthology.orchestra.run.smithi049:> os.close(dirfd) 2024-01-22T05:10:05.416 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-01-22T05:10:07.953 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:10:07.958 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:10:38.031 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:10:38.037 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:10:55.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:10:55.225 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-01-22T05:10:55.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:10:55.272 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-01-22T05:11:08.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:11:08.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:11:37.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:11:37.008 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-01-22T05:11:37.076 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 perf dump 2024-01-22T05:11:37.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.247+0000 7fa42fa00700 1 Processor -- start 2024-01-22T05:11:37.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.247+0000 7fa42fa00700 1 -- start start 2024-01-22T05:11:37.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.251+0000 7fa42fa00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa428063e30 0x7fa428064210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.251+0000 7fa42fa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa428068b90 0x7fa428068ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.251+0000 7fa42fa00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4280c1cf0 con 0x7fa4281576e0 2024-01-22T05:11:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.251+0000 7fa42fa00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4280c1fd0 con 0x7fa428068b90 2024-01-22T05:11:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.251+0000 7fa42fa00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa428069900 con 0x7fa428063e30 2024-01-22T05:11:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.251+0000 7fa427e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa428068b90 0x7fa428068ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.251+0000 7fa42d000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa428063e30 0x7fa428064210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.251+0000 7fa42d000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa428063e30 0x7fa428064210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:55174/0 (socket says 172.21.15.49:55174) 2024-01-22T05:11:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.251+0000 7fa42d000700 1 -- 172.21.15.49:0/225760293 learned_addr learned my addr 172.21.15.49:0/225760293 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.251+0000 7fa427e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa428068b90 0x7fa428068ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59026/0 (socket says 172.21.15.49:59026) 2024-01-22T05:11:37.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.251+0000 7fa42da00700 1 --1- 172.21.15.49:0/225760293 >> v1:172.21.15.110:6789/0 conn(0x7fa4281576e0 0x7fa428157b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:51298/0 (socket says 172.21.15.49:51298) 2024-01-22T05:11:37.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa42d000700 1 -- 172.21.15.49:0/225760293 >> v2:172.21.15.49:3300/0 conn(0x7fa428068b90 msgr2=0x7fa428068ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa42d000700 1 --2- 172.21.15.49:0/225760293 >> v2:172.21.15.49:3300/0 conn(0x7fa428068b90 0x7fa428068ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa42d000700 1 -- 172.21.15.49:0/225760293 >> v1:172.21.15.110:6789/0 conn(0x7fa4281576e0 legacy=0x7fa428157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa42d000700 1 -- 172.21.15.49:0/225760293 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa428069be0 con 0x7fa428063e30 2024-01-22T05:11:37.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa427e00700 1 --2- 172.21.15.49:0/225760293 >> v2:172.21.15.49:3300/0 conn(0x7fa428068b90 0x7fa428068ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:11:37.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa42d000700 1 --2- 172.21.15.49:0/225760293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa428063e30 0x7fa428064210 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fa42806b170 tx=0x7fa4180090f0).ready entity=mon.1 client_cookie=2c18265c1a9cdb1f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa427400700 1 -- 172.21.15.49:0/225760293 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41800b520 con 0x7fa428063e30 2024-01-22T05:11:37.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa427400700 1 -- 172.21.15.49:0/225760293 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41800b680 con 0x7fa428063e30 2024-01-22T05:11:37.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa427400700 1 -- 172.21.15.49:0/225760293 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41800ba00 con 0x7fa428063e30 2024-01-22T05:11:37.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa42fa00700 1 -- 172.21.15.49:0/225760293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa428063e30 msgr2=0x7fa428064210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa42fa00700 1 --2- 172.21.15.49:0/225760293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa428063e30 0x7fa428064210 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fa42806b170 tx=0x7fa4180090f0).stop 2024-01-22T05:11:37.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa42fa00700 1 -- 172.21.15.49:0/225760293 shutdown_connections 2024-01-22T05:11:37.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa42fa00700 1 --2- 172.21.15.49:0/225760293 >> v2:172.21.15.49:3300/0 conn(0x7fa428068b90 0x7fa428068ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa42fa00700 1 --2- 172.21.15.49:0/225760293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa428063e30 0x7fa428064210 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa42fa00700 1 -- 172.21.15.49:0/225760293 >> 172.21.15.49:0/225760293 conn(0x7fa4280c40f0 msgr2=0x7fa4280c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa42fa00700 1 -- 172.21.15.49:0/225760293 shutdown_connections 2024-01-22T05:11:37.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.255+0000 7fa42fa00700 1 -- 172.21.15.49:0/225760293 wait complete. 2024-01-22T05:11:37.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.259+0000 7fa42fa00700 1 Processor -- start 2024-01-22T05:11:37.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.259+0000 7fa42fa00700 1 -- start start 2024-01-22T05:11:37.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.259+0000 7fa42fa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa428063e30 0x7fa428168b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.259+0000 7fa42fa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa428068b90 0x7fa42816b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.259+0000 7fa42fa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4281576e0 0x7fa4280ac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.259+0000 7fa42fa00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4280bf9f0 con 0x7fa4281576e0 2024-01-22T05:11:37.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.259+0000 7fa42fa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4280bf6c0 con 0x7fa428068b90 2024-01-22T05:11:37.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.259+0000 7fa42fa00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4280bd8f0 con 0x7fa428063e30 2024-01-22T05:11:37.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa42da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4281576e0 0x7fa4280ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa42da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4281576e0 0x7fa4280ac750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59042/0 (socket says 172.21.15.49:59042) 2024-01-22T05:11:37.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa42da00700 1 -- 172.21.15.49:0/3635685095 learned_addr learned my addr 172.21.15.49:0/3635685095 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa42d000700 1 --2- 172.21.15.49:0/3635685095 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa428063e30 0x7fa428168b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa427e00700 1 --2- 172.21.15.49:0/3635685095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa428068b90 0x7fa42816b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa42da00700 1 -- 172.21.15.49:0/3635685095 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa428063e30 msgr2=0x7fa428168b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa42da00700 1 --2- 172.21.15.49:0/3635685095 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa428063e30 0x7fa428168b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa42da00700 1 -- 172.21.15.49:0/3635685095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa428068b90 msgr2=0x7fa42816b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa42da00700 1 --2- 172.21.15.49:0/3635685095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa428068b90 0x7fa42816b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa42da00700 1 -- 172.21.15.49:0/3635685095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4100092a0 con 0x7fa4281576e0 2024-01-22T05:11:37.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa42da00700 1 --2- 172.21.15.49:0/3635685095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4281576e0 0x7fa4280ac750 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fa42000c7c0 tx=0x7fa420001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa41fe00700 1 -- 172.21.15.49:0/3635685095 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420005c70 con 0x7fa4281576e0 2024-01-22T05:11:37.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa41fe00700 1 -- 172.21.15.49:0/3635685095 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa420005dd0 con 0x7fa4281576e0 2024-01-22T05:11:37.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa41fe00700 1 -- 172.21.15.49:0/3635685095 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4200072e0 con 0x7fa4281576e0 2024-01-22T05:11:37.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa42fa00700 1 -- 172.21.15.49:0/3635685095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa418009370 con 0x7fa4281576e0 2024-01-22T05:11:37.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.263+0000 7fa42fa00700 1 -- 172.21.15.49:0/3635685095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4280bdeb0 con 0x7fa4281576e0 2024-01-22T05:11:37.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.267+0000 7fa41fe00700 1 -- 172.21.15.49:0/3635685095 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa4200076d0 con 0x7fa4281576e0 2024-01-22T05:11:37.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.267+0000 7fa41fe00700 1 --2- 172.21.15.49:0/3635685095 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa40005a510 0x7fa40005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.267+0000 7fa41fe00700 1 -- 172.21.15.49:0/3635685095 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa420074200 con 0x7fa4281576e0 2024-01-22T05:11:37.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.267+0000 7fa42d000700 1 --2- 172.21.15.49:0/3635685095 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa40005a510 0x7fa40005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.271+0000 7fa42d000700 1 --2- 172.21.15.49:0/3635685095 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa40005a510 0x7fa40005c9d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fa418009130 tx=0x7fa418017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.271+0000 7fa439faa740 1 Processor -- start 2024-01-22T05:11:37.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.271+0000 7fa439faa740 1 -- start start 2024-01-22T05:11:37.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa439faa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7e5c0 0x1f7e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa439faa740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7f170 0x1f39cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa439faa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 0x1f3a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa439faa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e772a0 con 0x1f7e5c0 2024-01-22T05:11:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa439faa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e9a4a0 con 0x1f3a1b0 2024-01-22T05:11:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa439faa740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e63ce0 con 0x1f7f170 2024-01-22T05:11:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa42d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7e5c0 0x1f7e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa42da00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 0x1f3a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa427e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7f170 0x1f39cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa42da00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 0x1f3a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:55194/0 (socket says 172.21.15.49:55194) 2024-01-22T05:11:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa42da00700 1 -- 172.21.15.49:0/3478768951 learned_addr learned my addr 172.21.15.49:0/3478768951 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa42d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7e5c0 0x1f7e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59052/0 (socket says 172.21.15.49:59052) 2024-01-22T05:11:37.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa42da00700 1 -- 172.21.15.49:0/3478768951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7f170 msgr2=0x1f39cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa42da00700 1 --2- 172.21.15.49:0/3478768951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7f170 0x1f39cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa42da00700 1 -- 172.21.15.49:0/3478768951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7e5c0 msgr2=0x1f7e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa42da00700 1 --2- 172.21.15.49:0/3478768951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7e5c0 0x1f7e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa42da00700 1 -- 172.21.15.49:0/3478768951 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1ec88e0 con 0x1f3a1b0 2024-01-22T05:11:37.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa42da00700 1 --2- 172.21.15.49:0/3478768951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 0x1f3a610 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fa42004b430 tx=0x7fa42000f000).ready entity=mon.1 client_cookie=855d864ce8c44bf4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa41cc00700 1 -- 172.21.15.49:0/3478768951 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420054030 con 0x1f3a1b0 2024-01-22T05:11:37.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa41cc00700 1 -- 172.21.15.49:0/3478768951 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42004b4a0 con 0x1f3a1b0 2024-01-22T05:11:37.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa41cc00700 1 -- 172.21.15.49:0/3478768951 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420047c10 con 0x1f3a1b0 2024-01-22T05:11:37.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa439faa740 1 -- 172.21.15.49:0/3478768951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 msgr2=0x1f3a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa439faa740 1 --2- 172.21.15.49:0/3478768951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 0x1f3a610 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fa42004b430 tx=0x7fa42000f000).stop 2024-01-22T05:11:37.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa439faa740 1 -- 172.21.15.49:0/3478768951 shutdown_connections 2024-01-22T05:11:37.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa439faa740 1 --2- 172.21.15.49:0/3478768951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 0x1f3a610 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa439faa740 1 --2- 172.21.15.49:0/3478768951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7f170 0x1f39cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa439faa740 1 --2- 172.21.15.49:0/3478768951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7e5c0 0x1f7e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.275+0000 7fa439faa740 1 -- 172.21.15.49:0/3478768951 >> 172.21.15.49:0/3478768951 conn(0x1d1c640 msgr2=0x1f83e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.279+0000 7fa439faa740 1 -- 172.21.15.49:0/3478768951 shutdown_connections 2024-01-22T05:11:37.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.279+0000 7fa439faa740 1 -- 172.21.15.49:0/3478768951 wait complete. 2024-01-22T05:11:37.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.279+0000 7fa439faa740 1 -- start start 2024-01-22T05:11:37.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.279+0000 7fa439faa740 1 Processor -- start 2024-01-22T05:11:37.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 0x1f60040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7e5c0 0x1f663b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7f170 0x1f8f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f37ef0 con 0x1f7f170 2024-01-22T05:11:37.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f69080 con 0x1f3a1b0 2024-01-22T05:11:37.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f60530 con 0x1f7e5c0 2024-01-22T05:11:37.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 10 client.0 ll_register_callbacks cb 0x1ef49f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:11:37.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa42da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7f170 0x1f8f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa427e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7e5c0 0x1f663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa42da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7f170 0x1f8f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59060/0 (socket says 172.21.15.49:59060) 2024-01-22T05:11:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa42da00700 1 -- 172.21.15.49:0/3759759004 learned_addr learned my addr 172.21.15.49:0/3759759004 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa42d000700 1 --2- 172.21.15.49:0/3759759004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 0x1f60040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa42da00700 1 -- 172.21.15.49:0/3759759004 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7e5c0 msgr2=0x1f663b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa42da00700 1 --2- 172.21.15.49:0/3759759004 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7e5c0 0x1f663b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa42da00700 1 -- 172.21.15.49:0/3759759004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 msgr2=0x1f60040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa42da00700 1 --2- 172.21.15.49:0/3759759004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 0x1f60040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa42da00700 1 -- 172.21.15.49:0/3759759004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4280bdeb0 con 0x1f7f170 2024-01-22T05:11:37.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa42da00700 1 --2- 172.21.15.49:0/3759759004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7f170 0x1f8f700 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fa420049850 tx=0x7fa42004d000).ready entity=mon.0 client_cookie=5884a834f86d1fb7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa415600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:11:37.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa415600700 1 -- 172.21.15.49:0/3759759004 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420054070 con 0x1f7f170 2024-01-22T05:11:37.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa415600700 1 -- 172.21.15.49:0/3759759004 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa420055070 con 0x1f7f170 2024-01-22T05:11:37.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 1 -- 172.21.15.49:0/3759759004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1eb41f0 con 0x1f7f170 2024-01-22T05:11:37.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa415600700 1 -- 172.21.15.49:0/3759759004 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4200472f0 con 0x1f7f170 2024-01-22T05:11:37.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 10 client.7038 fetch_fsmap learned FSMap version 80 2024-01-22T05:11:37.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 1 -- 172.21.15.49:0/3759759004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x1eb7780 con 0x1f7f170 2024-01-22T05:11:37.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa415600700 1 -- 172.21.15.49:0/3759759004 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1eb41f0 con 0x1f7f170 2024-01-22T05:11:37.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa415600700 1 -- 172.21.15.49:0/3759759004 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 80) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa420047450 con 0x1f7f170 2024-01-22T05:11:37.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 10 client.7038 fetch_fsmap finished waiting for FSMap version 80 2024-01-22T05:11:37.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 10 client.7038 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-01-22T05:11:37.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 20 client.7038 populate_metadata read hostname 'smithi049' 2024-01-22T05:11:37.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 1 --2- 172.21.15.49:0/3759759004 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x1f53a50 0x1f53e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 4 client.7038 mds_command: new command op to 6846 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:11:37.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.283+0000 7fa439faa740 1 -- 172.21.15.49:0/3759759004 --> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1eaa740 con 0x1f53a50 2024-01-22T05:11:37.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.287+0000 7fa42d000700 1 --2- 172.21.15.49:0/3759759004 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x1f53a50 0x1f53e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.291+0000 7fa42d000700 1 --2- 172.21.15.49:0/3759759004 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x1f53a50 0x1f53e60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f2f5c8cf80d205d5 server_cookie=45f26a21c4632087 in_seq=0 out_seq=0 2024-01-22T05:11:37.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.291+0000 7fa415600700 10 client.7038 ms_handle_connect on v2:172.21.15.110:6832/1072346524 2024-01-22T05:11:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.295+0000 7fa415600700 1 -- 172.21.15.49:0/3759759004 <== mds.0 v2:172.21.15.110:6832/1072346524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1eaa740 con 0x1f53a50 2024-01-22T05:11:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.295+0000 7fa415600700 10 client.7038 handle_command_reply: tid=0 2024-01-22T05:11:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.295+0000 7fa439faa740 1 client.7038 shutdown 2024-01-22T05:11:37.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.299+0000 7fa439faa740 1 -- 172.21.15.49:0/3759759004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7f170 msgr2=0x1f8f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.299+0000 7fa439faa740 1 --2- 172.21.15.49:0/3759759004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7f170 0x1f8f700 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fa420049850 tx=0x7fa42004d000).stop 2024-01-22T05:11:37.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.299+0000 7fa439faa740 1 -- 172.21.15.49:0/3759759004 shutdown_connections 2024-01-22T05:11:37.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.299+0000 7fa439faa740 1 --2- 172.21.15.49:0/3759759004 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x1f53a50 0x1f53e60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.299+0000 7fa439faa740 1 --2- 172.21.15.49:0/3759759004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7f170 0x1f8f700 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.299+0000 7fa439faa740 1 --2- 172.21.15.49:0/3759759004 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7e5c0 0x1f663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.299+0000 7fa439faa740 1 --2- 172.21.15.49:0/3759759004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 0x1f60040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.299+0000 7fa439faa740 1 -- 172.21.15.49:0/3759759004 >> 172.21.15.49:0/3759759004 conn(0x1d1c640 msgr2=0x1f61de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.299+0000 7fa415600700 0 client.7038 ms_handle_reset on v2:172.21.15.110:6832/1072346524 2024-01-22T05:11:37.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.299+0000 7fa439faa740 1 -- 172.21.15.49:0/3759759004 shutdown_connections 2024-01-22T05:11:37.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.299+0000 7fa439faa740 1 -- 172.21.15.49:0/3759759004 wait complete. 2024-01-22T05:11:37.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.303+0000 7fa439faa740 20 client.7038 trim_cache size 0 max 16384 2024-01-22T05:11:37.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa439faa740 1 Processor -- start 2024-01-22T05:11:37.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa439faa740 1 -- start start 2024-01-22T05:11:37.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa439faa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f3a1b0 0x1f38560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa439faa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f7e5c0 0x1f83820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa439faa740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7f170 0x1f683e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa439faa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f369e0 con 0x1f3a1b0 2024-01-22T05:11:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa439faa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f66730 con 0x1f7e5c0 2024-01-22T05:11:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa439faa740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f7eed0 con 0x1f7f170 2024-01-22T05:11:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa42d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f3a1b0 0x1f38560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa42d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f3a1b0 0x1f38560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59076/0 (socket says 172.21.15.49:59076) 2024-01-22T05:11:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa42d000700 1 -- 172.21.15.49:0/3276702191 learned_addr learned my addr 172.21.15.49:0/3276702191 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa427e00700 1 --2- 172.21.15.49:0/3276702191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f7e5c0 0x1f83820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa42da00700 1 --2- 172.21.15.49:0/3276702191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7f170 0x1f683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa42d000700 1 -- 172.21.15.49:0/3276702191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7f170 msgr2=0x1f683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa42d000700 1 --2- 172.21.15.49:0/3276702191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7f170 0x1f683e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa42d000700 1 -- 172.21.15.49:0/3276702191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f7e5c0 msgr2=0x1f83820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.331+0000 7fa42d000700 1 --2- 172.21.15.49:0/3276702191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f7e5c0 0x1f83820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa42d000700 1 -- 172.21.15.49:0/3276702191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4280acfa0 con 0x1f3a1b0 2024-01-22T05:11:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa42d000700 1 --2- 172.21.15.49:0/3276702191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f3a1b0 0x1f38560 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fa428069a40 tx=0x7fa418015000).ready entity=mon.0 client_cookie=d65a1f661424426 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa41d600700 1 -- 172.21.15.49:0/3276702191 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41802e040 con 0x1f3a1b0 2024-01-22T05:11:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa41d600700 1 -- 172.21.15.49:0/3276702191 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa418029620 con 0x1f3a1b0 2024-01-22T05:11:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa41d600700 1 -- 172.21.15.49:0/3276702191 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418029790 con 0x1f3a1b0 2024-01-22T05:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa439faa740 1 -- 172.21.15.49:0/3276702191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f3a1b0 msgr2=0x1f38560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa439faa740 1 --2- 172.21.15.49:0/3276702191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f3a1b0 0x1f38560 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fa428069a40 tx=0x7fa418015000).stop 2024-01-22T05:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa439faa740 1 -- 172.21.15.49:0/3276702191 shutdown_connections 2024-01-22T05:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa439faa740 1 --2- 172.21.15.49:0/3276702191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7f170 0x1f683e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa439faa740 1 --2- 172.21.15.49:0/3276702191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f7e5c0 0x1f83820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa439faa740 1 --2- 172.21.15.49:0/3276702191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f3a1b0 0x1f38560 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa439faa740 1 -- 172.21.15.49:0/3276702191 >> 172.21.15.49:0/3276702191 conn(0x1d1c640 msgr2=0x1f900d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa439faa740 1 -- 172.21.15.49:0/3276702191 shutdown_connections 2024-01-22T05:11:37.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa439faa740 1 -- 172.21.15.49:0/3276702191 wait complete. 2024-01-22T05:11:37.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa439faa740 1 -- start start 2024-01-22T05:11:37.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.335+0000 7fa439faa740 1 Processor -- start 2024-01-22T05:11:37.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 0x1fe4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7e5c0 0x1f68390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7f170 0x1f68880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f65ba0 con 0x1f7e5c0 2024-01-22T05:11:37.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f68d70 con 0x1f3a1b0 2024-01-22T05:11:37.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fa05f0 con 0x1f7f170 2024-01-22T05:11:37.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 10 client.0 ll_register_callbacks cb 0x7fa418006c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:11:37.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa427e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7e5c0 0x1f68390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa427e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7e5c0 0x1f68390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59088/0 (socket says 172.21.15.49:59088) 2024-01-22T05:11:37.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa427e00700 1 -- 172.21.15.49:0/3603565944 learned_addr learned my addr 172.21.15.49:0/3603565944 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa42d000700 1 --2- 172.21.15.49:0/3603565944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 0x1fe4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa42da00700 1 --2- 172.21.15.49:0/3603565944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7f170 0x1f68880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa427e00700 1 -- 172.21.15.49:0/3603565944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7f170 msgr2=0x1f68880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa427e00700 1 --2- 172.21.15.49:0/3603565944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7f170 0x1f68880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa427e00700 1 -- 172.21.15.49:0/3603565944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 msgr2=0x1fe4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa427e00700 1 --2- 172.21.15.49:0/3603565944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 0x1fe4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa427e00700 1 -- 172.21.15.49:0/3603565944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa428069be0 con 0x1f7e5c0 2024-01-22T05:11:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa427e00700 1 --2- 172.21.15.49:0/3603565944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7e5c0 0x1f68390 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7fa4280ad900 tx=0x7fa410017040).ready entity=mon.0 client_cookie=e288e9568afe7102 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa415600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:11:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa415600700 1 -- 172.21.15.49:0/3603565944 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41001a070 con 0x1f7e5c0 2024-01-22T05:11:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 1 -- 172.21.15.49:0/3603565944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa42004b4a0 con 0x1f7e5c0 2024-01-22T05:11:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa415600700 1 -- 172.21.15.49:0/3603565944 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa410009e10 con 0x1f7e5c0 2024-01-22T05:11:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa415600700 1 -- 172.21.15.49:0/3603565944 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa410014ae0 con 0x1f7e5c0 2024-01-22T05:11:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 10 client.7044 fetch_fsmap learned FSMap version 80 2024-01-22T05:11:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 1 -- 172.21.15.49:0/3603565944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x1f680f0 con 0x1f7e5c0 2024-01-22T05:11:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa415600700 1 -- 172.21.15.49:0/3603565944 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42004b4a0 con 0x1f7e5c0 2024-01-22T05:11:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa415600700 1 -- 172.21.15.49:0/3603565944 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 80) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa410014c40 con 0x1f7e5c0 2024-01-22T05:11:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 10 client.7044 fetch_fsmap finished waiting for FSMap version 80 2024-01-22T05:11:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 10 client.7044 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-01-22T05:11:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 20 client.7044 populate_metadata read hostname 'smithi049' 2024-01-22T05:11:37.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 1 --2- 172.21.15.49:0/3603565944 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x1f839e0 0x1f80700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 4 client.7044 mds_command: new command op to 6846 tid=0[{"prefix": "perf dump"}] 2024-01-22T05:11:37.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.339+0000 7fa439faa740 1 -- 172.21.15.49:0/3603565944 --> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x1d735d0 con 0x1f839e0 2024-01-22T05:11:37.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.343+0000 7fa42d000700 1 --2- 172.21.15.49:0/3603565944 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x1f839e0 0x1f80700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.343+0000 7fa42d000700 1 --2- 172.21.15.49:0/3603565944 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x1f839e0 0x1f80700 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fddb3a819053461c server_cookie=e0680b9e1c0b3ce in_seq=0 out_seq=0 2024-01-22T05:11:37.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.343+0000 7fa415600700 10 client.7044 ms_handle_connect on v2:172.21.15.110:6832/1072346524 2024-01-22T05:11:37.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.343+0000 7fa415600700 1 -- 172.21.15.49:0/3603565944 <== mds.0 v2:172.21.15.110:6832/1072346524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17080 (crc 0 0 0) 0x1d735d0 con 0x1f839e0 2024-01-22T05:11:37.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.343+0000 7fa415600700 10 client.7044 handle_command_reply: tid=0 2024-01-22T05:11:37.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.343+0000 7fa439faa740 1 client.7044 shutdown 2024-01-22T05:11:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.343+0000 7fa439faa740 1 -- 172.21.15.49:0/3603565944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7e5c0 msgr2=0x1f68390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.343+0000 7fa439faa740 1 --2- 172.21.15.49:0/3603565944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7e5c0 0x1f68390 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7fa4280ad900 tx=0x7fa410017040).stop 2024-01-22T05:11:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.343+0000 7fa439faa740 1 -- 172.21.15.49:0/3603565944 shutdown_connections 2024-01-22T05:11:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.343+0000 7fa439faa740 1 --2- 172.21.15.49:0/3603565944 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x1f839e0 0x1f80700 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.343+0000 7fa439faa740 1 --2- 172.21.15.49:0/3603565944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f7f170 0x1f68880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.343+0000 7fa439faa740 1 --2- 172.21.15.49:0/3603565944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f7e5c0 0x1f68390 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.343+0000 7fa439faa740 1 --2- 172.21.15.49:0/3603565944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f3a1b0 0x1fe4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.343+0000 7fa415600700 0 client.7044 ms_handle_reset on v2:172.21.15.110:6832/1072346524 2024-01-22T05:11:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.343+0000 7fa439faa740 1 -- 172.21.15.49:0/3603565944 >> 172.21.15.49:0/3603565944 conn(0x1d1c640 msgr2=0x1f65d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.347+0000 7fa439faa740 1 -- 172.21.15.49:0/3603565944 shutdown_connections 2024-01-22T05:11:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.347+0000 7fa439faa740 1 -- 172.21.15.49:0/3603565944 wait complete. 2024-01-22T05:11:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.347+0000 7fa439faa740 20 client.7044 trim_cache size 0 max 16384 2024-01-22T05:11:37.350 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:11:37.350 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-01-22T05:11:37.350 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 1659, 2024-01-22T05:11:37.350 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 1643, 2024-01-22T05:11:37.350 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 553676, 2024-01-22T05:11:37.350 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 13259748, 2024-01-22T05:11:37.350 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 8, 2024-01-22T05:11:37.351 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-01-22T05:11:37.351 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.268414438, 2024-01-22T05:11:37.351 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.116313382, 2024-01-22T05:11:37.351 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.069061816, 2024-01-22T05:11:37.351 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.060932089, 2024-01-22T05:11:37.351 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-01-22T05:11:37.351 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1643, 2024-01-22T05:11:37.351 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.779871143, 2024-01-22T05:11:37.351 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000474662 2024-01-22T05:11:37.351 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.351 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-01-22T05:11:37.351 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2, 2024-01-22T05:11:37.351 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000463, 2024-01-22T05:11:37.351 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000231 2024-01-22T05:11:37.352 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:11:37.352 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.352 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-01-22T05:11:37.352 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 5114, 2024-01-22T05:11:37.352 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 5136, 2024-01-22T05:11:37.352 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1647493, 2024-01-22T05:11:37.352 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 39855974, 2024-01-22T05:11:37.352 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 6, 2024-01-22T05:11:37.352 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-01-22T05:11:37.352 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.766273846, 2024-01-22T05:11:37.352 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.372225037, 2024-01-22T05:11:37.352 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.139680922, 2024-01-22T05:11:37.352 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.205874535, 2024-01-22T05:11:37.352 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-01-22T05:11:37.352 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 5135, 2024-01-22T05:11:37.353 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.882279617, 2024-01-22T05:11:37.353 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000561300 2024-01-22T05:11:37.353 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.353 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-01-22T05:11:37.353 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.353 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.353 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.353 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:11:37.353 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.353 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-01-22T05:11:37.353 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 31845, 2024-01-22T05:11:37.353 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 52947, 2024-01-22T05:11:37.353 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 10666318, 2024-01-22T05:11:37.353 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 66178749, 2024-01-22T05:11:37.353 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 8, 2024-01-22T05:11:37.354 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-01-22T05:11:37.354 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 5.800946322, 2024-01-22T05:11:37.354 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 3.375662586, 2024-01-22T05:11:37.354 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 2.313712132, 2024-01-22T05:11:37.354 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.412251723, 2024-01-22T05:11:37.354 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-01-22T05:11:37.354 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 52946, 2024-01-22T05:11:37.354 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 7.954763235, 2024-01-22T05:11:37.354 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000150242 2024-01-22T05:11:37.354 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.354 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-01-22T05:11:37.354 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 44972, 2024-01-22T05:11:37.354 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.023348539, 2024-01-22T05:11:37.354 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000519 2024-01-22T05:11:37.355 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:11:37.355 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.355 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-01-22T05:11:37.355 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 1, 2024-01-22T05:11:37.355 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-01-22T05:11:37.355 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.355 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-MDSRank": { 2024-01-22T05:11:37.355 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-01-22T05:11:37.355 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-01-22T05:11:37.355 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 4972, 2024-01-22T05:11:37.355 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 19.390504779, 2024-01-22T05:11:37.355 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.003899940 2024-01-22T05:11:37.355 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:11:37.356 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.356 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-PurgeQueue": { 2024-01-22T05:11:37.356 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-01-22T05:11:37.356 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-01-22T05:11:37.356 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2032, 2024-01-22T05:11:37.356 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.949249112, 2024-01-22T05:11:37.356 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000467150 2024-01-22T05:11:37.356 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:11:37.356 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.356 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-01-22T05:11:37.356 INFO:teuthology.orchestra.run.smithi049.stdout: "request": 26126, 2024-01-22T05:11:37.356 INFO:teuthology.orchestra.run.smithi049.stdout: "reply": 26126, 2024-01-22T05:11:37.356 INFO:teuthology.orchestra.run.smithi049.stdout: "reply_latency": { 2024-01-22T05:11:37.356 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 26126, 2024-01-22T05:11:37.357 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 319.517458643, 2024-01-22T05:11:37.357 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.012229865 2024-01-22T05:11:37.357 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.357 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_reply": 0, 2024-01-22T05:11:37.357 INFO:teuthology.orchestra.run.smithi049.stdout: "forward": 0, 2024-01-22T05:11:37.357 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch": 0, 2024-01-22T05:11:37.357 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_commit": 60, 2024-01-22T05:11:37.357 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_split": 0, 2024-01-22T05:11:37.357 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_merge": 0, 2024-01-22T05:11:37.357 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes": 10011, 2024-01-22T05:11:37.357 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_top": 5866, 2024-01-22T05:11:37.357 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_bottom": 4145, 2024-01-22T05:11:37.357 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pin_tail": 0, 2024-01-22T05:11:37.357 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pinned": 1630, 2024-01-22T05:11:37.357 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_expired": 6872, 2024-01-22T05:11:37.358 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_with_caps": 164, 2024-01-22T05:11:37.358 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": 164, 2024-01-22T05:11:37.358 INFO:teuthology.orchestra.run.smithi049.stdout: "subtrees": 2, 2024-01-22T05:11:37.358 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse": 48782, 2024-01-22T05:11:37.358 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_hit": 48302, 2024-01-22T05:11:37.358 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_forward": 0, 2024-01-22T05:11:37.358 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_discover": 0, 2024-01-22T05:11:37.358 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_dir_fetch": 0, 2024-01-22T05:11:37.358 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_remote_ino": 0, 2024-01-22T05:11:37.358 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_lock": 136, 2024-01-22T05:11:37.358 INFO:teuthology.orchestra.run.smithi049.stdout: "load_cent": 481846, 2024-01-22T05:11:37.358 INFO:teuthology.orchestra.run.smithi049.stdout: "q": 0, 2024-01-22T05:11:37.358 INFO:teuthology.orchestra.run.smithi049.stdout: "exported": 0, 2024-01-22T05:11:37.358 INFO:teuthology.orchestra.run.smithi049.stdout: "exported_inodes": 0, 2024-01-22T05:11:37.358 INFO:teuthology.orchestra.run.smithi049.stdout: "imported": 0, 2024-01-22T05:11:37.359 INFO:teuthology.orchestra.run.smithi049.stdout: "imported_inodes": 0, 2024-01-22T05:11:37.359 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_dir_fetch": 0, 2024-01-22T05:11:37.359 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_backtrace_fetch": 0, 2024-01-22T05:11:37.359 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_peer_discover": 0, 2024-01-22T05:11:37.359 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rfiles": 0, 2024-01-22T05:11:37.359 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rbytes": 0, 2024-01-22T05:11:37.359 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rsnaps": 0, 2024-01-22T05:11:37.359 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_fetch": 0, 2024-01-22T05:11:37.359 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_set_tag": 0, 2024-01-22T05:11:37.359 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_repaired": 0, 2024-01-22T05:11:37.359 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_inotable_repaired": 0, 2024-01-22T05:11:37.359 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_inodes": 0, 2024-01-22T05:11:37.359 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_base_inodes": 0, 2024-01-22T05:11:37.359 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dirfrag_rstats": 0, 2024-01-22T05:11:37.360 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_file_inodes": 0, 2024-01-22T05:11:37.360 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_inode_file_caps": 0, 2024-01-22T05:11:37.360 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_revoke": 735, 2024-01-22T05:11:37.360 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_grant": 4033, 2024-01-22T05:11:37.360 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_trunc": 0, 2024-01-22T05:11:37.360 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-22T05:11:37.360 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-22T05:11:37.360 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps": 3516, 2024-01-22T05:11:37.360 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps_dirty": 2000, 2024-01-22T05:11:37.360 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_cap_release": 65, 2024-01-22T05:11:37.360 INFO:teuthology.orchestra.run.smithi049.stdout: "process_request_cap_release": 14052 2024-01-22T05:11:37.360 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.360 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache": { 2024-01-22T05:11:37.360 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays": 1839, 2024-01-22T05:11:37.360 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_delayed": 0, 2024-01-22T05:11:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_enqueuing": 0, 2024-01-22T05:11:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_created": 4098, 2024-01-22T05:11:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_enqueued": 1838, 2024-01-22T05:11:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_reintegrated": 2188, 2024-01-22T05:11:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_migrated": 0, 2024-01-22T05:11:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_processing": 0, 2024-01-22T05:11:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_enqueued": 0, 2024-01-22T05:11:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_prioritized": 0, 2024-01-22T05:11:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_started": 0, 2024-01-22T05:11:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_completed": 0, 2024-01-22T05:11:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_enqueue_scrub": 0, 2024-01-22T05:11:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_exportdir": 0, 2024-01-22T05:11:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_flush": 0, 2024-01-22T05:11:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragmentdir": 0, 2024-01-22T05:11:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragstats": 0, 2024-01-22T05:11:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_inodestats": 0 2024-01-22T05:11:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log": { 2024-01-22T05:11:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "evadd": 24437, 2024-01-22T05:11:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "evex": 21602, 2024-01-22T05:11:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "evtrm": 20539, 2024-01-22T05:11:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "ev": 3898, 2024-01-22T05:11:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "evexg": 0, 2024-01-22T05:11:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "evexd": 1063, 2024-01-22T05:11:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "segadd": 31, 2024-01-22T05:11:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "segex": 26, 2024-01-22T05:11:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "segtrm": 24, 2024-01-22T05:11:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "seg": 7, 2024-01-22T05:11:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "segexg": 0, 2024-01-22T05:11:37.363 INFO:teuthology.orchestra.run.smithi049.stdout: "segexd": 2, 2024-01-22T05:11:37.363 INFO:teuthology.orchestra.run.smithi049.stdout: "expos": 71108576, 2024-01-22T05:11:37.363 INFO:teuthology.orchestra.run.smithi049.stdout: "wrpos": 84976607, 2024-01-22T05:11:37.363 INFO:teuthology.orchestra.run.smithi049.stdout: "rdpos": 0, 2024-01-22T05:11:37.363 INFO:teuthology.orchestra.run.smithi049.stdout: "jlat": { 2024-01-22T05:11:37.363 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 4387, 2024-01-22T05:11:37.363 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 89.006782080, 2024-01-22T05:11:37.363 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020288758 2024-01-22T05:11:37.363 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.363 INFO:teuthology.orchestra.run.smithi049.stdout: "replayed": 0 2024-01-22T05:11:37.363 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.363 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_mem": { 2024-01-22T05:11:37.363 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 2014, 2024-01-22T05:11:37.363 INFO:teuthology.orchestra.run.smithi049.stdout: "ino+": 2014, 2024-01-22T05:11:37.363 INFO:teuthology.orchestra.run.smithi049.stdout: "ino-": 0, 2024-01-22T05:11:37.364 INFO:teuthology.orchestra.run.smithi049.stdout: "dir": 13, 2024-01-22T05:11:37.364 INFO:teuthology.orchestra.run.smithi049.stdout: "dir+": 13, 2024-01-22T05:11:37.364 INFO:teuthology.orchestra.run.smithi049.stdout: "dir-": 0, 2024-01-22T05:11:37.364 INFO:teuthology.orchestra.run.smithi049.stdout: "dn": 11274, 2024-01-22T05:11:37.364 INFO:teuthology.orchestra.run.smithi049.stdout: "dn+": 19969, 2024-01-22T05:11:37.364 INFO:teuthology.orchestra.run.smithi049.stdout: "dn-": 8695, 2024-01-22T05:11:37.364 INFO:teuthology.orchestra.run.smithi049.stdout: "cap": 164, 2024-01-22T05:11:37.364 INFO:teuthology.orchestra.run.smithi049.stdout: "cap+": 8686, 2024-01-22T05:11:37.364 INFO:teuthology.orchestra.run.smithi049.stdout: "cap-": 8522, 2024-01-22T05:11:37.364 INFO:teuthology.orchestra.run.smithi049.stdout: "rss": 98032, 2024-01-22T05:11:37.364 INFO:teuthology.orchestra.run.smithi049.stdout: "heap": 340196 2024-01-22T05:11:37.364 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.364 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_server": { 2024-01-22T05:11:37.364 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_client_request": 29682, 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_server_request": 0, 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_request": 26126, 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_session": 6, 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_peer_request": 0, 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: "req_create_latency": { 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2000, 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.489826832, 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001244913 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getattr_latency": { 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.003329665, 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000416208 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getfilelock_latency": { 2024-01-22T05:11:37.365 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.366 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.366 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.366 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.366 INFO:teuthology.orchestra.run.smithi049.stdout: "req_link_latency": { 2024-01-22T05:11:37.366 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6000, 2024-01-22T05:11:37.366 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 12.605476613, 2024-01-22T05:11:37.366 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002100912 2024-01-22T05:11:37.366 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.366 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookup_latency": { 2024-01-22T05:11:37.366 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 7917, 2024-01-22T05:11:37.366 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 9.963284279, 2024-01-22T05:11:37.366 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001258467 2024-01-22T05:11:37.366 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.366 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookuphash_latency": { 2024-01-22T05:11:37.366 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.367 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.367 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.367 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.367 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupino_latency": { 2024-01-22T05:11:37.367 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.367 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.367 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.367 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.367 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupname_latency": { 2024-01-22T05:11:37.367 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.367 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.367 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.367 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.368 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupparent_latency": { 2024-01-22T05:11:37.368 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.368 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.368 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.368 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.368 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupsnap_latency": { 2024-01-22T05:11:37.368 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:11:37.368 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000219605, 2024-01-22T05:11:37.368 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000219605 2024-01-22T05:11:37.368 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.368 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lssnap_latency": { 2024-01-22T05:11:37.368 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.368 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.369 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.369 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.369 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mkdir_latency": { 2024-01-22T05:11:37.369 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:11:37.369 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.004145635, 2024-01-22T05:11:37.369 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.004145635 2024-01-22T05:11:37.369 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.369 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mknod_latency": { 2024-01-22T05:11:37.369 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.369 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.369 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.369 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.370 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mksnap_latency": { 2024-01-22T05:11:37.370 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:11:37.370 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.017391535, 2024-01-22T05:11:37.370 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.017391535 2024-01-22T05:11:37.370 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.370 INFO:teuthology.orchestra.run.smithi049.stdout: "req_open_latency": { 2024-01-22T05:11:37.370 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.370 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.370 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.370 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.370 INFO:teuthology.orchestra.run.smithi049.stdout: "req_readdir_latency": { 2024-01-22T05:11:37.370 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-01-22T05:11:37.370 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.146839348, 2024-01-22T05:11:37.371 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018354918 2024-01-22T05:11:37.371 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.371 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rename_latency": { 2024-01-22T05:11:37.371 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2188, 2024-01-22T05:11:37.371 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 273.357998708, 2024-01-22T05:11:37.371 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.124935099 2024-01-22T05:11:37.371 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.371 INFO:teuthology.orchestra.run.smithi049.stdout: "req_renamesnap_latency": { 2024-01-22T05:11:37.371 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.371 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.371 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.371 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.371 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmdir_latency": { 2024-01-22T05:11:37.372 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.372 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.372 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.372 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.372 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmsnap_latency": { 2024-01-22T05:11:37.372 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:11:37.372 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.045337119, 2024-01-22T05:11:37.372 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.045337119 2024-01-22T05:11:37.372 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.372 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmxattr_latency": { 2024-01-22T05:11:37.372 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.372 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.372 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.373 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.373 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setattr_latency": { 2024-01-22T05:11:37.373 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:11:37.373 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000482517, 2024-01-22T05:11:37.373 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000482517 2024-01-22T05:11:37.373 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.373 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setdirlayout_latency": { 2024-01-22T05:11:37.373 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.373 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.373 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.373 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.373 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setfilelock_latency": { 2024-01-22T05:11:37.373 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.374 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.374 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.374 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.374 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setlayout_latency": { 2024-01-22T05:11:37.374 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.374 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.374 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.374 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.374 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setxattr_latency": { 2024-01-22T05:11:37.374 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.374 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.374 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.374 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.374 INFO:teuthology.orchestra.run.smithi049.stdout: "req_symlink_latency": { 2024-01-22T05:11:37.375 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.375 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.375 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.375 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.375 INFO:teuthology.orchestra.run.smithi049.stdout: "req_unlink_latency": { 2024-01-22T05:11:37.375 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8000, 2024-01-22T05:11:37.375 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 20.883126787, 2024-01-22T05:11:37.375 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002610390 2024-01-22T05:11:37.375 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.375 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_revoke_eviction": 0, 2024-01-22T05:11:37.375 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_acquisition_throttle": 0, 2024-01-22T05:11:37.375 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getvxattr_latency": { 2024-01-22T05:11:37.375 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.376 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.376 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.376 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:11:37.376 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.376 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_sessions": { 2024-01-22T05:11:37.376 INFO:teuthology.orchestra.run.smithi049.stdout: "session_count": 1, 2024-01-22T05:11:37.376 INFO:teuthology.orchestra.run.smithi049.stdout: "session_add": 1, 2024-01-22T05:11:37.376 INFO:teuthology.orchestra.run.smithi049.stdout: "session_remove": 0, 2024-01-22T05:11:37.376 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_open": 1, 2024-01-22T05:11:37.376 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_stale": 0, 2024-01-22T05:11:37.376 INFO:teuthology.orchestra.run.smithi049.stdout: "total_load": 16464, 2024-01-22T05:11:37.376 INFO:teuthology.orchestra.run.smithi049.stdout: "average_load": 16464, 2024-01-22T05:11:37.376 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_session_uptime": 87, 2024-01-22T05:11:37.377 INFO:teuthology.orchestra.run.smithi049.stdout: "mdthresh_evicted": 0 2024-01-22T05:11:37.377 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.377 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-01-22T05:11:37.377 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 18763, 2024-01-22T05:11:37.377 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 18763, 2024-01-22T05:11:37.377 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-01-22T05:11:37.377 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-01-22T05:11:37.377 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-01-22T05:11:37.377 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-01-22T05:11:37.377 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-22T05:11:37.377 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-01-22T05:11:37.377 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-22T05:11:37.377 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-01-22T05:11:37.378 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-01-22T05:11:37.378 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-01-22T05:11:37.378 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Buffer_bytes": 0, 2024-01-22T05:11:37.378 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Buffer_items": 0, 2024-01-22T05:11:37.378 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Extent_bytes": 0, 2024-01-22T05:11:37.378 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Extent_items": 0, 2024-01-22T05:11:37.378 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Blob_bytes": 0, 2024-01-22T05:11:37.378 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Blob_items": 0, 2024-01-22T05:11:37.378 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_SharedBlob_bytes": 0, 2024-01-22T05:11:37.378 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_SharedBlob_items": 0, 2024-01-22T05:11:37.378 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-22T05:11:37.378 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-01-22T05:11:37.378 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-01-22T05:11:37.378 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-01-22T05:11:37.378 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 9494703, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 2422, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 88, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 1, 2024-01-22T05:11:37.379 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-01-22T05:11:37.380 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-01-22T05:11:37.380 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-01-22T05:11:37.380 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-01-22T05:11:37.380 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-01-22T05:11:37.380 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-01-22T05:11:37.380 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 6408, 2024-01-22T05:11:37.380 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 83, 2024-01-22T05:11:37.380 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-01-22T05:11:37.380 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-01-22T05:11:37.380 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-01-22T05:11:37.380 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-01-22T05:11:37.380 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 14099982, 2024-01-22T05:11:37.380 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 512700, 2024-01-22T05:11:37.380 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-01-22T05:11:37.380 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-01-22T05:11:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-01-22T05:11:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-01-22T05:11:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": { 2024-01-22T05:11:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-01-22T05:11:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-01-22T05:11:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 10853, 2024-01-22T05:11:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 91501161, 2024-01-22T05:11:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 37, 2024-01-22T05:11:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 10853, 2024-01-22T05:11:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-01-22T05:11:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 10853, 2024-01-22T05:11:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 19559 2024-01-22T05:11:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.382 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 10853, 2024-01-22T05:11:37.382 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 72, 2024-01-22T05:11:37.382 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 10781, 2024-01-22T05:11:37.382 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-01-22T05:11:37.382 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-01-22T05:11:37.382 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 47, 2024-01-22T05:11:37.382 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 4274, 2024-01-22T05:11:37.382 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 72, 2024-01-22T05:11:37.382 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 4459, 2024-01-22T05:11:37.382 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 67, 2024-01-22T05:11:37.382 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-01-22T05:11:37.382 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-01-22T05:11:37.382 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 1677, 2024-01-22T05:11:37.382 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-01-22T05:11:37.382 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 207, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 8548, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-01-22T05:11:37.383 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-01-22T05:11:37.384 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-01-22T05:11:37.384 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-01-22T05:11:37.384 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-01-22T05:11:37.384 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-01-22T05:11:37.384 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-01-22T05:11:37.384 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-01-22T05:11:37.384 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-01-22T05:11:37.384 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-01-22T05:11:37.384 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-01-22T05:11:37.384 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-01-22T05:11:37.384 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-01-22T05:11:37.384 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-01-22T05:11:37.384 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-01-22T05:11:37.384 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-01-22T05:11:37.384 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-01-22T05:11:37.385 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 90, 2024-01-22T05:11:37.385 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-01-22T05:11:37.385 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 3, 2024-01-22T05:11:37.385 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 8, 2024-01-22T05:11:37.385 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 8, 2024-01-22T05:11:37.385 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-01-22T05:11:37.385 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-01-22T05:11:37.385 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 171, 2024-01-22T05:11:37.385 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-01-22T05:11:37.385 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 37 2024-01-22T05:11:37.385 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.385 INFO:teuthology.orchestra.run.smithi049.stdout: "oft": { 2024-01-22T05:11:37.385 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_objs": 1, 2024-01-22T05:11:37.385 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_kv_pairs": 0, 2024-01-22T05:11:37.385 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_updates": 0, 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_removes": 0 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: "purge_queue": { 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops": 0, 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops_high_water": 32, 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing": 0, 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_high_water": 32, 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed": 1838, 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_item_in_journal": 0 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 38613, 2024-01-22T05:11:37.386 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 9828821, 2024-01-22T05:11:37.387 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:11:37.387 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 38613, 2024-01-22T05:11:37.387 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-01-22T05:11:37.387 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-01-22T05:11:37.387 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 38613, 2024-01-22T05:11:37.387 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 9828821, 2024-01-22T05:11:37.387 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:11:37.387 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.387 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.387 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.387 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:11:37.387 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.387 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": { 2024-01-22T05:11:37.387 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:11:37.388 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-01-22T05:11:37.388 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:11:37.388 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-01-22T05:11:37.388 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-01-22T05:11:37.388 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:11:37.388 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-01-22T05:11:37.388 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 10853, 2024-01-22T05:11:37.388 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 91700215, 2024-01-22T05:11:37.388 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 10853, 2024-01-22T05:11:37.388 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 91700215, 2024-01-22T05:11:37.388 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:11:37.388 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.388 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": { 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 10853, 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 10853, 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 10853, 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 10853, 2024-01-22T05:11:37.389 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:11:37.390 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.390 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.390 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.390 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:11:37.390 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.390 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle": { 2024-01-22T05:11:37.390 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:11:37.390 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-01-22T05:11:37.390 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:11:37.390 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 1838, 2024-01-22T05:11:37.390 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 199054, 2024-01-22T05:11:37.390 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:11:37.390 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 1838, 2024-01-22T05:11:37.390 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-01-22T05:11:37.391 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-01-22T05:11:37.391 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 72, 2024-01-22T05:11:37.391 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 199054, 2024-01-22T05:11:37.391 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:11:37.391 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.391 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.391 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.391 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:11:37.391 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:11:37.391 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle-0x55c762274280": { 2024-01-22T05:11:37.391 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 97360, 2024-01-22T05:11:37.391 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-01-22T05:11:37.391 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:11:37.391 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 24437, 2024-01-22T05:11:37.391 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 80782303, 2024-01-22T05:11:37.392 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:11:37.392 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 24437, 2024-01-22T05:11:37.392 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-01-22T05:11:37.392 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-01-22T05:11:37.392 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 4387, 2024-01-22T05:11:37.392 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 80684943, 2024-01-22T05:11:37.392 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:11:37.392 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:11:37.392 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:11:37.392 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:11:37.392 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:11:37.392 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:11:37.392 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:11:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.347+0000 7fa42fa00700 1 -- 172.21.15.49:0/3635685095 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa40005a510 msgr2=0x7fa40005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.347+0000 7fa42fa00700 1 --2- 172.21.15.49:0/3635685095 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa40005a510 0x7fa40005c9d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fa418009130 tx=0x7fa418017000).stop 2024-01-22T05:11:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.347+0000 7fa42fa00700 1 -- 172.21.15.49:0/3635685095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4281576e0 msgr2=0x7fa4280ac750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.347+0000 7fa42fa00700 1 --2- 172.21.15.49:0/3635685095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4281576e0 0x7fa4280ac750 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fa42000c7c0 tx=0x7fa420001510).stop 2024-01-22T05:11:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.347+0000 7fa42fa00700 1 -- 172.21.15.49:0/3635685095 shutdown_connections 2024-01-22T05:11:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.347+0000 7fa42fa00700 1 --2- 172.21.15.49:0/3635685095 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa40005a510 0x7fa40005c9d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.347+0000 7fa42fa00700 1 --2- 172.21.15.49:0/3635685095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4281576e0 0x7fa4280ac750 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.347+0000 7fa42fa00700 1 --2- 172.21.15.49:0/3635685095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa428068b90 0x7fa42816b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.347+0000 7fa42fa00700 1 --2- 172.21.15.49:0/3635685095 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa428063e30 0x7fa428168b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.347+0000 7fa42fa00700 1 -- 172.21.15.49:0/3635685095 >> 172.21.15.49:0/3635685095 conn(0x7fa4280c40f0 msgr2=0x7fa428138170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.347+0000 7fa42fa00700 1 -- 172.21.15.49:0/3635685095 shutdown_connections 2024-01-22T05:11:37.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.347+0000 7fa42fa00700 1 -- 172.21.15.49:0/3635685095 wait complete. 2024-01-22T05:11:37.395 INFO:tasks.cephfs.test_scrub_checks:num of strays: 1839 2024-01-22T05:11:37.395 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start '~mdsdir' recursive 2024-01-22T05:11:37.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.583+0000 7faf15c00700 1 Processor -- start 2024-01-22T05:11:37.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.587+0000 7faf15c00700 1 -- start start 2024-01-22T05:11:37.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf15c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faf10062230 0x7faf100c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf15c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf100a6420 0x7faf101540b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf15c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf100632d0 con 0x7faf100a58d0 2024-01-22T05:11:37.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf15c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf100626c0 con 0x7faf100a6420 2024-01-22T05:11:37.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf15c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf100629a0 con 0x7faf10062230 2024-01-22T05:11:37.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf0f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf100a6420 0x7faf101540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf0f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faf100a6420 0x7faf101540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59104/0 (socket says 172.21.15.49:59104) 2024-01-22T05:11:37.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf0f400700 1 -- 172.21.15.49:0/2449871340 learned_addr learned my addr 172.21.15.49:0/2449871340 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf0ea00700 1 --2- 172.21.15.49:0/2449871340 >> v2:172.21.15.110:3300/0 conn(0x7faf10062230 0x7faf100c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf0f400700 1 -- 172.21.15.49:0/2449871340 >> v2:172.21.15.110:3300/0 conn(0x7faf10062230 msgr2=0x7faf100c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf0f400700 1 --2- 172.21.15.49:0/2449871340 >> v2:172.21.15.110:3300/0 conn(0x7faf10062230 0x7faf100c1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf0f400700 1 -- 172.21.15.49:0/2449871340 >> v1:172.21.15.49:6789/0 conn(0x7faf100a58d0 legacy=0x7faf100a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf0f400700 1 -- 172.21.15.49:0/2449871340 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf10062c80 con 0x7faf100a6420 2024-01-22T05:11:37.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf0ea00700 1 --2- 172.21.15.49:0/2449871340 >> v2:172.21.15.110:3300/0 conn(0x7faf10062230 0x7faf100c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:11:37.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf0f400700 1 --2- 172.21.15.49:0/2449871340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf100a6420 0x7faf101540b0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7faf10065bd0 tx=0x7faf08009840).ready entity=mon.0 client_cookie=1f88308fce381b9f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf0d600700 1 -- 172.21.15.49:0/2449871340 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800e070 con 0x7faf100a6420 2024-01-22T05:11:37.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf0d600700 1 -- 172.21.15.49:0/2449871340 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0800ba50 con 0x7faf100a6420 2024-01-22T05:11:37.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf0d600700 1 -- 172.21.15.49:0/2449871340 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800bdd0 con 0x7faf100a6420 2024-01-22T05:11:37.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf15c00700 1 -- 172.21.15.49:0/2449871340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf100a6420 msgr2=0x7faf101540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.591+0000 7faf15c00700 1 --2- 172.21.15.49:0/2449871340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf100a6420 0x7faf101540b0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7faf10065bd0 tx=0x7faf08009840).stop 2024-01-22T05:11:37.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.595+0000 7faf15c00700 1 -- 172.21.15.49:0/2449871340 shutdown_connections 2024-01-22T05:11:37.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.595+0000 7faf15c00700 1 --2- 172.21.15.49:0/2449871340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf100a6420 0x7faf101540b0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.595+0000 7faf15c00700 1 --2- 172.21.15.49:0/2449871340 >> v2:172.21.15.110:3300/0 conn(0x7faf10062230 0x7faf100c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.595+0000 7faf15c00700 1 -- 172.21.15.49:0/2449871340 >> 172.21.15.49:0/2449871340 conn(0x7faf100c3830 msgr2=0x7faf100c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.595+0000 7faf15c00700 1 -- 172.21.15.49:0/2449871340 shutdown_connections 2024-01-22T05:11:37.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.595+0000 7faf15c00700 1 -- 172.21.15.49:0/2449871340 wait complete. 2024-01-22T05:11:37.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.599+0000 7faf15c00700 1 Processor -- start 2024-01-22T05:11:37.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.599+0000 7faf15c00700 1 -- start start 2024-01-22T05:11:37.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.599+0000 7faf15c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf100a58d0 0x7faf100a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.599+0000 7faf15c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf100a6420 0x7faf10151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.599+0000 7faf15c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf1014a8a0 0x7faf10164590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.599+0000 7faf15c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf10152690 con 0x7faf100a6420 2024-01-22T05:11:37.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.599+0000 7faf15c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf10152970 con 0x7faf100a58d0 2024-01-22T05:11:37.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.599+0000 7faf15c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf10152c50 con 0x7faf1014a8a0 2024-01-22T05:11:37.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf0e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf100a6420 0x7faf10151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf0e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf100a6420 0x7faf10151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59112/0 (socket says 172.21.15.49:59112) 2024-01-22T05:11:37.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf0e000700 1 -- 172.21.15.49:0/2474406299 learned_addr learned my addr 172.21.15.49:0/2474406299 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf0f400700 1 --2- 172.21.15.49:0/2474406299 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf1014a8a0 0x7faf10164590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf0ea00700 1 --2- 172.21.15.49:0/2474406299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf100a58d0 0x7faf100a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf0e000700 1 -- 172.21.15.49:0/2474406299 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf1014a8a0 msgr2=0x7faf10164590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf0e000700 1 --2- 172.21.15.49:0/2474406299 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf1014a8a0 0x7faf10164590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf0e000700 1 -- 172.21.15.49:0/2474406299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf100a58d0 msgr2=0x7faf100a92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf0e000700 1 --2- 172.21.15.49:0/2474406299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf100a58d0 0x7faf100a92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf0e000700 1 -- 172.21.15.49:0/2474406299 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf08009ae0 con 0x7faf100a6420 2024-01-22T05:11:37.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf0e000700 1 --2- 172.21.15.49:0/2474406299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf100a6420 0x7faf10151e40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7faef800c4c0 tx=0x7faef8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf06000700 1 -- 172.21.15.49:0/2474406299 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef800ce70 con 0x7faf100a6420 2024-01-22T05:11:37.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf06000700 1 -- 172.21.15.49:0/2474406299 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef8001e90 con 0x7faf100a6420 2024-01-22T05:11:37.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf15c00700 1 -- 172.21.15.49:0/2474406299 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf10152f30 con 0x7faf100a6420 2024-01-22T05:11:37.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf06000700 1 -- 172.21.15.49:0/2474406299 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8007250 con 0x7faf100a6420 2024-01-22T05:11:37.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.603+0000 7faf15c00700 1 -- 172.21.15.49:0/2474406299 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf10152330 con 0x7faf100a6420 2024-01-22T05:11:37.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.607+0000 7faf06000700 1 -- 172.21.15.49:0/2474406299 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7faef80066a0 con 0x7faf100a6420 2024-01-22T05:11:37.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.607+0000 7faf06000700 1 --2- 172.21.15.49:0/2474406299 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faee805a540 0x7faee805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.607+0000 7faf06000700 1 -- 172.21.15.49:0/2474406299 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faef80742a0 con 0x7faf100a6420 2024-01-22T05:11:37.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.607+0000 7faf0ea00700 1 --2- 172.21.15.49:0/2474406299 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faee805a540 0x7faee805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.607+0000 7faf1ffee740 1 Processor -- start 2024-01-22T05:11:37.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf0ea00700 1 --2- 172.21.15.49:0/2474406299 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faee805a540 0x7faee805ca00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7faf0000abd0 tx=0x7faf00008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf1ffee740 1 -- start start 2024-01-22T05:11:37.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf1ffee740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xd11430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf1ffee740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xce5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf1ffee740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xce8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf1ffee740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xc26160 con 0xd11aa0 2024-01-22T05:11:37.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf1ffee740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xc26400 con 0xd2d1d0 2024-01-22T05:11:37.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf1ffee740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xc12e00 con 0xd2cdf0 2024-01-22T05:11:37.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf0e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xce5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf0e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xce5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59116/0 (socket says 172.21.15.49:59116) 2024-01-22T05:11:37.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf0e000700 1 -- 172.21.15.49:0/2189829324 learned_addr learned my addr 172.21.15.49:0/2189829324 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf0ea00700 1 --2- 172.21.15.49:0/2189829324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xd11430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf0f400700 1 --2- 172.21.15.49:0/2189829324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xce8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf0e000700 1 -- 172.21.15.49:0/2189829324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 msgr2=0xd11430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf0e000700 1 --2- 172.21.15.49:0/2189829324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xd11430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf0e000700 1 -- 172.21.15.49:0/2189829324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 msgr2=0xce8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf0e000700 1 --2- 172.21.15.49:0/2189829324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xce8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf0e000700 1 -- 172.21.15.49:0/2189829324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc668e0 con 0xd11aa0 2024-01-22T05:11:37.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf0f400700 1 --2- 172.21.15.49:0/2189829324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xce8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:11:37.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faf0e000700 1 --2- 172.21.15.49:0/2189829324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xce5f10 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7faef80076c0 tx=0x7faef800f000).ready entity=mon.0 client_cookie=dd2ff5c67aa51240 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faefea00700 1 -- 172.21.15.49:0/2189829324 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef804b480 con 0xd11aa0 2024-01-22T05:11:37.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faefea00700 1 -- 172.21.15.49:0/2189829324 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef8049880 con 0xd11aa0 2024-01-22T05:11:37.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.611+0000 7faefea00700 1 -- 172.21.15.49:0/2189829324 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8047bf0 con 0xd11aa0 2024-01-22T05:11:37.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.615+0000 7faf1ffee740 1 -- 172.21.15.49:0/2189829324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 msgr2=0xce5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.615+0000 7faf1ffee740 1 --2- 172.21.15.49:0/2189829324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xce5f10 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7faef80076c0 tx=0x7faef800f000).stop 2024-01-22T05:11:37.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.615+0000 7faf1ffee740 1 -- 172.21.15.49:0/2189829324 shutdown_connections 2024-01-22T05:11:37.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.615+0000 7faf1ffee740 1 --2- 172.21.15.49:0/2189829324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xce8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.615+0000 7faf1ffee740 1 --2- 172.21.15.49:0/2189829324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xce5f10 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.615+0000 7faf1ffee740 1 --2- 172.21.15.49:0/2189829324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xd11430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.615+0000 7faf1ffee740 1 -- 172.21.15.49:0/2189829324 >> 172.21.15.49:0/2189829324 conn(0xacb7c0 msgr2=0xcebde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.615+0000 7faf1ffee740 1 -- 172.21.15.49:0/2189829324 shutdown_connections 2024-01-22T05:11:37.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.615+0000 7faf1ffee740 1 -- 172.21.15.49:0/2189829324 wait complete. 2024-01-22T05:11:37.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.615+0000 7faf1ffee740 1 -- start start 2024-01-22T05:11:37.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.615+0000 7faf1ffee740 1 Processor -- start 2024-01-22T05:11:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf1ffee740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xd2f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf1ffee740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xd17d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf1ffee740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xd0f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf1ffee740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xd300c0 con 0xd11aa0 2024-01-22T05:11:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf1ffee740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xd15580 con 0xd2d1d0 2024-01-22T05:11:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf1ffee740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xd15860 con 0xd2cdf0 2024-01-22T05:11:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf1ffee740 10 client.0 ll_register_callbacks cb 0xca2fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:11:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf0ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xd2f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf0ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xd2f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59126/0 (socket says 172.21.15.49:59126) 2024-01-22T05:11:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf0ea00700 1 -- 172.21.15.49:0/3391031248 learned_addr learned my addr 172.21.15.49:0/3391031248 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf0f400700 1 --2- 172.21.15.49:0/3391031248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xd0f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf0e000700 1 --2- 172.21.15.49:0/3391031248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xd17d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf0ea00700 1 -- 172.21.15.49:0/3391031248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 msgr2=0xd17d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf0ea00700 1 --2- 172.21.15.49:0/3391031248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xd17d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf0ea00700 1 -- 172.21.15.49:0/3391031248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 msgr2=0xd0f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf0ea00700 1 --2- 172.21.15.49:0/3391031248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xd0f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf0ea00700 1 -- 172.21.15.49:0/3391031248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf10152330 con 0xd11aa0 2024-01-22T05:11:37.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf0e000700 1 --2- 172.21.15.49:0/3391031248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xd17d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:11:37.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf0f400700 1 --2- 172.21.15.49:0/3391031248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xd0f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:11:37.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf0ea00700 1 --2- 172.21.15.49:0/3391031248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xd2f830 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7faf00013850 tx=0x7faf00015000).ready entity=mon.0 client_cookie=a55dad52bcc80829 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faef7400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:11:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faef7400700 1 -- 172.21.15.49:0/3391031248 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0001f690 con 0xd11aa0 2024-01-22T05:11:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faef7400700 1 -- 172.21.15.49:0/3391031248 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faf00018040 con 0xd11aa0 2024-01-22T05:11:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf1ffee740 1 -- 172.21.15.49:0/3391031248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xc63350 con 0xd11aa0 2024-01-22T05:11:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faef7400700 1 -- 172.21.15.49:0/3391031248 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf0001fa00 con 0xd11aa0 2024-01-22T05:11:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf1ffee740 10 client.7059 fetch_fsmap learned FSMap version 80 2024-01-22T05:11:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faf1ffee740 1 -- 172.21.15.49:0/3391031248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0xc61b10 con 0xd11aa0 2024-01-22T05:11:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.619+0000 7faef7400700 1 -- 172.21.15.49:0/3391031248 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xc63350 con 0xd11aa0 2024-01-22T05:11:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faef7400700 1 -- 172.21.15.49:0/3391031248 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 80) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faf0001fb60 con 0xd11aa0 2024-01-22T05:11:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf1ffee740 10 client.7059 fetch_fsmap finished waiting for FSMap version 80 2024-01-22T05:11:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf1ffee740 10 client.7059 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-01-22T05:11:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf1ffee740 20 client.7059 populate_metadata read hostname 'smithi049' 2024-01-22T05:11:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf1ffee740 1 --2- 172.21.15.49:0/3391031248 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0xd16290 0xd16670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf1ffee740 4 client.7059 mds_command: new command op to 6846 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:11:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf1ffee740 1 -- 172.21.15.49:0/3391031248 --> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xc598a0 con 0xd16290 2024-01-22T05:11:37.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf0e000700 1 --2- 172.21.15.49:0/3391031248 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0xd16290 0xd16670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf0e000700 1 --2- 172.21.15.49:0/3391031248 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0xd16290 0xd16670 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a265f1151bd822d7 server_cookie=c1eaecd8c51e977b in_seq=0 out_seq=0 2024-01-22T05:11:37.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faef7400700 10 client.7059 ms_handle_connect on v2:172.21.15.110:6832/1072346524 2024-01-22T05:11:37.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faef7400700 1 -- 172.21.15.49:0/3391031248 <== mds.0 v2:172.21.15.110:6832/1072346524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xc598a0 con 0xd16290 2024-01-22T05:11:37.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faef7400700 10 client.7059 handle_command_reply: tid=0 2024-01-22T05:11:37.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf1ffee740 1 client.7059 shutdown 2024-01-22T05:11:37.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf1ffee740 1 -- 172.21.15.49:0/3391031248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 msgr2=0xd2f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf1ffee740 1 --2- 172.21.15.49:0/3391031248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xd2f830 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7faf00013850 tx=0x7faf00015000).stop 2024-01-22T05:11:37.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf1ffee740 1 -- 172.21.15.49:0/3391031248 shutdown_connections 2024-01-22T05:11:37.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf1ffee740 1 --2- 172.21.15.49:0/3391031248 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0xd16290 0xd16670 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf1ffee740 1 --2- 172.21.15.49:0/3391031248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xd0f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf1ffee740 1 --2- 172.21.15.49:0/3391031248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xd17d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faef7400700 0 client.7059 ms_handle_reset on v2:172.21.15.110:6832/1072346524 2024-01-22T05:11:37.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf1ffee740 1 --2- 172.21.15.49:0/3391031248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xd2f830 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.623+0000 7faf1ffee740 1 -- 172.21.15.49:0/3391031248 >> 172.21.15.49:0/3391031248 conn(0xacb7c0 msgr2=0xd10430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.627+0000 7faf1ffee740 1 -- 172.21.15.49:0/3391031248 shutdown_connections 2024-01-22T05:11:37.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.627+0000 7faf1ffee740 1 -- 172.21.15.49:0/3391031248 wait complete. 2024-01-22T05:11:37.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.627+0000 7faf1ffee740 20 client.7059 trim_cache size 0 max 16384 2024-01-22T05:11:37.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.647+0000 7faf1ffee740 1 Processor -- start 2024-01-22T05:11:37.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.647+0000 7faf1ffee740 1 -- start start 2024-01-22T05:11:37.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf1ffee740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xce5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf1ffee740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xce4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf1ffee740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xce4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf1ffee740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xcaede0 con 0xd11aa0 2024-01-22T05:11:37.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf1ffee740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xd159a0 con 0xd2d1d0 2024-01-22T05:11:37.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf1ffee740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xd15f60 con 0xd2cdf0 2024-01-22T05:11:37.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf0ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xce5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf0ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xce5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59132/0 (socket says 172.21.15.49:59132) 2024-01-22T05:11:37.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf0ea00700 1 -- 172.21.15.49:0/1494743837 learned_addr learned my addr 172.21.15.49:0/1494743837 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf0f400700 1 --2- 172.21.15.49:0/1494743837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xce4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf0e000700 1 --2- 172.21.15.49:0/1494743837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xce4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf0ea00700 1 -- 172.21.15.49:0/1494743837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 msgr2=0xce4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf0ea00700 1 --2- 172.21.15.49:0/1494743837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xce4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf0ea00700 1 -- 172.21.15.49:0/1494743837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 msgr2=0xce4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf0ea00700 1 --2- 172.21.15.49:0/1494743837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xce4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf0ea00700 1 -- 172.21.15.49:0/1494743837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd169d0 con 0xd11aa0 2024-01-22T05:11:37.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf0ea00700 1 --2- 172.21.15.49:0/1494743837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xce5fc0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7faf00006ec0 tx=0x7faf00022000).ready entity=mon.0 client_cookie=e1076d825932e689 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faeff400700 1 -- 172.21.15.49:0/1494743837 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00013cc0 con 0xd11aa0 2024-01-22T05:11:37.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faeff400700 1 -- 172.21.15.49:0/1494743837 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0000c040 con 0xd11aa0 2024-01-22T05:11:37.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faeff400700 1 -- 172.21.15.49:0/1494743837 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0001fa00 con 0xd11aa0 2024-01-22T05:11:37.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf1ffee740 1 -- 172.21.15.49:0/1494743837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 msgr2=0xce5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.651+0000 7faf1ffee740 1 --2- 172.21.15.49:0/1494743837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xce5fc0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7faf00006ec0 tx=0x7faf00022000).stop 2024-01-22T05:11:37.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.655+0000 7faf1ffee740 1 -- 172.21.15.49:0/1494743837 shutdown_connections 2024-01-22T05:11:37.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.655+0000 7faf1ffee740 1 --2- 172.21.15.49:0/1494743837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xce4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.655+0000 7faf1ffee740 1 --2- 172.21.15.49:0/1494743837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xce4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.655+0000 7faf1ffee740 1 --2- 172.21.15.49:0/1494743837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xce5fc0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.655+0000 7faf1ffee740 1 -- 172.21.15.49:0/1494743837 >> 172.21.15.49:0/1494743837 conn(0xacb7c0 msgr2=0xd16df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.655+0000 7faf1ffee740 1 -- 172.21.15.49:0/1494743837 shutdown_connections 2024-01-22T05:11:37.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.655+0000 7faf1ffee740 1 -- 172.21.15.49:0/1494743837 wait complete. 2024-01-22T05:11:37.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.655+0000 7faf1ffee740 1 -- start start 2024-01-22T05:11:37.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.655+0000 7faf1ffee740 1 Processor -- start 2024-01-22T05:11:37.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xd8f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xd3d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xd3d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xd8f620 con 0xd11aa0 2024-01-22T05:11:37.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xd4fd50 con 0xd2d1d0 2024-01-22T05:11:37.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xd17e90 con 0xd2cdf0 2024-01-22T05:11:37.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 10 client.0 ll_register_callbacks cb 0x7faf0000ff70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:11:37.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf0ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xd8f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf0ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xd8f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59148/0 (socket says 172.21.15.49:59148) 2024-01-22T05:11:37.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf0ea00700 1 -- 172.21.15.49:0/4293618696 learned_addr learned my addr 172.21.15.49:0/4293618696 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf0e000700 1 --2- 172.21.15.49:0/4293618696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xd3d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf0f400700 1 --2- 172.21.15.49:0/4293618696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xd3d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf0ea00700 1 -- 172.21.15.49:0/4293618696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 msgr2=0xd3d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf0ea00700 1 --2- 172.21.15.49:0/4293618696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xd3d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf0ea00700 1 -- 172.21.15.49:0/4293618696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 msgr2=0xd3d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf0ea00700 1 --2- 172.21.15.49:0/4293618696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xd3d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf0ea00700 1 -- 172.21.15.49:0/4293618696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xc61b10 con 0xd11aa0 2024-01-22T05:11:37.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf0ea00700 1 --2- 172.21.15.49:0/4293618696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xd8f130 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7faf0000f5d0 tx=0x7faf00032000).ready entity=mon.0 client_cookie=3585a1c9da6bdc97 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faef7400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:11:37.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faef7400700 1 -- 172.21.15.49:0/4293618696 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00013cc0 con 0xd11aa0 2024-01-22T05:11:37.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faef7400700 1 -- 172.21.15.49:0/4293618696 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faf0001fa00 con 0xd11aa0 2024-01-22T05:11:37.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 1 -- 172.21.15.49:0/4293618696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faef8049880 con 0xd11aa0 2024-01-22T05:11:37.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faef7400700 1 -- 172.21.15.49:0/4293618696 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf00042450 con 0xd11aa0 2024-01-22T05:11:37.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 10 client.7065 fetch_fsmap learned FSMap version 80 2024-01-22T05:11:37.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 1 -- 172.21.15.49:0/4293618696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x7faf100bcc30 con 0xd11aa0 2024-01-22T05:11:37.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faef7400700 1 -- 172.21.15.49:0/4293618696 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef8049880 con 0xd11aa0 2024-01-22T05:11:37.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faef7400700 1 -- 172.21.15.49:0/4293618696 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 80) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faf00037020 con 0xd11aa0 2024-01-22T05:11:37.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 10 client.7065 fetch_fsmap finished waiting for FSMap version 80 2024-01-22T05:11:37.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 10 client.7065 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-01-22T05:11:37.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 20 client.7065 populate_metadata read hostname 'smithi049' 2024-01-22T05:11:37.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 1 --2- 172.21.15.49:0/4293618696 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0xd3dba0 0xce4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 4 client.7065 mds_command: new command op to 6846 tid=0[{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-01-22T05:11:37.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.659+0000 7faf1ffee740 1 -- 172.21.15.49:0/4293618696 --> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) v1 -- 0xb22750 con 0xd3dba0 2024-01-22T05:11:37.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.663+0000 7faf0e000700 1 --2- 172.21.15.49:0/4293618696 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0xd3dba0 0xce4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.663+0000 7faf0e000700 1 --2- 172.21.15.49:0/4293618696 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0xd3dba0 0xce4340 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d9faa808c6749daf server_cookie=7c543ebf8c77e9a1 in_seq=0 out_seq=0 2024-01-22T05:11:37.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.663+0000 7faef7400700 10 client.7065 ms_handle_connect on v2:172.21.15.110:6832/1072346524 2024-01-22T05:11:37.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.679+0000 7faef7400700 1 -- 172.21.15.49:0/4293618696 <== mds.0 v2:172.21.15.110:6832/1072346524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0xb22750 con 0xd3dba0 2024-01-22T05:11:37.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.679+0000 7faef7400700 10 client.7065 handle_command_reply: tid=0 2024-01-22T05:11:37.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.679+0000 7faf1ffee740 1 client.7065 shutdown 2024-01-22T05:11:37.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.679+0000 7faf1ffee740 1 -- 172.21.15.49:0/4293618696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 msgr2=0xd8f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.679+0000 7faf1ffee740 1 --2- 172.21.15.49:0/4293618696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xd8f130 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7faf0000f5d0 tx=0x7faf00032000).stop 2024-01-22T05:11:37.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.679+0000 7faf1ffee740 1 -- 172.21.15.49:0/4293618696 shutdown_connections 2024-01-22T05:11:37.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.679+0000 7faf1ffee740 1 --2- 172.21.15.49:0/4293618696 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0xd3dba0 0xce4340 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.679+0000 7faf1ffee740 1 --2- 172.21.15.49:0/4293618696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd2d1d0 0xd3d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.679+0000 7faf1ffee740 1 --2- 172.21.15.49:0/4293618696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd2cdf0 0xd3d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.679+0000 7faf1ffee740 1 --2- 172.21.15.49:0/4293618696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd11aa0 0xd8f130 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.679+0000 7faf1ffee740 1 -- 172.21.15.49:0/4293618696 >> 172.21.15.49:0/4293618696 conn(0xacb7c0 msgr2=0xd16df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.679+0000 7faef7400700 0 client.7065 ms_handle_reset on v2:172.21.15.110:6832/1072346524 2024-01-22T05:11:37.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.683+0000 7faf1ffee740 1 -- 172.21.15.49:0/4293618696 shutdown_connections 2024-01-22T05:11:37.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.683+0000 7faf1ffee740 1 -- 172.21.15.49:0/4293618696 wait complete. 2024-01-22T05:11:37.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.683+0000 7faf1ffee740 20 client.7065 trim_cache size 0 max 16384 2024-01-22T05:11:37.687 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:11:37.687 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:11:37.687 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "6be10a45-95b4-48c4-b52d-60108038dc49", 2024-01-22T05:11:37.687 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:11:37.687 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:11:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.683+0000 7faf15c00700 1 -- 172.21.15.49:0/2474406299 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faee805a540 msgr2=0x7faee805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.683+0000 7faf15c00700 1 --2- 172.21.15.49:0/2474406299 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faee805a540 0x7faee805ca00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7faf0000abd0 tx=0x7faf00008040).stop 2024-01-22T05:11:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.683+0000 7faf15c00700 1 -- 172.21.15.49:0/2474406299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf100a6420 msgr2=0x7faf10151e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.683+0000 7faf15c00700 1 --2- 172.21.15.49:0/2474406299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf100a6420 0x7faf10151e40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7faef800c4c0 tx=0x7faef8007e00).stop 2024-01-22T05:11:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.683+0000 7faf15c00700 1 -- 172.21.15.49:0/2474406299 shutdown_connections 2024-01-22T05:11:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.683+0000 7faf15c00700 1 --2- 172.21.15.49:0/2474406299 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faee805a540 0x7faee805ca00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.683+0000 7faf15c00700 1 --2- 172.21.15.49:0/2474406299 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf1014a8a0 0x7faf10164590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.683+0000 7faf15c00700 1 --2- 172.21.15.49:0/2474406299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf100a6420 0x7faf10151e40 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.683+0000 7faf15c00700 1 --2- 172.21.15.49:0/2474406299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf100a58d0 0x7faf100a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.683+0000 7faf15c00700 1 -- 172.21.15.49:0/2474406299 >> 172.21.15.49:0/2474406299 conn(0x7faf100c3830 msgr2=0x7faf100688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.687+0000 7faf15c00700 1 -- 172.21.15.49:0/2474406299 shutdown_connections 2024-01-22T05:11:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.687+0000 7faf15c00700 1 -- 172.21.15.49:0/2474406299 wait complete. 2024-01-22T05:11:37.713 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub status 2024-01-22T05:11:37.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.899+0000 7eff8ba00700 1 Processor -- start 2024-01-22T05:11:37.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.899+0000 7eff8ba00700 1 -- start start 2024-01-22T05:11:37.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff8ba00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7eff84150d20 0x7eff84069e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff8ba00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff84152240 0x7eff84063e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff8ba00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff84068ba0 con 0x7eff841526b0 2024-01-22T05:11:37.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff8ba00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff84151490 con 0x7eff84152240 2024-01-22T05:11:37.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff8ba00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff84151770 con 0x7eff84150d20 2024-01-22T05:11:37.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff83e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff84152240 0x7eff84063e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff83e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff84152240 0x7eff84063e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59158/0 (socket says 172.21.15.49:59158) 2024-01-22T05:11:37.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff83e00700 1 -- 172.21.15.49:0/2933263619 learned_addr learned my addr 172.21.15.49:0/2933263619 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff89000700 1 --2- 172.21.15.49:0/2933263619 >> v2:172.21.15.110:3300/0 conn(0x7eff84150d20 0x7eff84069e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff83e00700 1 -- 172.21.15.49:0/2933263619 >> v2:172.21.15.110:3300/0 conn(0x7eff84150d20 msgr2=0x7eff84069e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff83e00700 1 --2- 172.21.15.49:0/2933263619 >> v2:172.21.15.110:3300/0 conn(0x7eff84150d20 0x7eff84069e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff83e00700 1 -- 172.21.15.49:0/2933263619 >> v1:172.21.15.110:6789/0 conn(0x7eff841526b0 legacy=0x7eff840690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff83e00700 1 -- 172.21.15.49:0/2933263619 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff84151a50 con 0x7eff84152240 2024-01-22T05:11:37.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff83e00700 1 --2- 172.21.15.49:0/2933263619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff84152240 0x7eff84063e80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7eff84065950 tx=0x7eff6c0090f0).ready entity=mon.0 client_cookie=c40de45d47e2f379 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff83400700 1 -- 172.21.15.49:0/2933263619 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c00b520 con 0x7eff84152240 2024-01-22T05:11:37.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff83400700 1 -- 172.21.15.49:0/2933263619 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c00b680 con 0x7eff84152240 2024-01-22T05:11:37.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff83400700 1 -- 172.21.15.49:0/2933263619 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c00ba00 con 0x7eff84152240 2024-01-22T05:11:37.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff8ba00700 1 -- 172.21.15.49:0/2933263619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff84152240 msgr2=0x7eff84063e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.903+0000 7eff8ba00700 1 --2- 172.21.15.49:0/2933263619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff84152240 0x7eff84063e80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7eff84065950 tx=0x7eff6c0090f0).stop 2024-01-22T05:11:37.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.907+0000 7eff8ba00700 1 -- 172.21.15.49:0/2933263619 shutdown_connections 2024-01-22T05:11:37.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.907+0000 7eff8ba00700 1 --2- 172.21.15.49:0/2933263619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff84152240 0x7eff84063e80 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.907+0000 7eff8ba00700 1 --2- 172.21.15.49:0/2933263619 >> v2:172.21.15.110:3300/0 conn(0x7eff84150d20 0x7eff84069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.907+0000 7eff8ba00700 1 -- 172.21.15.49:0/2933263619 >> 172.21.15.49:0/2933263619 conn(0x7eff840c7670 msgr2=0x7eff840c7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.907+0000 7eff8ba00700 1 -- 172.21.15.49:0/2933263619 shutdown_connections 2024-01-22T05:11:37.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.907+0000 7eff8ba00700 1 -- 172.21.15.49:0/2933263619 wait complete. 2024-01-22T05:11:37.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.907+0000 7eff8ba00700 1 Processor -- start 2024-01-22T05:11:37.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff8ba00700 1 -- start start 2024-01-22T05:11:37.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff8ba00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff84150d20 0x7eff8415a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff8ba00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff84152240 0x7eff84158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff8ba00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff841526b0 0x7eff84159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff8ba00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8415b040 con 0x7eff841526b0 2024-01-22T05:11:37.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff8ba00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff840ab2b0 con 0x7eff84150d20 2024-01-22T05:11:37.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff8ba00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff840aa6a0 con 0x7eff84152240 2024-01-22T05:11:37.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff89a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff841526b0 0x7eff84159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff89a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff841526b0 0x7eff84159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59164/0 (socket says 172.21.15.49:59164) 2024-01-22T05:11:37.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff89a00700 1 -- 172.21.15.49:0/2505857921 learned_addr learned my addr 172.21.15.49:0/2505857921 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff83e00700 1 --2- 172.21.15.49:0/2505857921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff84152240 0x7eff84158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff89000700 1 --2- 172.21.15.49:0/2505857921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff84150d20 0x7eff8415a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff89a00700 1 -- 172.21.15.49:0/2505857921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff84152240 msgr2=0x7eff84158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff89a00700 1 --2- 172.21.15.49:0/2505857921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff84152240 0x7eff84158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff89a00700 1 -- 172.21.15.49:0/2505857921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff84150d20 msgr2=0x7eff8415a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff89a00700 1 --2- 172.21.15.49:0/2505857921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff84150d20 0x7eff8415a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.911+0000 7eff89a00700 1 -- 172.21.15.49:0/2505857921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c009370 con 0x7eff841526b0 2024-01-22T05:11:37.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.915+0000 7eff89a00700 1 --2- 172.21.15.49:0/2505857921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff841526b0 0x7eff84159450 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7eff7c00c7c0 tx=0x7eff7c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.915+0000 7eff7be00700 1 -- 172.21.15.49:0/2505857921 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c00e4a0 con 0x7eff841526b0 2024-01-22T05:11:37.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.915+0000 7eff7be00700 1 -- 172.21.15.49:0/2505857921 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c00e600 con 0x7eff841526b0 2024-01-22T05:11:37.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.915+0000 7eff8ba00700 1 -- 172.21.15.49:0/2505857921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff840aa980 con 0x7eff841526b0 2024-01-22T05:11:37.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.915+0000 7eff7be00700 1 -- 172.21.15.49:0/2505857921 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c00e980 con 0x7eff841526b0 2024-01-22T05:11:37.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.915+0000 7eff8ba00700 1 -- 172.21.15.49:0/2505857921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff840aaf40 con 0x7eff841526b0 2024-01-22T05:11:37.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.915+0000 7eff7be00700 1 -- 172.21.15.49:0/2505857921 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7eff7c0123f0 con 0x7eff841526b0 2024-01-22T05:11:37.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.919+0000 7eff7be00700 1 --2- 172.21.15.49:0/2505857921 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7eff5c05a510 0x7eff5c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.919+0000 7eff7be00700 1 -- 172.21.15.49:0/2505857921 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6532+0+0 (secure 0 0 0) 0x7eff7c074230 con 0x7eff841526b0 2024-01-22T05:11:37.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.919+0000 7eff89000700 1 --2- 172.21.15.49:0/2505857921 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7eff5c05a510 0x7eff5c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.919+0000 7eff89000700 1 --2- 172.21.15.49:0/2505857921 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7eff5c05a510 0x7eff5c05c9d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7eff74009c30 tx=0x7eff74009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.923+0000 7eff95e3e740 1 Processor -- start 2024-01-22T05:11:37.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.923+0000 7eff95e3e740 1 -- start start 2024-01-22T05:11:37.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.923+0000 7eff95e3e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22724d0 0x22728b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.923+0000 7eff95e3e740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2279570 0x22799f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.923+0000 7eff95e3e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279ee0 0x22584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.923+0000 7eff95e3e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x218a540 con 0x22724d0 2024-01-22T05:11:37.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.923+0000 7eff95e3e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x214de90 con 0x2279ee0 2024-01-22T05:11:37.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.923+0000 7eff95e3e740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2153d90 con 0x2279570 2024-01-22T05:11:37.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.923+0000 7eff89000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22724d0 0x22728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.923+0000 7eff89000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22724d0 0x22728b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59178/0 (socket says 172.21.15.49:59178) 2024-01-22T05:11:37.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.923+0000 7eff89000700 1 -- 172.21.15.49:0/3523513847 learned_addr learned my addr 172.21.15.49:0/3523513847 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.923+0000 7eff83e00700 1 --2- 172.21.15.49:0/3523513847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2279570 0x22799f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.923+0000 7eff89a00700 1 --2- 172.21.15.49:0/3523513847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279ee0 0x22584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff89000700 1 -- 172.21.15.49:0/3523513847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2279570 msgr2=0x22799f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff89000700 1 --2- 172.21.15.49:0/3523513847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2279570 0x22799f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff89000700 1 -- 172.21.15.49:0/3523513847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279ee0 msgr2=0x22584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff89000700 1 --2- 172.21.15.49:0/3523513847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279ee0 0x22584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff89000700 1 -- 172.21.15.49:0/3523513847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21b84c0 con 0x22724d0 2024-01-22T05:11:37.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff89000700 1 --2- 172.21.15.49:0/3523513847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22724d0 0x22728b0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7eff74011da0 tx=0x7eff74017000).ready entity=mon.0 client_cookie=3ae1befc89fd2a2f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff78c00700 1 -- 172.21.15.49:0/3523513847 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff74011ea0 con 0x22724d0 2024-01-22T05:11:37.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff78c00700 1 -- 172.21.15.49:0/3523513847 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff74014bb0 con 0x22724d0 2024-01-22T05:11:37.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff78c00700 1 -- 172.21.15.49:0/3523513847 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7401e3f0 con 0x22724d0 2024-01-22T05:11:37.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff95e3e740 1 -- 172.21.15.49:0/3523513847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22724d0 msgr2=0x22728b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff95e3e740 1 --2- 172.21.15.49:0/3523513847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22724d0 0x22728b0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7eff74011da0 tx=0x7eff74017000).stop 2024-01-22T05:11:37.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff95e3e740 1 -- 172.21.15.49:0/3523513847 shutdown_connections 2024-01-22T05:11:37.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff95e3e740 1 --2- 172.21.15.49:0/3523513847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279ee0 0x22584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff95e3e740 1 --2- 172.21.15.49:0/3523513847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2279570 0x22799f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff95e3e740 1 --2- 172.21.15.49:0/3523513847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22724d0 0x22728b0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff95e3e740 1 -- 172.21.15.49:0/3523513847 >> 172.21.15.49:0/3523513847 conn(0x200c680 msgr2=0x222bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff95e3e740 1 -- 172.21.15.49:0/3523513847 shutdown_connections 2024-01-22T05:11:37.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.927+0000 7eff95e3e740 1 -- 172.21.15.49:0/3523513847 wait complete. 2024-01-22T05:11:37.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.931+0000 7eff95e3e740 1 -- start start 2024-01-22T05:11:37.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.931+0000 7eff95e3e740 1 Processor -- start 2024-01-22T05:11:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.931+0000 7eff95e3e740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 0x224f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.931+0000 7eff95e3e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 0x226b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.931+0000 7eff95e3e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x222b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.931+0000 7eff95e3e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2251a90 con 0x2279ee0 2024-01-22T05:11:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.931+0000 7eff95e3e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x226bc80 con 0x2279570 2024-01-22T05:11:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.931+0000 7eff95e3e740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2229d60 con 0x22724d0 2024-01-22T05:11:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.931+0000 7eff95e3e740 10 client.0 ll_register_callbacks cb 0x21e45d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:11:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff89000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 0x224f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff89a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x222b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff89a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x222b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59188/0 (socket says 172.21.15.49:59188) 2024-01-22T05:11:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff89a00700 1 -- 172.21.15.49:0/2983445535 learned_addr learned my addr 172.21.15.49:0/2983445535 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff89000700 1 --2- 172.21.15.49:0/2983445535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 0x224f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:56326/0 (socket says 172.21.15.49:56326) 2024-01-22T05:11:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff83e00700 1 --2- 172.21.15.49:0/2983445535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 0x226b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff89a00700 1 -- 172.21.15.49:0/2983445535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 msgr2=0x224f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff89a00700 1 --2- 172.21.15.49:0/2983445535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 0x224f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff89a00700 1 -- 172.21.15.49:0/2983445535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 msgr2=0x226b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff89a00700 1 --2- 172.21.15.49:0/2983445535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 0x226b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff89a00700 1 -- 172.21.15.49:0/2983445535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff74011990 con 0x2279ee0 2024-01-22T05:11:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff89a00700 1 --2- 172.21.15.49:0/2983445535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x222b050 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7eff7c072680 tx=0x7eff7c00f000).ready entity=mon.0 client_cookie=2760c39866103f46 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff71600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:11:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff71600700 1 -- 172.21.15.49:0/2983445535 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c050070 con 0x2279ee0 2024-01-22T05:11:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff71600700 1 -- 172.21.15.49:0/2983445535 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 6532+0+0 (secure 0 0 0) 0x7eff7c04b3b0 con 0x2279ee0 2024-01-22T05:11:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff95e3e740 1 -- 172.21.15.49:0/2983445535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x21a4230 con 0x2279ee0 2024-01-22T05:11:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff71600700 1 -- 172.21.15.49:0/2983445535 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff7c050b50 con 0x2279ee0 2024-01-22T05:11:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff95e3e740 10 client.7077 fetch_fsmap learned FSMap version 80 2024-01-22T05:11:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff95e3e740 1 -- 172.21.15.49:0/2983445535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x21a77c0 con 0x2279ee0 2024-01-22T05:11:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff71600700 1 -- 172.21.15.49:0/2983445535 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x21a4230 con 0x2279ee0 2024-01-22T05:11:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff71600700 1 -- 172.21.15.49:0/2983445535 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 80) v1 ==== 3100+0+0 (secure 0 0 0) 0x7eff7c047200 con 0x2279ee0 2024-01-22T05:11:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff95e3e740 10 client.7077 fetch_fsmap finished waiting for FSMap version 80 2024-01-22T05:11:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff95e3e740 10 client.7077 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-01-22T05:11:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff95e3e740 20 client.7077 populate_metadata read hostname 'smithi049' 2024-01-22T05:11:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff95e3e740 1 --2- 172.21.15.49:0/2983445535 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x22521b0 0x22525c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff95e3e740 4 client.7077 mds_command: new command op to 6846 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:11:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff95e3e740 1 -- 172.21.15.49:0/2983445535 --> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x219a780 con 0x22521b0 2024-01-22T05:11:37.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.935+0000 7eff89000700 1 --2- 172.21.15.49:0/2983445535 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x22521b0 0x22525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff89000700 1 --2- 172.21.15.49:0/2983445535 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x22521b0 0x22525c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3dd69e0b32ea548e server_cookie=383321d8691a4f07 in_seq=0 out_seq=0 2024-01-22T05:11:37.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff71600700 10 client.7077 ms_handle_connect on v2:172.21.15.110:6832/1072346524 2024-01-22T05:11:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff71600700 1 -- 172.21.15.49:0/2983445535 <== mds.0 v2:172.21.15.110:6832/1072346524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x219a780 con 0x22521b0 2024-01-22T05:11:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff71600700 10 client.7077 handle_command_reply: tid=0 2024-01-22T05:11:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff95e3e740 1 client.7077 shutdown 2024-01-22T05:11:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff95e3e740 1 -- 172.21.15.49:0/2983445535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 msgr2=0x222b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff95e3e740 1 --2- 172.21.15.49:0/2983445535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x222b050 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7eff7c072680 tx=0x7eff7c00f000).stop 2024-01-22T05:11:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff95e3e740 1 -- 172.21.15.49:0/2983445535 shutdown_connections 2024-01-22T05:11:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff95e3e740 1 --2- 172.21.15.49:0/2983445535 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x22521b0 0x22525c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff95e3e740 1 --2- 172.21.15.49:0/2983445535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x222b050 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff95e3e740 1 --2- 172.21.15.49:0/2983445535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 0x226b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff71600700 0 client.7077 ms_handle_reset on v2:172.21.15.110:6832/1072346524 2024-01-22T05:11:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff95e3e740 1 --2- 172.21.15.49:0/2983445535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 0x224f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff95e3e740 1 -- 172.21.15.49:0/2983445535 >> 172.21.15.49:0/2983445535 conn(0x200c680 msgr2=0x22728b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff95e3e740 1 -- 172.21.15.49:0/2983445535 shutdown_connections 2024-01-22T05:11:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.939+0000 7eff95e3e740 1 -- 172.21.15.49:0/2983445535 wait complete. 2024-01-22T05:11:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.943+0000 7eff95e3e740 20 client.7077 trim_cache size 0 max 16384 2024-01-22T05:11:37.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.959+0000 7eff95e3e740 1 Processor -- start 2024-01-22T05:11:37.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.959+0000 7eff95e3e740 1 -- start start 2024-01-22T05:11:37.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff95e3e740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 0x222ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff95e3e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 0x2255910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff95e3e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x22d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff95e3e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x21f0040 con 0x2279ee0 2024-01-22T05:11:37.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff95e3e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x226afd0 con 0x2279570 2024-01-22T05:11:37.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff95e3e740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x21a4230 con 0x22724d0 2024-01-22T05:11:37.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff83e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 0x2255910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff89a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x22d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff83e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 0x2255910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:55312/0 (socket says 172.21.15.49:55312) 2024-01-22T05:11:37.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff83e00700 1 -- 172.21.15.49:0/3559979032 learned_addr learned my addr 172.21.15.49:0/3559979032 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff89000700 1 --2- 172.21.15.49:0/3559979032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 0x222ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff83e00700 1 -- 172.21.15.49:0/3559979032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 msgr2=0x222ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff83e00700 1 --2- 172.21.15.49:0/3559979032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 0x222ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff83e00700 1 -- 172.21.15.49:0/3559979032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 msgr2=0x22d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff83e00700 1 --2- 172.21.15.49:0/3559979032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x22d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff83e00700 1 -- 172.21.15.49:0/3559979032 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff840c6a20 con 0x2279570 2024-01-22T05:11:37.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff83e00700 1 --2- 172.21.15.49:0/3559979032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 0x2255910 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7eff84065980 tx=0x7eff6c017000).ready entity=mon.1 client_cookie=3b7e4115cdcdd2af server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff79600700 1 -- 172.21.15.49:0/3559979032 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c00be90 con 0x2279570 2024-01-22T05:11:37.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff79600700 1 -- 172.21.15.49:0/3559979032 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c024040 con 0x2279570 2024-01-22T05:11:37.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff79600700 1 -- 172.21.15.49:0/3559979032 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c00b7f0 con 0x2279570 2024-01-22T05:11:37.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff95e3e740 1 -- 172.21.15.49:0/3559979032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 msgr2=0x2255910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff95e3e740 1 --2- 172.21.15.49:0/3559979032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 0x2255910 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7eff84065980 tx=0x7eff6c017000).stop 2024-01-22T05:11:37.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff95e3e740 1 -- 172.21.15.49:0/3559979032 shutdown_connections 2024-01-22T05:11:37.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff95e3e740 1 --2- 172.21.15.49:0/3559979032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x22d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff95e3e740 1 --2- 172.21.15.49:0/3559979032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 0x2255910 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff95e3e740 1 --2- 172.21.15.49:0/3559979032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 0x222ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff95e3e740 1 -- 172.21.15.49:0/3559979032 >> 172.21.15.49:0/3559979032 conn(0x200c680 msgr2=0x222d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff95e3e740 1 -- 172.21.15.49:0/3559979032 shutdown_connections 2024-01-22T05:11:37.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.963+0000 7eff95e3e740 1 -- 172.21.15.49:0/3559979032 wait complete. 2024-01-22T05:11:37.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.967+0000 7eff95e3e740 1 -- start start 2024-01-22T05:11:37.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.967+0000 7eff95e3e740 1 Processor -- start 2024-01-22T05:11:37.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.967+0000 7eff95e3e740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 0x22ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.967+0000 7eff95e3e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 0x2271940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.967+0000 7eff95e3e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x2282010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.967+0000 7eff95e3e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x224b110 con 0x2279ee0 2024-01-22T05:11:37.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.967+0000 7eff95e3e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x224a800 con 0x2279570 2024-01-22T05:11:37.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.967+0000 7eff95e3e740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x22d61d0 con 0x22724d0 2024-01-22T05:11:37.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.967+0000 7eff95e3e740 10 client.0 ll_register_callbacks cb 0x7eff7c04b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:11:37.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.967+0000 7eff89a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x2282010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.967+0000 7eff89a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x2282010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59198/0 (socket says 172.21.15.49:59198) 2024-01-22T05:11:37.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.967+0000 7eff89a00700 1 -- 172.21.15.49:0/2513122722 learned_addr learned my addr 172.21.15.49:0/2513122722 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:11:37.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.967+0000 7eff83e00700 1 --2- 172.21.15.49:0/2513122722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 0x2271940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.967+0000 7eff89000700 1 --2- 172.21.15.49:0/2513122722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 0x22ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff89a00700 1 -- 172.21.15.49:0/2513122722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 msgr2=0x22ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff89a00700 1 --2- 172.21.15.49:0/2513122722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 0x22ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff89a00700 1 -- 172.21.15.49:0/2513122722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 msgr2=0x2271940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:11:37.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff89a00700 1 --2- 172.21.15.49:0/2513122722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 0x2271940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff89a00700 1 -- 172.21.15.49:0/2513122722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff84151a50 con 0x2279ee0 2024-01-22T05:11:37.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff89a00700 1 --2- 172.21.15.49:0/2513122722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x2282010 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7eff7c047910 tx=0x7eff7c053000).ready entity=mon.0 client_cookie=d56245917804fbed server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:11:37.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff71600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:11:37.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff71600700 1 -- 172.21.15.49:0/2513122722 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c050b50 con 0x2279ee0 2024-01-22T05:11:37.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff95e3e740 1 -- 172.21.15.49:0/2513122722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff74014bb0 con 0x2279ee0 2024-01-22T05:11:37.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff71600700 1 -- 172.21.15.49:0/2513122722 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 6532+0+0 (secure 0 0 0) 0x7eff7c04a370 con 0x2279ee0 2024-01-22T05:11:37.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff71600700 1 -- 172.21.15.49:0/2513122722 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff7c04a740 con 0x2279ee0 2024-01-22T05:11:37.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff95e3e740 10 client.7083 fetch_fsmap learned FSMap version 80 2024-01-22T05:11:37.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff95e3e740 1 -- 172.21.15.49:0/2513122722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x21a29f0 con 0x2279ee0 2024-01-22T05:11:37.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff71600700 1 -- 172.21.15.49:0/2513122722 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c06f030 con 0x2279ee0 2024-01-22T05:11:37.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff71600700 1 -- 172.21.15.49:0/2513122722 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 80) v1 ==== 3100+0+0 (secure 0 0 0) 0x7eff7c072770 con 0x2279ee0 2024-01-22T05:11:37.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff95e3e740 10 client.7083 fetch_fsmap finished waiting for FSMap version 80 2024-01-22T05:11:37.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff95e3e740 10 client.7083 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-01-22T05:11:37.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff95e3e740 20 client.7083 populate_metadata read hostname 'smithi049' 2024-01-22T05:11:37.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff95e3e740 1 --2- 172.21.15.49:0/2513122722 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2271e30 0x2282500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:11:37.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff95e3e740 4 client.7083 mds_command: new command op to 6846 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:11:37.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff95e3e740 1 -- 172.21.15.49:0/2513122722 --> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x2063610 con 0x2271e30 2024-01-22T05:11:37.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff89000700 1 --2- 172.21.15.49:0/2513122722 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2271e30 0x2282500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:11:37.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff89000700 1 --2- 172.21.15.49:0/2513122722 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2271e30 0x2282500 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b90ed736166da29f server_cookie=eb0751b82ef28a67 in_seq=0 out_seq=0 2024-01-22T05:11:37.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff71600700 10 client.7083 ms_handle_connect on v2:172.21.15.110:6832/1072346524 2024-01-22T05:11:37.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff71600700 1 -- 172.21.15.49:0/2513122722 <== mds.0 v2:172.21.15.110:6832/1072346524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+257 (crc 0 0 0) 0x2063610 con 0x2271e30 2024-01-22T05:11:37.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.971+0000 7eff71600700 10 client.7083 handle_command_reply: tid=0 2024-01-22T05:11:37.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff95e3e740 1 client.7083 shutdown 2024-01-22T05:11:37.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff95e3e740 1 -- 172.21.15.49:0/2513122722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 msgr2=0x2282010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff95e3e740 1 --2- 172.21.15.49:0/2513122722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x2282010 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7eff7c047910 tx=0x7eff7c053000).stop 2024-01-22T05:11:37.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff95e3e740 1 -- 172.21.15.49:0/2513122722 shutdown_connections 2024-01-22T05:11:37.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff95e3e740 1 --2- 172.21.15.49:0/2513122722 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2271e30 0x2282500 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff95e3e740 1 --2- 172.21.15.49:0/2513122722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2279ee0 0x2282010 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff95e3e740 1 --2- 172.21.15.49:0/2513122722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2279570 0x2271940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff95e3e740 1 --2- 172.21.15.49:0/2513122722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22724d0 0x22ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff95e3e740 1 -- 172.21.15.49:0/2513122722 >> 172.21.15.49:0/2513122722 conn(0x200c680 msgr2=0x222bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff71600700 0 client.7083 ms_handle_reset on v2:172.21.15.110:6832/1072346524 2024-01-22T05:11:37.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff95e3e740 1 -- 172.21.15.49:0/2513122722 shutdown_connections 2024-01-22T05:11:37.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff95e3e740 1 -- 172.21.15.49:0/2513122722 wait complete. 2024-01-22T05:11:37.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff95e3e740 20 client.7083 trim_cache size 0 max 16384 2024-01-22T05:11:37.979 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:11:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-01-22T05:11:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-01-22T05:11:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "6be10a45-95b4-48c4-b52d-60108038dc49": { 2024-01-22T05:11:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "~mds0", 2024-01-22T05:11:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "6be10a45-95b4-48c4-b52d-60108038dc49", 2024-01-22T05:11:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive" 2024-01-22T05:11:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:11:37.979 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:11:37.979 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:11:37.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff8ba00700 1 -- 172.21.15.49:0/2505857921 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7eff5c05a510 msgr2=0x7eff5c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff8ba00700 1 --2- 172.21.15.49:0/2505857921 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7eff5c05a510 0x7eff5c05c9d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7eff74009c30 tx=0x7eff74009060).stop 2024-01-22T05:11:37.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff8ba00700 1 -- 172.21.15.49:0/2505857921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff841526b0 msgr2=0x7eff84159450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:11:37.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff8ba00700 1 --2- 172.21.15.49:0/2505857921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff841526b0 0x7eff84159450 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7eff7c00c7c0 tx=0x7eff7c001510).stop 2024-01-22T05:11:37.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff8ba00700 1 -- 172.21.15.49:0/2505857921 shutdown_connections 2024-01-22T05:11:37.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff8ba00700 1 --2- 172.21.15.49:0/2505857921 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7eff5c05a510 0x7eff5c05c9d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff8ba00700 1 --2- 172.21.15.49:0/2505857921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff841526b0 0x7eff84159450 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff8ba00700 1 --2- 172.21.15.49:0/2505857921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff84152240 0x7eff84158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff8ba00700 1 --2- 172.21.15.49:0/2505857921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff84150d20 0x7eff8415a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:11:37.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff8ba00700 1 -- 172.21.15.49:0/2505857921 >> 172.21.15.49:0/2505857921 conn(0x7eff840c7670 msgr2=0x7eff840c5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:11:37.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff8ba00700 1 -- 172.21.15.49:0/2505857921 shutdown_connections 2024-01-22T05:11:37.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:11:37.975+0000 7eff8ba00700 1 -- 172.21.15.49:0/2505857921 wait complete. 2024-01-22T05:11:38.003 INFO:tasks.cephfs.filesystem:scrub status for tag:6be10a45-95b4-48c4-b52d-60108038dc49 - {'path': '~mds0', 'tag': '6be10a45-95b4-48c4-b52d-60108038dc49', 'options': 'recursive'} 2024-01-22T05:11:38.178 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:11:38.184 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:12:08.004 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub status 2024-01-22T05:12:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.170+0000 7f21c7000700 1 Processor -- start 2024-01-22T05:12:08.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.170+0000 7f21c7000700 1 -- start start 2024-01-22T05:12:08.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.170+0000 7f21c7000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c01524f0 0x7f21c0066400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.170+0000 7f21c7000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f21c015bad0 0x7f21c015bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21c7000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c00bd3e0 con 0x7f21c00a8760 2024-01-22T05:12:08.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21c7000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c0067c50 con 0x7f21c015bad0 2024-01-22T05:12:08.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21c7000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c015c440 con 0x7f21c01524f0 2024-01-22T05:12:08.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21c5000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f21c00a8760 0x7f21c00a8c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34716/0 (socket says 172.21.15.49:34716) 2024-01-22T05:12:08.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21c5000700 1 -- 172.21.15.49:0/4072853 learned_addr learned my addr 172.21.15.49:0/4072853 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:08.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21bf400700 1 --2- 172.21.15.49:0/4072853 >> v2:172.21.15.110:3300/0 conn(0x7f21c015bad0 0x7f21c015bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21bfe00700 1 --2- 172.21.15.49:0/4072853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c01524f0 0x7f21c0066400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21bea00700 1 -- 172.21.15.49:0/4072853 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385943203 0 0) 0x7f21c00bd3e0 con 0x7f21c00a8760 2024-01-22T05:12:08.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21bea00700 1 -- 172.21.15.49:0/4072853 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21a00033f0 con 0x7f21c00a8760 2024-01-22T05:12:08.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21bf400700 1 -- 172.21.15.49:0/4072853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c01524f0 msgr2=0x7f21c0066400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21bf400700 1 --2- 172.21.15.49:0/4072853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c01524f0 0x7f21c0066400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21bf400700 1 -- 172.21.15.49:0/4072853 >> v1:172.21.15.49:6789/0 conn(0x7f21c00a8760 legacy=0x7f21c00a8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21bf400700 1 -- 172.21.15.49:0/4072853 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c00bcb40 con 0x7f21c015bad0 2024-01-22T05:12:08.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21bf400700 1 --2- 172.21.15.49:0/4072853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c015bad0 0x7f21c015bf50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f21a8009760 tx=0x7f21a8009060).ready entity=mon.1 client_cookie=9c43baba5423d53e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21bea00700 1 -- 172.21.15.49:0/4072853 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a800d4a0 con 0x7f21c015bad0 2024-01-22T05:12:08.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21bea00700 1 -- 172.21.15.49:0/4072853 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a800d600 con 0x7f21c015bad0 2024-01-22T05:12:08.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21bea00700 1 -- 172.21.15.49:0/4072853 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a800d980 con 0x7f21c015bad0 2024-01-22T05:12:08.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21c7000700 1 -- 172.21.15.49:0/4072853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c015bad0 msgr2=0x7f21c015bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.174+0000 7f21c7000700 1 --2- 172.21.15.49:0/4072853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c015bad0 0x7f21c015bf50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f21a8009760 tx=0x7f21a8009060).stop 2024-01-22T05:12:08.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.178+0000 7f21c7000700 1 -- 172.21.15.49:0/4072853 shutdown_connections 2024-01-22T05:12:08.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.178+0000 7f21c7000700 1 --2- 172.21.15.49:0/4072853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c015bad0 0x7f21c015bf50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.178+0000 7f21c7000700 1 --2- 172.21.15.49:0/4072853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c01524f0 0x7f21c0066400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.178+0000 7f21c7000700 1 -- 172.21.15.49:0/4072853 >> 172.21.15.49:0/4072853 conn(0x7f21c00c6560 msgr2=0x7f21c00c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:08.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.178+0000 7f21c7000700 1 -- 172.21.15.49:0/4072853 shutdown_connections 2024-01-22T05:12:08.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.178+0000 7f21c7000700 1 -- 172.21.15.49:0/4072853 wait complete. 2024-01-22T05:12:08.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.178+0000 7f21c7000700 1 Processor -- start 2024-01-22T05:12:08.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.178+0000 7f21c7000700 1 -- start start 2024-01-22T05:12:08.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c7000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c00a8760 0x7f21c016c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c7000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c01524f0 0x7f21c015df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c7000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c015bad0 0x7f21c0159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c7000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c016c900 con 0x7f21c015bad0 2024-01-22T05:12:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c7000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0168a50 con 0x7f21c01524f0 2024-01-22T05:12:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c7000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0168d30 con 0x7f21c00a8760 2024-01-22T05:12:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c015bad0 0x7f21c0159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c015bad0 0x7f21c0159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34918/0 (socket says 172.21.15.49:34918) 2024-01-22T05:12:08.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c5000700 1 -- 172.21.15.49:0/1390952406 learned_addr learned my addr 172.21.15.49:0/1390952406 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:08.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21bf400700 1 --2- 172.21.15.49:0/1390952406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c01524f0 0x7f21c015df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21bfe00700 1 --2- 172.21.15.49:0/1390952406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c00a8760 0x7f21c016c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c5000700 1 -- 172.21.15.49:0/1390952406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c00a8760 msgr2=0x7f21c016c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c5000700 1 --2- 172.21.15.49:0/1390952406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c00a8760 0x7f21c016c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c5000700 1 -- 172.21.15.49:0/1390952406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c01524f0 msgr2=0x7f21c015df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c5000700 1 --2- 172.21.15.49:0/1390952406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c01524f0 0x7f21c015df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c5000700 1 -- 172.21.15.49:0/1390952406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a80092a0 con 0x7f21c015bad0 2024-01-22T05:12:08.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c5000700 1 --2- 172.21.15.49:0/1390952406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c015bad0 0x7f21c0159910 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f21b8005ad0 tx=0x7f21b8001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21b7400700 1 -- 172.21.15.49:0/1390952406 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8005d30 con 0x7f21c015bad0 2024-01-22T05:12:08.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21b7400700 1 -- 172.21.15.49:0/1390952406 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b8005e90 con 0x7f21c015bad0 2024-01-22T05:12:08.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21c7000700 1 -- 172.21.15.49:0/1390952406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c0169010 con 0x7f21c015bad0 2024-01-22T05:12:08.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.182+0000 7f21b7400700 1 -- 172.21.15.49:0/1390952406 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8007320 con 0x7f21c015bad0 2024-01-22T05:12:08.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.186+0000 7f21c7000700 1 -- 172.21.15.49:0/1390952406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c00a95b0 con 0x7f21c015bad0 2024-01-22T05:12:08.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.186+0000 7f21b7400700 1 -- 172.21.15.49:0/1390952406 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f21b8007710 con 0x7f21c015bad0 2024-01-22T05:12:08.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.190+0000 7f21b7400700 1 --2- 172.21.15.49:0/1390952406 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f219805a510 0x7f219805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.190+0000 7f21b7400700 1 -- 172.21.15.49:0/1390952406 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f21b8074920 con 0x7f21c015bad0 2024-01-22T05:12:08.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.190+0000 7f21bfe00700 1 --2- 172.21.15.49:0/1390952406 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f219805a510 0x7f219805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.190+0000 7f21bfe00700 1 --2- 172.21.15.49:0/1390952406 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f219805a510 0x7f219805c9d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f21b0009c30 tx=0x7f21b0009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.190+0000 7f21d14a0740 1 Processor -- start 2024-01-22T05:12:08.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21d14a0740 1 -- start start 2024-01-22T05:12:08.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21d14a0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24424d0 0x24428b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21d14a0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x24499f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21d14a0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2449ee0 0x24284f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21d14a0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x235a540 con 0x2449570 2024-01-22T05:12:08.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21d14a0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x231de90 con 0x24424d0 2024-01-22T05:12:08.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21d14a0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2323d90 con 0x2449ee0 2024-01-22T05:12:08.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21bf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x24499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21bf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x24499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34924/0 (socket says 172.21.15.49:34924) 2024-01-22T05:12:08.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21bf400700 1 -- 172.21.15.49:0/279585301 learned_addr learned my addr 172.21.15.49:0/279585301 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:08.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21bfe00700 1 --2- 172.21.15.49:0/279585301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24424d0 0x24428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21c5000700 1 --2- 172.21.15.49:0/279585301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2449ee0 0x24284f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21c5000700 1 -- 172.21.15.49:0/279585301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24424d0 msgr2=0x24428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21c5000700 1 --2- 172.21.15.49:0/279585301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24424d0 0x24428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21c5000700 1 -- 172.21.15.49:0/279585301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 msgr2=0x24499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21c5000700 1 --2- 172.21.15.49:0/279585301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x24499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21c5000700 1 -- 172.21.15.49:0/279585301 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23884c0 con 0x2449ee0 2024-01-22T05:12:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21bf400700 1 --2- 172.21.15.49:0/279585301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x24499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:12:08.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21c5000700 1 --2- 172.21.15.49:0/279585301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2449ee0 0x24284f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f21b8072c40 tx=0x7f21b800f000).ready entity=mon.2 client_cookie=1e6a9f6f5a688595 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.194+0000 7f21afe00700 1 -- 172.21.15.49:0/279585301 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8051070 con 0x2449ee0 2024-01-22T05:12:08.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.198+0000 7f21afe00700 1 -- 172.21.15.49:0/279585301 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b804bab0 con 0x2449ee0 2024-01-22T05:12:08.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.198+0000 7f21afe00700 1 -- 172.21.15.49:0/279585301 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8051250 con 0x2449ee0 2024-01-22T05:12:08.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.198+0000 7f21d14a0740 1 -- 172.21.15.49:0/279585301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2449ee0 msgr2=0x24284f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.198+0000 7f21d14a0740 1 --2- 172.21.15.49:0/279585301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2449ee0 0x24284f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f21b8072c40 tx=0x7f21b800f000).stop 2024-01-22T05:12:08.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.198+0000 7f21d14a0740 1 -- 172.21.15.49:0/279585301 shutdown_connections 2024-01-22T05:12:08.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.198+0000 7f21d14a0740 1 --2- 172.21.15.49:0/279585301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2449ee0 0x24284f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.198+0000 7f21d14a0740 1 --2- 172.21.15.49:0/279585301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x24499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.198+0000 7f21d14a0740 1 --2- 172.21.15.49:0/279585301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24424d0 0x24428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.198+0000 7f21d14a0740 1 -- 172.21.15.49:0/279585301 >> 172.21.15.49:0/279585301 conn(0x21dc680 msgr2=0x23fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:08.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.198+0000 7f21d14a0740 1 -- 172.21.15.49:0/279585301 shutdown_connections 2024-01-22T05:12:08.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.198+0000 7f21d14a0740 1 -- 172.21.15.49:0/279585301 wait complete. 2024-01-22T05:12:08.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.198+0000 7f21d14a0740 1 -- start start 2024-01-22T05:12:08.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.198+0000 7f21d14a0740 1 Processor -- start 2024-01-22T05:12:08.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21d14a0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24424d0 0x2421150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21d14a0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x2423020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21d14a0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2449ee0 0x2419fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21d14a0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2423510 con 0x2449570 2024-01-22T05:12:08.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21d14a0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x241a490 con 0x24424d0 2024-01-22T05:12:08.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21d14a0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2421930 con 0x2449ee0 2024-01-22T05:12:08.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21d14a0740 10 client.0 ll_register_callbacks cb 0x23b45d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:12:08.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21bf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x2423020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21bf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x2423020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34940/0 (socket says 172.21.15.49:34940) 2024-01-22T05:12:08.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21bf400700 1 -- 172.21.15.49:0/1331936269 learned_addr learned my addr 172.21.15.49:0/1331936269 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21c5000700 1 --2- 172.21.15.49:0/1331936269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2449ee0 0x2419fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21bfe00700 1 --2- 172.21.15.49:0/1331936269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24424d0 0x2421150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21bf400700 1 -- 172.21.15.49:0/1331936269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2449ee0 msgr2=0x2419fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21bf400700 1 --2- 172.21.15.49:0/1331936269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2449ee0 0x2419fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21bf400700 1 -- 172.21.15.49:0/1331936269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24424d0 msgr2=0x2421150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21bf400700 1 --2- 172.21.15.49:0/1331936269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24424d0 0x2421150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21bf400700 1 -- 172.21.15.49:0/1331936269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c00bcb40 con 0x2449570 2024-01-22T05:12:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21c5000700 1 --2- 172.21.15.49:0/1331936269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2449ee0 0x2419fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21bf400700 1 --2- 172.21.15.49:0/1331936269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x2423020 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f21a800df70 tx=0x7f21a8016000).ready entity=mon.0 client_cookie=fad3985f4826bd87 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21acc00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:12:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21acc00700 1 -- 172.21.15.49:0/1331936269 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8023070 con 0x2449570 2024-01-22T05:12:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21acc00700 1 -- 172.21.15.49:0/1331936269 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f21a8011610 con 0x2449570 2024-01-22T05:12:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.202+0000 7f21d14a0740 1 -- 172.21.15.49:0/1331936269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2374230 con 0x2449570 2024-01-22T05:12:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21acc00700 1 -- 172.21.15.49:0/1331936269 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21a8000d10 con 0x2449570 2024-01-22T05:12:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21d14a0740 10 client.7095 fetch_fsmap learned FSMap version 83 2024-01-22T05:12:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21d14a0740 1 -- 172.21.15.49:0/1331936269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x7f21c00a95b0 con 0x2449570 2024-01-22T05:12:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21acc00700 1 -- 172.21.15.49:0/1331936269 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2374230 con 0x2449570 2024-01-22T05:12:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21acc00700 1 -- 172.21.15.49:0/1331936269 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 83) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f21a80119e0 con 0x2449570 2024-01-22T05:12:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21d14a0740 10 client.7095 fetch_fsmap finished waiting for FSMap version 83 2024-01-22T05:12:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21d14a0740 10 client.7095 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-01-22T05:12:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21d14a0740 20 client.7095 populate_metadata read hostname 'smithi049' 2024-01-22T05:12:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21d14a0740 1 --2- 172.21.15.49:0/1331936269 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2420ba0 0x241f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21d14a0740 4 client.7095 mds_command: new command op to 6846 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:12:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21d14a0740 1 -- 172.21.15.49:0/1331936269 --> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x236a780 con 0x2420ba0 2024-01-22T05:12:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21bfe00700 1 --2- 172.21.15.49:0/1331936269 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2420ba0 0x241f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21bfe00700 1 --2- 172.21.15.49:0/1331936269 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2420ba0 0x241f330 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=98de112ad2fc5fc7 server_cookie=4da2a5e6abea3e5c in_seq=0 out_seq=0 2024-01-22T05:12:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21acc00700 10 client.7095 ms_handle_connect on v2:172.21.15.110:6832/1072346524 2024-01-22T05:12:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21acc00700 1 -- 172.21.15.49:0/1331936269 <== mds.0 v2:172.21.15.110:6832/1072346524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x236a780 con 0x2420ba0 2024-01-22T05:12:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21acc00700 10 client.7095 handle_command_reply: tid=0 2024-01-22T05:12:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.206+0000 7f21d14a0740 1 client.7095 shutdown 2024-01-22T05:12:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.210+0000 7f21d14a0740 1 -- 172.21.15.49:0/1331936269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 msgr2=0x2423020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.210+0000 7f21d14a0740 1 --2- 172.21.15.49:0/1331936269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x2423020 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f21a800df70 tx=0x7f21a8016000).stop 2024-01-22T05:12:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.210+0000 7f21d14a0740 1 -- 172.21.15.49:0/1331936269 shutdown_connections 2024-01-22T05:12:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.210+0000 7f21d14a0740 1 --2- 172.21.15.49:0/1331936269 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2420ba0 0x241f330 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.210+0000 7f21d14a0740 1 --2- 172.21.15.49:0/1331936269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2449ee0 0x2419fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.210+0000 7f21d14a0740 1 --2- 172.21.15.49:0/1331936269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x2423020 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.210+0000 7f21d14a0740 1 --2- 172.21.15.49:0/1331936269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24424d0 0x2421150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.210+0000 7f21acc00700 0 client.7095 ms_handle_reset on v2:172.21.15.110:6832/1072346524 2024-01-22T05:12:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.210+0000 7f21d14a0740 1 -- 172.21.15.49:0/1331936269 >> 172.21.15.49:0/1331936269 conn(0x21dc680 msgr2=0x24432c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.210+0000 7f21d14a0740 1 -- 172.21.15.49:0/1331936269 shutdown_connections 2024-01-22T05:12:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.210+0000 7f21d14a0740 1 -- 172.21.15.49:0/1331936269 wait complete. 2024-01-22T05:12:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.210+0000 7f21d14a0740 20 client.7095 trim_cache size 0 max 16384 2024-01-22T05:12:08.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.226+0000 7f21d14a0740 1 Processor -- start 2024-01-22T05:12:08.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.226+0000 7f21d14a0740 1 -- start start 2024-01-22T05:12:08.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21d14a0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24424d0 0x2419fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21d14a0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x2422ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21d14a0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2449ee0 0x23fd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21d14a0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2427050 con 0x2449570 2024-01-22T05:12:08.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21d14a0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x243abf0 con 0x2449ee0 2024-01-22T05:12:08.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21d14a0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x23f8920 con 0x24424d0 2024-01-22T05:12:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21bf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x2422ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21bfe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24424d0 0x2419fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21bfe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24424d0 0x2419fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:44268/0 (socket says 172.21.15.49:44268) 2024-01-22T05:12:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21bfe00700 1 -- 172.21.15.49:0/2512093744 learned_addr learned my addr 172.21.15.49:0/2512093744 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21c5000700 1 --2- 172.21.15.49:0/2512093744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2449ee0 0x23fd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21bf400700 1 -- 172.21.15.49:0/2512093744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24424d0 msgr2=0x2419fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21bf400700 1 --2- 172.21.15.49:0/2512093744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24424d0 0x2419fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21bf400700 1 -- 172.21.15.49:0/2512093744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2449ee0 msgr2=0x23fd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21bf400700 1 --2- 172.21.15.49:0/2512093744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2449ee0 0x23fd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21bf400700 1 -- 172.21.15.49:0/2512093744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c015a160 con 0x2449570 2024-01-22T05:12:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21c5000700 1 --2- 172.21.15.49:0/2512093744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2449ee0 0x23fd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:12:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21bfe00700 1 --2- 172.21.15.49:0/2512093744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24424d0 0x2419fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:12:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21bf400700 1 --2- 172.21.15.49:0/2512093744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x2422ea0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f21a8009760 tx=0x7f21a8023000).ready entity=mon.0 client_cookie=ba5ec8dc6031b199 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21b4c00700 1 -- 172.21.15.49:0/2512093744 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a80119e0 con 0x2449570 2024-01-22T05:12:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21b4c00700 1 -- 172.21.15.49:0/2512093744 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a8011b40 con 0x2449570 2024-01-22T05:12:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.230+0000 7f21b4c00700 1 -- 172.21.15.49:0/2512093744 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a800d460 con 0x2449570 2024-01-22T05:12:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.234+0000 7f21d14a0740 1 -- 172.21.15.49:0/2512093744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 msgr2=0x2422ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.234+0000 7f21d14a0740 1 --2- 172.21.15.49:0/2512093744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x2422ea0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f21a8009760 tx=0x7f21a8023000).stop 2024-01-22T05:12:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.234+0000 7f21d14a0740 1 -- 172.21.15.49:0/2512093744 shutdown_connections 2024-01-22T05:12:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.234+0000 7f21d14a0740 1 --2- 172.21.15.49:0/2512093744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2449ee0 0x23fd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.234+0000 7f21d14a0740 1 --2- 172.21.15.49:0/2512093744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449570 0x2422ea0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.234+0000 7f21d14a0740 1 --2- 172.21.15.49:0/2512093744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24424d0 0x2419fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.234+0000 7f21d14a0740 1 -- 172.21.15.49:0/2512093744 >> 172.21.15.49:0/2512093744 conn(0x21dc680 msgr2=0x2429510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.234+0000 7f21d14a0740 1 -- 172.21.15.49:0/2512093744 shutdown_connections 2024-01-22T05:12:08.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.234+0000 7f21d14a0740 1 -- 172.21.15.49:0/2512093744 wait complete. 2024-01-22T05:12:08.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.234+0000 7f21d14a0740 1 -- start start 2024-01-22T05:12:08.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.234+0000 7f21d14a0740 1 Processor -- start 2024-01-22T05:12:08.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21d14a0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24424d0 0x2428cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21d14a0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2449570 0x2447f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21d14a0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449ee0 0x241f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21d14a0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2448aa0 con 0x2449ee0 2024-01-22T05:12:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21d14a0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x23fd0a0 con 0x2449570 2024-01-22T05:12:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21d14a0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x23fd2f0 con 0x24424d0 2024-01-22T05:12:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21d14a0740 10 client.0 ll_register_callbacks cb 0x7f21a8009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:12:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21c5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449ee0 0x241f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21c5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449ee0 0x241f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34956/0 (socket says 172.21.15.49:34956) 2024-01-22T05:12:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21c5000700 1 -- 172.21.15.49:0/565205027 learned_addr learned my addr 172.21.15.49:0/565205027 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21bf400700 1 --2- 172.21.15.49:0/565205027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2449570 0x2447f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21bfe00700 1 --2- 172.21.15.49:0/565205027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24424d0 0x2428cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21c5000700 1 -- 172.21.15.49:0/565205027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24424d0 msgr2=0x2428cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21c5000700 1 --2- 172.21.15.49:0/565205027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24424d0 0x2428cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21c5000700 1 -- 172.21.15.49:0/565205027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2449570 msgr2=0x2447f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21c5000700 1 --2- 172.21.15.49:0/565205027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2449570 0x2447f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21c5000700 1 -- 172.21.15.49:0/565205027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c00a95b0 con 0x2449ee0 2024-01-22T05:12:08.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21c5000700 1 --2- 172.21.15.49:0/565205027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449ee0 0x241f9a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f21b804b8a0 tx=0x7f21b8055000).ready entity=mon.0 client_cookie=8d435a1a4c95f79b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21acc00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:12:08.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21acc00700 1 -- 172.21.15.49:0/565205027 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8051250 con 0x2449ee0 2024-01-22T05:12:08.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21acc00700 1 -- 172.21.15.49:0/565205027 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f21b8048220 con 0x2449ee0 2024-01-22T05:12:08.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21d14a0740 1 -- 172.21.15.49:0/565205027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2233610 con 0x2449ee0 2024-01-22T05:12:08.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21acc00700 1 -- 172.21.15.49:0/565205027 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21b804b210 con 0x2449ee0 2024-01-22T05:12:08.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21d14a0740 10 client.7101 fetch_fsmap learned FSMap version 83 2024-01-22T05:12:08.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21d14a0740 1 -- 172.21.15.49:0/565205027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x7f21c01688c0 con 0x2449ee0 2024-01-22T05:12:08.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21acc00700 1 -- 172.21.15.49:0/565205027 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2233610 con 0x2449ee0 2024-01-22T05:12:08.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21acc00700 1 -- 172.21.15.49:0/565205027 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 83) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f21b8047900 con 0x2449ee0 2024-01-22T05:12:08.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.238+0000 7f21d14a0740 10 client.7101 fetch_fsmap finished waiting for FSMap version 83 2024-01-22T05:12:08.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21d14a0740 10 client.7101 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-01-22T05:12:08.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21d14a0740 20 client.7101 populate_metadata read hostname 'smithi049' 2024-01-22T05:12:08.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21d14a0740 1 --2- 172.21.15.49:0/565205027 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2419fa0 0x241fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21d14a0740 4 client.7101 mds_command: new command op to 6846 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:12:08.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21d14a0740 1 -- 172.21.15.49:0/565205027 --> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x21e9390 con 0x2419fa0 2024-01-22T05:12:08.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21bfe00700 1 --2- 172.21.15.49:0/565205027 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2419fa0 0x241fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21bfe00700 1 --2- 172.21.15.49:0/565205027 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2419fa0 0x241fe90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9d412a38cd73cc53 server_cookie=da33bbdc0c1951e7 in_seq=0 out_seq=0 2024-01-22T05:12:08.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21acc00700 10 client.7101 ms_handle_connect on v2:172.21.15.110:6832/1072346524 2024-01-22T05:12:08.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21acc00700 1 -- 172.21.15.49:0/565205027 <== mds.0 v2:172.21.15.110:6832/1072346524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x21e9390 con 0x2419fa0 2024-01-22T05:12:08.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21acc00700 10 client.7101 handle_command_reply: tid=0 2024-01-22T05:12:08.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21d14a0740 1 client.7101 shutdown 2024-01-22T05:12:08.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21d14a0740 1 -- 172.21.15.49:0/565205027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449ee0 msgr2=0x241f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21d14a0740 1 --2- 172.21.15.49:0/565205027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449ee0 0x241f9a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f21b804b8a0 tx=0x7f21b8055000).stop 2024-01-22T05:12:08.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21d14a0740 1 -- 172.21.15.49:0/565205027 shutdown_connections 2024-01-22T05:12:08.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21d14a0740 1 --2- 172.21.15.49:0/565205027 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2419fa0 0x241fe90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21d14a0740 1 --2- 172.21.15.49:0/565205027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2449ee0 0x241f9a0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21d14a0740 1 --2- 172.21.15.49:0/565205027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2449570 0x2447f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21d14a0740 1 --2- 172.21.15.49:0/565205027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24424d0 0x2428cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21acc00700 0 client.7101 ms_handle_reset on v2:172.21.15.110:6832/1072346524 2024-01-22T05:12:08.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21d14a0740 1 -- 172.21.15.49:0/565205027 >> 172.21.15.49:0/565205027 conn(0x21dc680 msgr2=0x24294f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:08.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.242+0000 7f21d14a0740 1 -- 172.21.15.49:0/565205027 shutdown_connections 2024-01-22T05:12:08.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.246+0000 7f21d14a0740 1 -- 172.21.15.49:0/565205027 wait complete. 2024-01-22T05:12:08.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.246+0000 7f21d14a0740 20 client.7101 trim_cache size 0 max 16384 2024-01-22T05:12:08.251 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:12:08.252 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-01-22T05:12:08.252 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-01-22T05:12:08.252 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:12:08.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.246+0000 7f21c7000700 1 -- 172.21.15.49:0/1390952406 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f219805a510 msgr2=0x7f219805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.246+0000 7f21c7000700 1 --2- 172.21.15.49:0/1390952406 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f219805a510 0x7f219805c9d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f21b0009c30 tx=0x7f21b0009060).stop 2024-01-22T05:12:08.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.246+0000 7f21c7000700 1 -- 172.21.15.49:0/1390952406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c015bad0 msgr2=0x7f21c0159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.246+0000 7f21c7000700 1 --2- 172.21.15.49:0/1390952406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c015bad0 0x7f21c0159910 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f21b8005ad0 tx=0x7f21b8001650).stop 2024-01-22T05:12:08.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.246+0000 7f21c7000700 1 -- 172.21.15.49:0/1390952406 shutdown_connections 2024-01-22T05:12:08.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.246+0000 7f21c7000700 1 --2- 172.21.15.49:0/1390952406 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f219805a510 0x7f219805c9d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.246+0000 7f21c7000700 1 --2- 172.21.15.49:0/1390952406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c015bad0 0x7f21c0159910 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.246+0000 7f21c7000700 1 --2- 172.21.15.49:0/1390952406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c01524f0 0x7f21c015df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.246+0000 7f21c7000700 1 --2- 172.21.15.49:0/1390952406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c00a8760 0x7f21c016c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.246+0000 7f21c7000700 1 -- 172.21.15.49:0/1390952406 >> 172.21.15.49:0/1390952406 conn(0x7f21c00c6560 msgr2=0x7f21c00c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:08.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.246+0000 7f21c7000700 1 -- 172.21.15.49:0/1390952406 shutdown_connections 2024-01-22T05:12:08.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.246+0000 7f21c7000700 1 -- 172.21.15.49:0/1390952406 wait complete. 2024-01-22T05:12:08.272 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-22T05:12:08.273 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 perf dump 2024-01-22T05:12:08.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.430+0000 7fb8f1000700 1 Processor -- start 2024-01-22T05:12:08.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.430+0000 7fb8f1000700 1 -- start start 2024-01-22T05:12:08.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.434+0000 7fb8f1000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8ec0690f0 0x7fb8ec0a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.434+0000 7fb8f1000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ec0bd3e0 con 0x7fb8ec15bad0 2024-01-22T05:12:08.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.434+0000 7fb8f1000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ec067c50 con 0x7fb8ec1524f0 2024-01-22T05:12:08.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.434+0000 7fb8f1000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0bcb40 con 0x7fb8ec0690f0 2024-01-22T05:12:08.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.434+0000 7fb8e9400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb8ec15bad0 0x7fb8ec0a8760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34724/0 (socket says 172.21.15.49:34724) 2024-01-22T05:12:08.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.434+0000 7fb8e9400700 1 -- 172.21.15.49:0/4180942292 learned_addr learned my addr 172.21.15.49:0/4180942292 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:08.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.434+0000 7fb8ea800700 1 --2- 172.21.15.49:0/4180942292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8ec0690f0 0x7fb8ec0a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.434+0000 7fb8e8a00700 1 -- 172.21.15.49:0/4180942292 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161567007 0 0) 0x7fb8ec0bd3e0 con 0x7fb8ec15bad0 2024-01-22T05:12:08.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.434+0000 7fb8e8a00700 1 -- 172.21.15.49:0/4180942292 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8cc0033f0 con 0x7fb8ec15bad0 2024-01-22T05:12:08.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.434+0000 7fb8e8a00700 1 -- 172.21.15.49:0/4180942292 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325549936 0 0) 0x7fb8ec067c50 con 0x7fb8ec1524f0 2024-01-22T05:12:08.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.434+0000 7fb8e8a00700 1 -- 172.21.15.49:0/4180942292 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8ec0bd3e0 con 0x7fb8ec1524f0 2024-01-22T05:12:08.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.434+0000 7fb8ea800700 1 -- 172.21.15.49:0/4180942292 >> v1:172.21.15.110:6789/0 conn(0x7fb8ec1524f0 legacy=0x7fb8ec066400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.434+0000 7fb8e8a00700 1 -- 172.21.15.49:0/4180942292 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4219810284 0 0) 0x7fb8cc0033f0 con 0x7fb8ec15bad0 2024-01-22T05:12:08.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.434+0000 7fb8ea800700 1 -- 172.21.15.49:0/4180942292 >> v1:172.21.15.49:6789/0 conn(0x7fb8ec15bad0 legacy=0x7fb8ec0a8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.434+0000 7fb8ea800700 1 -- 172.21.15.49:0/4180942292 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec0bce20 con 0x7fb8ec0690f0 2024-01-22T05:12:08.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.438+0000 7fb8ea800700 1 --2- 172.21.15.49:0/4180942292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8ec0690f0 0x7fb8ec0a8e70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fb8e4009e90 tx=0x7fb8e4009780).ready entity=mon.2 client_cookie=91b17d797085d29c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.438+0000 7fb8e8a00700 1 -- 172.21.15.49:0/4180942292 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400e070 con 0x7fb8ec0690f0 2024-01-22T05:12:08.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.438+0000 7fb8e8a00700 1 -- 172.21.15.49:0/4180942292 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e400b7a0 con 0x7fb8ec0690f0 2024-01-22T05:12:08.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.438+0000 7fb8e8a00700 1 -- 172.21.15.49:0/4180942292 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4001470 con 0x7fb8ec0690f0 2024-01-22T05:12:08.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.438+0000 7fb8f1000700 1 -- 172.21.15.49:0/4180942292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8ec0690f0 msgr2=0x7fb8ec0a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.438+0000 7fb8f1000700 1 --2- 172.21.15.49:0/4180942292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8ec0690f0 0x7fb8ec0a8e70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fb8e4009e90 tx=0x7fb8e4009780).stop 2024-01-22T05:12:08.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.438+0000 7fb8f1000700 1 -- 172.21.15.49:0/4180942292 shutdown_connections 2024-01-22T05:12:08.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.438+0000 7fb8f1000700 1 --2- 172.21.15.49:0/4180942292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8ec0690f0 0x7fb8ec0a8e70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.438+0000 7fb8f1000700 1 -- 172.21.15.49:0/4180942292 >> 172.21.15.49:0/4180942292 conn(0x7fb8ec0c6560 msgr2=0x7fb8ec0c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:08.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.438+0000 7fb8f1000700 1 -- 172.21.15.49:0/4180942292 shutdown_connections 2024-01-22T05:12:08.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.438+0000 7fb8f1000700 1 -- 172.21.15.49:0/4180942292 wait complete. 2024-01-22T05:12:08.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.442+0000 7fb8f1000700 1 Processor -- start 2024-01-22T05:12:08.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.442+0000 7fb8f1000700 1 -- start start 2024-01-22T05:12:08.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.442+0000 7fb8f1000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8ec0690f0 0x7fb8ec15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.442+0000 7fb8f1000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8ec1524f0 0x7fb8ec0be7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.442+0000 7fb8f1000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8ec15bad0 0x7fb8ec0bec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.442+0000 7fb8f1000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0bf180 con 0x7fb8ec0690f0 2024-01-22T05:12:08.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.442+0000 7fb8f1000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec15a830 con 0x7fb8ec1524f0 2024-01-22T05:12:08.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.442+0000 7fb8f1000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec159c20 con 0x7fb8ec15bad0 2024-01-22T05:12:08.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.442+0000 7fb8e9e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8ec0690f0 0x7fb8ec15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.442+0000 7fb8e9e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8ec0690f0 0x7fb8ec15acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34972/0 (socket says 172.21.15.49:34972) 2024-01-22T05:12:08.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.442+0000 7fb8e9e00700 1 -- 172.21.15.49:0/2917753241 learned_addr learned my addr 172.21.15.49:0/2917753241 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:08.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.446+0000 7fb8ea800700 1 --2- 172.21.15.49:0/2917753241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8ec15bad0 0x7fb8ec0bec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.446+0000 7fb8e9400700 1 --2- 172.21.15.49:0/2917753241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8ec1524f0 0x7fb8ec0be7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.446+0000 7fb8e9e00700 1 -- 172.21.15.49:0/2917753241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8ec15bad0 msgr2=0x7fb8ec0bec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.446+0000 7fb8e9e00700 1 --2- 172.21.15.49:0/2917753241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8ec15bad0 0x7fb8ec0bec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.446+0000 7fb8e9e00700 1 -- 172.21.15.49:0/2917753241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8ec1524f0 msgr2=0x7fb8ec0be7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.446+0000 7fb8e9e00700 1 --2- 172.21.15.49:0/2917753241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8ec1524f0 0x7fb8ec0be7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.446+0000 7fb8e9e00700 1 -- 172.21.15.49:0/2917753241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e4009a20 con 0x7fb8ec0690f0 2024-01-22T05:12:08.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.446+0000 7fb8e9400700 1 --2- 172.21.15.49:0/2917753241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8ec1524f0 0x7fb8ec0be7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:08.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.446+0000 7fb8e9e00700 1 --2- 172.21.15.49:0/2917753241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8ec0690f0 0x7fb8ec15acc0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fb8dc00c490 tx=0x7fb8dc007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.446+0000 7fb8e1600700 1 -- 172.21.15.49:0/2917753241 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc00f470 con 0x7fb8ec0690f0 2024-01-22T05:12:08.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.446+0000 7fb8e1600700 1 -- 172.21.15.49:0/2917753241 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8dc00f5d0 con 0x7fb8ec0690f0 2024-01-22T05:12:08.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.446+0000 7fb8f1000700 1 -- 172.21.15.49:0/2917753241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ec159f00 con 0x7fb8ec0690f0 2024-01-22T05:12:08.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.446+0000 7fb8e1600700 1 -- 172.21.15.49:0/2917753241 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc00f970 con 0x7fb8ec0690f0 2024-01-22T05:12:08.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.446+0000 7fb8f1000700 1 -- 172.21.15.49:0/2917753241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ec15a4c0 con 0x7fb8ec0690f0 2024-01-22T05:12:08.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.450+0000 7fb8e1600700 1 -- 172.21.15.49:0/2917753241 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb8dc00fce0 con 0x7fb8ec0690f0 2024-01-22T05:12:08.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.450+0000 7fb8e1600700 1 --2- 172.21.15.49:0/2917753241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8c405a510 0x7fb8c405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.450+0000 7fb8e1600700 1 -- 172.21.15.49:0/2917753241 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fb8dc073fb0 con 0x7fb8ec0690f0 2024-01-22T05:12:08.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.450+0000 7fb8e9400700 1 --2- 172.21.15.49:0/2917753241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8c405a510 0x7fb8c405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.454+0000 7fb8e9400700 1 --2- 172.21.15.49:0/2917753241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8c405a510 0x7fb8c405c9d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fb8d4001ed0 tx=0x7fb8d40015a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.454+0000 7fb8fb56c740 1 Processor -- start 2024-01-22T05:12:08.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.454+0000 7fb8fb56c740 1 -- start start 2024-01-22T05:12:08.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.454+0000 7fb8fb56c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26985c0 0x26989a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.454+0000 7fb8fb56c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x2653cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.454+0000 7fb8fb56c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26541b0 0x2654610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.454+0000 7fb8fb56c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x25912a0 con 0x2699170 2024-01-22T05:12:08.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.454+0000 7fb8fb56c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x25b44a0 con 0x26541b0 2024-01-22T05:12:08.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.454+0000 7fb8fb56c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x257dce0 con 0x26985c0 2024-01-22T05:12:08.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.454+0000 7fb8e9400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x2653cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.454+0000 7fb8e9400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x2653cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34980/0 (socket says 172.21.15.49:34980) 2024-01-22T05:12:08.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.454+0000 7fb8e9400700 1 -- 172.21.15.49:0/726078427 learned_addr learned my addr 172.21.15.49:0/726078427 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:08.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8ea800700 1 --2- 172.21.15.49:0/726078427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26541b0 0x2654610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8e9e00700 1 --2- 172.21.15.49:0/726078427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26985c0 0x26989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8e9400700 1 -- 172.21.15.49:0/726078427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26985c0 msgr2=0x26989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8e9400700 1 --2- 172.21.15.49:0/726078427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26985c0 0x26989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8e9400700 1 -- 172.21.15.49:0/726078427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26541b0 msgr2=0x2654610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8e9400700 1 --2- 172.21.15.49:0/726078427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26541b0 0x2654610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8e9400700 1 -- 172.21.15.49:0/726078427 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x25e28e0 con 0x2699170 2024-01-22T05:12:08.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8ea800700 1 --2- 172.21.15.49:0/726078427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26541b0 0x2654610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:08.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8e9400700 1 --2- 172.21.15.49:0/726078427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x2653cc0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7fb8d400e8c0 tx=0x7fb8d400a000).ready entity=mon.0 client_cookie=72d98fc4077698b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8da000700 1 -- 172.21.15.49:0/726078427 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d40187f0 con 0x2699170 2024-01-22T05:12:08.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8da000700 1 -- 172.21.15.49:0/726078427 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d4018950 con 0x2699170 2024-01-22T05:12:08.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8da000700 1 -- 172.21.15.49:0/726078427 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4018cd0 con 0x2699170 2024-01-22T05:12:08.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8fb56c740 1 -- 172.21.15.49:0/726078427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 msgr2=0x2653cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/726078427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x2653cc0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7fb8d400e8c0 tx=0x7fb8d400a000).stop 2024-01-22T05:12:08.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8fb56c740 1 -- 172.21.15.49:0/726078427 shutdown_connections 2024-01-22T05:12:08.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/726078427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26541b0 0x2654610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/726078427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x2653cc0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/726078427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26985c0 0x26989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8fb56c740 1 -- 172.21.15.49:0/726078427 >> 172.21.15.49:0/726078427 conn(0x2436640 msgr2=0x269de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:08.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8fb56c740 1 -- 172.21.15.49:0/726078427 shutdown_connections 2024-01-22T05:12:08.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.458+0000 7fb8fb56c740 1 -- 172.21.15.49:0/726078427 wait complete. 2024-01-22T05:12:08.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.462+0000 7fb8fb56c740 1 -- start start 2024-01-22T05:12:08.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.462+0000 7fb8fb56c740 1 Processor -- start 2024-01-22T05:12:08.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26541b0 0x2651e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26985c0 0x266f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x266fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2670210 con 0x2699170 2024-01-22T05:12:08.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x26aa460 con 0x26541b0 2024-01-22T05:12:08.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x267bcc0 con 0x26985c0 2024-01-22T05:12:08.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 10 client.0 ll_register_callbacks cb 0x260e9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:12:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8ea800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x266fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8ea800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x266fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34988/0 (socket says 172.21.15.49:34988) 2024-01-22T05:12:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8ea800700 1 -- 172.21.15.49:0/35632326 learned_addr learned my addr 172.21.15.49:0/35632326 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8e9e00700 1 --2- 172.21.15.49:0/35632326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26541b0 0x2651e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8e9400700 1 --2- 172.21.15.49:0/35632326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26985c0 0x266f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8ea800700 1 -- 172.21.15.49:0/35632326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26985c0 msgr2=0x266f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8ea800700 1 --2- 172.21.15.49:0/35632326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26985c0 0x266f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8ea800700 1 -- 172.21.15.49:0/35632326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26541b0 msgr2=0x2651e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8ea800700 1 --2- 172.21.15.49:0/35632326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26541b0 0x2651e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8ea800700 1 -- 172.21.15.49:0/35632326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d400f040 con 0x2699170 2024-01-22T05:12:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8ea800700 1 --2- 172.21.15.49:0/35632326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x266fd20 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7fb8ec05f520 tx=0x7fb8ec067bc0).ready entity=mon.0 client_cookie=f61cd7bfe6c16c16 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8d2a00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:12:08.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8d2a00700 1 -- 172.21.15.49:0/35632326 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4020650 con 0x2699170 2024-01-22T05:12:08.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 1 -- 172.21.15.49:0/35632326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x25ce1f0 con 0x2699170 2024-01-22T05:12:08.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8d2a00700 1 -- 172.21.15.49:0/35632326 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fb8e40207b0 con 0x2699170 2024-01-22T05:12:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8d2a00700 1 -- 172.21.15.49:0/35632326 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8e4020b80 con 0x2699170 2024-01-22T05:12:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 10 client.7113 fetch_fsmap learned FSMap version 83 2024-01-22T05:12:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 1 -- 172.21.15.49:0/35632326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x25d1780 con 0x2699170 2024-01-22T05:12:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8d2a00700 1 -- 172.21.15.49:0/35632326 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x25ce1f0 con 0x2699170 2024-01-22T05:12:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8d2a00700 1 -- 172.21.15.49:0/35632326 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 83) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb8e4020ce0 con 0x2699170 2024-01-22T05:12:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 10 client.7113 fetch_fsmap finished waiting for FSMap version 83 2024-01-22T05:12:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 10 client.7113 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-01-22T05:12:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 20 client.7113 populate_metadata read hostname 'smithi049' 2024-01-22T05:12:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/35632326 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x267c160 0x26a9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 4 client.7113 mds_command: new command op to 6846 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:12:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.466+0000 7fb8fb56c740 1 -- 172.21.15.49:0/35632326 --> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x25c4740 con 0x267c160 2024-01-22T05:12:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.470+0000 7fb8e9e00700 1 --2- 172.21.15.49:0/35632326 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x267c160 0x26a9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.470+0000 7fb8d2a00700 10 client.7113 ms_handle_connect on v2:172.21.15.110:6832/1072346524 2024-01-22T05:12:08.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.470+0000 7fb8e9e00700 1 --2- 172.21.15.49:0/35632326 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x267c160 0x26a9ae0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f8fc8850b2c4abf3 server_cookie=8acc573cafb786e7 in_seq=0 out_seq=0 2024-01-22T05:12:08.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.470+0000 7fb8d2a00700 1 -- 172.21.15.49:0/35632326 <== mds.0 v2:172.21.15.110:6832/1072346524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x25c4740 con 0x267c160 2024-01-22T05:12:08.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.470+0000 7fb8d2a00700 10 client.7113 handle_command_reply: tid=0 2024-01-22T05:12:08.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.470+0000 7fb8fb56c740 1 client.7113 shutdown 2024-01-22T05:12:08.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.470+0000 7fb8fb56c740 1 -- 172.21.15.49:0/35632326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 msgr2=0x266fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.470+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/35632326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x266fd20 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7fb8ec05f520 tx=0x7fb8ec067bc0).stop 2024-01-22T05:12:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.474+0000 7fb8fb56c740 1 -- 172.21.15.49:0/35632326 shutdown_connections 2024-01-22T05:12:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.474+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/35632326 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x267c160 0x26a9ae0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.474+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/35632326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x266fd20 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.474+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/35632326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26985c0 0x266f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.474+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/35632326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26541b0 0x2651e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.474+0000 7fb8d2a00700 0 client.7113 ms_handle_reset on v2:172.21.15.110:6832/1072346524 2024-01-22T05:12:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.474+0000 7fb8fb56c740 1 -- 172.21.15.49:0/35632326 >> 172.21.15.49:0/35632326 conn(0x2436640 msgr2=0x2694650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.474+0000 7fb8fb56c740 1 -- 172.21.15.49:0/35632326 shutdown_connections 2024-01-22T05:12:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.474+0000 7fb8fb56c740 1 -- 172.21.15.49:0/35632326 wait complete. 2024-01-22T05:12:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.474+0000 7fb8fb56c740 20 client.7113 trim_cache size 0 max 16384 2024-01-22T05:12:08.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.498+0000 7fb8fb56c740 1 Processor -- start 2024-01-22T05:12:08.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.498+0000 7fb8fb56c740 1 -- start start 2024-01-22T05:12:08.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.498+0000 7fb8fb56c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26541b0 0x267c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.498+0000 7fb8fb56c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26985c0 0x266f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.498+0000 7fb8fb56c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x266f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.498+0000 7fb8fb56c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2656880 con 0x2699170 2024-01-22T05:12:08.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.498+0000 7fb8fb56c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x267b450 con 0x26985c0 2024-01-22T05:12:08.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.498+0000 7fb8fb56c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2680130 con 0x26541b0 2024-01-22T05:12:08.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8ea800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x266f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8e9e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26541b0 0x267c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8ea800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x266f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34998/0 (socket says 172.21.15.49:34998) 2024-01-22T05:12:08.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8e9400700 1 --2- 172.21.15.49:0/788857846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26985c0 0x266f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8ea800700 1 -- 172.21.15.49:0/788857846 learned_addr learned my addr 172.21.15.49:0/788857846 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:08.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8e9400700 1 -- 172.21.15.49:0/788857846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26541b0 msgr2=0x267c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8e9400700 1 --2- 172.21.15.49:0/788857846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26541b0 0x267c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8e9400700 1 -- 172.21.15.49:0/788857846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 msgr2=0x266f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8e9400700 1 --2- 172.21.15.49:0/788857846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x266f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8e9400700 1 -- 172.21.15.49:0/788857846 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x25cc9b0 con 0x26985c0 2024-01-22T05:12:08.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8e9400700 1 --2- 172.21.15.49:0/788857846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26985c0 0x266f4d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fb8d4008000 tx=0x7fb8d4016000).ready entity=mon.1 client_cookie=e6a2c34e75015ee7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8daa00700 1 -- 172.21.15.49:0/788857846 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d402a070 con 0x26985c0 2024-01-22T05:12:08.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8daa00700 1 -- 172.21.15.49:0/788857846 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d400e630 con 0x26985c0 2024-01-22T05:12:08.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8daa00700 1 -- 172.21.15.49:0/788857846 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4001820 con 0x26985c0 2024-01-22T05:12:08.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8fb56c740 1 -- 172.21.15.49:0/788857846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26985c0 msgr2=0x266f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/788857846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26985c0 0x266f4d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fb8d4008000 tx=0x7fb8d4016000).stop 2024-01-22T05:12:08.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8fb56c740 1 -- 172.21.15.49:0/788857846 shutdown_connections 2024-01-22T05:12:08.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/788857846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2699170 0x266f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/788857846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26985c0 0x266f4d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/788857846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26541b0 0x267c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8fb56c740 1 -- 172.21.15.49:0/788857846 >> 172.21.15.49:0/788857846 conn(0x2436640 msgr2=0x2696660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:08.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8fb56c740 1 -- 172.21.15.49:0/788857846 shutdown_connections 2024-01-22T05:12:08.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.502+0000 7fb8fb56c740 1 -- 172.21.15.49:0/788857846 wait complete. 2024-01-22T05:12:08.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.506+0000 7fb8fb56c740 1 -- start start 2024-01-22T05:12:08.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.506+0000 7fb8fb56c740 1 Processor -- start 2024-01-22T05:12:08.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.506+0000 7fb8fb56c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26541b0 0x266fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.506+0000 7fb8fb56c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26985c0 0x26fec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.506+0000 7fb8fb56c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2699170 0x2654a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.506+0000 7fb8fb56c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x26833b0 con 0x26541b0 2024-01-22T05:12:08.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.506+0000 7fb8fb56c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x26b3660 con 0x26985c0 2024-01-22T05:12:08.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.506+0000 7fb8fb56c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x266f830 con 0x2699170 2024-01-22T05:12:08.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.506+0000 7fb8fb56c740 10 client.0 ll_register_callbacks cb 0x7fb8e400b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:12:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.506+0000 7fb8e9e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26541b0 0x266fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.506+0000 7fb8e9e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26541b0 0x266fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35002/0 (socket says 172.21.15.49:35002) 2024-01-22T05:12:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.506+0000 7fb8e9e00700 1 -- 172.21.15.49:0/2442343000 learned_addr learned my addr 172.21.15.49:0/2442343000 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8e9400700 1 --2- 172.21.15.49:0/2442343000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26985c0 0x26fec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8ea800700 1 --2- 172.21.15.49:0/2442343000 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2699170 0x2654a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8e9e00700 1 -- 172.21.15.49:0/2442343000 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2699170 msgr2=0x2654a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8e9e00700 1 --2- 172.21.15.49:0/2442343000 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2699170 0x2654a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8e9e00700 1 -- 172.21.15.49:0/2442343000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26985c0 msgr2=0x26fec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8e9e00700 1 --2- 172.21.15.49:0/2442343000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26985c0 0x26fec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8e9e00700 1 -- 172.21.15.49:0/2442343000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x25e28e0 con 0x26541b0 2024-01-22T05:12:08.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8e9e00700 1 --2- 172.21.15.49:0/2442343000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26541b0 0x266fcc0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fb8dc0722d0 tx=0x7fb8dc04d040).ready entity=mon.0 client_cookie=695dc71571fd410a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8d2a00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:12:08.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8d2a00700 1 -- 172.21.15.49:0/2442343000 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc050040 con 0x26541b0 2024-01-22T05:12:08.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8d2a00700 1 -- 172.21.15.49:0/2442343000 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fb8dc055070 con 0x26541b0 2024-01-22T05:12:08.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8fb56c740 1 -- 172.21.15.49:0/2442343000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb8d4018950 con 0x26541b0 2024-01-22T05:12:08.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8d2a00700 1 -- 172.21.15.49:0/2442343000 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8dc047a70 con 0x26541b0 2024-01-22T05:12:08.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8fb56c740 10 client.7119 fetch_fsmap learned FSMap version 83 2024-01-22T05:12:08.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8fb56c740 1 -- 172.21.15.49:0/2442343000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x25cc700 con 0x26541b0 2024-01-22T05:12:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8d2a00700 1 -- 172.21.15.49:0/2442343000 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d4018950 con 0x26541b0 2024-01-22T05:12:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8d2a00700 1 -- 172.21.15.49:0/2442343000 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 83) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb8dc050b30 con 0x26541b0 2024-01-22T05:12:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8fb56c740 10 client.7119 fetch_fsmap finished waiting for FSMap version 83 2024-01-22T05:12:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8fb56c740 10 client.7119 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-01-22T05:12:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8fb56c740 20 client.7119 populate_metadata read hostname 'smithi049' 2024-01-22T05:12:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/2442343000 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2654f20 0x26825d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8fb56c740 4 client.7119 mds_command: new command op to 6846 tid=0[{"prefix": "perf dump"}] 2024-01-22T05:12:08.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8fb56c740 1 -- 172.21.15.49:0/2442343000 --> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x248d5d0 con 0x2654f20 2024-01-22T05:12:08.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8e9400700 1 --2- 172.21.15.49:0/2442343000 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2654f20 0x26825d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8d2a00700 10 client.7119 ms_handle_connect on v2:172.21.15.110:6832/1072346524 2024-01-22T05:12:08.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.510+0000 7fb8e9400700 1 --2- 172.21.15.49:0/2442343000 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2654f20 0x26825d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=bff6162bea7dbed0 server_cookie=b5586108a537f8c in_seq=0 out_seq=0 2024-01-22T05:12:08.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.514+0000 7fb8d2a00700 1 -- 172.21.15.49:0/2442343000 <== mds.0 v2:172.21.15.110:6832/1072346524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17080 (crc 0 0 0) 0x248d5d0 con 0x2654f20 2024-01-22T05:12:08.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.514+0000 7fb8d2a00700 10 client.7119 handle_command_reply: tid=0 2024-01-22T05:12:08.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.514+0000 7fb8fb56c740 1 client.7119 shutdown 2024-01-22T05:12:08.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.514+0000 7fb8fb56c740 1 -- 172.21.15.49:0/2442343000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26541b0 msgr2=0x266fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.514+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/2442343000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26541b0 0x266fcc0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fb8dc0722d0 tx=0x7fb8dc04d040).stop 2024-01-22T05:12:08.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.514+0000 7fb8fb56c740 1 -- 172.21.15.49:0/2442343000 shutdown_connections 2024-01-22T05:12:08.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.514+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/2442343000 >> [v2:172.21.15.110:6832/1072346524,v1:172.21.15.110:6834/1072346524] conn(0x2654f20 0x26825d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.514+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/2442343000 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2699170 0x2654a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.514+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/2442343000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26985c0 0x26fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.514+0000 7fb8fb56c740 1 --2- 172.21.15.49:0/2442343000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26541b0 0x266fcc0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.514+0000 7fb8d2a00700 0 client.7119 ms_handle_reset on v2:172.21.15.110:6832/1072346524 2024-01-22T05:12:08.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.514+0000 7fb8fb56c740 1 -- 172.21.15.49:0/2442343000 >> 172.21.15.49:0/2442343000 conn(0x2436640 msgr2=0x267c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.514+0000 7fb8fb56c740 1 -- 172.21.15.49:0/2442343000 shutdown_connections 2024-01-22T05:12:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.514+0000 7fb8fb56c740 1 -- 172.21.15.49:0/2442343000 wait complete. 2024-01-22T05:12:08.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.514+0000 7fb8fb56c740 20 client.7119 trim_cache size 0 max 16384 2024-01-22T05:12:08.520 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:12:08.520 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-01-22T05:12:08.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 2217, 2024-01-22T05:12:08.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 2198, 2024-01-22T05:12:08.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 727986, 2024-01-22T05:12:08.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 14788867, 2024-01-22T05:12:08.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 16, 2024-01-22T05:12:08.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 6, 2024-01-22T05:12:08.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.336771125, 2024-01-22T05:12:08.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.141835025, 2024-01-22T05:12:08.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.087338273, 2024-01-22T05:12:08.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.075665768, 2024-01-22T05:12:08.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-01-22T05:12:08.521 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2198, 2024-01-22T05:12:08.521 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.884724817, 2024-01-22T05:12:08.521 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000402513 2024-01-22T05:12:08.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-01-22T05:12:08.521 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 10, 2024-01-22T05:12:08.521 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000002304, 2024-01-22T05:12:08.521 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000230 2024-01-22T05:12:08.521 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:08.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.522 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-01-22T05:12:08.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 7024, 2024-01-22T05:12:08.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 7053, 2024-01-22T05:12:08.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 2426617, 2024-01-22T05:12:08.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 40977688, 2024-01-22T05:12:08.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 6, 2024-01-22T05:12:08.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-01-22T05:12:08.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.940770789, 2024-01-22T05:12:08.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.449884540, 2024-01-22T05:12:08.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.180558673, 2024-01-22T05:12:08.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.249446260, 2024-01-22T05:12:08.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-01-22T05:12:08.522 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 7052, 2024-01-22T05:12:08.522 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 4.203285818, 2024-01-22T05:12:08.522 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000596041 2024-01-22T05:12:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-01-22T05:12:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-01-22T05:12:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 33586, 2024-01-22T05:12:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 54656, 2024-01-22T05:12:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 11214329, 2024-01-22T05:12:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 67098018, 2024-01-22T05:12:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 8, 2024-01-22T05:12:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-01-22T05:12:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 5.963960749, 2024-01-22T05:12:08.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 3.444952337, 2024-01-22T05:12:08.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 2.351541462, 2024-01-22T05:12:08.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.455267005, 2024-01-22T05:12:08.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-01-22T05:12:08.524 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 54655, 2024-01-22T05:12:08.524 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 8.592061306, 2024-01-22T05:12:08.524 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000157205 2024-01-22T05:12:08.524 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-01-22T05:12:08.524 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 44974, 2024-01-22T05:12:08.524 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.023350940, 2024-01-22T05:12:08.524 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000519 2024-01-22T05:12:08.524 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:08.524 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.524 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-01-22T05:12:08.525 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 1, 2024-01-22T05:12:08.525 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-01-22T05:12:08.525 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.525 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-MDSRank": { 2024-01-22T05:12:08.525 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-01-22T05:12:08.525 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-01-22T05:12:08.525 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6430, 2024-01-22T05:12:08.525 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 19.833852879, 2024-01-22T05:12:08.525 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.003084580 2024-01-22T05:12:08.525 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:08.525 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.525 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-PurgeQueue": { 2024-01-22T05:12:08.525 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-01-22T05:12:08.525 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-01-22T05:12:08.525 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3553, 2024-01-22T05:12:08.526 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 1.190819737, 2024-01-22T05:12:08.526 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000335158 2024-01-22T05:12:08.526 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:08.526 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.526 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-01-22T05:12:08.526 INFO:teuthology.orchestra.run.smithi049.stdout: "request": 26126, 2024-01-22T05:12:08.526 INFO:teuthology.orchestra.run.smithi049.stdout: "reply": 26126, 2024-01-22T05:12:08.526 INFO:teuthology.orchestra.run.smithi049.stdout: "reply_latency": { 2024-01-22T05:12:08.526 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 26126, 2024-01-22T05:12:08.526 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 319.517458643, 2024-01-22T05:12:08.526 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.012229865 2024-01-22T05:12:08.526 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.526 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_reply": 0, 2024-01-22T05:12:08.526 INFO:teuthology.orchestra.run.smithi049.stdout: "forward": 0, 2024-01-22T05:12:08.527 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch": 0, 2024-01-22T05:12:08.527 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_commit": 81, 2024-01-22T05:12:08.527 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_split": 0, 2024-01-22T05:12:08.527 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_merge": 0, 2024-01-22T05:12:08.527 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes": 7547, 2024-01-22T05:12:08.527 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_top": 5275, 2024-01-22T05:12:08.527 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_bottom": 2272, 2024-01-22T05:12:08.527 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pin_tail": 0, 2024-01-22T05:12:08.527 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pinned": 11, 2024-01-22T05:12:08.527 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_expired": 8001, 2024-01-22T05:12:08.527 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_with_caps": 2, 2024-01-22T05:12:08.527 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": 2, 2024-01-22T05:12:08.527 INFO:teuthology.orchestra.run.smithi049.stdout: "subtrees": 2, 2024-01-22T05:12:08.527 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse": 48783, 2024-01-22T05:12:08.528 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_hit": 48303, 2024-01-22T05:12:08.528 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_forward": 0, 2024-01-22T05:12:08.528 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_discover": 0, 2024-01-22T05:12:08.528 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_dir_fetch": 0, 2024-01-22T05:12:08.528 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_remote_ino": 0, 2024-01-22T05:12:08.528 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_lock": 136, 2024-01-22T05:12:08.528 INFO:teuthology.orchestra.run.smithi049.stdout: "load_cent": 6862, 2024-01-22T05:12:08.528 INFO:teuthology.orchestra.run.smithi049.stdout: "q": 0, 2024-01-22T05:12:08.528 INFO:teuthology.orchestra.run.smithi049.stdout: "exported": 0, 2024-01-22T05:12:08.528 INFO:teuthology.orchestra.run.smithi049.stdout: "exported_inodes": 0, 2024-01-22T05:12:08.528 INFO:teuthology.orchestra.run.smithi049.stdout: "imported": 0, 2024-01-22T05:12:08.528 INFO:teuthology.orchestra.run.smithi049.stdout: "imported_inodes": 0, 2024-01-22T05:12:08.528 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_dir_fetch": 0, 2024-01-22T05:12:08.528 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_backtrace_fetch": 1850, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_peer_discover": 0, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rfiles": 0, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rbytes": 0, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rsnaps": 0, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_fetch": 1850, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_set_tag": 0, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_repaired": 0, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_inotable_repaired": 0, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_inodes": 11, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_base_inodes": 1, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dirfrag_rstats": 10, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_file_inodes": 1839, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_inode_file_caps": 0, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_revoke": 735, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_grant": 4033, 2024-01-22T05:12:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_trunc": 0, 2024-01-22T05:12:08.530 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-22T05:12:08.530 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-22T05:12:08.530 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps": 3516, 2024-01-22T05:12:08.530 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps_dirty": 2000, 2024-01-22T05:12:08.530 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_cap_release": 66, 2024-01-22T05:12:08.530 INFO:teuthology.orchestra.run.smithi049.stdout: "process_request_cap_release": 14052 2024-01-22T05:12:08.530 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.530 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache": { 2024-01-22T05:12:08.530 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays": 0, 2024-01-22T05:12:08.530 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_delayed": 0, 2024-01-22T05:12:08.530 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_enqueuing": 0, 2024-01-22T05:12:08.530 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_created": 4098, 2024-01-22T05:12:08.530 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_enqueued": 3677, 2024-01-22T05:12:08.530 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_reintegrated": 2188, 2024-01-22T05:12:08.530 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_migrated": 0, 2024-01-22T05:12:08.531 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_processing": 0, 2024-01-22T05:12:08.531 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_enqueued": 0, 2024-01-22T05:12:08.531 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_prioritized": 0, 2024-01-22T05:12:08.531 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_started": 0, 2024-01-22T05:12:08.531 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_completed": 0, 2024-01-22T05:12:08.531 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_enqueue_scrub": 1, 2024-01-22T05:12:08.531 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_exportdir": 0, 2024-01-22T05:12:08.531 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_flush": 0, 2024-01-22T05:12:08.531 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragmentdir": 0, 2024-01-22T05:12:08.531 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragstats": 0, 2024-01-22T05:12:08.531 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_inodestats": 0 2024-01-22T05:12:08.531 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.531 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log": { 2024-01-22T05:12:08.531 INFO:teuthology.orchestra.run.smithi049.stdout: "evadd": 26283, 2024-01-22T05:12:08.531 INFO:teuthology.orchestra.run.smithi049.stdout: "evex": 26030, 2024-01-22T05:12:08.532 INFO:teuthology.orchestra.run.smithi049.stdout: "evtrm": 26030, 2024-01-22T05:12:08.532 INFO:teuthology.orchestra.run.smithi049.stdout: "ev": 2301, 2024-01-22T05:12:08.532 INFO:teuthology.orchestra.run.smithi049.stdout: "evexg": 0, 2024-01-22T05:12:08.532 INFO:teuthology.orchestra.run.smithi049.stdout: "evexd": 2048, 2024-01-22T05:12:08.532 INFO:teuthology.orchestra.run.smithi049.stdout: "segadd": 33, 2024-01-22T05:12:08.532 INFO:teuthology.orchestra.run.smithi049.stdout: "segex": 32, 2024-01-22T05:12:08.532 INFO:teuthology.orchestra.run.smithi049.stdout: "segtrm": 32, 2024-01-22T05:12:08.532 INFO:teuthology.orchestra.run.smithi049.stdout: "seg": 3, 2024-01-22T05:12:08.532 INFO:teuthology.orchestra.run.smithi049.stdout: "segexg": 0, 2024-01-22T05:12:08.532 INFO:teuthology.orchestra.run.smithi049.stdout: "segexd": 2, 2024-01-22T05:12:08.532 INFO:teuthology.orchestra.run.smithi049.stdout: "expos": 85942049, 2024-01-22T05:12:08.532 INFO:teuthology.orchestra.run.smithi049.stdout: "wrpos": 86096863, 2024-01-22T05:12:08.532 INFO:teuthology.orchestra.run.smithi049.stdout: "rdpos": 0, 2024-01-22T05:12:08.532 INFO:teuthology.orchestra.run.smithi049.stdout: "jlat": { 2024-01-22T05:12:08.532 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 4392, 2024-01-22T05:12:08.533 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 89.059224074, 2024-01-22T05:12:08.533 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020277601 2024-01-22T05:12:08.533 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.533 INFO:teuthology.orchestra.run.smithi049.stdout: "replayed": 0 2024-01-22T05:12:08.533 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.533 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_mem": { 2024-01-22T05:12:08.533 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 14, 2024-01-22T05:12:08.533 INFO:teuthology.orchestra.run.smithi049.stdout: "ino+": 2015, 2024-01-22T05:12:08.533 INFO:teuthology.orchestra.run.smithi049.stdout: "ino-": 2001, 2024-01-22T05:12:08.533 INFO:teuthology.orchestra.run.smithi049.stdout: "dir": 13, 2024-01-22T05:12:08.533 INFO:teuthology.orchestra.run.smithi049.stdout: "dir+": 13, 2024-01-22T05:12:08.533 INFO:teuthology.orchestra.run.smithi049.stdout: "dir-": 0, 2024-01-22T05:12:08.533 INFO:teuthology.orchestra.run.smithi049.stdout: "dn": 7547, 2024-01-22T05:12:08.533 INFO:teuthology.orchestra.run.smithi049.stdout: "dn+": 19969, 2024-01-22T05:12:08.533 INFO:teuthology.orchestra.run.smithi049.stdout: "dn-": 12422, 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: "cap": 2, 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: "cap+": 8686, 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: "cap-": 8684, 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: "rss": 85136, 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: "heap": 340196 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_server": { 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_client_request": 29682, 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_server_request": 0, 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_request": 26126, 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_session": 8, 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_peer_request": 0, 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: "req_create_latency": { 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2000, 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.489826832, 2024-01-22T05:12:08.534 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001244913 2024-01-22T05:12:08.535 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.535 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getattr_latency": { 2024-01-22T05:12:08.535 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-01-22T05:12:08.535 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.003329665, 2024-01-22T05:12:08.535 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000416208 2024-01-22T05:12:08.535 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.535 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getfilelock_latency": { 2024-01-22T05:12:08.535 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.535 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.535 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.535 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.535 INFO:teuthology.orchestra.run.smithi049.stdout: "req_link_latency": { 2024-01-22T05:12:08.535 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6000, 2024-01-22T05:12:08.535 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 12.605476613, 2024-01-22T05:12:08.535 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002100912 2024-01-22T05:12:08.536 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.536 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookup_latency": { 2024-01-22T05:12:08.536 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 7917, 2024-01-22T05:12:08.536 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 9.963284279, 2024-01-22T05:12:08.536 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001258467 2024-01-22T05:12:08.536 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.536 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookuphash_latency": { 2024-01-22T05:12:08.536 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.536 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.536 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.536 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.536 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupino_latency": { 2024-01-22T05:12:08.536 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.536 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.536 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.537 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.537 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupname_latency": { 2024-01-22T05:12:08.537 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.537 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.537 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.537 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.537 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupparent_latency": { 2024-01-22T05:12:08.537 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.537 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.537 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.537 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.537 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupsnap_latency": { 2024-01-22T05:12:08.537 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:12:08.537 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000219605, 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000219605 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lssnap_latency": { 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mkdir_latency": { 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.004145635, 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.004145635 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mknod_latency": { 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.538 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mksnap_latency": { 2024-01-22T05:12:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:12:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.017391535, 2024-01-22T05:12:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.017391535 2024-01-22T05:12:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: "req_open_latency": { 2024-01-22T05:12:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: "req_readdir_latency": { 2024-01-22T05:12:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-01-22T05:12:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.146839348, 2024-01-22T05:12:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018354918 2024-01-22T05:12:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rename_latency": { 2024-01-22T05:12:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2188, 2024-01-22T05:12:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 273.357998708, 2024-01-22T05:12:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.124935099 2024-01-22T05:12:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: "req_renamesnap_latency": { 2024-01-22T05:12:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmdir_latency": { 2024-01-22T05:12:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.541 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.541 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmsnap_latency": { 2024-01-22T05:12:08.541 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:12:08.541 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.045337119, 2024-01-22T05:12:08.541 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.045337119 2024-01-22T05:12:08.541 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.541 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmxattr_latency": { 2024-01-22T05:12:08.541 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.541 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.541 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.541 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.541 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setattr_latency": { 2024-01-22T05:12:08.541 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-01-22T05:12:08.541 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000482517, 2024-01-22T05:12:08.541 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000482517 2024-01-22T05:12:08.542 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.542 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setdirlayout_latency": { 2024-01-22T05:12:08.542 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.542 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.542 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.542 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.542 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setfilelock_latency": { 2024-01-22T05:12:08.542 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.542 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.542 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.542 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.542 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setlayout_latency": { 2024-01-22T05:12:08.542 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.542 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.542 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setxattr_latency": { 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: "req_symlink_latency": { 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: "req_unlink_latency": { 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8000, 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 20.883126787, 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002610390 2024-01-22T05:12:08.543 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.544 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_revoke_eviction": 0, 2024-01-22T05:12:08.544 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_acquisition_throttle": 0, 2024-01-22T05:12:08.544 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getvxattr_latency": { 2024-01-22T05:12:08.544 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.544 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.544 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.544 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:08.544 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.544 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_sessions": { 2024-01-22T05:12:08.544 INFO:teuthology.orchestra.run.smithi049.stdout: "session_count": 1, 2024-01-22T05:12:08.544 INFO:teuthology.orchestra.run.smithi049.stdout: "session_add": 1, 2024-01-22T05:12:08.544 INFO:teuthology.orchestra.run.smithi049.stdout: "session_remove": 0, 2024-01-22T05:12:08.544 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_open": 1, 2024-01-22T05:12:08.544 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_stale": 0, 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: "total_load": 16464, 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: "average_load": 16464, 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_session_uptime": 122, 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: "mdthresh_evicted": 0 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 18763, 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 18763, 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-22T05:12:08.545 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-01-22T05:12:08.546 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-01-22T05:12:08.546 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-01-22T05:12:08.546 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Buffer_bytes": 0, 2024-01-22T05:12:08.546 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Buffer_items": 0, 2024-01-22T05:12:08.546 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Extent_bytes": 0, 2024-01-22T05:12:08.546 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Extent_items": 0, 2024-01-22T05:12:08.546 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Blob_bytes": 0, 2024-01-22T05:12:08.546 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_Blob_items": 0, 2024-01-22T05:12:08.546 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_SharedBlob_bytes": 0, 2024-01-22T05:12:08.546 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_SharedBlob_items": 0, 2024-01-22T05:12:08.546 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-22T05:12:08.546 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-01-22T05:12:08.546 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-01-22T05:12:08.546 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-01-22T05:12:08.546 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-01-22T05:12:08.547 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-01-22T05:12:08.547 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-22T05:12:08.547 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-01-22T05:12:08.547 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-01-22T05:12:08.547 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-01-22T05:12:08.547 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-01-22T05:12:08.547 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-01-22T05:12:08.547 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-01-22T05:12:08.547 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-01-22T05:12:08.547 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-01-22T05:12:08.547 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-01-22T05:12:08.547 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 179593, 2024-01-22T05:12:08.547 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 95, 2024-01-22T05:12:08.547 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-01-22T05:12:08.547 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-01-22T05:12:08.548 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-01-22T05:12:08.548 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-01-22T05:12:08.548 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-01-22T05:12:08.548 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-01-22T05:12:08.548 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-01-22T05:12:08.548 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-01-22T05:12:08.548 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 6512, 2024-01-22T05:12:08.548 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 85, 2024-01-22T05:12:08.548 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-01-22T05:12:08.548 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-01-22T05:12:08.548 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-01-22T05:12:08.548 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-01-22T05:12:08.548 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 5633744, 2024-01-22T05:12:08.548 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 299758, 2024-01-22T05:12:08.548 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-01-22T05:12:08.549 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-01-22T05:12:08.549 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-01-22T05:12:08.549 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-01-22T05:12:08.549 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.549 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": { 2024-01-22T05:12:08.549 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-01-22T05:12:08.549 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-01-22T05:12:08.549 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 15004, 2024-01-22T05:12:08.549 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 93610008, 2024-01-22T05:12:08.549 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 37, 2024-01-22T05:12:08.549 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 15004, 2024-01-22T05:12:08.549 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-01-22T05:12:08.549 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 15004, 2024-01-22T05:12:08.549 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 24570 2024-01-22T05:12:08.549 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 15004, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 1930, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 13074, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 68, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 4680, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 79, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 4470, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 76, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 1677, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 2050, 2024-01-22T05:12:08.550 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 1851, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 9360, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-01-22T05:12:08.551 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-01-22T05:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-01-22T05:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-01-22T05:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-01-22T05:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-01-22T05:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-01-22T05:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-01-22T05:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-01-22T05:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-01-22T05:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-01-22T05:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-01-22T05:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-01-22T05:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-01-22T05:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-01-22T05:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-01-22T05:12:08.552 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 92, 2024-01-22T05:12:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-01-22T05:12:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 5, 2024-01-22T05:12:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 8, 2024-01-22T05:12:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 8, 2024-01-22T05:12:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-01-22T05:12:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-01-22T05:12:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 205, 2024-01-22T05:12:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-01-22T05:12:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 54 2024-01-22T05:12:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "oft": { 2024-01-22T05:12:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_objs": 1, 2024-01-22T05:12:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_kv_pairs": 0, 2024-01-22T05:12:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_updates": 0, 2024-01-22T05:12:08.553 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_removes": 0 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "purge_queue": { 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops": 0, 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops_high_water": 32, 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing": 0, 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_high_water": 32, 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed": 3677, 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_item_in_journal": 0 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 42822, 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 10951229, 2024-01-22T05:12:08.554 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:12:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 42822, 2024-01-22T05:12:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-01-22T05:12:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-01-22T05:12:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 42822, 2024-01-22T05:12:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 10951229, 2024-01-22T05:12:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:12:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": { 2024-01-22T05:12:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:12:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-01-22T05:12:08.555 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:12:08.556 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-01-22T05:12:08.556 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-01-22T05:12:08.556 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:12:08.556 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-01-22T05:12:08.556 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 15004, 2024-01-22T05:12:08.556 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 93994801, 2024-01-22T05:12:08.556 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 15004, 2024-01-22T05:12:08.556 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 93994801, 2024-01-22T05:12:08.556 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:12:08.556 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.556 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.556 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.556 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:08.556 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.556 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": { 2024-01-22T05:12:08.557 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:12:08.557 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-01-22T05:12:08.557 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:12:08.557 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-01-22T05:12:08.557 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-01-22T05:12:08.557 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:12:08.557 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-01-22T05:12:08.557 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 15004, 2024-01-22T05:12:08.557 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 15004, 2024-01-22T05:12:08.557 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 15004, 2024-01-22T05:12:08.557 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 15004, 2024-01-22T05:12:08.557 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:12:08.557 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.557 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.557 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.558 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:08.558 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.558 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle": { 2024-01-22T05:12:08.558 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:12:08.558 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-01-22T05:12:08.558 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:12:08.558 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 3677, 2024-01-22T05:12:08.558 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 384793, 2024-01-22T05:12:08.558 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:12:08.558 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 3677, 2024-01-22T05:12:08.558 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-01-22T05:12:08.558 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-01-22T05:12:08.558 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 78, 2024-01-22T05:12:08.558 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 384793, 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle-0x55c762274280": { 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 26283, 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 81902559, 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 26283, 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-01-22T05:12:08.559 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-01-22T05:12:08.560 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 4392, 2024-01-22T05:12:08.560 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 81902559, 2024-01-22T05:12:08.560 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-01-22T05:12:08.560 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-01-22T05:12:08.560 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-01-22T05:12:08.560 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-01-22T05:12:08.560 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:08.560 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:08.560 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:12:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.518+0000 7fb8f1000700 1 -- 172.21.15.49:0/2917753241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8c405a510 msgr2=0x7fb8c405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.518+0000 7fb8f1000700 1 --2- 172.21.15.49:0/2917753241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8c405a510 0x7fb8c405c9d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fb8d4001ed0 tx=0x7fb8d40015a0).stop 2024-01-22T05:12:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.518+0000 7fb8f1000700 1 -- 172.21.15.49:0/2917753241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8ec0690f0 msgr2=0x7fb8ec15acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.518+0000 7fb8f1000700 1 --2- 172.21.15.49:0/2917753241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8ec0690f0 0x7fb8ec15acc0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fb8dc00c490 tx=0x7fb8dc007c90).stop 2024-01-22T05:12:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.518+0000 7fb8f1000700 1 -- 172.21.15.49:0/2917753241 shutdown_connections 2024-01-22T05:12:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.518+0000 7fb8f1000700 1 --2- 172.21.15.49:0/2917753241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb8c405a510 0x7fb8c405c9d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.518+0000 7fb8f1000700 1 --2- 172.21.15.49:0/2917753241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8ec15bad0 0x7fb8ec0bec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.518+0000 7fb8f1000700 1 --2- 172.21.15.49:0/2917753241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8ec1524f0 0x7fb8ec0be7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.518+0000 7fb8f1000700 1 --2- 172.21.15.49:0/2917753241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8ec0690f0 0x7fb8ec15acc0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.518+0000 7fb8f1000700 1 -- 172.21.15.49:0/2917753241 >> 172.21.15.49:0/2917753241 conn(0x7fb8ec0c6560 msgr2=0x7fb8ec0c1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:08.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.518+0000 7fb8f1000700 1 -- 172.21.15.49:0/2917753241 shutdown_connections 2024-01-22T05:12:08.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.518+0000 7fb8f1000700 1 -- 172.21.15.49:0/2917753241 wait complete. 2024-01-22T05:12:08.563 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:12:08.563 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:12:08.606 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:12:08.648 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:12:08.648 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T05:12:08.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:08.649 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-22T05:12:08.726 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:12:08.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:12:08.727 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:12:08.737 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:12:08.808 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:12:08.841 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:12:08.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.938+0000 7fbe55200700 1 Processor -- start 2024-01-22T05:12:08.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.942+0000 7fbe55200700 1 -- start start 2024-01-22T05:12:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.942+0000 7fbe55200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe500be110 0x7fbe500c3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.942+0000 7fbe55200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe500c3680 0x7fbe500a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.942+0000 7fbe55200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe50151a60 con 0x7fbe5014b1e0 2024-01-22T05:12:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.942+0000 7fbe55200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe500c3e80 con 0x7fbe500be110 2024-01-22T05:12:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.942+0000 7fbe55200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50151130 con 0x7fbe500c3680 2024-01-22T05:12:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.942+0000 7fbe4ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe500be110 0x7fbe500c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.942+0000 7fbe4ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe500be110 0x7fbe500c3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35016/0 (socket says 172.21.15.49:35016) 2024-01-22T05:12:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.942+0000 7fbe4ea00700 1 -- 172.21.15.49:0/1199734851 learned_addr learned my addr 172.21.15.49:0/1199734851 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:08.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.942+0000 7fbe4fe00700 1 --2- 172.21.15.49:0/1199734851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe500c3680 0x7fbe500a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.942+0000 7fbe4ea00700 1 -- 172.21.15.49:0/1199734851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe500c3680 msgr2=0x7fbe500a91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.942+0000 7fbe4ea00700 1 --2- 172.21.15.49:0/1199734851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe500c3680 0x7fbe500a91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.942+0000 7fbe4ea00700 1 -- 172.21.15.49:0/1199734851 >> v1:172.21.15.110:6789/0 conn(0x7fbe5014b1e0 legacy=0x7fbe500bda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:08.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.946+0000 7fbe4ea00700 1 -- 172.21.15.49:0/1199734851 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe50151410 con 0x7fbe500be110 2024-01-22T05:12:08.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.946+0000 7fbe4ea00700 1 --2- 172.21.15.49:0/1199734851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe500be110 0x7fbe500c3190 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fbe38006fd0 tx=0x7fbe380090f0).ready entity=mon.0 client_cookie=d7a5177ad0c0283e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.946+0000 7fbe4e000700 1 -- 172.21.15.49:0/1199734851 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3800b600 con 0x7fbe500be110 2024-01-22T05:12:08.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.946+0000 7fbe4e000700 1 -- 172.21.15.49:0/1199734851 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3800b760 con 0x7fbe500be110 2024-01-22T05:12:08.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.946+0000 7fbe4e000700 1 -- 172.21.15.49:0/1199734851 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3800bae0 con 0x7fbe500be110 2024-01-22T05:12:08.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.946+0000 7fbe55200700 1 -- 172.21.15.49:0/1199734851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe500be110 msgr2=0x7fbe500c3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.946+0000 7fbe55200700 1 --2- 172.21.15.49:0/1199734851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe500be110 0x7fbe500c3190 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fbe38006fd0 tx=0x7fbe380090f0).stop 2024-01-22T05:12:08.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.946+0000 7fbe55200700 1 -- 172.21.15.49:0/1199734851 shutdown_connections 2024-01-22T05:12:08.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.946+0000 7fbe55200700 1 --2- 172.21.15.49:0/1199734851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe500c3680 0x7fbe500a91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.946+0000 7fbe55200700 1 --2- 172.21.15.49:0/1199734851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe500be110 0x7fbe500c3190 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.946+0000 7fbe55200700 1 -- 172.21.15.49:0/1199734851 >> 172.21.15.49:0/1199734851 conn(0x7fbe50066750 msgr2=0x7fbe50066b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:08.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.946+0000 7fbe55200700 1 -- 172.21.15.49:0/1199734851 shutdown_connections 2024-01-22T05:12:08.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.946+0000 7fbe55200700 1 -- 172.21.15.49:0/1199734851 wait complete. 2024-01-22T05:12:08.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.950+0000 7fbe55200700 1 Processor -- start 2024-01-22T05:12:08.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.950+0000 7fbe55200700 1 -- start start 2024-01-22T05:12:08.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe55200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe500be110 0x7fbe50165e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe55200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe500c3680 0x7fbe50067a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe55200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5014b1e0 0x7fbe50067f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe55200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50068470 con 0x7fbe500be110 2024-01-22T05:12:08.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe55200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500c2510 con 0x7fbe5014b1e0 2024-01-22T05:12:08.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe55200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500bf490 con 0x7fbe500c3680 2024-01-22T05:12:08.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe4f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe500be110 0x7fbe50165e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe4fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5014b1e0 0x7fbe50067f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe4f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe500be110 0x7fbe50165e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35028/0 (socket says 172.21.15.49:35028) 2024-01-22T05:12:08.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe4f400700 1 -- 172.21.15.49:0/798110614 learned_addr learned my addr 172.21.15.49:0/798110614 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:08.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe4ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe500c3680 0x7fbe50067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe4f400700 1 -- 172.21.15.49:0/798110614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe500c3680 msgr2=0x7fbe50067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe4f400700 1 --2- 172.21.15.49:0/798110614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe500c3680 0x7fbe50067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe4f400700 1 -- 172.21.15.49:0/798110614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5014b1e0 msgr2=0x7fbe50067f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:08.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe4f400700 1 --2- 172.21.15.49:0/798110614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5014b1e0 0x7fbe50067f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:08.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe4f400700 1 -- 172.21.15.49:0/798110614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe38009370 con 0x7fbe500be110 2024-01-22T05:12:08.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe4f400700 1 --2- 172.21.15.49:0/798110614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe500be110 0x7fbe50165e20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fbe4000c490 tx=0x7fbe40007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe46a00700 1 -- 172.21.15.49:0/798110614 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4000ce40 con 0x7fbe500be110 2024-01-22T05:12:08.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe46a00700 1 -- 172.21.15.49:0/798110614 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40007020 con 0x7fbe500be110 2024-01-22T05:12:08.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.954+0000 7fbe46a00700 1 -- 172.21.15.49:0/798110614 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe400073c0 con 0x7fbe500be110 2024-01-22T05:12:08.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.958+0000 7fbe55200700 1 -- 172.21.15.49:0/798110614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe50162f90 con 0x7fbe500be110 2024-01-22T05:12:08.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.958+0000 7fbe55200700 1 -- 172.21.15.49:0/798110614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe500beb60 con 0x7fbe500be110 2024-01-22T05:12:08.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.958+0000 7fbe55200700 1 -- 172.21.15.49:0/798110614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5013ab20 con 0x7fbe500be110 2024-01-22T05:12:08.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.958+0000 7fbe46a00700 1 -- 172.21.15.49:0/798110614 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbe400068b0 con 0x7fbe500be110 2024-01-22T05:12:08.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.962+0000 7fbe46a00700 1 --2- 172.21.15.49:0/798110614 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe2805a510 0x7fbe2805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:08.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.962+0000 7fbe46a00700 1 -- 172.21.15.49:0/798110614 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fbe40073d70 con 0x7fbe500be110 2024-01-22T05:12:08.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.962+0000 7fbe4ea00700 1 --2- 172.21.15.49:0/798110614 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe2805a510 0x7fbe2805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:08.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.962+0000 7fbe4ea00700 1 --2- 172.21.15.49:0/798110614 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe2805a510 0x7fbe2805c9d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fbe38009130 tx=0x7fbe38017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:08.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:08.970+0000 7fbe46a00700 1 -- 172.21.15.49:0/798110614 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbe40047300 con 0x7fbe500be110 2024-01-22T05:12:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.170+0000 7fbe55200700 1 -- 172.21.15.49:0/798110614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe500656d0 con 0x7fbe500be110 2024-01-22T05:12:09.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.170+0000 7fbe46a00700 1 -- 172.21.15.49:0/798110614 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fbe4004a920 con 0x7fbe500be110 2024-01-22T05:12:09.174 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:09.174 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":83,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6080,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/948258971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":948258971},{"type":"v1","addr":"172.21.15.110:6835","nonce":948258971}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6828,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/304005498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":304005498},{"type":"v1","addr":"172.21.15.49:6835","nonce":304005498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6843,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1613189666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1613189666},{"type":"v1","addr":"172.21.15.49:6837","nonce":1613189666}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-01-22T05:09:52.708060+0000","modified":"2024-01-22T05:11:53.237873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6846},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6846":{"gid":6846,"name":"b","rank":0,"incarnation":66,"state":"up:active","state_seq":33,"addr":"172.21.15.110:6834/1072346524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1072346524},{"type":"v1","addr":"172.21.15.110:6834","nonce":1072346524}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2024-01-22T05:12:09.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.174+0000 7fbe55200700 1 -- 172.21.15.49:0/798110614 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe2805a510 msgr2=0x7fbe2805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:09.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.174+0000 7fbe55200700 1 --2- 172.21.15.49:0/798110614 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe2805a510 0x7fbe2805c9d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fbe38009130 tx=0x7fbe38017000).stop 2024-01-22T05:12:09.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.174+0000 7fbe55200700 1 -- 172.21.15.49:0/798110614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe500be110 msgr2=0x7fbe50165e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:09.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.174+0000 7fbe55200700 1 --2- 172.21.15.49:0/798110614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe500be110 0x7fbe50165e20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fbe4000c490 tx=0x7fbe40007e00).stop 2024-01-22T05:12:09.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.174+0000 7fbe55200700 1 -- 172.21.15.49:0/798110614 shutdown_connections 2024-01-22T05:12:09.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.174+0000 7fbe55200700 1 --2- 172.21.15.49:0/798110614 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe2805a510 0x7fbe2805c9d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.174+0000 7fbe55200700 1 --2- 172.21.15.49:0/798110614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5014b1e0 0x7fbe50067f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.174+0000 7fbe55200700 1 --2- 172.21.15.49:0/798110614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe500c3680 0x7fbe50067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.174+0000 7fbe55200700 1 --2- 172.21.15.49:0/798110614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe500be110 0x7fbe50165e20 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.174+0000 7fbe55200700 1 -- 172.21.15.49:0/798110614 >> 172.21.15.49:0/798110614 conn(0x7fbe50066750 msgr2=0x7fbe500c5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:09.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.174+0000 7fbe55200700 1 -- 172.21.15.49:0/798110614 shutdown_connections 2024-01-22T05:12:09.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.174+0000 7fbe55200700 1 -- 172.21.15.49:0/798110614 wait complete. 2024-01-22T05:12:09.181 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 83 2024-01-22T05:12:09.200 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:12:09.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.402+0000 7f8c2e400700 1 Processor -- start 2024-01-22T05:12:09.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.406+0000 7f8c2e400700 1 -- start start 2024-01-22T05:12:09.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.406+0000 7f8c2e400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c280a8740 0x7f8c280a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:09.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.406+0000 7f8c2e400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8c280c1ed0 0x7f8c280c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:09.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.406+0000 7f8c2e400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c280c1a40 con 0x7f8c28155d20 2024-01-22T05:12:09.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.406+0000 7f8c2e400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c280a90b0 con 0x7f8c280a8740 2024-01-22T05:12:09.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.406+0000 7f8c2e400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c28159310 con 0x7f8c280c1ed0 2024-01-22T05:12:09.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.406+0000 7f8c27400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8c28155d20 0x7f8c28065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34734/0 (socket says 172.21.15.49:34734) 2024-01-22T05:12:09.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.406+0000 7f8c27400700 1 -- 172.21.15.49:0/4121315194 learned_addr learned my addr 172.21.15.49:0/4121315194 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:09.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.406+0000 7f8c26a00700 1 --2- 172.21.15.49:0/4121315194 >> v2:172.21.15.49:3300/0 conn(0x7f8c280a8740 0x7f8c280a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:09.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c27e00700 1 --2- 172.21.15.49:0/4121315194 >> v2:172.21.15.110:3300/0 conn(0x7f8c280c1ed0 0x7f8c280c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c26000700 1 -- 172.21.15.49:0/4121315194 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229903549 0 0) 0x7f8c280c1a40 con 0x7f8c28155d20 2024-01-22T05:12:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c26000700 1 -- 172.21.15.49:0/4121315194 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c080033f0 con 0x7f8c28155d20 2024-01-22T05:12:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c26a00700 1 -- 172.21.15.49:0/4121315194 >> v2:172.21.15.110:3300/0 conn(0x7f8c280c1ed0 msgr2=0x7f8c280c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c26a00700 1 --2- 172.21.15.49:0/4121315194 >> v2:172.21.15.110:3300/0 conn(0x7f8c280c1ed0 0x7f8c280c2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c26a00700 1 -- 172.21.15.49:0/4121315194 >> v1:172.21.15.49:6789/0 conn(0x7f8c28155d20 legacy=0x7f8c28065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c26a00700 1 -- 172.21.15.49:0/4121315194 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c280c13f0 con 0x7f8c280a8740 2024-01-22T05:12:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c26a00700 1 --2- 172.21.15.49:0/4121315194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c280a8740 0x7f8c280a8bc0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f8c280c19b0 tx=0x7f8c10009060).ready entity=mon.0 client_cookie=5b735619f46795eb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c26000700 1 -- 172.21.15.49:0/4121315194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1000d4a0 con 0x7f8c280a8740 2024-01-22T05:12:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c26000700 1 -- 172.21.15.49:0/4121315194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1000d600 con 0x7f8c280a8740 2024-01-22T05:12:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c26000700 1 -- 172.21.15.49:0/4121315194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1000d980 con 0x7f8c280a8740 2024-01-22T05:12:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c2e400700 1 -- 172.21.15.49:0/4121315194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c280a8740 msgr2=0x7f8c280a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c2e400700 1 --2- 172.21.15.49:0/4121315194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c280a8740 0x7f8c280a8bc0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f8c280c19b0 tx=0x7f8c10009060).stop 2024-01-22T05:12:09.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c2e400700 1 -- 172.21.15.49:0/4121315194 shutdown_connections 2024-01-22T05:12:09.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c2e400700 1 --2- 172.21.15.49:0/4121315194 >> v2:172.21.15.110:3300/0 conn(0x7f8c280c1ed0 0x7f8c280c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c2e400700 1 --2- 172.21.15.49:0/4121315194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c280a8740 0x7f8c280a8bc0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.410+0000 7f8c2e400700 1 -- 172.21.15.49:0/4121315194 >> 172.21.15.49:0/4121315194 conn(0x7f8c280c6540 msgr2=0x7f8c280c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:09.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.414+0000 7f8c2e400700 1 -- 172.21.15.49:0/4121315194 shutdown_connections 2024-01-22T05:12:09.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.414+0000 7f8c2e400700 1 -- 172.21.15.49:0/4121315194 wait complete. 2024-01-22T05:12:09.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.414+0000 7f8c2e400700 1 Processor -- start 2024-01-22T05:12:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c2e400700 1 -- start start 2024-01-22T05:12:09.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c2e400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c280a8740 0x7f8c280a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:09.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c2e400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c280c1ed0 0x7f8c281561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:09.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c2e400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c28155d20 0x7f8c281566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:09.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c2e400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280ac2e0 con 0x7f8c280c1ed0 2024-01-22T05:12:09.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c2e400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28157db0 con 0x7f8c28155d20 2024-01-22T05:12:09.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c2e400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28156d30 con 0x7f8c280a8740 2024-01-22T05:12:09.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c26a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c280c1ed0 0x7f8c281561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:09.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c26a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c280c1ed0 0x7f8c281561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35058/0 (socket says 172.21.15.49:35058) 2024-01-22T05:12:09.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c26a00700 1 -- 172.21.15.49:0/3641221825 learned_addr learned my addr 172.21.15.49:0/3641221825 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:09.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c27e00700 1 --2- 172.21.15.49:0/3641221825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c28155d20 0x7f8c281566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:09.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c27400700 1 --2- 172.21.15.49:0/3641221825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c280a8740 0x7f8c280a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:09.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c26a00700 1 -- 172.21.15.49:0/3641221825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c280a8740 msgr2=0x7f8c280a9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:09.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c26a00700 1 --2- 172.21.15.49:0/3641221825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c280a8740 0x7f8c280a9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c26a00700 1 -- 172.21.15.49:0/3641221825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c28155d20 msgr2=0x7f8c281566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c26a00700 1 --2- 172.21.15.49:0/3641221825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c28155d20 0x7f8c281566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c26a00700 1 -- 172.21.15.49:0/3641221825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c100092a0 con 0x7f8c280c1ed0 2024-01-22T05:12:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c26a00700 1 --2- 172.21.15.49:0/3641221825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c280c1ed0 0x7f8c281561c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f8c28059c60 tx=0x7f8c10016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:09.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.418+0000 7f8c1ea00700 1 -- 172.21.15.49:0/3641221825 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10021070 con 0x7f8c280c1ed0 2024-01-22T05:12:09.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.422+0000 7f8c1ea00700 1 -- 172.21.15.49:0/3641221825 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c10000cb0 con 0x7f8c280c1ed0 2024-01-22T05:12:09.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.422+0000 7f8c2e400700 1 -- 172.21.15.49:0/3641221825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c28157010 con 0x7f8c280c1ed0 2024-01-22T05:12:09.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.422+0000 7f8c1ea00700 1 -- 172.21.15.49:0/3641221825 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1000d980 con 0x7f8c280c1ed0 2024-01-22T05:12:09.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.422+0000 7f8c2e400700 1 -- 172.21.15.49:0/3641221825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c281575d0 con 0x7f8c280c1ed0 2024-01-22T05:12:09.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.422+0000 7f8c2e400700 1 -- 172.21.15.49:0/3641221825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c28047060 con 0x7f8c280c1ed0 2024-01-22T05:12:09.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.422+0000 7f8c1ea00700 1 -- 172.21.15.49:0/3641221825 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8c1001d640 con 0x7f8c280c1ed0 2024-01-22T05:12:09.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.426+0000 7f8c1ea00700 1 --2- 172.21.15.49:0/3641221825 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8c0005a4e0 0x7f8c0005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:09.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.426+0000 7f8c1ea00700 1 -- 172.21.15.49:0/3641221825 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f8c10075e90 con 0x7f8c280c1ed0 2024-01-22T05:12:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.426+0000 7f8c27400700 1 --2- 172.21.15.49:0/3641221825 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8c0005a4e0 0x7f8c0005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:09.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.426+0000 7f8c27400700 1 --2- 172.21.15.49:0/3641221825 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8c0005a4e0 0x7f8c0005c9a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f8c18005750 tx=0x7f8c18009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:09.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.430+0000 7f8c1ea00700 1 -- 172.21.15.49:0/3641221825 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8c10049460 con 0x7f8c280c1ed0 2024-01-22T05:12:09.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.594+0000 7f8c2e400700 1 -- 172.21.15.49:0/3641221825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c28046800 con 0x7f8c280c1ed0 2024-01-22T05:12:09.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.594+0000 7f8c1ea00700 1 -- 172.21.15.49:0/3641221825 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+17330 (secure 0 0 0) 0x7f8c10077070 con 0x7f8c280c1ed0 2024-01-22T05:12:09.599 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:09.599 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":92,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:11:51.218642+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:09:50.901052+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-22T05:09:51.722128+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1","mappings":[{"from":6,"to":3}]},{"pgid":"13.16","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":13,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:12:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.598+0000 7f8c2e400700 1 -- 172.21.15.49:0/3641221825 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8c0005a4e0 msgr2=0x7f8c0005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.598+0000 7f8c2e400700 1 --2- 172.21.15.49:0/3641221825 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8c0005a4e0 0x7f8c0005c9a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f8c18005750 tx=0x7f8c18009040).stop 2024-01-22T05:12:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.598+0000 7f8c2e400700 1 -- 172.21.15.49:0/3641221825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c280c1ed0 msgr2=0x7f8c281561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.598+0000 7f8c2e400700 1 --2- 172.21.15.49:0/3641221825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c280c1ed0 0x7f8c281561c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f8c28059c60 tx=0x7f8c10016000).stop 2024-01-22T05:12:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.598+0000 7f8c2e400700 1 -- 172.21.15.49:0/3641221825 shutdown_connections 2024-01-22T05:12:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.598+0000 7f8c2e400700 1 --2- 172.21.15.49:0/3641221825 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8c0005a4e0 0x7f8c0005c9a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.598+0000 7f8c2e400700 1 --2- 172.21.15.49:0/3641221825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c28155d20 0x7f8c281566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.598+0000 7f8c2e400700 1 --2- 172.21.15.49:0/3641221825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c280c1ed0 0x7f8c281561c0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.598+0000 7f8c2e400700 1 --2- 172.21.15.49:0/3641221825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c280a8740 0x7f8c280a9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.598+0000 7f8c2e400700 1 -- 172.21.15.49:0/3641221825 >> 172.21.15.49:0/3641221825 conn(0x7f8c280c6540 msgr2=0x7f8c280c2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:09.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.598+0000 7f8c2e400700 1 -- 172.21.15.49:0/3641221825 shutdown_connections 2024-01-22T05:12:09.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.598+0000 7f8c2e400700 1 -- 172.21.15.49:0/3641221825 wait complete. 2024-01-22T05:12:09.623 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:09:50.901052+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:09:51.722128+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 91, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:12:09.623 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:12:09.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.774+0000 7f5563200700 1 Processor -- start 2024-01-22T05:12:09.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.778+0000 7f5563200700 1 -- start start 2024-01-22T05:12:09.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.778+0000 7f5563200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5564151a10 0x7f55640689e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:09.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5563200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5564064560 0x7f5564068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:09.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5563200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55640c2a10 con 0x7f5564151630 2024-01-22T05:12:09.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5563200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55640c1e00 con 0x7f5564151a10 2024-01-22T05:12:09.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5563200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55640c20e0 con 0x7f5564064560 2024-01-22T05:12:09.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5561400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5564151a10 0x7f55640689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:09.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5561e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5564151630 0x7f5564063e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34738/0 (socket says 172.21.15.49:34738) 2024-01-22T05:12:09.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5561e00700 1 -- 172.21.15.49:0/2409434381 learned_addr learned my addr 172.21.15.49:0/2409434381 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:09.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5562800700 1 --2- 172.21.15.49:0/2409434381 >> v2:172.21.15.110:3300/0 conn(0x7f5564064560 0x7f5564068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:09.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5560a00700 1 -- 172.21.15.49:0/2409434381 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703081735 0 0) 0x7f55640c2a10 con 0x7f5564151630 2024-01-22T05:12:09.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5560a00700 1 -- 172.21.15.49:0/2409434381 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55440033f0 con 0x7f5564151630 2024-01-22T05:12:09.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5561400700 1 -- 172.21.15.49:0/2409434381 >> v2:172.21.15.110:3300/0 conn(0x7f5564064560 msgr2=0x7f5564068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:09.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5561400700 1 --2- 172.21.15.49:0/2409434381 >> v2:172.21.15.110:3300/0 conn(0x7f5564064560 0x7f5564068ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5561400700 1 -- 172.21.15.49:0/2409434381 >> v1:172.21.15.49:6789/0 conn(0x7f5564151630 legacy=0x7f5564063e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:09.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5561400700 1 -- 172.21.15.49:0/2409434381 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55640c23c0 con 0x7f5564151a10 2024-01-22T05:12:09.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5562800700 1 --2- 172.21.15.49:0/2409434381 >> v2:172.21.15.110:3300/0 conn(0x7f5564064560 0x7f5564068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:09.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5561400700 1 --2- 172.21.15.49:0/2409434381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5564151a10 0x7f55640689e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f55640a68a0 tx=0x7f554c009060).ready entity=mon.0 client_cookie=d8aeeadf24c3b1dc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5560a00700 1 -- 172.21.15.49:0/2409434381 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c00f510 con 0x7f5564151a10 2024-01-22T05:12:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5560a00700 1 -- 172.21.15.49:0/2409434381 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c00f670 con 0x7f5564151a10 2024-01-22T05:12:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5560a00700 1 -- 172.21.15.49:0/2409434381 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c00f9f0 con 0x7f5564151a10 2024-01-22T05:12:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5563200700 1 -- 172.21.15.49:0/2409434381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5564151a10 msgr2=0x7f55640689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5563200700 1 --2- 172.21.15.49:0/2409434381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5564151a10 0x7f55640689e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f55640a68a0 tx=0x7f554c009060).stop 2024-01-22T05:12:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5563200700 1 -- 172.21.15.49:0/2409434381 shutdown_connections 2024-01-22T05:12:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5563200700 1 --2- 172.21.15.49:0/2409434381 >> v2:172.21.15.110:3300/0 conn(0x7f5564064560 0x7f5564068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5563200700 1 --2- 172.21.15.49:0/2409434381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5564151a10 0x7f55640689e0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.782+0000 7f5563200700 1 -- 172.21.15.49:0/2409434381 >> 172.21.15.49:0/2409434381 conn(0x7f55640c4ba0 msgr2=0x7f55640667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:09.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.786+0000 7f5563200700 1 -- 172.21.15.49:0/2409434381 shutdown_connections 2024-01-22T05:12:09.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.786+0000 7f5563200700 1 -- 172.21.15.49:0/2409434381 wait complete. 2024-01-22T05:12:09.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.786+0000 7f5563200700 1 Processor -- start 2024-01-22T05:12:09.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.786+0000 7f5563200700 1 -- start start 2024-01-22T05:12:09.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5563200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5564064560 0x7f55640aab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:09.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5563200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5564151630 0x7f5564149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:09.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5563200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5564151a10 0x7f55640c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:09.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5563200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5564156260 con 0x7f5564151630 2024-01-22T05:12:09.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5563200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5564156de0 con 0x7f5564151a10 2024-01-22T05:12:09.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5563200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55641564b0 con 0x7f5564064560 2024-01-22T05:12:09.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5561400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5564151630 0x7f5564149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:09.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5561400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5564151630 0x7f5564149790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35084/0 (socket says 172.21.15.49:35084) 2024-01-22T05:12:09.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5561400700 1 -- 172.21.15.49:0/1066181572 learned_addr learned my addr 172.21.15.49:0/1066181572 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:09.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5562800700 1 --2- 172.21.15.49:0/1066181572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5564151a10 0x7f55640c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:09.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5561e00700 1 --2- 172.21.15.49:0/1066181572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5564064560 0x7f55640aab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:09.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5561400700 1 -- 172.21.15.49:0/1066181572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5564064560 msgr2=0x7f55640aab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:09.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5561400700 1 --2- 172.21.15.49:0/1066181572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5564064560 0x7f55640aab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5561400700 1 -- 172.21.15.49:0/1066181572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5564151a10 msgr2=0x7f55640c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:09.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5561400700 1 --2- 172.21.15.49:0/1066181572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5564151a10 0x7f55640c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5561400700 1 -- 172.21.15.49:0/1066181572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0092a0 con 0x7f5564151630 2024-01-22T05:12:09.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5561400700 1 --2- 172.21.15.49:0/1066181572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5564151630 0x7f5564149790 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f554c009dd0 tx=0x7f554c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:09.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5559600700 1 -- 172.21.15.49:0/1066181572 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c00f7e0 con 0x7f5564151630 2024-01-22T05:12:09.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5559600700 1 -- 172.21.15.49:0/1066181572 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c00f940 con 0x7f5564151630 2024-01-22T05:12:09.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5563200700 1 -- 172.21.15.49:0/1066181572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5564156790 con 0x7f5564151630 2024-01-22T05:12:09.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5559600700 1 -- 172.21.15.49:0/1066181572 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c01a680 con 0x7f5564151630 2024-01-22T05:12:09.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.790+0000 7f5563200700 1 -- 172.21.15.49:0/1066181572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55640ab050 con 0x7f5564151630 2024-01-22T05:12:09.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.794+0000 7f5563200700 1 -- 172.21.15.49:0/1066181572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5564065d20 con 0x7f5564151630 2024-01-22T05:12:09.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.794+0000 7f5559600700 1 -- 172.21.15.49:0/1066181572 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f554c01a9f0 con 0x7f5564151630 2024-01-22T05:12:09.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.798+0000 7f5559600700 1 --2- 172.21.15.49:0/1066181572 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f553c05a510 0x7f553c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:09.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.798+0000 7f5559600700 1 -- 172.21.15.49:0/1066181572 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f554c075c10 con 0x7f5564151630 2024-01-22T05:12:09.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.798+0000 7f5561e00700 1 --2- 172.21.15.49:0/1066181572 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f553c05a510 0x7f553c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:09.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.798+0000 7f5561e00700 1 --2- 172.21.15.49:0/1066181572 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f553c05a510 0x7f553c05c9d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f5554005750 tx=0x7f5554009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:09.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.802+0000 7f5559600700 1 -- 172.21.15.49:0/1066181572 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f554c0491a0 con 0x7f5564151630 2024-01-22T05:12:09.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.966+0000 7f5563200700 1 -- 172.21.15.49:0/1066181572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f55640c26a0 con 0x7f5564151630 2024-01-22T05:12:09.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.966+0000 7f5559600700 1 -- 172.21.15.49:0/1066181572 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v92) v1 ==== 110+0+10 (secure 0 0 0) 0x7f554c018320 con 0x7f5564151630 2024-01-22T05:12:09.971 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:12:09.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.970+0000 7f5563200700 1 -- 172.21.15.49:0/1066181572 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f553c05a510 msgr2=0x7f553c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:09.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.970+0000 7f5563200700 1 --2- 172.21.15.49:0/1066181572 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f553c05a510 0x7f553c05c9d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f5554005750 tx=0x7f5554009040).stop 2024-01-22T05:12:09.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.970+0000 7f5563200700 1 -- 172.21.15.49:0/1066181572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5564151630 msgr2=0x7f5564149790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:09.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.970+0000 7f5563200700 1 --2- 172.21.15.49:0/1066181572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5564151630 0x7f5564149790 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f554c009dd0 tx=0x7f554c017000).stop 2024-01-22T05:12:09.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.970+0000 7f5563200700 1 -- 172.21.15.49:0/1066181572 shutdown_connections 2024-01-22T05:12:09.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.970+0000 7f5563200700 1 --2- 172.21.15.49:0/1066181572 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f553c05a510 0x7f553c05c9d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.970+0000 7f5563200700 1 --2- 172.21.15.49:0/1066181572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5564151a10 0x7f55640c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.970+0000 7f5563200700 1 --2- 172.21.15.49:0/1066181572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5564151630 0x7f5564149790 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.970+0000 7f5563200700 1 --2- 172.21.15.49:0/1066181572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5564064560 0x7f55640aab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:09.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.970+0000 7f5563200700 1 -- 172.21.15.49:0/1066181572 >> 172.21.15.49:0/1066181572 conn(0x7f55640c4ba0 msgr2=0x7f55640a9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:09.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.970+0000 7f5563200700 1 -- 172.21.15.49:0/1066181572 shutdown_connections 2024-01-22T05:12:09.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:09.970+0000 7f5563200700 1 -- 172.21.15.49:0/1066181572 wait complete. 2024-01-22T05:12:09.999 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:12:10.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.162+0000 7fe1b3e00700 1 Processor -- start 2024-01-22T05:12:10.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.162+0000 7fe1b3e00700 1 -- start start 2024-01-22T05:12:10.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.166+0000 7fe1b3e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe1ac0c0760 0x7fe1ac1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.166+0000 7fe1b3e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac155770 con 0x7fe1ac151ba0 2024-01-22T05:12:10.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.166+0000 7fe1b3e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac0c2880 con 0x7fe1ac155c00 2024-01-22T05:12:10.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.166+0000 7fe1b3e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac0c2e40 con 0x7fe1ac0c0760 2024-01-22T05:12:10.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.166+0000 7fe1b0a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe1ac151ba0 0x7fe1ac067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34746/0 (socket says 172.21.15.49:34746) 2024-01-22T05:12:10.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.166+0000 7fe1b0a00700 1 -- 172.21.15.49:0/215294982 learned_addr learned my addr 172.21.15.49:0/215294982 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:10.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.166+0000 7fe1b1400700 1 --2- 172.21.15.49:0/215294982 >> v2:172.21.15.49:3300/0 conn(0x7fe1ac0c0760 0x7fe1ac1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.166+0000 7fe1abe00700 1 -- 172.21.15.49:0/215294982 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402561415 0 0) 0x7fe1ac155770 con 0x7fe1ac151ba0 2024-01-22T05:12:10.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.166+0000 7fe1abe00700 1 -- 172.21.15.49:0/215294982 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe18c0033f0 con 0x7fe1ac151ba0 2024-01-22T05:12:10.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.166+0000 7fe1b1400700 1 -- 172.21.15.49:0/215294982 >> v1:172.21.15.110:6789/0 conn(0x7fe1ac155c00 legacy=0x7fe1ac0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.166+0000 7fe1abe00700 1 -- 172.21.15.49:0/215294982 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663873152 0 0) 0x7fe1ac0c2880 con 0x7fe1ac155c00 2024-01-22T05:12:10.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.166+0000 7fe1b1400700 1 -- 172.21.15.49:0/215294982 >> v1:172.21.15.49:6789/0 conn(0x7fe1ac151ba0 legacy=0x7fe1ac067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.166+0000 7fe1b1400700 1 -- 172.21.15.49:0/215294982 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac0c2b60 con 0x7fe1ac0c0760 2024-01-22T05:12:10.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.166+0000 7fe1b1400700 1 --2- 172.21.15.49:0/215294982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ac0c0760 0x7fe1ac1516b0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7fe19c009760 tx=0x7fe19c009060).ready entity=mon.0 client_cookie=caecaea145ca3e2d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:10.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.166+0000 7fe1abe00700 1 -- 172.21.15.49:0/215294982 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c0090d0 con 0x7fe1ac0c0760 2024-01-22T05:12:10.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.170+0000 7fe1abe00700 1 -- 172.21.15.49:0/215294982 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c00f510 con 0x7fe1ac0c0760 2024-01-22T05:12:10.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.170+0000 7fe1abe00700 1 -- 172.21.15.49:0/215294982 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c00f890 con 0x7fe1ac0c0760 2024-01-22T05:12:10.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.170+0000 7fe1b3e00700 1 -- 172.21.15.49:0/215294982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ac0c0760 msgr2=0x7fe1ac1516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.170+0000 7fe1b3e00700 1 --2- 172.21.15.49:0/215294982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ac0c0760 0x7fe1ac1516b0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7fe19c009760 tx=0x7fe19c009060).stop 2024-01-22T05:12:10.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.170+0000 7fe1b3e00700 1 -- 172.21.15.49:0/215294982 shutdown_connections 2024-01-22T05:12:10.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.170+0000 7fe1b3e00700 1 --2- 172.21.15.49:0/215294982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ac0c0760 0x7fe1ac1516b0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.170+0000 7fe1b3e00700 1 -- 172.21.15.49:0/215294982 >> 172.21.15.49:0/215294982 conn(0x7fe1ac062cb0 msgr2=0x7fe1ac0c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:10.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.170+0000 7fe1b3e00700 1 -- 172.21.15.49:0/215294982 shutdown_connections 2024-01-22T05:12:10.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.170+0000 7fe1b3e00700 1 -- 172.21.15.49:0/215294982 wait complete. 2024-01-22T05:12:10.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b3e00700 1 Processor -- start 2024-01-22T05:12:10.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b3e00700 1 -- start start 2024-01-22T05:12:10.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b3e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1ac0c0760 0x7fe1ac0bc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ac151ba0 0x7fe1ac1494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1ac155c00 0x7fe1ac1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b3e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac158b20 con 0x7fe1ac151ba0 2024-01-22T05:12:10.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b3e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0be590 con 0x7fe1ac155c00 2024-01-22T05:12:10.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b3e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0be280 con 0x7fe1ac0c0760 2024-01-22T05:12:10.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ac151ba0 0x7fe1ac1494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ac151ba0 0x7fe1ac1494a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35112/0 (socket says 172.21.15.49:35112) 2024-01-22T05:12:10.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b0a00700 1 -- 172.21.15.49:0/1567390849 learned_addr learned my addr 172.21.15.49:0/1567390849 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:10.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b1400700 1 --2- 172.21.15.49:0/1567390849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1ac0c0760 0x7fe1ac0bc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b1e00700 1 --2- 172.21.15.49:0/1567390849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1ac155c00 0x7fe1ac1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b0a00700 1 -- 172.21.15.49:0/1567390849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1ac0c0760 msgr2=0x7fe1ac0bc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b0a00700 1 --2- 172.21.15.49:0/1567390849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1ac0c0760 0x7fe1ac0bc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b0a00700 1 -- 172.21.15.49:0/1567390849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1ac155c00 msgr2=0x7fe1ac1579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b0a00700 1 --2- 172.21.15.49:0/1567390849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1ac155c00 0x7fe1ac1579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.174+0000 7fe1b0a00700 1 -- 172.21.15.49:0/1567390849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c0092a0 con 0x7fe1ac151ba0 2024-01-22T05:12:10.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.178+0000 7fe1b1e00700 1 --2- 172.21.15.49:0/1567390849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1ac155c00 0x7fe1ac1579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:10.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.178+0000 7fe1b0a00700 1 --2- 172.21.15.49:0/1567390849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ac151ba0 0x7fe1ac1494a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7fe19400c410 tx=0x7fe194007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:10.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.178+0000 7fe1a8c00700 1 -- 172.21.15.49:0/1567390849 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19400ce10 con 0x7fe1ac151ba0 2024-01-22T05:12:10.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.178+0000 7fe1a8c00700 1 -- 172.21.15.49:0/1567390849 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1940072e0 con 0x7fe1ac151ba0 2024-01-22T05:12:10.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.178+0000 7fe1b3e00700 1 -- 172.21.15.49:0/1567390849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac158280 con 0x7fe1ac151ba0 2024-01-22T05:12:10.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.178+0000 7fe1a8c00700 1 -- 172.21.15.49:0/1567390849 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe194005670 con 0x7fe1ac151ba0 2024-01-22T05:12:10.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.178+0000 7fe1b3e00700 1 -- 172.21.15.49:0/1567390849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac158840 con 0x7fe1ac151ba0 2024-01-22T05:12:10.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.178+0000 7fe1b3e00700 1 -- 172.21.15.49:0/1567390849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac0c0c00 con 0x7fe1ac151ba0 2024-01-22T05:12:10.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.178+0000 7fe1a8c00700 1 -- 172.21.15.49:0/1567390849 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe194005a60 con 0x7fe1ac151ba0 2024-01-22T05:12:10.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.182+0000 7fe1a8c00700 1 --2- 172.21.15.49:0/1567390849 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe18405a510 0x7fe18405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.182+0000 7fe1a8c00700 1 -- 172.21.15.49:0/1567390849 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fe194074040 con 0x7fe1ac151ba0 2024-01-22T05:12:10.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.182+0000 7fe1b1400700 1 --2- 172.21.15.49:0/1567390849 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe18405a510 0x7fe18405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.182+0000 7fe1b1400700 1 --2- 172.21.15.49:0/1567390849 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe18405a510 0x7fe18405c9d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fe19c009760 tx=0x7fe19c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:10.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.186+0000 7fe1a8c00700 1 -- 172.21.15.49:0/1567390849 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe194047610 con 0x7fe1ac151ba0 2024-01-22T05:12:10.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.358+0000 7fe1b3e00700 1 -- 172.21.15.49:0/1567390849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe1ac069930 con 0x7fe1ac151ba0 2024-01-22T05:12:10.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.358+0000 7fe1a8c00700 1 -- 172.21.15.49:0/1567390849 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v92) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe19404ac30 con 0x7fe1ac151ba0 2024-01-22T05:12:10.361 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:12:10.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.362+0000 7fe1b3e00700 1 -- 172.21.15.49:0/1567390849 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe18405a510 msgr2=0x7fe18405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.362+0000 7fe1b3e00700 1 --2- 172.21.15.49:0/1567390849 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe18405a510 0x7fe18405c9d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fe19c009760 tx=0x7fe19c017000).stop 2024-01-22T05:12:10.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.362+0000 7fe1b3e00700 1 -- 172.21.15.49:0/1567390849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ac151ba0 msgr2=0x7fe1ac1494a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.362+0000 7fe1b3e00700 1 --2- 172.21.15.49:0/1567390849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ac151ba0 0x7fe1ac1494a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7fe19400c410 tx=0x7fe194007ae0).stop 2024-01-22T05:12:10.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.362+0000 7fe1b3e00700 1 -- 172.21.15.49:0/1567390849 shutdown_connections 2024-01-22T05:12:10.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.362+0000 7fe1b3e00700 1 --2- 172.21.15.49:0/1567390849 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe18405a510 0x7fe18405c9d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.362+0000 7fe1b3e00700 1 --2- 172.21.15.49:0/1567390849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1ac155c00 0x7fe1ac1579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.362+0000 7fe1b3e00700 1 --2- 172.21.15.49:0/1567390849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1ac151ba0 0x7fe1ac1494a0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.362+0000 7fe1b3e00700 1 --2- 172.21.15.49:0/1567390849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1ac0c0760 0x7fe1ac0bc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.362+0000 7fe1b3e00700 1 -- 172.21.15.49:0/1567390849 >> 172.21.15.49:0/1567390849 conn(0x7fe1ac062cb0 msgr2=0x7fe1ac0c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:10.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.362+0000 7fe1b3e00700 1 -- 172.21.15.49:0/1567390849 shutdown_connections 2024-01-22T05:12:10.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.362+0000 7fe1b3e00700 1 -- 172.21.15.49:0/1567390849 wait complete. 2024-01-22T05:12:10.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:12:10.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.542+0000 7f7458200700 1 Processor -- start 2024-01-22T05:12:10.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.542+0000 7f7458200700 1 -- start start 2024-01-22T05:12:10.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.546+0000 7f7458200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74500c3cc0 0x7f7450067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.546+0000 7f7458200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f74500c40a0 0x7f74500c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.546+0000 7f7458200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74500c45a0 con 0x7f7450067f80 2024-01-22T05:12:10.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.546+0000 7f7458200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7450063380 con 0x7f74500c3cc0 2024-01-22T05:12:10.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.546+0000 7f7458200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7450062a50 con 0x7f74500c40a0 2024-01-22T05:12:10.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.546+0000 7f7455800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74500c3cc0 0x7f7450067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.546+0000 7f7455800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74500c3cc0 0x7f7450067a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35120/0 (socket says 172.21.15.49:35120) 2024-01-22T05:12:10.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.546+0000 7f7455800700 1 -- 172.21.15.49:0/3253975648 learned_addr learned my addr 172.21.15.49:0/3253975648 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:10.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.546+0000 7f7456200700 1 --2- 172.21.15.49:0/3253975648 >> v2:172.21.15.110:3300/0 conn(0x7f74500c40a0 0x7f74500c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.546+0000 7f744fe00700 1 -- 172.21.15.49:0/3253975648 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374846908 0 0) 0x7f74500c45a0 con 0x7f7450067f80 2024-01-22T05:12:10.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.546+0000 7f7455800700 1 -- 172.21.15.49:0/3253975648 >> v2:172.21.15.110:3300/0 conn(0x7f74500c40a0 msgr2=0x7f74500c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:10.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.546+0000 7f7455800700 1 --2- 172.21.15.49:0/3253975648 >> v2:172.21.15.110:3300/0 conn(0x7f74500c40a0 0x7f74500c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.546+0000 7f7455800700 1 -- 172.21.15.49:0/3253975648 >> v1:172.21.15.110:6789/0 conn(0x7f7450067f80 legacy=0x7f7450157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.546+0000 7f7455800700 1 -- 172.21.15.49:0/3253975648 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7450062d30 con 0x7f74500c3cc0 2024-01-22T05:12:10.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.550+0000 7f7455800700 1 --2- 172.21.15.49:0/3253975648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74500c3cc0 0x7f7450067a90 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f7450069650 tx=0x7f74400090f0).ready entity=mon.0 client_cookie=87b4265169b11ecd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:10.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.550+0000 7f744fe00700 1 -- 172.21.15.49:0/3253975648 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744000b520 con 0x7f74500c3cc0 2024-01-22T05:12:10.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.550+0000 7f744fe00700 1 -- 172.21.15.49:0/3253975648 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744000b680 con 0x7f74500c3cc0 2024-01-22T05:12:10.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.550+0000 7f744fe00700 1 -- 172.21.15.49:0/3253975648 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744000ba00 con 0x7f74500c3cc0 2024-01-22T05:12:10.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.550+0000 7f7458200700 1 -- 172.21.15.49:0/3253975648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74500c3cc0 msgr2=0x7f7450067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.550+0000 7f7458200700 1 --2- 172.21.15.49:0/3253975648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74500c3cc0 0x7f7450067a90 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f7450069650 tx=0x7f74400090f0).stop 2024-01-22T05:12:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.550+0000 7f7458200700 1 -- 172.21.15.49:0/3253975648 shutdown_connections 2024-01-22T05:12:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.550+0000 7f7458200700 1 --2- 172.21.15.49:0/3253975648 >> v2:172.21.15.110:3300/0 conn(0x7f74500c40a0 0x7f74500c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.550+0000 7f7458200700 1 --2- 172.21.15.49:0/3253975648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74500c3cc0 0x7f7450067a90 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.550+0000 7f7458200700 1 -- 172.21.15.49:0/3253975648 >> 172.21.15.49:0/3253975648 conn(0x7f7450064f10 msgr2=0x7f74500c8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.550+0000 7f7458200700 1 -- 172.21.15.49:0/3253975648 shutdown_connections 2024-01-22T05:12:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.550+0000 7f7458200700 1 -- 172.21.15.49:0/3253975648 wait complete. 2024-01-22T05:12:10.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.554+0000 7f7458200700 1 Processor -- start 2024-01-22T05:12:10.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7458200700 1 -- start start 2024-01-22T05:12:10.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7458200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7450067f80 0x7f74500ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7458200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74500c3cc0 0x7f7450159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7458200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74500c40a0 0x7f745015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7458200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74501686f0 con 0x7f7450067f80 2024-01-22T05:12:10.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7458200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74500adb20 con 0x7f74500c40a0 2024-01-22T05:12:10.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7458200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74500adfb0 con 0x7f74500c3cc0 2024-01-22T05:12:10.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7455800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7450067f80 0x7f74500ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7455800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7450067f80 0x7f74500ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35124/0 (socket says 172.21.15.49:35124) 2024-01-22T05:12:10.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7455800700 1 -- 172.21.15.49:0/3457821232 learned_addr learned my addr 172.21.15.49:0/3457821232 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:10.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7456200700 1 --2- 172.21.15.49:0/3457821232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74500c40a0 0x7f745015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7454e00700 1 --2- 172.21.15.49:0/3457821232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74500c3cc0 0x7f7450159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7455800700 1 -- 172.21.15.49:0/3457821232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74500c3cc0 msgr2=0x7f7450159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7455800700 1 --2- 172.21.15.49:0/3457821232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74500c3cc0 0x7f7450159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7455800700 1 -- 172.21.15.49:0/3457821232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74500c40a0 msgr2=0x7f745015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7455800700 1 --2- 172.21.15.49:0/3457821232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74500c40a0 0x7f745015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7455800700 1 -- 172.21.15.49:0/3457821232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7440009370 con 0x7f7450067f80 2024-01-22T05:12:10.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7454e00700 1 --2- 172.21.15.49:0/3457821232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74500c3cc0 0x7f7450159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:10.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f7455800700 1 --2- 172.21.15.49:0/3457821232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7450067f80 0x7f74500ac6e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f7450067040 tx=0x7f7440017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:10.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.558+0000 7f744cc00700 1 -- 172.21.15.49:0/3457821232 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744000be90 con 0x7f7450067f80 2024-01-22T05:12:10.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.562+0000 7f744cc00700 1 -- 172.21.15.49:0/3457821232 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744000b7f0 con 0x7f7450067f80 2024-01-22T05:12:10.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.562+0000 7f744cc00700 1 -- 172.21.15.49:0/3457821232 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744001c650 con 0x7f7450067f80 2024-01-22T05:12:10.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.562+0000 7f7458200700 1 -- 172.21.15.49:0/3457821232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74500acf10 con 0x7f7450067f80 2024-01-22T05:12:10.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.562+0000 7f7458200700 1 -- 172.21.15.49:0/3457821232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74500ad4d0 con 0x7f7450067f80 2024-01-22T05:12:10.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.562+0000 7f7458200700 1 -- 172.21.15.49:0/3457821232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7450066590 con 0x7f7450067f80 2024-01-22T05:12:10.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.562+0000 7f744cc00700 1 -- 172.21.15.49:0/3457821232 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f744001ca00 con 0x7f7450067f80 2024-01-22T05:12:10.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.566+0000 7f744cc00700 1 --2- 172.21.15.49:0/3457821232 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f742805a540 0x7f742805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.566+0000 7f744cc00700 1 -- 172.21.15.49:0/3457821232 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f74400765a0 con 0x7f7450067f80 2024-01-22T05:12:10.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.566+0000 7f7454e00700 1 --2- 172.21.15.49:0/3457821232 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f742805a540 0x7f742805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.566+0000 7f7454e00700 1 --2- 172.21.15.49:0/3457821232 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f742805a540 0x7f742805ca00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f7438007fd0 tx=0x7f7438009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:10.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.570+0000 7f744cc00700 1 -- 172.21.15.49:0/3457821232 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7440049b30 con 0x7f7450067f80 2024-01-22T05:12:10.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.738+0000 7f7458200700 1 -- 172.21.15.49:0/3457821232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7450063010 con 0x7f7450067f80 2024-01-22T05:12:10.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.738+0000 7f744cc00700 1 -- 172.21.15.49:0/3457821232 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74400200a0 con 0x7f7450067f80 2024-01-22T05:12:10.742 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:12:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.742+0000 7f7458200700 1 -- 172.21.15.49:0/3457821232 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f742805a540 msgr2=0x7f742805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.742+0000 7f7458200700 1 --2- 172.21.15.49:0/3457821232 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f742805a540 0x7f742805ca00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f7438007fd0 tx=0x7f7438009040).stop 2024-01-22T05:12:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.742+0000 7f7458200700 1 -- 172.21.15.49:0/3457821232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7450067f80 msgr2=0x7f74500ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.742+0000 7f7458200700 1 --2- 172.21.15.49:0/3457821232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7450067f80 0x7f74500ac6e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f7450067040 tx=0x7f7440017000).stop 2024-01-22T05:12:10.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.742+0000 7f7458200700 1 -- 172.21.15.49:0/3457821232 shutdown_connections 2024-01-22T05:12:10.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.742+0000 7f7458200700 1 --2- 172.21.15.49:0/3457821232 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f742805a540 0x7f742805ca00 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.742+0000 7f7458200700 1 --2- 172.21.15.49:0/3457821232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74500c40a0 0x7f745015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.742+0000 7f7458200700 1 --2- 172.21.15.49:0/3457821232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74500c3cc0 0x7f7450159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.742+0000 7f7458200700 1 --2- 172.21.15.49:0/3457821232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7450067f80 0x7f74500ac6e0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.742+0000 7f7458200700 1 -- 172.21.15.49:0/3457821232 >> 172.21.15.49:0/3457821232 conn(0x7f7450064f10 msgr2=0x7f74500c1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.742+0000 7f7458200700 1 -- 172.21.15.49:0/3457821232 shutdown_connections 2024-01-22T05:12:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.742+0000 7f7458200700 1 -- 172.21.15.49:0/3457821232 wait complete. 2024-01-22T05:12:10.769 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:12:10.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.938+0000 7fabf1a00700 1 Processor -- start 2024-01-22T05:12:10.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.938+0000 7fabf1a00700 1 -- start start 2024-01-22T05:12:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.942+0000 7fabf1a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fabec0ace60 0x7fabec069960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.942+0000 7fabf1a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabec0c5ad0 0x7fabec0c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.942+0000 7fabf1a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec0a6fd0 con 0x7fabec069580 2024-01-22T05:12:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.942+0000 7fabf1a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabec0c5640 con 0x7fabec0ace60 2024-01-22T05:12:10.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.942+0000 7fabf1a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec154170 con 0x7fabec0c5ad0 2024-01-22T05:12:10.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.942+0000 7fabea000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fabec0ace60 0x7fabec069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.942+0000 7fabea000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fabec0ace60 0x7fabec069960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35140/0 (socket says 172.21.15.49:35140) 2024-01-22T05:12:10.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.942+0000 7fabea000700 1 -- 172.21.15.49:0/2266370257 learned_addr learned my addr 172.21.15.49:0/2266370257 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:10.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.946+0000 7fabeb400700 1 --2- 172.21.15.49:0/2266370257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabec0c5ad0 0x7fabec0c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.946+0000 7fabea000700 1 -- 172.21.15.49:0/2266370257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabec0c5ad0 msgr2=0x7fabec0c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.946+0000 7fabea000700 1 --2- 172.21.15.49:0/2266370257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabec0c5ad0 0x7fabec0c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.946+0000 7fabea000700 1 -- 172.21.15.49:0/2266370257 >> v1:172.21.15.110:6789/0 conn(0x7fabec069580 legacy=0x7fabec0ac750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.946+0000 7fabea000700 1 -- 172.21.15.49:0/2266370257 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec0c5310 con 0x7fabec0ace60 2024-01-22T05:12:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.946+0000 7fabea000700 1 --2- 172.21.15.49:0/2266370257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabec0ace60 0x7fabec069960 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7fabd4009810 tx=0x7fabd4009060).ready entity=mon.0 client_cookie=8195f84533676369 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.946+0000 7fabe9600700 1 -- 172.21.15.49:0/2266370257 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4005880 con 0x7fabec0ace60 2024-01-22T05:12:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.946+0000 7fabe9600700 1 -- 172.21.15.49:0/2266370257 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd40059e0 con 0x7fabec0ace60 2024-01-22T05:12:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.946+0000 7fabe9600700 1 -- 172.21.15.49:0/2266370257 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4005d60 con 0x7fabec0ace60 2024-01-22T05:12:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.946+0000 7fabf1a00700 1 -- 172.21.15.49:0/2266370257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabec0ace60 msgr2=0x7fabec069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.946+0000 7fabf1a00700 1 --2- 172.21.15.49:0/2266370257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabec0ace60 0x7fabec069960 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7fabd4009810 tx=0x7fabd4009060).stop 2024-01-22T05:12:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.946+0000 7fabf1a00700 1 -- 172.21.15.49:0/2266370257 shutdown_connections 2024-01-22T05:12:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.946+0000 7fabf1a00700 1 --2- 172.21.15.49:0/2266370257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabec0c5ad0 0x7fabec0c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.946+0000 7fabf1a00700 1 --2- 172.21.15.49:0/2266370257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabec0ace60 0x7fabec069960 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.946+0000 7fabf1a00700 1 -- 172.21.15.49:0/2266370257 >> 172.21.15.49:0/2266370257 conn(0x7fabec0aa700 msgr2=0x7fabec0aab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:10.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.950+0000 7fabf1a00700 1 -- 172.21.15.49:0/2266370257 shutdown_connections 2024-01-22T05:12:10.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.950+0000 7fabf1a00700 1 -- 172.21.15.49:0/2266370257 wait complete. 2024-01-22T05:12:10.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.950+0000 7fabf1a00700 1 Processor -- start 2024-01-22T05:12:10.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.950+0000 7fabf1a00700 1 -- start start 2024-01-22T05:12:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabf1a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabec069580 0x7fabec148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabf1a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabec0ace60 0x7fabec0aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabf1a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabec0c5ad0 0x7fabec0aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabf1a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0ab4c0 con 0x7fabec0ace60 2024-01-22T05:12:10.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabf1a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0a7160 con 0x7fabec069580 2024-01-22T05:12:10.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabf1a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0a7400 con 0x7fabec0c5ad0 2024-01-22T05:12:10.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabea000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabec0ace60 0x7fabec0aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabea000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabec0ace60 0x7fabec0aaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35156/0 (socket says 172.21.15.49:35156) 2024-01-22T05:12:10.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabea000700 1 -- 172.21.15.49:0/1974923525 learned_addr learned my addr 172.21.15.49:0/1974923525 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:10.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabeb400700 1 --2- 172.21.15.49:0/1974923525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabec0c5ad0 0x7fabec0aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabeaa00700 1 --2- 172.21.15.49:0/1974923525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabec069580 0x7fabec148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabea000700 1 -- 172.21.15.49:0/1974923525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabec0c5ad0 msgr2=0x7fabec0aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabea000700 1 --2- 172.21.15.49:0/1974923525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabec0c5ad0 0x7fabec0aafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabea000700 1 -- 172.21.15.49:0/1974923525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabec069580 msgr2=0x7fabec148760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:10.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabea000700 1 --2- 172.21.15.49:0/1974923525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabec069580 0x7fabec148760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:10.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabea000700 1 -- 172.21.15.49:0/1974923525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd4009300 con 0x7fabec0ace60 2024-01-22T05:12:10.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabea000700 1 --2- 172.21.15.49:0/1974923525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabec0ace60 0x7fabec0aaae0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7fabec062600 tx=0x7fabd4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:10.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabe2000700 1 -- 172.21.15.49:0/1974923525 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4005880 con 0x7fabec0ace60 2024-01-22T05:12:10.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabe2000700 1 -- 172.21.15.49:0/1974923525 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd4006850 con 0x7fabec0ace60 2024-01-22T05:12:10.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabf1a00700 1 -- 172.21.15.49:0/1974923525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec14bdc0 con 0x7fabec0ace60 2024-01-22T05:12:10.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabe2000700 1 -- 172.21.15.49:0/1974923525 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd400b9c0 con 0x7fabec0ace60 2024-01-22T05:12:10.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.954+0000 7fabf1a00700 1 -- 172.21.15.49:0/1974923525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabec14c380 con 0x7fabec0ace60 2024-01-22T05:12:10.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.958+0000 7fabf1a00700 1 -- 172.21.15.49:0/1974923525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabec064990 con 0x7fabec0ace60 2024-01-22T05:12:10.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.958+0000 7fabe2000700 1 -- 172.21.15.49:0/1974923525 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fabd4018070 con 0x7fabec0ace60 2024-01-22T05:12:10.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.958+0000 7fabe2000700 1 --2- 172.21.15.49:0/1974923525 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fabc405a510 0x7fabc405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:10.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.958+0000 7fabe2000700 1 -- 172.21.15.49:0/1974923525 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fabd40758b0 con 0x7fabec0ace60 2024-01-22T05:12:10.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.958+0000 7fabeaa00700 1 --2- 172.21.15.49:0/1974923525 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fabc405a510 0x7fabc405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:10.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.962+0000 7fabeaa00700 1 --2- 172.21.15.49:0/1974923525 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fabc405a510 0x7fabc405c9d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fabdc0036d0 tx=0x7fabdc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:10.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:10.966+0000 7fabe2000700 1 -- 172.21.15.49:0/1974923525 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fabd4048e40 con 0x7fabec0ace60 2024-01-22T05:12:11.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.130+0000 7fabf1a00700 1 -- 172.21.15.49:0/1974923525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fabec0bc780 con 0x7fabec0ace60 2024-01-22T05:12:11.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.130+0000 7fabe2000700 1 -- 172.21.15.49:0/1974923525 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7fabd404c460 con 0x7fabec0ace60 2024-01-22T05:12:11.135 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:12:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.134+0000 7fabf1a00700 1 -- 172.21.15.49:0/1974923525 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fabc405a510 msgr2=0x7fabc405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.134+0000 7fabf1a00700 1 --2- 172.21.15.49:0/1974923525 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fabc405a510 0x7fabc405c9d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fabdc0036d0 tx=0x7fabdc009040).stop 2024-01-22T05:12:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.134+0000 7fabf1a00700 1 -- 172.21.15.49:0/1974923525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabec0ace60 msgr2=0x7fabec0aaae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.134+0000 7fabf1a00700 1 --2- 172.21.15.49:0/1974923525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabec0ace60 0x7fabec0aaae0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7fabec062600 tx=0x7fabd4016000).stop 2024-01-22T05:12:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.134+0000 7fabf1a00700 1 -- 172.21.15.49:0/1974923525 shutdown_connections 2024-01-22T05:12:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.134+0000 7fabf1a00700 1 --2- 172.21.15.49:0/1974923525 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fabc405a510 0x7fabc405c9d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.134+0000 7fabf1a00700 1 --2- 172.21.15.49:0/1974923525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabec0c5ad0 0x7fabec0aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.134+0000 7fabf1a00700 1 --2- 172.21.15.49:0/1974923525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabec0ace60 0x7fabec0aaae0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.134+0000 7fabf1a00700 1 --2- 172.21.15.49:0/1974923525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabec069580 0x7fabec148760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.134+0000 7fabf1a00700 1 -- 172.21.15.49:0/1974923525 >> 172.21.15.49:0/1974923525 conn(0x7fabec0aa700 msgr2=0x7fabec063510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.134+0000 7fabf1a00700 1 -- 172.21.15.49:0/1974923525 shutdown_connections 2024-01-22T05:12:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.134+0000 7fabf1a00700 1 -- 172.21.15.49:0/1974923525 wait complete. 2024-01-22T05:12:11.163 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:12:11.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.326+0000 7fdb22000700 1 Processor -- start 2024-01-22T05:12:11.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.326+0000 7fdb22000700 1 -- start start 2024-01-22T05:12:11.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.330+0000 7fdb22000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdb1c0a8f90 0x7fdb1c065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:11.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.330+0000 7fdb22000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1c0c1ee0 con 0x7fdb1c066fb0 2024-01-22T05:12:11.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.330+0000 7fdb22000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1c0c12f0 con 0x7fdb1c0a8b10 2024-01-22T05:12:11.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.330+0000 7fdb22000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1c0c15b0 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.330+0000 7fdb1b400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdb1c066fb0 0x7fdb1c0c2370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34748/0 (socket says 172.21.15.49:34748) 2024-01-22T05:12:11.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.330+0000 7fdb1b400700 1 -- 172.21.15.49:0/109080573 learned_addr learned my addr 172.21.15.49:0/109080573 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:11.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.330+0000 7fdb1be00700 1 --2- 172.21.15.49:0/109080573 >> v2:172.21.15.110:3300/0 conn(0x7fdb1c0a8f90 0x7fdb1c065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:11.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.330+0000 7fdb1a000700 1 -- 172.21.15.49:0/109080573 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511426210 0 0) 0x7fdb1c0c1ee0 con 0x7fdb1c066fb0 2024-01-22T05:12:11.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.330+0000 7fdb1a000700 1 -- 172.21.15.49:0/109080573 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdafc0033f0 con 0x7fdb1c066fb0 2024-01-22T05:12:11.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.330+0000 7fdb1a000700 1 -- 172.21.15.49:0/109080573 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195338272 0 0) 0x7fdb1c0c12f0 con 0x7fdb1c0a8b10 2024-01-22T05:12:11.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.330+0000 7fdb1a000700 1 -- 172.21.15.49:0/109080573 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb1c0c1ee0 con 0x7fdb1c0a8b10 2024-01-22T05:12:11.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.330+0000 7fdb1be00700 1 -- 172.21.15.49:0/109080573 >> v1:172.21.15.110:6789/0 conn(0x7fdb1c0a8b10 legacy=0x7fdb1c157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:11.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.330+0000 7fdb1be00700 1 -- 172.21.15.49:0/109080573 >> v1:172.21.15.49:6789/0 conn(0x7fdb1c066fb0 legacy=0x7fdb1c0c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:11.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.330+0000 7fdb1be00700 1 -- 172.21.15.49:0/109080573 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c0c1890 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.330+0000 7fdb1be00700 1 --2- 172.21.15.49:0/109080573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb1c0a8f90 0x7fdb1c065b80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fdb14009e60 tx=0x7fdb14009780).ready entity=mon.1 client_cookie=e16ae1ecda850d38 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:11.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.334+0000 7fdb1a000700 1 -- 172.21.15.49:0/109080573 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400e070 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.334+0000 7fdb1a000700 1 -- 172.21.15.49:0/109080573 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1400bab0 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.334+0000 7fdb1a000700 1 -- 172.21.15.49:0/109080573 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400be30 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.334+0000 7fdb22000700 1 -- 172.21.15.49:0/109080573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb1c0a8f90 msgr2=0x7fdb1c065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:11.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.334+0000 7fdb22000700 1 --2- 172.21.15.49:0/109080573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb1c0a8f90 0x7fdb1c065b80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fdb14009e60 tx=0x7fdb14009780).stop 2024-01-22T05:12:11.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.334+0000 7fdb22000700 1 -- 172.21.15.49:0/109080573 shutdown_connections 2024-01-22T05:12:11.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.334+0000 7fdb22000700 1 --2- 172.21.15.49:0/109080573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb1c0a8f90 0x7fdb1c065b80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.334+0000 7fdb22000700 1 -- 172.21.15.49:0/109080573 >> 172.21.15.49:0/109080573 conn(0x7fdb1c0c6540 msgr2=0x7fdb1c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:11.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.334+0000 7fdb22000700 1 -- 172.21.15.49:0/109080573 shutdown_connections 2024-01-22T05:12:11.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.334+0000 7fdb22000700 1 -- 172.21.15.49:0/109080573 wait complete. 2024-01-22T05:12:11.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.338+0000 7fdb22000700 1 Processor -- start 2024-01-22T05:12:11.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.338+0000 7fdb22000700 1 -- start start 2024-01-22T05:12:11.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.338+0000 7fdb22000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb1c066fb0 0x7fdb1c0bef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:11.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.338+0000 7fdb22000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb1c0a8b10 0x7fdb1c0abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:11.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.338+0000 7fdb22000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb1c0a8f90 0x7fdb1c0aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:11.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.338+0000 7fdb22000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c0bd8e0 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.338+0000 7fdb22000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c0c00e0 con 0x7fdb1c066fb0 2024-01-22T05:12:11.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.338+0000 7fdb22000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c0bf4d0 con 0x7fdb1c0a8b10 2024-01-22T05:12:11.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.338+0000 7fdb1be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb1c0a8f90 0x7fdb1c0aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:11.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.338+0000 7fdb1be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb1c0a8f90 0x7fdb1c0aaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35172/0 (socket says 172.21.15.49:35172) 2024-01-22T05:12:11.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.338+0000 7fdb1be00700 1 -- 172.21.15.49:0/4189376858 learned_addr learned my addr 172.21.15.49:0/4189376858 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:11.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.338+0000 7fdb1aa00700 1 --2- 172.21.15.49:0/4189376858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb1c0a8b10 0x7fdb1c0abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:11.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.338+0000 7fdb1b400700 1 --2- 172.21.15.49:0/4189376858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb1c066fb0 0x7fdb1c0bef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:11.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.342+0000 7fdb1be00700 1 -- 172.21.15.49:0/4189376858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb1c0a8b10 msgr2=0x7fdb1c0abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:11.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.342+0000 7fdb1be00700 1 --2- 172.21.15.49:0/4189376858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb1c0a8b10 0x7fdb1c0abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.342+0000 7fdb1be00700 1 -- 172.21.15.49:0/4189376858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb1c066fb0 msgr2=0x7fdb1c0bef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:11.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.342+0000 7fdb1be00700 1 --2- 172.21.15.49:0/4189376858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb1c066fb0 0x7fdb1c0bef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.342+0000 7fdb1be00700 1 -- 172.21.15.49:0/4189376858 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb14009a20 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.342+0000 7fdb1be00700 1 --2- 172.21.15.49:0/4189376858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb1c0a8f90 0x7fdb1c0aaed0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7fdb1c059c60 tx=0x7fdb14009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:11.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.342+0000 7fdb12a00700 1 -- 172.21.15.49:0/4189376858 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14012e30 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.342+0000 7fdb12a00700 1 -- 172.21.15.49:0/4189376858 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1401d630 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.342+0000 7fdb12a00700 1 -- 172.21.15.49:0/4189376858 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1401d9b0 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.342+0000 7fdb22000700 1 -- 172.21.15.49:0/4189376858 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1c0bf7b0 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.342+0000 7fdb22000700 1 -- 172.21.15.49:0/4189376858 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1c0bfd70 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.342+0000 7fdb22000700 1 -- 172.21.15.49:0/4189376858 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c0c0250 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.346+0000 7fdb12a00700 1 -- 172.21.15.49:0/4189376858 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdb14026410 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.346+0000 7fdb12a00700 1 --2- 172.21.15.49:0/4189376858 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdaf405a540 0x7fdaf405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:11.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.346+0000 7fdb12a00700 1 -- 172.21.15.49:0/4189376858 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fdb14076650 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.346+0000 7fdb1b400700 1 --2- 172.21.15.49:0/4189376858 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdaf405a540 0x7fdaf405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:11.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.346+0000 7fdb1b400700 1 --2- 172.21.15.49:0/4189376858 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdaf405a540 0x7fdaf405ca00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fdb0c005750 tx=0x7fdb0c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:11.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.350+0000 7fdb12a00700 1 -- 172.21.15.49:0/4189376858 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdb14049b80 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.550+0000 7fdb22000700 1 -- 172.21.15.49:0/4189376858 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb1c047060 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.550+0000 7fdb12a00700 1 -- 172.21.15.49:0/4189376858 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fdb1404d1a0 con 0x7fdb1c0a8f90 2024-01-22T05:12:11.555 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:11.555 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":83,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6080,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/948258971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":948258971},{"type":"v1","addr":"172.21.15.110:6835","nonce":948258971}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6828,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/304005498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":304005498},{"type":"v1","addr":"172.21.15.49:6835","nonce":304005498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6843,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1613189666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1613189666},{"type":"v1","addr":"172.21.15.49:6837","nonce":1613189666}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-01-22T05:09:52.708060+0000","modified":"2024-01-22T05:11:53.237873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6846},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6846":{"gid":6846,"name":"b","rank":0,"incarnation":66,"state":"up:active","state_seq":33,"addr":"172.21.15.110:6834/1072346524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1072346524},{"type":"v1","addr":"172.21.15.110:6834","nonce":1072346524}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2024-01-22T05:12:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.554+0000 7fdb22000700 1 -- 172.21.15.49:0/4189376858 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdaf405a540 msgr2=0x7fdaf405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.554+0000 7fdb22000700 1 --2- 172.21.15.49:0/4189376858 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdaf405a540 0x7fdaf405ca00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fdb0c005750 tx=0x7fdb0c009040).stop 2024-01-22T05:12:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.554+0000 7fdb22000700 1 -- 172.21.15.49:0/4189376858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb1c0a8f90 msgr2=0x7fdb1c0aaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.554+0000 7fdb22000700 1 --2- 172.21.15.49:0/4189376858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb1c0a8f90 0x7fdb1c0aaed0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7fdb1c059c60 tx=0x7fdb14009780).stop 2024-01-22T05:12:11.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.554+0000 7fdb22000700 1 -- 172.21.15.49:0/4189376858 shutdown_connections 2024-01-22T05:12:11.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.554+0000 7fdb22000700 1 --2- 172.21.15.49:0/4189376858 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdaf405a540 0x7fdaf405ca00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.554+0000 7fdb22000700 1 --2- 172.21.15.49:0/4189376858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb1c0a8f90 0x7fdb1c0aaed0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.554+0000 7fdb22000700 1 --2- 172.21.15.49:0/4189376858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb1c0a8b10 0x7fdb1c0abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.554+0000 7fdb22000700 1 --2- 172.21.15.49:0/4189376858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb1c066fb0 0x7fdb1c0bef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.554+0000 7fdb22000700 1 -- 172.21.15.49:0/4189376858 >> 172.21.15.49:0/4189376858 conn(0x7fdb1c0c6540 msgr2=0x7fdb1c1576d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:11.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.554+0000 7fdb22000700 1 -- 172.21.15.49:0/4189376858 shutdown_connections 2024-01-22T05:12:11.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.554+0000 7fdb22000700 1 -- 172.21.15.49:0/4189376858 wait complete. 2024-01-22T05:12:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 83 2024-01-22T05:12:11.584 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:12:11.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.746+0000 7fd1c4600700 1 Processor -- start 2024-01-22T05:12:11.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.746+0000 7fd1c4600700 1 -- start start 2024-01-22T05:12:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.746+0000 7fd1c4600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd1bc065240 0x7fd1bc0644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.746+0000 7fd1c4600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd1bc065620 0x7fd1bc0649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.746+0000 7fd1c4600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1bc15b9b0 0x7fd1bc15be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.746+0000 7fd1c4600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc064ed0 con 0x7fd1bc065620 2024-01-22T05:12:11.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.746+0000 7fd1c4600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc0c2700 con 0x7fd1bc065240 2024-01-22T05:12:11.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.746+0000 7fd1c4600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0c29a0 con 0x7fd1bc15b9b0 2024-01-22T05:12:11.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1c1200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd1bc065620 0x7fd1bc0649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:11.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1c1200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd1bc065620 0x7fd1bc0649e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35186/0 (socket says 172.21.15.49:35186) 2024-01-22T05:12:11.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1c1200700 1 -- 172.21.15.49:0/1705719840 learned_addr learned my addr 172.21.15.49:0/1705719840 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:11.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1c1c00700 1 --2- 172.21.15.49:0/1705719840 >> v2:172.21.15.110:3300/0 conn(0x7fd1bc065240 0x7fd1bc0644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:11.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1c3000700 1 --2- 172.21.15.49:0/1705719840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1bc15b9b0 0x7fd1bc15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:11.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1c1200700 1 -- 172.21.15.49:0/1705719840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1bc15b9b0 msgr2=0x7fd1bc15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:11.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1c1200700 1 --2- 172.21.15.49:0/1705719840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1bc15b9b0 0x7fd1bc15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1c1200700 1 -- 172.21.15.49:0/1705719840 >> v2:172.21.15.110:3300/0 conn(0x7fd1bc065240 msgr2=0x7fd1bc0644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:11.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1c1200700 1 --2- 172.21.15.49:0/1705719840 >> v2:172.21.15.110:3300/0 conn(0x7fd1bc065240 0x7fd1bc0644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1c1200700 1 -- 172.21.15.49:0/1705719840 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc0c2c80 con 0x7fd1bc065620 2024-01-22T05:12:11.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1c1c00700 1 --2- 172.21.15.49:0/1705719840 >> v2:172.21.15.110:3300/0 conn(0x7fd1bc065240 0x7fd1bc0644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:12:11.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1c3000700 1 --2- 172.21.15.49:0/1705719840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1bc15b9b0 0x7fd1bc15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:11.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1c1200700 1 --2- 172.21.15.49:0/1705719840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc065620 0x7fd1bc0649e0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7fd1bc060220 tx=0x7fd1a40090f0).ready entity=mon.0 client_cookie=45bf06e2e9bf74c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:11.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1bbe00700 1 -- 172.21.15.49:0/1705719840 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a400b520 con 0x7fd1bc065620 2024-01-22T05:12:11.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1bbe00700 1 -- 172.21.15.49:0/1705719840 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a400b680 con 0x7fd1bc065620 2024-01-22T05:12:11.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1bbe00700 1 -- 172.21.15.49:0/1705719840 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a400ba00 con 0x7fd1bc065620 2024-01-22T05:12:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1c4600700 1 -- 172.21.15.49:0/1705719840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc065620 msgr2=0x7fd1bc0649e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.750+0000 7fd1c4600700 1 --2- 172.21.15.49:0/1705719840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc065620 0x7fd1bc0649e0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7fd1bc060220 tx=0x7fd1a40090f0).stop 2024-01-22T05:12:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.754+0000 7fd1c4600700 1 -- 172.21.15.49:0/1705719840 shutdown_connections 2024-01-22T05:12:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.754+0000 7fd1c4600700 1 --2- 172.21.15.49:0/1705719840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1bc15b9b0 0x7fd1bc15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.754+0000 7fd1c4600700 1 --2- 172.21.15.49:0/1705719840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc065620 0x7fd1bc0649e0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.754+0000 7fd1c4600700 1 --2- 172.21.15.49:0/1705719840 >> v2:172.21.15.110:3300/0 conn(0x7fd1bc065240 0x7fd1bc0644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.754+0000 7fd1c4600700 1 -- 172.21.15.49:0/1705719840 >> 172.21.15.49:0/1705719840 conn(0x7fd1bc0c87f0 msgr2=0x7fd1bc0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.754+0000 7fd1c4600700 1 -- 172.21.15.49:0/1705719840 shutdown_connections 2024-01-22T05:12:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.754+0000 7fd1c4600700 1 -- 172.21.15.49:0/1705719840 wait complete. 2024-01-22T05:12:11.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.758+0000 7fd1c4600700 1 Processor -- start 2024-01-22T05:12:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.758+0000 7fd1c4600700 1 -- start start 2024-01-22T05:12:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.758+0000 7fd1c4600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc065240 0x7fd1bc0c1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.758+0000 7fd1c4600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1bc065620 0x7fd1bc147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.758+0000 7fd1c4600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1bc15b9b0 0x7fd1bc062230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.758+0000 7fd1c4600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0a87d0 con 0x7fd1bc065240 2024-01-22T05:12:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.758+0000 7fd1c4600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc15b700 con 0x7fd1bc15b9b0 2024-01-22T05:12:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.758+0000 7fd1c4600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0a7bc0 con 0x7fd1bc065620 2024-01-22T05:12:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.758+0000 7fd1c1c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc065240 0x7fd1bc0c1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.758+0000 7fd1c1200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1bc065620 0x7fd1bc147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.758+0000 7fd1c3000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1bc15b9b0 0x7fd1bc062230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.758+0000 7fd1c1c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc065240 0x7fd1bc0c1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35202/0 (socket says 172.21.15.49:35202) 2024-01-22T05:12:11.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.758+0000 7fd1c1c00700 1 -- 172.21.15.49:0/4173807768 learned_addr learned my addr 172.21.15.49:0/4173807768 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.762+0000 7fd1c1200700 1 -- 172.21.15.49:0/4173807768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1bc15b9b0 msgr2=0x7fd1bc062230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.762+0000 7fd1c1200700 1 --2- 172.21.15.49:0/4173807768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1bc15b9b0 0x7fd1bc062230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.762+0000 7fd1c1200700 1 -- 172.21.15.49:0/4173807768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc065240 msgr2=0x7fd1bc0c1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.762+0000 7fd1c1200700 1 --2- 172.21.15.49:0/4173807768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc065240 0x7fd1bc0c1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.762+0000 7fd1c1200700 1 -- 172.21.15.49:0/4173807768 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac0092a0 con 0x7fd1bc065620 2024-01-22T05:12:11.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.762+0000 7fd1c3000700 1 --2- 172.21.15.49:0/4173807768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1bc15b9b0 0x7fd1bc062230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:12:11.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.762+0000 7fd1c1c00700 1 --2- 172.21.15.49:0/4173807768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc065240 0x7fd1bc0c1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:12:11.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.762+0000 7fd1c1200700 1 --2- 172.21.15.49:0/4173807768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1bc065620 0x7fd1bc147dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fd1a4014000 tx=0x7fd1a4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:11.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.762+0000 7fd1b8c00700 1 -- 172.21.15.49:0/4173807768 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4000bc0 con 0x7fd1bc065620 2024-01-22T05:12:11.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.762+0000 7fd1b8c00700 1 -- 172.21.15.49:0/4173807768 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a400b7f0 con 0x7fd1bc065620 2024-01-22T05:12:11.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.762+0000 7fd1c4600700 1 -- 172.21.15.49:0/4173807768 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a4009370 con 0x7fd1bc065620 2024-01-22T05:12:11.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.762+0000 7fd1b8c00700 1 -- 172.21.15.49:0/4173807768 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4000d20 con 0x7fd1bc065620 2024-01-22T05:12:11.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.762+0000 7fd1c4600700 1 -- 172.21.15.49:0/4173807768 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc0a8180 con 0x7fd1bc065620 2024-01-22T05:12:11.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.766+0000 7fd1c4600700 1 -- 172.21.15.49:0/4173807768 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc047060 con 0x7fd1bc065620 2024-01-22T05:12:11.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.766+0000 7fd1b8c00700 1 -- 172.21.15.49:0/4173807768 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd1a401c900 con 0x7fd1bc065620 2024-01-22T05:12:11.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.766+0000 7fd1b8c00700 1 --2- 172.21.15.49:0/4173807768 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd19405a510 0x7fd19405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:11.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.766+0000 7fd1b8c00700 1 -- 172.21.15.49:0/4173807768 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fd1a4076410 con 0x7fd1bc065620 2024-01-22T05:12:11.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.766+0000 7fd1c1c00700 1 --2- 172.21.15.49:0/4173807768 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd19405a510 0x7fd19405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:11.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.770+0000 7fd1c1c00700 1 --2- 172.21.15.49:0/4173807768 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd19405a510 0x7fd19405c9d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fd1ac011580 tx=0x7fd1ac009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:11.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.778+0000 7fd1b8c00700 1 -- 172.21.15.49:0/4173807768 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd1a40499a0 con 0x7fd1bc065620 2024-01-22T05:12:11.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.942+0000 7fd1c4600700 1 -- 172.21.15.49:0/4173807768 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1bc0a8910 con 0x7fd1bc065620 2024-01-22T05:12:11.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.942+0000 7fd1b8c00700 1 -- 172.21.15.49:0/4173807768 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+17330 (secure 0 0 0) 0x7fd1a402a020 con 0x7fd1bc065620 2024-01-22T05:12:11.947 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:11.947 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":92,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:11:51.218642+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:09:50.901052+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-22T05:09:51.722128+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1","mappings":[{"from":6,"to":3}]},{"pgid":"13.16","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":13,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:12:11.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.946+0000 7fd1c4600700 1 -- 172.21.15.49:0/4173807768 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd19405a510 msgr2=0x7fd19405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:11.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.946+0000 7fd1c4600700 1 --2- 172.21.15.49:0/4173807768 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd19405a510 0x7fd19405c9d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fd1ac011580 tx=0x7fd1ac009060).stop 2024-01-22T05:12:11.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.946+0000 7fd1c4600700 1 -- 172.21.15.49:0/4173807768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1bc065620 msgr2=0x7fd1bc147dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:11.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.946+0000 7fd1c4600700 1 --2- 172.21.15.49:0/4173807768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1bc065620 0x7fd1bc147dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fd1a4014000 tx=0x7fd1a4017000).stop 2024-01-22T05:12:11.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.946+0000 7fd1c4600700 1 -- 172.21.15.49:0/4173807768 shutdown_connections 2024-01-22T05:12:11.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.946+0000 7fd1c4600700 1 --2- 172.21.15.49:0/4173807768 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd19405a510 0x7fd19405c9d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.946+0000 7fd1c4600700 1 --2- 172.21.15.49:0/4173807768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1bc15b9b0 0x7fd1bc062230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.946+0000 7fd1c4600700 1 --2- 172.21.15.49:0/4173807768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1bc065620 0x7fd1bc147dc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.946+0000 7fd1c4600700 1 --2- 172.21.15.49:0/4173807768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1bc065240 0x7fd1bc0c1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:11.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.946+0000 7fd1c4600700 1 -- 172.21.15.49:0/4173807768 >> 172.21.15.49:0/4173807768 conn(0x7fd1bc0c87f0 msgr2=0x7fd1bc0644f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:11.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.946+0000 7fd1c4600700 1 -- 172.21.15.49:0/4173807768 shutdown_connections 2024-01-22T05:12:11.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:11.946+0000 7fd1c4600700 1 -- 172.21.15.49:0/4173807768 wait complete. 2024-01-22T05:12:11.978 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:12:11.978 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:12:12.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.138+0000 7ffacb000700 1 Processor -- start 2024-01-22T05:12:12.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.138+0000 7ffacb000700 1 -- start start 2024-01-22T05:12:12.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffacb000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffac4065240 0x7ffac40644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:12.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffacb000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac415c7d0 con 0x7ffac4065620 2024-01-22T05:12:12.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffacb000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac40c2700 con 0x7ffac40649e0 2024-01-22T05:12:12.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffacb000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac40c29a0 con 0x7ffac4065240 2024-01-22T05:12:12.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffac3e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffac4065240 0x7ffac40644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:12.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffac3e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffac4065240 0x7ffac40644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35210/0 (socket says 172.21.15.49:35210) 2024-01-22T05:12:12.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffac3e00700 1 -- 172.21.15.49:0/2890306667 learned_addr learned my addr 172.21.15.49:0/2890306667 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:12.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffac3400700 1 --1- 172.21.15.49:0/2890306667 >> v1:172.21.15.49:6789/0 conn(0x7ffac4065620 0x7ffac415b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34754/0 (socket says 172.21.15.49:34754) 2024-01-22T05:12:12.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffac3e00700 1 -- 172.21.15.49:0/2890306667 >> v1:172.21.15.110:6789/0 conn(0x7ffac40649e0 legacy=0x7ffac415c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:12.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffac3e00700 1 -- 172.21.15.49:0/2890306667 >> v1:172.21.15.49:6789/0 conn(0x7ffac4065620 legacy=0x7ffac415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:12.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffac3e00700 1 -- 172.21.15.49:0/2890306667 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac40c2c80 con 0x7ffac4065240 2024-01-22T05:12:12.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffac3e00700 1 --2- 172.21.15.49:0/2890306667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4065240 0x7ffac40644f0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7ffab4006fd0 tx=0x7ffab40090f0).ready entity=mon.0 client_cookie=e550b97a98430a44 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:12.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffac2a00700 1 -- 172.21.15.49:0/2890306667 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab400b600 con 0x7ffac4065240 2024-01-22T05:12:12.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffac2a00700 1 -- 172.21.15.49:0/2890306667 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab400b760 con 0x7ffac4065240 2024-01-22T05:12:12.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffac2a00700 1 -- 172.21.15.49:0/2890306667 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab400bae0 con 0x7ffac4065240 2024-01-22T05:12:12.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffacb000700 1 -- 172.21.15.49:0/2890306667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4065240 msgr2=0x7ffac40644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:12.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.142+0000 7ffacb000700 1 --2- 172.21.15.49:0/2890306667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4065240 0x7ffac40644f0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7ffab4006fd0 tx=0x7ffab40090f0).stop 2024-01-22T05:12:12.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.146+0000 7ffacb000700 1 -- 172.21.15.49:0/2890306667 shutdown_connections 2024-01-22T05:12:12.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.146+0000 7ffacb000700 1 --2- 172.21.15.49:0/2890306667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4065240 0x7ffac40644f0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.146+0000 7ffacb000700 1 -- 172.21.15.49:0/2890306667 >> 172.21.15.49:0/2890306667 conn(0x7ffac40c87f0 msgr2=0x7ffac40c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:12.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.146+0000 7ffacb000700 1 -- 172.21.15.49:0/2890306667 shutdown_connections 2024-01-22T05:12:12.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.146+0000 7ffacb000700 1 -- 172.21.15.49:0/2890306667 wait complete. 2024-01-22T05:12:12.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.150+0000 7ffacb000700 1 Processor -- start 2024-01-22T05:12:12.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.150+0000 7ffacb000700 1 -- start start 2024-01-22T05:12:12.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffacb000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffac40649e0 0x7ffac40ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:12.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffacb000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffac4065240 0x7ffac414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:12.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffacb000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4065620 0x7ffac40bf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:12.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffacb000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40a87d0 con 0x7ffac4065620 2024-01-22T05:12:12.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffacb000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40acf40 con 0x7ffac40649e0 2024-01-22T05:12:12.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffacb000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40a7bc0 con 0x7ffac4065240 2024-01-22T05:12:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffac9a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4065620 0x7ffac40bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffac9a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4065620 0x7ffac40bf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35216/0 (socket says 172.21.15.49:35216) 2024-01-22T05:12:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffac9a00700 1 -- 172.21.15.49:0/2301566373 learned_addr learned my addr 172.21.15.49:0/2301566373 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffac3e00700 1 --2- 172.21.15.49:0/2301566373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffac40649e0 0x7ffac40ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffac3400700 1 --2- 172.21.15.49:0/2301566373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffac4065240 0x7ffac414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffac9a00700 1 -- 172.21.15.49:0/2301566373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffac4065240 msgr2=0x7ffac414d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffac9a00700 1 --2- 172.21.15.49:0/2301566373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffac4065240 0x7ffac414d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffac9a00700 1 -- 172.21.15.49:0/2301566373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffac40649e0 msgr2=0x7ffac40ac010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffac9a00700 1 --2- 172.21.15.49:0/2301566373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffac40649e0 0x7ffac40ac010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffac9a00700 1 -- 172.21.15.49:0/2301566373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab4009370 con 0x7ffac4065620 2024-01-22T05:12:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffac9a00700 1 --2- 172.21.15.49:0/2301566373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4065620 0x7ffac40bf380 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7ffabc002230 tx=0x7ffabc0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffabb400700 1 -- 172.21.15.49:0/2301566373 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc00e4a0 con 0x7ffac4065620 2024-01-22T05:12:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffabb400700 1 -- 172.21.15.49:0/2301566373 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc00e600 con 0x7ffac4065620 2024-01-22T05:12:12.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffacb000700 1 -- 172.21.15.49:0/2301566373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac40a7ea0 con 0x7ffac4065620 2024-01-22T05:12:12.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffabb400700 1 -- 172.21.15.49:0/2301566373 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc00e980 con 0x7ffac4065620 2024-01-22T05:12:12.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.154+0000 7ffacb000700 1 -- 172.21.15.49:0/2301566373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac40a8230 con 0x7ffac4065620 2024-01-22T05:12:12.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.158+0000 7ffacb000700 1 -- 172.21.15.49:0/2301566373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac40a8980 con 0x7ffac4065620 2024-01-22T05:12:12.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.158+0000 7ffabb400700 1 -- 172.21.15.49:0/2301566373 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ffabc01b3b0 con 0x7ffac4065620 2024-01-22T05:12:12.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.158+0000 7ffabb400700 1 --2- 172.21.15.49:0/2301566373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa9c05a510 0x7ffa9c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:12.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.158+0000 7ffabb400700 1 -- 172.21.15.49:0/2301566373 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7ffabc073ff0 con 0x7ffac4065620 2024-01-22T05:12:12.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.158+0000 7ffac3e00700 1 --2- 172.21.15.49:0/2301566373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa9c05a510 0x7ffa9c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:12.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.162+0000 7ffac3e00700 1 --2- 172.21.15.49:0/2301566373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa9c05a510 0x7ffa9c05c9d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7ffab4009130 tx=0x7ffab4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:12.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.170+0000 7ffabb400700 1 -- 172.21.15.49:0/2301566373 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffabc0a2b00 con 0x7ffac4065620 2024-01-22T05:12:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.378+0000 7ffacb000700 1 -- 172.21.15.49:0/2301566373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffac40ac5c0 con 0x7ffac4065620 2024-01-22T05:12:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.378+0000 7ffabb400700 1 -- 172.21.15.49:0/2301566373 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4492 (secure 0 0 0) 0x7ffabc047610 con 0x7ffac4065620 2024-01-22T05:12:12.384 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:12.385 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":83,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6080,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/948258971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":948258971},{"type":"v1","addr":"172.21.15.110:6835","nonce":948258971}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6828,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/304005498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":304005498},{"type":"v1","addr":"172.21.15.49:6835","nonce":304005498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6843,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1613189666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1613189666},{"type":"v1","addr":"172.21.15.49:6837","nonce":1613189666}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-01-22T05:09:52.708060+0000","modified":"2024-01-22T05:11:53.237873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6846},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6846":{"gid":6846,"name":"b","rank":0,"incarnation":66,"state":"up:active","state_seq":33,"addr":"172.21.15.110:6834/1072346524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1072346524},{"type":"v1","addr":"172.21.15.110:6834","nonce":1072346524}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2024-01-22T05:12:12.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.382+0000 7ffacb000700 1 -- 172.21.15.49:0/2301566373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa9c05a510 msgr2=0x7ffa9c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:12.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.382+0000 7ffacb000700 1 --2- 172.21.15.49:0/2301566373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa9c05a510 0x7ffa9c05c9d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7ffab4009130 tx=0x7ffab4017000).stop 2024-01-22T05:12:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.382+0000 7ffacb000700 1 -- 172.21.15.49:0/2301566373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4065620 msgr2=0x7ffac40bf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.382+0000 7ffacb000700 1 --2- 172.21.15.49:0/2301566373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4065620 0x7ffac40bf380 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7ffabc002230 tx=0x7ffabc0015e0).stop 2024-01-22T05:12:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.386+0000 7ffacb000700 1 -- 172.21.15.49:0/2301566373 shutdown_connections 2024-01-22T05:12:12.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.386+0000 7ffacb000700 1 --2- 172.21.15.49:0/2301566373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa9c05a510 0x7ffa9c05c9d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.386+0000 7ffacb000700 1 --2- 172.21.15.49:0/2301566373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4065620 0x7ffac40bf380 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.386+0000 7ffacb000700 1 --2- 172.21.15.49:0/2301566373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffac4065240 0x7ffac414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.386+0000 7ffacb000700 1 --2- 172.21.15.49:0/2301566373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffac40649e0 0x7ffac40ac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.386+0000 7ffacb000700 1 -- 172.21.15.49:0/2301566373 >> 172.21.15.49:0/2301566373 conn(0x7ffac40c87f0 msgr2=0x7ffac4063560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:12.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.386+0000 7ffacb000700 1 -- 172.21.15.49:0/2301566373 shutdown_connections 2024-01-22T05:12:12.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.386+0000 7ffacb000700 1 -- 172.21.15.49:0/2301566373 wait complete. 2024-01-22T05:12:12.392 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 83 2024-01-22T05:12:12.412 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:12:12.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.570+0000 7fe902400700 1 Processor -- start 2024-01-22T05:12:12.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.570+0000 7fe902400700 1 -- start start 2024-01-22T05:12:12.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.570+0000 7fe902400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe8fc153280 0x7fe8fc153660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:12.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.570+0000 7fe902400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8fc068aa0 0x7fe8fc068f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.570+0000 7fe902400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8fc067a90 con 0x7fe8fc155470 2024-01-22T05:12:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.570+0000 7fe902400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8fc068610 con 0x7fe8fc153280 2024-01-22T05:12:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.570+0000 7fe902400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc069410 con 0x7fe8fc068aa0 2024-01-22T05:12:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.570+0000 7fe901a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe8fc155470 0x7fe8fc0ab9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34770/0 (socket says 172.21.15.49:34770) 2024-01-22T05:12:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.570+0000 7fe901a00700 1 -- 172.21.15.49:0/2907471198 learned_addr learned my addr 172.21.15.49:0/2907471198 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.570+0000 7fe901000700 1 --2- 172.21.15.49:0/2907471198 >> v2:172.21.15.110:3300/0 conn(0x7fe8fc153280 0x7fe8fc153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:12.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.570+0000 7fe8fbe00700 1 --2- 172.21.15.49:0/2907471198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8fc068aa0 0x7fe8fc068f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:12.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe8fbe00700 1 -- 172.21.15.49:0/2907471198 >> v2:172.21.15.110:3300/0 conn(0x7fe8fc153280 msgr2=0x7fe8fc153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:12.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe8fbe00700 1 --2- 172.21.15.49:0/2907471198 >> v2:172.21.15.110:3300/0 conn(0x7fe8fc153280 0x7fe8fc153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe8fbe00700 1 -- 172.21.15.49:0/2907471198 >> v1:172.21.15.49:6789/0 conn(0x7fe8fc155470 legacy=0x7fe8fc0ab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:12.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe8fb400700 1 -- 172.21.15.49:0/2907471198 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495641225 0 0) 0x7fe8fc067a90 con 0x7fe8fc155470 2024-01-22T05:12:12.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe8fbe00700 1 -- 172.21.15.49:0/2907471198 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8fc0a99e0 con 0x7fe8fc068aa0 2024-01-22T05:12:12.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe8fbe00700 1 --2- 172.21.15.49:0/2907471198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8fc068aa0 0x7fe8fc068f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fe8e4009760 tx=0x7fe8e4009060).ready entity=mon.2 client_cookie=1554e3b31b0ec246 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:12.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe8fb400700 1 -- 172.21.15.49:0/2907471198 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e400f510 con 0x7fe8fc068aa0 2024-01-22T05:12:12.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe8fb400700 1 -- 172.21.15.49:0/2907471198 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e400f670 con 0x7fe8fc068aa0 2024-01-22T05:12:12.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe8fb400700 1 -- 172.21.15.49:0/2907471198 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e400f9f0 con 0x7fe8fc068aa0 2024-01-22T05:12:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe902400700 1 -- 172.21.15.49:0/2907471198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8fc068aa0 msgr2=0x7fe8fc068f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe902400700 1 --2- 172.21.15.49:0/2907471198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8fc068aa0 0x7fe8fc068f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fe8e4009760 tx=0x7fe8e4009060).stop 2024-01-22T05:12:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe902400700 1 -- 172.21.15.49:0/2907471198 shutdown_connections 2024-01-22T05:12:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe902400700 1 --2- 172.21.15.49:0/2907471198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8fc068aa0 0x7fe8fc068f20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe902400700 1 --2- 172.21.15.49:0/2907471198 >> v2:172.21.15.110:3300/0 conn(0x7fe8fc153280 0x7fe8fc153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe902400700 1 -- 172.21.15.49:0/2907471198 >> 172.21.15.49:0/2907471198 conn(0x7fe8fc0c6530 msgr2=0x7fe8fc0c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe902400700 1 -- 172.21.15.49:0/2907471198 shutdown_connections 2024-01-22T05:12:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.574+0000 7fe902400700 1 -- 172.21.15.49:0/2907471198 wait complete. 2024-01-22T05:12:12.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.578+0000 7fe902400700 1 Processor -- start 2024-01-22T05:12:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.578+0000 7fe902400700 1 -- start start 2024-01-22T05:12:12.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.578+0000 7fe902400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8fc068aa0 0x7fe8fc1418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:12.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.578+0000 7fe902400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8fc153280 0x7fe8fc14c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:12.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.578+0000 7fe902400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8fc155470 0x7fe8fc14e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:12.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.578+0000 7fe902400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc14d450 con 0x7fe8fc153280 2024-01-22T05:12:12.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe902400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc14d730 con 0x7fe8fc155470 2024-01-22T05:12:12.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe902400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc14da10 con 0x7fe8fc068aa0 2024-01-22T05:12:12.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe8fbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8fc153280 0x7fe8fc14c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:12.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe8fbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8fc153280 0x7fe8fc14c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35222/0 (socket says 172.21.15.49:35222) 2024-01-22T05:12:12.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe8fbe00700 1 -- 172.21.15.49:0/1755152652 learned_addr learned my addr 172.21.15.49:0/1755152652 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:12.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe901a00700 1 --2- 172.21.15.49:0/1755152652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8fc155470 0x7fe8fc14e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:12.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe901000700 1 --2- 172.21.15.49:0/1755152652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8fc068aa0 0x7fe8fc1418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:12.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe8fbe00700 1 -- 172.21.15.49:0/1755152652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8fc068aa0 msgr2=0x7fe8fc1418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:12.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe8fbe00700 1 --2- 172.21.15.49:0/1755152652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8fc068aa0 0x7fe8fc1418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe8fbe00700 1 -- 172.21.15.49:0/1755152652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8fc155470 msgr2=0x7fe8fc14e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:12.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe8fbe00700 1 --2- 172.21.15.49:0/1755152652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8fc155470 0x7fe8fc14e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe8fbe00700 1 -- 172.21.15.49:0/1755152652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e40092a0 con 0x7fe8fc153280 2024-01-22T05:12:12.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe901a00700 1 --2- 172.21.15.49:0/1755152652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8fc155470 0x7fe8fc14e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:12.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe8fbe00700 1 --2- 172.21.15.49:0/1755152652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8fc153280 0x7fe8fc14c720 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7fe8fc069550 tx=0x7fe8e4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:12.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe8f3e00700 1 -- 172.21.15.49:0/1755152652 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e400f7e0 con 0x7fe8fc153280 2024-01-22T05:12:12.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe8f3e00700 1 -- 172.21.15.49:0/1755152652 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e400f940 con 0x7fe8fc153280 2024-01-22T05:12:12.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe902400700 1 -- 172.21.15.49:0/1755152652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8fc14dcf0 con 0x7fe8fc153280 2024-01-22T05:12:12.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe8f3e00700 1 -- 172.21.15.49:0/1755152652 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e401b660 con 0x7fe8fc153280 2024-01-22T05:12:12.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.582+0000 7fe902400700 1 -- 172.21.15.49:0/1755152652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8fc141580 con 0x7fe8fc153280 2024-01-22T05:12:12.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.586+0000 7fe902400700 1 -- 172.21.15.49:0/1755152652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8fc05fd40 con 0x7fe8fc153280 2024-01-22T05:12:12.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.586+0000 7fe8f3e00700 1 -- 172.21.15.49:0/1755152652 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe8e401ba50 con 0x7fe8fc153280 2024-01-22T05:12:12.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.586+0000 7fe8f3e00700 1 --2- 172.21.15.49:0/1755152652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe8d405a510 0x7fe8d405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:12.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.586+0000 7fe8f3e00700 1 -- 172.21.15.49:0/1755152652 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fe8e40764a0 con 0x7fe8fc153280 2024-01-22T05:12:12.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.590+0000 7fe901000700 1 --2- 172.21.15.49:0/1755152652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe8d405a510 0x7fe8d405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:12.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.590+0000 7fe901000700 1 --2- 172.21.15.49:0/1755152652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe8d405a510 0x7fe8d405c9d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fe8ec009bc0 tx=0x7fe8ec008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:12.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.594+0000 7fe8f3e00700 1 -- 172.21.15.49:0/1755152652 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe8e4049ad0 con 0x7fe8fc153280 2024-01-22T05:12:12.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.798+0000 7fe902400700 1 -- 172.21.15.49:0/1755152652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8fc046800 con 0x7fe8fc153280 2024-01-22T05:12:12.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.802+0000 7fe8f3e00700 1 -- 172.21.15.49:0/1755152652 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fe8e4006b30 con 0x7fe8fc153280 2024-01-22T05:12:12.804 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:12.805 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":83,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6080,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/948258971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":948258971},{"type":"v1","addr":"172.21.15.110:6835","nonce":948258971}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6828,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/304005498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":304005498},{"type":"v1","addr":"172.21.15.49:6835","nonce":304005498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6843,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1613189666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1613189666},{"type":"v1","addr":"172.21.15.49:6837","nonce":1613189666}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-01-22T05:09:52.708060+0000","modified":"2024-01-22T05:11:53.237873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6846},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6846":{"gid":6846,"name":"b","rank":0,"incarnation":66,"state":"up:active","state_seq":33,"addr":"172.21.15.110:6834/1072346524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1072346524},{"type":"v1","addr":"172.21.15.110:6834","nonce":1072346524}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2024-01-22T05:12:12.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.806+0000 7fe902400700 1 -- 172.21.15.49:0/1755152652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe8d405a510 msgr2=0x7fe8d405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:12.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.806+0000 7fe902400700 1 --2- 172.21.15.49:0/1755152652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe8d405a510 0x7fe8d405c9d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fe8ec009bc0 tx=0x7fe8ec008040).stop 2024-01-22T05:12:12.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.806+0000 7fe902400700 1 -- 172.21.15.49:0/1755152652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8fc153280 msgr2=0x7fe8fc14c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:12.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.806+0000 7fe902400700 1 --2- 172.21.15.49:0/1755152652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8fc153280 0x7fe8fc14c720 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7fe8fc069550 tx=0x7fe8e4017000).stop 2024-01-22T05:12:12.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.806+0000 7fe902400700 1 -- 172.21.15.49:0/1755152652 shutdown_connections 2024-01-22T05:12:12.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.806+0000 7fe902400700 1 --2- 172.21.15.49:0/1755152652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe8d405a510 0x7fe8d405c9d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.806+0000 7fe902400700 1 --2- 172.21.15.49:0/1755152652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8fc155470 0x7fe8fc14e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.806+0000 7fe902400700 1 --2- 172.21.15.49:0/1755152652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8fc153280 0x7fe8fc14c720 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.806+0000 7fe902400700 1 --2- 172.21.15.49:0/1755152652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8fc068aa0 0x7fe8fc1418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:12.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.806+0000 7fe902400700 1 -- 172.21.15.49:0/1755152652 >> 172.21.15.49:0/1755152652 conn(0x7fe8fc0c6530 msgr2=0x7fe8fc0c55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:12.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.806+0000 7fe902400700 1 -- 172.21.15.49:0/1755152652 shutdown_connections 2024-01-22T05:12:12.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.806+0000 7fe902400700 1 -- 172.21.15.49:0/1755152652 wait complete. 2024-01-22T05:12:12.814 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 83 2024-01-22T05:12:12.834 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:12:12.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.994+0000 7fc6b8000700 1 Processor -- start 2024-01-22T05:12:12.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.994+0000 7fc6b8000700 1 -- start start 2024-01-22T05:12:13.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6b8000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6b0155d20 0x7fc6b0065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:13.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6b8000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc6b0066070 0x7fc6b00a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:13.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6b8000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b00a90e0 con 0x7fc6b00a8c30 2024-01-22T05:12:13.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6b8000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b00c1a40 con 0x7fc6b0066070 2024-01-22T05:12:13.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6b8000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b0159310 con 0x7fc6b0155d20 2024-01-22T05:12:13.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6b4c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc6b0066070 0x7fc6b00a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:13.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6b4c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc6b0066070 0x7fc6b00a8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35224/0 (socket says 172.21.15.49:35224) 2024-01-22T05:12:13.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6b4c00700 1 -- 172.21.15.49:0/3173265773 learned_addr learned my addr 172.21.15.49:0/3173265773 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:13.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6b6000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc6b00a8c30 0x7fc6b00c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34784/0 (socket says 172.21.15.49:34784) 2024-01-22T05:12:13.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6b5600700 1 --2- 172.21.15.49:0/3173265773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6b0155d20 0x7fc6b0065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:13.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6b4c00700 1 -- 172.21.15.49:0/3173265773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6b0155d20 msgr2=0x7fc6b0065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:13.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6b4c00700 1 --2- 172.21.15.49:0/3173265773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6b0155d20 0x7fc6b0065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:13.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6b4c00700 1 -- 172.21.15.49:0/3173265773 >> v1:172.21.15.49:6789/0 conn(0x7fc6b00a8c30 legacy=0x7fc6b00c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:13.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6b4c00700 1 -- 172.21.15.49:0/3173265773 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b00c13f0 con 0x7fc6b0066070 2024-01-22T05:12:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6b4c00700 1 --2- 172.21.15.49:0/3173265773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6b0066070 0x7fc6b00a8740 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fc698006fd0 tx=0x7fc6980090f0).ready entity=mon.0 client_cookie=72a58d085b07dbcd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6afe00700 1 -- 172.21.15.49:0/3173265773 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69800b580 con 0x7fc6b0066070 2024-01-22T05:12:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6afe00700 1 -- 172.21.15.49:0/3173265773 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69800b6e0 con 0x7fc6b0066070 2024-01-22T05:12:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:12.998+0000 7fc6afe00700 1 -- 172.21.15.49:0/3173265773 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69800ba60 con 0x7fc6b0066070 2024-01-22T05:12:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.002+0000 7fc6b8000700 1 -- 172.21.15.49:0/3173265773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6b0066070 msgr2=0x7fc6b00a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:13.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.002+0000 7fc6b8000700 1 --2- 172.21.15.49:0/3173265773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6b0066070 0x7fc6b00a8740 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fc698006fd0 tx=0x7fc6980090f0).stop 2024-01-22T05:12:13.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.002+0000 7fc6b8000700 1 -- 172.21.15.49:0/3173265773 shutdown_connections 2024-01-22T05:12:13.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.002+0000 7fc6b8000700 1 --2- 172.21.15.49:0/3173265773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6b0066070 0x7fc6b00a8740 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:13.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.002+0000 7fc6b8000700 1 --2- 172.21.15.49:0/3173265773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6b0155d20 0x7fc6b0065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:13.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.002+0000 7fc6b8000700 1 -- 172.21.15.49:0/3173265773 >> 172.21.15.49:0/3173265773 conn(0x7fc6b00c6540 msgr2=0x7fc6b00c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:13.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.002+0000 7fc6b8000700 1 -- 172.21.15.49:0/3173265773 shutdown_connections 2024-01-22T05:12:13.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.002+0000 7fc6b8000700 1 -- 172.21.15.49:0/3173265773 wait complete. 2024-01-22T05:12:13.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b8000700 1 Processor -- start 2024-01-22T05:12:13.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b8000700 1 -- start start 2024-01-22T05:12:13.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b8000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6b0066070 0x7fc6b015a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:13.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b8000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6b00a8c30 0x7fc6b0152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:13.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b8000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6b0155d20 0x7fc6b00c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:13.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b8000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b00c05b0 con 0x7fc6b0066070 2024-01-22T05:12:13.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b8000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b015a7e0 con 0x7fc6b00a8c30 2024-01-22T05:12:13.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b8000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b00c02d0 con 0x7fc6b0155d20 2024-01-22T05:12:13.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b5600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6b0066070 0x7fc6b015a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:13.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b5600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6b0066070 0x7fc6b015a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35226/0 (socket says 172.21.15.49:35226) 2024-01-22T05:12:13.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b5600700 1 -- 172.21.15.49:0/1183951137 learned_addr learned my addr 172.21.15.49:0/1183951137 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:13.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b6000700 1 --2- 172.21.15.49:0/1183951137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6b0155d20 0x7fc6b00c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:13.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b4c00700 1 --2- 172.21.15.49:0/1183951137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6b00a8c30 0x7fc6b0152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:13.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b5600700 1 -- 172.21.15.49:0/1183951137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6b0155d20 msgr2=0x7fc6b00c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:13.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b5600700 1 --2- 172.21.15.49:0/1183951137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6b0155d20 0x7fc6b00c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:13.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b5600700 1 -- 172.21.15.49:0/1183951137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6b00a8c30 msgr2=0x7fc6b0152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:13.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b5600700 1 --2- 172.21.15.49:0/1183951137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6b00a8c30 0x7fc6b0152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:13.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b5600700 1 -- 172.21.15.49:0/1183951137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc698009370 con 0x7fc6b0066070 2024-01-22T05:12:13.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b6000700 1 --2- 172.21.15.49:0/1183951137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6b0155d20 0x7fc6b00c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:13.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b5600700 1 --2- 172.21.15.49:0/1183951137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6b0066070 0x7fc6b015a2f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fc6a000e960 tx=0x7fc6a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:13.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6acc00700 1 -- 172.21.15.49:0/1183951137 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0009510 con 0x7fc6b0066070 2024-01-22T05:12:13.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6acc00700 1 -- 172.21.15.49:0/1183951137 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a000c850 con 0x7fc6b0066070 2024-01-22T05:12:13.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.006+0000 7fc6b8000700 1 -- 172.21.15.49:0/1183951137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b0159810 con 0x7fc6b0066070 2024-01-22T05:12:13.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.010+0000 7fc6acc00700 1 -- 172.21.15.49:0/1183951137 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a000cbd0 con 0x7fc6b0066070 2024-01-22T05:12:13.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.010+0000 7fc6b8000700 1 -- 172.21.15.49:0/1183951137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b0159dd0 con 0x7fc6b0066070 2024-01-22T05:12:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.010+0000 7fc6b8000700 1 -- 172.21.15.49:0/1183951137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b0159670 con 0x7fc6b0066070 2024-01-22T05:12:13.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.010+0000 7fc6acc00700 1 -- 172.21.15.49:0/1183951137 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc6a001b400 con 0x7fc6b0066070 2024-01-22T05:12:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.010+0000 7fc6acc00700 1 --2- 172.21.15.49:0/1183951137 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc68805a510 0x7fc68805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.014+0000 7fc6acc00700 1 -- 172.21.15.49:0/1183951137 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fc6a0074e60 con 0x7fc6b0066070 2024-01-22T05:12:13.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.014+0000 7fc6b4c00700 1 --2- 172.21.15.49:0/1183951137 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc68805a510 0x7fc68805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:13.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.014+0000 7fc6b4c00700 1 --2- 172.21.15.49:0/1183951137 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc68805a510 0x7fc68805c9d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fc698006fd0 tx=0x7fc698017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:13.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.022+0000 7fc6acc00700 1 -- 172.21.15.49:0/1183951137 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc6b0159670 con 0x7fc6b0066070 2024-01-22T05:12:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.186+0000 7fc6b8000700 1 -- 172.21.15.49:0/1183951137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6b0159670 con 0x7fc6b0066070 2024-01-22T05:12:13.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.190+0000 7fc6acc00700 1 -- 172.21.15.49:0/1183951137 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+17330 (secure 0 0 0) 0x7fc6b0159670 con 0x7fc6b0066070 2024-01-22T05:12:13.193 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:13.193 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":92,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:11:51.218642+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:09:50.901052+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-22T05:09:51.722128+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1","mappings":[{"from":6,"to":3}]},{"pgid":"13.16","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":13,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:12:13.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.190+0000 7fc6b8000700 1 -- 172.21.15.49:0/1183951137 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc68805a510 msgr2=0x7fc68805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:13.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.190+0000 7fc6b8000700 1 --2- 172.21.15.49:0/1183951137 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc68805a510 0x7fc68805c9d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fc698006fd0 tx=0x7fc698017000).stop 2024-01-22T05:12:13.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.190+0000 7fc6b8000700 1 -- 172.21.15.49:0/1183951137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6b0066070 msgr2=0x7fc6b015a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:13.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.190+0000 7fc6b8000700 1 --2- 172.21.15.49:0/1183951137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6b0066070 0x7fc6b015a2f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fc6a000e960 tx=0x7fc6a0009060).stop 2024-01-22T05:12:13.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.194+0000 7fc6b8000700 1 -- 172.21.15.49:0/1183951137 shutdown_connections 2024-01-22T05:12:13.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.194+0000 7fc6b8000700 1 --2- 172.21.15.49:0/1183951137 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc68805a510 0x7fc68805c9d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:13.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.194+0000 7fc6b8000700 1 --2- 172.21.15.49:0/1183951137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6b0155d20 0x7fc6b00c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:13.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.194+0000 7fc6b8000700 1 --2- 172.21.15.49:0/1183951137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6b00a8c30 0x7fc6b0152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.194+0000 7fc6b8000700 1 --2- 172.21.15.49:0/1183951137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6b0066070 0x7fc6b015a2f0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.194+0000 7fc6b8000700 1 -- 172.21.15.49:0/1183951137 >> 172.21.15.49:0/1183951137 conn(0x7fc6b00c6540 msgr2=0x7fc6b0066520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.194+0000 7fc6b8000700 1 -- 172.21.15.49:0/1183951137 shutdown_connections 2024-01-22T05:12:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.194+0000 7fc6b8000700 1 -- 172.21.15.49:0/1183951137 wait complete. 2024-01-22T05:12:13.222 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:12:13.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.382+0000 7fd004c00700 1 Processor -- start 2024-01-22T05:12:13.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.382+0000 7fd004c00700 1 -- start start 2024-01-22T05:12:13.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.382+0000 7fd004c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd000068e80 0x7fd0000c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:13.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.382+0000 7fd004c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd000066a10 con 0x7fd0000a7cb0 2024-01-22T05:12:13.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.382+0000 7fd004c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0000a8140 con 0x7fd0000c1330 2024-01-22T05:12:13.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.382+0000 7fd004c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000a8420 con 0x7fd000068e80 2024-01-22T05:12:13.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.382+0000 7fcffde00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd0000a7cb0 0x7fd000157bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56440/0 (socket says 172.21.15.49:56440) 2024-01-22T05:12:13.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffde00700 1 -- 172.21.15.49:0/3634170991 learned_addr learned my addr 172.21.15.49:0/3634170991 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:13.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffd400700 1 --2- 172.21.15.49:0/3634170991 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd000068e80 0x7fd0000c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:13.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 -- 172.21.15.49:0/3634170991 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546846855 0 0) 0x7fd000066a10 con 0x7fd0000a7cb0 2024-01-22T05:12:13.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 -- 172.21.15.49:0/3634170991 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfe00033f0 con 0x7fd0000a7cb0 2024-01-22T05:12:13.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 -- 172.21.15.49:0/3634170991 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3969595292 0 0) 0x7fcfe00033f0 con 0x7fd0000a7cb0 2024-01-22T05:12:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 -- 172.21.15.49:0/3634170991 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd000068e80 msgr2=0x7fd0000c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 --2- 172.21.15.49:0/3634170991 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd000068e80 0x7fd0000c0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 -- 172.21.15.49:0/3634170991 >> v1:172.21.15.110:6789/0 conn(0x7fd0000c1330 legacy=0x7fd0000c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 -- 172.21.15.49:0/3634170991 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0000a8700 con 0x7fd0000a7cb0 2024-01-22T05:12:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 -- 172.21.15.49:0/3634170991 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fcff0001470 con 0x7fd0000a7cb0 2024-01-22T05:12:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 -- 172.21.15.49:0/3634170991 >> v1:172.21.15.49:6789/0 conn(0x7fd0000a7cb0 legacy=0x7fd000157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 --2- 172.21.15.49:0/3634170991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe0003910 0x7fcfe0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 --2- 172.21.15.49:0/3634170991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe0004690 0x7fcfe0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 --2- 172.21.15.49:0/3634170991 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd000068e80 0x7fcfe0005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 -- 172.21.15.49:0/3634170991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000a8420 con 0x7fcfe0003910 2024-01-22T05:12:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 -- 172.21.15.49:0/3634170991 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe000b9c0 con 0x7fcfe0004690 2024-01-22T05:12:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 -- 172.21.15.49:0/3634170991 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe000bb80 con 0x7fd000068e80 2024-01-22T05:12:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffde00700 1 --2- 172.21.15.49:0/3634170991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe0003910 0x7fcfe0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:13.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffd400700 1 --2- 172.21.15.49:0/3634170991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe0004690 0x7fcfe0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:13.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffe800700 1 --2- 172.21.15.49:0/3634170991 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd000068e80 0x7fcfe0005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:13.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffde00700 1 -- 172.21.15.49:0/3634170991 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd000068e80 msgr2=0x7fcfe0005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:13.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffde00700 1 --2- 172.21.15.49:0/3634170991 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd000068e80 0x7fcfe0005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:13.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffde00700 1 -- 172.21.15.49:0/3634170991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe0004690 msgr2=0x7fcfe0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:13.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffde00700 1 --2- 172.21.15.49:0/3634170991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe0004690 0x7fcfe0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:13.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffde00700 1 -- 172.21.15.49:0/3634170991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe00033f0 con 0x7fcfe0003910 2024-01-22T05:12:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffde00700 1 --2- 172.21.15.49:0/3634170991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe0003910 0x7fcfe0003d30 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fcff000c190 tx=0x7fcff0001e50).ready entity=mon.0 client_cookie=9bf95835ae3ce2a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 -- 172.21.15.49:0/3634170991 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0007a20 con 0x7fcfe0003910 2024-01-22T05:12:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 -- 172.21.15.49:0/3634170991 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff000cac0 con 0x7fcfe0003910 2024-01-22T05:12:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.386+0000 7fcffca00700 1 -- 172.21.15.49:0/3634170991 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000ce40 con 0x7fcfe0003910 2024-01-22T05:12:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.390+0000 7fd004c00700 1 -- 172.21.15.49:0/3634170991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe0003910 msgr2=0x7fcfe0003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.390+0000 7fd004c00700 1 --2- 172.21.15.49:0/3634170991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe0003910 0x7fcfe0003d30 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fcff000c190 tx=0x7fcff0001e50).stop 2024-01-22T05:12:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.390+0000 7fcffe800700 1 -- 172.21.15.49:0/3634170991 reap_dead start 2024-01-22T05:12:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.390+0000 7fd004c00700 1 -- 172.21.15.49:0/3634170991 shutdown_connections 2024-01-22T05:12:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.390+0000 7fd004c00700 1 -- 172.21.15.49:0/3634170991 >> 172.21.15.49:0/3634170991 conn(0x7fd0000c64a0 msgr2=0x7fd0000c68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:13.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.390+0000 7fd004c00700 1 -- 172.21.15.49:0/3634170991 shutdown_connections 2024-01-22T05:12:13.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.390+0000 7fd004c00700 1 -- 172.21.15.49:0/3634170991 wait complete. 2024-01-22T05:12:13.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.394+0000 7fd004c00700 1 Processor -- start 2024-01-22T05:12:13.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.394+0000 7fd004c00700 1 -- start start 2024-01-22T05:12:13.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.394+0000 7fd004c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe0003910 0x7fd00013a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:13.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.394+0000 7fd004c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0001399f0 0x7fd0000a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:13.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.394+0000 7fd004c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0000aa420 0x7fd00014f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:13.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.394+0000 7fd004c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd000150980 con 0x7fcfe0003910 2024-01-22T05:12:13.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.394+0000 7fd004c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000aa860 con 0x7fd0001399f0 2024-01-22T05:12:13.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.394+0000 7fd004c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00013a7a0 con 0x7fd0000aa420 2024-01-22T05:12:13.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fcffde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe0003910 0x7fd00013a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:13.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fcffde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe0003910 0x7fd00013a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44296/0 (socket says 172.21.15.49:44296) 2024-01-22T05:12:13.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fcffde00700 1 -- 172.21.15.49:0/2217848668 learned_addr learned my addr 172.21.15.49:0/2217848668 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:13.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fcffd400700 1 --2- 172.21.15.49:0/2217848668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0001399f0 0x7fd0000a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:13.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fcffe800700 1 --2- 172.21.15.49:0/2217848668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0000aa420 0x7fd00014f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:13.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fcffde00700 1 -- 172.21.15.49:0/2217848668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0000aa420 msgr2=0x7fd00014f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:13.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fcffde00700 1 --2- 172.21.15.49:0/2217848668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0000aa420 0x7fd00014f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:13.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fcffde00700 1 -- 172.21.15.49:0/2217848668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0001399f0 msgr2=0x7fd0000a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:13.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fcffde00700 1 --2- 172.21.15.49:0/2217848668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0001399f0 0x7fd0000a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:13.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fcffde00700 1 -- 172.21.15.49:0/2217848668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00014fd70 con 0x7fcfe0003910 2024-01-22T05:12:13.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fcffde00700 1 --2- 172.21.15.49:0/2217848668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe0003910 0x7fd00013a2b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7fcfe000b990 tx=0x7fcff0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:13.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fcff5600700 1 -- 172.21.15.49:0/2217848668 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff00075c0 con 0x7fcfe0003910 2024-01-22T05:12:13.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fcff5600700 1 -- 172.21.15.49:0/2217848668 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff00046b0 con 0x7fcfe0003910 2024-01-22T05:12:13.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fcff5600700 1 -- 172.21.15.49:0/2217848668 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0004a50 con 0x7fcfe0003910 2024-01-22T05:12:13.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fd004c00700 1 -- 172.21.15.49:0/2217848668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd000150050 con 0x7fcfe0003910 2024-01-22T05:12:13.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fd004c00700 1 -- 172.21.15.49:0/2217848668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd000150610 con 0x7fcfe0003910 2024-01-22T05:12:13.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.398+0000 7fd004c00700 1 -- 172.21.15.49:0/2217848668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0000c0b40 con 0x7fcfe0003910 2024-01-22T05:12:13.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.402+0000 7fcff5600700 1 -- 172.21.15.49:0/2217848668 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcff0020480 con 0x7fcfe0003910 2024-01-22T05:12:13.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.402+0000 7fcff5600700 1 --2- 172.21.15.49:0/2217848668 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcfd805a4e0 0x7fcfd805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:13.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.402+0000 7fcff5600700 1 -- 172.21.15.49:0/2217848668 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fcff00758a0 con 0x7fcfe0003910 2024-01-22T05:12:13.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.402+0000 7fcffd400700 1 --2- 172.21.15.49:0/2217848668 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcfd805a4e0 0x7fcfd805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:13.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.402+0000 7fcffd400700 1 --2- 172.21.15.49:0/2217848668 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcfd805a4e0 0x7fcfd805c9a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fcfe8006d80 tx=0x7fcfe8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:13.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.410+0000 7fcff5600700 1 -- 172.21.15.49:0/2217848668 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcff0048e70 con 0x7fcfe0003910 2024-01-22T05:12:13.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:13.618+0000 7fd004c00700 1 -- 172.21.15.49:0/2217848668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd000046800 con 0x7fcfe0003910 2024-01-22T05:12:14.261 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:12:14.258+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:12:14.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.270+0000 7fcff5600700 1 -- 172.21.15.49:0/2217848668 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcff004c490 con 0x7fcfe0003910 2024-01-22T05:12:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.274+0000 7fd004c00700 1 -- 172.21.15.49:0/2217848668 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcfd805a4e0 msgr2=0x7fcfd805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.274+0000 7fd004c00700 1 --2- 172.21.15.49:0/2217848668 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcfd805a4e0 0x7fcfd805c9a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fcfe8006d80 tx=0x7fcfe8008040).stop 2024-01-22T05:12:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.274+0000 7fd004c00700 1 -- 172.21.15.49:0/2217848668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe0003910 msgr2=0x7fd00013a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.274+0000 7fd004c00700 1 --2- 172.21.15.49:0/2217848668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe0003910 0x7fd00013a2b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7fcfe000b990 tx=0x7fcff0015000).stop 2024-01-22T05:12:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.274+0000 7fd004c00700 1 -- 172.21.15.49:0/2217848668 shutdown_connections 2024-01-22T05:12:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.274+0000 7fd004c00700 1 --2- 172.21.15.49:0/2217848668 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcfd805a4e0 0x7fcfd805c9a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.274+0000 7fd004c00700 1 --2- 172.21.15.49:0/2217848668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0000aa420 0x7fd00014f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.274+0000 7fd004c00700 1 --2- 172.21.15.49:0/2217848668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0001399f0 0x7fd0000a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.274+0000 7fd004c00700 1 --2- 172.21.15.49:0/2217848668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe0003910 0x7fd00013a2b0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.274+0000 7fd004c00700 1 -- 172.21.15.49:0/2217848668 >> 172.21.15.49:0/2217848668 conn(0x7fd0000c64a0 msgr2=0x7fd0000c1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.274+0000 7fd004c00700 1 -- 172.21.15.49:0/2217848668 shutdown_connections 2024-01-22T05:12:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.274+0000 7fd004c00700 1 -- 172.21.15.49:0/2217848668 wait complete. 2024-01-22T05:12:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:12:14.304 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:12:14.351 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:12:14.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.486+0000 7f77af200700 1 Processor -- start 2024-01-22T05:12:14.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.486+0000 7f77af200700 1 -- start start 2024-01-22T05:12:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77af200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f77a8062900 0x7f77a8062d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77af200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f77a8068b30 0x7f77a8068fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77af200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a8063260 con 0x7f77a80bded0 2024-01-22T05:12:14.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77af200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a80be2b0 con 0x7f77a8062900 2024-01-22T05:12:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77af200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a8069490 con 0x7f77a8068b30 2024-01-22T05:12:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77a7400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f77a8062900 0x7f77a8062d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77ad200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f77a8068b30 0x7f77a8068fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77a7e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f77a80bded0 0x7f77a8157db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:32970/0 (socket says 172.21.15.49:32970) 2024-01-22T05:12:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77a7400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f77a8062900 0x7f77a8062d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44310/0 (socket says 172.21.15.49:44310) 2024-01-22T05:12:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77a7e00700 1 -- 172.21.15.49:0/50685357 learned_addr learned my addr 172.21.15.49:0/50685357 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:14.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77a6a00700 1 -- 172.21.15.49:0/50685357 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947159359 0 0) 0x7f77a8063260 con 0x7f77a80bded0 2024-01-22T05:12:14.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77a6a00700 1 -- 172.21.15.49:0/50685357 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77880033f0 con 0x7f77a80bded0 2024-01-22T05:12:14.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77ad200700 1 -- 172.21.15.49:0/50685357 >> v2:172.21.15.49:3300/0 conn(0x7f77a8062900 msgr2=0x7f77a8062d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:14.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77ad200700 1 --2- 172.21.15.49:0/50685357 >> v2:172.21.15.49:3300/0 conn(0x7f77a8062900 0x7f77a8062d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:14.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77ad200700 1 -- 172.21.15.49:0/50685357 >> v1:172.21.15.110:6789/0 conn(0x7f77a80bded0 legacy=0x7f77a8157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:14.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77ad200700 1 -- 172.21.15.49:0/50685357 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a8067a90 con 0x7f77a8068b30 2024-01-22T05:12:14.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77ad200700 1 --2- 172.21.15.49:0/50685357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77a8068b30 0x7f77a8068fa0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f77a80bf790 tx=0x7f77a0009780).ready entity=mon.1 client_cookie=3f3bba6dd7aaf1f5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:14.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77a6a00700 1 -- 172.21.15.49:0/50685357 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a000e070 con 0x7f77a8068b30 2024-01-22T05:12:14.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77a6a00700 1 -- 172.21.15.49:0/50685357 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a000bab0 con 0x7f77a8068b30 2024-01-22T05:12:14.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.490+0000 7f77a6a00700 1 -- 172.21.15.49:0/50685357 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a000be30 con 0x7f77a8068b30 2024-01-22T05:12:14.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.494+0000 7f77af200700 1 -- 172.21.15.49:0/50685357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77a8068b30 msgr2=0x7f77a8068fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:14.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.494+0000 7f77af200700 1 --2- 172.21.15.49:0/50685357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77a8068b30 0x7f77a8068fa0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f77a80bf790 tx=0x7f77a0009780).stop 2024-01-22T05:12:14.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.494+0000 7f77af200700 1 -- 172.21.15.49:0/50685357 shutdown_connections 2024-01-22T05:12:14.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.494+0000 7f77af200700 1 --2- 172.21.15.49:0/50685357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77a8068b30 0x7f77a8068fa0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:14.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.494+0000 7f77af200700 1 --2- 172.21.15.49:0/50685357 >> v2:172.21.15.49:3300/0 conn(0x7f77a8062900 0x7f77a8062d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:14.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.494+0000 7f77af200700 1 -- 172.21.15.49:0/50685357 >> 172.21.15.49:0/50685357 conn(0x7f77a80c8740 msgr2=0x7f77a80c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:14.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.494+0000 7f77af200700 1 -- 172.21.15.49:0/50685357 shutdown_connections 2024-01-22T05:12:14.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.494+0000 7f77af200700 1 -- 172.21.15.49:0/50685357 wait complete. 2024-01-22T05:12:14.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.498+0000 7f77af200700 1 Processor -- start 2024-01-22T05:12:14.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.498+0000 7f77af200700 1 -- start start 2024-01-22T05:12:14.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77af200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77a8062900 0x7f77a8153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77af200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77a8068b30 0x7f77a8157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77af200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77a80bded0 0x7f77a80ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77af200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a8158720 con 0x7f77a8062900 2024-01-22T05:12:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77af200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a8158a00 con 0x7f77a8068b30 2024-01-22T05:12:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77af200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a8158ce0 con 0x7f77a80bded0 2024-01-22T05:12:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77a7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77a8062900 0x7f77a8153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77a7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77a8062900 0x7f77a8153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44316/0 (socket says 172.21.15.49:44316) 2024-01-22T05:12:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77a7e00700 1 -- 172.21.15.49:0/3615688369 learned_addr learned my addr 172.21.15.49:0/3615688369 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77a7400700 1 --2- 172.21.15.49:0/3615688369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77a8068b30 0x7f77a8157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77ad200700 1 --2- 172.21.15.49:0/3615688369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77a80bded0 0x7f77a80ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77a7e00700 1 -- 172.21.15.49:0/3615688369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77a80bded0 msgr2=0x7f77a80ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77a7e00700 1 --2- 172.21.15.49:0/3615688369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77a80bded0 0x7f77a80ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:14.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77a7e00700 1 -- 172.21.15.49:0/3615688369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77a8068b30 msgr2=0x7f77a8157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:14.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77a7e00700 1 --2- 172.21.15.49:0/3615688369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77a8068b30 0x7f77a8157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:14.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77a7e00700 1 -- 172.21.15.49:0/3615688369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a0009a20 con 0x7f77a8062900 2024-01-22T05:12:14.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77ad200700 1 --2- 172.21.15.49:0/3615688369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77a80bded0 0x7f77a80ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:14.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77a7e00700 1 --2- 172.21.15.49:0/3615688369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77a8062900 0x7f77a8153460 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f7798001ed0 tx=0x7f7798007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:14.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f779f400700 1 -- 172.21.15.49:0/3615688369 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980072e0 con 0x7f77a8062900 2024-01-22T05:12:14.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f779f400700 1 -- 172.21.15.49:0/3615688369 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7798007440 con 0x7f77a8062900 2024-01-22T05:12:14.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77af200700 1 -- 172.21.15.49:0/3615688369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a8158fc0 con 0x7f77a8062900 2024-01-22T05:12:14.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f779f400700 1 -- 172.21.15.49:0/3615688369 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980057a0 con 0x7f77a8062900 2024-01-22T05:12:14.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.502+0000 7f77af200700 1 -- 172.21.15.49:0/3615688369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a8153950 con 0x7f77a8062900 2024-01-22T05:12:14.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.506+0000 7f77af200700 1 -- 172.21.15.49:0/3615688369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a805fd40 con 0x7f77a8062900 2024-01-22T05:12:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.506+0000 7f779f400700 1 -- 172.21.15.49:0/3615688369 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7798005b50 con 0x7f77a8062900 2024-01-22T05:12:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.510+0000 7f779f400700 1 --2- 172.21.15.49:0/3615688369 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f778005a510 0x7f778005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.510+0000 7f779f400700 1 -- 172.21.15.49:0/3615688369 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f7798074150 con 0x7f77a8062900 2024-01-22T05:12:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.510+0000 7f77a7400700 1 --2- 172.21.15.49:0/3615688369 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f778005a510 0x7f778005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:14.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.510+0000 7f77a7400700 1 --2- 172.21.15.49:0/3615688369 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f778005a510 0x7f778005c9d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f77a80ab490 tx=0x7f7790009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:14.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.514+0000 7f779f400700 1 -- 172.21.15.49:0/3615688369 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7798047680 con 0x7f77a8062900 2024-01-22T05:12:14.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:14.718+0000 7f77af200700 1 -- 172.21.15.49:0/3615688369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f77a8046800 con 0x7f77a8062900 2024-01-22T05:12:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.282+0000 7f779f400700 1 -- 172.21.15.49:0/3615688369 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v85) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7798018020 con 0x7f77a8062900 2024-01-22T05:12:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.286+0000 7f77af200700 1 -- 172.21.15.49:0/3615688369 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f778005a510 msgr2=0x7f778005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.286+0000 7f77af200700 1 --2- 172.21.15.49:0/3615688369 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f778005a510 0x7f778005c9d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f77a80ab490 tx=0x7f7790009060).stop 2024-01-22T05:12:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.286+0000 7f77af200700 1 -- 172.21.15.49:0/3615688369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77a8062900 msgr2=0x7f77a8153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.286+0000 7f77af200700 1 --2- 172.21.15.49:0/3615688369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77a8062900 0x7f77a8153460 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f7798001ed0 tx=0x7f7798007c70).stop 2024-01-22T05:12:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.286+0000 7f77af200700 1 -- 172.21.15.49:0/3615688369 shutdown_connections 2024-01-22T05:12:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.286+0000 7f77af200700 1 --2- 172.21.15.49:0/3615688369 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f778005a510 0x7f778005c9d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.286+0000 7f77af200700 1 --2- 172.21.15.49:0/3615688369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77a80bded0 0x7f77a80ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.286+0000 7f77af200700 1 --2- 172.21.15.49:0/3615688369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77a8068b30 0x7f77a8157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:15.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.286+0000 7f77af200700 1 --2- 172.21.15.49:0/3615688369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77a8062900 0x7f77a8153460 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:15.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.286+0000 7f77af200700 1 -- 172.21.15.49:0/3615688369 >> 172.21.15.49:0/3615688369 conn(0x7f77a80c8740 msgr2=0x7f77a8154930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:15.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.286+0000 7f77af200700 1 -- 172.21.15.49:0/3615688369 shutdown_connections 2024-01-22T05:12:15.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.286+0000 7f77af200700 1 -- 172.21.15.49:0/3615688369 wait complete. 2024-01-22T05:12:15.316 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:12:15.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.482+0000 7fcca0800700 1 Processor -- start 2024-01-22T05:12:15.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.482+0000 7fcca0800700 1 -- start start 2024-01-22T05:12:15.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcca0800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc98068fe0 0x7fcc98062a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:15.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcca0800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc98062f00 0x7fcc980c3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:15.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcca0800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc980bf4b0 con 0x7fcc980bd960 2024-01-22T05:12:15.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcca0800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc980bec00 con 0x7fcc98068fe0 2024-01-22T05:12:15.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcca0800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98158410 con 0x7fcc98062f00 2024-01-22T05:12:15.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9de00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcc980bd960 0x7fcc98157d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56454/0 (socket says 172.21.15.49:56454) 2024-01-22T05:12:15.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9de00700 1 -- 172.21.15.49:0/2740669520 learned_addr learned my addr 172.21.15.49:0/2740669520 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:15.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9d400700 1 --2- 172.21.15.49:0/2740669520 >> v2:172.21.15.49:3300/0 conn(0x7fcc98068fe0 0x7fcc98062a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:15.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 -- 172.21.15.49:0/2740669520 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202161184 0 0) 0x7fcc980bf4b0 con 0x7fcc980bd960 2024-01-22T05:12:15.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 -- 172.21.15.49:0/2740669520 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc780033f0 con 0x7fcc980bd960 2024-01-22T05:12:15.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9e800700 1 --2- 172.21.15.49:0/2740669520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc98062f00 0x7fcc980c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:15.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 -- 172.21.15.49:0/2740669520 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1669641533 0 0) 0x7fcc780033f0 con 0x7fcc980bd960 2024-01-22T05:12:15.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 -- 172.21.15.49:0/2740669520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc98062f00 msgr2=0x7fcc980c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:15.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 --2- 172.21.15.49:0/2740669520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc98062f00 0x7fcc980c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:15.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 -- 172.21.15.49:0/2740669520 >> v2:172.21.15.49:3300/0 conn(0x7fcc98068fe0 msgr2=0x7fcc98062a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:15.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 --2- 172.21.15.49:0/2740669520 >> v2:172.21.15.49:3300/0 conn(0x7fcc98068fe0 0x7fcc98062a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:15.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 -- 172.21.15.49:0/2740669520 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc98063390 con 0x7fcc980bd960 2024-01-22T05:12:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 -- 172.21.15.49:0/2740669520 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fcc880015f0 con 0x7fcc980bd960 2024-01-22T05:12:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 -- 172.21.15.49:0/2740669520 >> v1:172.21.15.49:6789/0 conn(0x7fcc980bd960 legacy=0x7fcc98157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 --2- 172.21.15.49:0/2740669520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc780038e0 0x7fcc78003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 --2- 172.21.15.49:0/2740669520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc78004690 0x7fcc78004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 --2- 172.21.15.49:0/2740669520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc98062f00 0x7fcc78005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 -- 172.21.15.49:0/2740669520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc980bec00 con 0x7fcc78004690 2024-01-22T05:12:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 -- 172.21.15.49:0/2740669520 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98158410 con 0x7fcc780038e0 2024-01-22T05:12:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9ca00700 1 -- 172.21.15.49:0/2740669520 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7800b8e0 con 0x7fcc98062f00 2024-01-22T05:12:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9d400700 1 --2- 172.21.15.49:0/2740669520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc78004690 0x7fcc78004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9de00700 1 --2- 172.21.15.49:0/2740669520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc780038e0 0x7fcc78003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9e800700 1 --2- 172.21.15.49:0/2740669520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc98062f00 0x7fcc78005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9d400700 1 -- 172.21.15.49:0/2740669520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc98062f00 msgr2=0x7fcc78005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9d400700 1 --2- 172.21.15.49:0/2740669520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc98062f00 0x7fcc78005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9d400700 1 -- 172.21.15.49:0/2740669520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc780038e0 msgr2=0x7fcc78003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9d400700 1 --2- 172.21.15.49:0/2740669520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc780038e0 0x7fcc78003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9d400700 1 -- 172.21.15.49:0/2740669520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc780033f0 con 0x7fcc78004690 2024-01-22T05:12:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9de00700 1 --2- 172.21.15.49:0/2740669520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc780038e0 0x7fcc78003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:15.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.486+0000 7fcc9d400700 1 --2- 172.21.15.49:0/2740669520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc78004690 0x7fcc78004b10 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fcc80009a80 tx=0x7fcc80009060).ready entity=mon.0 client_cookie=91dd030bc27466a2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:15.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.490+0000 7fcc9ca00700 1 -- 172.21.15.49:0/2740669520 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80009430 con 0x7fcc78004690 2024-01-22T05:12:15.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.490+0000 7fcc9ca00700 1 -- 172.21.15.49:0/2740669520 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8000e5e0 con 0x7fcc78004690 2024-01-22T05:12:15.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.490+0000 7fcc9ca00700 1 -- 172.21.15.49:0/2740669520 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8000e960 con 0x7fcc78004690 2024-01-22T05:12:15.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.490+0000 7fcca0800700 1 -- 172.21.15.49:0/2740669520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc78004690 msgr2=0x7fcc78004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:15.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.490+0000 7fcca0800700 1 --2- 172.21.15.49:0/2740669520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc78004690 0x7fcc78004b10 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fcc80009a80 tx=0x7fcc80009060).stop 2024-01-22T05:12:15.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.490+0000 7fcc9e800700 1 -- 172.21.15.49:0/2740669520 reap_dead start 2024-01-22T05:12:15.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.490+0000 7fcca0800700 1 -- 172.21.15.49:0/2740669520 shutdown_connections 2024-01-22T05:12:15.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.490+0000 7fcca0800700 1 -- 172.21.15.49:0/2740669520 >> 172.21.15.49:0/2740669520 conn(0x7fcc980c8710 msgr2=0x7fcc980c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:15.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.490+0000 7fcca0800700 1 -- 172.21.15.49:0/2740669520 shutdown_connections 2024-01-22T05:12:15.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.490+0000 7fcca0800700 1 -- 172.21.15.49:0/2740669520 wait complete. 2024-01-22T05:12:15.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.494+0000 7fcca0800700 1 Processor -- start 2024-01-22T05:12:15.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.494+0000 7fcca0800700 1 -- start start 2024-01-22T05:12:15.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcca0800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc78004690 0x7fcc981541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:15.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcca0800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc9816d130 0x7fcc98149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:15.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcca0800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc98156ed0 0x7fcc980ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:15.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcca0800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9816cca0 con 0x7fcc9816d130 2024-01-22T05:12:15.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcca0800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98157400 con 0x7fcc78004690 2024-01-22T05:12:15.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcca0800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9816c650 con 0x7fcc98156ed0 2024-01-22T05:12:15.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcc9d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc9816d130 0x7fcc98149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:15.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcc9d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc9816d130 0x7fcc98149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44338/0 (socket says 172.21.15.49:44338) 2024-01-22T05:12:15.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcc9d400700 1 -- 172.21.15.49:0/908151724 learned_addr learned my addr 172.21.15.49:0/908151724 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:15.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcc9e800700 1 --2- 172.21.15.49:0/908151724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc98156ed0 0x7fcc980ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:15.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcc9de00700 1 --2- 172.21.15.49:0/908151724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc78004690 0x7fcc981541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:15.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcc9d400700 1 -- 172.21.15.49:0/908151724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc98156ed0 msgr2=0x7fcc980ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:15.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcc9d400700 1 --2- 172.21.15.49:0/908151724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc98156ed0 0x7fcc980ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:15.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcc9d400700 1 -- 172.21.15.49:0/908151724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc78004690 msgr2=0x7fcc981541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:15.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcc9d400700 1 --2- 172.21.15.49:0/908151724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc78004690 0x7fcc981541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:15.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcc9d400700 1 -- 172.21.15.49:0/908151724 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9816c930 con 0x7fcc9816d130 2024-01-22T05:12:15.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcc9d400700 1 --2- 172.21.15.49:0/908151724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc9816d130 0x7fcc98149890 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fcc8000e4b0 tx=0x7fcc8001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:15.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcc95600700 1 -- 172.21.15.49:0/908151724 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8000ecd0 con 0x7fcc9816d130 2024-01-22T05:12:15.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcc95600700 1 -- 172.21.15.49:0/908151724 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8000ee30 con 0x7fcc9816d130 2024-01-22T05:12:15.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcca0800700 1 -- 172.21.15.49:0/908151724 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc98152b80 con 0x7fcc9816d130 2024-01-22T05:12:15.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcc95600700 1 -- 172.21.15.49:0/908151724 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80026440 con 0x7fcc9816d130 2024-01-22T05:12:15.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.498+0000 7fcca0800700 1 -- 172.21.15.49:0/908151724 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc98149f20 con 0x7fcc9816d130 2024-01-22T05:12:15.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.502+0000 7fcca0800700 1 -- 172.21.15.49:0/908151724 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9816ce10 con 0x7fcc9816d130 2024-01-22T05:12:15.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.502+0000 7fcc95600700 1 -- 172.21.15.49:0/908151724 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcc8002f440 con 0x7fcc9816d130 2024-01-22T05:12:15.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.502+0000 7fcc95600700 1 --2- 172.21.15.49:0/908151724 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc7005a540 0x7fcc7005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:15.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.502+0000 7fcc95600700 1 -- 172.21.15.49:0/908151724 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fcc800766e0 con 0x7fcc9816d130 2024-01-22T05:12:15.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.506+0000 7fcc9de00700 1 --2- 172.21.15.49:0/908151724 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc7005a540 0x7fcc7005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.506+0000 7fcc9de00700 1 --2- 172.21.15.49:0/908151724 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc7005a540 0x7fcc7005ca00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fcc880011d0 tx=0x7fcc88009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:15.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.510+0000 7fcc95600700 1 -- 172.21.15.49:0/908151724 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcc80049bb0 con 0x7fcc9816d130 2024-01-22T05:12:15.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:15.670+0000 7fcca0800700 1 -- 172.21.15.49:0/908151724 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcc98047060 con 0x7fcc9816d130 2024-01-22T05:12:16.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.290+0000 7fcc95600700 1 -- 172.21.15.49:0/908151724 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcc80016020 con 0x7fcc9816d130 2024-01-22T05:12:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.298+0000 7fcca0800700 1 -- 172.21.15.49:0/908151724 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc7005a540 msgr2=0x7fcc7005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.298+0000 7fcca0800700 1 --2- 172.21.15.49:0/908151724 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc7005a540 0x7fcc7005ca00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fcc880011d0 tx=0x7fcc88009040).stop 2024-01-22T05:12:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.298+0000 7fcca0800700 1 -- 172.21.15.49:0/908151724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc9816d130 msgr2=0x7fcc98149890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.298+0000 7fcca0800700 1 --2- 172.21.15.49:0/908151724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc9816d130 0x7fcc98149890 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fcc8000e4b0 tx=0x7fcc8001a000).stop 2024-01-22T05:12:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.302+0000 7fcca0800700 1 -- 172.21.15.49:0/908151724 shutdown_connections 2024-01-22T05:12:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.302+0000 7fcca0800700 1 --2- 172.21.15.49:0/908151724 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc7005a540 0x7fcc7005ca00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.302+0000 7fcca0800700 1 --2- 172.21.15.49:0/908151724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc98156ed0 0x7fcc980ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.302+0000 7fcca0800700 1 --2- 172.21.15.49:0/908151724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc9816d130 0x7fcc98149890 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.302+0000 7fcca0800700 1 --2- 172.21.15.49:0/908151724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc78004690 0x7fcc981541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.302+0000 7fcca0800700 1 -- 172.21.15.49:0/908151724 >> 172.21.15.49:0/908151724 conn(0x7fcc980c8710 msgr2=0x7fcc980c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:16.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.302+0000 7fcca0800700 1 -- 172.21.15.49:0/908151724 shutdown_connections 2024-01-22T05:12:16.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.302+0000 7fcca0800700 1 -- 172.21.15.49:0/908151724 wait complete. 2024-01-22T05:12:16.307 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:12:16.327 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:12:16.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.494+0000 7f0625c00700 1 Processor -- start 2024-01-22T05:12:16.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.498+0000 7f0625c00700 1 -- start start 2024-01-22T05:12:16.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.498+0000 7f0625c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f06200c2520 0x7f0620139560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:16.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.502+0000 7f0625c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0620067a90 con 0x7f0620154ab0 2024-01-22T05:12:16.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.502+0000 7f0625c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06200c2b30 con 0x7f0620139a50 2024-01-22T05:12:16.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.502+0000 7f0625c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06200c36b0 con 0x7f06200c2520 2024-01-22T05:12:16.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.502+0000 7f061e000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f06200c2520 0x7f0620139560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:16.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.502+0000 7f061e000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f06200c2520 0x7f0620139560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44348/0 (socket says 172.21.15.49:44348) 2024-01-22T05:12:16.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.502+0000 7f061e000700 1 -- 172.21.15.49:0/1450137449 learned_addr learned my addr 172.21.15.49:0/1450137449 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:16.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.502+0000 7f061ea00700 1 --1- 172.21.15.49:0/1450137449 >> v1:172.21.15.49:6789/0 conn(0x7f0620154ab0 0x7f06200bcb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56462/0 (socket says 172.21.15.49:56462) 2024-01-22T05:12:16.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.502+0000 7f061e000700 1 -- 172.21.15.49:0/1450137449 >> v1:172.21.15.110:6789/0 conn(0x7f0620139a50 legacy=0x7f0620062b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:16.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.502+0000 7f061e000700 1 -- 172.21.15.49:0/1450137449 >> v1:172.21.15.49:6789/0 conn(0x7f0620154ab0 legacy=0x7f06200bcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:16.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.502+0000 7f061d600700 1 -- 172.21.15.49:0/1450137449 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336810468 0 0) 0x7f06200c2b30 con 0x7f0620139a50 2024-01-22T05:12:16.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.502+0000 7f061e000700 1 -- 172.21.15.49:0/1450137449 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06200c2e10 con 0x7f06200c2520 2024-01-22T05:12:16.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.502+0000 7f061e000700 1 --2- 172.21.15.49:0/1450137449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06200c2520 0x7f0620139560 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f0608006fd0 tx=0x7f06080090f0).ready entity=mon.0 client_cookie=ae026703876b5131 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.502+0000 7f061d600700 1 -- 172.21.15.49:0/1450137449 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0608010620 con 0x7f06200c2520 2024-01-22T05:12:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.502+0000 7f061d600700 1 -- 172.21.15.49:0/1450137449 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0608010780 con 0x7f06200c2520 2024-01-22T05:12:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.502+0000 7f061d600700 1 -- 172.21.15.49:0/1450137449 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0608010b00 con 0x7f06200c2520 2024-01-22T05:12:16.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.506+0000 7f0625c00700 1 -- 172.21.15.49:0/1450137449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06200c2520 msgr2=0x7f0620139560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:16.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.506+0000 7f0625c00700 1 --2- 172.21.15.49:0/1450137449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06200c2520 0x7f0620139560 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f0608006fd0 tx=0x7f06080090f0).stop 2024-01-22T05:12:16.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.506+0000 7f0625c00700 1 -- 172.21.15.49:0/1450137449 shutdown_connections 2024-01-22T05:12:16.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.506+0000 7f0625c00700 1 --2- 172.21.15.49:0/1450137449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06200c2520 0x7f0620139560 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:16.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.506+0000 7f0625c00700 1 -- 172.21.15.49:0/1450137449 >> 172.21.15.49:0/1450137449 conn(0x7f06200c7830 msgr2=0x7f06200c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:16.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.506+0000 7f0625c00700 1 -- 172.21.15.49:0/1450137449 shutdown_connections 2024-01-22T05:12:16.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.506+0000 7f0625c00700 1 -- 172.21.15.49:0/1450137449 wait complete. 2024-01-22T05:12:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.510+0000 7f0625c00700 1 Processor -- start 2024-01-22T05:12:16.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.510+0000 7f0625c00700 1 -- start start 2024-01-22T05:12:16.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f0625c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06200c2520 0x7f0620169770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:16.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f0625c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0620139a50 0x7f06200beec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:16.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f0625c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0620154ab0 0x7f06200bf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:16.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f0625c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06200bfa60 con 0x7f06200c2520 2024-01-22T05:12:16.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f0625c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062016c5d0 con 0x7f0620139a50 2024-01-22T05:12:16.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f0625c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062016c8b0 con 0x7f0620154ab0 2024-01-22T05:12:16.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f061ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06200c2520 0x7f0620169770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:16.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f061ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06200c2520 0x7f0620169770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44364/0 (socket says 172.21.15.49:44364) 2024-01-22T05:12:16.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f061ea00700 1 -- 172.21.15.49:0/1718532497 learned_addr learned my addr 172.21.15.49:0/1718532497 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:16.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f061e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0620139a50 0x7f06200beec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:16.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f061f400700 1 --2- 172.21.15.49:0/1718532497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0620154ab0 0x7f06200bf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:16.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f061ea00700 1 -- 172.21.15.49:0/1718532497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0620154ab0 msgr2=0x7f06200bf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:16.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f061ea00700 1 --2- 172.21.15.49:0/1718532497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0620154ab0 0x7f06200bf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:16.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f061ea00700 1 -- 172.21.15.49:0/1718532497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0620139a50 msgr2=0x7f06200beec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:16.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f061ea00700 1 --2- 172.21.15.49:0/1718532497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0620139a50 0x7f06200beec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:16.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.514+0000 7f061ea00700 1 -- 172.21.15.49:0/1718532497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0608009370 con 0x7f06200c2520 2024-01-22T05:12:16.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.518+0000 7f061ea00700 1 --2- 172.21.15.49:0/1718532497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06200c2520 0x7f0620169770 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f061000c4c0 tx=0x7f0610007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:16.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.518+0000 7f0616000700 1 -- 172.21.15.49:0/1718532497 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06100072e0 con 0x7f06200c2520 2024-01-22T05:12:16.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.518+0000 7f0616000700 1 -- 172.21.15.49:0/1718532497 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0610007440 con 0x7f06200c2520 2024-01-22T05:12:16.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.518+0000 7f0616000700 1 -- 172.21.15.49:0/1718532497 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06100058f0 con 0x7f06200c2520 2024-01-22T05:12:16.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.518+0000 7f0625c00700 1 -- 172.21.15.49:0/1718532497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062016cb90 con 0x7f06200c2520 2024-01-22T05:12:16.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.518+0000 7f0625c00700 1 -- 172.21.15.49:0/1718532497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0620169c60 con 0x7f06200c2520 2024-01-22T05:12:16.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.522+0000 7f0616000700 1 -- 172.21.15.49:0/1718532497 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0610005ca0 con 0x7f06200c2520 2024-01-22T05:12:16.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.522+0000 7f0616000700 1 --2- 172.21.15.49:0/1718532497 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05f805a4e0 0x7f05f805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:16.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.522+0000 7f0616000700 1 -- 172.21.15.49:0/1718532497 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f0610073e60 con 0x7f06200c2520 2024-01-22T05:12:16.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.522+0000 7f061e000700 1 --2- 172.21.15.49:0/1718532497 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05f805a4e0 0x7f05f805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:16.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.522+0000 7f061e000700 1 --2- 172.21.15.49:0/1718532497 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05f805a4e0 0x7f05f805c9a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f0608009130 tx=0x7f0608018000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:16.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.526+0000 7f0625c00700 1 -- 172.21.15.49:0/1718532497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0620046800 con 0x7f06200c2520 2024-01-22T05:12:16.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.538+0000 7f0616000700 1 -- 172.21.15.49:0/1718532497 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0610047600 con 0x7f06200c2520 2024-01-22T05:12:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:16.706+0000 7f0625c00700 1 -- 172.21.15.49:0/1718532497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0620062540 con 0x7f06200c2520 2024-01-22T05:12:17.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.302+0000 7f0616000700 1 -- 172.21.15.49:0/1718532497 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0620062540 con 0x7f06200c2520 2024-01-22T05:12:17.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.310+0000 7f0625c00700 1 -- 172.21.15.49:0/1718532497 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05f805a4e0 msgr2=0x7f05f805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:17.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.310+0000 7f0625c00700 1 --2- 172.21.15.49:0/1718532497 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05f805a4e0 0x7f05f805c9a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f0608009130 tx=0x7f0608018000).stop 2024-01-22T05:12:17.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.310+0000 7f0625c00700 1 -- 172.21.15.49:0/1718532497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06200c2520 msgr2=0x7f0620169770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:17.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.310+0000 7f0625c00700 1 --2- 172.21.15.49:0/1718532497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06200c2520 0x7f0620169770 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f061000c4c0 tx=0x7f0610007d80).stop 2024-01-22T05:12:17.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.310+0000 7f0625c00700 1 -- 172.21.15.49:0/1718532497 shutdown_connections 2024-01-22T05:12:17.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.310+0000 7f0625c00700 1 --2- 172.21.15.49:0/1718532497 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05f805a4e0 0x7f05f805c9a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.310+0000 7f0625c00700 1 --2- 172.21.15.49:0/1718532497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0620154ab0 0x7f06200bf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.310+0000 7f0625c00700 1 --2- 172.21.15.49:0/1718532497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0620139a50 0x7f06200beec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.310+0000 7f0625c00700 1 --2- 172.21.15.49:0/1718532497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06200c2520 0x7f0620169770 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.310+0000 7f0625c00700 1 -- 172.21.15.49:0/1718532497 >> 172.21.15.49:0/1718532497 conn(0x7f06200c7830 msgr2=0x7f06201384e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:17.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.310+0000 7f0625c00700 1 -- 172.21.15.49:0/1718532497 shutdown_connections 2024-01-22T05:12:17.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.310+0000 7f0625c00700 1 -- 172.21.15.49:0/1718532497 wait complete. 2024-01-22T05:12:17.319 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-01-22T05:12:17.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-22T05:12:17.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.502+0000 7fc31f200700 1 Processor -- start 2024-01-22T05:12:17.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.506+0000 7fc31f200700 1 -- start start 2024-01-22T05:12:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.506+0000 7fc31f200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc3200a8740 0x7fc3200a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.506+0000 7fc31f200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc320066080 0x7fc320066510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.506+0000 7fc31f200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc320065bd0 con 0x7fc3201581e0 2024-01-22T05:12:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.506+0000 7fc31f200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3200a9070 con 0x7fc320066080 2024-01-22T05:12:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.506+0000 7fc31f200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3200c15f0 con 0x7fc3200a8740 2024-01-22T05:12:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.506+0000 7fc31e800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc320066080 0x7fc320066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.506+0000 7fc31e800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc320066080 0x7fc320066510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44380/0 (socket says 172.21.15.49:44380) 2024-01-22T05:12:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.506+0000 7fc31e800700 1 -- 172.21.15.49:0/3757928117 learned_addr learned my addr 172.21.15.49:0/3757928117 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.506+0000 7fc31d400700 1 --2- 172.21.15.49:0/3757928117 >> v2:172.21.15.110:3300/0 conn(0x7fc3200a8740 0x7fc3200a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31ca00700 1 -- 172.21.15.49:0/3757928117 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451720041 0 0) 0x7fc320065bd0 con 0x7fc3201581e0 2024-01-22T05:12:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31ca00700 1 -- 172.21.15.49:0/3757928117 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3000033f0 con 0x7fc3201581e0 2024-01-22T05:12:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31e800700 1 -- 172.21.15.49:0/3757928117 >> v2:172.21.15.110:3300/0 conn(0x7fc3200a8740 msgr2=0x7fc3200a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31e800700 1 --2- 172.21.15.49:0/3757928117 >> v2:172.21.15.110:3300/0 conn(0x7fc3200a8740 0x7fc3200a8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31e800700 1 -- 172.21.15.49:0/3757928117 >> v1:172.21.15.110:6789/0 conn(0x7fc3201581e0 legacy=0x7fc3200c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31e800700 1 -- 172.21.15.49:0/3757928117 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3200c18c0 con 0x7fc320066080 2024-01-22T05:12:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31e800700 1 --2- 172.21.15.49:0/3757928117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc320066080 0x7fc320066510 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fc320065060 tx=0x7fc318009840).ready entity=mon.0 client_cookie=7bcfb8649568c371 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31ca00700 1 -- 172.21.15.49:0/3757928117 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31800e070 con 0x7fc320066080 2024-01-22T05:12:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31ca00700 1 -- 172.21.15.49:0/3757928117 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31800b970 con 0x7fc320066080 2024-01-22T05:12:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31ca00700 1 -- 172.21.15.49:0/3757928117 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31800bcf0 con 0x7fc320066080 2024-01-22T05:12:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31f200700 1 -- 172.21.15.49:0/3757928117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc320066080 msgr2=0x7fc320066510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31f200700 1 --2- 172.21.15.49:0/3757928117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc320066080 0x7fc320066510 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fc320065060 tx=0x7fc318009840).stop 2024-01-22T05:12:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31f200700 1 -- 172.21.15.49:0/3757928117 shutdown_connections 2024-01-22T05:12:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31f200700 1 --2- 172.21.15.49:0/3757928117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc320066080 0x7fc320066510 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31f200700 1 --2- 172.21.15.49:0/3757928117 >> v2:172.21.15.110:3300/0 conn(0x7fc3200a8740 0x7fc3200a8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31f200700 1 -- 172.21.15.49:0/3757928117 >> 172.21.15.49:0/3757928117 conn(0x7fc3200c6540 msgr2=0x7fc3200c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31f200700 1 -- 172.21.15.49:0/3757928117 shutdown_connections 2024-01-22T05:12:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.510+0000 7fc31f200700 1 -- 172.21.15.49:0/3757928117 wait complete. 2024-01-22T05:12:17.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.514+0000 7fc31f200700 1 Processor -- start 2024-01-22T05:12:17.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31f200700 1 -- start start 2024-01-22T05:12:17.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31f200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc320066080 0x7fc320158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:17.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31f200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3200a8740 0x7fc3201657c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:17.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31f200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3201581e0 0x7fc32016baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:17.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31f200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200c0440 con 0x7fc3201581e0 2024-01-22T05:12:17.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31f200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3201594c0 con 0x7fc3200a8740 2024-01-22T05:12:17.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31f200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32016c840 con 0x7fc320066080 2024-01-22T05:12:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3201581e0 0x7fc32016baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3201581e0 0x7fc32016baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44386/0 (socket says 172.21.15.49:44386) 2024-01-22T05:12:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31e800700 1 -- 172.21.15.49:0/1163666352 learned_addr learned my addr 172.21.15.49:0/1163666352 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31d400700 1 --2- 172.21.15.49:0/1163666352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3200a8740 0x7fc3201657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:17.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31de00700 1 --2- 172.21.15.49:0/1163666352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc320066080 0x7fc320158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:17.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31e800700 1 -- 172.21.15.49:0/1163666352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc320066080 msgr2=0x7fc320158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:17.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31e800700 1 --2- 172.21.15.49:0/1163666352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc320066080 0x7fc320158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31e800700 1 -- 172.21.15.49:0/1163666352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3200a8740 msgr2=0x7fc3201657c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:17.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31e800700 1 --2- 172.21.15.49:0/1163666352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3200a8740 0x7fc3201657c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31e800700 1 -- 172.21.15.49:0/1163666352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318009ae0 con 0x7fc3201581e0 2024-01-22T05:12:17.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31e800700 1 --2- 172.21.15.49:0/1163666352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3201581e0 0x7fc32016baa0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7fc31800b610 tx=0x7fc318009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:17.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc315600700 1 -- 172.21.15.49:0/1163666352 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31800bee0 con 0x7fc3201581e0 2024-01-22T05:12:17.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc315600700 1 -- 172.21.15.49:0/1163666352 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318007080 con 0x7fc3201581e0 2024-01-22T05:12:17.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc31f200700 1 -- 172.21.15.49:0/1163666352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3200bf7c0 con 0x7fc3201581e0 2024-01-22T05:12:17.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.518+0000 7fc315600700 1 -- 172.21.15.49:0/1163666352 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31801e6c0 con 0x7fc3201581e0 2024-01-22T05:12:17.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.522+0000 7fc31f200700 1 -- 172.21.15.49:0/1163666352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3200bfd80 con 0x7fc3201581e0 2024-01-22T05:12:17.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.522+0000 7fc31f200700 1 -- 172.21.15.49:0/1163666352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc320047060 con 0x7fc3201581e0 2024-01-22T05:12:17.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.522+0000 7fc315600700 1 -- 172.21.15.49:0/1163666352 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc318003040 con 0x7fc3201581e0 2024-01-22T05:12:17.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.522+0000 7fc315600700 1 --2- 172.21.15.49:0/1163666352 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc2f805a510 0x7fc2f805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:17.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.522+0000 7fc315600700 1 -- 172.21.15.49:0/1163666352 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fc318075820 con 0x7fc3201581e0 2024-01-22T05:12:17.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.526+0000 7fc31de00700 1 --2- 172.21.15.49:0/1163666352 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc2f805a510 0x7fc2f805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:17.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.526+0000 7fc31de00700 1 --2- 172.21.15.49:0/1163666352 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc2f805a510 0x7fc2f805c9d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fc310003890 tx=0x7fc310007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.530+0000 7fc315600700 1 -- 172.21.15.49:0/1163666352 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc318049250 con 0x7fc3201581e0 2024-01-22T05:12:17.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.730+0000 7fc31f200700 1 -- 172.21.15.49:0/1163666352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc3200c1ba0 con 0x7fc3201581e0 2024-01-22T05:12:17.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.734+0000 7fc315600700 1 -- 172.21.15.49:0/1163666352 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc318023070 con 0x7fc3201581e0 2024-01-22T05:12:17.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.738+0000 7fc31f200700 1 -- 172.21.15.49:0/1163666352 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc2f805a510 msgr2=0x7fc2f805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:17.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.738+0000 7fc31f200700 1 --2- 172.21.15.49:0/1163666352 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc2f805a510 0x7fc2f805c9d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fc310003890 tx=0x7fc310007bd0).stop 2024-01-22T05:12:17.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.738+0000 7fc31f200700 1 -- 172.21.15.49:0/1163666352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3201581e0 msgr2=0x7fc32016baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:17.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.738+0000 7fc31f200700 1 --2- 172.21.15.49:0/1163666352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3201581e0 0x7fc32016baa0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7fc31800b610 tx=0x7fc318009840).stop 2024-01-22T05:12:17.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.738+0000 7fc31f200700 1 -- 172.21.15.49:0/1163666352 shutdown_connections 2024-01-22T05:12:17.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.738+0000 7fc31f200700 1 --2- 172.21.15.49:0/1163666352 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc2f805a510 0x7fc2f805c9d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.738+0000 7fc31f200700 1 --2- 172.21.15.49:0/1163666352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3201581e0 0x7fc32016baa0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.738+0000 7fc31f200700 1 --2- 172.21.15.49:0/1163666352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3200a8740 0x7fc3201657c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.738+0000 7fc31f200700 1 --2- 172.21.15.49:0/1163666352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc320066080 0x7fc320158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.738+0000 7fc31f200700 1 -- 172.21.15.49:0/1163666352 >> 172.21.15.49:0/1163666352 conn(0x7fc3200c6540 msgr2=0x7fc320067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:17.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.738+0000 7fc31f200700 1 -- 172.21.15.49:0/1163666352 shutdown_connections 2024-01-22T05:12:17.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.738+0000 7fc31f200700 1 -- 172.21.15.49:0/1163666352 wait complete. 2024-01-22T05:12:17.767 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-01-22T05:12:17.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.926+0000 7f766fa00700 1 Processor -- start 2024-01-22T05:12:17.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.926+0000 7f766fa00700 1 -- start start 2024-01-22T05:12:17.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f766fa00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7668155d20 0x7f7668065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:17.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f766fa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7668066070 0x7f76680a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:17.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f766fa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76680a8c30 0x7f76680c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:17.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f766fa00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76680c1a40 con 0x7f7668066070 2024-01-22T05:12:17.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f766fa00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76680a90c0 con 0x7f7668155d20 2024-01-22T05:12:17.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f766fa00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7668159310 con 0x7f76680a8c30 2024-01-22T05:12:17.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f7667e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7668066070 0x7f76680a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:17.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f7667e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7668066070 0x7f76680a8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44400/0 (socket says 172.21.15.49:44400) 2024-01-22T05:12:17.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f7667e00700 1 -- 172.21.15.49:0/1991828431 learned_addr learned my addr 172.21.15.49:0/1991828431 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:17.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f766da00700 1 --2- 172.21.15.49:0/1991828431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76680a8c30 0x7f76680c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:17.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f766d000700 1 --2- 172.21.15.49:0/1991828431 >> v2:172.21.15.110:3300/0 conn(0x7f7668155d20 0x7f7668065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:17.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f7667e00700 1 -- 172.21.15.49:0/1991828431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76680a8c30 msgr2=0x7f76680c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:17.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f7667e00700 1 --2- 172.21.15.49:0/1991828431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76680a8c30 0x7f76680c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f7667e00700 1 -- 172.21.15.49:0/1991828431 >> v2:172.21.15.110:3300/0 conn(0x7f7668155d20 msgr2=0x7f7668065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:17.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f7667e00700 1 --2- 172.21.15.49:0/1991828431 >> v2:172.21.15.110:3300/0 conn(0x7f7668155d20 0x7f7668065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f7667e00700 1 -- 172.21.15.49:0/1991828431 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76680c13f0 con 0x7f7668066070 2024-01-22T05:12:17.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f7667e00700 1 --2- 172.21.15.49:0/1991828431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7668066070 0x7f76680a8740 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f766805ff40 tx=0x7f76500090f0).ready entity=mon.0 client_cookie=5ca917594fd4f204 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:17.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f7667400700 1 -- 172.21.15.49:0/1991828431 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765000f510 con 0x7f7668066070 2024-01-22T05:12:17.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f7667400700 1 -- 172.21.15.49:0/1991828431 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765000f670 con 0x7f7668066070 2024-01-22T05:12:17.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.930+0000 7f7667400700 1 -- 172.21.15.49:0/1991828431 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765000f9f0 con 0x7f7668066070 2024-01-22T05:12:17.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.934+0000 7f766fa00700 1 -- 172.21.15.49:0/1991828431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7668066070 msgr2=0x7f76680a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:17.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.934+0000 7f766fa00700 1 --2- 172.21.15.49:0/1991828431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7668066070 0x7f76680a8740 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f766805ff40 tx=0x7f76500090f0).stop 2024-01-22T05:12:17.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.934+0000 7f766fa00700 1 -- 172.21.15.49:0/1991828431 shutdown_connections 2024-01-22T05:12:17.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.934+0000 7f766fa00700 1 --2- 172.21.15.49:0/1991828431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76680a8c30 0x7f76680c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.934+0000 7f766fa00700 1 --2- 172.21.15.49:0/1991828431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7668066070 0x7f76680a8740 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.934+0000 7f766fa00700 1 --2- 172.21.15.49:0/1991828431 >> v2:172.21.15.110:3300/0 conn(0x7f7668155d20 0x7f7668065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.934+0000 7f766fa00700 1 -- 172.21.15.49:0/1991828431 >> 172.21.15.49:0/1991828431 conn(0x7f76680c6540 msgr2=0x7f76680c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:17.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.934+0000 7f766fa00700 1 -- 172.21.15.49:0/1991828431 shutdown_connections 2024-01-22T05:12:17.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.934+0000 7f766fa00700 1 -- 172.21.15.49:0/1991828431 wait complete. 2024-01-22T05:12:17.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.938+0000 7f766fa00700 1 Processor -- start 2024-01-22T05:12:17.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.938+0000 7f766fa00700 1 -- start start 2024-01-22T05:12:17.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.938+0000 7f766fa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7668066070 0x7f76680bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:17.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.938+0000 7f766fa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76680a8c30 0x7f76680bf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:17.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.938+0000 7f766fa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7668155d20 0x7f76680bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:17.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.938+0000 7f766fa00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76680c27b0 con 0x7f7668066070 2024-01-22T05:12:17.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.938+0000 7f766fa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76680c3600 con 0x7f7668155d20 2024-01-22T05:12:17.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.938+0000 7f766fa00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76680c29f0 con 0x7f76680a8c30 2024-01-22T05:12:17.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.938+0000 7f766d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7668066070 0x7f76680bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:17.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f766d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7668066070 0x7f76680bd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44404/0 (socket says 172.21.15.49:44404) 2024-01-22T05:12:17.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f766d000700 1 -- 172.21.15.49:0/3928500457 learned_addr learned my addr 172.21.15.49:0/3928500457 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:17.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f7667e00700 1 --2- 172.21.15.49:0/3928500457 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76680a8c30 0x7f76680bf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:17.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f766da00700 1 --2- 172.21.15.49:0/3928500457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7668155d20 0x7f76680bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:17.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f766d000700 1 -- 172.21.15.49:0/3928500457 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76680a8c30 msgr2=0x7f76680bf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:17.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f766d000700 1 --2- 172.21.15.49:0/3928500457 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76680a8c30 0x7f76680bf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f766d000700 1 -- 172.21.15.49:0/3928500457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7668155d20 msgr2=0x7f76680bf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:17.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f766d000700 1 --2- 172.21.15.49:0/3928500457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7668155d20 0x7f76680bf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:17.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f766d000700 1 -- 172.21.15.49:0/3928500457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7650009370 con 0x7f7668066070 2024-01-22T05:12:17.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f766da00700 1 --2- 172.21.15.49:0/3928500457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7668155d20 0x7f76680bf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:17.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f766d000700 1 --2- 172.21.15.49:0/3928500457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7668066070 0x7f76680bd5e0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f765800e900 tx=0x7f7658009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:17.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f765fe00700 1 -- 172.21.15.49:0/3928500457 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658012600 con 0x7f7668066070 2024-01-22T05:12:17.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f765fe00700 1 -- 172.21.15.49:0/3928500457 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7658012760 con 0x7f7668066070 2024-01-22T05:12:17.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f766fa00700 1 -- 172.21.15.49:0/3928500457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76680c2cd0 con 0x7f7668066070 2024-01-22T05:12:17.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f765fe00700 1 -- 172.21.15.49:0/3928500457 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658012ae0 con 0x7f7668066070 2024-01-22T05:12:17.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f766fa00700 1 -- 172.21.15.49:0/3928500457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76680c3290 con 0x7f7668066070 2024-01-22T05:12:17.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.942+0000 7f766fa00700 1 -- 172.21.15.49:0/3928500457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7668047060 con 0x7f7668066070 2024-01-22T05:12:17.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.946+0000 7f765fe00700 1 -- 172.21.15.49:0/3928500457 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f765801b400 con 0x7f7668066070 2024-01-22T05:12:17.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.946+0000 7f765fe00700 1 --2- 172.21.15.49:0/3928500457 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f764005a510 0x7f764005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:17.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.946+0000 7f765fe00700 1 -- 172.21.15.49:0/3928500457 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f7658074a30 con 0x7f7668066070 2024-01-22T05:12:17.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.946+0000 7f7667e00700 1 --2- 172.21.15.49:0/3928500457 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f764005a510 0x7f764005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:17.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.946+0000 7f7667e00700 1 --2- 172.21.15.49:0/3928500457 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f764005a510 0x7f764005c9d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f7650009130 tx=0x7f7650017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:17.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:17.950+0000 7f765fe00700 1 -- 172.21.15.49:0/3928500457 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7658048290 con 0x7f7668066070 2024-01-22T05:12:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.166+0000 7f766fa00700 1 -- 172.21.15.49:0/3928500457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) v1 -- 0x7f76680c16d0 con 0x7f7668066070 2024-01-22T05:12:18.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.314+0000 7f765fe00700 1 -- 172.21.15.49:0/3928500457 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v370) v1 ==== 158+0+0 (secure 0 0 0) 0x7f765804b8b0 con 0x7f7668066070 2024-01-22T05:12:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.318+0000 7f766fa00700 1 -- 172.21.15.49:0/3928500457 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f764005a510 msgr2=0x7f764005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.318+0000 7f766fa00700 1 --2- 172.21.15.49:0/3928500457 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f764005a510 0x7f764005c9d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f7650009130 tx=0x7f7650017000).stop 2024-01-22T05:12:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.318+0000 7f766fa00700 1 -- 172.21.15.49:0/3928500457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7668066070 msgr2=0x7f76680bd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.318+0000 7f766fa00700 1 --2- 172.21.15.49:0/3928500457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7668066070 0x7f76680bd5e0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f765800e900 tx=0x7f7658009060).stop 2024-01-22T05:12:18.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.318+0000 7f766fa00700 1 -- 172.21.15.49:0/3928500457 shutdown_connections 2024-01-22T05:12:18.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.318+0000 7f766fa00700 1 --2- 172.21.15.49:0/3928500457 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f764005a510 0x7f764005c9d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:18.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.318+0000 7f766fa00700 1 --2- 172.21.15.49:0/3928500457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7668155d20 0x7f76680bf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:18.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.318+0000 7f766fa00700 1 --2- 172.21.15.49:0/3928500457 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76680a8c30 0x7f76680bf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.318+0000 7f766fa00700 1 --2- 172.21.15.49:0/3928500457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7668066070 0x7f76680bd5e0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.318+0000 7f766fa00700 1 -- 172.21.15.49:0/3928500457 >> 172.21.15.49:0/3928500457 conn(0x7f76680c6540 msgr2=0x7f7668158680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.318+0000 7f766fa00700 1 -- 172.21.15.49:0/3928500457 shutdown_connections 2024-01-22T05:12:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.318+0000 7f766fa00700 1 -- 172.21.15.49:0/3928500457 wait complete. 2024-01-22T05:12:18.345 INFO:tasks.cephfs_test_runner:test that scrub can iterate over ~mdsdir and evaluate strays ... ok 2024-01-22T05:12:18.345 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-01-22T05:12:18.346 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-01-22T05:12:18.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.510+0000 7ff687000700 1 Processor -- start 2024-01-22T05:12:18.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.510+0000 7ff687000700 1 -- start start 2024-01-22T05:12:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff687000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff680157dc0 0x7ff680063da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:18.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff687000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6801581a0 0x7ff680064290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:18.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff687000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff68015bb10 con 0x7ff6800bdaf0 2024-01-22T05:12:18.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff687000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff680064780 con 0x7ff6801581a0 2024-01-22T05:12:18.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff687000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68015c970 con 0x7ff680157dc0 2024-01-22T05:12:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff67f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6801581a0 0x7ff680064290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff67f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6801581a0 0x7ff680064290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44416/0 (socket says 172.21.15.49:44416) 2024-01-22T05:12:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff67f400700 1 -- 172.21.15.49:0/2985253319 learned_addr learned my addr 172.21.15.49:0/2985253319 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff685000700 1 --1- 172.21.15.49:0/2985253319 >> v1:172.21.15.110:6789/0 conn(0x7ff6800bdaf0 0x7ff6800c1c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:32990/0 (socket says 172.21.15.49:32990) 2024-01-22T05:12:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff67fe00700 1 --2- 172.21.15.49:0/2985253319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff680157dc0 0x7ff680063da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff67ea00700 1 -- 172.21.15.49:0/2985253319 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935129343 0 0) 0x7ff68015bb10 con 0x7ff6800bdaf0 2024-01-22T05:12:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff67ea00700 1 -- 172.21.15.49:0/2985253319 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6600033f0 con 0x7ff6800bdaf0 2024-01-22T05:12:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff67f400700 1 -- 172.21.15.49:0/2985253319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff680157dc0 msgr2=0x7ff680063da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff67f400700 1 --2- 172.21.15.49:0/2985253319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff680157dc0 0x7ff680063da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff67f400700 1 -- 172.21.15.49:0/2985253319 >> v1:172.21.15.110:6789/0 conn(0x7ff6800bdaf0 legacy=0x7ff6800c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff67f400700 1 -- 172.21.15.49:0/2985253319 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68015bd60 con 0x7ff6801581a0 2024-01-22T05:12:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff67fe00700 1 --2- 172.21.15.49:0/2985253319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff680157dc0 0x7ff680063da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:12:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff67f400700 1 --2- 172.21.15.49:0/2985253319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6801581a0 0x7ff680064290 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7ff668006fd0 tx=0x7ff6680090f0).ready entity=mon.0 client_cookie=68077a77e5d681a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:18.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff67ea00700 1 -- 172.21.15.49:0/2985253319 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66800f510 con 0x7ff6801581a0 2024-01-22T05:12:18.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff67ea00700 1 -- 172.21.15.49:0/2985253319 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66800f670 con 0x7ff6801581a0 2024-01-22T05:12:18.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.514+0000 7ff67ea00700 1 -- 172.21.15.49:0/2985253319 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66800f9f0 con 0x7ff6801581a0 2024-01-22T05:12:18.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.518+0000 7ff687000700 1 -- 172.21.15.49:0/2985253319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6801581a0 msgr2=0x7ff680064290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:18.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.518+0000 7ff687000700 1 --2- 172.21.15.49:0/2985253319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6801581a0 0x7ff680064290 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7ff668006fd0 tx=0x7ff6680090f0).stop 2024-01-22T05:12:18.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.518+0000 7ff687000700 1 -- 172.21.15.49:0/2985253319 shutdown_connections 2024-01-22T05:12:18.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.518+0000 7ff687000700 1 --2- 172.21.15.49:0/2985253319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6801581a0 0x7ff680064290 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:18.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.518+0000 7ff687000700 1 --2- 172.21.15.49:0/2985253319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff680157dc0 0x7ff680063da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:18.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.518+0000 7ff687000700 1 -- 172.21.15.49:0/2985253319 >> 172.21.15.49:0/2985253319 conn(0x7ff6800c40c0 msgr2=0x7ff6800c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:18.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.518+0000 7ff687000700 1 -- 172.21.15.49:0/2985253319 shutdown_connections 2024-01-22T05:12:18.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.518+0000 7ff687000700 1 -- 172.21.15.49:0/2985253319 wait complete. 2024-01-22T05:12:18.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.522+0000 7ff687000700 1 Processor -- start 2024-01-22T05:12:18.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.522+0000 7ff687000700 1 -- start start 2024-01-22T05:12:18.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.522+0000 7ff687000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6800bdaf0 0x7ff68015ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:18.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.522+0000 7ff687000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff680157dc0 0x7ff6800a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:18.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.522+0000 7ff687000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6801581a0 0x7ff68014b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:18.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.522+0000 7ff687000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800a85a0 con 0x7ff6801581a0 2024-01-22T05:12:18.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.522+0000 7ff687000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800a74b0 con 0x7ff6800bdaf0 2024-01-22T05:12:18.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.522+0000 7ff687000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800a7790 con 0x7ff680157dc0 2024-01-22T05:12:18.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.522+0000 7ff685000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6801581a0 0x7ff68014b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:18.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.522+0000 7ff685000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6801581a0 0x7ff68014b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44424/0 (socket says 172.21.15.49:44424) 2024-01-22T05:12:18.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.522+0000 7ff685000700 1 -- 172.21.15.49:0/302446080 learned_addr learned my addr 172.21.15.49:0/302446080 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:18.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.522+0000 7ff67f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff680157dc0 0x7ff6800a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:18.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.522+0000 7ff67fe00700 1 --2- 172.21.15.49:0/302446080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6800bdaf0 0x7ff68015ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:18.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.526+0000 7ff685000700 1 -- 172.21.15.49:0/302446080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff680157dc0 msgr2=0x7ff6800a8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:18.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.526+0000 7ff685000700 1 --2- 172.21.15.49:0/302446080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff680157dc0 0x7ff6800a8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:18.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.526+0000 7ff685000700 1 -- 172.21.15.49:0/302446080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6800bdaf0 msgr2=0x7ff68015ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:18.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.526+0000 7ff685000700 1 --2- 172.21.15.49:0/302446080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6800bdaf0 0x7ff68015ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:18.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.526+0000 7ff685000700 1 -- 172.21.15.49:0/302446080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6700092a0 con 0x7ff6801581a0 2024-01-22T05:12:18.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.526+0000 7ff685000700 1 --2- 172.21.15.49:0/302446080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6801581a0 0x7ff68014b4f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7ff67800c7c0 tx=0x7ff678007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:18.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.526+0000 7ff677400700 1 -- 172.21.15.49:0/302446080 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678005c70 con 0x7ff6801581a0 2024-01-22T05:12:18.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.526+0000 7ff677400700 1 -- 172.21.15.49:0/302446080 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff678005dd0 con 0x7ff6801581a0 2024-01-22T05:12:18.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.526+0000 7ff687000700 1 -- 172.21.15.49:0/302446080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff668009370 con 0x7ff6801581a0 2024-01-22T05:12:18.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.526+0000 7ff677400700 1 -- 172.21.15.49:0/302446080 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678007320 con 0x7ff6801581a0 2024-01-22T05:12:18.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.526+0000 7ff687000700 1 -- 172.21.15.49:0/302446080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6800a7d50 con 0x7ff6801581a0 2024-01-22T05:12:18.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.526+0000 7ff687000700 1 -- 172.21.15.49:0/302446080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff680065660 con 0x7ff6801581a0 2024-01-22T05:12:18.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.530+0000 7ff677400700 1 -- 172.21.15.49:0/302446080 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff678007750 con 0x7ff6801581a0 2024-01-22T05:12:18.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.530+0000 7ff677400700 1 --2- 172.21.15.49:0/302446080 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff65805a510 0x7ff65805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:18.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.530+0000 7ff677400700 1 -- 172.21.15.49:0/302446080 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5708+0+0 (secure 0 0 0) 0x7ff6780745b0 con 0x7ff6801581a0 2024-01-22T05:12:18.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.530+0000 7ff67fe00700 1 --2- 172.21.15.49:0/302446080 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff65805a510 0x7ff65805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:18.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.530+0000 7ff67fe00700 1 --2- 172.21.15.49:0/302446080 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff65805a510 0x7ff65805c9d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7ff670009dc0 tx=0x7ff670009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:18.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.538+0000 7ff677400700 1 -- 172.21.15.49:0/302446080 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff678047f30 con 0x7ff6801581a0 2024-01-22T05:12:18.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:18.758+0000 7ff687000700 1 -- 172.21.15.49:0/302446080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) v1 -- 0x7ff680046800 con 0x7ff6801581a0 2024-01-22T05:12:19.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.322+0000 7ff677400700 1 -- 172.21.15.49:0/302446080 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v371) v1 ==== 147+0+0 (secure 0 0 0) 0x7ff67804b550 con 0x7ff6801581a0 2024-01-22T05:12:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.326+0000 7ff687000700 1 -- 172.21.15.49:0/302446080 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff65805a510 msgr2=0x7ff65805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.326+0000 7ff687000700 1 --2- 172.21.15.49:0/302446080 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff65805a510 0x7ff65805c9d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7ff670009dc0 tx=0x7ff670009060).stop 2024-01-22T05:12:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.326+0000 7ff687000700 1 -- 172.21.15.49:0/302446080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6801581a0 msgr2=0x7ff68014b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:19.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.326+0000 7ff687000700 1 --2- 172.21.15.49:0/302446080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6801581a0 0x7ff68014b4f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7ff67800c7c0 tx=0x7ff678007f90).stop 2024-01-22T05:12:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.326+0000 7ff687000700 1 -- 172.21.15.49:0/302446080 shutdown_connections 2024-01-22T05:12:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.326+0000 7ff687000700 1 --2- 172.21.15.49:0/302446080 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff65805a510 0x7ff65805c9d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.326+0000 7ff687000700 1 --2- 172.21.15.49:0/302446080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6801581a0 0x7ff68014b4f0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.326+0000 7ff687000700 1 --2- 172.21.15.49:0/302446080 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff680157dc0 0x7ff6800a8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.326+0000 7ff687000700 1 --2- 172.21.15.49:0/302446080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6800bdaf0 0x7ff68015ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.326+0000 7ff687000700 1 -- 172.21.15.49:0/302446080 >> 172.21.15.49:0/302446080 conn(0x7ff6800c40c0 msgr2=0x7ff6800c6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.326+0000 7ff687000700 1 -- 172.21.15.49:0/302446080 shutdown_connections 2024-01-22T05:12:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.326+0000 7ff687000700 1 -- 172.21.15.49:0/302446080 wait complete. 2024-01-22T05:12:19.355 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-22T05:12:19.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.522+0000 7ff37b200700 1 Processor -- start 2024-01-22T05:12:19.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.522+0000 7ff37b200700 1 -- start start 2024-01-22T05:12:19.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.526+0000 7ff37b200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff37c0c6840 0x7ff37c150530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.526+0000 7ff37b200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37c0c4ee0 con 0x7ff37c0625f0 2024-01-22T05:12:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.526+0000 7ff37b200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37c0c51c0 con 0x7ff37c0c2ab0 2024-01-22T05:12:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.526+0000 7ff37b200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37c0c6c20 con 0x7ff37c0c6840 2024-01-22T05:12:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.530+0000 7ff37a800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff37c0625f0 0x7ff37c062a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56476/0 (socket says 172.21.15.49:56476) 2024-01-22T05:12:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.530+0000 7ff37a800700 1 -- 172.21.15.49:0/2799290191 learned_addr learned my addr 172.21.15.49:0/2799290191 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:19.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.530+0000 7ff379e00700 1 --2- 172.21.15.49:0/2799290191 >> v2:172.21.15.110:3300/0 conn(0x7ff37c0c6840 0x7ff37c150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:19.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.530+0000 7ff378a00700 1 -- 172.21.15.49:0/2799290191 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866725199 0 0) 0x7ff37c0c4ee0 con 0x7ff37c0625f0 2024-01-22T05:12:19.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.530+0000 7ff378a00700 1 -- 172.21.15.49:0/2799290191 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff35c0033f0 con 0x7ff37c0625f0 2024-01-22T05:12:19.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.530+0000 7ff379e00700 1 -- 172.21.15.49:0/2799290191 >> v1:172.21.15.110:6789/0 conn(0x7ff37c0c2ab0 legacy=0x7ff37c0c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:19.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.530+0000 7ff379e00700 1 -- 172.21.15.49:0/2799290191 >> v1:172.21.15.49:6789/0 conn(0x7ff37c0625f0 legacy=0x7ff37c062a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:19.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.530+0000 7ff379e00700 1 -- 172.21.15.49:0/2799290191 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c0c54a0 con 0x7ff37c0c6840 2024-01-22T05:12:19.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.530+0000 7ff379e00700 1 --2- 172.21.15.49:0/2799290191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0c6840 0x7ff37c150530 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7ff36c009760 tx=0x7ff36c009060).ready entity=mon.1 client_cookie=4383e26680fb30fb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:19.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.530+0000 7ff378a00700 1 -- 172.21.15.49:0/2799290191 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c0090d0 con 0x7ff37c0c6840 2024-01-22T05:12:19.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.530+0000 7ff378a00700 1 -- 172.21.15.49:0/2799290191 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c00f510 con 0x7ff37c0c6840 2024-01-22T05:12:19.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.530+0000 7ff378a00700 1 -- 172.21.15.49:0/2799290191 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c00f890 con 0x7ff37c0c6840 2024-01-22T05:12:19.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.530+0000 7ff37b200700 1 -- 172.21.15.49:0/2799290191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0c6840 msgr2=0x7ff37c150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:19.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.530+0000 7ff37b200700 1 --2- 172.21.15.49:0/2799290191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0c6840 0x7ff37c150530 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7ff36c009760 tx=0x7ff36c009060).stop 2024-01-22T05:12:19.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.534+0000 7ff37b200700 1 -- 172.21.15.49:0/2799290191 shutdown_connections 2024-01-22T05:12:19.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.534+0000 7ff37b200700 1 --2- 172.21.15.49:0/2799290191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0c6840 0x7ff37c150530 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:19.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.534+0000 7ff37b200700 1 -- 172.21.15.49:0/2799290191 >> 172.21.15.49:0/2799290191 conn(0x7ff37c0c3880 msgr2=0x7ff37c0c3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:19.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.534+0000 7ff37b200700 1 -- 172.21.15.49:0/2799290191 shutdown_connections 2024-01-22T05:12:19.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.534+0000 7ff37b200700 1 -- 172.21.15.49:0/2799290191 wait complete. 2024-01-22T05:12:19.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.538+0000 7ff37b200700 1 Processor -- start 2024-01-22T05:12:19.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.538+0000 7ff37b200700 1 -- start start 2024-01-22T05:12:19.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c0625f0 0x7ff37c09f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:19.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0c2ab0 0x7ff37c152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:19.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37b200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff37c0c6840 0x7ff37c0bc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:19.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37b200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c09f990 con 0x7ff37c0c6840 2024-01-22T05:12:19.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c155780 con 0x7ff37c0c2ab0 2024-01-22T05:12:19.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c14f250 con 0x7ff37c0625f0 2024-01-22T05:12:19.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff37c0c6840 0x7ff37c0bc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:19.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff37c0c6840 0x7ff37c0bc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44434/0 (socket says 172.21.15.49:44434) 2024-01-22T05:12:19.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37a800700 1 -- 172.21.15.49:0/856231479 learned_addr learned my addr 172.21.15.49:0/856231479 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:19.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff379e00700 1 --2- 172.21.15.49:0/856231479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c0625f0 0x7ff37c09f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:19.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff379400700 1 --2- 172.21.15.49:0/856231479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0c2ab0 0x7ff37c152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:19.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37a800700 1 -- 172.21.15.49:0/856231479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c0625f0 msgr2=0x7ff37c09f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:19.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37a800700 1 --2- 172.21.15.49:0/856231479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c0625f0 0x7ff37c09f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:19.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37a800700 1 -- 172.21.15.49:0/856231479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0c2ab0 msgr2=0x7ff37c152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:19.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37a800700 1 --2- 172.21.15.49:0/856231479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0c2ab0 0x7ff37c152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:19.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37a800700 1 -- 172.21.15.49:0/856231479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c0092a0 con 0x7ff37c0c6840 2024-01-22T05:12:19.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff379400700 1 --2- 172.21.15.49:0/856231479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0c2ab0 0x7ff37c152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:19.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37a800700 1 --2- 172.21.15.49:0/856231479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff37c0c6840 0x7ff37c0bc790 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7ff374005ad0 tx=0x7ff374001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:19.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff371600700 1 -- 172.21.15.49:0/856231479 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374005d30 con 0x7ff37c0c6840 2024-01-22T05:12:19.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff371600700 1 -- 172.21.15.49:0/856231479 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff374005e90 con 0x7ff37c0c6840 2024-01-22T05:12:19.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff371600700 1 -- 172.21.15.49:0/856231479 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374007320 con 0x7ff37c0c6840 2024-01-22T05:12:19.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37b200700 1 -- 172.21.15.49:0/856231479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37c154b70 con 0x7ff37c0c6840 2024-01-22T05:12:19.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.542+0000 7ff37b200700 1 -- 172.21.15.49:0/856231479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37c155130 con 0x7ff37c0c6840 2024-01-22T05:12:19.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.546+0000 7ff37b200700 1 -- 172.21.15.49:0/856231479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff37c155930 con 0x7ff37c0c6840 2024-01-22T05:12:19.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.546+0000 7ff371600700 1 -- 172.21.15.49:0/856231479 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff3740076d0 con 0x7ff37c0c6840 2024-01-22T05:12:19.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.546+0000 7ff371600700 1 --2- 172.21.15.49:0/856231479 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff35405a510 0x7ff35405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:19.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.546+0000 7ff371600700 1 -- 172.21.15.49:0/856231479 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5708+0+0 (secure 0 0 0) 0x7ff3740746c0 con 0x7ff37c0c6840 2024-01-22T05:12:19.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.546+0000 7ff379e00700 1 --2- 172.21.15.49:0/856231479 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff35405a510 0x7ff35405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:19.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.550+0000 7ff379e00700 1 --2- 172.21.15.49:0/856231479 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff35405a510 0x7ff35405c9d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7ff36c009760 tx=0x7ff36c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:19.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.554+0000 7ff371600700 1 -- 172.21.15.49:0/856231479 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff37c155930 con 0x7ff37c0c6840 2024-01-22T05:12:19.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.726+0000 7ff37b200700 1 -- 172.21.15.49:0/856231479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff37c1558f0 con 0x7ff37c0c6840 2024-01-22T05:12:19.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.734+0000 7ff371600700 1 -- 172.21.15.49:0/856231479 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff374048040 con 0x7ff37c0c6840 2024-01-22T05:12:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.738+0000 7ff37b200700 1 -- 172.21.15.49:0/856231479 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff35405a510 msgr2=0x7ff35405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.738+0000 7ff37b200700 1 --2- 172.21.15.49:0/856231479 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff35405a510 0x7ff35405c9d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7ff36c009760 tx=0x7ff36c017000).stop 2024-01-22T05:12:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.738+0000 7ff37b200700 1 -- 172.21.15.49:0/856231479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff37c0c6840 msgr2=0x7ff37c0bc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.738+0000 7ff37b200700 1 --2- 172.21.15.49:0/856231479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff37c0c6840 0x7ff37c0bc790 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7ff374005ad0 tx=0x7ff374001650).stop 2024-01-22T05:12:19.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.738+0000 7ff37b200700 1 -- 172.21.15.49:0/856231479 shutdown_connections 2024-01-22T05:12:19.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.738+0000 7ff37b200700 1 --2- 172.21.15.49:0/856231479 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff35405a510 0x7ff35405c9d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:19.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.738+0000 7ff37b200700 1 --2- 172.21.15.49:0/856231479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff37c0c6840 0x7ff37c0bc790 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:19.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.738+0000 7ff37b200700 1 --2- 172.21.15.49:0/856231479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0c2ab0 0x7ff37c152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:19.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.738+0000 7ff37b200700 1 --2- 172.21.15.49:0/856231479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c0625f0 0x7ff37c09f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:19.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.738+0000 7ff37b200700 1 -- 172.21.15.49:0/856231479 >> 172.21.15.49:0/856231479 conn(0x7ff37c0c3880 msgr2=0x7ff37c065f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:19.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.738+0000 7ff37b200700 1 -- 172.21.15.49:0/856231479 shutdown_connections 2024-01-22T05:12:19.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:19.738+0000 7ff37b200700 1 -- 172.21.15.49:0/856231479 wait complete. 2024-01-22T05:12:19.764 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:12:19.764 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:12:19.806 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:12:19.849 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:12:19.850 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-22T05:12:19.850 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:12:20.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.010+0000 7ff741400700 1 Processor -- start 2024-01-22T05:12:20.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.010+0000 7ff741400700 1 -- start start 2024-01-22T05:12:20.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.014+0000 7ff741400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff73c065240 0x7ff73c0644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:20.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.014+0000 7ff741400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff73c0649e0 0x7ff73c15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:20.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.014+0000 7ff741400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73c064e90 con 0x7ff73c065620 2024-01-22T05:12:20.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.014+0000 7ff741400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73c0c2700 con 0x7ff73c0649e0 2024-01-22T05:12:20.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.014+0000 7ff741400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c0c29a0 con 0x7ff73c065240 2024-01-22T05:12:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.014+0000 7ff740a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff73c0649e0 0x7ff73c15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.014+0000 7ff73a800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff73c065240 0x7ff73c0644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.014+0000 7ff73a800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff73c065240 0x7ff73c0644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:51352/0 (socket says 172.21.15.49:51352) 2024-01-22T05:12:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.014+0000 7ff73a800700 1 -- 172.21.15.49:0/3653425189 learned_addr learned my addr 172.21.15.49:0/3653425189 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.014+0000 7ff73a800700 1 -- 172.21.15.49:0/3653425189 >> v2:172.21.15.49:3300/0 conn(0x7ff73c0649e0 msgr2=0x7ff73c15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.014+0000 7ff73a800700 1 --2- 172.21.15.49:0/3653425189 >> v2:172.21.15.49:3300/0 conn(0x7ff73c0649e0 0x7ff73c15c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.014+0000 7ff73a800700 1 -- 172.21.15.49:0/3653425189 >> v1:172.21.15.110:6789/0 conn(0x7ff73c065620 legacy=0x7ff73c15b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:20.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.014+0000 7ff73a800700 1 -- 172.21.15.49:0/3653425189 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c0c2c80 con 0x7ff73c065240 2024-01-22T05:12:20.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.014+0000 7ff73a800700 1 --2- 172.21.15.49:0/3653425189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff73c065240 0x7ff73c0644f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7ff72c006fd0 tx=0x7ff72c0090f0).ready entity=mon.2 client_cookie=617040d91ba375eb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:20.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.018+0000 7ff739400700 1 -- 172.21.15.49:0/3653425189 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c00b580 con 0x7ff73c065240 2024-01-22T05:12:20.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.018+0000 7ff739400700 1 -- 172.21.15.49:0/3653425189 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c00b6e0 con 0x7ff73c065240 2024-01-22T05:12:20.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.018+0000 7ff739400700 1 -- 172.21.15.49:0/3653425189 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c00ba60 con 0x7ff73c065240 2024-01-22T05:12:20.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.018+0000 7ff741400700 1 -- 172.21.15.49:0/3653425189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff73c065240 msgr2=0x7ff73c0644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:20.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.018+0000 7ff741400700 1 --2- 172.21.15.49:0/3653425189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff73c065240 0x7ff73c0644f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7ff72c006fd0 tx=0x7ff72c0090f0).stop 2024-01-22T05:12:20.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.018+0000 7ff741400700 1 -- 172.21.15.49:0/3653425189 shutdown_connections 2024-01-22T05:12:20.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.018+0000 7ff741400700 1 --2- 172.21.15.49:0/3653425189 >> v2:172.21.15.49:3300/0 conn(0x7ff73c0649e0 0x7ff73c15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:20.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.018+0000 7ff741400700 1 --2- 172.21.15.49:0/3653425189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff73c065240 0x7ff73c0644f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:20.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.018+0000 7ff741400700 1 -- 172.21.15.49:0/3653425189 >> 172.21.15.49:0/3653425189 conn(0x7ff73c0c87f0 msgr2=0x7ff73c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:20.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.018+0000 7ff741400700 1 -- 172.21.15.49:0/3653425189 shutdown_connections 2024-01-22T05:12:20.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.018+0000 7ff741400700 1 -- 172.21.15.49:0/3653425189 wait complete. 2024-01-22T05:12:20.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.022+0000 7ff741400700 1 Processor -- start 2024-01-22T05:12:20.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.022+0000 7ff741400700 1 -- start start 2024-01-22T05:12:20.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.022+0000 7ff741400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff73c0649e0 0x7ff73c16cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:20.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.022+0000 7ff741400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff73c065240 0x7ff73c1460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:20.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.022+0000 7ff741400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff73c065620 0x7ff73c0a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:20.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.022+0000 7ff741400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c16c160 con 0x7ff73c0649e0 2024-01-22T05:12:20.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.022+0000 7ff741400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c16d0a0 con 0x7ff73c065620 2024-01-22T05:12:20.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.022+0000 7ff741400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c0a8160 con 0x7ff73c065240 2024-01-22T05:12:20.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff73a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff73c0649e0 0x7ff73c16cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:20.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff73a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff73c0649e0 0x7ff73c16cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44460/0 (socket says 172.21.15.49:44460) 2024-01-22T05:12:20.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff73a800700 1 -- 172.21.15.49:0/3255935753 learned_addr learned my addr 172.21.15.49:0/3255935753 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:20.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff739e00700 1 --2- 172.21.15.49:0/3255935753 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff73c065240 0x7ff73c1460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:20.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff740a00700 1 --2- 172.21.15.49:0/3255935753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff73c065620 0x7ff73c0a7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff73a800700 1 -- 172.21.15.49:0/3255935753 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff73c065240 msgr2=0x7ff73c1460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff73a800700 1 --2- 172.21.15.49:0/3255935753 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff73c065240 0x7ff73c1460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff73a800700 1 -- 172.21.15.49:0/3255935753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff73c065620 msgr2=0x7ff73c0a7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff73a800700 1 --2- 172.21.15.49:0/3255935753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff73c065620 0x7ff73c0a7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff73a800700 1 -- 172.21.15.49:0/3255935753 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c009370 con 0x7ff73c0649e0 2024-01-22T05:12:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff73a800700 1 --2- 172.21.15.49:0/3255935753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff73c0649e0 0x7ff73c16cbb0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7ff72c009fd0 tx=0x7ff72c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff732000700 1 -- 172.21.15.49:0/3255935753 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c00b850 con 0x7ff73c0649e0 2024-01-22T05:12:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff732000700 1 -- 172.21.15.49:0/3255935753 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c00b9b0 con 0x7ff73c0649e0 2024-01-22T05:12:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff741400700 1 -- 172.21.15.49:0/3255935753 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73c0a8440 con 0x7ff73c0649e0 2024-01-22T05:12:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff732000700 1 -- 172.21.15.49:0/3255935753 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c01c670 con 0x7ff73c0649e0 2024-01-22T05:12:20.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff741400700 1 -- 172.21.15.49:0/3255935753 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73c16c690 con 0x7ff73c0649e0 2024-01-22T05:12:20.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.026+0000 7ff741400700 1 -- 172.21.15.49:0/3255935753 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73c068d10 con 0x7ff73c0649e0 2024-01-22T05:12:20.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.030+0000 7ff732000700 1 -- 172.21.15.49:0/3255935753 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff72c01ca60 con 0x7ff73c0649e0 2024-01-22T05:12:20.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.034+0000 7ff732000700 1 --2- 172.21.15.49:0/3255935753 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff71405a510 0x7ff71405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:20.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.034+0000 7ff732000700 1 -- 172.21.15.49:0/3255935753 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5708+0+0 (secure 0 0 0) 0x7ff72c076290 con 0x7ff73c0649e0 2024-01-22T05:12:20.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.034+0000 7ff739e00700 1 --2- 172.21.15.49:0/3255935753 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff71405a510 0x7ff71405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:20.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.034+0000 7ff739e00700 1 --2- 172.21.15.49:0/3255935753 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff71405a510 0x7ff71405c9d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7ff73c0bfe40 tx=0x7ff724009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:20.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.038+0000 7ff732000700 1 -- 172.21.15.49:0/3255935753 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff73c068d10 con 0x7ff73c0649e0 2024-01-22T05:12:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.238+0000 7ff741400700 1 -- 172.21.15.49:0/3255935753 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff73c067630 con 0x7ff73c0649e0 2024-01-22T05:12:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.242+0000 7ff732000700 1 -- 172.21.15.49:0/3255935753 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+3529 (secure 0 0 0) 0x7ff73c067630 con 0x7ff73c0649e0 2024-01-22T05:12:20.244 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:20.245 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":85,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6080,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/948258971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":948258971},{"type":"v1","addr":"172.21.15.110:6835","nonce":948258971}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/3309288523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3309288523},{"type":"v1","addr":"172.21.15.110:6834","nonce":3309288523}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":6828,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/304005498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":304005498},{"type":"v1","addr":"172.21.15.49:6835","nonce":304005498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6843,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1613189666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1613189666},{"type":"v1","addr":"172.21.15.49:6837","nonce":1613189666}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[]} 2024-01-22T05:12:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.242+0000 7ff741400700 1 -- 172.21.15.49:0/3255935753 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff71405a510 msgr2=0x7ff71405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.242+0000 7ff741400700 1 --2- 172.21.15.49:0/3255935753 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff71405a510 0x7ff71405c9d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7ff73c0bfe40 tx=0x7ff724009040).stop 2024-01-22T05:12:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.242+0000 7ff741400700 1 -- 172.21.15.49:0/3255935753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff73c0649e0 msgr2=0x7ff73c16cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.242+0000 7ff741400700 1 --2- 172.21.15.49:0/3255935753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff73c0649e0 0x7ff73c16cbb0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7ff72c009fd0 tx=0x7ff72c017000).stop 2024-01-22T05:12:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.242+0000 7ff741400700 1 -- 172.21.15.49:0/3255935753 shutdown_connections 2024-01-22T05:12:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.242+0000 7ff741400700 1 --2- 172.21.15.49:0/3255935753 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff71405a510 0x7ff71405c9d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.242+0000 7ff741400700 1 --2- 172.21.15.49:0/3255935753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff73c065620 0x7ff73c0a7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.242+0000 7ff741400700 1 --2- 172.21.15.49:0/3255935753 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff73c065240 0x7ff73c1460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.242+0000 7ff741400700 1 --2- 172.21.15.49:0/3255935753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff73c0649e0 0x7ff73c16cbb0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.242+0000 7ff741400700 1 -- 172.21.15.49:0/3255935753 >> 172.21.15.49:0/3255935753 conn(0x7ff73c0c87f0 msgr2=0x7ff73c063b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.246+0000 7ff741400700 1 -- 172.21.15.49:0/3255935753 shutdown_connections 2024-01-22T05:12:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.246+0000 7ff741400700 1 -- 172.21.15.49:0/3255935753 wait complete. 2024-01-22T05:12:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 85 2024-01-22T05:12:20.271 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:12:20.271 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-22T05:12:20.271 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:12:20.271 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:12:20.271 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:12:20.271 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-22T05:12:20.272 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:12:20.272 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:12:20.272 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:12:20.272 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-22T05:12:20.272 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:12:20.272 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:12:20.272 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:12:20.273 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-22T05:12:20.273 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:12:20.273 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:12:20.293 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:12:20.293 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:12:20.297 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:12:20.297 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:12:20.298 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:12:20.298 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:12:20.301 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:12:20.301 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:12:20.343 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:12:20.344 DEBUG:teuthology.parallel:result is None 2024-01-22T05:12:20.348 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:12:20.348 DEBUG:teuthology.parallel:result is None 2024-01-22T05:12:20.349 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:12:20.349 DEBUG:teuthology.parallel:result is None 2024-01-22T05:12:20.354 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:12:20.354 DEBUG:teuthology.parallel:result is None 2024-01-22T05:12:20.355 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-22T05:12:20.461 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:12:20.462 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:12:20.466 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:12:20.468 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-22T05:12:20.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.514+0000 7f7f1ba00700 1 Processor -- start 2024-01-22T05:12:20.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.514+0000 7f7f1ba00700 1 -- start start 2024-01-22T05:12:20.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f1ba00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f140bdfa0 0x7f7f140688f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f1ba00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7f14153d60 0x7f7f14064380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f1ba00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f14157b40 con 0x7f7f14063f40 2024-01-22T05:12:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f1ba00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f14158610 con 0x7f7f14153d60 2024-01-22T05:12:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f1ba00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f140bc740 con 0x7f7f140bdfa0 2024-01-22T05:12:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f19000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f140bdfa0 0x7f7f140688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f19a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7f14153d60 0x7f7f14064380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f19000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f140bdfa0 0x7f7f140688f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:51416/0 (socket says 172.21.15.49:51416) 2024-01-22T05:12:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f13e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7f14063f40 0x7f7f14153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:33022/0 (socket says 172.21.15.49:33022) 2024-01-22T05:12:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f19000700 1 -- 172.21.15.49:0/1590296100 learned_addr learned my addr 172.21.15.49:0/1590296100 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f13400700 1 -- 172.21.15.49:0/1590296100 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187914648 0 0) 0x7f7f14157b40 con 0x7f7f14063f40 2024-01-22T05:12:20.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f13400700 1 -- 172.21.15.49:0/1590296100 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ef40033f0 con 0x7f7f14063f40 2024-01-22T05:12:20.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f19a00700 1 -- 172.21.15.49:0/1590296100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f140bdfa0 msgr2=0x7f7f140688f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:20.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f19a00700 1 --2- 172.21.15.49:0/1590296100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f140bdfa0 0x7f7f140688f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:20.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f19a00700 1 -- 172.21.15.49:0/1590296100 >> v1:172.21.15.110:6789/0 conn(0x7f7f14063f40 legacy=0x7f7f14153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:20.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.518+0000 7f7f19a00700 1 -- 172.21.15.49:0/1590296100 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f14157d70 con 0x7f7f14153d60 2024-01-22T05:12:20.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.522+0000 7f7f19a00700 1 --2- 172.21.15.49:0/1590296100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f14153d60 0x7f7f14064380 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f7f0c009e90 tx=0x7f7f0c009780).ready entity=mon.1 client_cookie=96d017cf945876b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:20.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.522+0000 7f7f13400700 1 -- 172.21.15.49:0/1590296100 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c00e070 con 0x7f7f14153d60 2024-01-22T05:12:20.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.522+0000 7f7f13400700 1 -- 172.21.15.49:0/1590296100 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c00ba70 con 0x7f7f14153d60 2024-01-22T05:12:20.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.522+0000 7f7f13400700 1 -- 172.21.15.49:0/1590296100 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c00bdf0 con 0x7f7f14153d60 2024-01-22T05:12:20.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.522+0000 7f7f1ba00700 1 -- 172.21.15.49:0/1590296100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f14153d60 msgr2=0x7f7f14064380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:20.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.522+0000 7f7f1ba00700 1 --2- 172.21.15.49:0/1590296100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f14153d60 0x7f7f14064380 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f7f0c009e90 tx=0x7f7f0c009780).stop 2024-01-22T05:12:20.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.522+0000 7f7f1ba00700 1 -- 172.21.15.49:0/1590296100 shutdown_connections 2024-01-22T05:12:20.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.522+0000 7f7f1ba00700 1 --2- 172.21.15.49:0/1590296100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f14153d60 0x7f7f14064380 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:20.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.522+0000 7f7f1ba00700 1 --2- 172.21.15.49:0/1590296100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f140bdfa0 0x7f7f140688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:20.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.522+0000 7f7f1ba00700 1 -- 172.21.15.49:0/1590296100 >> 172.21.15.49:0/1590296100 conn(0x7f7f140c40c0 msgr2=0x7f7f140c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:20.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.522+0000 7f7f1ba00700 1 -- 172.21.15.49:0/1590296100 shutdown_connections 2024-01-22T05:12:20.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.522+0000 7f7f1ba00700 1 -- 172.21.15.49:0/1590296100 wait complete. 2024-01-22T05:12:20.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.526+0000 7f7f1ba00700 1 Processor -- start 2024-01-22T05:12:20.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.526+0000 7f7f1ba00700 1 -- start start 2024-01-22T05:12:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f1ba00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f14063f40 0x7f7f140abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f1ba00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f140bdfa0 0x7f7f14139930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f1ba00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f14153d60 0x7f7f14167200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f1ba00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14157390 con 0x7f7f140bdfa0 2024-01-22T05:12:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f1ba00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14139e20 con 0x7f7f14153d60 2024-01-22T05:12:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f1ba00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f140ab8f0 con 0x7f7f14063f40 2024-01-22T05:12:20.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f13e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f140bdfa0 0x7f7f14139930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:20.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f19a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f14153d60 0x7f7f14167200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:20.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f19000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f14063f40 0x7f7f140abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:20.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f19000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f14063f40 0x7f7f140abd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:51422/0 (socket says 172.21.15.49:51422) 2024-01-22T05:12:20.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f19a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f14153d60 0x7f7f14167200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:60354/0 (socket says 172.21.15.49:60354) 2024-01-22T05:12:20.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f19000700 1 -- 172.21.15.49:0/3252995646 learned_addr learned my addr 172.21.15.49:0/3252995646 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:20.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f13e00700 1 -- 172.21.15.49:0/3252995646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f14063f40 msgr2=0x7f7f140abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:20.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f13e00700 1 --2- 172.21.15.49:0/3252995646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f14063f40 0x7f7f140abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:20.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f13e00700 1 -- 172.21.15.49:0/3252995646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f14153d60 msgr2=0x7f7f14167200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:20.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f13e00700 1 --2- 172.21.15.49:0/3252995646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f14153d60 0x7f7f14167200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:20.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f13e00700 1 -- 172.21.15.49:0/3252995646 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c009a20 con 0x7f7f140bdfa0 2024-01-22T05:12:20.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f19a00700 1 --2- 172.21.15.49:0/3252995646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f14153d60 0x7f7f14167200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:12:20.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f19000700 1 --2- 172.21.15.49:0/3252995646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f14063f40 0x7f7f140abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:12:20.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f13e00700 1 --2- 172.21.15.49:0/3252995646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f140bdfa0 0x7f7f14139930 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f7efc00c470 tx=0x7f7efc007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:20.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f0be00700 1 -- 172.21.15.49:0/3252995646 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0070d0 con 0x7f7f140bdfa0 2024-01-22T05:12:20.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f0be00700 1 -- 172.21.15.49:0/3252995646 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc007230 con 0x7f7f140bdfa0 2024-01-22T05:12:20.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f0be00700 1 -- 172.21.15.49:0/3252995646 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0056e0 con 0x7f7f140bdfa0 2024-01-22T05:12:20.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.530+0000 7f7f1ba00700 1 -- 172.21.15.49:0/3252995646 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1414fb60 con 0x7f7f140bdfa0 2024-01-22T05:12:20.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.534+0000 7f7f1ba00700 1 -- 172.21.15.49:0/3252995646 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1414f880 con 0x7f7f140bdfa0 2024-01-22T05:12:20.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.534+0000 7f7f1ba00700 1 -- 172.21.15.49:0/3252995646 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f140aba80 con 0x7f7f140bdfa0 2024-01-22T05:12:20.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.534+0000 7f7f0be00700 1 -- 172.21.15.49:0/3252995646 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7efc005b10 con 0x7f7f140bdfa0 2024-01-22T05:12:20.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.538+0000 7f7f0be00700 1 --2- 172.21.15.49:0/3252995646 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7eec05a510 0x7f7eec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:20.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.538+0000 7f7f0be00700 1 -- 172.21.15.49:0/3252995646 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f7efc073cf0 con 0x7f7f140bdfa0 2024-01-22T05:12:20.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.538+0000 7f7f19000700 1 --2- 172.21.15.49:0/3252995646 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7eec05a510 0x7f7eec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:20.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.538+0000 7f7f19000700 1 --2- 172.21.15.49:0/3252995646 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7eec05a510 0x7f7eec05c9d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f7f141539d0 tx=0x7f7f040090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:20.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.542+0000 7f7f0be00700 1 -- 172.21.15.49:0/3252995646 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7efc0475b0 con 0x7f7f140bdfa0 2024-01-22T05:12:20.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:20.726+0000 7f7f1ba00700 1 -- 172.21.15.49:0/3252995646 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7f14158050 con 0x7f7f140bdfa0 2024-01-22T05:12:21.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.502+0000 7f7f0be00700 1 -- 172.21.15.49:0/3252995646 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v100) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7efc04abd0 con 0x7f7f140bdfa0 2024-01-22T05:12:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.510+0000 7f7f1ba00700 1 -- 172.21.15.49:0/3252995646 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7eec05a510 msgr2=0x7f7eec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.510+0000 7f7f1ba00700 1 --2- 172.21.15.49:0/3252995646 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7eec05a510 0x7f7eec05c9d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f7f141539d0 tx=0x7f7f040090f0).stop 2024-01-22T05:12:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.510+0000 7f7f1ba00700 1 -- 172.21.15.49:0/3252995646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f140bdfa0 msgr2=0x7f7f14139930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.510+0000 7f7f1ba00700 1 --2- 172.21.15.49:0/3252995646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f140bdfa0 0x7f7f14139930 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f7efc00c470 tx=0x7f7efc007bc0).stop 2024-01-22T05:12:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.510+0000 7f7f1ba00700 1 -- 172.21.15.49:0/3252995646 shutdown_connections 2024-01-22T05:12:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.510+0000 7f7f1ba00700 1 --2- 172.21.15.49:0/3252995646 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7eec05a510 0x7f7eec05c9d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.510+0000 7f7f1ba00700 1 --2- 172.21.15.49:0/3252995646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f14153d60 0x7f7f14167200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.510+0000 7f7f1ba00700 1 --2- 172.21.15.49:0/3252995646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f140bdfa0 0x7f7f14139930 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.510+0000 7f7f1ba00700 1 --2- 172.21.15.49:0/3252995646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f14063f40 0x7f7f140abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.510+0000 7f7f1ba00700 1 -- 172.21.15.49:0/3252995646 >> 172.21.15.49:0/3252995646 conn(0x7f7f140c40c0 msgr2=0x7f7f14069980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.510+0000 7f7f1ba00700 1 -- 172.21.15.49:0/3252995646 shutdown_connections 2024-01-22T05:12:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.510+0000 7f7f1ba00700 1 -- 172.21.15.49:0/3252995646 wait complete. 2024-01-22T05:12:21.516 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-01-22T05:12:21.536 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-22T05:12:21.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.694+0000 7f08ce400700 1 Processor -- start 2024-01-22T05:12:21.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.694+0000 7f08ce400700 1 -- start start 2024-01-22T05:12:21.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08ce400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f08c8155d20 0x7f08c8065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:21.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08ce400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f08c8066070 0x7f08c80a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:21.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08ce400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c80c1a40 con 0x7f08c80a8c30 2024-01-22T05:12:21.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08ce400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c80a90c0 con 0x7f08c8066070 2024-01-22T05:12:21.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08ce400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c8159310 con 0x7f08c8155d20 2024-01-22T05:12:21.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08c6a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f08c8066070 0x7f08c80a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:21.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08c7e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f08c80a8c30 0x7f08c80c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56514/0 (socket says 172.21.15.49:56514) 2024-01-22T05:12:21.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08c6a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f08c8066070 0x7f08c80a8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44532/0 (socket says 172.21.15.49:44532) 2024-01-22T05:12:21.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08c7e00700 1 -- 172.21.15.49:0/4141870366 learned_addr learned my addr 172.21.15.49:0/4141870366 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:21.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08c7400700 1 --2- 172.21.15.49:0/4141870366 >> v2:172.21.15.110:3300/0 conn(0x7f08c8155d20 0x7f08c8065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:21.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08c6a00700 1 -- 172.21.15.49:0/4141870366 >> v2:172.21.15.110:3300/0 conn(0x7f08c8155d20 msgr2=0x7f08c8065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:21.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08c6a00700 1 --2- 172.21.15.49:0/4141870366 >> v2:172.21.15.110:3300/0 conn(0x7f08c8155d20 0x7f08c8065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:21.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08c6a00700 1 -- 172.21.15.49:0/4141870366 >> v1:172.21.15.49:6789/0 conn(0x7f08c80a8c30 legacy=0x7f08c80c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:21.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08c6a00700 1 -- 172.21.15.49:0/4141870366 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c80c13f0 con 0x7f08c8066070 2024-01-22T05:12:21.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08c6a00700 1 --2- 172.21.15.49:0/4141870366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c8066070 0x7f08c80a8740 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f08c805ff40 tx=0x7f08b0009060).ready entity=mon.0 client_cookie=9162de299e45d52b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:21.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.698+0000 7f08c6000700 1 -- 172.21.15.49:0/4141870366 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b000b580 con 0x7f08c8066070 2024-01-22T05:12:21.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.702+0000 7f08c6000700 1 -- 172.21.15.49:0/4141870366 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b000b6e0 con 0x7f08c8066070 2024-01-22T05:12:21.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.702+0000 7f08c6000700 1 -- 172.21.15.49:0/4141870366 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b000ba60 con 0x7f08c8066070 2024-01-22T05:12:21.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.702+0000 7f08ce400700 1 -- 172.21.15.49:0/4141870366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c8066070 msgr2=0x7f08c80a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:21.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.702+0000 7f08ce400700 1 --2- 172.21.15.49:0/4141870366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c8066070 0x7f08c80a8740 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f08c805ff40 tx=0x7f08b0009060).stop 2024-01-22T05:12:21.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.702+0000 7f08ce400700 1 -- 172.21.15.49:0/4141870366 shutdown_connections 2024-01-22T05:12:21.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.702+0000 7f08ce400700 1 --2- 172.21.15.49:0/4141870366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c8066070 0x7f08c80a8740 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:21.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.702+0000 7f08ce400700 1 --2- 172.21.15.49:0/4141870366 >> v2:172.21.15.110:3300/0 conn(0x7f08c8155d20 0x7f08c8065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:21.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.702+0000 7f08ce400700 1 -- 172.21.15.49:0/4141870366 >> 172.21.15.49:0/4141870366 conn(0x7f08c80c6540 msgr2=0x7f08c80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:21.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.702+0000 7f08ce400700 1 -- 172.21.15.49:0/4141870366 shutdown_connections 2024-01-22T05:12:21.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.702+0000 7f08ce400700 1 -- 172.21.15.49:0/4141870366 wait complete. 2024-01-22T05:12:21.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.706+0000 7f08ce400700 1 Processor -- start 2024-01-22T05:12:21.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.706+0000 7f08ce400700 1 -- start start 2024-01-22T05:12:21.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.706+0000 7f08ce400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c8066070 0x7f08c81684a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:21.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.706+0000 7f08ce400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08c80a8c30 0x7f08c80bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:21.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.706+0000 7f08ce400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08c8155d20 0x7f08c8157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:21.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.706+0000 7f08ce400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c80a95b0 con 0x7f08c8066070 2024-01-22T05:12:21.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.706+0000 7f08ce400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c80bdf50 con 0x7f08c8155d20 2024-01-22T05:12:21.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.706+0000 7f08ce400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c8151880 con 0x7f08c80a8c30 2024-01-22T05:12:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08c7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c8066070 0x7f08c81684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08c7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c8066070 0x7f08c81684a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44542/0 (socket says 172.21.15.49:44542) 2024-01-22T05:12:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08c7400700 1 -- 172.21.15.49:0/219586523 learned_addr learned my addr 172.21.15.49:0/219586523 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08c7e00700 1 --2- 172.21.15.49:0/219586523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08c8155d20 0x7f08c8157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08c6a00700 1 --2- 172.21.15.49:0/219586523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08c80a8c30 0x7f08c80bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08c7400700 1 -- 172.21.15.49:0/219586523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08c80a8c30 msgr2=0x7f08c80bd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08c7400700 1 --2- 172.21.15.49:0/219586523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08c80a8c30 0x7f08c80bd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08c7400700 1 -- 172.21.15.49:0/219586523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08c8155d20 msgr2=0x7f08c8157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08c7400700 1 --2- 172.21.15.49:0/219586523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08c8155d20 0x7f08c8157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08c7400700 1 -- 172.21.15.49:0/219586523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b00092a0 con 0x7f08c8066070 2024-01-22T05:12:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08c7400700 1 --2- 172.21.15.49:0/219586523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c8066070 0x7f08c81684a0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f08b800d890 tx=0x7f08b8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08bea00700 1 -- 172.21.15.49:0/219586523 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8011590 con 0x7f08c8066070 2024-01-22T05:12:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08bea00700 1 -- 172.21.15.49:0/219586523 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b80116f0 con 0x7f08c8066070 2024-01-22T05:12:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08ce400700 1 -- 172.21.15.49:0/219586523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c8151b60 con 0x7f08c8066070 2024-01-22T05:12:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08bea00700 1 -- 172.21.15.49:0/219586523 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8011a70 con 0x7f08c8066070 2024-01-22T05:12:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08ce400700 1 -- 172.21.15.49:0/219586523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c80be230 con 0x7f08c8066070 2024-01-22T05:12:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.710+0000 7f08ce400700 1 -- 172.21.15.49:0/219586523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c8047060 con 0x7f08c8066070 2024-01-22T05:12:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.714+0000 7f08bea00700 1 -- 172.21.15.49:0/219586523 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f08b801c460 con 0x7f08c8066070 2024-01-22T05:12:21.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.714+0000 7f08bea00700 1 --2- 172.21.15.49:0/219586523 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08a005a540 0x7f08a005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:21.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.714+0000 7f08bea00700 1 -- 172.21.15.49:0/219586523 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f08b80743a0 con 0x7f08c8066070 2024-01-22T05:12:21.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.714+0000 7f08c6a00700 1 --2- 172.21.15.49:0/219586523 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08a005a540 0x7f08a005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:21.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.714+0000 7f08c6a00700 1 --2- 172.21.15.49:0/219586523 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08a005a540 0x7f08a005ca00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f08b0009fd0 tx=0x7f08b0017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.722+0000 7f08bea00700 1 -- 172.21.15.49:0/219586523 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f08b8047c50 con 0x7f08c8066070 2024-01-22T05:12:21.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.938+0000 7f08ce400700 1 -- 172.21.15.49:0/219586523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f08c80c3df0 con 0x7f08c8066070 2024-01-22T05:12:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.942+0000 7f08bea00700 1 -- 172.21.15.49:0/219586523 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f08b8011e60 con 0x7f08c8066070 2024-01-22T05:12:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:21.945 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:12:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-01-22T05:12:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-01-22T05:12:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lTCfoJxAAxDGvXKXgooA9/f0J70s6AA==", 2024-01-22T05:12:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:12:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lHqV6ORAA1DwpPV2PyDBF/6/ePTdQJw==", 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-01-22T05:12:21.947 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lPo86MhAAonfC3M+AkLldljODYNGzyA==", 2024-01-22T05:12:21.947 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.947 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:12:21.947 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:12:21.947 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:12:21.947 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:12:21.947 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.947 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.947 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.947 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-01-22T05:12:21.947 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lLwvMBxAAFm52HWeGbTH1gbWVm6r5zQ==", 2024-01-22T05:12:21.947 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.947 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:12:21.947 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:12:21.948 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:12:21.948 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:12:21.948 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.948 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.948 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.948 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-01-22T05:12:21.948 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAt961lH2F9NBAAHm8R9/Q5IuFUvb0o1GyD4Q==", 2024-01-22T05:12:21.948 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.948 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:12:21.948 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:12:21.948 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:12:21.948 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.948 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.948 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-01-22T05:12:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAx961lS1lEIhAAuDm2OYfTYff1kVEq5vXvFw==", 2024-01-22T05:12:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:12:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:12:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:12:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-01-22T05:12:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA1961limLvERAAv23crKrwjLIg84u48BHHbg==", 2024-01-22T05:12:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:12:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:12:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA5961lShJiABAAnvyhz0ggDaITaMgwzi9kAA==", 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA9961lcopfNRAAAZgHzI1t7YHI5cAjaCMiNw==", 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.950 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBB961lX+nTIxAAtP3YQypuFWM5O/LADjvybA==", 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2024-01-22T05:12:21.951 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBF961lQ4/XERAARZPqENsV3jokk2g3OXUI5w==", 2024-01-22T05:12:21.952 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.952 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:12:21.952 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:12:21.952 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:12:21.952 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.952 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.952 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.952 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2024-01-22T05:12:21.952 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBI961luxnqOhAAGsV74DKQda5cetNA/woOnA==", 2024-01-22T05:12:21.952 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.952 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:12:21.952 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:12:21.952 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:12:21.952 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lmrM6DhAAYU09HviWyrUIz4lio15wFw==", 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lIhYRGRAAFG+YtkDLFsra6zU44xKCHw==", 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:12:21.953 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lRuyaExAAQO3a7ahOEcuE+WVfXYEBTg==", 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.954 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lMiMkHhAAxPdKpcHdtqSphbc/2agq9Q==", 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961ljsweARAAJrY3z/sBjayjB2BRQNrJew==", 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:12:21.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:12:21.956 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.956 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.956 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.956 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-01-22T05:12:21.956 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961l0DwDIhAAeuCu79LxNMEJvWiW/BfDhA==", 2024-01-22T05:12:21.956 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.956 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:12:21.956 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:12:21.956 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:12:21.956 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.956 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:21.956 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:21.956 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2024-01-22T05:12:21.956 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lZlmPGxAA1KVZR+XzNdoFVo/980hD8w==", 2024-01-22T05:12:21.957 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:12:21.957 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:12:21.957 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:12:21.957 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:12:21.957 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.957 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:21.957 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-01-22T05:12:21.957 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:12:21.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.942+0000 7f08ce400700 1 -- 172.21.15.49:0/219586523 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08a005a540 msgr2=0x7f08a005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:21.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.942+0000 7f08ce400700 1 --2- 172.21.15.49:0/219586523 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08a005a540 0x7f08a005ca00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f08b0009fd0 tx=0x7f08b0017000).stop 2024-01-22T05:12:21.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.946+0000 7f08ce400700 1 -- 172.21.15.49:0/219586523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c8066070 msgr2=0x7f08c81684a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:21.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.946+0000 7f08ce400700 1 --2- 172.21.15.49:0/219586523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c8066070 0x7f08c81684a0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f08b800d890 tx=0x7f08b8008040).stop 2024-01-22T05:12:21.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.946+0000 7f08ce400700 1 -- 172.21.15.49:0/219586523 shutdown_connections 2024-01-22T05:12:21.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.946+0000 7f08ce400700 1 --2- 172.21.15.49:0/219586523 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08a005a540 0x7f08a005ca00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:21.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.946+0000 7f08ce400700 1 --2- 172.21.15.49:0/219586523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08c8155d20 0x7f08c8157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:21.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.946+0000 7f08ce400700 1 --2- 172.21.15.49:0/219586523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08c80a8c30 0x7f08c80bd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:21.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.946+0000 7f08ce400700 1 --2- 172.21.15.49:0/219586523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c8066070 0x7f08c81684a0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:21.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.946+0000 7f08ce400700 1 -- 172.21.15.49:0/219586523 >> 172.21.15.49:0/219586523 conn(0x7f08c80c6540 msgr2=0x7f08c80c4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:21.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.946+0000 7f08ce400700 1 -- 172.21.15.49:0/219586523 shutdown_connections 2024-01-22T05:12:21.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:21.946+0000 7f08ce400700 1 -- 172.21.15.49:0/219586523 wait complete. 2024-01-22T05:12:21.974 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:12:22.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.126+0000 7fee97800700 1 Processor -- start 2024-01-22T05:12:22.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.130+0000 7fee97800700 1 -- start start 2024-01-22T05:12:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.130+0000 7fee97800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee90155d20 0x7fee90065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.130+0000 7fee97800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee900a8e50 0x7fee900c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.130+0000 7fee97800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee900c1a40 con 0x7fee90066070 2024-01-22T05:12:22.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.130+0000 7fee97800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee90159310 con 0x7fee90155d20 2024-01-22T05:12:22.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.130+0000 7fee97800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee900c13f0 con 0x7fee900a8e50 2024-01-22T05:12:22.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.130+0000 7fee94e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee90155d20 0x7fee90065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.130+0000 7fee94e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee90155d20 0x7fee90065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44554/0 (socket says 172.21.15.49:44554) 2024-01-22T05:12:22.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.130+0000 7fee94e00700 1 -- 172.21.15.49:0/322168094 learned_addr learned my addr 172.21.15.49:0/322168094 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:22.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.130+0000 7fee94e00700 1 -- 172.21.15.49:0/322168094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee900a8e50 msgr2=0x7fee900c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:22.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.130+0000 7fee95800700 1 --2- 172.21.15.49:0/322168094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee900a8e50 0x7fee900c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee94e00700 1 --2- 172.21.15.49:0/322168094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee900a8e50 0x7fee900c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee94e00700 1 -- 172.21.15.49:0/322168094 >> v1:172.21.15.49:6789/0 conn(0x7fee90066070 legacy=0x7fee900a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee94e00700 1 -- 172.21.15.49:0/322168094 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee900c16d0 con 0x7fee90155d20 2024-01-22T05:12:22.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee95800700 1 --2- 172.21.15.49:0/322168094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee900a8e50 0x7fee900c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:12:22.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee94e00700 1 --2- 172.21.15.49:0/322168094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee90155d20 0x7fee90065b80 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7fee80006fd0 tx=0x7fee800090f0).ready entity=mon.0 client_cookie=a3bac814e863088f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:22.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee8f400700 1 -- 172.21.15.49:0/322168094 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8000b600 con 0x7fee90155d20 2024-01-22T05:12:22.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee8f400700 1 -- 172.21.15.49:0/322168094 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8000b760 con 0x7fee90155d20 2024-01-22T05:12:22.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee8f400700 1 -- 172.21.15.49:0/322168094 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8000bae0 con 0x7fee90155d20 2024-01-22T05:12:22.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee97800700 1 -- 172.21.15.49:0/322168094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee90155d20 msgr2=0x7fee90065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee97800700 1 --2- 172.21.15.49:0/322168094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee90155d20 0x7fee90065b80 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7fee80006fd0 tx=0x7fee800090f0).stop 2024-01-22T05:12:22.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee97800700 1 -- 172.21.15.49:0/322168094 shutdown_connections 2024-01-22T05:12:22.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee97800700 1 --2- 172.21.15.49:0/322168094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee900a8e50 0x7fee900c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee97800700 1 --2- 172.21.15.49:0/322168094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee90155d20 0x7fee90065b80 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee97800700 1 -- 172.21.15.49:0/322168094 >> 172.21.15.49:0/322168094 conn(0x7fee900c6540 msgr2=0x7fee900c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:22.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee97800700 1 -- 172.21.15.49:0/322168094 shutdown_connections 2024-01-22T05:12:22.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.134+0000 7fee97800700 1 -- 172.21.15.49:0/322168094 wait complete. 2024-01-22T05:12:22.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.138+0000 7fee97800700 1 Processor -- start 2024-01-22T05:12:22.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.142+0000 7fee97800700 1 -- start start 2024-01-22T05:12:22.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.142+0000 7fee97800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee90066070 0x7fee901431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.142+0000 7fee97800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee900a8e50 0x7fee90142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.142+0000 7fee97800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee90155d20 0x7fee90153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.142+0000 7fee97800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee90151fd0 con 0x7fee900a8e50 2024-01-22T05:12:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.142+0000 7fee97800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee901513c0 con 0x7fee90155d20 2024-01-22T05:12:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.142+0000 7fee97800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee901516a0 con 0x7fee90066070 2024-01-22T05:12:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.142+0000 7fee8fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee900a8e50 0x7fee90142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.142+0000 7fee8fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee900a8e50 0x7fee90142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44562/0 (socket says 172.21.15.49:44562) 2024-01-22T05:12:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.142+0000 7fee8fe00700 1 -- 172.21.15.49:0/1909875846 learned_addr learned my addr 172.21.15.49:0/1909875846 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.142+0000 7fee94e00700 1 --2- 172.21.15.49:0/1909875846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee90066070 0x7fee901431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.142+0000 7fee95800700 1 --2- 172.21.15.49:0/1909875846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee90155d20 0x7fee90153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.146+0000 7fee8fe00700 1 -- 172.21.15.49:0/1909875846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee90066070 msgr2=0x7fee901431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.146+0000 7fee8fe00700 1 --2- 172.21.15.49:0/1909875846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee90066070 0x7fee901431e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.146+0000 7fee8fe00700 1 -- 172.21.15.49:0/1909875846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee90155d20 msgr2=0x7fee90153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.146+0000 7fee8fe00700 1 --2- 172.21.15.49:0/1909875846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee90155d20 0x7fee90153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.146+0000 7fee8fe00700 1 -- 172.21.15.49:0/1909875846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee80009370 con 0x7fee900a8e50 2024-01-22T05:12:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.146+0000 7fee8fe00700 1 --2- 172.21.15.49:0/1909875846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee900a8e50 0x7fee90142690 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fee7800c4c0 tx=0x7fee78007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.146+0000 7fee87e00700 1 -- 172.21.15.49:0/1909875846 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7800ce70 con 0x7fee900a8e50 2024-01-22T05:12:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.146+0000 7fee87e00700 1 -- 172.21.15.49:0/1909875846 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee78001e90 con 0x7fee900a8e50 2024-01-22T05:12:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.146+0000 7fee97800700 1 -- 172.21.15.49:0/1909875846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee90151980 con 0x7fee900a8e50 2024-01-22T05:12:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.146+0000 7fee87e00700 1 -- 172.21.15.49:0/1909875846 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78007250 con 0x7fee900a8e50 2024-01-22T05:12:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.146+0000 7fee97800700 1 -- 172.21.15.49:0/1909875846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee90142b80 con 0x7fee900a8e50 2024-01-22T05:12:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.146+0000 7fee97800700 1 -- 172.21.15.49:0/1909875846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee90047060 con 0x7fee900a8e50 2024-01-22T05:12:22.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.150+0000 7fee87e00700 1 -- 172.21.15.49:0/1909875846 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fee780066a0 con 0x7fee900a8e50 2024-01-22T05:12:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.150+0000 7fee87e00700 1 --2- 172.21.15.49:0/1909875846 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fee6805a510 0x7fee6805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.150+0000 7fee87e00700 1 -- 172.21.15.49:0/1909875846 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fee78073e00 con 0x7fee900a8e50 2024-01-22T05:12:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.150+0000 7fee94e00700 1 --2- 172.21.15.49:0/1909875846 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fee6805a510 0x7fee6805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.150+0000 7fee94e00700 1 --2- 172.21.15.49:0/1909875846 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fee6805a510 0x7fee6805c9d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fee80009130 tx=0x7fee80017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.154+0000 7fee87e00700 1 -- 172.21.15.49:0/1909875846 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fee780477d0 con 0x7fee900a8e50 2024-01-22T05:12:22.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.322+0000 7fee97800700 1 -- 172.21.15.49:0/1909875846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee900c23c0 con 0x7fee900a8e50 2024-01-22T05:12:22.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.326+0000 7fee87e00700 1 -- 172.21.15.49:0/1909875846 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+13950 (secure 0 0 0) 0x7fee7804adf0 con 0x7fee900a8e50 2024-01-22T05:12:22.328 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:22.328 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":100,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:12:21.499412+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:12:22.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.326+0000 7fee97800700 1 -- 172.21.15.49:0/1909875846 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fee6805a510 msgr2=0x7fee6805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.326+0000 7fee97800700 1 --2- 172.21.15.49:0/1909875846 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fee6805a510 0x7fee6805c9d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fee80009130 tx=0x7fee80017000).stop 2024-01-22T05:12:22.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.326+0000 7fee97800700 1 -- 172.21.15.49:0/1909875846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee900a8e50 msgr2=0x7fee90142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.326+0000 7fee97800700 1 --2- 172.21.15.49:0/1909875846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee900a8e50 0x7fee90142690 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fee7800c4c0 tx=0x7fee78007e00).stop 2024-01-22T05:12:22.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.326+0000 7fee97800700 1 -- 172.21.15.49:0/1909875846 shutdown_connections 2024-01-22T05:12:22.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.326+0000 7fee97800700 1 --2- 172.21.15.49:0/1909875846 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fee6805a510 0x7fee6805c9d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.326+0000 7fee97800700 1 --2- 172.21.15.49:0/1909875846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee90155d20 0x7fee90153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.326+0000 7fee97800700 1 --2- 172.21.15.49:0/1909875846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee900a8e50 0x7fee90142690 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.326+0000 7fee97800700 1 --2- 172.21.15.49:0/1909875846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee90066070 0x7fee901431e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.326+0000 7fee97800700 1 -- 172.21.15.49:0/1909875846 >> 172.21.15.49:0/1909875846 conn(0x7fee900c6540 msgr2=0x7fee90068720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:22.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.326+0000 7fee97800700 1 -- 172.21.15.49:0/1909875846 shutdown_connections 2024-01-22T05:12:22.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.326+0000 7fee97800700 1 -- 172.21.15.49:0/1909875846 wait complete. 2024-01-22T05:12:22.353 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:12:22.354 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:12:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.514+0000 7f5338c00700 1 Processor -- start 2024-01-22T05:12:22.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.514+0000 7f5338c00700 1 -- start start 2024-01-22T05:12:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.518+0000 7f5338c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53340691b0 0x7f5334062230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.518+0000 7f5338c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53340bd3e0 con 0x7f53340bc060 2024-01-22T05:12:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.518+0000 7f5338c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5334066830 con 0x7f53340bd870 2024-01-22T05:12:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.518+0000 7f5338c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53340bdc50 con 0x7f53340691b0 2024-01-22T05:12:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.518+0000 7f5332a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f53340bc060 0x7f5334068aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56538/0 (socket says 172.21.15.49:56538) 2024-01-22T05:12:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5332a00700 1 -- 172.21.15.49:0/3735300646 learned_addr learned my addr 172.21.15.49:0/3735300646 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5333e00700 1 --2- 172.21.15.49:0/3735300646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53340691b0 0x7f5334062230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5332000700 1 -- 172.21.15.49:0/3735300646 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783354935 0 0) 0x7f53340bd3e0 con 0x7f53340bc060 2024-01-22T05:12:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5332000700 1 -- 172.21.15.49:0/3735300646 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53140033f0 con 0x7f53340bc060 2024-01-22T05:12:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5332000700 1 -- 172.21.15.49:0/3735300646 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687915817 0 0) 0x7f5334066830 con 0x7f53340bd870 2024-01-22T05:12:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5332000700 1 -- 172.21.15.49:0/3735300646 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53340bd3e0 con 0x7f53340bd870 2024-01-22T05:12:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5333e00700 1 -- 172.21.15.49:0/3735300646 >> v1:172.21.15.110:6789/0 conn(0x7f53340bd870 legacy=0x7f5334153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5333e00700 1 -- 172.21.15.49:0/3735300646 >> v1:172.21.15.49:6789/0 conn(0x7f53340bc060 legacy=0x7f5334068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5333e00700 1 -- 172.21.15.49:0/3735300646 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53340bc7d0 con 0x7f53340691b0 2024-01-22T05:12:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5333e00700 1 --2- 172.21.15.49:0/3735300646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53340691b0 0x7f5334062230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f532c009e90 tx=0x7f532c009780).ready entity=mon.2 client_cookie=6e302d2f010dd5db server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5332000700 1 -- 172.21.15.49:0/3735300646 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c00e070 con 0x7f53340691b0 2024-01-22T05:12:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5332000700 1 -- 172.21.15.49:0/3735300646 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c00bab0 con 0x7f53340691b0 2024-01-22T05:12:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5332000700 1 -- 172.21.15.49:0/3735300646 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c00be30 con 0x7f53340691b0 2024-01-22T05:12:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5338c00700 1 -- 172.21.15.49:0/3735300646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53340691b0 msgr2=0x7f5334062230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5338c00700 1 --2- 172.21.15.49:0/3735300646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53340691b0 0x7f5334062230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f532c009e90 tx=0x7f532c009780).stop 2024-01-22T05:12:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5338c00700 1 -- 172.21.15.49:0/3735300646 shutdown_connections 2024-01-22T05:12:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5338c00700 1 --2- 172.21.15.49:0/3735300646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53340691b0 0x7f5334062230 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.522+0000 7f5338c00700 1 -- 172.21.15.49:0/3735300646 >> 172.21.15.49:0/3735300646 conn(0x7f53340c4370 msgr2=0x7f5334065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.526+0000 7f5338c00700 1 -- 172.21.15.49:0/3735300646 shutdown_connections 2024-01-22T05:12:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.526+0000 7f5338c00700 1 -- 172.21.15.49:0/3735300646 wait complete. 2024-01-22T05:12:22.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.526+0000 7f5338c00700 1 Processor -- start 2024-01-22T05:12:22.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.526+0000 7f5338c00700 1 -- start start 2024-01-22T05:12:22.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5338c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53340691b0 0x7f53340a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5338c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53340bc060 0x7f5334147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5338c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53340bd870 0x7f53340a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5338c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5334147e20 con 0x7f53340bd870 2024-01-22T05:12:22.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5338c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53340a6610 con 0x7f53340bc060 2024-01-22T05:12:22.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5338c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53340a5a00 con 0x7f53340691b0 2024-01-22T05:12:22.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5333e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53340bd870 0x7f53340a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5333e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53340bd870 0x7f53340a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44564/0 (socket says 172.21.15.49:44564) 2024-01-22T05:12:22.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5333e00700 1 -- 172.21.15.49:0/2023449534 learned_addr learned my addr 172.21.15.49:0/2023449534 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:22.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5332a00700 1 --2- 172.21.15.49:0/2023449534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53340bc060 0x7f5334147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5333400700 1 --2- 172.21.15.49:0/2023449534 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53340691b0 0x7f53340a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5333e00700 1 -- 172.21.15.49:0/2023449534 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53340691b0 msgr2=0x7f53340a6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5333e00700 1 --2- 172.21.15.49:0/2023449534 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53340691b0 0x7f53340a6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5333e00700 1 -- 172.21.15.49:0/2023449534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53340bc060 msgr2=0x7f5334147930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5333e00700 1 --2- 172.21.15.49:0/2023449534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53340bc060 0x7f5334147930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5333e00700 1 -- 172.21.15.49:0/2023449534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c009a20 con 0x7f53340bd870 2024-01-22T05:12:22.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5333e00700 1 --2- 172.21.15.49:0/2023449534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53340bd870 0x7f53340a51b0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f5334067840 tx=0x7f5334064a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:22.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f532aa00700 1 -- 172.21.15.49:0/2023449534 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c013e40 con 0x7f53340bd870 2024-01-22T05:12:22.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f532aa00700 1 -- 172.21.15.49:0/2023449534 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c01d630 con 0x7f53340bd870 2024-01-22T05:12:22.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5338c00700 1 -- 172.21.15.49:0/2023449534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53340a5ce0 con 0x7f53340bd870 2024-01-22T05:12:22.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f532aa00700 1 -- 172.21.15.49:0/2023449534 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c01d9f0 con 0x7f53340bd870 2024-01-22T05:12:22.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.530+0000 7f5338c00700 1 -- 172.21.15.49:0/2023449534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53340a62a0 con 0x7f53340bd870 2024-01-22T05:12:22.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.534+0000 7f5338c00700 1 -- 172.21.15.49:0/2023449534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53340a6750 con 0x7f53340bd870 2024-01-22T05:12:22.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.534+0000 7f532aa00700 1 -- 172.21.15.49:0/2023449534 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f532c003040 con 0x7f53340bd870 2024-01-22T05:12:22.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.534+0000 7f532aa00700 1 --2- 172.21.15.49:0/2023449534 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f530c05a510 0x7f530c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.538+0000 7f532aa00700 1 -- 172.21.15.49:0/2023449534 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f532c076480 con 0x7f53340bd870 2024-01-22T05:12:22.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.538+0000 7f5333400700 1 --2- 172.21.15.49:0/2023449534 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f530c05a510 0x7f530c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.538+0000 7f5333400700 1 --2- 172.21.15.49:0/2023449534 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f530c05a510 0x7f530c05c9d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f5324003930 tx=0x7f5324007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:22.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.542+0000 7f532aa00700 1 -- 172.21.15.49:0/2023449534 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f532c049d90 con 0x7f53340bd870 2024-01-22T05:12:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.710+0000 7f5338c00700 1 -- 172.21.15.49:0/2023449534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f53340bd160 con 0x7f53340bd870 2024-01-22T05:12:22.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.710+0000 7f532aa00700 1 -- 172.21.15.49:0/2023449534 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v100) v1 ==== 110+0+10 (secure 0 0 0) 0x7f532c04d3b0 con 0x7f53340bd870 2024-01-22T05:12:22.714 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:12:22.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.714+0000 7f5338c00700 1 -- 172.21.15.49:0/2023449534 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f530c05a510 msgr2=0x7f530c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.714+0000 7f5338c00700 1 --2- 172.21.15.49:0/2023449534 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f530c05a510 0x7f530c05c9d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f5324003930 tx=0x7f5324007bd0).stop 2024-01-22T05:12:22.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.714+0000 7f5338c00700 1 -- 172.21.15.49:0/2023449534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53340bd870 msgr2=0x7f53340a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.714+0000 7f5338c00700 1 --2- 172.21.15.49:0/2023449534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53340bd870 0x7f53340a51b0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f5334067840 tx=0x7f5334064a80).stop 2024-01-22T05:12:22.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.714+0000 7f5338c00700 1 -- 172.21.15.49:0/2023449534 shutdown_connections 2024-01-22T05:12:22.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.714+0000 7f5338c00700 1 --2- 172.21.15.49:0/2023449534 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f530c05a510 0x7f530c05c9d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.714+0000 7f5338c00700 1 --2- 172.21.15.49:0/2023449534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53340bd870 0x7f53340a51b0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.714+0000 7f5338c00700 1 --2- 172.21.15.49:0/2023449534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53340bc060 0x7f5334147930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.714+0000 7f5338c00700 1 --2- 172.21.15.49:0/2023449534 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53340691b0 0x7f53340a6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.714+0000 7f5338c00700 1 -- 172.21.15.49:0/2023449534 >> 172.21.15.49:0/2023449534 conn(0x7f53340c4370 msgr2=0x7f53340c62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:22.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.714+0000 7f5338c00700 1 -- 172.21.15.49:0/2023449534 shutdown_connections 2024-01-22T05:12:22.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.714+0000 7f5338c00700 1 -- 172.21.15.49:0/2023449534 wait complete. 2024-01-22T05:12:22.742 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:12:22.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.902+0000 7f166ea00700 1 Processor -- start 2024-01-22T05:12:22.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.906+0000 7f166ea00700 1 -- start start 2024-01-22T05:12:22.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f166ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1668069580 0x7f1668069960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f166ea00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f16680ac750 0x7f16680acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f166ea00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16680a6fd0 con 0x7f16681543d0 2024-01-22T05:12:22.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f166ea00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16680c5640 con 0x7f16680ac750 2024-01-22T05:12:22.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f166ea00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1668154170 con 0x7f1668069580 2024-01-22T05:12:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f166ca00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f16681543d0 0x7f1668154880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:56554/0 (socket says 172.21.15.49:56554) 2024-01-22T05:12:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f166ca00700 1 -- 172.21.15.49:0/3307195705 learned_addr learned my addr 172.21.15.49:0/3307195705 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1667400700 1 --2- 172.21.15.49:0/3307195705 >> v2:172.21.15.110:3300/0 conn(0x7f16680ac750 0x7f16680acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1667e00700 1 --2- 172.21.15.49:0/3307195705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1668069580 0x7f1668069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 -- 172.21.15.49:0/3307195705 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130771667 0 0) 0x7f16680a6fd0 con 0x7f16681543d0 2024-01-22T05:12:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 -- 172.21.15.49:0/3307195705 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16480033f0 con 0x7f16681543d0 2024-01-22T05:12:22.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 -- 172.21.15.49:0/3307195705 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3209181799 0 0) 0x7f16480033f0 con 0x7f16681543d0 2024-01-22T05:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 -- 172.21.15.49:0/3307195705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1668069580 msgr2=0x7f1668069960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 --2- 172.21.15.49:0/3307195705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1668069580 0x7f1668069960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 -- 172.21.15.49:0/3307195705 >> v2:172.21.15.110:3300/0 conn(0x7f16680ac750 msgr2=0x7f16680acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 --2- 172.21.15.49:0/3307195705 >> v2:172.21.15.110:3300/0 conn(0x7f16680ac750 0x7f16680acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 -- 172.21.15.49:0/3307195705 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16680ad0a0 con 0x7f16681543d0 2024-01-22T05:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 -- 172.21.15.49:0/3307195705 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f16600017f0 con 0x7f16681543d0 2024-01-22T05:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 -- 172.21.15.49:0/3307195705 >> v1:172.21.15.49:6789/0 conn(0x7f16681543d0 legacy=0x7f1668154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 --2- 172.21.15.49:0/3307195705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1668069580 0x7f16480038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 --2- 172.21.15.49:0/3307195705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1648003e10 0x7f1648004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 --2- 172.21.15.49:0/3307195705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1648004b80 0x7f1648005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 -- 172.21.15.49:0/3307195705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16680c5640 con 0x7f1648004b80 2024-01-22T05:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 -- 172.21.15.49:0/3307195705 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1668154170 con 0x7f1648003e10 2024-01-22T05:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1666a00700 1 -- 172.21.15.49:0/3307195705 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164800b8e0 con 0x7f1668069580 2024-01-22T05:12:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1667400700 1 --2- 172.21.15.49:0/3307195705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1648003e10 0x7f1648004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f166ca00700 1 --2- 172.21.15.49:0/3307195705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1648004b80 0x7f1648005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1667e00700 1 --2- 172.21.15.49:0/3307195705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1668069580 0x7f16480038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1667400700 1 -- 172.21.15.49:0/3307195705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1668069580 msgr2=0x7f16480038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1667400700 1 --2- 172.21.15.49:0/3307195705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1668069580 0x7f16480038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1667400700 1 -- 172.21.15.49:0/3307195705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1648004b80 msgr2=0x7f1648005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1667400700 1 --2- 172.21.15.49:0/3307195705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1648004b80 0x7f1648005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1667400700 1 -- 172.21.15.49:0/3307195705 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480033f0 con 0x7f1648003e10 2024-01-22T05:12:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.910+0000 7f1667e00700 1 --2- 172.21.15.49:0/3307195705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1668069580 0x7f16480038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.914+0000 7f1667400700 1 --2- 172.21.15.49:0/3307195705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1648003e10 0x7f1648004690 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f1668066d70 tx=0x7f1650006f40).ready entity=mon.1 client_cookie=8d21061fb1b03fe9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.914+0000 7f1666a00700 1 -- 172.21.15.49:0/3307195705 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650009430 con 0x7f1648003e10 2024-01-22T05:12:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.914+0000 7f1666a00700 1 -- 172.21.15.49:0/3307195705 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165000e610 con 0x7f1648003e10 2024-01-22T05:12:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.914+0000 7f1666a00700 1 -- 172.21.15.49:0/3307195705 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165000e990 con 0x7f1648003e10 2024-01-22T05:12:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.914+0000 7f166ea00700 1 -- 172.21.15.49:0/3307195705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1648003e10 msgr2=0x7f1648004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.914+0000 7f166ea00700 1 --2- 172.21.15.49:0/3307195705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1648003e10 0x7f1648004690 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f1668066d70 tx=0x7f1650006f40).stop 2024-01-22T05:12:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.914+0000 7f166ca00700 1 -- 172.21.15.49:0/3307195705 reap_dead start 2024-01-22T05:12:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.914+0000 7f166ea00700 1 -- 172.21.15.49:0/3307195705 shutdown_connections 2024-01-22T05:12:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.914+0000 7f166ea00700 1 -- 172.21.15.49:0/3307195705 >> 172.21.15.49:0/3307195705 conn(0x7f16680aa700 msgr2=0x7f16680aab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.914+0000 7f166ea00700 1 -- 172.21.15.49:0/3307195705 shutdown_connections 2024-01-22T05:12:22.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.914+0000 7f166ea00700 1 -- 172.21.15.49:0/3307195705 wait complete. 2024-01-22T05:12:22.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.918+0000 7f166ea00700 1 Processor -- start 2024-01-22T05:12:22.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.918+0000 7f166ea00700 1 -- start start 2024-01-22T05:12:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.918+0000 7f166ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1648003e10 0x7f1668136010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.918+0000 7f166ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f166814c690 0x7f16680a8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.918+0000 7f166ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1668064430 0x7f16680a8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.918+0000 7f166ea00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16680a9150 con 0x7f1648003e10 2024-01-22T05:12:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.918+0000 7f166ea00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166814b560 con 0x7f1668064430 2024-01-22T05:12:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.918+0000 7f166ea00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166814b800 con 0x7f166814c690 2024-01-22T05:12:22.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f1667e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1648003e10 0x7f1668136010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f1667e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1648003e10 0x7f1668136010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44594/0 (socket says 172.21.15.49:44594) 2024-01-22T05:12:22.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f1667e00700 1 -- 172.21.15.49:0/1513810892 learned_addr learned my addr 172.21.15.49:0/1513810892 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:22.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f1667400700 1 --2- 172.21.15.49:0/1513810892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f166814c690 0x7f16680a8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f166ca00700 1 --2- 172.21.15.49:0/1513810892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1668064430 0x7f16680a8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f1667e00700 1 -- 172.21.15.49:0/1513810892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f166814c690 msgr2=0x7f16680a8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f1667e00700 1 --2- 172.21.15.49:0/1513810892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f166814c690 0x7f16680a8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f1667e00700 1 -- 172.21.15.49:0/1513810892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1668064430 msgr2=0x7f16680a8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:22.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f1667e00700 1 --2- 172.21.15.49:0/1513810892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1668064430 0x7f16680a8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:22.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f1667e00700 1 -- 172.21.15.49:0/1513810892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166814bae0 con 0x7f1648003e10 2024-01-22T05:12:22.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f1667400700 1 --2- 172.21.15.49:0/1513810892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f166814c690 0x7f16680a8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:22.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f1667e00700 1 --2- 172.21.15.49:0/1513810892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1648003e10 0x7f1668136010 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f1658011960 tx=0x7f1658008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:22.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f165f400700 1 -- 172.21.15.49:0/1513810892 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165800f6d0 con 0x7f1648003e10 2024-01-22T05:12:22.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f165f400700 1 -- 172.21.15.49:0/1513810892 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165800f830 con 0x7f1648003e10 2024-01-22T05:12:22.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f166ea00700 1 -- 172.21.15.49:0/1513810892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166814bdc0 con 0x7f1648003e10 2024-01-22T05:12:22.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f165f400700 1 -- 172.21.15.49:0/1513810892 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165800fbb0 con 0x7f1648003e10 2024-01-22T05:12:22.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f166ea00700 1 -- 172.21.15.49:0/1513810892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16680a83a0 con 0x7f1648003e10 2024-01-22T05:12:22.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.922+0000 7f166ea00700 1 -- 172.21.15.49:0/1513810892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1668064990 con 0x7f1648003e10 2024-01-22T05:12:22.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.926+0000 7f165f400700 1 -- 172.21.15.49:0/1513810892 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1658015480 con 0x7f1648003e10 2024-01-22T05:12:22.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.926+0000 7f165f400700 1 --2- 172.21.15.49:0/1513810892 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f164005a540 0x7f164005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:22.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.926+0000 7f165f400700 1 -- 172.21.15.49:0/1513810892 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f1658074bd0 con 0x7f1648003e10 2024-01-22T05:12:22.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.926+0000 7f1667400700 1 --2- 172.21.15.49:0/1513810892 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f164005a540 0x7f164005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:22.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.926+0000 7f1667400700 1 --2- 172.21.15.49:0/1513810892 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f164005a540 0x7f164005ca00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f1668062c80 tx=0x7f1650019000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:22.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:22.934+0000 7f165f400700 1 -- 172.21.15.49:0/1513810892 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1658048480 con 0x7f1648003e10 2024-01-22T05:12:23.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.090+0000 7f166ea00700 1 -- 172.21.15.49:0/1513810892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1668046800 con 0x7f1648003e10 2024-01-22T05:12:23.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.094+0000 7f165f400700 1 -- 172.21.15.49:0/1513810892 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v100) v1 ==== 92+0+10 (secure 0 0 0) 0x7f165804baa0 con 0x7f1648003e10 2024-01-22T05:12:23.096 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:12:23.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.094+0000 7f166ea00700 1 -- 172.21.15.49:0/1513810892 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f164005a540 msgr2=0x7f164005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:23.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.094+0000 7f166ea00700 1 --2- 172.21.15.49:0/1513810892 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f164005a540 0x7f164005ca00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f1668062c80 tx=0x7f1650019000).stop 2024-01-22T05:12:23.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.094+0000 7f166ea00700 1 -- 172.21.15.49:0/1513810892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1648003e10 msgr2=0x7f1668136010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:23.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.094+0000 7f166ea00700 1 --2- 172.21.15.49:0/1513810892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1648003e10 0x7f1668136010 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f1658011960 tx=0x7f1658008040).stop 2024-01-22T05:12:23.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.094+0000 7f166ea00700 1 -- 172.21.15.49:0/1513810892 shutdown_connections 2024-01-22T05:12:23.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.094+0000 7f166ea00700 1 --2- 172.21.15.49:0/1513810892 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f164005a540 0x7f164005ca00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.094+0000 7f166ea00700 1 --2- 172.21.15.49:0/1513810892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1668064430 0x7f16680a8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.094+0000 7f166ea00700 1 --2- 172.21.15.49:0/1513810892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f166814c690 0x7f16680a8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.094+0000 7f166ea00700 1 --2- 172.21.15.49:0/1513810892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1648003e10 0x7f1668136010 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.094+0000 7f166ea00700 1 -- 172.21.15.49:0/1513810892 >> 172.21.15.49:0/1513810892 conn(0x7f16680aa700 msgr2=0x7f1668153200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:23.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.094+0000 7f166ea00700 1 -- 172.21.15.49:0/1513810892 shutdown_connections 2024-01-22T05:12:23.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.098+0000 7f166ea00700 1 -- 172.21.15.49:0/1513810892 wait complete. 2024-01-22T05:12:23.124 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:12:23.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.282+0000 7fba04e00700 1 Processor -- start 2024-01-22T05:12:23.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.282+0000 7fba04e00700 1 -- start start 2024-01-22T05:12:23.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fba04e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fba001554b0 0x7fba00063470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:23.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fba04e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba000bc470 0x7fba000bc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:23.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fba04e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba00068b10 0x7fba00068fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:23.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fba04e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba00062fe0 con 0x7fba001554b0 2024-01-22T05:12:23.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fba04e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba00069490 con 0x7fba00068b10 2024-01-22T05:12:23.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fba04e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba000bcdc0 con 0x7fba000bc470 2024-01-22T05:12:23.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fb9fde00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fba001554b0 0x7fba00063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:23.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fb9fd400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba000bc470 0x7fba000bc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:23.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fb9fde00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fba001554b0 0x7fba00063470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60320/0 (socket says 172.21.15.49:60320) 2024-01-22T05:12:23.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fb9fe800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba00068b10 0x7fba00068fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:23.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fb9fde00700 1 -- 172.21.15.49:0/2089097277 learned_addr learned my addr 172.21.15.49:0/2089097277 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:23.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fb9fd400700 1 -- 172.21.15.49:0/2089097277 >> v2:172.21.15.110:3300/0 conn(0x7fba00068b10 msgr2=0x7fba00068fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:23.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fb9fd400700 1 --2- 172.21.15.49:0/2089097277 >> v2:172.21.15.110:3300/0 conn(0x7fba00068b10 0x7fba00068fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fb9fd400700 1 -- 172.21.15.49:0/2089097277 >> v2:172.21.15.49:3300/0 conn(0x7fba001554b0 msgr2=0x7fba00063470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:23.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fb9fd400700 1 --2- 172.21.15.49:0/2089097277 >> v2:172.21.15.49:3300/0 conn(0x7fba001554b0 0x7fba00063470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fb9fd400700 1 -- 172.21.15.49:0/2089097277 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba000623d0 con 0x7fba000bc470 2024-01-22T05:12:23.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.286+0000 7fb9fe800700 1 --2- 172.21.15.49:0/2089097277 >> v2:172.21.15.110:3300/0 conn(0x7fba00068b10 0x7fba00068fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:12:23.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.290+0000 7fb9fd400700 1 --2- 172.21.15.49:0/2089097277 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba000bc470 0x7fba000bc8d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fba00060350 tx=0x7fb9e8009060).ready entity=mon.2 client_cookie=96f2822abab807cf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:23.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.290+0000 7fb9fca00700 1 -- 172.21.15.49:0/2089097277 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e800d4a0 con 0x7fba000bc470 2024-01-22T05:12:23.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.290+0000 7fb9fca00700 1 -- 172.21.15.49:0/2089097277 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e800d600 con 0x7fba000bc470 2024-01-22T05:12:23.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.290+0000 7fb9fca00700 1 -- 172.21.15.49:0/2089097277 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e800d980 con 0x7fba000bc470 2024-01-22T05:12:23.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.290+0000 7fba04e00700 1 -- 172.21.15.49:0/2089097277 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba000bc470 msgr2=0x7fba000bc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:23.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.290+0000 7fba04e00700 1 --2- 172.21.15.49:0/2089097277 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba000bc470 0x7fba000bc8d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fba00060350 tx=0x7fb9e8009060).stop 2024-01-22T05:12:23.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.290+0000 7fba04e00700 1 -- 172.21.15.49:0/2089097277 shutdown_connections 2024-01-22T05:12:23.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.290+0000 7fba04e00700 1 --2- 172.21.15.49:0/2089097277 >> v2:172.21.15.110:3300/0 conn(0x7fba00068b10 0x7fba00068fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.290+0000 7fba04e00700 1 --2- 172.21.15.49:0/2089097277 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba000bc470 0x7fba000bc8d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.290+0000 7fba04e00700 1 --2- 172.21.15.49:0/2089097277 >> v2:172.21.15.49:3300/0 conn(0x7fba001554b0 0x7fba00063470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.290+0000 7fba04e00700 1 -- 172.21.15.49:0/2089097277 >> 172.21.15.49:0/2089097277 conn(0x7fba000c4300 msgr2=0x7fba00065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:23.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.290+0000 7fba04e00700 1 -- 172.21.15.49:0/2089097277 shutdown_connections 2024-01-22T05:12:23.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.290+0000 7fba04e00700 1 -- 172.21.15.49:0/2089097277 wait complete. 2024-01-22T05:12:23.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.294+0000 7fba04e00700 1 Processor -- start 2024-01-22T05:12:23.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.294+0000 7fba04e00700 1 -- start start 2024-01-22T05:12:23.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.294+0000 7fba04e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba00068b10 0x7fba001651e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:23.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.294+0000 7fba04e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba000bc470 0x7fba001475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fba04e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba001554b0 0x7fba000a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fba04e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba000a38b0 con 0x7fba00068b10 2024-01-22T05:12:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fba04e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba000a4710 con 0x7fba000bc470 2024-01-22T05:12:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fba04e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba000a4ba0 con 0x7fba001554b0 2024-01-22T05:12:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fb9fde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba00068b10 0x7fba001651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fb9fde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba00068b10 0x7fba001651e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60326/0 (socket says 172.21.15.49:60326) 2024-01-22T05:12:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fb9fde00700 1 -- 172.21.15.49:0/2063875002 learned_addr learned my addr 172.21.15.49:0/2063875002 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fb9fd400700 1 --2- 172.21.15.49:0/2063875002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba000bc470 0x7fba001475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fb9fe800700 1 --2- 172.21.15.49:0/2063875002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba001554b0 0x7fba000a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fb9fde00700 1 -- 172.21.15.49:0/2063875002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba001554b0 msgr2=0x7fba000a5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fb9fde00700 1 --2- 172.21.15.49:0/2063875002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba001554b0 0x7fba000a5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fb9fde00700 1 -- 172.21.15.49:0/2063875002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba000bc470 msgr2=0x7fba001475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fb9fde00700 1 --2- 172.21.15.49:0/2063875002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba000bc470 0x7fba001475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fb9fde00700 1 -- 172.21.15.49:0/2063875002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f8009a20 con 0x7fba00068b10 2024-01-22T05:12:23.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fb9fe800700 1 --2- 172.21.15.49:0/2063875002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba001554b0 0x7fba000a5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:23.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fb9fde00700 1 --2- 172.21.15.49:0/2063875002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba00068b10 0x7fba001651e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7fb9f000e930 tx=0x7fb9f00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:23.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fb9f5600700 1 -- 172.21.15.49:0/2063875002 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0012600 con 0x7fba00068b10 2024-01-22T05:12:23.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fb9f5600700 1 -- 172.21.15.49:0/2063875002 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f0012760 con 0x7fba00068b10 2024-01-22T05:12:23.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fba04e00700 1 -- 172.21.15.49:0/2063875002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e80092a0 con 0x7fba00068b10 2024-01-22T05:12:23.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fb9f5600700 1 -- 172.21.15.49:0/2063875002 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0012ae0 con 0x7fba00068b10 2024-01-22T05:12:23.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.298+0000 7fba04e00700 1 -- 172.21.15.49:0/2063875002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba000a3de0 con 0x7fba00068b10 2024-01-22T05:12:23.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.302+0000 7fba04e00700 1 -- 172.21.15.49:0/2063875002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba00064b90 con 0x7fba00068b10 2024-01-22T05:12:23.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.302+0000 7fb9f5600700 1 -- 172.21.15.49:0/2063875002 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb9f001b400 con 0x7fba00068b10 2024-01-22T05:12:23.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.302+0000 7fb9f5600700 1 --2- 172.21.15.49:0/2063875002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9d805a540 0x7fb9d805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:23.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.302+0000 7fb9f5600700 1 -- 172.21.15.49:0/2063875002 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fb9f0074a20 con 0x7fba00068b10 2024-01-22T05:12:23.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.302+0000 7fb9fd400700 1 --2- 172.21.15.49:0/2063875002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9d805a540 0x7fb9d805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:23.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.306+0000 7fb9fd400700 1 --2- 172.21.15.49:0/2063875002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9d805a540 0x7fb9d805ca00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fb9e8009fd0 tx=0x7fb9e8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:23.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.310+0000 7fb9f5600700 1 -- 172.21.15.49:0/2063875002 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb9f0048390 con 0x7fba00068b10 2024-01-22T05:12:23.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.478+0000 7fba04e00700 1 -- 172.21.15.49:0/2063875002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fba000a6720 con 0x7fba00068b10 2024-01-22T05:12:23.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.478+0000 7fb9f5600700 1 -- 172.21.15.49:0/2063875002 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v100) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb9f004b9b0 con 0x7fba00068b10 2024-01-22T05:12:23.483 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:23.483 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-22T05:12:23.483 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:23.483 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-01-22T05:12:23.483 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2024-01-22T05:12:23.483 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:12:23.483 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:12:23.483 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2024-01-22T05:12:23.484 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2024-01-22T05:12:23.484 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:12:23.484 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-22T05:12:23.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.486+0000 7fba04e00700 1 -- 172.21.15.49:0/2063875002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9d805a540 msgr2=0x7fb9d805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:23.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.486+0000 7fba04e00700 1 --2- 172.21.15.49:0/2063875002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9d805a540 0x7fb9d805ca00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fb9e8009fd0 tx=0x7fb9e8016000).stop 2024-01-22T05:12:23.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.486+0000 7fba04e00700 1 -- 172.21.15.49:0/2063875002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba00068b10 msgr2=0x7fba001651e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:23.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.486+0000 7fba04e00700 1 --2- 172.21.15.49:0/2063875002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba00068b10 0x7fba001651e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7fb9f000e930 tx=0x7fb9f00090f0).stop 2024-01-22T05:12:23.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.486+0000 7fba04e00700 1 -- 172.21.15.49:0/2063875002 shutdown_connections 2024-01-22T05:12:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.486+0000 7fba04e00700 1 --2- 172.21.15.49:0/2063875002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9d805a540 0x7fb9d805ca00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.486+0000 7fba04e00700 1 --2- 172.21.15.49:0/2063875002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba001554b0 0x7fba000a5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.486+0000 7fba04e00700 1 --2- 172.21.15.49:0/2063875002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba000bc470 0x7fba001475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.486+0000 7fba04e00700 1 --2- 172.21.15.49:0/2063875002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba00068b10 0x7fba001651e0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.486+0000 7fba04e00700 1 -- 172.21.15.49:0/2063875002 >> 172.21.15.49:0/2063875002 conn(0x7fba000c4300 msgr2=0x7fba000a7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.486+0000 7fba04e00700 1 -- 172.21.15.49:0/2063875002 shutdown_connections 2024-01-22T05:12:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.486+0000 7fba04e00700 1 -- 172.21.15.49:0/2063875002 wait complete. 2024-01-22T05:12:23.511 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:12:23.512 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:12:23.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.678+0000 7f2a88200700 1 Processor -- start 2024-01-22T05:12:23.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.682+0000 7f2a88200700 1 -- start start 2024-01-22T05:12:23.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.682+0000 7f2a88200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2a800ac3b0 0x7f2a80159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:23.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.682+0000 7f2a88200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a80066690 0x7f2a80066af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:23.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.682+0000 7f2a88200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2a80067a90 0x7f2a80067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:23.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.682+0000 7f2a88200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a800a7cb0 con 0x7f2a80067a90 2024-01-22T05:12:23.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.682+0000 7f2a88200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a800a8b10 con 0x7f2a800ac3b0 2024-01-22T05:12:23.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.682+0000 7f2a88200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800a7f00 con 0x7f2a80066690 2024-01-22T05:12:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.682+0000 7f2a85800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2a800ac3b0 0x7f2a80159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.682+0000 7f2a86200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2a80067a90 0x7f2a80067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.682+0000 7f2a85800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2a800ac3b0 0x7f2a80159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:39320/0 (socket says 172.21.15.49:39320) 2024-01-22T05:12:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.682+0000 7f2a85800700 1 -- 172.21.15.49:0/4249407670 learned_addr learned my addr 172.21.15.49:0/4249407670 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.682+0000 7f2a84e00700 1 --2- 172.21.15.49:0/4249407670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a80066690 0x7f2a80066af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.682+0000 7f2a85800700 1 -- 172.21.15.49:0/4249407670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a80066690 msgr2=0x7f2a80066af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.682+0000 7f2a85800700 1 --2- 172.21.15.49:0/4249407670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a80066690 0x7f2a80066af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a85800700 1 -- 172.21.15.49:0/4249407670 >> v2:172.21.15.49:3300/0 conn(0x7f2a80067a90 msgr2=0x7f2a80067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a85800700 1 --2- 172.21.15.49:0/4249407670 >> v2:172.21.15.49:3300/0 conn(0x7f2a80067a90 0x7f2a80067ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a85800700 1 -- 172.21.15.49:0/4249407670 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a800a81e0 con 0x7f2a800ac3b0 2024-01-22T05:12:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a85800700 1 --2- 172.21.15.49:0/4249407670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a800ac3b0 0x7f2a80159000 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f2a800642d0 tx=0x7f2a700090f0).ready entity=mon.1 client_cookie=bf6ff3091fbceece server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a7fe00700 1 -- 172.21.15.49:0/4249407670 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7000f510 con 0x7f2a800ac3b0 2024-01-22T05:12:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a7fe00700 1 -- 172.21.15.49:0/4249407670 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7000f670 con 0x7f2a800ac3b0 2024-01-22T05:12:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a7fe00700 1 -- 172.21.15.49:0/4249407670 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7000fa10 con 0x7f2a800ac3b0 2024-01-22T05:12:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a88200700 1 -- 172.21.15.49:0/4249407670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a800ac3b0 msgr2=0x7f2a80159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a88200700 1 --2- 172.21.15.49:0/4249407670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a800ac3b0 0x7f2a80159000 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f2a800642d0 tx=0x7f2a700090f0).stop 2024-01-22T05:12:23.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a88200700 1 -- 172.21.15.49:0/4249407670 shutdown_connections 2024-01-22T05:12:23.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a88200700 1 --2- 172.21.15.49:0/4249407670 >> v2:172.21.15.49:3300/0 conn(0x7f2a80067a90 0x7f2a80067ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a88200700 1 --2- 172.21.15.49:0/4249407670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a80066690 0x7f2a80066af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a88200700 1 --2- 172.21.15.49:0/4249407670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a800ac3b0 0x7f2a80159000 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a88200700 1 -- 172.21.15.49:0/4249407670 >> 172.21.15.49:0/4249407670 conn(0x7f2a800c6500 msgr2=0x7f2a800c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:23.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a88200700 1 -- 172.21.15.49:0/4249407670 shutdown_connections 2024-01-22T05:12:23.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.686+0000 7f2a88200700 1 -- 172.21.15.49:0/4249407670 wait complete. 2024-01-22T05:12:23.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.690+0000 7f2a88200700 1 Processor -- start 2024-01-22T05:12:23.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.690+0000 7f2a88200700 1 -- start start 2024-01-22T05:12:23.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a88200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a80066690 0x7f2a800bfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:23.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a88200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a80067a90 0x7f2a80168a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:23.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a88200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a800ac3b0 0x7f2a80168f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:23.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a88200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a80169aa0 con 0x7f2a80067a90 2024-01-22T05:12:23.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a88200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a801589c0 con 0x7f2a80066690 2024-01-22T05:12:23.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a88200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a801694e0 con 0x7f2a800ac3b0 2024-01-22T05:12:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a84e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a80067a90 0x7f2a80168a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a84e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a80067a90 0x7f2a80168a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60340/0 (socket says 172.21.15.49:60340) 2024-01-22T05:12:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a84e00700 1 -- 172.21.15.49:0/728336643 learned_addr learned my addr 172.21.15.49:0/728336643 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a86200700 1 --2- 172.21.15.49:0/728336643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a800ac3b0 0x7f2a80168f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a85800700 1 --2- 172.21.15.49:0/728336643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a80066690 0x7f2a800bfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a84e00700 1 -- 172.21.15.49:0/728336643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a800ac3b0 msgr2=0x7f2a80168f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a84e00700 1 --2- 172.21.15.49:0/728336643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a800ac3b0 0x7f2a80168f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a84e00700 1 -- 172.21.15.49:0/728336643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a80066690 msgr2=0x7f2a800bfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:23.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a84e00700 1 --2- 172.21.15.49:0/728336643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a80066690 0x7f2a800bfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:23.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a84e00700 1 -- 172.21.15.49:0/728336643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a70009370 con 0x7f2a80067a90 2024-01-22T05:12:23.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a86200700 1 --2- 172.21.15.49:0/728336643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a800ac3b0 0x7f2a80168f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:23.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a84e00700 1 --2- 172.21.15.49:0/728336643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a80067a90 0x7f2a80168a10 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f2a6800e980 tx=0x7f2a68009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:23.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a7cc00700 1 -- 172.21.15.49:0/728336643 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800ee70 con 0x7f2a80067a90 2024-01-22T05:12:23.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a7cc00700 1 -- 172.21.15.49:0/728336643 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6800c850 con 0x7f2a80067a90 2024-01-22T05:12:23.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a88200700 1 -- 172.21.15.49:0/728336643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a801697c0 con 0x7f2a80067a90 2024-01-22T05:12:23.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a7cc00700 1 -- 172.21.15.49:0/728336643 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800cbd0 con 0x7f2a80067a90 2024-01-22T05:12:23.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.694+0000 7f2a88200700 1 -- 172.21.15.49:0/728336643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a800bb500 con 0x7f2a80067a90 2024-01-22T05:12:23.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.698+0000 7f2a7cc00700 1 -- 172.21.15.49:0/728336643 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2a6801b400 con 0x7f2a80067a90 2024-01-22T05:12:23.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.698+0000 7f2a88200700 1 -- 172.21.15.49:0/728336643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a801584b0 con 0x7f2a80067a90 2024-01-22T05:12:23.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.698+0000 7f2a7cc00700 1 --2- 172.21.15.49:0/728336643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2a5805a510 0x7f2a5805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:23.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.698+0000 7f2a7cc00700 1 -- 172.21.15.49:0/728336643 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f2a68074b40 con 0x7f2a80067a90 2024-01-22T05:12:23.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.698+0000 7f2a85800700 1 --2- 172.21.15.49:0/728336643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2a5805a510 0x7f2a5805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.702+0000 7f2a85800700 1 --2- 172.21.15.49:0/728336643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2a5805a510 0x7f2a5805c9d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f2a700091e0 tx=0x7f2a70017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.706+0000 7f2a7cc00700 1 -- 172.21.15.49:0/728336643 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2a801584b0 con 0x7f2a80067a90 2024-01-22T05:12:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:23.870+0000 7f2a88200700 1 -- 172.21.15.49:0/728336643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f2a801584b0 con 0x7f2a80067a90 2024-01-22T05:12:24.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.378+0000 7f2a7cc00700 1 -- 172.21.15.49:0/728336643 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v101) v1 ==== 152+0+0 (secure 0 0 0) 0x7f2a801584b0 con 0x7f2a80067a90 2024-01-22T05:12:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.386+0000 7f2a88200700 1 -- 172.21.15.49:0/728336643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2a5805a510 msgr2=0x7f2a5805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:24.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.386+0000 7f2a88200700 1 --2- 172.21.15.49:0/728336643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2a5805a510 0x7f2a5805c9d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f2a700091e0 tx=0x7f2a70017000).stop 2024-01-22T05:12:24.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.386+0000 7f2a88200700 1 -- 172.21.15.49:0/728336643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a80067a90 msgr2=0x7f2a80168a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:24.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.386+0000 7f2a88200700 1 --2- 172.21.15.49:0/728336643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a80067a90 0x7f2a80168a10 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f2a6800e980 tx=0x7f2a68009060).stop 2024-01-22T05:12:24.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.390+0000 7f2a88200700 1 -- 172.21.15.49:0/728336643 shutdown_connections 2024-01-22T05:12:24.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.390+0000 7f2a88200700 1 --2- 172.21.15.49:0/728336643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2a5805a510 0x7f2a5805c9d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:24.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.390+0000 7f2a88200700 1 --2- 172.21.15.49:0/728336643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a800ac3b0 0x7f2a80168f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:24.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.390+0000 7f2a88200700 1 --2- 172.21.15.49:0/728336643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a80067a90 0x7f2a80168a10 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:24.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.390+0000 7f2a88200700 1 --2- 172.21.15.49:0/728336643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a80066690 0x7f2a800bfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:24.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.390+0000 7f2a88200700 1 -- 172.21.15.49:0/728336643 >> 172.21.15.49:0/728336643 conn(0x7f2a800c6500 msgr2=0x7f2a80066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.390+0000 7f2a88200700 1 -- 172.21.15.49:0/728336643 shutdown_connections 2024-01-22T05:12:24.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.394+0000 7f2a88200700 1 -- 172.21.15.49:0/728336643 wait complete. 2024-01-22T05:12:24.400 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-01-22T05:12:24.417 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:12:24.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.586+0000 7fc4a1e00700 1 Processor -- start 2024-01-22T05:12:24.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.586+0000 7fc4a1e00700 1 -- start start 2024-01-22T05:12:24.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.590+0000 7fc4a1e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc49c062b50 0x7fc49c15b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:24.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.590+0000 7fc4a1e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc49c062fb0 0x7fc49c15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:24.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.590+0000 7fc4a1e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49c0c25c0 con 0x7fc49c063860 2024-01-22T05:12:24.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.590+0000 7fc4a1e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49c0c1a20 con 0x7fc49c062fb0 2024-01-22T05:12:24.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.590+0000 7fc4a1e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c0c1c90 con 0x7fc49c062b50 2024-01-22T05:12:24.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.590+0000 7fc49b400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc49c062fb0 0x7fc49c15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:24.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.590+0000 7fc49aa00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc49c063860 0x7fc49c062440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:56496/0 (socket says 172.21.15.49:56496) 2024-01-22T05:12:24.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.590+0000 7fc49aa00700 1 -- 172.21.15.49:0/1161213357 learned_addr learned my addr 172.21.15.49:0/1161213357 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:24.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.590+0000 7fc49a000700 1 --2- 172.21.15.49:0/1161213357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc49c062b50 0x7fc49c15b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:24.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc499600700 1 -- 172.21.15.49:0/1161213357 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826411775 0 0) 0x7fc49c0c25c0 con 0x7fc49c063860 2024-01-22T05:12:24.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc499600700 1 -- 172.21.15.49:0/1161213357 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc47c0033f0 con 0x7fc49c063860 2024-01-22T05:12:24.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc49a000700 1 -- 172.21.15.49:0/1161213357 >> v2:172.21.15.49:3300/0 conn(0x7fc49c062fb0 msgr2=0x7fc49c15dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:24.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc49a000700 1 --2- 172.21.15.49:0/1161213357 >> v2:172.21.15.49:3300/0 conn(0x7fc49c062fb0 0x7fc49c15dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:24.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc49a000700 1 -- 172.21.15.49:0/1161213357 >> v1:172.21.15.110:6789/0 conn(0x7fc49c063860 legacy=0x7fc49c062440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:24.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc49a000700 1 -- 172.21.15.49:0/1161213357 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c0c1f70 con 0x7fc49c062b50 2024-01-22T05:12:24.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc49a000700 1 --2- 172.21.15.49:0/1161213357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc49c062b50 0x7fc49c15b7f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fc484009790 tx=0x7fc484009060).ready entity=mon.2 client_cookie=8fc1b5df2e120e76 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:24.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc499600700 1 -- 172.21.15.49:0/1161213357 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48400d4a0 con 0x7fc49c062b50 2024-01-22T05:12:24.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc499600700 1 -- 172.21.15.49:0/1161213357 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48400d600 con 0x7fc49c062b50 2024-01-22T05:12:24.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc499600700 1 -- 172.21.15.49:0/1161213357 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48400d980 con 0x7fc49c062b50 2024-01-22T05:12:24.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc4a1e00700 1 -- 172.21.15.49:0/1161213357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc49c062b50 msgr2=0x7fc49c15b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:24.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc4a1e00700 1 --2- 172.21.15.49:0/1161213357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc49c062b50 0x7fc49c15b7f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fc484009790 tx=0x7fc484009060).stop 2024-01-22T05:12:24.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc4a1e00700 1 -- 172.21.15.49:0/1161213357 shutdown_connections 2024-01-22T05:12:24.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc4a1e00700 1 --2- 172.21.15.49:0/1161213357 >> v2:172.21.15.49:3300/0 conn(0x7fc49c062fb0 0x7fc49c15dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:24.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc4a1e00700 1 --2- 172.21.15.49:0/1161213357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc49c062b50 0x7fc49c15b7f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:24.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc4a1e00700 1 -- 172.21.15.49:0/1161213357 >> 172.21.15.49:0/1161213357 conn(0x7fc49c0c3940 msgr2=0x7fc49c0c3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:24.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc4a1e00700 1 -- 172.21.15.49:0/1161213357 shutdown_connections 2024-01-22T05:12:24.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.594+0000 7fc4a1e00700 1 -- 172.21.15.49:0/1161213357 wait complete. 2024-01-22T05:12:24.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.598+0000 7fc4a1e00700 1 Processor -- start 2024-01-22T05:12:24.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.598+0000 7fc4a1e00700 1 -- start start 2024-01-22T05:12:24.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.598+0000 7fc4a1e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc49c062b50 0x7fc49c0becd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:24.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.598+0000 7fc4a1e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc49c062fb0 0x7fc49c148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:24.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.598+0000 7fc4a1e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc49c063860 0x7fc49c0bc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:24.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.598+0000 7fc4a1e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c1491a0 con 0x7fc49c062fb0 2024-01-22T05:12:24.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.598+0000 7fc4a1e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c0aacf0 con 0x7fc49c063860 2024-01-22T05:12:24.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.598+0000 7fc4a1e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c0aafd0 con 0x7fc49c062b50 2024-01-22T05:12:24.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc49a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc49c062fb0 0x7fc49c148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:24.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc49a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc49c062fb0 0x7fc49c148cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60358/0 (socket says 172.21.15.49:60358) 2024-01-22T05:12:24.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc49a000700 1 -- 172.21.15.49:0/423286045 learned_addr learned my addr 172.21.15.49:0/423286045 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:24.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc49b400700 1 --2- 172.21.15.49:0/423286045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc49c063860 0x7fc49c0bc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:24.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc49aa00700 1 --2- 172.21.15.49:0/423286045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc49c062b50 0x7fc49c0becd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:24.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc49a000700 1 -- 172.21.15.49:0/423286045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc49c062b50 msgr2=0x7fc49c0becd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:24.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc49a000700 1 --2- 172.21.15.49:0/423286045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc49c062b50 0x7fc49c0becd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:24.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc49a000700 1 -- 172.21.15.49:0/423286045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc49c063860 msgr2=0x7fc49c0bc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:24.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc49a000700 1 --2- 172.21.15.49:0/423286045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc49c063860 0x7fc49c0bc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:24.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc49a000700 1 -- 172.21.15.49:0/423286045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4840092a0 con 0x7fc49c062fb0 2024-01-22T05:12:24.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc49a000700 1 --2- 172.21.15.49:0/423286045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc49c062fb0 0x7fc49c148cb0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fc484009d80 tx=0x7fc484016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:24.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc492000700 1 -- 172.21.15.49:0/423286045 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48400dd30 con 0x7fc49c062fb0 2024-01-22T05:12:24.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc492000700 1 -- 172.21.15.49:0/423286045 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48400de90 con 0x7fc49c062fb0 2024-01-22T05:12:24.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc4a1e00700 1 -- 172.21.15.49:0/423286045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49c0bcff0 con 0x7fc49c062fb0 2024-01-22T05:12:24.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc492000700 1 -- 172.21.15.49:0/423286045 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48400d9c0 con 0x7fc49c062fb0 2024-01-22T05:12:24.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.602+0000 7fc4a1e00700 1 -- 172.21.15.49:0/423286045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49c0bd5b0 con 0x7fc49c062fb0 2024-01-22T05:12:24.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.606+0000 7fc4a1e00700 1 -- 172.21.15.49:0/423286045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49c0651f0 con 0x7fc49c062fb0 2024-01-22T05:12:24.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.606+0000 7fc492000700 1 -- 172.21.15.49:0/423286045 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc4840263b0 con 0x7fc49c062fb0 2024-01-22T05:12:24.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.606+0000 7fc492000700 1 --2- 172.21.15.49:0/423286045 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc47405a510 0x7fc47405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:24.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.606+0000 7fc492000700 1 -- 172.21.15.49:0/423286045 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5992+0+0 (secure 0 0 0) 0x7fc484075610 con 0x7fc49c062fb0 2024-01-22T05:12:24.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.610+0000 7fc49aa00700 1 --2- 172.21.15.49:0/423286045 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc47405a510 0x7fc47405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:24.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.610+0000 7fc49aa00700 1 --2- 172.21.15.49:0/423286045 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc47405a510 0x7fc47405c9d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fc48c007fd0 tx=0x7fc48c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:24.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.614+0000 7fc492000700 1 -- 172.21.15.49:0/423286045 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc484048d50 con 0x7fc49c062fb0 2024-01-22T05:12:24.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:24.782+0000 7fc4a1e00700 1 -- 172.21.15.49:0/423286045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc49c0ab110 con 0x7fc49c062fb0 2024-01-22T05:12:25.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.386+0000 7fc492000700 1 -- 172.21.15.49:0/423286045 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v102) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc484022020 con 0x7fc49c062fb0 2024-01-22T05:12:25.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.394+0000 7fc4a1e00700 1 -- 172.21.15.49:0/423286045 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc47405a510 msgr2=0x7fc47405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:25.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.394+0000 7fc4a1e00700 1 --2- 172.21.15.49:0/423286045 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc47405a510 0x7fc47405c9d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fc48c007fd0 tx=0x7fc48c009040).stop 2024-01-22T05:12:25.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.394+0000 7fc4a1e00700 1 -- 172.21.15.49:0/423286045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc49c062fb0 msgr2=0x7fc49c148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:25.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.394+0000 7fc4a1e00700 1 --2- 172.21.15.49:0/423286045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc49c062fb0 0x7fc49c148cb0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fc484009d80 tx=0x7fc484016000).stop 2024-01-22T05:12:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.398+0000 7fc4a1e00700 1 -- 172.21.15.49:0/423286045 shutdown_connections 2024-01-22T05:12:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.398+0000 7fc4a1e00700 1 --2- 172.21.15.49:0/423286045 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc47405a510 0x7fc47405c9d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.398+0000 7fc4a1e00700 1 --2- 172.21.15.49:0/423286045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc49c063860 0x7fc49c0bc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.398+0000 7fc4a1e00700 1 --2- 172.21.15.49:0/423286045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc49c062fb0 0x7fc49c148cb0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.398+0000 7fc4a1e00700 1 --2- 172.21.15.49:0/423286045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc49c062b50 0x7fc49c0becd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.398+0000 7fc4a1e00700 1 -- 172.21.15.49:0/423286045 >> 172.21.15.49:0/423286045 conn(0x7fc49c0c3940 msgr2=0x7fc49c0a38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:25.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.402+0000 7fc4a1e00700 1 -- 172.21.15.49:0/423286045 shutdown_connections 2024-01-22T05:12:25.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.402+0000 7fc4a1e00700 1 -- 172.21.15.49:0/423286045 wait complete. 2024-01-22T05:12:25.413 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-01-22T05:12:25.440 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:12:25.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.594+0000 7f6df8a00700 1 Processor -- start 2024-01-22T05:12:25.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.598+0000 7f6df8a00700 1 -- start start 2024-01-22T05:12:25.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.598+0000 7f6df8a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6df4153d70 0x7f6df40bc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:25.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.598+0000 7f6df8a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df40bcae0 0x7f6df40c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:25.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df8a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df40c5be0 con 0x7f6df40c6560 2024-01-22T05:12:25.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df8a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df40c7300 con 0x7f6df4153d70 2024-01-22T05:12:25.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df8a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df40c4bb0 con 0x7f6df40bcae0 2024-01-22T05:12:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df2800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6df4153d70 0x7f6df40bc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df3200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6df40c6560 0x7f6df40a43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36128/0 (socket says 172.21.15.49:36128) 2024-01-22T05:12:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df3200700 1 -- 172.21.15.49:0/598801468 learned_addr learned my addr 172.21.15.49:0/598801468 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:25.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df1e00700 1 --2- 172.21.15.49:0/598801468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df40bcae0 0x7f6df40c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df2800700 1 -- 172.21.15.49:0/598801468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df40bcae0 msgr2=0x7f6df40c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df2800700 1 --2- 172.21.15.49:0/598801468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df40bcae0 0x7f6df40c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df2800700 1 -- 172.21.15.49:0/598801468 >> v1:172.21.15.49:6789/0 conn(0x7f6df40c6560 legacy=0x7f6df40a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df1400700 1 -- 172.21.15.49:0/598801468 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021366323 0 0) 0x7f6df40c5be0 con 0x7f6df40c6560 2024-01-22T05:12:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df2800700 1 -- 172.21.15.49:0/598801468 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df40c4e90 con 0x7f6df4153d70 2024-01-22T05:12:25.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df2800700 1 --2- 172.21.15.49:0/598801468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df4153d70 0x7f6df40bc5f0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f6de4009750 tx=0x7f6de4009060).ready entity=mon.0 client_cookie=366a1be486f2b8aa server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df1400700 1 -- 172.21.15.49:0/598801468 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de400f510 con 0x7f6df4153d70 2024-01-22T05:12:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df1400700 1 -- 172.21.15.49:0/598801468 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de400f670 con 0x7f6df4153d70 2024-01-22T05:12:25.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.602+0000 7f6df1400700 1 -- 172.21.15.49:0/598801468 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de400f9f0 con 0x7f6df4153d70 2024-01-22T05:12:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.606+0000 7f6df8a00700 1 -- 172.21.15.49:0/598801468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df4153d70 msgr2=0x7f6df40bc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:25.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.606+0000 7f6df8a00700 1 --2- 172.21.15.49:0/598801468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df4153d70 0x7f6df40bc5f0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f6de4009750 tx=0x7f6de4009060).stop 2024-01-22T05:12:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.606+0000 7f6df8a00700 1 -- 172.21.15.49:0/598801468 shutdown_connections 2024-01-22T05:12:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.606+0000 7f6df8a00700 1 --2- 172.21.15.49:0/598801468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df40bcae0 0x7f6df40c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.606+0000 7f6df8a00700 1 --2- 172.21.15.49:0/598801468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df4153d70 0x7f6df40bc5f0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.606+0000 7f6df8a00700 1 -- 172.21.15.49:0/598801468 >> 172.21.15.49:0/598801468 conn(0x7f6df40c8120 msgr2=0x7f6df40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.606+0000 7f6df8a00700 1 -- 172.21.15.49:0/598801468 shutdown_connections 2024-01-22T05:12:25.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.606+0000 7f6df8a00700 1 -- 172.21.15.49:0/598801468 wait complete. 2024-01-22T05:12:25.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.606+0000 7f6df8a00700 1 Processor -- start 2024-01-22T05:12:25.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.610+0000 7f6df8a00700 1 -- start start 2024-01-22T05:12:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.610+0000 7f6df8a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df40bcae0 0x7f6df41647f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.610+0000 7f6df8a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6df40c6560 0x7f6df4164ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.610+0000 7f6df8a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df4153d70 0x7f6df40be880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.610+0000 7f6df8a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df40bf420 con 0x7f6df4153d70 2024-01-22T05:12:25.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.610+0000 7f6df8a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df4165290 con 0x7f6df40c6560 2024-01-22T05:12:25.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.610+0000 7f6df8a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df4165570 con 0x7f6df40bcae0 2024-01-22T05:12:25.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.610+0000 7f6df3200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df4153d70 0x7f6df40be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:25.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.610+0000 7f6df2800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df40bcae0 0x7f6df41647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:25.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.610+0000 7f6df3200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df4153d70 0x7f6df40be880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60374/0 (socket says 172.21.15.49:60374) 2024-01-22T05:12:25.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.610+0000 7f6df2800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df40bcae0 0x7f6df41647f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:55742/0 (socket says 172.21.15.49:55742) 2024-01-22T05:12:25.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.610+0000 7f6df3200700 1 -- 172.21.15.49:0/818131729 learned_addr learned my addr 172.21.15.49:0/818131729 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.610+0000 7f6df1e00700 1 --2- 172.21.15.49:0/818131729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6df40c6560 0x7f6df4164ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.610+0000 7f6df2800700 1 -- 172.21.15.49:0/818131729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6df40c6560 msgr2=0x7f6df4164ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.610+0000 7f6df2800700 1 --2- 172.21.15.49:0/818131729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6df40c6560 0x7f6df4164ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.614+0000 7f6df2800700 1 -- 172.21.15.49:0/818131729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df4153d70 msgr2=0x7f6df40be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.614+0000 7f6df2800700 1 --2- 172.21.15.49:0/818131729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df4153d70 0x7f6df40be880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:25.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.614+0000 7f6df2800700 1 -- 172.21.15.49:0/818131729 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de4009240 con 0x7f6df40bcae0 2024-01-22T05:12:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.614+0000 7f6df2800700 1 --2- 172.21.15.49:0/818131729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df40bcae0 0x7f6df41647f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f6de4014000 tx=0x7f6de4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.614+0000 7f6dea000700 1 -- 172.21.15.49:0/818131729 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de400f7e0 con 0x7f6df40bcae0 2024-01-22T05:12:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.614+0000 7f6dea000700 1 -- 172.21.15.49:0/818131729 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de400f940 con 0x7f6df40bcae0 2024-01-22T05:12:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.614+0000 7f6dea000700 1 -- 172.21.15.49:0/818131729 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de401b660 con 0x7f6df40bcae0 2024-01-22T05:12:25.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.614+0000 7f6df8a00700 1 -- 172.21.15.49:0/818131729 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df4165850 con 0x7f6df40bcae0 2024-01-22T05:12:25.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.614+0000 7f6df8a00700 1 -- 172.21.15.49:0/818131729 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df40bed70 con 0x7f6df40bcae0 2024-01-22T05:12:25.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.614+0000 7f6df8a00700 1 -- 172.21.15.49:0/818131729 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df40c8500 con 0x7f6df40bcae0 2024-01-22T05:12:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.618+0000 7f6dea000700 1 -- 172.21.15.49:0/818131729 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6de401ba10 con 0x7f6df40bcae0 2024-01-22T05:12:25.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.618+0000 7f6dea000700 1 --2- 172.21.15.49:0/818131729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6dcc05a510 0x7f6dcc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:25.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.618+0000 7f6dea000700 1 -- 172.21.15.49:0/818131729 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f6de4076380 con 0x7f6df40bcae0 2024-01-22T05:12:25.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.618+0000 7f6df1e00700 1 --2- 172.21.15.49:0/818131729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6dcc05a510 0x7f6dcc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:25.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.622+0000 7f6df1e00700 1 --2- 172.21.15.49:0/818131729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6dcc05a510 0x7f6dcc05c9d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f6df40a5300 tx=0x7f6ddc009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:25.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.630+0000 7f6dea000700 1 -- 172.21.15.49:0/818131729 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6de40499a0 con 0x7f6df40bcae0 2024-01-22T05:12:25.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.834+0000 7f6df8a00700 1 -- 172.21.15.49:0/818131729 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6df41656b0 con 0x7f6df40bcae0 2024-01-22T05:12:25.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.854+0000 7f6dea000700 1 -- 172.21.15.49:0/818131729 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v87) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6df41656b0 con 0x7f6df40bcae0 2024-01-22T05:12:25.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.858+0000 7f6df8a00700 1 -- 172.21.15.49:0/818131729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6dcc05a510 msgr2=0x7f6dcc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:25.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.858+0000 7f6df8a00700 1 --2- 172.21.15.49:0/818131729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6dcc05a510 0x7f6dcc05c9d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f6df40a5300 tx=0x7f6ddc009060).stop 2024-01-22T05:12:25.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.858+0000 7f6df8a00700 1 -- 172.21.15.49:0/818131729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df40bcae0 msgr2=0x7f6df41647f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:25.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.858+0000 7f6df8a00700 1 --2- 172.21.15.49:0/818131729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df40bcae0 0x7f6df41647f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f6de4014000 tx=0x7f6de4017000).stop 2024-01-22T05:12:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.866+0000 7f6df8a00700 1 -- 172.21.15.49:0/818131729 shutdown_connections 2024-01-22T05:12:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.866+0000 7f6df8a00700 1 --2- 172.21.15.49:0/818131729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6dcc05a510 0x7f6dcc05c9d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.866+0000 7f6df8a00700 1 --2- 172.21.15.49:0/818131729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df4153d70 0x7f6df40be880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.866+0000 7f6df8a00700 1 --2- 172.21.15.49:0/818131729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6df40c6560 0x7f6df4164ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.866+0000 7f6df8a00700 1 --2- 172.21.15.49:0/818131729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df40bcae0 0x7f6df41647f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:25.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.866+0000 7f6df8a00700 1 -- 172.21.15.49:0/818131729 >> 172.21.15.49:0/818131729 conn(0x7f6df40c8120 msgr2=0x7f6df40a4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:25.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.874+0000 7f6df8a00700 1 -- 172.21.15.49:0/818131729 shutdown_connections 2024-01-22T05:12:25.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:25.874+0000 7f6df8a00700 1 -- 172.21.15.49:0/818131729 wait complete. 2024-01-22T05:12:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 14 and data pool 15 2024-01-22T05:12:25.910 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:12:26.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.062+0000 7f1d3ac00700 1 Processor -- start 2024-01-22T05:12:26.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.062+0000 7f1d3ac00700 1 -- start start 2024-01-22T05:12:26.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d3ac00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d34064c00 0x7f1d340bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d3ac00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d34065620 0x7f1d340bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d3ac00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d340c2700 con 0x7f1d34065240 2024-01-22T05:12:26.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d3ac00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d340c29a0 con 0x7f1d34064c00 2024-01-22T05:12:26.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d3ac00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d340c2c80 con 0x7f1d34065620 2024-01-22T05:12:26.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d33e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f1d34065240 0x7f1d340644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:56510/0 (socket says 172.21.15.49:56510) 2024-01-22T05:12:26.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d33e00700 1 -- 172.21.15.49:0/4247818467 learned_addr learned my addr 172.21.15.49:0/4247818467 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:26.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d39600700 1 --2- 172.21.15.49:0/4247818467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d34065620 0x7f1d340bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d33400700 1 --2- 172.21.15.49:0/4247818467 >> v2:172.21.15.49:3300/0 conn(0x7f1d34064c00 0x7f1d340bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d32a00700 1 -- 172.21.15.49:0/4247818467 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696418844 0 0) 0x7f1d340c2700 con 0x7f1d34065240 2024-01-22T05:12:26.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d32a00700 1 -- 172.21.15.49:0/4247818467 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d140033f0 con 0x7f1d34065240 2024-01-22T05:12:26.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d39600700 1 -- 172.21.15.49:0/4247818467 >> v2:172.21.15.49:3300/0 conn(0x7f1d34064c00 msgr2=0x7f1d340bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:26.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d39600700 1 --2- 172.21.15.49:0/4247818467 >> v2:172.21.15.49:3300/0 conn(0x7f1d34064c00 0x7f1d340bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d39600700 1 -- 172.21.15.49:0/4247818467 >> v1:172.21.15.110:6789/0 conn(0x7f1d34065240 legacy=0x7f1d340644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d39600700 1 -- 172.21.15.49:0/4247818467 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d340c2f60 con 0x7f1d34065620 2024-01-22T05:12:26.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d39600700 1 --2- 172.21.15.49:0/4247818467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d34065620 0x7f1d340bd170 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f1d2c009e60 tx=0x7f1d2c009780).ready entity=mon.2 client_cookie=cf299454a8ef82e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:26.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d32a00700 1 -- 172.21.15.49:0/4247818467 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00e070 con 0x7f1d34065620 2024-01-22T05:12:26.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d32a00700 1 -- 172.21.15.49:0/4247818467 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c00bab0 con 0x7f1d34065620 2024-01-22T05:12:26.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.066+0000 7f1d32a00700 1 -- 172.21.15.49:0/4247818467 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00be30 con 0x7f1d34065620 2024-01-22T05:12:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.070+0000 7f1d3ac00700 1 -- 172.21.15.49:0/4247818467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d34065620 msgr2=0x7f1d340bd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.070+0000 7f1d3ac00700 1 --2- 172.21.15.49:0/4247818467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d34065620 0x7f1d340bd170 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f1d2c009e60 tx=0x7f1d2c009780).stop 2024-01-22T05:12:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.070+0000 7f1d3ac00700 1 -- 172.21.15.49:0/4247818467 shutdown_connections 2024-01-22T05:12:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.070+0000 7f1d3ac00700 1 --2- 172.21.15.49:0/4247818467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d34065620 0x7f1d340bd170 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.070+0000 7f1d3ac00700 1 --2- 172.21.15.49:0/4247818467 >> v2:172.21.15.49:3300/0 conn(0x7f1d34064c00 0x7f1d340bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.070+0000 7f1d3ac00700 1 -- 172.21.15.49:0/4247818467 >> 172.21.15.49:0/4247818467 conn(0x7f1d340c87f0 msgr2=0x7f1d340c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.070+0000 7f1d3ac00700 1 -- 172.21.15.49:0/4247818467 shutdown_connections 2024-01-22T05:12:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.070+0000 7f1d3ac00700 1 -- 172.21.15.49:0/4247818467 wait complete. 2024-01-22T05:12:26.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.070+0000 7f1d3ac00700 1 Processor -- start 2024-01-22T05:12:26.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d3ac00700 1 -- start start 2024-01-22T05:12:26.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d3ac00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d34064c00 0x7f1d34148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d3ac00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d34065240 0x7f1d340a9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d3ac00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d34065620 0x7f1d340a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d3ac00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d340aa260 con 0x7f1d34064c00 2024-01-22T05:12:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d3ac00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d341589b0 con 0x7f1d34065240 2024-01-22T05:12:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d3ac00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d340bfdd0 con 0x7f1d34065620 2024-01-22T05:12:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d33e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d34064c00 0x7f1d34148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d33e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d34064c00 0x7f1d34148dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60392/0 (socket says 172.21.15.49:60392) 2024-01-22T05:12:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d33e00700 1 -- 172.21.15.49:0/2253713836 learned_addr learned my addr 172.21.15.49:0/2253713836 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d39600700 1 --2- 172.21.15.49:0/2253713836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d34065620 0x7f1d340a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d33400700 1 --2- 172.21.15.49:0/2253713836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d34065240 0x7f1d340a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d33e00700 1 -- 172.21.15.49:0/2253713836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d34065620 msgr2=0x7f1d340a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d33e00700 1 --2- 172.21.15.49:0/2253713836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d34065620 0x7f1d340a9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d33e00700 1 -- 172.21.15.49:0/2253713836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d34065240 msgr2=0x7f1d340a9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d33e00700 1 --2- 172.21.15.49:0/2253713836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d34065240 0x7f1d340a9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d33e00700 1 -- 172.21.15.49:0/2253713836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c009a20 con 0x7f1d34064c00 2024-01-22T05:12:26.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.074+0000 7f1d33e00700 1 --2- 172.21.15.49:0/2253713836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d34064c00 0x7f1d34148dd0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f1d2400c490 tx=0x7f1d24007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.078+0000 7f1d2b400700 1 -- 172.21.15.49:0/2253713836 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2400ce40 con 0x7f1d34064c00 2024-01-22T05:12:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.078+0000 7f1d2b400700 1 -- 172.21.15.49:0/2253713836 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d240072e0 con 0x7f1d34064c00 2024-01-22T05:12:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.078+0000 7f1d3ac00700 1 -- 172.21.15.49:0/2253713836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d34158080 con 0x7f1d34064c00 2024-01-22T05:12:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.078+0000 7f1d2b400700 1 -- 172.21.15.49:0/2253713836 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24007660 con 0x7f1d34064c00 2024-01-22T05:12:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.078+0000 7f1d3ac00700 1 -- 172.21.15.49:0/2253713836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d34158640 con 0x7f1d34064c00 2024-01-22T05:12:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.078+0000 7f1d3ac00700 1 -- 172.21.15.49:0/2253713836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d34047060 con 0x7f1d34064c00 2024-01-22T05:12:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.078+0000 7f1d2b400700 1 -- 172.21.15.49:0/2253713836 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1d240059b0 con 0x7f1d34064c00 2024-01-22T05:12:26.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.082+0000 7f1d2b400700 1 --2- 172.21.15.49:0/2253713836 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d0c05a510 0x7f1d0c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.082+0000 7f1d2b400700 1 -- 172.21.15.49:0/2253713836 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f1d24074180 con 0x7f1d34064c00 2024-01-22T05:12:26.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.082+0000 7f1d33400700 1 --2- 172.21.15.49:0/2253713836 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d0c05a510 0x7f1d0c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.082+0000 7f1d33400700 1 --2- 172.21.15.49:0/2253713836 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d0c05a510 0x7f1d0c05c9d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f1d34156980 tx=0x7f1d1c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.090+0000 7f1d2b400700 1 -- 172.21.15.49:0/2253713836 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1d24047740 con 0x7f1d34064c00 2024-01-22T05:12:26.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.254+0000 7f1d3ac00700 1 -- 172.21.15.49:0/2253713836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d340c3240 con 0x7f1d34064c00 2024-01-22T05:12:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.258+0000 7f1d2b400700 1 -- 172.21.15.49:0/2253713836 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+17191 (secure 0 0 0) 0x7f1d2404ad60 con 0x7f1d34064c00 2024-01-22T05:12:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:26.261 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":103,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:12:25.842147+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:12:23.950155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-01-22T05:12:24.858181+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:12:26.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.258+0000 7f1d3ac00700 1 -- 172.21.15.49:0/2253713836 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d0c05a510 msgr2=0x7f1d0c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.258+0000 7f1d3ac00700 1 --2- 172.21.15.49:0/2253713836 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d0c05a510 0x7f1d0c05c9d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f1d34156980 tx=0x7f1d1c009060).stop 2024-01-22T05:12:26.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.258+0000 7f1d3ac00700 1 -- 172.21.15.49:0/2253713836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d34064c00 msgr2=0x7f1d34148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.258+0000 7f1d3ac00700 1 --2- 172.21.15.49:0/2253713836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d34064c00 0x7f1d34148dd0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f1d2400c490 tx=0x7f1d24007c50).stop 2024-01-22T05:12:26.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.262+0000 7f1d3ac00700 1 -- 172.21.15.49:0/2253713836 shutdown_connections 2024-01-22T05:12:26.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.262+0000 7f1d3ac00700 1 --2- 172.21.15.49:0/2253713836 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d0c05a510 0x7f1d0c05c9d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.262+0000 7f1d3ac00700 1 --2- 172.21.15.49:0/2253713836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d34065620 0x7f1d340a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.262+0000 7f1d3ac00700 1 --2- 172.21.15.49:0/2253713836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d34065240 0x7f1d340a9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.262+0000 7f1d3ac00700 1 --2- 172.21.15.49:0/2253713836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d34064c00 0x7f1d34148dd0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.262+0000 7f1d3ac00700 1 -- 172.21.15.49:0/2253713836 >> 172.21.15.49:0/2253713836 conn(0x7f1d340c87f0 msgr2=0x7f1d34063b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.262+0000 7f1d3ac00700 1 -- 172.21.15.49:0/2253713836 shutdown_connections 2024-01-22T05:12:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.262+0000 7f1d3ac00700 1 -- 172.21.15.49:0/2253713836 wait complete. 2024-01-22T05:12:26.286 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:12:26.346 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-22T05:12:26.342+0000 7f5ab6c00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:12:26.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.438+0000 7f8ae5000700 1 Processor -- start 2024-01-22T05:12:26.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.438+0000 7f8ae5000700 1 -- start start 2024-01-22T05:12:26.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8ae5000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ae0155d20 0x7f8ae0065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8ae5000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8ae00a8e50 0x7f8ae00c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8ae5000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae00c1a40 con 0x7f8ae0066070 2024-01-22T05:12:26.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8ae5000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae0159310 con 0x7f8ae0155d20 2024-01-22T05:12:26.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8ae5000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae00c13f0 con 0x7f8ae00a8e50 2024-01-22T05:12:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8adde00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ae0155d20 0x7f8ae0065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8add400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8ae0066070 0x7f8ae00a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36144/0 (socket says 172.21.15.49:36144) 2024-01-22T05:12:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8adde00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ae0155d20 0x7f8ae0065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60404/0 (socket says 172.21.15.49:60404) 2024-01-22T05:12:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8add400700 1 -- 172.21.15.49:0/1114504572 learned_addr learned my addr 172.21.15.49:0/1114504572 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8ade800700 1 --2- 172.21.15.49:0/1114504572 >> v2:172.21.15.110:3300/0 conn(0x7f8ae00a8e50 0x7f8ae00c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8adca00700 1 -- 172.21.15.49:0/1114504572 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2599666114 0 0) 0x7f8ae00c1a40 con 0x7f8ae0066070 2024-01-22T05:12:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8adca00700 1 -- 172.21.15.49:0/1114504572 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ac00033f0 con 0x7f8ae0066070 2024-01-22T05:12:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8adde00700 1 -- 172.21.15.49:0/1114504572 >> v2:172.21.15.110:3300/0 conn(0x7f8ae00a8e50 msgr2=0x7f8ae00c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8adde00700 1 --2- 172.21.15.49:0/1114504572 >> v2:172.21.15.110:3300/0 conn(0x7f8ae00a8e50 0x7f8ae00c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8adde00700 1 -- 172.21.15.49:0/1114504572 >> v1:172.21.15.49:6789/0 conn(0x7f8ae0066070 legacy=0x7f8ae00a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.442+0000 7f8adde00700 1 -- 172.21.15.49:0/1114504572 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae00c16d0 con 0x7f8ae0155d20 2024-01-22T05:12:26.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.446+0000 7f8adde00700 1 --2- 172.21.15.49:0/1114504572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ae0155d20 0x7f8ae0065b80 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f8ae00c19b0 tx=0x7f8ad0009060).ready entity=mon.0 client_cookie=f1d6f056e52393f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:26.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.446+0000 7f8adca00700 1 -- 172.21.15.49:0/1114504572 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad000d4a0 con 0x7f8ae0155d20 2024-01-22T05:12:26.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.446+0000 7f8adca00700 1 -- 172.21.15.49:0/1114504572 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad000d600 con 0x7f8ae0155d20 2024-01-22T05:12:26.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.446+0000 7f8adca00700 1 -- 172.21.15.49:0/1114504572 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad000d980 con 0x7f8ae0155d20 2024-01-22T05:12:26.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.446+0000 7f8ae5000700 1 -- 172.21.15.49:0/1114504572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ae0155d20 msgr2=0x7f8ae0065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.446+0000 7f8ae5000700 1 --2- 172.21.15.49:0/1114504572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ae0155d20 0x7f8ae0065b80 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f8ae00c19b0 tx=0x7f8ad0009060).stop 2024-01-22T05:12:26.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.446+0000 7f8ae5000700 1 -- 172.21.15.49:0/1114504572 shutdown_connections 2024-01-22T05:12:26.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.446+0000 7f8ae5000700 1 --2- 172.21.15.49:0/1114504572 >> v2:172.21.15.110:3300/0 conn(0x7f8ae00a8e50 0x7f8ae00c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.446+0000 7f8ae5000700 1 --2- 172.21.15.49:0/1114504572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ae0155d20 0x7f8ae0065b80 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.446+0000 7f8ae5000700 1 -- 172.21.15.49:0/1114504572 >> 172.21.15.49:0/1114504572 conn(0x7f8ae00c6540 msgr2=0x7f8ae00c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.446+0000 7f8ae5000700 1 -- 172.21.15.49:0/1114504572 shutdown_connections 2024-01-22T05:12:26.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.446+0000 7f8ae5000700 1 -- 172.21.15.49:0/1114504572 wait complete. 2024-01-22T05:12:26.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.450+0000 7f8ae5000700 1 Processor -- start 2024-01-22T05:12:26.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.450+0000 7f8ae5000700 1 -- start start 2024-01-22T05:12:26.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8ae5000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ae0066070 0x7f8ae0152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8ae5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ae00a8e50 0x7f8ae0157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8ae5000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ae0155d20 0x7f8ae00c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8ae5000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0156f70 con 0x7f8ae00a8e50 2024-01-22T05:12:26.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8ae5000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae00ac300 con 0x7f8ae0155d20 2024-01-22T05:12:26.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8ae5000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0156360 con 0x7f8ae0066070 2024-01-22T05:12:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8add400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ae00a8e50 0x7f8ae0157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8add400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ae00a8e50 0x7f8ae0157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60406/0 (socket says 172.21.15.49:60406) 2024-01-22T05:12:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8add400700 1 -- 172.21.15.49:0/3656492424 learned_addr learned my addr 172.21.15.49:0/3656492424 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8adde00700 1 --2- 172.21.15.49:0/3656492424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ae0066070 0x7f8ae0152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8ade800700 1 --2- 172.21.15.49:0/3656492424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ae0155d20 0x7f8ae00c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8add400700 1 -- 172.21.15.49:0/3656492424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ae0066070 msgr2=0x7f8ae0152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8add400700 1 --2- 172.21.15.49:0/3656492424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ae0066070 0x7f8ae0152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8add400700 1 -- 172.21.15.49:0/3656492424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ae0155d20 msgr2=0x7f8ae00c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8add400700 1 --2- 172.21.15.49:0/3656492424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ae0155d20 0x7f8ae00c46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8add400700 1 -- 172.21.15.49:0/3656492424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad00092a0 con 0x7f8ae00a8e50 2024-01-22T05:12:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8add400700 1 --2- 172.21.15.49:0/3656492424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ae00a8e50 0x7f8ae0157550 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f8ac800c590 tx=0x7f8ac8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8ad5600700 1 -- 172.21.15.49:0/3656492424 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80072e0 con 0x7f8ae00a8e50 2024-01-22T05:12:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8ad5600700 1 -- 172.21.15.49:0/3656492424 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac8007440 con 0x7f8ae00a8e50 2024-01-22T05:12:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8ae5000700 1 -- 172.21.15.49:0/3656492424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae0156640 con 0x7f8ae00a8e50 2024-01-22T05:12:26.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8ad5600700 1 -- 172.21.15.49:0/3656492424 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80057a0 con 0x7f8ae00a8e50 2024-01-22T05:12:26.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.454+0000 7f8ae5000700 1 -- 172.21.15.49:0/3656492424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae0156c00 con 0x7f8ae00a8e50 2024-01-22T05:12:26.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.458+0000 7f8ae5000700 1 -- 172.21.15.49:0/3656492424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae00c0810 con 0x7f8ae00a8e50 2024-01-22T05:12:26.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.458+0000 7f8ad5600700 1 -- 172.21.15.49:0/3656492424 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8ac8005bd0 con 0x7f8ae00a8e50 2024-01-22T05:12:26.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.458+0000 7f8ad5600700 1 --2- 172.21.15.49:0/3656492424 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8ab805a510 0x7f8ab805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.458+0000 7f8ad5600700 1 -- 172.21.15.49:0/3656492424 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f8ac80740d0 con 0x7f8ae00a8e50 2024-01-22T05:12:26.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.458+0000 7f8adde00700 1 --2- 172.21.15.49:0/3656492424 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8ab805a510 0x7f8ab805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.462+0000 7f8adde00700 1 --2- 172.21.15.49:0/3656492424 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8ab805a510 0x7f8ab805c9d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f8ad000d260 tx=0x7f8ad0016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:26.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.466+0000 7f8ad5600700 1 -- 172.21.15.49:0/3656492424 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8ac8047750 con 0x7f8ae00a8e50 2024-01-22T05:12:26.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.634+0000 7f8ae5000700 1 -- 172.21.15.49:0/3656492424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ae0047060 con 0x7f8ae00a8e50 2024-01-22T05:12:26.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.634+0000 7f8ad5600700 1 -- 172.21.15.49:0/3656492424 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+17191 (secure 0 0 0) 0x7f8ac804ad70 con 0x7f8ae00a8e50 2024-01-22T05:12:26.639 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:26.639 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":103,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:12:25.842147+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:12:23.950155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-01-22T05:12:24.858181+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:12:26.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.638+0000 7f8ae5000700 1 -- 172.21.15.49:0/3656492424 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8ab805a510 msgr2=0x7f8ab805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.638+0000 7f8ae5000700 1 --2- 172.21.15.49:0/3656492424 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8ab805a510 0x7f8ab805c9d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f8ad000d260 tx=0x7f8ad0016000).stop 2024-01-22T05:12:26.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.638+0000 7f8ae5000700 1 -- 172.21.15.49:0/3656492424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ae00a8e50 msgr2=0x7f8ae0157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.638+0000 7f8ae5000700 1 --2- 172.21.15.49:0/3656492424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ae00a8e50 0x7f8ae0157550 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f8ac800c590 tx=0x7f8ac8007c80).stop 2024-01-22T05:12:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.638+0000 7f8ae5000700 1 -- 172.21.15.49:0/3656492424 shutdown_connections 2024-01-22T05:12:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.638+0000 7f8ae5000700 1 --2- 172.21.15.49:0/3656492424 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8ab805a510 0x7f8ab805c9d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.638+0000 7f8ae5000700 1 --2- 172.21.15.49:0/3656492424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ae0155d20 0x7f8ae00c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.638+0000 7f8ae5000700 1 --2- 172.21.15.49:0/3656492424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ae00a8e50 0x7f8ae0157550 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.638+0000 7f8ae5000700 1 --2- 172.21.15.49:0/3656492424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ae0066070 0x7f8ae0152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.638+0000 7f8ae5000700 1 -- 172.21.15.49:0/3656492424 >> 172.21.15.49:0/3656492424 conn(0x7f8ae00c6540 msgr2=0x7f8ae0154490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.638+0000 7f8ae5000700 1 -- 172.21.15.49:0/3656492424 shutdown_connections 2024-01-22T05:12:26.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.638+0000 7f8ae5000700 1 -- 172.21.15.49:0/3656492424 wait complete. 2024-01-22T05:12:26.666 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:12:26.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.838+0000 7f83f5a00700 1 Processor -- start 2024-01-22T05:12:26.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.838+0000 7f83f5a00700 1 -- start start 2024-01-22T05:12:26.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83f5a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f83f0067a90 0x7f83f015bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83f5a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f83f015c0b0 0x7f83f0158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83f5a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f0069600 con 0x7f83f0158b60 2024-01-22T05:12:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83f5a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f01561a0 con 0x7f83f0067a90 2024-01-22T05:12:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83f5a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f0068dd0 con 0x7f83f015c0b0 2024-01-22T05:12:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83efe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f83f0067a90 0x7f83f015bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83efe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f83f0067a90 0x7f83f015bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60422/0 (socket says 172.21.15.49:60422) 2024-01-22T05:12:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83efe00700 1 -- 172.21.15.49:0/2586321287 learned_addr learned my addr 172.21.15.49:0/2586321287 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:26.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83f5000700 1 --1- 172.21.15.49:0/2586321287 >> v1:172.21.15.49:6789/0 conn(0x7f83f0158b60 0x7f83f0158f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36160/0 (socket says 172.21.15.49:36160) 2024-01-22T05:12:26.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83ef400700 1 --2- 172.21.15.49:0/2586321287 >> v2:172.21.15.110:3300/0 conn(0x7f83f015c0b0 0x7f83f0158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83efe00700 1 -- 172.21.15.49:0/2586321287 >> v2:172.21.15.110:3300/0 conn(0x7f83f015c0b0 msgr2=0x7f83f0158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:26.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83efe00700 1 --2- 172.21.15.49:0/2586321287 >> v2:172.21.15.110:3300/0 conn(0x7f83f015c0b0 0x7f83f0158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83efe00700 1 -- 172.21.15.49:0/2586321287 >> v1:172.21.15.49:6789/0 conn(0x7f83f0158b60 legacy=0x7f83f0158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83efe00700 1 -- 172.21.15.49:0/2586321287 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f015c510 con 0x7f83f0067a90 2024-01-22T05:12:26.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83efe00700 1 --2- 172.21.15.49:0/2586321287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f0067a90 0x7f83f015bbc0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f83f015ccb0 tx=0x7f83e0009060).ready entity=mon.0 client_cookie=96899e776fe15b00 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:26.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83eea00700 1 -- 172.21.15.49:0/2586321287 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0005880 con 0x7f83f0067a90 2024-01-22T05:12:26.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83eea00700 1 -- 172.21.15.49:0/2586321287 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e00059e0 con 0x7f83f0067a90 2024-01-22T05:12:26.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.842+0000 7f83eea00700 1 -- 172.21.15.49:0/2586321287 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0005d60 con 0x7f83f0067a90 2024-01-22T05:12:26.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.846+0000 7f83f5a00700 1 -- 172.21.15.49:0/2586321287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f0067a90 msgr2=0x7f83f015bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.846+0000 7f83f5a00700 1 --2- 172.21.15.49:0/2586321287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f0067a90 0x7f83f015bbc0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f83f015ccb0 tx=0x7f83e0009060).stop 2024-01-22T05:12:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.846+0000 7f83f5a00700 1 -- 172.21.15.49:0/2586321287 shutdown_connections 2024-01-22T05:12:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.846+0000 7f83f5a00700 1 --2- 172.21.15.49:0/2586321287 >> v2:172.21.15.110:3300/0 conn(0x7f83f015c0b0 0x7f83f0158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.846+0000 7f83f5a00700 1 --2- 172.21.15.49:0/2586321287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f0067a90 0x7f83f015bbc0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.846+0000 7f83f5a00700 1 -- 172.21.15.49:0/2586321287 >> 172.21.15.49:0/2586321287 conn(0x7f83f00c6fc0 msgr2=0x7f83f00c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.846+0000 7f83f5a00700 1 -- 172.21.15.49:0/2586321287 shutdown_connections 2024-01-22T05:12:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.846+0000 7f83f5a00700 1 -- 172.21.15.49:0/2586321287 wait complete. 2024-01-22T05:12:26.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.850+0000 7f83f5a00700 1 Processor -- start 2024-01-22T05:12:26.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.850+0000 7f83f5a00700 1 -- start start 2024-01-22T05:12:26.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.850+0000 7f83f5a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83f0067a90 0x7f83f01539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.850+0000 7f83f5a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f0158b60 0x7f83f0153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.850+0000 7f83f5a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f015c0b0 0x7f83f00a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.850+0000 7f83f5a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f015f010 con 0x7f83f015c0b0 2024-01-22T05:12:26.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.850+0000 7f83f5a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f015e400 con 0x7f83f0158b60 2024-01-22T05:12:26.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.850+0000 7f83f5a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f015e6e0 con 0x7f83f0067a90 2024-01-22T05:12:26.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83f5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f015c0b0 0x7f83f00a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83f5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f015c0b0 0x7f83f00a9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60432/0 (socket says 172.21.15.49:60432) 2024-01-22T05:12:26.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83f5000700 1 -- 172.21.15.49:0/2706219378 learned_addr learned my addr 172.21.15.49:0/2706219378 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:26.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83ef400700 1 --2- 172.21.15.49:0/2706219378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f0158b60 0x7f83f0153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83f5000700 1 -- 172.21.15.49:0/2706219378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83f0067a90 msgr2=0x7f83f01539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83f5000700 1 --2- 172.21.15.49:0/2706219378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83f0067a90 0x7f83f01539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:12:26.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83f5000700 1 -- 172.21.15.49:0/2706219378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f0158b60 msgr2=0x7f83f0153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:26.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83f5000700 1 --2- 172.21.15.49:0/2706219378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f0158b60 0x7f83f0153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:26.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83f5000700 1 -- 172.21.15.49:0/2706219378 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e0009300 con 0x7f83f015c0b0 2024-01-22T05:12:26.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83ef400700 1 --2- 172.21.15.49:0/2706219378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f0158b60 0x7f83f0153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:26.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83f5000700 1 --2- 172.21.15.49:0/2706219378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f015c0b0 0x7f83f00a9e80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f83e800c790 tx=0x7f83e80015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:26.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83e7400700 1 -- 172.21.15.49:0/2706219378 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e8005c70 con 0x7f83f015c0b0 2024-01-22T05:12:26.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83e7400700 1 -- 172.21.15.49:0/2706219378 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e8005dd0 con 0x7f83f015c0b0 2024-01-22T05:12:26.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83e7400700 1 -- 172.21.15.49:0/2706219378 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e8007320 con 0x7f83f015c0b0 2024-01-22T05:12:26.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83f5a00700 1 -- 172.21.15.49:0/2706219378 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f015e9c0 con 0x7f83f015c0b0 2024-01-22T05:12:26.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83f5a00700 1 -- 172.21.15.49:0/2706219378 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f0153ee0 con 0x7f83f015c0b0 2024-01-22T05:12:26.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.854+0000 7f83f5a00700 1 -- 172.21.15.49:0/2706219378 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f0047060 con 0x7f83f015c0b0 2024-01-22T05:12:26.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.858+0000 7f83e7400700 1 -- 172.21.15.49:0/2706219378 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f83e80076d0 con 0x7f83f015c0b0 2024-01-22T05:12:26.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.858+0000 7f83e7400700 1 --2- 172.21.15.49:0/2706219378 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f83c805a540 0x7f83c805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:26.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.858+0000 7f83e7400700 1 -- 172.21.15.49:0/2706219378 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f83e80749e0 con 0x7f83f015c0b0 2024-01-22T05:12:26.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.858+0000 7f83efe00700 1 --2- 172.21.15.49:0/2706219378 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f83c805a540 0x7f83c805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:26.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.858+0000 7f83efe00700 1 --2- 172.21.15.49:0/2706219378 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f83c805a540 0x7f83c805ca00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f83e000b2e0 tx=0x7f83e0016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:26.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:26.862+0000 7f83e7400700 1 -- 172.21.15.49:0/2706219378 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f83e8047fa0 con 0x7f83f015c0b0 2024-01-22T05:12:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:27.062+0000 7f83f5a00700 1 -- 172.21.15.49:0/2706219378 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f83f015f150 con 0x7f83f015c0b0 2024-01-22T05:12:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:27.862+0000 7f83e7400700 1 -- 172.21.15.49:0/2706219378 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v89) v1 ==== 118+0+0 (secure 0 0 0) 0x7f83e804b5c0 con 0x7f83f015c0b0 2024-01-22T05:12:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:27.866+0000 7f83f5a00700 1 -- 172.21.15.49:0/2706219378 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f83c805a540 msgr2=0x7f83c805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:27.866+0000 7f83f5a00700 1 --2- 172.21.15.49:0/2706219378 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f83c805a540 0x7f83c805ca00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f83e000b2e0 tx=0x7f83e0016000).stop 2024-01-22T05:12:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:27.866+0000 7f83f5a00700 1 -- 172.21.15.49:0/2706219378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f015c0b0 msgr2=0x7f83f00a9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:27.866+0000 7f83f5a00700 1 --2- 172.21.15.49:0/2706219378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f015c0b0 0x7f83f00a9e80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f83e800c790 tx=0x7f83e80015e0).stop 2024-01-22T05:12:27.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:27.866+0000 7f83f5a00700 1 -- 172.21.15.49:0/2706219378 shutdown_connections 2024-01-22T05:12:27.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:27.866+0000 7f83f5a00700 1 --2- 172.21.15.49:0/2706219378 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f83c805a540 0x7f83c805ca00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:27.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:27.866+0000 7f83f5a00700 1 --2- 172.21.15.49:0/2706219378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f015c0b0 0x7f83f00a9e80 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:27.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:27.866+0000 7f83f5a00700 1 --2- 172.21.15.49:0/2706219378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f0158b60 0x7f83f0153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:27.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:27.866+0000 7f83f5a00700 1 --2- 172.21.15.49:0/2706219378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83f0067a90 0x7f83f01539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:12:27.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:27.866+0000 7f83f5a00700 1 -- 172.21.15.49:0/2706219378 >> 172.21.15.49:0/2706219378 conn(0x7f83f00c6fc0 msgr2=0x7f83f01582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:27.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:27.866+0000 7f83f5a00700 1 -- 172.21.15.49:0/2706219378 shutdown_connections 2024-01-22T05:12:27.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:27.866+0000 7f83f5a00700 1 -- 172.21.15.49:0/2706219378 wait complete. 2024-01-22T05:12:27.894 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T05:12:27.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:12:28.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.058+0000 7fae48000700 1 Processor -- start 2024-01-22T05:12:28.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.058+0000 7fae48000700 1 -- start start 2024-01-22T05:12:28.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.062+0000 7fae48000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae400a8c20 0x7fae400c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:28.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.062+0000 7fae48000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fae400c1ac0 0x7fae400bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:28.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.062+0000 7fae48000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae40158650 con 0x7fae400bc9c0 2024-01-22T05:12:28.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.062+0000 7fae48000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae400c1f20 con 0x7fae400c1ac0 2024-01-22T05:12:28.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.062+0000 7fae48000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae400bd170 con 0x7fae400a8c20 2024-01-22T05:12:28.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.062+0000 7fae46000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fae400bc9c0 0x7fae40068710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36174/0 (socket says 172.21.15.49:36174) 2024-01-22T05:12:28.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.062+0000 7fae46000700 1 -- 172.21.15.49:0/4282287499 learned_addr learned my addr 172.21.15.49:0/4282287499 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:28.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.062+0000 7fae44c00700 1 --2- 172.21.15.49:0/4282287499 >> v2:172.21.15.110:3300/0 conn(0x7fae400c1ac0 0x7fae400bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:28.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.062+0000 7fae45600700 1 --2- 172.21.15.49:0/4282287499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae400a8c20 0x7fae400c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:28.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.062+0000 7fae3fe00700 1 -- 172.21.15.49:0/4282287499 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697825297 0 0) 0x7fae38001490 con 0x7fae400bc9c0 2024-01-22T05:12:28.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae3fe00700 1 -- 172.21.15.49:0/4282287499 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae200033f0 con 0x7fae400bc9c0 2024-01-22T05:12:28.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae45600700 1 -- 172.21.15.49:0/4282287499 >> v2:172.21.15.110:3300/0 conn(0x7fae400c1ac0 msgr2=0x7fae400bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:28.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae45600700 1 --2- 172.21.15.49:0/4282287499 >> v2:172.21.15.110:3300/0 conn(0x7fae400c1ac0 0x7fae400bc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:28.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae45600700 1 -- 172.21.15.49:0/4282287499 >> v1:172.21.15.49:6789/0 conn(0x7fae400bc9c0 legacy=0x7fae40068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:28.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae45600700 1 -- 172.21.15.49:0/4282287499 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae40067c30 con 0x7fae400a8c20 2024-01-22T05:12:28.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae45600700 1 --2- 172.21.15.49:0/4282287499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae400a8c20 0x7fae400c15d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fae30009760 tx=0x7fae30009060).ready entity=mon.2 client_cookie=79dd01ca51cee948 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:28.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae3fe00700 1 -- 172.21.15.49:0/4282287499 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3000d4a0 con 0x7fae400a8c20 2024-01-22T05:12:28.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae3fe00700 1 -- 172.21.15.49:0/4282287499 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3000d600 con 0x7fae400a8c20 2024-01-22T05:12:28.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae3fe00700 1 -- 172.21.15.49:0/4282287499 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3000d980 con 0x7fae400a8c20 2024-01-22T05:12:28.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae48000700 1 -- 172.21.15.49:0/4282287499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae400a8c20 msgr2=0x7fae400c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:28.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae48000700 1 --2- 172.21.15.49:0/4282287499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae400a8c20 0x7fae400c15d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fae30009760 tx=0x7fae30009060).stop 2024-01-22T05:12:28.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae48000700 1 -- 172.21.15.49:0/4282287499 shutdown_connections 2024-01-22T05:12:28.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae48000700 1 --2- 172.21.15.49:0/4282287499 >> v2:172.21.15.110:3300/0 conn(0x7fae400c1ac0 0x7fae400bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:28.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae48000700 1 --2- 172.21.15.49:0/4282287499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae400a8c20 0x7fae400c15d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:28.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae48000700 1 -- 172.21.15.49:0/4282287499 >> 172.21.15.49:0/4282287499 conn(0x7fae40062cb0 msgr2=0x7fae400c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:28.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae48000700 1 -- 172.21.15.49:0/4282287499 shutdown_connections 2024-01-22T05:12:28.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.066+0000 7fae48000700 1 -- 172.21.15.49:0/4282287499 wait complete. 2024-01-22T05:12:28.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.070+0000 7fae48000700 1 Processor -- start 2024-01-22T05:12:28.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.070+0000 7fae48000700 1 -- start start 2024-01-22T05:12:28.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae48000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae400a8c20 0x7fae4015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:28.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae48000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae400bc9c0 0x7fae401591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:28.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae48000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae400c1ac0 0x7fae4014f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:28.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae48000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4014e1e0 con 0x7fae400bc9c0 2024-01-22T05:12:28.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae48000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae400bd7b0 con 0x7fae400c1ac0 2024-01-22T05:12:28.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae48000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae40159a30 con 0x7fae400a8c20 2024-01-22T05:12:28.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae44c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae400bc9c0 0x7fae401591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:28.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae44c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae400bc9c0 0x7fae401591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60440/0 (socket says 172.21.15.49:60440) 2024-01-22T05:12:28.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae44c00700 1 -- 172.21.15.49:0/2366525874 learned_addr learned my addr 172.21.15.49:0/2366525874 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:28.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae46000700 1 --2- 172.21.15.49:0/2366525874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae400c1ac0 0x7fae4014f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:28.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae45600700 1 --2- 172.21.15.49:0/2366525874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae400a8c20 0x7fae4015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae44c00700 1 -- 172.21.15.49:0/2366525874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae400a8c20 msgr2=0x7fae4015b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae44c00700 1 --2- 172.21.15.49:0/2366525874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae400a8c20 0x7fae4015b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae44c00700 1 -- 172.21.15.49:0/2366525874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae400c1ac0 msgr2=0x7fae4014f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae44c00700 1 --2- 172.21.15.49:0/2366525874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae400c1ac0 0x7fae4014f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae44c00700 1 -- 172.21.15.49:0/2366525874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae300092a0 con 0x7fae400bc9c0 2024-01-22T05:12:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae44c00700 1 --2- 172.21.15.49:0/2366525874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae400bc9c0 0x7fae401591c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7fae2800e930 tx=0x7fae28006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae3cc00700 1 -- 172.21.15.49:0/2366525874 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28012600 con 0x7fae400bc9c0 2024-01-22T05:12:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae3cc00700 1 -- 172.21.15.49:0/2366525874 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae28012760 con 0x7fae400bc9c0 2024-01-22T05:12:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae48000700 1 -- 172.21.15.49:0/2366525874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae40159d10 con 0x7fae400bc9c0 2024-01-22T05:12:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae3cc00700 1 -- 172.21.15.49:0/2366525874 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28012ae0 con 0x7fae400bc9c0 2024-01-22T05:12:28.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.074+0000 7fae48000700 1 -- 172.21.15.49:0/2366525874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4015a2d0 con 0x7fae400bc9c0 2024-01-22T05:12:28.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.078+0000 7fae48000700 1 -- 172.21.15.49:0/2366525874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae400bd3d0 con 0x7fae400bc9c0 2024-01-22T05:12:28.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.078+0000 7fae3cc00700 1 -- 172.21.15.49:0/2366525874 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fae2801b400 con 0x7fae400bc9c0 2024-01-22T05:12:28.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.078+0000 7fae3cc00700 1 --2- 172.21.15.49:0/2366525874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae1805a510 0x7fae1805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:28.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.082+0000 7fae3cc00700 1 -- 172.21.15.49:0/2366525874 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fae28074b50 con 0x7fae400bc9c0 2024-01-22T05:12:28.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.082+0000 7fae45600700 1 --2- 172.21.15.49:0/2366525874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae1805a510 0x7fae1805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.082+0000 7fae45600700 1 --2- 172.21.15.49:0/2366525874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae1805a510 0x7fae1805c9d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fae3000d260 tx=0x7fae30016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:28.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.086+0000 7fae3cc00700 1 -- 172.21.15.49:0/2366525874 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fae400bd3d0 con 0x7fae400bc9c0 2024-01-22T05:12:28.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.282+0000 7fae48000700 1 -- 172.21.15.49:0/2366525874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fae400bd3d0 con 0x7fae400bc9c0 2024-01-22T05:12:28.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.866+0000 7fae3cc00700 1 -- 172.21.15.49:0/2366525874 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v90) v1 ==== 122+0+0 (secure 0 0 0) 0x7fae400bd3d0 con 0x7fae400bc9c0 2024-01-22T05:12:28.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.874+0000 7fae48000700 1 -- 172.21.15.49:0/2366525874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae1805a510 msgr2=0x7fae1805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:28.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.874+0000 7fae48000700 1 --2- 172.21.15.49:0/2366525874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae1805a510 0x7fae1805c9d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fae3000d260 tx=0x7fae30016000).stop 2024-01-22T05:12:28.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.874+0000 7fae48000700 1 -- 172.21.15.49:0/2366525874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae400bc9c0 msgr2=0x7fae401591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:28.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.874+0000 7fae48000700 1 --2- 172.21.15.49:0/2366525874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae400bc9c0 0x7fae401591c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7fae2800e930 tx=0x7fae28006f40).stop 2024-01-22T05:12:28.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.874+0000 7fae48000700 1 -- 172.21.15.49:0/2366525874 shutdown_connections 2024-01-22T05:12:28.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.874+0000 7fae48000700 1 --2- 172.21.15.49:0/2366525874 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae1805a510 0x7fae1805c9d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:28.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.874+0000 7fae48000700 1 --2- 172.21.15.49:0/2366525874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae400c1ac0 0x7fae4014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:28.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.874+0000 7fae48000700 1 --2- 172.21.15.49:0/2366525874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae400bc9c0 0x7fae401591c0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:28.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.874+0000 7fae48000700 1 --2- 172.21.15.49:0/2366525874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae400a8c20 0x7fae4015b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:28.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.874+0000 7fae48000700 1 -- 172.21.15.49:0/2366525874 >> 172.21.15.49:0/2366525874 conn(0x7fae40062cb0 msgr2=0x7fae400656d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:28.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.874+0000 7fae48000700 1 -- 172.21.15.49:0/2366525874 shutdown_connections 2024-01-22T05:12:28.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:28.874+0000 7fae48000700 1 -- 172.21.15.49:0/2366525874 wait complete. 2024-01-22T05:12:28.902 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:12:28.903 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:12:29.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.054+0000 7f378b400700 1 Processor -- start 2024-01-22T05:12:29.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.058+0000 7f378b400700 1 -- start start 2024-01-22T05:12:29.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.058+0000 7f378b400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784066fb0 0x7f37840c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.058+0000 7f378b400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f37840a8b10 0x7f3784157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f378b400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37840c1ee0 con 0x7f37840a8f90 2024-01-22T05:12:29.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f378b400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37840c12f0 con 0x7f37840a8b10 2024-01-22T05:12:29.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f378b400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37840c15b0 con 0x7f3784066fb0 2024-01-22T05:12:29.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f3783e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f37840a8b10 0x7f3784157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f3788a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784066fb0 0x7f37840c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f3789400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f37840a8f90 0x7f3784065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:56522/0 (socket says 172.21.15.49:56522) 2024-01-22T05:12:29.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f3789400700 1 -- 172.21.15.49:0/1228757168 learned_addr learned my addr 172.21.15.49:0/1228757168 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:29.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f3783400700 1 -- 172.21.15.49:0/1228757168 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656036669 0 0) 0x7f37840c1ee0 con 0x7f37840a8f90 2024-01-22T05:12:29.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f3783400700 1 -- 172.21.15.49:0/1228757168 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37640033f0 con 0x7f37840a8f90 2024-01-22T05:12:29.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f3788a00700 1 -- 172.21.15.49:0/1228757168 >> v2:172.21.15.110:3300/0 conn(0x7f37840a8b10 msgr2=0x7f3784157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:29.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f3788a00700 1 --2- 172.21.15.49:0/1228757168 >> v2:172.21.15.110:3300/0 conn(0x7f37840a8b10 0x7f3784157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f3788a00700 1 -- 172.21.15.49:0/1228757168 >> v1:172.21.15.110:6789/0 conn(0x7f37840a8f90 legacy=0x7f3784065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f3788a00700 1 -- 172.21.15.49:0/1228757168 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37840c1890 con 0x7f3784066fb0 2024-01-22T05:12:29.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f3783e00700 1 --2- 172.21.15.49:0/1228757168 >> v2:172.21.15.110:3300/0 conn(0x7f37840a8b10 0x7f3784157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:12:29.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f3788a00700 1 --2- 172.21.15.49:0/1228757168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784066fb0 0x7f37840c2370 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f3774009790 tx=0x7f3774009060).ready entity=mon.2 client_cookie=c8c915c37046b375 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f3783400700 1 -- 172.21.15.49:0/1228757168 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377400d4a0 con 0x7f3784066fb0 2024-01-22T05:12:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f3783400700 1 -- 172.21.15.49:0/1228757168 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377400d600 con 0x7f3784066fb0 2024-01-22T05:12:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.062+0000 7f3783400700 1 -- 172.21.15.49:0/1228757168 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377400d980 con 0x7f3784066fb0 2024-01-22T05:12:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.066+0000 7f378b400700 1 -- 172.21.15.49:0/1228757168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784066fb0 msgr2=0x7f37840c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.066+0000 7f378b400700 1 --2- 172.21.15.49:0/1228757168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784066fb0 0x7f37840c2370 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f3774009790 tx=0x7f3774009060).stop 2024-01-22T05:12:29.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.066+0000 7f378b400700 1 -- 172.21.15.49:0/1228757168 shutdown_connections 2024-01-22T05:12:29.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.066+0000 7f378b400700 1 --2- 172.21.15.49:0/1228757168 >> v2:172.21.15.110:3300/0 conn(0x7f37840a8b10 0x7f3784157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.066+0000 7f378b400700 1 --2- 172.21.15.49:0/1228757168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784066fb0 0x7f37840c2370 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.066+0000 7f378b400700 1 -- 172.21.15.49:0/1228757168 >> 172.21.15.49:0/1228757168 conn(0x7f37840c6540 msgr2=0x7f37840c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:29.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.066+0000 7f378b400700 1 -- 172.21.15.49:0/1228757168 shutdown_connections 2024-01-22T05:12:29.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.066+0000 7f378b400700 1 -- 172.21.15.49:0/1228757168 wait complete. 2024-01-22T05:12:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.070+0000 7f378b400700 1 Processor -- start 2024-01-22T05:12:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.070+0000 7f378b400700 1 -- start start 2024-01-22T05:12:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f378b400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784066fb0 0x7f3784148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f378b400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37840a8b10 0x7f37841690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f378b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37840a8f90 0x7f37840aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f378b400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3784149090 con 0x7f37840a8f90 2024-01-22T05:12:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f378b400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3784149e90 con 0x7f37840a8b10 2024-01-22T05:12:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f378b400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3784149280 con 0x7f3784066fb0 2024-01-22T05:12:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f3789400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37840a8f90 0x7f37840aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f3788a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784066fb0 0x7f3784148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f3789400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37840a8f90 0x7f37840aba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60448/0 (socket says 172.21.15.49:60448) 2024-01-22T05:12:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f3789400700 1 -- 172.21.15.49:0/531764336 learned_addr learned my addr 172.21.15.49:0/531764336 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f3783e00700 1 --2- 172.21.15.49:0/531764336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37840a8b10 0x7f37841690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f3789400700 1 -- 172.21.15.49:0/531764336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784066fb0 msgr2=0x7f3784148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f3789400700 1 --2- 172.21.15.49:0/531764336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784066fb0 0x7f3784148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f3789400700 1 -- 172.21.15.49:0/531764336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37840a8b10 msgr2=0x7f37841690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f3789400700 1 --2- 172.21.15.49:0/531764336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37840a8b10 0x7f37841690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f3789400700 1 -- 172.21.15.49:0/531764336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c0092a0 con 0x7f37840a8f90 2024-01-22T05:12:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f3789400700 1 --2- 172.21.15.49:0/531764336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37840a8f90 0x7f37840aba60 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f377c001460 tx=0x7f377c007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f377be00700 1 -- 172.21.15.49:0/531764336 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c005d30 con 0x7f37840a8f90 2024-01-22T05:12:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f377be00700 1 -- 172.21.15.49:0/531764336 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c005e90 con 0x7f37840a8f90 2024-01-22T05:12:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f378b400700 1 -- 172.21.15.49:0/531764336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37740092a0 con 0x7f37840a8f90 2024-01-22T05:12:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f377be00700 1 -- 172.21.15.49:0/531764336 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c007300 con 0x7f37840a8f90 2024-01-22T05:12:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.074+0000 7f378b400700 1 -- 172.21.15.49:0/531764336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3784149610 con 0x7f37840a8f90 2024-01-22T05:12:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.078+0000 7f378b400700 1 -- 172.21.15.49:0/531764336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37840aaa00 con 0x7f37840a8f90 2024-01-22T05:12:29.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.078+0000 7f377be00700 1 -- 172.21.15.49:0/531764336 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f377c0076b0 con 0x7f37840a8f90 2024-01-22T05:12:29.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.078+0000 7f377be00700 1 --2- 172.21.15.49:0/531764336 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f375c05a510 0x7f375c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.078+0000 7f377be00700 1 -- 172.21.15.49:0/531764336 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f377c074340 con 0x7f37840a8f90 2024-01-22T05:12:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.078+0000 7f3788a00700 1 --2- 172.21.15.49:0/531764336 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f375c05a510 0x7f375c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.082+0000 7f3788a00700 1 --2- 172.21.15.49:0/531764336 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f375c05a510 0x7f375c05c9d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f3774009fd0 tx=0x7f3774016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:29.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.086+0000 7f377be00700 1 -- 172.21.15.49:0/531764336 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f377c047900 con 0x7f37840a8f90 2024-01-22T05:12:29.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.286+0000 7f378b400700 1 -- 172.21.15.49:0/531764336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3784047060 con 0x7f37840a8f90 2024-01-22T05:12:29.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.290+0000 7f377be00700 1 -- 172.21.15.49:0/531764336 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f377c04af20 con 0x7f37840a8f90 2024-01-22T05:12:29.293 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:29.293 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2953480069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2953480069},{"type":"v1","addr":"172.21.15.110:6833","nonce":2953480069}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2000522159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2000522159},{"type":"v1","addr":"172.21.15.110:6835","nonce":2000522159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/578632238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":578632238},{"type":"v1","addr":"172.21.15.49:6836","nonce":578632238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:12:25.842913+0000","modified":"2024-01-22T05:12:28.864832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7287":{"gid":7287,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/1226995696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1226995696},{"type":"v1","addr":"172.21.15.49:6837","nonce":1226995696}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-22T05:12:29.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.290+0000 7f378b400700 1 -- 172.21.15.49:0/531764336 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f375c05a510 msgr2=0x7f375c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.290+0000 7f378b400700 1 --2- 172.21.15.49:0/531764336 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f375c05a510 0x7f375c05c9d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f3774009fd0 tx=0x7f3774016000).stop 2024-01-22T05:12:29.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.290+0000 7f378b400700 1 -- 172.21.15.49:0/531764336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37840a8f90 msgr2=0x7f37840aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.290+0000 7f378b400700 1 --2- 172.21.15.49:0/531764336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37840a8f90 0x7f37840aba60 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f377c001460 tx=0x7f377c007f70).stop 2024-01-22T05:12:29.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.294+0000 7f378b400700 1 -- 172.21.15.49:0/531764336 shutdown_connections 2024-01-22T05:12:29.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.294+0000 7f378b400700 1 --2- 172.21.15.49:0/531764336 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f375c05a510 0x7f375c05c9d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.294+0000 7f378b400700 1 --2- 172.21.15.49:0/531764336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37840a8f90 0x7f37840aba60 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.294+0000 7f378b400700 1 --2- 172.21.15.49:0/531764336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37840a8b10 0x7f37841690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.294+0000 7f378b400700 1 --2- 172.21.15.49:0/531764336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784066fb0 0x7f3784148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.294+0000 7f378b400700 1 -- 172.21.15.49:0/531764336 >> 172.21.15.49:0/531764336 conn(0x7f37840c6540 msgr2=0x7f37840c3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:29.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.294+0000 7f378b400700 1 -- 172.21.15.49:0/531764336 shutdown_connections 2024-01-22T05:12:29.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.294+0000 7f378b400700 1 -- 172.21.15.49:0/531764336 wait complete. 2024-01-22T05:12:29.301 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 90 2024-01-22T05:12:29.323 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:12:29.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.482+0000 7f4470000700 1 Processor -- start 2024-01-22T05:12:29.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.482+0000 7f4470000700 1 -- start start 2024-01-22T05:12:29.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.486+0000 7f4470000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4468155d20 0x7f4468065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.486+0000 7f4470000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44680c1a40 con 0x7f4468066070 2024-01-22T05:12:29.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.486+0000 7f4470000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4468159310 con 0x7f44680a8e50 2024-01-22T05:12:29.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.486+0000 7f4470000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44680c13f0 con 0x7f4468155d20 2024-01-22T05:12:29.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.486+0000 7f446d600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4468155d20 0x7f4468065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.486+0000 7f446cc00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4468066070 0x7f44680a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36182/0 (socket says 172.21.15.49:36182) 2024-01-22T05:12:29.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.486+0000 7f446d600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4468155d20 0x7f4468065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60464/0 (socket says 172.21.15.49:60464) 2024-01-22T05:12:29.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.486+0000 7f446cc00700 1 -- 172.21.15.49:0/2940078032 learned_addr learned my addr 172.21.15.49:0/2940078032 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:29.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.486+0000 7f446d600700 1 -- 172.21.15.49:0/2940078032 >> v1:172.21.15.110:6789/0 conn(0x7f44680a8e50 legacy=0x7f44680c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.486+0000 7f446d600700 1 -- 172.21.15.49:0/2940078032 >> v1:172.21.15.49:6789/0 conn(0x7f4468066070 legacy=0x7f44680a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.486+0000 7f446d600700 1 -- 172.21.15.49:0/2940078032 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44680c16d0 con 0x7f4468155d20 2024-01-22T05:12:29.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.486+0000 7f446d600700 1 --2- 172.21.15.49:0/2940078032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4468155d20 0x7f4468065b80 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f4458009760 tx=0x7f4458009060).ready entity=mon.0 client_cookie=9af764b1e40c9bf4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:29.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.486+0000 7f4467e00700 1 -- 172.21.15.49:0/2940078032 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445800b580 con 0x7f4468155d20 2024-01-22T05:12:29.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.490+0000 7f4467e00700 1 -- 172.21.15.49:0/2940078032 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445800b6e0 con 0x7f4468155d20 2024-01-22T05:12:29.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.490+0000 7f4467e00700 1 -- 172.21.15.49:0/2940078032 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445800ba60 con 0x7f4468155d20 2024-01-22T05:12:29.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.490+0000 7f4470000700 1 -- 172.21.15.49:0/2940078032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4468155d20 msgr2=0x7f4468065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.490+0000 7f4470000700 1 --2- 172.21.15.49:0/2940078032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4468155d20 0x7f4468065b80 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f4458009760 tx=0x7f4458009060).stop 2024-01-22T05:12:29.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.490+0000 7f4470000700 1 -- 172.21.15.49:0/2940078032 shutdown_connections 2024-01-22T05:12:29.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.490+0000 7f4470000700 1 --2- 172.21.15.49:0/2940078032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4468155d20 0x7f4468065b80 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.490+0000 7f4470000700 1 -- 172.21.15.49:0/2940078032 >> 172.21.15.49:0/2940078032 conn(0x7f44680c6540 msgr2=0x7f44680c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.490+0000 7f4470000700 1 -- 172.21.15.49:0/2940078032 shutdown_connections 2024-01-22T05:12:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.490+0000 7f4470000700 1 -- 172.21.15.49:0/2940078032 wait complete. 2024-01-22T05:12:29.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.494+0000 7f4470000700 1 Processor -- start 2024-01-22T05:12:29.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.494+0000 7f4470000700 1 -- start start 2024-01-22T05:12:29.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f4470000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4468066070 0x7f446813f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f4470000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44680a8e50 0x7f44680ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f4470000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4468155d20 0x7f44680abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f4470000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44681694f0 con 0x7f44680a8e50 2024-01-22T05:12:29.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f4470000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44681595f0 con 0x7f4468066070 2024-01-22T05:12:29.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f4470000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44681598d0 con 0x7f4468155d20 2024-01-22T05:12:29.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f446cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44680a8e50 0x7f44680ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f446cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44680a8e50 0x7f44680ab880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60470/0 (socket says 172.21.15.49:60470) 2024-01-22T05:12:29.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f446cc00700 1 -- 172.21.15.49:0/1477992373 learned_addr learned my addr 172.21.15.49:0/1477992373 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:29.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f446d600700 1 --2- 172.21.15.49:0/1477992373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4468066070 0x7f446813f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f446e000700 1 --2- 172.21.15.49:0/1477992373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4468155d20 0x7f44680abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f446cc00700 1 -- 172.21.15.49:0/1477992373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4468155d20 msgr2=0x7f44680abd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f446cc00700 1 --2- 172.21.15.49:0/1477992373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4468155d20 0x7f44680abd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f446cc00700 1 -- 172.21.15.49:0/1477992373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4468066070 msgr2=0x7f446813f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f446cc00700 1 --2- 172.21.15.49:0/1477992373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4468066070 0x7f446813f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f446cc00700 1 -- 172.21.15.49:0/1477992373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44580092a0 con 0x7f44680a8e50 2024-01-22T05:12:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f446e000700 1 --2- 172.21.15.49:0/1477992373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4468155d20 0x7f44680abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f446cc00700 1 --2- 172.21.15.49:0/1477992373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44680a8e50 0x7f44680ab880 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f4450007fd0 tx=0x7f4450007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f4464c00700 1 -- 172.21.15.49:0/1477992373 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44500072e0 con 0x7f44680a8e50 2024-01-22T05:12:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f4464c00700 1 -- 172.21.15.49:0/1477992373 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4450007440 con 0x7f44680a8e50 2024-01-22T05:12:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f4470000700 1 -- 172.21.15.49:0/1477992373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4468159bb0 con 0x7f44680a8e50 2024-01-22T05:12:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f4464c00700 1 -- 172.21.15.49:0/1477992373 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44500057a0 con 0x7f44680a8e50 2024-01-22T05:12:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.498+0000 7f4470000700 1 -- 172.21.15.49:0/1477992373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446813fc20 con 0x7f44680a8e50 2024-01-22T05:12:29.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.502+0000 7f4470000700 1 -- 172.21.15.49:0/1477992373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4468047060 con 0x7f44680a8e50 2024-01-22T05:12:29.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.502+0000 7f4464c00700 1 -- 172.21.15.49:0/1477992373 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4450005b90 con 0x7f44680a8e50 2024-01-22T05:12:29.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.506+0000 7f4464c00700 1 --2- 172.21.15.49:0/1477992373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f444005a510 0x7f444005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.506+0000 7f4464c00700 1 -- 172.21.15.49:0/1477992373 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4450074110 con 0x7f44680a8e50 2024-01-22T05:12:29.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.506+0000 7f446d600700 1 --2- 172.21.15.49:0/1477992373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f444005a510 0x7f444005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.506+0000 7f446d600700 1 --2- 172.21.15.49:0/1477992373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f444005a510 0x7f444005c9d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f445800b340 tx=0x7f4458017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:29.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.510+0000 7f4464c00700 1 -- 172.21.15.49:0/1477992373 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f44500476d0 con 0x7f44680a8e50 2024-01-22T05:12:29.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.674+0000 7f4470000700 1 -- 172.21.15.49:0/1477992373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4468046800 con 0x7f44680a8e50 2024-01-22T05:12:29.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.678+0000 7f4464c00700 1 -- 172.21.15.49:0/1477992373 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+17178 (secure 0 0 0) 0x7f445004acf0 con 0x7f44680a8e50 2024-01-22T05:12:29.683 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:29.683 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":104,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:12:26.847459+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:12:23.950155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-01-22T05:12:24.858181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:12:29.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.682+0000 7f4470000700 1 -- 172.21.15.49:0/1477992373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f444005a510 msgr2=0x7f444005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.682+0000 7f4470000700 1 --2- 172.21.15.49:0/1477992373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f444005a510 0x7f444005c9d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f445800b340 tx=0x7f4458017000).stop 2024-01-22T05:12:29.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.682+0000 7f4470000700 1 -- 172.21.15.49:0/1477992373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44680a8e50 msgr2=0x7f44680ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.682+0000 7f4470000700 1 --2- 172.21.15.49:0/1477992373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44680a8e50 0x7f44680ab880 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f4450007fd0 tx=0x7f4450007df0).stop 2024-01-22T05:12:29.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.682+0000 7f4470000700 1 -- 172.21.15.49:0/1477992373 shutdown_connections 2024-01-22T05:12:29.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.682+0000 7f4470000700 1 --2- 172.21.15.49:0/1477992373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f444005a510 0x7f444005c9d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.682+0000 7f4470000700 1 --2- 172.21.15.49:0/1477992373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4468155d20 0x7f44680abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.682+0000 7f4470000700 1 --2- 172.21.15.49:0/1477992373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44680a8e50 0x7f44680ab880 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.682+0000 7f4470000700 1 --2- 172.21.15.49:0/1477992373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4468066070 0x7f446813f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.682+0000 7f4470000700 1 -- 172.21.15.49:0/1477992373 >> 172.21.15.49:0/1477992373 conn(0x7f44680c6540 msgr2=0x7f4468068620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:29.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.682+0000 7f4470000700 1 -- 172.21.15.49:0/1477992373 shutdown_connections 2024-01-22T05:12:29.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.682+0000 7f4470000700 1 -- 172.21.15.49:0/1477992373 wait complete. 2024-01-22T05:12:29.709 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:12:29.710 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:12:29.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.874+0000 7f4d47000700 1 Processor -- start 2024-01-22T05:12:29.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.874+0000 7f4d47000700 1 -- start start 2024-01-22T05:12:29.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d47000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d400c25e0 0x7f4d400a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d47000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d400c1a40 con 0x7f4d40155d20 2024-01-22T05:12:29.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d47000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d400a90b0 con 0x7f4d400a8740 2024-01-22T05:12:29.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d47000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40159310 con 0x7f4d400c25e0 2024-01-22T05:12:29.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3fe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4d40155d20 0x7f4d40065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36188/0 (socket says 172.21.15.49:36188) 2024-01-22T05:12:29.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3fe00700 1 -- 172.21.15.49:0/3826762812 learned_addr learned my addr 172.21.15.49:0/3826762812 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:29.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d45000700 1 --2- 172.21.15.49:0/3826762812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d400c25e0 0x7f4d400a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490243278 0 0) 0x7f4d400c1a40 con 0x7f4d40155d20 2024-01-22T05:12:29.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d200033f0 con 0x7f4d40155d20 2024-01-22T05:12:29.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305887104 0 0) 0x7f4d400a90b0 con 0x7f4d400a8740 2024-01-22T05:12:29.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d400c1a40 con 0x7f4d400a8740 2024-01-22T05:12:29.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1055495462 0 0) 0x7f4d200033f0 con 0x7f4d40155d20 2024-01-22T05:12:29.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d400c25e0 msgr2=0x7f4d400a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:29.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 --2- 172.21.15.49:0/3826762812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d400c25e0 0x7f4d400a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 >> v1:172.21.15.110:6789/0 conn(0x7f4d400a8740 legacy=0x7f4d400c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d400c13f0 con 0x7f4d40155d20 2024-01-22T05:12:29.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f4d30001470 con 0x7f4d40155d20 2024-01-22T05:12:29.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 >> v1:172.21.15.49:6789/0 conn(0x7f4d40155d20 legacy=0x7f4d40065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 --2- 172.21.15.49:0/3826762812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d20003aa0 0x7f4d20003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 --2- 172.21.15.49:0/3826762812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d20004690 0x7f4d20004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 --2- 172.21.15.49:0/3826762812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d400c25e0 0x7f4d20005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40159310 con 0x7f4d20004690 2024-01-22T05:12:29.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2000b8e0 con 0x7f4d20003aa0 2024-01-22T05:12:29.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2000ba50 con 0x7f4d400c25e0 2024-01-22T05:12:29.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3fe00700 1 --2- 172.21.15.49:0/3826762812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d20003aa0 0x7f4d20003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3f400700 1 --2- 172.21.15.49:0/3826762812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d20004690 0x7f4d20004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d45000700 1 --2- 172.21.15.49:0/3826762812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d400c25e0 0x7f4d20005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3fe00700 1 -- 172.21.15.49:0/3826762812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d400c25e0 msgr2=0x7f4d20005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:29.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3fe00700 1 --2- 172.21.15.49:0/3826762812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d400c25e0 0x7f4d20005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3fe00700 1 -- 172.21.15.49:0/3826762812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d20004690 msgr2=0x7f4d20004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:29.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3fe00700 1 --2- 172.21.15.49:0/3826762812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d20004690 0x7f4d20004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.878+0000 7f4d3fe00700 1 -- 172.21.15.49:0/3826762812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d200033f0 con 0x7f4d20003aa0 2024-01-22T05:12:29.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.882+0000 7f4d3fe00700 1 --2- 172.21.15.49:0/3826762812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d20003aa0 0x7f4d20003e80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f4d3000c460 tx=0x7f4d300079e0).ready entity=mon.1 client_cookie=f392237a3069bcf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:29.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.882+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30007cf0 con 0x7f4d20003aa0 2024-01-22T05:12:29.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.882+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3000cd10 con 0x7f4d20003aa0 2024-01-22T05:12:29.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.882+0000 7f4d3ea00700 1 -- 172.21.15.49:0/3826762812 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30007320 con 0x7f4d20003aa0 2024-01-22T05:12:29.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.882+0000 7f4d47000700 1 -- 172.21.15.49:0/3826762812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d20003aa0 msgr2=0x7f4d20003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.882+0000 7f4d47000700 1 --2- 172.21.15.49:0/3826762812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d20003aa0 0x7f4d20003e80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f4d3000c460 tx=0x7f4d300079e0).stop 2024-01-22T05:12:29.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.882+0000 7f4d45000700 1 -- 172.21.15.49:0/3826762812 reap_dead start 2024-01-22T05:12:29.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.882+0000 7f4d47000700 1 -- 172.21.15.49:0/3826762812 shutdown_connections 2024-01-22T05:12:29.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.882+0000 7f4d47000700 1 -- 172.21.15.49:0/3826762812 >> 172.21.15.49:0/3826762812 conn(0x7f4d400c6540 msgr2=0x7f4d400c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:29.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.882+0000 7f4d47000700 1 -- 172.21.15.49:0/3826762812 shutdown_connections 2024-01-22T05:12:29.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.882+0000 7f4d47000700 1 -- 172.21.15.49:0/3826762812 wait complete. 2024-01-22T05:12:29.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d47000700 1 Processor -- start 2024-01-22T05:12:29.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d47000700 1 -- start start 2024-01-22T05:12:29.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d47000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d20003aa0 0x7f4d400aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d47000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d40152bd0 0x7f4d400bff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d47000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d400ab9f0 0x7f4d400abe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d47000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d400bfac0 con 0x7f4d20003aa0 2024-01-22T05:12:29.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d47000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d400ac360 con 0x7f4d40152bd0 2024-01-22T05:12:29.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d47000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d400beeb0 con 0x7f4d400ab9f0 2024-01-22T05:12:29.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d3fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d20003aa0 0x7f4d400aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d3fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d20003aa0 0x7f4d400aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60490/0 (socket says 172.21.15.49:60490) 2024-01-22T05:12:29.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d3fe00700 1 -- 172.21.15.49:0/983477719 learned_addr learned my addr 172.21.15.49:0/983477719 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:29.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d45000700 1 --2- 172.21.15.49:0/983477719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d400ab9f0 0x7f4d400abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d3f400700 1 --2- 172.21.15.49:0/983477719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d40152bd0 0x7f4d400bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d3fe00700 1 -- 172.21.15.49:0/983477719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d400ab9f0 msgr2=0x7f4d400abe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d3fe00700 1 --2- 172.21.15.49:0/983477719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d400ab9f0 0x7f4d400abe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d3fe00700 1 -- 172.21.15.49:0/983477719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d40152bd0 msgr2=0x7f4d400bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:29.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d3fe00700 1 --2- 172.21.15.49:0/983477719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d40152bd0 0x7f4d400bff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:29.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d3fe00700 1 -- 172.21.15.49:0/983477719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d400bf190 con 0x7f4d20003aa0 2024-01-22T05:12:29.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d3fe00700 1 --2- 172.21.15.49:0/983477719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d20003aa0 0x7f4d400aa890 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f4d30007750 tx=0x7f4d30015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:29.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.886+0000 7f4d37400700 1 -- 172.21.15.49:0/983477719 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3000ce80 con 0x7f4d20003aa0 2024-01-22T05:12:29.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.890+0000 7f4d37400700 1 -- 172.21.15.49:0/983477719 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d300046b0 con 0x7f4d20003aa0 2024-01-22T05:12:29.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.890+0000 7f4d47000700 1 -- 172.21.15.49:0/983477719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d400bf470 con 0x7f4d20003aa0 2024-01-22T05:12:29.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.890+0000 7f4d37400700 1 -- 172.21.15.49:0/983477719 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30004a30 con 0x7f4d20003aa0 2024-01-22T05:12:29.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.890+0000 7f4d47000700 1 -- 172.21.15.49:0/983477719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d400aad80 con 0x7f4d20003aa0 2024-01-22T05:12:29.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.890+0000 7f4d47000700 1 -- 172.21.15.49:0/983477719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d400bf8f0 con 0x7f4d20003aa0 2024-01-22T05:12:29.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.890+0000 7f4d37400700 1 -- 172.21.15.49:0/983477719 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4d30020450 con 0x7f4d20003aa0 2024-01-22T05:12:29.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.894+0000 7f4d37400700 1 --2- 172.21.15.49:0/983477719 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d1805a540 0x7f4d1805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:29.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.894+0000 7f4d37400700 1 -- 172.21.15.49:0/983477719 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4d30075800 con 0x7f4d20003aa0 2024-01-22T05:12:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.894+0000 7f4d3f400700 1 --2- 172.21.15.49:0/983477719 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d1805a540 0x7f4d1805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.894+0000 7f4d3f400700 1 --2- 172.21.15.49:0/983477719 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d1805a540 0x7f4d1805ca00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f4d40158e90 tx=0x7f4d28009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:29.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:29.902+0000 7f4d37400700 1 -- 172.21.15.49:0/983477719 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4d30048e10 con 0x7f4d20003aa0 2024-01-22T05:12:30.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.062+0000 7f4d47000700 1 -- 172.21.15.49:0/983477719 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d400bfc00 con 0x7f4d1805a540 2024-01-22T05:12:30.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.074+0000 7f4d37400700 1 -- 172.21.15.49:0/983477719 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359702 (secure 0 0 0) 0x7f4d280037c0 con 0x7f4d1805a540 2024-01-22T05:12:30.085 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:30.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.082+0000 7f4d47000700 1 -- 172.21.15.49:0/983477719 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d1805a540 msgr2=0x7f4d1805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:30.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.082+0000 7f4d47000700 1 --2- 172.21.15.49:0/983477719 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d1805a540 0x7f4d1805ca00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f4d40158e90 tx=0x7f4d28009040).stop 2024-01-22T05:12:30.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.082+0000 7f4d47000700 1 -- 172.21.15.49:0/983477719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d20003aa0 msgr2=0x7f4d400aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:30.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.082+0000 7f4d47000700 1 --2- 172.21.15.49:0/983477719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d20003aa0 0x7f4d400aa890 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f4d30007750 tx=0x7f4d30015000).stop 2024-01-22T05:12:30.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.082+0000 7f4d47000700 1 -- 172.21.15.49:0/983477719 shutdown_connections 2024-01-22T05:12:30.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.082+0000 7f4d47000700 1 --2- 172.21.15.49:0/983477719 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d1805a540 0x7f4d1805ca00 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.082+0000 7f4d47000700 1 --2- 172.21.15.49:0/983477719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d400ab9f0 0x7f4d400abe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.082+0000 7f4d47000700 1 --2- 172.21.15.49:0/983477719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d40152bd0 0x7f4d400bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.082+0000 7f4d47000700 1 --2- 172.21.15.49:0/983477719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d20003aa0 0x7f4d400aa890 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.082+0000 7f4d47000700 1 -- 172.21.15.49:0/983477719 >> 172.21.15.49:0/983477719 conn(0x7f4d400c6540 msgr2=0x7f4d400c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:30.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.086+0000 7f4d47000700 1 -- 172.21.15.49:0/983477719 shutdown_connections 2024-01-22T05:12:30.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.086+0000 7f4d47000700 1 -- 172.21.15.49:0/983477719 wait complete. 2024-01-22T05:12:30.092 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:12:30.110 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-01-22T05:12:29.399065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428748,"kb_used_data":9996,"kb_used_omap":0,"kb_used_meta":2418688,"kb_avail":752545972,"statfs":{"total":773094113280,"available":770607075328,"internally_reserved":0,"allocated":10235904,"data_stored":5016853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2476736512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2597014,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1997,"num_read_kb":-2282,"num_write":-19860,"num_write_kb":-94304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-19,"num_bytes_recovered":-46,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.912939"},"pg_stats":[{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.889590+0000","last_change":"2024-01-22T05:12:25.879013+0000","last_active":"2024-01-22T05:12:25.889590+0000","last_peered":"2024-01-22T05:12:25.889590+0000","last_clean":"2024-01-22T05:12:25.889590+0000","last_became_active":"2024-01-22T05:12:25.878393+0000","last_became_peered":"2024-01-22T05:12:25.878393+0000","last_unstale":"2024-01-22T05:12:25.889590+0000","last_undegraded":"2024-01-22T05:12:25.889590+0000","last_fullsized":"2024-01-22T05:12:25.889590+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.3f","version":"103'3","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.901353+0000","last_change":"2024-01-22T05:12:25.426821+0000","last_active":"2024-01-22T05:12:25.901353+0000","last_peered":"2024-01-22T05:12:25.901353+0000","last_clean":"2024-01-22T05:12:25.901353+0000","last_became_active":"2024-01-22T05:12:25.426523+0000","last_became_peered":"2024-01-22T05:12:25.426523+0000","last_unstale":"2024-01-22T05:12:25.901353+0000","last_undegraded":"2024-01-22T05:12:25.901353+0000","last_fullsized":"2024-01-22T05:12:25.901353+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.888888+0000","last_change":"2024-01-22T05:12:25.881275+0000","last_active":"2024-01-22T05:12:25.888888+0000","last_peered":"2024-01-22T05:12:25.888888+0000","last_clean":"2024-01-22T05:12:25.888888+0000","last_became_active":"2024-01-22T05:12:25.880780+0000","last_became_peered":"2024-01-22T05:12:25.880780+0000","last_unstale":"2024-01-22T05:12:25.888888+0000","last_undegraded":"2024-01-22T05:12:25.888888+0000","last_fullsized":"2024-01-22T05:12:25.888888+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.852766+0000","last_change":"2024-01-22T05:12:25.415146+0000","last_active":"2024-01-22T05:12:25.852766+0000","last_peered":"2024-01-22T05:12:25.852766+0000","last_clean":"2024-01-22T05:12:25.852766+0000","last_became_active":"2024-01-22T05:12:25.414865+0000","last_became_peered":"2024-01-22T05:12:25.414865+0000","last_unstale":"2024-01-22T05:12:25.852766+0000","last_undegraded":"2024-01-22T05:12:25.852766+0000","last_fullsized":"2024-01-22T05:12:25.852766+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.890367+0000","last_change":"2024-01-22T05:12:25.890367+0000","last_active":"2024-01-22T05:12:25.890367+0000","last_peered":"2024-01-22T05:12:25.890367+0000","last_clean":"2024-01-22T05:12:25.890367+0000","last_became_active":"2024-01-22T05:12:25.890071+0000","last_became_peered":"2024-01-22T05:12:25.890071+0000","last_unstale":"2024-01-22T05:12:25.890367+0000","last_undegraded":"2024-01-22T05:12:25.890367+0000","last_fullsized":"2024-01-22T05:12:25.890367+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.440612+0000","last_change":"2024-01-22T05:12:25.424228+0000","last_active":"2024-01-22T05:12:25.440612+0000","last_peered":"2024-01-22T05:12:25.440612+0000","last_clean":"2024-01-22T05:12:25.440612+0000","last_became_active":"2024-01-22T05:12:25.423942+0000","last_became_peered":"2024-01-22T05:12:25.423942+0000","last_unstale":"2024-01-22T05:12:25.440612+0000","last_undegraded":"2024-01-22T05:12:25.440612+0000","last_fullsized":"2024-01-22T05:12:25.440612+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.888937+0000","last_change":"2024-01-22T05:12:25.881313+0000","last_active":"2024-01-22T05:12:25.888937+0000","last_peered":"2024-01-22T05:12:25.888937+0000","last_clean":"2024-01-22T05:12:25.888937+0000","last_became_active":"2024-01-22T05:12:25.881019+0000","last_became_peered":"2024-01-22T05:12:25.881019+0000","last_unstale":"2024-01-22T05:12:25.888937+0000","last_undegraded":"2024-01-22T05:12:25.888937+0000","last_fullsized":"2024-01-22T05:12:25.888937+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3c","version":"103'2","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.896977+0000","last_change":"2024-01-22T05:12:25.433858+0000","last_active":"2024-01-22T05:12:25.896977+0000","last_peered":"2024-01-22T05:12:25.896977+0000","last_clean":"2024-01-22T05:12:25.896977+0000","last_became_active":"2024-01-22T05:12:25.433536+0000","last_became_peered":"2024-01-22T05:12:25.433536+0000","last_unstale":"2024-01-22T05:12:25.896977+0000","last_undegraded":"2024-01-22T05:12:25.896977+0000","last_fullsized":"2024-01-22T05:12:25.896977+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.877470+0000","last_change":"2024-01-22T05:12:25.877470+0000","last_active":"2024-01-22T05:12:25.877470+0000","last_peered":"2024-01-22T05:12:25.877470+0000","last_clean":"2024-01-22T05:12:25.877470+0000","last_became_active":"2024-01-22T05:12:25.876061+0000","last_became_peered":"2024-01-22T05:12:25.876061+0000","last_unstale":"2024-01-22T05:12:25.877470+0000","last_undegraded":"2024-01-22T05:12:25.877470+0000","last_fullsized":"2024-01-22T05:12:25.877470+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"103'1","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884911+0000","last_change":"2024-01-22T05:12:25.410105+0000","last_active":"2024-01-22T05:12:25.884911+0000","last_peered":"2024-01-22T05:12:25.884911+0000","last_clean":"2024-01-22T05:12:25.884911+0000","last_became_active":"2024-01-22T05:12:25.409816+0000","last_became_peered":"2024-01-22T05:12:25.409816+0000","last_unstale":"2024-01-22T05:12:25.884911+0000","last_undegraded":"2024-01-22T05:12:25.884911+0000","last_fullsized":"2024-01-22T05:12:25.884911+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.873592+0000","last_change":"2024-01-22T05:12:25.873592+0000","last_active":"2024-01-22T05:12:25.873592+0000","last_peered":"2024-01-22T05:12:25.873592+0000","last_clean":"2024-01-22T05:12:25.873592+0000","last_became_active":"2024-01-22T05:12:25.872966+0000","last_became_peered":"2024-01-22T05:12:25.872966+0000","last_unstale":"2024-01-22T05:12:25.873592+0000","last_undegraded":"2024-01-22T05:12:25.873592+0000","last_fullsized":"2024-01-22T05:12:25.873592+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3a","version":"103'1","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.885424+0000","last_change":"2024-01-22T05:12:25.428643+0000","last_active":"2024-01-22T05:12:25.885424+0000","last_peered":"2024-01-22T05:12:25.885424+0000","last_clean":"2024-01-22T05:12:25.885424+0000","last_became_active":"2024-01-22T05:12:25.428393+0000","last_became_peered":"2024-01-22T05:12:25.428393+0000","last_unstale":"2024-01-22T05:12:25.885424+0000","last_undegraded":"2024-01-22T05:12:25.885424+0000","last_fullsized":"2024-01-22T05:12:25.885424+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.886687+0000","last_change":"2024-01-22T05:12:25.878702+0000","last_active":"2024-01-22T05:12:25.886687+0000","last_peered":"2024-01-22T05:12:25.886687+0000","last_clean":"2024-01-22T05:12:25.886687+0000","last_became_active":"2024-01-22T05:12:25.878441+0000","last_became_peered":"2024-01-22T05:12:25.878441+0000","last_unstale":"2024-01-22T05:12:25.886687+0000","last_undegraded":"2024-01-22T05:12:25.886687+0000","last_fullsized":"2024-01-22T05:12:25.886687+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.420253+0000","last_change":"2024-01-22T05:12:25.419051+0000","last_active":"2024-01-22T05:12:25.420253+0000","last_peered":"2024-01-22T05:12:25.420253+0000","last_clean":"2024-01-22T05:12:25.420253+0000","last_became_active":"2024-01-22T05:12:25.418718+0000","last_became_peered":"2024-01-22T05:12:25.418718+0000","last_unstale":"2024-01-22T05:12:25.420253+0000","last_undegraded":"2024-01-22T05:12:25.420253+0000","last_fullsized":"2024-01-22T05:12:25.420253+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.875187+0000","last_change":"2024-01-22T05:12:25.875187+0000","last_active":"2024-01-22T05:12:25.875187+0000","last_peered":"2024-01-22T05:12:25.875187+0000","last_clean":"2024-01-22T05:12:25.875187+0000","last_became_active":"2024-01-22T05:12:25.874910+0000","last_became_peered":"2024-01-22T05:12:25.874910+0000","last_unstale":"2024-01-22T05:12:25.875187+0000","last_undegraded":"2024-01-22T05:12:25.875187+0000","last_fullsized":"2024-01-22T05:12:25.875187+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.866065+0000","last_change":"2024-01-22T05:12:25.425615+0000","last_active":"2024-01-22T05:12:25.866065+0000","last_peered":"2024-01-22T05:12:25.866065+0000","last_clean":"2024-01-22T05:12:25.866065+0000","last_became_active":"2024-01-22T05:12:25.425353+0000","last_became_peered":"2024-01-22T05:12:25.425353+0000","last_unstale":"2024-01-22T05:12:25.866065+0000","last_undegraded":"2024-01-22T05:12:25.866065+0000","last_fullsized":"2024-01-22T05:12:25.866065+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.879751+0000","last_change":"2024-01-22T05:12:25.879751+0000","last_active":"2024-01-22T05:12:25.879751+0000","last_peered":"2024-01-22T05:12:25.879751+0000","last_clean":"2024-01-22T05:12:25.879751+0000","last_became_active":"2024-01-22T05:12:25.879463+0000","last_became_peered":"2024-01-22T05:12:25.879463+0000","last_unstale":"2024-01-22T05:12:25.879751+0000","last_undegraded":"2024-01-22T05:12:25.879751+0000","last_fullsized":"2024-01-22T05:12:25.879751+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.854916+0000","last_change":"2024-01-22T05:12:25.412836+0000","last_active":"2024-01-22T05:12:25.854916+0000","last_peered":"2024-01-22T05:12:25.854916+0000","last_clean":"2024-01-22T05:12:25.854916+0000","last_became_active":"2024-01-22T05:12:25.412531+0000","last_became_peered":"2024-01-22T05:12:25.412531+0000","last_unstale":"2024-01-22T05:12:25.854916+0000","last_undegraded":"2024-01-22T05:12:25.854916+0000","last_fullsized":"2024-01-22T05:12:25.854916+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.898337+0000","last_change":"2024-01-22T05:12:25.897041+0000","last_active":"2024-01-22T05:12:25.898337+0000","last_peered":"2024-01-22T05:12:25.898337+0000","last_clean":"2024-01-22T05:12:25.898337+0000","last_became_active":"2024-01-22T05:12:25.896698+0000","last_became_peered":"2024-01-22T05:12:25.896698+0000","last_unstale":"2024-01-22T05:12:25.898337+0000","last_undegraded":"2024-01-22T05:12:25.898337+0000","last_fullsized":"2024-01-22T05:12:25.898337+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.441942+0000","last_change":"2024-01-22T05:12:25.436854+0000","last_active":"2024-01-22T05:12:25.441942+0000","last_peered":"2024-01-22T05:12:25.441942+0000","last_clean":"2024-01-22T05:12:25.441942+0000","last_became_active":"2024-01-22T05:12:25.436584+0000","last_became_peered":"2024-01-22T05:12:25.436584+0000","last_unstale":"2024-01-22T05:12:25.441942+0000","last_undegraded":"2024-01-22T05:12:25.441942+0000","last_fullsized":"2024-01-22T05:12:25.441942+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.885758+0000","last_change":"2024-01-22T05:12:25.879873+0000","last_active":"2024-01-22T05:12:25.885758+0000","last_peered":"2024-01-22T05:12:25.885758+0000","last_clean":"2024-01-22T05:12:25.885758+0000","last_became_active":"2024-01-22T05:12:25.879108+0000","last_became_peered":"2024-01-22T05:12:25.879108+0000","last_unstale":"2024-01-22T05:12:25.885758+0000","last_undegraded":"2024-01-22T05:12:25.885758+0000","last_fullsized":"2024-01-22T05:12:25.885758+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.855429+0000","last_change":"2024-01-22T05:12:25.420672+0000","last_active":"2024-01-22T05:12:25.855429+0000","last_peered":"2024-01-22T05:12:25.855429+0000","last_clean":"2024-01-22T05:12:25.855429+0000","last_became_active":"2024-01-22T05:12:25.420321+0000","last_became_peered":"2024-01-22T05:12:25.420321+0000","last_unstale":"2024-01-22T05:12:25.855429+0000","last_undegraded":"2024-01-22T05:12:25.855429+0000","last_fullsized":"2024-01-22T05:12:25.855429+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884797+0000","last_change":"2024-01-22T05:12:25.884797+0000","last_active":"2024-01-22T05:12:25.884797+0000","last_peered":"2024-01-22T05:12:25.884797+0000","last_clean":"2024-01-22T05:12:25.884797+0000","last_became_active":"2024-01-22T05:12:25.883665+0000","last_became_peered":"2024-01-22T05:12:25.883665+0000","last_unstale":"2024-01-22T05:12:25.884797+0000","last_undegraded":"2024-01-22T05:12:25.884797+0000","last_fullsized":"2024-01-22T05:12:25.884797+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.34","version":"103'4","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.900251+0000","last_change":"2024-01-22T05:12:25.432783+0000","last_active":"2024-01-22T05:12:25.900251+0000","last_peered":"2024-01-22T05:12:25.900251+0000","last_clean":"2024-01-22T05:12:25.900251+0000","last_became_active":"2024-01-22T05:12:25.432505+0000","last_became_peered":"2024-01-22T05:12:25.432505+0000","last_unstale":"2024-01-22T05:12:25.900251+0000","last_undegraded":"2024-01-22T05:12:25.900251+0000","last_fullsized":"2024-01-22T05:12:25.900251+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.889190+0000","last_change":"2024-01-22T05:12:25.889190+0000","last_active":"2024-01-22T05:12:25.889190+0000","last_peered":"2024-01-22T05:12:25.889190+0000","last_clean":"2024-01-22T05:12:25.889190+0000","last_became_active":"2024-01-22T05:12:25.887854+0000","last_became_peered":"2024-01-22T05:12:25.887854+0000","last_unstale":"2024-01-22T05:12:25.889190+0000","last_undegraded":"2024-01-22T05:12:25.889190+0000","last_fullsized":"2024-01-22T05:12:25.889190+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"103'1","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.897034+0000","last_change":"2024-01-22T05:12:25.427382+0000","last_active":"2024-01-22T05:12:25.897034+0000","last_peered":"2024-01-22T05:12:25.897034+0000","last_clean":"2024-01-22T05:12:25.897034+0000","last_became_active":"2024-01-22T05:12:25.427079+0000","last_became_peered":"2024-01-22T05:12:25.427079+0000","last_unstale":"2024-01-22T05:12:25.897034+0000","last_undegraded":"2024-01-22T05:12:25.897034+0000","last_fullsized":"2024-01-22T05:12:25.897034+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.891063+0000","last_change":"2024-01-22T05:12:25.891063+0000","last_active":"2024-01-22T05:12:25.891063+0000","last_peered":"2024-01-22T05:12:25.891063+0000","last_clean":"2024-01-22T05:12:25.891063+0000","last_became_active":"2024-01-22T05:12:25.890783+0000","last_became_peered":"2024-01-22T05:12:25.890783+0000","last_unstale":"2024-01-22T05:12:25.891063+0000","last_undegraded":"2024-01-22T05:12:25.891063+0000","last_fullsized":"2024-01-22T05:12:25.891063+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.852222+0000","last_change":"2024-01-22T05:12:25.429742+0000","last_active":"2024-01-22T05:12:25.852222+0000","last_peered":"2024-01-22T05:12:25.852222+0000","last_clean":"2024-01-22T05:12:25.852222+0000","last_became_active":"2024-01-22T05:12:25.429380+0000","last_became_peered":"2024-01-22T05:12:25.429380+0000","last_unstale":"2024-01-22T05:12:25.852222+0000","last_undegraded":"2024-01-22T05:12:25.852222+0000","last_fullsized":"2024-01-22T05:12:25.852222+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884824+0000","last_change":"2024-01-22T05:12:25.884824+0000","last_active":"2024-01-22T05:12:25.884824+0000","last_peered":"2024-01-22T05:12:25.884824+0000","last_clean":"2024-01-22T05:12:25.884824+0000","last_became_active":"2024-01-22T05:12:25.884531+0000","last_became_peered":"2024-01-22T05:12:25.884531+0000","last_unstale":"2024-01-22T05:12:25.884824+0000","last_undegraded":"2024-01-22T05:12:25.884824+0000","last_fullsized":"2024-01-22T05:12:25.884824+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.866500+0000","last_change":"2024-01-22T05:12:25.439604+0000","last_active":"2024-01-22T05:12:25.866500+0000","last_peered":"2024-01-22T05:12:25.866500+0000","last_clean":"2024-01-22T05:12:25.866500+0000","last_became_active":"2024-01-22T05:12:25.439307+0000","last_became_peered":"2024-01-22T05:12:25.439307+0000","last_unstale":"2024-01-22T05:12:25.866500+0000","last_undegraded":"2024-01-22T05:12:25.866500+0000","last_fullsized":"2024-01-22T05:12:25.866500+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884059+0000","last_change":"2024-01-22T05:12:25.884059+0000","last_active":"2024-01-22T05:12:25.884059+0000","last_peered":"2024-01-22T05:12:25.884059+0000","last_clean":"2024-01-22T05:12:25.884059+0000","last_became_active":"2024-01-22T05:12:25.883721+0000","last_became_peered":"2024-01-22T05:12:25.883721+0000","last_unstale":"2024-01-22T05:12:25.884059+0000","last_undegraded":"2024-01-22T05:12:25.884059+0000","last_fullsized":"2024-01-22T05:12:25.884059+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.30","version":"103'4","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.886642+0000","last_change":"2024-01-22T05:12:25.417540+0000","last_active":"2024-01-22T05:12:25.886642+0000","last_peered":"2024-01-22T05:12:25.886642+0000","last_clean":"2024-01-22T05:12:25.886642+0000","last_became_active":"2024-01-22T05:12:25.417079+0000","last_became_peered":"2024-01-22T05:12:25.417079+0000","last_unstale":"2024-01-22T05:12:25.886642+0000","last_undegraded":"2024-01-22T05:12:25.886642+0000","last_fullsized":"2024-01-22T05:12:25.886642+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.891434+0000","last_change":"2024-01-22T05:12:25.891434+0000","last_active":"2024-01-22T05:12:25.891434+0000","last_peered":"2024-01-22T05:12:25.891434+0000","last_clean":"2024-01-22T05:12:25.891434+0000","last_became_active":"2024-01-22T05:12:25.886101+0000","last_became_peered":"2024-01-22T05:12:25.886101+0000","last_unstale":"2024-01-22T05:12:25.891434+0000","last_undegraded":"2024-01-22T05:12:25.891434+0000","last_fullsized":"2024-01-22T05:12:25.891434+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.855439+0000","last_change":"2024-01-22T05:12:25.417283+0000","last_active":"2024-01-22T05:12:25.855439+0000","last_peered":"2024-01-22T05:12:25.855439+0000","last_clean":"2024-01-22T05:12:25.855439+0000","last_became_active":"2024-01-22T05:12:25.416973+0000","last_became_peered":"2024-01-22T05:12:25.416973+0000","last_unstale":"2024-01-22T05:12:25.855439+0000","last_undegraded":"2024-01-22T05:12:25.855439+0000","last_fullsized":"2024-01-22T05:12:25.855439+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.899538+0000","last_change":"2024-01-22T05:12:25.895906+0000","last_active":"2024-01-22T05:12:25.899538+0000","last_peered":"2024-01-22T05:12:25.899538+0000","last_clean":"2024-01-22T05:12:25.899538+0000","last_became_active":"2024-01-22T05:12:25.895716+0000","last_became_peered":"2024-01-22T05:12:25.895716+0000","last_unstale":"2024-01-22T05:12:25.899538+0000","last_undegraded":"2024-01-22T05:12:25.899538+0000","last_fullsized":"2024-01-22T05:12:25.899538+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.436018+0000","last_change":"2024-01-22T05:12:25.418633+0000","last_active":"2024-01-22T05:12:25.436018+0000","last_peered":"2024-01-22T05:12:25.436018+0000","last_clean":"2024-01-22T05:12:25.436018+0000","last_became_active":"2024-01-22T05:12:25.417905+0000","last_became_peered":"2024-01-22T05:12:25.417905+0000","last_unstale":"2024-01-22T05:12:25.436018+0000","last_undegraded":"2024-01-22T05:12:25.436018+0000","last_fullsized":"2024-01-22T05:12:25.436018+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.882247+0000","last_change":"2024-01-22T05:12:25.871920+0000","last_active":"2024-01-22T05:12:25.882247+0000","last_peered":"2024-01-22T05:12:25.882247+0000","last_clean":"2024-01-22T05:12:25.882247+0000","last_became_active":"2024-01-22T05:12:25.871632+0000","last_became_peered":"2024-01-22T05:12:25.871632+0000","last_unstale":"2024-01-22T05:12:25.882247+0000","last_undegraded":"2024-01-22T05:12:25.882247+0000","last_fullsized":"2024-01-22T05:12:25.882247+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"103'1","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.893177+0000","last_change":"2024-01-22T05:12:25.429819+0000","last_active":"2024-01-22T05:12:25.893177+0000","last_peered":"2024-01-22T05:12:25.893177+0000","last_clean":"2024-01-22T05:12:25.893177+0000","last_became_active":"2024-01-22T05:12:25.429464+0000","last_became_peered":"2024-01-22T05:12:25.429464+0000","last_unstale":"2024-01-22T05:12:25.893177+0000","last_undegraded":"2024-01-22T05:12:25.893177+0000","last_fullsized":"2024-01-22T05:12:25.893177+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.886139+0000","last_change":"2024-01-22T05:12:25.886139+0000","last_active":"2024-01-22T05:12:25.886139+0000","last_peered":"2024-01-22T05:12:25.886139+0000","last_clean":"2024-01-22T05:12:25.886139+0000","last_became_active":"2024-01-22T05:12:25.885851+0000","last_became_peered":"2024-01-22T05:12:25.885851+0000","last_unstale":"2024-01-22T05:12:25.886139+0000","last_undegraded":"2024-01-22T05:12:25.886139+0000","last_fullsized":"2024-01-22T05:12:25.886139+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.867378+0000","last_change":"2024-01-22T05:12:25.438195+0000","last_active":"2024-01-22T05:12:25.867378+0000","last_peered":"2024-01-22T05:12:25.867378+0000","last_clean":"2024-01-22T05:12:25.867378+0000","last_became_active":"2024-01-22T05:12:25.437970+0000","last_became_peered":"2024-01-22T05:12:25.437970+0000","last_unstale":"2024-01-22T05:12:25.867378+0000","last_undegraded":"2024-01-22T05:12:25.867378+0000","last_fullsized":"2024-01-22T05:12:25.867378+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.885526+0000","last_change":"2024-01-22T05:12:25.879591+0000","last_active":"2024-01-22T05:12:25.885526+0000","last_peered":"2024-01-22T05:12:25.885526+0000","last_clean":"2024-01-22T05:12:25.885526+0000","last_became_active":"2024-01-22T05:12:25.879288+0000","last_became_peered":"2024-01-22T05:12:25.879288+0000","last_unstale":"2024-01-22T05:12:25.885526+0000","last_undegraded":"2024-01-22T05:12:25.885526+0000","last_fullsized":"2024-01-22T05:12:25.885526+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2b","version":"103'1","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884465+0000","last_change":"2024-01-22T05:12:25.409965+0000","last_active":"2024-01-22T05:12:25.884465+0000","last_peered":"2024-01-22T05:12:25.884465+0000","last_clean":"2024-01-22T05:12:25.884465+0000","last_became_active":"2024-01-22T05:12:25.409639+0000","last_became_peered":"2024-01-22T05:12:25.409639+0000","last_unstale":"2024-01-22T05:12:25.884465+0000","last_undegraded":"2024-01-22T05:12:25.884465+0000","last_fullsized":"2024-01-22T05:12:25.884465+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.878205+0000","last_change":"2024-01-22T05:12:25.878205+0000","last_active":"2024-01-22T05:12:25.878205+0000","last_peered":"2024-01-22T05:12:25.878205+0000","last_clean":"2024-01-22T05:12:25.878205+0000","last_became_active":"2024-01-22T05:12:25.877935+0000","last_became_peered":"2024-01-22T05:12:25.877935+0000","last_unstale":"2024-01-22T05:12:25.878205+0000","last_undegraded":"2024-01-22T05:12:25.878205+0000","last_fullsized":"2024-01-22T05:12:25.878205+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.855622+0000","last_change":"2024-01-22T05:12:25.429756+0000","last_active":"2024-01-22T05:12:25.855622+0000","last_peered":"2024-01-22T05:12:25.855622+0000","last_clean":"2024-01-22T05:12:25.855622+0000","last_became_active":"2024-01-22T05:12:25.429429+0000","last_became_peered":"2024-01-22T05:12:25.429429+0000","last_unstale":"2024-01-22T05:12:25.855622+0000","last_undegraded":"2024-01-22T05:12:25.855622+0000","last_fullsized":"2024-01-22T05:12:25.855622+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.890984+0000","last_change":"2024-01-22T05:12:25.890984+0000","last_active":"2024-01-22T05:12:25.890984+0000","last_peered":"2024-01-22T05:12:25.890984+0000","last_clean":"2024-01-22T05:12:25.890984+0000","last_became_active":"2024-01-22T05:12:25.890658+0000","last_became_peered":"2024-01-22T05:12:25.890658+0000","last_unstale":"2024-01-22T05:12:25.890984+0000","last_undegraded":"2024-01-22T05:12:25.890984+0000","last_fullsized":"2024-01-22T05:12:25.890984+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.421761+0000","last_change":"2024-01-22T05:12:25.420106+0000","last_active":"2024-01-22T05:12:25.421761+0000","last_peered":"2024-01-22T05:12:25.421761+0000","last_clean":"2024-01-22T05:12:25.421761+0000","last_became_active":"2024-01-22T05:12:25.419754+0000","last_became_peered":"2024-01-22T05:12:25.419754+0000","last_unstale":"2024-01-22T05:12:25.421761+0000","last_undegraded":"2024-01-22T05:12:25.421761+0000","last_fullsized":"2024-01-22T05:12:25.421761+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.886103+0000","last_change":"2024-01-22T05:12:25.879535+0000","last_active":"2024-01-22T05:12:25.886103+0000","last_peered":"2024-01-22T05:12:25.886103+0000","last_clean":"2024-01-22T05:12:25.886103+0000","last_became_active":"2024-01-22T05:12:25.879248+0000","last_became_peered":"2024-01-22T05:12:25.879248+0000","last_unstale":"2024-01-22T05:12:25.886103+0000","last_undegraded":"2024-01-22T05:12:25.886103+0000","last_fullsized":"2024-01-22T05:12:25.886103+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.441274+0000","last_change":"2024-01-22T05:12:25.425169+0000","last_active":"2024-01-22T05:12:25.441274+0000","last_peered":"2024-01-22T05:12:25.441274+0000","last_clean":"2024-01-22T05:12:25.441274+0000","last_became_active":"2024-01-22T05:12:25.424600+0000","last_became_peered":"2024-01-22T05:12:25.424600+0000","last_unstale":"2024-01-22T05:12:25.441274+0000","last_undegraded":"2024-01-22T05:12:25.441274+0000","last_fullsized":"2024-01-22T05:12:25.441274+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.885396+0000","last_change":"2024-01-22T05:12:25.876532+0000","last_active":"2024-01-22T05:12:25.885396+0000","last_peered":"2024-01-22T05:12:25.885396+0000","last_clean":"2024-01-22T05:12:25.885396+0000","last_became_active":"2024-01-22T05:12:25.876088+0000","last_became_peered":"2024-01-22T05:12:25.876088+0000","last_unstale":"2024-01-22T05:12:25.885396+0000","last_undegraded":"2024-01-22T05:12:25.885396+0000","last_fullsized":"2024-01-22T05:12:25.885396+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.854605+0000","last_change":"2024-01-22T05:12:25.410503+0000","last_active":"2024-01-22T05:12:25.854605+0000","last_peered":"2024-01-22T05:12:25.854605+0000","last_clean":"2024-01-22T05:12:25.854605+0000","last_became_active":"2024-01-22T05:12:25.410018+0000","last_became_peered":"2024-01-22T05:12:25.410018+0000","last_unstale":"2024-01-22T05:12:25.854605+0000","last_undegraded":"2024-01-22T05:12:25.854605+0000","last_fullsized":"2024-01-22T05:12:25.854605+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.874870+0000","last_change":"2024-01-22T05:12:25.874870+0000","last_active":"2024-01-22T05:12:25.874870+0000","last_peered":"2024-01-22T05:12:25.874870+0000","last_clean":"2024-01-22T05:12:25.874870+0000","last_became_active":"2024-01-22T05:12:25.874568+0000","last_became_peered":"2024-01-22T05:12:25.874568+0000","last_unstale":"2024-01-22T05:12:25.874870+0000","last_undegraded":"2024-01-22T05:12:25.874870+0000","last_fullsized":"2024-01-22T05:12:25.874870+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.855269+0000","last_change":"2024-01-22T05:12:25.431022+0000","last_active":"2024-01-22T05:12:25.855269+0000","last_peered":"2024-01-22T05:12:25.855269+0000","last_clean":"2024-01-22T05:12:25.855269+0000","last_became_active":"2024-01-22T05:12:25.430002+0000","last_became_peered":"2024-01-22T05:12:25.430002+0000","last_unstale":"2024-01-22T05:12:25.855269+0000","last_undegraded":"2024-01-22T05:12:25.855269+0000","last_fullsized":"2024-01-22T05:12:25.855269+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.874110+0000","last_change":"2024-01-22T05:12:25.874110+0000","last_active":"2024-01-22T05:12:25.874110+0000","last_peered":"2024-01-22T05:12:25.874110+0000","last_clean":"2024-01-22T05:12:25.874110+0000","last_became_active":"2024-01-22T05:12:25.872892+0000","last_became_peered":"2024-01-22T05:12:25.872892+0000","last_unstale":"2024-01-22T05:12:25.874110+0000","last_undegraded":"2024-01-22T05:12:25.874110+0000","last_fullsized":"2024-01-22T05:12:25.874110+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.426335+0000","last_change":"2024-01-22T05:12:25.419226+0000","last_active":"2024-01-22T05:12:25.426335+0000","last_peered":"2024-01-22T05:12:25.426335+0000","last_clean":"2024-01-22T05:12:25.426335+0000","last_became_active":"2024-01-22T05:12:25.418877+0000","last_became_peered":"2024-01-22T05:12:25.418877+0000","last_unstale":"2024-01-22T05:12:25.426335+0000","last_undegraded":"2024-01-22T05:12:25.426335+0000","last_fullsized":"2024-01-22T05:12:25.426335+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.874047+0000","last_change":"2024-01-22T05:12:25.874047+0000","last_active":"2024-01-22T05:12:25.874047+0000","last_peered":"2024-01-22T05:12:25.874047+0000","last_clean":"2024-01-22T05:12:25.874047+0000","last_became_active":"2024-01-22T05:12:25.873691+0000","last_became_peered":"2024-01-22T05:12:25.873691+0000","last_unstale":"2024-01-22T05:12:25.874047+0000","last_undegraded":"2024-01-22T05:12:25.874047+0000","last_fullsized":"2024-01-22T05:12:25.874047+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.867424+0000","last_change":"2024-01-22T05:12:25.423615+0000","last_active":"2024-01-22T05:12:25.867424+0000","last_peered":"2024-01-22T05:12:25.867424+0000","last_clean":"2024-01-22T05:12:25.867424+0000","last_became_active":"2024-01-22T05:12:25.422823+0000","last_became_peered":"2024-01-22T05:12:25.422823+0000","last_unstale":"2024-01-22T05:12:25.867424+0000","last_undegraded":"2024-01-22T05:12:25.867424+0000","last_fullsized":"2024-01-22T05:12:25.867424+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.888430+0000","last_change":"2024-01-22T05:12:25.888430+0000","last_active":"2024-01-22T05:12:25.888430+0000","last_peered":"2024-01-22T05:12:25.888430+0000","last_clean":"2024-01-22T05:12:25.888430+0000","last_became_active":"2024-01-22T05:12:25.887534+0000","last_became_peered":"2024-01-22T05:12:25.887534+0000","last_unstale":"2024-01-22T05:12:25.888430+0000","last_undegraded":"2024-01-22T05:12:25.888430+0000","last_fullsized":"2024-01-22T05:12:25.888430+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.438782+0000","last_change":"2024-01-22T05:12:25.437943+0000","last_active":"2024-01-22T05:12:25.438782+0000","last_peered":"2024-01-22T05:12:25.438782+0000","last_clean":"2024-01-22T05:12:25.438782+0000","last_became_active":"2024-01-22T05:12:25.437583+0000","last_became_peered":"2024-01-22T05:12:25.437583+0000","last_unstale":"2024-01-22T05:12:25.438782+0000","last_undegraded":"2024-01-22T05:12:25.438782+0000","last_fullsized":"2024-01-22T05:12:25.438782+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.865199+0000","last_change":"2024-01-22T05:12:25.862765+0000","last_active":"2024-01-22T05:12:25.865199+0000","last_peered":"2024-01-22T05:12:25.865199+0000","last_clean":"2024-01-22T05:12:25.865199+0000","last_became_active":"2024-01-22T05:12:25.862466+0000","last_became_peered":"2024-01-22T05:12:25.862466+0000","last_unstale":"2024-01-22T05:12:25.865199+0000","last_undegraded":"2024-01-22T05:12:25.865199+0000","last_fullsized":"2024-01-22T05:12:25.865199+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.855072+0000","last_change":"2024-01-22T05:12:25.397192+0000","last_active":"2024-01-22T05:12:25.855072+0000","last_peered":"2024-01-22T05:12:25.855072+0000","last_clean":"2024-01-22T05:12:25.855072+0000","last_became_active":"2024-01-22T05:12:25.395834+0000","last_became_peered":"2024-01-22T05:12:25.395834+0000","last_unstale":"2024-01-22T05:12:25.855072+0000","last_undegraded":"2024-01-22T05:12:25.855072+0000","last_fullsized":"2024-01-22T05:12:25.855072+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.873350+0000","last_change":"2024-01-22T05:12:25.865863+0000","last_active":"2024-01-22T05:12:25.873350+0000","last_peered":"2024-01-22T05:12:25.873350+0000","last_clean":"2024-01-22T05:12:25.873350+0000","last_became_active":"2024-01-22T05:12:25.865474+0000","last_became_peered":"2024-01-22T05:12:25.865474+0000","last_unstale":"2024-01-22T05:12:25.873350+0000","last_undegraded":"2024-01-22T05:12:25.873350+0000","last_fullsized":"2024-01-22T05:12:25.873350+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.852771+0000","last_change":"2024-01-22T05:12:25.420873+0000","last_active":"2024-01-22T05:12:25.852771+0000","last_peered":"2024-01-22T05:12:25.852771+0000","last_clean":"2024-01-22T05:12:25.852771+0000","last_became_active":"2024-01-22T05:12:25.420586+0000","last_became_peered":"2024-01-22T05:12:25.420586+0000","last_unstale":"2024-01-22T05:12:25.852771+0000","last_undegraded":"2024-01-22T05:12:25.852771+0000","last_fullsized":"2024-01-22T05:12:25.852771+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.880134+0000","last_change":"2024-01-22T05:12:25.880134+0000","last_active":"2024-01-22T05:12:25.880134+0000","last_peered":"2024-01-22T05:12:25.880134+0000","last_clean":"2024-01-22T05:12:25.880134+0000","last_became_active":"2024-01-22T05:12:25.879723+0000","last_became_peered":"2024-01-22T05:12:25.879723+0000","last_unstale":"2024-01-22T05:12:25.880134+0000","last_undegraded":"2024-01-22T05:12:25.880134+0000","last_fullsized":"2024-01-22T05:12:25.880134+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.854780+0000","last_change":"2024-01-22T05:12:25.417355+0000","last_active":"2024-01-22T05:12:25.854780+0000","last_peered":"2024-01-22T05:12:25.854780+0000","last_clean":"2024-01-22T05:12:25.854780+0000","last_became_active":"2024-01-22T05:12:25.416705+0000","last_became_peered":"2024-01-22T05:12:25.416705+0000","last_unstale":"2024-01-22T05:12:25.854780+0000","last_undegraded":"2024-01-22T05:12:25.854780+0000","last_fullsized":"2024-01-22T05:12:25.854780+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.886935+0000","last_change":"2024-01-22T05:12:25.886935+0000","last_active":"2024-01-22T05:12:25.886935+0000","last_peered":"2024-01-22T05:12:25.886935+0000","last_clean":"2024-01-22T05:12:25.886935+0000","last_became_active":"2024-01-22T05:12:25.886673+0000","last_became_peered":"2024-01-22T05:12:25.886673+0000","last_unstale":"2024-01-22T05:12:25.886935+0000","last_undegraded":"2024-01-22T05:12:25.886935+0000","last_fullsized":"2024-01-22T05:12:25.886935+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"103'1","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.882352+0000","last_change":"2024-01-22T05:12:25.413501+0000","last_active":"2024-01-22T05:12:25.882352+0000","last_peered":"2024-01-22T05:12:25.882352+0000","last_clean":"2024-01-22T05:12:25.882352+0000","last_became_active":"2024-01-22T05:12:25.413105+0000","last_became_peered":"2024-01-22T05:12:25.413105+0000","last_unstale":"2024-01-22T05:12:25.882352+0000","last_undegraded":"2024-01-22T05:12:25.882352+0000","last_fullsized":"2024-01-22T05:12:25.882352+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.894054+0000","last_change":"2024-01-22T05:12:25.894054+0000","last_active":"2024-01-22T05:12:25.894054+0000","last_peered":"2024-01-22T05:12:25.894054+0000","last_clean":"2024-01-22T05:12:25.894054+0000","last_became_active":"2024-01-22T05:12:25.893764+0000","last_became_peered":"2024-01-22T05:12:25.893764+0000","last_unstale":"2024-01-22T05:12:25.894054+0000","last_undegraded":"2024-01-22T05:12:25.894054+0000","last_fullsized":"2024-01-22T05:12:25.894054+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"103'1","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.864637+0000","last_change":"2024-01-22T05:12:25.430818+0000","last_active":"2024-01-22T05:12:25.864637+0000","last_peered":"2024-01-22T05:12:25.864637+0000","last_clean":"2024-01-22T05:12:25.864637+0000","last_became_active":"2024-01-22T05:12:25.430529+0000","last_became_peered":"2024-01-22T05:12:25.430529+0000","last_unstale":"2024-01-22T05:12:25.864637+0000","last_undegraded":"2024-01-22T05:12:25.864637+0000","last_fullsized":"2024-01-22T05:12:25.864637+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.897208+0000","last_change":"2024-01-22T05:12:25.890242+0000","last_active":"2024-01-22T05:12:25.897208+0000","last_peered":"2024-01-22T05:12:25.897208+0000","last_clean":"2024-01-22T05:12:25.897208+0000","last_became_active":"2024-01-22T05:12:25.889956+0000","last_became_peered":"2024-01-22T05:12:25.889956+0000","last_unstale":"2024-01-22T05:12:25.897208+0000","last_undegraded":"2024-01-22T05:12:25.897208+0000","last_fullsized":"2024-01-22T05:12:25.897208+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"103'2","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.893400+0000","last_change":"2024-01-22T05:12:25.429831+0000","last_active":"2024-01-22T05:12:25.893400+0000","last_peered":"2024-01-22T05:12:25.893400+0000","last_clean":"2024-01-22T05:12:25.893400+0000","last_became_active":"2024-01-22T05:12:25.429535+0000","last_became_peered":"2024-01-22T05:12:25.429535+0000","last_unstale":"2024-01-22T05:12:25.893400+0000","last_undegraded":"2024-01-22T05:12:25.893400+0000","last_fullsized":"2024-01-22T05:12:25.893400+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.869108+0000","last_change":"2024-01-22T05:12:25.864927+0000","last_active":"2024-01-22T05:12:25.869108+0000","last_peered":"2024-01-22T05:12:25.869108+0000","last_clean":"2024-01-22T05:12:25.869108+0000","last_became_active":"2024-01-22T05:12:25.863638+0000","last_became_peered":"2024-01-22T05:12:25.863638+0000","last_unstale":"2024-01-22T05:12:25.869108+0000","last_undegraded":"2024-01-22T05:12:25.869108+0000","last_fullsized":"2024-01-22T05:12:25.869108+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.855027+0000","last_change":"2024-01-22T05:12:25.426650+0000","last_active":"2024-01-22T05:12:25.855027+0000","last_peered":"2024-01-22T05:12:25.855027+0000","last_clean":"2024-01-22T05:12:25.855027+0000","last_became_active":"2024-01-22T05:12:25.426351+0000","last_became_peered":"2024-01-22T05:12:25.426351+0000","last_unstale":"2024-01-22T05:12:25.855027+0000","last_undegraded":"2024-01-22T05:12:25.855027+0000","last_fullsized":"2024-01-22T05:12:25.855027+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.874346+0000","last_change":"2024-01-22T05:12:25.871540+0000","last_active":"2024-01-22T05:12:25.874346+0000","last_peered":"2024-01-22T05:12:25.874346+0000","last_clean":"2024-01-22T05:12:25.874346+0000","last_became_active":"2024-01-22T05:12:25.869129+0000","last_became_peered":"2024-01-22T05:12:25.869129+0000","last_unstale":"2024-01-22T05:12:25.874346+0000","last_undegraded":"2024-01-22T05:12:25.874346+0000","last_fullsized":"2024-01-22T05:12:25.874346+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.870447+0000","last_change":"2024-01-22T05:12:25.426810+0000","last_active":"2024-01-22T05:12:25.870447+0000","last_peered":"2024-01-22T05:12:25.870447+0000","last_clean":"2024-01-22T05:12:25.870447+0000","last_became_active":"2024-01-22T05:12:25.426540+0000","last_became_peered":"2024-01-22T05:12:25.426540+0000","last_unstale":"2024-01-22T05:12:25.870447+0000","last_undegraded":"2024-01-22T05:12:25.870447+0000","last_fullsized":"2024-01-22T05:12:25.870447+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.878139+0000","last_change":"2024-01-22T05:12:25.878139+0000","last_active":"2024-01-22T05:12:25.878139+0000","last_peered":"2024-01-22T05:12:25.878139+0000","last_clean":"2024-01-22T05:12:25.878139+0000","last_became_active":"2024-01-22T05:12:25.877867+0000","last_became_peered":"2024-01-22T05:12:25.877867+0000","last_unstale":"2024-01-22T05:12:25.878139+0000","last_undegraded":"2024-01-22T05:12:25.878139+0000","last_fullsized":"2024-01-22T05:12:25.878139+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.860649+0000","last_change":"2024-01-22T05:12:25.428128+0000","last_active":"2024-01-22T05:12:25.860649+0000","last_peered":"2024-01-22T05:12:25.860649+0000","last_clean":"2024-01-22T05:12:25.860649+0000","last_became_active":"2024-01-22T05:12:25.427849+0000","last_became_peered":"2024-01-22T05:12:25.427849+0000","last_unstale":"2024-01-22T05:12:25.860649+0000","last_undegraded":"2024-01-22T05:12:25.860649+0000","last_fullsized":"2024-01-22T05:12:25.860649+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.894223+0000","last_change":"2024-01-22T05:12:25.894223+0000","last_active":"2024-01-22T05:12:25.894223+0000","last_peered":"2024-01-22T05:12:25.894223+0000","last_clean":"2024-01-22T05:12:25.894223+0000","last_became_active":"2024-01-22T05:12:25.893924+0000","last_became_peered":"2024-01-22T05:12:25.893924+0000","last_unstale":"2024-01-22T05:12:25.894223+0000","last_undegraded":"2024-01-22T05:12:25.894223+0000","last_fullsized":"2024-01-22T05:12:25.894223+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.425438+0000","last_change":"2024-01-22T05:12:25.424032+0000","last_active":"2024-01-22T05:12:25.425438+0000","last_peered":"2024-01-22T05:12:25.425438+0000","last_clean":"2024-01-22T05:12:25.425438+0000","last_became_active":"2024-01-22T05:12:25.423709+0000","last_became_peered":"2024-01-22T05:12:25.423709+0000","last_unstale":"2024-01-22T05:12:25.425438+0000","last_undegraded":"2024-01-22T05:12:25.425438+0000","last_fullsized":"2024-01-22T05:12:25.425438+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.873851+0000","last_change":"2024-01-22T05:12:25.865067+0000","last_active":"2024-01-22T05:12:25.873851+0000","last_peered":"2024-01-22T05:12:25.873851+0000","last_clean":"2024-01-22T05:12:25.873851+0000","last_became_active":"2024-01-22T05:12:25.864774+0000","last_became_peered":"2024-01-22T05:12:25.864774+0000","last_unstale":"2024-01-22T05:12:25.873851+0000","last_undegraded":"2024-01-22T05:12:25.873851+0000","last_fullsized":"2024-01-22T05:12:25.873851+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.865964+0000","last_change":"2024-01-22T05:12:25.434351+0000","last_active":"2024-01-22T05:12:25.865964+0000","last_peered":"2024-01-22T05:12:25.865964+0000","last_clean":"2024-01-22T05:12:25.865964+0000","last_became_active":"2024-01-22T05:12:25.434192+0000","last_became_peered":"2024-01-22T05:12:25.434192+0000","last_unstale":"2024-01-22T05:12:25.865964+0000","last_undegraded":"2024-01-22T05:12:25.865964+0000","last_fullsized":"2024-01-22T05:12:25.865964+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.885378+0000","last_change":"2024-01-22T05:12:25.876354+0000","last_active":"2024-01-22T05:12:25.885378+0000","last_peered":"2024-01-22T05:12:25.885378+0000","last_clean":"2024-01-22T05:12:25.885378+0000","last_became_active":"2024-01-22T05:12:25.875660+0000","last_became_peered":"2024-01-22T05:12:25.875660+0000","last_unstale":"2024-01-22T05:12:25.885378+0000","last_undegraded":"2024-01-22T05:12:25.885378+0000","last_fullsized":"2024-01-22T05:12:25.885378+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.871904+0000","last_change":"2024-01-22T05:12:25.423632+0000","last_active":"2024-01-22T05:12:25.871904+0000","last_peered":"2024-01-22T05:12:25.871904+0000","last_clean":"2024-01-22T05:12:25.871904+0000","last_became_active":"2024-01-22T05:12:25.423372+0000","last_became_peered":"2024-01-22T05:12:25.423372+0000","last_unstale":"2024-01-22T05:12:25.871904+0000","last_undegraded":"2024-01-22T05:12:25.871904+0000","last_fullsized":"2024-01-22T05:12:25.871904+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.864572+0000","last_change":"2024-01-22T05:12:25.861744+0000","last_active":"2024-01-22T05:12:25.864572+0000","last_peered":"2024-01-22T05:12:25.864572+0000","last_clean":"2024-01-22T05:12:25.864572+0000","last_became_active":"2024-01-22T05:12:25.861448+0000","last_became_peered":"2024-01-22T05:12:25.861448+0000","last_unstale":"2024-01-22T05:12:25.864572+0000","last_undegraded":"2024-01-22T05:12:25.864572+0000","last_fullsized":"2024-01-22T05:12:25.864572+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.435390+0000","last_change":"2024-01-22T05:12:25.416465+0000","last_active":"2024-01-22T05:12:25.435390+0000","last_peered":"2024-01-22T05:12:25.435390+0000","last_clean":"2024-01-22T05:12:25.435390+0000","last_became_active":"2024-01-22T05:12:25.416143+0000","last_became_peered":"2024-01-22T05:12:25.416143+0000","last_unstale":"2024-01-22T05:12:25.435390+0000","last_undegraded":"2024-01-22T05:12:25.435390+0000","last_fullsized":"2024-01-22T05:12:25.435390+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884797+0000","last_change":"2024-01-22T05:12:25.884797+0000","last_active":"2024-01-22T05:12:25.884797+0000","last_peered":"2024-01-22T05:12:25.884797+0000","last_clean":"2024-01-22T05:12:25.884797+0000","last_became_active":"2024-01-22T05:12:25.883868+0000","last_became_peered":"2024-01-22T05:12:25.883868+0000","last_unstale":"2024-01-22T05:12:25.884797+0000","last_undegraded":"2024-01-22T05:12:25.884797+0000","last_fullsized":"2024-01-22T05:12:25.884797+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"103'3","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.883579+0000","last_change":"2024-01-22T05:12:25.417483+0000","last_active":"2024-01-22T05:12:25.883579+0000","last_peered":"2024-01-22T05:12:25.883579+0000","last_clean":"2024-01-22T05:12:25.883579+0000","last_became_active":"2024-01-22T05:12:25.417168+0000","last_became_peered":"2024-01-22T05:12:25.417168+0000","last_unstale":"2024-01-22T05:12:25.883579+0000","last_undegraded":"2024-01-22T05:12:25.883579+0000","last_fullsized":"2024-01-22T05:12:25.883579+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.882550+0000","last_change":"2024-01-22T05:12:25.882550+0000","last_active":"2024-01-22T05:12:25.882550+0000","last_peered":"2024-01-22T05:12:25.882550+0000","last_clean":"2024-01-22T05:12:25.882550+0000","last_became_active":"2024-01-22T05:12:25.881607+0000","last_became_peered":"2024-01-22T05:12:25.881607+0000","last_unstale":"2024-01-22T05:12:25.882550+0000","last_undegraded":"2024-01-22T05:12:25.882550+0000","last_fullsized":"2024-01-22T05:12:25.882550+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"103'2","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.892244+0000","last_change":"2024-01-22T05:12:25.415988+0000","last_active":"2024-01-22T05:12:25.892244+0000","last_peered":"2024-01-22T05:12:25.892244+0000","last_clean":"2024-01-22T05:12:25.892244+0000","last_became_active":"2024-01-22T05:12:25.415651+0000","last_became_peered":"2024-01-22T05:12:25.415651+0000","last_unstale":"2024-01-22T05:12:25.892244+0000","last_undegraded":"2024-01-22T05:12:25.892244+0000","last_fullsized":"2024-01-22T05:12:25.892244+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.890436+0000","last_change":"2024-01-22T05:12:25.890436+0000","last_active":"2024-01-22T05:12:25.890436+0000","last_peered":"2024-01-22T05:12:25.890436+0000","last_clean":"2024-01-22T05:12:25.890436+0000","last_became_active":"2024-01-22T05:12:25.890234+0000","last_became_peered":"2024-01-22T05:12:25.890234+0000","last_unstale":"2024-01-22T05:12:25.890436+0000","last_undegraded":"2024-01-22T05:12:25.890436+0000","last_fullsized":"2024-01-22T05:12:25.890436+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"103'1","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.870815+0000","last_change":"2024-01-22T05:12:25.429465+0000","last_active":"2024-01-22T05:12:25.870815+0000","last_peered":"2024-01-22T05:12:25.870815+0000","last_clean":"2024-01-22T05:12:25.870815+0000","last_became_active":"2024-01-22T05:12:25.422841+0000","last_became_peered":"2024-01-22T05:12:25.422841+0000","last_unstale":"2024-01-22T05:12:25.870815+0000","last_undegraded":"2024-01-22T05:12:25.870815+0000","last_fullsized":"2024-01-22T05:12:25.870815+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.882541+0000","last_change":"2024-01-22T05:12:25.873839+0000","last_active":"2024-01-22T05:12:25.882541+0000","last_peered":"2024-01-22T05:12:25.882541+0000","last_clean":"2024-01-22T05:12:25.882541+0000","last_became_active":"2024-01-22T05:12:25.872789+0000","last_became_peered":"2024-01-22T05:12:25.872789+0000","last_unstale":"2024-01-22T05:12:25.882541+0000","last_undegraded":"2024-01-22T05:12:25.882541+0000","last_fullsized":"2024-01-22T05:12:25.882541+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.441981+0000","last_change":"2024-01-22T05:12:25.436898+0000","last_active":"2024-01-22T05:12:25.441981+0000","last_peered":"2024-01-22T05:12:25.441981+0000","last_clean":"2024-01-22T05:12:25.441981+0000","last_became_active":"2024-01-22T05:12:25.436619+0000","last_became_peered":"2024-01-22T05:12:25.436619+0000","last_unstale":"2024-01-22T05:12:25.441981+0000","last_undegraded":"2024-01-22T05:12:25.441981+0000","last_fullsized":"2024-01-22T05:12:25.441981+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.867912+0000","last_change":"2024-01-22T05:12:25.858899+0000","last_active":"2024-01-22T05:12:25.867912+0000","last_peered":"2024-01-22T05:12:25.867912+0000","last_clean":"2024-01-22T05:12:25.867912+0000","last_became_active":"2024-01-22T05:12:25.858466+0000","last_became_peered":"2024-01-22T05:12:25.858466+0000","last_unstale":"2024-01-22T05:12:25.867912+0000","last_undegraded":"2024-01-22T05:12:25.867912+0000","last_fullsized":"2024-01-22T05:12:25.867912+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.853816+0000","last_change":"2024-01-22T05:12:25.411802+0000","last_active":"2024-01-22T05:12:25.853816+0000","last_peered":"2024-01-22T05:12:25.853816+0000","last_clean":"2024-01-22T05:12:25.853816+0000","last_became_active":"2024-01-22T05:12:25.409710+0000","last_became_peered":"2024-01-22T05:12:25.409710+0000","last_unstale":"2024-01-22T05:12:25.853816+0000","last_undegraded":"2024-01-22T05:12:25.853816+0000","last_fullsized":"2024-01-22T05:12:25.853816+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.883585+0000","last_change":"2024-01-22T05:12:25.883585+0000","last_active":"2024-01-22T05:12:25.883585+0000","last_peered":"2024-01-22T05:12:25.883585+0000","last_clean":"2024-01-22T05:12:25.883585+0000","last_became_active":"2024-01-22T05:12:25.883334+0000","last_became_peered":"2024-01-22T05:12:25.883334+0000","last_unstale":"2024-01-22T05:12:25.883585+0000","last_undegraded":"2024-01-22T05:12:25.883585+0000","last_fullsized":"2024-01-22T05:12:25.883585+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"103'4","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.898468+0000","last_change":"2024-01-22T05:12:25.414991+0000","last_active":"2024-01-22T05:12:25.898468+0000","last_peered":"2024-01-22T05:12:25.898468+0000","last_clean":"2024-01-22T05:12:25.898468+0000","last_became_active":"2024-01-22T05:12:25.414589+0000","last_became_peered":"2024-01-22T05:12:25.414589+0000","last_unstale":"2024-01-22T05:12:25.898468+0000","last_undegraded":"2024-01-22T05:12:25.898468+0000","last_fullsized":"2024-01-22T05:12:25.898468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.889566+0000","last_change":"2024-01-22T05:12:25.885054+0000","last_active":"2024-01-22T05:12:25.889566+0000","last_peered":"2024-01-22T05:12:25.889566+0000","last_clean":"2024-01-22T05:12:25.889566+0000","last_became_active":"2024-01-22T05:12:25.878731+0000","last_became_peered":"2024-01-22T05:12:25.878731+0000","last_unstale":"2024-01-22T05:12:25.889566+0000","last_undegraded":"2024-01-22T05:12:25.889566+0000","last_fullsized":"2024-01-22T05:12:25.889566+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"103'2","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.885743+0000","last_change":"2024-01-22T05:12:25.413821+0000","last_active":"2024-01-22T05:12:25.885743+0000","last_peered":"2024-01-22T05:12:25.885743+0000","last_clean":"2024-01-22T05:12:25.885743+0000","last_became_active":"2024-01-22T05:12:25.412957+0000","last_became_peered":"2024-01-22T05:12:25.412957+0000","last_unstale":"2024-01-22T05:12:25.885743+0000","last_undegraded":"2024-01-22T05:12:25.885743+0000","last_fullsized":"2024-01-22T05:12:25.885743+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884314+0000","last_change":"2024-01-22T05:12:25.881098+0000","last_active":"2024-01-22T05:12:25.884314+0000","last_peered":"2024-01-22T05:12:25.884314+0000","last_clean":"2024-01-22T05:12:25.884314+0000","last_became_active":"2024-01-22T05:12:25.880467+0000","last_became_peered":"2024-01-22T05:12:25.880467+0000","last_unstale":"2024-01-22T05:12:25.884314+0000","last_undegraded":"2024-01-22T05:12:25.884314+0000","last_fullsized":"2024-01-22T05:12:25.884314+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.856002+0000","last_change":"2024-01-22T05:12:25.437320+0000","last_active":"2024-01-22T05:12:25.856002+0000","last_peered":"2024-01-22T05:12:25.856002+0000","last_clean":"2024-01-22T05:12:25.856002+0000","last_became_active":"2024-01-22T05:12:25.436882+0000","last_became_peered":"2024-01-22T05:12:25.436882+0000","last_unstale":"2024-01-22T05:12:25.856002+0000","last_undegraded":"2024-01-22T05:12:25.856002+0000","last_fullsized":"2024-01-22T05:12:25.856002+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.896380+0000","last_change":"2024-01-22T05:12:25.882129+0000","last_active":"2024-01-22T05:12:25.896380+0000","last_peered":"2024-01-22T05:12:25.896380+0000","last_clean":"2024-01-22T05:12:25.896380+0000","last_became_active":"2024-01-22T05:12:25.881828+0000","last_became_peered":"2024-01-22T05:12:25.881828+0000","last_unstale":"2024-01-22T05:12:25.896380+0000","last_undegraded":"2024-01-22T05:12:25.896380+0000","last_fullsized":"2024-01-22T05:12:25.896380+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.854953+0000","last_change":"2024-01-22T05:12:25.424308+0000","last_active":"2024-01-22T05:12:25.854953+0000","last_peered":"2024-01-22T05:12:25.854953+0000","last_clean":"2024-01-22T05:12:25.854953+0000","last_became_active":"2024-01-22T05:12:25.423977+0000","last_became_peered":"2024-01-22T05:12:25.423977+0000","last_unstale":"2024-01-22T05:12:25.854953+0000","last_undegraded":"2024-01-22T05:12:25.854953+0000","last_fullsized":"2024-01-22T05:12:25.854953+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.874349+0000","last_change":"2024-01-22T05:12:25.874349+0000","last_active":"2024-01-22T05:12:25.874349+0000","last_peered":"2024-01-22T05:12:25.874349+0000","last_clean":"2024-01-22T05:12:25.874349+0000","last_became_active":"2024-01-22T05:12:25.874039+0000","last_became_peered":"2024-01-22T05:12:25.874039+0000","last_unstale":"2024-01-22T05:12:25.874349+0000","last_undegraded":"2024-01-22T05:12:25.874349+0000","last_fullsized":"2024-01-22T05:12:25.874349+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.414586+0000","last_change":"2024-01-22T05:12:25.410781+0000","last_active":"2024-01-22T05:12:25.414586+0000","last_peered":"2024-01-22T05:12:25.414586+0000","last_clean":"2024-01-22T05:12:25.414586+0000","last_became_active":"2024-01-22T05:12:25.410296+0000","last_became_peered":"2024-01-22T05:12:25.410296+0000","last_unstale":"2024-01-22T05:12:25.414586+0000","last_undegraded":"2024-01-22T05:12:25.414586+0000","last_fullsized":"2024-01-22T05:12:25.414586+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.890039+0000","last_change":"2024-01-22T05:12:25.890039+0000","last_active":"2024-01-22T05:12:25.890039+0000","last_peered":"2024-01-22T05:12:25.890039+0000","last_clean":"2024-01-22T05:12:25.890039+0000","last_became_active":"2024-01-22T05:12:25.888177+0000","last_became_peered":"2024-01-22T05:12:25.888177+0000","last_unstale":"2024-01-22T05:12:25.890039+0000","last_undegraded":"2024-01-22T05:12:25.890039+0000","last_fullsized":"2024-01-22T05:12:25.890039+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.858492+0000","last_change":"2024-01-22T05:12:25.413189+0000","last_active":"2024-01-22T05:12:25.858492+0000","last_peered":"2024-01-22T05:12:25.858492+0000","last_clean":"2024-01-22T05:12:25.858492+0000","last_became_active":"2024-01-22T05:12:25.412797+0000","last_became_peered":"2024-01-22T05:12:25.412797+0000","last_unstale":"2024-01-22T05:12:25.858492+0000","last_undegraded":"2024-01-22T05:12:25.858492+0000","last_fullsized":"2024-01-22T05:12:25.858492+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.881432+0000","last_change":"2024-01-22T05:12:25.871629+0000","last_active":"2024-01-22T05:12:25.881432+0000","last_peered":"2024-01-22T05:12:25.881432+0000","last_clean":"2024-01-22T05:12:25.881432+0000","last_became_active":"2024-01-22T05:12:25.870727+0000","last_became_peered":"2024-01-22T05:12:25.870727+0000","last_unstale":"2024-01-22T05:12:25.881432+0000","last_undegraded":"2024-01-22T05:12:25.881432+0000","last_fullsized":"2024-01-22T05:12:25.881432+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.425970+0000","last_change":"2024-01-22T05:12:25.424784+0000","last_active":"2024-01-22T05:12:25.425970+0000","last_peered":"2024-01-22T05:12:25.425970+0000","last_clean":"2024-01-22T05:12:25.425970+0000","last_became_active":"2024-01-22T05:12:25.424470+0000","last_became_peered":"2024-01-22T05:12:25.424470+0000","last_unstale":"2024-01-22T05:12:25.425970+0000","last_undegraded":"2024-01-22T05:12:25.425970+0000","last_fullsized":"2024-01-22T05:12:25.425970+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.877296+0000","last_change":"2024-01-22T05:12:25.877296+0000","last_active":"2024-01-22T05:12:25.877296+0000","last_peered":"2024-01-22T05:12:25.877296+0000","last_clean":"2024-01-22T05:12:25.877296+0000","last_became_active":"2024-01-22T05:12:25.877024+0000","last_became_peered":"2024-01-22T05:12:25.877024+0000","last_unstale":"2024-01-22T05:12:25.877296+0000","last_undegraded":"2024-01-22T05:12:25.877296+0000","last_fullsized":"2024-01-22T05:12:25.877296+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.441498+0000","last_change":"2024-01-22T05:12:25.433769+0000","last_active":"2024-01-22T05:12:25.441498+0000","last_peered":"2024-01-22T05:12:25.441498+0000","last_clean":"2024-01-22T05:12:25.441498+0000","last_became_active":"2024-01-22T05:12:25.433361+0000","last_became_peered":"2024-01-22T05:12:25.433361+0000","last_unstale":"2024-01-22T05:12:25.441498+0000","last_undegraded":"2024-01-22T05:12:25.441498+0000","last_fullsized":"2024-01-22T05:12:25.441498+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.874157+0000","last_change":"2024-01-22T05:12:25.874157+0000","last_active":"2024-01-22T05:12:25.874157+0000","last_peered":"2024-01-22T05:12:25.874157+0000","last_clean":"2024-01-22T05:12:25.874157+0000","last_became_active":"2024-01-22T05:12:25.873255+0000","last_became_peered":"2024-01-22T05:12:25.873255+0000","last_unstale":"2024-01-22T05:12:25.874157+0000","last_undegraded":"2024-01-22T05:12:25.874157+0000","last_fullsized":"2024-01-22T05:12:25.874157+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.440477+0000","last_change":"2024-01-22T05:12:25.429649+0000","last_active":"2024-01-22T05:12:25.440477+0000","last_peered":"2024-01-22T05:12:25.440477+0000","last_clean":"2024-01-22T05:12:25.440477+0000","last_became_active":"2024-01-22T05:12:25.429329+0000","last_became_peered":"2024-01-22T05:12:25.429329+0000","last_unstale":"2024-01-22T05:12:25.440477+0000","last_undegraded":"2024-01-22T05:12:25.440477+0000","last_fullsized":"2024-01-22T05:12:25.440477+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884195+0000","last_change":"2024-01-22T05:12:25.884195+0000","last_active":"2024-01-22T05:12:25.884195+0000","last_peered":"2024-01-22T05:12:25.884195+0000","last_clean":"2024-01-22T05:12:25.884195+0000","last_became_active":"2024-01-22T05:12:25.883096+0000","last_became_peered":"2024-01-22T05:12:25.883096+0000","last_unstale":"2024-01-22T05:12:25.884195+0000","last_undegraded":"2024-01-22T05:12:25.884195+0000","last_fullsized":"2024-01-22T05:12:25.884195+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"103'1","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.893297+0000","last_change":"2024-01-22T05:12:25.429928+0000","last_active":"2024-01-22T05:12:25.893297+0000","last_peered":"2024-01-22T05:12:25.893297+0000","last_clean":"2024-01-22T05:12:25.893297+0000","last_became_active":"2024-01-22T05:12:25.429652+0000","last_became_peered":"2024-01-22T05:12:25.429652+0000","last_unstale":"2024-01-22T05:12:25.893297+0000","last_undegraded":"2024-01-22T05:12:25.893297+0000","last_fullsized":"2024-01-22T05:12:25.893297+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":81,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.403569+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:12:25.403569+0000","last_peered":"2024-01-22T05:12:25.403569+0000","last_clean":"2024-01-22T05:12:25.403569+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:12:25.403569+0000","last_undegraded":"2024-01-22T05:12:25.403569+0000","last_fullsized":"2024-01-22T05:12:25.403569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.890236+0000","last_change":"2024-01-22T05:12:25.890236+0000","last_active":"2024-01-22T05:12:25.890236+0000","last_peered":"2024-01-22T05:12:25.890236+0000","last_clean":"2024-01-22T05:12:25.890236+0000","last_became_active":"2024-01-22T05:12:25.889925+0000","last_became_peered":"2024-01-22T05:12:25.889925+0000","last_unstale":"2024-01-22T05:12:25.890236+0000","last_undegraded":"2024-01-22T05:12:25.890236+0000","last_fullsized":"2024-01-22T05:12:25.890236+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.853960+0000","last_change":"2024-01-22T05:12:25.429893+0000","last_active":"2024-01-22T05:12:25.853960+0000","last_peered":"2024-01-22T05:12:25.853960+0000","last_clean":"2024-01-22T05:12:25.853960+0000","last_became_active":"2024-01-22T05:12:25.429544+0000","last_became_peered":"2024-01-22T05:12:25.429544+0000","last_unstale":"2024-01-22T05:12:25.853960+0000","last_undegraded":"2024-01-22T05:12:25.853960+0000","last_fullsized":"2024-01-22T05:12:25.853960+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":87,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.871772+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:12:25.871772+0000","last_peered":"2024-01-22T05:12:25.871772+0000","last_clean":"2024-01-22T05:12:25.871772+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:12:25.871772+0000","last_undegraded":"2024-01-22T05:12:25.871772+0000","last_fullsized":"2024-01-22T05:12:25.871772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.882199+0000","last_change":"2024-01-22T05:12:25.882199+0000","last_active":"2024-01-22T05:12:25.882199+0000","last_peered":"2024-01-22T05:12:25.882199+0000","last_clean":"2024-01-22T05:12:25.882199+0000","last_became_active":"2024-01-22T05:12:25.881908+0000","last_became_peered":"2024-01-22T05:12:25.881908+0000","last_unstale":"2024-01-22T05:12:25.882199+0000","last_undegraded":"2024-01-22T05:12:25.882199+0000","last_fullsized":"2024-01-22T05:12:25.882199+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.852968+0000","last_change":"2024-01-22T05:12:25.414420+0000","last_active":"2024-01-22T05:12:25.852968+0000","last_peered":"2024-01-22T05:12:25.852968+0000","last_clean":"2024-01-22T05:12:25.852968+0000","last_became_active":"2024-01-22T05:12:25.414147+0000","last_became_peered":"2024-01-22T05:12:25.414147+0000","last_unstale":"2024-01-22T05:12:25.852968+0000","last_undegraded":"2024-01-22T05:12:25.852968+0000","last_fullsized":"2024-01-22T05:12:25.852968+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.405510+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:12:25.405510+0000","last_peered":"2024-01-22T05:12:25.405510+0000","last_clean":"2024-01-22T05:12:25.405510+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:12:25.405510+0000","last_undegraded":"2024-01-22T05:12:25.405510+0000","last_fullsized":"2024-01-22T05:12:25.405510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.868790+0000","last_change":"2024-01-22T05:12:25.868790+0000","last_active":"2024-01-22T05:12:25.868790+0000","last_peered":"2024-01-22T05:12:25.868790+0000","last_clean":"2024-01-22T05:12:25.868790+0000","last_became_active":"2024-01-22T05:12:25.865250+0000","last_became_peered":"2024-01-22T05:12:25.865250+0000","last_unstale":"2024-01-22T05:12:25.868790+0000","last_undegraded":"2024-01-22T05:12:25.868790+0000","last_fullsized":"2024-01-22T05:12:25.868790+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.854953+0000","last_change":"2024-01-22T05:12:25.410597+0000","last_active":"2024-01-22T05:12:25.854953+0000","last_peered":"2024-01-22T05:12:25.854953+0000","last_clean":"2024-01-22T05:12:25.854953+0000","last_became_active":"2024-01-22T05:12:25.410291+0000","last_became_peered":"2024-01-22T05:12:25.410291+0000","last_unstale":"2024-01-22T05:12:25.854953+0000","last_undegraded":"2024-01-22T05:12:25.854953+0000","last_fullsized":"2024-01-22T05:12:25.854953+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":87,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.867470+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:12:25.867470+0000","last_peered":"2024-01-22T05:12:25.867470+0000","last_clean":"2024-01-22T05:12:25.867470+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:12:25.867470+0000","last_undegraded":"2024-01-22T05:12:25.867470+0000","last_fullsized":"2024-01-22T05:12:25.867470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.870945+0000","last_change":"2024-01-22T05:12:25.870945+0000","last_active":"2024-01-22T05:12:25.870945+0000","last_peered":"2024-01-22T05:12:25.870945+0000","last_clean":"2024-01-22T05:12:25.870945+0000","last_became_active":"2024-01-22T05:12:25.870092+0000","last_became_peered":"2024-01-22T05:12:25.870092+0000","last_unstale":"2024-01-22T05:12:25.870945+0000","last_undegraded":"2024-01-22T05:12:25.870945+0000","last_fullsized":"2024-01-22T05:12:25.870945+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"103'2","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.891679+0000","last_change":"2024-01-22T05:12:25.433661+0000","last_active":"2024-01-22T05:12:25.891679+0000","last_peered":"2024-01-22T05:12:25.891679+0000","last_clean":"2024-01-22T05:12:25.891679+0000","last_became_active":"2024-01-22T05:12:25.433401+0000","last_became_peered":"2024-01-22T05:12:25.433401+0000","last_unstale":"2024-01-22T05:12:25.891679+0000","last_undegraded":"2024-01-22T05:12:25.891679+0000","last_fullsized":"2024-01-22T05:12:25.891679+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.854107+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:12:25.854107+0000","last_peered":"2024-01-22T05:12:25.854107+0000","last_clean":"2024-01-22T05:12:25.854107+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:12:25.854107+0000","last_undegraded":"2024-01-22T05:12:25.854107+0000","last_fullsized":"2024-01-22T05:12:25.854107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.870535+0000","last_change":"2024-01-22T05:12:25.866054+0000","last_active":"2024-01-22T05:12:25.870535+0000","last_peered":"2024-01-22T05:12:25.870535+0000","last_clean":"2024-01-22T05:12:25.870535+0000","last_became_active":"2024-01-22T05:12:25.865780+0000","last_became_peered":"2024-01-22T05:12:25.865780+0000","last_unstale":"2024-01-22T05:12:25.870535+0000","last_undegraded":"2024-01-22T05:12:25.870535+0000","last_fullsized":"2024-01-22T05:12:25.870535+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.411048+0000","last_change":"2024-01-22T05:12:25.407658+0000","last_active":"2024-01-22T05:12:25.411048+0000","last_peered":"2024-01-22T05:12:25.411048+0000","last_clean":"2024-01-22T05:12:25.411048+0000","last_became_active":"2024-01-22T05:12:25.407337+0000","last_became_peered":"2024-01-22T05:12:25.407337+0000","last_unstale":"2024-01-22T05:12:25.411048+0000","last_undegraded":"2024-01-22T05:12:25.411048+0000","last_fullsized":"2024-01-22T05:12:25.411048+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":82,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.402432+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:12:25.402432+0000","last_peered":"2024-01-22T05:12:25.402432+0000","last_clean":"2024-01-22T05:12:25.402432+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:12:25.402432+0000","last_undegraded":"2024-01-22T05:12:25.402432+0000","last_fullsized":"2024-01-22T05:12:25.402432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.877146+0000","last_change":"2024-01-22T05:12:25.877146+0000","last_active":"2024-01-22T05:12:25.877146+0000","last_peered":"2024-01-22T05:12:25.877146+0000","last_clean":"2024-01-22T05:12:25.877146+0000","last_became_active":"2024-01-22T05:12:25.876870+0000","last_became_peered":"2024-01-22T05:12:25.876870+0000","last_unstale":"2024-01-22T05:12:25.877146+0000","last_undegraded":"2024-01-22T05:12:25.877146+0000","last_fullsized":"2024-01-22T05:12:25.877146+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.855189+0000","last_change":"2024-01-22T05:12:25.424389+0000","last_active":"2024-01-22T05:12:25.855189+0000","last_peered":"2024-01-22T05:12:25.855189+0000","last_clean":"2024-01-22T05:12:25.855189+0000","last_became_active":"2024-01-22T05:12:25.424059+0000","last_became_peered":"2024-01-22T05:12:25.424059+0000","last_unstale":"2024-01-22T05:12:25.855189+0000","last_undegraded":"2024-01-22T05:12:25.855189+0000","last_fullsized":"2024-01-22T05:12:25.855189+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.404709+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:12:25.404709+0000","last_peered":"2024-01-22T05:12:25.404709+0000","last_clean":"2024-01-22T05:12:25.404709+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:12:25.404709+0000","last_undegraded":"2024-01-22T05:12:25.404709+0000","last_fullsized":"2024-01-22T05:12:25.404709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884808+0000","last_change":"2024-01-22T05:12:25.884808+0000","last_active":"2024-01-22T05:12:25.884808+0000","last_peered":"2024-01-22T05:12:25.884808+0000","last_clean":"2024-01-22T05:12:25.884808+0000","last_became_active":"2024-01-22T05:12:25.884623+0000","last_became_peered":"2024-01-22T05:12:25.884623+0000","last_unstale":"2024-01-22T05:12:25.884808+0000","last_undegraded":"2024-01-22T05:12:25.884808+0000","last_fullsized":"2024-01-22T05:12:25.884808+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"103'1","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.863798+0000","last_change":"2024-01-22T05:12:25.419021+0000","last_active":"2024-01-22T05:12:25.863798+0000","last_peered":"2024-01-22T05:12:25.863798+0000","last_clean":"2024-01-22T05:12:25.863798+0000","last_became_active":"2024-01-22T05:12:25.418702+0000","last_became_peered":"2024-01-22T05:12:25.418702+0000","last_unstale":"2024-01-22T05:12:25.863798+0000","last_undegraded":"2024-01-22T05:12:25.863798+0000","last_fullsized":"2024-01-22T05:12:25.863798+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.853220+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:12:25.853220+0000","last_peered":"2024-01-22T05:12:25.853220+0000","last_clean":"2024-01-22T05:12:25.853220+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:12:25.853220+0000","last_undegraded":"2024-01-22T05:12:25.853220+0000","last_fullsized":"2024-01-22T05:12:25.853220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":79,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.404799+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:12:25.404799+0000","last_peered":"2024-01-22T05:12:25.404799+0000","last_clean":"2024-01-22T05:12:25.404799+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:12:25.404799+0000","last_undegraded":"2024-01-22T05:12:25.404799+0000","last_fullsized":"2024-01-22T05:12:25.404799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302568,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069272,"statfs":{"total":96636764160,"available":96326934528,"internally_reserved":0,"allocated":1277952,"data_stored":625760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:11:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.97299999999999998,"15min":1.024},"min":{"1min":0.56200000000000006,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3280000000000001,"5min":1.548,"15min":1.548},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.72699999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.405,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":1.371}]},{"osd":1,"last update":"Mon Jan 22 05:11:45 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.98699999999999999,"15min":0.97899999999999998},"min":{"1min":0.59199999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1559999999999999,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1539999999999999,"15min":1.171},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.3140000000000001,"5min":7.1840000000000002,"15min":7.1840000000000002},"last":1.2370000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:11:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.109,"15min":1.103},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.494,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.026},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.1379999999999999,"15min":1.161},"min":{"1min":0.73799999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.4219999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.96099999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:11:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.208,"15min":1.2250000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5349999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.194},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.2390000000000001,"15min":1.234},"min":{"1min":0.78300000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3660000000000001,"5min":6.4589999999999996,"15min":6.4589999999999996},"last":1.073}]},{"osd":4,"last update":"Mon Jan 22 05:11:45 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.054,"15min":1.0549999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.6180000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.514},{"interface":"front","average":{"1min":0.91400000000000003,"5min":1.119,"15min":1.1479999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.51,"5min":2.077,"15min":2.077},"last":1.3919999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:11:45 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.155,"15min":1.1819999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.4650000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.278,"15min":1.228},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.591,"5min":3.625,"15min":3.625},"last":1.3120000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:11:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.161,"15min":1.2290000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.526,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.464},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.3400000000000001,"15min":1.329},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.6859999999999999,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":1.6000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302560,"kb_used_data":1240,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069280,"statfs":{"total":96636764160,"available":96326942720,"internally_reserved":0,"allocated":1269760,"data_stored":625648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.7490000000000001,"15min":1.3109999999999999},"min":{"1min":0.72399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.454,"5min":77.745000000000005,"15min":77.745000000000005},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.111,"15min":1.069},"min":{"1min":0.65400000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.4019999999999999,"5min":13.555999999999999,"15min":13.555999999999999},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:11:50 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2210000000000001,"15min":1.109},"min":{"1min":0.55100000000000005,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.2450000000000001,"5min":15.499000000000001,"15min":15.499000000000001},"last":0.503},{"interface":"front","average":{"1min":1.083,"5min":1.175,"15min":1.2130000000000001},"min":{"1min":0.67900000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4770000000000001,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":3.6080000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:11:50 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.161,"15min":1.155},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.653,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":1.212},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.123,"15min":1.107},"min":{"1min":0.747,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4279999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.68600000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:11:50 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":2.0920000000000001,"15min":1.4510000000000001},"min":{"1min":0.82899999999999996,"5min":0.63500000000000001,"15min":0.59299999999999997},"max":{"1min":1.8169999999999999,"5min":102.08199999999999,"15min":102.08199999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.28,"5min":1.3089999999999999,"15min":1.2350000000000001},"min":{"1min":0.66600000000000004,"5min":0.374,"15min":0.374},"max":{"1min":6.0129999999999999,"5min":15.468,"15min":15.468},"last":0.92500000000000004}]},{"osd":4,"last update":"Mon Jan 22 05:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":1.115,"15min":1.0940000000000001},"min":{"1min":0.55500000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.5529999999999999,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0760000000000001,"15min":1.113},"min":{"1min":0.60099999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6180000000000001,"5min":1.649,"15min":1.649},"last":0.76000000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:11:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.415,"15min":1.2569999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":5.2930000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.274,"15min":1.2689999999999999},"min":{"1min":0.63500000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.6179999999999999,"5min":3.875,"15min":3.875},"last":0.748}]},{"osd":7,"last update":"Mon Jan 22 05:11:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.462,"15min":1.4059999999999999},"min":{"1min":0.72599999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.7849999999999999,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.889,"15min":1.5680000000000001},"min":{"1min":0.60199999999999998,"5min":0.495,"15min":0.495},"max":{"1min":6.0529999999999999,"5min":63.737000000000002,"15min":63.737000000000002},"last":0.88900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302572,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069268,"statfs":{"total":96636764160,"available":96326930432,"internally_reserved":0,"allocated":1282048,"data_stored":632705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:11:47 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":1.008,"15min":0.997},"min":{"1min":0.70199999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3720000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.042},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.004,"15min":1.0860000000000001},"min":{"1min":0.66900000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3149999999999999,"5min":1.5680000000000001,"15min":1.571},"last":1.1830000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:11:47 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.1459999999999999,"15min":1.1990000000000001},"min":{"1min":0.67300000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.29,"5min":1.6859999999999999,"15min":1.821},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.139,"15min":1.2689999999999999},"min":{"1min":0.76300000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3640000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.3480000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:11:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.1180000000000001,"15min":1.147},"min":{"1min":0.79100000000000004,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.2470000000000001,"5min":1.925,"15min":1.925},"last":1.286},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.097,"15min":1.1299999999999999},"min":{"1min":0.67100000000000004,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2929999999999999,"5min":1.859,"15min":1.859},"last":1.2310000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:11:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1120000000000001,"15min":1.1699999999999999},"min":{"1min":0.76900000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.3779999999999999,"5min":1.4990000000000001,"15min":1.931},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.145,"15min":1.264},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.72699999999999998},"max":{"1min":1.3109999999999999,"5min":1.569,"15min":2.266},"last":1.4219999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:11:47 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.052,"15min":1.1559999999999999},"min":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.504,"5min":1.7749999999999999,"15min":1.7829999999999999},"last":1.157},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.137,"15min":1.258},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.361,"5min":1.8300000000000001,"15min":2.0699999999999998},"last":1.2589999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:11:47 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.1599999999999999,"15min":1.2989999999999999},"min":{"1min":0.63600000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3919999999999999,"5min":1.8129999999999999,"15min":2.2010000000000001},"last":1.615},{"interface":"front","average":{"1min":1.03,"5min":1.204,"15min":1.282},"min":{"1min":0.56100000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5309999999999999,"5min":1.899,"15min":1.909},"last":1.4550000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:11:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.2470000000000001,"15min":1.379},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4530000000000001,"5min":1.881,"15min":2.3359999999999999},"last":1.49},{"interface":"front","average":{"1min":1.054,"5min":1.27,"15min":1.425},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.472,"5min":2.0499999999999998,"15min":3.1840000000000002},"last":1.5489999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306676,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065164,"statfs":{"total":96636764160,"available":96322727936,"internally_reserved":0,"allocated":1290240,"data_stored":626486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.0589999999999999,"15min":1.121},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.47799999999999998},"max":{"1min":1.274,"5min":1.7490000000000001,"15min":2.0150000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.123,"15min":1.1040000000000001},"min":{"1min":0.69899999999999995,"5min":0.55300000000000005,"15min":0.501},"max":{"1min":1.2709999999999999,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.94299999999999995}]},{"osd":1,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0760000000000001,"15min":1.0840000000000001},"min":{"1min":0.82799999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4299999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.004,"5min":1.0369999999999999,"15min":1.159},"min":{"1min":0.73699999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.296,"5min":1.5329999999999999,"15min":2.194},"last":0.71099999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.079,"15min":1.0840000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.7030000000000001,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.006,"5min":1.1100000000000001,"15min":1.238},"min":{"1min":0.69099999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3169999999999999,"5min":1.6180000000000001,"15min":2.3479999999999999},"last":0.77000000000000002}]},{"osd":3,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1100000000000001,"15min":1.1699999999999999},"min":{"1min":0.59299999999999997,"5min":0.496,"15min":0.496},"max":{"1min":1.51,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.1499999999999999,"15min":1.153},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.671,"5min":5.3029999999999999,"15min":5.3029999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":1.0549999999999999,"15min":1.1819999999999999},"min":{"1min":0.57799999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.387,"5min":1.6970000000000001,"15min":2.0790000000000002},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0640000000000001,"15min":1.137},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3999999999999999,"5min":1.597,"15min":2.0030000000000001},"last":0.97899999999999998}]},{"osd":6,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.1240000000000001,"15min":1.167},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5960000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.999,"5min":1.1990000000000001,"15min":1.361},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.4610000000000001,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.996}]},{"osd":7,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2470000000000001,"15min":1.3360000000000001},"min":{"1min":0.66500000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.5600000000000001,"5min":1.833,"15min":2.2839999999999998},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.294,"15min":1.353},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6379999999999999,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.0189999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306676,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065164,"statfs":{"total":96636764160,"available":96322727936,"internally_reserved":0,"allocated":1290240,"data_stored":627760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81200000000000006,"15min":0.89600000000000002},"min":{"1min":0.46200000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.663,"5min":1.663,"15min":14.859},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.89700000000000002,"15min":0.89000000000000001},"min":{"1min":0.52000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":2.3519999999999999,"5min":3.9860000000000002,"15min":5.0919999999999996},"last":1.002}]},{"osd":1,"last update":"Mon Jan 22 05:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":0.94299999999999995,"15min":0.88300000000000001},"min":{"1min":0.67900000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":6.5570000000000004,"5min":6.5570000000000004,"15min":6.5570000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.94799999999999995,"15min":0.97999999999999998},"min":{"1min":0.64500000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.27,"5min":1.526,"15min":5.7519999999999998},"last":0.79100000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.111,"15min":1.155},"min":{"1min":0.77200000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.413,"5min":1.21,"15min":1.2},"min":{"1min":0.879,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":4.1429999999999998,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":1.554}]},{"osd":4,"last update":"Mon Jan 22 05:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":1.3320000000000001,"15min":1.3200000000000001},"min":{"1min":0.879,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":10.858000000000001,"5min":10.858000000000001,"15min":10.858000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.357,"15min":1.3540000000000001},"min":{"1min":0.79500000000000004,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":10.846,"5min":10.846,"15min":10.846},"last":1.139}]},{"osd":5,"last update":"Mon Jan 22 05:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.302,"15min":1.306},"min":{"1min":0.76000000000000001,"5min":0.505,"15min":0.505},"max":{"1min":7.3639999999999999,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":1.466},{"interface":"front","average":{"1min":1.778,"5min":1.5209999999999999,"15min":1.371},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":12.128,"5min":14.523999999999999,"15min":14.523999999999999},"last":1.341}]},{"osd":6,"last update":"Mon Jan 22 05:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.298,"15min":1.397},"min":{"1min":0.81699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":4.9809999999999999},"last":1.234},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3460000000000001,"15min":1.4019999999999999},"min":{"1min":0.85699999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8089999999999999,"5min":1.8680000000000001,"15min":5.4210000000000003},"last":1.369}]},{"osd":7,"last update":"Mon Jan 22 05:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.353,"15min":1.3919999999999999},"min":{"1min":0.97199999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.472,"5min":2.472,"15min":5.7160000000000002},"last":1.425},{"interface":"front","average":{"1min":1.661,"5min":1.419,"15min":1.4379999999999999},"min":{"1min":0.97299999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":6.4279999999999999,"5min":6.4279999999999999,"15min":6.4279999999999999},"last":1.52}]}]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302568,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069272,"statfs":{"total":96636764160,"available":96326934528,"internally_reserved":0,"allocated":1277952,"data_stored":626574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:11:42 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.753},"min":{"1min":0.53300000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2749999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.879,"15min":0.83799999999999997},"min":{"1min":0.56599999999999995,"5min":0.373,"15min":0.373},"max":{"1min":1.1399999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.72199999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:11:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86599999999999999,"15min":0.81599999999999995},"min":{"1min":0.58799999999999997,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":1.254,"5min":1.534,"15min":1.534},"last":1.27},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.92800000000000005,"15min":0.93600000000000005},"min":{"1min":0.60699999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.377,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.97099999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:11:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1719999999999999,"15min":1.091},"min":{"1min":0.93000000000000005,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.611,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.2270000000000001,"15min":1.1799999999999999},"min":{"1min":0.58499999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.54,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.76000000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:11:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.242,"15min":1.2869999999999999},"min":{"1min":0.92600000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.448,"5min":1.8340000000000001,"15min":2.1709999999999998},"last":1.071},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.1639999999999999,"15min":1.196},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.63500000000000001},"max":{"1min":1.411,"5min":1.837,"15min":1.952},"last":1.3320000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:11:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.216,"15min":1.1919999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.579,"5min":2.0510000000000002,"15min":2.3660000000000001},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.234,"15min":1.296},"min":{"1min":0.77000000000000002,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5960000000000001,"5min":1.929,"15min":2.2210000000000001},"last":1.256}]},{"osd":6,"last update":"Mon Jan 22 05:11:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2310000000000001,"15min":1.2490000000000001},"min":{"1min":0.77600000000000002,"5min":0.754,"15min":0.68400000000000005},"max":{"1min":1.5680000000000001,"5min":1.875,"15min":2.1920000000000002},"last":1.224},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2929999999999999,"15min":1.286},"min":{"1min":0.84799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.788,"5min":2.1320000000000001,"15min":2.4449999999999998},"last":1.4750000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:11:42 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3140000000000001,"15min":1.3460000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.704,"5min":1.867,"15min":1.9199999999999999},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.4139999999999999,"15min":1.407},"min":{"1min":0.99299999999999999,"5min":0.92400000000000004,"15min":0.89000000000000001},"max":{"1min":1.9119999999999999,"5min":2.0329999999999999,"15min":2.5059999999999998},"last":1.369}]}]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302564,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069276,"statfs":{"total":96636764160,"available":96326938624,"internally_reserved":0,"allocated":1273856,"data_stored":625718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.90500000000000003,"15min":0.85599999999999998},"min":{"1min":0.56899999999999995,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":1.0740000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.47999999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4570000000000001,"5min":2.101,"15min":2.101},"last":1.2669999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99399999999999999,"15min":1},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48299999999999998},"max":{"1min":1.357,"5min":1.722,"15min":1.722},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.0600000000000001,"15min":1.032},"min":{"1min":0.59099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.427,"5min":2.008,"15min":2.008},"last":1.151}]},{"osd":3,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0660000000000001,"15min":1.0109999999999999},"min":{"1min":0.59499999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5089999999999999,"5min":4.665,"15min":4.665},"last":1.052},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95199999999999996,"15min":0.90400000000000003},"min":{"1min":0.50600000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4319999999999999,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":1.6879999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.335,"15min":1.242},"min":{"1min":0.74099999999999999,"5min":0.73799999999999999,"15min":0.60599999999999998},"max":{"1min":1.2809999999999999,"5min":15.76,"15min":15.76},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.4670000000000001,"15min":1.3109999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6499999999999999,"5min":16.975000000000001,"15min":16.975000000000001},"last":1.77}]},{"osd":5,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1890000000000001,"15min":1.1870000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.3759999999999999,"5min":2.738,"15min":2.738},"last":1.74},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2769999999999999,"15min":1.2709999999999999},"min":{"1min":0.90000000000000002,"5min":0.78900000000000003,"15min":0.74099999999999999},"max":{"1min":1.5409999999999999,"5min":2.52,"15min":2.52},"last":1.4970000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.2390000000000001,"15min":1.2549999999999999},"min":{"1min":0.85199999999999998,"5min":0.76700000000000002,"15min":0.76000000000000001},"max":{"1min":1.5309999999999999,"5min":3.093,"15min":3.093},"last":1.552},{"interface":"front","average":{"1min":1.3,"5min":1.333,"15min":1.335},"min":{"1min":0.93200000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.294},"last":1.6659999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3759999999999999,"15min":1.3680000000000001},"min":{"1min":0.86099999999999999,"5min":0.82299999999999995,"15min":0.77400000000000002},"max":{"1min":2.0019999999999998,"5min":4.4329999999999998,"15min":4.4329999999999998},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.3300000000000001,"15min":1.3500000000000001},"min":{"1min":0.81999999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.587,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":1.325}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302564,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069276,"statfs":{"total":96636764160,"available":96326938624,"internally_reserved":0,"allocated":1273856,"data_stored":626202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:11:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.94999999999999996,"15min":0.93700000000000006},"min":{"1min":0.41199999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.1399999999999999,"5min":15.273,"15min":15.273},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.96799999999999997},"min":{"1min":0.58999999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.4330000000000001,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.0229999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:11:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.1100000000000001,"15min":1.093},"min":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3879999999999999,"5min":15.473000000000001,"15min":15.473000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.996,"15min":1.016},"min":{"1min":0.626,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.282,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.0980000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.97599999999999998,"15min":1.02},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.609,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.077,"5min":1.2230000000000001,"15min":1.226},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.5820000000000001,"5min":15.439,"15min":15.439},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1879999999999999,"15min":1.333},"min":{"1min":0.68200000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3819999999999999,"5min":1.696,"15min":5.1799999999999997},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.175,"15min":1.2330000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.429,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":1.5960000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.2070000000000001,"15min":1.337},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.4970000000000001,"5min":2.891,"15min":3.548},"last":1.496},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.254,"15min":1.3759999999999999},"min":{"1min":0.75900000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5620000000000001,"5min":2.823,"15min":2.823},"last":1.3799999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.4510000000000001,"15min":1.458},"min":{"1min":0.81399999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.514,"5min":15.4,"15min":15.4},"last":1.274},{"interface":"front","average":{"1min":1.216,"5min":1.3440000000000001,"15min":1.4710000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5509999999999999,"5min":7.1349999999999998,"15min":7.1349999999999998},"last":1.5329999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.359,"15min":1.5680000000000001},"min":{"1min":0.91400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.5389999999999999,"5min":2.1080000000000001,"15min":5.29},"last":1.391},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3169999999999999,"15min":1.409},"min":{"1min":0.81799999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.671,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.6850000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:12:30.116 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:12:30.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.306+0000 7fb4d9800700 1 Processor -- start 2024-01-22T05:12:30.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.306+0000 7fb4d9800700 1 -- start start 2024-01-22T05:12:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.310+0000 7fb4d9800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb4d4065240 0x7fb4d40644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.310+0000 7fb4d9800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4d4065620 0x7fb4d40649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.310+0000 7fb4d9800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d40c2700 con 0x7fb4d415b9b0 2024-01-22T05:12:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.310+0000 7fb4d9800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d4064ed0 con 0x7fb4d4065620 2024-01-22T05:12:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.310+0000 7fb4d9800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d40c29a0 con 0x7fb4d4065240 2024-01-22T05:12:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.310+0000 7fb4d2000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4d4065620 0x7fb4d40649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.310+0000 7fb4d2a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb4d4065240 0x7fb4d40644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.310+0000 7fb4d2000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4d4065620 0x7fb4d40649e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60498/0 (socket says 172.21.15.49:60498) 2024-01-22T05:12:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.310+0000 7fb4d2000700 1 -- 172.21.15.49:0/2755732177 learned_addr learned my addr 172.21.15.49:0/2755732177 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.310+0000 7fb4d2a00700 1 -- 172.21.15.49:0/2755732177 >> v2:172.21.15.49:3300/0 conn(0x7fb4d4065620 msgr2=0x7fb4d40649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.310+0000 7fb4d2a00700 1 --2- 172.21.15.49:0/2755732177 >> v2:172.21.15.49:3300/0 conn(0x7fb4d4065620 0x7fb4d40649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.310+0000 7fb4d2a00700 1 -- 172.21.15.49:0/2755732177 >> v1:172.21.15.110:6789/0 conn(0x7fb4d415b9b0 legacy=0x7fb4d415bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.310+0000 7fb4d1600700 1 -- 172.21.15.49:0/2755732177 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397165208 0 0) 0x7fb4d40c2700 con 0x7fb4d415b9b0 2024-01-22T05:12:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.310+0000 7fb4d2a00700 1 -- 172.21.15.49:0/2755732177 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d40c2c80 con 0x7fb4d4065240 2024-01-22T05:12:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.310+0000 7fb4d2a00700 1 --2- 172.21.15.49:0/2755732177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4d4065240 0x7fb4d40644f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fb4d4060220 tx=0x7fb4c4009060).ready entity=mon.1 client_cookie=18dfb2aaa9178199 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:30.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.314+0000 7fb4d1600700 1 -- 172.21.15.49:0/2755732177 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c400f510 con 0x7fb4d4065240 2024-01-22T05:12:30.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.314+0000 7fb4d1600700 1 -- 172.21.15.49:0/2755732177 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c400f670 con 0x7fb4d4065240 2024-01-22T05:12:30.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.314+0000 7fb4d1600700 1 -- 172.21.15.49:0/2755732177 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c400f9f0 con 0x7fb4d4065240 2024-01-22T05:12:30.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.314+0000 7fb4d9800700 1 -- 172.21.15.49:0/2755732177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4d4065240 msgr2=0x7fb4d40644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:30.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.314+0000 7fb4d9800700 1 --2- 172.21.15.49:0/2755732177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4d4065240 0x7fb4d40644f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fb4d4060220 tx=0x7fb4c4009060).stop 2024-01-22T05:12:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.314+0000 7fb4d9800700 1 -- 172.21.15.49:0/2755732177 shutdown_connections 2024-01-22T05:12:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.314+0000 7fb4d9800700 1 --2- 172.21.15.49:0/2755732177 >> v2:172.21.15.49:3300/0 conn(0x7fb4d4065620 0x7fb4d40649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.314+0000 7fb4d9800700 1 --2- 172.21.15.49:0/2755732177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4d4065240 0x7fb4d40644f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.314+0000 7fb4d9800700 1 -- 172.21.15.49:0/2755732177 >> 172.21.15.49:0/2755732177 conn(0x7fb4d40c87f0 msgr2=0x7fb4d40c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:30.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.314+0000 7fb4d9800700 1 -- 172.21.15.49:0/2755732177 shutdown_connections 2024-01-22T05:12:30.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.314+0000 7fb4d9800700 1 -- 172.21.15.49:0/2755732177 wait complete. 2024-01-22T05:12:30.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.318+0000 7fb4d9800700 1 Processor -- start 2024-01-22T05:12:30.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.318+0000 7fb4d9800700 1 -- start start 2024-01-22T05:12:30.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d9800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4d4065240 0x7fb4d4148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:30.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d9800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4d4065620 0x7fb4d40a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:30.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d9800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4d415b9b0 0x7fb4d40bd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:30.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d9800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40bf7d0 con 0x7fb4d415b9b0 2024-01-22T05:12:30.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d9800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40bfa20 con 0x7fb4d4065240 2024-01-22T05:12:30.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d9800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40bfd00 con 0x7fb4d4065620 2024-01-22T05:12:30.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4d415b9b0 0x7fb4d40bd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:30.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d2a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4d4065240 0x7fb4d4148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:30.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d2a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4d4065240 0x7fb4d4148f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:39520/0 (socket says 172.21.15.49:39520) 2024-01-22T05:12:30.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d2000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4d4065620 0x7fb4d40a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:30.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d2a00700 1 -- 172.21.15.49:0/3045220876 learned_addr learned my addr 172.21.15.49:0/3045220876 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d3e00700 1 -- 172.21.15.49:0/3045220876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4d4065620 msgr2=0x7fb4d40a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d3e00700 1 --2- 172.21.15.49:0/3045220876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4d4065620 0x7fb4d40a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d3e00700 1 -- 172.21.15.49:0/3045220876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4d4065240 msgr2=0x7fb4d4148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d3e00700 1 --2- 172.21.15.49:0/3045220876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4d4065240 0x7fb4d4148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d3e00700 1 -- 172.21.15.49:0/3045220876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c40092a0 con 0x7fb4d415b9b0 2024-01-22T05:12:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4d3e00700 1 --2- 172.21.15.49:0/3045220876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4d415b9b0 0x7fb4d40bd690 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7fb4cc00c7e0 tx=0x7fb4cc001480).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.322+0000 7fb4ca000700 1 -- 172.21.15.49:0/3045220876 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc00f470 con 0x7fb4d415b9b0 2024-01-22T05:12:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.326+0000 7fb4ca000700 1 -- 172.21.15.49:0/3045220876 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4cc00f5d0 con 0x7fb4d415b9b0 2024-01-22T05:12:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.326+0000 7fb4d9800700 1 -- 172.21.15.49:0/3045220876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d40bffe0 con 0x7fb4d415b9b0 2024-01-22T05:12:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.326+0000 7fb4ca000700 1 -- 172.21.15.49:0/3045220876 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc00f970 con 0x7fb4d415b9b0 2024-01-22T05:12:30.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.326+0000 7fb4d9800700 1 -- 172.21.15.49:0/3045220876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d40c05a0 con 0x7fb4d415b9b0 2024-01-22T05:12:30.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.326+0000 7fb4d9800700 1 -- 172.21.15.49:0/3045220876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d40c07c0 con 0x7fb4d415b9b0 2024-01-22T05:12:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.326+0000 7fb4ca000700 1 -- 172.21.15.49:0/3045220876 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb4cc012400 con 0x7fb4d415b9b0 2024-01-22T05:12:30.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.330+0000 7fb4ca000700 1 --2- 172.21.15.49:0/3045220876 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb4ac05a540 0x7fb4ac05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:30.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.330+0000 7fb4ca000700 1 -- 172.21.15.49:0/3045220876 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb4cc0742c0 con 0x7fb4d415b9b0 2024-01-22T05:12:30.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.330+0000 7fb4d2a00700 1 --2- 172.21.15.49:0/3045220876 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb4ac05a540 0x7fb4ac05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:30.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.330+0000 7fb4d2a00700 1 --2- 172.21.15.49:0/3045220876 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb4ac05a540 0x7fb4ac05ca00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fb4d40c2ae0 tx=0x7fb4c4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.334+0000 7fb4ca000700 1 -- 172.21.15.49:0/3045220876 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb4cc047820 con 0x7fb4d415b9b0 2024-01-22T05:12:30.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.498+0000 7fb4d9800700 1 -- 172.21.15.49:0/3045220876 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4d4047060 con 0x7fb4ac05a540 2024-01-22T05:12:30.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.518+0000 7fb4ca000700 1 -- 172.21.15.49:0/3045220876 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359702 (secure 0 0 0) 0x7fb4d4047060 con 0x7fb4ac05a540 2024-01-22T05:12:30.530 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:30.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.526+0000 7fb4d9800700 1 -- 172.21.15.49:0/3045220876 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb4ac05a540 msgr2=0x7fb4ac05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:30.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.526+0000 7fb4d9800700 1 --2- 172.21.15.49:0/3045220876 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb4ac05a540 0x7fb4ac05ca00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fb4d40c2ae0 tx=0x7fb4c4017000).stop 2024-01-22T05:12:30.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.526+0000 7fb4d9800700 1 -- 172.21.15.49:0/3045220876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4d415b9b0 msgr2=0x7fb4d40bd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:30.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.526+0000 7fb4d9800700 1 --2- 172.21.15.49:0/3045220876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4d415b9b0 0x7fb4d40bd690 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7fb4cc00c7e0 tx=0x7fb4cc001480).stop 2024-01-22T05:12:30.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.526+0000 7fb4d9800700 1 -- 172.21.15.49:0/3045220876 shutdown_connections 2024-01-22T05:12:30.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.526+0000 7fb4d9800700 1 --2- 172.21.15.49:0/3045220876 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb4ac05a540 0x7fb4ac05ca00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.526+0000 7fb4d9800700 1 --2- 172.21.15.49:0/3045220876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4d415b9b0 0x7fb4d40bd690 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.526+0000 7fb4d9800700 1 --2- 172.21.15.49:0/3045220876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4d4065620 0x7fb4d40a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.526+0000 7fb4d9800700 1 --2- 172.21.15.49:0/3045220876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4d4065240 0x7fb4d4148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.526+0000 7fb4d9800700 1 -- 172.21.15.49:0/3045220876 >> 172.21.15.49:0/3045220876 conn(0x7fb4d40c87f0 msgr2=0x7fb4d40638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:30.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.526+0000 7fb4d9800700 1 -- 172.21.15.49:0/3045220876 shutdown_connections 2024-01-22T05:12:30.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.526+0000 7fb4d9800700 1 -- 172.21.15.49:0/3045220876 wait complete. 2024-01-22T05:12:30.534 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:12:30.549 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-01-22T05:12:29.399065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428748,"kb_used_data":9996,"kb_used_omap":0,"kb_used_meta":2418688,"kb_avail":752545972,"statfs":{"total":773094113280,"available":770607075328,"internally_reserved":0,"allocated":10235904,"data_stored":5016853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2476736512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2597014,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1997,"num_read_kb":-2282,"num_write":-19860,"num_write_kb":-94304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-19,"num_bytes_recovered":-46,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.912939"},"pg_stats":[{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.889590+0000","last_change":"2024-01-22T05:12:25.879013+0000","last_active":"2024-01-22T05:12:25.889590+0000","last_peered":"2024-01-22T05:12:25.889590+0000","last_clean":"2024-01-22T05:12:25.889590+0000","last_became_active":"2024-01-22T05:12:25.878393+0000","last_became_peered":"2024-01-22T05:12:25.878393+0000","last_unstale":"2024-01-22T05:12:25.889590+0000","last_undegraded":"2024-01-22T05:12:25.889590+0000","last_fullsized":"2024-01-22T05:12:25.889590+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.3f","version":"103'3","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.901353+0000","last_change":"2024-01-22T05:12:25.426821+0000","last_active":"2024-01-22T05:12:25.901353+0000","last_peered":"2024-01-22T05:12:25.901353+0000","last_clean":"2024-01-22T05:12:25.901353+0000","last_became_active":"2024-01-22T05:12:25.426523+0000","last_became_peered":"2024-01-22T05:12:25.426523+0000","last_unstale":"2024-01-22T05:12:25.901353+0000","last_undegraded":"2024-01-22T05:12:25.901353+0000","last_fullsized":"2024-01-22T05:12:25.901353+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.888888+0000","last_change":"2024-01-22T05:12:25.881275+0000","last_active":"2024-01-22T05:12:25.888888+0000","last_peered":"2024-01-22T05:12:25.888888+0000","last_clean":"2024-01-22T05:12:25.888888+0000","last_became_active":"2024-01-22T05:12:25.880780+0000","last_became_peered":"2024-01-22T05:12:25.880780+0000","last_unstale":"2024-01-22T05:12:25.888888+0000","last_undegraded":"2024-01-22T05:12:25.888888+0000","last_fullsized":"2024-01-22T05:12:25.888888+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.852766+0000","last_change":"2024-01-22T05:12:25.415146+0000","last_active":"2024-01-22T05:12:25.852766+0000","last_peered":"2024-01-22T05:12:25.852766+0000","last_clean":"2024-01-22T05:12:25.852766+0000","last_became_active":"2024-01-22T05:12:25.414865+0000","last_became_peered":"2024-01-22T05:12:25.414865+0000","last_unstale":"2024-01-22T05:12:25.852766+0000","last_undegraded":"2024-01-22T05:12:25.852766+0000","last_fullsized":"2024-01-22T05:12:25.852766+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.890367+0000","last_change":"2024-01-22T05:12:25.890367+0000","last_active":"2024-01-22T05:12:25.890367+0000","last_peered":"2024-01-22T05:12:25.890367+0000","last_clean":"2024-01-22T05:12:25.890367+0000","last_became_active":"2024-01-22T05:12:25.890071+0000","last_became_peered":"2024-01-22T05:12:25.890071+0000","last_unstale":"2024-01-22T05:12:25.890367+0000","last_undegraded":"2024-01-22T05:12:25.890367+0000","last_fullsized":"2024-01-22T05:12:25.890367+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.440612+0000","last_change":"2024-01-22T05:12:25.424228+0000","last_active":"2024-01-22T05:12:25.440612+0000","last_peered":"2024-01-22T05:12:25.440612+0000","last_clean":"2024-01-22T05:12:25.440612+0000","last_became_active":"2024-01-22T05:12:25.423942+0000","last_became_peered":"2024-01-22T05:12:25.423942+0000","last_unstale":"2024-01-22T05:12:25.440612+0000","last_undegraded":"2024-01-22T05:12:25.440612+0000","last_fullsized":"2024-01-22T05:12:25.440612+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.888937+0000","last_change":"2024-01-22T05:12:25.881313+0000","last_active":"2024-01-22T05:12:25.888937+0000","last_peered":"2024-01-22T05:12:25.888937+0000","last_clean":"2024-01-22T05:12:25.888937+0000","last_became_active":"2024-01-22T05:12:25.881019+0000","last_became_peered":"2024-01-22T05:12:25.881019+0000","last_unstale":"2024-01-22T05:12:25.888937+0000","last_undegraded":"2024-01-22T05:12:25.888937+0000","last_fullsized":"2024-01-22T05:12:25.888937+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3c","version":"103'2","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.896977+0000","last_change":"2024-01-22T05:12:25.433858+0000","last_active":"2024-01-22T05:12:25.896977+0000","last_peered":"2024-01-22T05:12:25.896977+0000","last_clean":"2024-01-22T05:12:25.896977+0000","last_became_active":"2024-01-22T05:12:25.433536+0000","last_became_peered":"2024-01-22T05:12:25.433536+0000","last_unstale":"2024-01-22T05:12:25.896977+0000","last_undegraded":"2024-01-22T05:12:25.896977+0000","last_fullsized":"2024-01-22T05:12:25.896977+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.877470+0000","last_change":"2024-01-22T05:12:25.877470+0000","last_active":"2024-01-22T05:12:25.877470+0000","last_peered":"2024-01-22T05:12:25.877470+0000","last_clean":"2024-01-22T05:12:25.877470+0000","last_became_active":"2024-01-22T05:12:25.876061+0000","last_became_peered":"2024-01-22T05:12:25.876061+0000","last_unstale":"2024-01-22T05:12:25.877470+0000","last_undegraded":"2024-01-22T05:12:25.877470+0000","last_fullsized":"2024-01-22T05:12:25.877470+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"103'1","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884911+0000","last_change":"2024-01-22T05:12:25.410105+0000","last_active":"2024-01-22T05:12:25.884911+0000","last_peered":"2024-01-22T05:12:25.884911+0000","last_clean":"2024-01-22T05:12:25.884911+0000","last_became_active":"2024-01-22T05:12:25.409816+0000","last_became_peered":"2024-01-22T05:12:25.409816+0000","last_unstale":"2024-01-22T05:12:25.884911+0000","last_undegraded":"2024-01-22T05:12:25.884911+0000","last_fullsized":"2024-01-22T05:12:25.884911+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.873592+0000","last_change":"2024-01-22T05:12:25.873592+0000","last_active":"2024-01-22T05:12:25.873592+0000","last_peered":"2024-01-22T05:12:25.873592+0000","last_clean":"2024-01-22T05:12:25.873592+0000","last_became_active":"2024-01-22T05:12:25.872966+0000","last_became_peered":"2024-01-22T05:12:25.872966+0000","last_unstale":"2024-01-22T05:12:25.873592+0000","last_undegraded":"2024-01-22T05:12:25.873592+0000","last_fullsized":"2024-01-22T05:12:25.873592+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3a","version":"103'1","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.885424+0000","last_change":"2024-01-22T05:12:25.428643+0000","last_active":"2024-01-22T05:12:25.885424+0000","last_peered":"2024-01-22T05:12:25.885424+0000","last_clean":"2024-01-22T05:12:25.885424+0000","last_became_active":"2024-01-22T05:12:25.428393+0000","last_became_peered":"2024-01-22T05:12:25.428393+0000","last_unstale":"2024-01-22T05:12:25.885424+0000","last_undegraded":"2024-01-22T05:12:25.885424+0000","last_fullsized":"2024-01-22T05:12:25.885424+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.886687+0000","last_change":"2024-01-22T05:12:25.878702+0000","last_active":"2024-01-22T05:12:25.886687+0000","last_peered":"2024-01-22T05:12:25.886687+0000","last_clean":"2024-01-22T05:12:25.886687+0000","last_became_active":"2024-01-22T05:12:25.878441+0000","last_became_peered":"2024-01-22T05:12:25.878441+0000","last_unstale":"2024-01-22T05:12:25.886687+0000","last_undegraded":"2024-01-22T05:12:25.886687+0000","last_fullsized":"2024-01-22T05:12:25.886687+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.420253+0000","last_change":"2024-01-22T05:12:25.419051+0000","last_active":"2024-01-22T05:12:25.420253+0000","last_peered":"2024-01-22T05:12:25.420253+0000","last_clean":"2024-01-22T05:12:25.420253+0000","last_became_active":"2024-01-22T05:12:25.418718+0000","last_became_peered":"2024-01-22T05:12:25.418718+0000","last_unstale":"2024-01-22T05:12:25.420253+0000","last_undegraded":"2024-01-22T05:12:25.420253+0000","last_fullsized":"2024-01-22T05:12:25.420253+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.875187+0000","last_change":"2024-01-22T05:12:25.875187+0000","last_active":"2024-01-22T05:12:25.875187+0000","last_peered":"2024-01-22T05:12:25.875187+0000","last_clean":"2024-01-22T05:12:25.875187+0000","last_became_active":"2024-01-22T05:12:25.874910+0000","last_became_peered":"2024-01-22T05:12:25.874910+0000","last_unstale":"2024-01-22T05:12:25.875187+0000","last_undegraded":"2024-01-22T05:12:25.875187+0000","last_fullsized":"2024-01-22T05:12:25.875187+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.866065+0000","last_change":"2024-01-22T05:12:25.425615+0000","last_active":"2024-01-22T05:12:25.866065+0000","last_peered":"2024-01-22T05:12:25.866065+0000","last_clean":"2024-01-22T05:12:25.866065+0000","last_became_active":"2024-01-22T05:12:25.425353+0000","last_became_peered":"2024-01-22T05:12:25.425353+0000","last_unstale":"2024-01-22T05:12:25.866065+0000","last_undegraded":"2024-01-22T05:12:25.866065+0000","last_fullsized":"2024-01-22T05:12:25.866065+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.879751+0000","last_change":"2024-01-22T05:12:25.879751+0000","last_active":"2024-01-22T05:12:25.879751+0000","last_peered":"2024-01-22T05:12:25.879751+0000","last_clean":"2024-01-22T05:12:25.879751+0000","last_became_active":"2024-01-22T05:12:25.879463+0000","last_became_peered":"2024-01-22T05:12:25.879463+0000","last_unstale":"2024-01-22T05:12:25.879751+0000","last_undegraded":"2024-01-22T05:12:25.879751+0000","last_fullsized":"2024-01-22T05:12:25.879751+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.854916+0000","last_change":"2024-01-22T05:12:25.412836+0000","last_active":"2024-01-22T05:12:25.854916+0000","last_peered":"2024-01-22T05:12:25.854916+0000","last_clean":"2024-01-22T05:12:25.854916+0000","last_became_active":"2024-01-22T05:12:25.412531+0000","last_became_peered":"2024-01-22T05:12:25.412531+0000","last_unstale":"2024-01-22T05:12:25.854916+0000","last_undegraded":"2024-01-22T05:12:25.854916+0000","last_fullsized":"2024-01-22T05:12:25.854916+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.898337+0000","last_change":"2024-01-22T05:12:25.897041+0000","last_active":"2024-01-22T05:12:25.898337+0000","last_peered":"2024-01-22T05:12:25.898337+0000","last_clean":"2024-01-22T05:12:25.898337+0000","last_became_active":"2024-01-22T05:12:25.896698+0000","last_became_peered":"2024-01-22T05:12:25.896698+0000","last_unstale":"2024-01-22T05:12:25.898337+0000","last_undegraded":"2024-01-22T05:12:25.898337+0000","last_fullsized":"2024-01-22T05:12:25.898337+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.441942+0000","last_change":"2024-01-22T05:12:25.436854+0000","last_active":"2024-01-22T05:12:25.441942+0000","last_peered":"2024-01-22T05:12:25.441942+0000","last_clean":"2024-01-22T05:12:25.441942+0000","last_became_active":"2024-01-22T05:12:25.436584+0000","last_became_peered":"2024-01-22T05:12:25.436584+0000","last_unstale":"2024-01-22T05:12:25.441942+0000","last_undegraded":"2024-01-22T05:12:25.441942+0000","last_fullsized":"2024-01-22T05:12:25.441942+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.885758+0000","last_change":"2024-01-22T05:12:25.879873+0000","last_active":"2024-01-22T05:12:25.885758+0000","last_peered":"2024-01-22T05:12:25.885758+0000","last_clean":"2024-01-22T05:12:25.885758+0000","last_became_active":"2024-01-22T05:12:25.879108+0000","last_became_peered":"2024-01-22T05:12:25.879108+0000","last_unstale":"2024-01-22T05:12:25.885758+0000","last_undegraded":"2024-01-22T05:12:25.885758+0000","last_fullsized":"2024-01-22T05:12:25.885758+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.855429+0000","last_change":"2024-01-22T05:12:25.420672+0000","last_active":"2024-01-22T05:12:25.855429+0000","last_peered":"2024-01-22T05:12:25.855429+0000","last_clean":"2024-01-22T05:12:25.855429+0000","last_became_active":"2024-01-22T05:12:25.420321+0000","last_became_peered":"2024-01-22T05:12:25.420321+0000","last_unstale":"2024-01-22T05:12:25.855429+0000","last_undegraded":"2024-01-22T05:12:25.855429+0000","last_fullsized":"2024-01-22T05:12:25.855429+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884797+0000","last_change":"2024-01-22T05:12:25.884797+0000","last_active":"2024-01-22T05:12:25.884797+0000","last_peered":"2024-01-22T05:12:25.884797+0000","last_clean":"2024-01-22T05:12:25.884797+0000","last_became_active":"2024-01-22T05:12:25.883665+0000","last_became_peered":"2024-01-22T05:12:25.883665+0000","last_unstale":"2024-01-22T05:12:25.884797+0000","last_undegraded":"2024-01-22T05:12:25.884797+0000","last_fullsized":"2024-01-22T05:12:25.884797+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.34","version":"103'4","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.900251+0000","last_change":"2024-01-22T05:12:25.432783+0000","last_active":"2024-01-22T05:12:25.900251+0000","last_peered":"2024-01-22T05:12:25.900251+0000","last_clean":"2024-01-22T05:12:25.900251+0000","last_became_active":"2024-01-22T05:12:25.432505+0000","last_became_peered":"2024-01-22T05:12:25.432505+0000","last_unstale":"2024-01-22T05:12:25.900251+0000","last_undegraded":"2024-01-22T05:12:25.900251+0000","last_fullsized":"2024-01-22T05:12:25.900251+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.889190+0000","last_change":"2024-01-22T05:12:25.889190+0000","last_active":"2024-01-22T05:12:25.889190+0000","last_peered":"2024-01-22T05:12:25.889190+0000","last_clean":"2024-01-22T05:12:25.889190+0000","last_became_active":"2024-01-22T05:12:25.887854+0000","last_became_peered":"2024-01-22T05:12:25.887854+0000","last_unstale":"2024-01-22T05:12:25.889190+0000","last_undegraded":"2024-01-22T05:12:25.889190+0000","last_fullsized":"2024-01-22T05:12:25.889190+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"103'1","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.897034+0000","last_change":"2024-01-22T05:12:25.427382+0000","last_active":"2024-01-22T05:12:25.897034+0000","last_peered":"2024-01-22T05:12:25.897034+0000","last_clean":"2024-01-22T05:12:25.897034+0000","last_became_active":"2024-01-22T05:12:25.427079+0000","last_became_peered":"2024-01-22T05:12:25.427079+0000","last_unstale":"2024-01-22T05:12:25.897034+0000","last_undegraded":"2024-01-22T05:12:25.897034+0000","last_fullsized":"2024-01-22T05:12:25.897034+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.891063+0000","last_change":"2024-01-22T05:12:25.891063+0000","last_active":"2024-01-22T05:12:25.891063+0000","last_peered":"2024-01-22T05:12:25.891063+0000","last_clean":"2024-01-22T05:12:25.891063+0000","last_became_active":"2024-01-22T05:12:25.890783+0000","last_became_peered":"2024-01-22T05:12:25.890783+0000","last_unstale":"2024-01-22T05:12:25.891063+0000","last_undegraded":"2024-01-22T05:12:25.891063+0000","last_fullsized":"2024-01-22T05:12:25.891063+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.852222+0000","last_change":"2024-01-22T05:12:25.429742+0000","last_active":"2024-01-22T05:12:25.852222+0000","last_peered":"2024-01-22T05:12:25.852222+0000","last_clean":"2024-01-22T05:12:25.852222+0000","last_became_active":"2024-01-22T05:12:25.429380+0000","last_became_peered":"2024-01-22T05:12:25.429380+0000","last_unstale":"2024-01-22T05:12:25.852222+0000","last_undegraded":"2024-01-22T05:12:25.852222+0000","last_fullsized":"2024-01-22T05:12:25.852222+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884824+0000","last_change":"2024-01-22T05:12:25.884824+0000","last_active":"2024-01-22T05:12:25.884824+0000","last_peered":"2024-01-22T05:12:25.884824+0000","last_clean":"2024-01-22T05:12:25.884824+0000","last_became_active":"2024-01-22T05:12:25.884531+0000","last_became_peered":"2024-01-22T05:12:25.884531+0000","last_unstale":"2024-01-22T05:12:25.884824+0000","last_undegraded":"2024-01-22T05:12:25.884824+0000","last_fullsized":"2024-01-22T05:12:25.884824+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.866500+0000","last_change":"2024-01-22T05:12:25.439604+0000","last_active":"2024-01-22T05:12:25.866500+0000","last_peered":"2024-01-22T05:12:25.866500+0000","last_clean":"2024-01-22T05:12:25.866500+0000","last_became_active":"2024-01-22T05:12:25.439307+0000","last_became_peered":"2024-01-22T05:12:25.439307+0000","last_unstale":"2024-01-22T05:12:25.866500+0000","last_undegraded":"2024-01-22T05:12:25.866500+0000","last_fullsized":"2024-01-22T05:12:25.866500+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884059+0000","last_change":"2024-01-22T05:12:25.884059+0000","last_active":"2024-01-22T05:12:25.884059+0000","last_peered":"2024-01-22T05:12:25.884059+0000","last_clean":"2024-01-22T05:12:25.884059+0000","last_became_active":"2024-01-22T05:12:25.883721+0000","last_became_peered":"2024-01-22T05:12:25.883721+0000","last_unstale":"2024-01-22T05:12:25.884059+0000","last_undegraded":"2024-01-22T05:12:25.884059+0000","last_fullsized":"2024-01-22T05:12:25.884059+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.30","version":"103'4","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.886642+0000","last_change":"2024-01-22T05:12:25.417540+0000","last_active":"2024-01-22T05:12:25.886642+0000","last_peered":"2024-01-22T05:12:25.886642+0000","last_clean":"2024-01-22T05:12:25.886642+0000","last_became_active":"2024-01-22T05:12:25.417079+0000","last_became_peered":"2024-01-22T05:12:25.417079+0000","last_unstale":"2024-01-22T05:12:25.886642+0000","last_undegraded":"2024-01-22T05:12:25.886642+0000","last_fullsized":"2024-01-22T05:12:25.886642+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.891434+0000","last_change":"2024-01-22T05:12:25.891434+0000","last_active":"2024-01-22T05:12:25.891434+0000","last_peered":"2024-01-22T05:12:25.891434+0000","last_clean":"2024-01-22T05:12:25.891434+0000","last_became_active":"2024-01-22T05:12:25.886101+0000","last_became_peered":"2024-01-22T05:12:25.886101+0000","last_unstale":"2024-01-22T05:12:25.891434+0000","last_undegraded":"2024-01-22T05:12:25.891434+0000","last_fullsized":"2024-01-22T05:12:25.891434+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.855439+0000","last_change":"2024-01-22T05:12:25.417283+0000","last_active":"2024-01-22T05:12:25.855439+0000","last_peered":"2024-01-22T05:12:25.855439+0000","last_clean":"2024-01-22T05:12:25.855439+0000","last_became_active":"2024-01-22T05:12:25.416973+0000","last_became_peered":"2024-01-22T05:12:25.416973+0000","last_unstale":"2024-01-22T05:12:25.855439+0000","last_undegraded":"2024-01-22T05:12:25.855439+0000","last_fullsized":"2024-01-22T05:12:25.855439+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.899538+0000","last_change":"2024-01-22T05:12:25.895906+0000","last_active":"2024-01-22T05:12:25.899538+0000","last_peered":"2024-01-22T05:12:25.899538+0000","last_clean":"2024-01-22T05:12:25.899538+0000","last_became_active":"2024-01-22T05:12:25.895716+0000","last_became_peered":"2024-01-22T05:12:25.895716+0000","last_unstale":"2024-01-22T05:12:25.899538+0000","last_undegraded":"2024-01-22T05:12:25.899538+0000","last_fullsized":"2024-01-22T05:12:25.899538+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.436018+0000","last_change":"2024-01-22T05:12:25.418633+0000","last_active":"2024-01-22T05:12:25.436018+0000","last_peered":"2024-01-22T05:12:25.436018+0000","last_clean":"2024-01-22T05:12:25.436018+0000","last_became_active":"2024-01-22T05:12:25.417905+0000","last_became_peered":"2024-01-22T05:12:25.417905+0000","last_unstale":"2024-01-22T05:12:25.436018+0000","last_undegraded":"2024-01-22T05:12:25.436018+0000","last_fullsized":"2024-01-22T05:12:25.436018+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.882247+0000","last_change":"2024-01-22T05:12:25.871920+0000","last_active":"2024-01-22T05:12:25.882247+0000","last_peered":"2024-01-22T05:12:25.882247+0000","last_clean":"2024-01-22T05:12:25.882247+0000","last_became_active":"2024-01-22T05:12:25.871632+0000","last_became_peered":"2024-01-22T05:12:25.871632+0000","last_unstale":"2024-01-22T05:12:25.882247+0000","last_undegraded":"2024-01-22T05:12:25.882247+0000","last_fullsized":"2024-01-22T05:12:25.882247+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"103'1","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.893177+0000","last_change":"2024-01-22T05:12:25.429819+0000","last_active":"2024-01-22T05:12:25.893177+0000","last_peered":"2024-01-22T05:12:25.893177+0000","last_clean":"2024-01-22T05:12:25.893177+0000","last_became_active":"2024-01-22T05:12:25.429464+0000","last_became_peered":"2024-01-22T05:12:25.429464+0000","last_unstale":"2024-01-22T05:12:25.893177+0000","last_undegraded":"2024-01-22T05:12:25.893177+0000","last_fullsized":"2024-01-22T05:12:25.893177+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.886139+0000","last_change":"2024-01-22T05:12:25.886139+0000","last_active":"2024-01-22T05:12:25.886139+0000","last_peered":"2024-01-22T05:12:25.886139+0000","last_clean":"2024-01-22T05:12:25.886139+0000","last_became_active":"2024-01-22T05:12:25.885851+0000","last_became_peered":"2024-01-22T05:12:25.885851+0000","last_unstale":"2024-01-22T05:12:25.886139+0000","last_undegraded":"2024-01-22T05:12:25.886139+0000","last_fullsized":"2024-01-22T05:12:25.886139+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.867378+0000","last_change":"2024-01-22T05:12:25.438195+0000","last_active":"2024-01-22T05:12:25.867378+0000","last_peered":"2024-01-22T05:12:25.867378+0000","last_clean":"2024-01-22T05:12:25.867378+0000","last_became_active":"2024-01-22T05:12:25.437970+0000","last_became_peered":"2024-01-22T05:12:25.437970+0000","last_unstale":"2024-01-22T05:12:25.867378+0000","last_undegraded":"2024-01-22T05:12:25.867378+0000","last_fullsized":"2024-01-22T05:12:25.867378+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.885526+0000","last_change":"2024-01-22T05:12:25.879591+0000","last_active":"2024-01-22T05:12:25.885526+0000","last_peered":"2024-01-22T05:12:25.885526+0000","last_clean":"2024-01-22T05:12:25.885526+0000","last_became_active":"2024-01-22T05:12:25.879288+0000","last_became_peered":"2024-01-22T05:12:25.879288+0000","last_unstale":"2024-01-22T05:12:25.885526+0000","last_undegraded":"2024-01-22T05:12:25.885526+0000","last_fullsized":"2024-01-22T05:12:25.885526+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2b","version":"103'1","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884465+0000","last_change":"2024-01-22T05:12:25.409965+0000","last_active":"2024-01-22T05:12:25.884465+0000","last_peered":"2024-01-22T05:12:25.884465+0000","last_clean":"2024-01-22T05:12:25.884465+0000","last_became_active":"2024-01-22T05:12:25.409639+0000","last_became_peered":"2024-01-22T05:12:25.409639+0000","last_unstale":"2024-01-22T05:12:25.884465+0000","last_undegraded":"2024-01-22T05:12:25.884465+0000","last_fullsized":"2024-01-22T05:12:25.884465+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.878205+0000","last_change":"2024-01-22T05:12:25.878205+0000","last_active":"2024-01-22T05:12:25.878205+0000","last_peered":"2024-01-22T05:12:25.878205+0000","last_clean":"2024-01-22T05:12:25.878205+0000","last_became_active":"2024-01-22T05:12:25.877935+0000","last_became_peered":"2024-01-22T05:12:25.877935+0000","last_unstale":"2024-01-22T05:12:25.878205+0000","last_undegraded":"2024-01-22T05:12:25.878205+0000","last_fullsized":"2024-01-22T05:12:25.878205+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.855622+0000","last_change":"2024-01-22T05:12:25.429756+0000","last_active":"2024-01-22T05:12:25.855622+0000","last_peered":"2024-01-22T05:12:25.855622+0000","last_clean":"2024-01-22T05:12:25.855622+0000","last_became_active":"2024-01-22T05:12:25.429429+0000","last_became_peered":"2024-01-22T05:12:25.429429+0000","last_unstale":"2024-01-22T05:12:25.855622+0000","last_undegraded":"2024-01-22T05:12:25.855622+0000","last_fullsized":"2024-01-22T05:12:25.855622+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.890984+0000","last_change":"2024-01-22T05:12:25.890984+0000","last_active":"2024-01-22T05:12:25.890984+0000","last_peered":"2024-01-22T05:12:25.890984+0000","last_clean":"2024-01-22T05:12:25.890984+0000","last_became_active":"2024-01-22T05:12:25.890658+0000","last_became_peered":"2024-01-22T05:12:25.890658+0000","last_unstale":"2024-01-22T05:12:25.890984+0000","last_undegraded":"2024-01-22T05:12:25.890984+0000","last_fullsized":"2024-01-22T05:12:25.890984+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.421761+0000","last_change":"2024-01-22T05:12:25.420106+0000","last_active":"2024-01-22T05:12:25.421761+0000","last_peered":"2024-01-22T05:12:25.421761+0000","last_clean":"2024-01-22T05:12:25.421761+0000","last_became_active":"2024-01-22T05:12:25.419754+0000","last_became_peered":"2024-01-22T05:12:25.419754+0000","last_unstale":"2024-01-22T05:12:25.421761+0000","last_undegraded":"2024-01-22T05:12:25.421761+0000","last_fullsized":"2024-01-22T05:12:25.421761+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.886103+0000","last_change":"2024-01-22T05:12:25.879535+0000","last_active":"2024-01-22T05:12:25.886103+0000","last_peered":"2024-01-22T05:12:25.886103+0000","last_clean":"2024-01-22T05:12:25.886103+0000","last_became_active":"2024-01-22T05:12:25.879248+0000","last_became_peered":"2024-01-22T05:12:25.879248+0000","last_unstale":"2024-01-22T05:12:25.886103+0000","last_undegraded":"2024-01-22T05:12:25.886103+0000","last_fullsized":"2024-01-22T05:12:25.886103+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.441274+0000","last_change":"2024-01-22T05:12:25.425169+0000","last_active":"2024-01-22T05:12:25.441274+0000","last_peered":"2024-01-22T05:12:25.441274+0000","last_clean":"2024-01-22T05:12:25.441274+0000","last_became_active":"2024-01-22T05:12:25.424600+0000","last_became_peered":"2024-01-22T05:12:25.424600+0000","last_unstale":"2024-01-22T05:12:25.441274+0000","last_undegraded":"2024-01-22T05:12:25.441274+0000","last_fullsized":"2024-01-22T05:12:25.441274+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.885396+0000","last_change":"2024-01-22T05:12:25.876532+0000","last_active":"2024-01-22T05:12:25.885396+0000","last_peered":"2024-01-22T05:12:25.885396+0000","last_clean":"2024-01-22T05:12:25.885396+0000","last_became_active":"2024-01-22T05:12:25.876088+0000","last_became_peered":"2024-01-22T05:12:25.876088+0000","last_unstale":"2024-01-22T05:12:25.885396+0000","last_undegraded":"2024-01-22T05:12:25.885396+0000","last_fullsized":"2024-01-22T05:12:25.885396+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.854605+0000","last_change":"2024-01-22T05:12:25.410503+0000","last_active":"2024-01-22T05:12:25.854605+0000","last_peered":"2024-01-22T05:12:25.854605+0000","last_clean":"2024-01-22T05:12:25.854605+0000","last_became_active":"2024-01-22T05:12:25.410018+0000","last_became_peered":"2024-01-22T05:12:25.410018+0000","last_unstale":"2024-01-22T05:12:25.854605+0000","last_undegraded":"2024-01-22T05:12:25.854605+0000","last_fullsized":"2024-01-22T05:12:25.854605+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.874870+0000","last_change":"2024-01-22T05:12:25.874870+0000","last_active":"2024-01-22T05:12:25.874870+0000","last_peered":"2024-01-22T05:12:25.874870+0000","last_clean":"2024-01-22T05:12:25.874870+0000","last_became_active":"2024-01-22T05:12:25.874568+0000","last_became_peered":"2024-01-22T05:12:25.874568+0000","last_unstale":"2024-01-22T05:12:25.874870+0000","last_undegraded":"2024-01-22T05:12:25.874870+0000","last_fullsized":"2024-01-22T05:12:25.874870+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.855269+0000","last_change":"2024-01-22T05:12:25.431022+0000","last_active":"2024-01-22T05:12:25.855269+0000","last_peered":"2024-01-22T05:12:25.855269+0000","last_clean":"2024-01-22T05:12:25.855269+0000","last_became_active":"2024-01-22T05:12:25.430002+0000","last_became_peered":"2024-01-22T05:12:25.430002+0000","last_unstale":"2024-01-22T05:12:25.855269+0000","last_undegraded":"2024-01-22T05:12:25.855269+0000","last_fullsized":"2024-01-22T05:12:25.855269+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.874110+0000","last_change":"2024-01-22T05:12:25.874110+0000","last_active":"2024-01-22T05:12:25.874110+0000","last_peered":"2024-01-22T05:12:25.874110+0000","last_clean":"2024-01-22T05:12:25.874110+0000","last_became_active":"2024-01-22T05:12:25.872892+0000","last_became_peered":"2024-01-22T05:12:25.872892+0000","last_unstale":"2024-01-22T05:12:25.874110+0000","last_undegraded":"2024-01-22T05:12:25.874110+0000","last_fullsized":"2024-01-22T05:12:25.874110+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.426335+0000","last_change":"2024-01-22T05:12:25.419226+0000","last_active":"2024-01-22T05:12:25.426335+0000","last_peered":"2024-01-22T05:12:25.426335+0000","last_clean":"2024-01-22T05:12:25.426335+0000","last_became_active":"2024-01-22T05:12:25.418877+0000","last_became_peered":"2024-01-22T05:12:25.418877+0000","last_unstale":"2024-01-22T05:12:25.426335+0000","last_undegraded":"2024-01-22T05:12:25.426335+0000","last_fullsized":"2024-01-22T05:12:25.426335+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.874047+0000","last_change":"2024-01-22T05:12:25.874047+0000","last_active":"2024-01-22T05:12:25.874047+0000","last_peered":"2024-01-22T05:12:25.874047+0000","last_clean":"2024-01-22T05:12:25.874047+0000","last_became_active":"2024-01-22T05:12:25.873691+0000","last_became_peered":"2024-01-22T05:12:25.873691+0000","last_unstale":"2024-01-22T05:12:25.874047+0000","last_undegraded":"2024-01-22T05:12:25.874047+0000","last_fullsized":"2024-01-22T05:12:25.874047+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.867424+0000","last_change":"2024-01-22T05:12:25.423615+0000","last_active":"2024-01-22T05:12:25.867424+0000","last_peered":"2024-01-22T05:12:25.867424+0000","last_clean":"2024-01-22T05:12:25.867424+0000","last_became_active":"2024-01-22T05:12:25.422823+0000","last_became_peered":"2024-01-22T05:12:25.422823+0000","last_unstale":"2024-01-22T05:12:25.867424+0000","last_undegraded":"2024-01-22T05:12:25.867424+0000","last_fullsized":"2024-01-22T05:12:25.867424+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.888430+0000","last_change":"2024-01-22T05:12:25.888430+0000","last_active":"2024-01-22T05:12:25.888430+0000","last_peered":"2024-01-22T05:12:25.888430+0000","last_clean":"2024-01-22T05:12:25.888430+0000","last_became_active":"2024-01-22T05:12:25.887534+0000","last_became_peered":"2024-01-22T05:12:25.887534+0000","last_unstale":"2024-01-22T05:12:25.888430+0000","last_undegraded":"2024-01-22T05:12:25.888430+0000","last_fullsized":"2024-01-22T05:12:25.888430+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.438782+0000","last_change":"2024-01-22T05:12:25.437943+0000","last_active":"2024-01-22T05:12:25.438782+0000","last_peered":"2024-01-22T05:12:25.438782+0000","last_clean":"2024-01-22T05:12:25.438782+0000","last_became_active":"2024-01-22T05:12:25.437583+0000","last_became_peered":"2024-01-22T05:12:25.437583+0000","last_unstale":"2024-01-22T05:12:25.438782+0000","last_undegraded":"2024-01-22T05:12:25.438782+0000","last_fullsized":"2024-01-22T05:12:25.438782+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.865199+0000","last_change":"2024-01-22T05:12:25.862765+0000","last_active":"2024-01-22T05:12:25.865199+0000","last_peered":"2024-01-22T05:12:25.865199+0000","last_clean":"2024-01-22T05:12:25.865199+0000","last_became_active":"2024-01-22T05:12:25.862466+0000","last_became_peered":"2024-01-22T05:12:25.862466+0000","last_unstale":"2024-01-22T05:12:25.865199+0000","last_undegraded":"2024-01-22T05:12:25.865199+0000","last_fullsized":"2024-01-22T05:12:25.865199+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.855072+0000","last_change":"2024-01-22T05:12:25.397192+0000","last_active":"2024-01-22T05:12:25.855072+0000","last_peered":"2024-01-22T05:12:25.855072+0000","last_clean":"2024-01-22T05:12:25.855072+0000","last_became_active":"2024-01-22T05:12:25.395834+0000","last_became_peered":"2024-01-22T05:12:25.395834+0000","last_unstale":"2024-01-22T05:12:25.855072+0000","last_undegraded":"2024-01-22T05:12:25.855072+0000","last_fullsized":"2024-01-22T05:12:25.855072+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.873350+0000","last_change":"2024-01-22T05:12:25.865863+0000","last_active":"2024-01-22T05:12:25.873350+0000","last_peered":"2024-01-22T05:12:25.873350+0000","last_clean":"2024-01-22T05:12:25.873350+0000","last_became_active":"2024-01-22T05:12:25.865474+0000","last_became_peered":"2024-01-22T05:12:25.865474+0000","last_unstale":"2024-01-22T05:12:25.873350+0000","last_undegraded":"2024-01-22T05:12:25.873350+0000","last_fullsized":"2024-01-22T05:12:25.873350+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.852771+0000","last_change":"2024-01-22T05:12:25.420873+0000","last_active":"2024-01-22T05:12:25.852771+0000","last_peered":"2024-01-22T05:12:25.852771+0000","last_clean":"2024-01-22T05:12:25.852771+0000","last_became_active":"2024-01-22T05:12:25.420586+0000","last_became_peered":"2024-01-22T05:12:25.420586+0000","last_unstale":"2024-01-22T05:12:25.852771+0000","last_undegraded":"2024-01-22T05:12:25.852771+0000","last_fullsized":"2024-01-22T05:12:25.852771+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.880134+0000","last_change":"2024-01-22T05:12:25.880134+0000","last_active":"2024-01-22T05:12:25.880134+0000","last_peered":"2024-01-22T05:12:25.880134+0000","last_clean":"2024-01-22T05:12:25.880134+0000","last_became_active":"2024-01-22T05:12:25.879723+0000","last_became_peered":"2024-01-22T05:12:25.879723+0000","last_unstale":"2024-01-22T05:12:25.880134+0000","last_undegraded":"2024-01-22T05:12:25.880134+0000","last_fullsized":"2024-01-22T05:12:25.880134+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.854780+0000","last_change":"2024-01-22T05:12:25.417355+0000","last_active":"2024-01-22T05:12:25.854780+0000","last_peered":"2024-01-22T05:12:25.854780+0000","last_clean":"2024-01-22T05:12:25.854780+0000","last_became_active":"2024-01-22T05:12:25.416705+0000","last_became_peered":"2024-01-22T05:12:25.416705+0000","last_unstale":"2024-01-22T05:12:25.854780+0000","last_undegraded":"2024-01-22T05:12:25.854780+0000","last_fullsized":"2024-01-22T05:12:25.854780+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.886935+0000","last_change":"2024-01-22T05:12:25.886935+0000","last_active":"2024-01-22T05:12:25.886935+0000","last_peered":"2024-01-22T05:12:25.886935+0000","last_clean":"2024-01-22T05:12:25.886935+0000","last_became_active":"2024-01-22T05:12:25.886673+0000","last_became_peered":"2024-01-22T05:12:25.886673+0000","last_unstale":"2024-01-22T05:12:25.886935+0000","last_undegraded":"2024-01-22T05:12:25.886935+0000","last_fullsized":"2024-01-22T05:12:25.886935+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"103'1","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.882352+0000","last_change":"2024-01-22T05:12:25.413501+0000","last_active":"2024-01-22T05:12:25.882352+0000","last_peered":"2024-01-22T05:12:25.882352+0000","last_clean":"2024-01-22T05:12:25.882352+0000","last_became_active":"2024-01-22T05:12:25.413105+0000","last_became_peered":"2024-01-22T05:12:25.413105+0000","last_unstale":"2024-01-22T05:12:25.882352+0000","last_undegraded":"2024-01-22T05:12:25.882352+0000","last_fullsized":"2024-01-22T05:12:25.882352+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.894054+0000","last_change":"2024-01-22T05:12:25.894054+0000","last_active":"2024-01-22T05:12:25.894054+0000","last_peered":"2024-01-22T05:12:25.894054+0000","last_clean":"2024-01-22T05:12:25.894054+0000","last_became_active":"2024-01-22T05:12:25.893764+0000","last_became_peered":"2024-01-22T05:12:25.893764+0000","last_unstale":"2024-01-22T05:12:25.894054+0000","last_undegraded":"2024-01-22T05:12:25.894054+0000","last_fullsized":"2024-01-22T05:12:25.894054+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"103'1","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.864637+0000","last_change":"2024-01-22T05:12:25.430818+0000","last_active":"2024-01-22T05:12:25.864637+0000","last_peered":"2024-01-22T05:12:25.864637+0000","last_clean":"2024-01-22T05:12:25.864637+0000","last_became_active":"2024-01-22T05:12:25.430529+0000","last_became_peered":"2024-01-22T05:12:25.430529+0000","last_unstale":"2024-01-22T05:12:25.864637+0000","last_undegraded":"2024-01-22T05:12:25.864637+0000","last_fullsized":"2024-01-22T05:12:25.864637+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.897208+0000","last_change":"2024-01-22T05:12:25.890242+0000","last_active":"2024-01-22T05:12:25.897208+0000","last_peered":"2024-01-22T05:12:25.897208+0000","last_clean":"2024-01-22T05:12:25.897208+0000","last_became_active":"2024-01-22T05:12:25.889956+0000","last_became_peered":"2024-01-22T05:12:25.889956+0000","last_unstale":"2024-01-22T05:12:25.897208+0000","last_undegraded":"2024-01-22T05:12:25.897208+0000","last_fullsized":"2024-01-22T05:12:25.897208+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"103'2","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.893400+0000","last_change":"2024-01-22T05:12:25.429831+0000","last_active":"2024-01-22T05:12:25.893400+0000","last_peered":"2024-01-22T05:12:25.893400+0000","last_clean":"2024-01-22T05:12:25.893400+0000","last_became_active":"2024-01-22T05:12:25.429535+0000","last_became_peered":"2024-01-22T05:12:25.429535+0000","last_unstale":"2024-01-22T05:12:25.893400+0000","last_undegraded":"2024-01-22T05:12:25.893400+0000","last_fullsized":"2024-01-22T05:12:25.893400+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.869108+0000","last_change":"2024-01-22T05:12:25.864927+0000","last_active":"2024-01-22T05:12:25.869108+0000","last_peered":"2024-01-22T05:12:25.869108+0000","last_clean":"2024-01-22T05:12:25.869108+0000","last_became_active":"2024-01-22T05:12:25.863638+0000","last_became_peered":"2024-01-22T05:12:25.863638+0000","last_unstale":"2024-01-22T05:12:25.869108+0000","last_undegraded":"2024-01-22T05:12:25.869108+0000","last_fullsized":"2024-01-22T05:12:25.869108+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.855027+0000","last_change":"2024-01-22T05:12:25.426650+0000","last_active":"2024-01-22T05:12:25.855027+0000","last_peered":"2024-01-22T05:12:25.855027+0000","last_clean":"2024-01-22T05:12:25.855027+0000","last_became_active":"2024-01-22T05:12:25.426351+0000","last_became_peered":"2024-01-22T05:12:25.426351+0000","last_unstale":"2024-01-22T05:12:25.855027+0000","last_undegraded":"2024-01-22T05:12:25.855027+0000","last_fullsized":"2024-01-22T05:12:25.855027+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.874346+0000","last_change":"2024-01-22T05:12:25.871540+0000","last_active":"2024-01-22T05:12:25.874346+0000","last_peered":"2024-01-22T05:12:25.874346+0000","last_clean":"2024-01-22T05:12:25.874346+0000","last_became_active":"2024-01-22T05:12:25.869129+0000","last_became_peered":"2024-01-22T05:12:25.869129+0000","last_unstale":"2024-01-22T05:12:25.874346+0000","last_undegraded":"2024-01-22T05:12:25.874346+0000","last_fullsized":"2024-01-22T05:12:25.874346+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.870447+0000","last_change":"2024-01-22T05:12:25.426810+0000","last_active":"2024-01-22T05:12:25.870447+0000","last_peered":"2024-01-22T05:12:25.870447+0000","last_clean":"2024-01-22T05:12:25.870447+0000","last_became_active":"2024-01-22T05:12:25.426540+0000","last_became_peered":"2024-01-22T05:12:25.426540+0000","last_unstale":"2024-01-22T05:12:25.870447+0000","last_undegraded":"2024-01-22T05:12:25.870447+0000","last_fullsized":"2024-01-22T05:12:25.870447+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.878139+0000","last_change":"2024-01-22T05:12:25.878139+0000","last_active":"2024-01-22T05:12:25.878139+0000","last_peered":"2024-01-22T05:12:25.878139+0000","last_clean":"2024-01-22T05:12:25.878139+0000","last_became_active":"2024-01-22T05:12:25.877867+0000","last_became_peered":"2024-01-22T05:12:25.877867+0000","last_unstale":"2024-01-22T05:12:25.878139+0000","last_undegraded":"2024-01-22T05:12:25.878139+0000","last_fullsized":"2024-01-22T05:12:25.878139+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.860649+0000","last_change":"2024-01-22T05:12:25.428128+0000","last_active":"2024-01-22T05:12:25.860649+0000","last_peered":"2024-01-22T05:12:25.860649+0000","last_clean":"2024-01-22T05:12:25.860649+0000","last_became_active":"2024-01-22T05:12:25.427849+0000","last_became_peered":"2024-01-22T05:12:25.427849+0000","last_unstale":"2024-01-22T05:12:25.860649+0000","last_undegraded":"2024-01-22T05:12:25.860649+0000","last_fullsized":"2024-01-22T05:12:25.860649+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.894223+0000","last_change":"2024-01-22T05:12:25.894223+0000","last_active":"2024-01-22T05:12:25.894223+0000","last_peered":"2024-01-22T05:12:25.894223+0000","last_clean":"2024-01-22T05:12:25.894223+0000","last_became_active":"2024-01-22T05:12:25.893924+0000","last_became_peered":"2024-01-22T05:12:25.893924+0000","last_unstale":"2024-01-22T05:12:25.894223+0000","last_undegraded":"2024-01-22T05:12:25.894223+0000","last_fullsized":"2024-01-22T05:12:25.894223+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.425438+0000","last_change":"2024-01-22T05:12:25.424032+0000","last_active":"2024-01-22T05:12:25.425438+0000","last_peered":"2024-01-22T05:12:25.425438+0000","last_clean":"2024-01-22T05:12:25.425438+0000","last_became_active":"2024-01-22T05:12:25.423709+0000","last_became_peered":"2024-01-22T05:12:25.423709+0000","last_unstale":"2024-01-22T05:12:25.425438+0000","last_undegraded":"2024-01-22T05:12:25.425438+0000","last_fullsized":"2024-01-22T05:12:25.425438+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.873851+0000","last_change":"2024-01-22T05:12:25.865067+0000","last_active":"2024-01-22T05:12:25.873851+0000","last_peered":"2024-01-22T05:12:25.873851+0000","last_clean":"2024-01-22T05:12:25.873851+0000","last_became_active":"2024-01-22T05:12:25.864774+0000","last_became_peered":"2024-01-22T05:12:25.864774+0000","last_unstale":"2024-01-22T05:12:25.873851+0000","last_undegraded":"2024-01-22T05:12:25.873851+0000","last_fullsized":"2024-01-22T05:12:25.873851+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.865964+0000","last_change":"2024-01-22T05:12:25.434351+0000","last_active":"2024-01-22T05:12:25.865964+0000","last_peered":"2024-01-22T05:12:25.865964+0000","last_clean":"2024-01-22T05:12:25.865964+0000","last_became_active":"2024-01-22T05:12:25.434192+0000","last_became_peered":"2024-01-22T05:12:25.434192+0000","last_unstale":"2024-01-22T05:12:25.865964+0000","last_undegraded":"2024-01-22T05:12:25.865964+0000","last_fullsized":"2024-01-22T05:12:25.865964+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.885378+0000","last_change":"2024-01-22T05:12:25.876354+0000","last_active":"2024-01-22T05:12:25.885378+0000","last_peered":"2024-01-22T05:12:25.885378+0000","last_clean":"2024-01-22T05:12:25.885378+0000","last_became_active":"2024-01-22T05:12:25.875660+0000","last_became_peered":"2024-01-22T05:12:25.875660+0000","last_unstale":"2024-01-22T05:12:25.885378+0000","last_undegraded":"2024-01-22T05:12:25.885378+0000","last_fullsized":"2024-01-22T05:12:25.885378+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.871904+0000","last_change":"2024-01-22T05:12:25.423632+0000","last_active":"2024-01-22T05:12:25.871904+0000","last_peered":"2024-01-22T05:12:25.871904+0000","last_clean":"2024-01-22T05:12:25.871904+0000","last_became_active":"2024-01-22T05:12:25.423372+0000","last_became_peered":"2024-01-22T05:12:25.423372+0000","last_unstale":"2024-01-22T05:12:25.871904+0000","last_undegraded":"2024-01-22T05:12:25.871904+0000","last_fullsized":"2024-01-22T05:12:25.871904+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.864572+0000","last_change":"2024-01-22T05:12:25.861744+0000","last_active":"2024-01-22T05:12:25.864572+0000","last_peered":"2024-01-22T05:12:25.864572+0000","last_clean":"2024-01-22T05:12:25.864572+0000","last_became_active":"2024-01-22T05:12:25.861448+0000","last_became_peered":"2024-01-22T05:12:25.861448+0000","last_unstale":"2024-01-22T05:12:25.864572+0000","last_undegraded":"2024-01-22T05:12:25.864572+0000","last_fullsized":"2024-01-22T05:12:25.864572+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.435390+0000","last_change":"2024-01-22T05:12:25.416465+0000","last_active":"2024-01-22T05:12:25.435390+0000","last_peered":"2024-01-22T05:12:25.435390+0000","last_clean":"2024-01-22T05:12:25.435390+0000","last_became_active":"2024-01-22T05:12:25.416143+0000","last_became_peered":"2024-01-22T05:12:25.416143+0000","last_unstale":"2024-01-22T05:12:25.435390+0000","last_undegraded":"2024-01-22T05:12:25.435390+0000","last_fullsized":"2024-01-22T05:12:25.435390+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884797+0000","last_change":"2024-01-22T05:12:25.884797+0000","last_active":"2024-01-22T05:12:25.884797+0000","last_peered":"2024-01-22T05:12:25.884797+0000","last_clean":"2024-01-22T05:12:25.884797+0000","last_became_active":"2024-01-22T05:12:25.883868+0000","last_became_peered":"2024-01-22T05:12:25.883868+0000","last_unstale":"2024-01-22T05:12:25.884797+0000","last_undegraded":"2024-01-22T05:12:25.884797+0000","last_fullsized":"2024-01-22T05:12:25.884797+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"103'3","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.883579+0000","last_change":"2024-01-22T05:12:25.417483+0000","last_active":"2024-01-22T05:12:25.883579+0000","last_peered":"2024-01-22T05:12:25.883579+0000","last_clean":"2024-01-22T05:12:25.883579+0000","last_became_active":"2024-01-22T05:12:25.417168+0000","last_became_peered":"2024-01-22T05:12:25.417168+0000","last_unstale":"2024-01-22T05:12:25.883579+0000","last_undegraded":"2024-01-22T05:12:25.883579+0000","last_fullsized":"2024-01-22T05:12:25.883579+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.882550+0000","last_change":"2024-01-22T05:12:25.882550+0000","last_active":"2024-01-22T05:12:25.882550+0000","last_peered":"2024-01-22T05:12:25.882550+0000","last_clean":"2024-01-22T05:12:25.882550+0000","last_became_active":"2024-01-22T05:12:25.881607+0000","last_became_peered":"2024-01-22T05:12:25.881607+0000","last_unstale":"2024-01-22T05:12:25.882550+0000","last_undegraded":"2024-01-22T05:12:25.882550+0000","last_fullsized":"2024-01-22T05:12:25.882550+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"103'2","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.892244+0000","last_change":"2024-01-22T05:12:25.415988+0000","last_active":"2024-01-22T05:12:25.892244+0000","last_peered":"2024-01-22T05:12:25.892244+0000","last_clean":"2024-01-22T05:12:25.892244+0000","last_became_active":"2024-01-22T05:12:25.415651+0000","last_became_peered":"2024-01-22T05:12:25.415651+0000","last_unstale":"2024-01-22T05:12:25.892244+0000","last_undegraded":"2024-01-22T05:12:25.892244+0000","last_fullsized":"2024-01-22T05:12:25.892244+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.890436+0000","last_change":"2024-01-22T05:12:25.890436+0000","last_active":"2024-01-22T05:12:25.890436+0000","last_peered":"2024-01-22T05:12:25.890436+0000","last_clean":"2024-01-22T05:12:25.890436+0000","last_became_active":"2024-01-22T05:12:25.890234+0000","last_became_peered":"2024-01-22T05:12:25.890234+0000","last_unstale":"2024-01-22T05:12:25.890436+0000","last_undegraded":"2024-01-22T05:12:25.890436+0000","last_fullsized":"2024-01-22T05:12:25.890436+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"103'1","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.870815+0000","last_change":"2024-01-22T05:12:25.429465+0000","last_active":"2024-01-22T05:12:25.870815+0000","last_peered":"2024-01-22T05:12:25.870815+0000","last_clean":"2024-01-22T05:12:25.870815+0000","last_became_active":"2024-01-22T05:12:25.422841+0000","last_became_peered":"2024-01-22T05:12:25.422841+0000","last_unstale":"2024-01-22T05:12:25.870815+0000","last_undegraded":"2024-01-22T05:12:25.870815+0000","last_fullsized":"2024-01-22T05:12:25.870815+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.882541+0000","last_change":"2024-01-22T05:12:25.873839+0000","last_active":"2024-01-22T05:12:25.882541+0000","last_peered":"2024-01-22T05:12:25.882541+0000","last_clean":"2024-01-22T05:12:25.882541+0000","last_became_active":"2024-01-22T05:12:25.872789+0000","last_became_peered":"2024-01-22T05:12:25.872789+0000","last_unstale":"2024-01-22T05:12:25.882541+0000","last_undegraded":"2024-01-22T05:12:25.882541+0000","last_fullsized":"2024-01-22T05:12:25.882541+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.441981+0000","last_change":"2024-01-22T05:12:25.436898+0000","last_active":"2024-01-22T05:12:25.441981+0000","last_peered":"2024-01-22T05:12:25.441981+0000","last_clean":"2024-01-22T05:12:25.441981+0000","last_became_active":"2024-01-22T05:12:25.436619+0000","last_became_peered":"2024-01-22T05:12:25.436619+0000","last_unstale":"2024-01-22T05:12:25.441981+0000","last_undegraded":"2024-01-22T05:12:25.441981+0000","last_fullsized":"2024-01-22T05:12:25.441981+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.867912+0000","last_change":"2024-01-22T05:12:25.858899+0000","last_active":"2024-01-22T05:12:25.867912+0000","last_peered":"2024-01-22T05:12:25.867912+0000","last_clean":"2024-01-22T05:12:25.867912+0000","last_became_active":"2024-01-22T05:12:25.858466+0000","last_became_peered":"2024-01-22T05:12:25.858466+0000","last_unstale":"2024-01-22T05:12:25.867912+0000","last_undegraded":"2024-01-22T05:12:25.867912+0000","last_fullsized":"2024-01-22T05:12:25.867912+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.853816+0000","last_change":"2024-01-22T05:12:25.411802+0000","last_active":"2024-01-22T05:12:25.853816+0000","last_peered":"2024-01-22T05:12:25.853816+0000","last_clean":"2024-01-22T05:12:25.853816+0000","last_became_active":"2024-01-22T05:12:25.409710+0000","last_became_peered":"2024-01-22T05:12:25.409710+0000","last_unstale":"2024-01-22T05:12:25.853816+0000","last_undegraded":"2024-01-22T05:12:25.853816+0000","last_fullsized":"2024-01-22T05:12:25.853816+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.883585+0000","last_change":"2024-01-22T05:12:25.883585+0000","last_active":"2024-01-22T05:12:25.883585+0000","last_peered":"2024-01-22T05:12:25.883585+0000","last_clean":"2024-01-22T05:12:25.883585+0000","last_became_active":"2024-01-22T05:12:25.883334+0000","last_became_peered":"2024-01-22T05:12:25.883334+0000","last_unstale":"2024-01-22T05:12:25.883585+0000","last_undegraded":"2024-01-22T05:12:25.883585+0000","last_fullsized":"2024-01-22T05:12:25.883585+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"103'4","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.898468+0000","last_change":"2024-01-22T05:12:25.414991+0000","last_active":"2024-01-22T05:12:25.898468+0000","last_peered":"2024-01-22T05:12:25.898468+0000","last_clean":"2024-01-22T05:12:25.898468+0000","last_became_active":"2024-01-22T05:12:25.414589+0000","last_became_peered":"2024-01-22T05:12:25.414589+0000","last_unstale":"2024-01-22T05:12:25.898468+0000","last_undegraded":"2024-01-22T05:12:25.898468+0000","last_fullsized":"2024-01-22T05:12:25.898468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.889566+0000","last_change":"2024-01-22T05:12:25.885054+0000","last_active":"2024-01-22T05:12:25.889566+0000","last_peered":"2024-01-22T05:12:25.889566+0000","last_clean":"2024-01-22T05:12:25.889566+0000","last_became_active":"2024-01-22T05:12:25.878731+0000","last_became_peered":"2024-01-22T05:12:25.878731+0000","last_unstale":"2024-01-22T05:12:25.889566+0000","last_undegraded":"2024-01-22T05:12:25.889566+0000","last_fullsized":"2024-01-22T05:12:25.889566+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"103'2","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.885743+0000","last_change":"2024-01-22T05:12:25.413821+0000","last_active":"2024-01-22T05:12:25.885743+0000","last_peered":"2024-01-22T05:12:25.885743+0000","last_clean":"2024-01-22T05:12:25.885743+0000","last_became_active":"2024-01-22T05:12:25.412957+0000","last_became_peered":"2024-01-22T05:12:25.412957+0000","last_unstale":"2024-01-22T05:12:25.885743+0000","last_undegraded":"2024-01-22T05:12:25.885743+0000","last_fullsized":"2024-01-22T05:12:25.885743+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884314+0000","last_change":"2024-01-22T05:12:25.881098+0000","last_active":"2024-01-22T05:12:25.884314+0000","last_peered":"2024-01-22T05:12:25.884314+0000","last_clean":"2024-01-22T05:12:25.884314+0000","last_became_active":"2024-01-22T05:12:25.880467+0000","last_became_peered":"2024-01-22T05:12:25.880467+0000","last_unstale":"2024-01-22T05:12:25.884314+0000","last_undegraded":"2024-01-22T05:12:25.884314+0000","last_fullsized":"2024-01-22T05:12:25.884314+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.856002+0000","last_change":"2024-01-22T05:12:25.437320+0000","last_active":"2024-01-22T05:12:25.856002+0000","last_peered":"2024-01-22T05:12:25.856002+0000","last_clean":"2024-01-22T05:12:25.856002+0000","last_became_active":"2024-01-22T05:12:25.436882+0000","last_became_peered":"2024-01-22T05:12:25.436882+0000","last_unstale":"2024-01-22T05:12:25.856002+0000","last_undegraded":"2024-01-22T05:12:25.856002+0000","last_fullsized":"2024-01-22T05:12:25.856002+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.896380+0000","last_change":"2024-01-22T05:12:25.882129+0000","last_active":"2024-01-22T05:12:25.896380+0000","last_peered":"2024-01-22T05:12:25.896380+0000","last_clean":"2024-01-22T05:12:25.896380+0000","last_became_active":"2024-01-22T05:12:25.881828+0000","last_became_peered":"2024-01-22T05:12:25.881828+0000","last_unstale":"2024-01-22T05:12:25.896380+0000","last_undegraded":"2024-01-22T05:12:25.896380+0000","last_fullsized":"2024-01-22T05:12:25.896380+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.854953+0000","last_change":"2024-01-22T05:12:25.424308+0000","last_active":"2024-01-22T05:12:25.854953+0000","last_peered":"2024-01-22T05:12:25.854953+0000","last_clean":"2024-01-22T05:12:25.854953+0000","last_became_active":"2024-01-22T05:12:25.423977+0000","last_became_peered":"2024-01-22T05:12:25.423977+0000","last_unstale":"2024-01-22T05:12:25.854953+0000","last_undegraded":"2024-01-22T05:12:25.854953+0000","last_fullsized":"2024-01-22T05:12:25.854953+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.874349+0000","last_change":"2024-01-22T05:12:25.874349+0000","last_active":"2024-01-22T05:12:25.874349+0000","last_peered":"2024-01-22T05:12:25.874349+0000","last_clean":"2024-01-22T05:12:25.874349+0000","last_became_active":"2024-01-22T05:12:25.874039+0000","last_became_peered":"2024-01-22T05:12:25.874039+0000","last_unstale":"2024-01-22T05:12:25.874349+0000","last_undegraded":"2024-01-22T05:12:25.874349+0000","last_fullsized":"2024-01-22T05:12:25.874349+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.414586+0000","last_change":"2024-01-22T05:12:25.410781+0000","last_active":"2024-01-22T05:12:25.414586+0000","last_peered":"2024-01-22T05:12:25.414586+0000","last_clean":"2024-01-22T05:12:25.414586+0000","last_became_active":"2024-01-22T05:12:25.410296+0000","last_became_peered":"2024-01-22T05:12:25.410296+0000","last_unstale":"2024-01-22T05:12:25.414586+0000","last_undegraded":"2024-01-22T05:12:25.414586+0000","last_fullsized":"2024-01-22T05:12:25.414586+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.890039+0000","last_change":"2024-01-22T05:12:25.890039+0000","last_active":"2024-01-22T05:12:25.890039+0000","last_peered":"2024-01-22T05:12:25.890039+0000","last_clean":"2024-01-22T05:12:25.890039+0000","last_became_active":"2024-01-22T05:12:25.888177+0000","last_became_peered":"2024-01-22T05:12:25.888177+0000","last_unstale":"2024-01-22T05:12:25.890039+0000","last_undegraded":"2024-01-22T05:12:25.890039+0000","last_fullsized":"2024-01-22T05:12:25.890039+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.858492+0000","last_change":"2024-01-22T05:12:25.413189+0000","last_active":"2024-01-22T05:12:25.858492+0000","last_peered":"2024-01-22T05:12:25.858492+0000","last_clean":"2024-01-22T05:12:25.858492+0000","last_became_active":"2024-01-22T05:12:25.412797+0000","last_became_peered":"2024-01-22T05:12:25.412797+0000","last_unstale":"2024-01-22T05:12:25.858492+0000","last_undegraded":"2024-01-22T05:12:25.858492+0000","last_fullsized":"2024-01-22T05:12:25.858492+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.881432+0000","last_change":"2024-01-22T05:12:25.871629+0000","last_active":"2024-01-22T05:12:25.881432+0000","last_peered":"2024-01-22T05:12:25.881432+0000","last_clean":"2024-01-22T05:12:25.881432+0000","last_became_active":"2024-01-22T05:12:25.870727+0000","last_became_peered":"2024-01-22T05:12:25.870727+0000","last_unstale":"2024-01-22T05:12:25.881432+0000","last_undegraded":"2024-01-22T05:12:25.881432+0000","last_fullsized":"2024-01-22T05:12:25.881432+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.425970+0000","last_change":"2024-01-22T05:12:25.424784+0000","last_active":"2024-01-22T05:12:25.425970+0000","last_peered":"2024-01-22T05:12:25.425970+0000","last_clean":"2024-01-22T05:12:25.425970+0000","last_became_active":"2024-01-22T05:12:25.424470+0000","last_became_peered":"2024-01-22T05:12:25.424470+0000","last_unstale":"2024-01-22T05:12:25.425970+0000","last_undegraded":"2024-01-22T05:12:25.425970+0000","last_fullsized":"2024-01-22T05:12:25.425970+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.877296+0000","last_change":"2024-01-22T05:12:25.877296+0000","last_active":"2024-01-22T05:12:25.877296+0000","last_peered":"2024-01-22T05:12:25.877296+0000","last_clean":"2024-01-22T05:12:25.877296+0000","last_became_active":"2024-01-22T05:12:25.877024+0000","last_became_peered":"2024-01-22T05:12:25.877024+0000","last_unstale":"2024-01-22T05:12:25.877296+0000","last_undegraded":"2024-01-22T05:12:25.877296+0000","last_fullsized":"2024-01-22T05:12:25.877296+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.441498+0000","last_change":"2024-01-22T05:12:25.433769+0000","last_active":"2024-01-22T05:12:25.441498+0000","last_peered":"2024-01-22T05:12:25.441498+0000","last_clean":"2024-01-22T05:12:25.441498+0000","last_became_active":"2024-01-22T05:12:25.433361+0000","last_became_peered":"2024-01-22T05:12:25.433361+0000","last_unstale":"2024-01-22T05:12:25.441498+0000","last_undegraded":"2024-01-22T05:12:25.441498+0000","last_fullsized":"2024-01-22T05:12:25.441498+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.874157+0000","last_change":"2024-01-22T05:12:25.874157+0000","last_active":"2024-01-22T05:12:25.874157+0000","last_peered":"2024-01-22T05:12:25.874157+0000","last_clean":"2024-01-22T05:12:25.874157+0000","last_became_active":"2024-01-22T05:12:25.873255+0000","last_became_peered":"2024-01-22T05:12:25.873255+0000","last_unstale":"2024-01-22T05:12:25.874157+0000","last_undegraded":"2024-01-22T05:12:25.874157+0000","last_fullsized":"2024-01-22T05:12:25.874157+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.440477+0000","last_change":"2024-01-22T05:12:25.429649+0000","last_active":"2024-01-22T05:12:25.440477+0000","last_peered":"2024-01-22T05:12:25.440477+0000","last_clean":"2024-01-22T05:12:25.440477+0000","last_became_active":"2024-01-22T05:12:25.429329+0000","last_became_peered":"2024-01-22T05:12:25.429329+0000","last_unstale":"2024-01-22T05:12:25.440477+0000","last_undegraded":"2024-01-22T05:12:25.440477+0000","last_fullsized":"2024-01-22T05:12:25.440477+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884195+0000","last_change":"2024-01-22T05:12:25.884195+0000","last_active":"2024-01-22T05:12:25.884195+0000","last_peered":"2024-01-22T05:12:25.884195+0000","last_clean":"2024-01-22T05:12:25.884195+0000","last_became_active":"2024-01-22T05:12:25.883096+0000","last_became_peered":"2024-01-22T05:12:25.883096+0000","last_unstale":"2024-01-22T05:12:25.884195+0000","last_undegraded":"2024-01-22T05:12:25.884195+0000","last_fullsized":"2024-01-22T05:12:25.884195+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"103'1","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.893297+0000","last_change":"2024-01-22T05:12:25.429928+0000","last_active":"2024-01-22T05:12:25.893297+0000","last_peered":"2024-01-22T05:12:25.893297+0000","last_clean":"2024-01-22T05:12:25.893297+0000","last_became_active":"2024-01-22T05:12:25.429652+0000","last_became_peered":"2024-01-22T05:12:25.429652+0000","last_unstale":"2024-01-22T05:12:25.893297+0000","last_undegraded":"2024-01-22T05:12:25.893297+0000","last_fullsized":"2024-01-22T05:12:25.893297+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":81,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.403569+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:12:25.403569+0000","last_peered":"2024-01-22T05:12:25.403569+0000","last_clean":"2024-01-22T05:12:25.403569+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:12:25.403569+0000","last_undegraded":"2024-01-22T05:12:25.403569+0000","last_fullsized":"2024-01-22T05:12:25.403569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.890236+0000","last_change":"2024-01-22T05:12:25.890236+0000","last_active":"2024-01-22T05:12:25.890236+0000","last_peered":"2024-01-22T05:12:25.890236+0000","last_clean":"2024-01-22T05:12:25.890236+0000","last_became_active":"2024-01-22T05:12:25.889925+0000","last_became_peered":"2024-01-22T05:12:25.889925+0000","last_unstale":"2024-01-22T05:12:25.890236+0000","last_undegraded":"2024-01-22T05:12:25.890236+0000","last_fullsized":"2024-01-22T05:12:25.890236+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.853960+0000","last_change":"2024-01-22T05:12:25.429893+0000","last_active":"2024-01-22T05:12:25.853960+0000","last_peered":"2024-01-22T05:12:25.853960+0000","last_clean":"2024-01-22T05:12:25.853960+0000","last_became_active":"2024-01-22T05:12:25.429544+0000","last_became_peered":"2024-01-22T05:12:25.429544+0000","last_unstale":"2024-01-22T05:12:25.853960+0000","last_undegraded":"2024-01-22T05:12:25.853960+0000","last_fullsized":"2024-01-22T05:12:25.853960+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":87,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.871772+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:12:25.871772+0000","last_peered":"2024-01-22T05:12:25.871772+0000","last_clean":"2024-01-22T05:12:25.871772+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:12:25.871772+0000","last_undegraded":"2024-01-22T05:12:25.871772+0000","last_fullsized":"2024-01-22T05:12:25.871772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.882199+0000","last_change":"2024-01-22T05:12:25.882199+0000","last_active":"2024-01-22T05:12:25.882199+0000","last_peered":"2024-01-22T05:12:25.882199+0000","last_clean":"2024-01-22T05:12:25.882199+0000","last_became_active":"2024-01-22T05:12:25.881908+0000","last_became_peered":"2024-01-22T05:12:25.881908+0000","last_unstale":"2024-01-22T05:12:25.882199+0000","last_undegraded":"2024-01-22T05:12:25.882199+0000","last_fullsized":"2024-01-22T05:12:25.882199+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.852968+0000","last_change":"2024-01-22T05:12:25.414420+0000","last_active":"2024-01-22T05:12:25.852968+0000","last_peered":"2024-01-22T05:12:25.852968+0000","last_clean":"2024-01-22T05:12:25.852968+0000","last_became_active":"2024-01-22T05:12:25.414147+0000","last_became_peered":"2024-01-22T05:12:25.414147+0000","last_unstale":"2024-01-22T05:12:25.852968+0000","last_undegraded":"2024-01-22T05:12:25.852968+0000","last_fullsized":"2024-01-22T05:12:25.852968+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.405510+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:12:25.405510+0000","last_peered":"2024-01-22T05:12:25.405510+0000","last_clean":"2024-01-22T05:12:25.405510+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:12:25.405510+0000","last_undegraded":"2024-01-22T05:12:25.405510+0000","last_fullsized":"2024-01-22T05:12:25.405510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.868790+0000","last_change":"2024-01-22T05:12:25.868790+0000","last_active":"2024-01-22T05:12:25.868790+0000","last_peered":"2024-01-22T05:12:25.868790+0000","last_clean":"2024-01-22T05:12:25.868790+0000","last_became_active":"2024-01-22T05:12:25.865250+0000","last_became_peered":"2024-01-22T05:12:25.865250+0000","last_unstale":"2024-01-22T05:12:25.868790+0000","last_undegraded":"2024-01-22T05:12:25.868790+0000","last_fullsized":"2024-01-22T05:12:25.868790+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.854953+0000","last_change":"2024-01-22T05:12:25.410597+0000","last_active":"2024-01-22T05:12:25.854953+0000","last_peered":"2024-01-22T05:12:25.854953+0000","last_clean":"2024-01-22T05:12:25.854953+0000","last_became_active":"2024-01-22T05:12:25.410291+0000","last_became_peered":"2024-01-22T05:12:25.410291+0000","last_unstale":"2024-01-22T05:12:25.854953+0000","last_undegraded":"2024-01-22T05:12:25.854953+0000","last_fullsized":"2024-01-22T05:12:25.854953+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":87,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.867470+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:12:25.867470+0000","last_peered":"2024-01-22T05:12:25.867470+0000","last_clean":"2024-01-22T05:12:25.867470+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:12:25.867470+0000","last_undegraded":"2024-01-22T05:12:25.867470+0000","last_fullsized":"2024-01-22T05:12:25.867470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.870945+0000","last_change":"2024-01-22T05:12:25.870945+0000","last_active":"2024-01-22T05:12:25.870945+0000","last_peered":"2024-01-22T05:12:25.870945+0000","last_clean":"2024-01-22T05:12:25.870945+0000","last_became_active":"2024-01-22T05:12:25.870092+0000","last_became_peered":"2024-01-22T05:12:25.870092+0000","last_unstale":"2024-01-22T05:12:25.870945+0000","last_undegraded":"2024-01-22T05:12:25.870945+0000","last_fullsized":"2024-01-22T05:12:25.870945+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"103'2","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.891679+0000","last_change":"2024-01-22T05:12:25.433661+0000","last_active":"2024-01-22T05:12:25.891679+0000","last_peered":"2024-01-22T05:12:25.891679+0000","last_clean":"2024-01-22T05:12:25.891679+0000","last_became_active":"2024-01-22T05:12:25.433401+0000","last_became_peered":"2024-01-22T05:12:25.433401+0000","last_unstale":"2024-01-22T05:12:25.891679+0000","last_undegraded":"2024-01-22T05:12:25.891679+0000","last_fullsized":"2024-01-22T05:12:25.891679+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.854107+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:12:25.854107+0000","last_peered":"2024-01-22T05:12:25.854107+0000","last_clean":"2024-01-22T05:12:25.854107+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:12:25.854107+0000","last_undegraded":"2024-01-22T05:12:25.854107+0000","last_fullsized":"2024-01-22T05:12:25.854107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.870535+0000","last_change":"2024-01-22T05:12:25.866054+0000","last_active":"2024-01-22T05:12:25.870535+0000","last_peered":"2024-01-22T05:12:25.870535+0000","last_clean":"2024-01-22T05:12:25.870535+0000","last_became_active":"2024-01-22T05:12:25.865780+0000","last_became_peered":"2024-01-22T05:12:25.865780+0000","last_unstale":"2024-01-22T05:12:25.870535+0000","last_undegraded":"2024-01-22T05:12:25.870535+0000","last_fullsized":"2024-01-22T05:12:25.870535+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.411048+0000","last_change":"2024-01-22T05:12:25.407658+0000","last_active":"2024-01-22T05:12:25.411048+0000","last_peered":"2024-01-22T05:12:25.411048+0000","last_clean":"2024-01-22T05:12:25.411048+0000","last_became_active":"2024-01-22T05:12:25.407337+0000","last_became_peered":"2024-01-22T05:12:25.407337+0000","last_unstale":"2024-01-22T05:12:25.411048+0000","last_undegraded":"2024-01-22T05:12:25.411048+0000","last_fullsized":"2024-01-22T05:12:25.411048+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":82,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.402432+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:12:25.402432+0000","last_peered":"2024-01-22T05:12:25.402432+0000","last_clean":"2024-01-22T05:12:25.402432+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:12:25.402432+0000","last_undegraded":"2024-01-22T05:12:25.402432+0000","last_fullsized":"2024-01-22T05:12:25.402432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.877146+0000","last_change":"2024-01-22T05:12:25.877146+0000","last_active":"2024-01-22T05:12:25.877146+0000","last_peered":"2024-01-22T05:12:25.877146+0000","last_clean":"2024-01-22T05:12:25.877146+0000","last_became_active":"2024-01-22T05:12:25.876870+0000","last_became_peered":"2024-01-22T05:12:25.876870+0000","last_unstale":"2024-01-22T05:12:25.877146+0000","last_undegraded":"2024-01-22T05:12:25.877146+0000","last_fullsized":"2024-01-22T05:12:25.877146+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.855189+0000","last_change":"2024-01-22T05:12:25.424389+0000","last_active":"2024-01-22T05:12:25.855189+0000","last_peered":"2024-01-22T05:12:25.855189+0000","last_clean":"2024-01-22T05:12:25.855189+0000","last_became_active":"2024-01-22T05:12:25.424059+0000","last_became_peered":"2024-01-22T05:12:25.424059+0000","last_unstale":"2024-01-22T05:12:25.855189+0000","last_undegraded":"2024-01-22T05:12:25.855189+0000","last_fullsized":"2024-01-22T05:12:25.855189+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.404709+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:12:25.404709+0000","last_peered":"2024-01-22T05:12:25.404709+0000","last_clean":"2024-01-22T05:12:25.404709+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:12:25.404709+0000","last_undegraded":"2024-01-22T05:12:25.404709+0000","last_fullsized":"2024-01-22T05:12:25.404709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":8,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.884808+0000","last_change":"2024-01-22T05:12:25.884808+0000","last_active":"2024-01-22T05:12:25.884808+0000","last_peered":"2024-01-22T05:12:25.884808+0000","last_clean":"2024-01-22T05:12:25.884808+0000","last_became_active":"2024-01-22T05:12:25.884623+0000","last_became_peered":"2024-01-22T05:12:25.884623+0000","last_unstale":"2024-01-22T05:12:25.884808+0000","last_undegraded":"2024-01-22T05:12:25.884808+0000","last_fullsized":"2024-01-22T05:12:25.884808+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:25.375131+0000","last_clean_scrub_stamp":"2024-01-22T05:12:25.375131+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"103'1","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.863798+0000","last_change":"2024-01-22T05:12:25.419021+0000","last_active":"2024-01-22T05:12:25.863798+0000","last_peered":"2024-01-22T05:12:25.863798+0000","last_clean":"2024-01-22T05:12:25.863798+0000","last_became_active":"2024-01-22T05:12:25.418702+0000","last_became_peered":"2024-01-22T05:12:25.418702+0000","last_unstale":"2024-01-22T05:12:25.863798+0000","last_undegraded":"2024-01-22T05:12:25.863798+0000","last_fullsized":"2024-01-22T05:12:25.863798+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:12:24.360511+0000","last_clean_scrub_stamp":"2024-01-22T05:12:24.360511+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.853220+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:12:25.853220+0000","last_peered":"2024-01-22T05:12:25.853220+0000","last_clean":"2024-01-22T05:12:25.853220+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:12:25.853220+0000","last_undegraded":"2024-01-22T05:12:25.853220+0000","last_fullsized":"2024-01-22T05:12:25.853220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":79,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-01-22T05:12:25.404799+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:12:25.404799+0000","last_peered":"2024-01-22T05:12:25.404799+0000","last_clean":"2024-01-22T05:12:25.404799+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:12:25.404799+0000","last_undegraded":"2024-01-22T05:12:25.404799+0000","last_fullsized":"2024-01-22T05:12:25.404799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302568,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069272,"statfs":{"total":96636764160,"available":96326934528,"internally_reserved":0,"allocated":1277952,"data_stored":625760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:11:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.97299999999999998,"15min":1.024},"min":{"1min":0.56200000000000006,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3280000000000001,"5min":1.548,"15min":1.548},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.72699999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.405,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":1.371}]},{"osd":1,"last update":"Mon Jan 22 05:11:45 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.98699999999999999,"15min":0.97899999999999998},"min":{"1min":0.59199999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1559999999999999,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1539999999999999,"15min":1.171},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.3140000000000001,"5min":7.1840000000000002,"15min":7.1840000000000002},"last":1.2370000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:11:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.109,"15min":1.103},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.494,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.026},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.1379999999999999,"15min":1.161},"min":{"1min":0.73799999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.4219999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.96099999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:11:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.208,"15min":1.2250000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5349999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.194},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.2390000000000001,"15min":1.234},"min":{"1min":0.78300000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3660000000000001,"5min":6.4589999999999996,"15min":6.4589999999999996},"last":1.073}]},{"osd":4,"last update":"Mon Jan 22 05:11:45 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.054,"15min":1.0549999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.6180000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.514},{"interface":"front","average":{"1min":0.91400000000000003,"5min":1.119,"15min":1.1479999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.51,"5min":2.077,"15min":2.077},"last":1.3919999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:11:45 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.155,"15min":1.1819999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.4650000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.278,"15min":1.228},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.591,"5min":3.625,"15min":3.625},"last":1.3120000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:11:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.161,"15min":1.2290000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.526,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.464},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.3400000000000001,"15min":1.329},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.6859999999999999,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":1.6000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302560,"kb_used_data":1240,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069280,"statfs":{"total":96636764160,"available":96326942720,"internally_reserved":0,"allocated":1269760,"data_stored":625648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.7490000000000001,"15min":1.3109999999999999},"min":{"1min":0.72399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.454,"5min":77.745000000000005,"15min":77.745000000000005},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.111,"15min":1.069},"min":{"1min":0.65400000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.4019999999999999,"5min":13.555999999999999,"15min":13.555999999999999},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:11:50 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2210000000000001,"15min":1.109},"min":{"1min":0.55100000000000005,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.2450000000000001,"5min":15.499000000000001,"15min":15.499000000000001},"last":0.503},{"interface":"front","average":{"1min":1.083,"5min":1.175,"15min":1.2130000000000001},"min":{"1min":0.67900000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4770000000000001,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":3.6080000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:11:50 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.161,"15min":1.155},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.653,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":1.212},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.123,"15min":1.107},"min":{"1min":0.747,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4279999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.68600000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:11:50 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":2.0920000000000001,"15min":1.4510000000000001},"min":{"1min":0.82899999999999996,"5min":0.63500000000000001,"15min":0.59299999999999997},"max":{"1min":1.8169999999999999,"5min":102.08199999999999,"15min":102.08199999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.28,"5min":1.3089999999999999,"15min":1.2350000000000001},"min":{"1min":0.66600000000000004,"5min":0.374,"15min":0.374},"max":{"1min":6.0129999999999999,"5min":15.468,"15min":15.468},"last":0.92500000000000004}]},{"osd":4,"last update":"Mon Jan 22 05:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":1.115,"15min":1.0940000000000001},"min":{"1min":0.55500000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.5529999999999999,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0760000000000001,"15min":1.113},"min":{"1min":0.60099999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6180000000000001,"5min":1.649,"15min":1.649},"last":0.76000000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:11:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.415,"15min":1.2569999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":5.2930000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.274,"15min":1.2689999999999999},"min":{"1min":0.63500000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.6179999999999999,"5min":3.875,"15min":3.875},"last":0.748}]},{"osd":7,"last update":"Mon Jan 22 05:11:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.462,"15min":1.4059999999999999},"min":{"1min":0.72599999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.7849999999999999,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.889,"15min":1.5680000000000001},"min":{"1min":0.60199999999999998,"5min":0.495,"15min":0.495},"max":{"1min":6.0529999999999999,"5min":63.737000000000002,"15min":63.737000000000002},"last":0.88900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302572,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069268,"statfs":{"total":96636764160,"available":96326930432,"internally_reserved":0,"allocated":1282048,"data_stored":632705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:11:47 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":1.008,"15min":0.997},"min":{"1min":0.70199999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3720000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.042},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.004,"15min":1.0860000000000001},"min":{"1min":0.66900000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3149999999999999,"5min":1.5680000000000001,"15min":1.571},"last":1.1830000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:11:47 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.1459999999999999,"15min":1.1990000000000001},"min":{"1min":0.67300000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.29,"5min":1.6859999999999999,"15min":1.821},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.139,"15min":1.2689999999999999},"min":{"1min":0.76300000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3640000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.3480000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:11:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.1180000000000001,"15min":1.147},"min":{"1min":0.79100000000000004,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.2470000000000001,"5min":1.925,"15min":1.925},"last":1.286},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.097,"15min":1.1299999999999999},"min":{"1min":0.67100000000000004,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2929999999999999,"5min":1.859,"15min":1.859},"last":1.2310000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:11:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1120000000000001,"15min":1.1699999999999999},"min":{"1min":0.76900000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.3779999999999999,"5min":1.4990000000000001,"15min":1.931},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.145,"15min":1.264},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.72699999999999998},"max":{"1min":1.3109999999999999,"5min":1.569,"15min":2.266},"last":1.4219999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:11:47 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.052,"15min":1.1559999999999999},"min":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.504,"5min":1.7749999999999999,"15min":1.7829999999999999},"last":1.157},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.137,"15min":1.258},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.361,"5min":1.8300000000000001,"15min":2.0699999999999998},"last":1.2589999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:11:47 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.1599999999999999,"15min":1.2989999999999999},"min":{"1min":0.63600000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3919999999999999,"5min":1.8129999999999999,"15min":2.2010000000000001},"last":1.615},{"interface":"front","average":{"1min":1.03,"5min":1.204,"15min":1.282},"min":{"1min":0.56100000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5309999999999999,"5min":1.899,"15min":1.909},"last":1.4550000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:11:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.2470000000000001,"15min":1.379},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4530000000000001,"5min":1.881,"15min":2.3359999999999999},"last":1.49},{"interface":"front","average":{"1min":1.054,"5min":1.27,"15min":1.425},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.472,"5min":2.0499999999999998,"15min":3.1840000000000002},"last":1.5489999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306676,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065164,"statfs":{"total":96636764160,"available":96322727936,"internally_reserved":0,"allocated":1290240,"data_stored":626486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.0589999999999999,"15min":1.121},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.47799999999999998},"max":{"1min":1.274,"5min":1.7490000000000001,"15min":2.0150000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.123,"15min":1.1040000000000001},"min":{"1min":0.69899999999999995,"5min":0.55300000000000005,"15min":0.501},"max":{"1min":1.2709999999999999,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.94299999999999995}]},{"osd":1,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0760000000000001,"15min":1.0840000000000001},"min":{"1min":0.82799999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4299999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.004,"5min":1.0369999999999999,"15min":1.159},"min":{"1min":0.73699999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.296,"5min":1.5329999999999999,"15min":2.194},"last":0.71099999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.079,"15min":1.0840000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.7030000000000001,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.006,"5min":1.1100000000000001,"15min":1.238},"min":{"1min":0.69099999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3169999999999999,"5min":1.6180000000000001,"15min":2.3479999999999999},"last":0.77000000000000002}]},{"osd":3,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1100000000000001,"15min":1.1699999999999999},"min":{"1min":0.59299999999999997,"5min":0.496,"15min":0.496},"max":{"1min":1.51,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.1499999999999999,"15min":1.153},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.671,"5min":5.3029999999999999,"15min":5.3029999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":1.0549999999999999,"15min":1.1819999999999999},"min":{"1min":0.57799999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.387,"5min":1.6970000000000001,"15min":2.0790000000000002},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0640000000000001,"15min":1.137},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3999999999999999,"5min":1.597,"15min":2.0030000000000001},"last":0.97899999999999998}]},{"osd":6,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.1240000000000001,"15min":1.167},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5960000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.999,"5min":1.1990000000000001,"15min":1.361},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.4610000000000001,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.996}]},{"osd":7,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2470000000000001,"15min":1.3360000000000001},"min":{"1min":0.66500000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.5600000000000001,"5min":1.833,"15min":2.2839999999999998},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.294,"15min":1.353},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6379999999999999,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.0189999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306676,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065164,"statfs":{"total":96636764160,"available":96322727936,"internally_reserved":0,"allocated":1290240,"data_stored":627760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81200000000000006,"15min":0.89600000000000002},"min":{"1min":0.46200000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.663,"5min":1.663,"15min":14.859},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.89700000000000002,"15min":0.89000000000000001},"min":{"1min":0.52000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":2.3519999999999999,"5min":3.9860000000000002,"15min":5.0919999999999996},"last":1.002}]},{"osd":1,"last update":"Mon Jan 22 05:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":0.94299999999999995,"15min":0.88300000000000001},"min":{"1min":0.67900000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":6.5570000000000004,"5min":6.5570000000000004,"15min":6.5570000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.94799999999999995,"15min":0.97999999999999998},"min":{"1min":0.64500000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.27,"5min":1.526,"15min":5.7519999999999998},"last":0.79100000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.111,"15min":1.155},"min":{"1min":0.77200000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.413,"5min":1.21,"15min":1.2},"min":{"1min":0.879,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":4.1429999999999998,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":1.554}]},{"osd":4,"last update":"Mon Jan 22 05:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":1.3320000000000001,"15min":1.3200000000000001},"min":{"1min":0.879,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":10.858000000000001,"5min":10.858000000000001,"15min":10.858000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.357,"15min":1.3540000000000001},"min":{"1min":0.79500000000000004,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":10.846,"5min":10.846,"15min":10.846},"last":1.139}]},{"osd":5,"last update":"Mon Jan 22 05:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.302,"15min":1.306},"min":{"1min":0.76000000000000001,"5min":0.505,"15min":0.505},"max":{"1min":7.3639999999999999,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":1.466},{"interface":"front","average":{"1min":1.778,"5min":1.5209999999999999,"15min":1.371},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":12.128,"5min":14.523999999999999,"15min":14.523999999999999},"last":1.341}]},{"osd":6,"last update":"Mon Jan 22 05:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.298,"15min":1.397},"min":{"1min":0.81699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":4.9809999999999999},"last":1.234},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3460000000000001,"15min":1.4019999999999999},"min":{"1min":0.85699999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8089999999999999,"5min":1.8680000000000001,"15min":5.4210000000000003},"last":1.369}]},{"osd":7,"last update":"Mon Jan 22 05:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.353,"15min":1.3919999999999999},"min":{"1min":0.97199999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.472,"5min":2.472,"15min":5.7160000000000002},"last":1.425},{"interface":"front","average":{"1min":1.661,"5min":1.419,"15min":1.4379999999999999},"min":{"1min":0.97299999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":6.4279999999999999,"5min":6.4279999999999999,"15min":6.4279999999999999},"last":1.52}]}]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302568,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069272,"statfs":{"total":96636764160,"available":96326934528,"internally_reserved":0,"allocated":1277952,"data_stored":626574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:11:42 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.753},"min":{"1min":0.53300000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2749999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.879,"15min":0.83799999999999997},"min":{"1min":0.56599999999999995,"5min":0.373,"15min":0.373},"max":{"1min":1.1399999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.72199999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:11:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86599999999999999,"15min":0.81599999999999995},"min":{"1min":0.58799999999999997,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":1.254,"5min":1.534,"15min":1.534},"last":1.27},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.92800000000000005,"15min":0.93600000000000005},"min":{"1min":0.60699999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.377,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.97099999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:11:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1719999999999999,"15min":1.091},"min":{"1min":0.93000000000000005,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.611,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.2270000000000001,"15min":1.1799999999999999},"min":{"1min":0.58499999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.54,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.76000000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:11:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.242,"15min":1.2869999999999999},"min":{"1min":0.92600000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.448,"5min":1.8340000000000001,"15min":2.1709999999999998},"last":1.071},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.1639999999999999,"15min":1.196},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.63500000000000001},"max":{"1min":1.411,"5min":1.837,"15min":1.952},"last":1.3320000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:11:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.216,"15min":1.1919999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.579,"5min":2.0510000000000002,"15min":2.3660000000000001},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.234,"15min":1.296},"min":{"1min":0.77000000000000002,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5960000000000001,"5min":1.929,"15min":2.2210000000000001},"last":1.256}]},{"osd":6,"last update":"Mon Jan 22 05:11:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2310000000000001,"15min":1.2490000000000001},"min":{"1min":0.77600000000000002,"5min":0.754,"15min":0.68400000000000005},"max":{"1min":1.5680000000000001,"5min":1.875,"15min":2.1920000000000002},"last":1.224},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2929999999999999,"15min":1.286},"min":{"1min":0.84799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.788,"5min":2.1320000000000001,"15min":2.4449999999999998},"last":1.4750000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:11:42 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3140000000000001,"15min":1.3460000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.704,"5min":1.867,"15min":1.9199999999999999},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.4139999999999999,"15min":1.407},"min":{"1min":0.99299999999999999,"5min":0.92400000000000004,"15min":0.89000000000000001},"max":{"1min":1.9119999999999999,"5min":2.0329999999999999,"15min":2.5059999999999998},"last":1.369}]}]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302564,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069276,"statfs":{"total":96636764160,"available":96326938624,"internally_reserved":0,"allocated":1273856,"data_stored":625718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.90500000000000003,"15min":0.85599999999999998},"min":{"1min":0.56899999999999995,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":1.0740000000000001,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.47999999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4570000000000001,"5min":2.101,"15min":2.101},"last":1.2669999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99399999999999999,"15min":1},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48299999999999998},"max":{"1min":1.357,"5min":1.722,"15min":1.722},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.0600000000000001,"15min":1.032},"min":{"1min":0.59099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.427,"5min":2.008,"15min":2.008},"last":1.151}]},{"osd":3,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0660000000000001,"15min":1.0109999999999999},"min":{"1min":0.59499999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5089999999999999,"5min":4.665,"15min":4.665},"last":1.052},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95199999999999996,"15min":0.90400000000000003},"min":{"1min":0.50600000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4319999999999999,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":1.6879999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.335,"15min":1.242},"min":{"1min":0.74099999999999999,"5min":0.73799999999999999,"15min":0.60599999999999998},"max":{"1min":1.2809999999999999,"5min":15.76,"15min":15.76},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.4670000000000001,"15min":1.3109999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6499999999999999,"5min":16.975000000000001,"15min":16.975000000000001},"last":1.77}]},{"osd":5,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1890000000000001,"15min":1.1870000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.3759999999999999,"5min":2.738,"15min":2.738},"last":1.74},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2769999999999999,"15min":1.2709999999999999},"min":{"1min":0.90000000000000002,"5min":0.78900000000000003,"15min":0.74099999999999999},"max":{"1min":1.5409999999999999,"5min":2.52,"15min":2.52},"last":1.4970000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.2390000000000001,"15min":1.2549999999999999},"min":{"1min":0.85199999999999998,"5min":0.76700000000000002,"15min":0.76000000000000001},"max":{"1min":1.5309999999999999,"5min":3.093,"15min":3.093},"last":1.552},{"interface":"front","average":{"1min":1.3,"5min":1.333,"15min":1.335},"min":{"1min":0.93200000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.294},"last":1.6659999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:11:40 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3759999999999999,"15min":1.3680000000000001},"min":{"1min":0.86099999999999999,"5min":0.82299999999999995,"15min":0.77400000000000002},"max":{"1min":2.0019999999999998,"5min":4.4329999999999998,"15min":4.4329999999999998},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.3300000000000001,"15min":1.3500000000000001},"min":{"1min":0.81999999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.587,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":1.325}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302564,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069276,"statfs":{"total":96636764160,"available":96326938624,"internally_reserved":0,"allocated":1273856,"data_stored":626202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:11:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.94999999999999996,"15min":0.93700000000000006},"min":{"1min":0.41199999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.1399999999999999,"5min":15.273,"15min":15.273},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.96799999999999997},"min":{"1min":0.58999999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.4330000000000001,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.0229999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:11:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.1100000000000001,"15min":1.093},"min":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3879999999999999,"5min":15.473000000000001,"15min":15.473000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.996,"15min":1.016},"min":{"1min":0.626,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.282,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.0980000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.97599999999999998,"15min":1.02},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.609,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.077,"5min":1.2230000000000001,"15min":1.226},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.5820000000000001,"5min":15.439,"15min":15.439},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1879999999999999,"15min":1.333},"min":{"1min":0.68200000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3819999999999999,"5min":1.696,"15min":5.1799999999999997},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.175,"15min":1.2330000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.429,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":1.5960000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.2070000000000001,"15min":1.337},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.4970000000000001,"5min":2.891,"15min":3.548},"last":1.496},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.254,"15min":1.3759999999999999},"min":{"1min":0.75900000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5620000000000001,"5min":2.823,"15min":2.823},"last":1.3799999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.4510000000000001,"15min":1.458},"min":{"1min":0.81399999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.514,"5min":15.4,"15min":15.4},"last":1.274},{"interface":"front","average":{"1min":1.216,"5min":1.3440000000000001,"15min":1.4710000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5509999999999999,"5min":7.1349999999999998,"15min":7.1349999999999998},"last":1.5329999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.359,"15min":1.5680000000000001},"min":{"1min":0.91400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.5389999999999999,"5min":2.1080000000000001,"15min":5.29},"last":1.391},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3169999999999999,"15min":1.409},"min":{"1min":0.81799999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.671,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.6850000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:12:30.555 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:12:30.555 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-22T05:12:30.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.762+0000 7f4b33200700 1 Processor -- start 2024-01-22T05:12:30.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.766+0000 7f4b33200700 1 -- start start 2024-01-22T05:12:30.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.766+0000 7f4b33200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b2c141bf0 0x7f4b2c064300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:30.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.766+0000 7f4b33200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4b2c0c2db0 0x7f4b2c0c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:30.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.766+0000 7f4b33200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c0c2920 con 0x7f4b2c063f20 2024-01-22T05:12:30.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.766+0000 7f4b33200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c0c1d80 con 0x7f4b2c0c2db0 2024-01-22T05:12:30.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.766+0000 7f4b33200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0c1ff0 con 0x7f4b2c141bf0 2024-01-22T05:12:30.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b32800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4b2c0c2db0 0x7f4b2c0c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:30.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b31e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4b2c063f20 0x7f4b2c1414e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36202/0 (socket says 172.21.15.49:36202) 2024-01-22T05:12:30.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b31e00700 1 -- 172.21.15.49:0/2442906041 learned_addr learned my addr 172.21.15.49:0/2442906041 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:30.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b31400700 1 --2- 172.21.15.49:0/2442906041 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b2c141bf0 0x7f4b2c064300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:30.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b32800700 1 -- 172.21.15.49:0/2442906041 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b2c141bf0 msgr2=0x7f4b2c064300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:30.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b32800700 1 --2- 172.21.15.49:0/2442906041 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b2c141bf0 0x7f4b2c064300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b32800700 1 -- 172.21.15.49:0/2442906041 >> v1:172.21.15.49:6789/0 conn(0x7f4b2c063f20 legacy=0x7f4b2c1414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:30.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b32800700 1 -- 172.21.15.49:0/2442906041 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c0c22d0 con 0x7f4b2c0c2db0 2024-01-22T05:12:30.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b30a00700 1 -- 172.21.15.49:0/2442906041 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797491571 0 0) 0x7f4b2c0c2920 con 0x7f4b2c063f20 2024-01-22T05:12:30.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b32800700 1 --2- 172.21.15.49:0/2442906041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b2c0c2db0 0x7f4b2c0c3220 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f4b24009e60 tx=0x7f4b24009780).ready entity=mon.1 client_cookie=730283d988342796 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:30.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b30a00700 1 -- 172.21.15.49:0/2442906041 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2400e070 con 0x7f4b2c0c2db0 2024-01-22T05:12:30.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b30a00700 1 -- 172.21.15.49:0/2442906041 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2400bb60 con 0x7f4b2c0c2db0 2024-01-22T05:12:30.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b30a00700 1 -- 172.21.15.49:0/2442906041 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b24012410 con 0x7f4b2c0c2db0 2024-01-22T05:12:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b33200700 1 -- 172.21.15.49:0/2442906041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b2c0c2db0 msgr2=0x7f4b2c0c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b33200700 1 --2- 172.21.15.49:0/2442906041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b2c0c2db0 0x7f4b2c0c3220 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f4b24009e60 tx=0x7f4b24009780).stop 2024-01-22T05:12:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b33200700 1 -- 172.21.15.49:0/2442906041 shutdown_connections 2024-01-22T05:12:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b33200700 1 --2- 172.21.15.49:0/2442906041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b2c0c2db0 0x7f4b2c0c3220 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b33200700 1 --2- 172.21.15.49:0/2442906041 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b2c141bf0 0x7f4b2c064300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.770+0000 7f4b33200700 1 -- 172.21.15.49:0/2442906041 >> 172.21.15.49:0/2442906041 conn(0x7f4b2c0c40e0 msgr2=0x7f4b2c0c44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.774+0000 7f4b33200700 1 -- 172.21.15.49:0/2442906041 shutdown_connections 2024-01-22T05:12:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.774+0000 7f4b33200700 1 -- 172.21.15.49:0/2442906041 wait complete. 2024-01-22T05:12:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.774+0000 7f4b33200700 1 Processor -- start 2024-01-22T05:12:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.774+0000 7f4b33200700 1 -- start start 2024-01-22T05:12:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b33200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b2c063f20 0x7f4b2c13e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b33200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b2c0c2db0 0x7f4b2c069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b33200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b2c141bf0 0x7f4b2c069b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b33200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c069ff0 con 0x7f4b2c141bf0 2024-01-22T05:12:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b33200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c13eea0 con 0x7f4b2c0c2db0 2024-01-22T05:12:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b33200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0ad0e0 con 0x7f4b2c063f20 2024-01-22T05:12:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b32800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b2c141bf0 0x7f4b2c069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b32800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b2c141bf0 0x7f4b2c069b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60516/0 (socket says 172.21.15.49:60516) 2024-01-22T05:12:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b32800700 1 -- 172.21.15.49:0/2008288244 learned_addr learned my addr 172.21.15.49:0/2008288244 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b31400700 1 --2- 172.21.15.49:0/2008288244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b2c0c2db0 0x7f4b2c069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b31e00700 1 --2- 172.21.15.49:0/2008288244 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b2c063f20 0x7f4b2c13e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b32800700 1 -- 172.21.15.49:0/2008288244 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b2c063f20 msgr2=0x7f4b2c13e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b32800700 1 --2- 172.21.15.49:0/2008288244 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b2c063f20 0x7f4b2c13e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b32800700 1 -- 172.21.15.49:0/2008288244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b2c0c2db0 msgr2=0x7f4b2c069610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b32800700 1 --2- 172.21.15.49:0/2008288244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b2c0c2db0 0x7f4b2c069610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b32800700 1 -- 172.21.15.49:0/2008288244 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b24009a20 con 0x7f4b2c141bf0 2024-01-22T05:12:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b32800700 1 --2- 172.21.15.49:0/2008288244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b2c141bf0 0x7f4b2c069b00 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f4b2400c000 tx=0x7f4b2c1586c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b29600700 1 -- 172.21.15.49:0/2008288244 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2401d630 con 0x7f4b2c141bf0 2024-01-22T05:12:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b29600700 1 -- 172.21.15.49:0/2008288244 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2401d790 con 0x7f4b2c141bf0 2024-01-22T05:12:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b33200700 1 -- 172.21.15.49:0/2008288244 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c0ac4d0 con 0x7f4b2c141bf0 2024-01-22T05:12:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b29600700 1 -- 172.21.15.49:0/2008288244 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2401db50 con 0x7f4b2c141bf0 2024-01-22T05:12:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.778+0000 7f4b33200700 1 -- 172.21.15.49:0/2008288244 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c0aca90 con 0x7f4b2c141bf0 2024-01-22T05:12:30.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.782+0000 7f4b33200700 1 -- 172.21.15.49:0/2008288244 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2c0ad270 con 0x7f4b2c141bf0 2024-01-22T05:12:30.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.782+0000 7f4b29600700 1 -- 172.21.15.49:0/2008288244 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4b24003040 con 0x7f4b2c141bf0 2024-01-22T05:12:30.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.782+0000 7f4b29600700 1 --2- 172.21.15.49:0/2008288244 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b0405a540 0x7f4b0405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:30.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.782+0000 7f4b29600700 1 -- 172.21.15.49:0/2008288244 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4b24076760 con 0x7f4b2c141bf0 2024-01-22T05:12:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.786+0000 7f4b31e00700 1 --2- 172.21.15.49:0/2008288244 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b0405a540 0x7f4b0405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.786+0000 7f4b31e00700 1 --2- 172.21.15.49:0/2008288244 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b0405a540 0x7f4b0405ca00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f4b1c007fd0 tx=0x7f4b1c007dd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:30.790+0000 7f4b29600700 1 -- 172.21.15.49:0/2008288244 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4b24049e80 con 0x7f4b2c141bf0 2024-01-22T05:12:31.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.018+0000 7f4b33200700 1 -- 172.21.15.49:0/2008288244 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4b2c0c25b0 con 0x7f4b2c141bf0 2024-01-22T05:12:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.026+0000 7f4b29600700 1 -- 172.21.15.49:0/2008288244 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4b2404d4a0 con 0x7f4b2c141bf0 2024-01-22T05:12:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.030+0000 7f4b33200700 1 -- 172.21.15.49:0/2008288244 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b0405a540 msgr2=0x7f4b0405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.030+0000 7f4b33200700 1 --2- 172.21.15.49:0/2008288244 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b0405a540 0x7f4b0405ca00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f4b1c007fd0 tx=0x7f4b1c007dd0).stop 2024-01-22T05:12:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.030+0000 7f4b33200700 1 -- 172.21.15.49:0/2008288244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b2c141bf0 msgr2=0x7f4b2c069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.030+0000 7f4b33200700 1 --2- 172.21.15.49:0/2008288244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b2c141bf0 0x7f4b2c069b00 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f4b2400c000 tx=0x7f4b2c1586c0).stop 2024-01-22T05:12:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.030+0000 7f4b33200700 1 -- 172.21.15.49:0/2008288244 shutdown_connections 2024-01-22T05:12:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.030+0000 7f4b33200700 1 --2- 172.21.15.49:0/2008288244 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b0405a540 0x7f4b0405ca00 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.030+0000 7f4b33200700 1 --2- 172.21.15.49:0/2008288244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b2c141bf0 0x7f4b2c069b00 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.030+0000 7f4b33200700 1 --2- 172.21.15.49:0/2008288244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b2c0c2db0 0x7f4b2c069610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.030+0000 7f4b33200700 1 --2- 172.21.15.49:0/2008288244 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b2c063f20 0x7f4b2c13e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.030+0000 7f4b33200700 1 -- 172.21.15.49:0/2008288244 >> 172.21.15.49:0/2008288244 conn(0x7f4b2c0c40e0 msgr2=0x7f4b2c1412b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.030+0000 7f4b33200700 1 -- 172.21.15.49:0/2008288244 shutdown_connections 2024-01-22T05:12:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.030+0000 7f4b33200700 1 -- 172.21.15.49:0/2008288244 wait complete. 2024-01-22T05:12:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-01-22T05:12:31.058 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:12:31.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.218+0000 7f3f95800700 1 Processor -- start 2024-01-22T05:12:31.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.218+0000 7f3f95800700 1 -- start start 2024-01-22T05:12:31.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.218+0000 7f3f95800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f9014ffd0 0x7f3f900c1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:31.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.218+0000 7f3f95800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f900bc320 con 0x7f3f900c1d50 2024-01-22T05:12:31.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.218+0000 7f3f95800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f900c73a0 con 0x7f3f9014fbf0 2024-01-22T05:12:31.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.218+0000 7f3f95800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f900bbd30 con 0x7f3f9014ffd0 2024-01-22T05:12:31.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.218+0000 7f3f8f400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3f900c1d50 0x7f3f900bc7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36218/0 (socket says 172.21.15.49:36218) 2024-01-22T05:12:31.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.218+0000 7f3f8f400700 1 -- 172.21.15.49:0/3740385847 learned_addr learned my addr 172.21.15.49:0/3740385847 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:31.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.218+0000 7f3f8e000700 1 --2- 172.21.15.49:0/3740385847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f9014ffd0 0x7f3f900c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:31.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.218+0000 7f3f8d600700 1 -- 172.21.15.49:0/3740385847 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458937757 0 0) 0x7f3f900bc320 con 0x7f3f900c1d50 2024-01-22T05:12:31.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f8d600700 1 -- 172.21.15.49:0/3740385847 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f70004500 con 0x7f3f900c1d50 2024-01-22T05:12:31.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f8d600700 1 -- 172.21.15.49:0/3740385847 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523178758 0 0) 0x7f3f900c73a0 con 0x7f3f9014fbf0 2024-01-22T05:12:31.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f8d600700 1 -- 172.21.15.49:0/3740385847 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f900bc320 con 0x7f3f9014fbf0 2024-01-22T05:12:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f8e000700 1 -- 172.21.15.49:0/3740385847 >> v1:172.21.15.110:6789/0 conn(0x7f3f9014fbf0 legacy=0x7f3f900a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f8e000700 1 -- 172.21.15.49:0/3740385847 >> v1:172.21.15.49:6789/0 conn(0x7f3f900c1d50 legacy=0x7f3f900bc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f8e000700 1 -- 172.21.15.49:0/3740385847 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f900c21c0 con 0x7f3f9014ffd0 2024-01-22T05:12:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f8e000700 1 --2- 172.21.15.49:0/3740385847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f9014ffd0 0x7f3f900c1860 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f3f78009790 tx=0x7f3f78009060).ready entity=mon.2 client_cookie=6f056395598603d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f8d600700 1 -- 172.21.15.49:0/3740385847 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7800f510 con 0x7f3f9014ffd0 2024-01-22T05:12:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f8d600700 1 -- 172.21.15.49:0/3740385847 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7800f670 con 0x7f3f9014ffd0 2024-01-22T05:12:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f8d600700 1 -- 172.21.15.49:0/3740385847 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7800f9f0 con 0x7f3f9014ffd0 2024-01-22T05:12:31.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f95800700 1 -- 172.21.15.49:0/3740385847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f9014ffd0 msgr2=0x7f3f900c1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:31.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f95800700 1 --2- 172.21.15.49:0/3740385847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f9014ffd0 0x7f3f900c1860 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f3f78009790 tx=0x7f3f78009060).stop 2024-01-22T05:12:31.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f95800700 1 -- 172.21.15.49:0/3740385847 shutdown_connections 2024-01-22T05:12:31.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f95800700 1 --2- 172.21.15.49:0/3740385847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f9014ffd0 0x7f3f900c1860 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:31.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f95800700 1 -- 172.21.15.49:0/3740385847 >> 172.21.15.49:0/3740385847 conn(0x7f3f90062cc0 msgr2=0x7f3f900c6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:31.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f95800700 1 -- 172.21.15.49:0/3740385847 shutdown_connections 2024-01-22T05:12:31.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.222+0000 7f3f95800700 1 -- 172.21.15.49:0/3740385847 wait complete. 2024-01-22T05:12:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.226+0000 7f3f95800700 1 Processor -- start 2024-01-22T05:12:31.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.226+0000 7f3f95800700 1 -- start start 2024-01-22T05:12:31.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f95800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f900c1d50 0x7f3f90141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:31.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f95800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f9014fbf0 0x7f3f900c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:31.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f95800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f9014ffd0 0x7f3f900c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:31.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f95800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f900c60f0 con 0x7f3f9014fbf0 2024-01-22T05:12:31.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f95800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f90154f70 con 0x7f3f9014ffd0 2024-01-22T05:12:31.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f95800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f90155250 con 0x7f3f900c1d50 2024-01-22T05:12:31.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f8e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f9014fbf0 0x7f3f900c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:31.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f8e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f9014fbf0 0x7f3f900c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60524/0 (socket says 172.21.15.49:60524) 2024-01-22T05:12:31.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f8e000700 1 -- 172.21.15.49:0/3698176072 learned_addr learned my addr 172.21.15.49:0/3698176072 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:31.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f8ea00700 1 --2- 172.21.15.49:0/3698176072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f900c1d50 0x7f3f90141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:31.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f8f400700 1 --2- 172.21.15.49:0/3698176072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f9014ffd0 0x7f3f900c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:31.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f8e000700 1 -- 172.21.15.49:0/3698176072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f900c1d50 msgr2=0x7f3f90141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:31.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f8e000700 1 --2- 172.21.15.49:0/3698176072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f900c1d50 0x7f3f90141ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:31.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f8e000700 1 -- 172.21.15.49:0/3698176072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f9014ffd0 msgr2=0x7f3f900c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:31.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f8e000700 1 --2- 172.21.15.49:0/3698176072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f9014ffd0 0x7f3f900c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:31.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f8e000700 1 -- 172.21.15.49:0/3698176072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f780092a0 con 0x7f3f9014fbf0 2024-01-22T05:12:31.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f8e000700 1 --2- 172.21.15.49:0/3698176072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f9014fbf0 0x7f3f900c5710 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f3f900644e0 tx=0x7f3f78017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f86000700 1 -- 172.21.15.49:0/3698176072 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7800f9f0 con 0x7f3f9014fbf0 2024-01-22T05:12:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f86000700 1 -- 172.21.15.49:0/3698176072 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f78000c90 con 0x7f3f9014fbf0 2024-01-22T05:12:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f95800700 1 -- 172.21.15.49:0/3698176072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f90155530 con 0x7f3f9014fbf0 2024-01-22T05:12:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.230+0000 7f3f86000700 1 -- 172.21.15.49:0/3698176072 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7801b660 con 0x7f3f9014fbf0 2024-01-22T05:12:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.234+0000 7f3f95800700 1 -- 172.21.15.49:0/3698176072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f901423c0 con 0x7f3f9014fbf0 2024-01-22T05:12:31.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.234+0000 7f3f95800700 1 -- 172.21.15.49:0/3698176072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f901425b0 con 0x7f3f9014fbf0 2024-01-22T05:12:31.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.234+0000 7f3f86000700 1 -- 172.21.15.49:0/3698176072 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3f7801ba10 con 0x7f3f9014fbf0 2024-01-22T05:12:31.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.238+0000 7f3f86000700 1 --2- 172.21.15.49:0/3698176072 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3f6805a510 0x7f3f6805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:31.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.238+0000 7f3f86000700 1 -- 172.21.15.49:0/3698176072 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3f780764d0 con 0x7f3f9014fbf0 2024-01-22T05:12:31.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.238+0000 7f3f8ea00700 1 --2- 172.21.15.49:0/3698176072 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3f6805a510 0x7f3f6805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:31.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.238+0000 7f3f8ea00700 1 --2- 172.21.15.49:0/3698176072 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3f6805a510 0x7f3f6805c9d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f3f80000c00 tx=0x7f3f80009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:31.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.246+0000 7f3f86000700 1 -- 172.21.15.49:0/3698176072 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3f78049bf0 con 0x7f3f9014fbf0 2024-01-22T05:12:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.450+0000 7f3f95800700 1 -- 172.21.15.49:0/3698176072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f901425b0 con 0x7f3f9014fbf0 2024-01-22T05:12:31.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.450+0000 7f3f86000700 1 -- 172.21.15.49:0/3698176072 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f3f901425b0 con 0x7f3f9014fbf0 2024-01-22T05:12:31.455 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:12:31.455 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2953480069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2953480069},{"type":"v1","addr":"172.21.15.110:6833","nonce":2953480069}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2000522159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2000522159},{"type":"v1","addr":"172.21.15.110:6835","nonce":2000522159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/578632238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":578632238},{"type":"v1","addr":"172.21.15.49:6836","nonce":578632238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:12:25.842913+0000","modified":"2024-01-22T05:12:28.864832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7287":{"gid":7287,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/1226995696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1226995696},{"type":"v1","addr":"172.21.15.49:6837","nonce":1226995696}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-22T05:12:31.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.454+0000 7f3f95800700 1 -- 172.21.15.49:0/3698176072 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3f6805a510 msgr2=0x7f3f6805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:31.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.454+0000 7f3f95800700 1 --2- 172.21.15.49:0/3698176072 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3f6805a510 0x7f3f6805c9d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f3f80000c00 tx=0x7f3f80009040).stop 2024-01-22T05:12:31.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.454+0000 7f3f95800700 1 -- 172.21.15.49:0/3698176072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f9014fbf0 msgr2=0x7f3f900c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:31.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.454+0000 7f3f95800700 1 --2- 172.21.15.49:0/3698176072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f9014fbf0 0x7f3f900c5710 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f3f900644e0 tx=0x7f3f78017000).stop 2024-01-22T05:12:31.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.454+0000 7f3f95800700 1 -- 172.21.15.49:0/3698176072 shutdown_connections 2024-01-22T05:12:31.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.454+0000 7f3f95800700 1 --2- 172.21.15.49:0/3698176072 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3f6805a510 0x7f3f6805c9d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:31.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.454+0000 7f3f95800700 1 --2- 172.21.15.49:0/3698176072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f9014ffd0 0x7f3f900c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:31.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.454+0000 7f3f95800700 1 --2- 172.21.15.49:0/3698176072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f9014fbf0 0x7f3f900c5710 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:31.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.454+0000 7f3f95800700 1 --2- 172.21.15.49:0/3698176072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f900c1d50 0x7f3f90141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:31.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.454+0000 7f3f95800700 1 -- 172.21.15.49:0/3698176072 >> 172.21.15.49:0/3698176072 conn(0x7f3f90062cc0 msgr2=0x7f3f900c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.458+0000 7f3f95800700 1 -- 172.21.15.49:0/3698176072 shutdown_connections 2024-01-22T05:12:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:31.458+0000 7f3f95800700 1 -- 172.21.15.49:0/3698176072 wait complete. 2024-01-22T05:12:31.463 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 90 2024-01-22T05:12:31.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 90, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:12:25.842913+0000', 'modified': '2024-01-22T05:12:28.864832+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7287': {'gid': 7287, 'name': 'c', 'rank': 0, 'incarnation': 87, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6837/1226995696', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6835', 'nonce': 1226995696}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 1226995696}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:12:31.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:12:31.884 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-22T05:12:32.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.054+0000 7fd841200700 1 Processor -- start 2024-01-22T05:12:32.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.054+0000 7fd841200700 1 -- start start 2024-01-22T05:12:32.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.058+0000 7fd841200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd83c154d60 0x7fd83c0c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.058+0000 7fd841200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83c1548d0 con 0x7fd83c0643f0 2024-01-22T05:12:32.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.058+0000 7fd841200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83c1542a0 con 0x7fd83c0c30d0 2024-01-22T05:12:32.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.058+0000 7fd841200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c150c40 con 0x7fd83c154d60 2024-01-22T05:12:32.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.058+0000 7fd83b400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd83c154d60 0x7fd83c0c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.058+0000 7fd83be00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd83c0643f0 0x7fd83c0c50f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36222/0 (socket says 172.21.15.49:36222) 2024-01-22T05:12:32.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.058+0000 7fd83be00700 1 -- 172.21.15.49:0/115540078 learned_addr learned my addr 172.21.15.49:0/115540078 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:12:32.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.058+0000 7fd83a000700 1 -- 172.21.15.49:0/115540078 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527573839 0 0) 0x7fd83c1548d0 con 0x7fd83c0643f0 2024-01-22T05:12:32.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.058+0000 7fd83b400700 1 -- 172.21.15.49:0/115540078 >> v1:172.21.15.110:6789/0 conn(0x7fd83c0c30d0 legacy=0x7fd83c063ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.058+0000 7fd83b400700 1 -- 172.21.15.49:0/115540078 >> v1:172.21.15.49:6789/0 conn(0x7fd83c0643f0 legacy=0x7fd83c0c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.058+0000 7fd83b400700 1 -- 172.21.15.49:0/115540078 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c0c39b0 con 0x7fd83c154d60 2024-01-22T05:12:32.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.058+0000 7fd83b400700 1 --2- 172.21.15.49:0/115540078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd83c154d60 0x7fd83c0c6e20 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fd82c009750 tx=0x7fd82c009060).ready entity=mon.0 client_cookie=fec1e3a5db8d9770 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:32.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.058+0000 7fd83a000700 1 -- 172.21.15.49:0/115540078 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00b580 con 0x7fd83c154d60 2024-01-22T05:12:32.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.058+0000 7fd83a000700 1 -- 172.21.15.49:0/115540078 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c00b6e0 con 0x7fd83c154d60 2024-01-22T05:12:32.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.058+0000 7fd83a000700 1 -- 172.21.15.49:0/115540078 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00ba60 con 0x7fd83c154d60 2024-01-22T05:12:32.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.062+0000 7fd841200700 1 -- 172.21.15.49:0/115540078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd83c154d60 msgr2=0x7fd83c0c6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.062+0000 7fd841200700 1 --2- 172.21.15.49:0/115540078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd83c154d60 0x7fd83c0c6e20 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fd82c009750 tx=0x7fd82c009060).stop 2024-01-22T05:12:32.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.062+0000 7fd841200700 1 -- 172.21.15.49:0/115540078 shutdown_connections 2024-01-22T05:12:32.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.062+0000 7fd841200700 1 --2- 172.21.15.49:0/115540078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd83c154d60 0x7fd83c0c6e20 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.062+0000 7fd841200700 1 -- 172.21.15.49:0/115540078 >> 172.21.15.49:0/115540078 conn(0x7fd83c0626d0 msgr2=0x7fd83c062ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.062+0000 7fd841200700 1 -- 172.21.15.49:0/115540078 shutdown_connections 2024-01-22T05:12:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.062+0000 7fd841200700 1 -- 172.21.15.49:0/115540078 wait complete. 2024-01-22T05:12:32.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd841200700 1 Processor -- start 2024-01-22T05:12:32.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd841200700 1 -- start start 2024-01-22T05:12:32.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd841200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c0643f0 0x7fd83c0a7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd841200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd83c0c30d0 0x7fd83c14c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd841200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd83c154d60 0x7fd83c168230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd841200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c169220 con 0x7fd83c0c30d0 2024-01-22T05:12:32.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd841200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c168c60 con 0x7fd83c154d60 2024-01-22T05:12:32.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd841200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c168f40 con 0x7fd83c0643f0 2024-01-22T05:12:32.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd83aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd83c0c30d0 0x7fd83c14c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd83aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd83c0c30d0 0x7fd83c14c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60544/0 (socket says 172.21.15.49:60544) 2024-01-22T05:12:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd83aa00700 1 -- 172.21.15.49:0/2807998195 learned_addr learned my addr 172.21.15.49:0/2807998195 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd83be00700 1 --2- 172.21.15.49:0/2807998195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd83c154d60 0x7fd83c168230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd83b400700 1 --2- 172.21.15.49:0/2807998195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c0643f0 0x7fd83c0a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd83aa00700 1 -- 172.21.15.49:0/2807998195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c0643f0 msgr2=0x7fd83c0a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd83aa00700 1 --2- 172.21.15.49:0/2807998195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c0643f0 0x7fd83c0a7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd83aa00700 1 -- 172.21.15.49:0/2807998195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd83c154d60 msgr2=0x7fd83c168230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd83aa00700 1 --2- 172.21.15.49:0/2807998195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd83c154d60 0x7fd83c168230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.066+0000 7fd83aa00700 1 -- 172.21.15.49:0/2807998195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c009240 con 0x7fd83c0c30d0 2024-01-22T05:12:32.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.070+0000 7fd83aa00700 1 --2- 172.21.15.49:0/2807998195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd83c0c30d0 0x7fd83c14c1e0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fd82400c4c0 tx=0x7fd824007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:32.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.070+0000 7fd832a00700 1 -- 172.21.15.49:0/2807998195 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82400ce70 con 0x7fd83c0c30d0 2024-01-22T05:12:32.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.070+0000 7fd832a00700 1 -- 172.21.15.49:0/2807998195 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd824001e90 con 0x7fd83c0c30d0 2024-01-22T05:12:32.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.070+0000 7fd841200700 1 -- 172.21.15.49:0/2807998195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83c0aa6a0 con 0x7fd83c0c30d0 2024-01-22T05:12:32.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.070+0000 7fd832a00700 1 -- 172.21.15.49:0/2807998195 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824007250 con 0x7fd83c0c30d0 2024-01-22T05:12:32.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.070+0000 7fd841200700 1 -- 172.21.15.49:0/2807998195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83c0a7540 con 0x7fd83c0c30d0 2024-01-22T05:12:32.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.074+0000 7fd832a00700 1 -- 172.21.15.49:0/2807998195 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd8240066a0 con 0x7fd83c0c30d0 2024-01-22T05:12:32.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.074+0000 7fd832a00700 1 --2- 172.21.15.49:0/2807998195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd81405a510 0x7fd81405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.074+0000 7fd832a00700 1 -- 172.21.15.49:0/2807998195 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd824074260 con 0x7fd83c0c30d0 2024-01-22T05:12:32.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.074+0000 7fd83b400700 1 --2- 172.21.15.49:0/2807998195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd81405a510 0x7fd81405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.078+0000 7fd83b400700 1 --2- 172.21.15.49:0/2807998195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd81405a510 0x7fd81405c9d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fd82c00b340 tx=0x7fd82c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:32.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.078+0000 7fd84cbfc740 1 Processor -- start 2024-01-22T05:12:32.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.078+0000 7fd84cbfc740 1 -- start start 2024-01-22T05:12:32.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.078+0000 7fd84cbfc740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x292c3a0 0x2910d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.078+0000 7fd84cbfc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28ebe40 0x28e7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.078+0000 7fd84cbfc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c780 0x28e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.078+0000 7fd84cbfc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x286b410 con 0x292c780 2024-01-22T05:12:32.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.078+0000 7fd84cbfc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x286b550 con 0x28ebe40 2024-01-22T05:12:32.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.078+0000 7fd84cbfc740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x286ba00 con 0x292c3a0 2024-01-22T05:12:32.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd83be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c780 0x28e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd83be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c780 0x28e53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60546/0 (socket says 172.21.15.49:60546) 2024-01-22T05:12:32.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd83be00700 1 -- 172.21.15.49:0/4040751232 learned_addr learned my addr 172.21.15.49:0/4040751232 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:32.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd83b400700 1 --2- 172.21.15.49:0/4040751232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x292c3a0 0x2910d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd83aa00700 1 --2- 172.21.15.49:0/4040751232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28ebe40 0x28e7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd83be00700 1 -- 172.21.15.49:0/4040751232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x292c3a0 msgr2=0x2910d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd83be00700 1 --2- 172.21.15.49:0/4040751232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x292c3a0 0x2910d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd83be00700 1 -- 172.21.15.49:0/4040751232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28ebe40 msgr2=0x28e7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd83be00700 1 --2- 172.21.15.49:0/4040751232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28ebe40 0x28e7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd83be00700 1 -- 172.21.15.49:0/4040751232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2864730 con 0x292c780 2024-01-22T05:12:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd83be00700 1 --2- 172.21.15.49:0/4040751232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c780 0x28e53a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fd834007430 tx=0x7fd834007f90).ready entity=mon.0 client_cookie=edaa3918ce701226 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd82b400700 1 -- 172.21.15.49:0/4040751232 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834004ca0 con 0x292c780 2024-01-22T05:12:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd82b400700 1 -- 172.21.15.49:0/4040751232 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8340019f0 con 0x292c780 2024-01-22T05:12:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd82b400700 1 -- 172.21.15.49:0/4040751232 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834001d90 con 0x292c780 2024-01-22T05:12:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd84cbfc740 1 -- 172.21.15.49:0/4040751232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c780 msgr2=0x28e53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/4040751232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c780 0x28e53a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fd834007430 tx=0x7fd834007f90).stop 2024-01-22T05:12:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd84cbfc740 1 -- 172.21.15.49:0/4040751232 shutdown_connections 2024-01-22T05:12:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/4040751232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c780 0x28e53a0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/4040751232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28ebe40 0x28e7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/4040751232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x292c3a0 0x2910d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.082+0000 7fd84cbfc740 1 -- 172.21.15.49:0/4040751232 >> 172.21.15.49:0/4040751232 conn(0x26c9550 msgr2=0x28eb730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:32.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.086+0000 7fd84cbfc740 1 -- 172.21.15.49:0/4040751232 shutdown_connections 2024-01-22T05:12:32.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.086+0000 7fd84cbfc740 1 -- 172.21.15.49:0/4040751232 wait complete. 2024-01-22T05:12:32.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.086+0000 7fd84cbfc740 1 -- start start 2024-01-22T05:12:32.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.086+0000 7fd84cbfc740 1 Processor -- start 2024-01-22T05:12:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd84cbfc740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28ebe40 0x2917780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd84cbfc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c3a0 0x2915750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd84cbfc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c780 0x2930710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd84cbfc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2836650 con 0x292c780 2024-01-22T05:12:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd84cbfc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x290ad50 con 0x292c3a0 2024-01-22T05:12:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd84cbfc740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x290d360 con 0x28ebe40 2024-01-22T05:12:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd84cbfc740 10 client.0 ll_register_callbacks cb 0x28a3020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:12:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd83be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c780 0x2930710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd83be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c780 0x2930710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60550/0 (socket says 172.21.15.49:60550) 2024-01-22T05:12:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd83be00700 1 -- 172.21.15.49:0/3265237900 learned_addr learned my addr 172.21.15.49:0/3265237900 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd83b400700 1 --2- 172.21.15.49:0/3265237900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28ebe40 0x2917780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd83aa00700 1 --2- 172.21.15.49:0/3265237900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c3a0 0x2915750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd83be00700 1 -- 172.21.15.49:0/3265237900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28ebe40 msgr2=0x2917780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:32.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd83be00700 1 --2- 172.21.15.49:0/3265237900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28ebe40 0x2917780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd83be00700 1 -- 172.21.15.49:0/3265237900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c3a0 msgr2=0x2915750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:32.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd83be00700 1 --2- 172.21.15.49:0/3265237900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c3a0 0x2915750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd83be00700 1 -- 172.21.15.49:0/3265237900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd834007060 con 0x292c780 2024-01-22T05:12:32.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd83aa00700 1 --2- 172.21.15.49:0/3265237900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c3a0 0x2915750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:12:32.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd83be00700 1 --2- 172.21.15.49:0/3265237900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c780 0x2930710 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fd834007a20 tx=0x7fd834013000).ready entity=mon.0 client_cookie=c2618f809ca59485 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:32.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.090+0000 7fd823e00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:12:32.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd823e00700 1 -- 172.21.15.49:0/3265237900 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834013600 con 0x292c780 2024-01-22T05:12:32.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd823e00700 1 -- 172.21.15.49:0/3265237900 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd834013760 con 0x292c780 2024-01-22T05:12:32.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd84cbfc740 1 -- 172.21.15.49:0/3265237900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x28611a0 con 0x292c780 2024-01-22T05:12:32.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd823e00700 1 -- 172.21.15.49:0/3265237900 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd834013b30 con 0x292c780 2024-01-22T05:12:32.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd84cbfc740 10 client.7431 fetch_fsmap learned FSMap version 90 2024-01-22T05:12:32.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd84cbfc740 1 -- 172.21.15.49:0/3265237900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x285f960 con 0x292c780 2024-01-22T05:12:32.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd823e00700 1 -- 172.21.15.49:0/3265237900 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x28611a0 con 0x292c780 2024-01-22T05:12:32.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd823e00700 1 -- 172.21.15.49:0/3265237900 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 90) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd834012070 con 0x292c780 2024-01-22T05:12:32.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd84cbfc740 10 client.7431 fetch_fsmap finished waiting for FSMap version 90 2024-01-22T05:12:32.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd84cbfc740 10 client.7431 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-22T05:12:32.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd84cbfc740 20 client.7431 populate_metadata read hostname 'smithi049' 2024-01-22T05:12:32.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/3265237900 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x290e500 0x290e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd84cbfc740 4 client.7431 mds_command: new command op to 7287 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:12:32.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd84cbfc740 1 -- 172.21.15.49:0/3265237900 --> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x28576f0 con 0x290e500 2024-01-22T05:12:32.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd83b400700 1 --2- 172.21.15.49:0/3265237900 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x290e500 0x290e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd83b400700 1 --2- 172.21.15.49:0/3265237900 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x290e500 0x290e8e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ca220738d78ba14e server_cookie=558ade3149d8ed27 in_seq=0 out_seq=0 2024-01-22T05:12:32.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.094+0000 7fd823e00700 10 client.7431 ms_handle_connect on v2:172.21.15.49:6835/1226995696 2024-01-22T05:12:32.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.098+0000 7fd823e00700 1 -- 172.21.15.49:0/3265237900 <== mds.0 v2:172.21.15.49:6835/1226995696 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x28576f0 con 0x290e500 2024-01-22T05:12:32.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.098+0000 7fd823e00700 10 client.7431 handle_command_reply: tid=0 2024-01-22T05:12:32.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.098+0000 7fd84cbfc740 1 client.7431 shutdown 2024-01-22T05:12:32.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.098+0000 7fd84cbfc740 1 -- 172.21.15.49:0/3265237900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c780 msgr2=0x2930710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.098+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/3265237900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c780 0x2930710 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fd834007a20 tx=0x7fd834013000).stop 2024-01-22T05:12:32.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.098+0000 7fd84cbfc740 1 -- 172.21.15.49:0/3265237900 shutdown_connections 2024-01-22T05:12:32.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.098+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/3265237900 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x290e500 0x290e8e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.098+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/3265237900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c780 0x2930710 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.098+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/3265237900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c3a0 0x2915750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.098+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/3265237900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28ebe40 0x2917780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.098+0000 7fd84cbfc740 1 -- 172.21.15.49:0/3265237900 >> 172.21.15.49:0/3265237900 conn(0x26c9550 msgr2=0x2932350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:32.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.098+0000 7fd823e00700 0 client.7431 ms_handle_reset on v2:172.21.15.49:6835/1226995696 2024-01-22T05:12:32.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.098+0000 7fd84cbfc740 1 -- 172.21.15.49:0/3265237900 shutdown_connections 2024-01-22T05:12:32.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.098+0000 7fd84cbfc740 1 -- 172.21.15.49:0/3265237900 wait complete. 2024-01-22T05:12:32.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.098+0000 7fd84cbfc740 20 client.7431 trim_cache size 0 max 16384 2024-01-22T05:12:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd84cbfc740 1 Processor -- start 2024-01-22T05:12:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd84cbfc740 1 -- start start 2024-01-22T05:12:32.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd84cbfc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28ebe40 0x28e64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd84cbfc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c3a0 0x28e69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd84cbfc740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x292c780 0x292f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd84cbfc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x28b72c0 con 0x28ebe40 2024-01-22T05:12:32.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd84cbfc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x290f260 con 0x292c3a0 2024-01-22T05:12:32.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd84cbfc740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x290dc70 con 0x292c780 2024-01-22T05:12:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd83b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28ebe40 0x28e64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd83b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28ebe40 0x28e64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60560/0 (socket says 172.21.15.49:60560) 2024-01-22T05:12:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd83b400700 1 -- 172.21.15.49:0/346335730 learned_addr learned my addr 172.21.15.49:0/346335730 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd83be00700 1 --2- 172.21.15.49:0/346335730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x292c780 0x292f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd83aa00700 1 --2- 172.21.15.49:0/346335730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c3a0 0x28e69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd83b400700 1 -- 172.21.15.49:0/346335730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x292c780 msgr2=0x292f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:32.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd83b400700 1 --2- 172.21.15.49:0/346335730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x292c780 0x292f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd83b400700 1 -- 172.21.15.49:0/346335730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c3a0 msgr2=0x28e69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:32.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd83b400700 1 --2- 172.21.15.49:0/346335730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c3a0 0x28e69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd83b400700 1 -- 172.21.15.49:0/346335730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x290ec40 con 0x28ebe40 2024-01-22T05:12:32.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.118+0000 7fd83aa00700 1 --2- 172.21.15.49:0/346335730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c3a0 0x28e69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:12:32.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.122+0000 7fd83b400700 1 --2- 172.21.15.49:0/346335730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28ebe40 0x28e64e0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fd82c011000 tx=0x7fd82c003040).ready entity=mon.0 client_cookie=57b2eb0867feaa83 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:32.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.122+0000 7fd82be00700 1 -- 172.21.15.49:0/346335730 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c02d040 con 0x28ebe40 2024-01-22T05:12:32.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.122+0000 7fd82be00700 1 -- 172.21.15.49:0/346335730 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c028a80 con 0x28ebe40 2024-01-22T05:12:32.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.122+0000 7fd82be00700 1 -- 172.21.15.49:0/346335730 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c028bf0 con 0x28ebe40 2024-01-22T05:12:32.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.122+0000 7fd84cbfc740 1 -- 172.21.15.49:0/346335730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28ebe40 msgr2=0x28e64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.122+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/346335730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28ebe40 0x28e64e0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fd82c011000 tx=0x7fd82c003040).stop 2024-01-22T05:12:32.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.122+0000 7fd84cbfc740 1 -- 172.21.15.49:0/346335730 shutdown_connections 2024-01-22T05:12:32.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.122+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/346335730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x292c780 0x292f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.122+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/346335730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c3a0 0x28e69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.122+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/346335730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28ebe40 0x28e64e0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.122+0000 7fd84cbfc740 1 -- 172.21.15.49:0/346335730 >> 172.21.15.49:0/346335730 conn(0x26c9550 msgr2=0x2915610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:32.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.122+0000 7fd84cbfc740 1 -- 172.21.15.49:0/346335730 shutdown_connections 2024-01-22T05:12:32.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.122+0000 7fd84cbfc740 1 -- 172.21.15.49:0/346335730 wait complete. 2024-01-22T05:12:32.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.122+0000 7fd84cbfc740 1 -- start start 2024-01-22T05:12:32.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.122+0000 7fd84cbfc740 1 Processor -- start 2024-01-22T05:12:32.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd84cbfc740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28ebe40 0x2992d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd84cbfc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c3a0 0x28e8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd84cbfc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c780 0x28e8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd84cbfc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x292b560 con 0x292c3a0 2024-01-22T05:12:32.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd84cbfc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2930750 con 0x292c780 2024-01-22T05:12:32.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd84cbfc740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x292f420 con 0x28ebe40 2024-01-22T05:12:32.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd84cbfc740 10 client.0 ll_register_callbacks cb 0x7fd834017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:12:32.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd83aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c3a0 0x28e8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd83aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c3a0 0x28e8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60576/0 (socket says 172.21.15.49:60576) 2024-01-22T05:12:32.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd83aa00700 1 -- 172.21.15.49:0/736783161 learned_addr learned my addr 172.21.15.49:0/736783161 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:32.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd83b400700 1 --2- 172.21.15.49:0/736783161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28ebe40 0x2992d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd83be00700 1 --2- 172.21.15.49:0/736783161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c780 0x28e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd83aa00700 1 -- 172.21.15.49:0/736783161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28ebe40 msgr2=0x2992d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:32.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd83aa00700 1 --2- 172.21.15.49:0/736783161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28ebe40 0x2992d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd83aa00700 1 -- 172.21.15.49:0/736783161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c780 msgr2=0x28e8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:32.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd83aa00700 1 --2- 172.21.15.49:0/736783161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c780 0x28e8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd83aa00700 1 -- 172.21.15.49:0/736783161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83c0c39b0 con 0x292c3a0 2024-01-22T05:12:32.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd83aa00700 1 --2- 172.21.15.49:0/736783161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c3a0 0x28e8070 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7fd82404b3c0 tx=0x7fd82404e040).ready entity=mon.0 client_cookie=bb6776d01db7d731 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:32.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd823e00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:12:32.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd823e00700 1 -- 172.21.15.49:0/736783161 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824055040 con 0x292c3a0 2024-01-22T05:12:32.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd823e00700 1 -- 172.21.15.49:0/736783161 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd82405bdc0 con 0x292c3a0 2024-01-22T05:12:32.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd84cbfc740 1 -- 172.21.15.49:0/736783161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd8340019f0 con 0x292c3a0 2024-01-22T05:12:32.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd823e00700 1 -- 172.21.15.49:0/736783161 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd824074070 con 0x292c3a0 2024-01-22T05:12:32.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd84cbfc740 10 client.7437 fetch_fsmap learned FSMap version 90 2024-01-22T05:12:32.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.126+0000 7fd84cbfc740 1 -- 172.21.15.49:0/736783161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x7fd83c062e10 con 0x292c3a0 2024-01-22T05:12:32.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd823e00700 1 -- 172.21.15.49:0/736783161 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8340019f0 con 0x292c3a0 2024-01-22T05:12:32.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd823e00700 1 -- 172.21.15.49:0/736783161 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 90) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd824058020 con 0x292c3a0 2024-01-22T05:12:32.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 10 client.7437 fetch_fsmap finished waiting for FSMap version 90 2024-01-22T05:12:32.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 10 client.7437 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-22T05:12:32.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 20 client.7437 populate_metadata read hostname 'smithi049' 2024-01-22T05:12:32.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/736783161 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x2916200 0x29165e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 4 client.7437 mds_command: new command op to 7287 tid=0[{"prefix": "status"}] 2024-01-22T05:12:32.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 1 -- 172.21.15.49:0/736783161 --> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] -- command(tid 0: {"prefix": "status"}) v1 -- 0x27204e0 con 0x2916200 2024-01-22T05:12:32.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd83b400700 1 --2- 172.21.15.49:0/736783161 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x2916200 0x29165e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd83b400700 1 --2- 172.21.15.49:0/736783161 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x2916200 0x29165e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9b6166e241d00fe6 server_cookie=37745a5a91df29d7 in_seq=0 out_seq=0 2024-01-22T05:12:32.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd823e00700 10 client.7437 ms_handle_connect on v2:172.21.15.49:6835/1226995696 2024-01-22T05:12:32.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd823e00700 1 -- 172.21.15.49:0/736783161 <== mds.0 v2:172.21.15.49:6835/1226995696 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x27204e0 con 0x2916200 2024-01-22T05:12:32.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd823e00700 10 client.7437 handle_command_reply: tid=0 2024-01-22T05:12:32.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 1 client.7437 shutdown 2024-01-22T05:12:32.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 1 -- 172.21.15.49:0/736783161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c3a0 msgr2=0x28e8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/736783161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c3a0 0x28e8070 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7fd82404b3c0 tx=0x7fd82404e040).stop 2024-01-22T05:12:32.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 1 -- 172.21.15.49:0/736783161 shutdown_connections 2024-01-22T05:12:32.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/736783161 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x2916200 0x29165e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/736783161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x292c780 0x28e8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/736783161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x292c3a0 0x28e8070 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 1 --2- 172.21.15.49:0/736783161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28ebe40 0x2992d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd823e00700 0 client.7437 ms_handle_reset on v2:172.21.15.49:6835/1226995696 2024-01-22T05:12:32.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 1 -- 172.21.15.49:0/736783161 >> 172.21.15.49:0/736783161 conn(0x26c9550 msgr2=0x28e64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:32.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 1 -- 172.21.15.49:0/736783161 shutdown_connections 2024-01-22T05:12:32.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.130+0000 7fd84cbfc740 1 -- 172.21.15.49:0/736783161 wait complete. 2024-01-22T05:12:32.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.134+0000 7fd84cbfc740 20 client.7437 trim_cache size 0 max 16384 2024-01-22T05:12:32.137 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:12:32.137 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:12:32.137 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:12:32.137 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 7287, 2024-01-22T05:12:32.137 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:12:32.137 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:12:32.137 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:12:32.138 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 6.2860030589999996, 2024-01-22T05:12:32.138 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 90, 2024-01-22T05:12:32.138 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 104, 2024-01-22T05:12:32.138 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 104, 2024-01-22T05:12:32.138 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 11.666770855999999 2024-01-22T05:12:32.138 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:12:32.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.134+0000 7fd841200700 1 -- 172.21.15.49:0/2807998195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd81405a510 msgr2=0x7fd81405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.134+0000 7fd841200700 1 --2- 172.21.15.49:0/2807998195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd81405a510 0x7fd81405c9d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fd82c00b340 tx=0x7fd82c017000).stop 2024-01-22T05:12:32.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.134+0000 7fd841200700 1 -- 172.21.15.49:0/2807998195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd83c0c30d0 msgr2=0x7fd83c14c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.134+0000 7fd841200700 1 --2- 172.21.15.49:0/2807998195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd83c0c30d0 0x7fd83c14c1e0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fd82400c4c0 tx=0x7fd824007e00).stop 2024-01-22T05:12:32.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.134+0000 7fd841200700 1 -- 172.21.15.49:0/2807998195 shutdown_connections 2024-01-22T05:12:32.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.134+0000 7fd841200700 1 --2- 172.21.15.49:0/2807998195 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd81405a510 0x7fd81405c9d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.134+0000 7fd841200700 1 --2- 172.21.15.49:0/2807998195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd83c154d60 0x7fd83c168230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.134+0000 7fd841200700 1 --2- 172.21.15.49:0/2807998195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd83c0c30d0 0x7fd83c14c1e0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.134+0000 7fd841200700 1 --2- 172.21.15.49:0/2807998195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c0643f0 0x7fd83c0a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.134+0000 7fd841200700 1 -- 172.21.15.49:0/2807998195 >> 172.21.15.49:0/2807998195 conn(0x7fd83c0626d0 msgr2=0x7fd83c0bd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:32.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.134+0000 7fd841200700 1 -- 172.21.15.49:0/2807998195 shutdown_connections 2024-01-22T05:12:32.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.134+0000 7fd841200700 1 -- 172.21.15.49:0/2807998195 wait complete. 2024-01-22T05:12:32.161 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:12:32.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.286+0000 7f7af2e00700 1 Processor -- start 2024-01-22T05:12:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.286+0000 7f7af2e00700 1 -- start start 2024-01-22T05:12:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.290+0000 7f7af2e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7aec063930 0x7f7aec157b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.290+0000 7f7af2e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7aec158010 0x7f7aec0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.290+0000 7f7af2e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec064a70 con 0x7f7aec063550 2024-01-22T05:12:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.290+0000 7f7af2e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aec15cc50 con 0x7f7aec158010 2024-01-22T05:12:32.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.290+0000 7f7af2e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec1584c0 con 0x7f7aec063930 2024-01-22T05:12:32.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.290+0000 7f7af1800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7aec158010 0x7f7aec0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.290+0000 7f7af1800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7aec158010 0x7f7aec0c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60592/0 (socket says 172.21.15.49:60592) 2024-01-22T05:12:32.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.290+0000 7f7aebe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7aec063550 0x7f7aec0677c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36238/0 (socket says 172.21.15.49:36238) 2024-01-22T05:12:32.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.290+0000 7f7af1800700 1 -- 172.21.15.49:0/3913961635 learned_addr learned my addr 172.21.15.49:0/3913961635 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:32.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.290+0000 7f7aeb400700 1 --2- 172.21.15.49:0/3913961635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7aec063930 0x7f7aec157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.290+0000 7f7af1800700 1 -- 172.21.15.49:0/3913961635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7aec063930 msgr2=0x7f7aec157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:12:32.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.290+0000 7f7af1800700 1 --2- 172.21.15.49:0/3913961635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7aec063930 0x7f7aec157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.290+0000 7f7af1800700 1 -- 172.21.15.49:0/3913961635 >> v1:172.21.15.49:6789/0 conn(0x7f7aec063550 legacy=0x7f7aec0677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.294+0000 7f7aeaa00700 1 -- 172.21.15.49:0/3913961635 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301602501 0 0) 0x7f7aec064a70 con 0x7f7aec063550 2024-01-22T05:12:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.294+0000 7f7af1800700 1 -- 172.21.15.49:0/3913961635 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec064f00 con 0x7f7aec158010 2024-01-22T05:12:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.294+0000 7f7af1800700 1 --2- 172.21.15.49:0/3913961635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec158010 0x7f7aec0c24a0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f7ae4009f20 tx=0x7f7ae4009840).ready entity=mon.0 client_cookie=c2055772514df475 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.294+0000 7f7aeaa00700 1 -- 172.21.15.49:0/3913961635 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae400e070 con 0x7f7aec158010 2024-01-22T05:12:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.294+0000 7f7aeaa00700 1 -- 172.21.15.49:0/3913961635 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae400b9d0 con 0x7f7aec158010 2024-01-22T05:12:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.294+0000 7f7aeaa00700 1 -- 172.21.15.49:0/3913961635 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae400bd50 con 0x7f7aec158010 2024-01-22T05:12:32.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.294+0000 7f7af2e00700 1 -- 172.21.15.49:0/3913961635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec158010 msgr2=0x7f7aec0c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.294+0000 7f7af2e00700 1 --2- 172.21.15.49:0/3913961635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec158010 0x7f7aec0c24a0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f7ae4009f20 tx=0x7f7ae4009840).stop 2024-01-22T05:12:32.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.294+0000 7f7af2e00700 1 -- 172.21.15.49:0/3913961635 shutdown_connections 2024-01-22T05:12:32.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.294+0000 7f7af2e00700 1 --2- 172.21.15.49:0/3913961635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec158010 0x7f7aec0c24a0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.294+0000 7f7af2e00700 1 --2- 172.21.15.49:0/3913961635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7aec063930 0x7f7aec157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.294+0000 7f7af2e00700 1 -- 172.21.15.49:0/3913961635 >> 172.21.15.49:0/3913961635 conn(0x7f7aec0c4940 msgr2=0x7f7aec0c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:32.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.294+0000 7f7af2e00700 1 -- 172.21.15.49:0/3913961635 shutdown_connections 2024-01-22T05:12:32.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.294+0000 7f7af2e00700 1 -- 172.21.15.49:0/3913961635 wait complete. 2024-01-22T05:12:32.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.298+0000 7f7af2e00700 1 Processor -- start 2024-01-22T05:12:32.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.298+0000 7f7af2e00700 1 -- start start 2024-01-22T05:12:32.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.298+0000 7f7af2e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7aec063550 0x7f7aec16bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.298+0000 7f7af2e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec063930 0x7f7aec16bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.298+0000 7f7af2e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7aec158010 0x7f7aec0c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.298+0000 7f7af2e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0a7b20 con 0x7f7aec063930 2024-01-22T05:12:32.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.298+0000 7f7af2e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec16c490 con 0x7f7aec158010 2024-01-22T05:12:32.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.298+0000 7f7af2e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0c1b60 con 0x7f7aec063550 2024-01-22T05:12:32.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.298+0000 7f7aeb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec063930 0x7f7aec16bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7aeb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec063930 0x7f7aec16bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60594/0 (socket says 172.21.15.49:60594) 2024-01-22T05:12:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7aeb400700 1 -- 172.21.15.49:0/3488927460 learned_addr learned my addr 172.21.15.49:0/3488927460 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:12:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7aebe00700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7aec063550 0x7f7aec16bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7af1800700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7aec158010 0x7f7aec0c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7aeb400700 1 -- 172.21.15.49:0/3488927460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7aec063550 msgr2=0x7f7aec16bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7aeb400700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7aec063550 0x7f7aec16bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7aeb400700 1 -- 172.21.15.49:0/3488927460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7aec158010 msgr2=0x7f7aec0c04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7aeb400700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7aec158010 0x7f7aec0c04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7aeb400700 1 -- 172.21.15.49:0/3488927460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4009ae0 con 0x7f7aec063930 2024-01-22T05:12:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7af1800700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7aec158010 0x7f7aec0c04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:12:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7aebe00700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7aec063550 0x7f7aec16bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:12:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7aeb400700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec063930 0x7f7aec16bfa0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f7ad400e930 tx=0x7f7ad4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7ae3400700 1 -- 172.21.15.49:0/3488927460 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad400eed0 con 0x7f7aec063930 2024-01-22T05:12:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7ae3400700 1 -- 172.21.15.49:0/3488927460 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad400c850 con 0x7f7aec063930 2024-01-22T05:12:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7af2e00700 1 -- 172.21.15.49:0/3488927460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aec0ab950 con 0x7f7aec063930 2024-01-22T05:12:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7ae3400700 1 -- 172.21.15.49:0/3488927460 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad400cbd0 con 0x7f7aec063930 2024-01-22T05:12:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7af2e00700 1 -- 172.21.15.49:0/3488927460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aec0c1900 con 0x7f7aec063930 2024-01-22T05:12:32.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7ae3400700 1 -- 172.21.15.49:0/3488927460 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7ad401b400 con 0x7f7aec063930 2024-01-22T05:12:32.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.302+0000 7f7af2e00700 1 -- 172.21.15.49:0/3488927460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aec0abae0 con 0x7f7aec063930 2024-01-22T05:12:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.306+0000 7f7ae3400700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ac405a4e0 0x7f7ac405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:12:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.306+0000 7f7ae3400700 1 -- 172.21.15.49:0/3488927460 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7ad4074ee0 con 0x7f7aec063930 2024-01-22T05:12:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.306+0000 7f7aebe00700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ac405a4e0 0x7f7ac405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:12:32.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.306+0000 7f7aebe00700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ac405a4e0 0x7f7ac405c9a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f7adc001750 tx=0x7f7adc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:12:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.314+0000 7f7ae3400700 1 -- 172.21.15.49:0/3488927460 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7ad4048440 con 0x7f7aec063930 2024-01-22T05:12:32.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.514+0000 7f7af2e00700 1 -- 172.21.15.49:0/3488927460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7aec0ab6a0 con 0x7f7aec063930 2024-01-22T05:12:32.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.514+0000 7f7ae3400700 1 -- 172.21.15.49:0/3488927460 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v90) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7ad404ba60 con 0x7f7aec063930 2024-01-22T05:12:32.518 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:12:32.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.518+0000 7f7af2e00700 1 -- 172.21.15.49:0/3488927460 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ac405a4e0 msgr2=0x7f7ac405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.518+0000 7f7af2e00700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ac405a4e0 0x7f7ac405c9a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f7adc001750 tx=0x7f7adc009040).stop 2024-01-22T05:12:32.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.518+0000 7f7af2e00700 1 -- 172.21.15.49:0/3488927460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec063930 msgr2=0x7f7aec16bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:12:32.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.518+0000 7f7af2e00700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec063930 0x7f7aec16bfa0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f7ad400e930 tx=0x7f7ad4009060).stop 2024-01-22T05:12:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.518+0000 7f7af2e00700 1 -- 172.21.15.49:0/3488927460 shutdown_connections 2024-01-22T05:12:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.518+0000 7f7af2e00700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ac405a4e0 0x7f7ac405c9a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.518+0000 7f7af2e00700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7aec158010 0x7f7aec0c04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.518+0000 7f7af2e00700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7aec063930 0x7f7aec16bfa0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.518+0000 7f7af2e00700 1 --2- 172.21.15.49:0/3488927460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7aec063550 0x7f7aec16bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:12:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.518+0000 7f7af2e00700 1 -- 172.21.15.49:0/3488927460 >> 172.21.15.49:0/3488927460 conn(0x7f7aec0c4940 msgr2=0x7f7aec152030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:12:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.518+0000 7f7af2e00700 1 -- 172.21.15.49:0/3488927460 shutdown_connections 2024-01-22T05:12:32.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:12:32.518+0000 7f7af2e00700 1 -- 172.21.15.49:0/3488927460 wait complete. 2024-01-22T05:12:32.543 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-22T05:12:32.543 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:12:32.543 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:12:32.543 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:12:32.543 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:12:32.543 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-22T05:12:32.543 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-22T05:12:32.543 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:12:32.543 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:12:32.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:12:32.544 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:12:32.563 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:12:32.563 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:12:32.563 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:12:32.563 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:12:32.563 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:12:32.563 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:12:32.563 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:12:32.563 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:12:32.564 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:12:32.564 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:12:32.564 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:12:32.564 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:12:32.564 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:12:32.564 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42018sec preferred_lft 42018sec 2024-01-22T05:12:32.564 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:12:32.564 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:12:32.564 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:12:32.564 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:12:32.564 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:12:32.564 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:12:32.564 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:12:32.564 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:12:32.564 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:12:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:12:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:12:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:12:32.565 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:12:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:12:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:12:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:12:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::7ce7:e3ff:fed1:1e88/64 scope link 2024-01-22T05:12:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:12:32.565 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:12:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 82:c1:48:e7:c7:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:12:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::80c1:48ff:fee7:c731/64 scope link 2024-01-22T05:12:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:12:32.565 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:12:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:12:32.566 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3426:32ff:feee:c4c9/64 scope link 2024-01-22T05:12:32.566 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:12:32.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:12:32.567 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:12:32.644 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:12:32.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:12:32.648 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:12:32.713 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:12:32.713 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:12:32.713 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:12:32.713 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:12:32.713 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:12:32.713 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:12:32.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:12:32.715 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:12:32.715 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:32.715 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:12:32.715 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:12:32.715 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:12:32.715 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:32.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:12:32.847 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:12:32.863 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:12:32.863 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:12:32.864 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:12:32.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:12:32.865 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-22T05:12:32.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:12:32.948 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-22T05:12:33.016 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:12:33.016 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:12:33.142 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:12:33.142 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:12:33.167 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:12:33.167 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:12:33.174 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:12:33.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:12:33.174 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:12:33.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:33.206 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:33.206 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:33.206 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.0 2024-01-22T05:12:33.206 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:33.206 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:33.206 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:33.206 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:33.336 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.336 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.336 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0451963 s, 23.2 MB/s 2024-01-22T05:12:33.381 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.381 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.381 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0408852 s, 25.6 MB/s 2024-01-22T05:12:33.423 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.424 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.424 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0382227 s, 27.4 MB/s 2024-01-22T05:12:33.460 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.460 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.460 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330135 s, 31.8 MB/s 2024-01-22T05:12:33.506 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.506 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.507 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0423537 s, 24.8 MB/s 2024-01-22T05:12:33.544 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.544 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.544 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.033118 s, 31.7 MB/s 2024-01-22T05:12:33.585 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.585 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.585 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0366807 s, 28.6 MB/s 2024-01-22T05:12:33.618 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.618 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.619 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292295 s, 35.9 MB/s 2024-01-22T05:12:33.646 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.646 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.646 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238447 s, 44.0 MB/s 2024-01-22T05:12:33.686 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.686 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.687 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0368006 s, 28.5 MB/s 2024-01-22T05:12:33.717 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.717 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.717 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270555 s, 38.8 MB/s 2024-01-22T05:12:33.753 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.753 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.753 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319788 s, 32.8 MB/s 2024-01-22T05:12:33.783 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.783 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.783 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263946 s, 39.7 MB/s 2024-01-22T05:12:33.821 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.821 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.821 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0351732 s, 29.8 MB/s 2024-01-22T05:12:33.864 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.865 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.865 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0392252 s, 26.7 MB/s 2024-01-22T05:12:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0366009 s, 28.6 MB/s 2024-01-22T05:12:33.943 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.944 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.944 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0350809 s, 29.9 MB/s 2024-01-22T05:12:33.975 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:33.975 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:33.975 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266702 s, 39.3 MB/s 2024-01-22T05:12:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.014 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.014 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345243 s, 30.4 MB/s 2024-01-22T05:12:34.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.045 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277192 s, 37.8 MB/s 2024-01-22T05:12:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.084 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.033832 s, 31.0 MB/s 2024-01-22T05:12:34.112 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.112 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.112 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257456 s, 40.7 MB/s 2024-01-22T05:12:34.148 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.148 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.148 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323591 s, 32.4 MB/s 2024-01-22T05:12:34.176 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.176 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.177 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246252 s, 42.6 MB/s 2024-01-22T05:12:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217641 s, 48.2 MB/s 2024-01-22T05:12:34.226 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.226 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.227 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021769 s, 48.2 MB/s 2024-01-22T05:12:34.261 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.261 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.261 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307728 s, 34.1 MB/s 2024-01-22T05:12:34.291 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.291 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.291 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264194 s, 39.7 MB/s 2024-01-22T05:12:34.323 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.323 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.323 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287239 s, 36.5 MB/s 2024-01-22T05:12:34.349 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.349 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.350 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240026 s, 43.7 MB/s 2024-01-22T05:12:34.378 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.378 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.378 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244308 s, 42.9 MB/s 2024-01-22T05:12:34.403 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.403 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.403 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208564 s, 50.3 MB/s 2024-01-22T05:12:34.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:34.405 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:34.406 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:34.406 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.1 2024-01-22T05:12:34.406 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:34.406 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:34.406 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:34.406 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.470 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.470 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317679 s, 33.0 MB/s 2024-01-22T05:12:34.499 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.499 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.499 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025275 s, 41.5 MB/s 2024-01-22T05:12:34.529 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.529 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.529 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251099 s, 41.8 MB/s 2024-01-22T05:12:34.562 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.562 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.563 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284526 s, 36.9 MB/s 2024-01-22T05:12:34.601 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.601 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.601 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349755 s, 30.0 MB/s 2024-01-22T05:12:34.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.643 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0384576 s, 27.3 MB/s 2024-01-22T05:12:34.678 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.678 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.678 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312971 s, 33.5 MB/s 2024-01-22T05:12:34.717 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.718 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.718 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349968 s, 30.0 MB/s 2024-01-22T05:12:34.746 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.746 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.746 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245592 s, 42.7 MB/s 2024-01-22T05:12:34.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.774 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.774 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238312 s, 44.0 MB/s 2024-01-22T05:12:34.795 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.795 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.795 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184137 s, 56.9 MB/s 2024-01-22T05:12:34.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.827 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281329 s, 37.3 MB/s 2024-01-22T05:12:34.849 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.849 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.849 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193853 s, 54.1 MB/s 2024-01-22T05:12:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.887 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0339127 s, 30.9 MB/s 2024-01-22T05:12:34.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.914 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246777 s, 42.5 MB/s 2024-01-22T05:12:34.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.947 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.947 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027453 s, 38.2 MB/s 2024-01-22T05:12:34.975 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:34.975 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:34.975 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271464 s, 38.6 MB/s 2024-01-22T05:12:35.007 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.007 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.007 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272532 s, 38.5 MB/s 2024-01-22T05:12:35.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.045 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345065 s, 30.4 MB/s 2024-01-22T05:12:35.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.074 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026068 s, 40.2 MB/s 2024-01-22T05:12:35.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.104 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256986 s, 40.8 MB/s 2024-01-22T05:12:35.132 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.132 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.132 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241157 s, 43.5 MB/s 2024-01-22T05:12:35.163 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.163 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.163 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026397 s, 39.7 MB/s 2024-01-22T05:12:35.191 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.192 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.192 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242538 s, 43.2 MB/s 2024-01-22T05:12:35.229 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.229 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.230 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334143 s, 31.4 MB/s 2024-01-22T05:12:35.259 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.260 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.260 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260358 s, 40.3 MB/s 2024-01-22T05:12:35.285 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.285 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.285 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222568 s, 47.1 MB/s 2024-01-22T05:12:35.312 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.313 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.313 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235152 s, 44.6 MB/s 2024-01-22T05:12:35.335 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.335 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.335 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203222 s, 51.6 MB/s 2024-01-22T05:12:35.373 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.374 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.374 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338529 s, 31.0 MB/s 2024-01-22T05:12:35.403 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.403 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.403 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253186 s, 41.4 MB/s 2024-01-22T05:12:35.429 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.430 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.430 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226256 s, 46.3 MB/s 2024-01-22T05:12:35.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:35.432 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:35.432 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:35.432 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.2 2024-01-22T05:12:35.432 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:35.433 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:35.433 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:35.433 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:35.482 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.483 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.483 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261181 s, 40.1 MB/s 2024-01-22T05:12:35.505 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.505 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.505 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204756 s, 51.2 MB/s 2024-01-22T05:12:35.528 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.528 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.528 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207037 s, 50.6 MB/s 2024-01-22T05:12:35.557 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.558 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025421 s, 41.2 MB/s 2024-01-22T05:12:35.590 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.590 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.590 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302699 s, 34.6 MB/s 2024-01-22T05:12:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338028 s, 31.0 MB/s 2024-01-22T05:12:35.654 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.654 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.655 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222649 s, 47.1 MB/s 2024-01-22T05:12:35.681 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.681 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.681 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225788 s, 46.4 MB/s 2024-01-22T05:12:35.712 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.712 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.712 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028557 s, 36.7 MB/s 2024-01-22T05:12:35.748 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.749 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.749 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322692 s, 32.5 MB/s 2024-01-22T05:12:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221533 s, 47.3 MB/s 2024-01-22T05:12:35.800 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.800 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.801 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229074 s, 45.8 MB/s 2024-01-22T05:12:35.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.828 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.828 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238748 s, 43.9 MB/s 2024-01-22T05:12:35.855 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.855 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.855 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246616 s, 42.5 MB/s 2024-01-22T05:12:35.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.885 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253176 s, 41.4 MB/s 2024-01-22T05:12:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304728 s, 34.4 MB/s 2024-01-22T05:12:35.950 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.950 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.950 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277083 s, 37.8 MB/s 2024-01-22T05:12:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220999 s, 47.4 MB/s 2024-01-22T05:12:36.014 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.014 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.014 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342389 s, 30.6 MB/s 2024-01-22T05:12:36.047 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.047 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.048 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301908 s, 34.7 MB/s 2024-01-22T05:12:36.080 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.080 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.080 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282479 s, 37.1 MB/s 2024-01-22T05:12:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.106 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222423 s, 47.1 MB/s 2024-01-22T05:12:36.136 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.137 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.137 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271354 s, 38.6 MB/s 2024-01-22T05:12:36.168 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.168 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.168 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273318 s, 38.4 MB/s 2024-01-22T05:12:36.199 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.199 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.199 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027588 s, 38.0 MB/s 2024-01-22T05:12:36.220 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.220 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.220 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187977 s, 55.8 MB/s 2024-01-22T05:12:36.245 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.245 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.245 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220161 s, 47.6 MB/s 2024-01-22T05:12:36.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.267 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189506 s, 55.3 MB/s 2024-01-22T05:12:36.296 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.296 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.296 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264005 s, 39.7 MB/s 2024-01-22T05:12:36.323 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.323 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.323 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231778 s, 45.2 MB/s 2024-01-22T05:12:36.357 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.357 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.357 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311183 s, 33.7 MB/s 2024-01-22T05:12:36.387 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.387 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.387 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269559 s, 38.9 MB/s 2024-01-22T05:12:36.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:36.390 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:36.390 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:36.390 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.3 2024-01-22T05:12:36.390 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:36.390 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:36.390 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:36.390 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:36.494 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.494 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.494 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342371 s, 30.6 MB/s 2024-01-22T05:12:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217076 s, 48.3 MB/s 2024-01-22T05:12:36.547 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.547 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.547 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238838 s, 43.9 MB/s 2024-01-22T05:12:36.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.575 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251588 s, 41.7 MB/s 2024-01-22T05:12:36.598 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.599 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.599 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208013 s, 50.4 MB/s 2024-01-22T05:12:36.626 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.626 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.627 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246743 s, 42.5 MB/s 2024-01-22T05:12:36.670 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.670 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.670 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0390819 s, 26.8 MB/s 2024-01-22T05:12:36.702 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.702 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.702 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02798 s, 37.5 MB/s 2024-01-22T05:12:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.728 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221469 s, 47.3 MB/s 2024-01-22T05:12:36.757 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.757 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.757 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253886 s, 41.3 MB/s 2024-01-22T05:12:36.792 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.792 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.792 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311808 s, 33.6 MB/s 2024-01-22T05:12:36.837 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.837 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.837 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0401809 s, 26.1 MB/s 2024-01-22T05:12:36.873 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.874 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.874 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327056 s, 32.1 MB/s 2024-01-22T05:12:36.903 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.903 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.903 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256164 s, 40.9 MB/s 2024-01-22T05:12:36.934 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.934 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.934 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276777 s, 37.9 MB/s 2024-01-22T05:12:36.961 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.961 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.961 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229558 s, 45.7 MB/s 2024-01-22T05:12:36.998 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:36.998 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:36.998 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341768 s, 30.7 MB/s 2024-01-22T05:12:37.029 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.029 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.030 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285156 s, 36.8 MB/s 2024-01-22T05:12:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305211 s, 34.4 MB/s 2024-01-22T05:12:37.093 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.093 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.093 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024636 s, 42.6 MB/s 2024-01-22T05:12:37.119 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.119 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.120 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222568 s, 47.1 MB/s 2024-01-22T05:12:37.151 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.151 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.151 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026875 s, 39.0 MB/s 2024-01-22T05:12:37.176 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.176 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.176 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219891 s, 47.7 MB/s 2024-01-22T05:12:37.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.203 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225006 s, 46.6 MB/s 2024-01-22T05:12:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283136 s, 37.0 MB/s 2024-01-22T05:12:37.266 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.266 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.266 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270703 s, 38.7 MB/s 2024-01-22T05:12:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259341 s, 40.4 MB/s 2024-01-22T05:12:37.326 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.326 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.326 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025373 s, 41.3 MB/s 2024-01-22T05:12:37.357 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.357 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.358 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282047 s, 37.2 MB/s 2024-01-22T05:12:37.383 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.383 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.383 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218858 s, 47.9 MB/s 2024-01-22T05:12:37.414 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.414 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.414 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271032 s, 38.7 MB/s 2024-01-22T05:12:37.444 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.445 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273086 s, 38.4 MB/s 2024-01-22T05:12:37.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:37.447 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:37.447 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:37.447 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.4 2024-01-22T05:12:37.447 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:37.447 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:37.447 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:37.448 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:37.502 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.502 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.502 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026689 s, 39.3 MB/s 2024-01-22T05:12:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.536 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.536 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296356 s, 35.4 MB/s 2024-01-22T05:12:37.560 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.560 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.560 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219991 s, 47.7 MB/s 2024-01-22T05:12:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230879 s, 45.4 MB/s 2024-01-22T05:12:37.611 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.611 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.611 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211129 s, 49.7 MB/s 2024-01-22T05:12:37.644 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.644 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.645 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303312 s, 34.6 MB/s 2024-01-22T05:12:37.676 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.676 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.676 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272509 s, 38.5 MB/s 2024-01-22T05:12:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188957 s, 55.5 MB/s 2024-01-22T05:12:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.726 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234492 s, 44.7 MB/s 2024-01-22T05:12:37.752 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.752 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.752 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223601 s, 46.9 MB/s 2024-01-22T05:12:37.784 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.784 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.784 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281344 s, 37.3 MB/s 2024-01-22T05:12:37.810 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.810 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.810 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219958 s, 47.7 MB/s 2024-01-22T05:12:37.845 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.845 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.845 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322022 s, 32.6 MB/s 2024-01-22T05:12:37.880 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.880 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.880 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305052 s, 34.4 MB/s 2024-01-22T05:12:37.912 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.912 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.912 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283686 s, 37.0 MB/s 2024-01-22T05:12:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252182 s, 41.6 MB/s 2024-01-22T05:12:37.971 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.971 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.971 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251741 s, 41.7 MB/s 2024-01-22T05:12:37.998 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:37.998 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:37.998 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233347 s, 44.9 MB/s 2024-01-22T05:12:38.023 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.023 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.023 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218535 s, 48.0 MB/s 2024-01-22T05:12:38.055 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.056 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.056 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295175 s, 35.5 MB/s 2024-01-22T05:12:38.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.085 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249502 s, 42.0 MB/s 2024-01-22T05:12:38.116 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.117 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.117 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277306 s, 37.8 MB/s 2024-01-22T05:12:38.167 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.167 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.167 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0458456 s, 22.9 MB/s 2024-01-22T05:12:38.205 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.205 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.205 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336688 s, 31.1 MB/s 2024-01-22T05:12:38.234 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.234 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.234 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247297 s, 42.4 MB/s 2024-01-22T05:12:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.264 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269065 s, 39.0 MB/s 2024-01-22T05:12:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234769 s, 44.7 MB/s 2024-01-22T05:12:38.319 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.319 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.319 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232706 s, 45.1 MB/s 2024-01-22T05:12:38.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.352 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.352 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291756 s, 35.9 MB/s 2024-01-22T05:12:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030834 s, 34.0 MB/s 2024-01-22T05:12:38.416 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.416 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.416 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249404 s, 42.0 MB/s 2024-01-22T05:12:38.447 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.447 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.447 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278854 s, 37.6 MB/s 2024-01-22T05:12:38.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:38.449 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:38.449 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:38.449 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.5 2024-01-22T05:12:38.450 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:38.450 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:38.450 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:38.450 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:38.517 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.517 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.517 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0372949 s, 28.1 MB/s 2024-01-22T05:12:38.549 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.549 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.549 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276985 s, 37.9 MB/s 2024-01-22T05:12:38.570 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.570 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.571 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190373 s, 55.1 MB/s 2024-01-22T05:12:38.599 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.599 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.599 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255219 s, 41.1 MB/s 2024-01-22T05:12:38.628 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.628 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.628 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255264 s, 41.1 MB/s 2024-01-22T05:12:38.668 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.668 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.668 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0363989 s, 28.8 MB/s 2024-01-22T05:12:38.699 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.699 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.699 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280965 s, 37.3 MB/s 2024-01-22T05:12:38.721 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.721 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.721 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193148 s, 54.3 MB/s 2024-01-22T05:12:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245934 s, 42.6 MB/s 2024-01-22T05:12:38.786 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.787 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.787 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322777 s, 32.5 MB/s 2024-01-22T05:12:38.812 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.812 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.813 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237487 s, 44.2 MB/s 2024-01-22T05:12:38.849 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.849 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.849 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322676 s, 32.5 MB/s 2024-01-22T05:12:38.881 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.881 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.881 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279481 s, 37.5 MB/s 2024-01-22T05:12:38.914 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:12:38.919 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:12:38.921 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0368219 s, 28.5 MB/s 2024-01-22T05:12:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334931 s, 31.3 MB/s 2024-01-22T05:12:38.988 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:38.988 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:38.988 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267168 s, 39.2 MB/s 2024-01-22T05:12:39.013 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.013 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.014 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225505 s, 46.5 MB/s 2024-01-22T05:12:39.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.043 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261945 s, 40.0 MB/s 2024-01-22T05:12:39.069 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.069 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.069 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226918 s, 46.2 MB/s 2024-01-22T05:12:39.094 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.094 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.094 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208253 s, 50.4 MB/s 2024-01-22T05:12:39.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.121 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231492 s, 45.3 MB/s 2024-01-22T05:12:39.156 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.156 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.156 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314478 s, 33.3 MB/s 2024-01-22T05:12:39.197 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.197 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.197 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0374619 s, 28.0 MB/s 2024-01-22T05:12:39.224 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.224 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.224 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229108 s, 45.8 MB/s 2024-01-22T05:12:39.249 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.249 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.249 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225145 s, 46.6 MB/s 2024-01-22T05:12:39.279 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.279 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.279 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025577 s, 41.0 MB/s 2024-01-22T05:12:39.300 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.300 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.300 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018227 s, 57.5 MB/s 2024-01-22T05:12:39.328 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.329 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.329 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025066 s, 41.8 MB/s 2024-01-22T05:12:39.359 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.359 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.359 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268153 s, 39.1 MB/s 2024-01-22T05:12:39.386 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.386 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.386 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241252 s, 43.5 MB/s 2024-01-22T05:12:39.415 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.416 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.416 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256111 s, 40.9 MB/s 2024-01-22T05:12:39.447 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.447 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.447 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288714 s, 36.3 MB/s 2024-01-22T05:12:39.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:39.449 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:39.450 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:39.450 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.6 2024-01-22T05:12:39.450 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:39.450 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:39.450 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:39.450 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:39.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.556 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030597 s, 34.3 MB/s 2024-01-22T05:12:39.590 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.590 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.590 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292858 s, 35.8 MB/s 2024-01-22T05:12:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232905 s, 45.0 MB/s 2024-01-22T05:12:39.640 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.640 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.640 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209622 s, 50.0 MB/s 2024-01-22T05:12:39.673 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.673 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.673 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029392 s, 35.7 MB/s 2024-01-22T05:12:39.703 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.703 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.703 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266692 s, 39.3 MB/s 2024-01-22T05:12:39.741 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338004 s, 31.0 MB/s 2024-01-22T05:12:39.768 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.768 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.768 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237673 s, 44.1 MB/s 2024-01-22T05:12:39.808 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.808 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.808 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0355604 s, 29.5 MB/s 2024-01-22T05:12:39.835 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.835 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.835 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229207 s, 45.7 MB/s 2024-01-22T05:12:39.864 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.864 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.864 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266152 s, 39.4 MB/s 2024-01-22T05:12:39.894 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.894 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.894 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261289 s, 40.1 MB/s 2024-01-22T05:12:39.928 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.928 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.928 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300236 s, 34.9 MB/s 2024-01-22T05:12:39.959 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.959 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.959 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259327 s, 40.4 MB/s 2024-01-22T05:12:39.988 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:39.988 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:39.989 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261398 s, 40.1 MB/s 2024-01-22T05:12:40.023 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.023 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.023 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316673 s, 33.1 MB/s 2024-01-22T05:12:40.055 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.055 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.056 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277115 s, 37.8 MB/s 2024-01-22T05:12:40.082 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.082 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.082 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232409 s, 45.1 MB/s 2024-01-22T05:12:40.113 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.113 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.113 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027332 s, 38.4 MB/s 2024-01-22T05:12:40.142 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.142 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.142 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025596 s, 41.0 MB/s 2024-01-22T05:12:40.168 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.168 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.168 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219556 s, 47.8 MB/s 2024-01-22T05:12:40.197 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.197 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.197 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247654 s, 42.3 MB/s 2024-01-22T05:12:40.227 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.227 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.227 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261188 s, 40.1 MB/s 2024-01-22T05:12:40.257 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.258 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.258 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276153 s, 38.0 MB/s 2024-01-22T05:12:40.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.285 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.285 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220285 s, 47.6 MB/s 2024-01-22T05:12:40.314 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.314 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.315 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262499 s, 39.9 MB/s 2024-01-22T05:12:40.343 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.343 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.343 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249641 s, 42.0 MB/s 2024-01-22T05:12:40.370 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.370 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.370 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234318 s, 44.8 MB/s 2024-01-22T05:12:40.397 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.397 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.397 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024999 s, 41.9 MB/s 2024-01-22T05:12:40.429 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.429 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.429 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289939 s, 36.2 MB/s 2024-01-22T05:12:40.459 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261017 s, 40.2 MB/s 2024-01-22T05:12:40.494 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.494 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.494 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031334 s, 33.5 MB/s 2024-01-22T05:12:40.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:40.496 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:40.496 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:40.496 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.7 2024-01-22T05:12:40.496 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:40.496 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:40.496 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:40.496 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:40.560 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.560 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.560 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253822 s, 41.3 MB/s 2024-01-22T05:12:40.587 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.587 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.587 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236911 s, 44.3 MB/s 2024-01-22T05:12:40.613 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.613 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.613 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020958 s, 50.0 MB/s 2024-01-22T05:12:40.645 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.646 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.646 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028854 s, 36.3 MB/s 2024-01-22T05:12:40.677 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.677 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.677 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277926 s, 37.7 MB/s 2024-01-22T05:12:40.715 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.715 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.715 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0339433 s, 30.9 MB/s 2024-01-22T05:12:40.748 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.749 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.749 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294823 s, 35.6 MB/s 2024-01-22T05:12:40.786 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.786 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.786 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332796 s, 31.5 MB/s 2024-01-22T05:12:40.821 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.822 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.822 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312669 s, 33.5 MB/s 2024-01-22T05:12:40.857 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.857 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.857 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317046 s, 33.1 MB/s 2024-01-22T05:12:40.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.888 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258284 s, 40.6 MB/s 2024-01-22T05:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028154 s, 37.2 MB/s 2024-01-22T05:12:40.957 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.957 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.957 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329419 s, 31.8 MB/s 2024-01-22T05:12:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02969 s, 35.3 MB/s 2024-01-22T05:12:41.024 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.024 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.024 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291871 s, 35.9 MB/s 2024-01-22T05:12:41.059 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.059 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.059 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306388 s, 34.2 MB/s 2024-01-22T05:12:41.088 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.089 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.089 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267532 s, 39.2 MB/s 2024-01-22T05:12:41.119 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.119 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.119 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259446 s, 40.4 MB/s 2024-01-22T05:12:41.149 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.150 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.150 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026718 s, 39.2 MB/s 2024-01-22T05:12:41.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.186 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.186 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316406 s, 33.1 MB/s 2024-01-22T05:12:41.213 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.213 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.214 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247545 s, 42.4 MB/s 2024-01-22T05:12:41.237 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.237 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.237 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199609 s, 52.5 MB/s 2024-01-22T05:12:41.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.267 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255545 s, 41.0 MB/s 2024-01-22T05:12:41.296 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.296 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.296 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245062 s, 42.8 MB/s 2024-01-22T05:12:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.332 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031329 s, 33.5 MB/s 2024-01-22T05:12:41.360 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.361 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.361 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024686 s, 42.5 MB/s 2024-01-22T05:12:41.386 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.387 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.387 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223853 s, 46.8 MB/s 2024-01-22T05:12:41.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.412 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218632 s, 48.0 MB/s 2024-01-22T05:12:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.437 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218795 s, 47.9 MB/s 2024-01-22T05:12:41.466 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.466 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.466 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255994 s, 41.0 MB/s 2024-01-22T05:12:41.504 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.504 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.505 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341193 s, 30.7 MB/s 2024-01-22T05:12:41.535 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.535 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.535 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261516 s, 40.1 MB/s 2024-01-22T05:12:41.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:41.538 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:41.538 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:41.538 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.8 2024-01-22T05:12:41.538 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:41.538 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:41.538 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:41.538 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:41.597 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.597 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.598 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293315 s, 35.7 MB/s 2024-01-22T05:12:41.626 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.626 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.626 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239267 s, 43.8 MB/s 2024-01-22T05:12:41.659 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.659 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.659 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295353 s, 35.5 MB/s 2024-01-22T05:12:41.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.689 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259632 s, 40.4 MB/s 2024-01-22T05:12:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.720 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266589 s, 39.3 MB/s 2024-01-22T05:12:41.749 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.750 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.750 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251865 s, 41.6 MB/s 2024-01-22T05:12:41.778 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.778 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.778 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249099 s, 42.1 MB/s 2024-01-22T05:12:41.809 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.809 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.809 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263749 s, 39.8 MB/s 2024-01-22T05:12:41.837 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.837 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.837 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241103 s, 43.5 MB/s 2024-01-22T05:12:41.864 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.864 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.864 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241146 s, 43.5 MB/s 2024-01-22T05:12:41.893 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.894 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258017 s, 40.6 MB/s 2024-01-22T05:12:41.929 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.929 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.929 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321584 s, 32.6 MB/s 2024-01-22T05:12:41.961 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.962 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.962 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280569 s, 37.4 MB/s 2024-01-22T05:12:41.993 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:41.993 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:41.993 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269298 s, 38.9 MB/s 2024-01-22T05:12:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243209 s, 43.1 MB/s 2024-01-22T05:12:42.057 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.057 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.057 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031592 s, 33.2 MB/s 2024-01-22T05:12:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.095 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.095 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0339131 s, 30.9 MB/s 2024-01-22T05:12:42.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.122 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233571 s, 44.9 MB/s 2024-01-22T05:12:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02791 s, 37.6 MB/s 2024-01-22T05:12:42.182 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.182 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.182 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242591 s, 43.2 MB/s 2024-01-22T05:12:42.210 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.211 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236262 s, 44.4 MB/s 2024-01-22T05:12:42.235 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.235 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.235 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213892 s, 49.0 MB/s 2024-01-22T05:12:42.263 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.263 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.263 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226253 s, 46.3 MB/s 2024-01-22T05:12:42.286 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.286 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.286 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214201 s, 49.0 MB/s 2024-01-22T05:12:42.313 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.313 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.313 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240542 s, 43.6 MB/s 2024-01-22T05:12:42.344 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.344 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.344 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271812 s, 38.6 MB/s 2024-01-22T05:12:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.377 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.378 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293402 s, 35.7 MB/s 2024-01-22T05:12:42.410 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.410 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.410 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290174 s, 36.1 MB/s 2024-01-22T05:12:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289395 s, 36.2 MB/s 2024-01-22T05:12:42.470 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.470 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.470 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242882 s, 43.2 MB/s 2024-01-22T05:12:42.503 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.504 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.504 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307082 s, 34.1 MB/s 2024-01-22T05:12:42.534 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.534 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.534 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271641 s, 38.6 MB/s 2024-01-22T05:12:42.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:42.536 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:42.536 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:42.537 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.9 2024-01-22T05:12:42.537 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:42.537 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:42.537 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:42.537 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:42.594 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.610 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.610 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245211 s, 42.8 MB/s 2024-01-22T05:12:42.621 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.622 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.622 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232407 s, 45.1 MB/s 2024-01-22T05:12:42.660 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.660 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.660 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348615 s, 30.1 MB/s 2024-01-22T05:12:42.687 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.688 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.688 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235291 s, 44.6 MB/s 2024-01-22T05:12:42.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.714 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221242 s, 47.4 MB/s 2024-01-22T05:12:42.746 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.746 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.746 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028388 s, 36.9 MB/s 2024-01-22T05:12:42.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.780 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296034 s, 35.4 MB/s 2024-01-22T05:12:42.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.828 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0437187 s, 24.0 MB/s 2024-01-22T05:12:42.857 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.857 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.858 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026502 s, 39.6 MB/s 2024-01-22T05:12:42.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.887 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256577 s, 40.9 MB/s 2024-01-22T05:12:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256908 s, 40.8 MB/s 2024-01-22T05:12:42.954 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.954 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.954 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324473 s, 32.3 MB/s 2024-01-22T05:12:42.984 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:42.984 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:42.984 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266768 s, 39.3 MB/s 2024-01-22T05:12:43.015 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.015 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.015 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272608 s, 38.5 MB/s 2024-01-22T05:12:43.044 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.045 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025759 s, 40.7 MB/s 2024-01-22T05:12:43.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.074 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254334 s, 41.2 MB/s 2024-01-22T05:12:43.113 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.113 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.113 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348721 s, 30.1 MB/s 2024-01-22T05:12:43.142 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.143 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.143 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256162 s, 40.9 MB/s 2024-01-22T05:12:43.171 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.171 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.172 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253777 s, 41.3 MB/s 2024-01-22T05:12:43.199 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.200 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.200 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246028 s, 42.6 MB/s 2024-01-22T05:12:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025766 s, 40.7 MB/s 2024-01-22T05:12:43.258 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261173 s, 40.1 MB/s 2024-01-22T05:12:43.285 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.285 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.285 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219433 s, 47.8 MB/s 2024-01-22T05:12:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0360651 s, 29.1 MB/s 2024-01-22T05:12:43.359 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.359 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.359 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292271 s, 35.9 MB/s 2024-01-22T05:12:43.383 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.383 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.383 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218672 s, 48.0 MB/s 2024-01-22T05:12:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227876 s, 46.0 MB/s 2024-01-22T05:12:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249998 s, 41.9 MB/s 2024-01-22T05:12:43.471 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.471 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.471 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027916 s, 37.6 MB/s 2024-01-22T05:12:43.490 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.491 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.491 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170586 s, 61.5 MB/s 2024-01-22T05:12:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.514 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.514 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195035 s, 53.8 MB/s 2024-01-22T05:12:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293011 s, 35.8 MB/s 2024-01-22T05:12:43.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:43.549 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:43.550 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:43.550 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.10 2024-01-22T05:12:43.550 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:43.550 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:43.550 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:43.550 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:43.608 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.608 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.609 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267735 s, 39.2 MB/s 2024-01-22T05:12:43.638 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.638 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.638 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258245 s, 40.6 MB/s 2024-01-22T05:12:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277469 s, 37.8 MB/s 2024-01-22T05:12:43.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.705 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317578 s, 33.0 MB/s 2024-01-22T05:12:43.736 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.736 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.736 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028252 s, 37.1 MB/s 2024-01-22T05:12:43.764 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.764 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.765 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237847 s, 44.1 MB/s 2024-01-22T05:12:43.792 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.793 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.793 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254949 s, 41.1 MB/s 2024-01-22T05:12:43.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.827 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306505 s, 34.2 MB/s 2024-01-22T05:12:43.856 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.856 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.856 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250407 s, 41.9 MB/s 2024-01-22T05:12:43.889 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.889 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.889 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285677 s, 36.7 MB/s 2024-01-22T05:12:43.920 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.920 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.920 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267145 s, 39.3 MB/s 2024-01-22T05:12:43.953 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.953 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.953 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294885 s, 35.6 MB/s 2024-01-22T05:12:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:43.988 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:43.988 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305154 s, 34.4 MB/s 2024-01-22T05:12:44.017 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.017 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.017 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024724 s, 42.4 MB/s 2024-01-22T05:12:44.042 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.042 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.042 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231523 s, 45.3 MB/s 2024-01-22T05:12:44.075 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.075 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.075 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292366 s, 35.9 MB/s 2024-01-22T05:12:44.102 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.102 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.102 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221647 s, 47.3 MB/s 2024-01-22T05:12:44.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.131 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026193 s, 40.0 MB/s 2024-01-22T05:12:44.154 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.154 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.154 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203486 s, 51.5 MB/s 2024-01-22T05:12:44.179 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.179 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.179 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213323 s, 49.2 MB/s 2024-01-22T05:12:44.208 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.208 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.208 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257198 s, 40.8 MB/s 2024-01-22T05:12:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233792 s, 44.9 MB/s 2024-01-22T05:12:44.263 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.264 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.264 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02635 s, 39.8 MB/s 2024-01-22T05:12:44.293 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.294 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.294 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255253 s, 41.1 MB/s 2024-01-22T05:12:44.328 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.329 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.329 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305377 s, 34.3 MB/s 2024-01-22T05:12:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.365 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316999 s, 33.1 MB/s 2024-01-22T05:12:44.394 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.394 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.394 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252357 s, 41.6 MB/s 2024-01-22T05:12:44.427 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.427 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.427 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028571 s, 36.7 MB/s 2024-01-22T05:12:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238845 s, 43.9 MB/s 2024-01-22T05:12:44.480 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.480 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.480 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223985 s, 46.8 MB/s 2024-01-22T05:12:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.504 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214368 s, 48.9 MB/s 2024-01-22T05:12:44.530 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.531 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.531 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240962 s, 43.5 MB/s 2024-01-22T05:12:44.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:44.533 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:44.533 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:44.533 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.11 2024-01-22T05:12:44.533 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:44.533 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:44.533 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:44.533 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:44.588 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.588 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.588 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260691 s, 40.2 MB/s 2024-01-22T05:12:44.612 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.612 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.612 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212368 s, 49.4 MB/s 2024-01-22T05:12:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341332 s, 30.7 MB/s 2024-01-22T05:12:44.679 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.679 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.679 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242462 s, 43.2 MB/s 2024-01-22T05:12:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.710 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265511 s, 39.5 MB/s 2024-01-22T05:12:44.746 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.746 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.746 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314174 s, 33.4 MB/s 2024-01-22T05:12:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.779 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.780 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292657 s, 35.8 MB/s 2024-01-22T05:12:44.809 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.809 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.810 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255144 s, 41.1 MB/s 2024-01-22T05:12:44.843 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.843 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.843 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303276 s, 34.6 MB/s 2024-01-22T05:12:44.874 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.874 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.874 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262346 s, 40.0 MB/s 2024-01-22T05:12:44.911 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.911 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.911 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332848 s, 31.5 MB/s 2024-01-22T05:12:44.945 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.945 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.945 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029343 s, 35.7 MB/s 2024-01-22T05:12:44.968 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:44.968 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:44.969 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204215 s, 51.3 MB/s 2024-01-22T05:12:45.002 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.002 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.002 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296082 s, 35.4 MB/s 2024-01-22T05:12:45.032 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.032 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.032 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265389 s, 39.5 MB/s 2024-01-22T05:12:45.058 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.058 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.058 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229323 s, 45.7 MB/s 2024-01-22T05:12:45.083 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.084 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.084 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217229 s, 48.3 MB/s 2024-01-22T05:12:45.111 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.111 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.111 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243057 s, 43.1 MB/s 2024-01-22T05:12:45.142 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.142 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.142 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258317 s, 40.6 MB/s 2024-01-22T05:12:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.181 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0355798 s, 29.5 MB/s 2024-01-22T05:12:45.213 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.213 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.213 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285007 s, 36.8 MB/s 2024-01-22T05:12:45.240 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.240 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.240 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229327 s, 45.7 MB/s 2024-01-22T05:12:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303138 s, 34.6 MB/s 2024-01-22T05:12:45.308 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.308 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.308 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029743 s, 35.3 MB/s 2024-01-22T05:12:45.340 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.340 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.340 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271044 s, 38.7 MB/s 2024-01-22T05:12:45.370 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.370 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.370 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258494 s, 40.6 MB/s 2024-01-22T05:12:45.398 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.399 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.399 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244683 s, 42.9 MB/s 2024-01-22T05:12:45.428 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.428 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.428 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256375 s, 40.9 MB/s 2024-01-22T05:12:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228027 s, 46.0 MB/s 2024-01-22T05:12:45.484 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.484 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.485 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262494 s, 39.9 MB/s 2024-01-22T05:12:45.508 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.508 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.508 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209284 s, 50.1 MB/s 2024-01-22T05:12:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198403 s, 52.9 MB/s 2024-01-22T05:12:45.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:45.532 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:45.532 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:45.532 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.12 2024-01-22T05:12:45.532 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:45.532 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:45.532 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:45.532 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:45.582 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.582 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.582 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024841 s, 42.2 MB/s 2024-01-22T05:12:45.603 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.603 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.603 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178698 s, 58.7 MB/s 2024-01-22T05:12:45.635 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.635 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.635 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02843 s, 36.9 MB/s 2024-01-22T05:12:45.660 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.661 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.661 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210079 s, 49.9 MB/s 2024-01-22T05:12:45.687 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.687 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.687 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237126 s, 44.2 MB/s 2024-01-22T05:12:45.719 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.720 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.720 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282273 s, 37.1 MB/s 2024-01-22T05:12:45.756 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.756 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.756 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317635 s, 33.0 MB/s 2024-01-22T05:12:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274845 s, 38.2 MB/s 2024-01-22T05:12:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239429 s, 43.8 MB/s 2024-01-22T05:12:45.845 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.845 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.846 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264423 s, 39.7 MB/s 2024-01-22T05:12:45.875 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.875 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.875 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251846 s, 41.6 MB/s 2024-01-22T05:12:45.909 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.909 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.909 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307613 s, 34.1 MB/s 2024-01-22T05:12:45.938 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.938 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.939 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249382 s, 42.0 MB/s 2024-01-22T05:12:45.964 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:45.964 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:45.964 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233207 s, 45.0 MB/s 2024-01-22T05:12:46.002 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.002 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.002 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336039 s, 31.2 MB/s 2024-01-22T05:12:46.034 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.035 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.035 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285828 s, 36.7 MB/s 2024-01-22T05:12:46.067 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.067 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.067 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282512 s, 37.1 MB/s 2024-01-22T05:12:46.098 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.098 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.098 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265758 s, 39.5 MB/s 2024-01-22T05:12:46.132 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.132 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.133 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302459 s, 34.7 MB/s 2024-01-22T05:12:46.161 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.162 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.162 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247717 s, 42.3 MB/s 2024-01-22T05:12:46.191 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.191 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.191 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025811 s, 40.6 MB/s 2024-01-22T05:12:46.222 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.222 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.222 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262016 s, 40.0 MB/s 2024-01-22T05:12:46.245 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.245 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.245 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196601 s, 53.3 MB/s 2024-01-22T05:12:46.273 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.274 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.274 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250973 s, 41.8 MB/s 2024-01-22T05:12:46.304 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.305 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.305 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265569 s, 39.5 MB/s 2024-01-22T05:12:46.333 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.333 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.333 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255572 s, 41.0 MB/s 2024-01-22T05:12:46.359 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.359 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.359 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227722 s, 46.0 MB/s 2024-01-22T05:12:46.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.388 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264583 s, 39.6 MB/s 2024-01-22T05:12:46.422 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.422 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.422 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297246 s, 35.3 MB/s 2024-01-22T05:12:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.458 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.458 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310508 s, 33.8 MB/s 2024-01-22T05:12:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222925 s, 47.0 MB/s 2024-01-22T05:12:46.514 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.514 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.514 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259956 s, 40.3 MB/s 2024-01-22T05:12:46.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:46.517 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:46.517 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:46.517 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.13 2024-01-22T05:12:46.517 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:46.517 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:46.517 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:46.517 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:46.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.575 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252815 s, 41.5 MB/s 2024-01-22T05:12:46.607 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.607 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.607 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280373 s, 37.4 MB/s 2024-01-22T05:12:46.636 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025069 s, 41.8 MB/s 2024-01-22T05:12:46.672 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.672 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.672 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313089 s, 33.5 MB/s 2024-01-22T05:12:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269791 s, 38.9 MB/s 2024-01-22T05:12:46.730 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.730 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.730 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245716 s, 42.7 MB/s 2024-01-22T05:12:46.755 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.755 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.755 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223124 s, 47.0 MB/s 2024-01-22T05:12:46.784 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.784 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.784 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247106 s, 42.4 MB/s 2024-01-22T05:12:46.822 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.822 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.822 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349964 s, 30.0 MB/s 2024-01-22T05:12:46.851 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.851 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.851 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248154 s, 42.3 MB/s 2024-01-22T05:12:46.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.884 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297167 s, 35.3 MB/s 2024-01-22T05:12:46.911 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.912 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.912 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024183 s, 43.4 MB/s 2024-01-22T05:12:46.944 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.944 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.944 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281433 s, 37.3 MB/s 2024-01-22T05:12:46.987 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:46.987 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:46.987 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0381737 s, 27.5 MB/s 2024-01-22T05:12:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305249 s, 34.4 MB/s 2024-01-22T05:12:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287372 s, 36.5 MB/s 2024-01-22T05:12:47.095 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.096 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.096 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0356095 s, 29.4 MB/s 2024-01-22T05:12:47.129 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.129 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.129 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298601 s, 35.1 MB/s 2024-01-22T05:12:47.158 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.158 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.158 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025018 s, 41.9 MB/s 2024-01-22T05:12:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.185 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238248 s, 44.0 MB/s 2024-01-22T05:12:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224917 s, 46.6 MB/s 2024-01-22T05:12:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027724 s, 37.8 MB/s 2024-01-22T05:12:47.268 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.269 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.269 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218399 s, 48.0 MB/s 2024-01-22T05:12:47.293 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.293 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.293 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213584 s, 49.1 MB/s 2024-01-22T05:12:47.318 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.318 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.318 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214474 s, 48.9 MB/s 2024-01-22T05:12:47.343 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.343 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.343 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217105 s, 48.3 MB/s 2024-01-22T05:12:47.376 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.376 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.376 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290045 s, 36.2 MB/s 2024-01-22T05:12:47.407 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.407 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.407 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267136 s, 39.3 MB/s 2024-01-22T05:12:47.438 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.438 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.438 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027922 s, 37.6 MB/s 2024-01-22T05:12:47.460 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.460 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.460 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187509 s, 55.9 MB/s 2024-01-22T05:12:47.488 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.489 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239901 s, 43.7 MB/s 2024-01-22T05:12:47.520 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.520 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.520 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273965 s, 38.3 MB/s 2024-01-22T05:12:47.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:47.522 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:47.522 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:47.522 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.14 2024-01-22T05:12:47.523 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:47.523 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:47.523 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:47.523 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:47.571 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.571 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.571 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212004 s, 49.5 MB/s 2024-01-22T05:12:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.597 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224331 s, 46.7 MB/s 2024-01-22T05:12:47.626 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.626 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.626 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267964 s, 39.1 MB/s 2024-01-22T05:12:47.665 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.665 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.665 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0347318 s, 30.2 MB/s 2024-01-22T05:12:47.700 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.701 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.701 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308049 s, 34.0 MB/s 2024-01-22T05:12:47.731 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.731 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.731 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263804 s, 39.7 MB/s 2024-01-22T05:12:47.765 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.765 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.765 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311108 s, 33.7 MB/s 2024-01-22T05:12:47.803 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.803 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.803 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332609 s, 31.5 MB/s 2024-01-22T05:12:47.834 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.835 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.835 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270795 s, 38.7 MB/s 2024-01-22T05:12:47.869 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303545 s, 34.5 MB/s 2024-01-22T05:12:47.895 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.895 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.895 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221841 s, 47.3 MB/s 2024-01-22T05:12:47.927 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.927 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.927 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284339 s, 36.9 MB/s 2024-01-22T05:12:47.964 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.964 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.965 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332549 s, 31.5 MB/s 2024-01-22T05:12:47.997 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:47.997 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:47.997 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282533 s, 37.1 MB/s 2024-01-22T05:12:48.024 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.024 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.024 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234202 s, 44.8 MB/s 2024-01-22T05:12:48.052 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.052 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.052 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237284 s, 44.2 MB/s 2024-01-22T05:12:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287791 s, 36.4 MB/s 2024-01-22T05:12:48.122 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.122 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.122 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032119 s, 32.6 MB/s 2024-01-22T05:12:48.149 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.149 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.149 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244354 s, 42.9 MB/s 2024-01-22T05:12:48.179 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.179 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.179 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265588 s, 39.5 MB/s 2024-01-22T05:12:48.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.211 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028033 s, 37.4 MB/s 2024-01-22T05:12:48.236 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.236 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.236 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226834 s, 46.2 MB/s 2024-01-22T05:12:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.267 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263689 s, 39.8 MB/s 2024-01-22T05:12:48.294 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.294 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.294 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244472 s, 42.9 MB/s 2024-01-22T05:12:48.320 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.320 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.320 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215913 s, 48.6 MB/s 2024-01-22T05:12:48.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.348 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248747 s, 42.2 MB/s 2024-01-22T05:12:48.384 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.384 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.384 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316752 s, 33.1 MB/s 2024-01-22T05:12:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242795 s, 43.2 MB/s 2024-01-22T05:12:48.444 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.444 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.444 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280556 s, 37.4 MB/s 2024-01-22T05:12:48.469 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.469 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.469 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220596 s, 47.5 MB/s 2024-01-22T05:12:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248329 s, 42.2 MB/s 2024-01-22T05:12:48.526 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.526 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.526 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249037 s, 42.1 MB/s 2024-01-22T05:12:48.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:48.529 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:48.529 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:48.529 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.15 2024-01-22T05:12:48.529 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:48.529 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:48.529 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:48.529 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:48.625 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.625 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.625 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225484 s, 46.5 MB/s 2024-01-22T05:12:48.662 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.662 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.662 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322339 s, 32.5 MB/s 2024-01-22T05:12:48.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.689 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233054 s, 45.0 MB/s 2024-01-22T05:12:48.718 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.718 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.718 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250706 s, 41.8 MB/s 2024-01-22T05:12:48.748 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.748 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.748 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264865 s, 39.6 MB/s 2024-01-22T05:12:48.778 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.778 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.778 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251408 s, 41.7 MB/s 2024-01-22T05:12:48.806 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.806 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.806 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247263 s, 42.4 MB/s 2024-01-22T05:12:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025847 s, 40.6 MB/s 2024-01-22T05:12:48.874 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.874 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.874 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344543 s, 30.4 MB/s 2024-01-22T05:12:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300499 s, 34.9 MB/s 2024-01-22T05:12:48.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.946 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0339002 s, 30.9 MB/s 2024-01-22T05:12:48.975 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.975 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.975 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245386 s, 42.7 MB/s 2024-01-22T05:12:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197147 s, 53.2 MB/s 2024-01-22T05:12:49.032 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.032 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.032 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324742 s, 32.3 MB/s 2024-01-22T05:12:49.072 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.073 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0370919 s, 28.3 MB/s 2024-01-22T05:12:49.102 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.102 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.102 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255005 s, 41.1 MB/s 2024-01-22T05:12:49.138 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.138 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.138 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325123 s, 32.3 MB/s 2024-01-22T05:12:49.166 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.166 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.166 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023948 s, 43.8 MB/s 2024-01-22T05:12:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239164 s, 43.8 MB/s 2024-01-22T05:12:49.230 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330193 s, 31.8 MB/s 2024-01-22T05:12:49.259 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.259 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.259 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245502 s, 42.7 MB/s 2024-01-22T05:12:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238473 s, 44.0 MB/s 2024-01-22T05:12:49.311 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.311 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.311 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208426 s, 50.3 MB/s 2024-01-22T05:12:49.338 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.338 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.338 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235538 s, 44.5 MB/s 2024-01-22T05:12:49.373 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.373 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.373 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302284 s, 34.7 MB/s 2024-01-22T05:12:49.403 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.403 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.403 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252803 s, 41.5 MB/s 2024-01-22T05:12:49.432 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.432 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.432 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02466 s, 42.5 MB/s 2024-01-22T05:12:49.467 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.467 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.467 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328571 s, 31.9 MB/s 2024-01-22T05:12:49.498 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.498 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.498 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270228 s, 38.8 MB/s 2024-01-22T05:12:49.528 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.528 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.528 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256345 s, 40.9 MB/s 2024-01-22T05:12:49.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.556 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023478 s, 44.7 MB/s 2024-01-22T05:12:49.579 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.579 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.579 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187816 s, 55.8 MB/s 2024-01-22T05:12:49.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:49.581 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:49.581 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:49.582 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.16 2024-01-22T05:12:49.582 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:49.582 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:49.582 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:49.582 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:49.637 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.638 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.638 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257043 s, 40.8 MB/s 2024-01-22T05:12:49.663 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.663 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.663 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223481 s, 46.9 MB/s 2024-01-22T05:12:49.690 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.690 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.690 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237766 s, 44.1 MB/s 2024-01-22T05:12:49.720 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.720 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.720 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253235 s, 41.4 MB/s 2024-01-22T05:12:49.752 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.753 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.753 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282748 s, 37.1 MB/s 2024-01-22T05:12:49.781 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.781 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.782 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246504 s, 42.5 MB/s 2024-01-22T05:12:49.811 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.811 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.811 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264338 s, 39.7 MB/s 2024-01-22T05:12:49.851 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.852 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.852 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0356122 s, 29.4 MB/s 2024-01-22T05:12:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287093 s, 36.5 MB/s 2024-01-22T05:12:49.911 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.911 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.911 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232952 s, 45.0 MB/s 2024-01-22T05:12:49.940 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.940 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.940 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266859 s, 39.3 MB/s 2024-01-22T05:12:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292696 s, 35.8 MB/s 2024-01-22T05:12:50.010 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.010 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.011 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336095 s, 31.2 MB/s 2024-01-22T05:12:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023211 s, 45.2 MB/s 2024-01-22T05:12:50.067 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.067 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.067 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268355 s, 39.1 MB/s 2024-01-22T05:12:50.103 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.103 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.103 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324402 s, 32.3 MB/s 2024-01-22T05:12:50.123 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.123 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.123 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017651 s, 59.4 MB/s 2024-01-22T05:12:50.154 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.155 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.155 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291473 s, 36.0 MB/s 2024-01-22T05:12:50.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.184 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259232 s, 40.4 MB/s 2024-01-22T05:12:50.216 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.216 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.216 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286199 s, 36.6 MB/s 2024-01-22T05:12:50.244 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.245 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.245 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234321 s, 44.7 MB/s 2024-01-22T05:12:50.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.267 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196366 s, 53.4 MB/s 2024-01-22T05:12:50.292 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.292 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.293 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217382 s, 48.2 MB/s 2024-01-22T05:12:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230215 s, 45.5 MB/s 2024-01-22T05:12:50.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.350 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279759 s, 37.5 MB/s 2024-01-22T05:12:50.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.379 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025087 s, 41.8 MB/s 2024-01-22T05:12:50.407 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.407 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.407 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249897 s, 42.0 MB/s 2024-01-22T05:12:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336535 s, 31.2 MB/s 2024-01-22T05:12:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212343 s, 49.4 MB/s 2024-01-22T05:12:50.502 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.503 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.503 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311388 s, 33.7 MB/s 2024-01-22T05:12:50.537 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.537 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.538 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316737 s, 33.1 MB/s 2024-01-22T05:12:50.573 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.573 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.573 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332599 s, 31.5 MB/s 2024-01-22T05:12:50.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:50.576 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:50.576 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:50.576 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.17 2024-01-22T05:12:50.576 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:50.576 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:50.576 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:50.576 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:50.623 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.623 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.623 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186634 s, 56.2 MB/s 2024-01-22T05:12:50.652 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.653 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.653 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266828 s, 39.3 MB/s 2024-01-22T05:12:50.686 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.687 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.687 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299312 s, 35.0 MB/s 2024-01-22T05:12:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311101 s, 33.7 MB/s 2024-01-22T05:12:50.751 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.751 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.751 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252555 s, 41.5 MB/s 2024-01-22T05:12:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249577 s, 42.0 MB/s 2024-01-22T05:12:50.810 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.810 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.810 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253229 s, 41.4 MB/s 2024-01-22T05:12:50.837 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.837 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.837 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231625 s, 45.3 MB/s 2024-01-22T05:12:50.868 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.868 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.868 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274962 s, 38.1 MB/s 2024-01-22T05:12:50.896 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.896 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.896 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247575 s, 42.4 MB/s 2024-01-22T05:12:50.929 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.929 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.929 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279709 s, 37.5 MB/s 2024-01-22T05:12:50.958 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.958 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.959 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025691 s, 40.8 MB/s 2024-01-22T05:12:50.990 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:50.990 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:50.991 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276017 s, 38.0 MB/s 2024-01-22T05:12:51.028 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.028 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.028 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.033215 s, 31.6 MB/s 2024-01-22T05:12:51.059 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.060 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267585 s, 39.2 MB/s 2024-01-22T05:12:51.086 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.086 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.086 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238216 s, 44.0 MB/s 2024-01-22T05:12:51.114 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.114 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.114 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238316 s, 44.0 MB/s 2024-01-22T05:12:51.146 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.146 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.146 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278263 s, 37.7 MB/s 2024-01-22T05:12:51.188 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.188 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.188 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0381606 s, 27.5 MB/s 2024-01-22T05:12:51.219 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.220 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.220 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264879 s, 39.6 MB/s 2024-01-22T05:12:51.247 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.247 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241997 s, 43.3 MB/s 2024-01-22T05:12:51.283 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.283 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.283 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319497 s, 32.8 MB/s 2024-01-22T05:12:51.313 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.313 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.313 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267497 s, 39.2 MB/s 2024-01-22T05:12:51.340 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.340 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.340 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242881 s, 43.2 MB/s 2024-01-22T05:12:51.369 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.369 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.370 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248868 s, 42.1 MB/s 2024-01-22T05:12:51.404 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.404 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.404 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312426 s, 33.6 MB/s 2024-01-22T05:12:51.430 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.430 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.430 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021834 s, 48.0 MB/s 2024-01-22T05:12:51.456 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.456 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227755 s, 46.0 MB/s 2024-01-22T05:12:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296913 s, 35.3 MB/s 2024-01-22T05:12:51.521 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.521 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.521 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282005 s, 37.2 MB/s 2024-01-22T05:12:51.548 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.548 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.548 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231554 s, 45.3 MB/s 2024-01-22T05:12:51.573 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.573 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.573 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218585 s, 48.0 MB/s 2024-01-22T05:12:51.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:51.575 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:51.575 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:51.575 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.18 2024-01-22T05:12:51.575 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:51.575 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:51.575 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:51.575 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:51.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.689 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0389716 s, 26.9 MB/s 2024-01-22T05:12:51.716 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.716 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.716 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226189 s, 46.4 MB/s 2024-01-22T05:12:51.743 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.743 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.743 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226221 s, 46.4 MB/s 2024-01-22T05:12:51.784 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.784 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.784 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0380071 s, 27.6 MB/s 2024-01-22T05:12:51.813 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.813 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.814 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235796 s, 44.5 MB/s 2024-01-22T05:12:51.841 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.841 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.841 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258483 s, 40.6 MB/s 2024-01-22T05:12:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338102 s, 31.0 MB/s 2024-01-22T05:12:51.910 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.910 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.910 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258329 s, 40.6 MB/s 2024-01-22T05:12:51.939 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.939 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.939 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257508 s, 40.7 MB/s 2024-01-22T05:12:51.976 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:51.976 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:51.976 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334203 s, 31.4 MB/s 2024-01-22T05:12:52.011 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.011 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.011 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310325 s, 33.8 MB/s 2024-01-22T05:12:52.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.045 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306679 s, 34.2 MB/s 2024-01-22T05:12:52.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.074 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246464 s, 42.5 MB/s 2024-01-22T05:12:52.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.107 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295284 s, 35.5 MB/s 2024-01-22T05:12:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243631 s, 43.0 MB/s 2024-01-22T05:12:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.158 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213286 s, 49.2 MB/s 2024-01-22T05:12:52.195 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.195 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.195 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340025 s, 30.8 MB/s 2024-01-22T05:12:52.223 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.223 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.223 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023604 s, 44.4 MB/s 2024-01-22T05:12:52.250 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.250 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.250 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241875 s, 43.4 MB/s 2024-01-22T05:12:52.288 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.289 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.289 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341392 s, 30.7 MB/s 2024-01-22T05:12:52.317 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.318 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.318 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264528 s, 39.6 MB/s 2024-01-22T05:12:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299494 s, 35.0 MB/s 2024-01-22T05:12:52.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.388 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321687 s, 32.6 MB/s 2024-01-22T05:12:52.419 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.419 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.419 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264512 s, 39.6 MB/s 2024-01-22T05:12:52.447 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.448 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.448 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265136 s, 39.5 MB/s 2024-01-22T05:12:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223886 s, 46.8 MB/s 2024-01-22T05:12:52.504 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.505 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.505 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266672 s, 39.3 MB/s 2024-01-22T05:12:52.533 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.534 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.534 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255693 s, 41.0 MB/s 2024-01-22T05:12:52.559 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.559 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.559 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230598 s, 45.5 MB/s 2024-01-22T05:12:52.595 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.595 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.595 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328408 s, 31.9 MB/s 2024-01-22T05:12:52.626 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.627 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.627 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275094 s, 38.1 MB/s 2024-01-22T05:12:52.656 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.657 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.657 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255747 s, 41.0 MB/s 2024-01-22T05:12:52.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:52.659 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:52.659 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:52.659 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.19 2024-01-22T05:12:52.659 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:52.659 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:52.659 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:52.659 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:52.726 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.727 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.727 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03666 s, 28.6 MB/s 2024-01-22T05:12:52.754 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.754 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.754 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235274 s, 44.6 MB/s 2024-01-22T05:12:52.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.780 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230303 s, 45.5 MB/s 2024-01-22T05:12:52.807 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.807 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.807 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230455 s, 45.5 MB/s 2024-01-22T05:12:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241996 s, 43.3 MB/s 2024-01-22T05:12:52.862 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.863 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.863 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235438 s, 44.5 MB/s 2024-01-22T05:12:52.894 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.894 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.894 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276829 s, 37.9 MB/s 2024-01-22T05:12:52.924 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.924 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.924 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260863 s, 40.2 MB/s 2024-01-22T05:12:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274223 s, 38.2 MB/s 2024-01-22T05:12:52.985 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:52.986 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:52.986 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252789 s, 41.5 MB/s 2024-01-22T05:12:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.017 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270222 s, 38.8 MB/s 2024-01-22T05:12:53.046 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.047 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.047 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254099 s, 41.3 MB/s 2024-01-22T05:12:53.076 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.076 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.077 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254598 s, 41.2 MB/s 2024-01-22T05:12:53.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.108 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025703 s, 40.8 MB/s 2024-01-22T05:12:53.139 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.139 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.139 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289687 s, 36.2 MB/s 2024-01-22T05:12:53.174 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.174 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.174 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311051 s, 33.7 MB/s 2024-01-22T05:12:53.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.203 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.203 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242765 s, 43.2 MB/s 2024-01-22T05:12:53.227 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.227 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.228 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223295 s, 47.0 MB/s 2024-01-22T05:12:53.257 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.257 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.257 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260515 s, 40.3 MB/s 2024-01-22T05:12:53.294 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.294 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.294 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338426 s, 31.0 MB/s 2024-01-22T05:12:53.334 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.334 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.334 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0358924 s, 29.2 MB/s 2024-01-22T05:12:53.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.380 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0408883 s, 25.6 MB/s 2024-01-22T05:12:53.410 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.410 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.410 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258256 s, 40.6 MB/s 2024-01-22T05:12:53.440 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.440 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.440 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270116 s, 38.8 MB/s 2024-01-22T05:12:53.474 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.474 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.474 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285186 s, 36.8 MB/s 2024-01-22T05:12:53.498 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.498 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.498 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208545 s, 50.3 MB/s 2024-01-22T05:12:53.523 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.523 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.523 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222284 s, 47.2 MB/s 2024-01-22T05:12:53.553 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.553 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.553 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027283 s, 38.4 MB/s 2024-01-22T05:12:53.593 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.593 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0359732 s, 29.1 MB/s 2024-01-22T05:12:53.616 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.616 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.616 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199214 s, 52.6 MB/s 2024-01-22T05:12:53.644 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.644 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.644 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236711 s, 44.3 MB/s 2024-01-22T05:12:53.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.669 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02226 s, 47.1 MB/s 2024-01-22T05:12:53.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:53.671 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:53.671 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:53.672 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.20 2024-01-22T05:12:53.672 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:53.672 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:53.672 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:53.672 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:53.724 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.724 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.724 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239623 s, 43.8 MB/s 2024-01-22T05:12:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.752 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254104 s, 41.3 MB/s 2024-01-22T05:12:53.779 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.780 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241723 s, 43.4 MB/s 2024-01-22T05:12:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0351102 s, 29.9 MB/s 2024-01-22T05:12:53.852 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.853 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.853 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285341 s, 36.7 MB/s 2024-01-22T05:12:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229735 s, 45.6 MB/s 2024-01-22T05:12:53.909 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.909 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.909 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248329 s, 42.2 MB/s 2024-01-22T05:12:53.933 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.933 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.933 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211544 s, 49.6 MB/s 2024-01-22T05:12:53.961 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.961 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.961 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241569 s, 43.4 MB/s 2024-01-22T05:12:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:53.986 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:53.986 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212443 s, 49.4 MB/s 2024-01-22T05:12:54.017 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.017 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.017 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276899 s, 37.9 MB/s 2024-01-22T05:12:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239255 s, 43.8 MB/s 2024-01-22T05:12:54.069 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.069 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.069 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219101 s, 47.9 MB/s 2024-01-22T05:12:54.101 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.101 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.101 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027287 s, 38.4 MB/s 2024-01-22T05:12:54.139 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.139 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.139 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.033859 s, 31.0 MB/s 2024-01-22T05:12:54.168 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.169 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.169 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255513 s, 41.0 MB/s 2024-01-22T05:12:54.198 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.198 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.198 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252214 s, 41.6 MB/s 2024-01-22T05:12:54.223 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.223 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.223 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228699 s, 45.8 MB/s 2024-01-22T05:12:54.252 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.252 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.252 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252688 s, 41.5 MB/s 2024-01-22T05:12:54.277 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.277 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.278 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022909 s, 45.8 MB/s 2024-01-22T05:12:54.302 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.302 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.302 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216971 s, 48.3 MB/s 2024-01-22T05:12:54.342 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.342 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.342 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0356288 s, 29.4 MB/s 2024-01-22T05:12:54.369 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.369 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.369 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233108 s, 45.0 MB/s 2024-01-22T05:12:54.399 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.399 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.399 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252209 s, 41.6 MB/s 2024-01-22T05:12:54.428 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.428 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.429 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251724 s, 41.7 MB/s 2024-01-22T05:12:54.455 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.455 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.455 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225991 s, 46.4 MB/s 2024-01-22T05:12:54.482 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.482 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.483 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240547 s, 43.6 MB/s 2024-01-22T05:12:54.514 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.514 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.514 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278294 s, 37.7 MB/s 2024-01-22T05:12:54.543 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.543 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.543 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251289 s, 41.7 MB/s 2024-01-22T05:12:54.579 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.579 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.579 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313592 s, 33.4 MB/s 2024-01-22T05:12:54.607 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.607 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.607 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242849 s, 43.2 MB/s 2024-01-22T05:12:54.635 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.635 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.635 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236292 s, 44.4 MB/s 2024-01-22T05:12:54.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:54.637 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:54.637 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:54.637 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.21 2024-01-22T05:12:54.637 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:54.638 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:54.638 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:54.638 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:54.691 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.691 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.692 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243826 s, 43.0 MB/s 2024-01-22T05:12:54.716 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.716 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.719 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215267 s, 48.7 MB/s 2024-01-22T05:12:54.741 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.741 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.741 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214456 s, 48.9 MB/s 2024-01-22T05:12:54.769 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.769 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.769 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234017 s, 44.8 MB/s 2024-01-22T05:12:54.797 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.797 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.798 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246685 s, 42.5 MB/s 2024-01-22T05:12:54.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.827 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025231 s, 41.6 MB/s 2024-01-22T05:12:54.858 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.859 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.859 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259399 s, 40.4 MB/s 2024-01-22T05:12:54.885 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.885 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.885 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024268 s, 43.2 MB/s 2024-01-22T05:12:54.916 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.916 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.916 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266026 s, 39.4 MB/s 2024-01-22T05:12:54.949 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.949 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.950 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288886 s, 36.3 MB/s 2024-01-22T05:12:54.980 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:54.980 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:54.980 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264601 s, 39.6 MB/s 2024-01-22T05:12:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229222 s, 45.7 MB/s 2024-01-22T05:12:55.036 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.036 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.036 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025402 s, 41.3 MB/s 2024-01-22T05:12:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.075 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0339932 s, 30.8 MB/s 2024-01-22T05:12:55.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.104 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244299 s, 42.9 MB/s 2024-01-22T05:12:55.136 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.137 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.137 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285277 s, 36.8 MB/s 2024-01-22T05:12:55.165 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.165 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.165 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241701 s, 43.4 MB/s 2024-01-22T05:12:55.194 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.194 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.194 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257646 s, 40.7 MB/s 2024-01-22T05:12:55.229 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.230 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.230 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315891 s, 33.2 MB/s 2024-01-22T05:12:55.255 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.255 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.256 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217978 s, 48.1 MB/s 2024-01-22T05:12:55.285 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.285 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.285 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263198 s, 39.8 MB/s 2024-01-22T05:12:55.315 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.315 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.315 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251838 s, 41.6 MB/s 2024-01-22T05:12:55.345 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.345 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.345 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254385 s, 41.2 MB/s 2024-01-22T05:12:55.376 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.376 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.377 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277601 s, 37.8 MB/s 2024-01-22T05:12:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0353771 s, 29.6 MB/s 2024-01-22T05:12:55.451 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.451 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.452 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306018 s, 34.3 MB/s 2024-01-22T05:12:55.478 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.478 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.478 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231535 s, 45.3 MB/s 2024-01-22T05:12:55.509 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.509 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.509 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274067 s, 38.3 MB/s 2024-01-22T05:12:55.531 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.532 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.532 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202246 s, 51.8 MB/s 2024-01-22T05:12:55.567 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.567 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.568 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332245 s, 31.6 MB/s 2024-01-22T05:12:55.595 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.596 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.596 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239449 s, 43.8 MB/s 2024-01-22T05:12:55.624 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.624 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.624 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247216 s, 42.4 MB/s 2024-01-22T05:12:55.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:55.626 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:55.626 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:55.626 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.22 2024-01-22T05:12:55.627 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:55.627 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:55.627 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:55.627 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:55.682 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230181 s, 45.6 MB/s 2024-01-22T05:12:55.713 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.713 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.713 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275687 s, 38.0 MB/s 2024-01-22T05:12:55.750 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.750 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.750 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330937 s, 31.7 MB/s 2024-01-22T05:12:55.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262149 s, 40.0 MB/s 2024-01-22T05:12:55.813 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.813 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.814 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281676 s, 37.2 MB/s 2024-01-22T05:12:55.842 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.842 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.842 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246662 s, 42.5 MB/s 2024-01-22T05:12:55.871 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.871 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.871 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258711 s, 40.5 MB/s 2024-01-22T05:12:55.897 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.897 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.897 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230929 s, 45.4 MB/s 2024-01-22T05:12:55.923 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.923 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.923 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233009 s, 45.0 MB/s 2024-01-22T05:12:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.948 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.948 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218273 s, 48.0 MB/s 2024-01-22T05:12:55.988 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:55.988 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:55.988 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0353947 s, 29.6 MB/s 2024-01-22T05:12:56.020 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.020 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.020 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02863 s, 36.6 MB/s 2024-01-22T05:12:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260175 s, 40.3 MB/s 2024-01-22T05:12:56.081 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.081 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.081 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260752 s, 40.2 MB/s 2024-01-22T05:12:56.111 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.111 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.112 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026243 s, 40.0 MB/s 2024-01-22T05:12:56.138 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.138 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.139 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244612 s, 42.9 MB/s 2024-01-22T05:12:56.176 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.176 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.176 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340504 s, 30.8 MB/s 2024-01-22T05:12:56.208 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.208 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.208 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285068 s, 36.8 MB/s 2024-01-22T05:12:56.238 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.238 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.238 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255367 s, 41.1 MB/s 2024-01-22T05:12:56.264 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.264 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.264 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222671 s, 47.1 MB/s 2024-01-22T05:12:56.296 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.297 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.297 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291358 s, 36.0 MB/s 2024-01-22T05:12:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.327 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261399 s, 40.1 MB/s 2024-01-22T05:12:56.361 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.362 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.362 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317219 s, 33.1 MB/s 2024-01-22T05:12:56.390 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.390 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.390 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243295 s, 43.1 MB/s 2024-01-22T05:12:56.428 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.428 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.428 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0352469 s, 29.7 MB/s 2024-01-22T05:12:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267678 s, 39.2 MB/s 2024-01-22T05:12:56.493 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.493 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.493 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301128 s, 34.8 MB/s 2024-01-22T05:12:56.529 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.529 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.529 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316496 s, 33.1 MB/s 2024-01-22T05:12:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244191 s, 42.9 MB/s 2024-01-22T05:12:56.588 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.588 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.588 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258406 s, 40.6 MB/s 2024-01-22T05:12:56.624 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.624 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.624 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320108 s, 32.8 MB/s 2024-01-22T05:12:56.655 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.655 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.655 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265004 s, 39.6 MB/s 2024-01-22T05:12:56.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:56.658 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:56.658 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:56.658 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.23 2024-01-22T05:12:56.658 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:56.658 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:56.658 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:56.658 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:56.711 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.711 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.711 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226166 s, 46.4 MB/s 2024-01-22T05:12:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244373 s, 42.9 MB/s 2024-01-22T05:12:56.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.773 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286864 s, 36.6 MB/s 2024-01-22T05:12:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241618 s, 43.4 MB/s 2024-01-22T05:12:56.831 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.831 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.831 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257002 s, 40.8 MB/s 2024-01-22T05:12:56.862 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.863 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.863 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282535 s, 37.1 MB/s 2024-01-22T05:12:56.894 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.894 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.894 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271085 s, 38.7 MB/s 2024-01-22T05:12:56.929 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.929 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.929 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315308 s, 33.3 MB/s 2024-01-22T05:12:56.961 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.961 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.961 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027862 s, 37.6 MB/s 2024-01-22T05:12:56.987 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:56.987 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:56.988 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223006 s, 47.0 MB/s 2024-01-22T05:12:57.012 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.012 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.012 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213241 s, 49.2 MB/s 2024-01-22T05:12:57.048 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.048 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.048 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312096 s, 33.6 MB/s 2024-01-22T05:12:57.081 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.081 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.081 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292368 s, 35.9 MB/s 2024-01-22T05:12:57.115 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.116 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.116 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302722 s, 34.6 MB/s 2024-01-22T05:12:57.143 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.143 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.143 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240105 s, 43.7 MB/s 2024-01-22T05:12:57.178 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.178 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.178 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032008 s, 32.8 MB/s 2024-01-22T05:12:57.208 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.208 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.208 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255871 s, 41.0 MB/s 2024-01-22T05:12:57.244 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.244 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.244 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031348 s, 33.4 MB/s 2024-01-22T05:12:57.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.282 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332779 s, 31.5 MB/s 2024-01-22T05:12:57.316 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.316 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.316 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303268 s, 34.6 MB/s 2024-01-22T05:12:57.355 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.355 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.355 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342612 s, 30.6 MB/s 2024-01-22T05:12:57.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.389 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.389 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291308 s, 36.0 MB/s 2024-01-22T05:12:57.420 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.420 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.420 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271541 s, 38.6 MB/s 2024-01-22T05:12:57.449 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.449 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.449 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258302 s, 40.6 MB/s 2024-01-22T05:12:57.475 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.476 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.476 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227694 s, 46.1 MB/s 2024-01-22T05:12:57.502 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.502 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.502 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239162 s, 43.8 MB/s 2024-01-22T05:12:57.533 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.533 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.533 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268503 s, 39.1 MB/s 2024-01-22T05:12:57.559 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.559 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.559 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215766 s, 48.6 MB/s 2024-01-22T05:12:57.593 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.593 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.593 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316371 s, 33.1 MB/s 2024-01-22T05:12:57.624 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.624 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.624 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027208 s, 38.5 MB/s 2024-01-22T05:12:57.654 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.655 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.655 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266903 s, 39.3 MB/s 2024-01-22T05:12:57.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.689 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310555 s, 33.8 MB/s 2024-01-22T05:12:57.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:57.691 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:57.691 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:57.691 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.24 2024-01-22T05:12:57.691 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:57.691 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:57.691 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:57.692 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:57.752 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.752 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.753 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327843 s, 32.0 MB/s 2024-01-22T05:12:57.790 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.790 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.790 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330491 s, 31.7 MB/s 2024-01-22T05:12:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.820 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255184 s, 41.1 MB/s 2024-01-22T05:12:57.848 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.848 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.848 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252416 s, 41.5 MB/s 2024-01-22T05:12:57.873 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.873 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.873 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213861 s, 49.0 MB/s 2024-01-22T05:12:57.910 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.910 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.910 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338491 s, 31.0 MB/s 2024-01-22T05:12:57.939 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.939 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.939 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025327 s, 41.4 MB/s 2024-01-22T05:12:57.970 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.970 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.970 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266934 s, 39.3 MB/s 2024-01-22T05:12:57.996 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:57.997 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:57.997 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226347 s, 46.3 MB/s 2024-01-22T05:12:58.021 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.021 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.021 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214646 s, 48.9 MB/s 2024-01-22T05:12:58.053 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.053 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.053 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273701 s, 38.3 MB/s 2024-01-22T05:12:58.079 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.079 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.079 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229996 s, 45.6 MB/s 2024-01-22T05:12:58.113 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.113 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.114 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306256 s, 34.2 MB/s 2024-01-22T05:12:58.140 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.140 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.140 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213861 s, 49.0 MB/s 2024-01-22T05:12:58.171 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.172 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.172 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274502 s, 38.2 MB/s 2024-01-22T05:12:58.205 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.206 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.206 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298375 s, 35.1 MB/s 2024-01-22T05:12:58.231 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.232 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.232 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219205 s, 47.8 MB/s 2024-01-22T05:12:58.265 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.265 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.265 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300588 s, 34.9 MB/s 2024-01-22T05:12:58.295 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.295 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.295 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261469 s, 40.1 MB/s 2024-01-22T05:12:58.320 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.320 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.320 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217877 s, 48.1 MB/s 2024-01-22T05:12:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234903 s, 44.6 MB/s 2024-01-22T05:12:58.378 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.378 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.378 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259753 s, 40.4 MB/s 2024-01-22T05:12:58.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.412 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300132 s, 34.9 MB/s 2024-01-22T05:12:58.437 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.437 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.437 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211197 s, 49.6 MB/s 2024-01-22T05:12:58.468 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.468 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.469 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288691 s, 36.3 MB/s 2024-01-22T05:12:58.497 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.497 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.497 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243048 s, 43.1 MB/s 2024-01-22T05:12:58.525 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.525 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.525 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245577 s, 42.7 MB/s 2024-01-22T05:12:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229501 s, 45.7 MB/s 2024-01-22T05:12:58.580 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.580 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.580 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245699 s, 42.7 MB/s 2024-01-22T05:12:58.611 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.611 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.611 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260961 s, 40.2 MB/s 2024-01-22T05:12:58.645 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.645 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.645 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291619 s, 36.0 MB/s 2024-01-22T05:12:58.674 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.674 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.674 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254017 s, 41.3 MB/s 2024-01-22T05:12:58.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:58.676 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:58.677 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:58.677 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.25 2024-01-22T05:12:58.677 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:58.677 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:58.677 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:58.677 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:58.727 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.727 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.727 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213185 s, 49.2 MB/s 2024-01-22T05:12:58.758 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.758 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.758 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270023 s, 38.8 MB/s 2024-01-22T05:12:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232634 s, 45.1 MB/s 2024-01-22T05:12:58.819 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.819 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.819 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295328 s, 35.5 MB/s 2024-01-22T05:12:58.855 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.855 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.855 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316961 s, 33.1 MB/s 2024-01-22T05:12:58.883 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.883 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.883 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241349 s, 43.4 MB/s 2024-01-22T05:12:58.926 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.926 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.926 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0389956 s, 26.9 MB/s 2024-01-22T05:12:58.953 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.953 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.953 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235583 s, 44.5 MB/s 2024-01-22T05:12:58.986 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:58.986 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:58.986 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289878 s, 36.2 MB/s 2024-01-22T05:12:59.020 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.020 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.020 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296343 s, 35.4 MB/s 2024-01-22T05:12:59.051 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.051 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.051 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268976 s, 39.0 MB/s 2024-01-22T05:12:59.079 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.079 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.079 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252623 s, 41.5 MB/s 2024-01-22T05:12:59.111 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.112 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.112 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280007 s, 37.4 MB/s 2024-01-22T05:12:59.144 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.144 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.144 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282875 s, 37.1 MB/s 2024-01-22T05:12:59.178 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.178 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.178 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295934 s, 35.4 MB/s 2024-01-22T05:12:59.212 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.212 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.212 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294343 s, 35.6 MB/s 2024-01-22T05:12:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.244 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274849 s, 38.2 MB/s 2024-01-22T05:12:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281195 s, 37.3 MB/s 2024-01-22T05:12:59.305 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.305 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.305 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251873 s, 41.6 MB/s 2024-01-22T05:12:59.336 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.336 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.336 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275245 s, 38.1 MB/s 2024-01-22T05:12:59.364 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.364 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.364 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234525 s, 44.7 MB/s 2024-01-22T05:12:59.394 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.394 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.394 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260677 s, 40.2 MB/s 2024-01-22T05:12:59.423 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.423 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.423 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254582 s, 41.2 MB/s 2024-01-22T05:12:59.456 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.456 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.457 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302317 s, 34.7 MB/s 2024-01-22T05:12:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221228 s, 47.4 MB/s 2024-01-22T05:12:59.513 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.513 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.513 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279672 s, 37.5 MB/s 2024-01-22T05:12:59.539 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.539 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.539 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232256 s, 45.1 MB/s 2024-01-22T05:12:59.568 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.568 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.568 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255164 s, 41.1 MB/s 2024-01-22T05:12:59.595 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.595 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.595 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226233 s, 46.3 MB/s 2024-01-22T05:12:59.630 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.630 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.630 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321406 s, 32.6 MB/s 2024-01-22T05:12:59.658 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.658 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.658 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238577 s, 44.0 MB/s 2024-01-22T05:12:59.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.689 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279606 s, 37.5 MB/s 2024-01-22T05:12:59.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:12:59.692 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:12:59.692 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:12:59.692 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.26 2024-01-22T05:12:59.692 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:12:59.692 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:12:59.692 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:12:59.692 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:12:59.794 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.794 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.795 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225665 s, 46.5 MB/s 2024-01-22T05:12:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0353855 s, 29.6 MB/s 2024-01-22T05:12:59.863 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.863 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.863 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261974 s, 40.0 MB/s 2024-01-22T05:12:59.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.885 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.885 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192319 s, 54.5 MB/s 2024-01-22T05:12:59.921 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.921 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.921 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323388 s, 32.4 MB/s 2024-01-22T05:12:59.955 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.955 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.955 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292325 s, 35.9 MB/s 2024-01-22T05:12:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:12:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:12:59.981 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022745 s, 46.1 MB/s 2024-01-22T05:13:00.014 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.014 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.014 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028662 s, 36.6 MB/s 2024-01-22T05:13:00.049 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.049 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.049 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313714 s, 33.4 MB/s 2024-01-22T05:13:00.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.074 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212455 s, 49.4 MB/s 2024-01-22T05:13:00.100 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.100 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.100 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218133 s, 48.1 MB/s 2024-01-22T05:13:00.126 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.127 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.127 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230974 s, 45.4 MB/s 2024-01-22T05:13:00.154 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.154 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.154 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242896 s, 43.2 MB/s 2024-01-22T05:13:00.188 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.188 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.189 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308226 s, 34.0 MB/s 2024-01-22T05:13:00.217 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.217 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.217 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246628 s, 42.5 MB/s 2024-01-22T05:13:00.249 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.249 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.249 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277328 s, 37.8 MB/s 2024-01-22T05:13:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.275 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213936 s, 49.0 MB/s 2024-01-22T05:13:00.298 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.298 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.298 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208263 s, 50.3 MB/s 2024-01-22T05:13:00.327 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.327 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.328 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259571 s, 40.4 MB/s 2024-01-22T05:13:00.356 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.356 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.357 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242437 s, 43.3 MB/s 2024-01-22T05:13:00.382 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.382 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.382 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221848 s, 47.3 MB/s 2024-01-22T05:13:00.409 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.410 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.410 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237798 s, 44.1 MB/s 2024-01-22T05:13:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217351 s, 48.2 MB/s 2024-01-22T05:13:00.463 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.463 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.463 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022286 s, 47.1 MB/s 2024-01-22T05:13:00.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.489 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247067 s, 42.4 MB/s 2024-01-22T05:13:00.521 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.521 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.521 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288977 s, 36.3 MB/s 2024-01-22T05:13:00.559 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.559 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.559 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338419 s, 31.0 MB/s 2024-01-22T05:13:00.587 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.587 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.587 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242629 s, 43.2 MB/s 2024-01-22T05:13:00.616 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.616 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.616 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251877 s, 41.6 MB/s 2024-01-22T05:13:00.646 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.647 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.647 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026782 s, 39.2 MB/s 2024-01-22T05:13:00.675 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.676 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.676 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262923 s, 39.9 MB/s 2024-01-22T05:13:00.701 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221704 s, 47.3 MB/s 2024-01-22T05:13:00.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:00.704 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:13:00.705 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:00.705 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.27 2024-01-22T05:13:00.705 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:13:00.705 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:13:00.705 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:13:00.705 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:00.767 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.767 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.767 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338618 s, 31.0 MB/s 2024-01-22T05:13:00.798 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.799 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.799 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271034 s, 38.7 MB/s 2024-01-22T05:13:00.823 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.823 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.823 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224438 s, 46.7 MB/s 2024-01-22T05:13:00.857 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.857 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.857 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306646 s, 34.2 MB/s 2024-01-22T05:13:00.888 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.888 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.888 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260385 s, 40.3 MB/s 2024-01-22T05:13:00.915 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.915 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.915 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228494 s, 45.9 MB/s 2024-01-22T05:13:00.941 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.941 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.941 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022274 s, 47.1 MB/s 2024-01-22T05:13:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.966 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218066 s, 48.1 MB/s 2024-01-22T05:13:00.993 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:00.993 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:00.993 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239554 s, 43.8 MB/s 2024-01-22T05:13:01.021 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.021 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.021 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236321 s, 44.4 MB/s 2024-01-22T05:13:01.051 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.052 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.052 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265154 s, 39.5 MB/s 2024-01-22T05:13:01.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.085 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292932 s, 35.8 MB/s 2024-01-22T05:13:01.120 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.120 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.120 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315002 s, 33.3 MB/s 2024-01-22T05:13:01.143 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.143 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.144 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204351 s, 51.3 MB/s 2024-01-22T05:13:01.170 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.170 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.170 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234263 s, 44.8 MB/s 2024-01-22T05:13:01.196 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.196 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.196 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224159 s, 46.8 MB/s 2024-01-22T05:13:01.223 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.223 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.224 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227574 s, 46.1 MB/s 2024-01-22T05:13:01.252 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.252 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.252 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244754 s, 42.8 MB/s 2024-01-22T05:13:01.278 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.278 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.278 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226282 s, 46.3 MB/s 2024-01-22T05:13:01.305 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.306 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.306 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249552 s, 42.0 MB/s 2024-01-22T05:13:01.335 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.335 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.335 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258027 s, 40.6 MB/s 2024-01-22T05:13:01.363 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.363 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.363 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244431 s, 42.9 MB/s 2024-01-22T05:13:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284586 s, 36.8 MB/s 2024-01-22T05:13:01.431 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.431 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.431 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313701 s, 33.4 MB/s 2024-01-22T05:13:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259374 s, 40.4 MB/s 2024-01-22T05:13:01.491 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.491 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.491 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250232 s, 41.9 MB/s 2024-01-22T05:13:01.515 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.515 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.515 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214914 s, 48.8 MB/s 2024-01-22T05:13:01.540 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.540 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.540 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210467 s, 49.8 MB/s 2024-01-22T05:13:01.568 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.568 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.568 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253142 s, 41.4 MB/s 2024-01-22T05:13:01.598 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.598 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.598 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252836 s, 41.5 MB/s 2024-01-22T05:13:01.624 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.624 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.624 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227141 s, 46.2 MB/s 2024-01-22T05:13:01.655 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.655 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.655 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268752 s, 39.0 MB/s 2024-01-22T05:13:01.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:01.657 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:13:01.657 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:01.657 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.28 2024-01-22T05:13:01.657 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:13:01.658 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:13:01.658 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:13:01.658 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:01.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.714 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262069 s, 40.0 MB/s 2024-01-22T05:13:01.742 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.742 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.742 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246882 s, 42.5 MB/s 2024-01-22T05:13:01.767 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.768 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.768 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224117 s, 46.8 MB/s 2024-01-22T05:13:01.803 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.803 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.803 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309544 s, 33.9 MB/s 2024-01-22T05:13:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.835 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272068 s, 38.5 MB/s 2024-01-22T05:13:01.867 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.867 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.868 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029147 s, 36.0 MB/s 2024-01-22T05:13:01.896 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.897 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.897 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257234 s, 40.8 MB/s 2024-01-22T05:13:01.926 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.926 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.926 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258632 s, 40.5 MB/s 2024-01-22T05:13:01.962 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.962 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.962 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031911 s, 32.9 MB/s 2024-01-22T05:13:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314742 s, 33.3 MB/s 2024-01-22T05:13:02.035 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.035 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.035 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333537 s, 31.4 MB/s 2024-01-22T05:13:02.064 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.064 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.064 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255786 s, 41.0 MB/s 2024-01-22T05:13:02.100 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.100 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.100 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309153 s, 33.9 MB/s 2024-01-22T05:13:02.132 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.132 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.132 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275613 s, 38.0 MB/s 2024-01-22T05:13:02.158 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.158 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.158 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022626 s, 46.3 MB/s 2024-01-22T05:13:02.187 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.187 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.187 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261589 s, 40.1 MB/s 2024-01-22T05:13:02.214 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.214 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.214 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231421 s, 45.3 MB/s 2024-01-22T05:13:02.252 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.252 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.252 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342125 s, 30.6 MB/s 2024-01-22T05:13:02.288 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.289 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.289 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323448 s, 32.4 MB/s 2024-01-22T05:13:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226962 s, 46.2 MB/s 2024-01-22T05:13:02.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.348 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285677 s, 36.7 MB/s 2024-01-22T05:13:02.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.380 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284965 s, 36.8 MB/s 2024-01-22T05:13:02.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.412 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278171 s, 37.7 MB/s 2024-01-22T05:13:02.440 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.440 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.440 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240022 s, 43.7 MB/s 2024-01-22T05:13:02.478 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.478 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.478 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338978 s, 30.9 MB/s 2024-01-22T05:13:02.511 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.511 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.511 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289235 s, 36.3 MB/s 2024-01-22T05:13:02.540 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.540 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.540 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253121 s, 41.4 MB/s 2024-01-22T05:13:02.566 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232079 s, 45.2 MB/s 2024-01-22T05:13:02.595 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.596 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.596 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263466 s, 39.8 MB/s 2024-01-22T05:13:02.634 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.634 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0343955 s, 30.5 MB/s 2024-01-22T05:13:02.661 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.661 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.661 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216084 s, 48.5 MB/s 2024-01-22T05:13:02.691 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.691 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.691 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254373 s, 41.2 MB/s 2024-01-22T05:13:02.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:02.693 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:13:02.693 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:02.693 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.29 2024-01-22T05:13:02.693 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:13:02.693 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:13:02.693 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:13:02.693 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.751 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.751 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243465 s, 43.1 MB/s 2024-01-22T05:13:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278199 s, 37.7 MB/s 2024-01-22T05:13:02.819 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.819 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.819 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340251 s, 30.8 MB/s 2024-01-22T05:13:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287054 s, 36.5 MB/s 2024-01-22T05:13:02.883 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.883 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.883 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260991 s, 40.2 MB/s 2024-01-22T05:13:02.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.914 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269276 s, 38.9 MB/s 2024-01-22T05:13:02.940 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.940 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.940 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022621 s, 46.4 MB/s 2024-01-22T05:13:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254048 s, 41.3 MB/s 2024-01-22T05:13:02.998 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:02.998 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:02.998 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252339 s, 41.6 MB/s 2024-01-22T05:13:03.024 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.024 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.024 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022765 s, 46.1 MB/s 2024-01-22T05:13:03.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.060 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322749 s, 32.5 MB/s 2024-01-22T05:13:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.088 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241521 s, 43.4 MB/s 2024-01-22T05:13:03.118 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.118 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.118 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025219 s, 41.6 MB/s 2024-01-22T05:13:03.149 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.150 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.150 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284403 s, 36.9 MB/s 2024-01-22T05:13:03.190 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.191 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.191 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0364998 s, 28.7 MB/s 2024-01-22T05:13:03.220 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.220 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.220 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256878 s, 40.8 MB/s 2024-01-22T05:13:03.240 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.240 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.240 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163823 s, 64.0 MB/s 2024-01-22T05:13:03.276 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.276 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.276 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0339306 s, 30.9 MB/s 2024-01-22T05:13:03.302 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.302 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.302 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223833 s, 46.8 MB/s 2024-01-22T05:13:03.326 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.326 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.326 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215987 s, 48.5 MB/s 2024-01-22T05:13:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235028 s, 44.6 MB/s 2024-01-22T05:13:03.387 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.388 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312771 s, 33.5 MB/s 2024-01-22T05:13:03.418 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.418 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.418 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260507 s, 40.3 MB/s 2024-01-22T05:13:03.446 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.446 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.446 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246082 s, 42.6 MB/s 2024-01-22T05:13:03.474 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.474 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.474 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246517 s, 42.5 MB/s 2024-01-22T05:13:03.512 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.512 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.512 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334811 s, 31.3 MB/s 2024-01-22T05:13:03.549 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.549 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.549 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334785 s, 31.3 MB/s 2024-01-22T05:13:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238396 s, 44.0 MB/s 2024-01-22T05:13:03.605 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.605 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245386 s, 42.7 MB/s 2024-01-22T05:13:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.632 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023601 s, 44.4 MB/s 2024-01-22T05:13:03.662 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.663 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.663 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277209 s, 37.8 MB/s 2024-01-22T05:13:03.687 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.687 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.687 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020075 s, 52.2 MB/s 2024-01-22T05:13:03.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:03.689 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:13:03.689 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:03.689 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.30 2024-01-22T05:13:03.690 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:13:03.690 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:13:03.690 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:13:03.690 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:03.743 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.744 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.744 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272372 s, 38.5 MB/s 2024-01-22T05:13:03.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.774 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.774 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255122 s, 41.1 MB/s 2024-01-22T05:13:03.803 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.803 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.803 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262759 s, 39.9 MB/s 2024-01-22T05:13:03.828 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.828 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.828 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224551 s, 46.7 MB/s 2024-01-22T05:13:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285521 s, 36.7 MB/s 2024-01-22T05:13:03.889 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.890 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.890 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025112 s, 41.8 MB/s 2024-01-22T05:13:03.920 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.920 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.920 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264302 s, 39.7 MB/s 2024-01-22T05:13:03.953 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.953 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.953 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297208 s, 35.3 MB/s 2024-01-22T05:13:03.980 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:03.981 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:03.981 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245548 s, 42.7 MB/s 2024-01-22T05:13:04.013 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.013 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.013 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279018 s, 37.6 MB/s 2024-01-22T05:13:04.037 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.038 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.038 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021838 s, 48.0 MB/s 2024-01-22T05:13:04.064 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.064 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.064 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219249 s, 47.8 MB/s 2024-01-22T05:13:04.093 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.093 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.094 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249897 s, 42.0 MB/s 2024-01-22T05:13:04.130 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.130 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.130 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324327 s, 32.3 MB/s 2024-01-22T05:13:04.164 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.164 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.164 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300286 s, 34.9 MB/s 2024-01-22T05:13:04.193 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.193 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.193 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251365 s, 41.7 MB/s 2024-01-22T05:13:04.224 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.224 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.224 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270821 s, 38.7 MB/s 2024-01-22T05:13:04.260 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.260 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.260 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320122 s, 32.8 MB/s 2024-01-22T05:13:04.288 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.288 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.288 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239369 s, 43.8 MB/s 2024-01-22T05:13:04.315 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.316 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.316 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245397 s, 42.7 MB/s 2024-01-22T05:13:04.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.347 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276637 s, 37.9 MB/s 2024-01-22T05:13:04.372 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.372 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.372 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227557 s, 46.1 MB/s 2024-01-22T05:13:04.396 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.397 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.397 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021504 s, 48.8 MB/s 2024-01-22T05:13:04.426 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.426 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.426 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257306 s, 40.8 MB/s 2024-01-22T05:13:04.460 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.460 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.460 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308659 s, 34.0 MB/s 2024-01-22T05:13:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229899 s, 45.6 MB/s 2024-01-22T05:13:04.517 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.517 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.517 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248603 s, 42.2 MB/s 2024-01-22T05:13:04.544 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.544 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.545 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241964 s, 43.3 MB/s 2024-01-22T05:13:04.570 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.570 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.571 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219997 s, 47.7 MB/s 2024-01-22T05:13:04.596 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.596 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.596 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223998 s, 46.8 MB/s 2024-01-22T05:13:04.618 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.618 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.618 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191939 s, 54.6 MB/s 2024-01-22T05:13:04.655 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.655 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.655 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0335321 s, 31.3 MB/s 2024-01-22T05:13:04.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:04.657 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:13:04.657 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:04.657 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.31 2024-01-22T05:13:04.657 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:13:04.657 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:13:04.657 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:13:04.657 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261826 s, 40.0 MB/s 2024-01-22T05:13:04.740 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.741 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.741 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230287 s, 45.5 MB/s 2024-01-22T05:13:04.769 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.769 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.769 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025089 s, 41.8 MB/s 2024-01-22T05:13:04.795 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.795 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.795 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232884 s, 45.0 MB/s 2024-01-22T05:13:04.825 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.825 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.825 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258174 s, 40.6 MB/s 2024-01-22T05:13:04.851 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.851 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.851 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216949 s, 48.3 MB/s 2024-01-22T05:13:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210588 s, 49.8 MB/s 2024-01-22T05:13:04.910 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.910 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.910 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311522 s, 33.7 MB/s 2024-01-22T05:13:04.935 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.935 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.935 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213713 s, 49.1 MB/s 2024-01-22T05:13:04.962 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.962 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.962 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226682 s, 46.3 MB/s 2024-01-22T05:13:04.993 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:04.994 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:04.994 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282276 s, 37.1 MB/s 2024-01-22T05:13:05.027 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.027 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.027 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291734 s, 35.9 MB/s 2024-01-22T05:13:05.055 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.055 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.056 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254617 s, 41.2 MB/s 2024-01-22T05:13:05.082 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.082 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.082 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240088 s, 43.7 MB/s 2024-01-22T05:13:05.119 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.119 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.119 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326799 s, 32.1 MB/s 2024-01-22T05:13:05.146 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.146 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.146 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233367 s, 44.9 MB/s 2024-01-22T05:13:05.174 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.175 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.175 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249558 s, 42.0 MB/s 2024-01-22T05:13:05.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.202 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247309 s, 42.4 MB/s 2024-01-22T05:13:05.230 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.230 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.230 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241072 s, 43.5 MB/s 2024-01-22T05:13:05.259 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.259 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.259 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266322 s, 39.4 MB/s 2024-01-22T05:13:05.290 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.290 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.290 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266121 s, 39.4 MB/s 2024-01-22T05:13:05.315 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.315 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.315 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221705 s, 47.3 MB/s 2024-01-22T05:13:05.345 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.345 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.345 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252129 s, 41.6 MB/s 2024-01-22T05:13:05.370 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.370 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.370 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219564 s, 47.8 MB/s 2024-01-22T05:13:05.397 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.398 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.398 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246379 s, 42.6 MB/s 2024-01-22T05:13:05.432 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.432 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.432 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307753 s, 34.1 MB/s 2024-01-22T05:13:05.460 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.460 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.460 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243977 s, 43.0 MB/s 2024-01-22T05:13:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.491 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277072 s, 37.8 MB/s 2024-01-22T05:13:05.520 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.520 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.520 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256617 s, 40.9 MB/s 2024-01-22T05:13:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330241 s, 31.8 MB/s 2024-01-22T05:13:05.583 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.583 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.583 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253437 s, 41.4 MB/s 2024-01-22T05:13:05.609 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:05.609 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:05.609 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236981 s, 44.2 MB/s 2024-01-22T05:13:05.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub start /scrub_control_test_path recursive 2024-01-22T05:13:05.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.773+0000 7ff776800700 1 Processor -- start 2024-01-22T05:13:05.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.773+0000 7ff776800700 1 -- start start 2024-01-22T05:13:05.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff776800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff770152870 0x7ff77014f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff776800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff770067ef0 0x7ff7700bc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff776800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff770155d30 con 0x7ff770067a90 2024-01-22T05:13:05.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff776800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff770063240 con 0x7ff770067ef0 2024-01-22T05:13:05.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff776800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff770059890 con 0x7ff770152870 2024-01-22T05:13:05.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff76fe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff770067ef0 0x7ff7700bc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff76f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff770152870 0x7ff77014f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff76ea00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff770067a90 0x7ff7700bbcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:54206/0 (socket says 172.21.15.49:54206) 2024-01-22T05:13:05.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff76f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff770152870 0x7ff77014f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:43950/0 (socket says 172.21.15.49:43950) 2024-01-22T05:13:05.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff76ea00700 1 -- 172.21.15.49:0/2569787664 learned_addr learned my addr 172.21.15.49:0/2569787664 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:05.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff76fe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff770067ef0 0x7ff7700bc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:38636/0 (socket says 172.21.15.49:38636) 2024-01-22T05:13:05.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff76f400700 1 -- 172.21.15.49:0/2569787664 >> v2:172.21.15.110:3300/0 conn(0x7ff770067ef0 msgr2=0x7ff7700bc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:05.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff76f400700 1 --2- 172.21.15.49:0/2569787664 >> v2:172.21.15.110:3300/0 conn(0x7ff770067ef0 0x7ff7700bc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff76f400700 1 -- 172.21.15.49:0/2569787664 >> v1:172.21.15.110:6789/0 conn(0x7ff770067a90 legacy=0x7ff7700bbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:05.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff76f400700 1 -- 172.21.15.49:0/2569787664 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7700683a0 con 0x7ff770152870 2024-01-22T05:13:05.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff76e000700 1 -- 172.21.15.49:0/2569787664 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192226826 0 0) 0x7ff770155d30 con 0x7ff770067a90 2024-01-22T05:13:05.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff76f400700 1 --2- 172.21.15.49:0/2569787664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff770152870 0x7ff77014f290 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7ff760009760 tx=0x7ff760009060).ready entity=mon.2 client_cookie=54200f7b39320917 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.777+0000 7ff76e000700 1 -- 172.21.15.49:0/2569787664 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76000f510 con 0x7ff770152870 2024-01-22T05:13:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.781+0000 7ff76e000700 1 -- 172.21.15.49:0/2569787664 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76000f670 con 0x7ff770152870 2024-01-22T05:13:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.781+0000 7ff76e000700 1 -- 172.21.15.49:0/2569787664 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76000f9f0 con 0x7ff770152870 2024-01-22T05:13:05.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.781+0000 7ff776800700 1 -- 172.21.15.49:0/2569787664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff770152870 msgr2=0x7ff77014f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:05.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.781+0000 7ff776800700 1 --2- 172.21.15.49:0/2569787664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff770152870 0x7ff77014f290 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7ff760009760 tx=0x7ff760009060).stop 2024-01-22T05:13:05.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.781+0000 7ff776800700 1 -- 172.21.15.49:0/2569787664 shutdown_connections 2024-01-22T05:13:05.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.781+0000 7ff776800700 1 --2- 172.21.15.49:0/2569787664 >> v2:172.21.15.110:3300/0 conn(0x7ff770067ef0 0x7ff7700bc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.781+0000 7ff776800700 1 --2- 172.21.15.49:0/2569787664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff770152870 0x7ff77014f290 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.781+0000 7ff776800700 1 -- 172.21.15.49:0/2569787664 >> 172.21.15.49:0/2569787664 conn(0x7ff7700c3830 msgr2=0x7ff7700c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:05.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.781+0000 7ff776800700 1 -- 172.21.15.49:0/2569787664 shutdown_connections 2024-01-22T05:13:05.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.781+0000 7ff776800700 1 -- 172.21.15.49:0/2569787664 wait complete. 2024-01-22T05:13:05.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.785+0000 7ff776800700 1 Processor -- start 2024-01-22T05:13:05.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.785+0000 7ff776800700 1 -- start start 2024-01-22T05:13:05.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.785+0000 7ff776800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff770067a90 0x7ff77013e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.785+0000 7ff776800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff770067ef0 0x7ff7700a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.785+0000 7ff776800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7700bde30 0x7ff770150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.785+0000 7ff776800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700be2c0 con 0x7ff770067ef0 2024-01-22T05:13:05.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.785+0000 7ff776800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700be5a0 con 0x7ff7700bde30 2024-01-22T05:13:05.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.785+0000 7ff776800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700be880 con 0x7ff770067a90 2024-01-22T05:13:05.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.785+0000 7ff76ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff770067ef0 0x7ff7700a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.789+0000 7ff76f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff770067a90 0x7ff77013e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.789+0000 7ff76ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff770067ef0 0x7ff7700a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60782/0 (socket says 172.21.15.49:60782) 2024-01-22T05:13:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.789+0000 7ff76ea00700 1 -- 172.21.15.49:0/1063996455 learned_addr learned my addr 172.21.15.49:0/1063996455 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.789+0000 7ff76fe00700 1 --2- 172.21.15.49:0/1063996455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7700bde30 0x7ff770150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.789+0000 7ff76ea00700 1 -- 172.21.15.49:0/1063996455 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff770067a90 msgr2=0x7ff77013e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.789+0000 7ff76ea00700 1 --2- 172.21.15.49:0/1063996455 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff770067a90 0x7ff77013e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.789+0000 7ff76ea00700 1 -- 172.21.15.49:0/1063996455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7700bde30 msgr2=0x7ff770150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.789+0000 7ff76ea00700 1 --2- 172.21.15.49:0/1063996455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7700bde30 0x7ff770150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.789+0000 7ff76ea00700 1 -- 172.21.15.49:0/1063996455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7600092a0 con 0x7ff770067ef0 2024-01-22T05:13:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.789+0000 7ff76ea00700 1 --2- 172.21.15.49:0/1063996455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff770067ef0 0x7ff7700a84d0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7ff75800c4a0 tx=0x7ff758007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:05.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.789+0000 7ff766a00700 1 -- 172.21.15.49:0/1063996455 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75800ce50 con 0x7ff770067ef0 2024-01-22T05:13:05.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.789+0000 7ff776800700 1 -- 172.21.15.49:0/1063996455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7700beb60 con 0x7ff770067ef0 2024-01-22T05:13:05.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.789+0000 7ff766a00700 1 -- 172.21.15.49:0/1063996455 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7580072e0 con 0x7ff770067ef0 2024-01-22T05:13:05.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.789+0000 7ff766a00700 1 -- 172.21.15.49:0/1063996455 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758007660 con 0x7ff770067ef0 2024-01-22T05:13:05.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.789+0000 7ff776800700 1 -- 172.21.15.49:0/1063996455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77013ec00 con 0x7ff770067ef0 2024-01-22T05:13:05.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.793+0000 7ff766a00700 1 -- 172.21.15.49:0/1063996455 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff7580059b0 con 0x7ff770067ef0 2024-01-22T05:13:05.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.793+0000 7ff766a00700 1 --2- 172.21.15.49:0/1063996455 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff74805a510 0x7ff74805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.793+0000 7ff766a00700 1 -- 172.21.15.49:0/1063996455 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff758074040 con 0x7ff770067ef0 2024-01-22T05:13:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.793+0000 7ff76f400700 1 --2- 172.21.15.49:0/1063996455 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff74805a510 0x7ff74805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.793+0000 7ff76f400700 1 --2- 172.21.15.49:0/1063996455 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff74805a510 0x7ff74805c9d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7ff760009fd0 tx=0x7ff760017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:05.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.797+0000 7ff780bcc740 1 Processor -- start 2024-01-22T05:13:05.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.797+0000 7ff780bcc740 1 -- start start 2024-01-22T05:13:05.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.797+0000 7ff780bcc740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 0x16ba400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.797+0000 7ff780bcc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1676a10 0x16b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff780bcc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169cb30 0x16b7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff780bcc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x15e1780 con 0x1676a10 2024-01-22T05:13:05.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff780bcc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x15c2340 con 0x169cb30 2024-01-22T05:13:05.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff780bcc740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x15a9530 con 0x16ba020 2024-01-22T05:13:05.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff76ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1676a10 0x16b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff76ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1676a10 0x16b7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60784/0 (socket says 172.21.15.49:60784) 2024-01-22T05:13:05.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff76ea00700 1 -- 172.21.15.49:0/652596985 learned_addr learned my addr 172.21.15.49:0/652596985 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:05.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff76f400700 1 --2- 172.21.15.49:0/652596985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 0x16ba400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff76fe00700 1 --2- 172.21.15.49:0/652596985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169cb30 0x16b7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff76ea00700 1 -- 172.21.15.49:0/652596985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 msgr2=0x16ba400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:05.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff76ea00700 1 --2- 172.21.15.49:0/652596985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 0x16ba400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff76ea00700 1 -- 172.21.15.49:0/652596985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169cb30 msgr2=0x16b7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:05.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff76ea00700 1 --2- 172.21.15.49:0/652596985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169cb30 0x16b7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff76ea00700 1 -- 172.21.15.49:0/652596985 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1602700 con 0x1676a10 2024-01-22T05:13:05.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff76ea00700 1 --2- 172.21.15.49:0/652596985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1676a10 0x16b7ae0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7ff75804af40 tx=0x7ff75800f000).ready entity=mon.0 client_cookie=a4d588c46ab88aec server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:05.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff75f400700 1 -- 172.21.15.49:0/652596985 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758049720 con 0x1676a10 2024-01-22T05:13:05.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff75f400700 1 -- 172.21.15.49:0/652596985 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff758047a90 con 0x1676a10 2024-01-22T05:13:05.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff75f400700 1 -- 172.21.15.49:0/652596985 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758005e90 con 0x1676a10 2024-01-22T05:13:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff780bcc740 1 -- 172.21.15.49:0/652596985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1676a10 msgr2=0x16b7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff780bcc740 1 --2- 172.21.15.49:0/652596985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1676a10 0x16b7ae0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7ff75804af40 tx=0x7ff75800f000).stop 2024-01-22T05:13:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff780bcc740 1 -- 172.21.15.49:0/652596985 shutdown_connections 2024-01-22T05:13:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff780bcc740 1 --2- 172.21.15.49:0/652596985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169cb30 0x16b7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff780bcc740 1 --2- 172.21.15.49:0/652596985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1676a10 0x16b7ae0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff780bcc740 1 --2- 172.21.15.49:0/652596985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 0x16ba400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff780bcc740 1 -- 172.21.15.49:0/652596985 >> 172.21.15.49:0/652596985 conn(0x1455920 msgr2=0x1676fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff780bcc740 1 -- 172.21.15.49:0/652596985 shutdown_connections 2024-01-22T05:13:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.801+0000 7ff780bcc740 1 -- 172.21.15.49:0/652596985 wait complete. 2024-01-22T05:13:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.805+0000 7ff780bcc740 1 -- start start 2024-01-22T05:13:05.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.805+0000 7ff780bcc740 1 Processor -- start 2024-01-22T05:13:05.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff780bcc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x169cb30 0x169fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff780bcc740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 0x16a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff780bcc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169a9f0 0x16a3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff780bcc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x16a3650 con 0x169cb30 2024-01-22T05:13:05.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff780bcc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x16a1670 con 0x169a9f0 2024-01-22T05:13:05.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff780bcc740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x16a10b0 con 0x16ba020 2024-01-22T05:13:05.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff780bcc740 10 client.0 ll_register_callbacks cb 0x162de40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:13:05.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff76f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x169cb30 0x169fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff76f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x169cb30 0x169fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60790/0 (socket says 172.21.15.49:60790) 2024-01-22T05:13:05.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff76f400700 1 -- 172.21.15.49:0/3823277751 learned_addr learned my addr 172.21.15.49:0/3823277751 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:05.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff76fe00700 1 --2- 172.21.15.49:0/3823277751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169a9f0 0x16a3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff76ea00700 1 --2- 172.21.15.49:0/3823277751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 0x16a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff76f400700 1 -- 172.21.15.49:0/3823277751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 msgr2=0x16a2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:05.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff76f400700 1 --2- 172.21.15.49:0/3823277751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 0x16a2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff76f400700 1 -- 172.21.15.49:0/3823277751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169a9f0 msgr2=0x16a3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:05.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff76f400700 1 --2- 172.21.15.49:0/3823277751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169a9f0 0x16a3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff76f400700 1 -- 172.21.15.49:0/3823277751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77013ec00 con 0x169cb30 2024-01-22T05:13:05.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff76ea00700 1 --2- 172.21.15.49:0/3823277751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 0x16a2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:13:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff76f400700 1 --2- 172.21.15.49:0/3823277751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x169cb30 0x169fb80 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7ff760009e00 tx=0x7ff76001e040).ready entity=mon.0 client_cookie=b3689551e0a6e4ec server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff757e00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:13:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff757e00700 1 -- 172.21.15.49:0/3823277751 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7600276f0 con 0x169cb30 2024-01-22T05:13:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff757e00700 1 -- 172.21.15.49:0/3823277751 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff760027850 con 0x169cb30 2024-01-22T05:13:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff780bcc740 1 -- 172.21.15.49:0/3823277751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x15ece20 con 0x169cb30 2024-01-22T05:13:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff757e00700 1 -- 172.21.15.49:0/3823277751 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff760027c20 con 0x169cb30 2024-01-22T05:13:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff780bcc740 10 client.7455 fetch_fsmap learned FSMap version 90 2024-01-22T05:13:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff780bcc740 1 -- 172.21.15.49:0/3823277751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x15f03b0 con 0x169cb30 2024-01-22T05:13:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff757e00700 1 -- 172.21.15.49:0/3823277751 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x15ece20 con 0x169cb30 2024-01-22T05:13:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff757e00700 1 -- 172.21.15.49:0/3823277751 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 90) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff760011400 con 0x169cb30 2024-01-22T05:13:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.809+0000 7ff780bcc740 10 client.7455 fetch_fsmap finished waiting for FSMap version 90 2024-01-22T05:13:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff780bcc740 10 client.7455 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-01-22T05:13:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff780bcc740 20 client.7455 populate_metadata read hostname 'smithi049' 2024-01-22T05:13:05.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff780bcc740 1 --2- 172.21.15.49:0/3823277751 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x16b6840 0x16b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff780bcc740 4 client.7455 mds_command: new command op to 7287 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:13:05.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff780bcc740 1 -- 172.21.15.49:0/3823277751 --> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x15e3370 con 0x16b6840 2024-01-22T05:13:05.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff76ea00700 1 --2- 172.21.15.49:0/3823277751 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x16b6840 0x16b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff757e00700 10 client.7455 ms_handle_connect on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:05.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff76ea00700 1 --2- 172.21.15.49:0/3823277751 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x16b6840 0x16b6c50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=bf4fe4442ee9dabb server_cookie=b02ca70cc666b2a9 in_seq=0 out_seq=0 2024-01-22T05:13:05.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff757e00700 1 -- 172.21.15.49:0/3823277751 <== mds.0 v2:172.21.15.49:6835/1226995696 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x15e3370 con 0x16b6840 2024-01-22T05:13:05.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff757e00700 10 client.7455 handle_command_reply: tid=0 2024-01-22T05:13:05.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff780bcc740 1 client.7455 shutdown 2024-01-22T05:13:05.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff780bcc740 1 -- 172.21.15.49:0/3823277751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x169cb30 msgr2=0x169fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:05.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff780bcc740 1 --2- 172.21.15.49:0/3823277751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x169cb30 0x169fb80 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7ff760009e00 tx=0x7ff76001e040).stop 2024-01-22T05:13:05.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff780bcc740 1 -- 172.21.15.49:0/3823277751 shutdown_connections 2024-01-22T05:13:05.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff780bcc740 1 --2- 172.21.15.49:0/3823277751 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x16b6840 0x16b6c50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff780bcc740 1 --2- 172.21.15.49:0/3823277751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169a9f0 0x16a3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff780bcc740 1 --2- 172.21.15.49:0/3823277751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 0x16a2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff780bcc740 1 --2- 172.21.15.49:0/3823277751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x169cb30 0x169fb80 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff757e00700 0 client.7455 ms_handle_reset on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:05.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.813+0000 7ff780bcc740 1 -- 172.21.15.49:0/3823277751 >> 172.21.15.49:0/3823277751 conn(0x1455920 msgr2=0x16bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:05.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.817+0000 7ff780bcc740 1 -- 172.21.15.49:0/3823277751 shutdown_connections 2024-01-22T05:13:05.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.817+0000 7ff780bcc740 1 -- 172.21.15.49:0/3823277751 wait complete. 2024-01-22T05:13:05.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.817+0000 7ff780bcc740 20 client.7455 trim_cache size 0 max 16384 2024-01-22T05:13:05.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff780bcc740 1 Processor -- start 2024-01-22T05:13:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff780bcc740 1 -- start start 2024-01-22T05:13:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff780bcc740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x169a9f0 0x169fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff780bcc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169cb30 0x16bcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff780bcc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16ba020 0x169c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff780bcc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1672260 con 0x16ba020 2024-01-22T05:13:05.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff780bcc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1671ce0 con 0x169cb30 2024-01-22T05:13:05.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff780bcc740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x16be120 con 0x169a9f0 2024-01-22T05:13:05.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff76fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16ba020 0x169c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff76fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16ba020 0x169c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60800/0 (socket says 172.21.15.49:60800) 2024-01-22T05:13:05.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff76fe00700 1 -- 172.21.15.49:0/3331557147 learned_addr learned my addr 172.21.15.49:0/3331557147 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:05.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff76f400700 1 --2- 172.21.15.49:0/3331557147 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x169a9f0 0x169fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff76ea00700 1 --2- 172.21.15.49:0/3331557147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169cb30 0x16bcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff76fe00700 1 -- 172.21.15.49:0/3331557147 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x169a9f0 msgr2=0x169fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:05.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff76fe00700 1 --2- 172.21.15.49:0/3331557147 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x169a9f0 0x169fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff76fe00700 1 -- 172.21.15.49:0/3331557147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169cb30 msgr2=0x16bcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:05.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff76fe00700 1 --2- 172.21.15.49:0/3331557147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169cb30 0x16bcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff76fe00700 1 -- 172.21.15.49:0/3331557147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7701510a0 con 0x16ba020 2024-01-22T05:13:05.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff76f400700 1 --2- 172.21.15.49:0/3331557147 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x169a9f0 0x169fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:05.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff76fe00700 1 --2- 172.21.15.49:0/3331557147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16ba020 0x169c0e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7ff768007850 tx=0x7ff76800b040).ready entity=mon.0 client_cookie=f350356560862b8e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:05.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.837+0000 7ff75fe00700 1 -- 172.21.15.49:0/3331557147 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76800e040 con 0x16ba020 2024-01-22T05:13:05.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.841+0000 7ff75fe00700 1 -- 172.21.15.49:0/3331557147 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76800f040 con 0x16ba020 2024-01-22T05:13:05.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.841+0000 7ff75fe00700 1 -- 172.21.15.49:0/3331557147 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff768017a00 con 0x16ba020 2024-01-22T05:13:05.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.841+0000 7ff780bcc740 1 -- 172.21.15.49:0/3331557147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16ba020 msgr2=0x169c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:05.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.841+0000 7ff780bcc740 1 --2- 172.21.15.49:0/3331557147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16ba020 0x169c0e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7ff768007850 tx=0x7ff76800b040).stop 2024-01-22T05:13:05.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.841+0000 7ff780bcc740 1 -- 172.21.15.49:0/3331557147 shutdown_connections 2024-01-22T05:13:05.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.841+0000 7ff780bcc740 1 --2- 172.21.15.49:0/3331557147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16ba020 0x169c0e0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.841+0000 7ff780bcc740 1 --2- 172.21.15.49:0/3331557147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169cb30 0x16bcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.841+0000 7ff780bcc740 1 --2- 172.21.15.49:0/3331557147 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x169a9f0 0x169fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.841+0000 7ff780bcc740 1 -- 172.21.15.49:0/3331557147 >> 172.21.15.49:0/3331557147 conn(0x1455920 msgr2=0x1675bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:05.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.841+0000 7ff780bcc740 1 -- 172.21.15.49:0/3331557147 shutdown_connections 2024-01-22T05:13:05.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.841+0000 7ff780bcc740 1 -- 172.21.15.49:0/3331557147 wait complete. 2024-01-22T05:13:05.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.841+0000 7ff780bcc740 1 -- start start 2024-01-22T05:13:05.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.845+0000 7ff780bcc740 1 Processor -- start 2024-01-22T05:13:05.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.845+0000 7ff780bcc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169a9f0 0x169b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.845+0000 7ff780bcc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x169cb30 0x169b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.845+0000 7ff780bcc740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 0x1695d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.845+0000 7ff780bcc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x169bbe0 con 0x169cb30 2024-01-22T05:13:05.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.845+0000 7ff780bcc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1698ad0 con 0x169a9f0 2024-01-22T05:13:05.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.845+0000 7ff780bcc740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1697300 con 0x16ba020 2024-01-22T05:13:05.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.845+0000 7ff780bcc740 10 client.0 ll_register_callbacks cb 0x7ff760000db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:13:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.845+0000 7ff76ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x169cb30 0x169b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.845+0000 7ff76ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x169cb30 0x169b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60806/0 (socket says 172.21.15.49:60806) 2024-01-22T05:13:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.845+0000 7ff76ea00700 1 -- 172.21.15.49:0/2535884888 learned_addr learned my addr 172.21.15.49:0/2535884888 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.845+0000 7ff76fe00700 1 --2- 172.21.15.49:0/2535884888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 0x1695d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.845+0000 7ff76f400700 1 --2- 172.21.15.49:0/2535884888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169a9f0 0x169b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff76ea00700 1 -- 172.21.15.49:0/2535884888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 msgr2=0x1695d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff76ea00700 1 --2- 172.21.15.49:0/2535884888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 0x1695d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff76ea00700 1 -- 172.21.15.49:0/2535884888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169a9f0 msgr2=0x169b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff76ea00700 1 --2- 172.21.15.49:0/2535884888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169a9f0 0x169b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff76ea00700 1 -- 172.21.15.49:0/2535884888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff768007580 con 0x169cb30 2024-01-22T05:13:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff76ea00700 1 --2- 172.21.15.49:0/2535884888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x169cb30 0x169b6f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7ff758052010 tx=0x7ff75805b040).ready entity=mon.0 client_cookie=b066ce4c994b89bf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff757e00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:13:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff757e00700 1 -- 172.21.15.49:0/2535884888 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758060070 con 0x169cb30 2024-01-22T05:13:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff757e00700 1 -- 172.21.15.49:0/2535884888 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff758047c00 con 0x169cb30 2024-01-22T05:13:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff780bcc740 1 -- 172.21.15.49:0/2535884888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff758047a90 con 0x169cb30 2024-01-22T05:13:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff757e00700 1 -- 172.21.15.49:0/2535884888 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff758064280 con 0x169cb30 2024-01-22T05:13:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff780bcc740 10 client.7461 fetch_fsmap learned FSMap version 90 2024-01-22T05:13:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff780bcc740 1 -- 172.21.15.49:0/2535884888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x15eb5e0 con 0x169cb30 2024-01-22T05:13:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff757e00700 1 -- 172.21.15.49:0/2535884888 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff758047a90 con 0x169cb30 2024-01-22T05:13:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff757e00700 1 -- 172.21.15.49:0/2535884888 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 90) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff75806d020 con 0x169cb30 2024-01-22T05:13:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff780bcc740 10 client.7461 fetch_fsmap finished waiting for FSMap version 90 2024-01-22T05:13:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff780bcc740 10 client.7461 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-01-22T05:13:05.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff780bcc740 20 client.7461 populate_metadata read hostname 'smithi049' 2024-01-22T05:13:05.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff780bcc740 1 --2- 172.21.15.49:0/2535884888 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x16bd620 0x16961f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:05.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff780bcc740 4 client.7461 mds_command: new command op to 7287 tid=0[{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-01-22T05:13:05.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff780bcc740 1 -- 172.21.15.49:0/2535884888 --> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x14ac8b0 con 0x16bd620 2024-01-22T05:13:05.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff76f400700 1 --2- 172.21.15.49:0/2535884888 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x16bd620 0x16961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:05.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff757e00700 10 client.7461 ms_handle_connect on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:05.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.849+0000 7ff76f400700 1 --2- 172.21.15.49:0/2535884888 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x16bd620 0x16961f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c82c636213b33e25 server_cookie=285e5472f07beef3 in_seq=0 out_seq=0 2024-01-22T05:13:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.853+0000 7ff757e00700 1 -- 172.21.15.49:0/2535884888 <== mds.0 v2:172.21.15.49:6835/1226995696 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x14ac8b0 con 0x16bd620 2024-01-22T05:13:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.853+0000 7ff757e00700 10 client.7461 handle_command_reply: tid=0 2024-01-22T05:13:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.853+0000 7ff780bcc740 1 client.7461 shutdown 2024-01-22T05:13:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff780bcc740 1 -- 172.21.15.49:0/2535884888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x169cb30 msgr2=0x169b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff780bcc740 1 --2- 172.21.15.49:0/2535884888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x169cb30 0x169b6f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7ff758052010 tx=0x7ff75805b040).stop 2024-01-22T05:13:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff780bcc740 1 -- 172.21.15.49:0/2535884888 shutdown_connections 2024-01-22T05:13:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff780bcc740 1 --2- 172.21.15.49:0/2535884888 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x16bd620 0x16961f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff780bcc740 1 --2- 172.21.15.49:0/2535884888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16ba020 0x1695d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff780bcc740 1 --2- 172.21.15.49:0/2535884888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x169cb30 0x169b6f0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff780bcc740 1 --2- 172.21.15.49:0/2535884888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x169a9f0 0x169b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff757e00700 0 client.7461 ms_handle_reset on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff780bcc740 1 -- 172.21.15.49:0/2535884888 >> 172.21.15.49:0/2535884888 conn(0x1455920 msgr2=0x1675bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff780bcc740 1 -- 172.21.15.49:0/2535884888 shutdown_connections 2024-01-22T05:13:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff780bcc740 1 -- 172.21.15.49:0/2535884888 wait complete. 2024-01-22T05:13:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff780bcc740 20 client.7461 trim_cache size 0 max 16384 2024-01-22T05:13:05.862 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:13:05.862 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:13:05.862 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "966d164b-f07b-44bc-bc81-68e47c2572d5", 2024-01-22T05:13:05.862 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:13:05.862 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:13:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff776800700 1 -- 172.21.15.49:0/1063996455 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff74805a510 msgr2=0x7ff74805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff776800700 1 --2- 172.21.15.49:0/1063996455 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff74805a510 0x7ff74805c9d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7ff760009fd0 tx=0x7ff760017000).stop 2024-01-22T05:13:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff776800700 1 -- 172.21.15.49:0/1063996455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff770067ef0 msgr2=0x7ff7700a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff776800700 1 --2- 172.21.15.49:0/1063996455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff770067ef0 0x7ff7700a84d0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7ff75800c4a0 tx=0x7ff758007c30).stop 2024-01-22T05:13:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff776800700 1 -- 172.21.15.49:0/1063996455 shutdown_connections 2024-01-22T05:13:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff776800700 1 --2- 172.21.15.49:0/1063996455 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff74805a510 0x7ff74805c9d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff776800700 1 --2- 172.21.15.49:0/1063996455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7700bde30 0x7ff770150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff776800700 1 --2- 172.21.15.49:0/1063996455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff770067ef0 0x7ff7700a84d0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff776800700 1 --2- 172.21.15.49:0/1063996455 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff770067a90 0x7ff77013e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff776800700 1 -- 172.21.15.49:0/1063996455 >> 172.21.15.49:0/1063996455 conn(0x7ff7700c3830 msgr2=0x7ff7700c4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff776800700 1 -- 172.21.15.49:0/1063996455 shutdown_connections 2024-01-22T05:13:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:05.857+0000 7ff776800700 1 -- 172.21.15.49:0/1063996455 wait complete. 2024-01-22T05:13:05.889 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub abort 2024-01-22T05:13:06.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.069+0000 7f2b86c00700 1 Processor -- start 2024-01-22T05:13:06.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.073+0000 7f2b86c00700 1 -- start start 2024-01-22T05:13:06.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.073+0000 7f2b86c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b80151900 0x7f2b80063e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.073+0000 7f2b86c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2b80064370 0x7f2b800bc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b86c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b80155cc0 con 0x7f2b800a9da0 2024-01-22T05:13:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b86c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b80064800 con 0x7f2b80064370 2024-01-22T05:13:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b86c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b80069320 con 0x7f2b80151900 2024-01-22T05:13:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b84c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2b80064370 0x7f2b800bc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b7f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b80151900 0x7f2b80063e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b7fe00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2b800a9da0 0x7f2b80068ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:54210/0 (socket says 172.21.15.49:54210) 2024-01-22T05:13:06.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b7fe00700 1 -- 172.21.15.49:0/1147529466 learned_addr learned my addr 172.21.15.49:0/1147529466 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:06.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b84c00700 1 -- 172.21.15.49:0/1147529466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b80151900 msgr2=0x7f2b80063e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b84c00700 1 --2- 172.21.15.49:0/1147529466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b80151900 0x7f2b80063e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b84c00700 1 -- 172.21.15.49:0/1147529466 >> v1:172.21.15.110:6789/0 conn(0x7f2b800a9da0 legacy=0x7f2b80068ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b84c00700 1 -- 172.21.15.49:0/1147529466 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b80069600 con 0x7f2b80064370 2024-01-22T05:13:06.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b7ea00700 1 -- 172.21.15.49:0/1147529466 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276552453 0 0) 0x7f2b80155cc0 con 0x7f2b800a9da0 2024-01-22T05:13:06.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b84c00700 1 --2- 172.21.15.49:0/1147529466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b80064370 0x7f2b800bc5b0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f2b78009e60 tx=0x7f2b78009780).ready entity=mon.0 client_cookie=3d4591e3cfc49a0e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:06.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b7ea00700 1 -- 172.21.15.49:0/1147529466 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7800e070 con 0x7f2b80064370 2024-01-22T05:13:06.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b7ea00700 1 -- 172.21.15.49:0/1147529466 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7800bb60 con 0x7f2b80064370 2024-01-22T05:13:06.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b7ea00700 1 -- 172.21.15.49:0/1147529466 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78012410 con 0x7f2b80064370 2024-01-22T05:13:06.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b86c00700 1 -- 172.21.15.49:0/1147529466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b80064370 msgr2=0x7f2b800bc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.077+0000 7f2b86c00700 1 --2- 172.21.15.49:0/1147529466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b80064370 0x7f2b800bc5b0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f2b78009e60 tx=0x7f2b78009780).stop 2024-01-22T05:13:06.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.081+0000 7f2b86c00700 1 -- 172.21.15.49:0/1147529466 shutdown_connections 2024-01-22T05:13:06.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.081+0000 7f2b86c00700 1 --2- 172.21.15.49:0/1147529466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b80064370 0x7f2b800bc5b0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.081+0000 7f2b86c00700 1 --2- 172.21.15.49:0/1147529466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b80151900 0x7f2b80063e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.081+0000 7f2b86c00700 1 -- 172.21.15.49:0/1147529466 >> 172.21.15.49:0/1147529466 conn(0x7f2b80067290 msgr2=0x7f2b800c7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:06.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.081+0000 7f2b86c00700 1 -- 172.21.15.49:0/1147529466 shutdown_connections 2024-01-22T05:13:06.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.081+0000 7f2b86c00700 1 -- 172.21.15.49:0/1147529466 wait complete. 2024-01-22T05:13:06.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.081+0000 7f2b86c00700 1 Processor -- start 2024-01-22T05:13:06.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.085+0000 7f2b86c00700 1 -- start start 2024-01-22T05:13:06.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.085+0000 7f2b86c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b80064370 0x7f2b80167d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.085+0000 7f2b86c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b800a9da0 0x7f2b800c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.085+0000 7f2b86c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b80151900 0x7f2b800c2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.085+0000 7f2b86c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b800c3db0 con 0x7f2b80064370 2024-01-22T05:13:06.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.085+0000 7f2b86c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b800c3920 con 0x7f2b800a9da0 2024-01-22T05:13:06.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.085+0000 7f2b86c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b800c2d10 con 0x7f2b80151900 2024-01-22T05:13:06.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.085+0000 7f2b7fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b80064370 0x7f2b80167d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.085+0000 7f2b7fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b80064370 0x7f2b80167d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60820/0 (socket says 172.21.15.49:60820) 2024-01-22T05:13:06.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.085+0000 7f2b7fe00700 1 -- 172.21.15.49:0/2902522788 learned_addr learned my addr 172.21.15.49:0/2902522788 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:06.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.085+0000 7f2b84c00700 1 --2- 172.21.15.49:0/2902522788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b80151900 0x7f2b800c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.085+0000 7f2b7f400700 1 --2- 172.21.15.49:0/2902522788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b800a9da0 0x7f2b800c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.089+0000 7f2b7fe00700 1 -- 172.21.15.49:0/2902522788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b80151900 msgr2=0x7f2b800c2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.089+0000 7f2b7fe00700 1 --2- 172.21.15.49:0/2902522788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b80151900 0x7f2b800c2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.089+0000 7f2b7fe00700 1 -- 172.21.15.49:0/2902522788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b800a9da0 msgr2=0x7f2b800c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.089+0000 7f2b7fe00700 1 --2- 172.21.15.49:0/2902522788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b800a9da0 0x7f2b800c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.089+0000 7f2b7fe00700 1 -- 172.21.15.49:0/2902522788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b78009a20 con 0x7f2b80064370 2024-01-22T05:13:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.089+0000 7f2b7fe00700 1 --2- 172.21.15.49:0/2902522788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b80064370 0x7f2b80167d50 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f2b7000c510 tx=0x7f2b70007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.089+0000 7f2b77400700 1 -- 172.21.15.49:0/2902522788 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7000ce80 con 0x7f2b80064370 2024-01-22T05:13:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.089+0000 7f2b77400700 1 -- 172.21.15.49:0/2902522788 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b700072e0 con 0x7f2b80064370 2024-01-22T05:13:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.089+0000 7f2b77400700 1 -- 172.21.15.49:0/2902522788 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70007660 con 0x7f2b80064370 2024-01-22T05:13:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.089+0000 7f2b86c00700 1 -- 172.21.15.49:0/2902522788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b800c2ff0 con 0x7f2b80064370 2024-01-22T05:13:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.089+0000 7f2b86c00700 1 -- 172.21.15.49:0/2902522788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b800c35b0 con 0x7f2b80064370 2024-01-22T05:13:06.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.093+0000 7f2b77400700 1 -- 172.21.15.49:0/2902522788 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2b700059b0 con 0x7f2b80064370 2024-01-22T05:13:06.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.093+0000 7f2b77400700 1 --2- 172.21.15.49:0/2902522788 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2b5805a4e0 0x7f2b5805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.093+0000 7f2b77400700 1 -- 172.21.15.49:0/2902522788 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2b70073fd0 con 0x7f2b80064370 2024-01-22T05:13:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.093+0000 7f2b7f400700 1 --2- 172.21.15.49:0/2902522788 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2b5805a4e0 0x7f2b5805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.093+0000 7f2b91101740 1 Processor -- start 2024-01-22T05:13:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.093+0000 7f2b7f400700 1 --2- 172.21.15.49:0/2902522788 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2b5805a4e0 0x7f2b5805c9a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f2b800c21e0 tx=0x7f2b68009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.093+0000 7f2b91101740 1 -- start start 2024-01-22T05:13:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b91101740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x171f5c0 0x171f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b91101740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x16dacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b91101740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16db1b0 0x16db610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b91101740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x16182a0 con 0x1720170 2024-01-22T05:13:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b91101740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x163b4a0 con 0x16db1b0 2024-01-22T05:13:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b91101740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1604ce0 con 0x171f5c0 2024-01-22T05:13:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b7f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x16dacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b7f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x16dacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60830/0 (socket says 172.21.15.49:60830) 2024-01-22T05:13:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b7f400700 1 -- 172.21.15.49:0/1735679894 learned_addr learned my addr 172.21.15.49:0/1735679894 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:06.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b84c00700 1 --2- 172.21.15.49:0/1735679894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16db1b0 0x16db610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b7fe00700 1 --2- 172.21.15.49:0/1735679894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x171f5c0 0x171f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b7f400700 1 -- 172.21.15.49:0/1735679894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x171f5c0 msgr2=0x171f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b7f400700 1 --2- 172.21.15.49:0/1735679894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x171f5c0 0x171f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b7f400700 1 -- 172.21.15.49:0/1735679894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16db1b0 msgr2=0x16db610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b7f400700 1 --2- 172.21.15.49:0/1735679894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16db1b0 0x16db610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b7f400700 1 -- 172.21.15.49:0/1735679894 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x16698e0 con 0x1720170 2024-01-22T05:13:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b84c00700 1 --2- 172.21.15.49:0/1735679894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16db1b0 0x16db610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b7fe00700 1 --2- 172.21.15.49:0/1735679894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x171f5c0 0x171f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b7f400700 1 --2- 172.21.15.49:0/1735679894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x16dacc0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f2b68011cc0 tx=0x7f2b68017000).ready entity=mon.0 client_cookie=1351f971885784c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b6f400700 1 -- 172.21.15.49:0/1735679894 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68011e70 con 0x1720170 2024-01-22T05:13:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b6f400700 1 -- 172.21.15.49:0/1735679894 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b68014c60 con 0x1720170 2024-01-22T05:13:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.097+0000 7f2b6f400700 1 -- 172.21.15.49:0/1735679894 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6801e600 con 0x1720170 2024-01-22T05:13:06.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.101+0000 7f2b91101740 1 -- 172.21.15.49:0/1735679894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 msgr2=0x16dacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.101+0000 7f2b91101740 1 --2- 172.21.15.49:0/1735679894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x16dacc0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f2b68011cc0 tx=0x7f2b68017000).stop 2024-01-22T05:13:06.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.101+0000 7f2b91101740 1 -- 172.21.15.49:0/1735679894 shutdown_connections 2024-01-22T05:13:06.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.101+0000 7f2b91101740 1 --2- 172.21.15.49:0/1735679894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16db1b0 0x16db610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.101+0000 7f2b91101740 1 --2- 172.21.15.49:0/1735679894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x16dacc0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.101+0000 7f2b91101740 1 --2- 172.21.15.49:0/1735679894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x171f5c0 0x171f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.101+0000 7f2b91101740 1 -- 172.21.15.49:0/1735679894 >> 172.21.15.49:0/1735679894 conn(0x14bd640 msgr2=0x1724e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:06.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.101+0000 7f2b91101740 1 -- 172.21.15.49:0/1735679894 shutdown_connections 2024-01-22T05:13:06.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.101+0000 7f2b91101740 1 -- 172.21.15.49:0/1735679894 wait complete. 2024-01-22T05:13:06.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.101+0000 7f2b91101740 1 -- start start 2024-01-22T05:13:06.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.101+0000 7f2b91101740 1 Processor -- start 2024-01-22T05:13:06.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b91101740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16db1b0 0x171e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b91101740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 0x1705410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b91101740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x1702da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b91101740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1707ec0 con 0x1720170 2024-01-22T05:13:06.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b91101740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x171bf30 con 0x171f5c0 2024-01-22T05:13:06.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b91101740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x171c210 con 0x16db1b0 2024-01-22T05:13:06.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b91101740 10 client.0 ll_register_callbacks cb 0x16959f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:13:06.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b84c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x1702da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b7f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 0x1705410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b7fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16db1b0 0x171e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b84c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x1702da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60844/0 (socket says 172.21.15.49:60844) 2024-01-22T05:13:06.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b84c00700 1 -- 172.21.15.49:0/639492928 learned_addr learned my addr 172.21.15.49:0/639492928 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:06.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b84c00700 1 -- 172.21.15.49:0/639492928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16db1b0 msgr2=0x171e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b84c00700 1 --2- 172.21.15.49:0/639492928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16db1b0 0x171e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b84c00700 1 -- 172.21.15.49:0/639492928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 msgr2=0x1705410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b84c00700 1 --2- 172.21.15.49:0/639492928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 0x1705410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b84c00700 1 -- 172.21.15.49:0/639492928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b680118e0 con 0x1720170 2024-01-22T05:13:06.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b84c00700 1 --2- 172.21.15.49:0/639492928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x1702da0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f2b78011000 tx=0x7f2b78009780).ready entity=mon.0 client_cookie=686374de918f5723 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:06.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b67e00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:13:06.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b67e00700 1 -- 172.21.15.49:0/639492928 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78012e10 con 0x1720170 2024-01-22T05:13:06.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b67e00700 1 -- 172.21.15.49:0/639492928 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2b7801f410 con 0x1720170 2024-01-22T05:13:06.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.105+0000 7f2b91101740 1 -- 172.21.15.49:0/639492928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x16551f0 con 0x1720170 2024-01-22T05:13:06.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b67e00700 1 -- 172.21.15.49:0/639492928 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b7801f5d0 con 0x1720170 2024-01-22T05:13:06.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b91101740 10 client.7473 fetch_fsmap learned FSMap version 90 2024-01-22T05:13:06.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b91101740 1 -- 172.21.15.49:0/639492928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x1658780 con 0x1720170 2024-01-22T05:13:06.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b67e00700 1 -- 172.21.15.49:0/639492928 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x16551f0 con 0x1720170 2024-01-22T05:13:06.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b67e00700 1 -- 172.21.15.49:0/639492928 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 90) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2b7801f730 con 0x1720170 2024-01-22T05:13:06.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b91101740 10 client.7473 fetch_fsmap finished waiting for FSMap version 90 2024-01-22T05:13:06.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b91101740 10 client.7473 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-01-22T05:13:06.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b91101740 20 client.7473 populate_metadata read hostname 'smithi049' 2024-01-22T05:13:06.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b91101740 1 --2- 172.21.15.49:0/639492928 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x173b4f0 0x173d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b91101740 4 client.7473 mds_command: new command op to 7287 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:13:06.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b91101740 1 -- 172.21.15.49:0/639492928 --> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x164b740 con 0x173b4f0 2024-01-22T05:13:06.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b7fe00700 1 --2- 172.21.15.49:0/639492928 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x173b4f0 0x173d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b67e00700 10 client.7473 ms_handle_connect on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:06.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b7fe00700 1 --2- 172.21.15.49:0/639492928 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x173b4f0 0x173d8e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=687de01f1e145963 server_cookie=531aa674a8e31704 in_seq=0 out_seq=0 2024-01-22T05:13:06.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b67e00700 1 -- 172.21.15.49:0/639492928 <== mds.0 v2:172.21.15.49:6835/1226995696 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x164b740 con 0x173b4f0 2024-01-22T05:13:06.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b67e00700 10 client.7473 handle_command_reply: tid=0 2024-01-22T05:13:06.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b91101740 1 client.7473 shutdown 2024-01-22T05:13:06.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b91101740 1 -- 172.21.15.49:0/639492928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 msgr2=0x1702da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.109+0000 7f2b91101740 1 --2- 172.21.15.49:0/639492928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x1702da0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f2b78011000 tx=0x7f2b78009780).stop 2024-01-22T05:13:06.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.113+0000 7f2b91101740 1 -- 172.21.15.49:0/639492928 shutdown_connections 2024-01-22T05:13:06.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.113+0000 7f2b91101740 1 --2- 172.21.15.49:0/639492928 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x173b4f0 0x173d8e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.113+0000 7f2b91101740 1 --2- 172.21.15.49:0/639492928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x1702da0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.113+0000 7f2b67e00700 0 client.7473 ms_handle_reset on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:06.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.113+0000 7f2b91101740 1 --2- 172.21.15.49:0/639492928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 0x1705410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.113+0000 7f2b91101740 1 --2- 172.21.15.49:0/639492928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16db1b0 0x171e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.113+0000 7f2b91101740 1 -- 172.21.15.49:0/639492928 >> 172.21.15.49:0/639492928 conn(0x14bd640 msgr2=0x171b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:06.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.113+0000 7f2b91101740 1 -- 172.21.15.49:0/639492928 shutdown_connections 2024-01-22T05:13:06.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.113+0000 7f2b91101740 1 -- 172.21.15.49:0/639492928 wait complete. 2024-01-22T05:13:06.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.113+0000 7f2b91101740 20 client.7473 trim_cache size 0 max 16384 2024-01-22T05:13:06.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.133+0000 7f2b91101740 1 Processor -- start 2024-01-22T05:13:06.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.133+0000 7f2b91101740 1 -- start start 2024-01-22T05:13:06.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.133+0000 7f2b91101740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16db1b0 0x1724850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.133+0000 7f2b91101740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 0x1724d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.133+0000 7f2b91101740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1720170 0x1701520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.133+0000 7f2b91101740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x16dd8b0 con 0x16db1b0 2024-01-22T05:13:06.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.133+0000 7f2b91101740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1725230 con 0x171f5c0 2024-01-22T05:13:06.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.133+0000 7f2b91101740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x16a2a00 con 0x1720170 2024-01-22T05:13:06.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b7fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16db1b0 0x1724850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b7f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 0x1724d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b84c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1720170 0x1701520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b7f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 0x1724d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:38708/0 (socket says 172.21.15.49:38708) 2024-01-22T05:13:06.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b7f400700 1 -- 172.21.15.49:0/2892299629 learned_addr learned my addr 172.21.15.49:0/2892299629 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:06.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b7fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16db1b0 0x1724850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60856/0 (socket says 172.21.15.49:60856) 2024-01-22T05:13:06.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b7fe00700 1 -- 172.21.15.49:0/2892299629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1720170 msgr2=0x1701520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b7fe00700 1 --2- 172.21.15.49:0/2892299629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1720170 0x1701520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b7fe00700 1 -- 172.21.15.49:0/2892299629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 msgr2=0x1724d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b7fe00700 1 --2- 172.21.15.49:0/2892299629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 0x1724d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b7fe00700 1 -- 172.21.15.49:0/2892299629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b800c6ba0 con 0x16db1b0 2024-01-22T05:13:06.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b84c00700 1 --2- 172.21.15.49:0/2892299629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1720170 0x1701520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:06.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b7fe00700 1 --2- 172.21.15.49:0/2892299629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16db1b0 0x1724850 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f2b70047810 tx=0x7f2b7004d040).ready entity=mon.0 client_cookie=54ddc2b102bc37d0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:06.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b6fe00700 1 -- 172.21.15.49:0/2892299629 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70056040 con 0x16db1b0 2024-01-22T05:13:06.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b6fe00700 1 -- 172.21.15.49:0/2892299629 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b700496b0 con 0x16db1b0 2024-01-22T05:13:06.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b6fe00700 1 -- 172.21.15.49:0/2892299629 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70005c60 con 0x16db1b0 2024-01-22T05:13:06.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b91101740 1 -- 172.21.15.49:0/2892299629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16db1b0 msgr2=0x1724850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b91101740 1 --2- 172.21.15.49:0/2892299629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16db1b0 0x1724850 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f2b70047810 tx=0x7f2b7004d040).stop 2024-01-22T05:13:06.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b91101740 1 -- 172.21.15.49:0/2892299629 shutdown_connections 2024-01-22T05:13:06.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b91101740 1 --2- 172.21.15.49:0/2892299629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1720170 0x1701520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b91101740 1 --2- 172.21.15.49:0/2892299629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 0x1724d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b91101740 1 --2- 172.21.15.49:0/2892299629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16db1b0 0x1724850 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b91101740 1 -- 172.21.15.49:0/2892299629 >> 172.21.15.49:0/2892299629 conn(0x14bd640 msgr2=0x1702b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:06.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b91101740 1 -- 172.21.15.49:0/2892299629 shutdown_connections 2024-01-22T05:13:06.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.137+0000 7f2b91101740 1 -- 172.21.15.49:0/2892299629 wait complete. 2024-01-22T05:13:06.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.141+0000 7f2b91101740 1 -- start start 2024-01-22T05:13:06.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.141+0000 7f2b91101740 1 Processor -- start 2024-01-22T05:13:06.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b91101740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16db1b0 0x1784460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b91101740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 0x1730a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b91101740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x17397c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b91101740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1787870 con 0x1720170 2024-01-22T05:13:06.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b91101740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x16d4160 con 0x171f5c0 2024-01-22T05:13:06.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b91101740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1721960 con 0x16db1b0 2024-01-22T05:13:06.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b91101740 10 client.0 ll_register_callbacks cb 0x7f2b78012410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:13:06.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b84c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x17397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b84c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x17397c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60858/0 (socket says 172.21.15.49:60858) 2024-01-22T05:13:06.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b84c00700 1 -- 172.21.15.49:0/2121405050 learned_addr learned my addr 172.21.15.49:0/2121405050 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:06.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b7fe00700 1 --2- 172.21.15.49:0/2121405050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16db1b0 0x1784460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b7f400700 1 --2- 172.21.15.49:0/2121405050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 0x1730a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b84c00700 1 -- 172.21.15.49:0/2121405050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16db1b0 msgr2=0x1784460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b84c00700 1 --2- 172.21.15.49:0/2121405050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16db1b0 0x1784460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b84c00700 1 -- 172.21.15.49:0/2121405050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 msgr2=0x1730a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b84c00700 1 --2- 172.21.15.49:0/2121405050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 0x1730a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b84c00700 1 -- 172.21.15.49:0/2121405050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1658780 con 0x1720170 2024-01-22T05:13:06.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b84c00700 1 --2- 172.21.15.49:0/2121405050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x17397c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x1720e30 tx=0x7f2b78021070).ready entity=mon.0 client_cookie=cd17ddfe7f8518d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:06.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b67e00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:13:06.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b67e00700 1 -- 172.21.15.49:0/2121405050 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7801f410 con 0x1720170 2024-01-22T05:13:06.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b91101740 1 -- 172.21.15.49:0/2121405050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b68014c60 con 0x1720170 2024-01-22T05:13:06.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b67e00700 1 -- 172.21.15.49:0/2121405050 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2b7801f570 con 0x1720170 2024-01-22T05:13:06.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b67e00700 1 -- 172.21.15.49:0/2121405050 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b78028460 con 0x1720170 2024-01-22T05:13:06.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b91101740 10 client.7479 fetch_fsmap learned FSMap version 90 2024-01-22T05:13:06.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.145+0000 7f2b91101740 1 -- 172.21.15.49:0/2121405050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x7f2b800c35b0 con 0x1720170 2024-01-22T05:13:06.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b67e00700 1 -- 172.21.15.49:0/2121405050 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b68014c60 con 0x1720170 2024-01-22T05:13:06.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b67e00700 1 -- 172.21.15.49:0/2121405050 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 90) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2b780285c0 con 0x1720170 2024-01-22T05:13:06.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b91101740 10 client.7479 fetch_fsmap finished waiting for FSMap version 90 2024-01-22T05:13:06.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b91101740 10 client.7479 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-01-22T05:13:06.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b91101740 20 client.7479 populate_metadata read hostname 'smithi049' 2024-01-22T05:13:06.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b91101740 1 --2- 172.21.15.49:0/2121405050 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x170a020 0x1721b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b91101740 4 client.7479 mds_command: new command op to 7287 tid=0[{"prefix": "scrub abort"}] 2024-01-22T05:13:06.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b91101740 1 -- 172.21.15.49:0/2121405050 --> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x15145d0 con 0x170a020 2024-01-22T05:13:06.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b7fe00700 1 --2- 172.21.15.49:0/2121405050 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x170a020 0x1721b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b7fe00700 1 --2- 172.21.15.49:0/2121405050 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x170a020 0x1721b80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9bd397ddd1e2eb8e server_cookie=86ef759a0a682278 in_seq=0 out_seq=0 2024-01-22T05:13:06.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b67e00700 10 client.7479 ms_handle_connect on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:06.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b67e00700 1 -- 172.21.15.49:0/2121405050 <== mds.0 v2:172.21.15.49:6835/1226995696 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x15145d0 con 0x170a020 2024-01-22T05:13:06.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b67e00700 10 client.7479 handle_command_reply: tid=0 2024-01-22T05:13:06.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b91101740 1 client.7479 shutdown 2024-01-22T05:13:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b91101740 1 -- 172.21.15.49:0/2121405050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 msgr2=0x17397c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b91101740 1 --2- 172.21.15.49:0/2121405050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x17397c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x1720e30 tx=0x7f2b78021070).stop 2024-01-22T05:13:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b91101740 1 -- 172.21.15.49:0/2121405050 shutdown_connections 2024-01-22T05:13:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b91101740 1 --2- 172.21.15.49:0/2121405050 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x170a020 0x1721b80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b91101740 1 --2- 172.21.15.49:0/2121405050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1720170 0x17397c0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b91101740 1 --2- 172.21.15.49:0/2121405050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x171f5c0 0x1730a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b91101740 1 --2- 172.21.15.49:0/2121405050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x16db1b0 0x1784460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b91101740 1 -- 172.21.15.49:0/2121405050 >> 172.21.15.49:0/2121405050 conn(0x14bd640 msgr2=0x171b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.149+0000 7f2b67e00700 0 client.7479 ms_handle_reset on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.153+0000 7f2b91101740 1 -- 172.21.15.49:0/2121405050 shutdown_connections 2024-01-22T05:13:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.153+0000 7f2b91101740 1 -- 172.21.15.49:0/2121405050 wait complete. 2024-01-22T05:13:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.153+0000 7f2b91101740 20 client.7479 trim_cache size 0 max 16384 2024-01-22T05:13:06.156 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:13:06.157 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:13:06.157 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:13:06.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.153+0000 7f2b86c00700 1 -- 172.21.15.49:0/2902522788 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2b5805a4e0 msgr2=0x7f2b5805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.153+0000 7f2b86c00700 1 --2- 172.21.15.49:0/2902522788 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2b5805a4e0 0x7f2b5805c9a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f2b800c21e0 tx=0x7f2b68009060).stop 2024-01-22T05:13:06.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.153+0000 7f2b86c00700 1 -- 172.21.15.49:0/2902522788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b80064370 msgr2=0x7f2b80167d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.153+0000 7f2b86c00700 1 --2- 172.21.15.49:0/2902522788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b80064370 0x7f2b80167d50 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f2b7000c510 tx=0x7f2b70007c70).stop 2024-01-22T05:13:06.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.153+0000 7f2b86c00700 1 -- 172.21.15.49:0/2902522788 shutdown_connections 2024-01-22T05:13:06.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.153+0000 7f2b86c00700 1 --2- 172.21.15.49:0/2902522788 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2b5805a4e0 0x7f2b5805c9a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.153+0000 7f2b86c00700 1 --2- 172.21.15.49:0/2902522788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b80151900 0x7f2b800c2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.153+0000 7f2b86c00700 1 --2- 172.21.15.49:0/2902522788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b800a9da0 0x7f2b800c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.153+0000 7f2b86c00700 1 --2- 172.21.15.49:0/2902522788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b80064370 0x7f2b80167d50 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.153+0000 7f2b86c00700 1 -- 172.21.15.49:0/2902522788 >> 172.21.15.49:0/2902522788 conn(0x7f2b80067290 msgr2=0x7f2b800c5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:06.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.153+0000 7f2b86c00700 1 -- 172.21.15.49:0/2902522788 shutdown_connections 2024-01-22T05:13:06.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.153+0000 7f2b86c00700 1 -- 172.21.15.49:0/2902522788 wait complete. 2024-01-22T05:13:06.181 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2024-01-22T05:13:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.345+0000 7fddffe00700 1 Processor -- start 2024-01-22T05:13:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.345+0000 7fddffe00700 1 -- start start 2024-01-22T05:13:06.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.349+0000 7fddffe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf8067b70 0x7fddf80ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.349+0000 7fddffe00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf8066200 con 0x7fddf8067240 2024-01-22T05:13:06.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.349+0000 7fddffe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf80655f0 con 0x7fddf8066e20 2024-01-22T05:13:06.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.349+0000 7fddffe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf8066690 con 0x7fddf8067b70 2024-01-22T05:13:06.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.349+0000 7fddfde00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fddf8067240 0x7fddf815a430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35312/0 (socket says 172.21.15.49:35312) 2024-01-22T05:13:06.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.349+0000 7fddfde00700 1 -- 172.21.15.49:0/2351876257 learned_addr learned my addr 172.21.15.49:0/2351876257 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:06.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.349+0000 7fddfd400700 1 --2- 172.21.15.49:0/2351876257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf8067b70 0x7fddf80ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.349+0000 7fddf7e00700 1 -- 172.21.15.49:0/2351876257 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753033757 0 0) 0x7fddf8066200 con 0x7fddf8067240 2024-01-22T05:13:06.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.349+0000 7fddf7e00700 1 -- 172.21.15.49:0/2351876257 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddd80033f0 con 0x7fddf8067240 2024-01-22T05:13:06.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.349+0000 7fddf7e00700 1 -- 172.21.15.49:0/2351876257 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793605500 0 0) 0x7fddf80655f0 con 0x7fddf8066e20 2024-01-22T05:13:06.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.349+0000 7fddf7e00700 1 -- 172.21.15.49:0/2351876257 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf8066200 con 0x7fddf8066e20 2024-01-22T05:13:06.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.349+0000 7fddfd400700 1 -- 172.21.15.49:0/2351876257 >> v1:172.21.15.110:6789/0 conn(0x7fddf8066e20 legacy=0x7fddf80c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.349+0000 7fddfd400700 1 -- 172.21.15.49:0/2351876257 >> v1:172.21.15.49:6789/0 conn(0x7fddf8067240 legacy=0x7fddf815a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.349+0000 7fddfd400700 1 -- 172.21.15.49:0/2351876257 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80658d0 con 0x7fddf8067b70 2024-01-22T05:13:06.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.353+0000 7fddfd400700 1 --2- 172.21.15.49:0/2351876257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf8067b70 0x7fddf80ac0e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fdde8009790 tx=0x7fdde8009060).ready entity=mon.2 client_cookie=123fe74f79d6dfda server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:06.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.353+0000 7fddf7e00700 1 -- 172.21.15.49:0/2351876257 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde800f510 con 0x7fddf8067b70 2024-01-22T05:13:06.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.353+0000 7fddf7e00700 1 -- 172.21.15.49:0/2351876257 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde800f670 con 0x7fddf8067b70 2024-01-22T05:13:06.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.353+0000 7fddf7e00700 1 -- 172.21.15.49:0/2351876257 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde800f9f0 con 0x7fddf8067b70 2024-01-22T05:13:06.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.353+0000 7fddffe00700 1 -- 172.21.15.49:0/2351876257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf8067b70 msgr2=0x7fddf80ac0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.353+0000 7fddffe00700 1 --2- 172.21.15.49:0/2351876257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf8067b70 0x7fddf80ac0e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fdde8009790 tx=0x7fdde8009060).stop 2024-01-22T05:13:06.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.353+0000 7fddffe00700 1 -- 172.21.15.49:0/2351876257 shutdown_connections 2024-01-22T05:13:06.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.353+0000 7fddffe00700 1 --2- 172.21.15.49:0/2351876257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf8067b70 0x7fddf80ac0e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.353+0000 7fddffe00700 1 -- 172.21.15.49:0/2351876257 >> 172.21.15.49:0/2351876257 conn(0x7fddf80c6560 msgr2=0x7fddf80c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:06.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.353+0000 7fddffe00700 1 -- 172.21.15.49:0/2351876257 shutdown_connections 2024-01-22T05:13:06.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.353+0000 7fddffe00700 1 -- 172.21.15.49:0/2351876257 wait complete. 2024-01-22T05:13:06.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.357+0000 7fddffe00700 1 Processor -- start 2024-01-22T05:13:06.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.357+0000 7fddffe00700 1 -- start start 2024-01-22T05:13:06.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.357+0000 7fddffe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddf8066e20 0x7fddf814f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.357+0000 7fddffe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf8067240 0x7fddf80be5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.357+0000 7fddffe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddf8067b70 0x7fddf80c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.357+0000 7fddffe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf815dbb0 con 0x7fddf8067b70 2024-01-22T05:13:06.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.357+0000 7fddffe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf815de90 con 0x7fddf8066e20 2024-01-22T05:13:06.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.357+0000 7fddffe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80beed0 con 0x7fddf8067240 2024-01-22T05:13:06.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddfde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddf8067b70 0x7fddf80c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddfde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddf8067b70 0x7fddf80c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60872/0 (socket says 172.21.15.49:60872) 2024-01-22T05:13:06.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddfde00700 1 -- 172.21.15.49:0/1335037392 learned_addr learned my addr 172.21.15.49:0/1335037392 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:06.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddfd400700 1 --2- 172.21.15.49:0/1335037392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddf8066e20 0x7fddf814f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddfca00700 1 --2- 172.21.15.49:0/1335037392 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf8067240 0x7fddf80be5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddfde00700 1 -- 172.21.15.49:0/1335037392 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf8067240 msgr2=0x7fddf80be5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddfde00700 1 --2- 172.21.15.49:0/1335037392 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf8067240 0x7fddf80be5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddfde00700 1 -- 172.21.15.49:0/1335037392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddf8066e20 msgr2=0x7fddf814f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddfde00700 1 --2- 172.21.15.49:0/1335037392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddf8066e20 0x7fddf814f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddfde00700 1 -- 172.21.15.49:0/1335037392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde80092a0 con 0x7fddf8067b70 2024-01-22T05:13:06.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddfde00700 1 --2- 172.21.15.49:0/1335037392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddf8067b70 0x7fddf80c54f0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7fddf000c810 tx=0x7fddf0001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:06.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddf4c00700 1 -- 172.21.15.49:0/1335037392 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0005d30 con 0x7fddf8067b70 2024-01-22T05:13:06.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddf4c00700 1 -- 172.21.15.49:0/1335037392 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf0005e90 con 0x7fddf8067b70 2024-01-22T05:13:06.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddf4c00700 1 -- 172.21.15.49:0/1335037392 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0007340 con 0x7fddf8067b70 2024-01-22T05:13:06.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddffe00700 1 -- 172.21.15.49:0/1335037392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf80bf1b0 con 0x7fddf8067b70 2024-01-22T05:13:06.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.361+0000 7fddffe00700 1 -- 172.21.15.49:0/1335037392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf814fd40 con 0x7fddf8067b70 2024-01-22T05:13:06.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.365+0000 7fddf4c00700 1 -- 172.21.15.49:0/1335037392 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fddf00076b0 con 0x7fddf8067b70 2024-01-22T05:13:06.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.365+0000 7fddf4c00700 1 --2- 172.21.15.49:0/1335037392 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fddd005a510 0x7fddd005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.365+0000 7fddf4c00700 1 -- 172.21.15.49:0/1335037392 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fddf00748d0 con 0x7fddf8067b70 2024-01-22T05:13:06.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.365+0000 7fddfd400700 1 --2- 172.21.15.49:0/1335037392 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fddd005a510 0x7fddd005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.369+0000 7fddfd400700 1 --2- 172.21.15.49:0/1335037392 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fddd005a510 0x7fddd005c9d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fdde8009fd0 tx=0x7fdde8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:06.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.369+0000 7fde0a25d740 1 Processor -- start 2024-01-22T05:13:06.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.369+0000 7fde0a25d740 1 -- start start 2024-01-22T05:13:06.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.369+0000 7fde0a25d740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fc44d0 0x1fc48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.369+0000 7fde0a25d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcb570 0x1fcb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.369+0000 7fde0a25d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fcbee0 0x1faa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.369+0000 7fde0a25d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1edc540 con 0x1fcbee0 2024-01-22T05:13:06.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.369+0000 7fde0a25d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e9fe90 con 0x1fcb570 2024-01-22T05:13:06.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.369+0000 7fde0a25d740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ea5d90 con 0x1fc44d0 2024-01-22T05:13:06.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fddfde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fcbee0 0x1faa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fddfde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fcbee0 0x1faa4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60886/0 (socket says 172.21.15.49:60886) 2024-01-22T05:13:06.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fddfde00700 1 -- 172.21.15.49:0/659664419 learned_addr learned my addr 172.21.15.49:0/659664419 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:06.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fddfca00700 1 --2- 172.21.15.49:0/659664419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcb570 0x1fcb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fddfd400700 1 --2- 172.21.15.49:0/659664419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fc44d0 0x1fc48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fddfde00700 1 -- 172.21.15.49:0/659664419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fc44d0 msgr2=0x1fc48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fddfde00700 1 --2- 172.21.15.49:0/659664419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fc44d0 0x1fc48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fddfde00700 1 -- 172.21.15.49:0/659664419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcb570 msgr2=0x1fcb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fddfde00700 1 --2- 172.21.15.49:0/659664419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcb570 0x1fcb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fddfde00700 1 -- 172.21.15.49:0/659664419 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1f0a4c0 con 0x1fcbee0 2024-01-22T05:13:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fddfca00700 1 --2- 172.21.15.49:0/659664419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcb570 0x1fcb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fddfde00700 1 --2- 172.21.15.49:0/659664419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fcbee0 0x1faa4f0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7fddf004b730 tx=0x7fddf000f000).ready entity=mon.0 client_cookie=3acdbe75c7f02fba server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fdded200700 1 -- 172.21.15.49:0/659664419 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0051070 con 0x1fcbee0 2024-01-22T05:13:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fdded200700 1 -- 172.21.15.49:0/659664419 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf0072e90 con 0x1fcbee0 2024-01-22T05:13:06.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fdded200700 1 -- 172.21.15.49:0/659664419 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0051230 con 0x1fcbee0 2024-01-22T05:13:06.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fde0a25d740 1 -- 172.21.15.49:0/659664419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fcbee0 msgr2=0x1faa4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fde0a25d740 1 --2- 172.21.15.49:0/659664419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fcbee0 0x1faa4f0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7fddf004b730 tx=0x7fddf000f000).stop 2024-01-22T05:13:06.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fde0a25d740 1 -- 172.21.15.49:0/659664419 shutdown_connections 2024-01-22T05:13:06.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fde0a25d740 1 --2- 172.21.15.49:0/659664419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fcbee0 0x1faa4f0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fde0a25d740 1 --2- 172.21.15.49:0/659664419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcb570 0x1fcb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fde0a25d740 1 --2- 172.21.15.49:0/659664419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fc44d0 0x1fc48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fde0a25d740 1 -- 172.21.15.49:0/659664419 >> 172.21.15.49:0/659664419 conn(0x1d5e680 msgr2=0x1f7dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:06.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fde0a25d740 1 -- 172.21.15.49:0/659664419 shutdown_connections 2024-01-22T05:13:06.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.373+0000 7fde0a25d740 1 -- 172.21.15.49:0/659664419 wait complete. 2024-01-22T05:13:06.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.377+0000 7fde0a25d740 1 -- start start 2024-01-22T05:13:06.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.377+0000 7fde0a25d740 1 Processor -- start 2024-01-22T05:13:06.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.377+0000 7fde0a25d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fc44d0 0x1fa7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.377+0000 7fde0a25d740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcb570 0x1fa7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.377+0000 7fde0a25d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcbee0 0x1f7c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.377+0000 7fde0a25d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fbdc90 con 0x1fc44d0 2024-01-22T05:13:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.377+0000 7fde0a25d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fa5d30 con 0x1fcbee0 2024-01-22T05:13:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.377+0000 7fde0a25d740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fa6b90 con 0x1fcb570 2024-01-22T05:13:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.377+0000 7fde0a25d740 10 client.0 ll_register_callbacks cb 0x1f365d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:13:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fddfd400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fc44d0 0x1fa7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fddfd400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fc44d0 0x1fa7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60896/0 (socket says 172.21.15.49:60896) 2024-01-22T05:13:06.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fddfd400700 1 -- 172.21.15.49:0/125942411 learned_addr learned my addr 172.21.15.49:0/125942411 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fddfca00700 1 --2- 172.21.15.49:0/125942411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcb570 0x1fa7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fddfde00700 1 --2- 172.21.15.49:0/125942411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcbee0 0x1f7c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fddfd400700 1 -- 172.21.15.49:0/125942411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcb570 msgr2=0x1fa7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fddfd400700 1 --2- 172.21.15.49:0/125942411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcb570 0x1fa7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fddfd400700 1 -- 172.21.15.49:0/125942411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcbee0 msgr2=0x1f7c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fddfd400700 1 --2- 172.21.15.49:0/125942411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcbee0 0x1f7c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fddfd400700 1 -- 172.21.15.49:0/125942411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf814fd40 con 0x1fc44d0 2024-01-22T05:13:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fddfde00700 1 --2- 172.21.15.49:0/125942411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcbee0 0x1f7c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fddfd400700 1 --2- 172.21.15.49:0/125942411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fc44d0 0x1fa7020 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fdde8011000 tx=0x7fdde801e040).ready entity=mon.0 client_cookie=ff86d5605c2de7a3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:06.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fdde5600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:13:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fdde5600700 1 -- 172.21.15.49:0/125942411 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde80090b0 con 0x1fc44d0 2024-01-22T05:13:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fdde5600700 1 -- 172.21.15.49:0/125942411 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fdde800ba90 con 0x1fc44d0 2024-01-22T05:13:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fde0a25d740 1 -- 172.21.15.49:0/125942411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1ef6230 con 0x1fc44d0 2024-01-22T05:13:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fdde5600700 1 -- 172.21.15.49:0/125942411 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdde800be60 con 0x1fc44d0 2024-01-22T05:13:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fde0a25d740 10 client.7491 fetch_fsmap learned FSMap version 90 2024-01-22T05:13:06.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fde0a25d740 1 -- 172.21.15.49:0/125942411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x1ef97c0 con 0x1fc44d0 2024-01-22T05:13:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fdde5600700 1 -- 172.21.15.49:0/125942411 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1ef6230 con 0x1fc44d0 2024-01-22T05:13:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fdde5600700 1 -- 172.21.15.49:0/125942411 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 90) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdde800b120 con 0x1fc44d0 2024-01-22T05:13:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fde0a25d740 10 client.7491 fetch_fsmap finished waiting for FSMap version 90 2024-01-22T05:13:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fde0a25d740 10 client.7491 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-01-22T05:13:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fde0a25d740 20 client.7491 populate_metadata read hostname 'smithi049' 2024-01-22T05:13:06.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fde0a25d740 1 --2- 172.21.15.49:0/125942411 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x1f7ccc0 0x1fd55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fde0a25d740 4 client.7491 mds_command: new command op to 7287 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:13:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fde0a25d740 1 -- 172.21.15.49:0/125942411 --> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1eec780 con 0x1f7ccc0 2024-01-22T05:13:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.381+0000 7fddfca00700 1 --2- 172.21.15.49:0/125942411 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x1f7ccc0 0x1fd55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fddfca00700 1 --2- 172.21.15.49:0/125942411 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x1f7ccc0 0x1fd55d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=35475a3c69cdc4f0 server_cookie=d8c3d48ade62001 in_seq=0 out_seq=0 2024-01-22T05:13:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fdde5600700 10 client.7491 ms_handle_connect on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:06.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fdde5600700 1 -- 172.21.15.49:0/125942411 <== mds.0 v2:172.21.15.49:6835/1226995696 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1eec780 con 0x1f7ccc0 2024-01-22T05:13:06.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fdde5600700 10 client.7491 handle_command_reply: tid=0 2024-01-22T05:13:06.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fde0a25d740 1 client.7491 shutdown 2024-01-22T05:13:06.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fde0a25d740 1 -- 172.21.15.49:0/125942411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fc44d0 msgr2=0x1fa7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fde0a25d740 1 --2- 172.21.15.49:0/125942411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fc44d0 0x1fa7020 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fdde8011000 tx=0x7fdde801e040).stop 2024-01-22T05:13:06.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fde0a25d740 1 -- 172.21.15.49:0/125942411 shutdown_connections 2024-01-22T05:13:06.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fde0a25d740 1 --2- 172.21.15.49:0/125942411 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x1f7ccc0 0x1fd55d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fde0a25d740 1 --2- 172.21.15.49:0/125942411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcbee0 0x1f7c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fde0a25d740 1 --2- 172.21.15.49:0/125942411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcb570 0x1fa7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fde0a25d740 1 --2- 172.21.15.49:0/125942411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fc44d0 0x1fa7020 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fde0a25d740 1 -- 172.21.15.49:0/125942411 >> 172.21.15.49:0/125942411 conn(0x1d5e680 msgr2=0x1fc52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:06.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fdde5600700 0 client.7491 ms_handle_reset on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:06.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fde0a25d740 1 -- 172.21.15.49:0/125942411 shutdown_connections 2024-01-22T05:13:06.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fde0a25d740 1 -- 172.21.15.49:0/125942411 wait complete. 2024-01-22T05:13:06.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.385+0000 7fde0a25d740 20 client.7491 trim_cache size 0 max 16384 2024-01-22T05:13:06.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.405+0000 7fde0a25d740 1 Processor -- start 2024-01-22T05:13:06.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.405+0000 7fde0a25d740 1 -- start start 2024-01-22T05:13:06.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.405+0000 7fde0a25d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fc44d0 0x1fdbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.405+0000 7fde0a25d740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcb570 0x1fdc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.405+0000 7fde0a25d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fcbee0 0x1fc62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.405+0000 7fde0a25d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fcba50 con 0x1fcbee0 2024-01-22T05:13:06.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.405+0000 7fde0a25d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fc3b90 con 0x1fc44d0 2024-01-22T05:13:06.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.405+0000 7fde0a25d740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fdc6d0 con 0x1fcb570 2024-01-22T05:13:06.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fddfde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fcbee0 0x1fc62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fddfd400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fc44d0 0x1fdbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fddfca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcb570 0x1fdc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fddfd400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fc44d0 0x1fdbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:38748/0 (socket says 172.21.15.49:38748) 2024-01-22T05:13:06.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fddfd400700 1 -- 172.21.15.49:0/3142197619 learned_addr learned my addr 172.21.15.49:0/3142197619 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fddfd400700 1 -- 172.21.15.49:0/3142197619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcb570 msgr2=0x1fdc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fddfd400700 1 --2- 172.21.15.49:0/3142197619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcb570 0x1fdc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fddfd400700 1 -- 172.21.15.49:0/3142197619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fcbee0 msgr2=0x1fc62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fddfd400700 1 --2- 172.21.15.49:0/3142197619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fcbee0 0x1fc62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fddfd400700 1 -- 172.21.15.49:0/3142197619 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80c5d40 con 0x1fc44d0 2024-01-22T05:13:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fddfd400700 1 --2- 172.21.15.49:0/3142197619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fc44d0 0x1fdbcf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fdde8009dc0 tx=0x7fdde8028000).ready entity=mon.1 client_cookie=85128f6776c1be76 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fddedc00700 1 -- 172.21.15.49:0/3142197619 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde80090b0 con 0x1fc44d0 2024-01-22T05:13:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fddedc00700 1 -- 172.21.15.49:0/3142197619 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde800be60 con 0x1fc44d0 2024-01-22T05:13:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fddedc00700 1 -- 172.21.15.49:0/3142197619 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde800b120 con 0x1fc44d0 2024-01-22T05:13:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fde0a25d740 1 -- 172.21.15.49:0/3142197619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fc44d0 msgr2=0x1fdbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fde0a25d740 1 --2- 172.21.15.49:0/3142197619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fc44d0 0x1fdbcf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fdde8009dc0 tx=0x7fdde8028000).stop 2024-01-22T05:13:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fde0a25d740 1 -- 172.21.15.49:0/3142197619 shutdown_connections 2024-01-22T05:13:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fde0a25d740 1 --2- 172.21.15.49:0/3142197619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fcbee0 0x1fc62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fde0a25d740 1 --2- 172.21.15.49:0/3142197619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcb570 0x1fdc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fde0a25d740 1 --2- 172.21.15.49:0/3142197619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fc44d0 0x1fdbcf0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.409+0000 7fde0a25d740 1 -- 172.21.15.49:0/3142197619 >> 172.21.15.49:0/3142197619 conn(0x1d5e680 msgr2=0x1f7f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.413+0000 7fde0a25d740 1 -- 172.21.15.49:0/3142197619 shutdown_connections 2024-01-22T05:13:06.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.413+0000 7fde0a25d740 1 -- 172.21.15.49:0/3142197619 wait complete. 2024-01-22T05:13:06.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.413+0000 7fde0a25d740 1 -- start start 2024-01-22T05:13:06.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.413+0000 7fde0a25d740 1 Processor -- start 2024-01-22T05:13:06.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fde0a25d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fc44d0 0x1fc2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fde0a25d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcb570 0x1fc3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fde0a25d740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcbee0 0x202b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fde0a25d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fa3870 con 0x1fc44d0 2024-01-22T05:13:06.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fde0a25d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fc3860 con 0x1fcb570 2024-01-22T05:13:06.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fde0a25d740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fc84d0 con 0x1fcbee0 2024-01-22T05:13:06.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fde0a25d740 10 client.0 ll_register_callbacks cb 0x7fdde8000d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:13:06.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fddfd400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fc44d0 0x1fc2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fddfd400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fc44d0 0x1fc2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60914/0 (socket says 172.21.15.49:60914) 2024-01-22T05:13:06.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fddfde00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcbee0 0x202b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fddfca00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcb570 0x1fc3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fddfd400700 1 -- 172.21.15.49:0/1656417117 learned_addr learned my addr 172.21.15.49:0/1656417117 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:06.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fddfde00700 1 -- 172.21.15.49:0/1656417117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcb570 msgr2=0x1fc3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fddfde00700 1 --2- 172.21.15.49:0/1656417117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcb570 0x1fc3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fddfde00700 1 -- 172.21.15.49:0/1656417117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fc44d0 msgr2=0x1fc2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:06.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fddfde00700 1 --2- 172.21.15.49:0/1656417117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fc44d0 0x1fc2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fddfde00700 1 -- 172.21.15.49:0/1656417117 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1ef97c0 con 0x1fcbee0 2024-01-22T05:13:06.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fddfd400700 1 --2- 172.21.15.49:0/1656417117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fc44d0 0x1fc2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:06.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fddfde00700 1 --2- 172.21.15.49:0/1656417117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcbee0 0x202b4a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fddf004ba20 tx=0x7fddf0057000).ready entity=mon.2 client_cookie=56b7a6688b3ef341 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:06.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fdde5600700 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2024-01-22T05:13:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fdde5600700 1 -- 172.21.15.49:0/1656417117 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0051070 con 0x1fcbee0 2024-01-22T05:13:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fdde5600700 1 -- 172.21.15.49:0/1656417117 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fddf0051230 con 0x1fcbee0 2024-01-22T05:13:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.417+0000 7fde0a25d740 1 -- 172.21.15.49:0/1656417117 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fddf0072e90 con 0x1fcbee0 2024-01-22T05:13:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fdde5600700 1 -- 172.21.15.49:0/1656417117 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddf00017b0 con 0x1fcbee0 2024-01-22T05:13:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 10 client.6560 fetch_fsmap learned FSMap version 90 2024-01-22T05:13:06.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 1 -- 172.21.15.49:0/1656417117 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x1ef49f0 con 0x1fcbee0 2024-01-22T05:13:06.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fdde5600700 1 -- 172.21.15.49:0/1656417117 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf0072e90 con 0x1fcbee0 2024-01-22T05:13:06.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fdde5600700 1 -- 172.21.15.49:0/1656417117 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 90) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fddf001a020 con 0x1fcbee0 2024-01-22T05:13:06.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 10 client.6560 fetch_fsmap finished waiting for FSMap version 90 2024-01-22T05:13:06.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 10 client.6560 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-01-22T05:13:06.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 20 client.6560 populate_metadata read hostname 'smithi049' 2024-01-22T05:13:06.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 1 --2- 172.21.15.49:0/1656417117 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x2027b40 0x202b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:06.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 4 client.6560 mds_command: new command op to 7287 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:13:06.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 1 -- 172.21.15.49:0/1656417117 --> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1db5610 con 0x2027b40 2024-01-22T05:13:06.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fddfd400700 1 --2- 172.21.15.49:0/1656417117 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x2027b40 0x202b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:06.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fdde5600700 10 client.6560 ms_handle_connect on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:06.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fddfd400700 1 --2- 172.21.15.49:0/1656417117 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x2027b40 0x202b990 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c682a5183c425d0c server_cookie=6e789d9fa787e82a in_seq=0 out_seq=0 2024-01-22T05:13:06.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fdde5600700 1 -- 172.21.15.49:0/1656417117 <== mds.0 v2:172.21.15.49:6835/1226995696 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x1db5610 con 0x2027b40 2024-01-22T05:13:06.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fdde5600700 10 client.6560 handle_command_reply: tid=0 2024-01-22T05:13:06.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 1 client.6560 shutdown 2024-01-22T05:13:06.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 1 -- 172.21.15.49:0/1656417117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcbee0 msgr2=0x202b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 1 --2- 172.21.15.49:0/1656417117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcbee0 0x202b4a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fddf004ba20 tx=0x7fddf0057000).stop 2024-01-22T05:13:06.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 1 -- 172.21.15.49:0/1656417117 shutdown_connections 2024-01-22T05:13:06.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 1 --2- 172.21.15.49:0/1656417117 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x2027b40 0x202b990 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 1 --2- 172.21.15.49:0/1656417117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fcbee0 0x202b4a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 1 --2- 172.21.15.49:0/1656417117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fcb570 0x1fc3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 1 --2- 172.21.15.49:0/1656417117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fc44d0 0x1fc2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fdde5600700 0 client.6560 ms_handle_reset on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:06.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.421+0000 7fde0a25d740 1 -- 172.21.15.49:0/1656417117 >> 172.21.15.49:0/1656417117 conn(0x1d5e680 msgr2=0x1f7f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:06.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.425+0000 7fde0a25d740 1 -- 172.21.15.49:0/1656417117 shutdown_connections 2024-01-22T05:13:06.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.425+0000 7fde0a25d740 1 -- 172.21.15.49:0/1656417117 wait complete. 2024-01-22T05:13:06.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.425+0000 7fde0a25d740 20 client.6560 trim_cache size 0 max 16384 2024-01-22T05:13:06.429 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:13:06.429 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-01-22T05:13:06.429 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-01-22T05:13:06.429 INFO:teuthology.orchestra.run.smithi049.stdout: "966d164b-f07b-44bc-bc81-68e47c2572d5": { 2024-01-22T05:13:06.429 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/scrub_control_test_path", 2024-01-22T05:13:06.430 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "966d164b-f07b-44bc-bc81-68e47c2572d5", 2024-01-22T05:13:06.430 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive" 2024-01-22T05:13:06.430 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:06.430 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:06.430 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:13:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.425+0000 7fddffe00700 1 -- 172.21.15.49:0/1335037392 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fddd005a510 msgr2=0x7fddd005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.425+0000 7fddffe00700 1 --2- 172.21.15.49:0/1335037392 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fddd005a510 0x7fddd005c9d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fdde8009fd0 tx=0x7fdde8017000).stop 2024-01-22T05:13:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.425+0000 7fddffe00700 1 -- 172.21.15.49:0/1335037392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddf8067b70 msgr2=0x7fddf80c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.425+0000 7fddffe00700 1 --2- 172.21.15.49:0/1335037392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddf8067b70 0x7fddf80c54f0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7fddf000c810 tx=0x7fddf0001650).stop 2024-01-22T05:13:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.425+0000 7fddffe00700 1 -- 172.21.15.49:0/1335037392 shutdown_connections 2024-01-22T05:13:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.425+0000 7fddffe00700 1 --2- 172.21.15.49:0/1335037392 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fddd005a510 0x7fddd005c9d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.425+0000 7fddffe00700 1 --2- 172.21.15.49:0/1335037392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddf8067b70 0x7fddf80c54f0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.425+0000 7fddffe00700 1 --2- 172.21.15.49:0/1335037392 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf8067240 0x7fddf80be5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.425+0000 7fddffe00700 1 --2- 172.21.15.49:0/1335037392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddf8066e20 0x7fddf814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.425+0000 7fddffe00700 1 -- 172.21.15.49:0/1335037392 >> 172.21.15.49:0/1335037392 conn(0x7fddf80c6560 msgr2=0x7fddf8152eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.425+0000 7fddffe00700 1 -- 172.21.15.49:0/1335037392 shutdown_connections 2024-01-22T05:13:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:06.425+0000 7fddffe00700 1 -- 172.21.15.49:0/1335037392 wait complete. 2024-01-22T05:13:08.996 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:13:09.002 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:13:11.451 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2024-01-22T05:13:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.625+0000 7fac50a00700 1 Processor -- start 2024-01-22T05:13:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.625+0000 7fac50a00700 1 -- start start 2024-01-22T05:13:11.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.629+0000 7fac50a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac481583c0 0x7fac48158820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.629+0000 7fac50a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fac48158d10 0x7fac480bdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.629+0000 7fac50a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac480694b0 con 0x7fac48067b40 2024-01-22T05:13:11.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.629+0000 7fac50a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac48068630 con 0x7fac48158d10 2024-01-22T05:13:11.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.629+0000 7fac50a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac480688a0 con 0x7fac481583c0 2024-01-22T05:13:11.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.629+0000 7fac4ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fac48158d10 0x7fac480bdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.629+0000 7fac4ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fac48158d10 0x7fac480bdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60916/0 (socket says 172.21.15.49:60916) 2024-01-22T05:13:11.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.629+0000 7fac4ea00700 1 -- 172.21.15.49:0/2142883484 learned_addr learned my addr 172.21.15.49:0/2142883484 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:11.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.629+0000 7fac4d600700 1 --2- 172.21.15.49:0/2142883484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac481583c0 0x7fac48158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.629+0000 7fac4ea00700 1 -- 172.21.15.49:0/2142883484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac481583c0 msgr2=0x7fac48158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:11.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.629+0000 7fac4ea00700 1 --2- 172.21.15.49:0/2142883484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac481583c0 0x7fac48158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.629+0000 7fac4ea00700 1 -- 172.21.15.49:0/2142883484 >> v1:172.21.15.110:6789/0 conn(0x7fac48067b40 legacy=0x7fac48067f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:11.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.629+0000 7fac4cc00700 1 -- 172.21.15.49:0/2142883484 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167761796 0 0) 0x7fac480694b0 con 0x7fac48067b40 2024-01-22T05:13:11.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.629+0000 7fac4ea00700 1 -- 172.21.15.49:0/2142883484 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac48068b80 con 0x7fac48158d10 2024-01-22T05:13:11.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.633+0000 7fac4ea00700 1 --2- 172.21.15.49:0/2142883484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac48158d10 0x7fac480bdc80 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7fac40009f20 tx=0x7fac40009840).ready entity=mon.0 client_cookie=c0a0143598a08e0a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:11.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.633+0000 7fac4cc00700 1 -- 172.21.15.49:0/2142883484 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4000e070 con 0x7fac48158d10 2024-01-22T05:13:11.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.633+0000 7fac4cc00700 1 -- 172.21.15.49:0/2142883484 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4000b9d0 con 0x7fac48158d10 2024-01-22T05:13:11.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.633+0000 7fac4cc00700 1 -- 172.21.15.49:0/2142883484 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4000bd50 con 0x7fac48158d10 2024-01-22T05:13:11.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.633+0000 7fac50a00700 1 -- 172.21.15.49:0/2142883484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac48158d10 msgr2=0x7fac480bdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:11.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.633+0000 7fac50a00700 1 --2- 172.21.15.49:0/2142883484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac48158d10 0x7fac480bdc80 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7fac40009f20 tx=0x7fac40009840).stop 2024-01-22T05:13:11.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.633+0000 7fac50a00700 1 -- 172.21.15.49:0/2142883484 shutdown_connections 2024-01-22T05:13:11.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.633+0000 7fac50a00700 1 --2- 172.21.15.49:0/2142883484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac48158d10 0x7fac480bdc80 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.633+0000 7fac50a00700 1 --2- 172.21.15.49:0/2142883484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac481583c0 0x7fac48158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.633+0000 7fac50a00700 1 -- 172.21.15.49:0/2142883484 >> 172.21.15.49:0/2142883484 conn(0x7fac480c8750 msgr2=0x7fac480c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:11.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.633+0000 7fac50a00700 1 -- 172.21.15.49:0/2142883484 shutdown_connections 2024-01-22T05:13:11.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.633+0000 7fac50a00700 1 -- 172.21.15.49:0/2142883484 wait complete. 2024-01-22T05:13:11.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.637+0000 7fac50a00700 1 Processor -- start 2024-01-22T05:13:11.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.637+0000 7fac50a00700 1 -- start start 2024-01-22T05:13:11.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.637+0000 7fac50a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac48067b40 0x7fac480aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.637+0000 7fac50a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac481583c0 0x7fac480ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.637+0000 7fac50a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac48158d10 0x7fac4814c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.637+0000 7fac50a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac480ad1d0 con 0x7fac481583c0 2024-01-22T05:13:11.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.637+0000 7fac50a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac480ad4b0 con 0x7fac48067b40 2024-01-22T05:13:11.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.637+0000 7fac50a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac480ad790 con 0x7fac48158d10 2024-01-22T05:13:11.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.637+0000 7fac4d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac481583c0 0x7fac480ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.637+0000 7fac4d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac481583c0 0x7fac480ae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60924/0 (socket says 172.21.15.49:60924) 2024-01-22T05:13:11.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.637+0000 7fac4d600700 1 -- 172.21.15.49:0/43283601 learned_addr learned my addr 172.21.15.49:0/43283601 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:11.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.641+0000 7fac4ea00700 1 --2- 172.21.15.49:0/43283601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac48158d10 0x7fac4814c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.641+0000 7fac4e000700 1 --2- 172.21.15.49:0/43283601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac48067b40 0x7fac480aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.641+0000 7fac4ea00700 1 -- 172.21.15.49:0/43283601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac48067b40 msgr2=0x7fac480aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:11.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.641+0000 7fac4ea00700 1 --2- 172.21.15.49:0/43283601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac48067b40 0x7fac480aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.641+0000 7fac4ea00700 1 -- 172.21.15.49:0/43283601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac481583c0 msgr2=0x7fac480ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:11.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.641+0000 7fac4ea00700 1 --2- 172.21.15.49:0/43283601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac481583c0 0x7fac480ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.641+0000 7fac4ea00700 1 -- 172.21.15.49:0/43283601 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac40009ae0 con 0x7fac48158d10 2024-01-22T05:13:11.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.641+0000 7fac4d600700 1 --2- 172.21.15.49:0/43283601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac481583c0 0x7fac480ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:11.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.641+0000 7fac4ea00700 1 --2- 172.21.15.49:0/43283601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac48158d10 0x7fac4814c990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fac40013000 tx=0x7fac40009840).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:11.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.641+0000 7fac45600700 1 -- 172.21.15.49:0/43283601 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40013ea0 con 0x7fac48158d10 2024-01-22T05:13:11.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.641+0000 7fac45600700 1 -- 172.21.15.49:0/43283601 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac40007170 con 0x7fac48158d10 2024-01-22T05:13:11.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.641+0000 7fac45600700 1 -- 172.21.15.49:0/43283601 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4001e680 con 0x7fac48158d10 2024-01-22T05:13:11.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.641+0000 7fac50a00700 1 -- 172.21.15.49:0/43283601 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac480ada70 con 0x7fac48158d10 2024-01-22T05:13:11.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.641+0000 7fac50a00700 1 -- 172.21.15.49:0/43283601 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4814ce80 con 0x7fac48158d10 2024-01-22T05:13:11.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.645+0000 7fac45600700 1 -- 172.21.15.49:0/43283601 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fac40003040 con 0x7fac48158d10 2024-01-22T05:13:11.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.645+0000 7fac45600700 1 --2- 172.21.15.49:0/43283601 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac2005a510 0x7fac2005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.645+0000 7fac45600700 1 -- 172.21.15.49:0/43283601 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fac40075a70 con 0x7fac48158d10 2024-01-22T05:13:11.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.649+0000 7fac4e000700 1 --2- 172.21.15.49:0/43283601 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac2005a510 0x7fac2005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.649+0000 7fac4e000700 1 --2- 172.21.15.49:0/43283601 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac2005a510 0x7fac2005c9d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fac38003870 tx=0x7fac38007d20).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:11.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.649+0000 7fac5af46740 1 Processor -- start 2024-01-22T05:13:11.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.649+0000 7fac5af46740 1 -- start start 2024-01-22T05:13:11.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac5af46740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x17444d0 0x17448b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac5af46740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x174b570 0x174b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac5af46740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x172a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac5af46740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x165c540 con 0x174b570 2024-01-22T05:13:11.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac5af46740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x161fe90 con 0x17444d0 2024-01-22T05:13:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac5af46740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1625d90 con 0x174bee0 2024-01-22T05:13:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac4d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x174b570 0x174b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac4d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x174b570 0x174b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60930/0 (socket says 172.21.15.49:60930) 2024-01-22T05:13:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac4d600700 1 -- 172.21.15.49:0/350566721 learned_addr learned my addr 172.21.15.49:0/350566721 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac4e000700 1 --2- 172.21.15.49:0/350566721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x17444d0 0x17448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac4ea00700 1 --2- 172.21.15.49:0/350566721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x172a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac4d600700 1 -- 172.21.15.49:0/350566721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 msgr2=0x172a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac4d600700 1 --2- 172.21.15.49:0/350566721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x172a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac4d600700 1 -- 172.21.15.49:0/350566721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x17444d0 msgr2=0x17448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:11.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac4d600700 1 --2- 172.21.15.49:0/350566721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x17444d0 0x17448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac4d600700 1 -- 172.21.15.49:0/350566721 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x168a4c0 con 0x174b570 2024-01-22T05:13:11.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac4d600700 1 --2- 172.21.15.49:0/350566721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x174b570 0x174b9f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fac30009f50 tx=0x7fac30009060).ready entity=mon.0 client_cookie=b58c19dd2bbe99f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:11.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac3dc00700 1 -- 172.21.15.49:0/350566721 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac300099f0 con 0x174b570 2024-01-22T05:13:11.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac3dc00700 1 -- 172.21.15.49:0/350566721 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac30011cf0 con 0x174b570 2024-01-22T05:13:11.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac3dc00700 1 -- 172.21.15.49:0/350566721 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac30014650 con 0x174b570 2024-01-22T05:13:11.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac5af46740 1 -- 172.21.15.49:0/350566721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x174b570 msgr2=0x174b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:11.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac5af46740 1 --2- 172.21.15.49:0/350566721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x174b570 0x174b9f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fac30009f50 tx=0x7fac30009060).stop 2024-01-22T05:13:11.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac5af46740 1 -- 172.21.15.49:0/350566721 shutdown_connections 2024-01-22T05:13:11.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac5af46740 1 --2- 172.21.15.49:0/350566721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x172a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac5af46740 1 --2- 172.21.15.49:0/350566721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x174b570 0x174b9f0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac5af46740 1 --2- 172.21.15.49:0/350566721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x17444d0 0x17448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.653+0000 7fac5af46740 1 -- 172.21.15.49:0/350566721 >> 172.21.15.49:0/350566721 conn(0x14de680 msgr2=0x16fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:11.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.657+0000 7fac5af46740 1 -- 172.21.15.49:0/350566721 shutdown_connections 2024-01-22T05:13:11.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.657+0000 7fac5af46740 1 -- 172.21.15.49:0/350566721 wait complete. 2024-01-22T05:13:11.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.657+0000 7fac5af46740 1 -- start start 2024-01-22T05:13:11.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.657+0000 7fac5af46740 1 Processor -- start 2024-01-22T05:13:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac5af46740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x17444d0 0x17458a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac5af46740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x174b570 0x171a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac5af46740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x16fc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac5af46740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1724c70 con 0x174b570 2024-01-22T05:13:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac5af46740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1726c40 con 0x17444d0 2024-01-22T05:13:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac5af46740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1722ee0 con 0x174bee0 2024-01-22T05:13:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac5af46740 10 client.0 ll_register_callbacks cb 0x16b65d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:13:11.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac4d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x174b570 0x171a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac4d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x174b570 0x171a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60940/0 (socket says 172.21.15.49:60940) 2024-01-22T05:13:11.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac4d600700 1 -- 172.21.15.49:0/3566649670 learned_addr learned my addr 172.21.15.49:0/3566649670 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:11.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac4ea00700 1 --2- 172.21.15.49:0/3566649670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x16fc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac4e000700 1 --2- 172.21.15.49:0/3566649670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x17444d0 0x17458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac4d600700 1 -- 172.21.15.49:0/3566649670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 msgr2=0x16fc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:11.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac4d600700 1 --2- 172.21.15.49:0/3566649670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x16fc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac4d600700 1 -- 172.21.15.49:0/3566649670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x17444d0 msgr2=0x17458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:11.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac4d600700 1 --2- 172.21.15.49:0/3566649670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x17444d0 0x17458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac4d600700 1 -- 172.21.15.49:0/3566649670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac30009ba0 con 0x174b570 2024-01-22T05:13:11.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac4e000700 1 --2- 172.21.15.49:0/3566649670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x17444d0 0x17458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:11.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac4ea00700 1 --2- 172.21.15.49:0/3566649670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x16fc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:11.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac4d600700 1 --2- 172.21.15.49:0/3566649670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x174b570 0x171a900 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fac30002000 tx=0x7fac3001c000).ready entity=mon.0 client_cookie=1c32307e55531ea4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:11.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac36000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:13:11.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac36000700 1 -- 172.21.15.49:0/3566649670 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac30022070 con 0x174b570 2024-01-22T05:13:11.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac5af46740 1 -- 172.21.15.49:0/3566649670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1676230 con 0x174b570 2024-01-22T05:13:11.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.661+0000 7fac36000700 1 -- 172.21.15.49:0/3566649670 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fac30014d60 con 0x174b570 2024-01-22T05:13:11.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac36000700 1 -- 172.21.15.49:0/3566649670 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac30026620 con 0x174b570 2024-01-22T05:13:11.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac5af46740 10 client.7509 fetch_fsmap learned FSMap version 90 2024-01-22T05:13:11.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac5af46740 1 -- 172.21.15.49:0/3566649670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x16797c0 con 0x174b570 2024-01-22T05:13:11.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac36000700 1 -- 172.21.15.49:0/3566649670 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1676230 con 0x174b570 2024-01-22T05:13:11.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac36000700 1 -- 172.21.15.49:0/3566649670 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 90) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fac30026780 con 0x174b570 2024-01-22T05:13:11.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac5af46740 10 client.7509 fetch_fsmap finished waiting for FSMap version 90 2024-01-22T05:13:11.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac5af46740 10 client.7509 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-01-22T05:13:11.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac5af46740 20 client.7509 populate_metadata read hostname 'smithi049' 2024-01-22T05:13:11.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac5af46740 1 --2- 172.21.15.49:0/3566649670 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x1755110 0x17554f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac5af46740 4 client.7509 mds_command: new command op to 7287 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:13:11.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac5af46740 1 -- 172.21.15.49:0/3566649670 --> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x166c780 con 0x1755110 2024-01-22T05:13:11.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac4e000700 1 --2- 172.21.15.49:0/3566649670 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x1755110 0x17554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac4e000700 1 --2- 172.21.15.49:0/3566649670 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x1755110 0x17554f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7d1d4a77279475a0 server_cookie=306d7229810ef178 in_seq=0 out_seq=0 2024-01-22T05:13:11.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac36000700 10 client.7509 ms_handle_connect on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:11.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac36000700 1 -- 172.21.15.49:0/3566649670 <== mds.0 v2:172.21.15.49:6835/1226995696 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x166c780 con 0x1755110 2024-01-22T05:13:11.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac36000700 10 client.7509 handle_command_reply: tid=0 2024-01-22T05:13:11.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.665+0000 7fac5af46740 1 client.7509 shutdown 2024-01-22T05:13:11.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.669+0000 7fac5af46740 1 -- 172.21.15.49:0/3566649670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x174b570 msgr2=0x171a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:11.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.669+0000 7fac5af46740 1 --2- 172.21.15.49:0/3566649670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x174b570 0x171a900 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fac30002000 tx=0x7fac3001c000).stop 2024-01-22T05:13:11.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.669+0000 7fac5af46740 1 -- 172.21.15.49:0/3566649670 shutdown_connections 2024-01-22T05:13:11.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.669+0000 7fac5af46740 1 --2- 172.21.15.49:0/3566649670 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x1755110 0x17554f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.669+0000 7fac5af46740 1 --2- 172.21.15.49:0/3566649670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x16fc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.669+0000 7fac5af46740 1 --2- 172.21.15.49:0/3566649670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x174b570 0x171a900 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.669+0000 7fac5af46740 1 --2- 172.21.15.49:0/3566649670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x17444d0 0x17458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.669+0000 7fac36000700 0 client.7509 ms_handle_reset on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:11.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.669+0000 7fac5af46740 1 -- 172.21.15.49:0/3566649670 >> 172.21.15.49:0/3566649670 conn(0x14de680 msgr2=0x1746740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:11.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.669+0000 7fac5af46740 1 -- 172.21.15.49:0/3566649670 shutdown_connections 2024-01-22T05:13:11.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.669+0000 7fac5af46740 1 -- 172.21.15.49:0/3566649670 wait complete. 2024-01-22T05:13:11.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.669+0000 7fac5af46740 20 client.7509 trim_cache size 0 max 16384 2024-01-22T05:13:11.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.689+0000 7fac5af46740 1 Processor -- start 2024-01-22T05:13:11.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.689+0000 7fac5af46740 1 -- start start 2024-01-22T05:13:11.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.689+0000 7fac5af46740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x17444d0 0x16fd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac5af46740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x174b570 0x172ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac5af46740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x1725390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac5af46740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1725f70 con 0x17444d0 2024-01-22T05:13:11.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac5af46740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1637e00 con 0x174b570 2024-01-22T05:13:11.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac5af46740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1745ce0 con 0x174bee0 2024-01-22T05:13:11.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac4e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x17444d0 0x16fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac4e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x17444d0 0x16fd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60946/0 (socket says 172.21.15.49:60946) 2024-01-22T05:13:11.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac4e000700 1 -- 172.21.15.49:0/1172415042 learned_addr learned my addr 172.21.15.49:0/1172415042 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:11.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac4ea00700 1 --2- 172.21.15.49:0/1172415042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x1725390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac4d600700 1 --2- 172.21.15.49:0/1172415042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x174b570 0x172ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac4e000700 1 -- 172.21.15.49:0/1172415042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 msgr2=0x1725390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:11.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac4e000700 1 --2- 172.21.15.49:0/1172415042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x1725390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac4e000700 1 -- 172.21.15.49:0/1172415042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x174b570 msgr2=0x172ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:11.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac4e000700 1 --2- 172.21.15.49:0/1172415042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x174b570 0x172ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac4e000700 1 -- 172.21.15.49:0/1172415042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x16f50d0 con 0x17444d0 2024-01-22T05:13:11.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac4e000700 1 --2- 172.21.15.49:0/1172415042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x17444d0 0x16fd780 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7fac38003f10 tx=0x7fac38002000).ready entity=mon.0 client_cookie=a28f2ecec259e720 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:11.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac3e600700 1 -- 172.21.15.49:0/1172415042 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3801c030 con 0x17444d0 2024-01-22T05:13:11.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac3e600700 1 -- 172.21.15.49:0/1172415042 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3801d040 con 0x17444d0 2024-01-22T05:13:11.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac3e600700 1 -- 172.21.15.49:0/1172415042 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac380179d0 con 0x17444d0 2024-01-22T05:13:11.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac5af46740 1 -- 172.21.15.49:0/1172415042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x17444d0 msgr2=0x16fd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:11.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac5af46740 1 --2- 172.21.15.49:0/1172415042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x17444d0 0x16fd780 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7fac38003f10 tx=0x7fac38002000).stop 2024-01-22T05:13:11.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac5af46740 1 -- 172.21.15.49:0/1172415042 shutdown_connections 2024-01-22T05:13:11.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac5af46740 1 --2- 172.21.15.49:0/1172415042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x1725390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac5af46740 1 --2- 172.21.15.49:0/1172415042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x174b570 0x172ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac5af46740 1 --2- 172.21.15.49:0/1172415042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x17444d0 0x16fd780 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac5af46740 1 -- 172.21.15.49:0/1172415042 >> 172.21.15.49:0/1172415042 conn(0x14de680 msgr2=0x1728720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:11.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac5af46740 1 -- 172.21.15.49:0/1172415042 shutdown_connections 2024-01-22T05:13:11.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.693+0000 7fac5af46740 1 -- 172.21.15.49:0/1172415042 wait complete. 2024-01-22T05:13:11.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.697+0000 7fac5af46740 1 -- start start 2024-01-22T05:13:11.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.697+0000 7fac5af46740 1 Processor -- start 2024-01-22T05:13:11.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac5af46740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x17444d0 0x1724520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac5af46740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x174b570 0x17257d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac5af46740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x17226a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac5af46740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x172b150 con 0x17444d0 2024-01-22T05:13:11.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac5af46740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1749470 con 0x174b570 2024-01-22T05:13:11.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac5af46740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x172ac20 con 0x174bee0 2024-01-22T05:13:11.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac5af46740 10 client.0 ll_register_callbacks cb 0x7fac400099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:13:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac4e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x17444d0 0x1724520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac4e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x17444d0 0x1724520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60948/0 (socket says 172.21.15.49:60948) 2024-01-22T05:13:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac4e000700 1 -- 172.21.15.49:0/478101975 learned_addr learned my addr 172.21.15.49:0/478101975 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac4d600700 1 --2- 172.21.15.49:0/478101975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x174b570 0x17257d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac4ea00700 1 --2- 172.21.15.49:0/478101975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x17226a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac4e000700 1 -- 172.21.15.49:0/478101975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 msgr2=0x17226a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac4e000700 1 --2- 172.21.15.49:0/478101975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x17226a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac4e000700 1 -- 172.21.15.49:0/478101975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x174b570 msgr2=0x17257d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac4e000700 1 --2- 172.21.15.49:0/478101975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x174b570 0x17257d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac4e000700 1 -- 172.21.15.49:0/478101975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3800fba0 con 0x17444d0 2024-01-22T05:13:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac4e000700 1 --2- 172.21.15.49:0/478101975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x17444d0 0x1724520 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x17442f0 tx=0x7fac38019070).ready entity=mon.0 client_cookie=b042dc3d2a09a29f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.701+0000 7fac36000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:13:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac36000700 1 -- 172.21.15.49:0/478101975 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac380179d0 con 0x17444d0 2024-01-22T05:13:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac5af46740 1 -- 172.21.15.49:0/478101975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fac30011cf0 con 0x17444d0 2024-01-22T05:13:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac36000700 1 -- 172.21.15.49:0/478101975 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fac380265c0 con 0x17444d0 2024-01-22T05:13:11.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac36000700 1 -- 172.21.15.49:0/478101975 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac38026990 con 0x17444d0 2024-01-22T05:13:11.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac5af46740 10 client.7515 fetch_fsmap learned FSMap version 90 2024-01-22T05:13:11.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac5af46740 1 -- 172.21.15.49:0/478101975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x7fac480bdfe0 con 0x17444d0 2024-01-22T05:13:11.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac36000700 1 -- 172.21.15.49:0/478101975 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac30011cf0 con 0x17444d0 2024-01-22T05:13:11.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac36000700 1 -- 172.21.15.49:0/478101975 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 90) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fac3802d070 con 0x17444d0 2024-01-22T05:13:11.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac5af46740 10 client.7515 fetch_fsmap finished waiting for FSMap version 90 2024-01-22T05:13:11.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac5af46740 10 client.7515 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-01-22T05:13:11.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac5af46740 20 client.7515 populate_metadata read hostname 'smithi049' 2024-01-22T05:13:11.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac5af46740 1 --2- 172.21.15.49:0/478101975 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x17486b0 0x1748a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac5af46740 4 client.7515 mds_command: new command op to 7287 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:13:11.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac5af46740 1 -- 172.21.15.49:0/478101975 --> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1535610 con 0x17486b0 2024-01-22T05:13:11.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac4d600700 1 --2- 172.21.15.49:0/478101975 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x17486b0 0x1748a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac36000700 10 client.7515 ms_handle_connect on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:11.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac4d600700 1 --2- 172.21.15.49:0/478101975 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x17486b0 0x1748a90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=11a8865ed779c83a server_cookie=67367846b550212 in_seq=0 out_seq=0 2024-01-22T05:13:11.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac36000700 1 -- 172.21.15.49:0/478101975 <== mds.0 v2:172.21.15.49:6835/1226995696 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1535610 con 0x17486b0 2024-01-22T05:13:11.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac36000700 10 client.7515 handle_command_reply: tid=0 2024-01-22T05:13:11.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.705+0000 7fac5af46740 1 client.7515 shutdown 2024-01-22T05:13:11.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac5af46740 1 -- 172.21.15.49:0/478101975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x17444d0 msgr2=0x1724520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:11.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac5af46740 1 --2- 172.21.15.49:0/478101975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x17444d0 0x1724520 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x17442f0 tx=0x7fac38019070).stop 2024-01-22T05:13:11.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac5af46740 1 -- 172.21.15.49:0/478101975 shutdown_connections 2024-01-22T05:13:11.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac5af46740 1 --2- 172.21.15.49:0/478101975 >> [v2:172.21.15.49:6835/1226995696,v1:172.21.15.49:6837/1226995696] conn(0x17486b0 0x1748a90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac5af46740 1 --2- 172.21.15.49:0/478101975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x174bee0 0x17226a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac5af46740 1 --2- 172.21.15.49:0/478101975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x174b570 0x17257d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac36000700 0 client.7515 ms_handle_reset on v2:172.21.15.49:6835/1226995696 2024-01-22T05:13:11.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac5af46740 1 --2- 172.21.15.49:0/478101975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x17444d0 0x1724520 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac5af46740 1 -- 172.21.15.49:0/478101975 >> 172.21.15.49:0/478101975 conn(0x14de680 msgr2=0x1728720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:11.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac5af46740 1 -- 172.21.15.49:0/478101975 shutdown_connections 2024-01-22T05:13:11.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac5af46740 1 -- 172.21.15.49:0/478101975 wait complete. 2024-01-22T05:13:11.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac5af46740 20 client.7515 trim_cache size 0 max 16384 2024-01-22T05:13:11.709 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:13:11.710 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-01-22T05:13:11.710 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-01-22T05:13:11.710 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:13:11.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac50a00700 1 -- 172.21.15.49:0/43283601 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac2005a510 msgr2=0x7fac2005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:11.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac50a00700 1 --2- 172.21.15.49:0/43283601 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac2005a510 0x7fac2005c9d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fac38003870 tx=0x7fac38007d20).stop 2024-01-22T05:13:11.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac50a00700 1 -- 172.21.15.49:0/43283601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac48158d10 msgr2=0x7fac4814c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:11.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac50a00700 1 --2- 172.21.15.49:0/43283601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac48158d10 0x7fac4814c990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fac40013000 tx=0x7fac40009840).stop 2024-01-22T05:13:11.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac50a00700 1 -- 172.21.15.49:0/43283601 shutdown_connections 2024-01-22T05:13:11.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac50a00700 1 --2- 172.21.15.49:0/43283601 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac2005a510 0x7fac2005c9d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac50a00700 1 --2- 172.21.15.49:0/43283601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac48158d10 0x7fac4814c990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac50a00700 1 --2- 172.21.15.49:0/43283601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac481583c0 0x7fac480ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac50a00700 1 --2- 172.21.15.49:0/43283601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac48067b40 0x7fac480aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac50a00700 1 -- 172.21.15.49:0/43283601 >> 172.21.15.49:0/43283601 conn(0x7fac480c8750 msgr2=0x7fac48062840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:11.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac50a00700 1 -- 172.21.15.49:0/43283601 shutdown_connections 2024-01-22T05:13:11.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.709+0000 7fac50a00700 1 -- 172.21.15.49:0/43283601 wait complete. 2024-01-22T05:13:11.734 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-22T05:13:11.735 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:13:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.913+0000 7fadf7600700 1 Processor -- start 2024-01-22T05:13:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.913+0000 7fadf7600700 1 -- start start 2024-01-22T05:13:11.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.913+0000 7fadf7600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fadf0065240 0x7fadf00644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.913+0000 7fadf7600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadf00649e0 0x7fadf015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.913+0000 7fadf7600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf00c2700 con 0x7fadf0065620 2024-01-22T05:13:11.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.913+0000 7fadf7600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf0064e30 con 0x7fadf0065240 2024-01-22T05:13:11.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.913+0000 7fadf7600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00c29a0 con 0x7fadf00649e0 2024-01-22T05:13:11.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.913+0000 7fadf4c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fadf0065240 0x7fadf00644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.913+0000 7fadefe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fadf0065620 0x7fadf015b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35320/0 (socket says 172.21.15.49:35320) 2024-01-22T05:13:11.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.913+0000 7fadf4c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fadf0065240 0x7fadf00644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60962/0 (socket says 172.21.15.49:60962) 2024-01-22T05:13:11.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.913+0000 7fadefe00700 1 -- 172.21.15.49:0/3315181070 learned_addr learned my addr 172.21.15.49:0/3315181070 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:11.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.913+0000 7fadf6000700 1 --2- 172.21.15.49:0/3315181070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadf00649e0 0x7fadf015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadf4c00700 1 -- 172.21.15.49:0/3315181070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadf00649e0 msgr2=0x7fadf015c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:11.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadf4c00700 1 --2- 172.21.15.49:0/3315181070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadf00649e0 0x7fadf015c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadf4c00700 1 -- 172.21.15.49:0/3315181070 >> v1:172.21.15.49:6789/0 conn(0x7fadf0065620 legacy=0x7fadf015b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:11.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadf4c00700 1 -- 172.21.15.49:0/3315181070 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00c2c80 con 0x7fadf0065240 2024-01-22T05:13:11.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadf4c00700 1 --2- 172.21.15.49:0/3315181070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadf0065240 0x7fadf00644f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fade0009760 tx=0x7fade0009060).ready entity=mon.0 client_cookie=e49e8c2e3793cbf0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:11.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadef400700 1 -- 172.21.15.49:0/3315181070 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade000f510 con 0x7fadf0065240 2024-01-22T05:13:11.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadef400700 1 -- 172.21.15.49:0/3315181070 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade000f670 con 0x7fadf0065240 2024-01-22T05:13:11.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadef400700 1 -- 172.21.15.49:0/3315181070 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade000f9f0 con 0x7fadf0065240 2024-01-22T05:13:11.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadf7600700 1 -- 172.21.15.49:0/3315181070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadf0065240 msgr2=0x7fadf00644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:11.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadf7600700 1 --2- 172.21.15.49:0/3315181070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadf0065240 0x7fadf00644f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fade0009760 tx=0x7fade0009060).stop 2024-01-22T05:13:11.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadf7600700 1 -- 172.21.15.49:0/3315181070 shutdown_connections 2024-01-22T05:13:11.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadf7600700 1 --2- 172.21.15.49:0/3315181070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadf00649e0 0x7fadf015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadf7600700 1 --2- 172.21.15.49:0/3315181070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadf0065240 0x7fadf00644f0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadf7600700 1 -- 172.21.15.49:0/3315181070 >> 172.21.15.49:0/3315181070 conn(0x7fadf00c87f0 msgr2=0x7fadf00c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:11.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadf7600700 1 -- 172.21.15.49:0/3315181070 shutdown_connections 2024-01-22T05:13:11.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.917+0000 7fadf7600700 1 -- 172.21.15.49:0/3315181070 wait complete. 2024-01-22T05:13:11.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.921+0000 7fadf7600700 1 Processor -- start 2024-01-22T05:13:11.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.921+0000 7fadf7600700 1 -- start start 2024-01-22T05:13:11.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf7600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadf00649e0 0x7fadf015d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf7600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadf0065240 0x7fadf0067a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf7600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadf0065620 0x7fadf0067f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf7600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf0168760 con 0x7fadf00649e0 2024-01-22T05:13:11.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf7600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00c1ca0 con 0x7fadf0065240 2024-01-22T05:13:11.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf7600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf0068470 con 0x7fadf0065620 2024-01-22T05:13:11.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf4c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadf00649e0 0x7fadf015d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf4c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadf00649e0 0x7fadf015d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60974/0 (socket says 172.21.15.49:60974) 2024-01-22T05:13:11.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf4c00700 1 -- 172.21.15.49:0/4243796598 learned_addr learned my addr 172.21.15.49:0/4243796598 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:11.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadefe00700 1 --2- 172.21.15.49:0/4243796598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadf0065240 0x7fadf0067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf6000700 1 --2- 172.21.15.49:0/4243796598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadf0065620 0x7fadf0067f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf4c00700 1 -- 172.21.15.49:0/4243796598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadf0065620 msgr2=0x7fadf0067f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:11.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf4c00700 1 --2- 172.21.15.49:0/4243796598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadf0065620 0x7fadf0067f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf4c00700 1 -- 172.21.15.49:0/4243796598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadf0065240 msgr2=0x7fadf0067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:11.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf4c00700 1 --2- 172.21.15.49:0/4243796598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadf0065240 0x7fadf0067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:11.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf4c00700 1 -- 172.21.15.49:0/4243796598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade00092a0 con 0x7fadf00649e0 2024-01-22T05:13:11.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf6000700 1 --2- 172.21.15.49:0/4243796598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadf0065620 0x7fadf0067f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:11.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf4c00700 1 --2- 172.21.15.49:0/4243796598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadf00649e0 0x7fadf015d7a0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fadf0066be0 tx=0x7fade0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:11.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fade7e00700 1 -- 172.21.15.49:0/4243796598 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade000f7e0 con 0x7fadf00649e0 2024-01-22T05:13:11.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fade7e00700 1 -- 172.21.15.49:0/4243796598 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade000f940 con 0x7fadf00649e0 2024-01-22T05:13:11.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf7600700 1 -- 172.21.15.49:0/4243796598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf00c1090 con 0x7fadf00649e0 2024-01-22T05:13:11.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fade7e00700 1 -- 172.21.15.49:0/4243796598 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade001b660 con 0x7fadf00649e0 2024-01-22T05:13:11.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.925+0000 7fadf7600700 1 -- 172.21.15.49:0/4243796598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf00c16d0 con 0x7fadf00649e0 2024-01-22T05:13:11.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.929+0000 7fadf7600700 1 -- 172.21.15.49:0/4243796598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf0047060 con 0x7fadf00649e0 2024-01-22T05:13:11.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.929+0000 7fade7e00700 1 -- 172.21.15.49:0/4243796598 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fade001ba10 con 0x7fadf00649e0 2024-01-22T05:13:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.929+0000 7fade7e00700 1 --2- 172.21.15.49:0/4243796598 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadc805a540 0x7fadc805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.929+0000 7fade7e00700 1 -- 172.21.15.49:0/4243796598 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fade0076410 con 0x7fadf00649e0 2024-01-22T05:13:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.929+0000 7fadefe00700 1 --2- 172.21.15.49:0/4243796598 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadc805a540 0x7fadc805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.933+0000 7fadefe00700 1 --2- 172.21.15.49:0/4243796598 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadc805a540 0x7fadc805ca00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fadf00bcca0 tx=0x7fadd8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:11.937+0000 7fade7e00700 1 -- 172.21.15.49:0/4243796598 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fade00499d0 con 0x7fadf00649e0 2024-01-22T05:13:12.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.137+0000 7fadf7600700 1 -- 172.21.15.49:0/4243796598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadf00c2f60 con 0x7fadf00649e0 2024-01-22T05:13:12.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.141+0000 7fade7e00700 1 -- 172.21.15.49:0/4243796598 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fade0028020 con 0x7fadf00649e0 2024-01-22T05:13:12.141 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:12.141 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2953480069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2953480069},{"type":"v1","addr":"172.21.15.110:6833","nonce":2953480069}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2000522159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2000522159},{"type":"v1","addr":"172.21.15.110:6835","nonce":2000522159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/578632238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":578632238},{"type":"v1","addr":"172.21.15.49:6836","nonce":578632238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:12:25.842913+0000","modified":"2024-01-22T05:12:28.864832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7287":{"gid":7287,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/1226995696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1226995696},{"type":"v1","addr":"172.21.15.49:6837","nonce":1226995696}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-22T05:13:12.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.141+0000 7fadf7600700 1 -- 172.21.15.49:0/4243796598 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadc805a540 msgr2=0x7fadc805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:12.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.141+0000 7fadf7600700 1 --2- 172.21.15.49:0/4243796598 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadc805a540 0x7fadc805ca00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fadf00bcca0 tx=0x7fadd8009040).stop 2024-01-22T05:13:12.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.141+0000 7fadf7600700 1 -- 172.21.15.49:0/4243796598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadf00649e0 msgr2=0x7fadf015d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:12.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.141+0000 7fadf7600700 1 --2- 172.21.15.49:0/4243796598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadf00649e0 0x7fadf015d7a0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fadf0066be0 tx=0x7fade0017000).stop 2024-01-22T05:13:12.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.141+0000 7fadf7600700 1 -- 172.21.15.49:0/4243796598 shutdown_connections 2024-01-22T05:13:12.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.141+0000 7fadf7600700 1 --2- 172.21.15.49:0/4243796598 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadc805a540 0x7fadc805ca00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:12.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.141+0000 7fadf7600700 1 --2- 172.21.15.49:0/4243796598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadf0065620 0x7fadf0067f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:12.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.141+0000 7fadf7600700 1 --2- 172.21.15.49:0/4243796598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadf0065240 0x7fadf0067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:12.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.141+0000 7fadf7600700 1 --2- 172.21.15.49:0/4243796598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadf00649e0 0x7fadf015d7a0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:12.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.145+0000 7fadf7600700 1 -- 172.21.15.49:0/4243796598 >> 172.21.15.49:0/4243796598 conn(0x7fadf00c87f0 msgr2=0x7fadf0156920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:12.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.145+0000 7fadf7600700 1 -- 172.21.15.49:0/4243796598 shutdown_connections 2024-01-22T05:13:12.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.145+0000 7fadf7600700 1 -- 172.21.15.49:0/4243796598 wait complete. 2024-01-22T05:13:12.148 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 90 2024-01-22T05:13:12.168 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-01-22T05:13:12.168 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:13:12.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.329+0000 7fb559000700 1 Processor -- start 2024-01-22T05:13:12.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.329+0000 7fb559000700 1 -- start start 2024-01-22T05:13:12.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.329+0000 7fb559000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb554155d20 0x7fb554065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:12.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.329+0000 7fb559000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5540a8e50 0x7fb5540c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:12.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.329+0000 7fb559000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5540c1a40 con 0x7fb554066070 2024-01-22T05:13:12.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.329+0000 7fb559000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb554159310 con 0x7fb554155d20 2024-01-22T05:13:12.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.329+0000 7fb559000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5540c13f0 con 0x7fb5540a8e50 2024-01-22T05:13:12.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.329+0000 7fb551400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb554066070 0x7fb5540a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35324/0 (socket says 172.21.15.49:35324) 2024-01-22T05:13:12.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.329+0000 7fb551400700 1 -- 172.21.15.49:0/3928905741 learned_addr learned my addr 172.21.15.49:0/3928905741 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:12.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb551e00700 1 --2- 172.21.15.49:0/3928905741 >> v2:172.21.15.110:3300/0 conn(0x7fb554155d20 0x7fb554065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:12.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb552800700 1 --2- 172.21.15.49:0/3928905741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5540a8e50 0x7fb5540c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:12.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb550a00700 1 -- 172.21.15.49:0/3928905741 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145023082 0 0) 0x7fb5540c1a40 con 0x7fb554066070 2024-01-22T05:13:12.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb550a00700 1 -- 172.21.15.49:0/3928905741 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5340033f0 con 0x7fb554066070 2024-01-22T05:13:12.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb551e00700 1 -- 172.21.15.49:0/3928905741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5540a8e50 msgr2=0x7fb5540c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:12.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb551e00700 1 --2- 172.21.15.49:0/3928905741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5540a8e50 0x7fb5540c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:12.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb551e00700 1 -- 172.21.15.49:0/3928905741 >> v1:172.21.15.49:6789/0 conn(0x7fb554066070 legacy=0x7fb5540a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:12.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb551e00700 1 -- 172.21.15.49:0/3928905741 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5540c16d0 con 0x7fb554155d20 2024-01-22T05:13:12.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb551e00700 1 --2- 172.21.15.49:0/3928905741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb554155d20 0x7fb554065b80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fb544009760 tx=0x7fb544009060).ready entity=mon.1 client_cookie=aa1d287e98292bc0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:12.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb550a00700 1 -- 172.21.15.49:0/3928905741 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400d4a0 con 0x7fb554155d20 2024-01-22T05:13:12.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb550a00700 1 -- 172.21.15.49:0/3928905741 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54400d600 con 0x7fb554155d20 2024-01-22T05:13:12.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb550a00700 1 -- 172.21.15.49:0/3928905741 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400d980 con 0x7fb554155d20 2024-01-22T05:13:12.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb559000700 1 -- 172.21.15.49:0/3928905741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb554155d20 msgr2=0x7fb554065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:12.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb559000700 1 --2- 172.21.15.49:0/3928905741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb554155d20 0x7fb554065b80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fb544009760 tx=0x7fb544009060).stop 2024-01-22T05:13:12.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb559000700 1 -- 172.21.15.49:0/3928905741 shutdown_connections 2024-01-22T05:13:12.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb559000700 1 --2- 172.21.15.49:0/3928905741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5540a8e50 0x7fb5540c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:12.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb559000700 1 --2- 172.21.15.49:0/3928905741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb554155d20 0x7fb554065b80 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:12.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb559000700 1 -- 172.21.15.49:0/3928905741 >> 172.21.15.49:0/3928905741 conn(0x7fb5540c6540 msgr2=0x7fb5540c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:12.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.333+0000 7fb559000700 1 -- 172.21.15.49:0/3928905741 shutdown_connections 2024-01-22T05:13:12.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.337+0000 7fb559000700 1 -- 172.21.15.49:0/3928905741 wait complete. 2024-01-22T05:13:12.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.337+0000 7fb559000700 1 Processor -- start 2024-01-22T05:13:12.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.337+0000 7fb559000700 1 -- start start 2024-01-22T05:13:12.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb559000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb554066070 0x7fb5541511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:12.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb559000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5540a8e50 0x7fb554142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:12.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb559000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb554155d20 0x7fb5540ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:12.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb559000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5541561c0 con 0x7fb554066070 2024-01-22T05:13:12.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb559000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5541516e0 con 0x7fb5540a8e50 2024-01-22T05:13:12.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb559000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55416cbe0 con 0x7fb554155d20 2024-01-22T05:13:12.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb551e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb554066070 0x7fb5541511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:12.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb551e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb554066070 0x7fb5541511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60980/0 (socket says 172.21.15.49:60980) 2024-01-22T05:13:12.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb551e00700 1 -- 172.21.15.49:0/504566113 learned_addr learned my addr 172.21.15.49:0/504566113 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:12.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb552800700 1 --2- 172.21.15.49:0/504566113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb554155d20 0x7fb5540ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:12.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb551400700 1 --2- 172.21.15.49:0/504566113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5540a8e50 0x7fb554142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:12.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb551e00700 1 -- 172.21.15.49:0/504566113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb554155d20 msgr2=0x7fb5540ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:12.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb551e00700 1 --2- 172.21.15.49:0/504566113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb554155d20 0x7fb5540ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:12.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb551e00700 1 -- 172.21.15.49:0/504566113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5540a8e50 msgr2=0x7fb554142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:12.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb551e00700 1 --2- 172.21.15.49:0/504566113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5540a8e50 0x7fb554142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:12.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb551e00700 1 -- 172.21.15.49:0/504566113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5440092a0 con 0x7fb554066070 2024-01-22T05:13:12.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb551e00700 1 --2- 172.21.15.49:0/504566113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb554066070 0x7fb5541511f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7fb544009d50 tx=0x7fb544016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:12.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb549600700 1 -- 172.21.15.49:0/504566113 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544000c90 con 0x7fb554066070 2024-01-22T05:13:12.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb549600700 1 -- 172.21.15.49:0/504566113 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54400d770 con 0x7fb554066070 2024-01-22T05:13:12.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb549600700 1 -- 172.21.15.49:0/504566113 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54401d640 con 0x7fb554066070 2024-01-22T05:13:12.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb559000700 1 -- 172.21.15.49:0/504566113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5541563a0 con 0x7fb554066070 2024-01-22T05:13:12.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.341+0000 7fb559000700 1 -- 172.21.15.49:0/504566113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb554156960 con 0x7fb554066070 2024-01-22T05:13:12.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.345+0000 7fb559000700 1 -- 172.21.15.49:0/504566113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5540bb660 con 0x7fb554066070 2024-01-22T05:13:12.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.345+0000 7fb549600700 1 -- 172.21.15.49:0/504566113 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb54401da70 con 0x7fb554066070 2024-01-22T05:13:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.345+0000 7fb549600700 1 --2- 172.21.15.49:0/504566113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb52c05a510 0x7fb52c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:12.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.345+0000 7fb549600700 1 -- 172.21.15.49:0/504566113 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb544076260 con 0x7fb554066070 2024-01-22T05:13:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.349+0000 7fb551400700 1 --2- 172.21.15.49:0/504566113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb52c05a510 0x7fb52c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:12.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.349+0000 7fb551400700 1 --2- 172.21.15.49:0/504566113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb52c05a510 0x7fb52c05c9d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fb5540c0970 tx=0x7fb53c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:12.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.353+0000 7fb549600700 1 -- 172.21.15.49:0/504566113 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb5540bb660 con 0x7fb554066070 2024-01-22T05:13:12.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.569+0000 7fb559000700 1 -- 172.21.15.49:0/504566113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb5540bb660 con 0x7fb554066070 2024-01-22T05:13:12.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.573+0000 7fb549600700 1 -- 172.21.15.49:0/504566113 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1641 (secure 0 0 0) 0x7fb5540bb660 con 0x7fb554066070 2024-01-22T05:13:12.572 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:12.572 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":536,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":104,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075834248,"bytes_used":4647174144,"bytes_avail":768446939136,"bytes_total":773094113280,"write_bytes_sec":23204022,"read_op_per_sec":0,"write_op_per_sec":22},"fsmap":{"epoch":90,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7287}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-01-22T05:13:11.416827+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:13:12.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.577+0000 7fb559000700 1 -- 172.21.15.49:0/504566113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb52c05a510 msgr2=0x7fb52c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:12.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.577+0000 7fb559000700 1 --2- 172.21.15.49:0/504566113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb52c05a510 0x7fb52c05c9d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fb5540c0970 tx=0x7fb53c009040).stop 2024-01-22T05:13:12.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.577+0000 7fb559000700 1 -- 172.21.15.49:0/504566113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb554066070 msgr2=0x7fb5541511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:12.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.577+0000 7fb559000700 1 --2- 172.21.15.49:0/504566113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb554066070 0x7fb5541511f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7fb544009d50 tx=0x7fb544016000).stop 2024-01-22T05:13:12.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.577+0000 7fb559000700 1 -- 172.21.15.49:0/504566113 shutdown_connections 2024-01-22T05:13:12.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.577+0000 7fb559000700 1 --2- 172.21.15.49:0/504566113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb52c05a510 0x7fb52c05c9d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.577+0000 7fb559000700 1 --2- 172.21.15.49:0/504566113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb554155d20 0x7fb5540ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.577+0000 7fb559000700 1 --2- 172.21.15.49:0/504566113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5540a8e50 0x7fb554142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.577+0000 7fb559000700 1 --2- 172.21.15.49:0/504566113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb554066070 0x7fb5541511f0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.577+0000 7fb559000700 1 -- 172.21.15.49:0/504566113 >> 172.21.15.49:0/504566113 conn(0x7fb5540c6540 msgr2=0x7fb554067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.577+0000 7fb559000700 1 -- 172.21.15.49:0/504566113 shutdown_connections 2024-01-22T05:13:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:12.577+0000 7fb559000700 1 -- 172.21.15.49:0/504566113 wait complete. 2024-01-22T05:13:12.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'idle+waiting paths [/scrub_control_test_path]'} 2024-01-22T05:13:13.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:13:13.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.769+0000 7f7b88200700 1 Processor -- start 2024-01-22T05:13:13.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.773+0000 7f7b88200700 1 -- start start 2024-01-22T05:13:13.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.773+0000 7f7b88200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7b80155d20 0x7f7b80065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:13.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.773+0000 7f7b88200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b80066070 0x7f7b800a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:13.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.773+0000 7f7b88200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7b800a8c30 0x7f7b800c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:13.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.773+0000 7f7b88200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b800c1a40 con 0x7f7b800a8c30 2024-01-22T05:13:13.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.773+0000 7f7b88200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b800a9090 con 0x7f7b80155d20 2024-01-22T05:13:13.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.773+0000 7f7b88200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b80159310 con 0x7f7b80066070 2024-01-22T05:13:13.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.773+0000 7f7b86200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7b800a8c30 0x7f7b800c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:13.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.773+0000 7f7b86200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7b800a8c30 0x7f7b800c1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52252/0 (socket says 172.21.15.49:52252) 2024-01-22T05:13:13.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.773+0000 7f7b86200700 1 -- 172.21.15.49:0/130156584 learned_addr learned my addr 172.21.15.49:0/130156584 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:13.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.773+0000 7f7b84e00700 1 --2- 172.21.15.49:0/130156584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b80066070 0x7f7b800a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:13.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.773+0000 7f7b85800700 1 --2- 172.21.15.49:0/130156584 >> v2:172.21.15.110:3300/0 conn(0x7f7b80155d20 0x7f7b80065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:13.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b86200700 1 -- 172.21.15.49:0/130156584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b80066070 msgr2=0x7f7b800a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:13.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b86200700 1 --2- 172.21.15.49:0/130156584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b80066070 0x7f7b800a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:13.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b86200700 1 -- 172.21.15.49:0/130156584 >> v2:172.21.15.110:3300/0 conn(0x7f7b80155d20 msgr2=0x7f7b80065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:13.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b86200700 1 --2- 172.21.15.49:0/130156584 >> v2:172.21.15.110:3300/0 conn(0x7f7b80155d20 0x7f7b80065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:13.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b86200700 1 -- 172.21.15.49:0/130156584 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b800c13f0 con 0x7f7b800a8c30 2024-01-22T05:13:13.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b86200700 1 --2- 172.21.15.49:0/130156584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800a8c30 0x7f7b800c1ed0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f7b8005ff40 tx=0x7f7b78009840).ready entity=mon.0 client_cookie=cfc884b02bdfd07f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:13.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b7fe00700 1 -- 172.21.15.49:0/130156584 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7800e070 con 0x7f7b800a8c30 2024-01-22T05:13:13.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b7fe00700 1 -- 172.21.15.49:0/130156584 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7800b970 con 0x7f7b800a8c30 2024-01-22T05:13:13.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b7fe00700 1 -- 172.21.15.49:0/130156584 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7800bcf0 con 0x7f7b800a8c30 2024-01-22T05:13:13.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b88200700 1 -- 172.21.15.49:0/130156584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800a8c30 msgr2=0x7f7b800c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:13.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b88200700 1 --2- 172.21.15.49:0/130156584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800a8c30 0x7f7b800c1ed0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f7b8005ff40 tx=0x7f7b78009840).stop 2024-01-22T05:13:13.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b88200700 1 -- 172.21.15.49:0/130156584 shutdown_connections 2024-01-22T05:13:13.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b88200700 1 --2- 172.21.15.49:0/130156584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800a8c30 0x7f7b800c1ed0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:13.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b88200700 1 --2- 172.21.15.49:0/130156584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b80066070 0x7f7b800a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:13.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b88200700 1 --2- 172.21.15.49:0/130156584 >> v2:172.21.15.110:3300/0 conn(0x7f7b80155d20 0x7f7b80065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:13.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b88200700 1 -- 172.21.15.49:0/130156584 >> 172.21.15.49:0/130156584 conn(0x7f7b800c6540 msgr2=0x7f7b800c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:13.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b88200700 1 -- 172.21.15.49:0/130156584 shutdown_connections 2024-01-22T05:13:13.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.777+0000 7f7b88200700 1 -- 172.21.15.49:0/130156584 wait complete. 2024-01-22T05:13:13.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.781+0000 7f7b88200700 1 Processor -- start 2024-01-22T05:13:13.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.781+0000 7f7b88200700 1 -- start start 2024-01-22T05:13:13.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b88200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b80066070 0x7f7b80144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:13.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b88200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800a8c30 0x7f7b800c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:13.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b88200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b80155d20 0x7f7b800c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:13.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b88200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800c7300 con 0x7f7b800a8c30 2024-01-22T05:13:13.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b88200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b80144d80 con 0x7f7b80155d20 2024-01-22T05:13:13.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b88200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800aac70 con 0x7f7b80066070 2024-01-22T05:13:13.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b84e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800a8c30 0x7f7b800c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:13.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b84e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800a8c30 0x7f7b800c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52264/0 (socket says 172.21.15.49:52264) 2024-01-22T05:13:13.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b84e00700 1 -- 172.21.15.49:0/334830735 learned_addr learned my addr 172.21.15.49:0/334830735 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:13.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b86200700 1 --2- 172.21.15.49:0/334830735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b80155d20 0x7f7b800c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:13.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b85800700 1 --2- 172.21.15.49:0/334830735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b80066070 0x7f7b80144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:13.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b84e00700 1 -- 172.21.15.49:0/334830735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b80066070 msgr2=0x7f7b80144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:13.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b84e00700 1 --2- 172.21.15.49:0/334830735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b80066070 0x7f7b80144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:13.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b84e00700 1 -- 172.21.15.49:0/334830735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b80155d20 msgr2=0x7f7b800c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:13.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b84e00700 1 --2- 172.21.15.49:0/334830735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b80155d20 0x7f7b800c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:13.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b84e00700 1 -- 172.21.15.49:0/334830735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b78009ae0 con 0x7f7b800a8c30 2024-01-22T05:13:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b86200700 1 --2- 172.21.15.49:0/334830735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b80155d20 0x7f7b800c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.785+0000 7f7b84e00700 1 --2- 172.21.15.49:0/334830735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800a8c30 0x7f7b800c6920 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f7b6800e980 tx=0x7f7b68009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.789+0000 7f7b7cc00700 1 -- 172.21.15.49:0/334830735 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b68012600 con 0x7f7b800a8c30 2024-01-22T05:13:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.789+0000 7f7b7cc00700 1 -- 172.21.15.49:0/334830735 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b68012760 con 0x7f7b800a8c30 2024-01-22T05:13:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.789+0000 7f7b88200700 1 -- 172.21.15.49:0/334830735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b800aa060 con 0x7f7b800a8c30 2024-01-22T05:13:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.789+0000 7f7b7cc00700 1 -- 172.21.15.49:0/334830735 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b68012ae0 con 0x7f7b800a8c30 2024-01-22T05:13:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.789+0000 7f7b88200700 1 -- 172.21.15.49:0/334830735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b800aa620 con 0x7f7b800a8c30 2024-01-22T05:13:13.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.789+0000 7f7b7cc00700 1 -- 172.21.15.49:0/334830735 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7b6801b400 con 0x7f7b800a8c30 2024-01-22T05:13:13.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.789+0000 7f7b88200700 1 -- 172.21.15.49:0/334830735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b800a8740 con 0x7f7b800a8c30 2024-01-22T05:13:13.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.789+0000 7f7b7cc00700 1 --2- 172.21.15.49:0/334830735 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7b5805a510 0x7f7b5805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:13.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.789+0000 7f7b7cc00700 1 -- 172.21.15.49:0/334830735 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7b68074d60 con 0x7f7b800a8c30 2024-01-22T05:13:13.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.793+0000 7f7b85800700 1 --2- 172.21.15.49:0/334830735 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7b5805a510 0x7f7b5805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:13.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.793+0000 7f7b85800700 1 --2- 172.21.15.49:0/334830735 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7b5805a510 0x7f7b5805c9d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f7b800ac680 tx=0x7f7b70009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:13.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:13.797+0000 7f7b7cc00700 1 -- 172.21.15.49:0/334830735 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7b800a8740 con 0x7f7b800a8c30 2024-01-22T05:13:14.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.005+0000 7f7b88200700 1 -- 172.21.15.49:0/334830735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b800a8740 con 0x7f7b800a8c30 2024-01-22T05:13:14.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.009+0000 7f7b7cc00700 1 -- 172.21.15.49:0/334830735 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f7b800a8740 con 0x7f7b800a8c30 2024-01-22T05:13:14.008 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:14.008 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2953480069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2953480069},{"type":"v1","addr":"172.21.15.110:6833","nonce":2953480069}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2000522159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2000522159},{"type":"v1","addr":"172.21.15.110:6835","nonce":2000522159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/578632238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":578632238},{"type":"v1","addr":"172.21.15.49:6836","nonce":578632238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:12:25.842913+0000","modified":"2024-01-22T05:12:28.864832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7287":{"gid":7287,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/1226995696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1226995696},{"type":"v1","addr":"172.21.15.49:6837","nonce":1226995696}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-22T05:13:14.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.013+0000 7f7b88200700 1 -- 172.21.15.49:0/334830735 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7b5805a510 msgr2=0x7f7b5805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:14.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.013+0000 7f7b88200700 1 --2- 172.21.15.49:0/334830735 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7b5805a510 0x7f7b5805c9d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f7b800ac680 tx=0x7f7b70009060).stop 2024-01-22T05:13:14.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.013+0000 7f7b88200700 1 -- 172.21.15.49:0/334830735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800a8c30 msgr2=0x7f7b800c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:14.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.013+0000 7f7b88200700 1 --2- 172.21.15.49:0/334830735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800a8c30 0x7f7b800c6920 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f7b6800e980 tx=0x7f7b68009060).stop 2024-01-22T05:13:14.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.013+0000 7f7b88200700 1 -- 172.21.15.49:0/334830735 shutdown_connections 2024-01-22T05:13:14.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.013+0000 7f7b88200700 1 --2- 172.21.15.49:0/334830735 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7b5805a510 0x7f7b5805c9d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:14.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.013+0000 7f7b88200700 1 --2- 172.21.15.49:0/334830735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b80155d20 0x7f7b800c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:14.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.013+0000 7f7b88200700 1 --2- 172.21.15.49:0/334830735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800a8c30 0x7f7b800c6920 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:14.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.013+0000 7f7b88200700 1 --2- 172.21.15.49:0/334830735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b80066070 0x7f7b80144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:14.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.013+0000 7f7b88200700 1 -- 172.21.15.49:0/334830735 >> 172.21.15.49:0/334830735 conn(0x7f7b800c6540 msgr2=0x7f7b80068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:14.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.013+0000 7f7b88200700 1 -- 172.21.15.49:0/334830735 shutdown_connections 2024-01-22T05:13:14.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.013+0000 7f7b88200700 1 -- 172.21.15.49:0/334830735 wait complete. 2024-01-22T05:13:14.017 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 90 2024-01-22T05:13:14.038 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-01-22T05:13:14.038 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:13:14.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.193+0000 7f6471600700 1 Processor -- start 2024-01-22T05:13:14.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.193+0000 7f6471600700 1 -- start start 2024-01-22T05:13:14.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.193+0000 7f6471600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f646c064c00 0x7f646c0bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:14.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.193+0000 7f6471600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f646c065620 0x7f646c0bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:14.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.193+0000 7f6471600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646c0c2700 con 0x7f646c065240 2024-01-22T05:13:14.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.193+0000 7f6471600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646c0c29a0 con 0x7f646c065620 2024-01-22T05:13:14.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.193+0000 7f6471600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0c2c80 con 0x7f646c064c00 2024-01-22T05:13:14.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f646be00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f646c065620 0x7f646c0bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:14.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f646a000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f646c064c00 0x7f646c0bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:14.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f646be00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f646c065620 0x7f646c0bd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:45566/0 (socket says 172.21.15.49:45566) 2024-01-22T05:13:14.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f646a000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f646c064c00 0x7f646c0bcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:40382/0 (socket says 172.21.15.49:40382) 2024-01-22T05:13:14.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f646be00700 1 -- 172.21.15.49:0/2910061959 learned_addr learned my addr 172.21.15.49:0/2910061959 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f646be00700 1 -- 172.21.15.49:0/2910061959 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f646c064c00 msgr2=0x7f646c0bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f646be00700 1 --2- 172.21.15.49:0/2910061959 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f646c064c00 0x7f646c0bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f646be00700 1 -- 172.21.15.49:0/2910061959 >> v1:172.21.15.110:6789/0 conn(0x7f646c065240 legacy=0x7f646c0644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f646be00700 1 -- 172.21.15.49:0/2910061959 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c0c2f60 con 0x7f646c065620 2024-01-22T05:13:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f646a000700 1 --2- 172.21.15.49:0/2910061959 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f646c064c00 0x7f646c0bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:14.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f646be00700 1 --2- 172.21.15.49:0/2910061959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f646c065620 0x7f646c0bd170 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f6464009f20 tx=0x7f6464009840).ready entity=mon.1 client_cookie=5f36557553713cba server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:14.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f6469600700 1 -- 172.21.15.49:0/2910061959 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646400e070 con 0x7f646c065620 2024-01-22T05:13:14.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f6469600700 1 -- 172.21.15.49:0/2910061959 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646400b9d0 con 0x7f646c065620 2024-01-22T05:13:14.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f6469600700 1 -- 172.21.15.49:0/2910061959 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646400bd50 con 0x7f646c065620 2024-01-22T05:13:14.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f6471600700 1 -- 172.21.15.49:0/2910061959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f646c065620 msgr2=0x7f646c0bd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:14.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f6471600700 1 --2- 172.21.15.49:0/2910061959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f646c065620 0x7f646c0bd170 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f6464009f20 tx=0x7f6464009840).stop 2024-01-22T05:13:14.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f6471600700 1 -- 172.21.15.49:0/2910061959 shutdown_connections 2024-01-22T05:13:14.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f6471600700 1 --2- 172.21.15.49:0/2910061959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f646c065620 0x7f646c0bd170 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:14.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f6471600700 1 --2- 172.21.15.49:0/2910061959 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f646c064c00 0x7f646c0bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:14.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.197+0000 7f6471600700 1 -- 172.21.15.49:0/2910061959 >> 172.21.15.49:0/2910061959 conn(0x7f646c0c87f0 msgr2=0x7f646c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:14.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.201+0000 7f6471600700 1 -- 172.21.15.49:0/2910061959 shutdown_connections 2024-01-22T05:13:14.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.201+0000 7f6471600700 1 -- 172.21.15.49:0/2910061959 wait complete. 2024-01-22T05:13:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.201+0000 7f6471600700 1 Processor -- start 2024-01-22T05:13:14.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.201+0000 7f6471600700 1 -- start start 2024-01-22T05:13:14.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f6471600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f646c064c00 0x7f646c16b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:14.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f6471600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f646c065240 0x7f646c0aa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:14.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f6471600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f646c065620 0x7f646c148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:14.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f6471600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c16c7a0 con 0x7f646c065620 2024-01-22T05:13:14.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f6471600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c16bcf0 con 0x7f646c064c00 2024-01-22T05:13:14.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f6471600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0aa4f0 con 0x7f646c065240 2024-01-22T05:13:14.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f646be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f646c065620 0x7f646c148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:14.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f646a000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f646c065240 0x7f646c0aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:14.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f646aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f646c064c00 0x7f646c16b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f646a000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f646c065240 0x7f646c0aa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:40386/0 (socket says 172.21.15.49:40386) 2024-01-22T05:13:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f646a000700 1 -- 172.21.15.49:0/1870219052 learned_addr learned my addr 172.21.15.49:0/1870219052 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f646a000700 1 -- 172.21.15.49:0/1870219052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f646c064c00 msgr2=0x7f646c16b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f646a000700 1 --2- 172.21.15.49:0/1870219052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f646c064c00 0x7f646c16b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:14.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f646a000700 1 -- 172.21.15.49:0/1870219052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f646c065620 msgr2=0x7f646c148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f646a000700 1 --2- 172.21.15.49:0/1870219052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f646c065620 0x7f646c148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f646a000700 1 -- 172.21.15.49:0/1870219052 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64540092a0 con 0x7f646c065240 2024-01-22T05:13:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f646be00700 1 --2- 172.21.15.49:0/1870219052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f646c065620 0x7f646c148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:14.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f646a000700 1 --2- 172.21.15.49:0/1870219052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f646c065240 0x7f646c0aa000 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f645400ea50 tx=0x7f6454009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:14.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f6462000700 1 -- 172.21.15.49:0/1870219052 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645400c640 con 0x7f646c065240 2024-01-22T05:13:14.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f6462000700 1 -- 172.21.15.49:0/1870219052 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645400c7a0 con 0x7f646c065240 2024-01-22T05:13:14.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f6471600700 1 -- 172.21.15.49:0/1870219052 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6464009ae0 con 0x7f646c065240 2024-01-22T05:13:14.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.205+0000 7f6462000700 1 -- 172.21.15.49:0/1870219052 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645400cb20 con 0x7f646c065240 2024-01-22T05:13:14.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.209+0000 7f6471600700 1 -- 172.21.15.49:0/1870219052 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646c16bf00 con 0x7f646c065240 2024-01-22T05:13:14.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.209+0000 7f6471600700 1 -- 172.21.15.49:0/1870219052 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646c168680 con 0x7f646c065240 2024-01-22T05:13:14.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.209+0000 7f6462000700 1 -- 172.21.15.49:0/1870219052 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f64540123f0 con 0x7f646c065240 2024-01-22T05:13:14.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.213+0000 7f6462000700 1 --2- 172.21.15.49:0/1870219052 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f644405a540 0x7f644405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:14.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.213+0000 7f6462000700 1 -- 172.21.15.49:0/1870219052 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f6454074750 con 0x7f646c065240 2024-01-22T05:13:14.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.213+0000 7f646aa00700 1 --2- 172.21.15.49:0/1870219052 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f644405a540 0x7f644405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:14.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.213+0000 7f646aa00700 1 --2- 172.21.15.49:0/1870219052 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f644405a540 0x7f644405ca00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f645c003900 tx=0x7f645c007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:14.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.221+0000 7f6462000700 1 -- 172.21.15.49:0/1870219052 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6454047d70 con 0x7f646c065240 2024-01-22T05:13:14.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.441+0000 7f6471600700 1 -- 172.21.15.49:0/1870219052 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f646c047060 con 0x7f646c065240 2024-01-22T05:13:14.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.445+0000 7f6462000700 1 -- 172.21.15.49:0/1870219052 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1642 (secure 0 0 0) 0x7f645404b390 con 0x7f646c065240 2024-01-22T05:13:14.445 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:14.445 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":538,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":104,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1078,"data_bytes":1075883791,"bytes_used":4647272448,"bytes_avail":768446840832,"bytes_total":773094113280,"write_bytes_sec":23259874,"read_op_per_sec":0,"write_op_per_sec":197},"fsmap":{"epoch":90,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7287}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-01-22T05:13:11.416827+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:13:14.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.449+0000 7f6471600700 1 -- 172.21.15.49:0/1870219052 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f644405a540 msgr2=0x7f644405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:14.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.449+0000 7f6471600700 1 --2- 172.21.15.49:0/1870219052 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f644405a540 0x7f644405ca00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f645c003900 tx=0x7f645c007d40).stop 2024-01-22T05:13:14.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.449+0000 7f6471600700 1 -- 172.21.15.49:0/1870219052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f646c065240 msgr2=0x7f646c0aa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:14.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.449+0000 7f6471600700 1 --2- 172.21.15.49:0/1870219052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f646c065240 0x7f646c0aa000 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f645400ea50 tx=0x7f6454009060).stop 2024-01-22T05:13:14.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.449+0000 7f6471600700 1 -- 172.21.15.49:0/1870219052 shutdown_connections 2024-01-22T05:13:14.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.449+0000 7f6471600700 1 --2- 172.21.15.49:0/1870219052 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f644405a540 0x7f644405ca00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:14.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.449+0000 7f6471600700 1 --2- 172.21.15.49:0/1870219052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f646c065620 0x7f646c148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:14.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.449+0000 7f6471600700 1 --2- 172.21.15.49:0/1870219052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f646c065240 0x7f646c0aa000 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:14.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.449+0000 7f6471600700 1 --2- 172.21.15.49:0/1870219052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f646c064c00 0x7f646c16b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:14.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.449+0000 7f6471600700 1 -- 172.21.15.49:0/1870219052 >> 172.21.15.49:0/1870219052 conn(0x7f646c0c87f0 msgr2=0x7f646c0ad650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:14.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.449+0000 7f6471600700 1 -- 172.21.15.49:0/1870219052 shutdown_connections 2024-01-22T05:13:14.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:14.449+0000 7f6471600700 1 -- 172.21.15.49:0/1870219052 wait complete. 2024-01-22T05:13:14.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'idle+waiting paths [/scrub_control_test_path]'} 2024-01-22T05:13:15.474 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:13:15.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.629+0000 7fc732c00700 1 Processor -- start 2024-01-22T05:13:15.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.629+0000 7fc732c00700 1 -- start start 2024-01-22T05:13:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc732c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc72c155d20 0x7fc72c065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc732c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc72c0a8e50 0x7fc72c0c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc732c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72c0c1a40 con 0x7fc72c066070 2024-01-22T05:13:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc732c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72c159310 con 0x7fc72c0a8e50 2024-01-22T05:13:15.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc732c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72c0c13f0 con 0x7fc72c155d20 2024-01-22T05:13:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc730c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc72c0a8e50 0x7fc72c0c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc730c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc72c0a8e50 0x7fc72c0c1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52286/0 (socket says 172.21.15.49:52286) 2024-01-22T05:13:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc730c00700 1 -- 172.21.15.49:0/1617424954 learned_addr learned my addr 172.21.15.49:0/1617424954 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc72be00700 1 --2- 172.21.15.49:0/1617424954 >> v2:172.21.15.110:3300/0 conn(0x7fc72c155d20 0x7fc72c065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc730c00700 1 -- 172.21.15.49:0/1617424954 >> v2:172.21.15.110:3300/0 conn(0x7fc72c155d20 msgr2=0x7fc72c065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc730c00700 1 --2- 172.21.15.49:0/1617424954 >> v2:172.21.15.110:3300/0 conn(0x7fc72c155d20 0x7fc72c065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:15.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc730c00700 1 -- 172.21.15.49:0/1617424954 >> v1:172.21.15.110:6789/0 conn(0x7fc72c066070 legacy=0x7fc72c0a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc730c00700 1 -- 172.21.15.49:0/1617424954 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c0c16d0 con 0x7fc72c0a8e50 2024-01-22T05:13:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc730c00700 1 --2- 172.21.15.49:0/1617424954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc72c0a8e50 0x7fc72c0c1ed0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7fc72c05ff40 tx=0x7fc724009840).ready entity=mon.0 client_cookie=7a34ba73cea90721 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc72aa00700 1 -- 172.21.15.49:0/1617424954 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72400e070 con 0x7fc72c0a8e50 2024-01-22T05:13:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc72aa00700 1 -- 172.21.15.49:0/1617424954 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72400ba50 con 0x7fc72c0a8e50 2024-01-22T05:13:15.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.633+0000 7fc72aa00700 1 -- 172.21.15.49:0/1617424954 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72400bdd0 con 0x7fc72c0a8e50 2024-01-22T05:13:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.637+0000 7fc732c00700 1 -- 172.21.15.49:0/1617424954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc72c0a8e50 msgr2=0x7fc72c0c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.637+0000 7fc732c00700 1 --2- 172.21.15.49:0/1617424954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc72c0a8e50 0x7fc72c0c1ed0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7fc72c05ff40 tx=0x7fc724009840).stop 2024-01-22T05:13:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.637+0000 7fc732c00700 1 -- 172.21.15.49:0/1617424954 shutdown_connections 2024-01-22T05:13:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.637+0000 7fc732c00700 1 --2- 172.21.15.49:0/1617424954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc72c0a8e50 0x7fc72c0c1ed0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.637+0000 7fc732c00700 1 --2- 172.21.15.49:0/1617424954 >> v2:172.21.15.110:3300/0 conn(0x7fc72c155d20 0x7fc72c065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:15.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.637+0000 7fc732c00700 1 -- 172.21.15.49:0/1617424954 >> 172.21.15.49:0/1617424954 conn(0x7fc72c0c6540 msgr2=0x7fc72c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:15.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.637+0000 7fc732c00700 1 -- 172.21.15.49:0/1617424954 shutdown_connections 2024-01-22T05:13:15.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.637+0000 7fc732c00700 1 -- 172.21.15.49:0/1617424954 wait complete. 2024-01-22T05:13:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.637+0000 7fc732c00700 1 Processor -- start 2024-01-22T05:13:15.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc732c00700 1 -- start start 2024-01-22T05:13:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc732c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc72c066070 0x7fc72c1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc732c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc72c0a8e50 0x7fc72c0a7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc732c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc72c155d20 0x7fc72c168890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc732c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0bd710 con 0x7fc72c066070 2024-01-22T05:13:15.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc732c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0ab1d0 con 0x7fc72c155d20 2024-01-22T05:13:15.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc732c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0ab650 con 0x7fc72c0a8e50 2024-01-22T05:13:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc72be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc72c066070 0x7fc72c1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc72be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc72c066070 0x7fc72c1536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52290/0 (socket says 172.21.15.49:52290) 2024-01-22T05:13:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc72be00700 1 -- 172.21.15.49:0/390408779 learned_addr learned my addr 172.21.15.49:0/390408779 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc730c00700 1 --2- 172.21.15.49:0/390408779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc72c155d20 0x7fc72c168890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc72b400700 1 --2- 172.21.15.49:0/390408779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc72c0a8e50 0x7fc72c0a7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc72be00700 1 -- 172.21.15.49:0/390408779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc72c0a8e50 msgr2=0x7fc72c0a7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc72be00700 1 --2- 172.21.15.49:0/390408779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc72c0a8e50 0x7fc72c0a7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc72be00700 1 -- 172.21.15.49:0/390408779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc72c155d20 msgr2=0x7fc72c168890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc72be00700 1 --2- 172.21.15.49:0/390408779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc72c155d20 0x7fc72c168890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc72be00700 1 -- 172.21.15.49:0/390408779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc724009ae0 con 0x7fc72c066070 2024-01-22T05:13:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc730c00700 1 --2- 172.21.15.49:0/390408779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc72c155d20 0x7fc72c168890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:15.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc72be00700 1 --2- 172.21.15.49:0/390408779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc72c066070 0x7fc72c1536b0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7fc71c00d860 tx=0x7fc71c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc723400700 1 -- 172.21.15.49:0/390408779 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c011590 con 0x7fc72c066070 2024-01-22T05:13:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc723400700 1 -- 172.21.15.49:0/390408779 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71c0116f0 con 0x7fc72c066070 2024-01-22T05:13:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc732c00700 1 -- 172.21.15.49:0/390408779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72c0ab930 con 0x7fc72c066070 2024-01-22T05:13:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.641+0000 7fc723400700 1 -- 172.21.15.49:0/390408779 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c011a70 con 0x7fc72c066070 2024-01-22T05:13:15.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.645+0000 7fc732c00700 1 -- 172.21.15.49:0/390408779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72c0abef0 con 0x7fc72c066070 2024-01-22T05:13:15.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.645+0000 7fc732c00700 1 -- 172.21.15.49:0/390408779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72c047060 con 0x7fc72c066070 2024-01-22T05:13:15.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.645+0000 7fc723400700 1 -- 172.21.15.49:0/390408779 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc71c012420 con 0x7fc72c066070 2024-01-22T05:13:15.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.649+0000 7fc723400700 1 --2- 172.21.15.49:0/390408779 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc70405a540 0x7fc70405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:15.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.649+0000 7fc723400700 1 -- 172.21.15.49:0/390408779 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc71c074370 con 0x7fc72c066070 2024-01-22T05:13:15.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.649+0000 7fc72b400700 1 --2- 172.21.15.49:0/390408779 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc70405a540 0x7fc70405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:15.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.649+0000 7fc72b400700 1 --2- 172.21.15.49:0/390408779 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc70405a540 0x7fc70405ca00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fc72c0aadf0 tx=0x7fc714009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:15.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.653+0000 7fc723400700 1 -- 172.21.15.49:0/390408779 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc71c047990 con 0x7fc72c066070 2024-01-22T05:13:15.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.853+0000 7fc732c00700 1 -- 172.21.15.49:0/390408779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc72c0c23c0 con 0x7fc72c066070 2024-01-22T05:13:15.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.853+0000 7fc723400700 1 -- 172.21.15.49:0/390408779 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fc71c011e60 con 0x7fc72c066070 2024-01-22T05:13:15.855 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:15.855 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2953480069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2953480069},{"type":"v1","addr":"172.21.15.110:6833","nonce":2953480069}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2000522159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2000522159},{"type":"v1","addr":"172.21.15.110:6835","nonce":2000522159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/578632238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":578632238},{"type":"v1","addr":"172.21.15.49:6836","nonce":578632238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:12:25.842913+0000","modified":"2024-01-22T05:12:28.864832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7287":{"gid":7287,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/1226995696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1226995696},{"type":"v1","addr":"172.21.15.49:6837","nonce":1226995696}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-22T05:13:15.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.857+0000 7fc732c00700 1 -- 172.21.15.49:0/390408779 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc70405a540 msgr2=0x7fc70405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:15.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.857+0000 7fc732c00700 1 --2- 172.21.15.49:0/390408779 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc70405a540 0x7fc70405ca00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fc72c0aadf0 tx=0x7fc714009040).stop 2024-01-22T05:13:15.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.857+0000 7fc732c00700 1 -- 172.21.15.49:0/390408779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc72c066070 msgr2=0x7fc72c1536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:15.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.857+0000 7fc732c00700 1 --2- 172.21.15.49:0/390408779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc72c066070 0x7fc72c1536b0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7fc71c00d860 tx=0x7fc71c008040).stop 2024-01-22T05:13:15.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.857+0000 7fc732c00700 1 -- 172.21.15.49:0/390408779 shutdown_connections 2024-01-22T05:13:15.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.857+0000 7fc732c00700 1 --2- 172.21.15.49:0/390408779 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc70405a540 0x7fc70405ca00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:15.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.857+0000 7fc732c00700 1 --2- 172.21.15.49:0/390408779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc72c155d20 0x7fc72c168890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:15.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.857+0000 7fc732c00700 1 --2- 172.21.15.49:0/390408779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc72c0a8e50 0x7fc72c0a7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:15.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.857+0000 7fc732c00700 1 --2- 172.21.15.49:0/390408779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc72c066070 0x7fc72c1536b0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:15.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.857+0000 7fc732c00700 1 -- 172.21.15.49:0/390408779 >> 172.21.15.49:0/390408779 conn(0x7fc72c0c6540 msgr2=0x7fc72c067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:15.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.857+0000 7fc732c00700 1 -- 172.21.15.49:0/390408779 shutdown_connections 2024-01-22T05:13:15.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:15.857+0000 7fc732c00700 1 -- 172.21.15.49:0/390408779 wait complete. 2024-01-22T05:13:15.863 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 90 2024-01-22T05:13:15.881 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-01-22T05:13:15.881 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:13:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.033+0000 7f67bfe00700 1 Processor -- start 2024-01-22T05:13:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.037+0000 7f67bfe00700 1 -- start start 2024-01-22T05:13:16.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.037+0000 7f67bfe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f67b81584e0 0x7f67b8158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:16.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.037+0000 7f67bfe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67b80c2ad0 0x7f67b80bc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:16.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.037+0000 7f67bfe00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b815c820 con 0x7f67b80bc190 2024-01-22T05:13:16.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.037+0000 7f67bfe00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b80bcfb0 con 0x7f67b81584e0 2024-01-22T05:13:16.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.037+0000 7f67bfe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b81588c0 con 0x7f67b80c2ad0 2024-01-22T05:13:16.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.037+0000 7f67bd400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f67b81584e0 0x7f67b8158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:16.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.037+0000 7f67bca00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f67b80bc190 0x7f67b80626e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39286/0 (socket says 172.21.15.49:39286) 2024-01-22T05:13:16.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.037+0000 7f67bca00700 1 -- 172.21.15.49:0/59935883 learned_addr learned my addr 172.21.15.49:0/59935883 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:16.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.037+0000 7f67bde00700 1 --2- 172.21.15.49:0/59935883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67b80c2ad0 0x7f67b80bc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.037+0000 7f67b7e00700 1 -- 172.21.15.49:0/59935883 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736648510 0 0) 0x7f67b815c820 con 0x7f67b80bc190 2024-01-22T05:13:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.037+0000 7f67b7e00700 1 -- 172.21.15.49:0/59935883 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67980033f0 con 0x7f67b80bc190 2024-01-22T05:13:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67bd400700 1 -- 172.21.15.49:0/59935883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67b80c2ad0 msgr2=0x7f67b80bc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67bd400700 1 --2- 172.21.15.49:0/59935883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67b80c2ad0 0x7f67b80bc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67bd400700 1 -- 172.21.15.49:0/59935883 >> v1:172.21.15.49:6789/0 conn(0x7f67b80bc190 legacy=0x7f67b80626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67bd400700 1 -- 172.21.15.49:0/59935883 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b80bcb00 con 0x7f67b81584e0 2024-01-22T05:13:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67bde00700 1 --2- 172.21.15.49:0/59935883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67b80c2ad0 0x7f67b80bc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:16.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67bd400700 1 --2- 172.21.15.49:0/59935883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b81584e0 0x7f67b8158e90 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f67a8009760 tx=0x7f67a8009060).ready entity=mon.0 client_cookie=9eb1c725d84e714f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:16.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67b7e00700 1 -- 172.21.15.49:0/59935883 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a800d4a0 con 0x7f67b81584e0 2024-01-22T05:13:16.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67b7e00700 1 -- 172.21.15.49:0/59935883 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a800d600 con 0x7f67b81584e0 2024-01-22T05:13:16.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67b7e00700 1 -- 172.21.15.49:0/59935883 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a800d980 con 0x7f67b81584e0 2024-01-22T05:13:16.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67bfe00700 1 -- 172.21.15.49:0/59935883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b81584e0 msgr2=0x7f67b8158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67bfe00700 1 --2- 172.21.15.49:0/59935883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b81584e0 0x7f67b8158e90 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f67a8009760 tx=0x7f67a8009060).stop 2024-01-22T05:13:16.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67bfe00700 1 -- 172.21.15.49:0/59935883 shutdown_connections 2024-01-22T05:13:16.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67bfe00700 1 --2- 172.21.15.49:0/59935883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67b80c2ad0 0x7f67b80bc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:16.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67bfe00700 1 --2- 172.21.15.49:0/59935883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b81584e0 0x7f67b8158e90 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67bfe00700 1 -- 172.21.15.49:0/59935883 >> 172.21.15.49:0/59935883 conn(0x7f67b80c3830 msgr2=0x7f67b80c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67bfe00700 1 -- 172.21.15.49:0/59935883 shutdown_connections 2024-01-22T05:13:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.041+0000 7f67bfe00700 1 -- 172.21.15.49:0/59935883 wait complete. 2024-01-22T05:13:16.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.045+0000 7f67bfe00700 1 Processor -- start 2024-01-22T05:13:16.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.045+0000 7f67bfe00700 1 -- start start 2024-01-22T05:13:16.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b80bc190 0x7f67b80bfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:16.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67b80c2ad0 0x7f67b80684f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:16.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bfe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67b81584e0 0x7f67b80689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:16.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bfe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b8068ed0 con 0x7f67b80bc190 2024-01-22T05:13:16.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bfe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b80bf100 con 0x7f67b80c2ad0 2024-01-22T05:13:16.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bfe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b815ed60 con 0x7f67b81584e0 2024-01-22T05:13:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bd400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b80bc190 0x7f67b80bfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bd400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b80bc190 0x7f67b80bfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52314/0 (socket says 172.21.15.49:52314) 2024-01-22T05:13:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bd400700 1 -- 172.21.15.49:0/778225802 learned_addr learned my addr 172.21.15.49:0/778225802 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bca00700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67b80c2ad0 0x7f67b80684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bde00700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67b81584e0 0x7f67b80689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bd400700 1 -- 172.21.15.49:0/778225802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67b81584e0 msgr2=0x7f67b80689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bd400700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67b81584e0 0x7f67b80689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bd400700 1 -- 172.21.15.49:0/778225802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67b80c2ad0 msgr2=0x7f67b80684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bd400700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67b80c2ad0 0x7f67b80684f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:16.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bd400700 1 -- 172.21.15.49:0/778225802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b0009a20 con 0x7f67b80bc190 2024-01-22T05:13:16.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bde00700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67b81584e0 0x7f67b80689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:13:16.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bca00700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67b80c2ad0 0x7f67b80684f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:13:16.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bd400700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b80bc190 0x7f67b80bfb40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f67a8011fb0 tx=0x7f67a8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:16.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67b4c00700 1 -- 172.21.15.49:0/778225802 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a8000c90 con 0x7f67b80bc190 2024-01-22T05:13:16.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67b4c00700 1 -- 172.21.15.49:0/778225802 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a800d770 con 0x7f67b80bc190 2024-01-22T05:13:16.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bfe00700 1 -- 172.21.15.49:0/778225802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a80092a0 con 0x7f67b80bc190 2024-01-22T05:13:16.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67b4c00700 1 -- 172.21.15.49:0/778225802 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a801d430 con 0x7f67b80bc190 2024-01-22T05:13:16.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.049+0000 7f67bfe00700 1 -- 172.21.15.49:0/778225802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b815f320 con 0x7f67b80bc190 2024-01-22T05:13:16.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.053+0000 7f67bfe00700 1 -- 172.21.15.49:0/778225802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b8069500 con 0x7f67b80bc190 2024-01-22T05:13:16.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.053+0000 7f67b4c00700 1 -- 172.21.15.49:0/778225802 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f67a801d860 con 0x7f67b80bc190 2024-01-22T05:13:16.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.053+0000 7f67b4c00700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f679005a4e0 0x7f679005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:16.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.053+0000 7f67b4c00700 1 -- 172.21.15.49:0/778225802 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f67a8076040 con 0x7f67b80bc190 2024-01-22T05:13:16.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.053+0000 7f67bca00700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f679005a4e0 0x7f679005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:16.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.057+0000 7f67bca00700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f679005a4e0 0x7f679005c9a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f67a0005750 tx=0x7f67a0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:16.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.061+0000 7f67b4c00700 1 -- 172.21.15.49:0/778225802 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f67a80496c0 con 0x7f67b80bc190 2024-01-22T05:13:16.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.289+0000 7f67bfe00700 1 -- 172.21.15.49:0/778225802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f67b815bc10 con 0x7f67b80bc190 2024-01-22T05:13:16.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.289+0000 7f67b4c00700 1 -- 172.21.15.49:0/778225802 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1642 (secure 0 0 0) 0x7f67a804cce0 con 0x7f67b80bc190 2024-01-22T05:13:16.290 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:16.290 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":540,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":104,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1078,"data_bytes":1075883791,"bytes_used":4647272448,"bytes_avail":768446840832,"bytes_total":773094113280,"write_bytes_sec":23259874,"read_op_per_sec":0,"write_op_per_sec":197},"fsmap":{"epoch":90,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7287}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-01-22T05:13:11.416827+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:13:16.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.293+0000 7f67bfe00700 1 -- 172.21.15.49:0/778225802 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f679005a4e0 msgr2=0x7f679005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:16.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.293+0000 7f67bfe00700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f679005a4e0 0x7f679005c9a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f67a0005750 tx=0x7f67a0009040).stop 2024-01-22T05:13:16.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.293+0000 7f67bfe00700 1 -- 172.21.15.49:0/778225802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b80bc190 msgr2=0x7f67b80bfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:16.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.293+0000 7f67bfe00700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b80bc190 0x7f67b80bfb40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f67a8011fb0 tx=0x7f67a8016000).stop 2024-01-22T05:13:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.297+0000 7f67bfe00700 1 -- 172.21.15.49:0/778225802 shutdown_connections 2024-01-22T05:13:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.297+0000 7f67bfe00700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f679005a4e0 0x7f679005c9a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.297+0000 7f67bfe00700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67b81584e0 0x7f67b80689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.297+0000 7f67bfe00700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67b80c2ad0 0x7f67b80684f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.297+0000 7f67bfe00700 1 --2- 172.21.15.49:0/778225802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67b80bc190 0x7f67b80bfb40 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.297+0000 7f67bfe00700 1 -- 172.21.15.49:0/778225802 >> 172.21.15.49:0/778225802 conn(0x7f67b80c3830 msgr2=0x7f67b80665c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.297+0000 7f67bfe00700 1 -- 172.21.15.49:0/778225802 shutdown_connections 2024-01-22T05:13:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:16.297+0000 7f67bfe00700 1 -- 172.21.15.49:0/778225802 wait complete. 2024-01-22T05:13:16.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'idle+waiting paths [/scrub_control_test_path]'} 2024-01-22T05:13:17.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:13:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.497+0000 7f7913000700 1 Processor -- start 2024-01-22T05:13:17.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.497+0000 7f7913000700 1 -- start start 2024-01-22T05:13:17.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f7913000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f790c155d20 0x7f790c065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:17.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f7913000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f790c066070 0x7f790c0a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:17.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f7913000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790c0c1a40 con 0x7f790c0a8c30 2024-01-22T05:13:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f7913000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790c0a9090 con 0x7f790c155d20 2024-01-22T05:13:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f7913000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c159310 con 0x7f790c066070 2024-01-22T05:13:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f7911000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f790c0a8c30 0x7f790c0c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39290/0 (socket says 172.21.15.49:39290) 2024-01-22T05:13:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f7911000700 1 -- 172.21.15.49:0/148695885 learned_addr learned my addr 172.21.15.49:0/148695885 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:17.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f790be00700 1 --2- 172.21.15.49:0/148695885 >> v2:172.21.15.110:3300/0 conn(0x7f790c155d20 0x7f790c065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f790b400700 1 --2- 172.21.15.49:0/148695885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f790c066070 0x7f790c0a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:17.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f790aa00700 1 -- 172.21.15.49:0/148695885 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522632913 0 0) 0x7f790c0c1a40 con 0x7f790c0a8c30 2024-01-22T05:13:17.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f790aa00700 1 -- 172.21.15.49:0/148695885 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78ec0033f0 con 0x7f790c0a8c30 2024-01-22T05:13:17.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f790b400700 1 -- 172.21.15.49:0/148695885 >> v2:172.21.15.110:3300/0 conn(0x7f790c155d20 msgr2=0x7f790c065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:17.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f790b400700 1 --2- 172.21.15.49:0/148695885 >> v2:172.21.15.110:3300/0 conn(0x7f790c155d20 0x7f790c065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:17.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f790b400700 1 -- 172.21.15.49:0/148695885 >> v1:172.21.15.49:6789/0 conn(0x7f790c0a8c30 legacy=0x7f790c0c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:17.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f790b400700 1 -- 172.21.15.49:0/148695885 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c0c13f0 con 0x7f790c066070 2024-01-22T05:13:17.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.501+0000 7f790be00700 1 --2- 172.21.15.49:0/148695885 >> v2:172.21.15.110:3300/0 conn(0x7f790c155d20 0x7f790c065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:17.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.505+0000 7f790b400700 1 --2- 172.21.15.49:0/148695885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f790c066070 0x7f790c0a8740 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f78f4009760 tx=0x7f78f4009060).ready entity=mon.2 client_cookie=4c354b97cd17b50f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:17.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.505+0000 7f790aa00700 1 -- 172.21.15.49:0/148695885 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f400d4a0 con 0x7f790c066070 2024-01-22T05:13:17.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.505+0000 7f790aa00700 1 -- 172.21.15.49:0/148695885 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f400d600 con 0x7f790c066070 2024-01-22T05:13:17.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.505+0000 7f790aa00700 1 -- 172.21.15.49:0/148695885 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f400d980 con 0x7f790c066070 2024-01-22T05:13:17.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.505+0000 7f7913000700 1 -- 172.21.15.49:0/148695885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f790c066070 msgr2=0x7f790c0a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:17.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.505+0000 7f7913000700 1 --2- 172.21.15.49:0/148695885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f790c066070 0x7f790c0a8740 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f78f4009760 tx=0x7f78f4009060).stop 2024-01-22T05:13:17.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.505+0000 7f7913000700 1 -- 172.21.15.49:0/148695885 shutdown_connections 2024-01-22T05:13:17.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.505+0000 7f7913000700 1 --2- 172.21.15.49:0/148695885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f790c066070 0x7f790c0a8740 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:17.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.505+0000 7f7913000700 1 --2- 172.21.15.49:0/148695885 >> v2:172.21.15.110:3300/0 conn(0x7f790c155d20 0x7f790c065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:17.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.505+0000 7f7913000700 1 -- 172.21.15.49:0/148695885 >> 172.21.15.49:0/148695885 conn(0x7f790c0c6540 msgr2=0x7f790c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:17.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.505+0000 7f7913000700 1 -- 172.21.15.49:0/148695885 shutdown_connections 2024-01-22T05:13:17.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.505+0000 7f7913000700 1 -- 172.21.15.49:0/148695885 wait complete. 2024-01-22T05:13:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.509+0000 7f7913000700 1 Processor -- start 2024-01-22T05:13:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.509+0000 7f7913000700 1 -- start start 2024-01-22T05:13:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f7913000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f790c066070 0x7f790c152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f7913000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f790c0a8c30 0x7f790c0a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f7913000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f790c155d20 0x7f790c1688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f7913000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0a9aa0 con 0x7f790c0a8c30 2024-01-22T05:13:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f7913000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0be460 con 0x7f790c066070 2024-01-22T05:13:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f7913000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c168dd0 con 0x7f790c155d20 2024-01-22T05:13:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f790b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f790c0a8c30 0x7f790c0a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f790b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f790c0a8c30 0x7f790c0a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52316/0 (socket says 172.21.15.49:52316) 2024-01-22T05:13:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f790b400700 1 -- 172.21.15.49:0/3351939967 learned_addr learned my addr 172.21.15.49:0/3351939967 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f790be00700 1 --2- 172.21.15.49:0/3351939967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f790c066070 0x7f790c152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f7911000700 1 --2- 172.21.15.49:0/3351939967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f790c155d20 0x7f790c1688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f790b400700 1 -- 172.21.15.49:0/3351939967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f790c155d20 msgr2=0x7f790c1688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f790b400700 1 --2- 172.21.15.49:0/3351939967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f790c155d20 0x7f790c1688e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f790b400700 1 -- 172.21.15.49:0/3351939967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f790c066070 msgr2=0x7f790c152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f790b400700 1 --2- 172.21.15.49:0/3351939967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f790c066070 0x7f790c152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f790b400700 1 -- 172.21.15.49:0/3351939967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc0092a0 con 0x7f790c0a8c30 2024-01-22T05:13:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f790b400700 1 --2- 172.21.15.49:0/3351939967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f790c0a8c30 0x7f790c0a95b0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f78f4009d50 tx=0x7f78f4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:17.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f7903400700 1 -- 172.21.15.49:0/3351939967 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f400dd30 con 0x7f790c0a8c30 2024-01-22T05:13:17.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f7903400700 1 -- 172.21.15.49:0/3351939967 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f400de90 con 0x7f790c0a8c30 2024-01-22T05:13:17.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f7913000700 1 -- 172.21.15.49:0/3351939967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f40092a0 con 0x7f790c0a8c30 2024-01-22T05:13:17.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.513+0000 7f7903400700 1 -- 172.21.15.49:0/3351939967 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f400d980 con 0x7f790c0a8c30 2024-01-22T05:13:17.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.517+0000 7f7913000700 1 -- 172.21.15.49:0/3351939967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790c1698b0 con 0x7f790c0a8c30 2024-01-22T05:13:17.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.517+0000 7f7913000700 1 -- 172.21.15.49:0/3351939967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790c0be8d0 con 0x7f790c0a8c30 2024-01-22T05:13:17.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.521+0000 7f7903400700 1 -- 172.21.15.49:0/3351939967 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f78f401d640 con 0x7f790c0a8c30 2024-01-22T05:13:17.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.521+0000 7f7903400700 1 --2- 172.21.15.49:0/3351939967 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f78e405a540 0x7f78e405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:17.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.521+0000 7f7903400700 1 -- 172.21.15.49:0/3351939967 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f78f4076100 con 0x7f790c0a8c30 2024-01-22T05:13:17.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.521+0000 7f790be00700 1 --2- 172.21.15.49:0/3351939967 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f78e405a540 0x7f78e405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.521+0000 7f790be00700 1 --2- 172.21.15.49:0/3351939967 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f78e405a540 0x7f78e405ca00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f78fc009d20 tx=0x7f78fc009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:17.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.529+0000 7f7903400700 1 -- 172.21.15.49:0/3351939967 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f790c0be8d0 con 0x7f790c0a8c30 2024-01-22T05:13:17.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.737+0000 7f7913000700 1 -- 172.21.15.49:0/3351939967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f790c0be8d0 con 0x7f790c0a8c30 2024-01-22T05:13:17.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.737+0000 7f7903400700 1 -- 172.21.15.49:0/3351939967 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f790c0be8d0 con 0x7f790c0a8c30 2024-01-22T05:13:17.737 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:17.737 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2953480069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2953480069},{"type":"v1","addr":"172.21.15.110:6833","nonce":2953480069}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2000522159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2000522159},{"type":"v1","addr":"172.21.15.110:6835","nonce":2000522159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/578632238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":578632238},{"type":"v1","addr":"172.21.15.49:6836","nonce":578632238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:12:25.842913+0000","modified":"2024-01-22T05:12:28.864832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7287":{"gid":7287,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/1226995696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1226995696},{"type":"v1","addr":"172.21.15.49:6837","nonce":1226995696}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-22T05:13:17.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.741+0000 7f7913000700 1 -- 172.21.15.49:0/3351939967 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f78e405a540 msgr2=0x7f78e405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:17.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.741+0000 7f7913000700 1 --2- 172.21.15.49:0/3351939967 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f78e405a540 0x7f78e405ca00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f78fc009d20 tx=0x7f78fc009060).stop 2024-01-22T05:13:17.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.741+0000 7f7913000700 1 -- 172.21.15.49:0/3351939967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f790c0a8c30 msgr2=0x7f790c0a95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:17.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.741+0000 7f7913000700 1 --2- 172.21.15.49:0/3351939967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f790c0a8c30 0x7f790c0a95b0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f78f4009d50 tx=0x7f78f4016000).stop 2024-01-22T05:13:17.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.741+0000 7f7913000700 1 -- 172.21.15.49:0/3351939967 shutdown_connections 2024-01-22T05:13:17.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.741+0000 7f7913000700 1 --2- 172.21.15.49:0/3351939967 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f78e405a540 0x7f78e405ca00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:17.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.741+0000 7f7913000700 1 --2- 172.21.15.49:0/3351939967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f790c155d20 0x7f790c1688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:17.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.741+0000 7f7913000700 1 --2- 172.21.15.49:0/3351939967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f790c0a8c30 0x7f790c0a95b0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:17.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.741+0000 7f7913000700 1 --2- 172.21.15.49:0/3351939967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f790c066070 0x7f790c152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:17.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.741+0000 7f7913000700 1 -- 172.21.15.49:0/3351939967 >> 172.21.15.49:0/3351939967 conn(0x7f790c0c6540 msgr2=0x7f790c067b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:17.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.741+0000 7f7913000700 1 -- 172.21.15.49:0/3351939967 shutdown_connections 2024-01-22T05:13:17.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.741+0000 7f7913000700 1 -- 172.21.15.49:0/3351939967 wait complete. 2024-01-22T05:13:17.747 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 90 2024-01-22T05:13:17.765 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-01-22T05:13:17.765 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:13:17.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.921+0000 7fa393e00700 1 Processor -- start 2024-01-22T05:13:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.921+0000 7fa393e00700 1 -- start start 2024-01-22T05:13:17.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.921+0000 7fa393e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa38c065240 0x7fa38c0644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:17.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.921+0000 7fa393e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa38c0649e0 0x7fa38c15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:17.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa393e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38c0c2700 con 0x7fa38c065620 2024-01-22T05:13:17.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa393e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38c0c29a0 con 0x7fa38c065240 2024-01-22T05:13:17.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa393e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38c0c2c80 con 0x7fa38c0649e0 2024-01-22T05:13:17.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa391400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa38c065240 0x7fa38c0644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:17.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa391400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa38c065240 0x7fa38c0644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52324/0 (socket says 172.21.15.49:52324) 2024-01-22T05:13:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa391400700 1 -- 172.21.15.49:0/984859005 learned_addr learned my addr 172.21.15.49:0/984859005 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa392800700 1 --2- 172.21.15.49:0/984859005 >> v2:172.21.15.110:3300/0 conn(0x7fa38c0649e0 0x7fa38c15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa391400700 1 -- 172.21.15.49:0/984859005 >> v2:172.21.15.110:3300/0 conn(0x7fa38c0649e0 msgr2=0x7fa38c15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa391400700 1 --2- 172.21.15.49:0/984859005 >> v2:172.21.15.110:3300/0 conn(0x7fa38c0649e0 0x7fa38c15c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa391400700 1 -- 172.21.15.49:0/984859005 >> v1:172.21.15.110:6789/0 conn(0x7fa38c065620 legacy=0x7fa38c15b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa391400700 1 -- 172.21.15.49:0/984859005 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c0c2f60 con 0x7fa38c065240 2024-01-22T05:13:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa391400700 1 --2- 172.21.15.49:0/984859005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa38c065240 0x7fa38c0644f0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7fa38c0665c0 tx=0x7fa37c0090f0).ready entity=mon.0 client_cookie=7eb68cc28ace4397 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa38be00700 1 -- 172.21.15.49:0/984859005 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c00b520 con 0x7fa38c065240 2024-01-22T05:13:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa38be00700 1 -- 172.21.15.49:0/984859005 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c00b680 con 0x7fa38c065240 2024-01-22T05:13:17.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa38be00700 1 -- 172.21.15.49:0/984859005 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c00ba00 con 0x7fa38c065240 2024-01-22T05:13:17.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa393e00700 1 -- 172.21.15.49:0/984859005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa38c065240 msgr2=0x7fa38c0644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:17.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa393e00700 1 --2- 172.21.15.49:0/984859005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa38c065240 0x7fa38c0644f0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7fa38c0665c0 tx=0x7fa37c0090f0).stop 2024-01-22T05:13:17.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa393e00700 1 -- 172.21.15.49:0/984859005 shutdown_connections 2024-01-22T05:13:17.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa393e00700 1 --2- 172.21.15.49:0/984859005 >> v2:172.21.15.110:3300/0 conn(0x7fa38c0649e0 0x7fa38c15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:17.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa393e00700 1 --2- 172.21.15.49:0/984859005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa38c065240 0x7fa38c0644f0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:17.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.925+0000 7fa393e00700 1 -- 172.21.15.49:0/984859005 >> 172.21.15.49:0/984859005 conn(0x7fa38c0c87f0 msgr2=0x7fa38c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:17.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.929+0000 7fa393e00700 1 -- 172.21.15.49:0/984859005 shutdown_connections 2024-01-22T05:13:17.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.929+0000 7fa393e00700 1 -- 172.21.15.49:0/984859005 wait complete. 2024-01-22T05:13:17.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.929+0000 7fa393e00700 1 Processor -- start 2024-01-22T05:13:17.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.929+0000 7fa393e00700 1 -- start start 2024-01-22T05:13:17.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.933+0000 7fa393e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38c0649e0 0x7fa38c169330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:17.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.933+0000 7fa393e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa38c065240 0x7fa38c0aa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:17.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.933+0000 7fa393e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa38c065620 0x7fa38c145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:17.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.933+0000 7fa393e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c169820 con 0x7fa38c065240 2024-01-22T05:13:17.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.933+0000 7fa393e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0a7e90 con 0x7fa38c0649e0 2024-01-22T05:13:17.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.933+0000 7fa393e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0bff90 con 0x7fa38c065620 2024-01-22T05:13:17.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.933+0000 7fa390a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa38c065240 0x7fa38c0aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:17.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.933+0000 7fa390a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa38c065240 0x7fa38c0aa170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52338/0 (socket says 172.21.15.49:52338) 2024-01-22T05:13:17.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.933+0000 7fa390a00700 1 -- 172.21.15.49:0/2220711811 learned_addr learned my addr 172.21.15.49:0/2220711811 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:17.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.933+0000 7fa391400700 1 --2- 172.21.15.49:0/2220711811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38c0649e0 0x7fa38c169330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:17.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.933+0000 7fa392800700 1 --2- 172.21.15.49:0/2220711811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa38c065620 0x7fa38c145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:17.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.937+0000 7fa390a00700 1 -- 172.21.15.49:0/2220711811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa38c065620 msgr2=0x7fa38c145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:17.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.937+0000 7fa390a00700 1 --2- 172.21.15.49:0/2220711811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa38c065620 0x7fa38c145de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:17.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.937+0000 7fa390a00700 1 -- 172.21.15.49:0/2220711811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38c0649e0 msgr2=0x7fa38c169330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:17.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.937+0000 7fa390a00700 1 --2- 172.21.15.49:0/2220711811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38c0649e0 0x7fa38c169330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:17.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.937+0000 7fa390a00700 1 -- 172.21.15.49:0/2220711811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c009370 con 0x7fa38c065240 2024-01-22T05:13:17.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.937+0000 7fa391400700 1 --2- 172.21.15.49:0/2220711811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38c0649e0 0x7fa38c169330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:17.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.937+0000 7fa390a00700 1 --2- 172.21.15.49:0/2220711811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa38c065240 0x7fa38c0aa170 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7fa37400c440 tx=0x7fa374007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:17.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.937+0000 7fa388c00700 1 -- 172.21.15.49:0/2220711811 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374007020 con 0x7fa38c065240 2024-01-22T05:13:17.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.937+0000 7fa388c00700 1 -- 172.21.15.49:0/2220711811 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa374007180 con 0x7fa38c065240 2024-01-22T05:13:17.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.937+0000 7fa393e00700 1 -- 172.21.15.49:0/2220711811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38c0a78d0 con 0x7fa38c065240 2024-01-22T05:13:17.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.937+0000 7fa388c00700 1 -- 172.21.15.49:0/2220711811 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374007520 con 0x7fa38c065240 2024-01-22T05:13:17.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.937+0000 7fa393e00700 1 -- 172.21.15.49:0/2220711811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c0aa660 con 0x7fa38c065240 2024-01-22T05:13:17.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.937+0000 7fa393e00700 1 -- 172.21.15.49:0/2220711811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38c0c0140 con 0x7fa38c065240 2024-01-22T05:13:17.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.941+0000 7fa388c00700 1 -- 172.21.15.49:0/2220711811 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa3740068b0 con 0x7fa38c065240 2024-01-22T05:13:17.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.941+0000 7fa388c00700 1 --2- 172.21.15.49:0/2220711811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa36405a510 0x7fa36405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:17.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.941+0000 7fa388c00700 1 -- 172.21.15.49:0/2220711811 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa374074240 con 0x7fa38c065240 2024-01-22T05:13:17.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.941+0000 7fa391400700 1 --2- 172.21.15.49:0/2220711811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa36405a510 0x7fa36405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:17.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.941+0000 7fa391400700 1 --2- 172.21.15.49:0/2220711811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa36405a510 0x7fa36405c9d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fa37c009130 tx=0x7fa37c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:17.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:17.949+0000 7fa388c00700 1 -- 172.21.15.49:0/2220711811 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa38c0c0140 con 0x7fa38c065240 2024-01-22T05:13:18.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:18.165+0000 7fa393e00700 1 -- 172.21.15.49:0/2220711811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa38c0c0100 con 0x7fa38c065240 2024-01-22T05:13:18.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:18.165+0000 7fa388c00700 1 -- 172.21.15.49:0/2220711811 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1641 (secure 0 0 0) 0x7fa374047800 con 0x7fa38c065240 2024-01-22T05:13:18.165 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:18.165 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":541,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":104,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1078,"data_bytes":1075883791,"bytes_used":4647272448,"bytes_avail":768446840832,"bytes_total":773094113280,"write_bytes_sec":9254452,"read_op_per_sec":0,"write_op_per_sec":183},"fsmap":{"epoch":90,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7287}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-01-22T05:13:11.416827+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:13:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:18.169+0000 7fa393e00700 1 -- 172.21.15.49:0/2220711811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa36405a510 msgr2=0x7fa36405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:18.169+0000 7fa393e00700 1 --2- 172.21.15.49:0/2220711811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa36405a510 0x7fa36405c9d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fa37c009130 tx=0x7fa37c017000).stop 2024-01-22T05:13:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:18.169+0000 7fa393e00700 1 -- 172.21.15.49:0/2220711811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa38c065240 msgr2=0x7fa38c0aa170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:18.169+0000 7fa393e00700 1 --2- 172.21.15.49:0/2220711811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa38c065240 0x7fa38c0aa170 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7fa37400c440 tx=0x7fa374007dd0).stop 2024-01-22T05:13:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:18.169+0000 7fa393e00700 1 -- 172.21.15.49:0/2220711811 shutdown_connections 2024-01-22T05:13:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:18.169+0000 7fa393e00700 1 --2- 172.21.15.49:0/2220711811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa36405a510 0x7fa36405c9d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:18.169+0000 7fa393e00700 1 --2- 172.21.15.49:0/2220711811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa38c065620 0x7fa38c145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:18.169+0000 7fa393e00700 1 --2- 172.21.15.49:0/2220711811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa38c065240 0x7fa38c0aa170 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:18.169+0000 7fa393e00700 1 --2- 172.21.15.49:0/2220711811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38c0649e0 0x7fa38c169330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:18.169+0000 7fa393e00700 1 -- 172.21.15.49:0/2220711811 >> 172.21.15.49:0/2220711811 conn(0x7fa38c0c87f0 msgr2=0x7fa38c0aacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:18.169+0000 7fa393e00700 1 -- 172.21.15.49:0/2220711811 shutdown_connections 2024-01-22T05:13:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:18.169+0000 7fa393e00700 1 -- 172.21.15.49:0/2220711811 wait complete. 2024-01-22T05:13:18.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'idle+waiting paths [/scrub_control_test_path]'} 2024-01-22T05:13:19.194 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:13:19.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.361+0000 7fe07da00700 1 Processor -- start 2024-01-22T05:13:19.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.361+0000 7fe07da00700 1 -- start start 2024-01-22T05:13:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.365+0000 7fe07da00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780c2d70 0x7fe078157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.365+0000 7fe07da00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe078068aa0 0x7fe078068f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.365+0000 7fe07da00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0780c1960 con 0x7fe078066600 2024-01-22T05:13:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.365+0000 7fe07da00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0780672c0 con 0x7fe078068aa0 2024-01-22T05:13:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.365+0000 7fe07da00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780c24c0 con 0x7fe0780c2d70 2024-01-22T05:13:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.365+0000 7fe076000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe078068aa0 0x7fe078068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.365+0000 7fe076000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe078068aa0 0x7fe078068f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52346/0 (socket says 172.21.15.49:52346) 2024-01-22T05:13:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.365+0000 7fe076000700 1 -- 172.21.15.49:0/1169886119 learned_addr learned my addr 172.21.15.49:0/1169886119 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.365+0000 7fe076a00700 1 --2- 172.21.15.49:0/1169886119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780c2d70 0x7fe078157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.365+0000 7fe076000700 1 -- 172.21.15.49:0/1169886119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780c2d70 msgr2=0x7fe078157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.365+0000 7fe076000700 1 --2- 172.21.15.49:0/1169886119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780c2d70 0x7fe078157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.365+0000 7fe076000700 1 -- 172.21.15.49:0/1169886119 >> v1:172.21.15.110:6789/0 conn(0x7fe078066600 legacy=0x7fe078066ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.365+0000 7fe076000700 1 -- 172.21.15.49:0/1169886119 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780693f0 con 0x7fe078068aa0 2024-01-22T05:13:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.365+0000 7fe076000700 1 --2- 172.21.15.49:0/1169886119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe078068aa0 0x7fe078068f00 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7fe060006fd0 tx=0x7fe0600090f0).ready entity=mon.0 client_cookie=91c30d76f2482a75 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:19.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.369+0000 7fe075600700 1 -- 172.21.15.49:0/1169886119 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06000b580 con 0x7fe078068aa0 2024-01-22T05:13:19.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.369+0000 7fe075600700 1 -- 172.21.15.49:0/1169886119 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06000b6e0 con 0x7fe078068aa0 2024-01-22T05:13:19.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.369+0000 7fe075600700 1 -- 172.21.15.49:0/1169886119 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06000ba60 con 0x7fe078068aa0 2024-01-22T05:13:19.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.369+0000 7fe07da00700 1 -- 172.21.15.49:0/1169886119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe078068aa0 msgr2=0x7fe078068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.369+0000 7fe07da00700 1 --2- 172.21.15.49:0/1169886119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe078068aa0 0x7fe078068f00 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7fe060006fd0 tx=0x7fe0600090f0).stop 2024-01-22T05:13:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.369+0000 7fe07da00700 1 -- 172.21.15.49:0/1169886119 shutdown_connections 2024-01-22T05:13:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.369+0000 7fe07da00700 1 --2- 172.21.15.49:0/1169886119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe078068aa0 0x7fe078068f00 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.369+0000 7fe07da00700 1 --2- 172.21.15.49:0/1169886119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780c2d70 0x7fe078157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.369+0000 7fe07da00700 1 -- 172.21.15.49:0/1169886119 >> 172.21.15.49:0/1169886119 conn(0x7fe0780c4300 msgr2=0x7fe078065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:19.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.369+0000 7fe07da00700 1 -- 172.21.15.49:0/1169886119 shutdown_connections 2024-01-22T05:13:19.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.369+0000 7fe07da00700 1 -- 172.21.15.49:0/1169886119 wait complete. 2024-01-22T05:13:19.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.373+0000 7fe07da00700 1 Processor -- start 2024-01-22T05:13:19.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.373+0000 7fe07da00700 1 -- start start 2024-01-22T05:13:19.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe07da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe078066600 0x7fe078159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:19.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe07da00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe078068aa0 0x7fe078157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:19.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe07da00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078159650 0x7fe0780c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:19.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe07da00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07816c060 con 0x7fe078066600 2024-01-22T05:13:19.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe07da00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07816c300 con 0x7fe078159650 2024-01-22T05:13:19.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe07da00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07816c5e0 con 0x7fe078068aa0 2024-01-22T05:13:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe076a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe078066600 0x7fe078159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe076a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe078066600 0x7fe078159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52356/0 (socket says 172.21.15.49:52356) 2024-01-22T05:13:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe076a00700 1 -- 172.21.15.49:0/1313564245 learned_addr learned my addr 172.21.15.49:0/1313564245 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe076000700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe078068aa0 0x7fe078157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe077400700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078159650 0x7fe0780c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe076a00700 1 -- 172.21.15.49:0/1313564245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe078068aa0 msgr2=0x7fe078157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe076a00700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe078068aa0 0x7fe078157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe076a00700 1 -- 172.21.15.49:0/1313564245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078159650 msgr2=0x7fe0780c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe076a00700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078159650 0x7fe0780c04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe076a00700 1 -- 172.21.15.49:0/1313564245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe060009370 con 0x7fe078066600 2024-01-22T05:13:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe077400700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078159650 0x7fe0780c04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:13:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe076000700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe078068aa0 0x7fe078157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:13:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe076a00700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe078066600 0x7fe078159160 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7fe06800e930 tx=0x7fe068009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe06e000700 1 -- 172.21.15.49:0/1313564245 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06800eed0 con 0x7fe078066600 2024-01-22T05:13:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe06e000700 1 -- 172.21.15.49:0/1313564245 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06800c850 con 0x7fe078066600 2024-01-22T05:13:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe07da00700 1 -- 172.21.15.49:0/1313564245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07816c8c0 con 0x7fe078066600 2024-01-22T05:13:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe06e000700 1 -- 172.21.15.49:0/1313564245 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06800cbd0 con 0x7fe078066600 2024-01-22T05:13:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.377+0000 7fe07da00700 1 -- 172.21.15.49:0/1313564245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07815af50 con 0x7fe078066600 2024-01-22T05:13:19.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.381+0000 7fe06e000700 1 -- 172.21.15.49:0/1313564245 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe06801b400 con 0x7fe078066600 2024-01-22T05:13:19.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.381+0000 7fe07da00700 1 -- 172.21.15.49:0/1313564245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe078064b90 con 0x7fe078066600 2024-01-22T05:13:19.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.381+0000 7fe06e000700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05005a510 0x7fe05005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:19.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.381+0000 7fe06e000700 1 -- 172.21.15.49:0/1313564245 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe068074e40 con 0x7fe078066600 2024-01-22T05:13:19.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.381+0000 7fe076000700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05005a510 0x7fe05005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:19.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.385+0000 7fe076000700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05005a510 0x7fe05005c9d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fe060006fd0 tx=0x7fe060017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:19.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.389+0000 7fe06e000700 1 -- 172.21.15.49:0/1313564245 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe068048550 con 0x7fe078066600 2024-01-22T05:13:19.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.593+0000 7fe07da00700 1 -- 172.21.15.49:0/1313564245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0780c1b90 con 0x7fe078066600 2024-01-22T05:13:19.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.593+0000 7fe06e000700 1 -- 172.21.15.49:0/1313564245 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fe06804e1a0 con 0x7fe078066600 2024-01-22T05:13:19.593 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:19.593 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2953480069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2953480069},{"type":"v1","addr":"172.21.15.110:6833","nonce":2953480069}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2000522159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2000522159},{"type":"v1","addr":"172.21.15.110:6835","nonce":2000522159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/578632238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":578632238},{"type":"v1","addr":"172.21.15.49:6836","nonce":578632238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:12:25.842913+0000","modified":"2024-01-22T05:12:28.864832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7287":{"gid":7287,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/1226995696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1226995696},{"type":"v1","addr":"172.21.15.49:6837","nonce":1226995696}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-22T05:13:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.597+0000 7fe07da00700 1 -- 172.21.15.49:0/1313564245 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05005a510 msgr2=0x7fe05005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.597+0000 7fe07da00700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05005a510 0x7fe05005c9d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fe060006fd0 tx=0x7fe060017000).stop 2024-01-22T05:13:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.597+0000 7fe07da00700 1 -- 172.21.15.49:0/1313564245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe078066600 msgr2=0x7fe078159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.597+0000 7fe07da00700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe078066600 0x7fe078159160 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7fe06800e930 tx=0x7fe068009060).stop 2024-01-22T05:13:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.597+0000 7fe07da00700 1 -- 172.21.15.49:0/1313564245 shutdown_connections 2024-01-22T05:13:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.597+0000 7fe07da00700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05005a510 0x7fe05005c9d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.597+0000 7fe07da00700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078159650 0x7fe0780c04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.597+0000 7fe07da00700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe078068aa0 0x7fe078157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.597+0000 7fe07da00700 1 --2- 172.21.15.49:0/1313564245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe078066600 0x7fe078159160 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.597+0000 7fe07da00700 1 -- 172.21.15.49:0/1313564245 >> 172.21.15.49:0/1313564245 conn(0x7fe0780c4300 msgr2=0x7fe078062740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.597+0000 7fe07da00700 1 -- 172.21.15.49:0/1313564245 shutdown_connections 2024-01-22T05:13:19.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.597+0000 7fe07da00700 1 -- 172.21.15.49:0/1313564245 wait complete. 2024-01-22T05:13:19.601 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 90 2024-01-22T05:13:19.620 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-01-22T05:13:19.621 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:13:19.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.781+0000 7fd2eee00700 1 Processor -- start 2024-01-22T05:13:19.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.781+0000 7fd2eee00700 1 -- start start 2024-01-22T05:13:19.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2eee00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2e8065240 0x7fd2e80644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:19.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2eee00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e8064e90 con 0x7fd2e80649e0 2024-01-22T05:13:19.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2eee00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e815c7d0 con 0x7fd2e8065620 2024-01-22T05:13:19.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2eee00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80c2700 con 0x7fd2e8065240 2024-01-22T05:13:19.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2ed800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd2e80649e0 0x7fd2e815c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39298/0 (socket says 172.21.15.49:39298) 2024-01-22T05:13:19.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2ed800700 1 -- 172.21.15.49:0/1557051985 learned_addr learned my addr 172.21.15.49:0/1557051985 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:19.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2e7e00700 1 --2- 172.21.15.49:0/1557051985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2e8065240 0x7fd2e80644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:19.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2e6a00700 1 -- 172.21.15.49:0/1557051985 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239124516 0 0) 0x7fd2e0001490 con 0x7fd2e80649e0 2024-01-22T05:13:19.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2e6a00700 1 -- 172.21.15.49:0/1557051985 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c80033f0 con 0x7fd2e80649e0 2024-01-22T05:13:19.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2e6a00700 1 -- 172.21.15.49:0/1557051985 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195096408 0 0) 0x7fd2e815c7d0 con 0x7fd2e8065620 2024-01-22T05:13:19.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2e6a00700 1 -- 172.21.15.49:0/1557051985 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2e0001490 con 0x7fd2e8065620 2024-01-22T05:13:19.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2e6a00700 1 -- 172.21.15.49:0/1557051985 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1064230329 0 0) 0x7fd2c80033f0 con 0x7fd2e80649e0 2024-01-22T05:13:19.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2e7e00700 1 -- 172.21.15.49:0/1557051985 >> v1:172.21.15.110:6789/0 conn(0x7fd2e8065620 legacy=0x7fd2e815b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:19.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2e7e00700 1 -- 172.21.15.49:0/1557051985 >> v1:172.21.15.49:6789/0 conn(0x7fd2e80649e0 legacy=0x7fd2e815c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:19.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2e7e00700 1 -- 172.21.15.49:0/1557051985 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e80c29a0 con 0x7fd2e8065240 2024-01-22T05:13:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.785+0000 7fd2e7e00700 1 --2- 172.21.15.49:0/1557051985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2e8065240 0x7fd2e80644f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fd2d8009790 tx=0x7fd2d8009060).ready entity=mon.2 client_cookie=47216defaaeca54a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.789+0000 7fd2e6a00700 1 -- 172.21.15.49:0/1557051985 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0001980 con 0x7fd2e8065240 2024-01-22T05:13:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.789+0000 7fd2e6a00700 1 -- 172.21.15.49:0/1557051985 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d8011400 con 0x7fd2e8065240 2024-01-22T05:13:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.789+0000 7fd2e6a00700 1 -- 172.21.15.49:0/1557051985 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8011780 con 0x7fd2e8065240 2024-01-22T05:13:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.789+0000 7fd2eee00700 1 -- 172.21.15.49:0/1557051985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2e8065240 msgr2=0x7fd2e80644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.789+0000 7fd2eee00700 1 --2- 172.21.15.49:0/1557051985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2e8065240 0x7fd2e80644f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fd2d8009790 tx=0x7fd2d8009060).stop 2024-01-22T05:13:19.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.789+0000 7fd2eee00700 1 -- 172.21.15.49:0/1557051985 shutdown_connections 2024-01-22T05:13:19.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.789+0000 7fd2eee00700 1 --2- 172.21.15.49:0/1557051985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2e8065240 0x7fd2e80644f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:19.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.789+0000 7fd2eee00700 1 -- 172.21.15.49:0/1557051985 >> 172.21.15.49:0/1557051985 conn(0x7fd2e80c87f0 msgr2=0x7fd2e80c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:19.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.789+0000 7fd2eee00700 1 -- 172.21.15.49:0/1557051985 shutdown_connections 2024-01-22T05:13:19.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.789+0000 7fd2eee00700 1 -- 172.21.15.49:0/1557051985 wait complete. 2024-01-22T05:13:19.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2eee00700 1 Processor -- start 2024-01-22T05:13:19.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2eee00700 1 -- start start 2024-01-22T05:13:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2eee00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2e80649e0 0x7fd2e80c0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2eee00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2e8065240 0x7fd2e80bedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2eee00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2e8065620 0x7fd2e80a8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2eee00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80c0400 con 0x7fd2e8065620 2024-01-22T05:13:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2eee00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80bf7f0 con 0x7fd2e8065240 2024-01-22T05:13:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2eee00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80bfad0 con 0x7fd2e80649e0 2024-01-22T05:13:19.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2ed800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2e8065620 0x7fd2e80a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:19.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2ed800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2e8065620 0x7fd2e80a8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52372/0 (socket says 172.21.15.49:52372) 2024-01-22T05:13:19.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2ed800700 1 -- 172.21.15.49:0/47919893 learned_addr learned my addr 172.21.15.49:0/47919893 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2e7400700 1 --2- 172.21.15.49:0/47919893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2e8065240 0x7fd2e80bedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2e7e00700 1 --2- 172.21.15.49:0/47919893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2e80649e0 0x7fd2e80c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2ed800700 1 -- 172.21.15.49:0/47919893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2e80649e0 msgr2=0x7fd2e80c0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2ed800700 1 --2- 172.21.15.49:0/47919893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2e80649e0 0x7fd2e80c0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2ed800700 1 -- 172.21.15.49:0/47919893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2e8065240 msgr2=0x7fd2e80bedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2ed800700 1 --2- 172.21.15.49:0/47919893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2e8065240 0x7fd2e80bedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2ed800700 1 -- 172.21.15.49:0/47919893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d80092a0 con 0x7fd2e8065620 2024-01-22T05:13:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.793+0000 7fd2e7e00700 1 --2- 172.21.15.49:0/47919893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2e80649e0 0x7fd2e80c0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.797+0000 7fd2ed800700 1 --2- 172.21.15.49:0/47919893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2e8065620 0x7fd2e80a8700 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fd2e000cc70 tx=0x7fd2e0001f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.797+0000 7fd2df400700 1 -- 172.21.15.49:0/47919893 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000ce20 con 0x7fd2e8065620 2024-01-22T05:13:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.797+0000 7fd2df400700 1 -- 172.21.15.49:0/47919893 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e0004c40 con 0x7fd2e8065620 2024-01-22T05:13:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.797+0000 7fd2eee00700 1 -- 172.21.15.49:0/47919893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e80bfdb0 con 0x7fd2e8065620 2024-01-22T05:13:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.797+0000 7fd2df400700 1 -- 172.21.15.49:0/47919893 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000a920 con 0x7fd2e8065620 2024-01-22T05:13:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.797+0000 7fd2eee00700 1 -- 172.21.15.49:0/47919893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e814a540 con 0x7fd2e8065620 2024-01-22T05:13:19.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.797+0000 7fd2eee00700 1 -- 172.21.15.49:0/47919893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e80c05b0 con 0x7fd2e8065620 2024-01-22T05:13:19.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.797+0000 7fd2df400700 1 -- 172.21.15.49:0/47919893 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd2e000ac90 con 0x7fd2e8065620 2024-01-22T05:13:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.801+0000 7fd2df400700 1 --2- 172.21.15.49:0/47919893 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd2c005a510 0x7fd2c005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.801+0000 7fd2df400700 1 -- 172.21.15.49:0/47919893 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd2e00747f0 con 0x7fd2e8065620 2024-01-22T05:13:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.801+0000 7fd2e7e00700 1 --2- 172.21.15.49:0/47919893 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd2c005a510 0x7fd2c005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.801+0000 7fd2e7e00700 1 --2- 172.21.15.49:0/47919893 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd2c005a510 0x7fd2c005c9d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fd2d800a010 tx=0x7fd2d8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:19.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:19.805+0000 7fd2df400700 1 -- 172.21.15.49:0/47919893 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd2e80c05b0 con 0x7fd2e8065620 2024-01-22T05:13:20.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:20.037+0000 7fd2eee00700 1 -- 172.21.15.49:0/47919893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd2e8064e90 con 0x7fd2e8065620 2024-01-22T05:13:20.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:20.037+0000 7fd2df400700 1 -- 172.21.15.49:0/47919893 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1579 (secure 0 0 0) 0x7fd2e8064e90 con 0x7fd2e8065620 2024-01-22T05:13:20.040 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:20.040 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":543,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":104,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1078,"data_bytes":1075883791,"bytes_used":4647583744,"bytes_avail":768446529536,"bytes_total":773094113280,"write_bytes_sec":9254837,"read_op_per_sec":0,"write_op_per_sec":183},"fsmap":{"epoch":90,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7287}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-01-22T05:13:17.419545+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:13:20.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:20.041+0000 7fd2eee00700 1 -- 172.21.15.49:0/47919893 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd2c005a510 msgr2=0x7fd2c005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:20.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:20.041+0000 7fd2eee00700 1 --2- 172.21.15.49:0/47919893 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd2c005a510 0x7fd2c005c9d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fd2d800a010 tx=0x7fd2d8016000).stop 2024-01-22T05:13:20.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:20.041+0000 7fd2eee00700 1 -- 172.21.15.49:0/47919893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2e8065620 msgr2=0x7fd2e80a8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:20.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:20.041+0000 7fd2eee00700 1 --2- 172.21.15.49:0/47919893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2e8065620 0x7fd2e80a8700 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fd2e000cc70 tx=0x7fd2e0001f70).stop 2024-01-22T05:13:20.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:20.041+0000 7fd2eee00700 1 -- 172.21.15.49:0/47919893 shutdown_connections 2024-01-22T05:13:20.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:20.041+0000 7fd2eee00700 1 --2- 172.21.15.49:0/47919893 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd2c005a510 0x7fd2c005c9d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:20.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:20.041+0000 7fd2eee00700 1 --2- 172.21.15.49:0/47919893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2e8065620 0x7fd2e80a8700 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:20.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:20.041+0000 7fd2eee00700 1 --2- 172.21.15.49:0/47919893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2e8065240 0x7fd2e80bedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:20.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:20.041+0000 7fd2eee00700 1 --2- 172.21.15.49:0/47919893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2e80649e0 0x7fd2e80c0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:20.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:20.041+0000 7fd2eee00700 1 -- 172.21.15.49:0/47919893 >> 172.21.15.49:0/47919893 conn(0x7fd2e80c87f0 msgr2=0x7fd2e80ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:20.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:20.045+0000 7fd2eee00700 1 -- 172.21.15.49:0/47919893 shutdown_connections 2024-01-22T05:13:20.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:20.045+0000 7fd2eee00700 1 -- 172.21.15.49:0/47919893 wait complete. 2024-01-22T05:13:20.068 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-01-22T05:13:20.068 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:13:20.068 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:13:20.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:13:20.147 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:13:20.148 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T05:13:20.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:20.148 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-22T05:13:21.025 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:13:21.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:13:21.025 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:13:21.036 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:13:21.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.237+0000 7f64c3400700 1 Processor -- start 2024-01-22T05:13:21.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.241+0000 7f64c3400700 1 -- start start 2024-01-22T05:13:21.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.241+0000 7f64c3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64bc0be050 0x7f64bc154060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:21.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.241+0000 7f64c3400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64bc154550 0x7f64bc1549b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:21.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.241+0000 7f64c3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64bc067b20 0x7f64bc067fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:21.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.241+0000 7f64c3400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64bc0c4600 con 0x7f64bc0be050 2024-01-22T05:13:21.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c3400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64bc0bdd10 con 0x7f64bc154550 2024-01-22T05:13:21.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c3400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc0be730 con 0x7f64bc067b20 2024-01-22T05:13:21.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c2000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64bc0be050 0x7f64bc154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:21.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c2000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64bc0be050 0x7f64bc154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52382/0 (socket says 172.21.15.49:52382) 2024-01-22T05:13:21.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c1600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64bc154550 0x7f64bc1549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:21.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c2000700 1 -- 172.21.15.49:0/1400359463 learned_addr learned my addr 172.21.15.49:0/1400359463 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:21.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c2a00700 1 --2- 172.21.15.49:0/1400359463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64bc067b20 0x7f64bc067fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:21.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c2000700 1 -- 172.21.15.49:0/1400359463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64bc067b20 msgr2=0x7f64bc067fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:21.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c2000700 1 --2- 172.21.15.49:0/1400359463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64bc067b20 0x7f64bc067fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c2000700 1 -- 172.21.15.49:0/1400359463 >> v2:172.21.15.110:3300/0 conn(0x7f64bc154550 msgr2=0x7f64bc1549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:21.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c2000700 1 --2- 172.21.15.49:0/1400359463 >> v2:172.21.15.110:3300/0 conn(0x7f64bc154550 0x7f64bc1549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c2000700 1 -- 172.21.15.49:0/1400359463 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc0c3fb0 con 0x7f64bc0be050 2024-01-22T05:13:21.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c2000700 1 --2- 172.21.15.49:0/1400359463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64bc0be050 0x7f64bc154060 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f64bc066f90 tx=0x7f64ac0090f0).ready entity=mon.0 client_cookie=d4eff04755537614 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:21.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c0c00700 1 -- 172.21.15.49:0/1400359463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac00f510 con 0x7f64bc0be050 2024-01-22T05:13:21.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c0c00700 1 -- 172.21.15.49:0/1400359463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac00f670 con 0x7f64bc0be050 2024-01-22T05:13:21.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c0c00700 1 -- 172.21.15.49:0/1400359463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac00fa10 con 0x7f64bc0be050 2024-01-22T05:13:21.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c3400700 1 -- 172.21.15.49:0/1400359463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64bc0be050 msgr2=0x7f64bc154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:21.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.245+0000 7f64c3400700 1 --2- 172.21.15.49:0/1400359463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64bc0be050 0x7f64bc154060 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f64bc066f90 tx=0x7f64ac0090f0).stop 2024-01-22T05:13:21.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.249+0000 7f64c3400700 1 -- 172.21.15.49:0/1400359463 shutdown_connections 2024-01-22T05:13:21.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.249+0000 7f64c3400700 1 --2- 172.21.15.49:0/1400359463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64bc067b20 0x7f64bc067fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.249+0000 7f64c3400700 1 --2- 172.21.15.49:0/1400359463 >> v2:172.21.15.110:3300/0 conn(0x7f64bc154550 0x7f64bc1549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.249+0000 7f64c3400700 1 --2- 172.21.15.49:0/1400359463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64bc0be050 0x7f64bc154060 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.249+0000 7f64c3400700 1 -- 172.21.15.49:0/1400359463 >> 172.21.15.49:0/1400359463 conn(0x7f64bc0c86e0 msgr2=0x7f64bc0c8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:21.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.249+0000 7f64c3400700 1 -- 172.21.15.49:0/1400359463 shutdown_connections 2024-01-22T05:13:21.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.249+0000 7f64c3400700 1 -- 172.21.15.49:0/1400359463 wait complete. 2024-01-22T05:13:21.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.249+0000 7f64c3400700 1 Processor -- start 2024-01-22T05:13:21.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.249+0000 7f64c3400700 1 -- start start 2024-01-22T05:13:21.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64bc067b20 0x7f64bc164b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:21.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64bc0be050 0x7f64bc0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:21.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c3400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64bc154550 0x7f64bc0a3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:21.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c3400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc0a4290 con 0x7f64bc067b20 2024-01-22T05:13:21.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c3400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc165020 con 0x7f64bc154550 2024-01-22T05:13:21.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c3400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc0c25a0 con 0x7f64bc0be050 2024-01-22T05:13:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64bc067b20 0x7f64bc164b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64bc067b20 0x7f64bc164b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52396/0 (socket says 172.21.15.49:52396) 2024-01-22T05:13:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c2000700 1 -- 172.21.15.49:0/1445096486 learned_addr learned my addr 172.21.15.49:0/1445096486 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c1600700 1 --2- 172.21.15.49:0/1445096486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64bc0be050 0x7f64bc0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c2a00700 1 --2- 172.21.15.49:0/1445096486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64bc154550 0x7f64bc0a3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:21.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c2000700 1 -- 172.21.15.49:0/1445096486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64bc0be050 msgr2=0x7f64bc0a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:21.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c2000700 1 --2- 172.21.15.49:0/1445096486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64bc0be050 0x7f64bc0a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c2000700 1 -- 172.21.15.49:0/1445096486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64bc154550 msgr2=0x7f64bc0a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:21.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c2000700 1 --2- 172.21.15.49:0/1445096486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64bc154550 0x7f64bc0a3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c2000700 1 -- 172.21.15.49:0/1445096486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac009370 con 0x7f64bc067b20 2024-01-22T05:13:21.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c2000700 1 --2- 172.21.15.49:0/1445096486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64bc067b20 0x7f64bc164b30 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f64ac006fd0 tx=0x7f64ac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:21.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64b9600700 1 -- 172.21.15.49:0/1445096486 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac000bc0 con 0x7f64bc067b20 2024-01-22T05:13:21.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64b9600700 1 -- 172.21.15.49:0/1445096486 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac00f7e0 con 0x7f64bc067b20 2024-01-22T05:13:21.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64b9600700 1 -- 172.21.15.49:0/1445096486 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac024470 con 0x7f64bc067b20 2024-01-22T05:13:21.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.253+0000 7f64c3400700 1 -- 172.21.15.49:0/1445096486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64bc0c1990 con 0x7f64bc067b20 2024-01-22T05:13:21.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.257+0000 7f64c3400700 1 -- 172.21.15.49:0/1445096486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64bc0c1f50 con 0x7f64bc067b20 2024-01-22T05:13:21.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.257+0000 7f64c3400700 1 -- 172.21.15.49:0/1445096486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64bc0667c0 con 0x7f64bc067b20 2024-01-22T05:13:21.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.257+0000 7f64b9600700 1 -- 172.21.15.49:0/1445096486 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f64ac021070 con 0x7f64bc067b20 2024-01-22T05:13:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.257+0000 7f64b9600700 1 --2- 172.21.15.49:0/1445096486 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f649405a510 0x7f649405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.257+0000 7f64b9600700 1 -- 172.21.15.49:0/1445096486 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f64ac076180 con 0x7f64bc067b20 2024-01-22T05:13:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.257+0000 7f64c1600700 1 --2- 172.21.15.49:0/1445096486 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f649405a510 0x7f649405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.261+0000 7f64c1600700 1 --2- 172.21.15.49:0/1445096486 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f649405a510 0x7f649405c9d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f64bc1551c0 tx=0x7f64a4009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:21.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.265+0000 7f64b9600700 1 -- 172.21.15.49:0/1445096486 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f64ac049740 con 0x7f64bc067b20 2024-01-22T05:13:21.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.477+0000 7f64c3400700 1 -- 172.21.15.49:0/1445096486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64bc0c4290 con 0x7f64bc067b20 2024-01-22T05:13:21.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.477+0000 7f64b9600700 1 -- 172.21.15.49:0/1445096486 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f64ac029070 con 0x7f64bc067b20 2024-01-22T05:13:21.479 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:21.479 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2953480069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2953480069},{"type":"v1","addr":"172.21.15.110:6833","nonce":2953480069}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2000522159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2000522159},{"type":"v1","addr":"172.21.15.110:6835","nonce":2000522159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/578632238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":578632238},{"type":"v1","addr":"172.21.15.49:6836","nonce":578632238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:12:25.842913+0000","modified":"2024-01-22T05:12:28.864832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7287":{"gid":7287,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/1226995696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1226995696},{"type":"v1","addr":"172.21.15.49:6837","nonce":1226995696}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-22T05:13:21.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.481+0000 7f64c3400700 1 -- 172.21.15.49:0/1445096486 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f649405a510 msgr2=0x7f649405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:21.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.481+0000 7f64c3400700 1 --2- 172.21.15.49:0/1445096486 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f649405a510 0x7f649405c9d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f64bc1551c0 tx=0x7f64a4009060).stop 2024-01-22T05:13:21.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.481+0000 7f64c3400700 1 -- 172.21.15.49:0/1445096486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64bc067b20 msgr2=0x7f64bc164b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:21.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.481+0000 7f64c3400700 1 --2- 172.21.15.49:0/1445096486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64bc067b20 0x7f64bc164b30 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f64ac006fd0 tx=0x7f64ac017000).stop 2024-01-22T05:13:21.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.481+0000 7f64c3400700 1 -- 172.21.15.49:0/1445096486 shutdown_connections 2024-01-22T05:13:21.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.481+0000 7f64c3400700 1 --2- 172.21.15.49:0/1445096486 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f649405a510 0x7f649405c9d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.481+0000 7f64c3400700 1 --2- 172.21.15.49:0/1445096486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64bc154550 0x7f64bc0a3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.481+0000 7f64c3400700 1 --2- 172.21.15.49:0/1445096486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64bc0be050 0x7f64bc0a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.481+0000 7f64c3400700 1 --2- 172.21.15.49:0/1445096486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64bc067b20 0x7f64bc164b30 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.481+0000 7f64c3400700 1 -- 172.21.15.49:0/1445096486 >> 172.21.15.49:0/1445096486 conn(0x7f64bc0c86e0 msgr2=0x7f64bc157020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:21.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.481+0000 7f64c3400700 1 -- 172.21.15.49:0/1445096486 shutdown_connections 2024-01-22T05:13:21.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.481+0000 7f64c3400700 1 -- 172.21.15.49:0/1445096486 wait complete. 2024-01-22T05:13:21.486 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 90 2024-01-22T05:13:21.507 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:13:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.669+0000 7f9f89000700 1 Processor -- start 2024-01-22T05:13:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.669+0000 7f9f89000700 1 -- start start 2024-01-22T05:13:21.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f89000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f840c6d20 0x7f9f8415b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:21.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f89000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f840c5880 con 0x7f9f840c37d0 2024-01-22T05:13:21.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f89000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f840bdd90 con 0x7f9f840bd650 2024-01-22T05:13:21.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f89000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840c5220 con 0x7f9f840c6d20 2024-01-22T05:13:21.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f81400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9f840c37d0 0x7f9f840c3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39302/0 (socket says 172.21.15.49:39302) 2024-01-22T05:13:21.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f81400700 1 -- 172.21.15.49:0/1610062923 learned_addr learned my addr 172.21.15.49:0/1610062923 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:21.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f83200700 1 --2- 172.21.15.49:0/1610062923 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f840c6d20 0x7f9f8415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:21.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f80a00700 1 -- 172.21.15.49:0/1610062923 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271146839 0 0) 0x7f9f840c5880 con 0x7f9f840c37d0 2024-01-22T05:13:21.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f80a00700 1 -- 172.21.15.49:0/1610062923 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f640033f0 con 0x7f9f840c37d0 2024-01-22T05:13:21.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f80a00700 1 -- 172.21.15.49:0/1610062923 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581742501 0 0) 0x7f9f840bdd90 con 0x7f9f840bd650 2024-01-22T05:13:21.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f80a00700 1 -- 172.21.15.49:0/1610062923 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f840c5880 con 0x7f9f840bd650 2024-01-22T05:13:21.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f83200700 1 -- 172.21.15.49:0/1610062923 >> v1:172.21.15.110:6789/0 conn(0x7f9f840bd650 legacy=0x7f9f841503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:21.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f80a00700 1 -- 172.21.15.49:0/1610062923 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1410585513 0 0) 0x7f9f640033f0 con 0x7f9f840c37d0 2024-01-22T05:13:21.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f83200700 1 -- 172.21.15.49:0/1610062923 >> v1:172.21.15.49:6789/0 conn(0x7f9f840c37d0 legacy=0x7f9f840c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:21.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f83200700 1 -- 172.21.15.49:0/1610062923 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f840be070 con 0x7f9f840c6d20 2024-01-22T05:13:21.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f83200700 1 --2- 172.21.15.49:0/1610062923 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f840c6d20 0x7f9f8415b640 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f9f7c009e90 tx=0x7f9f7c009780).ready entity=mon.2 client_cookie=21a3273e363eb7b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:21.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f80a00700 1 -- 172.21.15.49:0/1610062923 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00e070 con 0x7f9f840c6d20 2024-01-22T05:13:21.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f80a00700 1 -- 172.21.15.49:0/1610062923 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c00b7a0 con 0x7f9f840c6d20 2024-01-22T05:13:21.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.673+0000 7f9f80a00700 1 -- 172.21.15.49:0/1610062923 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c001470 con 0x7f9f840c6d20 2024-01-22T05:13:21.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.677+0000 7f9f89000700 1 -- 172.21.15.49:0/1610062923 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f840c6d20 msgr2=0x7f9f8415b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:21.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.677+0000 7f9f89000700 1 --2- 172.21.15.49:0/1610062923 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f840c6d20 0x7f9f8415b640 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f9f7c009e90 tx=0x7f9f7c009780).stop 2024-01-22T05:13:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.677+0000 7f9f89000700 1 -- 172.21.15.49:0/1610062923 shutdown_connections 2024-01-22T05:13:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.677+0000 7f9f89000700 1 --2- 172.21.15.49:0/1610062923 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f840c6d20 0x7f9f8415b640 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.677+0000 7f9f89000700 1 -- 172.21.15.49:0/1610062923 >> 172.21.15.49:0/1610062923 conn(0x7f9f840c87f0 msgr2=0x7f9f840c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.677+0000 7f9f89000700 1 -- 172.21.15.49:0/1610062923 shutdown_connections 2024-01-22T05:13:21.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.677+0000 7f9f89000700 1 -- 172.21.15.49:0/1610062923 wait complete. 2024-01-22T05:13:21.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.677+0000 7f9f89000700 1 Processor -- start 2024-01-22T05:13:21.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.677+0000 7f9f89000700 1 -- start start 2024-01-22T05:13:21.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f89000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f840bd650 0x7f9f8414ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:21.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f89000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c37d0 0x7f9f84151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:21.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f89000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f840c6d20 0x7f9f841516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:21.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f89000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f841532f0 con 0x7f9f840c37d0 2024-01-22T05:13:21.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f89000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f841535d0 con 0x7f9f840bd650 2024-01-22T05:13:21.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f89000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f841538b0 con 0x7f9f840c6d20 2024-01-22T05:13:21.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f81400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c37d0 0x7f9f84151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:21.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f81400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c37d0 0x7f9f84151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52408/0 (socket says 172.21.15.49:52408) 2024-01-22T05:13:21.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f81400700 1 -- 172.21.15.49:0/4149124505 learned_addr learned my addr 172.21.15.49:0/4149124505 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:21.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f81e00700 1 --2- 172.21.15.49:0/4149124505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f840bd650 0x7f9f8414ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:21.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f83200700 1 --2- 172.21.15.49:0/4149124505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f840c6d20 0x7f9f841516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f81400700 1 -- 172.21.15.49:0/4149124505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f840c6d20 msgr2=0x7f9f841516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f81400700 1 --2- 172.21.15.49:0/4149124505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f840c6d20 0x7f9f841516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f81400700 1 -- 172.21.15.49:0/4149124505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f840bd650 msgr2=0x7f9f8414ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f81400700 1 --2- 172.21.15.49:0/4149124505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f840bd650 0x7f9f8414ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f81400700 1 -- 172.21.15.49:0/4149124505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c009a20 con 0x7f9f840c37d0 2024-01-22T05:13:21.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f81e00700 1 --2- 172.21.15.49:0/4149124505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f840bd650 0x7f9f8414ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:21.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f81400700 1 --2- 172.21.15.49:0/4149124505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c37d0 0x7f9f84151200 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f9f6c00c7c0 tx=0x7f9f6c001b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:21.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f79600700 1 -- 172.21.15.49:0/4149124505 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c007170 con 0x7f9f840c37d0 2024-01-22T05:13:21.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f79600700 1 -- 172.21.15.49:0/4149124505 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c007310 con 0x7f9f840c37d0 2024-01-22T05:13:21.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f89000700 1 -- 172.21.15.49:0/4149124505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f84153b90 con 0x7f9f840c37d0 2024-01-22T05:13:21.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.681+0000 7f9f79600700 1 -- 172.21.15.49:0/4149124505 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c0048c0 con 0x7f9f840c37d0 2024-01-22T05:13:21.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.685+0000 7f9f89000700 1 -- 172.21.15.49:0/4149124505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8414f100 con 0x7f9f840c37d0 2024-01-22T05:13:21.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.685+0000 7f9f89000700 1 -- 172.21.15.49:0/4149124505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f84047060 con 0x7f9f840c37d0 2024-01-22T05:13:21.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.685+0000 7f9f79600700 1 -- 172.21.15.49:0/4149124505 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9f6c004c30 con 0x7f9f840c37d0 2024-01-22T05:13:21.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.689+0000 7f9f79600700 1 --2- 172.21.15.49:0/4149124505 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f5c05a510 0x7f9f5c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:21.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.689+0000 7f9f79600700 1 -- 172.21.15.49:0/4149124505 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9f6c0742b0 con 0x7f9f840c37d0 2024-01-22T05:13:21.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.689+0000 7f9f81e00700 1 --2- 172.21.15.49:0/4149124505 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f5c05a510 0x7f9f5c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.689+0000 7f9f81e00700 1 --2- 172.21.15.49:0/4149124505 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f5c05a510 0x7f9f5c05c9d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f9f74007fd0 tx=0x7f9f74007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:21.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.693+0000 7f9f79600700 1 -- 172.21.15.49:0/4149124505 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9f6c047870 con 0x7f9f840c37d0 2024-01-22T05:13:21.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.861+0000 7f9f89000700 1 -- 172.21.15.49:0/4149124505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f840be350 con 0x7f9f840c37d0 2024-01-22T05:13:21.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.861+0000 7f9f79600700 1 -- 172.21.15.49:0/4149124505 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+17178 (secure 0 0 0) 0x7f9f6c019070 con 0x7f9f840c37d0 2024-01-22T05:13:21.862 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:21.863 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":104,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:12:26.847459+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:12:23.950155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-01-22T05:12:24.858181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:13:21.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.865+0000 7f9f89000700 1 -- 172.21.15.49:0/4149124505 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f5c05a510 msgr2=0x7f9f5c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:21.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.865+0000 7f9f89000700 1 --2- 172.21.15.49:0/4149124505 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f5c05a510 0x7f9f5c05c9d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f9f74007fd0 tx=0x7f9f74007bd0).stop 2024-01-22T05:13:21.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.865+0000 7f9f89000700 1 -- 172.21.15.49:0/4149124505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c37d0 msgr2=0x7f9f84151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:21.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.865+0000 7f9f89000700 1 --2- 172.21.15.49:0/4149124505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c37d0 0x7f9f84151200 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f9f6c00c7c0 tx=0x7f9f6c001b00).stop 2024-01-22T05:13:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.865+0000 7f9f89000700 1 -- 172.21.15.49:0/4149124505 shutdown_connections 2024-01-22T05:13:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.865+0000 7f9f89000700 1 --2- 172.21.15.49:0/4149124505 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f5c05a510 0x7f9f5c05c9d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.865+0000 7f9f89000700 1 --2- 172.21.15.49:0/4149124505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f840c6d20 0x7f9f841516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.865+0000 7f9f89000700 1 --2- 172.21.15.49:0/4149124505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f840c37d0 0x7f9f84151200 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.865+0000 7f9f89000700 1 --2- 172.21.15.49:0/4149124505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f840bd650 0x7f9f8414ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.865+0000 7f9f89000700 1 -- 172.21.15.49:0/4149124505 >> 172.21.15.49:0/4149124505 conn(0x7f9f840c87f0 msgr2=0x7f9f8414fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.865+0000 7f9f89000700 1 -- 172.21.15.49:0/4149124505 shutdown_connections 2024-01-22T05:13:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:21.865+0000 7f9f89000700 1 -- 172.21.15.49:0/4149124505 wait complete. 2024-01-22T05:13:21.890 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:12:23.950155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:12:24.858181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:13:21.891 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:13:22.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.053+0000 7fb1c5e00700 1 Processor -- start 2024-01-22T05:13:22.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.053+0000 7fb1c5e00700 1 -- start start 2024-01-22T05:13:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.057+0000 7fb1c5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1c0154ee0 0x7fb1c00bca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.057+0000 7fb1c5e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c014e8c0 con 0x7fb1c00691c0 2024-01-22T05:13:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.057+0000 7fb1c5e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c00c2410 con 0x7fb1c0154a60 2024-01-22T05:13:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.057+0000 7fb1c5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c0062ce0 con 0x7fb1c0154ee0 2024-01-22T05:13:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.057+0000 7fb1c4a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb1c00691c0 0x7fb1c0154350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39316/0 (socket says 172.21.15.49:39316) 2024-01-22T05:13:22.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.057+0000 7fb1c4a00700 1 -- 172.21.15.49:0/2762908312 learned_addr learned my addr 172.21.15.49:0/2762908312 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:22.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1c5400700 1 --2- 172.21.15.49:0/2762908312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1c0154ee0 0x7fb1c00bca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860408304 0 0) 0x7fb1c014e8c0 con 0x7fb1c00691c0 2024-01-22T05:13:22.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a00033f0 con 0x7fb1c00691c0 2024-01-22T05:13:22.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945635326 0 0) 0x7fb1c00c2410 con 0x7fb1c0154a60 2024-01-22T05:13:22.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1c014e8c0 con 0x7fb1c0154a60 2024-01-22T05:13:22.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2450259809 0 0) 0x7fb1a00033f0 con 0x7fb1c00691c0 2024-01-22T05:13:22.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1c0154ee0 msgr2=0x7fb1c00bca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:22.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 --2- 172.21.15.49:0/2762908312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1c0154ee0 0x7fb1c00bca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 >> v1:172.21.15.110:6789/0 conn(0x7fb1c0154a60 legacy=0x7fb1c00bc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c0062fc0 con 0x7fb1c00691c0 2024-01-22T05:13:22.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fb1b0001490 con 0x7fb1c00691c0 2024-01-22T05:13:22.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1c5400700 1 --2- 172.21.15.49:0/2762908312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1c0154ee0 0x7fb1c00bca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 >> v1:172.21.15.49:6789/0 conn(0x7fb1c00691c0 legacy=0x7fb1c0154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 --2- 172.21.15.49:0/2762908312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1a0003aa0 0x7fb1a0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 --2- 172.21.15.49:0/2762908312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1c0154ee0 0x7fb1a0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 --2- 172.21.15.49:0/2762908312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1a0004b80 0x7fb1a0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c0062ce0 con 0x7fb1a0003aa0 2024-01-22T05:13:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a000b8e0 con 0x7fb1a0004b80 2024-01-22T05:13:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a000ba70 con 0x7fb1c0154ee0 2024-01-22T05:13:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1c4a00700 1 --2- 172.21.15.49:0/2762908312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1a0003aa0 0x7fb1a0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1c5400700 1 --2- 172.21.15.49:0/2762908312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1a0004b80 0x7fb1a0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bfe00700 1 --2- 172.21.15.49:0/2762908312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1c0154ee0 0x7fb1a0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1c4a00700 1 -- 172.21.15.49:0/2762908312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1c0154ee0 msgr2=0x7fb1a0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:22.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1c4a00700 1 --2- 172.21.15.49:0/2762908312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1c0154ee0 0x7fb1a0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1c4a00700 1 -- 172.21.15.49:0/2762908312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1a0004b80 msgr2=0x7fb1a0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:22.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1c4a00700 1 --2- 172.21.15.49:0/2762908312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1a0004b80 0x7fb1a0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1c4a00700 1 -- 172.21.15.49:0/2762908312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b8009a20 con 0x7fb1a0003aa0 2024-01-22T05:13:22.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1c4a00700 1 --2- 172.21.15.49:0/2762908312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1a0003aa0 0x7fb1a0003ea0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fb1b000c160 tx=0x7fb1b0001e30).ready entity=mon.0 client_cookie=2c899600c7884ea0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:22.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.061+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b000ca50 con 0x7fb1a0003aa0 2024-01-22T05:13:22.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.065+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b000cbb0 con 0x7fb1a0003aa0 2024-01-22T05:13:22.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.065+0000 7fb1bf400700 1 -- 172.21.15.49:0/2762908312 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0007170 con 0x7fb1a0003aa0 2024-01-22T05:13:22.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.065+0000 7fb1c5e00700 1 -- 172.21.15.49:0/2762908312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1a0003aa0 msgr2=0x7fb1a0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.065+0000 7fb1c5e00700 1 --2- 172.21.15.49:0/2762908312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1a0003aa0 0x7fb1a0003ea0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fb1b000c160 tx=0x7fb1b0001e30).stop 2024-01-22T05:13:22.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.065+0000 7fb1c5400700 1 -- 172.21.15.49:0/2762908312 reap_dead start 2024-01-22T05:13:22.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.065+0000 7fb1c5e00700 1 -- 172.21.15.49:0/2762908312 shutdown_connections 2024-01-22T05:13:22.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.065+0000 7fb1c5e00700 1 -- 172.21.15.49:0/2762908312 >> 172.21.15.49:0/2762908312 conn(0x7fb1c00c38a0 msgr2=0x7fb1c00c3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:22.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.065+0000 7fb1c5e00700 1 -- 172.21.15.49:0/2762908312 shutdown_connections 2024-01-22T05:13:22.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.065+0000 7fb1c5e00700 1 -- 172.21.15.49:0/2762908312 wait complete. 2024-01-22T05:13:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.069+0000 7fb1c5e00700 1 Processor -- start 2024-01-22T05:13:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.069+0000 7fb1c5e00700 1 -- start start 2024-01-22T05:13:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.069+0000 7fb1c5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1a0003aa0 0x7fb1c0153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.069+0000 7fb1c5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1c00bfc30 0x7fb1c01644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.069+0000 7fb1c5e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1c0155dd0 0x7fb1c0156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.069+0000 7fb1c5e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00bdea0 con 0x7fb1c00bfc30 2024-01-22T05:13:22.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.069+0000 7fb1c5e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00be9e0 con 0x7fb1c0155dd0 2024-01-22T05:13:22.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.069+0000 7fb1c5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00be0b0 con 0x7fb1a0003aa0 2024-01-22T05:13:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1bfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1c00bfc30 0x7fb1c01644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1bfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1c00bfc30 0x7fb1c01644a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52428/0 (socket says 172.21.15.49:52428) 2024-01-22T05:13:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1bfe00700 1 -- 172.21.15.49:0/2184590934 learned_addr learned my addr 172.21.15.49:0/2184590934 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1c4a00700 1 --2- 172.21.15.49:0/2184590934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1a0003aa0 0x7fb1c0153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1c5400700 1 --2- 172.21.15.49:0/2184590934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1c0155dd0 0x7fb1c0156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1bfe00700 1 -- 172.21.15.49:0/2184590934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1a0003aa0 msgr2=0x7fb1c0153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1bfe00700 1 --2- 172.21.15.49:0/2184590934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1a0003aa0 0x7fb1c0153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1bfe00700 1 -- 172.21.15.49:0/2184590934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1c0155dd0 msgr2=0x7fb1c0156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1bfe00700 1 --2- 172.21.15.49:0/2184590934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1c0155dd0 0x7fb1c0156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1bfe00700 1 -- 172.21.15.49:0/2184590934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c00be390 con 0x7fb1c00bfc30 2024-01-22T05:13:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1bfe00700 1 --2- 172.21.15.49:0/2184590934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1c00bfc30 0x7fb1c01644a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7fb1a800e5e0 tx=0x7fb1a8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1b7e00700 1 -- 172.21.15.49:0/2184590934 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a800ee50 con 0x7fb1c00bfc30 2024-01-22T05:13:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1b7e00700 1 -- 172.21.15.49:0/2184590934 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a8001570 con 0x7fb1c00bfc30 2024-01-22T05:13:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1b7e00700 1 -- 172.21.15.49:0/2184590934 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a80018f0 con 0x7fb1c00bfc30 2024-01-22T05:13:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1c5e00700 1 -- 172.21.15.49:0/2184590934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c00be670 con 0x7fb1c00bfc30 2024-01-22T05:13:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1c5e00700 1 -- 172.21.15.49:0/2184590934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c0164990 con 0x7fb1c00bfc30 2024-01-22T05:13:22.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.073+0000 7fb1c5e00700 1 -- 172.21.15.49:0/2184590934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c00beb70 con 0x7fb1c00bfc30 2024-01-22T05:13:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.077+0000 7fb1b7e00700 1 -- 172.21.15.49:0/2184590934 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb1a8001ca0 con 0x7fb1c00bfc30 2024-01-22T05:13:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.077+0000 7fb1b7e00700 1 --2- 172.21.15.49:0/2184590934 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb19805a540 0x7fb19805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.077+0000 7fb1b7e00700 1 -- 172.21.15.49:0/2184590934 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb1a8074470 con 0x7fb1c00bfc30 2024-01-22T05:13:22.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.077+0000 7fb1c4a00700 1 --2- 172.21.15.49:0/2184590934 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb19805a540 0x7fb19805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.077+0000 7fb1c4a00700 1 --2- 172.21.15.49:0/2184590934 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb19805a540 0x7fb19805ca00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fb1b0008fd0 tx=0x7fb1b0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:22.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.085+0000 7fb1b7e00700 1 -- 172.21.15.49:0/2184590934 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb1a8047af0 con 0x7fb1c00bfc30 2024-01-22T05:13:22.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.249+0000 7fb1c5e00700 1 -- 172.21.15.49:0/2184590934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb1c00632a0 con 0x7fb1c00bfc30 2024-01-22T05:13:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.249+0000 7fb1b7e00700 1 -- 172.21.15.49:0/2184590934 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v104) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb1a804b110 con 0x7fb1c00bfc30 2024-01-22T05:13:22.251 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:13:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.253+0000 7fb1c5e00700 1 -- 172.21.15.49:0/2184590934 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb19805a540 msgr2=0x7fb19805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.253+0000 7fb1c5e00700 1 --2- 172.21.15.49:0/2184590934 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb19805a540 0x7fb19805ca00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fb1b0008fd0 tx=0x7fb1b0015000).stop 2024-01-22T05:13:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.253+0000 7fb1c5e00700 1 -- 172.21.15.49:0/2184590934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1c00bfc30 msgr2=0x7fb1c01644a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.253+0000 7fb1c5e00700 1 --2- 172.21.15.49:0/2184590934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1c00bfc30 0x7fb1c01644a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7fb1a800e5e0 tx=0x7fb1a8009040).stop 2024-01-22T05:13:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.253+0000 7fb1c5e00700 1 -- 172.21.15.49:0/2184590934 shutdown_connections 2024-01-22T05:13:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.253+0000 7fb1c5e00700 1 --2- 172.21.15.49:0/2184590934 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb19805a540 0x7fb19805ca00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.253+0000 7fb1c5e00700 1 --2- 172.21.15.49:0/2184590934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1c0155dd0 0x7fb1c0156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.253+0000 7fb1c5e00700 1 --2- 172.21.15.49:0/2184590934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1c00bfc30 0x7fb1c01644a0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.253+0000 7fb1c5e00700 1 --2- 172.21.15.49:0/2184590934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1a0003aa0 0x7fb1c0153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.253+0000 7fb1c5e00700 1 -- 172.21.15.49:0/2184590934 >> 172.21.15.49:0/2184590934 conn(0x7fb1c00c38a0 msgr2=0x7fb1c00bd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:22.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.253+0000 7fb1c5e00700 1 -- 172.21.15.49:0/2184590934 shutdown_connections 2024-01-22T05:13:22.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.253+0000 7fb1c5e00700 1 -- 172.21.15.49:0/2184590934 wait complete. 2024-01-22T05:13:22.279 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:13:22.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.449+0000 7f1eb4600700 1 Processor -- start 2024-01-22T05:13:22.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.449+0000 7f1eb4600700 1 -- start start 2024-01-22T05:13:22.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.453+0000 7f1eb4600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1eac15b220 0x7f1eac15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.453+0000 7f1eb4600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1eac15bb90 0x7f1eac15c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.453+0000 7f1eb4600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eac0c4070 con 0x7f1eac067a90 2024-01-22T05:13:22.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.453+0000 7f1eb4600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eac0c4630 con 0x7f1eac15bb90 2024-01-22T05:13:22.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.453+0000 7f1eb4600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0c4350 con 0x7f1eac15b220 2024-01-22T05:13:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.453+0000 7f1eb2600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1eac15bb90 0x7f1eac15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.453+0000 7f1eb1200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1eac15b220 0x7f1eac15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.453+0000 7f1eb2600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1eac15bb90 0x7f1eac15c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:45734/0 (socket says 172.21.15.49:45734) 2024-01-22T05:13:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.453+0000 7f1eb1200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1eac15b220 0x7f1eac15b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:40532/0 (socket says 172.21.15.49:40532) 2024-01-22T05:13:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.453+0000 7f1eb2600700 1 -- 172.21.15.49:0/2366462808 learned_addr learned my addr 172.21.15.49:0/2366462808 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.453+0000 7f1eb1c00700 1 --1- 172.21.15.49:0/2366462808 >> v1:172.21.15.110:6789/0 conn(0x7f1eac067a90 0x7f1eac0c6e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:46088/0 (socket says 172.21.15.49:46088) 2024-01-22T05:13:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eb2600700 1 -- 172.21.15.49:0/2366462808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1eac15b220 msgr2=0x7f1eac15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eb2600700 1 --2- 172.21.15.49:0/2366462808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1eac15b220 0x7f1eac15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eb2600700 1 -- 172.21.15.49:0/2366462808 >> v1:172.21.15.110:6789/0 conn(0x7f1eac067a90 legacy=0x7f1eac0c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eb2600700 1 -- 172.21.15.49:0/2366462808 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac062aa0 con 0x7f1eac15bb90 2024-01-22T05:13:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eabe00700 1 -- 172.21.15.49:0/2366462808 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819921122 0 0) 0x7f1eac0c4070 con 0x7f1eac067a90 2024-01-22T05:13:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eb1200700 1 --2- 172.21.15.49:0/2366462808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1eac15b220 0x7f1eac15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eb2600700 1 --2- 172.21.15.49:0/2366462808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1eac15bb90 0x7f1eac15c020 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f1ea4009f20 tx=0x7f1ea4009840).ready entity=mon.1 client_cookie=55674b640b71551b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eabe00700 1 -- 172.21.15.49:0/2366462808 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea400e070 con 0x7f1eac15bb90 2024-01-22T05:13:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eabe00700 1 -- 172.21.15.49:0/2366462808 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea400b9d0 con 0x7f1eac15bb90 2024-01-22T05:13:22.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eabe00700 1 -- 172.21.15.49:0/2366462808 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea400bd50 con 0x7f1eac15bb90 2024-01-22T05:13:22.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eb4600700 1 -- 172.21.15.49:0/2366462808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1eac15bb90 msgr2=0x7f1eac15c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eb4600700 1 --2- 172.21.15.49:0/2366462808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1eac15bb90 0x7f1eac15c020 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f1ea4009f20 tx=0x7f1ea4009840).stop 2024-01-22T05:13:22.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eb4600700 1 -- 172.21.15.49:0/2366462808 shutdown_connections 2024-01-22T05:13:22.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eb4600700 1 --2- 172.21.15.49:0/2366462808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1eac15bb90 0x7f1eac15c020 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eb4600700 1 --2- 172.21.15.49:0/2366462808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1eac15b220 0x7f1eac15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.457+0000 7f1eb4600700 1 -- 172.21.15.49:0/2366462808 >> 172.21.15.49:0/2366462808 conn(0x7f1eac0c9240 msgr2=0x7f1eac0c5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:22.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.461+0000 7f1eb4600700 1 -- 172.21.15.49:0/2366462808 shutdown_connections 2024-01-22T05:13:22.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.461+0000 7f1eb4600700 1 -- 172.21.15.49:0/2366462808 wait complete. 2024-01-22T05:13:22.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.461+0000 7f1eb4600700 1 Processor -- start 2024-01-22T05:13:22.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.465+0000 7f1eb4600700 1 -- start start 2024-01-22T05:13:22.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.465+0000 7f1eb4600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1eac067a90 0x7f1eac169040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.465+0000 7f1eb4600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1eac15b220 0x7f1eac156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.465+0000 7f1eb4600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac15bb90 0x7f1eac142110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.465+0000 7f1eb4600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac157c10 con 0x7f1eac15bb90 2024-01-22T05:13:22.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.465+0000 7f1eb4600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac157000 con 0x7f1eac067a90 2024-01-22T05:13:22.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.465+0000 7f1eb4600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac1572e0 con 0x7f1eac15b220 2024-01-22T05:13:22.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.465+0000 7f1eb2600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac15bb90 0x7f1eac142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.465+0000 7f1eb2600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac15bb90 0x7f1eac142110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52444/0 (socket says 172.21.15.49:52444) 2024-01-22T05:13:22.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.465+0000 7f1eb2600700 1 -- 172.21.15.49:0/455622594 learned_addr learned my addr 172.21.15.49:0/455622594 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:22.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.465+0000 7f1eb1c00700 1 --2- 172.21.15.49:0/455622594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1eac067a90 0x7f1eac169040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.465+0000 7f1eb1200700 1 --2- 172.21.15.49:0/455622594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1eac15b220 0x7f1eac156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.469+0000 7f1eb2600700 1 -- 172.21.15.49:0/455622594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1eac15b220 msgr2=0x7f1eac156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.469+0000 7f1eb2600700 1 --2- 172.21.15.49:0/455622594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1eac15b220 0x7f1eac156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.469+0000 7f1eb2600700 1 -- 172.21.15.49:0/455622594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1eac067a90 msgr2=0x7f1eac169040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.469+0000 7f1eb2600700 1 --2- 172.21.15.49:0/455622594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1eac067a90 0x7f1eac169040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.469+0000 7f1eb2600700 1 -- 172.21.15.49:0/455622594 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e940092a0 con 0x7f1eac15bb90 2024-01-22T05:13:22.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.469+0000 7f1eb1c00700 1 --2- 172.21.15.49:0/455622594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1eac067a90 0x7f1eac169040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:22.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.469+0000 7f1eb2600700 1 --2- 172.21.15.49:0/455622594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac15bb90 0x7f1eac142110 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f1ea400b610 tx=0x7f1ea4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:22.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.469+0000 7f1ea8c00700 1 -- 172.21.15.49:0/455622594 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea400b640 con 0x7f1eac15bb90 2024-01-22T05:13:22.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.469+0000 7f1ea8c00700 1 -- 172.21.15.49:0/455622594 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea40092e0 con 0x7f1eac15bb90 2024-01-22T05:13:22.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.469+0000 7f1eb4600700 1 -- 172.21.15.49:0/455622594 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea4009ae0 con 0x7f1eac15bb90 2024-01-22T05:13:22.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.469+0000 7f1ea8c00700 1 -- 172.21.15.49:0/455622594 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea401e680 con 0x7f1eac15bb90 2024-01-22T05:13:22.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.469+0000 7f1eb4600700 1 -- 172.21.15.49:0/455622594 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eac1578a0 con 0x7f1eac15bb90 2024-01-22T05:13:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.469+0000 7f1eb4600700 1 -- 172.21.15.49:0/455622594 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eac06b030 con 0x7f1eac15bb90 2024-01-22T05:13:22.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.473+0000 7f1ea8c00700 1 -- 172.21.15.49:0/455622594 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1ea4003040 con 0x7f1eac15bb90 2024-01-22T05:13:22.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.473+0000 7f1ea8c00700 1 --2- 172.21.15.49:0/455622594 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e8405a540 0x7f1e8405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.473+0000 7f1ea8c00700 1 -- 172.21.15.49:0/455622594 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f1ea4075c90 con 0x7f1eac15bb90 2024-01-22T05:13:22.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.473+0000 7f1eb1c00700 1 --2- 172.21.15.49:0/455622594 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e8405a540 0x7f1e8405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.473+0000 7f1eb1c00700 1 --2- 172.21.15.49:0/455622594 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e8405a540 0x7f1e8405ca00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f1e9c0011e0 tx=0x7f1e9c007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:22.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.481+0000 7f1ea8c00700 1 -- 172.21.15.49:0/455622594 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1eac06b030 con 0x7f1eac15bb90 2024-01-22T05:13:22.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.645+0000 7f1eb4600700 1 -- 172.21.15.49:0/455622594 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1eac06b030 con 0x7f1eac15bb90 2024-01-22T05:13:22.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.645+0000 7f1ea8c00700 1 -- 172.21.15.49:0/455622594 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v104) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1eac06b030 con 0x7f1eac15bb90 2024-01-22T05:13:22.646 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:13:22.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.649+0000 7f1eb4600700 1 -- 172.21.15.49:0/455622594 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e8405a540 msgr2=0x7f1e8405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.649+0000 7f1eb4600700 1 --2- 172.21.15.49:0/455622594 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e8405a540 0x7f1e8405ca00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f1e9c0011e0 tx=0x7f1e9c007bd0).stop 2024-01-22T05:13:22.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.649+0000 7f1eb4600700 1 -- 172.21.15.49:0/455622594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac15bb90 msgr2=0x7f1eac142110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.649+0000 7f1eb4600700 1 --2- 172.21.15.49:0/455622594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac15bb90 0x7f1eac142110 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f1ea400b610 tx=0x7f1ea4009840).stop 2024-01-22T05:13:22.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.649+0000 7f1eb4600700 1 -- 172.21.15.49:0/455622594 shutdown_connections 2024-01-22T05:13:22.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.649+0000 7f1eb4600700 1 --2- 172.21.15.49:0/455622594 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e8405a540 0x7f1e8405ca00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.649+0000 7f1eb4600700 1 --2- 172.21.15.49:0/455622594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eac15bb90 0x7f1eac142110 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.649+0000 7f1eb4600700 1 --2- 172.21.15.49:0/455622594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1eac15b220 0x7f1eac156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.649+0000 7f1eb4600700 1 --2- 172.21.15.49:0/455622594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1eac067a90 0x7f1eac169040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.649+0000 7f1eb4600700 1 -- 172.21.15.49:0/455622594 >> 172.21.15.49:0/455622594 conn(0x7f1eac0c9240 msgr2=0x7f1eac0be3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:22.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.649+0000 7f1eb4600700 1 -- 172.21.15.49:0/455622594 shutdown_connections 2024-01-22T05:13:22.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.653+0000 7f1eb4600700 1 -- 172.21.15.49:0/455622594 wait complete. 2024-01-22T05:13:22.674 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:13:22.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.837+0000 7f13e1200700 1 Processor -- start 2024-01-22T05:13:22.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.837+0000 7f13e1200700 1 -- start start 2024-01-22T05:13:22.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.841+0000 7f13e1200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13dc157070 0x7f13dc067e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.841+0000 7f13e1200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f13dc063430 0x7f13dc0638e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.841+0000 7f13e1200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13dc0c4ab0 con 0x7f13dc067a90 2024-01-22T05:13:22.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.841+0000 7f13e1200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13dc062fa0 con 0x7f13dc063430 2024-01-22T05:13:22.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.841+0000 7f13e1200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc063dd0 con 0x7f13dc157070 2024-01-22T05:13:22.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.841+0000 7f13dbe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f13dc063430 0x7f13dc0638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.841+0000 7f13db400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f13dc067a90 0x7f13dc156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39332/0 (socket says 172.21.15.49:39332) 2024-01-22T05:13:22.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13db400700 1 -- 172.21.15.49:0/3849618404 learned_addr learned my addr 172.21.15.49:0/3849618404 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:22.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13daa00700 1 --2- 172.21.15.49:0/3849618404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13dc157070 0x7f13dc067e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13dbe00700 1 -- 172.21.15.49:0/3849618404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13dc157070 msgr2=0x7f13dc067e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:22.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13dbe00700 1 --2- 172.21.15.49:0/3849618404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13dc157070 0x7f13dc067e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13dbe00700 1 -- 172.21.15.49:0/3849618404 >> v1:172.21.15.49:6789/0 conn(0x7f13dc067a90 legacy=0x7f13dc156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13dbe00700 1 -- 172.21.15.49:0/3849618404 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc0c44f0 con 0x7f13dc063430 2024-01-22T05:13:22.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13da000700 1 -- 172.21.15.49:0/3849618404 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967735031 0 0) 0x7f13dc0c4ab0 con 0x7f13dc067a90 2024-01-22T05:13:22.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13dbe00700 1 --2- 172.21.15.49:0/3849618404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13dc063430 0x7f13dc0638e0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f13d4009e90 tx=0x7f13d4009780).ready entity=mon.0 client_cookie=b1c58a17f8c6f67a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:22.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13da000700 1 -- 172.21.15.49:0/3849618404 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d400e070 con 0x7f13dc063430 2024-01-22T05:13:22.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13da000700 1 -- 172.21.15.49:0/3849618404 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d400bb20 con 0x7f13dc063430 2024-01-22T05:13:22.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13da000700 1 -- 172.21.15.49:0/3849618404 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d400bea0 con 0x7f13dc063430 2024-01-22T05:13:22.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13e1200700 1 -- 172.21.15.49:0/3849618404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13dc063430 msgr2=0x7f13dc0638e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13e1200700 1 --2- 172.21.15.49:0/3849618404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13dc063430 0x7f13dc0638e0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f13d4009e90 tx=0x7f13d4009780).stop 2024-01-22T05:13:22.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13e1200700 1 -- 172.21.15.49:0/3849618404 shutdown_connections 2024-01-22T05:13:22.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13e1200700 1 --2- 172.21.15.49:0/3849618404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13dc063430 0x7f13dc0638e0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13e1200700 1 --2- 172.21.15.49:0/3849618404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13dc157070 0x7f13dc067e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.845+0000 7f13e1200700 1 -- 172.21.15.49:0/3849618404 >> 172.21.15.49:0/3849618404 conn(0x7f13dc0c3f00 msgr2=0x7f13dc065a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:22.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.849+0000 7f13e1200700 1 -- 172.21.15.49:0/3849618404 shutdown_connections 2024-01-22T05:13:22.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.849+0000 7f13e1200700 1 -- 172.21.15.49:0/3849618404 wait complete. 2024-01-22T05:13:22.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.849+0000 7f13e1200700 1 Processor -- start 2024-01-22T05:13:22.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13e1200700 1 -- start start 2024-01-22T05:13:22.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13e1200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13dc063430 0x7f13dc1541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13e1200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13dc067a90 0x7f13dc154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13e1200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13dc157070 0x7f13dc164360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13e1200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc154b80 con 0x7f13dc157070 2024-01-22T05:13:22.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13e1200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc152a60 con 0x7f13dc067a90 2024-01-22T05:13:22.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13e1200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc152d40 con 0x7f13dc063430 2024-01-22T05:13:22.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13dbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13dc157070 0x7f13dc164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13db400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13dc063430 0x7f13dc1541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13dbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13dc157070 0x7f13dc164360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52458/0 (socket says 172.21.15.49:52458) 2024-01-22T05:13:22.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13daa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13dc067a90 0x7f13dc154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13dbe00700 1 -- 172.21.15.49:0/843240460 learned_addr learned my addr 172.21.15.49:0/843240460 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:22.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13dbe00700 1 -- 172.21.15.49:0/843240460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13dc063430 msgr2=0x7f13dc1541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13dbe00700 1 --2- 172.21.15.49:0/843240460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13dc063430 0x7f13dc1541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13dbe00700 1 -- 172.21.15.49:0/843240460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13dc067a90 msgr2=0x7f13dc154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:22.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13dbe00700 1 --2- 172.21.15.49:0/843240460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13dc067a90 0x7f13dc154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:22.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13dbe00700 1 -- 172.21.15.49:0/843240460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d4009a20 con 0x7f13dc157070 2024-01-22T05:13:22.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13daa00700 1 --2- 172.21.15.49:0/843240460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13dc067a90 0x7f13dc154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:22.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.853+0000 7f13db400700 1 --2- 172.21.15.49:0/843240460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13dc063430 0x7f13dc1541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:22.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.857+0000 7f13dbe00700 1 --2- 172.21.15.49:0/843240460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13dc157070 0x7f13dc164360 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f13dc060380 tx=0x7f13dc062f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:22.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.857+0000 7f13d2a00700 1 -- 172.21.15.49:0/843240460 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d401d630 con 0x7f13dc157070 2024-01-22T05:13:22.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.857+0000 7f13d2a00700 1 -- 172.21.15.49:0/843240460 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d401d790 con 0x7f13dc157070 2024-01-22T05:13:22.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.857+0000 7f13d2a00700 1 -- 172.21.15.49:0/843240460 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d401db50 con 0x7f13dc157070 2024-01-22T05:13:22.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.857+0000 7f13e1200700 1 -- 172.21.15.49:0/843240460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13dc153020 con 0x7f13dc157070 2024-01-22T05:13:22.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.857+0000 7f13e1200700 1 -- 172.21.15.49:0/843240460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc1535e0 con 0x7f13dc157070 2024-01-22T05:13:22.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.857+0000 7f13e1200700 1 -- 172.21.15.49:0/843240460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13dc153830 con 0x7f13dc157070 2024-01-22T05:13:22.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.861+0000 7f13d2a00700 1 -- 172.21.15.49:0/843240460 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f13d4003040 con 0x7f13dc157070 2024-01-22T05:13:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.861+0000 7f13d2a00700 1 --2- 172.21.15.49:0/843240460 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13b405a510 0x7f13b405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.861+0000 7f13d2a00700 1 -- 172.21.15.49:0/843240460 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f13d4076810 con 0x7f13dc157070 2024-01-22T05:13:22.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.861+0000 7f13db400700 1 --2- 172.21.15.49:0/843240460 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13b405a510 0x7f13b405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:22.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.861+0000 7f13db400700 1 --2- 172.21.15.49:0/843240460 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13b405a510 0x7f13b405c9d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f13dc150fa0 tx=0x7f13cc007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:22.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:22.865+0000 7f13d2a00700 1 -- 172.21.15.49:0/843240460 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f13d4049dd0 con 0x7f13dc157070 2024-01-22T05:13:23.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.029+0000 7f13e1200700 1 -- 172.21.15.49:0/843240460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13dc046800 con 0x7f13dc157070 2024-01-22T05:13:23.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.029+0000 7f13d2a00700 1 -- 172.21.15.49:0/843240460 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v104) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13d404d3f0 con 0x7f13dc157070 2024-01-22T05:13:23.029 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:13:23.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.029+0000 7f13e1200700 1 -- 172.21.15.49:0/843240460 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13b405a510 msgr2=0x7f13b405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:23.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.029+0000 7f13e1200700 1 --2- 172.21.15.49:0/843240460 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13b405a510 0x7f13b405c9d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f13dc150fa0 tx=0x7f13cc007bb0).stop 2024-01-22T05:13:23.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.029+0000 7f13e1200700 1 -- 172.21.15.49:0/843240460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13dc157070 msgr2=0x7f13dc164360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:23.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.029+0000 7f13e1200700 1 --2- 172.21.15.49:0/843240460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13dc157070 0x7f13dc164360 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f13dc060380 tx=0x7f13dc062f10).stop 2024-01-22T05:13:23.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.033+0000 7f13e1200700 1 -- 172.21.15.49:0/843240460 shutdown_connections 2024-01-22T05:13:23.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.033+0000 7f13e1200700 1 --2- 172.21.15.49:0/843240460 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13b405a510 0x7f13b405c9d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.033+0000 7f13e1200700 1 --2- 172.21.15.49:0/843240460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13dc157070 0x7f13dc164360 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.033+0000 7f13e1200700 1 --2- 172.21.15.49:0/843240460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13dc067a90 0x7f13dc154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.033+0000 7f13e1200700 1 --2- 172.21.15.49:0/843240460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13dc063430 0x7f13dc1541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.033+0000 7f13e1200700 1 -- 172.21.15.49:0/843240460 >> 172.21.15.49:0/843240460 conn(0x7f13dc0c3f00 msgr2=0x7f13dc0bca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:23.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.033+0000 7f13e1200700 1 -- 172.21.15.49:0/843240460 shutdown_connections 2024-01-22T05:13:23.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.033+0000 7f13e1200700 1 -- 172.21.15.49:0/843240460 wait complete. 2024-01-22T05:13:23.055 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:13:23.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.225+0000 7f54ac800700 1 Processor -- start 2024-01-22T05:13:23.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.225+0000 7f54ac800700 1 -- start start 2024-01-22T05:13:23.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.229+0000 7f54ac800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54a40c1ce0 0x7f54a40bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:23.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.229+0000 7f54ac800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a40bc9c0 0x7f54a4068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:23.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.229+0000 7f54ac800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a4158650 con 0x7f54a40a8c20 2024-01-22T05:13:23.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.229+0000 7f54ac800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a40bd170 con 0x7f54a40c1ce0 2024-01-22T05:13:23.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.229+0000 7f54ac800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a4067c30 con 0x7f54a40bc9c0 2024-01-22T05:13:23.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.229+0000 7f54a9400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54a40c1ce0 0x7f54a40bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.229+0000 7f54a9400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54a40c1ce0 0x7f54a40bc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52470/0 (socket says 172.21.15.49:52470) 2024-01-22T05:13:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.229+0000 7f54a9400700 1 -- 172.21.15.49:0/1286423163 learned_addr learned my addr 172.21.15.49:0/1286423163 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.229+0000 7f54aa800700 1 --2- 172.21.15.49:0/1286423163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a40bc9c0 0x7f54a4068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.229+0000 7f54a9400700 1 -- 172.21.15.49:0/1286423163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a40bc9c0 msgr2=0x7f54a4068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.229+0000 7f54a9400700 1 --2- 172.21.15.49:0/1286423163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a40bc9c0 0x7f54a4068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.233+0000 7f54a9400700 1 -- 172.21.15.49:0/1286423163 >> v1:172.21.15.110:6789/0 conn(0x7f54a40a8c20 legacy=0x7f54a40c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.233+0000 7f54a9400700 1 -- 172.21.15.49:0/1286423163 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a4067f10 con 0x7f54a40c1ce0 2024-01-22T05:13:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.233+0000 7f54a9400700 1 --2- 172.21.15.49:0/1286423163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a40c1ce0 0x7f54a40bc4d0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f548c009810 tx=0x7f548c009060).ready entity=mon.0 client_cookie=784486fcd4e43fbe server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.233+0000 7f54a8a00700 1 -- 172.21.15.49:0/1286423163 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c005880 con 0x7f54a40c1ce0 2024-01-22T05:13:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.233+0000 7f54a8a00700 1 -- 172.21.15.49:0/1286423163 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c0059e0 con 0x7f54a40c1ce0 2024-01-22T05:13:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.233+0000 7f54a8a00700 1 -- 172.21.15.49:0/1286423163 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c005d60 con 0x7f54a40c1ce0 2024-01-22T05:13:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.233+0000 7f54ac800700 1 -- 172.21.15.49:0/1286423163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a40c1ce0 msgr2=0x7f54a40bc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.233+0000 7f54ac800700 1 --2- 172.21.15.49:0/1286423163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a40c1ce0 0x7f54a40bc4d0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f548c009810 tx=0x7f548c009060).stop 2024-01-22T05:13:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.233+0000 7f54ac800700 1 -- 172.21.15.49:0/1286423163 shutdown_connections 2024-01-22T05:13:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.233+0000 7f54ac800700 1 --2- 172.21.15.49:0/1286423163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a40bc9c0 0x7f54a4068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.233+0000 7f54ac800700 1 --2- 172.21.15.49:0/1286423163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a40c1ce0 0x7f54a40bc4d0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.233+0000 7f54ac800700 1 -- 172.21.15.49:0/1286423163 >> 172.21.15.49:0/1286423163 conn(0x7f54a4062cb0 msgr2=0x7f54a40c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.233+0000 7f54ac800700 1 -- 172.21.15.49:0/1286423163 shutdown_connections 2024-01-22T05:13:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.233+0000 7f54ac800700 1 -- 172.21.15.49:0/1286423163 wait complete. 2024-01-22T05:13:23.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.237+0000 7f54ac800700 1 Processor -- start 2024-01-22T05:13:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.237+0000 7f54ac800700 1 -- start start 2024-01-22T05:13:23.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54ac800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a40a8c20 0x7f54a414ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:23.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54ac800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a40bc9c0 0x7f54a40be1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:23.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54ac800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a40c1ce0 0x7f54a4168ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:23.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54ac800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40c3ad0 con 0x7f54a40a8c20 2024-01-22T05:13:23.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54ac800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a4169980 con 0x7f54a40bc9c0 2024-01-22T05:13:23.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54ac800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a41696a0 con 0x7f54a40c1ce0 2024-01-22T05:13:23.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54a9e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a40a8c20 0x7f54a414ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:23.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54a9e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a40a8c20 0x7f54a414ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52478/0 (socket says 172.21.15.49:52478) 2024-01-22T05:13:23.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54a9400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a40bc9c0 0x7f54a40be1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:23.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54a9e00700 1 -- 172.21.15.49:0/576666992 learned_addr learned my addr 172.21.15.49:0/576666992 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:23.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54aa800700 1 --2- 172.21.15.49:0/576666992 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a40c1ce0 0x7f54a4168ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:23.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54aa800700 1 -- 172.21.15.49:0/576666992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a40bc9c0 msgr2=0x7f54a40be1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:23.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54aa800700 1 --2- 172.21.15.49:0/576666992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a40bc9c0 0x7f54a40be1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54aa800700 1 -- 172.21.15.49:0/576666992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a40a8c20 msgr2=0x7f54a414ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:23.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54aa800700 1 --2- 172.21.15.49:0/576666992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a40a8c20 0x7f54a414ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54aa800700 1 -- 172.21.15.49:0/576666992 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c009300 con 0x7f54a40c1ce0 2024-01-22T05:13:23.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54a9e00700 1 --2- 172.21.15.49:0/576666992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a40a8c20 0x7f54a414ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:23.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54aa800700 1 --2- 172.21.15.49:0/576666992 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a40c1ce0 0x7f54a4168ac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f549c007ed0 tx=0x7f549c009850).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:23.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54a1600700 1 -- 172.21.15.49:0/576666992 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c00eb90 con 0x7f54a40c1ce0 2024-01-22T05:13:23.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54a1600700 1 -- 172.21.15.49:0/576666992 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c00ecf0 con 0x7f54a40c1ce0 2024-01-22T05:13:23.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54ac800700 1 -- 172.21.15.49:0/576666992 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a40bd720 con 0x7f54a40c1ce0 2024-01-22T05:13:23.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.241+0000 7f54a1600700 1 -- 172.21.15.49:0/576666992 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c014610 con 0x7f54a40c1ce0 2024-01-22T05:13:23.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.245+0000 7f54ac800700 1 -- 172.21.15.49:0/576666992 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a40bdce0 con 0x7f54a40c1ce0 2024-01-22T05:13:23.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.245+0000 7f54ac800700 1 -- 172.21.15.49:0/576666992 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a40c0c00 con 0x7f54a40c1ce0 2024-01-22T05:13:23.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.245+0000 7f54a1600700 1 -- 172.21.15.49:0/576666992 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f549c014a00 con 0x7f54a40c1ce0 2024-01-22T05:13:23.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.245+0000 7f54a1600700 1 --2- 172.21.15.49:0/576666992 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f547c05a510 0x7f547c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:23.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.249+0000 7f54a1600700 1 -- 172.21.15.49:0/576666992 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f549c074d00 con 0x7f54a40c1ce0 2024-01-22T05:13:23.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.249+0000 7f54a9e00700 1 --2- 172.21.15.49:0/576666992 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f547c05a510 0x7f547c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:23.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.249+0000 7f54a9e00700 1 --2- 172.21.15.49:0/576666992 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f547c05a510 0x7f547c05c9d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f5494007fd0 tx=0x7f5494009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:23.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.257+0000 7f54a1600700 1 -- 172.21.15.49:0/576666992 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f549c048360 con 0x7f54a40c1ce0 2024-01-22T05:13:23.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.421+0000 7f54ac800700 1 -- 172.21.15.49:0/576666992 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54a40681f0 con 0x7f54a40c1ce0 2024-01-22T05:13:23.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.421+0000 7f54a1600700 1 -- 172.21.15.49:0/576666992 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v104) v1 ==== 100+0+11 (secure 0 0 0) 0x7f549c00ee60 con 0x7f54a40c1ce0 2024-01-22T05:13:23.422 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:13:23.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.425+0000 7f54ac800700 1 -- 172.21.15.49:0/576666992 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f547c05a510 msgr2=0x7f547c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:23.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.425+0000 7f54ac800700 1 --2- 172.21.15.49:0/576666992 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f547c05a510 0x7f547c05c9d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f5494007fd0 tx=0x7f5494009040).stop 2024-01-22T05:13:23.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.425+0000 7f54ac800700 1 -- 172.21.15.49:0/576666992 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a40c1ce0 msgr2=0x7f54a4168ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:23.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.425+0000 7f54ac800700 1 --2- 172.21.15.49:0/576666992 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a40c1ce0 0x7f54a4168ac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f549c007ed0 tx=0x7f549c009850).stop 2024-01-22T05:13:23.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.425+0000 7f54ac800700 1 -- 172.21.15.49:0/576666992 shutdown_connections 2024-01-22T05:13:23.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.425+0000 7f54ac800700 1 --2- 172.21.15.49:0/576666992 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f547c05a510 0x7f547c05c9d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.425+0000 7f54ac800700 1 --2- 172.21.15.49:0/576666992 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a40c1ce0 0x7f54a4168ac0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.425+0000 7f54ac800700 1 --2- 172.21.15.49:0/576666992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a40bc9c0 0x7f54a40be1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.425+0000 7f54ac800700 1 --2- 172.21.15.49:0/576666992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a40a8c20 0x7f54a414ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.425+0000 7f54ac800700 1 -- 172.21.15.49:0/576666992 >> 172.21.15.49:0/576666992 conn(0x7f54a4062cb0 msgr2=0x7f54a40c1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:23.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.425+0000 7f54ac800700 1 -- 172.21.15.49:0/576666992 shutdown_connections 2024-01-22T05:13:23.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.425+0000 7f54ac800700 1 -- 172.21.15.49:0/576666992 wait complete. 2024-01-22T05:13:23.447 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:13:23.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.601+0000 7f29b8200700 1 Processor -- start 2024-01-22T05:13:23.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.605+0000 7f29b8200700 1 -- start start 2024-01-22T05:13:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.605+0000 7f29b8200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f29b0065240 0x7f29b00644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.605+0000 7f29b8200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29b0065620 0x7f29b00649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.605+0000 7f29b8200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b00c2700 con 0x7f29b015b9b0 2024-01-22T05:13:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.605+0000 7f29b8200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b0064ed0 con 0x7f29b0065240 2024-01-22T05:13:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.605+0000 7f29b8200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00c29a0 con 0x7f29b0065620 2024-01-22T05:13:23.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29b5800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f29b0065240 0x7f29b00644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:23.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29b5800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f29b0065240 0x7f29b00644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32960/0 (socket says 172.21.15.49:32960) 2024-01-22T05:13:23.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29b5800700 1 -- 172.21.15.49:0/1956077424 learned_addr learned my addr 172.21.15.49:0/1956077424 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:23.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29b4e00700 1 --2- 172.21.15.49:0/1956077424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29b0065620 0x7f29b00649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:23.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29b5800700 1 -- 172.21.15.49:0/1956077424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29b0065620 msgr2=0x7f29b00649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:23.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29b5800700 1 --2- 172.21.15.49:0/1956077424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29b0065620 0x7f29b00649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29b5800700 1 -- 172.21.15.49:0/1956077424 >> v1:172.21.15.110:6789/0 conn(0x7f29b015b9b0 legacy=0x7f29b015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:23.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29b5800700 1 -- 172.21.15.49:0/1956077424 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00c2c80 con 0x7f29b0065240 2024-01-22T05:13:23.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29b5800700 1 --2- 172.21.15.49:0/1956077424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b0065240 0x7f29b00644f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7f29a0006fd0 tx=0x7f29a00090f0).ready entity=mon.0 client_cookie=ec237d59eb6b0e5f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:23.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29afe00700 1 -- 172.21.15.49:0/1956077424 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a000b580 con 0x7f29b0065240 2024-01-22T05:13:23.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29afe00700 1 -- 172.21.15.49:0/1956077424 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a000b6e0 con 0x7f29b0065240 2024-01-22T05:13:23.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29afe00700 1 -- 172.21.15.49:0/1956077424 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a000ba60 con 0x7f29b0065240 2024-01-22T05:13:23.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29b8200700 1 -- 172.21.15.49:0/1956077424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b0065240 msgr2=0x7f29b00644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:23.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29b8200700 1 --2- 172.21.15.49:0/1956077424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b0065240 0x7f29b00644f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7f29a0006fd0 tx=0x7f29a00090f0).stop 2024-01-22T05:13:23.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29b8200700 1 -- 172.21.15.49:0/1956077424 shutdown_connections 2024-01-22T05:13:23.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29b8200700 1 --2- 172.21.15.49:0/1956077424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29b0065620 0x7f29b00649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29b8200700 1 --2- 172.21.15.49:0/1956077424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b0065240 0x7f29b00644f0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.609+0000 7f29b8200700 1 -- 172.21.15.49:0/1956077424 >> 172.21.15.49:0/1956077424 conn(0x7f29b00c87f0 msgr2=0x7f29b00c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:23.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.613+0000 7f29b8200700 1 -- 172.21.15.49:0/1956077424 shutdown_connections 2024-01-22T05:13:23.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.613+0000 7f29b8200700 1 -- 172.21.15.49:0/1956077424 wait complete. 2024-01-22T05:13:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.613+0000 7f29b8200700 1 Processor -- start 2024-01-22T05:13:23.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.613+0000 7f29b8200700 1 -- start start 2024-01-22T05:13:23.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b8200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29b0065240 0x7f29b0168c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:23.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b8200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b0065620 0x7f29b01570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:23.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b8200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29b015b9b0 0x7f29b00a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:23.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b8200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00a8d50 con 0x7f29b0065620 2024-01-22T05:13:23.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b8200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b0169100 con 0x7f29b015b9b0 2024-01-22T05:13:23.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b8200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00a9f30 con 0x7f29b0065240 2024-01-22T05:13:23.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b4e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b0065620 0x7f29b01570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b4e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b0065620 0x7f29b01570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32974/0 (socket says 172.21.15.49:32974) 2024-01-22T05:13:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b4e00700 1 -- 172.21.15.49:0/1907592711 learned_addr learned my addr 172.21.15.49:0/1907592711 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b5800700 1 --2- 172.21.15.49:0/1907592711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29b0065240 0x7f29b0168c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b6c00700 1 --2- 172.21.15.49:0/1907592711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29b015b9b0 0x7f29b00a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b4e00700 1 -- 172.21.15.49:0/1907592711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29b0065240 msgr2=0x7f29b0168c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b4e00700 1 --2- 172.21.15.49:0/1907592711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29b0065240 0x7f29b0168c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b4e00700 1 -- 172.21.15.49:0/1907592711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29b015b9b0 msgr2=0x7f29b00a91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b4e00700 1 --2- 172.21.15.49:0/1907592711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29b015b9b0 0x7f29b00a91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b4e00700 1 -- 172.21.15.49:0/1907592711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a0009370 con 0x7f29b0065620 2024-01-22T05:13:23.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b6c00700 1 --2- 172.21.15.49:0/1907592711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29b015b9b0 0x7f29b00a91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b4e00700 1 --2- 172.21.15.49:0/1907592711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b0065620 0x7f29b01570e0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7f299800e950 tx=0x7f2998009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29acc00700 1 -- 172.21.15.49:0/1907592711 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299800c6a0 con 0x7f29b0065620 2024-01-22T05:13:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29acc00700 1 -- 172.21.15.49:0/1907592711 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299800c800 con 0x7f29b0065620 2024-01-22T05:13:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b8200700 1 -- 172.21.15.49:0/1907592711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b00aa210 con 0x7f29b0065620 2024-01-22T05:13:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29acc00700 1 -- 172.21.15.49:0/1907592711 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299800cb80 con 0x7f29b0065620 2024-01-22T05:13:23.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.617+0000 7f29b8200700 1 -- 172.21.15.49:0/1907592711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b00a89e0 con 0x7f29b0065620 2024-01-22T05:13:23.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.621+0000 7f29b8200700 1 -- 172.21.15.49:0/1907592711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b0047060 con 0x7f29b0065620 2024-01-22T05:13:23.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.621+0000 7f29acc00700 1 -- 172.21.15.49:0/1907592711 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f299801b400 con 0x7f29b0065620 2024-01-22T05:13:23.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.621+0000 7f29acc00700 1 --2- 172.21.15.49:0/1907592711 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f298805a510 0x7f298805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:23.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.621+0000 7f29acc00700 1 -- 172.21.15.49:0/1907592711 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2998075090 con 0x7f29b0065620 2024-01-22T05:13:23.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.621+0000 7f29b5800700 1 --2- 172.21.15.49:0/1907592711 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f298805a510 0x7f298805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:23.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.625+0000 7f29b5800700 1 --2- 172.21.15.49:0/1907592711 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f298805a510 0x7f298805c9d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f29a0009fd0 tx=0x7f29a0017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:23.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.629+0000 7f29acc00700 1 -- 172.21.15.49:0/1907592711 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f29980486a0 con 0x7f29b0065620 2024-01-22T05:13:23.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.829+0000 7f29b8200700 1 -- 172.21.15.49:0/1907592711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29b00a8e90 con 0x7f29b0065620 2024-01-22T05:13:23.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.829+0000 7f29acc00700 1 -- 172.21.15.49:0/1907592711 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f2998016070 con 0x7f29b0065620 2024-01-22T05:13:23.830 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:23.830 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2953480069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2953480069},{"type":"v1","addr":"172.21.15.110:6833","nonce":2953480069}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2000522159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2000522159},{"type":"v1","addr":"172.21.15.110:6835","nonce":2000522159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/578632238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":578632238},{"type":"v1","addr":"172.21.15.49:6836","nonce":578632238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:12:25.842913+0000","modified":"2024-01-22T05:12:28.864832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7287":{"gid":7287,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/1226995696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1226995696},{"type":"v1","addr":"172.21.15.49:6837","nonce":1226995696}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-22T05:13:23.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.833+0000 7f29b8200700 1 -- 172.21.15.49:0/1907592711 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f298805a510 msgr2=0x7f298805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:23.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.833+0000 7f29b8200700 1 --2- 172.21.15.49:0/1907592711 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f298805a510 0x7f298805c9d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f29a0009fd0 tx=0x7f29a0017000).stop 2024-01-22T05:13:23.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.833+0000 7f29b8200700 1 -- 172.21.15.49:0/1907592711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b0065620 msgr2=0x7f29b01570e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:23.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.833+0000 7f29b8200700 1 --2- 172.21.15.49:0/1907592711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b0065620 0x7f29b01570e0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7f299800e950 tx=0x7f2998009060).stop 2024-01-22T05:13:23.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.833+0000 7f29b8200700 1 -- 172.21.15.49:0/1907592711 shutdown_connections 2024-01-22T05:13:23.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.833+0000 7f29b8200700 1 --2- 172.21.15.49:0/1907592711 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f298805a510 0x7f298805c9d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.833+0000 7f29b8200700 1 --2- 172.21.15.49:0/1907592711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29b015b9b0 0x7f29b00a91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.833+0000 7f29b8200700 1 --2- 172.21.15.49:0/1907592711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29b0065620 0x7f29b01570e0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.833+0000 7f29b8200700 1 --2- 172.21.15.49:0/1907592711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29b0065240 0x7f29b0168c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:23.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.833+0000 7f29b8200700 1 -- 172.21.15.49:0/1907592711 >> 172.21.15.49:0/1907592711 conn(0x7f29b00c87f0 msgr2=0x7f29b00ad470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:23.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.833+0000 7f29b8200700 1 -- 172.21.15.49:0/1907592711 shutdown_connections 2024-01-22T05:13:23.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:23.833+0000 7f29b8200700 1 -- 172.21.15.49:0/1907592711 wait complete. 2024-01-22T05:13:23.837 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 90 2024-01-22T05:13:23.858 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:13:24.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.025+0000 7f42a7600700 1 Processor -- start 2024-01-22T05:13:24.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.029+0000 7f42a7600700 1 -- start start 2024-01-22T05:13:24.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f42a7600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f42a0066fb0 0x7f42a00c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f42a7600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a00a8f90 0x7f42a0065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f42a7600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a00c1ee0 con 0x7f42a00a8b10 2024-01-22T05:13:24.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f42a7600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a00c12f0 con 0x7f42a0066fb0 2024-01-22T05:13:24.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f42a7600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a00c15b0 con 0x7f42a00a8f90 2024-01-22T05:13:24.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f42a4c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f42a0066fb0 0x7f42a00c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f42a4c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f42a0066fb0 0x7f42a00c2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32988/0 (socket says 172.21.15.49:32988) 2024-01-22T05:13:24.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f42a4c00700 1 -- 172.21.15.49:0/2173704791 learned_addr learned my addr 172.21.15.49:0/2173704791 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:24.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f42a5600700 1 --2- 172.21.15.49:0/2173704791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a00a8f90 0x7f42a0065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f42a4c00700 1 -- 172.21.15.49:0/2173704791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a00a8f90 msgr2=0x7f42a0065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:24.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f42a4c00700 1 --2- 172.21.15.49:0/2173704791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a00a8f90 0x7f42a0065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f42a4c00700 1 -- 172.21.15.49:0/2173704791 >> v1:172.21.15.110:6789/0 conn(0x7f42a00a8b10 legacy=0x7f42a0157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f42a4c00700 1 -- 172.21.15.49:0/2173704791 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a00c1890 con 0x7f42a0066fb0 2024-01-22T05:13:24.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f42a5600700 1 --2- 172.21.15.49:0/2173704791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a00a8f90 0x7f42a0065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:24.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f42a4c00700 1 --2- 172.21.15.49:0/2173704791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42a0066fb0 0x7f42a00c2370 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f4290006fd0 tx=0x7f42900090f0).ready entity=mon.0 client_cookie=ceb159a50026bd33 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:24.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f429f400700 1 -- 172.21.15.49:0/2173704791 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429000b580 con 0x7f42a0066fb0 2024-01-22T05:13:24.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f429f400700 1 -- 172.21.15.49:0/2173704791 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429000b6e0 con 0x7f42a0066fb0 2024-01-22T05:13:24.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.033+0000 7f429f400700 1 -- 172.21.15.49:0/2173704791 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429000ba60 con 0x7f42a0066fb0 2024-01-22T05:13:24.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.037+0000 7f42a7600700 1 -- 172.21.15.49:0/2173704791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42a0066fb0 msgr2=0x7f42a00c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.037+0000 7f42a7600700 1 --2- 172.21.15.49:0/2173704791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42a0066fb0 0x7f42a00c2370 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f4290006fd0 tx=0x7f42900090f0).stop 2024-01-22T05:13:24.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.037+0000 7f42a7600700 1 -- 172.21.15.49:0/2173704791 shutdown_connections 2024-01-22T05:13:24.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.037+0000 7f42a7600700 1 --2- 172.21.15.49:0/2173704791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a00a8f90 0x7f42a0065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.037+0000 7f42a7600700 1 --2- 172.21.15.49:0/2173704791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42a0066fb0 0x7f42a00c2370 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.037+0000 7f42a7600700 1 -- 172.21.15.49:0/2173704791 >> 172.21.15.49:0/2173704791 conn(0x7f42a00c6540 msgr2=0x7f42a00c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:24.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.037+0000 7f42a7600700 1 -- 172.21.15.49:0/2173704791 shutdown_connections 2024-01-22T05:13:24.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.037+0000 7f42a7600700 1 -- 172.21.15.49:0/2173704791 wait complete. 2024-01-22T05:13:24.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.041+0000 7f42a7600700 1 Processor -- start 2024-01-22T05:13:24.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.041+0000 7f42a7600700 1 -- start start 2024-01-22T05:13:24.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f42a7600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a0066fb0 0x7f42a00c02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f42a7600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42a00a8b10 0x7f42a0135240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f42a7600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a00a8f90 0x7f42a00c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f42a7600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a00aa450 con 0x7f42a00a8b10 2024-01-22T05:13:24.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f42a7600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a00aa730 con 0x7f42a00a8f90 2024-01-22T05:13:24.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f42a7600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a00aaa10 con 0x7f42a0066fb0 2024-01-22T05:13:24.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f429fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42a00a8b10 0x7f42a0135240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f429fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42a00a8b10 0x7f42a0135240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33000/0 (socket says 172.21.15.49:33000) 2024-01-22T05:13:24.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f429fe00700 1 -- 172.21.15.49:0/1393252654 learned_addr learned my addr 172.21.15.49:0/1393252654 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:24.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f42a4c00700 1 --2- 172.21.15.49:0/1393252654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a0066fb0 0x7f42a00c02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f42a5600700 1 --2- 172.21.15.49:0/1393252654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a00a8f90 0x7f42a00c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f429fe00700 1 -- 172.21.15.49:0/1393252654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a0066fb0 msgr2=0x7f42a00c02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f429fe00700 1 --2- 172.21.15.49:0/1393252654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a0066fb0 0x7f42a00c02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f429fe00700 1 -- 172.21.15.49:0/1393252654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a00a8f90 msgr2=0x7f42a00c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f429fe00700 1 --2- 172.21.15.49:0/1393252654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a00a8f90 0x7f42a00c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f429fe00700 1 -- 172.21.15.49:0/1393252654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4298009a20 con 0x7f42a00a8b10 2024-01-22T05:13:24.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f429fe00700 1 --2- 172.21.15.49:0/1393252654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42a00a8b10 0x7f42a0135240 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f428800c4c0 tx=0x7f4288007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:24.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f4297e00700 1 -- 172.21.15.49:0/1393252654 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288007020 con 0x7f42a00a8b10 2024-01-22T05:13:24.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f4297e00700 1 -- 172.21.15.49:0/1393252654 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4288001e90 con 0x7f42a00a8b10 2024-01-22T05:13:24.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f42a7600700 1 -- 172.21.15.49:0/1393252654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4290009370 con 0x7f42a00a8b10 2024-01-22T05:13:24.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f4297e00700 1 -- 172.21.15.49:0/1393252654 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42880073b0 con 0x7f42a00a8b10 2024-01-22T05:13:24.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.045+0000 7f42a7600700 1 -- 172.21.15.49:0/1393252654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a00ab050 con 0x7f42a00a8b10 2024-01-22T05:13:24.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.049+0000 7f42a7600700 1 -- 172.21.15.49:0/1393252654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a00aa210 con 0x7f42a00a8b10 2024-01-22T05:13:24.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.049+0000 7f4297e00700 1 -- 172.21.15.49:0/1393252654 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f42880068b0 con 0x7f42a00a8b10 2024-01-22T05:13:24.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.049+0000 7f4297e00700 1 --2- 172.21.15.49:0/1393252654 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f427805a540 0x7f427805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.049+0000 7f4297e00700 1 -- 172.21.15.49:0/1393252654 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4288074220 con 0x7f42a00a8b10 2024-01-22T05:13:24.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.053+0000 7f42a4c00700 1 --2- 172.21.15.49:0/1393252654 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f427805a540 0x7f427805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.053+0000 7f42a4c00700 1 --2- 172.21.15.49:0/1393252654 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f427805a540 0x7f427805ca00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f4290009fd0 tx=0x7f4290017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:24.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.057+0000 7f4297e00700 1 -- 172.21.15.49:0/1393252654 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f42a00aa210 con 0x7f42a00a8b10 2024-01-22T05:13:24.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.229+0000 7f42a7600700 1 -- 172.21.15.49:0/1393252654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42a00ab1e0 con 0x7f42a00a8b10 2024-01-22T05:13:24.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.233+0000 7f4297e00700 1 -- 172.21.15.49:0/1393252654 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+17178 (secure 0 0 0) 0x7f42880478a0 con 0x7f42a00a8b10 2024-01-22T05:13:24.232 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:24.232 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":104,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:12:26.847459+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:12:23.950155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-01-22T05:12:24.858181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:13:24.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.237+0000 7f42a7600700 1 -- 172.21.15.49:0/1393252654 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f427805a540 msgr2=0x7f427805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.237+0000 7f42a7600700 1 --2- 172.21.15.49:0/1393252654 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f427805a540 0x7f427805ca00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f4290009fd0 tx=0x7f4290017000).stop 2024-01-22T05:13:24.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.237+0000 7f42a7600700 1 -- 172.21.15.49:0/1393252654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42a00a8b10 msgr2=0x7f42a0135240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.237+0000 7f42a7600700 1 --2- 172.21.15.49:0/1393252654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42a00a8b10 0x7f42a0135240 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f428800c4c0 tx=0x7f4288007e00).stop 2024-01-22T05:13:24.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.237+0000 7f42a7600700 1 -- 172.21.15.49:0/1393252654 shutdown_connections 2024-01-22T05:13:24.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.237+0000 7f42a7600700 1 --2- 172.21.15.49:0/1393252654 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f427805a540 0x7f427805ca00 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.237+0000 7f42a7600700 1 --2- 172.21.15.49:0/1393252654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a00a8f90 0x7f42a00c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.237+0000 7f42a7600700 1 --2- 172.21.15.49:0/1393252654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42a00a8b10 0x7f42a0135240 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.237+0000 7f42a7600700 1 --2- 172.21.15.49:0/1393252654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a0066fb0 0x7f42a00c02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.237+0000 7f42a7600700 1 -- 172.21.15.49:0/1393252654 >> 172.21.15.49:0/1393252654 conn(0x7f42a00c6540 msgr2=0x7f42a00688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:24.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.237+0000 7f42a7600700 1 -- 172.21.15.49:0/1393252654 shutdown_connections 2024-01-22T05:13:24.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.237+0000 7f42a7600700 1 -- 172.21.15.49:0/1393252654 wait complete. 2024-01-22T05:13:24.259 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:13:24.260 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:13:24.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.417+0000 7fc78a400700 1 Processor -- start 2024-01-22T05:13:24.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.421+0000 7fc78a400700 1 -- start start 2024-01-22T05:13:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.421+0000 7fc78a400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7840abd20 0x7fc784065c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.421+0000 7fc78a400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc784068a60 con 0x7fc7840ab890 2024-01-22T05:13:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.421+0000 7fc78a400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7840bd380 con 0x7fc7840bcfa0 2024-01-22T05:13:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.421+0000 7fc78a400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7840bb790 con 0x7fc7840abd20 2024-01-22T05:13:24.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.421+0000 7fc782a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc7840ab890 0x7fc784065550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59790/0 (socket says 172.21.15.49:59790) 2024-01-22T05:13:24.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.421+0000 7fc782a00700 1 -- 172.21.15.49:0/3871798301 learned_addr learned my addr 172.21.15.49:0/3871798301 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:24.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.421+0000 7fc783e00700 1 --2- 172.21.15.49:0/3871798301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7840abd20 0x7fc784065c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.421+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392544036 0 0) 0x7fc784068a60 con 0x7fc7840ab890 2024-01-22T05:13:24.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7640033f0 con 0x7fc7840ab890 2024-01-22T05:13:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997156796 0 0) 0x7fc7840bd380 con 0x7fc7840bcfa0 2024-01-22T05:13:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc784068a60 con 0x7fc7840bcfa0 2024-01-22T05:13:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 644961204 0 0) 0x7fc7640033f0 con 0x7fc7840ab890 2024-01-22T05:13:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7840abd20 msgr2=0x7fc784065c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 --2- 172.21.15.49:0/3871798301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7840abd20 0x7fc784065c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 >> v1:172.21.15.110:6789/0 conn(0x7fc7840bcfa0 legacy=0x7fc784151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc784068460 con 0x7fc7840ab890 2024-01-22T05:13:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fc76c001470 con 0x7fc7840ab890 2024-01-22T05:13:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 >> v1:172.21.15.49:6789/0 conn(0x7fc7840ab890 legacy=0x7fc784065550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 --2- 172.21.15.49:0/3871798301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc764003aa0 0x7fc764003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 --2- 172.21.15.49:0/3871798301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc764004690 0x7fc764004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 --2- 172.21.15.49:0/3871798301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7840abd20 0x7fc764005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7840bb790 con 0x7fc764004690 2024-01-22T05:13:24.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76400b910 con 0x7fc764003aa0 2024-01-22T05:13:24.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76400bad0 con 0x7fc7840abd20 2024-01-22T05:13:24.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782a00700 1 --2- 172.21.15.49:0/3871798301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc764004690 0x7fc764004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc783e00700 1 --2- 172.21.15.49:0/3871798301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7840abd20 0x7fc764005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc783400700 1 --2- 172.21.15.49:0/3871798301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc764003aa0 0x7fc764003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782a00700 1 -- 172.21.15.49:0/3871798301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7840abd20 msgr2=0x7fc764005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:24.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782a00700 1 --2- 172.21.15.49:0/3871798301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7840abd20 0x7fc764005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782a00700 1 -- 172.21.15.49:0/3871798301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc764003aa0 msgr2=0x7fc764003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782a00700 1 --2- 172.21.15.49:0/3871798301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc764003aa0 0x7fc764003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782a00700 1 -- 172.21.15.49:0/3871798301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7640033f0 con 0x7fc764004690 2024-01-22T05:13:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782a00700 1 --2- 172.21.15.49:0/3871798301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc764004690 0x7fc764004b10 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7fc76c00c190 tx=0x7fc76c001e10).ready entity=mon.0 client_cookie=183059f43c0278a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c00ca00 con 0x7fc764004690 2024-01-22T05:13:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c00cb60 con 0x7fc764004690 2024-01-22T05:13:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.425+0000 7fc782000700 1 -- 172.21.15.49:0/3871798301 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0070d0 con 0x7fc764004690 2024-01-22T05:13:24.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.429+0000 7fc78a400700 1 -- 172.21.15.49:0/3871798301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc764004690 msgr2=0x7fc764004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.429+0000 7fc78a400700 1 --2- 172.21.15.49:0/3871798301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc764004690 0x7fc764004b10 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7fc76c00c190 tx=0x7fc76c001e10).stop 2024-01-22T05:13:24.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.429+0000 7fc783e00700 1 -- 172.21.15.49:0/3871798301 reap_dead start 2024-01-22T05:13:24.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.429+0000 7fc78a400700 1 -- 172.21.15.49:0/3871798301 shutdown_connections 2024-01-22T05:13:24.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.429+0000 7fc78a400700 1 -- 172.21.15.49:0/3871798301 >> 172.21.15.49:0/3871798301 conn(0x7fc7840c6540 msgr2=0x7fc7840c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:24.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.429+0000 7fc78a400700 1 -- 172.21.15.49:0/3871798301 shutdown_connections 2024-01-22T05:13:24.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.429+0000 7fc78a400700 1 -- 172.21.15.49:0/3871798301 wait complete. 2024-01-22T05:13:24.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.433+0000 7fc78a400700 1 Processor -- start 2024-01-22T05:13:24.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.433+0000 7fc78a400700 1 -- start start 2024-01-22T05:13:24.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.433+0000 7fc78a400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc764004690 0x7fc7840c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.433+0000 7fc78a400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc78413f140 0x7fc78414dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.433+0000 7fc78a400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7840c52d0 0x7fc7840c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.433+0000 7fc78a400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78414ec80 con 0x7fc78413f140 2024-01-22T05:13:24.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.433+0000 7fc78a400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78413f5c0 con 0x7fc7840c52d0 2024-01-22T05:13:24.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.433+0000 7fc78a400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc784155320 con 0x7fc764004690 2024-01-22T05:13:24.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc782a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc78413f140 0x7fc78414dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc783400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc764004690 0x7fc7840c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc782a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc78413f140 0x7fc78414dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33014/0 (socket says 172.21.15.49:33014) 2024-01-22T05:13:24.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc782a00700 1 -- 172.21.15.49:0/2936055552 learned_addr learned my addr 172.21.15.49:0/2936055552 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:24.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc783e00700 1 --2- 172.21.15.49:0/2936055552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7840c52d0 0x7fc7840c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc782a00700 1 -- 172.21.15.49:0/2936055552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc764004690 msgr2=0x7fc7840c30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc782a00700 1 --2- 172.21.15.49:0/2936055552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc764004690 0x7fc7840c30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc782a00700 1 -- 172.21.15.49:0/2936055552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7840c52d0 msgr2=0x7fc7840c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc782a00700 1 --2- 172.21.15.49:0/2936055552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7840c52d0 0x7fc7840c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc782a00700 1 -- 172.21.15.49:0/2936055552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840c5c40 con 0x7fc78413f140 2024-01-22T05:13:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc782a00700 1 --2- 172.21.15.49:0/2936055552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc78413f140 0x7fc78414dc00 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fc76400b8e0 tx=0x7fc76c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc77aa00700 1 -- 172.21.15.49:0/2936055552 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c001430 con 0x7fc78413f140 2024-01-22T05:13:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc77aa00700 1 -- 172.21.15.49:0/2936055552 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c001590 con 0x7fc78413f140 2024-01-22T05:13:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc78a400700 1 -- 172.21.15.49:0/2936055552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78414e3e0 con 0x7fc78413f140 2024-01-22T05:13:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc77aa00700 1 -- 172.21.15.49:0/2936055552 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c004900 con 0x7fc78413f140 2024-01-22T05:13:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc78a400700 1 -- 172.21.15.49:0/2936055552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78414e9a0 con 0x7fc78413f140 2024-01-22T05:13:24.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.437+0000 7fc78a400700 1 -- 172.21.15.49:0/2936055552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc784047060 con 0x7fc78413f140 2024-01-22T05:13:24.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.441+0000 7fc77aa00700 1 -- 172.21.15.49:0/2936055552 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc76c004c70 con 0x7fc78413f140 2024-01-22T05:13:24.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.441+0000 7fc77aa00700 1 --2- 172.21.15.49:0/2936055552 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc75c05a540 0x7fc75c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.441+0000 7fc77aa00700 1 -- 172.21.15.49:0/2936055552 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc76c075460 con 0x7fc78413f140 2024-01-22T05:13:24.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.441+0000 7fc783400700 1 --2- 172.21.15.49:0/2936055552 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc75c05a540 0x7fc75c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.445+0000 7fc783400700 1 --2- 172.21.15.49:0/2936055552 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc75c05a540 0x7fc75c05ca00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fc7740010e0 tx=0x7fc774009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:24.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.449+0000 7fc77aa00700 1 -- 172.21.15.49:0/2936055552 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc76c048a20 con 0x7fc78413f140 2024-01-22T05:13:24.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.661+0000 7fc78a400700 1 -- 172.21.15.49:0/2936055552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc784046800 con 0x7fc78413f140 2024-01-22T05:13:24.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.661+0000 7fc77aa00700 1 -- 172.21.15.49:0/2936055552 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fc76c025020 con 0x7fc78413f140 2024-01-22T05:13:24.662 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:24.663 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2953480069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2953480069},{"type":"v1","addr":"172.21.15.110:6833","nonce":2953480069}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2000522159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2000522159},{"type":"v1","addr":"172.21.15.110:6835","nonce":2000522159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/578632238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":578632238},{"type":"v1","addr":"172.21.15.49:6836","nonce":578632238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:12:25.842913+0000","modified":"2024-01-22T05:12:28.864832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7287":{"gid":7287,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/1226995696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1226995696},{"type":"v1","addr":"172.21.15.49:6837","nonce":1226995696}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-22T05:13:24.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.665+0000 7fc78a400700 1 -- 172.21.15.49:0/2936055552 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc75c05a540 msgr2=0x7fc75c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.665+0000 7fc78a400700 1 --2- 172.21.15.49:0/2936055552 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc75c05a540 0x7fc75c05ca00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fc7740010e0 tx=0x7fc774009040).stop 2024-01-22T05:13:24.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.665+0000 7fc78a400700 1 -- 172.21.15.49:0/2936055552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc78413f140 msgr2=0x7fc78414dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.665+0000 7fc78a400700 1 --2- 172.21.15.49:0/2936055552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc78413f140 0x7fc78414dc00 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fc76400b8e0 tx=0x7fc76c015000).stop 2024-01-22T05:13:24.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.665+0000 7fc78a400700 1 -- 172.21.15.49:0/2936055552 shutdown_connections 2024-01-22T05:13:24.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.665+0000 7fc78a400700 1 --2- 172.21.15.49:0/2936055552 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc75c05a540 0x7fc75c05ca00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.665+0000 7fc78a400700 1 --2- 172.21.15.49:0/2936055552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7840c52d0 0x7fc7840c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.665+0000 7fc78a400700 1 --2- 172.21.15.49:0/2936055552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc78413f140 0x7fc78414dc00 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.665+0000 7fc78a400700 1 --2- 172.21.15.49:0/2936055552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc764004690 0x7fc7840c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.665+0000 7fc78a400700 1 -- 172.21.15.49:0/2936055552 >> 172.21.15.49:0/2936055552 conn(0x7fc7840c6540 msgr2=0x7fc78414d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:24.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.665+0000 7fc78a400700 1 -- 172.21.15.49:0/2936055552 shutdown_connections 2024-01-22T05:13:24.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.665+0000 7fc78a400700 1 -- 172.21.15.49:0/2936055552 wait complete. 2024-01-22T05:13:24.671 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 90 2024-01-22T05:13:24.691 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:13:24.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.853+0000 7f5513200700 1 Processor -- start 2024-01-22T05:13:24.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.853+0000 7f5513200700 1 -- start start 2024-01-22T05:13:24.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f5513200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f550c065240 0x7f550c0644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f5513200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550c065620 0x7f550c0649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f5513200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f550c15b9b0 0x7f550c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f5513200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550c064ed0 con 0x7f550c065240 2024-01-22T05:13:24.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f5513200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550c0c2700 con 0x7f550c15b9b0 2024-01-22T05:13:24.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f5513200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0c29a0 con 0x7f550c065620 2024-01-22T05:13:24.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f550be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f550c065240 0x7f550c0644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f550be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f550c065240 0x7f550c0644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33024/0 (socket says 172.21.15.49:33024) 2024-01-22T05:13:24.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f550be00700 1 -- 172.21.15.49:0/2925796274 learned_addr learned my addr 172.21.15.49:0/2925796274 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:24.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f550b400700 1 --2- 172.21.15.49:0/2925796274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550c065620 0x7f550c0649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f5511c00700 1 --2- 172.21.15.49:0/2925796274 >> v2:172.21.15.110:3300/0 conn(0x7f550c15b9b0 0x7f550c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f550be00700 1 -- 172.21.15.49:0/2925796274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550c065620 msgr2=0x7f550c0649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:24.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f550be00700 1 --2- 172.21.15.49:0/2925796274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550c065620 0x7f550c0649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f550be00700 1 -- 172.21.15.49:0/2925796274 >> v2:172.21.15.110:3300/0 conn(0x7f550c15b9b0 msgr2=0x7f550c15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:24.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f550be00700 1 --2- 172.21.15.49:0/2925796274 >> v2:172.21.15.110:3300/0 conn(0x7f550c15b9b0 0x7f550c15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f550be00700 1 -- 172.21.15.49:0/2925796274 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c0c2c80 con 0x7f550c065240 2024-01-22T05:13:24.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.857+0000 7f550be00700 1 --2- 172.21.15.49:0/2925796274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f550c065240 0x7f550c0644f0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f550c0665c0 tx=0x7f54fc0090f0).ready entity=mon.0 client_cookie=f2879cf480884716 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:24.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.861+0000 7f550aa00700 1 -- 172.21.15.49:0/2925796274 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00b600 con 0x7f550c065240 2024-01-22T05:13:24.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.861+0000 7f550aa00700 1 -- 172.21.15.49:0/2925796274 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc00b760 con 0x7f550c065240 2024-01-22T05:13:24.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.861+0000 7f550aa00700 1 -- 172.21.15.49:0/2925796274 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00bae0 con 0x7f550c065240 2024-01-22T05:13:24.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.861+0000 7f5513200700 1 -- 172.21.15.49:0/2925796274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f550c065240 msgr2=0x7f550c0644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.861+0000 7f5513200700 1 --2- 172.21.15.49:0/2925796274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f550c065240 0x7f550c0644f0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f550c0665c0 tx=0x7f54fc0090f0).stop 2024-01-22T05:13:24.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.861+0000 7f5513200700 1 -- 172.21.15.49:0/2925796274 shutdown_connections 2024-01-22T05:13:24.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.861+0000 7f5513200700 1 --2- 172.21.15.49:0/2925796274 >> v2:172.21.15.110:3300/0 conn(0x7f550c15b9b0 0x7f550c15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.861+0000 7f5513200700 1 --2- 172.21.15.49:0/2925796274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550c065620 0x7f550c0649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.861+0000 7f5513200700 1 --2- 172.21.15.49:0/2925796274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f550c065240 0x7f550c0644f0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.861+0000 7f5513200700 1 -- 172.21.15.49:0/2925796274 >> 172.21.15.49:0/2925796274 conn(0x7f550c0c87f0 msgr2=0x7f550c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:24.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.861+0000 7f5513200700 1 -- 172.21.15.49:0/2925796274 shutdown_connections 2024-01-22T05:13:24.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.861+0000 7f5513200700 1 -- 172.21.15.49:0/2925796274 wait complete. 2024-01-22T05:13:24.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.865+0000 7f5513200700 1 Processor -- start 2024-01-22T05:13:24.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.865+0000 7f5513200700 1 -- start start 2024-01-22T05:13:24.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.865+0000 7f5513200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f550c065240 0x7f550c169100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.865+0000 7f5513200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550c065620 0x7f550c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.865+0000 7f5513200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550c15b9b0 0x7f550c0a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.865+0000 7f5513200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0aa800 con 0x7f550c065240 2024-01-22T05:13:24.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.865+0000 7f5513200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0a9760 con 0x7f550c15b9b0 2024-01-22T05:13:24.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.865+0000 7f5513200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0a9a40 con 0x7f550c065620 2024-01-22T05:13:24.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f550be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f550c065240 0x7f550c169100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f550be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f550c065240 0x7f550c169100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33034/0 (socket says 172.21.15.49:33034) 2024-01-22T05:13:24.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f550be00700 1 -- 172.21.15.49:0/2155129696 learned_addr learned my addr 172.21.15.49:0/2155129696 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:24.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f550b400700 1 --2- 172.21.15.49:0/2155129696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550c065620 0x7f550c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f5511c00700 1 --2- 172.21.15.49:0/2155129696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550c15b9b0 0x7f550c0a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f550be00700 1 -- 172.21.15.49:0/2155129696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550c065620 msgr2=0x7f550c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f550be00700 1 --2- 172.21.15.49:0/2155129696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550c065620 0x7f550c14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f550be00700 1 -- 172.21.15.49:0/2155129696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550c15b9b0 msgr2=0x7f550c0a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:24.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f550be00700 1 --2- 172.21.15.49:0/2155129696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550c15b9b0 0x7f550c0a8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:24.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f550be00700 1 -- 172.21.15.49:0/2155129696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc009370 con 0x7f550c065240 2024-01-22T05:13:24.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f550be00700 1 --2- 172.21.15.49:0/2155129696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f550c065240 0x7f550c169100 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f54fc009130 tx=0x7f54fc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:24.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f5503400700 1 -- 172.21.15.49:0/2155129696 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00bea0 con 0x7f550c065240 2024-01-22T05:13:24.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f5503400700 1 -- 172.21.15.49:0/2155129696 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc00b8d0 con 0x7f550c065240 2024-01-22T05:13:24.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f5513200700 1 -- 172.21.15.49:0/2155129696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550c0a9d20 con 0x7f550c065240 2024-01-22T05:13:24.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f5503400700 1 -- 172.21.15.49:0/2155129696 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc01c650 con 0x7f550c065240 2024-01-22T05:13:24.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.869+0000 7f5513200700 1 -- 172.21.15.49:0/2155129696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550c0aa2e0 con 0x7f550c065240 2024-01-22T05:13:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.873+0000 7f5513200700 1 -- 172.21.15.49:0/2155129696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550c047060 con 0x7f550c065240 2024-01-22T05:13:24.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.873+0000 7f5503400700 1 -- 172.21.15.49:0/2155129696 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f54fc01c9c0 con 0x7f550c065240 2024-01-22T05:13:24.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.873+0000 7f5503400700 1 --2- 172.21.15.49:0/2155129696 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54e405a510 0x7f54e405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:24.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.873+0000 7f5503400700 1 -- 172.21.15.49:0/2155129696 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f54fc076570 con 0x7f550c065240 2024-01-22T05:13:24.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.877+0000 7f550b400700 1 --2- 172.21.15.49:0/2155129696 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54e405a510 0x7f54e405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:24.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.877+0000 7f550b400700 1 --2- 172.21.15.49:0/2155129696 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54e405a510 0x7f54e405c9d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f550c14d720 tx=0x7f54f4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:24.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:24.881+0000 7f5503400700 1 -- 172.21.15.49:0/2155129696 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f54fc049b30 con 0x7f550c065240 2024-01-22T05:13:25.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.081+0000 7f5513200700 1 -- 172.21.15.49:0/2155129696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f550c0c2f60 con 0x7f550c065240 2024-01-22T05:13:25.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.081+0000 7f5503400700 1 -- 172.21.15.49:0/2155129696 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f54fc020090 con 0x7f550c065240 2024-01-22T05:13:25.083 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:25.083 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2953480069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2953480069},{"type":"v1","addr":"172.21.15.110:6833","nonce":2953480069}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2000522159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2000522159},{"type":"v1","addr":"172.21.15.110:6835","nonce":2000522159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/578632238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":578632238},{"type":"v1","addr":"172.21.15.49:6836","nonce":578632238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:12:25.842913+0000","modified":"2024-01-22T05:12:28.864832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7287":{"gid":7287,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/1226995696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1226995696},{"type":"v1","addr":"172.21.15.49:6837","nonce":1226995696}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-22T05:13:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.085+0000 7f5513200700 1 -- 172.21.15.49:0/2155129696 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54e405a510 msgr2=0x7f54e405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.085+0000 7f5513200700 1 --2- 172.21.15.49:0/2155129696 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54e405a510 0x7f54e405c9d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f550c14d720 tx=0x7f54f4008040).stop 2024-01-22T05:13:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.085+0000 7f5513200700 1 -- 172.21.15.49:0/2155129696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f550c065240 msgr2=0x7f550c169100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.085+0000 7f5513200700 1 --2- 172.21.15.49:0/2155129696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f550c065240 0x7f550c169100 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f54fc009130 tx=0x7f54fc017000).stop 2024-01-22T05:13:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.085+0000 7f5513200700 1 -- 172.21.15.49:0/2155129696 shutdown_connections 2024-01-22T05:13:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.085+0000 7f5513200700 1 --2- 172.21.15.49:0/2155129696 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54e405a510 0x7f54e405c9d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.085+0000 7f5513200700 1 --2- 172.21.15.49:0/2155129696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550c15b9b0 0x7f550c0a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.085+0000 7f5513200700 1 --2- 172.21.15.49:0/2155129696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550c065620 0x7f550c14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.085+0000 7f5513200700 1 --2- 172.21.15.49:0/2155129696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f550c065240 0x7f550c169100 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.085+0000 7f5513200700 1 -- 172.21.15.49:0/2155129696 >> 172.21.15.49:0/2155129696 conn(0x7f550c0c87f0 msgr2=0x7f550c156760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:25.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.085+0000 7f5513200700 1 -- 172.21.15.49:0/2155129696 shutdown_connections 2024-01-22T05:13:25.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.085+0000 7f5513200700 1 -- 172.21.15.49:0/2155129696 wait complete. 2024-01-22T05:13:25.091 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 90 2024-01-22T05:13:25.108 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:13:25.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.273+0000 7f97bb800700 1 Processor -- start 2024-01-22T05:13:25.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.273+0000 7f97bb800700 1 -- start start 2024-01-22T05:13:25.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97bb800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f97b4063150 0x7f97b4065530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:25.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97bb800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97b40635b0 0x7f97b4065a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:25.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97bb800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b415bbe0 con 0x7f97b40a81d0 2024-01-22T05:13:25.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97bb800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b4065f10 con 0x7f97b4063150 2024-01-22T05:13:25.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97bb800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b4062940 con 0x7f97b40635b0 2024-01-22T05:13:25.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97b8e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f97b40a81d0 0x7f97b4062230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59792/0 (socket says 172.21.15.49:59792) 2024-01-22T05:13:25.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97b8e00700 1 -- 172.21.15.49:0/1354633024 learned_addr learned my addr 172.21.15.49:0/1354633024 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:25.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97b3e00700 1 --2- 172.21.15.49:0/1354633024 >> v2:172.21.15.110:3300/0 conn(0x7f97b4063150 0x7f97b4065530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:25.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97ba200700 1 --2- 172.21.15.49:0/1354633024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97b40635b0 0x7f97b4065a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:25.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97b3e00700 1 -- 172.21.15.49:0/1354633024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97b40635b0 msgr2=0x7f97b4065a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:25.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97b3e00700 1 --2- 172.21.15.49:0/1354633024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97b40635b0 0x7f97b4065a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97b3400700 1 -- 172.21.15.49:0/1354633024 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744500152 0 0) 0x7f97b415bbe0 con 0x7f97b40a81d0 2024-01-22T05:13:25.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97b3e00700 1 -- 172.21.15.49:0/1354633024 >> v1:172.21.15.49:6789/0 conn(0x7f97b40a81d0 legacy=0x7f97b4062230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:25.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97b3e00700 1 -- 172.21.15.49:0/1354633024 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b4158bb0 con 0x7f97b4063150 2024-01-22T05:13:25.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97b3e00700 1 --2- 172.21.15.49:0/1354633024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b4063150 0x7f97b4065530 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f979c009790 tx=0x7f979c009060).ready entity=mon.1 client_cookie=2215fdb01b2d0b23 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:25.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.277+0000 7f97b3400700 1 -- 172.21.15.49:0/1354633024 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c00f510 con 0x7f97b4063150 2024-01-22T05:13:25.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.281+0000 7f97b3400700 1 -- 172.21.15.49:0/1354633024 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c00f670 con 0x7f97b4063150 2024-01-22T05:13:25.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.281+0000 7f97b3400700 1 -- 172.21.15.49:0/1354633024 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c00f9f0 con 0x7f97b4063150 2024-01-22T05:13:25.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.281+0000 7f97bb800700 1 -- 172.21.15.49:0/1354633024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b4063150 msgr2=0x7f97b4065530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:25.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.281+0000 7f97bb800700 1 --2- 172.21.15.49:0/1354633024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b4063150 0x7f97b4065530 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f979c009790 tx=0x7f979c009060).stop 2024-01-22T05:13:25.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.281+0000 7f97bb800700 1 -- 172.21.15.49:0/1354633024 shutdown_connections 2024-01-22T05:13:25.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.281+0000 7f97bb800700 1 --2- 172.21.15.49:0/1354633024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97b40635b0 0x7f97b4065a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.281+0000 7f97bb800700 1 --2- 172.21.15.49:0/1354633024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b4063150 0x7f97b4065530 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.281+0000 7f97bb800700 1 -- 172.21.15.49:0/1354633024 >> 172.21.15.49:0/1354633024 conn(0x7f97b4064080 msgr2=0x7f97b4064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:25.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.281+0000 7f97bb800700 1 -- 172.21.15.49:0/1354633024 shutdown_connections 2024-01-22T05:13:25.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.281+0000 7f97bb800700 1 -- 172.21.15.49:0/1354633024 wait complete. 2024-01-22T05:13:25.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.285+0000 7f97bb800700 1 Processor -- start 2024-01-22T05:13:25.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.285+0000 7f97bb800700 1 -- start start 2024-01-22T05:13:25.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97bb800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97b4063150 0x7f97b40ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:25.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97bb800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97b40635b0 0x7f97b4152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:25.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97bb800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b40a81d0 0x7f97b41510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:25.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97bb800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40aec70 con 0x7f97b4063150 2024-01-22T05:13:25.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97bb800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b4154010 con 0x7f97b40a81d0 2024-01-22T05:13:25.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97bb800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b41531a0 con 0x7f97b40635b0 2024-01-22T05:13:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97b8e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97b4063150 0x7f97b40ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97b8e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97b4063150 0x7f97b40ae780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33050/0 (socket says 172.21.15.49:33050) 2024-01-22T05:13:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97b8e00700 1 -- 172.21.15.49:0/523757605 learned_addr learned my addr 172.21.15.49:0/523757605 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97b3e00700 1 --2- 172.21.15.49:0/523757605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97b40635b0 0x7f97b4152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97ba200700 1 --2- 172.21.15.49:0/523757605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b40a81d0 0x7f97b41510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97b8e00700 1 -- 172.21.15.49:0/523757605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97b40635b0 msgr2=0x7f97b4152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97b8e00700 1 --2- 172.21.15.49:0/523757605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97b40635b0 0x7f97b4152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97b8e00700 1 -- 172.21.15.49:0/523757605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b40a81d0 msgr2=0x7f97b41510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97b8e00700 1 --2- 172.21.15.49:0/523757605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b40a81d0 0x7f97b41510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97b8e00700 1 -- 172.21.15.49:0/523757605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c0092a0 con 0x7f97b4063150 2024-01-22T05:13:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97b8e00700 1 --2- 172.21.15.49:0/523757605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97b4063150 0x7f97b40ae780 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f97a4001eb0 tx=0x7f97a4007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97abe00700 1 -- 172.21.15.49:0/523757605 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a40070d0 con 0x7f97b4063150 2024-01-22T05:13:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97abe00700 1 -- 172.21.15.49:0/523757605 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a4007230 con 0x7f97b4063150 2024-01-22T05:13:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97bb800700 1 -- 172.21.15.49:0/523757605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b4153400 con 0x7f97b4063150 2024-01-22T05:13:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97abe00700 1 -- 172.21.15.49:0/523757605 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a40075d0 con 0x7f97b4063150 2024-01-22T05:13:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.289+0000 7f97bb800700 1 -- 172.21.15.49:0/523757605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b4153ca0 con 0x7f97b4063150 2024-01-22T05:13:25.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.293+0000 7f97bb800700 1 -- 172.21.15.49:0/523757605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b41537f0 con 0x7f97b4063150 2024-01-22T05:13:25.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.293+0000 7f97abe00700 1 -- 172.21.15.49:0/523757605 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f97a4005bc0 con 0x7f97b4063150 2024-01-22T05:13:25.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.297+0000 7f97abe00700 1 --2- 172.21.15.49:0/523757605 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f978c05a510 0x7f978c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:25.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.297+0000 7f97abe00700 1 -- 172.21.15.49:0/523757605 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f97a4074360 con 0x7f97b4063150 2024-01-22T05:13:25.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.297+0000 7f97b3e00700 1 --2- 172.21.15.49:0/523757605 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f978c05a510 0x7f978c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:25.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.297+0000 7f97b3e00700 1 --2- 172.21.15.49:0/523757605 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f978c05a510 0x7f978c05c9d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f979c0096e0 tx=0x7f979c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.301+0000 7f97abe00700 1 -- 172.21.15.49:0/523757605 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f97a4047920 con 0x7f97b4063150 2024-01-22T05:13:25.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.481+0000 7f97bb800700 1 -- 172.21.15.49:0/523757605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97b4047060 con 0x7f97b4063150 2024-01-22T05:13:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.481+0000 7f97abe00700 1 -- 172.21.15.49:0/523757605 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+17371 (secure 0 0 0) 0x7f97a4018070 con 0x7f97b4063150 2024-01-22T05:13:25.481 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:25.481 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":105,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:13:25.391939+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:12:23.950155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-01-22T05:12:24.858181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1","mappings":[{"from":1,"to":5}]},{"pgid":"14.10","mappings":[{"from":1,"to":2}]},{"pgid":"14.2a","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:13:25.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.485+0000 7f97bb800700 1 -- 172.21.15.49:0/523757605 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f978c05a510 msgr2=0x7f978c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:25.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.485+0000 7f97bb800700 1 --2- 172.21.15.49:0/523757605 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f978c05a510 0x7f978c05c9d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f979c0096e0 tx=0x7f979c017000).stop 2024-01-22T05:13:25.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.485+0000 7f97bb800700 1 -- 172.21.15.49:0/523757605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97b4063150 msgr2=0x7f97b40ae780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:25.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.485+0000 7f97bb800700 1 --2- 172.21.15.49:0/523757605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97b4063150 0x7f97b40ae780 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f97a4001eb0 tx=0x7f97a4007e90).stop 2024-01-22T05:13:25.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.485+0000 7f97bb800700 1 -- 172.21.15.49:0/523757605 shutdown_connections 2024-01-22T05:13:25.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.485+0000 7f97bb800700 1 --2- 172.21.15.49:0/523757605 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f978c05a510 0x7f978c05c9d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.485+0000 7f97bb800700 1 --2- 172.21.15.49:0/523757605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b40a81d0 0x7f97b41510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.485+0000 7f97bb800700 1 --2- 172.21.15.49:0/523757605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97b40635b0 0x7f97b4152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.485+0000 7f97bb800700 1 --2- 172.21.15.49:0/523757605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97b4063150 0x7f97b40ae780 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.485+0000 7f97bb800700 1 -- 172.21.15.49:0/523757605 >> 172.21.15.49:0/523757605 conn(0x7f97b4064080 msgr2=0x7f97b4156b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:25.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.485+0000 7f97bb800700 1 -- 172.21.15.49:0/523757605 shutdown_connections 2024-01-22T05:13:25.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.485+0000 7f97bb800700 1 -- 172.21.15.49:0/523757605 wait complete. 2024-01-22T05:13:25.527 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:13:25.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.681+0000 7f6eb9600700 1 Processor -- start 2024-01-22T05:13:25.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.681+0000 7f6eb9600700 1 -- start start 2024-01-22T05:13:25.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb9600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb4155d20 0x7f6eb4065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:25.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb9600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6eb40a8e50 0x7f6eb40c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:25.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb9600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb40c1a40 con 0x7f6eb4066070 2024-01-22T05:13:25.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb9600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb4159310 con 0x7f6eb40a8e50 2024-01-22T05:13:25.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb9600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40c13f0 con 0x7f6eb4155d20 2024-01-22T05:13:25.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6eb40a8e50 0x7f6eb40c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:25.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb2000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6eb4066070 0x7f6eb40a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59806/0 (socket says 172.21.15.49:59806) 2024-01-22T05:13:25.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb2000700 1 -- 172.21.15.49:0/4831754 learned_addr learned my addr 172.21.15.49:0/4831754 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:25.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb2a00700 1 --2- 172.21.15.49:0/4831754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb4155d20 0x7f6eb4065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:25.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb1600700 1 -- 172.21.15.49:0/4831754 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829200948 0 0) 0x7f6eb40c1a40 con 0x7f6eb4066070 2024-01-22T05:13:25.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb1600700 1 -- 172.21.15.49:0/4831754 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e940033f0 con 0x7f6eb4066070 2024-01-22T05:13:25.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb3400700 1 -- 172.21.15.49:0/4831754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb4155d20 msgr2=0x7f6eb4065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:25.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb3400700 1 --2- 172.21.15.49:0/4831754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb4155d20 0x7f6eb4065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb3400700 1 -- 172.21.15.49:0/4831754 >> v1:172.21.15.49:6789/0 conn(0x7f6eb4066070 legacy=0x7f6eb40a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:25.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb3400700 1 -- 172.21.15.49:0/4831754 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb40c16d0 con 0x7f6eb40a8e50 2024-01-22T05:13:25.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.685+0000 7f6eb3400700 1 --2- 172.21.15.49:0/4831754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eb40a8e50 0x7f6eb40c1ed0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f6eac009e60 tx=0x7f6eac009780).ready entity=mon.0 client_cookie=728bee92b789ed3c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:25.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.689+0000 7f6eb1600700 1 -- 172.21.15.49:0/4831754 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00e070 con 0x7f6eb40a8e50 2024-01-22T05:13:25.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.689+0000 7f6eb1600700 1 -- 172.21.15.49:0/4831754 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac00bab0 con 0x7f6eb40a8e50 2024-01-22T05:13:25.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.689+0000 7f6eb1600700 1 -- 172.21.15.49:0/4831754 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00be30 con 0x7f6eb40a8e50 2024-01-22T05:13:25.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.689+0000 7f6eb9600700 1 -- 172.21.15.49:0/4831754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eb40a8e50 msgr2=0x7f6eb40c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:25.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.689+0000 7f6eb9600700 1 --2- 172.21.15.49:0/4831754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eb40a8e50 0x7f6eb40c1ed0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f6eac009e60 tx=0x7f6eac009780).stop 2024-01-22T05:13:25.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.689+0000 7f6eb9600700 1 -- 172.21.15.49:0/4831754 shutdown_connections 2024-01-22T05:13:25.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.689+0000 7f6eb9600700 1 --2- 172.21.15.49:0/4831754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eb40a8e50 0x7f6eb40c1ed0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.689+0000 7f6eb9600700 1 --2- 172.21.15.49:0/4831754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb4155d20 0x7f6eb4065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.689+0000 7f6eb9600700 1 -- 172.21.15.49:0/4831754 >> 172.21.15.49:0/4831754 conn(0x7f6eb40c6540 msgr2=0x7f6eb40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:25.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.689+0000 7f6eb9600700 1 -- 172.21.15.49:0/4831754 shutdown_connections 2024-01-22T05:13:25.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.689+0000 7f6eb9600700 1 -- 172.21.15.49:0/4831754 wait complete. 2024-01-22T05:13:25.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.693+0000 7f6eb9600700 1 Processor -- start 2024-01-22T05:13:25.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.693+0000 7f6eb9600700 1 -- start start 2024-01-22T05:13:25.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.693+0000 7f6eb9600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb4066070 0x7f6eb4149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:25.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.693+0000 7f6eb9600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eb40a8e50 0x7f6eb40be610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:25.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.693+0000 7f6eb9600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eb4155d20 0x7f6eb40beb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:25.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.693+0000 7f6eb9600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40beff0 con 0x7f6eb4155d20 2024-01-22T05:13:25.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.693+0000 7f6eb9600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40a95b0 con 0x7f6eb40a8e50 2024-01-22T05:13:25.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.693+0000 7f6eb9600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40aa410 con 0x7f6eb4066070 2024-01-22T05:13:25.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eb3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eb4155d20 0x7f6eb40beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:25.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eb3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eb4155d20 0x7f6eb40beb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33076/0 (socket says 172.21.15.49:33076) 2024-01-22T05:13:25.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eb3400700 1 -- 172.21.15.49:0/1082987196 learned_addr learned my addr 172.21.15.49:0/1082987196 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:25.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eb2a00700 1 --2- 172.21.15.49:0/1082987196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb4066070 0x7f6eb4149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:25.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eb2000700 1 --2- 172.21.15.49:0/1082987196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eb40a8e50 0x7f6eb40be610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:25.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eb3400700 1 -- 172.21.15.49:0/1082987196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb4066070 msgr2=0x7f6eb4149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:25.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eb3400700 1 --2- 172.21.15.49:0/1082987196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb4066070 0x7f6eb4149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eb3400700 1 -- 172.21.15.49:0/1082987196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eb40a8e50 msgr2=0x7f6eb40be610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:25.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eb3400700 1 --2- 172.21.15.49:0/1082987196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eb40a8e50 0x7f6eb40be610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:25.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eb3400700 1 -- 172.21.15.49:0/1082987196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac009a20 con 0x7f6eb4155d20 2024-01-22T05:13:25.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eb2000700 1 --2- 172.21.15.49:0/1082987196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eb40a8e50 0x7f6eb40be610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:25.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eb3400700 1 --2- 172.21.15.49:0/1082987196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eb4155d20 0x7f6eb40beb00 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f6eac00b610 tx=0x7f6eac009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eaa000700 1 -- 172.21.15.49:0/1082987196 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac01d630 con 0x7f6eb4155d20 2024-01-22T05:13:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eaa000700 1 -- 172.21.15.49:0/1082987196 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac01d790 con 0x7f6eb4155d20 2024-01-22T05:13:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eb9600700 1 -- 172.21.15.49:0/1082987196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb4147220 con 0x7f6eb4155d20 2024-01-22T05:13:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eaa000700 1 -- 172.21.15.49:0/1082987196 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac01db50 con 0x7f6eb4155d20 2024-01-22T05:13:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eb9600700 1 -- 172.21.15.49:0/1082987196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb40a9ae0 con 0x7f6eb4155d20 2024-01-22T05:13:25.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.697+0000 7f6eb9600700 1 -- 172.21.15.49:0/1082987196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb40c08e0 con 0x7f6eb4155d20 2024-01-22T05:13:25.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.701+0000 7f6eaa000700 1 -- 172.21.15.49:0/1082987196 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6eac003040 con 0x7f6eb4155d20 2024-01-22T05:13:25.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.701+0000 7f6eaa000700 1 --2- 172.21.15.49:0/1082987196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e8c05a510 0x7f6e8c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:25.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.701+0000 7f6eaa000700 1 -- 172.21.15.49:0/1082987196 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f6eac076850 con 0x7f6eb4155d20 2024-01-22T05:13:25.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.701+0000 7f6eb2a00700 1 --2- 172.21.15.49:0/1082987196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e8c05a510 0x7f6e8c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.705+0000 7f6eb2a00700 1 --2- 172.21.15.49:0/1082987196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e8c05a510 0x7f6e8c05c9d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f6ea4009b20 tx=0x7f6ea4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:25.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.709+0000 7f6eaa000700 1 -- 172.21.15.49:0/1082987196 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6eac049e60 con 0x7f6eb4155d20 2024-01-22T05:13:25.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:25.909+0000 7f6eb9600700 1 -- 172.21.15.49:0/1082987196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6eb4047060 con 0x7f6eb4155d20 2024-01-22T05:13:25.929 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-22T05:13:25.929+0000 7f5ab2600700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-22T05:13:25.961 INFO:tasks.ceph.mds.c.smithi049.stderr: -1> 2024-01-22T05:13:25.929+0000 7f5ab2600700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-22T05:13:26.005 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:13:26.406 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:13:26.405+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:13:26.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.421+0000 7f6eaa000700 1 -- 172.21.15.49:0/1082987196 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v91) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6eac04d480 con 0x7f6eb4155d20 2024-01-22T05:13:26.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.425+0000 7f6eb9600700 1 -- 172.21.15.49:0/1082987196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e8c05a510 msgr2=0x7f6e8c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:26.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.425+0000 7f6eb9600700 1 --2- 172.21.15.49:0/1082987196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e8c05a510 0x7f6e8c05c9d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f6ea4009b20 tx=0x7f6ea4008040).stop 2024-01-22T05:13:26.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.425+0000 7f6eb9600700 1 -- 172.21.15.49:0/1082987196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eb4155d20 msgr2=0x7f6eb40beb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:26.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.425+0000 7f6eb9600700 1 --2- 172.21.15.49:0/1082987196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eb4155d20 0x7f6eb40beb00 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f6eac00b610 tx=0x7f6eac009780).stop 2024-01-22T05:13:26.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.425+0000 7f6eb9600700 1 -- 172.21.15.49:0/1082987196 shutdown_connections 2024-01-22T05:13:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.425+0000 7f6eb9600700 1 --2- 172.21.15.49:0/1082987196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e8c05a510 0x7f6e8c05c9d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.425+0000 7f6eb9600700 1 --2- 172.21.15.49:0/1082987196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eb4155d20 0x7f6eb40beb00 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.425+0000 7f6eb9600700 1 --2- 172.21.15.49:0/1082987196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eb40a8e50 0x7f6eb40be610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.425+0000 7f6eb9600700 1 --2- 172.21.15.49:0/1082987196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb4066070 0x7f6eb4149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.425+0000 7f6eb9600700 1 -- 172.21.15.49:0/1082987196 >> 172.21.15.49:0/1082987196 conn(0x7f6eb40c6540 msgr2=0x7f6eb40c3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.425+0000 7f6eb9600700 1 -- 172.21.15.49:0/1082987196 shutdown_connections 2024-01-22T05:13:26.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.425+0000 7f6eb9600700 1 -- 172.21.15.49:0/1082987196 wait complete. 2024-01-22T05:13:26.428 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:13:26.450 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:13:26.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.617+0000 7f3b7ba00700 1 Processor -- start 2024-01-22T05:13:26.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.617+0000 7f3b7ba00700 1 -- start start 2024-01-22T05:13:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b7ba00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b741524f0 0x7f3b74066400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b7ba00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3b7415bad0 0x7f3b7415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b7ba00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b740bd3e0 con 0x7f3b740a8760 2024-01-22T05:13:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b7ba00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b74067c50 con 0x7f3b7415bad0 2024-01-22T05:13:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b7ba00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7415c440 con 0x7f3b741524f0 2024-01-22T05:13:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b79a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3b740a8760 0x7f3b740a8c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59818/0 (socket says 172.21.15.49:59818) 2024-01-22T05:13:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b79a00700 1 -- 172.21.15.49:0/929666548 learned_addr learned my addr 172.21.15.49:0/929666548 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b79000700 1 --2- 172.21.15.49:0/929666548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b741524f0 0x7f3b74066400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b73e00700 1 --2- 172.21.15.49:0/929666548 >> v2:172.21.15.110:3300/0 conn(0x7f3b7415bad0 0x7f3b7415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b73400700 1 -- 172.21.15.49:0/929666548 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006704866 0 0) 0x7f3b740bd3e0 con 0x7f3b740a8760 2024-01-22T05:13:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b73400700 1 -- 172.21.15.49:0/929666548 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b540033f0 con 0x7f3b740a8760 2024-01-22T05:13:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b73400700 1 -- 172.21.15.49:0/929666548 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 53517670 0 0) 0x7f3b540033f0 con 0x7f3b740a8760 2024-01-22T05:13:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b73400700 1 -- 172.21.15.49:0/929666548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b741524f0 msgr2=0x7f3b74066400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b73400700 1 --2- 172.21.15.49:0/929666548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b741524f0 0x7f3b74066400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b73400700 1 -- 172.21.15.49:0/929666548 >> v2:172.21.15.110:3300/0 conn(0x7f3b7415bad0 msgr2=0x7f3b7415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b73400700 1 --2- 172.21.15.49:0/929666548 >> v2:172.21.15.110:3300/0 conn(0x7f3b7415bad0 0x7f3b7415bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b73400700 1 -- 172.21.15.49:0/929666548 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b740bcb40 con 0x7f3b740a8760 2024-01-22T05:13:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.621+0000 7f3b73400700 1 -- 172.21.15.49:0/929666548 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f3b6c0017f0 con 0x7f3b740a8760 2024-01-22T05:13:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b73400700 1 -- 172.21.15.49:0/929666548 >> v1:172.21.15.49:6789/0 conn(0x7f3b740a8760 legacy=0x7f3b740a8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b73400700 1 --2- 172.21.15.49:0/929666548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b741524f0 0x7f3b540038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b73400700 1 --2- 172.21.15.49:0/929666548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b54003e10 0x7f3b54004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b73400700 1 --2- 172.21.15.49:0/929666548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b54004b80 0x7f3b54005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b73400700 1 -- 172.21.15.49:0/929666548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b74067c50 con 0x7f3b54004b80 2024-01-22T05:13:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b73400700 1 -- 172.21.15.49:0/929666548 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7415c440 con 0x7f3b54003e10 2024-01-22T05:13:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b73400700 1 -- 172.21.15.49:0/929666548 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5400b8e0 con 0x7f3b741524f0 2024-01-22T05:13:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b79a00700 1 --2- 172.21.15.49:0/929666548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b54004b80 0x7f3b54005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b79000700 1 --2- 172.21.15.49:0/929666548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b741524f0 0x7f3b540038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b73e00700 1 --2- 172.21.15.49:0/929666548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b54003e10 0x7f3b54004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b79a00700 1 -- 172.21.15.49:0/929666548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b741524f0 msgr2=0x7f3b540038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b79a00700 1 --2- 172.21.15.49:0/929666548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b741524f0 0x7f3b540038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b79a00700 1 -- 172.21.15.49:0/929666548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b54003e10 msgr2=0x7f3b54004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b79a00700 1 --2- 172.21.15.49:0/929666548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b54003e10 0x7f3b54004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:26.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b79a00700 1 -- 172.21.15.49:0/929666548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b540033f0 con 0x7f3b54004b80 2024-01-22T05:13:26.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b79a00700 1 --2- 172.21.15.49:0/929666548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b54004b80 0x7f3b54005000 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f3b6c00c560 tx=0x7f3b6c002210).ready entity=mon.0 client_cookie=6305838a71e951b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:26.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b73400700 1 -- 172.21.15.49:0/929666548 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c007de0 con 0x7f3b54004b80 2024-01-22T05:13:26.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b73400700 1 -- 172.21.15.49:0/929666548 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c00ce50 con 0x7f3b54004b80 2024-01-22T05:13:26.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b73400700 1 -- 172.21.15.49:0/929666548 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c005d50 con 0x7f3b54004b80 2024-01-22T05:13:26.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b7ba00700 1 -- 172.21.15.49:0/929666548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b54004b80 msgr2=0x7f3b54005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:26.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b7ba00700 1 --2- 172.21.15.49:0/929666548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b54004b80 0x7f3b54005000 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f3b6c00c560 tx=0x7f3b6c002210).stop 2024-01-22T05:13:26.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b79a00700 1 -- 172.21.15.49:0/929666548 reap_dead start 2024-01-22T05:13:26.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b7ba00700 1 -- 172.21.15.49:0/929666548 shutdown_connections 2024-01-22T05:13:26.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.625+0000 7f3b7ba00700 1 -- 172.21.15.49:0/929666548 >> 172.21.15.49:0/929666548 conn(0x7f3b740c6560 msgr2=0x7f3b740c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:26.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.629+0000 7f3b7ba00700 1 -- 172.21.15.49:0/929666548 shutdown_connections 2024-01-22T05:13:26.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.629+0000 7f3b7ba00700 1 -- 172.21.15.49:0/929666548 wait complete. 2024-01-22T05:13:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.629+0000 7f3b7ba00700 1 Processor -- start 2024-01-22T05:13:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.629+0000 7f3b7ba00700 1 -- start start 2024-01-22T05:13:26.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b7ba00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b54004b80 0x7f3b740abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:26.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b7ba00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b741538a0 0x7f3b7416bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:26.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b7ba00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b7416c010 0x7f3b740aa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:26.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b7ba00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b740aa1a0 con 0x7f3b54004b80 2024-01-22T05:13:26.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b7ba00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7416c490 con 0x7f3b7416c010 2024-01-22T05:13:26.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b7ba00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b740a95b0 con 0x7f3b741538a0 2024-01-22T05:13:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b79000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b54004b80 0x7f3b740abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b79000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b54004b80 0x7f3b740abeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33112/0 (socket says 172.21.15.49:33112) 2024-01-22T05:13:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b79000700 1 -- 172.21.15.49:0/4250795935 learned_addr learned my addr 172.21.15.49:0/4250795935 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b73e00700 1 --2- 172.21.15.49:0/4250795935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b741538a0 0x7f3b7416bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b79a00700 1 --2- 172.21.15.49:0/4250795935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b7416c010 0x7f3b740aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b79000700 1 -- 172.21.15.49:0/4250795935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b741538a0 msgr2=0x7f3b7416bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b79000700 1 --2- 172.21.15.49:0/4250795935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b741538a0 0x7f3b7416bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b79000700 1 -- 172.21.15.49:0/4250795935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b7416c010 msgr2=0x7f3b740aa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b79000700 1 --2- 172.21.15.49:0/4250795935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b7416c010 0x7f3b740aa630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b79000700 1 -- 172.21.15.49:0/4250795935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b740a9870 con 0x7f3b54004b80 2024-01-22T05:13:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b79000700 1 --2- 172.21.15.49:0/4250795935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b54004b80 0x7f3b740abeb0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f3b640119f0 tx=0x7f3b64009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:26.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b6be00700 1 -- 172.21.15.49:0/4250795935 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64011ee0 con 0x7f3b54004b80 2024-01-22T05:13:26.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b6be00700 1 -- 172.21.15.49:0/4250795935 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6400f8e0 con 0x7f3b54004b80 2024-01-22T05:13:26.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b7ba00700 1 -- 172.21.15.49:0/4250795935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b740a9b50 con 0x7f3b54004b80 2024-01-22T05:13:26.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b6be00700 1 -- 172.21.15.49:0/4250795935 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400fc60 con 0x7f3b54004b80 2024-01-22T05:13:26.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.633+0000 7f3b7ba00700 1 -- 172.21.15.49:0/4250795935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b740ac3a0 con 0x7f3b54004b80 2024-01-22T05:13:26.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.637+0000 7f3b7ba00700 1 -- 172.21.15.49:0/4250795935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b740a9fd0 con 0x7f3b54004b80 2024-01-22T05:13:26.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.637+0000 7f3b6be00700 1 -- 172.21.15.49:0/4250795935 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3b64014650 con 0x7f3b54004b80 2024-01-22T05:13:26.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.637+0000 7f3b6be00700 1 --2- 172.21.15.49:0/4250795935 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b4c05a540 0x7f3b4c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:26.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.637+0000 7f3b6be00700 1 -- 172.21.15.49:0/4250795935 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6676+0+0 (secure 0 0 0) 0x7f3b64075580 con 0x7f3b54004b80 2024-01-22T05:13:26.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.637+0000 7f3b73e00700 1 --2- 172.21.15.49:0/4250795935 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b4c05a540 0x7f3b4c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:26.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.641+0000 7f3b73e00700 1 --2- 172.21.15.49:0/4250795935 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b4c05a540 0x7f3b4c05ca00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f3b5c006f70 tx=0x7f3b5c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:26.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.645+0000 7f3b6be00700 1 -- 172.21.15.49:0/4250795935 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3b64048a70 con 0x7f3b54004b80 2024-01-22T05:13:26.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:26.849+0000 7f3b7ba00700 1 -- 172.21.15.49:0/4250795935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3b74047060 con 0x7f3b54004b80 2024-01-22T05:13:27.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.433+0000 7f3b6be00700 1 -- 172.21.15.49:0/4250795935 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v92) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3b6404c090 con 0x7f3b54004b80 2024-01-22T05:13:27.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.437+0000 7f3b7ba00700 1 -- 172.21.15.49:0/4250795935 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b4c05a540 msgr2=0x7f3b4c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:27.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.437+0000 7f3b7ba00700 1 --2- 172.21.15.49:0/4250795935 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b4c05a540 0x7f3b4c05ca00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f3b5c006f70 tx=0x7f3b5c008040).stop 2024-01-22T05:13:27.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.437+0000 7f3b7ba00700 1 -- 172.21.15.49:0/4250795935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b54004b80 msgr2=0x7f3b740abeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:27.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.437+0000 7f3b7ba00700 1 --2- 172.21.15.49:0/4250795935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b54004b80 0x7f3b740abeb0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f3b640119f0 tx=0x7f3b64009060).stop 2024-01-22T05:13:27.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.437+0000 7f3b7ba00700 1 -- 172.21.15.49:0/4250795935 shutdown_connections 2024-01-22T05:13:27.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.437+0000 7f3b7ba00700 1 --2- 172.21.15.49:0/4250795935 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b4c05a540 0x7f3b4c05ca00 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:27.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.437+0000 7f3b7ba00700 1 --2- 172.21.15.49:0/4250795935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b7416c010 0x7f3b740aa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:27.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.437+0000 7f3b7ba00700 1 --2- 172.21.15.49:0/4250795935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b741538a0 0x7f3b7416bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:27.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.437+0000 7f3b7ba00700 1 --2- 172.21.15.49:0/4250795935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b54004b80 0x7f3b740abeb0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:27.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.437+0000 7f3b7ba00700 1 -- 172.21.15.49:0/4250795935 >> 172.21.15.49:0/4250795935 conn(0x7f3b740c6560 msgr2=0x7f3b740c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:27.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.437+0000 7f3b7ba00700 1 -- 172.21.15.49:0/4250795935 shutdown_connections 2024-01-22T05:13:27.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.437+0000 7f3b7ba00700 1 -- 172.21.15.49:0/4250795935 wait complete. 2024-01-22T05:13:27.459 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:13:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.621+0000 7f25f1600700 1 Processor -- start 2024-01-22T05:13:27.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.621+0000 7f25f1600700 1 -- start start 2024-01-22T05:13:27.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.621+0000 7f25f1600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec066690 0x7f25ec066af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:27.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.621+0000 7f25f1600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f25ec15fbc0 0x7f25ec161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:27.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.621+0000 7f25f1600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ec0a7cb0 con 0x7f25ec0ac3b0 2024-01-22T05:13:27.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.621+0000 7f25f1600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25ec0a8b10 con 0x7f25ec15fbc0 2024-01-22T05:13:27.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.621+0000 7f25f1600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec0a7f00 con 0x7f25ec066690 2024-01-22T05:13:27.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.621+0000 7f25eaa00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f25ec0ac3b0 0x7f25ec159000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59830/0 (socket says 172.21.15.49:59830) 2024-01-22T05:13:27.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.625+0000 7f25eaa00700 1 -- 172.21.15.49:0/2176079338 learned_addr learned my addr 172.21.15.49:0/2176079338 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:27.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.625+0000 7f25ea000700 1 --2- 172.21.15.49:0/2176079338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec066690 0x7f25ec066af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:27.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.625+0000 7f25eb400700 1 --2- 172.21.15.49:0/2176079338 >> v2:172.21.15.110:3300/0 conn(0x7f25ec15fbc0 0x7f25ec161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.625+0000 7f25e9600700 1 -- 172.21.15.49:0/2176079338 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856338645 0 0) 0x7f25ec0a7cb0 con 0x7f25ec0ac3b0 2024-01-22T05:13:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.625+0000 7f25e9600700 1 -- 172.21.15.49:0/2176079338 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25cc0033f0 con 0x7f25ec0ac3b0 2024-01-22T05:13:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.625+0000 7f25ea000700 1 -- 172.21.15.49:0/2176079338 >> v2:172.21.15.110:3300/0 conn(0x7f25ec15fbc0 msgr2=0x7f25ec161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.625+0000 7f25ea000700 1 --2- 172.21.15.49:0/2176079338 >> v2:172.21.15.110:3300/0 conn(0x7f25ec15fbc0 0x7f25ec161fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.625+0000 7f25ea000700 1 -- 172.21.15.49:0/2176079338 >> v1:172.21.15.49:6789/0 conn(0x7f25ec0ac3b0 legacy=0x7f25ec159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.625+0000 7f25ea000700 1 -- 172.21.15.49:0/2176079338 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec0a81e0 con 0x7f25ec066690 2024-01-22T05:13:27.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.625+0000 7f25ea000700 1 --2- 172.21.15.49:0/2176079338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec066690 0x7f25ec066af0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f25d4009760 tx=0x7f25d4009060).ready entity=mon.2 client_cookie=dc3edc92550e2c41 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:27.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.625+0000 7f25e9600700 1 -- 172.21.15.49:0/2176079338 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d400d4a0 con 0x7f25ec066690 2024-01-22T05:13:27.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.625+0000 7f25e9600700 1 -- 172.21.15.49:0/2176079338 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d400d600 con 0x7f25ec066690 2024-01-22T05:13:27.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.625+0000 7f25e9600700 1 -- 172.21.15.49:0/2176079338 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d400d980 con 0x7f25ec066690 2024-01-22T05:13:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.629+0000 7f25f1600700 1 -- 172.21.15.49:0/2176079338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec066690 msgr2=0x7f25ec066af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.629+0000 7f25f1600700 1 --2- 172.21.15.49:0/2176079338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec066690 0x7f25ec066af0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f25d4009760 tx=0x7f25d4009060).stop 2024-01-22T05:13:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.629+0000 7f25f1600700 1 -- 172.21.15.49:0/2176079338 shutdown_connections 2024-01-22T05:13:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.629+0000 7f25f1600700 1 --2- 172.21.15.49:0/2176079338 >> v2:172.21.15.110:3300/0 conn(0x7f25ec15fbc0 0x7f25ec161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.629+0000 7f25f1600700 1 --2- 172.21.15.49:0/2176079338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec066690 0x7f25ec066af0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:27.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.629+0000 7f25f1600700 1 -- 172.21.15.49:0/2176079338 >> 172.21.15.49:0/2176079338 conn(0x7f25ec0c6500 msgr2=0x7f25ec0c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:27.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.629+0000 7f25f1600700 1 -- 172.21.15.49:0/2176079338 shutdown_connections 2024-01-22T05:13:27.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.629+0000 7f25f1600700 1 -- 172.21.15.49:0/2176079338 wait complete. 2024-01-22T05:13:27.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.633+0000 7f25f1600700 1 Processor -- start 2024-01-22T05:13:27.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.633+0000 7f25f1600700 1 -- start start 2024-01-22T05:13:27.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.633+0000 7f25f1600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec066690 0x7f25ec14a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:27.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.633+0000 7f25f1600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ec0ac3b0 0x7f25ec0aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:27.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.633+0000 7f25f1600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25ec15fbc0 0x7f25ec14bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:27.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.633+0000 7f25f1600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec0a95b0 con 0x7f25ec0ac3b0 2024-01-22T05:13:27.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.633+0000 7f25f1600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec0aa410 con 0x7f25ec15fbc0 2024-01-22T05:13:27.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.633+0000 7f25f1600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec0a9800 con 0x7f25ec066690 2024-01-22T05:13:27.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.633+0000 7f25ea000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ec0ac3b0 0x7f25ec0aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:27.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.633+0000 7f25ea000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ec0ac3b0 0x7f25ec0aa8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33114/0 (socket says 172.21.15.49:33114) 2024-01-22T05:13:27.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.633+0000 7f25ea000700 1 -- 172.21.15.49:0/3865973010 learned_addr learned my addr 172.21.15.49:0/3865973010 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:27.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.633+0000 7f25eaa00700 1 --2- 172.21.15.49:0/3865973010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec066690 0x7f25ec14a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:27.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.633+0000 7f25eb400700 1 --2- 172.21.15.49:0/3865973010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25ec15fbc0 0x7f25ec14bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:27.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.637+0000 7f25ea000700 1 -- 172.21.15.49:0/3865973010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec066690 msgr2=0x7f25ec14a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:27.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.637+0000 7f25ea000700 1 --2- 172.21.15.49:0/3865973010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec066690 0x7f25ec14a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:27.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.637+0000 7f25ea000700 1 -- 172.21.15.49:0/3865973010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25ec15fbc0 msgr2=0x7f25ec14bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:27.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.637+0000 7f25ea000700 1 --2- 172.21.15.49:0/3865973010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25ec15fbc0 0x7f25ec14bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:27.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.637+0000 7f25ea000700 1 -- 172.21.15.49:0/3865973010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d40092a0 con 0x7f25ec0ac3b0 2024-01-22T05:13:27.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.637+0000 7f25eaa00700 1 --2- 172.21.15.49:0/3865973010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec066690 0x7f25ec14a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:27.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.637+0000 7f25ea000700 1 --2- 172.21.15.49:0/3865973010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ec0ac3b0 0x7f25ec0aa8a0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f25d4011fb0 tx=0x7f25d4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:27.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.637+0000 7f25e2000700 1 -- 172.21.15.49:0/3865973010 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d400dd30 con 0x7f25ec0ac3b0 2024-01-22T05:13:27.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.637+0000 7f25e2000700 1 -- 172.21.15.49:0/3865973010 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d400de90 con 0x7f25ec0ac3b0 2024-01-22T05:13:27.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.637+0000 7f25f1600700 1 -- 172.21.15.49:0/3865973010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ec0a9ae0 con 0x7f25ec0ac3b0 2024-01-22T05:13:27.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.637+0000 7f25e2000700 1 -- 172.21.15.49:0/3865973010 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d400d980 con 0x7f25ec0ac3b0 2024-01-22T05:13:27.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.637+0000 7f25f1600700 1 -- 172.21.15.49:0/3865973010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ec0aa0a0 con 0x7f25ec0ac3b0 2024-01-22T05:13:27.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.637+0000 7f25f1600700 1 -- 172.21.15.49:0/3865973010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ec0aa5a0 con 0x7f25ec0ac3b0 2024-01-22T05:13:27.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.637+0000 7f25e2000700 1 -- 172.21.15.49:0/3865973010 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f25d401d640 con 0x7f25ec0ac3b0 2024-01-22T05:13:27.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.641+0000 7f25e2000700 1 --2- 172.21.15.49:0/3865973010 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f25c405a510 0x7f25c405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:27.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.641+0000 7f25e2000700 1 -- 172.21.15.49:0/3865973010 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6676+0+0 (secure 0 0 0) 0x7f25d4076010 con 0x7f25ec0ac3b0 2024-01-22T05:13:27.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.641+0000 7f25eaa00700 1 --2- 172.21.15.49:0/3865973010 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f25c405a510 0x7f25c405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:27.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.641+0000 7f25eaa00700 1 --2- 172.21.15.49:0/3865973010 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f25c405a510 0x7f25c405c9d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f25dc005750 tx=0x7f25dc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:27.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.649+0000 7f25e2000700 1 -- 172.21.15.49:0/3865973010 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f25d40495c0 con 0x7f25ec0ac3b0 2024-01-22T05:13:27.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:27.821+0000 7f25f1600700 1 -- 172.21.15.49:0/3865973010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f25ec0c1d20 con 0x7f25ec0ac3b0 2024-01-22T05:13:28.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.437+0000 7f25e2000700 1 -- 172.21.15.49:0/3865973010 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v107) v1 ==== 181+0+0 (secure 0 0 0) 0x7f25d404cbe0 con 0x7f25ec0ac3b0 2024-01-22T05:13:28.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.441+0000 7f25f1600700 1 -- 172.21.15.49:0/3865973010 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f25c405a510 msgr2=0x7f25c405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:28.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.441+0000 7f25f1600700 1 --2- 172.21.15.49:0/3865973010 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f25c405a510 0x7f25c405c9d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f25dc005750 tx=0x7f25dc009040).stop 2024-01-22T05:13:28.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.441+0000 7f25f1600700 1 -- 172.21.15.49:0/3865973010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ec0ac3b0 msgr2=0x7f25ec0aa8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:28.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.441+0000 7f25f1600700 1 --2- 172.21.15.49:0/3865973010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ec0ac3b0 0x7f25ec0aa8a0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f25d4011fb0 tx=0x7f25d4016000).stop 2024-01-22T05:13:28.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.441+0000 7f25f1600700 1 -- 172.21.15.49:0/3865973010 shutdown_connections 2024-01-22T05:13:28.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.441+0000 7f25f1600700 1 --2- 172.21.15.49:0/3865973010 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f25c405a510 0x7f25c405c9d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:28.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.441+0000 7f25f1600700 1 --2- 172.21.15.49:0/3865973010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25ec15fbc0 0x7f25ec14bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:28.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.441+0000 7f25f1600700 1 --2- 172.21.15.49:0/3865973010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25ec0ac3b0 0x7f25ec0aa8a0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:28.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.441+0000 7f25f1600700 1 --2- 172.21.15.49:0/3865973010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec066690 0x7f25ec14a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:28.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.441+0000 7f25f1600700 1 -- 172.21.15.49:0/3865973010 >> 172.21.15.49:0/3865973010 conn(0x7f25ec0c6500 msgr2=0x7f25ec15ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:28.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.441+0000 7f25f1600700 1 -- 172.21.15.49:0/3865973010 shutdown_connections 2024-01-22T05:13:28.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.441+0000 7f25f1600700 1 -- 172.21.15.49:0/3865973010 wait complete. 2024-01-22T05:13:28.446 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:13:28.465 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:13:28.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.645+0000 7fcd8ae00700 1 Processor -- start 2024-01-22T05:13:28.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.645+0000 7fcd8ae00700 1 -- start start 2024-01-22T05:13:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.649+0000 7fcd8ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd840adff0 0x7fcd840ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.649+0000 7fcd8ae00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd84068b30 0x7fcd84068f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.649+0000 7fcd8ae00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd840686a0 con 0x7fcd840669f0 2024-01-22T05:13:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.649+0000 7fcd8ae00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd840ae8e0 con 0x7fcd84068b30 2024-01-22T05:13:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.649+0000 7fcd8ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd84069480 con 0x7fcd840adff0 2024-01-22T05:13:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd88e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd84068b30 0x7fcd84068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd83400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd840adff0 0x7fcd840ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd83e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fcd840669f0 0x7fcd840c5a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:44102/0 (socket says 172.21.15.49:44102) 2024-01-22T05:13:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd83e00700 1 -- 172.21.15.49:0/2182550860 learned_addr learned my addr 172.21.15.49:0/2182550860 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:28.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd88e00700 1 -- 172.21.15.49:0/2182550860 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd840adff0 msgr2=0x7fcd840ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:28.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd88e00700 1 --2- 172.21.15.49:0/2182550860 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd840adff0 0x7fcd840ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:28.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd82a00700 1 -- 172.21.15.49:0/2182550860 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911588712 0 0) 0x7fcd840686a0 con 0x7fcd840669f0 2024-01-22T05:13:28.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd88e00700 1 -- 172.21.15.49:0/2182550860 >> v1:172.21.15.110:6789/0 conn(0x7fcd840669f0 legacy=0x7fcd840c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:28.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd88e00700 1 -- 172.21.15.49:0/2182550860 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd84067a90 con 0x7fcd84068b30 2024-01-22T05:13:28.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd88e00700 1 --2- 172.21.15.49:0/2182550860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd84068b30 0x7fcd84068f90 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fcd7c009e60 tx=0x7fcd7c009780).ready entity=mon.0 client_cookie=e07afeabd3e31878 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd82a00700 1 -- 172.21.15.49:0/2182550860 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c00e070 con 0x7fcd84068b30 2024-01-22T05:13:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd82a00700 1 -- 172.21.15.49:0/2182550860 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c00bb60 con 0x7fcd84068b30 2024-01-22T05:13:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd82a00700 1 -- 172.21.15.49:0/2182550860 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c012410 con 0x7fcd84068b30 2024-01-22T05:13:28.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd8ae00700 1 -- 172.21.15.49:0/2182550860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd84068b30 msgr2=0x7fcd84068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:28.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd8ae00700 1 --2- 172.21.15.49:0/2182550860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd84068b30 0x7fcd84068f90 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fcd7c009e60 tx=0x7fcd7c009780).stop 2024-01-22T05:13:28.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd8ae00700 1 -- 172.21.15.49:0/2182550860 shutdown_connections 2024-01-22T05:13:28.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd8ae00700 1 --2- 172.21.15.49:0/2182550860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd84068b30 0x7fcd84068f90 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:28.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd8ae00700 1 --2- 172.21.15.49:0/2182550860 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd840adff0 0x7fcd840ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.653+0000 7fcd8ae00700 1 -- 172.21.15.49:0/2182550860 >> 172.21.15.49:0/2182550860 conn(0x7fcd84062d00 msgr2=0x7fcd840ca910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.657+0000 7fcd8ae00700 1 -- 172.21.15.49:0/2182550860 shutdown_connections 2024-01-22T05:13:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.657+0000 7fcd8ae00700 1 -- 172.21.15.49:0/2182550860 wait complete. 2024-01-22T05:13:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.661+0000 7fcd8ae00700 1 Processor -- start 2024-01-22T05:13:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.661+0000 7fcd8ae00700 1 -- start start 2024-01-22T05:13:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.661+0000 7fcd8ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd840669f0 0x7fcd84149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.661+0000 7fcd8ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd84068b30 0x7fcd84151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.661+0000 7fcd8ae00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840adff0 0x7fcd841521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.661+0000 7fcd8ae00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd841526a0 con 0x7fcd840adff0 2024-01-22T05:13:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.661+0000 7fcd8ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840c2d00 con 0x7fcd840669f0 2024-01-22T05:13:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.661+0000 7fcd8ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840c2e90 con 0x7fcd84068b30 2024-01-22T05:13:28.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.661+0000 7fcd88e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840adff0 0x7fcd841521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.661+0000 7fcd88e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840adff0 0x7fcd841521b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33134/0 (socket says 172.21.15.49:33134) 2024-01-22T05:13:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.661+0000 7fcd88e00700 1 -- 172.21.15.49:0/2581802659 learned_addr learned my addr 172.21.15.49:0/2581802659 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.661+0000 7fcd83400700 1 --2- 172.21.15.49:0/2581802659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd84068b30 0x7fcd84151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.661+0000 7fcd83e00700 1 --2- 172.21.15.49:0/2581802659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd840669f0 0x7fcd84149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.665+0000 7fcd88e00700 1 -- 172.21.15.49:0/2581802659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd84068b30 msgr2=0x7fcd84151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.665+0000 7fcd88e00700 1 --2- 172.21.15.49:0/2581802659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd84068b30 0x7fcd84151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.665+0000 7fcd88e00700 1 -- 172.21.15.49:0/2581802659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd840669f0 msgr2=0x7fcd84149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.665+0000 7fcd88e00700 1 --2- 172.21.15.49:0/2581802659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd840669f0 0x7fcd84149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.665+0000 7fcd88e00700 1 -- 172.21.15.49:0/2581802659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c009a20 con 0x7fcd840adff0 2024-01-22T05:13:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.665+0000 7fcd83400700 1 --2- 172.21.15.49:0/2581802659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd84068b30 0x7fcd84151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:28.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.665+0000 7fcd88e00700 1 --2- 172.21.15.49:0/2581802659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840adff0 0x7fcd841521b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7fcd7c00b6c0 tx=0x7fcd840649b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.665+0000 7fcd7b400700 1 -- 172.21.15.49:0/2581802659 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c01d630 con 0x7fcd840adff0 2024-01-22T05:13:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.665+0000 7fcd7b400700 1 -- 172.21.15.49:0/2581802659 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c01d790 con 0x7fcd840adff0 2024-01-22T05:13:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.665+0000 7fcd8ae00700 1 -- 172.21.15.49:0/2581802659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd841508d0 con 0x7fcd840adff0 2024-01-22T05:13:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.665+0000 7fcd7b400700 1 -- 172.21.15.49:0/2581802659 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c01db50 con 0x7fcd840adff0 2024-01-22T05:13:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.665+0000 7fcd8ae00700 1 -- 172.21.15.49:0/2581802659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd84150c60 con 0x7fcd840adff0 2024-01-22T05:13:28.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.669+0000 7fcd8ae00700 1 -- 172.21.15.49:0/2581802659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd84047060 con 0x7fcd840adff0 2024-01-22T05:13:28.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.669+0000 7fcd7b400700 1 -- 172.21.15.49:0/2581802659 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcd7c003040 con 0x7fcd840adff0 2024-01-22T05:13:28.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.669+0000 7fcd7b400700 1 --2- 172.21.15.49:0/2581802659 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5c05a510 0x7fcd5c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:28.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.669+0000 7fcd7b400700 1 -- 172.21.15.49:0/2581802659 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6122+0+0 (secure 0 0 0) 0x7fcd7c076760 con 0x7fcd840adff0 2024-01-22T05:13:28.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.669+0000 7fcd83e00700 1 --2- 172.21.15.49:0/2581802659 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5c05a510 0x7fcd5c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:28.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.669+0000 7fcd83e00700 1 --2- 172.21.15.49:0/2581802659 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5c05a510 0x7fcd5c05c9d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fcd740011e0 tx=0x7fcd74007b90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:28.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.677+0000 7fcd7b400700 1 -- 172.21.15.49:0/2581802659 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcd7c049e80 con 0x7fcd840adff0 2024-01-22T05:13:28.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:28.845+0000 7fcd8ae00700 1 -- 172.21.15.49:0/2581802659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcd840c2fd0 con 0x7fcd840adff0 2024-01-22T05:13:29.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.453+0000 7fcd7b400700 1 -- 172.21.15.49:0/2581802659 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v108) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcd7c04d4a0 con 0x7fcd840adff0 2024-01-22T05:13:29.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.461+0000 7fcd8ae00700 1 -- 172.21.15.49:0/2581802659 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5c05a510 msgr2=0x7fcd5c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:29.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.461+0000 7fcd8ae00700 1 --2- 172.21.15.49:0/2581802659 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5c05a510 0x7fcd5c05c9d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fcd740011e0 tx=0x7fcd74007b90).stop 2024-01-22T05:13:29.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.461+0000 7fcd8ae00700 1 -- 172.21.15.49:0/2581802659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840adff0 msgr2=0x7fcd841521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:29.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.461+0000 7fcd8ae00700 1 --2- 172.21.15.49:0/2581802659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840adff0 0x7fcd841521b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7fcd7c00b6c0 tx=0x7fcd840649b0).stop 2024-01-22T05:13:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.461+0000 7fcd8ae00700 1 -- 172.21.15.49:0/2581802659 shutdown_connections 2024-01-22T05:13:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.461+0000 7fcd8ae00700 1 --2- 172.21.15.49:0/2581802659 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5c05a510 0x7fcd5c05c9d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.461+0000 7fcd8ae00700 1 --2- 172.21.15.49:0/2581802659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840adff0 0x7fcd841521b0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.461+0000 7fcd8ae00700 1 --2- 172.21.15.49:0/2581802659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd84068b30 0x7fcd84151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.461+0000 7fcd8ae00700 1 --2- 172.21.15.49:0/2581802659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd840669f0 0x7fcd84149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.461+0000 7fcd8ae00700 1 -- 172.21.15.49:0/2581802659 >> 172.21.15.49:0/2581802659 conn(0x7fcd84062d00 msgr2=0x7fcd840ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:29.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.461+0000 7fcd8ae00700 1 -- 172.21.15.49:0/2581802659 shutdown_connections 2024-01-22T05:13:29.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.461+0000 7fcd8ae00700 1 -- 172.21.15.49:0/2581802659 wait complete. 2024-01-22T05:13:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-01-22T05:13:29.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-22T05:13:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.649+0000 7f5f66400700 1 Processor -- start 2024-01-22T05:13:29.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.649+0000 7f5f66400700 1 -- start start 2024-01-22T05:13:29.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.653+0000 7f5f66400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5f600c1cf0 0x7f5f600c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:29.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.653+0000 7f5f66400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f60064270 0x7f5f6015c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:29.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.653+0000 7f5f66400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f600698e0 con 0x7f5f60063e30 2024-01-22T05:13:29.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.653+0000 7f5f66400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f600c26d0 con 0x7f5f600c1cf0 2024-01-22T05:13:29.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.653+0000 7f5f66400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f600c29b0 con 0x7f5f60064270 2024-01-22T05:13:29.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.653+0000 7f5f5f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5f600c1cf0 0x7f5f600c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:29.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.653+0000 7f5f5ea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5f60063e30 0x7f5f6015bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59846/0 (socket says 172.21.15.49:59846) 2024-01-22T05:13:29.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.653+0000 7f5f5ea00700 1 -- 172.21.15.49:0/936250788 learned_addr learned my addr 172.21.15.49:0/936250788 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:29.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.653+0000 7f5f5fe00700 1 --2- 172.21.15.49:0/936250788 >> v2:172.21.15.110:3300/0 conn(0x7f5f60064270 0x7f5f6015c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:29.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.653+0000 7f5f5f400700 1 -- 172.21.15.49:0/936250788 >> v2:172.21.15.110:3300/0 conn(0x7f5f60064270 msgr2=0x7f5f6015c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:29.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.653+0000 7f5f5f400700 1 --2- 172.21.15.49:0/936250788 >> v2:172.21.15.110:3300/0 conn(0x7f5f60064270 0x7f5f6015c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:29.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.653+0000 7f5f5f400700 1 -- 172.21.15.49:0/936250788 >> v1:172.21.15.49:6789/0 conn(0x7f5f60063e30 legacy=0x7f5f6015bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:29.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.653+0000 7f5f5f400700 1 -- 172.21.15.49:0/936250788 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f600c2c90 con 0x7f5f600c1cf0 2024-01-22T05:13:29.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.653+0000 7f5f5f400700 1 --2- 172.21.15.49:0/936250788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f600c1cf0 0x7f5f600c20d0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f5f600ad820 tx=0x7f5f50009060).ready entity=mon.0 client_cookie=9bf880adbfb0a7d4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:29.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.657+0000 7f5f5e000700 1 -- 172.21.15.49:0/936250788 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5000f510 con 0x7f5f600c1cf0 2024-01-22T05:13:29.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.657+0000 7f5f5e000700 1 -- 172.21.15.49:0/936250788 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5000f670 con 0x7f5f600c1cf0 2024-01-22T05:13:29.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.657+0000 7f5f5e000700 1 -- 172.21.15.49:0/936250788 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5000f9f0 con 0x7f5f600c1cf0 2024-01-22T05:13:29.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.657+0000 7f5f66400700 1 -- 172.21.15.49:0/936250788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f600c1cf0 msgr2=0x7f5f600c20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:29.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.657+0000 7f5f66400700 1 --2- 172.21.15.49:0/936250788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f600c1cf0 0x7f5f600c20d0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f5f600ad820 tx=0x7f5f50009060).stop 2024-01-22T05:13:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.657+0000 7f5f66400700 1 -- 172.21.15.49:0/936250788 shutdown_connections 2024-01-22T05:13:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.657+0000 7f5f66400700 1 --2- 172.21.15.49:0/936250788 >> v2:172.21.15.110:3300/0 conn(0x7f5f60064270 0x7f5f6015c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.657+0000 7f5f66400700 1 --2- 172.21.15.49:0/936250788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f600c1cf0 0x7f5f600c20d0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.657+0000 7f5f66400700 1 -- 172.21.15.49:0/936250788 >> 172.21.15.49:0/936250788 conn(0x7f5f600c40f0 msgr2=0x7f5f600c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:29.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.657+0000 7f5f66400700 1 -- 172.21.15.49:0/936250788 shutdown_connections 2024-01-22T05:13:29.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.657+0000 7f5f66400700 1 -- 172.21.15.49:0/936250788 wait complete. 2024-01-22T05:13:29.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.661+0000 7f5f66400700 1 Processor -- start 2024-01-22T05:13:29.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.661+0000 7f5f66400700 1 -- start start 2024-01-22T05:13:29.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.661+0000 7f5f66400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f60063e30 0x7f5f601575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:29.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f66400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60064270 0x7f5f6015d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:29.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f66400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f600c1cf0 0x7f5f6015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:29.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f66400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f600a9710 con 0x7f5f60063e30 2024-01-22T05:13:29.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f66400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f600abc10 con 0x7f5f60064270 2024-01-22T05:13:29.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f66400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f600ab2e0 con 0x7f5f600c1cf0 2024-01-22T05:13:29.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f5f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f60063e30 0x7f5f601575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:29.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f5f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f60063e30 0x7f5f601575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33150/0 (socket says 172.21.15.49:33150) 2024-01-22T05:13:29.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f5f400700 1 -- 172.21.15.49:0/70558788 learned_addr learned my addr 172.21.15.49:0/70558788 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f5ea00700 1 --2- 172.21.15.49:0/70558788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60064270 0x7f5f6015d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f5fe00700 1 --2- 172.21.15.49:0/70558788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f600c1cf0 0x7f5f6015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f5f400700 1 -- 172.21.15.49:0/70558788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f600c1cf0 msgr2=0x7f5f6015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f5f400700 1 --2- 172.21.15.49:0/70558788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f600c1cf0 0x7f5f6015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f5f400700 1 -- 172.21.15.49:0/70558788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60064270 msgr2=0x7f5f6015d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f5f400700 1 --2- 172.21.15.49:0/70558788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60064270 0x7f5f6015d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f5f400700 1 -- 172.21.15.49:0/70558788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f500092a0 con 0x7f5f60063e30 2024-01-22T05:13:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f5fe00700 1 --2- 172.21.15.49:0/70558788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f600c1cf0 0x7f5f6015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:13:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f5f400700 1 --2- 172.21.15.49:0/70558788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f60063e30 0x7f5f601575d0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f5f50011e50 tx=0x7f5f50017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f56a00700 1 -- 172.21.15.49:0/70558788 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50000d10 con 0x7f5f60063e30 2024-01-22T05:13:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f56a00700 1 -- 172.21.15.49:0/70558788 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5000f9f0 con 0x7f5f60063e30 2024-01-22T05:13:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f66400700 1 -- 172.21.15.49:0/70558788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f600ab5c0 con 0x7f5f60063e30 2024-01-22T05:13:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f56a00700 1 -- 172.21.15.49:0/70558788 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5001b640 con 0x7f5f60063e30 2024-01-22T05:13:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.665+0000 7f5f66400700 1 -- 172.21.15.49:0/70558788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6015dab0 con 0x7f5f60063e30 2024-01-22T05:13:29.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.669+0000 7f5f66400700 1 -- 172.21.15.49:0/70558788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f600656b0 con 0x7f5f60063e30 2024-01-22T05:13:29.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.669+0000 7f5f56a00700 1 -- 172.21.15.49:0/70558788 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5f5001ba30 con 0x7f5f60063e30 2024-01-22T05:13:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.669+0000 7f5f56a00700 1 --2- 172.21.15.49:0/70558788 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f3805a510 0x7f5f3805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.669+0000 7f5f56a00700 1 -- 172.21.15.49:0/70558788 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f5f50075f30 con 0x7f5f60063e30 2024-01-22T05:13:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.669+0000 7f5f5ea00700 1 --2- 172.21.15.49:0/70558788 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f3805a510 0x7f5f3805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:29.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.673+0000 7f5f5ea00700 1 --2- 172.21.15.49:0/70558788 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f3805a510 0x7f5f3805c9d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f5f6015b220 tx=0x7f5f48009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:29.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.677+0000 7f5f56a00700 1 -- 172.21.15.49:0/70558788 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5f500497f0 con 0x7f5f60063e30 2024-01-22T05:13:29.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.901+0000 7f5f66400700 1 -- 172.21.15.49:0/70558788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5f600c2f70 con 0x7f5f60063e30 2024-01-22T05:13:29.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.909+0000 7f5f56a00700 1 -- 172.21.15.49:0/70558788 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5f5004ce10 con 0x7f5f60063e30 2024-01-22T05:13:29.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.913+0000 7f5f66400700 1 -- 172.21.15.49:0/70558788 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f3805a510 msgr2=0x7f5f3805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:29.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.913+0000 7f5f66400700 1 --2- 172.21.15.49:0/70558788 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f3805a510 0x7f5f3805c9d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f5f6015b220 tx=0x7f5f48009040).stop 2024-01-22T05:13:29.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.913+0000 7f5f66400700 1 -- 172.21.15.49:0/70558788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f60063e30 msgr2=0x7f5f601575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:29.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.913+0000 7f5f66400700 1 --2- 172.21.15.49:0/70558788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f60063e30 0x7f5f601575d0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f5f50011e50 tx=0x7f5f50017000).stop 2024-01-22T05:13:29.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.913+0000 7f5f66400700 1 -- 172.21.15.49:0/70558788 shutdown_connections 2024-01-22T05:13:29.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.913+0000 7f5f66400700 1 --2- 172.21.15.49:0/70558788 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f3805a510 0x7f5f3805c9d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:29.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.913+0000 7f5f66400700 1 --2- 172.21.15.49:0/70558788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f600c1cf0 0x7f5f6015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:29.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.913+0000 7f5f66400700 1 --2- 172.21.15.49:0/70558788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60064270 0x7f5f6015d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:29.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.913+0000 7f5f66400700 1 --2- 172.21.15.49:0/70558788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f60063e30 0x7f5f601575d0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:29.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.913+0000 7f5f66400700 1 -- 172.21.15.49:0/70558788 >> 172.21.15.49:0/70558788 conn(0x7f5f600c40f0 msgr2=0x7f5f60068740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.917+0000 7f5f66400700 1 -- 172.21.15.49:0/70558788 shutdown_connections 2024-01-22T05:13:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:29.917+0000 7f5f66400700 1 -- 172.21.15.49:0/70558788 wait complete. 2024-01-22T05:13:29.934 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-01-22T05:13:30.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.093+0000 7f749fe00700 1 Processor -- start 2024-01-22T05:13:30.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.093+0000 7f749fe00700 1 -- start start 2024-01-22T05:13:30.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.097+0000 7f749fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74a0155880 0x7f74a00a8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:30.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.097+0000 7f749fe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f74a00a7260 0x7f74a00659b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:30.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.097+0000 7f749fe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a0068a60 con 0x7f74a0155c60 2024-01-22T05:13:30.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.097+0000 7f749fe00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a0067e50 con 0x7f74a0155880 2024-01-22T05:13:30.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.097+0000 7f749fe00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a0068130 con 0x7f74a00a7260 2024-01-22T05:13:30.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.097+0000 7f749ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74a0155880 0x7f74a00a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:30.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.097+0000 7f749ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f74a0155880 0x7f74a00a8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33166/0 (socket says 172.21.15.49:33166) 2024-01-22T05:13:30.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.097+0000 7f749f400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f74a00a7260 0x7f74a00659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:30.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.097+0000 7f749ea00700 1 -- 172.21.15.49:0/1891149105 learned_addr learned my addr 172.21.15.49:0/1891149105 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:30.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.097+0000 7f749ea00700 1 -- 172.21.15.49:0/1891149105 >> v2:172.21.15.110:3300/0 conn(0x7f74a00a7260 msgr2=0x7f74a00659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:30.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.097+0000 7f749ea00700 1 --2- 172.21.15.49:0/1891149105 >> v2:172.21.15.110:3300/0 conn(0x7f74a00a7260 0x7f74a00659b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.097+0000 7f749ea00700 1 -- 172.21.15.49:0/1891149105 >> v1:172.21.15.110:6789/0 conn(0x7f74a0155c60 legacy=0x7f74a00a6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:30.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.097+0000 7f749d600700 1 -- 172.21.15.49:0/1891149105 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908632114 0 0) 0x7f74a0068a60 con 0x7f74a0155c60 2024-01-22T05:13:30.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.097+0000 7f749ea00700 1 -- 172.21.15.49:0/1891149105 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a0068410 con 0x7f74a0155880 2024-01-22T05:13:30.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.101+0000 7f749ea00700 1 --2- 172.21.15.49:0/1891149105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a0155880 0x7f74a00a8990 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f74a00c2d80 tx=0x7f74900090f0).ready entity=mon.0 client_cookie=3e730f5fee21551b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:30.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.101+0000 7f749d600700 1 -- 172.21.15.49:0/1891149105 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749000b520 con 0x7f74a0155880 2024-01-22T05:13:30.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.101+0000 7f749d600700 1 -- 172.21.15.49:0/1891149105 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749000b680 con 0x7f74a0155880 2024-01-22T05:13:30.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.101+0000 7f749d600700 1 -- 172.21.15.49:0/1891149105 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749000ba00 con 0x7f74a0155880 2024-01-22T05:13:30.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.101+0000 7f749fe00700 1 -- 172.21.15.49:0/1891149105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a0155880 msgr2=0x7f74a00a8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:30.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.101+0000 7f749fe00700 1 --2- 172.21.15.49:0/1891149105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a0155880 0x7f74a00a8990 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f74a00c2d80 tx=0x7f74900090f0).stop 2024-01-22T05:13:30.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.101+0000 7f749fe00700 1 -- 172.21.15.49:0/1891149105 shutdown_connections 2024-01-22T05:13:30.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.101+0000 7f749fe00700 1 --2- 172.21.15.49:0/1891149105 >> v2:172.21.15.110:3300/0 conn(0x7f74a00a7260 0x7f74a00659b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.101+0000 7f749fe00700 1 --2- 172.21.15.49:0/1891149105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a0155880 0x7f74a00a8990 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.101+0000 7f749fe00700 1 -- 172.21.15.49:0/1891149105 >> 172.21.15.49:0/1891149105 conn(0x7f74a00c6530 msgr2=0x7f74a00c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:30.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.101+0000 7f749fe00700 1 -- 172.21.15.49:0/1891149105 shutdown_connections 2024-01-22T05:13:30.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.101+0000 7f749fe00700 1 -- 172.21.15.49:0/1891149105 wait complete. 2024-01-22T05:13:30.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.105+0000 7f749fe00700 1 Processor -- start 2024-01-22T05:13:30.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.105+0000 7f749fe00700 1 -- start start 2024-01-22T05:13:30.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00a7260 0x7f74a00a0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:30.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a0155880 0x7f74a00aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:30.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a0155c60 0x7f74a016c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:30.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749fe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a016cf20 con 0x7f74a00a7260 2024-01-22T05:13:30.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00a1b30 con 0x7f74a0155c60 2024-01-22T05:13:30.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00a0830 con 0x7f74a0155880 2024-01-22T05:13:30.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00a7260 0x7f74a00a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:30.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00a7260 0x7f74a00a0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33172/0 (socket says 172.21.15.49:33172) 2024-01-22T05:13:30.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749ea00700 1 -- 172.21.15.49:0/1005653473 learned_addr learned my addr 172.21.15.49:0/1005653473 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:30.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749e000700 1 --2- 172.21.15.49:0/1005653473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a0155880 0x7f74a00aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:30.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749f400700 1 --2- 172.21.15.49:0/1005653473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a0155c60 0x7f74a016c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:30.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749ea00700 1 -- 172.21.15.49:0/1005653473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a0155880 msgr2=0x7f74a00aaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:30.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749ea00700 1 --2- 172.21.15.49:0/1005653473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a0155880 0x7f74a00aaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749ea00700 1 -- 172.21.15.49:0/1005653473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a0155c60 msgr2=0x7f74a016c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:30.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749ea00700 1 --2- 172.21.15.49:0/1005653473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a0155c60 0x7f74a016c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749ea00700 1 -- 172.21.15.49:0/1005653473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7490009370 con 0x7f74a00a7260 2024-01-22T05:13:30.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749e000700 1 --2- 172.21.15.49:0/1005653473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a0155880 0x7f74a00aaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:13:30.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749ea00700 1 --2- 172.21.15.49:0/1005653473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00a7260 0x7f74a00a0340 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f7490009130 tx=0x7f7490017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:30.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f7496000700 1 -- 172.21.15.49:0/1005653473 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749000be90 con 0x7f74a00a7260 2024-01-22T05:13:30.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f7496000700 1 -- 172.21.15.49:0/1005653473 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749000b7f0 con 0x7f74a00a7260 2024-01-22T05:13:30.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f7496000700 1 -- 172.21.15.49:0/1005653473 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749001c670 con 0x7f74a00a7260 2024-01-22T05:13:30.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749fe00700 1 -- 172.21.15.49:0/1005653473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a0067170 con 0x7f74a00a7260 2024-01-22T05:13:30.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.109+0000 7f749fe00700 1 -- 172.21.15.49:0/1005653473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a00a14e0 con 0x7f74a00a7260 2024-01-22T05:13:30.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.113+0000 7f7496000700 1 -- 172.21.15.49:0/1005653473 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f749001ca20 con 0x7f74a00a7260 2024-01-22T05:13:30.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.113+0000 7f749fe00700 1 -- 172.21.15.49:0/1005653473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a005fd40 con 0x7f74a00a7260 2024-01-22T05:13:30.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.113+0000 7f7496000700 1 --2- 172.21.15.49:0/1005653473 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f747805a510 0x7f747805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:30.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.113+0000 7f7496000700 1 -- 172.21.15.49:0/1005653473 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f7490076200 con 0x7f74a00a7260 2024-01-22T05:13:30.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.113+0000 7f749e000700 1 --2- 172.21.15.49:0/1005653473 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f747805a510 0x7f747805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:30.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.117+0000 7f749e000700 1 --2- 172.21.15.49:0/1005653473 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f747805a510 0x7f747805c9d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f74880011e0 tx=0x7f7488009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:30.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.121+0000 7f7496000700 1 -- 172.21.15.49:0/1005653473 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7490049b80 con 0x7f74a00a7260 2024-01-22T05:13:30.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.341+0000 7f749fe00700 1 -- 172.21.15.49:0/1005653473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) v1 -- 0x7f74a0046800 con 0x7f74a00a7260 2024-01-22T05:13:30.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.461+0000 7f7496000700 1 -- 172.21.15.49:0/1005653473 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v422) v1 ==== 144+0+0 (secure 0 0 0) 0x7f7490020020 con 0x7f74a00a7260 2024-01-22T05:13:30.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.465+0000 7f749fe00700 1 -- 172.21.15.49:0/1005653473 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f747805a510 msgr2=0x7f747805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:30.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.465+0000 7f749fe00700 1 --2- 172.21.15.49:0/1005653473 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f747805a510 0x7f747805c9d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f74880011e0 tx=0x7f7488009040).stop 2024-01-22T05:13:30.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.465+0000 7f749fe00700 1 -- 172.21.15.49:0/1005653473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00a7260 msgr2=0x7f74a00a0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:30.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.465+0000 7f749fe00700 1 --2- 172.21.15.49:0/1005653473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00a7260 0x7f74a00a0340 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f7490009130 tx=0x7f7490017000).stop 2024-01-22T05:13:30.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.465+0000 7f749fe00700 1 -- 172.21.15.49:0/1005653473 shutdown_connections 2024-01-22T05:13:30.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.465+0000 7f749fe00700 1 --2- 172.21.15.49:0/1005653473 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f747805a510 0x7f747805c9d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.465+0000 7f749fe00700 1 --2- 172.21.15.49:0/1005653473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a0155c60 0x7f74a016c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.465+0000 7f749fe00700 1 --2- 172.21.15.49:0/1005653473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a0155880 0x7f74a00aaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.465+0000 7f749fe00700 1 --2- 172.21.15.49:0/1005653473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00a7260 0x7f74a00a0340 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.465+0000 7f749fe00700 1 -- 172.21.15.49:0/1005653473 >> 172.21.15.49:0/1005653473 conn(0x7f74a00c6530 msgr2=0x7f74a0156e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:30.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.465+0000 7f749fe00700 1 -- 172.21.15.49:0/1005653473 shutdown_connections 2024-01-22T05:13:30.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.465+0000 7f749fe00700 1 -- 172.21.15.49:0/1005653473 wait complete. 2024-01-22T05:13:30.493 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-01-22T05:13:30.493 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-01-22T05:13:30.493 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-01-22T05:13:30.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.665+0000 7f8863200700 1 Processor -- start 2024-01-22T05:13:30.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.665+0000 7f8863200700 1 -- start start 2024-01-22T05:13:30.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f8863200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f885c065660 0x7f885c0a6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:30.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f8863200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f885c0644f0 0x7f885c064950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f8863200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f885c1575b0 0x7f885c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f8863200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885c0c2700 con 0x7f885c065660 2024-01-22T05:13:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f8863200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885c064e40 con 0x7f885c1575b0 2024-01-22T05:13:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f8863200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0c2930 con 0x7f885c0644f0 2024-01-22T05:13:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f885be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f885c065660 0x7f885c0a6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:30.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f885be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f885c065660 0x7f885c0a6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33186/0 (socket says 172.21.15.49:33186) 2024-01-22T05:13:30.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f885be00700 1 -- 172.21.15.49:0/3314610285 learned_addr learned my addr 172.21.15.49:0/3314610285 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:30.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f885b400700 1 --2- 172.21.15.49:0/3314610285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f885c0644f0 0x7f885c064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:30.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f8861c00700 1 --2- 172.21.15.49:0/3314610285 >> v2:172.21.15.110:3300/0 conn(0x7f885c1575b0 0x7f885c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:30.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f885b400700 1 -- 172.21.15.49:0/3314610285 >> v2:172.21.15.110:3300/0 conn(0x7f885c1575b0 msgr2=0x7f885c157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:30.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f885b400700 1 --2- 172.21.15.49:0/3314610285 >> v2:172.21.15.110:3300/0 conn(0x7f885c1575b0 0x7f885c157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f885b400700 1 -- 172.21.15.49:0/3314610285 >> v2:172.21.15.49:3300/0 conn(0x7f885c065660 msgr2=0x7f885c0a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:30.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f885b400700 1 --2- 172.21.15.49:0/3314610285 >> v2:172.21.15.49:3300/0 conn(0x7f885c065660 0x7f885c0a6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f885b400700 1 -- 172.21.15.49:0/3314610285 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c0c2c10 con 0x7f885c0644f0 2024-01-22T05:13:30.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f885b400700 1 --2- 172.21.15.49:0/3314610285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f885c0644f0 0x7f885c064950 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f8844009760 tx=0x7f8844009060).ready entity=mon.2 client_cookie=4da2e785cd91d4f8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:30.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f885aa00700 1 -- 172.21.15.49:0/3314610285 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88440090d0 con 0x7f885c0644f0 2024-01-22T05:13:30.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f885aa00700 1 -- 172.21.15.49:0/3314610285 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884400f510 con 0x7f885c0644f0 2024-01-22T05:13:30.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.669+0000 7f885aa00700 1 -- 172.21.15.49:0/3314610285 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884400f890 con 0x7f885c0644f0 2024-01-22T05:13:30.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.673+0000 7f8863200700 1 -- 172.21.15.49:0/3314610285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f885c0644f0 msgr2=0x7f885c064950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:30.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.673+0000 7f8863200700 1 --2- 172.21.15.49:0/3314610285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f885c0644f0 0x7f885c064950 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f8844009760 tx=0x7f8844009060).stop 2024-01-22T05:13:30.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.673+0000 7f8863200700 1 -- 172.21.15.49:0/3314610285 shutdown_connections 2024-01-22T05:13:30.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.673+0000 7f8863200700 1 --2- 172.21.15.49:0/3314610285 >> v2:172.21.15.110:3300/0 conn(0x7f885c1575b0 0x7f885c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.673+0000 7f8863200700 1 --2- 172.21.15.49:0/3314610285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f885c0644f0 0x7f885c064950 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.673+0000 7f8863200700 1 --2- 172.21.15.49:0/3314610285 >> v2:172.21.15.49:3300/0 conn(0x7f885c065660 0x7f885c0a6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.673+0000 7f8863200700 1 -- 172.21.15.49:0/3314610285 >> 172.21.15.49:0/3314610285 conn(0x7f885c0c87f0 msgr2=0x7f885c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.673+0000 7f8863200700 1 -- 172.21.15.49:0/3314610285 shutdown_connections 2024-01-22T05:13:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.673+0000 7f8863200700 1 -- 172.21.15.49:0/3314610285 wait complete. 2024-01-22T05:13:30.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.677+0000 7f8863200700 1 Processor -- start 2024-01-22T05:13:30.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.677+0000 7f8863200700 1 -- start start 2024-01-22T05:13:30.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.677+0000 7f8863200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f885c0644f0 0x7f885c1432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:30.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.677+0000 7f8863200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f885c065660 0x7f885c0acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:30.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.677+0000 7f8863200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f885c1575b0 0x7f885c0ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:30.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.677+0000 7f8863200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0a92e0 con 0x7f885c065660 2024-01-22T05:13:30.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.677+0000 7f8863200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0bedc0 con 0x7f885c0644f0 2024-01-22T05:13:30.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.677+0000 7f8863200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0a86d0 con 0x7f885c1575b0 2024-01-22T05:13:30.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.677+0000 7f885b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f885c065660 0x7f885c0acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:30.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.677+0000 7f885b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f885c065660 0x7f885c0acdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33200/0 (socket says 172.21.15.49:33200) 2024-01-22T05:13:30.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.677+0000 7f885b400700 1 -- 172.21.15.49:0/30743557 learned_addr learned my addr 172.21.15.49:0/30743557 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:30.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.677+0000 7f8861c00700 1 --2- 172.21.15.49:0/30743557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f885c1575b0 0x7f885c0ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:30.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.677+0000 7f885be00700 1 --2- 172.21.15.49:0/30743557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f885c0644f0 0x7f885c1432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:30.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.681+0000 7f885b400700 1 -- 172.21.15.49:0/30743557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f885c1575b0 msgr2=0x7f885c0ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:30.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.681+0000 7f885b400700 1 --2- 172.21.15.49:0/30743557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f885c1575b0 0x7f885c0ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.681+0000 7f885b400700 1 -- 172.21.15.49:0/30743557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f885c0644f0 msgr2=0x7f885c1432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:30.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.681+0000 7f885b400700 1 --2- 172.21.15.49:0/30743557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f885c0644f0 0x7f885c1432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:30.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.681+0000 7f885b400700 1 -- 172.21.15.49:0/30743557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88440092a0 con 0x7f885c065660 2024-01-22T05:13:30.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.681+0000 7f8861c00700 1 --2- 172.21.15.49:0/30743557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f885c1575b0 0x7f885c0ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:30.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.681+0000 7f885b400700 1 --2- 172.21.15.49:0/30743557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f885c065660 0x7f885c0acdd0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f8844009e00 tx=0x7f8844017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:30.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.681+0000 7f8853400700 1 -- 172.21.15.49:0/30743557 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884400fea0 con 0x7f885c065660 2024-01-22T05:13:30.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.681+0000 7f8853400700 1 -- 172.21.15.49:0/30743557 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884400f680 con 0x7f885c065660 2024-01-22T05:13:30.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.681+0000 7f8853400700 1 -- 172.21.15.49:0/30743557 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884401b410 con 0x7f885c065660 2024-01-22T05:13:30.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.681+0000 7f8863200700 1 -- 172.21.15.49:0/30743557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c0a89b0 con 0x7f885c065660 2024-01-22T05:13:30.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.681+0000 7f8863200700 1 -- 172.21.15.49:0/30743557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885c0a8f70 con 0x7f885c065660 2024-01-22T05:13:30.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.681+0000 7f8863200700 1 -- 172.21.15.49:0/30743557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885c0a9490 con 0x7f885c065660 2024-01-22T05:13:30.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.685+0000 7f8853400700 1 -- 172.21.15.49:0/30743557 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f884401b7c0 con 0x7f885c065660 2024-01-22T05:13:30.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.685+0000 7f8853400700 1 --2- 172.21.15.49:0/30743557 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f883405a510 0x7f883405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:30.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.685+0000 7f8853400700 1 -- 172.21.15.49:0/30743557 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f8844075f60 con 0x7f885c065660 2024-01-22T05:13:30.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.685+0000 7f885be00700 1 --2- 172.21.15.49:0/30743557 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f883405a510 0x7f883405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:30.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.685+0000 7f885be00700 1 --2- 172.21.15.49:0/30743557 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f883405a510 0x7f883405c9d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f884c006bc0 tx=0x7f884c0090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:30.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.693+0000 7f8853400700 1 -- 172.21.15.49:0/30743557 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f885c0a9490 con 0x7f885c065660 2024-01-22T05:13:30.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:30.933+0000 7f8863200700 1 -- 172.21.15.49:0/30743557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) v1 -- 0x7f885c047060 con 0x7f885c065660 2024-01-22T05:13:31.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.460+0000 7f8853400700 1 -- 172.21.15.49:0/30743557 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v423) v1 ==== 158+0+0 (secure 0 0 0) 0x7f8844029070 con 0x7f885c065660 2024-01-22T05:13:31.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.468+0000 7f8863200700 1 -- 172.21.15.49:0/30743557 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f883405a510 msgr2=0x7f883405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:31.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.468+0000 7f8863200700 1 --2- 172.21.15.49:0/30743557 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f883405a510 0x7f883405c9d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f884c006bc0 tx=0x7f884c0090f0).stop 2024-01-22T05:13:31.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.468+0000 7f8863200700 1 -- 172.21.15.49:0/30743557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f885c065660 msgr2=0x7f885c0acdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:31.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.468+0000 7f8863200700 1 --2- 172.21.15.49:0/30743557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f885c065660 0x7f885c0acdd0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f8844009e00 tx=0x7f8844017000).stop 2024-01-22T05:13:31.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.468+0000 7f8863200700 1 -- 172.21.15.49:0/30743557 shutdown_connections 2024-01-22T05:13:31.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.468+0000 7f8863200700 1 --2- 172.21.15.49:0/30743557 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f883405a510 0x7f883405c9d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:31.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.468+0000 7f8863200700 1 --2- 172.21.15.49:0/30743557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f885c1575b0 0x7f885c0ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:31.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.468+0000 7f8863200700 1 --2- 172.21.15.49:0/30743557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f885c065660 0x7f885c0acdd0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:31.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.468+0000 7f8863200700 1 --2- 172.21.15.49:0/30743557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f885c0644f0 0x7f885c1432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:31.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.468+0000 7f8863200700 1 -- 172.21.15.49:0/30743557 >> 172.21.15.49:0/30743557 conn(0x7f885c0c87f0 msgr2=0x7f885c155d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:31.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.468+0000 7f8863200700 1 -- 172.21.15.49:0/30743557 shutdown_connections 2024-01-22T05:13:31.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.468+0000 7f8863200700 1 -- 172.21.15.49:0/30743557 wait complete. 2024-01-22T05:13:31.493 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-22T05:13:31.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.664+0000 7fa973400700 1 Processor -- start 2024-01-22T05:13:31.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.664+0000 7fa973400700 1 -- start start 2024-01-22T05:13:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.668+0000 7fa973400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa96c15c2d0 0x7fa96c065900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.668+0000 7fa973400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa96c065df0 0x7fa96c066260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.668+0000 7fa973400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96c069600 con 0x7fa96c067a90 2024-01-22T05:13:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.668+0000 7fa973400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96c1561a0 con 0x7fa96c065df0 2024-01-22T05:13:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.668+0000 7fa973400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c068dd0 con 0x7fa96c15c2d0 2024-01-22T05:13:31.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.668+0000 7fa972000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa96c067a90 0x7fa96c15bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59854/0 (socket says 172.21.15.49:59854) 2024-01-22T05:13:31.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.668+0000 7fa972000700 1 -- 172.21.15.49:0/311997210 learned_addr learned my addr 172.21.15.49:0/311997210 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:31.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.668+0000 7fa971600700 1 --2- 172.21.15.49:0/311997210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa96c15c2d0 0x7fa96c065900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:31.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.668+0000 7fa972a00700 1 --2- 172.21.15.49:0/311997210 >> v2:172.21.15.110:3300/0 conn(0x7fa96c065df0 0x7fa96c066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:31.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.668+0000 7fa970c00700 1 -- 172.21.15.49:0/311997210 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586505924 0 0) 0x7fa96c069600 con 0x7fa96c067a90 2024-01-22T05:13:31.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.668+0000 7fa970c00700 1 -- 172.21.15.49:0/311997210 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa94c0033f0 con 0x7fa96c067a90 2024-01-22T05:13:31.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.668+0000 7fa971600700 1 -- 172.21.15.49:0/311997210 >> v2:172.21.15.110:3300/0 conn(0x7fa96c065df0 msgr2=0x7fa96c066260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:31.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.668+0000 7fa971600700 1 --2- 172.21.15.49:0/311997210 >> v2:172.21.15.110:3300/0 conn(0x7fa96c065df0 0x7fa96c066260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:31.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.668+0000 7fa971600700 1 -- 172.21.15.49:0/311997210 >> v1:172.21.15.49:6789/0 conn(0x7fa96c067a90 legacy=0x7fa96c15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:31.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.672+0000 7fa970c00700 1 -- 172.21.15.49:0/311997210 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2398204242 0 0) 0x7fa94c0033f0 con 0x7fa96c067a90 2024-01-22T05:13:31.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.672+0000 7fa971600700 1 -- 172.21.15.49:0/311997210 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c0a90f0 con 0x7fa96c15c2d0 2024-01-22T05:13:31.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.672+0000 7fa971600700 1 --2- 172.21.15.49:0/311997210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa96c15c2d0 0x7fa96c065900 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fa954009760 tx=0x7fa954009060).ready entity=mon.2 client_cookie=70cd32119bf12982 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:31.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.672+0000 7fa970c00700 1 -- 172.21.15.49:0/311997210 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c0015f0 con 0x7fa96c15c2d0 2024-01-22T05:13:31.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.672+0000 7fa970c00700 1 -- 172.21.15.49:0/311997210 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa954011400 con 0x7fa96c15c2d0 2024-01-22T05:13:31.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.672+0000 7fa970c00700 1 -- 172.21.15.49:0/311997210 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954011780 con 0x7fa96c15c2d0 2024-01-22T05:13:31.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.672+0000 7fa973400700 1 -- 172.21.15.49:0/311997210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa96c15c2d0 msgr2=0x7fa96c065900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:31.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.672+0000 7fa973400700 1 --2- 172.21.15.49:0/311997210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa96c15c2d0 0x7fa96c065900 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fa954009760 tx=0x7fa954009060).stop 2024-01-22T05:13:31.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.672+0000 7fa973400700 1 -- 172.21.15.49:0/311997210 shutdown_connections 2024-01-22T05:13:31.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.672+0000 7fa973400700 1 --2- 172.21.15.49:0/311997210 >> v2:172.21.15.110:3300/0 conn(0x7fa96c065df0 0x7fa96c066260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:31.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.672+0000 7fa973400700 1 --2- 172.21.15.49:0/311997210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa96c15c2d0 0x7fa96c065900 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:31.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.672+0000 7fa973400700 1 -- 172.21.15.49:0/311997210 >> 172.21.15.49:0/311997210 conn(0x7fa96c0c6fc0 msgr2=0x7fa96c0c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:31.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.672+0000 7fa973400700 1 -- 172.21.15.49:0/311997210 shutdown_connections 2024-01-22T05:13:31.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.672+0000 7fa973400700 1 -- 172.21.15.49:0/311997210 wait complete. 2024-01-22T05:13:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.676+0000 7fa973400700 1 Processor -- start 2024-01-22T05:13:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.676+0000 7fa973400700 1 -- start start 2024-01-22T05:13:31.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.676+0000 7fa973400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa96c065df0 0x7fa96c15d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:31.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.676+0000 7fa973400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa96c067a90 0x7fa96c1527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:31.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.676+0000 7fa973400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa96c15c2d0 0x7fa96c152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:31.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.676+0000 7fa973400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c157290 con 0x7fa96c065df0 2024-01-22T05:13:31.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.676+0000 7fa973400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c1569f0 con 0x7fa96c15c2d0 2024-01-22T05:13:31.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.676+0000 7fa973400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c156cd0 con 0x7fa96c067a90 2024-01-22T05:13:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa972000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa96c065df0 0x7fa96c15d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa972000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa96c065df0 0x7fa96c15d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33212/0 (socket says 172.21.15.49:33212) 2024-01-22T05:13:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa972000700 1 -- 172.21.15.49:0/2562512986 learned_addr learned my addr 172.21.15.49:0/2562512986 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa971600700 1 --2- 172.21.15.49:0/2562512986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa96c067a90 0x7fa96c1527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa972a00700 1 --2- 172.21.15.49:0/2562512986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa96c15c2d0 0x7fa96c152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:31.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa972000700 1 -- 172.21.15.49:0/2562512986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa96c067a90 msgr2=0x7fa96c1527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:31.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa972000700 1 --2- 172.21.15.49:0/2562512986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa96c067a90 0x7fa96c1527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:31.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa972000700 1 -- 172.21.15.49:0/2562512986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa96c15c2d0 msgr2=0x7fa96c152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:31.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa972000700 1 --2- 172.21.15.49:0/2562512986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa96c15c2d0 0x7fa96c152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:31.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa972000700 1 -- 172.21.15.49:0/2562512986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9540092a0 con 0x7fa96c065df0 2024-01-22T05:13:31.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa972000700 1 --2- 172.21.15.49:0/2562512986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa96c065df0 0x7fa96c15d9c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7fa95c00c810 tx=0x7fa95c001440).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa969600700 1 -- 172.21.15.49:0/2562512986 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c007320 con 0x7fa96c065df0 2024-01-22T05:13:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa969600700 1 -- 172.21.15.49:0/2562512986 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95c007480 con 0x7fa96c065df0 2024-01-22T05:13:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa973400700 1 -- 172.21.15.49:0/2562512986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96c156fb0 con 0x7fa96c065df0 2024-01-22T05:13:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa969600700 1 -- 172.21.15.49:0/2562512986 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c0058a0 con 0x7fa96c065df0 2024-01-22T05:13:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.680+0000 7fa973400700 1 -- 172.21.15.49:0/2562512986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96c153940 con 0x7fa96c065df0 2024-01-22T05:13:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.684+0000 7fa973400700 1 -- 172.21.15.49:0/2562512986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96c047060 con 0x7fa96c065df0 2024-01-22T05:13:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.684+0000 7fa969600700 1 -- 172.21.15.49:0/2562512986 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa95c005c90 con 0x7fa96c065df0 2024-01-22T05:13:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.684+0000 7fa969600700 1 --2- 172.21.15.49:0/2562512986 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa94405a510 0x7fa94405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:31.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.684+0000 7fa969600700 1 -- 172.21.15.49:0/2562512986 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fa95c0745a0 con 0x7fa96c065df0 2024-01-22T05:13:31.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.684+0000 7fa971600700 1 --2- 172.21.15.49:0/2562512986 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa94405a510 0x7fa94405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.688+0000 7fa971600700 1 --2- 172.21.15.49:0/2562512986 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa94405a510 0x7fa94405c9d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fa96c0c05d0 tx=0x7fa954016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:31.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.692+0000 7fa969600700 1 -- 172.21.15.49:0/2562512986 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa95c047f20 con 0x7fa96c065df0 2024-01-22T05:13:31.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.856+0000 7fa973400700 1 -- 172.21.15.49:0/2562512986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa96c0681c0 con 0x7fa96c065df0 2024-01-22T05:13:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.864+0000 7fa969600700 1 -- 172.21.15.49:0/2562512986 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa95c04b540 con 0x7fa96c065df0 2024-01-22T05:13:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.868+0000 7fa973400700 1 -- 172.21.15.49:0/2562512986 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa94405a510 msgr2=0x7fa94405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.868+0000 7fa973400700 1 --2- 172.21.15.49:0/2562512986 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa94405a510 0x7fa94405c9d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fa96c0c05d0 tx=0x7fa954016000).stop 2024-01-22T05:13:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.868+0000 7fa973400700 1 -- 172.21.15.49:0/2562512986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa96c065df0 msgr2=0x7fa96c15d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.868+0000 7fa973400700 1 --2- 172.21.15.49:0/2562512986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa96c065df0 0x7fa96c15d9c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7fa95c00c810 tx=0x7fa95c001440).stop 2024-01-22T05:13:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.868+0000 7fa973400700 1 -- 172.21.15.49:0/2562512986 shutdown_connections 2024-01-22T05:13:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.868+0000 7fa973400700 1 --2- 172.21.15.49:0/2562512986 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa94405a510 0x7fa94405c9d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.868+0000 7fa973400700 1 --2- 172.21.15.49:0/2562512986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa96c15c2d0 0x7fa96c152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.868+0000 7fa973400700 1 --2- 172.21.15.49:0/2562512986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa96c067a90 0x7fa96c1527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.868+0000 7fa973400700 1 --2- 172.21.15.49:0/2562512986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa96c065df0 0x7fa96c15d9c0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.868+0000 7fa973400700 1 -- 172.21.15.49:0/2562512986 >> 172.21.15.49:0/2562512986 conn(0x7fa96c0c6fc0 msgr2=0x7fa96c066260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.868+0000 7fa973400700 1 -- 172.21.15.49:0/2562512986 shutdown_connections 2024-01-22T05:13:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:31.868+0000 7fa973400700 1 -- 172.21.15.49:0/2562512986 wait complete. 2024-01-22T05:13:31.892 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:13:31.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:13:31.937 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:13:31.982 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:13:31.982 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-22T05:13:31.983 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:13:32.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.156+0000 7f3d4de00700 1 Processor -- start 2024-01-22T05:13:32.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.156+0000 7f3d4de00700 1 -- start start 2024-01-22T05:13:32.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.160+0000 7f3d4de00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3d48062a10 0x7f3d48062e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:32.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.160+0000 7f3d4de00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d48068b10 con 0x7f3d480c3200 2024-01-22T05:13:32.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.160+0000 7f3d4de00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d480bf5a0 con 0x7f3d48068fa0 2024-01-22T05:13:32.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.160+0000 7f3d4de00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d481583b0 con 0x7f3d48062a10 2024-01-22T05:13:32.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.160+0000 7f3d47e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3d48062a10 0x7f3d48062e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.160+0000 7f3d47e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3d48062a10 0x7f3d48062e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33214/0 (socket says 172.21.15.49:33214) 2024-01-22T05:13:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.160+0000 7f3d47e00700 1 -- 172.21.15.49:0/1677035124 learned_addr learned my addr 172.21.15.49:0/1677035124 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.160+0000 7f3d4d400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3d480c3200 0x7f3d480c3650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59856/0 (socket says 172.21.15.49:59856) 2024-01-22T05:13:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.160+0000 7f3d47e00700 1 -- 172.21.15.49:0/1677035124 >> v1:172.21.15.110:6789/0 conn(0x7f3d48068fa0 legacy=0x7f3d480bee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.160+0000 7f3d47e00700 1 -- 172.21.15.49:0/1677035124 >> v1:172.21.15.49:6789/0 conn(0x7f3d480c3200 legacy=0x7f3d480c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:32.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.160+0000 7f3d47e00700 1 -- 172.21.15.49:0/1677035124 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d480c4d30 con 0x7f3d48062a10 2024-01-22T05:13:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.164+0000 7f3d47e00700 1 --2- 172.21.15.49:0/1677035124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48062a10 0x7f3d48062e50 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f3d30006fd0 tx=0x7f3d300090f0).ready entity=mon.0 client_cookie=62139119dce9aab7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.164+0000 7f3d47400700 1 -- 172.21.15.49:0/1677035124 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000b600 con 0x7f3d48062a10 2024-01-22T05:13:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.164+0000 7f3d47400700 1 -- 172.21.15.49:0/1677035124 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3000b760 con 0x7f3d48062a10 2024-01-22T05:13:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.164+0000 7f3d47400700 1 -- 172.21.15.49:0/1677035124 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000bae0 con 0x7f3d48062a10 2024-01-22T05:13:32.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.164+0000 7f3d4de00700 1 -- 172.21.15.49:0/1677035124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48062a10 msgr2=0x7f3d48062e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:32.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.164+0000 7f3d4de00700 1 --2- 172.21.15.49:0/1677035124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48062a10 0x7f3d48062e50 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f3d30006fd0 tx=0x7f3d300090f0).stop 2024-01-22T05:13:32.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.164+0000 7f3d4de00700 1 -- 172.21.15.49:0/1677035124 shutdown_connections 2024-01-22T05:13:32.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.164+0000 7f3d4de00700 1 --2- 172.21.15.49:0/1677035124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48062a10 0x7f3d48062e50 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:32.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.164+0000 7f3d4de00700 1 -- 172.21.15.49:0/1677035124 >> 172.21.15.49:0/1677035124 conn(0x7f3d480c8740 msgr2=0x7f3d480c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:32.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.164+0000 7f3d4de00700 1 -- 172.21.15.49:0/1677035124 shutdown_connections 2024-01-22T05:13:32.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.164+0000 7f3d4de00700 1 -- 172.21.15.49:0/1677035124 wait complete. 2024-01-22T05:13:32.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.168+0000 7f3d4de00700 1 Processor -- start 2024-01-22T05:13:32.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.168+0000 7f3d4de00700 1 -- start start 2024-01-22T05:13:32.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48062a10 0x7f3d48145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:32.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4de00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d48068fa0 0x7f3d480a9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:32.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d480c3200 0x7f3d480a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:32.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4de00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d48145d00 con 0x7f3d48062a10 2024-01-22T05:13:32.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4de00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480ae670 con 0x7f3d480c3200 2024-01-22T05:13:32.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4de00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480a8c00 con 0x7f3d48068fa0 2024-01-22T05:13:32.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48062a10 0x7f3d48145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:32.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48062a10 0x7f3d48145810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33218/0 (socket says 172.21.15.49:33218) 2024-01-22T05:13:32.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4ca00700 1 -- 172.21.15.49:0/2009167522 learned_addr learned my addr 172.21.15.49:0/2009167522 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:32.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4d400700 1 --2- 172.21.15.49:0/2009167522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d480c3200 0x7f3d480a80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:32.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d47e00700 1 --2- 172.21.15.49:0/2009167522 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d48068fa0 0x7f3d480a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:32.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4ca00700 1 -- 172.21.15.49:0/2009167522 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d48068fa0 msgr2=0x7f3d480a9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:32.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4ca00700 1 --2- 172.21.15.49:0/2009167522 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d48068fa0 0x7f3d480a9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:32.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4ca00700 1 -- 172.21.15.49:0/2009167522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d480c3200 msgr2=0x7f3d480a80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:32.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4ca00700 1 --2- 172.21.15.49:0/2009167522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d480c3200 0x7f3d480a80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:32.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4ca00700 1 -- 172.21.15.49:0/2009167522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d30009370 con 0x7f3d48062a10 2024-01-22T05:13:32.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4d400700 1 --2- 172.21.15.49:0/2009167522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d480c3200 0x7f3d480a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:32.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4ca00700 1 --2- 172.21.15.49:0/2009167522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48062a10 0x7f3d48145810 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f3d3800c4c0 tx=0x7f3d38007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:32.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d3fe00700 1 -- 172.21.15.49:0/2009167522 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38007020 con 0x7f3d48062a10 2024-01-22T05:13:32.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d3fe00700 1 -- 172.21.15.49:0/2009167522 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d38001e90 con 0x7f3d48062a10 2024-01-22T05:13:32.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d4de00700 1 -- 172.21.15.49:0/2009167522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d480a8ee0 con 0x7f3d48062a10 2024-01-22T05:13:32.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.172+0000 7f3d3fe00700 1 -- 172.21.15.49:0/2009167522 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d380073b0 con 0x7f3d48062a10 2024-01-22T05:13:32.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.176+0000 7f3d4de00700 1 -- 172.21.15.49:0/2009167522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d48153c40 con 0x7f3d48062a10 2024-01-22T05:13:32.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.176+0000 7f3d4de00700 1 -- 172.21.15.49:0/2009167522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d480664e0 con 0x7f3d48062a10 2024-01-22T05:13:32.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.180+0000 7f3d3fe00700 1 -- 172.21.15.49:0/2009167522 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3d380068b0 con 0x7f3d48062a10 2024-01-22T05:13:32.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.180+0000 7f3d3fe00700 1 --2- 172.21.15.49:0/2009167522 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3d2005a510 0x7f3d2005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:32.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.180+0000 7f3d3fe00700 1 -- 172.21.15.49:0/2009167522 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f3d38073fe0 con 0x7f3d48062a10 2024-01-22T05:13:32.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.180+0000 7f3d47e00700 1 --2- 172.21.15.49:0/2009167522 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3d2005a510 0x7f3d2005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:32.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.180+0000 7f3d47e00700 1 --2- 172.21.15.49:0/2009167522 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3d2005a510 0x7f3d2005c9d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f3d30009130 tx=0x7f3d30017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.188+0000 7f3d3fe00700 1 -- 172.21.15.49:0/2009167522 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3d380478e0 con 0x7f3d48062a10 2024-01-22T05:13:32.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.384+0000 7f3d4de00700 1 -- 172.21.15.49:0/2009167522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d48067f00 con 0x7f3d48062a10 2024-01-22T05:13:32.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.388+0000 7f3d3fe00700 1 -- 172.21.15.49:0/2009167522 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f3d3804af00 con 0x7f3d48062a10 2024-01-22T05:13:32.388 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:32.388 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":92,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6395,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2953480069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2953480069},{"type":"v1","addr":"172.21.15.110:6833","nonce":2953480069}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7207,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2000522159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2000522159},{"type":"v1","addr":"172.21.15.110:6835","nonce":2000522159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/578632238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":578632238},{"type":"v1","addr":"172.21.15.49:6836","nonce":578632238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7659,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3507460182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3507460182},{"type":"v1","addr":"172.21.15.49:6837","nonce":3507460182}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91}],"filesystems":[]} 2024-01-22T05:13:32.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.388+0000 7f3d4de00700 1 -- 172.21.15.49:0/2009167522 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3d2005a510 msgr2=0x7f3d2005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:32.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.388+0000 7f3d4de00700 1 --2- 172.21.15.49:0/2009167522 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3d2005a510 0x7f3d2005c9d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f3d30009130 tx=0x7f3d30017000).stop 2024-01-22T05:13:32.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.388+0000 7f3d4de00700 1 -- 172.21.15.49:0/2009167522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48062a10 msgr2=0x7f3d48145810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:32.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.388+0000 7f3d4de00700 1 --2- 172.21.15.49:0/2009167522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48062a10 0x7f3d48145810 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f3d3800c4c0 tx=0x7f3d38007e00).stop 2024-01-22T05:13:32.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.388+0000 7f3d4de00700 1 -- 172.21.15.49:0/2009167522 shutdown_connections 2024-01-22T05:13:32.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.388+0000 7f3d4de00700 1 --2- 172.21.15.49:0/2009167522 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3d2005a510 0x7f3d2005c9d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:32.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.388+0000 7f3d4de00700 1 --2- 172.21.15.49:0/2009167522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d480c3200 0x7f3d480a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:32.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.388+0000 7f3d4de00700 1 --2- 172.21.15.49:0/2009167522 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d48068fa0 0x7f3d480a9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:32.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.388+0000 7f3d4de00700 1 --2- 172.21.15.49:0/2009167522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48062a10 0x7f3d48145810 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:32.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.388+0000 7f3d4de00700 1 -- 172.21.15.49:0/2009167522 >> 172.21.15.49:0/2009167522 conn(0x7f3d480c8740 msgr2=0x7f3d480c4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:32.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.388+0000 7f3d4de00700 1 -- 172.21.15.49:0/2009167522 shutdown_connections 2024-01-22T05:13:32.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.388+0000 7f3d4de00700 1 -- 172.21.15.49:0/2009167522 wait complete. 2024-01-22T05:13:32.394 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 92 2024-01-22T05:13:32.412 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:13:32.412 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-22T05:13:32.412 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:13:32.412 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:13:32.412 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:13:32.413 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-22T05:13:32.413 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:13:32.413 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:13:32.413 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:13:32.413 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-22T05:13:32.413 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:13:32.413 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:13:32.413 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:13:32.414 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-22T05:13:32.414 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:13:32.414 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:13:32.431 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:13:32.431 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:13:32.435 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:13:32.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:13:32.441 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:13:32.442 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:13:32.442 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:13:32.442 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:13:32.484 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:13:32.485 DEBUG:teuthology.parallel:result is None 2024-01-22T05:13:32.490 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:13:32.490 DEBUG:teuthology.parallel:result is None 2024-01-22T05:13:32.490 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:13:32.490 DEBUG:teuthology.parallel:result is None 2024-01-22T05:13:32.494 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:13:32.494 DEBUG:teuthology.parallel:result is None 2024-01-22T05:13:32.494 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-22T05:13:32.584 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:13:32.590 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:13:32.598 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:13:32.607 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-22T05:13:32.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.664+0000 7f8829000700 1 Processor -- start 2024-01-22T05:13:32.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.664+0000 7f8829000700 1 -- start start 2024-01-22T05:13:32.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8829000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8824153d60 0x7f8824064380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:32.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8829000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8824157b40 con 0x7f8824063f40 2024-01-22T05:13:32.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8829000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8824158610 con 0x7f88240bdfa0 2024-01-22T05:13:32.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8829000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8824069000 con 0x7f8824153d60 2024-01-22T05:13:32.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8821400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8824063f40 0x7f8824153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59876/0 (socket says 172.21.15.49:59876) 2024-01-22T05:13:32.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8821400700 1 -- 172.21.15.49:0/3778200626 learned_addr learned my addr 172.21.15.49:0/3778200626 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:32.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8822800700 1 --2- 172.21.15.49:0/3778200626 >> v2:172.21.15.110:3300/0 conn(0x7f8824153d60 0x7f8824064380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036367473 0 0) 0x7f8824157b40 con 0x7f8824063f40 2024-01-22T05:13:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88040033f0 con 0x7f8824063f40 2024-01-22T05:13:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999331692 0 0) 0x7f8824158610 con 0x7f88240bdfa0 2024-01-22T05:13:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8824157b40 con 0x7f88240bdfa0 2024-01-22T05:13:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3811299498 0 0) 0x7f88040033f0 con 0x7f8824063f40 2024-01-22T05:13:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 >> v2:172.21.15.110:3300/0 conn(0x7f8824153d60 msgr2=0x7f8824064380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 --2- 172.21.15.49:0/3778200626 >> v2:172.21.15.110:3300/0 conn(0x7f8824153d60 0x7f8824064380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 >> v1:172.21.15.110:6789/0 conn(0x7f88240bdfa0 legacy=0x7f88240688f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88240bc740 con 0x7f8824063f40 2024-01-22T05:13:32.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f880c001470 con 0x7f8824063f40 2024-01-22T05:13:32.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 >> v1:172.21.15.49:6789/0 conn(0x7f8824063f40 legacy=0x7f8824153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:32.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 --2- 172.21.15.49:0/3778200626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8804003a70 0x7f8804003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:32.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 --2- 172.21.15.49:0/3778200626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8804004690 0x7f8804004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:32.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 --2- 172.21.15.49:0/3778200626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8804005000 0x7f880400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:32.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8824069000 con 0x7f8804005000 2024-01-22T05:13:32.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880400bf30 con 0x7f8804004690 2024-01-22T05:13:32.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.668+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880400c0f0 con 0x7f8804003a70 2024-01-22T05:13:32.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8822800700 1 --2- 172.21.15.49:0/3778200626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8804005000 0x7f880400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:32.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8821e00700 1 --2- 172.21.15.49:0/3778200626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8804003a70 0x7f8804003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:32.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8821400700 1 --2- 172.21.15.49:0/3778200626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8804004690 0x7f8804004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:32.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8822800700 1 -- 172.21.15.49:0/3778200626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8804003a70 msgr2=0x7f8804003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:32.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8822800700 1 --2- 172.21.15.49:0/3778200626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8804003a70 0x7f8804003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:32.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8822800700 1 -- 172.21.15.49:0/3778200626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8804004690 msgr2=0x7f8804004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:32.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8822800700 1 --2- 172.21.15.49:0/3778200626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8804004690 0x7f8804004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:32.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8822800700 1 -- 172.21.15.49:0/3778200626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88040033f0 con 0x7f8804005000 2024-01-22T05:13:32.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8822800700 1 -- 172.21.15.49:0/3778200626 reap_dead start 2024-01-22T05:13:32.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8822800700 1 --2- 172.21.15.49:0/3778200626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8804005000 0x7f880400b8e0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f881c00e210 tx=0x7f881c00b040).ready entity=mon.0 client_cookie=71525a3e65fdce0d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:32.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c009ac0 con 0x7f8804005000 2024-01-22T05:13:32.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c00f040 con 0x7f8804005000 2024-01-22T05:13:32.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8820a00700 1 -- 172.21.15.49:0/3778200626 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c00ecd0 con 0x7f8804005000 2024-01-22T05:13:32.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8829000700 1 -- 172.21.15.49:0/3778200626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8804005000 msgr2=0x7f880400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:32.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8829000700 1 --2- 172.21.15.49:0/3778200626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8804005000 0x7f880400b8e0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f881c00e210 tx=0x7f881c00b040).stop 2024-01-22T05:13:32.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8829000700 1 -- 172.21.15.49:0/3778200626 shutdown_connections 2024-01-22T05:13:32.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8829000700 1 --2- 172.21.15.49:0/3778200626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8804005000 0x7f880400b8e0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:32.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8829000700 1 -- 172.21.15.49:0/3778200626 >> 172.21.15.49:0/3778200626 conn(0x7f88240c40c0 msgr2=0x7f88240c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:32.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8829000700 1 -- 172.21.15.49:0/3778200626 shutdown_connections 2024-01-22T05:13:32.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.672+0000 7f8829000700 1 -- 172.21.15.49:0/3778200626 wait complete. 2024-01-22T05:13:32.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.676+0000 7f8829000700 1 Processor -- start 2024-01-22T05:13:32.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.676+0000 7f8829000700 1 -- start start 2024-01-22T05:13:32.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8829000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8804005000 0x7f88240a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:32.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8829000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8824147200 0x7f88240a9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:32.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8829000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88240a7710 0x7f88240a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:32.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8829000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88241558c0 con 0x7f88240a7710 2024-01-22T05:13:32.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8829000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88240a8080 con 0x7f8804005000 2024-01-22T05:13:32.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8829000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8824154cb0 con 0x7f8824147200 2024-01-22T05:13:32.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8822800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88240a7710 0x7f88240a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:32.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8822800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88240a7710 0x7f88240a7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33264/0 (socket says 172.21.15.49:33264) 2024-01-22T05:13:32.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8822800700 1 -- 172.21.15.49:0/1702040359 learned_addr learned my addr 172.21.15.49:0/1702040359 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:32.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8821400700 1 --2- 172.21.15.49:0/1702040359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8824147200 0x7f88240a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:32.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8821e00700 1 --2- 172.21.15.49:0/1702040359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8804005000 0x7f88240a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:32.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8822800700 1 -- 172.21.15.49:0/1702040359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8824147200 msgr2=0x7f88240a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:32.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8822800700 1 --2- 172.21.15.49:0/1702040359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8824147200 0x7f88240a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:32.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8822800700 1 -- 172.21.15.49:0/1702040359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8804005000 msgr2=0x7f88240a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:32.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8822800700 1 --2- 172.21.15.49:0/1702040359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8804005000 0x7f88240a63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:32.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8822800700 1 -- 172.21.15.49:0/1702040359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8824154f90 con 0x7f88240a7710 2024-01-22T05:13:32.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8821e00700 1 --2- 172.21.15.49:0/1702040359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8804005000 0x7f88240a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:32.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8822800700 1 --2- 172.21.15.49:0/1702040359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88240a7710 0x7f88240a7b90 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f8824065cc0 tx=0x7f881c018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:32.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8819600700 1 -- 172.21.15.49:0/1702040359 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c009ac0 con 0x7f88240a7710 2024-01-22T05:13:32.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8819600700 1 -- 172.21.15.49:0/1702040359 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c01e470 con 0x7f88240a7710 2024-01-22T05:13:32.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8829000700 1 -- 172.21.15.49:0/1702040359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8824155270 con 0x7f88240a7710 2024-01-22T05:13:32.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8819600700 1 -- 172.21.15.49:0/1702040359 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c01e810 con 0x7f88240a7710 2024-01-22T05:13:32.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.680+0000 7f8829000700 1 -- 172.21.15.49:0/1702040359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8824147660 con 0x7f88240a7710 2024-01-22T05:13:32.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.684+0000 7f8829000700 1 -- 172.21.15.49:0/1702040359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88241556f0 con 0x7f88240a7710 2024-01-22T05:13:32.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.684+0000 7f8819600700 1 -- 172.21.15.49:0/1702040359 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f881c003020 con 0x7f88240a7710 2024-01-22T05:13:32.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.684+0000 7f8819600700 1 --2- 172.21.15.49:0/1702040359 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f87fc05a510 0x7f87fc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:32.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.684+0000 7f8819600700 1 -- 172.21.15.49:0/1702040359 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f881c076500 con 0x7f88240a7710 2024-01-22T05:13:32.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.684+0000 7f8821e00700 1 --2- 172.21.15.49:0/1702040359 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f87fc05a510 0x7f87fc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:32.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.688+0000 7f8821e00700 1 --2- 172.21.15.49:0/1702040359 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f87fc05a510 0x7f87fc05c9d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f88140010e0 tx=0x7f8814009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:32.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.692+0000 7f8819600700 1 -- 172.21.15.49:0/1702040359 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f881c049dc0 con 0x7f88240a7710 2024-01-22T05:13:32.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:32.876+0000 7f8829000700 1 -- 172.21.15.49:0/1702040359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8824157d70 con 0x7f88240a7710 2024-01-22T05:13:33.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.640+0000 7f8819600700 1 -- 172.21.15.49:0/1702040359 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v113) v1 ==== 97+0+0 (secure 0 0 0) 0x7f881c017020 con 0x7f88240a7710 2024-01-22T05:13:33.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.644+0000 7f8829000700 1 -- 172.21.15.49:0/1702040359 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f87fc05a510 msgr2=0x7f87fc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:33.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.644+0000 7f8829000700 1 --2- 172.21.15.49:0/1702040359 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f87fc05a510 0x7f87fc05c9d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f88140010e0 tx=0x7f8814009040).stop 2024-01-22T05:13:33.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.644+0000 7f8829000700 1 -- 172.21.15.49:0/1702040359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88240a7710 msgr2=0x7f88240a7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:33.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.644+0000 7f8829000700 1 --2- 172.21.15.49:0/1702040359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88240a7710 0x7f88240a7b90 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f8824065cc0 tx=0x7f881c018000).stop 2024-01-22T05:13:33.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.644+0000 7f8829000700 1 -- 172.21.15.49:0/1702040359 shutdown_connections 2024-01-22T05:13:33.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.644+0000 7f8829000700 1 --2- 172.21.15.49:0/1702040359 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f87fc05a510 0x7f87fc05c9d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:33.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.644+0000 7f8829000700 1 --2- 172.21.15.49:0/1702040359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88240a7710 0x7f88240a7b90 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:33.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.644+0000 7f8829000700 1 --2- 172.21.15.49:0/1702040359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8824147200 0x7f88240a9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:33.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.644+0000 7f8829000700 1 --2- 172.21.15.49:0/1702040359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8804005000 0x7f88240a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:33.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.644+0000 7f8829000700 1 -- 172.21.15.49:0/1702040359 >> 172.21.15.49:0/1702040359 conn(0x7f88240c40c0 msgr2=0x7f88240ac8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:33.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.644+0000 7f8829000700 1 -- 172.21.15.49:0/1702040359 shutdown_connections 2024-01-22T05:13:33.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.648+0000 7f8829000700 1 -- 172.21.15.49:0/1702040359 wait complete. 2024-01-22T05:13:33.650 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-01-22T05:13:33.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-22T05:13:33.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.844+0000 7f8988800700 1 Processor -- start 2024-01-22T05:13:33.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.844+0000 7f8988800700 1 -- start start 2024-01-22T05:13:33.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8988800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89801547c0 0x7f89800c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:33.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8988800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89800691b0 0x7f89800bbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:33.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8988800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89800c2330 con 0x7f89801500b0 2024-01-22T05:13:33.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8988800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8980066950 con 0x7f89800691b0 2024-01-22T05:13:33.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8988800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89800c2610 con 0x7f89801547c0 2024-01-22T05:13:33.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8986800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89800691b0 0x7f89800bbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:33.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8986800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89800691b0 0x7f89800bbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58388/0 (socket says 172.21.15.49:58388) 2024-01-22T05:13:33.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8986800700 1 -- 172.21.15.49:0/3358014727 learned_addr learned my addr 172.21.15.49:0/3358014727 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:33.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8985e00700 1 --2- 172.21.15.49:0/3358014727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89801547c0 0x7f89800c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:33.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8986800700 1 -- 172.21.15.49:0/3358014727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89801547c0 msgr2=0x7f89800c30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:33.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8986800700 1 --2- 172.21.15.49:0/3358014727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89801547c0 0x7f89800c30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:33.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8986800700 1 -- 172.21.15.49:0/3358014727 >> v1:172.21.15.110:6789/0 conn(0x7f89801500b0 legacy=0x7f8980068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:33.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8986800700 1 -- 172.21.15.49:0/3358014727 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89800c28f0 con 0x7f89800691b0 2024-01-22T05:13:33.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8986800700 1 --2- 172.21.15.49:0/3358014727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89800691b0 0x7f89800bbf10 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f8978009f20 tx=0x7f8978009840).ready entity=mon.0 client_cookie=520db984bde80a36 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:33.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8984a00700 1 -- 172.21.15.49:0/3358014727 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800e070 con 0x7f89800691b0 2024-01-22T05:13:33.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8984a00700 1 -- 172.21.15.49:0/3358014727 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897800b9d0 con 0x7f89800691b0 2024-01-22T05:13:33.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.848+0000 7f8984a00700 1 -- 172.21.15.49:0/3358014727 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800bd50 con 0x7f89800691b0 2024-01-22T05:13:33.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.852+0000 7f8988800700 1 -- 172.21.15.49:0/3358014727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89800691b0 msgr2=0x7f89800bbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:33.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.852+0000 7f8988800700 1 --2- 172.21.15.49:0/3358014727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89800691b0 0x7f89800bbf10 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f8978009f20 tx=0x7f8978009840).stop 2024-01-22T05:13:33.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.852+0000 7f8988800700 1 -- 172.21.15.49:0/3358014727 shutdown_connections 2024-01-22T05:13:33.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.852+0000 7f8988800700 1 --2- 172.21.15.49:0/3358014727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89800691b0 0x7f89800bbf10 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:33.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.852+0000 7f8988800700 1 --2- 172.21.15.49:0/3358014727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89801547c0 0x7f89800c30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:33.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.852+0000 7f8988800700 1 -- 172.21.15.49:0/3358014727 >> 172.21.15.49:0/3358014727 conn(0x7f89800c4300 msgr2=0x7f8980065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:33.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.852+0000 7f8988800700 1 -- 172.21.15.49:0/3358014727 shutdown_connections 2024-01-22T05:13:33.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.852+0000 7f8988800700 1 -- 172.21.15.49:0/3358014727 wait complete. 2024-01-22T05:13:33.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.856+0000 7f8988800700 1 Processor -- start 2024-01-22T05:13:33.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.856+0000 7f8988800700 1 -- start start 2024-01-22T05:13:33.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8988800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89800691b0 0x7f8980150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:33.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8988800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89801500b0 0x7f89800a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:33.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8988800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89801547c0 0x7f89801663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:33.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8988800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8980165f60 con 0x7f89800691b0 2024-01-22T05:13:33.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8988800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8980165c30 con 0x7f89801547c0 2024-01-22T05:13:33.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8988800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89800a6e30 con 0x7f89801500b0 2024-01-22T05:13:33.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8985e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89800691b0 0x7f8980150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:33.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8985e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89800691b0 0x7f8980150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58390/0 (socket says 172.21.15.49:58390) 2024-01-22T05:13:33.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8985e00700 1 -- 172.21.15.49:0/488842736 learned_addr learned my addr 172.21.15.49:0/488842736 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:33.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8985400700 1 --2- 172.21.15.49:0/488842736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89801500b0 0x7f89800a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:33.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8986800700 1 --2- 172.21.15.49:0/488842736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89801547c0 0x7f89801663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:33.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8985e00700 1 -- 172.21.15.49:0/488842736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89801500b0 msgr2=0x7f89800a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:33.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8985e00700 1 --2- 172.21.15.49:0/488842736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89801500b0 0x7f89800a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:33.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8985e00700 1 -- 172.21.15.49:0/488842736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89801547c0 msgr2=0x7f89801663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:33.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8985e00700 1 --2- 172.21.15.49:0/488842736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89801547c0 0x7f89801663f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:33.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8985e00700 1 -- 172.21.15.49:0/488842736 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8978009ae0 con 0x7f89800691b0 2024-01-22T05:13:33.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8985e00700 1 --2- 172.21.15.49:0/488842736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89800691b0 0x7f8980150f30 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f897000e900 tx=0x7f8970009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:33.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f897d600700 1 -- 172.21.15.49:0/488842736 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970012600 con 0x7f89800691b0 2024-01-22T05:13:33.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f897d600700 1 -- 172.21.15.49:0/488842736 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8970012760 con 0x7f89800691b0 2024-01-22T05:13:33.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.860+0000 7f8988800700 1 -- 172.21.15.49:0/488842736 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89800a7100 con 0x7f89800691b0 2024-01-22T05:13:33.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.864+0000 7f897d600700 1 -- 172.21.15.49:0/488842736 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970012ae0 con 0x7f89800691b0 2024-01-22T05:13:33.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.864+0000 7f8988800700 1 -- 172.21.15.49:0/488842736 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89800a76c0 con 0x7f89800691b0 2024-01-22T05:13:33.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.864+0000 7f8988800700 1 -- 172.21.15.49:0/488842736 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8980064b90 con 0x7f89800691b0 2024-01-22T05:13:33.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.864+0000 7f897d600700 1 -- 172.21.15.49:0/488842736 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f897001b400 con 0x7f89800691b0 2024-01-22T05:13:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.868+0000 7f897d600700 1 --2- 172.21.15.49:0/488842736 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f895805a540 0x7f895805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.868+0000 7f897d600700 1 -- 172.21.15.49:0/488842736 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f8970074940 con 0x7f89800691b0 2024-01-22T05:13:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.868+0000 7f8985400700 1 --2- 172.21.15.49:0/488842736 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f895805a540 0x7f895805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.868+0000 7f8985400700 1 --2- 172.21.15.49:0/488842736 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f895805a540 0x7f895805ca00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f89800a7ea0 tx=0x7f8968007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:33.872+0000 7f897d600700 1 -- 172.21.15.49:0/488842736 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f89700481f0 con 0x7f89800691b0 2024-01-22T05:13:34.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.088+0000 7f8988800700 1 -- 172.21.15.49:0/488842736 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f89800a6720 con 0x7f89800691b0 2024-01-22T05:13:34.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.088+0000 7f897d600700 1 -- 172.21.15.49:0/488842736 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f897004b810 con 0x7f89800691b0 2024-01-22T05:13:34.089 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:34.090 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:13:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-01-22T05:13:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-01-22T05:13:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lTCfoJxAAxDGvXKXgooA9/f0J70s6AA==", 2024-01-22T05:13:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:13:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:13:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:13:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:13:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lHqV6ORAA1DwpPV2PyDBF/6/ePTdQJw==", 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lPo86MhAAonfC3M+AkLldljODYNGzyA==", 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:13:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:13:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:13:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-01-22T05:13:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lLwvMBxAAFm52HWeGbTH1gbWVm6r5zQ==", 2024-01-22T05:13:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:13:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:13:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:13:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:13:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-01-22T05:13:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAt961lH2F9NBAAHm8R9/Q5IuFUvb0o1GyD4Q==", 2024-01-22T05:13:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:13:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:13:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:13:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-01-22T05:13:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAx961lS1lEIhAAuDm2OYfTYff1kVEq5vXvFw==", 2024-01-22T05:13:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:13:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:13:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:13:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-01-22T05:13:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA1961limLvERAAv23crKrwjLIg84u48BHHbg==", 2024-01-22T05:13:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:13:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:13:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:13:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2024-01-22T05:13:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA5961lShJiABAAnvyhz0ggDaITaMgwzi9kAA==", 2024-01-22T05:13:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:13:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:13:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:13:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2024-01-22T05:13:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA9961lcopfNRAAAZgHzI1t7YHI5cAjaCMiNw==", 2024-01-22T05:13:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:13:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:13:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:13:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2024-01-22T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBB961lX+nTIxAAtP3YQypuFWM5O/LADjvybA==", 2024-01-22T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2024-01-22T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBF961lQ4/XERAARZPqENsV3jokk2g3OXUI5w==", 2024-01-22T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBI961luxnqOhAAGsV74DKQda5cetNA/woOnA==", 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lmrM6DhAAYU09HviWyrUIz4lio15wFw==", 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:13:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lIhYRGRAAFG+YtkDLFsra6zU44xKCHw==", 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lRuyaExAAQO3a7ahOEcuE+WVfXYEBTg==", 2024-01-22T05:13:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:13:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:13:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:13:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:13:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2024-01-22T05:13:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lMiMkHhAAxPdKpcHdtqSphbc/2agq9Q==", 2024-01-22T05:13:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:13:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:13:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:13:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:13:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-01-22T05:13:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961ljsweARAAJrY3z/sBjayjB2BRQNrJew==", 2024-01-22T05:13:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:13:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:13:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:13:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:13:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-01-22T05:13:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961l0DwDIhAAeuCu79LxNMEJvWiW/BfDhA==", 2024-01-22T05:13:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:13:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:13:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:13:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2024-01-22T05:13:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lZlmPGxAA1KVZR+XzNdoFVo/980hD8w==", 2024-01-22T05:13:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:13:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:13:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:13:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:13:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-01-22T05:13:34.102 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:13:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.092+0000 7f8988800700 1 -- 172.21.15.49:0/488842736 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f895805a540 msgr2=0x7f895805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.092+0000 7f8988800700 1 --2- 172.21.15.49:0/488842736 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f895805a540 0x7f895805ca00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f89800a7ea0 tx=0x7f8968007d40).stop 2024-01-22T05:13:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.092+0000 7f8988800700 1 -- 172.21.15.49:0/488842736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89800691b0 msgr2=0x7f8980150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.092+0000 7f8988800700 1 --2- 172.21.15.49:0/488842736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89800691b0 0x7f8980150f30 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f897000e900 tx=0x7f8970009060).stop 2024-01-22T05:13:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.092+0000 7f8988800700 1 -- 172.21.15.49:0/488842736 shutdown_connections 2024-01-22T05:13:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.092+0000 7f8988800700 1 --2- 172.21.15.49:0/488842736 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f895805a540 0x7f895805ca00 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.092+0000 7f8988800700 1 --2- 172.21.15.49:0/488842736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89801547c0 0x7f89801663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.092+0000 7f8988800700 1 --2- 172.21.15.49:0/488842736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89801500b0 0x7f89800a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.092+0000 7f8988800700 1 --2- 172.21.15.49:0/488842736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89800691b0 0x7f8980150f30 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.092+0000 7f8988800700 1 -- 172.21.15.49:0/488842736 >> 172.21.15.49:0/488842736 conn(0x7f89800c4300 msgr2=0x7f8980153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.096+0000 7f8988800700 1 -- 172.21.15.49:0/488842736 shutdown_connections 2024-01-22T05:13:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.096+0000 7f8988800700 1 -- 172.21.15.49:0/488842736 wait complete. 2024-01-22T05:13:34.120 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:13:34.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.292+0000 7fca69e00700 1 Processor -- start 2024-01-22T05:13:34.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.292+0000 7fca69e00700 1 -- start start 2024-01-22T05:13:34.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.296+0000 7fca69e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fca64155d20 0x7fca64065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:34.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.296+0000 7fca69e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca640c1a40 con 0x7fca640a8e50 2024-01-22T05:13:34.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.296+0000 7fca69e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca64159310 con 0x7fca64066070 2024-01-22T05:13:34.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.296+0000 7fca69e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca640c13f0 con 0x7fca64155d20 2024-01-22T05:13:34.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.296+0000 7fca63400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fca640a8e50 0x7fca640c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52992/0 (socket says 172.21.15.49:52992) 2024-01-22T05:13:34.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.296+0000 7fca63400700 1 -- 172.21.15.49:0/2204739242 learned_addr learned my addr 172.21.15.49:0/2204739242 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:34.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.296+0000 7fca62a00700 1 --2- 172.21.15.49:0/2204739242 >> v2:172.21.15.110:3300/0 conn(0x7fca64155d20 0x7fca64065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:34.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.296+0000 7fca61600700 1 -- 172.21.15.49:0/2204739242 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223456639 0 0) 0x7fca640c1a40 con 0x7fca640a8e50 2024-01-22T05:13:34.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.296+0000 7fca61600700 1 -- 172.21.15.49:0/2204739242 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca440033f0 con 0x7fca640a8e50 2024-01-22T05:13:34.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.296+0000 7fca61600700 1 -- 172.21.15.49:0/2204739242 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396028133 0 0) 0x7fca64159310 con 0x7fca64066070 2024-01-22T05:13:34.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.300+0000 7fca61600700 1 -- 172.21.15.49:0/2204739242 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca640c1a40 con 0x7fca64066070 2024-01-22T05:13:34.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.300+0000 7fca62a00700 1 -- 172.21.15.49:0/2204739242 >> v1:172.21.15.110:6789/0 conn(0x7fca64066070 legacy=0x7fca640a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:34.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.300+0000 7fca62a00700 1 -- 172.21.15.49:0/2204739242 >> v1:172.21.15.49:6789/0 conn(0x7fca640a8e50 legacy=0x7fca640c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:34.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.300+0000 7fca62a00700 1 -- 172.21.15.49:0/2204739242 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca640c16d0 con 0x7fca64155d20 2024-01-22T05:13:34.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.300+0000 7fca62a00700 1 --2- 172.21.15.49:0/2204739242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca64155d20 0x7fca64065b80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fca54009760 tx=0x7fca54009060).ready entity=mon.1 client_cookie=75170d34246d2d61 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:34.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.300+0000 7fca61600700 1 -- 172.21.15.49:0/2204739242 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5400d4a0 con 0x7fca64155d20 2024-01-22T05:13:34.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.300+0000 7fca61600700 1 -- 172.21.15.49:0/2204739242 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5400d600 con 0x7fca64155d20 2024-01-22T05:13:34.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.300+0000 7fca61600700 1 -- 172.21.15.49:0/2204739242 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5400d980 con 0x7fca64155d20 2024-01-22T05:13:34.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.300+0000 7fca69e00700 1 -- 172.21.15.49:0/2204739242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca64155d20 msgr2=0x7fca64065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:34.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.300+0000 7fca69e00700 1 --2- 172.21.15.49:0/2204739242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca64155d20 0x7fca64065b80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fca54009760 tx=0x7fca54009060).stop 2024-01-22T05:13:34.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.300+0000 7fca69e00700 1 -- 172.21.15.49:0/2204739242 shutdown_connections 2024-01-22T05:13:34.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.300+0000 7fca69e00700 1 --2- 172.21.15.49:0/2204739242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca64155d20 0x7fca64065b80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.300+0000 7fca69e00700 1 -- 172.21.15.49:0/2204739242 >> 172.21.15.49:0/2204739242 conn(0x7fca640c6540 msgr2=0x7fca640c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:34.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.300+0000 7fca69e00700 1 -- 172.21.15.49:0/2204739242 shutdown_connections 2024-01-22T05:13:34.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.300+0000 7fca69e00700 1 -- 172.21.15.49:0/2204739242 wait complete. 2024-01-22T05:13:34.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.304+0000 7fca69e00700 1 Processor -- start 2024-01-22T05:13:34.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca69e00700 1 -- start start 2024-01-22T05:13:34.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca69e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca64066070 0x7fca64169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:34.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca69e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca640a8e50 0x7fca64157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:34.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca69e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca64155d20 0x7fca6416b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:34.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca69e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca64169970 con 0x7fca640a8e50 2024-01-22T05:13:34.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca69e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca640bf320 con 0x7fca64155d20 2024-01-22T05:13:34.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca69e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca640bd810 con 0x7fca64066070 2024-01-22T05:13:34.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca62000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca640a8e50 0x7fca64157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:34.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca62000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca640a8e50 0x7fca64157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58406/0 (socket says 172.21.15.49:58406) 2024-01-22T05:13:34.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca63400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca64155d20 0x7fca6416b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:34.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca62a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca64066070 0x7fca64169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:34.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca62000700 1 -- 172.21.15.49:0/39097265 learned_addr learned my addr 172.21.15.49:0/39097265 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:34.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca62000700 1 -- 172.21.15.49:0/39097265 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca64066070 msgr2=0x7fca64169b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:34.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca62000700 1 --2- 172.21.15.49:0/39097265 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca64066070 0x7fca64169b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca62000700 1 -- 172.21.15.49:0/39097265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca64155d20 msgr2=0x7fca6416b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:34.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca62000700 1 --2- 172.21.15.49:0/39097265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca64155d20 0x7fca6416b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.308+0000 7fca62000700 1 -- 172.21.15.49:0/39097265 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca540092a0 con 0x7fca640a8e50 2024-01-22T05:13:34.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.312+0000 7fca62000700 1 --2- 172.21.15.49:0/39097265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca640a8e50 0x7fca64157c50 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7fca4c00c4c0 tx=0x7fca4c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:34.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.312+0000 7fca5a000700 1 -- 172.21.15.49:0/39097265 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c00ce30 con 0x7fca640a8e50 2024-01-22T05:13:34.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.312+0000 7fca5a000700 1 -- 172.21.15.49:0/39097265 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c00f470 con 0x7fca640a8e50 2024-01-22T05:13:34.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.312+0000 7fca69e00700 1 -- 172.21.15.49:0/39097265 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca641690d0 con 0x7fca640a8e50 2024-01-22T05:13:34.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.312+0000 7fca5a000700 1 -- 172.21.15.49:0/39097265 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c00f810 con 0x7fca640a8e50 2024-01-22T05:13:34.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.312+0000 7fca69e00700 1 -- 172.21.15.49:0/39097265 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca64169690 con 0x7fca640a8e50 2024-01-22T05:13:34.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.312+0000 7fca69e00700 1 -- 172.21.15.49:0/39097265 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca640bd5c0 con 0x7fca640a8e50 2024-01-22T05:13:34.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.316+0000 7fca5a000700 1 -- 172.21.15.49:0/39097265 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fca4c00fbc0 con 0x7fca640a8e50 2024-01-22T05:13:34.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.316+0000 7fca5a000700 1 --2- 172.21.15.49:0/39097265 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca3c05a510 0x7fca3c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:34.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.316+0000 7fca5a000700 1 -- 172.21.15.49:0/39097265 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fca4c073b90 con 0x7fca640a8e50 2024-01-22T05:13:34.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.316+0000 7fca62a00700 1 --2- 172.21.15.49:0/39097265 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca3c05a510 0x7fca3c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:34.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.316+0000 7fca62a00700 1 --2- 172.21.15.49:0/39097265 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca3c05a510 0x7fca3c05c9d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fca54006d60 tx=0x7fca54016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:34.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.324+0000 7fca5a000700 1 -- 172.21.15.49:0/39097265 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fca4c0474a0 con 0x7fca640a8e50 2024-01-22T05:13:34.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.492+0000 7fca69e00700 1 -- 172.21.15.49:0/39097265 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca640bd950 con 0x7fca640a8e50 2024-01-22T05:13:34.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.496+0000 7fca5a000700 1 -- 172.21.15.49:0/39097265 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+13958 (secure 0 0 0) 0x7fca4c04aac0 con 0x7fca640a8e50 2024-01-22T05:13:34.497 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:34.497 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":113,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:13:33.633743+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:13:34.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.496+0000 7fca69e00700 1 -- 172.21.15.49:0/39097265 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca3c05a510 msgr2=0x7fca3c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:34.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.496+0000 7fca69e00700 1 --2- 172.21.15.49:0/39097265 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca3c05a510 0x7fca3c05c9d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fca54006d60 tx=0x7fca54016000).stop 2024-01-22T05:13:34.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.496+0000 7fca69e00700 1 -- 172.21.15.49:0/39097265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca640a8e50 msgr2=0x7fca64157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:34.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.496+0000 7fca69e00700 1 --2- 172.21.15.49:0/39097265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca640a8e50 0x7fca64157c50 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7fca4c00c4c0 tx=0x7fca4c007c90).stop 2024-01-22T05:13:34.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.500+0000 7fca69e00700 1 -- 172.21.15.49:0/39097265 shutdown_connections 2024-01-22T05:13:34.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.500+0000 7fca69e00700 1 --2- 172.21.15.49:0/39097265 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fca3c05a510 0x7fca3c05c9d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.500+0000 7fca69e00700 1 --2- 172.21.15.49:0/39097265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca64155d20 0x7fca6416b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.500+0000 7fca69e00700 1 --2- 172.21.15.49:0/39097265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca640a8e50 0x7fca64157c50 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.500+0000 7fca69e00700 1 --2- 172.21.15.49:0/39097265 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca64066070 0x7fca64169b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.500+0000 7fca69e00700 1 -- 172.21.15.49:0/39097265 >> 172.21.15.49:0/39097265 conn(0x7fca640c6540 msgr2=0x7fca640bbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:34.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.500+0000 7fca69e00700 1 -- 172.21.15.49:0/39097265 shutdown_connections 2024-01-22T05:13:34.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.500+0000 7fca69e00700 1 -- 172.21.15.49:0/39097265 wait complete. 2024-01-22T05:13:34.522 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:13:34.522 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:13:34.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.692+0000 7fbfa7e00700 1 Processor -- start 2024-01-22T05:13:34.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.692+0000 7fbfa7e00700 1 -- start start 2024-01-22T05:13:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa7e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbfa8067a90 0x7fbfa815bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa7e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbfa8066910 0x7fbfa8158d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa7e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa8069600 con 0x7fbfa815c0b0 2024-01-22T05:13:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa7e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa81561a0 con 0x7fbfa8067a90 2024-01-22T05:13:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa7e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa8068dd0 con 0x7fbfa8066910 2024-01-22T05:13:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa6a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbfa8067a90 0x7fbfa815bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:34.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa6a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbfa8067a90 0x7fbfa815bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58414/0 (socket says 172.21.15.49:58414) 2024-01-22T05:13:34.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa6a00700 1 -- 172.21.15.49:0/1062982137 learned_addr learned my addr 172.21.15.49:0/1062982137 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:34.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa6000700 1 --1- 172.21.15.49:0/1062982137 >> v1:172.21.15.49:6789/0 conn(0x7fbfa815c0b0 0x7fbfa8158670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52998/0 (socket says 172.21.15.49:52998) 2024-01-22T05:13:34.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa7400700 1 --2- 172.21.15.49:0/1062982137 >> v2:172.21.15.110:3300/0 conn(0x7fbfa8066910 0x7fbfa8158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:34.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa6a00700 1 -- 172.21.15.49:0/1062982137 >> v2:172.21.15.110:3300/0 conn(0x7fbfa8066910 msgr2=0x7fbfa8158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:34.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa6a00700 1 --2- 172.21.15.49:0/1062982137 >> v2:172.21.15.110:3300/0 conn(0x7fbfa8066910 0x7fbfa8158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa6a00700 1 -- 172.21.15.49:0/1062982137 >> v1:172.21.15.49:6789/0 conn(0x7fbfa815c0b0 legacy=0x7fbfa8158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:34.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa6a00700 1 -- 172.21.15.49:0/1062982137 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa815c510 con 0x7fbfa8067a90 2024-01-22T05:13:34.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa6a00700 1 --2- 172.21.15.49:0/1062982137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa8067a90 0x7fbfa815bbc0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7fbfa80c1260 tx=0x7fbf98009060).ready entity=mon.0 client_cookie=3147a1e7e68f3ae9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:34.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa5600700 1 -- 172.21.15.49:0/1062982137 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98005880 con 0x7fbfa8067a90 2024-01-22T05:13:34.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa5600700 1 -- 172.21.15.49:0/1062982137 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf980059e0 con 0x7fbfa8067a90 2024-01-22T05:13:34.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.696+0000 7fbfa5600700 1 -- 172.21.15.49:0/1062982137 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98005d60 con 0x7fbfa8067a90 2024-01-22T05:13:34.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.700+0000 7fbfa7e00700 1 -- 172.21.15.49:0/1062982137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa8067a90 msgr2=0x7fbfa815bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:34.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.700+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/1062982137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa8067a90 0x7fbfa815bbc0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7fbfa80c1260 tx=0x7fbf98009060).stop 2024-01-22T05:13:34.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.700+0000 7fbfa7e00700 1 -- 172.21.15.49:0/1062982137 shutdown_connections 2024-01-22T05:13:34.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.700+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/1062982137 >> v2:172.21.15.110:3300/0 conn(0x7fbfa8066910 0x7fbfa8158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.700+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/1062982137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa8067a90 0x7fbfa815bbc0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.700+0000 7fbfa7e00700 1 -- 172.21.15.49:0/1062982137 >> 172.21.15.49:0/1062982137 conn(0x7fbfa80c6fc0 msgr2=0x7fbfa80c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:34.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.700+0000 7fbfa7e00700 1 -- 172.21.15.49:0/1062982137 shutdown_connections 2024-01-22T05:13:34.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.700+0000 7fbfa7e00700 1 -- 172.21.15.49:0/1062982137 wait complete. 2024-01-22T05:13:34.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.704+0000 7fbfa7e00700 1 Processor -- start 2024-01-22T05:13:34.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.704+0000 7fbfa7e00700 1 -- start start 2024-01-22T05:13:34.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.704+0000 7fbfa7e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa8066910 0x7fbfa8157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:34.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.704+0000 7fbfa7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfa8067a90 0x7fbfa8168cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:34.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.704+0000 7fbfa7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa815c0b0 0x7fbfa815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:34.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.704+0000 7fbfa7e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa8169d70 con 0x7fbfa815c0b0 2024-01-22T05:13:34.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.704+0000 7fbfa7e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa81582d0 con 0x7fbfa8067a90 2024-01-22T05:13:34.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.704+0000 7fbfa7e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa80bd800 con 0x7fbfa8066910 2024-01-22T05:13:34.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbfa7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa815c0b0 0x7fbfa815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:34.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbfa7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa815c0b0 0x7fbfa815ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58426/0 (socket says 172.21.15.49:58426) 2024-01-22T05:13:34.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbfa7400700 1 -- 172.21.15.49:0/2823945402 learned_addr learned my addr 172.21.15.49:0/2823945402 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:34.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbfa6000700 1 --2- 172.21.15.49:0/2823945402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfa8067a90 0x7fbfa8168cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:34.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbfa6a00700 1 --2- 172.21.15.49:0/2823945402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa8066910 0x7fbfa8157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:34.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbfa7400700 1 -- 172.21.15.49:0/2823945402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa8066910 msgr2=0x7fbfa8157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:34.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbfa7400700 1 --2- 172.21.15.49:0/2823945402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa8066910 0x7fbfa8157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbfa7400700 1 -- 172.21.15.49:0/2823945402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfa8067a90 msgr2=0x7fbfa8168cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:34.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbfa7400700 1 --2- 172.21.15.49:0/2823945402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfa8067a90 0x7fbfa8168cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbfa7400700 1 -- 172.21.15.49:0/2823945402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf98009300 con 0x7fbfa815c0b0 2024-01-22T05:13:34.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbfa7400700 1 --2- 172.21.15.49:0/2823945402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa815c0b0 0x7fbfa815ae70 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7fbfa0009fa0 tx=0x7fbfa0009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:34.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbf9e000700 1 -- 172.21.15.49:0/2823945402 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa000ec50 con 0x7fbfa815c0b0 2024-01-22T05:13:34.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbf9e000700 1 -- 172.21.15.49:0/2823945402 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa000edb0 con 0x7fbfa815c0b0 2024-01-22T05:13:34.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbfa7e00700 1 -- 172.21.15.49:0/2823945402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa81694d0 con 0x7fbfa815c0b0 2024-01-22T05:13:34.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbf9e000700 1 -- 172.21.15.49:0/2823945402 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0014610 con 0x7fbfa815c0b0 2024-01-22T05:13:34.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.708+0000 7fbfa7e00700 1 -- 172.21.15.49:0/2823945402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa8169a90 con 0x7fbfa815c0b0 2024-01-22T05:13:34.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.712+0000 7fbf9e000700 1 -- 172.21.15.49:0/2823945402 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbfa001d3b0 con 0x7fbfa815c0b0 2024-01-22T05:13:34.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.712+0000 7fbfa7e00700 1 -- 172.21.15.49:0/2823945402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa80bd5d0 con 0x7fbfa815c0b0 2024-01-22T05:13:34.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.712+0000 7fbf9e000700 1 --2- 172.21.15.49:0/2823945402 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf8005a510 0x7fbf8005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:34.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.712+0000 7fbf9e000700 1 -- 172.21.15.49:0/2823945402 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fbfa0074ae0 con 0x7fbfa815c0b0 2024-01-22T05:13:34.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.712+0000 7fbfa6a00700 1 --2- 172.21.15.49:0/2823945402 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf8005a510 0x7fbf8005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:34.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.712+0000 7fbfa6a00700 1 --2- 172.21.15.49:0/2823945402 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf8005a510 0x7fbf8005c9d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fbf98009fd0 tx=0x7fbf98016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:34.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.720+0000 7fbf9e000700 1 -- 172.21.15.49:0/2823945402 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbfa80bd5d0 con 0x7fbfa815c0b0 2024-01-22T05:13:34.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.880+0000 7fbfa7e00700 1 -- 172.21.15.49:0/2823945402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbfa80bd5d0 con 0x7fbfa815c0b0 2024-01-22T05:13:34.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.880+0000 7fbf9e000700 1 -- 172.21.15.49:0/2823945402 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v113) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbfa80bd5d0 con 0x7fbfa815c0b0 2024-01-22T05:13:34.883 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:13:34.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.884+0000 7fbfa7e00700 1 -- 172.21.15.49:0/2823945402 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf8005a510 msgr2=0x7fbf8005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:34.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.884+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/2823945402 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf8005a510 0x7fbf8005c9d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fbf98009fd0 tx=0x7fbf98016000).stop 2024-01-22T05:13:34.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.884+0000 7fbfa7e00700 1 -- 172.21.15.49:0/2823945402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa815c0b0 msgr2=0x7fbfa815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:34.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.884+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/2823945402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa815c0b0 0x7fbfa815ae70 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7fbfa0009fa0 tx=0x7fbfa0009900).stop 2024-01-22T05:13:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.884+0000 7fbfa7e00700 1 -- 172.21.15.49:0/2823945402 shutdown_connections 2024-01-22T05:13:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.884+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/2823945402 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf8005a510 0x7fbf8005c9d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.884+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/2823945402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa815c0b0 0x7fbfa815ae70 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.884+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/2823945402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfa8067a90 0x7fbfa8168cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.884+0000 7fbfa7e00700 1 --2- 172.21.15.49:0/2823945402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfa8066910 0x7fbfa8157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.884+0000 7fbfa7e00700 1 -- 172.21.15.49:0/2823945402 >> 172.21.15.49:0/2823945402 conn(0x7fbfa80c6fc0 msgr2=0x7fbfa8154e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.884+0000 7fbfa7e00700 1 -- 172.21.15.49:0/2823945402 shutdown_connections 2024-01-22T05:13:34.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:34.884+0000 7fbfa7e00700 1 -- 172.21.15.49:0/2823945402 wait complete. 2024-01-22T05:13:34.906 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:13:35.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.072+0000 7f2cd3e00700 1 Processor -- start 2024-01-22T05:13:35.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.072+0000 7f2cd3e00700 1 -- start start 2024-01-22T05:13:35.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.076+0000 7f2cd3e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2cd40c2ec0 0x7f2cd40c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.076+0000 7f2cd3e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2cd4063e60 0x7f2cd4064280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.076+0000 7f2cd3e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd40bd360 con 0x7f2cd40c1c50 2024-01-22T05:13:35.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.076+0000 7f2cd3e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd40c3790 con 0x7f2cd40c2ec0 2024-01-22T05:13:35.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.076+0000 7f2cd3e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd4064770 con 0x7f2cd4063e60 2024-01-22T05:13:35.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.076+0000 7f2cd2a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2cd40c2ec0 0x7f2cd40c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.076+0000 7f2cd3400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2cd40c1c50 0x7f2cd40c20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53002/0 (socket says 172.21.15.49:53002) 2024-01-22T05:13:35.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.076+0000 7f2cd3400700 1 -- 172.21.15.49:0/4069705368 learned_addr learned my addr 172.21.15.49:0/4069705368 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:35.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.076+0000 7f2cd2a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2cd40c2ec0 0x7f2cd40c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58442/0 (socket says 172.21.15.49:58442) 2024-01-22T05:13:35.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.076+0000 7f2cd2000700 1 --2- 172.21.15.49:0/4069705368 >> v2:172.21.15.110:3300/0 conn(0x7f2cd4063e60 0x7f2cd4064280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.076+0000 7f2cd2a00700 1 -- 172.21.15.49:0/4069705368 >> v2:172.21.15.110:3300/0 conn(0x7f2cd4063e60 msgr2=0x7f2cd4064280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:35.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.076+0000 7f2cd2a00700 1 --2- 172.21.15.49:0/4069705368 >> v2:172.21.15.110:3300/0 conn(0x7f2cd4063e60 0x7f2cd4064280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.076+0000 7f2cd2a00700 1 -- 172.21.15.49:0/4069705368 >> v1:172.21.15.49:6789/0 conn(0x7f2cd40c1c50 legacy=0x7f2cd40c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.076+0000 7f2cd2a00700 1 -- 172.21.15.49:0/4069705368 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd40bc750 con 0x7f2cd40c2ec0 2024-01-22T05:13:35.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.076+0000 7f2cd1600700 1 -- 172.21.15.49:0/4069705368 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490008374 0 0) 0x7f2cd40bd360 con 0x7f2cd40c1c50 2024-01-22T05:13:35.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.080+0000 7f2cd2a00700 1 --2- 172.21.15.49:0/4069705368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cd40c2ec0 0x7f2cd40c32a0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f2cd406a7b0 tx=0x7f2cc4009060).ready entity=mon.0 client_cookie=8855e5125d0ec497 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:35.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.080+0000 7f2cd1600700 1 -- 172.21.15.49:0/4069705368 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc400f510 con 0x7f2cd40c2ec0 2024-01-22T05:13:35.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.080+0000 7f2cd1600700 1 -- 172.21.15.49:0/4069705368 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc400f670 con 0x7f2cd40c2ec0 2024-01-22T05:13:35.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.080+0000 7f2cd1600700 1 -- 172.21.15.49:0/4069705368 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc400f9f0 con 0x7f2cd40c2ec0 2024-01-22T05:13:35.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.080+0000 7f2cd3e00700 1 -- 172.21.15.49:0/4069705368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cd40c2ec0 msgr2=0x7f2cd40c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.080+0000 7f2cd3e00700 1 --2- 172.21.15.49:0/4069705368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cd40c2ec0 0x7f2cd40c32a0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f2cd406a7b0 tx=0x7f2cc4009060).stop 2024-01-22T05:13:35.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.080+0000 7f2cd3e00700 1 -- 172.21.15.49:0/4069705368 shutdown_connections 2024-01-22T05:13:35.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.080+0000 7f2cd3e00700 1 --2- 172.21.15.49:0/4069705368 >> v2:172.21.15.110:3300/0 conn(0x7f2cd4063e60 0x7f2cd4064280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.080+0000 7f2cd3e00700 1 --2- 172.21.15.49:0/4069705368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cd40c2ec0 0x7f2cd40c32a0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.080+0000 7f2cd3e00700 1 -- 172.21.15.49:0/4069705368 >> 172.21.15.49:0/4069705368 conn(0x7f2cd40c8120 msgr2=0x7f2cd40c40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:35.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.080+0000 7f2cd3e00700 1 -- 172.21.15.49:0/4069705368 shutdown_connections 2024-01-22T05:13:35.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.080+0000 7f2cd3e00700 1 -- 172.21.15.49:0/4069705368 wait complete. 2024-01-22T05:13:35.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.084+0000 7f2cd3e00700 1 Processor -- start 2024-01-22T05:13:35.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.084+0000 7f2cd3e00700 1 -- start start 2024-01-22T05:13:35.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.084+0000 7f2cd3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cd4063e60 0x7f2cd416be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.084+0000 7f2cd3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd40c1c50 0x7f2cd40ad140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.084+0000 7f2cd3e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd40c2ec0 0x7f2cd4068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.084+0000 7f2cd3e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40ad630 con 0x7f2cd4063e60 2024-01-22T05:13:35.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.084+0000 7f2cd3e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd416c430 con 0x7f2cd40c1c50 2024-01-22T05:13:35.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.084+0000 7f2cd3e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd416c710 con 0x7f2cd40c2ec0 2024-01-22T05:13:35.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.084+0000 7f2cd2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cd4063e60 0x7f2cd416be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.088+0000 7f2cd2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cd4063e60 0x7f2cd416be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58444/0 (socket says 172.21.15.49:58444) 2024-01-22T05:13:35.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.088+0000 7f2cd2a00700 1 -- 172.21.15.49:0/2990443560 learned_addr learned my addr 172.21.15.49:0/2990443560 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:35.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.088+0000 7f2cd3400700 1 --2- 172.21.15.49:0/2990443560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd40c2ec0 0x7f2cd4068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.088+0000 7f2cd2000700 1 --2- 172.21.15.49:0/2990443560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd40c1c50 0x7f2cd40ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.088+0000 7f2cd2a00700 1 -- 172.21.15.49:0/2990443560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd40c2ec0 msgr2=0x7f2cd4068a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.088+0000 7f2cd2a00700 1 --2- 172.21.15.49:0/2990443560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd40c2ec0 0x7f2cd4068a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.088+0000 7f2cd2a00700 1 -- 172.21.15.49:0/2990443560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd40c1c50 msgr2=0x7f2cd40ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.088+0000 7f2cd2a00700 1 --2- 172.21.15.49:0/2990443560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd40c1c50 0x7f2cd40ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.088+0000 7f2cd2a00700 1 -- 172.21.15.49:0/2990443560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc40092a0 con 0x7f2cd4063e60 2024-01-22T05:13:35.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.088+0000 7f2cd2a00700 1 --2- 172.21.15.49:0/2990443560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cd4063e60 0x7f2cd416be70 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f2cc4009dd0 tx=0x7f2cc4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:35.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.088+0000 7f2cca000700 1 -- 172.21.15.49:0/2990443560 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc400f7e0 con 0x7f2cd4063e60 2024-01-22T05:13:35.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.088+0000 7f2cca000700 1 -- 172.21.15.49:0/2990443560 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc400f940 con 0x7f2cd4063e60 2024-01-22T05:13:35.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.088+0000 7f2cd3e00700 1 -- 172.21.15.49:0/2990443560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd416c9f0 con 0x7f2cd4063e60 2024-01-22T05:13:35.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.088+0000 7f2cca000700 1 -- 172.21.15.49:0/2990443560 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc401b660 con 0x7f2cd4063e60 2024-01-22T05:13:35.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.088+0000 7f2cd3e00700 1 -- 172.21.15.49:0/2990443560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd40a79b0 con 0x7f2cd4063e60 2024-01-22T05:13:35.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.092+0000 7f2cd3e00700 1 -- 172.21.15.49:0/2990443560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd4065990 con 0x7f2cd4063e60 2024-01-22T05:13:35.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.092+0000 7f2cca000700 1 -- 172.21.15.49:0/2990443560 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2cc401ba10 con 0x7f2cd4063e60 2024-01-22T05:13:35.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.092+0000 7f2cca000700 1 --2- 172.21.15.49:0/2990443560 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2cac05a510 0x7f2cac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.092+0000 7f2cca000700 1 -- 172.21.15.49:0/2990443560 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f2cc4076150 con 0x7f2cd4063e60 2024-01-22T05:13:35.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.092+0000 7f2cd2000700 1 --2- 172.21.15.49:0/2990443560 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2cac05a510 0x7f2cac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.096+0000 7f2cd2000700 1 --2- 172.21.15.49:0/2990443560 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2cac05a510 0x7f2cac05c9d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f2cd416c360 tx=0x7f2cbc008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:35.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.096+0000 7f2cca000700 1 -- 172.21.15.49:0/2990443560 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2cc4049a00 con 0x7f2cd4063e60 2024-01-22T05:13:35.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.264+0000 7f2cd3e00700 1 -- 172.21.15.49:0/2990443560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2cd40bca30 con 0x7f2cd4063e60 2024-01-22T05:13:35.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.268+0000 7f2cca000700 1 -- 172.21.15.49:0/2990443560 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v113) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2cc4028020 con 0x7f2cd4063e60 2024-01-22T05:13:35.269 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:13:35.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.268+0000 7f2cd3e00700 1 -- 172.21.15.49:0/2990443560 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2cac05a510 msgr2=0x7f2cac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.268+0000 7f2cd3e00700 1 --2- 172.21.15.49:0/2990443560 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2cac05a510 0x7f2cac05c9d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f2cd416c360 tx=0x7f2cbc008040).stop 2024-01-22T05:13:35.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.268+0000 7f2cd3e00700 1 -- 172.21.15.49:0/2990443560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cd4063e60 msgr2=0x7f2cd416be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.268+0000 7f2cd3e00700 1 --2- 172.21.15.49:0/2990443560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cd4063e60 0x7f2cd416be70 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f2cc4009dd0 tx=0x7f2cc4017000).stop 2024-01-22T05:13:35.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.272+0000 7f2cd3e00700 1 -- 172.21.15.49:0/2990443560 shutdown_connections 2024-01-22T05:13:35.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.272+0000 7f2cd3e00700 1 --2- 172.21.15.49:0/2990443560 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2cac05a510 0x7f2cac05c9d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.272+0000 7f2cd3e00700 1 --2- 172.21.15.49:0/2990443560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd40c2ec0 0x7f2cd4068a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.272+0000 7f2cd3e00700 1 --2- 172.21.15.49:0/2990443560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd40c1c50 0x7f2cd40ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.272+0000 7f2cd3e00700 1 --2- 172.21.15.49:0/2990443560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cd4063e60 0x7f2cd416be70 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.272+0000 7f2cd3e00700 1 -- 172.21.15.49:0/2990443560 >> 172.21.15.49:0/2990443560 conn(0x7f2cd40c8120 msgr2=0x7f2cd415a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:35.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.272+0000 7f2cd3e00700 1 -- 172.21.15.49:0/2990443560 shutdown_connections 2024-01-22T05:13:35.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.272+0000 7f2cd3e00700 1 -- 172.21.15.49:0/2990443560 wait complete. 2024-01-22T05:13:35.294 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:13:35.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.456+0000 7f152b200700 1 Processor -- start 2024-01-22T05:13:35.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.456+0000 7f152b200700 1 -- start start 2024-01-22T05:13:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f152b200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1524065660 0x7f15240a6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f152b200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15240644f0 0x7f1524064950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f152b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15241575b0 0x7f1524157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f152b200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15240c2700 con 0x7f15240644f0 2024-01-22T05:13:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f152b200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1524064e40 con 0x7f1524065660 2024-01-22T05:13:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f152b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15240c2930 con 0x7f15241575b0 2024-01-22T05:13:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f1523400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15240644f0 0x7f1524064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f1523e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1524065660 0x7f15240a6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f1523400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15240644f0 0x7f1524064950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58448/0 (socket says 172.21.15.49:58448) 2024-01-22T05:13:35.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f1523400700 1 -- 172.21.15.49:0/3098036036 learned_addr learned my addr 172.21.15.49:0/3098036036 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:35.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f1529c00700 1 --2- 172.21.15.49:0/3098036036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15241575b0 0x7f1524157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f1523e00700 1 -- 172.21.15.49:0/3098036036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15241575b0 msgr2=0x7f1524157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:35.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f1523e00700 1 --2- 172.21.15.49:0/3098036036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15241575b0 0x7f1524157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f1523e00700 1 -- 172.21.15.49:0/3098036036 >> v2:172.21.15.49:3300/0 conn(0x7f15240644f0 msgr2=0x7f1524064950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:35.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f1523e00700 1 --2- 172.21.15.49:0/3098036036 >> v2:172.21.15.49:3300/0 conn(0x7f15240644f0 0x7f1524064950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f1523e00700 1 -- 172.21.15.49:0/3098036036 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15240c2c10 con 0x7f1524065660 2024-01-22T05:13:35.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f1523e00700 1 --2- 172.21.15.49:0/3098036036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1524065660 0x7f15240a6f40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f1524066410 tx=0x7f1514009060).ready entity=mon.1 client_cookie=19ee7690859a9385 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:35.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f1522a00700 1 -- 172.21.15.49:0/3098036036 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151400f510 con 0x7f1524065660 2024-01-22T05:13:35.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f1522a00700 1 -- 172.21.15.49:0/3098036036 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151400f670 con 0x7f1524065660 2024-01-22T05:13:35.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.460+0000 7f1522a00700 1 -- 172.21.15.49:0/3098036036 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151400f9f0 con 0x7f1524065660 2024-01-22T05:13:35.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.464+0000 7f152b200700 1 -- 172.21.15.49:0/3098036036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1524065660 msgr2=0x7f15240a6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.464+0000 7f152b200700 1 --2- 172.21.15.49:0/3098036036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1524065660 0x7f15240a6f40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f1524066410 tx=0x7f1514009060).stop 2024-01-22T05:13:35.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.464+0000 7f152b200700 1 -- 172.21.15.49:0/3098036036 shutdown_connections 2024-01-22T05:13:35.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.464+0000 7f152b200700 1 --2- 172.21.15.49:0/3098036036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15241575b0 0x7f1524157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.464+0000 7f152b200700 1 --2- 172.21.15.49:0/3098036036 >> v2:172.21.15.49:3300/0 conn(0x7f15240644f0 0x7f1524064950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.464+0000 7f152b200700 1 --2- 172.21.15.49:0/3098036036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1524065660 0x7f15240a6f40 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.464+0000 7f152b200700 1 -- 172.21.15.49:0/3098036036 >> 172.21.15.49:0/3098036036 conn(0x7f15240c87f0 msgr2=0x7f15240c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:35.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.464+0000 7f152b200700 1 -- 172.21.15.49:0/3098036036 shutdown_connections 2024-01-22T05:13:35.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.464+0000 7f152b200700 1 -- 172.21.15.49:0/3098036036 wait complete. 2024-01-22T05:13:35.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.464+0000 7f152b200700 1 Processor -- start 2024-01-22T05:13:35.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.464+0000 7f152b200700 1 -- start start 2024-01-22T05:13:35.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f152b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15240644f0 0x7f1524148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f152b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1524065660 0x7f15240a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f152b200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15241575b0 0x7f15240aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f152b200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15240a9570 con 0x7f15241575b0 2024-01-22T05:13:35.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f152b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15240a8960 con 0x7f15240644f0 2024-01-22T05:13:35.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f152b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15240a8c40 con 0x7f1524065660 2024-01-22T05:13:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f1529c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15241575b0 0x7f15240aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f1529c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15241575b0 0x7f15240aacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58450/0 (socket says 172.21.15.49:58450) 2024-01-22T05:13:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f1529c00700 1 -- 172.21.15.49:0/3527011940 learned_addr learned my addr 172.21.15.49:0/3527011940 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f1523400700 1 --2- 172.21.15.49:0/3527011940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1524065660 0x7f15240a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f1523e00700 1 --2- 172.21.15.49:0/3527011940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15240644f0 0x7f1524148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f1529c00700 1 -- 172.21.15.49:0/3527011940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1524065660 msgr2=0x7f15240a7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f1529c00700 1 --2- 172.21.15.49:0/3527011940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1524065660 0x7f15240a7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f1529c00700 1 -- 172.21.15.49:0/3527011940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15240644f0 msgr2=0x7f1524148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f1529c00700 1 --2- 172.21.15.49:0/3527011940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15240644f0 0x7f1524148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f1529c00700 1 -- 172.21.15.49:0/3527011940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15140092a0 con 0x7f15241575b0 2024-01-22T05:13:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f1529c00700 1 --2- 172.21.15.49:0/3527011940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15241575b0 0x7f15240aacd0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f151c007f20 tx=0x7f151c009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:35.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f151b400700 1 -- 172.21.15.49:0/3527011940 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00eb90 con 0x7f15241575b0 2024-01-22T05:13:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f151b400700 1 -- 172.21.15.49:0/3527011940 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c00ecf0 con 0x7f15241575b0 2024-01-22T05:13:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f152b200700 1 -- 172.21.15.49:0/3527011940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15240a8f20 con 0x7f15241575b0 2024-01-22T05:13:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.468+0000 7f151b400700 1 -- 172.21.15.49:0/3527011940 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c014610 con 0x7f15241575b0 2024-01-22T05:13:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.472+0000 7f152b200700 1 -- 172.21.15.49:0/3527011940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15240bf4b0 con 0x7f15241575b0 2024-01-22T05:13:35.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.472+0000 7f152b200700 1 -- 172.21.15.49:0/3527011940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1524047060 con 0x7f15241575b0 2024-01-22T05:13:35.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.476+0000 7f151b400700 1 -- 172.21.15.49:0/3527011940 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f151c014980 con 0x7f15241575b0 2024-01-22T05:13:35.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.476+0000 7f151b400700 1 --2- 172.21.15.49:0/3527011940 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f14fc05a510 0x7f14fc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.476+0000 7f151b400700 1 -- 172.21.15.49:0/3527011940 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f151c0748f0 con 0x7f15241575b0 2024-01-22T05:13:35.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.476+0000 7f1523e00700 1 --2- 172.21.15.49:0/3527011940 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f14fc05a510 0x7f14fc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.476+0000 7f1523e00700 1 --2- 172.21.15.49:0/3527011940 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f14fc05a510 0x7f14fc05c9d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f1524066410 tx=0x7f1514017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:35.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.480+0000 7f151b400700 1 -- 172.21.15.49:0/3527011940 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f151c0482c0 con 0x7f15241575b0 2024-01-22T05:13:35.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.648+0000 7f152b200700 1 -- 172.21.15.49:0/3527011940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f15240c2ef0 con 0x7f15241575b0 2024-01-22T05:13:35.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.648+0000 7f151b400700 1 -- 172.21.15.49:0/3527011940 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v113) v1 ==== 84+0+143 (secure 0 0 0) 0x7f151c00ee60 con 0x7f15241575b0 2024-01-22T05:13:35.651 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:35.651 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-22T05:13:35.651 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:35.651 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-01-22T05:13:35.651 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2024-01-22T05:13:35.652 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:13:35.652 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:13:35.652 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2024-01-22T05:13:35.652 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2024-01-22T05:13:35.652 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:13:35.652 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-22T05:13:35.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.652+0000 7f152b200700 1 -- 172.21.15.49:0/3527011940 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f14fc05a510 msgr2=0x7f14fc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.652+0000 7f152b200700 1 --2- 172.21.15.49:0/3527011940 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f14fc05a510 0x7f14fc05c9d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f1524066410 tx=0x7f1514017000).stop 2024-01-22T05:13:35.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.652+0000 7f152b200700 1 -- 172.21.15.49:0/3527011940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15241575b0 msgr2=0x7f15240aacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.652+0000 7f152b200700 1 --2- 172.21.15.49:0/3527011940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15241575b0 0x7f15240aacd0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f151c007f20 tx=0x7f151c009860).stop 2024-01-22T05:13:35.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.656+0000 7f152b200700 1 -- 172.21.15.49:0/3527011940 shutdown_connections 2024-01-22T05:13:35.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.656+0000 7f152b200700 1 --2- 172.21.15.49:0/3527011940 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f14fc05a510 0x7f14fc05c9d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.656+0000 7f152b200700 1 --2- 172.21.15.49:0/3527011940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15241575b0 0x7f15240aacd0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.656+0000 7f152b200700 1 --2- 172.21.15.49:0/3527011940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1524065660 0x7f15240a7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.656+0000 7f152b200700 1 --2- 172.21.15.49:0/3527011940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15240644f0 0x7f1524148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.656+0000 7f152b200700 1 -- 172.21.15.49:0/3527011940 >> 172.21.15.49:0/3527011940 conn(0x7f15240c87f0 msgr2=0x7f15240a38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:35.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.656+0000 7f152b200700 1 -- 172.21.15.49:0/3527011940 shutdown_connections 2024-01-22T05:13:35.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.656+0000 7f152b200700 1 -- 172.21.15.49:0/3527011940 wait complete. 2024-01-22T05:13:35.678 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:13:35.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:13:35.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.840+0000 7f6c2ea00700 1 Processor -- start 2024-01-22T05:13:35.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.840+0000 7f6c2ea00700 1 -- start start 2024-01-22T05:13:35.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.844+0000 7f6c2ea00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6c280bbf50 0x7f6c280bc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.844+0000 7f6c2ea00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c281561f0 con 0x7f6c280a9130 2024-01-22T05:13:35.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.844+0000 7f6c2ea00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c280bc860 con 0x7f6c28148040 2024-01-22T05:13:35.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.844+0000 7f6c2ea00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c28059bb0 con 0x7f6c280bbf50 2024-01-22T05:13:35.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.844+0000 7f6c2d600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6c280a9130 0x7f6c28152900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53004/0 (socket says 172.21.15.49:53004) 2024-01-22T05:13:35.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.844+0000 7f6c2d600700 1 -- 172.21.15.49:0/311198873 learned_addr learned my addr 172.21.15.49:0/311198873 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:35.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.844+0000 7f6c2cc00700 1 --2- 172.21.15.49:0/311198873 >> v2:172.21.15.110:3300/0 conn(0x7f6c280bbf50 0x7f6c280bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c27e00700 1 -- 172.21.15.49:0/311198873 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971207071 0 0) 0x7f6c281561f0 con 0x7f6c280a9130 2024-01-22T05:13:35.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c27e00700 1 -- 172.21.15.49:0/311198873 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c080033f0 con 0x7f6c280a9130 2024-01-22T05:13:35.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c27e00700 1 -- 172.21.15.49:0/311198873 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014865791 0 0) 0x7f6c280bc860 con 0x7f6c28148040 2024-01-22T05:13:35.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c27e00700 1 -- 172.21.15.49:0/311198873 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c281561f0 con 0x7f6c28148040 2024-01-22T05:13:35.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c2cc00700 1 -- 172.21.15.49:0/311198873 >> v1:172.21.15.110:6789/0 conn(0x7f6c28148040 legacy=0x7f6c28148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c2cc00700 1 -- 172.21.15.49:0/311198873 >> v1:172.21.15.49:6789/0 conn(0x7f6c280a9130 legacy=0x7f6c28152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c2cc00700 1 -- 172.21.15.49:0/311198873 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c281555e0 con 0x7f6c280bbf50 2024-01-22T05:13:35.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c2cc00700 1 --2- 172.21.15.49:0/311198873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c280bbf50 0x7f6c280bc370 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f6c10009760 tx=0x7f6c10009060).ready entity=mon.1 client_cookie=521d2b9529bd32e5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:35.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c27e00700 1 -- 172.21.15.49:0/311198873 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000d4a0 con 0x7f6c280bbf50 2024-01-22T05:13:35.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c27e00700 1 -- 172.21.15.49:0/311198873 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1000d600 con 0x7f6c280bbf50 2024-01-22T05:13:35.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c27e00700 1 -- 172.21.15.49:0/311198873 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000d980 con 0x7f6c280bbf50 2024-01-22T05:13:35.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c2ea00700 1 -- 172.21.15.49:0/311198873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c280bbf50 msgr2=0x7f6c280bc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c2ea00700 1 --2- 172.21.15.49:0/311198873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c280bbf50 0x7f6c280bc370 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f6c10009760 tx=0x7f6c10009060).stop 2024-01-22T05:13:35.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c2ea00700 1 -- 172.21.15.49:0/311198873 shutdown_connections 2024-01-22T05:13:35.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c2ea00700 1 --2- 172.21.15.49:0/311198873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c280bbf50 0x7f6c280bc370 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.848+0000 7f6c2ea00700 1 -- 172.21.15.49:0/311198873 >> 172.21.15.49:0/311198873 conn(0x7f6c280c3880 msgr2=0x7f6c280c3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:35.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.852+0000 7f6c2ea00700 1 -- 172.21.15.49:0/311198873 shutdown_connections 2024-01-22T05:13:35.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.852+0000 7f6c2ea00700 1 -- 172.21.15.49:0/311198873 wait complete. 2024-01-22T05:13:35.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2ea00700 1 Processor -- start 2024-01-22T05:13:35.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2ea00700 1 -- start start 2024-01-22T05:13:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c280a9130 0x7f6c280a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c280bbf50 0x7f6c280a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c28148040 0x7f6c28166f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2ea00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c280a5d40 con 0x7f6c280bbf50 2024-01-22T05:13:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2ea00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c28167460 con 0x7f6c280a9130 2024-01-22T05:13:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2ea00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c280c1ad0 con 0x7f6c28148040 2024-01-22T05:13:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c280bbf50 0x7f6c280a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c280bbf50 0x7f6c280a5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58464/0 (socket says 172.21.15.49:58464) 2024-01-22T05:13:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2cc00700 1 -- 172.21.15.49:0/1979699935 learned_addr learned my addr 172.21.15.49:0/1979699935 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2e000700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c28148040 0x7f6c28166f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2d600700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c280a9130 0x7f6c280a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2cc00700 1 -- 172.21.15.49:0/1979699935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c28148040 msgr2=0x7f6c28166f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2cc00700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c28148040 0x7f6c28166f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2cc00700 1 -- 172.21.15.49:0/1979699935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c280a9130 msgr2=0x7f6c280a9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2cc00700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c280a9130 0x7f6c280a9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2cc00700 1 -- 172.21.15.49:0/1979699935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c100092a0 con 0x7f6c280bbf50 2024-01-22T05:13:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2e000700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c28148040 0x7f6c28166f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.856+0000 7f6c2d600700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c280a9130 0x7f6c280a9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.860+0000 7f6c2cc00700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c280bbf50 0x7f6c280a5850 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f6c280c36e0 tx=0x7f6c10016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:35.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.860+0000 7f6c24c00700 1 -- 172.21.15.49:0/1979699935 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000d770 con 0x7f6c280bbf50 2024-01-22T05:13:35.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.860+0000 7f6c24c00700 1 -- 172.21.15.49:0/1979699935 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1000d8d0 con 0x7f6c280bbf50 2024-01-22T05:13:35.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.860+0000 7f6c2ea00700 1 -- 172.21.15.49:0/1979699935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c280a5f20 con 0x7f6c280bbf50 2024-01-22T05:13:35.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.860+0000 7f6c24c00700 1 -- 172.21.15.49:0/1979699935 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1001d660 con 0x7f6c280bbf50 2024-01-22T05:13:35.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.860+0000 7f6c2ea00700 1 -- 172.21.15.49:0/1979699935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c280c1480 con 0x7f6c280bbf50 2024-01-22T05:13:35.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.860+0000 7f6c2ea00700 1 -- 172.21.15.49:0/1979699935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c28064e70 con 0x7f6c280bbf50 2024-01-22T05:13:35.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.864+0000 7f6c24c00700 1 -- 172.21.15.49:0/1979699935 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6c1001da50 con 0x7f6c280bbf50 2024-01-22T05:13:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.864+0000 7f6c24c00700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6c0005a510 0x7f6c0005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.864+0000 7f6c24c00700 1 -- 172.21.15.49:0/1979699935 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f6c10075e00 con 0x7f6c280bbf50 2024-01-22T05:13:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.864+0000 7f6c2d600700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6c0005a510 0x7f6c0005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.864+0000 7f6c2d600700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6c0005a510 0x7f6c0005c9d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f6c18005750 tx=0x7f6c18009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:35.868+0000 7f6c24c00700 1 -- 172.21.15.49:0/1979699935 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6c10049710 con 0x7f6c280bbf50 2024-01-22T05:13:36.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.036+0000 7f6c2ea00700 1 -- 172.21.15.49:0/1979699935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f6c28046800 con 0x7f6c280bbf50 2024-01-22T05:13:36.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.508+0000 7f6c24c00700 1 -- 172.21.15.49:0/1979699935 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v114) v1 ==== 152+0+0 (secure 0 0 0) 0x7f6c1004cd30 con 0x7f6c280bbf50 2024-01-22T05:13:36.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.516+0000 7f6c2ea00700 1 -- 172.21.15.49:0/1979699935 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6c0005a510 msgr2=0x7f6c0005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:36.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.516+0000 7f6c2ea00700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6c0005a510 0x7f6c0005c9d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f6c18005750 tx=0x7f6c18009040).stop 2024-01-22T05:13:36.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.516+0000 7f6c2ea00700 1 -- 172.21.15.49:0/1979699935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c280bbf50 msgr2=0x7f6c280a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:36.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.516+0000 7f6c2ea00700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c280bbf50 0x7f6c280a5850 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f6c280c36e0 tx=0x7f6c10016000).stop 2024-01-22T05:13:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.516+0000 7f6c2ea00700 1 -- 172.21.15.49:0/1979699935 shutdown_connections 2024-01-22T05:13:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.516+0000 7f6c2ea00700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6c0005a510 0x7f6c0005c9d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.516+0000 7f6c2ea00700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c28148040 0x7f6c28166f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.516+0000 7f6c2ea00700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c280bbf50 0x7f6c280a5850 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.516+0000 7f6c2ea00700 1 --2- 172.21.15.49:0/1979699935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c280a9130 0x7f6c280a9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.516+0000 7f6c2ea00700 1 -- 172.21.15.49:0/1979699935 >> 172.21.15.49:0/1979699935 conn(0x7f6c280c3880 msgr2=0x7f6c280a8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.516+0000 7f6c2ea00700 1 -- 172.21.15.49:0/1979699935 shutdown_connections 2024-01-22T05:13:36.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.520+0000 7f6c2ea00700 1 -- 172.21.15.49:0/1979699935 wait complete. 2024-01-22T05:13:36.527 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-01-22T05:13:36.543 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:13:36.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.716+0000 7f3deb800700 1 Processor -- start 2024-01-22T05:13:36.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.716+0000 7f3deb800700 1 -- start start 2024-01-22T05:13:36.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3deb800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3de40a8c20 0x7f3de40c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:36.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3deb800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de40bcbe0 0x7f3de4068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:36.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3deb800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de4158650 con 0x7f3de40c1ac0 2024-01-22T05:13:36.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3deb800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de40c1f20 con 0x7f3de40a8c20 2024-01-22T05:13:36.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3deb800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40bd170 con 0x7f3de40bcbe0 2024-01-22T05:13:36.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3de8e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3de40a8c20 0x7f3de40c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:36.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3de3e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3de40c1ac0 0x7f3de40bc4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:40798/0 (socket says 172.21.15.49:40798) 2024-01-22T05:13:36.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3de3e00700 1 -- 172.21.15.49:0/2178665406 learned_addr learned my addr 172.21.15.49:0/2178665406 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:36.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3de9800700 1 --2- 172.21.15.49:0/2178665406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de40bcbe0 0x7f3de4068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3de3400700 1 -- 172.21.15.49:0/2178665406 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202500329 0 0) 0x7f3dcc001160 con 0x7f3de40c1ac0 2024-01-22T05:13:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3de3400700 1 -- 172.21.15.49:0/2178665406 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc40033f0 con 0x7f3de40c1ac0 2024-01-22T05:13:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3de9800700 1 -- 172.21.15.49:0/2178665406 >> v2:172.21.15.49:3300/0 conn(0x7f3de40a8c20 msgr2=0x7f3de40c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3de9800700 1 --2- 172.21.15.49:0/2178665406 >> v2:172.21.15.49:3300/0 conn(0x7f3de40a8c20 0x7f3de40c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3de9800700 1 -- 172.21.15.49:0/2178665406 >> v1:172.21.15.110:6789/0 conn(0x7f3de40c1ac0 legacy=0x7f3de40bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3de9800700 1 -- 172.21.15.49:0/2178665406 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de4067c30 con 0x7f3de40bcbe0 2024-01-22T05:13:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3de8e00700 1 --2- 172.21.15.49:0/2178665406 >> v2:172.21.15.49:3300/0 conn(0x7f3de40a8c20 0x7f3de40c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3de9800700 1 --2- 172.21.15.49:0/2178665406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de40bcbe0 0x7f3de4068710 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f3ddc009e60 tx=0x7f3ddc009780).ready entity=mon.2 client_cookie=bba528104140d3f0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3de3400700 1 -- 172.21.15.49:0/2178665406 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc00e070 con 0x7f3de40bcbe0 2024-01-22T05:13:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3de3400700 1 -- 172.21.15.49:0/2178665406 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc00bab0 con 0x7f3de40bcbe0 2024-01-22T05:13:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.720+0000 7f3de3400700 1 -- 172.21.15.49:0/2178665406 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc00be30 con 0x7f3de40bcbe0 2024-01-22T05:13:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.724+0000 7f3deb800700 1 -- 172.21.15.49:0/2178665406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de40bcbe0 msgr2=0x7f3de4068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.724+0000 7f3deb800700 1 --2- 172.21.15.49:0/2178665406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de40bcbe0 0x7f3de4068710 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f3ddc009e60 tx=0x7f3ddc009780).stop 2024-01-22T05:13:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.724+0000 7f3deb800700 1 -- 172.21.15.49:0/2178665406 shutdown_connections 2024-01-22T05:13:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.724+0000 7f3deb800700 1 --2- 172.21.15.49:0/2178665406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de40bcbe0 0x7f3de4068710 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.724+0000 7f3deb800700 1 --2- 172.21.15.49:0/2178665406 >> v2:172.21.15.49:3300/0 conn(0x7f3de40a8c20 0x7f3de40c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.724+0000 7f3deb800700 1 -- 172.21.15.49:0/2178665406 >> 172.21.15.49:0/2178665406 conn(0x7f3de4062cb0 msgr2=0x7f3de40c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.724+0000 7f3deb800700 1 -- 172.21.15.49:0/2178665406 shutdown_connections 2024-01-22T05:13:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.724+0000 7f3deb800700 1 -- 172.21.15.49:0/2178665406 wait complete. 2024-01-22T05:13:36.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.728+0000 7f3deb800700 1 Processor -- start 2024-01-22T05:13:36.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.728+0000 7f3deb800700 1 -- start start 2024-01-22T05:13:36.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3deb800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de40a8c20 0x7f3de40a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:36.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3deb800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de40bcbe0 0x7f3de40c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:36.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3deb800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de40c1ac0 0x7f3de40c3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:36.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3deb800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40aaeb0 con 0x7f3de40c1ac0 2024-01-22T05:13:36.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3deb800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40c3940 con 0x7f3de40bcbe0 2024-01-22T05:13:36.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3deb800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de415b020 con 0x7f3de40a8c20 2024-01-22T05:13:36.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3de9800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de40c1ac0 0x7f3de40c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:36.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3de9800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de40c1ac0 0x7f3de40c3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58482/0 (socket says 172.21.15.49:58482) 2024-01-22T05:13:36.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3de9800700 1 -- 172.21.15.49:0/1549888441 learned_addr learned my addr 172.21.15.49:0/1549888441 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:36.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3de8e00700 1 --2- 172.21.15.49:0/1549888441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de40a8c20 0x7f3de40a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:36.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3de3e00700 1 --2- 172.21.15.49:0/1549888441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de40bcbe0 0x7f3de40c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:36.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3de9800700 1 -- 172.21.15.49:0/1549888441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de40a8c20 msgr2=0x7f3de40a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:36.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3de9800700 1 --2- 172.21.15.49:0/1549888441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de40a8c20 0x7f3de40a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:36.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3de9800700 1 -- 172.21.15.49:0/1549888441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de40bcbe0 msgr2=0x7f3de40c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:36.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3de9800700 1 --2- 172.21.15.49:0/1549888441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de40bcbe0 0x7f3de40c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:36.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3de9800700 1 -- 172.21.15.49:0/1549888441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd40092a0 con 0x7f3de40c1ac0 2024-01-22T05:13:36.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3de3e00700 1 --2- 172.21.15.49:0/1549888441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de40bcbe0 0x7f3de40c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:36.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3de9800700 1 --2- 172.21.15.49:0/1549888441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de40c1ac0 0x7f3de40c3450 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f3ddc012cb0 tx=0x7f3ddc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:36.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3ddbe00700 1 -- 172.21.15.49:0/1549888441 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc01d630 con 0x7f3de40c1ac0 2024-01-22T05:13:36.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3ddbe00700 1 -- 172.21.15.49:0/1549888441 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc01d790 con 0x7f3de40c1ac0 2024-01-22T05:13:36.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3deb800700 1 -- 172.21.15.49:0/1549888441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ddc009a20 con 0x7f3de40c1ac0 2024-01-22T05:13:36.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3ddbe00700 1 -- 172.21.15.49:0/1549888441 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc01db30 con 0x7f3de40c1ac0 2024-01-22T05:13:36.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.732+0000 7f3deb800700 1 -- 172.21.15.49:0/1549888441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de415a6f0 con 0x7f3de40c1ac0 2024-01-22T05:13:36.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.736+0000 7f3deb800700 1 -- 172.21.15.49:0/1549888441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de415b190 con 0x7f3de40c1ac0 2024-01-22T05:13:36.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.736+0000 7f3ddbe00700 1 -- 172.21.15.49:0/1549888441 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3ddc026410 con 0x7f3de40c1ac0 2024-01-22T05:13:36.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.740+0000 7f3ddbe00700 1 --2- 172.21.15.49:0/1549888441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3dbc05a540 0x7f3dbc05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:36.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.740+0000 7f3ddbe00700 1 -- 172.21.15.49:0/1549888441 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5992+0+0 (secure 0 0 0) 0x7f3ddc076600 con 0x7f3de40c1ac0 2024-01-22T05:13:36.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.740+0000 7f3de8e00700 1 --2- 172.21.15.49:0/1549888441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3dbc05a540 0x7f3dbc05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:36.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.740+0000 7f3de8e00700 1 --2- 172.21.15.49:0/1549888441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3dbc05a540 0x7f3dbc05ca00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f3dd4009dc0 tx=0x7f3dd4009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:36.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.744+0000 7f3ddbe00700 1 -- 172.21.15.49:0/1549888441 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3ddc049d40 con 0x7f3de40c1ac0 2024-01-22T05:13:36.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:36.916+0000 7f3deb800700 1 -- 172.21.15.49:0/1549888441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3de4067f10 con 0x7f3de40c1ac0 2024-01-22T05:13:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.524+0000 7f3ddbe00700 1 -- 172.21.15.49:0/1549888441 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v115) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3ddc04d360 con 0x7f3de40c1ac0 2024-01-22T05:13:37.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.532+0000 7f3deb800700 1 -- 172.21.15.49:0/1549888441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3dbc05a540 msgr2=0x7f3dbc05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.532+0000 7f3deb800700 1 --2- 172.21.15.49:0/1549888441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3dbc05a540 0x7f3dbc05ca00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f3dd4009dc0 tx=0x7f3dd4009060).stop 2024-01-22T05:13:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.532+0000 7f3deb800700 1 -- 172.21.15.49:0/1549888441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de40c1ac0 msgr2=0x7f3de40c3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.532+0000 7f3deb800700 1 --2- 172.21.15.49:0/1549888441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de40c1ac0 0x7f3de40c3450 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f3ddc012cb0 tx=0x7f3ddc009780).stop 2024-01-22T05:13:37.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.536+0000 7f3deb800700 1 -- 172.21.15.49:0/1549888441 shutdown_connections 2024-01-22T05:13:37.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.536+0000 7f3deb800700 1 --2- 172.21.15.49:0/1549888441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3dbc05a540 0x7f3dbc05ca00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:37.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.536+0000 7f3deb800700 1 --2- 172.21.15.49:0/1549888441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de40c1ac0 0x7f3de40c3450 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:37.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.536+0000 7f3deb800700 1 --2- 172.21.15.49:0/1549888441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de40bcbe0 0x7f3de40c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:37.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.536+0000 7f3deb800700 1 --2- 172.21.15.49:0/1549888441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3de40a8c20 0x7f3de40a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:37.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.536+0000 7f3deb800700 1 -- 172.21.15.49:0/1549888441 >> 172.21.15.49:0/1549888441 conn(0x7f3de4062cb0 msgr2=0x7f3de40bc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:37.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.540+0000 7f3deb800700 1 -- 172.21.15.49:0/1549888441 shutdown_connections 2024-01-22T05:13:37.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.540+0000 7f3deb800700 1 -- 172.21.15.49:0/1549888441 wait complete. 2024-01-22T05:13:37.565 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-01-22T05:13:37.585 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:13:37.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.752+0000 7f774e800700 1 Processor -- start 2024-01-22T05:13:37.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.756+0000 7f774e800700 1 -- start start 2024-01-22T05:13:37.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.756+0000 7f774e800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7748151b90 0x7f7748068460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:37.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f774e800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77480bdb20 con 0x7f77480c3dd0 2024-01-22T05:13:37.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f774e800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7748069490 con 0x7f7748068950 2024-01-22T05:13:37.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f774e800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7748068ed0 con 0x7f7748151b90 2024-01-22T05:13:37.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f7747e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f77480c3dd0 0x7f774815b5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53016/0 (socket says 172.21.15.49:53016) 2024-01-22T05:13:37.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f7747e00700 1 -- 172.21.15.49:0/1808227030 learned_addr learned my addr 172.21.15.49:0/1808227030 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:37.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f7747400700 1 --2- 172.21.15.49:0/1808227030 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7748151b90 0x7f7748068460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:37.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f7746000700 1 -- 172.21.15.49:0/1808227030 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157088532 0 0) 0x7f77480bdb20 con 0x7f77480c3dd0 2024-01-22T05:13:37.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f7746000700 1 -- 172.21.15.49:0/1808227030 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77280033f0 con 0x7f77480c3dd0 2024-01-22T05:13:37.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f7746000700 1 -- 172.21.15.49:0/1808227030 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899386509 0 0) 0x7f7748069490 con 0x7f7748068950 2024-01-22T05:13:37.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f7746000700 1 -- 172.21.15.49:0/1808227030 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77480bdb20 con 0x7f7748068950 2024-01-22T05:13:37.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f7746000700 1 -- 172.21.15.49:0/1808227030 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2528398537 0 0) 0x7f77280033f0 con 0x7f77480c3dd0 2024-01-22T05:13:37.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f7747400700 1 -- 172.21.15.49:0/1808227030 >> v1:172.21.15.110:6789/0 conn(0x7f7748068950 legacy=0x7f77480c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:37.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f7747400700 1 -- 172.21.15.49:0/1808227030 >> v1:172.21.15.49:6789/0 conn(0x7f77480c3dd0 legacy=0x7f774815b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:37.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f7747400700 1 -- 172.21.15.49:0/1808227030 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77480691b0 con 0x7f7748151b90 2024-01-22T05:13:37.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f7747400700 1 --2- 172.21.15.49:0/1808227030 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7748151b90 0x7f7748068460 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f7738009790 tx=0x7f7738009060).ready entity=mon.2 client_cookie=c8891c21210a62ba server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:37.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f7746000700 1 -- 172.21.15.49:0/1808227030 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400017f0 con 0x7f7748151b90 2024-01-22T05:13:37.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f7746000700 1 -- 172.21.15.49:0/1808227030 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7738011400 con 0x7f7748151b90 2024-01-22T05:13:37.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.760+0000 7f7746000700 1 -- 172.21.15.49:0/1808227030 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738011780 con 0x7f7748151b90 2024-01-22T05:13:37.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.764+0000 7f774e800700 1 -- 172.21.15.49:0/1808227030 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7748151b90 msgr2=0x7f7748068460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:37.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.764+0000 7f774e800700 1 --2- 172.21.15.49:0/1808227030 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7748151b90 0x7f7748068460 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f7738009790 tx=0x7f7738009060).stop 2024-01-22T05:13:37.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.764+0000 7f774e800700 1 -- 172.21.15.49:0/1808227030 shutdown_connections 2024-01-22T05:13:37.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.764+0000 7f774e800700 1 --2- 172.21.15.49:0/1808227030 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7748151b90 0x7f7748068460 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:37.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.764+0000 7f774e800700 1 -- 172.21.15.49:0/1808227030 >> 172.21.15.49:0/1808227030 conn(0x7f77480c87b0 msgr2=0x7f77480c8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:37.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.764+0000 7f774e800700 1 -- 172.21.15.49:0/1808227030 shutdown_connections 2024-01-22T05:13:37.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.764+0000 7f774e800700 1 -- 172.21.15.49:0/1808227030 wait complete. 2024-01-22T05:13:37.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.768+0000 7f774e800700 1 Processor -- start 2024-01-22T05:13:37.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.768+0000 7f774e800700 1 -- start start 2024-01-22T05:13:37.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.768+0000 7f774e800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7748068950 0x7f77480c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:37.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.768+0000 7f774e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77480c3dd0 0x7f77480bf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:37.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.768+0000 7f774e800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7748151b90 0x7f77480ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:37.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.768+0000 7f774e800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77480ad930 con 0x7f77480c3dd0 2024-01-22T05:13:37.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.768+0000 7f774e800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77480adbe0 con 0x7f7748068950 2024-01-22T05:13:37.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.768+0000 7f774e800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77480adec0 con 0x7f7748151b90 2024-01-22T05:13:37.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.768+0000 7f7746a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77480c3dd0 0x7f77480bf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:37.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.768+0000 7f7747400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7748068950 0x7f77480c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:37.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.772+0000 7f7746a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77480c3dd0 0x7f77480bf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58496/0 (socket says 172.21.15.49:58496) 2024-01-22T05:13:37.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.772+0000 7f7746a00700 1 -- 172.21.15.49:0/1103540828 learned_addr learned my addr 172.21.15.49:0/1103540828 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:37.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.772+0000 7f7747e00700 1 --2- 172.21.15.49:0/1103540828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7748151b90 0x7f77480ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.772+0000 7f7746a00700 1 -- 172.21.15.49:0/1103540828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7748151b90 msgr2=0x7f77480ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.772+0000 7f7746a00700 1 --2- 172.21.15.49:0/1103540828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7748151b90 0x7f77480ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.772+0000 7f7746a00700 1 -- 172.21.15.49:0/1103540828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7748068950 msgr2=0x7f77480c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.772+0000 7f7746a00700 1 --2- 172.21.15.49:0/1103540828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7748068950 0x7f77480c23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.772+0000 7f7746a00700 1 -- 172.21.15.49:0/1103540828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77380092a0 con 0x7f77480c3dd0 2024-01-22T05:13:37.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.772+0000 7f7746a00700 1 --2- 172.21.15.49:0/1103540828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77480c3dd0 0x7f77480bf740 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f773000c420 tx=0x7f7730007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:37.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.772+0000 7f773ea00700 1 -- 172.21.15.49:0/1103540828 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730012400 con 0x7f77480c3dd0 2024-01-22T05:13:37.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.772+0000 7f773ea00700 1 -- 172.21.15.49:0/1103540828 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7730012560 con 0x7f77480c3dd0 2024-01-22T05:13:37.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.772+0000 7f774e800700 1 -- 172.21.15.49:0/1103540828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f774814f1b0 con 0x7f77480c3dd0 2024-01-22T05:13:37.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.772+0000 7f773ea00700 1 -- 172.21.15.49:0/1103540828 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730012920 con 0x7f77480c3dd0 2024-01-22T05:13:37.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.772+0000 7f774e800700 1 -- 172.21.15.49:0/1103540828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f774814f770 con 0x7f77480c3dd0 2024-01-22T05:13:37.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.772+0000 7f774e800700 1 -- 172.21.15.49:0/1103540828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774814f990 con 0x7f77480c3dd0 2024-01-22T05:13:37.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.776+0000 7f773ea00700 1 -- 172.21.15.49:0/1103540828 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f773001b3b0 con 0x7f77480c3dd0 2024-01-22T05:13:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.776+0000 7f773ea00700 1 --2- 172.21.15.49:0/1103540828 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f772005a510 0x7f772005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.776+0000 7f773ea00700 1 -- 172.21.15.49:0/1103540828 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f7730074130 con 0x7f77480c3dd0 2024-01-22T05:13:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.776+0000 7f7747400700 1 --2- 172.21.15.49:0/1103540828 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f772005a510 0x7f772005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:37.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.780+0000 7f7747400700 1 --2- 172.21.15.49:0/1103540828 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f772005a510 0x7f772005c9d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f77380096e0 tx=0x7f7738016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:37.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.784+0000 7f773ea00700 1 -- 172.21.15.49:0/1103540828 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f77300476f0 con 0x7f77480c3dd0 2024-01-22T05:13:37.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.984+0000 7f774e800700 1 -- 172.21.15.49:0/1103540828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f77480c63b0 con 0x7f77480c3dd0 2024-01-22T05:13:37.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:37.996+0000 7f773ea00700 1 -- 172.21.15.49:0/1103540828 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v94) v1 ==== 174+0+0 (secure 0 0 0) 0x7f773004ad10 con 0x7f77480c3dd0 2024-01-22T05:13:38.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.004+0000 7f774e800700 1 -- 172.21.15.49:0/1103540828 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f772005a510 msgr2=0x7f772005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.004+0000 7f774e800700 1 --2- 172.21.15.49:0/1103540828 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f772005a510 0x7f772005c9d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f77380096e0 tx=0x7f7738016000).stop 2024-01-22T05:13:38.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.004+0000 7f774e800700 1 -- 172.21.15.49:0/1103540828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77480c3dd0 msgr2=0x7f77480bf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.004+0000 7f774e800700 1 --2- 172.21.15.49:0/1103540828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77480c3dd0 0x7f77480bf740 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f773000c420 tx=0x7f7730007c60).stop 2024-01-22T05:13:38.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.008+0000 7f774e800700 1 -- 172.21.15.49:0/1103540828 shutdown_connections 2024-01-22T05:13:38.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.008+0000 7f774e800700 1 --2- 172.21.15.49:0/1103540828 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f772005a510 0x7f772005c9d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.008+0000 7f774e800700 1 --2- 172.21.15.49:0/1103540828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7748151b90 0x7f77480ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.008+0000 7f774e800700 1 --2- 172.21.15.49:0/1103540828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77480c3dd0 0x7f77480bf740 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.008+0000 7f774e800700 1 --2- 172.21.15.49:0/1103540828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7748068950 0x7f77480c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.008+0000 7f774e800700 1 -- 172.21.15.49:0/1103540828 >> 172.21.15.49:0/1103540828 conn(0x7f77480c87b0 msgr2=0x7f77480be880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:38.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.008+0000 7f774e800700 1 -- 172.21.15.49:0/1103540828 shutdown_connections 2024-01-22T05:13:38.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.008+0000 7f774e800700 1 -- 172.21.15.49:0/1103540828 wait complete. 2024-01-22T05:13:38.016 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 16 and data pool 17 2024-01-22T05:13:38.041 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:13:38.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.192+0000 7f250f800700 1 Processor -- start 2024-01-22T05:13:38.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.192+0000 7f250f800700 1 -- start start 2024-01-22T05:13:38.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.192+0000 7f250f800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2508155d20 0x7f2508065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.192+0000 7f250f800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2508066070 0x7f25080a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.192+0000 7f250f800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25080c1a40 con 0x7f25080a8c30 2024-01-22T05:13:38.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.192+0000 7f250f800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25080a9090 con 0x7f2508155d20 2024-01-22T05:13:38.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.192+0000 7f250f800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2508159310 con 0x7f2508066070 2024-01-22T05:13:38.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f250ce00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2508155d20 0x7f2508065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f2507e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2508066070 0x7f25080a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f250d800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f25080a8c30 0x7f25080c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53026/0 (socket says 172.21.15.49:53026) 2024-01-22T05:13:38.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f250ce00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2508155d20 0x7f2508065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:39026/0 (socket says 172.21.15.49:39026) 2024-01-22T05:13:38.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f250d800700 1 -- 172.21.15.49:0/3224576771 learned_addr learned my addr 172.21.15.49:0/3224576771 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:38.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f2507400700 1 -- 172.21.15.49:0/3224576771 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288589390 0 0) 0x7f25080c1a40 con 0x7f25080a8c30 2024-01-22T05:13:38.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f250ce00700 1 -- 172.21.15.49:0/3224576771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2508066070 msgr2=0x7f25080a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:38.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f250ce00700 1 --2- 172.21.15.49:0/3224576771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2508066070 0x7f25080a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f250ce00700 1 -- 172.21.15.49:0/3224576771 >> v1:172.21.15.49:6789/0 conn(0x7f25080a8c30 legacy=0x7f25080c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f250ce00700 1 -- 172.21.15.49:0/3224576771 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25080c13f0 con 0x7f2508155d20 2024-01-22T05:13:38.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f250ce00700 1 --2- 172.21.15.49:0/3224576771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2508155d20 0x7f2508065b80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f24f8009760 tx=0x7f24f8009060).ready entity=mon.1 client_cookie=ceacedf83bc6162c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:38.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f2507400700 1 -- 172.21.15.49:0/3224576771 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f800f510 con 0x7f2508155d20 2024-01-22T05:13:38.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f2507400700 1 -- 172.21.15.49:0/3224576771 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f800f670 con 0x7f2508155d20 2024-01-22T05:13:38.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f2507400700 1 -- 172.21.15.49:0/3224576771 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f800f9f0 con 0x7f2508155d20 2024-01-22T05:13:38.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f250f800700 1 -- 172.21.15.49:0/3224576771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2508155d20 msgr2=0x7f2508065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f250f800700 1 --2- 172.21.15.49:0/3224576771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2508155d20 0x7f2508065b80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f24f8009760 tx=0x7f24f8009060).stop 2024-01-22T05:13:38.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f250f800700 1 -- 172.21.15.49:0/3224576771 shutdown_connections 2024-01-22T05:13:38.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f250f800700 1 --2- 172.21.15.49:0/3224576771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2508066070 0x7f25080a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f250f800700 1 --2- 172.21.15.49:0/3224576771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2508155d20 0x7f2508065b80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.196+0000 7f250f800700 1 -- 172.21.15.49:0/3224576771 >> 172.21.15.49:0/3224576771 conn(0x7f25080c6540 msgr2=0x7f25080c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:38.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.200+0000 7f250f800700 1 -- 172.21.15.49:0/3224576771 shutdown_connections 2024-01-22T05:13:38.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.200+0000 7f250f800700 1 -- 172.21.15.49:0/3224576771 wait complete. 2024-01-22T05:13:38.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.200+0000 7f250f800700 1 Processor -- start 2024-01-22T05:13:38.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.200+0000 7f250f800700 1 -- start start 2024-01-22T05:13:38.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250f800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2508066070 0x7f25080bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250f800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25080a8c30 0x7f25080bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250f800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2508155d20 0x7f2508168690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250f800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25080be9d0 con 0x7f2508155d20 2024-01-22T05:13:38.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250f800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25080bddc0 con 0x7f2508066070 2024-01-22T05:13:38.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250f800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25080be0a0 con 0x7f25080a8c30 2024-01-22T05:13:38.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250d800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2508155d20 0x7f2508168690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250d800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2508155d20 0x7f2508168690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58504/0 (socket says 172.21.15.49:58504) 2024-01-22T05:13:38.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250d800700 1 -- 172.21.15.49:0/1417328577 learned_addr learned my addr 172.21.15.49:0/1417328577 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:38.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f2507e00700 1 --2- 172.21.15.49:0/1417328577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25080a8c30 0x7f25080bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250ce00700 1 --2- 172.21.15.49:0/1417328577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2508066070 0x7f25080bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250d800700 1 -- 172.21.15.49:0/1417328577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25080a8c30 msgr2=0x7f25080bd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250d800700 1 --2- 172.21.15.49:0/1417328577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25080a8c30 0x7f25080bd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250d800700 1 -- 172.21.15.49:0/1417328577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2508066070 msgr2=0x7f25080bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250d800700 1 --2- 172.21.15.49:0/1417328577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2508066070 0x7f25080bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250d800700 1 -- 172.21.15.49:0/1417328577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f80092a0 con 0x7f2508155d20 2024-01-22T05:13:38.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f2507e00700 1 --2- 172.21.15.49:0/1417328577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25080a8c30 0x7f25080bd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:38.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250d800700 1 --2- 172.21.15.49:0/1417328577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2508155d20 0x7f2508168690 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f250000c7e0 tx=0x7f2500007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:38.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f24ffe00700 1 -- 172.21.15.49:0/1417328577 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500005d30 con 0x7f2508155d20 2024-01-22T05:13:38.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f24ffe00700 1 -- 172.21.15.49:0/1417328577 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2500005e90 con 0x7f2508155d20 2024-01-22T05:13:38.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250f800700 1 -- 172.21.15.49:0/1417328577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25080be380 con 0x7f2508155d20 2024-01-22T05:13:38.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f24ffe00700 1 -- 172.21.15.49:0/1417328577 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500007320 con 0x7f2508155d20 2024-01-22T05:13:38.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.204+0000 7f250f800700 1 -- 172.21.15.49:0/1417328577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25080bdad0 con 0x7f2508155d20 2024-01-22T05:13:38.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.208+0000 7f250f800700 1 -- 172.21.15.49:0/1417328577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2508047060 con 0x7f2508155d20 2024-01-22T05:13:38.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.208+0000 7f24ffe00700 1 -- 172.21.15.49:0/1417328577 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2500007710 con 0x7f2508155d20 2024-01-22T05:13:38.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.208+0000 7f24ffe00700 1 --2- 172.21.15.49:0/1417328577 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f24e005a540 0x7f24e005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.208+0000 7f24ffe00700 1 -- 172.21.15.49:0/1417328577 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2500074890 con 0x7f2508155d20 2024-01-22T05:13:38.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.212+0000 7f250ce00700 1 --2- 172.21.15.49:0/1417328577 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f24e005a540 0x7f24e005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.212+0000 7f250ce00700 1 --2- 172.21.15.49:0/1417328577 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f24e005a540 0x7f24e005ca00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f24f8009fd0 tx=0x7f24f8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:38.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.216+0000 7f24ffe00700 1 -- 172.21.15.49:0/1417328577 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2500047e50 con 0x7f2508155d20 2024-01-22T05:13:38.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.384+0000 7f250f800700 1 -- 172.21.15.49:0/1417328577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25080c16d0 con 0x7f2508155d20 2024-01-22T05:13:38.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.388+0000 7f24ffe00700 1 -- 172.21.15.49:0/1417328577 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+17191 (secure 0 0 0) 0x7f250004b470 con 0x7f2508155d20 2024-01-22T05:13:38.389 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:38.389 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":116,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:13:37.988603+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:13:36.110138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-01-22T05:13:36.984415+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:13:38.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.392+0000 7f250f800700 1 -- 172.21.15.49:0/1417328577 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f24e005a540 msgr2=0x7f24e005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.392+0000 7f250f800700 1 --2- 172.21.15.49:0/1417328577 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f24e005a540 0x7f24e005ca00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f24f8009fd0 tx=0x7f24f8017000).stop 2024-01-22T05:13:38.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.392+0000 7f250f800700 1 -- 172.21.15.49:0/1417328577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2508155d20 msgr2=0x7f2508168690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.392+0000 7f250f800700 1 --2- 172.21.15.49:0/1417328577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2508155d20 0x7f2508168690 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f250000c7e0 tx=0x7f2500007f90).stop 2024-01-22T05:13:38.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.392+0000 7f250f800700 1 -- 172.21.15.49:0/1417328577 shutdown_connections 2024-01-22T05:13:38.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.392+0000 7f250f800700 1 --2- 172.21.15.49:0/1417328577 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f24e005a540 0x7f24e005ca00 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.392+0000 7f250f800700 1 --2- 172.21.15.49:0/1417328577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2508155d20 0x7f2508168690 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.392+0000 7f250f800700 1 --2- 172.21.15.49:0/1417328577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25080a8c30 0x7f25080bd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.392+0000 7f250f800700 1 --2- 172.21.15.49:0/1417328577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2508066070 0x7f25080bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.392+0000 7f250f800700 1 -- 172.21.15.49:0/1417328577 >> 172.21.15.49:0/1417328577 conn(0x7f25080c6540 msgr2=0x7f2508067b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:38.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.392+0000 7f250f800700 1 -- 172.21.15.49:0/1417328577 shutdown_connections 2024-01-22T05:13:38.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.392+0000 7f250f800700 1 -- 172.21.15.49:0/1417328577 wait complete. 2024-01-22T05:13:38.417 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:13:38.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.572+0000 7f720cc00700 1 Processor -- start 2024-01-22T05:13:38.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.572+0000 7f720cc00700 1 -- start start 2024-01-22T05:13:38.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f720cc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7208155d20 0x7f7208065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f720cc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7208066070 0x7f72080a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f720cc00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72080a90e0 con 0x7f72080a8c30 2024-01-22T05:13:38.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f720cc00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72080c1a40 con 0x7f7208066070 2024-01-22T05:13:38.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f720cc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7208159310 con 0x7f7208155d20 2024-01-22T05:13:38.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f7205400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7208066070 0x7f72080a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f7205400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7208066070 0x7f72080a8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58518/0 (socket says 172.21.15.49:58518) 2024-01-22T05:13:38.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f7205e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7208155d20 0x7f7208065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f7205400700 1 -- 172.21.15.49:0/747350381 learned_addr learned my addr 172.21.15.49:0/747350381 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:38.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f7205400700 1 -- 172.21.15.49:0/747350381 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7208155d20 msgr2=0x7f7208065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:38.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f7205400700 1 --2- 172.21.15.49:0/747350381 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7208155d20 0x7f7208065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f7205400700 1 -- 172.21.15.49:0/747350381 >> v1:172.21.15.49:6789/0 conn(0x7f72080a8c30 legacy=0x7f72080c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f7205400700 1 -- 172.21.15.49:0/747350381 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72080c13f0 con 0x7f7208066070 2024-01-22T05:13:38.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f7205400700 1 --2- 172.21.15.49:0/747350381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7208066070 0x7f72080a8740 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f71f0006fd0 tx=0x7f71f00090f0).ready entity=mon.0 client_cookie=4a1dfd72c55ff8d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:38.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f7204a00700 1 -- 172.21.15.49:0/747350381 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f000b580 con 0x7f7208066070 2024-01-22T05:13:38.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f7204a00700 1 -- 172.21.15.49:0/747350381 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f000b6e0 con 0x7f7208066070 2024-01-22T05:13:38.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.576+0000 7f7204a00700 1 -- 172.21.15.49:0/747350381 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f000ba60 con 0x7f7208066070 2024-01-22T05:13:38.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.580+0000 7f720cc00700 1 -- 172.21.15.49:0/747350381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7208066070 msgr2=0x7f72080a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.580+0000 7f720cc00700 1 --2- 172.21.15.49:0/747350381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7208066070 0x7f72080a8740 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f71f0006fd0 tx=0x7f71f00090f0).stop 2024-01-22T05:13:38.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.580+0000 7f720cc00700 1 -- 172.21.15.49:0/747350381 shutdown_connections 2024-01-22T05:13:38.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.580+0000 7f720cc00700 1 --2- 172.21.15.49:0/747350381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7208066070 0x7f72080a8740 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.580+0000 7f720cc00700 1 --2- 172.21.15.49:0/747350381 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7208155d20 0x7f7208065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.580+0000 7f720cc00700 1 -- 172.21.15.49:0/747350381 >> 172.21.15.49:0/747350381 conn(0x7f72080c6540 msgr2=0x7f72080c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:38.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.580+0000 7f720cc00700 1 -- 172.21.15.49:0/747350381 shutdown_connections 2024-01-22T05:13:38.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.580+0000 7f720cc00700 1 -- 172.21.15.49:0/747350381 wait complete. 2024-01-22T05:13:38.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.584+0000 7f720cc00700 1 Processor -- start 2024-01-22T05:13:38.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.584+0000 7f720cc00700 1 -- start start 2024-01-22T05:13:38.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.584+0000 7f720cc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7208066070 0x7f7208141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.584+0000 7f720cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72080a8c30 0x7f72080c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.584+0000 7f720cc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7208155d20 0x7f72080c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.584+0000 7f720cc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72080c5df0 con 0x7f72080a8c30 2024-01-22T05:13:38.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.584+0000 7f720cc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72080ac4c0 con 0x7f7208155d20 2024-01-22T05:13:38.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.584+0000 7f720cc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72080ab8b0 con 0x7f7208066070 2024-01-22T05:13:38.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.584+0000 7f7205400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72080a8c30 0x7f72080c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.584+0000 7f7205400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72080a8c30 0x7f72080c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58532/0 (socket says 172.21.15.49:58532) 2024-01-22T05:13:38.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.584+0000 7f7205400700 1 -- 172.21.15.49:0/1872675790 learned_addr learned my addr 172.21.15.49:0/1872675790 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:38.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.584+0000 7f7206800700 1 --2- 172.21.15.49:0/1872675790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7208155d20 0x7f72080c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.584+0000 7f7205e00700 1 --2- 172.21.15.49:0/1872675790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7208066070 0x7f7208141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.588+0000 7f7205400700 1 -- 172.21.15.49:0/1872675790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7208066070 msgr2=0x7f7208141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.588+0000 7f7205400700 1 --2- 172.21.15.49:0/1872675790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7208066070 0x7f7208141ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.588+0000 7f7205400700 1 -- 172.21.15.49:0/1872675790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7208155d20 msgr2=0x7f72080c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.588+0000 7f7205400700 1 --2- 172.21.15.49:0/1872675790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7208155d20 0x7f72080c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.588+0000 7f7205400700 1 -- 172.21.15.49:0/1872675790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f0009370 con 0x7f72080a8c30 2024-01-22T05:13:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.588+0000 7f7205400700 1 --2- 172.21.15.49:0/1872675790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72080a8c30 0x7f72080c5410 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f71f0009130 tx=0x7f71f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.588+0000 7f71fd600700 1 -- 172.21.15.49:0/1872675790 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f0000bc0 con 0x7f72080a8c30 2024-01-22T05:13:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.588+0000 7f71fd600700 1 -- 172.21.15.49:0/1872675790 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f000b850 con 0x7f72080a8c30 2024-01-22T05:13:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.588+0000 7f720cc00700 1 -- 172.21.15.49:0/1872675790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72080abb90 con 0x7f72080a8c30 2024-01-22T05:13:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.588+0000 7f71fd600700 1 -- 172.21.15.49:0/1872675790 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f0000d20 con 0x7f72080a8c30 2024-01-22T05:13:38.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.588+0000 7f720cc00700 1 -- 172.21.15.49:0/1872675790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72080ac150 con 0x7f72080a8c30 2024-01-22T05:13:38.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.588+0000 7f720cc00700 1 -- 172.21.15.49:0/1872675790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72080ac630 con 0x7f72080a8c30 2024-01-22T05:13:38.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.592+0000 7f71fd600700 1 -- 172.21.15.49:0/1872675790 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f71f001cb10 con 0x7f72080a8c30 2024-01-22T05:13:38.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.592+0000 7f71fd600700 1 --2- 172.21.15.49:0/1872675790 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71e005a510 0x7f71e005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.592+0000 7f71fd600700 1 -- 172.21.15.49:0/1872675790 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f71f00767b0 con 0x7f72080a8c30 2024-01-22T05:13:38.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.592+0000 7f7205e00700 1 --2- 172.21.15.49:0/1872675790 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71e005a510 0x7f71e005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.592+0000 7f7205e00700 1 --2- 172.21.15.49:0/1872675790 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71e005a510 0x7f71e005c9d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f71f8009b90 tx=0x7f71f8009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:38.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.600+0000 7f71fd600700 1 -- 172.21.15.49:0/1872675790 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f71f0049e30 con 0x7f72080a8c30 2024-01-22T05:13:38.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.772+0000 7f720cc00700 1 -- 172.21.15.49:0/1872675790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72080bb500 con 0x7f72080a8c30 2024-01-22T05:13:38.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.772+0000 7f71fd600700 1 -- 172.21.15.49:0/1872675790 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+17191 (secure 0 0 0) 0x7f72080bb500 con 0x7f72080a8c30 2024-01-22T05:13:38.775 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:38.775 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":116,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:13:37.988603+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:13:36.110138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-01-22T05:13:36.984415+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:13:38.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.776+0000 7f720cc00700 1 -- 172.21.15.49:0/1872675790 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71e005a510 msgr2=0x7f71e005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.776+0000 7f720cc00700 1 --2- 172.21.15.49:0/1872675790 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71e005a510 0x7f71e005c9d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f71f8009b90 tx=0x7f71f8009060).stop 2024-01-22T05:13:38.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.776+0000 7f720cc00700 1 -- 172.21.15.49:0/1872675790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72080a8c30 msgr2=0x7f72080c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.776+0000 7f720cc00700 1 --2- 172.21.15.49:0/1872675790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72080a8c30 0x7f72080c5410 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f71f0009130 tx=0x7f71f0017000).stop 2024-01-22T05:13:38.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.776+0000 7f720cc00700 1 -- 172.21.15.49:0/1872675790 shutdown_connections 2024-01-22T05:13:38.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.776+0000 7f720cc00700 1 --2- 172.21.15.49:0/1872675790 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71e005a510 0x7f71e005c9d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.776+0000 7f720cc00700 1 --2- 172.21.15.49:0/1872675790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7208155d20 0x7f72080c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.776+0000 7f720cc00700 1 --2- 172.21.15.49:0/1872675790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72080a8c30 0x7f72080c5410 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.776+0000 7f720cc00700 1 --2- 172.21.15.49:0/1872675790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7208066070 0x7f7208141ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.776+0000 7f720cc00700 1 -- 172.21.15.49:0/1872675790 >> 172.21.15.49:0/1872675790 conn(0x7f72080c6540 msgr2=0x7f7208066540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:38.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.776+0000 7f720cc00700 1 -- 172.21.15.49:0/1872675790 shutdown_connections 2024-01-22T05:13:38.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.776+0000 7f720cc00700 1 -- 172.21.15.49:0/1872675790 wait complete. 2024-01-22T05:13:38.801 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:13:38.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.968+0000 7f1e8e000700 1 Processor -- start 2024-01-22T05:13:38.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.968+0000 7f1e8e000700 1 -- start start 2024-01-22T05:13:38.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.972+0000 7f1e8e000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1e880c6840 0x7f1e88150530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.972+0000 7f1e8e000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e880625f0 0x7f1e88062a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.972+0000 7f1e8e000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880c4ee0 con 0x7f1e880c2ab0 2024-01-22T05:13:38.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.972+0000 7f1e8e000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e880c6c20 con 0x7f1e880c6840 2024-01-22T05:13:38.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.972+0000 7f1e8e000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880c51c0 con 0x7f1e880625f0 2024-01-22T05:13:38.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.972+0000 7f1e8cc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1e880c6840 0x7f1e88150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.972+0000 7f1e87e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1e880c2ab0 0x7f1e880c2f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53036/0 (socket says 172.21.15.49:53036) 2024-01-22T05:13:38.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.972+0000 7f1e87e00700 1 -- 172.21.15.49:0/2739367697 learned_addr learned my addr 172.21.15.49:0/2739367697 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:38.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.972+0000 7f1e8d600700 1 --2- 172.21.15.49:0/2739367697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e880625f0 0x7f1e88062a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e8d600700 1 -- 172.21.15.49:0/2739367697 >> v2:172.21.15.49:3300/0 conn(0x7f1e880c6840 msgr2=0x7f1e88150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:38.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e8d600700 1 --2- 172.21.15.49:0/2739367697 >> v2:172.21.15.49:3300/0 conn(0x7f1e880c6840 0x7f1e88150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e8d600700 1 -- 172.21.15.49:0/2739367697 >> v1:172.21.15.49:6789/0 conn(0x7f1e880c2ab0 legacy=0x7f1e880c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e87400700 1 -- 172.21.15.49:0/2739367697 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766556133 0 0) 0x7f1e880c4ee0 con 0x7f1e880c2ab0 2024-01-22T05:13:38.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e8d600700 1 -- 172.21.15.49:0/2739367697 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e880c54a0 con 0x7f1e880625f0 2024-01-22T05:13:38.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e8d600700 1 --2- 172.21.15.49:0/2739367697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e880625f0 0x7f1e88062a60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f1e80009e60 tx=0x7f1e80009780).ready entity=mon.2 client_cookie=9ba46b36a0668e18 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:38.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e87400700 1 -- 172.21.15.49:0/2739367697 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8000e070 con 0x7f1e880625f0 2024-01-22T05:13:38.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e87400700 1 -- 172.21.15.49:0/2739367697 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8000bb60 con 0x7f1e880625f0 2024-01-22T05:13:38.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e87400700 1 -- 172.21.15.49:0/2739367697 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80012410 con 0x7f1e880625f0 2024-01-22T05:13:38.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e8e000700 1 -- 172.21.15.49:0/2739367697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e880625f0 msgr2=0x7f1e88062a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e8e000700 1 --2- 172.21.15.49:0/2739367697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e880625f0 0x7f1e88062a60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f1e80009e60 tx=0x7f1e80009780).stop 2024-01-22T05:13:38.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e8e000700 1 -- 172.21.15.49:0/2739367697 shutdown_connections 2024-01-22T05:13:38.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e8e000700 1 --2- 172.21.15.49:0/2739367697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e880625f0 0x7f1e88062a60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e8e000700 1 --2- 172.21.15.49:0/2739367697 >> v2:172.21.15.49:3300/0 conn(0x7f1e880c6840 0x7f1e88150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e8e000700 1 -- 172.21.15.49:0/2739367697 >> 172.21.15.49:0/2739367697 conn(0x7f1e880c3880 msgr2=0x7f1e880c3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:38.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.976+0000 7f1e8e000700 1 -- 172.21.15.49:0/2739367697 shutdown_connections 2024-01-22T05:13:38.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.980+0000 7f1e8e000700 1 -- 172.21.15.49:0/2739367697 wait complete. 2024-01-22T05:13:38.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.980+0000 7f1e8e000700 1 Processor -- start 2024-01-22T05:13:38.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.980+0000 7f1e8e000700 1 -- start start 2024-01-22T05:13:38.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e880625f0 0x7f1e88156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8e000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e880c2ab0 0x7f1e880ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e880c6840 0x7f1e8813d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8e000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880ac1a0 con 0x7f1e880625f0 2024-01-22T05:13:38.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8e000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8813d850 con 0x7f1e880c6840 2024-01-22T05:13:38.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8e000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880ab590 con 0x7f1e880c2ab0 2024-01-22T05:13:38.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e880625f0 0x7f1e88156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e880625f0 0x7f1e88156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58556/0 (socket says 172.21.15.49:58556) 2024-01-22T05:13:38.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8cc00700 1 -- 172.21.15.49:0/2223794893 learned_addr learned my addr 172.21.15.49:0/2223794893 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:38.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8d600700 1 --2- 172.21.15.49:0/2223794893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e880c6840 0x7f1e8813d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e87e00700 1 --2- 172.21.15.49:0/2223794893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e880c2ab0 0x7f1e880ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8cc00700 1 -- 172.21.15.49:0/2223794893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e880c2ab0 msgr2=0x7f1e880ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8cc00700 1 --2- 172.21.15.49:0/2223794893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e880c2ab0 0x7f1e880ac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8cc00700 1 -- 172.21.15.49:0/2223794893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e880c6840 msgr2=0x7f1e8813d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:38.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8cc00700 1 --2- 172.21.15.49:0/2223794893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e880c6840 0x7f1e8813d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:38.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8cc00700 1 -- 172.21.15.49:0/2223794893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e80009a20 con 0x7f1e880625f0 2024-01-22T05:13:38.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8d600700 1 --2- 172.21.15.49:0/2223794893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e880c6840 0x7f1e8813d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:38.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8cc00700 1 --2- 172.21.15.49:0/2223794893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e880625f0 0x7f1e88156ee0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f1e7800e930 tx=0x7f1e78009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:38.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e7fe00700 1 -- 172.21.15.49:0/2223794893 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78012600 con 0x7f1e880625f0 2024-01-22T05:13:38.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e7fe00700 1 -- 172.21.15.49:0/2223794893 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e78012760 con 0x7f1e880625f0 2024-01-22T05:13:38.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8e000700 1 -- 172.21.15.49:0/2223794893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e880ab870 con 0x7f1e880625f0 2024-01-22T05:13:38.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e7fe00700 1 -- 172.21.15.49:0/2223794893 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78012ae0 con 0x7f1e880625f0 2024-01-22T05:13:38.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.984+0000 7f1e8e000700 1 -- 172.21.15.49:0/2223794893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e880abe30 con 0x7f1e880625f0 2024-01-22T05:13:38.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.988+0000 7f1e8e000700 1 -- 172.21.15.49:0/2223794893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e880654b0 con 0x7f1e880625f0 2024-01-22T05:13:38.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.988+0000 7f1e7fe00700 1 -- 172.21.15.49:0/2223794893 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1e7801b400 con 0x7f1e880625f0 2024-01-22T05:13:38.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.988+0000 7f1e7fe00700 1 --2- 172.21.15.49:0/2223794893 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e6005a510 0x7f1e6005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:38.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.988+0000 7f1e7fe00700 1 -- 172.21.15.49:0/2223794893 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f1e78074bf0 con 0x7f1e880625f0 2024-01-22T05:13:38.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.988+0000 7f1e87e00700 1 --2- 172.21.15.49:0/2223794893 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e6005a510 0x7f1e6005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:38.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.992+0000 7f1e87e00700 1 --2- 172.21.15.49:0/2223794893 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e6005a510 0x7f1e6005c9d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f1e881573d0 tx=0x7f1e70007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:38.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:38.996+0000 7f1e7fe00700 1 -- 172.21.15.49:0/2223794893 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1e78048210 con 0x7f1e880625f0 2024-01-22T05:13:39.078 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:13:39.083 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:13:39.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:39.204+0000 7f1e8e000700 1 -- 172.21.15.49:0/2223794893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1e880c5780 con 0x7f1e880625f0 2024-01-22T05:13:40.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.020+0000 7f1e7fe00700 1 -- 172.21.15.49:0/2223794893 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v97) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1e7804b830 con 0x7f1e880625f0 2024-01-22T05:13:40.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.024+0000 7f1e8e000700 1 -- 172.21.15.49:0/2223794893 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e6005a510 msgr2=0x7f1e6005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:40.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.024+0000 7f1e8e000700 1 --2- 172.21.15.49:0/2223794893 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e6005a510 0x7f1e6005c9d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f1e881573d0 tx=0x7f1e70007bb0).stop 2024-01-22T05:13:40.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.024+0000 7f1e8e000700 1 -- 172.21.15.49:0/2223794893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e880625f0 msgr2=0x7f1e88156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:40.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.024+0000 7f1e8e000700 1 --2- 172.21.15.49:0/2223794893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e880625f0 0x7f1e88156ee0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f1e7800e930 tx=0x7f1e78009060).stop 2024-01-22T05:13:40.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.028+0000 7f1e8e000700 1 -- 172.21.15.49:0/2223794893 shutdown_connections 2024-01-22T05:13:40.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.028+0000 7f1e8e000700 1 --2- 172.21.15.49:0/2223794893 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e6005a510 0x7f1e6005c9d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:40.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.028+0000 7f1e8e000700 1 --2- 172.21.15.49:0/2223794893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e880c6840 0x7f1e8813d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:40.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.028+0000 7f1e8e000700 1 --2- 172.21.15.49:0/2223794893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e880c2ab0 0x7f1e880ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:40.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.028+0000 7f1e8e000700 1 --2- 172.21.15.49:0/2223794893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e880625f0 0x7f1e88156ee0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:40.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.028+0000 7f1e8e000700 1 -- 172.21.15.49:0/2223794893 >> 172.21.15.49:0/2223794893 conn(0x7f1e880c3880 msgr2=0x7f1e880bd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:40.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.028+0000 7f1e8e000700 1 -- 172.21.15.49:0/2223794893 shutdown_connections 2024-01-22T05:13:40.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.028+0000 7f1e8e000700 1 -- 172.21.15.49:0/2223794893 wait complete. 2024-01-22T05:13:40.054 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T05:13:40.055 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:13:40.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.240+0000 7ff5fbe00700 1 Processor -- start 2024-01-22T05:13:40.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.240+0000 7ff5fbe00700 1 -- start start 2024-01-22T05:13:40.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.244+0000 7ff5fbe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff5fc0c3720 0x7ff5fc0c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:40.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.244+0000 7ff5fbe00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc0bea80 con 0x7ff5fc1554d0 2024-01-22T05:13:40.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.244+0000 7ff5fbe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc0bf620 con 0x7ff5fc151b30 2024-01-22T05:13:40.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.244+0000 7ff5fbe00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc1563e0 con 0x7ff5fc0c3720 2024-01-22T05:13:40.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.244+0000 7ff5fa000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff5fc0c3720 0x7ff5fc0c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:40.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.244+0000 7ff5faa00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff5fc151b30 0x7ff5fc0bef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:40824/0 (socket says 172.21.15.49:40824) 2024-01-22T05:13:40.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.244+0000 7ff5faa00700 1 -- 172.21.15.49:0/413244381 learned_addr learned my addr 172.21.15.49:0/413244381 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:40.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.248+0000 7ff5fa000700 1 -- 172.21.15.49:0/413244381 >> v1:172.21.15.110:6789/0 conn(0x7ff5fc151b30 legacy=0x7ff5fc0bef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:40.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.248+0000 7ff5fa000700 1 -- 172.21.15.49:0/413244381 >> v1:172.21.15.49:6789/0 conn(0x7ff5fc1554d0 legacy=0x7ff5fc0a8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:40.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.248+0000 7ff5fa000700 1 -- 172.21.15.49:0/413244381 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc0bdb90 con 0x7ff5fc0c3720 2024-01-22T05:13:40.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.248+0000 7ff5fa000700 1 --2- 172.21.15.49:0/413244381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5fc0c3720 0x7ff5fc0c3b80 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7ff5e4009760 tx=0x7ff5e4009060).ready entity=mon.0 client_cookie=d11cc9772d6d8862 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:40.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.248+0000 7ff5f9600700 1 -- 172.21.15.49:0/413244381 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e400b580 con 0x7ff5fc0c3720 2024-01-22T05:13:40.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.248+0000 7ff5f9600700 1 -- 172.21.15.49:0/413244381 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e400b6e0 con 0x7ff5fc0c3720 2024-01-22T05:13:40.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.248+0000 7ff5f9600700 1 -- 172.21.15.49:0/413244381 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e400ba60 con 0x7ff5fc0c3720 2024-01-22T05:13:40.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.248+0000 7ff5fbe00700 1 -- 172.21.15.49:0/413244381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5fc0c3720 msgr2=0x7ff5fc0c3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:40.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.248+0000 7ff5fbe00700 1 --2- 172.21.15.49:0/413244381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5fc0c3720 0x7ff5fc0c3b80 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7ff5e4009760 tx=0x7ff5e4009060).stop 2024-01-22T05:13:40.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.248+0000 7ff5fbe00700 1 -- 172.21.15.49:0/413244381 shutdown_connections 2024-01-22T05:13:40.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.248+0000 7ff5fbe00700 1 --2- 172.21.15.49:0/413244381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5fc0c3720 0x7ff5fc0c3b80 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:40.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.248+0000 7ff5fbe00700 1 -- 172.21.15.49:0/413244381 >> 172.21.15.49:0/413244381 conn(0x7ff5fc0c8770 msgr2=0x7ff5fc0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:40.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.248+0000 7ff5fbe00700 1 -- 172.21.15.49:0/413244381 shutdown_connections 2024-01-22T05:13:40.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.248+0000 7ff5fbe00700 1 -- 172.21.15.49:0/413244381 wait complete. 2024-01-22T05:13:40.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.252+0000 7ff5fbe00700 1 Processor -- start 2024-01-22T05:13:40.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fbe00700 1 -- start start 2024-01-22T05:13:40.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fbe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5fc0c3720 0x7ff5fc154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:40.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5fc151b30 0x7ff5fc0aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:40.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5fc1554d0 0x7ff5fc1624d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:40.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fbe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc152580 con 0x7ff5fc151b30 2024-01-22T05:13:40.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fbe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0adac0 con 0x7ff5fc1554d0 2024-01-22T05:13:40.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fbe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0ad220 con 0x7ff5fc0c3720 2024-01-22T05:13:40.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fa000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5fc151b30 0x7ff5fc0aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:40.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fa000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5fc151b30 0x7ff5fc0aca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58574/0 (socket says 172.21.15.49:58574) 2024-01-22T05:13:40.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fa000700 1 -- 172.21.15.49:0/3539725776 learned_addr learned my addr 172.21.15.49:0/3539725776 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:40.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5faa00700 1 --2- 172.21.15.49:0/3539725776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5fc0c3720 0x7ff5fc154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:40.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fb400700 1 --2- 172.21.15.49:0/3539725776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5fc1554d0 0x7ff5fc1624d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:40.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fa000700 1 -- 172.21.15.49:0/3539725776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5fc0c3720 msgr2=0x7ff5fc154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:40.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fa000700 1 --2- 172.21.15.49:0/3539725776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5fc0c3720 0x7ff5fc154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:40.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fa000700 1 -- 172.21.15.49:0/3539725776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5fc1554d0 msgr2=0x7ff5fc1624d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:40.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fa000700 1 --2- 172.21.15.49:0/3539725776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5fc1554d0 0x7ff5fc1624d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:40.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fa000700 1 -- 172.21.15.49:0/3539725776 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e40092a0 con 0x7ff5fc151b30 2024-01-22T05:13:40.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fb400700 1 --2- 172.21.15.49:0/3539725776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5fc1554d0 0x7ff5fc1624d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:13:40.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fa000700 1 --2- 172.21.15.49:0/3539725776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5fc151b30 0x7ff5fc0aca00 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7ff5e4009260 tx=0x7ff5e4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:40.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5f2000700 1 -- 172.21.15.49:0/3539725776 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e400ba60 con 0x7ff5fc151b30 2024-01-22T05:13:40.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5f2000700 1 -- 172.21.15.49:0/3539725776 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4000c90 con 0x7ff5fc151b30 2024-01-22T05:13:40.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5fbe00700 1 -- 172.21.15.49:0/3539725776 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5fc0ad500 con 0x7ff5fc151b30 2024-01-22T05:13:40.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.256+0000 7ff5f2000700 1 -- 172.21.15.49:0/3539725776 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e401b650 con 0x7ff5fc151b30 2024-01-22T05:13:40.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.260+0000 7ff5fbe00700 1 -- 172.21.15.49:0/3539725776 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5fc0acef0 con 0x7ff5fc151b30 2024-01-22T05:13:40.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.260+0000 7ff5fbe00700 1 -- 172.21.15.49:0/3539725776 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5fc152730 con 0x7ff5fc151b30 2024-01-22T05:13:40.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.260+0000 7ff5f2000700 1 -- 172.21.15.49:0/3539725776 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff5e401ba00 con 0x7ff5fc151b30 2024-01-22T05:13:40.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.264+0000 7ff5f2000700 1 --2- 172.21.15.49:0/3539725776 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff5d405a510 0x7ff5d405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:40.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.264+0000 7ff5f2000700 1 -- 172.21.15.49:0/3539725776 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff5e40762b0 con 0x7ff5fc151b30 2024-01-22T05:13:40.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.264+0000 7ff5faa00700 1 --2- 172.21.15.49:0/3539725776 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff5d405a510 0x7ff5d405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:40.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.264+0000 7ff5faa00700 1 --2- 172.21.15.49:0/3539725776 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff5d405a510 0x7ff5d405c9d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7ff5ec007fd0 tx=0x7ff5ec009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:40.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.268+0000 7ff5f2000700 1 -- 172.21.15.49:0/3539725776 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff5fc152730 con 0x7ff5fc151b30 2024-01-22T05:13:40.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:40.472+0000 7ff5fbe00700 1 -- 172.21.15.49:0/3539725776 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff5fc152730 con 0x7ff5fc151b30 2024-01-22T05:13:41.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.028+0000 7ff5f2000700 1 -- 172.21.15.49:0/3539725776 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v98) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff5fc152730 con 0x7ff5fc151b30 2024-01-22T05:13:41.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.032+0000 7ff5fbe00700 1 -- 172.21.15.49:0/3539725776 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff5d405a510 msgr2=0x7ff5d405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:41.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.032+0000 7ff5fbe00700 1 --2- 172.21.15.49:0/3539725776 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff5d405a510 0x7ff5d405c9d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7ff5ec007fd0 tx=0x7ff5ec009040).stop 2024-01-22T05:13:41.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.032+0000 7ff5fbe00700 1 -- 172.21.15.49:0/3539725776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5fc151b30 msgr2=0x7ff5fc0aca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:41.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.032+0000 7ff5fbe00700 1 --2- 172.21.15.49:0/3539725776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5fc151b30 0x7ff5fc0aca00 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7ff5e4009260 tx=0x7ff5e4017000).stop 2024-01-22T05:13:41.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.032+0000 7ff5fbe00700 1 -- 172.21.15.49:0/3539725776 shutdown_connections 2024-01-22T05:13:41.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.032+0000 7ff5fbe00700 1 --2- 172.21.15.49:0/3539725776 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff5d405a510 0x7ff5d405c9d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.032+0000 7ff5fbe00700 1 --2- 172.21.15.49:0/3539725776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5fc1554d0 0x7ff5fc1624d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.032+0000 7ff5fbe00700 1 --2- 172.21.15.49:0/3539725776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5fc151b30 0x7ff5fc0aca00 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.032+0000 7ff5fbe00700 1 --2- 172.21.15.49:0/3539725776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5fc0c3720 0x7ff5fc154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.032+0000 7ff5fbe00700 1 -- 172.21.15.49:0/3539725776 >> 172.21.15.49:0/3539725776 conn(0x7ff5fc0c8770 msgr2=0x7ff5fc155960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:41.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.032+0000 7ff5fbe00700 1 -- 172.21.15.49:0/3539725776 shutdown_connections 2024-01-22T05:13:41.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.032+0000 7ff5fbe00700 1 -- 172.21.15.49:0/3539725776 wait complete. 2024-01-22T05:13:41.059 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:13:41.059 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:13:41.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.220+0000 7f6279e00700 1 Processor -- start 2024-01-22T05:13:41.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.224+0000 7f6279e00700 1 -- start start 2024-01-22T05:13:41.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6279e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62740c30d0 0x7f6274063ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:41.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6279e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f62740c3530 0x7f62740641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:41.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6279e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62741548d0 con 0x7f6274154d60 2024-01-22T05:13:41.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6279e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6274150c40 con 0x7f62740c3530 2024-01-22T05:13:41.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6279e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627406a510 con 0x7f62740c30d0 2024-01-22T05:13:41.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6279400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f62740c3530 0x7f62740641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:41.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6273e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62740c30d0 0x7f6274063ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:41.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6278a00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6274154d60 0x7f62740c6e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:40830/0 (socket says 172.21.15.49:40830) 2024-01-22T05:13:41.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6278a00700 1 -- 172.21.15.49:0/4131206275 learned_addr learned my addr 172.21.15.49:0/4131206275 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:41.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6273400700 1 -- 172.21.15.49:0/4131206275 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124678920 0 0) 0x7f62741548d0 con 0x7f6274154d60 2024-01-22T05:13:41.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6273400700 1 -- 172.21.15.49:0/4131206275 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62540033f0 con 0x7f6274154d60 2024-01-22T05:13:41.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6273e00700 1 -- 172.21.15.49:0/4131206275 >> v2:172.21.15.110:3300/0 conn(0x7f62740c3530 msgr2=0x7f62740641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:41.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6273e00700 1 --2- 172.21.15.49:0/4131206275 >> v2:172.21.15.110:3300/0 conn(0x7f62740c3530 0x7f62740641d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6273e00700 1 -- 172.21.15.49:0/4131206275 >> v1:172.21.15.110:6789/0 conn(0x7f6274154d60 legacy=0x7f62740c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:41.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6273e00700 1 -- 172.21.15.49:0/4131206275 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62741542a0 con 0x7f62740c30d0 2024-01-22T05:13:41.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6273e00700 1 --2- 172.21.15.49:0/4131206275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62740c30d0 0x7f6274063ce0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f625c009760 tx=0x7f625c009060).ready entity=mon.2 client_cookie=afa1821e6a47f9a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:41.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6273400700 1 -- 172.21.15.49:0/4131206275 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c00d4a0 con 0x7f62740c30d0 2024-01-22T05:13:41.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6273400700 1 -- 172.21.15.49:0/4131206275 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c00d600 con 0x7f62740c30d0 2024-01-22T05:13:41.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.228+0000 7f6273400700 1 -- 172.21.15.49:0/4131206275 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c00d980 con 0x7f62740c30d0 2024-01-22T05:13:41.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.232+0000 7f6279e00700 1 -- 172.21.15.49:0/4131206275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62740c30d0 msgr2=0x7f6274063ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:41.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.232+0000 7f6279e00700 1 --2- 172.21.15.49:0/4131206275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62740c30d0 0x7f6274063ce0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f625c009760 tx=0x7f625c009060).stop 2024-01-22T05:13:41.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.232+0000 7f6279e00700 1 -- 172.21.15.49:0/4131206275 shutdown_connections 2024-01-22T05:13:41.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.232+0000 7f6279e00700 1 --2- 172.21.15.49:0/4131206275 >> v2:172.21.15.110:3300/0 conn(0x7f62740c3530 0x7f62740641d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.232+0000 7f6279e00700 1 --2- 172.21.15.49:0/4131206275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62740c30d0 0x7f6274063ce0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.232+0000 7f6279e00700 1 -- 172.21.15.49:0/4131206275 >> 172.21.15.49:0/4131206275 conn(0x7f62740626d0 msgr2=0x7f6274062ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:41.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.232+0000 7f6279e00700 1 -- 172.21.15.49:0/4131206275 shutdown_connections 2024-01-22T05:13:41.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.232+0000 7f6279e00700 1 -- 172.21.15.49:0/4131206275 wait complete. 2024-01-22T05:13:41.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.232+0000 7f6279e00700 1 Processor -- start 2024-01-22T05:13:41.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.236+0000 7f6279e00700 1 -- start start 2024-01-22T05:13:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.236+0000 7f6279e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62740c30d0 0x7f6274160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.236+0000 7f6279e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62740c3530 0x7f627414f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.236+0000 7f6279e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6274154d60 0x7f62741532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.236+0000 7f6279e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627414e3e0 con 0x7f62740c30d0 2024-01-22T05:13:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.236+0000 7f6279e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627414f9e0 con 0x7f62740c3530 2024-01-22T05:13:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.236+0000 7f6279e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627414fcb0 con 0x7f6274154d60 2024-01-22T05:13:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.236+0000 7f6278a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62740c30d0 0x7f6274160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.236+0000 7f6278a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62740c30d0 0x7f6274160850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58578/0 (socket says 172.21.15.49:58578) 2024-01-22T05:13:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.236+0000 7f6278a00700 1 -- 172.21.15.49:0/2451219894 learned_addr learned my addr 172.21.15.49:0/2451219894 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:41.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.236+0000 7f6273e00700 1 --2- 172.21.15.49:0/2451219894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62740c3530 0x7f627414f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:41.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.236+0000 7f6279400700 1 --2- 172.21.15.49:0/2451219894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6274154d60 0x7f62741532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:41.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.240+0000 7f6278a00700 1 -- 172.21.15.49:0/2451219894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6274154d60 msgr2=0x7f62741532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:41.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.240+0000 7f6278a00700 1 --2- 172.21.15.49:0/2451219894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6274154d60 0x7f62741532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.240+0000 7f6278a00700 1 -- 172.21.15.49:0/2451219894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62740c3530 msgr2=0x7f627414f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:41.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.240+0000 7f6278a00700 1 --2- 172.21.15.49:0/2451219894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62740c3530 0x7f627414f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.240+0000 7f6278a00700 1 -- 172.21.15.49:0/2451219894 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c0092a0 con 0x7f62740c30d0 2024-01-22T05:13:41.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.240+0000 7f6278a00700 1 --2- 172.21.15.49:0/2451219894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62740c30d0 0x7f6274160850 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f626400c3f0 tx=0x7f6264007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:41.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.240+0000 7f626be00700 1 -- 172.21.15.49:0/2451219894 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640070d0 con 0x7f62740c30d0 2024-01-22T05:13:41.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.240+0000 7f626be00700 1 -- 172.21.15.49:0/2451219894 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6264007230 con 0x7f62740c30d0 2024-01-22T05:13:41.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.240+0000 7f626be00700 1 -- 172.21.15.49:0/2451219894 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640075d0 con 0x7f62740c30d0 2024-01-22T05:13:41.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.240+0000 7f6279e00700 1 -- 172.21.15.49:0/2451219894 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627414dab0 con 0x7f62740c30d0 2024-01-22T05:13:41.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.240+0000 7f6279e00700 1 -- 172.21.15.49:0/2451219894 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627414e070 con 0x7f62740c30d0 2024-01-22T05:13:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.240+0000 7f6279e00700 1 -- 172.21.15.49:0/2451219894 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6274065330 con 0x7f62740c30d0 2024-01-22T05:13:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.244+0000 7f626be00700 1 -- 172.21.15.49:0/2451219894 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6264005a00 con 0x7f62740c30d0 2024-01-22T05:13:41.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.244+0000 7f626be00700 1 --2- 172.21.15.49:0/2451219894 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f624c05a510 0x7f624c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:41.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.244+0000 7f626be00700 1 -- 172.21.15.49:0/2451219894 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f6264073f40 con 0x7f62740c30d0 2024-01-22T05:13:41.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.244+0000 7f6273e00700 1 --2- 172.21.15.49:0/2451219894 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f624c05a510 0x7f624c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:41.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.244+0000 7f6273e00700 1 --2- 172.21.15.49:0/2451219894 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f624c05a510 0x7f624c05c9d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f625c00d260 tx=0x7f625c016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:41.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.252+0000 7f626be00700 1 -- 172.21.15.49:0/2451219894 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f62640475c0 con 0x7f62740c30d0 2024-01-22T05:13:41.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.452+0000 7f6279e00700 1 -- 172.21.15.49:0/2451219894 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6274046800 con 0x7f62740c30d0 2024-01-22T05:13:41.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.452+0000 7f626be00700 1 -- 172.21.15.49:0/2451219894 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f6264005cb0 con 0x7f62740c30d0 2024-01-22T05:13:41.453 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:41.453 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:13:41.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.456+0000 7f6279e00700 1 -- 172.21.15.49:0/2451219894 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f624c05a510 msgr2=0x7f624c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:41.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.456+0000 7f6279e00700 1 --2- 172.21.15.49:0/2451219894 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f624c05a510 0x7f624c05c9d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f625c00d260 tx=0x7f625c016000).stop 2024-01-22T05:13:41.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.456+0000 7f6279e00700 1 -- 172.21.15.49:0/2451219894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62740c30d0 msgr2=0x7f6274160850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:41.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.456+0000 7f6279e00700 1 --2- 172.21.15.49:0/2451219894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62740c30d0 0x7f6274160850 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f626400c3f0 tx=0x7f6264007c80).stop 2024-01-22T05:13:41.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.456+0000 7f6279e00700 1 -- 172.21.15.49:0/2451219894 shutdown_connections 2024-01-22T05:13:41.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.456+0000 7f6279e00700 1 --2- 172.21.15.49:0/2451219894 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f624c05a510 0x7f624c05c9d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.456+0000 7f6279e00700 1 --2- 172.21.15.49:0/2451219894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6274154d60 0x7f62741532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.456+0000 7f6279e00700 1 --2- 172.21.15.49:0/2451219894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62740c3530 0x7f627414f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.456+0000 7f6279e00700 1 --2- 172.21.15.49:0/2451219894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62740c30d0 0x7f6274160850 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.456+0000 7f6279e00700 1 -- 172.21.15.49:0/2451219894 >> 172.21.15.49:0/2451219894 conn(0x7f62740626d0 msgr2=0x7f6274067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:41.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.456+0000 7f6279e00700 1 -- 172.21.15.49:0/2451219894 shutdown_connections 2024-01-22T05:13:41.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.456+0000 7f6279e00700 1 -- 172.21.15.49:0/2451219894 wait complete. 2024-01-22T05:13:41.461 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:13:41.480 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:13:41.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.640+0000 7f33dea00700 1 Processor -- start 2024-01-22T05:13:41.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.640+0000 7f33dea00700 1 -- start start 2024-01-22T05:13:41.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33dea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d8064c00 0x7f33d80bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:41.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33dea00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f33d8065620 0x7f33d80bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:41.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33dea00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d80c2700 con 0x7f33d8065240 2024-01-22T05:13:41.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33dea00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d80c29a0 con 0x7f33d8065620 2024-01-22T05:13:41.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33dea00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d80c2c80 con 0x7f33d8064c00 2024-01-22T05:13:41.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33d7400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d8064c00 0x7f33d80bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:41.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33d7e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f33d8065240 0x7f33d80644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:40842/0 (socket says 172.21.15.49:40842) 2024-01-22T05:13:41.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33d7e00700 1 -- 172.21.15.49:0/2238395911 learned_addr learned my addr 172.21.15.49:0/2238395911 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:41.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33dd400700 1 --2- 172.21.15.49:0/2238395911 >> v2:172.21.15.110:3300/0 conn(0x7f33d8065620 0x7f33d80bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:41.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33d6a00700 1 -- 172.21.15.49:0/2238395911 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081591594 0 0) 0x7f33d80c2700 con 0x7f33d8065240 2024-01-22T05:13:41.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33d6a00700 1 -- 172.21.15.49:0/2238395911 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33b80033f0 con 0x7f33d8065240 2024-01-22T05:13:41.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33d7400700 1 -- 172.21.15.49:0/2238395911 >> v2:172.21.15.110:3300/0 conn(0x7f33d8065620 msgr2=0x7f33d80bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:41.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33d7400700 1 --2- 172.21.15.49:0/2238395911 >> v2:172.21.15.110:3300/0 conn(0x7f33d8065620 0x7f33d80bd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33d7400700 1 -- 172.21.15.49:0/2238395911 >> v1:172.21.15.110:6789/0 conn(0x7f33d8065240 legacy=0x7f33d80644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:41.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33d7400700 1 -- 172.21.15.49:0/2238395911 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80c2f60 con 0x7f33d8064c00 2024-01-22T05:13:41.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33d7400700 1 --2- 172.21.15.49:0/2238395911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d8064c00 0x7f33d80bcc80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f33c0009760 tx=0x7f33c0009060).ready entity=mon.2 client_cookie=ae828c76bf9ffdf2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:41.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.644+0000 7f33d6a00700 1 -- 172.21.15.49:0/2238395911 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c000d4a0 con 0x7f33d8064c00 2024-01-22T05:13:41.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.648+0000 7f33d6a00700 1 -- 172.21.15.49:0/2238395911 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c000d600 con 0x7f33d8064c00 2024-01-22T05:13:41.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.648+0000 7f33d6a00700 1 -- 172.21.15.49:0/2238395911 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c000d980 con 0x7f33d8064c00 2024-01-22T05:13:41.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.648+0000 7f33dea00700 1 -- 172.21.15.49:0/2238395911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d8064c00 msgr2=0x7f33d80bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:41.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.648+0000 7f33dea00700 1 --2- 172.21.15.49:0/2238395911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d8064c00 0x7f33d80bcc80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f33c0009760 tx=0x7f33c0009060).stop 2024-01-22T05:13:41.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.648+0000 7f33dea00700 1 -- 172.21.15.49:0/2238395911 shutdown_connections 2024-01-22T05:13:41.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.648+0000 7f33dea00700 1 --2- 172.21.15.49:0/2238395911 >> v2:172.21.15.110:3300/0 conn(0x7f33d8065620 0x7f33d80bd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.648+0000 7f33dea00700 1 --2- 172.21.15.49:0/2238395911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d8064c00 0x7f33d80bcc80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.648+0000 7f33dea00700 1 -- 172.21.15.49:0/2238395911 >> 172.21.15.49:0/2238395911 conn(0x7f33d80c87f0 msgr2=0x7f33d80c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:41.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.648+0000 7f33dea00700 1 -- 172.21.15.49:0/2238395911 shutdown_connections 2024-01-22T05:13:41.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.648+0000 7f33dea00700 1 -- 172.21.15.49:0/2238395911 wait complete. 2024-01-22T05:13:41.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33dea00700 1 Processor -- start 2024-01-22T05:13:41.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33dea00700 1 -- start start 2024-01-22T05:13:41.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33dea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33d8064c00 0x7f33d80aa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:41.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33dea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33d8065240 0x7f33d80c1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:41.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33dea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d8065620 0x7f33d80aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:41.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33dea00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d8152a50 con 0x7f33d8064c00 2024-01-22T05:13:41.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33dea00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d80c0490 con 0x7f33d8065240 2024-01-22T05:13:41.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33dea00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d80c0770 con 0x7f33d8065620 2024-01-22T05:13:41.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33d7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33d8064c00 0x7f33d80aa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:41.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33d7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33d8064c00 0x7f33d80aa080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58590/0 (socket says 172.21.15.49:58590) 2024-01-22T05:13:41.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33d7e00700 1 -- 172.21.15.49:0/42926656 learned_addr learned my addr 172.21.15.49:0/42926656 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:41.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33dd400700 1 --2- 172.21.15.49:0/42926656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d8065620 0x7f33d80aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:41.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33d7400700 1 --2- 172.21.15.49:0/42926656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33d8065240 0x7f33d80c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:41.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33d7e00700 1 -- 172.21.15.49:0/42926656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d8065620 msgr2=0x7f33d80aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:41.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33d7e00700 1 --2- 172.21.15.49:0/42926656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d8065620 0x7f33d80aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33d7e00700 1 -- 172.21.15.49:0/42926656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33d8065240 msgr2=0x7f33d80c1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:41.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33d7e00700 1 --2- 172.21.15.49:0/42926656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33d8065240 0x7f33d80c1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.652+0000 7f33d7e00700 1 -- 172.21.15.49:0/42926656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c00092a0 con 0x7f33d8064c00 2024-01-22T05:13:41.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.656+0000 7f33d7e00700 1 --2- 172.21.15.49:0/42926656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33d8064c00 0x7f33d80aa080 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f33c800c590 tx=0x7f33c8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:41.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.656+0000 7f33cf400700 1 -- 172.21.15.49:0/42926656 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c80072e0 con 0x7f33d8064c00 2024-01-22T05:13:41.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.656+0000 7f33cf400700 1 -- 172.21.15.49:0/42926656 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c8007440 con 0x7f33d8064c00 2024-01-22T05:13:41.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.656+0000 7f33cf400700 1 -- 172.21.15.49:0/42926656 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c80057a0 con 0x7f33d8064c00 2024-01-22T05:13:41.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.656+0000 7f33dea00700 1 -- 172.21.15.49:0/42926656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d80c0a50 con 0x7f33d8064c00 2024-01-22T05:13:41.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.656+0000 7f33dea00700 1 -- 172.21.15.49:0/42926656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d80c1010 con 0x7f33d8064c00 2024-01-22T05:13:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.656+0000 7f33dea00700 1 -- 172.21.15.49:0/42926656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d8047060 con 0x7f33d8064c00 2024-01-22T05:13:41.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.656+0000 7f33cf400700 1 -- 172.21.15.49:0/42926656 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f33c8005bd0 con 0x7f33d8064c00 2024-01-22T05:13:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.660+0000 7f33cf400700 1 --2- 172.21.15.49:0/42926656 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f33b005a510 0x7f33b005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.660+0000 7f33cf400700 1 -- 172.21.15.49:0/42926656 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f33c8074120 con 0x7f33d8064c00 2024-01-22T05:13:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.660+0000 7f33d7400700 1 --2- 172.21.15.49:0/42926656 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f33b005a510 0x7f33b005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:41.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.660+0000 7f33d7400700 1 --2- 172.21.15.49:0/42926656 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f33b005a510 0x7f33b005c9d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f33d8065000 tx=0x7f33c0016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:41.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.668+0000 7f33cf400700 1 -- 172.21.15.49:0/42926656 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f33c80476e0 con 0x7f33d8064c00 2024-01-22T05:13:41.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.832+0000 7f33dea00700 1 -- 172.21.15.49:0/42926656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33d80c3240 con 0x7f33d8064c00 2024-01-22T05:13:41.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.836+0000 7f33cf400700 1 -- 172.21.15.49:0/42926656 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+17178 (secure 0 0 0) 0x7f33c804ad00 con 0x7f33d8064c00 2024-01-22T05:13:41.838 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:41.838 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":117,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:13:39.000715+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:13:36.110138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-01-22T05:13:36.984415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:13:41.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.840+0000 7f33dea00700 1 -- 172.21.15.49:0/42926656 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f33b005a510 msgr2=0x7f33b005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:41.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.840+0000 7f33dea00700 1 --2- 172.21.15.49:0/42926656 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f33b005a510 0x7f33b005c9d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f33d8065000 tx=0x7f33c0016000).stop 2024-01-22T05:13:41.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.840+0000 7f33dea00700 1 -- 172.21.15.49:0/42926656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33d8064c00 msgr2=0x7f33d80aa080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:41.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.840+0000 7f33dea00700 1 --2- 172.21.15.49:0/42926656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33d8064c00 0x7f33d80aa080 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f33c800c590 tx=0x7f33c8007c80).stop 2024-01-22T05:13:41.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.840+0000 7f33dea00700 1 -- 172.21.15.49:0/42926656 shutdown_connections 2024-01-22T05:13:41.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.840+0000 7f33dea00700 1 --2- 172.21.15.49:0/42926656 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f33b005a510 0x7f33b005c9d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.840+0000 7f33dea00700 1 --2- 172.21.15.49:0/42926656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d8065620 0x7f33d80aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.840+0000 7f33dea00700 1 --2- 172.21.15.49:0/42926656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33d8065240 0x7f33d80c1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.840+0000 7f33dea00700 1 --2- 172.21.15.49:0/42926656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33d8064c00 0x7f33d80aa080 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:41.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.840+0000 7f33dea00700 1 -- 172.21.15.49:0/42926656 >> 172.21.15.49:0/42926656 conn(0x7f33d80c87f0 msgr2=0x7f33d80bcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:41.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.840+0000 7f33dea00700 1 -- 172.21.15.49:0/42926656 shutdown_connections 2024-01-22T05:13:41.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:41.840+0000 7f33dea00700 1 -- 172.21.15.49:0/42926656 wait complete. 2024-01-22T05:13:41.862 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:13:41.862 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:13:42.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.024+0000 7ff42e000700 1 Processor -- start 2024-01-22T05:13:42.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.024+0000 7ff42e000700 1 -- start start 2024-01-22T05:13:42.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.028+0000 7ff42e000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff42806a1c0 0x7ff4281508e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.028+0000 7ff42e000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4280c3dd0 con 0x7ff428064530 2024-01-22T05:13:42.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.028+0000 7ff42e000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff428150dd0 con 0x7ff4280a6720 2024-01-22T05:13:42.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.028+0000 7ff42e000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4280a6f00 con 0x7ff42806a1c0 2024-01-22T05:13:42.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.028+0000 7ff427e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff428064530 0x7ff428154600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53066/0 (socket says 172.21.15.49:53066) 2024-01-22T05:13:42.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.028+0000 7ff427e00700 1 -- 172.21.15.49:0/1975185349 learned_addr learned my addr 172.21.15.49:0/1975185349 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:42.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.028+0000 7ff427400700 1 --2- 172.21.15.49:0/1975185349 >> v2:172.21.15.110:3300/0 conn(0x7ff42806a1c0 0x7ff4281508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.028+0000 7ff426000700 1 -- 172.21.15.49:0/1975185349 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648236713 0 0) 0x7ff4280c3dd0 con 0x7ff428064530 2024-01-22T05:13:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.028+0000 7ff426000700 1 -- 172.21.15.49:0/1975185349 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4080033f0 con 0x7ff428064530 2024-01-22T05:13:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.028+0000 7ff426000700 1 -- 172.21.15.49:0/1975185349 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875588625 0 0) 0x7ff410001110 con 0x7ff4280a6720 2024-01-22T05:13:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.028+0000 7ff426000700 1 -- 172.21.15.49:0/1975185349 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4280c3dd0 con 0x7ff4280a6720 2024-01-22T05:13:42.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.032+0000 7ff427400700 1 -- 172.21.15.49:0/1975185349 >> v1:172.21.15.110:6789/0 conn(0x7ff4280a6720 legacy=0x7ff428063e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.032+0000 7ff427400700 1 -- 172.21.15.49:0/1975185349 >> v1:172.21.15.49:6789/0 conn(0x7ff428064530 legacy=0x7ff428154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.032+0000 7ff427400700 1 -- 172.21.15.49:0/1975185349 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42806a5a0 con 0x7ff42806a1c0 2024-01-22T05:13:42.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.032+0000 7ff427400700 1 --2- 172.21.15.49:0/1975185349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff42806a1c0 0x7ff4281508e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7ff418009760 tx=0x7ff418009060).ready entity=mon.1 client_cookie=b87c669f7c7c1308 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.032+0000 7ff426000700 1 -- 172.21.15.49:0/1975185349 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800d4a0 con 0x7ff42806a1c0 2024-01-22T05:13:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.032+0000 7ff426000700 1 -- 172.21.15.49:0/1975185349 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41800d600 con 0x7ff42806a1c0 2024-01-22T05:13:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.032+0000 7ff426000700 1 -- 172.21.15.49:0/1975185349 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800d980 con 0x7ff42806a1c0 2024-01-22T05:13:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.032+0000 7ff42e000700 1 -- 172.21.15.49:0/1975185349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff42806a1c0 msgr2=0x7ff4281508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.032+0000 7ff42e000700 1 --2- 172.21.15.49:0/1975185349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff42806a1c0 0x7ff4281508e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7ff418009760 tx=0x7ff418009060).stop 2024-01-22T05:13:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.032+0000 7ff42e000700 1 -- 172.21.15.49:0/1975185349 shutdown_connections 2024-01-22T05:13:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.032+0000 7ff42e000700 1 --2- 172.21.15.49:0/1975185349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff42806a1c0 0x7ff4281508e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.032+0000 7ff42e000700 1 -- 172.21.15.49:0/1975185349 >> 172.21.15.49:0/1975185349 conn(0x7ff428066830 msgr2=0x7ff428066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:42.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.032+0000 7ff42e000700 1 -- 172.21.15.49:0/1975185349 shutdown_connections 2024-01-22T05:13:42.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.032+0000 7ff42e000700 1 -- 172.21.15.49:0/1975185349 wait complete. 2024-01-22T05:13:42.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.036+0000 7ff42e000700 1 Processor -- start 2024-01-22T05:13:42.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.036+0000 7ff42e000700 1 -- start start 2024-01-22T05:13:42.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.036+0000 7ff42e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff428064530 0x7ff4280ac660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff42e000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff42806a1c0 0x7ff4280a8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff42e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4280a6720 0x7ff428163d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff42e000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280a3940 con 0x7ff4280a6720 2024-01-22T05:13:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff42e000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280a8fb0 con 0x7ff428064530 2024-01-22T05:13:42.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff42e000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280acd10 con 0x7ff42806a1c0 2024-01-22T05:13:42.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff427e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4280a6720 0x7ff428163d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff427400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff428064530 0x7ff4280ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff427e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4280a6720 0x7ff428163d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58606/0 (socket says 172.21.15.49:58606) 2024-01-22T05:13:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff427e00700 1 -- 172.21.15.49:0/3681636544 learned_addr learned my addr 172.21.15.49:0/3681636544 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff426a00700 1 --2- 172.21.15.49:0/3681636544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff42806a1c0 0x7ff4280a8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff427e00700 1 -- 172.21.15.49:0/3681636544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff42806a1c0 msgr2=0x7ff4280a8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff427e00700 1 --2- 172.21.15.49:0/3681636544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff42806a1c0 0x7ff4280a8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff427e00700 1 -- 172.21.15.49:0/3681636544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff428064530 msgr2=0x7ff4280ac660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff427e00700 1 --2- 172.21.15.49:0/3681636544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff428064530 0x7ff4280ac660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff427e00700 1 -- 172.21.15.49:0/3681636544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4180092a0 con 0x7ff4280a6720 2024-01-22T05:13:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff427e00700 1 --2- 172.21.15.49:0/3681636544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4280a6720 0x7ff428163d80 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7ff420001460 tx=0x7ff420007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff41ea00700 1 -- 172.21.15.49:0/3681636544 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420005d30 con 0x7ff4280a6720 2024-01-22T05:13:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff41ea00700 1 -- 172.21.15.49:0/3681636544 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff420005e90 con 0x7ff4280a6720 2024-01-22T05:13:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff41ea00700 1 -- 172.21.15.49:0/3681636544 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420007300 con 0x7ff4280a6720 2024-01-22T05:13:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff42e000700 1 -- 172.21.15.49:0/3681636544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4280acff0 con 0x7ff4280a6720 2024-01-22T05:13:42.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.040+0000 7ff42e000700 1 -- 172.21.15.49:0/3681636544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4280ad5b0 con 0x7ff4280a6720 2024-01-22T05:13:42.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.044+0000 7ff42e000700 1 -- 172.21.15.49:0/3681636544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4280a3af0 con 0x7ff4280a6720 2024-01-22T05:13:42.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.044+0000 7ff41ea00700 1 -- 172.21.15.49:0/3681636544 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff420007670 con 0x7ff4280a6720 2024-01-22T05:13:42.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.044+0000 7ff41ea00700 1 --2- 172.21.15.49:0/3681636544 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff40005a510 0x7ff40005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.044+0000 7ff41ea00700 1 -- 172.21.15.49:0/3681636544 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff4200742d0 con 0x7ff4280a6720 2024-01-22T05:13:42.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.044+0000 7ff427400700 1 --2- 172.21.15.49:0/3681636544 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff40005a510 0x7ff40005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.048+0000 7ff427400700 1 --2- 172.21.15.49:0/3681636544 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff40005a510 0x7ff40005c9d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7ff41800d260 tx=0x7ff418016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:42.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.052+0000 7ff41ea00700 1 -- 172.21.15.49:0/3681636544 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff4280a3af0 con 0x7ff4280a6720 2024-01-22T05:13:42.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.212+0000 7ff42e000700 1 -- 172.21.15.49:0/3681636544 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4280a3a80 con 0x7ff40005a510 2024-01-22T05:13:42.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.224+0000 7ff41ea00700 1 -- 172.21.15.49:0/3681636544 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350609 (secure 0 0 0) 0x7ff4280a3a80 con 0x7ff40005a510 2024-01-22T05:13:42.234 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.236+0000 7ff42e000700 1 -- 172.21.15.49:0/3681636544 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff40005a510 msgr2=0x7ff40005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.236+0000 7ff42e000700 1 --2- 172.21.15.49:0/3681636544 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff40005a510 0x7ff40005c9d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7ff41800d260 tx=0x7ff418016000).stop 2024-01-22T05:13:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.236+0000 7ff42e000700 1 -- 172.21.15.49:0/3681636544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4280a6720 msgr2=0x7ff428163d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.236+0000 7ff42e000700 1 --2- 172.21.15.49:0/3681636544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4280a6720 0x7ff428163d80 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7ff420001460 tx=0x7ff420007f70).stop 2024-01-22T05:13:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.236+0000 7ff42e000700 1 -- 172.21.15.49:0/3681636544 shutdown_connections 2024-01-22T05:13:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.236+0000 7ff42e000700 1 --2- 172.21.15.49:0/3681636544 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff40005a510 0x7ff40005c9d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.236+0000 7ff42e000700 1 --2- 172.21.15.49:0/3681636544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4280a6720 0x7ff428163d80 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.236+0000 7ff42e000700 1 --2- 172.21.15.49:0/3681636544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff42806a1c0 0x7ff4280a8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.236+0000 7ff42e000700 1 --2- 172.21.15.49:0/3681636544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff428064530 0x7ff4280ac660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.236+0000 7ff42e000700 1 -- 172.21.15.49:0/3681636544 >> 172.21.15.49:0/3681636544 conn(0x7ff428066830 msgr2=0x7ff4280bcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:42.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.236+0000 7ff42e000700 1 -- 172.21.15.49:0/3681636544 shutdown_connections 2024-01-22T05:13:42.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.236+0000 7ff42e000700 1 -- 172.21.15.49:0/3681636544 wait complete. 2024-01-22T05:13:42.240 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:13:42.260 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":387,"stamp":"2024-01-22T05:13:41.426892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437960,"kb_used_data":11016,"kb_used_omap":0,"kb_used_meta":2426880,"kb_avail":752536760,"statfs":{"total":773094113280,"available":770597642240,"internally_reserved":0,"allocated":11280384,"data_stored":5553164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485125120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077814386,"num_objects":-1078,"num_object_clones":0,"num_object_copies":-2156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3210,"num_write_kb":-1053285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.056634"},"pg_stats":[{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.522183+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.520679+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.522301+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.522510+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.525127+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515821+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515535+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515836+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515906+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.524411+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.510645+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.511704+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521631+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.517014+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.516890+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.516029+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521164+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.519952+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521743+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.510739+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.517295+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.523488+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.519782+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.523811+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.510963+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.511746+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.509972+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515947+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.516084+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.511398+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514961+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514900+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.509806+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.518248+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515181+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514282+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.511835+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.522403+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.510970+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.523179+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.520132+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514701+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.516372+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.509806+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.524122+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.513749+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.525857+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521504+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.523430+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.516145+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.520200+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521926+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.509972+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.510571+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.513745+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.519838+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521098+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:35.031670+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:13:35.031670+0000","last_peered":"2024-01-22T05:13:35.031670+0000","last_clean":"2024-01-22T05:13:35.031670+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:13:35.031670+0000","last_undegraded":"2024-01-22T05:13:35.031670+0000","last_fullsized":"2024-01-22T05:13:35.031670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.520454+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":95,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:35.036169+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:13:35.036169+0000","last_peered":"2024-01-22T05:13:35.036169+0000","last_clean":"2024-01-22T05:13:35.036169+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:13:35.036169+0000","last_undegraded":"2024-01-22T05:13:35.036169+0000","last_fullsized":"2024-01-22T05:13:35.036169+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514178+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:34.684655+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:13:34.684655+0000","last_peered":"2024-01-22T05:13:34.684655+0000","last_clean":"2024-01-22T05:13:34.684655+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:13:34.684655+0000","last_undegraded":"2024-01-22T05:13:34.684655+0000","last_fullsized":"2024-01-22T05:13:34.684655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.523347+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:35.036193+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:13:35.036193+0000","last_peered":"2024-01-22T05:13:35.036193+0000","last_clean":"2024-01-22T05:13:35.036193+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:13:35.036193+0000","last_undegraded":"2024-01-22T05:13:35.036193+0000","last_fullsized":"2024-01-22T05:13:35.036193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514178+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":106,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:33.639995+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:13:33.639995+0000","last_peered":"2024-01-22T05:13:33.639995+0000","last_clean":"2024-01-22T05:13:33.639995+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:13:33.639995+0000","last_undegraded":"2024-01-22T05:13:33.639995+0000","last_fullsized":"2024-01-22T05:13:33.639995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.524628+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:33.643018+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:13:33.643018+0000","last_peered":"2024-01-22T05:13:33.643018+0000","last_clean":"2024-01-22T05:13:33.643018+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:13:33.643018+0000","last_undegraded":"2024-01-22T05:13:33.643018+0000","last_fullsized":"2024-01-22T05:13:33.643018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515090+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:34.684610+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:13:34.684610+0000","last_peered":"2024-01-22T05:13:34.684610+0000","last_clean":"2024-01-22T05:13:34.684610+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:13:34.684610+0000","last_undegraded":"2024-01-22T05:13:34.684610+0000","last_fullsized":"2024-01-22T05:13:34.684610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.509817+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:33.640072+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:13:33.640072+0000","last_peered":"2024-01-22T05:13:33.640072+0000","last_clean":"2024-01-22T05:13:33.640072+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:13:33.640072+0000","last_undegraded":"2024-01-22T05:13:33.640072+0000","last_fullsized":"2024-01-22T05:13:33.640072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":89,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:34.684655+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:13:34.684655+0000","last_peered":"2024-01-22T05:13:34.684655+0000","last_clean":"2024-01-22T05:13:34.684655+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:13:34.684655+0000","last_undegraded":"2024-01-22T05:13:34.684655+0000","last_fullsized":"2024-01-22T05:13:34.684655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574960,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.006,"15min":1.0189999999999999},"min":{"1min":0.64700000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.04},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0720000000000001,"15min":1.0489999999999999},"min":{"1min":0.68500000000000005,"5min":0.63400000000000001,"15min":0.61899999999999999},"max":{"1min":1.371,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":1.0489999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.98299999999999998,"15min":0.98199999999999998},"min":{"1min":0.74299999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4530000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.165,"15min":1.1659999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.456,"5min":7.1840000000000002,"15min":7.1840000000000002},"last":1.2070000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.1180000000000001,"15min":1.1020000000000001},"min":{"1min":0.74399999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.962,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.161,"15min":1.161},"min":{"1min":0.73999999999999999,"5min":0.73799999999999999,"15min":0.68899999999999995},"max":{"1min":1.589,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.96799999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.216,"15min":1.2210000000000001},"min":{"1min":0.90400000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.6499999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.079},{"interface":"front","average":{"1min":1.23,"5min":1.264,"15min":1.2330000000000001},"min":{"1min":0.91400000000000003,"5min":0.78300000000000003,"15min":0.60199999999999998},"max":{"1min":1.6930000000000001,"5min":6.4589999999999996,"15min":6.4589999999999996},"last":0.90600000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0529999999999999,"15min":1.0569999999999999},"min":{"1min":0.52600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.514,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.111,"15min":1.1439999999999999},"min":{"1min":0.66500000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.7130000000000001,"5min":2.077,"15min":2.077},"last":1.1719999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1599999999999999,"15min":1.181},"min":{"1min":0.64400000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.7849999999999999,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.276,"15min":1.232},"min":{"1min":0.76700000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.0329999999999999,"5min":3.625,"15min":3.625},"last":1.0009999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.169,"15min":1.228},"min":{"1min":0.64800000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5920000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.351,"15min":1.333},"min":{"1min":0.80800000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.1339999999999999,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":1.129}]}]},{"osd":6,"up_from":13,"seq":55834574960,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1400832,"data_stored":689215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.7509999999999999,"15min":1.3069999999999999},"min":{"1min":0.52400000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.679,"5min":77.745000000000005,"15min":77.745000000000005},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.012,"5min":1.115,"15min":1.0660000000000001},"min":{"1min":0.54700000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.4990000000000001,"5min":13.555999999999999,"15min":13.555999999999999},"last":0.93100000000000005}]},{"osd":1,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.2330000000000001,"15min":1.1080000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.40000000000000002},"max":{"1min":1.4239999999999999,"5min":15.499000000000001,"15min":15.499000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.1779999999999999,"15min":1.2070000000000001},"min":{"1min":0.80500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.6080000000000001,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":1.079}]},{"osd":2,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1459999999999999,"15min":1.1519999999999999},"min":{"1min":0.70999999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.823,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":1.171},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.139,"15min":1.111},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.38200000000000001},"max":{"1min":1.579,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.278}]},{"osd":3,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":2.0979999999999999,"15min":1.454},"min":{"1min":0.72199999999999998,"5min":0.69299999999999995,"15min":0.59299999999999997},"max":{"1min":1.6220000000000001,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.405},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.319,"15min":1.232},"min":{"1min":0.879,"5min":0.66600000000000004,"15min":0.374},"max":{"1min":1.552,"5min":15.468,"15min":15.468},"last":0.74399999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.0960000000000001,"15min":1.095},"min":{"1min":0.65500000000000003,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.772,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.0940000000000001,"15min":1.1180000000000001},"min":{"1min":0.748,"5min":0.56899999999999995,"15min":0.48299999999999998},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.48}]},{"osd":5,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.415,"15min":1.254},"min":{"1min":0.66100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5980000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.26,"15min":1.2689999999999999},"min":{"1min":0.748,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8759999999999999,"5min":3.875,"15min":3.875},"last":1.3640000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4790000000000001,"15min":1.4059999999999999},"min":{"1min":1.0289999999999999,"5min":0.72599999999999998,"15min":0.42699999999999999},"max":{"1min":1.774,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.9119999999999999,"15min":1.5649999999999999},"min":{"1min":0.73099999999999998,"5min":0.60199999999999998,"15min":0.495},"max":{"1min":1.7729999999999999,"5min":63.737000000000002,"15min":63.737000000000002},"last":1.329}]}]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.044,"15min":1.004},"min":{"1min":0.67900000000000005,"5min":0.61599999999999999,"15min":0.53300000000000003},"max":{"1min":1.5640000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.0209999999999999,"15min":1.0780000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3460000000000001,"5min":1.5680000000000001,"15min":1.571},"last":1.397}]},{"osd":1,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.173,"15min":1.1970000000000001},"min":{"1min":0.93000000000000005,"5min":0.67300000000000004,"15min":0.50600000000000001},"max":{"1min":1.4610000000000001,"5min":1.6859999999999999,"15min":1.821},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.175,"15min":1.2609999999999999},"min":{"1min":0.80100000000000005,"5min":0.76000000000000001,"15min":0.50900000000000001},"max":{"1min":1.9690000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.042}]},{"osd":2,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.1319999999999999,"15min":1.143},"min":{"1min":0.78400000000000003,"5min":0.77900000000000003,"15min":0.63500000000000001},"max":{"1min":1.286,"5min":1.925,"15min":1.925},"last":1.151},{"interface":"front","average":{"1min":1.125,"5min":1.107,"15min":1.1279999999999999},"min":{"1min":0.82999999999999996,"5min":0.64200000000000002,"15min":0.59899999999999998},"max":{"1min":1.4059999999999999,"5min":1.859,"15min":1.859},"last":1.347}]},{"osd":3,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.115,"15min":1.165},"min":{"1min":0.85199999999999998,"5min":0.76100000000000001,"15min":0.73499999999999999},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.931},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.2090000000000001,"15min":1.2689999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":4.8819999999999997,"5min":4.8819999999999997,"15min":4.8819999999999997},"last":1.2609999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0329999999999999,"15min":1.1419999999999999},"min":{"1min":0.60099999999999998,"5min":0.51700000000000002,"15min":0.44400000000000001},"max":{"1min":1.3520000000000001,"5min":1.5780000000000001,"15min":1.7829999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.04,"5min":1.107,"15min":1.2390000000000001},"min":{"1min":0.65100000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.401,"5min":1.8300000000000001,"15min":2.0699999999999998},"last":1.1970000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1519999999999999,"15min":1.284},"min":{"1min":0.874,"5min":0.63600000000000001,"15min":0.58199999999999996},"max":{"1min":1.615,"5min":1.8129999999999999,"15min":2.2010000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.208,"15min":1.2769999999999999},"min":{"1min":0.93200000000000005,"5min":0.56100000000000005,"15min":0.55900000000000005},"max":{"1min":1.7150000000000001,"5min":1.7829999999999999,"15min":1.909},"last":1.4610000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.226,"15min":1.3640000000000001},"min":{"1min":0.77300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5149999999999999,"5min":1.766,"15min":2.3359999999999999},"last":1.319},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2549999999999999,"15min":1.4079999999999999},"min":{"1min":0.64200000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":3.1840000000000002},"last":1.4319999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.0980000000000001,"15min":1.1200000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.726,"5min":1.7490000000000001,"15min":2.0150000000000001},"last":0.755},{"interface":"front","average":{"1min":1.107,"5min":1.1399999999999999,"15min":1.1060000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.484,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.0589999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.081,"15min":1.0820000000000001},"min":{"1min":0.72499999999999998,"5min":0.64000000000000001,"15min":0.53100000000000003},"max":{"1min":1.448,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.46},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.052,"15min":1.145},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":2.194},"last":0.98299999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.52800000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5009999999999999,"5min":1.7030000000000001,"15min":5.3390000000000004},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.1379999999999999,"15min":1.226},"min":{"1min":0.77000000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.641,"5min":1.641,"15min":2.3479999999999999},"last":1.169}]},{"osd":3,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1080000000000001,"15min":1.1599999999999999},"min":{"1min":0.72699999999999998,"5min":0.59299999999999997,"15min":0.496},"max":{"1min":1.468,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1180000000000001,"15min":1.151},"min":{"1min":0.71499999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.643,"5min":1.671,"15min":5.3029999999999999},"last":1.0920000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0669999999999999,"15min":1.171},"min":{"1min":0.73099999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.589,"5min":1.6970000000000001,"15min":2.0790000000000002},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.056,"15min":1.127},"min":{"1min":0.60499999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4219999999999999,"5min":1.597,"15min":2.0030000000000001},"last":1.129}]},{"osd":6,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.089,"15min":1.163},"min":{"1min":0.63100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.573,"5min":1.6160000000000001,"15min":5.3769999999999998},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.167,"15min":1.3440000000000001},"min":{"1min":0.84999999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.641,"5min":1.778,"15min":4.4409999999999998},"last":1.3959999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.246,"15min":1.327},"min":{"1min":0.97299999999999998,"5min":0.66500000000000004,"15min":0.59399999999999997},"max":{"1min":1.5840000000000001,"5min":1.833,"15min":2.2839999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.2589999999999999,"15min":1.3460000000000001},"min":{"1min":0.95499999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.72,"5min":1.72,"15min":5.2629999999999999},"last":1.5}]}]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.84099999999999997,"15min":0.89700000000000002},"min":{"1min":0.60699999999999998,"5min":0.46200000000000002,"15min":0.34200000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":14.859},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89600000000000002,"15min":0.89200000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.317},"max":{"1min":1.3109999999999999,"5min":2.3519999999999999,"15min":5.0919999999999996},"last":1.103}]},{"osd":1,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.96499999999999997,"15min":0.88700000000000001},"min":{"1min":0.68200000000000005,"5min":0.57899999999999996,"15min":0.39300000000000002},"max":{"1min":1.224,"5min":6.5570000000000004,"15min":6.5570000000000004},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.01,"5min":0.97399999999999998,"15min":0.98199999999999998},"min":{"1min":0.69199999999999995,"5min":0.52800000000000002,"15min":0.48399999999999999},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":5.7519999999999998},"last":0.96099999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1519999999999999},"min":{"1min":0.64500000000000002,"5min":0.64000000000000001,"15min":0.40600000000000003},"max":{"1min":1.599,"5min":2.391,"15min":2.391},"last":1.228},{"interface":"front","average":{"1min":1.284,"5min":1.25,"15min":1.2050000000000001},"min":{"1min":0.84999999999999998,"5min":0.501,"15min":0.44800000000000001},"max":{"1min":1.7030000000000001,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":1.1559999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3799999999999999,"15min":1.3240000000000001},"min":{"1min":0.82799999999999996,"5min":0.71299999999999997,"15min":0.51700000000000002},"max":{"1min":1.6819999999999999,"5min":10.858000000000001,"15min":10.858000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.397,"15min":1.3580000000000001},"min":{"1min":1.0409999999999999,"5min":0.79500000000000004,"15min":0.63600000000000001},"max":{"1min":1.7529999999999999,"5min":10.846,"15min":10.846},"last":1.498}]},{"osd":5,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.319,"15min":1.304},"min":{"1min":1.006,"5min":0.74099999999999999,"15min":0.505},"max":{"1min":1.655,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":1.266},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.5229999999999999,"15min":1.373},"min":{"1min":0.89400000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.7909999999999999,"5min":14.523999999999999,"15min":14.523999999999999},"last":1.175}]},{"osd":6,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3260000000000001,"15min":1.3899999999999999},"min":{"1min":0.95699999999999996,"5min":0.81699999999999995,"15min":0.56699999999999995},"max":{"1min":1.8899999999999999,"5min":2.2610000000000001,"15min":4.9809999999999999},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.45,"5min":1.373,"15min":1.405},"min":{"1min":1.22,"5min":0.78800000000000003,"15min":0.68500000000000005},"max":{"1min":1.923,"5min":1.923,"15min":5.4210000000000003},"last":1.407}]},{"osd":7,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.3680000000000001,"15min":1.393},"min":{"1min":1.097,"5min":0.95699999999999996,"15min":0.79900000000000004},"max":{"1min":2.0539999999999998,"5min":2.472,"15min":5.7160000000000002},"last":1.083},{"interface":"front","average":{"1min":1.381,"5min":1.4399999999999999,"15min":1.4339999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.71299999999999997},"max":{"1min":1.748,"5min":6.4279999999999999,"15min":6.4279999999999999},"last":1.3009999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.79300000000000004,"15min":0.75900000000000001},"min":{"1min":0.61899999999999999,"5min":0.46100000000000002,"15min":0.38500000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.90500000000000003,"15min":0.84399999999999997},"min":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.373},"max":{"1min":1.27,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.86599999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89600000000000002,"15min":0.82499999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2729999999999999,"5min":1.534,"15min":1.534},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.96299999999999997,"15min":0.94199999999999995},"min":{"1min":0.81999999999999995,"5min":0.57499999999999996,"15min":0.41599999999999998},"max":{"1min":1.383,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.1950000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.206,"15min":1.0980000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.7569999999999999,"5min":1.79,"15min":2.0779999999999998},"last":1.329},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.272,"15min":1.1910000000000001},"min":{"1min":0.76000000000000001,"5min":0.58499999999999996,"15min":0.51100000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.9990000000000001},"last":1.5249999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.2689999999999999,"15min":1.2869999999999999},"min":{"1min":1.014,"5min":0.71299999999999997,"15min":0.59099999999999997},"max":{"1min":1.647,"5min":1.647,"15min":2.1709999999999998},"last":1.369},{"interface":"front","average":{"1min":1.343,"5min":1.208,"15min":1.204},"min":{"1min":0.84899999999999998,"5min":0.66400000000000003,"15min":0.63500000000000001},"max":{"1min":1.7490000000000001,"5min":1.837,"15min":1.952},"last":1.5389999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.2609999999999999,"15min":1.2030000000000001},"min":{"1min":0.90000000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6120000000000001,"5min":2.0510000000000002,"15min":2.3660000000000001},"last":1.276},{"interface":"front","average":{"1min":1.373,"5min":1.274,"15min":1.298},"min":{"1min":1.143,"5min":0.77000000000000002,"15min":0.67000000000000004},"max":{"1min":1.7010000000000001,"5min":1.8600000000000001,"15min":2.2210000000000001},"last":1.4550000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.28,"15min":1.2569999999999999},"min":{"1min":0.89200000000000002,"5min":0.77600000000000002,"15min":0.68400000000000005},"max":{"1min":1.766,"5min":1.8360000000000001,"15min":2.1920000000000002},"last":1.595},{"interface":"front","average":{"1min":1.431,"5min":1.3400000000000001,"15min":1.2949999999999999},"min":{"1min":0.86699999999999999,"5min":0.84399999999999997,"15min":0.83999999999999997},"max":{"1min":1.9299999999999999,"5min":2.1320000000000001,"15min":2.4449999999999998},"last":1.393}]},{"osd":7,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.3680000000000001,"15min":1.3540000000000001},"min":{"1min":1.0469999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9199999999999999},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.516,"5min":1.4550000000000001,"15min":1.4139999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.89000000000000001},"max":{"1min":1.8069999999999999,"5min":2.0329999999999999,"15min":2.5059999999999998},"last":1.4790000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.89600000000000002,"15min":0.86199999999999999},"min":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":1.911,"5min":1.911,"15min":3.4119999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0289999999999999,"15min":1.006},"min":{"1min":0.42899999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8680000000000001,"5min":1.873,"15min":2.101},"last":1.1140000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.008,"15min":1},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.448},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0620000000000001,"15min":1.034},"min":{"1min":0.60599999999999998,"5min":0.59099999999999997,"15min":0.46899999999999997},"max":{"1min":1.671,"5min":1.71,"15min":2.008},"last":0.92700000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.046,"15min":1.016},"min":{"1min":0.66600000000000004,"5min":0.54800000000000004,"15min":0.38900000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":4.665},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.224,"5min":1.032,"15min":0.92700000000000005},"min":{"1min":0.55200000000000005,"5min":0.50600000000000001,"15min":0.41899999999999998},"max":{"1min":4.1319999999999997,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":0.95299999999999996}]},{"osd":4,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.359,"15min":1.248},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.60599999999999998},"max":{"1min":2.2509999999999999,"5min":15.76,"15min":15.76},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.456,"15min":1.3160000000000001},"min":{"1min":0.94399999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.77,"5min":16.975000000000001,"15min":16.975000000000001},"last":1.0349999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.258,"15min":1.206},"min":{"1min":0.80900000000000005,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":4.3230000000000004,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":1.383},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3009999999999999,"15min":1.276},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.3330000000000002,"5min":2.52,"15min":2.52},"last":1.573}]},{"osd":6,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.288,"15min":1.2689999999999999},"min":{"1min":0.89900000000000002,"5min":0.83899999999999997,"15min":0.76000000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.355,"15min":1.3380000000000001},"min":{"1min":0.77400000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.5569999999999999,"5min":2.5569999999999999,"15min":2.5569999999999999},"last":1.669}]},{"osd":7,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3600000000000001,"15min":1.3700000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.77400000000000002},"max":{"1min":1.829,"5min":2.0019999999999998,"15min":4.4329999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.377,"15min":1.363},"min":{"1min":1.0089999999999999,"5min":0.81999999999999995,"15min":0.77600000000000002},"max":{"1min":4.3970000000000002,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.6060000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1400832,"data_stored":689215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.99199999999999999,"15min":0.93600000000000005},"min":{"1min":0.56499999999999995,"5min":0.34799999999999998,"15min":0.28699999999999998},"max":{"1min":1.972,"5min":15.273,"15min":15.273},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.95699999999999996,"15min":0.96499999999999997},"min":{"1min":0.70199999999999996,"5min":0.51800000000000002,"15min":0.34499999999999997},"max":{"1min":1.381,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.0069999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1499999999999999,"15min":1.091},"min":{"1min":0.755,"5min":0.48199999999999998,"15min":0.46400000000000002},"max":{"1min":1.4550000000000001,"5min":15.473000000000001,"15min":15.473000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.0489999999999999,"15min":1.0229999999999999},"min":{"1min":0.71699999999999997,"5min":0.626,"15min":0.45400000000000001},"max":{"1min":1.5249999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.1659999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.0049999999999999,"15min":1.0149999999999999},"min":{"1min":0.66200000000000003,"5min":0.40000000000000002,"15min":0.39000000000000001},"max":{"1min":1.409,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":0.878},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.2629999999999999,"15min":1.22},"min":{"1min":0.61799999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.647,"5min":15.439,"15min":15.439},"last":1.679}]},{"osd":4,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.236,"15min":1.325},"min":{"1min":0.91600000000000004,"5min":0.68200000000000005,"15min":0.61399999999999999},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":5.1799999999999997},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.204,"15min":1.2330000000000001},"min":{"1min":0.78200000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.7909999999999999,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":1.194}]},{"osd":5,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.244,"15min":1.329},"min":{"1min":0.88200000000000001,"5min":0.755,"15min":0.755},"max":{"1min":1.8149999999999999,"5min":2.891,"15min":3.548},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.321,"15min":1.3759999999999999},"min":{"1min":1.153,"5min":0.75900000000000001,"15min":0.59499999999999997},"max":{"1min":2.2309999999999999,"5min":2.823,"15min":2.823},"last":1.587}]},{"osd":6,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.506,"15min":1.456},"min":{"1min":1.1180000000000001,"5min":0.81399999999999995,"15min":0.59099999999999997},"max":{"1min":2.0950000000000002,"5min":15.4,"15min":15.4},"last":1.415},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.399,"15min":1.4590000000000001},"min":{"1min":1.0389999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.871,"5min":7.1349999999999998,"15min":7.1349999999999998},"last":1.627}]},{"osd":7,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.405,"15min":1.5489999999999999},"min":{"1min":1.141,"5min":0.91400000000000003,"15min":0.79900000000000004},"max":{"1min":1.8560000000000001,"5min":2.1080000000000001,"15min":5.29},"last":1.76},{"interface":"front","average":{"1min":1.419,"5min":1.3660000000000001,"15min":1.405},"min":{"1min":1.0609999999999999,"5min":0.81799999999999995,"15min":0.752},"max":{"1min":2.1869999999999998,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.5329999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:13:42.267 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:13:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.464+0000 7f2d78a00700 1 Processor -- start 2024-01-22T05:13:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.464+0000 7f2d78a00700 1 -- start start 2024-01-22T05:13:42.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d78a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d700c3690 0x7f2d700c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d78a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d700bf0b0 0x7f2d701559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d78a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d700bdc10 con 0x7f2d70155550 2024-01-22T05:13:42.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d78a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d700c3f60 con 0x7f2d700bf0b0 2024-01-22T05:13:42.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d78a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d70155ea0 con 0x7f2d700c3690 2024-01-22T05:13:42.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d75600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2d70155550 0x7f2d70067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53074/0 (socket says 172.21.15.49:53074) 2024-01-22T05:13:42.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d75600700 1 -- 172.21.15.49:0/3143356874 learned_addr learned my addr 172.21.15.49:0/3143356874 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:42.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d76a00700 1 --2- 172.21.15.49:0/3143356874 >> v2:172.21.15.49:3300/0 conn(0x7f2d700bf0b0 0x7f2d701559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d76000700 1 --2- 172.21.15.49:0/3143356874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d700c3690 0x7f2d700c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d74c00700 1 -- 172.21.15.49:0/3143356874 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070586533 0 0) 0x7f2d700bdc10 con 0x7f2d70155550 2024-01-22T05:13:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d74c00700 1 -- 172.21.15.49:0/3143356874 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d500033f0 con 0x7f2d70155550 2024-01-22T05:13:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d76a00700 1 -- 172.21.15.49:0/3143356874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d700c3690 msgr2=0x7f2d700c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d76a00700 1 --2- 172.21.15.49:0/3143356874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d700c3690 0x7f2d700c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d76a00700 1 -- 172.21.15.49:0/3143356874 >> v1:172.21.15.49:6789/0 conn(0x7f2d70155550 legacy=0x7f2d70067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d76a00700 1 -- 172.21.15.49:0/3143356874 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d70068e10 con 0x7f2d700bf0b0 2024-01-22T05:13:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.468+0000 7f2d76a00700 1 --2- 172.21.15.49:0/3143356874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d700bf0b0 0x7f2d701559b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f2d68009e60 tx=0x7f2d68009780).ready entity=mon.0 client_cookie=4e76da558016760 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.472+0000 7f2d74c00700 1 -- 172.21.15.49:0/3143356874 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6800e070 con 0x7f2d700bf0b0 2024-01-22T05:13:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.472+0000 7f2d74c00700 1 -- 172.21.15.49:0/3143356874 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6800bab0 con 0x7f2d700bf0b0 2024-01-22T05:13:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.472+0000 7f2d74c00700 1 -- 172.21.15.49:0/3143356874 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6800be30 con 0x7f2d700bf0b0 2024-01-22T05:13:42.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.472+0000 7f2d78a00700 1 -- 172.21.15.49:0/3143356874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d700bf0b0 msgr2=0x7f2d701559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.472+0000 7f2d78a00700 1 --2- 172.21.15.49:0/3143356874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d700bf0b0 0x7f2d701559b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f2d68009e60 tx=0x7f2d68009780).stop 2024-01-22T05:13:42.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.472+0000 7f2d78a00700 1 -- 172.21.15.49:0/3143356874 shutdown_connections 2024-01-22T05:13:42.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.472+0000 7f2d78a00700 1 --2- 172.21.15.49:0/3143356874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d700bf0b0 0x7f2d701559b0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.472+0000 7f2d78a00700 1 --2- 172.21.15.49:0/3143356874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d700c3690 0x7f2d700c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.472+0000 7f2d78a00700 1 -- 172.21.15.49:0/3143356874 >> 172.21.15.49:0/3143356874 conn(0x7f2d700c51c0 msgr2=0x7f2d700c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.472+0000 7f2d78a00700 1 -- 172.21.15.49:0/3143356874 shutdown_connections 2024-01-22T05:13:42.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.472+0000 7f2d78a00700 1 -- 172.21.15.49:0/3143356874 wait complete. 2024-01-22T05:13:42.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.476+0000 7f2d78a00700 1 Processor -- start 2024-01-22T05:13:42.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.476+0000 7f2d78a00700 1 -- start start 2024-01-22T05:13:42.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d78a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d700bf0b0 0x7f2d7014bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d78a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d700c3690 0x7f2d700ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d78a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d70155550 0x7f2d70154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d78a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d700abfd0 con 0x7f2d700bf0b0 2024-01-22T05:13:42.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d78a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d700ac2b0 con 0x7f2d70155550 2024-01-22T05:13:42.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d78a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d700ac590 con 0x7f2d700c3690 2024-01-22T05:13:42.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d76000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d700bf0b0 0x7f2d7014bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d76000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d700bf0b0 0x7f2d7014bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58614/0 (socket says 172.21.15.49:58614) 2024-01-22T05:13:42.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d76000700 1 -- 172.21.15.49:0/2617058076 learned_addr learned my addr 172.21.15.49:0/2617058076 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:42.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d76a00700 1 --2- 172.21.15.49:0/2617058076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d70155550 0x7f2d70154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d75600700 1 --2- 172.21.15.49:0/2617058076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d700c3690 0x7f2d700ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d76000700 1 -- 172.21.15.49:0/2617058076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d700c3690 msgr2=0x7f2d700ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d76000700 1 --2- 172.21.15.49:0/2617058076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d700c3690 0x7f2d700ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d76000700 1 -- 172.21.15.49:0/2617058076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d70155550 msgr2=0x7f2d70154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d76000700 1 --2- 172.21.15.49:0/2617058076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d70155550 0x7f2d70154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d76000700 1 -- 172.21.15.49:0/2617058076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d68009a20 con 0x7f2d700bf0b0 2024-01-22T05:13:42.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d76000700 1 --2- 172.21.15.49:0/2617058076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d700bf0b0 0x7f2d7014bea0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f2d6000e930 tx=0x7f2d60009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:42.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d6d600700 1 -- 172.21.15.49:0/2617058076 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d60012600 con 0x7f2d700bf0b0 2024-01-22T05:13:42.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d6d600700 1 -- 172.21.15.49:0/2617058076 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d60012760 con 0x7f2d700bf0b0 2024-01-22T05:13:42.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d6d600700 1 -- 172.21.15.49:0/2617058076 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d60012ae0 con 0x7f2d700bf0b0 2024-01-22T05:13:42.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.480+0000 7f2d78a00700 1 -- 172.21.15.49:0/2617058076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d700ac870 con 0x7f2d700bf0b0 2024-01-22T05:13:42.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.484+0000 7f2d78a00700 1 -- 172.21.15.49:0/2617058076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7014c390 con 0x7f2d700bf0b0 2024-01-22T05:13:42.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.484+0000 7f2d78a00700 1 -- 172.21.15.49:0/2617058076 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d70151ce0 con 0x7f2d700bf0b0 2024-01-22T05:13:42.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.484+0000 7f2d6d600700 1 -- 172.21.15.49:0/2617058076 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2d6001b400 con 0x7f2d700bf0b0 2024-01-22T05:13:42.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.488+0000 7f2d6d600700 1 --2- 172.21.15.49:0/2617058076 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d4805a510 0x7f2d4805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.488+0000 7f2d6d600700 1 -- 172.21.15.49:0/2617058076 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2d60074df0 con 0x7f2d700bf0b0 2024-01-22T05:13:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.488+0000 7f2d75600700 1 --2- 172.21.15.49:0/2617058076 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d4805a510 0x7f2d4805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.488+0000 7f2d75600700 1 --2- 172.21.15.49:0/2617058076 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d4805a510 0x7f2d4805c9d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f2d58007fd0 tx=0x7f2d58009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:42.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.492+0000 7f2d6d600700 1 -- 172.21.15.49:0/2617058076 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2d60048350 con 0x7f2d700bf0b0 2024-01-22T05:13:42.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.652+0000 7f2d78a00700 1 -- 172.21.15.49:0/2617058076 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d70047060 con 0x7f2d4805a510 2024-01-22T05:13:42.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.664+0000 7f2d6d600700 1 -- 172.21.15.49:0/2617058076 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350609 (secure 0 0 0) 0x7f2d70047060 con 0x7f2d4805a510 2024-01-22T05:13:42.671 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:42.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.676+0000 7f2d78a00700 1 -- 172.21.15.49:0/2617058076 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d4805a510 msgr2=0x7f2d4805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.676+0000 7f2d78a00700 1 --2- 172.21.15.49:0/2617058076 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d4805a510 0x7f2d4805c9d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f2d58007fd0 tx=0x7f2d58009040).stop 2024-01-22T05:13:42.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.676+0000 7f2d78a00700 1 -- 172.21.15.49:0/2617058076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d700bf0b0 msgr2=0x7f2d7014bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.676+0000 7f2d78a00700 1 --2- 172.21.15.49:0/2617058076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d700bf0b0 0x7f2d7014bea0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f2d6000e930 tx=0x7f2d60009060).stop 2024-01-22T05:13:42.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.676+0000 7f2d78a00700 1 -- 172.21.15.49:0/2617058076 shutdown_connections 2024-01-22T05:13:42.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.676+0000 7f2d78a00700 1 --2- 172.21.15.49:0/2617058076 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d4805a510 0x7f2d4805c9d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.676+0000 7f2d78a00700 1 --2- 172.21.15.49:0/2617058076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d70155550 0x7f2d70154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.676+0000 7f2d78a00700 1 --2- 172.21.15.49:0/2617058076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d700c3690 0x7f2d700ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.676+0000 7f2d78a00700 1 --2- 172.21.15.49:0/2617058076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d700bf0b0 0x7f2d7014bea0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.676+0000 7f2d78a00700 1 -- 172.21.15.49:0/2617058076 >> 172.21.15.49:0/2617058076 conn(0x7f2d700c51c0 msgr2=0x7f2d700a9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:42.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.676+0000 7f2d78a00700 1 -- 172.21.15.49:0/2617058076 shutdown_connections 2024-01-22T05:13:42.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.676+0000 7f2d78a00700 1 -- 172.21.15.49:0/2617058076 wait complete. 2024-01-22T05:13:42.683 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:13:42.702 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":387,"stamp":"2024-01-22T05:13:41.426892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437960,"kb_used_data":11016,"kb_used_omap":0,"kb_used_meta":2426880,"kb_avail":752536760,"statfs":{"total":773094113280,"available":770597642240,"internally_reserved":0,"allocated":11280384,"data_stored":5553164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485125120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077814386,"num_objects":-1078,"num_object_clones":0,"num_object_copies":-2156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3210,"num_write_kb":-1053285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.056634"},"pg_stats":[{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.522183+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.520679+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.522301+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.522510+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.525127+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515821+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515535+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515836+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515906+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.524411+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.510645+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.511704+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521631+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.517014+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.516890+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.516029+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521164+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.519952+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521743+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.510739+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.517295+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.523488+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.519782+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.523811+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.510963+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.511746+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.509972+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515947+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.516084+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.511398+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514961+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514900+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.509806+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.518248+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515181+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514282+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.511835+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.522403+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.510970+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.523179+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.520132+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514701+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.516372+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.509806+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.524122+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.513749+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.525857+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521504+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.523430+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.516145+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.520200+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521926+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.509972+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.510571+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.513745+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.519838+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521098+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:35.031670+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:13:35.031670+0000","last_peered":"2024-01-22T05:13:35.031670+0000","last_clean":"2024-01-22T05:13:35.031670+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:13:35.031670+0000","last_undegraded":"2024-01-22T05:13:35.031670+0000","last_fullsized":"2024-01-22T05:13:35.031670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.520454+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":95,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:35.036169+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:13:35.036169+0000","last_peered":"2024-01-22T05:13:35.036169+0000","last_clean":"2024-01-22T05:13:35.036169+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:13:35.036169+0000","last_undegraded":"2024-01-22T05:13:35.036169+0000","last_fullsized":"2024-01-22T05:13:35.036169+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514178+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:34.684655+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:13:34.684655+0000","last_peered":"2024-01-22T05:13:34.684655+0000","last_clean":"2024-01-22T05:13:34.684655+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:13:34.684655+0000","last_undegraded":"2024-01-22T05:13:34.684655+0000","last_fullsized":"2024-01-22T05:13:34.684655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.523347+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:35.036193+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:13:35.036193+0000","last_peered":"2024-01-22T05:13:35.036193+0000","last_clean":"2024-01-22T05:13:35.036193+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:13:35.036193+0000","last_undegraded":"2024-01-22T05:13:35.036193+0000","last_fullsized":"2024-01-22T05:13:35.036193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514178+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":106,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:33.639995+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:13:33.639995+0000","last_peered":"2024-01-22T05:13:33.639995+0000","last_clean":"2024-01-22T05:13:33.639995+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:13:33.639995+0000","last_undegraded":"2024-01-22T05:13:33.639995+0000","last_fullsized":"2024-01-22T05:13:33.639995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.524628+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:33.643018+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:13:33.643018+0000","last_peered":"2024-01-22T05:13:33.643018+0000","last_clean":"2024-01-22T05:13:33.643018+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:13:33.643018+0000","last_undegraded":"2024-01-22T05:13:33.643018+0000","last_fullsized":"2024-01-22T05:13:33.643018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515090+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:34.684610+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:13:34.684610+0000","last_peered":"2024-01-22T05:13:34.684610+0000","last_clean":"2024-01-22T05:13:34.684610+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:13:34.684610+0000","last_undegraded":"2024-01-22T05:13:34.684610+0000","last_fullsized":"2024-01-22T05:13:34.684610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.509817+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:33.640072+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:13:33.640072+0000","last_peered":"2024-01-22T05:13:33.640072+0000","last_clean":"2024-01-22T05:13:33.640072+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:13:33.640072+0000","last_undegraded":"2024-01-22T05:13:33.640072+0000","last_fullsized":"2024-01-22T05:13:33.640072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":89,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:34.684655+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:13:34.684655+0000","last_peered":"2024-01-22T05:13:34.684655+0000","last_clean":"2024-01-22T05:13:34.684655+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:13:34.684655+0000","last_undegraded":"2024-01-22T05:13:34.684655+0000","last_fullsized":"2024-01-22T05:13:34.684655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574960,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.006,"15min":1.0189999999999999},"min":{"1min":0.64700000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.04},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0720000000000001,"15min":1.0489999999999999},"min":{"1min":0.68500000000000005,"5min":0.63400000000000001,"15min":0.61899999999999999},"max":{"1min":1.371,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":1.0489999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.98299999999999998,"15min":0.98199999999999998},"min":{"1min":0.74299999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4530000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.165,"15min":1.1659999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.456,"5min":7.1840000000000002,"15min":7.1840000000000002},"last":1.2070000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.1180000000000001,"15min":1.1020000000000001},"min":{"1min":0.74399999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.962,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.161,"15min":1.161},"min":{"1min":0.73999999999999999,"5min":0.73799999999999999,"15min":0.68899999999999995},"max":{"1min":1.589,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.96799999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.216,"15min":1.2210000000000001},"min":{"1min":0.90400000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.6499999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.079},{"interface":"front","average":{"1min":1.23,"5min":1.264,"15min":1.2330000000000001},"min":{"1min":0.91400000000000003,"5min":0.78300000000000003,"15min":0.60199999999999998},"max":{"1min":1.6930000000000001,"5min":6.4589999999999996,"15min":6.4589999999999996},"last":0.90600000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0529999999999999,"15min":1.0569999999999999},"min":{"1min":0.52600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.514,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.111,"15min":1.1439999999999999},"min":{"1min":0.66500000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.7130000000000001,"5min":2.077,"15min":2.077},"last":1.1719999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1599999999999999,"15min":1.181},"min":{"1min":0.64400000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.7849999999999999,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.276,"15min":1.232},"min":{"1min":0.76700000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.0329999999999999,"5min":3.625,"15min":3.625},"last":1.0009999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.169,"15min":1.228},"min":{"1min":0.64800000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5920000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.351,"15min":1.333},"min":{"1min":0.80800000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.1339999999999999,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":1.129}]}]},{"osd":6,"up_from":13,"seq":55834574960,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1400832,"data_stored":689215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.7509999999999999,"15min":1.3069999999999999},"min":{"1min":0.52400000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.679,"5min":77.745000000000005,"15min":77.745000000000005},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.012,"5min":1.115,"15min":1.0660000000000001},"min":{"1min":0.54700000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.4990000000000001,"5min":13.555999999999999,"15min":13.555999999999999},"last":0.93100000000000005}]},{"osd":1,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.2330000000000001,"15min":1.1080000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.40000000000000002},"max":{"1min":1.4239999999999999,"5min":15.499000000000001,"15min":15.499000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.1779999999999999,"15min":1.2070000000000001},"min":{"1min":0.80500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.6080000000000001,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":1.079}]},{"osd":2,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1459999999999999,"15min":1.1519999999999999},"min":{"1min":0.70999999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.823,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":1.171},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.139,"15min":1.111},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.38200000000000001},"max":{"1min":1.579,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.278}]},{"osd":3,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":2.0979999999999999,"15min":1.454},"min":{"1min":0.72199999999999998,"5min":0.69299999999999995,"15min":0.59299999999999997},"max":{"1min":1.6220000000000001,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.405},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.319,"15min":1.232},"min":{"1min":0.879,"5min":0.66600000000000004,"15min":0.374},"max":{"1min":1.552,"5min":15.468,"15min":15.468},"last":0.74399999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.0960000000000001,"15min":1.095},"min":{"1min":0.65500000000000003,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.772,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.0940000000000001,"15min":1.1180000000000001},"min":{"1min":0.748,"5min":0.56899999999999995,"15min":0.48299999999999998},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.48}]},{"osd":5,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.415,"15min":1.254},"min":{"1min":0.66100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5980000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.26,"15min":1.2689999999999999},"min":{"1min":0.748,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8759999999999999,"5min":3.875,"15min":3.875},"last":1.3640000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4790000000000001,"15min":1.4059999999999999},"min":{"1min":1.0289999999999999,"5min":0.72599999999999998,"15min":0.42699999999999999},"max":{"1min":1.774,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.9119999999999999,"15min":1.5649999999999999},"min":{"1min":0.73099999999999998,"5min":0.60199999999999998,"15min":0.495},"max":{"1min":1.7729999999999999,"5min":63.737000000000002,"15min":63.737000000000002},"last":1.329}]}]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.044,"15min":1.004},"min":{"1min":0.67900000000000005,"5min":0.61599999999999999,"15min":0.53300000000000003},"max":{"1min":1.5640000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.0209999999999999,"15min":1.0780000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3460000000000001,"5min":1.5680000000000001,"15min":1.571},"last":1.397}]},{"osd":1,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.173,"15min":1.1970000000000001},"min":{"1min":0.93000000000000005,"5min":0.67300000000000004,"15min":0.50600000000000001},"max":{"1min":1.4610000000000001,"5min":1.6859999999999999,"15min":1.821},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.175,"15min":1.2609999999999999},"min":{"1min":0.80100000000000005,"5min":0.76000000000000001,"15min":0.50900000000000001},"max":{"1min":1.9690000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.042}]},{"osd":2,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.1319999999999999,"15min":1.143},"min":{"1min":0.78400000000000003,"5min":0.77900000000000003,"15min":0.63500000000000001},"max":{"1min":1.286,"5min":1.925,"15min":1.925},"last":1.151},{"interface":"front","average":{"1min":1.125,"5min":1.107,"15min":1.1279999999999999},"min":{"1min":0.82999999999999996,"5min":0.64200000000000002,"15min":0.59899999999999998},"max":{"1min":1.4059999999999999,"5min":1.859,"15min":1.859},"last":1.347}]},{"osd":3,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.115,"15min":1.165},"min":{"1min":0.85199999999999998,"5min":0.76100000000000001,"15min":0.73499999999999999},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.931},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.2090000000000001,"15min":1.2689999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":4.8819999999999997,"5min":4.8819999999999997,"15min":4.8819999999999997},"last":1.2609999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0329999999999999,"15min":1.1419999999999999},"min":{"1min":0.60099999999999998,"5min":0.51700000000000002,"15min":0.44400000000000001},"max":{"1min":1.3520000000000001,"5min":1.5780000000000001,"15min":1.7829999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.04,"5min":1.107,"15min":1.2390000000000001},"min":{"1min":0.65100000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.401,"5min":1.8300000000000001,"15min":2.0699999999999998},"last":1.1970000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1519999999999999,"15min":1.284},"min":{"1min":0.874,"5min":0.63600000000000001,"15min":0.58199999999999996},"max":{"1min":1.615,"5min":1.8129999999999999,"15min":2.2010000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.208,"15min":1.2769999999999999},"min":{"1min":0.93200000000000005,"5min":0.56100000000000005,"15min":0.55900000000000005},"max":{"1min":1.7150000000000001,"5min":1.7829999999999999,"15min":1.909},"last":1.4610000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.226,"15min":1.3640000000000001},"min":{"1min":0.77300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5149999999999999,"5min":1.766,"15min":2.3359999999999999},"last":1.319},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2549999999999999,"15min":1.4079999999999999},"min":{"1min":0.64200000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":3.1840000000000002},"last":1.4319999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.0980000000000001,"15min":1.1200000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.726,"5min":1.7490000000000001,"15min":2.0150000000000001},"last":0.755},{"interface":"front","average":{"1min":1.107,"5min":1.1399999999999999,"15min":1.1060000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.484,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.0589999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.081,"15min":1.0820000000000001},"min":{"1min":0.72499999999999998,"5min":0.64000000000000001,"15min":0.53100000000000003},"max":{"1min":1.448,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.46},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.052,"15min":1.145},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":2.194},"last":0.98299999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.52800000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5009999999999999,"5min":1.7030000000000001,"15min":5.3390000000000004},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.1379999999999999,"15min":1.226},"min":{"1min":0.77000000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.641,"5min":1.641,"15min":2.3479999999999999},"last":1.169}]},{"osd":3,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1080000000000001,"15min":1.1599999999999999},"min":{"1min":0.72699999999999998,"5min":0.59299999999999997,"15min":0.496},"max":{"1min":1.468,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1180000000000001,"15min":1.151},"min":{"1min":0.71499999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.643,"5min":1.671,"15min":5.3029999999999999},"last":1.0920000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0669999999999999,"15min":1.171},"min":{"1min":0.73099999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.589,"5min":1.6970000000000001,"15min":2.0790000000000002},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.056,"15min":1.127},"min":{"1min":0.60499999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4219999999999999,"5min":1.597,"15min":2.0030000000000001},"last":1.129}]},{"osd":6,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.089,"15min":1.163},"min":{"1min":0.63100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.573,"5min":1.6160000000000001,"15min":5.3769999999999998},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.167,"15min":1.3440000000000001},"min":{"1min":0.84999999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.641,"5min":1.778,"15min":4.4409999999999998},"last":1.3959999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.246,"15min":1.327},"min":{"1min":0.97299999999999998,"5min":0.66500000000000004,"15min":0.59399999999999997},"max":{"1min":1.5840000000000001,"5min":1.833,"15min":2.2839999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.2589999999999999,"15min":1.3460000000000001},"min":{"1min":0.95499999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.72,"5min":1.72,"15min":5.2629999999999999},"last":1.5}]}]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.84099999999999997,"15min":0.89700000000000002},"min":{"1min":0.60699999999999998,"5min":0.46200000000000002,"15min":0.34200000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":14.859},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89600000000000002,"15min":0.89200000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.317},"max":{"1min":1.3109999999999999,"5min":2.3519999999999999,"15min":5.0919999999999996},"last":1.103}]},{"osd":1,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.96499999999999997,"15min":0.88700000000000001},"min":{"1min":0.68200000000000005,"5min":0.57899999999999996,"15min":0.39300000000000002},"max":{"1min":1.224,"5min":6.5570000000000004,"15min":6.5570000000000004},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.01,"5min":0.97399999999999998,"15min":0.98199999999999998},"min":{"1min":0.69199999999999995,"5min":0.52800000000000002,"15min":0.48399999999999999},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":5.7519999999999998},"last":0.96099999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1519999999999999},"min":{"1min":0.64500000000000002,"5min":0.64000000000000001,"15min":0.40600000000000003},"max":{"1min":1.599,"5min":2.391,"15min":2.391},"last":1.228},{"interface":"front","average":{"1min":1.284,"5min":1.25,"15min":1.2050000000000001},"min":{"1min":0.84999999999999998,"5min":0.501,"15min":0.44800000000000001},"max":{"1min":1.7030000000000001,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":1.1559999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3799999999999999,"15min":1.3240000000000001},"min":{"1min":0.82799999999999996,"5min":0.71299999999999997,"15min":0.51700000000000002},"max":{"1min":1.6819999999999999,"5min":10.858000000000001,"15min":10.858000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.397,"15min":1.3580000000000001},"min":{"1min":1.0409999999999999,"5min":0.79500000000000004,"15min":0.63600000000000001},"max":{"1min":1.7529999999999999,"5min":10.846,"15min":10.846},"last":1.498}]},{"osd":5,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.319,"15min":1.304},"min":{"1min":1.006,"5min":0.74099999999999999,"15min":0.505},"max":{"1min":1.655,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":1.266},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.5229999999999999,"15min":1.373},"min":{"1min":0.89400000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.7909999999999999,"5min":14.523999999999999,"15min":14.523999999999999},"last":1.175}]},{"osd":6,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3260000000000001,"15min":1.3899999999999999},"min":{"1min":0.95699999999999996,"5min":0.81699999999999995,"15min":0.56699999999999995},"max":{"1min":1.8899999999999999,"5min":2.2610000000000001,"15min":4.9809999999999999},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.45,"5min":1.373,"15min":1.405},"min":{"1min":1.22,"5min":0.78800000000000003,"15min":0.68500000000000005},"max":{"1min":1.923,"5min":1.923,"15min":5.4210000000000003},"last":1.407}]},{"osd":7,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.3680000000000001,"15min":1.393},"min":{"1min":1.097,"5min":0.95699999999999996,"15min":0.79900000000000004},"max":{"1min":2.0539999999999998,"5min":2.472,"15min":5.7160000000000002},"last":1.083},{"interface":"front","average":{"1min":1.381,"5min":1.4399999999999999,"15min":1.4339999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.71299999999999997},"max":{"1min":1.748,"5min":6.4279999999999999,"15min":6.4279999999999999},"last":1.3009999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.79300000000000004,"15min":0.75900000000000001},"min":{"1min":0.61899999999999999,"5min":0.46100000000000002,"15min":0.38500000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.90500000000000003,"15min":0.84399999999999997},"min":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.373},"max":{"1min":1.27,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.86599999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89600000000000002,"15min":0.82499999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2729999999999999,"5min":1.534,"15min":1.534},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.96299999999999997,"15min":0.94199999999999995},"min":{"1min":0.81999999999999995,"5min":0.57499999999999996,"15min":0.41599999999999998},"max":{"1min":1.383,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.1950000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.206,"15min":1.0980000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.7569999999999999,"5min":1.79,"15min":2.0779999999999998},"last":1.329},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.272,"15min":1.1910000000000001},"min":{"1min":0.76000000000000001,"5min":0.58499999999999996,"15min":0.51100000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.9990000000000001},"last":1.5249999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.2689999999999999,"15min":1.2869999999999999},"min":{"1min":1.014,"5min":0.71299999999999997,"15min":0.59099999999999997},"max":{"1min":1.647,"5min":1.647,"15min":2.1709999999999998},"last":1.369},{"interface":"front","average":{"1min":1.343,"5min":1.208,"15min":1.204},"min":{"1min":0.84899999999999998,"5min":0.66400000000000003,"15min":0.63500000000000001},"max":{"1min":1.7490000000000001,"5min":1.837,"15min":1.952},"last":1.5389999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.2609999999999999,"15min":1.2030000000000001},"min":{"1min":0.90000000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6120000000000001,"5min":2.0510000000000002,"15min":2.3660000000000001},"last":1.276},{"interface":"front","average":{"1min":1.373,"5min":1.274,"15min":1.298},"min":{"1min":1.143,"5min":0.77000000000000002,"15min":0.67000000000000004},"max":{"1min":1.7010000000000001,"5min":1.8600000000000001,"15min":2.2210000000000001},"last":1.4550000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.28,"15min":1.2569999999999999},"min":{"1min":0.89200000000000002,"5min":0.77600000000000002,"15min":0.68400000000000005},"max":{"1min":1.766,"5min":1.8360000000000001,"15min":2.1920000000000002},"last":1.595},{"interface":"front","average":{"1min":1.431,"5min":1.3400000000000001,"15min":1.2949999999999999},"min":{"1min":0.86699999999999999,"5min":0.84399999999999997,"15min":0.83999999999999997},"max":{"1min":1.9299999999999999,"5min":2.1320000000000001,"15min":2.4449999999999998},"last":1.393}]},{"osd":7,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.3680000000000001,"15min":1.3540000000000001},"min":{"1min":1.0469999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9199999999999999},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.516,"5min":1.4550000000000001,"15min":1.4139999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.89000000000000001},"max":{"1min":1.8069999999999999,"5min":2.0329999999999999,"15min":2.5059999999999998},"last":1.4790000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.89600000000000002,"15min":0.86199999999999999},"min":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":1.911,"5min":1.911,"15min":3.4119999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0289999999999999,"15min":1.006},"min":{"1min":0.42899999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8680000000000001,"5min":1.873,"15min":2.101},"last":1.1140000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.008,"15min":1},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.448},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0620000000000001,"15min":1.034},"min":{"1min":0.60599999999999998,"5min":0.59099999999999997,"15min":0.46899999999999997},"max":{"1min":1.671,"5min":1.71,"15min":2.008},"last":0.92700000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.046,"15min":1.016},"min":{"1min":0.66600000000000004,"5min":0.54800000000000004,"15min":0.38900000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":4.665},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.224,"5min":1.032,"15min":0.92700000000000005},"min":{"1min":0.55200000000000005,"5min":0.50600000000000001,"15min":0.41899999999999998},"max":{"1min":4.1319999999999997,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":0.95299999999999996}]},{"osd":4,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.359,"15min":1.248},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.60599999999999998},"max":{"1min":2.2509999999999999,"5min":15.76,"15min":15.76},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.456,"15min":1.3160000000000001},"min":{"1min":0.94399999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.77,"5min":16.975000000000001,"15min":16.975000000000001},"last":1.0349999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.258,"15min":1.206},"min":{"1min":0.80900000000000005,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":4.3230000000000004,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":1.383},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3009999999999999,"15min":1.276},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.3330000000000002,"5min":2.52,"15min":2.52},"last":1.573}]},{"osd":6,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.288,"15min":1.2689999999999999},"min":{"1min":0.89900000000000002,"5min":0.83899999999999997,"15min":0.76000000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.355,"15min":1.3380000000000001},"min":{"1min":0.77400000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.5569999999999999,"5min":2.5569999999999999,"15min":2.5569999999999999},"last":1.669}]},{"osd":7,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3600000000000001,"15min":1.3700000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.77400000000000002},"max":{"1min":1.829,"5min":2.0019999999999998,"15min":4.4329999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.377,"15min":1.363},"min":{"1min":1.0089999999999999,"5min":0.81999999999999995,"15min":0.77600000000000002},"max":{"1min":4.3970000000000002,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.6060000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1400832,"data_stored":689215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.99199999999999999,"15min":0.93600000000000005},"min":{"1min":0.56499999999999995,"5min":0.34799999999999998,"15min":0.28699999999999998},"max":{"1min":1.972,"5min":15.273,"15min":15.273},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.95699999999999996,"15min":0.96499999999999997},"min":{"1min":0.70199999999999996,"5min":0.51800000000000002,"15min":0.34499999999999997},"max":{"1min":1.381,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.0069999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1499999999999999,"15min":1.091},"min":{"1min":0.755,"5min":0.48199999999999998,"15min":0.46400000000000002},"max":{"1min":1.4550000000000001,"5min":15.473000000000001,"15min":15.473000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.0489999999999999,"15min":1.0229999999999999},"min":{"1min":0.71699999999999997,"5min":0.626,"15min":0.45400000000000001},"max":{"1min":1.5249999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.1659999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.0049999999999999,"15min":1.0149999999999999},"min":{"1min":0.66200000000000003,"5min":0.40000000000000002,"15min":0.39000000000000001},"max":{"1min":1.409,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":0.878},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.2629999999999999,"15min":1.22},"min":{"1min":0.61799999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.647,"5min":15.439,"15min":15.439},"last":1.679}]},{"osd":4,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.236,"15min":1.325},"min":{"1min":0.91600000000000004,"5min":0.68200000000000005,"15min":0.61399999999999999},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":5.1799999999999997},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.204,"15min":1.2330000000000001},"min":{"1min":0.78200000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.7909999999999999,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":1.194}]},{"osd":5,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.244,"15min":1.329},"min":{"1min":0.88200000000000001,"5min":0.755,"15min":0.755},"max":{"1min":1.8149999999999999,"5min":2.891,"15min":3.548},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.321,"15min":1.3759999999999999},"min":{"1min":1.153,"5min":0.75900000000000001,"15min":0.59499999999999997},"max":{"1min":2.2309999999999999,"5min":2.823,"15min":2.823},"last":1.587}]},{"osd":6,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.506,"15min":1.456},"min":{"1min":1.1180000000000001,"5min":0.81399999999999995,"15min":0.59099999999999997},"max":{"1min":2.0950000000000002,"5min":15.4,"15min":15.4},"last":1.415},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.399,"15min":1.4590000000000001},"min":{"1min":1.0389999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.871,"5min":7.1349999999999998,"15min":7.1349999999999998},"last":1.627}]},{"osd":7,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.405,"15min":1.5489999999999999},"min":{"1min":1.141,"5min":0.91400000000000003,"15min":0.79900000000000004},"max":{"1min":1.8560000000000001,"5min":2.1080000000000001,"15min":5.29},"last":1.76},{"interface":"front","average":{"1min":1.419,"5min":1.3660000000000001,"15min":1.405},"min":{"1min":1.0609999999999999,"5min":0.81799999999999995,"15min":0.752},"max":{"1min":2.1869999999999998,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.5329999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:13:42.707 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:13:42.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.904+0000 7f2933000700 1 Processor -- start 2024-01-22T05:13:42.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.904+0000 7f2933000700 1 -- start start 2024-01-22T05:13:42.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.908+0000 7f2933000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f292c0a8740 0x7f292c0a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.908+0000 7f2933000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f292c0c1ed0 0x7f292c0c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.908+0000 7f2933000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f292c0c1a40 con 0x7f292c155d20 2024-01-22T05:13:42.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.908+0000 7f2933000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292c0a90b0 con 0x7f292c0c1ed0 2024-01-22T05:13:42.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.908+0000 7f2933000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292c159310 con 0x7f292c0a8740 2024-01-22T05:13:42.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.908+0000 7f2931000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f292c0c1ed0 0x7f292c0c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.908+0000 7f2931000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f292c0c1ed0 0x7f292c0c2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58616/0 (socket says 172.21.15.49:58616) 2024-01-22T05:13:42.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.908+0000 7f2931000700 1 -- 172.21.15.49:0/1587131377 learned_addr learned my addr 172.21.15.49:0/1587131377 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:42.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.908+0000 7f292b400700 1 --2- 172.21.15.49:0/1587131377 >> v2:172.21.15.110:3300/0 conn(0x7f292c0a8740 0x7f292c0a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.908+0000 7f2931000700 1 -- 172.21.15.49:0/1587131377 >> v2:172.21.15.110:3300/0 conn(0x7f292c0a8740 msgr2=0x7f292c0a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.908+0000 7f2931000700 1 --2- 172.21.15.49:0/1587131377 >> v2:172.21.15.110:3300/0 conn(0x7f292c0a8740 0x7f292c0a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.908+0000 7f2931000700 1 -- 172.21.15.49:0/1587131377 >> v1:172.21.15.110:6789/0 conn(0x7f292c155d20 legacy=0x7f292c065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.908+0000 7f2931000700 1 -- 172.21.15.49:0/1587131377 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c0c13f0 con 0x7f292c0c1ed0 2024-01-22T05:13:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.908+0000 7f2931000700 1 --2- 172.21.15.49:0/1587131377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f292c0c1ed0 0x7f292c0c2360 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f292c0c0ad0 tx=0x7f2924009840).ready entity=mon.0 client_cookie=7770cd873fc9826e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.912+0000 7f292aa00700 1 -- 172.21.15.49:0/1587131377 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292400e070 con 0x7f292c0c1ed0 2024-01-22T05:13:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.912+0000 7f292aa00700 1 -- 172.21.15.49:0/1587131377 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292400ba50 con 0x7f292c0c1ed0 2024-01-22T05:13:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.912+0000 7f292aa00700 1 -- 172.21.15.49:0/1587131377 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292400bdd0 con 0x7f292c0c1ed0 2024-01-22T05:13:42.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.912+0000 7f2933000700 1 -- 172.21.15.49:0/1587131377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f292c0c1ed0 msgr2=0x7f292c0c2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.912+0000 7f2933000700 1 --2- 172.21.15.49:0/1587131377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f292c0c1ed0 0x7f292c0c2360 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f292c0c0ad0 tx=0x7f2924009840).stop 2024-01-22T05:13:42.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.912+0000 7f2933000700 1 -- 172.21.15.49:0/1587131377 shutdown_connections 2024-01-22T05:13:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.912+0000 7f2933000700 1 --2- 172.21.15.49:0/1587131377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f292c0c1ed0 0x7f292c0c2360 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.912+0000 7f2933000700 1 --2- 172.21.15.49:0/1587131377 >> v2:172.21.15.110:3300/0 conn(0x7f292c0a8740 0x7f292c0a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.912+0000 7f2933000700 1 -- 172.21.15.49:0/1587131377 >> 172.21.15.49:0/1587131377 conn(0x7f292c0c6540 msgr2=0x7f292c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.912+0000 7f2933000700 1 -- 172.21.15.49:0/1587131377 shutdown_connections 2024-01-22T05:13:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.912+0000 7f2933000700 1 -- 172.21.15.49:0/1587131377 wait complete. 2024-01-22T05:13:42.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.916+0000 7f2933000700 1 Processor -- start 2024-01-22T05:13:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.916+0000 7f2933000700 1 -- start start 2024-01-22T05:13:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.916+0000 7f2933000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f292c0a8740 0x7f292c1680a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.916+0000 7f2933000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f292c0c1ed0 0x7f292c169120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.916+0000 7f2933000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f292c155d20 0x7f292c0a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.916+0000 7f2933000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c0abb20 con 0x7f292c0c1ed0 2024-01-22T05:13:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.916+0000 7f2933000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c168590 con 0x7f292c0a8740 2024-01-22T05:13:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.916+0000 7f2933000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292c169610 con 0x7f292c155d20 2024-01-22T05:13:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f292b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f292c0c1ed0 0x7f292c169120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f292b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f292c0c1ed0 0x7f292c169120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58626/0 (socket says 172.21.15.49:58626) 2024-01-22T05:13:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f292b400700 1 -- 172.21.15.49:0/3663403394 learned_addr learned my addr 172.21.15.49:0/3663403394 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f2931000700 1 --2- 172.21.15.49:0/3663403394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f292c155d20 0x7f292c0a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f292be00700 1 --2- 172.21.15.49:0/3663403394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f292c0a8740 0x7f292c1680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f292b400700 1 -- 172.21.15.49:0/3663403394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f292c155d20 msgr2=0x7f292c0a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f292b400700 1 --2- 172.21.15.49:0/3663403394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f292c155d20 0x7f292c0a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f292b400700 1 -- 172.21.15.49:0/3663403394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f292c0a8740 msgr2=0x7f292c1680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f292b400700 1 --2- 172.21.15.49:0/3663403394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f292c0a8740 0x7f292c1680a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f292b400700 1 -- 172.21.15.49:0/3663403394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2924009ae0 con 0x7f292c0c1ed0 2024-01-22T05:13:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f2931000700 1 --2- 172.21.15.49:0/3663403394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f292c155d20 0x7f292c0a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f292b400700 1 --2- 172.21.15.49:0/3663403394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f292c0c1ed0 0x7f292c169120 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f291400d890 tx=0x7f2914008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f2923400700 1 -- 172.21.15.49:0/3663403394 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914011590 con 0x7f292c0c1ed0 2024-01-22T05:13:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f2923400700 1 -- 172.21.15.49:0/3663403394 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29140116f0 con 0x7f292c0c1ed0 2024-01-22T05:13:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f2933000700 1 -- 172.21.15.49:0/3663403394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292c0aaf10 con 0x7f292c0c1ed0 2024-01-22T05:13:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f2923400700 1 -- 172.21.15.49:0/3663403394 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914011a70 con 0x7f292c0c1ed0 2024-01-22T05:13:42.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.920+0000 7f2933000700 1 -- 172.21.15.49:0/3663403394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292c0ab4d0 con 0x7f292c0c1ed0 2024-01-22T05:13:42.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.924+0000 7f2933000700 1 -- 172.21.15.49:0/3663403394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292c159510 con 0x7f292c0c1ed0 2024-01-22T05:13:42.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.924+0000 7f2923400700 1 -- 172.21.15.49:0/3663403394 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f291401c460 con 0x7f292c0c1ed0 2024-01-22T05:13:42.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.924+0000 7f2923400700 1 --2- 172.21.15.49:0/3663403394 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f290405a510 0x7f290405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.924+0000 7f2923400700 1 -- 172.21.15.49:0/3663403394 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2914074670 con 0x7f292c0c1ed0 2024-01-22T05:13:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.924+0000 7f292be00700 1 --2- 172.21.15.49:0/3663403394 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f290405a510 0x7f290405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.928+0000 7f292be00700 1 --2- 172.21.15.49:0/3663403394 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f290405a510 0x7f290405c9d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f291c003860 tx=0x7f291c007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:42.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:42.932+0000 7f2923400700 1 -- 172.21.15.49:0/3663403394 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2914047c50 con 0x7f292c0c1ed0 2024-01-22T05:13:43.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.096+0000 7f2933000700 1 -- 172.21.15.49:0/3663403394 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f292c0c16d0 con 0x7f290405a510 2024-01-22T05:13:43.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.116+0000 7f2923400700 1 -- 172.21.15.49:0/3663403394 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350609 (secure 0 0 0) 0x7f292c0c16d0 con 0x7f290405a510 2024-01-22T05:13:43.122 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:43.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.120+0000 7f2933000700 1 -- 172.21.15.49:0/3663403394 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f290405a510 msgr2=0x7f290405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:43.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.120+0000 7f2933000700 1 --2- 172.21.15.49:0/3663403394 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f290405a510 0x7f290405c9d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f291c003860 tx=0x7f291c007d40).stop 2024-01-22T05:13:43.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.120+0000 7f2933000700 1 -- 172.21.15.49:0/3663403394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f292c0c1ed0 msgr2=0x7f292c169120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:43.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.120+0000 7f2933000700 1 --2- 172.21.15.49:0/3663403394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f292c0c1ed0 0x7f292c169120 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f291400d890 tx=0x7f2914008040).stop 2024-01-22T05:13:43.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.120+0000 7f2933000700 1 -- 172.21.15.49:0/3663403394 shutdown_connections 2024-01-22T05:13:43.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.120+0000 7f2933000700 1 --2- 172.21.15.49:0/3663403394 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f290405a510 0x7f290405c9d0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.120+0000 7f2933000700 1 --2- 172.21.15.49:0/3663403394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f292c155d20 0x7f292c0a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.120+0000 7f2933000700 1 --2- 172.21.15.49:0/3663403394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f292c0c1ed0 0x7f292c169120 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.120+0000 7f2933000700 1 --2- 172.21.15.49:0/3663403394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f292c0a8740 0x7f292c1680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.120+0000 7f2933000700 1 -- 172.21.15.49:0/3663403394 >> 172.21.15.49:0/3663403394 conn(0x7f292c0c6540 msgr2=0x7f292c1583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.124+0000 7f2933000700 1 -- 172.21.15.49:0/3663403394 shutdown_connections 2024-01-22T05:13:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.124+0000 7f2933000700 1 -- 172.21.15.49:0/3663403394 wait complete. 2024-01-22T05:13:43.127 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:13:43.146 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":387,"stamp":"2024-01-22T05:13:41.426892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437960,"kb_used_data":11016,"kb_used_omap":0,"kb_used_meta":2426880,"kb_avail":752536760,"statfs":{"total":773094113280,"available":770597642240,"internally_reserved":0,"allocated":11280384,"data_stored":5553164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485125120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077814386,"num_objects":-1078,"num_object_clones":0,"num_object_copies":-2156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3210,"num_write_kb":-1053285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.056634"},"pg_stats":[{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.522183+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.520679+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.522301+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.522510+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.525127+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515821+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515535+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515836+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515906+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.524411+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.510645+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.511704+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521631+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.517014+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.516890+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.516029+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521164+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.519952+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521743+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.510739+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.517295+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.523488+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.519782+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.523811+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.510963+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.511746+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.509972+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515947+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.516084+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.511398+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514961+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514900+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.509806+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.518248+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515181+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514282+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.511835+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.522403+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.510970+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.523179+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.520132+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514701+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.516372+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.509806+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.524122+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.513749+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.525857+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521504+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.523430+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.516145+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.520200+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521926+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.509972+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.510571+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.513745+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.519838+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.521098+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:35.031670+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:13:35.031670+0000","last_peered":"2024-01-22T05:13:35.031670+0000","last_clean":"2024-01-22T05:13:35.031670+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:13:35.031670+0000","last_undegraded":"2024-01-22T05:13:35.031670+0000","last_fullsized":"2024-01-22T05:13:35.031670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.520454+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":95,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:35.036169+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:13:35.036169+0000","last_peered":"2024-01-22T05:13:35.036169+0000","last_clean":"2024-01-22T05:13:35.036169+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:13:35.036169+0000","last_undegraded":"2024-01-22T05:13:35.036169+0000","last_fullsized":"2024-01-22T05:13:35.036169+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514178+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:34.684655+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:13:34.684655+0000","last_peered":"2024-01-22T05:13:34.684655+0000","last_clean":"2024-01-22T05:13:34.684655+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:13:34.684655+0000","last_undegraded":"2024-01-22T05:13:34.684655+0000","last_fullsized":"2024-01-22T05:13:34.684655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.523347+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:35.036193+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:13:35.036193+0000","last_peered":"2024-01-22T05:13:35.036193+0000","last_clean":"2024-01-22T05:13:35.036193+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:13:35.036193+0000","last_undegraded":"2024-01-22T05:13:35.036193+0000","last_fullsized":"2024-01-22T05:13:35.036193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.514178+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":106,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:33.639995+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:13:33.639995+0000","last_peered":"2024-01-22T05:13:33.639995+0000","last_clean":"2024-01-22T05:13:33.639995+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:13:33.639995+0000","last_undegraded":"2024-01-22T05:13:33.639995+0000","last_fullsized":"2024-01-22T05:13:33.639995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.524628+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:33.643018+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:13:33.643018+0000","last_peered":"2024-01-22T05:13:33.643018+0000","last_clean":"2024-01-22T05:13:33.643018+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:13:33.643018+0000","last_undegraded":"2024-01-22T05:13:33.643018+0000","last_fullsized":"2024-01-22T05:13:33.643018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.515090+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:34.684610+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:13:34.684610+0000","last_peered":"2024-01-22T05:13:34.684610+0000","last_clean":"2024-01-22T05:13:34.684610+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:13:34.684610+0000","last_undegraded":"2024-01-22T05:13:34.684610+0000","last_fullsized":"2024-01-22T05:13:34.684610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:13:37.509399+0000","last_change":"2024-01-22T05:13:37.509399+0000","last_active":"2024-01-22T05:13:37.509399+0000","last_peered":"2024-01-22T05:13:37.509399+0000","last_clean":"2024-01-22T05:13:37.509399+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:37.509399+0000","last_undegraded":"2024-01-22T05:13:37.509399+0000","last_fullsized":"2024-01-22T05:13:37.509399+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:13:36.496933+0000","last_change":"2024-01-22T05:13:36.509817+0000","last_active":"2024-01-22T05:13:36.496933+0000","last_peered":"2024-01-22T05:13:36.496933+0000","last_clean":"2024-01-22T05:13:36.496933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:13:36.496933+0000","last_undegraded":"2024-01-22T05:13:36.496933+0000","last_fullsized":"2024-01-22T05:13:36.496933+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:33.640072+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:13:33.640072+0000","last_peered":"2024-01-22T05:13:33.640072+0000","last_clean":"2024-01-22T05:13:33.640072+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:13:33.640072+0000","last_undegraded":"2024-01-22T05:13:33.640072+0000","last_fullsized":"2024-01-22T05:13:33.640072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":89,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-01-22T05:13:34.684655+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:13:34.684655+0000","last_peered":"2024-01-22T05:13:34.684655+0000","last_clean":"2024-01-22T05:13:34.684655+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:13:34.684655+0000","last_undegraded":"2024-01-22T05:13:34.684655+0000","last_fullsized":"2024-01-22T05:13:34.684655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574960,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.006,"15min":1.0189999999999999},"min":{"1min":0.64700000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.04},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0720000000000001,"15min":1.0489999999999999},"min":{"1min":0.68500000000000005,"5min":0.63400000000000001,"15min":0.61899999999999999},"max":{"1min":1.371,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":1.0489999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.98299999999999998,"15min":0.98199999999999998},"min":{"1min":0.74299999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4530000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.165,"15min":1.1659999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.456,"5min":7.1840000000000002,"15min":7.1840000000000002},"last":1.2070000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.1180000000000001,"15min":1.1020000000000001},"min":{"1min":0.74399999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.962,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.161,"15min":1.161},"min":{"1min":0.73999999999999999,"5min":0.73799999999999999,"15min":0.68899999999999995},"max":{"1min":1.589,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.96799999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.216,"15min":1.2210000000000001},"min":{"1min":0.90400000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.6499999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.079},{"interface":"front","average":{"1min":1.23,"5min":1.264,"15min":1.2330000000000001},"min":{"1min":0.91400000000000003,"5min":0.78300000000000003,"15min":0.60199999999999998},"max":{"1min":1.6930000000000001,"5min":6.4589999999999996,"15min":6.4589999999999996},"last":0.90600000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0529999999999999,"15min":1.0569999999999999},"min":{"1min":0.52600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.514,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.111,"15min":1.1439999999999999},"min":{"1min":0.66500000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.7130000000000001,"5min":2.077,"15min":2.077},"last":1.1719999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1599999999999999,"15min":1.181},"min":{"1min":0.64400000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.7849999999999999,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.276,"15min":1.232},"min":{"1min":0.76700000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.0329999999999999,"5min":3.625,"15min":3.625},"last":1.0009999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.169,"15min":1.228},"min":{"1min":0.64800000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5920000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.351,"15min":1.333},"min":{"1min":0.80800000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.1339999999999999,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":1.129}]}]},{"osd":6,"up_from":13,"seq":55834574960,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1400832,"data_stored":689215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.7509999999999999,"15min":1.3069999999999999},"min":{"1min":0.52400000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.679,"5min":77.745000000000005,"15min":77.745000000000005},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.012,"5min":1.115,"15min":1.0660000000000001},"min":{"1min":0.54700000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.4990000000000001,"5min":13.555999999999999,"15min":13.555999999999999},"last":0.93100000000000005}]},{"osd":1,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.2330000000000001,"15min":1.1080000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.40000000000000002},"max":{"1min":1.4239999999999999,"5min":15.499000000000001,"15min":15.499000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.1779999999999999,"15min":1.2070000000000001},"min":{"1min":0.80500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.6080000000000001,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":1.079}]},{"osd":2,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1459999999999999,"15min":1.1519999999999999},"min":{"1min":0.70999999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.823,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":1.171},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.139,"15min":1.111},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.38200000000000001},"max":{"1min":1.579,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.278}]},{"osd":3,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":2.0979999999999999,"15min":1.454},"min":{"1min":0.72199999999999998,"5min":0.69299999999999995,"15min":0.59299999999999997},"max":{"1min":1.6220000000000001,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.405},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.319,"15min":1.232},"min":{"1min":0.879,"5min":0.66600000000000004,"15min":0.374},"max":{"1min":1.552,"5min":15.468,"15min":15.468},"last":0.74399999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.0960000000000001,"15min":1.095},"min":{"1min":0.65500000000000003,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.772,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.0940000000000001,"15min":1.1180000000000001},"min":{"1min":0.748,"5min":0.56899999999999995,"15min":0.48299999999999998},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.48}]},{"osd":5,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.415,"15min":1.254},"min":{"1min":0.66100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5980000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.26,"15min":1.2689999999999999},"min":{"1min":0.748,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8759999999999999,"5min":3.875,"15min":3.875},"last":1.3640000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4790000000000001,"15min":1.4059999999999999},"min":{"1min":1.0289999999999999,"5min":0.72599999999999998,"15min":0.42699999999999999},"max":{"1min":1.774,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.9119999999999999,"15min":1.5649999999999999},"min":{"1min":0.73099999999999998,"5min":0.60199999999999998,"15min":0.495},"max":{"1min":1.7729999999999999,"5min":63.737000000000002,"15min":63.737000000000002},"last":1.329}]}]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.044,"15min":1.004},"min":{"1min":0.67900000000000005,"5min":0.61599999999999999,"15min":0.53300000000000003},"max":{"1min":1.5640000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.0209999999999999,"15min":1.0780000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3460000000000001,"5min":1.5680000000000001,"15min":1.571},"last":1.397}]},{"osd":1,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.173,"15min":1.1970000000000001},"min":{"1min":0.93000000000000005,"5min":0.67300000000000004,"15min":0.50600000000000001},"max":{"1min":1.4610000000000001,"5min":1.6859999999999999,"15min":1.821},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.175,"15min":1.2609999999999999},"min":{"1min":0.80100000000000005,"5min":0.76000000000000001,"15min":0.50900000000000001},"max":{"1min":1.9690000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.042}]},{"osd":2,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.1319999999999999,"15min":1.143},"min":{"1min":0.78400000000000003,"5min":0.77900000000000003,"15min":0.63500000000000001},"max":{"1min":1.286,"5min":1.925,"15min":1.925},"last":1.151},{"interface":"front","average":{"1min":1.125,"5min":1.107,"15min":1.1279999999999999},"min":{"1min":0.82999999999999996,"5min":0.64200000000000002,"15min":0.59899999999999998},"max":{"1min":1.4059999999999999,"5min":1.859,"15min":1.859},"last":1.347}]},{"osd":3,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.115,"15min":1.165},"min":{"1min":0.85199999999999998,"5min":0.76100000000000001,"15min":0.73499999999999999},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.931},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.2090000000000001,"15min":1.2689999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":4.8819999999999997,"5min":4.8819999999999997,"15min":4.8819999999999997},"last":1.2609999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0329999999999999,"15min":1.1419999999999999},"min":{"1min":0.60099999999999998,"5min":0.51700000000000002,"15min":0.44400000000000001},"max":{"1min":1.3520000000000001,"5min":1.5780000000000001,"15min":1.7829999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.04,"5min":1.107,"15min":1.2390000000000001},"min":{"1min":0.65100000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.401,"5min":1.8300000000000001,"15min":2.0699999999999998},"last":1.1970000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1519999999999999,"15min":1.284},"min":{"1min":0.874,"5min":0.63600000000000001,"15min":0.58199999999999996},"max":{"1min":1.615,"5min":1.8129999999999999,"15min":2.2010000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.208,"15min":1.2769999999999999},"min":{"1min":0.93200000000000005,"5min":0.56100000000000005,"15min":0.55900000000000005},"max":{"1min":1.7150000000000001,"5min":1.7829999999999999,"15min":1.909},"last":1.4610000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.226,"15min":1.3640000000000001},"min":{"1min":0.77300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5149999999999999,"5min":1.766,"15min":2.3359999999999999},"last":1.319},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2549999999999999,"15min":1.4079999999999999},"min":{"1min":0.64200000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":3.1840000000000002},"last":1.4319999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.0980000000000001,"15min":1.1200000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.726,"5min":1.7490000000000001,"15min":2.0150000000000001},"last":0.755},{"interface":"front","average":{"1min":1.107,"5min":1.1399999999999999,"15min":1.1060000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.484,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.0589999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.081,"15min":1.0820000000000001},"min":{"1min":0.72499999999999998,"5min":0.64000000000000001,"15min":0.53100000000000003},"max":{"1min":1.448,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.46},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.052,"15min":1.145},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":2.194},"last":0.98299999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.52800000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5009999999999999,"5min":1.7030000000000001,"15min":5.3390000000000004},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.1379999999999999,"15min":1.226},"min":{"1min":0.77000000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.641,"5min":1.641,"15min":2.3479999999999999},"last":1.169}]},{"osd":3,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1080000000000001,"15min":1.1599999999999999},"min":{"1min":0.72699999999999998,"5min":0.59299999999999997,"15min":0.496},"max":{"1min":1.468,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1180000000000001,"15min":1.151},"min":{"1min":0.71499999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.643,"5min":1.671,"15min":5.3029999999999999},"last":1.0920000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0669999999999999,"15min":1.171},"min":{"1min":0.73099999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.589,"5min":1.6970000000000001,"15min":2.0790000000000002},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.056,"15min":1.127},"min":{"1min":0.60499999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4219999999999999,"5min":1.597,"15min":2.0030000000000001},"last":1.129}]},{"osd":6,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.089,"15min":1.163},"min":{"1min":0.63100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.573,"5min":1.6160000000000001,"15min":5.3769999999999998},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.167,"15min":1.3440000000000001},"min":{"1min":0.84999999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.641,"5min":1.778,"15min":4.4409999999999998},"last":1.3959999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.246,"15min":1.327},"min":{"1min":0.97299999999999998,"5min":0.66500000000000004,"15min":0.59399999999999997},"max":{"1min":1.5840000000000001,"5min":1.833,"15min":2.2839999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.2589999999999999,"15min":1.3460000000000001},"min":{"1min":0.95499999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.72,"5min":1.72,"15min":5.2629999999999999},"last":1.5}]}]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.84099999999999997,"15min":0.89700000000000002},"min":{"1min":0.60699999999999998,"5min":0.46200000000000002,"15min":0.34200000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":14.859},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89600000000000002,"15min":0.89200000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.317},"max":{"1min":1.3109999999999999,"5min":2.3519999999999999,"15min":5.0919999999999996},"last":1.103}]},{"osd":1,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.96499999999999997,"15min":0.88700000000000001},"min":{"1min":0.68200000000000005,"5min":0.57899999999999996,"15min":0.39300000000000002},"max":{"1min":1.224,"5min":6.5570000000000004,"15min":6.5570000000000004},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.01,"5min":0.97399999999999998,"15min":0.98199999999999998},"min":{"1min":0.69199999999999995,"5min":0.52800000000000002,"15min":0.48399999999999999},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":5.7519999999999998},"last":0.96099999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1519999999999999},"min":{"1min":0.64500000000000002,"5min":0.64000000000000001,"15min":0.40600000000000003},"max":{"1min":1.599,"5min":2.391,"15min":2.391},"last":1.228},{"interface":"front","average":{"1min":1.284,"5min":1.25,"15min":1.2050000000000001},"min":{"1min":0.84999999999999998,"5min":0.501,"15min":0.44800000000000001},"max":{"1min":1.7030000000000001,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":1.1559999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3799999999999999,"15min":1.3240000000000001},"min":{"1min":0.82799999999999996,"5min":0.71299999999999997,"15min":0.51700000000000002},"max":{"1min":1.6819999999999999,"5min":10.858000000000001,"15min":10.858000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.397,"15min":1.3580000000000001},"min":{"1min":1.0409999999999999,"5min":0.79500000000000004,"15min":0.63600000000000001},"max":{"1min":1.7529999999999999,"5min":10.846,"15min":10.846},"last":1.498}]},{"osd":5,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.319,"15min":1.304},"min":{"1min":1.006,"5min":0.74099999999999999,"15min":0.505},"max":{"1min":1.655,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":1.266},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.5229999999999999,"15min":1.373},"min":{"1min":0.89400000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.7909999999999999,"5min":14.523999999999999,"15min":14.523999999999999},"last":1.175}]},{"osd":6,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3260000000000001,"15min":1.3899999999999999},"min":{"1min":0.95699999999999996,"5min":0.81699999999999995,"15min":0.56699999999999995},"max":{"1min":1.8899999999999999,"5min":2.2610000000000001,"15min":4.9809999999999999},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.45,"5min":1.373,"15min":1.405},"min":{"1min":1.22,"5min":0.78800000000000003,"15min":0.68500000000000005},"max":{"1min":1.923,"5min":1.923,"15min":5.4210000000000003},"last":1.407}]},{"osd":7,"last update":"Mon Jan 22 05:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.3680000000000001,"15min":1.393},"min":{"1min":1.097,"5min":0.95699999999999996,"15min":0.79900000000000004},"max":{"1min":2.0539999999999998,"5min":2.472,"15min":5.7160000000000002},"last":1.083},{"interface":"front","average":{"1min":1.381,"5min":1.4399999999999999,"15min":1.4339999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.71299999999999997},"max":{"1min":1.748,"5min":6.4279999999999999,"15min":6.4279999999999999},"last":1.3009999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.79300000000000004,"15min":0.75900000000000001},"min":{"1min":0.61899999999999999,"5min":0.46100000000000002,"15min":0.38500000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.90500000000000003,"15min":0.84399999999999997},"min":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.373},"max":{"1min":1.27,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.86599999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89600000000000002,"15min":0.82499999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2729999999999999,"5min":1.534,"15min":1.534},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.96299999999999997,"15min":0.94199999999999995},"min":{"1min":0.81999999999999995,"5min":0.57499999999999996,"15min":0.41599999999999998},"max":{"1min":1.383,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.1950000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.206,"15min":1.0980000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.7569999999999999,"5min":1.79,"15min":2.0779999999999998},"last":1.329},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.272,"15min":1.1910000000000001},"min":{"1min":0.76000000000000001,"5min":0.58499999999999996,"15min":0.51100000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.9990000000000001},"last":1.5249999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.2689999999999999,"15min":1.2869999999999999},"min":{"1min":1.014,"5min":0.71299999999999997,"15min":0.59099999999999997},"max":{"1min":1.647,"5min":1.647,"15min":2.1709999999999998},"last":1.369},{"interface":"front","average":{"1min":1.343,"5min":1.208,"15min":1.204},"min":{"1min":0.84899999999999998,"5min":0.66400000000000003,"15min":0.63500000000000001},"max":{"1min":1.7490000000000001,"5min":1.837,"15min":1.952},"last":1.5389999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.2609999999999999,"15min":1.2030000000000001},"min":{"1min":0.90000000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6120000000000001,"5min":2.0510000000000002,"15min":2.3660000000000001},"last":1.276},{"interface":"front","average":{"1min":1.373,"5min":1.274,"15min":1.298},"min":{"1min":1.143,"5min":0.77000000000000002,"15min":0.67000000000000004},"max":{"1min":1.7010000000000001,"5min":1.8600000000000001,"15min":2.2210000000000001},"last":1.4550000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.28,"15min":1.2569999999999999},"min":{"1min":0.89200000000000002,"5min":0.77600000000000002,"15min":0.68400000000000005},"max":{"1min":1.766,"5min":1.8360000000000001,"15min":2.1920000000000002},"last":1.595},{"interface":"front","average":{"1min":1.431,"5min":1.3400000000000001,"15min":1.2949999999999999},"min":{"1min":0.86699999999999999,"5min":0.84399999999999997,"15min":0.83999999999999997},"max":{"1min":1.9299999999999999,"5min":2.1320000000000001,"15min":2.4449999999999998},"last":1.393}]},{"osd":7,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.3680000000000001,"15min":1.3540000000000001},"min":{"1min":1.0469999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9199999999999999},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.516,"5min":1.4550000000000001,"15min":1.4139999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.89000000000000001},"max":{"1min":1.8069999999999999,"5min":2.0329999999999999,"15min":2.5059999999999998},"last":1.4790000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1413120,"data_stored":695789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.89600000000000002,"15min":0.86199999999999999},"min":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":1.911,"5min":1.911,"15min":3.4119999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0289999999999999,"15min":1.006},"min":{"1min":0.42899999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8680000000000001,"5min":1.873,"15min":2.101},"last":1.1140000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.008,"15min":1},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.448},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0620000000000001,"15min":1.034},"min":{"1min":0.60599999999999998,"5min":0.59099999999999997,"15min":0.46899999999999997},"max":{"1min":1.671,"5min":1.71,"15min":2.008},"last":0.92700000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.046,"15min":1.016},"min":{"1min":0.66600000000000004,"5min":0.54800000000000004,"15min":0.38900000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":4.665},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.224,"5min":1.032,"15min":0.92700000000000005},"min":{"1min":0.55200000000000005,"5min":0.50600000000000001,"15min":0.41899999999999998},"max":{"1min":4.1319999999999997,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":0.95299999999999996}]},{"osd":4,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.359,"15min":1.248},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.60599999999999998},"max":{"1min":2.2509999999999999,"5min":15.76,"15min":15.76},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.456,"15min":1.3160000000000001},"min":{"1min":0.94399999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.77,"5min":16.975000000000001,"15min":16.975000000000001},"last":1.0349999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.258,"15min":1.206},"min":{"1min":0.80900000000000005,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":4.3230000000000004,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":1.383},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3009999999999999,"15min":1.276},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.3330000000000002,"5min":2.52,"15min":2.52},"last":1.573}]},{"osd":6,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.288,"15min":1.2689999999999999},"min":{"1min":0.89900000000000002,"5min":0.83899999999999997,"15min":0.76000000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.355,"15min":1.3380000000000001},"min":{"1min":0.77400000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.5569999999999999,"5min":2.5569999999999999,"15min":2.5569999999999999},"last":1.669}]},{"osd":7,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3600000000000001,"15min":1.3700000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.77400000000000002},"max":{"1min":1.829,"5min":2.0019999999999998,"15min":4.4329999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.377,"15min":1.363},"min":{"1min":1.0089999999999999,"5min":0.81999999999999995,"15min":0.77600000000000002},"max":{"1min":4.3970000000000002,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.6060000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1400832,"data_stored":689215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.99199999999999999,"15min":0.93600000000000005},"min":{"1min":0.56499999999999995,"5min":0.34799999999999998,"15min":0.28699999999999998},"max":{"1min":1.972,"5min":15.273,"15min":15.273},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.95699999999999996,"15min":0.96499999999999997},"min":{"1min":0.70199999999999996,"5min":0.51800000000000002,"15min":0.34499999999999997},"max":{"1min":1.381,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.0069999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1499999999999999,"15min":1.091},"min":{"1min":0.755,"5min":0.48199999999999998,"15min":0.46400000000000002},"max":{"1min":1.4550000000000001,"5min":15.473000000000001,"15min":15.473000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.0489999999999999,"15min":1.0229999999999999},"min":{"1min":0.71699999999999997,"5min":0.626,"15min":0.45400000000000001},"max":{"1min":1.5249999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.1659999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.0049999999999999,"15min":1.0149999999999999},"min":{"1min":0.66200000000000003,"5min":0.40000000000000002,"15min":0.39000000000000001},"max":{"1min":1.409,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":0.878},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.2629999999999999,"15min":1.22},"min":{"1min":0.61799999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.647,"5min":15.439,"15min":15.439},"last":1.679}]},{"osd":4,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.236,"15min":1.325},"min":{"1min":0.91600000000000004,"5min":0.68200000000000005,"15min":0.61399999999999999},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":5.1799999999999997},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.204,"15min":1.2330000000000001},"min":{"1min":0.78200000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.7909999999999999,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":1.194}]},{"osd":5,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.244,"15min":1.329},"min":{"1min":0.88200000000000001,"5min":0.755,"15min":0.755},"max":{"1min":1.8149999999999999,"5min":2.891,"15min":3.548},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.321,"15min":1.3759999999999999},"min":{"1min":1.153,"5min":0.75900000000000001,"15min":0.59499999999999997},"max":{"1min":2.2309999999999999,"5min":2.823,"15min":2.823},"last":1.587}]},{"osd":6,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.506,"15min":1.456},"min":{"1min":1.1180000000000001,"5min":0.81399999999999995,"15min":0.59099999999999997},"max":{"1min":2.0950000000000002,"5min":15.4,"15min":15.4},"last":1.415},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.399,"15min":1.4590000000000001},"min":{"1min":1.0389999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.871,"5min":7.1349999999999998,"15min":7.1349999999999998},"last":1.627}]},{"osd":7,"last update":"Mon Jan 22 05:12:40 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.405,"15min":1.5489999999999999},"min":{"1min":1.141,"5min":0.91400000000000003,"15min":0.79900000000000004},"max":{"1min":1.8560000000000001,"5min":2.1080000000000001,"15min":5.29},"last":1.76},{"interface":"front","average":{"1min":1.419,"5min":1.3660000000000001,"15min":1.405},"min":{"1min":1.0609999999999999,"5min":0.81799999999999995,"15min":0.752},"max":{"1min":2.1869999999999998,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.5329999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:13:43.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3e is not active+clean 2024-01-22T05:13:43.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2024-01-22T05:13:43.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.522183+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:13:43.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3f is not active+clean 2024-01-22T05:13:43.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2024-01-22T05:13:43.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.520679+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:13:43.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3c is not active+clean 2024-01-22T05:13:43.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2024-01-22T05:13:43.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.522301+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:13:43.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3d is not active+clean 2024-01-22T05:13:43.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3c is not active+clean 2024-01-22T05:13:43.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.522510+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:13:43.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3a is not active+clean 2024-01-22T05:13:43.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2024-01-22T05:13:43.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.525127+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:13:43.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3b is not active+clean 2024-01-22T05:13:43.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2024-01-22T05:13:43.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.515821+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:13:43.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.38 is not active+clean 2024-01-22T05:13:43.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2024-01-22T05:13:43.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.515535+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:13:43.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.39 is not active+clean 2024-01-22T05:13:43.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.38 is not active+clean 2024-01-22T05:13:43.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.515836+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:13:43.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.36 is not active+clean 2024-01-22T05:13:43.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2024-01-22T05:13:43.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.515906+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:13:43.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.37 is not active+clean 2024-01-22T05:13:43.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2024-01-22T05:13:43.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.524411+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:13:43.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.34 is not active+clean 2024-01-22T05:13:43.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.35 is not active+clean 2024-01-22T05:13:43.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.510645+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:13:43.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.35 is not active+clean 2024-01-22T05:13:43.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2024-01-22T05:13:43.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.511704+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:13:43.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.32 is not active+clean 2024-01-22T05:13:43.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.33 is not active+clean 2024-01-22T05:13:43.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.521631+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:13:43.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.33 is not active+clean 2024-01-22T05:13:43.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2024-01-22T05:13:43.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.517014+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:13:43.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.30 is not active+clean 2024-01-22T05:13:43.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2024-01-22T05:13:43.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.516890+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:13:43.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.31 is not active+clean 2024-01-22T05:13:43.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2024-01-22T05:13:43.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.516029+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:13:43.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2e is not active+clean 2024-01-22T05:13:43.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2024-01-22T05:13:43.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.521164+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:13:43.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2f is not active+clean 2024-01-22T05:13:43.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2024-01-22T05:13:43.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.519952+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:13:43.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2c is not active+clean 2024-01-22T05:13:43.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2024-01-22T05:13:43.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.521743+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:13:43.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2d is not active+clean 2024-01-22T05:13:43.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2024-01-22T05:13:43.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.510739+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:13:43.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2a is not active+clean 2024-01-22T05:13:43.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2b is not active+clean 2024-01-22T05:13:43.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.517295+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:13:43.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2b is not active+clean 2024-01-22T05:13:43.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2024-01-22T05:13:43.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.523488+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:13:43.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.28 is not active+clean 2024-01-22T05:13:43.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2024-01-22T05:13:43.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.519782+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:13:43.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.29 is not active+clean 2024-01-22T05:13:43.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2024-01-22T05:13:43.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.523811+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:13:43.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.26 is not active+clean 2024-01-22T05:13:43.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2024-01-22T05:13:43.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.510963+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:13:43.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.27 is not active+clean 2024-01-22T05:13:43.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2024-01-22T05:13:43.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.511746+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:13:43.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.24 is not active+clean 2024-01-22T05:13:43.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.25 is not active+clean 2024-01-22T05:13:43.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.509972+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:13:43.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.25 is not active+clean 2024-01-22T05:13:43.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2024-01-22T05:13:43.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.515947+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:13:43.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.22 is not active+clean 2024-01-22T05:13:43.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.23 is not active+clean 2024-01-22T05:13:43.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.516084+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:13:43.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.23 is not active+clean 2024-01-22T05:13:43.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2024-01-22T05:13:43.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.511398+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:13:43.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.20 is not active+clean 2024-01-22T05:13:43.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2024-01-22T05:13:43.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.514961+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:13:43.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.21 is not active+clean 2024-01-22T05:13:43.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.20 is not active+clean 2024-01-22T05:13:43.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.514900+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:13:43.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1e is not active+clean 2024-01-22T05:13:43.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2024-01-22T05:13:43.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.509806+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:13:43.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1f is not active+clean 2024-01-22T05:13:43.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2024-01-22T05:13:43.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.518248+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:13:43.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1c is not active+clean 2024-01-22T05:13:43.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2024-01-22T05:13:43.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.515181+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:13:43.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1d is not active+clean 2024-01-22T05:13:43.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2024-01-22T05:13:43.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.514282+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:13:43.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1a is not active+clean 2024-01-22T05:13:43.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2024-01-22T05:13:43.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.511835+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:13:43.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1b is not active+clean 2024-01-22T05:13:43.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2024-01-22T05:13:43.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.522403+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:13:43.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.18 is not active+clean 2024-01-22T05:13:43.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2024-01-22T05:13:43.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.510970+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:13:43.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.19 is not active+clean 2024-01-22T05:13:43.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2024-01-22T05:13:43.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.523179+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:13:43.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.e is not active+clean 2024-01-22T05:13:43.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2024-01-22T05:13:43.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.520132+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:13:43.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.f is not active+clean 2024-01-22T05:13:43.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2024-01-22T05:13:43.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.514701+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:13:43.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.c is not active+clean 2024-01-22T05:13:43.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2024-01-22T05:13:43.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.516372+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:13:43.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.d is not active+clean 2024-01-22T05:13:43.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2024-01-22T05:13:43.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.509806+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:13:43.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.a is not active+clean 2024-01-22T05:13:43.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2024-01-22T05:13:43.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.524122+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:13:43.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.b is not active+clean 2024-01-22T05:13:43.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2024-01-22T05:13:43.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.513749+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:13:43.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.8 is not active+clean 2024-01-22T05:13:43.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2024-01-22T05:13:43.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.525857+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:13:43.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.9 is not active+clean 2024-01-22T05:13:43.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2024-01-22T05:13:43.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.521504+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:13:43.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.6 is not active+clean 2024-01-22T05:13:43.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2024-01-22T05:13:43.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.523430+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:13:43.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.7 is not active+clean 2024-01-22T05:13:43.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2024-01-22T05:13:43.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.516145+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:13:43.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.4 is not active+clean 2024-01-22T05:13:43.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2024-01-22T05:13:43.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.520200+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:13:43.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.5 is not active+clean 2024-01-22T05:13:43.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2024-01-22T05:13:43.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.521926+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:13:43.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2 is not active+clean 2024-01-22T05:13:43.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2024-01-22T05:13:43.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.509972+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:13:43.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3 is not active+clean 2024-01-22T05:13:43.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2024-01-22T05:13:43.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.510571+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:13:43.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.0 is not active+clean 2024-01-22T05:13:43.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2024-01-22T05:13:43.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.513745+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:13:43.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1 is not active+clean 2024-01-22T05:13:43.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2024-01-22T05:13:43.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.519838+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:13:43.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.14 is not active+clean 2024-01-22T05:13:43.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2024-01-22T05:13:43.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.521098+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:13:43.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.15 is not active+clean 2024-01-22T05:13:43.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2024-01-22T05:13:43.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.520454+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:13:43.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.16 is not active+clean 2024-01-22T05:13:43.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2024-01-22T05:13:43.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.514178+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:13:43.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.17 is not active+clean 2024-01-22T05:13:43.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2024-01-22T05:13:43.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.523347+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:13:43.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.11 is not active+clean 2024-01-22T05:13:43.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2024-01-22T05:13:43.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.514178+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:13:43.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.12 is not active+clean 2024-01-22T05:13:43.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2024-01-22T05:13:43.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.524628+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:13:43.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.13 is not active+clean 2024-01-22T05:13:43.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2024-01-22T05:13:43.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.515090+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:13:43.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.10 is not active+clean 2024-01-22T05:13:43.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:13:37.509399+0000', 'last_change': '2024-01-22T05:13:37.509399+0000', 'last_active': '2024-01-22T05:13:37.509399+0000', 'last_peered': '2024-01-22T05:13:37.509399+0000', 'last_clean': '2024-01-22T05:13:37.509399+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:37.509399+0000', 'last_undegraded': '2024-01-22T05:13:37.509399+0000', 'last_fullsized': '2024-01-22T05:13:37.509399+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:37.509399+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:13:43.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2024-01-22T05:13:43.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:13:36.496933+0000', 'last_change': '2024-01-22T05:13:36.509817+0000', 'last_active': '2024-01-22T05:13:36.496933+0000', 'last_peered': '2024-01-22T05:13:36.496933+0000', 'last_clean': '2024-01-22T05:13:36.496933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:13:36.496933+0000', 'last_undegraded': '2024-01-22T05:13:36.496933+0000', 'last_fullsized': '2024-01-22T05:13:36.496933+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'last_clean_scrub_stamp': '2024-01-22T05:13:36.496933+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:13:43.174 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:13:43.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.352+0000 7f0542600700 1 Processor -- start 2024-01-22T05:13:43.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.352+0000 7f0542600700 1 -- start start 2024-01-22T05:13:43.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.356+0000 7f0542600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f053c062c10 0x7f053c0c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:43.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.356+0000 7f0542600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f053c157c00 0x7f053c068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:43.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.356+0000 7f0542600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f053c158090 0x7f053c068f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:43.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.356+0000 7f0542600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053c069480 con 0x7f053c157c00 2024-01-22T05:13:43.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.356+0000 7f0542600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053c0632f0 con 0x7f053c062c10 2024-01-22T05:13:43.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.356+0000 7f0542600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0635d0 con 0x7f053c158090 2024-01-22T05:13:43.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.356+0000 7f053be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f053c157c00 0x7f053c068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:43.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f0541200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f053c062c10 0x7f053c0c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:43.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f053be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f053c157c00 0x7f053c068aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55590/0 (socket says 172.21.15.49:55590) 2024-01-22T05:13:43.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f0541200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f053c062c10 0x7f053c0c2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:43392/0 (socket says 172.21.15.49:43392) 2024-01-22T05:13:43.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f0541c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f053c158090 0x7f053c068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:43.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f053be00700 1 -- 172.21.15.49:0/2384937965 learned_addr learned my addr 172.21.15.49:0/2384937965 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:43.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f053be00700 1 -- 172.21.15.49:0/2384937965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f053c158090 msgr2=0x7f053c068f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:43.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f053be00700 1 --2- 172.21.15.49:0/2384937965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f053c158090 0x7f053c068f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f053be00700 1 -- 172.21.15.49:0/2384937965 >> v2:172.21.15.110:3300/0 conn(0x7f053c062c10 msgr2=0x7f053c0c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:43.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f053be00700 1 --2- 172.21.15.49:0/2384937965 >> v2:172.21.15.110:3300/0 conn(0x7f053c062c10 0x7f053c0c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f053be00700 1 -- 172.21.15.49:0/2384937965 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c0638b0 con 0x7f053c157c00 2024-01-22T05:13:43.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f053be00700 1 --2- 172.21.15.49:0/2384937965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f053c157c00 0x7f053c068aa0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f053c0659c0 tx=0x7f05240090f0).ready entity=mon.0 client_cookie=b49eb9176e9b4dc1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:43.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f053b400700 1 -- 172.21.15.49:0/2384937965 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052400f510 con 0x7f053c157c00 2024-01-22T05:13:43.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f053b400700 1 -- 172.21.15.49:0/2384937965 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052400f670 con 0x7f053c157c00 2024-01-22T05:13:43.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f053b400700 1 -- 172.21.15.49:0/2384937965 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052400fa10 con 0x7f053c157c00 2024-01-22T05:13:43.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f0542600700 1 -- 172.21.15.49:0/2384937965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f053c157c00 msgr2=0x7f053c068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:43.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f0542600700 1 --2- 172.21.15.49:0/2384937965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f053c157c00 0x7f053c068aa0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f053c0659c0 tx=0x7f05240090f0).stop 2024-01-22T05:13:43.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f0542600700 1 -- 172.21.15.49:0/2384937965 shutdown_connections 2024-01-22T05:13:43.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f0542600700 1 --2- 172.21.15.49:0/2384937965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f053c158090 0x7f053c068f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f0542600700 1 --2- 172.21.15.49:0/2384937965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f053c157c00 0x7f053c068aa0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f0542600700 1 --2- 172.21.15.49:0/2384937965 >> v2:172.21.15.110:3300/0 conn(0x7f053c062c10 0x7f053c0c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.360+0000 7f0542600700 1 -- 172.21.15.49:0/2384937965 >> 172.21.15.49:0/2384937965 conn(0x7f053c0c42c0 msgr2=0x7f053c065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:43.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.364+0000 7f0542600700 1 -- 172.21.15.49:0/2384937965 shutdown_connections 2024-01-22T05:13:43.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.364+0000 7f0542600700 1 -- 172.21.15.49:0/2384937965 wait complete. 2024-01-22T05:13:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.364+0000 7f0542600700 1 Processor -- start 2024-01-22T05:13:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.364+0000 7f0542600700 1 -- start start 2024-01-22T05:13:43.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f0542600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f053c062c10 0x7f053c14e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:43.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f0542600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f053c157c00 0x7f053c0bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:43.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f0542600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f053c158090 0x7f053c0ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:43.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f0542600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0c0220 con 0x7f053c157c00 2024-01-22T05:13:43.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f0542600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0aa7d0 con 0x7f053c062c10 2024-01-22T05:13:43.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f0542600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0aa4a0 con 0x7f053c158090 2024-01-22T05:13:43.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f053be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f053c157c00 0x7f053c0bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:43.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f053be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f053c157c00 0x7f053c0bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55598/0 (socket says 172.21.15.49:55598) 2024-01-22T05:13:43.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f053be00700 1 -- 172.21.15.49:0/607909825 learned_addr learned my addr 172.21.15.49:0/607909825 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:43.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f0541c00700 1 --2- 172.21.15.49:0/607909825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f053c158090 0x7f053c0ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:43.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f0541200700 1 --2- 172.21.15.49:0/607909825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f053c062c10 0x7f053c14e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:43.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f053be00700 1 -- 172.21.15.49:0/607909825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f053c158090 msgr2=0x7f053c0ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:43.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f053be00700 1 --2- 172.21.15.49:0/607909825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f053c158090 0x7f053c0ac790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f053be00700 1 -- 172.21.15.49:0/607909825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f053c062c10 msgr2=0x7f053c14e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:43.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f053be00700 1 --2- 172.21.15.49:0/607909825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f053c062c10 0x7f053c14e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f053be00700 1 -- 172.21.15.49:0/607909825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0524009370 con 0x7f053c157c00 2024-01-22T05:13:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f0541200700 1 --2- 172.21.15.49:0/607909825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f053c062c10 0x7f053c14e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f053be00700 1 --2- 172.21.15.49:0/607909825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f053c157c00 0x7f053c0bf130 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f0524006fd0 tx=0x7f0524017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f0533e00700 1 -- 172.21.15.49:0/607909825 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524000bc0 con 0x7f053c157c00 2024-01-22T05:13:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f0533e00700 1 -- 172.21.15.49:0/607909825 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052400f7e0 con 0x7f053c157c00 2024-01-22T05:13:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f0542600700 1 -- 172.21.15.49:0/607909825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c0bf980 con 0x7f053c157c00 2024-01-22T05:13:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f0533e00700 1 -- 172.21.15.49:0/607909825 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524000d20 con 0x7f053c157c00 2024-01-22T05:13:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.368+0000 7f0542600700 1 -- 172.21.15.49:0/607909825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053c0bff40 con 0x7f053c157c00 2024-01-22T05:13:43.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.372+0000 7f0542600700 1 -- 172.21.15.49:0/607909825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c065120 con 0x7f053c157c00 2024-01-22T05:13:43.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.372+0000 7f0533e00700 1 -- 172.21.15.49:0/607909825 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0524021070 con 0x7f053c157c00 2024-01-22T05:13:43.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.372+0000 7f0533e00700 1 --2- 172.21.15.49:0/607909825 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f051405a510 0x7f051405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:43.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.372+0000 7f0533e00700 1 -- 172.21.15.49:0/607909825 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f0524076300 con 0x7f053c157c00 2024-01-22T05:13:43.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.372+0000 7f0541200700 1 --2- 172.21.15.49:0/607909825 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f051405a510 0x7f051405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:43.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.372+0000 7f0541200700 1 --2- 172.21.15.49:0/607909825 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f051405a510 0x7f051405c9d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f052c009c00 tx=0x7f052c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:43.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.380+0000 7f0533e00700 1 -- 172.21.15.49:0/607909825 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0524049980 con 0x7f053c157c00 2024-01-22T05:13:43.485 INFO:tasks.ceph.mds.b.smithi110.stderr:2024-01-22T05:13:43.477+0000 7f1f53e00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:13:43.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.596+0000 7f0542600700 1 -- 172.21.15.49:0/607909825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f053c063b90 con 0x7f053c157c00 2024-01-22T05:13:43.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.596+0000 7f0533e00700 1 -- 172.21.15.49:0/607909825 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1271 (secure 0 0 0) 0x7f0524029020 con 0x7f053c157c00 2024-01-22T05:13:43.598 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:43.599 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":567,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":117,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2496471040,"bytes_avail":770597642240,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":98,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7743}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-01-22T05:13:21.420936+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:13:43.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.600+0000 7f0542600700 1 -- 172.21.15.49:0/607909825 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f051405a510 msgr2=0x7f051405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:43.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.600+0000 7f0542600700 1 --2- 172.21.15.49:0/607909825 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f051405a510 0x7f051405c9d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f052c009c00 tx=0x7f052c008040).stop 2024-01-22T05:13:43.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.600+0000 7f0542600700 1 -- 172.21.15.49:0/607909825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f053c157c00 msgr2=0x7f053c0bf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:43.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.600+0000 7f0542600700 1 --2- 172.21.15.49:0/607909825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f053c157c00 0x7f053c0bf130 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f0524006fd0 tx=0x7f0524017000).stop 2024-01-22T05:13:43.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.600+0000 7f0542600700 1 -- 172.21.15.49:0/607909825 shutdown_connections 2024-01-22T05:13:43.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.600+0000 7f0542600700 1 --2- 172.21.15.49:0/607909825 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f051405a510 0x7f051405c9d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.600+0000 7f0542600700 1 --2- 172.21.15.49:0/607909825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f053c158090 0x7f053c0ac790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.600+0000 7f0542600700 1 --2- 172.21.15.49:0/607909825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f053c157c00 0x7f053c0bf130 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.600+0000 7f0542600700 1 --2- 172.21.15.49:0/607909825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f053c062c10 0x7f053c14e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.600+0000 7f0542600700 1 -- 172.21.15.49:0/607909825 >> 172.21.15.49:0/607909825 conn(0x7f053c0c42c0 msgr2=0x7f053c067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:43.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.600+0000 7f0542600700 1 -- 172.21.15.49:0/607909825 shutdown_connections 2024-01-22T05:13:43.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.600+0000 7f0542600700 1 -- 172.21.15.49:0/607909825 wait complete. 2024-01-22T05:13:43.625 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-22T05:13:43.626 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:13:43.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.796+0000 7f0c7a200700 1 Processor -- start 2024-01-22T05:13:43.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.796+0000 7f0c7a200700 1 -- start start 2024-01-22T05:13:43.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c7a200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c740aaa40 0x7f0c74059470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:43.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c7a200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0c74062690 0x7f0c74155b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:43.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c7a200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c74059960 con 0x7f0c74062230 2024-01-22T05:13:43.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c7a200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c74064dd0 con 0x7f0c74062690 2024-01-22T05:13:43.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c7a200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c74152e30 con 0x7f0c740aaa40 2024-01-22T05:13:43.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c78c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0c74062690 0x7f0c74155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:43.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c73400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c740aaa40 0x7f0c74059470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:43.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c78c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0c74062690 0x7f0c74155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:43406/0 (socket says 172.21.15.49:43406) 2024-01-22T05:13:43.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c78c00700 1 -- 172.21.15.49:0/2155751293 learned_addr learned my addr 172.21.15.49:0/2155751293 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:43.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c73400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c740aaa40 0x7f0c74059470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:59990/0 (socket says 172.21.15.49:59990) 2024-01-22T05:13:43.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c72a00700 1 --1- 172.21.15.49:0/2155751293 >> v1:172.21.15.110:6789/0 conn(0x7f0c74062230 0x7f0c74155410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:49796/0 (socket says 172.21.15.49:49796) 2024-01-22T05:13:43.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c73400700 1 -- 172.21.15.49:0/2155751293 >> v2:172.21.15.110:3300/0 conn(0x7f0c74062690 msgr2=0x7f0c74155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:43.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c73400700 1 --2- 172.21.15.49:0/2155751293 >> v2:172.21.15.110:3300/0 conn(0x7f0c74062690 0x7f0c74155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c73400700 1 -- 172.21.15.49:0/2155751293 >> v1:172.21.15.110:6789/0 conn(0x7f0c74062230 legacy=0x7f0c74155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:43.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c73400700 1 -- 172.21.15.49:0/2155751293 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c74064fe0 con 0x7f0c740aaa40 2024-01-22T05:13:43.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.800+0000 7f0c73400700 1 --2- 172.21.15.49:0/2155751293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c740aaa40 0x7f0c74059470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f0c64009760 tx=0x7f0c64009060).ready entity=mon.2 client_cookie=75b6f812a7d6edd6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:43.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.804+0000 7f0c72000700 1 -- 172.21.15.49:0/2155751293 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6400f510 con 0x7f0c740aaa40 2024-01-22T05:13:43.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.804+0000 7f0c72000700 1 -- 172.21.15.49:0/2155751293 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6400f670 con 0x7f0c740aaa40 2024-01-22T05:13:43.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.804+0000 7f0c72000700 1 -- 172.21.15.49:0/2155751293 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6400f9f0 con 0x7f0c740aaa40 2024-01-22T05:13:43.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.804+0000 7f0c7a200700 1 -- 172.21.15.49:0/2155751293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c740aaa40 msgr2=0x7f0c74059470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:43.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.804+0000 7f0c7a200700 1 --2- 172.21.15.49:0/2155751293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c740aaa40 0x7f0c74059470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f0c64009760 tx=0x7f0c64009060).stop 2024-01-22T05:13:43.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.804+0000 7f0c7a200700 1 -- 172.21.15.49:0/2155751293 shutdown_connections 2024-01-22T05:13:43.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.804+0000 7f0c7a200700 1 --2- 172.21.15.49:0/2155751293 >> v2:172.21.15.110:3300/0 conn(0x7f0c74062690 0x7f0c74155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.804+0000 7f0c7a200700 1 --2- 172.21.15.49:0/2155751293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c740aaa40 0x7f0c74059470 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.804+0000 7f0c7a200700 1 -- 172.21.15.49:0/2155751293 >> 172.21.15.49:0/2155751293 conn(0x7f0c740c8560 msgr2=0x7f0c740c8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:43.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.804+0000 7f0c7a200700 1 -- 172.21.15.49:0/2155751293 shutdown_connections 2024-01-22T05:13:43.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.804+0000 7f0c7a200700 1 -- 172.21.15.49:0/2155751293 wait complete. 2024-01-22T05:13:43.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.808+0000 7f0c7a200700 1 Processor -- start 2024-01-22T05:13:43.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.808+0000 7f0c7a200700 1 -- start start 2024-01-22T05:13:43.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.808+0000 7f0c7a200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c74062230 0x7f0c741501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:43.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.808+0000 7f0c7a200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c74062690 0x7f0c741506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:43.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.808+0000 7f0c7a200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c740aaa40 0x7f0c740c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:43.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.808+0000 7f0c7a200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c740c2eb0 con 0x7f0c74062690 2024-01-22T05:13:43.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.808+0000 7f0c7a200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c741691c0 con 0x7f0c740aaa40 2024-01-22T05:13:43.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.808+0000 7f0c7a200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7416c000 con 0x7f0c74062230 2024-01-22T05:13:43.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.808+0000 7f0c72a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c74062690 0x7f0c741506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:43.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.812+0000 7f0c72a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c74062690 0x7f0c741506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55614/0 (socket says 172.21.15.49:55614) 2024-01-22T05:13:43.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.812+0000 7f0c73400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c74062230 0x7f0c741501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:43.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.812+0000 7f0c72a00700 1 -- 172.21.15.49:0/1687906143 learned_addr learned my addr 172.21.15.49:0/1687906143 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:43.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.812+0000 7f0c78c00700 1 --2- 172.21.15.49:0/1687906143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c740aaa40 0x7f0c740c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:43.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.812+0000 7f0c72a00700 1 -- 172.21.15.49:0/1687906143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c74062230 msgr2=0x7f0c741501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:43.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.812+0000 7f0c72a00700 1 --2- 172.21.15.49:0/1687906143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c74062230 0x7f0c741501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.812+0000 7f0c72a00700 1 -- 172.21.15.49:0/1687906143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c740aaa40 msgr2=0x7f0c740c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:43.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.812+0000 7f0c72a00700 1 --2- 172.21.15.49:0/1687906143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c740aaa40 0x7f0c740c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.812+0000 7f0c72a00700 1 -- 172.21.15.49:0/1687906143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c640092a0 con 0x7f0c74062690 2024-01-22T05:13:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.812+0000 7f0c72a00700 1 --2- 172.21.15.49:0/1687906143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c74062690 0x7f0c741506d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f0c5c00c440 tx=0x7f0c5c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.812+0000 7f0c6aa00700 1 -- 172.21.15.49:0/1687906143 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c0070d0 con 0x7f0c74062690 2024-01-22T05:13:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.812+0000 7f0c6aa00700 1 -- 172.21.15.49:0/1687906143 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5c007230 con 0x7f0c74062690 2024-01-22T05:13:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.812+0000 7f0c7a200700 1 -- 172.21.15.49:0/1687906143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c74168ee0 con 0x7f0c74062690 2024-01-22T05:13:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.812+0000 7f0c6aa00700 1 -- 172.21.15.49:0/1687906143 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c0075b0 con 0x7f0c74062690 2024-01-22T05:13:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.812+0000 7f0c7a200700 1 -- 172.21.15.49:0/1687906143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7416bc90 con 0x7f0c74062690 2024-01-22T05:13:43.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.816+0000 7f0c7a200700 1 -- 172.21.15.49:0/1687906143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c74047060 con 0x7f0c74062690 2024-01-22T05:13:43.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.816+0000 7f0c6aa00700 1 -- 172.21.15.49:0/1687906143 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0c5c0058f0 con 0x7f0c74062690 2024-01-22T05:13:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.816+0000 7f0c6aa00700 1 --2- 172.21.15.49:0/1687906143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0c4c05a510 0x7f0c4c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.816+0000 7f0c6aa00700 1 -- 172.21.15.49:0/1687906143 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f0c5c073ff0 con 0x7f0c74062690 2024-01-22T05:13:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.816+0000 7f0c73400700 1 --2- 172.21.15.49:0/1687906143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0c4c05a510 0x7f0c4c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.820+0000 7f0c73400700 1 --2- 172.21.15.49:0/1687906143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0c4c05a510 0x7f0c4c05c9d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f0c64009fd0 tx=0x7f0c64017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:43.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.824+0000 7f0c6aa00700 1 -- 172.21.15.49:0/1687906143 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0c5c047630 con 0x7f0c74062690 2024-01-22T05:13:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:43.984+0000 7f0c7a200700 1 -- 172.21.15.49:0/1687906143 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c74060140 con 0x7f0c4c05a510 2024-01-22T05:13:44.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:44.000+0000 7f0c6aa00700 1 -- 172.21.15.49:0/1687906143 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359553 (secure 0 0 0) 0x7f0c74060140 con 0x7f0c4c05a510 2024-01-22T05:13:44.029 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:44.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:44.012+0000 7f0c7a200700 1 -- 172.21.15.49:0/1687906143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0c4c05a510 msgr2=0x7f0c4c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:44.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:44.012+0000 7f0c7a200700 1 --2- 172.21.15.49:0/1687906143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0c4c05a510 0x7f0c4c05c9d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f0c64009fd0 tx=0x7f0c64017000).stop 2024-01-22T05:13:44.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:44.012+0000 7f0c7a200700 1 -- 172.21.15.49:0/1687906143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c74062690 msgr2=0x7f0c741506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:44.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:44.012+0000 7f0c7a200700 1 --2- 172.21.15.49:0/1687906143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c74062690 0x7f0c741506d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f0c5c00c440 tx=0x7f0c5c007dc0).stop 2024-01-22T05:13:44.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:44.012+0000 7f0c7a200700 1 -- 172.21.15.49:0/1687906143 shutdown_connections 2024-01-22T05:13:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:44.012+0000 7f0c7a200700 1 --2- 172.21.15.49:0/1687906143 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0c4c05a510 0x7f0c4c05c9d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:44.012+0000 7f0c7a200700 1 --2- 172.21.15.49:0/1687906143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c740aaa40 0x7f0c740c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:44.012+0000 7f0c7a200700 1 --2- 172.21.15.49:0/1687906143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c74062690 0x7f0c741506d0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:44.012+0000 7f0c7a200700 1 --2- 172.21.15.49:0/1687906143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c74062230 0x7f0c741501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:44.012+0000 7f0c7a200700 1 -- 172.21.15.49:0/1687906143 >> 172.21.15.49:0/1687906143 conn(0x7f0c740c8560 msgr2=0x7f0c740ad500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:44.012+0000 7f0c7a200700 1 -- 172.21.15.49:0/1687906143 shutdown_connections 2024-01-22T05:13:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:44.012+0000 7f0c7a200700 1 -- 172.21.15.49:0/1687906143 wait complete. 2024-01-22T05:13:44.032 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:13:44.040 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2024-01-22T05:13:43.427429+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2442432,"kb_used_data":11392,"kb_used_omap":0,"kb_used_meta":2430976,"kb_avail":752532288,"statfs":{"total":773094113280,"available":770593062912,"internally_reserved":0,"allocated":11665408,"data_stored":5743892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489319424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077814386,"num_objects":-1078,"num_object_clones":0,"num_object_copies":-2156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3210,"num_write_kb":-1053285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.056634"},"pg_stats":[{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.023661+0000","last_change":"2024-01-22T05:13:38.019459+0000","last_active":"2024-01-22T05:13:38.023661+0000","last_peered":"2024-01-22T05:13:38.023661+0000","last_clean":"2024-01-22T05:13:38.023661+0000","last_became_active":"2024-01-22T05:13:38.019196+0000","last_became_peered":"2024-01-22T05:13:38.019196+0000","last_unstale":"2024-01-22T05:13:38.023661+0000","last_undegraded":"2024-01-22T05:13:38.023661+0000","last_fullsized":"2024-01-22T05:13:38.023661+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3f","version":"116'3","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.043624+0000","last_change":"2024-01-22T05:13:37.569345+0000","last_active":"2024-01-22T05:13:38.043624+0000","last_peered":"2024-01-22T05:13:38.043624+0000","last_clean":"2024-01-22T05:13:38.043624+0000","last_became_active":"2024-01-22T05:13:37.569095+0000","last_became_peered":"2024-01-22T05:13:37.569095+0000","last_unstale":"2024-01-22T05:13:38.043624+0000","last_undegraded":"2024-01-22T05:13:38.043624+0000","last_fullsized":"2024-01-22T05:13:38.043624+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.043509+0000","last_change":"2024-01-22T05:13:38.032505+0000","last_active":"2024-01-22T05:13:38.043509+0000","last_peered":"2024-01-22T05:13:38.043509+0000","last_clean":"2024-01-22T05:13:38.043509+0000","last_became_active":"2024-01-22T05:13:38.031468+0000","last_became_peered":"2024-01-22T05:13:38.031468+0000","last_unstale":"2024-01-22T05:13:38.043509+0000","last_undegraded":"2024-01-22T05:13:38.043509+0000","last_fullsized":"2024-01-22T05:13:38.043509+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.013490+0000","last_change":"2024-01-22T05:13:37.553258+0000","last_active":"2024-01-22T05:13:38.013490+0000","last_peered":"2024-01-22T05:13:38.013490+0000","last_clean":"2024-01-22T05:13:38.013490+0000","last_became_active":"2024-01-22T05:13:37.551419+0000","last_became_peered":"2024-01-22T05:13:37.551419+0000","last_unstale":"2024-01-22T05:13:38.013490+0000","last_undegraded":"2024-01-22T05:13:38.013490+0000","last_fullsized":"2024-01-22T05:13:38.013490+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.026477+0000","last_change":"2024-01-22T05:13:38.018376+0000","last_active":"2024-01-22T05:13:38.026477+0000","last_peered":"2024-01-22T05:13:38.026477+0000","last_clean":"2024-01-22T05:13:38.026477+0000","last_became_active":"2024-01-22T05:13:38.018109+0000","last_became_peered":"2024-01-22T05:13:38.018109+0000","last_unstale":"2024-01-22T05:13:38.026477+0000","last_undegraded":"2024-01-22T05:13:38.026477+0000","last_fullsized":"2024-01-22T05:13:38.026477+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.011470+0000","last_change":"2024-01-22T05:13:37.560576+0000","last_active":"2024-01-22T05:13:38.011470+0000","last_peered":"2024-01-22T05:13:38.011470+0000","last_clean":"2024-01-22T05:13:38.011470+0000","last_became_active":"2024-01-22T05:13:37.560307+0000","last_became_peered":"2024-01-22T05:13:37.560307+0000","last_unstale":"2024-01-22T05:13:38.011470+0000","last_undegraded":"2024-01-22T05:13:38.011470+0000","last_fullsized":"2024-01-22T05:13:38.011470+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034975+0000","last_change":"2024-01-22T05:13:38.027527+0000","last_active":"2024-01-22T05:13:38.034975+0000","last_peered":"2024-01-22T05:13:38.034975+0000","last_clean":"2024-01-22T05:13:38.034975+0000","last_became_active":"2024-01-22T05:13:38.027060+0000","last_became_peered":"2024-01-22T05:13:38.027060+0000","last_unstale":"2024-01-22T05:13:38.034975+0000","last_undegraded":"2024-01-22T05:13:38.034975+0000","last_fullsized":"2024-01-22T05:13:38.034975+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3c","version":"116'2","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034925+0000","last_change":"2024-01-22T05:13:37.543334+0000","last_active":"2024-01-22T05:13:38.034925+0000","last_peered":"2024-01-22T05:13:38.034925+0000","last_clean":"2024-01-22T05:13:38.034925+0000","last_became_active":"2024-01-22T05:13:37.543039+0000","last_became_peered":"2024-01-22T05:13:37.543039+0000","last_unstale":"2024-01-22T05:13:38.034925+0000","last_undegraded":"2024-01-22T05:13:38.034925+0000","last_fullsized":"2024-01-22T05:13:38.034925+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.024520+0000","last_change":"2024-01-22T05:13:38.016943+0000","last_active":"2024-01-22T05:13:38.024520+0000","last_peered":"2024-01-22T05:13:38.024520+0000","last_clean":"2024-01-22T05:13:38.024520+0000","last_became_active":"2024-01-22T05:13:38.016669+0000","last_became_peered":"2024-01-22T05:13:38.016669+0000","last_unstale":"2024-01-22T05:13:38.024520+0000","last_undegraded":"2024-01-22T05:13:38.024520+0000","last_fullsized":"2024-01-22T05:13:38.024520+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3b","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.024156+0000","last_change":"2024-01-22T05:13:37.557502+0000","last_active":"2024-01-22T05:13:38.024156+0000","last_peered":"2024-01-22T05:13:38.024156+0000","last_clean":"2024-01-22T05:13:38.024156+0000","last_became_active":"2024-01-22T05:13:37.557216+0000","last_became_peered":"2024-01-22T05:13:37.557216+0000","last_unstale":"2024-01-22T05:13:38.024156+0000","last_undegraded":"2024-01-22T05:13:38.024156+0000","last_fullsized":"2024-01-22T05:13:38.024156+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.028483+0000","last_change":"2024-01-22T05:13:38.024711+0000","last_active":"2024-01-22T05:13:38.028483+0000","last_peered":"2024-01-22T05:13:38.028483+0000","last_clean":"2024-01-22T05:13:38.028483+0000","last_became_active":"2024-01-22T05:13:38.023888+0000","last_became_peered":"2024-01-22T05:13:38.023888+0000","last_unstale":"2024-01-22T05:13:38.028483+0000","last_undegraded":"2024-01-22T05:13:38.028483+0000","last_fullsized":"2024-01-22T05:13:38.028483+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3a","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.026441+0000","last_change":"2024-01-22T05:13:37.557402+0000","last_active":"2024-01-22T05:13:38.026441+0000","last_peered":"2024-01-22T05:13:38.026441+0000","last_clean":"2024-01-22T05:13:38.026441+0000","last_became_active":"2024-01-22T05:13:37.557125+0000","last_became_peered":"2024-01-22T05:13:37.557125+0000","last_unstale":"2024-01-22T05:13:38.026441+0000","last_undegraded":"2024-01-22T05:13:38.026441+0000","last_fullsized":"2024-01-22T05:13:38.026441+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.035288+0000","last_change":"2024-01-22T05:13:38.028813+0000","last_active":"2024-01-22T05:13:38.035288+0000","last_peered":"2024-01-22T05:13:38.035288+0000","last_clean":"2024-01-22T05:13:38.035288+0000","last_became_active":"2024-01-22T05:13:38.028390+0000","last_became_peered":"2024-01-22T05:13:38.028390+0000","last_unstale":"2024-01-22T05:13:38.035288+0000","last_undegraded":"2024-01-22T05:13:38.035288+0000","last_fullsized":"2024-01-22T05:13:38.035288+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.012158+0000","last_change":"2024-01-22T05:13:37.550353+0000","last_active":"2024-01-22T05:13:38.012158+0000","last_peered":"2024-01-22T05:13:38.012158+0000","last_clean":"2024-01-22T05:13:38.012158+0000","last_became_active":"2024-01-22T05:13:37.550085+0000","last_became_peered":"2024-01-22T05:13:37.550085+0000","last_unstale":"2024-01-22T05:13:38.012158+0000","last_undegraded":"2024-01-22T05:13:38.012158+0000","last_fullsized":"2024-01-22T05:13:38.012158+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.023904+0000","last_change":"2024-01-22T05:13:38.017453+0000","last_active":"2024-01-22T05:13:38.023904+0000","last_peered":"2024-01-22T05:13:38.023904+0000","last_clean":"2024-01-22T05:13:38.023904+0000","last_became_active":"2024-01-22T05:13:38.017170+0000","last_became_peered":"2024-01-22T05:13:38.017170+0000","last_unstale":"2024-01-22T05:13:38.023904+0000","last_undegraded":"2024-01-22T05:13:38.023904+0000","last_fullsized":"2024-01-22T05:13:38.023904+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.005727+0000","last_change":"2024-01-22T05:13:37.565191+0000","last_active":"2024-01-22T05:13:38.005727+0000","last_peered":"2024-01-22T05:13:38.005727+0000","last_clean":"2024-01-22T05:13:38.005727+0000","last_became_active":"2024-01-22T05:13:37.564903+0000","last_became_peered":"2024-01-22T05:13:37.564903+0000","last_unstale":"2024-01-22T05:13:38.005727+0000","last_undegraded":"2024-01-22T05:13:38.005727+0000","last_fullsized":"2024-01-22T05:13:38.005727+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.044073+0000","last_change":"2024-01-22T05:13:38.035320+0000","last_active":"2024-01-22T05:13:38.044073+0000","last_peered":"2024-01-22T05:13:38.044073+0000","last_clean":"2024-01-22T05:13:38.044073+0000","last_became_active":"2024-01-22T05:13:38.034977+0000","last_became_peered":"2024-01-22T05:13:38.034977+0000","last_unstale":"2024-01-22T05:13:38.044073+0000","last_undegraded":"2024-01-22T05:13:38.044073+0000","last_fullsized":"2024-01-22T05:13:38.044073+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.012569+0000","last_change":"2024-01-22T05:13:37.553658+0000","last_active":"2024-01-22T05:13:38.012569+0000","last_peered":"2024-01-22T05:13:38.012569+0000","last_clean":"2024-01-22T05:13:38.012569+0000","last_became_active":"2024-01-22T05:13:37.553353+0000","last_became_peered":"2024-01-22T05:13:37.553353+0000","last_unstale":"2024-01-22T05:13:38.012569+0000","last_undegraded":"2024-01-22T05:13:38.012569+0000","last_fullsized":"2024-01-22T05:13:38.012569+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034572+0000","last_change":"2024-01-22T05:13:38.025758+0000","last_active":"2024-01-22T05:13:38.034572+0000","last_peered":"2024-01-22T05:13:38.034572+0000","last_clean":"2024-01-22T05:13:38.034572+0000","last_became_active":"2024-01-22T05:13:38.022843+0000","last_became_peered":"2024-01-22T05:13:38.022843+0000","last_unstale":"2024-01-22T05:13:38.034572+0000","last_undegraded":"2024-01-22T05:13:38.034572+0000","last_fullsized":"2024-01-22T05:13:38.034572+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.012859+0000","last_change":"2024-01-22T05:13:37.559713+0000","last_active":"2024-01-22T05:13:38.012859+0000","last_peered":"2024-01-22T05:13:38.012859+0000","last_clean":"2024-01-22T05:13:38.012859+0000","last_became_active":"2024-01-22T05:13:37.559421+0000","last_became_peered":"2024-01-22T05:13:37.559421+0000","last_unstale":"2024-01-22T05:13:38.012859+0000","last_undegraded":"2024-01-22T05:13:38.012859+0000","last_fullsized":"2024-01-22T05:13:38.012859+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.026456+0000","last_change":"2024-01-22T05:13:38.017798+0000","last_active":"2024-01-22T05:13:38.026456+0000","last_peered":"2024-01-22T05:13:38.026456+0000","last_clean":"2024-01-22T05:13:38.026456+0000","last_became_active":"2024-01-22T05:13:38.017489+0000","last_became_peered":"2024-01-22T05:13:38.017489+0000","last_unstale":"2024-01-22T05:13:38.026456+0000","last_undegraded":"2024-01-22T05:13:38.026456+0000","last_fullsized":"2024-01-22T05:13:38.026456+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:37.999093+0000","last_change":"2024-01-22T05:13:37.547775+0000","last_active":"2024-01-22T05:13:37.999093+0000","last_peered":"2024-01-22T05:13:37.999093+0000","last_clean":"2024-01-22T05:13:37.999093+0000","last_became_active":"2024-01-22T05:13:37.547486+0000","last_became_peered":"2024-01-22T05:13:37.547486+0000","last_unstale":"2024-01-22T05:13:37.999093+0000","last_undegraded":"2024-01-22T05:13:37.999093+0000","last_fullsized":"2024-01-22T05:13:37.999093+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.018852+0000","last_change":"2024-01-22T05:13:38.016335+0000","last_active":"2024-01-22T05:13:38.018852+0000","last_peered":"2024-01-22T05:13:38.018852+0000","last_clean":"2024-01-22T05:13:38.018852+0000","last_became_active":"2024-01-22T05:13:38.014968+0000","last_became_peered":"2024-01-22T05:13:38.014968+0000","last_unstale":"2024-01-22T05:13:38.018852+0000","last_undegraded":"2024-01-22T05:13:38.018852+0000","last_fullsized":"2024-01-22T05:13:38.018852+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"116'4","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.038428+0000","last_change":"2024-01-22T05:13:37.535933+0000","last_active":"2024-01-22T05:13:38.038428+0000","last_peered":"2024-01-22T05:13:38.038428+0000","last_clean":"2024-01-22T05:13:38.038428+0000","last_became_active":"2024-01-22T05:13:37.535622+0000","last_became_peered":"2024-01-22T05:13:37.535622+0000","last_unstale":"2024-01-22T05:13:38.038428+0000","last_undegraded":"2024-01-22T05:13:38.038428+0000","last_fullsized":"2024-01-22T05:13:38.038428+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034523+0000","last_change":"2024-01-22T05:13:38.027622+0000","last_active":"2024-01-22T05:13:38.034523+0000","last_peered":"2024-01-22T05:13:38.034523+0000","last_clean":"2024-01-22T05:13:38.034523+0000","last_became_active":"2024-01-22T05:13:38.027000+0000","last_became_peered":"2024-01-22T05:13:38.027000+0000","last_unstale":"2024-01-22T05:13:38.034523+0000","last_undegraded":"2024-01-22T05:13:38.034523+0000","last_fullsized":"2024-01-22T05:13:38.034523+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.33","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.033085+0000","last_change":"2024-01-22T05:13:37.538432+0000","last_active":"2024-01-22T05:13:38.033085+0000","last_peered":"2024-01-22T05:13:38.033085+0000","last_clean":"2024-01-22T05:13:38.033085+0000","last_became_active":"2024-01-22T05:13:37.538133+0000","last_became_peered":"2024-01-22T05:13:37.538133+0000","last_unstale":"2024-01-22T05:13:38.033085+0000","last_undegraded":"2024-01-22T05:13:38.033085+0000","last_fullsized":"2024-01-22T05:13:38.033085+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.036264+0000","last_change":"2024-01-22T05:13:38.034766+0000","last_active":"2024-01-22T05:13:38.036264+0000","last_peered":"2024-01-22T05:13:38.036264+0000","last_clean":"2024-01-22T05:13:38.036264+0000","last_became_active":"2024-01-22T05:13:38.034324+0000","last_became_peered":"2024-01-22T05:13:38.034324+0000","last_unstale":"2024-01-22T05:13:38.036264+0000","last_undegraded":"2024-01-22T05:13:38.036264+0000","last_fullsized":"2024-01-22T05:13:38.036264+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.019347+0000","last_change":"2024-01-22T05:13:37.564688+0000","last_active":"2024-01-22T05:13:38.019347+0000","last_peered":"2024-01-22T05:13:38.019347+0000","last_clean":"2024-01-22T05:13:38.019347+0000","last_became_active":"2024-01-22T05:13:37.564370+0000","last_became_peered":"2024-01-22T05:13:37.564370+0000","last_unstale":"2024-01-22T05:13:38.019347+0000","last_undegraded":"2024-01-22T05:13:38.019347+0000","last_fullsized":"2024-01-22T05:13:38.019347+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.043503+0000","last_change":"2024-01-22T05:13:38.034440+0000","last_active":"2024-01-22T05:13:38.043503+0000","last_peered":"2024-01-22T05:13:38.043503+0000","last_clean":"2024-01-22T05:13:38.043503+0000","last_became_active":"2024-01-22T05:13:38.034151+0000","last_became_peered":"2024-01-22T05:13:38.034151+0000","last_unstale":"2024-01-22T05:13:38.043503+0000","last_undegraded":"2024-01-22T05:13:38.043503+0000","last_fullsized":"2024-01-22T05:13:38.043503+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.021062+0000","last_change":"2024-01-22T05:13:37.554466+0000","last_active":"2024-01-22T05:13:38.021062+0000","last_peered":"2024-01-22T05:13:38.021062+0000","last_clean":"2024-01-22T05:13:38.021062+0000","last_became_active":"2024-01-22T05:13:37.554168+0000","last_became_peered":"2024-01-22T05:13:37.554168+0000","last_unstale":"2024-01-22T05:13:38.021062+0000","last_undegraded":"2024-01-22T05:13:38.021062+0000","last_fullsized":"2024-01-22T05:13:38.021062+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.021724+0000","last_change":"2024-01-22T05:13:38.017473+0000","last_active":"2024-01-22T05:13:38.021724+0000","last_peered":"2024-01-22T05:13:38.021724+0000","last_clean":"2024-01-22T05:13:38.021724+0000","last_became_active":"2024-01-22T05:13:38.017131+0000","last_became_peered":"2024-01-22T05:13:38.017131+0000","last_unstale":"2024-01-22T05:13:38.021724+0000","last_undegraded":"2024-01-22T05:13:38.021724+0000","last_fullsized":"2024-01-22T05:13:38.021724+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.30","version":"116'4","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.039651+0000","last_change":"2024-01-22T05:13:37.563803+0000","last_active":"2024-01-22T05:13:38.039651+0000","last_peered":"2024-01-22T05:13:38.039651+0000","last_clean":"2024-01-22T05:13:38.039651+0000","last_became_active":"2024-01-22T05:13:37.563515+0000","last_became_peered":"2024-01-22T05:13:37.563515+0000","last_unstale":"2024-01-22T05:13:38.039651+0000","last_undegraded":"2024-01-22T05:13:38.039651+0000","last_fullsized":"2024-01-22T05:13:38.039651+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.021289+0000","last_change":"2024-01-22T05:13:38.015521+0000","last_active":"2024-01-22T05:13:38.021289+0000","last_peered":"2024-01-22T05:13:38.021289+0000","last_clean":"2024-01-22T05:13:38.021289+0000","last_became_active":"2024-01-22T05:13:38.015117+0000","last_became_peered":"2024-01-22T05:13:38.015117+0000","last_unstale":"2024-01-22T05:13:38.021289+0000","last_undegraded":"2024-01-22T05:13:38.021289+0000","last_fullsized":"2024-01-22T05:13:38.021289+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.011398+0000","last_change":"2024-01-22T05:13:37.559552+0000","last_active":"2024-01-22T05:13:38.011398+0000","last_peered":"2024-01-22T05:13:38.011398+0000","last_clean":"2024-01-22T05:13:38.011398+0000","last_became_active":"2024-01-22T05:13:37.559248+0000","last_became_peered":"2024-01-22T05:13:37.559248+0000","last_unstale":"2024-01-22T05:13:38.011398+0000","last_undegraded":"2024-01-22T05:13:38.011398+0000","last_fullsized":"2024-01-22T05:13:38.011398+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.025702+0000","last_change":"2024-01-22T05:13:38.021201+0000","last_active":"2024-01-22T05:13:38.025702+0000","last_peered":"2024-01-22T05:13:38.025702+0000","last_clean":"2024-01-22T05:13:38.025702+0000","last_became_active":"2024-01-22T05:13:38.020885+0000","last_became_peered":"2024-01-22T05:13:38.020885+0000","last_unstale":"2024-01-22T05:13:38.025702+0000","last_undegraded":"2024-01-22T05:13:38.025702+0000","last_fullsized":"2024-01-22T05:13:38.025702+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.013604+0000","last_change":"2024-01-22T05:13:37.554937+0000","last_active":"2024-01-22T05:13:38.013604+0000","last_peered":"2024-01-22T05:13:38.013604+0000","last_clean":"2024-01-22T05:13:38.013604+0000","last_became_active":"2024-01-22T05:13:37.554583+0000","last_became_peered":"2024-01-22T05:13:37.554583+0000","last_unstale":"2024-01-22T05:13:38.013604+0000","last_undegraded":"2024-01-22T05:13:38.013604+0000","last_fullsized":"2024-01-22T05:13:38.013604+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.035035+0000","last_change":"2024-01-22T05:13:38.028985+0000","last_active":"2024-01-22T05:13:38.035035+0000","last_peered":"2024-01-22T05:13:38.035035+0000","last_clean":"2024-01-22T05:13:38.035035+0000","last_became_active":"2024-01-22T05:13:38.027144+0000","last_became_peered":"2024-01-22T05:13:38.027144+0000","last_unstale":"2024-01-22T05:13:38.035035+0000","last_undegraded":"2024-01-22T05:13:38.035035+0000","last_fullsized":"2024-01-22T05:13:38.035035+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2d","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.044783+0000","last_change":"2024-01-22T05:13:37.558570+0000","last_active":"2024-01-22T05:13:38.044783+0000","last_peered":"2024-01-22T05:13:38.044783+0000","last_clean":"2024-01-22T05:13:38.044783+0000","last_became_active":"2024-01-22T05:13:37.558107+0000","last_became_peered":"2024-01-22T05:13:37.558107+0000","last_unstale":"2024-01-22T05:13:38.044783+0000","last_undegraded":"2024-01-22T05:13:38.044783+0000","last_fullsized":"2024-01-22T05:13:38.044783+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.036236+0000","last_change":"2024-01-22T05:13:38.034729+0000","last_active":"2024-01-22T05:13:38.036236+0000","last_peered":"2024-01-22T05:13:38.036236+0000","last_clean":"2024-01-22T05:13:38.036236+0000","last_became_active":"2024-01-22T05:13:38.034366+0000","last_became_peered":"2024-01-22T05:13:38.034366+0000","last_unstale":"2024-01-22T05:13:38.036236+0000","last_undegraded":"2024-01-22T05:13:38.036236+0000","last_fullsized":"2024-01-22T05:13:38.036236+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.007436+0000","last_change":"2024-01-22T05:13:37.544820+0000","last_active":"2024-01-22T05:13:38.007436+0000","last_peered":"2024-01-22T05:13:38.007436+0000","last_clean":"2024-01-22T05:13:38.007436+0000","last_became_active":"2024-01-22T05:13:37.544312+0000","last_became_peered":"2024-01-22T05:13:37.544312+0000","last_unstale":"2024-01-22T05:13:38.007436+0000","last_undegraded":"2024-01-22T05:13:38.007436+0000","last_fullsized":"2024-01-22T05:13:38.007436+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.032727+0000","last_change":"2024-01-22T05:13:38.027428+0000","last_active":"2024-01-22T05:13:38.032727+0000","last_peered":"2024-01-22T05:13:38.032727+0000","last_clean":"2024-01-22T05:13:38.032727+0000","last_became_active":"2024-01-22T05:13:38.027156+0000","last_became_peered":"2024-01-22T05:13:38.027156+0000","last_unstale":"2024-01-22T05:13:38.032727+0000","last_undegraded":"2024-01-22T05:13:38.032727+0000","last_fullsized":"2024-01-22T05:13:38.032727+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2b","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.037039+0000","last_change":"2024-01-22T05:13:37.555752+0000","last_active":"2024-01-22T05:13:38.037039+0000","last_peered":"2024-01-22T05:13:38.037039+0000","last_clean":"2024-01-22T05:13:38.037039+0000","last_became_active":"2024-01-22T05:13:37.554142+0000","last_became_peered":"2024-01-22T05:13:37.554142+0000","last_unstale":"2024-01-22T05:13:38.037039+0000","last_undegraded":"2024-01-22T05:13:38.037039+0000","last_fullsized":"2024-01-22T05:13:38.037039+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.018441+0000","last_change":"2024-01-22T05:13:38.014620+0000","last_active":"2024-01-22T05:13:38.018441+0000","last_peered":"2024-01-22T05:13:38.018441+0000","last_clean":"2024-01-22T05:13:38.018441+0000","last_became_active":"2024-01-22T05:13:38.014324+0000","last_became_peered":"2024-01-22T05:13:38.014324+0000","last_unstale":"2024-01-22T05:13:38.018441+0000","last_undegraded":"2024-01-22T05:13:38.018441+0000","last_fullsized":"2024-01-22T05:13:38.018441+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.010722+0000","last_change":"2024-01-22T05:13:37.560808+0000","last_active":"2024-01-22T05:13:38.010722+0000","last_peered":"2024-01-22T05:13:38.010722+0000","last_clean":"2024-01-22T05:13:38.010722+0000","last_became_active":"2024-01-22T05:13:37.558518+0000","last_became_peered":"2024-01-22T05:13:37.558518+0000","last_unstale":"2024-01-22T05:13:38.010722+0000","last_undegraded":"2024-01-22T05:13:38.010722+0000","last_fullsized":"2024-01-22T05:13:38.010722+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.037707+0000","last_change":"2024-01-22T05:13:38.029853+0000","last_active":"2024-01-22T05:13:38.037707+0000","last_peered":"2024-01-22T05:13:38.037707+0000","last_clean":"2024-01-22T05:13:38.037707+0000","last_became_active":"2024-01-22T05:13:38.029573+0000","last_became_peered":"2024-01-22T05:13:38.029573+0000","last_unstale":"2024-01-22T05:13:38.037707+0000","last_undegraded":"2024-01-22T05:13:38.037707+0000","last_fullsized":"2024-01-22T05:13:38.037707+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.007524+0000","last_change":"2024-01-22T05:13:37.560111+0000","last_active":"2024-01-22T05:13:38.007524+0000","last_peered":"2024-01-22T05:13:38.007524+0000","last_clean":"2024-01-22T05:13:38.007524+0000","last_became_active":"2024-01-22T05:13:37.559433+0000","last_became_peered":"2024-01-22T05:13:37.559433+0000","last_unstale":"2024-01-22T05:13:38.007524+0000","last_undegraded":"2024-01-22T05:13:38.007524+0000","last_fullsized":"2024-01-22T05:13:38.007524+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034034+0000","last_change":"2024-01-22T05:13:38.027434+0000","last_active":"2024-01-22T05:13:38.034034+0000","last_peered":"2024-01-22T05:13:38.034034+0000","last_clean":"2024-01-22T05:13:38.034034+0000","last_became_active":"2024-01-22T05:13:38.027084+0000","last_became_peered":"2024-01-22T05:13:38.027084+0000","last_unstale":"2024-01-22T05:13:38.034034+0000","last_undegraded":"2024-01-22T05:13:38.034034+0000","last_fullsized":"2024-01-22T05:13:38.034034+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.007908+0000","last_change":"2024-01-22T05:13:37.559125+0000","last_active":"2024-01-22T05:13:38.007908+0000","last_peered":"2024-01-22T05:13:38.007908+0000","last_clean":"2024-01-22T05:13:38.007908+0000","last_became_active":"2024-01-22T05:13:37.558292+0000","last_became_peered":"2024-01-22T05:13:37.558292+0000","last_unstale":"2024-01-22T05:13:38.007908+0000","last_undegraded":"2024-01-22T05:13:38.007908+0000","last_fullsized":"2024-01-22T05:13:38.007908+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.027975+0000","last_change":"2024-01-22T05:13:38.017206+0000","last_active":"2024-01-22T05:13:38.027975+0000","last_peered":"2024-01-22T05:13:38.027975+0000","last_clean":"2024-01-22T05:13:38.027975+0000","last_became_active":"2024-01-22T05:13:38.016939+0000","last_became_peered":"2024-01-22T05:13:38.016939+0000","last_unstale":"2024-01-22T05:13:38.027975+0000","last_undegraded":"2024-01-22T05:13:38.027975+0000","last_fullsized":"2024-01-22T05:13:38.027975+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.007938+0000","last_change":"2024-01-22T05:13:37.538721+0000","last_active":"2024-01-22T05:13:38.007938+0000","last_peered":"2024-01-22T05:13:38.007938+0000","last_clean":"2024-01-22T05:13:38.007938+0000","last_became_active":"2024-01-22T05:13:37.538445+0000","last_became_peered":"2024-01-22T05:13:37.538445+0000","last_unstale":"2024-01-22T05:13:38.007938+0000","last_undegraded":"2024-01-22T05:13:38.007938+0000","last_fullsized":"2024-01-22T05:13:38.007938+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.018145+0000","last_change":"2024-01-22T05:13:38.015761+0000","last_active":"2024-01-22T05:13:38.018145+0000","last_peered":"2024-01-22T05:13:38.018145+0000","last_clean":"2024-01-22T05:13:38.018145+0000","last_became_active":"2024-01-22T05:13:38.015064+0000","last_became_peered":"2024-01-22T05:13:38.015064+0000","last_unstale":"2024-01-22T05:13:38.018145+0000","last_undegraded":"2024-01-22T05:13:38.018145+0000","last_fullsized":"2024-01-22T05:13:38.018145+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.007343+0000","last_change":"2024-01-22T05:13:37.550094+0000","last_active":"2024-01-22T05:13:38.007343+0000","last_peered":"2024-01-22T05:13:38.007343+0000","last_clean":"2024-01-22T05:13:38.007343+0000","last_became_active":"2024-01-22T05:13:37.549835+0000","last_became_peered":"2024-01-22T05:13:37.549835+0000","last_unstale":"2024-01-22T05:13:38.007343+0000","last_undegraded":"2024-01-22T05:13:38.007343+0000","last_fullsized":"2024-01-22T05:13:38.007343+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.041098+0000","last_change":"2024-01-22T05:13:38.038250+0000","last_active":"2024-01-22T05:13:38.041098+0000","last_peered":"2024-01-22T05:13:38.041098+0000","last_clean":"2024-01-22T05:13:38.041098+0000","last_became_active":"2024-01-22T05:13:38.037695+0000","last_became_peered":"2024-01-22T05:13:38.037695+0000","last_unstale":"2024-01-22T05:13:38.041098+0000","last_undegraded":"2024-01-22T05:13:38.041098+0000","last_fullsized":"2024-01-22T05:13:38.041098+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:37.999239+0000","last_change":"2024-01-22T05:13:37.545092+0000","last_active":"2024-01-22T05:13:37.999239+0000","last_peered":"2024-01-22T05:13:37.999239+0000","last_clean":"2024-01-22T05:13:37.999239+0000","last_became_active":"2024-01-22T05:13:37.544811+0000","last_became_peered":"2024-01-22T05:13:37.544811+0000","last_unstale":"2024-01-22T05:13:37.999239+0000","last_undegraded":"2024-01-22T05:13:37.999239+0000","last_fullsized":"2024-01-22T05:13:37.999239+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.042874+0000","last_change":"2024-01-22T05:13:38.038149+0000","last_active":"2024-01-22T05:13:38.042874+0000","last_peered":"2024-01-22T05:13:38.042874+0000","last_clean":"2024-01-22T05:13:38.042874+0000","last_became_active":"2024-01-22T05:13:38.037895+0000","last_became_peered":"2024-01-22T05:13:38.037895+0000","last_unstale":"2024-01-22T05:13:38.042874+0000","last_undegraded":"2024-01-22T05:13:38.042874+0000","last_fullsized":"2024-01-22T05:13:38.042874+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.011084+0000","last_change":"2024-01-22T05:13:37.542968+0000","last_active":"2024-01-22T05:13:38.011084+0000","last_peered":"2024-01-22T05:13:38.011084+0000","last_clean":"2024-01-22T05:13:38.011084+0000","last_became_active":"2024-01-22T05:13:37.542654+0000","last_became_peered":"2024-01-22T05:13:37.542654+0000","last_unstale":"2024-01-22T05:13:38.011084+0000","last_undegraded":"2024-01-22T05:13:38.011084+0000","last_fullsized":"2024-01-22T05:13:38.011084+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.024822+0000","last_change":"2024-01-22T05:13:38.011857+0000","last_active":"2024-01-22T05:13:38.024822+0000","last_peered":"2024-01-22T05:13:38.024822+0000","last_clean":"2024-01-22T05:13:38.024822+0000","last_became_active":"2024-01-22T05:13:38.011453+0000","last_became_peered":"2024-01-22T05:13:38.011453+0000","last_unstale":"2024-01-22T05:13:38.024822+0000","last_undegraded":"2024-01-22T05:13:38.024822+0000","last_fullsized":"2024-01-22T05:13:38.024822+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.008603+0000","last_change":"2024-01-22T05:13:37.558512+0000","last_active":"2024-01-22T05:13:38.008603+0000","last_peered":"2024-01-22T05:13:38.008603+0000","last_clean":"2024-01-22T05:13:38.008603+0000","last_became_active":"2024-01-22T05:13:37.558207+0000","last_became_peered":"2024-01-22T05:13:37.558207+0000","last_unstale":"2024-01-22T05:13:38.008603+0000","last_undegraded":"2024-01-22T05:13:38.008603+0000","last_fullsized":"2024-01-22T05:13:38.008603+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034168+0000","last_change":"2024-01-22T05:13:38.030664+0000","last_active":"2024-01-22T05:13:38.034168+0000","last_peered":"2024-01-22T05:13:38.034168+0000","last_clean":"2024-01-22T05:13:38.034168+0000","last_became_active":"2024-01-22T05:13:38.030394+0000","last_became_peered":"2024-01-22T05:13:38.030394+0000","last_unstale":"2024-01-22T05:13:38.034168+0000","last_undegraded":"2024-01-22T05:13:38.034168+0000","last_fullsized":"2024-01-22T05:13:38.034168+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006289+0000","last_change":"2024-01-22T05:13:37.537581+0000","last_active":"2024-01-22T05:13:38.006289+0000","last_peered":"2024-01-22T05:13:38.006289+0000","last_clean":"2024-01-22T05:13:38.006289+0000","last_became_active":"2024-01-22T05:13:37.537298+0000","last_became_peered":"2024-01-22T05:13:37.537298+0000","last_unstale":"2024-01-22T05:13:38.006289+0000","last_undegraded":"2024-01-22T05:13:38.006289+0000","last_fullsized":"2024-01-22T05:13:38.006289+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.025583+0000","last_change":"2024-01-22T05:13:38.017716+0000","last_active":"2024-01-22T05:13:38.025583+0000","last_peered":"2024-01-22T05:13:38.025583+0000","last_clean":"2024-01-22T05:13:38.025583+0000","last_became_active":"2024-01-22T05:13:38.017454+0000","last_became_peered":"2024-01-22T05:13:38.017454+0000","last_unstale":"2024-01-22T05:13:38.025583+0000","last_undegraded":"2024-01-22T05:13:38.025583+0000","last_fullsized":"2024-01-22T05:13:38.025583+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.014637+0000","last_change":"2024-01-22T05:13:37.559151+0000","last_active":"2024-01-22T05:13:38.014637+0000","last_peered":"2024-01-22T05:13:38.014637+0000","last_clean":"2024-01-22T05:13:38.014637+0000","last_became_active":"2024-01-22T05:13:37.558877+0000","last_became_peered":"2024-01-22T05:13:37.558877+0000","last_unstale":"2024-01-22T05:13:38.014637+0000","last_undegraded":"2024-01-22T05:13:38.014637+0000","last_fullsized":"2024-01-22T05:13:38.014637+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.022669+0000","last_change":"2024-01-22T05:13:38.017696+0000","last_active":"2024-01-22T05:13:38.022669+0000","last_peered":"2024-01-22T05:13:38.022669+0000","last_clean":"2024-01-22T05:13:38.022669+0000","last_became_active":"2024-01-22T05:13:38.016625+0000","last_became_peered":"2024-01-22T05:13:38.016625+0000","last_unstale":"2024-01-22T05:13:38.022669+0000","last_undegraded":"2024-01-22T05:13:38.022669+0000","last_fullsized":"2024-01-22T05:13:38.022669+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006096+0000","last_change":"2024-01-22T05:13:37.564440+0000","last_active":"2024-01-22T05:13:38.006096+0000","last_peered":"2024-01-22T05:13:38.006096+0000","last_clean":"2024-01-22T05:13:38.006096+0000","last_became_active":"2024-01-22T05:13:37.563801+0000","last_became_peered":"2024-01-22T05:13:37.563801+0000","last_unstale":"2024-01-22T05:13:38.006096+0000","last_undegraded":"2024-01-22T05:13:38.006096+0000","last_fullsized":"2024-01-22T05:13:38.006096+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.030023+0000","last_change":"2024-01-22T05:13:38.026457+0000","last_active":"2024-01-22T05:13:38.030023+0000","last_peered":"2024-01-22T05:13:38.030023+0000","last_clean":"2024-01-22T05:13:38.030023+0000","last_became_active":"2024-01-22T05:13:38.026171+0000","last_became_peered":"2024-01-22T05:13:38.026171+0000","last_unstale":"2024-01-22T05:13:38.030023+0000","last_undegraded":"2024-01-22T05:13:38.030023+0000","last_fullsized":"2024-01-22T05:13:38.030023+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.030062+0000","last_change":"2024-01-22T05:13:37.544470+0000","last_active":"2024-01-22T05:13:38.030062+0000","last_peered":"2024-01-22T05:13:38.030062+0000","last_clean":"2024-01-22T05:13:38.030062+0000","last_became_active":"2024-01-22T05:13:37.544177+0000","last_became_peered":"2024-01-22T05:13:37.544177+0000","last_unstale":"2024-01-22T05:13:38.030062+0000","last_undegraded":"2024-01-22T05:13:38.030062+0000","last_fullsized":"2024-01-22T05:13:38.030062+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.033800+0000","last_change":"2024-01-22T05:13:38.031410+0000","last_active":"2024-01-22T05:13:38.033800+0000","last_peered":"2024-01-22T05:13:38.033800+0000","last_clean":"2024-01-22T05:13:38.033800+0000","last_became_active":"2024-01-22T05:13:38.030871+0000","last_became_peered":"2024-01-22T05:13:38.030871+0000","last_unstale":"2024-01-22T05:13:38.033800+0000","last_undegraded":"2024-01-22T05:13:38.033800+0000","last_fullsized":"2024-01-22T05:13:38.033800+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.029086+0000","last_change":"2024-01-22T05:13:37.553701+0000","last_active":"2024-01-22T05:13:38.029086+0000","last_peered":"2024-01-22T05:13:38.029086+0000","last_clean":"2024-01-22T05:13:38.029086+0000","last_became_active":"2024-01-22T05:13:37.553412+0000","last_became_peered":"2024-01-22T05:13:37.553412+0000","last_unstale":"2024-01-22T05:13:38.029086+0000","last_undegraded":"2024-01-22T05:13:38.029086+0000","last_fullsized":"2024-01-22T05:13:38.029086+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.021690+0000","last_change":"2024-01-22T05:13:38.017798+0000","last_active":"2024-01-22T05:13:38.021690+0000","last_peered":"2024-01-22T05:13:38.021690+0000","last_clean":"2024-01-22T05:13:38.021690+0000","last_became_active":"2024-01-22T05:13:38.017420+0000","last_became_peered":"2024-01-22T05:13:38.017420+0000","last_unstale":"2024-01-22T05:13:38.021690+0000","last_undegraded":"2024-01-22T05:13:38.021690+0000","last_fullsized":"2024-01-22T05:13:38.021690+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"116'2","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.025737+0000","last_change":"2024-01-22T05:13:37.557144+0000","last_active":"2024-01-22T05:13:38.025737+0000","last_peered":"2024-01-22T05:13:38.025737+0000","last_clean":"2024-01-22T05:13:38.025737+0000","last_became_active":"2024-01-22T05:13:37.556824+0000","last_became_peered":"2024-01-22T05:13:37.556824+0000","last_unstale":"2024-01-22T05:13:38.025737+0000","last_undegraded":"2024-01-22T05:13:38.025737+0000","last_fullsized":"2024-01-22T05:13:38.025737+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.036296+0000","last_change":"2024-01-22T05:13:38.035088+0000","last_active":"2024-01-22T05:13:38.036296+0000","last_peered":"2024-01-22T05:13:38.036296+0000","last_clean":"2024-01-22T05:13:38.036296+0000","last_became_active":"2024-01-22T05:13:38.034795+0000","last_became_peered":"2024-01-22T05:13:38.034795+0000","last_unstale":"2024-01-22T05:13:38.036296+0000","last_undegraded":"2024-01-22T05:13:38.036296+0000","last_fullsized":"2024-01-22T05:13:38.036296+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.007122+0000","last_change":"2024-01-22T05:13:37.571987+0000","last_active":"2024-01-22T05:13:38.007122+0000","last_peered":"2024-01-22T05:13:38.007122+0000","last_clean":"2024-01-22T05:13:38.007122+0000","last_became_active":"2024-01-22T05:13:37.571706+0000","last_became_peered":"2024-01-22T05:13:37.571706+0000","last_unstale":"2024-01-22T05:13:38.007122+0000","last_undegraded":"2024-01-22T05:13:38.007122+0000","last_fullsized":"2024-01-22T05:13:38.007122+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034467+0000","last_change":"2024-01-22T05:13:38.022355+0000","last_active":"2024-01-22T05:13:38.034467+0000","last_peered":"2024-01-22T05:13:38.034467+0000","last_clean":"2024-01-22T05:13:38.034467+0000","last_became_active":"2024-01-22T05:13:38.022020+0000","last_became_peered":"2024-01-22T05:13:38.022020+0000","last_unstale":"2024-01-22T05:13:38.034467+0000","last_undegraded":"2024-01-22T05:13:38.034467+0000","last_fullsized":"2024-01-22T05:13:38.034467+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:37.998950+0000","last_change":"2024-01-22T05:13:37.549530+0000","last_active":"2024-01-22T05:13:37.998950+0000","last_peered":"2024-01-22T05:13:37.998950+0000","last_clean":"2024-01-22T05:13:37.998950+0000","last_became_active":"2024-01-22T05:13:37.549237+0000","last_became_peered":"2024-01-22T05:13:37.549237+0000","last_unstale":"2024-01-22T05:13:37.998950+0000","last_undegraded":"2024-01-22T05:13:37.998950+0000","last_fullsized":"2024-01-22T05:13:37.998950+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.018459+0000","last_change":"2024-01-22T05:13:38.015929+0000","last_active":"2024-01-22T05:13:38.018459+0000","last_peered":"2024-01-22T05:13:38.018459+0000","last_clean":"2024-01-22T05:13:38.018459+0000","last_became_active":"2024-01-22T05:13:38.015296+0000","last_became_peered":"2024-01-22T05:13:38.015296+0000","last_unstale":"2024-01-22T05:13:38.018459+0000","last_undegraded":"2024-01-22T05:13:38.018459+0000","last_fullsized":"2024-01-22T05:13:38.018459+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.000314+0000","last_change":"2024-01-22T05:13:37.547370+0000","last_active":"2024-01-22T05:13:38.000314+0000","last_peered":"2024-01-22T05:13:38.000314+0000","last_clean":"2024-01-22T05:13:38.000314+0000","last_became_active":"2024-01-22T05:13:37.547089+0000","last_became_peered":"2024-01-22T05:13:37.547089+0000","last_unstale":"2024-01-22T05:13:38.000314+0000","last_undegraded":"2024-01-22T05:13:38.000314+0000","last_fullsized":"2024-01-22T05:13:38.000314+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.045062+0000","last_change":"2024-01-22T05:13:38.038057+0000","last_active":"2024-01-22T05:13:38.045062+0000","last_peered":"2024-01-22T05:13:38.045062+0000","last_clean":"2024-01-22T05:13:38.045062+0000","last_became_active":"2024-01-22T05:13:38.037865+0000","last_became_peered":"2024-01-22T05:13:38.037865+0000","last_unstale":"2024-01-22T05:13:38.045062+0000","last_undegraded":"2024-01-22T05:13:38.045062+0000","last_fullsized":"2024-01-22T05:13:38.045062+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.005286+0000","last_change":"2024-01-22T05:13:37.536103+0000","last_active":"2024-01-22T05:13:38.005286+0000","last_peered":"2024-01-22T05:13:38.005286+0000","last_clean":"2024-01-22T05:13:38.005286+0000","last_became_active":"2024-01-22T05:13:37.535635+0000","last_became_peered":"2024-01-22T05:13:37.535635+0000","last_unstale":"2024-01-22T05:13:38.005286+0000","last_undegraded":"2024-01-22T05:13:38.005286+0000","last_fullsized":"2024-01-22T05:13:38.005286+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.023923+0000","last_change":"2024-01-22T05:13:38.018587+0000","last_active":"2024-01-22T05:13:38.023923+0000","last_peered":"2024-01-22T05:13:38.023923+0000","last_clean":"2024-01-22T05:13:38.023923+0000","last_became_active":"2024-01-22T05:13:38.018220+0000","last_became_peered":"2024-01-22T05:13:38.018220+0000","last_unstale":"2024-01-22T05:13:38.023923+0000","last_undegraded":"2024-01-22T05:13:38.023923+0000","last_fullsized":"2024-01-22T05:13:38.023923+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006534+0000","last_change":"2024-01-22T05:13:37.571206+0000","last_active":"2024-01-22T05:13:38.006534+0000","last_peered":"2024-01-22T05:13:38.006534+0000","last_clean":"2024-01-22T05:13:38.006534+0000","last_became_active":"2024-01-22T05:13:37.570007+0000","last_became_peered":"2024-01-22T05:13:37.570007+0000","last_unstale":"2024-01-22T05:13:38.006534+0000","last_undegraded":"2024-01-22T05:13:38.006534+0000","last_fullsized":"2024-01-22T05:13:38.006534+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.037372+0000","last_change":"2024-01-22T05:13:38.032582+0000","last_active":"2024-01-22T05:13:38.037372+0000","last_peered":"2024-01-22T05:13:38.037372+0000","last_clean":"2024-01-22T05:13:38.037372+0000","last_became_active":"2024-01-22T05:13:38.032306+0000","last_became_peered":"2024-01-22T05:13:38.032306+0000","last_unstale":"2024-01-22T05:13:38.037372+0000","last_undegraded":"2024-01-22T05:13:38.037372+0000","last_fullsized":"2024-01-22T05:13:38.037372+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.043700+0000","last_change":"2024-01-22T05:13:37.561017+0000","last_active":"2024-01-22T05:13:38.043700+0000","last_peered":"2024-01-22T05:13:38.043700+0000","last_clean":"2024-01-22T05:13:38.043700+0000","last_became_active":"2024-01-22T05:13:37.559625+0000","last_became_peered":"2024-01-22T05:13:37.559625+0000","last_unstale":"2024-01-22T05:13:38.043700+0000","last_undegraded":"2024-01-22T05:13:38.043700+0000","last_fullsized":"2024-01-22T05:13:38.043700+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.044755+0000","last_change":"2024-01-22T05:13:38.037569+0000","last_active":"2024-01-22T05:13:38.044755+0000","last_peered":"2024-01-22T05:13:38.044755+0000","last_clean":"2024-01-22T05:13:38.044755+0000","last_became_active":"2024-01-22T05:13:38.035381+0000","last_became_peered":"2024-01-22T05:13:38.035381+0000","last_unstale":"2024-01-22T05:13:38.044755+0000","last_undegraded":"2024-01-22T05:13:38.044755+0000","last_fullsized":"2024-01-22T05:13:38.044755+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"116'2","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.028307+0000","last_change":"2024-01-22T05:13:37.548445+0000","last_active":"2024-01-22T05:13:38.028307+0000","last_peered":"2024-01-22T05:13:38.028307+0000","last_clean":"2024-01-22T05:13:38.028307+0000","last_became_active":"2024-01-22T05:13:37.548015+0000","last_became_peered":"2024-01-22T05:13:37.548015+0000","last_unstale":"2024-01-22T05:13:38.028307+0000","last_undegraded":"2024-01-22T05:13:38.028307+0000","last_fullsized":"2024-01-22T05:13:38.028307+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.040966+0000","last_change":"2024-01-22T05:13:38.040227+0000","last_active":"2024-01-22T05:13:38.040966+0000","last_peered":"2024-01-22T05:13:38.040966+0000","last_clean":"2024-01-22T05:13:38.040966+0000","last_became_active":"2024-01-22T05:13:38.039934+0000","last_became_peered":"2024-01-22T05:13:38.039934+0000","last_unstale":"2024-01-22T05:13:38.040966+0000","last_undegraded":"2024-01-22T05:13:38.040966+0000","last_fullsized":"2024-01-22T05:13:38.040966+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.013110+0000","last_change":"2024-01-22T05:13:37.543326+0000","last_active":"2024-01-22T05:13:38.013110+0000","last_peered":"2024-01-22T05:13:38.013110+0000","last_clean":"2024-01-22T05:13:38.013110+0000","last_became_active":"2024-01-22T05:13:37.543045+0000","last_became_peered":"2024-01-22T05:13:37.543045+0000","last_unstale":"2024-01-22T05:13:38.013110+0000","last_undegraded":"2024-01-22T05:13:38.013110+0000","last_fullsized":"2024-01-22T05:13:38.013110+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.035223+0000","last_change":"2024-01-22T05:13:38.029559+0000","last_active":"2024-01-22T05:13:38.035223+0000","last_peered":"2024-01-22T05:13:38.035223+0000","last_clean":"2024-01-22T05:13:38.035223+0000","last_became_active":"2024-01-22T05:13:38.029246+0000","last_became_peered":"2024-01-22T05:13:38.029246+0000","last_unstale":"2024-01-22T05:13:38.035223+0000","last_undegraded":"2024-01-22T05:13:38.035223+0000","last_fullsized":"2024-01-22T05:13:38.035223+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:37.999249+0000","last_change":"2024-01-22T05:13:37.553977+0000","last_active":"2024-01-22T05:13:37.999249+0000","last_peered":"2024-01-22T05:13:37.999249+0000","last_clean":"2024-01-22T05:13:37.999249+0000","last_became_active":"2024-01-22T05:13:37.553693+0000","last_became_peered":"2024-01-22T05:13:37.553693+0000","last_unstale":"2024-01-22T05:13:37.999249+0000","last_undegraded":"2024-01-22T05:13:37.999249+0000","last_fullsized":"2024-01-22T05:13:37.999249+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034547+0000","last_change":"2024-01-22T05:13:38.027805+0000","last_active":"2024-01-22T05:13:38.034547+0000","last_peered":"2024-01-22T05:13:38.034547+0000","last_clean":"2024-01-22T05:13:38.034547+0000","last_became_active":"2024-01-22T05:13:38.027332+0000","last_became_peered":"2024-01-22T05:13:38.027332+0000","last_unstale":"2024-01-22T05:13:38.034547+0000","last_undegraded":"2024-01-22T05:13:38.034547+0000","last_fullsized":"2024-01-22T05:13:38.034547+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.030937+0000","last_change":"2024-01-22T05:13:37.570225+0000","last_active":"2024-01-22T05:13:38.030937+0000","last_peered":"2024-01-22T05:13:38.030937+0000","last_clean":"2024-01-22T05:13:38.030937+0000","last_became_active":"2024-01-22T05:13:37.569857+0000","last_became_peered":"2024-01-22T05:13:37.569857+0000","last_unstale":"2024-01-22T05:13:38.030937+0000","last_undegraded":"2024-01-22T05:13:38.030937+0000","last_fullsized":"2024-01-22T05:13:38.030937+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.043753+0000","last_change":"2024-01-22T05:13:38.034744+0000","last_active":"2024-01-22T05:13:38.043753+0000","last_peered":"2024-01-22T05:13:38.043753+0000","last_clean":"2024-01-22T05:13:38.043753+0000","last_became_active":"2024-01-22T05:13:38.034471+0000","last_became_peered":"2024-01-22T05:13:38.034471+0000","last_unstale":"2024-01-22T05:13:38.043753+0000","last_undegraded":"2024-01-22T05:13:38.043753+0000","last_fullsized":"2024-01-22T05:13:38.043753+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006851+0000","last_change":"2024-01-22T05:13:37.571997+0000","last_active":"2024-01-22T05:13:38.006851+0000","last_peered":"2024-01-22T05:13:38.006851+0000","last_clean":"2024-01-22T05:13:38.006851+0000","last_became_active":"2024-01-22T05:13:37.571663+0000","last_became_peered":"2024-01-22T05:13:37.571663+0000","last_unstale":"2024-01-22T05:13:38.006851+0000","last_undegraded":"2024-01-22T05:13:38.006851+0000","last_fullsized":"2024-01-22T05:13:38.006851+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.035415+0000","last_change":"2024-01-22T05:13:38.033942+0000","last_active":"2024-01-22T05:13:38.035415+0000","last_peered":"2024-01-22T05:13:38.035415+0000","last_clean":"2024-01-22T05:13:38.035415+0000","last_became_active":"2024-01-22T05:13:38.033670+0000","last_became_peered":"2024-01-22T05:13:38.033670+0000","last_unstale":"2024-01-22T05:13:38.035415+0000","last_undegraded":"2024-01-22T05:13:38.035415+0000","last_fullsized":"2024-01-22T05:13:38.035415+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.009856+0000","last_change":"2024-01-22T05:13:37.569597+0000","last_active":"2024-01-22T05:13:38.009856+0000","last_peered":"2024-01-22T05:13:38.009856+0000","last_clean":"2024-01-22T05:13:38.009856+0000","last_became_active":"2024-01-22T05:13:37.569082+0000","last_became_peered":"2024-01-22T05:13:37.569082+0000","last_unstale":"2024-01-22T05:13:38.009856+0000","last_undegraded":"2024-01-22T05:13:38.009856+0000","last_fullsized":"2024-01-22T05:13:38.009856+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.028877+0000","last_change":"2024-01-22T05:13:38.025849+0000","last_active":"2024-01-22T05:13:38.028877+0000","last_peered":"2024-01-22T05:13:38.028877+0000","last_clean":"2024-01-22T05:13:38.028877+0000","last_became_active":"2024-01-22T05:13:38.025592+0000","last_became_peered":"2024-01-22T05:13:38.025592+0000","last_unstale":"2024-01-22T05:13:38.028877+0000","last_undegraded":"2024-01-22T05:13:38.028877+0000","last_fullsized":"2024-01-22T05:13:38.028877+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006641+0000","last_change":"2024-01-22T05:13:37.559125+0000","last_active":"2024-01-22T05:13:38.006641+0000","last_peered":"2024-01-22T05:13:38.006641+0000","last_clean":"2024-01-22T05:13:38.006641+0000","last_became_active":"2024-01-22T05:13:37.558625+0000","last_became_peered":"2024-01-22T05:13:37.558625+0000","last_unstale":"2024-01-22T05:13:38.006641+0000","last_undegraded":"2024-01-22T05:13:38.006641+0000","last_fullsized":"2024-01-22T05:13:38.006641+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.032266+0000","last_change":"2024-01-22T05:13:38.028367+0000","last_active":"2024-01-22T05:13:38.032266+0000","last_peered":"2024-01-22T05:13:38.032266+0000","last_clean":"2024-01-22T05:13:38.032266+0000","last_became_active":"2024-01-22T05:13:38.028038+0000","last_became_peered":"2024-01-22T05:13:38.028038+0000","last_unstale":"2024-01-22T05:13:38.032266+0000","last_undegraded":"2024-01-22T05:13:38.032266+0000","last_fullsized":"2024-01-22T05:13:38.032266+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"116'2","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.044204+0000","last_change":"2024-01-22T05:13:37.551795+0000","last_active":"2024-01-22T05:13:38.044204+0000","last_peered":"2024-01-22T05:13:38.044204+0000","last_clean":"2024-01-22T05:13:38.044204+0000","last_became_active":"2024-01-22T05:13:37.551500+0000","last_became_peered":"2024-01-22T05:13:37.551500+0000","last_unstale":"2024-01-22T05:13:38.044204+0000","last_undegraded":"2024-01-22T05:13:38.044204+0000","last_fullsized":"2024-01-22T05:13:38.044204+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034554+0000","last_change":"2024-01-22T05:13:38.023159+0000","last_active":"2024-01-22T05:13:38.034554+0000","last_peered":"2024-01-22T05:13:38.034554+0000","last_clean":"2024-01-22T05:13:38.034554+0000","last_became_active":"2024-01-22T05:13:38.022561+0000","last_became_peered":"2024-01-22T05:13:38.022561+0000","last_unstale":"2024-01-22T05:13:38.034554+0000","last_undegraded":"2024-01-22T05:13:38.034554+0000","last_fullsized":"2024-01-22T05:13:38.034554+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.013701+0000","last_change":"2024-01-22T05:13:37.548804+0000","last_active":"2024-01-22T05:13:38.013701+0000","last_peered":"2024-01-22T05:13:38.013701+0000","last_clean":"2024-01-22T05:13:38.013701+0000","last_became_active":"2024-01-22T05:13:37.548518+0000","last_became_peered":"2024-01-22T05:13:37.548518+0000","last_unstale":"2024-01-22T05:13:38.013701+0000","last_undegraded":"2024-01-22T05:13:38.013701+0000","last_fullsized":"2024-01-22T05:13:38.013701+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.045405+0000","last_change":"2024-01-22T05:13:38.039581+0000","last_active":"2024-01-22T05:13:38.045405+0000","last_peered":"2024-01-22T05:13:38.045405+0000","last_clean":"2024-01-22T05:13:38.045405+0000","last_became_active":"2024-01-22T05:13:38.039294+0000","last_became_peered":"2024-01-22T05:13:38.039294+0000","last_unstale":"2024-01-22T05:13:38.045405+0000","last_undegraded":"2024-01-22T05:13:38.045405+0000","last_fullsized":"2024-01-22T05:13:38.045405+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.012027+0000","last_change":"2024-01-22T05:13:37.558383+0000","last_active":"2024-01-22T05:13:38.012027+0000","last_peered":"2024-01-22T05:13:38.012027+0000","last_clean":"2024-01-22T05:13:38.012027+0000","last_became_active":"2024-01-22T05:13:37.557715+0000","last_became_peered":"2024-01-22T05:13:37.557715+0000","last_unstale":"2024-01-22T05:13:38.012027+0000","last_undegraded":"2024-01-22T05:13:38.012027+0000","last_fullsized":"2024-01-22T05:13:38.012027+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.032492+0000","last_change":"2024-01-22T05:13:38.028376+0000","last_active":"2024-01-22T05:13:38.032492+0000","last_peered":"2024-01-22T05:13:38.032492+0000","last_clean":"2024-01-22T05:13:38.032492+0000","last_became_active":"2024-01-22T05:13:38.028016+0000","last_became_peered":"2024-01-22T05:13:38.028016+0000","last_unstale":"2024-01-22T05:13:38.032492+0000","last_undegraded":"2024-01-22T05:13:38.032492+0000","last_fullsized":"2024-01-22T05:13:38.032492+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.001333+0000","last_change":"2024-01-22T05:13:37.560002+0000","last_active":"2024-01-22T05:13:38.001333+0000","last_peered":"2024-01-22T05:13:38.001333+0000","last_clean":"2024-01-22T05:13:38.001333+0000","last_became_active":"2024-01-22T05:13:37.559723+0000","last_became_peered":"2024-01-22T05:13:37.559723+0000","last_unstale":"2024-01-22T05:13:38.001333+0000","last_undegraded":"2024-01-22T05:13:38.001333+0000","last_fullsized":"2024-01-22T05:13:38.001333+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.012109+0000","last_change":"2024-01-22T05:13:38.007706+0000","last_active":"2024-01-22T05:13:38.012109+0000","last_peered":"2024-01-22T05:13:38.012109+0000","last_clean":"2024-01-22T05:13:38.012109+0000","last_became_active":"2024-01-22T05:13:38.007369+0000","last_became_peered":"2024-01-22T05:13:38.007369+0000","last_unstale":"2024-01-22T05:13:38.012109+0000","last_undegraded":"2024-01-22T05:13:38.012109+0000","last_fullsized":"2024-01-22T05:13:38.012109+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:37.999700+0000","last_change":"2024-01-22T05:13:37.536198+0000","last_active":"2024-01-22T05:13:37.999700+0000","last_peered":"2024-01-22T05:13:37.999700+0000","last_clean":"2024-01-22T05:13:37.999700+0000","last_became_active":"2024-01-22T05:13:37.535937+0000","last_became_peered":"2024-01-22T05:13:37.535937+0000","last_unstale":"2024-01-22T05:13:37.999700+0000","last_undegraded":"2024-01-22T05:13:37.999700+0000","last_fullsized":"2024-01-22T05:13:37.999700+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034145+0000","last_change":"2024-01-22T05:13:38.028603+0000","last_active":"2024-01-22T05:13:38.034145+0000","last_peered":"2024-01-22T05:13:38.034145+0000","last_clean":"2024-01-22T05:13:38.034145+0000","last_became_active":"2024-01-22T05:13:38.027554+0000","last_became_peered":"2024-01-22T05:13:38.027554+0000","last_unstale":"2024-01-22T05:13:38.034145+0000","last_undegraded":"2024-01-22T05:13:38.034145+0000","last_fullsized":"2024-01-22T05:13:38.034145+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006416+0000","last_change":"2024-01-22T05:13:37.560321+0000","last_active":"2024-01-22T05:13:38.006416+0000","last_peered":"2024-01-22T05:13:38.006416+0000","last_clean":"2024-01-22T05:13:38.006416+0000","last_became_active":"2024-01-22T05:13:37.559873+0000","last_became_peered":"2024-01-22T05:13:37.559873+0000","last_unstale":"2024-01-22T05:13:38.006416+0000","last_undegraded":"2024-01-22T05:13:38.006416+0000","last_fullsized":"2024-01-22T05:13:38.006416+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.035267+0000","last_change":"2024-01-22T05:13:38.028642+0000","last_active":"2024-01-22T05:13:38.035267+0000","last_peered":"2024-01-22T05:13:38.035267+0000","last_clean":"2024-01-22T05:13:38.035267+0000","last_became_active":"2024-01-22T05:13:38.028072+0000","last_became_peered":"2024-01-22T05:13:38.028072+0000","last_unstale":"2024-01-22T05:13:38.035267+0000","last_undegraded":"2024-01-22T05:13:38.035267+0000","last_fullsized":"2024-01-22T05:13:38.035267+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006647+0000","last_change":"2024-01-22T05:13:37.566299+0000","last_active":"2024-01-22T05:13:38.006647+0000","last_peered":"2024-01-22T05:13:38.006647+0000","last_clean":"2024-01-22T05:13:38.006647+0000","last_became_active":"2024-01-22T05:13:37.566009+0000","last_became_peered":"2024-01-22T05:13:37.566009+0000","last_unstale":"2024-01-22T05:13:38.006647+0000","last_undegraded":"2024-01-22T05:13:38.006647+0000","last_fullsized":"2024-01-22T05:13:38.006647+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.045220+0000","last_change":"2024-01-22T05:13:38.040474+0000","last_active":"2024-01-22T05:13:38.045220+0000","last_peered":"2024-01-22T05:13:38.045220+0000","last_clean":"2024-01-22T05:13:38.045220+0000","last_became_active":"2024-01-22T05:13:38.040220+0000","last_became_peered":"2024-01-22T05:13:38.040220+0000","last_unstale":"2024-01-22T05:13:38.045220+0000","last_undegraded":"2024-01-22T05:13:38.045220+0000","last_fullsized":"2024-01-22T05:13:38.045220+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006743+0000","last_change":"2024-01-22T05:13:37.560444+0000","last_active":"2024-01-22T05:13:38.006743+0000","last_peered":"2024-01-22T05:13:38.006743+0000","last_clean":"2024-01-22T05:13:38.006743+0000","last_became_active":"2024-01-22T05:13:37.559728+0000","last_became_peered":"2024-01-22T05:13:37.559728+0000","last_unstale":"2024-01-22T05:13:38.006743+0000","last_undegraded":"2024-01-22T05:13:38.006743+0000","last_fullsized":"2024-01-22T05:13:38.006743+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034683+0000","last_change":"2024-01-22T05:13:38.015707+0000","last_active":"2024-01-22T05:13:38.034683+0000","last_peered":"2024-01-22T05:13:38.034683+0000","last_clean":"2024-01-22T05:13:38.034683+0000","last_became_active":"2024-01-22T05:13:38.015416+0000","last_became_peered":"2024-01-22T05:13:38.015416+0000","last_unstale":"2024-01-22T05:13:38.034683+0000","last_undegraded":"2024-01-22T05:13:38.034683+0000","last_fullsized":"2024-01-22T05:13:38.034683+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"116'3","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.045577+0000","last_change":"2024-01-22T05:13:37.557429+0000","last_active":"2024-01-22T05:13:38.045577+0000","last_peered":"2024-01-22T05:13:38.045577+0000","last_clean":"2024-01-22T05:13:38.045577+0000","last_became_active":"2024-01-22T05:13:37.556435+0000","last_became_peered":"2024-01-22T05:13:37.556435+0000","last_unstale":"2024-01-22T05:13:38.045577+0000","last_undegraded":"2024-01-22T05:13:38.045577+0000","last_fullsized":"2024-01-22T05:13:38.045577+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.012598+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:13:38.012598+0000","last_peered":"2024-01-22T05:13:38.012598+0000","last_clean":"2024-01-22T05:13:38.012598+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:13:38.012598+0000","last_undegraded":"2024-01-22T05:13:38.012598+0000","last_fullsized":"2024-01-22T05:13:38.012598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.028025+0000","last_change":"2024-01-22T05:13:38.025612+0000","last_active":"2024-01-22T05:13:38.028025+0000","last_peered":"2024-01-22T05:13:38.028025+0000","last_clean":"2024-01-22T05:13:38.028025+0000","last_became_active":"2024-01-22T05:13:38.025328+0000","last_became_peered":"2024-01-22T05:13:38.025328+0000","last_unstale":"2024-01-22T05:13:38.028025+0000","last_undegraded":"2024-01-22T05:13:38.028025+0000","last_fullsized":"2024-01-22T05:13:38.028025+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"116'2","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.043512+0000","last_change":"2024-01-22T05:13:37.558920+0000","last_active":"2024-01-22T05:13:38.043512+0000","last_peered":"2024-01-22T05:13:38.043512+0000","last_clean":"2024-01-22T05:13:38.043512+0000","last_became_active":"2024-01-22T05:13:37.557706+0000","last_became_peered":"2024-01-22T05:13:37.557706+0000","last_unstale":"2024-01-22T05:13:38.043512+0000","last_undegraded":"2024-01-22T05:13:38.043512+0000","last_fullsized":"2024-01-22T05:13:38.043512+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":98,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.012932+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:13:38.012932+0000","last_peered":"2024-01-22T05:13:38.012932+0000","last_clean":"2024-01-22T05:13:38.012932+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:13:38.012932+0000","last_undegraded":"2024-01-22T05:13:38.012932+0000","last_fullsized":"2024-01-22T05:13:38.012932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.025055+0000","last_change":"2024-01-22T05:13:38.013918+0000","last_active":"2024-01-22T05:13:38.025055+0000","last_peered":"2024-01-22T05:13:38.025055+0000","last_clean":"2024-01-22T05:13:38.025055+0000","last_became_active":"2024-01-22T05:13:38.013596+0000","last_became_peered":"2024-01-22T05:13:38.013596+0000","last_unstale":"2024-01-22T05:13:38.025055+0000","last_undegraded":"2024-01-22T05:13:38.025055+0000","last_fullsized":"2024-01-22T05:13:38.025055+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006969+0000","last_change":"2024-01-22T05:13:37.566166+0000","last_active":"2024-01-22T05:13:38.006969+0000","last_peered":"2024-01-22T05:13:38.006969+0000","last_clean":"2024-01-22T05:13:38.006969+0000","last_became_active":"2024-01-22T05:13:37.565878+0000","last_became_peered":"2024-01-22T05:13:37.565878+0000","last_unstale":"2024-01-22T05:13:38.006969+0000","last_undegraded":"2024-01-22T05:13:38.006969+0000","last_fullsized":"2024-01-22T05:13:38.006969+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.021878+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:13:38.021878+0000","last_peered":"2024-01-22T05:13:38.021878+0000","last_clean":"2024-01-22T05:13:38.021878+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:13:38.021878+0000","last_undegraded":"2024-01-22T05:13:38.021878+0000","last_fullsized":"2024-01-22T05:13:38.021878+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.033251+0000","last_change":"2024-01-22T05:13:38.028558+0000","last_active":"2024-01-22T05:13:38.033251+0000","last_peered":"2024-01-22T05:13:38.033251+0000","last_clean":"2024-01-22T05:13:38.033251+0000","last_became_active":"2024-01-22T05:13:38.028219+0000","last_became_peered":"2024-01-22T05:13:38.028219+0000","last_unstale":"2024-01-22T05:13:38.033251+0000","last_undegraded":"2024-01-22T05:13:38.033251+0000","last_fullsized":"2024-01-22T05:13:38.033251+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:37.999504+0000","last_change":"2024-01-22T05:13:37.557777+0000","last_active":"2024-01-22T05:13:37.999504+0000","last_peered":"2024-01-22T05:13:37.999504+0000","last_clean":"2024-01-22T05:13:37.999504+0000","last_became_active":"2024-01-22T05:13:37.557462+0000","last_became_peered":"2024-01-22T05:13:37.557462+0000","last_unstale":"2024-01-22T05:13:37.999504+0000","last_undegraded":"2024-01-22T05:13:37.999504+0000","last_fullsized":"2024-01-22T05:13:37.999504+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":98,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.011647+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:13:38.011647+0000","last_peered":"2024-01-22T05:13:38.011647+0000","last_clean":"2024-01-22T05:13:38.011647+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:13:38.011647+0000","last_undegraded":"2024-01-22T05:13:38.011647+0000","last_fullsized":"2024-01-22T05:13:38.011647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.020624+0000","last_change":"2024-01-22T05:13:38.015314+0000","last_active":"2024-01-22T05:13:38.020624+0000","last_peered":"2024-01-22T05:13:38.020624+0000","last_clean":"2024-01-22T05:13:38.020624+0000","last_became_active":"2024-01-22T05:13:38.015016+0000","last_became_peered":"2024-01-22T05:13:38.015016+0000","last_unstale":"2024-01-22T05:13:38.020624+0000","last_undegraded":"2024-01-22T05:13:38.020624+0000","last_fullsized":"2024-01-22T05:13:38.020624+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"116'4","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.045762+0000","last_change":"2024-01-22T05:13:37.564628+0000","last_active":"2024-01-22T05:13:38.045762+0000","last_peered":"2024-01-22T05:13:38.045762+0000","last_clean":"2024-01-22T05:13:38.045762+0000","last_became_active":"2024-01-22T05:13:37.564171+0000","last_became_peered":"2024-01-22T05:13:37.564171+0000","last_unstale":"2024-01-22T05:13:38.045762+0000","last_undegraded":"2024-01-22T05:13:38.045762+0000","last_fullsized":"2024-01-22T05:13:38.045762+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.000649+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:13:38.000649+0000","last_peered":"2024-01-22T05:13:38.000649+0000","last_clean":"2024-01-22T05:13:38.000649+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:13:38.000649+0000","last_undegraded":"2024-01-22T05:13:38.000649+0000","last_fullsized":"2024-01-22T05:13:38.000649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.017123+0000","last_change":"2024-01-22T05:13:38.012713+0000","last_active":"2024-01-22T05:13:38.017123+0000","last_peered":"2024-01-22T05:13:38.017123+0000","last_clean":"2024-01-22T05:13:38.017123+0000","last_became_active":"2024-01-22T05:13:38.012436+0000","last_became_peered":"2024-01-22T05:13:38.012436+0000","last_unstale":"2024-01-22T05:13:38.017123+0000","last_undegraded":"2024-01-22T05:13:38.017123+0000","last_fullsized":"2024-01-22T05:13:38.017123+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.032328+0000","last_change":"2024-01-22T05:13:37.562087+0000","last_active":"2024-01-22T05:13:38.032328+0000","last_peered":"2024-01-22T05:13:38.032328+0000","last_clean":"2024-01-22T05:13:38.032328+0000","last_became_active":"2024-01-22T05:13:37.561811+0000","last_became_peered":"2024-01-22T05:13:37.561811+0000","last_unstale":"2024-01-22T05:13:38.032328+0000","last_undegraded":"2024-01-22T05:13:38.032328+0000","last_fullsized":"2024-01-22T05:13:38.032328+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006732+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:13:38.006732+0000","last_peered":"2024-01-22T05:13:38.006732+0000","last_clean":"2024-01-22T05:13:38.006732+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:13:38.006732+0000","last_undegraded":"2024-01-22T05:13:38.006732+0000","last_fullsized":"2024-01-22T05:13:38.006732+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.036555+0000","last_change":"2024-01-22T05:13:38.035294+0000","last_active":"2024-01-22T05:13:38.036555+0000","last_peered":"2024-01-22T05:13:38.036555+0000","last_clean":"2024-01-22T05:13:38.036555+0000","last_became_active":"2024-01-22T05:13:38.035023+0000","last_became_peered":"2024-01-22T05:13:38.035023+0000","last_unstale":"2024-01-22T05:13:38.036555+0000","last_undegraded":"2024-01-22T05:13:38.036555+0000","last_fullsized":"2024-01-22T05:13:38.036555+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.010966+0000","last_change":"2024-01-22T05:13:37.559619+0000","last_active":"2024-01-22T05:13:38.010966+0000","last_peered":"2024-01-22T05:13:38.010966+0000","last_clean":"2024-01-22T05:13:38.010966+0000","last_became_active":"2024-01-22T05:13:37.559326+0000","last_became_peered":"2024-01-22T05:13:37.559326+0000","last_unstale":"2024-01-22T05:13:38.010966+0000","last_undegraded":"2024-01-22T05:13:38.010966+0000","last_fullsized":"2024-01-22T05:13:38.010966+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.019838+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:13:38.019838+0000","last_peered":"2024-01-22T05:13:38.019838+0000","last_clean":"2024-01-22T05:13:38.019838+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:13:38.019838+0000","last_undegraded":"2024-01-22T05:13:38.019838+0000","last_fullsized":"2024-01-22T05:13:38.019838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.037690+0000","last_change":"2024-01-22T05:13:38.029800+0000","last_active":"2024-01-22T05:13:38.037690+0000","last_peered":"2024-01-22T05:13:38.037690+0000","last_clean":"2024-01-22T05:13:38.037690+0000","last_became_active":"2024-01-22T05:13:38.029190+0000","last_became_peered":"2024-01-22T05:13:38.029190+0000","last_unstale":"2024-01-22T05:13:38.037690+0000","last_undegraded":"2024-01-22T05:13:38.037690+0000","last_fullsized":"2024-01-22T05:13:38.037690+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.000492+0000","last_change":"2024-01-22T05:13:37.560400+0000","last_active":"2024-01-22T05:13:38.000492+0000","last_peered":"2024-01-22T05:13:38.000492+0000","last_clean":"2024-01-22T05:13:38.000492+0000","last_became_active":"2024-01-22T05:13:37.559572+0000","last_became_peered":"2024-01-22T05:13:37.559572+0000","last_unstale":"2024-01-22T05:13:38.000492+0000","last_undegraded":"2024-01-22T05:13:38.000492+0000","last_fullsized":"2024-01-22T05:13:38.000492+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.000028+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:13:38.000028+0000","last_peered":"2024-01-22T05:13:38.000028+0000","last_clean":"2024-01-22T05:13:38.000028+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:13:38.000028+0000","last_undegraded":"2024-01-22T05:13:38.000028+0000","last_fullsized":"2024-01-22T05:13:38.000028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.019946+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:13:38.019946+0000","last_peered":"2024-01-22T05:13:38.019946+0000","last_clean":"2024-01-22T05:13:38.019946+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:13:38.019946+0000","last_undegraded":"2024-01-22T05:13:38.019946+0000","last_fullsized":"2024-01-22T05:13:38.019946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574961,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302740,"kb_used_data":1420,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069100,"statfs":{"total":96636764160,"available":96326758400,"internally_reserved":0,"allocated":1454080,"data_stored":717444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.006,"15min":1.0189999999999999},"min":{"1min":0.64700000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0720000000000001,"15min":1.0489999999999999},"min":{"1min":0.68500000000000005,"5min":0.63400000000000001,"15min":0.61899999999999999},"max":{"1min":1.371,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":1.2090000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.98299999999999998,"15min":0.98199999999999998},"min":{"1min":0.74299999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4530000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.01},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.165,"15min":1.1659999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.456,"5min":7.1840000000000002,"15min":7.1840000000000002},"last":0.97499999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.1180000000000001,"15min":1.1020000000000001},"min":{"1min":0.74399999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.962,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.147},{"interface":"front","average":{"1min":1.167,"5min":1.161,"15min":1.161},"min":{"1min":0.73999999999999999,"5min":0.73799999999999999,"15min":0.68899999999999995},"max":{"1min":1.589,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.0900000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.216,"15min":1.2210000000000001},"min":{"1min":0.90400000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.6499999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.23,"5min":1.264,"15min":1.2330000000000001},"min":{"1min":0.91400000000000003,"5min":0.78300000000000003,"15min":0.60199999999999998},"max":{"1min":1.6930000000000001,"5min":6.4589999999999996,"15min":6.4589999999999996},"last":1.159}]},{"osd":4,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0529999999999999,"15min":1.0569999999999999},"min":{"1min":0.52600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.514,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.111,"15min":1.1439999999999999},"min":{"1min":0.66500000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.7130000000000001,"5min":2.077,"15min":2.077},"last":1.1919999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1599999999999999,"15min":1.181},"min":{"1min":0.64400000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.7849999999999999,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.276,"15min":1.232},"min":{"1min":0.76700000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.0329999999999999,"5min":3.625,"15min":3.625},"last":1.0640000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.169,"15min":1.228},"min":{"1min":0.64800000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5920000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.113},{"interface":"front","average":{"1min":1.383,"5min":1.351,"15min":1.333},"min":{"1min":0.80800000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.1339999999999999,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":1.3169999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302740,"kb_used_data":1420,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069100,"statfs":{"total":96636764160,"available":96326758400,"internally_reserved":0,"allocated":1454080,"data_stored":717480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.7509999999999999,"15min":1.3069999999999999},"min":{"1min":0.52400000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.679,"5min":77.745000000000005,"15min":77.745000000000005},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.115,"15min":1.0660000000000001},"min":{"1min":0.54700000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.4990000000000001,"5min":13.555999999999999,"15min":13.555999999999999},"last":0.91800000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.2330000000000001,"15min":1.1080000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.40000000000000002},"max":{"1min":1.4239999999999999,"5min":15.499000000000001,"15min":15.499000000000001},"last":0.879},{"interface":"front","average":{"1min":1.169,"5min":1.1779999999999999,"15min":1.2070000000000001},"min":{"1min":0.80500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.6080000000000001,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":1.28}]},{"osd":2,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1459999999999999,"15min":1.1519999999999999},"min":{"1min":0.70999999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.823,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.139,"15min":1.111},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.38200000000000001},"max":{"1min":1.579,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.73899999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":2.0979999999999999,"15min":1.454},"min":{"1min":0.72199999999999998,"5min":0.69299999999999995,"15min":0.59299999999999997},"max":{"1min":1.6220000000000001,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.319,"15min":1.232},"min":{"1min":0.879,"5min":0.66600000000000004,"15min":0.374},"max":{"1min":1.552,"5min":15.468,"15min":15.468},"last":0.97699999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.0960000000000001,"15min":1.095},"min":{"1min":0.65500000000000003,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.772,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.0940000000000001,"15min":1.1180000000000001},"min":{"1min":0.748,"5min":0.56899999999999995,"15min":0.48299999999999998},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.0980000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.415,"15min":1.254},"min":{"1min":0.66100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5980000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":1.21},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.26,"15min":1.2689999999999999},"min":{"1min":0.748,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8759999999999999,"5min":3.875,"15min":3.875},"last":1.679}]},{"osd":7,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4790000000000001,"15min":1.4059999999999999},"min":{"1min":1.0289999999999999,"5min":0.72599999999999998,"15min":0.42699999999999999},"max":{"1min":1.774,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.784},{"interface":"front","average":{"1min":1.389,"5min":1.9119999999999999,"15min":1.5649999999999999},"min":{"1min":0.73099999999999998,"5min":0.60199999999999998,"15min":0.495},"max":{"1min":1.7729999999999999,"5min":63.737000000000002,"15min":63.737000000000002},"last":1.887}]}]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302740,"kb_used_data":1420,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069100,"statfs":{"total":96636764160,"available":96326758400,"internally_reserved":0,"allocated":1454080,"data_stored":717432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.044,"15min":1.004},"min":{"1min":0.67900000000000005,"5min":0.61599999999999999,"15min":0.53300000000000003},"max":{"1min":1.5640000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.0209999999999999,"15min":1.0780000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3460000000000001,"5min":1.5680000000000001,"15min":1.571},"last":1.1479999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.173,"15min":1.1970000000000001},"min":{"1min":0.93000000000000005,"5min":0.67300000000000004,"15min":0.50600000000000001},"max":{"1min":1.4610000000000001,"5min":1.6859999999999999,"15min":1.821},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.175,"15min":1.2609999999999999},"min":{"1min":0.80100000000000005,"5min":0.76000000000000001,"15min":0.50900000000000001},"max":{"1min":1.9690000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.224}]},{"osd":2,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.1319999999999999,"15min":1.143},"min":{"1min":0.78400000000000003,"5min":0.77900000000000003,"15min":0.63500000000000001},"max":{"1min":1.286,"5min":1.925,"15min":1.925},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.107,"15min":1.1279999999999999},"min":{"1min":0.82999999999999996,"5min":0.64200000000000002,"15min":0.59899999999999998},"max":{"1min":1.4059999999999999,"5min":1.859,"15min":1.859},"last":0.72599999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.115,"15min":1.165},"min":{"1min":0.85199999999999998,"5min":0.76100000000000001,"15min":0.73499999999999999},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.931},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.2090000000000001,"15min":1.2689999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":4.8819999999999997,"5min":4.8819999999999997,"15min":4.8819999999999997},"last":1.111}]},{"osd":4,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0329999999999999,"15min":1.1419999999999999},"min":{"1min":0.60099999999999998,"5min":0.51700000000000002,"15min":0.44400000000000001},"max":{"1min":1.3520000000000001,"5min":1.5780000000000001,"15min":1.7829999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.107,"15min":1.2390000000000001},"min":{"1min":0.65100000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.401,"5min":1.8300000000000001,"15min":2.0699999999999998},"last":1.4139999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1519999999999999,"15min":1.284},"min":{"1min":0.874,"5min":0.63600000000000001,"15min":0.58199999999999996},"max":{"1min":1.615,"5min":1.8129999999999999,"15min":2.2010000000000001},"last":1.306},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.208,"15min":1.2769999999999999},"min":{"1min":0.93200000000000005,"5min":0.56100000000000005,"15min":0.55900000000000005},"max":{"1min":1.7150000000000001,"5min":1.7829999999999999,"15min":1.909},"last":1.2849999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.226,"15min":1.3640000000000001},"min":{"1min":0.77300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5149999999999999,"5min":1.766,"15min":2.3359999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2549999999999999,"15min":1.4079999999999999},"min":{"1min":0.64200000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":3.1840000000000002},"last":1.397}]}]},{"osd":4,"up_from":13,"seq":55834574961,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306836,"kb_used_data":1420,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065004,"statfs":{"total":96636764160,"available":96322564096,"internally_reserved":0,"allocated":1454080,"data_stored":718302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.0980000000000001,"15min":1.1200000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.726,"5min":1.7490000000000001,"15min":2.0150000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.1399999999999999,"15min":1.1060000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.484,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.6220000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.081,"15min":1.0820000000000001},"min":{"1min":0.72499999999999998,"5min":0.64000000000000001,"15min":0.53100000000000003},"max":{"1min":1.448,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.319},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.052,"15min":1.145},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":2.194},"last":1.1359999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.52800000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5009999999999999,"5min":1.7030000000000001,"15min":5.3390000000000004},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.1379999999999999,"15min":1.226},"min":{"1min":0.77000000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.641,"5min":1.641,"15min":2.3479999999999999},"last":1.4339999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1080000000000001,"15min":1.1599999999999999},"min":{"1min":0.72699999999999998,"5min":0.59299999999999997,"15min":0.496},"max":{"1min":1.468,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1180000000000001,"15min":1.151},"min":{"1min":0.71499999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.643,"5min":1.671,"15min":5.3029999999999999},"last":1.1859999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0669999999999999,"15min":1.171},"min":{"1min":0.73099999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.589,"5min":1.6970000000000001,"15min":2.0790000000000002},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.056,"15min":1.127},"min":{"1min":0.60499999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4219999999999999,"5min":1.597,"15min":2.0030000000000001},"last":1.4690000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.089,"15min":1.163},"min":{"1min":0.63100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.573,"5min":1.6160000000000001,"15min":5.3769999999999998},"last":1.071},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.167,"15min":1.3440000000000001},"min":{"1min":0.84999999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.641,"5min":1.778,"15min":4.4409999999999998},"last":1.365}]},{"osd":7,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.246,"15min":1.327},"min":{"1min":0.97299999999999998,"5min":0.66500000000000004,"15min":0.59399999999999997},"max":{"1min":1.5840000000000001,"5min":1.833,"15min":2.2839999999999998},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.2589999999999999,"15min":1.3460000000000001},"min":{"1min":0.95499999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.72,"5min":1.72,"15min":5.2629999999999999},"last":1.3919999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310944,"kb_used_data":1432,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060896,"statfs":{"total":96636764160,"available":96318357504,"internally_reserved":0,"allocated":1466368,"data_stored":719500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.83899999999999997,"15min":0.89100000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.34200000000000003},"max":{"1min":1.379,"5min":1.8440000000000001,"15min":14.859},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.879,"15min":0.89000000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":1.4490000000000001,"5min":2.3519999999999999,"15min":5.0919999999999996},"last":0.67300000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.93999999999999995,"15min":0.88200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.39300000000000002},"max":{"1min":1.0620000000000001,"5min":6.5570000000000004,"15min":6.5570000000000004},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.96099999999999997,"15min":0.97799999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.48399999999999999},"max":{"1min":1.3779999999999999,"5min":1.9510000000000001,"15min":5.7519999999999998},"last":0.70399999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1419999999999999,"15min":1.1439999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.40600000000000003},"max":{"1min":1.575,"5min":2.391,"15min":2.391},"last":1.268},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.2150000000000001,"15min":1.1970000000000001},"min":{"1min":0.59199999999999997,"5min":0.501,"15min":0.44800000000000001},"max":{"1min":1.6020000000000001,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":1.329}]},{"osd":4,"last update":"Mon Jan 22 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.385,"15min":1.323},"min":{"1min":1.018,"5min":0.71299999999999997,"15min":0.51700000000000002},"max":{"1min":1.6579999999999999,"5min":10.858000000000001,"15min":10.858000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3759999999999999,"15min":1.3520000000000001},"min":{"1min":0.82699999999999996,"5min":0.79500000000000004,"15min":0.63600000000000001},"max":{"1min":1.6910000000000001,"5min":10.846,"15min":10.846},"last":1.155}]},{"osd":5,"last update":"Mon Jan 22 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3140000000000001,"15min":1.3029999999999999},"min":{"1min":0.86399999999999999,"5min":0.74099999999999999,"15min":0.505},"max":{"1min":1.9910000000000001,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.3620000000000001,"15min":1.3700000000000001},"min":{"1min":0.76800000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.923,"5min":12.128,"15min":14.523999999999999},"last":0.98799999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3200000000000001,"15min":1.381},"min":{"1min":0.92900000000000005,"5min":0.81699999999999995,"15min":0.56699999999999995},"max":{"1min":1.9650000000000001,"5min":2.2610000000000001,"15min":4.9809999999999999},"last":1.212},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3560000000000001,"15min":1.403},"min":{"1min":1.0629999999999999,"5min":0.78800000000000003,"15min":0.68500000000000005},"max":{"1min":1.883,"5min":1.923,"15min":5.4210000000000003},"last":1.22}]},{"osd":7,"last update":"Mon Jan 22 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.355,"15min":1.3859999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.79900000000000004},"max":{"1min":1.6499999999999999,"5min":2.472,"15min":5.7160000000000002},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4299999999999999,"15min":1.427},"min":{"1min":0.84499999999999997,"5min":0.77800000000000002,"15min":0.71299999999999997},"max":{"1min":1.79,"5min":6.4279999999999999,"15min":6.4279999999999999},"last":1.137}]}]},{"osd":2,"up_from":13,"seq":55834574961,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306832,"kb_used_data":1416,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065008,"statfs":{"total":96636764160,"available":96322568192,"internally_reserved":0,"allocated":1449984,"data_stored":717410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.79300000000000004,"15min":0.75900000000000001},"min":{"1min":0.61899999999999999,"5min":0.46100000000000002,"15min":0.38500000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.90500000000000003,"15min":0.84399999999999997},"min":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.373},"max":{"1min":1.27,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.0189999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89600000000000002,"15min":0.82499999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2729999999999999,"5min":1.534,"15min":1.534},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.96299999999999997,"15min":0.94199999999999995},"min":{"1min":0.81999999999999995,"5min":0.57499999999999996,"15min":0.41599999999999998},"max":{"1min":1.383,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.1040000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.206,"15min":1.0980000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.7569999999999999,"5min":1.79,"15min":2.0779999999999998},"last":1.151},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.272,"15min":1.1910000000000001},"min":{"1min":0.76000000000000001,"5min":0.58499999999999996,"15min":0.51100000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.9990000000000001},"last":1.7}]},{"osd":4,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.2689999999999999,"15min":1.2869999999999999},"min":{"1min":1.014,"5min":0.71299999999999997,"15min":0.59099999999999997},"max":{"1min":1.647,"5min":1.647,"15min":2.1709999999999998},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.208,"15min":1.204},"min":{"1min":0.84899999999999998,"5min":0.66400000000000003,"15min":0.63500000000000001},"max":{"1min":1.7490000000000001,"5min":1.837,"15min":1.952},"last":1.347}]},{"osd":5,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.2609999999999999,"15min":1.2030000000000001},"min":{"1min":0.90000000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6120000000000001,"5min":2.0510000000000002,"15min":2.3660000000000001},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.274,"15min":1.298},"min":{"1min":1.143,"5min":0.77000000000000002,"15min":0.67000000000000004},"max":{"1min":1.7010000000000001,"5min":1.8600000000000001,"15min":2.2210000000000001},"last":1.5609999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.28,"15min":1.2569999999999999},"min":{"1min":0.89200000000000002,"5min":0.77600000000000002,"15min":0.68400000000000005},"max":{"1min":1.766,"5min":1.8360000000000001,"15min":2.1920000000000002},"last":1.597},{"interface":"front","average":{"1min":1.431,"5min":1.3400000000000001,"15min":1.2949999999999999},"min":{"1min":0.86699999999999999,"5min":0.84399999999999997,"15min":0.83999999999999997},"max":{"1min":1.9299999999999999,"5min":2.1320000000000001,"15min":2.4449999999999998},"last":1.504}]},{"osd":7,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.3680000000000001,"15min":1.3540000000000001},"min":{"1min":1.0469999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9199999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.516,"5min":1.4550000000000001,"15min":1.4139999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.89000000000000001},"max":{"1min":1.8069999999999999,"5min":2.0329999999999999,"15min":2.5059999999999998},"last":1.7330000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306840,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065000,"statfs":{"total":96636764160,"available":96322560000,"internally_reserved":0,"allocated":1458176,"data_stored":717534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.89600000000000002,"15min":0.86199999999999999},"min":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":1.911,"5min":1.911,"15min":3.4119999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0289999999999999,"15min":1.006},"min":{"1min":0.42899999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8680000000000001,"5min":1.873,"15min":2.101},"last":0.95499999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.008,"15min":1},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0620000000000001,"15min":1.034},"min":{"1min":0.60599999999999998,"5min":0.59099999999999997,"15min":0.46899999999999997},"max":{"1min":1.671,"5min":1.71,"15min":2.008},"last":1.1739999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.046,"15min":1.016},"min":{"1min":0.66600000000000004,"5min":0.54800000000000004,"15min":0.38900000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":4.665},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.032,"15min":0.92700000000000005},"min":{"1min":0.55200000000000005,"5min":0.50600000000000001,"15min":0.41899999999999998},"max":{"1min":4.1319999999999997,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":0.84099999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.359,"15min":1.248},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.60599999999999998},"max":{"1min":2.2509999999999999,"5min":15.76,"15min":15.76},"last":1.21},{"interface":"front","average":{"1min":1.325,"5min":1.456,"15min":1.3160000000000001},"min":{"1min":0.94399999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.77,"5min":16.975000000000001,"15min":16.975000000000001},"last":1.6100000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.258,"15min":1.206},"min":{"1min":0.80900000000000005,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":4.3230000000000004,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":1.629},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3009999999999999,"15min":1.276},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.3330000000000002,"5min":2.52,"15min":2.52},"last":1.47}]},{"osd":6,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.288,"15min":1.2689999999999999},"min":{"1min":0.89900000000000002,"5min":0.83899999999999997,"15min":0.76000000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.355,"15min":1.3380000000000001},"min":{"1min":0.77400000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.5569999999999999,"5min":2.5569999999999999,"15min":2.5569999999999999},"last":1.589}]},{"osd":7,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3600000000000001,"15min":1.3700000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.77400000000000002},"max":{"1min":1.829,"5min":2.0019999999999998,"15min":4.4329999999999998},"last":1.359},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.377,"15min":1.363},"min":{"1min":1.0089999999999999,"5min":0.81999999999999995,"15min":0.77600000000000002},"max":{"1min":4.3970000000000002,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.5069999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574961,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302760,"kb_used_data":1440,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069080,"statfs":{"total":96636764160,"available":96326737920,"internally_reserved":0,"allocated":1474560,"data_stored":718790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:13:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.999,"15min":0.93200000000000005},"min":{"1min":0.53700000000000003,"5min":0.34799999999999998,"15min":0.28699999999999998},"max":{"1min":1.452,"5min":15.273,"15min":15.273},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.94799999999999995,"15min":0.95999999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.34499999999999997},"max":{"1min":1.698,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":0.74099999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:13:40 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.147,"15min":1.0880000000000001},"min":{"1min":0.70599999999999996,"5min":0.48199999999999998,"15min":0.46400000000000002},"max":{"1min":1.6459999999999999,"5min":15.473000000000001,"15min":15.473000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.0580000000000001,"15min":1.03},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.45400000000000001},"max":{"1min":1.794,"5min":1.794,"15min":1.7989999999999999},"last":0.85699999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:13:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0169999999999999,"15min":1.01},"min":{"1min":0.63500000000000001,"5min":0.40000000000000002,"15min":0.39000000000000001},"max":{"1min":1.351,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3009999999999999,"15min":1.2230000000000001},"min":{"1min":0.69199999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.2349999999999999,"5min":15.439,"15min":15.439},"last":1.393}]},{"osd":4,"last update":"Mon Jan 22 05:13:40 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.2410000000000001,"15min":1.321},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.61399999999999999},"max":{"1min":1.986,"5min":2.1280000000000001,"15min":5.1799999999999997},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.21,"15min":1.2350000000000001},"min":{"1min":0.59399999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.736,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":1.2709999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:13:40 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2509999999999999,"15min":1.321},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.645,"5min":2.891,"15min":3.548},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.335,"15min":1.3740000000000001},"min":{"1min":1.119,"5min":0.75900000000000001,"15min":0.59499999999999997},"max":{"1min":1.8009999999999999,"5min":2.823,"15min":2.823},"last":1.4590000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:13:40 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.514,"15min":1.4550000000000001},"min":{"1min":1.085,"5min":0.81399999999999995,"15min":0.59099999999999997},"max":{"1min":1.8740000000000001,"5min":15.4,"15min":15.4},"last":1.522},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.411,"15min":1.4530000000000001},"min":{"1min":0.88900000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.105,"5min":7.1349999999999998,"15min":7.1349999999999998},"last":1.2390000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:13:40 2024","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.411,"15min":1.5369999999999999},"min":{"1min":0.96599999999999997,"5min":0.91400000000000003,"15min":0.79900000000000004},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":5.29},"last":1.347},{"interface":"front","average":{"1min":1.427,"5min":1.363,"15min":1.4019999999999999},"min":{"1min":1.0369999999999999,"5min":0.81799999999999995,"15min":0.752},"max":{"1min":2.0009999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.1719999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:13:47.048 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:13:47.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.220+0000 7f77cb400700 1 Processor -- start 2024-01-22T05:13:47.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.220+0000 7f77cb400700 1 -- start start 2024-01-22T05:13:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.224+0000 7f77cb400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f77c4064c00 0x7f77c40bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.224+0000 7f77cb400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c4065620 0x7f77c40bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.224+0000 7f77cb400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c40c2700 con 0x7f77c4065240 2024-01-22T05:13:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.224+0000 7f77cb400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c40c29a0 con 0x7f77c4064c00 2024-01-22T05:13:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.224+0000 7f77cb400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40c2c80 con 0x7f77c4065620 2024-01-22T05:13:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.224+0000 7f77c3e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f77c4064c00 0x7f77c40bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.224+0000 7f77c3e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f77c4064c00 0x7f77c40bcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55618/0 (socket says 172.21.15.49:55618) 2024-01-22T05:13:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.224+0000 7f77c9e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c4065620 0x7f77c40bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.224+0000 7f77c3e00700 1 -- 172.21.15.49:0/361996082 learned_addr learned my addr 172.21.15.49:0/361996082 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.224+0000 7f77c8a00700 1 --1- 172.21.15.49:0/361996082 >> v1:172.21.15.110:6789/0 conn(0x7f77c4065240 0x7f77c40644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:49808/0 (socket says 172.21.15.49:49808) 2024-01-22T05:13:47.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.224+0000 7f77c3e00700 1 -- 172.21.15.49:0/361996082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c4065620 msgr2=0x7f77c40bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:47.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.224+0000 7f77c3e00700 1 --2- 172.21.15.49:0/361996082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c4065620 0x7f77c40bd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.224+0000 7f77c3e00700 1 -- 172.21.15.49:0/361996082 >> v1:172.21.15.110:6789/0 conn(0x7f77c4065240 legacy=0x7f77c40644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:47.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.224+0000 7f77c3e00700 1 -- 172.21.15.49:0/361996082 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c40c2f60 con 0x7f77c4064c00 2024-01-22T05:13:47.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.224+0000 7f77c3e00700 1 --2- 172.21.15.49:0/361996082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c4064c00 0x7f77c40bcc80 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f77ac006fd0 tx=0x7f77ac0090f0).ready entity=mon.0 client_cookie=1e2a190e42fe0a49 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:47.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.228+0000 7f77c3400700 1 -- 172.21.15.49:0/361996082 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac00b580 con 0x7f77c4064c00 2024-01-22T05:13:47.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.228+0000 7f77c3400700 1 -- 172.21.15.49:0/361996082 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac00b6e0 con 0x7f77c4064c00 2024-01-22T05:13:47.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.228+0000 7f77c3400700 1 -- 172.21.15.49:0/361996082 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac00ba60 con 0x7f77c4064c00 2024-01-22T05:13:47.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.228+0000 7f77cb400700 1 -- 172.21.15.49:0/361996082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c4064c00 msgr2=0x7f77c40bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:47.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.228+0000 7f77cb400700 1 --2- 172.21.15.49:0/361996082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c4064c00 0x7f77c40bcc80 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f77ac006fd0 tx=0x7f77ac0090f0).stop 2024-01-22T05:13:47.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.228+0000 7f77cb400700 1 -- 172.21.15.49:0/361996082 shutdown_connections 2024-01-22T05:13:47.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.228+0000 7f77cb400700 1 --2- 172.21.15.49:0/361996082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c4065620 0x7f77c40bd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.228+0000 7f77cb400700 1 --2- 172.21.15.49:0/361996082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c4064c00 0x7f77c40bcc80 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.228+0000 7f77cb400700 1 -- 172.21.15.49:0/361996082 >> 172.21.15.49:0/361996082 conn(0x7f77c40c87f0 msgr2=0x7f77c40c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:47.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.228+0000 7f77cb400700 1 -- 172.21.15.49:0/361996082 shutdown_connections 2024-01-22T05:13:47.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.228+0000 7f77cb400700 1 -- 172.21.15.49:0/361996082 wait complete. 2024-01-22T05:13:47.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.232+0000 7f77cb400700 1 Processor -- start 2024-01-22T05:13:47.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.232+0000 7f77cb400700 1 -- start start 2024-01-22T05:13:47.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77cb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c4064c00 0x7f77c4158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:47.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77cb400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c4065240 0x7f77c40a8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:47.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77cb400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c4065620 0x7f77c40a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77cb400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40c1f50 con 0x7f77c4064c00 2024-01-22T05:13:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77cb400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40bf7b0 con 0x7f77c4065620 2024-01-22T05:13:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77cb400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40bfa90 con 0x7f77c4065240 2024-01-22T05:13:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77c8a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c4064c00 0x7f77c4158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77c8a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c4064c00 0x7f77c4158080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55626/0 (socket says 172.21.15.49:55626) 2024-01-22T05:13:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77c8a00700 1 -- 172.21.15.49:0/3043723809 learned_addr learned my addr 172.21.15.49:0/3043723809 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77c9e00700 1 --2- 172.21.15.49:0/3043723809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c4065620 0x7f77c40a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77c3e00700 1 --2- 172.21.15.49:0/3043723809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c4065240 0x7f77c40a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77c8a00700 1 -- 172.21.15.49:0/3043723809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c4065240 msgr2=0x7f77c40a8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77c8a00700 1 --2- 172.21.15.49:0/3043723809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c4065240 0x7f77c40a8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77c8a00700 1 -- 172.21.15.49:0/3043723809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c4065620 msgr2=0x7f77c40a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77c8a00700 1 --2- 172.21.15.49:0/3043723809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c4065620 0x7f77c40a8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77c8a00700 1 -- 172.21.15.49:0/3043723809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac009370 con 0x7f77c4064c00 2024-01-22T05:13:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77c3e00700 1 --2- 172.21.15.49:0/3043723809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c4065240 0x7f77c40a8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77c8a00700 1 --2- 172.21.15.49:0/3043723809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c4064c00 0x7f77c4158080 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f77b400c4c0 tx=0x7f77b4007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77bbe00700 1 -- 172.21.15.49:0/3043723809 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b40072e0 con 0x7f77c4064c00 2024-01-22T05:13:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77bbe00700 1 -- 172.21.15.49:0/3043723809 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b4007440 con 0x7f77c4064c00 2024-01-22T05:13:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77cb400700 1 -- 172.21.15.49:0/3043723809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c40bfd70 con 0x7f77c4064c00 2024-01-22T05:13:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.236+0000 7f77bbe00700 1 -- 172.21.15.49:0/3043723809 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b40058f0 con 0x7f77c4064c00 2024-01-22T05:13:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.240+0000 7f77cb400700 1 -- 172.21.15.49:0/3043723809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c40c0330 con 0x7f77c4064c00 2024-01-22T05:13:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.240+0000 7f77cb400700 1 -- 172.21.15.49:0/3043723809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c4047060 con 0x7f77c4064c00 2024-01-22T05:13:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.240+0000 7f77bbe00700 1 -- 172.21.15.49:0/3043723809 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f77b4005ca0 con 0x7f77c4064c00 2024-01-22T05:13:47.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.244+0000 7f77bbe00700 1 --2- 172.21.15.49:0/3043723809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f779c05a540 0x7f779c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:47.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.244+0000 7f77bbe00700 1 -- 172.21.15.49:0/3043723809 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f77b4073fd0 con 0x7f77c4064c00 2024-01-22T05:13:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.244+0000 7f77c3e00700 1 --2- 172.21.15.49:0/3043723809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f779c05a540 0x7f779c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:47.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.244+0000 7f77c3e00700 1 --2- 172.21.15.49:0/3043723809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f779c05a540 0x7f779c05ca00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f77ac009fd0 tx=0x7f77ac017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:47.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.248+0000 7f77bbe00700 1 -- 172.21.15.49:0/3043723809 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f77b4047590 con 0x7f77c4064c00 2024-01-22T05:13:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.416+0000 7f77cb400700 1 -- 172.21.15.49:0/3043723809 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77c40c3240 con 0x7f779c05a540 2024-01-22T05:13:47.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.436+0000 7f77bbe00700 1 -- 172.21.15.49:0/3043723809 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359553 (secure 0 0 0) 0x7f77c40c3240 con 0x7f779c05a540 2024-01-22T05:13:47.444 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:47.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.444+0000 7f77cb400700 1 -- 172.21.15.49:0/3043723809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f779c05a540 msgr2=0x7f779c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:47.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.444+0000 7f77cb400700 1 --2- 172.21.15.49:0/3043723809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f779c05a540 0x7f779c05ca00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f77ac009fd0 tx=0x7f77ac017000).stop 2024-01-22T05:13:47.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.444+0000 7f77cb400700 1 -- 172.21.15.49:0/3043723809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c4064c00 msgr2=0x7f77c4158080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:47.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.444+0000 7f77cb400700 1 --2- 172.21.15.49:0/3043723809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c4064c00 0x7f77c4158080 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f77b400c4c0 tx=0x7f77b4007d80).stop 2024-01-22T05:13:47.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.444+0000 7f77cb400700 1 -- 172.21.15.49:0/3043723809 shutdown_connections 2024-01-22T05:13:47.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.444+0000 7f77cb400700 1 --2- 172.21.15.49:0/3043723809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f779c05a540 0x7f779c05ca00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.444+0000 7f77cb400700 1 --2- 172.21.15.49:0/3043723809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c4065620 0x7f77c40a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.444+0000 7f77cb400700 1 --2- 172.21.15.49:0/3043723809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c4065240 0x7f77c40a8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.444+0000 7f77cb400700 1 --2- 172.21.15.49:0/3043723809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77c4064c00 0x7f77c4158080 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.444+0000 7f77cb400700 1 -- 172.21.15.49:0/3043723809 >> 172.21.15.49:0/3043723809 conn(0x7f77c40c87f0 msgr2=0x7f77c40ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:47.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.444+0000 7f77cb400700 1 -- 172.21.15.49:0/3043723809 shutdown_connections 2024-01-22T05:13:47.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.444+0000 7f77cb400700 1 -- 172.21.15.49:0/3043723809 wait complete. 2024-01-22T05:13:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:13:47.470 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":389,"stamp":"2024-01-22T05:13:45.428514+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2442432,"kb_used_data":11392,"kb_used_omap":0,"kb_used_meta":2430976,"kb_avail":752532288,"statfs":{"total":773094113280,"available":770593062912,"internally_reserved":0,"allocated":11665408,"data_stored":5743892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489319424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077814386,"num_objects":-1078,"num_object_clones":0,"num_object_copies":-2156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3210,"num_write_kb":-1053285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.033643"},"pg_stats":[{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.023661+0000","last_change":"2024-01-22T05:13:38.019459+0000","last_active":"2024-01-22T05:13:38.023661+0000","last_peered":"2024-01-22T05:13:38.023661+0000","last_clean":"2024-01-22T05:13:38.023661+0000","last_became_active":"2024-01-22T05:13:38.019196+0000","last_became_peered":"2024-01-22T05:13:38.019196+0000","last_unstale":"2024-01-22T05:13:38.023661+0000","last_undegraded":"2024-01-22T05:13:38.023661+0000","last_fullsized":"2024-01-22T05:13:38.023661+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3f","version":"116'3","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.043624+0000","last_change":"2024-01-22T05:13:37.569345+0000","last_active":"2024-01-22T05:13:38.043624+0000","last_peered":"2024-01-22T05:13:38.043624+0000","last_clean":"2024-01-22T05:13:38.043624+0000","last_became_active":"2024-01-22T05:13:37.569095+0000","last_became_peered":"2024-01-22T05:13:37.569095+0000","last_unstale":"2024-01-22T05:13:38.043624+0000","last_undegraded":"2024-01-22T05:13:38.043624+0000","last_fullsized":"2024-01-22T05:13:38.043624+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.043509+0000","last_change":"2024-01-22T05:13:38.032505+0000","last_active":"2024-01-22T05:13:38.043509+0000","last_peered":"2024-01-22T05:13:38.043509+0000","last_clean":"2024-01-22T05:13:38.043509+0000","last_became_active":"2024-01-22T05:13:38.031468+0000","last_became_peered":"2024-01-22T05:13:38.031468+0000","last_unstale":"2024-01-22T05:13:38.043509+0000","last_undegraded":"2024-01-22T05:13:38.043509+0000","last_fullsized":"2024-01-22T05:13:38.043509+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.013490+0000","last_change":"2024-01-22T05:13:37.553258+0000","last_active":"2024-01-22T05:13:38.013490+0000","last_peered":"2024-01-22T05:13:38.013490+0000","last_clean":"2024-01-22T05:13:38.013490+0000","last_became_active":"2024-01-22T05:13:37.551419+0000","last_became_peered":"2024-01-22T05:13:37.551419+0000","last_unstale":"2024-01-22T05:13:38.013490+0000","last_undegraded":"2024-01-22T05:13:38.013490+0000","last_fullsized":"2024-01-22T05:13:38.013490+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.026477+0000","last_change":"2024-01-22T05:13:38.018376+0000","last_active":"2024-01-22T05:13:38.026477+0000","last_peered":"2024-01-22T05:13:38.026477+0000","last_clean":"2024-01-22T05:13:38.026477+0000","last_became_active":"2024-01-22T05:13:38.018109+0000","last_became_peered":"2024-01-22T05:13:38.018109+0000","last_unstale":"2024-01-22T05:13:38.026477+0000","last_undegraded":"2024-01-22T05:13:38.026477+0000","last_fullsized":"2024-01-22T05:13:38.026477+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.011470+0000","last_change":"2024-01-22T05:13:37.560576+0000","last_active":"2024-01-22T05:13:38.011470+0000","last_peered":"2024-01-22T05:13:38.011470+0000","last_clean":"2024-01-22T05:13:38.011470+0000","last_became_active":"2024-01-22T05:13:37.560307+0000","last_became_peered":"2024-01-22T05:13:37.560307+0000","last_unstale":"2024-01-22T05:13:38.011470+0000","last_undegraded":"2024-01-22T05:13:38.011470+0000","last_fullsized":"2024-01-22T05:13:38.011470+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034975+0000","last_change":"2024-01-22T05:13:38.027527+0000","last_active":"2024-01-22T05:13:38.034975+0000","last_peered":"2024-01-22T05:13:38.034975+0000","last_clean":"2024-01-22T05:13:38.034975+0000","last_became_active":"2024-01-22T05:13:38.027060+0000","last_became_peered":"2024-01-22T05:13:38.027060+0000","last_unstale":"2024-01-22T05:13:38.034975+0000","last_undegraded":"2024-01-22T05:13:38.034975+0000","last_fullsized":"2024-01-22T05:13:38.034975+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3c","version":"116'2","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034925+0000","last_change":"2024-01-22T05:13:37.543334+0000","last_active":"2024-01-22T05:13:38.034925+0000","last_peered":"2024-01-22T05:13:38.034925+0000","last_clean":"2024-01-22T05:13:38.034925+0000","last_became_active":"2024-01-22T05:13:37.543039+0000","last_became_peered":"2024-01-22T05:13:37.543039+0000","last_unstale":"2024-01-22T05:13:38.034925+0000","last_undegraded":"2024-01-22T05:13:38.034925+0000","last_fullsized":"2024-01-22T05:13:38.034925+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.024520+0000","last_change":"2024-01-22T05:13:38.016943+0000","last_active":"2024-01-22T05:13:38.024520+0000","last_peered":"2024-01-22T05:13:38.024520+0000","last_clean":"2024-01-22T05:13:38.024520+0000","last_became_active":"2024-01-22T05:13:38.016669+0000","last_became_peered":"2024-01-22T05:13:38.016669+0000","last_unstale":"2024-01-22T05:13:38.024520+0000","last_undegraded":"2024-01-22T05:13:38.024520+0000","last_fullsized":"2024-01-22T05:13:38.024520+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3b","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.024156+0000","last_change":"2024-01-22T05:13:37.557502+0000","last_active":"2024-01-22T05:13:38.024156+0000","last_peered":"2024-01-22T05:13:38.024156+0000","last_clean":"2024-01-22T05:13:38.024156+0000","last_became_active":"2024-01-22T05:13:37.557216+0000","last_became_peered":"2024-01-22T05:13:37.557216+0000","last_unstale":"2024-01-22T05:13:38.024156+0000","last_undegraded":"2024-01-22T05:13:38.024156+0000","last_fullsized":"2024-01-22T05:13:38.024156+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.028483+0000","last_change":"2024-01-22T05:13:38.024711+0000","last_active":"2024-01-22T05:13:38.028483+0000","last_peered":"2024-01-22T05:13:38.028483+0000","last_clean":"2024-01-22T05:13:38.028483+0000","last_became_active":"2024-01-22T05:13:38.023888+0000","last_became_peered":"2024-01-22T05:13:38.023888+0000","last_unstale":"2024-01-22T05:13:38.028483+0000","last_undegraded":"2024-01-22T05:13:38.028483+0000","last_fullsized":"2024-01-22T05:13:38.028483+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3a","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.026441+0000","last_change":"2024-01-22T05:13:37.557402+0000","last_active":"2024-01-22T05:13:38.026441+0000","last_peered":"2024-01-22T05:13:38.026441+0000","last_clean":"2024-01-22T05:13:38.026441+0000","last_became_active":"2024-01-22T05:13:37.557125+0000","last_became_peered":"2024-01-22T05:13:37.557125+0000","last_unstale":"2024-01-22T05:13:38.026441+0000","last_undegraded":"2024-01-22T05:13:38.026441+0000","last_fullsized":"2024-01-22T05:13:38.026441+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.035288+0000","last_change":"2024-01-22T05:13:38.028813+0000","last_active":"2024-01-22T05:13:38.035288+0000","last_peered":"2024-01-22T05:13:38.035288+0000","last_clean":"2024-01-22T05:13:38.035288+0000","last_became_active":"2024-01-22T05:13:38.028390+0000","last_became_peered":"2024-01-22T05:13:38.028390+0000","last_unstale":"2024-01-22T05:13:38.035288+0000","last_undegraded":"2024-01-22T05:13:38.035288+0000","last_fullsized":"2024-01-22T05:13:38.035288+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.012158+0000","last_change":"2024-01-22T05:13:37.550353+0000","last_active":"2024-01-22T05:13:38.012158+0000","last_peered":"2024-01-22T05:13:38.012158+0000","last_clean":"2024-01-22T05:13:38.012158+0000","last_became_active":"2024-01-22T05:13:37.550085+0000","last_became_peered":"2024-01-22T05:13:37.550085+0000","last_unstale":"2024-01-22T05:13:38.012158+0000","last_undegraded":"2024-01-22T05:13:38.012158+0000","last_fullsized":"2024-01-22T05:13:38.012158+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.023904+0000","last_change":"2024-01-22T05:13:38.017453+0000","last_active":"2024-01-22T05:13:38.023904+0000","last_peered":"2024-01-22T05:13:38.023904+0000","last_clean":"2024-01-22T05:13:38.023904+0000","last_became_active":"2024-01-22T05:13:38.017170+0000","last_became_peered":"2024-01-22T05:13:38.017170+0000","last_unstale":"2024-01-22T05:13:38.023904+0000","last_undegraded":"2024-01-22T05:13:38.023904+0000","last_fullsized":"2024-01-22T05:13:38.023904+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.005727+0000","last_change":"2024-01-22T05:13:37.565191+0000","last_active":"2024-01-22T05:13:38.005727+0000","last_peered":"2024-01-22T05:13:38.005727+0000","last_clean":"2024-01-22T05:13:38.005727+0000","last_became_active":"2024-01-22T05:13:37.564903+0000","last_became_peered":"2024-01-22T05:13:37.564903+0000","last_unstale":"2024-01-22T05:13:38.005727+0000","last_undegraded":"2024-01-22T05:13:38.005727+0000","last_fullsized":"2024-01-22T05:13:38.005727+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.044073+0000","last_change":"2024-01-22T05:13:38.035320+0000","last_active":"2024-01-22T05:13:38.044073+0000","last_peered":"2024-01-22T05:13:38.044073+0000","last_clean":"2024-01-22T05:13:38.044073+0000","last_became_active":"2024-01-22T05:13:38.034977+0000","last_became_peered":"2024-01-22T05:13:38.034977+0000","last_unstale":"2024-01-22T05:13:38.044073+0000","last_undegraded":"2024-01-22T05:13:38.044073+0000","last_fullsized":"2024-01-22T05:13:38.044073+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.012569+0000","last_change":"2024-01-22T05:13:37.553658+0000","last_active":"2024-01-22T05:13:38.012569+0000","last_peered":"2024-01-22T05:13:38.012569+0000","last_clean":"2024-01-22T05:13:38.012569+0000","last_became_active":"2024-01-22T05:13:37.553353+0000","last_became_peered":"2024-01-22T05:13:37.553353+0000","last_unstale":"2024-01-22T05:13:38.012569+0000","last_undegraded":"2024-01-22T05:13:38.012569+0000","last_fullsized":"2024-01-22T05:13:38.012569+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034572+0000","last_change":"2024-01-22T05:13:38.025758+0000","last_active":"2024-01-22T05:13:38.034572+0000","last_peered":"2024-01-22T05:13:38.034572+0000","last_clean":"2024-01-22T05:13:38.034572+0000","last_became_active":"2024-01-22T05:13:38.022843+0000","last_became_peered":"2024-01-22T05:13:38.022843+0000","last_unstale":"2024-01-22T05:13:38.034572+0000","last_undegraded":"2024-01-22T05:13:38.034572+0000","last_fullsized":"2024-01-22T05:13:38.034572+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.012859+0000","last_change":"2024-01-22T05:13:37.559713+0000","last_active":"2024-01-22T05:13:38.012859+0000","last_peered":"2024-01-22T05:13:38.012859+0000","last_clean":"2024-01-22T05:13:38.012859+0000","last_became_active":"2024-01-22T05:13:37.559421+0000","last_became_peered":"2024-01-22T05:13:37.559421+0000","last_unstale":"2024-01-22T05:13:38.012859+0000","last_undegraded":"2024-01-22T05:13:38.012859+0000","last_fullsized":"2024-01-22T05:13:38.012859+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.026456+0000","last_change":"2024-01-22T05:13:38.017798+0000","last_active":"2024-01-22T05:13:38.026456+0000","last_peered":"2024-01-22T05:13:38.026456+0000","last_clean":"2024-01-22T05:13:38.026456+0000","last_became_active":"2024-01-22T05:13:38.017489+0000","last_became_peered":"2024-01-22T05:13:38.017489+0000","last_unstale":"2024-01-22T05:13:38.026456+0000","last_undegraded":"2024-01-22T05:13:38.026456+0000","last_fullsized":"2024-01-22T05:13:38.026456+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:37.999093+0000","last_change":"2024-01-22T05:13:37.547775+0000","last_active":"2024-01-22T05:13:37.999093+0000","last_peered":"2024-01-22T05:13:37.999093+0000","last_clean":"2024-01-22T05:13:37.999093+0000","last_became_active":"2024-01-22T05:13:37.547486+0000","last_became_peered":"2024-01-22T05:13:37.547486+0000","last_unstale":"2024-01-22T05:13:37.999093+0000","last_undegraded":"2024-01-22T05:13:37.999093+0000","last_fullsized":"2024-01-22T05:13:37.999093+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.018852+0000","last_change":"2024-01-22T05:13:38.016335+0000","last_active":"2024-01-22T05:13:38.018852+0000","last_peered":"2024-01-22T05:13:38.018852+0000","last_clean":"2024-01-22T05:13:38.018852+0000","last_became_active":"2024-01-22T05:13:38.014968+0000","last_became_peered":"2024-01-22T05:13:38.014968+0000","last_unstale":"2024-01-22T05:13:38.018852+0000","last_undegraded":"2024-01-22T05:13:38.018852+0000","last_fullsized":"2024-01-22T05:13:38.018852+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"116'4","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.038428+0000","last_change":"2024-01-22T05:13:37.535933+0000","last_active":"2024-01-22T05:13:38.038428+0000","last_peered":"2024-01-22T05:13:38.038428+0000","last_clean":"2024-01-22T05:13:38.038428+0000","last_became_active":"2024-01-22T05:13:37.535622+0000","last_became_peered":"2024-01-22T05:13:37.535622+0000","last_unstale":"2024-01-22T05:13:38.038428+0000","last_undegraded":"2024-01-22T05:13:38.038428+0000","last_fullsized":"2024-01-22T05:13:38.038428+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034523+0000","last_change":"2024-01-22T05:13:38.027622+0000","last_active":"2024-01-22T05:13:38.034523+0000","last_peered":"2024-01-22T05:13:38.034523+0000","last_clean":"2024-01-22T05:13:38.034523+0000","last_became_active":"2024-01-22T05:13:38.027000+0000","last_became_peered":"2024-01-22T05:13:38.027000+0000","last_unstale":"2024-01-22T05:13:38.034523+0000","last_undegraded":"2024-01-22T05:13:38.034523+0000","last_fullsized":"2024-01-22T05:13:38.034523+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.33","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.033085+0000","last_change":"2024-01-22T05:13:37.538432+0000","last_active":"2024-01-22T05:13:38.033085+0000","last_peered":"2024-01-22T05:13:38.033085+0000","last_clean":"2024-01-22T05:13:38.033085+0000","last_became_active":"2024-01-22T05:13:37.538133+0000","last_became_peered":"2024-01-22T05:13:37.538133+0000","last_unstale":"2024-01-22T05:13:38.033085+0000","last_undegraded":"2024-01-22T05:13:38.033085+0000","last_fullsized":"2024-01-22T05:13:38.033085+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.036264+0000","last_change":"2024-01-22T05:13:38.034766+0000","last_active":"2024-01-22T05:13:38.036264+0000","last_peered":"2024-01-22T05:13:38.036264+0000","last_clean":"2024-01-22T05:13:38.036264+0000","last_became_active":"2024-01-22T05:13:38.034324+0000","last_became_peered":"2024-01-22T05:13:38.034324+0000","last_unstale":"2024-01-22T05:13:38.036264+0000","last_undegraded":"2024-01-22T05:13:38.036264+0000","last_fullsized":"2024-01-22T05:13:38.036264+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.019347+0000","last_change":"2024-01-22T05:13:37.564688+0000","last_active":"2024-01-22T05:13:38.019347+0000","last_peered":"2024-01-22T05:13:38.019347+0000","last_clean":"2024-01-22T05:13:38.019347+0000","last_became_active":"2024-01-22T05:13:37.564370+0000","last_became_peered":"2024-01-22T05:13:37.564370+0000","last_unstale":"2024-01-22T05:13:38.019347+0000","last_undegraded":"2024-01-22T05:13:38.019347+0000","last_fullsized":"2024-01-22T05:13:38.019347+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.043503+0000","last_change":"2024-01-22T05:13:38.034440+0000","last_active":"2024-01-22T05:13:38.043503+0000","last_peered":"2024-01-22T05:13:38.043503+0000","last_clean":"2024-01-22T05:13:38.043503+0000","last_became_active":"2024-01-22T05:13:38.034151+0000","last_became_peered":"2024-01-22T05:13:38.034151+0000","last_unstale":"2024-01-22T05:13:38.043503+0000","last_undegraded":"2024-01-22T05:13:38.043503+0000","last_fullsized":"2024-01-22T05:13:38.043503+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.021062+0000","last_change":"2024-01-22T05:13:37.554466+0000","last_active":"2024-01-22T05:13:38.021062+0000","last_peered":"2024-01-22T05:13:38.021062+0000","last_clean":"2024-01-22T05:13:38.021062+0000","last_became_active":"2024-01-22T05:13:37.554168+0000","last_became_peered":"2024-01-22T05:13:37.554168+0000","last_unstale":"2024-01-22T05:13:38.021062+0000","last_undegraded":"2024-01-22T05:13:38.021062+0000","last_fullsized":"2024-01-22T05:13:38.021062+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.021724+0000","last_change":"2024-01-22T05:13:38.017473+0000","last_active":"2024-01-22T05:13:38.021724+0000","last_peered":"2024-01-22T05:13:38.021724+0000","last_clean":"2024-01-22T05:13:38.021724+0000","last_became_active":"2024-01-22T05:13:38.017131+0000","last_became_peered":"2024-01-22T05:13:38.017131+0000","last_unstale":"2024-01-22T05:13:38.021724+0000","last_undegraded":"2024-01-22T05:13:38.021724+0000","last_fullsized":"2024-01-22T05:13:38.021724+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.30","version":"116'4","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.039651+0000","last_change":"2024-01-22T05:13:37.563803+0000","last_active":"2024-01-22T05:13:38.039651+0000","last_peered":"2024-01-22T05:13:38.039651+0000","last_clean":"2024-01-22T05:13:38.039651+0000","last_became_active":"2024-01-22T05:13:37.563515+0000","last_became_peered":"2024-01-22T05:13:37.563515+0000","last_unstale":"2024-01-22T05:13:38.039651+0000","last_undegraded":"2024-01-22T05:13:38.039651+0000","last_fullsized":"2024-01-22T05:13:38.039651+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.021289+0000","last_change":"2024-01-22T05:13:38.015521+0000","last_active":"2024-01-22T05:13:38.021289+0000","last_peered":"2024-01-22T05:13:38.021289+0000","last_clean":"2024-01-22T05:13:38.021289+0000","last_became_active":"2024-01-22T05:13:38.015117+0000","last_became_peered":"2024-01-22T05:13:38.015117+0000","last_unstale":"2024-01-22T05:13:38.021289+0000","last_undegraded":"2024-01-22T05:13:38.021289+0000","last_fullsized":"2024-01-22T05:13:38.021289+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.011398+0000","last_change":"2024-01-22T05:13:37.559552+0000","last_active":"2024-01-22T05:13:38.011398+0000","last_peered":"2024-01-22T05:13:38.011398+0000","last_clean":"2024-01-22T05:13:38.011398+0000","last_became_active":"2024-01-22T05:13:37.559248+0000","last_became_peered":"2024-01-22T05:13:37.559248+0000","last_unstale":"2024-01-22T05:13:38.011398+0000","last_undegraded":"2024-01-22T05:13:38.011398+0000","last_fullsized":"2024-01-22T05:13:38.011398+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.025702+0000","last_change":"2024-01-22T05:13:38.021201+0000","last_active":"2024-01-22T05:13:38.025702+0000","last_peered":"2024-01-22T05:13:38.025702+0000","last_clean":"2024-01-22T05:13:38.025702+0000","last_became_active":"2024-01-22T05:13:38.020885+0000","last_became_peered":"2024-01-22T05:13:38.020885+0000","last_unstale":"2024-01-22T05:13:38.025702+0000","last_undegraded":"2024-01-22T05:13:38.025702+0000","last_fullsized":"2024-01-22T05:13:38.025702+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.013604+0000","last_change":"2024-01-22T05:13:37.554937+0000","last_active":"2024-01-22T05:13:38.013604+0000","last_peered":"2024-01-22T05:13:38.013604+0000","last_clean":"2024-01-22T05:13:38.013604+0000","last_became_active":"2024-01-22T05:13:37.554583+0000","last_became_peered":"2024-01-22T05:13:37.554583+0000","last_unstale":"2024-01-22T05:13:38.013604+0000","last_undegraded":"2024-01-22T05:13:38.013604+0000","last_fullsized":"2024-01-22T05:13:38.013604+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.035035+0000","last_change":"2024-01-22T05:13:38.028985+0000","last_active":"2024-01-22T05:13:38.035035+0000","last_peered":"2024-01-22T05:13:38.035035+0000","last_clean":"2024-01-22T05:13:38.035035+0000","last_became_active":"2024-01-22T05:13:38.027144+0000","last_became_peered":"2024-01-22T05:13:38.027144+0000","last_unstale":"2024-01-22T05:13:38.035035+0000","last_undegraded":"2024-01-22T05:13:38.035035+0000","last_fullsized":"2024-01-22T05:13:38.035035+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2d","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.044783+0000","last_change":"2024-01-22T05:13:37.558570+0000","last_active":"2024-01-22T05:13:38.044783+0000","last_peered":"2024-01-22T05:13:38.044783+0000","last_clean":"2024-01-22T05:13:38.044783+0000","last_became_active":"2024-01-22T05:13:37.558107+0000","last_became_peered":"2024-01-22T05:13:37.558107+0000","last_unstale":"2024-01-22T05:13:38.044783+0000","last_undegraded":"2024-01-22T05:13:38.044783+0000","last_fullsized":"2024-01-22T05:13:38.044783+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.036236+0000","last_change":"2024-01-22T05:13:38.034729+0000","last_active":"2024-01-22T05:13:38.036236+0000","last_peered":"2024-01-22T05:13:38.036236+0000","last_clean":"2024-01-22T05:13:38.036236+0000","last_became_active":"2024-01-22T05:13:38.034366+0000","last_became_peered":"2024-01-22T05:13:38.034366+0000","last_unstale":"2024-01-22T05:13:38.036236+0000","last_undegraded":"2024-01-22T05:13:38.036236+0000","last_fullsized":"2024-01-22T05:13:38.036236+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.007436+0000","last_change":"2024-01-22T05:13:37.544820+0000","last_active":"2024-01-22T05:13:38.007436+0000","last_peered":"2024-01-22T05:13:38.007436+0000","last_clean":"2024-01-22T05:13:38.007436+0000","last_became_active":"2024-01-22T05:13:37.544312+0000","last_became_peered":"2024-01-22T05:13:37.544312+0000","last_unstale":"2024-01-22T05:13:38.007436+0000","last_undegraded":"2024-01-22T05:13:38.007436+0000","last_fullsized":"2024-01-22T05:13:38.007436+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.032727+0000","last_change":"2024-01-22T05:13:38.027428+0000","last_active":"2024-01-22T05:13:38.032727+0000","last_peered":"2024-01-22T05:13:38.032727+0000","last_clean":"2024-01-22T05:13:38.032727+0000","last_became_active":"2024-01-22T05:13:38.027156+0000","last_became_peered":"2024-01-22T05:13:38.027156+0000","last_unstale":"2024-01-22T05:13:38.032727+0000","last_undegraded":"2024-01-22T05:13:38.032727+0000","last_fullsized":"2024-01-22T05:13:38.032727+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2b","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.037039+0000","last_change":"2024-01-22T05:13:37.555752+0000","last_active":"2024-01-22T05:13:38.037039+0000","last_peered":"2024-01-22T05:13:38.037039+0000","last_clean":"2024-01-22T05:13:38.037039+0000","last_became_active":"2024-01-22T05:13:37.554142+0000","last_became_peered":"2024-01-22T05:13:37.554142+0000","last_unstale":"2024-01-22T05:13:38.037039+0000","last_undegraded":"2024-01-22T05:13:38.037039+0000","last_fullsized":"2024-01-22T05:13:38.037039+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.018441+0000","last_change":"2024-01-22T05:13:38.014620+0000","last_active":"2024-01-22T05:13:38.018441+0000","last_peered":"2024-01-22T05:13:38.018441+0000","last_clean":"2024-01-22T05:13:38.018441+0000","last_became_active":"2024-01-22T05:13:38.014324+0000","last_became_peered":"2024-01-22T05:13:38.014324+0000","last_unstale":"2024-01-22T05:13:38.018441+0000","last_undegraded":"2024-01-22T05:13:38.018441+0000","last_fullsized":"2024-01-22T05:13:38.018441+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.010722+0000","last_change":"2024-01-22T05:13:37.560808+0000","last_active":"2024-01-22T05:13:38.010722+0000","last_peered":"2024-01-22T05:13:38.010722+0000","last_clean":"2024-01-22T05:13:38.010722+0000","last_became_active":"2024-01-22T05:13:37.558518+0000","last_became_peered":"2024-01-22T05:13:37.558518+0000","last_unstale":"2024-01-22T05:13:38.010722+0000","last_undegraded":"2024-01-22T05:13:38.010722+0000","last_fullsized":"2024-01-22T05:13:38.010722+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.037707+0000","last_change":"2024-01-22T05:13:38.029853+0000","last_active":"2024-01-22T05:13:38.037707+0000","last_peered":"2024-01-22T05:13:38.037707+0000","last_clean":"2024-01-22T05:13:38.037707+0000","last_became_active":"2024-01-22T05:13:38.029573+0000","last_became_peered":"2024-01-22T05:13:38.029573+0000","last_unstale":"2024-01-22T05:13:38.037707+0000","last_undegraded":"2024-01-22T05:13:38.037707+0000","last_fullsized":"2024-01-22T05:13:38.037707+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.007524+0000","last_change":"2024-01-22T05:13:37.560111+0000","last_active":"2024-01-22T05:13:38.007524+0000","last_peered":"2024-01-22T05:13:38.007524+0000","last_clean":"2024-01-22T05:13:38.007524+0000","last_became_active":"2024-01-22T05:13:37.559433+0000","last_became_peered":"2024-01-22T05:13:37.559433+0000","last_unstale":"2024-01-22T05:13:38.007524+0000","last_undegraded":"2024-01-22T05:13:38.007524+0000","last_fullsized":"2024-01-22T05:13:38.007524+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034034+0000","last_change":"2024-01-22T05:13:38.027434+0000","last_active":"2024-01-22T05:13:38.034034+0000","last_peered":"2024-01-22T05:13:38.034034+0000","last_clean":"2024-01-22T05:13:38.034034+0000","last_became_active":"2024-01-22T05:13:38.027084+0000","last_became_peered":"2024-01-22T05:13:38.027084+0000","last_unstale":"2024-01-22T05:13:38.034034+0000","last_undegraded":"2024-01-22T05:13:38.034034+0000","last_fullsized":"2024-01-22T05:13:38.034034+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.007908+0000","last_change":"2024-01-22T05:13:37.559125+0000","last_active":"2024-01-22T05:13:38.007908+0000","last_peered":"2024-01-22T05:13:38.007908+0000","last_clean":"2024-01-22T05:13:38.007908+0000","last_became_active":"2024-01-22T05:13:37.558292+0000","last_became_peered":"2024-01-22T05:13:37.558292+0000","last_unstale":"2024-01-22T05:13:38.007908+0000","last_undegraded":"2024-01-22T05:13:38.007908+0000","last_fullsized":"2024-01-22T05:13:38.007908+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.027975+0000","last_change":"2024-01-22T05:13:38.017206+0000","last_active":"2024-01-22T05:13:38.027975+0000","last_peered":"2024-01-22T05:13:38.027975+0000","last_clean":"2024-01-22T05:13:38.027975+0000","last_became_active":"2024-01-22T05:13:38.016939+0000","last_became_peered":"2024-01-22T05:13:38.016939+0000","last_unstale":"2024-01-22T05:13:38.027975+0000","last_undegraded":"2024-01-22T05:13:38.027975+0000","last_fullsized":"2024-01-22T05:13:38.027975+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.007938+0000","last_change":"2024-01-22T05:13:37.538721+0000","last_active":"2024-01-22T05:13:38.007938+0000","last_peered":"2024-01-22T05:13:38.007938+0000","last_clean":"2024-01-22T05:13:38.007938+0000","last_became_active":"2024-01-22T05:13:37.538445+0000","last_became_peered":"2024-01-22T05:13:37.538445+0000","last_unstale":"2024-01-22T05:13:38.007938+0000","last_undegraded":"2024-01-22T05:13:38.007938+0000","last_fullsized":"2024-01-22T05:13:38.007938+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.018145+0000","last_change":"2024-01-22T05:13:38.015761+0000","last_active":"2024-01-22T05:13:38.018145+0000","last_peered":"2024-01-22T05:13:38.018145+0000","last_clean":"2024-01-22T05:13:38.018145+0000","last_became_active":"2024-01-22T05:13:38.015064+0000","last_became_peered":"2024-01-22T05:13:38.015064+0000","last_unstale":"2024-01-22T05:13:38.018145+0000","last_undegraded":"2024-01-22T05:13:38.018145+0000","last_fullsized":"2024-01-22T05:13:38.018145+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.007343+0000","last_change":"2024-01-22T05:13:37.550094+0000","last_active":"2024-01-22T05:13:38.007343+0000","last_peered":"2024-01-22T05:13:38.007343+0000","last_clean":"2024-01-22T05:13:38.007343+0000","last_became_active":"2024-01-22T05:13:37.549835+0000","last_became_peered":"2024-01-22T05:13:37.549835+0000","last_unstale":"2024-01-22T05:13:38.007343+0000","last_undegraded":"2024-01-22T05:13:38.007343+0000","last_fullsized":"2024-01-22T05:13:38.007343+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.041098+0000","last_change":"2024-01-22T05:13:38.038250+0000","last_active":"2024-01-22T05:13:38.041098+0000","last_peered":"2024-01-22T05:13:38.041098+0000","last_clean":"2024-01-22T05:13:38.041098+0000","last_became_active":"2024-01-22T05:13:38.037695+0000","last_became_peered":"2024-01-22T05:13:38.037695+0000","last_unstale":"2024-01-22T05:13:38.041098+0000","last_undegraded":"2024-01-22T05:13:38.041098+0000","last_fullsized":"2024-01-22T05:13:38.041098+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:37.999239+0000","last_change":"2024-01-22T05:13:37.545092+0000","last_active":"2024-01-22T05:13:37.999239+0000","last_peered":"2024-01-22T05:13:37.999239+0000","last_clean":"2024-01-22T05:13:37.999239+0000","last_became_active":"2024-01-22T05:13:37.544811+0000","last_became_peered":"2024-01-22T05:13:37.544811+0000","last_unstale":"2024-01-22T05:13:37.999239+0000","last_undegraded":"2024-01-22T05:13:37.999239+0000","last_fullsized":"2024-01-22T05:13:37.999239+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.042874+0000","last_change":"2024-01-22T05:13:38.038149+0000","last_active":"2024-01-22T05:13:38.042874+0000","last_peered":"2024-01-22T05:13:38.042874+0000","last_clean":"2024-01-22T05:13:38.042874+0000","last_became_active":"2024-01-22T05:13:38.037895+0000","last_became_peered":"2024-01-22T05:13:38.037895+0000","last_unstale":"2024-01-22T05:13:38.042874+0000","last_undegraded":"2024-01-22T05:13:38.042874+0000","last_fullsized":"2024-01-22T05:13:38.042874+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.011084+0000","last_change":"2024-01-22T05:13:37.542968+0000","last_active":"2024-01-22T05:13:38.011084+0000","last_peered":"2024-01-22T05:13:38.011084+0000","last_clean":"2024-01-22T05:13:38.011084+0000","last_became_active":"2024-01-22T05:13:37.542654+0000","last_became_peered":"2024-01-22T05:13:37.542654+0000","last_unstale":"2024-01-22T05:13:38.011084+0000","last_undegraded":"2024-01-22T05:13:38.011084+0000","last_fullsized":"2024-01-22T05:13:38.011084+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.024822+0000","last_change":"2024-01-22T05:13:38.011857+0000","last_active":"2024-01-22T05:13:38.024822+0000","last_peered":"2024-01-22T05:13:38.024822+0000","last_clean":"2024-01-22T05:13:38.024822+0000","last_became_active":"2024-01-22T05:13:38.011453+0000","last_became_peered":"2024-01-22T05:13:38.011453+0000","last_unstale":"2024-01-22T05:13:38.024822+0000","last_undegraded":"2024-01-22T05:13:38.024822+0000","last_fullsized":"2024-01-22T05:13:38.024822+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.008603+0000","last_change":"2024-01-22T05:13:37.558512+0000","last_active":"2024-01-22T05:13:38.008603+0000","last_peered":"2024-01-22T05:13:38.008603+0000","last_clean":"2024-01-22T05:13:38.008603+0000","last_became_active":"2024-01-22T05:13:37.558207+0000","last_became_peered":"2024-01-22T05:13:37.558207+0000","last_unstale":"2024-01-22T05:13:38.008603+0000","last_undegraded":"2024-01-22T05:13:38.008603+0000","last_fullsized":"2024-01-22T05:13:38.008603+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034168+0000","last_change":"2024-01-22T05:13:38.030664+0000","last_active":"2024-01-22T05:13:38.034168+0000","last_peered":"2024-01-22T05:13:38.034168+0000","last_clean":"2024-01-22T05:13:38.034168+0000","last_became_active":"2024-01-22T05:13:38.030394+0000","last_became_peered":"2024-01-22T05:13:38.030394+0000","last_unstale":"2024-01-22T05:13:38.034168+0000","last_undegraded":"2024-01-22T05:13:38.034168+0000","last_fullsized":"2024-01-22T05:13:38.034168+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006289+0000","last_change":"2024-01-22T05:13:37.537581+0000","last_active":"2024-01-22T05:13:38.006289+0000","last_peered":"2024-01-22T05:13:38.006289+0000","last_clean":"2024-01-22T05:13:38.006289+0000","last_became_active":"2024-01-22T05:13:37.537298+0000","last_became_peered":"2024-01-22T05:13:37.537298+0000","last_unstale":"2024-01-22T05:13:38.006289+0000","last_undegraded":"2024-01-22T05:13:38.006289+0000","last_fullsized":"2024-01-22T05:13:38.006289+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.025583+0000","last_change":"2024-01-22T05:13:38.017716+0000","last_active":"2024-01-22T05:13:38.025583+0000","last_peered":"2024-01-22T05:13:38.025583+0000","last_clean":"2024-01-22T05:13:38.025583+0000","last_became_active":"2024-01-22T05:13:38.017454+0000","last_became_peered":"2024-01-22T05:13:38.017454+0000","last_unstale":"2024-01-22T05:13:38.025583+0000","last_undegraded":"2024-01-22T05:13:38.025583+0000","last_fullsized":"2024-01-22T05:13:38.025583+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.014637+0000","last_change":"2024-01-22T05:13:37.559151+0000","last_active":"2024-01-22T05:13:38.014637+0000","last_peered":"2024-01-22T05:13:38.014637+0000","last_clean":"2024-01-22T05:13:38.014637+0000","last_became_active":"2024-01-22T05:13:37.558877+0000","last_became_peered":"2024-01-22T05:13:37.558877+0000","last_unstale":"2024-01-22T05:13:38.014637+0000","last_undegraded":"2024-01-22T05:13:38.014637+0000","last_fullsized":"2024-01-22T05:13:38.014637+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.022669+0000","last_change":"2024-01-22T05:13:38.017696+0000","last_active":"2024-01-22T05:13:38.022669+0000","last_peered":"2024-01-22T05:13:38.022669+0000","last_clean":"2024-01-22T05:13:38.022669+0000","last_became_active":"2024-01-22T05:13:38.016625+0000","last_became_peered":"2024-01-22T05:13:38.016625+0000","last_unstale":"2024-01-22T05:13:38.022669+0000","last_undegraded":"2024-01-22T05:13:38.022669+0000","last_fullsized":"2024-01-22T05:13:38.022669+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006096+0000","last_change":"2024-01-22T05:13:37.564440+0000","last_active":"2024-01-22T05:13:38.006096+0000","last_peered":"2024-01-22T05:13:38.006096+0000","last_clean":"2024-01-22T05:13:38.006096+0000","last_became_active":"2024-01-22T05:13:37.563801+0000","last_became_peered":"2024-01-22T05:13:37.563801+0000","last_unstale":"2024-01-22T05:13:38.006096+0000","last_undegraded":"2024-01-22T05:13:38.006096+0000","last_fullsized":"2024-01-22T05:13:38.006096+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.030023+0000","last_change":"2024-01-22T05:13:38.026457+0000","last_active":"2024-01-22T05:13:38.030023+0000","last_peered":"2024-01-22T05:13:38.030023+0000","last_clean":"2024-01-22T05:13:38.030023+0000","last_became_active":"2024-01-22T05:13:38.026171+0000","last_became_peered":"2024-01-22T05:13:38.026171+0000","last_unstale":"2024-01-22T05:13:38.030023+0000","last_undegraded":"2024-01-22T05:13:38.030023+0000","last_fullsized":"2024-01-22T05:13:38.030023+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.030062+0000","last_change":"2024-01-22T05:13:37.544470+0000","last_active":"2024-01-22T05:13:38.030062+0000","last_peered":"2024-01-22T05:13:38.030062+0000","last_clean":"2024-01-22T05:13:38.030062+0000","last_became_active":"2024-01-22T05:13:37.544177+0000","last_became_peered":"2024-01-22T05:13:37.544177+0000","last_unstale":"2024-01-22T05:13:38.030062+0000","last_undegraded":"2024-01-22T05:13:38.030062+0000","last_fullsized":"2024-01-22T05:13:38.030062+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.033800+0000","last_change":"2024-01-22T05:13:38.031410+0000","last_active":"2024-01-22T05:13:38.033800+0000","last_peered":"2024-01-22T05:13:38.033800+0000","last_clean":"2024-01-22T05:13:38.033800+0000","last_became_active":"2024-01-22T05:13:38.030871+0000","last_became_peered":"2024-01-22T05:13:38.030871+0000","last_unstale":"2024-01-22T05:13:38.033800+0000","last_undegraded":"2024-01-22T05:13:38.033800+0000","last_fullsized":"2024-01-22T05:13:38.033800+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.029086+0000","last_change":"2024-01-22T05:13:37.553701+0000","last_active":"2024-01-22T05:13:38.029086+0000","last_peered":"2024-01-22T05:13:38.029086+0000","last_clean":"2024-01-22T05:13:38.029086+0000","last_became_active":"2024-01-22T05:13:37.553412+0000","last_became_peered":"2024-01-22T05:13:37.553412+0000","last_unstale":"2024-01-22T05:13:38.029086+0000","last_undegraded":"2024-01-22T05:13:38.029086+0000","last_fullsized":"2024-01-22T05:13:38.029086+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.021690+0000","last_change":"2024-01-22T05:13:38.017798+0000","last_active":"2024-01-22T05:13:38.021690+0000","last_peered":"2024-01-22T05:13:38.021690+0000","last_clean":"2024-01-22T05:13:38.021690+0000","last_became_active":"2024-01-22T05:13:38.017420+0000","last_became_peered":"2024-01-22T05:13:38.017420+0000","last_unstale":"2024-01-22T05:13:38.021690+0000","last_undegraded":"2024-01-22T05:13:38.021690+0000","last_fullsized":"2024-01-22T05:13:38.021690+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"116'2","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.025737+0000","last_change":"2024-01-22T05:13:37.557144+0000","last_active":"2024-01-22T05:13:38.025737+0000","last_peered":"2024-01-22T05:13:38.025737+0000","last_clean":"2024-01-22T05:13:38.025737+0000","last_became_active":"2024-01-22T05:13:37.556824+0000","last_became_peered":"2024-01-22T05:13:37.556824+0000","last_unstale":"2024-01-22T05:13:38.025737+0000","last_undegraded":"2024-01-22T05:13:38.025737+0000","last_fullsized":"2024-01-22T05:13:38.025737+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.036296+0000","last_change":"2024-01-22T05:13:38.035088+0000","last_active":"2024-01-22T05:13:38.036296+0000","last_peered":"2024-01-22T05:13:38.036296+0000","last_clean":"2024-01-22T05:13:38.036296+0000","last_became_active":"2024-01-22T05:13:38.034795+0000","last_became_peered":"2024-01-22T05:13:38.034795+0000","last_unstale":"2024-01-22T05:13:38.036296+0000","last_undegraded":"2024-01-22T05:13:38.036296+0000","last_fullsized":"2024-01-22T05:13:38.036296+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.007122+0000","last_change":"2024-01-22T05:13:37.571987+0000","last_active":"2024-01-22T05:13:38.007122+0000","last_peered":"2024-01-22T05:13:38.007122+0000","last_clean":"2024-01-22T05:13:38.007122+0000","last_became_active":"2024-01-22T05:13:37.571706+0000","last_became_peered":"2024-01-22T05:13:37.571706+0000","last_unstale":"2024-01-22T05:13:38.007122+0000","last_undegraded":"2024-01-22T05:13:38.007122+0000","last_fullsized":"2024-01-22T05:13:38.007122+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034467+0000","last_change":"2024-01-22T05:13:38.022355+0000","last_active":"2024-01-22T05:13:38.034467+0000","last_peered":"2024-01-22T05:13:38.034467+0000","last_clean":"2024-01-22T05:13:38.034467+0000","last_became_active":"2024-01-22T05:13:38.022020+0000","last_became_peered":"2024-01-22T05:13:38.022020+0000","last_unstale":"2024-01-22T05:13:38.034467+0000","last_undegraded":"2024-01-22T05:13:38.034467+0000","last_fullsized":"2024-01-22T05:13:38.034467+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:37.998950+0000","last_change":"2024-01-22T05:13:37.549530+0000","last_active":"2024-01-22T05:13:37.998950+0000","last_peered":"2024-01-22T05:13:37.998950+0000","last_clean":"2024-01-22T05:13:37.998950+0000","last_became_active":"2024-01-22T05:13:37.549237+0000","last_became_peered":"2024-01-22T05:13:37.549237+0000","last_unstale":"2024-01-22T05:13:37.998950+0000","last_undegraded":"2024-01-22T05:13:37.998950+0000","last_fullsized":"2024-01-22T05:13:37.998950+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.018459+0000","last_change":"2024-01-22T05:13:38.015929+0000","last_active":"2024-01-22T05:13:38.018459+0000","last_peered":"2024-01-22T05:13:38.018459+0000","last_clean":"2024-01-22T05:13:38.018459+0000","last_became_active":"2024-01-22T05:13:38.015296+0000","last_became_peered":"2024-01-22T05:13:38.015296+0000","last_unstale":"2024-01-22T05:13:38.018459+0000","last_undegraded":"2024-01-22T05:13:38.018459+0000","last_fullsized":"2024-01-22T05:13:38.018459+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.000314+0000","last_change":"2024-01-22T05:13:37.547370+0000","last_active":"2024-01-22T05:13:38.000314+0000","last_peered":"2024-01-22T05:13:38.000314+0000","last_clean":"2024-01-22T05:13:38.000314+0000","last_became_active":"2024-01-22T05:13:37.547089+0000","last_became_peered":"2024-01-22T05:13:37.547089+0000","last_unstale":"2024-01-22T05:13:38.000314+0000","last_undegraded":"2024-01-22T05:13:38.000314+0000","last_fullsized":"2024-01-22T05:13:38.000314+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.045062+0000","last_change":"2024-01-22T05:13:38.038057+0000","last_active":"2024-01-22T05:13:38.045062+0000","last_peered":"2024-01-22T05:13:38.045062+0000","last_clean":"2024-01-22T05:13:38.045062+0000","last_became_active":"2024-01-22T05:13:38.037865+0000","last_became_peered":"2024-01-22T05:13:38.037865+0000","last_unstale":"2024-01-22T05:13:38.045062+0000","last_undegraded":"2024-01-22T05:13:38.045062+0000","last_fullsized":"2024-01-22T05:13:38.045062+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.005286+0000","last_change":"2024-01-22T05:13:37.536103+0000","last_active":"2024-01-22T05:13:38.005286+0000","last_peered":"2024-01-22T05:13:38.005286+0000","last_clean":"2024-01-22T05:13:38.005286+0000","last_became_active":"2024-01-22T05:13:37.535635+0000","last_became_peered":"2024-01-22T05:13:37.535635+0000","last_unstale":"2024-01-22T05:13:38.005286+0000","last_undegraded":"2024-01-22T05:13:38.005286+0000","last_fullsized":"2024-01-22T05:13:38.005286+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.023923+0000","last_change":"2024-01-22T05:13:38.018587+0000","last_active":"2024-01-22T05:13:38.023923+0000","last_peered":"2024-01-22T05:13:38.023923+0000","last_clean":"2024-01-22T05:13:38.023923+0000","last_became_active":"2024-01-22T05:13:38.018220+0000","last_became_peered":"2024-01-22T05:13:38.018220+0000","last_unstale":"2024-01-22T05:13:38.023923+0000","last_undegraded":"2024-01-22T05:13:38.023923+0000","last_fullsized":"2024-01-22T05:13:38.023923+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006534+0000","last_change":"2024-01-22T05:13:37.571206+0000","last_active":"2024-01-22T05:13:38.006534+0000","last_peered":"2024-01-22T05:13:38.006534+0000","last_clean":"2024-01-22T05:13:38.006534+0000","last_became_active":"2024-01-22T05:13:37.570007+0000","last_became_peered":"2024-01-22T05:13:37.570007+0000","last_unstale":"2024-01-22T05:13:38.006534+0000","last_undegraded":"2024-01-22T05:13:38.006534+0000","last_fullsized":"2024-01-22T05:13:38.006534+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.037372+0000","last_change":"2024-01-22T05:13:38.032582+0000","last_active":"2024-01-22T05:13:38.037372+0000","last_peered":"2024-01-22T05:13:38.037372+0000","last_clean":"2024-01-22T05:13:38.037372+0000","last_became_active":"2024-01-22T05:13:38.032306+0000","last_became_peered":"2024-01-22T05:13:38.032306+0000","last_unstale":"2024-01-22T05:13:38.037372+0000","last_undegraded":"2024-01-22T05:13:38.037372+0000","last_fullsized":"2024-01-22T05:13:38.037372+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.043700+0000","last_change":"2024-01-22T05:13:37.561017+0000","last_active":"2024-01-22T05:13:38.043700+0000","last_peered":"2024-01-22T05:13:38.043700+0000","last_clean":"2024-01-22T05:13:38.043700+0000","last_became_active":"2024-01-22T05:13:37.559625+0000","last_became_peered":"2024-01-22T05:13:37.559625+0000","last_unstale":"2024-01-22T05:13:38.043700+0000","last_undegraded":"2024-01-22T05:13:38.043700+0000","last_fullsized":"2024-01-22T05:13:38.043700+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.044755+0000","last_change":"2024-01-22T05:13:38.037569+0000","last_active":"2024-01-22T05:13:38.044755+0000","last_peered":"2024-01-22T05:13:38.044755+0000","last_clean":"2024-01-22T05:13:38.044755+0000","last_became_active":"2024-01-22T05:13:38.035381+0000","last_became_peered":"2024-01-22T05:13:38.035381+0000","last_unstale":"2024-01-22T05:13:38.044755+0000","last_undegraded":"2024-01-22T05:13:38.044755+0000","last_fullsized":"2024-01-22T05:13:38.044755+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"116'2","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.028307+0000","last_change":"2024-01-22T05:13:37.548445+0000","last_active":"2024-01-22T05:13:38.028307+0000","last_peered":"2024-01-22T05:13:38.028307+0000","last_clean":"2024-01-22T05:13:38.028307+0000","last_became_active":"2024-01-22T05:13:37.548015+0000","last_became_peered":"2024-01-22T05:13:37.548015+0000","last_unstale":"2024-01-22T05:13:38.028307+0000","last_undegraded":"2024-01-22T05:13:38.028307+0000","last_fullsized":"2024-01-22T05:13:38.028307+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.040966+0000","last_change":"2024-01-22T05:13:38.040227+0000","last_active":"2024-01-22T05:13:38.040966+0000","last_peered":"2024-01-22T05:13:38.040966+0000","last_clean":"2024-01-22T05:13:38.040966+0000","last_became_active":"2024-01-22T05:13:38.039934+0000","last_became_peered":"2024-01-22T05:13:38.039934+0000","last_unstale":"2024-01-22T05:13:38.040966+0000","last_undegraded":"2024-01-22T05:13:38.040966+0000","last_fullsized":"2024-01-22T05:13:38.040966+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.013110+0000","last_change":"2024-01-22T05:13:37.543326+0000","last_active":"2024-01-22T05:13:38.013110+0000","last_peered":"2024-01-22T05:13:38.013110+0000","last_clean":"2024-01-22T05:13:38.013110+0000","last_became_active":"2024-01-22T05:13:37.543045+0000","last_became_peered":"2024-01-22T05:13:37.543045+0000","last_unstale":"2024-01-22T05:13:38.013110+0000","last_undegraded":"2024-01-22T05:13:38.013110+0000","last_fullsized":"2024-01-22T05:13:38.013110+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.035223+0000","last_change":"2024-01-22T05:13:38.029559+0000","last_active":"2024-01-22T05:13:38.035223+0000","last_peered":"2024-01-22T05:13:38.035223+0000","last_clean":"2024-01-22T05:13:38.035223+0000","last_became_active":"2024-01-22T05:13:38.029246+0000","last_became_peered":"2024-01-22T05:13:38.029246+0000","last_unstale":"2024-01-22T05:13:38.035223+0000","last_undegraded":"2024-01-22T05:13:38.035223+0000","last_fullsized":"2024-01-22T05:13:38.035223+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:37.999249+0000","last_change":"2024-01-22T05:13:37.553977+0000","last_active":"2024-01-22T05:13:37.999249+0000","last_peered":"2024-01-22T05:13:37.999249+0000","last_clean":"2024-01-22T05:13:37.999249+0000","last_became_active":"2024-01-22T05:13:37.553693+0000","last_became_peered":"2024-01-22T05:13:37.553693+0000","last_unstale":"2024-01-22T05:13:37.999249+0000","last_undegraded":"2024-01-22T05:13:37.999249+0000","last_fullsized":"2024-01-22T05:13:37.999249+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034547+0000","last_change":"2024-01-22T05:13:38.027805+0000","last_active":"2024-01-22T05:13:38.034547+0000","last_peered":"2024-01-22T05:13:38.034547+0000","last_clean":"2024-01-22T05:13:38.034547+0000","last_became_active":"2024-01-22T05:13:38.027332+0000","last_became_peered":"2024-01-22T05:13:38.027332+0000","last_unstale":"2024-01-22T05:13:38.034547+0000","last_undegraded":"2024-01-22T05:13:38.034547+0000","last_fullsized":"2024-01-22T05:13:38.034547+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.030937+0000","last_change":"2024-01-22T05:13:37.570225+0000","last_active":"2024-01-22T05:13:38.030937+0000","last_peered":"2024-01-22T05:13:38.030937+0000","last_clean":"2024-01-22T05:13:38.030937+0000","last_became_active":"2024-01-22T05:13:37.569857+0000","last_became_peered":"2024-01-22T05:13:37.569857+0000","last_unstale":"2024-01-22T05:13:38.030937+0000","last_undegraded":"2024-01-22T05:13:38.030937+0000","last_fullsized":"2024-01-22T05:13:38.030937+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.043753+0000","last_change":"2024-01-22T05:13:38.034744+0000","last_active":"2024-01-22T05:13:38.043753+0000","last_peered":"2024-01-22T05:13:38.043753+0000","last_clean":"2024-01-22T05:13:38.043753+0000","last_became_active":"2024-01-22T05:13:38.034471+0000","last_became_peered":"2024-01-22T05:13:38.034471+0000","last_unstale":"2024-01-22T05:13:38.043753+0000","last_undegraded":"2024-01-22T05:13:38.043753+0000","last_fullsized":"2024-01-22T05:13:38.043753+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006851+0000","last_change":"2024-01-22T05:13:37.571997+0000","last_active":"2024-01-22T05:13:38.006851+0000","last_peered":"2024-01-22T05:13:38.006851+0000","last_clean":"2024-01-22T05:13:38.006851+0000","last_became_active":"2024-01-22T05:13:37.571663+0000","last_became_peered":"2024-01-22T05:13:37.571663+0000","last_unstale":"2024-01-22T05:13:38.006851+0000","last_undegraded":"2024-01-22T05:13:38.006851+0000","last_fullsized":"2024-01-22T05:13:38.006851+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.035415+0000","last_change":"2024-01-22T05:13:38.033942+0000","last_active":"2024-01-22T05:13:38.035415+0000","last_peered":"2024-01-22T05:13:38.035415+0000","last_clean":"2024-01-22T05:13:38.035415+0000","last_became_active":"2024-01-22T05:13:38.033670+0000","last_became_peered":"2024-01-22T05:13:38.033670+0000","last_unstale":"2024-01-22T05:13:38.035415+0000","last_undegraded":"2024-01-22T05:13:38.035415+0000","last_fullsized":"2024-01-22T05:13:38.035415+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.009856+0000","last_change":"2024-01-22T05:13:37.569597+0000","last_active":"2024-01-22T05:13:38.009856+0000","last_peered":"2024-01-22T05:13:38.009856+0000","last_clean":"2024-01-22T05:13:38.009856+0000","last_became_active":"2024-01-22T05:13:37.569082+0000","last_became_peered":"2024-01-22T05:13:37.569082+0000","last_unstale":"2024-01-22T05:13:38.009856+0000","last_undegraded":"2024-01-22T05:13:38.009856+0000","last_fullsized":"2024-01-22T05:13:38.009856+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.028877+0000","last_change":"2024-01-22T05:13:38.025849+0000","last_active":"2024-01-22T05:13:38.028877+0000","last_peered":"2024-01-22T05:13:38.028877+0000","last_clean":"2024-01-22T05:13:38.028877+0000","last_became_active":"2024-01-22T05:13:38.025592+0000","last_became_peered":"2024-01-22T05:13:38.025592+0000","last_unstale":"2024-01-22T05:13:38.028877+0000","last_undegraded":"2024-01-22T05:13:38.028877+0000","last_fullsized":"2024-01-22T05:13:38.028877+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006641+0000","last_change":"2024-01-22T05:13:37.559125+0000","last_active":"2024-01-22T05:13:38.006641+0000","last_peered":"2024-01-22T05:13:38.006641+0000","last_clean":"2024-01-22T05:13:38.006641+0000","last_became_active":"2024-01-22T05:13:37.558625+0000","last_became_peered":"2024-01-22T05:13:37.558625+0000","last_unstale":"2024-01-22T05:13:38.006641+0000","last_undegraded":"2024-01-22T05:13:38.006641+0000","last_fullsized":"2024-01-22T05:13:38.006641+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.032266+0000","last_change":"2024-01-22T05:13:38.028367+0000","last_active":"2024-01-22T05:13:38.032266+0000","last_peered":"2024-01-22T05:13:38.032266+0000","last_clean":"2024-01-22T05:13:38.032266+0000","last_became_active":"2024-01-22T05:13:38.028038+0000","last_became_peered":"2024-01-22T05:13:38.028038+0000","last_unstale":"2024-01-22T05:13:38.032266+0000","last_undegraded":"2024-01-22T05:13:38.032266+0000","last_fullsized":"2024-01-22T05:13:38.032266+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"116'2","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.044204+0000","last_change":"2024-01-22T05:13:37.551795+0000","last_active":"2024-01-22T05:13:38.044204+0000","last_peered":"2024-01-22T05:13:38.044204+0000","last_clean":"2024-01-22T05:13:38.044204+0000","last_became_active":"2024-01-22T05:13:37.551500+0000","last_became_peered":"2024-01-22T05:13:37.551500+0000","last_unstale":"2024-01-22T05:13:38.044204+0000","last_undegraded":"2024-01-22T05:13:38.044204+0000","last_fullsized":"2024-01-22T05:13:38.044204+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034554+0000","last_change":"2024-01-22T05:13:38.023159+0000","last_active":"2024-01-22T05:13:38.034554+0000","last_peered":"2024-01-22T05:13:38.034554+0000","last_clean":"2024-01-22T05:13:38.034554+0000","last_became_active":"2024-01-22T05:13:38.022561+0000","last_became_peered":"2024-01-22T05:13:38.022561+0000","last_unstale":"2024-01-22T05:13:38.034554+0000","last_undegraded":"2024-01-22T05:13:38.034554+0000","last_fullsized":"2024-01-22T05:13:38.034554+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.013701+0000","last_change":"2024-01-22T05:13:37.548804+0000","last_active":"2024-01-22T05:13:38.013701+0000","last_peered":"2024-01-22T05:13:38.013701+0000","last_clean":"2024-01-22T05:13:38.013701+0000","last_became_active":"2024-01-22T05:13:37.548518+0000","last_became_peered":"2024-01-22T05:13:37.548518+0000","last_unstale":"2024-01-22T05:13:38.013701+0000","last_undegraded":"2024-01-22T05:13:38.013701+0000","last_fullsized":"2024-01-22T05:13:38.013701+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.045405+0000","last_change":"2024-01-22T05:13:38.039581+0000","last_active":"2024-01-22T05:13:38.045405+0000","last_peered":"2024-01-22T05:13:38.045405+0000","last_clean":"2024-01-22T05:13:38.045405+0000","last_became_active":"2024-01-22T05:13:38.039294+0000","last_became_peered":"2024-01-22T05:13:38.039294+0000","last_unstale":"2024-01-22T05:13:38.045405+0000","last_undegraded":"2024-01-22T05:13:38.045405+0000","last_fullsized":"2024-01-22T05:13:38.045405+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.012027+0000","last_change":"2024-01-22T05:13:37.558383+0000","last_active":"2024-01-22T05:13:38.012027+0000","last_peered":"2024-01-22T05:13:38.012027+0000","last_clean":"2024-01-22T05:13:38.012027+0000","last_became_active":"2024-01-22T05:13:37.557715+0000","last_became_peered":"2024-01-22T05:13:37.557715+0000","last_unstale":"2024-01-22T05:13:38.012027+0000","last_undegraded":"2024-01-22T05:13:38.012027+0000","last_fullsized":"2024-01-22T05:13:38.012027+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.032492+0000","last_change":"2024-01-22T05:13:38.028376+0000","last_active":"2024-01-22T05:13:38.032492+0000","last_peered":"2024-01-22T05:13:38.032492+0000","last_clean":"2024-01-22T05:13:38.032492+0000","last_became_active":"2024-01-22T05:13:38.028016+0000","last_became_peered":"2024-01-22T05:13:38.028016+0000","last_unstale":"2024-01-22T05:13:38.032492+0000","last_undegraded":"2024-01-22T05:13:38.032492+0000","last_fullsized":"2024-01-22T05:13:38.032492+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.001333+0000","last_change":"2024-01-22T05:13:37.560002+0000","last_active":"2024-01-22T05:13:38.001333+0000","last_peered":"2024-01-22T05:13:38.001333+0000","last_clean":"2024-01-22T05:13:38.001333+0000","last_became_active":"2024-01-22T05:13:37.559723+0000","last_became_peered":"2024-01-22T05:13:37.559723+0000","last_unstale":"2024-01-22T05:13:38.001333+0000","last_undegraded":"2024-01-22T05:13:38.001333+0000","last_fullsized":"2024-01-22T05:13:38.001333+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.012109+0000","last_change":"2024-01-22T05:13:38.007706+0000","last_active":"2024-01-22T05:13:38.012109+0000","last_peered":"2024-01-22T05:13:38.012109+0000","last_clean":"2024-01-22T05:13:38.012109+0000","last_became_active":"2024-01-22T05:13:38.007369+0000","last_became_peered":"2024-01-22T05:13:38.007369+0000","last_unstale":"2024-01-22T05:13:38.012109+0000","last_undegraded":"2024-01-22T05:13:38.012109+0000","last_fullsized":"2024-01-22T05:13:38.012109+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:37.999700+0000","last_change":"2024-01-22T05:13:37.536198+0000","last_active":"2024-01-22T05:13:37.999700+0000","last_peered":"2024-01-22T05:13:37.999700+0000","last_clean":"2024-01-22T05:13:37.999700+0000","last_became_active":"2024-01-22T05:13:37.535937+0000","last_became_peered":"2024-01-22T05:13:37.535937+0000","last_unstale":"2024-01-22T05:13:37.999700+0000","last_undegraded":"2024-01-22T05:13:37.999700+0000","last_fullsized":"2024-01-22T05:13:37.999700+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034145+0000","last_change":"2024-01-22T05:13:38.028603+0000","last_active":"2024-01-22T05:13:38.034145+0000","last_peered":"2024-01-22T05:13:38.034145+0000","last_clean":"2024-01-22T05:13:38.034145+0000","last_became_active":"2024-01-22T05:13:38.027554+0000","last_became_peered":"2024-01-22T05:13:38.027554+0000","last_unstale":"2024-01-22T05:13:38.034145+0000","last_undegraded":"2024-01-22T05:13:38.034145+0000","last_fullsized":"2024-01-22T05:13:38.034145+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006416+0000","last_change":"2024-01-22T05:13:37.560321+0000","last_active":"2024-01-22T05:13:38.006416+0000","last_peered":"2024-01-22T05:13:38.006416+0000","last_clean":"2024-01-22T05:13:38.006416+0000","last_became_active":"2024-01-22T05:13:37.559873+0000","last_became_peered":"2024-01-22T05:13:37.559873+0000","last_unstale":"2024-01-22T05:13:38.006416+0000","last_undegraded":"2024-01-22T05:13:38.006416+0000","last_fullsized":"2024-01-22T05:13:38.006416+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.035267+0000","last_change":"2024-01-22T05:13:38.028642+0000","last_active":"2024-01-22T05:13:38.035267+0000","last_peered":"2024-01-22T05:13:38.035267+0000","last_clean":"2024-01-22T05:13:38.035267+0000","last_became_active":"2024-01-22T05:13:38.028072+0000","last_became_peered":"2024-01-22T05:13:38.028072+0000","last_unstale":"2024-01-22T05:13:38.035267+0000","last_undegraded":"2024-01-22T05:13:38.035267+0000","last_fullsized":"2024-01-22T05:13:38.035267+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006647+0000","last_change":"2024-01-22T05:13:37.566299+0000","last_active":"2024-01-22T05:13:38.006647+0000","last_peered":"2024-01-22T05:13:38.006647+0000","last_clean":"2024-01-22T05:13:38.006647+0000","last_became_active":"2024-01-22T05:13:37.566009+0000","last_became_peered":"2024-01-22T05:13:37.566009+0000","last_unstale":"2024-01-22T05:13:38.006647+0000","last_undegraded":"2024-01-22T05:13:38.006647+0000","last_fullsized":"2024-01-22T05:13:38.006647+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.045220+0000","last_change":"2024-01-22T05:13:38.040474+0000","last_active":"2024-01-22T05:13:38.045220+0000","last_peered":"2024-01-22T05:13:38.045220+0000","last_clean":"2024-01-22T05:13:38.045220+0000","last_became_active":"2024-01-22T05:13:38.040220+0000","last_became_peered":"2024-01-22T05:13:38.040220+0000","last_unstale":"2024-01-22T05:13:38.045220+0000","last_undegraded":"2024-01-22T05:13:38.045220+0000","last_fullsized":"2024-01-22T05:13:38.045220+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006743+0000","last_change":"2024-01-22T05:13:37.560444+0000","last_active":"2024-01-22T05:13:38.006743+0000","last_peered":"2024-01-22T05:13:38.006743+0000","last_clean":"2024-01-22T05:13:38.006743+0000","last_became_active":"2024-01-22T05:13:37.559728+0000","last_became_peered":"2024-01-22T05:13:37.559728+0000","last_unstale":"2024-01-22T05:13:38.006743+0000","last_undegraded":"2024-01-22T05:13:38.006743+0000","last_fullsized":"2024-01-22T05:13:38.006743+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.034683+0000","last_change":"2024-01-22T05:13:38.015707+0000","last_active":"2024-01-22T05:13:38.034683+0000","last_peered":"2024-01-22T05:13:38.034683+0000","last_clean":"2024-01-22T05:13:38.034683+0000","last_became_active":"2024-01-22T05:13:38.015416+0000","last_became_peered":"2024-01-22T05:13:38.015416+0000","last_unstale":"2024-01-22T05:13:38.034683+0000","last_undegraded":"2024-01-22T05:13:38.034683+0000","last_fullsized":"2024-01-22T05:13:38.034683+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"116'3","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.045577+0000","last_change":"2024-01-22T05:13:37.557429+0000","last_active":"2024-01-22T05:13:38.045577+0000","last_peered":"2024-01-22T05:13:38.045577+0000","last_clean":"2024-01-22T05:13:38.045577+0000","last_became_active":"2024-01-22T05:13:37.556435+0000","last_became_peered":"2024-01-22T05:13:37.556435+0000","last_unstale":"2024-01-22T05:13:38.045577+0000","last_undegraded":"2024-01-22T05:13:38.045577+0000","last_fullsized":"2024-01-22T05:13:38.045577+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.012598+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:13:38.012598+0000","last_peered":"2024-01-22T05:13:38.012598+0000","last_clean":"2024-01-22T05:13:38.012598+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:13:38.012598+0000","last_undegraded":"2024-01-22T05:13:38.012598+0000","last_fullsized":"2024-01-22T05:13:38.012598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.028025+0000","last_change":"2024-01-22T05:13:38.025612+0000","last_active":"2024-01-22T05:13:38.028025+0000","last_peered":"2024-01-22T05:13:38.028025+0000","last_clean":"2024-01-22T05:13:38.028025+0000","last_became_active":"2024-01-22T05:13:38.025328+0000","last_became_peered":"2024-01-22T05:13:38.025328+0000","last_unstale":"2024-01-22T05:13:38.028025+0000","last_undegraded":"2024-01-22T05:13:38.028025+0000","last_fullsized":"2024-01-22T05:13:38.028025+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"116'2","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.043512+0000","last_change":"2024-01-22T05:13:37.558920+0000","last_active":"2024-01-22T05:13:38.043512+0000","last_peered":"2024-01-22T05:13:38.043512+0000","last_clean":"2024-01-22T05:13:38.043512+0000","last_became_active":"2024-01-22T05:13:37.557706+0000","last_became_peered":"2024-01-22T05:13:37.557706+0000","last_unstale":"2024-01-22T05:13:38.043512+0000","last_undegraded":"2024-01-22T05:13:38.043512+0000","last_fullsized":"2024-01-22T05:13:38.043512+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":98,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.012932+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:13:38.012932+0000","last_peered":"2024-01-22T05:13:38.012932+0000","last_clean":"2024-01-22T05:13:38.012932+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:13:38.012932+0000","last_undegraded":"2024-01-22T05:13:38.012932+0000","last_fullsized":"2024-01-22T05:13:38.012932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.025055+0000","last_change":"2024-01-22T05:13:38.013918+0000","last_active":"2024-01-22T05:13:38.025055+0000","last_peered":"2024-01-22T05:13:38.025055+0000","last_clean":"2024-01-22T05:13:38.025055+0000","last_became_active":"2024-01-22T05:13:38.013596+0000","last_became_peered":"2024-01-22T05:13:38.013596+0000","last_unstale":"2024-01-22T05:13:38.025055+0000","last_undegraded":"2024-01-22T05:13:38.025055+0000","last_fullsized":"2024-01-22T05:13:38.025055+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006969+0000","last_change":"2024-01-22T05:13:37.566166+0000","last_active":"2024-01-22T05:13:38.006969+0000","last_peered":"2024-01-22T05:13:38.006969+0000","last_clean":"2024-01-22T05:13:38.006969+0000","last_became_active":"2024-01-22T05:13:37.565878+0000","last_became_peered":"2024-01-22T05:13:37.565878+0000","last_unstale":"2024-01-22T05:13:38.006969+0000","last_undegraded":"2024-01-22T05:13:38.006969+0000","last_fullsized":"2024-01-22T05:13:38.006969+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.021878+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:13:38.021878+0000","last_peered":"2024-01-22T05:13:38.021878+0000","last_clean":"2024-01-22T05:13:38.021878+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:13:38.021878+0000","last_undegraded":"2024-01-22T05:13:38.021878+0000","last_fullsized":"2024-01-22T05:13:38.021878+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.033251+0000","last_change":"2024-01-22T05:13:38.028558+0000","last_active":"2024-01-22T05:13:38.033251+0000","last_peered":"2024-01-22T05:13:38.033251+0000","last_clean":"2024-01-22T05:13:38.033251+0000","last_became_active":"2024-01-22T05:13:38.028219+0000","last_became_peered":"2024-01-22T05:13:38.028219+0000","last_unstale":"2024-01-22T05:13:38.033251+0000","last_undegraded":"2024-01-22T05:13:38.033251+0000","last_fullsized":"2024-01-22T05:13:38.033251+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:37.999504+0000","last_change":"2024-01-22T05:13:37.557777+0000","last_active":"2024-01-22T05:13:37.999504+0000","last_peered":"2024-01-22T05:13:37.999504+0000","last_clean":"2024-01-22T05:13:37.999504+0000","last_became_active":"2024-01-22T05:13:37.557462+0000","last_became_peered":"2024-01-22T05:13:37.557462+0000","last_unstale":"2024-01-22T05:13:37.999504+0000","last_undegraded":"2024-01-22T05:13:37.999504+0000","last_fullsized":"2024-01-22T05:13:37.999504+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":98,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.011647+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:13:38.011647+0000","last_peered":"2024-01-22T05:13:38.011647+0000","last_clean":"2024-01-22T05:13:38.011647+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:13:38.011647+0000","last_undegraded":"2024-01-22T05:13:38.011647+0000","last_fullsized":"2024-01-22T05:13:38.011647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.020624+0000","last_change":"2024-01-22T05:13:38.015314+0000","last_active":"2024-01-22T05:13:38.020624+0000","last_peered":"2024-01-22T05:13:38.020624+0000","last_clean":"2024-01-22T05:13:38.020624+0000","last_became_active":"2024-01-22T05:13:38.015016+0000","last_became_peered":"2024-01-22T05:13:38.015016+0000","last_unstale":"2024-01-22T05:13:38.020624+0000","last_undegraded":"2024-01-22T05:13:38.020624+0000","last_fullsized":"2024-01-22T05:13:38.020624+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"116'4","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.045762+0000","last_change":"2024-01-22T05:13:37.564628+0000","last_active":"2024-01-22T05:13:38.045762+0000","last_peered":"2024-01-22T05:13:38.045762+0000","last_clean":"2024-01-22T05:13:38.045762+0000","last_became_active":"2024-01-22T05:13:37.564171+0000","last_became_peered":"2024-01-22T05:13:37.564171+0000","last_unstale":"2024-01-22T05:13:38.045762+0000","last_undegraded":"2024-01-22T05:13:38.045762+0000","last_fullsized":"2024-01-22T05:13:38.045762+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.000649+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:13:38.000649+0000","last_peered":"2024-01-22T05:13:38.000649+0000","last_clean":"2024-01-22T05:13:38.000649+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:13:38.000649+0000","last_undegraded":"2024-01-22T05:13:38.000649+0000","last_fullsized":"2024-01-22T05:13:38.000649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.017123+0000","last_change":"2024-01-22T05:13:38.012713+0000","last_active":"2024-01-22T05:13:38.017123+0000","last_peered":"2024-01-22T05:13:38.017123+0000","last_clean":"2024-01-22T05:13:38.017123+0000","last_became_active":"2024-01-22T05:13:38.012436+0000","last_became_peered":"2024-01-22T05:13:38.012436+0000","last_unstale":"2024-01-22T05:13:38.017123+0000","last_undegraded":"2024-01-22T05:13:38.017123+0000","last_fullsized":"2024-01-22T05:13:38.017123+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"116'1","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.032328+0000","last_change":"2024-01-22T05:13:37.562087+0000","last_active":"2024-01-22T05:13:38.032328+0000","last_peered":"2024-01-22T05:13:38.032328+0000","last_clean":"2024-01-22T05:13:38.032328+0000","last_became_active":"2024-01-22T05:13:37.561811+0000","last_became_peered":"2024-01-22T05:13:37.561811+0000","last_unstale":"2024-01-22T05:13:38.032328+0000","last_undegraded":"2024-01-22T05:13:38.032328+0000","last_fullsized":"2024-01-22T05:13:38.032328+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.006732+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:13:38.006732+0000","last_peered":"2024-01-22T05:13:38.006732+0000","last_clean":"2024-01-22T05:13:38.006732+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:13:38.006732+0000","last_undegraded":"2024-01-22T05:13:38.006732+0000","last_fullsized":"2024-01-22T05:13:38.006732+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.036555+0000","last_change":"2024-01-22T05:13:38.035294+0000","last_active":"2024-01-22T05:13:38.036555+0000","last_peered":"2024-01-22T05:13:38.036555+0000","last_clean":"2024-01-22T05:13:38.036555+0000","last_became_active":"2024-01-22T05:13:38.035023+0000","last_became_peered":"2024-01-22T05:13:38.035023+0000","last_unstale":"2024-01-22T05:13:38.036555+0000","last_undegraded":"2024-01-22T05:13:38.036555+0000","last_fullsized":"2024-01-22T05:13:38.036555+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.010966+0000","last_change":"2024-01-22T05:13:37.559619+0000","last_active":"2024-01-22T05:13:38.010966+0000","last_peered":"2024-01-22T05:13:38.010966+0000","last_clean":"2024-01-22T05:13:38.010966+0000","last_became_active":"2024-01-22T05:13:37.559326+0000","last_became_peered":"2024-01-22T05:13:37.559326+0000","last_unstale":"2024-01-22T05:13:38.010966+0000","last_undegraded":"2024-01-22T05:13:38.010966+0000","last_fullsized":"2024-01-22T05:13:38.010966+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.019838+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:13:38.019838+0000","last_peered":"2024-01-22T05:13:38.019838+0000","last_clean":"2024-01-22T05:13:38.019838+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:13:38.019838+0000","last_undegraded":"2024-01-22T05:13:38.019838+0000","last_fullsized":"2024-01-22T05:13:38.019838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.037690+0000","last_change":"2024-01-22T05:13:38.029800+0000","last_active":"2024-01-22T05:13:38.037690+0000","last_peered":"2024-01-22T05:13:38.037690+0000","last_clean":"2024-01-22T05:13:38.037690+0000","last_became_active":"2024-01-22T05:13:38.029190+0000","last_became_peered":"2024-01-22T05:13:38.029190+0000","last_unstale":"2024-01-22T05:13:38.037690+0000","last_undegraded":"2024-01-22T05:13:38.037690+0000","last_fullsized":"2024-01-22T05:13:38.037690+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:37.509399+0000","last_clean_scrub_stamp":"2024-01-22T05:13:37.509399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.000492+0000","last_change":"2024-01-22T05:13:37.560400+0000","last_active":"2024-01-22T05:13:38.000492+0000","last_peered":"2024-01-22T05:13:38.000492+0000","last_clean":"2024-01-22T05:13:38.000492+0000","last_became_active":"2024-01-22T05:13:37.559572+0000","last_became_peered":"2024-01-22T05:13:37.559572+0000","last_unstale":"2024-01-22T05:13:38.000492+0000","last_undegraded":"2024-01-22T05:13:38.000492+0000","last_fullsized":"2024-01-22T05:13:38.000492+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:13:36.496933+0000","last_clean_scrub_stamp":"2024-01-22T05:13:36.496933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.000028+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:13:38.000028+0000","last_peered":"2024-01-22T05:13:38.000028+0000","last_clean":"2024-01-22T05:13:38.000028+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:13:38.000028+0000","last_undegraded":"2024-01-22T05:13:38.000028+0000","last_fullsized":"2024-01-22T05:13:38.000028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":92,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-01-22T05:13:38.019946+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:13:38.019946+0000","last_peered":"2024-01-22T05:13:38.019946+0000","last_clean":"2024-01-22T05:13:38.019946+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:13:38.019946+0000","last_undegraded":"2024-01-22T05:13:38.019946+0000","last_fullsized":"2024-01-22T05:13:38.019946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574961,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302740,"kb_used_data":1420,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069100,"statfs":{"total":96636764160,"available":96326758400,"internally_reserved":0,"allocated":1454080,"data_stored":717444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.006,"15min":1.0189999999999999},"min":{"1min":0.64700000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0720000000000001,"15min":1.0489999999999999},"min":{"1min":0.68500000000000005,"5min":0.63400000000000001,"15min":0.61899999999999999},"max":{"1min":1.371,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":1.2090000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.98299999999999998,"15min":0.98199999999999998},"min":{"1min":0.74299999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4530000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.01},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.165,"15min":1.1659999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.456,"5min":7.1840000000000002,"15min":7.1840000000000002},"last":0.97499999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.1180000000000001,"15min":1.1020000000000001},"min":{"1min":0.74399999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.962,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.147},{"interface":"front","average":{"1min":1.167,"5min":1.161,"15min":1.161},"min":{"1min":0.73999999999999999,"5min":0.73799999999999999,"15min":0.68899999999999995},"max":{"1min":1.589,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.0900000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.216,"15min":1.2210000000000001},"min":{"1min":0.90400000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.6499999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.23,"5min":1.264,"15min":1.2330000000000001},"min":{"1min":0.91400000000000003,"5min":0.78300000000000003,"15min":0.60199999999999998},"max":{"1min":1.6930000000000001,"5min":6.4589999999999996,"15min":6.4589999999999996},"last":1.159}]},{"osd":4,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0529999999999999,"15min":1.0569999999999999},"min":{"1min":0.52600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.514,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.111,"15min":1.1439999999999999},"min":{"1min":0.66500000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.7130000000000001,"5min":2.077,"15min":2.077},"last":1.1919999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1599999999999999,"15min":1.181},"min":{"1min":0.64400000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.7849999999999999,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.276,"15min":1.232},"min":{"1min":0.76700000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.0329999999999999,"5min":3.625,"15min":3.625},"last":1.0640000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:12:47 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.169,"15min":1.228},"min":{"1min":0.64800000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5920000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.113},{"interface":"front","average":{"1min":1.383,"5min":1.351,"15min":1.333},"min":{"1min":0.80800000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.1339999999999999,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":1.3169999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302740,"kb_used_data":1420,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069100,"statfs":{"total":96636764160,"available":96326758400,"internally_reserved":0,"allocated":1454080,"data_stored":717480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.7509999999999999,"15min":1.3069999999999999},"min":{"1min":0.52400000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.679,"5min":77.745000000000005,"15min":77.745000000000005},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.115,"15min":1.0660000000000001},"min":{"1min":0.54700000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.4990000000000001,"5min":13.555999999999999,"15min":13.555999999999999},"last":0.91800000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.2330000000000001,"15min":1.1080000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.40000000000000002},"max":{"1min":1.4239999999999999,"5min":15.499000000000001,"15min":15.499000000000001},"last":0.879},{"interface":"front","average":{"1min":1.169,"5min":1.1779999999999999,"15min":1.2070000000000001},"min":{"1min":0.80500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.6080000000000001,"5min":7.7629999999999999,"15min":7.7629999999999999},"last":1.28}]},{"osd":2,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1459999999999999,"15min":1.1519999999999999},"min":{"1min":0.70999999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.823,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.139,"15min":1.111},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.38200000000000001},"max":{"1min":1.579,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.73899999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":2.0979999999999999,"15min":1.454},"min":{"1min":0.72199999999999998,"5min":0.69299999999999995,"15min":0.59299999999999997},"max":{"1min":1.6220000000000001,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.319,"15min":1.232},"min":{"1min":0.879,"5min":0.66600000000000004,"15min":0.374},"max":{"1min":1.552,"5min":15.468,"15min":15.468},"last":0.97699999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.0960000000000001,"15min":1.095},"min":{"1min":0.65500000000000003,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.772,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.0940000000000001,"15min":1.1180000000000001},"min":{"1min":0.748,"5min":0.56899999999999995,"15min":0.48299999999999998},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.0980000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.415,"15min":1.254},"min":{"1min":0.66100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5980000000000001,"5min":30.533000000000001,"15min":30.533000000000001},"last":1.21},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.26,"15min":1.2689999999999999},"min":{"1min":0.748,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8759999999999999,"5min":3.875,"15min":3.875},"last":1.679}]},{"osd":7,"last update":"Mon Jan 22 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4790000000000001,"15min":1.4059999999999999},"min":{"1min":1.0289999999999999,"5min":0.72599999999999998,"15min":0.42699999999999999},"max":{"1min":1.774,"5min":23.547999999999998,"15min":23.547999999999998},"last":1.784},{"interface":"front","average":{"1min":1.389,"5min":1.9119999999999999,"15min":1.5649999999999999},"min":{"1min":0.73099999999999998,"5min":0.60199999999999998,"15min":0.495},"max":{"1min":1.7729999999999999,"5min":63.737000000000002,"15min":63.737000000000002},"last":1.887}]}]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302740,"kb_used_data":1420,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069100,"statfs":{"total":96636764160,"available":96326758400,"internally_reserved":0,"allocated":1454080,"data_stored":717432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.044,"15min":1.004},"min":{"1min":0.67900000000000005,"5min":0.61599999999999999,"15min":0.53300000000000003},"max":{"1min":1.5640000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.0209999999999999,"15min":1.0780000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3460000000000001,"5min":1.5680000000000001,"15min":1.571},"last":1.1479999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.173,"15min":1.1970000000000001},"min":{"1min":0.93000000000000005,"5min":0.67300000000000004,"15min":0.50600000000000001},"max":{"1min":1.4610000000000001,"5min":1.6859999999999999,"15min":1.821},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.175,"15min":1.2609999999999999},"min":{"1min":0.80100000000000005,"5min":0.76000000000000001,"15min":0.50900000000000001},"max":{"1min":1.9690000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.224}]},{"osd":2,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.1319999999999999,"15min":1.143},"min":{"1min":0.78400000000000003,"5min":0.77900000000000003,"15min":0.63500000000000001},"max":{"1min":1.286,"5min":1.925,"15min":1.925},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.107,"15min":1.1279999999999999},"min":{"1min":0.82999999999999996,"5min":0.64200000000000002,"15min":0.59899999999999998},"max":{"1min":1.4059999999999999,"5min":1.859,"15min":1.859},"last":0.72599999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.115,"15min":1.165},"min":{"1min":0.85199999999999998,"5min":0.76100000000000001,"15min":0.73499999999999999},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.931},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.2090000000000001,"15min":1.2689999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":4.8819999999999997,"5min":4.8819999999999997,"15min":4.8819999999999997},"last":1.111}]},{"osd":4,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0329999999999999,"15min":1.1419999999999999},"min":{"1min":0.60099999999999998,"5min":0.51700000000000002,"15min":0.44400000000000001},"max":{"1min":1.3520000000000001,"5min":1.5780000000000001,"15min":1.7829999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.107,"15min":1.2390000000000001},"min":{"1min":0.65100000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.401,"5min":1.8300000000000001,"15min":2.0699999999999998},"last":1.4139999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1519999999999999,"15min":1.284},"min":{"1min":0.874,"5min":0.63600000000000001,"15min":0.58199999999999996},"max":{"1min":1.615,"5min":1.8129999999999999,"15min":2.2010000000000001},"last":1.306},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.208,"15min":1.2769999999999999},"min":{"1min":0.93200000000000005,"5min":0.56100000000000005,"15min":0.55900000000000005},"max":{"1min":1.7150000000000001,"5min":1.7829999999999999,"15min":1.909},"last":1.2849999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:12:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.226,"15min":1.3640000000000001},"min":{"1min":0.77300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5149999999999999,"5min":1.766,"15min":2.3359999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2549999999999999,"15min":1.4079999999999999},"min":{"1min":0.64200000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":3.1840000000000002},"last":1.397}]}]},{"osd":4,"up_from":13,"seq":55834574961,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306836,"kb_used_data":1420,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065004,"statfs":{"total":96636764160,"available":96322564096,"internally_reserved":0,"allocated":1454080,"data_stored":718302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.0980000000000001,"15min":1.1200000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.726,"5min":1.7490000000000001,"15min":2.0150000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.1399999999999999,"15min":1.1060000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.484,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.6220000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.081,"15min":1.0820000000000001},"min":{"1min":0.72499999999999998,"5min":0.64000000000000001,"15min":0.53100000000000003},"max":{"1min":1.448,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.319},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.052,"15min":1.145},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":2.194},"last":1.1359999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.52800000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5009999999999999,"5min":1.7030000000000001,"15min":5.3390000000000004},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.1379999999999999,"15min":1.226},"min":{"1min":0.77000000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.641,"5min":1.641,"15min":2.3479999999999999},"last":1.4339999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1080000000000001,"15min":1.1599999999999999},"min":{"1min":0.72699999999999998,"5min":0.59299999999999997,"15min":0.496},"max":{"1min":1.468,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1180000000000001,"15min":1.151},"min":{"1min":0.71499999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.643,"5min":1.671,"15min":5.3029999999999999},"last":1.1859999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0669999999999999,"15min":1.171},"min":{"1min":0.73099999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.589,"5min":1.6970000000000001,"15min":2.0790000000000002},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.056,"15min":1.127},"min":{"1min":0.60499999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4219999999999999,"5min":1.597,"15min":2.0030000000000001},"last":1.4690000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.089,"15min":1.163},"min":{"1min":0.63100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.573,"5min":1.6160000000000001,"15min":5.3769999999999998},"last":1.071},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.167,"15min":1.3440000000000001},"min":{"1min":0.84999999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.641,"5min":1.778,"15min":4.4409999999999998},"last":1.365}]},{"osd":7,"last update":"Mon Jan 22 05:12:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.246,"15min":1.327},"min":{"1min":0.97299999999999998,"5min":0.66500000000000004,"15min":0.59399999999999997},"max":{"1min":1.5840000000000001,"5min":1.833,"15min":2.2839999999999998},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.2589999999999999,"15min":1.3460000000000001},"min":{"1min":0.95499999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.72,"5min":1.72,"15min":5.2629999999999999},"last":1.3919999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310944,"kb_used_data":1432,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060896,"statfs":{"total":96636764160,"available":96318357504,"internally_reserved":0,"allocated":1466368,"data_stored":719500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.83899999999999997,"15min":0.89100000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.34200000000000003},"max":{"1min":1.379,"5min":1.8440000000000001,"15min":14.859},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.879,"15min":0.89000000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":1.4490000000000001,"5min":2.3519999999999999,"15min":5.0919999999999996},"last":0.67300000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.93999999999999995,"15min":0.88200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.39300000000000002},"max":{"1min":1.0620000000000001,"5min":6.5570000000000004,"15min":6.5570000000000004},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.96099999999999997,"15min":0.97799999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.48399999999999999},"max":{"1min":1.3779999999999999,"5min":1.9510000000000001,"15min":5.7519999999999998},"last":0.70399999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1419999999999999,"15min":1.1439999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.40600000000000003},"max":{"1min":1.575,"5min":2.391,"15min":2.391},"last":1.268},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.2150000000000001,"15min":1.1970000000000001},"min":{"1min":0.59199999999999997,"5min":0.501,"15min":0.44800000000000001},"max":{"1min":1.6020000000000001,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":1.329}]},{"osd":4,"last update":"Mon Jan 22 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.385,"15min":1.323},"min":{"1min":1.018,"5min":0.71299999999999997,"15min":0.51700000000000002},"max":{"1min":1.6579999999999999,"5min":10.858000000000001,"15min":10.858000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3759999999999999,"15min":1.3520000000000001},"min":{"1min":0.82699999999999996,"5min":0.79500000000000004,"15min":0.63600000000000001},"max":{"1min":1.6910000000000001,"5min":10.846,"15min":10.846},"last":1.155}]},{"osd":5,"last update":"Mon Jan 22 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3140000000000001,"15min":1.3029999999999999},"min":{"1min":0.86399999999999999,"5min":0.74099999999999999,"15min":0.505},"max":{"1min":1.9910000000000001,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.3620000000000001,"15min":1.3700000000000001},"min":{"1min":0.76800000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.923,"5min":12.128,"15min":14.523999999999999},"last":0.98799999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3200000000000001,"15min":1.381},"min":{"1min":0.92900000000000005,"5min":0.81699999999999995,"15min":0.56699999999999995},"max":{"1min":1.9650000000000001,"5min":2.2610000000000001,"15min":4.9809999999999999},"last":1.212},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3560000000000001,"15min":1.403},"min":{"1min":1.0629999999999999,"5min":0.78800000000000003,"15min":0.68500000000000005},"max":{"1min":1.883,"5min":1.923,"15min":5.4210000000000003},"last":1.22}]},{"osd":7,"last update":"Mon Jan 22 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.355,"15min":1.3859999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.79900000000000004},"max":{"1min":1.6499999999999999,"5min":2.472,"15min":5.7160000000000002},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4299999999999999,"15min":1.427},"min":{"1min":0.84499999999999997,"5min":0.77800000000000002,"15min":0.71299999999999997},"max":{"1min":1.79,"5min":6.4279999999999999,"15min":6.4279999999999999},"last":1.137}]}]},{"osd":2,"up_from":13,"seq":55834574961,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306832,"kb_used_data":1416,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065008,"statfs":{"total":96636764160,"available":96322568192,"internally_reserved":0,"allocated":1449984,"data_stored":717410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.79300000000000004,"15min":0.75900000000000001},"min":{"1min":0.61899999999999999,"5min":0.46100000000000002,"15min":0.38500000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.90500000000000003,"15min":0.84399999999999997},"min":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.373},"max":{"1min":1.27,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.0189999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89600000000000002,"15min":0.82499999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2729999999999999,"5min":1.534,"15min":1.534},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.96299999999999997,"15min":0.94199999999999995},"min":{"1min":0.81999999999999995,"5min":0.57499999999999996,"15min":0.41599999999999998},"max":{"1min":1.383,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.1040000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.206,"15min":1.0980000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.7569999999999999,"5min":1.79,"15min":2.0779999999999998},"last":1.151},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.272,"15min":1.1910000000000001},"min":{"1min":0.76000000000000001,"5min":0.58499999999999996,"15min":0.51100000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.9990000000000001},"last":1.7}]},{"osd":4,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.2689999999999999,"15min":1.2869999999999999},"min":{"1min":1.014,"5min":0.71299999999999997,"15min":0.59099999999999997},"max":{"1min":1.647,"5min":1.647,"15min":2.1709999999999998},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.208,"15min":1.204},"min":{"1min":0.84899999999999998,"5min":0.66400000000000003,"15min":0.63500000000000001},"max":{"1min":1.7490000000000001,"5min":1.837,"15min":1.952},"last":1.347}]},{"osd":5,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.2609999999999999,"15min":1.2030000000000001},"min":{"1min":0.90000000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6120000000000001,"5min":2.0510000000000002,"15min":2.3660000000000001},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.274,"15min":1.298},"min":{"1min":1.143,"5min":0.77000000000000002,"15min":0.67000000000000004},"max":{"1min":1.7010000000000001,"5min":1.8600000000000001,"15min":2.2210000000000001},"last":1.5609999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.28,"15min":1.2569999999999999},"min":{"1min":0.89200000000000002,"5min":0.77600000000000002,"15min":0.68400000000000005},"max":{"1min":1.766,"5min":1.8360000000000001,"15min":2.1920000000000002},"last":1.597},{"interface":"front","average":{"1min":1.431,"5min":1.3400000000000001,"15min":1.2949999999999999},"min":{"1min":0.86699999999999999,"5min":0.84399999999999997,"15min":0.83999999999999997},"max":{"1min":1.9299999999999999,"5min":2.1320000000000001,"15min":2.4449999999999998},"last":1.504}]},{"osd":7,"last update":"Mon Jan 22 05:12:44 2024","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.3680000000000001,"15min":1.3540000000000001},"min":{"1min":1.0469999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9199999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.516,"5min":1.4550000000000001,"15min":1.4139999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.89000000000000001},"max":{"1min":1.8069999999999999,"5min":2.0329999999999999,"15min":2.5059999999999998},"last":1.7330000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306840,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065000,"statfs":{"total":96636764160,"available":96322560000,"internally_reserved":0,"allocated":1458176,"data_stored":717534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.89600000000000002,"15min":0.86199999999999999},"min":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":1.911,"5min":1.911,"15min":3.4119999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0289999999999999,"15min":1.006},"min":{"1min":0.42899999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8680000000000001,"5min":1.873,"15min":2.101},"last":0.95499999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.008,"15min":1},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0620000000000001,"15min":1.034},"min":{"1min":0.60599999999999998,"5min":0.59099999999999997,"15min":0.46899999999999997},"max":{"1min":1.671,"5min":1.71,"15min":2.008},"last":1.1739999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.046,"15min":1.016},"min":{"1min":0.66600000000000004,"5min":0.54800000000000004,"15min":0.38900000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":4.665},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.032,"15min":0.92700000000000005},"min":{"1min":0.55200000000000005,"5min":0.50600000000000001,"15min":0.41899999999999998},"max":{"1min":4.1319999999999997,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":0.84099999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.359,"15min":1.248},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.60599999999999998},"max":{"1min":2.2509999999999999,"5min":15.76,"15min":15.76},"last":1.21},{"interface":"front","average":{"1min":1.325,"5min":1.456,"15min":1.3160000000000001},"min":{"1min":0.94399999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.77,"5min":16.975000000000001,"15min":16.975000000000001},"last":1.6100000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.258,"15min":1.206},"min":{"1min":0.80900000000000005,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":4.3230000000000004,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":1.629},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3009999999999999,"15min":1.276},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.3330000000000002,"5min":2.52,"15min":2.52},"last":1.47}]},{"osd":6,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.288,"15min":1.2689999999999999},"min":{"1min":0.89900000000000002,"5min":0.83899999999999997,"15min":0.76000000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.355,"15min":1.3380000000000001},"min":{"1min":0.77400000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.5569999999999999,"5min":2.5569999999999999,"15min":2.5569999999999999},"last":1.589}]},{"osd":7,"last update":"Mon Jan 22 05:12:45 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3600000000000001,"15min":1.3700000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.77400000000000002},"max":{"1min":1.829,"5min":2.0019999999999998,"15min":4.4329999999999998},"last":1.359},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.377,"15min":1.363},"min":{"1min":1.0089999999999999,"5min":0.81999999999999995,"15min":0.77600000000000002},"max":{"1min":4.3970000000000002,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.5069999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574961,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302760,"kb_used_data":1440,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069080,"statfs":{"total":96636764160,"available":96326737920,"internally_reserved":0,"allocated":1474560,"data_stored":718790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:13:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.999,"15min":0.93200000000000005},"min":{"1min":0.53700000000000003,"5min":0.34799999999999998,"15min":0.28699999999999998},"max":{"1min":1.452,"5min":15.273,"15min":15.273},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.94799999999999995,"15min":0.95999999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.34499999999999997},"max":{"1min":1.698,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":0.74099999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:13:40 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.147,"15min":1.0880000000000001},"min":{"1min":0.70599999999999996,"5min":0.48199999999999998,"15min":0.46400000000000002},"max":{"1min":1.6459999999999999,"5min":15.473000000000001,"15min":15.473000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.0580000000000001,"15min":1.03},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.45400000000000001},"max":{"1min":1.794,"5min":1.794,"15min":1.7989999999999999},"last":0.85699999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:13:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0169999999999999,"15min":1.01},"min":{"1min":0.63500000000000001,"5min":0.40000000000000002,"15min":0.39000000000000001},"max":{"1min":1.351,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3009999999999999,"15min":1.2230000000000001},"min":{"1min":0.69199999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.2349999999999999,"5min":15.439,"15min":15.439},"last":1.393}]},{"osd":4,"last update":"Mon Jan 22 05:13:40 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.2410000000000001,"15min":1.321},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.61399999999999999},"max":{"1min":1.986,"5min":2.1280000000000001,"15min":5.1799999999999997},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.21,"15min":1.2350000000000001},"min":{"1min":0.59399999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.736,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":1.2709999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:13:40 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2509999999999999,"15min":1.321},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.645,"5min":2.891,"15min":3.548},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.335,"15min":1.3740000000000001},"min":{"1min":1.119,"5min":0.75900000000000001,"15min":0.59499999999999997},"max":{"1min":1.8009999999999999,"5min":2.823,"15min":2.823},"last":1.4590000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:13:40 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.514,"15min":1.4550000000000001},"min":{"1min":1.085,"5min":0.81399999999999995,"15min":0.59099999999999997},"max":{"1min":1.8740000000000001,"5min":15.4,"15min":15.4},"last":1.522},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.411,"15min":1.4530000000000001},"min":{"1min":0.88900000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.105,"5min":7.1349999999999998,"15min":7.1349999999999998},"last":1.2390000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:13:40 2024","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.411,"15min":1.5369999999999999},"min":{"1min":0.96599999999999997,"5min":0.91400000000000003,"15min":0.79900000000000004},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":5.29},"last":1.347},{"interface":"front","average":{"1min":1.427,"5min":1.363,"15min":1.4019999999999999},"min":{"1min":1.0369999999999999,"5min":0.81799999999999995,"15min":0.752},"max":{"1min":2.0009999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.1719999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:13:47.476 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:13:47.476 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-22T05:13:47.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.688+0000 7fdc25600700 1 Processor -- start 2024-01-22T05:13:47.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.688+0000 7fdc25600700 1 -- start start 2024-01-22T05:13:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.692+0000 7fdc25600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc200c1ce0 0x7fdc200bc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.692+0000 7fdc25600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdc200bc980 0x7fdc20068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.692+0000 7fdc25600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc20068280 con 0x7fdc20153cf0 2024-01-22T05:13:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.692+0000 7fdc25600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc200bd190 con 0x7fdc200bc980 2024-01-22T05:13:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.692+0000 7fdc25600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc20067c30 con 0x7fdc200c1ce0 2024-01-22T05:13:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.692+0000 7fdc1f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdc200bc980 0x7fdc20068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:47.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.692+0000 7fdc1e000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc200c1ce0 0x7fdc200bc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:47.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.692+0000 7fdc1f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdc200bc980 0x7fdc20068710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55636/0 (socket says 172.21.15.49:55636) 2024-01-22T05:13:47.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.692+0000 7fdc1f400700 1 -- 172.21.15.49:0/564059567 learned_addr learned my addr 172.21.15.49:0/564059567 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:47.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.692+0000 7fdc1ea00700 1 --1- 172.21.15.49:0/564059567 >> v1:172.21.15.110:6789/0 conn(0x7fdc20153cf0 0x7fdc200c15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:49810/0 (socket says 172.21.15.49:49810) 2024-01-22T05:13:47.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.696+0000 7fdc1e000700 1 -- 172.21.15.49:0/564059567 >> v2:172.21.15.49:3300/0 conn(0x7fdc200bc980 msgr2=0x7fdc20068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.696+0000 7fdc1e000700 1 --2- 172.21.15.49:0/564059567 >> v2:172.21.15.49:3300/0 conn(0x7fdc200bc980 0x7fdc20068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.696+0000 7fdc1e000700 1 -- 172.21.15.49:0/564059567 >> v1:172.21.15.110:6789/0 conn(0x7fdc20153cf0 legacy=0x7fdc200c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.696+0000 7fdc1d600700 1 -- 172.21.15.49:0/564059567 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108235323 0 0) 0x7fdc20068280 con 0x7fdc20153cf0 2024-01-22T05:13:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.696+0000 7fdc1e000700 1 -- 172.21.15.49:0/564059567 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc20067f10 con 0x7fdc200c1ce0 2024-01-22T05:13:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.696+0000 7fdc1e000700 1 --2- 172.21.15.49:0/564059567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc200c1ce0 0x7fdc200bc490 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fdc08006fd0 tx=0x7fdc08006f40).ready entity=mon.2 client_cookie=2dc42e0e1e472c4a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.696+0000 7fdc1d600700 1 -- 172.21.15.49:0/564059567 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08005880 con 0x7fdc200c1ce0 2024-01-22T05:13:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.696+0000 7fdc1d600700 1 -- 172.21.15.49:0/564059567 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc080059e0 con 0x7fdc200c1ce0 2024-01-22T05:13:47.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.696+0000 7fdc1d600700 1 -- 172.21.15.49:0/564059567 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08005d60 con 0x7fdc200c1ce0 2024-01-22T05:13:47.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.696+0000 7fdc25600700 1 -- 172.21.15.49:0/564059567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc200c1ce0 msgr2=0x7fdc200bc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:47.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.696+0000 7fdc25600700 1 --2- 172.21.15.49:0/564059567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc200c1ce0 0x7fdc200bc490 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fdc08006fd0 tx=0x7fdc08006f40).stop 2024-01-22T05:13:47.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.700+0000 7fdc25600700 1 -- 172.21.15.49:0/564059567 shutdown_connections 2024-01-22T05:13:47.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.700+0000 7fdc25600700 1 --2- 172.21.15.49:0/564059567 >> v2:172.21.15.49:3300/0 conn(0x7fdc200bc980 0x7fdc20068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.700+0000 7fdc25600700 1 --2- 172.21.15.49:0/564059567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc200c1ce0 0x7fdc200bc490 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.700+0000 7fdc25600700 1 -- 172.21.15.49:0/564059567 >> 172.21.15.49:0/564059567 conn(0x7fdc20062cb0 msgr2=0x7fdc200c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:47.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.700+0000 7fdc25600700 1 -- 172.21.15.49:0/564059567 shutdown_connections 2024-01-22T05:13:47.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.700+0000 7fdc25600700 1 -- 172.21.15.49:0/564059567 wait complete. 2024-01-22T05:13:47.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.700+0000 7fdc25600700 1 Processor -- start 2024-01-22T05:13:47.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc25600700 1 -- start start 2024-01-22T05:13:47.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc25600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc200bc980 0x7fdc200a8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:47.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc25600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc200c1ce0 0x7fdc201649d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:47.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc25600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc20153cf0 0x7fdc201550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:47.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc25600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc20164ec0 con 0x7fdc200bc980 2024-01-22T05:13:47.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc25600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc20155590 con 0x7fdc20153cf0 2024-01-22T05:13:47.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc25600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc201557f0 con 0x7fdc200c1ce0 2024-01-22T05:13:47.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc1ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc200bc980 0x7fdc200a8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:47.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc1ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc200bc980 0x7fdc200a8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55652/0 (socket says 172.21.15.49:55652) 2024-01-22T05:13:47.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc1ea00700 1 -- 172.21.15.49:0/605056583 learned_addr learned my addr 172.21.15.49:0/605056583 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:47.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc1f400700 1 --2- 172.21.15.49:0/605056583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc20153cf0 0x7fdc201550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:47.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc1e000700 1 --2- 172.21.15.49:0/605056583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc200c1ce0 0x7fdc201649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:47.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc1ea00700 1 -- 172.21.15.49:0/605056583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc200c1ce0 msgr2=0x7fdc201649d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:47.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc1ea00700 1 --2- 172.21.15.49:0/605056583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc200c1ce0 0x7fdc201649d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc1ea00700 1 -- 172.21.15.49:0/605056583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc20153cf0 msgr2=0x7fdc201550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:47.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc1ea00700 1 --2- 172.21.15.49:0/605056583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc20153cf0 0x7fdc201550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc1ea00700 1 -- 172.21.15.49:0/605056583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc08009250 con 0x7fdc200bc980 2024-01-22T05:13:47.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.704+0000 7fdc1ea00700 1 --2- 172.21.15.49:0/605056583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc200bc980 0x7fdc200a8230 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7fdc1000c560 tx=0x7fdc10007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:47.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.708+0000 7fdc16000700 1 -- 172.21.15.49:0/605056583 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc100072e0 con 0x7fdc200bc980 2024-01-22T05:13:47.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.708+0000 7fdc16000700 1 -- 172.21.15.49:0/605056583 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc10007440 con 0x7fdc200bc980 2024-01-22T05:13:47.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.708+0000 7fdc25600700 1 -- 172.21.15.49:0/605056583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc20155ad0 con 0x7fdc200bc980 2024-01-22T05:13:47.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.708+0000 7fdc16000700 1 -- 172.21.15.49:0/605056583 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc100058f0 con 0x7fdc200bc980 2024-01-22T05:13:47.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.708+0000 7fdc25600700 1 -- 172.21.15.49:0/605056583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc20156090 con 0x7fdc200bc980 2024-01-22T05:13:47.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.708+0000 7fdc25600700 1 -- 172.21.15.49:0/605056583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc200c0c00 con 0x7fdc200bc980 2024-01-22T05:13:47.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.712+0000 7fdc16000700 1 -- 172.21.15.49:0/605056583 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdc10005ce0 con 0x7fdc200bc980 2024-01-22T05:13:47.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.712+0000 7fdc16000700 1 --2- 172.21.15.49:0/605056583 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdbf805a510 0x7fdbf805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.712+0000 7fdc16000700 1 -- 172.21.15.49:0/605056583 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fdc10074030 con 0x7fdc200bc980 2024-01-22T05:13:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.712+0000 7fdc1e000700 1 --2- 172.21.15.49:0/605056583 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdbf805a510 0x7fdbf805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.712+0000 7fdc1e000700 1 --2- 172.21.15.49:0/605056583 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdbf805a510 0x7fdbf805c9d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fdc200c20e0 tx=0x7fdc08016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:47.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.720+0000 7fdc16000700 1 -- 172.21.15.49:0/605056583 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdc100476b0 con 0x7fdc200bc980 2024-01-22T05:13:47.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.936+0000 7fdc25600700 1 -- 172.21.15.49:0/605056583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fdc20046800 con 0x7fdc200bc980 2024-01-22T05:13:47.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.944+0000 7fdc16000700 1 -- 172.21.15.49:0/605056583 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7fdc1004acd0 con 0x7fdc200bc980 2024-01-22T05:13:47.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.948+0000 7fdc25600700 1 -- 172.21.15.49:0/605056583 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdbf805a510 msgr2=0x7fdbf805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:47.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.948+0000 7fdc25600700 1 --2- 172.21.15.49:0/605056583 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdbf805a510 0x7fdbf805c9d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fdc200c20e0 tx=0x7fdc08016000).stop 2024-01-22T05:13:47.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.948+0000 7fdc25600700 1 -- 172.21.15.49:0/605056583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc200bc980 msgr2=0x7fdc200a8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:47.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.948+0000 7fdc25600700 1 --2- 172.21.15.49:0/605056583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc200bc980 0x7fdc200a8230 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7fdc1000c560 tx=0x7fdc10007c90).stop 2024-01-22T05:13:47.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.948+0000 7fdc25600700 1 -- 172.21.15.49:0/605056583 shutdown_connections 2024-01-22T05:13:47.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.948+0000 7fdc25600700 1 --2- 172.21.15.49:0/605056583 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdbf805a510 0x7fdbf805c9d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.948+0000 7fdc25600700 1 --2- 172.21.15.49:0/605056583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc20153cf0 0x7fdc201550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.948+0000 7fdc25600700 1 --2- 172.21.15.49:0/605056583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc200c1ce0 0x7fdc201649d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.948+0000 7fdc25600700 1 --2- 172.21.15.49:0/605056583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc200bc980 0x7fdc200a8230 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:47.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.948+0000 7fdc25600700 1 -- 172.21.15.49:0/605056583 >> 172.21.15.49:0/605056583 conn(0x7fdc20062cb0 msgr2=0x7fdc200c38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:47.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.948+0000 7fdc25600700 1 -- 172.21.15.49:0/605056583 shutdown_connections 2024-01-22T05:13:47.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:47.948+0000 7fdc25600700 1 -- 172.21.15.49:0/605056583 wait complete. 2024-01-22T05:13:47.954 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-01-22T05:13:47.976 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:13:48.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.136+0000 7f2a79200700 1 Processor -- start 2024-01-22T05:13:48.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.136+0000 7f2a79200700 1 -- start start 2024-01-22T05:13:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a79200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a74065240 0x7f2a740644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a79200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2a74065620 0x7f2a740649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a79200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a740c2700 con 0x7f2a7415b9b0 2024-01-22T05:13:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a79200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a74064ed0 con 0x7f2a74065620 2024-01-22T05:13:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a79200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a740c29a0 con 0x7f2a74065240 2024-01-22T05:13:48.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a71e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a74065240 0x7f2a740644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:48.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a71e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a74065240 0x7f2a740644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:60030/0 (socket says 172.21.15.49:60030) 2024-01-22T05:13:48.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a71e00700 1 -- 172.21.15.49:0/2403793054 learned_addr learned my addr 172.21.15.49:0/2403793054 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:48.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a71400700 1 --2- 172.21.15.49:0/2403793054 >> v2:172.21.15.110:3300/0 conn(0x7f2a74065620 0x7f2a740649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:48.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a71e00700 1 -- 172.21.15.49:0/2403793054 >> v2:172.21.15.110:3300/0 conn(0x7f2a74065620 msgr2=0x7f2a740649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:48.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a71e00700 1 --2- 172.21.15.49:0/2403793054 >> v2:172.21.15.110:3300/0 conn(0x7f2a74065620 0x7f2a740649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a71e00700 1 -- 172.21.15.49:0/2403793054 >> v1:172.21.15.110:6789/0 conn(0x7f2a7415b9b0 legacy=0x7f2a7415be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:48.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a71e00700 1 -- 172.21.15.49:0/2403793054 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a740c2c80 con 0x7f2a74065240 2024-01-22T05:13:48.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a71e00700 1 --2- 172.21.15.49:0/2403793054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a74065240 0x7f2a740644f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f2a64006fd0 tx=0x7f2a640090f0).ready entity=mon.2 client_cookie=208764cd2fb8aeec server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:48.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a70a00700 1 -- 172.21.15.49:0/2403793054 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6400b580 con 0x7f2a74065240 2024-01-22T05:13:48.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a70a00700 1 -- 172.21.15.49:0/2403793054 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6400b6e0 con 0x7f2a74065240 2024-01-22T05:13:48.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.140+0000 7f2a70a00700 1 -- 172.21.15.49:0/2403793054 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6400ba60 con 0x7f2a74065240 2024-01-22T05:13:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.144+0000 7f2a79200700 1 -- 172.21.15.49:0/2403793054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a74065240 msgr2=0x7f2a740644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.144+0000 7f2a79200700 1 --2- 172.21.15.49:0/2403793054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a74065240 0x7f2a740644f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f2a64006fd0 tx=0x7f2a640090f0).stop 2024-01-22T05:13:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.144+0000 7f2a79200700 1 -- 172.21.15.49:0/2403793054 shutdown_connections 2024-01-22T05:13:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.144+0000 7f2a79200700 1 --2- 172.21.15.49:0/2403793054 >> v2:172.21.15.110:3300/0 conn(0x7f2a74065620 0x7f2a740649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.144+0000 7f2a79200700 1 --2- 172.21.15.49:0/2403793054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a74065240 0x7f2a740644f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.144+0000 7f2a79200700 1 -- 172.21.15.49:0/2403793054 >> 172.21.15.49:0/2403793054 conn(0x7f2a740c87f0 msgr2=0x7f2a740c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:48.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.144+0000 7f2a79200700 1 -- 172.21.15.49:0/2403793054 shutdown_connections 2024-01-22T05:13:48.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.144+0000 7f2a79200700 1 -- 172.21.15.49:0/2403793054 wait complete. 2024-01-22T05:13:48.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.144+0000 7f2a79200700 1 Processor -- start 2024-01-22T05:13:48.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a79200700 1 -- start start 2024-01-22T05:13:48.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a79200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a74065240 0x7f2a74148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a79200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a74065620 0x7f2a7416bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a79200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a7415b9b0 0x7f2a7416c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a79200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7416c8d0 con 0x7f2a74065240 2024-01-22T05:13:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a79200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a740aa7f0 con 0x7f2a74065620 2024-01-22T05:13:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a79200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a74159b20 con 0x7f2a7415b9b0 2024-01-22T05:13:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a71e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a74065240 0x7f2a74148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:48.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a71e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a74065240 0x7f2a74148dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55666/0 (socket says 172.21.15.49:55666) 2024-01-22T05:13:48.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a71e00700 1 -- 172.21.15.49:0/3225090268 learned_addr learned my addr 172.21.15.49:0/3225090268 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:48.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a71400700 1 --2- 172.21.15.49:0/3225090268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a74065620 0x7f2a7416bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:48.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a73200700 1 --2- 172.21.15.49:0/3225090268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a7415b9b0 0x7f2a7416c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:48.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a71e00700 1 -- 172.21.15.49:0/3225090268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a7415b9b0 msgr2=0x7f2a7416c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:48.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a71e00700 1 --2- 172.21.15.49:0/3225090268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a7415b9b0 0x7f2a7416c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a71e00700 1 -- 172.21.15.49:0/3225090268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a74065620 msgr2=0x7f2a7416bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:48.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a71e00700 1 --2- 172.21.15.49:0/3225090268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a74065620 0x7f2a7416bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.148+0000 7f2a71e00700 1 -- 172.21.15.49:0/3225090268 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a64009370 con 0x7f2a74065240 2024-01-22T05:13:48.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.152+0000 7f2a71e00700 1 --2- 172.21.15.49:0/3225090268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a74065240 0x7f2a74148dd0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f2a64009130 tx=0x7f2a64017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:48.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.152+0000 7f2a69600700 1 -- 172.21.15.49:0/3225090268 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64000bc0 con 0x7f2a74065240 2024-01-22T05:13:48.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.152+0000 7f2a69600700 1 -- 172.21.15.49:0/3225090268 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6400b850 con 0x7f2a74065240 2024-01-22T05:13:48.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.152+0000 7f2a79200700 1 -- 172.21.15.49:0/3225090268 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a74159510 con 0x7f2a74065240 2024-01-22T05:13:48.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.152+0000 7f2a69600700 1 -- 172.21.15.49:0/3225090268 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64000d20 con 0x7f2a74065240 2024-01-22T05:13:48.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.152+0000 7f2a79200700 1 -- 172.21.15.49:0/3225090268 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a741597b0 con 0x7f2a74065240 2024-01-22T05:13:48.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.152+0000 7f2a79200700 1 -- 172.21.15.49:0/3225090268 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a74047060 con 0x7f2a74065240 2024-01-22T05:13:48.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.152+0000 7f2a69600700 1 -- 172.21.15.49:0/3225090268 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2a6401cb10 con 0x7f2a74065240 2024-01-22T05:13:48.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.156+0000 7f2a69600700 1 --2- 172.21.15.49:0/3225090268 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2a4c05a540 0x7f2a4c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:48.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.156+0000 7f2a69600700 1 -- 172.21.15.49:0/3225090268 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2a640767e0 con 0x7f2a74065240 2024-01-22T05:13:48.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.156+0000 7f2a71400700 1 --2- 172.21.15.49:0/3225090268 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2a4c05a540 0x7f2a4c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.156+0000 7f2a71400700 1 --2- 172.21.15.49:0/3225090268 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2a4c05a540 0x7f2a4c05ca00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f2a740a7bf0 tx=0x7f2a5c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:48.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.160+0000 7f2a69600700 1 -- 172.21.15.49:0/3225090268 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2a64049da0 con 0x7f2a74065240 2024-01-22T05:13:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.360+0000 7f2a79200700 1 -- 172.21.15.49:0/3225090268 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a740c2f60 con 0x7f2a74065240 2024-01-22T05:13:48.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.360+0000 7f2a69600700 1 -- 172.21.15.49:0/3225090268 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f2a6402a020 con 0x7f2a74065240 2024-01-22T05:13:48.362 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:13:48.362 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:13:48.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.364+0000 7f2a79200700 1 -- 172.21.15.49:0/3225090268 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2a4c05a540 msgr2=0x7f2a4c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.364+0000 7f2a79200700 1 --2- 172.21.15.49:0/3225090268 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2a4c05a540 0x7f2a4c05ca00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f2a740a7bf0 tx=0x7f2a5c009060).stop 2024-01-22T05:13:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.364+0000 7f2a79200700 1 -- 172.21.15.49:0/3225090268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a74065240 msgr2=0x7f2a74148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:48.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.364+0000 7f2a79200700 1 --2- 172.21.15.49:0/3225090268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a74065240 0x7f2a74148dd0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f2a64009130 tx=0x7f2a64017000).stop 2024-01-22T05:13:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.364+0000 7f2a79200700 1 -- 172.21.15.49:0/3225090268 shutdown_connections 2024-01-22T05:13:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.364+0000 7f2a79200700 1 --2- 172.21.15.49:0/3225090268 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2a4c05a540 0x7f2a4c05ca00 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.364+0000 7f2a79200700 1 --2- 172.21.15.49:0/3225090268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a7415b9b0 0x7f2a7416c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.364+0000 7f2a79200700 1 --2- 172.21.15.49:0/3225090268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a74065620 0x7f2a7416bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.364+0000 7f2a79200700 1 --2- 172.21.15.49:0/3225090268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a74065240 0x7f2a74148dd0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.364+0000 7f2a79200700 1 -- 172.21.15.49:0/3225090268 >> 172.21.15.49:0/3225090268 conn(0x7f2a740c87f0 msgr2=0x7f2a74063450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.364+0000 7f2a79200700 1 -- 172.21.15.49:0/3225090268 shutdown_connections 2024-01-22T05:13:48.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.364+0000 7f2a79200700 1 -- 172.21.15.49:0/3225090268 wait complete. 2024-01-22T05:13:48.371 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:13:48.793 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 98, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:13:37.989402+0000', 'modified': '2024-01-22T05:13:41.022182+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7743}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7743': {'gid': 7743, 'name': 'b', 'rank': 0, 'incarnation': 94, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.110:6833/1348218223', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6832', 'nonce': 1348218223}, {'type': 'v1', 'addr': '172.21.15.110:6833', 'nonce': 1348218223}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:13:48.793 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:13:48.793 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-22T05:13:48.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.964+0000 7fb055e00700 1 Processor -- start 2024-01-22T05:13:48.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.964+0000 7fb055e00700 1 -- start start 2024-01-22T05:13:48.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.968+0000 7fb055e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb050155d20 0x7fb050065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:48.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.968+0000 7fb055e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb050066070 0x7fb0500a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:48.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.968+0000 7fb055e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0500a90e0 con 0x7fb0500a8c30 2024-01-22T05:13:48.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.968+0000 7fb055e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0500c1a40 con 0x7fb050066070 2024-01-22T05:13:48.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.968+0000 7fb055e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb050159310 con 0x7fb050155d20 2024-01-22T05:13:48.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.968+0000 7fb04e000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb050066070 0x7fb0500a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:48.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.968+0000 7fb04ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb050155d20 0x7fb050065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:48.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.968+0000 7fb04f400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb0500a8c30 0x7fb0500c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:49820/0 (socket says 172.21.15.49:49820) 2024-01-22T05:13:48.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.968+0000 7fb04f400700 1 -- 172.21.15.49:0/788813398 learned_addr learned my addr 172.21.15.49:0/788813398 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:48.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.968+0000 7fb04e000700 1 -- 172.21.15.49:0/788813398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb050155d20 msgr2=0x7fb050065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:48.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.968+0000 7fb04e000700 1 --2- 172.21.15.49:0/788813398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb050155d20 0x7fb050065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.968+0000 7fb04e000700 1 -- 172.21.15.49:0/788813398 >> v1:172.21.15.110:6789/0 conn(0x7fb0500a8c30 legacy=0x7fb0500c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:48.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.968+0000 7fb04e000700 1 -- 172.21.15.49:0/788813398 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0500c13f0 con 0x7fb050066070 2024-01-22T05:13:48.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.968+0000 7fb04e000700 1 --2- 172.21.15.49:0/788813398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb050066070 0x7fb0500a8740 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fb038009760 tx=0x7fb038009060).ready entity=mon.1 client_cookie=69b0e96a14966b4c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:48.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.972+0000 7fb04d600700 1 -- 172.21.15.49:0/788813398 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03800f510 con 0x7fb050066070 2024-01-22T05:13:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.972+0000 7fb04d600700 1 -- 172.21.15.49:0/788813398 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03800f670 con 0x7fb050066070 2024-01-22T05:13:48.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.972+0000 7fb04d600700 1 -- 172.21.15.49:0/788813398 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03800f9f0 con 0x7fb050066070 2024-01-22T05:13:48.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.972+0000 7fb055e00700 1 -- 172.21.15.49:0/788813398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb050066070 msgr2=0x7fb0500a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:48.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.972+0000 7fb055e00700 1 --2- 172.21.15.49:0/788813398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb050066070 0x7fb0500a8740 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fb038009760 tx=0x7fb038009060).stop 2024-01-22T05:13:48.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.972+0000 7fb055e00700 1 -- 172.21.15.49:0/788813398 shutdown_connections 2024-01-22T05:13:48.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.972+0000 7fb055e00700 1 --2- 172.21.15.49:0/788813398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb050066070 0x7fb0500a8740 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.972+0000 7fb055e00700 1 --2- 172.21.15.49:0/788813398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb050155d20 0x7fb050065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.972+0000 7fb055e00700 1 -- 172.21.15.49:0/788813398 >> 172.21.15.49:0/788813398 conn(0x7fb0500c6540 msgr2=0x7fb0500c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:48.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.972+0000 7fb055e00700 1 -- 172.21.15.49:0/788813398 shutdown_connections 2024-01-22T05:13:48.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.972+0000 7fb055e00700 1 -- 172.21.15.49:0/788813398 wait complete. 2024-01-22T05:13:48.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.976+0000 7fb055e00700 1 Processor -- start 2024-01-22T05:13:48.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.976+0000 7fb055e00700 1 -- start start 2024-01-22T05:13:48.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb055e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb050066070 0x7fb050152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:48.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb055e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0500a8c30 0x7fb0500bf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:48.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb055e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb050155d20 0x7fb0500be520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:48.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb055e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500be090 con 0x7fb050155d20 2024-01-22T05:13:48.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb055e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500c0240 con 0x7fb0500a8c30 2024-01-22T05:13:48.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb055e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500bda40 con 0x7fb050066070 2024-01-22T05:13:48.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb04f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb050155d20 0x7fb0500be520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:48.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb04f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb050155d20 0x7fb0500be520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55668/0 (socket says 172.21.15.49:55668) 2024-01-22T05:13:48.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb04f400700 1 -- 172.21.15.49:0/2606867008 learned_addr learned my addr 172.21.15.49:0/2606867008 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:48.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb04ea00700 1 --2- 172.21.15.49:0/2606867008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb050066070 0x7fb050152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:48.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb04e000700 1 --2- 172.21.15.49:0/2606867008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0500a8c30 0x7fb0500bf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:48.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb04f400700 1 -- 172.21.15.49:0/2606867008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb050066070 msgr2=0x7fb050152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:48.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb04f400700 1 --2- 172.21.15.49:0/2606867008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb050066070 0x7fb050152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb04f400700 1 -- 172.21.15.49:0/2606867008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0500a8c30 msgr2=0x7fb0500bf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:48.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb04f400700 1 --2- 172.21.15.49:0/2606867008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0500a8c30 0x7fb0500bf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb04f400700 1 -- 172.21.15.49:0/2606867008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0380092a0 con 0x7fb050155d20 2024-01-22T05:13:48.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb04f400700 1 --2- 172.21.15.49:0/2606867008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb050155d20 0x7fb0500be520 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fb04800c790 tx=0x7fb0480015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:48.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb046000700 1 -- 172.21.15.49:0/2606867008 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048005d30 con 0x7fb050155d20 2024-01-22T05:13:48.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb046000700 1 -- 172.21.15.49:0/2606867008 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb048005e90 con 0x7fb050155d20 2024-01-22T05:13:48.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb055e00700 1 -- 172.21.15.49:0/2606867008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0500bdd20 con 0x7fb050155d20 2024-01-22T05:13:48.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb046000700 1 -- 172.21.15.49:0/2606867008 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048007320 con 0x7fb050155d20 2024-01-22T05:13:48.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.980+0000 7fb055e00700 1 -- 172.21.15.49:0/2606867008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0500c0520 con 0x7fb050155d20 2024-01-22T05:13:48.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.984+0000 7fb046000700 1 -- 172.21.15.49:0/2606867008 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb0480076d0 con 0x7fb050155d20 2024-01-22T05:13:48.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.988+0000 7fb046000700 1 --2- 172.21.15.49:0/2606867008 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb02805a4e0 0x7fb02805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:48.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.988+0000 7fb046000700 1 -- 172.21.15.49:0/2606867008 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb048074620 con 0x7fb050155d20 2024-01-22T05:13:48.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.988+0000 7fb04ea00700 1 --2- 172.21.15.49:0/2606867008 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb02805a4e0 0x7fb02805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:48.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.988+0000 7fb04ea00700 1 --2- 172.21.15.49:0/2606867008 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb02805a4e0 0x7fb02805c9a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fb040009c30 tx=0x7fb040009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:48.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.988+0000 7fb0601b8740 1 Processor -- start 2024-01-22T05:13:48.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb0601b8740 1 -- start start 2024-01-22T05:13:48.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb0601b8740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e3a0 0x1f52d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:48.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb0601b8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2de40 0x1f29af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:48.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb0601b8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6e780 0x1f273a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:48.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb0601b8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ead410 con 0x1f2de40 2024-01-22T05:13:48.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb0601b8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ead550 con 0x1f6e780 2024-01-22T05:13:48.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb0601b8740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1eada00 con 0x1f6e3a0 2024-01-22T05:13:48.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb04e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2de40 0x1f29af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:48.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb04e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2de40 0x1f29af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55672/0 (socket says 172.21.15.49:55672) 2024-01-22T05:13:48.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb04e000700 1 -- 172.21.15.49:0/958994166 learned_addr learned my addr 172.21.15.49:0/958994166 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:48.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb04ea00700 1 --2- 172.21.15.49:0/958994166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e3a0 0x1f52d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:48.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb04f400700 1 --2- 172.21.15.49:0/958994166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6e780 0x1f273a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:48.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb04e000700 1 -- 172.21.15.49:0/958994166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e3a0 msgr2=0x1f52d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb04e000700 1 --2- 172.21.15.49:0/958994166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e3a0 0x1f52d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb04e000700 1 -- 172.21.15.49:0/958994166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6e780 msgr2=0x1f273a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb04e000700 1 --2- 172.21.15.49:0/958994166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6e780 0x1f273a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb04e000700 1 -- 172.21.15.49:0/958994166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1ea6730 con 0x1f2de40 2024-01-22T05:13:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb04e000700 1 --2- 172.21.15.49:0/958994166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2de40 0x1f29af0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fb038009e00 tx=0x7fb038017000).ready entity=mon.0 client_cookie=b0f12c970f8aeb56 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:48.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb03ea00700 1 -- 172.21.15.49:0/958994166 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038000bc0 con 0x1f2de40 2024-01-22T05:13:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb03ea00700 1 -- 172.21.15.49:0/958994166 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03800f7e0 con 0x1f2de40 2024-01-22T05:13:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.992+0000 7fb03ea00700 1 -- 172.21.15.49:0/958994166 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038000d20 con 0x1f2de40 2024-01-22T05:13:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.996+0000 7fb0601b8740 1 -- 172.21.15.49:0/958994166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2de40 msgr2=0x1f29af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.996+0000 7fb0601b8740 1 --2- 172.21.15.49:0/958994166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2de40 0x1f29af0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fb038009e00 tx=0x7fb038017000).stop 2024-01-22T05:13:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.996+0000 7fb0601b8740 1 -- 172.21.15.49:0/958994166 shutdown_connections 2024-01-22T05:13:48.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.996+0000 7fb0601b8740 1 --2- 172.21.15.49:0/958994166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6e780 0x1f273a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.996+0000 7fb0601b8740 1 --2- 172.21.15.49:0/958994166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2de40 0x1f29af0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.996+0000 7fb0601b8740 1 --2- 172.21.15.49:0/958994166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e3a0 0x1f52d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.996+0000 7fb0601b8740 1 -- 172.21.15.49:0/958994166 >> 172.21.15.49:0/958994166 conn(0x1d0b550 msgr2=0x1f2d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.996+0000 7fb0601b8740 1 -- 172.21.15.49:0/958994166 shutdown_connections 2024-01-22T05:13:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.996+0000 7fb0601b8740 1 -- 172.21.15.49:0/958994166 wait complete. 2024-01-22T05:13:48.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.996+0000 7fb0601b8740 1 -- start start 2024-01-22T05:13:48.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:48.996+0000 7fb0601b8740 1 Processor -- start 2024-01-22T05:13:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb0601b8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2de40 0x1f54b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb0601b8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6e3a0 0x1f4fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb0601b8740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e780 0x1f6db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb0601b8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e78650 con 0x1f6e3a0 2024-01-22T05:13:49.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb0601b8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f6e000 con 0x1f2de40 2024-01-22T05:13:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb0601b8740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f57d60 con 0x1f6e780 2024-01-22T05:13:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb0601b8740 10 client.0 ll_register_callbacks cb 0x1ee5020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:13:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb04e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6e3a0 0x1f4fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb04e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6e3a0 0x1f4fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55684/0 (socket says 172.21.15.49:55684) 2024-01-22T05:13:49.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb04e000700 1 -- 172.21.15.49:0/2636109114 learned_addr learned my addr 172.21.15.49:0/2636109114 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:49.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb04ea00700 1 --2- 172.21.15.49:0/2636109114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2de40 0x1f54b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb04f400700 1 --2- 172.21.15.49:0/2636109114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e780 0x1f6db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb04e000700 1 -- 172.21.15.49:0/2636109114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e780 msgr2=0x1f6db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:49.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb04e000700 1 --2- 172.21.15.49:0/2636109114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e780 0x1f6db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb04e000700 1 -- 172.21.15.49:0/2636109114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2de40 msgr2=0x1f54b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:49.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb04e000700 1 --2- 172.21.15.49:0/2636109114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2de40 0x1f54b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb04e000700 1 -- 172.21.15.49:0/2636109114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0500c13f0 con 0x1f6e3a0 2024-01-22T05:13:49.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb04e000700 1 --2- 172.21.15.49:0/2636109114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6e3a0 0x1f4fd90 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7fb038009fd0 tx=0x7fb03801e070).ready entity=mon.0 client_cookie=42c712952c0ee92a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:49.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb037400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:13:49.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.000+0000 7fb037400700 1 -- 172.21.15.49:0/2636109114 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038025ea0 con 0x1f6e3a0 2024-01-22T05:13:49.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb0601b8740 1 -- 172.21.15.49:0/2636109114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1ea31a0 con 0x1f6e3a0 2024-01-22T05:13:49.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb037400700 1 -- 172.21.15.49:0/2636109114 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb038030e00 con 0x1f6e3a0 2024-01-22T05:13:49.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb037400700 1 -- 172.21.15.49:0/2636109114 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb038006910 con 0x1f6e3a0 2024-01-22T05:13:49.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb0601b8740 10 client.7899 fetch_fsmap learned FSMap version 98 2024-01-22T05:13:49.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb0601b8740 1 -- 172.21.15.49:0/2636109114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x1ea1960 con 0x1f6e3a0 2024-01-22T05:13:49.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb037400700 1 -- 172.21.15.49:0/2636109114 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1ea31a0 con 0x1f6e3a0 2024-01-22T05:13:49.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb037400700 1 -- 172.21.15.49:0/2636109114 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 98) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb038009790 con 0x1f6e3a0 2024-01-22T05:13:49.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb0601b8740 10 client.7899 fetch_fsmap finished waiting for FSMap version 98 2024-01-22T05:13:49.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb0601b8740 10 client.7899 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-22T05:13:49.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb0601b8740 20 client.7899 populate_metadata read hostname 'smithi049' 2024-01-22T05:13:49.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb0601b8740 1 --2- 172.21.15.49:0/2636109114 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1f56fc0 0x1f573a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb0601b8740 4 client.7899 mds_command: new command op to 7743 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:13:49.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb0601b8740 1 -- 172.21.15.49:0/2636109114 --> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1e996f0 con 0x1f56fc0 2024-01-22T05:13:49.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb04ea00700 1 --2- 172.21.15.49:0/2636109114 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1f56fc0 0x1f573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb04ea00700 1 --2- 172.21.15.49:0/2636109114 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1f56fc0 0x1f573a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7217a378937da79b server_cookie=3932018d9f40db04 in_seq=0 out_seq=0 2024-01-22T05:13:49.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.004+0000 7fb037400700 10 client.7899 ms_handle_connect on v2:172.21.15.110:6832/1348218223 2024-01-22T05:13:49.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.008+0000 7fb037400700 1 -- 172.21.15.49:0/2636109114 <== mds.0 v2:172.21.15.110:6832/1348218223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1e996f0 con 0x1f56fc0 2024-01-22T05:13:49.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.008+0000 7fb037400700 10 client.7899 handle_command_reply: tid=0 2024-01-22T05:13:49.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.008+0000 7fb0601b8740 1 client.7899 shutdown 2024-01-22T05:13:49.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.008+0000 7fb0601b8740 1 -- 172.21.15.49:0/2636109114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6e3a0 msgr2=0x1f4fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:49.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.008+0000 7fb0601b8740 1 --2- 172.21.15.49:0/2636109114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6e3a0 0x1f4fd90 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7fb038009fd0 tx=0x7fb03801e070).stop 2024-01-22T05:13:49.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.008+0000 7fb0601b8740 1 -- 172.21.15.49:0/2636109114 shutdown_connections 2024-01-22T05:13:49.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.008+0000 7fb0601b8740 1 --2- 172.21.15.49:0/2636109114 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1f56fc0 0x1f573a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.008+0000 7fb0601b8740 1 --2- 172.21.15.49:0/2636109114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e780 0x1f6db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.008+0000 7fb0601b8740 1 --2- 172.21.15.49:0/2636109114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6e3a0 0x1f4fd90 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.008+0000 7fb0601b8740 1 --2- 172.21.15.49:0/2636109114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2de40 0x1f54b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.008+0000 7fb037400700 0 client.7899 ms_handle_reset on v2:172.21.15.110:6832/1348218223 2024-01-22T05:13:49.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.008+0000 7fb0601b8740 1 -- 172.21.15.49:0/2636109114 >> 172.21.15.49:0/2636109114 conn(0x1d0b550 msgr2=0x1f2c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:49.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.008+0000 7fb0601b8740 1 -- 172.21.15.49:0/2636109114 shutdown_connections 2024-01-22T05:13:49.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.008+0000 7fb0601b8740 1 -- 172.21.15.49:0/2636109114 wait complete. 2024-01-22T05:13:49.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.008+0000 7fb0601b8740 20 client.7899 trim_cache size 0 max 16384 2024-01-22T05:13:49.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.032+0000 7fb0601b8740 1 Processor -- start 2024-01-22T05:13:49.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.032+0000 7fb0601b8740 1 -- start start 2024-01-22T05:13:49.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.032+0000 7fb0601b8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2de40 0x1f2c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.032+0000 7fb0601b8740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e3a0 0x1f2cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.032+0000 7fb0601b8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6e780 0x1f2d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.032+0000 7fb0601b8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f6dba0 con 0x1f6e780 2024-01-22T05:13:49.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.032+0000 7fb0601b8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e7cc50 con 0x1f2de40 2024-01-22T05:13:49.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.032+0000 7fb0601b8740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f50150 con 0x1f6e3a0 2024-01-22T05:13:49.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb04ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2de40 0x1f2c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb04f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6e780 0x1f2d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb04ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2de40 0x1f2c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:43496/0 (socket says 172.21.15.49:43496) 2024-01-22T05:13:49.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb04ea00700 1 -- 172.21.15.49:0/2343234829 learned_addr learned my addr 172.21.15.49:0/2343234829 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:49.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb04e000700 1 --2- 172.21.15.49:0/2343234829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e3a0 0x1f2cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb04ea00700 1 -- 172.21.15.49:0/2343234829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e3a0 msgr2=0x1f2cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:49.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb04ea00700 1 --2- 172.21.15.49:0/2343234829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e3a0 0x1f2cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb04ea00700 1 -- 172.21.15.49:0/2343234829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6e780 msgr2=0x1f2d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:49.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb04ea00700 1 --2- 172.21.15.49:0/2343234829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6e780 0x1f2d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb04ea00700 1 -- 172.21.15.49:0/2343234829 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050067df0 con 0x1f2de40 2024-01-22T05:13:49.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb04ea00700 1 --2- 172.21.15.49:0/2343234829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2de40 0x1f2c690 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fb040011df0 tx=0x7fb040017000).ready entity=mon.1 client_cookie=258bbdf85c9b7b7f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:49.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb03f400700 1 -- 172.21.15.49:0/2343234829 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040027070 con 0x1f2de40 2024-01-22T05:13:49.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb03f400700 1 -- 172.21.15.49:0/2343234829 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0400221e0 con 0x1f2de40 2024-01-22T05:13:49.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb03f400700 1 -- 172.21.15.49:0/2343234829 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040020440 con 0x1f2de40 2024-01-22T05:13:49.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb0601b8740 1 -- 172.21.15.49:0/2343234829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2de40 msgr2=0x1f2c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:49.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.036+0000 7fb0601b8740 1 --2- 172.21.15.49:0/2343234829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2de40 0x1f2c690 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fb040011df0 tx=0x7fb040017000).stop 2024-01-22T05:13:49.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.040+0000 7fb0601b8740 1 -- 172.21.15.49:0/2343234829 shutdown_connections 2024-01-22T05:13:49.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.040+0000 7fb0601b8740 1 --2- 172.21.15.49:0/2343234829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f6e780 0x1f2d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.040+0000 7fb0601b8740 1 --2- 172.21.15.49:0/2343234829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e3a0 0x1f2cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.040+0000 7fb0601b8740 1 --2- 172.21.15.49:0/2343234829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f2de40 0x1f2c690 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.040+0000 7fb0601b8740 1 -- 172.21.15.49:0/2343234829 >> 172.21.15.49:0/2343234829 conn(0x1d0b550 msgr2=0x1f28c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:49.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.040+0000 7fb0601b8740 1 -- 172.21.15.49:0/2343234829 shutdown_connections 2024-01-22T05:13:49.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.040+0000 7fb0601b8740 1 -- 172.21.15.49:0/2343234829 wait complete. 2024-01-22T05:13:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.040+0000 7fb0601b8740 1 -- start start 2024-01-22T05:13:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.040+0000 7fb0601b8740 1 Processor -- start 2024-01-22T05:13:49.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb0601b8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2de40 0x1f2b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb0601b8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6e3a0 0x1fd4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb0601b8740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e780 0x1f514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb0601b8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fd6550 con 0x1f2de40 2024-01-22T05:13:49.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb0601b8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fd69b0 con 0x1f6e3a0 2024-01-22T05:13:49.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb0601b8740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f50f10 con 0x1f6e780 2024-01-22T05:13:49.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb0601b8740 10 client.0 ll_register_callbacks cb 0x7fb0380259b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:13:49.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb04ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2de40 0x1f2b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb04e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6e3a0 0x1fd4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb04ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2de40 0x1f2b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55702/0 (socket says 172.21.15.49:55702) 2024-01-22T05:13:49.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb04ea00700 1 -- 172.21.15.49:0/835618889 learned_addr learned my addr 172.21.15.49:0/835618889 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:49.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb04f400700 1 --2- 172.21.15.49:0/835618889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e780 0x1f514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb04ea00700 1 -- 172.21.15.49:0/835618889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e780 msgr2=0x1f514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:49.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb04ea00700 1 --2- 172.21.15.49:0/835618889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e780 0x1f514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb04ea00700 1 -- 172.21.15.49:0/835618889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6e3a0 msgr2=0x1fd4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:13:49.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb04ea00700 1 --2- 172.21.15.49:0/835618889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6e3a0 0x1fd4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb04ea00700 1 -- 172.21.15.49:0/835618889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb040011c60 con 0x1f2de40 2024-01-22T05:13:49.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb04e000700 1 --2- 172.21.15.49:0/835618889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6e3a0 0x1fd4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:13:49.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb04ea00700 1 --2- 172.21.15.49:0/835618889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2de40 0x1f2b8f0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fb040022ad0 tx=0x7fb04002b000).ready entity=mon.0 client_cookie=d0108cfc9cf0978 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:49.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb037400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:13:49.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb037400700 1 -- 172.21.15.49:0/835618889 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040020ad0 con 0x1f2de40 2024-01-22T05:13:49.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb0601b8740 1 -- 172.21.15.49:0/835618889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb03800f7e0 con 0x1f2de40 2024-01-22T05:13:49.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb037400700 1 -- 172.21.15.49:0/835618889 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb040020c30 con 0x1f2de40 2024-01-22T05:13:49.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb037400700 1 -- 172.21.15.49:0/835618889 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb040035480 con 0x1f2de40 2024-01-22T05:13:49.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb0601b8740 10 client.7905 fetch_fsmap learned FSMap version 98 2024-01-22T05:13:49.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.044+0000 7fb0601b8740 1 -- 172.21.15.49:0/835618889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x1ea16b0 con 0x1f2de40 2024-01-22T05:13:49.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb037400700 1 -- 172.21.15.49:0/835618889 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03800f7e0 con 0x1f2de40 2024-01-22T05:13:49.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb037400700 1 -- 172.21.15.49:0/835618889 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 98) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb040014440 con 0x1f2de40 2024-01-22T05:13:49.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb0601b8740 10 client.7905 fetch_fsmap finished waiting for FSMap version 98 2024-01-22T05:13:49.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb0601b8740 10 client.7905 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-22T05:13:49.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb0601b8740 20 client.7905 populate_metadata read hostname 'smithi049' 2024-01-22T05:13:49.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb0601b8740 1 --2- 172.21.15.49:0/835618889 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1f81620 0x1f81a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb0601b8740 4 client.7905 mds_command: new command op to 7743 tid=0[{"prefix": "status"}] 2024-01-22T05:13:49.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb0601b8740 1 -- 172.21.15.49:0/835618889 --> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1d624e0 con 0x1f81620 2024-01-22T05:13:49.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb04e000700 1 --2- 172.21.15.49:0/835618889 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1f81620 0x1f81a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb04e000700 1 --2- 172.21.15.49:0/835618889 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1f81620 0x1f81a00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=32d2b097814549b9 server_cookie=fcdffa1535bb203d in_seq=0 out_seq=0 2024-01-22T05:13:49.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb037400700 10 client.7905 ms_handle_connect on v2:172.21.15.110:6832/1348218223 2024-01-22T05:13:49.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb037400700 1 -- 172.21.15.49:0/835618889 <== mds.0 v2:172.21.15.110:6832/1348218223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x1d624e0 con 0x1f81620 2024-01-22T05:13:49.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb037400700 10 client.7905 handle_command_reply: tid=0 2024-01-22T05:13:49.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb0601b8740 1 client.7905 shutdown 2024-01-22T05:13:49.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb0601b8740 1 -- 172.21.15.49:0/835618889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2de40 msgr2=0x1f2b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:49.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb0601b8740 1 --2- 172.21.15.49:0/835618889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2de40 0x1f2b8f0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fb040022ad0 tx=0x7fb04002b000).stop 2024-01-22T05:13:49.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb0601b8740 1 -- 172.21.15.49:0/835618889 shutdown_connections 2024-01-22T05:13:49.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb0601b8740 1 --2- 172.21.15.49:0/835618889 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1f81620 0x1f81a00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb0601b8740 1 --2- 172.21.15.49:0/835618889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f6e780 0x1f514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb0601b8740 1 --2- 172.21.15.49:0/835618889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f6e3a0 0x1fd4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb0601b8740 1 --2- 172.21.15.49:0/835618889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f2de40 0x1f2b8f0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb037400700 0 client.7905 ms_handle_reset on v2:172.21.15.110:6832/1348218223 2024-01-22T05:13:49.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.048+0000 7fb0601b8740 1 -- 172.21.15.49:0/835618889 >> 172.21.15.49:0/835618889 conn(0x1d0b550 msgr2=0x1f549c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:49.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.052+0000 7fb0601b8740 1 -- 172.21.15.49:0/835618889 shutdown_connections 2024-01-22T05:13:49.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.052+0000 7fb0601b8740 1 -- 172.21.15.49:0/835618889 wait complete. 2024-01-22T05:13:49.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.052+0000 7fb0601b8740 20 client.7905 trim_cache size 0 max 16384 2024-01-22T05:13:49.053 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:13:49.053 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:13:49.054 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:13:49.054 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 7743, 2024-01-22T05:13:49.054 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:13:49.054 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:13:49.054 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:13:49.054 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 11.056531026, 2024-01-22T05:13:49.054 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 98, 2024-01-22T05:13:49.054 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 117, 2024-01-22T05:13:49.054 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 117, 2024-01-22T05:13:49.054 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 16.443701377 2024-01-22T05:13:49.054 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:13:49.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.052+0000 7fb055e00700 1 -- 172.21.15.49:0/2606867008 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb02805a4e0 msgr2=0x7fb02805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:49.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.052+0000 7fb055e00700 1 --2- 172.21.15.49:0/2606867008 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb02805a4e0 0x7fb02805c9a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fb040009c30 tx=0x7fb040009060).stop 2024-01-22T05:13:49.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.052+0000 7fb055e00700 1 -- 172.21.15.49:0/2606867008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb050155d20 msgr2=0x7fb0500be520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:49.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.052+0000 7fb055e00700 1 --2- 172.21.15.49:0/2606867008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb050155d20 0x7fb0500be520 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fb04800c790 tx=0x7fb0480015e0).stop 2024-01-22T05:13:49.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.052+0000 7fb055e00700 1 -- 172.21.15.49:0/2606867008 shutdown_connections 2024-01-22T05:13:49.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.052+0000 7fb055e00700 1 --2- 172.21.15.49:0/2606867008 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb02805a4e0 0x7fb02805c9a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.052+0000 7fb055e00700 1 --2- 172.21.15.49:0/2606867008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb050155d20 0x7fb0500be520 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.052+0000 7fb055e00700 1 --2- 172.21.15.49:0/2606867008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0500a8c30 0x7fb0500bf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.052+0000 7fb055e00700 1 --2- 172.21.15.49:0/2606867008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb050066070 0x7fb050152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.052+0000 7fb055e00700 1 -- 172.21.15.49:0/2606867008 >> 172.21.15.49:0/2606867008 conn(0x7fb0500c6540 msgr2=0x7fb05015c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.052+0000 7fb055e00700 1 -- 172.21.15.49:0/2606867008 shutdown_connections 2024-01-22T05:13:49.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.052+0000 7fb055e00700 1 -- 172.21.15.49:0/2606867008 wait complete. 2024-01-22T05:13:49.078 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:13:49.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.212+0000 7f76ff200700 1 Processor -- start 2024-01-22T05:13:49.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.216+0000 7f76ff200700 1 -- start start 2024-01-22T05:13:49.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.216+0000 7f76ff200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77000c3790 0x7f77000c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.216+0000 7f76ff200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7700155f30 con 0x7f7700151990 2024-01-22T05:13:49.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.216+0000 7f76ff200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77000c40e0 con 0x7f7700064860 2024-01-22T05:13:49.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.216+0000 7f76ff200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7700063c90 con 0x7f77000c3790 2024-01-22T05:13:49.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.216+0000 7f76fde00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7700151990 0x7f7700065fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37226/0 (socket says 172.21.15.49:37226) 2024-01-22T05:13:49.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.216+0000 7f76fde00700 1 -- 172.21.15.49:0/610376764 learned_addr learned my addr 172.21.15.49:0/610376764 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:13:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.216+0000 7f76fd400700 1 --2- 172.21.15.49:0/610376764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77000c3790 0x7f77000c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.220+0000 7f76fca00700 1 -- 172.21.15.49:0/610376764 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490245819 0 0) 0x7f7700155f30 con 0x7f7700151990 2024-01-22T05:13:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.220+0000 7f76fd400700 1 -- 172.21.15.49:0/610376764 >> v1:172.21.15.110:6789/0 conn(0x7f7700064860 legacy=0x7f7700064cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.220+0000 7f76fd400700 1 -- 172.21.15.49:0/610376764 >> v1:172.21.15.49:6789/0 conn(0x7f7700151990 legacy=0x7f7700065fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:49.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.220+0000 7f76fd400700 1 -- 172.21.15.49:0/610376764 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7700155600 con 0x7f77000c3790 2024-01-22T05:13:49.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.220+0000 7f76fd400700 1 --2- 172.21.15.49:0/610376764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77000c3790 0x7f77000c3bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f76e8009710 tx=0x7f76e8009060).ready entity=mon.2 client_cookie=fde219f016a56794 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:49.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.220+0000 7f76fca00700 1 -- 172.21.15.49:0/610376764 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8009130 con 0x7f77000c3790 2024-01-22T05:13:49.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.220+0000 7f76fca00700 1 -- 172.21.15.49:0/610376764 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e800f510 con 0x7f77000c3790 2024-01-22T05:13:49.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.220+0000 7f76fca00700 1 -- 172.21.15.49:0/610376764 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e800f890 con 0x7f77000c3790 2024-01-22T05:13:49.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.220+0000 7f76ff200700 1 -- 172.21.15.49:0/610376764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77000c3790 msgr2=0x7f77000c3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:49.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.220+0000 7f76ff200700 1 --2- 172.21.15.49:0/610376764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77000c3790 0x7f77000c3bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f76e8009710 tx=0x7f76e8009060).stop 2024-01-22T05:13:49.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.220+0000 7f76ff200700 1 -- 172.21.15.49:0/610376764 shutdown_connections 2024-01-22T05:13:49.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.220+0000 7f76ff200700 1 --2- 172.21.15.49:0/610376764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77000c3790 0x7f77000c3bf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.220+0000 7f76ff200700 1 -- 172.21.15.49:0/610376764 >> 172.21.15.49:0/610376764 conn(0x7f77000c70b0 msgr2=0x7f77000c3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:49.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.224+0000 7f76ff200700 1 -- 172.21.15.49:0/610376764 shutdown_connections 2024-01-22T05:13:49.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.224+0000 7f76ff200700 1 -- 172.21.15.49:0/610376764 wait complete. 2024-01-22T05:13:49.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.224+0000 7f76ff200700 1 Processor -- start 2024-01-22T05:13:49.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.224+0000 7f76ff200700 1 -- start start 2024-01-22T05:13:49.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76ff200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7700064860 0x7f770014cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76ff200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77000c3790 0x7f77000c1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76ff200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7700151990 0x7f77001563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76ff200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770014d780 con 0x7f7700064860 2024-01-22T05:13:49.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76ff200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77000bcff0 con 0x7f7700151990 2024-01-22T05:13:49.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76ff200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77000bd890 con 0x7f77000c3790 2024-01-22T05:13:49.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76fde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7700064860 0x7f770014cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76fde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7700064860 0x7f770014cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55716/0 (socket says 172.21.15.49:55716) 2024-01-22T05:13:49.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76fde00700 1 -- 172.21.15.49:0/190056443 learned_addr learned my addr 172.21.15.49:0/190056443 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:13:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76fd400700 1 --2- 172.21.15.49:0/190056443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77000c3790 0x7f77000c1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76fe800700 1 --2- 172.21.15.49:0/190056443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7700151990 0x7f77001563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76fde00700 1 -- 172.21.15.49:0/190056443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77000c3790 msgr2=0x7f77000c1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76fde00700 1 --2- 172.21.15.49:0/190056443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77000c3790 0x7f77000c1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76fde00700 1 -- 172.21.15.49:0/190056443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7700151990 msgr2=0x7f77001563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76fde00700 1 --2- 172.21.15.49:0/190056443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7700151990 0x7f77001563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76fde00700 1 -- 172.21.15.49:0/190056443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e80092a0 con 0x7f7700064860 2024-01-22T05:13:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76fd400700 1 --2- 172.21.15.49:0/190056443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77000c3790 0x7f77000c1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:13:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76fde00700 1 --2- 172.21.15.49:0/190056443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7700064860 0x7f770014cef0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f76f000c4c0 tx=0x7f76f0007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76f5600700 1 -- 172.21.15.49:0/190056443 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f000ce30 con 0x7f7700064860 2024-01-22T05:13:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76f5600700 1 -- 172.21.15.49:0/190056443 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f00072e0 con 0x7f7700064860 2024-01-22T05:13:49.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76ff200700 1 -- 172.21.15.49:0/190056443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77000c2490 con 0x7f7700064860 2024-01-22T05:13:49.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76f5600700 1 -- 172.21.15.49:0/190056443 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f00057a0 con 0x7f7700064860 2024-01-22T05:13:49.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.228+0000 7f76ff200700 1 -- 172.21.15.49:0/190056443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77000c2760 con 0x7f7700064860 2024-01-22T05:13:49.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.232+0000 7f76ff200700 1 -- 172.21.15.49:0/190056443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77000c7530 con 0x7f7700064860 2024-01-22T05:13:49.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.232+0000 7f76f5600700 1 -- 172.21.15.49:0/190056443 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f76f0005bd0 con 0x7f7700064860 2024-01-22T05:13:49.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.232+0000 7f76f5600700 1 --2- 172.21.15.49:0/190056443 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f76d805a510 0x7f76d805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:13:49.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.232+0000 7f76f5600700 1 -- 172.21.15.49:0/190056443 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f76f0073fb0 con 0x7f7700064860 2024-01-22T05:13:49.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.232+0000 7f76fd400700 1 --2- 172.21.15.49:0/190056443 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f76d805a510 0x7f76d805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:13:49.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.236+0000 7f76fd400700 1 --2- 172.21.15.49:0/190056443 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f76d805a510 0x7f76d805c9d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f76e8006d30 tx=0x7f76e8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:13:49.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.240+0000 7f76f5600700 1 -- 172.21.15.49:0/190056443 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f77000c7530 con 0x7f7700064860 2024-01-22T05:13:49.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.448+0000 7f76ff200700 1 -- 172.21.15.49:0/190056443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f77000c7530 con 0x7f7700064860 2024-01-22T05:13:49.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.448+0000 7f76f5600700 1 -- 172.21.15.49:0/190056443 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v98) v1 ==== 53+0+73 (secure 0 0 0) 0x7f77000c7530 con 0x7f7700064860 2024-01-22T05:13:49.448 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:13:49.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.452+0000 7f76ff200700 1 -- 172.21.15.49:0/190056443 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f76d805a510 msgr2=0x7f76d805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:49.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.452+0000 7f76ff200700 1 --2- 172.21.15.49:0/190056443 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f76d805a510 0x7f76d805c9d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f76e8006d30 tx=0x7f76e8015000).stop 2024-01-22T05:13:49.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.452+0000 7f76ff200700 1 -- 172.21.15.49:0/190056443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7700064860 msgr2=0x7f770014cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:13:49.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.452+0000 7f76ff200700 1 --2- 172.21.15.49:0/190056443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7700064860 0x7f770014cef0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f76f000c4c0 tx=0x7f76f0007e40).stop 2024-01-22T05:13:49.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.452+0000 7f76ff200700 1 -- 172.21.15.49:0/190056443 shutdown_connections 2024-01-22T05:13:49.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.452+0000 7f76ff200700 1 --2- 172.21.15.49:0/190056443 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f76d805a510 0x7f76d805c9d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.452+0000 7f76ff200700 1 --2- 172.21.15.49:0/190056443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7700151990 0x7f77001563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.452+0000 7f76ff200700 1 --2- 172.21.15.49:0/190056443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77000c3790 0x7f77000c1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.452+0000 7f76ff200700 1 --2- 172.21.15.49:0/190056443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7700064860 0x7f770014cef0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:13:49.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.452+0000 7f76ff200700 1 -- 172.21.15.49:0/190056443 >> 172.21.15.49:0/190056443 conn(0x7f77000c70b0 msgr2=0x7f770014e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:13:49.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.452+0000 7f76ff200700 1 -- 172.21.15.49:0/190056443 shutdown_connections 2024-01-22T05:13:49.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:13:49.452+0000 7f76ff200700 1 -- 172.21.15.49:0/190056443 wait complete. 2024-01-22T05:13:49.473 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-22T05:13:49.473 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:13:49.473 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:13:49.473 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:13:49.473 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:13:49.473 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-22T05:13:49.473 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-22T05:13:49.474 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:13:49.474 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:13:49.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:13:49.474 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:13:49.496 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:13:49.496 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:13:49.496 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:13:49.496 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:13:49.496 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:13:49.496 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:13:49.496 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:13:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:13:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:13:49.497 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:13:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:13:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:13:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:13:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41941sec preferred_lft 41941sec 2024-01-22T05:13:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:13:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:13:49.497 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:13:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:13:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:13:49.498 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:13:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:13:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:13:49.498 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:13:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:13:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:13:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:13:49.498 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:13:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:13:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:13:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:13:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::7ce7:e3ff:fed1:1e88/64 scope link 2024-01-22T05:13:49.499 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:13:49.499 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:13:49.499 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 82:c1:48:e7:c7:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:13:49.499 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::80c1:48ff:fee7:c731/64 scope link 2024-01-22T05:13:49.499 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:13:49.499 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:13:49.499 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:13:49.499 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3426:32ff:feee:c4c9/64 scope link 2024-01-22T05:13:49.499 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:13:49.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:13:49.500 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:13:49.578 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:13:49.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:13:49.581 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:13:49.646 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:13:49.646 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:13:49.646 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:13:49.646 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:13:49.646 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:13:49.646 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:13:49.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:13:49.647 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:13:49.647 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:49.647 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:13:49.647 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:13:49.647 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:13:49.647 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:49.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:13:49.787 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:13:49.805 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:13:49.805 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:13:49.806 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:13:49.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:13:49.807 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-22T05:13:49.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:13:49.887 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-22T05:13:49.945 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:13:49.946 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:13:50.061 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:13:50.061 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:13:50.082 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:13:50.082 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:13:50.087 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:13:50.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:13:50.087 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:13:50.119 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-01-22T05:13:50.119 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2024-01-22T05:13:50.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:50.119 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:13:50.119 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:50.119 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.0 2024-01-22T05:13:50.119 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:13:50.119 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:13:50.119 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:13:50.120 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.250 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.251 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0374457 s, 28.0 MB/s 2024-01-22T05:13:50.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.282 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283226 s, 37.0 MB/s 2024-01-22T05:13:50.306 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.306 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.307 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214907 s, 48.8 MB/s 2024-01-22T05:13:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225866 s, 46.4 MB/s 2024-01-22T05:13:50.372 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.372 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.372 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03545 s, 29.6 MB/s 2024-01-22T05:13:50.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.412 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0352237 s, 29.8 MB/s 2024-01-22T05:13:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282971 s, 37.1 MB/s 2024-01-22T05:13:50.484 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.484 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.484 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345778 s, 30.3 MB/s 2024-01-22T05:13:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023207 s, 45.2 MB/s 2024-01-22T05:13:50.554 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.554 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.554 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.038124 s, 27.5 MB/s 2024-01-22T05:13:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.576 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194852 s, 53.8 MB/s 2024-01-22T05:13:50.613 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.613 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.613 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324679 s, 32.3 MB/s 2024-01-22T05:13:50.647 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.647 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.647 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290389 s, 36.1 MB/s 2024-01-22T05:13:50.678 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.678 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.678 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270971 s, 38.7 MB/s 2024-01-22T05:13:50.711 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.711 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.711 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294041 s, 35.7 MB/s 2024-01-22T05:13:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215723 s, 48.6 MB/s 2024-01-22T05:13:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.775 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0354939 s, 29.5 MB/s 2024-01-22T05:13:50.809 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.809 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.809 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296658 s, 35.3 MB/s 2024-01-22T05:13:50.845 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.845 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.845 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329125 s, 31.9 MB/s 2024-01-22T05:13:50.871 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.871 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.871 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227391 s, 46.1 MB/s 2024-01-22T05:13:50.905 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.905 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.905 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303388 s, 34.6 MB/s 2024-01-22T05:13:50.932 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.932 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.932 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215934 s, 48.6 MB/s 2024-01-22T05:13:50.955 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.955 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.955 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203897 s, 51.4 MB/s 2024-01-22T05:13:50.990 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:50.990 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:50.990 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030403 s, 34.5 MB/s 2024-01-22T05:13:51.030 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.031 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.031 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0376628 s, 27.8 MB/s 2024-01-22T05:13:51.066 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.066 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.067 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322499 s, 32.5 MB/s 2024-01-22T05:13:51.102 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329588 s, 31.8 MB/s 2024-01-22T05:13:51.138 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.138 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.138 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318222 s, 33.0 MB/s 2024-01-22T05:13:51.167 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.167 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.167 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024233 s, 43.3 MB/s 2024-01-22T05:13:51.198 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.198 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.198 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026262 s, 39.9 MB/s 2024-01-22T05:13:51.229 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.229 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.230 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282157 s, 37.2 MB/s 2024-01-22T05:13:51.261 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.261 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.261 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265744 s, 39.5 MB/s 2024-01-22T05:13:51.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:51.263 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:13:51.263 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:51.263 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.1 2024-01-22T05:13:51.264 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:13:51.264 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:13:51.264 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:13:51.264 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:51.321 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.321 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.321 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281171 s, 37.3 MB/s 2024-01-22T05:13:51.352 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.352 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.353 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265715 s, 39.5 MB/s 2024-01-22T05:13:51.381 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.381 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.382 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257183 s, 40.8 MB/s 2024-01-22T05:13:51.413 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.413 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.413 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277425 s, 37.8 MB/s 2024-01-22T05:13:51.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.446 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028968 s, 36.2 MB/s 2024-01-22T05:13:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237926 s, 44.1 MB/s 2024-01-22T05:13:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312606 s, 33.5 MB/s 2024-01-22T05:13:51.542 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.542 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.542 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291435 s, 36.0 MB/s 2024-01-22T05:13:51.572 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.572 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.572 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256735 s, 40.8 MB/s 2024-01-22T05:13:51.602 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.603 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.603 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264858 s, 39.6 MB/s 2024-01-22T05:13:51.634 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.634 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.634 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273398 s, 38.4 MB/s 2024-01-22T05:13:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253425 s, 41.4 MB/s 2024-01-22T05:13:51.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.690 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239303 s, 43.8 MB/s 2024-01-22T05:13:51.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.735 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0413387 s, 25.4 MB/s 2024-01-22T05:13:51.763 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.763 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.763 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233004 s, 45.0 MB/s 2024-01-22T05:13:51.784 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.784 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.784 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187792 s, 55.8 MB/s 2024-01-22T05:13:51.820 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.820 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.820 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322144 s, 32.5 MB/s 2024-01-22T05:13:51.850 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.850 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.850 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258673 s, 40.5 MB/s 2024-01-22T05:13:51.877 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.877 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.877 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223508 s, 46.9 MB/s 2024-01-22T05:13:51.909 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.909 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.909 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269159 s, 39.0 MB/s 2024-01-22T05:13:51.939 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.939 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.939 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265921 s, 39.4 MB/s 2024-01-22T05:13:51.972 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:51.972 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:51.972 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294681 s, 35.6 MB/s 2024-01-22T05:13:52.011 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.012 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.012 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0350593 s, 29.9 MB/s 2024-01-22T05:13:52.042 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.042 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.042 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255843 s, 41.0 MB/s 2024-01-22T05:13:52.078 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.078 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.078 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330712 s, 31.7 MB/s 2024-01-22T05:13:52.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.107 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246522 s, 42.5 MB/s 2024-01-22T05:13:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265342 s, 39.5 MB/s 2024-01-22T05:13:52.169 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.169 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.170 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285737 s, 36.7 MB/s 2024-01-22T05:13:52.200 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.200 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.200 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255229 s, 41.1 MB/s 2024-01-22T05:13:52.235 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.235 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.235 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308324 s, 34.0 MB/s 2024-01-22T05:13:52.270 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.270 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.270 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325305 s, 32.2 MB/s 2024-01-22T05:13:52.301 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.301 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.301 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269416 s, 38.9 MB/s 2024-01-22T05:13:52.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:52.303 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:13:52.303 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:52.304 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.2 2024-01-22T05:13:52.304 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:13:52.304 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:13:52.304 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:13:52.304 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226421 s, 46.3 MB/s 2024-01-22T05:13:52.382 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.383 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.383 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243412 s, 43.1 MB/s 2024-01-22T05:13:52.420 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.420 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.420 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322465 s, 32.5 MB/s 2024-01-22T05:13:52.455 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.455 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.455 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314623 s, 33.3 MB/s 2024-01-22T05:13:52.485 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.486 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.486 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263812 s, 39.7 MB/s 2024-01-22T05:13:52.513 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.514 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.514 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251101 s, 41.8 MB/s 2024-01-22T05:13:52.538 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.538 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.538 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021718 s, 48.3 MB/s 2024-01-22T05:13:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326319 s, 32.1 MB/s 2024-01-22T05:13:52.601 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.601 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.601 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022628 s, 46.3 MB/s 2024-01-22T05:13:52.639 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.640 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345749 s, 30.3 MB/s 2024-01-22T05:13:52.670 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.670 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.670 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259379 s, 40.4 MB/s 2024-01-22T05:13:52.708 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.708 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.708 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338307 s, 31.0 MB/s 2024-01-22T05:13:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281399 s, 37.3 MB/s 2024-01-22T05:13:52.764 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.764 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.764 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217018 s, 48.3 MB/s 2024-01-22T05:13:52.798 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.798 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.798 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304106 s, 34.5 MB/s 2024-01-22T05:13:52.829 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.829 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.829 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262527 s, 39.9 MB/s 2024-01-22T05:13:52.858 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.858 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.858 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249382 s, 42.0 MB/s 2024-01-22T05:13:52.895 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.895 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.895 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0335484 s, 31.3 MB/s 2024-01-22T05:13:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281115 s, 37.3 MB/s 2024-01-22T05:13:52.959 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.959 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.959 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278531 s, 37.6 MB/s 2024-01-22T05:13:52.988 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:52.988 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:52.988 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241795 s, 43.4 MB/s 2024-01-22T05:13:53.030 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.030 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.030 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0379697 s, 27.6 MB/s 2024-01-22T05:13:53.063 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.063 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.064 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289772 s, 36.2 MB/s 2024-01-22T05:13:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.097 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.098 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310033 s, 33.8 MB/s 2024-01-22T05:13:53.123 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.123 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.123 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221006 s, 47.4 MB/s 2024-01-22T05:13:53.149 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.149 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.149 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224561 s, 46.7 MB/s 2024-01-22T05:13:53.183 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.184 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302913 s, 34.6 MB/s 2024-01-22T05:13:53.216 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.216 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.216 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313133 s, 33.5 MB/s 2024-01-22T05:13:53.247 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.247 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.248 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258139 s, 40.6 MB/s 2024-01-22T05:13:53.279 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.279 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.279 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269719 s, 38.9 MB/s 2024-01-22T05:13:53.307 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.307 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.307 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246255 s, 42.6 MB/s 2024-01-22T05:13:53.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.348 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0367783 s, 28.5 MB/s 2024-01-22T05:13:53.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:53.350 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:13:53.351 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:53.351 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.3 2024-01-22T05:13:53.351 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:13:53.351 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:13:53.351 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:13:53.351 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:53.417 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.417 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.417 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322692 s, 32.5 MB/s 2024-01-22T05:13:53.444 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.444 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.444 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227053 s, 46.2 MB/s 2024-01-22T05:13:53.476 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.476 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.476 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276477 s, 37.9 MB/s 2024-01-22T05:13:53.508 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.508 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.508 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275822 s, 38.0 MB/s 2024-01-22T05:13:53.544 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.544 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.544 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323192 s, 32.4 MB/s 2024-01-22T05:13:53.574 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.574 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.574 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263856 s, 39.7 MB/s 2024-01-22T05:13:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249412 s, 42.0 MB/s 2024-01-22T05:13:53.630 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.630 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.630 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243332 s, 43.1 MB/s 2024-01-22T05:13:53.656 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.656 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.656 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230636 s, 45.5 MB/s 2024-01-22T05:13:53.680 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.681 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.681 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213131 s, 49.2 MB/s 2024-01-22T05:13:53.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.705 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216389 s, 48.5 MB/s 2024-01-22T05:13:53.739 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.740 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.740 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315358 s, 33.3 MB/s 2024-01-22T05:13:53.774 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.774 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.774 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305851 s, 34.3 MB/s 2024-01-22T05:13:53.803 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.803 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.803 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243488 s, 43.1 MB/s 2024-01-22T05:13:53.830 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.830 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.830 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222889 s, 47.0 MB/s 2024-01-22T05:13:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237803 s, 44.1 MB/s 2024-01-22T05:13:53.886 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251358 s, 41.7 MB/s 2024-01-22T05:13:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.918 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283066 s, 37.0 MB/s 2024-01-22T05:13:53.951 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.951 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302572 s, 34.7 MB/s 2024-01-22T05:13:53.977 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:53.977 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224318 s, 46.7 MB/s 2024-01-22T05:13:54.008 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.009 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.009 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266627 s, 39.3 MB/s 2024-01-22T05:13:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294792 s, 35.6 MB/s 2024-01-22T05:13:54.066 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.067 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.067 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215662 s, 48.6 MB/s 2024-01-22T05:13:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.107 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0366273 s, 28.6 MB/s 2024-01-22T05:13:54.141 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.141 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.141 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302826 s, 34.6 MB/s 2024-01-22T05:13:54.181 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.181 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.181 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0354161 s, 29.6 MB/s 2024-01-22T05:13:54.215 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.215 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.215 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301484 s, 34.8 MB/s 2024-01-22T05:13:54.248 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.249 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.249 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292001 s, 35.9 MB/s 2024-01-22T05:13:54.278 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.278 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.278 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241907 s, 43.3 MB/s 2024-01-22T05:13:54.313 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.313 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.313 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307293 s, 34.1 MB/s 2024-01-22T05:13:54.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.349 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032085 s, 32.7 MB/s 2024-01-22T05:13:54.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.380 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278339 s, 37.7 MB/s 2024-01-22T05:13:54.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:54.382 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:13:54.382 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:54.382 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.4 2024-01-22T05:13:54.382 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:13:54.382 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:13:54.382 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:13:54.382 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:54.439 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.440 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.440 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248506 s, 42.2 MB/s 2024-01-22T05:13:54.471 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.472 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.472 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287299 s, 36.5 MB/s 2024-01-22T05:13:54.505 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.505 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.505 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293984 s, 35.7 MB/s 2024-01-22T05:13:54.545 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.545 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.545 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0358071 s, 29.3 MB/s 2024-01-22T05:13:54.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.575 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263897 s, 39.7 MB/s 2024-01-22T05:13:54.602 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.602 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.602 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242089 s, 43.3 MB/s 2024-01-22T05:13:54.630 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.630 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.630 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242343 s, 43.3 MB/s 2024-01-22T05:13:54.660 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.660 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.660 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261525 s, 40.1 MB/s 2024-01-22T05:13:54.687 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.687 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.687 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023613 s, 44.4 MB/s 2024-01-22T05:13:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0379605 s, 27.6 MB/s 2024-01-22T05:13:54.763 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.763 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.763 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294724 s, 35.6 MB/s 2024-01-22T05:13:54.796 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.796 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.796 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280941 s, 37.3 MB/s 2024-01-22T05:13:54.831 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.831 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.831 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309302 s, 33.9 MB/s 2024-01-22T05:13:54.860 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.860 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.860 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248094 s, 42.3 MB/s 2024-01-22T05:13:54.900 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.901 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.901 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0360334 s, 29.1 MB/s 2024-01-22T05:13:54.932 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.932 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.932 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282387 s, 37.1 MB/s 2024-01-22T05:13:54.958 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.958 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.958 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229438 s, 45.7 MB/s 2024-01-22T05:13:54.993 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:54.993 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:54.993 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309245 s, 33.9 MB/s 2024-01-22T05:13:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245332 s, 42.7 MB/s 2024-01-22T05:13:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226488 s, 46.3 MB/s 2024-01-22T05:13:55.083 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.083 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.084 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325497 s, 32.2 MB/s 2024-01-22T05:13:55.110 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.110 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.110 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228766 s, 45.8 MB/s 2024-01-22T05:13:55.146 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.146 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.146 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333448 s, 31.4 MB/s 2024-01-22T05:13:55.172 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.172 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.172 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233829 s, 44.8 MB/s 2024-01-22T05:13:55.217 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.218 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.218 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0410483 s, 25.5 MB/s 2024-01-22T05:13:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.251 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301198 s, 34.8 MB/s 2024-01-22T05:13:55.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.282 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026304 s, 39.9 MB/s 2024-01-22T05:13:55.316 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.316 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.316 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301019 s, 34.8 MB/s 2024-01-22T05:13:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.350 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287083 s, 36.5 MB/s 2024-01-22T05:13:55.377 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.377 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.377 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227771 s, 46.0 MB/s 2024-01-22T05:13:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.405 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.405 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242161 s, 43.3 MB/s 2024-01-22T05:13:55.432 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.432 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.432 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239114 s, 43.9 MB/s 2024-01-22T05:13:55.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:55.433 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:13:55.434 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:55.434 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.5 2024-01-22T05:13:55.434 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:13:55.434 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:13:55.434 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:13:55.434 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:55.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.490 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.490 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269461 s, 38.9 MB/s 2024-01-22T05:13:55.518 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.518 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.518 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247265 s, 42.4 MB/s 2024-01-22T05:13:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277471 s, 37.8 MB/s 2024-01-22T05:13:55.584 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.584 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.584 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310554 s, 33.8 MB/s 2024-01-22T05:13:55.608 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.608 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.608 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211691 s, 49.5 MB/s 2024-01-22T05:13:55.637 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.637 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.637 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026286 s, 39.9 MB/s 2024-01-22T05:13:55.665 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.665 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.665 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241119 s, 43.5 MB/s 2024-01-22T05:13:55.698 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.698 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.698 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285549 s, 36.7 MB/s 2024-01-22T05:13:55.723 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.724 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.724 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217348 s, 48.2 MB/s 2024-01-22T05:13:55.750 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.750 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.750 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222746 s, 47.1 MB/s 2024-01-22T05:13:55.778 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.778 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.779 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245164 s, 42.8 MB/s 2024-01-22T05:13:55.810 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.810 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.810 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277223 s, 37.8 MB/s 2024-01-22T05:13:55.842 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.842 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.842 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276473 s, 37.9 MB/s 2024-01-22T05:13:55.867 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.867 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.867 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217908 s, 48.1 MB/s 2024-01-22T05:13:55.894 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024126 s, 43.5 MB/s 2024-01-22T05:13:55.930 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.930 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.930 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313058 s, 33.5 MB/s 2024-01-22T05:13:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260394 s, 40.3 MB/s 2024-01-22T05:13:55.994 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:55.994 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:55.994 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296895 s, 35.3 MB/s 2024-01-22T05:13:56.025 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.025 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.025 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264317 s, 39.7 MB/s 2024-01-22T05:13:56.054 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.055 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.055 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253414 s, 41.4 MB/s 2024-01-22T05:13:56.076 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.077 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.077 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196787 s, 53.3 MB/s 2024-01-22T05:13:56.102 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.102 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.102 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217542 s, 48.2 MB/s 2024-01-22T05:13:56.134 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.134 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.134 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273711 s, 38.3 MB/s 2024-01-22T05:13:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284992 s, 36.8 MB/s 2024-01-22T05:13:56.197 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.197 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.197 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255963 s, 41.0 MB/s 2024-01-22T05:13:56.227 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.227 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.227 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255187 s, 41.1 MB/s 2024-01-22T05:13:56.254 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.254 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.254 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247573 s, 42.4 MB/s 2024-01-22T05:13:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.287 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.287 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288803 s, 36.3 MB/s 2024-01-22T05:13:56.320 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.320 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.321 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293078 s, 35.8 MB/s 2024-01-22T05:13:56.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.351 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026951 s, 38.9 MB/s 2024-01-22T05:13:56.376 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.376 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.376 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215825 s, 48.6 MB/s 2024-01-22T05:13:56.411 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.411 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.411 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314729 s, 33.3 MB/s 2024-01-22T05:13:56.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:56.413 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:13:56.414 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:56.414 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.6 2024-01-22T05:13:56.414 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:13:56.414 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:13:56.414 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:13:56.414 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:56.475 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.475 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.475 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275467 s, 38.1 MB/s 2024-01-22T05:13:56.505 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.505 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.505 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264443 s, 39.7 MB/s 2024-01-22T05:13:56.543 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.543 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.543 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0335295 s, 31.3 MB/s 2024-01-22T05:13:56.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.575 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283354 s, 37.0 MB/s 2024-01-22T05:13:56.609 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.610 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.610 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301621 s, 34.8 MB/s 2024-01-22T05:13:56.644 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.644 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.644 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300003 s, 35.0 MB/s 2024-01-22T05:13:56.670 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.670 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.670 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230675 s, 45.5 MB/s 2024-01-22T05:13:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.696 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.696 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221073 s, 47.4 MB/s 2024-01-22T05:13:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236002 s, 44.4 MB/s 2024-01-22T05:13:56.759 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.759 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.759 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333081 s, 31.5 MB/s 2024-01-22T05:13:56.790 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.790 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.790 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265682 s, 39.5 MB/s 2024-01-22T05:13:56.818 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.818 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.818 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247656 s, 42.3 MB/s 2024-01-22T05:13:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249729 s, 42.0 MB/s 2024-01-22T05:13:56.873 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.873 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.873 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237644 s, 44.1 MB/s 2024-01-22T05:13:56.907 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.907 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.907 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294783 s, 35.6 MB/s 2024-01-22T05:13:56.935 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.935 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.935 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238419 s, 44.0 MB/s 2024-01-22T05:13:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:56.964 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:56.964 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246862 s, 42.5 MB/s 2024-01-22T05:13:57.002 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.002 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.002 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342474 s, 30.6 MB/s 2024-01-22T05:13:57.032 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.032 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.032 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258666 s, 40.5 MB/s 2024-01-22T05:13:57.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.061 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248668 s, 42.2 MB/s 2024-01-22T05:13:57.093 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.093 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.094 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280816 s, 37.3 MB/s 2024-01-22T05:13:57.125 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.125 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.125 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271153 s, 38.7 MB/s 2024-01-22T05:13:57.153 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.154 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.154 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251381 s, 41.7 MB/s 2024-01-22T05:13:57.188 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.189 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.189 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304657 s, 34.4 MB/s 2024-01-22T05:13:57.217 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.217 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.218 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242469 s, 43.2 MB/s 2024-01-22T05:13:57.246 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.246 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.246 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244057 s, 43.0 MB/s 2024-01-22T05:13:57.274 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.274 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.274 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249198 s, 42.1 MB/s 2024-01-22T05:13:57.299 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.299 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.299 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226223 s, 46.4 MB/s 2024-01-22T05:13:57.328 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.328 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.328 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246081 s, 42.6 MB/s 2024-01-22T05:13:57.356 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.357 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.357 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024229 s, 43.3 MB/s 2024-01-22T05:13:57.385 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.385 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.385 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254845 s, 41.1 MB/s 2024-01-22T05:13:57.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.412 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231945 s, 45.2 MB/s 2024-01-22T05:13:57.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:57.414 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:13:57.414 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:57.414 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.7 2024-01-22T05:13:57.414 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:13:57.414 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:13:57.415 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:13:57.415 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:57.481 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.481 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.481 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348088 s, 30.1 MB/s 2024-01-22T05:13:57.508 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.508 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.508 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233542 s, 44.9 MB/s 2024-01-22T05:13:57.536 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.536 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.536 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024966 s, 42.0 MB/s 2024-01-22T05:13:57.565 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.565 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.565 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247723 s, 42.3 MB/s 2024-01-22T05:13:57.601 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.602 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.602 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326165 s, 32.1 MB/s 2024-01-22T05:13:57.639 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.639 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.639 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328889 s, 31.9 MB/s 2024-01-22T05:13:57.675 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.675 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.675 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315712 s, 33.2 MB/s 2024-01-22T05:13:57.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.705 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272666 s, 38.5 MB/s 2024-01-22T05:13:57.739 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.739 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.739 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305527 s, 34.3 MB/s 2024-01-22T05:13:57.781 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.781 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.781 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0378451 s, 27.7 MB/s 2024-01-22T05:13:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.818 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327156 s, 32.1 MB/s 2024-01-22T05:13:57.849 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.849 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.850 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280168 s, 37.4 MB/s 2024-01-22T05:13:57.876 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.876 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.876 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224391 s, 46.7 MB/s 2024-01-22T05:13:57.907 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.907 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.907 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285165 s, 36.8 MB/s 2024-01-22T05:13:57.938 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.938 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.938 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273944 s, 38.3 MB/s 2024-01-22T05:13:57.966 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.966 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.966 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024005 s, 43.7 MB/s 2024-01-22T05:13:57.991 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:57.991 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:57.991 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213278 s, 49.2 MB/s 2024-01-22T05:13:58.017 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.017 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.017 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022228 s, 47.2 MB/s 2024-01-22T05:13:58.050 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.050 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.050 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294322 s, 35.6 MB/s 2024-01-22T05:13:58.081 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.081 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.081 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026619 s, 39.4 MB/s 2024-01-22T05:13:58.109 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.109 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.109 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255767 s, 41.0 MB/s 2024-01-22T05:13:58.138 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.138 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.139 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263077 s, 39.9 MB/s 2024-01-22T05:13:58.165 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.165 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.165 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238738 s, 43.9 MB/s 2024-01-22T05:13:58.199 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.199 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.199 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308788 s, 34.0 MB/s 2024-01-22T05:13:58.244 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.244 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.244 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0405788 s, 25.8 MB/s 2024-01-22T05:13:58.273 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.273 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.273 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246835 s, 42.5 MB/s 2024-01-22T05:13:58.311 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.311 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.311 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328107 s, 32.0 MB/s 2024-01-22T05:13:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242683 s, 43.2 MB/s 2024-01-22T05:13:58.373 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.373 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.373 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303119 s, 34.6 MB/s 2024-01-22T05:13:58.400 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.400 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.400 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235724 s, 44.5 MB/s 2024-01-22T05:13:58.437 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326803 s, 32.1 MB/s 2024-01-22T05:13:58.465 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.465 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.466 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239556 s, 43.8 MB/s 2024-01-22T05:13:58.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:58.468 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:13:58.468 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:58.469 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.8 2024-01-22T05:13:58.469 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:13:58.469 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:13:58.469 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:13:58.469 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:58.526 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.526 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.526 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283572 s, 37.0 MB/s 2024-01-22T05:13:58.555 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.556 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255037 s, 41.1 MB/s 2024-01-22T05:13:58.592 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.592 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.592 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322542 s, 32.5 MB/s 2024-01-22T05:13:58.628 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.629 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.629 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333491 s, 31.4 MB/s 2024-01-22T05:13:58.664 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.664 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.664 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310134 s, 33.8 MB/s 2024-01-22T05:13:58.696 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.696 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.696 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283541 s, 37.0 MB/s 2024-01-22T05:13:58.724 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.724 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.724 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240594 s, 43.6 MB/s 2024-01-22T05:13:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321106 s, 32.7 MB/s 2024-01-22T05:13:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.790 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259381 s, 40.4 MB/s 2024-01-22T05:13:58.817 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.817 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.817 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240411 s, 43.6 MB/s 2024-01-22T05:13:58.846 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.846 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.846 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250107 s, 41.9 MB/s 2024-01-22T05:13:58.879 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.879 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.879 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298862 s, 35.1 MB/s 2024-01-22T05:13:58.905 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.905 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.905 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228177 s, 46.0 MB/s 2024-01-22T05:13:58.935 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.935 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.935 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256271 s, 40.9 MB/s 2024-01-22T05:13:58.963 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.963 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.963 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242243 s, 43.3 MB/s 2024-01-22T05:13:58.992 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:58.992 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:58.992 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249621 s, 42.0 MB/s 2024-01-22T05:13:59.024 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.024 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.024 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273614 s, 38.3 MB/s 2024-01-22T05:13:59.052 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.052 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.052 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241817 s, 43.4 MB/s 2024-01-22T05:13:59.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.085 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290411 s, 36.1 MB/s 2024-01-22T05:13:59.114 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.114 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249951 s, 42.0 MB/s 2024-01-22T05:13:59.145 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.145 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.145 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262722 s, 39.9 MB/s 2024-01-22T05:13:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247413 s, 42.4 MB/s 2024-01-22T05:13:59.200 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.200 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.200 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232868 s, 45.0 MB/s 2024-01-22T05:13:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.230 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257573 s, 40.7 MB/s 2024-01-22T05:13:59.261 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.261 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.261 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274424 s, 38.2 MB/s 2024-01-22T05:13:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288145 s, 36.4 MB/s 2024-01-22T05:13:59.324 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.324 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264826 s, 39.6 MB/s 2024-01-22T05:13:59.353 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.353 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.353 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248805 s, 42.1 MB/s 2024-01-22T05:13:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.384 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.384 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265135 s, 39.5 MB/s 2024-01-22T05:13:59.404 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.404 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.404 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179073 s, 58.6 MB/s 2024-01-22T05:13:59.437 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.437 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.437 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286417 s, 36.6 MB/s 2024-01-22T05:13:59.467 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.467 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.467 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259978 s, 40.3 MB/s 2024-01-22T05:13:59.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:13:59.469 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:13:59.469 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:13:59.469 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.9 2024-01-22T05:13:59.469 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:13:59.469 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:13:59.469 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:13:59.469 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:13:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.528 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024937 s, 42.0 MB/s 2024-01-22T05:13:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024492 s, 42.8 MB/s 2024-01-22T05:13:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244412 s, 42.9 MB/s 2024-01-22T05:13:59.613 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.614 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.614 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251 s, 41.8 MB/s 2024-01-22T05:13:59.644 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.644 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.644 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268461 s, 39.1 MB/s 2024-01-22T05:13:59.674 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.674 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.674 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257381 s, 40.7 MB/s 2024-01-22T05:13:59.708 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.708 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.708 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305629 s, 34.3 MB/s 2024-01-22T05:13:59.742 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.742 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.742 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296566 s, 35.4 MB/s 2024-01-22T05:13:59.779 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.779 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.779 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322973 s, 32.5 MB/s 2024-01-22T05:13:59.807 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.808 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.808 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238063 s, 44.0 MB/s 2024-01-22T05:13:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.842 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030143 s, 34.8 MB/s 2024-01-22T05:13:59.876 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.876 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.876 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030808 s, 34.0 MB/s 2024-01-22T05:13:59.906 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.906 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.906 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254859 s, 41.1 MB/s 2024-01-22T05:13:59.933 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.933 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.933 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022552 s, 46.5 MB/s 2024-01-22T05:13:59.970 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:13:59.970 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:13:59.970 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032731 s, 32.0 MB/s 2024-01-22T05:14:00.003 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.003 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.004 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265074 s, 39.6 MB/s 2024-01-22T05:14:00.025 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.026 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.026 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210652 s, 49.8 MB/s 2024-01-22T05:14:00.054 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.055 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.055 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251947 s, 41.6 MB/s 2024-01-22T05:14:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.081 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223575 s, 46.9 MB/s 2024-01-22T05:14:00.111 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.111 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.111 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266821 s, 39.3 MB/s 2024-01-22T05:14:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024127 s, 43.5 MB/s 2024-01-22T05:14:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247677 s, 42.3 MB/s 2024-01-22T05:14:00.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.202 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312036 s, 33.6 MB/s 2024-01-22T05:14:00.230 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.231 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.231 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255463 s, 41.0 MB/s 2024-01-22T05:14:00.265 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.265 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.265 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030996 s, 33.8 MB/s 2024-01-22T05:14:00.294 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.294 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.294 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238139 s, 44.0 MB/s 2024-01-22T05:14:00.321 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.321 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.321 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243524 s, 43.1 MB/s 2024-01-22T05:14:00.353 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.353 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.353 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288374 s, 36.4 MB/s 2024-01-22T05:14:00.385 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.385 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.385 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267771 s, 39.2 MB/s 2024-01-22T05:14:00.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.412 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232986 s, 45.0 MB/s 2024-01-22T05:14:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256168 s, 40.9 MB/s 2024-01-22T05:14:00.473 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.473 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.473 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276769 s, 37.9 MB/s 2024-01-22T05:14:00.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:00.475 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:00.475 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:00.475 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.10 2024-01-22T05:14:00.475 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:00.476 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:00.476 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:00.476 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.531 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256711 s, 40.8 MB/s 2024-01-22T05:14:00.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.559 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242914 s, 43.2 MB/s 2024-01-22T05:14:00.586 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.586 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.586 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239958 s, 43.7 MB/s 2024-01-22T05:14:00.609 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.610 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.610 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206073 s, 50.9 MB/s 2024-01-22T05:14:00.635 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.636 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.636 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226225 s, 46.4 MB/s 2024-01-22T05:14:00.672 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.672 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.672 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318811 s, 32.9 MB/s 2024-01-22T05:14:00.701 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.701 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.701 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251284 s, 41.7 MB/s 2024-01-22T05:14:00.728 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.728 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.728 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240801 s, 43.5 MB/s 2024-01-22T05:14:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.756 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231914 s, 45.2 MB/s 2024-01-22T05:14:00.788 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.788 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.788 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288547 s, 36.3 MB/s 2024-01-22T05:14:00.822 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.822 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.822 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301079 s, 34.8 MB/s 2024-01-22T05:14:00.852 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.852 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.852 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025443 s, 41.2 MB/s 2024-01-22T05:14:00.886 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.886 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.886 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030395 s, 34.5 MB/s 2024-01-22T05:14:00.916 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.916 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.916 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252571 s, 41.5 MB/s 2024-01-22T05:14:00.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.946 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261475 s, 40.1 MB/s 2024-01-22T05:14:00.981 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:00.981 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:00.981 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307126 s, 34.1 MB/s 2024-01-22T05:14:01.018 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.018 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.018 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322628 s, 32.5 MB/s 2024-01-22T05:14:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306649 s, 34.2 MB/s 2024-01-22T05:14:01.093 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.093 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.093 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.035108 s, 29.9 MB/s 2024-01-22T05:14:01.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.122 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.122 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246699 s, 42.5 MB/s 2024-01-22T05:14:01.153 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.153 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.153 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274906 s, 38.1 MB/s 2024-01-22T05:14:01.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.186 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286708 s, 36.6 MB/s 2024-01-22T05:14:01.222 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.222 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.222 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321391 s, 32.6 MB/s 2024-01-22T05:14:01.251 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.251 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.251 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238824 s, 43.9 MB/s 2024-01-22T05:14:01.277 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.277 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.277 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235547 s, 44.5 MB/s 2024-01-22T05:14:01.306 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.306 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.306 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250889 s, 41.8 MB/s 2024-01-22T05:14:01.334 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.334 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.334 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246547 s, 42.5 MB/s 2024-01-22T05:14:01.367 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.367 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.367 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290565 s, 36.1 MB/s 2024-01-22T05:14:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.395 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235381 s, 44.5 MB/s 2024-01-22T05:14:01.416 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.416 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.416 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187108 s, 56.0 MB/s 2024-01-22T05:14:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267257 s, 39.2 MB/s 2024-01-22T05:14:01.485 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.485 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.485 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034528 s, 30.4 MB/s 2024-01-22T05:14:01.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:01.488 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:01.488 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:01.488 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.11 2024-01-22T05:14:01.488 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:01.488 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:01.488 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:01.489 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:01.547 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.547 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.547 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297303 s, 35.3 MB/s 2024-01-22T05:14:01.576 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.576 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.577 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025953 s, 40.4 MB/s 2024-01-22T05:14:01.613 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.613 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.613 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329315 s, 31.8 MB/s 2024-01-22T05:14:01.645 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.645 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.646 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275794 s, 38.0 MB/s 2024-01-22T05:14:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271295 s, 38.7 MB/s 2024-01-22T05:14:01.702 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.702 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.702 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024201 s, 43.3 MB/s 2024-01-22T05:14:01.733 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.733 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.733 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277029 s, 37.9 MB/s 2024-01-22T05:14:01.774 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.774 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.774 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0363377 s, 28.9 MB/s 2024-01-22T05:14:01.803 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.803 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.803 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254699 s, 41.2 MB/s 2024-01-22T05:14:01.829 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.829 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.830 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234568 s, 44.7 MB/s 2024-01-22T05:14:01.865 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.865 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.865 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321791 s, 32.6 MB/s 2024-01-22T05:14:01.895 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.895 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.895 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02533 s, 41.4 MB/s 2024-01-22T05:14:01.923 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242243 s, 43.3 MB/s 2024-01-22T05:14:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283961 s, 36.9 MB/s 2024-01-22T05:14:01.990 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:01.990 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:01.990 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029056 s, 36.1 MB/s 2024-01-22T05:14:02.018 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.018 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.018 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238834 s, 43.9 MB/s 2024-01-22T05:14:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.045 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235457 s, 44.5 MB/s 2024-01-22T05:14:02.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.073 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025643 s, 40.9 MB/s 2024-01-22T05:14:02.100 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.100 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.101 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231954 s, 45.2 MB/s 2024-01-22T05:14:02.125 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.125 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.125 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212018 s, 49.5 MB/s 2024-01-22T05:14:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215463 s, 48.7 MB/s 2024-01-22T05:14:02.182 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.182 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.182 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290548 s, 36.1 MB/s 2024-01-22T05:14:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.208 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216608 s, 48.4 MB/s 2024-01-22T05:14:02.239 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.239 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.239 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278628 s, 37.6 MB/s 2024-01-22T05:14:02.269 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.269 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.269 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274231 s, 38.2 MB/s 2024-01-22T05:14:02.294 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.294 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.294 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226383 s, 46.3 MB/s 2024-01-22T05:14:02.323 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.324 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.324 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256822 s, 40.8 MB/s 2024-01-22T05:14:02.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.348 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215299 s, 48.7 MB/s 2024-01-22T05:14:02.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.379 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273269 s, 38.4 MB/s 2024-01-22T05:14:02.403 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.403 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.404 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210392 s, 49.8 MB/s 2024-01-22T05:14:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029892 s, 35.1 MB/s 2024-01-22T05:14:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.466 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.466 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238026 s, 44.1 MB/s 2024-01-22T05:14:02.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:02.468 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:02.468 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:02.468 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.12 2024-01-22T05:14:02.468 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:02.468 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:02.468 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:02.468 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:02.531 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.532 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.532 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297295 s, 35.3 MB/s 2024-01-22T05:14:02.562 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.563 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.563 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268161 s, 39.1 MB/s 2024-01-22T05:14:02.596 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.596 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.596 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299131 s, 35.1 MB/s 2024-01-22T05:14:02.628 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.628 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.628 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284606 s, 36.8 MB/s 2024-01-22T05:14:02.656 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.657 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.657 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250217 s, 41.9 MB/s 2024-01-22T05:14:02.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.689 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291982 s, 35.9 MB/s 2024-01-22T05:14:02.716 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.716 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.716 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225001 s, 46.6 MB/s 2024-01-22T05:14:02.755 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.756 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.756 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349282 s, 30.0 MB/s 2024-01-22T05:14:02.785 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.785 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.785 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249211 s, 42.1 MB/s 2024-01-22T05:14:02.814 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.814 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.814 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248999 s, 42.1 MB/s 2024-01-22T05:14:02.842 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.842 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.842 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242167 s, 43.3 MB/s 2024-01-22T05:14:02.872 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.872 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.873 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267408 s, 39.2 MB/s 2024-01-22T05:14:02.910 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.910 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.910 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330005 s, 31.8 MB/s 2024-01-22T05:14:02.940 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.940 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.940 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271611 s, 38.6 MB/s 2024-01-22T05:14:02.971 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.971 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.971 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264819 s, 39.6 MB/s 2024-01-22T05:14:02.995 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:02.995 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:02.995 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218621 s, 48.0 MB/s 2024-01-22T05:14:03.032 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.032 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.032 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327261 s, 32.0 MB/s 2024-01-22T05:14:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329363 s, 31.8 MB/s 2024-01-22T05:14:03.105 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.106 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325127 s, 32.3 MB/s 2024-01-22T05:14:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281236 s, 37.3 MB/s 2024-01-22T05:14:03.163 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.163 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.163 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209594 s, 50.0 MB/s 2024-01-22T05:14:03.189 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.189 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.189 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232944 s, 45.0 MB/s 2024-01-22T05:14:03.213 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.213 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.213 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206809 s, 50.7 MB/s 2024-01-22T05:14:03.239 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.239 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.240 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226723 s, 46.2 MB/s 2024-01-22T05:14:03.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.267 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234596 s, 44.7 MB/s 2024-01-22T05:14:03.297 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.297 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.297 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026584 s, 39.4 MB/s 2024-01-22T05:14:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0364738 s, 28.7 MB/s 2024-01-22T05:14:03.372 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.372 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.372 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304147 s, 34.5 MB/s 2024-01-22T05:14:03.409 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.409 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.409 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322988 s, 32.5 MB/s 2024-01-22T05:14:03.442 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.442 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.442 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028879 s, 36.3 MB/s 2024-01-22T05:14:03.473 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.473 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.473 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262211 s, 40.0 MB/s 2024-01-22T05:14:03.505 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.505 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.505 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288145 s, 36.4 MB/s 2024-01-22T05:14:03.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:03.508 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:03.508 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:03.508 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.13 2024-01-22T05:14:03.508 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:03.508 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:03.509 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:03.509 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281504 s, 37.2 MB/s 2024-01-22T05:14:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.596 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256027 s, 41.0 MB/s 2024-01-22T05:14:03.626 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.626 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.626 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260578 s, 40.2 MB/s 2024-01-22T05:14:03.655 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.655 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.655 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255139 s, 41.1 MB/s 2024-01-22T05:14:03.684 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.684 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.684 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253367 s, 41.4 MB/s 2024-01-22T05:14:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260735 s, 40.2 MB/s 2024-01-22T05:14:03.743 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.744 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.744 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246286 s, 42.6 MB/s 2024-01-22T05:14:03.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.773 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266454 s, 39.4 MB/s 2024-01-22T05:14:03.801 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.801 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.801 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242448 s, 43.2 MB/s 2024-01-22T05:14:03.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.827 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223587 s, 46.9 MB/s 2024-01-22T05:14:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248664 s, 42.2 MB/s 2024-01-22T05:14:03.891 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.891 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.891 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299104 s, 35.1 MB/s 2024-01-22T05:14:03.923 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.923 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.923 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277427 s, 37.8 MB/s 2024-01-22T05:14:03.956 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.957 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.957 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304369 s, 34.5 MB/s 2024-01-22T05:14:03.979 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:03.979 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:03.979 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190879 s, 54.9 MB/s 2024-01-22T05:14:04.003 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.003 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.003 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207191 s, 50.6 MB/s 2024-01-22T05:14:04.035 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.035 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.035 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02972 s, 35.3 MB/s 2024-01-22T05:14:04.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.074 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0357348 s, 29.3 MB/s 2024-01-22T05:14:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270954 s, 38.7 MB/s 2024-01-22T05:14:04.145 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.145 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.145 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03563 s, 29.4 MB/s 2024-01-22T05:14:04.178 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.178 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.178 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293806 s, 35.7 MB/s 2024-01-22T05:14:04.198 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.198 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.198 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185752 s, 56.5 MB/s 2024-01-22T05:14:04.222 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.222 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.222 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209734 s, 50.0 MB/s 2024-01-22T05:14:04.257 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.257 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.257 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310245 s, 33.8 MB/s 2024-01-22T05:14:04.288 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.288 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.288 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027848 s, 37.7 MB/s 2024-01-22T05:14:04.316 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.316 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.316 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239232 s, 43.8 MB/s 2024-01-22T05:14:04.341 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.341 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.341 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224813 s, 46.6 MB/s 2024-01-22T05:14:04.371 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.371 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.371 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252877 s, 41.5 MB/s 2024-01-22T05:14:04.409 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.409 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.409 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342146 s, 30.6 MB/s 2024-01-22T05:14:04.438 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.438 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.439 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250696 s, 41.8 MB/s 2024-01-22T05:14:04.468 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.468 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.468 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258512 s, 40.6 MB/s 2024-01-22T05:14:04.497 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.497 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.498 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249879 s, 42.0 MB/s 2024-01-22T05:14:04.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:04.503 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:04.503 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:04.503 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.14 2024-01-22T05:14:04.503 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:04.503 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:04.504 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:04.504 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259841 s, 40.4 MB/s 2024-01-22T05:14:04.591 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.592 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.592 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272654 s, 38.5 MB/s 2024-01-22T05:14:04.620 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.620 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.620 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247489 s, 42.4 MB/s 2024-01-22T05:14:04.648 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.648 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.648 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240413 s, 43.6 MB/s 2024-01-22T05:14:04.686 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.686 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.686 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032975 s, 31.8 MB/s 2024-01-22T05:14:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312883 s, 33.5 MB/s 2024-01-22T05:14:04.756 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.756 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.756 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308368 s, 34.0 MB/s 2024-01-22T05:14:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245844 s, 42.7 MB/s 2024-01-22T05:14:04.817 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.817 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.817 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289961 s, 36.2 MB/s 2024-01-22T05:14:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.853 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310372 s, 33.8 MB/s 2024-01-22T05:14:04.880 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.880 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.880 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223741 s, 46.9 MB/s 2024-01-22T05:14:04.911 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.912 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.912 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265031 s, 39.6 MB/s 2024-01-22T05:14:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.947 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320375 s, 32.7 MB/s 2024-01-22T05:14:04.978 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:04.978 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:04.979 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271394 s, 38.6 MB/s 2024-01-22T05:14:05.011 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.011 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.011 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297421 s, 35.3 MB/s 2024-01-22T05:14:05.055 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.055 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.055 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.039509 s, 26.5 MB/s 2024-01-22T05:14:05.087 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.087 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.087 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275642 s, 38.0 MB/s 2024-01-22T05:14:05.116 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.117 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251843 s, 41.6 MB/s 2024-01-22T05:14:05.151 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.151 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.151 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299399 s, 35.0 MB/s 2024-01-22T05:14:05.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.184 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282031 s, 37.2 MB/s 2024-01-22T05:14:05.210 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.210 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.210 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230794 s, 45.4 MB/s 2024-01-22T05:14:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254263 s, 41.2 MB/s 2024-01-22T05:14:05.269 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.270 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.270 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286951 s, 36.5 MB/s 2024-01-22T05:14:05.306 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.306 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.306 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319577 s, 32.8 MB/s 2024-01-22T05:14:05.337 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.337 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.337 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258638 s, 40.5 MB/s 2024-01-22T05:14:05.372 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.372 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.372 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314499 s, 33.3 MB/s 2024-01-22T05:14:05.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.402 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256108 s, 40.9 MB/s 2024-01-22T05:14:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.428 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223225 s, 47.0 MB/s 2024-01-22T05:14:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241582 s, 43.4 MB/s 2024-01-22T05:14:05.488 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.488 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.488 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284357 s, 36.9 MB/s 2024-01-22T05:14:05.522 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.522 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.522 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287041 s, 36.5 MB/s 2024-01-22T05:14:05.551 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248058 s, 42.3 MB/s 2024-01-22T05:14:05.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:05.554 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:05.554 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:05.554 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.15 2024-01-22T05:14:05.554 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:05.554 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:05.554 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:05.554 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:05.614 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.614 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.614 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302103 s, 34.7 MB/s 2024-01-22T05:14:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0354549 s, 29.6 MB/s 2024-01-22T05:14:05.684 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.684 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.684 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259553 s, 40.4 MB/s 2024-01-22T05:14:05.722 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.722 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.722 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0335692 s, 31.2 MB/s 2024-01-22T05:14:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303069 s, 34.6 MB/s 2024-01-22T05:14:05.781 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.782 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.782 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223533 s, 46.9 MB/s 2024-01-22T05:14:05.824 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.824 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.824 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0385851 s, 27.2 MB/s 2024-01-22T05:14:05.849 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.849 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.849 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218501 s, 48.0 MB/s 2024-01-22T05:14:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232815 s, 45.0 MB/s 2024-01-22T05:14:05.915 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.915 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.915 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0346813 s, 30.2 MB/s 2024-01-22T05:14:05.942 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.942 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.942 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230438 s, 45.5 MB/s 2024-01-22T05:14:05.968 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.968 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.968 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022732 s, 46.1 MB/s 2024-01-22T05:14:05.996 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:05.996 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:05.996 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242163 s, 43.3 MB/s 2024-01-22T05:14:06.024 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.025 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.025 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240334 s, 43.6 MB/s 2024-01-22T05:14:06.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.060 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314629 s, 33.3 MB/s 2024-01-22T05:14:06.097 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.097 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.097 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325108 s, 32.3 MB/s 2024-01-22T05:14:06.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.131 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300795 s, 34.9 MB/s 2024-01-22T05:14:06.160 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.160 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.160 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252541 s, 41.5 MB/s 2024-01-22T05:14:06.186 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.186 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.186 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021847 s, 48.0 MB/s 2024-01-22T05:14:06.212 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.212 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.212 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228904 s, 45.8 MB/s 2024-01-22T05:14:06.234 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.234 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.234 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197482 s, 53.1 MB/s 2024-01-22T05:14:06.263 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.263 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.263 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245448 s, 42.7 MB/s 2024-01-22T05:14:06.293 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.293 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.293 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281359 s, 37.3 MB/s 2024-01-22T05:14:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236 s, 44.4 MB/s 2024-01-22T05:14:06.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.348 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238488 s, 44.0 MB/s 2024-01-22T05:14:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.382 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305278 s, 34.3 MB/s 2024-01-22T05:14:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.415 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.415 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276553 s, 37.9 MB/s 2024-01-22T05:14:06.436 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.436 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.436 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188077 s, 55.8 MB/s 2024-01-22T05:14:06.468 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.468 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.468 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279301 s, 37.5 MB/s 2024-01-22T05:14:06.498 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.498 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.498 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258005 s, 40.6 MB/s 2024-01-22T05:14:06.527 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.527 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.527 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246886 s, 42.5 MB/s 2024-01-22T05:14:06.552 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.552 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.552 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021933 s, 47.8 MB/s 2024-01-22T05:14:06.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:06.554 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:06.554 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:06.554 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.16 2024-01-22T05:14:06.554 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:06.554 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:06.555 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:06.555 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:06.615 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.615 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.615 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274726 s, 38.2 MB/s 2024-01-22T05:14:06.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.643 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249737 s, 42.0 MB/s 2024-01-22T05:14:06.670 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.670 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.670 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235291 s, 44.6 MB/s 2024-01-22T05:14:06.700 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.700 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.700 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269343 s, 38.9 MB/s 2024-01-22T05:14:06.734 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.734 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.734 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296179 s, 35.4 MB/s 2024-01-22T05:14:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249295 s, 42.1 MB/s 2024-01-22T05:14:06.793 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.793 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.793 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258412 s, 40.6 MB/s 2024-01-22T05:14:06.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.827 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311698 s, 33.6 MB/s 2024-01-22T05:14:06.856 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.857 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.857 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250224 s, 41.9 MB/s 2024-01-22T05:14:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028589 s, 36.7 MB/s 2024-01-22T05:14:06.915 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.915 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.915 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228079 s, 46.0 MB/s 2024-01-22T05:14:06.942 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.942 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.942 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236456 s, 44.3 MB/s 2024-01-22T05:14:06.970 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:06.970 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:06.971 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249837 s, 42.0 MB/s 2024-01-22T05:14:07.001 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.001 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.001 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270252 s, 38.8 MB/s 2024-01-22T05:14:07.034 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.035 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.035 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309581 s, 33.9 MB/s 2024-01-22T05:14:07.070 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.070 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.070 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311874 s, 33.6 MB/s 2024-01-22T05:14:07.103 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.103 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.103 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287171 s, 36.5 MB/s 2024-01-22T05:14:07.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.132 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244015 s, 43.0 MB/s 2024-01-22T05:14:07.156 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.156 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.156 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203866 s, 51.4 MB/s 2024-01-22T05:14:07.199 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.199 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.199 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0382722 s, 27.4 MB/s 2024-01-22T05:14:07.227 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.227 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.227 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240563 s, 43.6 MB/s 2024-01-22T05:14:07.256 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.256 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.256 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254594 s, 41.2 MB/s 2024-01-22T05:14:07.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.285 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.285 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242812 s, 43.2 MB/s 2024-01-22T05:14:07.317 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.317 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.317 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292549 s, 35.8 MB/s 2024-01-22T05:14:07.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.348 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266043 s, 39.4 MB/s 2024-01-22T05:14:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0374681 s, 28.0 MB/s 2024-01-22T05:14:07.423 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.423 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.423 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316806 s, 33.1 MB/s 2024-01-22T05:14:07.454 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.454 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.454 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270614 s, 38.7 MB/s 2024-01-22T05:14:07.487 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.487 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.487 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293478 s, 35.7 MB/s 2024-01-22T05:14:07.519 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.519 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.519 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274866 s, 38.1 MB/s 2024-01-22T05:14:07.543 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.544 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.544 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214904 s, 48.8 MB/s 2024-01-22T05:14:07.569 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.569 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.570 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227772 s, 46.0 MB/s 2024-01-22T05:14:07.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:07.571 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:07.572 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:07.572 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.17 2024-01-22T05:14:07.572 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:07.572 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:07.572 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:07.572 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:07.640 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.640 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.640 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308418 s, 34.0 MB/s 2024-01-22T05:14:07.678 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.678 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.678 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0335798 s, 31.2 MB/s 2024-01-22T05:14:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314091 s, 33.4 MB/s 2024-01-22T05:14:07.742 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.742 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.742 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240135 s, 43.7 MB/s 2024-01-22T05:14:07.770 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.770 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.770 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250236 s, 41.9 MB/s 2024-01-22T05:14:07.798 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.798 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.798 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234124 s, 44.8 MB/s 2024-01-22T05:14:07.829 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.829 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.829 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027579 s, 38.0 MB/s 2024-01-22T05:14:07.868 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.868 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.868 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0356673 s, 29.4 MB/s 2024-01-22T05:14:07.899 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.899 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.899 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278242 s, 37.7 MB/s 2024-01-22T05:14:07.929 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.929 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.930 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261889 s, 40.0 MB/s 2024-01-22T05:14:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275263 s, 38.1 MB/s 2024-01-22T05:14:07.986 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:07.986 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:07.986 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208529 s, 50.3 MB/s 2024-01-22T05:14:08.017 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.017 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.017 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273268 s, 38.4 MB/s 2024-01-22T05:14:08.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.045 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235212 s, 44.6 MB/s 2024-01-22T05:14:08.066 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.066 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.067 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187534 s, 55.9 MB/s 2024-01-22T05:14:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.092 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220703 s, 47.5 MB/s 2024-01-22T05:14:08.122 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.122 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.122 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260318 s, 40.3 MB/s 2024-01-22T05:14:08.153 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.153 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.153 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268345 s, 39.1 MB/s 2024-01-22T05:14:08.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.185 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02741 s, 38.3 MB/s 2024-01-22T05:14:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231693 s, 45.3 MB/s 2024-01-22T05:14:08.251 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.251 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.251 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0352326 s, 29.8 MB/s 2024-01-22T05:14:08.279 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.279 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.279 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234478 s, 44.7 MB/s 2024-01-22T05:14:08.305 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.306 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.306 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222016 s, 47.2 MB/s 2024-01-22T05:14:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.330 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02095 s, 50.1 MB/s 2024-01-22T05:14:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.360 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263873 s, 39.7 MB/s 2024-01-22T05:14:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.388 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234257 s, 44.8 MB/s 2024-01-22T05:14:08.423 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.423 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.423 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310778 s, 33.7 MB/s 2024-01-22T05:14:08.450 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.451 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.451 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023243 s, 45.1 MB/s 2024-01-22T05:14:08.472 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192264 s, 54.5 MB/s 2024-01-22T05:14:08.503 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.504 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.504 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265988 s, 39.4 MB/s 2024-01-22T05:14:08.536 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.537 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.537 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028228 s, 37.1 MB/s 2024-01-22T05:14:08.569 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.569 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.569 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281318 s, 37.3 MB/s 2024-01-22T05:14:08.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:08.572 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:08.572 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:08.572 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.18 2024-01-22T05:14:08.572 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:08.572 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:08.572 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:08.572 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:08.631 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.631 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.631 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253426 s, 41.4 MB/s 2024-01-22T05:14:08.661 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.661 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.661 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263717 s, 39.8 MB/s 2024-01-22T05:14:08.692 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.692 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.692 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267038 s, 39.3 MB/s 2024-01-22T05:14:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251104 s, 41.8 MB/s 2024-01-22T05:14:08.748 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.748 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.748 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234435 s, 44.7 MB/s 2024-01-22T05:14:08.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.780 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278183 s, 37.7 MB/s 2024-01-22T05:14:08.818 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.818 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.818 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348902 s, 30.1 MB/s 2024-01-22T05:14:08.842 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.842 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.842 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214717 s, 48.8 MB/s 2024-01-22T05:14:08.873 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.873 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.873 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272935 s, 38.4 MB/s 2024-01-22T05:14:08.900 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.900 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.900 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242077 s, 43.3 MB/s 2024-01-22T05:14:08.930 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.930 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.930 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270294 s, 38.8 MB/s 2024-01-22T05:14:08.958 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.958 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.958 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237061 s, 44.2 MB/s 2024-01-22T05:14:08.992 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:08.992 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:08.993 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308156 s, 34.0 MB/s 2024-01-22T05:14:09.020 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.020 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.020 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023928 s, 43.8 MB/s 2024-01-22T05:14:09.047 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.047 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.047 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023042 s, 45.5 MB/s 2024-01-22T05:14:09.077 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.077 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.077 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273742 s, 38.3 MB/s 2024-01-22T05:14:09.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240184 s, 43.7 MB/s 2024-01-22T05:14:09.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.131 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222643 s, 47.1 MB/s 2024-01-22T05:14:09.150 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:14:09.156 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:14:09.166 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.167 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.167 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314955 s, 33.3 MB/s 2024-01-22T05:14:09.192 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.192 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.192 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209345 s, 50.1 MB/s 2024-01-22T05:14:09.225 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.225 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.225 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282623 s, 37.1 MB/s 2024-01-22T05:14:09.256 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.256 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.256 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278962 s, 37.6 MB/s 2024-01-22T05:14:09.283 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.283 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.283 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232818 s, 45.0 MB/s 2024-01-22T05:14:09.312 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.312 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.312 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252707 s, 41.5 MB/s 2024-01-22T05:14:09.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.351 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344565 s, 30.4 MB/s 2024-01-22T05:14:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030238 s, 34.7 MB/s 2024-01-22T05:14:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.418 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290869 s, 36.0 MB/s 2024-01-22T05:14:09.451 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.451 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.451 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289125 s, 36.3 MB/s 2024-01-22T05:14:09.486 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.486 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.486 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307679 s, 34.1 MB/s 2024-01-22T05:14:09.512 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.512 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.512 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224925 s, 46.6 MB/s 2024-01-22T05:14:09.540 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.540 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.540 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245419 s, 42.7 MB/s 2024-01-22T05:14:09.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.575 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309722 s, 33.9 MB/s 2024-01-22T05:14:09.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:09.577 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:09.577 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:09.577 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.19 2024-01-22T05:14:09.577 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:09.577 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:09.577 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:09.577 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:09.685 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.685 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.685 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330206 s, 31.8 MB/s 2024-01-22T05:14:09.711 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.711 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.711 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225393 s, 46.5 MB/s 2024-01-22T05:14:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.736 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.736 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222942 s, 47.0 MB/s 2024-01-22T05:14:09.763 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.763 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.763 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237759 s, 44.1 MB/s 2024-01-22T05:14:09.797 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.797 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.797 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298663 s, 35.1 MB/s 2024-01-22T05:14:09.830 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.830 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.830 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282698 s, 37.1 MB/s 2024-01-22T05:14:09.855 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.856 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.856 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226654 s, 46.3 MB/s 2024-01-22T05:14:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240249 s, 43.6 MB/s 2024-01-22T05:14:09.911 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.911 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.911 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241697 s, 43.4 MB/s 2024-01-22T05:14:09.937 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.937 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.937 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212143 s, 49.4 MB/s 2024-01-22T05:14:09.966 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:09.966 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:09.966 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263698 s, 39.8 MB/s 2024-01-22T05:14:10.002 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.003 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.003 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031622 s, 33.2 MB/s 2024-01-22T05:14:10.034 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.034 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.034 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272461 s, 38.5 MB/s 2024-01-22T05:14:10.062 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.062 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.062 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242413 s, 43.3 MB/s 2024-01-22T05:14:10.089 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.089 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.089 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230582 s, 45.5 MB/s 2024-01-22T05:14:10.125 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.125 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.125 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314952 s, 33.3 MB/s 2024-01-22T05:14:10.152 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.152 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.152 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023628 s, 44.4 MB/s 2024-01-22T05:14:10.175 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.175 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.175 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203552 s, 51.5 MB/s 2024-01-22T05:14:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295254 s, 35.5 MB/s 2024-01-22T05:14:10.236 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.236 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.236 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230262 s, 45.5 MB/s 2024-01-22T05:14:10.263 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.264 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.264 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248664 s, 42.2 MB/s 2024-01-22T05:14:10.292 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.292 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.292 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242163 s, 43.3 MB/s 2024-01-22T05:14:10.325 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.326 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.326 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298328 s, 35.1 MB/s 2024-01-22T05:14:10.359 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.359 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.359 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029423 s, 35.6 MB/s 2024-01-22T05:14:10.395 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.395 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.395 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315373 s, 33.2 MB/s 2024-01-22T05:14:10.426 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.426 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.426 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259149 s, 40.5 MB/s 2024-01-22T05:14:10.461 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.461 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.461 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318948 s, 32.9 MB/s 2024-01-22T05:14:10.498 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.498 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.498 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329169 s, 31.9 MB/s 2024-01-22T05:14:10.527 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.527 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.527 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249768 s, 42.0 MB/s 2024-01-22T05:14:10.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.556 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273708 s, 38.3 MB/s 2024-01-22T05:14:10.587 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.587 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.587 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256741 s, 40.8 MB/s 2024-01-22T05:14:10.618 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.618 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.618 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268319 s, 39.1 MB/s 2024-01-22T05:14:10.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:10.621 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:10.621 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:10.621 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.20 2024-01-22T05:14:10.621 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:10.621 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:10.621 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:10.621 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:10.685 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.685 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.685 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326435 s, 32.1 MB/s 2024-01-22T05:14:10.715 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.715 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.715 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253572 s, 41.4 MB/s 2024-01-22T05:14:10.741 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.741 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.741 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223454 s, 46.9 MB/s 2024-01-22T05:14:10.775 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.776 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.776 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299452 s, 35.0 MB/s 2024-01-22T05:14:10.805 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.805 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.805 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251101 s, 41.8 MB/s 2024-01-22T05:14:10.831 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.831 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.831 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219026 s, 47.9 MB/s 2024-01-22T05:14:10.872 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.872 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.872 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0375474 s, 27.9 MB/s 2024-01-22T05:14:10.904 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.904 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.904 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278442 s, 37.7 MB/s 2024-01-22T05:14:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027933 s, 37.5 MB/s 2024-01-22T05:14:10.964 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:10.964 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:10.965 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236162 s, 44.4 MB/s 2024-01-22T05:14:10.997 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.348 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302804 s, 34.6 MB/s 2024-01-22T05:14:11.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.350 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214099 s, 49.0 MB/s 2024-01-22T05:14:11.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.350 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0343265 s, 30.5 MB/s 2024-01-22T05:14:11.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.350 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242072 s, 43.3 MB/s 2024-01-22T05:14:11.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.351 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295872 s, 35.4 MB/s 2024-01-22T05:14:11.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.351 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247147 s, 42.4 MB/s 2024-01-22T05:14:11.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.351 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273201 s, 38.4 MB/s 2024-01-22T05:14:11.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.351 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298378 s, 35.1 MB/s 2024-01-22T05:14:11.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.352 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241083 s, 43.5 MB/s 2024-01-22T05:14:11.352 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.352 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.352 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222568 s, 47.1 MB/s 2024-01-22T05:14:11.352 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.352 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.352 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0354181 s, 29.6 MB/s 2024-01-22T05:14:11.352 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.352 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.352 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232458 s, 45.1 MB/s 2024-01-22T05:14:11.366 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.366 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.366 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257747 s, 40.7 MB/s 2024-01-22T05:14:11.392 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.393 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.393 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230658 s, 45.5 MB/s 2024-01-22T05:14:11.421 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.421 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.421 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248666 s, 42.2 MB/s 2024-01-22T05:14:11.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.445 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212803 s, 49.3 MB/s 2024-01-22T05:14:11.481 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.481 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.481 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329187 s, 31.9 MB/s 2024-01-22T05:14:11.517 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.517 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.517 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031293 s, 33.5 MB/s 2024-01-22T05:14:11.545 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.545 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.545 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230143 s, 45.6 MB/s 2024-01-22T05:14:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.572 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234877 s, 44.6 MB/s 2024-01-22T05:14:11.609 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.609 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.609 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03291 s, 31.9 MB/s 2024-01-22T05:14:11.645 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.645 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.645 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324487 s, 32.3 MB/s 2024-01-22T05:14:11.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:11.647 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:11.647 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:11.647 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.21 2024-01-22T05:14:11.647 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:11.647 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:11.647 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:11.647 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244919 s, 42.8 MB/s 2024-01-22T05:14:11.732 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.732 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.732 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239864 s, 43.7 MB/s 2024-01-22T05:14:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0335691 s, 31.2 MB/s 2024-01-22T05:14:11.804 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.804 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.804 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302424 s, 34.7 MB/s 2024-01-22T05:14:11.839 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.839 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.839 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306681 s, 34.2 MB/s 2024-01-22T05:14:11.871 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.871 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.871 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275454 s, 38.1 MB/s 2024-01-22T05:14:11.897 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.898 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.898 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239715 s, 43.7 MB/s 2024-01-22T05:14:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293879 s, 35.7 MB/s 2024-01-22T05:14:11.965 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.965 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.965 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317633 s, 33.0 MB/s 2024-01-22T05:14:11.990 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:11.990 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:11.990 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206549 s, 50.8 MB/s 2024-01-22T05:14:12.014 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.015 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.015 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210026 s, 49.9 MB/s 2024-01-22T05:14:12.046 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.046 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.046 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272024 s, 38.5 MB/s 2024-01-22T05:14:12.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.073 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221065 s, 47.4 MB/s 2024-01-22T05:14:12.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.108 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316199 s, 33.2 MB/s 2024-01-22T05:14:12.136 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.136 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.136 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245855 s, 42.7 MB/s 2024-01-22T05:14:12.173 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.173 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.173 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328391 s, 31.9 MB/s 2024-01-22T05:14:12.210 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.210 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.210 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328112 s, 32.0 MB/s 2024-01-22T05:14:12.248 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.248 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.248 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0339288 s, 30.9 MB/s 2024-01-22T05:14:12.272 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.272 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.272 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212694 s, 49.3 MB/s 2024-01-22T05:14:12.307 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.307 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.307 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310237 s, 33.8 MB/s 2024-01-22T05:14:12.335 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.335 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.335 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236934 s, 44.3 MB/s 2024-01-22T05:14:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0352578 s, 29.7 MB/s 2024-01-22T05:14:12.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.402 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228605 s, 45.9 MB/s 2024-01-22T05:14:12.436 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.437 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.437 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305652 s, 34.3 MB/s 2024-01-22T05:14:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024487 s, 42.8 MB/s 2024-01-22T05:14:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235956 s, 44.4 MB/s 2024-01-22T05:14:12.524 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.524 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.524 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273588 s, 38.3 MB/s 2024-01-22T05:14:12.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.557 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295094 s, 35.5 MB/s 2024-01-22T05:14:12.592 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.592 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.592 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307735 s, 34.1 MB/s 2024-01-22T05:14:12.621 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.621 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.621 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246137 s, 42.6 MB/s 2024-01-22T05:14:12.650 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.650 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.651 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271788 s, 38.6 MB/s 2024-01-22T05:14:12.680 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.680 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.680 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247728 s, 42.3 MB/s 2024-01-22T05:14:12.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:12.682 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:12.682 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:12.682 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.22 2024-01-22T05:14:12.682 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:12.682 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:12.682 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:12.682 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:12.750 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.750 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.750 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0346948 s, 30.2 MB/s 2024-01-22T05:14:12.779 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.779 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.779 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254243 s, 41.2 MB/s 2024-01-22T05:14:12.802 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.802 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.802 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204846 s, 51.2 MB/s 2024-01-22T05:14:12.838 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.838 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.838 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318865 s, 32.9 MB/s 2024-01-22T05:14:12.865 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.865 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.865 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227947 s, 46.0 MB/s 2024-01-22T05:14:12.900 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.900 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.901 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309766 s, 33.9 MB/s 2024-01-22T05:14:12.933 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.933 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.933 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278321 s, 37.7 MB/s 2024-01-22T05:14:12.968 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:12.968 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:12.968 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318143 s, 33.0 MB/s 2024-01-22T05:14:13.000 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.000 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.000 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280554 s, 37.4 MB/s 2024-01-22T05:14:13.036 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.036 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.036 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314487 s, 33.3 MB/s 2024-01-22T05:14:13.063 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.063 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.063 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238372 s, 44.0 MB/s 2024-01-22T05:14:13.093 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.094 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.094 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028093 s, 37.3 MB/s 2024-01-22T05:14:13.130 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.130 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.130 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317089 s, 33.1 MB/s 2024-01-22T05:14:13.162 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.162 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.162 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276743 s, 37.9 MB/s 2024-01-22T05:14:13.186 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.187 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.187 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218969 s, 47.9 MB/s 2024-01-22T05:14:13.229 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.229 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.229 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0376314 s, 27.9 MB/s 2024-01-22T05:14:13.261 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.261 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.261 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027959 s, 37.5 MB/s 2024-01-22T05:14:13.291 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.292 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.292 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025761 s, 40.7 MB/s 2024-01-22T05:14:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0361668 s, 29.0 MB/s 2024-01-22T05:14:13.361 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.361 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.361 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242938 s, 43.2 MB/s 2024-01-22T05:14:13.385 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.385 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.385 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021494 s, 48.8 MB/s 2024-01-22T05:14:13.415 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.415 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.416 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265417 s, 39.5 MB/s 2024-01-22T05:14:13.450 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.450 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.450 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311069 s, 33.7 MB/s 2024-01-22T05:14:13.478 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.478 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.478 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247423 s, 42.4 MB/s 2024-01-22T05:14:13.504 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.504 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.504 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215726 s, 48.6 MB/s 2024-01-22T05:14:13.534 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.534 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.534 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260285 s, 40.3 MB/s 2024-01-22T05:14:13.564 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.564 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.564 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269053 s, 39.0 MB/s 2024-01-22T05:14:13.599 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.599 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.599 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307046 s, 34.2 MB/s 2024-01-22T05:14:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244232 s, 42.9 MB/s 2024-01-22T05:14:13.654 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.654 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.654 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023289 s, 45.0 MB/s 2024-01-22T05:14:13.683 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.684 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.684 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267574 s, 39.2 MB/s 2024-01-22T05:14:13.720 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.720 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.720 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317063 s, 33.1 MB/s 2024-01-22T05:14:13.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:13.722 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:13.723 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:13.723 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.23 2024-01-22T05:14:13.723 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:13.723 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:13.723 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:13.723 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:13.786 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.787 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.787 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330207 s, 31.8 MB/s 2024-01-22T05:14:13.813 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.813 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.813 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226795 s, 46.2 MB/s 2024-01-22T05:14:13.845 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.845 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.845 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277737 s, 37.8 MB/s 2024-01-22T05:14:13.877 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.877 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.877 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266389 s, 39.4 MB/s 2024-01-22T05:14:13.912 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.912 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.912 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305387 s, 34.3 MB/s 2024-01-22T05:14:13.945 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.945 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.945 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313767 s, 33.4 MB/s 2024-01-22T05:14:13.977 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:13.977 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:13.977 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284024 s, 36.9 MB/s 2024-01-22T05:14:14.015 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.015 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.015 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344689 s, 30.4 MB/s 2024-01-22T05:14:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.046 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.046 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268396 s, 39.1 MB/s 2024-01-22T05:14:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248261 s, 42.2 MB/s 2024-01-22T05:14:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203183 s, 51.6 MB/s 2024-01-22T05:14:14.137 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.138 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.138 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0339237 s, 30.9 MB/s 2024-01-22T05:14:14.175 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.175 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.175 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329524 s, 31.8 MB/s 2024-01-22T05:14:14.223 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.223 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.223 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0430181 s, 24.4 MB/s 2024-01-22T05:14:14.253 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.253 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.253 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255298 s, 41.1 MB/s 2024-01-22T05:14:14.295 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.295 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.295 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0389405 s, 26.9 MB/s 2024-01-22T05:14:14.330 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.331 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.331 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307895 s, 34.1 MB/s 2024-01-22T05:14:14.366 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.366 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.366 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031054 s, 33.8 MB/s 2024-01-22T05:14:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.399 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293711 s, 35.7 MB/s 2024-01-22T05:14:14.437 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.438 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.438 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340871 s, 30.8 MB/s 2024-01-22T05:14:14.465 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250157 s, 41.9 MB/s 2024-01-22T05:14:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.493 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229665 s, 45.7 MB/s 2024-01-22T05:14:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288043 s, 36.4 MB/s 2024-01-22T05:14:14.563 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.563 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.563 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337526 s, 31.1 MB/s 2024-01-22T05:14:14.593 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.593 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.593 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264711 s, 39.6 MB/s 2024-01-22T05:14:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301335 s, 34.8 MB/s 2024-01-22T05:14:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323871 s, 32.4 MB/s 2024-01-22T05:14:14.696 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.696 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.696 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279665 s, 37.5 MB/s 2024-01-22T05:14:14.726 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.726 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.726 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263133 s, 39.8 MB/s 2024-01-22T05:14:14.759 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.759 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.759 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292502 s, 35.8 MB/s 2024-01-22T05:14:14.790 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.790 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.790 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266203 s, 39.4 MB/s 2024-01-22T05:14:14.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.827 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0331689 s, 31.6 MB/s 2024-01-22T05:14:14.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:14.830 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:14.830 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:14.830 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.24 2024-01-22T05:14:14.830 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:14.830 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:14.830 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:14.830 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:14.889 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.889 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.889 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282903 s, 37.1 MB/s 2024-01-22T05:14:14.913 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.913 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.913 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210168 s, 49.9 MB/s 2024-01-22T05:14:14.938 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.939 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.939 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219222 s, 47.8 MB/s 2024-01-22T05:14:14.968 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:14.968 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:14.968 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258908 s, 40.5 MB/s 2024-01-22T05:14:14.999 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.000 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.000 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280135 s, 37.4 MB/s 2024-01-22T05:14:15.021 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.021 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.021 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187779 s, 55.8 MB/s 2024-01-22T05:14:15.054 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.054 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.054 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296306 s, 35.4 MB/s 2024-01-22T05:14:15.083 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.083 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.083 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251832 s, 41.6 MB/s 2024-01-22T05:14:15.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.122 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.122 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0358249 s, 29.3 MB/s 2024-01-22T05:14:15.151 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.151 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.151 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254189 s, 41.3 MB/s 2024-01-22T05:14:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022198 s, 47.2 MB/s 2024-01-22T05:14:15.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.202 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226014 s, 46.4 MB/s 2024-01-22T05:14:15.229 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.229 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.230 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231483 s, 45.3 MB/s 2024-01-22T05:14:15.258 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.258 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.258 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254928 s, 41.1 MB/s 2024-01-22T05:14:15.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.284 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222962 s, 47.0 MB/s 2024-01-22T05:14:15.321 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.321 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.321 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341024 s, 30.7 MB/s 2024-01-22T05:14:15.349 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.349 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.349 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234759 s, 44.7 MB/s 2024-01-22T05:14:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.373 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201651 s, 52.0 MB/s 2024-01-22T05:14:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254255 s, 41.2 MB/s 2024-01-22T05:14:15.429 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.429 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.429 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234734 s, 44.7 MB/s 2024-01-22T05:14:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259347 s, 40.4 MB/s 2024-01-22T05:14:15.496 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.496 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.496 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333788 s, 31.4 MB/s 2024-01-22T05:14:15.526 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.526 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.526 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259654 s, 40.4 MB/s 2024-01-22T05:14:15.552 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.552 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.552 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228139 s, 46.0 MB/s 2024-01-22T05:14:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232904 s, 45.0 MB/s 2024-01-22T05:14:15.608 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.608 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.608 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243618 s, 43.0 MB/s 2024-01-22T05:14:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.636 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241901 s, 43.3 MB/s 2024-01-22T05:14:15.673 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.673 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.673 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032041 s, 32.7 MB/s 2024-01-22T05:14:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.707 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294971 s, 35.5 MB/s 2024-01-22T05:14:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316436 s, 33.1 MB/s 2024-01-22T05:14:15.778 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.778 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.778 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315111 s, 33.3 MB/s 2024-01-22T05:14:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248721 s, 42.2 MB/s 2024-01-22T05:14:15.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:15.809 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:15.809 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:15.809 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.25 2024-01-22T05:14:15.809 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:15.809 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:15.809 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:15.809 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:15.870 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.870 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.870 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259286 s, 40.4 MB/s 2024-01-22T05:14:15.902 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.902 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.903 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285868 s, 36.7 MB/s 2024-01-22T05:14:15.933 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.933 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.933 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268912 s, 39.0 MB/s 2024-01-22T05:14:15.967 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:15.967 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:15.967 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304545 s, 34.4 MB/s 2024-01-22T05:14:16.002 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.002 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.002 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314798 s, 33.3 MB/s 2024-01-22T05:14:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026318 s, 39.8 MB/s 2024-01-22T05:14:16.061 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.061 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.061 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247271 s, 42.4 MB/s 2024-01-22T05:14:16.091 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.091 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.091 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026731 s, 39.2 MB/s 2024-01-22T05:14:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.121 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247079 s, 42.4 MB/s 2024-01-22T05:14:16.151 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.151 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.151 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025893 s, 40.5 MB/s 2024-01-22T05:14:16.180 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.180 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.180 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253646 s, 41.3 MB/s 2024-01-22T05:14:16.207 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.207 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.207 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022547 s, 46.5 MB/s 2024-01-22T05:14:16.234 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.235 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.235 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246528 s, 42.5 MB/s 2024-01-22T05:14:16.263 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.263 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.263 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243462 s, 43.1 MB/s 2024-01-22T05:14:16.289 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.289 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.289 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230272 s, 45.5 MB/s 2024-01-22T05:14:16.316 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.316 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.316 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231569 s, 45.3 MB/s 2024-01-22T05:14:16.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.350 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030359 s, 34.5 MB/s 2024-01-22T05:14:16.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.381 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.381 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262602 s, 39.9 MB/s 2024-01-22T05:14:16.413 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.413 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.413 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278635 s, 37.6 MB/s 2024-01-22T05:14:16.450 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.450 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.450 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323452 s, 32.4 MB/s 2024-01-22T05:14:16.487 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.487 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.487 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325415 s, 32.2 MB/s 2024-01-22T05:14:16.516 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.516 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.516 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253174 s, 41.4 MB/s 2024-01-22T05:14:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.551 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309385 s, 33.9 MB/s 2024-01-22T05:14:16.580 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.580 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.580 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247056 s, 42.4 MB/s 2024-01-22T05:14:16.608 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.608 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.608 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235475 s, 44.5 MB/s 2024-01-22T05:14:16.644 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.644 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.644 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316042 s, 33.2 MB/s 2024-01-22T05:14:16.672 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.672 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.672 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243576 s, 43.0 MB/s 2024-01-22T05:14:16.699 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.699 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.699 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238803 s, 43.9 MB/s 2024-01-22T05:14:16.731 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.731 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.731 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277109 s, 37.8 MB/s 2024-01-22T05:14:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320752 s, 32.7 MB/s 2024-01-22T05:14:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.794 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230302 s, 45.5 MB/s 2024-01-22T05:14:16.822 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.823 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.823 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238868 s, 43.9 MB/s 2024-01-22T05:14:16.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:16.825 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:16.825 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:16.825 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.26 2024-01-22T05:14:16.825 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:16.825 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:16.825 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:16.825 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:16.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.885 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.885 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225088 s, 46.6 MB/s 2024-01-22T05:14:16.910 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.910 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.910 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227744 s, 46.0 MB/s 2024-01-22T05:14:16.938 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.938 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.938 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236869 s, 44.3 MB/s 2024-01-22T05:14:16.966 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.967 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.967 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246944 s, 42.5 MB/s 2024-01-22T05:14:16.995 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:16.995 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:16.995 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239393 s, 43.8 MB/s 2024-01-22T05:14:17.031 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.031 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.031 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314562 s, 33.3 MB/s 2024-01-22T05:14:17.069 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.070 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.070 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0343349 s, 30.5 MB/s 2024-01-22T05:14:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202743 s, 51.7 MB/s 2024-01-22T05:14:17.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.121 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245003 s, 42.8 MB/s 2024-01-22T05:14:17.146 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.146 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.146 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217602 s, 48.2 MB/s 2024-01-22T05:14:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318413 s, 32.9 MB/s 2024-01-22T05:14:17.210 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.210 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.210 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240521 s, 43.6 MB/s 2024-01-22T05:14:17.246 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.247 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.247 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.033264 s, 31.5 MB/s 2024-01-22T05:14:17.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.282 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310883 s, 33.7 MB/s 2024-01-22T05:14:17.319 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.319 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.319 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329881 s, 31.8 MB/s 2024-01-22T05:14:17.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.348 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255441 s, 41.0 MB/s 2024-01-22T05:14:17.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.380 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292381 s, 35.9 MB/s 2024-01-22T05:14:17.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.412 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275149 s, 38.1 MB/s 2024-01-22T05:14:17.440 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.440 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.440 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234088 s, 44.8 MB/s 2024-01-22T05:14:17.477 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.477 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.477 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0335098 s, 31.3 MB/s 2024-01-22T05:14:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287177 s, 36.5 MB/s 2024-01-22T05:14:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022667 s, 46.3 MB/s 2024-01-22T05:14:17.573 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.573 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.573 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328875 s, 31.9 MB/s 2024-01-22T05:14:17.605 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.605 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.605 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286471 s, 36.6 MB/s 2024-01-22T05:14:17.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.643 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336364 s, 31.2 MB/s 2024-01-22T05:14:17.685 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.686 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.686 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0387519 s, 27.1 MB/s 2024-01-22T05:14:17.713 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.713 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.714 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244091 s, 43.0 MB/s 2024-01-22T05:14:17.743 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.743 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.744 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261277 s, 40.1 MB/s 2024-01-22T05:14:17.776 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.776 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.776 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294156 s, 35.6 MB/s 2024-01-22T05:14:17.808 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.808 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.808 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271324 s, 38.6 MB/s 2024-01-22T05:14:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261603 s, 40.1 MB/s 2024-01-22T05:14:17.860 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.860 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.860 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019353 s, 54.2 MB/s 2024-01-22T05:14:17.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:17.862 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:17.862 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:17.863 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.27 2024-01-22T05:14:17.863 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:17.863 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:17.863 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:17.863 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:17.923 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.923 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.923 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269757 s, 38.9 MB/s 2024-01-22T05:14:17.955 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.955 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.956 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300531 s, 34.9 MB/s 2024-01-22T05:14:17.993 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:17.993 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:17.993 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328606 s, 31.9 MB/s 2024-01-22T05:14:18.018 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.019 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.019 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212003 s, 49.5 MB/s 2024-01-22T05:14:18.049 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.049 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.049 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025898 s, 40.5 MB/s 2024-01-22T05:14:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.077 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245162 s, 42.8 MB/s 2024-01-22T05:14:18.101 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021754 s, 48.2 MB/s 2024-01-22T05:14:18.128 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.128 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.128 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238292 s, 44.0 MB/s 2024-01-22T05:14:18.160 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.160 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.160 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285693 s, 36.7 MB/s 2024-01-22T05:14:18.193 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.193 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.193 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292884 s, 35.8 MB/s 2024-01-22T05:14:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261862 s, 40.0 MB/s 2024-01-22T05:14:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.259 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030458 s, 34.4 MB/s 2024-01-22T05:14:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282241 s, 37.2 MB/s 2024-01-22T05:14:18.324 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.325 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.325 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294168 s, 35.6 MB/s 2024-01-22T05:14:18.356 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.356 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.356 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268427 s, 39.1 MB/s 2024-01-22T05:14:18.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.388 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027771 s, 37.8 MB/s 2024-01-22T05:14:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286426 s, 36.6 MB/s 2024-01-22T05:14:18.448 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.448 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.448 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229765 s, 45.6 MB/s 2024-01-22T05:14:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259903 s, 40.3 MB/s 2024-01-22T05:14:18.503 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.503 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.503 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219372 s, 47.8 MB/s 2024-01-22T05:14:18.532 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.532 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.532 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249345 s, 42.1 MB/s 2024-01-22T05:14:18.572 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.572 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.572 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0357221 s, 29.4 MB/s 2024-01-22T05:14:18.600 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.601 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.601 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238814 s, 43.9 MB/s 2024-01-22T05:14:18.638 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.638 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.638 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.033267 s, 31.5 MB/s 2024-01-22T05:14:18.672 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.672 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.672 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300132 s, 34.9 MB/s 2024-01-22T05:14:18.710 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.710 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.710 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341358 s, 30.7 MB/s 2024-01-22T05:14:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.738 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241484 s, 43.4 MB/s 2024-01-22T05:14:18.765 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.765 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.765 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231263 s, 45.3 MB/s 2024-01-22T05:14:18.793 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.793 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.793 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247702 s, 42.3 MB/s 2024-01-22T05:14:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223201 s, 47.0 MB/s 2024-01-22T05:14:18.852 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.852 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.852 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300055 s, 34.9 MB/s 2024-01-22T05:14:18.888 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.888 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.888 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314455 s, 33.3 MB/s 2024-01-22T05:14:18.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:18.890 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:18.891 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:18.891 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.28 2024-01-22T05:14:18.891 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:18.891 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:18.891 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:18.891 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256383 s, 40.9 MB/s 2024-01-22T05:14:18.983 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:18.983 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:18.983 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299764 s, 35.0 MB/s 2024-01-22T05:14:19.017 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.017 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.017 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292605 s, 35.8 MB/s 2024-01-22T05:14:19.056 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.056 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.056 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0346862 s, 30.2 MB/s 2024-01-22T05:14:19.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.085 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247983 s, 42.3 MB/s 2024-01-22T05:14:19.112 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.112 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.112 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022901 s, 45.8 MB/s 2024-01-22T05:14:19.140 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.140 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.140 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251215 s, 41.7 MB/s 2024-01-22T05:14:19.173 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.173 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.173 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293492 s, 35.7 MB/s 2024-01-22T05:14:19.210 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.210 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.210 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320169 s, 32.8 MB/s 2024-01-22T05:14:19.238 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.239 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.239 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249767 s, 42.0 MB/s 2024-01-22T05:14:19.270 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.270 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.270 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279419 s, 37.5 MB/s 2024-01-22T05:14:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284357 s, 36.9 MB/s 2024-01-22T05:14:19.335 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.335 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.336 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281531 s, 37.2 MB/s 2024-01-22T05:14:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303602 s, 34.5 MB/s 2024-01-22T05:14:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306276 s, 34.2 MB/s 2024-01-22T05:14:19.433 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.434 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.434 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255601 s, 41.0 MB/s 2024-01-22T05:14:19.461 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.461 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.461 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237245 s, 44.2 MB/s 2024-01-22T05:14:19.490 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.490 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.491 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247114 s, 42.4 MB/s 2024-01-22T05:14:19.515 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.515 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.515 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205202 s, 51.1 MB/s 2024-01-22T05:14:19.536 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.537 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.537 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191248 s, 54.8 MB/s 2024-01-22T05:14:19.579 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.579 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.579 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0382951 s, 27.4 MB/s 2024-01-22T05:14:19.615 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.615 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.615 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323821 s, 32.4 MB/s 2024-01-22T05:14:19.645 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.645 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.645 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264306 s, 39.7 MB/s 2024-01-22T05:14:19.677 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.677 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.677 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275928 s, 38.0 MB/s 2024-01-22T05:14:19.709 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.709 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.709 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282031 s, 37.2 MB/s 2024-01-22T05:14:19.738 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.738 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.738 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252503 s, 41.5 MB/s 2024-01-22T05:14:19.770 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.770 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.770 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277805 s, 37.7 MB/s 2024-01-22T05:14:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286633 s, 36.6 MB/s 2024-01-22T05:14:19.831 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.831 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.831 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233667 s, 44.9 MB/s 2024-01-22T05:14:19.858 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.858 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.858 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228834 s, 45.8 MB/s 2024-01-22T05:14:19.889 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.889 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281814 s, 37.2 MB/s 2024-01-22T05:14:19.919 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.919 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.919 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252757 s, 41.5 MB/s 2024-01-22T05:14:19.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:19.922 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:19.922 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:19.922 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.29 2024-01-22T05:14:19.922 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:19.922 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:19.922 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:19.922 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:19.976 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:19.976 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:19.976 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252521 s, 41.5 MB/s 2024-01-22T05:14:20.009 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.010 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.010 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301028 s, 34.8 MB/s 2024-01-22T05:14:20.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.045 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319533 s, 32.8 MB/s 2024-01-22T05:14:20.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.073 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240595 s, 43.6 MB/s 2024-01-22T05:14:20.103 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.103 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.103 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257427 s, 40.7 MB/s 2024-01-22T05:14:20.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.131 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235751 s, 44.5 MB/s 2024-01-22T05:14:20.162 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.162 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.162 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271792 s, 38.6 MB/s 2024-01-22T05:14:20.193 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.193 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.193 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263985 s, 39.7 MB/s 2024-01-22T05:14:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025472 s, 41.2 MB/s 2024-01-22T05:14:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230371 s, 45.5 MB/s 2024-01-22T05:14:20.275 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.275 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.275 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218445 s, 48.0 MB/s 2024-01-22T05:14:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.311 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325431 s, 32.2 MB/s 2024-01-22T05:14:20.344 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.344 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.344 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280962 s, 37.3 MB/s 2024-01-22T05:14:20.373 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.373 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.374 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254437 s, 41.2 MB/s 2024-01-22T05:14:20.407 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.407 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.407 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293999 s, 35.7 MB/s 2024-01-22T05:14:20.439 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.439 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.439 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290384 s, 36.1 MB/s 2024-01-22T05:14:20.469 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.469 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.469 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255921 s, 41.0 MB/s 2024-01-22T05:14:20.500 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.500 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.500 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276752 s, 37.9 MB/s 2024-01-22T05:14:20.538 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.538 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.538 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032856 s, 31.9 MB/s 2024-01-22T05:14:20.569 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.569 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.569 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270675 s, 38.7 MB/s 2024-01-22T05:14:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262922 s, 39.9 MB/s 2024-01-22T05:14:20.633 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.633 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.634 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300444 s, 34.9 MB/s 2024-01-22T05:14:20.660 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.660 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.661 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226455 s, 46.3 MB/s 2024-01-22T05:14:20.688 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.688 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.688 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232605 s, 45.1 MB/s 2024-01-22T05:14:20.717 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.717 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.717 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254575 s, 41.2 MB/s 2024-01-22T05:14:20.743 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.743 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.743 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228339 s, 45.9 MB/s 2024-01-22T05:14:20.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.773 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271359 s, 38.6 MB/s 2024-01-22T05:14:20.805 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.805 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.805 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276555 s, 37.9 MB/s 2024-01-22T05:14:20.834 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.834 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.834 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243268 s, 43.1 MB/s 2024-01-22T05:14:20.868 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.868 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.868 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315757 s, 33.2 MB/s 2024-01-22T05:14:20.902 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.902 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.902 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302278 s, 34.7 MB/s 2024-01-22T05:14:20.927 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.927 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.927 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212344 s, 49.4 MB/s 2024-01-22T05:14:20.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:20.930 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:20.930 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:20.930 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.30 2024-01-22T05:14:20.930 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:20.930 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:20.930 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:20.930 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240467 s, 43.6 MB/s 2024-01-22T05:14:21.018 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.019 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.019 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298075 s, 35.2 MB/s 2024-01-22T05:14:21.057 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.057 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.057 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0335638 s, 31.2 MB/s 2024-01-22T05:14:21.089 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.089 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.090 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294843 s, 35.6 MB/s 2024-01-22T05:14:21.120 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.120 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.120 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263858 s, 39.7 MB/s 2024-01-22T05:14:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322098 s, 32.6 MB/s 2024-01-22T05:14:21.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.185 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238317 s, 44.0 MB/s 2024-01-22T05:14:21.221 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.221 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.221 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320776 s, 32.7 MB/s 2024-01-22T05:14:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.035429 s, 29.6 MB/s 2024-01-22T05:14:21.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.284 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215427 s, 48.7 MB/s 2024-01-22T05:14:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.313 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249834 s, 42.0 MB/s 2024-01-22T05:14:21.338 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.338 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.338 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220214 s, 47.6 MB/s 2024-01-22T05:14:21.370 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.370 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.370 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285064 s, 36.8 MB/s 2024-01-22T05:14:21.399 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.399 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.399 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244205 s, 42.9 MB/s 2024-01-22T05:14:21.436 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.436 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.436 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.033272 s, 31.5 MB/s 2024-01-22T05:14:21.463 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.463 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.463 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233676 s, 44.9 MB/s 2024-01-22T05:14:21.498 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.499 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.499 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312678 s, 33.5 MB/s 2024-01-22T05:14:21.528 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.528 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.528 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255646 s, 41.0 MB/s 2024-01-22T05:14:21.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.558 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027286 s, 38.4 MB/s 2024-01-22T05:14:21.591 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.591 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.591 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293418 s, 35.7 MB/s 2024-01-22T05:14:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.621 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265597 s, 39.5 MB/s 2024-01-22T05:14:21.647 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.647 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.647 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221176 s, 47.4 MB/s 2024-01-22T05:14:21.679 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.679 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.679 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273932 s, 38.3 MB/s 2024-01-22T05:14:21.712 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.712 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.712 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291094 s, 36.0 MB/s 2024-01-22T05:14:21.744 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.744 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.744 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274075 s, 38.3 MB/s 2024-01-22T05:14:21.776 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.776 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.776 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271662 s, 38.6 MB/s 2024-01-22T05:14:21.810 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.810 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.810 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294052 s, 35.7 MB/s 2024-01-22T05:14:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268235 s, 39.1 MB/s 2024-01-22T05:14:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208117 s, 50.4 MB/s 2024-01-22T05:14:21.904 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.906 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.906 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342757 s, 30.6 MB/s 2024-01-22T05:14:21.934 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.934 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.934 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257161 s, 40.8 MB/s 2024-01-22T05:14:21.966 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:21.966 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:21.966 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287222 s, 36.5 MB/s 2024-01-22T05:14:21.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:21.969 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:14:21.969 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:14:21.969 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.31 2024-01-22T05:14:21.969 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:14:21.970 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:14:21.970 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:14:21.970 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:14:22.028 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.028 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.028 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261206 s, 40.1 MB/s 2024-01-22T05:14:22.057 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.057 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.057 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241627 s, 43.4 MB/s 2024-01-22T05:14:22.086 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.086 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.086 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257766 s, 40.7 MB/s 2024-01-22T05:14:22.118 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.118 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.118 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277434 s, 37.8 MB/s 2024-01-22T05:14:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257507 s, 40.7 MB/s 2024-01-22T05:14:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278637 s, 37.6 MB/s 2024-01-22T05:14:22.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.211 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265509 s, 39.5 MB/s 2024-01-22T05:14:22.234 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.234 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.234 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196679 s, 53.3 MB/s 2024-01-22T05:14:22.263 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.263 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.263 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02526 s, 41.5 MB/s 2024-01-22T05:14:22.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.284 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185283 s, 56.6 MB/s 2024-01-22T05:14:22.318 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.318 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.318 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030376 s, 34.5 MB/s 2024-01-22T05:14:22.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.347 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243288 s, 43.1 MB/s 2024-01-22T05:14:22.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.379 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282758 s, 37.1 MB/s 2024-01-22T05:14:22.411 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.411 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.411 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271547 s, 38.6 MB/s 2024-01-22T05:14:22.440 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.440 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.440 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258456 s, 40.6 MB/s 2024-01-22T05:14:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025691 s, 40.8 MB/s 2024-01-22T05:14:22.507 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.507 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.507 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332302 s, 31.6 MB/s 2024-01-22T05:14:22.534 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.534 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.534 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237993 s, 44.1 MB/s 2024-01-22T05:14:22.560 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.560 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.560 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205861 s, 50.9 MB/s 2024-01-22T05:14:22.592 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.593 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.593 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283208 s, 37.0 MB/s 2024-01-22T05:14:22.623 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.623 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.623 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261434 s, 40.1 MB/s 2024-01-22T05:14:22.655 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.655 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.655 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286382 s, 36.6 MB/s 2024-01-22T05:14:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272685 s, 38.5 MB/s 2024-01-22T05:14:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220379 s, 47.6 MB/s 2024-01-22T05:14:22.741 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.741 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.741 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254851 s, 41.1 MB/s 2024-01-22T05:14:22.768 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.768 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.768 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222101 s, 47.2 MB/s 2024-01-22T05:14:22.795 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.795 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.795 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238865 s, 43.9 MB/s 2024-01-22T05:14:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245201 s, 42.8 MB/s 2024-01-22T05:14:22.853 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.853 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.853 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264424 s, 39.7 MB/s 2024-01-22T05:14:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297956 s, 35.2 MB/s 2024-01-22T05:14:22.921 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.921 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.921 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293299 s, 35.8 MB/s 2024-01-22T05:14:22.952 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:14:22.952 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:14:22.952 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267434 s, 39.2 MB/s 2024-01-22T05:14:22.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub start /scrub_control_test_path recursive 2024-01-22T05:14:23.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.123+0000 7ffa49600700 1 Processor -- start 2024-01-22T05:14:23.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.123+0000 7ffa49600700 1 -- start start 2024-01-22T05:14:23.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa49600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffa440ac3b0 0x7ffa44159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa49600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffa44066690 0x7ffa44066af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa49600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa44067a90 0x7ffa44067f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa49600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa440a7cb0 con 0x7ffa44066690 2024-01-22T05:14:23.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa49600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa440a8b10 con 0x7ffa440ac3b0 2024-01-22T05:14:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa49600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa440a7f00 con 0x7ffa44067a90 2024-01-22T05:14:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa42000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffa44066690 0x7ffa44066af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa42000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffa44066690 0x7ffa44066af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46656/0 (socket says 172.21.15.49:46656) 2024-01-22T05:14:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa42000700 1 -- 172.21.15.49:0/2516071542 learned_addr learned my addr 172.21.15.49:0/2516071542 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa42000700 1 -- 172.21.15.49:0/2516071542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa44067a90 msgr2=0x7ffa44067f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa42000700 1 --2- 172.21.15.49:0/2516071542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa44067a90 0x7ffa44067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:14:23.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa42000700 1 -- 172.21.15.49:0/2516071542 >> v2:172.21.15.110:3300/0 conn(0x7ffa440ac3b0 msgr2=0x7ffa44159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa42000700 1 --2- 172.21.15.49:0/2516071542 >> v2:172.21.15.110:3300/0 conn(0x7ffa440ac3b0 0x7ffa44159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:14:23.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa42000700 1 -- 172.21.15.49:0/2516071542 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa440a81e0 con 0x7ffa44066690 2024-01-22T05:14:23.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa42000700 1 --2- 172.21.15.49:0/2516071542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa44066690 0x7ffa44066af0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7ffa440642d0 tx=0x7ffa2c0090f0).ready entity=mon.0 client_cookie=2afa82321d09e7d6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa41600700 1 -- 172.21.15.49:0/2516071542 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c00b600 con 0x7ffa44066690 2024-01-22T05:14:23.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa41600700 1 -- 172.21.15.49:0/2516071542 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2c00b760 con 0x7ffa44066690 2024-01-22T05:14:23.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa41600700 1 -- 172.21.15.49:0/2516071542 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c00bae0 con 0x7ffa44066690 2024-01-22T05:14:23.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa49600700 1 -- 172.21.15.49:0/2516071542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa44066690 msgr2=0x7ffa44066af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa49600700 1 --2- 172.21.15.49:0/2516071542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa44066690 0x7ffa44066af0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7ffa440642d0 tx=0x7ffa2c0090f0).stop 2024-01-22T05:14:23.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa49600700 1 -- 172.21.15.49:0/2516071542 shutdown_connections 2024-01-22T05:14:23.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa49600700 1 --2- 172.21.15.49:0/2516071542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa44067a90 0x7ffa44067f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:14:23.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa49600700 1 --2- 172.21.15.49:0/2516071542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa44066690 0x7ffa44066af0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa49600700 1 --2- 172.21.15.49:0/2516071542 >> v2:172.21.15.110:3300/0 conn(0x7ffa440ac3b0 0x7ffa44159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:14:23.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.127+0000 7ffa49600700 1 -- 172.21.15.49:0/2516071542 >> 172.21.15.49:0/2516071542 conn(0x7ffa440c6500 msgr2=0x7ffa440c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.131+0000 7ffa49600700 1 -- 172.21.15.49:0/2516071542 shutdown_connections 2024-01-22T05:14:23.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.131+0000 7ffa49600700 1 -- 172.21.15.49:0/2516071542 wait complete. 2024-01-22T05:14:23.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.131+0000 7ffa49600700 1 Processor -- start 2024-01-22T05:14:23.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.131+0000 7ffa49600700 1 -- start start 2024-01-22T05:14:23.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa49600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa44066690 0x7ffa44146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa49600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa44067a90 0x7ffa440c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa49600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa440ac3b0 0x7ffa440c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa49600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa440c5db0 con 0x7ffa44066690 2024-01-22T05:14:23.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa49600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4416bbf0 con 0x7ffa44067a90 2024-01-22T05:14:23.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa49600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4416be90 con 0x7ffa440ac3b0 2024-01-22T05:14:23.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa42a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa44066690 0x7ffa44146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa42a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa44066690 0x7ffa44146e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46664/0 (socket says 172.21.15.49:46664) 2024-01-22T05:14:23.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa42a00700 1 -- 172.21.15.49:0/1342246318 learned_addr learned my addr 172.21.15.49:0/1342246318 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa42000700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa44067a90 0x7ffa440c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa43400700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa440ac3b0 0x7ffa440c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa42a00700 1 -- 172.21.15.49:0/1342246318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa440ac3b0 msgr2=0x7ffa440c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa42a00700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa440ac3b0 0x7ffa440c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa42a00700 1 -- 172.21.15.49:0/1342246318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa44067a90 msgr2=0x7ffa440c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa42a00700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa44067a90 0x7ffa440c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa42a00700 1 -- 172.21.15.49:0/1342246318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2c009370 con 0x7ffa44066690 2024-01-22T05:14:23.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa42000700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa44067a90 0x7ffa440c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:23.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa43400700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa440ac3b0 0x7ffa440c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:23.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa42a00700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa44066690 0x7ffa44146e20 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7ffa3400b410 tx=0x7ffa34006f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa3a000700 1 -- 172.21.15.49:0/1342246318 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34002320 con 0x7ffa44066690 2024-01-22T05:14:23.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa3a000700 1 -- 172.21.15.49:0/1342246318 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa340024a0 con 0x7ffa44066690 2024-01-22T05:14:23.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa3a000700 1 -- 172.21.15.49:0/1342246318 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34002860 con 0x7ffa44066690 2024-01-22T05:14:23.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa49600700 1 -- 172.21.15.49:0/1342246318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4416c170 con 0x7ffa44066690 2024-01-22T05:14:23.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.135+0000 7ffa49600700 1 -- 172.21.15.49:0/1342246318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4416c730 con 0x7ffa44066690 2024-01-22T05:14:23.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.139+0000 7ffa3a000700 1 -- 172.21.15.49:0/1342246318 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ffa34002bd0 con 0x7ffa44066690 2024-01-22T05:14:23.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.139+0000 7ffa3a000700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa1c05a510 0x7ffa1c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.139+0000 7ffa3a000700 1 -- 172.21.15.49:0/1342246318 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ffa34074790 con 0x7ffa44066690 2024-01-22T05:14:23.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.139+0000 7ffa42000700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa1c05a510 0x7ffa1c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.143+0000 7ffa42000700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa1c05a510 0x7ffa1c05c9d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7ffa2c009130 tx=0x7ffa2c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.143+0000 7ffa53a08740 1 Processor -- start 2024-01-22T05:14:23.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.143+0000 7ffa53a08740 1 -- start start 2024-01-22T05:14:23.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa53a08740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f4020 0x26f4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa53a08740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26b0a10 0x26f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa53a08740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26d6b30 0x26f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa53a08740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x261b780 con 0x26f4020 2024-01-22T05:14:23.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa53a08740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x25fc340 con 0x26b0a10 2024-01-22T05:14:23.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa53a08740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x25e3530 con 0x26d6b30 2024-01-22T05:14:23.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa42a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f4020 0x26f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa42a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f4020 0x26f4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46672/0 (socket says 172.21.15.49:46672) 2024-01-22T05:14:23.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa42a00700 1 -- 172.21.15.49:0/2775114430 learned_addr learned my addr 172.21.15.49:0/2775114430 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa42000700 1 --2- 172.21.15.49:0/2775114430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26b0a10 0x26f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa43400700 1 --2- 172.21.15.49:0/2775114430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26d6b30 0x26f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa42a00700 1 -- 172.21.15.49:0/2775114430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26d6b30 msgr2=0x26f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa42a00700 1 --2- 172.21.15.49:0/2775114430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26d6b30 0x26f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa42a00700 1 -- 172.21.15.49:0/2775114430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26b0a10 msgr2=0x26f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa42a00700 1 --2- 172.21.15.49:0/2775114430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26b0a10 0x26f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa42a00700 1 -- 172.21.15.49:0/2775114430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x263c700 con 0x26f4020 2024-01-22T05:14:23.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa42a00700 1 --2- 172.21.15.49:0/2775114430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f4020 0x26f4400 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7ffa34009210 tx=0x7ffa3400e000).ready entity=mon.0 client_cookie=5c5dfa83ca5d5b80 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.147+0000 7ffa32600700 1 -- 172.21.15.49:0/2775114430 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34051130 con 0x26f4020 2024-01-22T05:14:23.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.151+0000 7ffa32600700 1 -- 172.21.15.49:0/2775114430 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3404b9b0 con 0x26f4020 2024-01-22T05:14:23.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.151+0000 7ffa32600700 1 -- 172.21.15.49:0/2775114430 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34019db0 con 0x26f4020 2024-01-22T05:14:23.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.151+0000 7ffa53a08740 1 -- 172.21.15.49:0/2775114430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f4020 msgr2=0x26f4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.151+0000 7ffa53a08740 1 --2- 172.21.15.49:0/2775114430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f4020 0x26f4400 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7ffa34009210 tx=0x7ffa3400e000).stop 2024-01-22T05:14:23.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.151+0000 7ffa53a08740 1 -- 172.21.15.49:0/2775114430 shutdown_connections 2024-01-22T05:14:23.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.151+0000 7ffa53a08740 1 --2- 172.21.15.49:0/2775114430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26d6b30 0x26f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.151+0000 7ffa53a08740 1 --2- 172.21.15.49:0/2775114430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26b0a10 0x26f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.151+0000 7ffa53a08740 1 --2- 172.21.15.49:0/2775114430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f4020 0x26f4400 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.151+0000 7ffa53a08740 1 -- 172.21.15.49:0/2775114430 >> 172.21.15.49:0/2775114430 conn(0x248f920 msgr2=0x26b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.151+0000 7ffa53a08740 1 -- 172.21.15.49:0/2775114430 shutdown_connections 2024-01-22T05:14:23.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.151+0000 7ffa53a08740 1 -- 172.21.15.49:0/2775114430 wait complete. 2024-01-22T05:14:23.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.151+0000 7ffa53a08740 1 -- start start 2024-01-22T05:14:23.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.155+0000 7ffa53a08740 1 Processor -- start 2024-01-22T05:14:23.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.155+0000 7ffa53a08740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d6b30 0x26d4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.155+0000 7ffa53a08740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f4020 0x26dafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.155+0000 7ffa53a08740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26f5ab0 0x26f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.155+0000 7ffa53a08740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x26da6c0 con 0x26d6b30 2024-01-22T05:14:23.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.155+0000 7ffa53a08740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x26d4d80 con 0x26f5ab0 2024-01-22T05:14:23.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.155+0000 7ffa53a08740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x26ee560 con 0x26f4020 2024-01-22T05:14:23.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa53a08740 10 client.0 ll_register_callbacks cb 0x2667e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:14:23.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa42a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d6b30 0x26d4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa42a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d6b30 0x26d4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46686/0 (socket says 172.21.15.49:46686) 2024-01-22T05:14:23.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa42a00700 1 -- 172.21.15.49:0/1495888666 learned_addr learned my addr 172.21.15.49:0/1495888666 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa42000700 1 --2- 172.21.15.49:0/1495888666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f4020 0x26dafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa43400700 1 --2- 172.21.15.49:0/1495888666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26f5ab0 0x26f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa42a00700 1 -- 172.21.15.49:0/1495888666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f4020 msgr2=0x26dafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa42a00700 1 --2- 172.21.15.49:0/1495888666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f4020 0x26dafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa42a00700 1 -- 172.21.15.49:0/1495888666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26f5ab0 msgr2=0x26f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa42a00700 1 --2- 172.21.15.49:0/1495888666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26f5ab0 0x26f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa42a00700 1 -- 172.21.15.49:0/1495888666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4416c730 con 0x26d6b30 2024-01-22T05:14:23.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa42000700 1 --2- 172.21.15.49:0/1495888666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f4020 0x26dafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:23.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa42a00700 1 --2- 172.21.15.49:0/1495888666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d6b30 0x26d4890 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7ffa34047f10 tx=0x7ffa34057000).ready entity=mon.0 client_cookie=4c1f55c309f2e80c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa2aa00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:14:23.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa2aa00700 1 -- 172.21.15.49:0/1495888666 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34019db0 con 0x26d6b30 2024-01-22T05:14:23.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa53a08740 1 -- 172.21.15.49:0/1495888666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2626e20 con 0x26d6b30 2024-01-22T05:14:23.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa2aa00700 1 -- 172.21.15.49:0/1495888666 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ffa3405fdf0 con 0x26d6b30 2024-01-22T05:14:23.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa2aa00700 1 -- 172.21.15.49:0/1495888666 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa3404b110 con 0x26d6b30 2024-01-22T05:14:23.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa53a08740 10 client.7923 fetch_fsmap learned FSMap version 98 2024-01-22T05:14:23.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa53a08740 1 -- 172.21.15.49:0/1495888666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x262a3b0 con 0x26d6b30 2024-01-22T05:14:23.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa2aa00700 1 -- 172.21.15.49:0/1495888666 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2626e20 con 0x26d6b30 2024-01-22T05:14:23.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa2aa00700 1 -- 172.21.15.49:0/1495888666 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 98) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffa34047800 con 0x26d6b30 2024-01-22T05:14:23.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa53a08740 10 client.7923 fetch_fsmap finished waiting for FSMap version 98 2024-01-22T05:14:23.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa53a08740 10 client.7923 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-01-22T05:14:23.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa53a08740 20 client.7923 populate_metadata read hostname 'smithi049' 2024-01-22T05:14:23.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa53a08740 1 --2- 172.21.15.49:0/1495888666 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x26ee6a0 0x26d74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa53a08740 4 client.7923 mds_command: new command op to 7743 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:14:23.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.159+0000 7ffa53a08740 1 -- 172.21.15.49:0/1495888666 --> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x261d370 con 0x26ee6a0 2024-01-22T05:14:23.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.163+0000 7ffa42000700 1 --2- 172.21.15.49:0/1495888666 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x26ee6a0 0x26d74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.163+0000 7ffa2aa00700 10 client.7923 ms_handle_connect on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.163+0000 7ffa42000700 1 --2- 172.21.15.49:0/1495888666 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x26ee6a0 0x26d74d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2c647df2417feec9 server_cookie=6790b92ffe9aca5a in_seq=0 out_seq=0 2024-01-22T05:14:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.163+0000 7ffa2aa00700 1 -- 172.21.15.49:0/1495888666 <== mds.0 v2:172.21.15.110:6832/1348218223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x261d370 con 0x26ee6a0 2024-01-22T05:14:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.163+0000 7ffa2aa00700 10 client.7923 handle_command_reply: tid=0 2024-01-22T05:14:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.163+0000 7ffa53a08740 1 client.7923 shutdown 2024-01-22T05:14:23.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.163+0000 7ffa53a08740 1 -- 172.21.15.49:0/1495888666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d6b30 msgr2=0x26d4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.163+0000 7ffa53a08740 1 --2- 172.21.15.49:0/1495888666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d6b30 0x26d4890 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7ffa34047f10 tx=0x7ffa34057000).stop 2024-01-22T05:14:23.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.167+0000 7ffa53a08740 1 -- 172.21.15.49:0/1495888666 shutdown_connections 2024-01-22T05:14:23.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.167+0000 7ffa53a08740 1 --2- 172.21.15.49:0/1495888666 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x26ee6a0 0x26d74d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.167+0000 7ffa53a08740 1 --2- 172.21.15.49:0/1495888666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26f5ab0 0x26f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.167+0000 7ffa53a08740 1 --2- 172.21.15.49:0/1495888666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f4020 0x26dafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.167+0000 7ffa53a08740 1 --2- 172.21.15.49:0/1495888666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d6b30 0x26d4890 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.167+0000 7ffa53a08740 1 -- 172.21.15.49:0/1495888666 >> 172.21.15.49:0/1495888666 conn(0x248f920 msgr2=0x26f7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.167+0000 7ffa2aa00700 0 client.7923 ms_handle_reset on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:23.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.167+0000 7ffa53a08740 1 -- 172.21.15.49:0/1495888666 shutdown_connections 2024-01-22T05:14:23.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.167+0000 7ffa53a08740 1 -- 172.21.15.49:0/1495888666 wait complete. 2024-01-22T05:14:23.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.167+0000 7ffa53a08740 20 client.7923 trim_cache size 0 max 16384 2024-01-22T05:14:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.187+0000 7ffa53a08740 1 Processor -- start 2024-01-22T05:14:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.187+0000 7ffa53a08740 1 -- start start 2024-01-22T05:14:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.187+0000 7ffa53a08740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d6b30 0x27029d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.187+0000 7ffa53a08740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f4020 0x26dada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.187+0000 7ffa53a08740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f5ab0 0x26db290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.187+0000 7ffa53a08740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x26f7220 con 0x26f4020 2024-01-22T05:14:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.187+0000 7ffa53a08740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x26d7f30 con 0x26d6b30 2024-01-22T05:14:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.187+0000 7ffa53a08740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x25fe1b0 con 0x26f5ab0 2024-01-22T05:14:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.187+0000 7ffa42000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f4020 0x26dada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.187+0000 7ffa42a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d6b30 0x27029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.187+0000 7ffa42a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d6b30 0x27029d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:35516/0 (socket says 172.21.15.49:35516) 2024-01-22T05:14:23.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.187+0000 7ffa42a00700 1 -- 172.21.15.49:0/2473023261 learned_addr learned my addr 172.21.15.49:0/2473023261 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.187+0000 7ffa42000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f4020 0x26dada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46698/0 (socket says 172.21.15.49:46698) 2024-01-22T05:14:23.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.187+0000 7ffa43400700 1 --2- 172.21.15.49:0/2473023261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f5ab0 0x26db290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa42a00700 1 -- 172.21.15.49:0/2473023261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f5ab0 msgr2=0x26db290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa42a00700 1 --2- 172.21.15.49:0/2473023261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f5ab0 0x26db290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa42a00700 1 -- 172.21.15.49:0/2473023261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f4020 msgr2=0x26dada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa42a00700 1 --2- 172.21.15.49:0/2473023261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f4020 0x26dada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa42a00700 1 -- 172.21.15.49:0/2473023261 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa440c1820 con 0x26d6b30 2024-01-22T05:14:23.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa42a00700 1 --2- 172.21.15.49:0/2473023261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d6b30 0x27029d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7ffa3404b300 tx=0x7ffa3405d000).ready entity=mon.1 client_cookie=fc014a1001496d41 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa33000700 1 -- 172.21.15.49:0/2473023261 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3404b110 con 0x26d6b30 2024-01-22T05:14:23.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa33000700 1 -- 172.21.15.49:0/2473023261 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3404b370 con 0x26d6b30 2024-01-22T05:14:23.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa33000700 1 -- 172.21.15.49:0/2473023261 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa340090f0 con 0x26d6b30 2024-01-22T05:14:23.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa53a08740 1 -- 172.21.15.49:0/2473023261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d6b30 msgr2=0x27029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa53a08740 1 --2- 172.21.15.49:0/2473023261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d6b30 0x27029d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7ffa3404b300 tx=0x7ffa3405d000).stop 2024-01-22T05:14:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa53a08740 1 -- 172.21.15.49:0/2473023261 shutdown_connections 2024-01-22T05:14:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa53a08740 1 --2- 172.21.15.49:0/2473023261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f5ab0 0x26db290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa53a08740 1 --2- 172.21.15.49:0/2473023261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f4020 0x26dada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa53a08740 1 --2- 172.21.15.49:0/2473023261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d6b30 0x27029d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa53a08740 1 -- 172.21.15.49:0/2473023261 >> 172.21.15.49:0/2473023261 conn(0x248f920 msgr2=0x26b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa53a08740 1 -- 172.21.15.49:0/2473023261 shutdown_connections 2024-01-22T05:14:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.191+0000 7ffa53a08740 1 -- 172.21.15.49:0/2473023261 wait complete. 2024-01-22T05:14:23.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.195+0000 7ffa53a08740 1 -- start start 2024-01-22T05:14:23.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.195+0000 7ffa53a08740 1 Processor -- start 2024-01-22T05:14:23.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa53a08740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d6b30 0x26dce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa53a08740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f4020 0x27566b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa53a08740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f5ab0 0x2756ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa53a08740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x26f6320 con 0x26f5ab0 2024-01-22T05:14:23.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa53a08740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x275ccd0 con 0x26d6b30 2024-01-22T05:14:23.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa53a08740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x275d130 con 0x26f4020 2024-01-22T05:14:23.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa53a08740 10 client.0 ll_register_callbacks cb 0x7ffa3c009790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:14:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa43400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f5ab0 0x2756ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa42a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d6b30 0x26dce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa42000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f4020 0x27566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa42000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f4020 0x27566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:47886/0 (socket says 172.21.15.49:47886) 2024-01-22T05:14:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa42000700 1 -- 172.21.15.49:0/2058501194 learned_addr learned my addr 172.21.15.49:0/2058501194 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa42000700 1 -- 172.21.15.49:0/2058501194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d6b30 msgr2=0x26dce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa42000700 1 --2- 172.21.15.49:0/2058501194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d6b30 0x26dce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa42000700 1 -- 172.21.15.49:0/2058501194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f5ab0 msgr2=0x2756ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa42000700 1 --2- 172.21.15.49:0/2058501194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f5ab0 0x2756ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa42000700 1 -- 172.21.15.49:0/2058501194 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x262a3b0 con 0x26f4020 2024-01-22T05:14:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa42000700 1 --2- 172.21.15.49:0/2058501194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f4020 0x27566b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7ffa2c00bc60 tx=0x7ffa2c026040).ready entity=mon.2 client_cookie=1bfa76a2c11c1278 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa2aa00700 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2024-01-22T05:14:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa2aa00700 1 -- 172.21.15.49:0/2058501194 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c029040 con 0x26f4020 2024-01-22T05:14:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa2aa00700 1 -- 172.21.15.49:0/2058501194 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ffa2c033030 con 0x26f4020 2024-01-22T05:14:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.199+0000 7ffa53a08740 1 -- 172.21.15.49:0/2058501194 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffa3404b9b0 con 0x26f4020 2024-01-22T05:14:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.203+0000 7ffa2aa00700 1 -- 172.21.15.49:0/2058501194 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa2c01f070 con 0x26f4020 2024-01-22T05:14:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.203+0000 7ffa53a08740 10 client.6905 fetch_fsmap learned FSMap version 98 2024-01-22T05:14:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.203+0000 7ffa53a08740 1 -- 172.21.15.49:0/2058501194 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x26255e0 con 0x26f4020 2024-01-22T05:14:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.203+0000 7ffa2aa00700 1 -- 172.21.15.49:0/2058501194 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3404b9b0 con 0x26f4020 2024-01-22T05:14:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.203+0000 7ffa2aa00700 1 -- 172.21.15.49:0/2058501194 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 98) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffa2c03b060 con 0x26f4020 2024-01-22T05:14:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.203+0000 7ffa53a08740 10 client.6905 fetch_fsmap finished waiting for FSMap version 98 2024-01-22T05:14:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.203+0000 7ffa53a08740 10 client.6905 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-01-22T05:14:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.203+0000 7ffa53a08740 20 client.6905 populate_metadata read hostname 'smithi049' 2024-01-22T05:14:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.203+0000 7ffa53a08740 1 --2- 172.21.15.49:0/2058501194 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x2759920 0x2759d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.203+0000 7ffa53a08740 4 client.6905 mds_command: new command op to 7743 tid=0[{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-01-22T05:14:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.203+0000 7ffa53a08740 1 -- 172.21.15.49:0/2058501194 --> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x24e68b0 con 0x2759920 2024-01-22T05:14:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.203+0000 7ffa42a00700 1 --2- 172.21.15.49:0/2058501194 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x2759920 0x2759d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.203+0000 7ffa2aa00700 10 client.6905 ms_handle_connect on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.203+0000 7ffa42a00700 1 --2- 172.21.15.49:0/2058501194 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x2759920 0x2759d00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=47c6f6ca0fce049d server_cookie=67759174916c5b8b in_seq=0 out_seq=0 2024-01-22T05:14:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.211+0000 7ffa2aa00700 1 -- 172.21.15.49:0/2058501194 <== mds.0 v2:172.21.15.110:6832/1348218223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x24e68b0 con 0x2759920 2024-01-22T05:14:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.211+0000 7ffa2aa00700 10 client.6905 handle_command_reply: tid=0 2024-01-22T05:14:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.211+0000 7ffa53a08740 1 client.6905 shutdown 2024-01-22T05:14:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.211+0000 7ffa53a08740 1 -- 172.21.15.49:0/2058501194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f4020 msgr2=0x27566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.211+0000 7ffa53a08740 1 --2- 172.21.15.49:0/2058501194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f4020 0x27566b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7ffa2c00bc60 tx=0x7ffa2c026040).stop 2024-01-22T05:14:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.211+0000 7ffa53a08740 1 -- 172.21.15.49:0/2058501194 shutdown_connections 2024-01-22T05:14:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.211+0000 7ffa53a08740 1 --2- 172.21.15.49:0/2058501194 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x2759920 0x2759d00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.211+0000 7ffa53a08740 1 --2- 172.21.15.49:0/2058501194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26f5ab0 0x2756ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.211+0000 7ffa53a08740 1 --2- 172.21.15.49:0/2058501194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26f4020 0x27566b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.211+0000 7ffa53a08740 1 --2- 172.21.15.49:0/2058501194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d6b30 0x26dce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.211+0000 7ffa2aa00700 0 client.6905 ms_handle_reset on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.211+0000 7ffa53a08740 1 -- 172.21.15.49:0/2058501194 >> 172.21.15.49:0/2058501194 conn(0x248f920 msgr2=0x26aa270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.211+0000 7ffa53a08740 1 -- 172.21.15.49:0/2058501194 shutdown_connections 2024-01-22T05:14:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.211+0000 7ffa53a08740 1 -- 172.21.15.49:0/2058501194 wait complete. 2024-01-22T05:14:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.211+0000 7ffa53a08740 20 client.6905 trim_cache size 0 max 16384 2024-01-22T05:14:23.214 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:14:23.215 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:14:23.215 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "6e497d85-b86a-4504-b18d-40c7ef591312", 2024-01-22T05:14:23.215 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:14:23.215 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:14:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.215+0000 7ffa49600700 1 -- 172.21.15.49:0/1342246318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa1c05a510 msgr2=0x7ffa1c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.215+0000 7ffa49600700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa1c05a510 0x7ffa1c05c9d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7ffa2c009130 tx=0x7ffa2c017000).stop 2024-01-22T05:14:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.215+0000 7ffa49600700 1 -- 172.21.15.49:0/1342246318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa44066690 msgr2=0x7ffa44146e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.215+0000 7ffa49600700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa44066690 0x7ffa44146e20 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7ffa3400b410 tx=0x7ffa34006f50).stop 2024-01-22T05:14:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.215+0000 7ffa49600700 1 -- 172.21.15.49:0/1342246318 shutdown_connections 2024-01-22T05:14:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.215+0000 7ffa49600700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ffa1c05a510 0x7ffa1c05c9d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.215+0000 7ffa49600700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa440ac3b0 0x7ffa440c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.215+0000 7ffa49600700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa44067a90 0x7ffa440c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.215+0000 7ffa49600700 1 --2- 172.21.15.49:0/1342246318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa44066690 0x7ffa44146e20 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.215+0000 7ffa49600700 1 -- 172.21.15.49:0/1342246318 >> 172.21.15.49:0/1342246318 conn(0x7ffa440c6500 msgr2=0x7ffa440c0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.215+0000 7ffa49600700 1 -- 172.21.15.49:0/1342246318 shutdown_connections 2024-01-22T05:14:23.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.215+0000 7ffa49600700 1 -- 172.21.15.49:0/1342246318 wait complete. 2024-01-22T05:14:23.241 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub pause 2024-01-22T05:14:23.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.411+0000 7f72a5e00700 1 Processor -- start 2024-01-22T05:14:23.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.411+0000 7f72a5e00700 1 -- start start 2024-01-22T05:14:23.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.415+0000 7f72a5e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f72a0154900 0x7f72a015e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.415+0000 7f72a5e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a0154f20 con 0x7f72a0062890 2024-01-22T05:14:23.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.415+0000 7f72a5e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a00659d0 con 0x7f72a00c5470 2024-01-22T05:14:23.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.415+0000 7f72a5e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a0065cb0 con 0x7f72a0154900 2024-01-22T05:14:23.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.415+0000 7f72a4a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f72a0062890 0x7f72a00c4d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33770/0 (socket says 172.21.15.49:33770) 2024-01-22T05:14:23.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.415+0000 7f72a4a00700 1 -- 172.21.15.49:0/4255928842 learned_addr learned my addr 172.21.15.49:0/4255928842 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:23.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.415+0000 7f72a5400700 1 --2- 172.21.15.49:0/4255928842 >> v2:172.21.15.49:3300/0 conn(0x7f72a0154900 0x7f72a015e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.415+0000 7f729f400700 1 -- 172.21.15.49:0/4255928842 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167193925 0 0) 0x7f72a0154f20 con 0x7f72a0062890 2024-01-22T05:14:23.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.415+0000 7f729f400700 1 -- 172.21.15.49:0/4255928842 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72800033f0 con 0x7f72a0062890 2024-01-22T05:14:23.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.415+0000 7f729f400700 1 -- 172.21.15.49:0/4255928842 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893641255 0 0) 0x7f72a00659d0 con 0x7f72a00c5470 2024-01-22T05:14:23.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.415+0000 7f729f400700 1 -- 172.21.15.49:0/4255928842 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a0154f20 con 0x7f72a00c5470 2024-01-22T05:14:23.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.415+0000 7f72a5400700 1 -- 172.21.15.49:0/4255928842 >> v1:172.21.15.110:6789/0 conn(0x7f72a00c5470 legacy=0x7f72a01541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.415+0000 7f72a5400700 1 -- 172.21.15.49:0/4255928842 >> v1:172.21.15.49:6789/0 conn(0x7f72a0062890 legacy=0x7f72a00c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.415+0000 7f72a5400700 1 -- 172.21.15.49:0/4255928842 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a0065f90 con 0x7f72a0154900 2024-01-22T05:14:23.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.419+0000 7f72a5400700 1 --2- 172.21.15.49:0/4255928842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72a0154900 0x7f72a015e9a0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f7298009e60 tx=0x7f7298009780).ready entity=mon.0 client_cookie=29dc13eeb7d17cad server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.419+0000 7f729f400700 1 -- 172.21.15.49:0/4255928842 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729800e070 con 0x7f72a0154900 2024-01-22T05:14:23.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.419+0000 7f729f400700 1 -- 172.21.15.49:0/4255928842 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729800bab0 con 0x7f72a0154900 2024-01-22T05:14:23.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.419+0000 7f729f400700 1 -- 172.21.15.49:0/4255928842 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729800be30 con 0x7f72a0154900 2024-01-22T05:14:23.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.419+0000 7f72a5e00700 1 -- 172.21.15.49:0/4255928842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72a0154900 msgr2=0x7f72a015e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.419+0000 7f72a5e00700 1 --2- 172.21.15.49:0/4255928842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72a0154900 0x7f72a015e9a0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f7298009e60 tx=0x7f7298009780).stop 2024-01-22T05:14:23.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.419+0000 7f72a5e00700 1 -- 172.21.15.49:0/4255928842 shutdown_connections 2024-01-22T05:14:23.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.419+0000 7f72a5e00700 1 --2- 172.21.15.49:0/4255928842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72a0154900 0x7f72a015e9a0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.419+0000 7f72a5e00700 1 -- 172.21.15.49:0/4255928842 >> 172.21.15.49:0/4255928842 conn(0x7f72a00c6920 msgr2=0x7f72a00c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.419+0000 7f72a5e00700 1 -- 172.21.15.49:0/4255928842 shutdown_connections 2024-01-22T05:14:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.419+0000 7f72a5e00700 1 -- 172.21.15.49:0/4255928842 wait complete. 2024-01-22T05:14:23.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.423+0000 7f72a5e00700 1 Processor -- start 2024-01-22T05:14:23.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.423+0000 7f72a5e00700 1 -- start start 2024-01-22T05:14:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f72a5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72a0062890 0x7f72a014c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f72a5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72a00c5470 0x7f72a00abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f72a5e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72a0154900 0x7f72a00be160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f72a5e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a00aa8e0 con 0x7f72a00c5470 2024-01-22T05:14:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f72a5e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a0167890 con 0x7f72a0154900 2024-01-22T05:14:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f72a5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a0167b70 con 0x7f72a0062890 2024-01-22T05:14:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f729fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72a00c5470 0x7f72a00abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f729fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72a00c5470 0x7f72a00abc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54814/0 (socket says 172.21.15.49:54814) 2024-01-22T05:14:23.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f729fe00700 1 -- 172.21.15.49:0/538667566 learned_addr learned my addr 172.21.15.49:0/538667566 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f72a4a00700 1 --2- 172.21.15.49:0/538667566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72a0062890 0x7f72a014c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f72a5400700 1 --2- 172.21.15.49:0/538667566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72a0154900 0x7f72a00be160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f729fe00700 1 -- 172.21.15.49:0/538667566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72a0062890 msgr2=0x7f72a014c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f729fe00700 1 --2- 172.21.15.49:0/538667566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72a0062890 0x7f72a014c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f729fe00700 1 -- 172.21.15.49:0/538667566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72a0154900 msgr2=0x7f72a00be160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f729fe00700 1 --2- 172.21.15.49:0/538667566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72a0154900 0x7f72a00be160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f729fe00700 1 -- 172.21.15.49:0/538667566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7298009a20 con 0x7f72a00c5470 2024-01-22T05:14:23.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f729fe00700 1 --2- 172.21.15.49:0/538667566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72a00c5470 0x7f72a00abc50 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f728800c490 tx=0x7f7288007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f7297e00700 1 -- 172.21.15.49:0/538667566 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728800ce40 con 0x7f72a00c5470 2024-01-22T05:14:23.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f7297e00700 1 -- 172.21.15.49:0/538667566 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728800f470 con 0x7f72a00c5470 2024-01-22T05:14:23.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f72a5e00700 1 -- 172.21.15.49:0/538667566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a0167e50 con 0x7f72a00c5470 2024-01-22T05:14:23.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.427+0000 7f7297e00700 1 -- 172.21.15.49:0/538667566 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728800f830 con 0x7f72a00c5470 2024-01-22T05:14:23.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.431+0000 7f72a5e00700 1 -- 172.21.15.49:0/538667566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a0167460 con 0x7f72a00c5470 2024-01-22T05:14:23.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.431+0000 7f7297e00700 1 -- 172.21.15.49:0/538667566 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f728800fbe0 con 0x7f72a00c5470 2024-01-22T05:14:23.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f7297e00700 1 --2- 172.21.15.49:0/538667566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f727805a510 0x7f727805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f7297e00700 1 -- 172.21.15.49:0/538667566 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7288073eb0 con 0x7f72a00c5470 2024-01-22T05:14:23.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f72b1810740 1 Processor -- start 2024-01-22T05:14:23.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f72a4a00700 1 --2- 172.21.15.49:0/538667566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f727805a510 0x7f727805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f72b1810740 1 -- start start 2024-01-22T05:14:23.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f72a4a00700 1 --2- 172.21.15.49:0/538667566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f727805a510 0x7f727805c9d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f7290005750 tx=0x7f7290009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f72b1810740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b55c0 0x22b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f72b1810740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b6170 0x2270cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f72b1810740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22711b0 0x2271610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f72b1810740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x21ae2a0 con 0x22711b0 2024-01-22T05:14:23.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f72b1810740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x21d14a0 con 0x22b6170 2024-01-22T05:14:23.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f72b1810740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x219ace0 con 0x22b55c0 2024-01-22T05:14:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f72a5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22711b0 0x2271610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f72a5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22711b0 0x2271610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54826/0 (socket says 172.21.15.49:54826) 2024-01-22T05:14:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f72a5400700 1 -- 172.21.15.49:0/2879615853 learned_addr learned my addr 172.21.15.49:0/2879615853 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f72a4a00700 1 --2- 172.21.15.49:0/2879615853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b55c0 0x22b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.435+0000 7f729fe00700 1 --2- 172.21.15.49:0/2879615853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b6170 0x2270cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f72a5400700 1 -- 172.21.15.49:0/2879615853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b55c0 msgr2=0x22b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f72a5400700 1 --2- 172.21.15.49:0/2879615853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b55c0 0x22b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f72a5400700 1 -- 172.21.15.49:0/2879615853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b6170 msgr2=0x2270cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f72a5400700 1 --2- 172.21.15.49:0/2879615853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b6170 0x2270cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f72a5400700 1 -- 172.21.15.49:0/2879615853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21ff8e0 con 0x22711b0 2024-01-22T05:14:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f72a5400700 1 --2- 172.21.15.49:0/2879615853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22711b0 0x2271610 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f729800b610 tx=0x7f7298009780).ready entity=mon.0 client_cookie=da0814cf28ffa29e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f728fe00700 1 -- 172.21.15.49:0/2879615853 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729800bd70 con 0x22711b0 2024-01-22T05:14:23.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f728fe00700 1 -- 172.21.15.49:0/2879615853 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729800bed0 con 0x22711b0 2024-01-22T05:14:23.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f728fe00700 1 -- 172.21.15.49:0/2879615853 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298012830 con 0x22711b0 2024-01-22T05:14:23.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f72b1810740 1 -- 172.21.15.49:0/2879615853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22711b0 msgr2=0x2271610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f72b1810740 1 --2- 172.21.15.49:0/2879615853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22711b0 0x2271610 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f729800b610 tx=0x7f7298009780).stop 2024-01-22T05:14:23.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f72b1810740 1 -- 172.21.15.49:0/2879615853 shutdown_connections 2024-01-22T05:14:23.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f72b1810740 1 --2- 172.21.15.49:0/2879615853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22711b0 0x2271610 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f72b1810740 1 --2- 172.21.15.49:0/2879615853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b6170 0x2270cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f72b1810740 1 --2- 172.21.15.49:0/2879615853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b55c0 0x22b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f72b1810740 1 -- 172.21.15.49:0/2879615853 >> 172.21.15.49:0/2879615853 conn(0x2053640 msgr2=0x22bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f72b1810740 1 -- 172.21.15.49:0/2879615853 shutdown_connections 2024-01-22T05:14:23.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.439+0000 7f72b1810740 1 -- 172.21.15.49:0/2879615853 wait complete. 2024-01-22T05:14:23.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.443+0000 7f72b1810740 1 -- start start 2024-01-22T05:14:23.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.443+0000 7f72b1810740 1 Processor -- start 2024-01-22T05:14:23.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.443+0000 7f72b1810740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22711b0 0x22b4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.443+0000 7f72b1810740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x2298ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.443+0000 7f72b1810740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b6170 0x229ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f72b1810740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x229def0 con 0x22b55c0 2024-01-22T05:14:23.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f72b1810740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x22b40e0 con 0x22b6170 2024-01-22T05:14:23.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f72b1810740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x22b1fc0 con 0x22711b0 2024-01-22T05:14:23.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f72b1810740 10 client.0 ll_register_callbacks cb 0x222b9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:14:23.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f729fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x2298ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f729fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x2298ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54838/0 (socket says 172.21.15.49:54838) 2024-01-22T05:14:23.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f729fe00700 1 -- 172.21.15.49:0/3485109264 learned_addr learned my addr 172.21.15.49:0/3485109264 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f72a5400700 1 --2- 172.21.15.49:0/3485109264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b6170 0x229ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f72a4a00700 1 --2- 172.21.15.49:0/3485109264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22711b0 0x22b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f729fe00700 1 -- 172.21.15.49:0/3485109264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22711b0 msgr2=0x22b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f729fe00700 1 --2- 172.21.15.49:0/3485109264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22711b0 0x22b4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f729fe00700 1 -- 172.21.15.49:0/3485109264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b6170 msgr2=0x229ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f729fe00700 1 --2- 172.21.15.49:0/3485109264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b6170 0x229ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f729fe00700 1 -- 172.21.15.49:0/3485109264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a0065f90 con 0x22b55c0 2024-01-22T05:14:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f729fe00700 1 --2- 172.21.15.49:0/3485109264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x2298ec0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f728804b060 tx=0x7f728800f000).ready entity=mon.0 client_cookie=1f8f30eee56ed41c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f728cc00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:14:23.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f728cc00700 1 -- 172.21.15.49:0/3485109264 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728804ac70 con 0x22b55c0 2024-01-22T05:14:23.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f728cc00700 1 -- 172.21.15.49:0/3485109264 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f728804a890 con 0x22b55c0 2024-01-22T05:14:23.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f72b1810740 1 -- 172.21.15.49:0/3485109264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x21eb1f0 con 0x22b55c0 2024-01-22T05:14:23.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f728cc00700 1 -- 172.21.15.49:0/3485109264 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7288047130 con 0x22b55c0 2024-01-22T05:14:23.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f72b1810740 10 client.7944 fetch_fsmap learned FSMap version 98 2024-01-22T05:14:23.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f72b1810740 1 -- 172.21.15.49:0/3485109264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x21ee780 con 0x22b55c0 2024-01-22T05:14:23.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f728cc00700 1 -- 172.21.15.49:0/3485109264 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x21eb1f0 con 0x22b55c0 2024-01-22T05:14:23.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f728cc00700 1 -- 172.21.15.49:0/3485109264 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 98) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f728804a090 con 0x22b55c0 2024-01-22T05:14:23.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f72b1810740 10 client.7944 fetch_fsmap finished waiting for FSMap version 98 2024-01-22T05:14:23.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f72b1810740 10 client.7944 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-01-22T05:14:23.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f72b1810740 20 client.7944 populate_metadata read hostname 'smithi049' 2024-01-22T05:14:23.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f72b1810740 1 --2- 172.21.15.49:0/3485109264 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x22ca210 0x22ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f72b1810740 4 client.7944 mds_command: new command op to 7743 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:14:23.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.447+0000 7f72b1810740 1 -- 172.21.15.49:0/3485109264 --> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x21e1740 con 0x22ca210 2024-01-22T05:14:23.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.451+0000 7f72a4a00700 1 --2- 172.21.15.49:0/3485109264 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x22ca210 0x22ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.451+0000 7f72a4a00700 1 --2- 172.21.15.49:0/3485109264 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x22ca210 0x22ca5f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e1080b92aa4308cf server_cookie=9aa1e4bf8adc8803 in_seq=0 out_seq=0 2024-01-22T05:14:23.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.451+0000 7f728cc00700 10 client.7944 ms_handle_connect on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:23.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.451+0000 7f728cc00700 1 -- 172.21.15.49:0/3485109264 <== mds.0 v2:172.21.15.110:6832/1348218223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x21e1740 con 0x22ca210 2024-01-22T05:14:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.451+0000 7f728cc00700 10 client.7944 handle_command_reply: tid=0 2024-01-22T05:14:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.451+0000 7f72b1810740 1 client.7944 shutdown 2024-01-22T05:14:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.451+0000 7f72b1810740 1 -- 172.21.15.49:0/3485109264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 msgr2=0x2298ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.451+0000 7f72b1810740 1 --2- 172.21.15.49:0/3485109264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x2298ec0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f728804b060 tx=0x7f728800f000).stop 2024-01-22T05:14:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.451+0000 7f72b1810740 1 -- 172.21.15.49:0/3485109264 shutdown_connections 2024-01-22T05:14:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.451+0000 7f72b1810740 1 --2- 172.21.15.49:0/3485109264 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x22ca210 0x22ca5f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.451+0000 7f72b1810740 1 --2- 172.21.15.49:0/3485109264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b6170 0x229ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.451+0000 7f72b1810740 1 --2- 172.21.15.49:0/3485109264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x2298ec0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.451+0000 7f72b1810740 1 --2- 172.21.15.49:0/3485109264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22711b0 0x22b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.451+0000 7f728cc00700 0 client.7944 ms_handle_reset on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.451+0000 7f72b1810740 1 -- 172.21.15.49:0/3485109264 >> 172.21.15.49:0/3485109264 conn(0x2053640 msgr2=0x22b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.455+0000 7f72b1810740 1 -- 172.21.15.49:0/3485109264 shutdown_connections 2024-01-22T05:14:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.455+0000 7f72b1810740 1 -- 172.21.15.49:0/3485109264 wait complete. 2024-01-22T05:14:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.455+0000 7f72b1810740 20 client.7944 trim_cache size 0 max 16384 2024-01-22T05:14:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.471+0000 7f72b1810740 1 Processor -- start 2024-01-22T05:14:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.471+0000 7f72b1810740 1 -- start start 2024-01-22T05:14:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f72b1810740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22711b0 0x2272980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f72b1810740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x2297520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f72b1810740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b6170 0x2297a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f72b1810740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2274df0 con 0x22b55c0 2024-01-22T05:14:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f72b1810740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x22b2100 con 0x22711b0 2024-01-22T05:14:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f72b1810740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x21e1740 con 0x22b6170 2024-01-22T05:14:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f729fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x2297520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f729fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x2297520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54852/0 (socket says 172.21.15.49:54852) 2024-01-22T05:14:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f729fe00700 1 -- 172.21.15.49:0/91910476 learned_addr learned my addr 172.21.15.49:0/91910476 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f72a5400700 1 --2- 172.21.15.49:0/91910476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b6170 0x2297a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f72a4a00700 1 --2- 172.21.15.49:0/91910476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22711b0 0x2272980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f729fe00700 1 -- 172.21.15.49:0/91910476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b6170 msgr2=0x2297a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f729fe00700 1 --2- 172.21.15.49:0/91910476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b6170 0x2297a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f729fe00700 1 -- 172.21.15.49:0/91910476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22711b0 msgr2=0x2272980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f729fe00700 1 --2- 172.21.15.49:0/91910476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22711b0 0x2272980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f729fe00700 1 -- 172.21.15.49:0/91910476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2299220 con 0x22b55c0 2024-01-22T05:14:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f72a5400700 1 --2- 172.21.15.49:0/91910476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b6170 0x2297a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:14:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f72a4a00700 1 --2- 172.21.15.49:0/91910476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22711b0 0x2272980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:14:23.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f729fe00700 1 --2- 172.21.15.49:0/91910476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x2297520 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f7288007fd0 tx=0x7f728805c000).ready entity=mon.0 client_cookie=f610317069feaa8e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f7295200700 1 -- 172.21.15.49:0/91910476 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728804ac70 con 0x22b55c0 2024-01-22T05:14:23.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f7295200700 1 -- 172.21.15.49:0/91910476 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728804a890 con 0x22b55c0 2024-01-22T05:14:23.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f7295200700 1 -- 172.21.15.49:0/91910476 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288047130 con 0x22b55c0 2024-01-22T05:14:23.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f72b1810740 1 -- 172.21.15.49:0/91910476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 msgr2=0x2297520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.475+0000 7f72b1810740 1 --2- 172.21.15.49:0/91910476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x2297520 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f7288007fd0 tx=0x7f728805c000).stop 2024-01-22T05:14:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.479+0000 7f72b1810740 1 -- 172.21.15.49:0/91910476 shutdown_connections 2024-01-22T05:14:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.479+0000 7f72b1810740 1 --2- 172.21.15.49:0/91910476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b6170 0x2297a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.479+0000 7f72b1810740 1 --2- 172.21.15.49:0/91910476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x2297520 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.479+0000 7f72b1810740 1 --2- 172.21.15.49:0/91910476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22711b0 0x2272980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.479+0000 7f72b1810740 1 -- 172.21.15.49:0/91910476 >> 172.21.15.49:0/91910476 conn(0x2053640 msgr2=0x22b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.479+0000 7f72b1810740 1 -- 172.21.15.49:0/91910476 shutdown_connections 2024-01-22T05:14:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.479+0000 7f72b1810740 1 -- 172.21.15.49:0/91910476 wait complete. 2024-01-22T05:14:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.479+0000 7f72b1810740 1 -- start start 2024-01-22T05:14:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.479+0000 7f72b1810740 1 Processor -- start 2024-01-22T05:14:23.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.479+0000 7f72b1810740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22711b0 0x22d4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.479+0000 7f72b1810740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x22d6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.479+0000 7f72b1810740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b6170 0x22d6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.479+0000 7f72b1810740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x22d7860 con 0x22b55c0 2024-01-22T05:14:23.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.479+0000 7f72b1810740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x22b6f60 con 0x22b6170 2024-01-22T05:14:23.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.479+0000 7f72b1810740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x22d3d00 con 0x22711b0 2024-01-22T05:14:23.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f72b1810740 10 client.0 ll_register_callbacks cb 0x7f7288072280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:14:23.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f729fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x22d6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f729fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x22d6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54858/0 (socket says 172.21.15.49:54858) 2024-01-22T05:14:23.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f729fe00700 1 -- 172.21.15.49:0/113928870 learned_addr learned my addr 172.21.15.49:0/113928870 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f72a4a00700 1 --2- 172.21.15.49:0/113928870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22711b0 0x22d4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f72a5400700 1 --2- 172.21.15.49:0/113928870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b6170 0x22d6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f729fe00700 1 -- 172.21.15.49:0/113928870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22711b0 msgr2=0x22d4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f729fe00700 1 --2- 172.21.15.49:0/113928870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22711b0 0x22d4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f729fe00700 1 -- 172.21.15.49:0/113928870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b6170 msgr2=0x22d6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f729fe00700 1 --2- 172.21.15.49:0/113928870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b6170 0x22d6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f729fe00700 1 -- 172.21.15.49:0/113928870 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x21ee780 con 0x22b55c0 2024-01-22T05:14:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f729fe00700 1 --2- 172.21.15.49:0/113928870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x22d6ad0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f728804aa20 tx=0x7f728805b070).ready entity=mon.0 client_cookie=8d69d8540a4de0e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f728cc00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:14:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f728cc00700 1 -- 172.21.15.49:0/113928870 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728804ac70 con 0x22b55c0 2024-01-22T05:14:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f72b1810740 1 -- 172.21.15.49:0/113928870 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f729800bed0 con 0x22b55c0 2024-01-22T05:14:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f728cc00700 1 -- 172.21.15.49:0/113928870 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f728804fe10 con 0x22b55c0 2024-01-22T05:14:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f728cc00700 1 -- 172.21.15.49:0/113928870 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7288049790 con 0x22b55c0 2024-01-22T05:14:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f72b1810740 10 client.7950 fetch_fsmap learned FSMap version 98 2024-01-22T05:14:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f72b1810740 1 -- 172.21.15.49:0/113928870 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x22ca950 con 0x22b55c0 2024-01-22T05:14:23.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f728cc00700 1 -- 172.21.15.49:0/113928870 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729800bed0 con 0x22b55c0 2024-01-22T05:14:23.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f728cc00700 1 -- 172.21.15.49:0/113928870 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 98) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f72880498f0 con 0x22b55c0 2024-01-22T05:14:23.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f72b1810740 10 client.7950 fetch_fsmap finished waiting for FSMap version 98 2024-01-22T05:14:23.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f72b1810740 10 client.7950 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-01-22T05:14:23.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f72b1810740 20 client.7950 populate_metadata read hostname 'smithi049' 2024-01-22T05:14:23.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f72b1810740 1 --2- 172.21.15.49:0/113928870 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x22d94c0 0x2272980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f72b1810740 4 client.7950 mds_command: new command op to 7743 tid=0[{"prefix": "scrub pause"}] 2024-01-22T05:14:23.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f72b1810740 1 -- 172.21.15.49:0/113928870 --> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x20aa5d0 con 0x22d94c0 2024-01-22T05:14:23.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.483+0000 7f72a4a00700 1 --2- 172.21.15.49:0/113928870 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x22d94c0 0x2272980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f72a4a00700 1 --2- 172.21.15.49:0/113928870 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x22d94c0 0x2272980 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=565b3909a48fb86c server_cookie=e872a13159a26bbb in_seq=0 out_seq=0 2024-01-22T05:14:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f728cc00700 10 client.7950 ms_handle_connect on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f728cc00700 1 -- 172.21.15.49:0/113928870 <== mds.0 v2:172.21.15.110:6832/1348218223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x20aa5d0 con 0x22d94c0 2024-01-22T05:14:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f728cc00700 10 client.7950 handle_command_reply: tid=0 2024-01-22T05:14:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f72b1810740 1 client.7950 shutdown 2024-01-22T05:14:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f72b1810740 1 -- 172.21.15.49:0/113928870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 msgr2=0x22d6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f72b1810740 1 --2- 172.21.15.49:0/113928870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x22d6ad0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f728804aa20 tx=0x7f728805b070).stop 2024-01-22T05:14:23.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f72b1810740 1 -- 172.21.15.49:0/113928870 shutdown_connections 2024-01-22T05:14:23.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f72b1810740 1 --2- 172.21.15.49:0/113928870 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x22d94c0 0x2272980 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f72b1810740 1 --2- 172.21.15.49:0/113928870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b6170 0x22d6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f728cc00700 0 client.7950 ms_handle_reset on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:23.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f72b1810740 1 --2- 172.21.15.49:0/113928870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b55c0 0x22d6ad0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f72b1810740 1 --2- 172.21.15.49:0/113928870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22711b0 0x22d4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f72b1810740 1 -- 172.21.15.49:0/113928870 >> 172.21.15.49:0/113928870 conn(0x2053640 msgr2=0x22b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f72b1810740 1 -- 172.21.15.49:0/113928870 shutdown_connections 2024-01-22T05:14:23.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f72b1810740 1 -- 172.21.15.49:0/113928870 wait complete. 2024-01-22T05:14:23.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.487+0000 7f72b1810740 20 client.7950 trim_cache size 0 max 16384 2024-01-22T05:14:23.491 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:14:23.491 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:14:23.491 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:14:23.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.491+0000 7f72a5e00700 1 -- 172.21.15.49:0/538667566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f727805a510 msgr2=0x7f727805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.491+0000 7f72a5e00700 1 --2- 172.21.15.49:0/538667566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f727805a510 0x7f727805c9d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f7290005750 tx=0x7f7290009040).stop 2024-01-22T05:14:23.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.491+0000 7f72a5e00700 1 -- 172.21.15.49:0/538667566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72a00c5470 msgr2=0x7f72a00abc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.491+0000 7f72a5e00700 1 --2- 172.21.15.49:0/538667566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72a00c5470 0x7f72a00abc50 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f728800c490 tx=0x7f7288007c60).stop 2024-01-22T05:14:23.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.491+0000 7f72a5e00700 1 -- 172.21.15.49:0/538667566 shutdown_connections 2024-01-22T05:14:23.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.491+0000 7f72a5e00700 1 --2- 172.21.15.49:0/538667566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f727805a510 0x7f727805c9d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.491+0000 7f72a5e00700 1 --2- 172.21.15.49:0/538667566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72a0154900 0x7f72a00be160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.491+0000 7f72a5e00700 1 --2- 172.21.15.49:0/538667566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72a00c5470 0x7f72a00abc50 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.491+0000 7f72a5e00700 1 --2- 172.21.15.49:0/538667566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72a0062890 0x7f72a014c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.491+0000 7f72a5e00700 1 -- 172.21.15.49:0/538667566 >> 172.21.15.49:0/538667566 conn(0x7f72a00c6920 msgr2=0x7f72a0154020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.491+0000 7f72a5e00700 1 -- 172.21.15.49:0/538667566 shutdown_connections 2024-01-22T05:14:23.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.491+0000 7f72a5e00700 1 -- 172.21.15.49:0/538667566 wait complete. 2024-01-22T05:14:23.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2024-01-22T05:14:23.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.683+0000 7f53d8800700 1 Processor -- start 2024-01-22T05:14:23.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.683+0000 7f53d8800700 1 -- start start 2024-01-22T05:14:23.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.683+0000 7f53d8800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d00c1960 0x7f53d01557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.683+0000 7f53d8800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d0062d90 con 0x7f53d0155c90 2024-01-22T05:14:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.683+0000 7f53d8800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d0062a60 con 0x7f53d00691b0 2024-01-22T05:14:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.683+0000 7f53d8800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00c2b50 con 0x7f53d00c1960 2024-01-22T05:14:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.683+0000 7f53d5400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f53d0155c90 0x7f53d0068aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33786/0 (socket says 172.21.15.49:33786) 2024-01-22T05:14:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.683+0000 7f53d5400700 1 -- 172.21.15.49:0/731498842 learned_addr learned my addr 172.21.15.49:0/731498842 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.687+0000 7f53d5e00700 1 --2- 172.21.15.49:0/731498842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d00c1960 0x7f53d01557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.687+0000 7f53d4a00700 1 -- 172.21.15.49:0/731498842 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232700637 0 0) 0x7f53d0062d90 con 0x7f53d0155c90 2024-01-22T05:14:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.687+0000 7f53d4a00700 1 -- 172.21.15.49:0/731498842 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53b00033f0 con 0x7f53d0155c90 2024-01-22T05:14:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.687+0000 7f53d4a00700 1 -- 172.21.15.49:0/731498842 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893851681 0 0) 0x7f53d0062a60 con 0x7f53d00691b0 2024-01-22T05:14:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.687+0000 7f53d4a00700 1 -- 172.21.15.49:0/731498842 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53d0062d90 con 0x7f53d00691b0 2024-01-22T05:14:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.687+0000 7f53d5e00700 1 -- 172.21.15.49:0/731498842 >> v1:172.21.15.110:6789/0 conn(0x7f53d00691b0 legacy=0x7f53d0063220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.687+0000 7f53d4a00700 1 -- 172.21.15.49:0/731498842 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 336952786 0 0) 0x7f53b00033f0 con 0x7f53d0155c90 2024-01-22T05:14:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.687+0000 7f53d5e00700 1 -- 172.21.15.49:0/731498842 >> v1:172.21.15.49:6789/0 conn(0x7f53d0155c90 legacy=0x7f53d0068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.687+0000 7f53d5e00700 1 -- 172.21.15.49:0/731498842 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d00c22b0 con 0x7f53d00c1960 2024-01-22T05:14:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.687+0000 7f53d5e00700 1 --2- 172.21.15.49:0/731498842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d00c1960 0x7f53d01557a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f53c0009790 tx=0x7f53c0009060).ready entity=mon.2 client_cookie=a7ac9a024ab643c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.687+0000 7f53d4a00700 1 -- 172.21.15.49:0/731498842 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8001470 con 0x7f53d00c1960 2024-01-22T05:14:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.687+0000 7f53d4a00700 1 -- 172.21.15.49:0/731498842 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c0011400 con 0x7f53d00c1960 2024-01-22T05:14:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.687+0000 7f53d4a00700 1 -- 172.21.15.49:0/731498842 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0011780 con 0x7f53d00c1960 2024-01-22T05:14:23.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.687+0000 7f53d8800700 1 -- 172.21.15.49:0/731498842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d00c1960 msgr2=0x7f53d01557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.687+0000 7f53d8800700 1 --2- 172.21.15.49:0/731498842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d00c1960 0x7f53d01557a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f53c0009790 tx=0x7f53c0009060).stop 2024-01-22T05:14:23.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.691+0000 7f53d8800700 1 -- 172.21.15.49:0/731498842 shutdown_connections 2024-01-22T05:14:23.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.691+0000 7f53d8800700 1 --2- 172.21.15.49:0/731498842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d00c1960 0x7f53d01557a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.691+0000 7f53d8800700 1 -- 172.21.15.49:0/731498842 >> 172.21.15.49:0/731498842 conn(0x7f53d00c4310 msgr2=0x7f53d0065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.691+0000 7f53d8800700 1 -- 172.21.15.49:0/731498842 shutdown_connections 2024-01-22T05:14:23.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.691+0000 7f53d8800700 1 -- 172.21.15.49:0/731498842 wait complete. 2024-01-22T05:14:23.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.691+0000 7f53d8800700 1 Processor -- start 2024-01-22T05:14:23.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.691+0000 7f53d8800700 1 -- start start 2024-01-22T05:14:23.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d8800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d00691b0 0x7f53d0150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d8800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00c1960 0x7f53d0150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d8800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d0155c90 0x7f53d00c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d8800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d0151410 con 0x7f53d00c1960 2024-01-22T05:14:23.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d8800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00bef90 con 0x7f53d0155c90 2024-01-22T05:14:23.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d8800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00be0a0 con 0x7f53d00691b0 2024-01-22T05:14:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00c1960 0x7f53d0150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00c1960 0x7f53d0150f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54874/0 (socket says 172.21.15.49:54874) 2024-01-22T05:14:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d5400700 1 -- 172.21.15.49:0/3615273821 learned_addr learned my addr 172.21.15.49:0/3615273821 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d6800700 1 --2- 172.21.15.49:0/3615273821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d0155c90 0x7f53d00c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d5e00700 1 --2- 172.21.15.49:0/3615273821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d00691b0 0x7f53d0150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d5400700 1 -- 172.21.15.49:0/3615273821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d00691b0 msgr2=0x7f53d0150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d5400700 1 --2- 172.21.15.49:0/3615273821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d00691b0 0x7f53d0150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d5400700 1 -- 172.21.15.49:0/3615273821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d0155c90 msgr2=0x7f53d00c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d5400700 1 --2- 172.21.15.49:0/3615273821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d0155c90 0x7f53d00c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d5400700 1 -- 172.21.15.49:0/3615273821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c00092a0 con 0x7f53d00c1960 2024-01-22T05:14:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d6800700 1 --2- 172.21.15.49:0/3615273821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d0155c90 0x7f53d00c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:23.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d5400700 1 --2- 172.21.15.49:0/3615273821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00c1960 0x7f53d0150f20 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f53b800c7c0 tx=0x7f53b8001980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53cd600700 1 -- 172.21.15.49:0/3615273821 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b80072e0 con 0x7f53d00c1960 2024-01-22T05:14:23.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53cd600700 1 -- 172.21.15.49:0/3615273821 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b8007460 con 0x7f53d00c1960 2024-01-22T05:14:23.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d8800700 1 -- 172.21.15.49:0/3615273821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d00be380 con 0x7f53d00c1960 2024-01-22T05:14:23.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53cd600700 1 -- 172.21.15.49:0/3615273821 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b80059b0 con 0x7f53d00c1960 2024-01-22T05:14:23.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.695+0000 7f53d8800700 1 -- 172.21.15.49:0/3615273821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d00be940 con 0x7f53d00c1960 2024-01-22T05:14:23.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.699+0000 7f53cd600700 1 -- 172.21.15.49:0/3615273821 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f53b8005d20 con 0x7f53d00c1960 2024-01-22T05:14:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.703+0000 7f53cd600700 1 --2- 172.21.15.49:0/3615273821 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53a805a510 0x7f53a805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.703+0000 7f53cd600700 1 -- 172.21.15.49:0/3615273821 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f53b8074200 con 0x7f53d00c1960 2024-01-22T05:14:23.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.703+0000 7f53d5e00700 1 --2- 172.21.15.49:0/3615273821 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53a805a510 0x7f53a805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.703+0000 7f53d5e00700 1 --2- 172.21.15.49:0/3615273821 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53a805a510 0x7f53a805c9d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f53c00096e0 tx=0x7f53c0016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.703+0000 7f53e2cc3740 1 Processor -- start 2024-01-22T05:14:23.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.703+0000 7f53e2cc3740 1 -- start start 2024-01-22T05:14:23.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.703+0000 7f53e2cc3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x224d4d0 0x224d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.703+0000 7f53e2cc3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2254570 0x22549f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.703+0000 7f53e2cc3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254ee0 0x22334f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.703+0000 7f53e2cc3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2165540 con 0x224d4d0 2024-01-22T05:14:23.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.703+0000 7f53e2cc3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2128e90 con 0x2254ee0 2024-01-22T05:14:23.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.703+0000 7f53e2cc3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x212ed90 con 0x2254570 2024-01-22T05:14:23.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53d5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x224d4d0 0x224d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53d5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x224d4d0 0x224d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54878/0 (socket says 172.21.15.49:54878) 2024-01-22T05:14:23.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53d5e00700 1 -- 172.21.15.49:0/3513547239 learned_addr learned my addr 172.21.15.49:0/3513547239 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53d6800700 1 --2- 172.21.15.49:0/3513547239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254ee0 0x22334f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53d5400700 1 --2- 172.21.15.49:0/3513547239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2254570 0x22549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53d5e00700 1 -- 172.21.15.49:0/3513547239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2254570 msgr2=0x22549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53d5e00700 1 --2- 172.21.15.49:0/3513547239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2254570 0x22549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53d5e00700 1 -- 172.21.15.49:0/3513547239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254ee0 msgr2=0x22334f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53d5e00700 1 --2- 172.21.15.49:0/3513547239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254ee0 0x22334f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53d5e00700 1 -- 172.21.15.49:0/3513547239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21934c0 con 0x224d4d0 2024-01-22T05:14:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53d5e00700 1 --2- 172.21.15.49:0/3513547239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x224d4d0 0x224d8b0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f53d0065730 tx=0x7f53c0020070).ready entity=mon.0 client_cookie=90bb8284ca002973 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53c5c00700 1 -- 172.21.15.49:0/3513547239 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c001e4e0 con 0x224d4d0 2024-01-22T05:14:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53c5c00700 1 -- 172.21.15.49:0/3513547239 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c001e640 con 0x224d4d0 2024-01-22T05:14:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53c5c00700 1 -- 172.21.15.49:0/3513547239 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c001e9e0 con 0x224d4d0 2024-01-22T05:14:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3513547239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x224d4d0 msgr2=0x224d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/3513547239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x224d4d0 0x224d8b0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f53d0065730 tx=0x7f53c0020070).stop 2024-01-22T05:14:23.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3513547239 shutdown_connections 2024-01-22T05:14:23.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/3513547239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254ee0 0x22334f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/3513547239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2254570 0x22549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/3513547239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x224d4d0 0x224d8b0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3513547239 >> 172.21.15.49:0/3513547239 conn(0x1fe7680 msgr2=0x2206de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3513547239 shutdown_connections 2024-01-22T05:14:23.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.707+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3513547239 wait complete. 2024-01-22T05:14:23.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53e2cc3740 1 -- start start 2024-01-22T05:14:23.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53e2cc3740 1 Processor -- start 2024-01-22T05:14:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53e2cc3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x224d4d0 0x2229f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53e2cc3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254570 0x222a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53e2cc3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2254ee0 0x222c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53e2cc3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x222f1e0 con 0x224d4d0 2024-01-22T05:14:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53e2cc3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2228a50 con 0x2254570 2024-01-22T05:14:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53e2cc3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2228c90 con 0x2254ee0 2024-01-22T05:14:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53e2cc3740 10 client.0 ll_register_callbacks cb 0x21bf5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:14:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53d5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x224d4d0 0x2229f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53d5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x224d4d0 0x2229f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54882/0 (socket says 172.21.15.49:54882) 2024-01-22T05:14:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53d5e00700 1 -- 172.21.15.49:0/3327833283 learned_addr learned my addr 172.21.15.49:0/3327833283 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53d6800700 1 --2- 172.21.15.49:0/3327833283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2254ee0 0x222c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53d5400700 1 --2- 172.21.15.49:0/3327833283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254570 0x222a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53d5e00700 1 -- 172.21.15.49:0/3327833283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2254ee0 msgr2=0x222c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53d5e00700 1 --2- 172.21.15.49:0/3327833283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2254ee0 0x222c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53d5e00700 1 -- 172.21.15.49:0/3327833283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254570 msgr2=0x222a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.711+0000 7f53d5e00700 1 --2- 172.21.15.49:0/3327833283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254570 0x222a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53d5e00700 1 -- 172.21.15.49:0/3327833283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d00c22b0 con 0x224d4d0 2024-01-22T05:14:23.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53d5e00700 1 --2- 172.21.15.49:0/3327833283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x224d4d0 0x2229f80 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f53c0009270 tx=0x7f53c0029000).ready entity=mon.0 client_cookie=f2fdc66019e24322 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53be000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:14:23.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53be000700 1 -- 172.21.15.49:0/3327833283 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0032650 con 0x224d4d0 2024-01-22T05:14:23.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3327833283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x217f230 con 0x224d4d0 2024-01-22T05:14:23.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53be000700 1 -- 172.21.15.49:0/3327833283 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f53c00327b0 con 0x224d4d0 2024-01-22T05:14:23.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53be000700 1 -- 172.21.15.49:0/3327833283 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53c0032b80 con 0x224d4d0 2024-01-22T05:14:23.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53e2cc3740 10 client.7962 fetch_fsmap learned FSMap version 98 2024-01-22T05:14:23.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3327833283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x21827c0 con 0x224d4d0 2024-01-22T05:14:23.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53be000700 1 -- 172.21.15.49:0/3327833283 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x217f230 con 0x224d4d0 2024-01-22T05:14:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53be000700 1 -- 172.21.15.49:0/3327833283 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 98) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f53c002f070 con 0x224d4d0 2024-01-22T05:14:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53e2cc3740 10 client.7962 fetch_fsmap finished waiting for FSMap version 98 2024-01-22T05:14:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53e2cc3740 10 client.7962 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-01-22T05:14:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53e2cc3740 20 client.7962 populate_metadata read hostname 'smithi049' 2024-01-22T05:14:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/3327833283 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x222ce10 0x22049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53e2cc3740 4 client.7962 mds_command: new command op to 7743 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:14:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3327833283 --> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2175780 con 0x222ce10 2024-01-22T05:14:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53d5400700 1 --2- 172.21.15.49:0/3327833283 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x222ce10 0x22049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53d5400700 1 --2- 172.21.15.49:0/3327833283 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x222ce10 0x22049f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7b13d9813c0bea6d server_cookie=6b144bdfd6b344d5 in_seq=0 out_seq=0 2024-01-22T05:14:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.715+0000 7f53be000700 10 client.7962 ms_handle_connect on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.719+0000 7f53be000700 1 -- 172.21.15.49:0/3327833283 <== mds.0 v2:172.21.15.110:6832/1348218223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2175780 con 0x222ce10 2024-01-22T05:14:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.719+0000 7f53be000700 10 client.7962 handle_command_reply: tid=0 2024-01-22T05:14:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.719+0000 7f53e2cc3740 1 client.7962 shutdown 2024-01-22T05:14:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.719+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3327833283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x224d4d0 msgr2=0x2229f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.719+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/3327833283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x224d4d0 0x2229f80 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f53c0009270 tx=0x7f53c0029000).stop 2024-01-22T05:14:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.719+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3327833283 shutdown_connections 2024-01-22T05:14:23.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.719+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/3327833283 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x222ce10 0x22049f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.719+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/3327833283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2254ee0 0x222c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.719+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/3327833283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254570 0x222a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.719+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/3327833283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x224d4d0 0x2229f80 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.719+0000 7f53be000700 0 client.7962 ms_handle_reset on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:23.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.719+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3327833283 >> 172.21.15.49:0/3327833283 conn(0x1fe7680 msgr2=0x224e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.719+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3327833283 shutdown_connections 2024-01-22T05:14:23.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.719+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3327833283 wait complete. 2024-01-22T05:14:23.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.719+0000 7f53e2cc3740 20 client.7962 trim_cache size 0 max 16384 2024-01-22T05:14:23.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53e2cc3740 1 Processor -- start 2024-01-22T05:14:23.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53e2cc3740 1 -- start start 2024-01-22T05:14:23.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53e2cc3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x224d4d0 0x22348b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53e2cc3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254570 0x21fde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53e2cc3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2254ee0 0x2245730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53e2cc3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x22079b0 con 0x2254ee0 2024-01-22T05:14:23.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53e2cc3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2206400 con 0x2254570 2024-01-22T05:14:23.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53e2cc3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2245c20 con 0x224d4d0 2024-01-22T05:14:23.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53d6800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2254ee0 0x2245730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53d5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x224d4d0 0x22348b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53d6800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2254ee0 0x2245730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54894/0 (socket says 172.21.15.49:54894) 2024-01-22T05:14:23.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53d5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x224d4d0 0x22348b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:47462/0 (socket says 172.21.15.49:47462) 2024-01-22T05:14:23.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53d6800700 1 -- 172.21.15.49:0/3652679958 learned_addr learned my addr 172.21.15.49:0/3652679958 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53d5400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254570 0x21fde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53d5e00700 1 -- 172.21.15.49:0/3652679958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254570 msgr2=0x21fde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53d5e00700 1 --2- 172.21.15.49:0/3652679958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254570 0x21fde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53d5e00700 1 -- 172.21.15.49:0/3652679958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2254ee0 msgr2=0x2245730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53d5e00700 1 --2- 172.21.15.49:0/3652679958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2254ee0 0x2245730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53d5e00700 1 -- 172.21.15.49:0/3652679958 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x222c6d0 con 0x224d4d0 2024-01-22T05:14:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53d6800700 1 --2- 172.21.15.49:0/3652679958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2254ee0 0x2245730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.735+0000 7f53d5e00700 1 --2- 172.21.15.49:0/3652679958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x224d4d0 0x22348b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f53c0006c00 tx=0x7f53c0034070).ready entity=mon.2 client_cookie=7a85387b966b8dc4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.739+0000 7f53c6600700 1 -- 172.21.15.49:0/3652679958 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c00118b0 con 0x224d4d0 2024-01-22T05:14:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.739+0000 7f53c6600700 1 -- 172.21.15.49:0/3652679958 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c0032b80 con 0x224d4d0 2024-01-22T05:14:23.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.739+0000 7f53c6600700 1 -- 172.21.15.49:0/3652679958 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c003b5b0 con 0x224d4d0 2024-01-22T05:14:23.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.739+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3652679958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x224d4d0 msgr2=0x22348b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.739+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/3652679958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x224d4d0 0x22348b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f53c0006c00 tx=0x7f53c0034070).stop 2024-01-22T05:14:23.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.739+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3652679958 shutdown_connections 2024-01-22T05:14:23.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.739+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/3652679958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2254ee0 0x2245730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.739+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/3652679958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254570 0x21fde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.739+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/3652679958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x224d4d0 0x22348b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.739+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3652679958 >> 172.21.15.49:0/3652679958 conn(0x1fe7680 msgr2=0x2208010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.739+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3652679958 shutdown_connections 2024-01-22T05:14:23.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.739+0000 7f53e2cc3740 1 -- 172.21.15.49:0/3652679958 wait complete. 2024-01-22T05:14:23.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.739+0000 7f53e2cc3740 1 -- start start 2024-01-22T05:14:23.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.743+0000 7f53e2cc3740 1 Processor -- start 2024-01-22T05:14:23.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x224d4d0 0x2227dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2254570 0x22489d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254ee0 0x22a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2205ec0 con 0x2254570 2024-01-22T05:14:23.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x22a6030 con 0x2254ee0 2024-01-22T05:14:23.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x224ba10 con 0x224d4d0 2024-01-22T05:14:23.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 10 client.0 ll_register_callbacks cb 0x7f53b8001a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:14:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53d5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2254570 0x22489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53d5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2254570 0x22489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54906/0 (socket says 172.21.15.49:54906) 2024-01-22T05:14:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53d5400700 1 -- 172.21.15.49:0/1015043730 learned_addr learned my addr 172.21.15.49:0/1015043730 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53d6800700 1 --2- 172.21.15.49:0/1015043730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254ee0 0x22a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53d5e00700 1 --2- 172.21.15.49:0/1015043730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x224d4d0 0x2227dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53d5400700 1 -- 172.21.15.49:0/1015043730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x224d4d0 msgr2=0x2227dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53d5400700 1 --2- 172.21.15.49:0/1015043730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x224d4d0 0x2227dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53d5400700 1 -- 172.21.15.49:0/1015043730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254ee0 msgr2=0x22a49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53d5400700 1 --2- 172.21.15.49:0/1015043730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254ee0 0x22a49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53d5400700 1 -- 172.21.15.49:0/1015043730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d0062d90 con 0x2254570 2024-01-22T05:14:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53d5e00700 1 --2- 172.21.15.49:0/1015043730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x224d4d0 0x2227dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53d5400700 1 --2- 172.21.15.49:0/1015043730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2254570 0x22489d0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f53b8005fd0 tx=0x7f53b804f040).ready entity=mon.0 client_cookie=7f0854ce7bcff9bd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53be000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:14:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53be000700 1 -- 172.21.15.49:0/1015043730 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8055040 con 0x2254570 2024-01-22T05:14:23.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53be000700 1 -- 172.21.15.49:0/1015043730 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f53b801bc10 con 0x2254570 2024-01-22T05:14:23.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 1 -- 172.21.15.49:0/1015043730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f53c001e640 con 0x2254570 2024-01-22T05:14:23.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53be000700 1 -- 172.21.15.49:0/1015043730 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53b804a970 con 0x2254570 2024-01-22T05:14:23.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 10 client.7968 fetch_fsmap learned FSMap version 98 2024-01-22T05:14:23.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 1 -- 172.21.15.49:0/1015043730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x21827c0 con 0x2254570 2024-01-22T05:14:23.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53be000700 1 -- 172.21.15.49:0/1015043730 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c001e640 con 0x2254570 2024-01-22T05:14:23.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53be000700 1 -- 172.21.15.49:0/1015043730 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 98) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f53b8047270 con 0x2254570 2024-01-22T05:14:23.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 10 client.7968 fetch_fsmap finished waiting for FSMap version 98 2024-01-22T05:14:23.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 10 client.7968 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-01-22T05:14:23.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 20 client.7968 populate_metadata read hostname 'smithi049' 2024-01-22T05:14:23.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/1015043730 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x22a5750 0x224c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 4 client.7968 mds_command: new command op to 7743 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:14:23.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53e2cc3740 1 -- 172.21.15.49:0/1015043730 --> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x203e610 con 0x22a5750 2024-01-22T05:14:23.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.747+0000 7f53d5e00700 1 --2- 172.21.15.49:0/1015043730 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x22a5750 0x224c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53d5e00700 1 --2- 172.21.15.49:0/1015043730 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x22a5750 0x224c4b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=de85fa6061dd3623 server_cookie=2702e185403ceac2 in_seq=0 out_seq=0 2024-01-22T05:14:23.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53be000700 10 client.7968 ms_handle_connect on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:23.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53be000700 1 -- 172.21.15.49:0/1015043730 <== mds.0 v2:172.21.15.110:6832/1348218223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x203e610 con 0x22a5750 2024-01-22T05:14:23.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53be000700 10 client.7968 handle_command_reply: tid=0 2024-01-22T05:14:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53e2cc3740 1 client.7968 shutdown 2024-01-22T05:14:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53e2cc3740 1 -- 172.21.15.49:0/1015043730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2254570 msgr2=0x22489d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/1015043730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2254570 0x22489d0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f53b8005fd0 tx=0x7f53b804f040).stop 2024-01-22T05:14:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53e2cc3740 1 -- 172.21.15.49:0/1015043730 shutdown_connections 2024-01-22T05:14:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/1015043730 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x22a5750 0x224c4b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/1015043730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2254ee0 0x22a49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/1015043730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2254570 0x22489d0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53e2cc3740 1 --2- 172.21.15.49:0/1015043730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x224d4d0 0x2227dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53e2cc3740 1 -- 172.21.15.49:0/1015043730 >> 172.21.15.49:0/1015043730 conn(0x1fe7680 msgr2=0x2208010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53be000700 0 client.7968 ms_handle_reset on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:23.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53e2cc3740 1 -- 172.21.15.49:0/1015043730 shutdown_connections 2024-01-22T05:14:23.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53e2cc3740 1 -- 172.21.15.49:0/1015043730 wait complete. 2024-01-22T05:14:23.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53e2cc3740 20 client.7968 trim_cache size 0 max 16384 2024-01-22T05:14:23.756 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:14:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-01-22T05:14:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-01-22T05:14:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: "6e497d85-b86a-4504-b18d-40c7ef591312": { 2024-01-22T05:14:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/scrub_control_test_path", 2024-01-22T05:14:23.756 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "6e497d85-b86a-4504-b18d-40c7ef591312", 2024-01-22T05:14:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive" 2024-01-22T05:14:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:23.757 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:23.757 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:14:23.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53d8800700 1 -- 172.21.15.49:0/3615273821 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53a805a510 msgr2=0x7f53a805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53d8800700 1 --2- 172.21.15.49:0/3615273821 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53a805a510 0x7f53a805c9d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f53c00096e0 tx=0x7f53c0016000).stop 2024-01-22T05:14:23.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53d8800700 1 -- 172.21.15.49:0/3615273821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00c1960 msgr2=0x7f53d0150f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.751+0000 7f53d8800700 1 --2- 172.21.15.49:0/3615273821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00c1960 0x7f53d0150f20 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f53b800c7c0 tx=0x7f53b8001980).stop 2024-01-22T05:14:23.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.755+0000 7f53d8800700 1 -- 172.21.15.49:0/3615273821 shutdown_connections 2024-01-22T05:14:23.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.755+0000 7f53d8800700 1 --2- 172.21.15.49:0/3615273821 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f53a805a510 0x7f53a805c9d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.755+0000 7f53d8800700 1 --2- 172.21.15.49:0/3615273821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d0155c90 0x7f53d00c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.755+0000 7f53d8800700 1 --2- 172.21.15.49:0/3615273821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00c1960 0x7f53d0150f20 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.755+0000 7f53d8800700 1 --2- 172.21.15.49:0/3615273821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d00691b0 0x7f53d0150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.755+0000 7f53d8800700 1 -- 172.21.15.49:0/3615273821 >> 172.21.15.49:0/3615273821 conn(0x7f53d00c4310 msgr2=0x7f53d0058c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.755+0000 7f53d8800700 1 -- 172.21.15.49:0/3615273821 shutdown_connections 2024-01-22T05:14:23.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.755+0000 7f53d8800700 1 -- 172.21.15.49:0/3615273821 wait complete. 2024-01-22T05:14:23.777 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:14:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.939+0000 7f1786800700 1 Processor -- start 2024-01-22T05:14:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.939+0000 7f1786800700 1 -- start start 2024-01-22T05:14:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.943+0000 7f1786800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17800bc580 0x7f17800bca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.943+0000 7f1786800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1780153930 0x7f1780153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.943+0000 7f1786800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17800c2130 con 0x7f17800c2d90 2024-01-22T05:14:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.943+0000 7f1786800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1780154c50 con 0x7f1780153930 2024-01-22T05:14:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.943+0000 7f1786800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1780154f30 con 0x7f17800bc580 2024-01-22T05:14:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.943+0000 7f177f400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f17800c2d90 0x7f17800c3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33790/0 (socket says 172.21.15.49:33790) 2024-01-22T05:14:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.943+0000 7f177f400700 1 -- 172.21.15.49:0/3555617869 learned_addr learned my addr 172.21.15.49:0/3555617869 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.943+0000 7f177fe00700 1 --2- 172.21.15.49:0/3555617869 >> v2:172.21.15.49:3300/0 conn(0x7f1780153930 0x7f1780153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.943+0000 7f177ea00700 1 --2- 172.21.15.49:0/3555617869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17800bc580 0x7f17800bca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.943+0000 7f177e000700 1 -- 172.21.15.49:0/3555617869 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665033070 0 0) 0x7f17800c2130 con 0x7f17800c2d90 2024-01-22T05:14:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f177e000700 1 -- 172.21.15.49:0/3555617869 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17600033f0 con 0x7f17800c2d90 2024-01-22T05:14:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f177fe00700 1 -- 172.21.15.49:0/3555617869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17800bc580 msgr2=0x7f17800bca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f177fe00700 1 --2- 172.21.15.49:0/3555617869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17800bc580 0x7f17800bca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f177fe00700 1 -- 172.21.15.49:0/3555617869 >> v1:172.21.15.49:6789/0 conn(0x7f17800c2d90 legacy=0x7f17800c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f177fe00700 1 -- 172.21.15.49:0/3555617869 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17800c1dc0 con 0x7f1780153930 2024-01-22T05:14:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f177fe00700 1 --2- 172.21.15.49:0/3555617869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1780153930 0x7f1780153dc0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f1778009e60 tx=0x7f1778009780).ready entity=mon.0 client_cookie=fe976f2695aaed8f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f177e000700 1 -- 172.21.15.49:0/3555617869 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177800e070 con 0x7f1780153930 2024-01-22T05:14:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f177e000700 1 -- 172.21.15.49:0/3555617869 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177800bab0 con 0x7f1780153930 2024-01-22T05:14:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f177e000700 1 -- 172.21.15.49:0/3555617869 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177800be30 con 0x7f1780153930 2024-01-22T05:14:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f1786800700 1 -- 172.21.15.49:0/3555617869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1780153930 msgr2=0x7f1780153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f1786800700 1 --2- 172.21.15.49:0/3555617869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1780153930 0x7f1780153dc0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f1778009e60 tx=0x7f1778009780).stop 2024-01-22T05:14:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f1786800700 1 -- 172.21.15.49:0/3555617869 shutdown_connections 2024-01-22T05:14:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f1786800700 1 --2- 172.21.15.49:0/3555617869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1780153930 0x7f1780153dc0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f1786800700 1 --2- 172.21.15.49:0/3555617869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17800bc580 0x7f17800bca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f1786800700 1 -- 172.21.15.49:0/3555617869 >> 172.21.15.49:0/3555617869 conn(0x7f1780066830 msgr2=0x7f1780066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:23.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f1786800700 1 -- 172.21.15.49:0/3555617869 shutdown_connections 2024-01-22T05:14:23.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.947+0000 7f1786800700 1 -- 172.21.15.49:0/3555617869 wait complete. 2024-01-22T05:14:23.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.951+0000 7f1786800700 1 Processor -- start 2024-01-22T05:14:23.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.951+0000 7f1786800700 1 -- start start 2024-01-22T05:14:23.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f1786800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17800bc580 0x7f1780069200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f1786800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17800c2d90 0x7f17800aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f1786800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1780153930 0x7f178014d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f1786800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1780069ea0 con 0x7f17800c2d90 2024-01-22T05:14:23.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f1786800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17800696f0 con 0x7f17800bc580 2024-01-22T05:14:23.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f1786800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178014ff10 con 0x7f1780153930 2024-01-22T05:14:23.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f177ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17800c2d90 0x7f17800aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f177ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17800c2d90 0x7f17800aa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54920/0 (socket says 172.21.15.49:54920) 2024-01-22T05:14:23.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f177ea00700 1 -- 172.21.15.49:0/373839570 learned_addr learned my addr 172.21.15.49:0/373839570 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:23.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f177f400700 1 --2- 172.21.15.49:0/373839570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17800bc580 0x7f1780069200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f177fe00700 1 --2- 172.21.15.49:0/373839570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1780153930 0x7f178014d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f177ea00700 1 -- 172.21.15.49:0/373839570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1780153930 msgr2=0x7f178014d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f177ea00700 1 --2- 172.21.15.49:0/373839570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1780153930 0x7f178014d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f177ea00700 1 -- 172.21.15.49:0/373839570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17800bc580 msgr2=0x7f1780069200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:23.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f177ea00700 1 --2- 172.21.15.49:0/373839570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17800bc580 0x7f1780069200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:23.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f177ea00700 1 -- 172.21.15.49:0/373839570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1778009a20 con 0x7f17800c2d90 2024-01-22T05:14:23.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f177ea00700 1 --2- 172.21.15.49:0/373839570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17800c2d90 0x7f17800aa5d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f176800e930 tx=0x7f1768009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f1776a00700 1 -- 172.21.15.49:0/373839570 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768012600 con 0x7f17800c2d90 2024-01-22T05:14:23.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f1776a00700 1 -- 172.21.15.49:0/373839570 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1768012760 con 0x7f17800c2d90 2024-01-22T05:14:23.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f1776a00700 1 -- 172.21.15.49:0/373839570 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768012ae0 con 0x7f17800c2d90 2024-01-22T05:14:23.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.955+0000 7f1786800700 1 -- 172.21.15.49:0/373839570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1780069930 con 0x7f17800c2d90 2024-01-22T05:14:23.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.959+0000 7f1786800700 1 -- 172.21.15.49:0/373839570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178014f8c0 con 0x7f17800c2d90 2024-01-22T05:14:23.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.959+0000 7f1786800700 1 -- 172.21.15.49:0/373839570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17801500a0 con 0x7f17800c2d90 2024-01-22T05:14:23.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.959+0000 7f1776a00700 1 -- 172.21.15.49:0/373839570 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f176801b400 con 0x7f17800c2d90 2024-01-22T05:14:23.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.963+0000 7f1776a00700 1 --2- 172.21.15.49:0/373839570 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f175805a510 0x7f175805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:23.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.963+0000 7f1776a00700 1 -- 172.21.15.49:0/373839570 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f1768074b70 con 0x7f17800c2d90 2024-01-22T05:14:23.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.963+0000 7f177f400700 1 --2- 172.21.15.49:0/373839570 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f175805a510 0x7f175805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:23.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.963+0000 7f177f400700 1 --2- 172.21.15.49:0/373839570 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f175805a510 0x7f175805c9d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f1770005750 tx=0x7f1770009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:23.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:23.971+0000 7f1776a00700 1 -- 172.21.15.49:0/373839570 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1768048190 con 0x7f17800c2d90 2024-01-22T05:14:24.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.167+0000 7f1786800700 1 -- 172.21.15.49:0/373839570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17800bdf70 con 0x7f17800c2d90 2024-01-22T05:14:24.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.167+0000 7f1776a00700 1 -- 172.21.15.49:0/373839570 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f176804b7b0 con 0x7f17800c2d90 2024-01-22T05:14:24.171 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:24.171 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:14:24.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.171+0000 7f1786800700 1 -- 172.21.15.49:0/373839570 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f175805a510 msgr2=0x7f175805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:24.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.171+0000 7f1786800700 1 --2- 172.21.15.49:0/373839570 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f175805a510 0x7f175805c9d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f1770005750 tx=0x7f1770009040).stop 2024-01-22T05:14:24.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.171+0000 7f1786800700 1 -- 172.21.15.49:0/373839570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17800c2d90 msgr2=0x7f17800aa5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:24.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.171+0000 7f1786800700 1 --2- 172.21.15.49:0/373839570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17800c2d90 0x7f17800aa5d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f176800e930 tx=0x7f1768009060).stop 2024-01-22T05:14:24.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.171+0000 7f1786800700 1 -- 172.21.15.49:0/373839570 shutdown_connections 2024-01-22T05:14:24.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.171+0000 7f1786800700 1 --2- 172.21.15.49:0/373839570 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f175805a510 0x7f175805c9d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:24.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.171+0000 7f1786800700 1 --2- 172.21.15.49:0/373839570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1780153930 0x7f178014d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:24.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.171+0000 7f1786800700 1 --2- 172.21.15.49:0/373839570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17800c2d90 0x7f17800aa5d0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:24.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.171+0000 7f1786800700 1 --2- 172.21.15.49:0/373839570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17800bc580 0x7f1780069200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:24.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.171+0000 7f1786800700 1 -- 172.21.15.49:0/373839570 >> 172.21.15.49:0/373839570 conn(0x7f1780066830 msgr2=0x7f17800c6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:24.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.171+0000 7f1786800700 1 -- 172.21.15.49:0/373839570 shutdown_connections 2024-01-22T05:14:24.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.171+0000 7f1786800700 1 -- 172.21.15.49:0/373839570 wait complete. 2024-01-22T05:14:24.177 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:14:24.195 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-01-22T05:14:24.195 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:14:24.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b8000700 1 Processor -- start 2024-01-22T05:14:24.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b8000700 1 -- start start 2024-01-22T05:14:24.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b8000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7b0065240 0x7fa7b00644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:24.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b8000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa7b00649e0 0x7fa7b015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:24.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b8000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b00c2700 con 0x7fa7b0065620 2024-01-22T05:14:24.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b8000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b00c29a0 con 0x7fa7b0065240 2024-01-22T05:14:24.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b8000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b00c2c80 con 0x7fa7b00649e0 2024-01-22T05:14:24.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b5600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7b0065240 0x7fa7b00644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:24.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b5600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7b0065240 0x7fa7b00644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54930/0 (socket says 172.21.15.49:54930) 2024-01-22T05:14:24.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b5600700 1 -- 172.21.15.49:0/857997036 learned_addr learned my addr 172.21.15.49:0/857997036 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:24.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b4c00700 1 --1- 172.21.15.49:0/857997036 >> v1:172.21.15.49:6789/0 conn(0x7fa7b0065620 0x7fa7b015b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33792/0 (socket says 172.21.15.49:33792) 2024-01-22T05:14:24.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b5600700 1 -- 172.21.15.49:0/857997036 >> v2:172.21.15.110:3300/0 conn(0x7fa7b00649e0 msgr2=0x7fa7b015c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:24.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b6a00700 1 --2- 172.21.15.49:0/857997036 >> v2:172.21.15.110:3300/0 conn(0x7fa7b00649e0 0x7fa7b015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:24.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b5600700 1 --2- 172.21.15.49:0/857997036 >> v2:172.21.15.110:3300/0 conn(0x7fa7b00649e0 0x7fa7b015c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:24.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b5600700 1 -- 172.21.15.49:0/857997036 >> v1:172.21.15.49:6789/0 conn(0x7fa7b0065620 legacy=0x7fa7b015b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:24.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b5600700 1 -- 172.21.15.49:0/857997036 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b00c2f60 con 0x7fa7b0065240 2024-01-22T05:14:24.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.351+0000 7fa7b6a00700 1 --2- 172.21.15.49:0/857997036 >> v2:172.21.15.110:3300/0 conn(0x7fa7b00649e0 0x7fa7b015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:14:24.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.355+0000 7fa7b5600700 1 --2- 172.21.15.49:0/857997036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b0065240 0x7fa7b00644f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7fa7b00665c0 tx=0x7fa7a00090f0).ready entity=mon.0 client_cookie=88c82362f3f83b77 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:24.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.355+0000 7fa7afe00700 1 -- 172.21.15.49:0/857997036 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000b600 con 0x7fa7b0065240 2024-01-22T05:14:24.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.355+0000 7fa7afe00700 1 -- 172.21.15.49:0/857997036 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a000b760 con 0x7fa7b0065240 2024-01-22T05:14:24.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.355+0000 7fa7afe00700 1 -- 172.21.15.49:0/857997036 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000bae0 con 0x7fa7b0065240 2024-01-22T05:14:24.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.355+0000 7fa7b8000700 1 -- 172.21.15.49:0/857997036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b0065240 msgr2=0x7fa7b00644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:24.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.355+0000 7fa7b8000700 1 --2- 172.21.15.49:0/857997036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b0065240 0x7fa7b00644f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7fa7b00665c0 tx=0x7fa7a00090f0).stop 2024-01-22T05:14:24.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.355+0000 7fa7b8000700 1 -- 172.21.15.49:0/857997036 shutdown_connections 2024-01-22T05:14:24.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.355+0000 7fa7b8000700 1 --2- 172.21.15.49:0/857997036 >> v2:172.21.15.110:3300/0 conn(0x7fa7b00649e0 0x7fa7b015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:24.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.355+0000 7fa7b8000700 1 --2- 172.21.15.49:0/857997036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b0065240 0x7fa7b00644f0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:24.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.355+0000 7fa7b8000700 1 -- 172.21.15.49:0/857997036 >> 172.21.15.49:0/857997036 conn(0x7fa7b00c87f0 msgr2=0x7fa7b00c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:24.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.355+0000 7fa7b8000700 1 -- 172.21.15.49:0/857997036 shutdown_connections 2024-01-22T05:14:24.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.355+0000 7fa7b8000700 1 -- 172.21.15.49:0/857997036 wait complete. 2024-01-22T05:14:24.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.359+0000 7fa7b8000700 1 Processor -- start 2024-01-22T05:14:24.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.359+0000 7fa7b8000700 1 -- start start 2024-01-22T05:14:24.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.359+0000 7fa7b8000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7b00649e0 0x7fa7b015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:24.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.359+0000 7fa7b8000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7b0065240 0x7fa7b00c01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:24.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.359+0000 7fa7b8000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b0065620 0x7fa7b00a8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:24.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.359+0000 7fa7b8000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b00bfd20 con 0x7fa7b0065620 2024-01-22T05:14:24.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.359+0000 7fa7b8000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b00bf110 con 0x7fa7b00649e0 2024-01-22T05:14:24.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.359+0000 7fa7b8000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b00bf3f0 con 0x7fa7b0065240 2024-01-22T05:14:24.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.359+0000 7fa7b6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b0065620 0x7fa7b00a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:24.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.359+0000 7fa7b4c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7b0065240 0x7fa7b00c01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:24.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.359+0000 7fa7b6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b0065620 0x7fa7b00a8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54942/0 (socket says 172.21.15.49:54942) 2024-01-22T05:14:24.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.359+0000 7fa7b5600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7b00649e0 0x7fa7b015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:24.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.359+0000 7fa7b6a00700 1 -- 172.21.15.49:0/1063184135 learned_addr learned my addr 172.21.15.49:0/1063184135 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:24.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.363+0000 7fa7b6a00700 1 -- 172.21.15.49:0/1063184135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7b0065240 msgr2=0x7fa7b00c01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:24.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.363+0000 7fa7b6a00700 1 --2- 172.21.15.49:0/1063184135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7b0065240 0x7fa7b00c01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:24.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.363+0000 7fa7b6a00700 1 -- 172.21.15.49:0/1063184135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7b00649e0 msgr2=0x7fa7b015dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:24.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.363+0000 7fa7b6a00700 1 --2- 172.21.15.49:0/1063184135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7b00649e0 0x7fa7b015dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:24.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.363+0000 7fa7b6a00700 1 -- 172.21.15.49:0/1063184135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a0009370 con 0x7fa7b0065620 2024-01-22T05:14:24.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.363+0000 7fa7b6a00700 1 --2- 172.21.15.49:0/1063184135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b0065620 0x7fa7b00a8490 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7fa7a800a380 tx=0x7fa7a8007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:24.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.363+0000 7fa7acc00700 1 -- 172.21.15.49:0/1063184135 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8016470 con 0x7fa7b0065620 2024-01-22T05:14:24.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.363+0000 7fa7acc00700 1 -- 172.21.15.49:0/1063184135 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a80165d0 con 0x7fa7b0065620 2024-01-22T05:14:24.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.363+0000 7fa7acc00700 1 -- 172.21.15.49:0/1063184135 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8016950 con 0x7fa7b0065620 2024-01-22T05:14:24.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.363+0000 7fa7b8000700 1 -- 172.21.15.49:0/1063184135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b00bf6d0 con 0x7fa7b0065620 2024-01-22T05:14:24.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.363+0000 7fa7b8000700 1 -- 172.21.15.49:0/1063184135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b00c06a0 con 0x7fa7b0065620 2024-01-22T05:14:24.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.363+0000 7fa7b8000700 1 -- 172.21.15.49:0/1063184135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b00bfed0 con 0x7fa7b0065620 2024-01-22T05:14:24.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.367+0000 7fa7acc00700 1 -- 172.21.15.49:0/1063184135 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa7a8013070 con 0x7fa7b0065620 2024-01-22T05:14:24.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.367+0000 7fa7acc00700 1 --2- 172.21.15.49:0/1063184135 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa78805a510 0x7fa78805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:24.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.367+0000 7fa7acc00700 1 -- 172.21.15.49:0/1063184135 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa7a8075640 con 0x7fa7b0065620 2024-01-22T05:14:24.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.367+0000 7fa7b5600700 1 --2- 172.21.15.49:0/1063184135 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa78805a510 0x7fa78805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:24.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.367+0000 7fa7b5600700 1 --2- 172.21.15.49:0/1063184135 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa78805a510 0x7fa78805c9d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fa7a0009130 tx=0x7fa7a0017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:24.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.375+0000 7fa7acc00700 1 -- 172.21.15.49:0/1063184135 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa7a8048cb0 con 0x7fa7b0065620 2024-01-22T05:14:24.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.591+0000 7fa7b8000700 1 -- 172.21.15.49:0/1063184135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa7b0047060 con 0x7fa7b0065620 2024-01-22T05:14:24.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.595+0000 7fa7acc00700 1 -- 172.21.15.49:0/1063184135 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1192 (secure 0 0 0) 0x7fa7a804c2d0 con 0x7fa7b0065620 2024-01-22T05:14:24.596 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:24.596 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":608,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":117,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1028,"data_bytes":1056642217,"bytes_used":4597547008,"bytes_avail":768496566272,"bytes_total":773094113280,"write_bytes_sec":40878385,"read_op_per_sec":0,"write_op_per_sec":40},"fsmap":{"epoch":98,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7743}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-01-22T05:13:21.420936+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:14:24.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.599+0000 7fa7b8000700 1 -- 172.21.15.49:0/1063184135 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa78805a510 msgr2=0x7fa78805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:24.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.599+0000 7fa7b8000700 1 --2- 172.21.15.49:0/1063184135 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa78805a510 0x7fa78805c9d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fa7a0009130 tx=0x7fa7a0017000).stop 2024-01-22T05:14:24.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.599+0000 7fa7b8000700 1 -- 172.21.15.49:0/1063184135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b0065620 msgr2=0x7fa7b00a8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:24.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.599+0000 7fa7b8000700 1 --2- 172.21.15.49:0/1063184135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b0065620 0x7fa7b00a8490 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7fa7a800a380 tx=0x7fa7a8007900).stop 2024-01-22T05:14:24.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.599+0000 7fa7b8000700 1 -- 172.21.15.49:0/1063184135 shutdown_connections 2024-01-22T05:14:24.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.599+0000 7fa7b8000700 1 --2- 172.21.15.49:0/1063184135 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa78805a510 0x7fa78805c9d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:24.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.599+0000 7fa7b8000700 1 --2- 172.21.15.49:0/1063184135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b0065620 0x7fa7b00a8490 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:24.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.599+0000 7fa7b8000700 1 --2- 172.21.15.49:0/1063184135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7b0065240 0x7fa7b00c01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:24.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.599+0000 7fa7b8000700 1 --2- 172.21.15.49:0/1063184135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7b00649e0 0x7fa7b015dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:24.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.599+0000 7fa7b8000700 1 -- 172.21.15.49:0/1063184135 >> 172.21.15.49:0/1063184135 conn(0x7fa7b00c87f0 msgr2=0x7fa7b0062230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:24.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.599+0000 7fa7b8000700 1 -- 172.21.15.49:0/1063184135 shutdown_connections 2024-01-22T05:14:24.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:24.599+0000 7fa7b8000700 1 -- 172.21.15.49:0/1063184135 wait complete. 2024-01-22T05:14:24.623 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-01-22T05:14:25.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:14:25.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.795+0000 7f3763600700 1 Processor -- start 2024-01-22T05:14:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.795+0000 7f3763600700 1 -- start start 2024-01-22T05:14:25.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.799+0000 7f3763600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f375c0644f0 0x7f375c064950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:25.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.799+0000 7f3763600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c0c2700 con 0x7f375c065660 2024-01-22T05:14:25.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.799+0000 7f3763600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c0a7650 con 0x7f375c0bcc80 2024-01-22T05:14:25.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.799+0000 7f3763600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375c064e40 con 0x7f375c0644f0 2024-01-22T05:14:25.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.799+0000 7f3760c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f375c065660 0x7f375c0a6f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33802/0 (socket says 172.21.15.49:33802) 2024-01-22T05:14:25.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.799+0000 7f3760c00700 1 -- 172.21.15.49:0/2807263324 learned_addr learned my addr 172.21.15.49:0/2807263324 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:25.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.799+0000 7f375be00700 1 --2- 172.21.15.49:0/2807263324 >> v2:172.21.15.110:3300/0 conn(0x7f375c0644f0 0x7f375c064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f375b400700 1 -- 172.21.15.49:0/2807263324 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279895698 0 0) 0x7f375c0c2700 con 0x7f375c065660 2024-01-22T05:14:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f375b400700 1 -- 172.21.15.49:0/2807263324 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f373c0033f0 con 0x7f375c065660 2024-01-22T05:14:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f375b400700 1 -- 172.21.15.49:0/2807263324 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600135473 0 0) 0x7f375c0a7650 con 0x7f375c0bcc80 2024-01-22T05:14:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f375b400700 1 -- 172.21.15.49:0/2807263324 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f375c0c2700 con 0x7f375c0bcc80 2024-01-22T05:14:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f375be00700 1 -- 172.21.15.49:0/2807263324 >> v1:172.21.15.110:6789/0 conn(0x7f375c0bcc80 legacy=0x7f375c0bd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f375be00700 1 -- 172.21.15.49:0/2807263324 >> v1:172.21.15.49:6789/0 conn(0x7f375c065660 legacy=0x7f375c0a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f375be00700 1 -- 172.21.15.49:0/2807263324 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c0c2930 con 0x7f375c0644f0 2024-01-22T05:14:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f375be00700 1 --2- 172.21.15.49:0/2807263324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f375c0644f0 0x7f375c064950 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f3744009760 tx=0x7f3744009060).ready entity=mon.1 client_cookie=8d0f5efb240e41ca server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f375b400700 1 -- 172.21.15.49:0/2807263324 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374400d4a0 con 0x7f375c0644f0 2024-01-22T05:14:25.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f375b400700 1 -- 172.21.15.49:0/2807263324 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374400d600 con 0x7f375c0644f0 2024-01-22T05:14:25.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f375b400700 1 -- 172.21.15.49:0/2807263324 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374400d980 con 0x7f375c0644f0 2024-01-22T05:14:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f3763600700 1 -- 172.21.15.49:0/2807263324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f375c0644f0 msgr2=0x7f375c064950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f3763600700 1 --2- 172.21.15.49:0/2807263324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f375c0644f0 0x7f375c064950 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f3744009760 tx=0x7f3744009060).stop 2024-01-22T05:14:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f3763600700 1 -- 172.21.15.49:0/2807263324 shutdown_connections 2024-01-22T05:14:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f3763600700 1 --2- 172.21.15.49:0/2807263324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f375c0644f0 0x7f375c064950 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.803+0000 7f3763600700 1 -- 172.21.15.49:0/2807263324 >> 172.21.15.49:0/2807263324 conn(0x7f375c0c87f0 msgr2=0x7f375c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:25.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.807+0000 7f3763600700 1 -- 172.21.15.49:0/2807263324 shutdown_connections 2024-01-22T05:14:25.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.807+0000 7f3763600700 1 -- 172.21.15.49:0/2807263324 wait complete. 2024-01-22T05:14:25.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.807+0000 7f3763600700 1 Processor -- start 2024-01-22T05:14:25.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.807+0000 7f3763600700 1 -- start start 2024-01-22T05:14:25.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f3763600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f375c0644f0 0x7f375c167db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:25.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f3763600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c065660 0x7f375c0c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:25.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f3763600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375c0bcc80 0x7f375c141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:25.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f3763600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c1422b0 con 0x7f375c065660 2024-01-22T05:14:25.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f3763600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0c1c70 con 0x7f375c0644f0 2024-01-22T05:14:25.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f3763600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0a79a0 con 0x7f375c0bcc80 2024-01-22T05:14:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f375be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c065660 0x7f375c0c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f375be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c065660 0x7f375c0c14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54956/0 (socket says 172.21.15.49:54956) 2024-01-22T05:14:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f375be00700 1 -- 172.21.15.49:0/1849556236 learned_addr learned my addr 172.21.15.49:0/1849556236 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f3760c00700 1 --2- 172.21.15.49:0/1849556236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f375c0644f0 0x7f375c167db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f3762000700 1 --2- 172.21.15.49:0/1849556236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375c0bcc80 0x7f375c141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f375be00700 1 -- 172.21.15.49:0/1849556236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375c0bcc80 msgr2=0x7f375c141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f375be00700 1 --2- 172.21.15.49:0/1849556236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375c0bcc80 0x7f375c141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f375be00700 1 -- 172.21.15.49:0/1849556236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f375c0644f0 msgr2=0x7f375c167db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:25.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f375be00700 1 --2- 172.21.15.49:0/1849556236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f375c0644f0 0x7f375c167db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:25.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f375be00700 1 -- 172.21.15.49:0/1849556236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37440092a0 con 0x7f375c065660 2024-01-22T05:14:25.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f3762000700 1 --2- 172.21.15.49:0/1849556236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375c0bcc80 0x7f375c141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:14:25.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f375be00700 1 --2- 172.21.15.49:0/1849556236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c065660 0x7f375c0c14d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f3744009d50 tx=0x7f3744016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:25.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f3753e00700 1 -- 172.21.15.49:0/1849556236 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374400d770 con 0x7f375c065660 2024-01-22T05:14:25.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f3753e00700 1 -- 172.21.15.49:0/1849556236 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374400d8d0 con 0x7f375c065660 2024-01-22T05:14:25.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f3763600700 1 -- 172.21.15.49:0/1849556236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375c0c19c0 con 0x7f375c065660 2024-01-22T05:14:25.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f3753e00700 1 -- 172.21.15.49:0/1849556236 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374401d660 con 0x7f375c065660 2024-01-22T05:14:25.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.811+0000 7f3763600700 1 -- 172.21.15.49:0/1849556236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375c0a7350 con 0x7f375c065660 2024-01-22T05:14:25.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.815+0000 7f3763600700 1 -- 172.21.15.49:0/1849556236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375c0aa890 con 0x7f375c065660 2024-01-22T05:14:25.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.815+0000 7f3753e00700 1 -- 172.21.15.49:0/1849556236 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f374401da50 con 0x7f375c065660 2024-01-22T05:14:25.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.819+0000 7f3753e00700 1 --2- 172.21.15.49:0/1849556236 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f373405a510 0x7f373405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:25.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.819+0000 7f3753e00700 1 -- 172.21.15.49:0/1849556236 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3744076090 con 0x7f375c065660 2024-01-22T05:14:25.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.819+0000 7f3760c00700 1 --2- 172.21.15.49:0/1849556236 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f373405a510 0x7f373405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:25.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.819+0000 7f3760c00700 1 --2- 172.21.15.49:0/1849556236 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f373405a510 0x7f373405c9d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f374c005750 tx=0x7f374c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:25.823+0000 7f3753e00700 1 -- 172.21.15.49:0/1849556236 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3744049650 con 0x7f375c065660 2024-01-22T05:14:26.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.027+0000 7f3763600700 1 -- 172.21.15.49:0/1849556236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f375c047060 con 0x7f375c065660 2024-01-22T05:14:26.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.031+0000 7f3753e00700 1 -- 172.21.15.49:0/1849556236 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f374404cc70 con 0x7f375c065660 2024-01-22T05:14:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:14:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.035+0000 7f3763600700 1 -- 172.21.15.49:0/1849556236 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f373405a510 msgr2=0x7f373405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.035+0000 7f3763600700 1 --2- 172.21.15.49:0/1849556236 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f373405a510 0x7f373405c9d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f374c005750 tx=0x7f374c009040).stop 2024-01-22T05:14:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.035+0000 7f3763600700 1 -- 172.21.15.49:0/1849556236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c065660 msgr2=0x7f375c0c14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.035+0000 7f3763600700 1 --2- 172.21.15.49:0/1849556236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c065660 0x7f375c0c14d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f3744009d50 tx=0x7f3744016000).stop 2024-01-22T05:14:26.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.035+0000 7f3763600700 1 -- 172.21.15.49:0/1849556236 shutdown_connections 2024-01-22T05:14:26.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.035+0000 7f3763600700 1 --2- 172.21.15.49:0/1849556236 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f373405a510 0x7f373405c9d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:26.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.035+0000 7f3763600700 1 --2- 172.21.15.49:0/1849556236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375c0bcc80 0x7f375c141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:26.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.035+0000 7f3763600700 1 --2- 172.21.15.49:0/1849556236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f375c065660 0x7f375c0c14d0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:26.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.035+0000 7f3763600700 1 --2- 172.21.15.49:0/1849556236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f375c0644f0 0x7f375c167db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:26.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.035+0000 7f3763600700 1 -- 172.21.15.49:0/1849556236 >> 172.21.15.49:0/1849556236 conn(0x7f375c0c87f0 msgr2=0x7f375c0a3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:26.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.035+0000 7f3763600700 1 -- 172.21.15.49:0/1849556236 shutdown_connections 2024-01-22T05:14:26.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.035+0000 7f3763600700 1 -- 172.21.15.49:0/1849556236 wait complete. 2024-01-22T05:14:26.041 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:14:26.058 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-01-22T05:14:26.058 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:14:26.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.211+0000 7f09ebe00700 1 Processor -- start 2024-01-22T05:14:26.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.211+0000 7f09ebe00700 1 -- start start 2024-01-22T05:14:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.215+0000 7f09ebe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09e4065620 0x7f09e40bd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.215+0000 7f09ebe00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e40c2700 con 0x7f09e4064c00 2024-01-22T05:14:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.215+0000 7f09ebe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e40c29a0 con 0x7f09e4065240 2024-01-22T05:14:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.215+0000 7f09ebe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40c2c80 con 0x7f09e4065620 2024-01-22T05:14:26.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.215+0000 7f09e8a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f09e4064c00 0x7f09e40bcc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33804/0 (socket says 172.21.15.49:33804) 2024-01-22T05:14:26.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.215+0000 7f09e8a00700 1 -- 172.21.15.49:0/680788940 learned_addr learned my addr 172.21.15.49:0/680788940 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:26.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.215+0000 7f09ea800700 1 --2- 172.21.15.49:0/680788940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09e4065620 0x7f09e40bd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:26.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.215+0000 7f09e3e00700 1 -- 172.21.15.49:0/680788940 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275179327 0 0) 0x7f09e40c2700 con 0x7f09e4064c00 2024-01-22T05:14:26.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.215+0000 7f09e3e00700 1 -- 172.21.15.49:0/680788940 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09c40033f0 con 0x7f09e4064c00 2024-01-22T05:14:26.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.215+0000 7f09ea800700 1 -- 172.21.15.49:0/680788940 >> v1:172.21.15.110:6789/0 conn(0x7f09e4065240 legacy=0x7f09e40644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:26.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.215+0000 7f09e3e00700 1 -- 172.21.15.49:0/680788940 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125271422 0 0) 0x7f09e40c29a0 con 0x7f09e4065240 2024-01-22T05:14:26.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.215+0000 7f09ea800700 1 -- 172.21.15.49:0/680788940 >> v1:172.21.15.49:6789/0 conn(0x7f09e4064c00 legacy=0x7f09e40bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:26.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.215+0000 7f09ea800700 1 -- 172.21.15.49:0/680788940 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40c2f60 con 0x7f09e4065620 2024-01-22T05:14:26.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.215+0000 7f09ea800700 1 --2- 172.21.15.49:0/680788940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09e4065620 0x7f09e40bd390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f09dc009e90 tx=0x7f09dc009780).ready entity=mon.2 client_cookie=e28332e51cfb9fad server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:26.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.219+0000 7f09e3e00700 1 -- 172.21.15.49:0/680788940 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc00e070 con 0x7f09e4065620 2024-01-22T05:14:26.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.219+0000 7f09e3e00700 1 -- 172.21.15.49:0/680788940 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc00bb60 con 0x7f09e4065620 2024-01-22T05:14:26.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.219+0000 7f09e3e00700 1 -- 172.21.15.49:0/680788940 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc00bee0 con 0x7f09e4065620 2024-01-22T05:14:26.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.219+0000 7f09ebe00700 1 -- 172.21.15.49:0/680788940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09e4065620 msgr2=0x7f09e40bd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:26.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.219+0000 7f09ebe00700 1 --2- 172.21.15.49:0/680788940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09e4065620 0x7f09e40bd390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f09dc009e90 tx=0x7f09dc009780).stop 2024-01-22T05:14:26.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.219+0000 7f09ebe00700 1 -- 172.21.15.49:0/680788940 shutdown_connections 2024-01-22T05:14:26.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.219+0000 7f09ebe00700 1 --2- 172.21.15.49:0/680788940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09e4065620 0x7f09e40bd390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:26.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.219+0000 7f09ebe00700 1 -- 172.21.15.49:0/680788940 >> 172.21.15.49:0/680788940 conn(0x7f09e40c87f0 msgr2=0x7f09e40c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:26.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.219+0000 7f09ebe00700 1 -- 172.21.15.49:0/680788940 shutdown_connections 2024-01-22T05:14:26.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.219+0000 7f09ebe00700 1 -- 172.21.15.49:0/680788940 wait complete. 2024-01-22T05:14:26.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.223+0000 7f09ebe00700 1 Processor -- start 2024-01-22T05:14:26.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.223+0000 7f09ebe00700 1 -- start start 2024-01-22T05:14:26.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.223+0000 7f09ebe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09e4064c00 0x7f09e40a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:26.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.223+0000 7f09ebe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09e4065240 0x7f09e409fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:26.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.223+0000 7f09ebe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e4065620 0x7f09e4150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:26.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.223+0000 7f09ebe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40a1310 con 0x7f09e4065620 2024-01-22T05:14:26.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.223+0000 7f09ebe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40a0700 con 0x7f09e4065240 2024-01-22T05:14:26.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.223+0000 7f09ebe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40a09e0 con 0x7f09e4064c00 2024-01-22T05:14:26.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.223+0000 7f09ea800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e4065620 0x7f09e4150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:26.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.223+0000 7f09ea800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e4065620 0x7f09e4150100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54958/0 (socket says 172.21.15.49:54958) 2024-01-22T05:14:26.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.223+0000 7f09ea800700 1 -- 172.21.15.49:0/3339481480 learned_addr learned my addr 172.21.15.49:0/3339481480 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:26.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.223+0000 7f09e8a00700 1 --2- 172.21.15.49:0/3339481480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09e4065240 0x7f09e409fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:26.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.223+0000 7f09e9400700 1 --2- 172.21.15.49:0/3339481480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09e4064c00 0x7f09e40a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:26.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.227+0000 7f09ea800700 1 -- 172.21.15.49:0/3339481480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09e4064c00 msgr2=0x7f09e40a8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:26.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.227+0000 7f09ea800700 1 --2- 172.21.15.49:0/3339481480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09e4064c00 0x7f09e40a8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:26.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.227+0000 7f09ea800700 1 -- 172.21.15.49:0/3339481480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09e4065240 msgr2=0x7f09e409fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:26.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.227+0000 7f09ea800700 1 --2- 172.21.15.49:0/3339481480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09e4065240 0x7f09e409fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:26.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.227+0000 7f09ea800700 1 -- 172.21.15.49:0/3339481480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc009a20 con 0x7f09e4065620 2024-01-22T05:14:26.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.227+0000 7f09e9400700 1 --2- 172.21.15.49:0/3339481480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09e4064c00 0x7f09e40a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:26.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.227+0000 7f09ea800700 1 --2- 172.21.15.49:0/3339481480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e4065620 0x7f09e4150100 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f09dc00b6c0 tx=0x7f09e40c2890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:26.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.227+0000 7f09e0c00700 1 -- 172.21.15.49:0/3339481480 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc01d630 con 0x7f09e4065620 2024-01-22T05:14:26.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.227+0000 7f09e0c00700 1 -- 172.21.15.49:0/3339481480 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc01d790 con 0x7f09e4065620 2024-01-22T05:14:26.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.227+0000 7f09ebe00700 1 -- 172.21.15.49:0/3339481480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e40a0cc0 con 0x7f09e4065620 2024-01-22T05:14:26.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.227+0000 7f09e0c00700 1 -- 172.21.15.49:0/3339481480 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc01db30 con 0x7f09e4065620 2024-01-22T05:14:26.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.227+0000 7f09ebe00700 1 -- 172.21.15.49:0/3339481480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e40a0360 con 0x7f09e4065620 2024-01-22T05:14:26.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.227+0000 7f09ebe00700 1 -- 172.21.15.49:0/3339481480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e40c2000 con 0x7f09e4065620 2024-01-22T05:14:26.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.231+0000 7f09e0c00700 1 -- 172.21.15.49:0/3339481480 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f09dc003040 con 0x7f09e4065620 2024-01-22T05:14:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.231+0000 7f09e0c00700 1 --2- 172.21.15.49:0/3339481480 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f09bc05a560 0x7f09bc05ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.231+0000 7f09e0c00700 1 -- 172.21.15.49:0/3339481480 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f09dc0768f0 con 0x7f09e4065620 2024-01-22T05:14:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.231+0000 7f09e9400700 1 --2- 172.21.15.49:0/3339481480 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f09bc05a560 0x7f09bc05ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:26.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.235+0000 7f09e9400700 1 --2- 172.21.15.49:0/3339481480 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f09bc05a560 0x7f09bc05ca20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f09d4007fd0 tx=0x7f09d4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.239+0000 7f09e0c00700 1 -- 172.21.15.49:0/3339481480 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f09dc049f30 con 0x7f09e4065620 2024-01-22T05:14:26.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.467+0000 7f09ebe00700 1 -- 172.21.15.49:0/3339481480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f09e4047060 con 0x7f09e4065620 2024-01-22T05:14:26.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.471+0000 7f09e0c00700 1 -- 172.21.15.49:0/3339481480 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1192 (secure 0 0 0) 0x7f09dc04d550 con 0x7f09e4065620 2024-01-22T05:14:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:26.472 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":610,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":118,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1028,"data_bytes":1056642217,"bytes_used":4597547008,"bytes_avail":768496566272,"bytes_total":773094113280,"write_bytes_sec":27134490,"read_op_per_sec":0,"write_op_per_sec":26},"fsmap":{"epoch":98,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7743}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-01-22T05:13:21.420936+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:14:26.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.471+0000 7f09ebe00700 1 -- 172.21.15.49:0/3339481480 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f09bc05a560 msgr2=0x7f09bc05ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:26.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.471+0000 7f09ebe00700 1 --2- 172.21.15.49:0/3339481480 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f09bc05a560 0x7f09bc05ca20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f09d4007fd0 tx=0x7f09d4009040).stop 2024-01-22T05:14:26.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.471+0000 7f09ebe00700 1 -- 172.21.15.49:0/3339481480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e4065620 msgr2=0x7f09e4150100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:26.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.471+0000 7f09ebe00700 1 --2- 172.21.15.49:0/3339481480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e4065620 0x7f09e4150100 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f09dc00b6c0 tx=0x7f09e40c2890).stop 2024-01-22T05:14:26.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.471+0000 7f09ebe00700 1 -- 172.21.15.49:0/3339481480 shutdown_connections 2024-01-22T05:14:26.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.471+0000 7f09ebe00700 1 --2- 172.21.15.49:0/3339481480 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f09bc05a560 0x7f09bc05ca20 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:26.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.471+0000 7f09ebe00700 1 --2- 172.21.15.49:0/3339481480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09e4065620 0x7f09e4150100 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:26.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.471+0000 7f09ebe00700 1 --2- 172.21.15.49:0/3339481480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09e4065240 0x7f09e409fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:26.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.471+0000 7f09ebe00700 1 --2- 172.21.15.49:0/3339481480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09e4064c00 0x7f09e40a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:26.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.471+0000 7f09ebe00700 1 -- 172.21.15.49:0/3339481480 >> 172.21.15.49:0/3339481480 conn(0x7f09e40c87f0 msgr2=0x7f09e4062230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:26.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.475+0000 7f09ebe00700 1 -- 172.21.15.49:0/3339481480 shutdown_connections 2024-01-22T05:14:26.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:26.475+0000 7f09ebe00700 1 -- 172.21.15.49:0/3339481480 wait complete. 2024-01-22T05:14:26.495 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-01-22T05:14:27.496 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:14:27.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.667+0000 7f3cc5000700 1 Processor -- start 2024-01-22T05:14:27.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.667+0000 7f3cc5000700 1 -- start start 2024-01-22T05:14:27.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.671+0000 7f3cc5000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3cc00a8740 0x7f3cc00a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:27.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.671+0000 7f3cc5000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3cc00c1ed0 0x7f3cc00c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:27.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.671+0000 7f3cc5000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc00c1a40 con 0x7f3cc0155d20 2024-01-22T05:14:27.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.671+0000 7f3cc5000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc00a90b0 con 0x7f3cc00a8740 2024-01-22T05:14:27.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.671+0000 7f3cc5000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc0159310 con 0x7f3cc00c1ed0 2024-01-22T05:14:27.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.671+0000 7f3cbe800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3cc00c1ed0 0x7f3cc00c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:27.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.671+0000 7f3cbe800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3cc00c1ed0 0x7f3cc00c2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:57770/0 (socket says 172.21.15.49:57770) 2024-01-22T05:14:27.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.671+0000 7f3cbe800700 1 -- 172.21.15.49:0/4291709765 learned_addr learned my addr 172.21.15.49:0/4291709765 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:27.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.671+0000 7f3cbd400700 1 --2- 172.21.15.49:0/4291709765 >> v2:172.21.15.49:3300/0 conn(0x7f3cc00a8740 0x7f3cc00a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:27.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.675+0000 7f3cbe800700 1 -- 172.21.15.49:0/4291709765 >> v2:172.21.15.49:3300/0 conn(0x7f3cc00a8740 msgr2=0x7f3cc00a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:27.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.675+0000 7f3cbe800700 1 --2- 172.21.15.49:0/4291709765 >> v2:172.21.15.49:3300/0 conn(0x7f3cc00a8740 0x7f3cc00a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:27.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.675+0000 7f3cbe800700 1 -- 172.21.15.49:0/4291709765 >> v1:172.21.15.110:6789/0 conn(0x7f3cc0155d20 legacy=0x7f3cc0065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:27.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.675+0000 7f3cbe800700 1 -- 172.21.15.49:0/4291709765 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc00c13f0 con 0x7f3cc00c1ed0 2024-01-22T05:14:27.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.679+0000 7f3cbe800700 1 --2- 172.21.15.49:0/4291709765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cc00c1ed0 0x7f3cc00c2360 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f3cc00c19b0 tx=0x7f3cb8009840).ready entity=mon.1 client_cookie=ed6057096a66cadf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.679+0000 7f3cbca00700 1 -- 172.21.15.49:0/4291709765 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb800e070 con 0x7f3cc00c1ed0 2024-01-22T05:14:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.679+0000 7f3cbca00700 1 -- 172.21.15.49:0/4291709765 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb800ba20 con 0x7f3cc00c1ed0 2024-01-22T05:14:27.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.679+0000 7f3cbca00700 1 -- 172.21.15.49:0/4291709765 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb800bda0 con 0x7f3cc00c1ed0 2024-01-22T05:14:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.683+0000 7f3cc5000700 1 -- 172.21.15.49:0/4291709765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cc00c1ed0 msgr2=0x7f3cc00c2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.683+0000 7f3cc5000700 1 --2- 172.21.15.49:0/4291709765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cc00c1ed0 0x7f3cc00c2360 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f3cc00c19b0 tx=0x7f3cb8009840).stop 2024-01-22T05:14:27.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.691+0000 7f3cc5000700 1 -- 172.21.15.49:0/4291709765 shutdown_connections 2024-01-22T05:14:27.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.691+0000 7f3cc5000700 1 --2- 172.21.15.49:0/4291709765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cc00c1ed0 0x7f3cc00c2360 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:27.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.691+0000 7f3cc5000700 1 --2- 172.21.15.49:0/4291709765 >> v2:172.21.15.49:3300/0 conn(0x7f3cc00a8740 0x7f3cc00a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:27.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.691+0000 7f3cc5000700 1 -- 172.21.15.49:0/4291709765 >> 172.21.15.49:0/4291709765 conn(0x7f3cc00c6540 msgr2=0x7f3cc00c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:27.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.695+0000 7f3cc5000700 1 -- 172.21.15.49:0/4291709765 shutdown_connections 2024-01-22T05:14:27.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.695+0000 7f3cc5000700 1 -- 172.21.15.49:0/4291709765 wait complete. 2024-01-22T05:14:27.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.699+0000 7f3cc5000700 1 Processor -- start 2024-01-22T05:14:27.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.703+0000 7f3cc5000700 1 -- start start 2024-01-22T05:14:27.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.707+0000 7f3cc5000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cc00a8740 0x7f3cc0153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:27.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.707+0000 7f3cc5000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cc00c1ed0 0x7f3cc0153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:27.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.707+0000 7f3cc5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc0155d20 0x7f3cc00be3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:27.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.707+0000 7f3cc5000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc0152330 con 0x7f3cc0155d20 2024-01-22T05:14:27.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.707+0000 7f3cc5000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc0153190 con 0x7f3cc00c1ed0 2024-01-22T05:14:27.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.707+0000 7f3cc5000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc0152580 con 0x7f3cc00a8740 2024-01-22T05:14:27.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.707+0000 7f3cbe800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc0155d20 0x7f3cc00be3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:27.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.707+0000 7f3cbe800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc0155d20 0x7f3cc00be3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54966/0 (socket says 172.21.15.49:54966) 2024-01-22T05:14:27.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.707+0000 7f3cbe800700 1 -- 172.21.15.49:0/2753871652 learned_addr learned my addr 172.21.15.49:0/2753871652 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:27.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.707+0000 7f3cbe800700 1 -- 172.21.15.49:0/2753871652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cc00a8740 msgr2=0x7f3cc0153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:27.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.707+0000 7f3cbe800700 1 --2- 172.21.15.49:0/2753871652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cc00a8740 0x7f3cc0153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:14:27.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.707+0000 7f3cbe800700 1 -- 172.21.15.49:0/2753871652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cc00c1ed0 msgr2=0x7f3cc0153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:27.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.707+0000 7f3cbe800700 1 --2- 172.21.15.49:0/2753871652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cc00c1ed0 0x7f3cc0153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:14:27.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.707+0000 7f3cbe800700 1 -- 172.21.15.49:0/2753871652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb8009ae0 con 0x7f3cc0155d20 2024-01-22T05:14:27.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.711+0000 7f3cbe800700 1 --2- 172.21.15.49:0/2753871652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc0155d20 0x7f3cc00be3b0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f3cc0159450 tx=0x7f3cb8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:27.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.711+0000 7f3cb5600700 1 -- 172.21.15.49:0/2753871652 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb80092e0 con 0x7f3cc0155d20 2024-01-22T05:14:27.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.711+0000 7f3cb5600700 1 -- 172.21.15.49:0/2753871652 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb801d410 con 0x7f3cc0155d20 2024-01-22T05:14:27.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.711+0000 7f3cb5600700 1 -- 172.21.15.49:0/2753871652 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb801d7d0 con 0x7f3cc0155d20 2024-01-22T05:14:27.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.715+0000 7f3cc5000700 1 -- 172.21.15.49:0/2753871652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc0152860 con 0x7f3cc0155d20 2024-01-22T05:14:27.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.715+0000 7f3cc5000700 1 -- 172.21.15.49:0/2753871652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc0152e20 con 0x7f3cc0155d20 2024-01-22T05:14:27.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.715+0000 7f3cc5000700 1 -- 172.21.15.49:0/2753871652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc00a8bb0 con 0x7f3cc0155d20 2024-01-22T05:14:27.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.719+0000 7f3cb5600700 1 -- 172.21.15.49:0/2753871652 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3cb801db40 con 0x7f3cc0155d20 2024-01-22T05:14:27.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.723+0000 7f3cb5600700 1 --2- 172.21.15.49:0/2753871652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c9805a560 0x7f3c9805ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:27.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.723+0000 7f3cb5600700 1 -- 172.21.15.49:0/2753871652 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f3cb8076670 con 0x7f3cc0155d20 2024-01-22T05:14:27.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.727+0000 7f3cbde00700 1 --2- 172.21.15.49:0/2753871652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c9805a560 0x7f3c9805ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:27.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.731+0000 7f3cbde00700 1 --2- 172.21.15.49:0/2753871652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c9805a560 0x7f3c9805ca20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f3cb0001470 tx=0x7f3cb00079c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:27.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.731+0000 7f3cb5600700 1 -- 172.21.15.49:0/2753871652 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3cc00a8bb0 con 0x7f3cc0155d20 2024-01-22T05:14:27.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.967+0000 7f3cc5000700 1 -- 172.21.15.49:0/2753871652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3cc0047060 con 0x7f3cc0155d20 2024-01-22T05:14:27.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.967+0000 7f3cb5600700 1 -- 172.21.15.49:0/2753871652 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f3cc00a8bb0 con 0x7f3cc0155d20 2024-01-22T05:14:27.971 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:27.971 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:14:27.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.971+0000 7f3cc5000700 1 -- 172.21.15.49:0/2753871652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c9805a560 msgr2=0x7f3c9805ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:27.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.971+0000 7f3cc5000700 1 --2- 172.21.15.49:0/2753871652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c9805a560 0x7f3c9805ca20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f3cb0001470 tx=0x7f3cb00079c0).stop 2024-01-22T05:14:27.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.971+0000 7f3cc5000700 1 -- 172.21.15.49:0/2753871652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc0155d20 msgr2=0x7f3cc00be3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:27.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.971+0000 7f3cc5000700 1 --2- 172.21.15.49:0/2753871652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc0155d20 0x7f3cc00be3b0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f3cc0159450 tx=0x7f3cb8009840).stop 2024-01-22T05:14:27.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.971+0000 7f3cc5000700 1 -- 172.21.15.49:0/2753871652 shutdown_connections 2024-01-22T05:14:27.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.971+0000 7f3cc5000700 1 --2- 172.21.15.49:0/2753871652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c9805a560 0x7f3c9805ca20 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:27.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.971+0000 7f3cc5000700 1 --2- 172.21.15.49:0/2753871652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc0155d20 0x7f3cc00be3b0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:27.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.971+0000 7f3cc5000700 1 --2- 172.21.15.49:0/2753871652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cc00c1ed0 0x7f3cc0153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:14:27.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.971+0000 7f3cc5000700 1 --2- 172.21.15.49:0/2753871652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cc00a8740 0x7f3cc0153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:14:27.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.971+0000 7f3cc5000700 1 -- 172.21.15.49:0/2753871652 >> 172.21.15.49:0/2753871652 conn(0x7f3cc00c6540 msgr2=0x7f3cc00c22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:27.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.971+0000 7f3cc5000700 1 -- 172.21.15.49:0/2753871652 shutdown_connections 2024-01-22T05:14:27.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:27.971+0000 7f3cc5000700 1 -- 172.21.15.49:0/2753871652 wait complete. 2024-01-22T05:14:27.979 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:14:27.997 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-01-22T05:14:27.998 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:14:28.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.151+0000 7f4b6ae00700 1 Processor -- start 2024-01-22T05:14:28.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.151+0000 7f4b6ae00700 1 -- start start 2024-01-22T05:14:28.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b6ae00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4b640a8740 0x7f4b640a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:28.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b6ae00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4b640c1ed0 0x7f4b640c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:28.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b6ae00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b640c1a40 con 0x7f4b64155d20 2024-01-22T05:14:28.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b6ae00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b640a90b0 con 0x7f4b640c1ed0 2024-01-22T05:14:28.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b6ae00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b64159310 con 0x7f4b640a8740 2024-01-22T05:14:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b63e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4b64155d20 0x7f4b64065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33814/0 (socket says 172.21.15.49:33814) 2024-01-22T05:14:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b63e00700 1 -- 172.21.15.49:0/2215321416 learned_addr learned my addr 172.21.15.49:0/2215321416 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b68e00700 1 --2- 172.21.15.49:0/2215321416 >> v2:172.21.15.49:3300/0 conn(0x7f4b640c1ed0 0x7f4b640c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b63400700 1 --2- 172.21.15.49:0/2215321416 >> v2:172.21.15.110:3300/0 conn(0x7f4b640a8740 0x7f4b640a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:28.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b62a00700 1 -- 172.21.15.49:0/2215321416 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353720018 0 0) 0x7f4b640c1a40 con 0x7f4b64155d20 2024-01-22T05:14:28.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b62a00700 1 -- 172.21.15.49:0/2215321416 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b440033f0 con 0x7f4b64155d20 2024-01-22T05:14:28.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b62a00700 1 -- 172.21.15.49:0/2215321416 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1098827737 0 0) 0x7f4b440033f0 con 0x7f4b64155d20 2024-01-22T05:14:28.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b68e00700 1 -- 172.21.15.49:0/2215321416 >> v2:172.21.15.110:3300/0 conn(0x7f4b640a8740 msgr2=0x7f4b640a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:28.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b68e00700 1 --2- 172.21.15.49:0/2215321416 >> v2:172.21.15.110:3300/0 conn(0x7f4b640a8740 0x7f4b640a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:28.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b68e00700 1 -- 172.21.15.49:0/2215321416 >> v1:172.21.15.49:6789/0 conn(0x7f4b64155d20 legacy=0x7f4b64065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:28.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b68e00700 1 -- 172.21.15.49:0/2215321416 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b640c13f0 con 0x7f4b640c1ed0 2024-01-22T05:14:28.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b68e00700 1 --2- 172.21.15.49:0/2215321416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b640c1ed0 0x7f4b640c2360 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f4b640c0ad0 tx=0x7f4b5c009780).ready entity=mon.0 client_cookie=c662a0ed50df277d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:28.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b62a00700 1 -- 172.21.15.49:0/2215321416 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c00e070 con 0x7f4b640c1ed0 2024-01-22T05:14:28.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b62a00700 1 -- 172.21.15.49:0/2215321416 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5c00b7a0 con 0x7f4b640c1ed0 2024-01-22T05:14:28.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.155+0000 7f4b62a00700 1 -- 172.21.15.49:0/2215321416 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54001470 con 0x7f4b640c1ed0 2024-01-22T05:14:28.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.159+0000 7f4b6ae00700 1 -- 172.21.15.49:0/2215321416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b640c1ed0 msgr2=0x7f4b640c2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:28.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.159+0000 7f4b6ae00700 1 --2- 172.21.15.49:0/2215321416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b640c1ed0 0x7f4b640c2360 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f4b640c0ad0 tx=0x7f4b5c009780).stop 2024-01-22T05:14:28.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.159+0000 7f4b6ae00700 1 -- 172.21.15.49:0/2215321416 shutdown_connections 2024-01-22T05:14:28.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.159+0000 7f4b6ae00700 1 --2- 172.21.15.49:0/2215321416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b640c1ed0 0x7f4b640c2360 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:28.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.159+0000 7f4b6ae00700 1 --2- 172.21.15.49:0/2215321416 >> v2:172.21.15.110:3300/0 conn(0x7f4b640a8740 0x7f4b640a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:28.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.159+0000 7f4b6ae00700 1 -- 172.21.15.49:0/2215321416 >> 172.21.15.49:0/2215321416 conn(0x7f4b640c6540 msgr2=0x7f4b640c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:28.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.159+0000 7f4b6ae00700 1 -- 172.21.15.49:0/2215321416 shutdown_connections 2024-01-22T05:14:28.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.159+0000 7f4b6ae00700 1 -- 172.21.15.49:0/2215321416 wait complete. 2024-01-22T05:14:28.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.163+0000 7f4b6ae00700 1 Processor -- start 2024-01-22T05:14:28.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.163+0000 7f4b6ae00700 1 -- start start 2024-01-22T05:14:28.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.163+0000 7f4b6ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b640a8740 0x7f4b64169580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:28.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.163+0000 7f4b6ae00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b640c1ed0 0x7f4b640bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:28.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.163+0000 7f4b6ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b64155d20 0x7f4b6416ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:28.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.163+0000 7f4b6ae00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6415b050 con 0x7f4b640c1ed0 2024-01-22T05:14:28.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.163+0000 7f4b6ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6416c5b0 con 0x7f4b64155d20 2024-01-22T05:14:28.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.163+0000 7f4b6ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b640aa8e0 con 0x7f4b640a8740 2024-01-22T05:14:28.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b63400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b640c1ed0 0x7f4b640bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:28.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b63400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b640c1ed0 0x7f4b640bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54984/0 (socket says 172.21.15.49:54984) 2024-01-22T05:14:28.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b63400700 1 -- 172.21.15.49:0/1554268626 learned_addr learned my addr 172.21.15.49:0/1554268626 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:28.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b63e00700 1 --2- 172.21.15.49:0/1554268626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b640a8740 0x7f4b64169580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:28.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b68e00700 1 --2- 172.21.15.49:0/1554268626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b64155d20 0x7f4b6416ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:28.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b63400700 1 -- 172.21.15.49:0/1554268626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b640a8740 msgr2=0x7f4b64169580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:28.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b63400700 1 --2- 172.21.15.49:0/1554268626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b640a8740 0x7f4b64169580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:28.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b63400700 1 -- 172.21.15.49:0/1554268626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b64155d20 msgr2=0x7f4b6416ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:28.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b63400700 1 --2- 172.21.15.49:0/1554268626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b64155d20 0x7f4b6416ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:28.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b63400700 1 -- 172.21.15.49:0/1554268626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c009a20 con 0x7f4b640c1ed0 2024-01-22T05:14:28.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b63400700 1 --2- 172.21.15.49:0/1554268626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b640c1ed0 0x7f4b640bfcd0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f4b4c00e930 tx=0x7f4b4c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:28.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b5b400700 1 -- 172.21.15.49:0/1554268626 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c012600 con 0x7f4b640c1ed0 2024-01-22T05:14:28.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b5b400700 1 -- 172.21.15.49:0/1554268626 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4c012760 con 0x7f4b640c1ed0 2024-01-22T05:14:28.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b5b400700 1 -- 172.21.15.49:0/1554268626 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c012ae0 con 0x7f4b640c1ed0 2024-01-22T05:14:28.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b6ae00700 1 -- 172.21.15.49:0/1554268626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b640aabc0 con 0x7f4b640c1ed0 2024-01-22T05:14:28.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.167+0000 7f4b6ae00700 1 -- 172.21.15.49:0/1554268626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b640c01c0 con 0x7f4b640c1ed0 2024-01-22T05:14:28.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.171+0000 7f4b6ae00700 1 -- 172.21.15.49:0/1554268626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b64047060 con 0x7f4b640c1ed0 2024-01-22T05:14:28.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.171+0000 7f4b5b400700 1 -- 172.21.15.49:0/1554268626 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4b4c01b400 con 0x7f4b640c1ed0 2024-01-22T05:14:28.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.171+0000 7f4b5b400700 1 --2- 172.21.15.49:0/1554268626 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b3c05a510 0x7f4b3c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:28.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.171+0000 7f4b5b400700 1 -- 172.21.15.49:0/1554268626 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f4b4c074e60 con 0x7f4b640c1ed0 2024-01-22T05:14:28.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.171+0000 7f4b63e00700 1 --2- 172.21.15.49:0/1554268626 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b3c05a510 0x7f4b3c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:28.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.175+0000 7f4b63e00700 1 --2- 172.21.15.49:0/1554268626 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b3c05a510 0x7f4b3c05c9d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f4b540011e0 tx=0x7f4b54001a00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:28.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.175+0000 7f4b5b400700 1 -- 172.21.15.49:0/1554268626 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4b4c048350 con 0x7f4b640c1ed0 2024-01-22T05:14:28.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.403+0000 7f4b6ae00700 1 -- 172.21.15.49:0/1554268626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4b640c16d0 con 0x7f4b640c1ed0 2024-01-22T05:14:28.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.403+0000 7f4b5b400700 1 -- 172.21.15.49:0/1554268626 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1192 (secure 0 0 0) 0x7f4b4c04b970 con 0x7f4b640c1ed0 2024-01-22T05:14:28.406 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:28.407 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":612,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1042,"data_bytes":1071322281,"bytes_used":4643016704,"bytes_avail":768451096576,"bytes_total":773094113280,"write_bytes_sec":22316880,"read_op_per_sec":0,"write_op_per_sec":22},"fsmap":{"epoch":98,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7743}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-01-22T05:13:21.420936+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:14:28.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.407+0000 7f4b6ae00700 1 -- 172.21.15.49:0/1554268626 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b3c05a510 msgr2=0x7f4b3c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:28.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.407+0000 7f4b6ae00700 1 --2- 172.21.15.49:0/1554268626 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b3c05a510 0x7f4b3c05c9d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f4b540011e0 tx=0x7f4b54001a00).stop 2024-01-22T05:14:28.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.407+0000 7f4b6ae00700 1 -- 172.21.15.49:0/1554268626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b640c1ed0 msgr2=0x7f4b640bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:28.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.407+0000 7f4b6ae00700 1 --2- 172.21.15.49:0/1554268626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b640c1ed0 0x7f4b640bfcd0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f4b4c00e930 tx=0x7f4b4c009060).stop 2024-01-22T05:14:28.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.407+0000 7f4b6ae00700 1 -- 172.21.15.49:0/1554268626 shutdown_connections 2024-01-22T05:14:28.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.407+0000 7f4b6ae00700 1 --2- 172.21.15.49:0/1554268626 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b3c05a510 0x7f4b3c05c9d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:28.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.407+0000 7f4b6ae00700 1 --2- 172.21.15.49:0/1554268626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b64155d20 0x7f4b6416ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:28.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.407+0000 7f4b6ae00700 1 --2- 172.21.15.49:0/1554268626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b640c1ed0 0x7f4b640bfcd0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:28.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.407+0000 7f4b6ae00700 1 --2- 172.21.15.49:0/1554268626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b640a8740 0x7f4b64169580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:28.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.407+0000 7f4b6ae00700 1 -- 172.21.15.49:0/1554268626 >> 172.21.15.49:0/1554268626 conn(0x7f4b640c6540 msgr2=0x7f4b640c22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:28.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.411+0000 7f4b6ae00700 1 -- 172.21.15.49:0/1554268626 shutdown_connections 2024-01-22T05:14:28.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:28.411+0000 7f4b6ae00700 1 -- 172.21.15.49:0/1554268626 wait complete. 2024-01-22T05:14:28.433 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-01-22T05:14:29.433 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:14:29.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.607+0000 7ff8d0200700 1 Processor -- start 2024-01-22T05:14:29.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.607+0000 7ff8d0200700 1 -- start start 2024-01-22T05:14:29.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.611+0000 7ff8d0200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8c8065240 0x7ff8c80644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:29.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.611+0000 7ff8d0200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff8c8065620 0x7ff8c80649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:29.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.611+0000 7ff8d0200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c80c2700 con 0x7ff8c815b9b0 2024-01-22T05:14:29.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.611+0000 7ff8d0200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c8064ed0 con 0x7ff8c8065620 2024-01-22T05:14:29.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.611+0000 7ff8d0200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c80c29a0 con 0x7ff8c8065240 2024-01-22T05:14:29.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.611+0000 7ff8cce00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff8c8065620 0x7ff8c80649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:29.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.611+0000 7ff8cce00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff8c8065620 0x7ff8c80649e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54992/0 (socket says 172.21.15.49:54992) 2024-01-22T05:14:29.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.611+0000 7ff8cce00700 1 -- 172.21.15.49:0/828417622 learned_addr learned my addr 172.21.15.49:0/828417622 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:29.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.611+0000 7ff8cd800700 1 --2- 172.21.15.49:0/828417622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8c8065240 0x7ff8c80644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:29.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.611+0000 7ff8cce00700 1 -- 172.21.15.49:0/828417622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8c8065240 msgr2=0x7ff8c80644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:29.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.611+0000 7ff8cce00700 1 --2- 172.21.15.49:0/828417622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8c8065240 0x7ff8c80644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:29.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.611+0000 7ff8cce00700 1 -- 172.21.15.49:0/828417622 >> v1:172.21.15.110:6789/0 conn(0x7ff8c815b9b0 legacy=0x7ff8c815be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:29.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.611+0000 7ff8cce00700 1 -- 172.21.15.49:0/828417622 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c80c2c80 con 0x7ff8c8065620 2024-01-22T05:14:29.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.615+0000 7ff8cce00700 1 --2- 172.21.15.49:0/828417622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8c8065620 0x7ff8c80649e0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7ff8b0006fd0 tx=0x7ff8b00090f0).ready entity=mon.0 client_cookie=91922fffe2d68fc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:29.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.615+0000 7ff8c7e00700 1 -- 172.21.15.49:0/828417622 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000b600 con 0x7ff8c8065620 2024-01-22T05:14:29.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.615+0000 7ff8c7e00700 1 -- 172.21.15.49:0/828417622 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b000b760 con 0x7ff8c8065620 2024-01-22T05:14:29.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.615+0000 7ff8c7e00700 1 -- 172.21.15.49:0/828417622 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000bae0 con 0x7ff8c8065620 2024-01-22T05:14:29.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.615+0000 7ff8d0200700 1 -- 172.21.15.49:0/828417622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8c8065620 msgr2=0x7ff8c80649e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:29.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.615+0000 7ff8d0200700 1 --2- 172.21.15.49:0/828417622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8c8065620 0x7ff8c80649e0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7ff8b0006fd0 tx=0x7ff8b00090f0).stop 2024-01-22T05:14:29.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.615+0000 7ff8d0200700 1 -- 172.21.15.49:0/828417622 shutdown_connections 2024-01-22T05:14:29.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.615+0000 7ff8d0200700 1 --2- 172.21.15.49:0/828417622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8c8065620 0x7ff8c80649e0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:29.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.615+0000 7ff8d0200700 1 --2- 172.21.15.49:0/828417622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8c8065240 0x7ff8c80644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:29.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.615+0000 7ff8d0200700 1 -- 172.21.15.49:0/828417622 >> 172.21.15.49:0/828417622 conn(0x7ff8c80c87f0 msgr2=0x7ff8c80c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:29.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.615+0000 7ff8d0200700 1 -- 172.21.15.49:0/828417622 shutdown_connections 2024-01-22T05:14:29.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.615+0000 7ff8d0200700 1 -- 172.21.15.49:0/828417622 wait complete. 2024-01-22T05:14:29.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.619+0000 7ff8d0200700 1 Processor -- start 2024-01-22T05:14:29.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.619+0000 7ff8d0200700 1 -- start start 2024-01-22T05:14:29.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8d0200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8c8065240 0x7ff8c81598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:29.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8d0200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8c8065620 0x7ff8c8158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:29.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8d0200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8c815b9b0 0x7ff8c8146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:29.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8d0200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8158ad0 con 0x7ff8c8065620 2024-01-22T05:14:29.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8d0200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8158db0 con 0x7ff8c815b9b0 2024-01-22T05:14:29.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8d0200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8159090 con 0x7ff8c8065240 2024-01-22T05:14:29.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8cce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8c8065620 0x7ff8c8158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:29.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8cce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8c8065620 0x7ff8c8158080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54998/0 (socket says 172.21.15.49:54998) 2024-01-22T05:14:29.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8cce00700 1 -- 172.21.15.49:0/1443415256 learned_addr learned my addr 172.21.15.49:0/1443415256 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:29.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8cd800700 1 --2- 172.21.15.49:0/1443415256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8c8065240 0x7ff8c81598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:29.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8cec00700 1 --2- 172.21.15.49:0/1443415256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8c815b9b0 0x7ff8c8146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:29.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8cce00700 1 -- 172.21.15.49:0/1443415256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8c8065240 msgr2=0x7ff8c81598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:29.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8cce00700 1 --2- 172.21.15.49:0/1443415256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8c8065240 0x7ff8c81598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:29.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8cce00700 1 -- 172.21.15.49:0/1443415256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8c815b9b0 msgr2=0x7ff8c8146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:29.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8cce00700 1 --2- 172.21.15.49:0/1443415256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8c815b9b0 0x7ff8c8146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:29.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8cce00700 1 -- 172.21.15.49:0/1443415256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b0009370 con 0x7ff8c8065620 2024-01-22T05:14:29.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8cec00700 1 --2- 172.21.15.49:0/1443415256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8c815b9b0 0x7ff8c8146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:29.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8cce00700 1 --2- 172.21.15.49:0/1443415256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8c8065620 0x7ff8c8158080 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7ff8b0011000 tx=0x7ff8b0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:29.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8c4c00700 1 -- 172.21.15.49:0/1443415256 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000b8d0 con 0x7ff8c8065620 2024-01-22T05:14:29.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8c4c00700 1 -- 172.21.15.49:0/1443415256 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b000ba30 con 0x7ff8c8065620 2024-01-22T05:14:29.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8d0200700 1 -- 172.21.15.49:0/1443415256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c8159370 con 0x7ff8c8065620 2024-01-22T05:14:29.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8c4c00700 1 -- 172.21.15.49:0/1443415256 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b001c670 con 0x7ff8c8065620 2024-01-22T05:14:29.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.623+0000 7ff8d0200700 1 -- 172.21.15.49:0/1443415256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c80bf560 con 0x7ff8c8065620 2024-01-22T05:14:29.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.627+0000 7ff8d0200700 1 -- 172.21.15.49:0/1443415256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c8047060 con 0x7ff8c8065620 2024-01-22T05:14:29.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.627+0000 7ff8c4c00700 1 -- 172.21.15.49:0/1443415256 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff8b001ca60 con 0x7ff8c8065620 2024-01-22T05:14:29.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.627+0000 7ff8c4c00700 1 --2- 172.21.15.49:0/1443415256 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff8a005a510 0x7ff8a005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:29.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.627+0000 7ff8c4c00700 1 -- 172.21.15.49:0/1443415256 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7ff8b0076790 con 0x7ff8c8065620 2024-01-22T05:14:29.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.627+0000 7ff8cd800700 1 --2- 172.21.15.49:0/1443415256 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff8a005a510 0x7ff8a005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:29.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.631+0000 7ff8cd800700 1 --2- 172.21.15.49:0/1443415256 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff8a005a510 0x7ff8a005c9d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7ff8b800bbc0 tx=0x7ff8b8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:29.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.635+0000 7ff8c4c00700 1 -- 172.21.15.49:0/1443415256 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff8b0049ce0 con 0x7ff8c8065620 2024-01-22T05:14:29.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.831+0000 7ff8d0200700 1 -- 172.21.15.49:0/1443415256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8c80bf780 con 0x7ff8c8065620 2024-01-22T05:14:29.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.831+0000 7ff8c4c00700 1 -- 172.21.15.49:0/1443415256 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7ff8b002a020 con 0x7ff8c8065620 2024-01-22T05:14:29.834 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:29.834 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:14:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.835+0000 7ff8d0200700 1 -- 172.21.15.49:0/1443415256 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff8a005a510 msgr2=0x7ff8a005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.835+0000 7ff8d0200700 1 --2- 172.21.15.49:0/1443415256 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff8a005a510 0x7ff8a005c9d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7ff8b800bbc0 tx=0x7ff8b8008040).stop 2024-01-22T05:14:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.835+0000 7ff8d0200700 1 -- 172.21.15.49:0/1443415256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8c8065620 msgr2=0x7ff8c8158080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.835+0000 7ff8d0200700 1 --2- 172.21.15.49:0/1443415256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8c8065620 0x7ff8c8158080 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7ff8b0011000 tx=0x7ff8b0017000).stop 2024-01-22T05:14:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.835+0000 7ff8d0200700 1 -- 172.21.15.49:0/1443415256 shutdown_connections 2024-01-22T05:14:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.835+0000 7ff8d0200700 1 --2- 172.21.15.49:0/1443415256 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff8a005a510 0x7ff8a005c9d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.835+0000 7ff8d0200700 1 --2- 172.21.15.49:0/1443415256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8c815b9b0 0x7ff8c8146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.835+0000 7ff8d0200700 1 --2- 172.21.15.49:0/1443415256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8c8065620 0x7ff8c8158080 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.835+0000 7ff8d0200700 1 --2- 172.21.15.49:0/1443415256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8c8065240 0x7ff8c81598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.835+0000 7ff8d0200700 1 -- 172.21.15.49:0/1443415256 >> 172.21.15.49:0/1443415256 conn(0x7ff8c80c87f0 msgr2=0x7ff8c8156f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:29.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.835+0000 7ff8d0200700 1 -- 172.21.15.49:0/1443415256 shutdown_connections 2024-01-22T05:14:29.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:29.835+0000 7ff8d0200700 1 -- 172.21.15.49:0/1443415256 wait complete. 2024-01-22T05:14:29.841 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:14:29.860 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-01-22T05:14:29.860 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:14:30.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.007+0000 7f9b40400700 1 Processor -- start 2024-01-22T05:14:30.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.007+0000 7f9b40400700 1 -- start start 2024-01-22T05:14:30.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.011+0000 7f9b40400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9b380a8b10 0x7f9b38157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:30.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.011+0000 7f9b40400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b380a8f90 0x7f9b38157c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:30.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.011+0000 7f9b40400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b380c1ee0 con 0x7f9b38066fb0 2024-01-22T05:14:30.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.011+0000 7f9b40400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b38158120 con 0x7f9b380a8b10 2024-01-22T05:14:30.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.011+0000 7f9b40400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b380c12f0 con 0x7f9b380a8f90 2024-01-22T05:14:30.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.011+0000 7f9b3da00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9b38066fb0 0x7f9b380c2370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33820/0 (socket says 172.21.15.49:33820) 2024-01-22T05:14:30.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.011+0000 7f9b3da00700 1 -- 172.21.15.49:0/547306007 learned_addr learned my addr 172.21.15.49:0/547306007 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:30.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.011+0000 7f9b3d000700 1 --2- 172.21.15.49:0/547306007 >> v2:172.21.15.49:3300/0 conn(0x7f9b380a8b10 0x7f9b38157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:30.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.011+0000 7f9b3e400700 1 --2- 172.21.15.49:0/547306007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b380a8f90 0x7f9b38157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:30.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.011+0000 7f9b37e00700 1 -- 172.21.15.49:0/547306007 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437610162 0 0) 0x7f9b380c1ee0 con 0x7f9b38066fb0 2024-01-22T05:14:30.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.011+0000 7f9b37e00700 1 -- 172.21.15.49:0/547306007 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b180033f0 con 0x7f9b38066fb0 2024-01-22T05:14:30.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.011+0000 7f9b3d000700 1 -- 172.21.15.49:0/547306007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b380a8f90 msgr2=0x7f9b38157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:30.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.011+0000 7f9b3d000700 1 --2- 172.21.15.49:0/547306007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b380a8f90 0x7f9b38157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:30.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.011+0000 7f9b3d000700 1 -- 172.21.15.49:0/547306007 >> v1:172.21.15.49:6789/0 conn(0x7f9b38066fb0 legacy=0x7f9b380c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:30.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.011+0000 7f9b3d000700 1 -- 172.21.15.49:0/547306007 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b380c15b0 con 0x7f9b380a8b10 2024-01-22T05:14:30.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.015+0000 7f9b3d000700 1 --2- 172.21.15.49:0/547306007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b380a8b10 0x7f9b38157740 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f9b20009760 tx=0x7f9b20009060).ready entity=mon.0 client_cookie=a46e382bee9d76a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:30.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.015+0000 7f9b37e00700 1 -- 172.21.15.49:0/547306007 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2000d4a0 con 0x7f9b380a8b10 2024-01-22T05:14:30.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.015+0000 7f9b37e00700 1 -- 172.21.15.49:0/547306007 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2000d600 con 0x7f9b380a8b10 2024-01-22T05:14:30.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.015+0000 7f9b37e00700 1 -- 172.21.15.49:0/547306007 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2000d980 con 0x7f9b380a8b10 2024-01-22T05:14:30.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.015+0000 7f9b40400700 1 -- 172.21.15.49:0/547306007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b380a8b10 msgr2=0x7f9b38157740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:30.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.015+0000 7f9b40400700 1 --2- 172.21.15.49:0/547306007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b380a8b10 0x7f9b38157740 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f9b20009760 tx=0x7f9b20009060).stop 2024-01-22T05:14:30.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.015+0000 7f9b40400700 1 -- 172.21.15.49:0/547306007 shutdown_connections 2024-01-22T05:14:30.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.015+0000 7f9b40400700 1 --2- 172.21.15.49:0/547306007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b380a8f90 0x7f9b38157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:30.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.015+0000 7f9b40400700 1 --2- 172.21.15.49:0/547306007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b380a8b10 0x7f9b38157740 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:30.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.015+0000 7f9b40400700 1 -- 172.21.15.49:0/547306007 >> 172.21.15.49:0/547306007 conn(0x7f9b380c6540 msgr2=0x7f9b380c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:30.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.015+0000 7f9b40400700 1 -- 172.21.15.49:0/547306007 shutdown_connections 2024-01-22T05:14:30.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.015+0000 7f9b40400700 1 -- 172.21.15.49:0/547306007 wait complete. 2024-01-22T05:14:30.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.019+0000 7f9b40400700 1 Processor -- start 2024-01-22T05:14:30.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.019+0000 7f9b40400700 1 -- start start 2024-01-22T05:14:30.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.019+0000 7f9b40400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b38066fb0 0x7f9b380ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:30.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.019+0000 7f9b40400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b380a8b10 0x7f9b380bdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:30.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.019+0000 7f9b40400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b380a8f90 0x7f9b3814b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:30.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.019+0000 7f9b40400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38143900 con 0x7f9b380a8f90 2024-01-22T05:14:30.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.019+0000 7f9b40400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38168af0 con 0x7f9b38066fb0 2024-01-22T05:14:30.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.019+0000 7f9b40400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b381681c0 con 0x7f9b380a8b10 2024-01-22T05:14:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.019+0000 7f9b3e400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b380a8f90 0x7f9b3814b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.019+0000 7f9b3e400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b380a8f90 0x7f9b3814b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55006/0 (socket says 172.21.15.49:55006) 2024-01-22T05:14:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.019+0000 7f9b3e400700 1 -- 172.21.15.49:0/2057427241 learned_addr learned my addr 172.21.15.49:0/2057427241 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.019+0000 7f9b3d000700 1 --2- 172.21.15.49:0/2057427241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b380a8b10 0x7f9b380bdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.023+0000 7f9b3da00700 1 --2- 172.21.15.49:0/2057427241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b38066fb0 0x7f9b380ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.023+0000 7f9b3e400700 1 -- 172.21.15.49:0/2057427241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b380a8b10 msgr2=0x7f9b380bdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.023+0000 7f9b3e400700 1 --2- 172.21.15.49:0/2057427241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b380a8b10 0x7f9b380bdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.023+0000 7f9b3e400700 1 -- 172.21.15.49:0/2057427241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b38066fb0 msgr2=0x7f9b380ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.023+0000 7f9b3e400700 1 --2- 172.21.15.49:0/2057427241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b38066fb0 0x7f9b380ac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.023+0000 7f9b3e400700 1 -- 172.21.15.49:0/2057427241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b200092a0 con 0x7f9b380a8f90 2024-01-22T05:14:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.023+0000 7f9b3e400700 1 --2- 172.21.15.49:0/2057427241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b380a8f90 0x7f9b3814b680 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f9b30009ef0 tx=0x7f9b3000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.023+0000 7f9b34c00700 1 -- 172.21.15.49:0/2057427241 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3000cb70 con 0x7f9b380a8f90 2024-01-22T05:14:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.023+0000 7f9b34c00700 1 -- 172.21.15.49:0/2057427241 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3000f040 con 0x7f9b380a8f90 2024-01-22T05:14:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.023+0000 7f9b40400700 1 -- 172.21.15.49:0/2057427241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b381684a0 con 0x7f9b380a8f90 2024-01-22T05:14:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.023+0000 7f9b34c00700 1 -- 172.21.15.49:0/2057427241 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30013400 con 0x7f9b380a8f90 2024-01-22T05:14:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.023+0000 7f9b40400700 1 -- 172.21.15.49:0/2057427241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b380bd820 con 0x7f9b380a8f90 2024-01-22T05:14:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.023+0000 7f9b40400700 1 -- 172.21.15.49:0/2057427241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b38168c80 con 0x7f9b380a8f90 2024-01-22T05:14:30.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.027+0000 7f9b34c00700 1 -- 172.21.15.49:0/2057427241 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9b300137b0 con 0x7f9b380a8f90 2024-01-22T05:14:30.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.027+0000 7f9b34c00700 1 --2- 172.21.15.49:0/2057427241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9b1005a4e0 0x7f9b1005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:30.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.027+0000 7f9b34c00700 1 -- 172.21.15.49:0/2057427241 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f9b30075270 con 0x7f9b380a8f90 2024-01-22T05:14:30.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.027+0000 7f9b3da00700 1 --2- 172.21.15.49:0/2057427241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9b1005a4e0 0x7f9b1005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:30.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.027+0000 7f9b3da00700 1 --2- 172.21.15.49:0/2057427241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9b1005a4e0 0x7f9b1005c9a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f9b28007fd0 tx=0x7f9b28009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:30.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.035+0000 7f9b34c00700 1 -- 172.21.15.49:0/2057427241 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9b300487c0 con 0x7f9b380a8f90 2024-01-22T05:14:30.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.251+0000 7f9b40400700 1 -- 172.21.15.49:0/2057427241 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9b38047060 con 0x7f9b380a8f90 2024-01-22T05:14:30.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.251+0000 7f9b34c00700 1 -- 172.21.15.49:0/2057427241 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1192 (secure 0 0 0) 0x7f9b3004bde0 con 0x7f9b380a8f90 2024-01-22T05:14:30.254 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:30.254 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":613,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1042,"data_bytes":1071322281,"bytes_used":4643016704,"bytes_avail":768451096576,"bytes_total":773094113280,"write_bytes_sec":22316880,"read_op_per_sec":0,"write_op_per_sec":22},"fsmap":{"epoch":98,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7743}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-01-22T05:13:21.420936+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:14:30.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.255+0000 7f9b40400700 1 -- 172.21.15.49:0/2057427241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9b1005a4e0 msgr2=0x7f9b1005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:30.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.255+0000 7f9b40400700 1 --2- 172.21.15.49:0/2057427241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9b1005a4e0 0x7f9b1005c9a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f9b28007fd0 tx=0x7f9b28009040).stop 2024-01-22T05:14:30.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.255+0000 7f9b40400700 1 -- 172.21.15.49:0/2057427241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b380a8f90 msgr2=0x7f9b3814b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:30.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.255+0000 7f9b40400700 1 --2- 172.21.15.49:0/2057427241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b380a8f90 0x7f9b3814b680 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f9b30009ef0 tx=0x7f9b3000b040).stop 2024-01-22T05:14:30.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.255+0000 7f9b40400700 1 -- 172.21.15.49:0/2057427241 shutdown_connections 2024-01-22T05:14:30.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.255+0000 7f9b40400700 1 --2- 172.21.15.49:0/2057427241 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9b1005a4e0 0x7f9b1005c9a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:30.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.255+0000 7f9b40400700 1 --2- 172.21.15.49:0/2057427241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b380a8f90 0x7f9b3814b680 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:30.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.255+0000 7f9b40400700 1 --2- 172.21.15.49:0/2057427241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b380a8b10 0x7f9b380bdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:30.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.255+0000 7f9b40400700 1 --2- 172.21.15.49:0/2057427241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b38066fb0 0x7f9b380ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:30.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.255+0000 7f9b40400700 1 -- 172.21.15.49:0/2057427241 >> 172.21.15.49:0/2057427241 conn(0x7f9b380c6540 msgr2=0x7f9b38068a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:30.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.255+0000 7f9b40400700 1 -- 172.21.15.49:0/2057427241 shutdown_connections 2024-01-22T05:14:30.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:30.255+0000 7f9b40400700 1 -- 172.21.15.49:0/2057427241 wait complete. 2024-01-22T05:14:30.281 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-01-22T05:14:31.282 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:14:31.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.443+0000 7fee03800700 1 Processor -- start 2024-01-22T05:14:31.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.447+0000 7fee03800700 1 -- start start 2024-01-22T05:14:31.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.447+0000 7fee03800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fedfc064c00 0x7fedfc0bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:31.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.447+0000 7fee03800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc0c2700 con 0x7fedfc065240 2024-01-22T05:14:31.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.447+0000 7fee03800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc0c29a0 con 0x7fedfc065620 2024-01-22T05:14:31.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.447+0000 7fee03800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedfc0c2c80 con 0x7fedfc064c00 2024-01-22T05:14:31.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.447+0000 7fedfbe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fedfc064c00 0x7fedfc0bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:31.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fedfbe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fedfc064c00 0x7fedfc0bcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55016/0 (socket says 172.21.15.49:55016) 2024-01-22T05:14:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fedfbe00700 1 -- 172.21.15.49:0/553898686 learned_addr learned my addr 172.21.15.49:0/553898686 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.447+0000 7fee00e00700 1 --1- 172.21.15.49:0/553898686 >> v1:172.21.15.49:6789/0 conn(0x7fedfc065240 0x7fedfc0644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33828/0 (socket says 172.21.15.49:33828) 2024-01-22T05:14:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fedfbe00700 1 -- 172.21.15.49:0/553898686 >> v1:172.21.15.110:6789/0 conn(0x7fedfc065620 legacy=0x7fedfc0bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fedfbe00700 1 -- 172.21.15.49:0/553898686 >> v1:172.21.15.49:6789/0 conn(0x7fedfc065240 legacy=0x7fedfc0644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fedfbe00700 1 -- 172.21.15.49:0/553898686 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc0c2f60 con 0x7fedfc064c00 2024-01-22T05:14:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fedfbe00700 1 --2- 172.21.15.49:0/553898686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedfc064c00 0x7fedfc0bcc80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fede4006fd0 tx=0x7fede40090f0).ready entity=mon.0 client_cookie=342aa91ee8e078c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fedfb400700 1 -- 172.21.15.49:0/553898686 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede400b600 con 0x7fedfc064c00 2024-01-22T05:14:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fedfb400700 1 -- 172.21.15.49:0/553898686 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede400b760 con 0x7fedfc064c00 2024-01-22T05:14:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fedfb400700 1 -- 172.21.15.49:0/553898686 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede400bae0 con 0x7fedfc064c00 2024-01-22T05:14:31.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fee03800700 1 -- 172.21.15.49:0/553898686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedfc064c00 msgr2=0x7fedfc0bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:31.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fee03800700 1 --2- 172.21.15.49:0/553898686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedfc064c00 0x7fedfc0bcc80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fede4006fd0 tx=0x7fede40090f0).stop 2024-01-22T05:14:31.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fee03800700 1 -- 172.21.15.49:0/553898686 shutdown_connections 2024-01-22T05:14:31.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fee03800700 1 --2- 172.21.15.49:0/553898686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedfc064c00 0x7fedfc0bcc80 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:31.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fee03800700 1 -- 172.21.15.49:0/553898686 >> 172.21.15.49:0/553898686 conn(0x7fedfc0c87f0 msgr2=0x7fedfc0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:31.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fee03800700 1 -- 172.21.15.49:0/553898686 shutdown_connections 2024-01-22T05:14:31.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.451+0000 7fee03800700 1 -- 172.21.15.49:0/553898686 wait complete. 2024-01-22T05:14:31.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.455+0000 7fee03800700 1 Processor -- start 2024-01-22T05:14:31.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.455+0000 7fee03800700 1 -- start start 2024-01-22T05:14:31.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.455+0000 7fee03800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedfc064c00 0x7fedfc158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:31.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.455+0000 7fee03800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedfc065240 0x7fedfc0acc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:31.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.455+0000 7fee03800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedfc065620 0x7fedfc0ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:31.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fee03800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc0a7f70 con 0x7fedfc065620 2024-01-22T05:14:31.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fee03800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc0ad7d0 con 0x7fedfc065240 2024-01-22T05:14:31.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fee03800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc0adab0 con 0x7fedfc064c00 2024-01-22T05:14:31.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fee02200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedfc065620 0x7fedfc0ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fee02200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedfc065620 0x7fedfc0ad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55022/0 (socket says 172.21.15.49:55022) 2024-01-22T05:14:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fee02200700 1 -- 172.21.15.49:0/2883705948 learned_addr learned my addr 172.21.15.49:0/2883705948 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fedfbe00700 1 --2- 172.21.15.49:0/2883705948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedfc065240 0x7fedfc0acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fee00e00700 1 --2- 172.21.15.49:0/2883705948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedfc064c00 0x7fedfc158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fee02200700 1 -- 172.21.15.49:0/2883705948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedfc064c00 msgr2=0x7fedfc158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fee02200700 1 --2- 172.21.15.49:0/2883705948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedfc064c00 0x7fedfc158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fee02200700 1 -- 172.21.15.49:0/2883705948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedfc065240 msgr2=0x7fedfc0acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fee02200700 1 --2- 172.21.15.49:0/2883705948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedfc065240 0x7fedfc0acc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:31.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fee02200700 1 -- 172.21.15.49:0/2883705948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede4009370 con 0x7fedfc065620 2024-01-22T05:14:31.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fee02200700 1 --2- 172.21.15.49:0/2883705948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedfc065620 0x7fedfc0ad150 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7fedf400c7c0 tx=0x7fedf4001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:31.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fedf3e00700 1 -- 172.21.15.49:0/2883705948 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400e4a0 con 0x7fedfc065620 2024-01-22T05:14:31.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fedf3e00700 1 -- 172.21.15.49:0/2883705948 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf400e600 con 0x7fedfc065620 2024-01-22T05:14:31.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fee03800700 1 -- 172.21.15.49:0/2883705948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedfc0a8390 con 0x7fedfc065620 2024-01-22T05:14:31.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fedf3e00700 1 -- 172.21.15.49:0/2883705948 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400e980 con 0x7fedfc065620 2024-01-22T05:14:31.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.459+0000 7fee03800700 1 -- 172.21.15.49:0/2883705948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedfc0a8950 con 0x7fedfc065620 2024-01-22T05:14:31.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.463+0000 7fee03800700 1 -- 172.21.15.49:0/2883705948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedfc047060 con 0x7fedfc065620 2024-01-22T05:14:31.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.463+0000 7fedf3e00700 1 -- 172.21.15.49:0/2883705948 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fedf40123f0 con 0x7fedfc065620 2024-01-22T05:14:31.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.463+0000 7fedf3e00700 1 --2- 172.21.15.49:0/2883705948 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fedd405a510 0x7fedd405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:31.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.463+0000 7fedf3e00700 1 -- 172.21.15.49:0/2883705948 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fedf4074190 con 0x7fedfc065620 2024-01-22T05:14:31.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.463+0000 7fee00e00700 1 --2- 172.21.15.49:0/2883705948 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fedd405a510 0x7fedd405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:31.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.467+0000 7fee00e00700 1 --2- 172.21.15.49:0/2883705948 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fedd405a510 0x7fedd405c9d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fedec007fd0 tx=0x7fedec007d30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:31.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.471+0000 7fedf3e00700 1 -- 172.21.15.49:0/2883705948 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fedf4047680 con 0x7fedfc065620 2024-01-22T05:14:31.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.671+0000 7fee03800700 1 -- 172.21.15.49:0/2883705948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedfc0c3240 con 0x7fedfc065620 2024-01-22T05:14:31.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.671+0000 7fedf3e00700 1 -- 172.21.15.49:0/2883705948 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fedf404aca0 con 0x7fedfc065620 2024-01-22T05:14:31.674 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:31.674 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:14:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.675+0000 7fee03800700 1 -- 172.21.15.49:0/2883705948 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fedd405a510 msgr2=0x7fedd405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.675+0000 7fee03800700 1 --2- 172.21.15.49:0/2883705948 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fedd405a510 0x7fedd405c9d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fedec007fd0 tx=0x7fedec007d30).stop 2024-01-22T05:14:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.675+0000 7fee03800700 1 -- 172.21.15.49:0/2883705948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedfc065620 msgr2=0x7fedfc0ad150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.675+0000 7fee03800700 1 --2- 172.21.15.49:0/2883705948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedfc065620 0x7fedfc0ad150 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7fedf400c7c0 tx=0x7fedf4001510).stop 2024-01-22T05:14:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.675+0000 7fee03800700 1 -- 172.21.15.49:0/2883705948 shutdown_connections 2024-01-22T05:14:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.675+0000 7fee03800700 1 --2- 172.21.15.49:0/2883705948 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fedd405a510 0x7fedd405c9d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.675+0000 7fee03800700 1 --2- 172.21.15.49:0/2883705948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fedfc065620 0x7fedfc0ad150 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.675+0000 7fee03800700 1 --2- 172.21.15.49:0/2883705948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedfc065240 0x7fedfc0acc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.675+0000 7fee03800700 1 --2- 172.21.15.49:0/2883705948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedfc064c00 0x7fedfc158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.675+0000 7fee03800700 1 -- 172.21.15.49:0/2883705948 >> 172.21.15.49:0/2883705948 conn(0x7fedfc0c87f0 msgr2=0x7fedfc0644f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:31.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.675+0000 7fee03800700 1 -- 172.21.15.49:0/2883705948 shutdown_connections 2024-01-22T05:14:31.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.675+0000 7fee03800700 1 -- 172.21.15.49:0/2883705948 wait complete. 2024-01-22T05:14:31.681 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:14:31.700 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-01-22T05:14:31.700 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:14:31.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.859+0000 7fe559000700 1 Processor -- start 2024-01-22T05:14:31.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.859+0000 7fe559000700 1 -- start start 2024-01-22T05:14:31.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe559000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe554155d20 0x7fe554065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:31.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe559000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5540c1a40 con 0x7fe5540a8e50 2024-01-22T05:14:31.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe559000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe554159310 con 0x7fe554066070 2024-01-22T05:14:31.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe559000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540c13f0 con 0x7fe554155d20 2024-01-22T05:14:31.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe552800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe5540a8e50 0x7fe5540c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33840/0 (socket says 172.21.15.49:33840) 2024-01-22T05:14:31.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe552800700 1 -- 172.21.15.49:0/1401847290 learned_addr learned my addr 172.21.15.49:0/1401847290 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:31.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe551e00700 1 --2- 172.21.15.49:0/1401847290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe554155d20 0x7fe554065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:31.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe550a00700 1 -- 172.21.15.49:0/1401847290 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827662149 0 0) 0x7fe554159310 con 0x7fe554066070 2024-01-22T05:14:31.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe550a00700 1 -- 172.21.15.49:0/1401847290 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5340033f0 con 0x7fe554066070 2024-01-22T05:14:31.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe550a00700 1 -- 172.21.15.49:0/1401847290 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952868440 0 0) 0x7fe5540c1a40 con 0x7fe5540a8e50 2024-01-22T05:14:31.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe550a00700 1 -- 172.21.15.49:0/1401847290 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe554159310 con 0x7fe5540a8e50 2024-01-22T05:14:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe551e00700 1 -- 172.21.15.49:0/1401847290 >> v1:172.21.15.110:6789/0 conn(0x7fe554066070 legacy=0x7fe5540a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe551e00700 1 -- 172.21.15.49:0/1401847290 >> v1:172.21.15.49:6789/0 conn(0x7fe5540a8e50 legacy=0x7fe5540c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe551e00700 1 -- 172.21.15.49:0/1401847290 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5540c16d0 con 0x7fe554155d20 2024-01-22T05:14:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe551e00700 1 --2- 172.21.15.49:0/1401847290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe554155d20 0x7fe554065b80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fe544009790 tx=0x7fe544009060).ready entity=mon.2 client_cookie=374ce3dcd4d4b0e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe550a00700 1 -- 172.21.15.49:0/1401847290 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54400f510 con 0x7fe554155d20 2024-01-22T05:14:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe550a00700 1 -- 172.21.15.49:0/1401847290 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54400f670 con 0x7fe554155d20 2024-01-22T05:14:31.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.863+0000 7fe550a00700 1 -- 172.21.15.49:0/1401847290 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54400f9f0 con 0x7fe554155d20 2024-01-22T05:14:31.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.867+0000 7fe559000700 1 -- 172.21.15.49:0/1401847290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe554155d20 msgr2=0x7fe554065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:31.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.867+0000 7fe559000700 1 --2- 172.21.15.49:0/1401847290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe554155d20 0x7fe554065b80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fe544009790 tx=0x7fe544009060).stop 2024-01-22T05:14:31.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.867+0000 7fe559000700 1 -- 172.21.15.49:0/1401847290 shutdown_connections 2024-01-22T05:14:31.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.867+0000 7fe559000700 1 --2- 172.21.15.49:0/1401847290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe554155d20 0x7fe554065b80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:31.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.867+0000 7fe559000700 1 -- 172.21.15.49:0/1401847290 >> 172.21.15.49:0/1401847290 conn(0x7fe5540c6540 msgr2=0x7fe5540c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:31.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.867+0000 7fe559000700 1 -- 172.21.15.49:0/1401847290 shutdown_connections 2024-01-22T05:14:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.867+0000 7fe559000700 1 -- 172.21.15.49:0/1401847290 wait complete. 2024-01-22T05:14:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.867+0000 7fe559000700 1 Processor -- start 2024-01-22T05:14:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe559000700 1 -- start start 2024-01-22T05:14:31.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe559000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe554066070 0x7fe5540a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:31.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe559000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5540a8e50 0x7fe5541577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:31.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe559000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe554155d20 0x7fe5541533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:31.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe559000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe554157340 con 0x7fe554155d20 2024-01-22T05:14:31.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe559000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe554156730 con 0x7fe5540a8e50 2024-01-22T05:14:31.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe559000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe554156a10 con 0x7fe554066070 2024-01-22T05:14:31.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe552800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe554155d20 0x7fe5541533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:31.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe552800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe554155d20 0x7fe5541533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55034/0 (socket says 172.21.15.49:55034) 2024-01-22T05:14:31.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe552800700 1 -- 172.21.15.49:0/2065596263 learned_addr learned my addr 172.21.15.49:0/2065596263 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:31.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe551e00700 1 --2- 172.21.15.49:0/2065596263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe554066070 0x7fe5540a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe551400700 1 --2- 172.21.15.49:0/2065596263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5540a8e50 0x7fe5541577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe552800700 1 -- 172.21.15.49:0/2065596263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe554066070 msgr2=0x7fe5540a9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe552800700 1 --2- 172.21.15.49:0/2065596263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe554066070 0x7fe5540a9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe552800700 1 -- 172.21.15.49:0/2065596263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5540a8e50 msgr2=0x7fe5541577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe552800700 1 --2- 172.21.15.49:0/2065596263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5540a8e50 0x7fe5541577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe552800700 1 -- 172.21.15.49:0/2065596263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5440092a0 con 0x7fe554155d20 2024-01-22T05:14:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.871+0000 7fe552800700 1 --2- 172.21.15.49:0/2065596263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe554155d20 0x7fe5541533b0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7fe54c005ad0 tx=0x7fe54c001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.875+0000 7fe549600700 1 -- 172.21.15.49:0/2065596263 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c005d30 con 0x7fe554155d20 2024-01-22T05:14:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.875+0000 7fe549600700 1 -- 172.21.15.49:0/2065596263 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c005e90 con 0x7fe554155d20 2024-01-22T05:14:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.875+0000 7fe549600700 1 -- 172.21.15.49:0/2065596263 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c007320 con 0x7fe554155d20 2024-01-22T05:14:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.875+0000 7fe559000700 1 -- 172.21.15.49:0/2065596263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe554156cf0 con 0x7fe554155d20 2024-01-22T05:14:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.875+0000 7fe559000700 1 -- 172.21.15.49:0/2065596263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe554153be0 con 0x7fe554155d20 2024-01-22T05:14:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.875+0000 7fe559000700 1 -- 172.21.15.49:0/2065596263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5541574f0 con 0x7fe554155d20 2024-01-22T05:14:31.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.875+0000 7fe549600700 1 -- 172.21.15.49:0/2065596263 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe54c007710 con 0x7fe554155d20 2024-01-22T05:14:31.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.879+0000 7fe549600700 1 --2- 172.21.15.49:0/2065596263 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe52c05a510 0x7fe52c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:31.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.879+0000 7fe549600700 1 -- 172.21.15.49:0/2065596263 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fe54c074a50 con 0x7fe554155d20 2024-01-22T05:14:31.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.879+0000 7fe551e00700 1 --2- 172.21.15.49:0/2065596263 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe52c05a510 0x7fe52c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:31.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.879+0000 7fe551e00700 1 --2- 172.21.15.49:0/2065596263 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe52c05a510 0x7fe52c05c9d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fe544009fd0 tx=0x7fe544017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:31.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:31.883+0000 7fe549600700 1 -- 172.21.15.49:0/2065596263 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe5541574f0 con 0x7fe554155d20 2024-01-22T05:14:32.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.099+0000 7fe559000700 1 -- 172.21.15.49:0/2065596263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe554157170 con 0x7fe554155d20 2024-01-22T05:14:32.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.099+0000 7fe549600700 1 -- 172.21.15.49:0/2065596263 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2291 (secure 0 0 0) 0x7fe54c048020 con 0x7fe554155d20 2024-01-22T05:14:32.103 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:32.103 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 18/2092 objects degraded (0.860%), 1 pg degraded","count":1},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":615,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":134},{"state_name":"active+recovering","count":1},{"state_name":"activating","count":1},{"state_name":"active+recovery_wait+degraded","count":1}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075835141,"bytes_used":4661198848,"bytes_avail":768432914432,"bytes_total":773094113280,"inactive_pgs_ratio":0.0072992700152099133,"degraded_objects":18,"degraded_total":2092,"degraded_ratio":0.0086042065009560229,"misplaced_objects":4,"misplaced_total":2092,"misplaced_ratio":0.0019120458891013384,"recovering_objects_per_sec":1,"recovering_bytes_per_sec":1179201,"recovering_keys_per_sec":0,"num_objects_recovered":9,"num_bytes_recovered":9437184,"num_keys_recovered":0,"write_bytes_sec":22883358,"read_op_per_sec":0,"write_op_per_sec":22},"fsmap":{"epoch":98,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7743}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-01-22T05:14:29.453337+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:14:32.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.103+0000 7fe559000700 1 -- 172.21.15.49:0/2065596263 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe52c05a510 msgr2=0x7fe52c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.103+0000 7fe559000700 1 --2- 172.21.15.49:0/2065596263 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe52c05a510 0x7fe52c05c9d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fe544009fd0 tx=0x7fe544017000).stop 2024-01-22T05:14:32.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.103+0000 7fe559000700 1 -- 172.21.15.49:0/2065596263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe554155d20 msgr2=0x7fe5541533b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.103+0000 7fe559000700 1 --2- 172.21.15.49:0/2065596263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe554155d20 0x7fe5541533b0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7fe54c005ad0 tx=0x7fe54c001650).stop 2024-01-22T05:14:32.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.103+0000 7fe559000700 1 -- 172.21.15.49:0/2065596263 shutdown_connections 2024-01-22T05:14:32.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.103+0000 7fe559000700 1 --2- 172.21.15.49:0/2065596263 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe52c05a510 0x7fe52c05c9d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.103+0000 7fe559000700 1 --2- 172.21.15.49:0/2065596263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe554155d20 0x7fe5541533b0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.103+0000 7fe559000700 1 --2- 172.21.15.49:0/2065596263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5540a8e50 0x7fe5541577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.103+0000 7fe559000700 1 --2- 172.21.15.49:0/2065596263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe554066070 0x7fe5540a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.103+0000 7fe559000700 1 -- 172.21.15.49:0/2065596263 >> 172.21.15.49:0/2065596263 conn(0x7fe5540c6540 msgr2=0x7fe5540c4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:32.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.103+0000 7fe559000700 1 -- 172.21.15.49:0/2065596263 shutdown_connections 2024-01-22T05:14:32.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.103+0000 7fe559000700 1 -- 172.21.15.49:0/2065596263 wait complete. 2024-01-22T05:14:32.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'b': 'paused'} 2024-01-22T05:14:32.132 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub resume 2024-01-22T05:14:32.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.291+0000 7f5d4e000700 1 Processor -- start 2024-01-22T05:14:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.291+0000 7f5d4e000700 1 -- start start 2024-01-22T05:14:32.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d4e000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d481524f0 0x7f5d48066400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d4e000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d480a8e70 0x7f5d4815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d4e000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d480bd3e0 con 0x7f5d4815bad0 2024-01-22T05:14:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d4e000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d48067c50 con 0x7f5d480a8e70 2024-01-22T05:14:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d4e000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4815c440 con 0x7f5d481524f0 2024-01-22T05:14:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d46a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5d4815bad0 0x7f5d480a8760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33856/0 (socket says 172.21.15.49:33856) 2024-01-22T05:14:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d46a00700 1 -- 172.21.15.49:0/47315325 learned_addr learned my addr 172.21.15.49:0/47315325 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d47e00700 1 --2- 172.21.15.49:0/47315325 >> v2:172.21.15.110:3300/0 conn(0x7f5d480a8e70 0x7f5d4815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d47400700 1 --2- 172.21.15.49:0/47315325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d481524f0 0x7f5d48066400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d46000700 1 -- 172.21.15.49:0/47315325 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815765927 0 0) 0x7f5d480bd3e0 con 0x7f5d4815bad0 2024-01-22T05:14:32.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d46000700 1 -- 172.21.15.49:0/47315325 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d280033f0 con 0x7f5d4815bad0 2024-01-22T05:14:32.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d47e00700 1 -- 172.21.15.49:0/47315325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d481524f0 msgr2=0x7f5d48066400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d47e00700 1 --2- 172.21.15.49:0/47315325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d481524f0 0x7f5d48066400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d47e00700 1 -- 172.21.15.49:0/47315325 >> v1:172.21.15.49:6789/0 conn(0x7f5d4815bad0 legacy=0x7f5d480a8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d47e00700 1 -- 172.21.15.49:0/47315325 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d480bcb40 con 0x7f5d480a8e70 2024-01-22T05:14:32.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.295+0000 7f5d47e00700 1 --2- 172.21.15.49:0/47315325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d480a8e70 0x7f5d4815bf50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f5d40009e60 tx=0x7f5d40009780).ready entity=mon.1 client_cookie=7425009b02033d2f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.299+0000 7f5d46000700 1 -- 172.21.15.49:0/47315325 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000e070 con 0x7f5d480a8e70 2024-01-22T05:14:32.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.299+0000 7f5d46000700 1 -- 172.21.15.49:0/47315325 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4000bab0 con 0x7f5d480a8e70 2024-01-22T05:14:32.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.299+0000 7f5d46000700 1 -- 172.21.15.49:0/47315325 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000be30 con 0x7f5d480a8e70 2024-01-22T05:14:32.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.299+0000 7f5d4e000700 1 -- 172.21.15.49:0/47315325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d480a8e70 msgr2=0x7f5d4815bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.299+0000 7f5d4e000700 1 --2- 172.21.15.49:0/47315325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d480a8e70 0x7f5d4815bf50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f5d40009e60 tx=0x7f5d40009780).stop 2024-01-22T05:14:32.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.299+0000 7f5d4e000700 1 -- 172.21.15.49:0/47315325 shutdown_connections 2024-01-22T05:14:32.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.299+0000 7f5d4e000700 1 --2- 172.21.15.49:0/47315325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d480a8e70 0x7f5d4815bf50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.299+0000 7f5d4e000700 1 --2- 172.21.15.49:0/47315325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d481524f0 0x7f5d48066400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.299+0000 7f5d4e000700 1 -- 172.21.15.49:0/47315325 >> 172.21.15.49:0/47315325 conn(0x7f5d480c6560 msgr2=0x7f5d480c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:32.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.299+0000 7f5d4e000700 1 -- 172.21.15.49:0/47315325 shutdown_connections 2024-01-22T05:14:32.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.299+0000 7f5d4e000700 1 -- 172.21.15.49:0/47315325 wait complete. 2024-01-22T05:14:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.303+0000 7f5d4e000700 1 Processor -- start 2024-01-22T05:14:32.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.303+0000 7f5d4e000700 1 -- start start 2024-01-22T05:14:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d4e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d480a8e70 0x7f5d4814da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d4e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d481524f0 0x7f5d480becb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d4e000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d4815bad0 0x7f5d480bf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d4e000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d480a97e0 con 0x7f5d480a8e70 2024-01-22T05:14:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d4e000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d480bfff0 con 0x7f5d481524f0 2024-01-22T05:14:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d4e000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4814df30 con 0x7f5d4815bad0 2024-01-22T05:14:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d480a8e70 0x7f5d4814da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d480a8e70 0x7f5d4814da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55036/0 (socket says 172.21.15.49:55036) 2024-01-22T05:14:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d47400700 1 -- 172.21.15.49:0/3464666592 learned_addr learned my addr 172.21.15.49:0/3464666592 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:32.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d46a00700 1 --2- 172.21.15.49:0/3464666592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d481524f0 0x7f5d480becb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d47e00700 1 --2- 172.21.15.49:0/3464666592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d4815bad0 0x7f5d480bf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d46a00700 1 -- 172.21.15.49:0/3464666592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d4815bad0 msgr2=0x7f5d480bf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d46a00700 1 --2- 172.21.15.49:0/3464666592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d4815bad0 0x7f5d480bf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d46a00700 1 -- 172.21.15.49:0/3464666592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d480a8e70 msgr2=0x7f5d4814da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d46a00700 1 --2- 172.21.15.49:0/3464666592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d480a8e70 0x7f5d4814da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d46a00700 1 -- 172.21.15.49:0/3464666592 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d40009a20 con 0x7f5d481524f0 2024-01-22T05:14:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d47400700 1 --2- 172.21.15.49:0/3464666592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d480a8e70 0x7f5d4814da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d46a00700 1 --2- 172.21.15.49:0/3464666592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d481524f0 0x7f5d480becb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f5d3000c410 tx=0x7f5d30007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d3ea00700 1 -- 172.21.15.49:0/3464666592 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d300070d0 con 0x7f5d481524f0 2024-01-22T05:14:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d3ea00700 1 -- 172.21.15.49:0/3464666592 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d30007230 con 0x7f5d481524f0 2024-01-22T05:14:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d4e000700 1 -- 172.21.15.49:0/3464666592 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d480bf750 con 0x7f5d481524f0 2024-01-22T05:14:32.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.307+0000 7f5d3ea00700 1 -- 172.21.15.49:0/3464666592 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d300075f0 con 0x7f5d481524f0 2024-01-22T05:14:32.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.311+0000 7f5d4e000700 1 -- 172.21.15.49:0/3464666592 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d480bfd10 con 0x7f5d481524f0 2024-01-22T05:14:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.311+0000 7f5d3ea00700 1 -- 172.21.15.49:0/3464666592 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5d300059b0 con 0x7f5d481524f0 2024-01-22T05:14:32.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.315+0000 7f5d3ea00700 1 --2- 172.21.15.49:0/3464666592 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d2005a4e0 0x7f5d2005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.315+0000 7f5d3ea00700 1 -- 172.21.15.49:0/3464666592 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f5d300740c0 con 0x7f5d481524f0 2024-01-22T05:14:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.315+0000 7f5d47400700 1 --2- 172.21.15.49:0/3464666592 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d2005a4e0 0x7f5d2005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.315+0000 7f5d47400700 1 --2- 172.21.15.49:0/3464666592 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d2005a4e0 0x7f5d2005c9a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f5d38009fd0 tx=0x7f5d38009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.315+0000 7f5d584aa740 1 Processor -- start 2024-01-22T05:14:32.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d584aa740 1 -- start start 2024-01-22T05:14:32.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d584aa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15334d0 0x15338b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d584aa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 0x153a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d584aa740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x153aee0 0x15194f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d584aa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x144b540 con 0x15334d0 2024-01-22T05:14:32.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d584aa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x140ee90 con 0x153a570 2024-01-22T05:14:32.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d584aa740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1414d90 con 0x153aee0 2024-01-22T05:14:32.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15334d0 0x15338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d46a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 0x153a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d46a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 0x153a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:57842/0 (socket says 172.21.15.49:57842) 2024-01-22T05:14:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d46a00700 1 -- 172.21.15.49:0/1548749498 learned_addr learned my addr 172.21.15.49:0/1548749498 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d47e00700 1 --2- 172.21.15.49:0/1548749498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x153aee0 0x15194f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d47400700 1 -- 172.21.15.49:0/1548749498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x153aee0 msgr2=0x15194f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d47400700 1 --2- 172.21.15.49:0/1548749498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x153aee0 0x15194f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d47400700 1 -- 172.21.15.49:0/1548749498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 msgr2=0x153a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d47400700 1 --2- 172.21.15.49:0/1548749498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 0x153a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d47400700 1 -- 172.21.15.49:0/1548749498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x14794c0 con 0x15334d0 2024-01-22T05:14:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d46a00700 1 --2- 172.21.15.49:0/1548749498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 0x153a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d47400700 1 --2- 172.21.15.49:0/1548749498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15334d0 0x15338b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f5d38014630 tx=0x7f5d38017000).ready entity=mon.0 client_cookie=27e24810d249f27a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d37000700 1 -- 172.21.15.49:0/1548749498 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38014ea0 con 0x15334d0 2024-01-22T05:14:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d37000700 1 -- 172.21.15.49:0/1548749498 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d380135b0 con 0x15334d0 2024-01-22T05:14:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.319+0000 7f5d37000700 1 -- 172.21.15.49:0/1548749498 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38013930 con 0x15334d0 2024-01-22T05:14:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.323+0000 7f5d584aa740 1 -- 172.21.15.49:0/1548749498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15334d0 msgr2=0x15338b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.323+0000 7f5d584aa740 1 --2- 172.21.15.49:0/1548749498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15334d0 0x15338b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f5d38014630 tx=0x7f5d38017000).stop 2024-01-22T05:14:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.323+0000 7f5d584aa740 1 -- 172.21.15.49:0/1548749498 shutdown_connections 2024-01-22T05:14:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.323+0000 7f5d584aa740 1 --2- 172.21.15.49:0/1548749498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x153aee0 0x15194f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.323+0000 7f5d584aa740 1 --2- 172.21.15.49:0/1548749498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 0x153a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.323+0000 7f5d584aa740 1 --2- 172.21.15.49:0/1548749498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15334d0 0x15338b0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.323+0000 7f5d584aa740 1 -- 172.21.15.49:0/1548749498 >> 172.21.15.49:0/1548749498 conn(0x12cd680 msgr2=0x14ecde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.323+0000 7f5d584aa740 1 -- 172.21.15.49:0/1548749498 shutdown_connections 2024-01-22T05:14:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.323+0000 7f5d584aa740 1 -- 172.21.15.49:0/1548749498 wait complete. 2024-01-22T05:14:32.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.323+0000 7f5d584aa740 1 -- start start 2024-01-22T05:14:32.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.323+0000 7f5d584aa740 1 Processor -- start 2024-01-22T05:14:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d584aa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15334d0 0x1510350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d584aa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x153a570 0x1519ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d584aa740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x153aee0 0x1519fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d584aa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x150d7b0 con 0x153a570 2024-01-22T05:14:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d584aa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x151a4a0 con 0x15334d0 2024-01-22T05:14:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d584aa740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1515b30 con 0x153aee0 2024-01-22T05:14:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d584aa740 10 client.0 ll_register_callbacks cb 0x14a55d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:14:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d46a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x153a570 0x1519ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d46a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x153a570 0x1519ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55046/0 (socket says 172.21.15.49:55046) 2024-01-22T05:14:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d47e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x153aee0 0x1519fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d46a00700 1 -- 172.21.15.49:0/4084629944 learned_addr learned my addr 172.21.15.49:0/4084629944 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d47400700 1 --2- 172.21.15.49:0/4084629944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15334d0 0x1510350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d46a00700 1 -- 172.21.15.49:0/4084629944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x153aee0 msgr2=0x1519fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d46a00700 1 --2- 172.21.15.49:0/4084629944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x153aee0 0x1519fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d46a00700 1 -- 172.21.15.49:0/4084629944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15334d0 msgr2=0x1510350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d46a00700 1 --2- 172.21.15.49:0/4084629944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15334d0 0x1510350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d46a00700 1 -- 172.21.15.49:0/4084629944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d480bfd10 con 0x153a570 2024-01-22T05:14:32.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d46a00700 1 --2- 172.21.15.49:0/4084629944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x153a570 0x1519ac0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f5d30047770 tx=0x7f5d30052040).ready entity=mon.0 client_cookie=945b7f73b4ad9741 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d2f400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:14:32.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.327+0000 7f5d2f400700 1 -- 172.21.15.49:0/4084629944 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30055040 con 0x153a570 2024-01-22T05:14:32.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d2f400700 1 -- 172.21.15.49:0/4084629944 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f5d3004b210 con 0x153a570 2024-01-22T05:14:32.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d584aa740 1 -- 172.21.15.49:0/4084629944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1465230 con 0x153a570 2024-01-22T05:14:32.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d2f400700 1 -- 172.21.15.49:0/4084629944 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d30005e70 con 0x153a570 2024-01-22T05:14:32.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d584aa740 10 client.8055 fetch_fsmap learned FSMap version 98 2024-01-22T05:14:32.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d584aa740 1 -- 172.21.15.49:0/4084629944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x7f5d38011e40 con 0x153a570 2024-01-22T05:14:32.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d2f400700 1 -- 172.21.15.49:0/4084629944 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1465230 con 0x153a570 2024-01-22T05:14:32.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d2f400700 1 -- 172.21.15.49:0/4084629944 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 98) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5d30047060 con 0x153a570 2024-01-22T05:14:32.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d584aa740 10 client.8055 fetch_fsmap finished waiting for FSMap version 98 2024-01-22T05:14:32.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d584aa740 10 client.8055 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-01-22T05:14:32.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d584aa740 20 client.8055 populate_metadata read hostname 'smithi049' 2024-01-22T05:14:32.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d584aa740 1 --2- 172.21.15.49:0/4084629944 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1515190 0x15155a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d584aa740 4 client.8055 mds_command: new command op to 7743 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:14:32.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d584aa740 1 -- 172.21.15.49:0/4084629944 --> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x145b780 con 0x1515190 2024-01-22T05:14:32.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d47400700 1 --2- 172.21.15.49:0/4084629944 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1515190 0x15155a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d2f400700 10 client.8055 ms_handle_connect on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:32.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.331+0000 7f5d47400700 1 --2- 172.21.15.49:0/4084629944 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1515190 0x15155a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3d4bd735870d5823 server_cookie=153b5686806e2dcf in_seq=0 out_seq=0 2024-01-22T05:14:32.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.335+0000 7f5d2f400700 1 -- 172.21.15.49:0/4084629944 <== mds.0 v2:172.21.15.110:6832/1348218223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x145b780 con 0x1515190 2024-01-22T05:14:32.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.335+0000 7f5d2f400700 10 client.8055 handle_command_reply: tid=0 2024-01-22T05:14:32.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.335+0000 7f5d584aa740 1 client.8055 shutdown 2024-01-22T05:14:32.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.335+0000 7f5d584aa740 1 -- 172.21.15.49:0/4084629944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x153a570 msgr2=0x1519ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.335+0000 7f5d584aa740 1 --2- 172.21.15.49:0/4084629944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x153a570 0x1519ac0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f5d30047770 tx=0x7f5d30052040).stop 2024-01-22T05:14:32.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.335+0000 7f5d584aa740 1 -- 172.21.15.49:0/4084629944 shutdown_connections 2024-01-22T05:14:32.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.335+0000 7f5d584aa740 1 --2- 172.21.15.49:0/4084629944 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1515190 0x15155a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.335+0000 7f5d584aa740 1 --2- 172.21.15.49:0/4084629944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x153aee0 0x1519fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.335+0000 7f5d2f400700 0 client.8055 ms_handle_reset on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:32.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.335+0000 7f5d584aa740 1 --2- 172.21.15.49:0/4084629944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x153a570 0x1519ac0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.335+0000 7f5d584aa740 1 --2- 172.21.15.49:0/4084629944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x15334d0 0x1510350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.335+0000 7f5d584aa740 1 -- 172.21.15.49:0/4084629944 >> 172.21.15.49:0/4084629944 conn(0x12cd680 msgr2=0x15338b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.335+0000 7f5d584aa740 1 -- 172.21.15.49:0/4084629944 shutdown_connections 2024-01-22T05:14:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.335+0000 7f5d584aa740 1 -- 172.21.15.49:0/4084629944 wait complete. 2024-01-22T05:14:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.335+0000 7f5d584aa740 20 client.8055 trim_cache size 0 max 16384 2024-01-22T05:14:32.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.355+0000 7f5d584aa740 1 Processor -- start 2024-01-22T05:14:32.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.355+0000 7f5d584aa740 1 -- start start 2024-01-22T05:14:32.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d584aa740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15334d0 0x14ee010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d584aa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 0x14ee500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d584aa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x153aee0 0x1511fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d584aa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1424220 con 0x153aee0 2024-01-22T05:14:32.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d584aa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x14e9920 con 0x153a570 2024-01-22T05:14:32.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d584aa740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1475970 con 0x15334d0 2024-01-22T05:14:32.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d47400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15334d0 0x14ee010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d47400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15334d0 0x14ee010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:47628/0 (socket says 172.21.15.49:47628) 2024-01-22T05:14:32.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d47400700 1 -- 172.21.15.49:0/1276385410 learned_addr learned my addr 172.21.15.49:0/1276385410 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:32.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d46a00700 1 --2- 172.21.15.49:0/1276385410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 0x14ee500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d47e00700 1 --2- 172.21.15.49:0/1276385410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x153aee0 0x1511fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d47400700 1 -- 172.21.15.49:0/1276385410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 msgr2=0x14ee500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d47400700 1 --2- 172.21.15.49:0/1276385410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 0x14ee500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d47400700 1 -- 172.21.15.49:0/1276385410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x153aee0 msgr2=0x1511fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d47400700 1 --2- 172.21.15.49:0/1276385410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x153aee0 0x1511fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d47400700 1 -- 172.21.15.49:0/1276385410 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d48068340 con 0x15334d0 2024-01-22T05:14:32.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d47400700 1 --2- 172.21.15.49:0/1276385410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15334d0 0x14ee010 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f5d3801f000 tx=0x7f5d38033280).ready entity=mon.2 client_cookie=cbdbd466eb3f7c5f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d37a00700 1 -- 172.21.15.49:0/1276385410 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38032070 con 0x15334d0 2024-01-22T05:14:32.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d37a00700 1 -- 172.21.15.49:0/1276385410 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d38014dd0 con 0x15334d0 2024-01-22T05:14:32.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.359+0000 7f5d37a00700 1 -- 172.21.15.49:0/1276385410 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38013d60 con 0x15334d0 2024-01-22T05:14:32.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.363+0000 7f5d584aa740 1 -- 172.21.15.49:0/1276385410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15334d0 msgr2=0x14ee010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.363+0000 7f5d584aa740 1 --2- 172.21.15.49:0/1276385410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15334d0 0x14ee010 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f5d3801f000 tx=0x7f5d38033280).stop 2024-01-22T05:14:32.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.363+0000 7f5d584aa740 1 -- 172.21.15.49:0/1276385410 shutdown_connections 2024-01-22T05:14:32.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.363+0000 7f5d584aa740 1 --2- 172.21.15.49:0/1276385410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x153aee0 0x1511fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.363+0000 7f5d584aa740 1 --2- 172.21.15.49:0/1276385410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 0x14ee500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.363+0000 7f5d584aa740 1 --2- 172.21.15.49:0/1276385410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x15334d0 0x14ee010 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.363+0000 7f5d584aa740 1 -- 172.21.15.49:0/1276385410 >> 172.21.15.49:0/1276385410 conn(0x12cd680 msgr2=0x14ec290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:32.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.363+0000 7f5d584aa740 1 -- 172.21.15.49:0/1276385410 shutdown_connections 2024-01-22T05:14:32.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.363+0000 7f5d584aa740 1 -- 172.21.15.49:0/1276385410 wait complete. 2024-01-22T05:14:32.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.363+0000 7f5d584aa740 1 -- start start 2024-01-22T05:14:32.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.363+0000 7f5d584aa740 1 Processor -- start 2024-01-22T05:14:32.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d584aa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15334d0 0x1596b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d584aa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 0x14ede00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d584aa740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x153aee0 0x14ee2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d584aa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x14ee7e0 con 0x15334d0 2024-01-22T05:14:32.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d584aa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1543780 con 0x153a570 2024-01-22T05:14:32.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d584aa740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x15989c0 con 0x153aee0 2024-01-22T05:14:32.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d584aa740 10 client.0 ll_register_callbacks cb 0x7f5d3004adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:14:32.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15334d0 0x1596b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15334d0 0x1596b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55070/0 (socket says 172.21.15.49:55070) 2024-01-22T05:14:32.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d47400700 1 -- 172.21.15.49:0/981140069 learned_addr learned my addr 172.21.15.49:0/981140069 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:32.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d47e00700 1 --2- 172.21.15.49:0/981140069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x153aee0 0x14ee2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d46a00700 1 --2- 172.21.15.49:0/981140069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 0x14ede00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d47400700 1 -- 172.21.15.49:0/981140069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x153aee0 msgr2=0x14ee2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d47400700 1 --2- 172.21.15.49:0/981140069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x153aee0 0x14ee2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d47400700 1 -- 172.21.15.49:0/981140069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 msgr2=0x14ede00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d47400700 1 --2- 172.21.15.49:0/981140069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 0x14ede00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d47400700 1 -- 172.21.15.49:0/981140069 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x14794c0 con 0x15334d0 2024-01-22T05:14:32.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d47400700 1 --2- 172.21.15.49:0/981140069 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15334d0 0x1596b20 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f5d3802b880 tx=0x7f5d38032000).ready entity=mon.0 client_cookie=edcced8f9ad0e00a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d2f400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:14:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d2f400700 1 -- 172.21.15.49:0/981140069 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38013930 con 0x15334d0 2024-01-22T05:14:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d2f400700 1 -- 172.21.15.49:0/981140069 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f5d3801a040 con 0x15334d0 2024-01-22T05:14:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d584aa740 1 -- 172.21.15.49:0/981140069 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5d380135b0 con 0x15334d0 2024-01-22T05:14:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.367+0000 7f5d2f400700 1 -- 172.21.15.49:0/981140069 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d3802ba60 con 0x15334d0 2024-01-22T05:14:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d584aa740 10 client.8061 fetch_fsmap learned FSMap version 98 2024-01-22T05:14:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d584aa740 1 -- 172.21.15.49:0/981140069 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x14687c0 con 0x15334d0 2024-01-22T05:14:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d2f400700 1 -- 172.21.15.49:0/981140069 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d380135b0 con 0x15334d0 2024-01-22T05:14:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d2f400700 1 -- 172.21.15.49:0/981140069 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 98) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5d38014660 con 0x15334d0 2024-01-22T05:14:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d584aa740 10 client.8061 fetch_fsmap finished waiting for FSMap version 98 2024-01-22T05:14:32.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d584aa740 10 client.8061 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-01-22T05:14:32.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d584aa740 20 client.8061 populate_metadata read hostname 'smithi049' 2024-01-22T05:14:32.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d584aa740 1 --2- 172.21.15.49:0/981140069 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x14ebc10 0x14ea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d584aa740 4 client.8061 mds_command: new command op to 7743 tid=0[{"prefix": "scrub resume"}] 2024-01-22T05:14:32.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d584aa740 1 -- 172.21.15.49:0/981140069 --> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x1324610 con 0x14ebc10 2024-01-22T05:14:32.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d46a00700 1 --2- 172.21.15.49:0/981140069 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x14ebc10 0x14ea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d46a00700 1 --2- 172.21.15.49:0/981140069 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x14ebc10 0x14ea9f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=55b141e0f9f48c89 server_cookie=6a2336aa33288041 in_seq=0 out_seq=0 2024-01-22T05:14:32.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d2f400700 10 client.8061 ms_handle_connect on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:32.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d2f400700 1 -- 172.21.15.49:0/981140069 <== mds.0 v2:172.21.15.110:6832/1348218223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x1324610 con 0x14ebc10 2024-01-22T05:14:32.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d2f400700 10 client.8061 handle_command_reply: tid=0 2024-01-22T05:14:32.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d584aa740 1 client.8061 shutdown 2024-01-22T05:14:32.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d584aa740 1 -- 172.21.15.49:0/981140069 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15334d0 msgr2=0x1596b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.371+0000 7f5d584aa740 1 --2- 172.21.15.49:0/981140069 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15334d0 0x1596b20 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f5d3802b880 tx=0x7f5d38032000).stop 2024-01-22T05:14:32.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d584aa740 1 -- 172.21.15.49:0/981140069 shutdown_connections 2024-01-22T05:14:32.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d584aa740 1 --2- 172.21.15.49:0/981140069 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x14ebc10 0x14ea9f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d584aa740 1 --2- 172.21.15.49:0/981140069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x153aee0 0x14ee2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d584aa740 1 --2- 172.21.15.49:0/981140069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x153a570 0x14ede00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d584aa740 1 --2- 172.21.15.49:0/981140069 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x15334d0 0x1596b20 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d2f400700 0 client.8061 ms_handle_reset on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:32.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d584aa740 1 -- 172.21.15.49:0/981140069 >> 172.21.15.49:0/981140069 conn(0x12cd680 msgr2=0x14ec580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:32.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d584aa740 1 -- 172.21.15.49:0/981140069 shutdown_connections 2024-01-22T05:14:32.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d584aa740 1 -- 172.21.15.49:0/981140069 wait complete. 2024-01-22T05:14:32.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d584aa740 20 client.8061 trim_cache size 0 max 16384 2024-01-22T05:14:32.377 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:14:32.377 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:14:32.377 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:14:32.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d4e000700 1 -- 172.21.15.49:0/3464666592 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d2005a4e0 msgr2=0x7f5d2005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d4e000700 1 --2- 172.21.15.49:0/3464666592 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d2005a4e0 0x7f5d2005c9a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f5d38009fd0 tx=0x7f5d38009060).stop 2024-01-22T05:14:32.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d4e000700 1 -- 172.21.15.49:0/3464666592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d481524f0 msgr2=0x7f5d480becb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d4e000700 1 --2- 172.21.15.49:0/3464666592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d481524f0 0x7f5d480becb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f5d3000c410 tx=0x7f5d30007bd0).stop 2024-01-22T05:14:32.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d4e000700 1 -- 172.21.15.49:0/3464666592 shutdown_connections 2024-01-22T05:14:32.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d4e000700 1 --2- 172.21.15.49:0/3464666592 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d2005a4e0 0x7f5d2005c9a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d4e000700 1 --2- 172.21.15.49:0/3464666592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d4815bad0 0x7f5d480bf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d4e000700 1 --2- 172.21.15.49:0/3464666592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d481524f0 0x7f5d480becb0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d4e000700 1 --2- 172.21.15.49:0/3464666592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d480a8e70 0x7f5d4814da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d4e000700 1 -- 172.21.15.49:0/3464666592 >> 172.21.15.49:0/3464666592 conn(0x7f5d480c6560 msgr2=0x7f5d48150f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:32.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d4e000700 1 -- 172.21.15.49:0/3464666592 shutdown_connections 2024-01-22T05:14:32.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.375+0000 7f5d4e000700 1 -- 172.21.15.49:0/3464666592 wait complete. 2024-01-22T05:14:32.402 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2024-01-22T05:14:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.575+0000 7fd16e800700 1 Processor -- start 2024-01-22T05:14:32.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.575+0000 7fd16e800700 1 -- start start 2024-01-22T05:14:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.579+0000 7fd16e800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd168067b70 0x7fd1680ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.579+0000 7fd16e800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd168066e20 0x7fd168067240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.579+0000 7fd16e800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd168066200 con 0x7fd1680c2340 2024-01-22T05:14:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.579+0000 7fd16e800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd168066690 con 0x7fd168066e20 2024-01-22T05:14:32.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.579+0000 7fd16e800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1680655f0 con 0x7fd168067b70 2024-01-22T05:14:32.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.579+0000 7fd166a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd168066e20 0x7fd168067240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.579+0000 7fd167400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd168067b70 0x7fd1680ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.579+0000 7fd167400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd168067b70 0x7fd1680ac0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:57868/0 (socket says 172.21.15.49:57868) 2024-01-22T05:14:32.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.579+0000 7fd167400700 1 -- 172.21.15.49:0/937962353 learned_addr learned my addr 172.21.15.49:0/937962353 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:32.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.579+0000 7fd167e00700 1 --1- 172.21.15.49:0/937962353 >> v1:172.21.15.110:6789/0 conn(0x7fd1680c2340 0x7fd1680c27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:39314/0 (socket says 172.21.15.49:39314) 2024-01-22T05:14:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.579+0000 7fd166a00700 1 -- 172.21.15.49:0/937962353 >> v2:172.21.15.110:3300/0 conn(0x7fd168067b70 msgr2=0x7fd1680ac0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.579+0000 7fd166a00700 1 --2- 172.21.15.49:0/937962353 >> v2:172.21.15.110:3300/0 conn(0x7fd168067b70 0x7fd1680ac0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.579+0000 7fd166a00700 1 -- 172.21.15.49:0/937962353 >> v1:172.21.15.110:6789/0 conn(0x7fd1680c2340 legacy=0x7fd1680c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.579+0000 7fd166000700 1 -- 172.21.15.49:0/937962353 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521390677 0 0) 0x7fd168066200 con 0x7fd1680c2340 2024-01-22T05:14:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.579+0000 7fd166a00700 1 -- 172.21.15.49:0/937962353 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1680658d0 con 0x7fd168066e20 2024-01-22T05:14:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.583+0000 7fd166a00700 1 --2- 172.21.15.49:0/937962353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd168066e20 0x7fd168067240 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7fd16805f520 tx=0x7fd150009060).ready entity=mon.0 client_cookie=e5d75fb2a63dbefe server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.583+0000 7fd166000700 1 -- 172.21.15.49:0/937962353 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15000f510 con 0x7fd168066e20 2024-01-22T05:14:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.583+0000 7fd166000700 1 -- 172.21.15.49:0/937962353 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15000f670 con 0x7fd168066e20 2024-01-22T05:14:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.583+0000 7fd166000700 1 -- 172.21.15.49:0/937962353 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15000f9f0 con 0x7fd168066e20 2024-01-22T05:14:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.583+0000 7fd16e800700 1 -- 172.21.15.49:0/937962353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd168066e20 msgr2=0x7fd168067240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.583+0000 7fd16e800700 1 --2- 172.21.15.49:0/937962353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd168066e20 0x7fd168067240 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7fd16805f520 tx=0x7fd150009060).stop 2024-01-22T05:14:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.583+0000 7fd16e800700 1 -- 172.21.15.49:0/937962353 shutdown_connections 2024-01-22T05:14:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.583+0000 7fd16e800700 1 --2- 172.21.15.49:0/937962353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd168066e20 0x7fd168067240 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.583+0000 7fd16e800700 1 --2- 172.21.15.49:0/937962353 >> v2:172.21.15.110:3300/0 conn(0x7fd168067b70 0x7fd1680ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.583+0000 7fd16e800700 1 -- 172.21.15.49:0/937962353 >> 172.21.15.49:0/937962353 conn(0x7fd1680c6560 msgr2=0x7fd1680c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.583+0000 7fd16e800700 1 -- 172.21.15.49:0/937962353 shutdown_connections 2024-01-22T05:14:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.583+0000 7fd16e800700 1 -- 172.21.15.49:0/937962353 wait complete. 2024-01-22T05:14:32.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.587+0000 7fd16e800700 1 Processor -- start 2024-01-22T05:14:32.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.587+0000 7fd16e800700 1 -- start start 2024-01-22T05:14:32.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.587+0000 7fd16e800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd168066e20 0x7fd16814f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.587+0000 7fd16e800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd168067b70 0x7fd16809f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.587+0000 7fd16e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1680c2340 0x7fd16809f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.587+0000 7fd16e800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16809ff60 con 0x7fd1680c2340 2024-01-22T05:14:32.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.587+0000 7fd16e800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1680a0240 con 0x7fd168066e20 2024-01-22T05:14:32.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.587+0000 7fd16e800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1680a0520 con 0x7fd168067b70 2024-01-22T05:14:32.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd167e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1680c2340 0x7fd16809f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd167e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1680c2340 0x7fd16809f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55096/0 (socket says 172.21.15.49:55096) 2024-01-22T05:14:32.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd167e00700 1 -- 172.21.15.49:0/2983549007 learned_addr learned my addr 172.21.15.49:0/2983549007 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:32.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd167400700 1 --2- 172.21.15.49:0/2983549007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd168066e20 0x7fd16814f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd166a00700 1 --2- 172.21.15.49:0/2983549007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd168067b70 0x7fd16809f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd167e00700 1 -- 172.21.15.49:0/2983549007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd168067b70 msgr2=0x7fd16809f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd167e00700 1 --2- 172.21.15.49:0/2983549007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd168067b70 0x7fd16809f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd167e00700 1 -- 172.21.15.49:0/2983549007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd168066e20 msgr2=0x7fd16814f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd167e00700 1 --2- 172.21.15.49:0/2983549007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd168066e20 0x7fd16814f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd167e00700 1 -- 172.21.15.49:0/2983549007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1500092a0 con 0x7fd1680c2340 2024-01-22T05:14:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd167e00700 1 --2- 172.21.15.49:0/2983549007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1680c2340 0x7fd16809f990 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7fd16000ecc0 tx=0x7fd160001a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd15ea00700 1 -- 172.21.15.49:0/2983549007 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16000c8d0 con 0x7fd1680c2340 2024-01-22T05:14:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd15ea00700 1 -- 172.21.15.49:0/2983549007 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16000ca30 con 0x7fd1680c2340 2024-01-22T05:14:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd16e800700 1 -- 172.21.15.49:0/2983549007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1680a0800 con 0x7fd1680c2340 2024-01-22T05:14:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd15ea00700 1 -- 172.21.15.49:0/2983549007 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16000cdb0 con 0x7fd1680c2340 2024-01-22T05:14:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.591+0000 7fd16e800700 1 -- 172.21.15.49:0/2983549007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16814fea0 con 0x7fd1680c2340 2024-01-22T05:14:32.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.595+0000 7fd15ea00700 1 -- 172.21.15.49:0/2983549007 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd160009320 con 0x7fd1680c2340 2024-01-22T05:14:32.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.595+0000 7fd15ea00700 1 --2- 172.21.15.49:0/2983549007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd14005a540 0x7fd14005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.595+0000 7fd15ea00700 1 -- 172.21.15.49:0/2983549007 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fd1600771b0 con 0x7fd1680c2340 2024-01-22T05:14:32.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.595+0000 7fd167400700 1 --2- 172.21.15.49:0/2983549007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd14005a540 0x7fd14005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.599+0000 7fd167400700 1 --2- 172.21.15.49:0/2983549007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd14005a540 0x7fd14005ca00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fd158006bc0 tx=0x7fd1580090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.599+0000 7fd178cc0740 1 Processor -- start 2024-01-22T05:14:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.599+0000 7fd178cc0740 1 -- start start 2024-01-22T05:14:32.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.599+0000 7fd178cc0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16754d0 0x16758b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.599+0000 7fd178cc0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x167c570 0x167c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.599+0000 7fd178cc0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 0x165b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.599+0000 7fd178cc0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x158d540 con 0x167c570 2024-01-22T05:14:32.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.599+0000 7fd178cc0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1550e90 con 0x16754d0 2024-01-22T05:14:32.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.599+0000 7fd178cc0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1556d90 con 0x167cee0 2024-01-22T05:14:32.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd166a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x167c570 0x167c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd166a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x167c570 0x167c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55110/0 (socket says 172.21.15.49:55110) 2024-01-22T05:14:32.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd166a00700 1 -- 172.21.15.49:0/2114545088 learned_addr learned my addr 172.21.15.49:0/2114545088 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:32.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd167400700 1 --2- 172.21.15.49:0/2114545088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16754d0 0x16758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd167e00700 1 --2- 172.21.15.49:0/2114545088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 0x165b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd166a00700 1 -- 172.21.15.49:0/2114545088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 msgr2=0x165b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd166a00700 1 --2- 172.21.15.49:0/2114545088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 0x165b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd166a00700 1 -- 172.21.15.49:0/2114545088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16754d0 msgr2=0x16758b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd166a00700 1 --2- 172.21.15.49:0/2114545088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16754d0 0x16758b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd166a00700 1 -- 172.21.15.49:0/2114545088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x15bb4c0 con 0x167c570 2024-01-22T05:14:32.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd166a00700 1 --2- 172.21.15.49:0/2114545088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x167c570 0x167c9f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7fd15000f510 tx=0x7fd150017000).ready entity=mon.0 client_cookie=f9ba352e790dfd3c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd157400700 1 -- 172.21.15.49:0/2114545088 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd150000c90 con 0x167c570 2024-01-22T05:14:32.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd157400700 1 -- 172.21.15.49:0/2114545088 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15000f7e0 con 0x167c570 2024-01-22T05:14:32.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd157400700 1 -- 172.21.15.49:0/2114545088 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd150025660 con 0x167c570 2024-01-22T05:14:32.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd178cc0740 1 -- 172.21.15.49:0/2114545088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x167c570 msgr2=0x167c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd178cc0740 1 --2- 172.21.15.49:0/2114545088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x167c570 0x167c9f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7fd15000f510 tx=0x7fd150017000).stop 2024-01-22T05:14:32.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd178cc0740 1 -- 172.21.15.49:0/2114545088 shutdown_connections 2024-01-22T05:14:32.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd178cc0740 1 --2- 172.21.15.49:0/2114545088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 0x165b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd178cc0740 1 --2- 172.21.15.49:0/2114545088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x167c570 0x167c9f0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd178cc0740 1 --2- 172.21.15.49:0/2114545088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16754d0 0x16758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd178cc0740 1 -- 172.21.15.49:0/2114545088 >> 172.21.15.49:0/2114545088 conn(0x140f680 msgr2=0x162ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:32.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd178cc0740 1 -- 172.21.15.49:0/2114545088 shutdown_connections 2024-01-22T05:14:32.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.603+0000 7fd178cc0740 1 -- 172.21.15.49:0/2114545088 wait complete. 2024-01-22T05:14:32.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.607+0000 7fd178cc0740 1 -- start start 2024-01-22T05:14:32.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.607+0000 7fd178cc0740 1 Processor -- start 2024-01-22T05:14:32.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd178cc0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16754d0 0x164b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd178cc0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x167c570 0x16860a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd178cc0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 0x1686590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd178cc0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1686a80 con 0x16754d0 2024-01-22T05:14:32.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd178cc0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x162d280 con 0x167c570 2024-01-22T05:14:32.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd178cc0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1655ae0 con 0x167cee0 2024-01-22T05:14:32.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd178cc0740 10 client.0 ll_register_callbacks cb 0x15e75d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:14:32.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd167400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16754d0 0x164b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd167e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 0x1686590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd167400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16754d0 0x164b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55124/0 (socket says 172.21.15.49:55124) 2024-01-22T05:14:32.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd167400700 1 -- 172.21.15.49:0/4156863447 learned_addr learned my addr 172.21.15.49:0/4156863447 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:32.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd166a00700 1 --2- 172.21.15.49:0/4156863447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x167c570 0x16860a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd167e00700 1 -- 172.21.15.49:0/4156863447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x167c570 msgr2=0x16860a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd167e00700 1 --2- 172.21.15.49:0/4156863447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x167c570 0x16860a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd167e00700 1 -- 172.21.15.49:0/4156863447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16754d0 msgr2=0x164b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd167e00700 1 --2- 172.21.15.49:0/4156863447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16754d0 0x164b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd167e00700 1 -- 172.21.15.49:0/4156863447 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1680658d0 con 0x167cee0 2024-01-22T05:14:32.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd167400700 1 --2- 172.21.15.49:0/4156863447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16754d0 0x164b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:32.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd167e00700 1 --2- 172.21.15.49:0/4156863447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 0x1686590 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x162c5f0 tx=0x7fd160021040).ready entity=mon.2 client_cookie=39e7abb949d84ed1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd14fe00700 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2024-01-22T05:14:32.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd14fe00700 1 -- 172.21.15.49:0/4156863447 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16004aad0 con 0x167cee0 2024-01-22T05:14:32.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd14fe00700 1 -- 172.21.15.49:0/4156863447 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fd16004ac30 con 0x167cee0 2024-01-22T05:14:32.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd178cc0740 1 -- 172.21.15.49:0/4156863447 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x15a7230 con 0x167cee0 2024-01-22T05:14:32.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd14fe00700 1 -- 172.21.15.49:0/4156863447 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd16004d8b0 con 0x167cee0 2024-01-22T05:14:32.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd178cc0740 10 client.6998 fetch_fsmap learned FSMap version 98 2024-01-22T05:14:32.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.611+0000 7fd178cc0740 1 -- 172.21.15.49:0/4156863447 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x15aa7c0 con 0x167cee0 2024-01-22T05:14:32.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.615+0000 7fd14fe00700 1 -- 172.21.15.49:0/4156863447 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x15a7230 con 0x167cee0 2024-01-22T05:14:32.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.615+0000 7fd14fe00700 1 -- 172.21.15.49:0/4156863447 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 98) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd16004a1b0 con 0x167cee0 2024-01-22T05:14:32.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.615+0000 7fd178cc0740 10 client.6998 fetch_fsmap finished waiting for FSMap version 98 2024-01-22T05:14:32.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.615+0000 7fd178cc0740 10 client.6998 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-01-22T05:14:32.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.615+0000 7fd178cc0740 20 client.6998 populate_metadata read hostname 'smithi049' 2024-01-22T05:14:32.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.615+0000 7fd178cc0740 1 --2- 172.21.15.49:0/4156863447 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1654c90 0x16550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.615+0000 7fd178cc0740 4 client.6998 mds_command: new command op to 7743 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:14:32.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.615+0000 7fd178cc0740 1 -- 172.21.15.49:0/4156863447 --> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x159d780 con 0x1654c90 2024-01-22T05:14:32.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.615+0000 7fd167400700 1 --2- 172.21.15.49:0/4156863447 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1654c90 0x16550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.615+0000 7fd14fe00700 10 client.6998 ms_handle_connect on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:32.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.615+0000 7fd167400700 1 --2- 172.21.15.49:0/4156863447 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1654c90 0x16550a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=80a976f6e8ded645 server_cookie=f61774dea3997261 in_seq=0 out_seq=0 2024-01-22T05:14:32.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.619+0000 7fd14fe00700 1 -- 172.21.15.49:0/4156863447 <== mds.0 v2:172.21.15.110:6832/1348218223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x159d780 con 0x1654c90 2024-01-22T05:14:32.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.619+0000 7fd14fe00700 10 client.6998 handle_command_reply: tid=0 2024-01-22T05:14:32.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.619+0000 7fd178cc0740 1 client.6998 shutdown 2024-01-22T05:14:32.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.619+0000 7fd178cc0740 1 -- 172.21.15.49:0/4156863447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 msgr2=0x1686590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.619+0000 7fd178cc0740 1 --2- 172.21.15.49:0/4156863447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 0x1686590 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x162c5f0 tx=0x7fd160021040).stop 2024-01-22T05:14:32.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.619+0000 7fd178cc0740 1 -- 172.21.15.49:0/4156863447 shutdown_connections 2024-01-22T05:14:32.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.619+0000 7fd178cc0740 1 --2- 172.21.15.49:0/4156863447 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1654c90 0x16550a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.619+0000 7fd178cc0740 1 --2- 172.21.15.49:0/4156863447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 0x1686590 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.619+0000 7fd178cc0740 1 --2- 172.21.15.49:0/4156863447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x167c570 0x16860a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.619+0000 7fd178cc0740 1 --2- 172.21.15.49:0/4156863447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16754d0 0x164b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.619+0000 7fd178cc0740 1 -- 172.21.15.49:0/4156863447 >> 172.21.15.49:0/4156863447 conn(0x140f680 msgr2=0x1676230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:32.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.619+0000 7fd14fe00700 0 client.6998 ms_handle_reset on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:32.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.619+0000 7fd178cc0740 1 -- 172.21.15.49:0/4156863447 shutdown_connections 2024-01-22T05:14:32.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.619+0000 7fd178cc0740 1 -- 172.21.15.49:0/4156863447 wait complete. 2024-01-22T05:14:32.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.619+0000 7fd178cc0740 20 client.6998 trim_cache size 0 max 16384 2024-01-22T05:14:32.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.647+0000 7fd178cc0740 1 Processor -- start 2024-01-22T05:14:32.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.647+0000 7fd178cc0740 1 -- start start 2024-01-22T05:14:32.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd178cc0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16754d0 0x1676100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd178cc0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167c570 0x16765f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd178cc0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x167cee0 0x1652cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd178cc0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x15f6cb0 con 0x16754d0 2024-01-22T05:14:32.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd178cc0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1658ca0 con 0x167cee0 2024-01-22T05:14:32.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd178cc0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x16555e0 con 0x167c570 2024-01-22T05:14:32.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd167400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16754d0 0x1676100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd167400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16754d0 0x1676100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55126/0 (socket says 172.21.15.49:55126) 2024-01-22T05:14:32.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd167e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x167cee0 0x1652cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd167400700 1 -- 172.21.15.49:0/3988116785 learned_addr learned my addr 172.21.15.49:0/3988116785 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:32.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd166a00700 1 --2- 172.21.15.49:0/3988116785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167c570 0x16765f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd167400700 1 -- 172.21.15.49:0/3988116785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167c570 msgr2=0x16765f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd167400700 1 --2- 172.21.15.49:0/3988116785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167c570 0x16765f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd167400700 1 -- 172.21.15.49:0/3988116785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x167cee0 msgr2=0x1652cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd167400700 1 --2- 172.21.15.49:0/3988116785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x167cee0 0x1652cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd167400700 1 -- 172.21.15.49:0/3988116785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1655400 con 0x16754d0 2024-01-22T05:14:32.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd167400700 1 --2- 172.21.15.49:0/3988116785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16754d0 0x1676100 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fd158011e40 tx=0x7fd158017000).ready entity=mon.0 client_cookie=d1bdcd2b40ddf8b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.651+0000 7fd157e00700 1 -- 172.21.15.49:0/3988116785 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd158027070 con 0x16754d0 2024-01-22T05:14:32.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.655+0000 7fd157e00700 1 -- 172.21.15.49:0/3988116785 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15802a470 con 0x16754d0 2024-01-22T05:14:32.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.655+0000 7fd157e00700 1 -- 172.21.15.49:0/3988116785 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd158014ea0 con 0x16754d0 2024-01-22T05:14:32.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.655+0000 7fd178cc0740 1 -- 172.21.15.49:0/3988116785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16754d0 msgr2=0x1676100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.655+0000 7fd178cc0740 1 --2- 172.21.15.49:0/3988116785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16754d0 0x1676100 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fd158011e40 tx=0x7fd158017000).stop 2024-01-22T05:14:32.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.655+0000 7fd178cc0740 1 -- 172.21.15.49:0/3988116785 shutdown_connections 2024-01-22T05:14:32.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.655+0000 7fd178cc0740 1 --2- 172.21.15.49:0/3988116785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x167cee0 0x1652cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.655+0000 7fd178cc0740 1 --2- 172.21.15.49:0/3988116785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167c570 0x16765f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.655+0000 7fd178cc0740 1 --2- 172.21.15.49:0/3988116785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x16754d0 0x1676100 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.655+0000 7fd178cc0740 1 -- 172.21.15.49:0/3988116785 >> 172.21.15.49:0/3988116785 conn(0x140f680 msgr2=0x162edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:32.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.655+0000 7fd178cc0740 1 -- 172.21.15.49:0/3988116785 shutdown_connections 2024-01-22T05:14:32.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.655+0000 7fd178cc0740 1 -- 172.21.15.49:0/3988116785 wait complete. 2024-01-22T05:14:32.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.655+0000 7fd178cc0740 1 -- start start 2024-01-22T05:14:32.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.655+0000 7fd178cc0740 1 Processor -- start 2024-01-22T05:14:32.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd178cc0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16754d0 0x16dcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd178cc0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x167c570 0x164e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd178cc0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 0x164e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd178cc0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x164ea10 con 0x167c570 2024-01-22T05:14:32.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd178cc0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x166fb50 con 0x16754d0 2024-01-22T05:14:32.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd178cc0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x16e1510 con 0x167cee0 2024-01-22T05:14:32.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd178cc0740 10 client.0 ll_register_callbacks cb 0x7fd16004e1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:14:32.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd166a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x167c570 0x164e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd167400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16754d0 0x16dcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd166a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x167c570 0x164e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55132/0 (socket says 172.21.15.49:55132) 2024-01-22T05:14:32.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd166a00700 1 -- 172.21.15.49:0/1605701717 learned_addr learned my addr 172.21.15.49:0/1605701717 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:32.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd167400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16754d0 0x16dcf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:57906/0 (socket says 172.21.15.49:57906) 2024-01-22T05:14:32.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd167e00700 1 --2- 172.21.15.49:0/1605701717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 0x164e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd166a00700 1 -- 172.21.15.49:0/1605701717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 msgr2=0x164e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd166a00700 1 --2- 172.21.15.49:0/1605701717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 0x164e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd166a00700 1 -- 172.21.15.49:0/1605701717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16754d0 msgr2=0x16dcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:32.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd166a00700 1 --2- 172.21.15.49:0/1605701717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16754d0 0x16dcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.659+0000 7fd166a00700 1 -- 172.21.15.49:0/1605701717 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd158014600 con 0x167c570 2024-01-22T05:14:32.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd166a00700 1 --2- 172.21.15.49:0/1605701717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x167c570 0x164e030 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x159c520 tx=0x7fd15001e040).ready entity=mon.0 client_cookie=4c78a7a958ad8889 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd14fe00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:14:32.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd14fe00700 1 -- 172.21.15.49:0/1605701717 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd150025430 con 0x167c570 2024-01-22T05:14:32.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd14fe00700 1 -- 172.21.15.49:0/1605701717 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fd150025590 con 0x167c570 2024-01-22T05:14:32.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd178cc0740 1 -- 172.21.15.49:0/1605701717 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd15000f7e0 con 0x167c570 2024-01-22T05:14:32.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd14fe00700 1 -- 172.21.15.49:0/1605701717 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd150025ca0 con 0x167c570 2024-01-22T05:14:32.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd178cc0740 10 client.8079 fetch_fsmap learned FSMap version 98 2024-01-22T05:14:32.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd178cc0740 1 -- 172.21.15.49:0/1605701717 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x7fd1680a9910 con 0x167c570 2024-01-22T05:14:32.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd14fe00700 1 -- 172.21.15.49:0/1605701717 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15000f7e0 con 0x167c570 2024-01-22T05:14:32.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd14fe00700 1 -- 172.21.15.49:0/1605701717 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 98) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd150009760 con 0x167c570 2024-01-22T05:14:32.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd178cc0740 10 client.8079 fetch_fsmap finished waiting for FSMap version 98 2024-01-22T05:14:32.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd178cc0740 10 client.8079 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-01-22T05:14:32.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd178cc0740 20 client.8079 populate_metadata read hostname 'smithi049' 2024-01-22T05:14:32.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd178cc0740 1 --2- 172.21.15.49:0/1605701717 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1651850 0x1651c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd178cc0740 4 client.8079 mds_command: new command op to 7743 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:14:32.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd178cc0740 1 -- 172.21.15.49:0/1605701717 --> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1466610 con 0x1651850 2024-01-22T05:14:32.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd167400700 1 --2- 172.21.15.49:0/1605701717 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1651850 0x1651c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd167400700 1 --2- 172.21.15.49:0/1605701717 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1651850 0x1651c30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8135b2b3d3fa55d server_cookie=6559fec759652aba in_seq=0 out_seq=0 2024-01-22T05:14:32.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd14fe00700 10 client.8079 ms_handle_connect on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:32.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd14fe00700 1 -- 172.21.15.49:0/1605701717 <== mds.0 v2:172.21.15.110:6832/1348218223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1466610 con 0x1651850 2024-01-22T05:14:32.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd14fe00700 10 client.8079 handle_command_reply: tid=0 2024-01-22T05:14:32.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd178cc0740 1 client.8079 shutdown 2024-01-22T05:14:32.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd178cc0740 1 -- 172.21.15.49:0/1605701717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x167c570 msgr2=0x164e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.663+0000 7fd178cc0740 1 --2- 172.21.15.49:0/1605701717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x167c570 0x164e030 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x159c520 tx=0x7fd15001e040).stop 2024-01-22T05:14:32.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd178cc0740 1 -- 172.21.15.49:0/1605701717 shutdown_connections 2024-01-22T05:14:32.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd178cc0740 1 --2- 172.21.15.49:0/1605701717 >> [v2:172.21.15.110:6832/1348218223,v1:172.21.15.110:6833/1348218223] conn(0x1651850 0x1651c30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd178cc0740 1 --2- 172.21.15.49:0/1605701717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x167cee0 0x164e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd178cc0740 1 --2- 172.21.15.49:0/1605701717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x167c570 0x164e030 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd14fe00700 0 client.8079 ms_handle_reset on v2:172.21.15.110:6832/1348218223 2024-01-22T05:14:32.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd178cc0740 1 --2- 172.21.15.49:0/1605701717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x16754d0 0x16dcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd178cc0740 1 -- 172.21.15.49:0/1605701717 >> 172.21.15.49:0/1605701717 conn(0x140f680 msgr2=0x1655c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:32.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd178cc0740 1 -- 172.21.15.49:0/1605701717 shutdown_connections 2024-01-22T05:14:32.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd178cc0740 1 -- 172.21.15.49:0/1605701717 wait complete. 2024-01-22T05:14:32.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd178cc0740 20 client.8079 trim_cache size 0 max 16384 2024-01-22T05:14:32.669 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:14:32.670 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-01-22T05:14:32.670 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-01-22T05:14:32.670 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:14:32.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd16e800700 1 -- 172.21.15.49:0/2983549007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd14005a540 msgr2=0x7fd14005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd16e800700 1 --2- 172.21.15.49:0/2983549007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd14005a540 0x7fd14005ca00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fd158006bc0 tx=0x7fd1580090f0).stop 2024-01-22T05:14:32.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd16e800700 1 -- 172.21.15.49:0/2983549007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1680c2340 msgr2=0x7fd16809f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd16e800700 1 --2- 172.21.15.49:0/2983549007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1680c2340 0x7fd16809f990 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7fd16000ecc0 tx=0x7fd160001a70).stop 2024-01-22T05:14:32.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd16e800700 1 -- 172.21.15.49:0/2983549007 shutdown_connections 2024-01-22T05:14:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd16e800700 1 --2- 172.21.15.49:0/2983549007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd14005a540 0x7fd14005ca00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd16e800700 1 --2- 172.21.15.49:0/2983549007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1680c2340 0x7fd16809f990 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd16e800700 1 --2- 172.21.15.49:0/2983549007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd168067b70 0x7fd16809f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd16e800700 1 --2- 172.21.15.49:0/2983549007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd168066e20 0x7fd16814f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd16e800700 1 -- 172.21.15.49:0/2983549007 >> 172.21.15.49:0/2983549007 conn(0x7fd1680c6560 msgr2=0x7fd1680aa170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd16e800700 1 -- 172.21.15.49:0/2983549007 shutdown_connections 2024-01-22T05:14:32.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.667+0000 7fd16e800700 1 -- 172.21.15.49:0/2983549007 wait complete. 2024-01-22T05:14:32.694 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:14:32.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.867+0000 7f080a000700 1 Processor -- start 2024-01-22T05:14:32.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.867+0000 7f080a000700 1 -- start start 2024-01-22T05:14:32.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.871+0000 7f080a000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f08040be050 0x7f0804154060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.871+0000 7f080a000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08040c4600 con 0x7f0804154550 2024-01-22T05:14:32.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.871+0000 7f080a000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08040bdd10 con 0x7f0804068b30 2024-01-22T05:14:32.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.871+0000 7f080a000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08040be730 con 0x7f08040be050 2024-01-22T05:14:32.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.871+0000 7f0808c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f08040be050 0x7f0804154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.871+0000 7f0808c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f08040be050 0x7f0804154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55148/0 (socket says 172.21.15.49:55148) 2024-01-22T05:14:32.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.871+0000 7f0809600700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0804068b30 0x7f080415dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:39324/0 (socket says 172.21.15.49:39324) 2024-01-22T05:14:32.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.871+0000 7f0808c00700 1 -- 172.21.15.49:0/3294943614 learned_addr learned my addr 172.21.15.49:0/3294943614 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:32.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.871+0000 7f0808c00700 1 -- 172.21.15.49:0/3294943614 >> v1:172.21.15.110:6789/0 conn(0x7f0804068b30 legacy=0x7f080415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.871+0000 7f0803400700 1 -- 172.21.15.49:0/3294943614 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35730913 0 0) 0x7f08040bdd10 con 0x7f0804068b30 2024-01-22T05:14:32.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.871+0000 7f0808c00700 1 -- 172.21.15.49:0/3294943614 >> v1:172.21.15.49:6789/0 conn(0x7f0804154550 legacy=0x7f08041549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.871+0000 7f0808c00700 1 -- 172.21.15.49:0/3294943614 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08040c3fb0 con 0x7f08040be050 2024-01-22T05:14:32.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.871+0000 7f0808c00700 1 --2- 172.21.15.49:0/3294943614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08040be050 0x7f0804154060 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f07f4006fd0 tx=0x7f07f40090f0).ready entity=mon.0 client_cookie=e7c0c923a4ab0e9e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.871+0000 7f0803400700 1 -- 172.21.15.49:0/3294943614 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f400f510 con 0x7f08040be050 2024-01-22T05:14:32.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.871+0000 7f0803400700 1 -- 172.21.15.49:0/3294943614 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f400f670 con 0x7f08040be050 2024-01-22T05:14:32.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.875+0000 7f0803400700 1 -- 172.21.15.49:0/3294943614 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f400fa10 con 0x7f08040be050 2024-01-22T05:14:32.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.875+0000 7f080a000700 1 -- 172.21.15.49:0/3294943614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08040be050 msgr2=0x7f0804154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.875+0000 7f080a000700 1 --2- 172.21.15.49:0/3294943614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08040be050 0x7f0804154060 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f07f4006fd0 tx=0x7f07f40090f0).stop 2024-01-22T05:14:32.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.875+0000 7f080a000700 1 -- 172.21.15.49:0/3294943614 shutdown_connections 2024-01-22T05:14:32.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.875+0000 7f080a000700 1 --2- 172.21.15.49:0/3294943614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08040be050 0x7f0804154060 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.875+0000 7f080a000700 1 -- 172.21.15.49:0/3294943614 >> 172.21.15.49:0/3294943614 conn(0x7f08040c86e0 msgr2=0x7f08040c8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:32.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.875+0000 7f080a000700 1 -- 172.21.15.49:0/3294943614 shutdown_connections 2024-01-22T05:14:32.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.875+0000 7f080a000700 1 -- 172.21.15.49:0/3294943614 wait complete. 2024-01-22T05:14:32.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.879+0000 7f080a000700 1 Processor -- start 2024-01-22T05:14:32.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.879+0000 7f080a000700 1 -- start start 2024-01-22T05:14:32.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f080a000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0804068b30 0x7f0804168470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f080a000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08040be050 0x7f08040ae040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f080a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0804154550 0x7f0804151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f080a000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08040adbb0 con 0x7f0804154550 2024-01-22T05:14:32.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f080a000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0804168960 con 0x7f0804068b30 2024-01-22T05:14:32.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f080a000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08040acfa0 con 0x7f08040be050 2024-01-22T05:14:32.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f0809600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0804154550 0x7f0804151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f0809600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0804154550 0x7f0804151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55162/0 (socket says 172.21.15.49:55162) 2024-01-22T05:14:32.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f0809600700 1 -- 172.21.15.49:0/3778022136 learned_addr learned my addr 172.21.15.49:0/3778022136 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:32.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f0808c00700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0804068b30 0x7f0804168470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f0803e00700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08040be050 0x7f08040ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f0809600700 1 -- 172.21.15.49:0/3778022136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08040be050 msgr2=0x7f08040ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f0809600700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08040be050 0x7f08040ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f0809600700 1 -- 172.21.15.49:0/3778022136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0804068b30 msgr2=0x7f0804168470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:32.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f0809600700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0804068b30 0x7f0804168470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:32.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f0809600700 1 -- 172.21.15.49:0/3778022136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f4009370 con 0x7f0804154550 2024-01-22T05:14:32.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f0808c00700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0804068b30 0x7f0804168470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:32.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f0803e00700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08040be050 0x7f08040ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:32.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f0809600700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0804154550 0x7f0804151f80 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f07fc00c730 tx=0x7f07fc001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f07fbe00700 1 -- 172.21.15.49:0/3778022136 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc005c70 con 0x7f0804154550 2024-01-22T05:14:32.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f080a000700 1 -- 172.21.15.49:0/3778022136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08040ad280 con 0x7f0804154550 2024-01-22T05:14:32.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f07fbe00700 1 -- 172.21.15.49:0/3778022136 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc005dd0 con 0x7f0804154550 2024-01-22T05:14:32.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f07fbe00700 1 -- 172.21.15.49:0/3778022136 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc007340 con 0x7f0804154550 2024-01-22T05:14:32.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.883+0000 7f080a000700 1 -- 172.21.15.49:0/3778022136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08040ad840 con 0x7f0804154550 2024-01-22T05:14:32.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.887+0000 7f080a000700 1 -- 172.21.15.49:0/3778022136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08040691e0 con 0x7f0804154550 2024-01-22T05:14:32.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.887+0000 7f07fbe00700 1 -- 172.21.15.49:0/3778022136 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f07fc0076f0 con 0x7f0804154550 2024-01-22T05:14:32.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.887+0000 7f07fbe00700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07dc05a510 0x7f07dc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:32.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.887+0000 7f07fbe00700 1 -- 172.21.15.49:0/3778022136 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f07fc074a10 con 0x7f0804154550 2024-01-22T05:14:32.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.887+0000 7f0808c00700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07dc05a510 0x7f07dc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:32.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.891+0000 7f0808c00700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07dc05a510 0x7f07dc05c9d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f07f400f640 tx=0x7f07f4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:32.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:32.895+0000 7f07fbe00700 1 -- 172.21.15.49:0/3778022136 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f08040691e0 con 0x7f0804154550 2024-01-22T05:14:33.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.103+0000 7f080a000700 1 -- 172.21.15.49:0/3778022136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08040691e0 con 0x7f0804154550 2024-01-22T05:14:33.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.107+0000 7f07fbe00700 1 -- 172.21.15.49:0/3778022136 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f08040691e0 con 0x7f0804154550 2024-01-22T05:14:33.109 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:33.109 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:14:33.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.111+0000 7f080a000700 1 -- 172.21.15.49:0/3778022136 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07dc05a510 msgr2=0x7f07dc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:33.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.111+0000 7f080a000700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07dc05a510 0x7f07dc05c9d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f07f400f640 tx=0x7f07f4017000).stop 2024-01-22T05:14:33.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.111+0000 7f080a000700 1 -- 172.21.15.49:0/3778022136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0804154550 msgr2=0x7f0804151f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:33.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.111+0000 7f080a000700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0804154550 0x7f0804151f80 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f07fc00c730 tx=0x7f07fc001520).stop 2024-01-22T05:14:33.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.111+0000 7f080a000700 1 -- 172.21.15.49:0/3778022136 shutdown_connections 2024-01-22T05:14:33.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.111+0000 7f080a000700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07dc05a510 0x7f07dc05c9d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:33.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.111+0000 7f080a000700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0804154550 0x7f0804151f80 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:33.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.111+0000 7f080a000700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08040be050 0x7f08040ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:33.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.111+0000 7f080a000700 1 --2- 172.21.15.49:0/3778022136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0804068b30 0x7f0804168470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:33.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.111+0000 7f080a000700 1 -- 172.21.15.49:0/3778022136 >> 172.21.15.49:0/3778022136 conn(0x7f08040c86e0 msgr2=0x7f0804063390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:33.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.111+0000 7f080a000700 1 -- 172.21.15.49:0/3778022136 shutdown_connections 2024-01-22T05:14:33.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.111+0000 7f080a000700 1 -- 172.21.15.49:0/3778022136 wait complete. 2024-01-22T05:14:33.118 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:14:33.134 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-01-22T05:14:33.134 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:14:33.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.299+0000 7fdf4ca00700 1 Processor -- start 2024-01-22T05:14:33.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.299+0000 7fdf4ca00700 1 -- start start 2024-01-22T05:14:33.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.303+0000 7fdf4ca00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdf44064950 0x7fdf440bd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:33.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.303+0000 7fdf4ca00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf440c2700 con 0x7fdf44065660 2024-01-22T05:14:33.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.303+0000 7fdf4ca00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf440a7650 con 0x7fdf440644f0 2024-01-22T05:14:33.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.303+0000 7fdf4ca00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf440c2930 con 0x7fdf44064950 2024-01-22T05:14:33.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.303+0000 7fdf4a000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdf44065660 0x7fdf440a6f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48442/0 (socket says 172.21.15.49:48442) 2024-01-22T05:14:33.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.303+0000 7fdf4a000700 1 -- 172.21.15.49:0/2168989309 learned_addr learned my addr 172.21.15.49:0/2168989309 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:33.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.303+0000 7fdf4b400700 1 --2- 172.21.15.49:0/2168989309 >> v2:172.21.15.49:3300/0 conn(0x7fdf44064950 0x7fdf440bd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:33.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.303+0000 7fdf48c00700 1 -- 172.21.15.49:0/2168989309 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978870874 0 0) 0x7fdf440c2700 con 0x7fdf44065660 2024-01-22T05:14:33.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.303+0000 7fdf48c00700 1 -- 172.21.15.49:0/2168989309 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf240033f0 con 0x7fdf44065660 2024-01-22T05:14:33.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.303+0000 7fdf4b400700 1 -- 172.21.15.49:0/2168989309 >> v1:172.21.15.110:6789/0 conn(0x7fdf440644f0 legacy=0x7fdf440bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:33.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.303+0000 7fdf4b400700 1 -- 172.21.15.49:0/2168989309 >> v1:172.21.15.49:6789/0 conn(0x7fdf44065660 legacy=0x7fdf440a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:33.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.303+0000 7fdf4b400700 1 -- 172.21.15.49:0/2168989309 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf440c2c10 con 0x7fdf44064950 2024-01-22T05:14:33.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.303+0000 7fdf4b400700 1 --2- 172.21.15.49:0/2168989309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf44064950 0x7fdf440bd390 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7fdf3c009e60 tx=0x7fdf3c009780).ready entity=mon.0 client_cookie=d80e2580b14b4866 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:33.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.303+0000 7fdf48c00700 1 -- 172.21.15.49:0/2168989309 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c00e070 con 0x7fdf44064950 2024-01-22T05:14:33.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.307+0000 7fdf48c00700 1 -- 172.21.15.49:0/2168989309 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3c00bb60 con 0x7fdf44064950 2024-01-22T05:14:33.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.307+0000 7fdf48c00700 1 -- 172.21.15.49:0/2168989309 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c012410 con 0x7fdf44064950 2024-01-22T05:14:33.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.307+0000 7fdf4ca00700 1 -- 172.21.15.49:0/2168989309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf44064950 msgr2=0x7fdf440bd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:33.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.307+0000 7fdf4ca00700 1 --2- 172.21.15.49:0/2168989309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf44064950 0x7fdf440bd390 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7fdf3c009e60 tx=0x7fdf3c009780).stop 2024-01-22T05:14:33.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.307+0000 7fdf4ca00700 1 -- 172.21.15.49:0/2168989309 shutdown_connections 2024-01-22T05:14:33.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.307+0000 7fdf4ca00700 1 --2- 172.21.15.49:0/2168989309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf44064950 0x7fdf440bd390 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:33.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.307+0000 7fdf4ca00700 1 -- 172.21.15.49:0/2168989309 >> 172.21.15.49:0/2168989309 conn(0x7fdf440c87f0 msgr2=0x7fdf440c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:33.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.307+0000 7fdf4ca00700 1 -- 172.21.15.49:0/2168989309 shutdown_connections 2024-01-22T05:14:33.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.307+0000 7fdf4ca00700 1 -- 172.21.15.49:0/2168989309 wait complete. 2024-01-22T05:14:33.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4ca00700 1 Processor -- start 2024-01-22T05:14:33.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4ca00700 1 -- start start 2024-01-22T05:14:33.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf440644f0 0x7fdf441640c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:33.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4ca00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf44064950 0x7fdf440c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:33.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4ca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf44065660 0x7fdf44148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:33.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4ca00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440aae00 con 0x7fdf440644f0 2024-01-22T05:14:33.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4ca00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44164740 con 0x7fdf44064950 2024-01-22T05:14:33.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4ca00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44164a20 con 0x7fdf44065660 2024-01-22T05:14:33.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf440644f0 0x7fdf441640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:33.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf440644f0 0x7fdf441640c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60714/0 (socket says 172.21.15.49:60714) 2024-01-22T05:14:33.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4a000700 1 -- 172.21.15.49:0/709630930 learned_addr learned my addr 172.21.15.49:0/709630930 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:33.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4b400700 1 --2- 172.21.15.49:0/709630930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf44065660 0x7fdf44148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:33.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf49600700 1 --2- 172.21.15.49:0/709630930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf44064950 0x7fdf440c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:33.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4a000700 1 -- 172.21.15.49:0/709630930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf44065660 msgr2=0x7fdf44148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:33.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4a000700 1 --2- 172.21.15.49:0/709630930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf44065660 0x7fdf44148340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:33.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4a000700 1 -- 172.21.15.49:0/709630930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf44064950 msgr2=0x7fdf440c1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:33.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.311+0000 7fdf4a000700 1 --2- 172.21.15.49:0/709630930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf44064950 0x7fdf440c1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:33.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.315+0000 7fdf4a000700 1 -- 172.21.15.49:0/709630930 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c009a20 con 0x7fdf440644f0 2024-01-22T05:14:33.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.315+0000 7fdf4a000700 1 --2- 172.21.15.49:0/709630930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf440644f0 0x7fdf441640c0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7fdf3400c420 tx=0x7fdf34007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:33.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.315+0000 7fdf41600700 1 -- 172.21.15.49:0/709630930 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf340070d0 con 0x7fdf440644f0 2024-01-22T05:14:33.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.315+0000 7fdf41600700 1 -- 172.21.15.49:0/709630930 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf34007230 con 0x7fdf440644f0 2024-01-22T05:14:33.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.315+0000 7fdf4ca00700 1 -- 172.21.15.49:0/709630930 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf44164d00 con 0x7fdf440644f0 2024-01-22T05:14:33.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.315+0000 7fdf41600700 1 -- 172.21.15.49:0/709630930 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf340075b0 con 0x7fdf440644f0 2024-01-22T05:14:33.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.315+0000 7fdf4ca00700 1 -- 172.21.15.49:0/709630930 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf440c1f40 con 0x7fdf440644f0 2024-01-22T05:14:33.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.315+0000 7fdf4ca00700 1 -- 172.21.15.49:0/709630930 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf44047060 con 0x7fdf440644f0 2024-01-22T05:14:33.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.319+0000 7fdf41600700 1 -- 172.21.15.49:0/709630930 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdf340059b0 con 0x7fdf440644f0 2024-01-22T05:14:33.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.319+0000 7fdf41600700 1 --2- 172.21.15.49:0/709630930 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf1c05a540 0x7fdf1c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:33.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.319+0000 7fdf41600700 1 -- 172.21.15.49:0/709630930 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fdf340740b0 con 0x7fdf440644f0 2024-01-22T05:14:33.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.319+0000 7fdf49600700 1 --2- 172.21.15.49:0/709630930 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf1c05a540 0x7fdf1c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:33.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.319+0000 7fdf49600700 1 --2- 172.21.15.49:0/709630930 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf1c05a540 0x7fdf1c05ca00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fdf440abf70 tx=0x7fdf2c007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:33.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.323+0000 7fdf41600700 1 -- 172.21.15.49:0/709630930 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdf34047680 con 0x7fdf440644f0 2024-01-22T05:14:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.543+0000 7fdf4ca00700 1 -- 172.21.15.49:0/709630930 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdf440c2ef0 con 0x7fdf440644f0 2024-01-22T05:14:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.543+0000 7fdf41600700 1 -- 172.21.15.49:0/709630930 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2289 (secure 0 0 0) 0x7fdf3404aca0 con 0x7fdf440644f0 2024-01-22T05:14:33.546 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:33.546 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 18/2092 objects degraded (0.860%), 1 pg degraded","count":1},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":617,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":134},{"state_name":"active+recovering","count":1},{"state_name":"activating","count":1},{"state_name":"active+recovery_wait+degraded","count":1}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075835141,"bytes_used":4661198848,"bytes_avail":768432914432,"bytes_total":773094113280,"inactive_pgs_ratio":0.0072992700152099133,"degraded_objects":18,"degraded_total":2092,"degraded_ratio":0.0086042065009560229,"misplaced_objects":4,"misplaced_total":2092,"misplaced_ratio":0.0019120458891013384,"recovering_objects_per_sec":1,"recovering_bytes_per_sec":1179147,"recovering_keys_per_sec":0,"num_objects_recovered":9,"num_bytes_recovered":9437184,"num_keys_recovered":0,"write_bytes_sec":2400645,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":98,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7743}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-01-22T05:14:29.453337+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:14:33.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.547+0000 7fdf4ca00700 1 -- 172.21.15.49:0/709630930 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf1c05a540 msgr2=0x7fdf1c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:33.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.547+0000 7fdf4ca00700 1 --2- 172.21.15.49:0/709630930 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf1c05a540 0x7fdf1c05ca00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fdf440abf70 tx=0x7fdf2c007d40).stop 2024-01-22T05:14:33.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.547+0000 7fdf4ca00700 1 -- 172.21.15.49:0/709630930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf440644f0 msgr2=0x7fdf441640c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:33.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.547+0000 7fdf4ca00700 1 --2- 172.21.15.49:0/709630930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf440644f0 0x7fdf441640c0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7fdf3400c420 tx=0x7fdf34007c80).stop 2024-01-22T05:14:33.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.547+0000 7fdf4ca00700 1 -- 172.21.15.49:0/709630930 shutdown_connections 2024-01-22T05:14:33.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.547+0000 7fdf4ca00700 1 --2- 172.21.15.49:0/709630930 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdf1c05a540 0x7fdf1c05ca00 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:33.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.547+0000 7fdf4ca00700 1 --2- 172.21.15.49:0/709630930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf44065660 0x7fdf44148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:33.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.547+0000 7fdf4ca00700 1 --2- 172.21.15.49:0/709630930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf44064950 0x7fdf440c1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:33.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.547+0000 7fdf4ca00700 1 --2- 172.21.15.49:0/709630930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf440644f0 0x7fdf441640c0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:33.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.547+0000 7fdf4ca00700 1 -- 172.21.15.49:0/709630930 >> 172.21.15.49:0/709630930 conn(0x7fdf440c87f0 msgr2=0x7fdf440a5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:33.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.547+0000 7fdf4ca00700 1 -- 172.21.15.49:0/709630930 shutdown_connections 2024-01-22T05:14:33.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:33.547+0000 7fdf4ca00700 1 -- 172.21.15.49:0/709630930 wait complete. 2024-01-22T05:14:33.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'b': 'paused'} 2024-01-22T05:14:34.573 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:14:34.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.747+0000 7fe370000700 1 Processor -- start 2024-01-22T05:14:34.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.751+0000 7fe370000700 1 -- start start 2024-01-22T05:14:34.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.751+0000 7fe370000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe368155d20 0x7fe368065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:34.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.751+0000 7fe370000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3680a8e50 0x7fe3680c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:34.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe370000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3680c1a40 con 0x7fe368066070 2024-01-22T05:14:34.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe370000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe368159310 con 0x7fe3680a8e50 2024-01-22T05:14:34.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe370000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3680c13f0 con 0x7fe368155d20 2024-01-22T05:14:34.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe36e000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3680a8e50 0x7fe3680c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:34.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe36d600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe368155d20 0x7fe368065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:34.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe36e000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3680a8e50 0x7fe3680c1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:35756/0 (socket says 172.21.15.49:35756) 2024-01-22T05:14:34.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe36e000700 1 -- 172.21.15.49:0/253214863 learned_addr learned my addr 172.21.15.49:0/253214863 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:34.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe36cc00700 1 --1- 172.21.15.49:0/253214863 >> v1:172.21.15.110:6789/0 conn(0x7fe368066070 0x7fe3680a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:51682/0 (socket says 172.21.15.49:51682) 2024-01-22T05:14:34.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe367e00700 1 -- 172.21.15.49:0/253214863 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 883148564 0 0) 0x7fe3680c1a40 con 0x7fe368066070 2024-01-22T05:14:34.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe36d600700 1 -- 172.21.15.49:0/253214863 >> v2:172.21.15.110:3300/0 conn(0x7fe3680a8e50 msgr2=0x7fe3680c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:34.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe36d600700 1 --2- 172.21.15.49:0/253214863 >> v2:172.21.15.110:3300/0 conn(0x7fe3680a8e50 0x7fe3680c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:34.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe36d600700 1 -- 172.21.15.49:0/253214863 >> v1:172.21.15.110:6789/0 conn(0x7fe368066070 legacy=0x7fe3680a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:34.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe36d600700 1 -- 172.21.15.49:0/253214863 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3680c16d0 con 0x7fe368155d20 2024-01-22T05:14:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe36d600700 1 --2- 172.21.15.49:0/253214863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe368155d20 0x7fe368065b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fe358009760 tx=0x7fe358009060).ready entity=mon.2 client_cookie=3b947750b1f9b0d4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:34.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe367e00700 1 -- 172.21.15.49:0/253214863 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35800f510 con 0x7fe368155d20 2024-01-22T05:14:34.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe367e00700 1 -- 172.21.15.49:0/253214863 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35800f670 con 0x7fe368155d20 2024-01-22T05:14:34.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.755+0000 7fe367e00700 1 -- 172.21.15.49:0/253214863 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35800f9f0 con 0x7fe368155d20 2024-01-22T05:14:34.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.759+0000 7fe370000700 1 -- 172.21.15.49:0/253214863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe368155d20 msgr2=0x7fe368065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:34.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.759+0000 7fe370000700 1 --2- 172.21.15.49:0/253214863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe368155d20 0x7fe368065b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fe358009760 tx=0x7fe358009060).stop 2024-01-22T05:14:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.759+0000 7fe370000700 1 -- 172.21.15.49:0/253214863 shutdown_connections 2024-01-22T05:14:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.759+0000 7fe370000700 1 --2- 172.21.15.49:0/253214863 >> v2:172.21.15.110:3300/0 conn(0x7fe3680a8e50 0x7fe3680c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.759+0000 7fe370000700 1 --2- 172.21.15.49:0/253214863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe368155d20 0x7fe368065b80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.759+0000 7fe370000700 1 -- 172.21.15.49:0/253214863 >> 172.21.15.49:0/253214863 conn(0x7fe3680c6540 msgr2=0x7fe3680c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.759+0000 7fe370000700 1 -- 172.21.15.49:0/253214863 shutdown_connections 2024-01-22T05:14:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.759+0000 7fe370000700 1 -- 172.21.15.49:0/253214863 wait complete. 2024-01-22T05:14:34.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.763+0000 7fe370000700 1 Processor -- start 2024-01-22T05:14:34.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.763+0000 7fe370000700 1 -- start start 2024-01-22T05:14:34.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe370000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe368066070 0x7fe36813e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:34.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe370000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3680a8e50 0x7fe3680c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:34.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe370000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe368155d20 0x7fe3680c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:34.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe370000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3680c3c80 con 0x7fe3680a8e50 2024-01-22T05:14:34.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe370000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe368169660 con 0x7fe368155d20 2024-01-22T05:14:34.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe370000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36813eca0 con 0x7fe368066070 2024-01-22T05:14:34.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe36cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3680a8e50 0x7fe3680c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:34.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe36cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3680a8e50 0x7fe3680c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60716/0 (socket says 172.21.15.49:60716) 2024-01-22T05:14:34.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe36cc00700 1 -- 172.21.15.49:0/1647916650 learned_addr learned my addr 172.21.15.49:0/1647916650 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:34.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe36d600700 1 --2- 172.21.15.49:0/1647916650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe368066070 0x7fe36813e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:34.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe36e000700 1 --2- 172.21.15.49:0/1647916650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe368155d20 0x7fe3680c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:34.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe36cc00700 1 -- 172.21.15.49:0/1647916650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe368066070 msgr2=0x7fe36813e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:34.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe36cc00700 1 --2- 172.21.15.49:0/1647916650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe368066070 0x7fe36813e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:34.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe36cc00700 1 -- 172.21.15.49:0/1647916650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe368155d20 msgr2=0x7fe3680c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:34.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe36cc00700 1 --2- 172.21.15.49:0/1647916650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe368155d20 0x7fe3680c3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:34.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe36cc00700 1 -- 172.21.15.49:0/1647916650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3580092a0 con 0x7fe3680a8e50 2024-01-22T05:14:34.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe36cc00700 1 --2- 172.21.15.49:0/1647916650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3680a8e50 0x7fe3680c32a0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7fe35000c4e0 tx=0x7fe350007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:34.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe364c00700 1 -- 172.21.15.49:0/1647916650 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35000ce50 con 0x7fe3680a8e50 2024-01-22T05:14:34.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe364c00700 1 -- 172.21.15.49:0/1647916650 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3500072e0 con 0x7fe3680a8e50 2024-01-22T05:14:34.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe364c00700 1 -- 172.21.15.49:0/1647916650 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3500056e0 con 0x7fe3680a8e50 2024-01-22T05:14:34.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe370000700 1 -- 172.21.15.49:0/1647916650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3680bfc60 con 0x7fe3680a8e50 2024-01-22T05:14:34.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.767+0000 7fe370000700 1 -- 172.21.15.49:0/1647916650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3680c0220 con 0x7fe3680a8e50 2024-01-22T05:14:34.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.771+0000 7fe370000700 1 -- 172.21.15.49:0/1647916650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe368169810 con 0x7fe3680a8e50 2024-01-22T05:14:34.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.771+0000 7fe364c00700 1 -- 172.21.15.49:0/1647916650 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe350005ad0 con 0x7fe3680a8e50 2024-01-22T05:14:34.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.771+0000 7fe364c00700 1 --2- 172.21.15.49:0/1647916650 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe34005a510 0x7fe34005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:34.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.771+0000 7fe364c00700 1 -- 172.21.15.49:0/1647916650 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fe350074060 con 0x7fe3680a8e50 2024-01-22T05:14:34.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.775+0000 7fe36d600700 1 --2- 172.21.15.49:0/1647916650 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe34005a510 0x7fe34005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:34.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.775+0000 7fe36d600700 1 --2- 172.21.15.49:0/1647916650 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe34005a510 0x7fe34005c9d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fe36815b050 tx=0x7fe358017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:34.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.779+0000 7fe364c00700 1 -- 172.21.15.49:0/1647916650 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe368169810 con 0x7fe3680a8e50 2024-01-22T05:14:34.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.975+0000 7fe370000700 1 -- 172.21.15.49:0/1647916650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3681697d0 con 0x7fe3680a8e50 2024-01-22T05:14:34.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.979+0000 7fe364c00700 1 -- 172.21.15.49:0/1647916650 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fe350047670 con 0x7fe3680a8e50 2024-01-22T05:14:34.980 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:34.980 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:14:34.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.983+0000 7fe370000700 1 -- 172.21.15.49:0/1647916650 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe34005a510 msgr2=0x7fe34005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:34.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.983+0000 7fe370000700 1 --2- 172.21.15.49:0/1647916650 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe34005a510 0x7fe34005c9d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fe36815b050 tx=0x7fe358017000).stop 2024-01-22T05:14:34.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.983+0000 7fe370000700 1 -- 172.21.15.49:0/1647916650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3680a8e50 msgr2=0x7fe3680c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:34.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.983+0000 7fe370000700 1 --2- 172.21.15.49:0/1647916650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3680a8e50 0x7fe3680c32a0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7fe35000c4e0 tx=0x7fe350007c60).stop 2024-01-22T05:14:34.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.983+0000 7fe370000700 1 -- 172.21.15.49:0/1647916650 shutdown_connections 2024-01-22T05:14:34.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.983+0000 7fe370000700 1 --2- 172.21.15.49:0/1647916650 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe34005a510 0x7fe34005c9d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:34.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.983+0000 7fe370000700 1 --2- 172.21.15.49:0/1647916650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe368155d20 0x7fe3680c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:34.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.983+0000 7fe370000700 1 --2- 172.21.15.49:0/1647916650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3680a8e50 0x7fe3680c32a0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:34.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.983+0000 7fe370000700 1 --2- 172.21.15.49:0/1647916650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe368066070 0x7fe36813e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:34.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.983+0000 7fe370000700 1 -- 172.21.15.49:0/1647916650 >> 172.21.15.49:0/1647916650 conn(0x7fe3680c6540 msgr2=0x7fe3680c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:34.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.983+0000 7fe370000700 1 -- 172.21.15.49:0/1647916650 shutdown_connections 2024-01-22T05:14:34.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:34.983+0000 7fe370000700 1 -- 172.21.15.49:0/1647916650 wait complete. 2024-01-22T05:14:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:14:35.008 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-01-22T05:14:35.009 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:14:35.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.167+0000 7f5171600700 1 Processor -- start 2024-01-22T05:14:35.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.171+0000 7f5171600700 1 -- start start 2024-01-22T05:14:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.171+0000 7f5171600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f516c066fb0 0x7f516c0c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.171+0000 7f5171600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f516c0a8b10 0x7f516c157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.171+0000 7f5171600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f516c0c1ee0 con 0x7f516c0a8f90 2024-01-22T05:14:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.171+0000 7f5171600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516c0c12f0 con 0x7f516c0a8b10 2024-01-22T05:14:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.171+0000 7f5171600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516c0c15b0 con 0x7f516c066fb0 2024-01-22T05:14:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.175+0000 7f516aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f516c066fb0 0x7f516c0c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.175+0000 7f516a000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f516c0a8b10 0x7f516c157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.175+0000 7f516aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f516c066fb0 0x7f516c0c2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:48582/0 (socket says 172.21.15.49:48582) 2024-01-22T05:14:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.175+0000 7f516aa00700 1 -- 172.21.15.49:0/1480451629 learned_addr learned my addr 172.21.15.49:0/1480451629 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.175+0000 7f516a000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f516c0a8b10 0x7f516c157740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:35772/0 (socket says 172.21.15.49:35772) 2024-01-22T05:14:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.175+0000 7f516aa00700 1 -- 172.21.15.49:0/1480451629 >> v2:172.21.15.110:3300/0 conn(0x7f516c0a8b10 msgr2=0x7f516c157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:35.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.175+0000 7f516aa00700 1 --2- 172.21.15.49:0/1480451629 >> v2:172.21.15.110:3300/0 conn(0x7f516c0a8b10 0x7f516c157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:35.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.175+0000 7f516aa00700 1 -- 172.21.15.49:0/1480451629 >> v1:172.21.15.110:6789/0 conn(0x7f516c0a8f90 legacy=0x7f516c065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:35.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.175+0000 7f516aa00700 1 -- 172.21.15.49:0/1480451629 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c0c1890 con 0x7f516c066fb0 2024-01-22T05:14:35.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.175+0000 7f516aa00700 1 --2- 172.21.15.49:0/1480451629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f516c066fb0 0x7f516c0c2370 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f515c009830 tx=0x7f515c0090f0).ready entity=mon.2 client_cookie=56341e9796b9bd50 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:35.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.175+0000 7f5169600700 1 -- 172.21.15.49:0/1480451629 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c00b580 con 0x7f516c066fb0 2024-01-22T05:14:35.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.175+0000 7f5169600700 1 -- 172.21.15.49:0/1480451629 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c00b6e0 con 0x7f516c066fb0 2024-01-22T05:14:35.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.175+0000 7f5169600700 1 -- 172.21.15.49:0/1480451629 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c00ba60 con 0x7f516c066fb0 2024-01-22T05:14:35.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.175+0000 7f5171600700 1 -- 172.21.15.49:0/1480451629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f516c066fb0 msgr2=0x7f516c0c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.175+0000 7f5171600700 1 --2- 172.21.15.49:0/1480451629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f516c066fb0 0x7f516c0c2370 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f515c009830 tx=0x7f515c0090f0).stop 2024-01-22T05:14:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.179+0000 7f5171600700 1 -- 172.21.15.49:0/1480451629 shutdown_connections 2024-01-22T05:14:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.179+0000 7f5171600700 1 --2- 172.21.15.49:0/1480451629 >> v2:172.21.15.110:3300/0 conn(0x7f516c0a8b10 0x7f516c157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.179+0000 7f5171600700 1 --2- 172.21.15.49:0/1480451629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f516c066fb0 0x7f516c0c2370 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.179+0000 7f5171600700 1 -- 172.21.15.49:0/1480451629 >> 172.21.15.49:0/1480451629 conn(0x7f516c0c6540 msgr2=0x7f516c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:35.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.179+0000 7f5171600700 1 -- 172.21.15.49:0/1480451629 shutdown_connections 2024-01-22T05:14:35.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.179+0000 7f5171600700 1 -- 172.21.15.49:0/1480451629 wait complete. 2024-01-22T05:14:35.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.179+0000 7f5171600700 1 Processor -- start 2024-01-22T05:14:35.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.183+0000 7f5171600700 1 -- start start 2024-01-22T05:14:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.183+0000 7f5171600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f516c066fb0 0x7f516c145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.183+0000 7f5171600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c0a8b10 0x7f516c0abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.183+0000 7f5171600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f516c0a8f90 0x7f516c0ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.183+0000 7f5171600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c0ac590 con 0x7f516c0a8b10 2024-01-22T05:14:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.183+0000 7f5171600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c0a9c30 con 0x7f516c066fb0 2024-01-22T05:14:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.183+0000 7f5171600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516c0a9650 con 0x7f516c0a8f90 2024-01-22T05:14:35.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.183+0000 7f516a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c0a8b10 0x7f516c0abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:35.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.183+0000 7f516a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c0a8b10 0x7f516c0abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60730/0 (socket says 172.21.15.49:60730) 2024-01-22T05:14:35.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.183+0000 7f516a000700 1 -- 172.21.15.49:0/1721623783 learned_addr learned my addr 172.21.15.49:0/1721623783 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:35.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.183+0000 7f516aa00700 1 --2- 172.21.15.49:0/1721623783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f516c066fb0 0x7f516c145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:35.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.183+0000 7f516b400700 1 --2- 172.21.15.49:0/1721623783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f516c0a8f90 0x7f516c0ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:35.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.187+0000 7f516a000700 1 -- 172.21.15.49:0/1721623783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f516c0a8f90 msgr2=0x7f516c0ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:35.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.187+0000 7f516a000700 1 --2- 172.21.15.49:0/1721623783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f516c0a8f90 0x7f516c0ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:35.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.187+0000 7f516a000700 1 -- 172.21.15.49:0/1721623783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f516c066fb0 msgr2=0x7f516c145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:35.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.187+0000 7f516a000700 1 --2- 172.21.15.49:0/1721623783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f516c066fb0 0x7f516c145930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:35.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.187+0000 7f516a000700 1 -- 172.21.15.49:0/1721623783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c009370 con 0x7f516c0a8b10 2024-01-22T05:14:35.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.187+0000 7f516b400700 1 --2- 172.21.15.49:0/1721623783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f516c0a8f90 0x7f516c0ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:35.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.187+0000 7f516a000700 1 --2- 172.21.15.49:0/1721623783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c0a8b10 0x7f516c0abbb0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f515400e930 tx=0x7f5154009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:35.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.187+0000 7f5162000700 1 -- 172.21.15.49:0/1721623783 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515400c670 con 0x7f516c0a8b10 2024-01-22T05:14:35.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.187+0000 7f5162000700 1 -- 172.21.15.49:0/1721623783 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515400c7d0 con 0x7f516c0a8b10 2024-01-22T05:14:35.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.187+0000 7f5162000700 1 -- 172.21.15.49:0/1721623783 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515400cb50 con 0x7f516c0a8b10 2024-01-22T05:14:35.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.187+0000 7f5171600700 1 -- 172.21.15.49:0/1721623783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516c0be640 con 0x7f516c0a8b10 2024-01-22T05:14:35.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.187+0000 7f5171600700 1 -- 172.21.15.49:0/1721623783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516c0be920 con 0x7f516c0a8b10 2024-01-22T05:14:35.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.187+0000 7f5171600700 1 -- 172.21.15.49:0/1721623783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516c0a9de0 con 0x7f516c0a8b10 2024-01-22T05:14:35.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.191+0000 7f5162000700 1 -- 172.21.15.49:0/1721623783 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f515401b400 con 0x7f516c0a8b10 2024-01-22T05:14:35.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.191+0000 7f5162000700 1 --2- 172.21.15.49:0/1721623783 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f514405a510 0x7f514405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:35.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.191+0000 7f5162000700 1 -- 172.21.15.49:0/1721623783 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f5154074ec0 con 0x7f516c0a8b10 2024-01-22T05:14:35.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.191+0000 7f516aa00700 1 --2- 172.21.15.49:0/1721623783 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f514405a510 0x7f514405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:35.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.191+0000 7f516aa00700 1 --2- 172.21.15.49:0/1721623783 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f514405a510 0x7f514405c9d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f516c069290 tx=0x7f515c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:35.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.199+0000 7f5162000700 1 -- 172.21.15.49:0/1721623783 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f516c0a9de0 con 0x7f516c0a8b10 2024-01-22T05:14:35.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.419+0000 7f5171600700 1 -- 172.21.15.49:0/1721623783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f516c0a9de0 con 0x7f516c0a8b10 2024-01-22T05:14:35.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.419+0000 7f5162000700 1 -- 172.21.15.49:0/1721623783 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1777 (secure 0 0 0) 0x7f516c0a9de0 con 0x7f516c0a8b10 2024-01-22T05:14:35.421 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:35.421 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":619,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1078,"data_bytes":1075911620,"bytes_used":4665647104,"bytes_avail":768428466176,"bytes_total":773094113280,"recovering_objects_per_sec":3,"recovering_bytes_per_sec":4061678,"recovering_keys_per_sec":0,"num_objects_recovered":31,"num_bytes_recovered":32505856,"num_keys_recovered":0,"write_bytes_sec":2485832,"read_op_per_sec":0,"write_op_per_sec":262},"fsmap":{"epoch":98,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7743}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-01-22T05:14:29.453337+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:14:35.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.423+0000 7f5171600700 1 -- 172.21.15.49:0/1721623783 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f514405a510 msgr2=0x7f514405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:35.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.423+0000 7f5171600700 1 --2- 172.21.15.49:0/1721623783 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f514405a510 0x7f514405c9d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f516c069290 tx=0x7f515c017000).stop 2024-01-22T05:14:35.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.423+0000 7f5171600700 1 -- 172.21.15.49:0/1721623783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c0a8b10 msgr2=0x7f516c0abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:35.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.423+0000 7f5171600700 1 --2- 172.21.15.49:0/1721623783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c0a8b10 0x7f516c0abbb0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f515400e930 tx=0x7f5154009060).stop 2024-01-22T05:14:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.423+0000 7f5171600700 1 -- 172.21.15.49:0/1721623783 shutdown_connections 2024-01-22T05:14:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.423+0000 7f5171600700 1 --2- 172.21.15.49:0/1721623783 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f514405a510 0x7f514405c9d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.423+0000 7f5171600700 1 --2- 172.21.15.49:0/1721623783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f516c0a8f90 0x7f516c0ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.423+0000 7f5171600700 1 --2- 172.21.15.49:0/1721623783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f516c0a8b10 0x7f516c0abbb0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.423+0000 7f5171600700 1 --2- 172.21.15.49:0/1721623783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f516c066fb0 0x7f516c145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.423+0000 7f5171600700 1 -- 172.21.15.49:0/1721623783 >> 172.21.15.49:0/1721623783 conn(0x7f516c0c6540 msgr2=0x7f516c0bbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.423+0000 7f5171600700 1 -- 172.21.15.49:0/1721623783 shutdown_connections 2024-01-22T05:14:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:35.423+0000 7f5171600700 1 -- 172.21.15.49:0/1721623783 wait complete. 2024-01-22T05:14:35.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'b': 'paused'} 2024-01-22T05:14:36.450 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:14:36.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.615+0000 7fc786c00700 1 Processor -- start 2024-01-22T05:14:36.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.615+0000 7fc786c00700 1 -- start start 2024-01-22T05:14:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc786c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc7800c3690 0x7fc7800c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc786c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc780155550 0x7fc7801559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc786c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7800bdc10 con 0x7fc780067a90 2024-01-22T05:14:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc786c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7800c3f60 con 0x7fc780155550 2024-01-22T05:14:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc786c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc780155ea0 con 0x7fc7800c3690 2024-01-22T05:14:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc77f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc780155550 0x7fc7801559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc77f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc780155550 0x7fc7801559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60744/0 (socket says 172.21.15.49:60744) 2024-01-22T05:14:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc77f400700 1 -- 172.21.15.49:0/1304993139 learned_addr learned my addr 172.21.15.49:0/1304993139 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc77fe00700 1 --2- 172.21.15.49:0/1304993139 >> v2:172.21.15.110:3300/0 conn(0x7fc7800c3690 0x7fc7800c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc77f400700 1 -- 172.21.15.49:0/1304993139 >> v2:172.21.15.110:3300/0 conn(0x7fc7800c3690 msgr2=0x7fc7800c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc77f400700 1 --2- 172.21.15.49:0/1304993139 >> v2:172.21.15.110:3300/0 conn(0x7fc7800c3690 0x7fc7800c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc77f400700 1 -- 172.21.15.49:0/1304993139 >> v1:172.21.15.110:6789/0 conn(0x7fc780067a90 legacy=0x7fc780067f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc77f400700 1 -- 172.21.15.49:0/1304993139 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc780068e10 con 0x7fc780155550 2024-01-22T05:14:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc77f400700 1 --2- 172.21.15.49:0/1304993139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc780155550 0x7fc7801559b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fc7800c5e00 tx=0x7fc7680090f0).ready entity=mon.0 client_cookie=a0b9d09f8b7a9ea9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc77ea00700 1 -- 172.21.15.49:0/1304993139 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76800b520 con 0x7fc780155550 2024-01-22T05:14:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc77ea00700 1 -- 172.21.15.49:0/1304993139 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76800b680 con 0x7fc780155550 2024-01-22T05:14:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.619+0000 7fc77ea00700 1 -- 172.21.15.49:0/1304993139 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76800ba00 con 0x7fc780155550 2024-01-22T05:14:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.623+0000 7fc786c00700 1 -- 172.21.15.49:0/1304993139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc780155550 msgr2=0x7fc7801559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.623+0000 7fc786c00700 1 --2- 172.21.15.49:0/1304993139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc780155550 0x7fc7801559b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fc7800c5e00 tx=0x7fc7680090f0).stop 2024-01-22T05:14:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.623+0000 7fc786c00700 1 -- 172.21.15.49:0/1304993139 shutdown_connections 2024-01-22T05:14:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.623+0000 7fc786c00700 1 --2- 172.21.15.49:0/1304993139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc780155550 0x7fc7801559b0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.623+0000 7fc786c00700 1 --2- 172.21.15.49:0/1304993139 >> v2:172.21.15.110:3300/0 conn(0x7fc7800c3690 0x7fc7800c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.623+0000 7fc786c00700 1 -- 172.21.15.49:0/1304993139 >> 172.21.15.49:0/1304993139 conn(0x7fc7800c51c0 msgr2=0x7fc7800c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.623+0000 7fc786c00700 1 -- 172.21.15.49:0/1304993139 shutdown_connections 2024-01-22T05:14:36.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.623+0000 7fc786c00700 1 -- 172.21.15.49:0/1304993139 wait complete. 2024-01-22T05:14:36.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.623+0000 7fc786c00700 1 Processor -- start 2024-01-22T05:14:36.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc786c00700 1 -- start start 2024-01-22T05:14:36.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc786c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc780067a90 0x7fc7800c0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:36.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc786c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7800c3690 0x7fc7800abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:36.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc786c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc780155550 0x7fc780154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:36.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc786c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc780154f30 con 0x7fc780155550 2024-01-22T05:14:36.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc786c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800c25b0 con 0x7fc7800c3690 2024-01-22T05:14:36.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc786c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800c0d50 con 0x7fc780067a90 2024-01-22T05:14:36.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc784c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc780155550 0x7fc780154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:36.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc784c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc780155550 0x7fc780154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60754/0 (socket says 172.21.15.49:60754) 2024-01-22T05:14:36.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc784c00700 1 -- 172.21.15.49:0/4224455809 learned_addr learned my addr 172.21.15.49:0/4224455809 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:36.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc77fe00700 1 --2- 172.21.15.49:0/4224455809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc780067a90 0x7fc7800c0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:36.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc77f400700 1 --2- 172.21.15.49:0/4224455809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7800c3690 0x7fc7800abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:36.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc784c00700 1 -- 172.21.15.49:0/4224455809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc780067a90 msgr2=0x7fc7800c0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:36.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc784c00700 1 --2- 172.21.15.49:0/4224455809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc780067a90 0x7fc7800c0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:36.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc784c00700 1 -- 172.21.15.49:0/4224455809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7800c3690 msgr2=0x7fc7800abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:36.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc784c00700 1 --2- 172.21.15.49:0/4224455809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7800c3690 0x7fc7800abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:36.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc784c00700 1 -- 172.21.15.49:0/4224455809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc768009370 con 0x7fc780155550 2024-01-22T05:14:36.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc77fe00700 1 --2- 172.21.15.49:0/4224455809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc780067a90 0x7fc7800c0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:36.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc784c00700 1 --2- 172.21.15.49:0/4224455809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc780155550 0x7fc780154a40 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7fc77800c790 tx=0x7fc7780015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:36.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc777400700 1 -- 172.21.15.49:0/4224455809 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778010510 con 0x7fc780155550 2024-01-22T05:14:36.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc777400700 1 -- 172.21.15.49:0/4224455809 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc778010670 con 0x7fc780155550 2024-01-22T05:14:36.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc786c00700 1 -- 172.21.15.49:0/4224455809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7800c1030 con 0x7fc780155550 2024-01-22T05:14:36.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.627+0000 7fc777400700 1 -- 172.21.15.49:0/4224455809 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7780109f0 con 0x7fc780155550 2024-01-22T05:14:36.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.631+0000 7fc786c00700 1 -- 172.21.15.49:0/4224455809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7800c15f0 con 0x7fc780155550 2024-01-22T05:14:36.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.631+0000 7fc786c00700 1 -- 172.21.15.49:0/4224455809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc780047060 con 0x7fc780155550 2024-01-22T05:14:36.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.631+0000 7fc777400700 1 -- 172.21.15.49:0/4224455809 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc77801b400 con 0x7fc780155550 2024-01-22T05:14:36.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.635+0000 7fc777400700 1 --2- 172.21.15.49:0/4224455809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc75805a510 0x7fc75805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:36.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.635+0000 7fc777400700 1 -- 172.21.15.49:0/4224455809 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fc7780746a0 con 0x7fc780155550 2024-01-22T05:14:36.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.635+0000 7fc77fe00700 1 --2- 172.21.15.49:0/4224455809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc75805a510 0x7fc75805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:36.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.635+0000 7fc77fe00700 1 --2- 172.21.15.49:0/4224455809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc75805a510 0x7fc75805c9d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fc780151010 tx=0x7fc770008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.639+0000 7fc777400700 1 -- 172.21.15.49:0/4224455809 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc778047c10 con 0x7fc780155550 2024-01-22T05:14:36.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.839+0000 7fc786c00700 1 -- 172.21.15.49:0/4224455809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc780151100 con 0x7fc780155550 2024-01-22T05:14:36.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.843+0000 7fc777400700 1 -- 172.21.15.49:0/4224455809 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fc77804b230 con 0x7fc780155550 2024-01-22T05:14:36.844 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:36.844 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:14:36.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.843+0000 7fc786c00700 1 -- 172.21.15.49:0/4224455809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc75805a510 msgr2=0x7fc75805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:36.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.843+0000 7fc786c00700 1 --2- 172.21.15.49:0/4224455809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc75805a510 0x7fc75805c9d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fc780151010 tx=0x7fc770008040).stop 2024-01-22T05:14:36.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.843+0000 7fc786c00700 1 -- 172.21.15.49:0/4224455809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc780155550 msgr2=0x7fc780154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:36.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.843+0000 7fc786c00700 1 --2- 172.21.15.49:0/4224455809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc780155550 0x7fc780154a40 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7fc77800c790 tx=0x7fc7780015e0).stop 2024-01-22T05:14:36.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.843+0000 7fc786c00700 1 -- 172.21.15.49:0/4224455809 shutdown_connections 2024-01-22T05:14:36.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.843+0000 7fc786c00700 1 --2- 172.21.15.49:0/4224455809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc75805a510 0x7fc75805c9d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:36.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.843+0000 7fc786c00700 1 --2- 172.21.15.49:0/4224455809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc780155550 0x7fc780154a40 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:36.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.843+0000 7fc786c00700 1 --2- 172.21.15.49:0/4224455809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7800c3690 0x7fc7800abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:36.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.843+0000 7fc786c00700 1 --2- 172.21.15.49:0/4224455809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc780067a90 0x7fc7800c0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:36.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.843+0000 7fc786c00700 1 -- 172.21.15.49:0/4224455809 >> 172.21.15.49:0/4224455809 conn(0x7fc7800c51c0 msgr2=0x7fc7800a8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:36.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.847+0000 7fc786c00700 1 -- 172.21.15.49:0/4224455809 shutdown_connections 2024-01-22T05:14:36.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:36.847+0000 7fc786c00700 1 -- 172.21.15.49:0/4224455809 wait complete. 2024-01-22T05:14:36.851 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:14:36.869 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-01-22T05:14:36.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:14:37.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.027+0000 7f8594e00700 1 Processor -- start 2024-01-22T05:14:37.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.027+0000 7f8594e00700 1 -- start start 2024-01-22T05:14:37.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.027+0000 7f8594e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8590154b20 0x7f859015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:37.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.027+0000 7f8594e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8590067a90 con 0x7f8590154fd0 2024-01-22T05:14:37.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.027+0000 7f8594e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85900628a0 con 0x7f85900c3920 2024-01-22T05:14:37.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.027+0000 7f8594e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85900c4910 con 0x7f8590154b20 2024-01-22T05:14:37.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.031+0000 7f858d400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8590154b20 0x7f859015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:37.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.031+0000 7f858e800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8590154fd0 0x7f859015df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48454/0 (socket says 172.21.15.49:48454) 2024-01-22T05:14:37.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.031+0000 7f858e800700 1 -- 172.21.15.49:0/752184694 learned_addr learned my addr 172.21.15.49:0/752184694 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:37.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.031+0000 7f858ca00700 1 -- 172.21.15.49:0/752184694 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672022996 0 0) 0x7f8590067a90 con 0x7f8590154fd0 2024-01-22T05:14:37.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.031+0000 7f858ca00700 1 -- 172.21.15.49:0/752184694 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85700033f0 con 0x7f8590154fd0 2024-01-22T05:14:37.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.031+0000 7f858d400700 1 -- 172.21.15.49:0/752184694 >> v1:172.21.15.110:6789/0 conn(0x7f85900c3920 legacy=0x7f8590154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:37.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.031+0000 7f858d400700 1 -- 172.21.15.49:0/752184694 >> v1:172.21.15.49:6789/0 conn(0x7f8590154fd0 legacy=0x7f859015df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:37.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.031+0000 7f858d400700 1 -- 172.21.15.49:0/752184694 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85900bdb70 con 0x7f8590154b20 2024-01-22T05:14:37.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.031+0000 7f858d400700 1 --2- 172.21.15.49:0/752184694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8590154b20 0x7f859015ba00 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f8578009760 tx=0x7f8578009060).ready entity=mon.0 client_cookie=33d5811cbcc9e1da server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:37.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.031+0000 7f858ca00700 1 -- 172.21.15.49:0/752184694 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857800f510 con 0x7f8590154b20 2024-01-22T05:14:37.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.031+0000 7f858ca00700 1 -- 172.21.15.49:0/752184694 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857800f670 con 0x7f8590154b20 2024-01-22T05:14:37.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.031+0000 7f858ca00700 1 -- 172.21.15.49:0/752184694 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857800f9f0 con 0x7f8590154b20 2024-01-22T05:14:37.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.031+0000 7f8594e00700 1 -- 172.21.15.49:0/752184694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8590154b20 msgr2=0x7f859015ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:37.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.031+0000 7f8594e00700 1 --2- 172.21.15.49:0/752184694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8590154b20 0x7f859015ba00 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f8578009760 tx=0x7f8578009060).stop 2024-01-22T05:14:37.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.035+0000 7f8594e00700 1 -- 172.21.15.49:0/752184694 shutdown_connections 2024-01-22T05:14:37.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.035+0000 7f8594e00700 1 --2- 172.21.15.49:0/752184694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8590154b20 0x7f859015ba00 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:37.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.035+0000 7f8594e00700 1 -- 172.21.15.49:0/752184694 >> 172.21.15.49:0/752184694 conn(0x7f85900c8730 msgr2=0x7f85900c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:37.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.035+0000 7f8594e00700 1 -- 172.21.15.49:0/752184694 shutdown_connections 2024-01-22T05:14:37.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.035+0000 7f8594e00700 1 -- 172.21.15.49:0/752184694 wait complete. 2024-01-22T05:14:37.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.035+0000 7f8594e00700 1 Processor -- start 2024-01-22T05:14:37.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f8594e00700 1 -- start start 2024-01-22T05:14:37.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f8594e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85900c3920 0x7f85900aa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:37.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f8594e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8590154b20 0x7f859013fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:37.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f8594e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8590154fd0 0x7f85901401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:37.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f8594e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85900c8260 con 0x7f8590154b20 2024-01-22T05:14:37.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f8594e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85901647a0 con 0x7f8590154fd0 2024-01-22T05:14:37.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f8594e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8590164a40 con 0x7f85900c3920 2024-01-22T05:14:37.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f858d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8590154b20 0x7f859013fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:37.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f858d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8590154b20 0x7f859013fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60780/0 (socket says 172.21.15.49:60780) 2024-01-22T05:14:37.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f858d400700 1 -- 172.21.15.49:0/1178607389 learned_addr learned my addr 172.21.15.49:0/1178607389 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:37.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f858e800700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8590154fd0 0x7f85901401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:37.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f858de00700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85900c3920 0x7f85900aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:37.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f858d400700 1 -- 172.21.15.49:0/1178607389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85900c3920 msgr2=0x7f85900aa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:37.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f858d400700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85900c3920 0x7f85900aa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:37.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f858d400700 1 -- 172.21.15.49:0/1178607389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8590154fd0 msgr2=0x7f85901401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:37.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f858d400700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8590154fd0 0x7f85901401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:37.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f858d400700 1 -- 172.21.15.49:0/1178607389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85780092a0 con 0x7f8590154b20 2024-01-22T05:14:37.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f858de00700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85900c3920 0x7f85900aa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:37.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f858e800700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8590154fd0 0x7f85901401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:37.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f858d400700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8590154b20 0x7f859013fcd0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f8578009e00 tx=0x7f8578017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:37.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f8585600700 1 -- 172.21.15.49:0/1178607389 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857800f7e0 con 0x7f8590154b20 2024-01-22T05:14:37.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f8585600700 1 -- 172.21.15.49:0/1178607389 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857800f940 con 0x7f8590154b20 2024-01-22T05:14:37.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f8594e00700 1 -- 172.21.15.49:0/1178607389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8590164d20 con 0x7f8590154b20 2024-01-22T05:14:37.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.039+0000 7f8585600700 1 -- 172.21.15.49:0/1178607389 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857801b660 con 0x7f8590154b20 2024-01-22T05:14:37.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.043+0000 7f8594e00700 1 -- 172.21.15.49:0/1178607389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85901406b0 con 0x7f8590154b20 2024-01-22T05:14:37.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.043+0000 7f8594e00700 1 -- 172.21.15.49:0/1178607389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8590164f10 con 0x7f8590154b20 2024-01-22T05:14:37.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.043+0000 7f8585600700 1 -- 172.21.15.49:0/1178607389 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f857801ba10 con 0x7f8590154b20 2024-01-22T05:14:37.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.047+0000 7f8585600700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f856805a540 0x7f856805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:37.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.047+0000 7f8585600700 1 -- 172.21.15.49:0/1178607389 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f8578076540 con 0x7f8590154b20 2024-01-22T05:14:37.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.047+0000 7f858de00700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f856805a540 0x7f856805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:37.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.047+0000 7f858de00700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f856805a540 0x7f856805ca00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f8580001730 tx=0x7f8580009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:37.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.051+0000 7f8585600700 1 -- 172.21.15.49:0/1178607389 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8578049a90 con 0x7f8590154b20 2024-01-22T05:14:37.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.275+0000 7f8594e00700 1 -- 172.21.15.49:0/1178607389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8590165500 con 0x7f8590154b20 2024-01-22T05:14:37.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.279+0000 7f8585600700 1 -- 172.21.15.49:0/1178607389 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1390 (secure 0 0 0) 0x7f857804d0b0 con 0x7f8590154b20 2024-01-22T05:14:37.280 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:37.280 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":621,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1078,"data_bytes":1075911620,"bytes_used":4665647104,"bytes_avail":768428466176,"bytes_total":773094113280,"recovering_objects_per_sec":3,"recovering_bytes_per_sec":3575537,"recovering_keys_per_sec":0,"num_objects_recovered":31,"num_bytes_recovered":32505856,"num_keys_recovered":0,"write_bytes_sec":2188304,"read_op_per_sec":0,"write_op_per_sec":231},"fsmap":{"epoch":98,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7743}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-01-22T05:14:35.455713+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-01-22T05:14:37.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.283+0000 7f8594e00700 1 -- 172.21.15.49:0/1178607389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f856805a540 msgr2=0x7f856805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:37.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.283+0000 7f8594e00700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f856805a540 0x7f856805ca00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f8580001730 tx=0x7f8580009040).stop 2024-01-22T05:14:37.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.283+0000 7f8594e00700 1 -- 172.21.15.49:0/1178607389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8590154b20 msgr2=0x7f859013fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:37.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.283+0000 7f8594e00700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8590154b20 0x7f859013fcd0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f8578009e00 tx=0x7f8578017000).stop 2024-01-22T05:14:37.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.283+0000 7f8594e00700 1 -- 172.21.15.49:0/1178607389 shutdown_connections 2024-01-22T05:14:37.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.283+0000 7f8594e00700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f856805a540 0x7f856805ca00 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:37.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.283+0000 7f8594e00700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8590154fd0 0x7f85901401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:37.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.283+0000 7f8594e00700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8590154b20 0x7f859013fcd0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:37.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.283+0000 7f8594e00700 1 --2- 172.21.15.49:0/1178607389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85900c3920 0x7f85900aa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:37.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.283+0000 7f8594e00700 1 -- 172.21.15.49:0/1178607389 >> 172.21.15.49:0/1178607389 conn(0x7f85900c8730 msgr2=0x7f85900bf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:37.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.283+0000 7f8594e00700 1 -- 172.21.15.49:0/1178607389 shutdown_connections 2024-01-22T05:14:37.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:37.283+0000 7f8594e00700 1 -- 172.21.15.49:0/1178607389 wait complete. 2024-01-22T05:14:37.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'b': 'paused'} 2024-01-22T05:14:38.307 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:14:38.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.475+0000 7f8591200700 1 Processor -- start 2024-01-22T05:14:38.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.475+0000 7f8591200700 1 -- start start 2024-01-22T05:14:38.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f8591200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f858c0bc040 0x7f858c0bc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:38.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f8591200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f858c068e10 0x7f858c0c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:38.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f8591200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858c0c2570 con 0x7f858c0c1c40 2024-01-22T05:14:38.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f8591200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858c0bd7f0 con 0x7f858c068e10 2024-01-22T05:14:38.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f8591200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c14f520 con 0x7f858c0bc040 2024-01-22T05:14:38.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f858a800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f858c068e10 0x7f858c0c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:38.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f8589e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f858c0bc040 0x7f858c0bc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:38.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f8589400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f858c0c1c40 0x7f858c15bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:51700/0 (socket says 172.21.15.49:51700) 2024-01-22T05:14:38.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f858a800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f858c068e10 0x7f858c0c2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:35812/0 (socket says 172.21.15.49:35812) 2024-01-22T05:14:38.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f8589400700 1 -- 172.21.15.49:0/2425667530 learned_addr learned my addr 172.21.15.49:0/2425667530 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:38.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f858a800700 1 -- 172.21.15.49:0/2425667530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f858c0bc040 msgr2=0x7f858c0bc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:38.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f858a800700 1 --2- 172.21.15.49:0/2425667530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f858c0bc040 0x7f858c0bc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:38.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f858a800700 1 -- 172.21.15.49:0/2425667530 >> v1:172.21.15.110:6789/0 conn(0x7f858c0c1c40 legacy=0x7f858c15bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:38.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f858a800700 1 -- 172.21.15.49:0/2425667530 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c0bc910 con 0x7f858c068e10 2024-01-22T05:14:38.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f8589e00700 1 --2- 172.21.15.49:0/2425667530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f858c0bc040 0x7f858c0bc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:38.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.479+0000 7f8588a00700 1 -- 172.21.15.49:0/2425667530 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449016831 0 0) 0x7f858c0c2570 con 0x7f858c0c1c40 2024-01-22T05:14:38.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.483+0000 7f858a800700 1 --2- 172.21.15.49:0/2425667530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f858c068e10 0x7f858c0c2080 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f8584009e60 tx=0x7f8584009780).ready entity=mon.1 client_cookie=f0264e99054f90b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:38.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.483+0000 7f8588a00700 1 -- 172.21.15.49:0/2425667530 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858400e070 con 0x7f858c068e10 2024-01-22T05:14:38.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.483+0000 7f8588a00700 1 -- 172.21.15.49:0/2425667530 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858400bb60 con 0x7f858c068e10 2024-01-22T05:14:38.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.483+0000 7f8588a00700 1 -- 172.21.15.49:0/2425667530 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8584012410 con 0x7f858c068e10 2024-01-22T05:14:38.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.483+0000 7f8591200700 1 -- 172.21.15.49:0/2425667530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f858c068e10 msgr2=0x7f858c0c2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:38.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.483+0000 7f8591200700 1 --2- 172.21.15.49:0/2425667530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f858c068e10 0x7f858c0c2080 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f8584009e60 tx=0x7f8584009780).stop 2024-01-22T05:14:38.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.483+0000 7f8591200700 1 -- 172.21.15.49:0/2425667530 shutdown_connections 2024-01-22T05:14:38.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.483+0000 7f8591200700 1 --2- 172.21.15.49:0/2425667530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f858c068e10 0x7f858c0c2080 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:38.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.483+0000 7f8591200700 1 --2- 172.21.15.49:0/2425667530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f858c0bc040 0x7f858c0bc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:38.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.483+0000 7f8591200700 1 -- 172.21.15.49:0/2425667530 >> 172.21.15.49:0/2425667530 conn(0x7f858c0c3830 msgr2=0x7f858c0c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:38.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.483+0000 7f8591200700 1 -- 172.21.15.49:0/2425667530 shutdown_connections 2024-01-22T05:14:38.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.483+0000 7f8591200700 1 -- 172.21.15.49:0/2425667530 wait complete. 2024-01-22T05:14:38.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.487+0000 7f8591200700 1 Processor -- start 2024-01-22T05:14:38.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.487+0000 7f8591200700 1 -- start start 2024-01-22T05:14:38.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f8591200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f858c068e10 0x7f858c0bde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:38.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f8591200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f858c0bc040 0x7f858c0bf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:38.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f8591200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f858c0c1c40 0x7f858c0bfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:38.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f8591200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c0bf300 con 0x7f858c0c1c40 2024-01-22T05:14:38.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f8591200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c0be680 con 0x7f858c0bc040 2024-01-22T05:14:38.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f8591200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c0be960 con 0x7f858c068e10 2024-01-22T05:14:38.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f858a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f858c0c1c40 0x7f858c0bfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:38.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f858a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f858c0c1c40 0x7f858c0bfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60788/0 (socket says 172.21.15.49:60788) 2024-01-22T05:14:38.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f858a800700 1 -- 172.21.15.49:0/546412555 learned_addr learned my addr 172.21.15.49:0/546412555 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:38.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f8589e00700 1 --2- 172.21.15.49:0/546412555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f858c068e10 0x7f858c0bde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:38.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f8589400700 1 --2- 172.21.15.49:0/546412555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f858c0bc040 0x7f858c0bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:38.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f858a800700 1 -- 172.21.15.49:0/546412555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f858c068e10 msgr2=0x7f858c0bde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:38.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f858a800700 1 --2- 172.21.15.49:0/546412555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f858c068e10 0x7f858c0bde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:38.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f858a800700 1 -- 172.21.15.49:0/546412555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f858c0bc040 msgr2=0x7f858c0bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:38.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f858a800700 1 --2- 172.21.15.49:0/546412555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f858c0bc040 0x7f858c0bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:38.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f858a800700 1 -- 172.21.15.49:0/546412555 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c0092a0 con 0x7f858c0c1c40 2024-01-22T05:14:38.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f858a800700 1 --2- 172.21.15.49:0/546412555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f858c0c1c40 0x7f858c0bfc10 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f858c05f530 tx=0x7f8584009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:38.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f8581600700 1 -- 172.21.15.49:0/546412555 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8584012410 con 0x7f858c0c1c40 2024-01-22T05:14:38.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f8591200700 1 -- 172.21.15.49:0/546412555 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8584009a20 con 0x7f858c0c1c40 2024-01-22T05:14:38.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f8581600700 1 -- 172.21.15.49:0/546412555 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858401d630 con 0x7f858c0c1c40 2024-01-22T05:14:38.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f8581600700 1 -- 172.21.15.49:0/546412555 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858401d9f0 con 0x7f858c0c1c40 2024-01-22T05:14:38.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.491+0000 7f8591200700 1 -- 172.21.15.49:0/546412555 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858c0bef20 con 0x7f858c0c1c40 2024-01-22T05:14:38.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.495+0000 7f8591200700 1 -- 172.21.15.49:0/546412555 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858c065120 con 0x7f858c0c1c40 2024-01-22T05:14:38.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.495+0000 7f8581600700 1 -- 172.21.15.49:0/546412555 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8584026410 con 0x7f858c0c1c40 2024-01-22T05:14:38.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.495+0000 7f8581600700 1 --2- 172.21.15.49:0/546412555 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f856405a510 0x7f856405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:38.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.495+0000 7f8581600700 1 -- 172.21.15.49:0/546412555 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f8584076790 con 0x7f858c0c1c40 2024-01-22T05:14:38.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.499+0000 7f8589e00700 1 --2- 172.21.15.49:0/546412555 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f856405a510 0x7f856405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:38.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.499+0000 7f8589e00700 1 --2- 172.21.15.49:0/546412555 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f856405a510 0x7f856405c9d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f857c009dc0 tx=0x7f857c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:38.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.503+0000 7f8581600700 1 -- 172.21.15.49:0/546412555 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8584049c80 con 0x7f858c0c1c40 2024-01-22T05:14:38.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.715+0000 7f8591200700 1 -- 172.21.15.49:0/546412555 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f858c0bcbe0 con 0x7f858c0c1c40 2024-01-22T05:14:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.715+0000 7f8581600700 1 -- 172.21.15.49:0/546412555 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f858404d2a0 con 0x7f858c0c1c40 2024-01-22T05:14:38.719 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:38.719 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:14:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.723+0000 7f8591200700 1 -- 172.21.15.49:0/546412555 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f856405a510 msgr2=0x7f856405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.723+0000 7f8591200700 1 --2- 172.21.15.49:0/546412555 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f856405a510 0x7f856405c9d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f857c009dc0 tx=0x7f857c009060).stop 2024-01-22T05:14:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.723+0000 7f8591200700 1 -- 172.21.15.49:0/546412555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f858c0c1c40 msgr2=0x7f858c0bfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.723+0000 7f8591200700 1 --2- 172.21.15.49:0/546412555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f858c0c1c40 0x7f858c0bfc10 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f858c05f530 tx=0x7f8584009780).stop 2024-01-22T05:14:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.723+0000 7f8591200700 1 -- 172.21.15.49:0/546412555 shutdown_connections 2024-01-22T05:14:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.723+0000 7f8591200700 1 --2- 172.21.15.49:0/546412555 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f856405a510 0x7f856405c9d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.723+0000 7f8591200700 1 --2- 172.21.15.49:0/546412555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f858c0c1c40 0x7f858c0bfc10 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.723+0000 7f8591200700 1 --2- 172.21.15.49:0/546412555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f858c0bc040 0x7f858c0bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.723+0000 7f8591200700 1 --2- 172.21.15.49:0/546412555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f858c068e10 0x7f858c0bde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.723+0000 7f8591200700 1 -- 172.21.15.49:0/546412555 >> 172.21.15.49:0/546412555 conn(0x7f858c0c3830 msgr2=0x7f858c067d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.723+0000 7f8591200700 1 -- 172.21.15.49:0/546412555 shutdown_connections 2024-01-22T05:14:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.723+0000 7f8591200700 1 -- 172.21.15.49:0/546412555 wait complete. 2024-01-22T05:14:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:14:38.746 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-01-22T05:14:38.747 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:14:38.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.903+0000 7f31e7600700 1 Processor -- start 2024-01-22T05:14:38.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.903+0000 7f31e7600700 1 -- start start 2024-01-22T05:14:38.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.907+0000 7f31e7600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e0064950 0x7f31e00bd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:38.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.907+0000 7f31e7600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e00c2700 con 0x7f31e00644f0 2024-01-22T05:14:38.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.907+0000 7f31e7600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e00a7650 con 0x7f31e0065660 2024-01-22T05:14:38.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.907+0000 7f31e7600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00c2930 con 0x7f31e0064950 2024-01-22T05:14:38.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.907+0000 7f31dfe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f31e00644f0 0x7f31e00bcc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48458/0 (socket says 172.21.15.49:48458) 2024-01-22T05:14:38.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.907+0000 7f31dfe00700 1 -- 172.21.15.49:0/1575584668 learned_addr learned my addr 172.21.15.49:0/1575584668 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:38.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.907+0000 7f31e6000700 1 --2- 172.21.15.49:0/1575584668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e0064950 0x7f31e00bd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:38.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.907+0000 7f31df400700 1 -- 172.21.15.49:0/1575584668 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266849394 0 0) 0x7f31e00c2700 con 0x7f31e00644f0 2024-01-22T05:14:38.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.907+0000 7f31df400700 1 -- 172.21.15.49:0/1575584668 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c00033f0 con 0x7f31e00644f0 2024-01-22T05:14:38.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.911+0000 7f31df400700 1 -- 172.21.15.49:0/1575584668 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568165485 0 0) 0x7f31e00a7650 con 0x7f31e0065660 2024-01-22T05:14:38.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.911+0000 7f31e6000700 1 -- 172.21.15.49:0/1575584668 >> v1:172.21.15.110:6789/0 conn(0x7f31e0065660 legacy=0x7f31e00a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:38.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.911+0000 7f31e6000700 1 -- 172.21.15.49:0/1575584668 >> v1:172.21.15.49:6789/0 conn(0x7f31e00644f0 legacy=0x7f31e00bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:38.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.911+0000 7f31e6000700 1 -- 172.21.15.49:0/1575584668 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e00c2c10 con 0x7f31e0064950 2024-01-22T05:14:38.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.911+0000 7f31e6000700 1 --2- 172.21.15.49:0/1575584668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e0064950 0x7f31e00bd390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f31d8009e90 tx=0x7f31d8009780).ready entity=mon.2 client_cookie=6cf17b9b100fc3cc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:38.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.911+0000 7f31df400700 1 -- 172.21.15.49:0/1575584668 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d800e070 con 0x7f31e0064950 2024-01-22T05:14:38.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.911+0000 7f31df400700 1 -- 172.21.15.49:0/1575584668 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d800bb60 con 0x7f31e0064950 2024-01-22T05:14:38.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.911+0000 7f31df400700 1 -- 172.21.15.49:0/1575584668 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d800bee0 con 0x7f31e0064950 2024-01-22T05:14:38.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.911+0000 7f31e7600700 1 -- 172.21.15.49:0/1575584668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e0064950 msgr2=0x7f31e00bd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:38.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.911+0000 7f31e7600700 1 --2- 172.21.15.49:0/1575584668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e0064950 0x7f31e00bd390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f31d8009e90 tx=0x7f31d8009780).stop 2024-01-22T05:14:38.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.911+0000 7f31e7600700 1 -- 172.21.15.49:0/1575584668 shutdown_connections 2024-01-22T05:14:38.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.911+0000 7f31e7600700 1 --2- 172.21.15.49:0/1575584668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e0064950 0x7f31e00bd390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:38.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.911+0000 7f31e7600700 1 -- 172.21.15.49:0/1575584668 >> 172.21.15.49:0/1575584668 conn(0x7f31e00c87f0 msgr2=0x7f31e00c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:38.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.911+0000 7f31e7600700 1 -- 172.21.15.49:0/1575584668 shutdown_connections 2024-01-22T05:14:38.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.911+0000 7f31e7600700 1 -- 172.21.15.49:0/1575584668 wait complete. 2024-01-22T05:14:38.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.915+0000 7f31e7600700 1 Processor -- start 2024-01-22T05:14:38.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.915+0000 7f31e7600700 1 -- start start 2024-01-22T05:14:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e7600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e00644f0 0x7f31e00a7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e7600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e0064950 0x7f31e014bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e7600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31e0065660 0x7f31e00c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e7600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00a8880 con 0x7f31e0065660 2024-01-22T05:14:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e7600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00a9080 con 0x7f31e00644f0 2024-01-22T05:14:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e7600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0149430 con 0x7f31e0064950 2024-01-22T05:14:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31e0065660 0x7f31e00c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31e0065660 0x7f31e00c0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60794/0 (socket says 172.21.15.49:60794) 2024-01-22T05:14:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e6000700 1 -- 172.21.15.49:0/3002259266 learned_addr learned my addr 172.21.15.49:0/3002259266 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31dfe00700 1 --2- 172.21.15.49:0/3002259266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e0064950 0x7f31e014bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:38.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e4c00700 1 --2- 172.21.15.49:0/3002259266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e00644f0 0x7f31e00a7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:38.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e6000700 1 -- 172.21.15.49:0/3002259266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e0064950 msgr2=0x7f31e014bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:38.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e6000700 1 --2- 172.21.15.49:0/3002259266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e0064950 0x7f31e014bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:38.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e6000700 1 -- 172.21.15.49:0/3002259266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e00644f0 msgr2=0x7f31e00a7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:38.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e6000700 1 --2- 172.21.15.49:0/3002259266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e00644f0 0x7f31e00a7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:38.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e6000700 1 -- 172.21.15.49:0/3002259266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d8009a20 con 0x7f31e0065660 2024-01-22T05:14:38.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e4c00700 1 --2- 172.21.15.49:0/3002259266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e00644f0 0x7f31e00a7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:14:38.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e6000700 1 --2- 172.21.15.49:0/3002259266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31e0065660 0x7f31e00c0f10 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f31d800b6c0 tx=0x7f31e0154040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:38.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31d7e00700 1 -- 172.21.15.49:0/3002259266 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d801d630 con 0x7f31e0065660 2024-01-22T05:14:38.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31d7e00700 1 -- 172.21.15.49:0/3002259266 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d801d790 con 0x7f31e0065660 2024-01-22T05:14:38.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31e7600700 1 -- 172.21.15.49:0/3002259266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e00a7fe0 con 0x7f31e0065660 2024-01-22T05:14:38.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.919+0000 7f31d7e00700 1 -- 172.21.15.49:0/3002259266 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d801db50 con 0x7f31e0065660 2024-01-22T05:14:38.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.923+0000 7f31e7600700 1 -- 172.21.15.49:0/3002259266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e00a85a0 con 0x7f31e0065660 2024-01-22T05:14:38.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.923+0000 7f31e7600700 1 -- 172.21.15.49:0/3002259266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e00a9230 con 0x7f31e0065660 2024-01-22T05:14:38.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.923+0000 7f31d7e00700 1 -- 172.21.15.49:0/3002259266 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f31d8003040 con 0x7f31e0065660 2024-01-22T05:14:38.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.927+0000 7f31d7e00700 1 --2- 172.21.15.49:0/3002259266 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f31b805a510 0x7f31b805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:38.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.927+0000 7f31d7e00700 1 -- 172.21.15.49:0/3002259266 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f31d80768a0 con 0x7f31e0065660 2024-01-22T05:14:38.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.927+0000 7f31e4c00700 1 --2- 172.21.15.49:0/3002259266 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f31b805a510 0x7f31b805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:38.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.927+0000 7f31e4c00700 1 --2- 172.21.15.49:0/3002259266 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f31b805a510 0x7f31b805c9d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f31d00016f0 tx=0x7f31d0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:38.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:38.931+0000 7f31d7e00700 1 -- 172.21.15.49:0/3002259266 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f31e00a9230 con 0x7f31e0065660 2024-01-22T05:14:39.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:39.147+0000 7f31e7600700 1 -- 172.21.15.49:0/3002259266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f31e00a9230 con 0x7f31e0065660 2024-01-22T05:14:39.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:39.147+0000 7f31d7e00700 1 -- 172.21.15.49:0/3002259266 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1390 (secure 0 0 0) 0x7f31e00a9230 con 0x7f31e0065660 2024-01-22T05:14:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:39.149 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":622,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1078,"data_bytes":1076212380,"bytes_used":4666245120,"bytes_avail":768427868160,"bytes_total":773094113280,"recovering_objects_per_sec":3,"recovering_bytes_per_sec":3222833,"recovering_keys_per_sec":0,"num_objects_recovered":31,"num_bytes_recovered":32505856,"num_keys_recovered":0,"write_bytes_sec":2002493,"read_op_per_sec":0,"write_op_per_sec":209},"fsmap":{"epoch":98,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7743}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-01-22T05:14:35.455713+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-01-22T05:14:39.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:39.151+0000 7f31e7600700 1 -- 172.21.15.49:0/3002259266 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f31b805a510 msgr2=0x7f31b805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:39.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:39.151+0000 7f31e7600700 1 --2- 172.21.15.49:0/3002259266 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f31b805a510 0x7f31b805c9d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f31d00016f0 tx=0x7f31d0009040).stop 2024-01-22T05:14:39.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:39.151+0000 7f31e7600700 1 -- 172.21.15.49:0/3002259266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31e0065660 msgr2=0x7f31e00c0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:39.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:39.151+0000 7f31e7600700 1 --2- 172.21.15.49:0/3002259266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31e0065660 0x7f31e00c0f10 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f31d800b6c0 tx=0x7f31e0154040).stop 2024-01-22T05:14:39.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:39.151+0000 7f31e7600700 1 -- 172.21.15.49:0/3002259266 shutdown_connections 2024-01-22T05:14:39.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:39.151+0000 7f31e7600700 1 --2- 172.21.15.49:0/3002259266 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f31b805a510 0x7f31b805c9d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:39.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:39.151+0000 7f31e7600700 1 --2- 172.21.15.49:0/3002259266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31e0065660 0x7f31e00c0f10 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:39.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:39.151+0000 7f31e7600700 1 --2- 172.21.15.49:0/3002259266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e0064950 0x7f31e014bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:39.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:39.151+0000 7f31e7600700 1 --2- 172.21.15.49:0/3002259266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e00644f0 0x7f31e00a7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:39.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:39.151+0000 7f31e7600700 1 -- 172.21.15.49:0/3002259266 >> 172.21.15.49:0/3002259266 conn(0x7f31e00c87f0 msgr2=0x7f31e00a5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:39.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:39.151+0000 7f31e7600700 1 -- 172.21.15.49:0/3002259266 shutdown_connections 2024-01-22T05:14:39.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:39.151+0000 7f31e7600700 1 -- 172.21.15.49:0/3002259266 wait complete. 2024-01-22T05:14:39.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'b': 'paused'} 2024-01-22T05:14:39.243 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:14:39.249 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:14:40.178 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:14:40.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.359+0000 7f1f71c00700 1 Processor -- start 2024-01-22T05:14:40.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.359+0000 7f1f71c00700 1 -- start start 2024-01-22T05:14:40.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.363+0000 7f1f71c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6c0bdf60 0x7f1f6c150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:40.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.363+0000 7f1f71c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6c151db0 con 0x7f1f6c068ba0 2024-01-22T05:14:40.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.363+0000 7f1f71c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6c151510 con 0x7f1f6c1550e0 2024-01-22T05:14:40.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.363+0000 7f1f71c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c0a9f10 con 0x7f1f6c0bdf60 2024-01-22T05:14:40.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.363+0000 7f1f6a000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1f6c068ba0 0x7f1f6c1549d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48470/0 (socket says 172.21.15.49:48470) 2024-01-22T05:14:40.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.363+0000 7f1f6aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6c0bdf60 0x7f1f6c150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:40.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.363+0000 7f1f6a000700 1 -- 172.21.15.49:0/1871983465 learned_addr learned my addr 172.21.15.49:0/1871983465 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:40.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.363+0000 7f1f6aa00700 1 -- 172.21.15.49:0/1871983465 >> v1:172.21.15.110:6789/0 conn(0x7f1f6c1550e0 legacy=0x7f1f6c0c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:40.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.363+0000 7f1f6aa00700 1 -- 172.21.15.49:0/1871983465 >> v1:172.21.15.49:6789/0 conn(0x7f1f6c068ba0 legacy=0x7f1f6c1549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:40.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.363+0000 7f1f6aa00700 1 -- 172.21.15.49:0/1871983465 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c1517f0 con 0x7f1f6c0bdf60 2024-01-22T05:14:40.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.363+0000 7f1f6aa00700 1 --2- 172.21.15.49:0/1871983465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6c0bdf60 0x7f1f6c150cd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f1f5c009790 tx=0x7f1f5c009060).ready entity=mon.2 client_cookie=a89e8495dbad8ddd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:40.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.363+0000 7f1f69600700 1 -- 172.21.15.49:0/1871983465 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c009130 con 0x7f1f6c0bdf60 2024-01-22T05:14:40.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.363+0000 7f1f69600700 1 -- 172.21.15.49:0/1871983465 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c00b5a0 con 0x7f1f6c0bdf60 2024-01-22T05:14:40.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.363+0000 7f1f69600700 1 -- 172.21.15.49:0/1871983465 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c00b920 con 0x7f1f6c0bdf60 2024-01-22T05:14:40.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.367+0000 7f1f71c00700 1 -- 172.21.15.49:0/1871983465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6c0bdf60 msgr2=0x7f1f6c150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:40.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.367+0000 7f1f71c00700 1 --2- 172.21.15.49:0/1871983465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6c0bdf60 0x7f1f6c150cd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f1f5c009790 tx=0x7f1f5c009060).stop 2024-01-22T05:14:40.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.367+0000 7f1f71c00700 1 -- 172.21.15.49:0/1871983465 shutdown_connections 2024-01-22T05:14:40.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.367+0000 7f1f71c00700 1 --2- 172.21.15.49:0/1871983465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6c0bdf60 0x7f1f6c150cd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:40.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.367+0000 7f1f71c00700 1 -- 172.21.15.49:0/1871983465 >> 172.21.15.49:0/1871983465 conn(0x7f1f6c0c40c0 msgr2=0x7f1f6c0c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:40.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.367+0000 7f1f71c00700 1 -- 172.21.15.49:0/1871983465 shutdown_connections 2024-01-22T05:14:40.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.367+0000 7f1f71c00700 1 -- 172.21.15.49:0/1871983465 wait complete. 2024-01-22T05:14:40.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.371+0000 7f1f71c00700 1 Processor -- start 2024-01-22T05:14:40.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.371+0000 7f1f71c00700 1 -- start start 2024-01-22T05:14:40.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.371+0000 7f1f71c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f6c068ba0 0x7f1f6c142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:40.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.371+0000 7f1f71c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f6c0bdf60 0x7f1f6c0c1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:40.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.371+0000 7f1f71c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6c1550e0 0x7f1f6c0c1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:40.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.371+0000 7f1f71c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c0acf60 con 0x7f1f6c068ba0 2024-01-22T05:14:40.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.371+0000 7f1f71c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c0c1b00 con 0x7f1f6c0bdf60 2024-01-22T05:14:40.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.371+0000 7f1f71c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c142f20 con 0x7f1f6c1550e0 2024-01-22T05:14:40.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f6aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f6c068ba0 0x7f1f6c142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:40.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f6aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f6c068ba0 0x7f1f6c142a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60810/0 (socket says 172.21.15.49:60810) 2024-01-22T05:14:40.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f6aa00700 1 -- 172.21.15.49:0/1367142200 learned_addr learned my addr 172.21.15.49:0/1367142200 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:40.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f6b400700 1 --2- 172.21.15.49:0/1367142200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6c1550e0 0x7f1f6c0c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:40.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f6a000700 1 --2- 172.21.15.49:0/1367142200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f6c0bdf60 0x7f1f6c0c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:40.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f6aa00700 1 -- 172.21.15.49:0/1367142200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6c1550e0 msgr2=0x7f1f6c0c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:40.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f6aa00700 1 --2- 172.21.15.49:0/1367142200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6c1550e0 0x7f1f6c0c1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:40.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f6aa00700 1 -- 172.21.15.49:0/1367142200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f6c0bdf60 msgr2=0x7f1f6c0c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:40.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f6aa00700 1 --2- 172.21.15.49:0/1367142200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f6c0bdf60 0x7f1f6c0c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:40.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f6aa00700 1 -- 172.21.15.49:0/1367142200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c0092a0 con 0x7f1f6c068ba0 2024-01-22T05:14:40.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f6aa00700 1 --2- 172.21.15.49:0/1367142200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f6c068ba0 0x7f1f6c142a30 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f1f6c059cd0 tx=0x7f1f5c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:40.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f62000700 1 -- 172.21.15.49:0/1367142200 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c00b920 con 0x7f1f6c068ba0 2024-01-22T05:14:40.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f62000700 1 -- 172.21.15.49:0/1367142200 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c006910 con 0x7f1f6c068ba0 2024-01-22T05:14:40.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f71c00700 1 -- 172.21.15.49:0/1367142200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6c0bf1a0 con 0x7f1f6c068ba0 2024-01-22T05:14:40.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f62000700 1 -- 172.21.15.49:0/1367142200 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c01b660 con 0x7f1f6c068ba0 2024-01-22T05:14:40.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.375+0000 7f1f71c00700 1 -- 172.21.15.49:0/1367142200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6c0bf760 con 0x7f1f6c068ba0 2024-01-22T05:14:40.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.379+0000 7f1f71c00700 1 -- 172.21.15.49:0/1367142200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6c065660 con 0x7f1f6c068ba0 2024-01-22T05:14:40.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.379+0000 7f1f62000700 1 -- 172.21.15.49:0/1367142200 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1f5c01ba10 con 0x7f1f6c068ba0 2024-01-22T05:14:40.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.379+0000 7f1f62000700 1 --2- 172.21.15.49:0/1367142200 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1f4405a510 0x7f1f4405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:40.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.379+0000 7f1f62000700 1 -- 172.21.15.49:0/1367142200 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f1f5c0765e0 con 0x7f1f6c068ba0 2024-01-22T05:14:40.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.379+0000 7f1f6a000700 1 --2- 172.21.15.49:0/1367142200 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1f4405a510 0x7f1f4405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:40.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.383+0000 7f1f6a000700 1 --2- 172.21.15.49:0/1367142200 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1f4405a510 0x7f1f4405c9d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f1f6c09f550 tx=0x7f1f54009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:40.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.387+0000 7f1f62000700 1 -- 172.21.15.49:0/1367142200 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1f5c049b30 con 0x7f1f6c068ba0 2024-01-22T05:14:40.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.583+0000 7f1f71c00700 1 -- 172.21.15.49:0/1367142200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f6c046800 con 0x7f1f6c068ba0 2024-01-22T05:14:40.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.587+0000 7f1f62000700 1 -- 172.21.15.49:0/1367142200 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f1f5c028020 con 0x7f1f6c068ba0 2024-01-22T05:14:40.588 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:40.588 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:14:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.591+0000 7f1f71c00700 1 -- 172.21.15.49:0/1367142200 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1f4405a510 msgr2=0x7f1f4405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.591+0000 7f1f71c00700 1 --2- 172.21.15.49:0/1367142200 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1f4405a510 0x7f1f4405c9d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f1f6c09f550 tx=0x7f1f54009040).stop 2024-01-22T05:14:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.591+0000 7f1f71c00700 1 -- 172.21.15.49:0/1367142200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f6c068ba0 msgr2=0x7f1f6c142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:40.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.591+0000 7f1f71c00700 1 --2- 172.21.15.49:0/1367142200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f6c068ba0 0x7f1f6c142a30 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f1f6c059cd0 tx=0x7f1f5c015000).stop 2024-01-22T05:14:40.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.591+0000 7f1f71c00700 1 -- 172.21.15.49:0/1367142200 shutdown_connections 2024-01-22T05:14:40.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.591+0000 7f1f71c00700 1 --2- 172.21.15.49:0/1367142200 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1f4405a510 0x7f1f4405c9d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:40.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.591+0000 7f1f71c00700 1 --2- 172.21.15.49:0/1367142200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6c1550e0 0x7f1f6c0c1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:40.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.591+0000 7f1f71c00700 1 --2- 172.21.15.49:0/1367142200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f6c0bdf60 0x7f1f6c0c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:40.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.591+0000 7f1f71c00700 1 --2- 172.21.15.49:0/1367142200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f6c068ba0 0x7f1f6c142a30 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:40.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.591+0000 7f1f71c00700 1 -- 172.21.15.49:0/1367142200 >> 172.21.15.49:0/1367142200 conn(0x7f1f6c0c40c0 msgr2=0x7f1f6c153870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:40.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.591+0000 7f1f71c00700 1 -- 172.21.15.49:0/1367142200 shutdown_connections 2024-01-22T05:14:40.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.591+0000 7f1f71c00700 1 -- 172.21.15.49:0/1367142200 wait complete. 2024-01-22T05:14:40.598 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:14:40.615 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-01-22T05:14:40.615 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:14:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.771+0000 7fc269000700 1 Processor -- start 2024-01-22T05:14:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.771+0000 7fc269000700 1 -- start start 2024-01-22T05:14:40.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.771+0000 7fc269000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc2640c25e0 0x7fc2640a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:40.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.771+0000 7fc269000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2640c1a40 con 0x7fc264155d20 2024-01-22T05:14:40.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.771+0000 7fc269000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2640a90b0 con 0x7fc2640a8740 2024-01-22T05:14:40.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.771+0000 7fc269000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc264159310 con 0x7fc2640c25e0 2024-01-22T05:14:40.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.771+0000 7fc261e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc264155d20 0x7fc264065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48474/0 (socket says 172.21.15.49:48474) 2024-01-22T05:14:40.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.771+0000 7fc261e00700 1 -- 172.21.15.49:0/470076666 learned_addr learned my addr 172.21.15.49:0/470076666 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:40.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.771+0000 7fc262800700 1 --2- 172.21.15.49:0/470076666 >> v2:172.21.15.110:3300/0 conn(0x7fc2640c25e0 0x7fc2640a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:40.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc260a00700 1 -- 172.21.15.49:0/470076666 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246216211 0 0) 0x7fc2640c1a40 con 0x7fc264155d20 2024-01-22T05:14:40.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc260a00700 1 -- 172.21.15.49:0/470076666 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2440033f0 con 0x7fc264155d20 2024-01-22T05:14:40.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc262800700 1 -- 172.21.15.49:0/470076666 >> v1:172.21.15.110:6789/0 conn(0x7fc2640a8740 legacy=0x7fc2640c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:40.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc262800700 1 -- 172.21.15.49:0/470076666 >> v1:172.21.15.49:6789/0 conn(0x7fc264155d20 legacy=0x7fc264065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:40.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc262800700 1 -- 172.21.15.49:0/470076666 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2640c13f0 con 0x7fc2640c25e0 2024-01-22T05:14:40.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc262800700 1 --2- 172.21.15.49:0/470076666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2640c25e0 0x7fc2640a8bc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fc25c009e60 tx=0x7fc25c009780).ready entity=mon.1 client_cookie=73814d4a8def35c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:40.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc260a00700 1 -- 172.21.15.49:0/470076666 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c00e070 con 0x7fc2640c25e0 2024-01-22T05:14:40.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc260a00700 1 -- 172.21.15.49:0/470076666 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25c00bb60 con 0x7fc2640c25e0 2024-01-22T05:14:40.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc260a00700 1 -- 172.21.15.49:0/470076666 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c012410 con 0x7fc2640c25e0 2024-01-22T05:14:40.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc269000700 1 -- 172.21.15.49:0/470076666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2640c25e0 msgr2=0x7fc2640a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:40.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc269000700 1 --2- 172.21.15.49:0/470076666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2640c25e0 0x7fc2640a8bc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fc25c009e60 tx=0x7fc25c009780).stop 2024-01-22T05:14:40.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc269000700 1 -- 172.21.15.49:0/470076666 shutdown_connections 2024-01-22T05:14:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc269000700 1 --2- 172.21.15.49:0/470076666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2640c25e0 0x7fc2640a8bc0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc269000700 1 -- 172.21.15.49:0/470076666 >> 172.21.15.49:0/470076666 conn(0x7fc2640c6540 msgr2=0x7fc2640c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc269000700 1 -- 172.21.15.49:0/470076666 shutdown_connections 2024-01-22T05:14:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.775+0000 7fc269000700 1 -- 172.21.15.49:0/470076666 wait complete. 2024-01-22T05:14:40.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.779+0000 7fc269000700 1 Processor -- start 2024-01-22T05:14:40.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.779+0000 7fc269000700 1 -- start start 2024-01-22T05:14:40.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc269000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2640a8740 0x7fc2640c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:40.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc269000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2640c25e0 0x7fc2640aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc269000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc264155d20 0x7fc2641496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc269000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640aa080 con 0x7fc2640c25e0 2024-01-22T05:14:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc269000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640a9750 con 0x7fc2640a8740 2024-01-22T05:14:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc269000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640a9a30 con 0x7fc264155d20 2024-01-22T05:14:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc261400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2640c25e0 0x7fc2640aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc261400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2640c25e0 0x7fc2640aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60816/0 (socket says 172.21.15.49:60816) 2024-01-22T05:14:40.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc261e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2640a8740 0x7fc2640c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:40.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc261400700 1 -- 172.21.15.49:0/2342523510 learned_addr learned my addr 172.21.15.49:0/2342523510 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:40.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc262800700 1 --2- 172.21.15.49:0/2342523510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc264155d20 0x7fc2641496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:40.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc261400700 1 -- 172.21.15.49:0/2342523510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc264155d20 msgr2=0x7fc2641496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:40.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc261400700 1 --2- 172.21.15.49:0/2342523510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc264155d20 0x7fc2641496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:40.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc261400700 1 -- 172.21.15.49:0/2342523510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2640a8740 msgr2=0x7fc2640c05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:40.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc261400700 1 --2- 172.21.15.49:0/2342523510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2640a8740 0x7fc2640c05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:40.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc261400700 1 -- 172.21.15.49:0/2342523510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c009a20 con 0x7fc2640c25e0 2024-01-22T05:14:40.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc261e00700 1 --2- 172.21.15.49:0/2342523510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2640a8740 0x7fc2640c05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:40.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc261400700 1 --2- 172.21.15.49:0/2342523510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2640c25e0 0x7fc2640aa970 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7fc24c00c4c0 tx=0x7fc24c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:40.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc259600700 1 -- 172.21.15.49:0/2342523510 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c00ce70 con 0x7fc2640c25e0 2024-01-22T05:14:40.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc259600700 1 -- 172.21.15.49:0/2342523510 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c001e90 con 0x7fc2640c25e0 2024-01-22T05:14:40.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.783+0000 7fc259600700 1 -- 172.21.15.49:0/2342523510 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c007250 con 0x7fc2640c25e0 2024-01-22T05:14:40.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.787+0000 7fc269000700 1 -- 172.21.15.49:0/2342523510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2640a9d10 con 0x7fc2640c25e0 2024-01-22T05:14:40.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.787+0000 7fc269000700 1 -- 172.21.15.49:0/2342523510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2640aa510 con 0x7fc2640c25e0 2024-01-22T05:14:40.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.787+0000 7fc269000700 1 -- 172.21.15.49:0/2342523510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2640bb560 con 0x7fc2640c25e0 2024-01-22T05:14:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.787+0000 7fc259600700 1 -- 172.21.15.49:0/2342523510 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc24c0066a0 con 0x7fc2640c25e0 2024-01-22T05:14:40.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.791+0000 7fc259600700 1 --2- 172.21.15.49:0/2342523510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc23c05a510 0x7fc23c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.791+0000 7fc259600700 1 -- 172.21.15.49:0/2342523510 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fc24c0742d0 con 0x7fc2640c25e0 2024-01-22T05:14:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.791+0000 7fc261e00700 1 --2- 172.21.15.49:0/2342523510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc23c05a510 0x7fc23c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:40.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.791+0000 7fc261e00700 1 --2- 172.21.15.49:0/2342523510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc23c05a510 0x7fc23c05c9d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fc254005750 tx=0x7fc254009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:40.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:40.799+0000 7fc259600700 1 -- 172.21.15.49:0/2342523510 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc2640bb560 con 0x7fc2640c25e0 2024-01-22T05:14:41.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:41.015+0000 7fc269000700 1 -- 172.21.15.49:0/2342523510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc2640bb560 con 0x7fc2640c25e0 2024-01-22T05:14:41.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:41.019+0000 7fc259600700 1 -- 172.21.15.49:0/2342523510 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1366 (secure 0 0 0) 0x7fc24c047820 con 0x7fc2640c25e0 2024-01-22T05:14:41.020 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:41.021 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":624,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1078,"data_bytes":1076212380,"bytes_used":4666245120,"bytes_avail":768427868160,"bytes_total":773094113280,"recovering_objects_per_sec":2,"recovering_bytes_per_sec":2707708,"recovering_keys_per_sec":0,"num_objects_recovered":31,"num_bytes_recovered":32505856,"num_keys_recovered":0,"write_bytes_sec":459587,"read_op_per_sec":0,"write_op_per_sec":174},"fsmap":{"epoch":98,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7743}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-01-22T05:14:39.457325+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:14:41.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:41.019+0000 7fc269000700 1 -- 172.21.15.49:0/2342523510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc23c05a510 msgr2=0x7fc23c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:41.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:41.019+0000 7fc269000700 1 --2- 172.21.15.49:0/2342523510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc23c05a510 0x7fc23c05c9d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fc254005750 tx=0x7fc254009040).stop 2024-01-22T05:14:41.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:41.019+0000 7fc269000700 1 -- 172.21.15.49:0/2342523510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2640c25e0 msgr2=0x7fc2640aa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:41.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:41.019+0000 7fc269000700 1 --2- 172.21.15.49:0/2342523510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2640c25e0 0x7fc2640aa970 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7fc24c00c4c0 tx=0x7fc24c007e00).stop 2024-01-22T05:14:41.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:41.023+0000 7fc269000700 1 -- 172.21.15.49:0/2342523510 shutdown_connections 2024-01-22T05:14:41.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:41.023+0000 7fc269000700 1 --2- 172.21.15.49:0/2342523510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc23c05a510 0x7fc23c05c9d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:41.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:41.023+0000 7fc269000700 1 --2- 172.21.15.49:0/2342523510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc264155d20 0x7fc2641496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:41.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:41.023+0000 7fc269000700 1 --2- 172.21.15.49:0/2342523510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2640c25e0 0x7fc2640aa970 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:41.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:41.023+0000 7fc269000700 1 --2- 172.21.15.49:0/2342523510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2640a8740 0x7fc2640c05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:41.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:41.023+0000 7fc269000700 1 -- 172.21.15.49:0/2342523510 >> 172.21.15.49:0/2342523510 conn(0x7fc2640c6540 msgr2=0x7fc2640c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:41.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:41.023+0000 7fc269000700 1 -- 172.21.15.49:0/2342523510 shutdown_connections 2024-01-22T05:14:41.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:41.023+0000 7fc269000700 1 -- 172.21.15.49:0/2342523510 wait complete. 2024-01-22T05:14:41.047 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-01-22T05:14:41.048 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:14:41.048 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:14:41.089 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:14:41.131 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:14:41.131 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T05:14:41.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:14:41.131 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-22T05:14:41.794 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:14:41.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:14:41.794 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:14:41.804 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:14:42.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.011+0000 7f55cf800700 1 Processor -- start 2024-01-22T05:14:42.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.011+0000 7f55cf800700 1 -- start start 2024-01-22T05:14:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.015+0000 7f55cf800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55c80681a0 0x7f55c815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.015+0000 7f55cf800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c80c4db0 con 0x7f55c80c37d0 2024-01-22T05:14:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.015+0000 7f55cf800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c80c5240 con 0x7f55c80c3bb0 2024-01-22T05:14:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.015+0000 7f55cf800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c8062230 con 0x7f55c80681a0 2024-01-22T05:14:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.015+0000 7f55cce00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f55c80c37d0 0x7f55c8153bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48488/0 (socket says 172.21.15.49:48488) 2024-01-22T05:14:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.015+0000 7f55cce00700 1 -- 172.21.15.49:0/568981337 learned_addr learned my addr 172.21.15.49:0/568981337 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:42.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.015+0000 7f55ce200700 1 --2- 172.21.15.49:0/568981337 >> v2:172.21.15.110:3300/0 conn(0x7f55c80681a0 0x7f55c815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.015+0000 7f55c7400700 1 -- 172.21.15.49:0/568981337 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029334493 0 0) 0x7f55c80c4db0 con 0x7f55c80c37d0 2024-01-22T05:14:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.015+0000 7f55c7400700 1 -- 172.21.15.49:0/568981337 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55a80033f0 con 0x7f55c80c37d0 2024-01-22T05:14:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.019+0000 7f55c7400700 1 -- 172.21.15.49:0/568981337 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257472934 0 0) 0x7f55c80c5240 con 0x7f55c80c3bb0 2024-01-22T05:14:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.019+0000 7f55c7400700 1 -- 172.21.15.49:0/568981337 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c80c4db0 con 0x7f55c80c3bb0 2024-01-22T05:14:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.019+0000 7f55ce200700 1 -- 172.21.15.49:0/568981337 >> v1:172.21.15.110:6789/0 conn(0x7f55c80c3bb0 legacy=0x7f55c8067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.019+0000 7f55ce200700 1 -- 172.21.15.49:0/568981337 >> v1:172.21.15.49:6789/0 conn(0x7f55c80c37d0 legacy=0x7f55c8153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.019+0000 7f55ce200700 1 -- 172.21.15.49:0/568981337 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c81542e0 con 0x7f55c80681a0 2024-01-22T05:14:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.019+0000 7f55ce200700 1 --2- 172.21.15.49:0/568981337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55c80681a0 0x7f55c815b8b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f55c81544d0 tx=0x7f55c0009780).ready entity=mon.1 client_cookie=2c7ce47d4506b410 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:42.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.019+0000 7f55c7400700 1 -- 172.21.15.49:0/568981337 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c000e070 con 0x7f55c80681a0 2024-01-22T05:14:42.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.019+0000 7f55c7400700 1 -- 172.21.15.49:0/568981337 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c000bb40 con 0x7f55c80681a0 2024-01-22T05:14:42.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.019+0000 7f55c7400700 1 -- 172.21.15.49:0/568981337 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c0012410 con 0x7f55c80681a0 2024-01-22T05:14:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.019+0000 7f55cf800700 1 -- 172.21.15.49:0/568981337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55c80681a0 msgr2=0x7f55c815b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.019+0000 7f55cf800700 1 --2- 172.21.15.49:0/568981337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55c80681a0 0x7f55c815b8b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f55c81544d0 tx=0x7f55c0009780).stop 2024-01-22T05:14:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.019+0000 7f55cf800700 1 -- 172.21.15.49:0/568981337 shutdown_connections 2024-01-22T05:14:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.019+0000 7f55cf800700 1 --2- 172.21.15.49:0/568981337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55c80681a0 0x7f55c815b8b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.019+0000 7f55cf800700 1 -- 172.21.15.49:0/568981337 >> 172.21.15.49:0/568981337 conn(0x7f55c8064080 msgr2=0x7f55c8064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:42.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.019+0000 7f55cf800700 1 -- 172.21.15.49:0/568981337 shutdown_connections 2024-01-22T05:14:42.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.023+0000 7f55cf800700 1 -- 172.21.15.49:0/568981337 wait complete. 2024-01-22T05:14:42.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.023+0000 7f55cf800700 1 Processor -- start 2024-01-22T05:14:42.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55cf800700 1 -- start start 2024-01-22T05:14:42.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55cf800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55c80681a0 0x7f55c8141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55cf800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55c80c37d0 0x7f55c80ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55cf800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55c80c3bb0 0x7f55c80c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55cf800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80adfa0 con 0x7f55c80c37d0 2024-01-22T05:14:42.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55cf800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80ae280 con 0x7f55c80681a0 2024-01-22T05:14:42.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55cf800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80ae560 con 0x7f55c80c3bb0 2024-01-22T05:14:42.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55c7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55c80c37d0 0x7f55c80ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55c7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55c80c37d0 0x7f55c80ad550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60818/0 (socket says 172.21.15.49:60818) 2024-01-22T05:14:42.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55c7e00700 1 -- 172.21.15.49:0/1431078565 learned_addr learned my addr 172.21.15.49:0/1431078565 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:42.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55ce200700 1 --2- 172.21.15.49:0/1431078565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55c80c3bb0 0x7f55c80c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55cce00700 1 --2- 172.21.15.49:0/1431078565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55c80681a0 0x7f55c8141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55ce200700 1 -- 172.21.15.49:0/1431078565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55c80681a0 msgr2=0x7f55c8141830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55ce200700 1 --2- 172.21.15.49:0/1431078565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55c80681a0 0x7f55c8141830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55ce200700 1 -- 172.21.15.49:0/1431078565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55c80c37d0 msgr2=0x7f55c80ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55ce200700 1 --2- 172.21.15.49:0/1431078565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55c80c37d0 0x7f55c80ad550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55ce200700 1 -- 172.21.15.49:0/1431078565 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c0009a20 con 0x7f55c80c3bb0 2024-01-22T05:14:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55c7e00700 1 --2- 172.21.15.49:0/1431078565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55c80c37d0 0x7f55c80ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55ce200700 1 --2- 172.21.15.49:0/1431078565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55c80c3bb0 0x7f55c80c8220 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f55c0014000 tx=0x7f55c0009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55bfe00700 1 -- 172.21.15.49:0/1431078565 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c0012410 con 0x7f55c80c3bb0 2024-01-22T05:14:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55bfe00700 1 -- 172.21.15.49:0/1431078565 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c001d5a0 con 0x7f55c80c3bb0 2024-01-22T05:14:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55bfe00700 1 -- 172.21.15.49:0/1431078565 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c001d940 con 0x7f55c80c3bb0 2024-01-22T05:14:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.027+0000 7f55cf800700 1 -- 172.21.15.49:0/1431078565 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c80ae840 con 0x7f55c80c3bb0 2024-01-22T05:14:42.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.031+0000 7f55cf800700 1 -- 172.21.15.49:0/1431078565 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c80a8a40 con 0x7f55c80c3bb0 2024-01-22T05:14:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.031+0000 7f55cf800700 1 -- 172.21.15.49:0/1431078565 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c8047060 con 0x7f55c80c3bb0 2024-01-22T05:14:42.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.031+0000 7f55bfe00700 1 -- 172.21.15.49:0/1431078565 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f55c0003040 con 0x7f55c80c3bb0 2024-01-22T05:14:42.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.035+0000 7f55bfe00700 1 --2- 172.21.15.49:0/1431078565 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f55a005a510 0x7f55a005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.035+0000 7f55bfe00700 1 -- 172.21.15.49:0/1431078565 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f55c0076a10 con 0x7f55c80c3bb0 2024-01-22T05:14:42.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.035+0000 7f55cce00700 1 --2- 172.21.15.49:0/1431078565 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f55a005a510 0x7f55a005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.035+0000 7f55cce00700 1 --2- 172.21.15.49:0/1431078565 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f55a005a510 0x7f55a005c9d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f55b8005750 tx=0x7f55b8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:42.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.039+0000 7f55bfe00700 1 -- 172.21.15.49:0/1431078565 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f55c0049f60 con 0x7f55c80c3bb0 2024-01-22T05:14:42.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.239+0000 7f55cf800700 1 -- 172.21.15.49:0/1431078565 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55c8064f20 con 0x7f55c80c3bb0 2024-01-22T05:14:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.243+0000 7f55bfe00700 1 -- 172.21.15.49:0/1431078565 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f55c004d580 con 0x7f55c80c3bb0 2024-01-22T05:14:42.245 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:42.245 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:14:42.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.243+0000 7f55cf800700 1 -- 172.21.15.49:0/1431078565 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f55a005a510 msgr2=0x7f55a005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.243+0000 7f55cf800700 1 --2- 172.21.15.49:0/1431078565 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f55a005a510 0x7f55a005c9d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f55b8005750 tx=0x7f55b8009040).stop 2024-01-22T05:14:42.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.243+0000 7f55cf800700 1 -- 172.21.15.49:0/1431078565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55c80c3bb0 msgr2=0x7f55c80c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.243+0000 7f55cf800700 1 --2- 172.21.15.49:0/1431078565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55c80c3bb0 0x7f55c80c8220 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f55c0014000 tx=0x7f55c0009780).stop 2024-01-22T05:14:42.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.247+0000 7f55cf800700 1 -- 172.21.15.49:0/1431078565 shutdown_connections 2024-01-22T05:14:42.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.247+0000 7f55cf800700 1 --2- 172.21.15.49:0/1431078565 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f55a005a510 0x7f55a005c9d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.247+0000 7f55cf800700 1 --2- 172.21.15.49:0/1431078565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55c80c3bb0 0x7f55c80c8220 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.247+0000 7f55cf800700 1 --2- 172.21.15.49:0/1431078565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55c80c37d0 0x7f55c80ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.247+0000 7f55cf800700 1 --2- 172.21.15.49:0/1431078565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55c80681a0 0x7f55c8141830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.247+0000 7f55cf800700 1 -- 172.21.15.49:0/1431078565 >> 172.21.15.49:0/1431078565 conn(0x7f55c8064080 msgr2=0x7f55c80c6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:42.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.247+0000 7f55cf800700 1 -- 172.21.15.49:0/1431078565 shutdown_connections 2024-01-22T05:14:42.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.247+0000 7f55cf800700 1 -- 172.21.15.49:0/1431078565 wait complete. 2024-01-22T05:14:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:14:42.273 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:14:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.431+0000 7fdd91c00700 1 Processor -- start 2024-01-22T05:14:42.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.431+0000 7fdd91c00700 1 -- start start 2024-01-22T05:14:42.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.435+0000 7fdd91c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8c0c3470 0x7fdd8c069a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.435+0000 7fdd91c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c0695a0 con 0x7fdd8c066d10 2024-01-22T05:14:42.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.435+0000 7fdd91c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c068990 con 0x7fdd8c0bc570 2024-01-22T05:14:42.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.435+0000 7fdd91c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c068c70 con 0x7fdd8c0c3470 2024-01-22T05:14:42.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.435+0000 7fdd8b400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdd8c066d10 0x7fdd8c0c2d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48502/0 (socket says 172.21.15.49:48502) 2024-01-22T05:14:42.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.435+0000 7fdd8b400700 1 -- 172.21.15.49:0/3479389389 learned_addr learned my addr 172.21.15.49:0/3479389389 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:42.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.435+0000 7fdd91200700 1 --2- 172.21.15.49:0/3479389389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8c0c3470 0x7fdd8c069a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.435+0000 7fdd8aa00700 1 -- 172.21.15.49:0/3479389389 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381332394 0 0) 0x7fdd8c0695a0 con 0x7fdd8c066d10 2024-01-22T05:14:42.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.435+0000 7fdd8aa00700 1 -- 172.21.15.49:0/3479389389 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd6c0033f0 con 0x7fdd8c066d10 2024-01-22T05:14:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.435+0000 7fdd91200700 1 -- 172.21.15.49:0/3479389389 >> v1:172.21.15.110:6789/0 conn(0x7fdd8c0bc570 legacy=0x7fdd8c066600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.435+0000 7fdd8aa00700 1 -- 172.21.15.49:0/3479389389 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954931726 0 0) 0x7fdd8c068990 con 0x7fdd8c0bc570 2024-01-22T05:14:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.435+0000 7fdd91200700 1 -- 172.21.15.49:0/3479389389 >> v1:172.21.15.49:6789/0 conn(0x7fdd8c066d10 legacy=0x7fdd8c0c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.435+0000 7fdd91200700 1 -- 172.21.15.49:0/3479389389 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c068f50 con 0x7fdd8c0c3470 2024-01-22T05:14:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.439+0000 7fdd91200700 1 --2- 172.21.15.49:0/3479389389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8c0c3470 0x7fdd8c069a30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fdd84009e90 tx=0x7fdd84009780).ready entity=mon.2 client_cookie=6fc6f4f99ee03785 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.439+0000 7fdd8aa00700 1 -- 172.21.15.49:0/3479389389 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400e070 con 0x7fdd8c0c3470 2024-01-22T05:14:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.439+0000 7fdd8aa00700 1 -- 172.21.15.49:0/3479389389 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8400bb60 con 0x7fdd8c0c3470 2024-01-22T05:14:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.439+0000 7fdd8aa00700 1 -- 172.21.15.49:0/3479389389 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400bee0 con 0x7fdd8c0c3470 2024-01-22T05:14:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.439+0000 7fdd91c00700 1 -- 172.21.15.49:0/3479389389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8c0c3470 msgr2=0x7fdd8c069a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.439+0000 7fdd91c00700 1 --2- 172.21.15.49:0/3479389389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8c0c3470 0x7fdd8c069a30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fdd84009e90 tx=0x7fdd84009780).stop 2024-01-22T05:14:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.439+0000 7fdd91c00700 1 -- 172.21.15.49:0/3479389389 shutdown_connections 2024-01-22T05:14:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.439+0000 7fdd91c00700 1 --2- 172.21.15.49:0/3479389389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8c0c3470 0x7fdd8c069a30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.439+0000 7fdd91c00700 1 -- 172.21.15.49:0/3479389389 >> 172.21.15.49:0/3479389389 conn(0x7fdd8c0c40b0 msgr2=0x7fdd8c0c44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.439+0000 7fdd91c00700 1 -- 172.21.15.49:0/3479389389 shutdown_connections 2024-01-22T05:14:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.439+0000 7fdd91c00700 1 -- 172.21.15.49:0/3479389389 wait complete. 2024-01-22T05:14:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.443+0000 7fdd91c00700 1 Processor -- start 2024-01-22T05:14:42.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.443+0000 7fdd91c00700 1 -- start start 2024-01-22T05:14:42.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8c066d10 0x7fdd8c156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd8c0bc570 0x7fdd8c1570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd8c0c3470 0x7fdd8c157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c1575a0 con 0x7fdd8c0c3470 2024-01-22T05:14:42.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c157f00 con 0x7fdd8c0bc570 2024-01-22T05:14:42.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c0a9a40 con 0x7fdd8c066d10 2024-01-22T05:14:42.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd8c0c3470 0x7fdd8c157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd8c0c3470 0x7fdd8c157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60830/0 (socket says 172.21.15.49:60830) 2024-01-22T05:14:42.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91200700 1 -- 172.21.15.49:0/633300477 learned_addr learned my addr 172.21.15.49:0/633300477 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:42.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd8be00700 1 --2- 172.21.15.49:0/633300477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8c066d10 0x7fdd8c156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd8b400700 1 --2- 172.21.15.49:0/633300477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd8c0bc570 0x7fdd8c1570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91200700 1 -- 172.21.15.49:0/633300477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8c066d10 msgr2=0x7fdd8c156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91200700 1 --2- 172.21.15.49:0/633300477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8c066d10 0x7fdd8c156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91200700 1 -- 172.21.15.49:0/633300477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd8c0bc570 msgr2=0x7fdd8c1570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91200700 1 --2- 172.21.15.49:0/633300477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd8c0bc570 0x7fdd8c1570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91200700 1 -- 172.21.15.49:0/633300477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd84009a20 con 0x7fdd8c0c3470 2024-01-22T05:14:42.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91200700 1 --2- 172.21.15.49:0/633300477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd8c0c3470 0x7fdd8c157a10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7fdd8400b6c0 tx=0x7fdd84009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:42.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd83400700 1 -- 172.21.15.49:0/633300477 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84021070 con 0x7fdd8c0c3470 2024-01-22T05:14:42.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd83400700 1 -- 172.21.15.49:0/633300477 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8401d630 con 0x7fdd8c0c3470 2024-01-22T05:14:42.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd83400700 1 -- 172.21.15.49:0/633300477 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8401d9d0 con 0x7fdd8c0c3470 2024-01-22T05:14:42.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.447+0000 7fdd91c00700 1 -- 172.21.15.49:0/633300477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c0a9110 con 0x7fdd8c0c3470 2024-01-22T05:14:42.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.451+0000 7fdd91c00700 1 -- 172.21.15.49:0/633300477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c0a96d0 con 0x7fdd8c0c3470 2024-01-22T05:14:42.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.451+0000 7fdd91c00700 1 -- 172.21.15.49:0/633300477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c0a9bd0 con 0x7fdd8c0c3470 2024-01-22T05:14:42.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.451+0000 7fdd83400700 1 -- 172.21.15.49:0/633300477 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdd84003040 con 0x7fdd8c0c3470 2024-01-22T05:14:42.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.455+0000 7fdd83400700 1 --2- 172.21.15.49:0/633300477 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd6405a510 0x7fdd6405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.455+0000 7fdd83400700 1 -- 172.21.15.49:0/633300477 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fdd84076820 con 0x7fdd8c0c3470 2024-01-22T05:14:42.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.455+0000 7fdd8be00700 1 --2- 172.21.15.49:0/633300477 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd6405a510 0x7fdd6405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.455+0000 7fdd8be00700 1 --2- 172.21.15.49:0/633300477 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd6405a510 0x7fdd6405c9d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fdd7c007fd0 tx=0x7fdd7c007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.459+0000 7fdd83400700 1 -- 172.21.15.49:0/633300477 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdd84049d70 con 0x7fdd8c0c3470 2024-01-22T05:14:42.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.623+0000 7fdd91c00700 1 -- 172.21.15.49:0/633300477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd8c156730 con 0x7fdd8c0c3470 2024-01-22T05:14:42.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.627+0000 7fdd83400700 1 -- 172.21.15.49:0/633300477 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17370 (secure 0 0 0) 0x7fdd8404d390 con 0x7fdd8c0c3470 2024-01-22T05:14:42.629 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:42.629 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":119,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:14:27.362909+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:13:36.110138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-01-22T05:13:36.984415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.6","mappings":[{"from":5,"to":4}]},{"pgid":"16.2a","mappings":[{"from":1,"to":7}]},{"pgid":"17.5","mappings":[{"from":0,"to":5}]},{"pgid":"17.17","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:14:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.627+0000 7fdd91c00700 1 -- 172.21.15.49:0/633300477 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd6405a510 msgr2=0x7fdd6405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.627+0000 7fdd91c00700 1 --2- 172.21.15.49:0/633300477 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd6405a510 0x7fdd6405c9d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fdd7c007fd0 tx=0x7fdd7c007bb0).stop 2024-01-22T05:14:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.627+0000 7fdd91c00700 1 -- 172.21.15.49:0/633300477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd8c0c3470 msgr2=0x7fdd8c157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.627+0000 7fdd91c00700 1 --2- 172.21.15.49:0/633300477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd8c0c3470 0x7fdd8c157a10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7fdd8400b6c0 tx=0x7fdd84009780).stop 2024-01-22T05:14:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.627+0000 7fdd91c00700 1 -- 172.21.15.49:0/633300477 shutdown_connections 2024-01-22T05:14:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.627+0000 7fdd91c00700 1 --2- 172.21.15.49:0/633300477 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd6405a510 0x7fdd6405c9d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.627+0000 7fdd91c00700 1 --2- 172.21.15.49:0/633300477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd8c0c3470 0x7fdd8c157a10 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.627+0000 7fdd91c00700 1 --2- 172.21.15.49:0/633300477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd8c0bc570 0x7fdd8c1570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.627+0000 7fdd91c00700 1 --2- 172.21.15.49:0/633300477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8c066d10 0x7fdd8c156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.627+0000 7fdd91c00700 1 -- 172.21.15.49:0/633300477 >> 172.21.15.49:0/633300477 conn(0x7fdd8c0c40b0 msgr2=0x7fdd8c0c20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.631+0000 7fdd91c00700 1 -- 172.21.15.49:0/633300477 shutdown_connections 2024-01-22T05:14:42.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.631+0000 7fdd91c00700 1 -- 172.21.15.49:0/633300477 wait complete. 2024-01-22T05:14:42.661 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:13:36.110138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:13:36.984415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:14:42.661 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:14:42.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.819+0000 7feec0000700 1 Processor -- start 2024-01-22T05:14:42.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.819+0000 7feec0000700 1 -- start start 2024-01-22T05:14:42.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feec0000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80c6bc0 0x7feeb80bdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feec0000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feeb80be1b0 0x7feeb80a6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feec0000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb8154250 con 0x7feeb80c67e0 2024-01-22T05:14:42.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feec0000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb80c4350 con 0x7feeb80be1b0 2024-01-22T05:14:42.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feec0000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80c7150 con 0x7feeb80c6bc0 2024-01-22T05:14:42.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feebd600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7feeb80c67e0 0x7feeb80c47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48518/0 (socket says 172.21.15.49:48518) 2024-01-22T05:14:42.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feebd600700 1 -- 172.21.15.49:0/2550463525 learned_addr learned my addr 172.21.15.49:0/2550463525 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:42.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feebcc00700 1 --2- 172.21.15.49:0/2550463525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80c6bc0 0x7feeb80bdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feebe000700 1 --2- 172.21.15.49:0/2550463525 >> v2:172.21.15.110:3300/0 conn(0x7feeb80be1b0 0x7feeb80a6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feeb7e00700 1 -- 172.21.15.49:0/2550463525 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745053465 0 0) 0x7feea8001110 con 0x7feeb80c67e0 2024-01-22T05:14:42.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feeb7e00700 1 -- 172.21.15.49:0/2550463525 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee980033f0 con 0x7feeb80c67e0 2024-01-22T05:14:42.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feebcc00700 1 -- 172.21.15.49:0/2550463525 >> v2:172.21.15.110:3300/0 conn(0x7feeb80be1b0 msgr2=0x7feeb80a6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:42.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feebcc00700 1 --2- 172.21.15.49:0/2550463525 >> v2:172.21.15.110:3300/0 conn(0x7feeb80be1b0 0x7feeb80a6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feebcc00700 1 -- 172.21.15.49:0/2550463525 >> v1:172.21.15.49:6789/0 conn(0x7feeb80c67e0 legacy=0x7feeb80c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feebcc00700 1 -- 172.21.15.49:0/2550463525 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80c3d00 con 0x7feeb80c6bc0 2024-01-22T05:14:42.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feebcc00700 1 --2- 172.21.15.49:0/2550463525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80c6bc0 0x7feeb80bdcc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7feea0009760 tx=0x7feea0009060).ready entity=mon.2 client_cookie=bdc388b2e97bec95 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:42.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feeb7e00700 1 -- 172.21.15.49:0/2550463525 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00090d0 con 0x7feeb80c6bc0 2024-01-22T05:14:42.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feeb7e00700 1 -- 172.21.15.49:0/2550463525 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea000d4a0 con 0x7feeb80c6bc0 2024-01-22T05:14:42.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.823+0000 7feeb7e00700 1 -- 172.21.15.49:0/2550463525 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea000d820 con 0x7feeb80c6bc0 2024-01-22T05:14:42.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.827+0000 7feec0000700 1 -- 172.21.15.49:0/2550463525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80c6bc0 msgr2=0x7feeb80bdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.827+0000 7feec0000700 1 --2- 172.21.15.49:0/2550463525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80c6bc0 0x7feeb80bdcc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7feea0009760 tx=0x7feea0009060).stop 2024-01-22T05:14:42.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.827+0000 7feec0000700 1 -- 172.21.15.49:0/2550463525 shutdown_connections 2024-01-22T05:14:42.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.827+0000 7feec0000700 1 --2- 172.21.15.49:0/2550463525 >> v2:172.21.15.110:3300/0 conn(0x7feeb80be1b0 0x7feeb80a6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.827+0000 7feec0000700 1 --2- 172.21.15.49:0/2550463525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80c6bc0 0x7feeb80bdcc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.827+0000 7feec0000700 1 -- 172.21.15.49:0/2550463525 >> 172.21.15.49:0/2550463525 conn(0x7feeb80aa740 msgr2=0x7feeb80aab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:42.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.827+0000 7feec0000700 1 -- 172.21.15.49:0/2550463525 shutdown_connections 2024-01-22T05:14:42.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.827+0000 7feec0000700 1 -- 172.21.15.49:0/2550463525 wait complete. 2024-01-22T05:14:42.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.827+0000 7feec0000700 1 Processor -- start 2024-01-22T05:14:42.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feec0000700 1 -- start start 2024-01-22T05:14:42.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feec0000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80be1b0 0x7feeb80c0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feec0000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb80c67e0 0x7feeb80a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feec0000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c6bc0 0x7feeb80638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feec0000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb81640a0 con 0x7feeb80c6bc0 2024-01-22T05:14:42.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feec0000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8164350 con 0x7feeb80c67e0 2024-01-22T05:14:42.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feec0000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80c11e0 con 0x7feeb80be1b0 2024-01-22T05:14:42.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feebe000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c6bc0 0x7feeb80638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feebd600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80be1b0 0x7feeb80c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feebe000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c6bc0 0x7feeb80638c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60834/0 (socket says 172.21.15.49:60834) 2024-01-22T05:14:42.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feebe000700 1 -- 172.21.15.49:0/2716712700 learned_addr learned my addr 172.21.15.49:0/2716712700 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:42.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feebcc00700 1 --2- 172.21.15.49:0/2716712700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb80c67e0 0x7feeb80a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feebe000700 1 -- 172.21.15.49:0/2716712700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80be1b0 msgr2=0x7feeb80c0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feebe000700 1 --2- 172.21.15.49:0/2716712700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80be1b0 0x7feeb80c0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feebe000700 1 -- 172.21.15.49:0/2716712700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb80c67e0 msgr2=0x7feeb80a8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:42.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feebe000700 1 --2- 172.21.15.49:0/2716712700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb80c67e0 0x7feeb80a8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:42.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.831+0000 7feebe000700 1 -- 172.21.15.49:0/2716712700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea00092a0 con 0x7feeb80c6bc0 2024-01-22T05:14:42.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.835+0000 7feebe000700 1 --2- 172.21.15.49:0/2716712700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c6bc0 0x7feeb80638c0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7feeb0009e90 tx=0x7feeb000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:42.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.835+0000 7feeb4c00700 1 -- 172.21.15.49:0/2716712700 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb000caa0 con 0x7feeb80c6bc0 2024-01-22T05:14:42.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.835+0000 7feeb4c00700 1 -- 172.21.15.49:0/2716712700 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb000f040 con 0x7feeb80c6bc0 2024-01-22T05:14:42.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.835+0000 7feec0000700 1 -- 172.21.15.49:0/2716712700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb80c14c0 con 0x7feeb80c6bc0 2024-01-22T05:14:42.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.835+0000 7feeb4c00700 1 -- 172.21.15.49:0/2716712700 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb000ce10 con 0x7feeb80c6bc0 2024-01-22T05:14:42.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.835+0000 7feec0000700 1 -- 172.21.15.49:0/2716712700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb80c0e40 con 0x7feeb80c6bc0 2024-01-22T05:14:42.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.835+0000 7feec0000700 1 -- 172.21.15.49:0/2716712700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb81644e0 con 0x7feeb80c6bc0 2024-01-22T05:14:42.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.839+0000 7feeb4c00700 1 -- 172.21.15.49:0/2716712700 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7feeb0013610 con 0x7feeb80c6bc0 2024-01-22T05:14:42.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.839+0000 7feeb4c00700 1 --2- 172.21.15.49:0/2716712700 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fee9005a510 0x7fee9005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:42.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.839+0000 7feeb4c00700 1 -- 172.21.15.49:0/2716712700 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7feeb0075250 con 0x7feeb80c6bc0 2024-01-22T05:14:42.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.839+0000 7feebd600700 1 --2- 172.21.15.49:0/2716712700 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fee9005a510 0x7fee9005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:42.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.839+0000 7feebd600700 1 --2- 172.21.15.49:0/2716712700 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fee9005a510 0x7fee9005c9d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7feea8001270 tx=0x7feea8007a70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:42.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:42.847+0000 7feeb4c00700 1 -- 172.21.15.49:0/2716712700 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feeb0048860 con 0x7feeb80c6bc0 2024-01-22T05:14:43.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.015+0000 7feec0000700 1 -- 172.21.15.49:0/2716712700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7feeb80c3fe0 con 0x7feeb80c6bc0 2024-01-22T05:14:43.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.015+0000 7feeb4c00700 1 -- 172.21.15.49:0/2716712700 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v119) v1 ==== 110+0+10 (secure 0 0 0) 0x7feeb004be80 con 0x7feeb80c6bc0 2024-01-22T05:14:43.019 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:14:43.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.019+0000 7feec0000700 1 -- 172.21.15.49:0/2716712700 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fee9005a510 msgr2=0x7fee9005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:43.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.019+0000 7feec0000700 1 --2- 172.21.15.49:0/2716712700 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fee9005a510 0x7fee9005c9d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7feea8001270 tx=0x7feea8007a70).stop 2024-01-22T05:14:43.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.019+0000 7feec0000700 1 -- 172.21.15.49:0/2716712700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c6bc0 msgr2=0x7feeb80638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:43.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.019+0000 7feec0000700 1 --2- 172.21.15.49:0/2716712700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c6bc0 0x7feeb80638c0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7feeb0009e90 tx=0x7feeb000b040).stop 2024-01-22T05:14:43.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.019+0000 7feec0000700 1 -- 172.21.15.49:0/2716712700 shutdown_connections 2024-01-22T05:14:43.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.019+0000 7feec0000700 1 --2- 172.21.15.49:0/2716712700 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fee9005a510 0x7fee9005c9d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.019+0000 7feec0000700 1 --2- 172.21.15.49:0/2716712700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feeb80c6bc0 0x7feeb80638c0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.019+0000 7feec0000700 1 --2- 172.21.15.49:0/2716712700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb80c67e0 0x7feeb80a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.019+0000 7feec0000700 1 --2- 172.21.15.49:0/2716712700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80be1b0 0x7feeb80c0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.019+0000 7feec0000700 1 -- 172.21.15.49:0/2716712700 >> 172.21.15.49:0/2716712700 conn(0x7feeb80aa740 msgr2=0x7feeb80ac7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:43.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.019+0000 7feec0000700 1 -- 172.21.15.49:0/2716712700 shutdown_connections 2024-01-22T05:14:43.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.019+0000 7feec0000700 1 -- 172.21.15.49:0/2716712700 wait complete. 2024-01-22T05:14:43.046 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:14:43.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.207+0000 7fe75c200700 1 Processor -- start 2024-01-22T05:14:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.207+0000 7fe75c200700 1 -- start start 2024-01-22T05:14:43.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.211+0000 7fe75c200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7540a7e60 0x7fe7541554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:43.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.211+0000 7fe75c200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7541559c0 0x7fe7540aa750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:43.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.211+0000 7fe75c200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7540bdc70 con 0x7fe754068460 2024-01-22T05:14:43.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.211+0000 7fe75c200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7540bd9d0 con 0x7fe7541559c0 2024-01-22T05:14:43.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.211+0000 7fe75c200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe754155e50 con 0x7fe7540a7e60 2024-01-22T05:14:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.215+0000 7fe75a200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7541559c0 0x7fe7540aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.215+0000 7fe758e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7540a7e60 0x7fe7541554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.215+0000 7fe759800700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe754068460 0x7fe7540a7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:51768/0 (socket says 172.21.15.49:51768) 2024-01-22T05:14:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.215+0000 7fe759800700 1 -- 172.21.15.49:0/705363169 learned_addr learned my addr 172.21.15.49:0/705363169 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.215+0000 7fe753e00700 1 -- 172.21.15.49:0/705363169 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400521590 0 0) 0x7fe7540bdc70 con 0x7fe754068460 2024-01-22T05:14:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.215+0000 7fe75a200700 1 -- 172.21.15.49:0/705363169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7540a7e60 msgr2=0x7fe7541554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.215+0000 7fe75a200700 1 --2- 172.21.15.49:0/705363169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7540a7e60 0x7fe7541554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.215+0000 7fe75a200700 1 -- 172.21.15.49:0/705363169 >> v1:172.21.15.110:6789/0 conn(0x7fe754068460 legacy=0x7fe7540a7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.215+0000 7fe75a200700 1 -- 172.21.15.49:0/705363169 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7540c4040 con 0x7fe7541559c0 2024-01-22T05:14:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.215+0000 7fe75a200700 1 --2- 172.21.15.49:0/705363169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7541559c0 0x7fe7540aa750 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7fe74c009e60 tx=0x7fe74c009780).ready entity=mon.0 client_cookie=fca7defd6fa60313 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:43.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.215+0000 7fe753e00700 1 -- 172.21.15.49:0/705363169 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00e070 con 0x7fe7541559c0 2024-01-22T05:14:43.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.215+0000 7fe753e00700 1 -- 172.21.15.49:0/705363169 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c00bb60 con 0x7fe7541559c0 2024-01-22T05:14:43.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.215+0000 7fe753e00700 1 -- 172.21.15.49:0/705363169 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c012410 con 0x7fe7541559c0 2024-01-22T05:14:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.219+0000 7fe75c200700 1 -- 172.21.15.49:0/705363169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7541559c0 msgr2=0x7fe7540aa750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.219+0000 7fe75c200700 1 --2- 172.21.15.49:0/705363169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7541559c0 0x7fe7540aa750 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7fe74c009e60 tx=0x7fe74c009780).stop 2024-01-22T05:14:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.219+0000 7fe75c200700 1 -- 172.21.15.49:0/705363169 shutdown_connections 2024-01-22T05:14:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.219+0000 7fe75c200700 1 --2- 172.21.15.49:0/705363169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7541559c0 0x7fe7540aa750 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.219+0000 7fe75c200700 1 --2- 172.21.15.49:0/705363169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7540a7e60 0x7fe7541554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.219+0000 7fe75c200700 1 -- 172.21.15.49:0/705363169 >> 172.21.15.49:0/705363169 conn(0x7fe7540c8780 msgr2=0x7fe7540c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.219+0000 7fe75c200700 1 -- 172.21.15.49:0/705363169 shutdown_connections 2024-01-22T05:14:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.219+0000 7fe75c200700 1 -- 172.21.15.49:0/705363169 wait complete. 2024-01-22T05:14:43.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.223+0000 7fe75c200700 1 Processor -- start 2024-01-22T05:14:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.223+0000 7fe75c200700 1 -- start start 2024-01-22T05:14:43.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe75c200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe754068460 0x7fe75413e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:43.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe75c200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7540a7e60 0x7fe7540c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:43.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe75c200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7541559c0 0x7fe7540c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:43.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe75c200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7540c8080 con 0x7fe754068460 2024-01-22T05:14:43.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe75c200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe754166560 con 0x7fe7540a7e60 2024-01-22T05:14:43.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe75c200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7541657a0 con 0x7fe7541559c0 2024-01-22T05:14:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe759800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe754068460 0x7fe75413e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe759800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe754068460 0x7fe75413e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60848/0 (socket says 172.21.15.49:60848) 2024-01-22T05:14:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe759800700 1 -- 172.21.15.49:0/2557765516 learned_addr learned my addr 172.21.15.49:0/2557765516 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe758e00700 1 --2- 172.21.15.49:0/2557765516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7540a7e60 0x7fe7540c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe75a200700 1 --2- 172.21.15.49:0/2557765516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7541559c0 0x7fe7540c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe759800700 1 -- 172.21.15.49:0/2557765516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7541559c0 msgr2=0x7fe7540c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe759800700 1 --2- 172.21.15.49:0/2557765516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7541559c0 0x7fe7540c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe759800700 1 -- 172.21.15.49:0/2557765516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7540a7e60 msgr2=0x7fe7540c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe759800700 1 --2- 172.21.15.49:0/2557765516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7540a7e60 0x7fe7540c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe759800700 1 -- 172.21.15.49:0/2557765516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c009a20 con 0x7fe754068460 2024-01-22T05:14:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe758e00700 1 --2- 172.21.15.49:0/2557765516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7540a7e60 0x7fe7540c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe759800700 1 --2- 172.21.15.49:0/2557765516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe754068460 0x7fe75413e930 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fe74400c460 tx=0x7fe744007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe750c00700 1 -- 172.21.15.49:0/2557765516 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7440070d0 con 0x7fe754068460 2024-01-22T05:14:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe750c00700 1 -- 172.21.15.49:0/2557765516 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe744007230 con 0x7fe754068460 2024-01-22T05:14:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe750c00700 1 -- 172.21.15.49:0/2557765516 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7440075b0 con 0x7fe754068460 2024-01-22T05:14:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe75c200700 1 -- 172.21.15.49:0/2557765516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe754165a80 con 0x7fe754068460 2024-01-22T05:14:43.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.227+0000 7fe75c200700 1 -- 172.21.15.49:0/2557765516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe754166040 con 0x7fe754068460 2024-01-22T05:14:43.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.231+0000 7fe75c200700 1 -- 172.21.15.49:0/2557765516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75414f850 con 0x7fe754068460 2024-01-22T05:14:43.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.231+0000 7fe750c00700 1 -- 172.21.15.49:0/2557765516 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe7440059b0 con 0x7fe754068460 2024-01-22T05:14:43.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.231+0000 7fe750c00700 1 --2- 172.21.15.49:0/2557765516 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe72c05a510 0x7fe72c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:43.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.231+0000 7fe750c00700 1 -- 172.21.15.49:0/2557765516 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fe744073fc0 con 0x7fe754068460 2024-01-22T05:14:43.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.231+0000 7fe758e00700 1 --2- 172.21.15.49:0/2557765516 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe72c05a510 0x7fe72c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.235+0000 7fe758e00700 1 --2- 172.21.15.49:0/2557765516 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe72c05a510 0x7fe72c05c9d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fe7540c8e70 tx=0x7fe73c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:43.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.239+0000 7fe750c00700 1 -- 172.21.15.49:0/2557765516 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe7440475d0 con 0x7fe754068460 2024-01-22T05:14:43.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.403+0000 7fe75c200700 1 -- 172.21.15.49:0/2557765516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe75414c430 con 0x7fe754068460 2024-01-22T05:14:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.403+0000 7fe750c00700 1 -- 172.21.15.49:0/2557765516 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v119) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe74404abf0 con 0x7fe754068460 2024-01-22T05:14:43.405 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:14:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.403+0000 7fe75c200700 1 -- 172.21.15.49:0/2557765516 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe72c05a510 msgr2=0x7fe72c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.403+0000 7fe75c200700 1 --2- 172.21.15.49:0/2557765516 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe72c05a510 0x7fe72c05c9d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fe7540c8e70 tx=0x7fe73c009060).stop 2024-01-22T05:14:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.403+0000 7fe75c200700 1 -- 172.21.15.49:0/2557765516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe754068460 msgr2=0x7fe75413e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.403+0000 7fe75c200700 1 --2- 172.21.15.49:0/2557765516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe754068460 0x7fe75413e930 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fe74400c460 tx=0x7fe744007e90).stop 2024-01-22T05:14:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.407+0000 7fe75c200700 1 -- 172.21.15.49:0/2557765516 shutdown_connections 2024-01-22T05:14:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.407+0000 7fe75c200700 1 --2- 172.21.15.49:0/2557765516 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe72c05a510 0x7fe72c05c9d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.407+0000 7fe75c200700 1 --2- 172.21.15.49:0/2557765516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7541559c0 0x7fe7540c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.407+0000 7fe75c200700 1 --2- 172.21.15.49:0/2557765516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7540a7e60 0x7fe7540c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.407+0000 7fe75c200700 1 --2- 172.21.15.49:0/2557765516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe754068460 0x7fe75413e930 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.407+0000 7fe75c200700 1 -- 172.21.15.49:0/2557765516 >> 172.21.15.49:0/2557765516 conn(0x7fe7540c8780 msgr2=0x7fe7540aab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.407+0000 7fe75c200700 1 -- 172.21.15.49:0/2557765516 shutdown_connections 2024-01-22T05:14:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.407+0000 7fe75c200700 1 -- 172.21.15.49:0/2557765516 wait complete. 2024-01-22T05:14:43.433 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:14:43.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.603+0000 7fdef3000700 1 Processor -- start 2024-01-22T05:14:43.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.603+0000 7fdef3000700 1 -- start start 2024-01-22T05:14:43.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdef3000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdeec153cc0 0x7fdeec068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:43.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdef3000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdeec157e00 0x7fdeec0be3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:43.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdef3000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeec068820 con 0x7fdeec0691a0 2024-01-22T05:14:43.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdef3000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeec067c10 con 0x7fdeec157e00 2024-01-22T05:14:43.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdef3000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec067ef0 con 0x7fdeec153cc0 2024-01-22T05:14:43.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdeeb400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdeec0691a0 0x7fdeec1576f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34466/0 (socket says 172.21.15.49:34466) 2024-01-22T05:14:43.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdeeb400700 1 -- 172.21.15.49:0/3149746183 learned_addr learned my addr 172.21.15.49:0/3149746183 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:43.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdef1000700 1 --2- 172.21.15.49:0/3149746183 >> v2:172.21.15.110:3300/0 conn(0x7fdeec157e00 0x7fdeec0be3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:43.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdeebe00700 1 --2- 172.21.15.49:0/3149746183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdeec153cc0 0x7fdeec068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:43.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdeeaa00700 1 -- 172.21.15.49:0/3149746183 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095145510 0 0) 0x7fdeec068820 con 0x7fdeec0691a0 2024-01-22T05:14:43.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdeeaa00700 1 -- 172.21.15.49:0/3149746183 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdecc0033f0 con 0x7fdeec0691a0 2024-01-22T05:14:43.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdef1000700 1 -- 172.21.15.49:0/3149746183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdeec153cc0 msgr2=0x7fdeec068cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:43.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdef1000700 1 --2- 172.21.15.49:0/3149746183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdeec153cc0 0x7fdeec068cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdef1000700 1 -- 172.21.15.49:0/3149746183 >> v1:172.21.15.49:6789/0 conn(0x7fdeec0691a0 legacy=0x7fdeec1576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:43.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdef1000700 1 -- 172.21.15.49:0/3149746183 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec0681d0 con 0x7fdeec157e00 2024-01-22T05:14:43.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.607+0000 7fdef1000700 1 --2- 172.21.15.49:0/3149746183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec157e00 0x7fdeec0be3a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fdee4009e60 tx=0x7fdee4009780).ready entity=mon.1 client_cookie=997b4b3c75261df7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:43.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.611+0000 7fdeeaa00700 1 -- 172.21.15.49:0/3149746183 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee400e070 con 0x7fdeec157e00 2024-01-22T05:14:43.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.611+0000 7fdeeaa00700 1 -- 172.21.15.49:0/3149746183 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee400bab0 con 0x7fdeec157e00 2024-01-22T05:14:43.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.611+0000 7fdeeaa00700 1 -- 172.21.15.49:0/3149746183 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee400be30 con 0x7fdeec157e00 2024-01-22T05:14:43.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.611+0000 7fdef3000700 1 -- 172.21.15.49:0/3149746183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec157e00 msgr2=0x7fdeec0be3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:43.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.611+0000 7fdef3000700 1 --2- 172.21.15.49:0/3149746183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec157e00 0x7fdeec0be3a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fdee4009e60 tx=0x7fdee4009780).stop 2024-01-22T05:14:43.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.611+0000 7fdef3000700 1 -- 172.21.15.49:0/3149746183 shutdown_connections 2024-01-22T05:14:43.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.611+0000 7fdef3000700 1 --2- 172.21.15.49:0/3149746183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec157e00 0x7fdeec0be3a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.611+0000 7fdef3000700 1 --2- 172.21.15.49:0/3149746183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdeec153cc0 0x7fdeec068cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.611+0000 7fdef3000700 1 -- 172.21.15.49:0/3149746183 >> 172.21.15.49:0/3149746183 conn(0x7fdeec0c8780 msgr2=0x7fdeec0c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:43.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.611+0000 7fdef3000700 1 -- 172.21.15.49:0/3149746183 shutdown_connections 2024-01-22T05:14:43.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.611+0000 7fdef3000700 1 -- 172.21.15.49:0/3149746183 wait complete. 2024-01-22T05:14:43.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.615+0000 7fdef3000700 1 Processor -- start 2024-01-22T05:14:43.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.615+0000 7fdef3000700 1 -- start start 2024-01-22T05:14:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.615+0000 7fdef3000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec0691a0 0x7fdeec164ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.615+0000 7fdef3000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdeec153cc0 0x7fdeec14e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.615+0000 7fdef3000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeec157e00 0x7fdeec0aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.615+0000 7fdef3000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec1552a0 con 0x7fdeec157e00 2024-01-22T05:14:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdef3000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec155580 con 0x7fdeec0691a0 2024-01-22T05:14:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdef3000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec155860 con 0x7fdeec153cc0 2024-01-22T05:14:43.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdeebe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec0691a0 0x7fdeec164ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:43.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdef1000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeec157e00 0x7fdeec0aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:43.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdeebe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec0691a0 0x7fdeec164ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:46644/0 (socket says 172.21.15.49:46644) 2024-01-22T05:14:43.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdeebe00700 1 -- 172.21.15.49:0/16521628 learned_addr learned my addr 172.21.15.49:0/16521628 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:43.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdeeb400700 1 --2- 172.21.15.49:0/16521628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdeec153cc0 0x7fdeec14e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:43.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdeebe00700 1 -- 172.21.15.49:0/16521628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdeec153cc0 msgr2=0x7fdeec14e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:43.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdeebe00700 1 --2- 172.21.15.49:0/16521628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdeec153cc0 0x7fdeec14e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdeebe00700 1 -- 172.21.15.49:0/16521628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeec157e00 msgr2=0x7fdeec0aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:43.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdeebe00700 1 --2- 172.21.15.49:0/16521628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeec157e00 0x7fdeec0aa8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdeebe00700 1 -- 172.21.15.49:0/16521628 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee4009a20 con 0x7fdeec0691a0 2024-01-22T05:14:43.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdef1000700 1 --2- 172.21.15.49:0/16521628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeec157e00 0x7fdeec0aa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:43.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdeebe00700 1 --2- 172.21.15.49:0/16521628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec0691a0 0x7fdeec164ee0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fdedc00e930 tx=0x7fdedc009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:43.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdee3400700 1 -- 172.21.15.49:0/16521628 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc012600 con 0x7fdeec0691a0 2024-01-22T05:14:43.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdee3400700 1 -- 172.21.15.49:0/16521628 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc012760 con 0x7fdeec0691a0 2024-01-22T05:14:43.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdee3400700 1 -- 172.21.15.49:0/16521628 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc012ae0 con 0x7fdeec0691a0 2024-01-22T05:14:43.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdef3000700 1 -- 172.21.15.49:0/16521628 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeec155b40 con 0x7fdeec0691a0 2024-01-22T05:14:43.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.619+0000 7fdef3000700 1 -- 172.21.15.49:0/16521628 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeec156100 con 0x7fdeec0691a0 2024-01-22T05:14:43.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.623+0000 7fdef3000700 1 -- 172.21.15.49:0/16521628 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeec0684b0 con 0x7fdeec0691a0 2024-01-22T05:14:43.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.623+0000 7fdee3400700 1 -- 172.21.15.49:0/16521628 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdedc01b400 con 0x7fdeec0691a0 2024-01-22T05:14:43.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.623+0000 7fdee3400700 1 --2- 172.21.15.49:0/16521628 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdec405a510 0x7fdec405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.623+0000 7fdee3400700 1 -- 172.21.15.49:0/16521628 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fdedc074ec0 con 0x7fdeec0691a0 2024-01-22T05:14:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.623+0000 7fdeeb400700 1 --2- 172.21.15.49:0/16521628 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdec405a510 0x7fdec405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.627+0000 7fdeeb400700 1 --2- 172.21.15.49:0/16521628 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdec405a510 0x7fdec405c9d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fded4007fd0 tx=0x7fded4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:43.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.635+0000 7fdee3400700 1 -- 172.21.15.49:0/16521628 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdedc0483b0 con 0x7fdeec0691a0 2024-01-22T05:14:43.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.799+0000 7fdef3000700 1 -- 172.21.15.49:0/16521628 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdeec046800 con 0x7fdeec0691a0 2024-01-22T05:14:43.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.803+0000 7fdee3400700 1 -- 172.21.15.49:0/16521628 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v119) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdedc04b9d0 con 0x7fdeec0691a0 2024-01-22T05:14:43.805 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:14:43.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.807+0000 7fdef3000700 1 -- 172.21.15.49:0/16521628 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdec405a510 msgr2=0x7fdec405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:43.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.807+0000 7fdef3000700 1 --2- 172.21.15.49:0/16521628 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdec405a510 0x7fdec405c9d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fded4007fd0 tx=0x7fded4009040).stop 2024-01-22T05:14:43.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.807+0000 7fdef3000700 1 -- 172.21.15.49:0/16521628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec0691a0 msgr2=0x7fdeec164ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:43.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.807+0000 7fdef3000700 1 --2- 172.21.15.49:0/16521628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec0691a0 0x7fdeec164ee0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fdedc00e930 tx=0x7fdedc009060).stop 2024-01-22T05:14:43.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.807+0000 7fdef3000700 1 -- 172.21.15.49:0/16521628 shutdown_connections 2024-01-22T05:14:43.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.807+0000 7fdef3000700 1 --2- 172.21.15.49:0/16521628 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdec405a510 0x7fdec405c9d0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.807+0000 7fdef3000700 1 --2- 172.21.15.49:0/16521628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdeec157e00 0x7fdeec0aa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.807+0000 7fdef3000700 1 --2- 172.21.15.49:0/16521628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdeec153cc0 0x7fdeec14e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.807+0000 7fdef3000700 1 --2- 172.21.15.49:0/16521628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec0691a0 0x7fdeec164ee0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:43.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.807+0000 7fdef3000700 1 -- 172.21.15.49:0/16521628 >> 172.21.15.49:0/16521628 conn(0x7fdeec0c8780 msgr2=0x7fdeec062bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:43.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.807+0000 7fdef3000700 1 -- 172.21.15.49:0/16521628 shutdown_connections 2024-01-22T05:14:43.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:43.807+0000 7fdef3000700 1 -- 172.21.15.49:0/16521628 wait complete. 2024-01-22T05:14:43.833 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:14:44.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.003+0000 7fc1d6400700 1 Processor -- start 2024-01-22T05:14:44.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.003+0000 7fc1d6400700 1 -- start start 2024-01-22T05:14:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.007+0000 7fc1d6400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc1d00c3cc0 0x7fc1d0067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.007+0000 7fc1d6400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc1d00c40a0 0x7fc1d00c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.007+0000 7fc1d6400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d00c45a0 con 0x7fc1d0067f80 2024-01-22T05:14:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.007+0000 7fc1d6400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d0063380 con 0x7fc1d00c40a0 2024-01-22T05:14:44.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.007+0000 7fc1d6400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d0062a50 con 0x7fc1d00c3cc0 2024-01-22T05:14:44.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.007+0000 7fc1cfe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc1d00c40a0 0x7fc1d00c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.007+0000 7fc1cfe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc1d00c40a0 0x7fc1d00c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35208/0 (socket says 172.21.15.49:35208) 2024-01-22T05:14:44.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.007+0000 7fc1cfe00700 1 -- 172.21.15.49:0/21286953 learned_addr learned my addr 172.21.15.49:0/21286953 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:44.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.007+0000 7fc1cf400700 1 --2- 172.21.15.49:0/21286953 >> v2:172.21.15.110:3300/0 conn(0x7fc1d00c3cc0 0x7fc1d0067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1cfe00700 1 -- 172.21.15.49:0/21286953 >> v2:172.21.15.110:3300/0 conn(0x7fc1d00c3cc0 msgr2=0x7fc1d0067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:44.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1cfe00700 1 --2- 172.21.15.49:0/21286953 >> v2:172.21.15.110:3300/0 conn(0x7fc1d00c3cc0 0x7fc1d0067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1cfe00700 1 -- 172.21.15.49:0/21286953 >> v1:172.21.15.110:6789/0 conn(0x7fc1d0067f80 legacy=0x7fc1d0157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1cfe00700 1 -- 172.21.15.49:0/21286953 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d0062d30 con 0x7fc1d00c40a0 2024-01-22T05:14:44.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1cfe00700 1 --2- 172.21.15.49:0/21286953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d00c40a0 0x7fc1d00c6ba0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fc1d00653e0 tx=0x7fc1c8009840).ready entity=mon.0 client_cookie=ab2d019e02d90e72 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:44.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1ce000700 1 -- 172.21.15.49:0/21286953 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c800e070 con 0x7fc1d00c40a0 2024-01-22T05:14:44.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1ce000700 1 -- 172.21.15.49:0/21286953 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c800ba50 con 0x7fc1d00c40a0 2024-01-22T05:14:44.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1ce000700 1 -- 172.21.15.49:0/21286953 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c800bdd0 con 0x7fc1d00c40a0 2024-01-22T05:14:44.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1d6400700 1 -- 172.21.15.49:0/21286953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d00c40a0 msgr2=0x7fc1d00c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1d6400700 1 --2- 172.21.15.49:0/21286953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d00c40a0 0x7fc1d00c6ba0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fc1d00653e0 tx=0x7fc1c8009840).stop 2024-01-22T05:14:44.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1d6400700 1 -- 172.21.15.49:0/21286953 shutdown_connections 2024-01-22T05:14:44.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1d6400700 1 --2- 172.21.15.49:0/21286953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d00c40a0 0x7fc1d00c6ba0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1d6400700 1 --2- 172.21.15.49:0/21286953 >> v2:172.21.15.110:3300/0 conn(0x7fc1d00c3cc0 0x7fc1d0067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1d6400700 1 -- 172.21.15.49:0/21286953 >> 172.21.15.49:0/21286953 conn(0x7fc1d0064f10 msgr2=0x7fc1d00c8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:44.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1d6400700 1 -- 172.21.15.49:0/21286953 shutdown_connections 2024-01-22T05:14:44.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.011+0000 7fc1d6400700 1 -- 172.21.15.49:0/21286953 wait complete. 2024-01-22T05:14:44.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.015+0000 7fc1d6400700 1 Processor -- start 2024-01-22T05:14:44.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.015+0000 7fc1d6400700 1 -- start start 2024-01-22T05:14:44.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1d6400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d0067f80 0x7fc1d00aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1d6400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1d00c3cc0 0x7fc1d015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1d6400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d00c40a0 0x7fc1d015a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1d6400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d016c7b0 con 0x7fc1d00c40a0 2024-01-22T05:14:44.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1d6400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d015ae80 con 0x7fc1d0067f80 2024-01-22T05:14:44.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1d6400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0147010 con 0x7fc1d00c3cc0 2024-01-22T05:14:44.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1cfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d00c40a0 0x7fc1d015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1cfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d00c40a0 0x7fc1d015a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35218/0 (socket says 172.21.15.49:35218) 2024-01-22T05:14:44.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1cfe00700 1 -- 172.21.15.49:0/385833306 learned_addr learned my addr 172.21.15.49:0/385833306 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:44.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1cf400700 1 --2- 172.21.15.49:0/385833306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d0067f80 0x7fc1d00aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1cea00700 1 --2- 172.21.15.49:0/385833306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1d00c3cc0 0x7fc1d015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1cfe00700 1 -- 172.21.15.49:0/385833306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1d00c3cc0 msgr2=0x7fc1d015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1cfe00700 1 --2- 172.21.15.49:0/385833306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1d00c3cc0 0x7fc1d015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1cfe00700 1 -- 172.21.15.49:0/385833306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d0067f80 msgr2=0x7fc1d00aaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1cfe00700 1 --2- 172.21.15.49:0/385833306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d0067f80 0x7fc1d00aaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1cfe00700 1 -- 172.21.15.49:0/385833306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c8009ae0 con 0x7fc1d00c40a0 2024-01-22T05:14:44.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1cfe00700 1 --2- 172.21.15.49:0/385833306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d00c40a0 0x7fc1d015a990 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fc1c8009fd0 tx=0x7fc1c8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:44.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1c6a00700 1 -- 172.21.15.49:0/385833306 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8009500 con 0x7fc1d00c40a0 2024-01-22T05:14:44.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1c6a00700 1 -- 172.21.15.49:0/385833306 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c800bdd0 con 0x7fc1d00c40a0 2024-01-22T05:14:44.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1d6400700 1 -- 172.21.15.49:0/385833306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d01466e0 con 0x7fc1d00c40a0 2024-01-22T05:14:44.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1c6a00700 1 -- 172.21.15.49:0/385833306 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c801c610 con 0x7fc1d00c40a0 2024-01-22T05:14:44.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.019+0000 7fc1d6400700 1 -- 172.21.15.49:0/385833306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d0146ca0 con 0x7fc1d00c40a0 2024-01-22T05:14:44.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.023+0000 7fc1d6400700 1 -- 172.21.15.49:0/385833306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d0147180 con 0x7fc1d00c40a0 2024-01-22T05:14:44.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.023+0000 7fc1c6a00700 1 -- 172.21.15.49:0/385833306 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc1c801ca40 con 0x7fc1d00c40a0 2024-01-22T05:14:44.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.023+0000 7fc1c6a00700 1 --2- 172.21.15.49:0/385833306 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc1a805a540 0x7fc1a805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.023+0000 7fc1c6a00700 1 -- 172.21.15.49:0/385833306 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fc1c8076260 con 0x7fc1d00c40a0 2024-01-22T05:14:44.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.027+0000 7fc1cf400700 1 --2- 172.21.15.49:0/385833306 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc1a805a540 0x7fc1a805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.027+0000 7fc1cf400700 1 --2- 172.21.15.49:0/385833306 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc1a805a540 0x7fc1a805ca00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fc1c000bbc0 tx=0x7fc1c0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.031+0000 7fc1c6a00700 1 -- 172.21.15.49:0/385833306 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc1c80497b0 con 0x7fc1d00c40a0 2024-01-22T05:14:44.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.191+0000 7fc1d6400700 1 -- 172.21.15.49:0/385833306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1d0063010 con 0x7fc1d00c40a0 2024-01-22T05:14:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.195+0000 7fc1c6a00700 1 -- 172.21.15.49:0/385833306 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v119) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1c804cdd0 con 0x7fc1d00c40a0 2024-01-22T05:14:44.196 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:14:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.195+0000 7fc1d6400700 1 -- 172.21.15.49:0/385833306 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc1a805a540 msgr2=0x7fc1a805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.195+0000 7fc1d6400700 1 --2- 172.21.15.49:0/385833306 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc1a805a540 0x7fc1a805ca00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fc1c000bbc0 tx=0x7fc1c0008040).stop 2024-01-22T05:14:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.195+0000 7fc1d6400700 1 -- 172.21.15.49:0/385833306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d00c40a0 msgr2=0x7fc1d015a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.195+0000 7fc1d6400700 1 --2- 172.21.15.49:0/385833306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d00c40a0 0x7fc1d015a990 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fc1c8009fd0 tx=0x7fc1c8009840).stop 2024-01-22T05:14:44.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.199+0000 7fc1d6400700 1 -- 172.21.15.49:0/385833306 shutdown_connections 2024-01-22T05:14:44.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.199+0000 7fc1d6400700 1 --2- 172.21.15.49:0/385833306 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc1a805a540 0x7fc1a805ca00 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.199+0000 7fc1d6400700 1 --2- 172.21.15.49:0/385833306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d00c40a0 0x7fc1d015a990 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.199+0000 7fc1d6400700 1 --2- 172.21.15.49:0/385833306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1d00c3cc0 0x7fc1d015a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.199+0000 7fc1d6400700 1 --2- 172.21.15.49:0/385833306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d0067f80 0x7fc1d00aaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.199+0000 7fc1d6400700 1 -- 172.21.15.49:0/385833306 >> 172.21.15.49:0/385833306 conn(0x7fc1d0064f10 msgr2=0x7fc1d0063c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:44.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.199+0000 7fc1d6400700 1 -- 172.21.15.49:0/385833306 shutdown_connections 2024-01-22T05:14:44.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.199+0000 7fc1d6400700 1 -- 172.21.15.49:0/385833306 wait complete. 2024-01-22T05:14:44.224 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:14:44.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.391+0000 7f20f9a00700 1 Processor -- start 2024-01-22T05:14:44.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.391+0000 7f20f9a00700 1 -- start start 2024-01-22T05:14:44.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f9a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20f4065240 0x7f20f40644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f9a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f4064e90 con 0x7f20f4065620 2024-01-22T05:14:44.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f9a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f415c7d0 con 0x7f20f40649e0 2024-01-22T05:14:44.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f9a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f40c2700 con 0x7f20f4065240 2024-01-22T05:14:44.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f2000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f20f4065620 0x7f20f415b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34478/0 (socket says 172.21.15.49:34478) 2024-01-22T05:14:44.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f2000700 1 -- 172.21.15.49:0/3022950684 learned_addr learned my addr 172.21.15.49:0/3022950684 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:44.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f2a00700 1 --2- 172.21.15.49:0/3022950684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20f4065240 0x7f20f40644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f1600700 1 -- 172.21.15.49:0/3022950684 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959066009 0 0) 0x7f20dc001110 con 0x7f20f4065620 2024-01-22T05:14:44.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f1600700 1 -- 172.21.15.49:0/3022950684 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d40033f0 con 0x7f20f4065620 2024-01-22T05:14:44.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f1600700 1 -- 172.21.15.49:0/3022950684 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634659738 0 0) 0x7f20f415c7d0 con 0x7f20f40649e0 2024-01-22T05:14:44.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f2a00700 1 -- 172.21.15.49:0/3022950684 >> v1:172.21.15.110:6789/0 conn(0x7f20f40649e0 legacy=0x7f20f415c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f2a00700 1 -- 172.21.15.49:0/3022950684 >> v1:172.21.15.49:6789/0 conn(0x7f20f4065620 legacy=0x7f20f415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f2a00700 1 -- 172.21.15.49:0/3022950684 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f40c29a0 con 0x7f20f4065240 2024-01-22T05:14:44.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f2a00700 1 --2- 172.21.15.49:0/3022950684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20f4065240 0x7f20f40644f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f20e4009790 tx=0x7f20e4009060).ready entity=mon.2 client_cookie=b86db4a2f3286a7c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:44.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f1600700 1 -- 172.21.15.49:0/3022950684 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e400f510 con 0x7f20f4065240 2024-01-22T05:14:44.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f1600700 1 -- 172.21.15.49:0/3022950684 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e400f670 con 0x7f20f4065240 2024-01-22T05:14:44.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.395+0000 7f20f1600700 1 -- 172.21.15.49:0/3022950684 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e400f9f0 con 0x7f20f4065240 2024-01-22T05:14:44.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.399+0000 7f20f9a00700 1 -- 172.21.15.49:0/3022950684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20f4065240 msgr2=0x7f20f40644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.399+0000 7f20f9a00700 1 --2- 172.21.15.49:0/3022950684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20f4065240 0x7f20f40644f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f20e4009790 tx=0x7f20e4009060).stop 2024-01-22T05:14:44.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.399+0000 7f20f9a00700 1 -- 172.21.15.49:0/3022950684 shutdown_connections 2024-01-22T05:14:44.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.399+0000 7f20f9a00700 1 --2- 172.21.15.49:0/3022950684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20f4065240 0x7f20f40644f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.399+0000 7f20f9a00700 1 -- 172.21.15.49:0/3022950684 >> 172.21.15.49:0/3022950684 conn(0x7f20f40c87f0 msgr2=0x7f20f40c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:44.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.399+0000 7f20f9a00700 1 -- 172.21.15.49:0/3022950684 shutdown_connections 2024-01-22T05:14:44.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.399+0000 7f20f9a00700 1 -- 172.21.15.49:0/3022950684 wait complete. 2024-01-22T05:14:44.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.403+0000 7f20f9a00700 1 Processor -- start 2024-01-22T05:14:44.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.403+0000 7f20f9a00700 1 -- start start 2024-01-22T05:14:44.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.403+0000 7f20f9a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20f40649e0 0x7f20f41690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.403+0000 7f20f9a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20f4065240 0x7f20f40a8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.403+0000 7f20f9a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20f4065620 0x7f20f40c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.403+0000 7f20f9a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f40bfd90 con 0x7f20f4065240 2024-01-22T05:14:44.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.403+0000 7f20f9a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f40bf180 con 0x7f20f40649e0 2024-01-22T05:14:44.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.403+0000 7f20f9a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f40bf460 con 0x7f20f4065620 2024-01-22T05:14:44.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20f2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20f4065240 0x7f20f40a8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20f2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20f4065240 0x7f20f40a8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35234/0 (socket says 172.21.15.49:35234) 2024-01-22T05:14:44.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20f2000700 1 -- 172.21.15.49:0/2115360666 learned_addr learned my addr 172.21.15.49:0/2115360666 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:44.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20f2a00700 1 --2- 172.21.15.49:0/2115360666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20f40649e0 0x7f20f41690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20f3e00700 1 --2- 172.21.15.49:0/2115360666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20f4065620 0x7f20f40c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20f2000700 1 -- 172.21.15.49:0/2115360666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20f4065620 msgr2=0x7f20f40c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20f2000700 1 --2- 172.21.15.49:0/2115360666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20f4065620 0x7f20f40c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20f2000700 1 -- 172.21.15.49:0/2115360666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20f40649e0 msgr2=0x7f20f41690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20f2000700 1 --2- 172.21.15.49:0/2115360666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20f40649e0 0x7f20f41690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20f2000700 1 -- 172.21.15.49:0/2115360666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e40092a0 con 0x7f20f4065240 2024-01-22T05:14:44.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20f2000700 1 --2- 172.21.15.49:0/2115360666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20f4065240 0x7f20f40a8a70 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f20dc00c470 tx=0x7f20dc007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:44.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20ea000700 1 -- 172.21.15.49:0/2115360666 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc00ce20 con 0x7f20f4065240 2024-01-22T05:14:44.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20ea000700 1 -- 172.21.15.49:0/2115360666 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc0072e0 con 0x7f20f4065240 2024-01-22T05:14:44.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20f9a00700 1 -- 172.21.15.49:0/2115360666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f40bf740 con 0x7f20f4065240 2024-01-22T05:14:44.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20ea000700 1 -- 172.21.15.49:0/2115360666 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0057a0 con 0x7f20f4065240 2024-01-22T05:14:44.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.407+0000 7f20f9a00700 1 -- 172.21.15.49:0/2115360666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f40a9d60 con 0x7f20f4065240 2024-01-22T05:14:44.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.411+0000 7f20f9a00700 1 -- 172.21.15.49:0/2115360666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f40bff40 con 0x7f20f4065240 2024-01-22T05:14:44.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.411+0000 7f20ea000700 1 -- 172.21.15.49:0/2115360666 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f20dc005b90 con 0x7f20f4065240 2024-01-22T05:14:44.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.411+0000 7f20ea000700 1 --2- 172.21.15.49:0/2115360666 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f20cc05a510 0x7f20cc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.411+0000 7f20ea000700 1 -- 172.21.15.49:0/2115360666 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f20dc073f30 con 0x7f20f4065240 2024-01-22T05:14:44.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.415+0000 7f20f2a00700 1 --2- 172.21.15.49:0/2115360666 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f20cc05a510 0x7f20cc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.415+0000 7f20f2a00700 1 --2- 172.21.15.49:0/2115360666 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f20cc05a510 0x7f20cc05c9d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f20e40096e0 tx=0x7f20e4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:44.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.419+0000 7f20ea000700 1 -- 172.21.15.49:0/2115360666 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f20f40bff40 con 0x7f20f4065240 2024-01-22T05:14:44.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.619+0000 7f20f9a00700 1 -- 172.21.15.49:0/2115360666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20f4064e90 con 0x7f20f4065240 2024-01-22T05:14:44.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.619+0000 7f20ea000700 1 -- 172.21.15.49:0/2115360666 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f20f4064e90 con 0x7f20f4065240 2024-01-22T05:14:44.621 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:44.621 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:14:44.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.623+0000 7f20f9a00700 1 -- 172.21.15.49:0/2115360666 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f20cc05a510 msgr2=0x7f20cc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.623+0000 7f20f9a00700 1 --2- 172.21.15.49:0/2115360666 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f20cc05a510 0x7f20cc05c9d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f20e40096e0 tx=0x7f20e4017000).stop 2024-01-22T05:14:44.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.623+0000 7f20f9a00700 1 -- 172.21.15.49:0/2115360666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20f4065240 msgr2=0x7f20f40a8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.623+0000 7f20f9a00700 1 --2- 172.21.15.49:0/2115360666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20f4065240 0x7f20f40a8a70 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f20dc00c470 tx=0x7f20dc007ad0).stop 2024-01-22T05:14:44.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.623+0000 7f20f9a00700 1 -- 172.21.15.49:0/2115360666 shutdown_connections 2024-01-22T05:14:44.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.623+0000 7f20f9a00700 1 --2- 172.21.15.49:0/2115360666 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f20cc05a510 0x7f20cc05c9d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.623+0000 7f20f9a00700 1 --2- 172.21.15.49:0/2115360666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20f4065620 0x7f20f40c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.623+0000 7f20f9a00700 1 --2- 172.21.15.49:0/2115360666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20f4065240 0x7f20f40a8a70 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.623+0000 7f20f9a00700 1 --2- 172.21.15.49:0/2115360666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20f40649e0 0x7f20f41690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.623+0000 7f20f9a00700 1 -- 172.21.15.49:0/2115360666 >> 172.21.15.49:0/2115360666 conn(0x7f20f40c87f0 msgr2=0x7f20f40ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:44.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.623+0000 7f20f9a00700 1 -- 172.21.15.49:0/2115360666 shutdown_connections 2024-01-22T05:14:44.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.623+0000 7f20f9a00700 1 -- 172.21.15.49:0/2115360666 wait complete. 2024-01-22T05:14:44.628 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:14:44.646 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:14:44.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.807+0000 7f145f600700 1 Processor -- start 2024-01-22T05:14:44.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.811+0000 7f145f600700 1 -- start start 2024-01-22T05:14:44.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.811+0000 7f145f600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14580a8740 0x7f14580a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.811+0000 7f145f600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f14580c1ed0 0x7f14580c2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.811+0000 7f145f600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14580c1a40 con 0x7f1458155d20 2024-01-22T05:14:44.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.811+0000 7f145f600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14580a90b0 con 0x7f14580c1ed0 2024-01-22T05:14:44.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.811+0000 7f145f600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1458159310 con 0x7f14580a8740 2024-01-22T05:14:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f145d600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f14580c1ed0 0x7f14580c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f1457e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14580a8740 0x7f14580a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f1457e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14580a8740 0x7f14580a8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:48468/0 (socket says 172.21.15.49:48468) 2024-01-22T05:14:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f145d600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f14580c1ed0 0x7f14580c2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35242/0 (socket says 172.21.15.49:35242) 2024-01-22T05:14:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f1457e00700 1 -- 172.21.15.49:0/3005128313 learned_addr learned my addr 172.21.15.49:0/3005128313 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f145cc00700 1 --1- 172.21.15.49:0/3005128313 >> v1:172.21.15.110:6789/0 conn(0x7f1458155d20 0x7f1458065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:34426/0 (socket says 172.21.15.49:34426) 2024-01-22T05:14:44.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f1457e00700 1 -- 172.21.15.49:0/3005128313 >> v2:172.21.15.49:3300/0 conn(0x7f14580c1ed0 msgr2=0x7f14580c2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:44.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f1457e00700 1 --2- 172.21.15.49:0/3005128313 >> v2:172.21.15.49:3300/0 conn(0x7f14580c1ed0 0x7f14580c2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f1457e00700 1 -- 172.21.15.49:0/3005128313 >> v1:172.21.15.110:6789/0 conn(0x7f1458155d20 legacy=0x7f1458065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f1457e00700 1 -- 172.21.15.49:0/3005128313 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14580c13f0 con 0x7f14580a8740 2024-01-22T05:14:44.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f1457e00700 1 --2- 172.21.15.49:0/3005128313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14580a8740 0x7f14580a8bc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f1440006fd0 tx=0x7f14400090f0).ready entity=mon.2 client_cookie=979c9fd3f9121657 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f1457400700 1 -- 172.21.15.49:0/3005128313 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144000b580 con 0x7f14580a8740 2024-01-22T05:14:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f1457400700 1 -- 172.21.15.49:0/3005128313 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144000b6e0 con 0x7f14580a8740 2024-01-22T05:14:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f1457400700 1 -- 172.21.15.49:0/3005128313 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144000ba60 con 0x7f14580a8740 2024-01-22T05:14:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f145f600700 1 -- 172.21.15.49:0/3005128313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14580a8740 msgr2=0x7f14580a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.815+0000 7f145f600700 1 --2- 172.21.15.49:0/3005128313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14580a8740 0x7f14580a8bc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f1440006fd0 tx=0x7f14400090f0).stop 2024-01-22T05:14:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.819+0000 7f145f600700 1 -- 172.21.15.49:0/3005128313 shutdown_connections 2024-01-22T05:14:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.819+0000 7f145f600700 1 --2- 172.21.15.49:0/3005128313 >> v2:172.21.15.49:3300/0 conn(0x7f14580c1ed0 0x7f14580c2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.819+0000 7f145f600700 1 --2- 172.21.15.49:0/3005128313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14580a8740 0x7f14580a8bc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.819+0000 7f145f600700 1 -- 172.21.15.49:0/3005128313 >> 172.21.15.49:0/3005128313 conn(0x7f14580c6540 msgr2=0x7f14580c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:44.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.819+0000 7f145f600700 1 -- 172.21.15.49:0/3005128313 shutdown_connections 2024-01-22T05:14:44.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.819+0000 7f145f600700 1 -- 172.21.15.49:0/3005128313 wait complete. 2024-01-22T05:14:44.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.819+0000 7f145f600700 1 Processor -- start 2024-01-22T05:14:44.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.819+0000 7f145f600700 1 -- start start 2024-01-22T05:14:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145f600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14580a8740 0x7f1458152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145f600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14580c1ed0 0x7f14580aa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145f600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1458155d20 0x7f14580becc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145f600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1458152cf0 con 0x7f14580a8740 2024-01-22T05:14:44.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145f600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1458156190 con 0x7f1458155d20 2024-01-22T05:14:44.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145f600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14581563e0 con 0x7f14580c1ed0 2024-01-22T05:14:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14580a8740 0x7f1458152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14580a8740 0x7f1458152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35252/0 (socket says 172.21.15.49:35252) 2024-01-22T05:14:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145cc00700 1 -- 172.21.15.49:0/1440040290 learned_addr learned my addr 172.21.15.49:0/1440040290 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f1457e00700 1 --2- 172.21.15.49:0/1440040290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14580c1ed0 0x7f14580aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145d600700 1 --2- 172.21.15.49:0/1440040290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1458155d20 0x7f14580becc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145cc00700 1 -- 172.21.15.49:0/1440040290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14580c1ed0 msgr2=0x7f14580aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145cc00700 1 --2- 172.21.15.49:0/1440040290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14580c1ed0 0x7f14580aa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145cc00700 1 -- 172.21.15.49:0/1440040290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1458155d20 msgr2=0x7f14580becc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145cc00700 1 --2- 172.21.15.49:0/1440040290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1458155d20 0x7f14580becc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:44.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145cc00700 1 -- 172.21.15.49:0/1440040290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1440009370 con 0x7f14580a8740 2024-01-22T05:14:44.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145cc00700 1 --2- 172.21.15.49:0/1440040290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14580a8740 0x7f1458152800 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f1448001eb0 tx=0x7f1448007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:44.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f144fe00700 1 -- 172.21.15.49:0/1440040290 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14480070d0 con 0x7f14580a8740 2024-01-22T05:14:44.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f144fe00700 1 -- 172.21.15.49:0/1440040290 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1448007230 con 0x7f14580a8740 2024-01-22T05:14:44.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f145f600700 1 -- 172.21.15.49:0/1440040290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14581566c0 con 0x7f14580a8740 2024-01-22T05:14:44.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.823+0000 7f144fe00700 1 -- 172.21.15.49:0/1440040290 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14480075b0 con 0x7f14580a8740 2024-01-22T05:14:44.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.827+0000 7f145f600700 1 -- 172.21.15.49:0/1440040290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1458156c80 con 0x7f14580a8740 2024-01-22T05:14:44.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.827+0000 7f145f600700 1 -- 172.21.15.49:0/1440040290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145816bc50 con 0x7f14580a8740 2024-01-22T05:14:44.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.827+0000 7f144fe00700 1 -- 172.21.15.49:0/1440040290 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f14480058f0 con 0x7f14580a8740 2024-01-22T05:14:44.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.831+0000 7f144fe00700 1 --2- 172.21.15.49:0/1440040290 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f143005a510 0x7f143005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:44.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.831+0000 7f144fe00700 1 -- 172.21.15.49:0/1440040290 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f1448073ee0 con 0x7f14580a8740 2024-01-22T05:14:44.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.831+0000 7f1457e00700 1 --2- 172.21.15.49:0/1440040290 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f143005a510 0x7f143005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:44.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.831+0000 7f1457e00700 1 --2- 172.21.15.49:0/1440040290 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f143005a510 0x7f143005c9d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f1440009130 tx=0x7f1440017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:44.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.835+0000 7f144fe00700 1 -- 172.21.15.49:0/1440040290 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f14480474f0 con 0x7f14580a8740 2024-01-22T05:14:45.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:44.999+0000 7f145f600700 1 -- 172.21.15.49:0/1440040290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14580c16d0 con 0x7f14580a8740 2024-01-22T05:14:45.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.003+0000 7f144fe00700 1 -- 172.21.15.49:0/1440040290 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17370 (secure 0 0 0) 0x7f144804ab10 con 0x7f14580a8740 2024-01-22T05:14:45.006 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:45.006 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":119,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:14:27.362909+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:13:36.110138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-01-22T05:13:36.984415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.6","mappings":[{"from":5,"to":4}]},{"pgid":"16.2a","mappings":[{"from":1,"to":7}]},{"pgid":"17.5","mappings":[{"from":0,"to":5}]},{"pgid":"17.17","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:14:45.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.007+0000 7f145f600700 1 -- 172.21.15.49:0/1440040290 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f143005a510 msgr2=0x7f143005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:45.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.007+0000 7f145f600700 1 --2- 172.21.15.49:0/1440040290 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f143005a510 0x7f143005c9d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f1440009130 tx=0x7f1440017000).stop 2024-01-22T05:14:45.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.007+0000 7f145f600700 1 -- 172.21.15.49:0/1440040290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14580a8740 msgr2=0x7f1458152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:45.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.007+0000 7f145f600700 1 --2- 172.21.15.49:0/1440040290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14580a8740 0x7f1458152800 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f1448001eb0 tx=0x7f1448007df0).stop 2024-01-22T05:14:45.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.007+0000 7f145f600700 1 -- 172.21.15.49:0/1440040290 shutdown_connections 2024-01-22T05:14:45.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.007+0000 7f145f600700 1 --2- 172.21.15.49:0/1440040290 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f143005a510 0x7f143005c9d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.007+0000 7f145f600700 1 --2- 172.21.15.49:0/1440040290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1458155d20 0x7f14580becc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.007+0000 7f145f600700 1 --2- 172.21.15.49:0/1440040290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14580c1ed0 0x7f14580aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.007+0000 7f145f600700 1 --2- 172.21.15.49:0/1440040290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14580a8740 0x7f1458152800 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.007+0000 7f145f600700 1 -- 172.21.15.49:0/1440040290 >> 172.21.15.49:0/1440040290 conn(0x7f14580c6540 msgr2=0x7f14580c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:45.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.011+0000 7f145f600700 1 -- 172.21.15.49:0/1440040290 shutdown_connections 2024-01-22T05:14:45.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.011+0000 7f145f600700 1 -- 172.21.15.49:0/1440040290 wait complete. 2024-01-22T05:14:45.034 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:14:45.034 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:14:45.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.191+0000 7f60f1600700 1 Processor -- start 2024-01-22T05:14:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.191+0000 7f60f1600700 1 -- start start 2024-01-22T05:14:45.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.195+0000 7f60f1600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f60ec064c00 0x7f60ec0bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:45.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.195+0000 7f60f1600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f60ec065620 0x7f60ec0bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:45.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.195+0000 7f60f1600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ec0c2700 con 0x7f60ec065240 2024-01-22T05:14:45.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.195+0000 7f60f1600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ec0c29a0 con 0x7f60ec064c00 2024-01-22T05:14:45.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.195+0000 7f60f1600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ec0c2c80 con 0x7f60ec065620 2024-01-22T05:14:45.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.195+0000 7f60ea000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f60ec064c00 0x7f60ec0bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:45.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.195+0000 7f60ea000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f60ec064c00 0x7f60ec0bcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35254/0 (socket says 172.21.15.49:35254) 2024-01-22T05:14:45.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.195+0000 7f60ea000700 1 -- 172.21.15.49:0/3043132969 learned_addr learned my addr 172.21.15.49:0/3043132969 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:45.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.195+0000 7f60ebe00700 1 --2- 172.21.15.49:0/3043132969 >> v2:172.21.15.110:3300/0 conn(0x7f60ec065620 0x7f60ec0bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.195+0000 7f60e9600700 1 -- 172.21.15.49:0/3043132969 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098469881 0 0) 0x7f60ec0c2700 con 0x7f60ec065240 2024-01-22T05:14:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.195+0000 7f60e9600700 1 -- 172.21.15.49:0/3043132969 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60cc0033f0 con 0x7f60ec065240 2024-01-22T05:14:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.195+0000 7f60ea000700 1 -- 172.21.15.49:0/3043132969 >> v2:172.21.15.110:3300/0 conn(0x7f60ec065620 msgr2=0x7f60ec0bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.195+0000 7f60ea000700 1 --2- 172.21.15.49:0/3043132969 >> v2:172.21.15.110:3300/0 conn(0x7f60ec065620 0x7f60ec0bd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.195+0000 7f60ea000700 1 -- 172.21.15.49:0/3043132969 >> v1:172.21.15.110:6789/0 conn(0x7f60ec065240 legacy=0x7f60ec0644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.199+0000 7f60ea000700 1 -- 172.21.15.49:0/3043132969 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec0c2f60 con 0x7f60ec064c00 2024-01-22T05:14:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.199+0000 7f60ebe00700 1 --2- 172.21.15.49:0/3043132969 >> v2:172.21.15.110:3300/0 conn(0x7f60ec065620 0x7f60ec0bd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:45.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.199+0000 7f60ea000700 1 --2- 172.21.15.49:0/3043132969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60ec064c00 0x7f60ec0bcc80 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f60ec0665f0 tx=0x7f60d40090f0).ready entity=mon.0 client_cookie=d538ad7323276771 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:45.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.199+0000 7f60e9600700 1 -- 172.21.15.49:0/3043132969 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d400f510 con 0x7f60ec064c00 2024-01-22T05:14:45.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.199+0000 7f60e9600700 1 -- 172.21.15.49:0/3043132969 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d400f670 con 0x7f60ec064c00 2024-01-22T05:14:45.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.199+0000 7f60e9600700 1 -- 172.21.15.49:0/3043132969 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d400f9f0 con 0x7f60ec064c00 2024-01-22T05:14:45.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.199+0000 7f60f1600700 1 -- 172.21.15.49:0/3043132969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60ec064c00 msgr2=0x7f60ec0bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:45.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.199+0000 7f60f1600700 1 --2- 172.21.15.49:0/3043132969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60ec064c00 0x7f60ec0bcc80 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f60ec0665f0 tx=0x7f60d40090f0).stop 2024-01-22T05:14:45.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.199+0000 7f60f1600700 1 -- 172.21.15.49:0/3043132969 shutdown_connections 2024-01-22T05:14:45.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.199+0000 7f60f1600700 1 --2- 172.21.15.49:0/3043132969 >> v2:172.21.15.110:3300/0 conn(0x7f60ec065620 0x7f60ec0bd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.199+0000 7f60f1600700 1 --2- 172.21.15.49:0/3043132969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60ec064c00 0x7f60ec0bcc80 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.199+0000 7f60f1600700 1 -- 172.21.15.49:0/3043132969 >> 172.21.15.49:0/3043132969 conn(0x7f60ec0c87f0 msgr2=0x7f60ec0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:45.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.199+0000 7f60f1600700 1 -- 172.21.15.49:0/3043132969 shutdown_connections 2024-01-22T05:14:45.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.199+0000 7f60f1600700 1 -- 172.21.15.49:0/3043132969 wait complete. 2024-01-22T05:14:45.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.203+0000 7f60f1600700 1 Processor -- start 2024-01-22T05:14:45.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.203+0000 7f60f1600700 1 -- start start 2024-01-22T05:14:45.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60f1600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60ec064c00 0x7f60ec145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:45.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60f1600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60ec065240 0x7f60ec0bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:45.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60f1600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60ec065620 0x7f60ec0bfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:45.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60f1600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec168680 con 0x7f60ec064c00 2024-01-22T05:14:45.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60f1600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec168f20 con 0x7f60ec065620 2024-01-22T05:14:45.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60f1600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec1464e0 con 0x7f60ec065240 2024-01-22T05:14:45.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60eaa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60ec064c00 0x7f60ec145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:45.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60eaa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60ec064c00 0x7f60ec145ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35268/0 (socket says 172.21.15.49:35268) 2024-01-22T05:14:45.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60eaa00700 1 -- 172.21.15.49:0/3223698892 learned_addr learned my addr 172.21.15.49:0/3223698892 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:45.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60ea000700 1 --2- 172.21.15.49:0/3223698892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60ec065240 0x7f60ec0bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:45.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60ebe00700 1 --2- 172.21.15.49:0/3223698892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60ec065620 0x7f60ec0bfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:45.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60eaa00700 1 -- 172.21.15.49:0/3223698892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60ec065240 msgr2=0x7f60ec0bf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:45.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60eaa00700 1 --2- 172.21.15.49:0/3223698892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60ec065240 0x7f60ec0bf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60eaa00700 1 -- 172.21.15.49:0/3223698892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60ec065620 msgr2=0x7f60ec0bfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:45.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60eaa00700 1 --2- 172.21.15.49:0/3223698892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60ec065620 0x7f60ec0bfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60eaa00700 1 -- 172.21.15.49:0/3223698892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4009a20 con 0x7f60ec064c00 2024-01-22T05:14:45.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60eaa00700 1 --2- 172.21.15.49:0/3223698892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60ec064c00 0x7f60ec145ff0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f60dc00c4c0 tx=0x7f60dc007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:45.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.207+0000 7f60e2000700 1 -- 172.21.15.49:0/3223698892 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc00f470 con 0x7f60ec064c00 2024-01-22T05:14:45.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.211+0000 7f60e2000700 1 -- 172.21.15.49:0/3223698892 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc00f5d0 con 0x7f60ec064c00 2024-01-22T05:14:45.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.211+0000 7f60f1600700 1 -- 172.21.15.49:0/3223698892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d4009370 con 0x7f60ec064c00 2024-01-22T05:14:45.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.211+0000 7f60e2000700 1 -- 172.21.15.49:0/3223698892 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc00f970 con 0x7f60ec064c00 2024-01-22T05:14:45.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.211+0000 7f60f1600700 1 -- 172.21.15.49:0/3223698892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ec1688d0 con 0x7f60ec064c00 2024-01-22T05:14:45.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.211+0000 7f60f1600700 1 -- 172.21.15.49:0/3223698892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ec047060 con 0x7f60ec064c00 2024-01-22T05:14:45.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.215+0000 7f60e2000700 1 -- 172.21.15.49:0/3223698892 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f60dc00fd20 con 0x7f60ec064c00 2024-01-22T05:14:45.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.215+0000 7f60e2000700 1 --2- 172.21.15.49:0/3223698892 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f60c405a510 0x7f60c405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:45.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.215+0000 7f60e2000700 1 -- 172.21.15.49:0/3223698892 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f60dc073ff0 con 0x7f60ec064c00 2024-01-22T05:14:45.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.215+0000 7f60ea000700 1 --2- 172.21.15.49:0/3223698892 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f60c405a510 0x7f60c405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:45.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.215+0000 7f60ea000700 1 --2- 172.21.15.49:0/3223698892 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f60c405a510 0x7f60c405c9d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f60d4009130 tx=0x7f60d4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:45.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.223+0000 7f60e2000700 1 -- 172.21.15.49:0/3223698892 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f60dc0a2b00 con 0x7f60ec064c00 2024-01-22T05:14:45.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.431+0000 7f60f1600700 1 -- 172.21.15.49:0/3223698892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60ec0c3240 con 0x7f60ec064c00 2024-01-22T05:14:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.431+0000 7f60e2000700 1 -- 172.21.15.49:0/3223698892 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f60dc0475a0 con 0x7f60ec064c00 2024-01-22T05:14:45.434 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:45.434 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:14:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.435+0000 7f60f1600700 1 -- 172.21.15.49:0/3223698892 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f60c405a510 msgr2=0x7f60c405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:45.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.435+0000 7f60f1600700 1 --2- 172.21.15.49:0/3223698892 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f60c405a510 0x7f60c405c9d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f60d4009130 tx=0x7f60d4017000).stop 2024-01-22T05:14:45.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.435+0000 7f60f1600700 1 -- 172.21.15.49:0/3223698892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60ec064c00 msgr2=0x7f60ec145ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:45.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.435+0000 7f60f1600700 1 --2- 172.21.15.49:0/3223698892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60ec064c00 0x7f60ec145ff0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f60dc00c4c0 tx=0x7f60dc007c90).stop 2024-01-22T05:14:45.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.435+0000 7f60f1600700 1 -- 172.21.15.49:0/3223698892 shutdown_connections 2024-01-22T05:14:45.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.435+0000 7f60f1600700 1 --2- 172.21.15.49:0/3223698892 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f60c405a510 0x7f60c405c9d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.435+0000 7f60f1600700 1 --2- 172.21.15.49:0/3223698892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60ec065620 0x7f60ec0bfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.435+0000 7f60f1600700 1 --2- 172.21.15.49:0/3223698892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60ec065240 0x7f60ec0bf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.435+0000 7f60f1600700 1 --2- 172.21.15.49:0/3223698892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60ec064c00 0x7f60ec145ff0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.435+0000 7f60f1600700 1 -- 172.21.15.49:0/3223698892 >> 172.21.15.49:0/3223698892 conn(0x7f60ec0c87f0 msgr2=0x7f60ec0ad6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:45.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.435+0000 7f60f1600700 1 -- 172.21.15.49:0/3223698892 shutdown_connections 2024-01-22T05:14:45.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.435+0000 7f60f1600700 1 -- 172.21.15.49:0/3223698892 wait complete. 2024-01-22T05:14:45.441 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:14:45.460 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:14:45.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.623+0000 7fdbaec00700 1 Processor -- start 2024-01-22T05:14:45.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.623+0000 7fdbaec00700 1 -- start start 2024-01-22T05:14:45.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdbaec00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdba8063940 0x7fdba8068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:45.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdbaec00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8153d60 0x7fdba80be540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:45.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdbaec00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba8062230 con 0x7fdba80be0e0 2024-01-22T05:14:45.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdbaec00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba8068090 con 0x7fdba8063940 2024-01-22T05:14:45.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdbaec00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8062480 con 0x7fdba8153d60 2024-01-22T05:14:45.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdba7400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdba80be0e0 0x7fdba8153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34486/0 (socket says 172.21.15.49:34486) 2024-01-22T05:14:45.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdba7400700 1 -- 172.21.15.49:0/2759935285 learned_addr learned my addr 172.21.15.49:0/2759935285 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:45.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdba7e00700 1 --2- 172.21.15.49:0/2759935285 >> v2:172.21.15.110:3300/0 conn(0x7fdba8063940 0x7fdba8068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:45.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdbad600700 1 --2- 172.21.15.49:0/2759935285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8153d60 0x7fdba80be540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdba6a00700 1 -- 172.21.15.49:0/2759935285 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124127157 0 0) 0x7fdba8062230 con 0x7fdba80be0e0 2024-01-22T05:14:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdba6a00700 1 -- 172.21.15.49:0/2759935285 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb880033f0 con 0x7fdba80be0e0 2024-01-22T05:14:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdba7e00700 1 -- 172.21.15.49:0/2759935285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8153d60 msgr2=0x7fdba80be540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdba7e00700 1 --2- 172.21.15.49:0/2759935285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8153d60 0x7fdba80be540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdba7e00700 1 -- 172.21.15.49:0/2759935285 >> v1:172.21.15.49:6789/0 conn(0x7fdba80be0e0 legacy=0x7fdba8153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdba7e00700 1 -- 172.21.15.49:0/2759935285 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba8062760 con 0x7fdba8063940 2024-01-22T05:14:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.627+0000 7fdba7e00700 1 --2- 172.21.15.49:0/2759935285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba8063940 0x7fdba8068d20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fdb98009760 tx=0x7fdb98009060).ready entity=mon.1 client_cookie=186d0e1e5dc00b06 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.631+0000 7fdba6a00700 1 -- 172.21.15.49:0/2759935285 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9800d4a0 con 0x7fdba8063940 2024-01-22T05:14:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.631+0000 7fdba6a00700 1 -- 172.21.15.49:0/2759935285 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9800d600 con 0x7fdba8063940 2024-01-22T05:14:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.631+0000 7fdba6a00700 1 -- 172.21.15.49:0/2759935285 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9800d980 con 0x7fdba8063940 2024-01-22T05:14:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.631+0000 7fdbaec00700 1 -- 172.21.15.49:0/2759935285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba8063940 msgr2=0x7fdba8068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.631+0000 7fdbaec00700 1 --2- 172.21.15.49:0/2759935285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba8063940 0x7fdba8068d20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fdb98009760 tx=0x7fdb98009060).stop 2024-01-22T05:14:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.631+0000 7fdbaec00700 1 -- 172.21.15.49:0/2759935285 shutdown_connections 2024-01-22T05:14:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.631+0000 7fdbaec00700 1 --2- 172.21.15.49:0/2759935285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8153d60 0x7fdba80be540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.631+0000 7fdbaec00700 1 --2- 172.21.15.49:0/2759935285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba8063940 0x7fdba8068d20 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.631+0000 7fdbaec00700 1 -- 172.21.15.49:0/2759935285 >> 172.21.15.49:0/2759935285 conn(0x7fdba8064080 msgr2=0x7fdba8064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.631+0000 7fdbaec00700 1 -- 172.21.15.49:0/2759935285 shutdown_connections 2024-01-22T05:14:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.631+0000 7fdbaec00700 1 -- 172.21.15.49:0/2759935285 wait complete. 2024-01-22T05:14:45.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.635+0000 7fdbaec00700 1 Processor -- start 2024-01-22T05:14:45.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.635+0000 7fdbaec00700 1 -- start start 2024-01-22T05:14:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.635+0000 7fdbaec00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba80be0e0 0x7fdba8150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.635+0000 7fdbaec00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8153d60 0x7fdba8163eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.635+0000 7fdbaec00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba80bff40 0x7fdba80adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.635+0000 7fdbaec00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8165490 con 0x7fdba80be0e0 2024-01-22T05:14:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.635+0000 7fdbaec00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8164800 con 0x7fdba80bff40 2024-01-22T05:14:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.635+0000 7fdbaec00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8164ae0 con 0x7fdba8153d60 2024-01-22T05:14:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.635+0000 7fdba7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba80be0e0 0x7fdba8150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.635+0000 7fdba7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba80be0e0 0x7fdba8150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35282/0 (socket says 172.21.15.49:35282) 2024-01-22T05:14:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.635+0000 7fdba7e00700 1 -- 172.21.15.49:0/1463276772 learned_addr learned my addr 172.21.15.49:0/1463276772 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.635+0000 7fdbad600700 1 --2- 172.21.15.49:0/1463276772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba80bff40 0x7fdba80adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.635+0000 7fdba7400700 1 --2- 172.21.15.49:0/1463276772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8153d60 0x7fdba8163eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.639+0000 7fdba7e00700 1 -- 172.21.15.49:0/1463276772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8153d60 msgr2=0x7fdba8163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.639+0000 7fdba7e00700 1 --2- 172.21.15.49:0/1463276772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8153d60 0x7fdba8163eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.639+0000 7fdba7e00700 1 -- 172.21.15.49:0/1463276772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba80bff40 msgr2=0x7fdba80adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.639+0000 7fdba7e00700 1 --2- 172.21.15.49:0/1463276772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba80bff40 0x7fdba80adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.639+0000 7fdba7e00700 1 -- 172.21.15.49:0/1463276772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb980092a0 con 0x7fdba80be0e0 2024-01-22T05:14:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.639+0000 7fdba7e00700 1 --2- 172.21.15.49:0/1463276772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba80be0e0 0x7fdba8150cf0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fdb98009d50 tx=0x7fdb98016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.639+0000 7fdb9f400700 1 -- 172.21.15.49:0/1463276772 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98000d10 con 0x7fdba80be0e0 2024-01-22T05:14:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.639+0000 7fdb9f400700 1 -- 172.21.15.49:0/1463276772 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9800d770 con 0x7fdba80be0e0 2024-01-22T05:14:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.639+0000 7fdbaec00700 1 -- 172.21.15.49:0/1463276772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba8164dc0 con 0x7fdba80be0e0 2024-01-22T05:14:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.639+0000 7fdb9f400700 1 -- 172.21.15.49:0/1463276772 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9801d640 con 0x7fdba80be0e0 2024-01-22T05:14:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.639+0000 7fdbaec00700 1 -- 172.21.15.49:0/1463276772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba81511e0 con 0x7fdba80be0e0 2024-01-22T05:14:45.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.639+0000 7fdbaec00700 1 -- 172.21.15.49:0/1463276772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba8047060 con 0x7fdba80be0e0 2024-01-22T05:14:45.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.643+0000 7fdb9f400700 1 -- 172.21.15.49:0/1463276772 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdb9801da70 con 0x7fdba80be0e0 2024-01-22T05:14:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.643+0000 7fdb9f400700 1 --2- 172.21.15.49:0/1463276772 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb8005a540 0x7fdb8005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.643+0000 7fdb9f400700 1 -- 172.21.15.49:0/1463276772 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fdb98076180 con 0x7fdba80be0e0 2024-01-22T05:14:45.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.643+0000 7fdba7400700 1 --2- 172.21.15.49:0/1463276772 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb8005a540 0x7fdb8005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:45.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.643+0000 7fdba7400700 1 --2- 172.21.15.49:0/1463276772 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb8005a540 0x7fdb8005ca00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fdba80c4d00 tx=0x7fdb90009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.647+0000 7fdb9f400700 1 -- 172.21.15.49:0/1463276772 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdb98049790 con 0x7fdba80be0e0 2024-01-22T05:14:45.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.847+0000 7fdbaec00700 1 -- 172.21.15.49:0/1463276772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdba8062a40 con 0x7fdba80be0e0 2024-01-22T05:14:45.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.847+0000 7fdb9f400700 1 -- 172.21.15.49:0/1463276772 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fdb9804cdb0 con 0x7fdba80be0e0 2024-01-22T05:14:45.851 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:45.851 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":98,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:13:37.989402+0000","modified":"2024-01-22T05:13:41.022182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"b","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6833/1348218223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1348218223},{"type":"v1","addr":"172.21.15.110:6833","nonce":1348218223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-22T05:14:45.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.851+0000 7fdbaec00700 1 -- 172.21.15.49:0/1463276772 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb8005a540 msgr2=0x7fdb8005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:45.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.851+0000 7fdbaec00700 1 --2- 172.21.15.49:0/1463276772 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb8005a540 0x7fdb8005ca00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fdba80c4d00 tx=0x7fdb90009040).stop 2024-01-22T05:14:45.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.851+0000 7fdbaec00700 1 -- 172.21.15.49:0/1463276772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba80be0e0 msgr2=0x7fdba8150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.851+0000 7fdbaec00700 1 --2- 172.21.15.49:0/1463276772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba80be0e0 0x7fdba8150cf0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fdb98009d50 tx=0x7fdb98016000).stop 2024-01-22T05:14:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.851+0000 7fdbaec00700 1 -- 172.21.15.49:0/1463276772 shutdown_connections 2024-01-22T05:14:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.851+0000 7fdbaec00700 1 --2- 172.21.15.49:0/1463276772 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb8005a540 0x7fdb8005ca00 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.851+0000 7fdbaec00700 1 --2- 172.21.15.49:0/1463276772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba80bff40 0x7fdba80adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.851+0000 7fdbaec00700 1 --2- 172.21.15.49:0/1463276772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8153d60 0x7fdba8163eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.851+0000 7fdbaec00700 1 --2- 172.21.15.49:0/1463276772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba80be0e0 0x7fdba8150cf0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:45.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.851+0000 7fdbaec00700 1 -- 172.21.15.49:0/1463276772 >> 172.21.15.49:0/1463276772 conn(0x7fdba8064080 msgr2=0x7fdba8153630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.851+0000 7fdbaec00700 1 -- 172.21.15.49:0/1463276772 shutdown_connections 2024-01-22T05:14:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:45.851+0000 7fdbaec00700 1 -- 172.21.15.49:0/1463276772 wait complete. 2024-01-22T05:14:45.858 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 98 2024-01-22T05:14:45.878 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:14:46.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.039+0000 7f24c0200700 1 Processor -- start 2024-01-22T05:14:46.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.039+0000 7f24c0200700 1 -- start start 2024-01-22T05:14:46.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.039+0000 7f24c0200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f24b80a8740 0x7f24b80a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:46.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.039+0000 7f24c0200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b80c1a40 con 0x7f24b8155d20 2024-01-22T05:14:46.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.039+0000 7f24c0200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b80a90b0 con 0x7f24b80c1ed0 2024-01-22T05:14:46.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.039+0000 7f24c0200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b8159310 con 0x7f24b80a8740 2024-01-22T05:14:46.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24bd800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f24b8155d20 0x7f24b8065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34490/0 (socket says 172.21.15.49:34490) 2024-01-22T05:14:46.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24bd800700 1 -- 172.21.15.49:0/3497373941 learned_addr learned my addr 172.21.15.49:0/3497373941 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:46.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24bce00700 1 --2- 172.21.15.49:0/3497373941 >> v2:172.21.15.110:3300/0 conn(0x7f24b80a8740 0x7f24b80a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:46.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 -- 172.21.15.49:0/3497373941 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340816582 0 0) 0x7f24b80c1a40 con 0x7f24b8155d20 2024-01-22T05:14:46.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 -- 172.21.15.49:0/3497373941 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24980033f0 con 0x7f24b8155d20 2024-01-22T05:14:46.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 -- 172.21.15.49:0/3497373941 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3144003128 0 0) 0x7f24980033f0 con 0x7f24b8155d20 2024-01-22T05:14:46.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 -- 172.21.15.49:0/3497373941 >> v2:172.21.15.110:3300/0 conn(0x7f24b80a8740 msgr2=0x7f24b80a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:46.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 --2- 172.21.15.49:0/3497373941 >> v2:172.21.15.110:3300/0 conn(0x7f24b80a8740 0x7f24b80a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:46.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 -- 172.21.15.49:0/3497373941 >> v1:172.21.15.110:6789/0 conn(0x7f24b80c1ed0 legacy=0x7f24b80c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:46.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 -- 172.21.15.49:0/3497373941 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b80c13f0 con 0x7f24b8155d20 2024-01-22T05:14:46.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 -- 172.21.15.49:0/3497373941 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f24a8001470 con 0x7f24b8155d20 2024-01-22T05:14:46.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24bce00700 1 --2- 172.21.15.49:0/3497373941 >> v2:172.21.15.110:3300/0 conn(0x7f24b80a8740 0x7f24b80a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:46.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 -- 172.21.15.49:0/3497373941 >> v1:172.21.15.49:6789/0 conn(0x7f24b8155d20 legacy=0x7f24b8065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:46.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 --2- 172.21.15.49:0/3497373941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2498003930 0x7f2498003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:46.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 --2- 172.21.15.49:0/3497373941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2498004690 0x7f2498004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:46.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 --2- 172.21.15.49:0/3497373941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2498005000 0x7f249800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:46.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 -- 172.21.15.49:0/3497373941 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b8159310 con 0x7f2498004690 2024-01-22T05:14:46.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 -- 172.21.15.49:0/3497373941 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249800bfe0 con 0x7f2498003930 2024-01-22T05:14:46.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 -- 172.21.15.49:0/3497373941 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249800c1a0 con 0x7f2498005000 2024-01-22T05:14:46.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24bce00700 1 --2- 172.21.15.49:0/3497373941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2498004690 0x7f2498004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:46.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24bd800700 1 --2- 172.21.15.49:0/3497373941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2498003930 0x7f2498003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:46.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24be200700 1 --2- 172.21.15.49:0/3497373941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2498005000 0x7f249800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:46.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24bce00700 1 -- 172.21.15.49:0/3497373941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2498005000 msgr2=0x7f249800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:46.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24bce00700 1 --2- 172.21.15.49:0/3497373941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2498005000 0x7f249800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:46.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24bce00700 1 -- 172.21.15.49:0/3497373941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2498003930 msgr2=0x7f2498003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:46.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24bce00700 1 --2- 172.21.15.49:0/3497373941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2498003930 0x7f2498003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:46.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24bce00700 1 -- 172.21.15.49:0/3497373941 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24980033f0 con 0x7f2498004690 2024-01-22T05:14:46.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24bd800700 1 --2- 172.21.15.49:0/3497373941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2498003930 0x7f2498003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:46.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24be200700 1 -- 172.21.15.49:0/3497373941 reap_dead start 2024-01-22T05:14:46.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24bce00700 1 --2- 172.21.15.49:0/3497373941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2498004690 0x7f2498004b10 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f24a0009c70 tx=0x7f24a0009060).ready entity=mon.0 client_cookie=f1f7ff48d955f070 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:46.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 -- 172.21.15.49:0/3497373941 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a00095c0 con 0x7f2498004690 2024-01-22T05:14:46.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 -- 172.21.15.49:0/3497373941 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a000e690 con 0x7f2498004690 2024-01-22T05:14:46.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.043+0000 7f24b7e00700 1 -- 172.21.15.49:0/3497373941 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a000ea10 con 0x7f2498004690 2024-01-22T05:14:46.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.047+0000 7f24c0200700 1 -- 172.21.15.49:0/3497373941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2498004690 msgr2=0x7f2498004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:46.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.047+0000 7f24c0200700 1 --2- 172.21.15.49:0/3497373941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2498004690 0x7f2498004b10 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f24a0009c70 tx=0x7f24a0009060).stop 2024-01-22T05:14:46.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.047+0000 7f24c0200700 1 -- 172.21.15.49:0/3497373941 shutdown_connections 2024-01-22T05:14:46.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.047+0000 7f24c0200700 1 --2- 172.21.15.49:0/3497373941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2498004690 0x7f2498004b10 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:46.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.047+0000 7f24c0200700 1 -- 172.21.15.49:0/3497373941 >> 172.21.15.49:0/3497373941 conn(0x7f24b80c6540 msgr2=0x7f24b80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:46.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.047+0000 7f24c0200700 1 -- 172.21.15.49:0/3497373941 shutdown_connections 2024-01-22T05:14:46.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.047+0000 7f24c0200700 1 -- 172.21.15.49:0/3497373941 wait complete. 2024-01-22T05:14:46.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24c0200700 1 Processor -- start 2024-01-22T05:14:46.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24c0200700 1 -- start start 2024-01-22T05:14:46.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24c0200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2498004690 0x7f24b80ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:46.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24c0200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24b816bf60 0x7f24b80c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:46.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24c0200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b8169130 0x7f24b8169590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:46.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24c0200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b8168d10 con 0x7f24b8169130 2024-01-22T05:14:46.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24c0200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b8168990 con 0x7f24b816bf60 2024-01-22T05:14:46.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24c0200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b816c6d0 con 0x7f2498004690 2024-01-22T05:14:46.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24be200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b8169130 0x7f24b8169590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:46.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24bd800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2498004690 0x7f24b80ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:46.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24be200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b8169130 0x7f24b8169590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35304/0 (socket says 172.21.15.49:35304) 2024-01-22T05:14:46.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24be200700 1 -- 172.21.15.49:0/508053562 learned_addr learned my addr 172.21.15.49:0/508053562 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:46.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24bce00700 1 --2- 172.21.15.49:0/508053562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24b816bf60 0x7f24b80c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:46.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24bd800700 1 -- 172.21.15.49:0/508053562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24b816bf60 msgr2=0x7f24b80c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:46.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24bd800700 1 --2- 172.21.15.49:0/508053562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24b816bf60 0x7f24b80c01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:46.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24bd800700 1 -- 172.21.15.49:0/508053562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b8169130 msgr2=0x7f24b8169590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:46.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24bd800700 1 --2- 172.21.15.49:0/508053562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b8169130 0x7f24b8169590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:46.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.051+0000 7f24bd800700 1 -- 172.21.15.49:0/508053562 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b816c9b0 con 0x7f2498004690 2024-01-22T05:14:46.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.055+0000 7f24bd800700 1 --2- 172.21.15.49:0/508053562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2498004690 0x7f24b80ac130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f24a8000fd0 tx=0x7f24a8001d80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:46.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.055+0000 7f24b4c00700 1 -- 172.21.15.49:0/508053562 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a8011590 con 0x7f2498004690 2024-01-22T05:14:46.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.055+0000 7f24b4c00700 1 -- 172.21.15.49:0/508053562 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a80116f0 con 0x7f2498004690 2024-01-22T05:14:46.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.055+0000 7f24c0200700 1 -- 172.21.15.49:0/508053562 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b816cc90 con 0x7f2498004690 2024-01-22T05:14:46.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.055+0000 7f24b4c00700 1 -- 172.21.15.49:0/508053562 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a8011a90 con 0x7f2498004690 2024-01-22T05:14:46.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.055+0000 7f24c0200700 1 -- 172.21.15.49:0/508053562 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b80c0690 con 0x7f2498004690 2024-01-22T05:14:46.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.055+0000 7f24c0200700 1 -- 172.21.15.49:0/508053562 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b8047060 con 0x7f2498004690 2024-01-22T05:14:46.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.055+0000 7f24b4c00700 1 -- 172.21.15.49:0/508053562 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f24a801d3b0 con 0x7f2498004690 2024-01-22T05:14:46.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.059+0000 7f24b4c00700 1 --2- 172.21.15.49:0/508053562 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249005a510 0x7f249005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:46.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.059+0000 7f24b4c00700 1 -- 172.21.15.49:0/508053562 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f24a8074230 con 0x7f2498004690 2024-01-22T05:14:46.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.059+0000 7f24bce00700 1 --2- 172.21.15.49:0/508053562 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249005a510 0x7f249005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:46.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.059+0000 7f24bce00700 1 --2- 172.21.15.49:0/508053562 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249005a510 0x7f249005c9d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f24b80be8a0 tx=0x7f24a001a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:46.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.067+0000 7f24b4c00700 1 -- 172.21.15.49:0/508053562 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f24a80477d0 con 0x7f2498004690 2024-01-22T05:14:46.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.235+0000 7f24c0200700 1 -- 172.21.15.49:0/508053562 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24b8046800 con 0x7f2498004690 2024-01-22T05:14:46.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.239+0000 7f24b4c00700 1 -- 172.21.15.49:0/508053562 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17370 (secure 0 0 0) 0x7f24a8019020 con 0x7f2498004690 2024-01-22T05:14:46.242 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:46.242 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":119,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:14:27.362909+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:13:36.110138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-01-22T05:13:36.984415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.6","mappings":[{"from":5,"to":4}]},{"pgid":"16.2a","mappings":[{"from":1,"to":7}]},{"pgid":"17.5","mappings":[{"from":0,"to":5}]},{"pgid":"17.17","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:14:46.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.243+0000 7f24c0200700 1 -- 172.21.15.49:0/508053562 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249005a510 msgr2=0x7f249005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:46.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.243+0000 7f24c0200700 1 --2- 172.21.15.49:0/508053562 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249005a510 0x7f249005c9d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f24b80be8a0 tx=0x7f24a001a000).stop 2024-01-22T05:14:46.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.243+0000 7f24c0200700 1 -- 172.21.15.49:0/508053562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2498004690 msgr2=0x7f24b80ac130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:46.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.243+0000 7f24c0200700 1 --2- 172.21.15.49:0/508053562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2498004690 0x7f24b80ac130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f24a8000fd0 tx=0x7f24a8001d80).stop 2024-01-22T05:14:46.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.243+0000 7f24c0200700 1 -- 172.21.15.49:0/508053562 shutdown_connections 2024-01-22T05:14:46.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.243+0000 7f24c0200700 1 --2- 172.21.15.49:0/508053562 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f249005a510 0x7f249005c9d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:46.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.243+0000 7f24c0200700 1 --2- 172.21.15.49:0/508053562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b8169130 0x7f24b8169590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:46.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.243+0000 7f24c0200700 1 --2- 172.21.15.49:0/508053562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24b816bf60 0x7f24b80c01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:46.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.243+0000 7f24c0200700 1 --2- 172.21.15.49:0/508053562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2498004690 0x7f24b80ac130 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:46.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.243+0000 7f24c0200700 1 -- 172.21.15.49:0/508053562 >> 172.21.15.49:0/508053562 conn(0x7f24b80c6540 msgr2=0x7f24b80c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:46.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.247+0000 7f24c0200700 1 -- 172.21.15.49:0/508053562 shutdown_connections 2024-01-22T05:14:46.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.247+0000 7f24c0200700 1 -- 172.21.15.49:0/508053562 wait complete. 2024-01-22T05:14:46.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:14:46.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.439+0000 7fb009c00700 1 Processor -- start 2024-01-22T05:14:46.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.439+0000 7fb009c00700 1 -- start start 2024-01-22T05:14:46.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb009c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb004066fb0 0x7fb0040c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:46.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb009c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0040a8b10 0x7fb004157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:46.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb009c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0040c1ee0 con 0x7fb0040a8f90 2024-01-22T05:14:46.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb009c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0040c12f0 con 0x7fb004066fb0 2024-01-22T05:14:46.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb009c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0040c15b0 con 0x7fb0040a8b10 2024-01-22T05:14:46.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb003400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb0040a8f90 0x7fb004065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34500/0 (socket says 172.21.15.49:34500) 2024-01-22T05:14:46.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb003400700 1 -- 172.21.15.49:0/2766521829 learned_addr learned my addr 172.21.15.49:0/2766521829 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:46.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb002a00700 1 --2- 172.21.15.49:0/2766521829 >> v2:172.21.15.110:3300/0 conn(0x7fb004066fb0 0x7fb0040c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:46.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb002000700 1 --2- 172.21.15.49:0/2766521829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0040a8b10 0x7fb004157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:46.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb001600700 1 -- 172.21.15.49:0/2766521829 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197812540 0 0) 0x7fb0040c1ee0 con 0x7fb0040a8f90 2024-01-22T05:14:46.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb001600700 1 -- 172.21.15.49:0/2766521829 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe40033f0 con 0x7fb0040a8f90 2024-01-22T05:14:46.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb002a00700 1 -- 172.21.15.49:0/2766521829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0040a8b10 msgr2=0x7fb004157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:46.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb002a00700 1 --2- 172.21.15.49:0/2766521829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0040a8b10 0x7fb004157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:46.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb002a00700 1 -- 172.21.15.49:0/2766521829 >> v1:172.21.15.49:6789/0 conn(0x7fb0040a8f90 legacy=0x7fb004065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:46.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb002a00700 1 -- 172.21.15.49:0/2766521829 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0040c1890 con 0x7fb004066fb0 2024-01-22T05:14:46.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb002a00700 1 --2- 172.21.15.49:0/2766521829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb004066fb0 0x7fb0040c2370 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7faff4009760 tx=0x7faff4009060).ready entity=mon.1 client_cookie=b4c374454501f333 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:46.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb001600700 1 -- 172.21.15.49:0/2766521829 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff400d4a0 con 0x7fb004066fb0 2024-01-22T05:14:46.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb001600700 1 -- 172.21.15.49:0/2766521829 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff400d600 con 0x7fb004066fb0 2024-01-22T05:14:46.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.443+0000 7fb001600700 1 -- 172.21.15.49:0/2766521829 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff400d980 con 0x7fb004066fb0 2024-01-22T05:14:46.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.447+0000 7fb009c00700 1 -- 172.21.15.49:0/2766521829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb004066fb0 msgr2=0x7fb0040c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:46.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.447+0000 7fb009c00700 1 --2- 172.21.15.49:0/2766521829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb004066fb0 0x7fb0040c2370 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7faff4009760 tx=0x7faff4009060).stop 2024-01-22T05:14:46.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.447+0000 7fb009c00700 1 -- 172.21.15.49:0/2766521829 shutdown_connections 2024-01-22T05:14:46.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.447+0000 7fb009c00700 1 --2- 172.21.15.49:0/2766521829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0040a8b10 0x7fb004157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:46.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.447+0000 7fb009c00700 1 --2- 172.21.15.49:0/2766521829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb004066fb0 0x7fb0040c2370 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:46.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.447+0000 7fb009c00700 1 -- 172.21.15.49:0/2766521829 >> 172.21.15.49:0/2766521829 conn(0x7fb0040c6540 msgr2=0x7fb0040c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:46.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.447+0000 7fb009c00700 1 -- 172.21.15.49:0/2766521829 shutdown_connections 2024-01-22T05:14:46.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.447+0000 7fb009c00700 1 -- 172.21.15.49:0/2766521829 wait complete. 2024-01-22T05:14:46.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.447+0000 7fb009c00700 1 Processor -- start 2024-01-22T05:14:46.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb009c00700 1 -- start start 2024-01-22T05:14:46.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb009c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb004066fb0 0x7fb004149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:46.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb009c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0040a8b10 0x7fb0041463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:46.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb009c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0040a8f90 0x7fb0040ab720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:46.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb009c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0040ac560 con 0x7fb0040a8f90 2024-01-22T05:14:46.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb009c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00414a6d0 con 0x7fb0040a8b10 2024-01-22T05:14:46.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb009c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb004149760 con 0x7fb004066fb0 2024-01-22T05:14:46.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb003400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0040a8f90 0x7fb0040ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:46.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb003400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0040a8f90 0x7fb0040ab720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35316/0 (socket says 172.21.15.49:35316) 2024-01-22T05:14:46.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb003400700 1 -- 172.21.15.49:0/3494080002 learned_addr learned my addr 172.21.15.49:0/3494080002 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:46.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb002a00700 1 --2- 172.21.15.49:0/3494080002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb004066fb0 0x7fb004149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:46.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb002000700 1 --2- 172.21.15.49:0/3494080002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0040a8b10 0x7fb0041463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:46.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb003400700 1 -- 172.21.15.49:0/3494080002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb004066fb0 msgr2=0x7fb004149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb003400700 1 --2- 172.21.15.49:0/3494080002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb004066fb0 0x7fb004149270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb003400700 1 -- 172.21.15.49:0/3494080002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0040a8b10 msgr2=0x7fb0041463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb003400700 1 --2- 172.21.15.49:0/3494080002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0040a8b10 0x7fb0041463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb003400700 1 -- 172.21.15.49:0/3494080002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff40092a0 con 0x7fb0040a8f90 2024-01-22T05:14:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb002a00700 1 --2- 172.21.15.49:0/3494080002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb004066fb0 0x7fb004149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7fb003400700 1 --2- 172.21.15.49:0/3494080002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0040a8f90 0x7fb0040ab720 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7faffc00c6e0 tx=0x7faffc007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.451+0000 7faffa000700 1 -- 172.21.15.49:0/3494080002 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc005d30 con 0x7fb0040a8f90 2024-01-22T05:14:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.455+0000 7faffa000700 1 -- 172.21.15.49:0/3494080002 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc005e90 con 0x7fb0040a8f90 2024-01-22T05:14:46.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.455+0000 7fb009c00700 1 -- 172.21.15.49:0/3494080002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0041499e0 con 0x7fb0040a8f90 2024-01-22T05:14:46.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.455+0000 7faffa000700 1 -- 172.21.15.49:0/3494080002 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc007300 con 0x7fb0040a8f90 2024-01-22T05:14:46.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.455+0000 7fb009c00700 1 -- 172.21.15.49:0/3494080002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb004149fa0 con 0x7fb0040a8f90 2024-01-22T05:14:46.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.455+0000 7fb009c00700 1 -- 172.21.15.49:0/3494080002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb004047060 con 0x7fb0040a8f90 2024-01-22T05:14:46.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.455+0000 7faffa000700 1 -- 172.21.15.49:0/3494080002 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7faffc0076b0 con 0x7fb0040a8f90 2024-01-22T05:14:46.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.459+0000 7faffa000700 1 --2- 172.21.15.49:0/3494080002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fafdc05a510 0x7fafdc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:46.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.459+0000 7faffa000700 1 -- 172.21.15.49:0/3494080002 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6590+0+0 (secure 0 0 0) 0x7faffc074070 con 0x7fb0040a8f90 2024-01-22T05:14:46.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.459+0000 7fb002a00700 1 --2- 172.21.15.49:0/3494080002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fafdc05a510 0x7fafdc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:46.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.459+0000 7fb002a00700 1 --2- 172.21.15.49:0/3494080002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fafdc05a510 0x7fafdc05c9d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7faff400d260 tx=0x7faff4016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:46.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.463+0000 7faffa000700 1 -- 172.21.15.49:0/3494080002 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faffc047680 con 0x7fb0040a8f90 2024-01-22T05:14:46.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:46.663+0000 7fb009c00700 1 -- 172.21.15.49:0/3494080002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb004046800 con 0x7fb0040a8f90 2024-01-22T05:14:47.371 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:14:47.367+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:14:47.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.379+0000 7faffa000700 1 -- 172.21.15.49:0/3494080002 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v99) v1 ==== 161+0+0 (secure 0 0 0) 0x7faffc018070 con 0x7fb0040a8f90 2024-01-22T05:14:47.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.383+0000 7fb009c00700 1 -- 172.21.15.49:0/3494080002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fafdc05a510 msgr2=0x7fafdc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:47.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.383+0000 7fb009c00700 1 --2- 172.21.15.49:0/3494080002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fafdc05a510 0x7fafdc05c9d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7faff400d260 tx=0x7faff4016000).stop 2024-01-22T05:14:47.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.383+0000 7fb009c00700 1 -- 172.21.15.49:0/3494080002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0040a8f90 msgr2=0x7fb0040ab720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:47.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.383+0000 7fb009c00700 1 --2- 172.21.15.49:0/3494080002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0040a8f90 0x7fb0040ab720 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7faffc00c6e0 tx=0x7faffc007f70).stop 2024-01-22T05:14:47.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.383+0000 7fb009c00700 1 -- 172.21.15.49:0/3494080002 shutdown_connections 2024-01-22T05:14:47.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.383+0000 7fb009c00700 1 --2- 172.21.15.49:0/3494080002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fafdc05a510 0x7fafdc05c9d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:47.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.383+0000 7fb009c00700 1 --2- 172.21.15.49:0/3494080002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0040a8f90 0x7fb0040ab720 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:47.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.383+0000 7fb009c00700 1 --2- 172.21.15.49:0/3494080002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0040a8b10 0x7fb0041463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:47.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.383+0000 7fb009c00700 1 --2- 172.21.15.49:0/3494080002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb004066fb0 0x7fb004149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:47.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.383+0000 7fb009c00700 1 -- 172.21.15.49:0/3494080002 >> 172.21.15.49:0/3494080002 conn(0x7fb0040c6540 msgr2=0x7fb004154010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:47.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.383+0000 7fb009c00700 1 -- 172.21.15.49:0/3494080002 shutdown_connections 2024-01-22T05:14:47.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.383+0000 7fb009c00700 1 -- 172.21.15.49:0/3494080002 wait complete. 2024-01-22T05:14:47.389 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:14:47.410 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:14:47.452 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:14:47.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.575+0000 7f1e47800700 1 Processor -- start 2024-01-22T05:14:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.575+0000 7f1e47800700 1 -- start start 2024-01-22T05:14:47.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e47800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1e401524f0 0x7f1e40066400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:47.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e47800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e4015bad0 0x7f1e4015bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:47.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e47800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1e400a8760 0x7f1e400a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e47800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e400bd3e0 con 0x7f1e401524f0 2024-01-22T05:14:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e47800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e40067c50 con 0x7f1e400a8760 2024-01-22T05:14:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e47800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4015c440 con 0x7f1e4015bad0 2024-01-22T05:14:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e44e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1e401524f0 0x7f1e40066400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e3fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e4015bad0 0x7f1e4015bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:47.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e45800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1e400a8760 0x7f1e400a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e3fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e4015bad0 0x7f1e4015bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:48546/0 (socket says 172.21.15.49:48546) 2024-01-22T05:14:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e3fe00700 1 -- 172.21.15.49:0/452255290 learned_addr learned my addr 172.21.15.49:0/452255290 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e3fe00700 1 -- 172.21.15.49:0/452255290 >> v2:172.21.15.110:3300/0 conn(0x7f1e400a8760 msgr2=0x7f1e400a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e3fe00700 1 --2- 172.21.15.49:0/452255290 >> v2:172.21.15.110:3300/0 conn(0x7f1e400a8760 0x7f1e400a8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e3fe00700 1 -- 172.21.15.49:0/452255290 >> v2:172.21.15.49:3300/0 conn(0x7f1e401524f0 msgr2=0x7f1e40066400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e3fe00700 1 --2- 172.21.15.49:0/452255290 >> v2:172.21.15.49:3300/0 conn(0x7f1e401524f0 0x7f1e40066400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.579+0000 7f1e3fe00700 1 -- 172.21.15.49:0/452255290 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e400bcb40 con 0x7f1e4015bad0 2024-01-22T05:14:47.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.583+0000 7f1e3fe00700 1 --2- 172.21.15.49:0/452255290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e4015bad0 0x7f1e4015bf50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f1e400c2fd0 tx=0x7f1e280090f0).ready entity=mon.2 client_cookie=2a92a8d3dac9f840 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:47.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.583+0000 7f1e3f400700 1 -- 172.21.15.49:0/452255290 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2800f510 con 0x7f1e4015bad0 2024-01-22T05:14:47.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.583+0000 7f1e3f400700 1 -- 172.21.15.49:0/452255290 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2800f670 con 0x7f1e4015bad0 2024-01-22T05:14:47.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.583+0000 7f1e3f400700 1 -- 172.21.15.49:0/452255290 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2800fa10 con 0x7f1e4015bad0 2024-01-22T05:14:47.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.583+0000 7f1e47800700 1 -- 172.21.15.49:0/452255290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e4015bad0 msgr2=0x7f1e4015bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:47.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.583+0000 7f1e47800700 1 --2- 172.21.15.49:0/452255290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e4015bad0 0x7f1e4015bf50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f1e400c2fd0 tx=0x7f1e280090f0).stop 2024-01-22T05:14:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.583+0000 7f1e47800700 1 -- 172.21.15.49:0/452255290 shutdown_connections 2024-01-22T05:14:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.583+0000 7f1e47800700 1 --2- 172.21.15.49:0/452255290 >> v2:172.21.15.110:3300/0 conn(0x7f1e400a8760 0x7f1e400a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.583+0000 7f1e47800700 1 --2- 172.21.15.49:0/452255290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e4015bad0 0x7f1e4015bf50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.583+0000 7f1e47800700 1 --2- 172.21.15.49:0/452255290 >> v2:172.21.15.49:3300/0 conn(0x7f1e401524f0 0x7f1e40066400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.583+0000 7f1e47800700 1 -- 172.21.15.49:0/452255290 >> 172.21.15.49:0/452255290 conn(0x7f1e400c6560 msgr2=0x7f1e400c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.583+0000 7f1e47800700 1 -- 172.21.15.49:0/452255290 shutdown_connections 2024-01-22T05:14:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.583+0000 7f1e47800700 1 -- 172.21.15.49:0/452255290 wait complete. 2024-01-22T05:14:47.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.587+0000 7f1e47800700 1 Processor -- start 2024-01-22T05:14:47.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.587+0000 7f1e47800700 1 -- start start 2024-01-22T05:14:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e47800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e400a8760 0x7f1e40155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e47800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e401524f0 0x7f1e4016b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e47800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e4015bad0 0x7f1e400c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e47800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400c6280 con 0x7f1e400a8760 2024-01-22T05:14:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e47800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4013f320 con 0x7f1e401524f0 2024-01-22T05:14:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e47800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4016b070 con 0x7f1e4015bad0 2024-01-22T05:14:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e44e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e400a8760 0x7f1e40155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e44e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e400a8760 0x7f1e40155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35340/0 (socket says 172.21.15.49:35340) 2024-01-22T05:14:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e44e00700 1 -- 172.21.15.49:0/3443806885 learned_addr learned my addr 172.21.15.49:0/3443806885 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e45800700 1 --2- 172.21.15.49:0/3443806885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e4015bad0 0x7f1e400c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e3fe00700 1 --2- 172.21.15.49:0/3443806885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e401524f0 0x7f1e4016b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e44e00700 1 -- 172.21.15.49:0/3443806885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e4015bad0 msgr2=0x7f1e400c1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e44e00700 1 --2- 172.21.15.49:0/3443806885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e4015bad0 0x7f1e400c1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e44e00700 1 -- 172.21.15.49:0/3443806885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e401524f0 msgr2=0x7f1e4016b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e44e00700 1 --2- 172.21.15.49:0/3443806885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e401524f0 0x7f1e4016b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e44e00700 1 -- 172.21.15.49:0/3443806885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e28009370 con 0x7f1e400a8760 2024-01-22T05:14:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e3fe00700 1 --2- 172.21.15.49:0/3443806885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e401524f0 0x7f1e4016b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e44e00700 1 --2- 172.21.15.49:0/3443806885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e400a8760 0x7f1e40155460 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f1e3000e960 tx=0x7f1e30009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e37e00700 1 -- 172.21.15.49:0/3443806885 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3000c6a0 con 0x7f1e400a8760 2024-01-22T05:14:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e37e00700 1 -- 172.21.15.49:0/3443806885 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3000c800 con 0x7f1e400a8760 2024-01-22T05:14:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e37e00700 1 -- 172.21.15.49:0/3443806885 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3000cb80 con 0x7f1e400a8760 2024-01-22T05:14:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e47800700 1 -- 172.21.15.49:0/3443806885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4016a460 con 0x7f1e400a8760 2024-01-22T05:14:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.591+0000 7f1e47800700 1 -- 172.21.15.49:0/3443806885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4016aa20 con 0x7f1e400a8760 2024-01-22T05:14:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.595+0000 7f1e47800700 1 -- 172.21.15.49:0/3443806885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e40047060 con 0x7f1e400a8760 2024-01-22T05:14:47.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.595+0000 7f1e37e00700 1 -- 172.21.15.49:0/3443806885 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1e3001b400 con 0x7f1e400a8760 2024-01-22T05:14:47.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.595+0000 7f1e37e00700 1 --2- 172.21.15.49:0/3443806885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e1805a540 0x7f1e1805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:47.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.595+0000 7f1e37e00700 1 -- 172.21.15.49:0/3443806885 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6676+0+0 (secure 0 0 0) 0x7f1e30074e70 con 0x7f1e400a8760 2024-01-22T05:14:47.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.595+0000 7f1e3fe00700 1 --2- 172.21.15.49:0/3443806885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e1805a540 0x7f1e1805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:47.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.599+0000 7f1e3fe00700 1 --2- 172.21.15.49:0/3443806885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e1805a540 0x7f1e1805ca00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f1e400c5710 tx=0x7f1e28017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:47.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.603+0000 7f1e37e00700 1 -- 172.21.15.49:0/3443806885 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1e300483c0 con 0x7f1e400a8760 2024-01-22T05:14:47.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:47.807+0000 7f1e47800700 1 -- 172.21.15.49:0/3443806885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1e400bce20 con 0x7f1e400a8760 2024-01-22T05:14:48.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.399+0000 7f1e37e00700 1 -- 172.21.15.49:0/3443806885 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v100) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1e3004b9e0 con 0x7f1e400a8760 2024-01-22T05:14:48.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.403+0000 7f1e47800700 1 -- 172.21.15.49:0/3443806885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e1805a540 msgr2=0x7f1e1805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:48.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.403+0000 7f1e47800700 1 --2- 172.21.15.49:0/3443806885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e1805a540 0x7f1e1805ca00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f1e400c5710 tx=0x7f1e28017000).stop 2024-01-22T05:14:48.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.403+0000 7f1e47800700 1 -- 172.21.15.49:0/3443806885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e400a8760 msgr2=0x7f1e40155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:48.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.403+0000 7f1e47800700 1 --2- 172.21.15.49:0/3443806885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e400a8760 0x7f1e40155460 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f1e3000e960 tx=0x7f1e30009060).stop 2024-01-22T05:14:48.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.403+0000 7f1e47800700 1 -- 172.21.15.49:0/3443806885 shutdown_connections 2024-01-22T05:14:48.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.403+0000 7f1e47800700 1 --2- 172.21.15.49:0/3443806885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1e1805a540 0x7f1e1805ca00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:48.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.403+0000 7f1e47800700 1 --2- 172.21.15.49:0/3443806885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e4015bad0 0x7f1e400c1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:48.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.403+0000 7f1e47800700 1 --2- 172.21.15.49:0/3443806885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e401524f0 0x7f1e4016b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:48.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.403+0000 7f1e47800700 1 --2- 172.21.15.49:0/3443806885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e400a8760 0x7f1e40155460 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:48.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.403+0000 7f1e47800700 1 -- 172.21.15.49:0/3443806885 >> 172.21.15.49:0/3443806885 conn(0x7f1e400c6560 msgr2=0x7f1e400bf610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:48.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.403+0000 7f1e47800700 1 -- 172.21.15.49:0/3443806885 shutdown_connections 2024-01-22T05:14:48.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.403+0000 7f1e47800700 1 -- 172.21.15.49:0/3443806885 wait complete. 2024-01-22T05:14:48.430 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:14:48.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.599+0000 7efd0a400700 1 Processor -- start 2024-01-22T05:14:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.603+0000 7efd0a400700 1 -- start start 2024-01-22T05:14:48.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd0a400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd040ac3b0 0x7efd04159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:48.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd0a400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd040a7cb0 con 0x7efd0415fbc0 2024-01-22T05:14:48.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd0a400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd040a8b10 con 0x7efd04066690 2024-01-22T05:14:48.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd0a400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd040a7f00 con 0x7efd040ac3b0 2024-01-22T05:14:48.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd03e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efd0415fbc0 0x7efd04161fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34506/0 (socket says 172.21.15.49:34506) 2024-01-22T05:14:48.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd03e00700 1 -- 172.21.15.49:0/4080122785 learned_addr learned my addr 172.21.15.49:0/4080122785 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:48.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd03400700 1 --2- 172.21.15.49:0/4080122785 >> v2:172.21.15.110:3300/0 conn(0x7efd040ac3b0 0x7efd04159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:48.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440141115 0 0) 0x7efd040a7cb0 con 0x7efd0415fbc0 2024-01-22T05:14:48.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efce40033f0 con 0x7efd0415fbc0 2024-01-22T05:14:48.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110914083 0 0) 0x7efd040a8b10 con 0x7efd04066690 2024-01-22T05:14:48.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd040a7cb0 con 0x7efd04066690 2024-01-22T05:14:48.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 874044990 0 0) 0x7efce40033f0 con 0x7efd0415fbc0 2024-01-22T05:14:48.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 >> v2:172.21.15.110:3300/0 conn(0x7efd040ac3b0 msgr2=0x7efd04159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:48.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 --2- 172.21.15.49:0/4080122785 >> v2:172.21.15.110:3300/0 conn(0x7efd040ac3b0 0x7efd04159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:48.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 >> v1:172.21.15.110:6789/0 conn(0x7efd04066690 legacy=0x7efd04066af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:48.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd040a81e0 con 0x7efd0415fbc0 2024-01-22T05:14:48.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7efcfc0017f0 con 0x7efd0415fbc0 2024-01-22T05:14:48.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 >> v1:172.21.15.49:6789/0 conn(0x7efd0415fbc0 legacy=0x7efd04161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:48.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 --2- 172.21.15.49:0/4080122785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce4003a70 0x7efce4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:48.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 --2- 172.21.15.49:0/4080122785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efce4004690 0x7efce4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:48.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 --2- 172.21.15.49:0/4080122785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efce4005000 0x7efce400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:48.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd040a7f00 con 0x7efce4003a70 2024-01-22T05:14:48.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce400bf60 con 0x7efce4004690 2024-01-22T05:14:48.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.607+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce400c0d0 con 0x7efce4005000 2024-01-22T05:14:48.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.611+0000 7efd03400700 1 --2- 172.21.15.49:0/4080122785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce4003a70 0x7efce4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:48.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.611+0000 7efd03e00700 1 --2- 172.21.15.49:0/4080122785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efce4005000 0x7efce400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:48.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.611+0000 7efd02a00700 1 --2- 172.21.15.49:0/4080122785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efce4004690 0x7efce4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.611+0000 7efd03400700 1 -- 172.21.15.49:0/4080122785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efce4005000 msgr2=0x7efce400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.611+0000 7efd03400700 1 --2- 172.21.15.49:0/4080122785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efce4005000 0x7efce400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.611+0000 7efd03400700 1 -- 172.21.15.49:0/4080122785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efce4004690 msgr2=0x7efce4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.611+0000 7efd03400700 1 --2- 172.21.15.49:0/4080122785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efce4004690 0x7efce4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.611+0000 7efd03400700 1 -- 172.21.15.49:0/4080122785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce40033f0 con 0x7efce4003a70 2024-01-22T05:14:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.611+0000 7efd03e00700 1 -- 172.21.15.49:0/4080122785 reap_dead start 2024-01-22T05:14:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.611+0000 7efd03400700 1 --2- 172.21.15.49:0/4080122785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce4003a70 0x7efce4003e70 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7efcf4009a80 tx=0x7efcf4009060).ready entity=mon.0 client_cookie=56b8f541b6f90aa2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.611+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf4009430 con 0x7efce4003a70 2024-01-22T05:14:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.611+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf400e640 con 0x7efce4003a70 2024-01-22T05:14:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.611+0000 7efd02000700 1 -- 172.21.15.49:0/4080122785 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf400e9c0 con 0x7efce4003a70 2024-01-22T05:14:48.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.611+0000 7efd0a400700 1 -- 172.21.15.49:0/4080122785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce4003a70 msgr2=0x7efce4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:48.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.611+0000 7efd0a400700 1 --2- 172.21.15.49:0/4080122785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce4003a70 0x7efce4003e70 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7efcf4009a80 tx=0x7efcf4009060).stop 2024-01-22T05:14:48.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.615+0000 7efd0a400700 1 -- 172.21.15.49:0/4080122785 shutdown_connections 2024-01-22T05:14:48.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.615+0000 7efd0a400700 1 --2- 172.21.15.49:0/4080122785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce4003a70 0x7efce4003e70 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:48.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.615+0000 7efd0a400700 1 -- 172.21.15.49:0/4080122785 >> 172.21.15.49:0/4080122785 conn(0x7efd040c6500 msgr2=0x7efd040c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:48.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.615+0000 7efd0a400700 1 -- 172.21.15.49:0/4080122785 shutdown_connections 2024-01-22T05:14:48.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.615+0000 7efd0a400700 1 -- 172.21.15.49:0/4080122785 wait complete. 2024-01-22T05:14:48.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.615+0000 7efd0a400700 1 Processor -- start 2024-01-22T05:14:48.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd0a400700 1 -- start start 2024-01-22T05:14:48.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd0a400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce4003a70 0x7efd041505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:48.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd0a400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd0414ede0 0x7efd0416c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:48.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd0a400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd0416c580 0x7efd04149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:48.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd0a400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd04150ae0 con 0x7efce4003a70 2024-01-22T05:14:48.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd0a400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd041596e0 con 0x7efd0416c580 2024-01-22T05:14:48.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd0a400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0414f530 con 0x7efd0414ede0 2024-01-22T05:14:48.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd03400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce4003a70 0x7efd041505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:48.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd03400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce4003a70 0x7efd041505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35352/0 (socket says 172.21.15.49:35352) 2024-01-22T05:14:48.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd03400700 1 -- 172.21.15.49:0/2718680002 learned_addr learned my addr 172.21.15.49:0/2718680002 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:48.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd03e00700 1 --2- 172.21.15.49:0/2718680002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd0416c580 0x7efd04149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:48.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd02a00700 1 --2- 172.21.15.49:0/2718680002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd0414ede0 0x7efd0416c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:48.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd03400700 1 -- 172.21.15.49:0/2718680002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd0414ede0 msgr2=0x7efd0416c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:48.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd03400700 1 --2- 172.21.15.49:0/2718680002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd0414ede0 0x7efd0416c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:48.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd03400700 1 -- 172.21.15.49:0/2718680002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd0416c580 msgr2=0x7efd04149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:48.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd03400700 1 --2- 172.21.15.49:0/2718680002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd0416c580 0x7efd04149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:48.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd03400700 1 -- 172.21.15.49:0/2718680002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0414f810 con 0x7efce4003a70 2024-01-22T05:14:48.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.619+0000 7efd03400700 1 --2- 172.21.15.49:0/2718680002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce4003a70 0x7efd041505f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7efcf400e4b0 tx=0x7efcf401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:48.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.623+0000 7efcfaa00700 1 -- 172.21.15.49:0/2718680002 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf400ed30 con 0x7efce4003a70 2024-01-22T05:14:48.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.623+0000 7efcfaa00700 1 -- 172.21.15.49:0/2718680002 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf400eeb0 con 0x7efce4003a70 2024-01-22T05:14:48.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.623+0000 7efd0a400700 1 -- 172.21.15.49:0/2718680002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0414faf0 con 0x7efce4003a70 2024-01-22T05:14:48.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.623+0000 7efcfaa00700 1 -- 172.21.15.49:0/2718680002 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf4025440 con 0x7efce4003a70 2024-01-22T05:14:48.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.623+0000 7efd0a400700 1 -- 172.21.15.49:0/2718680002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0414f220 con 0x7efce4003a70 2024-01-22T05:14:48.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.623+0000 7efd0a400700 1 -- 172.21.15.49:0/2718680002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd040c0ba0 con 0x7efce4003a70 2024-01-22T05:14:48.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.623+0000 7efcfaa00700 1 -- 172.21.15.49:0/2718680002 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7efcf402e440 con 0x7efce4003a70 2024-01-22T05:14:48.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.623+0000 7efcfaa00700 1 --2- 172.21.15.49:0/2718680002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efcdc05a510 0x7efcdc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:48.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.623+0000 7efcfaa00700 1 -- 172.21.15.49:0/2718680002 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6676+0+0 (secure 0 0 0) 0x7efcf40762c0 con 0x7efce4003a70 2024-01-22T05:14:48.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.627+0000 7efd02a00700 1 --2- 172.21.15.49:0/2718680002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efcdc05a510 0x7efcdc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:48.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.627+0000 7efd02a00700 1 --2- 172.21.15.49:0/2718680002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efcdc05a510 0x7efcdc05c9d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7efd0414cdd0 tx=0x7efcec007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.631+0000 7efcfaa00700 1 -- 172.21.15.49:0/2718680002 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efcf4049750 con 0x7efce4003a70 2024-01-22T05:14:48.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:48.795+0000 7efd0a400700 1 -- 172.21.15.49:0/2718680002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efd040a84c0 con 0x7efce4003a70 2024-01-22T05:14:49.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.407+0000 7efcfaa00700 1 -- 172.21.15.49:0/2718680002 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v121) v1 ==== 181+0+0 (secure 0 0 0) 0x7efcf40160d0 con 0x7efce4003a70 2024-01-22T05:14:49.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.415+0000 7efd0a400700 1 -- 172.21.15.49:0/2718680002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efcdc05a510 msgr2=0x7efcdc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:49.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.415+0000 7efd0a400700 1 --2- 172.21.15.49:0/2718680002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efcdc05a510 0x7efcdc05c9d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7efd0414cdd0 tx=0x7efcec007bb0).stop 2024-01-22T05:14:49.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.415+0000 7efd0a400700 1 -- 172.21.15.49:0/2718680002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce4003a70 msgr2=0x7efd041505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:49.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.415+0000 7efd0a400700 1 --2- 172.21.15.49:0/2718680002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce4003a70 0x7efd041505f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7efcf400e4b0 tx=0x7efcf401a000).stop 2024-01-22T05:14:49.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.415+0000 7efd0a400700 1 -- 172.21.15.49:0/2718680002 shutdown_connections 2024-01-22T05:14:49.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.415+0000 7efd0a400700 1 --2- 172.21.15.49:0/2718680002 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efcdc05a510 0x7efcdc05c9d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:49.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.415+0000 7efd0a400700 1 --2- 172.21.15.49:0/2718680002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd0416c580 0x7efd04149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:49.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.415+0000 7efd0a400700 1 --2- 172.21.15.49:0/2718680002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd0414ede0 0x7efd0416c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:49.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.415+0000 7efd0a400700 1 --2- 172.21.15.49:0/2718680002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce4003a70 0x7efd041505f0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:49.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.415+0000 7efd0a400700 1 -- 172.21.15.49:0/2718680002 >> 172.21.15.49:0/2718680002 conn(0x7efd040c6500 msgr2=0x7efd0414cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:49.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.415+0000 7efd0a400700 1 -- 172.21.15.49:0/2718680002 shutdown_connections 2024-01-22T05:14:49.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.415+0000 7efd0a400700 1 -- 172.21.15.49:0/2718680002 wait complete. 2024-01-22T05:14:49.421 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:14:49.441 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:14:49.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.619+0000 7f3ce2c00700 1 Processor -- start 2024-01-22T05:14:49.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.623+0000 7f3ce2c00700 1 -- start start 2024-01-22T05:14:49.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.623+0000 7f3ce2c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cdc1518d0 0x7f3cdc068c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:49.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.623+0000 7f3ce2c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cdc0bc580 con 0x7f3cdc064530 2024-01-22T05:14:49.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3ce2c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cdc0bd3e0 con 0x7f3cdc151cb0 2024-01-22T05:14:49.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3ce2c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0bc7d0 con 0x7f3cdc1518d0 2024-01-22T05:14:49.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3cdbe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cdc1518d0 0x7f3cdc068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:49.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3ce0c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3cdc064530 0x7f3cdc0bd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34518/0 (socket says 172.21.15.49:34518) 2024-01-22T05:14:49.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3ce0c00700 1 -- 172.21.15.49:0/2335869604 learned_addr learned my addr 172.21.15.49:0/2335869604 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:49.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3cdb400700 1 --1- 172.21.15.49:0/2335869604 >> v1:172.21.15.110:6789/0 conn(0x7f3cdc151cb0 0x7f3cdc063e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:34466/0 (socket says 172.21.15.49:34466) 2024-01-22T05:14:49.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3cdaa00700 1 -- 172.21.15.49:0/2335869604 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515709095 0 0) 0x7f3cdc0bc580 con 0x7f3cdc064530 2024-01-22T05:14:49.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3cdaa00700 1 -- 172.21.15.49:0/2335869604 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cbc0033f0 con 0x7f3cdc064530 2024-01-22T05:14:49.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3cdaa00700 1 -- 172.21.15.49:0/2335869604 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834031416 0 0) 0x7f3cdc0bd3e0 con 0x7f3cdc151cb0 2024-01-22T05:14:49.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3cdaa00700 1 -- 172.21.15.49:0/2335869604 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cdc0bc580 con 0x7f3cdc151cb0 2024-01-22T05:14:49.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3cdbe00700 1 -- 172.21.15.49:0/2335869604 >> v1:172.21.15.110:6789/0 conn(0x7f3cdc151cb0 legacy=0x7f3cdc063e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:49.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3cdbe00700 1 -- 172.21.15.49:0/2335869604 >> v1:172.21.15.49:6789/0 conn(0x7f3cdc064530 legacy=0x7f3cdc0bd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:49.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3cdbe00700 1 -- 172.21.15.49:0/2335869604 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc0bcab0 con 0x7f3cdc1518d0 2024-01-22T05:14:49.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3cdbe00700 1 --2- 172.21.15.49:0/2335869604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cdc1518d0 0x7f3cdc068c50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f3ccc009760 tx=0x7f3ccc006f40).ready entity=mon.2 client_cookie=d5319a0e0231adc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:49.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3cdaa00700 1 -- 172.21.15.49:0/2335869604 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc005880 con 0x7f3cdc1518d0 2024-01-22T05:14:49.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3cdaa00700 1 -- 172.21.15.49:0/2335869604 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc0059e0 con 0x7f3cdc1518d0 2024-01-22T05:14:49.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.627+0000 7f3cdaa00700 1 -- 172.21.15.49:0/2335869604 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc005d60 con 0x7f3cdc1518d0 2024-01-22T05:14:49.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.631+0000 7f3ce2c00700 1 -- 172.21.15.49:0/2335869604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cdc1518d0 msgr2=0x7f3cdc068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:49.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.631+0000 7f3ce2c00700 1 --2- 172.21.15.49:0/2335869604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cdc1518d0 0x7f3cdc068c50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f3ccc009760 tx=0x7f3ccc006f40).stop 2024-01-22T05:14:49.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.631+0000 7f3ce2c00700 1 -- 172.21.15.49:0/2335869604 shutdown_connections 2024-01-22T05:14:49.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.631+0000 7f3ce2c00700 1 --2- 172.21.15.49:0/2335869604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cdc1518d0 0x7f3cdc068c50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:49.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.631+0000 7f3ce2c00700 1 -- 172.21.15.49:0/2335869604 >> 172.21.15.49:0/2335869604 conn(0x7f3cdc066830 msgr2=0x7f3cdc066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:49.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.631+0000 7f3ce2c00700 1 -- 172.21.15.49:0/2335869604 shutdown_connections 2024-01-22T05:14:49.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.631+0000 7f3ce2c00700 1 -- 172.21.15.49:0/2335869604 wait complete. 2024-01-22T05:14:49.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.635+0000 7f3ce2c00700 1 Processor -- start 2024-01-22T05:14:49.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.635+0000 7f3ce2c00700 1 -- start start 2024-01-22T05:14:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3ce2c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cdc064530 0x7f3cdc162110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3ce2c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc1518d0 0x7f3cdc148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3ce2c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cdc151cb0 0x7f3cdc0ac170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3ce2c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc1520b0 con 0x7f3cdc1518d0 2024-01-22T05:14:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3ce2c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc152ed0 con 0x7f3cdc064530 2024-01-22T05:14:49.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3ce2c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc1496e0 con 0x7f3cdc151cb0 2024-01-22T05:14:49.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3cdb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc1518d0 0x7f3cdc148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:49.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3cdb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc1518d0 0x7f3cdc148c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35364/0 (socket says 172.21.15.49:35364) 2024-01-22T05:14:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3cdb400700 1 -- 172.21.15.49:0/2533926452 learned_addr learned my addr 172.21.15.49:0/2533926452 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3ce0c00700 1 --2- 172.21.15.49:0/2533926452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cdc151cb0 0x7f3cdc0ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3cdbe00700 1 --2- 172.21.15.49:0/2533926452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cdc064530 0x7f3cdc162110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3cdb400700 1 -- 172.21.15.49:0/2533926452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cdc151cb0 msgr2=0x7f3cdc0ac170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3cdb400700 1 --2- 172.21.15.49:0/2533926452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cdc151cb0 0x7f3cdc0ac170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3cdb400700 1 -- 172.21.15.49:0/2533926452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cdc064530 msgr2=0x7f3cdc162110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3cdb400700 1 --2- 172.21.15.49:0/2533926452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cdc064530 0x7f3cdc162110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3cdb400700 1 -- 172.21.15.49:0/2533926452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc009250 con 0x7f3cdc1518d0 2024-01-22T05:14:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3cdb400700 1 --2- 172.21.15.49:0/2533926452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc1518d0 0x7f3cdc148c50 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f3cc400c3a0 tx=0x7f3cc4007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3cd3400700 1 -- 172.21.15.49:0/2533926452 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40070d0 con 0x7f3cdc1518d0 2024-01-22T05:14:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3cd3400700 1 -- 172.21.15.49:0/2533926452 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc4007230 con 0x7f3cdc1518d0 2024-01-22T05:14:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3cd3400700 1 -- 172.21.15.49:0/2533926452 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40056e0 con 0x7f3cdc1518d0 2024-01-22T05:14:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.639+0000 7f3ce2c00700 1 -- 172.21.15.49:0/2533926452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc1522c0 con 0x7f3cdc1518d0 2024-01-22T05:14:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.643+0000 7f3ce2c00700 1 -- 172.21.15.49:0/2533926452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc152880 con 0x7f3cdc1518d0 2024-01-22T05:14:49.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.643+0000 7f3ce2c00700 1 -- 172.21.15.49:0/2533926452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc0657b0 con 0x7f3cdc1518d0 2024-01-22T05:14:49.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.643+0000 7f3cd3400700 1 -- 172.21.15.49:0/2533926452 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3cc4005b10 con 0x7f3cdc1518d0 2024-01-22T05:14:49.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.647+0000 7f3cd3400700 1 --2- 172.21.15.49:0/2533926452 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3cb405a510 0x7f3cb405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:49.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.647+0000 7f3cd3400700 1 -- 172.21.15.49:0/2533926452 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f3cc4073f00 con 0x7f3cdc1518d0 2024-01-22T05:14:49.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.647+0000 7f3cdbe00700 1 --2- 172.21.15.49:0/2533926452 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3cb405a510 0x7f3cb405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:49.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.651+0000 7f3cdbe00700 1 --2- 172.21.15.49:0/2533926452 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3cb405a510 0x7f3cb405c9d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f3ccc006fa0 tx=0x7f3ccc015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:49.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.655+0000 7f3cd3400700 1 -- 172.21.15.49:0/2533926452 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3cc40475e0 con 0x7f3cdc1518d0 2024-01-22T05:14:49.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:49.815+0000 7f3ce2c00700 1 -- 172.21.15.49:0/2533926452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3cdc0bcd90 con 0x7f3cdc1518d0 2024-01-22T05:14:50.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.415+0000 7f3cd3400700 1 -- 172.21.15.49:0/2533926452 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v122) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3cc404ac00 con 0x7f3cdc1518d0 2024-01-22T05:14:50.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.423+0000 7f3ce2c00700 1 -- 172.21.15.49:0/2533926452 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3cb405a510 msgr2=0x7f3cb405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:50.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.423+0000 7f3ce2c00700 1 --2- 172.21.15.49:0/2533926452 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3cb405a510 0x7f3cb405c9d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f3ccc006fa0 tx=0x7f3ccc015000).stop 2024-01-22T05:14:50.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.423+0000 7f3ce2c00700 1 -- 172.21.15.49:0/2533926452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc1518d0 msgr2=0x7f3cdc148c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:50.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.423+0000 7f3ce2c00700 1 --2- 172.21.15.49:0/2533926452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc1518d0 0x7f3cdc148c50 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f3cc400c3a0 tx=0x7f3cc4007c20).stop 2024-01-22T05:14:50.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.423+0000 7f3ce2c00700 1 -- 172.21.15.49:0/2533926452 shutdown_connections 2024-01-22T05:14:50.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.423+0000 7f3ce2c00700 1 --2- 172.21.15.49:0/2533926452 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3cb405a510 0x7f3cb405c9d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:50.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.423+0000 7f3ce2c00700 1 --2- 172.21.15.49:0/2533926452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cdc151cb0 0x7f3cdc0ac170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:50.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.423+0000 7f3ce2c00700 1 --2- 172.21.15.49:0/2533926452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cdc1518d0 0x7f3cdc148c50 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:50.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.423+0000 7f3ce2c00700 1 --2- 172.21.15.49:0/2533926452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cdc064530 0x7f3cdc162110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:50.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.423+0000 7f3ce2c00700 1 -- 172.21.15.49:0/2533926452 >> 172.21.15.49:0/2533926452 conn(0x7f3cdc066830 msgr2=0x7f3cdc155db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:50.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.427+0000 7f3ce2c00700 1 -- 172.21.15.49:0/2533926452 shutdown_connections 2024-01-22T05:14:50.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.427+0000 7f3ce2c00700 1 -- 172.21.15.49:0/2533926452 wait complete. 2024-01-22T05:14:50.431 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-01-22T05:14:50.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-22T05:14:50.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.607+0000 7ff7ba600700 1 Processor -- start 2024-01-22T05:14:50.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.611+0000 7ff7ba600700 1 -- start start 2024-01-22T05:14:50.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.611+0000 7ff7ba600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b40bd0b0 0x7ff7b40a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:50.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.611+0000 7ff7ba600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b4066680 con 0x7ff7b40bccd0 2024-01-22T05:14:50.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.611+0000 7ff7ba600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b40bc840 con 0x7ff7b40a8c30 2024-01-22T05:14:50.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.611+0000 7ff7ba600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b40a90c0 con 0x7ff7b40bd0b0 2024-01-22T05:14:50.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.611+0000 7ff7b3400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff7b40bccd0 0x7ff7b4065f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34522/0 (socket says 172.21.15.49:34522) 2024-01-22T05:14:50.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.611+0000 7ff7b3400700 1 -- 172.21.15.49:0/3556957183 learned_addr learned my addr 172.21.15.49:0/3556957183 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:50.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2a00700 1 --2- 172.21.15.49:0/3556957183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b40bd0b0 0x7ff7b40a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:50.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3842051604 0 0) 0x7ff7a4001110 con 0x7ff7b40bccd0 2024-01-22T05:14:50.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7940033f0 con 0x7ff7b40bccd0 2024-01-22T05:14:50.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218898330 0 0) 0x7ff7b40bc840 con 0x7ff7b40a8c30 2024-01-22T05:14:50.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7a4001110 con 0x7ff7b40a8c30 2024-01-22T05:14:50.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4088262230 0 0) 0x7ff7940033f0 con 0x7ff7b40bccd0 2024-01-22T05:14:50.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b40bd0b0 msgr2=0x7ff7b40a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:50.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 --2- 172.21.15.49:0/3556957183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b40bd0b0 0x7ff7b40a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:50.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 >> v1:172.21.15.110:6789/0 conn(0x7ff7b40a8c30 legacy=0x7ff7b4067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:50.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b4151dd0 con 0x7ff7b40bccd0 2024-01-22T05:14:50.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7ff7a4001600 con 0x7ff7b40bccd0 2024-01-22T05:14:50.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 >> v1:172.21.15.49:6789/0 conn(0x7ff7b40bccd0 legacy=0x7ff7b4065f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:50.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 --2- 172.21.15.49:0/3556957183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b40bd0b0 0x7ff794003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:50.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 --2- 172.21.15.49:0/3556957183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff794003fb0 0x7ff794004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:50.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 --2- 172.21.15.49:0/3556957183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff794004b80 0x7ff794005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:50.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b40a90c0 con 0x7ff794004b80 2024-01-22T05:14:50.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79400b990 con 0x7ff794003fb0 2024-01-22T05:14:50.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79400bb50 con 0x7ff7b40bd0b0 2024-01-22T05:14:50.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b3e00700 1 --2- 172.21.15.49:0/3556957183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff794004b80 0x7ff794005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:50.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b3400700 1 --2- 172.21.15.49:0/3556957183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b40bd0b0 0x7ff794003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:50.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2a00700 1 --2- 172.21.15.49:0/3556957183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff794003fb0 0x7ff794004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:50.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b3e00700 1 -- 172.21.15.49:0/3556957183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b40bd0b0 msgr2=0x7ff794003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:50.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b3e00700 1 --2- 172.21.15.49:0/3556957183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b40bd0b0 0x7ff794003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:50.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b3e00700 1 -- 172.21.15.49:0/3556957183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff794003fb0 msgr2=0x7ff794004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:50.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b3e00700 1 --2- 172.21.15.49:0/3556957183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff794003fb0 0x7ff794004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:50.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b3e00700 1 -- 172.21.15.49:0/3556957183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7940033f0 con 0x7ff794004b80 2024-01-22T05:14:50.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b3e00700 1 --2- 172.21.15.49:0/3556957183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff794004b80 0x7ff794005000 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7ff7ac001f90 tx=0x7ff7ac007f30).ready entity=mon.0 client_cookie=6c3f2caa1e1f9e6b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:50.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0020f0 con 0x7ff794004b80 2024-01-22T05:14:50.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac006a20 con 0x7ff794004b80 2024-01-22T05:14:50.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.615+0000 7ff7b2000700 1 -- 172.21.15.49:0/3556957183 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac006dc0 con 0x7ff794004b80 2024-01-22T05:14:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.619+0000 7ff7ba600700 1 -- 172.21.15.49:0/3556957183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff794004b80 msgr2=0x7ff794005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.619+0000 7ff7ba600700 1 --2- 172.21.15.49:0/3556957183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff794004b80 0x7ff794005000 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7ff7ac001f90 tx=0x7ff7ac007f30).stop 2024-01-22T05:14:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.619+0000 7ff7b3e00700 1 -- 172.21.15.49:0/3556957183 reap_dead start 2024-01-22T05:14:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.619+0000 7ff7ba600700 1 -- 172.21.15.49:0/3556957183 shutdown_connections 2024-01-22T05:14:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.619+0000 7ff7ba600700 1 -- 172.21.15.49:0/3556957183 >> 172.21.15.49:0/3556957183 conn(0x7ff7b40c6560 msgr2=0x7ff7b40c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.619+0000 7ff7ba600700 1 -- 172.21.15.49:0/3556957183 shutdown_connections 2024-01-22T05:14:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.619+0000 7ff7ba600700 1 -- 172.21.15.49:0/3556957183 wait complete. 2024-01-22T05:14:50.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.623+0000 7ff7ba600700 1 Processor -- start 2024-01-22T05:14:50.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.623+0000 7ff7ba600700 1 -- start start 2024-01-22T05:14:50.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.623+0000 7ff7ba600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff794004b80 0x7ff7b40abf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:50.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.623+0000 7ff7ba600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b4148220 0x7ff7b413df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:50.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.623+0000 7ff7ba600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7b4162900 0x7ff7b4162d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:50.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.623+0000 7ff7ba600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b40bf260 con 0x7ff794004b80 2024-01-22T05:14:50.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.623+0000 7ff7ba600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b40beca0 con 0x7ff7b4162900 2024-01-22T05:14:50.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.623+0000 7ff7ba600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b40bef80 con 0x7ff7b4148220 2024-01-22T05:14:50.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.623+0000 7ff7b3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff794004b80 0x7ff7b40abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:50.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.623+0000 7ff7b3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff794004b80 0x7ff7b40abf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35392/0 (socket says 172.21.15.49:35392) 2024-01-22T05:14:50.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.623+0000 7ff7b3400700 1 -- 172.21.15.49:0/2732096296 learned_addr learned my addr 172.21.15.49:0/2732096296 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:50.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.627+0000 7ff7b2a00700 1 --2- 172.21.15.49:0/2732096296 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b4148220 0x7ff7b413df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:50.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.627+0000 7ff7b3e00700 1 --2- 172.21.15.49:0/2732096296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7b4162900 0x7ff7b4162d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:50.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.627+0000 7ff7b3400700 1 -- 172.21.15.49:0/2732096296 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b4148220 msgr2=0x7ff7b413df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:50.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.627+0000 7ff7b3400700 1 --2- 172.21.15.49:0/2732096296 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b4148220 0x7ff7b413df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:50.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.627+0000 7ff7b3400700 1 -- 172.21.15.49:0/2732096296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7b4162900 msgr2=0x7ff7b4162d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:50.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.627+0000 7ff7b3400700 1 --2- 172.21.15.49:0/2732096296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7b4162900 0x7ff7b4162d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:50.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.627+0000 7ff7b3400700 1 -- 172.21.15.49:0/2732096296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b40bf5c0 con 0x7ff794004b80 2024-01-22T05:14:50.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.627+0000 7ff7b3e00700 1 --2- 172.21.15.49:0/2732096296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7b4162900 0x7ff7b4162d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:50.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.627+0000 7ff7b3400700 1 --2- 172.21.15.49:0/2732096296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff794004b80 0x7ff7b40abf20 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7ff7a40010e0 tx=0x7ff7a4007880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:50.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.627+0000 7ff7aaa00700 1 -- 172.21.15.49:0/2732096296 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400f660 con 0x7ff794004b80 2024-01-22T05:14:50.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.627+0000 7ff7aaa00700 1 -- 172.21.15.49:0/2732096296 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a400f7c0 con 0x7ff794004b80 2024-01-22T05:14:50.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.627+0000 7ff7ba600700 1 -- 172.21.15.49:0/2732096296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b41486a0 con 0x7ff794004b80 2024-01-22T05:14:50.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.627+0000 7ff7aaa00700 1 -- 172.21.15.49:0/2732096296 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400fb60 con 0x7ff794004b80 2024-01-22T05:14:50.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.627+0000 7ff7ba600700 1 -- 172.21.15.49:0/2732096296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b40bfae0 con 0x7ff794004b80 2024-01-22T05:14:50.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.627+0000 7ff7ba600700 1 -- 172.21.15.49:0/2732096296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b40c08e0 con 0x7ff794004b80 2024-01-22T05:14:50.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.631+0000 7ff7aaa00700 1 -- 172.21.15.49:0/2732096296 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff7a401d3b0 con 0x7ff794004b80 2024-01-22T05:14:50.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.631+0000 7ff7aaa00700 1 --2- 172.21.15.49:0/2732096296 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff78c05a510 0x7ff78c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:50.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.631+0000 7ff7aaa00700 1 -- 172.21.15.49:0/2732096296 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5708+0+0 (secure 0 0 0) 0x7ff7a4073fa0 con 0x7ff794004b80 2024-01-22T05:14:50.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.631+0000 7ff7b2a00700 1 --2- 172.21.15.49:0/2732096296 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff78c05a510 0x7ff78c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:50.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.635+0000 7ff7b2a00700 1 --2- 172.21.15.49:0/2732096296 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff78c05a510 0x7ff78c05c9d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7ff7b4165db0 tx=0x7ff79c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:50.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.639+0000 7ff7aaa00700 1 -- 172.21.15.49:0/2732096296 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff7a4047800 con 0x7ff794004b80 2024-01-22T05:14:50.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.823+0000 7ff7ba600700 1 -- 172.21.15.49:0/2732096296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff7b4066680 con 0x7ff794004b80 2024-01-22T05:14:50.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.835+0000 7ff7aaa00700 1 -- 172.21.15.49:0/2732096296 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff7b4066680 con 0x7ff794004b80 2024-01-22T05:14:50.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.839+0000 7ff7ba600700 1 -- 172.21.15.49:0/2732096296 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff78c05a510 msgr2=0x7ff78c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:50.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.839+0000 7ff7ba600700 1 --2- 172.21.15.49:0/2732096296 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff78c05a510 0x7ff78c05c9d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7ff7b4165db0 tx=0x7ff79c008040).stop 2024-01-22T05:14:50.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.839+0000 7ff7ba600700 1 -- 172.21.15.49:0/2732096296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff794004b80 msgr2=0x7ff7b40abf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:50.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.839+0000 7ff7ba600700 1 --2- 172.21.15.49:0/2732096296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff794004b80 0x7ff7b40abf20 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7ff7a40010e0 tx=0x7ff7a4007880).stop 2024-01-22T05:14:50.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.839+0000 7ff7ba600700 1 -- 172.21.15.49:0/2732096296 shutdown_connections 2024-01-22T05:14:50.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.839+0000 7ff7ba600700 1 --2- 172.21.15.49:0/2732096296 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff78c05a510 0x7ff78c05c9d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:50.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.839+0000 7ff7ba600700 1 --2- 172.21.15.49:0/2732096296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7b4162900 0x7ff7b4162d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:50.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.839+0000 7ff7ba600700 1 --2- 172.21.15.49:0/2732096296 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b4148220 0x7ff7b413df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:50.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.839+0000 7ff7ba600700 1 --2- 172.21.15.49:0/2732096296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff794004b80 0x7ff7b40abf20 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:50.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.839+0000 7ff7ba600700 1 -- 172.21.15.49:0/2732096296 >> 172.21.15.49:0/2732096296 conn(0x7ff7b40c6560 msgr2=0x7ff7b4154660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:50.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.839+0000 7ff7ba600700 1 -- 172.21.15.49:0/2732096296 shutdown_connections 2024-01-22T05:14:50.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:50.839+0000 7ff7ba600700 1 -- 172.21.15.49:0/2732096296 wait complete. 2024-01-22T05:14:50.865 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-01-22T05:14:51.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.035+0000 7f06c7c00700 1 Processor -- start 2024-01-22T05:14:51.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.035+0000 7f06c7c00700 1 -- start start 2024-01-22T05:14:51.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.039+0000 7f06c7c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f06c0066fb0 0x7f06c00c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:51.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.039+0000 7f06c7c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c00a8b10 0x7f06c0157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:51.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.039+0000 7f06c7c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c00c1ee0 con 0x7f06c00a8f90 2024-01-22T05:14:51.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.039+0000 7f06c7c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c00c12f0 con 0x7f06c0066fb0 2024-01-22T05:14:51.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.039+0000 7f06c7c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00c15b0 con 0x7f06c00a8b10 2024-01-22T05:14:51.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.039+0000 7f06bfe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c00a8b10 0x7f06c0157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:51.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.039+0000 7f06c5c00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f06c00a8f90 0x7f06c0065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:34484/0 (socket says 172.21.15.49:34484) 2024-01-22T05:14:51.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.039+0000 7f06c5c00700 1 -- 172.21.15.49:0/312474317 learned_addr learned my addr 172.21.15.49:0/312474317 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:51.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.039+0000 7f06c5200700 1 --2- 172.21.15.49:0/312474317 >> v2:172.21.15.110:3300/0 conn(0x7f06c0066fb0 0x7f06c00c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06bf400700 1 -- 172.21.15.49:0/312474317 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680202753 0 0) 0x7f06c00c1ee0 con 0x7f06c00a8f90 2024-01-22T05:14:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06bf400700 1 -- 172.21.15.49:0/312474317 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06a00033f0 con 0x7f06c00a8f90 2024-01-22T05:14:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06bfe00700 1 -- 172.21.15.49:0/312474317 >> v2:172.21.15.110:3300/0 conn(0x7f06c0066fb0 msgr2=0x7f06c00c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06bfe00700 1 --2- 172.21.15.49:0/312474317 >> v2:172.21.15.110:3300/0 conn(0x7f06c0066fb0 0x7f06c00c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06bfe00700 1 -- 172.21.15.49:0/312474317 >> v1:172.21.15.110:6789/0 conn(0x7f06c00a8f90 legacy=0x7f06c0065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:51.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06bfe00700 1 -- 172.21.15.49:0/312474317 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c00c1890 con 0x7f06c00a8b10 2024-01-22T05:14:51.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06bfe00700 1 --2- 172.21.15.49:0/312474317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c00a8b10 0x7f06c0157740 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f06a8009760 tx=0x7f06a8009060).ready entity=mon.2 client_cookie=eead98fb537ab229 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:51.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06bf400700 1 -- 172.21.15.49:0/312474317 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a800d4a0 con 0x7f06c00a8b10 2024-01-22T05:14:51.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06bf400700 1 -- 172.21.15.49:0/312474317 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a800d600 con 0x7f06c00a8b10 2024-01-22T05:14:51.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06bf400700 1 -- 172.21.15.49:0/312474317 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a800d980 con 0x7f06c00a8b10 2024-01-22T05:14:51.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06c7c00700 1 -- 172.21.15.49:0/312474317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c00a8b10 msgr2=0x7f06c0157740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:51.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06c7c00700 1 --2- 172.21.15.49:0/312474317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c00a8b10 0x7f06c0157740 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f06a8009760 tx=0x7f06a8009060).stop 2024-01-22T05:14:51.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06c7c00700 1 -- 172.21.15.49:0/312474317 shutdown_connections 2024-01-22T05:14:51.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06c7c00700 1 --2- 172.21.15.49:0/312474317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c00a8b10 0x7f06c0157740 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:51.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06c7c00700 1 --2- 172.21.15.49:0/312474317 >> v2:172.21.15.110:3300/0 conn(0x7f06c0066fb0 0x7f06c00c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:51.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06c7c00700 1 -- 172.21.15.49:0/312474317 >> 172.21.15.49:0/312474317 conn(0x7f06c00c6540 msgr2=0x7f06c00c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:51.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06c7c00700 1 -- 172.21.15.49:0/312474317 shutdown_connections 2024-01-22T05:14:51.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.043+0000 7f06c7c00700 1 -- 172.21.15.49:0/312474317 wait complete. 2024-01-22T05:14:51.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.047+0000 7f06c7c00700 1 Processor -- start 2024-01-22T05:14:51.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.047+0000 7f06c7c00700 1 -- start start 2024-01-22T05:14:51.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c7c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c0066fb0 0x7f06c0164630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:51.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c7c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c00a8b10 0x7f06c00bf530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:51.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c7c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c00a8f90 0x7f06c00bfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:51.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c7c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00bff10 con 0x7f06c0066fb0 2024-01-22T05:14:51.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c7c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00a95b0 con 0x7f06c00a8b10 2024-01-22T05:14:51.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c7c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00aa410 con 0x7f06c00a8f90 2024-01-22T05:14:51.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c5200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c0066fb0 0x7f06c0164630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:51.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c5c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c00a8f90 0x7f06c00bfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:51.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c5200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c0066fb0 0x7f06c0164630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35404/0 (socket says 172.21.15.49:35404) 2024-01-22T05:14:51.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c5200700 1 -- 172.21.15.49:0/1375201546 learned_addr learned my addr 172.21.15.49:0/1375201546 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:51.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06bfe00700 1 --2- 172.21.15.49:0/1375201546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c00a8b10 0x7f06c00bf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:51.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c5200700 1 -- 172.21.15.49:0/1375201546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c00a8f90 msgr2=0x7f06c00bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c5200700 1 --2- 172.21.15.49:0/1375201546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c00a8f90 0x7f06c00bfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c5200700 1 -- 172.21.15.49:0/1375201546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c00a8b10 msgr2=0x7f06c00bf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c5200700 1 --2- 172.21.15.49:0/1375201546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c00a8b10 0x7f06c00bf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c5200700 1 -- 172.21.15.49:0/1375201546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a80092a0 con 0x7f06c0066fb0 2024-01-22T05:14:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06bfe00700 1 --2- 172.21.15.49:0/1375201546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c00a8b10 0x7f06c00bf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c5200700 1 --2- 172.21.15.49:0/1375201546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c0066fb0 0x7f06c0164630 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f06b000e950 tx=0x7f06b0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:51.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06b7e00700 1 -- 172.21.15.49:0/1375201546 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0012600 con 0x7f06c0066fb0 2024-01-22T05:14:51.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06b7e00700 1 -- 172.21.15.49:0/1375201546 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b0012760 con 0x7f06c0066fb0 2024-01-22T05:14:51.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c7c00700 1 -- 172.21.15.49:0/1375201546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c00a9800 con 0x7f06c0066fb0 2024-01-22T05:14:51.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06b7e00700 1 -- 172.21.15.49:0/1375201546 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0012ae0 con 0x7f06c0066fb0 2024-01-22T05:14:51.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.051+0000 7f06c7c00700 1 -- 172.21.15.49:0/1375201546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c00a9dc0 con 0x7f06c0066fb0 2024-01-22T05:14:51.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.055+0000 7f06c7c00700 1 -- 172.21.15.49:0/1375201546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c0047060 con 0x7f06c0066fb0 2024-01-22T05:14:51.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.055+0000 7f06b7e00700 1 -- 172.21.15.49:0/1375201546 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f06b001b400 con 0x7f06c0066fb0 2024-01-22T05:14:51.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.059+0000 7f06b7e00700 1 --2- 172.21.15.49:0/1375201546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f069805a510 0x7f069805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:51.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.059+0000 7f06b7e00700 1 -- 172.21.15.49:0/1375201546 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f06b0074c00 con 0x7f06c0066fb0 2024-01-22T05:14:51.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.059+0000 7f06bfe00700 1 --2- 172.21.15.49:0/1375201546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f069805a510 0x7f069805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:51.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.059+0000 7f06bfe00700 1 --2- 172.21.15.49:0/1375201546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f069805a510 0x7f069805c9d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f06a800d260 tx=0x7f06a8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:51.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.063+0000 7f06b7e00700 1 -- 172.21.15.49:0/1375201546 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f06b0048460 con 0x7f06c0066fb0 2024-01-22T05:14:51.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.283+0000 7f06c7c00700 1 -- 172.21.15.49:0/1375201546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) v1 -- 0x7f06c00c1b70 con 0x7f06c0066fb0 2024-01-22T05:14:51.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.419+0000 7f06b7e00700 1 -- 172.21.15.49:0/1375201546 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v482) v1 ==== 155+0+0 (secure 0 0 0) 0x7f06b0016070 con 0x7f06c0066fb0 2024-01-22T05:14:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.427+0000 7f06c7c00700 1 -- 172.21.15.49:0/1375201546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f069805a510 msgr2=0x7f069805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.427+0000 7f06c7c00700 1 --2- 172.21.15.49:0/1375201546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f069805a510 0x7f069805c9d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f06a800d260 tx=0x7f06a8016000).stop 2024-01-22T05:14:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.427+0000 7f06c7c00700 1 -- 172.21.15.49:0/1375201546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c0066fb0 msgr2=0x7f06c0164630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.427+0000 7f06c7c00700 1 --2- 172.21.15.49:0/1375201546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c0066fb0 0x7f06c0164630 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f06b000e950 tx=0x7f06b0009060).stop 2024-01-22T05:14:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.427+0000 7f06c7c00700 1 -- 172.21.15.49:0/1375201546 shutdown_connections 2024-01-22T05:14:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.427+0000 7f06c7c00700 1 --2- 172.21.15.49:0/1375201546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f069805a510 0x7f069805c9d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.427+0000 7f06c7c00700 1 --2- 172.21.15.49:0/1375201546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c00a8f90 0x7f06c00bfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.427+0000 7f06c7c00700 1 --2- 172.21.15.49:0/1375201546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c00a8b10 0x7f06c00bf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.427+0000 7f06c7c00700 1 --2- 172.21.15.49:0/1375201546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c0066fb0 0x7f06c0164630 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.427+0000 7f06c7c00700 1 -- 172.21.15.49:0/1375201546 >> 172.21.15.49:0/1375201546 conn(0x7f06c00c6540 msgr2=0x7f06c01576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:51.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.427+0000 7f06c7c00700 1 -- 172.21.15.49:0/1375201546 shutdown_connections 2024-01-22T05:14:51.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.427+0000 7f06c7c00700 1 -- 172.21.15.49:0/1375201546 wait complete. 2024-01-22T05:14:51.452 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-01-22T05:14:51.453 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-01-22T05:14:51.453 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-01-22T05:14:51.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.619+0000 7f8be0200700 1 Processor -- start 2024-01-22T05:14:51.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.619+0000 7f8be0200700 1 -- start start 2024-01-22T05:14:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.619+0000 7f8be0200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8155d20 0x7f8bd8065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.619+0000 7f8be0200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8bd80a8e50 0x7f8bd80c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.619+0000 7f8be0200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd80c1a40 con 0x7f8bd8066070 2024-01-22T05:14:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.619+0000 7f8be0200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd8159310 con 0x7f8bd80a8e50 2024-01-22T05:14:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.619+0000 7f8be0200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd80c13f0 con 0x7f8bd8155d20 2024-01-22T05:14:51.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.623+0000 7f8bdce00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8bd8066070 0x7f8bd80a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:34490/0 (socket says 172.21.15.49:34490) 2024-01-22T05:14:51.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.623+0000 7f8bde200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8bd80a8e50 0x7f8bd80c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:51.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.623+0000 7f8bdce00700 1 -- 172.21.15.49:0/466691421 learned_addr learned my addr 172.21.15.49:0/466691421 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:51.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.623+0000 7f8bdd800700 1 --2- 172.21.15.49:0/466691421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8155d20 0x7f8bd8065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.623+0000 7f8bd7e00700 1 -- 172.21.15.49:0/466691421 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241721543 0 0) 0x7f8bd80c1a40 con 0x7f8bd8066070 2024-01-22T05:14:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.623+0000 7f8bd7e00700 1 -- 172.21.15.49:0/466691421 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bb80033f0 con 0x7f8bd8066070 2024-01-22T05:14:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.623+0000 7f8bdd800700 1 -- 172.21.15.49:0/466691421 >> v2:172.21.15.49:3300/0 conn(0x7f8bd80a8e50 msgr2=0x7f8bd80c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.623+0000 7f8bdd800700 1 --2- 172.21.15.49:0/466691421 >> v2:172.21.15.49:3300/0 conn(0x7f8bd80a8e50 0x7f8bd80c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.623+0000 7f8bdd800700 1 -- 172.21.15.49:0/466691421 >> v1:172.21.15.110:6789/0 conn(0x7f8bd8066070 legacy=0x7f8bd80a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.623+0000 7f8bdd800700 1 -- 172.21.15.49:0/466691421 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd80c16d0 con 0x7f8bd8155d20 2024-01-22T05:14:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.623+0000 7f8bde200700 1 --2- 172.21.15.49:0/466691421 >> v2:172.21.15.49:3300/0 conn(0x7f8bd80a8e50 0x7f8bd80c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:51.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.623+0000 7f8bdd800700 1 --2- 172.21.15.49:0/466691421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8155d20 0x7f8bd8065b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f8bc8009760 tx=0x7f8bc8009060).ready entity=mon.2 client_cookie=cf1391f3df5b716e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:51.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.623+0000 7f8bd7e00700 1 -- 172.21.15.49:0/466691421 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc800d4a0 con 0x7f8bd8155d20 2024-01-22T05:14:51.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.623+0000 7f8bd7e00700 1 -- 172.21.15.49:0/466691421 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc800d600 con 0x7f8bd8155d20 2024-01-22T05:14:51.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.623+0000 7f8bd7e00700 1 -- 172.21.15.49:0/466691421 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc800d980 con 0x7f8bd8155d20 2024-01-22T05:14:51.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.627+0000 7f8be0200700 1 -- 172.21.15.49:0/466691421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8155d20 msgr2=0x7f8bd8065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:51.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.627+0000 7f8be0200700 1 --2- 172.21.15.49:0/466691421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8155d20 0x7f8bd8065b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f8bc8009760 tx=0x7f8bc8009060).stop 2024-01-22T05:14:51.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.627+0000 7f8be0200700 1 -- 172.21.15.49:0/466691421 shutdown_connections 2024-01-22T05:14:51.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.627+0000 7f8be0200700 1 --2- 172.21.15.49:0/466691421 >> v2:172.21.15.49:3300/0 conn(0x7f8bd80a8e50 0x7f8bd80c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:51.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.627+0000 7f8be0200700 1 --2- 172.21.15.49:0/466691421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8155d20 0x7f8bd8065b80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:51.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.627+0000 7f8be0200700 1 -- 172.21.15.49:0/466691421 >> 172.21.15.49:0/466691421 conn(0x7f8bd80c6540 msgr2=0x7f8bd80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:51.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.627+0000 7f8be0200700 1 -- 172.21.15.49:0/466691421 shutdown_connections 2024-01-22T05:14:51.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.627+0000 7f8be0200700 1 -- 172.21.15.49:0/466691421 wait complete. 2024-01-22T05:14:51.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.631+0000 7f8be0200700 1 Processor -- start 2024-01-22T05:14:51.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.631+0000 7f8be0200700 1 -- start start 2024-01-22T05:14:51.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.631+0000 7f8be0200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8066070 0x7f8bd81535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:51.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.631+0000 7f8be0200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd80a8e50 0x7f8bd80ab020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:51.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.631+0000 7f8be0200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd8155d20 0x7f8bd80c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:51.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.631+0000 7f8be0200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd80a9920 con 0x7f8bd80a8e50 2024-01-22T05:14:51.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.631+0000 7f8be0200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd80a9c00 con 0x7f8bd8155d20 2024-01-22T05:14:51.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.631+0000 7f8be0200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd80a9ee0 con 0x7f8bd8066070 2024-01-22T05:14:51.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.631+0000 7f8bdce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd80a8e50 0x7f8bd80ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:51.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.631+0000 7f8bdce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd80a8e50 0x7f8bd80ab020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35420/0 (socket says 172.21.15.49:35420) 2024-01-22T05:14:51.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.631+0000 7f8bdce00700 1 -- 172.21.15.49:0/41129153 learned_addr learned my addr 172.21.15.49:0/41129153 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:51.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.635+0000 7f8bdd800700 1 --2- 172.21.15.49:0/41129153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8066070 0x7f8bd81535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:51.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.635+0000 7f8bde200700 1 --2- 172.21.15.49:0/41129153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd8155d20 0x7f8bd80c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:51.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.635+0000 7f8bdce00700 1 -- 172.21.15.49:0/41129153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8066070 msgr2=0x7f8bd81535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:51.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.635+0000 7f8bdce00700 1 --2- 172.21.15.49:0/41129153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8066070 0x7f8bd81535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:51.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.635+0000 7f8bdce00700 1 -- 172.21.15.49:0/41129153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd8155d20 msgr2=0x7f8bd80c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:51.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.635+0000 7f8bdce00700 1 --2- 172.21.15.49:0/41129153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd8155d20 0x7f8bd80c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:51.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.635+0000 7f8bdce00700 1 -- 172.21.15.49:0/41129153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd0009a20 con 0x7f8bd80a8e50 2024-01-22T05:14:51.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.635+0000 7f8bdce00700 1 --2- 172.21.15.49:0/41129153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd80a8e50 0x7f8bd80ab020 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f8bc000c4c0 tx=0x7f8bc0007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:51.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.635+0000 7f8bd4c00700 1 -- 172.21.15.49:0/41129153 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00072e0 con 0x7f8bd80a8e50 2024-01-22T05:14:51.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.635+0000 7f8bd4c00700 1 -- 172.21.15.49:0/41129153 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc0007440 con 0x7f8bd80a8e50 2024-01-22T05:14:51.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.635+0000 7f8be0200700 1 -- 172.21.15.49:0/41129153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc80092a0 con 0x7f8bd80a8e50 2024-01-22T05:14:51.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.635+0000 7f8bd4c00700 1 -- 172.21.15.49:0/41129153 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00057a0 con 0x7f8bd80a8e50 2024-01-22T05:14:51.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.635+0000 7f8be0200700 1 -- 172.21.15.49:0/41129153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd80a95b0 con 0x7f8bd80a8e50 2024-01-22T05:14:51.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.635+0000 7f8be0200700 1 -- 172.21.15.49:0/41129153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd80aa360 con 0x7f8bd80a8e50 2024-01-22T05:14:51.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.639+0000 7f8bd4c00700 1 -- 172.21.15.49:0/41129153 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8bc0005bd0 con 0x7f8bd80a8e50 2024-01-22T05:14:51.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.639+0000 7f8bd4c00700 1 --2- 172.21.15.49:0/41129153 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8bb005a510 0x7f8bb005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:51.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.639+0000 7f8bd4c00700 1 -- 172.21.15.49:0/41129153 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f8bc0073fc0 con 0x7f8bd80a8e50 2024-01-22T05:14:51.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.639+0000 7f8bdd800700 1 --2- 172.21.15.49:0/41129153 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8bb005a510 0x7f8bb005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:51.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.643+0000 7f8bdd800700 1 --2- 172.21.15.49:0/41129153 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8bb005a510 0x7f8bb005c9d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f8bc8009760 tx=0x7f8bc8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.647+0000 7f8bd4c00700 1 -- 172.21.15.49:0/41129153 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8bc0047880 con 0x7f8bd80a8e50 2024-01-22T05:14:51.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:51.863+0000 7f8be0200700 1 -- 172.21.15.49:0/41129153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) v1 -- 0x7f8bd80c23c0 con 0x7f8bd80a8e50 2024-01-22T05:14:52.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.431+0000 7f8bd4c00700 1 -- 172.21.15.49:0/41129153 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v483) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8bc0018030 con 0x7f8bd80a8e50 2024-01-22T05:14:52.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.435+0000 7f8be0200700 1 -- 172.21.15.49:0/41129153 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8bb005a510 msgr2=0x7f8bb005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:52.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.435+0000 7f8be0200700 1 --2- 172.21.15.49:0/41129153 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8bb005a510 0x7f8bb005c9d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f8bc8009760 tx=0x7f8bc8016000).stop 2024-01-22T05:14:52.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.435+0000 7f8be0200700 1 -- 172.21.15.49:0/41129153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd80a8e50 msgr2=0x7f8bd80ab020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.435+0000 7f8be0200700 1 --2- 172.21.15.49:0/41129153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd80a8e50 0x7f8bd80ab020 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f8bc000c4c0 tx=0x7f8bc0007c50).stop 2024-01-22T05:14:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.435+0000 7f8be0200700 1 -- 172.21.15.49:0/41129153 shutdown_connections 2024-01-22T05:14:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.435+0000 7f8be0200700 1 --2- 172.21.15.49:0/41129153 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8bb005a510 0x7f8bb005c9d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.435+0000 7f8be0200700 1 --2- 172.21.15.49:0/41129153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd8155d20 0x7f8bd80c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.435+0000 7f8be0200700 1 --2- 172.21.15.49:0/41129153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd80a8e50 0x7f8bd80ab020 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.435+0000 7f8be0200700 1 --2- 172.21.15.49:0/41129153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8066070 0x7f8bd81535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.435+0000 7f8be0200700 1 -- 172.21.15.49:0/41129153 >> 172.21.15.49:0/41129153 conn(0x7f8bd80c6540 msgr2=0x7f8bd80c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:52.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.435+0000 7f8be0200700 1 -- 172.21.15.49:0/41129153 shutdown_connections 2024-01-22T05:14:52.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.435+0000 7f8be0200700 1 -- 172.21.15.49:0/41129153 wait complete. 2024-01-22T05:14:52.462 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-22T05:14:52.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.635+0000 7f062fe00700 1 Processor -- start 2024-01-22T05:14:52.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.635+0000 7f062fe00700 1 -- start start 2024-01-22T05:14:52.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0630154b20 0x7f06300c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:52.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0630154f60 0x7f06300c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:52.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062fe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0630154690 con 0x7f06300a6a40 2024-01-22T05:14:52.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062fe00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06300c73a0 con 0x7f0630154b20 2024-01-22T05:14:52.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0630064950 con 0x7f0630154f60 2024-01-22T05:14:52.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062e000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0630154b20 0x7f06300c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:52.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062e000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0630154b20 0x7f06300c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35428/0 (socket says 172.21.15.49:35428) 2024-01-22T05:14:52.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062e000700 1 -- 172.21.15.49:0/3190724626 learned_addr learned my addr 172.21.15.49:0/3190724626 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:52.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062f400700 1 --2- 172.21.15.49:0/3190724626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0630154f60 0x7f06300c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062e000700 1 -- 172.21.15.49:0/3190724626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0630154f60 msgr2=0x7f06300c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062e000700 1 --2- 172.21.15.49:0/3190724626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0630154f60 0x7f06300c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062e000700 1 -- 172.21.15.49:0/3190724626 >> v1:172.21.15.110:6789/0 conn(0x7f06300a6a40 legacy=0x7f06300c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062e000700 1 -- 172.21.15.49:0/3190724626 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0630154360 con 0x7f0630154b20 2024-01-22T05:14:52.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062e000700 1 --2- 172.21.15.49:0/3190724626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0630154b20 0x7f06300c69c0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f0618009830 tx=0x7f06180090f0).ready entity=mon.0 client_cookie=bc532da58069b0b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062d600700 1 -- 172.21.15.49:0/3190724626 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800b580 con 0x7f0630154b20 2024-01-22T05:14:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062d600700 1 -- 172.21.15.49:0/3190724626 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061800b6e0 con 0x7f0630154b20 2024-01-22T05:14:52.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.639+0000 7f062d600700 1 -- 172.21.15.49:0/3190724626 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800ba60 con 0x7f0630154b20 2024-01-22T05:14:52.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.643+0000 7f062fe00700 1 -- 172.21.15.49:0/3190724626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0630154b20 msgr2=0x7f06300c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:52.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.643+0000 7f062fe00700 1 --2- 172.21.15.49:0/3190724626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0630154b20 0x7f06300c69c0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f0618009830 tx=0x7f06180090f0).stop 2024-01-22T05:14:52.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.643+0000 7f062fe00700 1 -- 172.21.15.49:0/3190724626 shutdown_connections 2024-01-22T05:14:52.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.643+0000 7f062fe00700 1 --2- 172.21.15.49:0/3190724626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0630154f60 0x7f06300c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:52.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.643+0000 7f062fe00700 1 --2- 172.21.15.49:0/3190724626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0630154b20 0x7f06300c69c0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:52.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.643+0000 7f062fe00700 1 -- 172.21.15.49:0/3190724626 >> 172.21.15.49:0/3190724626 conn(0x7f06300c4bd0 msgr2=0x7f06300667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:52.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.643+0000 7f062fe00700 1 -- 172.21.15.49:0/3190724626 shutdown_connections 2024-01-22T05:14:52.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.643+0000 7f062fe00700 1 -- 172.21.15.49:0/3190724626 wait complete. 2024-01-22T05:14:52.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.647+0000 7f062fe00700 1 Processor -- start 2024-01-22T05:14:52.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.647+0000 7f062fe00700 1 -- start start 2024-01-22T05:14:52.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06300a6a40 0x7f063013c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:52.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0630154b20 0x7f06300a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:52.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0630154f60 0x7f063014f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:52.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062fe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063013cb10 con 0x7f06300a6a40 2024-01-22T05:14:52.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06300a8fc0 con 0x7f0630154b20 2024-01-22T05:14:52.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06300a92a0 con 0x7f0630154f60 2024-01-22T05:14:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06300a6a40 0x7f063013c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06300a6a40 0x7f063013c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35444/0 (socket says 172.21.15.49:35444) 2024-01-22T05:14:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062ea00700 1 -- 172.21.15.49:0/1664556752 learned_addr learned my addr 172.21.15.49:0/1664556752 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062f400700 1 --2- 172.21.15.49:0/1664556752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0630154f60 0x7f063014f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:52.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062e000700 1 --2- 172.21.15.49:0/1664556752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0630154b20 0x7f06300a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062ea00700 1 -- 172.21.15.49:0/1664556752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0630154f60 msgr2=0x7f063014f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062ea00700 1 --2- 172.21.15.49:0/1664556752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0630154f60 0x7f063014f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062ea00700 1 -- 172.21.15.49:0/1664556752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0630154b20 msgr2=0x7f06300a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062ea00700 1 --2- 172.21.15.49:0/1664556752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0630154b20 0x7f06300a6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062ea00700 1 -- 172.21.15.49:0/1664556752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618009370 con 0x7f06300a6a40 2024-01-22T05:14:52.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062ea00700 1 --2- 172.21.15.49:0/1664556752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06300a6a40 0x7f063013c620 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f062000c440 tx=0x7f0620007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:52.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f0626000700 1 -- 172.21.15.49:0/1664556752 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620007020 con 0x7f06300a6a40 2024-01-22T05:14:52.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f0626000700 1 -- 172.21.15.49:0/1664556752 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0620007180 con 0x7f06300a6a40 2024-01-22T05:14:52.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062fe00700 1 -- 172.21.15.49:0/1664556752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06300a9580 con 0x7f06300a6a40 2024-01-22T05:14:52.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f0626000700 1 -- 172.21.15.49:0/1664556752 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620007520 con 0x7f06300a6a40 2024-01-22T05:14:52.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.651+0000 7f062fe00700 1 -- 172.21.15.49:0/1664556752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0630152480 con 0x7f06300a6a40 2024-01-22T05:14:52.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.655+0000 7f062fe00700 1 -- 172.21.15.49:0/1664556752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0630152000 con 0x7f06300a6a40 2024-01-22T05:14:52.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.655+0000 7f0626000700 1 -- 172.21.15.49:0/1664556752 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f06200068b0 con 0x7f06300a6a40 2024-01-22T05:14:52.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.659+0000 7f0626000700 1 --2- 172.21.15.49:0/1664556752 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f060805a510 0x7f060805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:52.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.659+0000 7f0626000700 1 -- 172.21.15.49:0/1664556752 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f0620073960 con 0x7f06300a6a40 2024-01-22T05:14:52.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.659+0000 7f062e000700 1 --2- 172.21.15.49:0/1664556752 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f060805a510 0x7f060805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:52.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.659+0000 7f062e000700 1 --2- 172.21.15.49:0/1664556752 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f060805a510 0x7f060805c9d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f0618009130 tx=0x7f0618017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:52.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.663+0000 7f0626000700 1 -- 172.21.15.49:0/1664556752 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0630152000 con 0x7f06300a6a40 2024-01-22T05:14:52.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.831+0000 7f062fe00700 1 -- 172.21.15.49:0/1664556752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0630152000 con 0x7f06300a6a40 2024-01-22T05:14:52.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.839+0000 7f0626000700 1 -- 172.21.15.49:0/1664556752 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0630152000 con 0x7f06300a6a40 2024-01-22T05:14:52.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.843+0000 7f062fe00700 1 -- 172.21.15.49:0/1664556752 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f060805a510 msgr2=0x7f060805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:52.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.843+0000 7f062fe00700 1 --2- 172.21.15.49:0/1664556752 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f060805a510 0x7f060805c9d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f0618009130 tx=0x7f0618017000).stop 2024-01-22T05:14:52.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.843+0000 7f062fe00700 1 -- 172.21.15.49:0/1664556752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06300a6a40 msgr2=0x7f063013c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:52.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.843+0000 7f062fe00700 1 --2- 172.21.15.49:0/1664556752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06300a6a40 0x7f063013c620 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f062000c440 tx=0x7f0620007e00).stop 2024-01-22T05:14:52.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.843+0000 7f062fe00700 1 -- 172.21.15.49:0/1664556752 shutdown_connections 2024-01-22T05:14:52.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.843+0000 7f062fe00700 1 --2- 172.21.15.49:0/1664556752 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f060805a510 0x7f060805c9d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:52.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.843+0000 7f062fe00700 1 --2- 172.21.15.49:0/1664556752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0630154f60 0x7f063014f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:52.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.843+0000 7f062fe00700 1 --2- 172.21.15.49:0/1664556752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0630154b20 0x7f06300a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:52.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.843+0000 7f062fe00700 1 --2- 172.21.15.49:0/1664556752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06300a6a40 0x7f063013c620 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:52.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.843+0000 7f062fe00700 1 -- 172.21.15.49:0/1664556752 >> 172.21.15.49:0/1664556752 conn(0x7f06300c4bd0 msgr2=0x7f0630067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:52.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.843+0000 7f062fe00700 1 -- 172.21.15.49:0/1664556752 shutdown_connections 2024-01-22T05:14:52.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:52.843+0000 7f062fe00700 1 -- 172.21.15.49:0/1664556752 wait complete. 2024-01-22T05:14:52.868 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:14:52.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:14:52.908 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:14:52.949 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:14:52.949 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-22T05:14:52.950 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:14:53.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.115+0000 7f3078800700 1 Processor -- start 2024-01-22T05:14:53.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.115+0000 7f3078800700 1 -- start start 2024-01-22T05:14:53.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3078800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30700c4d60 0x7f30700681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:53.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3078800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3070068690 0x7f307015b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:53.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3078800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30700c38c0 con 0x7f30700be070 2024-01-22T05:14:53.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3078800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30700be450 con 0x7f3070068690 2024-01-22T05:14:53.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3078800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30700a8880 con 0x7f30700c4d60 2024-01-22T05:14:53.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3075e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f30700be070 0x7f3070067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34530/0 (socket says 172.21.15.49:34530) 2024-01-22T05:14:53.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3075e00700 1 -- 172.21.15.49:0/2550378268 learned_addr learned my addr 172.21.15.49:0/2550378268 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:53.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3076800700 1 --2- 172.21.15.49:0/2550378268 >> v2:172.21.15.49:3300/0 conn(0x7f3070068690 0x7f307015b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:53.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3075400700 1 --2- 172.21.15.49:0/2550378268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30700c4d60 0x7f30700681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:53.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3076800700 1 -- 172.21.15.49:0/2550378268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30700c4d60 msgr2=0x7f30700681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:53.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3076800700 1 --2- 172.21.15.49:0/2550378268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30700c4d60 0x7f30700681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3076800700 1 -- 172.21.15.49:0/2550378268 >> v1:172.21.15.49:6789/0 conn(0x7f30700be070 legacy=0x7f3070067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:53.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3076800700 1 -- 172.21.15.49:0/2550378268 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30700be650 con 0x7f3070068690 2024-01-22T05:14:53.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3074a00700 1 -- 172.21.15.49:0/2550378268 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970620428 0 0) 0x7f30700c38c0 con 0x7f30700be070 2024-01-22T05:14:53.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3076800700 1 --2- 172.21.15.49:0/2550378268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3070068690 0x7f307015b830 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f3068009e60 tx=0x7f3068009780).ready entity=mon.0 client_cookie=b439ef7e3e4fbc20 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:53.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3074a00700 1 -- 172.21.15.49:0/2550378268 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800e070 con 0x7f3070068690 2024-01-22T05:14:53.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3074a00700 1 -- 172.21.15.49:0/2550378268 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800bc30 con 0x7f3070068690 2024-01-22T05:14:53.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3074a00700 1 -- 172.21.15.49:0/2550378268 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068012410 con 0x7f3070068690 2024-01-22T05:14:53.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3078800700 1 -- 172.21.15.49:0/2550378268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3070068690 msgr2=0x7f307015b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:53.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.119+0000 7f3078800700 1 --2- 172.21.15.49:0/2550378268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3070068690 0x7f307015b830 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f3068009e60 tx=0x7f3068009780).stop 2024-01-22T05:14:53.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.123+0000 7f3078800700 1 -- 172.21.15.49:0/2550378268 shutdown_connections 2024-01-22T05:14:53.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.123+0000 7f3078800700 1 --2- 172.21.15.49:0/2550378268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3070068690 0x7f307015b830 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.123+0000 7f3078800700 1 --2- 172.21.15.49:0/2550378268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30700c4d60 0x7f30700681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.123+0000 7f3078800700 1 -- 172.21.15.49:0/2550378268 >> 172.21.15.49:0/2550378268 conn(0x7f30700c8730 msgr2=0x7f30700c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:53.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.123+0000 7f3078800700 1 -- 172.21.15.49:0/2550378268 shutdown_connections 2024-01-22T05:14:53.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.123+0000 7f3078800700 1 -- 172.21.15.49:0/2550378268 wait complete. 2024-01-22T05:14:53.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.127+0000 7f3078800700 1 Processor -- start 2024-01-22T05:14:53.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.127+0000 7f3078800700 1 -- start start 2024-01-22T05:14:53.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.127+0000 7f3078800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3070068690 0x7f3070145170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:53.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.127+0000 7f3078800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30700be070 0x7f307014e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:53.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.127+0000 7f3078800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30700c4d60 0x7f307014e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:53.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.127+0000 7f3078800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307014f7c0 con 0x7f30700be070 2024-01-22T05:14:53.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.127+0000 7f3078800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30700ab8f0 con 0x7f3070068690 2024-01-22T05:14:53.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.127+0000 7f3078800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307014ba20 con 0x7f30700c4d60 2024-01-22T05:14:53.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.127+0000 7f3075400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30700be070 0x7f307014e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:53.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.127+0000 7f3075400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30700be070 0x7f307014e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35454/0 (socket says 172.21.15.49:35454) 2024-01-22T05:14:53.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.127+0000 7f3075400700 1 -- 172.21.15.49:0/1812662898 learned_addr learned my addr 172.21.15.49:0/1812662898 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:53.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.131+0000 7f3076800700 1 --2- 172.21.15.49:0/1812662898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30700c4d60 0x7f307014e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:53.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.131+0000 7f3075e00700 1 --2- 172.21.15.49:0/1812662898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3070068690 0x7f3070145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:53.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.131+0000 7f3075400700 1 -- 172.21.15.49:0/1812662898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30700c4d60 msgr2=0x7f307014e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:53.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.131+0000 7f3075400700 1 --2- 172.21.15.49:0/1812662898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30700c4d60 0x7f307014e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.131+0000 7f3075400700 1 -- 172.21.15.49:0/1812662898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3070068690 msgr2=0x7f3070145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:53.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.131+0000 7f3075400700 1 --2- 172.21.15.49:0/1812662898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3070068690 0x7f3070145170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.131+0000 7f3075400700 1 -- 172.21.15.49:0/1812662898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068009a20 con 0x7f30700be070 2024-01-22T05:14:53.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.131+0000 7f3075e00700 1 --2- 172.21.15.49:0/1812662898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3070068690 0x7f3070145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:53.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.131+0000 7f3075400700 1 --2- 172.21.15.49:0/1812662898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30700be070 0x7f307014e3b0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f305800d860 tx=0x7f3058008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:53.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.131+0000 7f306d600700 1 -- 172.21.15.49:0/1812662898 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30580125f0 con 0x7f30700be070 2024-01-22T05:14:53.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.131+0000 7f306d600700 1 -- 172.21.15.49:0/1812662898 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3058012750 con 0x7f30700be070 2024-01-22T05:14:53.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.131+0000 7f306d600700 1 -- 172.21.15.49:0/1812662898 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058012ad0 con 0x7f30700be070 2024-01-22T05:14:53.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.131+0000 7f3078800700 1 -- 172.21.15.49:0/1812662898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307014ef20 con 0x7f30700be070 2024-01-22T05:14:53.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.131+0000 7f3078800700 1 -- 172.21.15.49:0/1812662898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307014f4e0 con 0x7f30700be070 2024-01-22T05:14:53.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.131+0000 7f306d600700 1 -- 172.21.15.49:0/1812662898 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3058013480 con 0x7f30700be070 2024-01-22T05:14:53.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.135+0000 7f3078800700 1 -- 172.21.15.49:0/1812662898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30700aba80 con 0x7f30700be070 2024-01-22T05:14:53.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.135+0000 7f306d600700 1 --2- 172.21.15.49:0/1812662898 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f304805a510 0x7f304805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:53.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.135+0000 7f306d600700 1 -- 172.21.15.49:0/1812662898 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f3058074310 con 0x7f30700be070 2024-01-22T05:14:53.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.135+0000 7f3075e00700 1 --2- 172.21.15.49:0/1812662898 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f304805a510 0x7f304805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:53.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.135+0000 7f3075e00700 1 --2- 172.21.15.49:0/1812662898 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f304805a510 0x7f304805c9d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f3060007fd0 tx=0x7f3060009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:53.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.143+0000 7f306d600700 1 -- 172.21.15.49:0/1812662898 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3058047c30 con 0x7f30700be070 2024-01-22T05:14:53.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.339+0000 7f3078800700 1 -- 172.21.15.49:0/1812662898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30700ab6c0 con 0x7f30700be070 2024-01-22T05:14:53.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.339+0000 7f306d600700 1 -- 172.21.15.49:0/1812662898 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+3534 (secure 0 0 0) 0x7f305804b250 con 0x7f30700be070 2024-01-22T05:14:53.341 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:53.341 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":100,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/495964270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":495964270},{"type":"v1","addr":"172.21.15.110:6835","nonce":495964270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7115,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1812560292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1812560292},{"type":"v1","addr":"172.21.15.110:6833","nonce":1812560292}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":7728,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3416779936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3416779936},{"type":"v1","addr":"172.21.15.49:6835","nonce":3416779936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":7737,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4201894282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":4201894282},{"type":"v1","addr":"172.21.15.49:6837","nonce":4201894282}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[]} 2024-01-22T05:14:53.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.343+0000 7f3078800700 1 -- 172.21.15.49:0/1812662898 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f304805a510 msgr2=0x7f304805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:53.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.343+0000 7f3078800700 1 --2- 172.21.15.49:0/1812662898 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f304805a510 0x7f304805c9d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f3060007fd0 tx=0x7f3060009040).stop 2024-01-22T05:14:53.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.343+0000 7f3078800700 1 -- 172.21.15.49:0/1812662898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30700be070 msgr2=0x7f307014e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:53.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.343+0000 7f3078800700 1 --2- 172.21.15.49:0/1812662898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30700be070 0x7f307014e3b0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f305800d860 tx=0x7f3058008040).stop 2024-01-22T05:14:53.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.343+0000 7f3078800700 1 -- 172.21.15.49:0/1812662898 shutdown_connections 2024-01-22T05:14:53.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.343+0000 7f3078800700 1 --2- 172.21.15.49:0/1812662898 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f304805a510 0x7f304805c9d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.343+0000 7f3078800700 1 --2- 172.21.15.49:0/1812662898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30700c4d60 0x7f307014e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.343+0000 7f3078800700 1 --2- 172.21.15.49:0/1812662898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30700be070 0x7f307014e3b0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.343+0000 7f3078800700 1 --2- 172.21.15.49:0/1812662898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3070068690 0x7f3070145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.343+0000 7f3078800700 1 -- 172.21.15.49:0/1812662898 >> 172.21.15.49:0/1812662898 conn(0x7f30700c8730 msgr2=0x7f30700a9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:53.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.343+0000 7f3078800700 1 -- 172.21.15.49:0/1812662898 shutdown_connections 2024-01-22T05:14:53.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.343+0000 7f3078800700 1 -- 172.21.15.49:0/1812662898 wait complete. 2024-01-22T05:14:53.350 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 100 2024-01-22T05:14:53.368 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:14:53.369 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-22T05:14:53.369 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:14:53.369 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:14:53.369 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:14:53.369 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-22T05:14:53.369 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:14:53.369 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:14:53.370 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:14:53.370 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-22T05:14:53.370 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:14:53.370 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:14:53.370 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:14:53.370 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-22T05:14:53.370 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:14:53.370 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:14:53.385 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:14:53.386 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:14:53.390 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:14:53.390 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:14:53.393 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:14:53.393 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:14:53.395 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:14:53.395 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:14:53.436 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:14:53.436 DEBUG:teuthology.parallel:result is None 2024-01-22T05:14:53.439 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:14:53.440 DEBUG:teuthology.parallel:result is None 2024-01-22T05:14:53.441 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:14:53.441 DEBUG:teuthology.parallel:result is None 2024-01-22T05:14:53.445 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:14:53.445 DEBUG:teuthology.parallel:result is None 2024-01-22T05:14:53.446 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-22T05:14:53.540 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:14:53.544 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:14:53.544 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:14:53.546 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-22T05:14:53.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.607+0000 7f56f1000700 1 Processor -- start 2024-01-22T05:14:53.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.607+0000 7f56f1000700 1 -- start start 2024-01-22T05:14:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56f1000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ec155880 0x7f56ec0a8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56f1000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f56ec155c60 0x7f56ec0a6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56f1000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f56ec0a8e80 0x7f56ec0a7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56f1000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ec068a60 con 0x7f56ec0a8e80 2024-01-22T05:14:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56f1000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ec0a7530 con 0x7f56ec155c60 2024-01-22T05:14:53.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56f1000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec067e50 con 0x7f56ec155880 2024-01-22T05:14:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56ebe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f56ec0a8e80 0x7f56ec0a7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56eb400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ec155880 0x7f56ec0a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56ebe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f56ec0a8e80 0x7f56ec0a7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58616/0 (socket says 172.21.15.49:58616) 2024-01-22T05:14:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56ebe00700 1 -- 172.21.15.49:0/2955308671 learned_addr learned my addr 172.21.15.49:0/2955308671 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56eaa00700 1 --2- 172.21.15.49:0/2955308671 >> v2:172.21.15.110:3300/0 conn(0x7f56ec155c60 0x7f56ec0a6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56ebe00700 1 -- 172.21.15.49:0/2955308671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ec155880 msgr2=0x7f56ec0a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56ebe00700 1 --2- 172.21.15.49:0/2955308671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ec155880 0x7f56ec0a8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56ebe00700 1 -- 172.21.15.49:0/2955308671 >> v2:172.21.15.110:3300/0 conn(0x7f56ec155c60 msgr2=0x7f56ec0a6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56ebe00700 1 --2- 172.21.15.49:0/2955308671 >> v2:172.21.15.110:3300/0 conn(0x7f56ec155c60 0x7f56ec0a6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56ebe00700 1 -- 172.21.15.49:0/2955308671 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec068130 con 0x7f56ec0a8e80 2024-01-22T05:14:53.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56eaa00700 1 --2- 172.21.15.49:0/2955308671 >> v2:172.21.15.110:3300/0 conn(0x7f56ec155c60 0x7f56ec0a6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:53.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.611+0000 7f56ebe00700 1 --2- 172.21.15.49:0/2955308671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec0a8e80 0x7f56ec0a7040 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f56ec06a9a0 tx=0x7f56e4009840).ready entity=mon.0 client_cookie=73beda9d1f0b475a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:53.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.615+0000 7f56ea000700 1 -- 172.21.15.49:0/2955308671 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e400e070 con 0x7f56ec0a8e80 2024-01-22T05:14:53.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.615+0000 7f56ea000700 1 -- 172.21.15.49:0/2955308671 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e400ba20 con 0x7f56ec0a8e80 2024-01-22T05:14:53.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.615+0000 7f56ea000700 1 -- 172.21.15.49:0/2955308671 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e400bda0 con 0x7f56ec0a8e80 2024-01-22T05:14:53.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.615+0000 7f56f1000700 1 -- 172.21.15.49:0/2955308671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec0a8e80 msgr2=0x7f56ec0a7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:53.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.615+0000 7f56f1000700 1 --2- 172.21.15.49:0/2955308671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec0a8e80 0x7f56ec0a7040 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f56ec06a9a0 tx=0x7f56e4009840).stop 2024-01-22T05:14:53.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.615+0000 7f56f1000700 1 -- 172.21.15.49:0/2955308671 shutdown_connections 2024-01-22T05:14:53.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.615+0000 7f56f1000700 1 --2- 172.21.15.49:0/2955308671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec0a8e80 0x7f56ec0a7040 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.615+0000 7f56f1000700 1 --2- 172.21.15.49:0/2955308671 >> v2:172.21.15.110:3300/0 conn(0x7f56ec155c60 0x7f56ec0a6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.615+0000 7f56f1000700 1 --2- 172.21.15.49:0/2955308671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ec155880 0x7f56ec0a8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.615+0000 7f56f1000700 1 -- 172.21.15.49:0/2955308671 >> 172.21.15.49:0/2955308671 conn(0x7f56ec0c6530 msgr2=0x7f56ec0c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:53.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.615+0000 7f56f1000700 1 -- 172.21.15.49:0/2955308671 shutdown_connections 2024-01-22T05:14:53.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.615+0000 7f56f1000700 1 -- 172.21.15.49:0/2955308671 wait complete. 2024-01-22T05:14:53.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56f1000700 1 Processor -- start 2024-01-22T05:14:53.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56f1000700 1 -- start start 2024-01-22T05:14:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56f1000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ec0a8e80 0x7f56ec09f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56f1000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec155880 0x7f56ec0a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56f1000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56ec155c60 0x7f56ec0a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56f1000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0a4d20 con 0x7f56ec155880 2024-01-22T05:14:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56f1000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0a4f90 con 0x7f56ec155c60 2024-01-22T05:14:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56f1000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0a5270 con 0x7f56ec0a8e80 2024-01-22T05:14:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56eaa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec155880 0x7f56ec0a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56eaa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec155880 0x7f56ec0a9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58632/0 (socket says 172.21.15.49:58632) 2024-01-22T05:14:53.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56eaa00700 1 -- 172.21.15.49:0/3107506113 learned_addr learned my addr 172.21.15.49:0/3107506113 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:53.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56ebe00700 1 --2- 172.21.15.49:0/3107506113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56ec155c60 0x7f56ec0a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:53.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56eb400700 1 --2- 172.21.15.49:0/3107506113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ec0a8e80 0x7f56ec09f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:53.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56eaa00700 1 -- 172.21.15.49:0/3107506113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ec0a8e80 msgr2=0x7f56ec09f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:53.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56eaa00700 1 --2- 172.21.15.49:0/3107506113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ec0a8e80 0x7f56ec09f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56eaa00700 1 -- 172.21.15.49:0/3107506113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56ec155c60 msgr2=0x7f56ec0a9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:53.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56eaa00700 1 --2- 172.21.15.49:0/3107506113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56ec155c60 0x7f56ec0a9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:53.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.619+0000 7f56eaa00700 1 -- 172.21.15.49:0/3107506113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e4009ae0 con 0x7f56ec155880 2024-01-22T05:14:53.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.623+0000 7f56eaa00700 1 --2- 172.21.15.49:0/3107506113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec155880 0x7f56ec0a9610 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f56d400d860 tx=0x7f56d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:53.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.623+0000 7f56e2a00700 1 -- 172.21.15.49:0/3107506113 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d400f520 con 0x7f56ec155880 2024-01-22T05:14:53.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.623+0000 7f56e2a00700 1 -- 172.21.15.49:0/3107506113 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d400f680 con 0x7f56ec155880 2024-01-22T05:14:53.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.623+0000 7f56f1000700 1 -- 172.21.15.49:0/3107506113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ec159670 con 0x7f56ec155880 2024-01-22T05:14:53.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.623+0000 7f56e2a00700 1 -- 172.21.15.49:0/3107506113 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d400fa00 con 0x7f56ec155880 2024-01-22T05:14:53.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.623+0000 7f56f1000700 1 -- 172.21.15.49:0/3107506113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ec09f990 con 0x7f56ec155880 2024-01-22T05:14:53.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.623+0000 7f56f1000700 1 -- 172.21.15.49:0/3107506113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ec05fd40 con 0x7f56ec155880 2024-01-22T05:14:53.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.627+0000 7f56e2a00700 1 -- 172.21.15.49:0/3107506113 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f56d40123e0 con 0x7f56ec155880 2024-01-22T05:14:53.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.627+0000 7f56e2a00700 1 --2- 172.21.15.49:0/3107506113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56c405a510 0x7f56c405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:53.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.627+0000 7f56e2a00700 1 -- 172.21.15.49:0/3107506113 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f56d4074300 con 0x7f56ec155880 2024-01-22T05:14:53.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.627+0000 7f56eb400700 1 --2- 172.21.15.49:0/3107506113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56c405a510 0x7f56c405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:53.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.627+0000 7f56eb400700 1 --2- 172.21.15.49:0/3107506113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56c405a510 0x7f56c405c9d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f56dc009c30 tx=0x7f56dc009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:53.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.635+0000 7f56e2a00700 1 -- 172.21.15.49:0/3107506113 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f56d4047b60 con 0x7f56ec155880 2024-01-22T05:14:53.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:53.807+0000 7f56f1000700 1 -- 172.21.15.49:0/3107506113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f56ec065790 con 0x7f56ec155880 2024-01-22T05:14:54.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.587+0000 7f56e2a00700 1 -- 172.21.15.49:0/3107506113 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v127) v1 ==== 97+0+0 (secure 0 0 0) 0x7f56d404b180 con 0x7f56ec155880 2024-01-22T05:14:54.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.591+0000 7f56f1000700 1 -- 172.21.15.49:0/3107506113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56c405a510 msgr2=0x7f56c405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:54.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.591+0000 7f56f1000700 1 --2- 172.21.15.49:0/3107506113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56c405a510 0x7f56c405c9d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f56dc009c30 tx=0x7f56dc009060).stop 2024-01-22T05:14:54.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.591+0000 7f56f1000700 1 -- 172.21.15.49:0/3107506113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec155880 msgr2=0x7f56ec0a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:54.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.591+0000 7f56f1000700 1 --2- 172.21.15.49:0/3107506113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec155880 0x7f56ec0a9610 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f56d400d860 tx=0x7f56d4008040).stop 2024-01-22T05:14:54.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.591+0000 7f56f1000700 1 -- 172.21.15.49:0/3107506113 shutdown_connections 2024-01-22T05:14:54.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.591+0000 7f56f1000700 1 --2- 172.21.15.49:0/3107506113 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56c405a510 0x7f56c405c9d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:54.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.591+0000 7f56f1000700 1 --2- 172.21.15.49:0/3107506113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56ec155c60 0x7f56ec0a9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:54.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.591+0000 7f56f1000700 1 --2- 172.21.15.49:0/3107506113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec155880 0x7f56ec0a9610 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:54.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.591+0000 7f56f1000700 1 --2- 172.21.15.49:0/3107506113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ec0a8e80 0x7f56ec09f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:54.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.591+0000 7f56f1000700 1 -- 172.21.15.49:0/3107506113 >> 172.21.15.49:0/3107506113 conn(0x7f56ec0c6530 msgr2=0x7f56ec0c2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:54.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.595+0000 7f56f1000700 1 -- 172.21.15.49:0/3107506113 shutdown_connections 2024-01-22T05:14:54.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.595+0000 7f56f1000700 1 -- 172.21.15.49:0/3107506113 wait complete. 2024-01-22T05:14:54.599 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-01-22T05:14:54.621 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-22T05:14:54.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.787+0000 7fd154a00700 1 Processor -- start 2024-01-22T05:14:54.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.787+0000 7fd154a00700 1 -- start start 2024-01-22T05:14:54.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.791+0000 7fd154a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd14c0a8740 0x7fd14c0a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:54.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.791+0000 7fd154a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd14c0c1a40 con 0x7fd14c155d20 2024-01-22T05:14:54.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.791+0000 7fd154a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd14c0a90b0 con 0x7fd14c0c1ed0 2024-01-22T05:14:54.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.791+0000 7fd154a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c159310 con 0x7fd14c0a8740 2024-01-22T05:14:54.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.791+0000 7fd152000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd14c155d20 0x7fd14c065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36478/0 (socket says 172.21.15.49:36478) 2024-01-22T05:14:54.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.791+0000 7fd152000700 1 -- 172.21.15.49:0/1154144864 learned_addr learned my addr 172.21.15.49:0/1154144864 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:54.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.791+0000 7fd151600700 1 --2- 172.21.15.49:0/1154144864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd14c0a8740 0x7fd14c0a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:54.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.791+0000 7fd150c00700 1 -- 172.21.15.49:0/1154144864 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255991616 0 0) 0x7fd14c0c1a40 con 0x7fd14c155d20 2024-01-22T05:14:54.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.791+0000 7fd150c00700 1 -- 172.21.15.49:0/1154144864 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd12c0033f0 con 0x7fd14c155d20 2024-01-22T05:14:54.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.791+0000 7fd151600700 1 -- 172.21.15.49:0/1154144864 >> v1:172.21.15.110:6789/0 conn(0x7fd14c0c1ed0 legacy=0x7fd14c0c2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:54.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.791+0000 7fd151600700 1 -- 172.21.15.49:0/1154144864 >> v1:172.21.15.49:6789/0 conn(0x7fd14c155d20 legacy=0x7fd14c065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:54.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.791+0000 7fd151600700 1 -- 172.21.15.49:0/1154144864 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c0c13f0 con 0x7fd14c0a8740 2024-01-22T05:14:54.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.791+0000 7fd151600700 1 --2- 172.21.15.49:0/1154144864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd14c0a8740 0x7fd14c0a8bc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fd134009790 tx=0x7fd134009060).ready entity=mon.2 client_cookie=63d773379c3e6333 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:54.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.791+0000 7fd150c00700 1 -- 172.21.15.49:0/1154144864 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13400f510 con 0x7fd14c0a8740 2024-01-22T05:14:54.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.795+0000 7fd150c00700 1 -- 172.21.15.49:0/1154144864 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13400f670 con 0x7fd14c0a8740 2024-01-22T05:14:54.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.795+0000 7fd150c00700 1 -- 172.21.15.49:0/1154144864 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13400f9f0 con 0x7fd14c0a8740 2024-01-22T05:14:54.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.795+0000 7fd154a00700 1 -- 172.21.15.49:0/1154144864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd14c0a8740 msgr2=0x7fd14c0a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:54.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.795+0000 7fd154a00700 1 --2- 172.21.15.49:0/1154144864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd14c0a8740 0x7fd14c0a8bc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fd134009790 tx=0x7fd134009060).stop 2024-01-22T05:14:54.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.795+0000 7fd154a00700 1 -- 172.21.15.49:0/1154144864 shutdown_connections 2024-01-22T05:14:54.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.795+0000 7fd154a00700 1 --2- 172.21.15.49:0/1154144864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd14c0a8740 0x7fd14c0a8bc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:54.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.795+0000 7fd154a00700 1 -- 172.21.15.49:0/1154144864 >> 172.21.15.49:0/1154144864 conn(0x7fd14c0c6540 msgr2=0x7fd14c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:54.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.795+0000 7fd154a00700 1 -- 172.21.15.49:0/1154144864 shutdown_connections 2024-01-22T05:14:54.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.795+0000 7fd154a00700 1 -- 172.21.15.49:0/1154144864 wait complete. 2024-01-22T05:14:54.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.799+0000 7fd154a00700 1 Processor -- start 2024-01-22T05:14:54.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.799+0000 7fd154a00700 1 -- start start 2024-01-22T05:14:54.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.799+0000 7fd154a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd14c0a8740 0x7fd14c0c0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:54.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd154a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd14c0c1ed0 0x7fd14c0a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:54.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd154a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd14c155d20 0x7fd14c0ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:54.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd154a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c0aac10 con 0x7fd14c155d20 2024-01-22T05:14:54.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd154a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c0aa000 con 0x7fd14c0c1ed0 2024-01-22T05:14:54.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd154a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c0aa2e0 con 0x7fd14c0a8740 2024-01-22T05:14:54.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd152a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd14c155d20 0x7fd14c0ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:54.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd152a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd14c155d20 0x7fd14c0ab980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58634/0 (socket says 172.21.15.49:58634) 2024-01-22T05:14:54.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd152a00700 1 -- 172.21.15.49:0/3090339318 learned_addr learned my addr 172.21.15.49:0/3090339318 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:54.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd152000700 1 --2- 172.21.15.49:0/3090339318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd14c0a8740 0x7fd14c0c0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:54.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd151600700 1 --2- 172.21.15.49:0/3090339318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd14c0c1ed0 0x7fd14c0a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:54.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd152a00700 1 -- 172.21.15.49:0/3090339318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd14c0a8740 msgr2=0x7fd14c0c0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:54.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd152a00700 1 --2- 172.21.15.49:0/3090339318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd14c0a8740 0x7fd14c0c0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:54.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd152a00700 1 -- 172.21.15.49:0/3090339318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd14c0c1ed0 msgr2=0x7fd14c0a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:54.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd152a00700 1 --2- 172.21.15.49:0/3090339318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd14c0c1ed0 0x7fd14c0a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:54.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd152a00700 1 -- 172.21.15.49:0/3090339318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1340092a0 con 0x7fd14c155d20 2024-01-22T05:14:54.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd152000700 1 --2- 172.21.15.49:0/3090339318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd14c0a8740 0x7fd14c0c0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:54.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd152a00700 1 --2- 172.21.15.49:0/3090339318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd14c155d20 0x7fd14c0ab980 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7fd144002230 tx=0x7fd1440015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:54.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd149600700 1 -- 172.21.15.49:0/3090339318 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14400e4a0 con 0x7fd14c155d20 2024-01-22T05:14:54.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd149600700 1 -- 172.21.15.49:0/3090339318 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14400e600 con 0x7fd14c155d20 2024-01-22T05:14:54.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd154a00700 1 -- 172.21.15.49:0/3090339318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14c0aa5c0 con 0x7fd14c155d20 2024-01-22T05:14:54.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd149600700 1 -- 172.21.15.49:0/3090339318 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14400e980 con 0x7fd14c155d20 2024-01-22T05:14:54.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.803+0000 7fd154a00700 1 -- 172.21.15.49:0/3090339318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14c168c00 con 0x7fd14c155d20 2024-01-22T05:14:54.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.807+0000 7fd149600700 1 -- 172.21.15.49:0/3090339318 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd14401b3b0 con 0x7fd14c155d20 2024-01-22T05:14:54.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.807+0000 7fd154a00700 1 -- 172.21.15.49:0/3090339318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14c0aaa40 con 0x7fd14c155d20 2024-01-22T05:14:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.807+0000 7fd149600700 1 --2- 172.21.15.49:0/3090339318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd12405a510 0x7fd12405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.807+0000 7fd149600700 1 -- 172.21.15.49:0/3090339318 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fd144073d50 con 0x7fd14c155d20 2024-01-22T05:14:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.807+0000 7fd152000700 1 --2- 172.21.15.49:0/3090339318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd12405a510 0x7fd12405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.807+0000 7fd152000700 1 --2- 172.21.15.49:0/3090339318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd12405a510 0x7fd12405c9d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fd13c005750 tx=0x7fd13c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:54.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:54.811+0000 7fd149600700 1 -- 172.21.15.49:0/3090339318 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd1440476b0 con 0x7fd14c155d20 2024-01-22T05:14:55.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.031+0000 7fd154a00700 1 -- 172.21.15.49:0/3090339318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd14c0aad50 con 0x7fd14c155d20 2024-01-22T05:14:55.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.031+0000 7fd149600700 1 -- 172.21.15.49:0/3090339318 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd14404acd0 con 0x7fd14c155d20 2024-01-22T05:14:55.033 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:55.034 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:14:55.034 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-01-22T05:14:55.034 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.034 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-01-22T05:14:55.034 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lTCfoJxAAxDGvXKXgooA9/f0J70s6AA==", 2024-01-22T05:14:55.034 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.034 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:14:55.034 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:14:55.034 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:14:55.034 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:14:55.034 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.034 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.034 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.034 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-01-22T05:14:55.035 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lHqV6ORAA1DwpPV2PyDBF/6/ePTdQJw==", 2024-01-22T05:14:55.035 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.035 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:14:55.035 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:14:55.035 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:14:55.035 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:14:55.035 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.035 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.035 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-01-22T05:14:55.035 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lPo86MhAAonfC3M+AkLldljODYNGzyA==", 2024-01-22T05:14:55.035 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.035 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:14:55.035 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:14:55.036 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:14:55.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:14:55.036 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.036 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.036 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.036 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-01-22T05:14:55.036 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lLwvMBxAAFm52HWeGbTH1gbWVm6r5zQ==", 2024-01-22T05:14:55.036 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.036 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:14:55.036 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:14:55.036 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:14:55.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:14:55.036 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.036 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAt961lH2F9NBAAHm8R9/Q5IuFUvb0o1GyD4Q==", 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAx961lS1lEIhAAuDm2OYfTYff1kVEq5vXvFw==", 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:14:55.037 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA1961limLvERAAv23crKrwjLIg84u48BHHbg==", 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA5961lShJiABAAnvyhz0ggDaITaMgwzi9kAA==", 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.038 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:14:55.039 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:14:55.039 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:14:55.039 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.039 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.039 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2024-01-22T05:14:55.039 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA9961lcopfNRAAAZgHzI1t7YHI5cAjaCMiNw==", 2024-01-22T05:14:55.039 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.039 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:14:55.039 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:14:55.039 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:14:55.039 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.039 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.039 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2024-01-22T05:14:55.040 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBB961lX+nTIxAAtP3YQypuFWM5O/LADjvybA==", 2024-01-22T05:14:55.040 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.040 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:14:55.040 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:14:55.040 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:14:55.040 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.040 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.040 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2024-01-22T05:14:55.040 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBF961lQ4/XERAARZPqENsV3jokk2g3OXUI5w==", 2024-01-22T05:14:55.040 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.040 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:14:55.040 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:14:55.040 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBI961luxnqOhAAGsV74DKQda5cetNA/woOnA==", 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lmrM6DhAAYU09HviWyrUIz4lio15wFw==", 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:14:55.041 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-01-22T05:14:55.042 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-22T05:14:55.042 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.042 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.042 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.042 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-01-22T05:14:55.042 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lIhYRGRAAFG+YtkDLFsra6zU44xKCHw==", 2024-01-22T05:14:55.042 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.042 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:14:55.042 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:14:55.042 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:14:55.042 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:14:55.042 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.042 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.042 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.043 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2024-01-22T05:14:55.043 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lRuyaExAAQO3a7ahOEcuE+WVfXYEBTg==", 2024-01-22T05:14:55.043 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.043 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:14:55.043 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:14:55.043 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:14:55.043 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:14:55.043 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.043 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.043 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.043 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2024-01-22T05:14:55.043 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lMiMkHhAAxPdKpcHdtqSphbc/2agq9Q==", 2024-01-22T05:14:55.043 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.043 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:14:55.044 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:14:55.044 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:14:55.044 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:14:55.044 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.044 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.044 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-01-22T05:14:55.044 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961ljsweARAAJrY3z/sBjayjB2BRQNrJew==", 2024-01-22T05:14:55.044 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.044 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:14:55.044 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:14:55.044 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:14:55.044 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:14:55.044 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-01-22T05:14:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961l0DwDIhAAeuCu79LxNMEJvWiW/BfDhA==", 2024-01-22T05:14:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:14:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:14:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:14:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2024-01-22T05:14:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lZlmPGxAA1KVZR+XzNdoFVo/980hD8w==", 2024-01-22T05:14:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:14:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:14:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:14:55.046 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:14:55.046 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.046 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:55.046 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-01-22T05:14:55.046 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:14:55.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.035+0000 7fd154a00700 1 -- 172.21.15.49:0/3090339318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd12405a510 msgr2=0x7fd12405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.035+0000 7fd154a00700 1 --2- 172.21.15.49:0/3090339318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd12405a510 0x7fd12405c9d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fd13c005750 tx=0x7fd13c009040).stop 2024-01-22T05:14:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.035+0000 7fd154a00700 1 -- 172.21.15.49:0/3090339318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd14c155d20 msgr2=0x7fd14c0ab980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.035+0000 7fd154a00700 1 --2- 172.21.15.49:0/3090339318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd14c155d20 0x7fd14c0ab980 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7fd144002230 tx=0x7fd1440015e0).stop 2024-01-22T05:14:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.035+0000 7fd154a00700 1 -- 172.21.15.49:0/3090339318 shutdown_connections 2024-01-22T05:14:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.035+0000 7fd154a00700 1 --2- 172.21.15.49:0/3090339318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd12405a510 0x7fd12405c9d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.035+0000 7fd154a00700 1 --2- 172.21.15.49:0/3090339318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd14c155d20 0x7fd14c0ab980 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.035+0000 7fd154a00700 1 --2- 172.21.15.49:0/3090339318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd14c0c1ed0 0x7fd14c0a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.035+0000 7fd154a00700 1 --2- 172.21.15.49:0/3090339318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd14c0a8740 0x7fd14c0c0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.035+0000 7fd154a00700 1 -- 172.21.15.49:0/3090339318 >> 172.21.15.49:0/3090339318 conn(0x7fd14c0c6540 msgr2=0x7fd14c065cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.035+0000 7fd154a00700 1 -- 172.21.15.49:0/3090339318 shutdown_connections 2024-01-22T05:14:55.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.035+0000 7fd154a00700 1 -- 172.21.15.49:0/3090339318 wait complete. 2024-01-22T05:14:55.053 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:14:55.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.203+0000 7f82df800700 1 Processor -- start 2024-01-22T05:14:55.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.203+0000 7f82df800700 1 -- start start 2024-01-22T05:14:55.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82df800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f82d8155d20 0x7f82d8065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82df800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f82d80a8e50 0x7f82d80c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82df800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d80c1a40 con 0x7f82d8066070 2024-01-22T05:14:55.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82df800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d8159310 con 0x7f82d80a8e50 2024-01-22T05:14:55.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82df800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d80c13f0 con 0x7f82d8155d20 2024-01-22T05:14:55.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82dd800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f82d80a8e50 0x7f82d80c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82dd800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f82d80a8e50 0x7f82d80c1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58640/0 (socket says 172.21.15.49:58640) 2024-01-22T05:14:55.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82dd800700 1 -- 172.21.15.49:0/422948315 learned_addr learned my addr 172.21.15.49:0/422948315 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:55.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82dce00700 1 --2- 172.21.15.49:0/422948315 >> v2:172.21.15.110:3300/0 conn(0x7f82d8155d20 0x7f82d8065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82dd800700 1 -- 172.21.15.49:0/422948315 >> v2:172.21.15.110:3300/0 conn(0x7f82d8155d20 msgr2=0x7f82d8065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:55.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82d7400700 1 -- 172.21.15.49:0/422948315 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650679662 0 0) 0x7f82d80c1a40 con 0x7f82d8066070 2024-01-22T05:14:55.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82dd800700 1 --2- 172.21.15.49:0/422948315 >> v2:172.21.15.110:3300/0 conn(0x7f82d8155d20 0x7f82d8065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82dd800700 1 -- 172.21.15.49:0/422948315 >> v1:172.21.15.110:6789/0 conn(0x7f82d8066070 legacy=0x7f82d80a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82dd800700 1 -- 172.21.15.49:0/422948315 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d80c16d0 con 0x7f82d80a8e50 2024-01-22T05:14:55.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82dd800700 1 --2- 172.21.15.49:0/422948315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d80a8e50 0x7f82d80c1ed0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f82d805ff40 tx=0x7f82d0009840).ready entity=mon.0 client_cookie=74cc8daaefa1347b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:55.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82d7400700 1 -- 172.21.15.49:0/422948315 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d000e070 con 0x7f82d80a8e50 2024-01-22T05:14:55.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82d7400700 1 -- 172.21.15.49:0/422948315 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d000ba20 con 0x7f82d80a8e50 2024-01-22T05:14:55.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82d7400700 1 -- 172.21.15.49:0/422948315 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d000bda0 con 0x7f82d80a8e50 2024-01-22T05:14:55.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82df800700 1 -- 172.21.15.49:0/422948315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d80a8e50 msgr2=0x7f82d80c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.207+0000 7f82df800700 1 --2- 172.21.15.49:0/422948315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d80a8e50 0x7f82d80c1ed0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f82d805ff40 tx=0x7f82d0009840).stop 2024-01-22T05:14:55.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.211+0000 7f82df800700 1 -- 172.21.15.49:0/422948315 shutdown_connections 2024-01-22T05:14:55.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.211+0000 7f82df800700 1 --2- 172.21.15.49:0/422948315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d80a8e50 0x7f82d80c1ed0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.211+0000 7f82df800700 1 --2- 172.21.15.49:0/422948315 >> v2:172.21.15.110:3300/0 conn(0x7f82d8155d20 0x7f82d8065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.211+0000 7f82df800700 1 -- 172.21.15.49:0/422948315 >> 172.21.15.49:0/422948315 conn(0x7f82d80c6540 msgr2=0x7f82d80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:55.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.211+0000 7f82df800700 1 -- 172.21.15.49:0/422948315 shutdown_connections 2024-01-22T05:14:55.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.211+0000 7f82df800700 1 -- 172.21.15.49:0/422948315 wait complete. 2024-01-22T05:14:55.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.211+0000 7f82df800700 1 Processor -- start 2024-01-22T05:14:55.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.211+0000 7f82df800700 1 -- start start 2024-01-22T05:14:55.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82df800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d8066070 0x7f82d80aa110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82df800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82d80a8e50 0x7f82d80aa600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82df800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d8155d20 0x7f82d816b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82df800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d80ac1d0 con 0x7f82d8066070 2024-01-22T05:14:55.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82df800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d80abd40 con 0x7f82d80a8e50 2024-01-22T05:14:55.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82df800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d80ab130 con 0x7f82d8155d20 2024-01-22T05:14:55.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82dce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d8066070 0x7f82d80aa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82dce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d8066070 0x7f82d80aa110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58654/0 (socket says 172.21.15.49:58654) 2024-01-22T05:14:55.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82dce00700 1 -- 172.21.15.49:0/2253558173 learned_addr learned my addr 172.21.15.49:0/2253558173 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:55.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82d7e00700 1 --2- 172.21.15.49:0/2253558173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82d80a8e50 0x7f82d80aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82dd800700 1 --2- 172.21.15.49:0/2253558173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d8155d20 0x7f82d816b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82dce00700 1 -- 172.21.15.49:0/2253558173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d8155d20 msgr2=0x7f82d816b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82dce00700 1 --2- 172.21.15.49:0/2253558173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d8155d20 0x7f82d816b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82dce00700 1 -- 172.21.15.49:0/2253558173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82d80a8e50 msgr2=0x7f82d80aa600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82dce00700 1 --2- 172.21.15.49:0/2253558173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82d80a8e50 0x7f82d80aa600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82dce00700 1 -- 172.21.15.49:0/2253558173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d0009ae0 con 0x7f82d8066070 2024-01-22T05:14:55.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82dce00700 1 --2- 172.21.15.49:0/2253558173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d8066070 0x7f82d80aa110 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f82c800e930 tx=0x7f82c8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:55.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82cfe00700 1 -- 172.21.15.49:0/2253558173 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8012600 con 0x7f82d8066070 2024-01-22T05:14:55.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82cfe00700 1 -- 172.21.15.49:0/2253558173 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c8012760 con 0x7f82d8066070 2024-01-22T05:14:55.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82df800700 1 -- 172.21.15.49:0/2253558173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d80ab410 con 0x7f82d8066070 2024-01-22T05:14:55.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.215+0000 7f82cfe00700 1 -- 172.21.15.49:0/2253558173 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8012ae0 con 0x7f82d8066070 2024-01-22T05:14:55.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.219+0000 7f82df800700 1 -- 172.21.15.49:0/2253558173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d80ab9d0 con 0x7f82d8066070 2024-01-22T05:14:55.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.219+0000 7f82df800700 1 -- 172.21.15.49:0/2253558173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d8047060 con 0x7f82d8066070 2024-01-22T05:14:55.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.219+0000 7f82cfe00700 1 -- 172.21.15.49:0/2253558173 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f82c801b400 con 0x7f82d8066070 2024-01-22T05:14:55.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.223+0000 7f82cfe00700 1 --2- 172.21.15.49:0/2253558173 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82b005a540 0x7f82b005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.223+0000 7f82cfe00700 1 -- 172.21.15.49:0/2253558173 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f82c8074880 con 0x7f82d8066070 2024-01-22T05:14:55.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.223+0000 7f82d7e00700 1 --2- 172.21.15.49:0/2253558173 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82b005a540 0x7f82b005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.223+0000 7f82d7e00700 1 --2- 172.21.15.49:0/2253558173 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82b005a540 0x7f82b005ca00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f82c0007fd0 tx=0x7f82c0007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:55.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.227+0000 7f82cfe00700 1 -- 172.21.15.49:0/2253558173 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f82c8048130 con 0x7f82d8066070 2024-01-22T05:14:55.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.390+0000 7f82df800700 1 -- 172.21.15.49:0/2253558173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82d80c23c0 con 0x7f82d8066070 2024-01-22T05:14:55.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.394+0000 7f82cfe00700 1 -- 172.21.15.49:0/2253558173 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+13958 (secure 0 0 0) 0x7f82c804b750 con 0x7f82d8066070 2024-01-22T05:14:55.397 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:55.397 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":127,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:14:54.581231+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:14:55.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.394+0000 7f82df800700 1 -- 172.21.15.49:0/2253558173 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82b005a540 msgr2=0x7f82b005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.394+0000 7f82df800700 1 --2- 172.21.15.49:0/2253558173 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82b005a540 0x7f82b005ca00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f82c0007fd0 tx=0x7f82c0007bb0).stop 2024-01-22T05:14:55.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.394+0000 7f82df800700 1 -- 172.21.15.49:0/2253558173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d8066070 msgr2=0x7f82d80aa110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.394+0000 7f82df800700 1 --2- 172.21.15.49:0/2253558173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d8066070 0x7f82d80aa110 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f82c800e930 tx=0x7f82c8009060).stop 2024-01-22T05:14:55.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.398+0000 7f82df800700 1 -- 172.21.15.49:0/2253558173 shutdown_connections 2024-01-22T05:14:55.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.398+0000 7f82df800700 1 --2- 172.21.15.49:0/2253558173 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82b005a540 0x7f82b005ca00 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.398+0000 7f82df800700 1 --2- 172.21.15.49:0/2253558173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d8155d20 0x7f82d816b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.398+0000 7f82df800700 1 --2- 172.21.15.49:0/2253558173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82d80a8e50 0x7f82d80aa600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.398+0000 7f82df800700 1 --2- 172.21.15.49:0/2253558173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82d8066070 0x7f82d80aa110 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.398+0000 7f82df800700 1 -- 172.21.15.49:0/2253558173 >> 172.21.15.49:0/2253558173 conn(0x7f82d80c6540 msgr2=0x7f82d80c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:55.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.398+0000 7f82df800700 1 -- 172.21.15.49:0/2253558173 shutdown_connections 2024-01-22T05:14:55.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.398+0000 7f82df800700 1 -- 172.21.15.49:0/2253558173 wait complete. 2024-01-22T05:14:55.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:14:55.423 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:14:55.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.578+0000 7fd76dc00700 1 Processor -- start 2024-01-22T05:14:55.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.578+0000 7fd76dc00700 1 -- start start 2024-01-22T05:14:55.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.582+0000 7fd76dc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd768067a90 0x7fd76815bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.582+0000 7fd76dc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd76815c0b0 0x7fd768158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.582+0000 7fd76dc00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd768069600 con 0x7fd768158b60 2024-01-22T05:14:55.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.582+0000 7fd76dc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7681561a0 con 0x7fd768067a90 2024-01-22T05:14:55.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.582+0000 7fd76dc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd768068dd0 con 0x7fd76815c0b0 2024-01-22T05:14:55.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.582+0000 7fd767400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd76815c0b0 0x7fd768158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.582+0000 7fd767400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd76815c0b0 0x7fd768158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:53392/0 (socket says 172.21.15.49:53392) 2024-01-22T05:14:55.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.582+0000 7fd767400700 1 -- 172.21.15.49:0/2473337952 learned_addr learned my addr 172.21.15.49:0/2473337952 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:55.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.582+0000 7fd767e00700 1 --2- 172.21.15.49:0/2473337952 >> v2:172.21.15.110:3300/0 conn(0x7fd768067a90 0x7fd76815bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.582+0000 7fd767400700 1 -- 172.21.15.49:0/2473337952 >> v2:172.21.15.110:3300/0 conn(0x7fd768067a90 msgr2=0x7fd76815bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:55.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.582+0000 7fd767400700 1 --2- 172.21.15.49:0/2473337952 >> v2:172.21.15.110:3300/0 conn(0x7fd768067a90 0x7fd76815bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.582+0000 7fd766a00700 1 -- 172.21.15.49:0/2473337952 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120189905 0 0) 0x7fd768069600 con 0x7fd768158b60 2024-01-22T05:14:55.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.582+0000 7fd767400700 1 -- 172.21.15.49:0/2473337952 >> v1:172.21.15.110:6789/0 conn(0x7fd768158b60 legacy=0x7fd768065900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.582+0000 7fd767400700 1 -- 172.21.15.49:0/2473337952 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76815c510 con 0x7fd76815c0b0 2024-01-22T05:14:55.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.582+0000 7fd767400700 1 --2- 172.21.15.49:0/2473337952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd76815c0b0 0x7fd768158670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fd750006fd0 tx=0x7fd7500090f0).ready entity=mon.2 client_cookie=6371a885681873b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:55.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.586+0000 7fd766a00700 1 -- 172.21.15.49:0/2473337952 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75000b580 con 0x7fd76815c0b0 2024-01-22T05:14:55.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.586+0000 7fd766a00700 1 -- 172.21.15.49:0/2473337952 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75000b6e0 con 0x7fd76815c0b0 2024-01-22T05:14:55.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.586+0000 7fd766a00700 1 -- 172.21.15.49:0/2473337952 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75000ba60 con 0x7fd76815c0b0 2024-01-22T05:14:55.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.586+0000 7fd76dc00700 1 -- 172.21.15.49:0/2473337952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd76815c0b0 msgr2=0x7fd768158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.586+0000 7fd76dc00700 1 --2- 172.21.15.49:0/2473337952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd76815c0b0 0x7fd768158670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fd750006fd0 tx=0x7fd7500090f0).stop 2024-01-22T05:14:55.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.586+0000 7fd76dc00700 1 -- 172.21.15.49:0/2473337952 shutdown_connections 2024-01-22T05:14:55.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.586+0000 7fd76dc00700 1 --2- 172.21.15.49:0/2473337952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd76815c0b0 0x7fd768158670 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.586+0000 7fd76dc00700 1 --2- 172.21.15.49:0/2473337952 >> v2:172.21.15.110:3300/0 conn(0x7fd768067a90 0x7fd76815bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.586+0000 7fd76dc00700 1 -- 172.21.15.49:0/2473337952 >> 172.21.15.49:0/2473337952 conn(0x7fd7680c6fc0 msgr2=0x7fd7680c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:55.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.586+0000 7fd76dc00700 1 -- 172.21.15.49:0/2473337952 shutdown_connections 2024-01-22T05:14:55.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.586+0000 7fd76dc00700 1 -- 172.21.15.49:0/2473337952 wait complete. 2024-01-22T05:14:55.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.590+0000 7fd76dc00700 1 Processor -- start 2024-01-22T05:14:55.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.590+0000 7fd76dc00700 1 -- start start 2024-01-22T05:14:55.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.590+0000 7fd76dc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd768067a90 0x7fd768157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.590+0000 7fd76dc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd768158b60 0x7fd768168330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.590+0000 7fd76dc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd76815c0b0 0x7fd7680a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.590+0000 7fd76dc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7680bfb40 con 0x7fd76815c0b0 2024-01-22T05:14:55.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.590+0000 7fd76dc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7680bec90 con 0x7fd768158b60 2024-01-22T05:14:55.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.590+0000 7fd76dc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7680bef30 con 0x7fd768067a90 2024-01-22T05:14:55.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd76d200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd76815c0b0 0x7fd7680a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd76d200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd76815c0b0 0x7fd7680a9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58668/0 (socket says 172.21.15.49:58668) 2024-01-22T05:14:55.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd76d200700 1 -- 172.21.15.49:0/133011876 learned_addr learned my addr 172.21.15.49:0/133011876 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd767e00700 1 --2- 172.21.15.49:0/133011876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd768067a90 0x7fd768157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd767400700 1 --2- 172.21.15.49:0/133011876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd768158b60 0x7fd768168330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd76d200700 1 -- 172.21.15.49:0/133011876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd768067a90 msgr2=0x7fd768157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd76d200700 1 --2- 172.21.15.49:0/133011876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd768067a90 0x7fd768157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd76d200700 1 -- 172.21.15.49:0/133011876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd768158b60 msgr2=0x7fd768168330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd76d200700 1 --2- 172.21.15.49:0/133011876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd768158b60 0x7fd768168330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd76d200700 1 -- 172.21.15.49:0/133011876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd750009370 con 0x7fd76815c0b0 2024-01-22T05:14:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd767400700 1 --2- 172.21.15.49:0/133011876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd768158b60 0x7fd768168330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd76d200700 1 --2- 172.21.15.49:0/133011876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd76815c0b0 0x7fd7680a9ac0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fd760002230 tx=0x7fd760007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd75f400700 1 -- 172.21.15.49:0/133011876 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760010510 con 0x7fd76815c0b0 2024-01-22T05:14:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd75f400700 1 -- 172.21.15.49:0/133011876 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd760010670 con 0x7fd76815c0b0 2024-01-22T05:14:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd76dc00700 1 -- 172.21.15.49:0/133011876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7680bf210 con 0x7fd76815c0b0 2024-01-22T05:14:55.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd75f400700 1 -- 172.21.15.49:0/133011876 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760010a10 con 0x7fd76815c0b0 2024-01-22T05:14:55.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd76dc00700 1 -- 172.21.15.49:0/133011876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7680bf7d0 con 0x7fd76815c0b0 2024-01-22T05:14:55.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.594+0000 7fd76dc00700 1 -- 172.21.15.49:0/133011876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7680bfcb0 con 0x7fd76815c0b0 2024-01-22T05:14:55.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.598+0000 7fd75f400700 1 -- 172.21.15.49:0/133011876 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd76001b400 con 0x7fd76815c0b0 2024-01-22T05:14:55.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.598+0000 7fd75f400700 1 --2- 172.21.15.49:0/133011876 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd74005a540 0x7fd74005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.598+0000 7fd75f400700 1 -- 172.21.15.49:0/133011876 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fd7600744c0 con 0x7fd76815c0b0 2024-01-22T05:14:55.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.598+0000 7fd767e00700 1 --2- 172.21.15.49:0/133011876 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd74005a540 0x7fd74005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.602+0000 7fd767e00700 1 --2- 172.21.15.49:0/133011876 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd74005a540 0x7fd74005ca00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fd758006fd0 tx=0x7fd758006f40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:55.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.606+0000 7fd75f400700 1 -- 172.21.15.49:0/133011876 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd760047d70 con 0x7fd76815c0b0 2024-01-22T05:14:55.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.766+0000 7fd76dc00700 1 -- 172.21.15.49:0/133011876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd768047060 con 0x7fd76815c0b0 2024-01-22T05:14:55.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.766+0000 7fd75f400700 1 -- 172.21.15.49:0/133011876 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v127) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd76004b390 con 0x7fd76815c0b0 2024-01-22T05:14:55.770 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:14:55.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.770+0000 7fd76dc00700 1 -- 172.21.15.49:0/133011876 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd74005a540 msgr2=0x7fd74005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.770+0000 7fd76dc00700 1 --2- 172.21.15.49:0/133011876 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd74005a540 0x7fd74005ca00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fd758006fd0 tx=0x7fd758006f40).stop 2024-01-22T05:14:55.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.770+0000 7fd76dc00700 1 -- 172.21.15.49:0/133011876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd76815c0b0 msgr2=0x7fd7680a9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.770+0000 7fd76dc00700 1 --2- 172.21.15.49:0/133011876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd76815c0b0 0x7fd7680a9ac0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fd760002230 tx=0x7fd760007f70).stop 2024-01-22T05:14:55.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.770+0000 7fd76dc00700 1 -- 172.21.15.49:0/133011876 shutdown_connections 2024-01-22T05:14:55.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.770+0000 7fd76dc00700 1 --2- 172.21.15.49:0/133011876 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd74005a540 0x7fd74005ca00 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.770+0000 7fd76dc00700 1 --2- 172.21.15.49:0/133011876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd76815c0b0 0x7fd7680a9ac0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.770+0000 7fd76dc00700 1 --2- 172.21.15.49:0/133011876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd768158b60 0x7fd768168330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.770+0000 7fd76dc00700 1 --2- 172.21.15.49:0/133011876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd768067a90 0x7fd768157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.770+0000 7fd76dc00700 1 -- 172.21.15.49:0/133011876 >> 172.21.15.49:0/133011876 conn(0x7fd7680c6fc0 msgr2=0x7fd7680c4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:55.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.770+0000 7fd76dc00700 1 -- 172.21.15.49:0/133011876 shutdown_connections 2024-01-22T05:14:55.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.770+0000 7fd76dc00700 1 -- 172.21.15.49:0/133011876 wait complete. 2024-01-22T05:14:55.796 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:14:55.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.962+0000 7f9ccf200700 1 Processor -- start 2024-01-22T05:14:55.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.962+0000 7f9ccf200700 1 -- start start 2024-01-22T05:14:55.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.966+0000 7f9ccf200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc80c3c80 0x7f9cc80c4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.966+0000 7f9ccf200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9cc815b6b0 0x7f9cc815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.966+0000 7f9ccf200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc80be2b0 con 0x7f9cc8067a90 2024-01-22T05:14:55.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.966+0000 7f9ccf200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc80bf3d0 con 0x7f9cc815b6b0 2024-01-22T05:14:55.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.966+0000 7f9ccf200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8153fd0 con 0x7f9cc80c3c80 2024-01-22T05:14:55.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.966+0000 7f9cce800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9cc815b6b0 0x7f9cc815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.966+0000 7f9cce800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9cc815b6b0 0x7f9cc815daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58682/0 (socket says 172.21.15.49:58682) 2024-01-22T05:14:55.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.966+0000 7f9cce800700 1 -- 172.21.15.49:0/4027198227 learned_addr learned my addr 172.21.15.49:0/4027198227 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:55.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.966+0000 7f9ccde00700 1 --2- 172.21.15.49:0/4027198227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc80c3c80 0x7f9cc80c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.966+0000 7f9cce800700 1 -- 172.21.15.49:0/4027198227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc80c3c80 msgr2=0x7f9cc80c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:55.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.966+0000 7f9cce800700 1 --2- 172.21.15.49:0/4027198227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc80c3c80 0x7f9cc80c4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.966+0000 7f9cce800700 1 -- 172.21.15.49:0/4027198227 >> v1:172.21.15.110:6789/0 conn(0x7f9cc8067a90 legacy=0x7f9cc8067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.970+0000 7f9cce800700 1 -- 172.21.15.49:0/4027198227 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc8068600 con 0x7f9cc815b6b0 2024-01-22T05:14:55.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.970+0000 7f9cce800700 1 --2- 172.21.15.49:0/4027198227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc815b6b0 0x7f9cc815daa0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f9cc0009f20 tx=0x7f9cc0009840).ready entity=mon.0 client_cookie=31e315e89fdb052d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:55.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.970+0000 7f9ccca00700 1 -- 172.21.15.49:0/4027198227 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc000e070 con 0x7f9cc815b6b0 2024-01-22T05:14:55.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.970+0000 7f9ccca00700 1 -- 172.21.15.49:0/4027198227 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc000b9d0 con 0x7f9cc815b6b0 2024-01-22T05:14:55.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.970+0000 7f9ccca00700 1 -- 172.21.15.49:0/4027198227 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc000bd50 con 0x7f9cc815b6b0 2024-01-22T05:14:55.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.970+0000 7f9ccf200700 1 -- 172.21.15.49:0/4027198227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc815b6b0 msgr2=0x7f9cc815daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.970+0000 7f9ccf200700 1 --2- 172.21.15.49:0/4027198227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc815b6b0 0x7f9cc815daa0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f9cc0009f20 tx=0x7f9cc0009840).stop 2024-01-22T05:14:55.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.970+0000 7f9ccf200700 1 -- 172.21.15.49:0/4027198227 shutdown_connections 2024-01-22T05:14:55.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.970+0000 7f9ccf200700 1 --2- 172.21.15.49:0/4027198227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc815b6b0 0x7f9cc815daa0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.970+0000 7f9ccf200700 1 --2- 172.21.15.49:0/4027198227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc80c3c80 0x7f9cc80c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.970+0000 7f9ccf200700 1 -- 172.21.15.49:0/4027198227 >> 172.21.15.49:0/4027198227 conn(0x7f9cc80c8740 msgr2=0x7f9cc80c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:55.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.970+0000 7f9ccf200700 1 -- 172.21.15.49:0/4027198227 shutdown_connections 2024-01-22T05:14:55.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.970+0000 7f9ccf200700 1 -- 172.21.15.49:0/4027198227 wait complete. 2024-01-22T05:14:55.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.974+0000 7f9ccf200700 1 Processor -- start 2024-01-22T05:14:55.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.974+0000 7f9ccf200700 1 -- start start 2024-01-22T05:14:55.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.974+0000 7f9ccf200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc8067a90 0x7f9cc80c01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.974+0000 7f9ccf200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc80c3c80 0x7f9cc80c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.974+0000 7f9ccf200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc815b6b0 0x7f9cc814c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.974+0000 7f9ccf200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80c0bd0 con 0x7f9cc815b6b0 2024-01-22T05:14:55.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.974+0000 7f9ccf200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80a82c0 con 0x7f9cc80c3c80 2024-01-22T05:14:55.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.974+0000 7f9ccf200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80c0e20 con 0x7f9cc8067a90 2024-01-22T05:14:55.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9cce800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc815b6b0 0x7f9cc814c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9cce800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc815b6b0 0x7f9cc814c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58696/0 (socket says 172.21.15.49:58696) 2024-01-22T05:14:55.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9cce800700 1 -- 172.21.15.49:0/3257236855 learned_addr learned my addr 172.21.15.49:0/3257236855 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:55.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9ccde00700 1 --2- 172.21.15.49:0/3257236855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc8067a90 0x7f9cc80c01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9ccd400700 1 --2- 172.21.15.49:0/3257236855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc80c3c80 0x7f9cc80c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9cce800700 1 -- 172.21.15.49:0/3257236855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc8067a90 msgr2=0x7f9cc80c01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9cce800700 1 --2- 172.21.15.49:0/3257236855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc8067a90 0x7f9cc80c01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9cce800700 1 -- 172.21.15.49:0/3257236855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc80c3c80 msgr2=0x7f9cc80c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:55.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9cce800700 1 --2- 172.21.15.49:0/3257236855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc80c3c80 0x7f9cc80c06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:55.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9cce800700 1 -- 172.21.15.49:0/3257236855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc0009ae0 con 0x7f9cc815b6b0 2024-01-22T05:14:55.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9ccd400700 1 --2- 172.21.15.49:0/3257236855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc80c3c80 0x7f9cc80c06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:14:55.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9cce800700 1 --2- 172.21.15.49:0/3257236855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc815b6b0 0x7f9cc814c100 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f9cc80672b0 tx=0x7f9cc0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:55.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9cc5600700 1 -- 172.21.15.49:0/3257236855 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc00092e0 con 0x7f9cc815b6b0 2024-01-22T05:14:55.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9cc5600700 1 -- 172.21.15.49:0/3257236855 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc0007610 con 0x7f9cc815b6b0 2024-01-22T05:14:55.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9ccf200700 1 -- 172.21.15.49:0/3257236855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc80a8560 con 0x7f9cc815b6b0 2024-01-22T05:14:55.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9cc5600700 1 -- 172.21.15.49:0/3257236855 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc00079d0 con 0x7f9cc815b6b0 2024-01-22T05:14:55.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9ccf200700 1 -- 172.21.15.49:0/3257236855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc80c1100 con 0x7f9cc815b6b0 2024-01-22T05:14:55.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.978+0000 7f9ccf200700 1 -- 172.21.15.49:0/3257236855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc8066520 con 0x7f9cc815b6b0 2024-01-22T05:14:55.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.982+0000 7f9cc5600700 1 -- 172.21.15.49:0/3257236855 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9cc0003040 con 0x7f9cc815b6b0 2024-01-22T05:14:55.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.982+0000 7f9cc5600700 1 --2- 172.21.15.49:0/3257236855 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9ca005a510 0x7f9ca005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:55.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.982+0000 7f9cc5600700 1 -- 172.21.15.49:0/3257236855 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f9cc0075f80 con 0x7f9cc815b6b0 2024-01-22T05:14:55.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.982+0000 7f9ccde00700 1 --2- 172.21.15.49:0/3257236855 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9ca005a510 0x7f9ca005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:55.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.982+0000 7f9ccde00700 1 --2- 172.21.15.49:0/3257236855 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9ca005a510 0x7f9ca005c9d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f9cb8009c30 tx=0x7f9cb8009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:55.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:55.990+0000 7f9cc5600700 1 -- 172.21.15.49:0/3257236855 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9cc0049940 con 0x7f9cc815b6b0 2024-01-22T05:14:56.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.154+0000 7f9ccf200700 1 -- 172.21.15.49:0/3257236855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9cc8064220 con 0x7f9cc815b6b0 2024-01-22T05:14:56.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.154+0000 7f9cc5600700 1 -- 172.21.15.49:0/3257236855 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v127) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9cc0023030 con 0x7f9cc815b6b0 2024-01-22T05:14:56.158 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:14:56.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.158+0000 7f9ccf200700 1 -- 172.21.15.49:0/3257236855 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9ca005a510 msgr2=0x7f9ca005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:56.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.158+0000 7f9ccf200700 1 --2- 172.21.15.49:0/3257236855 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9ca005a510 0x7f9ca005c9d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f9cb8009c30 tx=0x7f9cb8009060).stop 2024-01-22T05:14:56.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.158+0000 7f9ccf200700 1 -- 172.21.15.49:0/3257236855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc815b6b0 msgr2=0x7f9cc814c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:56.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.158+0000 7f9ccf200700 1 --2- 172.21.15.49:0/3257236855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc815b6b0 0x7f9cc814c100 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f9cc80672b0 tx=0x7f9cc0009840).stop 2024-01-22T05:14:56.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.158+0000 7f9ccf200700 1 -- 172.21.15.49:0/3257236855 shutdown_connections 2024-01-22T05:14:56.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.158+0000 7f9ccf200700 1 --2- 172.21.15.49:0/3257236855 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9ca005a510 0x7f9ca005c9d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.158+0000 7f9ccf200700 1 --2- 172.21.15.49:0/3257236855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc815b6b0 0x7f9cc814c100 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.158+0000 7f9ccf200700 1 --2- 172.21.15.49:0/3257236855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc80c3c80 0x7f9cc80c06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.158+0000 7f9ccf200700 1 --2- 172.21.15.49:0/3257236855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc8067a90 0x7f9cc80c01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.158+0000 7f9ccf200700 1 -- 172.21.15.49:0/3257236855 >> 172.21.15.49:0/3257236855 conn(0x7f9cc80c8740 msgr2=0x7f9cc814e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:56.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.158+0000 7f9ccf200700 1 -- 172.21.15.49:0/3257236855 shutdown_connections 2024-01-22T05:14:56.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.162+0000 7f9ccf200700 1 -- 172.21.15.49:0/3257236855 wait complete. 2024-01-22T05:14:56.186 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:14:56.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.346+0000 7fc6c7e00700 1 Processor -- start 2024-01-22T05:14:56.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.346+0000 7fc6c7e00700 1 -- start start 2024-01-22T05:14:56.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c7e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc6c8153280 0x7fc6c8153660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:56.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c7e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c8067a90 con 0x7fc6c8068aa0 2024-01-22T05:14:56.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c7e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c8068610 con 0x7fc6c8155b80 2024-01-22T05:14:56.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c7e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c80a99e0 con 0x7fc6c8153280 2024-01-22T05:14:56.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c6000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc6c8068aa0 0x7fc6c8155470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36484/0 (socket says 172.21.15.49:36484) 2024-01-22T05:14:56.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c6000700 1 -- 172.21.15.49:0/1358836555 learned_addr learned my addr 172.21.15.49:0/1358836555 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:56.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c6a00700 1 --2- 172.21.15.49:0/1358836555 >> v2:172.21.15.110:3300/0 conn(0x7fc6c8153280 0x7fc6c8153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:56.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222196626 0 0) 0x7fc6c8067a90 con 0x7fc6c8068aa0 2024-01-22T05:14:56.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a80033f0 con 0x7fc6c8068aa0 2024-01-22T05:14:56.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681690996 0 0) 0x7fc6c8068610 con 0x7fc6c8155b80 2024-01-22T05:14:56.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6c8067a90 con 0x7fc6c8155b80 2024-01-22T05:14:56.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2167150360 0 0) 0x7fc6a80033f0 con 0x7fc6c8068aa0 2024-01-22T05:14:56.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 >> v2:172.21.15.110:3300/0 conn(0x7fc6c8153280 msgr2=0x7fc6c8153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:56.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 --2- 172.21.15.49:0/1358836555 >> v2:172.21.15.110:3300/0 conn(0x7fc6c8153280 0x7fc6c8153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 >> v1:172.21.15.110:6789/0 conn(0x7fc6c8155b80 legacy=0x7fc6c80ab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c8067ce0 con 0x7fc6c8068aa0 2024-01-22T05:14:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fc6b0001470 con 0x7fc6c8068aa0 2024-01-22T05:14:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c6a00700 1 --2- 172.21.15.49:0/1358836555 >> v2:172.21.15.110:3300/0 conn(0x7fc6c8153280 0x7fc6c8153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 >> v1:172.21.15.49:6789/0 conn(0x7fc6c8068aa0 legacy=0x7fc6c8155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 --2- 172.21.15.49:0/1358836555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6a8003a70 0x7fc6a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 --2- 172.21.15.49:0/1358836555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6a8004690 0x7fc6a8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 --2- 172.21.15.49:0/1358836555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6a8005000 0x7fc6a800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80a99e0 con 0x7fc6a8004690 2024-01-22T05:14:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a800bf60 con 0x7fc6a8005000 2024-01-22T05:14:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.350+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a800c0d0 con 0x7fc6a8003a70 2024-01-22T05:14:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c6000700 1 --2- 172.21.15.49:0/1358836555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6a8004690 0x7fc6a8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:56.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c6000700 1 -- 172.21.15.49:0/1358836555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6a8003a70 msgr2=0x7fc6a8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:56.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c6000700 1 --2- 172.21.15.49:0/1358836555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6a8003a70 0x7fc6a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:14:56.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c6000700 1 -- 172.21.15.49:0/1358836555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6a8005000 msgr2=0x7fc6a800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:56.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c6000700 1 --2- 172.21.15.49:0/1358836555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6a8005000 0x7fc6a800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:14:56.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c6000700 1 -- 172.21.15.49:0/1358836555 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a80033f0 con 0x7fc6a8004690 2024-01-22T05:14:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c7400700 1 -- 172.21.15.49:0/1358836555 reap_dead start 2024-01-22T05:14:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c6000700 1 --2- 172.21.15.49:0/1358836555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6a8004690 0x7fc6a8004b10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fc6b000c190 tx=0x7fc6b0001e10).ready entity=mon.0 client_cookie=a1b612daea49f5b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0007960 con 0x7fc6a8004690 2024-01-22T05:14:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b000ca60 con 0x7fc6a8004690 2024-01-22T05:14:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c5600700 1 -- 172.21.15.49:0/1358836555 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000cde0 con 0x7fc6a8004690 2024-01-22T05:14:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c7e00700 1 -- 172.21.15.49:0/1358836555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6a8004690 msgr2=0x7fc6a8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c7e00700 1 --2- 172.21.15.49:0/1358836555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6a8004690 0x7fc6a8004b10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fc6b000c190 tx=0x7fc6b0001e10).stop 2024-01-22T05:14:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c7e00700 1 -- 172.21.15.49:0/1358836555 shutdown_connections 2024-01-22T05:14:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c7e00700 1 --2- 172.21.15.49:0/1358836555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6a8004690 0x7fc6a8004b10 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c7e00700 1 -- 172.21.15.49:0/1358836555 >> 172.21.15.49:0/1358836555 conn(0x7fc6c80c6530 msgr2=0x7fc6c80c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c7e00700 1 -- 172.21.15.49:0/1358836555 shutdown_connections 2024-01-22T05:14:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.354+0000 7fc6c7e00700 1 -- 172.21.15.49:0/1358836555 wait complete. 2024-01-22T05:14:56.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.358+0000 7fc6c7e00700 1 Processor -- start 2024-01-22T05:14:56.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.358+0000 7fc6c7e00700 1 -- start start 2024-01-22T05:14:56.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6a8004690 0x7fc6c814dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:56.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c7e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c814cd30 0x7fc6c80c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:56.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6c80c5240 0x7fc6c8161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:56.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c7e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c814c8a0 con 0x7fc6a8004690 2024-01-22T05:14:56.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c7e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80c56c0 con 0x7fc6c80c5240 2024-01-22T05:14:56.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c7e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8162ac0 con 0x7fc6c814cd30 2024-01-22T05:14:56.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6a8004690 0x7fc6c814dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:56.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6a8004690 0x7fc6c814dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58708/0 (socket says 172.21.15.49:58708) 2024-01-22T05:14:56.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c6a00700 1 -- 172.21.15.49:0/896643262 learned_addr learned my addr 172.21.15.49:0/896643262 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:56.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c6000700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c814cd30 0x7fc6c80c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c7400700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6c80c5240 0x7fc6c8161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c6a00700 1 -- 172.21.15.49:0/896643262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c814cd30 msgr2=0x7fc6c80c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c6a00700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c814cd30 0x7fc6c80c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c6a00700 1 -- 172.21.15.49:0/896643262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6c80c5240 msgr2=0x7fc6c8161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c6a00700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6c80c5240 0x7fc6c8161ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c6a00700 1 -- 172.21.15.49:0/896643262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c8162da0 con 0x7fc6a8004690 2024-01-22T05:14:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c6000700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c814cd30 0x7fc6c80c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c7400700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6c80c5240 0x7fc6c8161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c6a00700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6a8004690 0x7fc6c814dc80 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fc6b800e9a0 tx=0x7fc6b8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6be000700 1 -- 172.21.15.49:0/896643262 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b800c850 con 0x7fc6a8004690 2024-01-22T05:14:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6be000700 1 -- 172.21.15.49:0/896643262 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b800c9b0 con 0x7fc6a8004690 2024-01-22T05:14:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6c7e00700 1 -- 172.21.15.49:0/896643262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c814c250 con 0x7fc6a8004690 2024-01-22T05:14:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.362+0000 7fc6be000700 1 -- 172.21.15.49:0/896643262 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b800cd30 con 0x7fc6a8004690 2024-01-22T05:14:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.366+0000 7fc6c7e00700 1 -- 172.21.15.49:0/896643262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c80a8670 con 0x7fc6a8004690 2024-01-22T05:14:56.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.366+0000 7fc6c7e00700 1 -- 172.21.15.49:0/896643262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c8058e60 con 0x7fc6a8004690 2024-01-22T05:14:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.366+0000 7fc6be000700 1 -- 172.21.15.49:0/896643262 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc6b8012600 con 0x7fc6a8004690 2024-01-22T05:14:56.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.366+0000 7fc6be000700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc6a005a4e0 0x7fc6a005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:56.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.370+0000 7fc6be000700 1 -- 172.21.15.49:0/896643262 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fc6b8074b40 con 0x7fc6a8004690 2024-01-22T05:14:56.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.370+0000 7fc6c6000700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc6a005a4e0 0x7fc6a005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:56.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.370+0000 7fc6c6000700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc6a005a4e0 0x7fc6a005c9a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fc6b0001e70 tx=0x7fc6b0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:56.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.374+0000 7fc6be000700 1 -- 172.21.15.49:0/896643262 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc6b8048510 con 0x7fc6a8004690 2024-01-22T05:14:56.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.542+0000 7fc6c7e00700 1 -- 172.21.15.49:0/896643262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc6c805fd40 con 0x7fc6a8004690 2024-01-22T05:14:56.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.542+0000 7fc6be000700 1 -- 172.21.15.49:0/896643262 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v127) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc6b804bb30 con 0x7fc6a8004690 2024-01-22T05:14:56.547 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:56.547 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-22T05:14:56.547 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:56.547 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-01-22T05:14:56.547 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2024-01-22T05:14:56.547 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:14:56.547 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:14:56.547 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2024-01-22T05:14:56.547 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2024-01-22T05:14:56.547 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:14:56.547 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-22T05:14:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.546+0000 7fc6c7e00700 1 -- 172.21.15.49:0/896643262 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc6a005a4e0 msgr2=0x7fc6a005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.546+0000 7fc6c7e00700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc6a005a4e0 0x7fc6a005c9a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fc6b0001e70 tx=0x7fc6b0015000).stop 2024-01-22T05:14:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.546+0000 7fc6c7e00700 1 -- 172.21.15.49:0/896643262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6a8004690 msgr2=0x7fc6c814dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.546+0000 7fc6c7e00700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6a8004690 0x7fc6c814dc80 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fc6b800e9a0 tx=0x7fc6b8009060).stop 2024-01-22T05:14:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.546+0000 7fc6c7e00700 1 -- 172.21.15.49:0/896643262 shutdown_connections 2024-01-22T05:14:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.546+0000 7fc6c7e00700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc6a005a4e0 0x7fc6a005c9a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.546+0000 7fc6c7e00700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6c80c5240 0x7fc6c8161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.546+0000 7fc6c7e00700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c814cd30 0x7fc6c80c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.546+0000 7fc6c7e00700 1 --2- 172.21.15.49:0/896643262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6a8004690 0x7fc6c814dc80 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.546+0000 7fc6c7e00700 1 -- 172.21.15.49:0/896643262 >> 172.21.15.49:0/896643262 conn(0x7fc6c80c6530 msgr2=0x7fc6c8152690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.546+0000 7fc6c7e00700 1 -- 172.21.15.49:0/896643262 shutdown_connections 2024-01-22T05:14:56.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.546+0000 7fc6c7e00700 1 -- 172.21.15.49:0/896643262 wait complete. 2024-01-22T05:14:56.572 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:14:56.572 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:14:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.742+0000 7fcea8e00700 1 Processor -- start 2024-01-22T05:14:56.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.742+0000 7fcea8e00700 1 -- start start 2024-01-22T05:14:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea8e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea40bcd10 0x7fcea40bd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea8e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcea4139410 0x7fcea4139870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea8e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcea40c2c10 0x7fcea40c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea8e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea4063510 con 0x7fcea40c2c10 2024-01-22T05:14:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea8e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea4139d60 con 0x7fcea4139410 2024-01-22T05:14:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea8e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4062900 con 0x7fcea40bcd10 2024-01-22T05:14:56.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea40bcd10 0x7fcea40bd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:56.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea3e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcea40c2c10 0x7fcea40c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:56.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea40bcd10 0x7fcea40bd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:53456/0 (socket says 172.21.15.49:53456) 2024-01-22T05:14:56.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea3400700 1 -- 172.21.15.49:0/3800649160 learned_addr learned my addr 172.21.15.49:0/3800649160 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:56.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea2a00700 1 --2- 172.21.15.49:0/3800649160 >> v2:172.21.15.110:3300/0 conn(0x7fcea4139410 0x7fcea4139870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:56.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea3e00700 1 -- 172.21.15.49:0/3800649160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea40bcd10 msgr2=0x7fcea40bd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:56.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea3e00700 1 --2- 172.21.15.49:0/3800649160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea40bcd10 0x7fcea40bd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea3e00700 1 -- 172.21.15.49:0/3800649160 >> v2:172.21.15.110:3300/0 conn(0x7fcea4139410 msgr2=0x7fcea4139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea3e00700 1 --2- 172.21.15.49:0/3800649160 >> v2:172.21.15.110:3300/0 conn(0x7fcea4139410 0x7fcea4139870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea3e00700 1 -- 172.21.15.49:0/3800649160 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4062be0 con 0x7fcea40c2c10 2024-01-22T05:14:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea3400700 1 --2- 172.21.15.49:0/3800649160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea40bcd10 0x7fcea40bd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea3e00700 1 --2- 172.21.15.49:0/3800649160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea40c2c10 0x7fcea40c30c0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fcea4065710 tx=0x7fce9c009780).ready entity=mon.0 client_cookie=e7b9e79a9d44c1fd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea2000700 1 -- 172.21.15.49:0/3800649160 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c00e070 con 0x7fcea40c2c10 2024-01-22T05:14:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea2000700 1 -- 172.21.15.49:0/3800649160 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c00ba70 con 0x7fcea40c2c10 2024-01-22T05:14:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.746+0000 7fcea2000700 1 -- 172.21.15.49:0/3800649160 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c00bdf0 con 0x7fcea40c2c10 2024-01-22T05:14:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.750+0000 7fcea8e00700 1 -- 172.21.15.49:0/3800649160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea40c2c10 msgr2=0x7fcea40c30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.750+0000 7fcea8e00700 1 --2- 172.21.15.49:0/3800649160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea40c2c10 0x7fcea40c30c0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fcea4065710 tx=0x7fce9c009780).stop 2024-01-22T05:14:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.750+0000 7fcea8e00700 1 -- 172.21.15.49:0/3800649160 shutdown_connections 2024-01-22T05:14:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.750+0000 7fcea8e00700 1 --2- 172.21.15.49:0/3800649160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea40c2c10 0x7fcea40c30c0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.750+0000 7fcea8e00700 1 --2- 172.21.15.49:0/3800649160 >> v2:172.21.15.110:3300/0 conn(0x7fcea4139410 0x7fcea4139870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.750+0000 7fcea8e00700 1 --2- 172.21.15.49:0/3800649160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea40bcd10 0x7fcea40bd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.750+0000 7fcea8e00700 1 -- 172.21.15.49:0/3800649160 >> 172.21.15.49:0/3800649160 conn(0x7fcea40c3880 msgr2=0x7fcea40c3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:56.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.750+0000 7fcea8e00700 1 -- 172.21.15.49:0/3800649160 shutdown_connections 2024-01-22T05:14:56.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.750+0000 7fcea8e00700 1 -- 172.21.15.49:0/3800649160 wait complete. 2024-01-22T05:14:56.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.754+0000 7fcea8e00700 1 Processor -- start 2024-01-22T05:14:56.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.754+0000 7fcea8e00700 1 -- start start 2024-01-22T05:14:56.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.754+0000 7fcea8e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea40bcd10 0x7fcea40a7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:56.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.754+0000 7fcea8e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcea40c2c10 0x7fcea414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:56.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.754+0000 7fcea8e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea4139410 0x7fcea414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:56.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.754+0000 7fcea8e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea40acaa0 con 0x7fcea4139410 2024-01-22T05:14:56.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.754+0000 7fcea8e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4150120 con 0x7fcea40c2c10 2024-01-22T05:14:56.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.754+0000 7fcea8e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea40abe90 con 0x7fcea40bcd10 2024-01-22T05:14:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.754+0000 7fcea3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea4139410 0x7fcea414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.754+0000 7fcea3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea4139410 0x7fcea414fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58722/0 (socket says 172.21.15.49:58722) 2024-01-22T05:14:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.754+0000 7fcea3e00700 1 -- 172.21.15.49:0/2297079731 learned_addr learned my addr 172.21.15.49:0/2297079731 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.758+0000 7fcea2a00700 1 --2- 172.21.15.49:0/2297079731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcea40c2c10 0x7fcea414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.758+0000 7fcea3400700 1 --2- 172.21.15.49:0/2297079731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea40bcd10 0x7fcea40a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.758+0000 7fcea3e00700 1 -- 172.21.15.49:0/2297079731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea40bcd10 msgr2=0x7fcea40a7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.758+0000 7fcea3e00700 1 --2- 172.21.15.49:0/2297079731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea40bcd10 0x7fcea40a7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.758+0000 7fcea3e00700 1 -- 172.21.15.49:0/2297079731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcea40c2c10 msgr2=0x7fcea414f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.758+0000 7fcea3e00700 1 --2- 172.21.15.49:0/2297079731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcea40c2c10 0x7fcea414f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.758+0000 7fcea3e00700 1 -- 172.21.15.49:0/2297079731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce94009370 con 0x7fcea4139410 2024-01-22T05:14:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.758+0000 7fcea2a00700 1 --2- 172.21.15.49:0/2297079731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcea40c2c10 0x7fcea414f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:56.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.758+0000 7fcea3e00700 1 --2- 172.21.15.49:0/2297079731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea4139410 0x7fcea414fc30 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fce9c013ce0 tx=0x7fce9c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:56.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.758+0000 7fce9aa00700 1 -- 172.21.15.49:0/2297079731 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c01d630 con 0x7fcea4139410 2024-01-22T05:14:56.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.758+0000 7fce9aa00700 1 -- 172.21.15.49:0/2297079731 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c01d790 con 0x7fcea4139410 2024-01-22T05:14:56.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.758+0000 7fcea8e00700 1 -- 172.21.15.49:0/2297079731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9c009a20 con 0x7fcea4139410 2024-01-22T05:14:56.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.758+0000 7fce9aa00700 1 -- 172.21.15.49:0/2297079731 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c01db50 con 0x7fcea4139410 2024-01-22T05:14:56.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.758+0000 7fcea8e00700 1 -- 172.21.15.49:0/2297079731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea40ac450 con 0x7fcea4139410 2024-01-22T05:14:56.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.762+0000 7fcea8e00700 1 -- 172.21.15.49:0/2297079731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea40acc50 con 0x7fcea4139410 2024-01-22T05:14:56.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.762+0000 7fce9aa00700 1 -- 172.21.15.49:0/2297079731 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fce9c003040 con 0x7fcea4139410 2024-01-22T05:14:56.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.762+0000 7fce9aa00700 1 --2- 172.21.15.49:0/2297079731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce7c05a510 0x7fce7c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:56.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.762+0000 7fce9aa00700 1 -- 172.21.15.49:0/2297079731 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fce9c076420 con 0x7fcea4139410 2024-01-22T05:14:56.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.762+0000 7fcea3400700 1 --2- 172.21.15.49:0/2297079731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce7c05a510 0x7fce7c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:56.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.762+0000 7fcea3400700 1 --2- 172.21.15.49:0/2297079731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce7c05a510 0x7fce7c05c9d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fce94009340 tx=0x7fce94008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:56.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.766+0000 7fce9aa00700 1 -- 172.21.15.49:0/2297079731 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcea40acc50 con 0x7fcea4139410 2024-01-22T05:14:56.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:56.930+0000 7fcea8e00700 1 -- 172.21.15.49:0/2297079731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fcea40acc50 con 0x7fcea4139410 2024-01-22T05:14:57.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.470+0000 7fce9aa00700 1 -- 172.21.15.49:0/2297079731 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v128) v1 ==== 152+0+0 (secure 0 0 0) 0x7fcea40acc50 con 0x7fcea4139410 2024-01-22T05:14:57.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.478+0000 7fcea8e00700 1 -- 172.21.15.49:0/2297079731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce7c05a510 msgr2=0x7fce7c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:57.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.478+0000 7fcea8e00700 1 --2- 172.21.15.49:0/2297079731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce7c05a510 0x7fce7c05c9d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fce94009340 tx=0x7fce94008040).stop 2024-01-22T05:14:57.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.478+0000 7fcea8e00700 1 -- 172.21.15.49:0/2297079731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea4139410 msgr2=0x7fcea414fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:57.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.478+0000 7fcea8e00700 1 --2- 172.21.15.49:0/2297079731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea4139410 0x7fcea414fc30 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fce9c013ce0 tx=0x7fce9c009780).stop 2024-01-22T05:14:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.482+0000 7fcea8e00700 1 -- 172.21.15.49:0/2297079731 shutdown_connections 2024-01-22T05:14:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.482+0000 7fcea8e00700 1 --2- 172.21.15.49:0/2297079731 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce7c05a510 0x7fce7c05c9d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.482+0000 7fcea8e00700 1 --2- 172.21.15.49:0/2297079731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea4139410 0x7fcea414fc30 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.482+0000 7fcea8e00700 1 --2- 172.21.15.49:0/2297079731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcea40c2c10 0x7fcea414f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.482+0000 7fcea8e00700 1 --2- 172.21.15.49:0/2297079731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea40bcd10 0x7fcea40a7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:57.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.482+0000 7fcea8e00700 1 -- 172.21.15.49:0/2297079731 >> 172.21.15.49:0/2297079731 conn(0x7fcea40c3880 msgr2=0x7fcea40aa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:57.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.486+0000 7fcea8e00700 1 -- 172.21.15.49:0/2297079731 shutdown_connections 2024-01-22T05:14:57.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.486+0000 7fcea8e00700 1 -- 172.21.15.49:0/2297079731 wait complete. 2024-01-22T05:14:57.493 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-01-22T05:14:57.510 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:14:57.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.682+0000 7fade9400700 1 Processor -- start 2024-01-22T05:14:57.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.682+0000 7fade9400700 1 -- start start 2024-01-22T05:14:57.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.686+0000 7fade9400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fade4066010 0x7fade4066420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:57.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.686+0000 7fade9400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade4069600 con 0x7fade415c2d0 2024-01-22T05:14:57.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.686+0000 7fade9400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade40a90f0 con 0x7fade4067a90 2024-01-22T05:14:57.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.686+0000 7fade9400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade41561a0 con 0x7fade4066010 2024-01-22T05:14:57.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.686+0000 7fade8a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fade4066010 0x7fade4066420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:57.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.686+0000 7fade3400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fade415c2d0 0x7fade4065900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36494/0 (socket says 172.21.15.49:36494) 2024-01-22T05:14:57.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.686+0000 7fade3400700 1 -- 172.21.15.49:0/3109067519 learned_addr learned my addr 172.21.15.49:0/3109067519 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:57.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.686+0000 7fade2a00700 1 -- 172.21.15.49:0/3109067519 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984503240 0 0) 0x7fade4069600 con 0x7fade415c2d0 2024-01-22T05:14:57.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.686+0000 7fade2a00700 1 -- 172.21.15.49:0/3109067519 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc40033f0 con 0x7fade415c2d0 2024-01-22T05:14:57.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.686+0000 7fade2a00700 1 -- 172.21.15.49:0/3109067519 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342936614 0 0) 0x7fade40a90f0 con 0x7fade4067a90 2024-01-22T05:14:57.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.686+0000 7fade2a00700 1 -- 172.21.15.49:0/3109067519 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fade4069600 con 0x7fade4067a90 2024-01-22T05:14:57.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.686+0000 7fade8a00700 1 -- 172.21.15.49:0/3109067519 >> v1:172.21.15.110:6789/0 conn(0x7fade4067a90 legacy=0x7fade415bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:57.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.686+0000 7fade8a00700 1 -- 172.21.15.49:0/3109067519 >> v1:172.21.15.49:6789/0 conn(0x7fade415c2d0 legacy=0x7fade4065900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:57.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.686+0000 7fade8a00700 1 -- 172.21.15.49:0/3109067519 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade40681c0 con 0x7fade4066010 2024-01-22T05:14:57.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.690+0000 7fade8a00700 1 --2- 172.21.15.49:0/3109067519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4066010 0x7fade4066420 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7faddc009e60 tx=0x7faddc009780).ready entity=mon.0 client_cookie=7419741415c3891d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:57.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.690+0000 7fade2a00700 1 -- 172.21.15.49:0/3109067519 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc00e070 con 0x7fade4066010 2024-01-22T05:14:57.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.690+0000 7fade2a00700 1 -- 172.21.15.49:0/3109067519 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faddc00bab0 con 0x7fade4066010 2024-01-22T05:14:57.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.690+0000 7fade2a00700 1 -- 172.21.15.49:0/3109067519 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc00be30 con 0x7fade4066010 2024-01-22T05:14:57.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.690+0000 7fade9400700 1 -- 172.21.15.49:0/3109067519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4066010 msgr2=0x7fade4066420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:57.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.690+0000 7fade9400700 1 --2- 172.21.15.49:0/3109067519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4066010 0x7fade4066420 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7faddc009e60 tx=0x7faddc009780).stop 2024-01-22T05:14:57.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.690+0000 7fade9400700 1 -- 172.21.15.49:0/3109067519 shutdown_connections 2024-01-22T05:14:57.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.690+0000 7fade9400700 1 --2- 172.21.15.49:0/3109067519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4066010 0x7fade4066420 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:57.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.690+0000 7fade9400700 1 -- 172.21.15.49:0/3109067519 >> 172.21.15.49:0/3109067519 conn(0x7fade40c6fc0 msgr2=0x7fade40c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:57.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.690+0000 7fade9400700 1 -- 172.21.15.49:0/3109067519 shutdown_connections 2024-01-22T05:14:57.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.690+0000 7fade9400700 1 -- 172.21.15.49:0/3109067519 wait complete. 2024-01-22T05:14:57.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.694+0000 7fade9400700 1 Processor -- start 2024-01-22T05:14:57.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.694+0000 7fade9400700 1 -- start start 2024-01-22T05:14:57.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade9400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4066010 0x7fade415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:57.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade9400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade4067a90 0x7fade4169710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:57.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade9400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade415c2d0 0x7fade4153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:57.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade9400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade40ac2f0 con 0x7fade4066010 2024-01-22T05:14:57.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade9400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade415ab60 con 0x7fade415c2d0 2024-01-22T05:14:57.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade9400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade4169c00 con 0x7fade4067a90 2024-01-22T05:14:57.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4066010 0x7fade415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:57.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4066010 0x7fade415aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58744/0 (socket says 172.21.15.49:58744) 2024-01-22T05:14:57.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade3e00700 1 -- 172.21.15.49:0/1807393280 learned_addr learned my addr 172.21.15.49:0/1807393280 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:57.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade8a00700 1 --2- 172.21.15.49:0/1807393280 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade415c2d0 0x7fade4153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:57.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade3400700 1 --2- 172.21.15.49:0/1807393280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade4067a90 0x7fade4169710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:57.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade3e00700 1 -- 172.21.15.49:0/1807393280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade4067a90 msgr2=0x7fade4169710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:57.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade3e00700 1 --2- 172.21.15.49:0/1807393280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade4067a90 0x7fade4169710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:57.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade3e00700 1 -- 172.21.15.49:0/1807393280 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade415c2d0 msgr2=0x7fade4153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:57.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade3e00700 1 --2- 172.21.15.49:0/1807393280 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade415c2d0 0x7fade4153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:57.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade3e00700 1 -- 172.21.15.49:0/1807393280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc009a20 con 0x7fade4066010 2024-01-22T05:14:57.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade8a00700 1 --2- 172.21.15.49:0/1807393280 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade415c2d0 0x7fade4153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:14:57.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade3e00700 1 --2- 172.21.15.49:0/1807393280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4066010 0x7fade415aff0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7fadd400c4c0 tx=0x7fadd4007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:57.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7faddb400700 1 -- 172.21.15.49:0/1807393280 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd400f470 con 0x7fade4066010 2024-01-22T05:14:57.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7faddb400700 1 -- 172.21.15.49:0/1807393280 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd400f5d0 con 0x7fade4066010 2024-01-22T05:14:57.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7faddb400700 1 -- 172.21.15.49:0/1807393280 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd400f970 con 0x7fade4066010 2024-01-22T05:14:57.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.698+0000 7fade9400700 1 -- 172.21.15.49:0/1807393280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade4159f50 con 0x7fade4066010 2024-01-22T05:14:57.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.702+0000 7fade9400700 1 -- 172.21.15.49:0/1807393280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade415a510 con 0x7fade4066010 2024-01-22T05:14:57.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.702+0000 7fade9400700 1 -- 172.21.15.49:0/1807393280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade4047060 con 0x7fade4066010 2024-01-22T05:14:57.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.702+0000 7faddb400700 1 -- 172.21.15.49:0/1807393280 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fadd400fd20 con 0x7fade4066010 2024-01-22T05:14:57.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.706+0000 7faddb400700 1 --2- 172.21.15.49:0/1807393280 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadbc05a560 0x7fadbc05ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:57.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.706+0000 7faddb400700 1 -- 172.21.15.49:0/1807393280 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5992+0+0 (secure 0 0 0) 0x7fadd4073d90 con 0x7fade4066010 2024-01-22T05:14:57.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.706+0000 7fade3400700 1 --2- 172.21.15.49:0/1807393280 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadbc05a560 0x7fadbc05ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:57.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.706+0000 7fade3400700 1 --2- 172.21.15.49:0/1807393280 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadbc05a560 0x7fadbc05ca20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fade415bd50 tx=0x7fadcc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:57.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.710+0000 7faddb400700 1 -- 172.21.15.49:0/1807393280 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fadd4047630 con 0x7fade4066010 2024-01-22T05:14:57.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:57.882+0000 7fade9400700 1 -- 172.21.15.49:0/1807393280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fade415c700 con 0x7fade4066010 2024-01-22T05:14:58.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.474+0000 7faddb400700 1 -- 172.21.15.49:0/1807393280 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v129) v1 ==== 170+0+0 (secure 0 0 0) 0x7fadd404ac50 con 0x7fade4066010 2024-01-22T05:14:58.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.490+0000 7fade9400700 1 -- 172.21.15.49:0/1807393280 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadbc05a560 msgr2=0x7fadbc05ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:58.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.490+0000 7fade9400700 1 --2- 172.21.15.49:0/1807393280 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadbc05a560 0x7fadbc05ca20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fade415bd50 tx=0x7fadcc009040).stop 2024-01-22T05:14:58.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.490+0000 7fade9400700 1 -- 172.21.15.49:0/1807393280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4066010 msgr2=0x7fade415aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:58.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.490+0000 7fade9400700 1 --2- 172.21.15.49:0/1807393280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4066010 0x7fade415aff0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7fadd400c4c0 tx=0x7fadd4007c80).stop 2024-01-22T05:14:58.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.494+0000 7fade9400700 1 -- 172.21.15.49:0/1807393280 shutdown_connections 2024-01-22T05:14:58.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.498+0000 7fade9400700 1 --2- 172.21.15.49:0/1807393280 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fadbc05a560 0x7fadbc05ca20 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.498+0000 7fade9400700 1 --2- 172.21.15.49:0/1807393280 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade415c2d0 0x7fade4153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.498+0000 7fade9400700 1 --2- 172.21.15.49:0/1807393280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fade4067a90 0x7fade4169710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.498+0000 7fade9400700 1 --2- 172.21.15.49:0/1807393280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade4066010 0x7fade415aff0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.498+0000 7fade9400700 1 -- 172.21.15.49:0/1807393280 >> 172.21.15.49:0/1807393280 conn(0x7fade40c6fc0 msgr2=0x7fade40c4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.498+0000 7fade9400700 1 -- 172.21.15.49:0/1807393280 shutdown_connections 2024-01-22T05:14:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.498+0000 7fade9400700 1 -- 172.21.15.49:0/1807393280 wait complete. 2024-01-22T05:14:58.511 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-01-22T05:14:58.531 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:14:58.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.690+0000 7f1a56400700 1 Processor -- start 2024-01-22T05:14:58.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.690+0000 7f1a56400700 1 -- start start 2024-01-22T05:14:58.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.690+0000 7f1a56400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1a5015c2d0 0x7f1a50065900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:58.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.690+0000 7f1a56400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a50065df0 0x7f1a50066240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:58.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.690+0000 7f1a56400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a50069600 con 0x7f1a50067a90 2024-01-22T05:14:58.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.690+0000 7f1a56400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a501561a0 con 0x7f1a5015c2d0 2024-01-22T05:14:58.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.690+0000 7f1a56400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a50068dd0 con 0x7f1a50065df0 2024-01-22T05:14:58.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a55000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1a50067a90 0x7f1a5015bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36496/0 (socket says 172.21.15.49:36496) 2024-01-22T05:14:58.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a55000700 1 -- 172.21.15.49:0/3733247727 learned_addr learned my addr 172.21.15.49:0/3733247727 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:58.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a4fe00700 1 --2- 172.21.15.49:0/3733247727 >> v2:172.21.15.110:3300/0 conn(0x7f1a5015c2d0 0x7f1a50065900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:58.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a55a00700 1 --2- 172.21.15.49:0/3733247727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a50065df0 0x7f1a50066240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:58.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a4f400700 1 -- 172.21.15.49:0/3733247727 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807948041 0 0) 0x7f1a50069600 con 0x7f1a50067a90 2024-01-22T05:14:58.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a4f400700 1 -- 172.21.15.49:0/3733247727 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a300033f0 con 0x7f1a50067a90 2024-01-22T05:14:58.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a4fe00700 1 -- 172.21.15.49:0/3733247727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a50065df0 msgr2=0x7f1a50066240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:58.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a4fe00700 1 --2- 172.21.15.49:0/3733247727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a50065df0 0x7f1a50066240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:58.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a4fe00700 1 -- 172.21.15.49:0/3733247727 >> v1:172.21.15.49:6789/0 conn(0x7f1a50067a90 legacy=0x7f1a5015bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:58.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a4f400700 1 -- 172.21.15.49:0/3733247727 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2277124352 0 0) 0x7f1a300033f0 con 0x7f1a50067a90 2024-01-22T05:14:58.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a4fe00700 1 -- 172.21.15.49:0/3733247727 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a500a90f0 con 0x7f1a5015c2d0 2024-01-22T05:14:58.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a55a00700 1 --2- 172.21.15.49:0/3733247727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a50065df0 0x7f1a50066240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:58.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a4fe00700 1 --2- 172.21.15.49:0/3733247727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a5015c2d0 0x7f1a50065900 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f1a38009760 tx=0x7f1a38009060).ready entity=mon.1 client_cookie=9cdacd024e29f6a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:58.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a4f400700 1 -- 172.21.15.49:0/3733247727 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a400015f0 con 0x7f1a5015c2d0 2024-01-22T05:14:58.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a4f400700 1 -- 172.21.15.49:0/3733247727 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a38011400 con 0x7f1a5015c2d0 2024-01-22T05:14:58.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.694+0000 7f1a4f400700 1 -- 172.21.15.49:0/3733247727 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a38011780 con 0x7f1a5015c2d0 2024-01-22T05:14:58.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.698+0000 7f1a56400700 1 -- 172.21.15.49:0/3733247727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a5015c2d0 msgr2=0x7f1a50065900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:58.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.698+0000 7f1a56400700 1 --2- 172.21.15.49:0/3733247727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a5015c2d0 0x7f1a50065900 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f1a38009760 tx=0x7f1a38009060).stop 2024-01-22T05:14:58.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.698+0000 7f1a56400700 1 -- 172.21.15.49:0/3733247727 shutdown_connections 2024-01-22T05:14:58.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.698+0000 7f1a56400700 1 --2- 172.21.15.49:0/3733247727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a50065df0 0x7f1a50066240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:58.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.698+0000 7f1a56400700 1 --2- 172.21.15.49:0/3733247727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a5015c2d0 0x7f1a50065900 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:58.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.698+0000 7f1a56400700 1 -- 172.21.15.49:0/3733247727 >> 172.21.15.49:0/3733247727 conn(0x7f1a500c6fc0 msgr2=0x7f1a500c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:58.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.698+0000 7f1a56400700 1 -- 172.21.15.49:0/3733247727 shutdown_connections 2024-01-22T05:14:58.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.698+0000 7f1a56400700 1 -- 172.21.15.49:0/3733247727 wait complete. 2024-01-22T05:14:58.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.702+0000 7f1a56400700 1 Processor -- start 2024-01-22T05:14:58.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.702+0000 7f1a56400700 1 -- start start 2024-01-22T05:14:58.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.702+0000 7f1a56400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a50065df0 0x7f1a500bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:58.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.702+0000 7f1a56400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a50067a90 0x7f1a50151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:58.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.702+0000 7f1a56400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a5015c2d0 0x7f1a5016a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:58.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.702+0000 7f1a56400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a50169000 con 0x7f1a5015c2d0 2024-01-22T05:14:58.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.702+0000 7f1a56400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a500c04a0 con 0x7f1a50065df0 2024-01-22T05:14:58.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.702+0000 7f1a56400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a50151e40 con 0x7f1a50067a90 2024-01-22T05:14:58.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.702+0000 7f1a55a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a5015c2d0 0x7f1a5016a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:58.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.702+0000 7f1a55a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a5015c2d0 0x7f1a5016a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58750/0 (socket says 172.21.15.49:58750) 2024-01-22T05:14:58.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.702+0000 7f1a55a00700 1 -- 172.21.15.49:0/2276501285 learned_addr learned my addr 172.21.15.49:0/2276501285 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:58.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.702+0000 7f1a55000700 1 --2- 172.21.15.49:0/2276501285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a50065df0 0x7f1a500bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:58.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.702+0000 7f1a4fe00700 1 --2- 172.21.15.49:0/2276501285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a50067a90 0x7f1a50151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:58.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.706+0000 7f1a55a00700 1 -- 172.21.15.49:0/2276501285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a50067a90 msgr2=0x7f1a50151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:58.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.706+0000 7f1a55a00700 1 --2- 172.21.15.49:0/2276501285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a50067a90 0x7f1a50151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:58.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.706+0000 7f1a55a00700 1 -- 172.21.15.49:0/2276501285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a50065df0 msgr2=0x7f1a500bffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:58.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.706+0000 7f1a55a00700 1 --2- 172.21.15.49:0/2276501285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a50065df0 0x7f1a500bffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:58.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.706+0000 7f1a55a00700 1 -- 172.21.15.49:0/2276501285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a48009a20 con 0x7f1a5015c2d0 2024-01-22T05:14:58.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.706+0000 7f1a55a00700 1 --2- 172.21.15.49:0/2276501285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a5015c2d0 0x7f1a5016a1d0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f1a4800c0f0 tx=0x7f1a4800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:58.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.706+0000 7f1a47e00700 1 -- 172.21.15.49:0/2276501285 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4800cc30 con 0x7f1a5015c2d0 2024-01-22T05:14:58.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.706+0000 7f1a47e00700 1 -- 172.21.15.49:0/2276501285 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4800f040 con 0x7f1a5015c2d0 2024-01-22T05:14:58.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.706+0000 7f1a47e00700 1 -- 172.21.15.49:0/2276501285 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48013400 con 0x7f1a5015c2d0 2024-01-22T05:14:58.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.706+0000 7f1a56400700 1 -- 172.21.15.49:0/2276501285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a380092a0 con 0x7f1a5015c2d0 2024-01-22T05:14:58.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.706+0000 7f1a56400700 1 -- 172.21.15.49:0/2276501285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a500bdc70 con 0x7f1a5015c2d0 2024-01-22T05:14:58.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.706+0000 7f1a56400700 1 -- 172.21.15.49:0/2276501285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a50047060 con 0x7f1a5015c2d0 2024-01-22T05:14:58.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.710+0000 7f1a47e00700 1 -- 172.21.15.49:0/2276501285 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1a480137f0 con 0x7f1a5015c2d0 2024-01-22T05:14:58.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.710+0000 7f1a47e00700 1 --2- 172.21.15.49:0/2276501285 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a2805a510 0x7f1a2805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:58.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.710+0000 7f1a47e00700 1 -- 172.21.15.49:0/2276501285 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f1a48075d00 con 0x7f1a5015c2d0 2024-01-22T05:14:58.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.710+0000 7f1a55000700 1 --2- 172.21.15.49:0/2276501285 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a2805a510 0x7f1a2805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:58.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.710+0000 7f1a55000700 1 --2- 172.21.15.49:0/2276501285 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a2805a510 0x7f1a2805c9d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f1a40002cb0 tx=0x7f1a400013b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:58.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.718+0000 7f1a47e00700 1 -- 172.21.15.49:0/2276501285 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1a480493e0 con 0x7f1a5015c2d0 2024-01-22T05:14:58.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.918+0000 7f1a56400700 1 -- 172.21.15.49:0/2276501285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1a500681c0 con 0x7f1a5015c2d0 2024-01-22T05:14:58.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.930+0000 7f1a47e00700 1 -- 172.21.15.49:0/2276501285 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v102) v1 ==== 174+0+0 (secure 0 0 0) 0x7f1a4804ca00 con 0x7f1a5015c2d0 2024-01-22T05:14:58.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.942+0000 7f1a56400700 1 -- 172.21.15.49:0/2276501285 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a2805a510 msgr2=0x7f1a2805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:58.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.942+0000 7f1a56400700 1 --2- 172.21.15.49:0/2276501285 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a2805a510 0x7f1a2805c9d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f1a40002cb0 tx=0x7f1a400013b0).stop 2024-01-22T05:14:58.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.942+0000 7f1a56400700 1 -- 172.21.15.49:0/2276501285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a5015c2d0 msgr2=0x7f1a5016a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:58.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.942+0000 7f1a56400700 1 --2- 172.21.15.49:0/2276501285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a5015c2d0 0x7f1a5016a1d0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f1a4800c0f0 tx=0x7f1a4800b040).stop 2024-01-22T05:14:58.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.946+0000 7f1a56400700 1 -- 172.21.15.49:0/2276501285 shutdown_connections 2024-01-22T05:14:58.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.946+0000 7f1a56400700 1 --2- 172.21.15.49:0/2276501285 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a2805a510 0x7f1a2805c9d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:58.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.946+0000 7f1a56400700 1 --2- 172.21.15.49:0/2276501285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a5015c2d0 0x7f1a5016a1d0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:58.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.946+0000 7f1a56400700 1 --2- 172.21.15.49:0/2276501285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a50067a90 0x7f1a50151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:58.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.946+0000 7f1a56400700 1 --2- 172.21.15.49:0/2276501285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a50065df0 0x7f1a500bffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:58.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.946+0000 7f1a56400700 1 -- 172.21.15.49:0/2276501285 >> 172.21.15.49:0/2276501285 conn(0x7f1a500c6fc0 msgr2=0x7f1a5015b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:58.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.950+0000 7f1a56400700 1 -- 172.21.15.49:0/2276501285 shutdown_connections 2024-01-22T05:14:58.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:58.950+0000 7f1a56400700 1 -- 172.21.15.49:0/2276501285 wait complete. 2024-01-22T05:14:58.966 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 18 and data pool 19 2024-01-22T05:14:58.989 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:14:59.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.154+0000 7f84e8600700 1 Processor -- start 2024-01-22T05:14:59.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.154+0000 7f84e8600700 1 -- start start 2024-01-22T05:14:59.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.158+0000 7f84e8600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f84e006a1c0 0x7f84e01508e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.158+0000 7f84e8600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e0064530 0x7f84e0154600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.158+0000 7f84e8600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e00c3dd0 con 0x7f84e00a6720 2024-01-22T05:14:59.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.158+0000 7f84e8600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e00a6f00 con 0x7f84e006a1c0 2024-01-22T05:14:59.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.158+0000 7f84e8600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e0150dd0 con 0x7f84e0064530 2024-01-22T05:14:59.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.158+0000 7f84e5200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f84e00a6720 0x7f84e0063e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36508/0 (socket says 172.21.15.49:36508) 2024-01-22T05:14:59.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.158+0000 7f84e5200700 1 -- 172.21.15.49:0/1851057918 learned_addr learned my addr 172.21.15.49:0/1851057918 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:59.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.158+0000 7f84e5c00700 1 --2- 172.21.15.49:0/1851057918 >> v2:172.21.15.110:3300/0 conn(0x7f84e006a1c0 0x7f84e01508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.158+0000 7f84e6600700 1 --2- 172.21.15.49:0/1851057918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e0064530 0x7f84e0154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.158+0000 7f84e5c00700 1 -- 172.21.15.49:0/1851057918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e0064530 msgr2=0x7f84e0154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:59.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.158+0000 7f84e5c00700 1 --2- 172.21.15.49:0/1851057918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e0064530 0x7f84e0154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.158+0000 7f84e5c00700 1 -- 172.21.15.49:0/1851057918 >> v1:172.21.15.49:6789/0 conn(0x7f84e00a6720 legacy=0x7f84e0063e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.158+0000 7f84e5c00700 1 -- 172.21.15.49:0/1851057918 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e006a5a0 con 0x7f84e006a1c0 2024-01-22T05:14:59.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.158+0000 7f84e5c00700 1 --2- 172.21.15.49:0/1851057918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e006a1c0 0x7f84e01508e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f84d0009760 tx=0x7f84d0009060).ready entity=mon.1 client_cookie=6abb097e0fedee25 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:59.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.162+0000 7f84dfe00700 1 -- 172.21.15.49:0/1851057918 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d000f510 con 0x7f84e006a1c0 2024-01-22T05:14:59.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.162+0000 7f84dfe00700 1 -- 172.21.15.49:0/1851057918 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d000f670 con 0x7f84e006a1c0 2024-01-22T05:14:59.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.162+0000 7f84dfe00700 1 -- 172.21.15.49:0/1851057918 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d000f9f0 con 0x7f84e006a1c0 2024-01-22T05:14:59.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.162+0000 7f84e8600700 1 -- 172.21.15.49:0/1851057918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e006a1c0 msgr2=0x7f84e01508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.162+0000 7f84e8600700 1 --2- 172.21.15.49:0/1851057918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e006a1c0 0x7f84e01508e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f84d0009760 tx=0x7f84d0009060).stop 2024-01-22T05:14:59.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.162+0000 7f84e8600700 1 -- 172.21.15.49:0/1851057918 shutdown_connections 2024-01-22T05:14:59.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.162+0000 7f84e8600700 1 --2- 172.21.15.49:0/1851057918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e0064530 0x7f84e0154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.162+0000 7f84e8600700 1 --2- 172.21.15.49:0/1851057918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e006a1c0 0x7f84e01508e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.162+0000 7f84e8600700 1 -- 172.21.15.49:0/1851057918 >> 172.21.15.49:0/1851057918 conn(0x7f84e0066830 msgr2=0x7f84e0066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:59.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.162+0000 7f84e8600700 1 -- 172.21.15.49:0/1851057918 shutdown_connections 2024-01-22T05:14:59.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.162+0000 7f84e8600700 1 -- 172.21.15.49:0/1851057918 wait complete. 2024-01-22T05:14:59.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.166+0000 7f84e8600700 1 Processor -- start 2024-01-22T05:14:59.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.166+0000 7f84e8600700 1 -- start start 2024-01-22T05:14:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e8600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e0064530 0x7f84e0163250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e8600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e006a1c0 0x7f84e00c0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e8600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e00a6720 0x7f84e00c0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e8600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e014ef10 con 0x7f84e006a1c0 2024-01-22T05:14:59.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e8600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e014e300 con 0x7f84e0064530 2024-01-22T05:14:59.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e8600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e014e5e0 con 0x7f84e00a6720 2024-01-22T05:14:59.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e5c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e0064530 0x7f84e0163250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e5200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e006a1c0 0x7f84e00c0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e5c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e0064530 0x7f84e0163250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:36368/0 (socket says 172.21.15.49:36368) 2024-01-22T05:14:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e6600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e00a6720 0x7f84e00c0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e5c00700 1 -- 172.21.15.49:0/4243436652 learned_addr learned my addr 172.21.15.49:0/4243436652 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e5c00700 1 -- 172.21.15.49:0/4243436652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e00a6720 msgr2=0x7f84e00c0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e5c00700 1 --2- 172.21.15.49:0/4243436652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e00a6720 0x7f84e00c0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e5c00700 1 -- 172.21.15.49:0/4243436652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e006a1c0 msgr2=0x7f84e00c0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e5c00700 1 --2- 172.21.15.49:0/4243436652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e006a1c0 0x7f84e00c0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e5c00700 1 -- 172.21.15.49:0/4243436652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d00092a0 con 0x7f84e0064530 2024-01-22T05:14:59.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.170+0000 7f84e5c00700 1 --2- 172.21.15.49:0/4243436652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e0064530 0x7f84e0163250 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f84e0060240 tx=0x7f84d0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:59.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.174+0000 7f84dcc00700 1 -- 172.21.15.49:0/4243436652 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d000f7e0 con 0x7f84e0064530 2024-01-22T05:14:59.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.174+0000 7f84dcc00700 1 -- 172.21.15.49:0/4243436652 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d000f940 con 0x7f84e0064530 2024-01-22T05:14:59.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.174+0000 7f84e8600700 1 -- 172.21.15.49:0/4243436652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e014e8c0 con 0x7f84e0064530 2024-01-22T05:14:59.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.174+0000 7f84dcc00700 1 -- 172.21.15.49:0/4243436652 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d001b660 con 0x7f84e0064530 2024-01-22T05:14:59.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.174+0000 7f84e8600700 1 -- 172.21.15.49:0/4243436652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e0163740 con 0x7f84e0064530 2024-01-22T05:14:59.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.174+0000 7f84e8600700 1 -- 172.21.15.49:0/4243436652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e00657b0 con 0x7f84e0064530 2024-01-22T05:14:59.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.174+0000 7f84dcc00700 1 -- 172.21.15.49:0/4243436652 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f84d001ba50 con 0x7f84e0064530 2024-01-22T05:14:59.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.178+0000 7f84dcc00700 1 --2- 172.21.15.49:0/4243436652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84b805a510 0x7f84b805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.178+0000 7f84dcc00700 1 -- 172.21.15.49:0/4243436652 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f84d0076350 con 0x7f84e0064530 2024-01-22T05:14:59.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.178+0000 7f84e5200700 1 --2- 172.21.15.49:0/4243436652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84b805a510 0x7f84b805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.178+0000 7f84e5200700 1 --2- 172.21.15.49:0/4243436652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84b805a510 0x7f84b805c9d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f84e015fca0 tx=0x7f84c8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:59.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.186+0000 7f84dcc00700 1 -- 172.21.15.49:0/4243436652 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f84d0049990 con 0x7f84e0064530 2024-01-22T05:14:59.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.358+0000 7f84e8600700 1 -- 172.21.15.49:0/4243436652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84e0046800 con 0x7f84e0064530 2024-01-22T05:14:59.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.358+0000 7f84dcc00700 1 -- 172.21.15.49:0/4243436652 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+17191 (secure 0 0 0) 0x7f84d0028020 con 0x7f84e0064530 2024-01-22T05:14:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:59.363 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":130,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:14:58.924960+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:14:57.007984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-01-22T05:14:57.955380+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:14:59.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.362+0000 7f84e8600700 1 -- 172.21.15.49:0/4243436652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84b805a510 msgr2=0x7f84b805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.362+0000 7f84e8600700 1 --2- 172.21.15.49:0/4243436652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84b805a510 0x7f84b805c9d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f84e015fca0 tx=0x7f84c8009040).stop 2024-01-22T05:14:59.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.362+0000 7f84e8600700 1 -- 172.21.15.49:0/4243436652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e0064530 msgr2=0x7f84e0163250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.362+0000 7f84e8600700 1 --2- 172.21.15.49:0/4243436652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e0064530 0x7f84e0163250 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f84e0060240 tx=0x7f84d0017000).stop 2024-01-22T05:14:59.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.366+0000 7f84e8600700 1 -- 172.21.15.49:0/4243436652 shutdown_connections 2024-01-22T05:14:59.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.366+0000 7f84e8600700 1 --2- 172.21.15.49:0/4243436652 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84b805a510 0x7f84b805c9d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.366+0000 7f84e8600700 1 --2- 172.21.15.49:0/4243436652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e00a6720 0x7f84e00c0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.366+0000 7f84e8600700 1 --2- 172.21.15.49:0/4243436652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e006a1c0 0x7f84e00c0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.366+0000 7f84e8600700 1 --2- 172.21.15.49:0/4243436652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e0064530 0x7f84e0163250 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.366+0000 7f84e8600700 1 -- 172.21.15.49:0/4243436652 >> 172.21.15.49:0/4243436652 conn(0x7f84e0066830 msgr2=0x7f84e00ac5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:59.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.366+0000 7f84e8600700 1 -- 172.21.15.49:0/4243436652 shutdown_connections 2024-01-22T05:14:59.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.366+0000 7f84e8600700 1 -- 172.21.15.49:0/4243436652 wait complete. 2024-01-22T05:14:59.389 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:14:59.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.542+0000 7fa7fd600700 1 Processor -- start 2024-01-22T05:14:59.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.542+0000 7fa7fd600700 1 -- start start 2024-01-22T05:14:59.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7fd600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa7f8064c00 0x7fa7f80bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7fd600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7f8065620 0x7fa7f80bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7fd600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f80c2700 con 0x7fa7f8065240 2024-01-22T05:14:59.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7fd600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f80c29a0 con 0x7fa7f8064c00 2024-01-22T05:14:59.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7fd600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80c2c80 con 0x7fa7f8065620 2024-01-22T05:14:59.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7f6000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa7f8064c00 0x7fa7f80bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7f6a00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa7f8065240 0x7fa7f80644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:52908/0 (socket says 172.21.15.49:52908) 2024-01-22T05:14:59.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7f6a00700 1 -- 172.21.15.49:0/2321176729 learned_addr learned my addr 172.21.15.49:0/2321176729 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:59.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7f7e00700 1 --2- 172.21.15.49:0/2321176729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7f8065620 0x7fa7f80bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7f5600700 1 -- 172.21.15.49:0/2321176729 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024641756 0 0) 0x7fa7f80c2700 con 0x7fa7f8065240 2024-01-22T05:14:59.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7f5600700 1 -- 172.21.15.49:0/2321176729 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d80033f0 con 0x7fa7f8065240 2024-01-22T05:14:59.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7f6000700 1 -- 172.21.15.49:0/2321176729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7f8065620 msgr2=0x7fa7f80bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:59.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7f6000700 1 --2- 172.21.15.49:0/2321176729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7f8065620 0x7fa7f80bd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7f6000700 1 -- 172.21.15.49:0/2321176729 >> v1:172.21.15.110:6789/0 conn(0x7fa7f8065240 legacy=0x7fa7f80644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7f6000700 1 -- 172.21.15.49:0/2321176729 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f80c2f60 con 0x7fa7f8064c00 2024-01-22T05:14:59.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7f7e00700 1 --2- 172.21.15.49:0/2321176729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7f8065620 0x7fa7f80bd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:59.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7f6000700 1 --2- 172.21.15.49:0/2321176729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8064c00 0x7fa7f80bcc80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fa7e0009760 tx=0x7fa7e0009060).ready entity=mon.1 client_cookie=fb2fb97c07b9e5a2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:59.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7f5600700 1 -- 172.21.15.49:0/2321176729 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000d4a0 con 0x7fa7f8064c00 2024-01-22T05:14:59.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7f5600700 1 -- 172.21.15.49:0/2321176729 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e000d600 con 0x7fa7f8064c00 2024-01-22T05:14:59.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.546+0000 7fa7f5600700 1 -- 172.21.15.49:0/2321176729 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000d980 con 0x7fa7f8064c00 2024-01-22T05:14:59.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.550+0000 7fa7fd600700 1 -- 172.21.15.49:0/2321176729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8064c00 msgr2=0x7fa7f80bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.550+0000 7fa7fd600700 1 --2- 172.21.15.49:0/2321176729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8064c00 0x7fa7f80bcc80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fa7e0009760 tx=0x7fa7e0009060).stop 2024-01-22T05:14:59.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.550+0000 7fa7fd600700 1 -- 172.21.15.49:0/2321176729 shutdown_connections 2024-01-22T05:14:59.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.550+0000 7fa7fd600700 1 --2- 172.21.15.49:0/2321176729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7f8065620 0x7fa7f80bd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.550+0000 7fa7fd600700 1 --2- 172.21.15.49:0/2321176729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8064c00 0x7fa7f80bcc80 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.550+0000 7fa7fd600700 1 -- 172.21.15.49:0/2321176729 >> 172.21.15.49:0/2321176729 conn(0x7fa7f80c87f0 msgr2=0x7fa7f80c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:59.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.550+0000 7fa7fd600700 1 -- 172.21.15.49:0/2321176729 shutdown_connections 2024-01-22T05:14:59.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.550+0000 7fa7fd600700 1 -- 172.21.15.49:0/2321176729 wait complete. 2024-01-22T05:14:59.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.554+0000 7fa7fd600700 1 Processor -- start 2024-01-22T05:14:59.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.554+0000 7fa7fd600700 1 -- start start 2024-01-22T05:14:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7fd600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7f8064c00 0x7fa7f8146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7fd600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8065240 0x7fa7f80a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7fd600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7f8065620 0x7fa7f80aa240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7fd600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f81549a0 con 0x7fa7f8064c00 2024-01-22T05:14:59.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7fd600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80aa730 con 0x7fa7f8065240 2024-01-22T05:14:59.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7fd600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80a7730 con 0x7fa7f8065620 2024-01-22T05:14:59.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7f6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7f8064c00 0x7fa7f8146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7f6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7f8064c00 0x7fa7f8146e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58766/0 (socket says 172.21.15.49:58766) 2024-01-22T05:14:59.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7f6a00700 1 -- 172.21.15.49:0/1929344564 learned_addr learned my addr 172.21.15.49:0/1929344564 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:59.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7f7e00700 1 --2- 172.21.15.49:0/1929344564 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7f8065620 0x7fa7f80aa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7f6000700 1 --2- 172.21.15.49:0/1929344564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8065240 0x7fa7f80a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7f6a00700 1 -- 172.21.15.49:0/1929344564 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7f8065620 msgr2=0x7fa7f80aa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7f6a00700 1 --2- 172.21.15.49:0/1929344564 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7f8065620 0x7fa7f80aa240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7f6a00700 1 -- 172.21.15.49:0/1929344564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8065240 msgr2=0x7fa7f80a9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7f6a00700 1 --2- 172.21.15.49:0/1929344564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8065240 0x7fa7f80a9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7f6a00700 1 -- 172.21.15.49:0/1929344564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f0009a20 con 0x7fa7f8064c00 2024-01-22T05:14:59.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7f6a00700 1 --2- 172.21.15.49:0/1929344564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7f8064c00 0x7fa7f8146e80 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7fa7e800c490 tx=0x7fa7e8007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:59.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7ee000700 1 -- 172.21.15.49:0/1929344564 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e80072e0 con 0x7fa7f8064c00 2024-01-22T05:14:59.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7ee000700 1 -- 172.21.15.49:0/1929344564 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e8007440 con 0x7fa7f8064c00 2024-01-22T05:14:59.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7ee000700 1 -- 172.21.15.49:0/1929344564 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e80057a0 con 0x7fa7f8064c00 2024-01-22T05:14:59.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.558+0000 7fa7fd600700 1 -- 172.21.15.49:0/1929344564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e00092a0 con 0x7fa7f8064c00 2024-01-22T05:14:59.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.562+0000 7fa7fd600700 1 -- 172.21.15.49:0/1929344564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f80bfd70 con 0x7fa7f8064c00 2024-01-22T05:14:59.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.562+0000 7fa7fd600700 1 -- 172.21.15.49:0/1929344564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f8047060 con 0x7fa7f8064c00 2024-01-22T05:14:59.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.562+0000 7fa7ee000700 1 -- 172.21.15.49:0/1929344564 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa7e8005bd0 con 0x7fa7f8064c00 2024-01-22T05:14:59.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.566+0000 7fa7ee000700 1 --2- 172.21.15.49:0/1929344564 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7d005a510 0x7fa7d005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.566+0000 7fa7ee000700 1 -- 172.21.15.49:0/1929344564 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa7e80740e0 con 0x7fa7f8064c00 2024-01-22T05:14:59.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.566+0000 7fa7f6000700 1 --2- 172.21.15.49:0/1929344564 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7d005a510 0x7fa7d005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.566+0000 7fa7f6000700 1 --2- 172.21.15.49:0/1929344564 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7d005a510 0x7fa7d005c9d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fa7f8157420 tx=0x7fa7e0016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:59.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.570+0000 7fa7ee000700 1 -- 172.21.15.49:0/1929344564 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa7e80476a0 con 0x7fa7f8064c00 2024-01-22T05:14:59.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.738+0000 7fa7fd600700 1 -- 172.21.15.49:0/1929344564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7f80c3240 con 0x7fa7f8064c00 2024-01-22T05:14:59.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.742+0000 7fa7ee000700 1 -- 172.21.15.49:0/1929344564 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+17191 (secure 0 0 0) 0x7fa7e804acc0 con 0x7fa7f8064c00 2024-01-22T05:14:59.744 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:14:59.744 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":130,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:14:58.924960+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:14:57.007984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-01-22T05:14:57.955380+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:14:59.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.746+0000 7fa7fd600700 1 -- 172.21.15.49:0/1929344564 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7d005a510 msgr2=0x7fa7d005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.746+0000 7fa7fd600700 1 --2- 172.21.15.49:0/1929344564 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7d005a510 0x7fa7d005c9d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fa7f8157420 tx=0x7fa7e0016000).stop 2024-01-22T05:14:59.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.746+0000 7fa7fd600700 1 -- 172.21.15.49:0/1929344564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7f8064c00 msgr2=0x7fa7f8146e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.746+0000 7fa7fd600700 1 --2- 172.21.15.49:0/1929344564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7f8064c00 0x7fa7f8146e80 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7fa7e800c490 tx=0x7fa7e8007c50).stop 2024-01-22T05:14:59.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.746+0000 7fa7fd600700 1 -- 172.21.15.49:0/1929344564 shutdown_connections 2024-01-22T05:14:59.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.746+0000 7fa7fd600700 1 --2- 172.21.15.49:0/1929344564 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7d005a510 0x7fa7d005c9d0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.746+0000 7fa7fd600700 1 --2- 172.21.15.49:0/1929344564 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7f8065620 0x7fa7f80aa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.746+0000 7fa7fd600700 1 --2- 172.21.15.49:0/1929344564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8065240 0x7fa7f80a9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.746+0000 7fa7fd600700 1 --2- 172.21.15.49:0/1929344564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7f8064c00 0x7fa7f8146e80 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.746+0000 7fa7fd600700 1 -- 172.21.15.49:0/1929344564 >> 172.21.15.49:0/1929344564 conn(0x7fa7f80c87f0 msgr2=0x7fa7f80ab6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:59.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.746+0000 7fa7fd600700 1 -- 172.21.15.49:0/1929344564 shutdown_connections 2024-01-22T05:14:59.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.746+0000 7fa7fd600700 1 -- 172.21.15.49:0/1929344564 wait complete. 2024-01-22T05:14:59.773 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:14:59.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.934+0000 7f3b96c00700 1 Processor -- start 2024-01-22T05:14:59.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.934+0000 7f3b96c00700 1 -- start start 2024-01-22T05:14:59.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.938+0000 7f3b96c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3b900c67e0 0x7f3b900bdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.938+0000 7f3b96c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3b900be1b0 0x7f3b900c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.938+0000 7f3b96c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b900c41e0 con 0x7f3b900c4b60 2024-01-22T05:14:59.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.938+0000 7f3b96c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b900c3c60 con 0x7f3b900c67e0 2024-01-22T05:14:59.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.938+0000 7f3b96c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b900c7030 con 0x7f3b900be1b0 2024-01-22T05:14:59.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.938+0000 7f3b8fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3b900c67e0 0x7f3b900bdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.938+0000 7f3b94c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3b900c4b60 0x7f3b900a6660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36514/0 (socket says 172.21.15.49:36514) 2024-01-22T05:14:59.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.938+0000 7f3b94c00700 1 -- 172.21.15.49:0/2167346350 learned_addr learned my addr 172.21.15.49:0/2167346350 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:14:59.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.938+0000 7f3b8f400700 1 --2- 172.21.15.49:0/2167346350 >> v2:172.21.15.110:3300/0 conn(0x7f3b900be1b0 0x7f3b900c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.942+0000 7f3b8fe00700 1 -- 172.21.15.49:0/2167346350 >> v2:172.21.15.110:3300/0 conn(0x7f3b900be1b0 msgr2=0x7f3b900c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:14:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.942+0000 7f3b8fe00700 1 --2- 172.21.15.49:0/2167346350 >> v2:172.21.15.110:3300/0 conn(0x7f3b900be1b0 0x7f3b900c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.942+0000 7f3b8fe00700 1 -- 172.21.15.49:0/2167346350 >> v1:172.21.15.49:6789/0 conn(0x7f3b900c4b60 legacy=0x7f3b900a6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.942+0000 7f3b8fe00700 1 -- 172.21.15.49:0/2167346350 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b900c4f90 con 0x7f3b900c67e0 2024-01-22T05:14:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.942+0000 7f3b8fe00700 1 --2- 172.21.15.49:0/2167346350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b900c67e0 0x7f3b900bdcc0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f3b90157830 tx=0x7f3b80009060).ready entity=mon.0 client_cookie=f5b358ca4c4b1833 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:59.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.942+0000 7f3b8ea00700 1 -- 172.21.15.49:0/2167346350 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b800090d0 con 0x7f3b900c67e0 2024-01-22T05:14:59.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.942+0000 7f3b8ea00700 1 -- 172.21.15.49:0/2167346350 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8000f510 con 0x7f3b900c67e0 2024-01-22T05:14:59.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.942+0000 7f3b8ea00700 1 -- 172.21.15.49:0/2167346350 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000f890 con 0x7f3b900c67e0 2024-01-22T05:14:59.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.946+0000 7f3b96c00700 1 -- 172.21.15.49:0/2167346350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b900c67e0 msgr2=0x7f3b900bdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.946+0000 7f3b96c00700 1 --2- 172.21.15.49:0/2167346350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b900c67e0 0x7f3b900bdcc0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f3b90157830 tx=0x7f3b80009060).stop 2024-01-22T05:14:59.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.946+0000 7f3b96c00700 1 -- 172.21.15.49:0/2167346350 shutdown_connections 2024-01-22T05:14:59.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.946+0000 7f3b96c00700 1 --2- 172.21.15.49:0/2167346350 >> v2:172.21.15.110:3300/0 conn(0x7f3b900be1b0 0x7f3b900c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.946+0000 7f3b96c00700 1 --2- 172.21.15.49:0/2167346350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b900c67e0 0x7f3b900bdcc0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.946+0000 7f3b96c00700 1 -- 172.21.15.49:0/2167346350 >> 172.21.15.49:0/2167346350 conn(0x7f3b900aa740 msgr2=0x7f3b900aab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:14:59.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.946+0000 7f3b96c00700 1 -- 172.21.15.49:0/2167346350 shutdown_connections 2024-01-22T05:14:59.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.946+0000 7f3b96c00700 1 -- 172.21.15.49:0/2167346350 wait complete. 2024-01-22T05:14:59.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.946+0000 7f3b96c00700 1 Processor -- start 2024-01-22T05:14:59.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b96c00700 1 -- start start 2024-01-22T05:14:59.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b96c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b900be1b0 0x7f3b90148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b96c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b900c4b60 0x7f3b900be760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b96c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b900c67e0 0x7f3b90167590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b96c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b90148b60 con 0x7f3b900be1b0 2024-01-22T05:14:59.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b96c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b90094430 con 0x7f3b900c67e0 2024-01-22T05:14:59.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b96c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b90152960 con 0x7f3b900c4b60 2024-01-22T05:14:59.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b8fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b900be1b0 0x7f3b90148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b8fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b900be1b0 0x7f3b90148670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58784/0 (socket says 172.21.15.49:58784) 2024-01-22T05:14:59.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b8fe00700 1 -- 172.21.15.49:0/1264370960 learned_addr learned my addr 172.21.15.49:0/1264370960 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:14:59.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b94c00700 1 --2- 172.21.15.49:0/1264370960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b900c67e0 0x7f3b90167590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b8f400700 1 --2- 172.21.15.49:0/1264370960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b900c4b60 0x7f3b900be760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b8fe00700 1 -- 172.21.15.49:0/1264370960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b900c4b60 msgr2=0x7f3b900be760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b8fe00700 1 --2- 172.21.15.49:0/1264370960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b900c4b60 0x7f3b900be760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b8fe00700 1 -- 172.21.15.49:0/1264370960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b900c67e0 msgr2=0x7f3b90167590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:14:59.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b8fe00700 1 --2- 172.21.15.49:0/1264370960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b900c67e0 0x7f3b90167590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:14:59.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b8fe00700 1 -- 172.21.15.49:0/1264370960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b800092a0 con 0x7f3b900be1b0 2024-01-22T05:14:59.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b94c00700 1 --2- 172.21.15.49:0/1264370960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b900c67e0 0x7f3b90167590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:14:59.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.950+0000 7f3b8fe00700 1 --2- 172.21.15.49:0/1264370960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b900be1b0 0x7f3b90148670 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f3b800091d0 tx=0x7f3b80017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:59.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.954+0000 7f3b87400700 1 -- 172.21.15.49:0/1264370960 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000fea0 con 0x7f3b900be1b0 2024-01-22T05:14:59.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.954+0000 7f3b87400700 1 -- 172.21.15.49:0/1264370960 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8000f680 con 0x7f3b900be1b0 2024-01-22T05:14:59.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.954+0000 7f3b87400700 1 -- 172.21.15.49:0/1264370960 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8001b410 con 0x7f3b900be1b0 2024-01-22T05:14:59.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.954+0000 7f3b96c00700 1 -- 172.21.15.49:0/1264370960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b90168100 con 0x7f3b900be1b0 2024-01-22T05:14:59.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.954+0000 7f3b96c00700 1 -- 172.21.15.49:0/1264370960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b900940c0 con 0x7f3b900be1b0 2024-01-22T05:14:59.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.954+0000 7f3b96c00700 1 -- 172.21.15.49:0/1264370960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b900648b0 con 0x7f3b900be1b0 2024-01-22T05:14:59.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.954+0000 7f3b87400700 1 -- 172.21.15.49:0/1264370960 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3b8001b800 con 0x7f3b900be1b0 2024-01-22T05:14:59.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.958+0000 7f3b87400700 1 --2- 172.21.15.49:0/1264370960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b6805a510 0x7f3b6805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:14:59.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.958+0000 7f3b87400700 1 -- 172.21.15.49:0/1264370960 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3b800761d0 con 0x7f3b900be1b0 2024-01-22T05:14:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.958+0000 7f3b8f400700 1 --2- 172.21.15.49:0/1264370960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b6805a510 0x7f3b6805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:14:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.958+0000 7f3b8f400700 1 --2- 172.21.15.49:0/1264370960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b6805a510 0x7f3b6805c9d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f3b900a9f00 tx=0x7f3b78009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:14:59.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:14:59.962+0000 7f3b87400700 1 -- 172.21.15.49:0/1264370960 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3b80049730 con 0x7f3b900be1b0 2024-01-22T05:15:00.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:00.162+0000 7f3b96c00700 1 -- 172.21.15.49:0/1264370960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3b90046800 con 0x7f3b900be1b0 2024-01-22T05:15:00.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:00.954+0000 7f3b87400700 1 -- 172.21.15.49:0/1264370960 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v105) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3b800290b0 con 0x7f3b900be1b0 2024-01-22T05:15:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:00.958+0000 7f3b96c00700 1 -- 172.21.15.49:0/1264370960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b6805a510 msgr2=0x7f3b6805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:00.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:00.958+0000 7f3b96c00700 1 --2- 172.21.15.49:0/1264370960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b6805a510 0x7f3b6805c9d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f3b900a9f00 tx=0x7f3b78009060).stop 2024-01-22T05:15:00.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:00.958+0000 7f3b96c00700 1 -- 172.21.15.49:0/1264370960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b900be1b0 msgr2=0x7f3b90148670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:00.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:00.958+0000 7f3b96c00700 1 --2- 172.21.15.49:0/1264370960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b900be1b0 0x7f3b90148670 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f3b800091d0 tx=0x7f3b80017000).stop 2024-01-22T05:15:00.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:00.958+0000 7f3b96c00700 1 -- 172.21.15.49:0/1264370960 shutdown_connections 2024-01-22T05:15:00.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:00.958+0000 7f3b96c00700 1 --2- 172.21.15.49:0/1264370960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3b6805a510 0x7f3b6805c9d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:00.958+0000 7f3b96c00700 1 --2- 172.21.15.49:0/1264370960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b900c67e0 0x7f3b90167590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:00.958+0000 7f3b96c00700 1 --2- 172.21.15.49:0/1264370960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b900c4b60 0x7f3b900be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:00.958+0000 7f3b96c00700 1 --2- 172.21.15.49:0/1264370960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b900be1b0 0x7f3b90148670 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:00.958+0000 7f3b96c00700 1 -- 172.21.15.49:0/1264370960 >> 172.21.15.49:0/1264370960 conn(0x7f3b900aa740 msgr2=0x7f3b90068460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:00.958+0000 7f3b96c00700 1 -- 172.21.15.49:0/1264370960 shutdown_connections 2024-01-22T05:15:00.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:00.958+0000 7f3b96c00700 1 -- 172.21.15.49:0/1264370960 wait complete. 2024-01-22T05:15:00.987 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T05:15:00.988 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:15:01.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.154+0000 7f5e7f000700 1 Processor -- start 2024-01-22T05:15:01.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.154+0000 7f5e7f000700 1 -- start start 2024-01-22T05:15:01.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.158+0000 7f5e7f000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e78153cc0 0x7f5e78068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:01.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.158+0000 7f5e7f000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5e78068f90 0x7f5e78062230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:01.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.158+0000 7f5e7f000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e780bd4e0 con 0x7f5e78066dc0 2024-01-22T05:15:01.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e7f000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e78069420 con 0x7f5e78068f90 2024-01-22T05:15:01.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e7f000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e780bc8d0 con 0x7f5e78153cc0 2024-01-22T05:15:01.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e7e600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5e78068f90 0x7f5e78062230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:01.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e7d200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e78153cc0 0x7f5e78068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:01.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e7e600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5e78068f90 0x7f5e78062230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58794/0 (socket says 172.21.15.49:58794) 2024-01-22T05:15:01.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e7e600700 1 -- 172.21.15.49:0/2462484242 learned_addr learned my addr 172.21.15.49:0/2462484242 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:01.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e77e00700 1 -- 172.21.15.49:0/2462484242 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376228837 0 0) 0x7f5e780bd4e0 con 0x7f5e78066dc0 2024-01-22T05:15:01.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e7e600700 1 -- 172.21.15.49:0/2462484242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e78153cc0 msgr2=0x7f5e78068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:01.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e7e600700 1 --2- 172.21.15.49:0/2462484242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e78153cc0 0x7f5e78068aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:01.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e7e600700 1 -- 172.21.15.49:0/2462484242 >> v1:172.21.15.110:6789/0 conn(0x7f5e78066dc0 legacy=0x7f5e780bc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:01.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e7e600700 1 -- 172.21.15.49:0/2462484242 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e780bcbb0 con 0x7f5e78068f90 2024-01-22T05:15:01.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e7d200700 1 --2- 172.21.15.49:0/2462484242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e78153cc0 0x7f5e78068aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:15:01.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e7e600700 1 --2- 172.21.15.49:0/2462484242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e78068f90 0x7f5e78062230 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f5e70009f20 tx=0x7f5e70009840).ready entity=mon.0 client_cookie=53d8f447c1b8d16b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:01.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e77e00700 1 -- 172.21.15.49:0/2462484242 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7000e070 con 0x7f5e78068f90 2024-01-22T05:15:01.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e77e00700 1 -- 172.21.15.49:0/2462484242 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7000b9d0 con 0x7f5e78068f90 2024-01-22T05:15:01.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.162+0000 7f5e77e00700 1 -- 172.21.15.49:0/2462484242 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7000bd50 con 0x7f5e78068f90 2024-01-22T05:15:01.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.166+0000 7f5e7f000700 1 -- 172.21.15.49:0/2462484242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e78068f90 msgr2=0x7f5e78062230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:01.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.166+0000 7f5e7f000700 1 --2- 172.21.15.49:0/2462484242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e78068f90 0x7f5e78062230 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f5e70009f20 tx=0x7f5e70009840).stop 2024-01-22T05:15:01.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.166+0000 7f5e7f000700 1 -- 172.21.15.49:0/2462484242 shutdown_connections 2024-01-22T05:15:01.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.166+0000 7f5e7f000700 1 --2- 172.21.15.49:0/2462484242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e78068f90 0x7f5e78062230 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:01.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.166+0000 7f5e7f000700 1 --2- 172.21.15.49:0/2462484242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e78153cc0 0x7f5e78068aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:01.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.166+0000 7f5e7f000700 1 -- 172.21.15.49:0/2462484242 >> 172.21.15.49:0/2462484242 conn(0x7f5e780c4330 msgr2=0x7f5e78065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:01.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.166+0000 7f5e7f000700 1 -- 172.21.15.49:0/2462484242 shutdown_connections 2024-01-22T05:15:01.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.166+0000 7f5e7f000700 1 -- 172.21.15.49:0/2462484242 wait complete. 2024-01-22T05:15:01.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.170+0000 7f5e7f000700 1 Processor -- start 2024-01-22T05:15:01.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.170+0000 7f5e7f000700 1 -- start start 2024-01-22T05:15:01.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7f000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e78066dc0 0x7f5e780aa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:01.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7f000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e78068f90 0x7f5e7814f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:01.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7f000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e78153cc0 0x7f5e780be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:01.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7f000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e780a7750 con 0x7f5e78153cc0 2024-01-22T05:15:01.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7f000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e780c0b30 con 0x7f5e78066dc0 2024-01-22T05:15:01.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7f000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7814f790 con 0x7f5e78068f90 2024-01-22T05:15:01.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7e600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e78153cc0 0x7f5e780be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:01.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7e600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e78153cc0 0x7f5e780be870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58808/0 (socket says 172.21.15.49:58808) 2024-01-22T05:15:01.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7e600700 1 -- 172.21.15.49:0/3886486292 learned_addr learned my addr 172.21.15.49:0/3886486292 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:01.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7dc00700 1 --2- 172.21.15.49:0/3886486292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e78066dc0 0x7f5e780aa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:01.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7d200700 1 --2- 172.21.15.49:0/3886486292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e78068f90 0x7f5e7814f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:01.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7e600700 1 -- 172.21.15.49:0/3886486292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e78068f90 msgr2=0x7f5e7814f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:01.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7e600700 1 --2- 172.21.15.49:0/3886486292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e78068f90 0x7f5e7814f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:01.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7e600700 1 -- 172.21.15.49:0/3886486292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e78066dc0 msgr2=0x7f5e780aa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:01.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7e600700 1 --2- 172.21.15.49:0/3886486292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e78066dc0 0x7f5e780aa1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:01.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7e600700 1 -- 172.21.15.49:0/3886486292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60009250 con 0x7f5e78153cc0 2024-01-22T05:15:01.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7d200700 1 --2- 172.21.15.49:0/3886486292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e78068f90 0x7f5e7814f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:01.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7e600700 1 --2- 172.21.15.49:0/3886486292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e78153cc0 0x7f5e780be870 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f5e7000b610 tx=0x7f5e70009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:01.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e74c00700 1 -- 172.21.15.49:0/3886486292 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700092e0 con 0x7f5e78153cc0 2024-01-22T05:15:01.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e74c00700 1 -- 172.21.15.49:0/3886486292 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7001d410 con 0x7f5e78153cc0 2024-01-22T05:15:01.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7f000700 1 -- 172.21.15.49:0/3886486292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e70009ae0 con 0x7f5e78153cc0 2024-01-22T05:15:01.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e74c00700 1 -- 172.21.15.49:0/3886486292 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7001d7d0 con 0x7f5e78153cc0 2024-01-22T05:15:01.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.174+0000 7f5e7f000700 1 -- 172.21.15.49:0/3886486292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e780a6e20 con 0x7f5e78153cc0 2024-01-22T05:15:01.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.178+0000 7f5e7f000700 1 -- 172.21.15.49:0/3886486292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e780bce90 con 0x7f5e78153cc0 2024-01-22T05:15:01.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.178+0000 7f5e74c00700 1 -- 172.21.15.49:0/3886486292 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5e7001dbc0 con 0x7f5e78153cc0 2024-01-22T05:15:01.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.178+0000 7f5e74c00700 1 --2- 172.21.15.49:0/3886486292 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e5005a510 0x7f5e5005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:01.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.178+0000 7f5e74c00700 1 -- 172.21.15.49:0/3886486292 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f5e700765e0 con 0x7f5e78153cc0 2024-01-22T05:15:01.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.182+0000 7f5e7dc00700 1 --2- 172.21.15.49:0/3886486292 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e5005a510 0x7f5e5005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:01.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.182+0000 7f5e7dc00700 1 --2- 172.21.15.49:0/3886486292 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e5005a510 0x7f5e5005c9d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f5e680011e0 tx=0x7f5e68009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:01.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.186+0000 7f5e74c00700 1 -- 172.21.15.49:0/3886486292 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5e70049c60 con 0x7f5e78153cc0 2024-01-22T05:15:01.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:01.386+0000 7f5e7f000700 1 -- 172.21.15.49:0/3886486292 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5e7806a0c0 con 0x7f5e78153cc0 2024-01-22T05:15:02.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.334+0000 7f5e74c00700 1 -- 172.21.15.49:0/3886486292 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v106) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5e7004d280 con 0x7f5e78153cc0 2024-01-22T05:15:02.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.338+0000 7f5e7f000700 1 -- 172.21.15.49:0/3886486292 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e5005a510 msgr2=0x7f5e5005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:02.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.338+0000 7f5e7f000700 1 --2- 172.21.15.49:0/3886486292 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e5005a510 0x7f5e5005c9d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f5e680011e0 tx=0x7f5e68009040).stop 2024-01-22T05:15:02.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.338+0000 7f5e7f000700 1 -- 172.21.15.49:0/3886486292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e78153cc0 msgr2=0x7f5e780be870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:02.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.338+0000 7f5e7f000700 1 --2- 172.21.15.49:0/3886486292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e78153cc0 0x7f5e780be870 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f5e7000b610 tx=0x7f5e70009840).stop 2024-01-22T05:15:02.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.338+0000 7f5e7f000700 1 -- 172.21.15.49:0/3886486292 shutdown_connections 2024-01-22T05:15:02.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.338+0000 7f5e7f000700 1 --2- 172.21.15.49:0/3886486292 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e5005a510 0x7f5e5005c9d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.338+0000 7f5e7f000700 1 --2- 172.21.15.49:0/3886486292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e78153cc0 0x7f5e780be870 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.338+0000 7f5e7f000700 1 --2- 172.21.15.49:0/3886486292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e78068f90 0x7f5e7814f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.338+0000 7f5e7f000700 1 --2- 172.21.15.49:0/3886486292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e78066dc0 0x7f5e780aa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.338+0000 7f5e7f000700 1 -- 172.21.15.49:0/3886486292 >> 172.21.15.49:0/3886486292 conn(0x7f5e780c4330 msgr2=0x7f5e78063720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:02.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.338+0000 7f5e7f000700 1 -- 172.21.15.49:0/3886486292 shutdown_connections 2024-01-22T05:15:02.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.338+0000 7f5e7f000700 1 -- 172.21.15.49:0/3886486292 wait complete. 2024-01-22T05:15:02.366 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:15:02.366 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:15:02.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.526+0000 7f56b3e00700 1 Processor -- start 2024-01-22T05:15:02.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.526+0000 7f56b3e00700 1 -- start start 2024-01-22T05:15:02.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56b3e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f56ac065240 0x7f56ac0644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56b3e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ac0649e0 0x7f56ac15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56b3e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ac0c2700 con 0x7f56ac065620 2024-01-22T05:15:02.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56b3e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ac064e30 con 0x7f56ac065240 2024-01-22T05:15:02.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56b3e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0c29a0 con 0x7f56ac0649e0 2024-01-22T05:15:02.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56b0a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f56ac065620 0x7f56ac15b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36524/0 (socket says 172.21.15.49:36524) 2024-01-22T05:15:02.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56b0a00700 1 -- 172.21.15.49:0/1157429874 learned_addr learned my addr 172.21.15.49:0/1157429874 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:02.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56b1400700 1 --2- 172.21.15.49:0/1157429874 >> v2:172.21.15.110:3300/0 conn(0x7f56ac065240 0x7f56ac0644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56b2800700 1 --2- 172.21.15.49:0/1157429874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ac0649e0 0x7f56ac15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 -- 172.21.15.49:0/1157429874 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627923001 0 0) 0x7f56ac0c2700 con 0x7f56ac065620 2024-01-22T05:15:02.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 -- 172.21.15.49:0/1157429874 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f568c0033f0 con 0x7f56ac065620 2024-01-22T05:15:02.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 -- 172.21.15.49:0/1157429874 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2454485864 0 0) 0x7f568c0033f0 con 0x7f56ac065620 2024-01-22T05:15:02.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 -- 172.21.15.49:0/1157429874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ac0649e0 msgr2=0x7f56ac15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:02.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 --2- 172.21.15.49:0/1157429874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ac0649e0 0x7f56ac15c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 -- 172.21.15.49:0/1157429874 >> v2:172.21.15.110:3300/0 conn(0x7f56ac065240 msgr2=0x7f56ac0644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 --2- 172.21.15.49:0/1157429874 >> v2:172.21.15.110:3300/0 conn(0x7f56ac065240 0x7f56ac0644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 -- 172.21.15.49:0/1157429874 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac0c2c80 con 0x7f56ac065620 2024-01-22T05:15:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 -- 172.21.15.49:0/1157429874 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f5694001490 con 0x7f56ac065620 2024-01-22T05:15:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 -- 172.21.15.49:0/1157429874 >> v1:172.21.15.49:6789/0 conn(0x7f56ac065620 legacy=0x7f56ac15b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 --2- 172.21.15.49:0/1157429874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f568c0038e0 0x7f568c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 --2- 172.21.15.49:0/1157429874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f568c004690 0x7f568c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 --2- 172.21.15.49:0/1157429874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ac0649e0 0x7f568c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 -- 172.21.15.49:0/1157429874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac064e30 con 0x7f568c004690 2024-01-22T05:15:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 -- 172.21.15.49:0/1157429874 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0c29a0 con 0x7f568c0038e0 2024-01-22T05:15:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.530+0000 7f56abe00700 1 -- 172.21.15.49:0/1157429874 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c00b8e0 con 0x7f56ac0649e0 2024-01-22T05:15:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b0a00700 1 --2- 172.21.15.49:0/1157429874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f568c004690 0x7f568c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b2800700 1 --2- 172.21.15.49:0/1157429874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ac0649e0 0x7f568c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b1400700 1 --2- 172.21.15.49:0/1157429874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f568c0038e0 0x7f568c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b0a00700 1 -- 172.21.15.49:0/1157429874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ac0649e0 msgr2=0x7f568c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:02.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b0a00700 1 --2- 172.21.15.49:0/1157429874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ac0649e0 0x7f568c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b0a00700 1 -- 172.21.15.49:0/1157429874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f568c0038e0 msgr2=0x7f568c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:02.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b0a00700 1 --2- 172.21.15.49:0/1157429874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f568c0038e0 0x7f568c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b0a00700 1 -- 172.21.15.49:0/1157429874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c0033f0 con 0x7f568c004690 2024-01-22T05:15:02.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b2800700 1 --2- 172.21.15.49:0/1157429874 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ac0649e0 0x7f568c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:15:02.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b0a00700 1 --2- 172.21.15.49:0/1157429874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f568c004690 0x7f568c004b10 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f56ac0665f0 tx=0x7f56ac0c2890).ready entity=mon.0 client_cookie=3a113a5f99dabe9d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:02.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56abe00700 1 -- 172.21.15.49:0/1157429874 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400cae0 con 0x7f568c004690 2024-01-22T05:15:02.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56abe00700 1 -- 172.21.15.49:0/1157429874 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569400cc40 con 0x7f568c004690 2024-01-22T05:15:02.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56abe00700 1 -- 172.21.15.49:0/1157429874 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694007170 con 0x7f568c004690 2024-01-22T05:15:02.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b3e00700 1 -- 172.21.15.49:0/1157429874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f568c004690 msgr2=0x7f568c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:02.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b3e00700 1 --2- 172.21.15.49:0/1157429874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f568c004690 0x7f568c004b10 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f56ac0665f0 tx=0x7f56ac0c2890).stop 2024-01-22T05:15:02.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b2800700 1 -- 172.21.15.49:0/1157429874 reap_dead start 2024-01-22T05:15:02.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b3e00700 1 -- 172.21.15.49:0/1157429874 shutdown_connections 2024-01-22T05:15:02.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b3e00700 1 -- 172.21.15.49:0/1157429874 >> 172.21.15.49:0/1157429874 conn(0x7f56ac0c87f0 msgr2=0x7f56ac0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:02.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.534+0000 7f56b3e00700 1 -- 172.21.15.49:0/1157429874 shutdown_connections 2024-01-22T05:15:02.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.538+0000 7f56b3e00700 1 -- 172.21.15.49:0/1157429874 wait complete. 2024-01-22T05:15:02.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.538+0000 7f56b3e00700 1 Processor -- start 2024-01-22T05:15:02.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.538+0000 7f56b3e00700 1 -- start start 2024-01-22T05:15:02.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f568c004690 0x7f56ac145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b3e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ac0a7e40 0x7f56ac0ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56ac0ad680 0x7f56ac158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b3e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0adae0 con 0x7f568c004690 2024-01-22T05:15:02.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b3e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac1697e0 con 0x7f56ac0ad680 2024-01-22T05:15:02.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b3e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac16a640 con 0x7f56ac0a7e40 2024-01-22T05:15:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b1400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f568c004690 0x7f56ac145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b1400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f568c004690 0x7f56ac145180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58826/0 (socket says 172.21.15.49:58826) 2024-01-22T05:15:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b1400700 1 -- 172.21.15.49:0/22664090 learned_addr learned my addr 172.21.15.49:0/22664090 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b2800700 1 --2- 172.21.15.49:0/22664090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56ac0ad680 0x7f56ac158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b0a00700 1 --2- 172.21.15.49:0/22664090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ac0a7e40 0x7f56ac0ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b1400700 1 -- 172.21.15.49:0/22664090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ac0a7e40 msgr2=0x7f56ac0ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b1400700 1 --2- 172.21.15.49:0/22664090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ac0a7e40 0x7f56ac0ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b1400700 1 -- 172.21.15.49:0/22664090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56ac0ad680 msgr2=0x7f56ac158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b1400700 1 --2- 172.21.15.49:0/22664090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56ac0ad680 0x7f56ac158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b1400700 1 -- 172.21.15.49:0/22664090 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac169a30 con 0x7f568c004690 2024-01-22T05:15:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56b1400700 1 --2- 172.21.15.49:0/22664090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f568c004690 0x7f56ac145180 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f569c0119f0 tx=0x7f569c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56a8c00700 1 -- 172.21.15.49:0/22664090 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c00f710 con 0x7f568c004690 2024-01-22T05:15:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56a8c00700 1 -- 172.21.15.49:0/22664090 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c00f870 con 0x7f568c004690 2024-01-22T05:15:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.542+0000 7f56a8c00700 1 -- 172.21.15.49:0/22664090 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c00fbf0 con 0x7f568c004690 2024-01-22T05:15:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.546+0000 7f56b3e00700 1 -- 172.21.15.49:0/22664090 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ac169d10 con 0x7f568c004690 2024-01-22T05:15:02.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.546+0000 7f56b3e00700 1 -- 172.21.15.49:0/22664090 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ac16a2d0 con 0x7f568c004690 2024-01-22T05:15:02.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.546+0000 7f56b3e00700 1 -- 172.21.15.49:0/22664090 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac047060 con 0x7f568c004690 2024-01-22T05:15:02.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.546+0000 7f56a8c00700 1 -- 172.21.15.49:0/22664090 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f569c014440 con 0x7f568c004690 2024-01-22T05:15:02.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.550+0000 7f56a8c00700 1 --2- 172.21.15.49:0/22664090 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f568405a540 0x7f568405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.550+0000 7f56a8c00700 1 -- 172.21.15.49:0/22664090 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f569c0753b0 con 0x7f568c004690 2024-01-22T05:15:02.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.550+0000 7f56b0a00700 1 --2- 172.21.15.49:0/22664090 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f568405a540 0x7f568405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.550+0000 7f56b0a00700 1 --2- 172.21.15.49:0/22664090 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f568405a540 0x7f568405ca00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f56ac0a8220 tx=0x7f5694015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:02.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.558+0000 7f56a8c00700 1 -- 172.21.15.49:0/22664090 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f569c048a10 con 0x7f568c004690 2024-01-22T05:15:02.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.758+0000 7f56b3e00700 1 -- 172.21.15.49:0/22664090 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56ac0c2f60 con 0x7f568c004690 2024-01-22T05:15:02.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.758+0000 7f56a8c00700 1 -- 172.21.15.49:0/22664090 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4503 (secure 0 0 0) 0x7f569c04bff0 con 0x7f568c004690 2024-01-22T05:15:02.764 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:02.764 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:14:58.925818+0000","modified":"2024-01-22T05:15:02.323695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8292":{"gid":8292,"name":"a","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3036262557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3036262557},{"type":"v1","addr":"172.21.15.49:6837","nonce":3036262557}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-22T05:15:02.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.762+0000 7f56b3e00700 1 -- 172.21.15.49:0/22664090 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f568405a540 msgr2=0x7f568405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:02.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.762+0000 7f56b3e00700 1 --2- 172.21.15.49:0/22664090 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f568405a540 0x7f568405ca00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f56ac0a8220 tx=0x7f5694015000).stop 2024-01-22T05:15:02.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.762+0000 7f56b3e00700 1 -- 172.21.15.49:0/22664090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f568c004690 msgr2=0x7f56ac145180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:02.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.762+0000 7f56b3e00700 1 --2- 172.21.15.49:0/22664090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f568c004690 0x7f56ac145180 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f569c0119f0 tx=0x7f569c009060).stop 2024-01-22T05:15:02.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.762+0000 7f56b3e00700 1 -- 172.21.15.49:0/22664090 shutdown_connections 2024-01-22T05:15:02.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.762+0000 7f56b3e00700 1 --2- 172.21.15.49:0/22664090 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f568405a540 0x7f568405ca00 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.762+0000 7f56b3e00700 1 --2- 172.21.15.49:0/22664090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56ac0ad680 0x7f56ac158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.762+0000 7f56b3e00700 1 --2- 172.21.15.49:0/22664090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56ac0a7e40 0x7f56ac0ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.762+0000 7f56b3e00700 1 --2- 172.21.15.49:0/22664090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f568c004690 0x7f56ac145180 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.762+0000 7f56b3e00700 1 -- 172.21.15.49:0/22664090 >> 172.21.15.49:0/22664090 conn(0x7f56ac0c87f0 msgr2=0x7f56ac156990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:02.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.766+0000 7f56b3e00700 1 -- 172.21.15.49:0/22664090 shutdown_connections 2024-01-22T05:15:02.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.766+0000 7f56b3e00700 1 -- 172.21.15.49:0/22664090 wait complete. 2024-01-22T05:15:02.771 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2024-01-22T05:15:02.788 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:15:02.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.946+0000 7faa94a00700 1 Processor -- start 2024-01-22T05:15:02.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.950+0000 7faa94a00700 1 -- start start 2024-01-22T05:15:02.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.950+0000 7faa94a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa8c0abd20 0x7faa8c065c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.950+0000 7faa94a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8c068a60 con 0x7faa8c0ab890 2024-01-22T05:15:02.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.950+0000 7faa94a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8c0bd380 con 0x7faa8c0bcfa0 2024-01-22T05:15:02.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.950+0000 7faa94a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0bb790 con 0x7faa8c0abd20 2024-01-22T05:15:02.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.950+0000 7faa91600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faa8c0ab890 0x7faa8c065550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36534/0 (socket says 172.21.15.49:36534) 2024-01-22T05:15:02.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.950+0000 7faa91600700 1 -- 172.21.15.49:0/2162562322 learned_addr learned my addr 172.21.15.49:0/2162562322 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:02.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.950+0000 7faa92a00700 1 --2- 172.21.15.49:0/2162562322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa8c0abd20 0x7faa8c065c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.950+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114825228 0 0) 0x7faa8c068a60 con 0x7faa8c0ab890 2024-01-22T05:15:02.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa6c0033f0 con 0x7faa8c0ab890 2024-01-22T05:15:02.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926138932 0 0) 0x7faa8c0bd380 con 0x7faa8c0bcfa0 2024-01-22T05:15:02.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa8c068a60 con 0x7faa8c0bcfa0 2024-01-22T05:15:02.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 616618630 0 0) 0x7faa6c0033f0 con 0x7faa8c0ab890 2024-01-22T05:15:02.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa8c0abd20 msgr2=0x7faa8c065c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:02.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 --2- 172.21.15.49:0/2162562322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa8c0abd20 0x7faa8c065c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 >> v1:172.21.15.110:6789/0 conn(0x7faa8c0bcfa0 legacy=0x7faa8c151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:02.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c068460 con 0x7faa8c0ab890 2024-01-22T05:15:02.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7faa74001470 con 0x7faa8c0ab890 2024-01-22T05:15:02.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 >> v1:172.21.15.49:6789/0 conn(0x7faa8c0ab890 legacy=0x7faa8c065550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:02.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 --2- 172.21.15.49:0/2162562322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa6c003aa0 0x7faa6c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 --2- 172.21.15.49:0/2162562322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa6c004690 0x7faa6c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 --2- 172.21.15.49:0/2162562322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa8c0abd20 0x7faa6c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0bb790 con 0x7faa6c003aa0 2024-01-22T05:15:02.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c00b910 con 0x7faa6c004690 2024-01-22T05:15:02.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c00bad0 con 0x7faa8c0abd20 2024-01-22T05:15:02.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa92000700 1 --2- 172.21.15.49:0/2162562322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa6c003aa0 0x7faa6c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa91600700 1 --2- 172.21.15.49:0/2162562322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa6c004690 0x7faa6c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa92a00700 1 --2- 172.21.15.49:0/2162562322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa8c0abd20 0x7faa6c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa92000700 1 -- 172.21.15.49:0/2162562322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa8c0abd20 msgr2=0x7faa6c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:02.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa92000700 1 --2- 172.21.15.49:0/2162562322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa8c0abd20 0x7faa6c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa92000700 1 -- 172.21.15.49:0/2162562322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa6c004690 msgr2=0x7faa6c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:02.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa92000700 1 --2- 172.21.15.49:0/2162562322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa6c004690 0x7faa6c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa92000700 1 -- 172.21.15.49:0/2162562322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c0033f0 con 0x7faa6c003aa0 2024-01-22T05:15:02.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa92a00700 1 --2- 172.21.15.49:0/2162562322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa8c0abd20 0x7faa6c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:02.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa92000700 1 --2- 172.21.15.49:0/2162562322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa6c003aa0 0x7faa6c003ec0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7faa7c001890 tx=0x7faa7c007bb0).ready entity=mon.0 client_cookie=3ac2a65a976566e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:02.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c007020 con 0x7faa6c003aa0 2024-01-22T05:15:02.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7c007180 con 0x7faa6c003aa0 2024-01-22T05:15:02.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.954+0000 7faa90c00700 1 -- 172.21.15.49:0/2162562322 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c007500 con 0x7faa6c003aa0 2024-01-22T05:15:02.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.958+0000 7faa94a00700 1 -- 172.21.15.49:0/2162562322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa6c003aa0 msgr2=0x7faa6c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:02.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.958+0000 7faa94a00700 1 --2- 172.21.15.49:0/2162562322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa6c003aa0 0x7faa6c003ec0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7faa7c001890 tx=0x7faa7c007bb0).stop 2024-01-22T05:15:02.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.958+0000 7faa92a00700 1 -- 172.21.15.49:0/2162562322 reap_dead start 2024-01-22T05:15:02.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.958+0000 7faa94a00700 1 -- 172.21.15.49:0/2162562322 shutdown_connections 2024-01-22T05:15:02.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.958+0000 7faa94a00700 1 -- 172.21.15.49:0/2162562322 >> 172.21.15.49:0/2162562322 conn(0x7faa8c0c6540 msgr2=0x7faa8c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:02.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.958+0000 7faa94a00700 1 -- 172.21.15.49:0/2162562322 shutdown_connections 2024-01-22T05:15:02.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.958+0000 7faa94a00700 1 -- 172.21.15.49:0/2162562322 wait complete. 2024-01-22T05:15:02.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.962+0000 7faa94a00700 1 Processor -- start 2024-01-22T05:15:02.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.962+0000 7faa94a00700 1 -- start start 2024-01-22T05:15:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.962+0000 7faa94a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa6c003aa0 0x7faa8c157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.962+0000 7faa94a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c13ceb0 0x7faa8c154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.962+0000 7faa94a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa8c155060 0x7faa8c153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.962+0000 7faa94a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c157580 con 0x7faa8c13ceb0 2024-01-22T05:15:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.962+0000 7faa94a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c1566d0 con 0x7faa6c003aa0 2024-01-22T05:15:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.962+0000 7faa94a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c156970 con 0x7faa8c155060 2024-01-22T05:15:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.962+0000 7faa91600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c13ceb0 0x7faa8c154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.962+0000 7faa91600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c13ceb0 0x7faa8c154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58846/0 (socket says 172.21.15.49:58846) 2024-01-22T05:15:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.962+0000 7faa91600700 1 -- 172.21.15.49:0/3801025988 learned_addr learned my addr 172.21.15.49:0/3801025988 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:02.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.962+0000 7faa92000700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa6c003aa0 0x7faa8c157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.962+0000 7faa92a00700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa8c155060 0x7faa8c153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.962+0000 7faa91600700 1 -- 172.21.15.49:0/3801025988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa8c155060 msgr2=0x7faa8c153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.962+0000 7faa91600700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa8c155060 0x7faa8c153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.966+0000 7faa91600700 1 -- 172.21.15.49:0/3801025988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa6c003aa0 msgr2=0x7faa8c157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.966+0000 7faa91600700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa6c003aa0 0x7faa8c157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.966+0000 7faa91600700 1 -- 172.21.15.49:0/3801025988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c156c50 con 0x7faa8c13ceb0 2024-01-22T05:15:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.966+0000 7faa92000700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa6c003aa0 0x7faa8c157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.966+0000 7faa92a00700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa8c155060 0x7faa8c153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.966+0000 7faa91600700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c13ceb0 0x7faa8c154b70 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7faa74000df0 tx=0x7faa74001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.966+0000 7faa89600700 1 -- 172.21.15.49:0/3801025988 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74001000 con 0x7faa8c13ceb0 2024-01-22T05:15:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.966+0000 7faa89600700 1 -- 172.21.15.49:0/3801025988 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa74011590 con 0x7faa8c13ceb0 2024-01-22T05:15:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.966+0000 7faa94a00700 1 -- 172.21.15.49:0/3801025988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c156f30 con 0x7faa8c13ceb0 2024-01-22T05:15:02.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.966+0000 7faa89600700 1 -- 172.21.15.49:0/3801025988 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74011910 con 0x7faa8c13ceb0 2024-01-22T05:15:02.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.966+0000 7faa94a00700 1 -- 172.21.15.49:0/3801025988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c14d780 con 0x7faa8c13ceb0 2024-01-22T05:15:02.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.966+0000 7faa94a00700 1 -- 172.21.15.49:0/3801025988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8c14d910 con 0x7faa8c13ceb0 2024-01-22T05:15:02.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.970+0000 7faa89600700 1 -- 172.21.15.49:0/3801025988 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7faa74011d00 con 0x7faa8c13ceb0 2024-01-22T05:15:02.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.970+0000 7faa89600700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faa6405a510 0x7faa6405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:02.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.970+0000 7faa89600700 1 -- 172.21.15.49:0/3801025988 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6474+0+0 (secure 0 0 0) 0x7faa740742b0 con 0x7faa8c13ceb0 2024-01-22T05:15:02.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.970+0000 7faa92000700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faa6405a510 0x7faa6405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:02.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.970+0000 7faa92000700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faa6405a510 0x7faa6405c9d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7faa7c001120 tx=0x7faa7c016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:02.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:02.978+0000 7faa89600700 1 -- 172.21.15.49:0/3801025988 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faa74047920 con 0x7faa8c13ceb0 2024-01-22T05:15:03.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.142+0000 7faa94a00700 1 -- 172.21.15.49:0/3801025988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa8c047060 con 0x7faa8c13ceb0 2024-01-22T05:15:03.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.142+0000 7faa89600700 1 -- 172.21.15.49:0/3801025988 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+17178 (secure 0 0 0) 0x7faa74019020 con 0x7faa8c13ceb0 2024-01-22T05:15:03.146 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:03.146 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":131,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:14:59.930334+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:14:57.007984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-01-22T05:14:57.955380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:15:03.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.146+0000 7faa94a00700 1 -- 172.21.15.49:0/3801025988 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faa6405a510 msgr2=0x7faa6405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:03.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.146+0000 7faa94a00700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faa6405a510 0x7faa6405c9d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7faa7c001120 tx=0x7faa7c016000).stop 2024-01-22T05:15:03.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.146+0000 7faa94a00700 1 -- 172.21.15.49:0/3801025988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c13ceb0 msgr2=0x7faa8c154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:03.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.146+0000 7faa94a00700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c13ceb0 0x7faa8c154b70 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7faa74000df0 tx=0x7faa74001df0).stop 2024-01-22T05:15:03.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.146+0000 7faa94a00700 1 -- 172.21.15.49:0/3801025988 shutdown_connections 2024-01-22T05:15:03.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.146+0000 7faa94a00700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faa6405a510 0x7faa6405c9d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.146+0000 7faa94a00700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa8c155060 0x7faa8c153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.146+0000 7faa94a00700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c13ceb0 0x7faa8c154b70 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.146+0000 7faa94a00700 1 --2- 172.21.15.49:0/3801025988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa6c003aa0 0x7faa8c157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.146+0000 7faa94a00700 1 -- 172.21.15.49:0/3801025988 >> 172.21.15.49:0/3801025988 conn(0x7faa8c0c6540 msgr2=0x7faa8c0654a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:03.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.146+0000 7faa94a00700 1 -- 172.21.15.49:0/3801025988 shutdown_connections 2024-01-22T05:15:03.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.146+0000 7faa94a00700 1 -- 172.21.15.49:0/3801025988 wait complete. 2024-01-22T05:15:03.175 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:15:03.175 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:15:03.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.334+0000 7f81d9200700 1 Processor -- start 2024-01-22T05:15:03.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.334+0000 7f81d9200700 1 -- start start 2024-01-22T05:15:03.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.338+0000 7f81d9200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f81d40bcfa0 0x7f81d4151700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.338+0000 7f81d9200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d4068a60 con 0x7f81d4151bf0 2024-01-22T05:15:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.338+0000 7f81d9200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d40bd380 con 0x7f81d40abfa0 2024-01-22T05:15:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.338+0000 7f81d9200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d40bb790 con 0x7f81d40bcfa0 2024-01-22T05:15:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.338+0000 7f81d1e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f81d40bcfa0 0x7f81d4151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.338+0000 7f81d1400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f81d4151bf0 0x7f81d40ab890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35502/0 (socket says 172.21.15.49:35502) 2024-01-22T05:15:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.338+0000 7f81d1400700 1 -- 172.21.15.49:0/1070497357 learned_addr learned my addr 172.21.15.49:0/1070497357 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.338+0000 7f81d1e00700 1 --2- 172.21.15.49:0/1070497357 >> v2:172.21.15.49:3300/0 conn(0x7f81d40bcfa0 0x7f81d4151700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36996/0 (socket says 172.21.15.49:36996) 2024-01-22T05:15:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.338+0000 7f81d1e00700 1 -- 172.21.15.49:0/1070497357 >> v1:172.21.15.110:6789/0 conn(0x7f81d40abfa0 legacy=0x7f81d4065550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:03.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.338+0000 7f81d1e00700 1 -- 172.21.15.49:0/1070497357 >> v1:172.21.15.49:6789/0 conn(0x7f81d4151bf0 legacy=0x7f81d40ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:03.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.338+0000 7f81d0a00700 1 -- 172.21.15.49:0/1070497357 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741177405 0 0) 0x7f81d40bd380 con 0x7f81d40abfa0 2024-01-22T05:15:03.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.338+0000 7f81d1e00700 1 -- 172.21.15.49:0/1070497357 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d4068460 con 0x7f81d40bcfa0 2024-01-22T05:15:03.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.338+0000 7f81d1e00700 1 --2- 172.21.15.49:0/1070497357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d40bcfa0 0x7f81d4151700 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f81c4009760 tx=0x7f81c4009060).ready entity=mon.0 client_cookie=d7c0d4c30aa0b72a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:03.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.342+0000 7f81d0a00700 1 -- 172.21.15.49:0/1070497357 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40090d0 con 0x7f81d40bcfa0 2024-01-22T05:15:03.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.342+0000 7f81d0a00700 1 -- 172.21.15.49:0/1070497357 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c400f510 con 0x7f81d40bcfa0 2024-01-22T05:15:03.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.342+0000 7f81d0a00700 1 -- 172.21.15.49:0/1070497357 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c400f890 con 0x7f81d40bcfa0 2024-01-22T05:15:03.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.342+0000 7f81d9200700 1 -- 172.21.15.49:0/1070497357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d40bcfa0 msgr2=0x7f81d4151700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:03.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.342+0000 7f81d9200700 1 --2- 172.21.15.49:0/1070497357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d40bcfa0 0x7f81d4151700 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f81c4009760 tx=0x7f81c4009060).stop 2024-01-22T05:15:03.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.342+0000 7f81d9200700 1 -- 172.21.15.49:0/1070497357 shutdown_connections 2024-01-22T05:15:03.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.342+0000 7f81d9200700 1 --2- 172.21.15.49:0/1070497357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d40bcfa0 0x7f81d4151700 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.342+0000 7f81d9200700 1 -- 172.21.15.49:0/1070497357 >> 172.21.15.49:0/1070497357 conn(0x7f81d40c6540 msgr2=0x7f81d40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:03.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.342+0000 7f81d9200700 1 -- 172.21.15.49:0/1070497357 shutdown_connections 2024-01-22T05:15:03.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.342+0000 7f81d9200700 1 -- 172.21.15.49:0/1070497357 wait complete. 2024-01-22T05:15:03.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.346+0000 7f81d9200700 1 Processor -- start 2024-01-22T05:15:03.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.346+0000 7f81d9200700 1 -- start start 2024-01-22T05:15:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.346+0000 7f81d9200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81d40abfa0 0x7f81d413ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:03.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.346+0000 7f81d9200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d40bcfa0 0x7f81d40c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.346+0000 7f81d9200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81d4151bf0 0x7f81d41478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.346+0000 7f81d9200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d40c29d0 con 0x7f81d40bcfa0 2024-01-22T05:15:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.346+0000 7f81d9200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d40c1930 con 0x7f81d4151bf0 2024-01-22T05:15:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.346+0000 7f81d9200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d40c1c10 con 0x7f81d40abfa0 2024-01-22T05:15:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81d1400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d40bcfa0 0x7f81d40c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81d1400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d40bcfa0 0x7f81d40c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37012/0 (socket says 172.21.15.49:37012) 2024-01-22T05:15:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81d1400700 1 -- 172.21.15.49:0/1169237440 learned_addr learned my addr 172.21.15.49:0/1169237440 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81d1e00700 1 --2- 172.21.15.49:0/1169237440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81d40abfa0 0x7f81d413ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:03.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81d2800700 1 --2- 172.21.15.49:0/1169237440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81d4151bf0 0x7f81d41478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:03.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81d1400700 1 -- 172.21.15.49:0/1169237440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81d40abfa0 msgr2=0x7f81d413ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:03.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81d1400700 1 --2- 172.21.15.49:0/1169237440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81d40abfa0 0x7f81d413ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81d1400700 1 -- 172.21.15.49:0/1169237440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81d4151bf0 msgr2=0x7f81d41478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:03.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81d1400700 1 --2- 172.21.15.49:0/1169237440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81d4151bf0 0x7f81d41478e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81d1400700 1 -- 172.21.15.49:0/1169237440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c40092a0 con 0x7f81d40bcfa0 2024-01-22T05:15:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81d2800700 1 --2- 172.21.15.49:0/1169237440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81d4151bf0 0x7f81d41478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81d1400700 1 --2- 172.21.15.49:0/1169237440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d40bcfa0 0x7f81d40c34d0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f81bc00c600 tx=0x7f81bc007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81c9600700 1 -- 172.21.15.49:0/1169237440 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc0072e0 con 0x7f81d40bcfa0 2024-01-22T05:15:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81c9600700 1 -- 172.21.15.49:0/1169237440 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81bc007440 con 0x7f81d40bcfa0 2024-01-22T05:15:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81d9200700 1 -- 172.21.15.49:0/1169237440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d40c1ef0 con 0x7f81d40bcfa0 2024-01-22T05:15:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81c9600700 1 -- 172.21.15.49:0/1169237440 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc0057a0 con 0x7f81d40bcfa0 2024-01-22T05:15:03.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.350+0000 7f81d9200700 1 -- 172.21.15.49:0/1169237440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d40c24b0 con 0x7f81d40bcfa0 2024-01-22T05:15:03.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.354+0000 7f81d9200700 1 -- 172.21.15.49:0/1169237440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d40bdcf0 con 0x7f81d40bcfa0 2024-01-22T05:15:03.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.354+0000 7f81c9600700 1 -- 172.21.15.49:0/1169237440 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f81bc005b90 con 0x7f81d40bcfa0 2024-01-22T05:15:03.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.354+0000 7f81c9600700 1 --2- 172.21.15.49:0/1169237440 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f81ac05a510 0x7f81ac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:03.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.354+0000 7f81c9600700 1 -- 172.21.15.49:0/1169237440 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f81bc074100 con 0x7f81d40bcfa0 2024-01-22T05:15:03.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.354+0000 7f81d1e00700 1 --2- 172.21.15.49:0/1169237440 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f81ac05a510 0x7f81ac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:03.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.354+0000 7f81d1e00700 1 --2- 172.21.15.49:0/1169237440 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f81ac05a510 0x7f81ac05c9d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f81c4009760 tx=0x7f81c4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:03.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.362+0000 7f81c9600700 1 -- 172.21.15.49:0/1169237440 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f81d40bdcf0 con 0x7f81d40bcfa0 2024-01-22T05:15:03.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.530+0000 7f81d9200700 1 -- 172.21.15.49:0/1169237440 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81d40bdcf0 con 0x7f81ac05a510 2024-01-22T05:15:03.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.550+0000 7f81c9600700 1 -- 172.21.15.49:0/1169237440 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359365 (secure 0 0 0) 0x7f81d40bdcf0 con 0x7f81ac05a510 2024-01-22T05:15:03.558 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:03.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.554+0000 7f81d9200700 1 -- 172.21.15.49:0/1169237440 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f81ac05a510 msgr2=0x7f81ac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:03.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.554+0000 7f81d9200700 1 --2- 172.21.15.49:0/1169237440 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f81ac05a510 0x7f81ac05c9d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f81c4009760 tx=0x7f81c4017000).stop 2024-01-22T05:15:03.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.554+0000 7f81d9200700 1 -- 172.21.15.49:0/1169237440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d40bcfa0 msgr2=0x7f81d40c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:03.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.554+0000 7f81d9200700 1 --2- 172.21.15.49:0/1169237440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d40bcfa0 0x7f81d40c34d0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f81bc00c600 tx=0x7f81bc007d70).stop 2024-01-22T05:15:03.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.558+0000 7f81d9200700 1 -- 172.21.15.49:0/1169237440 shutdown_connections 2024-01-22T05:15:03.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.558+0000 7f81d9200700 1 --2- 172.21.15.49:0/1169237440 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f81ac05a510 0x7f81ac05c9d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.558+0000 7f81d9200700 1 --2- 172.21.15.49:0/1169237440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81d4151bf0 0x7f81d41478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.558+0000 7f81d9200700 1 --2- 172.21.15.49:0/1169237440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81d40bcfa0 0x7f81d40c34d0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.558+0000 7f81d9200700 1 --2- 172.21.15.49:0/1169237440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81d40abfa0 0x7f81d413ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.558+0000 7f81d9200700 1 -- 172.21.15.49:0/1169237440 >> 172.21.15.49:0/1169237440 conn(0x7f81d40c6540 msgr2=0x7f81d40bd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:03.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.558+0000 7f81d9200700 1 -- 172.21.15.49:0/1169237440 shutdown_connections 2024-01-22T05:15:03.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.558+0000 7f81d9200700 1 -- 172.21.15.49:0/1169237440 wait complete. 2024-01-22T05:15:03.563 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:15:03.582 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2024-01-22T05:15:03.465091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2456128,"kb_used_data":12800,"kb_used_omap":0,"kb_used_meta":2443264,"kb_avail":752518592,"statfs":{"total":773094113280,"available":770579038208,"internally_reserved":0,"allocated":13107200,"data_stored":6476188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2501902336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077827756,"num_objects":-1078,"num_object_clones":0,"num_object_copies":-2156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3202,"num_write_kb":-1053297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-31,"num_bytes_recovered":-32505856,"num_keys_recovered":0,"num_objects_omap":-46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.960698"},"pg_stats":[{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970335+0000","last_change":"2024-01-22T05:14:58.960573+0000","last_active":"2024-01-22T05:14:58.970335+0000","last_peered":"2024-01-22T05:14:58.970335+0000","last_clean":"2024-01-22T05:14:58.970335+0000","last_became_active":"2024-01-22T05:14:58.960299+0000","last_became_peered":"2024-01-22T05:14:58.960299+0000","last_unstale":"2024-01-22T05:14:58.970335+0000","last_undegraded":"2024-01-22T05:14:58.970335+0000","last_fullsized":"2024-01-22T05:14:58.970335+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3f","version":"130'3","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.964813+0000","last_change":"2024-01-22T05:14:58.502503+0000","last_active":"2024-01-22T05:14:58.964813+0000","last_peered":"2024-01-22T05:14:58.964813+0000","last_clean":"2024-01-22T05:14:58.964813+0000","last_became_active":"2024-01-22T05:14:58.502205+0000","last_became_peered":"2024-01-22T05:14:58.502205+0000","last_unstale":"2024-01-22T05:14:58.964813+0000","last_undegraded":"2024-01-22T05:14:58.964813+0000","last_fullsized":"2024-01-22T05:14:58.964813+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.974450+0000","last_change":"2024-01-22T05:14:58.962565+0000","last_active":"2024-01-22T05:14:58.974450+0000","last_peered":"2024-01-22T05:14:58.974450+0000","last_clean":"2024-01-22T05:14:58.974450+0000","last_became_active":"2024-01-22T05:14:58.962283+0000","last_became_peered":"2024-01-22T05:14:58.962283+0000","last_unstale":"2024-01-22T05:14:58.974450+0000","last_undegraded":"2024-01-22T05:14:58.974450+0000","last_fullsized":"2024-01-22T05:14:58.974450+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.953376+0000","last_change":"2024-01-22T05:14:58.518261+0000","last_active":"2024-01-22T05:14:58.953376+0000","last_peered":"2024-01-22T05:14:58.953376+0000","last_clean":"2024-01-22T05:14:58.953376+0000","last_became_active":"2024-01-22T05:14:58.516568+0000","last_became_peered":"2024-01-22T05:14:58.516568+0000","last_unstale":"2024-01-22T05:14:58.953376+0000","last_undegraded":"2024-01-22T05:14:58.953376+0000","last_fullsized":"2024-01-22T05:14:58.953376+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.974635+0000","last_change":"2024-01-22T05:14:58.960667+0000","last_active":"2024-01-22T05:14:58.974635+0000","last_peered":"2024-01-22T05:14:58.974635+0000","last_clean":"2024-01-22T05:14:58.974635+0000","last_became_active":"2024-01-22T05:14:58.960287+0000","last_became_peered":"2024-01-22T05:14:58.960287+0000","last_unstale":"2024-01-22T05:14:58.974635+0000","last_undegraded":"2024-01-22T05:14:58.974635+0000","last_fullsized":"2024-01-22T05:14:58.974635+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.952636+0000","last_change":"2024-01-22T05:14:58.520206+0000","last_active":"2024-01-22T05:14:58.952636+0000","last_peered":"2024-01-22T05:14:58.952636+0000","last_clean":"2024-01-22T05:14:58.952636+0000","last_became_active":"2024-01-22T05:14:58.519785+0000","last_became_peered":"2024-01-22T05:14:58.519785+0000","last_unstale":"2024-01-22T05:14:58.952636+0000","last_undegraded":"2024-01-22T05:14:58.952636+0000","last_fullsized":"2024-01-22T05:14:58.952636+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.957098+0000","last_change":"2024-01-22T05:14:58.953408+0000","last_active":"2024-01-22T05:14:58.957098+0000","last_peered":"2024-01-22T05:14:58.957098+0000","last_clean":"2024-01-22T05:14:58.957098+0000","last_became_active":"2024-01-22T05:14:58.953132+0000","last_became_peered":"2024-01-22T05:14:58.953132+0000","last_unstale":"2024-01-22T05:14:58.957098+0000","last_undegraded":"2024-01-22T05:14:58.957098+0000","last_fullsized":"2024-01-22T05:14:58.957098+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.3c","version":"130'2","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.968610+0000","last_change":"2024-01-22T05:14:58.515350+0000","last_active":"2024-01-22T05:14:58.968610+0000","last_peered":"2024-01-22T05:14:58.968610+0000","last_clean":"2024-01-22T05:14:58.968610+0000","last_became_active":"2024-01-22T05:14:58.515045+0000","last_became_peered":"2024-01-22T05:14:58.515045+0000","last_unstale":"2024-01-22T05:14:58.968610+0000","last_undegraded":"2024-01-22T05:14:58.968610+0000","last_fullsized":"2024-01-22T05:14:58.968610+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.968959+0000","last_change":"2024-01-22T05:14:58.957495+0000","last_active":"2024-01-22T05:14:58.968959+0000","last_peered":"2024-01-22T05:14:58.968959+0000","last_clean":"2024-01-22T05:14:58.968959+0000","last_became_active":"2024-01-22T05:14:58.957234+0000","last_became_peered":"2024-01-22T05:14:58.957234+0000","last_unstale":"2024-01-22T05:14:58.968959+0000","last_undegraded":"2024-01-22T05:14:58.968959+0000","last_fullsized":"2024-01-22T05:14:58.968959+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3b","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.959302+0000","last_change":"2024-01-22T05:14:58.506080+0000","last_active":"2024-01-22T05:14:58.959302+0000","last_peered":"2024-01-22T05:14:58.959302+0000","last_clean":"2024-01-22T05:14:58.959302+0000","last_became_active":"2024-01-22T05:14:58.505807+0000","last_became_peered":"2024-01-22T05:14:58.505807+0000","last_unstale":"2024-01-22T05:14:58.959302+0000","last_undegraded":"2024-01-22T05:14:58.959302+0000","last_fullsized":"2024-01-22T05:14:58.959302+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965377+0000","last_change":"2024-01-22T05:14:58.958592+0000","last_active":"2024-01-22T05:14:58.965377+0000","last_peered":"2024-01-22T05:14:58.965377+0000","last_clean":"2024-01-22T05:14:58.965377+0000","last_became_active":"2024-01-22T05:14:58.958286+0000","last_became_peered":"2024-01-22T05:14:58.958286+0000","last_unstale":"2024-01-22T05:14:58.965377+0000","last_undegraded":"2024-01-22T05:14:58.965377+0000","last_fullsized":"2024-01-22T05:14:58.965377+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3a","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.969927+0000","last_change":"2024-01-22T05:14:58.522579+0000","last_active":"2024-01-22T05:14:58.969927+0000","last_peered":"2024-01-22T05:14:58.969927+0000","last_clean":"2024-01-22T05:14:58.969927+0000","last_became_active":"2024-01-22T05:14:58.522279+0000","last_became_peered":"2024-01-22T05:14:58.522279+0000","last_unstale":"2024-01-22T05:14:58.969927+0000","last_undegraded":"2024-01-22T05:14:58.969927+0000","last_fullsized":"2024-01-22T05:14:58.969927+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.971137+0000","last_change":"2024-01-22T05:14:58.968592+0000","last_active":"2024-01-22T05:14:58.971137+0000","last_peered":"2024-01-22T05:14:58.971137+0000","last_clean":"2024-01-22T05:14:58.971137+0000","last_became_active":"2024-01-22T05:14:58.968328+0000","last_became_peered":"2024-01-22T05:14:58.968328+0000","last_unstale":"2024-01-22T05:14:58.971137+0000","last_undegraded":"2024-01-22T05:14:58.971137+0000","last_fullsized":"2024-01-22T05:14:58.971137+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.935476+0000","last_change":"2024-01-22T05:14:58.511060+0000","last_active":"2024-01-22T05:14:58.935476+0000","last_peered":"2024-01-22T05:14:58.935476+0000","last_clean":"2024-01-22T05:14:58.935476+0000","last_became_active":"2024-01-22T05:14:58.510783+0000","last_became_peered":"2024-01-22T05:14:58.510783+0000","last_unstale":"2024-01-22T05:14:58.935476+0000","last_undegraded":"2024-01-22T05:14:58.935476+0000","last_fullsized":"2024-01-22T05:14:58.935476+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965497+0000","last_change":"2024-01-22T05:14:58.954694+0000","last_active":"2024-01-22T05:14:58.965497+0000","last_peered":"2024-01-22T05:14:58.965497+0000","last_clean":"2024-01-22T05:14:58.965497+0000","last_became_active":"2024-01-22T05:14:58.954328+0000","last_became_peered":"2024-01-22T05:14:58.954328+0000","last_unstale":"2024-01-22T05:14:58.965497+0000","last_undegraded":"2024-01-22T05:14:58.965497+0000","last_fullsized":"2024-01-22T05:14:58.965497+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.952796+0000","last_change":"2024-01-22T05:14:58.517338+0000","last_active":"2024-01-22T05:14:58.952796+0000","last_peered":"2024-01-22T05:14:58.952796+0000","last_clean":"2024-01-22T05:14:58.952796+0000","last_became_active":"2024-01-22T05:14:58.517008+0000","last_became_peered":"2024-01-22T05:14:58.517008+0000","last_unstale":"2024-01-22T05:14:58.952796+0000","last_undegraded":"2024-01-22T05:14:58.952796+0000","last_fullsized":"2024-01-22T05:14:58.952796+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.968555+0000","last_change":"2024-01-22T05:14:58.959891+0000","last_active":"2024-01-22T05:14:58.968555+0000","last_peered":"2024-01-22T05:14:58.968555+0000","last_clean":"2024-01-22T05:14:58.968555+0000","last_became_active":"2024-01-22T05:14:58.959627+0000","last_became_peered":"2024-01-22T05:14:58.959627+0000","last_unstale":"2024-01-22T05:14:58.968555+0000","last_undegraded":"2024-01-22T05:14:58.968555+0000","last_fullsized":"2024-01-22T05:14:58.968555+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.945647+0000","last_change":"2024-01-22T05:14:58.513549+0000","last_active":"2024-01-22T05:14:58.945647+0000","last_peered":"2024-01-22T05:14:58.945647+0000","last_clean":"2024-01-22T05:14:58.945647+0000","last_became_active":"2024-01-22T05:14:58.511467+0000","last_became_peered":"2024-01-22T05:14:58.511467+0000","last_unstale":"2024-01-22T05:14:58.945647+0000","last_undegraded":"2024-01-22T05:14:58.945647+0000","last_fullsized":"2024-01-22T05:14:58.945647+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965358+0000","last_change":"2024-01-22T05:14:58.962162+0000","last_active":"2024-01-22T05:14:58.965358+0000","last_peered":"2024-01-22T05:14:58.965358+0000","last_clean":"2024-01-22T05:14:58.965358+0000","last_became_active":"2024-01-22T05:14:58.960760+0000","last_became_peered":"2024-01-22T05:14:58.960760+0000","last_unstale":"2024-01-22T05:14:58.965358+0000","last_undegraded":"2024-01-22T05:14:58.965358+0000","last_fullsized":"2024-01-22T05:14:58.965358+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.953194+0000","last_change":"2024-01-22T05:14:58.515373+0000","last_active":"2024-01-22T05:14:58.953194+0000","last_peered":"2024-01-22T05:14:58.953194+0000","last_clean":"2024-01-22T05:14:58.953194+0000","last_became_active":"2024-01-22T05:14:58.515096+0000","last_became_peered":"2024-01-22T05:14:58.515096+0000","last_unstale":"2024-01-22T05:14:58.953194+0000","last_undegraded":"2024-01-22T05:14:58.953194+0000","last_fullsized":"2024-01-22T05:14:58.953194+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.968110+0000","last_change":"2024-01-22T05:14:58.963663+0000","last_active":"2024-01-22T05:14:58.968110+0000","last_peered":"2024-01-22T05:14:58.968110+0000","last_clean":"2024-01-22T05:14:58.968110+0000","last_became_active":"2024-01-22T05:14:58.963380+0000","last_became_peered":"2024-01-22T05:14:58.963380+0000","last_unstale":"2024-01-22T05:14:58.968110+0000","last_undegraded":"2024-01-22T05:14:58.968110+0000","last_fullsized":"2024-01-22T05:14:58.968110+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.938772+0000","last_change":"2024-01-22T05:14:58.496184+0000","last_active":"2024-01-22T05:14:58.938772+0000","last_peered":"2024-01-22T05:14:58.938772+0000","last_clean":"2024-01-22T05:14:58.938772+0000","last_became_active":"2024-01-22T05:14:58.495840+0000","last_became_peered":"2024-01-22T05:14:58.495840+0000","last_unstale":"2024-01-22T05:14:58.938772+0000","last_undegraded":"2024-01-22T05:14:58.938772+0000","last_fullsized":"2024-01-22T05:14:58.938772+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.968321+0000","last_change":"2024-01-22T05:14:58.960521+0000","last_active":"2024-01-22T05:14:58.968321+0000","last_peered":"2024-01-22T05:14:58.968321+0000","last_clean":"2024-01-22T05:14:58.968321+0000","last_became_active":"2024-01-22T05:14:58.960232+0000","last_became_peered":"2024-01-22T05:14:58.960232+0000","last_unstale":"2024-01-22T05:14:58.968321+0000","last_undegraded":"2024-01-22T05:14:58.968321+0000","last_fullsized":"2024-01-22T05:14:58.968321+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.34","version":"130'4","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.978151+0000","last_change":"2024-01-22T05:14:58.513268+0000","last_active":"2024-01-22T05:14:58.978151+0000","last_peered":"2024-01-22T05:14:58.978151+0000","last_clean":"2024-01-22T05:14:58.978151+0000","last_became_active":"2024-01-22T05:14:58.512682+0000","last_became_peered":"2024-01-22T05:14:58.512682+0000","last_unstale":"2024-01-22T05:14:58.978151+0000","last_undegraded":"2024-01-22T05:14:58.978151+0000","last_fullsized":"2024-01-22T05:14:58.978151+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.972682+0000","last_change":"2024-01-22T05:14:58.971408+0000","last_active":"2024-01-22T05:14:58.972682+0000","last_peered":"2024-01-22T05:14:58.972682+0000","last_clean":"2024-01-22T05:14:58.972682+0000","last_became_active":"2024-01-22T05:14:58.971123+0000","last_became_peered":"2024-01-22T05:14:58.971123+0000","last_unstale":"2024-01-22T05:14:58.972682+0000","last_undegraded":"2024-01-22T05:14:58.972682+0000","last_fullsized":"2024-01-22T05:14:58.972682+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.966106+0000","last_change":"2024-01-22T05:14:58.507257+0000","last_active":"2024-01-22T05:14:58.966106+0000","last_peered":"2024-01-22T05:14:58.966106+0000","last_clean":"2024-01-22T05:14:58.966106+0000","last_became_active":"2024-01-22T05:14:58.506988+0000","last_became_peered":"2024-01-22T05:14:58.506988+0000","last_unstale":"2024-01-22T05:14:58.966106+0000","last_undegraded":"2024-01-22T05:14:58.966106+0000","last_fullsized":"2024-01-22T05:14:58.966106+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.977795+0000","last_change":"2024-01-22T05:14:58.970566+0000","last_active":"2024-01-22T05:14:58.977795+0000","last_peered":"2024-01-22T05:14:58.977795+0000","last_clean":"2024-01-22T05:14:58.977795+0000","last_became_active":"2024-01-22T05:14:58.970077+0000","last_became_peered":"2024-01-22T05:14:58.970077+0000","last_unstale":"2024-01-22T05:14:58.977795+0000","last_undegraded":"2024-01-22T05:14:58.977795+0000","last_fullsized":"2024-01-22T05:14:58.977795+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.950809+0000","last_change":"2024-01-22T05:14:58.517478+0000","last_active":"2024-01-22T05:14:58.950809+0000","last_peered":"2024-01-22T05:14:58.950809+0000","last_clean":"2024-01-22T05:14:58.950809+0000","last_became_active":"2024-01-22T05:14:58.517270+0000","last_became_peered":"2024-01-22T05:14:58.517270+0000","last_unstale":"2024-01-22T05:14:58.950809+0000","last_undegraded":"2024-01-22T05:14:58.950809+0000","last_fullsized":"2024-01-22T05:14:58.950809+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.979741+0000","last_change":"2024-01-22T05:14:58.978591+0000","last_active":"2024-01-22T05:14:58.979741+0000","last_peered":"2024-01-22T05:14:58.979741+0000","last_clean":"2024-01-22T05:14:58.979741+0000","last_became_active":"2024-01-22T05:14:58.975666+0000","last_became_peered":"2024-01-22T05:14:58.975666+0000","last_unstale":"2024-01-22T05:14:58.979741+0000","last_undegraded":"2024-01-22T05:14:58.979741+0000","last_fullsized":"2024-01-22T05:14:58.979741+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.938589+0000","last_change":"2024-01-22T05:14:58.496338+0000","last_active":"2024-01-22T05:14:58.938589+0000","last_peered":"2024-01-22T05:14:58.938589+0000","last_clean":"2024-01-22T05:14:58.938589+0000","last_became_active":"2024-01-22T05:14:58.496015+0000","last_became_peered":"2024-01-22T05:14:58.496015+0000","last_unstale":"2024-01-22T05:14:58.938589+0000","last_undegraded":"2024-01-22T05:14:58.938589+0000","last_fullsized":"2024-01-22T05:14:58.938589+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.974561+0000","last_change":"2024-01-22T05:14:58.960744+0000","last_active":"2024-01-22T05:14:58.974561+0000","last_peered":"2024-01-22T05:14:58.974561+0000","last_clean":"2024-01-22T05:14:58.974561+0000","last_became_active":"2024-01-22T05:14:58.960465+0000","last_became_peered":"2024-01-22T05:14:58.960465+0000","last_unstale":"2024-01-22T05:14:58.974561+0000","last_undegraded":"2024-01-22T05:14:58.974561+0000","last_fullsized":"2024-01-22T05:14:58.974561+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.30","version":"130'4","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.975794+0000","last_change":"2024-01-22T05:14:58.507031+0000","last_active":"2024-01-22T05:14:58.975794+0000","last_peered":"2024-01-22T05:14:58.975794+0000","last_clean":"2024-01-22T05:14:58.975794+0000","last_became_active":"2024-01-22T05:14:58.506766+0000","last_became_peered":"2024-01-22T05:14:58.506766+0000","last_unstale":"2024-01-22T05:14:58.975794+0000","last_undegraded":"2024-01-22T05:14:58.975794+0000","last_fullsized":"2024-01-22T05:14:58.975794+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.973269+0000","last_change":"2024-01-22T05:14:58.965433+0000","last_active":"2024-01-22T05:14:58.973269+0000","last_peered":"2024-01-22T05:14:58.973269+0000","last_clean":"2024-01-22T05:14:58.973269+0000","last_became_active":"2024-01-22T05:14:58.965174+0000","last_became_peered":"2024-01-22T05:14:58.965174+0000","last_unstale":"2024-01-22T05:14:58.973269+0000","last_undegraded":"2024-01-22T05:14:58.973269+0000","last_fullsized":"2024-01-22T05:14:58.973269+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.950274+0000","last_change":"2024-01-22T05:14:58.501500+0000","last_active":"2024-01-22T05:14:58.950274+0000","last_peered":"2024-01-22T05:14:58.950274+0000","last_clean":"2024-01-22T05:14:58.950274+0000","last_became_active":"2024-01-22T05:14:58.500327+0000","last_became_peered":"2024-01-22T05:14:58.500327+0000","last_unstale":"2024-01-22T05:14:58.950274+0000","last_undegraded":"2024-01-22T05:14:58.950274+0000","last_fullsized":"2024-01-22T05:14:58.950274+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.959560+0000","last_change":"2024-01-22T05:14:58.952907+0000","last_active":"2024-01-22T05:14:58.959560+0000","last_peered":"2024-01-22T05:14:58.959560+0000","last_clean":"2024-01-22T05:14:58.959560+0000","last_became_active":"2024-01-22T05:14:58.952601+0000","last_became_peered":"2024-01-22T05:14:58.952601+0000","last_unstale":"2024-01-22T05:14:58.959560+0000","last_undegraded":"2024-01-22T05:14:58.959560+0000","last_fullsized":"2024-01-22T05:14:58.959560+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.953501+0000","last_change":"2024-01-22T05:14:58.511528+0000","last_active":"2024-01-22T05:14:58.953501+0000","last_peered":"2024-01-22T05:14:58.953501+0000","last_clean":"2024-01-22T05:14:58.953501+0000","last_became_active":"2024-01-22T05:14:58.511249+0000","last_became_peered":"2024-01-22T05:14:58.511249+0000","last_unstale":"2024-01-22T05:14:58.953501+0000","last_undegraded":"2024-01-22T05:14:58.953501+0000","last_fullsized":"2024-01-22T05:14:58.953501+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.974135+0000","last_change":"2024-01-22T05:14:58.970598+0000","last_active":"2024-01-22T05:14:58.974135+0000","last_peered":"2024-01-22T05:14:58.974135+0000","last_clean":"2024-01-22T05:14:58.974135+0000","last_became_active":"2024-01-22T05:14:58.970241+0000","last_became_peered":"2024-01-22T05:14:58.970241+0000","last_unstale":"2024-01-22T05:14:58.974135+0000","last_undegraded":"2024-01-22T05:14:58.974135+0000","last_fullsized":"2024-01-22T05:14:58.974135+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.959832+0000","last_change":"2024-01-22T05:14:58.508820+0000","last_active":"2024-01-22T05:14:58.959832+0000","last_peered":"2024-01-22T05:14:58.959832+0000","last_clean":"2024-01-22T05:14:58.959832+0000","last_became_active":"2024-01-22T05:14:58.508554+0000","last_became_peered":"2024-01-22T05:14:58.508554+0000","last_unstale":"2024-01-22T05:14:58.959832+0000","last_undegraded":"2024-01-22T05:14:58.959832+0000","last_fullsized":"2024-01-22T05:14:58.959832+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.963908+0000","last_change":"2024-01-22T05:14:58.954573+0000","last_active":"2024-01-22T05:14:58.963908+0000","last_peered":"2024-01-22T05:14:58.963908+0000","last_clean":"2024-01-22T05:14:58.963908+0000","last_became_active":"2024-01-22T05:14:58.954273+0000","last_became_peered":"2024-01-22T05:14:58.954273+0000","last_unstale":"2024-01-22T05:14:58.963908+0000","last_undegraded":"2024-01-22T05:14:58.963908+0000","last_fullsized":"2024-01-22T05:14:58.963908+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.952882+0000","last_change":"2024-01-22T05:14:58.514152+0000","last_active":"2024-01-22T05:14:58.952882+0000","last_peered":"2024-01-22T05:14:58.952882+0000","last_clean":"2024-01-22T05:14:58.952882+0000","last_became_active":"2024-01-22T05:14:58.513862+0000","last_became_peered":"2024-01-22T05:14:58.513862+0000","last_unstale":"2024-01-22T05:14:58.952882+0000","last_undegraded":"2024-01-22T05:14:58.952882+0000","last_fullsized":"2024-01-22T05:14:58.952882+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.967048+0000","last_change":"2024-01-22T05:14:58.957112+0000","last_active":"2024-01-22T05:14:58.967048+0000","last_peered":"2024-01-22T05:14:58.967048+0000","last_clean":"2024-01-22T05:14:58.967048+0000","last_became_active":"2024-01-22T05:14:58.956821+0000","last_became_peered":"2024-01-22T05:14:58.956821+0000","last_unstale":"2024-01-22T05:14:58.967048+0000","last_undegraded":"2024-01-22T05:14:58.967048+0000","last_fullsized":"2024-01-22T05:14:58.967048+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2b","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970246+0000","last_change":"2024-01-22T05:14:58.513380+0000","last_active":"2024-01-22T05:14:58.970246+0000","last_peered":"2024-01-22T05:14:58.970246+0000","last_clean":"2024-01-22T05:14:58.970246+0000","last_became_active":"2024-01-22T05:14:58.509622+0000","last_became_peered":"2024-01-22T05:14:58.509622+0000","last_unstale":"2024-01-22T05:14:58.970246+0000","last_undegraded":"2024-01-22T05:14:58.970246+0000","last_fullsized":"2024-01-22T05:14:58.970246+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965396+0000","last_change":"2024-01-22T05:14:58.958600+0000","last_active":"2024-01-22T05:14:58.965396+0000","last_peered":"2024-01-22T05:14:58.965396+0000","last_clean":"2024-01-22T05:14:58.965396+0000","last_became_active":"2024-01-22T05:14:58.958221+0000","last_became_peered":"2024-01-22T05:14:58.958221+0000","last_unstale":"2024-01-22T05:14:58.965396+0000","last_undegraded":"2024-01-22T05:14:58.965396+0000","last_fullsized":"2024-01-22T05:14:58.965396+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.937506+0000","last_change":"2024-01-22T05:14:58.511853+0000","last_active":"2024-01-22T05:14:58.937506+0000","last_peered":"2024-01-22T05:14:58.937506+0000","last_clean":"2024-01-22T05:14:58.937506+0000","last_became_active":"2024-01-22T05:14:58.511445+0000","last_became_peered":"2024-01-22T05:14:58.511445+0000","last_unstale":"2024-01-22T05:14:58.937506+0000","last_undegraded":"2024-01-22T05:14:58.937506+0000","last_fullsized":"2024-01-22T05:14:58.937506+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.951801+0000","last_change":"2024-01-22T05:14:58.947697+0000","last_active":"2024-01-22T05:14:58.951801+0000","last_peered":"2024-01-22T05:14:58.951801+0000","last_clean":"2024-01-22T05:14:58.951801+0000","last_became_active":"2024-01-22T05:14:58.947373+0000","last_became_peered":"2024-01-22T05:14:58.947373+0000","last_unstale":"2024-01-22T05:14:58.951801+0000","last_undegraded":"2024-01-22T05:14:58.951801+0000","last_fullsized":"2024-01-22T05:14:58.951801+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.944611+0000","last_change":"2024-01-22T05:14:58.518890+0000","last_active":"2024-01-22T05:14:58.944611+0000","last_peered":"2024-01-22T05:14:58.944611+0000","last_clean":"2024-01-22T05:14:58.944611+0000","last_became_active":"2024-01-22T05:14:58.518481+0000","last_became_peered":"2024-01-22T05:14:58.518481+0000","last_unstale":"2024-01-22T05:14:58.944611+0000","last_undegraded":"2024-01-22T05:14:58.944611+0000","last_fullsized":"2024-01-22T05:14:58.944611+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.964483+0000","last_change":"2024-01-22T05:14:58.961513+0000","last_active":"2024-01-22T05:14:58.964483+0000","last_peered":"2024-01-22T05:14:58.964483+0000","last_clean":"2024-01-22T05:14:58.964483+0000","last_became_active":"2024-01-22T05:14:58.961243+0000","last_became_peered":"2024-01-22T05:14:58.961243+0000","last_unstale":"2024-01-22T05:14:58.964483+0000","last_undegraded":"2024-01-22T05:14:58.964483+0000","last_fullsized":"2024-01-22T05:14:58.964483+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.934411+0000","last_change":"2024-01-22T05:14:58.505313+0000","last_active":"2024-01-22T05:14:58.934411+0000","last_peered":"2024-01-22T05:14:58.934411+0000","last_clean":"2024-01-22T05:14:58.934411+0000","last_became_active":"2024-01-22T05:14:58.504789+0000","last_became_peered":"2024-01-22T05:14:58.504789+0000","last_unstale":"2024-01-22T05:14:58.934411+0000","last_undegraded":"2024-01-22T05:14:58.934411+0000","last_fullsized":"2024-01-22T05:14:58.934411+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.979974+0000","last_change":"2024-01-22T05:14:58.979125+0000","last_active":"2024-01-22T05:14:58.979974+0000","last_peered":"2024-01-22T05:14:58.979974+0000","last_clean":"2024-01-22T05:14:58.979974+0000","last_became_active":"2024-01-22T05:14:58.977742+0000","last_became_peered":"2024-01-22T05:14:58.977742+0000","last_unstale":"2024-01-22T05:14:58.979974+0000","last_undegraded":"2024-01-22T05:14:58.979974+0000","last_fullsized":"2024-01-22T05:14:58.979974+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.937340+0000","last_change":"2024-01-22T05:14:58.505393+0000","last_active":"2024-01-22T05:14:58.937340+0000","last_peered":"2024-01-22T05:14:58.937340+0000","last_clean":"2024-01-22T05:14:58.937340+0000","last_became_active":"2024-01-22T05:14:58.504880+0000","last_became_peered":"2024-01-22T05:14:58.504880+0000","last_unstale":"2024-01-22T05:14:58.937340+0000","last_undegraded":"2024-01-22T05:14:58.937340+0000","last_fullsized":"2024-01-22T05:14:58.937340+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.971522+0000","last_change":"2024-01-22T05:14:58.962100+0000","last_active":"2024-01-22T05:14:58.971522+0000","last_peered":"2024-01-22T05:14:58.971522+0000","last_clean":"2024-01-22T05:14:58.971522+0000","last_became_active":"2024-01-22T05:14:58.961759+0000","last_became_peered":"2024-01-22T05:14:58.961759+0000","last_unstale":"2024-01-22T05:14:58.971522+0000","last_undegraded":"2024-01-22T05:14:58.971522+0000","last_fullsized":"2024-01-22T05:14:58.971522+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.953000+0000","last_change":"2024-01-22T05:14:58.520535+0000","last_active":"2024-01-22T05:14:58.953000+0000","last_peered":"2024-01-22T05:14:58.953000+0000","last_clean":"2024-01-22T05:14:58.953000+0000","last_became_active":"2024-01-22T05:14:58.520242+0000","last_became_peered":"2024-01-22T05:14:58.520242+0000","last_unstale":"2024-01-22T05:14:58.953000+0000","last_undegraded":"2024-01-22T05:14:58.953000+0000","last_fullsized":"2024-01-22T05:14:58.953000+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970912+0000","last_change":"2024-01-22T05:14:58.969089+0000","last_active":"2024-01-22T05:14:58.970912+0000","last_peered":"2024-01-22T05:14:58.970912+0000","last_clean":"2024-01-22T05:14:58.970912+0000","last_became_active":"2024-01-22T05:14:58.968788+0000","last_became_peered":"2024-01-22T05:14:58.968788+0000","last_unstale":"2024-01-22T05:14:58.970912+0000","last_undegraded":"2024-01-22T05:14:58.970912+0000","last_fullsized":"2024-01-22T05:14:58.970912+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.944439+0000","last_change":"2024-01-22T05:14:58.508652+0000","last_active":"2024-01-22T05:14:58.944439+0000","last_peered":"2024-01-22T05:14:58.944439+0000","last_clean":"2024-01-22T05:14:58.944439+0000","last_became_active":"2024-01-22T05:14:58.508221+0000","last_became_peered":"2024-01-22T05:14:58.508221+0000","last_unstale":"2024-01-22T05:14:58.944439+0000","last_undegraded":"2024-01-22T05:14:58.944439+0000","last_fullsized":"2024-01-22T05:14:58.944439+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.975346+0000","last_change":"2024-01-22T05:14:58.962101+0000","last_active":"2024-01-22T05:14:58.975346+0000","last_peered":"2024-01-22T05:14:58.975346+0000","last_clean":"2024-01-22T05:14:58.975346+0000","last_became_active":"2024-01-22T05:14:58.961844+0000","last_became_peered":"2024-01-22T05:14:58.961844+0000","last_unstale":"2024-01-22T05:14:58.975346+0000","last_undegraded":"2024-01-22T05:14:58.975346+0000","last_fullsized":"2024-01-22T05:14:58.975346+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.937407+0000","last_change":"2024-01-22T05:14:58.513091+0000","last_active":"2024-01-22T05:14:58.937407+0000","last_peered":"2024-01-22T05:14:58.937407+0000","last_clean":"2024-01-22T05:14:58.937407+0000","last_became_active":"2024-01-22T05:14:58.512371+0000","last_became_peered":"2024-01-22T05:14:58.512371+0000","last_unstale":"2024-01-22T05:14:58.937407+0000","last_undegraded":"2024-01-22T05:14:58.937407+0000","last_fullsized":"2024-01-22T05:14:58.937407+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.977613+0000","last_change":"2024-01-22T05:14:58.965163+0000","last_active":"2024-01-22T05:14:58.977613+0000","last_peered":"2024-01-22T05:14:58.977613+0000","last_clean":"2024-01-22T05:14:58.977613+0000","last_became_active":"2024-01-22T05:14:58.964566+0000","last_became_peered":"2024-01-22T05:14:58.964566+0000","last_unstale":"2024-01-22T05:14:58.977613+0000","last_undegraded":"2024-01-22T05:14:58.977613+0000","last_fullsized":"2024-01-22T05:14:58.977613+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.953732+0000","last_change":"2024-01-22T05:14:58.518663+0000","last_active":"2024-01-22T05:14:58.953732+0000","last_peered":"2024-01-22T05:14:58.953732+0000","last_clean":"2024-01-22T05:14:58.953732+0000","last_became_active":"2024-01-22T05:14:58.518309+0000","last_became_peered":"2024-01-22T05:14:58.518309+0000","last_unstale":"2024-01-22T05:14:58.953732+0000","last_undegraded":"2024-01-22T05:14:58.953732+0000","last_fullsized":"2024-01-22T05:14:58.953732+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.977772+0000","last_change":"2024-01-22T05:14:58.970343+0000","last_active":"2024-01-22T05:14:58.977772+0000","last_peered":"2024-01-22T05:14:58.977772+0000","last_clean":"2024-01-22T05:14:58.977772+0000","last_became_active":"2024-01-22T05:14:58.969778+0000","last_became_peered":"2024-01-22T05:14:58.969778+0000","last_unstale":"2024-01-22T05:14:58.977772+0000","last_undegraded":"2024-01-22T05:14:58.977772+0000","last_fullsized":"2024-01-22T05:14:58.977772+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.950919+0000","last_change":"2024-01-22T05:14:58.510006+0000","last_active":"2024-01-22T05:14:58.950919+0000","last_peered":"2024-01-22T05:14:58.950919+0000","last_clean":"2024-01-22T05:14:58.950919+0000","last_became_active":"2024-01-22T05:14:58.509717+0000","last_became_peered":"2024-01-22T05:14:58.509717+0000","last_unstale":"2024-01-22T05:14:58.950919+0000","last_undegraded":"2024-01-22T05:14:58.950919+0000","last_fullsized":"2024-01-22T05:14:58.950919+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970173+0000","last_change":"2024-01-22T05:14:58.963869+0000","last_active":"2024-01-22T05:14:58.970173+0000","last_peered":"2024-01-22T05:14:58.970173+0000","last_clean":"2024-01-22T05:14:58.970173+0000","last_became_active":"2024-01-22T05:14:58.963322+0000","last_became_peered":"2024-01-22T05:14:58.963322+0000","last_unstale":"2024-01-22T05:14:58.970173+0000","last_undegraded":"2024-01-22T05:14:58.970173+0000","last_fullsized":"2024-01-22T05:14:58.970173+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.934167+0000","last_change":"2024-01-22T05:14:58.503052+0000","last_active":"2024-01-22T05:14:58.934167+0000","last_peered":"2024-01-22T05:14:58.934167+0000","last_clean":"2024-01-22T05:14:58.934167+0000","last_became_active":"2024-01-22T05:14:58.502772+0000","last_became_peered":"2024-01-22T05:14:58.502772+0000","last_unstale":"2024-01-22T05:14:58.934167+0000","last_undegraded":"2024-01-22T05:14:58.934167+0000","last_fullsized":"2024-01-22T05:14:58.934167+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970559+0000","last_change":"2024-01-22T05:14:58.968564+0000","last_active":"2024-01-22T05:14:58.970559+0000","last_peered":"2024-01-22T05:14:58.970559+0000","last_clean":"2024-01-22T05:14:58.970559+0000","last_became_active":"2024-01-22T05:14:58.968101+0000","last_became_peered":"2024-01-22T05:14:58.968101+0000","last_unstale":"2024-01-22T05:14:58.970559+0000","last_undegraded":"2024-01-22T05:14:58.970559+0000","last_fullsized":"2024-01-22T05:14:58.970559+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.934534+0000","last_change":"2024-01-22T05:14:58.509898+0000","last_active":"2024-01-22T05:14:58.934534+0000","last_peered":"2024-01-22T05:14:58.934534+0000","last_clean":"2024-01-22T05:14:58.934534+0000","last_became_active":"2024-01-22T05:14:58.509463+0000","last_became_peered":"2024-01-22T05:14:58.509463+0000","last_unstale":"2024-01-22T05:14:58.934534+0000","last_undegraded":"2024-01-22T05:14:58.934534+0000","last_fullsized":"2024-01-22T05:14:58.934534+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.973249+0000","last_change":"2024-01-22T05:14:58.964923+0000","last_active":"2024-01-22T05:14:58.973249+0000","last_peered":"2024-01-22T05:14:58.973249+0000","last_clean":"2024-01-22T05:14:58.973249+0000","last_became_active":"2024-01-22T05:14:58.964619+0000","last_became_peered":"2024-01-22T05:14:58.964619+0000","last_unstale":"2024-01-22T05:14:58.973249+0000","last_undegraded":"2024-01-22T05:14:58.973249+0000","last_fullsized":"2024-01-22T05:14:58.973249+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.971512+0000","last_change":"2024-01-22T05:14:58.510741+0000","last_active":"2024-01-22T05:14:58.971512+0000","last_peered":"2024-01-22T05:14:58.971512+0000","last_clean":"2024-01-22T05:14:58.971512+0000","last_became_active":"2024-01-22T05:14:58.510384+0000","last_became_peered":"2024-01-22T05:14:58.510384+0000","last_unstale":"2024-01-22T05:14:58.971512+0000","last_undegraded":"2024-01-22T05:14:58.971512+0000","last_fullsized":"2024-01-22T05:14:58.971512+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970730+0000","last_change":"2024-01-22T05:14:58.967863+0000","last_active":"2024-01-22T05:14:58.970730+0000","last_peered":"2024-01-22T05:14:58.970730+0000","last_clean":"2024-01-22T05:14:58.970730+0000","last_became_active":"2024-01-22T05:14:58.967568+0000","last_became_peered":"2024-01-22T05:14:58.967568+0000","last_unstale":"2024-01-22T05:14:58.970730+0000","last_undegraded":"2024-01-22T05:14:58.970730+0000","last_fullsized":"2024-01-22T05:14:58.970730+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.954987+0000","last_change":"2024-01-22T05:14:58.511538+0000","last_active":"2024-01-22T05:14:58.954987+0000","last_peered":"2024-01-22T05:14:58.954987+0000","last_clean":"2024-01-22T05:14:58.954987+0000","last_became_active":"2024-01-22T05:14:58.511261+0000","last_became_peered":"2024-01-22T05:14:58.511261+0000","last_unstale":"2024-01-22T05:14:58.954987+0000","last_undegraded":"2024-01-22T05:14:58.954987+0000","last_fullsized":"2024-01-22T05:14:58.954987+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.966067+0000","last_change":"2024-01-22T05:14:58.961638+0000","last_active":"2024-01-22T05:14:58.966067+0000","last_peered":"2024-01-22T05:14:58.966067+0000","last_clean":"2024-01-22T05:14:58.966067+0000","last_became_active":"2024-01-22T05:14:58.961376+0000","last_became_peered":"2024-01-22T05:14:58.961376+0000","last_unstale":"2024-01-22T05:14:58.966067+0000","last_undegraded":"2024-01-22T05:14:58.966067+0000","last_fullsized":"2024-01-22T05:14:58.966067+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"130'2","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970049+0000","last_change":"2024-01-22T05:14:58.522574+0000","last_active":"2024-01-22T05:14:58.970049+0000","last_peered":"2024-01-22T05:14:58.970049+0000","last_clean":"2024-01-22T05:14:58.970049+0000","last_became_active":"2024-01-22T05:14:58.522183+0000","last_became_peered":"2024-01-22T05:14:58.522183+0000","last_unstale":"2024-01-22T05:14:58.970049+0000","last_undegraded":"2024-01-22T05:14:58.970049+0000","last_fullsized":"2024-01-22T05:14:58.970049+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965702+0000","last_change":"2024-01-22T05:14:58.962492+0000","last_active":"2024-01-22T05:14:58.965702+0000","last_peered":"2024-01-22T05:14:58.965702+0000","last_clean":"2024-01-22T05:14:58.965702+0000","last_became_active":"2024-01-22T05:14:58.961997+0000","last_became_peered":"2024-01-22T05:14:58.961997+0000","last_unstale":"2024-01-22T05:14:58.965702+0000","last_undegraded":"2024-01-22T05:14:58.965702+0000","last_fullsized":"2024-01-22T05:14:58.965702+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.950228+0000","last_change":"2024-01-22T05:14:58.515963+0000","last_active":"2024-01-22T05:14:58.950228+0000","last_peered":"2024-01-22T05:14:58.950228+0000","last_clean":"2024-01-22T05:14:58.950228+0000","last_became_active":"2024-01-22T05:14:58.515685+0000","last_became_peered":"2024-01-22T05:14:58.515685+0000","last_unstale":"2024-01-22T05:14:58.950228+0000","last_undegraded":"2024-01-22T05:14:58.950228+0000","last_fullsized":"2024-01-22T05:14:58.950228+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.973906+0000","last_change":"2024-01-22T05:14:58.968710+0000","last_active":"2024-01-22T05:14:58.973906+0000","last_peered":"2024-01-22T05:14:58.973906+0000","last_clean":"2024-01-22T05:14:58.973906+0000","last_became_active":"2024-01-22T05:14:58.968439+0000","last_became_peered":"2024-01-22T05:14:58.968439+0000","last_unstale":"2024-01-22T05:14:58.973906+0000","last_undegraded":"2024-01-22T05:14:58.973906+0000","last_fullsized":"2024-01-22T05:14:58.973906+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.951992+0000","last_change":"2024-01-22T05:14:58.518625+0000","last_active":"2024-01-22T05:14:58.951992+0000","last_peered":"2024-01-22T05:14:58.951992+0000","last_clean":"2024-01-22T05:14:58.951992+0000","last_became_active":"2024-01-22T05:14:58.518358+0000","last_became_peered":"2024-01-22T05:14:58.518358+0000","last_unstale":"2024-01-22T05:14:58.951992+0000","last_undegraded":"2024-01-22T05:14:58.951992+0000","last_fullsized":"2024-01-22T05:14:58.951992+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.954833+0000","last_change":"2024-01-22T05:14:58.947003+0000","last_active":"2024-01-22T05:14:58.954833+0000","last_peered":"2024-01-22T05:14:58.954833+0000","last_clean":"2024-01-22T05:14:58.954833+0000","last_became_active":"2024-01-22T05:14:58.946704+0000","last_became_peered":"2024-01-22T05:14:58.946704+0000","last_unstale":"2024-01-22T05:14:58.954833+0000","last_undegraded":"2024-01-22T05:14:58.954833+0000","last_fullsized":"2024-01-22T05:14:58.954833+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.951007+0000","last_change":"2024-01-22T05:14:58.505910+0000","last_active":"2024-01-22T05:14:58.951007+0000","last_peered":"2024-01-22T05:14:58.951007+0000","last_clean":"2024-01-22T05:14:58.951007+0000","last_became_active":"2024-01-22T05:14:58.505393+0000","last_became_peered":"2024-01-22T05:14:58.505393+0000","last_unstale":"2024-01-22T05:14:58.951007+0000","last_undegraded":"2024-01-22T05:14:58.951007+0000","last_fullsized":"2024-01-22T05:14:58.951007+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.971126+0000","last_change":"2024-01-22T05:14:58.968587+0000","last_active":"2024-01-22T05:14:58.971126+0000","last_peered":"2024-01-22T05:14:58.971126+0000","last_clean":"2024-01-22T05:14:58.971126+0000","last_became_active":"2024-01-22T05:14:58.966395+0000","last_became_peered":"2024-01-22T05:14:58.966395+0000","last_unstale":"2024-01-22T05:14:58.971126+0000","last_undegraded":"2024-01-22T05:14:58.971126+0000","last_fullsized":"2024-01-22T05:14:58.971126+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.938655+0000","last_change":"2024-01-22T05:14:58.508944+0000","last_active":"2024-01-22T05:14:58.938655+0000","last_peered":"2024-01-22T05:14:58.938655+0000","last_clean":"2024-01-22T05:14:58.938655+0000","last_became_active":"2024-01-22T05:14:58.508671+0000","last_became_peered":"2024-01-22T05:14:58.508671+0000","last_unstale":"2024-01-22T05:14:58.938655+0000","last_undegraded":"2024-01-22T05:14:58.938655+0000","last_fullsized":"2024-01-22T05:14:58.938655+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.972661+0000","last_change":"2024-01-22T05:14:58.969478+0000","last_active":"2024-01-22T05:14:58.972661+0000","last_peered":"2024-01-22T05:14:58.972661+0000","last_clean":"2024-01-22T05:14:58.972661+0000","last_became_active":"2024-01-22T05:14:58.969160+0000","last_became_peered":"2024-01-22T05:14:58.969160+0000","last_unstale":"2024-01-22T05:14:58.972661+0000","last_undegraded":"2024-01-22T05:14:58.972661+0000","last_fullsized":"2024-01-22T05:14:58.972661+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.949085+0000","last_change":"2024-01-22T05:14:58.509898+0000","last_active":"2024-01-22T05:14:58.949085+0000","last_peered":"2024-01-22T05:14:58.949085+0000","last_clean":"2024-01-22T05:14:58.949085+0000","last_became_active":"2024-01-22T05:14:58.509605+0000","last_became_peered":"2024-01-22T05:14:58.509605+0000","last_unstale":"2024-01-22T05:14:58.949085+0000","last_undegraded":"2024-01-22T05:14:58.949085+0000","last_fullsized":"2024-01-22T05:14:58.949085+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970003+0000","last_change":"2024-01-22T05:14:58.967117+0000","last_active":"2024-01-22T05:14:58.970003+0000","last_peered":"2024-01-22T05:14:58.970003+0000","last_clean":"2024-01-22T05:14:58.970003+0000","last_became_active":"2024-01-22T05:14:58.966816+0000","last_became_peered":"2024-01-22T05:14:58.966816+0000","last_unstale":"2024-01-22T05:14:58.970003+0000","last_undegraded":"2024-01-22T05:14:58.970003+0000","last_fullsized":"2024-01-22T05:14:58.970003+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.961028+0000","last_change":"2024-01-22T05:14:58.507527+0000","last_active":"2024-01-22T05:14:58.961028+0000","last_peered":"2024-01-22T05:14:58.961028+0000","last_clean":"2024-01-22T05:14:58.961028+0000","last_became_active":"2024-01-22T05:14:58.507191+0000","last_became_peered":"2024-01-22T05:14:58.507191+0000","last_unstale":"2024-01-22T05:14:58.961028+0000","last_undegraded":"2024-01-22T05:14:58.961028+0000","last_fullsized":"2024-01-22T05:14:58.961028+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.954278+0000","last_change":"2024-01-22T05:14:58.950882+0000","last_active":"2024-01-22T05:14:58.954278+0000","last_peered":"2024-01-22T05:14:58.954278+0000","last_clean":"2024-01-22T05:14:58.954278+0000","last_became_active":"2024-01-22T05:14:58.950565+0000","last_became_peered":"2024-01-22T05:14:58.950565+0000","last_unstale":"2024-01-22T05:14:58.954278+0000","last_undegraded":"2024-01-22T05:14:58.954278+0000","last_fullsized":"2024-01-22T05:14:58.954278+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"130'2","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.967591+0000","last_change":"2024-01-22T05:14:58.514487+0000","last_active":"2024-01-22T05:14:58.967591+0000","last_peered":"2024-01-22T05:14:58.967591+0000","last_clean":"2024-01-22T05:14:58.967591+0000","last_became_active":"2024-01-22T05:14:58.514191+0000","last_became_peered":"2024-01-22T05:14:58.514191+0000","last_unstale":"2024-01-22T05:14:58.967591+0000","last_undegraded":"2024-01-22T05:14:58.967591+0000","last_fullsized":"2024-01-22T05:14:58.967591+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.979690+0000","last_change":"2024-01-22T05:14:58.978160+0000","last_active":"2024-01-22T05:14:58.979690+0000","last_peered":"2024-01-22T05:14:58.979690+0000","last_clean":"2024-01-22T05:14:58.979690+0000","last_became_active":"2024-01-22T05:14:58.977903+0000","last_became_peered":"2024-01-22T05:14:58.977903+0000","last_unstale":"2024-01-22T05:14:58.979690+0000","last_undegraded":"2024-01-22T05:14:58.979690+0000","last_fullsized":"2024-01-22T05:14:58.979690+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.938802+0000","last_change":"2024-01-22T05:14:58.513546+0000","last_active":"2024-01-22T05:14:58.938802+0000","last_peered":"2024-01-22T05:14:58.938802+0000","last_clean":"2024-01-22T05:14:58.938802+0000","last_became_active":"2024-01-22T05:14:58.513269+0000","last_became_peered":"2024-01-22T05:14:58.513269+0000","last_unstale":"2024-01-22T05:14:58.938802+0000","last_undegraded":"2024-01-22T05:14:58.938802+0000","last_fullsized":"2024-01-22T05:14:58.938802+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.971103+0000","last_change":"2024-01-22T05:14:58.966764+0000","last_active":"2024-01-22T05:14:58.971103+0000","last_peered":"2024-01-22T05:14:58.971103+0000","last_clean":"2024-01-22T05:14:58.971103+0000","last_became_active":"2024-01-22T05:14:58.966465+0000","last_became_peered":"2024-01-22T05:14:58.966465+0000","last_unstale":"2024-01-22T05:14:58.971103+0000","last_undegraded":"2024-01-22T05:14:58.971103+0000","last_fullsized":"2024-01-22T05:14:58.971103+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.935125+0000","last_change":"2024-01-22T05:14:58.512528+0000","last_active":"2024-01-22T05:14:58.935125+0000","last_peered":"2024-01-22T05:14:58.935125+0000","last_clean":"2024-01-22T05:14:58.935125+0000","last_became_active":"2024-01-22T05:14:58.511991+0000","last_became_peered":"2024-01-22T05:14:58.511991+0000","last_unstale":"2024-01-22T05:14:58.935125+0000","last_undegraded":"2024-01-22T05:14:58.935125+0000","last_fullsized":"2024-01-22T05:14:58.935125+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.974364+0000","last_change":"2024-01-22T05:14:58.962016+0000","last_active":"2024-01-22T05:14:58.974364+0000","last_peered":"2024-01-22T05:14:58.974364+0000","last_clean":"2024-01-22T05:14:58.974364+0000","last_became_active":"2024-01-22T05:14:58.961746+0000","last_became_peered":"2024-01-22T05:14:58.961746+0000","last_unstale":"2024-01-22T05:14:58.974364+0000","last_undegraded":"2024-01-22T05:14:58.974364+0000","last_fullsized":"2024-01-22T05:14:58.974364+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.966150+0000","last_change":"2024-01-22T05:14:58.499286+0000","last_active":"2024-01-22T05:14:58.966150+0000","last_peered":"2024-01-22T05:14:58.966150+0000","last_clean":"2024-01-22T05:14:58.966150+0000","last_became_active":"2024-01-22T05:14:58.498934+0000","last_became_peered":"2024-01-22T05:14:58.498934+0000","last_unstale":"2024-01-22T05:14:58.966150+0000","last_undegraded":"2024-01-22T05:14:58.966150+0000","last_fullsized":"2024-01-22T05:14:58.966150+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.969418+0000","last_change":"2024-01-22T05:14:58.959799+0000","last_active":"2024-01-22T05:14:58.969418+0000","last_peered":"2024-01-22T05:14:58.969418+0000","last_clean":"2024-01-22T05:14:58.969418+0000","last_became_active":"2024-01-22T05:14:58.959146+0000","last_became_peered":"2024-01-22T05:14:58.959146+0000","last_unstale":"2024-01-22T05:14:58.969418+0000","last_undegraded":"2024-01-22T05:14:58.969418+0000","last_fullsized":"2024-01-22T05:14:58.969418+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.951101+0000","last_change":"2024-01-22T05:14:58.517714+0000","last_active":"2024-01-22T05:14:58.951101+0000","last_peered":"2024-01-22T05:14:58.951101+0000","last_clean":"2024-01-22T05:14:58.951101+0000","last_became_active":"2024-01-22T05:14:58.516092+0000","last_became_peered":"2024-01-22T05:14:58.516092+0000","last_unstale":"2024-01-22T05:14:58.951101+0000","last_undegraded":"2024-01-22T05:14:58.951101+0000","last_fullsized":"2024-01-22T05:14:58.951101+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.966103+0000","last_change":"2024-01-22T05:14:58.956399+0000","last_active":"2024-01-22T05:14:58.966103+0000","last_peered":"2024-01-22T05:14:58.966103+0000","last_clean":"2024-01-22T05:14:58.966103+0000","last_became_active":"2024-01-22T05:14:58.956101+0000","last_became_peered":"2024-01-22T05:14:58.956101+0000","last_unstale":"2024-01-22T05:14:58.966103+0000","last_undegraded":"2024-01-22T05:14:58.966103+0000","last_fullsized":"2024-01-22T05:14:58.966103+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.951415+0000","last_change":"2024-01-22T05:14:58.505070+0000","last_active":"2024-01-22T05:14:58.951415+0000","last_peered":"2024-01-22T05:14:58.951415+0000","last_clean":"2024-01-22T05:14:58.951415+0000","last_became_active":"2024-01-22T05:14:58.504744+0000","last_became_peered":"2024-01-22T05:14:58.504744+0000","last_unstale":"2024-01-22T05:14:58.951415+0000","last_undegraded":"2024-01-22T05:14:58.951415+0000","last_fullsized":"2024-01-22T05:14:58.951415+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970538+0000","last_change":"2024-01-22T05:14:58.968380+0000","last_active":"2024-01-22T05:14:58.970538+0000","last_peered":"2024-01-22T05:14:58.970538+0000","last_clean":"2024-01-22T05:14:58.970538+0000","last_became_active":"2024-01-22T05:14:58.967708+0000","last_became_peered":"2024-01-22T05:14:58.967708+0000","last_unstale":"2024-01-22T05:14:58.970538+0000","last_undegraded":"2024-01-22T05:14:58.970538+0000","last_fullsized":"2024-01-22T05:14:58.970538+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.935728+0000","last_change":"2024-01-22T05:14:58.515228+0000","last_active":"2024-01-22T05:14:58.935728+0000","last_peered":"2024-01-22T05:14:58.935728+0000","last_clean":"2024-01-22T05:14:58.935728+0000","last_became_active":"2024-01-22T05:14:58.514951+0000","last_became_peered":"2024-01-22T05:14:58.514951+0000","last_unstale":"2024-01-22T05:14:58.935728+0000","last_undegraded":"2024-01-22T05:14:58.935728+0000","last_fullsized":"2024-01-22T05:14:58.935728+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.947955+0000","last_change":"2024-01-22T05:14:58.941930+0000","last_active":"2024-01-22T05:14:58.947955+0000","last_peered":"2024-01-22T05:14:58.947955+0000","last_clean":"2024-01-22T05:14:58.947955+0000","last_became_active":"2024-01-22T05:14:58.941612+0000","last_became_peered":"2024-01-22T05:14:58.941612+0000","last_unstale":"2024-01-22T05:14:58.947955+0000","last_undegraded":"2024-01-22T05:14:58.947955+0000","last_fullsized":"2024-01-22T05:14:58.947955+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"130'2","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.975969+0000","last_change":"2024-01-22T05:14:58.510233+0000","last_active":"2024-01-22T05:14:58.975969+0000","last_peered":"2024-01-22T05:14:58.975969+0000","last_clean":"2024-01-22T05:14:58.975969+0000","last_became_active":"2024-01-22T05:14:58.507555+0000","last_became_peered":"2024-01-22T05:14:58.507555+0000","last_unstale":"2024-01-22T05:14:58.975969+0000","last_undegraded":"2024-01-22T05:14:58.975969+0000","last_fullsized":"2024-01-22T05:14:58.975969+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.977834+0000","last_change":"2024-01-22T05:14:58.965627+0000","last_active":"2024-01-22T05:14:58.977834+0000","last_peered":"2024-01-22T05:14:58.977834+0000","last_clean":"2024-01-22T05:14:58.977834+0000","last_became_active":"2024-01-22T05:14:58.964961+0000","last_became_peered":"2024-01-22T05:14:58.964961+0000","last_unstale":"2024-01-22T05:14:58.977834+0000","last_undegraded":"2024-01-22T05:14:58.977834+0000","last_fullsized":"2024-01-22T05:14:58.977834+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.947715+0000","last_change":"2024-01-22T05:14:58.516775+0000","last_active":"2024-01-22T05:14:58.947715+0000","last_peered":"2024-01-22T05:14:58.947715+0000","last_clean":"2024-01-22T05:14:58.947715+0000","last_became_active":"2024-01-22T05:14:58.515517+0000","last_became_peered":"2024-01-22T05:14:58.515517+0000","last_unstale":"2024-01-22T05:14:58.947715+0000","last_undegraded":"2024-01-22T05:14:58.947715+0000","last_fullsized":"2024-01-22T05:14:58.947715+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970960+0000","last_change":"2024-01-22T05:14:58.962486+0000","last_active":"2024-01-22T05:14:58.970960+0000","last_peered":"2024-01-22T05:14:58.970960+0000","last_clean":"2024-01-22T05:14:58.970960+0000","last_became_active":"2024-01-22T05:14:58.960390+0000","last_became_peered":"2024-01-22T05:14:58.960390+0000","last_unstale":"2024-01-22T05:14:58.970960+0000","last_undegraded":"2024-01-22T05:14:58.970960+0000","last_fullsized":"2024-01-22T05:14:58.970960+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.950363+0000","last_change":"2024-01-22T05:14:58.509026+0000","last_active":"2024-01-22T05:14:58.950363+0000","last_peered":"2024-01-22T05:14:58.950363+0000","last_clean":"2024-01-22T05:14:58.950363+0000","last_became_active":"2024-01-22T05:14:58.507991+0000","last_became_peered":"2024-01-22T05:14:58.507991+0000","last_unstale":"2024-01-22T05:14:58.950363+0000","last_undegraded":"2024-01-22T05:14:58.950363+0000","last_fullsized":"2024-01-22T05:14:58.950363+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.969084+0000","last_change":"2024-01-22T05:14:58.958194+0000","last_active":"2024-01-22T05:14:58.969084+0000","last_peered":"2024-01-22T05:14:58.969084+0000","last_clean":"2024-01-22T05:14:58.969084+0000","last_became_active":"2024-01-22T05:14:58.957933+0000","last_became_peered":"2024-01-22T05:14:58.957933+0000","last_unstale":"2024-01-22T05:14:58.969084+0000","last_undegraded":"2024-01-22T05:14:58.969084+0000","last_fullsized":"2024-01-22T05:14:58.969084+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.939979+0000","last_change":"2024-01-22T05:14:58.523320+0000","last_active":"2024-01-22T05:14:58.939979+0000","last_peered":"2024-01-22T05:14:58.939979+0000","last_clean":"2024-01-22T05:14:58.939979+0000","last_became_active":"2024-01-22T05:14:58.522642+0000","last_became_peered":"2024-01-22T05:14:58.522642+0000","last_unstale":"2024-01-22T05:14:58.939979+0000","last_undegraded":"2024-01-22T05:14:58.939979+0000","last_fullsized":"2024-01-22T05:14:58.939979+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965606+0000","last_change":"2024-01-22T05:14:58.960741+0000","last_active":"2024-01-22T05:14:58.965606+0000","last_peered":"2024-01-22T05:14:58.965606+0000","last_clean":"2024-01-22T05:14:58.965606+0000","last_became_active":"2024-01-22T05:14:58.960417+0000","last_became_peered":"2024-01-22T05:14:58.960417+0000","last_unstale":"2024-01-22T05:14:58.965606+0000","last_undegraded":"2024-01-22T05:14:58.965606+0000","last_fullsized":"2024-01-22T05:14:58.965606+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.952081+0000","last_change":"2024-01-22T05:14:58.516217+0000","last_active":"2024-01-22T05:14:58.952081+0000","last_peered":"2024-01-22T05:14:58.952081+0000","last_clean":"2024-01-22T05:14:58.952081+0000","last_became_active":"2024-01-22T05:14:58.515911+0000","last_became_peered":"2024-01-22T05:14:58.515911+0000","last_unstale":"2024-01-22T05:14:58.952081+0000","last_undegraded":"2024-01-22T05:14:58.952081+0000","last_fullsized":"2024-01-22T05:14:58.952081+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.959738+0000","last_change":"2024-01-22T05:14:58.956531+0000","last_active":"2024-01-22T05:14:58.959738+0000","last_peered":"2024-01-22T05:14:58.959738+0000","last_clean":"2024-01-22T05:14:58.959738+0000","last_became_active":"2024-01-22T05:14:58.955796+0000","last_became_peered":"2024-01-22T05:14:58.955796+0000","last_unstale":"2024-01-22T05:14:58.959738+0000","last_undegraded":"2024-01-22T05:14:58.959738+0000","last_fullsized":"2024-01-22T05:14:58.959738+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.948718+0000","last_change":"2024-01-22T05:14:58.520193+0000","last_active":"2024-01-22T05:14:58.948718+0000","last_peered":"2024-01-22T05:14:58.948718+0000","last_clean":"2024-01-22T05:14:58.948718+0000","last_became_active":"2024-01-22T05:14:58.519933+0000","last_became_peered":"2024-01-22T05:14:58.519933+0000","last_unstale":"2024-01-22T05:14:58.948718+0000","last_undegraded":"2024-01-22T05:14:58.948718+0000","last_fullsized":"2024-01-22T05:14:58.948718+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.973595+0000","last_change":"2024-01-22T05:14:58.965950+0000","last_active":"2024-01-22T05:14:58.973595+0000","last_peered":"2024-01-22T05:14:58.973595+0000","last_clean":"2024-01-22T05:14:58.973595+0000","last_became_active":"2024-01-22T05:14:58.965478+0000","last_became_peered":"2024-01-22T05:14:58.965478+0000","last_unstale":"2024-01-22T05:14:58.973595+0000","last_undegraded":"2024-01-22T05:14:58.973595+0000","last_fullsized":"2024-01-22T05:14:58.973595+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.951504+0000","last_change":"2024-01-22T05:14:58.517339+0000","last_active":"2024-01-22T05:14:58.951504+0000","last_peered":"2024-01-22T05:14:58.951504+0000","last_clean":"2024-01-22T05:14:58.951504+0000","last_became_active":"2024-01-22T05:14:58.517002+0000","last_became_peered":"2024-01-22T05:14:58.517002+0000","last_unstale":"2024-01-22T05:14:58.951504+0000","last_undegraded":"2024-01-22T05:14:58.951504+0000","last_fullsized":"2024-01-22T05:14:58.951504+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965076+0000","last_change":"2024-01-22T05:14:58.955165+0000","last_active":"2024-01-22T05:14:58.965076+0000","last_peered":"2024-01-22T05:14:58.965076+0000","last_clean":"2024-01-22T05:14:58.965076+0000","last_became_active":"2024-01-22T05:14:58.954873+0000","last_became_peered":"2024-01-22T05:14:58.954873+0000","last_unstale":"2024-01-22T05:14:58.965076+0000","last_undegraded":"2024-01-22T05:14:58.965076+0000","last_fullsized":"2024-01-22T05:14:58.965076+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.935965+0000","last_change":"2024-01-22T05:14:58.506446+0000","last_active":"2024-01-22T05:14:58.935965+0000","last_peered":"2024-01-22T05:14:58.935965+0000","last_clean":"2024-01-22T05:14:58.935965+0000","last_became_active":"2024-01-22T05:14:58.506157+0000","last_became_peered":"2024-01-22T05:14:58.506157+0000","last_unstale":"2024-01-22T05:14:58.935965+0000","last_undegraded":"2024-01-22T05:14:58.935965+0000","last_fullsized":"2024-01-22T05:14:58.935965+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.974739+0000","last_change":"2024-01-22T05:14:58.962411+0000","last_active":"2024-01-22T05:14:58.974739+0000","last_peered":"2024-01-22T05:14:58.974739+0000","last_clean":"2024-01-22T05:14:58.974739+0000","last_became_active":"2024-01-22T05:14:58.960956+0000","last_became_peered":"2024-01-22T05:14:58.960956+0000","last_unstale":"2024-01-22T05:14:58.974739+0000","last_undegraded":"2024-01-22T05:14:58.974739+0000","last_fullsized":"2024-01-22T05:14:58.974739+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.937457+0000","last_change":"2024-01-22T05:14:58.503361+0000","last_active":"2024-01-22T05:14:58.937457+0000","last_peered":"2024-01-22T05:14:58.937457+0000","last_clean":"2024-01-22T05:14:58.937457+0000","last_became_active":"2024-01-22T05:14:58.501935+0000","last_became_peered":"2024-01-22T05:14:58.501935+0000","last_unstale":"2024-01-22T05:14:58.937457+0000","last_undegraded":"2024-01-22T05:14:58.937457+0000","last_fullsized":"2024-01-22T05:14:58.937457+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.943862+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:14:58.943862+0000","last_peered":"2024-01-22T05:14:58.943862+0000","last_clean":"2024-01-22T05:14:58.943862+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:14:58.943862+0000","last_undegraded":"2024-01-22T05:14:58.943862+0000","last_fullsized":"2024-01-22T05:14:58.943862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.967444+0000","last_change":"2024-01-22T05:14:58.965046+0000","last_active":"2024-01-22T05:14:58.967444+0000","last_peered":"2024-01-22T05:14:58.967444+0000","last_clean":"2024-01-22T05:14:58.967444+0000","last_became_active":"2024-01-22T05:14:58.964755+0000","last_became_peered":"2024-01-22T05:14:58.964755+0000","last_unstale":"2024-01-22T05:14:58.967444+0000","last_undegraded":"2024-01-22T05:14:58.967444+0000","last_fullsized":"2024-01-22T05:14:58.967444+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.953617+0000","last_change":"2024-01-22T05:14:58.518590+0000","last_active":"2024-01-22T05:14:58.953617+0000","last_peered":"2024-01-22T05:14:58.953617+0000","last_clean":"2024-01-22T05:14:58.953617+0000","last_became_active":"2024-01-22T05:14:58.518333+0000","last_became_peered":"2024-01-22T05:14:58.518333+0000","last_unstale":"2024-01-22T05:14:58.953617+0000","last_undegraded":"2024-01-22T05:14:58.953617+0000","last_fullsized":"2024-01-22T05:14:58.953617+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.953268+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:14:58.953268+0000","last_peered":"2024-01-22T05:14:58.953268+0000","last_clean":"2024-01-22T05:14:58.953268+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:14:58.953268+0000","last_undegraded":"2024-01-22T05:14:58.953268+0000","last_fullsized":"2024-01-22T05:14:58.953268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.969096+0000","last_change":"2024-01-22T05:14:58.966920+0000","last_active":"2024-01-22T05:14:58.969096+0000","last_peered":"2024-01-22T05:14:58.969096+0000","last_clean":"2024-01-22T05:14:58.969096+0000","last_became_active":"2024-01-22T05:14:58.966497+0000","last_became_peered":"2024-01-22T05:14:58.966497+0000","last_unstale":"2024-01-22T05:14:58.969096+0000","last_undegraded":"2024-01-22T05:14:58.969096+0000","last_fullsized":"2024-01-22T05:14:58.969096+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"130'3","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965550+0000","last_change":"2024-01-22T05:14:58.508099+0000","last_active":"2024-01-22T05:14:58.965550+0000","last_peered":"2024-01-22T05:14:58.965550+0000","last_clean":"2024-01-22T05:14:58.965550+0000","last_became_active":"2024-01-22T05:14:58.507740+0000","last_became_peered":"2024-01-22T05:14:58.507740+0000","last_unstale":"2024-01-22T05:14:58.965550+0000","last_undegraded":"2024-01-22T05:14:58.965550+0000","last_fullsized":"2024-01-22T05:14:58.965550+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":102,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.946302+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:14:58.946302+0000","last_peered":"2024-01-22T05:14:58.946302+0000","last_clean":"2024-01-22T05:14:58.946302+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:14:58.946302+0000","last_undegraded":"2024-01-22T05:14:58.946302+0000","last_fullsized":"2024-01-22T05:14:58.946302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.962682+0000","last_change":"2024-01-22T05:14:58.957444+0000","last_active":"2024-01-22T05:14:58.962682+0000","last_peered":"2024-01-22T05:14:58.962682+0000","last_clean":"2024-01-22T05:14:58.962682+0000","last_became_active":"2024-01-22T05:14:58.957147+0000","last_became_peered":"2024-01-22T05:14:58.957147+0000","last_unstale":"2024-01-22T05:14:58.962682+0000","last_undegraded":"2024-01-22T05:14:58.962682+0000","last_fullsized":"2024-01-22T05:14:58.962682+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"130'2","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.961317+0000","last_change":"2024-01-22T05:14:58.514183+0000","last_active":"2024-01-22T05:14:58.961317+0000","last_peered":"2024-01-22T05:14:58.961317+0000","last_clean":"2024-01-22T05:14:58.961317+0000","last_became_active":"2024-01-22T05:14:58.513911+0000","last_became_peered":"2024-01-22T05:14:58.513911+0000","last_unstale":"2024-01-22T05:14:58.961317+0000","last_undegraded":"2024-01-22T05:14:58.961317+0000","last_fullsized":"2024-01-22T05:14:58.961317+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.950325+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:14:58.950325+0000","last_peered":"2024-01-22T05:14:58.950325+0000","last_clean":"2024-01-22T05:14:58.950325+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:14:58.950325+0000","last_undegraded":"2024-01-22T05:14:58.950325+0000","last_fullsized":"2024-01-22T05:14:58.950325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.976139+0000","last_change":"2024-01-22T05:14:58.963063+0000","last_active":"2024-01-22T05:14:58.976139+0000","last_peered":"2024-01-22T05:14:58.976139+0000","last_clean":"2024-01-22T05:14:58.976139+0000","last_became_active":"2024-01-22T05:14:58.959680+0000","last_became_peered":"2024-01-22T05:14:58.959680+0000","last_unstale":"2024-01-22T05:14:58.976139+0000","last_undegraded":"2024-01-22T05:14:58.976139+0000","last_fullsized":"2024-01-22T05:14:58.976139+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.952986+0000","last_change":"2024-01-22T05:14:58.508233+0000","last_active":"2024-01-22T05:14:58.952986+0000","last_peered":"2024-01-22T05:14:58.952986+0000","last_clean":"2024-01-22T05:14:58.952986+0000","last_became_active":"2024-01-22T05:14:58.506472+0000","last_became_peered":"2024-01-22T05:14:58.506472+0000","last_unstale":"2024-01-22T05:14:58.952986+0000","last_undegraded":"2024-01-22T05:14:58.952986+0000","last_fullsized":"2024-01-22T05:14:58.952986+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":123,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.934450+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:14:58.934450+0000","last_peered":"2024-01-22T05:14:58.934450+0000","last_clean":"2024-01-22T05:14:58.934450+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:14:58.934450+0000","last_undegraded":"2024-01-22T05:14:58.934450+0000","last_fullsized":"2024-01-22T05:14:58.934450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970998+0000","last_change":"2024-01-22T05:14:58.961468+0000","last_active":"2024-01-22T05:14:58.970998+0000","last_peered":"2024-01-22T05:14:58.970998+0000","last_clean":"2024-01-22T05:14:58.970998+0000","last_became_active":"2024-01-22T05:14:58.961211+0000","last_became_peered":"2024-01-22T05:14:58.961211+0000","last_unstale":"2024-01-22T05:14:58.970998+0000","last_undegraded":"2024-01-22T05:14:58.970998+0000","last_fullsized":"2024-01-22T05:14:58.970998+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.949395+0000","last_change":"2024-01-22T05:14:58.512962+0000","last_active":"2024-01-22T05:14:58.949395+0000","last_peered":"2024-01-22T05:14:58.949395+0000","last_clean":"2024-01-22T05:14:58.949395+0000","last_became_active":"2024-01-22T05:14:58.512654+0000","last_became_peered":"2024-01-22T05:14:58.512654+0000","last_unstale":"2024-01-22T05:14:58.949395+0000","last_undegraded":"2024-01-22T05:14:58.949395+0000","last_fullsized":"2024-01-22T05:14:58.949395+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.952900+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:14:58.952900+0000","last_peered":"2024-01-22T05:14:58.952900+0000","last_clean":"2024-01-22T05:14:58.952900+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:14:58.952900+0000","last_undegraded":"2024-01-22T05:14:58.952900+0000","last_fullsized":"2024-01-22T05:14:58.952900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965459+0000","last_change":"2024-01-22T05:14:58.962803+0000","last_active":"2024-01-22T05:14:58.965459+0000","last_peered":"2024-01-22T05:14:58.965459+0000","last_clean":"2024-01-22T05:14:58.965459+0000","last_became_active":"2024-01-22T05:14:58.962515+0000","last_became_peered":"2024-01-22T05:14:58.962515+0000","last_unstale":"2024-01-22T05:14:58.965459+0000","last_undegraded":"2024-01-22T05:14:58.965459+0000","last_fullsized":"2024-01-22T05:14:58.965459+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"130'4","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.969934+0000","last_change":"2024-01-22T05:14:58.503967+0000","last_active":"2024-01-22T05:14:58.969934+0000","last_peered":"2024-01-22T05:14:58.969934+0000","last_clean":"2024-01-22T05:14:58.969934+0000","last_became_active":"2024-01-22T05:14:58.501023+0000","last_became_peered":"2024-01-22T05:14:58.501023+0000","last_unstale":"2024-01-22T05:14:58.969934+0000","last_undegraded":"2024-01-22T05:14:58.969934+0000","last_fullsized":"2024-01-22T05:14:58.969934+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":102,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.941381+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:14:58.941381+0000","last_peered":"2024-01-22T05:14:58.941381+0000","last_clean":"2024-01-22T05:14:58.941381+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:14:58.941381+0000","last_undegraded":"2024-01-22T05:14:58.941381+0000","last_fullsized":"2024-01-22T05:14:58.941381+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970564+0000","last_change":"2024-01-22T05:14:58.967888+0000","last_active":"2024-01-22T05:14:58.970564+0000","last_peered":"2024-01-22T05:14:58.970564+0000","last_clean":"2024-01-22T05:14:58.970564+0000","last_became_active":"2024-01-22T05:14:58.967602+0000","last_became_peered":"2024-01-22T05:14:58.967602+0000","last_unstale":"2024-01-22T05:14:58.970564+0000","last_undegraded":"2024-01-22T05:14:58.970564+0000","last_fullsized":"2024-01-22T05:14:58.970564+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970410+0000","last_change":"2024-01-22T05:14:58.511230+0000","last_active":"2024-01-22T05:14:58.970410+0000","last_peered":"2024-01-22T05:14:58.970410+0000","last_clean":"2024-01-22T05:14:58.970410+0000","last_became_active":"2024-01-22T05:14:58.510945+0000","last_became_peered":"2024-01-22T05:14:58.510945+0000","last_unstale":"2024-01-22T05:14:58.970410+0000","last_undegraded":"2024-01-22T05:14:58.970410+0000","last_fullsized":"2024-01-22T05:14:58.970410+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":123,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.934902+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:14:58.934902+0000","last_peered":"2024-01-22T05:14:58.934902+0000","last_clean":"2024-01-22T05:14:58.934902+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:14:58.934902+0000","last_undegraded":"2024-01-22T05:14:58.934902+0000","last_fullsized":"2024-01-22T05:14:58.934902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":103,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.941467+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:14:58.941467+0000","last_peered":"2024-01-22T05:14:58.941467+0000","last_clean":"2024-01-22T05:14:58.941467+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:14:58.941467+0000","last_undegraded":"2024-01-22T05:14:58.941467+0000","last_fullsized":"2024-01-22T05:14:58.941467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574977,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307028,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064812,"statfs":{"total":96636764160,"available":96322367488,"internally_reserved":0,"allocated":1650688,"data_stored":809717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":1.159,"15min":1.071},"min":{"1min":0.70299999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":14.779999999999999,"5min":14.779999999999999,"15min":14.779999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":5.5800000000000001,"5min":1.9630000000000001,"15min":1.357},"min":{"1min":0.77500000000000002,"5min":0.63400000000000001,"15min":0.61899999999999999},"max":{"1min":76.662000000000006,"5min":76.662000000000006,"15min":76.662000000000006},"last":1.276}]},{"osd":1,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.0409999999999999,"15min":1.0149999999999999},"min":{"1min":0.80600000000000005,"5min":0.59199999999999997,"15min":0.54400000000000004},"max":{"1min":4.9269999999999996,"5min":4.9269999999999996,"15min":4.9269999999999996},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.7190000000000001,"5min":1.2749999999999999,"15min":1.2},"min":{"1min":0.755,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":12.691000000000001,"5min":12.691000000000001,"15min":12.691000000000001},"last":1.383}]},{"osd":2,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1040000000000001,"15min":1.109},"min":{"1min":0.67500000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.984,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.95,"5min":1.294,"15min":1.212},"min":{"1min":0.76100000000000001,"5min":0.73799999999999999,"15min":0.68899999999999995},"max":{"1min":15.036,"5min":15.036,"15min":15.036},"last":0.85499999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":4.9119999999999999,"5min":1.9079999999999999,"15min":1.46},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":64.983999999999995,"5min":64.983999999999995,"15min":64.983999999999995},"last":1.1699999999999999},{"interface":"front","average":{"1min":2.0550000000000002,"5min":1.4099999999999999,"15min":1.286},"min":{"1min":0.78400000000000003,"5min":0.78300000000000003,"15min":0.60199999999999998},"max":{"1min":15.073,"5min":15.073,"15min":15.073},"last":0.97099999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":1.2649999999999999,"15min":1.1459999999999999},"min":{"1min":0.753,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":22.239000000000001,"5min":22.239000000000001,"15min":22.239000000000001},"last":1.494},{"interface":"front","average":{"1min":2.7509999999999999,"5min":1.405,"15min":1.25},"min":{"1min":0.81000000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":27.872,"5min":27.872,"15min":27.872},"last":1.4770000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":4.9119999999999999,"5min":1.8600000000000001,"15min":1.425},"min":{"1min":0.67400000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":65.652000000000001,"5min":65.652000000000001,"15min":65.652000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2270000000000001,"15min":1.2450000000000001},"min":{"1min":1.0389999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.1629999999999998,"5min":2.1819999999999999,"15min":3.625},"last":1.419}]},{"osd":6,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.218,"15min":1.2450000000000001},"min":{"1min":0.80700000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":6.9939999999999998,"5min":6.9939999999999998,"15min":6.9939999999999998},"last":1.573},{"interface":"front","average":{"1min":2.0019999999999998,"5min":1.452,"15min":1.381},"min":{"1min":0.83199999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":12.965,"5min":12.965,"15min":12.965},"last":1.5189999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574977,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302924,"kb_used_data":1604,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068916,"statfs":{"total":96636764160,"available":96326569984,"internally_reserved":0,"allocated":1642496,"data_stored":809661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:14:56 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.98699999999999999,"15min":1.2949999999999999},"min":{"1min":0.73899999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.3149999999999999,"5min":1.679,"15min":77.745000000000005},"last":1.3149999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.01,"15min":1.0760000000000001},"min":{"1min":0.57499999999999996,"5min":0.44,"15min":0.44},"max":{"1min":1.4019999999999999,"5min":5.0359999999999996,"15min":13.555999999999999},"last":1.107}]},{"osd":1,"last update":"Mon Jan 22 05:14:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.129,"15min":1.117},"min":{"1min":0.56999999999999995,"5min":0.503,"15min":0.40000000000000002},"max":{"1min":1.212,"5min":5.9210000000000003,"15min":15.499000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.077,"15min":1.1839999999999999},"min":{"1min":0.71999999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3580000000000001,"5min":3.6080000000000001,"15min":7.7629999999999999},"last":1.244}]},{"osd":2,"last update":"Mon Jan 22 05:14:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1579999999999999,"15min":1.157},"min":{"1min":0.91600000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4390000000000001,"5min":3.0230000000000001,"15min":3.0960000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.151,"15min":1.1339999999999999},"min":{"1min":0.71099999999999997,"5min":0.68600000000000005,"15min":0.38200000000000001},"max":{"1min":1.5449999999999999,"5min":4.9660000000000002,"15min":4.9660000000000002},"last":0.92400000000000004}]},{"osd":3,"last update":"Mon Jan 22 05:14:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1779999999999999,"15min":1.4750000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.59299999999999997},"max":{"1min":1.4330000000000001,"5min":5.0750000000000002,"15min":102.08199999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.2010000000000001,"15min":1.2290000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.374},"max":{"1min":1.48,"5min":6.0129999999999999,"15min":15.468},"last":1.4610000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:14:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1459999999999999,"15min":1.123},"min":{"1min":0.94999999999999996,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.5740000000000001,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.149},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.145},"min":{"1min":0.68300000000000005,"5min":0.56899999999999995,"15min":0.48299999999999998},"max":{"1min":1.6100000000000001,"5min":5.1200000000000001,"15min":5.1200000000000001},"last":1.385}]},{"osd":5,"last update":"Mon Jan 22 05:14:56 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1519999999999999,"15min":1.2529999999999999},"min":{"1min":0.58699999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.375,"5min":5.2930000000000001,"15min":30.533000000000001},"last":1.351},{"interface":"front","average":{"1min":1.3,"5min":1.236,"15min":1.2729999999999999},"min":{"1min":1.0009999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.6639999999999999,"5min":2.6179999999999999,"15min":3.875},"last":1.4259999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:14:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3799999999999999,"15min":1.4350000000000001},"min":{"1min":0.78900000000000003,"5min":0.72599999999999998,"15min":0.42699999999999999},"max":{"1min":1.6879999999999999,"5min":8.4190000000000005,"15min":23.547999999999998},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.4319999999999999,"15min":1.585},"min":{"1min":0.98399999999999999,"5min":0.60199999999999998,"15min":0.495},"max":{"1min":1.9019999999999999,"5min":7.46,"15min":63.737000000000002},"last":1.5800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574977,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302920,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068920,"statfs":{"total":96636764160,"available":96326574080,"internally_reserved":0,"allocated":1638400,"data_stored":809059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:14:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.042,"15min":1.0129999999999999},"min":{"1min":0.61799999999999999,"5min":0.56999999999999995,"15min":0.53300000000000003},"max":{"1min":1.651,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.276},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.014,"15min":1.0629999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.571},"last":1.3979999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:14:57 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.175,"15min":1.194},"min":{"1min":0.83999999999999997,"5min":0.67300000000000004,"15min":0.50600000000000001},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.454},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.151,"15min":1.2350000000000001},"min":{"1min":0.876,"5min":0.76300000000000001,"15min":0.50900000000000001},"max":{"1min":1.9930000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.5549999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:14:57 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.0940000000000001,"15min":1.137},"min":{"1min":0.80500000000000005,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.9219999999999999,"5min":1.925,"15min":1.925},"last":1.24},{"interface":"front","average":{"1min":1.216,"5min":1.1160000000000001,"15min":1.125},"min":{"1min":0.73999999999999999,"5min":0.64200000000000002,"15min":0.59899999999999998},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.2}]},{"osd":3,"last update":"Mon Jan 22 05:14:57 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.133,"15min":1.161},"min":{"1min":0.82699999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.347},{"interface":"front","average":{"1min":1.149,"5min":1.177,"15min":1.2470000000000001},"min":{"1min":0.81999999999999995,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5640000000000001,"5min":4.8819999999999997,"15min":4.8819999999999997},"last":1.3759999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:14:57 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.05,"15min":1.1299999999999999},"min":{"1min":0.74299999999999999,"5min":0.51700000000000002,"15min":0.44400000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1060000000000001,"15min":1.222},"min":{"1min":0.79600000000000004,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.04}]},{"osd":6,"last update":"Mon Jan 22 05:14:57 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.123,"15min":1.256},"min":{"1min":0.90900000000000003,"5min":0.63600000000000001,"15min":0.58199999999999996},"max":{"1min":1.47,"5min":1.8129999999999999,"15min":2.2010000000000001},"last":0.996},{"interface":"front","average":{"1min":1.302,"5min":1.202,"15min":1.2689999999999999},"min":{"1min":1.016,"5min":0.56100000000000005,"15min":0.55900000000000005},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.3160000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:14:57 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.216,"15min":1.343},"min":{"1min":0.95799999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.6789999999999998,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.288},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2250000000000001,"15min":1.3779999999999999},"min":{"1min":0.72699999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.7050000000000001,"5min":2.04,"15min":3.1840000000000002},"last":1.4790000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311112,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060728,"statfs":{"total":96636764160,"available":96318185472,"internally_reserved":0,"allocated":1638400,"data_stored":810393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.0669999999999999,"15min":1.113},"min":{"1min":0.749,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.448,"5min":1.726,"15min":2.0150000000000001},"last":1.25},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.125,"15min":1.115},"min":{"1min":0.79500000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5109999999999999,"5min":1.6220000000000001,"15min":1.7430000000000001},"last":1.393}]},{"osd":1,"last update":"Mon Jan 22 05:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.073,"15min":1.077},"min":{"1min":0.80000000000000004,"5min":0.60499999999999998,"15min":0.53100000000000003},"max":{"1min":1.363,"5min":1.5429999999999999,"15min":1.7609999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0189999999999999,"15min":1.113},"min":{"1min":0.70099999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.3129999999999999,"5min":1.6870000000000001,"15min":2.194},"last":0.93100000000000005}]},{"osd":2,"last update":"Mon Jan 22 05:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0389999999999999,"15min":1.075},"min":{"1min":0.77500000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.45,"5min":1.7030000000000001,"15min":5.3390000000000004},"last":1.286},{"interface":"front","average":{"1min":1.103,"5min":1.1120000000000001,"15min":1.2030000000000001},"min":{"1min":0.71199999999999997,"5min":0.69099999999999995,"15min":0.67600000000000005},"max":{"1min":1.452,"5min":1.641,"15min":2.3479999999999999},"last":1.147}]},{"osd":3,"last update":"Mon Jan 22 05:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.1040000000000001,"15min":1.149},"min":{"1min":0.65700000000000003,"5min":0.59299999999999997,"15min":0.496},"max":{"1min":1.6719999999999999,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.115},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.093,"15min":1.1459999999999999},"min":{"1min":0.70499999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":5.3029999999999999},"last":1.169}]},{"osd":5,"last update":"Mon Jan 22 05:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.048,"15min":1.1519999999999999},"min":{"1min":0.77500000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.446,"5min":1.6970000000000001,"15min":2.0790000000000002},"last":1.044},{"interface":"front","average":{"1min":1.147,"5min":1.0649999999999999,"15min":1.121},"min":{"1min":0.68200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.5389999999999999,"5min":1.5880000000000001,"15min":2.0030000000000001},"last":1.3080000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0669999999999999,"15min":1.151},"min":{"1min":0.76700000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.47,"5min":1.5960000000000001,"15min":5.3769999999999998},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.1619999999999999,"15min":1.3160000000000001},"min":{"1min":0.97499999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.623,"5min":1.778,"15min":4.4409999999999998},"last":1.3420000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.25,"15min":1.3200000000000001},"min":{"1min":1.151,"5min":0.62,"15min":0.59399999999999997},"max":{"1min":1.627,"5min":1.9119999999999999,"15min":2.2839999999999998},"last":1.48},{"interface":"front","average":{"1min":1.331,"5min":1.256,"15min":1.3360000000000001},"min":{"1min":1.008,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":5.2629999999999999},"last":0.97099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574977,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311108,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060732,"statfs":{"total":96636764160,"available":96318189568,"internally_reserved":0,"allocated":1634304,"data_stored":809037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:14:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81499999999999995,"15min":0.88300000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.34200000000000003},"max":{"1min":1.4670000000000001,"5min":1.8440000000000001,"15min":14.859},"last":0.436},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.873,"15min":0.89200000000000002},"min":{"1min":0.622,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":1.3979999999999999,"5min":2.3519999999999999,"15min":5.0919999999999996},"last":0.66700000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:14:43 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.92900000000000005,"15min":0.88300000000000001},"min":{"1min":0.54000000000000004,"5min":0.42399999999999999,"15min":0.39300000000000002},"max":{"1min":1.1739999999999999,"5min":6.5570000000000004,"15min":6.5570000000000004},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.95999999999999996,"15min":0.97899999999999998},"min":{"1min":0.64400000000000002,"5min":0.499,"15min":0.48399999999999999},"max":{"1min":1.7669999999999999,"5min":1.9510000000000001,"15min":5.7519999999999998},"last":0.746}]},{"osd":2,"last update":"Mon Jan 22 05:14:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.1259999999999999,"15min":1.135},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.40600000000000003},"max":{"1min":1.48,"5min":2.391,"15min":2.391},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.204,"15min":1.1950000000000001},"min":{"1min":0.753,"5min":0.501,"15min":0.44800000000000001},"max":{"1min":1.5409999999999999,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.91300000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:14:43 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.383,"15min":1.3240000000000001},"min":{"1min":0.84699999999999998,"5min":0.82799999999999996,"15min":0.51700000000000002},"max":{"1min":1.798,"5min":10.858000000000001,"15min":10.858000000000001},"last":1.474},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.367,"15min":1.3480000000000001},"min":{"1min":0.90800000000000003,"5min":0.79500000000000004,"15min":0.63600000000000001},"max":{"1min":1.609,"5min":10.846,"15min":10.846},"last":1.306}]},{"osd":5,"last update":"Mon Jan 22 05:14:43 2024","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.296,"15min":1.2969999999999999},"min":{"1min":0.95099999999999996,"5min":0.74099999999999999,"15min":0.505},"max":{"1min":1.7709999999999999,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.3879999999999999,"15min":1.3819999999999999},"min":{"1min":0.82099999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":6.3220000000000001,"5min":12.128,"15min":14.523999999999999},"last":1.02}]},{"osd":6,"last update":"Mon Jan 22 05:14:43 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.3160000000000001,"15min":1.3740000000000001},"min":{"1min":0.88100000000000001,"5min":0.81699999999999995,"15min":0.56699999999999995},"max":{"1min":1.859,"5min":2.2610000000000001,"15min":4.9809999999999999},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.411,"5min":1.357,"15min":1.4019999999999999},"min":{"1min":0.99299999999999999,"5min":0.78800000000000003,"15min":0.68500000000000005},"max":{"1min":1.71,"5min":1.923,"15min":5.4210000000000003},"last":1.0429999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:14:43 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.339,"15min":1.3819999999999999},"min":{"1min":0.92000000000000004,"5min":0.89100000000000001,"15min":0.79900000000000004},"max":{"1min":1.881,"5min":2.472,"15min":5.7160000000000002},"last":1.083},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.4079999999999999,"15min":1.4179999999999999},"min":{"1min":1.0640000000000001,"5min":0.77800000000000002,"15min":0.71299999999999997},"max":{"1min":1.796,"5min":6.4279999999999999,"15min":6.4279999999999999},"last":1.5349999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307012,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064828,"statfs":{"total":96636764160,"available":96322383872,"internally_reserved":0,"allocated":1634304,"data_stored":808981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:14:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77600000000000002,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85699999999999998,"15min":0.84599999999999997},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.373},"max":{"1min":1.556,"5min":1.556,"15min":1.7350000000000001},"last":0.92200000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:14:47 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.871,"15min":0.83199999999999996},"min":{"1min":0.51500000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4490000000000001,"5min":1.534,"15min":1.534},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.97299999999999998,"15min":0.94799999999999995},"min":{"1min":0.64200000000000002,"5min":0.43099999999999999,"15min":0.41599999999999998},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.1830000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:14:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.1359999999999999,"15min":1.095},"min":{"1min":0.56200000000000006,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.446,"5min":2.226,"15min":2.226},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2330000000000001,"15min":1.194},"min":{"1min":0.71499999999999997,"5min":0.53900000000000003,"15min":0.51100000000000001},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":0.81599999999999995}]},{"osd":4,"last update":"Mon Jan 22 05:14:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.2729999999999999,"15min":1.2869999999999999},"min":{"1min":0.88500000000000001,"5min":0.71299999999999997,"15min":0.59099999999999997},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2190000000000001,"15min":1.208},"min":{"1min":0.72099999999999997,"5min":0.66400000000000003,"15min":0.63500000000000001},"max":{"1min":1.6259999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.236}]},{"osd":5,"last update":"Mon Jan 22 05:14:47 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.2130000000000001,"15min":1.204},"min":{"1min":0.89500000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.593,"5min":1.8440000000000001,"15min":2.3660000000000001},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.3,"15min":1.304},"min":{"1min":0.98299999999999998,"5min":0.76100000000000001,"15min":0.67000000000000004},"max":{"1min":3.0910000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.034}]},{"osd":6,"last update":"Mon Jan 22 05:14:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.274,"15min":1.26},"min":{"1min":0.96299999999999997,"5min":0.749,"15min":0.68400000000000005},"max":{"1min":1.673,"5min":1.7749999999999999,"15min":2.1920000000000002},"last":1.506},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.282,"15min":1.288},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.915,"5min":1.9370000000000001,"15min":2.4449999999999998},"last":1.409}]},{"osd":7,"last update":"Mon Jan 22 05:14:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3500000000000001},"min":{"1min":0.90700000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.742,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.403,"15min":1.4079999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.9970000000000001,"5min":2.0030000000000001,"15min":2.5059999999999998},"last":1.2}]}]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307012,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064828,"statfs":{"total":96636764160,"available":96322383872,"internally_reserved":0,"allocated":1634304,"data_stored":809501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84899999999999998,"15min":0.86099999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.38100000000000001},"max":{"1min":1.411,"5min":1.911,"15min":3.4119999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0109999999999999,"15min":1.002},"min":{"1min":0.56999999999999995,"5min":0.42899999999999999,"15min":0.41099999999999998},"max":{"1min":1.4279999999999999,"5min":1.8680000000000001,"15min":2.101},"last":1.1439999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0089999999999999,"15min":1.002},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4610000000000001,"5min":2.169,"15min":2.169},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0669999999999999,"15min":1.044},"min":{"1min":0.623,"5min":0.59099999999999997,"15min":0.46899999999999997},"max":{"1min":1.5780000000000001,"5min":2.024,"15min":2.024},"last":1.5}]},{"osd":3,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.0149999999999999,"15min":1.0169999999999999},"min":{"1min":0.60399999999999998,"5min":0.59399999999999997,"15min":0.38900000000000001},"max":{"1min":1.5229999999999999,"5min":1.7130000000000001,"15min":4.665},"last":1.2589999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.026,"15min":0.93200000000000005},"min":{"1min":0.51600000000000001,"5min":0.45000000000000001,"15min":0.41899999999999998},"max":{"1min":1.383,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":1.391}]},{"osd":4,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.3129999999999999,"15min":1.244},"min":{"1min":0.60299999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.958,"5min":15.76,"15min":15.76},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.415,"15min":1.3160000000000001},"min":{"1min":0.74099999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.627,"5min":16.975000000000001,"15min":16.975000000000001},"last":1.714}]},{"osd":5,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2549999999999999,"15min":1.2130000000000001},"min":{"1min":0.72599999999999998,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.893,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.2669999999999999,"15min":1.2769999999999999},"min":{"1min":0.875,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1309999999999998,"5min":2.52,"15min":2.52},"last":1.476}]},{"osd":6,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.68999999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.746,"5min":4.359,"15min":4.359},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.331,"15min":1.339},"min":{"1min":0.85799999999999998,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.0609999999999999,"5min":2.5569999999999999,"15min":2.5569999999999999},"last":1.6830000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3160000000000001,"15min":1.361},"min":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6859999999999999,"5min":2.0019999999999998,"15min":4.4329999999999998},"last":1.8999999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.339,"15min":1.3520000000000001},"min":{"1min":0.81599999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.032,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.9259999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574977,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307012,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064828,"statfs":{"total":96636764160,"available":96322383872,"internally_reserved":0,"allocated":1634304,"data_stored":809839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:14:42 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84099999999999997,"15min":0.92500000000000004},"min":{"1min":0.622,"5min":0.41199999999999998,"15min":0.28699999999999998},"max":{"1min":1.196,"5min":1.972,"15min":15.273},"last":0.871},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.92400000000000004,"15min":0.95199999999999996},"min":{"1min":0.66200000000000003,"5min":0.502,"15min":0.34499999999999997},"max":{"1min":1.252,"5min":1.698,"15min":4.4009999999999998},"last":1.173}]},{"osd":2,"last update":"Mon Jan 22 05:14:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.008,"15min":1.0820000000000001},"min":{"1min":0.72299999999999998,"5min":0.48199999999999998,"15min":0.46400000000000002},"max":{"1min":1.3129999999999999,"5min":1.6459999999999999,"15min":15.473000000000001},"last":1.222},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.038,"15min":1.026},"min":{"1min":0.76200000000000001,"5min":0.60699999999999998,"15min":0.45400000000000001},"max":{"1min":1.48,"5min":1.794,"15min":1.7989999999999999},"last":1.042}]},{"osd":3,"last update":"Mon Jan 22 05:14:42 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.94199999999999995,"15min":0.997},"min":{"1min":0.63600000000000001,"5min":0.40000000000000002,"15min":0.39000000000000001},"max":{"1min":1.395,"5min":1.609,"15min":5.3970000000000002},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1359999999999999,"15min":1.2130000000000001},"min":{"1min":0.78500000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.448,"5min":2.2349999999999999,"15min":15.439},"last":1.4730000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:14:42 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2290000000000001,"15min":1.3029999999999999},"min":{"1min":0.872,"5min":0.66200000000000003,"15min":0.61399999999999999},"max":{"1min":1.6339999999999999,"5min":2.1280000000000001,"15min":5.1799999999999997},"last":1.399},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.175,"15min":1.2250000000000001},"min":{"1min":0.79100000000000004,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.383,"5min":1.7909999999999999,"15min":3.4340000000000002},"last":1.2609999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:14:42 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.222,"15min":1.306},"min":{"1min":0.98299999999999998,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.552,"5min":1.8149999999999999,"15min":3.548},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3080000000000001,"15min":1.365},"min":{"1min":0.97799999999999998,"5min":0.75900000000000001,"15min":0.59499999999999997},"max":{"1min":1.6919999999999999,"5min":2.2309999999999999,"15min":2.823},"last":1.359}]},{"osd":6,"last update":"Mon Jan 22 05:14:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.347,"15min":1.444},"min":{"1min":1.0600000000000001,"5min":0.81399999999999995,"15min":0.59099999999999997},"max":{"1min":1.7370000000000001,"5min":2.0950000000000002,"15min":15.4},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3360000000000001,"15min":1.4370000000000001},"min":{"1min":0.95399999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.728,"5min":2.105,"15min":7.1349999999999998},"last":1.306}]},{"osd":7,"last update":"Mon Jan 22 05:14:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.393,"15min":1.5129999999999999},"min":{"1min":1.034,"5min":0.91400000000000003,"15min":0.79900000000000004},"max":{"1min":1.681,"5min":2.1819999999999999,"15min":5.29},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3360000000000001,"15min":1.3899999999999999},"min":{"1min":1.1339999999999999,"5min":0.81799999999999995,"15min":0.752},"max":{"1min":1.615,"5min":2.1869999999999998,"15min":2.7269999999999999},"last":1.4319999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:15:03.588 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:15:03.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.786+0000 7f6f3fe00700 1 Processor -- start 2024-01-22T05:15:03.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.786+0000 7f6f3fe00700 1 -- start start 2024-01-22T05:15:03.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.786+0000 7f6f3fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38062230 0x7f6f381507c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:03.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.786+0000 7f6f3fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6f380681a0 0x7f6f380bf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:03.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.786+0000 7f6f3fe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f380c37d0 con 0x7f6f38062610 2024-01-22T05:15:03.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.786+0000 7f6f3fe00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f380c3a20 con 0x7f6f380681a0 2024-01-22T05:15:03.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.786+0000 7f6f3fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380c3d00 con 0x7f6f38062230 2024-01-22T05:15:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.786+0000 7f6f3e800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6f380681a0 0x7f6f380bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.786+0000 7f6f3e800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6f380681a0 0x7f6f380bf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37022/0 (socket says 172.21.15.49:37022) 2024-01-22T05:15:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.786+0000 7f6f3e800700 1 -- 172.21.15.49:0/2134191835 learned_addr learned my addr 172.21.15.49:0/2134191835 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f3d400700 1 --2- 172.21.15.49:0/2134191835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38062230 0x7f6f381507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f3e800700 1 -- 172.21.15.49:0/2134191835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38062230 msgr2=0x7f6f381507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f3e800700 1 --2- 172.21.15.49:0/2134191835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38062230 0x7f6f381507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f3e800700 1 -- 172.21.15.49:0/2134191835 >> v1:172.21.15.110:6789/0 conn(0x7f6f38062610 legacy=0x7f6f38067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f3e800700 1 -- 172.21.15.49:0/2134191835 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f380c3fe0 con 0x7f6f380681a0 2024-01-22T05:15:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f3e800700 1 --2- 172.21.15.49:0/2134191835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f380681a0 0x7f6f380bf180 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f6f30009f20 tx=0x7f6f30009840).ready entity=mon.0 client_cookie=d85f4a72cea7ccad server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:03.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f37e00700 1 -- 172.21.15.49:0/2134191835 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3000e070 con 0x7f6f380681a0 2024-01-22T05:15:03.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f37e00700 1 -- 172.21.15.49:0/2134191835 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3000ba80 con 0x7f6f380681a0 2024-01-22T05:15:03.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f37e00700 1 -- 172.21.15.49:0/2134191835 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3000be00 con 0x7f6f380681a0 2024-01-22T05:15:03.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f3fe00700 1 -- 172.21.15.49:0/2134191835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f380681a0 msgr2=0x7f6f380bf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:03.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f3fe00700 1 --2- 172.21.15.49:0/2134191835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f380681a0 0x7f6f380bf180 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f6f30009f20 tx=0x7f6f30009840).stop 2024-01-22T05:15:03.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f3fe00700 1 -- 172.21.15.49:0/2134191835 shutdown_connections 2024-01-22T05:15:03.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f3fe00700 1 --2- 172.21.15.49:0/2134191835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f380681a0 0x7f6f380bf180 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f3fe00700 1 --2- 172.21.15.49:0/2134191835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38062230 0x7f6f381507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f3fe00700 1 -- 172.21.15.49:0/2134191835 >> 172.21.15.49:0/2134191835 conn(0x7f6f38064080 msgr2=0x7f6f38064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:03.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f3fe00700 1 -- 172.21.15.49:0/2134191835 shutdown_connections 2024-01-22T05:15:03.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.790+0000 7f6f3fe00700 1 -- 172.21.15.49:0/2134191835 wait complete. 2024-01-22T05:15:03.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.794+0000 7f6f3fe00700 1 Processor -- start 2024-01-22T05:15:03.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.794+0000 7f6f3fe00700 1 -- start start 2024-01-22T05:15:03.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f38062230 0x7f6f380a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:03.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38062610 0x7f6f381684c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:03.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f380681a0 0x7f6f380a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:03.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3fe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380a5fa0 con 0x7f6f38062230 2024-01-22T05:15:03.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f381689b0 con 0x7f6f380681a0 2024-01-22T05:15:03.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380a6220 con 0x7f6f38062610 2024-01-22T05:15:03.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f38062230 0x7f6f380a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:03.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f38062230 0x7f6f380a5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37026/0 (socket says 172.21.15.49:37026) 2024-01-22T05:15:03.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3d400700 1 -- 172.21.15.49:0/1716968258 learned_addr learned my addr 172.21.15.49:0/1716968258 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:03.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3e800700 1 --2- 172.21.15.49:0/1716968258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f380681a0 0x7f6f380a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:03.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3ca00700 1 --2- 172.21.15.49:0/1716968258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38062610 0x7f6f381684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:03.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3d400700 1 -- 172.21.15.49:0/1716968258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38062610 msgr2=0x7f6f381684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:03.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3d400700 1 --2- 172.21.15.49:0/1716968258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38062610 0x7f6f381684c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3d400700 1 -- 172.21.15.49:0/1716968258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f380681a0 msgr2=0x7f6f380a72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:03.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3d400700 1 --2- 172.21.15.49:0/1716968258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f380681a0 0x7f6f380a72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:03.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3d400700 1 -- 172.21.15.49:0/1716968258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f30009ae0 con 0x7f6f38062230 2024-01-22T05:15:03.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3e800700 1 --2- 172.21.15.49:0/1716968258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f380681a0 0x7f6f380a72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:03.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3d400700 1 --2- 172.21.15.49:0/1716968258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f38062230 0x7f6f380a5ab0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f6f2800d890 tx=0x7f6f28008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:03.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f34c00700 1 -- 172.21.15.49:0/1716968258 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f280125f0 con 0x7f6f38062230 2024-01-22T05:15:03.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f34c00700 1 -- 172.21.15.49:0/1716968258 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f28012750 con 0x7f6f38062230 2024-01-22T05:15:03.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3fe00700 1 -- 172.21.15.49:0/1716968258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f380a6500 con 0x7f6f38062230 2024-01-22T05:15:03.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f34c00700 1 -- 172.21.15.49:0/1716968258 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28012ad0 con 0x7f6f38062230 2024-01-22T05:15:03.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.798+0000 7f6f3fe00700 1 -- 172.21.15.49:0/1716968258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f380a6ac0 con 0x7f6f38062230 2024-01-22T05:15:03.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.802+0000 7f6f3fe00700 1 -- 172.21.15.49:0/1716968258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f380ab780 con 0x7f6f38062230 2024-01-22T05:15:03.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.802+0000 7f6f34c00700 1 -- 172.21.15.49:0/1716968258 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6f28013480 con 0x7f6f38062230 2024-01-22T05:15:03.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.802+0000 7f6f34c00700 1 --2- 172.21.15.49:0/1716968258 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f1005a510 0x7f6f1005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:03.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.802+0000 7f6f34c00700 1 -- 172.21.15.49:0/1716968258 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f6f28074b10 con 0x7f6f38062230 2024-01-22T05:15:03.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.802+0000 7f6f3ca00700 1 --2- 172.21.15.49:0/1716968258 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f1005a510 0x7f6f1005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:03.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.806+0000 7f6f3ca00700 1 --2- 172.21.15.49:0/1716968258 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f1005a510 0x7f6f1005c9d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f6f3814f3c0 tx=0x7f6f20009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:03.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.810+0000 7f6f34c00700 1 -- 172.21.15.49:0/1716968258 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6f28048130 con 0x7f6f38062230 2024-01-22T05:15:03.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.974+0000 7f6f3fe00700 1 -- 172.21.15.49:0/1716968258 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f380c42c0 con 0x7f6f1005a510 2024-01-22T05:15:04.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:03.998+0000 7f6f34c00700 1 -- 172.21.15.49:0/1716968258 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359365 (secure 0 0 0) 0x7f6f380c42c0 con 0x7f6f1005a510 2024-01-22T05:15:04.004 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:04.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.010+0000 7f6f3fe00700 1 -- 172.21.15.49:0/1716968258 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f1005a510 msgr2=0x7f6f1005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:04.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.010+0000 7f6f3fe00700 1 --2- 172.21.15.49:0/1716968258 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f1005a510 0x7f6f1005c9d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f6f3814f3c0 tx=0x7f6f20009040).stop 2024-01-22T05:15:04.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.010+0000 7f6f3fe00700 1 -- 172.21.15.49:0/1716968258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f38062230 msgr2=0x7f6f380a5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:04.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.010+0000 7f6f3fe00700 1 --2- 172.21.15.49:0/1716968258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f38062230 0x7f6f380a5ab0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f6f2800d890 tx=0x7f6f28008040).stop 2024-01-22T05:15:04.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.010+0000 7f6f3fe00700 1 -- 172.21.15.49:0/1716968258 shutdown_connections 2024-01-22T05:15:04.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.010+0000 7f6f3fe00700 1 --2- 172.21.15.49:0/1716968258 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f1005a510 0x7f6f1005c9d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.010+0000 7f6f3fe00700 1 --2- 172.21.15.49:0/1716968258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f380681a0 0x7f6f380a72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.010+0000 7f6f3fe00700 1 --2- 172.21.15.49:0/1716968258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38062610 0x7f6f381684c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.010+0000 7f6f3fe00700 1 --2- 172.21.15.49:0/1716968258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f38062230 0x7f6f380a5ab0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.010+0000 7f6f3fe00700 1 -- 172.21.15.49:0/1716968258 >> 172.21.15.49:0/1716968258 conn(0x7f6f38064080 msgr2=0x7f6f3814fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:04.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.010+0000 7f6f3fe00700 1 -- 172.21.15.49:0/1716968258 shutdown_connections 2024-01-22T05:15:04.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.010+0000 7f6f3fe00700 1 -- 172.21.15.49:0/1716968258 wait complete. 2024-01-22T05:15:04.017 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:15:04.033 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2024-01-22T05:15:03.465091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2456128,"kb_used_data":12800,"kb_used_omap":0,"kb_used_meta":2443264,"kb_avail":752518592,"statfs":{"total":773094113280,"available":770579038208,"internally_reserved":0,"allocated":13107200,"data_stored":6476188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2501902336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077827756,"num_objects":-1078,"num_object_clones":0,"num_object_copies":-2156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3202,"num_write_kb":-1053297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-31,"num_bytes_recovered":-32505856,"num_keys_recovered":0,"num_objects_omap":-46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.960698"},"pg_stats":[{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970335+0000","last_change":"2024-01-22T05:14:58.960573+0000","last_active":"2024-01-22T05:14:58.970335+0000","last_peered":"2024-01-22T05:14:58.970335+0000","last_clean":"2024-01-22T05:14:58.970335+0000","last_became_active":"2024-01-22T05:14:58.960299+0000","last_became_peered":"2024-01-22T05:14:58.960299+0000","last_unstale":"2024-01-22T05:14:58.970335+0000","last_undegraded":"2024-01-22T05:14:58.970335+0000","last_fullsized":"2024-01-22T05:14:58.970335+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3f","version":"130'3","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.964813+0000","last_change":"2024-01-22T05:14:58.502503+0000","last_active":"2024-01-22T05:14:58.964813+0000","last_peered":"2024-01-22T05:14:58.964813+0000","last_clean":"2024-01-22T05:14:58.964813+0000","last_became_active":"2024-01-22T05:14:58.502205+0000","last_became_peered":"2024-01-22T05:14:58.502205+0000","last_unstale":"2024-01-22T05:14:58.964813+0000","last_undegraded":"2024-01-22T05:14:58.964813+0000","last_fullsized":"2024-01-22T05:14:58.964813+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.974450+0000","last_change":"2024-01-22T05:14:58.962565+0000","last_active":"2024-01-22T05:14:58.974450+0000","last_peered":"2024-01-22T05:14:58.974450+0000","last_clean":"2024-01-22T05:14:58.974450+0000","last_became_active":"2024-01-22T05:14:58.962283+0000","last_became_peered":"2024-01-22T05:14:58.962283+0000","last_unstale":"2024-01-22T05:14:58.974450+0000","last_undegraded":"2024-01-22T05:14:58.974450+0000","last_fullsized":"2024-01-22T05:14:58.974450+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.953376+0000","last_change":"2024-01-22T05:14:58.518261+0000","last_active":"2024-01-22T05:14:58.953376+0000","last_peered":"2024-01-22T05:14:58.953376+0000","last_clean":"2024-01-22T05:14:58.953376+0000","last_became_active":"2024-01-22T05:14:58.516568+0000","last_became_peered":"2024-01-22T05:14:58.516568+0000","last_unstale":"2024-01-22T05:14:58.953376+0000","last_undegraded":"2024-01-22T05:14:58.953376+0000","last_fullsized":"2024-01-22T05:14:58.953376+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.974635+0000","last_change":"2024-01-22T05:14:58.960667+0000","last_active":"2024-01-22T05:14:58.974635+0000","last_peered":"2024-01-22T05:14:58.974635+0000","last_clean":"2024-01-22T05:14:58.974635+0000","last_became_active":"2024-01-22T05:14:58.960287+0000","last_became_peered":"2024-01-22T05:14:58.960287+0000","last_unstale":"2024-01-22T05:14:58.974635+0000","last_undegraded":"2024-01-22T05:14:58.974635+0000","last_fullsized":"2024-01-22T05:14:58.974635+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.952636+0000","last_change":"2024-01-22T05:14:58.520206+0000","last_active":"2024-01-22T05:14:58.952636+0000","last_peered":"2024-01-22T05:14:58.952636+0000","last_clean":"2024-01-22T05:14:58.952636+0000","last_became_active":"2024-01-22T05:14:58.519785+0000","last_became_peered":"2024-01-22T05:14:58.519785+0000","last_unstale":"2024-01-22T05:14:58.952636+0000","last_undegraded":"2024-01-22T05:14:58.952636+0000","last_fullsized":"2024-01-22T05:14:58.952636+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.957098+0000","last_change":"2024-01-22T05:14:58.953408+0000","last_active":"2024-01-22T05:14:58.957098+0000","last_peered":"2024-01-22T05:14:58.957098+0000","last_clean":"2024-01-22T05:14:58.957098+0000","last_became_active":"2024-01-22T05:14:58.953132+0000","last_became_peered":"2024-01-22T05:14:58.953132+0000","last_unstale":"2024-01-22T05:14:58.957098+0000","last_undegraded":"2024-01-22T05:14:58.957098+0000","last_fullsized":"2024-01-22T05:14:58.957098+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.3c","version":"130'2","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.968610+0000","last_change":"2024-01-22T05:14:58.515350+0000","last_active":"2024-01-22T05:14:58.968610+0000","last_peered":"2024-01-22T05:14:58.968610+0000","last_clean":"2024-01-22T05:14:58.968610+0000","last_became_active":"2024-01-22T05:14:58.515045+0000","last_became_peered":"2024-01-22T05:14:58.515045+0000","last_unstale":"2024-01-22T05:14:58.968610+0000","last_undegraded":"2024-01-22T05:14:58.968610+0000","last_fullsized":"2024-01-22T05:14:58.968610+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.968959+0000","last_change":"2024-01-22T05:14:58.957495+0000","last_active":"2024-01-22T05:14:58.968959+0000","last_peered":"2024-01-22T05:14:58.968959+0000","last_clean":"2024-01-22T05:14:58.968959+0000","last_became_active":"2024-01-22T05:14:58.957234+0000","last_became_peered":"2024-01-22T05:14:58.957234+0000","last_unstale":"2024-01-22T05:14:58.968959+0000","last_undegraded":"2024-01-22T05:14:58.968959+0000","last_fullsized":"2024-01-22T05:14:58.968959+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3b","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.959302+0000","last_change":"2024-01-22T05:14:58.506080+0000","last_active":"2024-01-22T05:14:58.959302+0000","last_peered":"2024-01-22T05:14:58.959302+0000","last_clean":"2024-01-22T05:14:58.959302+0000","last_became_active":"2024-01-22T05:14:58.505807+0000","last_became_peered":"2024-01-22T05:14:58.505807+0000","last_unstale":"2024-01-22T05:14:58.959302+0000","last_undegraded":"2024-01-22T05:14:58.959302+0000","last_fullsized":"2024-01-22T05:14:58.959302+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965377+0000","last_change":"2024-01-22T05:14:58.958592+0000","last_active":"2024-01-22T05:14:58.965377+0000","last_peered":"2024-01-22T05:14:58.965377+0000","last_clean":"2024-01-22T05:14:58.965377+0000","last_became_active":"2024-01-22T05:14:58.958286+0000","last_became_peered":"2024-01-22T05:14:58.958286+0000","last_unstale":"2024-01-22T05:14:58.965377+0000","last_undegraded":"2024-01-22T05:14:58.965377+0000","last_fullsized":"2024-01-22T05:14:58.965377+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3a","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.969927+0000","last_change":"2024-01-22T05:14:58.522579+0000","last_active":"2024-01-22T05:14:58.969927+0000","last_peered":"2024-01-22T05:14:58.969927+0000","last_clean":"2024-01-22T05:14:58.969927+0000","last_became_active":"2024-01-22T05:14:58.522279+0000","last_became_peered":"2024-01-22T05:14:58.522279+0000","last_unstale":"2024-01-22T05:14:58.969927+0000","last_undegraded":"2024-01-22T05:14:58.969927+0000","last_fullsized":"2024-01-22T05:14:58.969927+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.971137+0000","last_change":"2024-01-22T05:14:58.968592+0000","last_active":"2024-01-22T05:14:58.971137+0000","last_peered":"2024-01-22T05:14:58.971137+0000","last_clean":"2024-01-22T05:14:58.971137+0000","last_became_active":"2024-01-22T05:14:58.968328+0000","last_became_peered":"2024-01-22T05:14:58.968328+0000","last_unstale":"2024-01-22T05:14:58.971137+0000","last_undegraded":"2024-01-22T05:14:58.971137+0000","last_fullsized":"2024-01-22T05:14:58.971137+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.935476+0000","last_change":"2024-01-22T05:14:58.511060+0000","last_active":"2024-01-22T05:14:58.935476+0000","last_peered":"2024-01-22T05:14:58.935476+0000","last_clean":"2024-01-22T05:14:58.935476+0000","last_became_active":"2024-01-22T05:14:58.510783+0000","last_became_peered":"2024-01-22T05:14:58.510783+0000","last_unstale":"2024-01-22T05:14:58.935476+0000","last_undegraded":"2024-01-22T05:14:58.935476+0000","last_fullsized":"2024-01-22T05:14:58.935476+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965497+0000","last_change":"2024-01-22T05:14:58.954694+0000","last_active":"2024-01-22T05:14:58.965497+0000","last_peered":"2024-01-22T05:14:58.965497+0000","last_clean":"2024-01-22T05:14:58.965497+0000","last_became_active":"2024-01-22T05:14:58.954328+0000","last_became_peered":"2024-01-22T05:14:58.954328+0000","last_unstale":"2024-01-22T05:14:58.965497+0000","last_undegraded":"2024-01-22T05:14:58.965497+0000","last_fullsized":"2024-01-22T05:14:58.965497+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.952796+0000","last_change":"2024-01-22T05:14:58.517338+0000","last_active":"2024-01-22T05:14:58.952796+0000","last_peered":"2024-01-22T05:14:58.952796+0000","last_clean":"2024-01-22T05:14:58.952796+0000","last_became_active":"2024-01-22T05:14:58.517008+0000","last_became_peered":"2024-01-22T05:14:58.517008+0000","last_unstale":"2024-01-22T05:14:58.952796+0000","last_undegraded":"2024-01-22T05:14:58.952796+0000","last_fullsized":"2024-01-22T05:14:58.952796+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.968555+0000","last_change":"2024-01-22T05:14:58.959891+0000","last_active":"2024-01-22T05:14:58.968555+0000","last_peered":"2024-01-22T05:14:58.968555+0000","last_clean":"2024-01-22T05:14:58.968555+0000","last_became_active":"2024-01-22T05:14:58.959627+0000","last_became_peered":"2024-01-22T05:14:58.959627+0000","last_unstale":"2024-01-22T05:14:58.968555+0000","last_undegraded":"2024-01-22T05:14:58.968555+0000","last_fullsized":"2024-01-22T05:14:58.968555+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.945647+0000","last_change":"2024-01-22T05:14:58.513549+0000","last_active":"2024-01-22T05:14:58.945647+0000","last_peered":"2024-01-22T05:14:58.945647+0000","last_clean":"2024-01-22T05:14:58.945647+0000","last_became_active":"2024-01-22T05:14:58.511467+0000","last_became_peered":"2024-01-22T05:14:58.511467+0000","last_unstale":"2024-01-22T05:14:58.945647+0000","last_undegraded":"2024-01-22T05:14:58.945647+0000","last_fullsized":"2024-01-22T05:14:58.945647+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965358+0000","last_change":"2024-01-22T05:14:58.962162+0000","last_active":"2024-01-22T05:14:58.965358+0000","last_peered":"2024-01-22T05:14:58.965358+0000","last_clean":"2024-01-22T05:14:58.965358+0000","last_became_active":"2024-01-22T05:14:58.960760+0000","last_became_peered":"2024-01-22T05:14:58.960760+0000","last_unstale":"2024-01-22T05:14:58.965358+0000","last_undegraded":"2024-01-22T05:14:58.965358+0000","last_fullsized":"2024-01-22T05:14:58.965358+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.953194+0000","last_change":"2024-01-22T05:14:58.515373+0000","last_active":"2024-01-22T05:14:58.953194+0000","last_peered":"2024-01-22T05:14:58.953194+0000","last_clean":"2024-01-22T05:14:58.953194+0000","last_became_active":"2024-01-22T05:14:58.515096+0000","last_became_peered":"2024-01-22T05:14:58.515096+0000","last_unstale":"2024-01-22T05:14:58.953194+0000","last_undegraded":"2024-01-22T05:14:58.953194+0000","last_fullsized":"2024-01-22T05:14:58.953194+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.968110+0000","last_change":"2024-01-22T05:14:58.963663+0000","last_active":"2024-01-22T05:14:58.968110+0000","last_peered":"2024-01-22T05:14:58.968110+0000","last_clean":"2024-01-22T05:14:58.968110+0000","last_became_active":"2024-01-22T05:14:58.963380+0000","last_became_peered":"2024-01-22T05:14:58.963380+0000","last_unstale":"2024-01-22T05:14:58.968110+0000","last_undegraded":"2024-01-22T05:14:58.968110+0000","last_fullsized":"2024-01-22T05:14:58.968110+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.938772+0000","last_change":"2024-01-22T05:14:58.496184+0000","last_active":"2024-01-22T05:14:58.938772+0000","last_peered":"2024-01-22T05:14:58.938772+0000","last_clean":"2024-01-22T05:14:58.938772+0000","last_became_active":"2024-01-22T05:14:58.495840+0000","last_became_peered":"2024-01-22T05:14:58.495840+0000","last_unstale":"2024-01-22T05:14:58.938772+0000","last_undegraded":"2024-01-22T05:14:58.938772+0000","last_fullsized":"2024-01-22T05:14:58.938772+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.968321+0000","last_change":"2024-01-22T05:14:58.960521+0000","last_active":"2024-01-22T05:14:58.968321+0000","last_peered":"2024-01-22T05:14:58.968321+0000","last_clean":"2024-01-22T05:14:58.968321+0000","last_became_active":"2024-01-22T05:14:58.960232+0000","last_became_peered":"2024-01-22T05:14:58.960232+0000","last_unstale":"2024-01-22T05:14:58.968321+0000","last_undegraded":"2024-01-22T05:14:58.968321+0000","last_fullsized":"2024-01-22T05:14:58.968321+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.34","version":"130'4","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.978151+0000","last_change":"2024-01-22T05:14:58.513268+0000","last_active":"2024-01-22T05:14:58.978151+0000","last_peered":"2024-01-22T05:14:58.978151+0000","last_clean":"2024-01-22T05:14:58.978151+0000","last_became_active":"2024-01-22T05:14:58.512682+0000","last_became_peered":"2024-01-22T05:14:58.512682+0000","last_unstale":"2024-01-22T05:14:58.978151+0000","last_undegraded":"2024-01-22T05:14:58.978151+0000","last_fullsized":"2024-01-22T05:14:58.978151+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.972682+0000","last_change":"2024-01-22T05:14:58.971408+0000","last_active":"2024-01-22T05:14:58.972682+0000","last_peered":"2024-01-22T05:14:58.972682+0000","last_clean":"2024-01-22T05:14:58.972682+0000","last_became_active":"2024-01-22T05:14:58.971123+0000","last_became_peered":"2024-01-22T05:14:58.971123+0000","last_unstale":"2024-01-22T05:14:58.972682+0000","last_undegraded":"2024-01-22T05:14:58.972682+0000","last_fullsized":"2024-01-22T05:14:58.972682+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.966106+0000","last_change":"2024-01-22T05:14:58.507257+0000","last_active":"2024-01-22T05:14:58.966106+0000","last_peered":"2024-01-22T05:14:58.966106+0000","last_clean":"2024-01-22T05:14:58.966106+0000","last_became_active":"2024-01-22T05:14:58.506988+0000","last_became_peered":"2024-01-22T05:14:58.506988+0000","last_unstale":"2024-01-22T05:14:58.966106+0000","last_undegraded":"2024-01-22T05:14:58.966106+0000","last_fullsized":"2024-01-22T05:14:58.966106+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.977795+0000","last_change":"2024-01-22T05:14:58.970566+0000","last_active":"2024-01-22T05:14:58.977795+0000","last_peered":"2024-01-22T05:14:58.977795+0000","last_clean":"2024-01-22T05:14:58.977795+0000","last_became_active":"2024-01-22T05:14:58.970077+0000","last_became_peered":"2024-01-22T05:14:58.970077+0000","last_unstale":"2024-01-22T05:14:58.977795+0000","last_undegraded":"2024-01-22T05:14:58.977795+0000","last_fullsized":"2024-01-22T05:14:58.977795+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.950809+0000","last_change":"2024-01-22T05:14:58.517478+0000","last_active":"2024-01-22T05:14:58.950809+0000","last_peered":"2024-01-22T05:14:58.950809+0000","last_clean":"2024-01-22T05:14:58.950809+0000","last_became_active":"2024-01-22T05:14:58.517270+0000","last_became_peered":"2024-01-22T05:14:58.517270+0000","last_unstale":"2024-01-22T05:14:58.950809+0000","last_undegraded":"2024-01-22T05:14:58.950809+0000","last_fullsized":"2024-01-22T05:14:58.950809+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.979741+0000","last_change":"2024-01-22T05:14:58.978591+0000","last_active":"2024-01-22T05:14:58.979741+0000","last_peered":"2024-01-22T05:14:58.979741+0000","last_clean":"2024-01-22T05:14:58.979741+0000","last_became_active":"2024-01-22T05:14:58.975666+0000","last_became_peered":"2024-01-22T05:14:58.975666+0000","last_unstale":"2024-01-22T05:14:58.979741+0000","last_undegraded":"2024-01-22T05:14:58.979741+0000","last_fullsized":"2024-01-22T05:14:58.979741+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.938589+0000","last_change":"2024-01-22T05:14:58.496338+0000","last_active":"2024-01-22T05:14:58.938589+0000","last_peered":"2024-01-22T05:14:58.938589+0000","last_clean":"2024-01-22T05:14:58.938589+0000","last_became_active":"2024-01-22T05:14:58.496015+0000","last_became_peered":"2024-01-22T05:14:58.496015+0000","last_unstale":"2024-01-22T05:14:58.938589+0000","last_undegraded":"2024-01-22T05:14:58.938589+0000","last_fullsized":"2024-01-22T05:14:58.938589+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.974561+0000","last_change":"2024-01-22T05:14:58.960744+0000","last_active":"2024-01-22T05:14:58.974561+0000","last_peered":"2024-01-22T05:14:58.974561+0000","last_clean":"2024-01-22T05:14:58.974561+0000","last_became_active":"2024-01-22T05:14:58.960465+0000","last_became_peered":"2024-01-22T05:14:58.960465+0000","last_unstale":"2024-01-22T05:14:58.974561+0000","last_undegraded":"2024-01-22T05:14:58.974561+0000","last_fullsized":"2024-01-22T05:14:58.974561+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.30","version":"130'4","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.975794+0000","last_change":"2024-01-22T05:14:58.507031+0000","last_active":"2024-01-22T05:14:58.975794+0000","last_peered":"2024-01-22T05:14:58.975794+0000","last_clean":"2024-01-22T05:14:58.975794+0000","last_became_active":"2024-01-22T05:14:58.506766+0000","last_became_peered":"2024-01-22T05:14:58.506766+0000","last_unstale":"2024-01-22T05:14:58.975794+0000","last_undegraded":"2024-01-22T05:14:58.975794+0000","last_fullsized":"2024-01-22T05:14:58.975794+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.973269+0000","last_change":"2024-01-22T05:14:58.965433+0000","last_active":"2024-01-22T05:14:58.973269+0000","last_peered":"2024-01-22T05:14:58.973269+0000","last_clean":"2024-01-22T05:14:58.973269+0000","last_became_active":"2024-01-22T05:14:58.965174+0000","last_became_peered":"2024-01-22T05:14:58.965174+0000","last_unstale":"2024-01-22T05:14:58.973269+0000","last_undegraded":"2024-01-22T05:14:58.973269+0000","last_fullsized":"2024-01-22T05:14:58.973269+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.950274+0000","last_change":"2024-01-22T05:14:58.501500+0000","last_active":"2024-01-22T05:14:58.950274+0000","last_peered":"2024-01-22T05:14:58.950274+0000","last_clean":"2024-01-22T05:14:58.950274+0000","last_became_active":"2024-01-22T05:14:58.500327+0000","last_became_peered":"2024-01-22T05:14:58.500327+0000","last_unstale":"2024-01-22T05:14:58.950274+0000","last_undegraded":"2024-01-22T05:14:58.950274+0000","last_fullsized":"2024-01-22T05:14:58.950274+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.959560+0000","last_change":"2024-01-22T05:14:58.952907+0000","last_active":"2024-01-22T05:14:58.959560+0000","last_peered":"2024-01-22T05:14:58.959560+0000","last_clean":"2024-01-22T05:14:58.959560+0000","last_became_active":"2024-01-22T05:14:58.952601+0000","last_became_peered":"2024-01-22T05:14:58.952601+0000","last_unstale":"2024-01-22T05:14:58.959560+0000","last_undegraded":"2024-01-22T05:14:58.959560+0000","last_fullsized":"2024-01-22T05:14:58.959560+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.953501+0000","last_change":"2024-01-22T05:14:58.511528+0000","last_active":"2024-01-22T05:14:58.953501+0000","last_peered":"2024-01-22T05:14:58.953501+0000","last_clean":"2024-01-22T05:14:58.953501+0000","last_became_active":"2024-01-22T05:14:58.511249+0000","last_became_peered":"2024-01-22T05:14:58.511249+0000","last_unstale":"2024-01-22T05:14:58.953501+0000","last_undegraded":"2024-01-22T05:14:58.953501+0000","last_fullsized":"2024-01-22T05:14:58.953501+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.974135+0000","last_change":"2024-01-22T05:14:58.970598+0000","last_active":"2024-01-22T05:14:58.974135+0000","last_peered":"2024-01-22T05:14:58.974135+0000","last_clean":"2024-01-22T05:14:58.974135+0000","last_became_active":"2024-01-22T05:14:58.970241+0000","last_became_peered":"2024-01-22T05:14:58.970241+0000","last_unstale":"2024-01-22T05:14:58.974135+0000","last_undegraded":"2024-01-22T05:14:58.974135+0000","last_fullsized":"2024-01-22T05:14:58.974135+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.959832+0000","last_change":"2024-01-22T05:14:58.508820+0000","last_active":"2024-01-22T05:14:58.959832+0000","last_peered":"2024-01-22T05:14:58.959832+0000","last_clean":"2024-01-22T05:14:58.959832+0000","last_became_active":"2024-01-22T05:14:58.508554+0000","last_became_peered":"2024-01-22T05:14:58.508554+0000","last_unstale":"2024-01-22T05:14:58.959832+0000","last_undegraded":"2024-01-22T05:14:58.959832+0000","last_fullsized":"2024-01-22T05:14:58.959832+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.963908+0000","last_change":"2024-01-22T05:14:58.954573+0000","last_active":"2024-01-22T05:14:58.963908+0000","last_peered":"2024-01-22T05:14:58.963908+0000","last_clean":"2024-01-22T05:14:58.963908+0000","last_became_active":"2024-01-22T05:14:58.954273+0000","last_became_peered":"2024-01-22T05:14:58.954273+0000","last_unstale":"2024-01-22T05:14:58.963908+0000","last_undegraded":"2024-01-22T05:14:58.963908+0000","last_fullsized":"2024-01-22T05:14:58.963908+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.952882+0000","last_change":"2024-01-22T05:14:58.514152+0000","last_active":"2024-01-22T05:14:58.952882+0000","last_peered":"2024-01-22T05:14:58.952882+0000","last_clean":"2024-01-22T05:14:58.952882+0000","last_became_active":"2024-01-22T05:14:58.513862+0000","last_became_peered":"2024-01-22T05:14:58.513862+0000","last_unstale":"2024-01-22T05:14:58.952882+0000","last_undegraded":"2024-01-22T05:14:58.952882+0000","last_fullsized":"2024-01-22T05:14:58.952882+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.967048+0000","last_change":"2024-01-22T05:14:58.957112+0000","last_active":"2024-01-22T05:14:58.967048+0000","last_peered":"2024-01-22T05:14:58.967048+0000","last_clean":"2024-01-22T05:14:58.967048+0000","last_became_active":"2024-01-22T05:14:58.956821+0000","last_became_peered":"2024-01-22T05:14:58.956821+0000","last_unstale":"2024-01-22T05:14:58.967048+0000","last_undegraded":"2024-01-22T05:14:58.967048+0000","last_fullsized":"2024-01-22T05:14:58.967048+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2b","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970246+0000","last_change":"2024-01-22T05:14:58.513380+0000","last_active":"2024-01-22T05:14:58.970246+0000","last_peered":"2024-01-22T05:14:58.970246+0000","last_clean":"2024-01-22T05:14:58.970246+0000","last_became_active":"2024-01-22T05:14:58.509622+0000","last_became_peered":"2024-01-22T05:14:58.509622+0000","last_unstale":"2024-01-22T05:14:58.970246+0000","last_undegraded":"2024-01-22T05:14:58.970246+0000","last_fullsized":"2024-01-22T05:14:58.970246+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965396+0000","last_change":"2024-01-22T05:14:58.958600+0000","last_active":"2024-01-22T05:14:58.965396+0000","last_peered":"2024-01-22T05:14:58.965396+0000","last_clean":"2024-01-22T05:14:58.965396+0000","last_became_active":"2024-01-22T05:14:58.958221+0000","last_became_peered":"2024-01-22T05:14:58.958221+0000","last_unstale":"2024-01-22T05:14:58.965396+0000","last_undegraded":"2024-01-22T05:14:58.965396+0000","last_fullsized":"2024-01-22T05:14:58.965396+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.937506+0000","last_change":"2024-01-22T05:14:58.511853+0000","last_active":"2024-01-22T05:14:58.937506+0000","last_peered":"2024-01-22T05:14:58.937506+0000","last_clean":"2024-01-22T05:14:58.937506+0000","last_became_active":"2024-01-22T05:14:58.511445+0000","last_became_peered":"2024-01-22T05:14:58.511445+0000","last_unstale":"2024-01-22T05:14:58.937506+0000","last_undegraded":"2024-01-22T05:14:58.937506+0000","last_fullsized":"2024-01-22T05:14:58.937506+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.951801+0000","last_change":"2024-01-22T05:14:58.947697+0000","last_active":"2024-01-22T05:14:58.951801+0000","last_peered":"2024-01-22T05:14:58.951801+0000","last_clean":"2024-01-22T05:14:58.951801+0000","last_became_active":"2024-01-22T05:14:58.947373+0000","last_became_peered":"2024-01-22T05:14:58.947373+0000","last_unstale":"2024-01-22T05:14:58.951801+0000","last_undegraded":"2024-01-22T05:14:58.951801+0000","last_fullsized":"2024-01-22T05:14:58.951801+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.944611+0000","last_change":"2024-01-22T05:14:58.518890+0000","last_active":"2024-01-22T05:14:58.944611+0000","last_peered":"2024-01-22T05:14:58.944611+0000","last_clean":"2024-01-22T05:14:58.944611+0000","last_became_active":"2024-01-22T05:14:58.518481+0000","last_became_peered":"2024-01-22T05:14:58.518481+0000","last_unstale":"2024-01-22T05:14:58.944611+0000","last_undegraded":"2024-01-22T05:14:58.944611+0000","last_fullsized":"2024-01-22T05:14:58.944611+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.964483+0000","last_change":"2024-01-22T05:14:58.961513+0000","last_active":"2024-01-22T05:14:58.964483+0000","last_peered":"2024-01-22T05:14:58.964483+0000","last_clean":"2024-01-22T05:14:58.964483+0000","last_became_active":"2024-01-22T05:14:58.961243+0000","last_became_peered":"2024-01-22T05:14:58.961243+0000","last_unstale":"2024-01-22T05:14:58.964483+0000","last_undegraded":"2024-01-22T05:14:58.964483+0000","last_fullsized":"2024-01-22T05:14:58.964483+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.934411+0000","last_change":"2024-01-22T05:14:58.505313+0000","last_active":"2024-01-22T05:14:58.934411+0000","last_peered":"2024-01-22T05:14:58.934411+0000","last_clean":"2024-01-22T05:14:58.934411+0000","last_became_active":"2024-01-22T05:14:58.504789+0000","last_became_peered":"2024-01-22T05:14:58.504789+0000","last_unstale":"2024-01-22T05:14:58.934411+0000","last_undegraded":"2024-01-22T05:14:58.934411+0000","last_fullsized":"2024-01-22T05:14:58.934411+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.979974+0000","last_change":"2024-01-22T05:14:58.979125+0000","last_active":"2024-01-22T05:14:58.979974+0000","last_peered":"2024-01-22T05:14:58.979974+0000","last_clean":"2024-01-22T05:14:58.979974+0000","last_became_active":"2024-01-22T05:14:58.977742+0000","last_became_peered":"2024-01-22T05:14:58.977742+0000","last_unstale":"2024-01-22T05:14:58.979974+0000","last_undegraded":"2024-01-22T05:14:58.979974+0000","last_fullsized":"2024-01-22T05:14:58.979974+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.937340+0000","last_change":"2024-01-22T05:14:58.505393+0000","last_active":"2024-01-22T05:14:58.937340+0000","last_peered":"2024-01-22T05:14:58.937340+0000","last_clean":"2024-01-22T05:14:58.937340+0000","last_became_active":"2024-01-22T05:14:58.504880+0000","last_became_peered":"2024-01-22T05:14:58.504880+0000","last_unstale":"2024-01-22T05:14:58.937340+0000","last_undegraded":"2024-01-22T05:14:58.937340+0000","last_fullsized":"2024-01-22T05:14:58.937340+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.971522+0000","last_change":"2024-01-22T05:14:58.962100+0000","last_active":"2024-01-22T05:14:58.971522+0000","last_peered":"2024-01-22T05:14:58.971522+0000","last_clean":"2024-01-22T05:14:58.971522+0000","last_became_active":"2024-01-22T05:14:58.961759+0000","last_became_peered":"2024-01-22T05:14:58.961759+0000","last_unstale":"2024-01-22T05:14:58.971522+0000","last_undegraded":"2024-01-22T05:14:58.971522+0000","last_fullsized":"2024-01-22T05:14:58.971522+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.953000+0000","last_change":"2024-01-22T05:14:58.520535+0000","last_active":"2024-01-22T05:14:58.953000+0000","last_peered":"2024-01-22T05:14:58.953000+0000","last_clean":"2024-01-22T05:14:58.953000+0000","last_became_active":"2024-01-22T05:14:58.520242+0000","last_became_peered":"2024-01-22T05:14:58.520242+0000","last_unstale":"2024-01-22T05:14:58.953000+0000","last_undegraded":"2024-01-22T05:14:58.953000+0000","last_fullsized":"2024-01-22T05:14:58.953000+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970912+0000","last_change":"2024-01-22T05:14:58.969089+0000","last_active":"2024-01-22T05:14:58.970912+0000","last_peered":"2024-01-22T05:14:58.970912+0000","last_clean":"2024-01-22T05:14:58.970912+0000","last_became_active":"2024-01-22T05:14:58.968788+0000","last_became_peered":"2024-01-22T05:14:58.968788+0000","last_unstale":"2024-01-22T05:14:58.970912+0000","last_undegraded":"2024-01-22T05:14:58.970912+0000","last_fullsized":"2024-01-22T05:14:58.970912+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.944439+0000","last_change":"2024-01-22T05:14:58.508652+0000","last_active":"2024-01-22T05:14:58.944439+0000","last_peered":"2024-01-22T05:14:58.944439+0000","last_clean":"2024-01-22T05:14:58.944439+0000","last_became_active":"2024-01-22T05:14:58.508221+0000","last_became_peered":"2024-01-22T05:14:58.508221+0000","last_unstale":"2024-01-22T05:14:58.944439+0000","last_undegraded":"2024-01-22T05:14:58.944439+0000","last_fullsized":"2024-01-22T05:14:58.944439+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.975346+0000","last_change":"2024-01-22T05:14:58.962101+0000","last_active":"2024-01-22T05:14:58.975346+0000","last_peered":"2024-01-22T05:14:58.975346+0000","last_clean":"2024-01-22T05:14:58.975346+0000","last_became_active":"2024-01-22T05:14:58.961844+0000","last_became_peered":"2024-01-22T05:14:58.961844+0000","last_unstale":"2024-01-22T05:14:58.975346+0000","last_undegraded":"2024-01-22T05:14:58.975346+0000","last_fullsized":"2024-01-22T05:14:58.975346+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.937407+0000","last_change":"2024-01-22T05:14:58.513091+0000","last_active":"2024-01-22T05:14:58.937407+0000","last_peered":"2024-01-22T05:14:58.937407+0000","last_clean":"2024-01-22T05:14:58.937407+0000","last_became_active":"2024-01-22T05:14:58.512371+0000","last_became_peered":"2024-01-22T05:14:58.512371+0000","last_unstale":"2024-01-22T05:14:58.937407+0000","last_undegraded":"2024-01-22T05:14:58.937407+0000","last_fullsized":"2024-01-22T05:14:58.937407+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.977613+0000","last_change":"2024-01-22T05:14:58.965163+0000","last_active":"2024-01-22T05:14:58.977613+0000","last_peered":"2024-01-22T05:14:58.977613+0000","last_clean":"2024-01-22T05:14:58.977613+0000","last_became_active":"2024-01-22T05:14:58.964566+0000","last_became_peered":"2024-01-22T05:14:58.964566+0000","last_unstale":"2024-01-22T05:14:58.977613+0000","last_undegraded":"2024-01-22T05:14:58.977613+0000","last_fullsized":"2024-01-22T05:14:58.977613+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.953732+0000","last_change":"2024-01-22T05:14:58.518663+0000","last_active":"2024-01-22T05:14:58.953732+0000","last_peered":"2024-01-22T05:14:58.953732+0000","last_clean":"2024-01-22T05:14:58.953732+0000","last_became_active":"2024-01-22T05:14:58.518309+0000","last_became_peered":"2024-01-22T05:14:58.518309+0000","last_unstale":"2024-01-22T05:14:58.953732+0000","last_undegraded":"2024-01-22T05:14:58.953732+0000","last_fullsized":"2024-01-22T05:14:58.953732+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.977772+0000","last_change":"2024-01-22T05:14:58.970343+0000","last_active":"2024-01-22T05:14:58.977772+0000","last_peered":"2024-01-22T05:14:58.977772+0000","last_clean":"2024-01-22T05:14:58.977772+0000","last_became_active":"2024-01-22T05:14:58.969778+0000","last_became_peered":"2024-01-22T05:14:58.969778+0000","last_unstale":"2024-01-22T05:14:58.977772+0000","last_undegraded":"2024-01-22T05:14:58.977772+0000","last_fullsized":"2024-01-22T05:14:58.977772+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.950919+0000","last_change":"2024-01-22T05:14:58.510006+0000","last_active":"2024-01-22T05:14:58.950919+0000","last_peered":"2024-01-22T05:14:58.950919+0000","last_clean":"2024-01-22T05:14:58.950919+0000","last_became_active":"2024-01-22T05:14:58.509717+0000","last_became_peered":"2024-01-22T05:14:58.509717+0000","last_unstale":"2024-01-22T05:14:58.950919+0000","last_undegraded":"2024-01-22T05:14:58.950919+0000","last_fullsized":"2024-01-22T05:14:58.950919+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970173+0000","last_change":"2024-01-22T05:14:58.963869+0000","last_active":"2024-01-22T05:14:58.970173+0000","last_peered":"2024-01-22T05:14:58.970173+0000","last_clean":"2024-01-22T05:14:58.970173+0000","last_became_active":"2024-01-22T05:14:58.963322+0000","last_became_peered":"2024-01-22T05:14:58.963322+0000","last_unstale":"2024-01-22T05:14:58.970173+0000","last_undegraded":"2024-01-22T05:14:58.970173+0000","last_fullsized":"2024-01-22T05:14:58.970173+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.934167+0000","last_change":"2024-01-22T05:14:58.503052+0000","last_active":"2024-01-22T05:14:58.934167+0000","last_peered":"2024-01-22T05:14:58.934167+0000","last_clean":"2024-01-22T05:14:58.934167+0000","last_became_active":"2024-01-22T05:14:58.502772+0000","last_became_peered":"2024-01-22T05:14:58.502772+0000","last_unstale":"2024-01-22T05:14:58.934167+0000","last_undegraded":"2024-01-22T05:14:58.934167+0000","last_fullsized":"2024-01-22T05:14:58.934167+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970559+0000","last_change":"2024-01-22T05:14:58.968564+0000","last_active":"2024-01-22T05:14:58.970559+0000","last_peered":"2024-01-22T05:14:58.970559+0000","last_clean":"2024-01-22T05:14:58.970559+0000","last_became_active":"2024-01-22T05:14:58.968101+0000","last_became_peered":"2024-01-22T05:14:58.968101+0000","last_unstale":"2024-01-22T05:14:58.970559+0000","last_undegraded":"2024-01-22T05:14:58.970559+0000","last_fullsized":"2024-01-22T05:14:58.970559+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.934534+0000","last_change":"2024-01-22T05:14:58.509898+0000","last_active":"2024-01-22T05:14:58.934534+0000","last_peered":"2024-01-22T05:14:58.934534+0000","last_clean":"2024-01-22T05:14:58.934534+0000","last_became_active":"2024-01-22T05:14:58.509463+0000","last_became_peered":"2024-01-22T05:14:58.509463+0000","last_unstale":"2024-01-22T05:14:58.934534+0000","last_undegraded":"2024-01-22T05:14:58.934534+0000","last_fullsized":"2024-01-22T05:14:58.934534+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.973249+0000","last_change":"2024-01-22T05:14:58.964923+0000","last_active":"2024-01-22T05:14:58.973249+0000","last_peered":"2024-01-22T05:14:58.973249+0000","last_clean":"2024-01-22T05:14:58.973249+0000","last_became_active":"2024-01-22T05:14:58.964619+0000","last_became_peered":"2024-01-22T05:14:58.964619+0000","last_unstale":"2024-01-22T05:14:58.973249+0000","last_undegraded":"2024-01-22T05:14:58.973249+0000","last_fullsized":"2024-01-22T05:14:58.973249+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.971512+0000","last_change":"2024-01-22T05:14:58.510741+0000","last_active":"2024-01-22T05:14:58.971512+0000","last_peered":"2024-01-22T05:14:58.971512+0000","last_clean":"2024-01-22T05:14:58.971512+0000","last_became_active":"2024-01-22T05:14:58.510384+0000","last_became_peered":"2024-01-22T05:14:58.510384+0000","last_unstale":"2024-01-22T05:14:58.971512+0000","last_undegraded":"2024-01-22T05:14:58.971512+0000","last_fullsized":"2024-01-22T05:14:58.971512+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970730+0000","last_change":"2024-01-22T05:14:58.967863+0000","last_active":"2024-01-22T05:14:58.970730+0000","last_peered":"2024-01-22T05:14:58.970730+0000","last_clean":"2024-01-22T05:14:58.970730+0000","last_became_active":"2024-01-22T05:14:58.967568+0000","last_became_peered":"2024-01-22T05:14:58.967568+0000","last_unstale":"2024-01-22T05:14:58.970730+0000","last_undegraded":"2024-01-22T05:14:58.970730+0000","last_fullsized":"2024-01-22T05:14:58.970730+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.954987+0000","last_change":"2024-01-22T05:14:58.511538+0000","last_active":"2024-01-22T05:14:58.954987+0000","last_peered":"2024-01-22T05:14:58.954987+0000","last_clean":"2024-01-22T05:14:58.954987+0000","last_became_active":"2024-01-22T05:14:58.511261+0000","last_became_peered":"2024-01-22T05:14:58.511261+0000","last_unstale":"2024-01-22T05:14:58.954987+0000","last_undegraded":"2024-01-22T05:14:58.954987+0000","last_fullsized":"2024-01-22T05:14:58.954987+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.966067+0000","last_change":"2024-01-22T05:14:58.961638+0000","last_active":"2024-01-22T05:14:58.966067+0000","last_peered":"2024-01-22T05:14:58.966067+0000","last_clean":"2024-01-22T05:14:58.966067+0000","last_became_active":"2024-01-22T05:14:58.961376+0000","last_became_peered":"2024-01-22T05:14:58.961376+0000","last_unstale":"2024-01-22T05:14:58.966067+0000","last_undegraded":"2024-01-22T05:14:58.966067+0000","last_fullsized":"2024-01-22T05:14:58.966067+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"130'2","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970049+0000","last_change":"2024-01-22T05:14:58.522574+0000","last_active":"2024-01-22T05:14:58.970049+0000","last_peered":"2024-01-22T05:14:58.970049+0000","last_clean":"2024-01-22T05:14:58.970049+0000","last_became_active":"2024-01-22T05:14:58.522183+0000","last_became_peered":"2024-01-22T05:14:58.522183+0000","last_unstale":"2024-01-22T05:14:58.970049+0000","last_undegraded":"2024-01-22T05:14:58.970049+0000","last_fullsized":"2024-01-22T05:14:58.970049+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965702+0000","last_change":"2024-01-22T05:14:58.962492+0000","last_active":"2024-01-22T05:14:58.965702+0000","last_peered":"2024-01-22T05:14:58.965702+0000","last_clean":"2024-01-22T05:14:58.965702+0000","last_became_active":"2024-01-22T05:14:58.961997+0000","last_became_peered":"2024-01-22T05:14:58.961997+0000","last_unstale":"2024-01-22T05:14:58.965702+0000","last_undegraded":"2024-01-22T05:14:58.965702+0000","last_fullsized":"2024-01-22T05:14:58.965702+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.950228+0000","last_change":"2024-01-22T05:14:58.515963+0000","last_active":"2024-01-22T05:14:58.950228+0000","last_peered":"2024-01-22T05:14:58.950228+0000","last_clean":"2024-01-22T05:14:58.950228+0000","last_became_active":"2024-01-22T05:14:58.515685+0000","last_became_peered":"2024-01-22T05:14:58.515685+0000","last_unstale":"2024-01-22T05:14:58.950228+0000","last_undegraded":"2024-01-22T05:14:58.950228+0000","last_fullsized":"2024-01-22T05:14:58.950228+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.973906+0000","last_change":"2024-01-22T05:14:58.968710+0000","last_active":"2024-01-22T05:14:58.973906+0000","last_peered":"2024-01-22T05:14:58.973906+0000","last_clean":"2024-01-22T05:14:58.973906+0000","last_became_active":"2024-01-22T05:14:58.968439+0000","last_became_peered":"2024-01-22T05:14:58.968439+0000","last_unstale":"2024-01-22T05:14:58.973906+0000","last_undegraded":"2024-01-22T05:14:58.973906+0000","last_fullsized":"2024-01-22T05:14:58.973906+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.951992+0000","last_change":"2024-01-22T05:14:58.518625+0000","last_active":"2024-01-22T05:14:58.951992+0000","last_peered":"2024-01-22T05:14:58.951992+0000","last_clean":"2024-01-22T05:14:58.951992+0000","last_became_active":"2024-01-22T05:14:58.518358+0000","last_became_peered":"2024-01-22T05:14:58.518358+0000","last_unstale":"2024-01-22T05:14:58.951992+0000","last_undegraded":"2024-01-22T05:14:58.951992+0000","last_fullsized":"2024-01-22T05:14:58.951992+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.954833+0000","last_change":"2024-01-22T05:14:58.947003+0000","last_active":"2024-01-22T05:14:58.954833+0000","last_peered":"2024-01-22T05:14:58.954833+0000","last_clean":"2024-01-22T05:14:58.954833+0000","last_became_active":"2024-01-22T05:14:58.946704+0000","last_became_peered":"2024-01-22T05:14:58.946704+0000","last_unstale":"2024-01-22T05:14:58.954833+0000","last_undegraded":"2024-01-22T05:14:58.954833+0000","last_fullsized":"2024-01-22T05:14:58.954833+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.951007+0000","last_change":"2024-01-22T05:14:58.505910+0000","last_active":"2024-01-22T05:14:58.951007+0000","last_peered":"2024-01-22T05:14:58.951007+0000","last_clean":"2024-01-22T05:14:58.951007+0000","last_became_active":"2024-01-22T05:14:58.505393+0000","last_became_peered":"2024-01-22T05:14:58.505393+0000","last_unstale":"2024-01-22T05:14:58.951007+0000","last_undegraded":"2024-01-22T05:14:58.951007+0000","last_fullsized":"2024-01-22T05:14:58.951007+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.971126+0000","last_change":"2024-01-22T05:14:58.968587+0000","last_active":"2024-01-22T05:14:58.971126+0000","last_peered":"2024-01-22T05:14:58.971126+0000","last_clean":"2024-01-22T05:14:58.971126+0000","last_became_active":"2024-01-22T05:14:58.966395+0000","last_became_peered":"2024-01-22T05:14:58.966395+0000","last_unstale":"2024-01-22T05:14:58.971126+0000","last_undegraded":"2024-01-22T05:14:58.971126+0000","last_fullsized":"2024-01-22T05:14:58.971126+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.938655+0000","last_change":"2024-01-22T05:14:58.508944+0000","last_active":"2024-01-22T05:14:58.938655+0000","last_peered":"2024-01-22T05:14:58.938655+0000","last_clean":"2024-01-22T05:14:58.938655+0000","last_became_active":"2024-01-22T05:14:58.508671+0000","last_became_peered":"2024-01-22T05:14:58.508671+0000","last_unstale":"2024-01-22T05:14:58.938655+0000","last_undegraded":"2024-01-22T05:14:58.938655+0000","last_fullsized":"2024-01-22T05:14:58.938655+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.972661+0000","last_change":"2024-01-22T05:14:58.969478+0000","last_active":"2024-01-22T05:14:58.972661+0000","last_peered":"2024-01-22T05:14:58.972661+0000","last_clean":"2024-01-22T05:14:58.972661+0000","last_became_active":"2024-01-22T05:14:58.969160+0000","last_became_peered":"2024-01-22T05:14:58.969160+0000","last_unstale":"2024-01-22T05:14:58.972661+0000","last_undegraded":"2024-01-22T05:14:58.972661+0000","last_fullsized":"2024-01-22T05:14:58.972661+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.949085+0000","last_change":"2024-01-22T05:14:58.509898+0000","last_active":"2024-01-22T05:14:58.949085+0000","last_peered":"2024-01-22T05:14:58.949085+0000","last_clean":"2024-01-22T05:14:58.949085+0000","last_became_active":"2024-01-22T05:14:58.509605+0000","last_became_peered":"2024-01-22T05:14:58.509605+0000","last_unstale":"2024-01-22T05:14:58.949085+0000","last_undegraded":"2024-01-22T05:14:58.949085+0000","last_fullsized":"2024-01-22T05:14:58.949085+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970003+0000","last_change":"2024-01-22T05:14:58.967117+0000","last_active":"2024-01-22T05:14:58.970003+0000","last_peered":"2024-01-22T05:14:58.970003+0000","last_clean":"2024-01-22T05:14:58.970003+0000","last_became_active":"2024-01-22T05:14:58.966816+0000","last_became_peered":"2024-01-22T05:14:58.966816+0000","last_unstale":"2024-01-22T05:14:58.970003+0000","last_undegraded":"2024-01-22T05:14:58.970003+0000","last_fullsized":"2024-01-22T05:14:58.970003+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.961028+0000","last_change":"2024-01-22T05:14:58.507527+0000","last_active":"2024-01-22T05:14:58.961028+0000","last_peered":"2024-01-22T05:14:58.961028+0000","last_clean":"2024-01-22T05:14:58.961028+0000","last_became_active":"2024-01-22T05:14:58.507191+0000","last_became_peered":"2024-01-22T05:14:58.507191+0000","last_unstale":"2024-01-22T05:14:58.961028+0000","last_undegraded":"2024-01-22T05:14:58.961028+0000","last_fullsized":"2024-01-22T05:14:58.961028+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.954278+0000","last_change":"2024-01-22T05:14:58.950882+0000","last_active":"2024-01-22T05:14:58.954278+0000","last_peered":"2024-01-22T05:14:58.954278+0000","last_clean":"2024-01-22T05:14:58.954278+0000","last_became_active":"2024-01-22T05:14:58.950565+0000","last_became_peered":"2024-01-22T05:14:58.950565+0000","last_unstale":"2024-01-22T05:14:58.954278+0000","last_undegraded":"2024-01-22T05:14:58.954278+0000","last_fullsized":"2024-01-22T05:14:58.954278+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"130'2","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.967591+0000","last_change":"2024-01-22T05:14:58.514487+0000","last_active":"2024-01-22T05:14:58.967591+0000","last_peered":"2024-01-22T05:14:58.967591+0000","last_clean":"2024-01-22T05:14:58.967591+0000","last_became_active":"2024-01-22T05:14:58.514191+0000","last_became_peered":"2024-01-22T05:14:58.514191+0000","last_unstale":"2024-01-22T05:14:58.967591+0000","last_undegraded":"2024-01-22T05:14:58.967591+0000","last_fullsized":"2024-01-22T05:14:58.967591+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.979690+0000","last_change":"2024-01-22T05:14:58.978160+0000","last_active":"2024-01-22T05:14:58.979690+0000","last_peered":"2024-01-22T05:14:58.979690+0000","last_clean":"2024-01-22T05:14:58.979690+0000","last_became_active":"2024-01-22T05:14:58.977903+0000","last_became_peered":"2024-01-22T05:14:58.977903+0000","last_unstale":"2024-01-22T05:14:58.979690+0000","last_undegraded":"2024-01-22T05:14:58.979690+0000","last_fullsized":"2024-01-22T05:14:58.979690+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.938802+0000","last_change":"2024-01-22T05:14:58.513546+0000","last_active":"2024-01-22T05:14:58.938802+0000","last_peered":"2024-01-22T05:14:58.938802+0000","last_clean":"2024-01-22T05:14:58.938802+0000","last_became_active":"2024-01-22T05:14:58.513269+0000","last_became_peered":"2024-01-22T05:14:58.513269+0000","last_unstale":"2024-01-22T05:14:58.938802+0000","last_undegraded":"2024-01-22T05:14:58.938802+0000","last_fullsized":"2024-01-22T05:14:58.938802+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.971103+0000","last_change":"2024-01-22T05:14:58.966764+0000","last_active":"2024-01-22T05:14:58.971103+0000","last_peered":"2024-01-22T05:14:58.971103+0000","last_clean":"2024-01-22T05:14:58.971103+0000","last_became_active":"2024-01-22T05:14:58.966465+0000","last_became_peered":"2024-01-22T05:14:58.966465+0000","last_unstale":"2024-01-22T05:14:58.971103+0000","last_undegraded":"2024-01-22T05:14:58.971103+0000","last_fullsized":"2024-01-22T05:14:58.971103+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.935125+0000","last_change":"2024-01-22T05:14:58.512528+0000","last_active":"2024-01-22T05:14:58.935125+0000","last_peered":"2024-01-22T05:14:58.935125+0000","last_clean":"2024-01-22T05:14:58.935125+0000","last_became_active":"2024-01-22T05:14:58.511991+0000","last_became_peered":"2024-01-22T05:14:58.511991+0000","last_unstale":"2024-01-22T05:14:58.935125+0000","last_undegraded":"2024-01-22T05:14:58.935125+0000","last_fullsized":"2024-01-22T05:14:58.935125+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.974364+0000","last_change":"2024-01-22T05:14:58.962016+0000","last_active":"2024-01-22T05:14:58.974364+0000","last_peered":"2024-01-22T05:14:58.974364+0000","last_clean":"2024-01-22T05:14:58.974364+0000","last_became_active":"2024-01-22T05:14:58.961746+0000","last_became_peered":"2024-01-22T05:14:58.961746+0000","last_unstale":"2024-01-22T05:14:58.974364+0000","last_undegraded":"2024-01-22T05:14:58.974364+0000","last_fullsized":"2024-01-22T05:14:58.974364+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.966150+0000","last_change":"2024-01-22T05:14:58.499286+0000","last_active":"2024-01-22T05:14:58.966150+0000","last_peered":"2024-01-22T05:14:58.966150+0000","last_clean":"2024-01-22T05:14:58.966150+0000","last_became_active":"2024-01-22T05:14:58.498934+0000","last_became_peered":"2024-01-22T05:14:58.498934+0000","last_unstale":"2024-01-22T05:14:58.966150+0000","last_undegraded":"2024-01-22T05:14:58.966150+0000","last_fullsized":"2024-01-22T05:14:58.966150+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.969418+0000","last_change":"2024-01-22T05:14:58.959799+0000","last_active":"2024-01-22T05:14:58.969418+0000","last_peered":"2024-01-22T05:14:58.969418+0000","last_clean":"2024-01-22T05:14:58.969418+0000","last_became_active":"2024-01-22T05:14:58.959146+0000","last_became_peered":"2024-01-22T05:14:58.959146+0000","last_unstale":"2024-01-22T05:14:58.969418+0000","last_undegraded":"2024-01-22T05:14:58.969418+0000","last_fullsized":"2024-01-22T05:14:58.969418+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.951101+0000","last_change":"2024-01-22T05:14:58.517714+0000","last_active":"2024-01-22T05:14:58.951101+0000","last_peered":"2024-01-22T05:14:58.951101+0000","last_clean":"2024-01-22T05:14:58.951101+0000","last_became_active":"2024-01-22T05:14:58.516092+0000","last_became_peered":"2024-01-22T05:14:58.516092+0000","last_unstale":"2024-01-22T05:14:58.951101+0000","last_undegraded":"2024-01-22T05:14:58.951101+0000","last_fullsized":"2024-01-22T05:14:58.951101+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.966103+0000","last_change":"2024-01-22T05:14:58.956399+0000","last_active":"2024-01-22T05:14:58.966103+0000","last_peered":"2024-01-22T05:14:58.966103+0000","last_clean":"2024-01-22T05:14:58.966103+0000","last_became_active":"2024-01-22T05:14:58.956101+0000","last_became_peered":"2024-01-22T05:14:58.956101+0000","last_unstale":"2024-01-22T05:14:58.966103+0000","last_undegraded":"2024-01-22T05:14:58.966103+0000","last_fullsized":"2024-01-22T05:14:58.966103+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.951415+0000","last_change":"2024-01-22T05:14:58.505070+0000","last_active":"2024-01-22T05:14:58.951415+0000","last_peered":"2024-01-22T05:14:58.951415+0000","last_clean":"2024-01-22T05:14:58.951415+0000","last_became_active":"2024-01-22T05:14:58.504744+0000","last_became_peered":"2024-01-22T05:14:58.504744+0000","last_unstale":"2024-01-22T05:14:58.951415+0000","last_undegraded":"2024-01-22T05:14:58.951415+0000","last_fullsized":"2024-01-22T05:14:58.951415+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970538+0000","last_change":"2024-01-22T05:14:58.968380+0000","last_active":"2024-01-22T05:14:58.970538+0000","last_peered":"2024-01-22T05:14:58.970538+0000","last_clean":"2024-01-22T05:14:58.970538+0000","last_became_active":"2024-01-22T05:14:58.967708+0000","last_became_peered":"2024-01-22T05:14:58.967708+0000","last_unstale":"2024-01-22T05:14:58.970538+0000","last_undegraded":"2024-01-22T05:14:58.970538+0000","last_fullsized":"2024-01-22T05:14:58.970538+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.935728+0000","last_change":"2024-01-22T05:14:58.515228+0000","last_active":"2024-01-22T05:14:58.935728+0000","last_peered":"2024-01-22T05:14:58.935728+0000","last_clean":"2024-01-22T05:14:58.935728+0000","last_became_active":"2024-01-22T05:14:58.514951+0000","last_became_peered":"2024-01-22T05:14:58.514951+0000","last_unstale":"2024-01-22T05:14:58.935728+0000","last_undegraded":"2024-01-22T05:14:58.935728+0000","last_fullsized":"2024-01-22T05:14:58.935728+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.947955+0000","last_change":"2024-01-22T05:14:58.941930+0000","last_active":"2024-01-22T05:14:58.947955+0000","last_peered":"2024-01-22T05:14:58.947955+0000","last_clean":"2024-01-22T05:14:58.947955+0000","last_became_active":"2024-01-22T05:14:58.941612+0000","last_became_peered":"2024-01-22T05:14:58.941612+0000","last_unstale":"2024-01-22T05:14:58.947955+0000","last_undegraded":"2024-01-22T05:14:58.947955+0000","last_fullsized":"2024-01-22T05:14:58.947955+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"130'2","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.975969+0000","last_change":"2024-01-22T05:14:58.510233+0000","last_active":"2024-01-22T05:14:58.975969+0000","last_peered":"2024-01-22T05:14:58.975969+0000","last_clean":"2024-01-22T05:14:58.975969+0000","last_became_active":"2024-01-22T05:14:58.507555+0000","last_became_peered":"2024-01-22T05:14:58.507555+0000","last_unstale":"2024-01-22T05:14:58.975969+0000","last_undegraded":"2024-01-22T05:14:58.975969+0000","last_fullsized":"2024-01-22T05:14:58.975969+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.977834+0000","last_change":"2024-01-22T05:14:58.965627+0000","last_active":"2024-01-22T05:14:58.977834+0000","last_peered":"2024-01-22T05:14:58.977834+0000","last_clean":"2024-01-22T05:14:58.977834+0000","last_became_active":"2024-01-22T05:14:58.964961+0000","last_became_peered":"2024-01-22T05:14:58.964961+0000","last_unstale":"2024-01-22T05:14:58.977834+0000","last_undegraded":"2024-01-22T05:14:58.977834+0000","last_fullsized":"2024-01-22T05:14:58.977834+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.947715+0000","last_change":"2024-01-22T05:14:58.516775+0000","last_active":"2024-01-22T05:14:58.947715+0000","last_peered":"2024-01-22T05:14:58.947715+0000","last_clean":"2024-01-22T05:14:58.947715+0000","last_became_active":"2024-01-22T05:14:58.515517+0000","last_became_peered":"2024-01-22T05:14:58.515517+0000","last_unstale":"2024-01-22T05:14:58.947715+0000","last_undegraded":"2024-01-22T05:14:58.947715+0000","last_fullsized":"2024-01-22T05:14:58.947715+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970960+0000","last_change":"2024-01-22T05:14:58.962486+0000","last_active":"2024-01-22T05:14:58.970960+0000","last_peered":"2024-01-22T05:14:58.970960+0000","last_clean":"2024-01-22T05:14:58.970960+0000","last_became_active":"2024-01-22T05:14:58.960390+0000","last_became_peered":"2024-01-22T05:14:58.960390+0000","last_unstale":"2024-01-22T05:14:58.970960+0000","last_undegraded":"2024-01-22T05:14:58.970960+0000","last_fullsized":"2024-01-22T05:14:58.970960+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.950363+0000","last_change":"2024-01-22T05:14:58.509026+0000","last_active":"2024-01-22T05:14:58.950363+0000","last_peered":"2024-01-22T05:14:58.950363+0000","last_clean":"2024-01-22T05:14:58.950363+0000","last_became_active":"2024-01-22T05:14:58.507991+0000","last_became_peered":"2024-01-22T05:14:58.507991+0000","last_unstale":"2024-01-22T05:14:58.950363+0000","last_undegraded":"2024-01-22T05:14:58.950363+0000","last_fullsized":"2024-01-22T05:14:58.950363+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.969084+0000","last_change":"2024-01-22T05:14:58.958194+0000","last_active":"2024-01-22T05:14:58.969084+0000","last_peered":"2024-01-22T05:14:58.969084+0000","last_clean":"2024-01-22T05:14:58.969084+0000","last_became_active":"2024-01-22T05:14:58.957933+0000","last_became_peered":"2024-01-22T05:14:58.957933+0000","last_unstale":"2024-01-22T05:14:58.969084+0000","last_undegraded":"2024-01-22T05:14:58.969084+0000","last_fullsized":"2024-01-22T05:14:58.969084+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.939979+0000","last_change":"2024-01-22T05:14:58.523320+0000","last_active":"2024-01-22T05:14:58.939979+0000","last_peered":"2024-01-22T05:14:58.939979+0000","last_clean":"2024-01-22T05:14:58.939979+0000","last_became_active":"2024-01-22T05:14:58.522642+0000","last_became_peered":"2024-01-22T05:14:58.522642+0000","last_unstale":"2024-01-22T05:14:58.939979+0000","last_undegraded":"2024-01-22T05:14:58.939979+0000","last_fullsized":"2024-01-22T05:14:58.939979+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965606+0000","last_change":"2024-01-22T05:14:58.960741+0000","last_active":"2024-01-22T05:14:58.965606+0000","last_peered":"2024-01-22T05:14:58.965606+0000","last_clean":"2024-01-22T05:14:58.965606+0000","last_became_active":"2024-01-22T05:14:58.960417+0000","last_became_peered":"2024-01-22T05:14:58.960417+0000","last_unstale":"2024-01-22T05:14:58.965606+0000","last_undegraded":"2024-01-22T05:14:58.965606+0000","last_fullsized":"2024-01-22T05:14:58.965606+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.952081+0000","last_change":"2024-01-22T05:14:58.516217+0000","last_active":"2024-01-22T05:14:58.952081+0000","last_peered":"2024-01-22T05:14:58.952081+0000","last_clean":"2024-01-22T05:14:58.952081+0000","last_became_active":"2024-01-22T05:14:58.515911+0000","last_became_peered":"2024-01-22T05:14:58.515911+0000","last_unstale":"2024-01-22T05:14:58.952081+0000","last_undegraded":"2024-01-22T05:14:58.952081+0000","last_fullsized":"2024-01-22T05:14:58.952081+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.959738+0000","last_change":"2024-01-22T05:14:58.956531+0000","last_active":"2024-01-22T05:14:58.959738+0000","last_peered":"2024-01-22T05:14:58.959738+0000","last_clean":"2024-01-22T05:14:58.959738+0000","last_became_active":"2024-01-22T05:14:58.955796+0000","last_became_peered":"2024-01-22T05:14:58.955796+0000","last_unstale":"2024-01-22T05:14:58.959738+0000","last_undegraded":"2024-01-22T05:14:58.959738+0000","last_fullsized":"2024-01-22T05:14:58.959738+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.948718+0000","last_change":"2024-01-22T05:14:58.520193+0000","last_active":"2024-01-22T05:14:58.948718+0000","last_peered":"2024-01-22T05:14:58.948718+0000","last_clean":"2024-01-22T05:14:58.948718+0000","last_became_active":"2024-01-22T05:14:58.519933+0000","last_became_peered":"2024-01-22T05:14:58.519933+0000","last_unstale":"2024-01-22T05:14:58.948718+0000","last_undegraded":"2024-01-22T05:14:58.948718+0000","last_fullsized":"2024-01-22T05:14:58.948718+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.973595+0000","last_change":"2024-01-22T05:14:58.965950+0000","last_active":"2024-01-22T05:14:58.973595+0000","last_peered":"2024-01-22T05:14:58.973595+0000","last_clean":"2024-01-22T05:14:58.973595+0000","last_became_active":"2024-01-22T05:14:58.965478+0000","last_became_peered":"2024-01-22T05:14:58.965478+0000","last_unstale":"2024-01-22T05:14:58.973595+0000","last_undegraded":"2024-01-22T05:14:58.973595+0000","last_fullsized":"2024-01-22T05:14:58.973595+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.951504+0000","last_change":"2024-01-22T05:14:58.517339+0000","last_active":"2024-01-22T05:14:58.951504+0000","last_peered":"2024-01-22T05:14:58.951504+0000","last_clean":"2024-01-22T05:14:58.951504+0000","last_became_active":"2024-01-22T05:14:58.517002+0000","last_became_peered":"2024-01-22T05:14:58.517002+0000","last_unstale":"2024-01-22T05:14:58.951504+0000","last_undegraded":"2024-01-22T05:14:58.951504+0000","last_fullsized":"2024-01-22T05:14:58.951504+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965076+0000","last_change":"2024-01-22T05:14:58.955165+0000","last_active":"2024-01-22T05:14:58.965076+0000","last_peered":"2024-01-22T05:14:58.965076+0000","last_clean":"2024-01-22T05:14:58.965076+0000","last_became_active":"2024-01-22T05:14:58.954873+0000","last_became_peered":"2024-01-22T05:14:58.954873+0000","last_unstale":"2024-01-22T05:14:58.965076+0000","last_undegraded":"2024-01-22T05:14:58.965076+0000","last_fullsized":"2024-01-22T05:14:58.965076+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.935965+0000","last_change":"2024-01-22T05:14:58.506446+0000","last_active":"2024-01-22T05:14:58.935965+0000","last_peered":"2024-01-22T05:14:58.935965+0000","last_clean":"2024-01-22T05:14:58.935965+0000","last_became_active":"2024-01-22T05:14:58.506157+0000","last_became_peered":"2024-01-22T05:14:58.506157+0000","last_unstale":"2024-01-22T05:14:58.935965+0000","last_undegraded":"2024-01-22T05:14:58.935965+0000","last_fullsized":"2024-01-22T05:14:58.935965+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.974739+0000","last_change":"2024-01-22T05:14:58.962411+0000","last_active":"2024-01-22T05:14:58.974739+0000","last_peered":"2024-01-22T05:14:58.974739+0000","last_clean":"2024-01-22T05:14:58.974739+0000","last_became_active":"2024-01-22T05:14:58.960956+0000","last_became_peered":"2024-01-22T05:14:58.960956+0000","last_unstale":"2024-01-22T05:14:58.974739+0000","last_undegraded":"2024-01-22T05:14:58.974739+0000","last_fullsized":"2024-01-22T05:14:58.974739+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.937457+0000","last_change":"2024-01-22T05:14:58.503361+0000","last_active":"2024-01-22T05:14:58.937457+0000","last_peered":"2024-01-22T05:14:58.937457+0000","last_clean":"2024-01-22T05:14:58.937457+0000","last_became_active":"2024-01-22T05:14:58.501935+0000","last_became_peered":"2024-01-22T05:14:58.501935+0000","last_unstale":"2024-01-22T05:14:58.937457+0000","last_undegraded":"2024-01-22T05:14:58.937457+0000","last_fullsized":"2024-01-22T05:14:58.937457+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.943862+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:14:58.943862+0000","last_peered":"2024-01-22T05:14:58.943862+0000","last_clean":"2024-01-22T05:14:58.943862+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:14:58.943862+0000","last_undegraded":"2024-01-22T05:14:58.943862+0000","last_fullsized":"2024-01-22T05:14:58.943862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.967444+0000","last_change":"2024-01-22T05:14:58.965046+0000","last_active":"2024-01-22T05:14:58.967444+0000","last_peered":"2024-01-22T05:14:58.967444+0000","last_clean":"2024-01-22T05:14:58.967444+0000","last_became_active":"2024-01-22T05:14:58.964755+0000","last_became_peered":"2024-01-22T05:14:58.964755+0000","last_unstale":"2024-01-22T05:14:58.967444+0000","last_undegraded":"2024-01-22T05:14:58.967444+0000","last_fullsized":"2024-01-22T05:14:58.967444+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.953617+0000","last_change":"2024-01-22T05:14:58.518590+0000","last_active":"2024-01-22T05:14:58.953617+0000","last_peered":"2024-01-22T05:14:58.953617+0000","last_clean":"2024-01-22T05:14:58.953617+0000","last_became_active":"2024-01-22T05:14:58.518333+0000","last_became_peered":"2024-01-22T05:14:58.518333+0000","last_unstale":"2024-01-22T05:14:58.953617+0000","last_undegraded":"2024-01-22T05:14:58.953617+0000","last_fullsized":"2024-01-22T05:14:58.953617+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.953268+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:14:58.953268+0000","last_peered":"2024-01-22T05:14:58.953268+0000","last_clean":"2024-01-22T05:14:58.953268+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:14:58.953268+0000","last_undegraded":"2024-01-22T05:14:58.953268+0000","last_fullsized":"2024-01-22T05:14:58.953268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.969096+0000","last_change":"2024-01-22T05:14:58.966920+0000","last_active":"2024-01-22T05:14:58.969096+0000","last_peered":"2024-01-22T05:14:58.969096+0000","last_clean":"2024-01-22T05:14:58.969096+0000","last_became_active":"2024-01-22T05:14:58.966497+0000","last_became_peered":"2024-01-22T05:14:58.966497+0000","last_unstale":"2024-01-22T05:14:58.969096+0000","last_undegraded":"2024-01-22T05:14:58.969096+0000","last_fullsized":"2024-01-22T05:14:58.969096+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"130'3","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965550+0000","last_change":"2024-01-22T05:14:58.508099+0000","last_active":"2024-01-22T05:14:58.965550+0000","last_peered":"2024-01-22T05:14:58.965550+0000","last_clean":"2024-01-22T05:14:58.965550+0000","last_became_active":"2024-01-22T05:14:58.507740+0000","last_became_peered":"2024-01-22T05:14:58.507740+0000","last_unstale":"2024-01-22T05:14:58.965550+0000","last_undegraded":"2024-01-22T05:14:58.965550+0000","last_fullsized":"2024-01-22T05:14:58.965550+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":102,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.946302+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:14:58.946302+0000","last_peered":"2024-01-22T05:14:58.946302+0000","last_clean":"2024-01-22T05:14:58.946302+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:14:58.946302+0000","last_undegraded":"2024-01-22T05:14:58.946302+0000","last_fullsized":"2024-01-22T05:14:58.946302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.962682+0000","last_change":"2024-01-22T05:14:58.957444+0000","last_active":"2024-01-22T05:14:58.962682+0000","last_peered":"2024-01-22T05:14:58.962682+0000","last_clean":"2024-01-22T05:14:58.962682+0000","last_became_active":"2024-01-22T05:14:58.957147+0000","last_became_peered":"2024-01-22T05:14:58.957147+0000","last_unstale":"2024-01-22T05:14:58.962682+0000","last_undegraded":"2024-01-22T05:14:58.962682+0000","last_fullsized":"2024-01-22T05:14:58.962682+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"130'2","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.961317+0000","last_change":"2024-01-22T05:14:58.514183+0000","last_active":"2024-01-22T05:14:58.961317+0000","last_peered":"2024-01-22T05:14:58.961317+0000","last_clean":"2024-01-22T05:14:58.961317+0000","last_became_active":"2024-01-22T05:14:58.513911+0000","last_became_peered":"2024-01-22T05:14:58.513911+0000","last_unstale":"2024-01-22T05:14:58.961317+0000","last_undegraded":"2024-01-22T05:14:58.961317+0000","last_fullsized":"2024-01-22T05:14:58.961317+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.950325+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:14:58.950325+0000","last_peered":"2024-01-22T05:14:58.950325+0000","last_clean":"2024-01-22T05:14:58.950325+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:14:58.950325+0000","last_undegraded":"2024-01-22T05:14:58.950325+0000","last_fullsized":"2024-01-22T05:14:58.950325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.976139+0000","last_change":"2024-01-22T05:14:58.963063+0000","last_active":"2024-01-22T05:14:58.976139+0000","last_peered":"2024-01-22T05:14:58.976139+0000","last_clean":"2024-01-22T05:14:58.976139+0000","last_became_active":"2024-01-22T05:14:58.959680+0000","last_became_peered":"2024-01-22T05:14:58.959680+0000","last_unstale":"2024-01-22T05:14:58.976139+0000","last_undegraded":"2024-01-22T05:14:58.976139+0000","last_fullsized":"2024-01-22T05:14:58.976139+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.952986+0000","last_change":"2024-01-22T05:14:58.508233+0000","last_active":"2024-01-22T05:14:58.952986+0000","last_peered":"2024-01-22T05:14:58.952986+0000","last_clean":"2024-01-22T05:14:58.952986+0000","last_became_active":"2024-01-22T05:14:58.506472+0000","last_became_peered":"2024-01-22T05:14:58.506472+0000","last_unstale":"2024-01-22T05:14:58.952986+0000","last_undegraded":"2024-01-22T05:14:58.952986+0000","last_fullsized":"2024-01-22T05:14:58.952986+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":123,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.934450+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:14:58.934450+0000","last_peered":"2024-01-22T05:14:58.934450+0000","last_clean":"2024-01-22T05:14:58.934450+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:14:58.934450+0000","last_undegraded":"2024-01-22T05:14:58.934450+0000","last_fullsized":"2024-01-22T05:14:58.934450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970998+0000","last_change":"2024-01-22T05:14:58.961468+0000","last_active":"2024-01-22T05:14:58.970998+0000","last_peered":"2024-01-22T05:14:58.970998+0000","last_clean":"2024-01-22T05:14:58.970998+0000","last_became_active":"2024-01-22T05:14:58.961211+0000","last_became_peered":"2024-01-22T05:14:58.961211+0000","last_unstale":"2024-01-22T05:14:58.970998+0000","last_undegraded":"2024-01-22T05:14:58.970998+0000","last_fullsized":"2024-01-22T05:14:58.970998+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.949395+0000","last_change":"2024-01-22T05:14:58.512962+0000","last_active":"2024-01-22T05:14:58.949395+0000","last_peered":"2024-01-22T05:14:58.949395+0000","last_clean":"2024-01-22T05:14:58.949395+0000","last_became_active":"2024-01-22T05:14:58.512654+0000","last_became_peered":"2024-01-22T05:14:58.512654+0000","last_unstale":"2024-01-22T05:14:58.949395+0000","last_undegraded":"2024-01-22T05:14:58.949395+0000","last_fullsized":"2024-01-22T05:14:58.949395+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.952900+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:14:58.952900+0000","last_peered":"2024-01-22T05:14:58.952900+0000","last_clean":"2024-01-22T05:14:58.952900+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:14:58.952900+0000","last_undegraded":"2024-01-22T05:14:58.952900+0000","last_fullsized":"2024-01-22T05:14:58.952900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.965459+0000","last_change":"2024-01-22T05:14:58.962803+0000","last_active":"2024-01-22T05:14:58.965459+0000","last_peered":"2024-01-22T05:14:58.965459+0000","last_clean":"2024-01-22T05:14:58.965459+0000","last_became_active":"2024-01-22T05:14:58.962515+0000","last_became_peered":"2024-01-22T05:14:58.962515+0000","last_unstale":"2024-01-22T05:14:58.965459+0000","last_undegraded":"2024-01-22T05:14:58.965459+0000","last_fullsized":"2024-01-22T05:14:58.965459+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"130'4","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.969934+0000","last_change":"2024-01-22T05:14:58.503967+0000","last_active":"2024-01-22T05:14:58.969934+0000","last_peered":"2024-01-22T05:14:58.969934+0000","last_clean":"2024-01-22T05:14:58.969934+0000","last_became_active":"2024-01-22T05:14:58.501023+0000","last_became_peered":"2024-01-22T05:14:58.501023+0000","last_unstale":"2024-01-22T05:14:58.969934+0000","last_undegraded":"2024-01-22T05:14:58.969934+0000","last_fullsized":"2024-01-22T05:14:58.969934+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":102,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.941381+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:14:58.941381+0000","last_peered":"2024-01-22T05:14:58.941381+0000","last_clean":"2024-01-22T05:14:58.941381+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:14:58.941381+0000","last_undegraded":"2024-01-22T05:14:58.941381+0000","last_fullsized":"2024-01-22T05:14:58.941381+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970564+0000","last_change":"2024-01-22T05:14:58.967888+0000","last_active":"2024-01-22T05:14:58.970564+0000","last_peered":"2024-01-22T05:14:58.970564+0000","last_clean":"2024-01-22T05:14:58.970564+0000","last_became_active":"2024-01-22T05:14:58.967602+0000","last_became_peered":"2024-01-22T05:14:58.967602+0000","last_unstale":"2024-01-22T05:14:58.970564+0000","last_undegraded":"2024-01-22T05:14:58.970564+0000","last_fullsized":"2024-01-22T05:14:58.970564+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:58.472400+0000","last_clean_scrub_stamp":"2024-01-22T05:14:58.472400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"130'1","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.970410+0000","last_change":"2024-01-22T05:14:58.511230+0000","last_active":"2024-01-22T05:14:58.970410+0000","last_peered":"2024-01-22T05:14:58.970410+0000","last_clean":"2024-01-22T05:14:58.970410+0000","last_became_active":"2024-01-22T05:14:58.510945+0000","last_became_peered":"2024-01-22T05:14:58.510945+0000","last_unstale":"2024-01-22T05:14:58.970410+0000","last_undegraded":"2024-01-22T05:14:58.970410+0000","last_fullsized":"2024-01-22T05:14:58.970410+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:14:57.456992+0000","last_clean_scrub_stamp":"2024-01-22T05:14:57.456992+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":123,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.934902+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:14:58.934902+0000","last_peered":"2024-01-22T05:14:58.934902+0000","last_clean":"2024-01-22T05:14:58.934902+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:14:58.934902+0000","last_undegraded":"2024-01-22T05:14:58.934902+0000","last_fullsized":"2024-01-22T05:14:58.934902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":103,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-01-22T05:14:58.941467+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:14:58.941467+0000","last_peered":"2024-01-22T05:14:58.941467+0000","last_clean":"2024-01-22T05:14:58.941467+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:14:58.941467+0000","last_undegraded":"2024-01-22T05:14:58.941467+0000","last_fullsized":"2024-01-22T05:14:58.941467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574977,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307028,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064812,"statfs":{"total":96636764160,"available":96322367488,"internally_reserved":0,"allocated":1650688,"data_stored":809717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":1.159,"15min":1.071},"min":{"1min":0.70299999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":14.779999999999999,"5min":14.779999999999999,"15min":14.779999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":5.5800000000000001,"5min":1.9630000000000001,"15min":1.357},"min":{"1min":0.77500000000000002,"5min":0.63400000000000001,"15min":0.61899999999999999},"max":{"1min":76.662000000000006,"5min":76.662000000000006,"15min":76.662000000000006},"last":1.276}]},{"osd":1,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.0409999999999999,"15min":1.0149999999999999},"min":{"1min":0.80600000000000005,"5min":0.59199999999999997,"15min":0.54400000000000004},"max":{"1min":4.9269999999999996,"5min":4.9269999999999996,"15min":4.9269999999999996},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.7190000000000001,"5min":1.2749999999999999,"15min":1.2},"min":{"1min":0.755,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":12.691000000000001,"5min":12.691000000000001,"15min":12.691000000000001},"last":1.383}]},{"osd":2,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1040000000000001,"15min":1.109},"min":{"1min":0.67500000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.984,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.95,"5min":1.294,"15min":1.212},"min":{"1min":0.76100000000000001,"5min":0.73799999999999999,"15min":0.68899999999999995},"max":{"1min":15.036,"5min":15.036,"15min":15.036},"last":0.85499999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":4.9119999999999999,"5min":1.9079999999999999,"15min":1.46},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":64.983999999999995,"5min":64.983999999999995,"15min":64.983999999999995},"last":1.1699999999999999},{"interface":"front","average":{"1min":2.0550000000000002,"5min":1.4099999999999999,"15min":1.286},"min":{"1min":0.78400000000000003,"5min":0.78300000000000003,"15min":0.60199999999999998},"max":{"1min":15.073,"5min":15.073,"15min":15.073},"last":0.97099999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":1.2649999999999999,"15min":1.1459999999999999},"min":{"1min":0.753,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":22.239000000000001,"5min":22.239000000000001,"15min":22.239000000000001},"last":1.494},{"interface":"front","average":{"1min":2.7509999999999999,"5min":1.405,"15min":1.25},"min":{"1min":0.81000000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":27.872,"5min":27.872,"15min":27.872},"last":1.4770000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":4.9119999999999999,"5min":1.8600000000000001,"15min":1.425},"min":{"1min":0.67400000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":65.652000000000001,"5min":65.652000000000001,"15min":65.652000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2270000000000001,"15min":1.2450000000000001},"min":{"1min":1.0389999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.1629999999999998,"5min":2.1819999999999999,"15min":3.625},"last":1.419}]},{"osd":6,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.218,"15min":1.2450000000000001},"min":{"1min":0.80700000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":6.9939999999999998,"5min":6.9939999999999998,"15min":6.9939999999999998},"last":1.573},{"interface":"front","average":{"1min":2.0019999999999998,"5min":1.452,"15min":1.381},"min":{"1min":0.83199999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":12.965,"5min":12.965,"15min":12.965},"last":1.5189999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574977,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302924,"kb_used_data":1604,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068916,"statfs":{"total":96636764160,"available":96326569984,"internally_reserved":0,"allocated":1642496,"data_stored":809661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:14:56 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.98699999999999999,"15min":1.2949999999999999},"min":{"1min":0.73899999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.3149999999999999,"5min":1.679,"15min":77.745000000000005},"last":1.3149999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.01,"15min":1.0760000000000001},"min":{"1min":0.57499999999999996,"5min":0.44,"15min":0.44},"max":{"1min":1.4019999999999999,"5min":5.0359999999999996,"15min":13.555999999999999},"last":1.107}]},{"osd":1,"last update":"Mon Jan 22 05:14:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.129,"15min":1.117},"min":{"1min":0.56999999999999995,"5min":0.503,"15min":0.40000000000000002},"max":{"1min":1.212,"5min":5.9210000000000003,"15min":15.499000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.077,"15min":1.1839999999999999},"min":{"1min":0.71999999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3580000000000001,"5min":3.6080000000000001,"15min":7.7629999999999999},"last":1.244}]},{"osd":2,"last update":"Mon Jan 22 05:14:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1579999999999999,"15min":1.157},"min":{"1min":0.91600000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4390000000000001,"5min":3.0230000000000001,"15min":3.0960000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.151,"15min":1.1339999999999999},"min":{"1min":0.71099999999999997,"5min":0.68600000000000005,"15min":0.38200000000000001},"max":{"1min":1.5449999999999999,"5min":4.9660000000000002,"15min":4.9660000000000002},"last":0.92400000000000004}]},{"osd":3,"last update":"Mon Jan 22 05:14:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1779999999999999,"15min":1.4750000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.59299999999999997},"max":{"1min":1.4330000000000001,"5min":5.0750000000000002,"15min":102.08199999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.2010000000000001,"15min":1.2290000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.374},"max":{"1min":1.48,"5min":6.0129999999999999,"15min":15.468},"last":1.4610000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:14:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1459999999999999,"15min":1.123},"min":{"1min":0.94999999999999996,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.5740000000000001,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.149},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.145},"min":{"1min":0.68300000000000005,"5min":0.56899999999999995,"15min":0.48299999999999998},"max":{"1min":1.6100000000000001,"5min":5.1200000000000001,"15min":5.1200000000000001},"last":1.385}]},{"osd":5,"last update":"Mon Jan 22 05:14:56 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1519999999999999,"15min":1.2529999999999999},"min":{"1min":0.58699999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.375,"5min":5.2930000000000001,"15min":30.533000000000001},"last":1.351},{"interface":"front","average":{"1min":1.3,"5min":1.236,"15min":1.2729999999999999},"min":{"1min":1.0009999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.6639999999999999,"5min":2.6179999999999999,"15min":3.875},"last":1.4259999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:14:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3799999999999999,"15min":1.4350000000000001},"min":{"1min":0.78900000000000003,"5min":0.72599999999999998,"15min":0.42699999999999999},"max":{"1min":1.6879999999999999,"5min":8.4190000000000005,"15min":23.547999999999998},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.4319999999999999,"15min":1.585},"min":{"1min":0.98399999999999999,"5min":0.60199999999999998,"15min":0.495},"max":{"1min":1.9019999999999999,"5min":7.46,"15min":63.737000000000002},"last":1.5800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574977,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302920,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068920,"statfs":{"total":96636764160,"available":96326574080,"internally_reserved":0,"allocated":1638400,"data_stored":809059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:14:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.042,"15min":1.0129999999999999},"min":{"1min":0.61799999999999999,"5min":0.56999999999999995,"15min":0.53300000000000003},"max":{"1min":1.651,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.276},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.014,"15min":1.0629999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.571},"last":1.3979999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:14:57 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.175,"15min":1.194},"min":{"1min":0.83999999999999997,"5min":0.67300000000000004,"15min":0.50600000000000001},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.454},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.151,"15min":1.2350000000000001},"min":{"1min":0.876,"5min":0.76300000000000001,"15min":0.50900000000000001},"max":{"1min":1.9930000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.5549999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:14:57 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.0940000000000001,"15min":1.137},"min":{"1min":0.80500000000000005,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.9219999999999999,"5min":1.925,"15min":1.925},"last":1.24},{"interface":"front","average":{"1min":1.216,"5min":1.1160000000000001,"15min":1.125},"min":{"1min":0.73999999999999999,"5min":0.64200000000000002,"15min":0.59899999999999998},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.2}]},{"osd":3,"last update":"Mon Jan 22 05:14:57 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.133,"15min":1.161},"min":{"1min":0.82699999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.347},{"interface":"front","average":{"1min":1.149,"5min":1.177,"15min":1.2470000000000001},"min":{"1min":0.81999999999999995,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5640000000000001,"5min":4.8819999999999997,"15min":4.8819999999999997},"last":1.3759999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:14:57 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.05,"15min":1.1299999999999999},"min":{"1min":0.74299999999999999,"5min":0.51700000000000002,"15min":0.44400000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1060000000000001,"15min":1.222},"min":{"1min":0.79600000000000004,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.04}]},{"osd":6,"last update":"Mon Jan 22 05:14:57 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.123,"15min":1.256},"min":{"1min":0.90900000000000003,"5min":0.63600000000000001,"15min":0.58199999999999996},"max":{"1min":1.47,"5min":1.8129999999999999,"15min":2.2010000000000001},"last":0.996},{"interface":"front","average":{"1min":1.302,"5min":1.202,"15min":1.2689999999999999},"min":{"1min":1.016,"5min":0.56100000000000005,"15min":0.55900000000000005},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.3160000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:14:57 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.216,"15min":1.343},"min":{"1min":0.95799999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.6789999999999998,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.288},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2250000000000001,"15min":1.3779999999999999},"min":{"1min":0.72699999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.7050000000000001,"5min":2.04,"15min":3.1840000000000002},"last":1.4790000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311112,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060728,"statfs":{"total":96636764160,"available":96318185472,"internally_reserved":0,"allocated":1638400,"data_stored":810393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.0669999999999999,"15min":1.113},"min":{"1min":0.749,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.448,"5min":1.726,"15min":2.0150000000000001},"last":1.25},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.125,"15min":1.115},"min":{"1min":0.79500000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5109999999999999,"5min":1.6220000000000001,"15min":1.7430000000000001},"last":1.393}]},{"osd":1,"last update":"Mon Jan 22 05:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.073,"15min":1.077},"min":{"1min":0.80000000000000004,"5min":0.60499999999999998,"15min":0.53100000000000003},"max":{"1min":1.363,"5min":1.5429999999999999,"15min":1.7609999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0189999999999999,"15min":1.113},"min":{"1min":0.70099999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.3129999999999999,"5min":1.6870000000000001,"15min":2.194},"last":0.93100000000000005}]},{"osd":2,"last update":"Mon Jan 22 05:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0389999999999999,"15min":1.075},"min":{"1min":0.77500000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.45,"5min":1.7030000000000001,"15min":5.3390000000000004},"last":1.286},{"interface":"front","average":{"1min":1.103,"5min":1.1120000000000001,"15min":1.2030000000000001},"min":{"1min":0.71199999999999997,"5min":0.69099999999999995,"15min":0.67600000000000005},"max":{"1min":1.452,"5min":1.641,"15min":2.3479999999999999},"last":1.147}]},{"osd":3,"last update":"Mon Jan 22 05:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.1040000000000001,"15min":1.149},"min":{"1min":0.65700000000000003,"5min":0.59299999999999997,"15min":0.496},"max":{"1min":1.6719999999999999,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.115},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.093,"15min":1.1459999999999999},"min":{"1min":0.70499999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":5.3029999999999999},"last":1.169}]},{"osd":5,"last update":"Mon Jan 22 05:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.048,"15min":1.1519999999999999},"min":{"1min":0.77500000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.446,"5min":1.6970000000000001,"15min":2.0790000000000002},"last":1.044},{"interface":"front","average":{"1min":1.147,"5min":1.0649999999999999,"15min":1.121},"min":{"1min":0.68200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.5389999999999999,"5min":1.5880000000000001,"15min":2.0030000000000001},"last":1.3080000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0669999999999999,"15min":1.151},"min":{"1min":0.76700000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.47,"5min":1.5960000000000001,"15min":5.3769999999999998},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.1619999999999999,"15min":1.3160000000000001},"min":{"1min":0.97499999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.623,"5min":1.778,"15min":4.4409999999999998},"last":1.3420000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.25,"15min":1.3200000000000001},"min":{"1min":1.151,"5min":0.62,"15min":0.59399999999999997},"max":{"1min":1.627,"5min":1.9119999999999999,"15min":2.2839999999999998},"last":1.48},{"interface":"front","average":{"1min":1.331,"5min":1.256,"15min":1.3360000000000001},"min":{"1min":1.008,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":5.2629999999999999},"last":0.97099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574977,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311108,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060732,"statfs":{"total":96636764160,"available":96318189568,"internally_reserved":0,"allocated":1634304,"data_stored":809037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:14:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81499999999999995,"15min":0.88300000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.34200000000000003},"max":{"1min":1.4670000000000001,"5min":1.8440000000000001,"15min":14.859},"last":0.436},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.873,"15min":0.89200000000000002},"min":{"1min":0.622,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":1.3979999999999999,"5min":2.3519999999999999,"15min":5.0919999999999996},"last":0.66700000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:14:43 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.92900000000000005,"15min":0.88300000000000001},"min":{"1min":0.54000000000000004,"5min":0.42399999999999999,"15min":0.39300000000000002},"max":{"1min":1.1739999999999999,"5min":6.5570000000000004,"15min":6.5570000000000004},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.95999999999999996,"15min":0.97899999999999998},"min":{"1min":0.64400000000000002,"5min":0.499,"15min":0.48399999999999999},"max":{"1min":1.7669999999999999,"5min":1.9510000000000001,"15min":5.7519999999999998},"last":0.746}]},{"osd":2,"last update":"Mon Jan 22 05:14:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.1259999999999999,"15min":1.135},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.40600000000000003},"max":{"1min":1.48,"5min":2.391,"15min":2.391},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.204,"15min":1.1950000000000001},"min":{"1min":0.753,"5min":0.501,"15min":0.44800000000000001},"max":{"1min":1.5409999999999999,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.91300000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:14:43 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.383,"15min":1.3240000000000001},"min":{"1min":0.84699999999999998,"5min":0.82799999999999996,"15min":0.51700000000000002},"max":{"1min":1.798,"5min":10.858000000000001,"15min":10.858000000000001},"last":1.474},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.367,"15min":1.3480000000000001},"min":{"1min":0.90800000000000003,"5min":0.79500000000000004,"15min":0.63600000000000001},"max":{"1min":1.609,"5min":10.846,"15min":10.846},"last":1.306}]},{"osd":5,"last update":"Mon Jan 22 05:14:43 2024","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.296,"15min":1.2969999999999999},"min":{"1min":0.95099999999999996,"5min":0.74099999999999999,"15min":0.505},"max":{"1min":1.7709999999999999,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.3879999999999999,"15min":1.3819999999999999},"min":{"1min":0.82099999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":6.3220000000000001,"5min":12.128,"15min":14.523999999999999},"last":1.02}]},{"osd":6,"last update":"Mon Jan 22 05:14:43 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.3160000000000001,"15min":1.3740000000000001},"min":{"1min":0.88100000000000001,"5min":0.81699999999999995,"15min":0.56699999999999995},"max":{"1min":1.859,"5min":2.2610000000000001,"15min":4.9809999999999999},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.411,"5min":1.357,"15min":1.4019999999999999},"min":{"1min":0.99299999999999999,"5min":0.78800000000000003,"15min":0.68500000000000005},"max":{"1min":1.71,"5min":1.923,"15min":5.4210000000000003},"last":1.0429999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:14:43 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.339,"15min":1.3819999999999999},"min":{"1min":0.92000000000000004,"5min":0.89100000000000001,"15min":0.79900000000000004},"max":{"1min":1.881,"5min":2.472,"15min":5.7160000000000002},"last":1.083},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.4079999999999999,"15min":1.4179999999999999},"min":{"1min":1.0640000000000001,"5min":0.77800000000000002,"15min":0.71299999999999997},"max":{"1min":1.796,"5min":6.4279999999999999,"15min":6.4279999999999999},"last":1.5349999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307012,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064828,"statfs":{"total":96636764160,"available":96322383872,"internally_reserved":0,"allocated":1634304,"data_stored":808981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:14:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77600000000000002,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85699999999999998,"15min":0.84599999999999997},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.373},"max":{"1min":1.556,"5min":1.556,"15min":1.7350000000000001},"last":0.92200000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:14:47 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.871,"15min":0.83199999999999996},"min":{"1min":0.51500000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4490000000000001,"5min":1.534,"15min":1.534},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.97299999999999998,"15min":0.94799999999999995},"min":{"1min":0.64200000000000002,"5min":0.43099999999999999,"15min":0.41599999999999998},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.1830000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:14:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.1359999999999999,"15min":1.095},"min":{"1min":0.56200000000000006,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.446,"5min":2.226,"15min":2.226},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2330000000000001,"15min":1.194},"min":{"1min":0.71499999999999997,"5min":0.53900000000000003,"15min":0.51100000000000001},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":0.81599999999999995}]},{"osd":4,"last update":"Mon Jan 22 05:14:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.2729999999999999,"15min":1.2869999999999999},"min":{"1min":0.88500000000000001,"5min":0.71299999999999997,"15min":0.59099999999999997},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2190000000000001,"15min":1.208},"min":{"1min":0.72099999999999997,"5min":0.66400000000000003,"15min":0.63500000000000001},"max":{"1min":1.6259999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.236}]},{"osd":5,"last update":"Mon Jan 22 05:14:47 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.2130000000000001,"15min":1.204},"min":{"1min":0.89500000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.593,"5min":1.8440000000000001,"15min":2.3660000000000001},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.3,"15min":1.304},"min":{"1min":0.98299999999999998,"5min":0.76100000000000001,"15min":0.67000000000000004},"max":{"1min":3.0910000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.034}]},{"osd":6,"last update":"Mon Jan 22 05:14:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.274,"15min":1.26},"min":{"1min":0.96299999999999997,"5min":0.749,"15min":0.68400000000000005},"max":{"1min":1.673,"5min":1.7749999999999999,"15min":2.1920000000000002},"last":1.506},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.282,"15min":1.288},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.915,"5min":1.9370000000000001,"15min":2.4449999999999998},"last":1.409}]},{"osd":7,"last update":"Mon Jan 22 05:14:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3500000000000001},"min":{"1min":0.90700000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.742,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.403,"15min":1.4079999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.9970000000000001,"5min":2.0030000000000001,"15min":2.5059999999999998},"last":1.2}]}]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307012,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064828,"statfs":{"total":96636764160,"available":96322383872,"internally_reserved":0,"allocated":1634304,"data_stored":809501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84899999999999998,"15min":0.86099999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.38100000000000001},"max":{"1min":1.411,"5min":1.911,"15min":3.4119999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0109999999999999,"15min":1.002},"min":{"1min":0.56999999999999995,"5min":0.42899999999999999,"15min":0.41099999999999998},"max":{"1min":1.4279999999999999,"5min":1.8680000000000001,"15min":2.101},"last":1.1439999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0089999999999999,"15min":1.002},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4610000000000001,"5min":2.169,"15min":2.169},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0669999999999999,"15min":1.044},"min":{"1min":0.623,"5min":0.59099999999999997,"15min":0.46899999999999997},"max":{"1min":1.5780000000000001,"5min":2.024,"15min":2.024},"last":1.5}]},{"osd":3,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.0149999999999999,"15min":1.0169999999999999},"min":{"1min":0.60399999999999998,"5min":0.59399999999999997,"15min":0.38900000000000001},"max":{"1min":1.5229999999999999,"5min":1.7130000000000001,"15min":4.665},"last":1.2589999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.026,"15min":0.93200000000000005},"min":{"1min":0.51600000000000001,"5min":0.45000000000000001,"15min":0.41899999999999998},"max":{"1min":1.383,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":1.391}]},{"osd":4,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.3129999999999999,"15min":1.244},"min":{"1min":0.60299999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.958,"5min":15.76,"15min":15.76},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.415,"15min":1.3160000000000001},"min":{"1min":0.74099999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.627,"5min":16.975000000000001,"15min":16.975000000000001},"last":1.714}]},{"osd":5,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2549999999999999,"15min":1.2130000000000001},"min":{"1min":0.72599999999999998,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.893,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.2669999999999999,"15min":1.2769999999999999},"min":{"1min":0.875,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1309999999999998,"5min":2.52,"15min":2.52},"last":1.476}]},{"osd":6,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.68999999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.746,"5min":4.359,"15min":4.359},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.331,"15min":1.339},"min":{"1min":0.85799999999999998,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.0609999999999999,"5min":2.5569999999999999,"15min":2.5569999999999999},"last":1.6830000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:14:49 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3160000000000001,"15min":1.361},"min":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6859999999999999,"5min":2.0019999999999998,"15min":4.4329999999999998},"last":1.8999999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.339,"15min":1.3520000000000001},"min":{"1min":0.81599999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.032,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.9259999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574977,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307012,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064828,"statfs":{"total":96636764160,"available":96322383872,"internally_reserved":0,"allocated":1634304,"data_stored":809839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:14:42 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84099999999999997,"15min":0.92500000000000004},"min":{"1min":0.622,"5min":0.41199999999999998,"15min":0.28699999999999998},"max":{"1min":1.196,"5min":1.972,"15min":15.273},"last":0.871},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.92400000000000004,"15min":0.95199999999999996},"min":{"1min":0.66200000000000003,"5min":0.502,"15min":0.34499999999999997},"max":{"1min":1.252,"5min":1.698,"15min":4.4009999999999998},"last":1.173}]},{"osd":2,"last update":"Mon Jan 22 05:14:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.008,"15min":1.0820000000000001},"min":{"1min":0.72299999999999998,"5min":0.48199999999999998,"15min":0.46400000000000002},"max":{"1min":1.3129999999999999,"5min":1.6459999999999999,"15min":15.473000000000001},"last":1.222},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.038,"15min":1.026},"min":{"1min":0.76200000000000001,"5min":0.60699999999999998,"15min":0.45400000000000001},"max":{"1min":1.48,"5min":1.794,"15min":1.7989999999999999},"last":1.042}]},{"osd":3,"last update":"Mon Jan 22 05:14:42 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.94199999999999995,"15min":0.997},"min":{"1min":0.63600000000000001,"5min":0.40000000000000002,"15min":0.39000000000000001},"max":{"1min":1.395,"5min":1.609,"15min":5.3970000000000002},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1359999999999999,"15min":1.2130000000000001},"min":{"1min":0.78500000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.448,"5min":2.2349999999999999,"15min":15.439},"last":1.4730000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:14:42 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2290000000000001,"15min":1.3029999999999999},"min":{"1min":0.872,"5min":0.66200000000000003,"15min":0.61399999999999999},"max":{"1min":1.6339999999999999,"5min":2.1280000000000001,"15min":5.1799999999999997},"last":1.399},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.175,"15min":1.2250000000000001},"min":{"1min":0.79100000000000004,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.383,"5min":1.7909999999999999,"15min":3.4340000000000002},"last":1.2609999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:14:42 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.222,"15min":1.306},"min":{"1min":0.98299999999999998,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.552,"5min":1.8149999999999999,"15min":3.548},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3080000000000001,"15min":1.365},"min":{"1min":0.97799999999999998,"5min":0.75900000000000001,"15min":0.59499999999999997},"max":{"1min":1.6919999999999999,"5min":2.2309999999999999,"15min":2.823},"last":1.359}]},{"osd":6,"last update":"Mon Jan 22 05:14:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.347,"15min":1.444},"min":{"1min":1.0600000000000001,"5min":0.81399999999999995,"15min":0.59099999999999997},"max":{"1min":1.7370000000000001,"5min":2.0950000000000002,"15min":15.4},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3360000000000001,"15min":1.4370000000000001},"min":{"1min":0.95399999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.728,"5min":2.105,"15min":7.1349999999999998},"last":1.306}]},{"osd":7,"last update":"Mon Jan 22 05:14:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.393,"15min":1.5129999999999999},"min":{"1min":1.034,"5min":0.91400000000000003,"15min":0.79900000000000004},"max":{"1min":1.681,"5min":2.1819999999999999,"15min":5.29},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3360000000000001,"15min":1.3899999999999999},"min":{"1min":1.1339999999999999,"5min":0.81799999999999995,"15min":0.752},"max":{"1min":1.615,"5min":2.1869999999999998,"15min":2.7269999999999999},"last":1.4319999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:15:04.039 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:15:04.040 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-22T05:15:04.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.250+0000 7f5925000700 1 Processor -- start 2024-01-22T05:15:04.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.250+0000 7f5925000700 1 -- start start 2024-01-22T05:15:04.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f5925000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f59201397c0 0x7f59200bcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:04.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f5925000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f59200c34c0 0x7f59200bd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:04.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f5925000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5920062ac0 con 0x7f5920139ba0 2024-01-22T05:15:04.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f5925000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59200628e0 con 0x7f59201397c0 2024-01-22T05:15:04.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f5925000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59200bd550 con 0x7f59200c34c0 2024-01-22T05:15:04.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f591de00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f59201397c0 0x7f59200bcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:04.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f591d400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5920139ba0 0x7f59200c2db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:54800/0 (socket says 172.21.15.49:54800) 2024-01-22T05:15:04.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f591d400700 1 -- 172.21.15.49:0/2108443205 learned_addr learned my addr 172.21.15.49:0/2108443205 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:04.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f591e800700 1 --2- 172.21.15.49:0/2108443205 >> v2:172.21.15.110:3300/0 conn(0x7f59200c34c0 0x7f59200bd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:04.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f591de00700 1 -- 172.21.15.49:0/2108443205 >> v2:172.21.15.110:3300/0 conn(0x7f59200c34c0 msgr2=0x7f59200bd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:04.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f591de00700 1 --2- 172.21.15.49:0/2108443205 >> v2:172.21.15.110:3300/0 conn(0x7f59200c34c0 0x7f59200bd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f591de00700 1 -- 172.21.15.49:0/2108443205 >> v1:172.21.15.110:6789/0 conn(0x7f5920139ba0 legacy=0x7f59200c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:04.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f591de00700 1 -- 172.21.15.49:0/2108443205 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920062da0 con 0x7f59201397c0 2024-01-22T05:15:04.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f591ca00700 1 -- 172.21.15.49:0/2108443205 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678171953 0 0) 0x7f5920062ac0 con 0x7f5920139ba0 2024-01-22T05:15:04.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f591de00700 1 --2- 172.21.15.49:0/2108443205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59201397c0 0x7f59200bcb70 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f5920067540 tx=0x7f5910006f30).ready entity=mon.0 client_cookie=6ff30c633b99f8b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:04.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f591ca00700 1 -- 172.21.15.49:0/2108443205 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591000db70 con 0x7f59201397c0 2024-01-22T05:15:04.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f591ca00700 1 -- 172.21.15.49:0/2108443205 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591000dcd0 con 0x7f59201397c0 2024-01-22T05:15:04.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.254+0000 7f591ca00700 1 -- 172.21.15.49:0/2108443205 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910015600 con 0x7f59201397c0 2024-01-22T05:15:04.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.258+0000 7f5925000700 1 -- 172.21.15.49:0/2108443205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59201397c0 msgr2=0x7f59200bcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:04.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.258+0000 7f5925000700 1 --2- 172.21.15.49:0/2108443205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59201397c0 0x7f59200bcb70 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f5920067540 tx=0x7f5910006f30).stop 2024-01-22T05:15:04.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.258+0000 7f5925000700 1 -- 172.21.15.49:0/2108443205 shutdown_connections 2024-01-22T05:15:04.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.258+0000 7f5925000700 1 --2- 172.21.15.49:0/2108443205 >> v2:172.21.15.110:3300/0 conn(0x7f59200c34c0 0x7f59200bd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.258+0000 7f5925000700 1 --2- 172.21.15.49:0/2108443205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59201397c0 0x7f59200bcb70 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.258+0000 7f5925000700 1 -- 172.21.15.49:0/2108443205 >> 172.21.15.49:0/2108443205 conn(0x7f59200c3900 msgr2=0x7f59200c3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:04.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.258+0000 7f5925000700 1 -- 172.21.15.49:0/2108443205 shutdown_connections 2024-01-22T05:15:04.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.258+0000 7f5925000700 1 -- 172.21.15.49:0/2108443205 wait complete. 2024-01-22T05:15:04.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.262+0000 7f5925000700 1 Processor -- start 2024-01-22T05:15:04.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.262+0000 7f5925000700 1 -- start start 2024-01-22T05:15:04.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.262+0000 7f5925000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59200c34c0 0x7f59201569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:04.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.262+0000 7f5925000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59201397c0 0x7f59200a8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:04.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.262+0000 7f5925000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5920139ba0 0x7f5920138980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:04.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.262+0000 7f5925000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5920156e90 con 0x7f5920139ba0 2024-01-22T05:15:04.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.262+0000 7f5925000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5920158580 con 0x7f59201397c0 2024-01-22T05:15:04.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.262+0000 7f5925000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59200a9750 con 0x7f59200c34c0 2024-01-22T05:15:04.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.262+0000 7f591e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5920139ba0 0x7f5920138980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:04.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.262+0000 7f591de00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59200c34c0 0x7f59201569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:04.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.262+0000 7f591e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5920139ba0 0x7f5920138980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37058/0 (socket says 172.21.15.49:37058) 2024-01-22T05:15:04.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.262+0000 7f591d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59201397c0 0x7f59200a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:04.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.262+0000 7f591e800700 1 -- 172.21.15.49:0/532859954 learned_addr learned my addr 172.21.15.49:0/532859954 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:04.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.266+0000 7f591e800700 1 -- 172.21.15.49:0/532859954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59200c34c0 msgr2=0x7f59201569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:04.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.266+0000 7f591e800700 1 --2- 172.21.15.49:0/532859954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59200c34c0 0x7f59201569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.266+0000 7f591e800700 1 -- 172.21.15.49:0/532859954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59201397c0 msgr2=0x7f59200a8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:04.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.266+0000 7f591e800700 1 --2- 172.21.15.49:0/532859954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59201397c0 0x7f59200a8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.266+0000 7f591e800700 1 -- 172.21.15.49:0/532859954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591000b540 con 0x7f5920139ba0 2024-01-22T05:15:04.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.266+0000 7f591e800700 1 --2- 172.21.15.49:0/532859954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5920139ba0 0x7f5920138980 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f5918009e90 tx=0x7f591800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:04.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.266+0000 7f5915600700 1 -- 172.21.15.49:0/532859954 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591800cb30 con 0x7f5920139ba0 2024-01-22T05:15:04.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.266+0000 7f5915600700 1 -- 172.21.15.49:0/532859954 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591800f040 con 0x7f5920139ba0 2024-01-22T05:15:04.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.266+0000 7f5925000700 1 -- 172.21.15.49:0/532859954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59200a8bf0 con 0x7f5920139ba0 2024-01-22T05:15:04.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.266+0000 7f5915600700 1 -- 172.21.15.49:0/532859954 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591800cea0 con 0x7f5920139ba0 2024-01-22T05:15:04.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.266+0000 7f5925000700 1 -- 172.21.15.49:0/532859954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59200a9190 con 0x7f5920139ba0 2024-01-22T05:15:04.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.266+0000 7f5925000700 1 -- 172.21.15.49:0/532859954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5920158710 con 0x7f5920139ba0 2024-01-22T05:15:04.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.270+0000 7f5915600700 1 -- 172.21.15.49:0/532859954 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5918013610 con 0x7f5920139ba0 2024-01-22T05:15:04.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.270+0000 7f5915600700 1 --2- 172.21.15.49:0/532859954 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f58f805a510 0x7f58f805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:04.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.270+0000 7f5915600700 1 -- 172.21.15.49:0/532859954 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f5918075360 con 0x7f5920139ba0 2024-01-22T05:15:04.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.270+0000 7f591de00700 1 --2- 172.21.15.49:0/532859954 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f58f805a510 0x7f58f805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:04.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.274+0000 7f591de00700 1 --2- 172.21.15.49:0/532859954 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f58f805a510 0x7f58f805c9d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f5910006f70 tx=0x7f591001a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:04.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.278+0000 7f5915600700 1 -- 172.21.15.49:0/532859954 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5918048920 con 0x7f5920139ba0 2024-01-22T05:15:04.460 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-22T05:15:04.458+0000 7f3a45c00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:15:04.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.498+0000 7f5925000700 1 -- 172.21.15.49:0/532859954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5920063080 con 0x7f5920139ba0 2024-01-22T05:15:04.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.510+0000 7f5915600700 1 -- 172.21.15.49:0/532859954 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f591804bf40 con 0x7f5920139ba0 2024-01-22T05:15:04.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.514+0000 7f5925000700 1 -- 172.21.15.49:0/532859954 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f58f805a510 msgr2=0x7f58f805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:04.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.514+0000 7f5925000700 1 --2- 172.21.15.49:0/532859954 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f58f805a510 0x7f58f805c9d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f5910006f70 tx=0x7f591001a000).stop 2024-01-22T05:15:04.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.514+0000 7f5925000700 1 -- 172.21.15.49:0/532859954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5920139ba0 msgr2=0x7f5920138980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:04.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.514+0000 7f5925000700 1 --2- 172.21.15.49:0/532859954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5920139ba0 0x7f5920138980 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f5918009e90 tx=0x7f591800b040).stop 2024-01-22T05:15:04.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.514+0000 7f5925000700 1 -- 172.21.15.49:0/532859954 shutdown_connections 2024-01-22T05:15:04.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.514+0000 7f5925000700 1 --2- 172.21.15.49:0/532859954 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f58f805a510 0x7f58f805c9d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.514+0000 7f5925000700 1 --2- 172.21.15.49:0/532859954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5920139ba0 0x7f5920138980 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.514+0000 7f5925000700 1 --2- 172.21.15.49:0/532859954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59201397c0 0x7f59200a8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.514+0000 7f5925000700 1 --2- 172.21.15.49:0/532859954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59200c34c0 0x7f59201569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.514+0000 7f5925000700 1 -- 172.21.15.49:0/532859954 >> 172.21.15.49:0/532859954 conn(0x7f59200c3900 msgr2=0x7f59201549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:04.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.514+0000 7f5925000700 1 -- 172.21.15.49:0/532859954 shutdown_connections 2024-01-22T05:15:04.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.514+0000 7f5925000700 1 -- 172.21.15.49:0/532859954 wait complete. 2024-01-22T05:15:04.519 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-01-22T05:15:04.543 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:15:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.710+0000 7f5cdcc00700 1 Processor -- start 2024-01-22T05:15:04.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.710+0000 7f5cdcc00700 1 -- start start 2024-01-22T05:15:04.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.714+0000 7f5cdcc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5cd80be6a0 0x7f5cd80c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.714+0000 7f5cdcc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5cd8064690 0x7f5cd8064af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.714+0000 7f5cdcc00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd80be210 con 0x7f5cd8151370 2024-01-22T05:15:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.714+0000 7f5cdcc00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd80bd650 con 0x7f5cd8064690 2024-01-22T05:15:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.714+0000 7f5cdcc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd80bd8e0 con 0x7f5cd80be6a0 2024-01-22T05:15:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.714+0000 7f5cd5400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5cd8064690 0x7f5cd8064af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.714+0000 7f5cd5e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5cd80be6a0 0x7f5cd80c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.714+0000 7f5cd7200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5cd8151370 0x7f5cd81517c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35504/0 (socket says 172.21.15.49:35504) 2024-01-22T05:15:04.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.714+0000 7f5cd7200700 1 -- 172.21.15.49:0/3103321667 learned_addr learned my addr 172.21.15.49:0/3103321667 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.714+0000 7f5cd5e00700 1 -- 172.21.15.49:0/3103321667 >> v2:172.21.15.49:3300/0 conn(0x7f5cd8064690 msgr2=0x7f5cd8064af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.714+0000 7f5cd5e00700 1 --2- 172.21.15.49:0/3103321667 >> v2:172.21.15.49:3300/0 conn(0x7f5cd8064690 0x7f5cd8064af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.714+0000 7f5cd5e00700 1 -- 172.21.15.49:0/3103321667 >> v1:172.21.15.49:6789/0 conn(0x7f5cd8151370 legacy=0x7f5cd81517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:04.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.714+0000 7f5cd5e00700 1 -- 172.21.15.49:0/3103321667 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd80bdbc0 con 0x7f5cd80be6a0 2024-01-22T05:15:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.714+0000 7f5cd4a00700 1 -- 172.21.15.49:0/3103321667 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689839067 0 0) 0x7f5cd80be210 con 0x7f5cd8151370 2024-01-22T05:15:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.714+0000 7f5cd5e00700 1 --2- 172.21.15.49:0/3103321667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd80be6a0 0x7f5cd80c2cf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f5cd80c7a90 tx=0x7f5cc8009060).ready entity=mon.1 client_cookie=77261f8573282f8d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:04.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.718+0000 7f5cd4a00700 1 -- 172.21.15.49:0/3103321667 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800f510 con 0x7f5cd80be6a0 2024-01-22T05:15:04.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.718+0000 7f5cd4a00700 1 -- 172.21.15.49:0/3103321667 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc800f670 con 0x7f5cd80be6a0 2024-01-22T05:15:04.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.718+0000 7f5cd4a00700 1 -- 172.21.15.49:0/3103321667 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800f9f0 con 0x7f5cd80be6a0 2024-01-22T05:15:04.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.718+0000 7f5cdcc00700 1 -- 172.21.15.49:0/3103321667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd80be6a0 msgr2=0x7f5cd80c2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:04.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.718+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/3103321667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd80be6a0 0x7f5cd80c2cf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f5cd80c7a90 tx=0x7f5cc8009060).stop 2024-01-22T05:15:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.718+0000 7f5cdcc00700 1 -- 172.21.15.49:0/3103321667 shutdown_connections 2024-01-22T05:15:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.718+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/3103321667 >> v2:172.21.15.49:3300/0 conn(0x7f5cd8064690 0x7f5cd8064af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.718+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/3103321667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd80be6a0 0x7f5cd80c2cf0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.718+0000 7f5cdcc00700 1 -- 172.21.15.49:0/3103321667 >> 172.21.15.49:0/3103321667 conn(0x7f5cd80c87f0 msgr2=0x7f5cd80c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.718+0000 7f5cdcc00700 1 -- 172.21.15.49:0/3103321667 shutdown_connections 2024-01-22T05:15:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.718+0000 7f5cdcc00700 1 -- 172.21.15.49:0/3103321667 wait complete. 2024-01-22T05:15:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.722+0000 7f5cdcc00700 1 Processor -- start 2024-01-22T05:15:04.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.722+0000 7f5cdcc00700 1 -- start start 2024-01-22T05:15:04.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.722+0000 7f5cdcc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cd8064690 0x7f5cd814dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:04.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.722+0000 7f5cdcc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd80be6a0 0x7f5cd814aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:04.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.722+0000 7f5cdcc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd8151370 0x7f5cd80aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:04.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.722+0000 7f5cdcc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80ad7f0 con 0x7f5cd8064690 2024-01-22T05:15:04.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.722+0000 7f5cdcc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80c1b80 con 0x7f5cd80be6a0 2024-01-22T05:15:04.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.722+0000 7f5cdcc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80c5880 con 0x7f5cd8151370 2024-01-22T05:15:04.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.722+0000 7f5cd5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cd8064690 0x7f5cd814dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:04.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.722+0000 7f5cd5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cd8064690 0x7f5cd814dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37076/0 (socket says 172.21.15.49:37076) 2024-01-22T05:15:04.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.722+0000 7f5cd5e00700 1 -- 172.21.15.49:0/1625009630 learned_addr learned my addr 172.21.15.49:0/1625009630 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:04.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.726+0000 7f5cd5400700 1 --2- 172.21.15.49:0/1625009630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd80be6a0 0x7f5cd814aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:04.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.726+0000 7f5cd7200700 1 --2- 172.21.15.49:0/1625009630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd8151370 0x7f5cd80aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:04.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.726+0000 7f5cd5e00700 1 -- 172.21.15.49:0/1625009630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd8151370 msgr2=0x7f5cd80aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:04.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.726+0000 7f5cd5e00700 1 --2- 172.21.15.49:0/1625009630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd8151370 0x7f5cd80aacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.726+0000 7f5cd5e00700 1 -- 172.21.15.49:0/1625009630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd80be6a0 msgr2=0x7f5cd814aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:04.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.726+0000 7f5cd5e00700 1 --2- 172.21.15.49:0/1625009630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd80be6a0 0x7f5cd814aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.726+0000 7f5cd5e00700 1 -- 172.21.15.49:0/1625009630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc80092a0 con 0x7f5cd8064690 2024-01-22T05:15:04.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.726+0000 7f5cd7200700 1 --2- 172.21.15.49:0/1625009630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd8151370 0x7f5cd80aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:04.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.726+0000 7f5cd5e00700 1 --2- 172.21.15.49:0/1625009630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cd8064690 0x7f5cd814dca0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f5cc8009dd0 tx=0x7f5cc8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:04.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.726+0000 7f5ccd600700 1 -- 172.21.15.49:0/1625009630 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800f7e0 con 0x7f5cd8064690 2024-01-22T05:15:04.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.726+0000 7f5ccd600700 1 -- 172.21.15.49:0/1625009630 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc800f940 con 0x7f5cd8064690 2024-01-22T05:15:04.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.726+0000 7f5cdcc00700 1 -- 172.21.15.49:0/1625009630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd80c60e0 con 0x7f5cd8064690 2024-01-22T05:15:04.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.726+0000 7f5ccd600700 1 -- 172.21.15.49:0/1625009630 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc801b660 con 0x7f5cd8064690 2024-01-22T05:15:04.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.726+0000 7f5cdcc00700 1 -- 172.21.15.49:0/1625009630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd814e190 con 0x7f5cd8064690 2024-01-22T05:15:04.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.726+0000 7f5cdcc00700 1 -- 172.21.15.49:0/1625009630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd80650c0 con 0x7f5cd8064690 2024-01-22T05:15:04.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.730+0000 7f5ccd600700 1 -- 172.21.15.49:0/1625009630 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5cc801b9d0 con 0x7f5cd8064690 2024-01-22T05:15:04.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.730+0000 7f5ccd600700 1 --2- 172.21.15.49:0/1625009630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5cb005a540 0x7f5cb005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:04.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.730+0000 7f5ccd600700 1 -- 172.21.15.49:0/1625009630 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f5cc8076240 con 0x7f5cd8064690 2024-01-22T05:15:04.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.730+0000 7f5cd5400700 1 --2- 172.21.15.49:0/1625009630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5cb005a540 0x7f5cb005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:04.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.734+0000 7f5cd5400700 1 --2- 172.21.15.49:0/1625009630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5cb005a540 0x7f5cb005ca00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f5cd8154c10 tx=0x7f5cc0009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:04.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.738+0000 7f5ccd600700 1 -- 172.21.15.49:0/1625009630 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5cd80650c0 con 0x7f5cd8064690 2024-01-22T05:15:04.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.938+0000 7f5cdcc00700 1 -- 172.21.15.49:0/1625009630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cd80650c0 con 0x7f5cd8064690 2024-01-22T05:15:04.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.938+0000 7f5ccd600700 1 -- 172.21.15.49:0/1625009630 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4503 (secure 0 0 0) 0x7f5cd80650c0 con 0x7f5cd8064690 2024-01-22T05:15:04.941 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:04.941 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:14:58.925818+0000","modified":"2024-01-22T05:15:02.323695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8292":{"gid":8292,"name":"a","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3036262557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3036262557},{"type":"v1","addr":"172.21.15.49:6837","nonce":3036262557}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-22T05:15:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.942+0000 7f5cdcc00700 1 -- 172.21.15.49:0/1625009630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5cb005a540 msgr2=0x7f5cb005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.942+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/1625009630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5cb005a540 0x7f5cb005ca00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f5cd8154c10 tx=0x7f5cc0009060).stop 2024-01-22T05:15:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.942+0000 7f5cdcc00700 1 -- 172.21.15.49:0/1625009630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cd8064690 msgr2=0x7f5cd814dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.942+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/1625009630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cd8064690 0x7f5cd814dca0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f5cc8009dd0 tx=0x7f5cc8017000).stop 2024-01-22T05:15:04.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.942+0000 7f5cdcc00700 1 -- 172.21.15.49:0/1625009630 shutdown_connections 2024-01-22T05:15:04.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.942+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/1625009630 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5cb005a540 0x7f5cb005ca00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.942+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/1625009630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cd8151370 0x7f5cd80aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.942+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/1625009630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd80be6a0 0x7f5cd814aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.942+0000 7f5cdcc00700 1 --2- 172.21.15.49:0/1625009630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5cd8064690 0x7f5cd814dca0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.942+0000 7f5cdcc00700 1 -- 172.21.15.49:0/1625009630 >> 172.21.15.49:0/1625009630 conn(0x7f5cd80c87f0 msgr2=0x7f5cd80a8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.942+0000 7f5cdcc00700 1 -- 172.21.15.49:0/1625009630 shutdown_connections 2024-01-22T05:15:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:04.942+0000 7f5cdcc00700 1 -- 172.21.15.49:0/1625009630 wait complete. 2024-01-22T05:15:04.949 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2024-01-22T05:15:05.370 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 106, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:14:58.925818+0000', 'modified': '2024-01-22T05:15:02.323695+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8292}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8292': {'gid': 8292, 'name': 'a', 'rank': 0, 'incarnation': 102, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6837/3036262557', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6835', 'nonce': 3036262557}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 3036262557}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:15:05.370 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:15:05.371 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-22T05:15:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.538+0000 7fe114e00700 1 Processor -- start 2024-01-22T05:15:05.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.538+0000 7fe114e00700 1 -- start start 2024-01-22T05:15:05.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe114e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe110065620 0x7fe1100bd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe114e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1100c2700 con 0x7fe110064c00 2024-01-22T05:15:05.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe114e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1100c29a0 con 0x7fe110065240 2024-01-22T05:15:05.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe114e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1100c2c80 con 0x7fe110065620 2024-01-22T05:15:05.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe10d400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe110064c00 0x7fe1100bcc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35506/0 (socket says 172.21.15.49:35506) 2024-01-22T05:15:05.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe10d400700 1 -- 172.21.15.49:0/2296615150 learned_addr learned my addr 172.21.15.49:0/2296615150 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:05.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe10f200700 1 --2- 172.21.15.49:0/2296615150 >> v2:172.21.15.49:3300/0 conn(0x7fe110065620 0x7fe1100bd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe10ca00700 1 -- 172.21.15.49:0/2296615150 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769555607 0 0) 0x7fe1100c2700 con 0x7fe110064c00 2024-01-22T05:15:05.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe10ca00700 1 -- 172.21.15.49:0/2296615150 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0f00033f0 con 0x7fe110064c00 2024-01-22T05:15:05.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe10f200700 1 -- 172.21.15.49:0/2296615150 >> v1:172.21.15.110:6789/0 conn(0x7fe110065240 legacy=0x7fe1100644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe10ca00700 1 -- 172.21.15.49:0/2296615150 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452680464 0 0) 0x7fe1100c29a0 con 0x7fe110065240 2024-01-22T05:15:05.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe10f200700 1 -- 172.21.15.49:0/2296615150 >> v1:172.21.15.49:6789/0 conn(0x7fe110064c00 legacy=0x7fe1100bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe10f200700 1 -- 172.21.15.49:0/2296615150 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1100c2f60 con 0x7fe110065620 2024-01-22T05:15:05.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe10f200700 1 --2- 172.21.15.49:0/2296615150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe110065620 0x7fe1100bd390 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7fe108009e60 tx=0x7fe108009780).ready entity=mon.0 client_cookie=abe91ed17c2ada96 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:05.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe10ca00700 1 -- 172.21.15.49:0/2296615150 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10800e070 con 0x7fe110065620 2024-01-22T05:15:05.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe10ca00700 1 -- 172.21.15.49:0/2296615150 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10800bb60 con 0x7fe110065620 2024-01-22T05:15:05.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.542+0000 7fe10ca00700 1 -- 172.21.15.49:0/2296615150 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10800bee0 con 0x7fe110065620 2024-01-22T05:15:05.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.546+0000 7fe114e00700 1 -- 172.21.15.49:0/2296615150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe110065620 msgr2=0x7fe1100bd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.546+0000 7fe114e00700 1 --2- 172.21.15.49:0/2296615150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe110065620 0x7fe1100bd390 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7fe108009e60 tx=0x7fe108009780).stop 2024-01-22T05:15:05.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.546+0000 7fe114e00700 1 -- 172.21.15.49:0/2296615150 shutdown_connections 2024-01-22T05:15:05.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.546+0000 7fe114e00700 1 --2- 172.21.15.49:0/2296615150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe110065620 0x7fe1100bd390 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.546+0000 7fe114e00700 1 -- 172.21.15.49:0/2296615150 >> 172.21.15.49:0/2296615150 conn(0x7fe1100c87f0 msgr2=0x7fe1100c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:05.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.546+0000 7fe114e00700 1 -- 172.21.15.49:0/2296615150 shutdown_connections 2024-01-22T05:15:05.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.546+0000 7fe114e00700 1 -- 172.21.15.49:0/2296615150 wait complete. 2024-01-22T05:15:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.550+0000 7fe114e00700 1 Processor -- start 2024-01-22T05:15:05.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.550+0000 7fe114e00700 1 -- start start 2024-01-22T05:15:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe114e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe110064c00 0x7fe1100c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe114e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe110065240 0x7fe110168570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe114e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe110065620 0x7fe110158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe114e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe110168a60 con 0x7fe110064c00 2024-01-22T05:15:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe114e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100bf5b0 con 0x7fe110065620 2024-01-22T05:15:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe114e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100c12d0 con 0x7fe110065240 2024-01-22T05:15:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe10de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe110064c00 0x7fe1100c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe10de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe110064c00 0x7fe1100c0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37088/0 (socket says 172.21.15.49:37088) 2024-01-22T05:15:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe10de00700 1 -- 172.21.15.49:0/2232663024 learned_addr learned my addr 172.21.15.49:0/2232663024 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe10f200700 1 --2- 172.21.15.49:0/2232663024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe110065620 0x7fe110158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe10d400700 1 --2- 172.21.15.49:0/2232663024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe110065240 0x7fe110168570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe10de00700 1 -- 172.21.15.49:0/2232663024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe110065240 msgr2=0x7fe110168570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe10de00700 1 --2- 172.21.15.49:0/2232663024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe110065240 0x7fe110168570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe10de00700 1 -- 172.21.15.49:0/2232663024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe110065620 msgr2=0x7fe110158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe10de00700 1 --2- 172.21.15.49:0/2232663024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe110065620 0x7fe110158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe10de00700 1 -- 172.21.15.49:0/2232663024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe108009a20 con 0x7fe110064c00 2024-01-22T05:15:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe10de00700 1 --2- 172.21.15.49:0/2232663024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe110064c00 0x7fe1100c0cf0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7fe10000c4e0 tx=0x7fe100007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe105600700 1 -- 172.21.15.49:0/2232663024 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10000f470 con 0x7fe110064c00 2024-01-22T05:15:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe105600700 1 -- 172.21.15.49:0/2232663024 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10000f5f0 con 0x7fe110064c00 2024-01-22T05:15:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe114e00700 1 -- 172.21.15.49:0/2232663024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1100bef60 con 0x7fe110064c00 2024-01-22T05:15:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe105600700 1 -- 172.21.15.49:0/2232663024 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10000f9b0 con 0x7fe110064c00 2024-01-22T05:15:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.554+0000 7fe114e00700 1 -- 172.21.15.49:0/2232663024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe110159060 con 0x7fe110064c00 2024-01-22T05:15:05.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.558+0000 7fe105600700 1 -- 172.21.15.49:0/2232663024 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe10000fd20 con 0x7fe110064c00 2024-01-22T05:15:05.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.558+0000 7fe11f306740 1 Processor -- start 2024-01-22T05:15:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe105600700 1 --2- 172.21.15.49:0/2232663024 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe0e805a510 0x7fe0e805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe105600700 1 -- 172.21.15.49:0/2232663024 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe100073fe0 con 0x7fe110064c00 2024-01-22T05:15:05.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe11f306740 1 -- start start 2024-01-22T05:15:05.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe10f200700 1 --2- 172.21.15.49:0/2232663024 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe0e805a510 0x7fe0e805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe10f200700 1 --2- 172.21.15.49:0/2232663024 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe0e805a510 0x7fe0e805c9d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fe108009d30 tx=0x7fe108009780).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe11f306740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a4b3a0 0x2a2fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe11f306740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a0ae40 0x2a06af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe11f306740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a4b780 0x2a043a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe11f306740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x298a410 con 0x2a4b3a0 2024-01-22T05:15:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe11f306740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x298a550 con 0x2a4b780 2024-01-22T05:15:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe11f306740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x298aa00 con 0x2a0ae40 2024-01-22T05:15:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe10de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a4b3a0 0x2a2fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe10de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a4b3a0 0x2a2fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37096/0 (socket says 172.21.15.49:37096) 2024-01-22T05:15:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe10de00700 1 -- 172.21.15.49:0/2243512655 learned_addr learned my addr 172.21.15.49:0/2243512655 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe10d400700 1 --2- 172.21.15.49:0/2243512655 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a0ae40 0x2a06af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe10f200700 1 --2- 172.21.15.49:0/2243512655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a4b780 0x2a043a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe10de00700 1 -- 172.21.15.49:0/2243512655 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a0ae40 msgr2=0x2a06af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe10de00700 1 --2- 172.21.15.49:0/2243512655 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a0ae40 0x2a06af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe10de00700 1 -- 172.21.15.49:0/2243512655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a4b780 msgr2=0x2a043a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe10de00700 1 --2- 172.21.15.49:0/2243512655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a4b780 0x2a043a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.562+0000 7fe10de00700 1 -- 172.21.15.49:0/2243512655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2983730 con 0x2a4b3a0 2024-01-22T05:15:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.566+0000 7fe10d400700 1 --2- 172.21.15.49:0/2243512655 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a0ae40 0x2a06af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:05.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.566+0000 7fe10de00700 1 --2- 172.21.15.49:0/2243512655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a4b3a0 0x2a2fd10 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7fe10004ae00 tx=0x7fe10000f000).ready entity=mon.0 client_cookie=395372d5c5e371f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.566+0000 7fe0fe000700 1 -- 172.21.15.49:0/2243512655 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100050070 con 0x2a4b3a0 2024-01-22T05:15:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.566+0000 7fe0fe000700 1 -- 172.21.15.49:0/2243512655 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10004b2c0 con 0x2a4b3a0 2024-01-22T05:15:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.566+0000 7fe0fe000700 1 -- 172.21.15.49:0/2243512655 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1000479d0 con 0x2a4b3a0 2024-01-22T05:15:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.566+0000 7fe11f306740 1 -- 172.21.15.49:0/2243512655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a4b3a0 msgr2=0x2a2fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.566+0000 7fe11f306740 1 --2- 172.21.15.49:0/2243512655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a4b3a0 0x2a2fd10 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7fe10004ae00 tx=0x7fe10000f000).stop 2024-01-22T05:15:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.566+0000 7fe11f306740 1 -- 172.21.15.49:0/2243512655 shutdown_connections 2024-01-22T05:15:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.566+0000 7fe11f306740 1 --2- 172.21.15.49:0/2243512655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a4b780 0x2a043a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.566+0000 7fe11f306740 1 --2- 172.21.15.49:0/2243512655 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a0ae40 0x2a06af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.566+0000 7fe11f306740 1 --2- 172.21.15.49:0/2243512655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a4b3a0 0x2a2fd10 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.566+0000 7fe11f306740 1 -- 172.21.15.49:0/2243512655 >> 172.21.15.49:0/2243512655 conn(0x27e8550 msgr2=0x2a0a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:05.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.566+0000 7fe11f306740 1 -- 172.21.15.49:0/2243512655 shutdown_connections 2024-01-22T05:15:05.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.566+0000 7fe11f306740 1 -- 172.21.15.49:0/2243512655 wait complete. 2024-01-22T05:15:05.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.566+0000 7fe11f306740 1 -- start start 2024-01-22T05:15:05.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.570+0000 7fe11f306740 1 Processor -- start 2024-01-22T05:15:05.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.570+0000 7fe11f306740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0ae40 0x2a4ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.570+0000 7fe11f306740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a4b3a0 0x2a32b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.570+0000 7fe11f306740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 0x2a34700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.570+0000 7fe11f306740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2955650 con 0x2a4b3a0 2024-01-22T05:15:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.570+0000 7fe11f306740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a35a40 con 0x2a0ae40 2024-01-22T05:15:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.570+0000 7fe11f306740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a33370 con 0x2a4b780 2024-01-22T05:15:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.570+0000 7fe11f306740 10 client.0 ll_register_callbacks cb 0x29c2020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.570+0000 7fe10d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a4b3a0 0x2a32b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.570+0000 7fe10d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a4b3a0 0x2a32b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37112/0 (socket says 172.21.15.49:37112) 2024-01-22T05:15:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.570+0000 7fe10d400700 1 -- 172.21.15.49:0/4190674575 learned_addr learned my addr 172.21.15.49:0/4190674575 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.570+0000 7fe10de00700 1 --2- 172.21.15.49:0/4190674575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0ae40 0x2a4ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.570+0000 7fe10f200700 1 --2- 172.21.15.49:0/4190674575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 0x2a34700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe10d400700 1 -- 172.21.15.49:0/4190674575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 msgr2=0x2a34700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:05.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe10d400700 1 --2- 172.21.15.49:0/4190674575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 0x2a34700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe10d400700 1 -- 172.21.15.49:0/4190674575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0ae40 msgr2=0x2a4ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:05.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe10d400700 1 --2- 172.21.15.49:0/4190674575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0ae40 0x2a4ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe10d400700 1 -- 172.21.15.49:0/4190674575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe110159060 con 0x2a4b3a0 2024-01-22T05:15:05.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe10d400700 1 --2- 172.21.15.49:0/4190674575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a4b3a0 0x2a32b70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7fe0f8005750 tx=0x7fe0f8009040).ready entity=mon.0 client_cookie=efefd8a697359be1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:05.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe0f6a00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:15:05.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe0f6a00700 1 -- 172.21.15.49:0/4190674575 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80019d0 con 0x2a4b3a0 2024-01-22T05:15:05.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe0f6a00700 1 -- 172.21.15.49:0/4190674575 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe0f8001b30 con 0x2a4b3a0 2024-01-22T05:15:05.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe11f306740 1 -- 172.21.15.49:0/4190674575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x29766f0 con 0x2a4b3a0 2024-01-22T05:15:05.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe0f6a00700 1 -- 172.21.15.49:0/4190674575 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0f8015410 con 0x2a4b3a0 2024-01-22T05:15:05.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe11f306740 10 client.8427 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:05.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe11f306740 1 -- 172.21.15.49:0/4190674575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x297e960 con 0x2a4b3a0 2024-01-22T05:15:05.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe0f6a00700 1 -- 172.21.15.49:0/4190674575 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x29766f0 con 0x2a4b3a0 2024-01-22T05:15:05.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe0f6a00700 1 -- 172.21.15.49:0/4190674575 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe0f801d020 con 0x2a4b3a0 2024-01-22T05:15:05.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe11f306740 10 client.8427 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:05.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe11f306740 10 client.8427 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:15:05.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe11f306740 20 client.8427 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:05.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe11f306740 1 --2- 172.21.15.49:0/4190674575 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2a04440 0x2a6a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe11f306740 4 client.8427 mds_command: new command op to 8292 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:15:05.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe11f306740 1 -- 172.21.15.49:0/4190674575 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x283f4e0 con 0x2a04440 2024-01-22T05:15:05.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe10de00700 1 --2- 172.21.15.49:0/4190674575 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2a04440 0x2a6a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe10de00700 1 --2- 172.21.15.49:0/4190674575 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2a04440 0x2a6a4d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=eb132538bf986f18 server_cookie=1aa447c1c435610f in_seq=0 out_seq=0 2024-01-22T05:15:05.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.574+0000 7fe0f6a00700 10 client.8427 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:05.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.578+0000 7fe0f6a00700 1 -- 172.21.15.49:0/4190674575 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x283f4e0 con 0x2a04440 2024-01-22T05:15:05.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.578+0000 7fe0f6a00700 10 client.8427 handle_command_reply: tid=0 2024-01-22T05:15:05.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.578+0000 7fe11f306740 1 client.8427 shutdown 2024-01-22T05:15:05.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.578+0000 7fe11f306740 1 -- 172.21.15.49:0/4190674575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a4b3a0 msgr2=0x2a32b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.578+0000 7fe11f306740 1 --2- 172.21.15.49:0/4190674575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a4b3a0 0x2a32b70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7fe0f8005750 tx=0x7fe0f8009040).stop 2024-01-22T05:15:05.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.578+0000 7fe11f306740 1 -- 172.21.15.49:0/4190674575 shutdown_connections 2024-01-22T05:15:05.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.578+0000 7fe11f306740 1 --2- 172.21.15.49:0/4190674575 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2a04440 0x2a6a4d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.578+0000 7fe11f306740 1 --2- 172.21.15.49:0/4190674575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 0x2a34700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.578+0000 7fe11f306740 1 --2- 172.21.15.49:0/4190674575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a4b3a0 0x2a32b70 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.578+0000 7fe11f306740 1 --2- 172.21.15.49:0/4190674575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a0ae40 0x2a4ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.578+0000 7fe0f6a00700 0 client.8427 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.578+0000 7fe11f306740 1 -- 172.21.15.49:0/4190674575 >> 172.21.15.49:0/4190674575 conn(0x27e8550 msgr2=0x2a51350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.578+0000 7fe11f306740 1 -- 172.21.15.49:0/4190674575 shutdown_connections 2024-01-22T05:15:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.578+0000 7fe11f306740 1 -- 172.21.15.49:0/4190674575 wait complete. 2024-01-22T05:15:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.578+0000 7fe11f306740 20 client.8427 trim_cache size 0 max 16384 2024-01-22T05:15:05.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.598+0000 7fe11f306740 1 Processor -- start 2024-01-22T05:15:05.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.598+0000 7fe11f306740 1 -- start start 2024-01-22T05:15:05.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe11f306740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0ae40 0x2a30230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe11f306740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a4b3a0 0x2a30720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe11f306740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 0x2a35b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe11f306740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a2eca0 con 0x2a0ae40 2024-01-22T05:15:05.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe11f306740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x295c540 con 0x2a4b3a0 2024-01-22T05:15:05.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe11f306740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a05130 con 0x2a4b780 2024-01-22T05:15:05.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe10de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0ae40 0x2a30230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe10de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0ae40 0x2a30230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37128/0 (socket says 172.21.15.49:37128) 2024-01-22T05:15:05.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe10de00700 1 -- 172.21.15.49:0/3212945561 learned_addr learned my addr 172.21.15.49:0/3212945561 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:05.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe10d400700 1 --2- 172.21.15.49:0/3212945561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a4b3a0 0x2a30720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe10f200700 1 --2- 172.21.15.49:0/3212945561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 0x2a35b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe10de00700 1 -- 172.21.15.49:0/3212945561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 msgr2=0x2a35b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:05.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe10de00700 1 --2- 172.21.15.49:0/3212945561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 0x2a35b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe10de00700 1 -- 172.21.15.49:0/3212945561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a4b3a0 msgr2=0x2a30720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:05.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe10de00700 1 --2- 172.21.15.49:0/3212945561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a4b3a0 0x2a30720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe10de00700 1 -- 172.21.15.49:0/3212945561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2a04b80 con 0x2a0ae40 2024-01-22T05:15:05.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe10f200700 1 --2- 172.21.15.49:0/3212945561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 0x2a35b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:05.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe10de00700 1 --2- 172.21.15.49:0/3212945561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0ae40 0x2a30230 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fe10000ffd0 tx=0x7fe100063280).ready entity=mon.0 client_cookie=8f98ab4321c72934 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:05.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe0fea00700 1 -- 172.21.15.49:0/3212945561 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100062070 con 0x2a0ae40 2024-01-22T05:15:05.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe0fea00700 1 -- 172.21.15.49:0/3212945561 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10000fb10 con 0x2a0ae40 2024-01-22T05:15:05.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe0fea00700 1 -- 172.21.15.49:0/3212945561 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10004a9c0 con 0x2a0ae40 2024-01-22T05:15:05.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe11f306740 1 -- 172.21.15.49:0/3212945561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0ae40 msgr2=0x2a30230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.602+0000 7fe11f306740 1 --2- 172.21.15.49:0/3212945561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0ae40 0x2a30230 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fe10000ffd0 tx=0x7fe100063280).stop 2024-01-22T05:15:05.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.606+0000 7fe11f306740 1 -- 172.21.15.49:0/3212945561 shutdown_connections 2024-01-22T05:15:05.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.606+0000 7fe11f306740 1 --2- 172.21.15.49:0/3212945561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 0x2a35b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.606+0000 7fe11f306740 1 --2- 172.21.15.49:0/3212945561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a4b3a0 0x2a30720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.606+0000 7fe11f306740 1 --2- 172.21.15.49:0/3212945561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0ae40 0x2a30230 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.606+0000 7fe11f306740 1 -- 172.21.15.49:0/3212945561 >> 172.21.15.49:0/3212945561 conn(0x27e8550 msgr2=0x2a6e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:05.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.606+0000 7fe11f306740 1 -- 172.21.15.49:0/3212945561 shutdown_connections 2024-01-22T05:15:05.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.606+0000 7fe11f306740 1 -- 172.21.15.49:0/3212945561 wait complete. 2024-01-22T05:15:05.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.606+0000 7fe11f306740 1 -- start start 2024-01-22T05:15:05.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.606+0000 7fe11f306740 1 Processor -- start 2024-01-22T05:15:05.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe11f306740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0ae40 0x2aacf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe11f306740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a4b3a0 0x2a09690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe11f306740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 0x2a09b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe11f306740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a0a070 con 0x2a0ae40 2024-01-22T05:15:05.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe11f306740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a4f5c0 con 0x2a4b3a0 2024-01-22T05:15:05.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe11f306740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a07190 con 0x2a4b780 2024-01-22T05:15:05.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe11f306740 10 client.0 ll_register_callbacks cb 0x7fe0f8007690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:05.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe10de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0ae40 0x2aacf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe10de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0ae40 0x2aacf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37142/0 (socket says 172.21.15.49:37142) 2024-01-22T05:15:05.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe10d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a4b3a0 0x2a09690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe10de00700 1 -- 172.21.15.49:0/506875459 learned_addr learned my addr 172.21.15.49:0/506875459 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:05.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe10f200700 1 --2- 172.21.15.49:0/506875459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 0x2a09b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe10de00700 1 -- 172.21.15.49:0/506875459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 msgr2=0x2a09b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:05.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe10de00700 1 --2- 172.21.15.49:0/506875459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 0x2a09b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe10de00700 1 -- 172.21.15.49:0/506875459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a4b3a0 msgr2=0x2a09690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:05.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe10de00700 1 --2- 172.21.15.49:0/506875459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a4b3a0 0x2a09690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.610+0000 7fe10de00700 1 -- 172.21.15.49:0/506875459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2983730 con 0x2a0ae40 2024-01-22T05:15:05.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe10de00700 1 --2- 172.21.15.49:0/506875459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0ae40 0x2aacf50 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7fe10000c0b0 tx=0x7fe100062000).ready entity=mon.0 client_cookie=8a37ee1f93074ced server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:05.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe0f6a00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:15:05.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe0f6a00700 1 -- 172.21.15.49:0/506875459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1000479d0 con 0x2a0ae40 2024-01-22T05:15:05.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe0f6a00700 1 -- 172.21.15.49:0/506875459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe100047b30 con 0x2a0ae40 2024-01-22T05:15:05.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe11f306740 1 -- 172.21.15.49:0/506875459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x29801a0 con 0x2a0ae40 2024-01-22T05:15:05.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe0f6a00700 1 -- 172.21.15.49:0/506875459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1000470b0 con 0x2a0ae40 2024-01-22T05:15:05.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe11f306740 10 client.8433 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:05.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe11f306740 1 -- 172.21.15.49:0/506875459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x7fe11016b570 con 0x2a0ae40 2024-01-22T05:15:05.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe0f6a00700 1 -- 172.21.15.49:0/506875459 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x29801a0 con 0x2a0ae40 2024-01-22T05:15:05.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe0f6a00700 1 -- 172.21.15.49:0/506875459 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe100071bf0 con 0x2a0ae40 2024-01-22T05:15:05.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe11f306740 10 client.8433 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:05.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe11f306740 10 client.8433 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:15:05.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe11f306740 20 client.8433 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:05.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe11f306740 1 --2- 172.21.15.49:0/506875459 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2ab3260 0x2ab3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe11f306740 4 client.8433 mds_command: new command op to 8292 tid=0[{"prefix": "status"}] 2024-01-22T05:15:05.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe11f306740 1 -- 172.21.15.49:0/506875459 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "status"}) v1 -- 0x27f5260 con 0x2ab3260 2024-01-22T05:15:05.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe10d400700 1 --2- 172.21.15.49:0/506875459 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2ab3260 0x2ab3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe10d400700 1 --2- 172.21.15.49:0/506875459 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2ab3260 0x2ab3640 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=45daf2533b4bd33e server_cookie=eb249972b31db5ee in_seq=0 out_seq=0 2024-01-22T05:15:05.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe0f6a00700 10 client.8433 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:05.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe0f6a00700 1 -- 172.21.15.49:0/506875459 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x27f5260 con 0x2ab3260 2024-01-22T05:15:05.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe0f6a00700 10 client.8433 handle_command_reply: tid=0 2024-01-22T05:15:05.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe11f306740 1 client.8433 shutdown 2024-01-22T05:15:05.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe11f306740 1 -- 172.21.15.49:0/506875459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0ae40 msgr2=0x2aacf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.614+0000 7fe11f306740 1 --2- 172.21.15.49:0/506875459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0ae40 0x2aacf50 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7fe10000c0b0 tx=0x7fe100062000).stop 2024-01-22T05:15:05.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe11f306740 1 -- 172.21.15.49:0/506875459 shutdown_connections 2024-01-22T05:15:05.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe11f306740 1 --2- 172.21.15.49:0/506875459 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2ab3260 0x2ab3640 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe11f306740 1 --2- 172.21.15.49:0/506875459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2a4b780 0x2a09b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe11f306740 1 --2- 172.21.15.49:0/506875459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2a4b3a0 0x2a09690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe11f306740 1 --2- 172.21.15.49:0/506875459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2a0ae40 0x2aacf50 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe11f306740 1 -- 172.21.15.49:0/506875459 >> 172.21.15.49:0/506875459 conn(0x27e8550 msgr2=0x2a511a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:05.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe0f6a00700 0 client.8433 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:05.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe11f306740 1 -- 172.21.15.49:0/506875459 shutdown_connections 2024-01-22T05:15:05.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe11f306740 1 -- 172.21.15.49:0/506875459 wait complete. 2024-01-22T05:15:05.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe11f306740 20 client.8433 trim_cache size 0 max 16384 2024-01-22T05:15:05.621 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:15:05.621 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:15:05.621 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:15:05.622 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 8292, 2024-01-22T05:15:05.622 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:15:05.622 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:15:05.622 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:15:05.622 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 6.6883922050000004, 2024-01-22T05:15:05.622 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 106, 2024-01-22T05:15:05.622 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 131, 2024-01-22T05:15:05.622 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 131, 2024-01-22T05:15:05.622 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 12.067898497 2024-01-22T05:15:05.622 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:15:05.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe114e00700 1 -- 172.21.15.49:0/2232663024 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe0e805a510 msgr2=0x7fe0e805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe114e00700 1 --2- 172.21.15.49:0/2232663024 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe0e805a510 0x7fe0e805c9d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fe108009d30 tx=0x7fe108009780).stop 2024-01-22T05:15:05.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe114e00700 1 -- 172.21.15.49:0/2232663024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe110064c00 msgr2=0x7fe1100c0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe114e00700 1 --2- 172.21.15.49:0/2232663024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe110064c00 0x7fe1100c0cf0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7fe10000c4e0 tx=0x7fe100007c70).stop 2024-01-22T05:15:05.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe114e00700 1 -- 172.21.15.49:0/2232663024 shutdown_connections 2024-01-22T05:15:05.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe114e00700 1 --2- 172.21.15.49:0/2232663024 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe0e805a510 0x7fe0e805c9d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe114e00700 1 --2- 172.21.15.49:0/2232663024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe110065620 0x7fe110158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe114e00700 1 --2- 172.21.15.49:0/2232663024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe110065240 0x7fe110168570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe114e00700 1 --2- 172.21.15.49:0/2232663024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe110064c00 0x7fe1100c0cf0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe114e00700 1 -- 172.21.15.49:0/2232663024 >> 172.21.15.49:0/2232663024 conn(0x7fe1100c87f0 msgr2=0x7fe110062230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:05.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe114e00700 1 -- 172.21.15.49:0/2232663024 shutdown_connections 2024-01-22T05:15:05.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.618+0000 7fe114e00700 1 -- 172.21.15.49:0/2232663024 wait complete. 2024-01-22T05:15:05.646 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:15:05.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.790+0000 7ff5cca00700 1 Processor -- start 2024-01-22T05:15:05.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.794+0000 7ff5cca00700 1 -- start start 2024-01-22T05:15:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.794+0000 7ff5cca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5c4064240 0x7ff5c40bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.794+0000 7ff5cca00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c4152bc0 con 0x7ff5c4063e60 2024-01-22T05:15:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.794+0000 7ff5cca00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c4153050 con 0x7ff5c40684a0 2024-01-22T05:15:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.794+0000 7ff5cca00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c40646f0 con 0x7ff5c4064240 2024-01-22T05:15:05.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.794+0000 7ff5ca000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff5c4063e60 0x7ff5c4067d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35522/0 (socket says 172.21.15.49:35522) 2024-01-22T05:15:05.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.794+0000 7ff5ca000700 1 -- 172.21.15.49:0/4262616361 learned_addr learned my addr 172.21.15.49:0/4262616361 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:05.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5cb400700 1 --2- 172.21.15.49:0/4262616361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5c4064240 0x7ff5c40bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5c8c00700 1 -- 172.21.15.49:0/4262616361 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181341981 0 0) 0x7ff5c4152bc0 con 0x7ff5c4063e60 2024-01-22T05:15:05.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5c8c00700 1 -- 172.21.15.49:0/4262616361 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5a40033f0 con 0x7ff5c4063e60 2024-01-22T05:15:05.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5c8c00700 1 -- 172.21.15.49:0/4262616361 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049672753 0 0) 0x7ff5c4153050 con 0x7ff5c40684a0 2024-01-22T05:15:05.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5c8c00700 1 -- 172.21.15.49:0/4262616361 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c4152bc0 con 0x7ff5c40684a0 2024-01-22T05:15:05.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5cb400700 1 -- 172.21.15.49:0/4262616361 >> v1:172.21.15.110:6789/0 conn(0x7ff5c40684a0 legacy=0x7ff5c40bd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5cb400700 1 -- 172.21.15.49:0/4262616361 >> v1:172.21.15.49:6789/0 conn(0x7ff5c4063e60 legacy=0x7ff5c4067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5c8c00700 1 -- 172.21.15.49:0/4262616361 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2201427085 0 0) 0x7ff5a40033f0 con 0x7ff5c4063e60 2024-01-22T05:15:05.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5cb400700 1 -- 172.21.15.49:0/4262616361 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c4067530 con 0x7ff5c4064240 2024-01-22T05:15:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5cb400700 1 --2- 172.21.15.49:0/4262616361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5c4064240 0x7ff5c40bdcb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7ff5bc009e90 tx=0x7ff5bc009780).ready entity=mon.2 client_cookie=e38d5c881d3a12dc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5c8c00700 1 -- 172.21.15.49:0/4262616361 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00e070 con 0x7ff5c4064240 2024-01-22T05:15:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5c8c00700 1 -- 172.21.15.49:0/4262616361 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc00b7a0 con 0x7ff5c4064240 2024-01-22T05:15:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5c8c00700 1 -- 172.21.15.49:0/4262616361 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4001470 con 0x7ff5c4064240 2024-01-22T05:15:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5cca00700 1 -- 172.21.15.49:0/4262616361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5c4064240 msgr2=0x7ff5c40bdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5cca00700 1 --2- 172.21.15.49:0/4262616361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5c4064240 0x7ff5c40bdcb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7ff5bc009e90 tx=0x7ff5bc009780).stop 2024-01-22T05:15:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5cca00700 1 -- 172.21.15.49:0/4262616361 shutdown_connections 2024-01-22T05:15:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5cca00700 1 --2- 172.21.15.49:0/4262616361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5c4064240 0x7ff5c40bdcb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.798+0000 7ff5cca00700 1 -- 172.21.15.49:0/4262616361 >> 172.21.15.49:0/4262616361 conn(0x7ff5c40c5bb0 msgr2=0x7ff5c4066830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:05.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.802+0000 7ff5cca00700 1 -- 172.21.15.49:0/4262616361 shutdown_connections 2024-01-22T05:15:05.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.802+0000 7ff5cca00700 1 -- 172.21.15.49:0/4262616361 wait complete. 2024-01-22T05:15:05.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.802+0000 7ff5cca00700 1 Processor -- start 2024-01-22T05:15:05.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.802+0000 7ff5cca00700 1 -- start start 2024-01-22T05:15:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5cca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c4063e60 0x7ff5c414ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5cca00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5c4064240 0x7ff5c4151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5cca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5c40684a0 0x7ff5c414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5cca00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c416c5a0 con 0x7ff5c4063e60 2024-01-22T05:15:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5cca00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4151300 con 0x7ff5c4064240 2024-01-22T05:15:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5cca00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4150d20 con 0x7ff5c40684a0 2024-01-22T05:15:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5ca000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c4063e60 0x7ff5c414ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5ca000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c4063e60 0x7ff5c414ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37150/0 (socket says 172.21.15.49:37150) 2024-01-22T05:15:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5ca000700 1 -- 172.21.15.49:0/1198269702 learned_addr learned my addr 172.21.15.49:0/1198269702 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5cb400700 1 --2- 172.21.15.49:0/1198269702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5c40684a0 0x7ff5c414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5c9600700 1 --2- 172.21.15.49:0/1198269702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5c4064240 0x7ff5c4151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5ca000700 1 -- 172.21.15.49:0/1198269702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5c40684a0 msgr2=0x7ff5c414d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5ca000700 1 --2- 172.21.15.49:0/1198269702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5c40684a0 0x7ff5c414d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5ca000700 1 -- 172.21.15.49:0/1198269702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5c4064240 msgr2=0x7ff5c4151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:05.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5ca000700 1 --2- 172.21.15.49:0/1198269702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5c4064240 0x7ff5c4151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:05.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5ca000700 1 -- 172.21.15.49:0/1198269702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc009a20 con 0x7ff5c4063e60 2024-01-22T05:15:05.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5cb400700 1 --2- 172.21.15.49:0/1198269702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5c40684a0 0x7ff5c414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:15:05.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5ca000700 1 --2- 172.21.15.49:0/1198269702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c4063e60 0x7ff5c414ca00 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7ff5b400c840 tx=0x7ff5b4001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:05.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5c1600700 1 -- 172.21.15.49:0/1198269702 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4007170 con 0x7ff5c4063e60 2024-01-22T05:15:05.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5c1600700 1 -- 172.21.15.49:0/1198269702 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b40072d0 con 0x7ff5c4063e60 2024-01-22T05:15:05.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5cca00700 1 -- 172.21.15.49:0/1198269702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c414e380 con 0x7ff5c4063e60 2024-01-22T05:15:05.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5c1600700 1 -- 172.21.15.49:0/1198269702 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40048c0 con 0x7ff5c4063e60 2024-01-22T05:15:05.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.806+0000 7ff5cca00700 1 -- 172.21.15.49:0/1198269702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c4150f90 con 0x7ff5c4063e60 2024-01-22T05:15:05.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.810+0000 7ff5cca00700 1 -- 172.21.15.49:0/1198269702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c4069700 con 0x7ff5c4063e60 2024-01-22T05:15:05.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.810+0000 7ff5c1600700 1 -- 172.21.15.49:0/1198269702 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff5b4004c70 con 0x7ff5c4063e60 2024-01-22T05:15:05.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.814+0000 7ff5c1600700 1 --2- 172.21.15.49:0/1198269702 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff59c05a540 0x7ff59c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:05.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.814+0000 7ff5c1600700 1 -- 172.21.15.49:0/1198269702 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff5b4074260 con 0x7ff5c4063e60 2024-01-22T05:15:05.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.814+0000 7ff5c9600700 1 --2- 172.21.15.49:0/1198269702 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff59c05a540 0x7ff59c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:05.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.814+0000 7ff5c9600700 1 --2- 172.21.15.49:0/1198269702 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff59c05a540 0x7ff59c05ca00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7ff5c40688a0 tx=0x7ff5ac007bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:05.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:05.818+0000 7ff5c1600700 1 -- 172.21.15.49:0/1198269702 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff5b40478e0 con 0x7ff5c4063e60 2024-01-22T05:15:06.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:06.022+0000 7ff5cca00700 1 -- 172.21.15.49:0/1198269702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff5c4152290 con 0x7ff5c4063e60 2024-01-22T05:15:06.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:06.022+0000 7ff5c1600700 1 -- 172.21.15.49:0/1198269702 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v106) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff5b4019070 con 0x7ff5c4063e60 2024-01-22T05:15:06.026 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:15:06.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:06.026+0000 7ff5cca00700 1 -- 172.21.15.49:0/1198269702 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff59c05a540 msgr2=0x7ff59c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:06.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:06.026+0000 7ff5cca00700 1 --2- 172.21.15.49:0/1198269702 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff59c05a540 0x7ff59c05ca00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7ff5c40688a0 tx=0x7ff5ac007bc0).stop 2024-01-22T05:15:06.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:06.026+0000 7ff5cca00700 1 -- 172.21.15.49:0/1198269702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c4063e60 msgr2=0x7ff5c414ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:06.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:06.026+0000 7ff5cca00700 1 --2- 172.21.15.49:0/1198269702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c4063e60 0x7ff5c414ca00 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7ff5b400c840 tx=0x7ff5b4001b50).stop 2024-01-22T05:15:06.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:06.026+0000 7ff5cca00700 1 -- 172.21.15.49:0/1198269702 shutdown_connections 2024-01-22T05:15:06.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:06.026+0000 7ff5cca00700 1 --2- 172.21.15.49:0/1198269702 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff59c05a540 0x7ff59c05ca00 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:06.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:06.026+0000 7ff5cca00700 1 --2- 172.21.15.49:0/1198269702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5c40684a0 0x7ff5c414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:06.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:06.026+0000 7ff5cca00700 1 --2- 172.21.15.49:0/1198269702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5c4064240 0x7ff5c4151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:06.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:06.026+0000 7ff5cca00700 1 --2- 172.21.15.49:0/1198269702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5c4063e60 0x7ff5c414ca00 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:06.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:06.026+0000 7ff5cca00700 1 -- 172.21.15.49:0/1198269702 >> 172.21.15.49:0/1198269702 conn(0x7ff5c40c5bb0 msgr2=0x7ff5c40aa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:06.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:06.030+0000 7ff5cca00700 1 -- 172.21.15.49:0/1198269702 shutdown_connections 2024-01-22T05:15:06.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:06.030+0000 7ff5cca00700 1 -- 172.21.15.49:0/1198269702 wait complete. 2024-01-22T05:15:06.051 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-22T05:15:06.051 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:15:06.051 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:15:06.051 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:15:06.051 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:15:06.051 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-22T05:15:06.051 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-22T05:15:06.051 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:15:06.051 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:15:06.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:15:06.052 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:15:06.066 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41865sec preferred_lft 41865sec 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:15:06.067 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::7ce7:e3ff:fed1:1e88/64 scope link 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:15:06.068 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:15:06.069 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 82:c1:48:e7:c7:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:15:06.069 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::80c1:48ff:fee7:c731/64 scope link 2024-01-22T05:15:06.069 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:15:06.069 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:15:06.069 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:15:06.069 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3426:32ff:feee:c4c9/64 scope link 2024-01-22T05:15:06.069 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:15:06.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:15:06.070 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:15:06.145 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:15:06.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:15:06.149 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:15:06.211 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:15:06.211 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:15:06.212 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:15:06.212 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:15:06.212 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:15:06.212 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:15:06.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:15:06.213 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:15:06.213 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:06.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:15:06.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:15:06.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:15:06.213 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:06.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:15:06.343 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:15:06.360 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:15:06.360 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:15:06.361 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:15:06.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:15:06.361 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-22T05:15:06.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:15:06.437 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-22T05:15:06.496 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:15:06.497 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:15:06.615 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:15:06.615 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:15:06.638 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:15:06.638 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:15:06.645 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:15:06.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:15:06.645 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:15:06.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:06.675 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:06.675 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:06.675 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.0 2024-01-22T05:15:06.675 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:06.675 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:06.676 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:06.676 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:06.797 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:06.797 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:06.797 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295505 s, 35.5 MB/s 2024-01-22T05:15:06.839 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:06.839 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:06.839 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0385819 s, 27.2 MB/s 2024-01-22T05:15:06.867 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:06.867 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:06.867 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247475 s, 42.4 MB/s 2024-01-22T05:15:06.899 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:06.899 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:06.899 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287077 s, 36.5 MB/s 2024-01-22T05:15:06.931 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:06.931 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:06.931 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278731 s, 37.6 MB/s 2024-01-22T05:15:06.969 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:06.969 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:06.969 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348132 s, 30.1 MB/s 2024-01-22T05:15:06.996 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:06.996 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:06.996 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233803 s, 44.8 MB/s 2024-01-22T05:15:07.028 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.028 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.028 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285339 s, 36.7 MB/s 2024-01-22T05:15:07.062 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.062 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.062 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287585 s, 36.5 MB/s 2024-01-22T05:15:07.091 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.091 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.092 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025941 s, 40.4 MB/s 2024-01-22T05:15:07.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.121 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253193 s, 41.4 MB/s 2024-01-22T05:15:07.164 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.164 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.165 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0393678 s, 26.6 MB/s 2024-01-22T05:15:07.192 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.192 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.192 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233624 s, 44.9 MB/s 2024-01-22T05:15:07.227 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.227 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.227 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310231 s, 33.8 MB/s 2024-01-22T05:15:07.264 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.264 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.264 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0331865 s, 31.6 MB/s 2024-01-22T05:15:07.297 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.297 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.298 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293874 s, 35.7 MB/s 2024-01-22T05:15:07.329 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.329 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.329 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266597 s, 39.3 MB/s 2024-01-22T05:15:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324767 s, 32.3 MB/s 2024-01-22T05:15:07.408 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.408 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.408 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0395397 s, 26.5 MB/s 2024-01-22T05:15:07.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.445 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03355 s, 31.3 MB/s 2024-01-22T05:15:07.474 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.474 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.474 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255843 s, 41.0 MB/s 2024-01-22T05:15:07.507 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.508 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.508 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297784 s, 35.2 MB/s 2024-01-22T05:15:07.539 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.539 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.539 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285071 s, 36.8 MB/s 2024-01-22T05:15:07.573 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.573 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.573 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308664 s, 34.0 MB/s 2024-01-22T05:15:07.602 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.602 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.602 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251285 s, 41.7 MB/s 2024-01-22T05:15:07.629 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.629 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.629 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241676 s, 43.4 MB/s 2024-01-22T05:15:07.656 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.656 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.657 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243191 s, 43.1 MB/s 2024-01-22T05:15:07.690 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.690 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.690 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291993 s, 35.9 MB/s 2024-01-22T05:15:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216268 s, 48.5 MB/s 2024-01-22T05:15:07.749 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.749 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.749 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301397 s, 34.8 MB/s 2024-01-22T05:15:07.781 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.781 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.781 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284971 s, 36.8 MB/s 2024-01-22T05:15:07.815 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.815 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.815 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301935 s, 34.7 MB/s 2024-01-22T05:15:07.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:07.818 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:07.818 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:07.818 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.1 2024-01-22T05:15:07.818 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:07.818 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:07.818 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:07.818 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:07.878 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.878 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.878 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261698 s, 40.1 MB/s 2024-01-22T05:15:07.911 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.911 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.911 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296515 s, 35.4 MB/s 2024-01-22T05:15:07.939 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.939 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.939 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232322 s, 45.1 MB/s 2024-01-22T05:15:07.973 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:07.973 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:07.973 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293123 s, 35.8 MB/s 2024-01-22T05:15:08.008 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.008 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.008 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319425 s, 32.8 MB/s 2024-01-22T05:15:08.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.045 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319225 s, 32.8 MB/s 2024-01-22T05:15:08.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.075 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255534 s, 41.0 MB/s 2024-01-22T05:15:08.111 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.111 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.111 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325051 s, 32.3 MB/s 2024-01-22T05:15:08.149 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.149 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.149 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333891 s, 31.4 MB/s 2024-01-22T05:15:08.177 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.177 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.178 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02456 s, 42.7 MB/s 2024-01-22T05:15:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289159 s, 36.3 MB/s 2024-01-22T05:15:08.240 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.240 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.240 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257561 s, 40.7 MB/s 2024-01-22T05:15:08.269 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.269 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.269 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264306 s, 39.7 MB/s 2024-01-22T05:15:08.303 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305724 s, 34.3 MB/s 2024-01-22T05:15:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.336 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281477 s, 37.3 MB/s 2024-01-22T05:15:08.365 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.365 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.365 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257924 s, 40.7 MB/s 2024-01-22T05:15:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.403 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342686 s, 30.6 MB/s 2024-01-22T05:15:08.446 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.446 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.446 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0386141 s, 27.2 MB/s 2024-01-22T05:15:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.473 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024075 s, 43.6 MB/s 2024-01-22T05:15:08.500 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.500 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.500 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229938 s, 45.6 MB/s 2024-01-22T05:15:08.529 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.529 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.529 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253128 s, 41.4 MB/s 2024-01-22T05:15:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.567 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0335899 s, 31.2 MB/s 2024-01-22T05:15:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251982 s, 41.6 MB/s 2024-01-22T05:15:08.626 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.626 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.626 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252879 s, 41.5 MB/s 2024-01-22T05:15:08.654 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.654 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.654 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246699 s, 42.5 MB/s 2024-01-22T05:15:08.695 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.695 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.695 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0375689 s, 27.9 MB/s 2024-01-22T05:15:08.720 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.720 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.720 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224182 s, 46.8 MB/s 2024-01-22T05:15:08.747 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.747 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.748 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226933 s, 46.2 MB/s 2024-01-22T05:15:08.777 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.778 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.778 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242421 s, 43.3 MB/s 2024-01-22T05:15:08.804 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.804 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.804 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244268 s, 42.9 MB/s 2024-01-22T05:15:08.832 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.832 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.832 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023489 s, 44.6 MB/s 2024-01-22T05:15:08.860 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.860 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.860 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241369 s, 43.4 MB/s 2024-01-22T05:15:08.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:08.862 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:08.862 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:08.862 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.2 2024-01-22T05:15:08.863 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:08.863 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:08.863 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:08.863 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:08.922 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.922 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.922 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251068 s, 41.8 MB/s 2024-01-22T05:15:08.953 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.953 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.953 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284033 s, 36.9 MB/s 2024-01-22T05:15:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:08.984 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270825 s, 38.7 MB/s 2024-01-22T05:15:09.013 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.013 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.013 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247595 s, 42.4 MB/s 2024-01-22T05:15:09.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.045 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278284 s, 37.7 MB/s 2024-01-22T05:15:09.079 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.079 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.080 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308532 s, 34.0 MB/s 2024-01-22T05:15:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223955 s, 46.8 MB/s 2024-01-22T05:15:09.132 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.132 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.132 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226977 s, 46.2 MB/s 2024-01-22T05:15:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0365535 s, 28.7 MB/s 2024-01-22T05:15:09.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.202 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258332 s, 40.6 MB/s 2024-01-22T05:15:09.232 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.232 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.232 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255878 s, 41.0 MB/s 2024-01-22T05:15:09.275 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.275 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.275 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0384126 s, 27.3 MB/s 2024-01-22T05:15:09.304 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.304 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.304 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242067 s, 43.3 MB/s 2024-01-22T05:15:09.322 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:15:09.328 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:15:09.333 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.333 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.333 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251927 s, 41.6 MB/s 2024-01-22T05:15:09.360 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.360 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.360 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239967 s, 43.7 MB/s 2024-01-22T05:15:09.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.388 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243385 s, 43.1 MB/s 2024-01-22T05:15:09.410 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.410 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.411 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188038 s, 55.8 MB/s 2024-01-22T05:15:09.433 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.433 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.433 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199006 s, 52.7 MB/s 2024-01-22T05:15:09.466 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.467 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.467 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292801 s, 35.8 MB/s 2024-01-22T05:15:09.492 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.493 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.493 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220989 s, 47.4 MB/s 2024-01-22T05:15:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.521 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245417 s, 42.7 MB/s 2024-01-22T05:15:09.545 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.545 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.545 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212398 s, 49.4 MB/s 2024-01-22T05:15:09.586 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.586 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.586 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0372854 s, 28.1 MB/s 2024-01-22T05:15:09.612 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.613 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.613 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233364 s, 44.9 MB/s 2024-01-22T05:15:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227213 s, 46.1 MB/s 2024-01-22T05:15:09.668 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.668 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.668 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247947 s, 42.3 MB/s 2024-01-22T05:15:09.700 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.700 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.700 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278405 s, 37.7 MB/s 2024-01-22T05:15:09.738 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.738 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.738 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328494 s, 31.9 MB/s 2024-01-22T05:15:09.771 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.771 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.771 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278286 s, 37.7 MB/s 2024-01-22T05:15:09.809 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.810 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.810 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345017 s, 30.4 MB/s 2024-01-22T05:15:09.842 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.843 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.843 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289079 s, 36.3 MB/s 2024-01-22T05:15:09.869 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.869 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.869 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219544 s, 47.8 MB/s 2024-01-22T05:15:09.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:09.871 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:09.871 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:09.871 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.3 2024-01-22T05:15:09.871 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:09.871 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:09.871 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:09.871 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:09.970 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.970 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.971 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190815 s, 55.0 MB/s 2024-01-22T05:15:09.996 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:09.996 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:09.996 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218374 s, 48.0 MB/s 2024-01-22T05:15:10.025 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.025 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.025 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246104 s, 42.6 MB/s 2024-01-22T05:15:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262564 s, 39.9 MB/s 2024-01-22T05:15:10.081 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.081 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.081 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208231 s, 50.4 MB/s 2024-01-22T05:15:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296408 s, 35.4 MB/s 2024-01-22T05:15:10.145 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.145 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.146 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027798 s, 37.7 MB/s 2024-01-22T05:15:10.182 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.182 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.182 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031567 s, 33.2 MB/s 2024-01-22T05:15:10.214 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.214 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.214 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278055 s, 37.7 MB/s 2024-01-22T05:15:10.250 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.250 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.250 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318851 s, 32.9 MB/s 2024-01-22T05:15:10.281 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.281 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.281 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274469 s, 38.2 MB/s 2024-01-22T05:15:10.309 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.309 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.309 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244949 s, 42.8 MB/s 2024-01-22T05:15:10.340 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.340 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.340 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270154 s, 38.8 MB/s 2024-01-22T05:15:10.378 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.378 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.378 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345708 s, 30.3 MB/s 2024-01-22T05:15:10.407 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.407 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.407 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246144 s, 42.6 MB/s 2024-01-22T05:15:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251499 s, 41.7 MB/s 2024-01-22T05:15:10.467 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.467 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.467 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277329 s, 37.8 MB/s 2024-01-22T05:15:10.500 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.500 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.500 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303945 s, 34.5 MB/s 2024-01-22T05:15:10.543 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.543 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.543 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0380016 s, 27.6 MB/s 2024-01-22T05:15:10.571 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.571 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.571 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246946 s, 42.5 MB/s 2024-01-22T05:15:10.610 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.611 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.611 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0364255 s, 28.8 MB/s 2024-01-22T05:15:10.640 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.640 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.640 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249685 s, 42.0 MB/s 2024-01-22T05:15:10.674 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.674 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.674 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299591 s, 35.0 MB/s 2024-01-22T05:15:10.704 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.704 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.704 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261658 s, 40.1 MB/s 2024-01-22T05:15:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300406 s, 34.9 MB/s 2024-01-22T05:15:10.767 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.767 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.767 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264515 s, 39.6 MB/s 2024-01-22T05:15:10.796 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.796 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.796 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264326 s, 39.7 MB/s 2024-01-22T05:15:10.830 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.830 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.830 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298637 s, 35.1 MB/s 2024-01-22T05:15:10.860 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.860 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.861 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263685 s, 39.8 MB/s 2024-01-22T05:15:10.888 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.888 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.888 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239312 s, 43.8 MB/s 2024-01-22T05:15:10.919 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.919 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.919 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268843 s, 39.0 MB/s 2024-01-22T05:15:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:10.948 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:10.948 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023115 s, 45.4 MB/s 2024-01-22T05:15:10.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:10.949 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:10.949 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:10.949 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.4 2024-01-22T05:15:10.950 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:10.950 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:10.950 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:10.950 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:11.010 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.010 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.010 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281006 s, 37.3 MB/s 2024-01-22T05:15:11.039 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.039 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.039 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253756 s, 41.3 MB/s 2024-01-22T05:15:11.067 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.067 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.067 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231775 s, 45.2 MB/s 2024-01-22T05:15:11.102 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.102 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.102 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317069 s, 33.1 MB/s 2024-01-22T05:15:11.129 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.129 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.129 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228425 s, 45.9 MB/s 2024-01-22T05:15:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026791 s, 39.1 MB/s 2024-01-22T05:15:11.186 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.186 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.186 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229327 s, 45.7 MB/s 2024-01-22T05:15:11.215 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.215 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.215 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260621 s, 40.2 MB/s 2024-01-22T05:15:11.246 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.246 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.246 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267757 s, 39.2 MB/s 2024-01-22T05:15:11.274 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.274 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.274 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248905 s, 42.1 MB/s 2024-01-22T05:15:11.311 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.312 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.312 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0347293 s, 30.2 MB/s 2024-01-22T05:15:11.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.347 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030823 s, 34.0 MB/s 2024-01-22T05:15:11.375 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.376 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.376 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241977 s, 43.3 MB/s 2024-01-22T05:15:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023003 s, 45.6 MB/s 2024-01-22T05:15:11.429 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.430 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.430 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248062 s, 42.3 MB/s 2024-01-22T05:15:11.455 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.455 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.455 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223517 s, 46.9 MB/s 2024-01-22T05:15:11.484 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.484 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.484 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254668 s, 41.2 MB/s 2024-01-22T05:15:11.518 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.518 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.518 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302611 s, 34.7 MB/s 2024-01-22T05:15:11.548 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.548 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.548 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265712 s, 39.5 MB/s 2024-01-22T05:15:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226478 s, 46.3 MB/s 2024-01-22T05:15:11.600 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.600 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.600 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220558 s, 47.5 MB/s 2024-01-22T05:15:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232875 s, 45.0 MB/s 2024-01-22T05:15:11.654 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.655 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.655 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233726 s, 44.9 MB/s 2024-01-22T05:15:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270108 s, 38.8 MB/s 2024-01-22T05:15:11.711 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.711 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.711 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213693 s, 49.1 MB/s 2024-01-22T05:15:11.741 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.741 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.742 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256895 s, 40.8 MB/s 2024-01-22T05:15:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243127 s, 43.1 MB/s 2024-01-22T05:15:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.797 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.797 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232848 s, 45.0 MB/s 2024-01-22T05:15:11.822 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.822 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.822 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233161 s, 45.0 MB/s 2024-01-22T05:15:11.852 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.852 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.852 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256975 s, 40.8 MB/s 2024-01-22T05:15:11.883 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.883 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.883 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269085 s, 39.0 MB/s 2024-01-22T05:15:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251883 s, 41.6 MB/s 2024-01-22T05:15:11.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:11.915 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:11.915 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:11.915 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.5 2024-01-22T05:15:11.915 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:11.915 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:11.915 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:11.915 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:11.971 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:11.971 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:11.971 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236668 s, 44.3 MB/s 2024-01-22T05:15:12.001 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.001 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.001 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287301 s, 36.5 MB/s 2024-01-22T05:15:12.027 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.027 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.027 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216303 s, 48.5 MB/s 2024-01-22T05:15:12.065 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.065 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.065 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340224 s, 30.8 MB/s 2024-01-22T05:15:12.095 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.095 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.095 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251724 s, 41.7 MB/s 2024-01-22T05:15:12.130 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.130 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.130 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311683 s, 33.6 MB/s 2024-01-22T05:15:12.166 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.166 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.166 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312774 s, 33.5 MB/s 2024-01-22T05:15:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235362 s, 44.6 MB/s 2024-01-22T05:15:12.221 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.221 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.221 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248062 s, 42.3 MB/s 2024-01-22T05:15:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249285 s, 42.1 MB/s 2024-01-22T05:15:12.281 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.281 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.281 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272683 s, 38.5 MB/s 2024-01-22T05:15:12.305 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.305 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.305 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209419 s, 50.1 MB/s 2024-01-22T05:15:12.343 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.344 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.344 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0356582 s, 29.4 MB/s 2024-01-22T05:15:12.378 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.378 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295804 s, 35.4 MB/s 2024-01-22T05:15:12.403 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.404 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.404 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225048 s, 46.6 MB/s 2024-01-22T05:15:12.430 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.430 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.431 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228896 s, 45.8 MB/s 2024-01-22T05:15:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230344 s, 45.5 MB/s 2024-01-22T05:15:12.490 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.490 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.490 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287053 s, 36.5 MB/s 2024-01-22T05:15:12.520 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.521 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.521 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264296 s, 39.7 MB/s 2024-01-22T05:15:12.551 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.551 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.551 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269158 s, 39.0 MB/s 2024-01-22T05:15:12.583 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.583 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.583 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279116 s, 37.6 MB/s 2024-01-22T05:15:12.608 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.608 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.608 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021104 s, 49.7 MB/s 2024-01-22T05:15:12.646 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.646 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.646 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0331764 s, 31.6 MB/s 2024-01-22T05:15:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257962 s, 40.6 MB/s 2024-01-22T05:15:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242741 s, 43.2 MB/s 2024-01-22T05:15:12.724 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.724 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.724 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187888 s, 55.8 MB/s 2024-01-22T05:15:12.751 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.751 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.751 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226319 s, 46.3 MB/s 2024-01-22T05:15:12.779 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.780 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252781 s, 41.5 MB/s 2024-01-22T05:15:12.807 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.807 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.807 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250474 s, 41.9 MB/s 2024-01-22T05:15:12.836 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.837 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.837 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261269 s, 40.1 MB/s 2024-01-22T05:15:12.866 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.866 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.866 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251301 s, 41.7 MB/s 2024-01-22T05:15:12.902 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.903 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328776 s, 31.9 MB/s 2024-01-22T05:15:12.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:12.905 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:12.905 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:12.905 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.6 2024-01-22T05:15:12.905 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:12.905 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:12.906 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:12.906 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:12.962 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.962 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.962 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265914 s, 39.4 MB/s 2024-01-22T05:15:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030946 s, 33.9 MB/s 2024-01-22T05:15:13.038 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.039 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.039 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0366267 s, 28.6 MB/s 2024-01-22T05:15:13.069 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.069 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.069 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261274 s, 40.1 MB/s 2024-01-22T05:15:13.096 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.096 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.096 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240862 s, 43.5 MB/s 2024-01-22T05:15:13.133 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.133 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.133 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329831 s, 31.8 MB/s 2024-01-22T05:15:13.164 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.164 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.164 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264156 s, 39.7 MB/s 2024-01-22T05:15:13.188 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.188 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.188 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211935 s, 49.5 MB/s 2024-01-22T05:15:13.220 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.220 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.220 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275595 s, 38.0 MB/s 2024-01-22T05:15:13.257 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.257 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.257 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326256 s, 32.1 MB/s 2024-01-22T05:15:13.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.282 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217773 s, 48.2 MB/s 2024-01-22T05:15:13.309 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.309 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.309 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233864 s, 44.8 MB/s 2024-01-22T05:15:13.343 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.343 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.344 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312301 s, 33.6 MB/s 2024-01-22T05:15:13.376 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.377 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.377 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288352 s, 36.4 MB/s 2024-01-22T05:15:13.405 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.405 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.405 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258042 s, 40.6 MB/s 2024-01-22T05:15:13.437 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.438 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.438 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278713 s, 37.6 MB/s 2024-01-22T05:15:13.467 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.467 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.467 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246581 s, 42.5 MB/s 2024-01-22T05:15:13.496 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.496 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.496 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255394 s, 41.1 MB/s 2024-01-22T05:15:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.524 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248278 s, 42.2 MB/s 2024-01-22T05:15:13.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.556 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272876 s, 38.4 MB/s 2024-01-22T05:15:13.591 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327749 s, 32.0 MB/s 2024-01-22T05:15:13.618 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.618 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.618 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244623 s, 42.9 MB/s 2024-01-22T05:15:13.636 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.636 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.636 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153263 s, 68.4 MB/s 2024-01-22T05:15:13.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.670 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297857 s, 35.2 MB/s 2024-01-22T05:15:13.701 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.701 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.701 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282736 s, 37.1 MB/s 2024-01-22T05:15:13.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.735 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299595 s, 35.0 MB/s 2024-01-22T05:15:13.761 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.762 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.762 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223712 s, 46.9 MB/s 2024-01-22T05:15:13.793 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.793 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.793 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267473 s, 39.2 MB/s 2024-01-22T05:15:13.825 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.825 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.825 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272565 s, 38.5 MB/s 2024-01-22T05:15:13.853 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.854 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.854 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026464 s, 39.6 MB/s 2024-01-22T05:15:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258756 s, 40.5 MB/s 2024-01-22T05:15:13.930 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:13.930 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:13.930 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0427044 s, 24.6 MB/s 2024-01-22T05:15:13.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:13.933 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:13.933 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:13.933 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.7 2024-01-22T05:15:13.933 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:13.933 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:13.934 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:13.934 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:14.006 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.006 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.006 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334548 s, 31.3 MB/s 2024-01-22T05:15:14.033 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.033 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.033 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230063 s, 45.6 MB/s 2024-01-22T05:15:14.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.060 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023652 s, 44.3 MB/s 2024-01-22T05:15:14.098 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.098 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.098 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0343684 s, 30.5 MB/s 2024-01-22T05:15:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259995 s, 40.3 MB/s 2024-01-22T05:15:14.163 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.164 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.164 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311757 s, 33.6 MB/s 2024-01-22T05:15:14.193 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.193 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.193 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026152 s, 40.1 MB/s 2024-01-22T05:15:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326126 s, 32.2 MB/s 2024-01-22T05:15:14.265 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.266 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.266 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031915 s, 32.9 MB/s 2024-01-22T05:15:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248364 s, 42.2 MB/s 2024-01-22T05:15:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282388 s, 37.1 MB/s 2024-01-22T05:15:14.354 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.354 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.354 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241968 s, 43.3 MB/s 2024-01-22T05:15:14.381 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.382 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.382 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237247 s, 44.2 MB/s 2024-01-22T05:15:14.415 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.416 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.416 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309956 s, 33.8 MB/s 2024-01-22T05:15:14.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.445 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255668 s, 41.0 MB/s 2024-01-22T05:15:14.474 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.475 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261016 s, 40.2 MB/s 2024-01-22T05:15:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286236 s, 36.6 MB/s 2024-01-22T05:15:14.531 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.531 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.531 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224256 s, 46.8 MB/s 2024-01-22T05:15:14.557 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.558 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227598 s, 46.1 MB/s 2024-01-22T05:15:14.583 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.583 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.583 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217802 s, 48.1 MB/s 2024-01-22T05:15:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020775 s, 50.5 MB/s 2024-01-22T05:15:14.636 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.636 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.636 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250378 s, 41.9 MB/s 2024-01-22T05:15:14.666 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.666 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.666 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257565 s, 40.7 MB/s 2024-01-22T05:15:14.702 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.702 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.702 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317514 s, 33.0 MB/s 2024-01-22T05:15:14.730 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.730 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.730 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239694 s, 43.7 MB/s 2024-01-22T05:15:14.755 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.756 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.756 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222772 s, 47.1 MB/s 2024-01-22T05:15:14.784 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.784 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.785 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247322 s, 42.4 MB/s 2024-01-22T05:15:14.823 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.823 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.823 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034409 s, 30.5 MB/s 2024-01-22T05:15:14.858 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.858 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.858 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298629 s, 35.1 MB/s 2024-01-22T05:15:14.886 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.886 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.886 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236687 s, 44.3 MB/s 2024-01-22T05:15:14.906 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.906 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.906 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173789 s, 60.3 MB/s 2024-01-22T05:15:14.934 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.934 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.934 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240052 s, 43.7 MB/s 2024-01-22T05:15:14.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:14.936 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:14.936 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:14.936 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.8 2024-01-22T05:15:14.936 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:14.936 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:14.936 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:14.936 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:14.993 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:14.993 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:14.993 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248286 s, 42.2 MB/s 2024-01-22T05:15:15.028 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.028 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.028 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307067 s, 34.1 MB/s 2024-01-22T05:15:15.057 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.057 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.057 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243706 s, 43.0 MB/s 2024-01-22T05:15:15.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.085 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245802 s, 42.7 MB/s 2024-01-22T05:15:15.119 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.119 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.119 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295444 s, 35.5 MB/s 2024-01-22T05:15:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241946 s, 43.3 MB/s 2024-01-22T05:15:15.174 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.174 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.174 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227506 s, 46.1 MB/s 2024-01-22T05:15:15.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.203 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259364 s, 40.4 MB/s 2024-01-22T05:15:15.235 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.235 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.235 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280213 s, 37.4 MB/s 2024-01-22T05:15:15.271 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.271 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.271 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319064 s, 32.9 MB/s 2024-01-22T05:15:15.300 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.300 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.301 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249462 s, 42.0 MB/s 2024-01-22T05:15:15.329 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.329 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.329 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243042 s, 43.1 MB/s 2024-01-22T05:15:15.359 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.359 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.359 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254562 s, 41.2 MB/s 2024-01-22T05:15:15.389 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.390 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.390 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265145 s, 39.5 MB/s 2024-01-22T05:15:15.416 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.416 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.416 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236031 s, 44.4 MB/s 2024-01-22T05:15:15.457 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.457 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.457 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.036877 s, 28.4 MB/s 2024-01-22T05:15:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312672 s, 33.5 MB/s 2024-01-22T05:15:15.522 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.522 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.522 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256354 s, 40.9 MB/s 2024-01-22T05:15:15.552 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.552 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.552 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254178 s, 41.3 MB/s 2024-01-22T05:15:15.583 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.583 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.583 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270486 s, 38.8 MB/s 2024-01-22T05:15:15.609 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.609 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.610 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234304 s, 44.8 MB/s 2024-01-22T05:15:15.637 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.637 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.637 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243901 s, 43.0 MB/s 2024-01-22T05:15:15.660 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.660 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.660 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197831 s, 53.0 MB/s 2024-01-22T05:15:15.683 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.684 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.684 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197154 s, 53.2 MB/s 2024-01-22T05:15:15.710 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.710 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.710 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235193 s, 44.6 MB/s 2024-01-22T05:15:15.739 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.739 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.739 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253399 s, 41.4 MB/s 2024-01-22T05:15:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237635 s, 44.1 MB/s 2024-01-22T05:15:15.794 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.794 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.794 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226672 s, 46.3 MB/s 2024-01-22T05:15:15.816 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.816 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.816 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193624 s, 54.2 MB/s 2024-01-22T05:15:15.849 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.849 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.849 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029272 s, 35.8 MB/s 2024-01-22T05:15:15.877 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.877 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.877 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025424 s, 41.2 MB/s 2024-01-22T05:15:15.905 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.905 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.905 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241336 s, 43.4 MB/s 2024-01-22T05:15:15.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:15.907 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:15.907 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:15.907 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.9 2024-01-22T05:15:15.907 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:15.907 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:15.907 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:15.907 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:15.960 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.960 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.960 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246174 s, 42.6 MB/s 2024-01-22T05:15:15.991 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:15.991 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:15.992 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285971 s, 36.7 MB/s 2024-01-22T05:15:16.024 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.024 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.024 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028765 s, 36.5 MB/s 2024-01-22T05:15:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0359932 s, 29.1 MB/s 2024-01-22T05:15:16.101 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.101 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.101 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323988 s, 32.4 MB/s 2024-01-22T05:15:16.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.131 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253615 s, 41.3 MB/s 2024-01-22T05:15:16.165 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.165 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.165 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02934 s, 35.7 MB/s 2024-01-22T05:15:16.201 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.201 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.201 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314508 s, 33.3 MB/s 2024-01-22T05:15:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.229 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234606 s, 44.7 MB/s 2024-01-22T05:15:16.254 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.254 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.254 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221266 s, 47.4 MB/s 2024-01-22T05:15:16.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.282 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248989 s, 42.1 MB/s 2024-01-22T05:15:16.316 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.316 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.316 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305311 s, 34.3 MB/s 2024-01-22T05:15:16.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.347 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262008 s, 40.0 MB/s 2024-01-22T05:15:16.382 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.382 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.382 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309808 s, 33.8 MB/s 2024-01-22T05:15:16.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.412 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254956 s, 41.1 MB/s 2024-01-22T05:15:16.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.445 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290506 s, 36.1 MB/s 2024-01-22T05:15:16.471 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.472 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.472 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236949 s, 44.3 MB/s 2024-01-22T05:15:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032637 s, 32.1 MB/s 2024-01-22T05:15:16.543 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.543 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.543 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313417 s, 33.5 MB/s 2024-01-22T05:15:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.574 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027206 s, 38.5 MB/s 2024-01-22T05:15:16.609 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.609 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.609 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317237 s, 33.1 MB/s 2024-01-22T05:15:16.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.643 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290982 s, 36.0 MB/s 2024-01-22T05:15:16.671 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.671 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.671 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246989 s, 42.5 MB/s 2024-01-22T05:15:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299512 s, 35.0 MB/s 2024-01-22T05:15:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.732 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229564 s, 45.7 MB/s 2024-01-22T05:15:16.758 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.758 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.758 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235942 s, 44.4 MB/s 2024-01-22T05:15:16.782 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.782 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.783 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200264 s, 52.4 MB/s 2024-01-22T05:15:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234509 s, 44.7 MB/s 2024-01-22T05:15:16.847 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.847 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.847 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328814 s, 31.9 MB/s 2024-01-22T05:15:16.878 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.878 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.878 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262385 s, 40.0 MB/s 2024-01-22T05:15:16.904 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.904 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.904 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232849 s, 45.0 MB/s 2024-01-22T05:15:16.931 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.931 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.931 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236516 s, 44.3 MB/s 2024-01-22T05:15:16.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:16.934 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:16.934 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:16.934 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.10 2024-01-22T05:15:16.934 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:16.934 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:16.934 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:16.934 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:16.988 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:16.988 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:16.988 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260276 s, 40.3 MB/s 2024-01-22T05:15:17.016 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.016 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.016 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239847 s, 43.7 MB/s 2024-01-22T05:15:17.053 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.053 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.053 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328654 s, 31.9 MB/s 2024-01-22T05:15:17.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.085 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278022 s, 37.7 MB/s 2024-01-22T05:15:17.115 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.115 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.115 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258114 s, 40.6 MB/s 2024-01-22T05:15:17.139 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.139 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.139 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203131 s, 51.6 MB/s 2024-01-22T05:15:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.033854 s, 31.0 MB/s 2024-01-22T05:15:17.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.212 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.212 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03107 s, 33.7 MB/s 2024-01-22T05:15:17.237 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.237 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.237 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228036 s, 46.0 MB/s 2024-01-22T05:15:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224034 s, 46.8 MB/s 2024-01-22T05:15:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325825 s, 32.2 MB/s 2024-01-22T05:15:17.327 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.328 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.328 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247032 s, 42.4 MB/s 2024-01-22T05:15:17.353 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.353 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.353 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218053 s, 48.1 MB/s 2024-01-22T05:15:17.383 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.383 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.384 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262385 s, 40.0 MB/s 2024-01-22T05:15:17.408 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.409 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.409 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02083 s, 50.3 MB/s 2024-01-22T05:15:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266967 s, 39.3 MB/s 2024-01-22T05:15:17.462 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.462 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.463 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207543 s, 50.5 MB/s 2024-01-22T05:15:17.492 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.492 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.492 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264789 s, 39.6 MB/s 2024-01-22T05:15:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201949 s, 51.9 MB/s 2024-01-22T05:15:17.542 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.542 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.542 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231839 s, 45.2 MB/s 2024-01-22T05:15:17.583 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.583 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.583 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.036943 s, 28.4 MB/s 2024-01-22T05:15:17.613 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.613 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.613 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252556 s, 41.5 MB/s 2024-01-22T05:15:17.652 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.652 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.652 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0361042 s, 29.0 MB/s 2024-01-22T05:15:17.682 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.682 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.683 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253954 s, 41.3 MB/s 2024-01-22T05:15:17.711 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.711 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.711 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248264 s, 42.2 MB/s 2024-01-22T05:15:17.739 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.739 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.739 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242051 s, 43.3 MB/s 2024-01-22T05:15:17.766 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.766 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.766 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231538 s, 45.3 MB/s 2024-01-22T05:15:17.795 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.795 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.795 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240332 s, 43.6 MB/s 2024-01-22T05:15:17.826 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.826 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.826 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273518 s, 38.3 MB/s 2024-01-22T05:15:17.856 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.857 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.857 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264843 s, 39.6 MB/s 2024-01-22T05:15:17.889 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.890 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.890 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289167 s, 36.3 MB/s 2024-01-22T05:15:17.921 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.921 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.921 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269619 s, 38.9 MB/s 2024-01-22T05:15:17.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:17.923 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:17.923 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:17.923 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.11 2024-01-22T05:15:17.923 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:17.923 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:17.923 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:17.924 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:17.977 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:17.977 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:17.977 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245326 s, 42.7 MB/s 2024-01-22T05:15:18.003 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.003 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.003 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234635 s, 44.7 MB/s 2024-01-22T05:15:18.033 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.033 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.033 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025553 s, 41.0 MB/s 2024-01-22T05:15:18.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.060 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234581 s, 44.7 MB/s 2024-01-22T05:15:18.089 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.089 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.089 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258907 s, 40.5 MB/s 2024-01-22T05:15:18.124 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.124 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.124 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307345 s, 34.1 MB/s 2024-01-22T05:15:18.158 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.159 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.159 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305116 s, 34.4 MB/s 2024-01-22T05:15:18.188 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.188 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.188 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260841 s, 40.2 MB/s 2024-01-22T05:15:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319541 s, 32.8 MB/s 2024-01-22T05:15:18.255 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.255 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.255 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264412 s, 39.7 MB/s 2024-01-22T05:15:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295093 s, 35.5 MB/s 2024-01-22T05:15:18.318 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.318 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.318 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247643 s, 42.3 MB/s 2024-01-22T05:15:18.353 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.353 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.353 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319102 s, 32.9 MB/s 2024-01-22T05:15:18.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.381 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224091 s, 46.8 MB/s 2024-01-22T05:15:18.409 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.409 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.409 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256104 s, 40.9 MB/s 2024-01-22T05:15:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024944 s, 42.0 MB/s 2024-01-22T05:15:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252226 s, 41.6 MB/s 2024-01-22T05:15:18.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.489 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202349 s, 51.8 MB/s 2024-01-22T05:15:18.520 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.520 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.521 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268322 s, 39.1 MB/s 2024-01-22T05:15:18.550 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.550 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.550 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263407 s, 39.8 MB/s 2024-01-22T05:15:18.589 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.589 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.589 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0347166 s, 30.2 MB/s 2024-01-22T05:15:18.627 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.627 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.627 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034845 s, 30.1 MB/s 2024-01-22T05:15:18.668 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.668 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.669 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0370912 s, 28.3 MB/s 2024-01-22T05:15:18.701 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.701 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.701 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277912 s, 37.7 MB/s 2024-01-22T05:15:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303134 s, 34.6 MB/s 2024-01-22T05:15:18.761 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.761 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.761 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021144 s, 49.6 MB/s 2024-01-22T05:15:18.789 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.789 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.789 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245895 s, 42.6 MB/s 2024-01-22T05:15:18.815 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.815 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.815 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223509 s, 46.9 MB/s 2024-01-22T05:15:18.855 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.855 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.855 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0359899 s, 29.1 MB/s 2024-01-22T05:15:18.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.884 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247035 s, 42.4 MB/s 2024-01-22T05:15:18.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.914 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262598 s, 39.9 MB/s 2024-01-22T05:15:18.944 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.944 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.944 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026821 s, 39.1 MB/s 2024-01-22T05:15:18.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:18.947 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:18.947 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:18.947 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.12 2024-01-22T05:15:18.947 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:18.947 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:18.947 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:18.947 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:18.997 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:18.997 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:18.997 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227528 s, 46.1 MB/s 2024-01-22T05:15:19.031 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.031 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.031 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301661 s, 34.8 MB/s 2024-01-22T05:15:19.063 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.064 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.064 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284929 s, 36.8 MB/s 2024-01-22T05:15:19.091 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.091 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.092 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239744 s, 43.7 MB/s 2024-01-22T05:15:19.124 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.124 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.124 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295033 s, 35.5 MB/s 2024-01-22T05:15:19.155 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.155 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.155 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266513 s, 39.3 MB/s 2024-01-22T05:15:19.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.186 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.186 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261238 s, 40.1 MB/s 2024-01-22T05:15:19.219 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.219 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.219 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296086 s, 35.4 MB/s 2024-01-22T05:15:19.248 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.248 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.248 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245798 s, 42.7 MB/s 2024-01-22T05:15:19.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.284 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315337 s, 33.3 MB/s 2024-01-22T05:15:19.313 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.314 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.314 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251155 s, 41.8 MB/s 2024-01-22T05:15:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.346 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.346 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281089 s, 37.3 MB/s 2024-01-22T05:15:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274852 s, 38.2 MB/s 2024-01-22T05:15:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217299 s, 48.3 MB/s 2024-01-22T05:15:19.431 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.431 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.432 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258318 s, 40.6 MB/s 2024-01-22T05:15:19.460 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.460 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.460 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243258 s, 43.1 MB/s 2024-01-22T05:15:19.496 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.496 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.496 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324575 s, 32.3 MB/s 2024-01-22T05:15:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245767 s, 42.7 MB/s 2024-01-22T05:15:19.551 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.552 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.552 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229342 s, 45.7 MB/s 2024-01-22T05:15:19.579 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.579 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.579 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250503 s, 41.9 MB/s 2024-01-22T05:15:19.609 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.610 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.610 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263454 s, 39.8 MB/s 2024-01-22T05:15:19.641 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.641 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.641 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274927 s, 38.1 MB/s 2024-01-22T05:15:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198387 s, 52.9 MB/s 2024-01-22T05:15:19.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.689 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230108 s, 45.6 MB/s 2024-01-22T05:15:19.718 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.718 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.718 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254544 s, 41.2 MB/s 2024-01-22T05:15:19.754 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.754 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.754 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334616 s, 31.3 MB/s 2024-01-22T05:15:19.787 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.787 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292419 s, 35.9 MB/s 2024-01-22T05:15:19.809 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.809 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.809 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177044 s, 59.2 MB/s 2024-01-22T05:15:19.842 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.842 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.842 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300748 s, 34.9 MB/s 2024-01-22T05:15:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028802 s, 36.4 MB/s 2024-01-22T05:15:19.904 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.904 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.904 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247527 s, 42.4 MB/s 2024-01-22T05:15:19.930 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.930 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.930 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235652 s, 44.5 MB/s 2024-01-22T05:15:19.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:19.933 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:19.933 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:19.933 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.13 2024-01-22T05:15:19.933 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:19.933 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:19.933 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:19.933 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:19.986 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:19.986 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:19.986 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02559 s, 41.0 MB/s 2024-01-22T05:15:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279706 s, 37.5 MB/s 2024-01-22T05:15:20.057 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.057 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.057 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338979 s, 30.9 MB/s 2024-01-22T05:15:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275702 s, 38.0 MB/s 2024-01-22T05:15:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.118 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251731 s, 41.7 MB/s 2024-01-22T05:15:20.161 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.161 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.161 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0399073 s, 26.3 MB/s 2024-01-22T05:15:20.190 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.190 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.190 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024863 s, 42.2 MB/s 2024-01-22T05:15:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.214 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220634 s, 47.5 MB/s 2024-01-22T05:15:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.249 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312811 s, 33.5 MB/s 2024-01-22T05:15:20.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.282 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293714 s, 35.7 MB/s 2024-01-22T05:15:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248738 s, 42.2 MB/s 2024-01-22T05:15:20.352 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.352 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.352 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0385716 s, 27.2 MB/s 2024-01-22T05:15:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324172 s, 32.3 MB/s 2024-01-22T05:15:20.419 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.419 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.419 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256525 s, 40.9 MB/s 2024-01-22T05:15:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022043 s, 47.6 MB/s 2024-01-22T05:15:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244577 s, 42.9 MB/s 2024-01-22T05:15:20.507 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.507 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.507 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299312 s, 35.0 MB/s 2024-01-22T05:15:20.540 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.540 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.540 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285342 s, 36.7 MB/s 2024-01-22T05:15:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319159 s, 32.9 MB/s 2024-01-22T05:15:20.601 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.601 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.601 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021913 s, 47.9 MB/s 2024-01-22T05:15:20.628 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.628 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.628 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241079 s, 43.5 MB/s 2024-01-22T05:15:20.663 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.663 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.663 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308148 s, 34.0 MB/s 2024-01-22T05:15:20.693 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.693 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.693 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258781 s, 40.5 MB/s 2024-01-22T05:15:20.718 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.718 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.718 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209934 s, 49.9 MB/s 2024-01-22T05:15:20.741 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.741 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.741 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206021 s, 50.9 MB/s 2024-01-22T05:15:20.765 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.765 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.765 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208494 s, 50.3 MB/s 2024-01-22T05:15:20.793 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.793 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.793 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248529 s, 42.2 MB/s 2024-01-22T05:15:20.818 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.819 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.819 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227073 s, 46.2 MB/s 2024-01-22T05:15:20.852 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.853 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.853 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297718 s, 35.2 MB/s 2024-01-22T05:15:20.885 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.885 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.885 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284973 s, 36.8 MB/s 2024-01-22T05:15:20.911 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.911 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.911 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225244 s, 46.6 MB/s 2024-01-22T05:15:20.938 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:20.938 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:20.938 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241601 s, 43.4 MB/s 2024-01-22T05:15:20.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:20.941 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:20.941 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:20.941 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.14 2024-01-22T05:15:20.941 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:20.941 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:20.941 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:20.941 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:21.001 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.001 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.001 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314113 s, 33.4 MB/s 2024-01-22T05:15:21.034 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.034 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.034 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291277 s, 36.0 MB/s 2024-01-22T05:15:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.067 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279154 s, 37.6 MB/s 2024-01-22T05:15:21.090 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.090 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.090 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211852 s, 49.5 MB/s 2024-01-22T05:15:21.110 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.110 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.110 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176959 s, 59.3 MB/s 2024-01-22T05:15:21.141 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.141 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.141 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257141 s, 40.8 MB/s 2024-01-22T05:15:21.170 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.170 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.170 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254977 s, 41.1 MB/s 2024-01-22T05:15:21.197 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.198 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234145 s, 44.8 MB/s 2024-01-22T05:15:21.217 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.217 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.217 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171538 s, 61.1 MB/s 2024-01-22T05:15:21.245 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.245 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.245 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240832 s, 43.5 MB/s 2024-01-22T05:15:21.269 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.269 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.269 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211614 s, 49.6 MB/s 2024-01-22T05:15:21.295 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.295 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.295 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022866 s, 45.9 MB/s 2024-01-22T05:15:21.323 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.323 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.323 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248068 s, 42.3 MB/s 2024-01-22T05:15:21.354 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.354 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.354 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270879 s, 38.7 MB/s 2024-01-22T05:15:21.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.380 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214805 s, 48.8 MB/s 2024-01-22T05:15:21.415 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.416 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.416 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313754 s, 33.4 MB/s 2024-01-22T05:15:21.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.445 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258058 s, 40.6 MB/s 2024-01-22T05:15:21.474 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.474 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.474 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254858 s, 41.1 MB/s 2024-01-22T05:15:21.507 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.507 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.507 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029249 s, 35.8 MB/s 2024-01-22T05:15:21.542 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.542 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.542 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307951 s, 34.1 MB/s 2024-01-22T05:15:21.572 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.572 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.572 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254681 s, 41.2 MB/s 2024-01-22T05:15:21.603 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.604 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.604 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275285 s, 38.1 MB/s 2024-01-22T05:15:21.631 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.632 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.632 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236337 s, 44.4 MB/s 2024-01-22T05:15:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.667 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.667 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309469 s, 33.9 MB/s 2024-01-22T05:15:21.691 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.691 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.691 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208393 s, 50.3 MB/s 2024-01-22T05:15:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307961 s, 34.0 MB/s 2024-01-22T05:15:21.762 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.762 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.762 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0331622 s, 31.6 MB/s 2024-01-22T05:15:21.800 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.800 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.800 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313619 s, 33.4 MB/s 2024-01-22T05:15:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031565 s, 33.2 MB/s 2024-01-22T05:15:21.861 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.861 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.861 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242962 s, 43.2 MB/s 2024-01-22T05:15:21.889 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.889 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.890 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244512 s, 42.9 MB/s 2024-01-22T05:15:21.920 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.920 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.920 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265042 s, 39.6 MB/s 2024-01-22T05:15:21.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:21.922 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:21.922 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:21.922 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.15 2024-01-22T05:15:21.922 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:21.922 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:21.922 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:21.922 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:21.981 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:21.981 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:21.981 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240485 s, 43.6 MB/s 2024-01-22T05:15:22.020 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.020 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.020 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.036256 s, 28.9 MB/s 2024-01-22T05:15:22.050 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.050 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.050 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252773 s, 41.5 MB/s 2024-01-22T05:15:22.075 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.075 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.075 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210317 s, 49.9 MB/s 2024-01-22T05:15:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269552 s, 38.9 MB/s 2024-01-22T05:15:22.146 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.146 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0365563 s, 28.7 MB/s 2024-01-22T05:15:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294839 s, 35.6 MB/s 2024-01-22T05:15:22.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.211 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272076 s, 38.5 MB/s 2024-01-22T05:15:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276172 s, 38.0 MB/s 2024-01-22T05:15:22.279 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.279 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.279 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322644 s, 32.5 MB/s 2024-01-22T05:15:22.307 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.307 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.307 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023215 s, 45.2 MB/s 2024-01-22T05:15:22.333 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.334 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.334 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231433 s, 45.3 MB/s 2024-01-22T05:15:22.362 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.363 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.363 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259498 s, 40.4 MB/s 2024-01-22T05:15:22.395 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.395 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.395 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282629 s, 37.1 MB/s 2024-01-22T05:15:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230616 s, 45.5 MB/s 2024-01-22T05:15:22.449 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.449 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.449 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236959 s, 44.3 MB/s 2024-01-22T05:15:22.478 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.478 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.478 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026309 s, 39.9 MB/s 2024-01-22T05:15:22.508 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.508 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.509 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265195 s, 39.5 MB/s 2024-01-22T05:15:22.534 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.534 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.534 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222833 s, 47.1 MB/s 2024-01-22T05:15:22.566 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.566 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.566 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283506 s, 37.0 MB/s 2024-01-22T05:15:22.597 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.597 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.598 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027047 s, 38.8 MB/s 2024-01-22T05:15:22.630 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.630 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.630 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286396 s, 36.6 MB/s 2024-01-22T05:15:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309468 s, 33.9 MB/s 2024-01-22T05:15:22.696 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.696 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.696 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255974 s, 41.0 MB/s 2024-01-22T05:15:22.729 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.729 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.729 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292685 s, 35.8 MB/s 2024-01-22T05:15:22.758 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.758 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.758 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249801 s, 42.0 MB/s 2024-01-22T05:15:22.790 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.790 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.790 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027142 s, 38.6 MB/s 2024-01-22T05:15:22.824 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.824 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.825 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309942 s, 33.8 MB/s 2024-01-22T05:15:22.863 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.863 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.863 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340194 s, 30.8 MB/s 2024-01-22T05:15:22.889 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.889 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.889 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227882 s, 46.0 MB/s 2024-01-22T05:15:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233936 s, 44.8 MB/s 2024-01-22T05:15:22.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:22.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:22.946 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275038 s, 38.1 MB/s 2024-01-22T05:15:22.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:22.948 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:22.948 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:22.948 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.16 2024-01-22T05:15:22.949 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:22.949 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:22.949 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:22.949 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:23.002 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.002 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.002 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242641 s, 43.2 MB/s 2024-01-22T05:15:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.034 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278649 s, 37.6 MB/s 2024-01-22T05:15:23.058 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.059 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.059 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217518 s, 48.2 MB/s 2024-01-22T05:15:23.092 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.092 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.092 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290499 s, 36.1 MB/s 2024-01-22T05:15:23.117 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.117 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.118 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219951 s, 47.7 MB/s 2024-01-22T05:15:23.147 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.147 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.147 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256923 s, 40.8 MB/s 2024-01-22T05:15:23.176 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.176 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.176 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261299 s, 40.1 MB/s 2024-01-22T05:15:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239945 s, 43.7 MB/s 2024-01-22T05:15:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210176 s, 49.9 MB/s 2024-01-22T05:15:23.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.267 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349472 s, 30.0 MB/s 2024-01-22T05:15:23.303 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.303 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.303 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330351 s, 31.7 MB/s 2024-01-22T05:15:23.333 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.334 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.334 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265944 s, 39.4 MB/s 2024-01-22T05:15:23.370 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.370 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.370 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328973 s, 31.9 MB/s 2024-01-22T05:15:23.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.402 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279359 s, 37.5 MB/s 2024-01-22T05:15:23.427 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.427 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.427 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204601 s, 51.2 MB/s 2024-01-22T05:15:23.461 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.461 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.461 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306886 s, 34.2 MB/s 2024-01-22T05:15:23.495 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.495 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.496 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306065 s, 34.3 MB/s 2024-01-22T05:15:23.523 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.523 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.523 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228539 s, 45.9 MB/s 2024-01-22T05:15:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.551 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245183 s, 42.8 MB/s 2024-01-22T05:15:23.576 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.576 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.576 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225215 s, 46.6 MB/s 2024-01-22T05:15:23.605 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.605 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.606 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268529 s, 39.0 MB/s 2024-01-22T05:15:23.638 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.638 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.638 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298653 s, 35.1 MB/s 2024-01-22T05:15:23.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.669 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261473 s, 40.1 MB/s 2024-01-22T05:15:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.698 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024365 s, 43.0 MB/s 2024-01-22T05:15:23.726 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.726 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.726 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247537 s, 42.4 MB/s 2024-01-22T05:15:23.751 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.751 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.751 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219088 s, 47.9 MB/s 2024-01-22T05:15:23.777 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.777 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.777 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221823 s, 47.3 MB/s 2024-01-22T05:15:23.804 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.804 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.804 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238698 s, 43.9 MB/s 2024-01-22T05:15:23.830 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.830 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.830 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233293 s, 44.9 MB/s 2024-01-22T05:15:23.859 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.859 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.859 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250585 s, 41.8 MB/s 2024-01-22T05:15:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247557 s, 42.4 MB/s 2024-01-22T05:15:23.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.914 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234915 s, 44.6 MB/s 2024-01-22T05:15:23.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:23.916 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:23.917 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:23.917 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.17 2024-01-22T05:15:23.917 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:23.917 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:23.917 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:23.917 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:23.970 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:23.970 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:23.970 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236309 s, 44.4 MB/s 2024-01-22T05:15:24.010 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.010 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.010 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348927 s, 30.1 MB/s 2024-01-22T05:15:24.044 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.044 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.045 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029916 s, 35.1 MB/s 2024-01-22T05:15:24.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.074 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255163 s, 41.1 MB/s 2024-01-22T05:15:24.105 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.105 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.105 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272848 s, 38.4 MB/s 2024-01-22T05:15:24.136 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.136 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.137 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273823 s, 38.3 MB/s 2024-01-22T05:15:24.165 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.165 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.165 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025214 s, 41.6 MB/s 2024-01-22T05:15:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275003 s, 38.1 MB/s 2024-01-22T05:15:24.229 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.229 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.229 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280729 s, 37.4 MB/s 2024-01-22T05:15:24.262 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.263 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.263 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301765 s, 34.7 MB/s 2024-01-22T05:15:24.291 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.291 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.291 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253932 s, 41.3 MB/s 2024-01-22T05:15:24.322 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.322 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.322 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272288 s, 38.5 MB/s 2024-01-22T05:15:24.360 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.360 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.360 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034885 s, 30.1 MB/s 2024-01-22T05:15:24.392 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.392 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.392 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272133 s, 38.5 MB/s 2024-01-22T05:15:24.420 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.420 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.420 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240521 s, 43.6 MB/s 2024-01-22T05:15:24.449 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.449 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.449 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266491 s, 39.3 MB/s 2024-01-22T05:15:24.477 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.478 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.478 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249983 s, 41.9 MB/s 2024-01-22T05:15:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250999 s, 41.8 MB/s 2024-01-22T05:15:24.543 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.543 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.543 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312817 s, 33.5 MB/s 2024-01-22T05:15:24.569 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.570 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.570 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231191 s, 45.4 MB/s 2024-01-22T05:15:24.602 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.602 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.602 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284076 s, 36.9 MB/s 2024-01-22T05:15:24.636 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.636 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.636 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288962 s, 36.3 MB/s 2024-01-22T05:15:24.665 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.665 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.665 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249668 s, 42.0 MB/s 2024-01-22T05:15:24.695 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.695 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.695 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260551 s, 40.2 MB/s 2024-01-22T05:15:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.720 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213165 s, 49.2 MB/s 2024-01-22T05:15:24.745 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.745 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.745 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224474 s, 46.7 MB/s 2024-01-22T05:15:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241777 s, 43.4 MB/s 2024-01-22T05:15:24.804 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.804 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.804 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262677 s, 39.9 MB/s 2024-01-22T05:15:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230431 s, 45.5 MB/s 2024-01-22T05:15:24.859 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.859 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.859 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243085 s, 43.1 MB/s 2024-01-22T05:15:24.890 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.890 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.890 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265893 s, 39.4 MB/s 2024-01-22T05:15:24.920 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.920 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.920 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261792 s, 40.1 MB/s 2024-01-22T05:15:24.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:24.922 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:24.923 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:24.923 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.18 2024-01-22T05:15:24.923 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:24.923 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:24.923 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:24.923 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252078 s, 41.6 MB/s 2024-01-22T05:15:25.015 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.015 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.015 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296151 s, 35.4 MB/s 2024-01-22T05:15:25.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.043 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242183 s, 43.3 MB/s 2024-01-22T05:15:25.075 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.075 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.075 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272 s, 38.6 MB/s 2024-01-22T05:15:25.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.104 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248157 s, 42.3 MB/s 2024-01-22T05:15:25.132 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.132 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.132 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247661 s, 42.3 MB/s 2024-01-22T05:15:25.163 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.163 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.163 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262978 s, 39.9 MB/s 2024-01-22T05:15:25.192 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.192 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.192 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255297 s, 41.1 MB/s 2024-01-22T05:15:25.221 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.221 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.221 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252046 s, 41.6 MB/s 2024-01-22T05:15:25.251 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.252 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.252 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266459 s, 39.4 MB/s 2024-01-22T05:15:25.281 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.282 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261594 s, 40.1 MB/s 2024-01-22T05:15:25.314 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.314 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.315 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288339 s, 36.4 MB/s 2024-01-22T05:15:25.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.351 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315988 s, 33.2 MB/s 2024-01-22T05:15:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309161 s, 33.9 MB/s 2024-01-22T05:15:25.415 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.415 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.416 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025773 s, 40.7 MB/s 2024-01-22T05:15:25.450 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.450 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.450 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308137 s, 34.0 MB/s 2024-01-22T05:15:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243068 s, 43.1 MB/s 2024-01-22T05:15:25.505 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.506 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.506 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244391 s, 42.9 MB/s 2024-01-22T05:15:25.528 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.528 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.529 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204436 s, 51.3 MB/s 2024-01-22T05:15:25.557 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.558 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256479 s, 40.9 MB/s 2024-01-22T05:15:25.586 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.586 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.587 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243724 s, 43.0 MB/s 2024-01-22T05:15:25.621 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.622 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.622 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303193 s, 34.6 MB/s 2024-01-22T05:15:25.647 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.647 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.647 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225009 s, 46.6 MB/s 2024-01-22T05:15:25.679 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.679 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.679 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279479 s, 37.5 MB/s 2024-01-22T05:15:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224912 s, 46.6 MB/s 2024-01-22T05:15:25.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.736 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.736 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255202 s, 41.1 MB/s 2024-01-22T05:15:25.772 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.772 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.772 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031983 s, 32.8 MB/s 2024-01-22T05:15:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281233 s, 37.3 MB/s 2024-01-22T05:15:25.838 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.838 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.838 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292937 s, 35.8 MB/s 2024-01-22T05:15:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.872 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293912 s, 35.7 MB/s 2024-01-22T05:15:25.899 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242283 s, 43.3 MB/s 2024-01-22T05:15:25.928 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.928 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.928 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238129 s, 44.0 MB/s 2024-01-22T05:15:25.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:25.930 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:25.930 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:25.930 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.19 2024-01-22T05:15:25.930 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:25.931 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:25.931 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:25.931 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296624 s, 35.4 MB/s 2024-01-22T05:15:26.022 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278061 s, 37.7 MB/s 2024-01-22T05:15:26.057 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.058 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.058 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323537 s, 32.4 MB/s 2024-01-22T05:15:26.091 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303433 s, 34.6 MB/s 2024-01-22T05:15:26.120 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.120 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.121 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024356 s, 43.1 MB/s 2024-01-22T05:15:26.149 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.149 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.150 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248726 s, 42.2 MB/s 2024-01-22T05:15:26.176 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.176 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.176 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239928 s, 43.7 MB/s 2024-01-22T05:15:26.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.203 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.203 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233889 s, 44.8 MB/s 2024-01-22T05:15:26.235 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.235 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.236 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301437 s, 34.8 MB/s 2024-01-22T05:15:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028558 s, 36.7 MB/s 2024-01-22T05:15:26.301 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.302 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.302 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301055 s, 34.8 MB/s 2024-01-22T05:15:26.324 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.324 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.325 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200514 s, 52.3 MB/s 2024-01-22T05:15:26.356 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.356 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.356 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277968 s, 37.7 MB/s 2024-01-22T05:15:26.387 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.387 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.388 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278676 s, 37.6 MB/s 2024-01-22T05:15:26.420 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.420 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.420 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287452 s, 36.5 MB/s 2024-01-22T05:15:26.454 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.454 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.455 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299265 s, 35.0 MB/s 2024-01-22T05:15:26.480 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.480 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.480 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229676 s, 45.7 MB/s 2024-01-22T05:15:26.513 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.514 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.514 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300746 s, 34.9 MB/s 2024-01-22T05:15:26.549 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.549 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.549 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314931 s, 33.3 MB/s 2024-01-22T05:15:26.583 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.583 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.583 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293639 s, 35.7 MB/s 2024-01-22T05:15:26.610 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.610 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.610 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239825 s, 43.7 MB/s 2024-01-22T05:15:26.642 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283945 s, 36.9 MB/s 2024-01-22T05:15:26.668 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.668 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.668 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021252 s, 49.3 MB/s 2024-01-22T05:15:26.698 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.698 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.698 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256452 s, 40.9 MB/s 2024-01-22T05:15:26.727 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.727 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.727 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240476 s, 43.6 MB/s 2024-01-22T05:15:26.759 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.760 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.760 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027641 s, 37.9 MB/s 2024-01-22T05:15:26.796 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.796 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.796 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334414 s, 31.4 MB/s 2024-01-22T05:15:26.821 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.821 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.821 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205068 s, 51.1 MB/s 2024-01-22T05:15:26.847 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.848 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.848 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225716 s, 46.5 MB/s 2024-01-22T05:15:26.877 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.877 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.877 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248467 s, 42.2 MB/s 2024-01-22T05:15:26.903 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.903 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.903 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021293 s, 49.2 MB/s 2024-01-22T05:15:26.929 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.929 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.929 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022224 s, 47.2 MB/s 2024-01-22T05:15:26.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:26.931 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:26.931 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:26.931 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.20 2024-01-22T05:15:26.931 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:26.931 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:26.931 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:26.932 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:26.998 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:26.998 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:26.998 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0346601 s, 30.3 MB/s 2024-01-22T05:15:27.029 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.029 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.029 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268362 s, 39.1 MB/s 2024-01-22T05:15:27.056 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.057 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.057 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023503 s, 44.6 MB/s 2024-01-22T05:15:27.083 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.083 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.083 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229825 s, 45.6 MB/s 2024-01-22T05:15:27.122 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.122 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.122 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345104 s, 30.4 MB/s 2024-01-22T05:15:27.148 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.148 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.148 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217771 s, 48.2 MB/s 2024-01-22T05:15:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333356 s, 31.5 MB/s 2024-01-22T05:15:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195099 s, 53.7 MB/s 2024-01-22T05:15:27.241 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.241 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.241 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290802 s, 36.1 MB/s 2024-01-22T05:15:27.269 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.269 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.270 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242132 s, 43.3 MB/s 2024-01-22T05:15:27.300 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.301 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.301 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270461 s, 38.8 MB/s 2024-01-22T05:15:27.332 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.333 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.333 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281784 s, 37.2 MB/s 2024-01-22T05:15:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222022 s, 47.2 MB/s 2024-01-22T05:15:27.389 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.389 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.389 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278889 s, 37.6 MB/s 2024-01-22T05:15:27.419 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.419 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.419 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273676 s, 38.3 MB/s 2024-01-22T05:15:27.444 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.444 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.444 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217215 s, 48.3 MB/s 2024-01-22T05:15:27.471 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:27.471 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:27.471 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232515 s, 45.1 MB/s 2024-01-22T05:15:28.366 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.366 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.366 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.891241 s, 1.2 MB/s 2024-01-22T05:15:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.392 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024026 s, 43.6 MB/s 2024-01-22T05:15:28.424 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.424 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.424 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285574 s, 36.7 MB/s 2024-01-22T05:15:28.464 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.464 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.464 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0372018 s, 28.2 MB/s 2024-01-22T05:15:28.492 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.492 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.492 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252823 s, 41.5 MB/s 2024-01-22T05:15:28.518 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.518 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.518 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222408 s, 47.1 MB/s 2024-01-22T05:15:28.551 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.551 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.551 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291726 s, 35.9 MB/s 2024-01-22T05:15:28.591 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.591 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.591 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0358149 s, 29.3 MB/s 2024-01-22T05:15:28.614 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.615 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.615 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205278 s, 51.1 MB/s 2024-01-22T05:15:28.645 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.645 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.645 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282077 s, 37.2 MB/s 2024-01-22T05:15:28.672 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.672 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.672 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224387 s, 46.7 MB/s 2024-01-22T05:15:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256445 s, 40.9 MB/s 2024-01-22T05:15:28.736 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.737 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.737 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030081 s, 34.9 MB/s 2024-01-22T05:15:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237165 s, 44.2 MB/s 2024-01-22T05:15:28.793 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.793 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.793 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251886 s, 41.6 MB/s 2024-01-22T05:15:28.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:28.796 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:28.796 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:28.796 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.21 2024-01-22T05:15:28.796 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:28.797 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:28.797 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:28.797 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:28.866 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.867 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.867 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0368208 s, 28.5 MB/s 2024-01-22T05:15:28.896 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.896 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.896 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254942 s, 41.1 MB/s 2024-01-22T05:15:28.922 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.923 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.923 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223242 s, 47.0 MB/s 2024-01-22T05:15:28.952 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.952 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.952 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260041 s, 40.3 MB/s 2024-01-22T05:15:28.987 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:28.987 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:28.987 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315067 s, 33.3 MB/s 2024-01-22T05:15:29.014 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.014 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.014 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234336 s, 44.7 MB/s 2024-01-22T05:15:29.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.043 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249579 s, 42.0 MB/s 2024-01-22T05:15:29.072 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.072 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.072 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239231 s, 43.8 MB/s 2024-01-22T05:15:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272713 s, 38.4 MB/s 2024-01-22T05:15:29.129 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.129 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.130 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213609 s, 49.1 MB/s 2024-01-22T05:15:29.157 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.157 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.157 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236995 s, 44.2 MB/s 2024-01-22T05:15:29.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.185 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243312 s, 43.1 MB/s 2024-01-22T05:15:29.216 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.216 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.216 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263257 s, 39.8 MB/s 2024-01-22T05:15:29.247 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.248 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.248 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263582 s, 39.8 MB/s 2024-01-22T05:15:29.289 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.289 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.289 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0383597 s, 27.3 MB/s 2024-01-22T05:15:29.321 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.321 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.322 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275676 s, 38.0 MB/s 2024-01-22T05:15:29.349 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.349 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.349 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248468 s, 42.2 MB/s 2024-01-22T05:15:29.387 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.387 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.387 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341954 s, 30.7 MB/s 2024-01-22T05:15:29.416 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.416 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.416 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261876 s, 40.0 MB/s 2024-01-22T05:15:29.451 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.452 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318244 s, 32.9 MB/s 2024-01-22T05:15:29.486 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.486 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.487 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305452 s, 34.3 MB/s 2024-01-22T05:15:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.514 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239464 s, 43.8 MB/s 2024-01-22T05:15:29.547 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.547 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.547 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029662 s, 35.4 MB/s 2024-01-22T05:15:29.583 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.583 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.584 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324891 s, 32.3 MB/s 2024-01-22T05:15:29.617 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.617 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.618 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301104 s, 34.8 MB/s 2024-01-22T05:15:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255094 s, 41.1 MB/s 2024-01-22T05:15:29.673 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.673 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.674 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233344 s, 44.9 MB/s 2024-01-22T05:15:29.713 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.714 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0364579 s, 28.8 MB/s 2024-01-22T05:15:29.739 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.740 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.740 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225379 s, 46.5 MB/s 2024-01-22T05:15:29.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.781 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.781 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0382772 s, 27.4 MB/s 2024-01-22T05:15:29.815 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.815 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.815 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301059 s, 34.8 MB/s 2024-01-22T05:15:29.843 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.843 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.843 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236364 s, 44.4 MB/s 2024-01-22T05:15:29.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:29.845 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:29.845 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:29.845 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.22 2024-01-22T05:15:29.845 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:29.845 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:29.845 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:29.845 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:29.907 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.907 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.907 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322166 s, 32.5 MB/s 2024-01-22T05:15:29.937 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.937 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.937 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258946 s, 40.5 MB/s 2024-01-22T05:15:29.967 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:29.967 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:29.967 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256227 s, 40.9 MB/s 2024-01-22T05:15:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314884 s, 33.3 MB/s 2024-01-22T05:15:30.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.043 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0355363 s, 29.5 MB/s 2024-01-22T05:15:30.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.073 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266977 s, 39.3 MB/s 2024-01-22T05:15:30.109 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.110 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.110 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325241 s, 32.2 MB/s 2024-01-22T05:15:30.137 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.137 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.137 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023485 s, 44.6 MB/s 2024-01-22T05:15:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292615 s, 35.8 MB/s 2024-01-22T05:15:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234138 s, 44.8 MB/s 2024-01-22T05:15:30.226 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.226 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.227 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259949 s, 40.3 MB/s 2024-01-22T05:15:30.258 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.258 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.258 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269432 s, 38.9 MB/s 2024-01-22T05:15:30.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.282 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201644 s, 52.0 MB/s 2024-01-22T05:15:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318296 s, 32.9 MB/s 2024-01-22T05:15:30.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.347 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248972 s, 42.1 MB/s 2024-01-22T05:15:30.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.379 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275683 s, 38.0 MB/s 2024-01-22T05:15:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023926 s, 43.8 MB/s 2024-01-22T05:15:30.432 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.432 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.432 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229753 s, 45.6 MB/s 2024-01-22T05:15:30.461 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.461 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.461 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245532 s, 42.7 MB/s 2024-01-22T05:15:30.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.490 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.490 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248407 s, 42.2 MB/s 2024-01-22T05:15:30.520 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.521 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.521 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273647 s, 38.3 MB/s 2024-01-22T05:15:30.549 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.549 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.549 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253534 s, 41.4 MB/s 2024-01-22T05:15:30.576 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.576 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.576 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226373 s, 46.3 MB/s 2024-01-22T05:15:30.610 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.610 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.610 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301892 s, 34.7 MB/s 2024-01-22T05:15:30.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.643 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275599 s, 38.0 MB/s 2024-01-22T05:15:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271397 s, 38.6 MB/s 2024-01-22T05:15:30.712 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.712 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.712 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334379 s, 31.4 MB/s 2024-01-22T05:15:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228548 s, 45.9 MB/s 2024-01-22T05:15:30.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.773 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028983 s, 36.2 MB/s 2024-01-22T05:15:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254373 s, 41.2 MB/s 2024-01-22T05:15:30.831 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.831 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.831 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240919 s, 43.5 MB/s 2024-01-22T05:15:30.864 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.864 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.864 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287595 s, 36.5 MB/s 2024-01-22T05:15:30.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:30.866 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:30.866 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:30.866 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.23 2024-01-22T05:15:30.866 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:30.866 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:30.866 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:30.867 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247969 s, 42.3 MB/s 2024-01-22T05:15:30.952 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.953 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.953 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247311 s, 42.4 MB/s 2024-01-22T05:15:30.985 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:30.985 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:30.985 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278304 s, 37.7 MB/s 2024-01-22T05:15:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024844 s, 42.2 MB/s 2024-01-22T05:15:31.047 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.047 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.047 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292413 s, 35.9 MB/s 2024-01-22T05:15:31.076 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.076 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.076 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255168 s, 41.1 MB/s 2024-01-22T05:15:31.103 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.103 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.103 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241008 s, 43.5 MB/s 2024-01-22T05:15:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.131 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236985 s, 44.2 MB/s 2024-01-22T05:15:31.156 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.156 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.156 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218365 s, 48.0 MB/s 2024-01-22T05:15:31.193 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.194 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.194 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336013 s, 31.2 MB/s 2024-01-22T05:15:31.224 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.224 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.224 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269755 s, 38.9 MB/s 2024-01-22T05:15:31.256 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.256 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.256 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282486 s, 37.1 MB/s 2024-01-22T05:15:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0378721 s, 27.7 MB/s 2024-01-22T05:15:31.339 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.339 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.339 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0369558 s, 28.4 MB/s 2024-01-22T05:15:31.372 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.372 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.372 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296395 s, 35.4 MB/s 2024-01-22T05:15:31.400 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.400 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.400 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243886 s, 43.0 MB/s 2024-01-22T05:15:31.427 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.427 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.427 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240929 s, 43.5 MB/s 2024-01-22T05:15:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230168 s, 45.6 MB/s 2024-01-22T05:15:31.484 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.484 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.484 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273209 s, 38.4 MB/s 2024-01-22T05:15:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249014 s, 42.1 MB/s 2024-01-22T05:15:31.550 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.550 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.550 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0339174 s, 30.9 MB/s 2024-01-22T05:15:31.576 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.576 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.576 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223071 s, 47.0 MB/s 2024-01-22T05:15:31.606 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.606 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.606 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251475 s, 41.7 MB/s 2024-01-22T05:15:31.635 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.636 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.636 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252216 s, 41.6 MB/s 2024-01-22T05:15:31.664 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.664 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.664 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246356 s, 42.6 MB/s 2024-01-22T05:15:31.696 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.696 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.697 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291371 s, 36.0 MB/s 2024-01-22T05:15:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223447 s, 46.9 MB/s 2024-01-22T05:15:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.752 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.752 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250157 s, 41.9 MB/s 2024-01-22T05:15:31.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.780 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243515 s, 43.1 MB/s 2024-01-22T05:15:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.810 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254026 s, 41.3 MB/s 2024-01-22T05:15:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219542 s, 47.8 MB/s 2024-01-22T05:15:31.873 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.873 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.873 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338646 s, 31.0 MB/s 2024-01-22T05:15:31.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:31.876 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:31.876 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:31.876 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.24 2024-01-22T05:15:31.876 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:31.876 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:31.876 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:31.876 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:31.935 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.935 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.935 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239155 s, 43.8 MB/s 2024-01-22T05:15:31.973 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:31.974 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:31.974 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.035587 s, 29.5 MB/s 2024-01-22T05:15:32.010 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.010 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.010 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333975 s, 31.4 MB/s 2024-01-22T05:15:32.041 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.041 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.041 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269034 s, 39.0 MB/s 2024-01-22T05:15:32.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.074 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289779 s, 36.2 MB/s 2024-01-22T05:15:32.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.105 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267891 s, 39.1 MB/s 2024-01-22T05:15:32.132 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.133 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.133 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243179 s, 43.1 MB/s 2024-01-22T05:15:32.162 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.162 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.162 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261325 s, 40.1 MB/s 2024-01-22T05:15:32.191 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.192 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.192 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252701 s, 41.5 MB/s 2024-01-22T05:15:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.222 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.223 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266472 s, 39.4 MB/s 2024-01-22T05:15:32.253 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.253 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.253 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268302 s, 39.1 MB/s 2024-01-22T05:15:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285347 s, 36.7 MB/s 2024-01-22T05:15:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275796 s, 38.0 MB/s 2024-01-22T05:15:32.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272734 s, 38.4 MB/s 2024-01-22T05:15:32.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.380 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278855 s, 37.6 MB/s 2024-01-22T05:15:32.407 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.407 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.407 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236155 s, 44.4 MB/s 2024-01-22T05:15:32.436 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.436 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.437 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250243 s, 41.9 MB/s 2024-01-22T05:15:32.465 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.465 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.465 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248645 s, 42.2 MB/s 2024-01-22T05:15:32.499 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.499 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.499 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299484 s, 35.0 MB/s 2024-01-22T05:15:32.534 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.534 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.535 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309734 s, 33.9 MB/s 2024-01-22T05:15:32.564 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.564 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.564 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250163 s, 41.9 MB/s 2024-01-22T05:15:32.591 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.591 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.591 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232563 s, 45.1 MB/s 2024-01-22T05:15:32.627 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.627 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.627 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323704 s, 32.4 MB/s 2024-01-22T05:15:32.661 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.661 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.661 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297937 s, 35.2 MB/s 2024-01-22T05:15:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246181 s, 42.6 MB/s 2024-01-22T05:15:32.721 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.721 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.721 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027012 s, 38.8 MB/s 2024-01-22T05:15:32.748 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228202 s, 45.9 MB/s 2024-01-22T05:15:32.781 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.781 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.781 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280325 s, 37.4 MB/s 2024-01-22T05:15:32.820 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.820 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.820 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345021 s, 30.4 MB/s 2024-01-22T05:15:32.851 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.851 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.851 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261356 s, 40.1 MB/s 2024-01-22T05:15:32.877 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.877 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.877 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233918 s, 44.8 MB/s 2024-01-22T05:15:32.900 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.900 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.900 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198626 s, 52.8 MB/s 2024-01-22T05:15:32.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:32.902 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:32.902 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:32.902 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.25 2024-01-22T05:15:32.903 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:32.903 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:32.903 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:32.903 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:32.959 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.959 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.959 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279926 s, 37.5 MB/s 2024-01-22T05:15:32.989 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:32.989 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:32.990 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265969 s, 39.4 MB/s 2024-01-22T05:15:33.015 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.016 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.016 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219111 s, 47.9 MB/s 2024-01-22T05:15:33.054 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.054 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.054 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338734 s, 31.0 MB/s 2024-01-22T05:15:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.084 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252793 s, 41.5 MB/s 2024-01-22T05:15:33.114 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.114 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.114 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260977 s, 40.2 MB/s 2024-01-22T05:15:33.139 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.139 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.140 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228563 s, 45.9 MB/s 2024-01-22T05:15:33.167 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.167 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.168 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242251 s, 43.3 MB/s 2024-01-22T05:15:33.194 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.194 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.194 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223303 s, 47.0 MB/s 2024-01-22T05:15:33.227 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.227 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.227 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030507 s, 34.4 MB/s 2024-01-22T05:15:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250396 s, 41.9 MB/s 2024-01-22T05:15:33.295 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.295 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.295 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344502 s, 30.4 MB/s 2024-01-22T05:15:33.325 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.325 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.325 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254882 s, 41.1 MB/s 2024-01-22T05:15:33.362 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.362 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.362 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325836 s, 32.2 MB/s 2024-01-22T05:15:33.396 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.397 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.397 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301557 s, 34.8 MB/s 2024-01-22T05:15:33.428 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.428 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.428 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276549 s, 37.9 MB/s 2024-01-22T05:15:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348306 s, 30.1 MB/s 2024-01-22T05:15:33.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.489 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194922 s, 53.8 MB/s 2024-01-22T05:15:33.512 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.512 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.513 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206124 s, 50.9 MB/s 2024-01-22T05:15:33.547 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.547 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.547 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314672 s, 33.3 MB/s 2024-01-22T05:15:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218122 s, 48.1 MB/s 2024-01-22T05:15:33.593 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.593 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.593 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01788 s, 58.6 MB/s 2024-01-22T05:15:33.622 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.622 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.622 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260091 s, 40.3 MB/s 2024-01-22T05:15:33.650 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.650 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.650 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255611 s, 41.0 MB/s 2024-01-22T05:15:33.677 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.677 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.677 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232203 s, 45.2 MB/s 2024-01-22T05:15:33.707 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.707 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.707 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263124 s, 39.9 MB/s 2024-01-22T05:15:33.731 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.731 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.731 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211461 s, 49.6 MB/s 2024-01-22T05:15:33.762 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.762 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.762 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260368 s, 40.3 MB/s 2024-01-22T05:15:33.792 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.792 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.793 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265005 s, 39.6 MB/s 2024-01-22T05:15:33.830 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.830 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.831 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034007 s, 30.8 MB/s 2024-01-22T05:15:33.859 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.859 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.859 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024235 s, 43.3 MB/s 2024-01-22T05:15:33.885 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.885 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.885 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022615 s, 46.4 MB/s 2024-01-22T05:15:33.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:33.888 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:33.888 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:33.888 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.26 2024-01-22T05:15:33.888 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:33.888 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:33.888 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:33.888 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:33.941 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.941 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.941 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228588 s, 45.9 MB/s 2024-01-22T05:15:33.967 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.967 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.967 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224322 s, 46.7 MB/s 2024-01-22T05:15:33.992 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:33.992 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:33.992 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223297 s, 47.0 MB/s 2024-01-22T05:15:34.021 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.021 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.021 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246762 s, 42.5 MB/s 2024-01-22T05:15:34.059 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.060 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034825 s, 30.1 MB/s 2024-01-22T05:15:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0395195 s, 26.5 MB/s 2024-01-22T05:15:34.133 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.133 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.133 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257805 s, 40.7 MB/s 2024-01-22T05:15:34.170 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.170 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.171 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0343192 s, 30.6 MB/s 2024-01-22T05:15:34.206 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.206 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.207 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320632 s, 32.7 MB/s 2024-01-22T05:15:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327511 s, 32.0 MB/s 2024-01-22T05:15:34.268 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.268 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.268 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217537 s, 48.2 MB/s 2024-01-22T05:15:34.296 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.296 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.296 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234026 s, 44.8 MB/s 2024-01-22T05:15:34.330 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.330 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.330 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314999 s, 33.3 MB/s 2024-01-22T05:15:34.370 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.370 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.370 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349373 s, 30.0 MB/s 2024-01-22T05:15:34.400 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.400 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.400 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258691 s, 40.5 MB/s 2024-01-22T05:15:34.439 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.439 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.439 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03474 s, 30.2 MB/s 2024-01-22T05:15:34.471 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.471 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.471 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285839 s, 36.7 MB/s 2024-01-22T05:15:34.500 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.501 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.501 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260851 s, 40.2 MB/s 2024-01-22T05:15:34.529 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.529 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.529 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247758 s, 42.3 MB/s 2024-01-22T05:15:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248554 s, 42.2 MB/s 2024-01-22T05:15:34.589 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:34.589 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:34.590 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273268 s, 38.4 MB/s 2024-01-22T05:15:34.628 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.182 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.182 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0351296 s, 29.8 MB/s 2024-01-22T05:15:35.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.184 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247783 s, 42.3 MB/s 2024-01-22T05:15:35.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.184 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225823 s, 46.4 MB/s 2024-01-22T05:15:35.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218714 s, 47.9 MB/s 2024-01-22T05:15:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188499 s, 55.6 MB/s 2024-01-22T05:15:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216936 s, 48.3 MB/s 2024-01-22T05:15:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244879 s, 42.8 MB/s 2024-01-22T05:15:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02883 s, 36.4 MB/s 2024-01-22T05:15:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208822 s, 50.2 MB/s 2024-01-22T05:15:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235316 s, 44.6 MB/s 2024-01-22T05:15:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266101 s, 39.4 MB/s 2024-01-22T05:15:35.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:35.186 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:35.186 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:35.187 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.27 2024-01-22T05:15:35.187 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:35.187 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:35.187 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:35.187 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:35.251 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.251 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.252 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301136 s, 34.8 MB/s 2024-01-22T05:15:35.292 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.293 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.293 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0362685 s, 28.9 MB/s 2024-01-22T05:15:35.322 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.322 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.322 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250894 s, 41.8 MB/s 2024-01-22T05:15:35.345 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.346 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.346 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206678 s, 50.7 MB/s 2024-01-22T05:15:35.374 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.374 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.374 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025604 s, 41.0 MB/s 2024-01-22T05:15:35.407 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.407 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.407 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295065 s, 35.5 MB/s 2024-01-22T05:15:35.448 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.448 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.448 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0360583 s, 29.1 MB/s 2024-01-22T05:15:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.478 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261715 s, 40.1 MB/s 2024-01-22T05:15:35.503 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.503 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.503 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206071 s, 50.9 MB/s 2024-01-22T05:15:35.534 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.534 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.534 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274814 s, 38.2 MB/s 2024-01-22T05:15:35.563 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.563 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.563 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246207 s, 42.6 MB/s 2024-01-22T05:15:35.592 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.593 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.593 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260133 s, 40.3 MB/s 2024-01-22T05:15:35.621 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.621 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.621 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024949 s, 42.0 MB/s 2024-01-22T05:15:35.650 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.650 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.651 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253005 s, 41.4 MB/s 2024-01-22T05:15:35.685 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.685 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.685 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309264 s, 33.9 MB/s 2024-01-22T05:15:35.720 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.720 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.720 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303391 s, 34.6 MB/s 2024-01-22T05:15:35.746 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.746 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.746 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229932 s, 45.6 MB/s 2024-01-22T05:15:35.776 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.777 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.777 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277761 s, 37.8 MB/s 2024-01-22T05:15:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341701 s, 30.7 MB/s 2024-01-22T05:15:35.841 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.841 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.841 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023 s, 45.6 MB/s 2024-01-22T05:15:35.874 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.874 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.874 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288835 s, 36.3 MB/s 2024-01-22T05:15:35.912 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.913 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.913 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342354 s, 30.6 MB/s 2024-01-22T05:15:35.941 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.941 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.941 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240568 s, 43.6 MB/s 2024-01-22T05:15:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:35.980 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.035424 s, 29.6 MB/s 2024-01-22T05:15:36.010 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.010 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.011 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271672 s, 38.6 MB/s 2024-01-22T05:15:36.035 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.035 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.035 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208521 s, 50.3 MB/s 2024-01-22T05:15:36.062 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.062 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.062 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222126 s, 47.2 MB/s 2024-01-22T05:15:36.086 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.086 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.086 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211934 s, 49.5 MB/s 2024-01-22T05:15:36.120 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.121 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312131 s, 33.6 MB/s 2024-01-22T05:15:36.148 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.148 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.148 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023027 s, 45.5 MB/s 2024-01-22T05:15:36.175 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.176 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.176 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232591 s, 45.1 MB/s 2024-01-22T05:15:36.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.211 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316168 s, 33.2 MB/s 2024-01-22T05:15:36.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:36.215 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:36.215 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:36.215 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.28 2024-01-22T05:15:36.215 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:36.215 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:36.215 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:36.215 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:36.268 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.268 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.269 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220197 s, 47.6 MB/s 2024-01-22T05:15:36.298 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.298 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.299 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258556 s, 40.6 MB/s 2024-01-22T05:15:36.331 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.331 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.331 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277604 s, 37.8 MB/s 2024-01-22T05:15:36.365 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.365 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.366 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304424 s, 34.4 MB/s 2024-01-22T05:15:36.389 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.390 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.390 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210925 s, 49.7 MB/s 2024-01-22T05:15:36.422 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.422 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.422 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294788 s, 35.6 MB/s 2024-01-22T05:15:36.459 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.459 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.459 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329044 s, 31.9 MB/s 2024-01-22T05:15:36.487 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.487 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.487 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225561 s, 46.5 MB/s 2024-01-22T05:15:36.510 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.510 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.510 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212181 s, 49.4 MB/s 2024-01-22T05:15:36.537 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.537 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.537 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236382 s, 44.4 MB/s 2024-01-22T05:15:36.565 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.565 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.565 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243064 s, 43.1 MB/s 2024-01-22T05:15:36.592 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.592 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.592 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241341 s, 43.4 MB/s 2024-01-22T05:15:36.630 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.631 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.631 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0358465 s, 29.3 MB/s 2024-01-22T05:15:36.657 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.657 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.657 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228809 s, 45.8 MB/s 2024-01-22T05:15:36.678 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.678 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.678 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180912 s, 58.0 MB/s 2024-01-22T05:15:36.703 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.703 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.703 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217932 s, 48.1 MB/s 2024-01-22T05:15:36.732 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.733 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.733 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270956 s, 38.7 MB/s 2024-01-22T05:15:36.754 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.754 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.754 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018472 s, 56.8 MB/s 2024-01-22T05:15:36.796 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.796 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.796 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0380386 s, 27.6 MB/s 2024-01-22T05:15:36.823 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.823 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.823 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233604 s, 44.9 MB/s 2024-01-22T05:15:36.850 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.850 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.850 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239511 s, 43.8 MB/s 2024-01-22T05:15:36.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.887 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329036 s, 31.9 MB/s 2024-01-22T05:15:36.915 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.915 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.915 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235558 s, 44.5 MB/s 2024-01-22T05:15:36.948 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.948 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.948 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288592 s, 36.3 MB/s 2024-01-22T05:15:36.985 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:36.986 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:36.986 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341164 s, 30.7 MB/s 2024-01-22T05:15:37.015 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.015 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.015 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254705 s, 41.2 MB/s 2024-01-22T05:15:37.046 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.046 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.046 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264417 s, 39.7 MB/s 2024-01-22T05:15:37.078 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.078 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.078 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278481 s, 37.7 MB/s 2024-01-22T05:15:37.114 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.114 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.114 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316233 s, 33.2 MB/s 2024-01-22T05:15:37.145 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.145 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.146 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278868 s, 37.6 MB/s 2024-01-22T05:15:37.180 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.180 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.180 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304428 s, 34.4 MB/s 2024-01-22T05:15:37.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.211 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260733 s, 40.2 MB/s 2024-01-22T05:15:37.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:37.214 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:37.214 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:37.214 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.29 2024-01-22T05:15:37.214 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:37.214 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:37.214 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:37.214 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:37.279 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.279 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.279 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319591 s, 32.8 MB/s 2024-01-22T05:15:37.309 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.309 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.309 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271879 s, 38.6 MB/s 2024-01-22T05:15:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0372827 s, 28.1 MB/s 2024-01-22T05:15:37.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.379 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245286 s, 42.7 MB/s 2024-01-22T05:15:37.408 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.408 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.408 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255438 s, 41.1 MB/s 2024-01-22T05:15:37.438 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.438 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.438 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263385 s, 39.8 MB/s 2024-01-22T05:15:37.464 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.464 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.464 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222151 s, 47.2 MB/s 2024-01-22T05:15:37.494 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.494 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.494 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267272 s, 39.2 MB/s 2024-01-22T05:15:37.520 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.520 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.520 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233025 s, 45.0 MB/s 2024-01-22T05:15:37.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.558 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340764 s, 30.8 MB/s 2024-01-22T05:15:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.588 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249697 s, 42.0 MB/s 2024-01-22T05:15:37.613 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.613 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.613 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215258 s, 48.7 MB/s 2024-01-22T05:15:37.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.643 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027201 s, 38.5 MB/s 2024-01-22T05:15:37.679 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.680 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.680 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322789 s, 32.5 MB/s 2024-01-22T05:15:37.723 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.724 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.724 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0395425 s, 26.5 MB/s 2024-01-22T05:15:37.751 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.751 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.751 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222267 s, 47.2 MB/s 2024-01-22T05:15:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244054 s, 43.0 MB/s 2024-01-22T05:15:37.806 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.807 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.807 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235566 s, 44.5 MB/s 2024-01-22T05:15:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.838 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.838 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268718 s, 39.0 MB/s 2024-01-22T05:15:37.869 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.869 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.869 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027282 s, 38.4 MB/s 2024-01-22T05:15:37.895 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.895 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.895 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229019 s, 45.8 MB/s 2024-01-22T05:15:37.923 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.923 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.923 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238364 s, 44.0 MB/s 2024-01-22T05:15:37.950 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.950 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.950 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227403 s, 46.1 MB/s 2024-01-22T05:15:37.984 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:37.984 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:37.984 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300023 s, 34.9 MB/s 2024-01-22T05:15:38.013 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.013 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.013 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242906 s, 43.2 MB/s 2024-01-22T05:15:38.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.043 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262759 s, 39.9 MB/s 2024-01-22T05:15:38.077 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.077 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.077 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299049 s, 35.1 MB/s 2024-01-22T05:15:38.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.107 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256144 s, 40.9 MB/s 2024-01-22T05:15:38.139 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.139 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.139 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271593 s, 38.6 MB/s 2024-01-22T05:15:38.170 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.170 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.170 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026679 s, 39.3 MB/s 2024-01-22T05:15:38.197 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.198 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.198 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023434 s, 44.7 MB/s 2024-01-22T05:15:38.226 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.226 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.226 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239826 s, 43.7 MB/s 2024-01-22T05:15:38.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:38.228 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:38.228 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:38.229 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.30 2024-01-22T05:15:38.229 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:38.229 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:38.229 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:38.229 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:38.286 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.286 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.286 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261872 s, 40.0 MB/s 2024-01-22T05:15:38.314 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.314 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.314 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023551 s, 44.5 MB/s 2024-01-22T05:15:38.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.351 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318685 s, 32.9 MB/s 2024-01-22T05:15:38.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.379 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235777 s, 44.5 MB/s 2024-01-22T05:15:38.417 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.417 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.418 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0357308 s, 29.3 MB/s 2024-01-22T05:15:38.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.445 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244415 s, 42.9 MB/s 2024-01-22T05:15:38.473 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.473 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.473 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248065 s, 42.3 MB/s 2024-01-22T05:15:38.502 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.502 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.502 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255237 s, 41.1 MB/s 2024-01-22T05:15:38.525 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.525 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.525 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194046 s, 54.0 MB/s 2024-01-22T05:15:38.555 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.555 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.555 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273649 s, 38.3 MB/s 2024-01-22T05:15:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307918 s, 34.1 MB/s 2024-01-22T05:15:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195318 s, 53.7 MB/s 2024-01-22T05:15:38.645 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.645 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309888 s, 33.8 MB/s 2024-01-22T05:15:38.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.669 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208267 s, 50.3 MB/s 2024-01-22T05:15:38.703 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.703 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.703 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295262 s, 35.5 MB/s 2024-01-22T05:15:38.740 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.740 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.740 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330262 s, 31.7 MB/s 2024-01-22T05:15:38.768 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.769 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.769 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248333 s, 42.2 MB/s 2024-01-22T05:15:38.802 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.802 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.803 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293465 s, 35.7 MB/s 2024-01-22T05:15:38.829 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.829 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.829 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221876 s, 47.3 MB/s 2024-01-22T05:15:38.859 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.860 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.860 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278726 s, 37.6 MB/s 2024-01-22T05:15:38.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.884 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020061 s, 52.3 MB/s 2024-01-22T05:15:38.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.915 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258634 s, 40.5 MB/s 2024-01-22T05:15:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274922 s, 38.1 MB/s 2024-01-22T05:15:38.977 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:38.978 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:38.978 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275679 s, 38.0 MB/s 2024-01-22T05:15:39.004 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.004 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.004 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235901 s, 44.4 MB/s 2024-01-22T05:15:39.038 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.038 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.038 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303421 s, 34.6 MB/s 2024-01-22T05:15:39.068 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.068 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.068 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258724 s, 40.5 MB/s 2024-01-22T05:15:39.099 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.099 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.099 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269842 s, 38.9 MB/s 2024-01-22T05:15:39.130 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.130 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.130 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268466 s, 39.1 MB/s 2024-01-22T05:15:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.159 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.159 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245914 s, 42.6 MB/s 2024-01-22T05:15:39.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.184 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215269 s, 48.7 MB/s 2024-01-22T05:15:39.217 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.217 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.217 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297136 s, 35.3 MB/s 2024-01-22T05:15:39.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:39.219 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:15:39.220 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:15:39.220 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.31 2024-01-22T05:15:39.220 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:15:39.220 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:15:39.220 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:15:39.220 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:15:39.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.284 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297863 s, 35.2 MB/s 2024-01-22T05:15:39.319 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.320 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.320 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321055 s, 32.7 MB/s 2024-01-22T05:15:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.350 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263317 s, 39.8 MB/s 2024-01-22T05:15:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.380 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273138 s, 38.4 MB/s 2024-01-22T05:15:39.406 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.406 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.406 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243248 s, 43.1 MB/s 2024-01-22T05:15:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017894 s, 58.6 MB/s 2024-01-22T05:15:39.431 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:15:39.436 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:15:39.464 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.464 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.464 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337307 s, 31.1 MB/s 2024-01-22T05:15:39.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.490 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.490 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022772 s, 46.0 MB/s 2024-01-22T05:15:39.512 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.512 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.513 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204871 s, 51.2 MB/s 2024-01-22T05:15:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288555 s, 36.3 MB/s 2024-01-22T05:15:39.576 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.576 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.576 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261594 s, 40.1 MB/s 2024-01-22T05:15:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337479 s, 31.1 MB/s 2024-01-22T05:15:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027596 s, 38.0 MB/s 2024-01-22T05:15:39.675 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.676 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.676 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248336 s, 42.2 MB/s 2024-01-22T05:15:39.704 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.704 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.704 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240057 s, 43.7 MB/s 2024-01-22T05:15:39.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.735 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279038 s, 37.6 MB/s 2024-01-22T05:15:39.767 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.767 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.767 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274531 s, 38.2 MB/s 2024-01-22T05:15:39.797 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.797 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.797 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265381 s, 39.5 MB/s 2024-01-22T05:15:39.830 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.830 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.830 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289769 s, 36.2 MB/s 2024-01-22T05:15:39.861 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.861 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.861 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026481 s, 39.6 MB/s 2024-01-22T05:15:39.894 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.894 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.895 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291462 s, 36.0 MB/s 2024-01-22T05:15:39.932 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.933 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.933 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337018 s, 31.1 MB/s 2024-01-22T05:15:39.967 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:39.967 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:39.967 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305625 s, 34.3 MB/s 2024-01-22T05:15:40.004 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:40.004 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:40.004 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032479 s, 32.3 MB/s 2024-01-22T05:15:40.039 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:40.039 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:40.039 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304652 s, 34.4 MB/s 2024-01-22T05:15:40.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:40.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:40.073 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315368 s, 33.2 MB/s 2024-01-22T05:15:40.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:40.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:40.106 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278878 s, 37.6 MB/s 2024-01-22T05:15:40.136 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:40.136 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:40.136 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025619 s, 40.9 MB/s 2024-01-22T05:15:40.159 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:40.159 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:40.159 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206776 s, 50.7 MB/s 2024-01-22T05:15:40.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:40.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:40.184 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218323 s, 48.0 MB/s 2024-01-22T05:15:40.215 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:40.215 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:40.215 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268903 s, 39.0 MB/s 2024-01-22T05:15:40.244 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:15:40.244 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:15:40.244 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250529 s, 41.9 MB/s 2024-01-22T05:15:40.247 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2024-01-22T05:15:40.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.461+0000 7f4108e00700 1 Processor -- start 2024-01-22T05:15:40.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.461+0000 7f4108e00700 1 -- start start 2024-01-22T05:15:40.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.465+0000 7f4108e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f41040a8c60 0x7f4104158090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.465+0000 7f4108e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f41040bfab0 0x7f41040bff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.465+0000 7f4108e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41040c24e0 con 0x7f41041535d0 2024-01-22T05:15:40.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.465+0000 7f4108e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4104154100 con 0x7f41040a8c60 2024-01-22T05:15:40.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.465+0000 7f4108e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41040c2d10 con 0x7f41040bfab0 2024-01-22T05:15:40.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.465+0000 7f4101e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f41040a8c60 0x7f4104158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.465+0000 7f4101e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f41040a8c60 0x7f4104158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56810/0 (socket says 172.21.15.49:56810) 2024-01-22T05:15:40.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.465+0000 7f4101e00700 1 -- 172.21.15.49:0/2015311211 learned_addr learned my addr 172.21.15.49:0/2015311211 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:40.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.465+0000 7f4101400700 1 --2- 172.21.15.49:0/2015311211 >> v2:172.21.15.110:3300/0 conn(0x7f41040bfab0 0x7f41040bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.465+0000 7f4101e00700 1 -- 172.21.15.49:0/2015311211 >> v2:172.21.15.110:3300/0 conn(0x7f41040bfab0 msgr2=0x7f41040bff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.465+0000 7f4101e00700 1 --2- 172.21.15.49:0/2015311211 >> v2:172.21.15.110:3300/0 conn(0x7f41040bfab0 0x7f41040bff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.465+0000 7f4101e00700 1 -- 172.21.15.49:0/2015311211 >> v1:172.21.15.110:6789/0 conn(0x7f41041535d0 legacy=0x7f41041539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.465+0000 7f4101e00700 1 -- 172.21.15.49:0/2015311211 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41041578d0 con 0x7f41040a8c60 2024-01-22T05:15:40.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.465+0000 7f4101e00700 1 --2- 172.21.15.49:0/2015311211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41040a8c60 0x7f4104158090 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f41040c05d0 tx=0x7f40f40090f0).ready entity=mon.0 client_cookie=d637f11c8c90b3f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:40.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.469+0000 7f4100a00700 1 -- 172.21.15.49:0/2015311211 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f400b520 con 0x7f41040a8c60 2024-01-22T05:15:40.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.469+0000 7f4100a00700 1 -- 172.21.15.49:0/2015311211 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f400b680 con 0x7f41040a8c60 2024-01-22T05:15:40.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.469+0000 7f4100a00700 1 -- 172.21.15.49:0/2015311211 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f400ba00 con 0x7f41040a8c60 2024-01-22T05:15:40.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.469+0000 7f4108e00700 1 -- 172.21.15.49:0/2015311211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41040a8c60 msgr2=0x7f4104158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.469+0000 7f4108e00700 1 --2- 172.21.15.49:0/2015311211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41040a8c60 0x7f4104158090 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f41040c05d0 tx=0x7f40f40090f0).stop 2024-01-22T05:15:40.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.469+0000 7f4108e00700 1 -- 172.21.15.49:0/2015311211 shutdown_connections 2024-01-22T05:15:40.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.469+0000 7f4108e00700 1 --2- 172.21.15.49:0/2015311211 >> v2:172.21.15.110:3300/0 conn(0x7f41040bfab0 0x7f41040bff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.469+0000 7f4108e00700 1 --2- 172.21.15.49:0/2015311211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41040a8c60 0x7f4104158090 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.469+0000 7f4108e00700 1 -- 172.21.15.49:0/2015311211 >> 172.21.15.49:0/2015311211 conn(0x7f41040c6500 msgr2=0x7f41040c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:40.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.469+0000 7f4108e00700 1 -- 172.21.15.49:0/2015311211 shutdown_connections 2024-01-22T05:15:40.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.469+0000 7f4108e00700 1 -- 172.21.15.49:0/2015311211 wait complete. 2024-01-22T05:15:40.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.473+0000 7f4108e00700 1 Processor -- start 2024-01-22T05:15:40.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.473+0000 7f4108e00700 1 -- start start 2024-01-22T05:15:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4108e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41040a8c60 0x7f41041594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4108e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41040bfab0 0x7f4104151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4108e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41041535d0 0x7f4104152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4108e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4104152530 con 0x7f41040bfab0 2024-01-22T05:15:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4108e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4104159030 con 0x7f41041535d0 2024-01-22T05:15:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4108e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4104158420 con 0x7f41040a8c60 2024-01-22T05:15:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4101400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41040bfab0 0x7f4104151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4101e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41040a8c60 0x7f41041594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4101400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41040bfab0 0x7f4104151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56816/0 (socket says 172.21.15.49:56816) 2024-01-22T05:15:40.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4101400700 1 -- 172.21.15.49:0/2957698431 learned_addr learned my addr 172.21.15.49:0/2957698431 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:40.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4102800700 1 --2- 172.21.15.49:0/2957698431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41041535d0 0x7f4104152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4101e00700 1 -- 172.21.15.49:0/2957698431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41041535d0 msgr2=0x7f4104152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4101e00700 1 --2- 172.21.15.49:0/2957698431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41041535d0 0x7f4104152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4101e00700 1 -- 172.21.15.49:0/2957698431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41040bfab0 msgr2=0x7f4104151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4101e00700 1 --2- 172.21.15.49:0/2957698431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41040bfab0 0x7f4104151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4101e00700 1 -- 172.21.15.49:0/2957698431 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f4009370 con 0x7f41040a8c60 2024-01-22T05:15:40.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4101400700 1 --2- 172.21.15.49:0/2957698431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41040bfab0 0x7f4104151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:15:40.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4101e00700 1 --2- 172.21.15.49:0/2957698431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41040a8c60 0x7f41041594c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f40f4014000 tx=0x7f40f4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:40.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f40f9600700 1 -- 172.21.15.49:0/2957698431 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4000bc0 con 0x7f41040a8c60 2024-01-22T05:15:40.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f40f9600700 1 -- 172.21.15.49:0/2957698431 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f400b7f0 con 0x7f41040a8c60 2024-01-22T05:15:40.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4108e00700 1 -- 172.21.15.49:0/2957698431 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4104158700 con 0x7f41040a8c60 2024-01-22T05:15:40.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f40f9600700 1 -- 172.21.15.49:0/2957698431 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4000d20 con 0x7f41040a8c60 2024-01-22T05:15:40.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.477+0000 7f4108e00700 1 -- 172.21.15.49:0/2957698431 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4104158cc0 con 0x7f41040a8c60 2024-01-22T05:15:40.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.481+0000 7f40f9600700 1 -- 172.21.15.49:0/2957698431 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f40f401b8b0 con 0x7f41040a8c60 2024-01-22T05:15:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.485+0000 7f40f9600700 1 --2- 172.21.15.49:0/2957698431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40dc05a540 0x7f40dc05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.485+0000 7f40f9600700 1 -- 172.21.15.49:0/2957698431 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f40f4076100 con 0x7f41040a8c60 2024-01-22T05:15:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.485+0000 7f4101400700 1 --2- 172.21.15.49:0/2957698431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40dc05a540 0x7f40dc05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.485+0000 7f4101400700 1 --2- 172.21.15.49:0/2957698431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40dc05a540 0x7f40dc05ca00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f4104151550 tx=0x7f40ec009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:40.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.485+0000 7f411326b740 1 Processor -- start 2024-01-22T05:15:40.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f411326b740 1 -- start start 2024-01-22T05:15:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f411326b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd6ecd0 0xdb7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f411326b740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xdc4ee0 0xd72f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f411326b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd73420 0xd6d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f411326b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xcde780 con 0xd6ecd0 2024-01-22T05:15:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f411326b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xcbf340 con 0xd73420 2024-01-22T05:15:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f411326b740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xca6530 con 0xdc4ee0 2024-01-22T05:15:40.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f4101e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd6ecd0 0xdb7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f4101e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd6ecd0 0xdb7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56832/0 (socket says 172.21.15.49:56832) 2024-01-22T05:15:40.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f4101e00700 1 -- 172.21.15.49:0/828201283 learned_addr learned my addr 172.21.15.49:0/828201283 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:40.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f4102800700 1 --2- 172.21.15.49:0/828201283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd73420 0xd6d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f4101400700 1 --2- 172.21.15.49:0/828201283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xdc4ee0 0xd72f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f4101e00700 1 -- 172.21.15.49:0/828201283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xdc4ee0 msgr2=0xd72f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f4101e00700 1 --2- 172.21.15.49:0/828201283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xdc4ee0 0xd72f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f4101e00700 1 -- 172.21.15.49:0/828201283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd73420 msgr2=0xd6d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f4101e00700 1 --2- 172.21.15.49:0/828201283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd73420 0xd6d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f4101e00700 1 -- 172.21.15.49:0/828201283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xcff700 con 0xd6ecd0 2024-01-22T05:15:40.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f4102800700 1 --2- 172.21.15.49:0/828201283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd73420 0xd6d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:40.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f4101e00700 1 --2- 172.21.15.49:0/828201283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd6ecd0 0xdb7910 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f40f400c010 tx=0x7f40f400e000).ready entity=mon.0 client_cookie=b3a559418a7c5f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:40.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f40f2000700 1 -- 172.21.15.49:0/828201283 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f400b960 con 0xd6ecd0 2024-01-22T05:15:40.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f40f2000700 1 -- 172.21.15.49:0/828201283 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f4051070 con 0xd6ecd0 2024-01-22T05:15:40.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.489+0000 7f40f2000700 1 -- 172.21.15.49:0/828201283 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f404b6e0 con 0xd6ecd0 2024-01-22T05:15:40.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.493+0000 7f411326b740 1 -- 172.21.15.49:0/828201283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd6ecd0 msgr2=0xdb7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.493+0000 7f411326b740 1 --2- 172.21.15.49:0/828201283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd6ecd0 0xdb7910 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f40f400c010 tx=0x7f40f400e000).stop 2024-01-22T05:15:40.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.493+0000 7f411326b740 1 -- 172.21.15.49:0/828201283 shutdown_connections 2024-01-22T05:15:40.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.493+0000 7f411326b740 1 --2- 172.21.15.49:0/828201283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd73420 0xd6d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.493+0000 7f411326b740 1 --2- 172.21.15.49:0/828201283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xdc4ee0 0xd72f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.493+0000 7f411326b740 1 --2- 172.21.15.49:0/828201283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd6ecd0 0xdb7910 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.493+0000 7f411326b740 1 -- 172.21.15.49:0/828201283 >> 172.21.15.49:0/828201283 conn(0xb52920 msgr2=0xd73fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:40.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.493+0000 7f411326b740 1 -- 172.21.15.49:0/828201283 shutdown_connections 2024-01-22T05:15:40.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.493+0000 7f411326b740 1 -- 172.21.15.49:0/828201283 wait complete. 2024-01-22T05:15:40.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.493+0000 7f411326b740 1 -- start start 2024-01-22T05:15:40.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.493+0000 7f411326b740 1 Processor -- start 2024-01-22T05:15:40.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f411326b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd6ecd0 0xdbd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f411326b740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd73420 0xd994b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f411326b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xdc4ee0 0xd863b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f411326b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xd9ba40 con 0xd6ecd0 2024-01-22T05:15:40.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f411326b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xd71810 con 0xdc4ee0 2024-01-22T05:15:40.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f411326b740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xd9a270 con 0xd73420 2024-01-22T05:15:40.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f411326b740 10 client.0 ll_register_callbacks cb 0xd2ae40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:40.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f4101e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd6ecd0 0xdbd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f4101e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd6ecd0 0xdbd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56848/0 (socket says 172.21.15.49:56848) 2024-01-22T05:15:40.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f4101e00700 1 -- 172.21.15.49:0/3806080301 learned_addr learned my addr 172.21.15.49:0/3806080301 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:40.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f4101400700 1 --2- 172.21.15.49:0/3806080301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd73420 0xd994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f4102800700 1 --2- 172.21.15.49:0/3806080301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xdc4ee0 0xd863b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f4101e00700 1 -- 172.21.15.49:0/3806080301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd73420 msgr2=0xd994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f4101e00700 1 --2- 172.21.15.49:0/3806080301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd73420 0xd994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f4101e00700 1 -- 172.21.15.49:0/3806080301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xdc4ee0 msgr2=0xd863b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f4101e00700 1 --2- 172.21.15.49:0/3806080301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xdc4ee0 0xd863b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f4101e00700 1 -- 172.21.15.49:0/3806080301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4104158cc0 con 0xd6ecd0 2024-01-22T05:15:40.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f4101400700 1 --2- 172.21.15.49:0/3806080301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd73420 0xd994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:40.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f4102800700 1 --2- 172.21.15.49:0/3806080301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xdc4ee0 0xd863b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:40.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f4101e00700 1 --2- 172.21.15.49:0/3806080301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd6ecd0 0xdbd5a0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f40f4007fe0 tx=0x7f40f402e000).ready entity=mon.0 client_cookie=3463ada826ade399 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:40.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f40eaa00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:15:40.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f40eaa00700 1 -- 172.21.15.49:0/3806080301 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f404ca40 con 0xd6ecd0 2024-01-22T05:15:40.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f40eaa00700 1 -- 172.21.15.49:0/3806080301 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f40f401bb60 con 0xd6ecd0 2024-01-22T05:15:40.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.497+0000 7f411326b740 1 -- 172.21.15.49:0/3806080301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xce9e20 con 0xd6ecd0 2024-01-22T05:15:40.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f40eaa00700 1 -- 172.21.15.49:0/3806080301 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40f4049130 con 0xd6ecd0 2024-01-22T05:15:40.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f411326b740 10 client.8454 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:40.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f411326b740 1 -- 172.21.15.49:0/3806080301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0xced3b0 con 0xd6ecd0 2024-01-22T05:15:40.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f40eaa00700 1 -- 172.21.15.49:0/3806080301 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xce9e20 con 0xd6ecd0 2024-01-22T05:15:40.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f40eaa00700 1 -- 172.21.15.49:0/3806080301 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f40f4049290 con 0xd6ecd0 2024-01-22T05:15:40.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f411326b740 10 client.8454 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:40.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f411326b740 10 client.8454 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-01-22T05:15:40.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f411326b740 20 client.8454 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:40.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f411326b740 1 --2- 172.21.15.49:0/3806080301 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xd9abf0 0xd9b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f411326b740 4 client.8454 mds_command: new command op to 8292 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:15:40.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f411326b740 1 -- 172.21.15.49:0/3806080301 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xce0370 con 0xd9abf0 2024-01-22T05:15:40.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f4101400700 1 --2- 172.21.15.49:0/3806080301 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xd9abf0 0xd9b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f40eaa00700 10 client.8454 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:40.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f4101400700 1 --2- 172.21.15.49:0/3806080301 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xd9abf0 0xd9b000 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=caa7a1395bf8677c server_cookie=7b77a948ec3910fe in_seq=0 out_seq=0 2024-01-22T05:15:40.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f40eaa00700 1 -- 172.21.15.49:0/3806080301 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xce0370 con 0xd9abf0 2024-01-22T05:15:40.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f40eaa00700 10 client.8454 handle_command_reply: tid=0 2024-01-22T05:15:40.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.501+0000 7f411326b740 1 client.8454 shutdown 2024-01-22T05:15:40.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.505+0000 7f411326b740 1 -- 172.21.15.49:0/3806080301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd6ecd0 msgr2=0xdbd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.505+0000 7f411326b740 1 --2- 172.21.15.49:0/3806080301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd6ecd0 0xdbd5a0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f40f4007fe0 tx=0x7f40f402e000).stop 2024-01-22T05:15:40.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.505+0000 7f411326b740 1 -- 172.21.15.49:0/3806080301 shutdown_connections 2024-01-22T05:15:40.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.505+0000 7f411326b740 1 --2- 172.21.15.49:0/3806080301 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xd9abf0 0xd9b000 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.505+0000 7f411326b740 1 --2- 172.21.15.49:0/3806080301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xdc4ee0 0xd863b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.505+0000 7f40eaa00700 0 client.8454 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:40.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.505+0000 7f411326b740 1 --2- 172.21.15.49:0/3806080301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd73420 0xd994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.505+0000 7f411326b740 1 --2- 172.21.15.49:0/3806080301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd6ecd0 0xdbd5a0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.505+0000 7f411326b740 1 -- 172.21.15.49:0/3806080301 >> 172.21.15.49:0/3806080301 conn(0xb52920 msgr2=0xd6d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:40.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.505+0000 7f411326b740 1 -- 172.21.15.49:0/3806080301 shutdown_connections 2024-01-22T05:15:40.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.505+0000 7f411326b740 1 -- 172.21.15.49:0/3806080301 wait complete. 2024-01-22T05:15:40.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.505+0000 7f411326b740 20 client.8454 trim_cache size 0 max 16384 2024-01-22T05:15:40.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.525+0000 7f411326b740 1 Processor -- start 2024-01-22T05:15:40.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.525+0000 7f411326b740 1 -- start start 2024-01-22T05:15:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.525+0000 7f411326b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd6ecd0 0xdb6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.525+0000 7f411326b740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd73420 0xd98430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.525+0000 7f411326b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xdc4ee0 0xd98920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.525+0000 7f411326b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xdb5cd0 con 0xdc4ee0 2024-01-22T05:15:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.525+0000 7f411326b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xd98e10 con 0xd6ecd0 2024-01-22T05:15:40.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.525+0000 7f411326b740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xce0370 con 0xd73420 2024-01-22T05:15:40.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.525+0000 7f4102800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xdc4ee0 0xd98920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.525+0000 7f4101e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd6ecd0 0xdb6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.525+0000 7f4102800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xdc4ee0 0xd98920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56856/0 (socket says 172.21.15.49:56856) 2024-01-22T05:15:40.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.525+0000 7f4102800700 1 -- 172.21.15.49:0/1296311581 learned_addr learned my addr 172.21.15.49:0/1296311581 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:40.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.525+0000 7f4101400700 1 --2- 172.21.15.49:0/1296311581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd73420 0xd98430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f4101e00700 1 -- 172.21.15.49:0/1296311581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd73420 msgr2=0xd98430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f4101e00700 1 --2- 172.21.15.49:0/1296311581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd73420 0xd98430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f4101e00700 1 -- 172.21.15.49:0/1296311581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xdc4ee0 msgr2=0xd98920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f4101e00700 1 --2- 172.21.15.49:0/1296311581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xdc4ee0 0xd98920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f4101e00700 1 -- 172.21.15.49:0/1296311581 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41040ab3a0 con 0xd6ecd0 2024-01-22T05:15:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f4101e00700 1 --2- 172.21.15.49:0/1296311581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd6ecd0 0xdb6d70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f40f4049720 tx=0x7f40f4030040).ready entity=mon.1 client_cookie=6930323991a3a543 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f40f2a00700 1 -- 172.21.15.49:0/1296311581 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f404ca40 con 0xd6ecd0 2024-01-22T05:15:40.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f40f2a00700 1 -- 172.21.15.49:0/1296311581 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f401bb60 con 0xd6ecd0 2024-01-22T05:15:40.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f40f2a00700 1 -- 172.21.15.49:0/1296311581 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f404b480 con 0xd6ecd0 2024-01-22T05:15:40.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f411326b740 1 -- 172.21.15.49:0/1296311581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd6ecd0 msgr2=0xdb6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f411326b740 1 --2- 172.21.15.49:0/1296311581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd6ecd0 0xdb6d70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f40f4049720 tx=0x7f40f4030040).stop 2024-01-22T05:15:40.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f411326b740 1 -- 172.21.15.49:0/1296311581 shutdown_connections 2024-01-22T05:15:40.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f411326b740 1 --2- 172.21.15.49:0/1296311581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xdc4ee0 0xd98920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f411326b740 1 --2- 172.21.15.49:0/1296311581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd73420 0xd98430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f411326b740 1 --2- 172.21.15.49:0/1296311581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd6ecd0 0xdb6d70 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f411326b740 1 -- 172.21.15.49:0/1296311581 >> 172.21.15.49:0/1296311581 conn(0xb52920 msgr2=0xd72500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:40.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f411326b740 1 -- 172.21.15.49:0/1296311581 shutdown_connections 2024-01-22T05:15:40.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f411326b740 1 -- 172.21.15.49:0/1296311581 wait complete. 2024-01-22T05:15:40.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.529+0000 7f411326b740 1 -- start start 2024-01-22T05:15:40.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.533+0000 7f411326b740 1 Processor -- start 2024-01-22T05:15:40.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.533+0000 7f411326b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd6ecd0 0xdb3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.533+0000 7f411326b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd73420 0xe238e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.533+0000 7f411326b740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xdc4ee0 0xdba8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.533+0000 7f411326b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xdb3800 con 0xd73420 2024-01-22T05:15:40.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.533+0000 7f411326b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xd6e710 con 0xd6ecd0 2024-01-22T05:15:40.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.533+0000 7f411326b740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xd9c660 con 0xdc4ee0 2024-01-22T05:15:40.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.533+0000 7f411326b740 10 client.0 ll_register_callbacks cb 0xdb58a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:40.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.533+0000 7f4101400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd73420 0xe238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.533+0000 7f4101400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd73420 0xe238e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56858/0 (socket says 172.21.15.49:56858) 2024-01-22T05:15:40.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.533+0000 7f4101400700 1 -- 172.21.15.49:0/3205287034 learned_addr learned my addr 172.21.15.49:0/3205287034 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:40.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.533+0000 7f4101e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd6ecd0 0xdb3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.533+0000 7f4102800700 1 --2- 172.21.15.49:0/3205287034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xdc4ee0 0xdba8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f4101400700 1 -- 172.21.15.49:0/3205287034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xdc4ee0 msgr2=0xdba8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f4101400700 1 --2- 172.21.15.49:0/3205287034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xdc4ee0 0xdba8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f4101400700 1 -- 172.21.15.49:0/3205287034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd6ecd0 msgr2=0xdb3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f4101400700 1 --2- 172.21.15.49:0/3205287034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd6ecd0 0xdb3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f4101400700 1 -- 172.21.15.49:0/3205287034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xced3b0 con 0xd73420 2024-01-22T05:15:40.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f4101400700 1 --2- 172.21.15.49:0/3205287034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd73420 0xe238e0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f41040c75d0 tx=0x7f40ec023040).ready entity=mon.0 client_cookie=fadbcb367c8974b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:40.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f40eaa00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:15:40.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f40eaa00700 1 -- 172.21.15.49:0/3205287034 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec021880 con 0xd73420 2024-01-22T05:15:40.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f40eaa00700 1 -- 172.21.15.49:0/3205287034 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f40ec01a040 con 0xd73420 2024-01-22T05:15:40.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f411326b740 1 -- 172.21.15.49:0/3205287034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40f4051070 con 0xd73420 2024-01-22T05:15:40.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f40eaa00700 1 -- 172.21.15.49:0/3205287034 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40ec021bf0 con 0xd73420 2024-01-22T05:15:40.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f411326b740 10 client.8460 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:40.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f411326b740 1 -- 172.21.15.49:0/3205287034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0xce85e0 con 0xd73420 2024-01-22T05:15:40.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f40eaa00700 1 -- 172.21.15.49:0/3205287034 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f4051070 con 0xd73420 2024-01-22T05:15:40.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f40eaa00700 1 -- 172.21.15.49:0/3205287034 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f40ec033350 con 0xd73420 2024-01-22T05:15:40.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f411326b740 10 client.8460 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:40.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f411326b740 10 client.8460 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-01-22T05:15:40.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f411326b740 20 client.8460 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:40.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f411326b740 1 --2- 172.21.15.49:0/3205287034 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xdbadd0 0xdb98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f411326b740 4 client.8460 mds_command: new command op to 8292 tid=0[{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-01-22T05:15:40.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f411326b740 1 -- 172.21.15.49:0/3205287034 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0xba98b0 con 0xdbadd0 2024-01-22T05:15:40.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f4101e00700 1 --2- 172.21.15.49:0/3205287034 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xdbadd0 0xdb98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f40eaa00700 10 client.8460 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:40.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.537+0000 7f4101e00700 1 --2- 172.21.15.49:0/3205287034 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xdbadd0 0xdb98d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=aeaa8db3c3d290bd server_cookie=8070a5c2c564c103 in_seq=0 out_seq=0 2024-01-22T05:15:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.545+0000 7f40eaa00700 1 -- 172.21.15.49:0/3205287034 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0xba98b0 con 0xdbadd0 2024-01-22T05:15:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.545+0000 7f40eaa00700 10 client.8460 handle_command_reply: tid=0 2024-01-22T05:15:40.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.545+0000 7f411326b740 1 client.8460 shutdown 2024-01-22T05:15:40.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.545+0000 7f411326b740 1 -- 172.21.15.49:0/3205287034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd73420 msgr2=0xe238e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.545+0000 7f411326b740 1 --2- 172.21.15.49:0/3205287034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd73420 0xe238e0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f41040c75d0 tx=0x7f40ec023040).stop 2024-01-22T05:15:40.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.545+0000 7f411326b740 1 -- 172.21.15.49:0/3205287034 shutdown_connections 2024-01-22T05:15:40.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.545+0000 7f411326b740 1 --2- 172.21.15.49:0/3205287034 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xdbadd0 0xdb98d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.545+0000 7f411326b740 1 --2- 172.21.15.49:0/3205287034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xdc4ee0 0xdba8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.545+0000 7f411326b740 1 --2- 172.21.15.49:0/3205287034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd73420 0xe238e0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.545+0000 7f411326b740 1 --2- 172.21.15.49:0/3205287034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd6ecd0 0xdb3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.545+0000 7f40eaa00700 0 client.8460 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:40.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.545+0000 7f411326b740 1 -- 172.21.15.49:0/3205287034 >> 172.21.15.49:0/3205287034 conn(0xb52920 msgr2=0xd723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:40.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.545+0000 7f411326b740 1 -- 172.21.15.49:0/3205287034 shutdown_connections 2024-01-22T05:15:40.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.545+0000 7f411326b740 1 -- 172.21.15.49:0/3205287034 wait complete. 2024-01-22T05:15:40.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.545+0000 7f411326b740 20 client.8460 trim_cache size 0 max 16384 2024-01-22T05:15:40.550 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:15:40.550 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:15:40.550 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "0f8d22fb-daca-4dd1-a1c1-d33fd38df60d", 2024-01-22T05:15:40.550 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:15:40.550 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:15:40.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.549+0000 7f4108e00700 1 -- 172.21.15.49:0/2957698431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40dc05a540 msgr2=0x7f40dc05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.549+0000 7f4108e00700 1 --2- 172.21.15.49:0/2957698431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40dc05a540 0x7f40dc05ca00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f4104151550 tx=0x7f40ec009060).stop 2024-01-22T05:15:40.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.549+0000 7f4108e00700 1 -- 172.21.15.49:0/2957698431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41040a8c60 msgr2=0x7f41041594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.549+0000 7f4108e00700 1 --2- 172.21.15.49:0/2957698431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41040a8c60 0x7f41041594c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f40f4014000 tx=0x7f40f4017000).stop 2024-01-22T05:15:40.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.549+0000 7f4108e00700 1 -- 172.21.15.49:0/2957698431 shutdown_connections 2024-01-22T05:15:40.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.549+0000 7f4108e00700 1 --2- 172.21.15.49:0/2957698431 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40dc05a540 0x7f40dc05ca00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.549+0000 7f4108e00700 1 --2- 172.21.15.49:0/2957698431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41041535d0 0x7f4104152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.549+0000 7f4108e00700 1 --2- 172.21.15.49:0/2957698431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41040bfab0 0x7f4104151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.549+0000 7f4108e00700 1 --2- 172.21.15.49:0/2957698431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41040a8c60 0x7f41041594c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.549+0000 7f4108e00700 1 -- 172.21.15.49:0/2957698431 >> 172.21.15.49:0/2957698431 conn(0x7f41040c6500 msgr2=0x7f41040682b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:40.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.549+0000 7f4108e00700 1 -- 172.21.15.49:0/2957698431 shutdown_connections 2024-01-22T05:15:40.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.549+0000 7f4108e00700 1 -- 172.21.15.49:0/2957698431 wait complete. 2024-01-22T05:15:40.581 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub pause 2024-01-22T05:15:40.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.761+0000 7f5799c00700 1 Processor -- start 2024-01-22T05:15:40.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.761+0000 7f5799c00700 1 -- start start 2024-01-22T05:15:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.761+0000 7f5799c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5794068f50 0x7f57940639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.761+0000 7f5799c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5794152ba0 con 0x7f5794068aa0 2024-01-22T05:15:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.761+0000 7f5799c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57940c23b0 con 0x7f57941590b0 2024-01-22T05:15:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.761+0000 7f5799c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57940c2690 con 0x7f5794068f50 2024-01-22T05:15:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5792000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5794068aa0 0x7f57940632d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48164/0 (socket says 172.21.15.49:48164) 2024-01-22T05:15:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5792000700 1 -- 172.21.15.49:0/2214909767 learned_addr learned my addr 172.21.15.49:0/2214909767 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:40.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5793400700 1 --2- 172.21.15.49:0/2214909767 >> v2:172.21.15.110:3300/0 conn(0x7f5794068f50 0x7f57940639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951954956 0 0) 0x7f577c001110 con 0x7f5794068aa0 2024-01-22T05:15:40.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57740033f0 con 0x7f5794068aa0 2024-01-22T05:15:40.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368087764 0 0) 0x7f57940c23b0 con 0x7f57941590b0 2024-01-22T05:15:40.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f577c001110 con 0x7f57941590b0 2024-01-22T05:15:40.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 499606139 0 0) 0x7f57740033f0 con 0x7f5794068aa0 2024-01-22T05:15:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 >> v2:172.21.15.110:3300/0 conn(0x7f5794068f50 msgr2=0x7f57940639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 --2- 172.21.15.49:0/2214909767 >> v2:172.21.15.110:3300/0 conn(0x7f5794068f50 0x7f57940639e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 >> v1:172.21.15.110:6789/0 conn(0x7f57941590b0 legacy=0x7f5794152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57940c2970 con 0x7f5794068aa0 2024-01-22T05:15:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f577c001600 con 0x7f5794068aa0 2024-01-22T05:15:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 >> v1:172.21.15.49:6789/0 conn(0x7f5794068aa0 legacy=0x7f57940632d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 --2- 172.21.15.49:0/2214909767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5774004ad0 0x7f5774004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 --2- 172.21.15.49:0/2214909767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5774003630 0x7f5774003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 --2- 172.21.15.49:0/2214909767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5774003fa0 0x7f577400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57940c2690 con 0x7f5774003fa0 2024-01-22T05:15:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577400bf60 con 0x7f5774004ad0 2024-01-22T05:15:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577400c0d0 con 0x7f5774003630 2024-01-22T05:15:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5793400700 1 --2- 172.21.15.49:0/2214909767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5774003fa0 0x7f577400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5792a00700 1 --2- 172.21.15.49:0/2214909767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5774004ad0 0x7f5774004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5792000700 1 --2- 172.21.15.49:0/2214909767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5774003630 0x7f5774003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5793400700 1 -- 172.21.15.49:0/2214909767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5774003630 msgr2=0x7f5774003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5793400700 1 --2- 172.21.15.49:0/2214909767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5774003630 0x7f5774003ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5793400700 1 -- 172.21.15.49:0/2214909767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5774004ad0 msgr2=0x7f5774004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5793400700 1 --2- 172.21.15.49:0/2214909767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5774004ad0 0x7f5774004ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5793400700 1 -- 172.21.15.49:0/2214909767 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57740033f0 con 0x7f5774003fa0 2024-01-22T05:15:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5792000700 1 --2- 172.21.15.49:0/2214909767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5774003630 0x7f5774003ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5793400700 1 -- 172.21.15.49:0/2214909767 reap_dead start 2024-01-22T05:15:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.765+0000 7f5793400700 1 --2- 172.21.15.49:0/2214909767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5774003fa0 0x7f577400b8e0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f578c00e210 tx=0x7f578c00b040).ready entity=mon.0 client_cookie=aec4a977a793e380 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:40.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.769+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c009ac0 con 0x7f5774003fa0 2024-01-22T05:15:40.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.769+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c00f040 con 0x7f5774003fa0 2024-01-22T05:15:40.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.769+0000 7f5791600700 1 -- 172.21.15.49:0/2214909767 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c00ed10 con 0x7f5774003fa0 2024-01-22T05:15:40.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.769+0000 7f5799c00700 1 -- 172.21.15.49:0/2214909767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5774003fa0 msgr2=0x7f577400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.769+0000 7f5799c00700 1 --2- 172.21.15.49:0/2214909767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5774003fa0 0x7f577400b8e0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f578c00e210 tx=0x7f578c00b040).stop 2024-01-22T05:15:40.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.769+0000 7f5799c00700 1 -- 172.21.15.49:0/2214909767 shutdown_connections 2024-01-22T05:15:40.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.769+0000 7f5799c00700 1 --2- 172.21.15.49:0/2214909767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5774003fa0 0x7f577400b8e0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.769+0000 7f5799c00700 1 -- 172.21.15.49:0/2214909767 >> 172.21.15.49:0/2214909767 conn(0x7f5794065f30 msgr2=0x7f5794066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:40.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.769+0000 7f5799c00700 1 -- 172.21.15.49:0/2214909767 shutdown_connections 2024-01-22T05:15:40.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.769+0000 7f5799c00700 1 -- 172.21.15.49:0/2214909767 wait complete. 2024-01-22T05:15:40.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5799c00700 1 Processor -- start 2024-01-22T05:15:40.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5799c00700 1 -- start start 2024-01-22T05:15:40.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5799c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5774003fa0 0x7f579414f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5799c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f579414fcf0 0x7f57940be340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5799c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57940be830 0x7f5794160100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5799c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57940a86d0 con 0x7f5774003fa0 2024-01-22T05:15:40.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5799c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57940a89b0 con 0x7f579414fcf0 2024-01-22T05:15:40.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5799c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57940a8c90 con 0x7f57940be830 2024-01-22T05:15:40.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5792a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5774003fa0 0x7f579414f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5792a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5774003fa0 0x7f579414f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56872/0 (socket says 172.21.15.49:56872) 2024-01-22T05:15:40.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5792a00700 1 -- 172.21.15.49:0/2908012915 learned_addr learned my addr 172.21.15.49:0/2908012915 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:40.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5793400700 1 --2- 172.21.15.49:0/2908012915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57940be830 0x7f5794160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5792000700 1 --2- 172.21.15.49:0/2908012915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f579414fcf0 0x7f57940be340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5792a00700 1 -- 172.21.15.49:0/2908012915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57940be830 msgr2=0x7f5794160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5792a00700 1 --2- 172.21.15.49:0/2908012915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57940be830 0x7f5794160100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5792a00700 1 -- 172.21.15.49:0/2908012915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f579414fcf0 msgr2=0x7f57940be340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5792a00700 1 --2- 172.21.15.49:0/2908012915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f579414fcf0 0x7f57940be340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5792a00700 1 -- 172.21.15.49:0/2908012915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57940a8f70 con 0x7f5774003fa0 2024-01-22T05:15:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.773+0000 7f5792a00700 1 --2- 172.21.15.49:0/2908012915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5774003fa0 0x7f579414f800 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f5784002a10 tx=0x7f5784007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.777+0000 7f578a000700 1 -- 172.21.15.49:0/2908012915 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5784007240 con 0x7f5774003fa0 2024-01-22T05:15:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.777+0000 7f578a000700 1 -- 172.21.15.49:0/2908012915 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57840073a0 con 0x7f5774003fa0 2024-01-22T05:15:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.777+0000 7f5799c00700 1 -- 172.21.15.49:0/2908012915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57940a82d0 con 0x7f5774003fa0 2024-01-22T05:15:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.777+0000 7f578a000700 1 -- 172.21.15.49:0/2908012915 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57840066f0 con 0x7f5774003fa0 2024-01-22T05:15:40.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.777+0000 7f5799c00700 1 -- 172.21.15.49:0/2908012915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5794160790 con 0x7f5774003fa0 2024-01-22T05:15:40.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.781+0000 7f578a000700 1 -- 172.21.15.49:0/2908012915 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5784006a60 con 0x7f5774003fa0 2024-01-22T05:15:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.781+0000 7f578a000700 1 --2- 172.21.15.49:0/2908012915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f576c05a510 0x7f576c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.781+0000 7f578a000700 1 -- 172.21.15.49:0/2908012915 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5784074720 con 0x7f5774003fa0 2024-01-22T05:15:40.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.781+0000 7f5792000700 1 --2- 172.21.15.49:0/2908012915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f576c05a510 0x7f576c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.781+0000 7f5792000700 1 --2- 172.21.15.49:0/2908012915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f576c05a510 0x7f576c05c9d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f57940aa750 tx=0x7f577c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:40.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.785+0000 7f57a40a0740 1 Processor -- start 2024-01-22T05:15:40.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.785+0000 7f57a40a0740 1 -- start start 2024-01-22T05:15:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.785+0000 7f57a40a0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b15c0 0x24b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.785+0000 7f57a40a0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24b2170 0x246ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.785+0000 7f57a40a0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x246d1b0 0x246d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.785+0000 7f57a40a0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x23aa2a0 con 0x246d1b0 2024-01-22T05:15:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.785+0000 7f57a40a0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x23cd4a0 con 0x24b2170 2024-01-22T05:15:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.785+0000 7f57a40a0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2396ce0 con 0x24b15c0 2024-01-22T05:15:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.785+0000 7f5793400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x246d1b0 0x246d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.785+0000 7f5793400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x246d1b0 0x246d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56886/0 (socket says 172.21.15.49:56886) 2024-01-22T05:15:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.785+0000 7f5793400700 1 -- 172.21.15.49:0/3812262998 learned_addr learned my addr 172.21.15.49:0/3812262998 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.785+0000 7f5792000700 1 --2- 172.21.15.49:0/3812262998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24b2170 0x246ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.785+0000 7f5792a00700 1 --2- 172.21.15.49:0/3812262998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b15c0 0x24b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.785+0000 7f5793400700 1 -- 172.21.15.49:0/3812262998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b15c0 msgr2=0x24b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.785+0000 7f5793400700 1 --2- 172.21.15.49:0/3812262998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b15c0 0x24b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f5793400700 1 -- 172.21.15.49:0/3812262998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24b2170 msgr2=0x246ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f5793400700 1 --2- 172.21.15.49:0/3812262998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24b2170 0x246ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f5793400700 1 -- 172.21.15.49:0/3812262998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23fb8e0 con 0x246d1b0 2024-01-22T05:15:40.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f5793400700 1 --2- 172.21.15.49:0/3812262998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x246d1b0 0x246d610 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f5794064ae0 tx=0x7f578c018000).ready entity=mon.0 client_cookie=e320f47804a3cdcd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:40.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f5782a00700 1 -- 172.21.15.49:0/3812262998 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c00e9f0 con 0x246d1b0 2024-01-22T05:15:40.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f5782a00700 1 -- 172.21.15.49:0/3812262998 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c00eb50 con 0x246d1b0 2024-01-22T05:15:40.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f5782a00700 1 -- 172.21.15.49:0/3812262998 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c013610 con 0x246d1b0 2024-01-22T05:15:40.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f57a40a0740 1 -- 172.21.15.49:0/3812262998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x246d1b0 msgr2=0x246d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f57a40a0740 1 --2- 172.21.15.49:0/3812262998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x246d1b0 0x246d610 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f5794064ae0 tx=0x7f578c018000).stop 2024-01-22T05:15:40.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f57a40a0740 1 -- 172.21.15.49:0/3812262998 shutdown_connections 2024-01-22T05:15:40.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f57a40a0740 1 --2- 172.21.15.49:0/3812262998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x246d1b0 0x246d610 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f57a40a0740 1 --2- 172.21.15.49:0/3812262998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24b2170 0x246ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f57a40a0740 1 --2- 172.21.15.49:0/3812262998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b15c0 0x24b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f57a40a0740 1 -- 172.21.15.49:0/3812262998 >> 172.21.15.49:0/3812262998 conn(0x224f640 msgr2=0x24b6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f57a40a0740 1 -- 172.21.15.49:0/3812262998 shutdown_connections 2024-01-22T05:15:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f57a40a0740 1 -- 172.21.15.49:0/3812262998 wait complete. 2024-01-22T05:15:40.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.789+0000 7f57a40a0740 1 -- start start 2024-01-22T05:15:40.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f57a40a0740 1 Processor -- start 2024-01-22T05:15:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f57a40a0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x246d1b0 0x249c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f57a40a0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24b15c0 0x2488ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f57a40a0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b2170 0x249a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f57a40a0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2499630 con 0x24b15c0 2024-01-22T05:15:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f57a40a0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x249cd00 con 0x246d1b0 2024-01-22T05:15:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f57a40a0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x24972e0 con 0x24b2170 2024-01-22T05:15:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f57a40a0740 10 client.0 ll_register_callbacks cb 0x24279f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f5792000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24b15c0 0x2488ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f5792000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24b15c0 0x2488ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56896/0 (socket says 172.21.15.49:56896) 2024-01-22T05:15:40.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f5792000700 1 -- 172.21.15.49:0/589167876 learned_addr learned my addr 172.21.15.49:0/589167876 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:40.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f5792a00700 1 --2- 172.21.15.49:0/589167876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x246d1b0 0x249c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f5793400700 1 --2- 172.21.15.49:0/589167876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b2170 0x249a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f5792000700 1 -- 172.21.15.49:0/589167876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b2170 msgr2=0x249a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f5792000700 1 --2- 172.21.15.49:0/589167876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b2170 0x249a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f5792000700 1 -- 172.21.15.49:0/589167876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x246d1b0 msgr2=0x249c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f5792000700 1 --2- 172.21.15.49:0/589167876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x246d1b0 0x249c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f5792000700 1 -- 172.21.15.49:0/589167876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57740033f0 con 0x24b15c0 2024-01-22T05:15:40.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f5792000700 1 --2- 172.21.15.49:0/589167876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24b15c0 0x2488ef0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f57940bcff0 tx=0x7f577c01c040).ready entity=mon.0 client_cookie=754038b34195fee7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:40.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.793+0000 7f577b400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:15:40.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f577b400700 1 -- 172.21.15.49:0/589167876 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c01f040 con 0x24b15c0 2024-01-22T05:15:40.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f577b400700 1 -- 172.21.15.49:0/589167876 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f577c0186c0 con 0x24b15c0 2024-01-22T05:15:40.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f57a40a0740 1 -- 172.21.15.49:0/589167876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x23e71f0 con 0x24b15c0 2024-01-22T05:15:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f577b400700 1 -- 172.21.15.49:0/589167876 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f577c018a90 con 0x24b15c0 2024-01-22T05:15:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f57a40a0740 10 client.8472 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f57a40a0740 1 -- 172.21.15.49:0/589167876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x23ea780 con 0x24b15c0 2024-01-22T05:15:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f577b400700 1 -- 172.21.15.49:0/589167876 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x23e71f0 con 0x24b15c0 2024-01-22T05:15:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f577b400700 1 -- 172.21.15.49:0/589167876 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f577c018bf0 con 0x24b15c0 2024-01-22T05:15:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f57a40a0740 10 client.8472 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f57a40a0740 10 client.8472 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-01-22T05:15:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f57a40a0740 20 client.8472 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f57a40a0740 1 --2- 172.21.15.49:0/589167876 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x24c5b40 0x24c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f57a40a0740 4 client.8472 mds_command: new command op to 8292 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:15:40.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f57a40a0740 1 -- 172.21.15.49:0/589167876 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x23dd740 con 0x24c5b40 2024-01-22T05:15:40.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f5792a00700 1 --2- 172.21.15.49:0/589167876 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x24c5b40 0x24c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f5792a00700 1 --2- 172.21.15.49:0/589167876 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x24c5b40 0x24c5f20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2cb97827d619e4bd server_cookie=66868261779b4618 in_seq=0 out_seq=0 2024-01-22T05:15:40.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f577b400700 10 client.8472 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:40.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f577b400700 1 -- 172.21.15.49:0/589167876 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x23dd740 con 0x24c5b40 2024-01-22T05:15:40.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f577b400700 10 client.8472 handle_command_reply: tid=0 2024-01-22T05:15:40.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.797+0000 7f57a40a0740 1 client.8472 shutdown 2024-01-22T05:15:40.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.801+0000 7f57a40a0740 1 -- 172.21.15.49:0/589167876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24b15c0 msgr2=0x2488ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.801+0000 7f57a40a0740 1 --2- 172.21.15.49:0/589167876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24b15c0 0x2488ef0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f57940bcff0 tx=0x7f577c01c040).stop 2024-01-22T05:15:40.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.801+0000 7f57a40a0740 1 -- 172.21.15.49:0/589167876 shutdown_connections 2024-01-22T05:15:40.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.801+0000 7f57a40a0740 1 --2- 172.21.15.49:0/589167876 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x24c5b40 0x24c5f20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.801+0000 7f57a40a0740 1 --2- 172.21.15.49:0/589167876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b2170 0x249a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.801+0000 7f57a40a0740 1 --2- 172.21.15.49:0/589167876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24b15c0 0x2488ef0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.801+0000 7f577b400700 0 client.8472 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:40.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.801+0000 7f57a40a0740 1 --2- 172.21.15.49:0/589167876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x246d1b0 0x249c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.801+0000 7f57a40a0740 1 -- 172.21.15.49:0/589167876 >> 172.21.15.49:0/589167876 conn(0x224f640 msgr2=0x246ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:40.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.801+0000 7f57a40a0740 1 -- 172.21.15.49:0/589167876 shutdown_connections 2024-01-22T05:15:40.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.801+0000 7f57a40a0740 1 -- 172.21.15.49:0/589167876 wait complete. 2024-01-22T05:15:40.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.801+0000 7f57a40a0740 20 client.8472 trim_cache size 0 max 16384 2024-01-22T05:15:40.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.817+0000 7f57a40a0740 1 Processor -- start 2024-01-22T05:15:40.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.817+0000 7f57a40a0740 1 -- start start 2024-01-22T05:15:40.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f57a40a0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x246d1b0 0x24c1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f57a40a0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b15c0 0x24b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f57a40a0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24b2170 0x24b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f57a40a0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x243c210 con 0x246d1b0 2024-01-22T05:15:40.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f57a40a0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x24b3140 con 0x24b2170 2024-01-22T05:15:40.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f57a40a0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2499a40 con 0x24b15c0 2024-01-22T05:15:40.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f5792a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x246d1b0 0x24c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f5792a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x246d1b0 0x24c1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56910/0 (socket says 172.21.15.49:56910) 2024-01-22T05:15:40.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f5792a00700 1 -- 172.21.15.49:0/1294891854 learned_addr learned my addr 172.21.15.49:0/1294891854 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:40.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f5793400700 1 --2- 172.21.15.49:0/1294891854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24b2170 0x24b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f5792000700 1 --2- 172.21.15.49:0/1294891854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b15c0 0x24b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f5792a00700 1 -- 172.21.15.49:0/1294891854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b15c0 msgr2=0x24b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f5792a00700 1 --2- 172.21.15.49:0/1294891854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b15c0 0x24b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f5792a00700 1 -- 172.21.15.49:0/1294891854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24b2170 msgr2=0x24b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f5792a00700 1 --2- 172.21.15.49:0/1294891854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24b2170 0x24b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f5792a00700 1 -- 172.21.15.49:0/1294891854 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x24c6280 con 0x246d1b0 2024-01-22T05:15:40.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f5792a00700 1 --2- 172.21.15.49:0/1294891854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x246d1b0 0x24c1810 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f5784047e60 tx=0x7f578404e040).ready entity=mon.0 client_cookie=37f9c172fc3080f5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:40.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f5783400700 1 -- 172.21.15.49:0/1294891854 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5784049aa0 con 0x246d1b0 2024-01-22T05:15:40.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f5783400700 1 -- 172.21.15.49:0/1294891854 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5784049d00 con 0x246d1b0 2024-01-22T05:15:40.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f5783400700 1 -- 172.21.15.49:0/1294891854 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5784072610 con 0x246d1b0 2024-01-22T05:15:40.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f57a40a0740 1 -- 172.21.15.49:0/1294891854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x246d1b0 msgr2=0x24c1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.821+0000 7f57a40a0740 1 --2- 172.21.15.49:0/1294891854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x246d1b0 0x24c1810 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f5784047e60 tx=0x7f578404e040).stop 2024-01-22T05:15:40.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.825+0000 7f57a40a0740 1 -- 172.21.15.49:0/1294891854 shutdown_connections 2024-01-22T05:15:40.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.825+0000 7f57a40a0740 1 --2- 172.21.15.49:0/1294891854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x24b2170 0x24b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.825+0000 7f57a40a0740 1 --2- 172.21.15.49:0/1294891854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b15c0 0x24b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.825+0000 7f57a40a0740 1 --2- 172.21.15.49:0/1294891854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x246d1b0 0x24c1810 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.825+0000 7f57a40a0740 1 -- 172.21.15.49:0/1294891854 >> 172.21.15.49:0/1294891854 conn(0x224f640 msgr2=0x24b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:40.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.825+0000 7f57a40a0740 1 -- 172.21.15.49:0/1294891854 shutdown_connections 2024-01-22T05:15:40.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.825+0000 7f57a40a0740 1 -- 172.21.15.49:0/1294891854 wait complete. 2024-01-22T05:15:40.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.825+0000 7f57a40a0740 1 -- start start 2024-01-22T05:15:40.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.825+0000 7f57a40a0740 1 Processor -- start 2024-01-22T05:15:40.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f57a40a0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x246d1b0 0x2517f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f57a40a0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24b15c0 0x24af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f57a40a0740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b2170 0x24af880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f57a40a0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x24c4fe0 con 0x24b15c0 2024-01-22T05:15:40.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f57a40a0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x24cb090 con 0x246d1b0 2024-01-22T05:15:40.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f57a40a0740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x24b6ce0 con 0x24b2170 2024-01-22T05:15:40.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f57a40a0740 10 client.0 ll_register_callbacks cb 0x7f577c010eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f5792000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24b15c0 0x24af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f5792000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24b15c0 0x24af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56918/0 (socket says 172.21.15.49:56918) 2024-01-22T05:15:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f5792000700 1 -- 172.21.15.49:0/2886992501 learned_addr learned my addr 172.21.15.49:0/2886992501 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f5793400700 1 --2- 172.21.15.49:0/2886992501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b2170 0x24af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f5792a00700 1 --2- 172.21.15.49:0/2886992501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x246d1b0 0x2517f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f5792000700 1 -- 172.21.15.49:0/2886992501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b2170 msgr2=0x24af880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f5792000700 1 --2- 172.21.15.49:0/2886992501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b2170 0x24af880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f5792000700 1 -- 172.21.15.49:0/2886992501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x246d1b0 msgr2=0x2517f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f5792000700 1 --2- 172.21.15.49:0/2886992501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x246d1b0 0x2517f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f5792000700 1 -- 172.21.15.49:0/2886992501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5794160790 con 0x24b15c0 2024-01-22T05:15:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f5792000700 1 --2- 172.21.15.49:0/2886992501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24b15c0 0x24af390 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f57940bcff0 tx=0x7f577c020000).ready entity=mon.0 client_cookie=2a02af338470796 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:40.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.829+0000 7f577b400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:15:40.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f577b400700 1 -- 172.21.15.49:0/2886992501 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c01f070 con 0x24b15c0 2024-01-22T05:15:40.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f57a40a0740 1 -- 172.21.15.49:0/2886992501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f578c00eb50 con 0x24b15c0 2024-01-22T05:15:40.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f577b400700 1 -- 172.21.15.49:0/2886992501 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f577c0186c0 con 0x24b15c0 2024-01-22T05:15:40.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f577b400700 1 -- 172.21.15.49:0/2886992501 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f577c025e70 con 0x24b15c0 2024-01-22T05:15:40.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f57a40a0740 10 client.8478 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:40.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f57a40a0740 1 -- 172.21.15.49:0/2886992501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x24b1d00 con 0x24b15c0 2024-01-22T05:15:40.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f577b400700 1 -- 172.21.15.49:0/2886992501 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c00eb50 con 0x24b15c0 2024-01-22T05:15:40.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f577b400700 1 -- 172.21.15.49:0/2886992501 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f577c0352b0 con 0x24b15c0 2024-01-22T05:15:40.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f57a40a0740 10 client.8478 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:40.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f57a40a0740 10 client.8478 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-01-22T05:15:40.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f57a40a0740 20 client.8478 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:40.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f57a40a0740 1 --2- 172.21.15.49:0/2886992501 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x24afd70 0x246d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:40.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f57a40a0740 4 client.8478 mds_command: new command op to 8292 tid=0[{"prefix": "scrub pause"}] 2024-01-22T05:15:40.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f57a40a0740 1 -- 172.21.15.49:0/2886992501 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x22a65d0 con 0x24afd70 2024-01-22T05:15:40.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f5792a00700 1 --2- 172.21.15.49:0/2886992501 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x24afd70 0x246d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f577b400700 10 client.8478 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f5792a00700 1 --2- 172.21.15.49:0/2886992501 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x24afd70 0x246d590 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=eed58c4bd0893917 server_cookie=a93b750258139a0 in_seq=0 out_seq=0 2024-01-22T05:15:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f577b400700 1 -- 172.21.15.49:0/2886992501 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x22a65d0 con 0x24afd70 2024-01-22T05:15:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f577b400700 10 client.8478 handle_command_reply: tid=0 2024-01-22T05:15:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f57a40a0740 1 client.8478 shutdown 2024-01-22T05:15:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f57a40a0740 1 -- 172.21.15.49:0/2886992501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24b15c0 msgr2=0x24af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.833+0000 7f57a40a0740 1 --2- 172.21.15.49:0/2886992501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24b15c0 0x24af390 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f57940bcff0 tx=0x7f577c020000).stop 2024-01-22T05:15:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f57a40a0740 1 -- 172.21.15.49:0/2886992501 shutdown_connections 2024-01-22T05:15:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f57a40a0740 1 --2- 172.21.15.49:0/2886992501 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x24afd70 0x246d590 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f57a40a0740 1 --2- 172.21.15.49:0/2886992501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x24b2170 0x24af880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f57a40a0740 1 --2- 172.21.15.49:0/2886992501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x24b15c0 0x24af390 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f57a40a0740 1 --2- 172.21.15.49:0/2886992501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x246d1b0 0x2517f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f577b400700 0 client.8478 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f57a40a0740 1 -- 172.21.15.49:0/2886992501 >> 172.21.15.49:0/2886992501 conn(0x224f640 msgr2=0x249ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f57a40a0740 1 -- 172.21.15.49:0/2886992501 shutdown_connections 2024-01-22T05:15:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f57a40a0740 1 -- 172.21.15.49:0/2886992501 wait complete. 2024-01-22T05:15:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f57a40a0740 20 client.8478 trim_cache size 0 max 16384 2024-01-22T05:15:40.842 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:15:40.842 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:15:40.842 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:15:40.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f5799c00700 1 -- 172.21.15.49:0/2908012915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f576c05a510 msgr2=0x7f576c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f5799c00700 1 --2- 172.21.15.49:0/2908012915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f576c05a510 0x7f576c05c9d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f57940aa750 tx=0x7f577c009040).stop 2024-01-22T05:15:40.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f5799c00700 1 -- 172.21.15.49:0/2908012915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5774003fa0 msgr2=0x7f579414f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:40.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f5799c00700 1 --2- 172.21.15.49:0/2908012915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5774003fa0 0x7f579414f800 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f5784002a10 tx=0x7f5784007c00).stop 2024-01-22T05:15:40.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f5799c00700 1 -- 172.21.15.49:0/2908012915 shutdown_connections 2024-01-22T05:15:40.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f5799c00700 1 --2- 172.21.15.49:0/2908012915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f576c05a510 0x7f576c05c9d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f5799c00700 1 --2- 172.21.15.49:0/2908012915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57940be830 0x7f5794160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f5799c00700 1 --2- 172.21.15.49:0/2908012915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f579414fcf0 0x7f57940be340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f5799c00700 1 --2- 172.21.15.49:0/2908012915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5774003fa0 0x7f579414f800 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:40.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f5799c00700 1 -- 172.21.15.49:0/2908012915 >> 172.21.15.49:0/2908012915 conn(0x7f5794065f30 msgr2=0x7f57940bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:40.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f5799c00700 1 -- 172.21.15.49:0/2908012915 shutdown_connections 2024-01-22T05:15:40.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:40.837+0000 7f5799c00700 1 -- 172.21.15.49:0/2908012915 wait complete. 2024-01-22T05:15:40.865 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub status 2024-01-22T05:15:41.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.029+0000 7fbbf9600700 1 Processor -- start 2024-01-22T05:15:41.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.029+0000 7fbbf9600700 1 -- start start 2024-01-22T05:15:41.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.033+0000 7fbbf9600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbbf40bc7b0 0x7fbbf414d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.033+0000 7fbbf9600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbbf4157de0 0x7fbbf414dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.033+0000 7fbbf9600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf4067a90 con 0x7fbbf40bc3d0 2024-01-22T05:15:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.033+0000 7fbbf9600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf40c1160 con 0x7fbbf40bc7b0 2024-01-22T05:15:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.033+0000 7fbbf9600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf4067d70 con 0x7fbbf4157de0 2024-01-22T05:15:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.033+0000 7fbbf2000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbbf40bc7b0 0x7fbbf414d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.033+0000 7fbbf2000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbbf40bc7b0 0x7fbbf414d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56934/0 (socket says 172.21.15.49:56934) 2024-01-22T05:15:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.033+0000 7fbbf2000700 1 -- 172.21.15.49:0/2904818557 learned_addr learned my addr 172.21.15.49:0/2904818557 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.033+0000 7fbbf3400700 1 --2- 172.21.15.49:0/2904818557 >> v2:172.21.15.110:3300/0 conn(0x7fbbf4157de0 0x7fbbf414dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.033+0000 7fbbf2a00700 1 --1- 172.21.15.49:0/2904818557 >> v1:172.21.15.110:6789/0 conn(0x7fbbf40bc3d0 0x7fbbf41576d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:59614/0 (socket says 172.21.15.49:59614) 2024-01-22T05:15:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.033+0000 7fbbf3400700 1 -- 172.21.15.49:0/2904818557 >> v2:172.21.15.49:3300/0 conn(0x7fbbf40bc7b0 msgr2=0x7fbbf414d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.033+0000 7fbbf3400700 1 --2- 172.21.15.49:0/2904818557 >> v2:172.21.15.49:3300/0 conn(0x7fbbf40bc7b0 0x7fbbf414d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.033+0000 7fbbf3400700 1 -- 172.21.15.49:0/2904818557 >> v1:172.21.15.110:6789/0 conn(0x7fbbf40bc3d0 legacy=0x7fbbf41576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.033+0000 7fbbf3400700 1 -- 172.21.15.49:0/2904818557 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40bcc60 con 0x7fbbf4157de0 2024-01-22T05:15:41.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.037+0000 7fbbf3400700 1 --2- 172.21.15.49:0/2904818557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf4157de0 0x7fbbf414dd10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fbbf4067ce0 tx=0x7fbbec009780).ready entity=mon.1 client_cookie=d49ca2bb1c9025a1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:41.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.037+0000 7fbbf1600700 1 -- 172.21.15.49:0/2904818557 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec00e070 con 0x7fbbf4157de0 2024-01-22T05:15:41.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.037+0000 7fbbf1600700 1 -- 172.21.15.49:0/2904818557 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec00bb60 con 0x7fbbf4157de0 2024-01-22T05:15:41.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.037+0000 7fbbf1600700 1 -- 172.21.15.49:0/2904818557 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec012410 con 0x7fbbf4157de0 2024-01-22T05:15:41.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.037+0000 7fbbf9600700 1 -- 172.21.15.49:0/2904818557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf4157de0 msgr2=0x7fbbf414dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.037+0000 7fbbf9600700 1 --2- 172.21.15.49:0/2904818557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf4157de0 0x7fbbf414dd10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fbbf4067ce0 tx=0x7fbbec009780).stop 2024-01-22T05:15:41.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.037+0000 7fbbf9600700 1 -- 172.21.15.49:0/2904818557 shutdown_connections 2024-01-22T05:15:41.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.037+0000 7fbbf9600700 1 --2- 172.21.15.49:0/2904818557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf4157de0 0x7fbbf414dd10 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.037+0000 7fbbf9600700 1 --2- 172.21.15.49:0/2904818557 >> v2:172.21.15.49:3300/0 conn(0x7fbbf40bc7b0 0x7fbbf414d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.037+0000 7fbbf9600700 1 -- 172.21.15.49:0/2904818557 >> 172.21.15.49:0/2904818557 conn(0x7fbbf40c6560 msgr2=0x7fbbf40c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:41.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.037+0000 7fbbf9600700 1 -- 172.21.15.49:0/2904818557 shutdown_connections 2024-01-22T05:15:41.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.037+0000 7fbbf9600700 1 -- 172.21.15.49:0/2904818557 wait complete. 2024-01-22T05:15:41.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.041+0000 7fbbf9600700 1 Processor -- start 2024-01-22T05:15:41.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.041+0000 7fbbf9600700 1 -- start start 2024-01-22T05:15:41.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.041+0000 7fbbf9600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf40bc3d0 0x7fbbf40a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.041+0000 7fbbf9600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbf40bc7b0 0x7fbbf4151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.041+0000 7fbbf9600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf4157de0 0x7fbbf40c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.041+0000 7fbbf9600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40a86d0 con 0x7fbbf40bc3d0 2024-01-22T05:15:41.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.041+0000 7fbbf9600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf4152f00 con 0x7fbbf4157de0 2024-01-22T05:15:41.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.041+0000 7fbbf9600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40aade0 con 0x7fbbf40bc7b0 2024-01-22T05:15:41.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbf2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf40bc3d0 0x7fbbf40a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbf2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf40bc3d0 0x7fbbf40a81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56936/0 (socket says 172.21.15.49:56936) 2024-01-22T05:15:41.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbf2a00700 1 -- 172.21.15.49:0/2986847472 learned_addr learned my addr 172.21.15.49:0/2986847472 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:41.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbf3400700 1 --2- 172.21.15.49:0/2986847472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf4157de0 0x7fbbf40c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbf2000700 1 --2- 172.21.15.49:0/2986847472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbf40bc7b0 0x7fbbf4151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbf2a00700 1 -- 172.21.15.49:0/2986847472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbf40bc7b0 msgr2=0x7fbbf4151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbf2a00700 1 --2- 172.21.15.49:0/2986847472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbf40bc7b0 0x7fbbf4151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbf2a00700 1 -- 172.21.15.49:0/2986847472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf4157de0 msgr2=0x7fbbf40c4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbf2a00700 1 --2- 172.21.15.49:0/2986847472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf4157de0 0x7fbbf40c4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbf2a00700 1 -- 172.21.15.49:0/2986847472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec009a20 con 0x7fbbf40bc3d0 2024-01-22T05:15:41.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbf2a00700 1 --2- 172.21.15.49:0/2986847472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf40bc3d0 0x7fbbf40a81e0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fbbe4001eb0 tx=0x7fbbe4007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:41.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbea000700 1 -- 172.21.15.49:0/2986847472 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40070d0 con 0x7fbbf40bc3d0 2024-01-22T05:15:41.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbf9600700 1 -- 172.21.15.49:0/2986847472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf40ab0c0 con 0x7fbbf40bc3d0 2024-01-22T05:15:41.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbea000700 1 -- 172.21.15.49:0/2986847472 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4007230 con 0x7fbbf40bc3d0 2024-01-22T05:15:41.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbea000700 1 -- 172.21.15.49:0/2986847472 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40075b0 con 0x7fbbf40bc3d0 2024-01-22T05:15:41.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.045+0000 7fbbf9600700 1 -- 172.21.15.49:0/2986847472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf41591f0 con 0x7fbbf40bc3d0 2024-01-22T05:15:41.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.049+0000 7fbbea000700 1 -- 172.21.15.49:0/2986847472 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbbe40058f0 con 0x7fbbf40bc3d0 2024-01-22T05:15:41.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.049+0000 7fbbea000700 1 --2- 172.21.15.49:0/2986847472 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbcc05a510 0x7fbbcc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.049+0000 7fbbea000700 1 -- 172.21.15.49:0/2986847472 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbbe4073fa0 con 0x7fbbf40bc3d0 2024-01-22T05:15:41.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.049+0000 7fbbf2000700 1 --2- 172.21.15.49:0/2986847472 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbcc05a510 0x7fbbcc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.053+0000 7fbbf2000700 1 --2- 172.21.15.49:0/2986847472 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbcc05a510 0x7fbbcc05c9d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fbbf40c60e0 tx=0x7fbbdc0090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:41.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.053+0000 7fbc039dc740 1 Processor -- start 2024-01-22T05:15:41.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.053+0000 7fbc039dc740 1 -- start start 2024-01-22T05:15:41.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbc039dc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xd1c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbc039dc740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23570 0xd239f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbc039dc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23ee0 0xd024f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbc039dc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xc34540 con 0xd1c4d0 2024-01-22T05:15:41.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbc039dc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xbf7e90 con 0xd23ee0 2024-01-22T05:15:41.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbc039dc740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xbfdd90 con 0xd23570 2024-01-22T05:15:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbbf2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xd1c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbbf2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xd1c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56940/0 (socket says 172.21.15.49:56940) 2024-01-22T05:15:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbbf2a00700 1 -- 172.21.15.49:0/1024610619 learned_addr learned my addr 172.21.15.49:0/1024610619 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbbf2000700 1 --2- 172.21.15.49:0/1024610619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23570 0xd239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbbf3400700 1 --2- 172.21.15.49:0/1024610619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23ee0 0xd024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbbf2a00700 1 -- 172.21.15.49:0/1024610619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23570 msgr2=0xd239f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbbf2a00700 1 --2- 172.21.15.49:0/1024610619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23570 0xd239f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbbf2a00700 1 -- 172.21.15.49:0/1024610619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23ee0 msgr2=0xd024f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbbf2a00700 1 --2- 172.21.15.49:0/1024610619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23ee0 0xd024f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbbf2a00700 1 -- 172.21.15.49:0/1024610619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc624c0 con 0xd1c4d0 2024-01-22T05:15:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbbf2a00700 1 --2- 172.21.15.49:0/1024610619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xd1c8b0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7fbbe4000fd0 tx=0x7fbbe400f000).ready entity=mon.0 client_cookie=de3053b2f4d03f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:41.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbbe2600700 1 -- 172.21.15.49:0/1024610619 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe404b240 con 0xd1c4d0 2024-01-22T05:15:41.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbbe2600700 1 -- 172.21.15.49:0/1024610619 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4049640 con 0xd1c4d0 2024-01-22T05:15:41.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbbe2600700 1 -- 172.21.15.49:0/1024610619 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4005c20 con 0xd1c4d0 2024-01-22T05:15:41.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbc039dc740 1 -- 172.21.15.49:0/1024610619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 msgr2=0xd1c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbc039dc740 1 --2- 172.21.15.49:0/1024610619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xd1c8b0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7fbbe4000fd0 tx=0x7fbbe400f000).stop 2024-01-22T05:15:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbc039dc740 1 -- 172.21.15.49:0/1024610619 shutdown_connections 2024-01-22T05:15:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.057+0000 7fbc039dc740 1 --2- 172.21.15.49:0/1024610619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23ee0 0xd024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.061+0000 7fbc039dc740 1 --2- 172.21.15.49:0/1024610619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23570 0xd239f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.061+0000 7fbc039dc740 1 --2- 172.21.15.49:0/1024610619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xd1c8b0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.061+0000 7fbc039dc740 1 -- 172.21.15.49:0/1024610619 >> 172.21.15.49:0/1024610619 conn(0xab6680 msgr2=0xcd5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:41.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.061+0000 7fbc039dc740 1 -- 172.21.15.49:0/1024610619 shutdown_connections 2024-01-22T05:15:41.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.061+0000 7fbc039dc740 1 -- 172.21.15.49:0/1024610619 wait complete. 2024-01-22T05:15:41.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.061+0000 7fbc039dc740 1 -- start start 2024-01-22T05:15:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.061+0000 7fbc039dc740 1 Processor -- start 2024-01-22T05:15:41.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbc039dc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xcf60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbc039dc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23570 0xcf8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbc039dc740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 0xcf8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbc039dc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xcd51c0 con 0xd1c4d0 2024-01-22T05:15:41.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbc039dc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xcf7bb0 con 0xd23570 2024-01-22T05:15:41.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbc039dc740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xcd39f0 con 0xd23ee0 2024-01-22T05:15:41.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbc039dc740 10 client.0 ll_register_callbacks cb 0xc8e5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:41.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbbf2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xcf60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbbf2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xcf60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56946/0 (socket says 172.21.15.49:56946) 2024-01-22T05:15:41.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbbf2a00700 1 -- 172.21.15.49:0/2873105956 learned_addr learned my addr 172.21.15.49:0/2873105956 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:41.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbbf3400700 1 --2- 172.21.15.49:0/2873105956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 0xcf8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbbf2000700 1 --2- 172.21.15.49:0/2873105956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23570 0xcf8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbbf2a00700 1 -- 172.21.15.49:0/2873105956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 msgr2=0xcf8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:41.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbbf2a00700 1 --2- 172.21.15.49:0/2873105956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 0xcf8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbbf2a00700 1 -- 172.21.15.49:0/2873105956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23570 msgr2=0xcf8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbbf2a00700 1 --2- 172.21.15.49:0/2873105956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23570 0xcf8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbbf2a00700 1 -- 172.21.15.49:0/2873105956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf41591f0 con 0xd1c4d0 2024-01-22T05:15:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbbf2000700 1 --2- 172.21.15.49:0/2873105956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23570 0xcf8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:15:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbbf2a00700 1 --2- 172.21.15.49:0/2873105956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xcf60b0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7fbbe4007fd0 tx=0x7fbbe4057000).ready entity=mon.0 client_cookie=d04028fb0787afa8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbbdaa00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:15:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbbdaa00700 1 -- 172.21.15.49:0/2873105956 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4010510 con 0xd1c4d0 2024-01-22T05:15:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbbdaa00700 1 -- 172.21.15.49:0/2873105956 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbbe404a790 con 0xd1c4d0 2024-01-22T05:15:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.065+0000 7fbc039dc740 1 -- 172.21.15.49:0/2873105956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xc4e230 con 0xd1c4d0 2024-01-22T05:15:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbbdaa00700 1 -- 172.21.15.49:0/2873105956 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbe4047090 con 0xd1c4d0 2024-01-22T05:15:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbc039dc740 10 client.8490 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbc039dc740 1 -- 172.21.15.49:0/2873105956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0xc517c0 con 0xd1c4d0 2024-01-22T05:15:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbbdaa00700 1 -- 172.21.15.49:0/2873105956 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xc4e230 con 0xd1c4d0 2024-01-22T05:15:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbbdaa00700 1 -- 172.21.15.49:0/2873105956 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbbe40471f0 con 0xd1c4d0 2024-01-22T05:15:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbc039dc740 10 client.8490 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:41.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbc039dc740 10 client.8490 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-01-22T05:15:41.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbc039dc740 20 client.8490 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:41.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2873105956 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xd2d690 0xd2da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbc039dc740 4 client.8490 mds_command: new command op to 8292 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:15:41.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbc039dc740 1 -- 172.21.15.49:0/2873105956 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xc44780 con 0xd2d690 2024-01-22T05:15:41.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbbf2000700 1 --2- 172.21.15.49:0/2873105956 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xd2d690 0xd2da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbbdaa00700 10 client.8490 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:41.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbbf2000700 1 --2- 172.21.15.49:0/2873105956 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xd2d690 0xd2da70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=805f06f5bc096f7 server_cookie=3518b7787f086c18 in_seq=0 out_seq=0 2024-01-22T05:15:41.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbbdaa00700 1 -- 172.21.15.49:0/2873105956 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xc44780 con 0xd2d690 2024-01-22T05:15:41.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbbdaa00700 10 client.8490 handle_command_reply: tid=0 2024-01-22T05:15:41.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.069+0000 7fbc039dc740 1 client.8490 shutdown 2024-01-22T05:15:41.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.073+0000 7fbc039dc740 1 -- 172.21.15.49:0/2873105956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 msgr2=0xcf60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.073+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2873105956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xcf60b0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7fbbe4007fd0 tx=0x7fbbe4057000).stop 2024-01-22T05:15:41.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.073+0000 7fbc039dc740 1 -- 172.21.15.49:0/2873105956 shutdown_connections 2024-01-22T05:15:41.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.073+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2873105956 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xd2d690 0xd2da70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.073+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2873105956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 0xcf8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.073+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2873105956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23570 0xcf8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.073+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2873105956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xcf60b0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.073+0000 7fbbdaa00700 0 client.8490 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:41.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.073+0000 7fbc039dc740 1 -- 172.21.15.49:0/2873105956 >> 172.21.15.49:0/2873105956 conn(0xab6680 msgr2=0xd03bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:41.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.073+0000 7fbc039dc740 1 -- 172.21.15.49:0/2873105956 shutdown_connections 2024-01-22T05:15:41.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.073+0000 7fbc039dc740 1 -- 172.21.15.49:0/2873105956 wait complete. 2024-01-22T05:15:41.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.073+0000 7fbc039dc740 20 client.8490 trim_cache size 0 max 16384 2024-01-22T05:15:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.093+0000 7fbc039dc740 1 Processor -- start 2024-01-22T05:15:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.093+0000 7fbc039dc740 1 -- start start 2024-01-22T05:15:41.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.093+0000 7fbc039dc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xd01380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.093+0000 7fbc039dc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23570 0xcf81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.093+0000 7fbc039dc740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 0xcd5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.093+0000 7fbc039dc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xcfcb30 con 0xd1c4d0 2024-01-22T05:15:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.093+0000 7fbc039dc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xc0fe00 con 0xd23570 2024-01-22T05:15:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.093+0000 7fbc039dc740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xcf7bb0 con 0xd23ee0 2024-01-22T05:15:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbf2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xd01380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbf3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 0xcd5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbf2000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23570 0xcf81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbf3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 0xcd5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:46366/0 (socket says 172.21.15.49:46366) 2024-01-22T05:15:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbf3400700 1 -- 172.21.15.49:0/2683858766 learned_addr learned my addr 172.21.15.49:0/2683858766 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbf2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xd01380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56962/0 (socket says 172.21.15.49:56962) 2024-01-22T05:15:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbf2a00700 1 -- 172.21.15.49:0/2683858766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 msgr2=0xcd5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbf2a00700 1 --2- 172.21.15.49:0/2683858766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 0xcd5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbf2a00700 1 -- 172.21.15.49:0/2683858766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23570 msgr2=0xcf81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbf2a00700 1 --2- 172.21.15.49:0/2683858766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23570 0xcf81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbf2a00700 1 -- 172.21.15.49:0/2683858766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf4159770 con 0xd1c4d0 2024-01-22T05:15:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbf2000700 1 --2- 172.21.15.49:0/2683858766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23570 0xcf81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:15:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbf2a00700 1 --2- 172.21.15.49:0/2683858766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xd01380 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7fbbe404b1d0 tx=0x7fbbe405c040).ready entity=mon.0 client_cookie=9b796c9313ab4829 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbe3000700 1 -- 172.21.15.49:0/2683858766 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4010510 con 0xd1c4d0 2024-01-22T05:15:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbe3000700 1 -- 172.21.15.49:0/2683858766 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe404f070 con 0xd1c4d0 2024-01-22T05:15:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbbe3000700 1 -- 172.21.15.49:0/2683858766 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe404ac00 con 0xd1c4d0 2024-01-22T05:15:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbc039dc740 1 -- 172.21.15.49:0/2683858766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 msgr2=0xd01380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.097+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2683858766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xd01380 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7fbbe404b1d0 tx=0x7fbbe405c040).stop 2024-01-22T05:15:41.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.101+0000 7fbc039dc740 1 -- 172.21.15.49:0/2683858766 shutdown_connections 2024-01-22T05:15:41.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.101+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2683858766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 0xcd5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.101+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2683858766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd23570 0xcf81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.101+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2683858766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd1c4d0 0xd01380 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.101+0000 7fbc039dc740 1 -- 172.21.15.49:0/2683858766 >> 172.21.15.49:0/2683858766 conn(0xab6680 msgr2=0xd1bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:41.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.101+0000 7fbc039dc740 1 -- 172.21.15.49:0/2683858766 shutdown_connections 2024-01-22T05:15:41.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.101+0000 7fbc039dc740 1 -- 172.21.15.49:0/2683858766 wait complete. 2024-01-22T05:15:41.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.101+0000 7fbc039dc740 1 -- start start 2024-01-22T05:15:41.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.101+0000 7fbc039dc740 1 Processor -- start 2024-01-22T05:15:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbc039dc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd1c4d0 0xd17c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbc039dc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd23570 0xcf6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbc039dc740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 0xcd6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbc039dc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xcd6530 con 0xd23570 2024-01-22T05:15:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbc039dc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xd009e0 con 0xd1c4d0 2024-01-22T05:15:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbc039dc740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xcd6a50 con 0xd23ee0 2024-01-22T05:15:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbc039dc740 10 client.0 ll_register_callbacks cb 0x7fbbdc009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbbf2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd23570 0xcf6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbbf2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd23570 0xcf6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56972/0 (socket says 172.21.15.49:56972) 2024-01-22T05:15:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbbf2000700 1 -- 172.21.15.49:0/2310182073 learned_addr learned my addr 172.21.15.49:0/2310182073 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbbf3400700 1 --2- 172.21.15.49:0/2310182073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 0xcd6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbbf2a00700 1 --2- 172.21.15.49:0/2310182073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd1c4d0 0xd17c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbbf2000700 1 -- 172.21.15.49:0/2310182073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 msgr2=0xcd6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbbf2000700 1 --2- 172.21.15.49:0/2310182073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 0xcd6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbbf2000700 1 -- 172.21.15.49:0/2310182073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd1c4d0 msgr2=0xd17c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbbf2000700 1 --2- 172.21.15.49:0/2310182073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd1c4d0 0xd17c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbbf2000700 1 -- 172.21.15.49:0/2310182073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc011d80 con 0xd23570 2024-01-22T05:15:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbbf3400700 1 --2- 172.21.15.49:0/2310182073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 0xcd6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:15:41.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbbf2000700 1 --2- 172.21.15.49:0/2310182073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd23570 0xcf6b30 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7fbbf40bb7c0 tx=0x7fbbdc027280).ready entity=mon.0 client_cookie=8e71a6cfd53905c8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:41.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbbdaa00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:15:41.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbbdaa00700 1 -- 172.21.15.49:0/2310182073 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc02a650 con 0xd23570 2024-01-22T05:15:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbc039dc740 1 -- 172.21.15.49:0/2310182073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbbe4049640 con 0xd23570 2024-01-22T05:15:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.105+0000 7fbbdaa00700 1 -- 172.21.15.49:0/2310182073 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbbdc02a7b0 con 0xd23570 2024-01-22T05:15:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbbdaa00700 1 -- 172.21.15.49:0/2310182073 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbdc02ab80 con 0xd23570 2024-01-22T05:15:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 10 client.8496 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 1 -- 172.21.15.49:0/2310182073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0xc517c0 con 0xd23570 2024-01-22T05:15:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbbdaa00700 1 -- 172.21.15.49:0/2310182073 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4049640 con 0xd23570 2024-01-22T05:15:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbbdaa00700 1 -- 172.21.15.49:0/2310182073 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbbdc02ace0 con 0xd23570 2024-01-22T05:15:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 10 client.8496 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 10 client.8496 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-01-22T05:15:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 20 client.8496 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2310182073 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xcffbe0 0xcffff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 4 client.8496 mds_command: new command op to 8292 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:15:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 1 -- 172.21.15.49:0/2310182073 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xb0d610 con 0xcffbe0 2024-01-22T05:15:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbbf2a00700 1 --2- 172.21.15.49:0/2310182073 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xcffbe0 0xcffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbbf2a00700 1 --2- 172.21.15.49:0/2310182073 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xcffbe0 0xcffff0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fc4621254f3f9a3f server_cookie=7d32629ef909a7a0 in_seq=0 out_seq=0 2024-01-22T05:15:41.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbbdaa00700 10 client.8496 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:41.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbbdaa00700 1 -- 172.21.15.49:0/2310182073 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0xb0d610 con 0xcffbe0 2024-01-22T05:15:41.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbbdaa00700 10 client.8496 handle_command_reply: tid=0 2024-01-22T05:15:41.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 1 client.8496 shutdown 2024-01-22T05:15:41.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 1 -- 172.21.15.49:0/2310182073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd23570 msgr2=0xcf6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2310182073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd23570 0xcf6b30 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7fbbf40bb7c0 tx=0x7fbbdc027280).stop 2024-01-22T05:15:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 1 -- 172.21.15.49:0/2310182073 shutdown_connections 2024-01-22T05:15:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2310182073 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xcffbe0 0xcffff0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2310182073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xd23ee0 0xcd6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2310182073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xd23570 0xcf6b30 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbbdaa00700 0 client.8496 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.109+0000 7fbc039dc740 1 --2- 172.21.15.49:0/2310182073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xd1c4d0 0xd17c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbc039dc740 1 -- 172.21.15.49:0/2310182073 >> 172.21.15.49:0/2310182073 conn(0xab6680 msgr2=0xd33aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:41.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbc039dc740 1 -- 172.21.15.49:0/2310182073 shutdown_connections 2024-01-22T05:15:41.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbc039dc740 1 -- 172.21.15.49:0/2310182073 wait complete. 2024-01-22T05:15:41.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbc039dc740 20 client.8496 trim_cache size 0 max 16384 2024-01-22T05:15:41.116 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:15:41.116 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-01-22T05:15:41.116 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-01-22T05:15:41.117 INFO:teuthology.orchestra.run.smithi049.stdout: "0f8d22fb-daca-4dd1-a1c1-d33fd38df60d": { 2024-01-22T05:15:41.117 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/scrub_control_test_path", 2024-01-22T05:15:41.117 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "0f8d22fb-daca-4dd1-a1c1-d33fd38df60d", 2024-01-22T05:15:41.117 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive" 2024-01-22T05:15:41.117 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:15:41.117 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:15:41.117 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:15:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbbf9600700 1 -- 172.21.15.49:0/2986847472 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbcc05a510 msgr2=0x7fbbcc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbbf9600700 1 --2- 172.21.15.49:0/2986847472 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbcc05a510 0x7fbbcc05c9d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fbbf40c60e0 tx=0x7fbbdc0090f0).stop 2024-01-22T05:15:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbbf9600700 1 -- 172.21.15.49:0/2986847472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf40bc3d0 msgr2=0x7fbbf40a81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbbf9600700 1 --2- 172.21.15.49:0/2986847472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf40bc3d0 0x7fbbf40a81e0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fbbe4001eb0 tx=0x7fbbe4007df0).stop 2024-01-22T05:15:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbbf9600700 1 -- 172.21.15.49:0/2986847472 shutdown_connections 2024-01-22T05:15:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbbf9600700 1 --2- 172.21.15.49:0/2986847472 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbcc05a510 0x7fbbcc05c9d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbbf9600700 1 --2- 172.21.15.49:0/2986847472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf4157de0 0x7fbbf40c4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbbf9600700 1 --2- 172.21.15.49:0/2986847472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbf40bc7b0 0x7fbbf4151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbbf9600700 1 --2- 172.21.15.49:0/2986847472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf40bc3d0 0x7fbbf40a81e0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbbf9600700 1 -- 172.21.15.49:0/2986847472 >> 172.21.15.49:0/2986847472 conn(0x7fbbf40c6560 msgr2=0x7fbbf40a8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:41.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbbf9600700 1 -- 172.21.15.49:0/2986847472 shutdown_connections 2024-01-22T05:15:41.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.113+0000 7fbbf9600700 1 -- 172.21.15.49:0/2986847472 wait complete. 2024-01-22T05:15:41.140 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:15:41.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.313+0000 7f471a600700 1 Processor -- start 2024-01-22T05:15:41.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.313+0000 7f471a600700 1 -- start start 2024-01-22T05:15:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f471a600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4714155d20 0x7f4714065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f471a600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f47140a8e50 0x7f47140c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f471a600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47140c1a40 con 0x7f4714066070 2024-01-22T05:15:41.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f471a600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4714159310 con 0x7f4714155d20 2024-01-22T05:15:41.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f471a600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47140c13f0 con 0x7f47140a8e50 2024-01-22T05:15:41.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f4713400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4714155d20 0x7f4714065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f4712a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4714066070 0x7f47140a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48168/0 (socket says 172.21.15.49:48168) 2024-01-22T05:15:41.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f4712a00700 1 -- 172.21.15.49:0/851310575 learned_addr learned my addr 172.21.15.49:0/851310575 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:41.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f4713e00700 1 --2- 172.21.15.49:0/851310575 >> v2:172.21.15.110:3300/0 conn(0x7f47140a8e50 0x7f47140c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f4713400700 1 -- 172.21.15.49:0/851310575 >> v2:172.21.15.110:3300/0 conn(0x7f47140a8e50 msgr2=0x7f47140c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:41.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f4713400700 1 --2- 172.21.15.49:0/851310575 >> v2:172.21.15.110:3300/0 conn(0x7f47140a8e50 0x7f47140c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f4713400700 1 -- 172.21.15.49:0/851310575 >> v1:172.21.15.49:6789/0 conn(0x7f4714066070 legacy=0x7f47140a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f4713400700 1 -- 172.21.15.49:0/851310575 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47140c16d0 con 0x7f4714155d20 2024-01-22T05:15:41.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f4713400700 1 --2- 172.21.15.49:0/851310575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4714155d20 0x7f4714065b80 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f47140c19b0 tx=0x7f4704009060).ready entity=mon.0 client_cookie=35481c62cd5f9792 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:41.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f4712000700 1 -- 172.21.15.49:0/851310575 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470400f510 con 0x7f4714155d20 2024-01-22T05:15:41.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f4712000700 1 -- 172.21.15.49:0/851310575 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470400f670 con 0x7f4714155d20 2024-01-22T05:15:41.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.317+0000 7f4712000700 1 -- 172.21.15.49:0/851310575 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470400f9f0 con 0x7f4714155d20 2024-01-22T05:15:41.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.321+0000 7f471a600700 1 -- 172.21.15.49:0/851310575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4714155d20 msgr2=0x7f4714065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.321+0000 7f471a600700 1 --2- 172.21.15.49:0/851310575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4714155d20 0x7f4714065b80 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f47140c19b0 tx=0x7f4704009060).stop 2024-01-22T05:15:41.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.321+0000 7f471a600700 1 -- 172.21.15.49:0/851310575 shutdown_connections 2024-01-22T05:15:41.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.321+0000 7f471a600700 1 --2- 172.21.15.49:0/851310575 >> v2:172.21.15.110:3300/0 conn(0x7f47140a8e50 0x7f47140c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.321+0000 7f471a600700 1 --2- 172.21.15.49:0/851310575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4714155d20 0x7f4714065b80 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.321+0000 7f471a600700 1 -- 172.21.15.49:0/851310575 >> 172.21.15.49:0/851310575 conn(0x7f47140c6540 msgr2=0x7f47140c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:41.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.321+0000 7f471a600700 1 -- 172.21.15.49:0/851310575 shutdown_connections 2024-01-22T05:15:41.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.321+0000 7f471a600700 1 -- 172.21.15.49:0/851310575 wait complete. 2024-01-22T05:15:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.325+0000 7f471a600700 1 Processor -- start 2024-01-22T05:15:41.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.325+0000 7f471a600700 1 -- start start 2024-01-22T05:15:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.325+0000 7f471a600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4714066070 0x7f47140bf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.325+0000 7f471a600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140a8e50 0x7f47140be720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.325+0000 7f471a600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4714155d20 0x7f4714157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.325+0000 7f471a600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471416bf60 con 0x7f4714066070 2024-01-22T05:15:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.325+0000 7f471a600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471416c240 con 0x7f4714155d20 2024-01-22T05:15:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.325+0000 7f471a600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471416c520 con 0x7f47140a8e50 2024-01-22T05:15:41.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f4713400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4714066070 0x7f47140bf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f4713400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4714066070 0x7f47140bf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56990/0 (socket says 172.21.15.49:56990) 2024-01-22T05:15:41.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f4713400700 1 -- 172.21.15.49:0/4245219052 learned_addr learned my addr 172.21.15.49:0/4245219052 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:41.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f4712a00700 1 --2- 172.21.15.49:0/4245219052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140a8e50 0x7f47140be720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f4713e00700 1 --2- 172.21.15.49:0/4245219052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4714155d20 0x7f4714157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f4713400700 1 -- 172.21.15.49:0/4245219052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140a8e50 msgr2=0x7f47140be720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f4713400700 1 --2- 172.21.15.49:0/4245219052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140a8e50 0x7f47140be720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f4713400700 1 -- 172.21.15.49:0/4245219052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4714155d20 msgr2=0x7f4714157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f4713400700 1 --2- 172.21.15.49:0/4245219052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4714155d20 0x7f4714157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f4713400700 1 -- 172.21.15.49:0/4245219052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47040092a0 con 0x7f4714066070 2024-01-22T05:15:41.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f4713400700 1 --2- 172.21.15.49:0/4245219052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4714066070 0x7f47140bf6f0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f4704009dd0 tx=0x7f4704017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:41.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f470aa00700 1 -- 172.21.15.49:0/4245219052 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470400f7e0 con 0x7f4714066070 2024-01-22T05:15:41.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f470aa00700 1 -- 172.21.15.49:0/4245219052 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470400f940 con 0x7f4714066070 2024-01-22T05:15:41.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f471a600700 1 -- 172.21.15.49:0/4245219052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f471416c800 con 0x7f4714066070 2024-01-22T05:15:41.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f470aa00700 1 -- 172.21.15.49:0/4245219052 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470401b690 con 0x7f4714066070 2024-01-22T05:15:41.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.329+0000 7f471a600700 1 -- 172.21.15.49:0/4245219052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47140bec10 con 0x7f4714066070 2024-01-22T05:15:41.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.333+0000 7f471a600700 1 -- 172.21.15.49:0/4245219052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4714168960 con 0x7f4714066070 2024-01-22T05:15:41.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.333+0000 7f470aa00700 1 -- 172.21.15.49:0/4245219052 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f470401ba40 con 0x7f4714066070 2024-01-22T05:15:41.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.333+0000 7f470aa00700 1 --2- 172.21.15.49:0/4245219052 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f46ec05a510 0x7f46ec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.333+0000 7f470aa00700 1 -- 172.21.15.49:0/4245219052 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4704076280 con 0x7f4714066070 2024-01-22T05:15:41.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.333+0000 7f4712a00700 1 --2- 172.21.15.49:0/4245219052 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f46ec05a510 0x7f46ec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.337+0000 7f4712a00700 1 --2- 172.21.15.49:0/4245219052 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f46ec05a510 0x7f46ec05c9d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f47140bd690 tx=0x7f46fc007d30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:41.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.341+0000 7f470aa00700 1 -- 172.21.15.49:0/4245219052 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4704049830 con 0x7f4714066070 2024-01-22T05:15:41.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.541+0000 7f471a600700 1 -- 172.21.15.49:0/4245219052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f471416cc80 con 0x7f4714066070 2024-01-22T05:15:41.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.545+0000 7f470aa00700 1 -- 172.21.15.49:0/4245219052 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4503 (secure 0 0 0) 0x7f470404ce50 con 0x7f4714066070 2024-01-22T05:15:41.548 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:41.548 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:14:58.925818+0000","modified":"2024-01-22T05:15:02.323695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8292":{"gid":8292,"name":"a","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3036262557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3036262557},{"type":"v1","addr":"172.21.15.49:6837","nonce":3036262557}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-22T05:15:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.549+0000 7f471a600700 1 -- 172.21.15.49:0/4245219052 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f46ec05a510 msgr2=0x7f46ec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.549+0000 7f471a600700 1 --2- 172.21.15.49:0/4245219052 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f46ec05a510 0x7f46ec05c9d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f47140bd690 tx=0x7f46fc007d30).stop 2024-01-22T05:15:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.549+0000 7f471a600700 1 -- 172.21.15.49:0/4245219052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4714066070 msgr2=0x7f47140bf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.549+0000 7f471a600700 1 --2- 172.21.15.49:0/4245219052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4714066070 0x7f47140bf6f0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f4704009dd0 tx=0x7f4704017000).stop 2024-01-22T05:15:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.549+0000 7f471a600700 1 -- 172.21.15.49:0/4245219052 shutdown_connections 2024-01-22T05:15:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.549+0000 7f471a600700 1 --2- 172.21.15.49:0/4245219052 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f46ec05a510 0x7f46ec05c9d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.549+0000 7f471a600700 1 --2- 172.21.15.49:0/4245219052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4714155d20 0x7f4714157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.549+0000 7f471a600700 1 --2- 172.21.15.49:0/4245219052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140a8e50 0x7f47140be720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.549+0000 7f471a600700 1 --2- 172.21.15.49:0/4245219052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4714066070 0x7f47140bf6f0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.549+0000 7f471a600700 1 -- 172.21.15.49:0/4245219052 >> 172.21.15.49:0/4245219052 conn(0x7f47140c6540 msgr2=0x7f47141537d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:41.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.549+0000 7f471a600700 1 -- 172.21.15.49:0/4245219052 shutdown_connections 2024-01-22T05:15:41.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.549+0000 7f471a600700 1 -- 172.21.15.49:0/4245219052 wait complete. 2024-01-22T05:15:41.556 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2024-01-22T05:15:41.573 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-01-22T05:15:41.573 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:15:41.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.729+0000 7f398e000700 1 Processor -- start 2024-01-22T05:15:41.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.729+0000 7f398e000700 1 -- start start 2024-01-22T05:15:41.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f398e000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f39880bcfa0 0x7f3988151700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f398e000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39880abfa0 0x7f3988065550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f398e000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3988068a60 con 0x7f3988151bf0 2024-01-22T05:15:41.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f398e000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39880bb790 con 0x7f39880bcfa0 2024-01-22T05:15:41.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f398e000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39880bd380 con 0x7f39880abfa0 2024-01-22T05:15:41.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f3987400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f39880bcfa0 0x7f3988151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f3986a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3988151bf0 0x7f39880ab890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48184/0 (socket says 172.21.15.49:48184) 2024-01-22T05:15:41.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f3987400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f39880bcfa0 0x7f3988151700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56992/0 (socket says 172.21.15.49:56992) 2024-01-22T05:15:41.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f3986a00700 1 -- 172.21.15.49:0/2201209650 learned_addr learned my addr 172.21.15.49:0/2201209650 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:41.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f3987e00700 1 --2- 172.21.15.49:0/2201209650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39880abfa0 0x7f3988065550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f3986000700 1 -- 172.21.15.49:0/2201209650 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762879998 0 0) 0x7f3988068a60 con 0x7f3988151bf0 2024-01-22T05:15:41.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f3987400700 1 -- 172.21.15.49:0/2201209650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39880abfa0 msgr2=0x7f3988065550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:41.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f3987400700 1 --2- 172.21.15.49:0/2201209650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39880abfa0 0x7f3988065550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f3987400700 1 -- 172.21.15.49:0/2201209650 >> v1:172.21.15.49:6789/0 conn(0x7f3988151bf0 legacy=0x7f39880ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f3987400700 1 -- 172.21.15.49:0/2201209650 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3988068460 con 0x7f39880bcfa0 2024-01-22T05:15:41.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f3987e00700 1 --2- 172.21.15.49:0/2201209650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39880abfa0 0x7f3988065550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:41.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f3987400700 1 --2- 172.21.15.49:0/2201209650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39880bcfa0 0x7f3988151700 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f39880bb8d0 tx=0x7f3978009060).ready entity=mon.0 client_cookie=920109c6bc5009d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:41.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f3986000700 1 -- 172.21.15.49:0/2201209650 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800b580 con 0x7f39880bcfa0 2024-01-22T05:15:41.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f3986000700 1 -- 172.21.15.49:0/2201209650 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397800b6e0 con 0x7f39880bcfa0 2024-01-22T05:15:41.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f3986000700 1 -- 172.21.15.49:0/2201209650 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800ba60 con 0x7f39880bcfa0 2024-01-22T05:15:41.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f398e000700 1 -- 172.21.15.49:0/2201209650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39880bcfa0 msgr2=0x7f3988151700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.733+0000 7f398e000700 1 --2- 172.21.15.49:0/2201209650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39880bcfa0 0x7f3988151700 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f39880bb8d0 tx=0x7f3978009060).stop 2024-01-22T05:15:41.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.737+0000 7f398e000700 1 -- 172.21.15.49:0/2201209650 shutdown_connections 2024-01-22T05:15:41.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.737+0000 7f398e000700 1 --2- 172.21.15.49:0/2201209650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39880abfa0 0x7f3988065550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.737+0000 7f398e000700 1 --2- 172.21.15.49:0/2201209650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39880bcfa0 0x7f3988151700 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.737+0000 7f398e000700 1 -- 172.21.15.49:0/2201209650 >> 172.21.15.49:0/2201209650 conn(0x7f39880c6540 msgr2=0x7f39880c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:41.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.737+0000 7f398e000700 1 -- 172.21.15.49:0/2201209650 shutdown_connections 2024-01-22T05:15:41.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.737+0000 7f398e000700 1 -- 172.21.15.49:0/2201209650 wait complete. 2024-01-22T05:15:41.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.737+0000 7f398e000700 1 Processor -- start 2024-01-22T05:15:41.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.737+0000 7f398e000700 1 -- start start 2024-01-22T05:15:41.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f398e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39880abfa0 0x7f398814a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f398e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39880bcfa0 0x7f398814e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f398e000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3988151bf0 0x7f398814be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f398e000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3988159f80 con 0x7f39880abfa0 2024-01-22T05:15:41.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f398e000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398816c970 con 0x7f39880bcfa0 2024-01-22T05:15:41.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f398e000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398814ed50 con 0x7f3988151bf0 2024-01-22T05:15:41.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f3987400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39880abfa0 0x7f398814a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f3987400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39880abfa0 0x7f398814a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57008/0 (socket says 172.21.15.49:57008) 2024-01-22T05:15:41.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f3987400700 1 -- 172.21.15.49:0/1636863036 learned_addr learned my addr 172.21.15.49:0/1636863036 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:41.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f3987e00700 1 --2- 172.21.15.49:0/1636863036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3988151bf0 0x7f398814be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f3986a00700 1 --2- 172.21.15.49:0/1636863036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39880bcfa0 0x7f398814e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f3987400700 1 -- 172.21.15.49:0/1636863036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3988151bf0 msgr2=0x7f398814be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f3987400700 1 --2- 172.21.15.49:0/1636863036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3988151bf0 0x7f398814be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f3987400700 1 -- 172.21.15.49:0/1636863036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39880bcfa0 msgr2=0x7f398814e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f3987400700 1 --2- 172.21.15.49:0/1636863036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39880bcfa0 0x7f398814e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f3987400700 1 -- 172.21.15.49:0/1636863036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39780092a0 con 0x7f39880abfa0 2024-01-22T05:15:41.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f3987400700 1 --2- 172.21.15.49:0/1636863036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39880abfa0 0x7f398814a0f0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7f3978009fd0 tx=0x7f3978017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:41.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f397ea00700 1 -- 172.21.15.49:0/1636863036 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978000bc0 con 0x7f39880abfa0 2024-01-22T05:15:41.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f397ea00700 1 -- 172.21.15.49:0/1636863036 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397800b850 con 0x7f39880abfa0 2024-01-22T05:15:41.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f397ea00700 1 -- 172.21.15.49:0/1636863036 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978000d20 con 0x7f39880abfa0 2024-01-22T05:15:41.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.741+0000 7f398e000700 1 -- 172.21.15.49:0/1636863036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398816c320 con 0x7f39880abfa0 2024-01-22T05:15:41.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.745+0000 7f398e000700 1 -- 172.21.15.49:0/1636863036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398814a5e0 con 0x7f39880abfa0 2024-01-22T05:15:41.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.745+0000 7f398e000700 1 -- 172.21.15.49:0/1636863036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39880c5870 con 0x7f39880abfa0 2024-01-22T05:15:41.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.745+0000 7f397ea00700 1 -- 172.21.15.49:0/1636863036 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f397801bb00 con 0x7f39880abfa0 2024-01-22T05:15:41.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.749+0000 7f397ea00700 1 --2- 172.21.15.49:0/1636863036 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f396005a510 0x7f396005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:41.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.749+0000 7f397ea00700 1 -- 172.21.15.49:0/1636863036 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3978076570 con 0x7f39880abfa0 2024-01-22T05:15:41.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.749+0000 7f3986a00700 1 --2- 172.21.15.49:0/1636863036 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f396005a510 0x7f396005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:41.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.749+0000 7f3986a00700 1 --2- 172.21.15.49:0/1636863036 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f396005a510 0x7f396005c9d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f398814db90 tx=0x7f3970007dd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:41.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.753+0000 7f397ea00700 1 -- 172.21.15.49:0/1636863036 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f39880c5870 con 0x7f39880abfa0 2024-01-22T05:15:41.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.969+0000 7f398e000700 1 -- 172.21.15.49:0/1636863036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f39880c5870 con 0x7f39880abfa0 2024-01-22T05:15:41.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.973+0000 7f397ea00700 1 -- 172.21.15.49:0/1636863036 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1205 (secure 0 0 0) 0x7f39880c5870 con 0x7f39880abfa0 2024-01-22T05:15:41.976 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:41.976 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":685,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":133,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":956,"data_bytes":981073128,"bytes_used":4444905472,"bytes_avail":768649207808,"bytes_total":773094113280,"recovering_objects_per_sec":1,"recovering_bytes_per_sec":1507662,"recovering_keys_per_sec":0,"num_objects_recovered":16,"num_bytes_recovered":16777216,"num_keys_recovered":0,"write_bytes_sec":27006332,"read_op_per_sec":0,"write_op_per_sec":26},"fsmap":{"epoch":106,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8292}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-01-22T05:14:47.460883+0000","services":{}},"progress_events":{}} 2024-01-22T05:15:41.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.973+0000 7f398e000700 1 -- 172.21.15.49:0/1636863036 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f396005a510 msgr2=0x7f396005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.973+0000 7f398e000700 1 --2- 172.21.15.49:0/1636863036 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f396005a510 0x7f396005c9d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f398814db90 tx=0x7f3970007dd0).stop 2024-01-22T05:15:41.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.973+0000 7f398e000700 1 -- 172.21.15.49:0/1636863036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39880abfa0 msgr2=0x7f398814a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:41.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.973+0000 7f398e000700 1 --2- 172.21.15.49:0/1636863036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39880abfa0 0x7f398814a0f0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7f3978009fd0 tx=0x7f3978017000).stop 2024-01-22T05:15:41.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.977+0000 7f398e000700 1 -- 172.21.15.49:0/1636863036 shutdown_connections 2024-01-22T05:15:41.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.977+0000 7f398e000700 1 --2- 172.21.15.49:0/1636863036 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f396005a510 0x7f396005c9d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.977+0000 7f398e000700 1 --2- 172.21.15.49:0/1636863036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3988151bf0 0x7f398814be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.977+0000 7f398e000700 1 --2- 172.21.15.49:0/1636863036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39880bcfa0 0x7f398814e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.977+0000 7f398e000700 1 --2- 172.21.15.49:0/1636863036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39880abfa0 0x7f398814a0f0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:41.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.977+0000 7f398e000700 1 -- 172.21.15.49:0/1636863036 >> 172.21.15.49:0/1636863036 conn(0x7f39880c6540 msgr2=0x7f39880c5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:41.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.977+0000 7f398e000700 1 -- 172.21.15.49:0/1636863036 shutdown_connections 2024-01-22T05:15:41.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:41.977+0000 7f398e000700 1 -- 172.21.15.49:0/1636863036 wait complete. 2024-01-22T05:15:43.003 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:15:43.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.169+0000 7f44ea600700 1 Processor -- start 2024-01-22T05:15:43.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.173+0000 7f44ea600700 1 -- start start 2024-01-22T05:15:43.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44ea600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44e4066fb0 0x7f44e40c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:43.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44ea600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f44e40a8f90 0x7f44e4065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:43.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44ea600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e40c1ee0 con 0x7f44e40a8b10 2024-01-22T05:15:43.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44ea600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e40c12f0 con 0x7f44e40a8f90 2024-01-22T05:15:43.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44ea600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40c15b0 con 0x7f44e4066fb0 2024-01-22T05:15:43.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44e2a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f44e40a8b10 0x7f44e4157740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48194/0 (socket says 172.21.15.49:48194) 2024-01-22T05:15:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44e2a00700 1 -- 172.21.15.49:0/2803088778 learned_addr learned my addr 172.21.15.49:0/2803088778 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44e3e00700 1 --2- 172.21.15.49:0/2803088778 >> v2:172.21.15.110:3300/0 conn(0x7f44e40a8f90 0x7f44e4065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44e3400700 1 --2- 172.21.15.49:0/2803088778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44e4066fb0 0x7f44e40c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44e3e00700 1 -- 172.21.15.49:0/2803088778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44e4066fb0 msgr2=0x7f44e40c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44e3e00700 1 --2- 172.21.15.49:0/2803088778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44e4066fb0 0x7f44e40c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44e3e00700 1 -- 172.21.15.49:0/2803088778 >> v1:172.21.15.49:6789/0 conn(0x7f44e40a8b10 legacy=0x7f44e4157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44e3e00700 1 -- 172.21.15.49:0/2803088778 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e40c1890 con 0x7f44e40a8f90 2024-01-22T05:15:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44e2000700 1 -- 172.21.15.49:0/2803088778 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143354687 0 0) 0x7f44e40c1ee0 con 0x7f44e40a8b10 2024-01-22T05:15:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44e3e00700 1 --2- 172.21.15.49:0/2803088778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e40a8f90 0x7f44e4065b80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f44dc009e90 tx=0x7f44dc009780).ready entity=mon.1 client_cookie=5ee73bc7c27007c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44e2000700 1 -- 172.21.15.49:0/2803088778 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc00e070 con 0x7f44e40a8f90 2024-01-22T05:15:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44e2000700 1 -- 172.21.15.49:0/2803088778 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc00bb20 con 0x7f44e40a8f90 2024-01-22T05:15:43.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.177+0000 7f44e2000700 1 -- 172.21.15.49:0/2803088778 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc00bea0 con 0x7f44e40a8f90 2024-01-22T05:15:43.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.181+0000 7f44ea600700 1 -- 172.21.15.49:0/2803088778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e40a8f90 msgr2=0x7f44e4065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:43.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.181+0000 7f44ea600700 1 --2- 172.21.15.49:0/2803088778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e40a8f90 0x7f44e4065b80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f44dc009e90 tx=0x7f44dc009780).stop 2024-01-22T05:15:43.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.181+0000 7f44ea600700 1 -- 172.21.15.49:0/2803088778 shutdown_connections 2024-01-22T05:15:43.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.181+0000 7f44ea600700 1 --2- 172.21.15.49:0/2803088778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e40a8f90 0x7f44e4065b80 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:43.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.181+0000 7f44ea600700 1 --2- 172.21.15.49:0/2803088778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44e4066fb0 0x7f44e40c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:43.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.181+0000 7f44ea600700 1 -- 172.21.15.49:0/2803088778 >> 172.21.15.49:0/2803088778 conn(0x7f44e40c6540 msgr2=0x7f44e40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:43.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.181+0000 7f44ea600700 1 -- 172.21.15.49:0/2803088778 shutdown_connections 2024-01-22T05:15:43.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.181+0000 7f44ea600700 1 -- 172.21.15.49:0/2803088778 wait complete. 2024-01-22T05:15:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.181+0000 7f44ea600700 1 Processor -- start 2024-01-22T05:15:43.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44ea600700 1 -- start start 2024-01-22T05:15:43.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44ea600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e4066fb0 0x7f44e40a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:43.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44ea600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44e40a8b10 0x7f44e4157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:43.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44ea600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44e40a8f90 0x7f44e4152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:43.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44ea600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40bf5f0 con 0x7f44e40a8b10 2024-01-22T05:15:43.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44ea600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40abfd0 con 0x7f44e4066fb0 2024-01-22T05:15:43.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44ea600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40ab0e0 con 0x7f44e40a8f90 2024-01-22T05:15:43.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44e2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44e40a8b10 0x7f44e4157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:43.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44e2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44e40a8b10 0x7f44e4157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57020/0 (socket says 172.21.15.49:57020) 2024-01-22T05:15:43.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44e2a00700 1 -- 172.21.15.49:0/4145316524 learned_addr learned my addr 172.21.15.49:0/4145316524 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:43.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44e3400700 1 --2- 172.21.15.49:0/4145316524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e4066fb0 0x7f44e40a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:43.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44e3e00700 1 --2- 172.21.15.49:0/4145316524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44e40a8f90 0x7f44e4152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:43.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44e2a00700 1 -- 172.21.15.49:0/4145316524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44e40a8f90 msgr2=0x7f44e4152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:43.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44e2a00700 1 --2- 172.21.15.49:0/4145316524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44e40a8f90 0x7f44e4152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:43.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44e2a00700 1 -- 172.21.15.49:0/4145316524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e4066fb0 msgr2=0x7f44e40a9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:43.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44e2a00700 1 --2- 172.21.15.49:0/4145316524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e4066fb0 0x7f44e40a9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:43.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44e2a00700 1 -- 172.21.15.49:0/4145316524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc009a20 con 0x7f44e40a8b10 2024-01-22T05:15:43.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.185+0000 7f44e2a00700 1 --2- 172.21.15.49:0/4145316524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44e40a8b10 0x7f44e4157870 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f44cc00c4a0 tx=0x7f44cc007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:43.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.189+0000 7f44daa00700 1 -- 172.21.15.49:0/4145316524 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc00ce50 con 0x7f44e40a8b10 2024-01-22T05:15:43.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.189+0000 7f44daa00700 1 -- 172.21.15.49:0/4145316524 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc0072e0 con 0x7f44e40a8b10 2024-01-22T05:15:43.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.189+0000 7f44ea600700 1 -- 172.21.15.49:0/4145316524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e40ab3c0 con 0x7f44e40a8b10 2024-01-22T05:15:43.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.189+0000 7f44daa00700 1 -- 172.21.15.49:0/4145316524 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc007660 con 0x7f44e40a8b10 2024-01-22T05:15:43.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.189+0000 7f44ea600700 1 -- 172.21.15.49:0/4145316524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e40ab980 con 0x7f44e40a8b10 2024-01-22T05:15:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.189+0000 7f44ea600700 1 -- 172.21.15.49:0/4145316524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e4047060 con 0x7f44e40a8b10 2024-01-22T05:15:43.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.193+0000 7f44daa00700 1 -- 172.21.15.49:0/4145316524 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f44cc0059b0 con 0x7f44e40a8b10 2024-01-22T05:15:43.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.193+0000 7f44daa00700 1 --2- 172.21.15.49:0/4145316524 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f44bc05a510 0x7f44bc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:43.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.193+0000 7f44daa00700 1 -- 172.21.15.49:0/4145316524 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f44cc074050 con 0x7f44e40a8b10 2024-01-22T05:15:43.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.193+0000 7f44e3400700 1 --2- 172.21.15.49:0/4145316524 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f44bc05a510 0x7f44bc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:43.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.193+0000 7f44e3400700 1 --2- 172.21.15.49:0/4145316524 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f44bc05a510 0x7f44bc05c9d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f44d4009c30 tx=0x7f44d4009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:43.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.201+0000 7f44daa00700 1 -- 172.21.15.49:0/4145316524 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f44cc047690 con 0x7f44e40a8b10 2024-01-22T05:15:43.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.397+0000 7f44ea600700 1 -- 172.21.15.49:0/4145316524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44e40c1b70 con 0x7f44e40a8b10 2024-01-22T05:15:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.401+0000 7f44daa00700 1 -- 172.21.15.49:0/4145316524 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4503 (secure 0 0 0) 0x7f44cc04acb0 con 0x7f44e40a8b10 2024-01-22T05:15:43.404 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:43.405 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:14:58.925818+0000","modified":"2024-01-22T05:15:02.323695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8292":{"gid":8292,"name":"a","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3036262557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3036262557},{"type":"v1","addr":"172.21.15.49:6837","nonce":3036262557}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-22T05:15:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.405+0000 7f44ea600700 1 -- 172.21.15.49:0/4145316524 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f44bc05a510 msgr2=0x7f44bc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.405+0000 7f44ea600700 1 --2- 172.21.15.49:0/4145316524 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f44bc05a510 0x7f44bc05c9d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f44d4009c30 tx=0x7f44d4009060).stop 2024-01-22T05:15:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.405+0000 7f44ea600700 1 -- 172.21.15.49:0/4145316524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44e40a8b10 msgr2=0x7f44e4157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:43.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.405+0000 7f44ea600700 1 --2- 172.21.15.49:0/4145316524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44e40a8b10 0x7f44e4157870 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f44cc00c4a0 tx=0x7f44cc007c30).stop 2024-01-22T05:15:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.405+0000 7f44ea600700 1 -- 172.21.15.49:0/4145316524 shutdown_connections 2024-01-22T05:15:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.405+0000 7f44ea600700 1 --2- 172.21.15.49:0/4145316524 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f44bc05a510 0x7f44bc05c9d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.405+0000 7f44ea600700 1 --2- 172.21.15.49:0/4145316524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44e40a8f90 0x7f44e4152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.405+0000 7f44ea600700 1 --2- 172.21.15.49:0/4145316524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44e40a8b10 0x7f44e4157870 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.405+0000 7f44ea600700 1 --2- 172.21.15.49:0/4145316524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e4066fb0 0x7f44e40a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.405+0000 7f44ea600700 1 -- 172.21.15.49:0/4145316524 >> 172.21.15.49:0/4145316524 conn(0x7f44e40c6540 msgr2=0x7f44e414c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.405+0000 7f44ea600700 1 -- 172.21.15.49:0/4145316524 shutdown_connections 2024-01-22T05:15:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.405+0000 7f44ea600700 1 -- 172.21.15.49:0/4145316524 wait complete. 2024-01-22T05:15:43.412 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2024-01-22T05:15:43.432 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-01-22T05:15:43.433 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:15:43.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.577+0000 7fbcc9800700 1 Processor -- start 2024-01-22T05:15:43.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.581+0000 7fbcc9800700 1 -- start start 2024-01-22T05:15:43.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc9800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbcc40c3a70 0x7fbcc40be7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:43.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc9800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc40c3f00 con 0x7fbcc4155c60 2024-01-22T05:15:43.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc9800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc40bdc10 con 0x7fbcc40c3690 2024-01-22T05:15:43.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc9800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc4068e10 con 0x7fbcc40c3a70 2024-01-22T05:15:43.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc2a00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbcc40c3690 0x7fbcc4155550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:54540/0 (socket says 172.21.15.49:54540) 2024-01-22T05:15:43.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc2a00700 1 -- 172.21.15.49:0/3818432224 learned_addr learned my addr 172.21.15.49:0/3818432224 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:43.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc3400700 1 --2- 172.21.15.49:0/3818432224 >> v2:172.21.15.110:3300/0 conn(0x7fbcc40c3a70 0x7fbcc40be7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:43.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc1600700 1 -- 172.21.15.49:0/3818432224 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684625486 0 0) 0x7fbcac001110 con 0x7fbcc4155c60 2024-01-22T05:15:43.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc1600700 1 -- 172.21.15.49:0/3818432224 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbca40033f0 con 0x7fbcc4155c60 2024-01-22T05:15:43.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc1600700 1 -- 172.21.15.49:0/3818432224 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986566849 0 0) 0x7fbcc40bdc10 con 0x7fbcc40c3690 2024-01-22T05:15:43.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc1600700 1 -- 172.21.15.49:0/3818432224 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcac001110 con 0x7fbcc40c3690 2024-01-22T05:15:43.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc3400700 1 -- 172.21.15.49:0/3818432224 >> v1:172.21.15.110:6789/0 conn(0x7fbcc40c3690 legacy=0x7fbcc4155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:43.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc3400700 1 -- 172.21.15.49:0/3818432224 >> v1:172.21.15.49:6789/0 conn(0x7fbcc4155c60 legacy=0x7fbcc40be0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:43.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc1600700 1 -- 172.21.15.49:0/3818432224 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4192079799 0 0) 0x7fbca40033f0 con 0x7fbcc4155c60 2024-01-22T05:15:43.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc3400700 1 -- 172.21.15.49:0/3818432224 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc40690f0 con 0x7fbcc40c3a70 2024-01-22T05:15:43.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.585+0000 7fbcc3400700 1 --2- 172.21.15.49:0/3818432224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcc40c3a70 0x7fbcc40be7b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fbcbc009e60 tx=0x7fbcbc009780).ready entity=mon.1 client_cookie=7f5aa031b02daf55 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:43.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.589+0000 7fbcc1600700 1 -- 172.21.15.49:0/3818432224 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc00e070 con 0x7fbcc40c3a70 2024-01-22T05:15:43.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.589+0000 7fbcc1600700 1 -- 172.21.15.49:0/3818432224 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcbc00b7a0 con 0x7fbcc40c3a70 2024-01-22T05:15:43.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.589+0000 7fbcc1600700 1 -- 172.21.15.49:0/3818432224 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac001600 con 0x7fbcc40c3a70 2024-01-22T05:15:43.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.589+0000 7fbcc9800700 1 -- 172.21.15.49:0/3818432224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcc40c3a70 msgr2=0x7fbcc40be7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:43.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.589+0000 7fbcc9800700 1 --2- 172.21.15.49:0/3818432224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcc40c3a70 0x7fbcc40be7b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fbcbc009e60 tx=0x7fbcbc009780).stop 2024-01-22T05:15:43.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.589+0000 7fbcc9800700 1 -- 172.21.15.49:0/3818432224 shutdown_connections 2024-01-22T05:15:43.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.589+0000 7fbcc9800700 1 --2- 172.21.15.49:0/3818432224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcc40c3a70 0x7fbcc40be7b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:43.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.589+0000 7fbcc9800700 1 -- 172.21.15.49:0/3818432224 >> 172.21.15.49:0/3818432224 conn(0x7fbcc40c51c0 msgr2=0x7fbcc40c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:43.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.589+0000 7fbcc9800700 1 -- 172.21.15.49:0/3818432224 shutdown_connections 2024-01-22T05:15:43.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.589+0000 7fbcc9800700 1 -- 172.21.15.49:0/3818432224 wait complete. 2024-01-22T05:15:43.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.593+0000 7fbcc9800700 1 Processor -- start 2024-01-22T05:15:43.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.593+0000 7fbcc9800700 1 -- start start 2024-01-22T05:15:43.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.593+0000 7fbcc9800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcc40c3690 0x7fbcc41526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:43.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.593+0000 7fbcc9800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbcc40c3a70 0x7fbcc41545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:43.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.593+0000 7fbcc9800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcc4155c60 0x7fbcc4165790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:43.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.593+0000 7fbcc9800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc4163390 con 0x7fbcc4155c60 2024-01-22T05:15:43.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.593+0000 7fbcc9800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc4152c90 con 0x7fbcc40c3690 2024-01-22T05:15:43.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.593+0000 7fbcc9800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc4152f70 con 0x7fbcc40c3a70 2024-01-22T05:15:43.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.593+0000 7fbcc2a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcc40c3690 0x7fbcc41526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:43.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.593+0000 7fbcc2a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcc40c3690 0x7fbcc41526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:43952/0 (socket says 172.21.15.49:43952) 2024-01-22T05:15:43.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.593+0000 7fbcc2a00700 1 -- 172.21.15.49:0/3401096013 learned_addr learned my addr 172.21.15.49:0/3401096013 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:43.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.593+0000 7fbcc2000700 1 --2- 172.21.15.49:0/3401096013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbcc40c3a70 0x7fbcc41545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:43.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.597+0000 7fbcc2a00700 1 -- 172.21.15.49:0/3401096013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbcc40c3a70 msgr2=0x7fbcc41545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:43.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.597+0000 7fbcc2a00700 1 --2- 172.21.15.49:0/3401096013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbcc40c3a70 0x7fbcc41545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:43.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.597+0000 7fbcc2a00700 1 -- 172.21.15.49:0/3401096013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcc4155c60 msgr2=0x7fbcc4165790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:43.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.597+0000 7fbcc2a00700 1 --2- 172.21.15.49:0/3401096013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcc4155c60 0x7fbcc4165790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:15:43.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.597+0000 7fbcc2a00700 1 -- 172.21.15.49:0/3401096013 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc009a20 con 0x7fbcc40c3690 2024-01-22T05:15:43.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.597+0000 7fbcc2a00700 1 --2- 172.21.15.49:0/3401096013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcc40c3690 0x7fbcc41526b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fbcb400c590 tx=0x7fbcb4007c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:43.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.597+0000 7fbcba000700 1 -- 172.21.15.49:0/3401096013 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb40072e0 con 0x7fbcc40c3690 2024-01-22T05:15:43.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.597+0000 7fbcba000700 1 -- 172.21.15.49:0/3401096013 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb4007440 con 0x7fbcc40c3690 2024-01-22T05:15:43.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.597+0000 7fbcba000700 1 -- 172.21.15.49:0/3401096013 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb40057a0 con 0x7fbcc40c3690 2024-01-22T05:15:43.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.597+0000 7fbcc9800700 1 -- 172.21.15.49:0/3401096013 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc4153250 con 0x7fbcc40c3690 2024-01-22T05:15:43.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.597+0000 7fbcc9800700 1 -- 172.21.15.49:0/3401096013 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc4154ab0 con 0x7fbcc40c3690 2024-01-22T05:15:43.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.601+0000 7fbcc9800700 1 -- 172.21.15.49:0/3401096013 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc41530b0 con 0x7fbcc40c3690 2024-01-22T05:15:43.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.601+0000 7fbcba000700 1 -- 172.21.15.49:0/3401096013 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbcb4005bd0 con 0x7fbcc40c3690 2024-01-22T05:15:43.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.601+0000 7fbcba000700 1 --2- 172.21.15.49:0/3401096013 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbc9c05a510 0x7fbc9c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:43.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.601+0000 7fbcba000700 1 -- 172.21.15.49:0/3401096013 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbcb4074150 con 0x7fbcc40c3690 2024-01-22T05:15:43.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.601+0000 7fbcc2000700 1 --2- 172.21.15.49:0/3401096013 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbc9c05a510 0x7fbc9c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:43.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.601+0000 7fbcc2000700 1 --2- 172.21.15.49:0/3401096013 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbc9c05a510 0x7fbc9c05c9d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fbcc41656f0 tx=0x7fbcac002c50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:43.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.609+0000 7fbcba000700 1 -- 172.21.15.49:0/3401096013 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbcc41530b0 con 0x7fbcc40c3690 2024-01-22T05:15:43.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.945+0000 7fbcc9800700 1 -- 172.21.15.49:0/3401096013 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbcc41530b0 con 0x7fbcc40c3690 2024-01-22T05:15:43.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.945+0000 7fbcba000700 1 -- 172.21.15.49:0/3401096013 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1205 (secure 0 0 0) 0x7fbcc41530b0 con 0x7fbcc40c3690 2024-01-22T05:15:43.949 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:43.949 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":687,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":133,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":956,"data_bytes":981073128,"bytes_used":4444905472,"bytes_avail":768649207808,"bytes_total":773094113280,"recovering_objects_per_sec":1,"recovering_bytes_per_sec":1397606,"recovering_keys_per_sec":0,"num_objects_recovered":16,"num_bytes_recovered":16777216,"num_keys_recovered":0,"write_bytes_sec":25034927,"read_op_per_sec":0,"write_op_per_sec":24},"fsmap":{"epoch":106,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8292}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-01-22T05:14:47.460883+0000","services":{}},"progress_events":{}} 2024-01-22T05:15:43.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.949+0000 7fbcc9800700 1 -- 172.21.15.49:0/3401096013 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbc9c05a510 msgr2=0x7fbc9c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:43.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.949+0000 7fbcc9800700 1 --2- 172.21.15.49:0/3401096013 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbc9c05a510 0x7fbc9c05c9d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fbcc41656f0 tx=0x7fbcac002c50).stop 2024-01-22T05:15:43.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.949+0000 7fbcc9800700 1 -- 172.21.15.49:0/3401096013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcc40c3690 msgr2=0x7fbcc41526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.949+0000 7fbcc9800700 1 --2- 172.21.15.49:0/3401096013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcc40c3690 0x7fbcc41526b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fbcb400c590 tx=0x7fbcb4007c80).stop 2024-01-22T05:15:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.949+0000 7fbcc9800700 1 -- 172.21.15.49:0/3401096013 shutdown_connections 2024-01-22T05:15:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.949+0000 7fbcc9800700 1 --2- 172.21.15.49:0/3401096013 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbc9c05a510 0x7fbc9c05c9d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.949+0000 7fbcc9800700 1 --2- 172.21.15.49:0/3401096013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcc4155c60 0x7fbcc4165790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:15:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.949+0000 7fbcc9800700 1 --2- 172.21.15.49:0/3401096013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbcc40c3a70 0x7fbcc41545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.949+0000 7fbcc9800700 1 --2- 172.21.15.49:0/3401096013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbcc40c3690 0x7fbcc41526b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.949+0000 7fbcc9800700 1 -- 172.21.15.49:0/3401096013 >> 172.21.15.49:0/3401096013 conn(0x7fbcc40c51c0 msgr2=0x7fbcc414cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:43.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.949+0000 7fbcc9800700 1 -- 172.21.15.49:0/3401096013 shutdown_connections 2024-01-22T05:15:43.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:43.949+0000 7fbcc9800700 1 -- 172.21.15.49:0/3401096013 wait complete. 2024-01-22T05:15:44.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:15:45.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.137+0000 7fbf62600700 1 Processor -- start 2024-01-22T05:15:45.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.137+0000 7fbf62600700 1 -- start start 2024-01-22T05:15:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf62600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf5c065660 0x7fbf5c0a6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf62600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf5c064950 0x7fbf5c157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf62600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5c0c2700 con 0x7fbf5c0644f0 2024-01-22T05:15:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf62600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf5c0bdc90 con 0x7fbf5c065660 2024-01-22T05:15:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf62600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0c2930 con 0x7fbf5c064950 2024-01-22T05:15:45.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf5b400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf5c065660 0x7fbf5c0a6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf5b400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf5c065660 0x7fbf5c0a6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:43958/0 (socket says 172.21.15.49:43958) 2024-01-22T05:15:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf5b400700 1 -- 172.21.15.49:0/3901175954 learned_addr learned my addr 172.21.15.49:0/3901175954 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf5aa00700 1 --1- 172.21.15.49:0/3901175954 >> v1:172.21.15.49:6789/0 conn(0x7fbf5c0644f0 0x7fbf5c1575b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59782/0 (socket says 172.21.15.49:59782) 2024-01-22T05:15:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf61000700 1 --2- 172.21.15.49:0/3901175954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf5c064950 0x7fbf5c157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf5b400700 1 -- 172.21.15.49:0/3901175954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf5c064950 msgr2=0x7fbf5c157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:45.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf5b400700 1 --2- 172.21.15.49:0/3901175954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf5c064950 0x7fbf5c157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf5b400700 1 -- 172.21.15.49:0/3901175954 >> v1:172.21.15.49:6789/0 conn(0x7fbf5c0644f0 legacy=0x7fbf5c1575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:45.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf5b400700 1 -- 172.21.15.49:0/3901175954 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c0c2c10 con 0x7fbf5c065660 2024-01-22T05:15:45.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf5a000700 1 -- 172.21.15.49:0/3901175954 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748826779 0 0) 0x7fbf5c0c2700 con 0x7fbf5c0644f0 2024-01-22T05:15:45.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.141+0000 7fbf5b400700 1 --2- 172.21.15.49:0/3901175954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf5c065660 0x7fbf5c0a6f40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fbf4c006fd0 tx=0x7fbf4c0090f0).ready entity=mon.1 client_cookie=daccf2961f6493ee server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:45.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.145+0000 7fbf5a000700 1 -- 172.21.15.49:0/3901175954 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c00b600 con 0x7fbf5c065660 2024-01-22T05:15:45.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.145+0000 7fbf5a000700 1 -- 172.21.15.49:0/3901175954 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c00b760 con 0x7fbf5c065660 2024-01-22T05:15:45.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.145+0000 7fbf5a000700 1 -- 172.21.15.49:0/3901175954 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c00bae0 con 0x7fbf5c065660 2024-01-22T05:15:45.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.145+0000 7fbf62600700 1 -- 172.21.15.49:0/3901175954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf5c065660 msgr2=0x7fbf5c0a6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:45.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.145+0000 7fbf62600700 1 --2- 172.21.15.49:0/3901175954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf5c065660 0x7fbf5c0a6f40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fbf4c006fd0 tx=0x7fbf4c0090f0).stop 2024-01-22T05:15:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.145+0000 7fbf62600700 1 -- 172.21.15.49:0/3901175954 shutdown_connections 2024-01-22T05:15:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.145+0000 7fbf62600700 1 --2- 172.21.15.49:0/3901175954 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf5c064950 0x7fbf5c157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.145+0000 7fbf62600700 1 --2- 172.21.15.49:0/3901175954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf5c065660 0x7fbf5c0a6f40 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.145+0000 7fbf62600700 1 -- 172.21.15.49:0/3901175954 >> 172.21.15.49:0/3901175954 conn(0x7fbf5c0c87f0 msgr2=0x7fbf5c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.145+0000 7fbf62600700 1 -- 172.21.15.49:0/3901175954 shutdown_connections 2024-01-22T05:15:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.145+0000 7fbf62600700 1 -- 172.21.15.49:0/3901175954 wait complete. 2024-01-22T05:15:45.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.149+0000 7fbf62600700 1 Processor -- start 2024-01-22T05:15:45.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.149+0000 7fbf62600700 1 -- start start 2024-01-22T05:15:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.149+0000 7fbf62600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf5c0644f0 0x7fbf5c156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.149+0000 7fbf62600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf5c064950 0x7fbf5c0a9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.149+0000 7fbf62600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf5c065660 0x7fbf5c152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf62600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c157c50 con 0x7fbf5c065660 2024-01-22T05:15:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf62600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0a9e60 con 0x7fbf5c0644f0 2024-01-22T05:15:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf62600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c156e30 con 0x7fbf5c064950 2024-01-22T05:15:45.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf61000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf5c065660 0x7fbf5c152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:45.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf61000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf5c065660 0x7fbf5c152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45126/0 (socket says 172.21.15.49:45126) 2024-01-22T05:15:45.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf61000700 1 -- 172.21.15.49:0/1324661439 learned_addr learned my addr 172.21.15.49:0/1324661439 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:45.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf5aa00700 1 --2- 172.21.15.49:0/1324661439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf5c064950 0x7fbf5c0a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:45.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf5b400700 1 --2- 172.21.15.49:0/1324661439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf5c0644f0 0x7fbf5c156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:45.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf61000700 1 -- 172.21.15.49:0/1324661439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf5c064950 msgr2=0x7fbf5c0a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:45.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf61000700 1 --2- 172.21.15.49:0/1324661439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf5c064950 0x7fbf5c0a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf61000700 1 -- 172.21.15.49:0/1324661439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf5c0644f0 msgr2=0x7fbf5c156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:45.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf61000700 1 --2- 172.21.15.49:0/1324661439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf5c0644f0 0x7fbf5c156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf61000700 1 -- 172.21.15.49:0/1324661439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c009370 con 0x7fbf5c065660 2024-01-22T05:15:45.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf61000700 1 --2- 172.21.15.49:0/1324661439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf5c065660 0x7fbf5c152db0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7fbf54009fa0 tx=0x7fbf54009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:45.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf52a00700 1 -- 172.21.15.49:0/1324661439 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400ed20 con 0x7fbf5c065660 2024-01-22T05:15:45.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf52a00700 1 -- 172.21.15.49:0/1324661439 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5400ee80 con 0x7fbf5c065660 2024-01-22T05:15:45.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf62600700 1 -- 172.21.15.49:0/1324661439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5c157110 con 0x7fbf5c065660 2024-01-22T05:15:45.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf52a00700 1 -- 172.21.15.49:0/1324661439 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54014610 con 0x7fbf5c065660 2024-01-22T05:15:45.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf62600700 1 -- 172.21.15.49:0/1324661439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5c1576d0 con 0x7fbf5c065660 2024-01-22T05:15:45.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.153+0000 7fbf62600700 1 -- 172.21.15.49:0/1324661439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5c157e00 con 0x7fbf5c065660 2024-01-22T05:15:45.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.157+0000 7fbf52a00700 1 -- 172.21.15.49:0/1324661439 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbf5401d3b0 con 0x7fbf5c065660 2024-01-22T05:15:45.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.157+0000 7fbf52a00700 1 --2- 172.21.15.49:0/1324661439 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf3405a510 0x7fbf3405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:45.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.157+0000 7fbf52a00700 1 -- 172.21.15.49:0/1324661439 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbf54074f20 con 0x7fbf5c065660 2024-01-22T05:15:45.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.157+0000 7fbf5b400700 1 --2- 172.21.15.49:0/1324661439 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf3405a510 0x7fbf3405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.157+0000 7fbf5b400700 1 --2- 172.21.15.49:0/1324661439 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf3405a510 0x7fbf3405c9d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fbf4c009130 tx=0x7fbf4c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:45.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.165+0000 7fbf52a00700 1 -- 172.21.15.49:0/1324661439 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbf5c157e00 con 0x7fbf5c065660 2024-01-22T05:15:45.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.369+0000 7fbf62600700 1 -- 172.21.15.49:0/1324661439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf5c1578f0 con 0x7fbf5c065660 2024-01-22T05:15:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.373+0000 7fbf52a00700 1 -- 172.21.15.49:0/1324661439 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4503 (secure 0 0 0) 0x7fbf54048500 con 0x7fbf5c065660 2024-01-22T05:15:45.375 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:45.376 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:14:58.925818+0000","modified":"2024-01-22T05:15:02.323695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8292":{"gid":8292,"name":"a","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3036262557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3036262557},{"type":"v1","addr":"172.21.15.49:6837","nonce":3036262557}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-22T05:15:45.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.373+0000 7fbf62600700 1 -- 172.21.15.49:0/1324661439 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf3405a510 msgr2=0x7fbf3405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:45.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.373+0000 7fbf62600700 1 --2- 172.21.15.49:0/1324661439 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf3405a510 0x7fbf3405c9d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fbf4c009130 tx=0x7fbf4c017000).stop 2024-01-22T05:15:45.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.373+0000 7fbf62600700 1 -- 172.21.15.49:0/1324661439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf5c065660 msgr2=0x7fbf5c152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:45.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.373+0000 7fbf62600700 1 --2- 172.21.15.49:0/1324661439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf5c065660 0x7fbf5c152db0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7fbf54009fa0 tx=0x7fbf54009900).stop 2024-01-22T05:15:45.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.373+0000 7fbf62600700 1 -- 172.21.15.49:0/1324661439 shutdown_connections 2024-01-22T05:15:45.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.373+0000 7fbf62600700 1 --2- 172.21.15.49:0/1324661439 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbf3405a510 0x7fbf3405c9d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.373+0000 7fbf62600700 1 --2- 172.21.15.49:0/1324661439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf5c065660 0x7fbf5c152db0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.373+0000 7fbf62600700 1 --2- 172.21.15.49:0/1324661439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf5c064950 0x7fbf5c0a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.373+0000 7fbf62600700 1 --2- 172.21.15.49:0/1324661439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf5c0644f0 0x7fbf5c156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.373+0000 7fbf62600700 1 -- 172.21.15.49:0/1324661439 >> 172.21.15.49:0/1324661439 conn(0x7fbf5c0c87f0 msgr2=0x7fbf5c0a38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:45.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.377+0000 7fbf62600700 1 -- 172.21.15.49:0/1324661439 shutdown_connections 2024-01-22T05:15:45.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.377+0000 7fbf62600700 1 -- 172.21.15.49:0/1324661439 wait complete. 2024-01-22T05:15:45.382 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2024-01-22T05:15:45.399 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-01-22T05:15:45.399 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:15:45.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.557+0000 7fc586e00700 1 Processor -- start 2024-01-22T05:15:45.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.561+0000 7fc586e00700 1 -- start start 2024-01-22T05:15:45.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.561+0000 7fc586e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5801554a0 0x7fc580067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:45.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.561+0000 7fc586e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c8e70 0x7fc5800c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:45.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.561+0000 7fc586e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc580151350 0x7fc5801517e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:45.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.561+0000 7fc586e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5800c5840 con 0x7fc5801554a0 2024-01-22T05:15:45.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.561+0000 7fc586e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc580155cf0 con 0x7fc580151350 2024-01-22T05:15:45.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.561+0000 7fc586e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc580155fd0 con 0x7fc5800c8e70 2024-01-22T05:15:45.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.561+0000 7fc57fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5801554a0 0x7fc580067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:45.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.561+0000 7fc57fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5801554a0 0x7fc580067a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45134/0 (socket says 172.21.15.49:45134) 2024-01-22T05:15:45.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.561+0000 7fc57fe00700 1 -- 172.21.15.49:0/3622628194 learned_addr learned my addr 172.21.15.49:0/3622628194 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:45.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.561+0000 7fc585800700 1 --2- 172.21.15.49:0/3622628194 >> v2:172.21.15.110:3300/0 conn(0x7fc580151350 0x7fc5801517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:45.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.561+0000 7fc57f400700 1 --2- 172.21.15.49:0/3622628194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c8e70 0x7fc5800c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:45.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc57fe00700 1 -- 172.21.15.49:0/3622628194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c8e70 msgr2=0x7fc5800c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:45.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc57fe00700 1 --2- 172.21.15.49:0/3622628194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c8e70 0x7fc5800c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc57fe00700 1 -- 172.21.15.49:0/3622628194 >> v2:172.21.15.110:3300/0 conn(0x7fc580151350 msgr2=0x7fc5801517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:45.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc57fe00700 1 --2- 172.21.15.49:0/3622628194 >> v2:172.21.15.110:3300/0 conn(0x7fc580151350 0x7fc5801517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc57fe00700 1 -- 172.21.15.49:0/3622628194 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5801562b0 con 0x7fc5801554a0 2024-01-22T05:15:45.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc57fe00700 1 --2- 172.21.15.49:0/3622628194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5801554a0 0x7fc580067a90 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7fc580069580 tx=0x7fc5700090f0).ready entity=mon.0 client_cookie=54e09dd8f9b50963 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:45.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc57ea00700 1 -- 172.21.15.49:0/3622628194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57000b520 con 0x7fc5801554a0 2024-01-22T05:15:45.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc57ea00700 1 -- 172.21.15.49:0/3622628194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57000b680 con 0x7fc5801554a0 2024-01-22T05:15:45.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc57ea00700 1 -- 172.21.15.49:0/3622628194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57000ba00 con 0x7fc5801554a0 2024-01-22T05:15:45.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc586e00700 1 -- 172.21.15.49:0/3622628194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5801554a0 msgr2=0x7fc580067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:45.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc586e00700 1 --2- 172.21.15.49:0/3622628194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5801554a0 0x7fc580067a90 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7fc580069580 tx=0x7fc5700090f0).stop 2024-01-22T05:15:45.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc586e00700 1 -- 172.21.15.49:0/3622628194 shutdown_connections 2024-01-22T05:15:45.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc586e00700 1 --2- 172.21.15.49:0/3622628194 >> v2:172.21.15.110:3300/0 conn(0x7fc580151350 0x7fc5801517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc586e00700 1 --2- 172.21.15.49:0/3622628194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c8e70 0x7fc5800c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc586e00700 1 --2- 172.21.15.49:0/3622628194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5801554a0 0x7fc580067a90 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc586e00700 1 -- 172.21.15.49:0/3622628194 >> 172.21.15.49:0/3622628194 conn(0x7fc5800c9f50 msgr2=0x7fc5800ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:45.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc586e00700 1 -- 172.21.15.49:0/3622628194 shutdown_connections 2024-01-22T05:15:45.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.565+0000 7fc586e00700 1 -- 172.21.15.49:0/3622628194 wait complete. 2024-01-22T05:15:45.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.569+0000 7fc586e00700 1 Processor -- start 2024-01-22T05:15:45.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.569+0000 7fc586e00700 1 -- start start 2024-01-22T05:15:45.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.569+0000 7fc586e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c8e70 0x7fc5800a9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:45.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.569+0000 7fc586e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580151350 0x7fc5800af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:45.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.569+0000 7fc586e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5801554a0 0x7fc5800af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:45.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.569+0000 7fc586e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5800afa10 con 0x7fc580151350 2024-01-22T05:15:45.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.569+0000 7fc586e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5800aaa00 con 0x7fc5801554a0 2024-01-22T05:15:45.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.569+0000 7fc586e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58014d570 con 0x7fc5800c8e70 2024-01-22T05:15:45.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc57f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580151350 0x7fc5800af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:45.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc57f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580151350 0x7fc5800af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45144/0 (socket says 172.21.15.49:45144) 2024-01-22T05:15:45.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc57f400700 1 -- 172.21.15.49:0/3501463886 learned_addr learned my addr 172.21.15.49:0/3501463886 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:45.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc585800700 1 --2- 172.21.15.49:0/3501463886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5801554a0 0x7fc5800af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:45.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc57fe00700 1 --2- 172.21.15.49:0/3501463886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c8e70 0x7fc5800a9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:45.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc57f400700 1 -- 172.21.15.49:0/3501463886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c8e70 msgr2=0x7fc5800a9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:45.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc57f400700 1 --2- 172.21.15.49:0/3501463886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c8e70 0x7fc5800a9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc57f400700 1 -- 172.21.15.49:0/3501463886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5801554a0 msgr2=0x7fc5800af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc57f400700 1 --2- 172.21.15.49:0/3501463886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5801554a0 0x7fc5800af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc57f400700 1 -- 172.21.15.49:0/3501463886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc570009370 con 0x7fc580151350 2024-01-22T05:15:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc585800700 1 --2- 172.21.15.49:0/3501463886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5801554a0 0x7fc5800af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc57f400700 1 --2- 172.21.15.49:0/3501463886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580151350 0x7fc5800af030 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7fc56800d890 tx=0x7fc568008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc577400700 1 -- 172.21.15.49:0/3501463886 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5680125f0 con 0x7fc580151350 2024-01-22T05:15:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc577400700 1 -- 172.21.15.49:0/3501463886 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc568012750 con 0x7fc580151350 2024-01-22T05:15:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc586e00700 1 -- 172.21.15.49:0/3501463886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5800a9df0 con 0x7fc580151350 2024-01-22T05:15:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc577400700 1 -- 172.21.15.49:0/3501463886 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568012ad0 con 0x7fc580151350 2024-01-22T05:15:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc586e00700 1 -- 172.21.15.49:0/3501463886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5800aa3b0 con 0x7fc580151350 2024-01-22T05:15:45.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.573+0000 7fc586e00700 1 -- 172.21.15.49:0/3501463886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc580047060 con 0x7fc580151350 2024-01-22T05:15:45.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.577+0000 7fc577400700 1 -- 172.21.15.49:0/3501463886 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc568013480 con 0x7fc580151350 2024-01-22T05:15:45.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.577+0000 7fc577400700 1 --2- 172.21.15.49:0/3501463886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc55805a510 0x7fc55805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:45.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.577+0000 7fc577400700 1 -- 172.21.15.49:0/3501463886 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc568074800 con 0x7fc580151350 2024-01-22T05:15:45.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.577+0000 7fc57fe00700 1 --2- 172.21.15.49:0/3501463886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc55805a510 0x7fc55805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:45.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.581+0000 7fc57fe00700 1 --2- 172.21.15.49:0/3501463886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc55805a510 0x7fc55805c9d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fc570009130 tx=0x7fc570017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.585+0000 7fc577400700 1 -- 172.21.15.49:0/3501463886 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc568047d20 con 0x7fc580151350 2024-01-22T05:15:45.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.801+0000 7fc586e00700 1 -- 172.21.15.49:0/3501463886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc580151cd0 con 0x7fc580151350 2024-01-22T05:15:45.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.805+0000 7fc577400700 1 -- 172.21.15.49:0/3501463886 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1207 (secure 0 0 0) 0x7fc56804b340 con 0x7fc580151350 2024-01-22T05:15:45.808 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:45.808 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":689,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":133,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075746882,"bytes_used":4675149824,"bytes_avail":768418963456,"bytes_total":773094113280,"recovering_objects_per_sec":1,"recovering_bytes_per_sec":1397614,"recovering_keys_per_sec":0,"num_objects_recovered":16,"num_bytes_recovered":16777216,"num_keys_recovered":0,"write_bytes_sec":32923438,"read_op_per_sec":0,"write_op_per_sec":32},"fsmap":{"epoch":106,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8292}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-01-22T05:14:47.460883+0000","services":{}},"progress_events":{}} 2024-01-22T05:15:45.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.809+0000 7fc586e00700 1 -- 172.21.15.49:0/3501463886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc55805a510 msgr2=0x7fc55805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:45.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.809+0000 7fc586e00700 1 --2- 172.21.15.49:0/3501463886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc55805a510 0x7fc55805c9d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fc570009130 tx=0x7fc570017000).stop 2024-01-22T05:15:45.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.809+0000 7fc586e00700 1 -- 172.21.15.49:0/3501463886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580151350 msgr2=0x7fc5800af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.809+0000 7fc586e00700 1 --2- 172.21.15.49:0/3501463886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580151350 0x7fc5800af030 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7fc56800d890 tx=0x7fc568008040).stop 2024-01-22T05:15:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.809+0000 7fc586e00700 1 -- 172.21.15.49:0/3501463886 shutdown_connections 2024-01-22T05:15:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.809+0000 7fc586e00700 1 --2- 172.21.15.49:0/3501463886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc55805a510 0x7fc55805c9d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.809+0000 7fc586e00700 1 --2- 172.21.15.49:0/3501463886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5801554a0 0x7fc5800af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.809+0000 7fc586e00700 1 --2- 172.21.15.49:0/3501463886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc580151350 0x7fc5800af030 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.809+0000 7fc586e00700 1 --2- 172.21.15.49:0/3501463886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c8e70 0x7fc5800a9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.809+0000 7fc586e00700 1 -- 172.21.15.49:0/3501463886 >> 172.21.15.49:0/3501463886 conn(0x7fc5800c9f50 msgr2=0x7fc580067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.809+0000 7fc586e00700 1 -- 172.21.15.49:0/3501463886 shutdown_connections 2024-01-22T05:15:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:45.809+0000 7fc586e00700 1 -- 172.21.15.49:0/3501463886 wait complete. 2024-01-22T05:15:46.837 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:15:46.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:46.997+0000 7fc68ec00700 1 Processor -- start 2024-01-22T05:15:47.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:46.997+0000 7fc68ec00700 1 -- start start 2024-01-22T05:15:47.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.001+0000 7fc68ec00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6880c1f00 0x7fc6880c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.001+0000 7fc68ec00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68815cb20 con 0x7fc6880bd260 2024-01-22T05:15:47.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.001+0000 7fc68ec00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc688152c10 con 0x7fc688062230 2024-01-22T05:15:47.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.001+0000 7fc68ec00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880c27d0 con 0x7fc6880c1f00 2024-01-22T05:15:47.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.001+0000 7fc68e200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc6880bd260 0x7fc68815c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59788/0 (socket says 172.21.15.49:59788) 2024-01-22T05:15:47.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.001+0000 7fc68e200700 1 -- 172.21.15.49:0/790903718 learned_addr learned my addr 172.21.15.49:0/790903718 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:47.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.001+0000 7fc68d800700 1 --2- 172.21.15.49:0/790903718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6880c1f00 0x7fc6880c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.001+0000 7fc68d800700 1 -- 172.21.15.49:0/790903718 >> v1:172.21.15.110:6789/0 conn(0x7fc688062230 legacy=0x7fc68815bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.001+0000 7fc68d800700 1 -- 172.21.15.49:0/790903718 >> v1:172.21.15.49:6789/0 conn(0x7fc6880bd260 legacy=0x7fc68815c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.001+0000 7fc687e00700 1 -- 172.21.15.49:0/790903718 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927152381 0 0) 0x7fc68815cb20 con 0x7fc6880bd260 2024-01-22T05:15:47.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.001+0000 7fc68d800700 1 -- 172.21.15.49:0/790903718 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6881588d0 con 0x7fc6880c1f00 2024-01-22T05:15:47.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.001+0000 7fc68d800700 1 --2- 172.21.15.49:0/790903718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6880c1f00 0x7fc6880c22e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fc678009790 tx=0x7fc678009060).ready entity=mon.2 client_cookie=2d20c3da4fb21e40 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:47.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.001+0000 7fc687e00700 1 -- 172.21.15.49:0/790903718 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67800b5a0 con 0x7fc6880c1f00 2024-01-22T05:15:47.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.001+0000 7fc687e00700 1 -- 172.21.15.49:0/790903718 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67800b700 con 0x7fc6880c1f00 2024-01-22T05:15:47.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.001+0000 7fc687e00700 1 -- 172.21.15.49:0/790903718 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67800ba80 con 0x7fc6880c1f00 2024-01-22T05:15:47.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.005+0000 7fc68ec00700 1 -- 172.21.15.49:0/790903718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6880c1f00 msgr2=0x7fc6880c22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.005+0000 7fc68ec00700 1 --2- 172.21.15.49:0/790903718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6880c1f00 0x7fc6880c22e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fc678009790 tx=0x7fc678009060).stop 2024-01-22T05:15:47.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.005+0000 7fc68ec00700 1 -- 172.21.15.49:0/790903718 shutdown_connections 2024-01-22T05:15:47.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.005+0000 7fc68ec00700 1 --2- 172.21.15.49:0/790903718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6880c1f00 0x7fc6880c22e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.005+0000 7fc68ec00700 1 -- 172.21.15.49:0/790903718 >> 172.21.15.49:0/790903718 conn(0x7fc6880c7830 msgr2=0x7fc6880c3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:47.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.005+0000 7fc68ec00700 1 -- 172.21.15.49:0/790903718 shutdown_connections 2024-01-22T05:15:47.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.005+0000 7fc68ec00700 1 -- 172.21.15.49:0/790903718 wait complete. 2024-01-22T05:15:47.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.009+0000 7fc68ec00700 1 Processor -- start 2024-01-22T05:15:47.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.009+0000 7fc68ec00700 1 -- start start 2024-01-22T05:15:47.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.009+0000 7fc68ec00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc688062230 0x7fc6880be940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.009+0000 7fc68ec00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6880bd260 0x7fc6880a6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.009+0000 7fc68ec00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6880c1f00 0x7fc6880abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.009+0000 7fc68ec00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880c4e00 con 0x7fc6880bd260 2024-01-22T05:15:47.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.009+0000 7fc68ec00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880c50e0 con 0x7fc688062230 2024-01-22T05:15:47.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.009+0000 7fc68ec00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880c53c0 con 0x7fc6880c1f00 2024-01-22T05:15:47.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.009+0000 7fc68ce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6880bd260 0x7fc6880a6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.009+0000 7fc68ce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6880bd260 0x7fc6880a6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45160/0 (socket says 172.21.15.49:45160) 2024-01-22T05:15:47.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.009+0000 7fc68ce00700 1 -- 172.21.15.49:0/709871915 learned_addr learned my addr 172.21.15.49:0/709871915 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:47.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.009+0000 7fc68d800700 1 --2- 172.21.15.49:0/709871915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc688062230 0x7fc6880be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.009+0000 7fc68e200700 1 --2- 172.21.15.49:0/709871915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6880c1f00 0x7fc6880abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.013+0000 7fc68ce00700 1 -- 172.21.15.49:0/709871915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6880c1f00 msgr2=0x7fc6880abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.013+0000 7fc68ce00700 1 --2- 172.21.15.49:0/709871915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6880c1f00 0x7fc6880abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.013+0000 7fc68ce00700 1 -- 172.21.15.49:0/709871915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc688062230 msgr2=0x7fc6880be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.013+0000 7fc68ce00700 1 --2- 172.21.15.49:0/709871915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc688062230 0x7fc6880be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.013+0000 7fc68ce00700 1 -- 172.21.15.49:0/709871915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6780092a0 con 0x7fc6880bd260 2024-01-22T05:15:47.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.013+0000 7fc68ce00700 1 --2- 172.21.15.49:0/709871915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6880bd260 0x7fc6880a6e80 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7fc67000c440 tx=0x7fc670007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:47.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.013+0000 7fc684c00700 1 -- 172.21.15.49:0/709871915 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc670007020 con 0x7fc6880bd260 2024-01-22T05:15:47.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.013+0000 7fc684c00700 1 -- 172.21.15.49:0/709871915 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc670007180 con 0x7fc6880bd260 2024-01-22T05:15:47.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.013+0000 7fc68ec00700 1 -- 172.21.15.49:0/709871915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6880c56a0 con 0x7fc6880bd260 2024-01-22T05:15:47.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.013+0000 7fc684c00700 1 -- 172.21.15.49:0/709871915 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc670007520 con 0x7fc6880bd260 2024-01-22T05:15:47.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.013+0000 7fc68ec00700 1 -- 172.21.15.49:0/709871915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6880a7370 con 0x7fc6880bd260 2024-01-22T05:15:47.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.013+0000 7fc68ec00700 1 -- 172.21.15.49:0/709871915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc688065120 con 0x7fc6880bd260 2024-01-22T05:15:47.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.017+0000 7fc684c00700 1 -- 172.21.15.49:0/709871915 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc6700068b0 con 0x7fc6880bd260 2024-01-22T05:15:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.017+0000 7fc684c00700 1 --2- 172.21.15.49:0/709871915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc66005a510 0x7fc66005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.017+0000 7fc684c00700 1 -- 172.21.15.49:0/709871915 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc6700742c0 con 0x7fc6880bd260 2024-01-22T05:15:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.017+0000 7fc68d800700 1 --2- 172.21.15.49:0/709871915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc66005a510 0x7fc66005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.021+0000 7fc68d800700 1 --2- 172.21.15.49:0/709871915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc66005a510 0x7fc66005c9d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fc6780096e0 tx=0x7fc678015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:47.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.025+0000 7fc684c00700 1 -- 172.21.15.49:0/709871915 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc670047840 con 0x7fc6880bd260 2024-01-22T05:15:47.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.217+0000 7fc68ec00700 1 -- 172.21.15.49:0/709871915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc688158bb0 con 0x7fc6880bd260 2024-01-22T05:15:47.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.217+0000 7fc684c00700 1 -- 172.21.15.49:0/709871915 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4503 (secure 0 0 0) 0x7fc67004ae60 con 0x7fc6880bd260 2024-01-22T05:15:47.223 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:47.223 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:14:58.925818+0000","modified":"2024-01-22T05:15:02.323695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8292":{"gid":8292,"name":"a","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3036262557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3036262557},{"type":"v1","addr":"172.21.15.49:6837","nonce":3036262557}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-22T05:15:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.221+0000 7fc68ec00700 1 -- 172.21.15.49:0/709871915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc66005a510 msgr2=0x7fc66005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.221+0000 7fc68ec00700 1 --2- 172.21.15.49:0/709871915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc66005a510 0x7fc66005c9d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fc6780096e0 tx=0x7fc678015000).stop 2024-01-22T05:15:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.221+0000 7fc68ec00700 1 -- 172.21.15.49:0/709871915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6880bd260 msgr2=0x7fc6880a6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.221+0000 7fc68ec00700 1 --2- 172.21.15.49:0/709871915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6880bd260 0x7fc6880a6e80 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7fc67000c440 tx=0x7fc670007dd0).stop 2024-01-22T05:15:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.221+0000 7fc68ec00700 1 -- 172.21.15.49:0/709871915 shutdown_connections 2024-01-22T05:15:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.221+0000 7fc68ec00700 1 --2- 172.21.15.49:0/709871915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc66005a510 0x7fc66005c9d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.221+0000 7fc68ec00700 1 --2- 172.21.15.49:0/709871915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6880c1f00 0x7fc6880abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.221+0000 7fc68ec00700 1 --2- 172.21.15.49:0/709871915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6880bd260 0x7fc6880a6e80 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.221+0000 7fc68ec00700 1 --2- 172.21.15.49:0/709871915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc688062230 0x7fc6880be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.221+0000 7fc68ec00700 1 -- 172.21.15.49:0/709871915 >> 172.21.15.49:0/709871915 conn(0x7fc6880c7830 msgr2=0x7fc688062630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:47.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.225+0000 7fc68ec00700 1 -- 172.21.15.49:0/709871915 shutdown_connections 2024-01-22T05:15:47.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.225+0000 7fc68ec00700 1 -- 172.21.15.49:0/709871915 wait complete. 2024-01-22T05:15:47.231 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2024-01-22T05:15:47.251 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-01-22T05:15:47.252 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:15:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.405+0000 7fe01e200700 1 Processor -- start 2024-01-22T05:15:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.405+0000 7fe01e200700 1 -- start start 2024-01-22T05:15:47.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.409+0000 7fe01e200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c13f0 0x7fe0180bbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.409+0000 7fe01e200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe018068aa0 0x7fe018068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.409+0000 7fe01e200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0180638a0 con 0x7fe018063d30 2024-01-22T05:15:47.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.409+0000 7fe01e200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0180648f0 con 0x7fe018068aa0 2024-01-22T05:15:47.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.409+0000 7fe01e200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe018139c80 con 0x7fe0180c13f0 2024-01-22T05:15:47.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.409+0000 7fe017e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe018068aa0 0x7fe018068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe017e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe018068aa0 0x7fe018068ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45172/0 (socket says 172.21.15.49:45172) 2024-01-22T05:15:47.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe017e00700 1 -- 172.21.15.49:0/944339774 learned_addr learned my addr 172.21.15.49:0/944339774 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:47.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe01ce00700 1 --2- 172.21.15.49:0/944339774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c13f0 0x7fe0180bbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe017400700 1 -- 172.21.15.49:0/944339774 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091563146 0 0) 0x7fe0180638a0 con 0x7fe018063d30 2024-01-22T05:15:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe017e00700 1 -- 172.21.15.49:0/944339774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c13f0 msgr2=0x7fe0180bbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe017e00700 1 --2- 172.21.15.49:0/944339774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c13f0 0x7fe0180bbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe017e00700 1 -- 172.21.15.49:0/944339774 >> v1:172.21.15.110:6789/0 conn(0x7fe018063d30 legacy=0x7fe0180641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe017e00700 1 -- 172.21.15.49:0/944339774 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0180693d0 con 0x7fe018068aa0 2024-01-22T05:15:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe017e00700 1 --2- 172.21.15.49:0/944339774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe018068aa0 0x7fe018068ee0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7fe00000bac0 tx=0x7fe00000b370).ready entity=mon.0 client_cookie=e0ef3c1cf0edae99 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:47.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe017400700 1 -- 172.21.15.49:0/944339774 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00000db70 con 0x7fe018068aa0 2024-01-22T05:15:47.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe017400700 1 -- 172.21.15.49:0/944339774 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00000dcd0 con 0x7fe018068aa0 2024-01-22T05:15:47.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe017400700 1 -- 172.21.15.49:0/944339774 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000015600 con 0x7fe018068aa0 2024-01-22T05:15:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe01e200700 1 -- 172.21.15.49:0/944339774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe018068aa0 msgr2=0x7fe018068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe01e200700 1 --2- 172.21.15.49:0/944339774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe018068aa0 0x7fe018068ee0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7fe00000bac0 tx=0x7fe00000b370).stop 2024-01-22T05:15:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe01e200700 1 -- 172.21.15.49:0/944339774 shutdown_connections 2024-01-22T05:15:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe01e200700 1 --2- 172.21.15.49:0/944339774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe018068aa0 0x7fe018068ee0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe01e200700 1 --2- 172.21.15.49:0/944339774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c13f0 0x7fe0180bbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.413+0000 7fe01e200700 1 -- 172.21.15.49:0/944339774 >> 172.21.15.49:0/944339774 conn(0x7fe0180c42c0 msgr2=0x7fe018065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:47.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.417+0000 7fe01e200700 1 -- 172.21.15.49:0/944339774 shutdown_connections 2024-01-22T05:15:47.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.417+0000 7fe01e200700 1 -- 172.21.15.49:0/944339774 wait complete. 2024-01-22T05:15:47.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.417+0000 7fe01e200700 1 Processor -- start 2024-01-22T05:15:47.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.417+0000 7fe01e200700 1 -- start start 2024-01-22T05:15:47.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe01e200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe018063d30 0x7fe0180a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe01e200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe018068aa0 0x7fe018167780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe01e200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c13f0 0x7fe0181652c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe01e200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180bfd10 con 0x7fe018068aa0 2024-01-22T05:15:47.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe01e200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180bf6d0 con 0x7fe018063d30 2024-01-22T05:15:47.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe01e200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe018168160 con 0x7fe0180c13f0 2024-01-22T05:15:47.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe017e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe018068aa0 0x7fe018167780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe017e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe018068aa0 0x7fe018167780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45184/0 (socket says 172.21.15.49:45184) 2024-01-22T05:15:47.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe017e00700 1 -- 172.21.15.49:0/1944799007 learned_addr learned my addr 172.21.15.49:0/1944799007 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:47.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe01d800700 1 --2- 172.21.15.49:0/1944799007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c13f0 0x7fe0181652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe01ce00700 1 --2- 172.21.15.49:0/1944799007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe018063d30 0x7fe0180a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe017e00700 1 -- 172.21.15.49:0/1944799007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c13f0 msgr2=0x7fe0181652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe017e00700 1 --2- 172.21.15.49:0/1944799007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c13f0 0x7fe0181652c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe017e00700 1 -- 172.21.15.49:0/1944799007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe018063d30 msgr2=0x7fe0180a5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe017e00700 1 --2- 172.21.15.49:0/1944799007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe018063d30 0x7fe0180a5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe017e00700 1 -- 172.21.15.49:0/1944799007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00000b6a0 con 0x7fe018068aa0 2024-01-22T05:15:47.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe01ce00700 1 --2- 172.21.15.49:0/1944799007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe018063d30 0x7fe0180a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:47.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe017e00700 1 --2- 172.21.15.49:0/1944799007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe018068aa0 0x7fe018167780 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7fe018065a10 tx=0x7fe00001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:47.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe00fe00700 1 -- 172.21.15.49:0/1944799007 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000009040 con 0x7fe018068aa0 2024-01-22T05:15:47.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe00fe00700 1 -- 172.21.15.49:0/1944799007 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe000016e80 con 0x7fe018068aa0 2024-01-22T05:15:47.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe01e200700 1 -- 172.21.15.49:0/1944799007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe018168440 con 0x7fe018068aa0 2024-01-22T05:15:47.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe00fe00700 1 -- 172.21.15.49:0/1944799007 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000014790 con 0x7fe018068aa0 2024-01-22T05:15:47.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.421+0000 7fe01e200700 1 -- 172.21.15.49:0/1944799007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0180a62c0 con 0x7fe018068aa0 2024-01-22T05:15:47.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.425+0000 7fe01e200700 1 -- 172.21.15.49:0/1944799007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0180bff80 con 0x7fe018068aa0 2024-01-22T05:15:47.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.425+0000 7fe00fe00700 1 -- 172.21.15.49:0/1944799007 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe000014b80 con 0x7fe018068aa0 2024-01-22T05:15:47.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.425+0000 7fe00fe00700 1 --2- 172.21.15.49:0/1944799007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdff005a510 0x7fdff005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.425+0000 7fe00fe00700 1 -- 172.21.15.49:0/1944799007 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe00000de40 con 0x7fe018068aa0 2024-01-22T05:15:47.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.425+0000 7fe01ce00700 1 --2- 172.21.15.49:0/1944799007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdff005a510 0x7fdff005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.429+0000 7fe01ce00700 1 --2- 172.21.15.49:0/1944799007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdff005a510 0x7fdff005c9d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fe018127360 tx=0x7fe008008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:47.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.433+0000 7fe00fe00700 1 -- 172.21.15.49:0/1944799007 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe000048cd0 con 0x7fe018068aa0 2024-01-22T05:15:47.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.657+0000 7fe01e200700 1 -- 172.21.15.49:0/1944799007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe0180bc5b0 con 0x7fe018068aa0 2024-01-22T05:15:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.657+0000 7fe00fe00700 1 -- 172.21.15.49:0/1944799007 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1636 (secure 0 0 0) 0x7fe000023020 con 0x7fe018068aa0 2024-01-22T05:15:47.661 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:47.661 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":691,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":133,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075746882,"bytes_used":4675149824,"bytes_avail":768418963456,"bytes_total":773094113280,"write_bytes_sec":20931576,"read_op_per_sec":0,"write_op_per_sec":20},"fsmap":{"epoch":106,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8292}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-01-22T05:15:45.481315+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:15:47.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.661+0000 7fe01e200700 1 -- 172.21.15.49:0/1944799007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdff005a510 msgr2=0x7fdff005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.661+0000 7fe01e200700 1 --2- 172.21.15.49:0/1944799007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdff005a510 0x7fdff005c9d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fe018127360 tx=0x7fe008008040).stop 2024-01-22T05:15:47.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.661+0000 7fe01e200700 1 -- 172.21.15.49:0/1944799007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe018068aa0 msgr2=0x7fe018167780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.661+0000 7fe01e200700 1 --2- 172.21.15.49:0/1944799007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe018068aa0 0x7fe018167780 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7fe018065a10 tx=0x7fe00001a000).stop 2024-01-22T05:15:47.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.661+0000 7fe01e200700 1 -- 172.21.15.49:0/1944799007 shutdown_connections 2024-01-22T05:15:47.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.661+0000 7fe01e200700 1 --2- 172.21.15.49:0/1944799007 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdff005a510 0x7fdff005c9d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.661+0000 7fe01e200700 1 --2- 172.21.15.49:0/1944799007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c13f0 0x7fe0181652c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.661+0000 7fe01e200700 1 --2- 172.21.15.49:0/1944799007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe018068aa0 0x7fe018167780 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.661+0000 7fe01e200700 1 --2- 172.21.15.49:0/1944799007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe018063d30 0x7fe0180a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.661+0000 7fe01e200700 1 -- 172.21.15.49:0/1944799007 >> 172.21.15.49:0/1944799007 conn(0x7fe0180c42c0 msgr2=0x7fe018065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:47.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.661+0000 7fe01e200700 1 -- 172.21.15.49:0/1944799007 shutdown_connections 2024-01-22T05:15:47.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.661+0000 7fe01e200700 1 -- 172.21.15.49:0/1944799007 wait complete. 2024-01-22T05:15:47.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/scrub_control_test_path]'} 2024-01-22T05:15:47.690 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub abort 2024-01-22T05:15:47.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.849+0000 7f54a8a00700 1 Processor -- start 2024-01-22T05:15:47.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.849+0000 7f54a8a00700 1 -- start start 2024-01-22T05:15:47.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.849+0000 7f54a8a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f54a01524f0 0x7f54a0066400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.849+0000 7f54a8a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54a015bad0 0x7f54a015bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.849+0000 7f54a8a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a00a8760 0x7f54a00a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.849+0000 7f54a8a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a00bd3e0 con 0x7f54a015bad0 2024-01-22T05:15:47.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.849+0000 7f54a8a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a0067c50 con 0x7f54a01524f0 2024-01-22T05:15:47.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.849+0000 7f54a8a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a015c440 con 0x7f54a00a8760 2024-01-22T05:15:47.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.849+0000 7f54a5600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54a015bad0 0x7f54a015bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.853+0000 7f54a5600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54a015bad0 0x7f54a015bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45194/0 (socket says 172.21.15.49:45194) 2024-01-22T05:15:47.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.853+0000 7f54a5600700 1 -- 172.21.15.49:0/3782527517 learned_addr learned my addr 172.21.15.49:0/3782527517 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:47.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.853+0000 7f54a6000700 1 --2- 172.21.15.49:0/3782527517 >> v2:172.21.15.110:3300/0 conn(0x7f54a01524f0 0x7f54a0066400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.853+0000 7f54a6a00700 1 --2- 172.21.15.49:0/3782527517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a00a8760 0x7f54a00a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.853+0000 7f54a5600700 1 -- 172.21.15.49:0/3782527517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a00a8760 msgr2=0x7f54a00a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:47.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.853+0000 7f54a5600700 1 --2- 172.21.15.49:0/3782527517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a00a8760 0x7f54a00a8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.853+0000 7f54a5600700 1 -- 172.21.15.49:0/3782527517 >> v2:172.21.15.110:3300/0 conn(0x7f54a01524f0 msgr2=0x7f54a0066400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:47.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.853+0000 7f54a5600700 1 --2- 172.21.15.49:0/3782527517 >> v2:172.21.15.110:3300/0 conn(0x7f54a01524f0 0x7f54a0066400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.853+0000 7f54a5600700 1 -- 172.21.15.49:0/3782527517 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a00bcb40 con 0x7f54a015bad0 2024-01-22T05:15:47.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.853+0000 7f54a5600700 1 --2- 172.21.15.49:0/3782527517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a015bad0 0x7f54a015bf50 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f54a00c4050 tx=0x7f54880090f0).ready entity=mon.0 client_cookie=4ab70fe1c60c4eeb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:47.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.853+0000 7f54a4c00700 1 -- 172.21.15.49:0/3782527517 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800b520 con 0x7f54a015bad0 2024-01-22T05:15:47.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.853+0000 7f54a4c00700 1 -- 172.21.15.49:0/3782527517 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548800b680 con 0x7f54a015bad0 2024-01-22T05:15:47.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.853+0000 7f54a4c00700 1 -- 172.21.15.49:0/3782527517 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800ba00 con 0x7f54a015bad0 2024-01-22T05:15:47.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.853+0000 7f54a8a00700 1 -- 172.21.15.49:0/3782527517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a015bad0 msgr2=0x7f54a015bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.853+0000 7f54a8a00700 1 --2- 172.21.15.49:0/3782527517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a015bad0 0x7f54a015bf50 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f54a00c4050 tx=0x7f54880090f0).stop 2024-01-22T05:15:47.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.857+0000 7f54a8a00700 1 -- 172.21.15.49:0/3782527517 shutdown_connections 2024-01-22T05:15:47.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.857+0000 7f54a8a00700 1 --2- 172.21.15.49:0/3782527517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a00a8760 0x7f54a00a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.857+0000 7f54a8a00700 1 --2- 172.21.15.49:0/3782527517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a015bad0 0x7f54a015bf50 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.857+0000 7f54a8a00700 1 --2- 172.21.15.49:0/3782527517 >> v2:172.21.15.110:3300/0 conn(0x7f54a01524f0 0x7f54a0066400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.857+0000 7f54a8a00700 1 -- 172.21.15.49:0/3782527517 >> 172.21.15.49:0/3782527517 conn(0x7f54a00c6560 msgr2=0x7f54a00c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:47.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.857+0000 7f54a8a00700 1 -- 172.21.15.49:0/3782527517 shutdown_connections 2024-01-22T05:15:47.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.857+0000 7f54a8a00700 1 -- 172.21.15.49:0/3782527517 wait complete. 2024-01-22T05:15:47.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.861+0000 7f54a8a00700 1 Processor -- start 2024-01-22T05:15:47.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.861+0000 7f54a8a00700 1 -- start start 2024-01-22T05:15:47.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.861+0000 7f54a8a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a00a8760 0x7f54a0147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.861+0000 7f54a8a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a01524f0 0x7f54a014db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.861+0000 7f54a8a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a015bad0 0x7f54a01697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.861+0000 7f54a8a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a01685e0 con 0x7f54a015bad0 2024-01-22T05:15:47.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.861+0000 7f54a8a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a0168880 con 0x7f54a00a8760 2024-01-22T05:15:47.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.861+0000 7f54a8a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a0147800 con 0x7f54a01524f0 2024-01-22T05:15:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.861+0000 7f54a6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a015bad0 0x7f54a01697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.861+0000 7f54a6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a015bad0 0x7f54a01697b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45202/0 (socket says 172.21.15.49:45202) 2024-01-22T05:15:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.861+0000 7f54a6a00700 1 -- 172.21.15.49:0/4091228589 learned_addr learned my addr 172.21.15.49:0/4091228589 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.861+0000 7f54a6000700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a00a8760 0x7f54a0147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.861+0000 7f54a5600700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a01524f0 0x7f54a014db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.865+0000 7f54a6a00700 1 -- 172.21.15.49:0/4091228589 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a01524f0 msgr2=0x7f54a014db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.865+0000 7f54a6a00700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a01524f0 0x7f54a014db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.865+0000 7f54a6a00700 1 -- 172.21.15.49:0/4091228589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a00a8760 msgr2=0x7f54a0147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.865+0000 7f54a6a00700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a00a8760 0x7f54a0147310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.865+0000 7f54a6a00700 1 -- 172.21.15.49:0/4091228589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5488009370 con 0x7f54a015bad0 2024-01-22T05:15:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.865+0000 7f54a6000700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a00a8760 0x7f54a0147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:15:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.865+0000 7f54a5600700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a01524f0 0x7f54a014db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.865+0000 7f54a6a00700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a015bad0 0x7f54a01697b0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f5498009fa0 tx=0x7f5498009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.865+0000 7f549d600700 1 -- 172.21.15.49:0/4091228589 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549800ec70 con 0x7f54a015bad0 2024-01-22T05:15:47.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.865+0000 7f549d600700 1 -- 172.21.15.49:0/4091228589 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549800edd0 con 0x7f54a015bad0 2024-01-22T05:15:47.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.865+0000 7f54a8a00700 1 -- 172.21.15.49:0/4091228589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a0148340 con 0x7f54a015bad0 2024-01-22T05:15:47.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.865+0000 7f549d600700 1 -- 172.21.15.49:0/4091228589 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498014610 con 0x7f54a015bad0 2024-01-22T05:15:47.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.865+0000 7f54a8a00700 1 -- 172.21.15.49:0/4091228589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a0148900 con 0x7f54a015bad0 2024-01-22T05:15:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.865+0000 7f549d600700 1 -- 172.21.15.49:0/4091228589 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f549801d3b0 con 0x7f54a015bad0 2024-01-22T05:15:47.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.869+0000 7f549d600700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f547805a510 0x7f547805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.869+0000 7f549d600700 1 -- 172.21.15.49:0/4091228589 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5498074ef0 con 0x7f54a015bad0 2024-01-22T05:15:47.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.869+0000 7f54a6000700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f547805a510 0x7f547805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.869+0000 7f54a6000700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f547805a510 0x7f547805c9d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f54a014d5f0 tx=0x7f5490009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:47.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.869+0000 7f54b2eae740 1 Processor -- start 2024-01-22T05:15:47.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54b2eae740 1 -- start start 2024-01-22T05:15:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54b2eae740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d35c0 0x19d39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54b2eae740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d4170 0x198ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54b2eae740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x198f1b0 0x198f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54b2eae740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x18cc2a0 con 0x19d4170 2024-01-22T05:15:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54b2eae740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x18ef4a0 con 0x19d35c0 2024-01-22T05:15:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54b2eae740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x18b8ce0 con 0x198f1b0 2024-01-22T05:15:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54a5600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d4170 0x198ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54a5600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d4170 0x198ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45214/0 (socket says 172.21.15.49:45214) 2024-01-22T05:15:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54a6000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d35c0 0x19d39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54a5600700 1 -- 172.21.15.49:0/493809569 learned_addr learned my addr 172.21.15.49:0/493809569 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:47.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54a6a00700 1 --2- 172.21.15.49:0/493809569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x198f1b0 0x198f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54a5600700 1 -- 172.21.15.49:0/493809569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x198f1b0 msgr2=0x198f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:47.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54a5600700 1 --2- 172.21.15.49:0/493809569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x198f1b0 0x198f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54a5600700 1 -- 172.21.15.49:0/493809569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d35c0 msgr2=0x19d39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:47.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54a5600700 1 --2- 172.21.15.49:0/493809569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d35c0 0x19d39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.873+0000 7f54a5600700 1 -- 172.21.15.49:0/493809569 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x191d8e0 con 0x19d4170 2024-01-22T05:15:47.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.877+0000 7f54a5600700 1 --2- 172.21.15.49:0/493809569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d4170 0x198ecc0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f5488006fd0 tx=0x7f5488017000).ready entity=mon.0 client_cookie=d43d3078a9811686 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:47.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.877+0000 7f5495c00700 1 -- 172.21.15.49:0/493809569 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54880069b0 con 0x19d4170 2024-01-22T05:15:47.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.877+0000 7f5495c00700 1 -- 172.21.15.49:0/493809569 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5488021070 con 0x19d4170 2024-01-22T05:15:47.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.877+0000 7f5495c00700 1 -- 172.21.15.49:0/493809569 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800bdc0 con 0x19d4170 2024-01-22T05:15:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.877+0000 7f54b2eae740 1 -- 172.21.15.49:0/493809569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d4170 msgr2=0x198ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.877+0000 7f54b2eae740 1 --2- 172.21.15.49:0/493809569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d4170 0x198ecc0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f5488006fd0 tx=0x7f5488017000).stop 2024-01-22T05:15:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.877+0000 7f54b2eae740 1 -- 172.21.15.49:0/493809569 shutdown_connections 2024-01-22T05:15:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.877+0000 7f54b2eae740 1 --2- 172.21.15.49:0/493809569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x198f1b0 0x198f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.877+0000 7f54b2eae740 1 --2- 172.21.15.49:0/493809569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d4170 0x198ecc0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.877+0000 7f54b2eae740 1 --2- 172.21.15.49:0/493809569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d35c0 0x19d39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.877+0000 7f54b2eae740 1 -- 172.21.15.49:0/493809569 >> 172.21.15.49:0/493809569 conn(0x1771640 msgr2=0x19d8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.877+0000 7f54b2eae740 1 -- 172.21.15.49:0/493809569 shutdown_connections 2024-01-22T05:15:47.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.877+0000 7f54b2eae740 1 -- 172.21.15.49:0/493809569 wait complete. 2024-01-22T05:15:47.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.877+0000 7f54b2eae740 1 -- start start 2024-01-22T05:15:47.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.877+0000 7f54b2eae740 1 Processor -- start 2024-01-22T05:15:47.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54b2eae740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x198f1b0 0x19bead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54b2eae740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d35c0 0x19e46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54b2eae740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d4170 0x19d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54b2eae740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x19e4fd0 con 0x19d35c0 2024-01-22T05:15:47.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54b2eae740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x19d10f0 con 0x19d4170 2024-01-22T05:15:47.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54b2eae740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x19d1f50 con 0x198f1b0 2024-01-22T05:15:47.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54b2eae740 10 client.0 ll_register_callbacks cb 0x19499f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:47.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54a5600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d35c0 0x19e46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54a5600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d35c0 0x19e46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45220/0 (socket says 172.21.15.49:45220) 2024-01-22T05:15:47.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54a5600700 1 -- 172.21.15.49:0/2244261719 learned_addr learned my addr 172.21.15.49:0/2244261719 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:47.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54a6000700 1 --2- 172.21.15.49:0/2244261719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x198f1b0 0x19bead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54a6a00700 1 --2- 172.21.15.49:0/2244261719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d4170 0x19d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54a5600700 1 -- 172.21.15.49:0/2244261719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x198f1b0 msgr2=0x19bead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:47.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54a5600700 1 --2- 172.21.15.49:0/2244261719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x198f1b0 0x19bead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54a5600700 1 -- 172.21.15.49:0/2244261719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d4170 msgr2=0x19d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:47.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54a5600700 1 --2- 172.21.15.49:0/2244261719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d4170 0x19d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54a5600700 1 -- 172.21.15.49:0/2244261719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a00bcb40 con 0x19d35c0 2024-01-22T05:15:47.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54a6000700 1 --2- 172.21.15.49:0/2244261719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x198f1b0 0x19bead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:47.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f54a5600700 1 --2- 172.21.15.49:0/2244261719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d35c0 0x19e46d0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f5488009340 tx=0x7f548801f070).ready entity=mon.0 client_cookie=7682814689e233af server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:47.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.881+0000 7f548e000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:15:47.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f548e000700 1 -- 172.21.15.49:0/2244261719 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800b9c0 con 0x19d35c0 2024-01-22T05:15:47.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f54b2eae740 1 -- 172.21.15.49:0/2244261719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x19091f0 con 0x19d35c0 2024-01-22T05:15:47.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f548e000700 1 -- 172.21.15.49:0/2244261719 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5488026650 con 0x19d35c0 2024-01-22T05:15:47.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f548e000700 1 -- 172.21.15.49:0/2244261719 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5488026a20 con 0x19d35c0 2024-01-22T05:15:47.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f54b2eae740 10 client.8559 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:47.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f54b2eae740 1 -- 172.21.15.49:0/2244261719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x190c780 con 0x19d35c0 2024-01-22T05:15:47.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f548e000700 1 -- 172.21.15.49:0/2244261719 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x19091f0 con 0x19d35c0 2024-01-22T05:15:47.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f548e000700 1 -- 172.21.15.49:0/2244261719 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5488009830 con 0x19d35c0 2024-01-22T05:15:47.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f54b2eae740 10 client.8559 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:47.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f54b2eae740 10 client.8559 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-01-22T05:15:47.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f54b2eae740 20 client.8559 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:47.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f54b2eae740 1 --2- 172.21.15.49:0/2244261719 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x1990ab0 0x198c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f54b2eae740 4 client.8559 mds_command: new command op to 8292 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:15:47.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f54b2eae740 1 -- 172.21.15.49:0/2244261719 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x18ff740 con 0x1990ab0 2024-01-22T05:15:47.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f54a6000700 1 --2- 172.21.15.49:0/2244261719 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x1990ab0 0x198c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f548e000700 10 client.8559 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:47.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f54a6000700 1 --2- 172.21.15.49:0/2244261719 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x1990ab0 0x198c810 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b985bfad11c1374 server_cookie=aa060df33ee61cd5 in_seq=0 out_seq=0 2024-01-22T05:15:47.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f548e000700 1 -- 172.21.15.49:0/2244261719 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x18ff740 con 0x1990ab0 2024-01-22T05:15:47.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f548e000700 10 client.8559 handle_command_reply: tid=0 2024-01-22T05:15:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.885+0000 7f54b2eae740 1 client.8559 shutdown 2024-01-22T05:15:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.889+0000 7f54b2eae740 1 -- 172.21.15.49:0/2244261719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d35c0 msgr2=0x19e46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.889+0000 7f54b2eae740 1 --2- 172.21.15.49:0/2244261719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d35c0 0x19e46d0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f5488009340 tx=0x7f548801f070).stop 2024-01-22T05:15:47.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.889+0000 7f54b2eae740 1 -- 172.21.15.49:0/2244261719 shutdown_connections 2024-01-22T05:15:47.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.889+0000 7f54b2eae740 1 --2- 172.21.15.49:0/2244261719 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x1990ab0 0x198c810 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.889+0000 7f54b2eae740 1 --2- 172.21.15.49:0/2244261719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d4170 0x19d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.889+0000 7f54b2eae740 1 --2- 172.21.15.49:0/2244261719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d35c0 0x19e46d0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.889+0000 7f54b2eae740 1 --2- 172.21.15.49:0/2244261719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x198f1b0 0x19bead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.889+0000 7f54b2eae740 1 -- 172.21.15.49:0/2244261719 >> 172.21.15.49:0/2244261719 conn(0x1771640 msgr2=0x19b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:47.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.889+0000 7f548e000700 0 client.8559 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:47.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.889+0000 7f54b2eae740 1 -- 172.21.15.49:0/2244261719 shutdown_connections 2024-01-22T05:15:47.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.889+0000 7f54b2eae740 1 -- 172.21.15.49:0/2244261719 wait complete. 2024-01-22T05:15:47.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.889+0000 7f54b2eae740 20 client.8559 trim_cache size 0 max 16384 2024-01-22T05:15:47.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.905+0000 7f54b2eae740 1 Processor -- start 2024-01-22T05:15:47.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.909+0000 7f54b2eae740 1 -- start start 2024-01-22T05:15:47.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.909+0000 7f54b2eae740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x198f1b0 0x19e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.909+0000 7f54b2eae740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x19d35c0 0x19e4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.909+0000 7f54b2eae740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d4170 0x19d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.909+0000 7f54b2eae740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x198e7a0 con 0x198f1b0 2024-01-22T05:15:47.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.909+0000 7f54b2eae740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x18d03f0 con 0x19d4170 2024-01-22T05:15:47.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.909+0000 7f54b2eae740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x19cf9d0 con 0x19d35c0 2024-01-22T05:15:47.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.909+0000 7f54a6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x198f1b0 0x19e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.909+0000 7f54a6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d4170 0x19d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.909+0000 7f54a5600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x19d35c0 0x19e4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.909+0000 7f54a6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d4170 0x19d2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:44050/0 (socket says 172.21.15.49:44050) 2024-01-22T05:15:47.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.909+0000 7f54a6a00700 1 -- 172.21.15.49:0/2297823505 learned_addr learned my addr 172.21.15.49:0/2297823505 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:47.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54a6a00700 1 -- 172.21.15.49:0/2297823505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x19d35c0 msgr2=0x19e4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:47.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54a6a00700 1 --2- 172.21.15.49:0/2297823505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x19d35c0 0x19e4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54a6a00700 1 -- 172.21.15.49:0/2297823505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x198f1b0 msgr2=0x19e71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:47.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54a6a00700 1 --2- 172.21.15.49:0/2297823505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x198f1b0 0x19e71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54a6a00700 1 -- 172.21.15.49:0/2297823505 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a016a000 con 0x19d4170 2024-01-22T05:15:47.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54a6a00700 1 --2- 172.21.15.49:0/2297823505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d4170 0x19d2860 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f549804c000 tx=0x7f5498020040).ready entity=mon.1 client_cookie=2834c52720249ed0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:47.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f5496600700 1 -- 172.21.15.49:0/2297823505 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498051810 con 0x19d4170 2024-01-22T05:15:47.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f5496600700 1 -- 172.21.15.49:0/2297823505 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549804a470 con 0x19d4170 2024-01-22T05:15:47.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f5496600700 1 -- 172.21.15.49:0/2297823505 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549804b5c0 con 0x19d4170 2024-01-22T05:15:47.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54b2eae740 1 -- 172.21.15.49:0/2297823505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d4170 msgr2=0x19d2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54b2eae740 1 --2- 172.21.15.49:0/2297823505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d4170 0x19d2860 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f549804c000 tx=0x7f5498020040).stop 2024-01-22T05:15:47.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54b2eae740 1 -- 172.21.15.49:0/2297823505 shutdown_connections 2024-01-22T05:15:47.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54b2eae740 1 --2- 172.21.15.49:0/2297823505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x19d4170 0x19d2860 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54b2eae740 1 --2- 172.21.15.49:0/2297823505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x19d35c0 0x19e4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54b2eae740 1 --2- 172.21.15.49:0/2297823505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x198f1b0 0x19e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54b2eae740 1 -- 172.21.15.49:0/2297823505 >> 172.21.15.49:0/2297823505 conn(0x1771640 msgr2=0x19b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:47.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54b2eae740 1 -- 172.21.15.49:0/2297823505 shutdown_connections 2024-01-22T05:15:47.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54b2eae740 1 -- 172.21.15.49:0/2297823505 wait complete. 2024-01-22T05:15:47.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.913+0000 7f54b2eae740 1 -- start start 2024-01-22T05:15:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.917+0000 7f54b2eae740 1 Processor -- start 2024-01-22T05:15:47.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.917+0000 7f54b2eae740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x198f1b0 0x1a3c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.917+0000 7f54b2eae740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x19d35c0 0x1a30330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.917+0000 7f54b2eae740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d4170 0x19b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.917+0000 7f54b2eae740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a3cd40 con 0x19d4170 2024-01-22T05:15:47.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.917+0000 7f54b2eae740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x19d8bf0 con 0x198f1b0 2024-01-22T05:15:47.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.917+0000 7f54b2eae740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x19b4700 con 0x19d35c0 2024-01-22T05:15:47.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.917+0000 7f54b2eae740 10 client.0 ll_register_callbacks cb 0x7f548800b370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:47.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54a6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d4170 0x19b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54a6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d4170 0x19b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45244/0 (socket says 172.21.15.49:45244) 2024-01-22T05:15:47.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54a6a00700 1 -- 172.21.15.49:0/567732472 learned_addr learned my addr 172.21.15.49:0/567732472 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:47.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54a5600700 1 --2- 172.21.15.49:0/567732472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x19d35c0 0x1a30330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54a6000700 1 --2- 172.21.15.49:0/567732472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x198f1b0 0x1a3c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54a6a00700 1 -- 172.21.15.49:0/567732472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x19d35c0 msgr2=0x1a30330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:47.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54a6a00700 1 --2- 172.21.15.49:0/567732472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x19d35c0 0x1a30330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54a6a00700 1 -- 172.21.15.49:0/567732472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x198f1b0 msgr2=0x1a3c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:47.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54a6a00700 1 --2- 172.21.15.49:0/567732472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x198f1b0 0x1a3c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54a6a00700 1 -- 172.21.15.49:0/567732472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a0148900 con 0x19d4170 2024-01-22T05:15:47.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54a6a00700 1 --2- 172.21.15.49:0/567732472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d4170 0x19b4b90 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f5498007fd0 tx=0x7f5498050000).ready entity=mon.0 client_cookie=60dbc98ff7ae5d93 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:47.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f548e000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:15:47.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f548e000700 1 -- 172.21.15.49:0/567732472 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498051810 con 0x19d4170 2024-01-22T05:15:47.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f548e000700 1 -- 172.21.15.49:0/567732472 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f54980480d0 con 0x19d4170 2024-01-22T05:15:47.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54b2eae740 1 -- 172.21.15.49:0/567732472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5488021070 con 0x19d4170 2024-01-22T05:15:47.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f548e000700 1 -- 172.21.15.49:0/567732472 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f549804b240 con 0x19d4170 2024-01-22T05:15:47.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54b2eae740 10 client.8565 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:47.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54b2eae740 1 -- 172.21.15.49:0/567732472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x19079b0 con 0x19d4170 2024-01-22T05:15:47.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f548e000700 1 -- 172.21.15.49:0/567732472 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5488021070 con 0x19d4170 2024-01-22T05:15:47.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f548e000700 1 -- 172.21.15.49:0/567732472 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5498051a60 con 0x19d4170 2024-01-22T05:15:47.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54b2eae740 10 client.8565 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:47.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54b2eae740 10 client.8565 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-01-22T05:15:47.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54b2eae740 20 client.8565 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:47.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54b2eae740 1 --2- 172.21.15.49:0/567732472 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x19d8740 0x19d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:47.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54b2eae740 4 client.8565 mds_command: new command op to 8292 tid=0[{"prefix": "scrub abort"}] 2024-01-22T05:15:47.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54b2eae740 1 -- 172.21.15.49:0/567732472 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x17c85d0 con 0x19d8740 2024-01-22T05:15:47.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.921+0000 7f54a6000700 1 --2- 172.21.15.49:0/567732472 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x19d8740 0x19d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:47.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f54a6000700 1 --2- 172.21.15.49:0/567732472 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x19d8740 0x19d2860 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1018043ff11e4ca9 server_cookie=8c8d4f14f052f6c9 in_seq=0 out_seq=0 2024-01-22T05:15:47.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f548e000700 10 client.8565 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:47.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f548e000700 1 -- 172.21.15.49:0/567732472 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x17c85d0 con 0x19d8740 2024-01-22T05:15:47.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f548e000700 10 client.8565 handle_command_reply: tid=0 2024-01-22T05:15:47.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f54b2eae740 1 client.8565 shutdown 2024-01-22T05:15:47.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f54b2eae740 1 -- 172.21.15.49:0/567732472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d4170 msgr2=0x19b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f54b2eae740 1 --2- 172.21.15.49:0/567732472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d4170 0x19b4b90 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f5498007fd0 tx=0x7f5498050000).stop 2024-01-22T05:15:47.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f54b2eae740 1 -- 172.21.15.49:0/567732472 shutdown_connections 2024-01-22T05:15:47.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f54b2eae740 1 --2- 172.21.15.49:0/567732472 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x19d8740 0x19d2860 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f54b2eae740 1 --2- 172.21.15.49:0/567732472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x19d4170 0x19b4b90 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f548e000700 0 client.8565 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:47.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f54b2eae740 1 --2- 172.21.15.49:0/567732472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x19d35c0 0x1a30330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f54b2eae740 1 --2- 172.21.15.49:0/567732472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x198f1b0 0x1a3c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f54b2eae740 1 -- 172.21.15.49:0/567732472 >> 172.21.15.49:0/567732472 conn(0x1771640 msgr2=0x19e43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:47.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f54b2eae740 1 -- 172.21.15.49:0/567732472 shutdown_connections 2024-01-22T05:15:47.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f54b2eae740 1 -- 172.21.15.49:0/567732472 wait complete. 2024-01-22T05:15:47.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.925+0000 7f54b2eae740 20 client.8565 trim_cache size 0 max 16384 2024-01-22T05:15:47.930 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:15:47.930 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:15:47.930 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:15:47.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.929+0000 7f54a8a00700 1 -- 172.21.15.49:0/4091228589 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f547805a510 msgr2=0x7f547805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.929+0000 7f54a8a00700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f547805a510 0x7f547805c9d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f54a014d5f0 tx=0x7f5490009060).stop 2024-01-22T05:15:47.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.929+0000 7f54a8a00700 1 -- 172.21.15.49:0/4091228589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a015bad0 msgr2=0x7f54a01697b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:47.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.929+0000 7f54a8a00700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a015bad0 0x7f54a01697b0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f5498009fa0 tx=0x7f5498009900).stop 2024-01-22T05:15:47.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.929+0000 7f54a8a00700 1 -- 172.21.15.49:0/4091228589 shutdown_connections 2024-01-22T05:15:47.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.929+0000 7f54a8a00700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f547805a510 0x7f547805c9d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.929+0000 7f54a8a00700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a015bad0 0x7f54a01697b0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.929+0000 7f54a8a00700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a01524f0 0x7f54a014db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.929+0000 7f54a8a00700 1 --2- 172.21.15.49:0/4091228589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a00a8760 0x7f54a0147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:47.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.929+0000 7f54a8a00700 1 -- 172.21.15.49:0/4091228589 >> 172.21.15.49:0/4091228589 conn(0x7f54a00c6560 msgr2=0x7f54a0150920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:47.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.929+0000 7f54a8a00700 1 -- 172.21.15.49:0/4091228589 shutdown_connections 2024-01-22T05:15:47.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:47.929+0000 7f54a8a00700 1 -- 172.21.15.49:0/4091228589 wait complete. 2024-01-22T05:15:47.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub status 2024-01-22T05:15:48.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.117+0000 7f5a03e00700 1 Processor -- start 2024-01-22T05:15:48.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.117+0000 7f5a03e00700 1 -- start start 2024-01-22T05:15:48.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.117+0000 7f5a03e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a041581e0 0x7f5a040c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a03e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a04065bd0 con 0x7f5a040a8e50 2024-01-22T05:15:48.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a03e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a040c18c0 con 0x7f5a040c13d0 2024-01-22T05:15:48.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a03e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a040c1ba0 con 0x7f5a041581e0 2024-01-22T05:15:48.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a03400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5a040a8e50 0x7f5a04066080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59792/0 (socket says 172.21.15.49:59792) 2024-01-22T05:15:48.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a02a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a041581e0 0x7f5a040c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a03400700 1 -- 172.21.15.49:0/105419310 learned_addr learned my addr 172.21.15.49:0/105419310 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:48.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a01600700 1 -- 172.21.15.49:0/105419310 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150632960 0 0) 0x7f5a04065bd0 con 0x7f5a040a8e50 2024-01-22T05:15:48.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a01600700 1 -- 172.21.15.49:0/105419310 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e40033f0 con 0x7f5a040a8e50 2024-01-22T05:15:48.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a01600700 1 -- 172.21.15.49:0/105419310 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327670590 0 0) 0x7f5a040c18c0 con 0x7f5a040c13d0 2024-01-22T05:15:48.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a01600700 1 -- 172.21.15.49:0/105419310 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a04065bd0 con 0x7f5a040c13d0 2024-01-22T05:15:48.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a02a00700 1 -- 172.21.15.49:0/105419310 >> v1:172.21.15.110:6789/0 conn(0x7f5a040c13d0 legacy=0x7f5a040a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a02a00700 1 -- 172.21.15.49:0/105419310 >> v1:172.21.15.49:6789/0 conn(0x7f5a040a8e50 legacy=0x7f5a04066080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a02a00700 1 -- 172.21.15.49:0/105419310 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a040c1e80 con 0x7f5a041581e0 2024-01-22T05:15:48.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a02a00700 1 --2- 172.21.15.49:0/105419310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a041581e0 0x7f5a040c0ee0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f59f4009790 tx=0x7f59f4009060).ready entity=mon.2 client_cookie=54f92a1c1094e48 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:48.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a01600700 1 -- 172.21.15.49:0/105419310 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f40090d0 con 0x7f5a041581e0 2024-01-22T05:15:48.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a01600700 1 -- 172.21.15.49:0/105419310 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f400f510 con 0x7f5a041581e0 2024-01-22T05:15:48.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.121+0000 7f5a01600700 1 -- 172.21.15.49:0/105419310 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f400f890 con 0x7f5a041581e0 2024-01-22T05:15:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.125+0000 7f5a03e00700 1 -- 172.21.15.49:0/105419310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a041581e0 msgr2=0x7f5a040c0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.125+0000 7f5a03e00700 1 --2- 172.21.15.49:0/105419310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a041581e0 0x7f5a040c0ee0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f59f4009790 tx=0x7f59f4009060).stop 2024-01-22T05:15:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.125+0000 7f5a03e00700 1 -- 172.21.15.49:0/105419310 shutdown_connections 2024-01-22T05:15:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.125+0000 7f5a03e00700 1 --2- 172.21.15.49:0/105419310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a041581e0 0x7f5a040c0ee0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.125+0000 7f5a03e00700 1 -- 172.21.15.49:0/105419310 >> 172.21.15.49:0/105419310 conn(0x7f5a040c6540 msgr2=0x7f5a040c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:48.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.125+0000 7f5a03e00700 1 -- 172.21.15.49:0/105419310 shutdown_connections 2024-01-22T05:15:48.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.125+0000 7f5a03e00700 1 -- 172.21.15.49:0/105419310 wait complete. 2024-01-22T05:15:48.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.129+0000 7f5a03e00700 1 Processor -- start 2024-01-22T05:15:48.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.129+0000 7f5a03e00700 1 -- start start 2024-01-22T05:15:48.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.129+0000 7f5a03e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a040a8e50 0x7f5a04156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.129+0000 7f5a03e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a040c13d0 0x7f5a04158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.129+0000 7f5a03e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a041581e0 0x7f5a0415b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.129+0000 7f5a03e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0415a430 con 0x7f5a040a8e50 2024-01-22T05:15:48.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.129+0000 7f5a03e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0415a710 con 0x7f5a040c13d0 2024-01-22T05:15:48.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.129+0000 7f5a03e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0415a9f0 con 0x7f5a041581e0 2024-01-22T05:15:48.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.129+0000 7f5a02a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a040a8e50 0x7f5a04156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.129+0000 7f5a02a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a040a8e50 0x7f5a04156f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45254/0 (socket says 172.21.15.49:45254) 2024-01-22T05:15:48.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.129+0000 7f5a02a00700 1 -- 172.21.15.49:0/2548885812 learned_addr learned my addr 172.21.15.49:0/2548885812 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:48.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.133+0000 7f5a03400700 1 --2- 172.21.15.49:0/2548885812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a041581e0 0x7f5a0415b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.133+0000 7f5a02000700 1 --2- 172.21.15.49:0/2548885812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a040c13d0 0x7f5a04158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.133+0000 7f5a02a00700 1 -- 172.21.15.49:0/2548885812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a041581e0 msgr2=0x7f5a0415b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.133+0000 7f5a02a00700 1 --2- 172.21.15.49:0/2548885812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a041581e0 0x7f5a0415b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.133+0000 7f5a02a00700 1 -- 172.21.15.49:0/2548885812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a040c13d0 msgr2=0x7f5a04158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.133+0000 7f5a02a00700 1 --2- 172.21.15.49:0/2548885812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a040c13d0 0x7f5a04158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.133+0000 7f5a02a00700 1 -- 172.21.15.49:0/2548885812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f40092a0 con 0x7f5a040a8e50 2024-01-22T05:15:48.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.133+0000 7f5a02a00700 1 --2- 172.21.15.49:0/2548885812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a040a8e50 0x7f5a04156f70 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f5a0405f4d0 tx=0x7f59f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:48.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.133+0000 7f59fa000700 1 -- 172.21.15.49:0/2548885812 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f400f890 con 0x7f5a040a8e50 2024-01-22T05:15:48.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.133+0000 7f59fa000700 1 -- 172.21.15.49:0/2548885812 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f400fc50 con 0x7f5a040a8e50 2024-01-22T05:15:48.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.133+0000 7f5a03e00700 1 -- 172.21.15.49:0/2548885812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0415acd0 con 0x7f5a040a8e50 2024-01-22T05:15:48.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.133+0000 7f59fa000700 1 -- 172.21.15.49:0/2548885812 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f401b410 con 0x7f5a040a8e50 2024-01-22T05:15:48.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.133+0000 7f5a03e00700 1 -- 172.21.15.49:0/2548885812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a04157460 con 0x7f5a040a8e50 2024-01-22T05:15:48.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.137+0000 7f59fa000700 1 -- 172.21.15.49:0/2548885812 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f59f401b780 con 0x7f5a040a8e50 2024-01-22T05:15:48.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.137+0000 7f59fa000700 1 --2- 172.21.15.49:0/2548885812 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f59dc05a510 0x7f59dc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.137+0000 7f59fa000700 1 -- 172.21.15.49:0/2548885812 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f59f40761c0 con 0x7f5a040a8e50 2024-01-22T05:15:48.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.137+0000 7f5a02000700 1 --2- 172.21.15.49:0/2548885812 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f59dc05a510 0x7f59dc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.141+0000 7f5a02000700 1 --2- 172.21.15.49:0/2548885812 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f59dc05a510 0x7f59dc05c9d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f5a04159930 tx=0x7f59ec009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:48.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.141+0000 7f5a13e40740 1 Processor -- start 2024-01-22T05:15:48.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.141+0000 7f5a13e40740 1 -- start start 2024-01-22T05:15:48.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.141+0000 7f5a13e40740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25404d0 0x25408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.141+0000 7f5a13e40740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547570 0x25479f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.141+0000 7f5a13e40740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2547ee0 0x25264f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.141+0000 7f5a13e40740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2458540 con 0x25404d0 2024-01-22T05:15:48.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.141+0000 7f5a13e40740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x241be90 con 0x2547570 2024-01-22T05:15:48.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.141+0000 7f5a13e40740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2421d90 con 0x2547ee0 2024-01-22T05:15:48.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a02a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25404d0 0x25408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a02a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25404d0 0x25408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45268/0 (socket says 172.21.15.49:45268) 2024-01-22T05:15:48.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a02a00700 1 -- 172.21.15.49:0/2843742755 learned_addr learned my addr 172.21.15.49:0/2843742755 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:48.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a02000700 1 --2- 172.21.15.49:0/2843742755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547570 0x25479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a03400700 1 --2- 172.21.15.49:0/2843742755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2547ee0 0x25264f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a02a00700 1 -- 172.21.15.49:0/2843742755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2547ee0 msgr2=0x25264f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:48.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a02a00700 1 --2- 172.21.15.49:0/2843742755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2547ee0 0x25264f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a02a00700 1 -- 172.21.15.49:0/2843742755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547570 msgr2=0x25479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:48.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a02a00700 1 --2- 172.21.15.49:0/2843742755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547570 0x25479f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a02a00700 1 -- 172.21.15.49:0/2843742755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x24864c0 con 0x25404d0 2024-01-22T05:15:48.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a02000700 1 --2- 172.21.15.49:0/2843742755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547570 0x25479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:48.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a02a00700 1 --2- 172.21.15.49:0/2843742755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25404d0 0x25408b0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f59f4007fd0 tx=0x7f59f4076040).ready entity=mon.0 client_cookie=ce685e9a9297cc5f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f59f2a00700 1 -- 172.21.15.49:0/2843742755 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f404b7a0 con 0x25404d0 2024-01-22T05:15:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f59f2a00700 1 -- 172.21.15.49:0/2843742755 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f40740b0 con 0x25404d0 2024-01-22T05:15:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f59f2a00700 1 -- 172.21.15.49:0/2843742755 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4074220 con 0x25404d0 2024-01-22T05:15:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a13e40740 1 -- 172.21.15.49:0/2843742755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25404d0 msgr2=0x25408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a13e40740 1 --2- 172.21.15.49:0/2843742755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25404d0 0x25408b0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f59f4007fd0 tx=0x7f59f4076040).stop 2024-01-22T05:15:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a13e40740 1 -- 172.21.15.49:0/2843742755 shutdown_connections 2024-01-22T05:15:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a13e40740 1 --2- 172.21.15.49:0/2843742755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2547ee0 0x25264f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a13e40740 1 --2- 172.21.15.49:0/2843742755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547570 0x25479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a13e40740 1 --2- 172.21.15.49:0/2843742755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25404d0 0x25408b0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a13e40740 1 -- 172.21.15.49:0/2843742755 >> 172.21.15.49:0/2843742755 conn(0x22da680 msgr2=0x24f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:48.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a13e40740 1 -- 172.21.15.49:0/2843742755 shutdown_connections 2024-01-22T05:15:48.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.145+0000 7f5a13e40740 1 -- 172.21.15.49:0/2843742755 wait complete. 2024-01-22T05:15:48.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.149+0000 7f5a13e40740 1 -- start start 2024-01-22T05:15:48.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.149+0000 7f5a13e40740 1 Processor -- start 2024-01-22T05:15:48.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.149+0000 7f5a13e40740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25404d0 0x251a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.149+0000 7f5a13e40740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547570 0x25389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.149+0000 7f5a13e40740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547ee0 0x2550d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.149+0000 7f5a13e40740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x24f8ea0 con 0x2547570 2024-01-22T05:15:48.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.149+0000 7f5a13e40740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x251f780 con 0x2547ee0 2024-01-22T05:15:48.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.149+0000 7f5a13e40740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2523080 con 0x25404d0 2024-01-22T05:15:48.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.149+0000 7f5a13e40740 10 client.0 ll_register_callbacks cb 0x24b25d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:48.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.149+0000 7f5a02000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547570 0x25389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.149+0000 7f5a02000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547570 0x25389c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45270/0 (socket says 172.21.15.49:45270) 2024-01-22T05:15:48.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.149+0000 7f5a02000700 1 -- 172.21.15.49:0/1259979906 learned_addr learned my addr 172.21.15.49:0/1259979906 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:48.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.149+0000 7f5a03400700 1 --2- 172.21.15.49:0/1259979906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547ee0 0x2550d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.149+0000 7f5a02a00700 1 --2- 172.21.15.49:0/1259979906 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25404d0 0x251a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a03400700 1 -- 172.21.15.49:0/1259979906 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25404d0 msgr2=0x251a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:48.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a03400700 1 --2- 172.21.15.49:0/1259979906 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25404d0 0x251a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a03400700 1 -- 172.21.15.49:0/1259979906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547570 msgr2=0x25389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:48.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a03400700 1 --2- 172.21.15.49:0/1259979906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547570 0x25389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a03400700 1 -- 172.21.15.49:0/1259979906 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a04157460 con 0x2547ee0 2024-01-22T05:15:48.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a02000700 1 --2- 172.21.15.49:0/1259979906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547570 0x25389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:15:48.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a03400700 1 --2- 172.21.15.49:0/1259979906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547ee0 0x2550d30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f59fc001460 tx=0x7f59fc009040).ready entity=mon.1 client_cookie=972a521e5a43beeb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:48.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f59eb400700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-01-22T05:15:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f59eb400700 1 -- 172.21.15.49:0/1259979906 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc013540 con 0x2547ee0 2024-01-22T05:15:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f59eb400700 1 -- 172.21.15.49:0/1259979906 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f59fc0136a0 con 0x2547ee0 2024-01-22T05:15:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a13e40740 1 -- 172.21.15.49:0/1259979906 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2472230 con 0x2547ee0 2024-01-22T05:15:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f59eb400700 1 -- 172.21.15.49:0/1259979906 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59fc013a70 con 0x2547ee0 2024-01-22T05:15:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a13e40740 10 client.8464 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a13e40740 1 -- 172.21.15.49:0/1259979906 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x24757c0 con 0x2547ee0 2024-01-22T05:15:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f59eb400700 1 -- 172.21.15.49:0/1259979906 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2472230 con 0x2547ee0 2024-01-22T05:15:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f59eb400700 1 -- 172.21.15.49:0/1259979906 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f59fc013bd0 con 0x2547ee0 2024-01-22T05:15:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a13e40740 10 client.8464 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a13e40740 10 client.8464 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-01-22T05:15:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a13e40740 20 client.8464 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:48.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a13e40740 1 --2- 172.21.15.49:0/1259979906 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x251fe40 0x2520250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a13e40740 4 client.8464 mds_command: new command op to 8292 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:15:48.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a13e40740 1 -- 172.21.15.49:0/1259979906 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2468780 con 0x251fe40 2024-01-22T05:15:48.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.153+0000 7f5a02a00700 1 --2- 172.21.15.49:0/1259979906 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x251fe40 0x2520250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f5a02a00700 1 --2- 172.21.15.49:0/1259979906 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x251fe40 0x2520250 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=790ca1fc748ccce6 server_cookie=79a3ace76acc366f in_seq=0 out_seq=0 2024-01-22T05:15:48.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f59eb400700 10 client.8464 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:48.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f59eb400700 1 -- 172.21.15.49:0/1259979906 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2468780 con 0x251fe40 2024-01-22T05:15:48.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f59eb400700 10 client.8464 handle_command_reply: tid=0 2024-01-22T05:15:48.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f5a13e40740 1 client.8464 shutdown 2024-01-22T05:15:48.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f5a13e40740 1 -- 172.21.15.49:0/1259979906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547ee0 msgr2=0x2550d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f5a13e40740 1 --2- 172.21.15.49:0/1259979906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547ee0 0x2550d30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f59fc001460 tx=0x7f59fc009040).stop 2024-01-22T05:15:48.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f5a13e40740 1 -- 172.21.15.49:0/1259979906 shutdown_connections 2024-01-22T05:15:48.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f5a13e40740 1 --2- 172.21.15.49:0/1259979906 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x251fe40 0x2520250 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f5a13e40740 1 --2- 172.21.15.49:0/1259979906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547ee0 0x2550d30 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f59eb400700 0 client.8464 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:48.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f5a13e40740 1 --2- 172.21.15.49:0/1259979906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547570 0x25389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f5a13e40740 1 --2- 172.21.15.49:0/1259979906 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25404d0 0x251a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f5a13e40740 1 -- 172.21.15.49:0/1259979906 >> 172.21.15.49:0/1259979906 conn(0x22da680 msgr2=0x2525450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:48.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f5a13e40740 1 -- 172.21.15.49:0/1259979906 shutdown_connections 2024-01-22T05:15:48.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f5a13e40740 1 -- 172.21.15.49:0/1259979906 wait complete. 2024-01-22T05:15:48.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.157+0000 7f5a13e40740 20 client.8464 trim_cache size 0 max 16384 2024-01-22T05:15:48.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.177+0000 7f5a13e40740 1 Processor -- start 2024-01-22T05:15:48.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.177+0000 7f5a13e40740 1 -- start start 2024-01-22T05:15:48.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.177+0000 7f5a13e40740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25404d0 0x24fa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.177+0000 7f5a13e40740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2547570 0x24f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.177+0000 7f5a13e40740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547ee0 0x2521a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.177+0000 7f5a13e40740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2524b00 con 0x2547ee0 2024-01-22T05:15:48.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.177+0000 7f5a13e40740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a040599d0 con 0x25404d0 2024-01-22T05:15:48.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.177+0000 7f5a13e40740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x24f01a0 con 0x2547570 2024-01-22T05:15:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.177+0000 7f5a03400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547ee0 0x2521a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.177+0000 7f5a03400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547ee0 0x2521a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45274/0 (socket says 172.21.15.49:45274) 2024-01-22T05:15:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.177+0000 7f5a03400700 1 -- 172.21.15.49:0/20462279 learned_addr learned my addr 172.21.15.49:0/20462279 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a02a00700 1 --2- 172.21.15.49:0/20462279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25404d0 0x24fa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a02000700 1 --2- 172.21.15.49:0/20462279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2547570 0x24f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a03400700 1 -- 172.21.15.49:0/20462279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2547570 msgr2=0x24f8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a03400700 1 --2- 172.21.15.49:0/20462279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2547570 0x24f8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a03400700 1 -- 172.21.15.49:0/20462279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25404d0 msgr2=0x24fa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a03400700 1 --2- 172.21.15.49:0/20462279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25404d0 0x24fa1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a03400700 1 -- 172.21.15.49:0/20462279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0415bd20 con 0x2547ee0 2024-01-22T05:15:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a02000700 1 --2- 172.21.15.49:0/20462279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2547570 0x24f8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:48.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a03400700 1 --2- 172.21.15.49:0/20462279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547ee0 0x2521a20 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f59fc005c30 tx=0x7f59fc01d000).ready entity=mon.0 client_cookie=68e678e0c27b863d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:48.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f59f3400700 1 -- 172.21.15.49:0/20462279 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc015420 con 0x2547ee0 2024-01-22T05:15:48.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f59f3400700 1 -- 172.21.15.49:0/20462279 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59fc001250 con 0x2547ee0 2024-01-22T05:15:48.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f59f3400700 1 -- 172.21.15.49:0/20462279 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc013a70 con 0x2547ee0 2024-01-22T05:15:48.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a13e40740 1 -- 172.21.15.49:0/20462279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547ee0 msgr2=0x2521a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a13e40740 1 --2- 172.21.15.49:0/20462279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547ee0 0x2521a20 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f59fc005c30 tx=0x7f59fc01d000).stop 2024-01-22T05:15:48.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a13e40740 1 -- 172.21.15.49:0/20462279 shutdown_connections 2024-01-22T05:15:48.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a13e40740 1 --2- 172.21.15.49:0/20462279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547ee0 0x2521a20 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a13e40740 1 --2- 172.21.15.49:0/20462279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2547570 0x24f8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a13e40740 1 --2- 172.21.15.49:0/20462279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25404d0 0x24fa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a13e40740 1 -- 172.21.15.49:0/20462279 >> 172.21.15.49:0/20462279 conn(0x22da680 msgr2=0x25239a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:48.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a13e40740 1 -- 172.21.15.49:0/20462279 shutdown_connections 2024-01-22T05:15:48.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a13e40740 1 -- 172.21.15.49:0/20462279 wait complete. 2024-01-22T05:15:48.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.181+0000 7f5a13e40740 1 -- start start 2024-01-22T05:15:48.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.185+0000 7f5a13e40740 1 Processor -- start 2024-01-22T05:15:48.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.185+0000 7f5a13e40740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25404d0 0x251cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.185+0000 7f5a13e40740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547570 0x2521de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.185+0000 7f5a13e40740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547ee0 0x25a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.185+0000 7f5a13e40740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x253f4f0 con 0x2547570 2024-01-22T05:15:48.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.185+0000 7f5a13e40740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x251d5d0 con 0x2547ee0 2024-01-22T05:15:48.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.185+0000 7f5a13e40740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x253b080 con 0x25404d0 2024-01-22T05:15:48.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.185+0000 7f5a13e40740 10 client.0 ll_register_callbacks cb 0x7f59fc005b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:48.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.185+0000 7f5a02000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547570 0x2521de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.185+0000 7f5a02000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547570 0x2521de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45288/0 (socket says 172.21.15.49:45288) 2024-01-22T05:15:48.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.185+0000 7f5a02000700 1 -- 172.21.15.49:0/2493302266 learned_addr learned my addr 172.21.15.49:0/2493302266 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:48.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.185+0000 7f5a03400700 1 --2- 172.21.15.49:0/2493302266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547ee0 0x25a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.185+0000 7f5a02a00700 1 --2- 172.21.15.49:0/2493302266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25404d0 0x251cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a02000700 1 -- 172.21.15.49:0/2493302266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25404d0 msgr2=0x251cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:48.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a02000700 1 --2- 172.21.15.49:0/2493302266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25404d0 0x251cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a02000700 1 -- 172.21.15.49:0/2493302266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547ee0 msgr2=0x25a5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:48.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a02000700 1 --2- 172.21.15.49:0/2493302266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547ee0 0x25a5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a02000700 1 -- 172.21.15.49:0/2493302266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x24757c0 con 0x2547570 2024-01-22T05:15:48.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a02000700 1 --2- 172.21.15.49:0/2493302266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547570 0x2521de0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f59ec015540 tx=0x7f59ec012000).ready entity=mon.0 client_cookie=8e5fee743ec2e8d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:48.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f59eb400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:15:48.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f59eb400700 1 -- 172.21.15.49:0/2493302266 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec012590 con 0x2547570 2024-01-22T05:15:48.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a13e40740 1 -- 172.21.15.49:0/2493302266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f59f40740b0 con 0x2547570 2024-01-22T05:15:48.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f59eb400700 1 -- 172.21.15.49:0/2493302266 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f59ec025e00 con 0x2547570 2024-01-22T05:15:48.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f59eb400700 1 -- 172.21.15.49:0/2493302266 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59ec012900 con 0x2547570 2024-01-22T05:15:48.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a13e40740 10 client.8583 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:48.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a13e40740 1 -- 172.21.15.49:0/2493302266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x24709f0 con 0x2547570 2024-01-22T05:15:48.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f59eb400700 1 -- 172.21.15.49:0/2493302266 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f40740b0 con 0x2547570 2024-01-22T05:15:48.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f59eb400700 1 -- 172.21.15.49:0/2493302266 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f59ec022070 con 0x2547570 2024-01-22T05:15:48.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a13e40740 10 client.8583 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:48.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a13e40740 10 client.8583 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-01-22T05:15:48.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a13e40740 20 client.8583 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:48.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a13e40740 1 --2- 172.21.15.49:0/2493302266 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2541970 0x25a6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a13e40740 4 client.8583 mds_command: new command op to 8292 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:15:48.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a13e40740 1 -- 172.21.15.49:0/2493302266 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x2331610 con 0x2541970 2024-01-22T05:15:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.189+0000 7f5a02a00700 1 --2- 172.21.15.49:0/2493302266 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2541970 0x25a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a02a00700 1 --2- 172.21.15.49:0/2493302266 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2541970 0x25a6240 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=aa86004e5ce6fe4c server_cookie=4b1a184b0ffaba50 in_seq=0 out_seq=0 2024-01-22T05:15:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f59eb400700 10 client.8583 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f59eb400700 1 -- 172.21.15.49:0/2493302266 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+69 (crc 0 0 0) 0x2331610 con 0x2541970 2024-01-22T05:15:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f59eb400700 10 client.8583 handle_command_reply: tid=0 2024-01-22T05:15:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a13e40740 1 client.8583 shutdown 2024-01-22T05:15:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a13e40740 1 -- 172.21.15.49:0/2493302266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547570 msgr2=0x2521de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a13e40740 1 --2- 172.21.15.49:0/2493302266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547570 0x2521de0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f59ec015540 tx=0x7f59ec012000).stop 2024-01-22T05:15:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a13e40740 1 -- 172.21.15.49:0/2493302266 shutdown_connections 2024-01-22T05:15:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a13e40740 1 --2- 172.21.15.49:0/2493302266 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2541970 0x25a6240 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a13e40740 1 --2- 172.21.15.49:0/2493302266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2547ee0 0x25a5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a13e40740 1 --2- 172.21.15.49:0/2493302266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2547570 0x2521de0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a13e40740 1 --2- 172.21.15.49:0/2493302266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25404d0 0x251cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a13e40740 1 -- 172.21.15.49:0/2493302266 >> 172.21.15.49:0/2493302266 conn(0x22da680 msgr2=0x24fb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:48.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f59eb400700 0 client.8583 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:48.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a13e40740 1 -- 172.21.15.49:0/2493302266 shutdown_connections 2024-01-22T05:15:48.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a13e40740 1 -- 172.21.15.49:0/2493302266 wait complete. 2024-01-22T05:15:48.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a13e40740 20 client.8583 trim_cache size 0 max 16384 2024-01-22T05:15:48.200 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:15:48.200 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-01-22T05:15:48.200 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-01-22T05:15:48.200 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:15:48.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a03e00700 1 -- 172.21.15.49:0/2548885812 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f59dc05a510 msgr2=0x7f59dc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a03e00700 1 --2- 172.21.15.49:0/2548885812 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f59dc05a510 0x7f59dc05c9d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f5a04159930 tx=0x7f59ec009040).stop 2024-01-22T05:15:48.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a03e00700 1 -- 172.21.15.49:0/2548885812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a040a8e50 msgr2=0x7f5a04156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a03e00700 1 --2- 172.21.15.49:0/2548885812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a040a8e50 0x7f5a04156f70 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f5a0405f4d0 tx=0x7f59f4017000).stop 2024-01-22T05:15:48.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a03e00700 1 -- 172.21.15.49:0/2548885812 shutdown_connections 2024-01-22T05:15:48.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a03e00700 1 --2- 172.21.15.49:0/2548885812 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f59dc05a510 0x7f59dc05c9d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a03e00700 1 --2- 172.21.15.49:0/2548885812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a041581e0 0x7f5a0415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a03e00700 1 --2- 172.21.15.49:0/2548885812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a040c13d0 0x7f5a04158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.193+0000 7f5a03e00700 1 --2- 172.21.15.49:0/2548885812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a040a8e50 0x7f5a04156f70 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.197+0000 7f5a03e00700 1 -- 172.21.15.49:0/2548885812 >> 172.21.15.49:0/2548885812 conn(0x7f5a040c6540 msgr2=0x7f5a04066080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:48.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.197+0000 7f5a03e00700 1 -- 172.21.15.49:0/2548885812 shutdown_connections 2024-01-22T05:15:48.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.197+0000 7f5a03e00700 1 -- 172.21.15.49:0/2548885812 wait complete. 2024-01-22T05:15:48.222 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:15:48.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.389+0000 7f98b0c00700 1 Processor -- start 2024-01-22T05:15:48.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.389+0000 7f98b0c00700 1 -- start start 2024-01-22T05:15:48.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98b0c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f98ac1554f0 0x7f98ac1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98b0c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98ac067a90 0x7f98ac067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98b0c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f98ac151dc0 0x7f98ac152250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98b0c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac0693b0 con 0x7f98ac151dc0 2024-01-22T05:15:48.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98b0c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac0687a0 con 0x7f98ac1554f0 2024-01-22T05:15:48.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98b0c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac068a80 con 0x7f98ac067a90 2024-01-22T05:15:48.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98aa800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f98ac151dc0 0x7f98ac152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98a9e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f98ac1554f0 0x7f98ac1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98a9e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f98ac1554f0 0x7f98ac1558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:44110/0 (socket says 172.21.15.49:44110) 2024-01-22T05:15:48.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98a9e00700 1 -- 172.21.15.49:0/3485632614 learned_addr learned my addr 172.21.15.49:0/3485632614 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:48.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98a9400700 1 --2- 172.21.15.49:0/3485632614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98ac067a90 0x7f98ac067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98aa800700 1 -- 172.21.15.49:0/3485632614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98ac067a90 msgr2=0x7f98ac067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:48.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98aa800700 1 --2- 172.21.15.49:0/3485632614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98ac067a90 0x7f98ac067ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98aa800700 1 -- 172.21.15.49:0/3485632614 >> v2:172.21.15.110:3300/0 conn(0x7f98ac1554f0 msgr2=0x7f98ac1558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:48.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98aa800700 1 --2- 172.21.15.49:0/3485632614 >> v2:172.21.15.110:3300/0 conn(0x7f98ac1554f0 0x7f98ac1558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98aa800700 1 -- 172.21.15.49:0/3485632614 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac068d60 con 0x7f98ac151dc0 2024-01-22T05:15:48.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98a9e00700 1 --2- 172.21.15.49:0/3485632614 >> v2:172.21.15.110:3300/0 conn(0x7f98ac1554f0 0x7f98ac1558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:15:48.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98aa800700 1 --2- 172.21.15.49:0/3485632614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98ac151dc0 0x7f98ac152250 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7f98ac156620 tx=0x7f98a4009780).ready entity=mon.0 client_cookie=a450469293541395 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:48.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98a8a00700 1 -- 172.21.15.49:0/3485632614 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a400e070 con 0x7f98ac151dc0 2024-01-22T05:15:48.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98a8a00700 1 -- 172.21.15.49:0/3485632614 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a400bab0 con 0x7f98ac151dc0 2024-01-22T05:15:48.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.393+0000 7f98a8a00700 1 -- 172.21.15.49:0/3485632614 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a400be30 con 0x7f98ac151dc0 2024-01-22T05:15:48.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.397+0000 7f98b0c00700 1 -- 172.21.15.49:0/3485632614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98ac151dc0 msgr2=0x7f98ac152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.397+0000 7f98b0c00700 1 --2- 172.21.15.49:0/3485632614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98ac151dc0 0x7f98ac152250 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7f98ac156620 tx=0x7f98a4009780).stop 2024-01-22T05:15:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.397+0000 7f98b0c00700 1 -- 172.21.15.49:0/3485632614 shutdown_connections 2024-01-22T05:15:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.397+0000 7f98b0c00700 1 --2- 172.21.15.49:0/3485632614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98ac151dc0 0x7f98ac152250 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.397+0000 7f98b0c00700 1 --2- 172.21.15.49:0/3485632614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98ac067a90 0x7f98ac067ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.397+0000 7f98b0c00700 1 --2- 172.21.15.49:0/3485632614 >> v2:172.21.15.110:3300/0 conn(0x7f98ac1554f0 0x7f98ac1558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.397+0000 7f98b0c00700 1 -- 172.21.15.49:0/3485632614 >> 172.21.15.49:0/3485632614 conn(0x7f98ac0c8710 msgr2=0x7f98ac0c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:48.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.397+0000 7f98b0c00700 1 -- 172.21.15.49:0/3485632614 shutdown_connections 2024-01-22T05:15:48.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.397+0000 7f98b0c00700 1 -- 172.21.15.49:0/3485632614 wait complete. 2024-01-22T05:15:48.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.401+0000 7f98b0c00700 1 Processor -- start 2024-01-22T05:15:48.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.401+0000 7f98b0c00700 1 -- start start 2024-01-22T05:15:48.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98b0c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98ac067a90 0x7f98ac14eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98b0c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98ac151dc0 0x7f98ac0a9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98b0c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98ac1554f0 0x7f98ac0a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98b0c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0aa020 con 0x7f98ac151dc0 2024-01-22T05:15:48.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98b0c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0ae610 con 0x7f98ac067a90 2024-01-22T05:15:48.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98b0c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0bf740 con 0x7f98ac1554f0 2024-01-22T05:15:48.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98a9400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98ac151dc0 0x7f98ac0a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98a9400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98ac151dc0 0x7f98ac0a9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45310/0 (socket says 172.21.15.49:45310) 2024-01-22T05:15:48.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98a9400700 1 -- 172.21.15.49:0/141194117 learned_addr learned my addr 172.21.15.49:0/141194117 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:48.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98a9e00700 1 --2- 172.21.15.49:0/141194117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98ac067a90 0x7f98ac14eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98aa800700 1 --2- 172.21.15.49:0/141194117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98ac1554f0 0x7f98ac0a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98a9400700 1 -- 172.21.15.49:0/141194117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98ac1554f0 msgr2=0x7f98ac0a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98a9400700 1 --2- 172.21.15.49:0/141194117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98ac1554f0 0x7f98ac0a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98a9400700 1 -- 172.21.15.49:0/141194117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98ac067a90 msgr2=0x7f98ac14eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98a9400700 1 --2- 172.21.15.49:0/141194117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98ac067a90 0x7f98ac14eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98a9400700 1 -- 172.21.15.49:0/141194117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c009300 con 0x7f98ac151dc0 2024-01-22T05:15:48.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98a9400700 1 --2- 172.21.15.49:0/141194117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98ac151dc0 0x7f98ac0a9640 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f989400e900 tx=0x7f9894009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:48.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98a1600700 1 -- 172.21.15.49:0/141194117 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989400c640 con 0x7f98ac151dc0 2024-01-22T05:15:48.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98a1600700 1 -- 172.21.15.49:0/141194117 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989400c7a0 con 0x7f98ac151dc0 2024-01-22T05:15:48.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98b0c00700 1 -- 172.21.15.49:0/141194117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a4009a20 con 0x7f98ac151dc0 2024-01-22T05:15:48.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98a1600700 1 -- 172.21.15.49:0/141194117 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989400cb20 con 0x7f98ac151dc0 2024-01-22T05:15:48.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.405+0000 7f98b0c00700 1 -- 172.21.15.49:0/141194117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac0bfd00 con 0x7f98ac151dc0 2024-01-22T05:15:48.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.409+0000 7f98b0c00700 1 -- 172.21.15.49:0/141194117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ac047060 con 0x7f98ac151dc0 2024-01-22T05:15:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.409+0000 7f98a1600700 1 -- 172.21.15.49:0/141194117 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f989401b400 con 0x7f98ac151dc0 2024-01-22T05:15:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.409+0000 7f98a1600700 1 --2- 172.21.15.49:0/141194117 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f988405a540 0x7f988405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.409+0000 7f98a1600700 1 -- 172.21.15.49:0/141194117 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9894074d90 con 0x7f98ac151dc0 2024-01-22T05:15:48.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.409+0000 7f98a9e00700 1 --2- 172.21.15.49:0/141194117 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f988405a540 0x7f988405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.413+0000 7f98a9e00700 1 --2- 172.21.15.49:0/141194117 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f988405a540 0x7f988405ca00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f989c0092d0 tx=0x7f989c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:48.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.417+0000 7f98a1600700 1 -- 172.21.15.49:0/141194117 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9894048370 con 0x7f98ac151dc0 2024-01-22T05:15:48.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.633+0000 7f98b0c00700 1 -- 172.21.15.49:0/141194117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98ac069a00 con 0x7f98ac151dc0 2024-01-22T05:15:48.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.633+0000 7f98a1600700 1 -- 172.21.15.49:0/141194117 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4503 (secure 0 0 0) 0x7f9894016070 con 0x7f98ac151dc0 2024-01-22T05:15:48.639 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:48.639 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:14:58.925818+0000","modified":"2024-01-22T05:15:02.323695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8292":{"gid":8292,"name":"a","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3036262557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3036262557},{"type":"v1","addr":"172.21.15.49:6837","nonce":3036262557}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-22T05:15:48.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.637+0000 7f98b0c00700 1 -- 172.21.15.49:0/141194117 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f988405a540 msgr2=0x7f988405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.637+0000 7f98b0c00700 1 --2- 172.21.15.49:0/141194117 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f988405a540 0x7f988405ca00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f989c0092d0 tx=0x7f989c008040).stop 2024-01-22T05:15:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.637+0000 7f98b0c00700 1 -- 172.21.15.49:0/141194117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98ac151dc0 msgr2=0x7f98ac0a9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.637+0000 7f98b0c00700 1 --2- 172.21.15.49:0/141194117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98ac151dc0 0x7f98ac0a9640 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f989400e900 tx=0x7f9894009060).stop 2024-01-22T05:15:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.637+0000 7f98b0c00700 1 -- 172.21.15.49:0/141194117 shutdown_connections 2024-01-22T05:15:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.637+0000 7f98b0c00700 1 --2- 172.21.15.49:0/141194117 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f988405a540 0x7f988405ca00 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.637+0000 7f98b0c00700 1 --2- 172.21.15.49:0/141194117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98ac1554f0 0x7f98ac0a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.637+0000 7f98b0c00700 1 --2- 172.21.15.49:0/141194117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98ac151dc0 0x7f98ac0a9640 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.637+0000 7f98b0c00700 1 --2- 172.21.15.49:0/141194117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98ac067a90 0x7f98ac14eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.637+0000 7f98b0c00700 1 -- 172.21.15.49:0/141194117 >> 172.21.15.49:0/141194117 conn(0x7f98ac0c8710 msgr2=0x7f98ac0a7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:48.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.637+0000 7f98b0c00700 1 -- 172.21.15.49:0/141194117 shutdown_connections 2024-01-22T05:15:48.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.637+0000 7f98b0c00700 1 -- 172.21.15.49:0/141194117 wait complete. 2024-01-22T05:15:48.646 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2024-01-22T05:15:48.663 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-01-22T05:15:48.663 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:15:48.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.817+0000 7ff4d0a00700 1 Processor -- start 2024-01-22T05:15:48.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.817+0000 7ff4d0a00700 1 -- start start 2024-01-22T05:15:48.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4d0a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff4c80be6a0 0x7ff4c80c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4d0a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff4c8064690 0x7ff4c8064af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4d0a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c8151370 0x7ff4c8151800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4d0a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c80be210 con 0x7ff4c80be6a0 2024-01-22T05:15:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4d0a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c80bd650 con 0x7ff4c8064690 2024-01-22T05:15:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4d0a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80bd8e0 con 0x7ff4c8151370 2024-01-22T05:15:48.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4ce000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff4c80be6a0 0x7ff4c80c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4cf400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c8151370 0x7ff4c8151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4ce000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff4c80be6a0 0x7ff4c80c2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45326/0 (socket says 172.21.15.49:45326) 2024-01-22T05:15:48.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4ce000700 1 -- 172.21.15.49:0/621969108 learned_addr learned my addr 172.21.15.49:0/621969108 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:48.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4cd600700 1 --2- 172.21.15.49:0/621969108 >> v2:172.21.15.110:3300/0 conn(0x7ff4c8064690 0x7ff4c8064af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4cf400700 1 -- 172.21.15.49:0/621969108 >> v2:172.21.15.110:3300/0 conn(0x7ff4c8064690 msgr2=0x7ff4c8064af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:48.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4cf400700 1 --2- 172.21.15.49:0/621969108 >> v2:172.21.15.110:3300/0 conn(0x7ff4c8064690 0x7ff4c8064af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4cf400700 1 -- 172.21.15.49:0/621969108 >> v2:172.21.15.49:3300/0 conn(0x7ff4c80be6a0 msgr2=0x7ff4c80c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:48.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4cf400700 1 --2- 172.21.15.49:0/621969108 >> v2:172.21.15.49:3300/0 conn(0x7ff4c80be6a0 0x7ff4c80c2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4cf400700 1 -- 172.21.15.49:0/621969108 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c80bdbc0 con 0x7ff4c8151370 2024-01-22T05:15:48.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4cf400700 1 --2- 172.21.15.49:0/621969108 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c8151370 0x7ff4c8151800 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7ff4c80c2290 tx=0x7ff4c0009780).ready entity=mon.2 client_cookie=fd79320ac9a7ee51 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:48.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.821+0000 7ff4ccc00700 1 -- 172.21.15.49:0/621969108 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000e070 con 0x7ff4c8151370 2024-01-22T05:15:48.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.825+0000 7ff4ccc00700 1 -- 172.21.15.49:0/621969108 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c000bab0 con 0x7ff4c8151370 2024-01-22T05:15:48.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.825+0000 7ff4ccc00700 1 -- 172.21.15.49:0/621969108 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000be30 con 0x7ff4c8151370 2024-01-22T05:15:48.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.825+0000 7ff4d0a00700 1 -- 172.21.15.49:0/621969108 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c8151370 msgr2=0x7ff4c8151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.825+0000 7ff4d0a00700 1 --2- 172.21.15.49:0/621969108 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c8151370 0x7ff4c8151800 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7ff4c80c2290 tx=0x7ff4c0009780).stop 2024-01-22T05:15:48.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.825+0000 7ff4d0a00700 1 -- 172.21.15.49:0/621969108 shutdown_connections 2024-01-22T05:15:48.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.825+0000 7ff4d0a00700 1 --2- 172.21.15.49:0/621969108 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c8151370 0x7ff4c8151800 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.825+0000 7ff4d0a00700 1 --2- 172.21.15.49:0/621969108 >> v2:172.21.15.110:3300/0 conn(0x7ff4c8064690 0x7ff4c8064af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.825+0000 7ff4d0a00700 1 --2- 172.21.15.49:0/621969108 >> v2:172.21.15.49:3300/0 conn(0x7ff4c80be6a0 0x7ff4c80c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.825+0000 7ff4d0a00700 1 -- 172.21.15.49:0/621969108 >> 172.21.15.49:0/621969108 conn(0x7ff4c80c87f0 msgr2=0x7ff4c80c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.825+0000 7ff4d0a00700 1 -- 172.21.15.49:0/621969108 shutdown_connections 2024-01-22T05:15:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.825+0000 7ff4d0a00700 1 -- 172.21.15.49:0/621969108 wait complete. 2024-01-22T05:15:48.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.829+0000 7ff4d0a00700 1 Processor -- start 2024-01-22T05:15:48.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.829+0000 7ff4d0a00700 1 -- start start 2024-01-22T05:15:48.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.829+0000 7ff4d0a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c8064690 0x7ff4c8164e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.829+0000 7ff4d0a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c80be6a0 0x7ff4c80c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.829+0000 7ff4d0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c8151370 0x7ff4c80c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.829+0000 7ff4d0a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80c1c10 con 0x7ff4c8151370 2024-01-22T05:15:48.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.829+0000 7ff4d0a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c8167070 con 0x7ff4c8064690 2024-01-22T05:15:48.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.829+0000 7ff4d0a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80ac780 con 0x7ff4c80be6a0 2024-01-22T05:15:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.829+0000 7ff4cf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c8151370 0x7ff4c80c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.829+0000 7ff4cf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c8151370 0x7ff4c80c1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45328/0 (socket says 172.21.15.49:45328) 2024-01-22T05:15:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.829+0000 7ff4cf400700 1 -- 172.21.15.49:0/3676632647 learned_addr learned my addr 172.21.15.49:0/3676632647 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.829+0000 7ff4ce000700 1 --2- 172.21.15.49:0/3676632647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c8064690 0x7ff4c8164e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.829+0000 7ff4cd600700 1 --2- 172.21.15.49:0/3676632647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c80be6a0 0x7ff4c80c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.833+0000 7ff4cf400700 1 -- 172.21.15.49:0/3676632647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c80be6a0 msgr2=0x7ff4c80c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.833+0000 7ff4cf400700 1 --2- 172.21.15.49:0/3676632647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c80be6a0 0x7ff4c80c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.833+0000 7ff4cf400700 1 -- 172.21.15.49:0/3676632647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c8064690 msgr2=0x7ff4c8164e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:48.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.833+0000 7ff4cf400700 1 --2- 172.21.15.49:0/3676632647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c8064690 0x7ff4c8164e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:48.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.833+0000 7ff4cf400700 1 -- 172.21.15.49:0/3676632647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c0009a20 con 0x7ff4c8151370 2024-01-22T05:15:48.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.833+0000 7ff4cf400700 1 --2- 172.21.15.49:0/3676632647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c8151370 0x7ff4c80c1720 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7ff4c000b610 tx=0x7ff4c0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:48.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.833+0000 7ff4c5600700 1 -- 172.21.15.49:0/3676632647 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0013e70 con 0x7ff4c8151370 2024-01-22T05:15:48.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.833+0000 7ff4c5600700 1 -- 172.21.15.49:0/3676632647 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c001d630 con 0x7ff4c8151370 2024-01-22T05:15:48.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.833+0000 7ff4d0a00700 1 -- 172.21.15.49:0/3676632647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c814cb70 con 0x7ff4c8151370 2024-01-22T05:15:48.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.833+0000 7ff4c5600700 1 -- 172.21.15.49:0/3676632647 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c001da10 con 0x7ff4c8151370 2024-01-22T05:15:48.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.833+0000 7ff4d0a00700 1 -- 172.21.15.49:0/3676632647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c80abe50 con 0x7ff4c8151370 2024-01-22T05:15:48.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.833+0000 7ff4d0a00700 1 -- 172.21.15.49:0/3676632647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c8047060 con 0x7ff4c8151370 2024-01-22T05:15:48.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.837+0000 7ff4c5600700 1 -- 172.21.15.49:0/3676632647 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff4c0003040 con 0x7ff4c8151370 2024-01-22T05:15:48.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.837+0000 7ff4c5600700 1 --2- 172.21.15.49:0/3676632647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff4a005a590 0x7ff4a005ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:48.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.837+0000 7ff4c5600700 1 -- 172.21.15.49:0/3676632647 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff4c00765b0 con 0x7ff4c8151370 2024-01-22T05:15:48.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.837+0000 7ff4ce000700 1 --2- 172.21.15.49:0/3676632647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff4a005a590 0x7ff4a005ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:48.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.837+0000 7ff4ce000700 1 --2- 172.21.15.49:0/3676632647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff4a005a590 0x7ff4a005ca50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7ff4b8006bc0 tx=0x7ff4b80090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:48.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:48.845+0000 7ff4c5600700 1 -- 172.21.15.49:0/3676632647 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff4c0049b90 con 0x7ff4c8151370 2024-01-22T05:15:49.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.065+0000 7ff4d0a00700 1 -- 172.21.15.49:0/3676632647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff4c80bdea0 con 0x7ff4c8151370 2024-01-22T05:15:49.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.065+0000 7ff4c5600700 1 -- 172.21.15.49:0/3676632647 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1656 (secure 0 0 0) 0x7ff4c004d1b0 con 0x7ff4c8151370 2024-01-22T05:15:49.070 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:49.070 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":692,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":133,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1078,"data_bytes":1075905752,"bytes_used":4675461120,"bytes_avail":768418652160,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":20995043,"read_op_per_sec":0,"write_op_per_sec":194},"fsmap":{"epoch":106,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8292}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-01-22T05:15:45.481315+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:15:49.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.069+0000 7ff4d0a00700 1 -- 172.21.15.49:0/3676632647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff4a005a590 msgr2=0x7ff4a005ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.069+0000 7ff4d0a00700 1 --2- 172.21.15.49:0/3676632647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff4a005a590 0x7ff4a005ca50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7ff4b8006bc0 tx=0x7ff4b80090f0).stop 2024-01-22T05:15:49.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.069+0000 7ff4d0a00700 1 -- 172.21.15.49:0/3676632647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c8151370 msgr2=0x7ff4c80c1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.069+0000 7ff4d0a00700 1 --2- 172.21.15.49:0/3676632647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c8151370 0x7ff4c80c1720 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7ff4c000b610 tx=0x7ff4c0009780).stop 2024-01-22T05:15:49.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.069+0000 7ff4d0a00700 1 -- 172.21.15.49:0/3676632647 shutdown_connections 2024-01-22T05:15:49.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.069+0000 7ff4d0a00700 1 --2- 172.21.15.49:0/3676632647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff4a005a590 0x7ff4a005ca50 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.069+0000 7ff4d0a00700 1 --2- 172.21.15.49:0/3676632647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c8151370 0x7ff4c80c1720 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.069+0000 7ff4d0a00700 1 --2- 172.21.15.49:0/3676632647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c80be6a0 0x7ff4c80c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.069+0000 7ff4d0a00700 1 --2- 172.21.15.49:0/3676632647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c8064690 0x7ff4c8164e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.069+0000 7ff4d0a00700 1 -- 172.21.15.49:0/3676632647 >> 172.21.15.49:0/3676632647 conn(0x7ff4c80c87f0 msgr2=0x7ff4c8154c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:49.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.069+0000 7ff4d0a00700 1 -- 172.21.15.49:0/3676632647 shutdown_connections 2024-01-22T05:15:49.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.069+0000 7ff4d0a00700 1 -- 172.21.15.49:0/3676632647 wait complete. 2024-01-22T05:15:49.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/scrub_control_test_path]'} 2024-01-22T05:15:49.096 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub resume 2024-01-22T05:15:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.253+0000 7fe20d400700 1 Processor -- start 2024-01-22T05:15:49.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.257+0000 7fe20d400700 1 -- start start 2024-01-22T05:15:49.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.257+0000 7fe20d400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe2081524f0 0x7fe208066400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.257+0000 7fe20d400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe20815bad0 0x7fe20815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.257+0000 7fe20d400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2080bd3e0 con 0x7fe2080a8760 2024-01-22T05:15:49.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.257+0000 7fe20d400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe208067c50 con 0x7fe2081524f0 2024-01-22T05:15:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.257+0000 7fe20d400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20815c440 con 0x7fe20815bad0 2024-01-22T05:15:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.261+0000 7fe205e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe20815bad0 0x7fe20815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.261+0000 7fe206800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe2081524f0 0x7fe208066400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.261+0000 7fe205e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe20815bad0 0x7fe20815bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:37750/0 (socket says 172.21.15.49:37750) 2024-01-22T05:15:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.261+0000 7fe205e00700 1 -- 172.21.15.49:0/26426334 learned_addr learned my addr 172.21.15.49:0/26426334 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.261+0000 7fe207200700 1 --1- 172.21.15.49:0/26426334 >> v1:172.21.15.49:6789/0 conn(0x7fe2080a8760 0x7fe2080a8bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59796/0 (socket says 172.21.15.49:59796) 2024-01-22T05:15:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.261+0000 7fe205e00700 1 -- 172.21.15.49:0/26426334 >> v2:172.21.15.110:3300/0 conn(0x7fe2081524f0 msgr2=0x7fe208066400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.261+0000 7fe205e00700 1 --2- 172.21.15.49:0/26426334 >> v2:172.21.15.110:3300/0 conn(0x7fe2081524f0 0x7fe208066400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.261+0000 7fe205e00700 1 -- 172.21.15.49:0/26426334 >> v1:172.21.15.49:6789/0 conn(0x7fe2080a8760 legacy=0x7fe2080a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.261+0000 7fe205e00700 1 -- 172.21.15.49:0/26426334 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2080bcb40 con 0x7fe20815bad0 2024-01-22T05:15:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.261+0000 7fe205e00700 1 --2- 172.21.15.49:0/26426334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe20815bad0 0x7fe20815bf50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fe1f0006fd0 tx=0x7fe1f00090f0).ready entity=mon.2 client_cookie=dad01f4fc033f80 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.261+0000 7fe205400700 1 -- 172.21.15.49:0/26426334 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f000b580 con 0x7fe20815bad0 2024-01-22T05:15:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.261+0000 7fe205400700 1 -- 172.21.15.49:0/26426334 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f000b6e0 con 0x7fe20815bad0 2024-01-22T05:15:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.261+0000 7fe205400700 1 -- 172.21.15.49:0/26426334 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f000ba60 con 0x7fe20815bad0 2024-01-22T05:15:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.261+0000 7fe20d400700 1 -- 172.21.15.49:0/26426334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe20815bad0 msgr2=0x7fe20815bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.261+0000 7fe20d400700 1 --2- 172.21.15.49:0/26426334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe20815bad0 0x7fe20815bf50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fe1f0006fd0 tx=0x7fe1f00090f0).stop 2024-01-22T05:15:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.265+0000 7fe20d400700 1 -- 172.21.15.49:0/26426334 shutdown_connections 2024-01-22T05:15:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.265+0000 7fe20d400700 1 --2- 172.21.15.49:0/26426334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe20815bad0 0x7fe20815bf50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.265+0000 7fe20d400700 1 --2- 172.21.15.49:0/26426334 >> v2:172.21.15.110:3300/0 conn(0x7fe2081524f0 0x7fe208066400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.265+0000 7fe20d400700 1 -- 172.21.15.49:0/26426334 >> 172.21.15.49:0/26426334 conn(0x7fe2080c6560 msgr2=0x7fe2080c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.265+0000 7fe20d400700 1 -- 172.21.15.49:0/26426334 shutdown_connections 2024-01-22T05:15:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.265+0000 7fe20d400700 1 -- 172.21.15.49:0/26426334 wait complete. 2024-01-22T05:15:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.265+0000 7fe20d400700 1 Processor -- start 2024-01-22T05:15:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.265+0000 7fe20d400700 1 -- start start 2024-01-22T05:15:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe20d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2080a8760 0x7fe20814e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe20d400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2081524f0 0x7fe20815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe20d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe20815bad0 0x7fe20814a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe20d400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20814e610 con 0x7fe20815bad0 2024-01-22T05:15:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe20d400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2081685e0 con 0x7fe2080a8760 2024-01-22T05:15:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe20d400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20815d4d0 con 0x7fe2081524f0 2024-01-22T05:15:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe207200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe20815bad0 0x7fe20814a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe207200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe20815bad0 0x7fe20814a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45344/0 (socket says 172.21.15.49:45344) 2024-01-22T05:15:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe207200700 1 -- 172.21.15.49:0/177965471 learned_addr learned my addr 172.21.15.49:0/177965471 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe206800700 1 --2- 172.21.15.49:0/177965471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2080a8760 0x7fe20814e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe205e00700 1 --2- 172.21.15.49:0/177965471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2081524f0 0x7fe20815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe207200700 1 -- 172.21.15.49:0/177965471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2081524f0 msgr2=0x7fe20815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe207200700 1 --2- 172.21.15.49:0/177965471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2081524f0 0x7fe20815cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe207200700 1 -- 172.21.15.49:0/177965471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2080a8760 msgr2=0x7fe20814e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe207200700 1 --2- 172.21.15.49:0/177965471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2080a8760 0x7fe20814e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe207200700 1 -- 172.21.15.49:0/177965471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f0009370 con 0x7fe20815bad0 2024-01-22T05:15:49.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe207200700 1 --2- 172.21.15.49:0/177965471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe20815bad0 0x7fe20814a780 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fe20000c790 tx=0x7fe2000015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe1fe000700 1 -- 172.21.15.49:0/177965471 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200005c70 con 0x7fe20815bad0 2024-01-22T05:15:49.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe20d400700 1 -- 172.21.15.49:0/177965471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe208169570 con 0x7fe20815bad0 2024-01-22T05:15:49.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe1fe000700 1 -- 172.21.15.49:0/177965471 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe200005dd0 con 0x7fe20815bad0 2024-01-22T05:15:49.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.269+0000 7fe1fe000700 1 -- 172.21.15.49:0/177965471 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200007320 con 0x7fe20815bad0 2024-01-22T05:15:49.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.273+0000 7fe20d400700 1 -- 172.21.15.49:0/177965471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20815d760 con 0x7fe20815bad0 2024-01-22T05:15:49.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.273+0000 7fe1fe000700 1 -- 172.21.15.49:0/177965471 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe2000076d0 con 0x7fe20815bad0 2024-01-22T05:15:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.277+0000 7fe1fe000700 1 --2- 172.21.15.49:0/177965471 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe1e005a540 0x7fe1e005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.277+0000 7fe1fe000700 1 -- 172.21.15.49:0/177965471 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe2000746d0 con 0x7fe20815bad0 2024-01-22T05:15:49.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.277+0000 7fe206800700 1 --2- 172.21.15.49:0/177965471 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe1e005a540 0x7fe1e005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.277+0000 7fe206800700 1 --2- 172.21.15.49:0/177965471 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe1e005a540 0x7fe1e005ca00 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fe1f8009c30 tx=0x7fe1f8009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.277+0000 7fe21789c740 1 Processor -- start 2024-01-22T05:15:49.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.277+0000 7fe21789c740 1 -- start start 2024-01-22T05:15:49.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe21789c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x286d4d0 0x286d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe21789c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 0x28749f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe21789c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x28534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe21789c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2785540 con 0x2874ee0 2024-01-22T05:15:49.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe21789c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2748e90 con 0x286d4d0 2024-01-22T05:15:49.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe21789c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x274ed90 con 0x2874570 2024-01-22T05:15:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe207200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x28534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe207200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x28534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45358/0 (socket says 172.21.15.49:45358) 2024-01-22T05:15:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe207200700 1 -- 172.21.15.49:0/1554235495 learned_addr learned my addr 172.21.15.49:0/1554235495 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe206800700 1 --2- 172.21.15.49:0/1554235495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x286d4d0 0x286d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe205e00700 1 --2- 172.21.15.49:0/1554235495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 0x28749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe207200700 1 -- 172.21.15.49:0/1554235495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 msgr2=0x28749f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe207200700 1 --2- 172.21.15.49:0/1554235495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 0x28749f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe207200700 1 -- 172.21.15.49:0/1554235495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x286d4d0 msgr2=0x286d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe207200700 1 --2- 172.21.15.49:0/1554235495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x286d4d0 0x286d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe207200700 1 -- 172.21.15.49:0/1554235495 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x27b34c0 con 0x2874ee0 2024-01-22T05:15:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe207200700 1 --2- 172.21.15.49:0/1554235495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x28534f0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fe20004b740 tx=0x7fe20000f000).ready entity=mon.0 client_cookie=9d32ad945f7b9737 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe1f6600700 1 -- 172.21.15.49:0/1554235495 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200051070 con 0x2874ee0 2024-01-22T05:15:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe1f6600700 1 -- 172.21.15.49:0/1554235495 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20004b330 con 0x2874ee0 2024-01-22T05:15:49.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe1f6600700 1 -- 172.21.15.49:0/1554235495 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20004b970 con 0x2874ee0 2024-01-22T05:15:49.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe21789c740 1 -- 172.21.15.49:0/1554235495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 msgr2=0x28534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.281+0000 7fe21789c740 1 --2- 172.21.15.49:0/1554235495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x28534f0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fe20004b740 tx=0x7fe20000f000).stop 2024-01-22T05:15:49.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.285+0000 7fe21789c740 1 -- 172.21.15.49:0/1554235495 shutdown_connections 2024-01-22T05:15:49.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.285+0000 7fe21789c740 1 --2- 172.21.15.49:0/1554235495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x28534f0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.285+0000 7fe21789c740 1 --2- 172.21.15.49:0/1554235495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 0x28749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.285+0000 7fe21789c740 1 --2- 172.21.15.49:0/1554235495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x286d4d0 0x286d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.285+0000 7fe21789c740 1 -- 172.21.15.49:0/1554235495 >> 172.21.15.49:0/1554235495 conn(0x2607680 msgr2=0x2826de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:49.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.285+0000 7fe21789c740 1 -- 172.21.15.49:0/1554235495 shutdown_connections 2024-01-22T05:15:49.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.285+0000 7fe21789c740 1 -- 172.21.15.49:0/1554235495 wait complete. 2024-01-22T05:15:49.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.285+0000 7fe21789c740 1 -- start start 2024-01-22T05:15:49.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.285+0000 7fe21789c740 1 Processor -- start 2024-01-22T05:15:49.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe21789c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x286d4d0 0x284aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe21789c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 0x2824eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe21789c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x2826530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe21789c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2825770 con 0x2874ee0 2024-01-22T05:15:49.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe21789c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2825a50 con 0x286d4d0 2024-01-22T05:15:49.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe21789c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2825d30 con 0x2874570 2024-01-22T05:15:49.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe21789c740 10 client.0 ll_register_callbacks cb 0x27df5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:49.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe207200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x2826530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe207200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x2826530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45370/0 (socket says 172.21.15.49:45370) 2024-01-22T05:15:49.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe207200700 1 -- 172.21.15.49:0/2980615924 learned_addr learned my addr 172.21.15.49:0/2980615924 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:49.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe206800700 1 --2- 172.21.15.49:0/2980615924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x286d4d0 0x284aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe205e00700 1 --2- 172.21.15.49:0/2980615924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 0x2824eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe207200700 1 -- 172.21.15.49:0/2980615924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 msgr2=0x2824eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe207200700 1 --2- 172.21.15.49:0/2980615924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 0x2824eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe207200700 1 -- 172.21.15.49:0/2980615924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x286d4d0 msgr2=0x284aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe207200700 1 --2- 172.21.15.49:0/2980615924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x286d4d0 0x284aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe207200700 1 -- 172.21.15.49:0/2980615924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe208169570 con 0x2874ee0 2024-01-22T05:15:49.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe205e00700 1 --2- 172.21.15.49:0/2980615924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 0x2824eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:49.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe207200700 1 --2- 172.21.15.49:0/2980615924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x2826530 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7fe20004b900 tx=0x7fe20000f000).ready entity=mon.0 client_cookie=e9c9f823ee5fe85a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe1eea00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:15:49.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe1eea00700 1 -- 172.21.15.49:0/2980615924 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20001a510 con 0x2874ee0 2024-01-22T05:15:49.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.289+0000 7fe1eea00700 1 -- 172.21.15.49:0/2980615924 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe20004aec0 con 0x2874ee0 2024-01-22T05:15:49.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe21789c740 1 -- 172.21.15.49:0/2980615924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x279f230 con 0x2874ee0 2024-01-22T05:15:49.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe1eea00700 1 -- 172.21.15.49:0/2980615924 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2000477c0 con 0x2874ee0 2024-01-22T05:15:49.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe21789c740 10 client.8607 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:49.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe21789c740 1 -- 172.21.15.49:0/2980615924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x27a27c0 con 0x2874ee0 2024-01-22T05:15:49.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe1eea00700 1 -- 172.21.15.49:0/2980615924 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x279f230 con 0x2874ee0 2024-01-22T05:15:49.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe1eea00700 1 -- 172.21.15.49:0/2980615924 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe200047920 con 0x2874ee0 2024-01-22T05:15:49.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe21789c740 10 client.8607 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:49.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe21789c740 10 client.8607 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-01-22T05:15:49.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe21789c740 20 client.8607 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:49.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe21789c740 1 --2- 172.21.15.49:0/2980615924 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x287ab50 0x287af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe21789c740 4 client.8607 mds_command: new command op to 8292 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:15:49.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe21789c740 1 -- 172.21.15.49:0/2980615924 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2795780 con 0x287ab50 2024-01-22T05:15:49.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe206800700 1 --2- 172.21.15.49:0/2980615924 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x287ab50 0x287af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe206800700 1 --2- 172.21.15.49:0/2980615924 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x287ab50 0x287af30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=44f2536aeebd2b40 server_cookie=293cac36f7aa9a7f in_seq=0 out_seq=0 2024-01-22T05:15:49.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe1eea00700 10 client.8607 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:49.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe1eea00700 1 -- 172.21.15.49:0/2980615924 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2795780 con 0x287ab50 2024-01-22T05:15:49.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe1eea00700 10 client.8607 handle_command_reply: tid=0 2024-01-22T05:15:49.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.293+0000 7fe21789c740 1 client.8607 shutdown 2024-01-22T05:15:49.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.297+0000 7fe21789c740 1 -- 172.21.15.49:0/2980615924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 msgr2=0x2826530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.297+0000 7fe21789c740 1 --2- 172.21.15.49:0/2980615924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x2826530 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7fe20004b900 tx=0x7fe20000f000).stop 2024-01-22T05:15:49.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.297+0000 7fe21789c740 1 -- 172.21.15.49:0/2980615924 shutdown_connections 2024-01-22T05:15:49.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.297+0000 7fe21789c740 1 --2- 172.21.15.49:0/2980615924 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x287ab50 0x287af30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.297+0000 7fe21789c740 1 --2- 172.21.15.49:0/2980615924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x2826530 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.297+0000 7fe21789c740 1 --2- 172.21.15.49:0/2980615924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 0x2824eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.297+0000 7fe1eea00700 0 client.8607 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:49.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.297+0000 7fe21789c740 1 --2- 172.21.15.49:0/2980615924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x286d4d0 0x284aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.297+0000 7fe21789c740 1 -- 172.21.15.49:0/2980615924 >> 172.21.15.49:0/2980615924 conn(0x2607680 msgr2=0x286e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:49.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.297+0000 7fe21789c740 1 -- 172.21.15.49:0/2980615924 shutdown_connections 2024-01-22T05:15:49.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.297+0000 7fe21789c740 1 -- 172.21.15.49:0/2980615924 wait complete. 2024-01-22T05:15:49.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.297+0000 7fe21789c740 20 client.8607 trim_cache size 0 max 16384 2024-01-22T05:15:49.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.313+0000 7fe21789c740 1 Processor -- start 2024-01-22T05:15:49.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.313+0000 7fe21789c740 1 -- start start 2024-01-22T05:15:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe21789c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x286d4d0 0x2826f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe21789c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2874570 0x28772d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe21789c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874ee0 0x28777c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe21789c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x281e0d0 con 0x286d4d0 2024-01-22T05:15:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe21789c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2855360 con 0x2874570 2024-01-22T05:15:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe21789c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x27afa10 con 0x2874ee0 2024-01-22T05:15:49.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe206800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x286d4d0 0x2826f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe206800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x286d4d0 0x2826f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45386/0 (socket says 172.21.15.49:45386) 2024-01-22T05:15:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe205e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2874570 0x28772d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe206800700 1 -- 172.21.15.49:0/2753091490 learned_addr learned my addr 172.21.15.49:0/2753091490 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe207200700 1 --2- 172.21.15.49:0/2753091490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874ee0 0x28777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe206800700 1 -- 172.21.15.49:0/2753091490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874ee0 msgr2=0x28777c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe206800700 1 --2- 172.21.15.49:0/2753091490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874ee0 0x28777c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe206800700 1 -- 172.21.15.49:0/2753091490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2874570 msgr2=0x28772d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe206800700 1 --2- 172.21.15.49:0/2753091490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2874570 0x28772d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe206800700 1 -- 172.21.15.49:0/2753091490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe208066370 con 0x286d4d0 2024-01-22T05:15:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe206800700 1 --2- 172.21.15.49:0/2753091490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x286d4d0 0x2826f60 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7fe1f8011ec0 tx=0x7fe1f8017000).ready entity=mon.0 client_cookie=6802b298f22d9e29 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe1f7000700 1 -- 172.21.15.49:0/2753091490 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8027070 con 0x286d4d0 2024-01-22T05:15:49.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe1f7000700 1 -- 172.21.15.49:0/2753091490 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f8022b50 con 0x286d4d0 2024-01-22T05:15:49.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.317+0000 7fe1f7000700 1 -- 172.21.15.49:0/2753091490 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8022cc0 con 0x286d4d0 2024-01-22T05:15:49.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.321+0000 7fe21789c740 1 -- 172.21.15.49:0/2753091490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x286d4d0 msgr2=0x2826f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.321+0000 7fe21789c740 1 --2- 172.21.15.49:0/2753091490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x286d4d0 0x2826f60 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7fe1f8011ec0 tx=0x7fe1f8017000).stop 2024-01-22T05:15:49.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.321+0000 7fe21789c740 1 -- 172.21.15.49:0/2753091490 shutdown_connections 2024-01-22T05:15:49.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.321+0000 7fe21789c740 1 --2- 172.21.15.49:0/2753091490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874ee0 0x28777c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.321+0000 7fe21789c740 1 --2- 172.21.15.49:0/2753091490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2874570 0x28772d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.321+0000 7fe21789c740 1 --2- 172.21.15.49:0/2753091490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x286d4d0 0x2826f60 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.321+0000 7fe21789c740 1 -- 172.21.15.49:0/2753091490 >> 172.21.15.49:0/2753091490 conn(0x2607680 msgr2=0x284d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:49.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.321+0000 7fe21789c740 1 -- 172.21.15.49:0/2753091490 shutdown_connections 2024-01-22T05:15:49.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.321+0000 7fe21789c740 1 -- 172.21.15.49:0/2753091490 wait complete. 2024-01-22T05:15:49.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.321+0000 7fe21789c740 1 -- start start 2024-01-22T05:15:49.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.321+0000 7fe21789c740 1 Processor -- start 2024-01-22T05:15:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe21789c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x286d4d0 0x28ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe21789c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 0x286de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe21789c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x286e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe21789c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x286ccd0 con 0x2874ee0 2024-01-22T05:15:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe21789c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x28d0a20 con 0x286d4d0 2024-01-22T05:15:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe21789c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x286e810 con 0x2874570 2024-01-22T05:15:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe21789c740 10 client.0 ll_register_callbacks cb 0x7fe20004b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:49.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe207200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x286e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe207200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x286e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45396/0 (socket says 172.21.15.49:45396) 2024-01-22T05:15:49.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe207200700 1 -- 172.21.15.49:0/3026414186 learned_addr learned my addr 172.21.15.49:0/3026414186 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:49.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe205e00700 1 --2- 172.21.15.49:0/3026414186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 0x286de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe206800700 1 --2- 172.21.15.49:0/3026414186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x286d4d0 0x28ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe207200700 1 -- 172.21.15.49:0/3026414186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 msgr2=0x286de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe207200700 1 --2- 172.21.15.49:0/3026414186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 0x286de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe207200700 1 -- 172.21.15.49:0/3026414186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x286d4d0 msgr2=0x28ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe207200700 1 --2- 172.21.15.49:0/3026414186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x286d4d0 0x28ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe207200700 1 -- 172.21.15.49:0/3026414186 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f8011d30 con 0x2874ee0 2024-01-22T05:15:49.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe207200700 1 --2- 172.21.15.49:0/3026414186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x286e320 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7fe200047ed0 tx=0x7fe20005b000).ready entity=mon.0 client_cookie=a39fefd423f7844f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe1eea00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:15:49.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe1eea00700 1 -- 172.21.15.49:0/3026414186 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20000e040 con 0x2874ee0 2024-01-22T05:15:49.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe1eea00700 1 -- 172.21.15.49:0/3026414186 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe20004aec0 con 0x2874ee0 2024-01-22T05:15:49.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe21789c740 1 -- 172.21.15.49:0/3026414186 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe20004b330 con 0x2874ee0 2024-01-22T05:15:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe1eea00700 1 -- 172.21.15.49:0/3026414186 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe200049d70 con 0x2874ee0 2024-01-22T05:15:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe21789c740 10 client.8613 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe21789c740 1 -- 172.21.15.49:0/3026414186 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x279d9f0 con 0x2874ee0 2024-01-22T05:15:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe1eea00700 1 -- 172.21.15.49:0/3026414186 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20004b330 con 0x2874ee0 2024-01-22T05:15:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.325+0000 7fe1eea00700 1 -- 172.21.15.49:0/3026414186 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe20004ab40 con 0x2874ee0 2024-01-22T05:15:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 10 client.8613 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 10 client.8613 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-01-22T05:15:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 20 client.8613 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 1 --2- 172.21.15.49:0/3026414186 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2824fb0 0x28d4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 4 client.8613 mds_command: new command op to 8292 tid=0[{"prefix": "scrub resume"}] 2024-01-22T05:15:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 1 -- 172.21.15.49:0/3026414186 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x265e610 con 0x2824fb0 2024-01-22T05:15:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe206800700 1 --2- 172.21.15.49:0/3026414186 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2824fb0 0x28d4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe1eea00700 10 client.8613 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe206800700 1 --2- 172.21.15.49:0/3026414186 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2824fb0 0x28d4040 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d3aa1ab53ada0292 server_cookie=7354490c77c041a8 in_seq=0 out_seq=0 2024-01-22T05:15:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe1eea00700 1 -- 172.21.15.49:0/3026414186 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x265e610 con 0x2824fb0 2024-01-22T05:15:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe1eea00700 10 client.8613 handle_command_reply: tid=0 2024-01-22T05:15:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 1 client.8613 shutdown 2024-01-22T05:15:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 1 -- 172.21.15.49:0/3026414186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 msgr2=0x286e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 1 --2- 172.21.15.49:0/3026414186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x286e320 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7fe200047ed0 tx=0x7fe20005b000).stop 2024-01-22T05:15:49.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 1 -- 172.21.15.49:0/3026414186 shutdown_connections 2024-01-22T05:15:49.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 1 --2- 172.21.15.49:0/3026414186 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0x2824fb0 0x28d4040 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 1 --2- 172.21.15.49:0/3026414186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2874ee0 0x286e320 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 1 --2- 172.21.15.49:0/3026414186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2874570 0x286de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 1 --2- 172.21.15.49:0/3026414186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x286d4d0 0x28ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe1eea00700 0 client.8613 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:49.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 1 -- 172.21.15.49:0/3026414186 >> 172.21.15.49:0/3026414186 conn(0x2607680 msgr2=0x2852730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:49.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 1 -- 172.21.15.49:0/3026414186 shutdown_connections 2024-01-22T05:15:49.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 1 -- 172.21.15.49:0/3026414186 wait complete. 2024-01-22T05:15:49.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.329+0000 7fe21789c740 20 client.8613 trim_cache size 0 max 16384 2024-01-22T05:15:49.335 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:15:49.335 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:15:49.336 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:15:49.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.333+0000 7fe20d400700 1 -- 172.21.15.49:0/177965471 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe1e005a540 msgr2=0x7fe1e005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.333+0000 7fe20d400700 1 --2- 172.21.15.49:0/177965471 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe1e005a540 0x7fe1e005ca00 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fe1f8009c30 tx=0x7fe1f8009060).stop 2024-01-22T05:15:49.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.333+0000 7fe20d400700 1 -- 172.21.15.49:0/177965471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe20815bad0 msgr2=0x7fe20814a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.333+0000 7fe20d400700 1 --2- 172.21.15.49:0/177965471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe20815bad0 0x7fe20814a780 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fe20000c790 tx=0x7fe2000015e0).stop 2024-01-22T05:15:49.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.333+0000 7fe20d400700 1 -- 172.21.15.49:0/177965471 shutdown_connections 2024-01-22T05:15:49.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.333+0000 7fe20d400700 1 --2- 172.21.15.49:0/177965471 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe1e005a540 0x7fe1e005ca00 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.333+0000 7fe20d400700 1 --2- 172.21.15.49:0/177965471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe20815bad0 0x7fe20814a780 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.333+0000 7fe20d400700 1 --2- 172.21.15.49:0/177965471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2081524f0 0x7fe20815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.333+0000 7fe20d400700 1 --2- 172.21.15.49:0/177965471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2080a8760 0x7fe20814e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.333+0000 7fe20d400700 1 -- 172.21.15.49:0/177965471 >> 172.21.15.49:0/177965471 conn(0x7fe2080c6560 msgr2=0x7fe2080c4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:49.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.333+0000 7fe20d400700 1 -- 172.21.15.49:0/177965471 shutdown_connections 2024-01-22T05:15:49.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.333+0000 7fe20d400700 1 -- 172.21.15.49:0/177965471 wait complete. 2024-01-22T05:15:49.358 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub status 2024-01-22T05:15:49.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.517+0000 7f0a7cc00700 1 Processor -- start 2024-01-22T05:15:49.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.517+0000 7f0a7cc00700 1 -- start start 2024-01-22T05:15:49.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a7cc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a7815bad0 0x7f0a7815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a7cc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0a780a8760 0x7f0a780a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a7cc00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a780bd3e0 con 0x7f0a781524f0 2024-01-22T05:15:49.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a7cc00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a78067c50 con 0x7f0a780a8760 2024-01-22T05:15:49.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a7cc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7815c420 con 0x7f0a7815bad0 2024-01-22T05:15:49.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a76800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0a780a8760 0x7f0a780a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a76800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0a780a8760 0x7f0a780a8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45410/0 (socket says 172.21.15.49:45410) 2024-01-22T05:15:49.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a76800700 1 -- 172.21.15.49:0/1034535362 learned_addr learned my addr 172.21.15.49:0/1034535362 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:49.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a75e00700 1 --1- 172.21.15.49:0/1034535362 >> v1:172.21.15.110:6789/0 conn(0x7f0a781524f0 0x7f0a78066400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:54562/0 (socket says 172.21.15.49:54562) 2024-01-22T05:15:49.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a75400700 1 --2- 172.21.15.49:0/1034535362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a7815bad0 0x7f0a7815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a76800700 1 -- 172.21.15.49:0/1034535362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a7815bad0 msgr2=0x7f0a7815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a76800700 1 --2- 172.21.15.49:0/1034535362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a7815bad0 0x7f0a7815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a76800700 1 -- 172.21.15.49:0/1034535362 >> v1:172.21.15.110:6789/0 conn(0x7f0a781524f0 legacy=0x7f0a78066400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a76800700 1 -- 172.21.15.49:0/1034535362 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a780bcb40 con 0x7f0a780a8760 2024-01-22T05:15:49.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a74a00700 1 -- 172.21.15.49:0/1034535362 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775178579 0 0) 0x7f0a780bd3e0 con 0x7f0a781524f0 2024-01-22T05:15:49.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a76800700 1 --2- 172.21.15.49:0/1034535362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a780a8760 0x7f0a780a8bf0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f0a70009f20 tx=0x7f0a70009840).ready entity=mon.0 client_cookie=5a7c6d12d3c9a3e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a74a00700 1 -- 172.21.15.49:0/1034535362 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7000e070 con 0x7f0a780a8760 2024-01-22T05:15:49.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a74a00700 1 -- 172.21.15.49:0/1034535362 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7000b9d0 con 0x7f0a780a8760 2024-01-22T05:15:49.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.521+0000 7f0a74a00700 1 -- 172.21.15.49:0/1034535362 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7000bd50 con 0x7f0a780a8760 2024-01-22T05:15:49.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.525+0000 7f0a7cc00700 1 -- 172.21.15.49:0/1034535362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a780a8760 msgr2=0x7f0a780a8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.525+0000 7f0a7cc00700 1 --2- 172.21.15.49:0/1034535362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a780a8760 0x7f0a780a8bf0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f0a70009f20 tx=0x7f0a70009840).stop 2024-01-22T05:15:49.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.525+0000 7f0a7cc00700 1 -- 172.21.15.49:0/1034535362 shutdown_connections 2024-01-22T05:15:49.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.525+0000 7f0a7cc00700 1 --2- 172.21.15.49:0/1034535362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a780a8760 0x7f0a780a8bf0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.525+0000 7f0a7cc00700 1 --2- 172.21.15.49:0/1034535362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a7815bad0 0x7f0a7815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.525+0000 7f0a7cc00700 1 -- 172.21.15.49:0/1034535362 >> 172.21.15.49:0/1034535362 conn(0x7f0a780c6560 msgr2=0x7f0a780c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:49.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.525+0000 7f0a7cc00700 1 -- 172.21.15.49:0/1034535362 shutdown_connections 2024-01-22T05:15:49.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.525+0000 7f0a7cc00700 1 -- 172.21.15.49:0/1034535362 wait complete. 2024-01-22T05:15:49.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a7cc00700 1 Processor -- start 2024-01-22T05:15:49.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a7cc00700 1 -- start start 2024-01-22T05:15:49.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a7cc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a780a8760 0x7f0a780bff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a7cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a781524f0 0x7f0a7814cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a7cc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a7815bad0 0x7f0a7815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a7cc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7815c5f0 con 0x7f0a781524f0 2024-01-22T05:15:49.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a7cc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7815c840 con 0x7f0a7815bad0 2024-01-22T05:15:49.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a7cc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7815cb20 con 0x7f0a780a8760 2024-01-22T05:15:49.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a75400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a781524f0 0x7f0a7814cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a75400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a781524f0 0x7f0a7814cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45422/0 (socket says 172.21.15.49:45422) 2024-01-22T05:15:49.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a75400700 1 -- 172.21.15.49:0/2179598610 learned_addr learned my addr 172.21.15.49:0/2179598610 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:49.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a76800700 1 --2- 172.21.15.49:0/2179598610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a7815bad0 0x7f0a7815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a75e00700 1 --2- 172.21.15.49:0/2179598610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a780a8760 0x7f0a780bff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a75400700 1 -- 172.21.15.49:0/2179598610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a780a8760 msgr2=0x7f0a780bff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a75400700 1 --2- 172.21.15.49:0/2179598610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a780a8760 0x7f0a780bff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a75400700 1 -- 172.21.15.49:0/2179598610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a7815bad0 msgr2=0x7f0a7815a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a75400700 1 --2- 172.21.15.49:0/2179598610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a7815bad0 0x7f0a7815a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a75400700 1 -- 172.21.15.49:0/2179598610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a70009ae0 con 0x7f0a781524f0 2024-01-22T05:15:49.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.529+0000 7f0a76800700 1 --2- 172.21.15.49:0/2179598610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a7815bad0 0x7f0a7815a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.533+0000 7f0a75400700 1 --2- 172.21.15.49:0/2179598610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a781524f0 0x7f0a7814cb90 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f0a6000e900 tx=0x7f0a60009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.533+0000 7f0a6d600700 1 -- 172.21.15.49:0/2179598610 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6000c640 con 0x7f0a781524f0 2024-01-22T05:15:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.533+0000 7f0a6d600700 1 -- 172.21.15.49:0/2179598610 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6000c7a0 con 0x7f0a781524f0 2024-01-22T05:15:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.533+0000 7f0a7cc00700 1 -- 172.21.15.49:0/2179598610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7815ce00 con 0x7f0a781524f0 2024-01-22T05:15:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.533+0000 7f0a6d600700 1 -- 172.21.15.49:0/2179598610 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6000cb20 con 0x7f0a781524f0 2024-01-22T05:15:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.533+0000 7f0a7cc00700 1 -- 172.21.15.49:0/2179598610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7814da80 con 0x7f0a781524f0 2024-01-22T05:15:49.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.533+0000 7f0a6d600700 1 -- 172.21.15.49:0/2179598610 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0a6001b400 con 0x7f0a781524f0 2024-01-22T05:15:49.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.537+0000 7f0a6d600700 1 --2- 172.21.15.49:0/2179598610 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a5005a510 0x7f0a5005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.537+0000 7f0a6d600700 1 -- 172.21.15.49:0/2179598610 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0a60074d60 con 0x7f0a781524f0 2024-01-22T05:15:49.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.537+0000 7f0a75e00700 1 --2- 172.21.15.49:0/2179598610 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a5005a510 0x7f0a5005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.537+0000 7f0a75e00700 1 --2- 172.21.15.49:0/2179598610 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a5005a510 0x7f0a5005c9d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f0a680011e0 tx=0x7f0a68007180).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a87014740 1 Processor -- start 2024-01-22T05:15:49.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a87014740 1 -- start start 2024-01-22T05:15:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a87014740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xef54d0 0xef58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a87014740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefc570 0xefc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a87014740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xefcee0 0xedb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a87014740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xe0d540 con 0xefc570 2024-01-22T05:15:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a87014740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xdd0e90 con 0xefcee0 2024-01-22T05:15:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a87014740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xdd6d90 con 0xef54d0 2024-01-22T05:15:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a75400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefc570 0xefc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a75400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefc570 0xefc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45428/0 (socket says 172.21.15.49:45428) 2024-01-22T05:15:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a75400700 1 -- 172.21.15.49:0/2693234283 learned_addr learned my addr 172.21.15.49:0/2693234283 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a76800700 1 --2- 172.21.15.49:0/2693234283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xefcee0 0xedb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a75e00700 1 --2- 172.21.15.49:0/2693234283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xef54d0 0xef58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a75400700 1 -- 172.21.15.49:0/2693234283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xef54d0 msgr2=0xef58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a75400700 1 --2- 172.21.15.49:0/2693234283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xef54d0 0xef58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a75400700 1 -- 172.21.15.49:0/2693234283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xefcee0 msgr2=0xedb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a75400700 1 --2- 172.21.15.49:0/2693234283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xefcee0 0xedb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.541+0000 7f0a75400700 1 -- 172.21.15.49:0/2693234283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe3b4c0 con 0xefc570 2024-01-22T05:15:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.545+0000 7f0a75400700 1 --2- 172.21.15.49:0/2693234283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefc570 0xefc9f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f0a6004bda0 tx=0x7f0a60011000).ready entity=mon.0 client_cookie=f3903f48b8187213 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.545+0000 7f0a65c00700 1 -- 172.21.15.49:0/2693234283 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6004bfa0 con 0xefc570 2024-01-22T05:15:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.545+0000 7f0a65c00700 1 -- 172.21.15.49:0/2693234283 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a60051740 con 0xefc570 2024-01-22T05:15:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.545+0000 7f0a65c00700 1 -- 172.21.15.49:0/2693234283 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60072d10 con 0xefc570 2024-01-22T05:15:49.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.545+0000 7f0a87014740 1 -- 172.21.15.49:0/2693234283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefc570 msgr2=0xefc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.545+0000 7f0a87014740 1 --2- 172.21.15.49:0/2693234283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefc570 0xefc9f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f0a6004bda0 tx=0x7f0a60011000).stop 2024-01-22T05:15:49.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.545+0000 7f0a87014740 1 -- 172.21.15.49:0/2693234283 shutdown_connections 2024-01-22T05:15:49.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.545+0000 7f0a87014740 1 --2- 172.21.15.49:0/2693234283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xefcee0 0xedb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.545+0000 7f0a87014740 1 --2- 172.21.15.49:0/2693234283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefc570 0xefc9f0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.545+0000 7f0a87014740 1 --2- 172.21.15.49:0/2693234283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xef54d0 0xef58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.545+0000 7f0a87014740 1 -- 172.21.15.49:0/2693234283 >> 172.21.15.49:0/2693234283 conn(0xc8f680 msgr2=0xeaede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:49.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.545+0000 7f0a87014740 1 -- 172.21.15.49:0/2693234283 shutdown_connections 2024-01-22T05:15:49.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.545+0000 7f0a87014740 1 -- 172.21.15.49:0/2693234283 wait complete. 2024-01-22T05:15:49.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.545+0000 7f0a87014740 1 -- start start 2024-01-22T05:15:49.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a87014740 1 Processor -- start 2024-01-22T05:15:49.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a87014740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xef54d0 0xed6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a87014740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xefc570 0xed8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a87014740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefcee0 0xf060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a87014740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xed7c30 con 0xefcee0 2024-01-22T05:15:49.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a87014740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xead050 con 0xef54d0 2024-01-22T05:15:49.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a87014740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xeadeb0 con 0xefc570 2024-01-22T05:15:49.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a87014740 10 client.0 ll_register_callbacks cb 0xe675d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:49.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a76800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefcee0 0xf060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a76800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefcee0 0xf060a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45436/0 (socket says 172.21.15.49:45436) 2024-01-22T05:15:49.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a76800700 1 -- 172.21.15.49:0/4050386813 learned_addr learned my addr 172.21.15.49:0/4050386813 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:49.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a75400700 1 --2- 172.21.15.49:0/4050386813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xefc570 0xed8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a75e00700 1 --2- 172.21.15.49:0/4050386813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xef54d0 0xed6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a76800700 1 -- 172.21.15.49:0/4050386813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xefc570 msgr2=0xed8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a76800700 1 --2- 172.21.15.49:0/4050386813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xefc570 0xed8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a76800700 1 -- 172.21.15.49:0/4050386813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xef54d0 msgr2=0xed6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a76800700 1 --2- 172.21.15.49:0/4050386813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xef54d0 0xed6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a76800700 1 -- 172.21.15.49:0/4050386813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7814da80 con 0xefcee0 2024-01-22T05:15:49.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a75e00700 1 --2- 172.21.15.49:0/4050386813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xef54d0 0xed6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:49.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a76800700 1 --2- 172.21.15.49:0/4050386813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefcee0 0xf060a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f0a70010000 tx=0x7f0a78067bc0).ready entity=mon.0 client_cookie=14672ac230b43a4e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a5e000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:15:49.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.549+0000 7f0a5e000700 1 -- 172.21.15.49:0/4050386813 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70013a90 con 0xefcee0 2024-01-22T05:15:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a5e000700 1 -- 172.21.15.49:0/4050386813 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0a70013bf0 con 0xefcee0 2024-01-22T05:15:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a87014740 1 -- 172.21.15.49:0/4050386813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe27230 con 0xefcee0 2024-01-22T05:15:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a5e000700 1 -- 172.21.15.49:0/4050386813 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a70020470 con 0xefcee0 2024-01-22T05:15:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a87014740 10 client.8625 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a87014740 1 -- 172.21.15.49:0/4050386813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0xe2a7c0 con 0xefcee0 2024-01-22T05:15:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a5e000700 1 -- 172.21.15.49:0/4050386813 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe27230 con 0xefcee0 2024-01-22T05:15:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a5e000700 1 -- 172.21.15.49:0/4050386813 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0a70028350 con 0xefcee0 2024-01-22T05:15:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a87014740 10 client.8625 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a87014740 10 client.8625 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-01-22T05:15:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a87014740 20 client.8625 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a87014740 1 --2- 172.21.15.49:0/4050386813 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xeacb30 0xed6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a87014740 4 client.8625 mds_command: new command op to 8292 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:15:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a87014740 1 -- 172.21.15.49:0/4050386813 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xe1d780 con 0xeacb30 2024-01-22T05:15:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a75e00700 1 --2- 172.21.15.49:0/4050386813 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xeacb30 0xed6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a75e00700 1 --2- 172.21.15.49:0/4050386813 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xeacb30 0xed6ca0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=922295a770965a5c server_cookie=865765058df7596f in_seq=0 out_seq=0 2024-01-22T05:15:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a5e000700 10 client.8625 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a5e000700 1 -- 172.21.15.49:0/4050386813 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xe1d780 con 0xeacb30 2024-01-22T05:15:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a5e000700 10 client.8625 handle_command_reply: tid=0 2024-01-22T05:15:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.553+0000 7f0a87014740 1 client.8625 shutdown 2024-01-22T05:15:49.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.557+0000 7f0a87014740 1 -- 172.21.15.49:0/4050386813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefcee0 msgr2=0xf060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.557+0000 7f0a87014740 1 --2- 172.21.15.49:0/4050386813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefcee0 0xf060a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f0a70010000 tx=0x7f0a78067bc0).stop 2024-01-22T05:15:49.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.557+0000 7f0a87014740 1 -- 172.21.15.49:0/4050386813 shutdown_connections 2024-01-22T05:15:49.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.557+0000 7f0a87014740 1 --2- 172.21.15.49:0/4050386813 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xeacb30 0xed6ca0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.557+0000 7f0a87014740 1 --2- 172.21.15.49:0/4050386813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefcee0 0xf060a0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.557+0000 7f0a87014740 1 --2- 172.21.15.49:0/4050386813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xefc570 0xed8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.557+0000 7f0a87014740 1 --2- 172.21.15.49:0/4050386813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xef54d0 0xed6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.557+0000 7f0a87014740 1 -- 172.21.15.49:0/4050386813 >> 172.21.15.49:0/4050386813 conn(0xc8f680 msgr2=0xef62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:49.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.557+0000 7f0a5e000700 0 client.8625 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:49.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.557+0000 7f0a87014740 1 -- 172.21.15.49:0/4050386813 shutdown_connections 2024-01-22T05:15:49.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.557+0000 7f0a87014740 1 -- 172.21.15.49:0/4050386813 wait complete. 2024-01-22T05:15:49.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.557+0000 7f0a87014740 20 client.8625 trim_cache size 0 max 16384 2024-01-22T05:15:49.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.577+0000 7f0a87014740 1 Processor -- start 2024-01-22T05:15:49.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.577+0000 7f0a87014740 1 -- start start 2024-01-22T05:15:49.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.577+0000 7f0a87014740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xef54d0 0xed2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.577+0000 7f0a87014740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xefc570 0xedc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.577+0000 7f0a87014740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xefcee0 0xf04b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.577+0000 7f0a87014740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xe36bf0 con 0xef54d0 2024-01-22T05:15:49.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.577+0000 7f0a87014740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xe73040 con 0xefcee0 2024-01-22T05:15:49.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.577+0000 7f0a87014740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xe54ff0 con 0xefc570 2024-01-22T05:15:49.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.577+0000 7f0a75400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xefc570 0xedc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.577+0000 7f0a75e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xef54d0 0xed2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.577+0000 7f0a75400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xefc570 0xedc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:37838/0 (socket says 172.21.15.49:37838) 2024-01-22T05:15:49.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.577+0000 7f0a75400700 1 -- 172.21.15.49:0/3306524072 learned_addr learned my addr 172.21.15.49:0/3306524072 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:49.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a76800700 1 --2- 172.21.15.49:0/3306524072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xefcee0 0xf04b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a75400700 1 -- 172.21.15.49:0/3306524072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xefcee0 msgr2=0xf04b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a75400700 1 --2- 172.21.15.49:0/3306524072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xefcee0 0xf04b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a75400700 1 -- 172.21.15.49:0/3306524072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xef54d0 msgr2=0xed2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a75400700 1 --2- 172.21.15.49:0/3306524072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xef54d0 0xed2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a75400700 1 -- 172.21.15.49:0/3306524072 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7815ab40 con 0xefc570 2024-01-22T05:15:49.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a75e00700 1 --2- 172.21.15.49:0/3306524072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xef54d0 0xed2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:49.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a75400700 1 --2- 172.21.15.49:0/3306524072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xefc570 0xedc680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f0a60048500 tx=0x7f0a60055000).ready entity=mon.2 client_cookie=965723578c48638c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a66600700 1 -- 172.21.15.49:0/3306524072 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6004a3a0 con 0xefc570 2024-01-22T05:15:49.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a66600700 1 -- 172.21.15.49:0/3306524072 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a60072d10 con 0xefc570 2024-01-22T05:15:49.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a66600700 1 -- 172.21.15.49:0/3306524072 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60072e80 con 0xefc570 2024-01-22T05:15:49.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a87014740 1 -- 172.21.15.49:0/3306524072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xefc570 msgr2=0xedc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a87014740 1 --2- 172.21.15.49:0/3306524072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xefc570 0xedc680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f0a60048500 tx=0x7f0a60055000).stop 2024-01-22T05:15:49.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a87014740 1 -- 172.21.15.49:0/3306524072 shutdown_connections 2024-01-22T05:15:49.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a87014740 1 --2- 172.21.15.49:0/3306524072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xefcee0 0xf04b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a87014740 1 --2- 172.21.15.49:0/3306524072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xefc570 0xedc680 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a87014740 1 --2- 172.21.15.49:0/3306524072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xef54d0 0xed2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a87014740 1 -- 172.21.15.49:0/3306524072 >> 172.21.15.49:0/3306524072 conn(0xc8f680 msgr2=0xf0cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:49.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a87014740 1 -- 172.21.15.49:0/3306524072 shutdown_connections 2024-01-22T05:15:49.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.581+0000 7f0a87014740 1 -- 172.21.15.49:0/3306524072 wait complete. 2024-01-22T05:15:49.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.585+0000 7f0a87014740 1 -- start start 2024-01-22T05:15:49.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.585+0000 7f0a87014740 1 Processor -- start 2024-01-22T05:15:49.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xef54d0 0xf58850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xefc570 0xefdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefcee0 0xed2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xf00ff0 con 0xefcee0 2024-01-22T05:15:49.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xefe510 con 0xefc570 2024-01-22T05:15:49.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xef16f0 con 0xef54d0 2024-01-22T05:15:49.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 10 client.0 ll_register_callbacks cb 0x7f0a7000bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:15:49.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a76800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefcee0 0xed2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a76800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefcee0 0xed2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45454/0 (socket says 172.21.15.49:45454) 2024-01-22T05:15:49.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a76800700 1 -- 172.21.15.49:0/1174471388 learned_addr learned my addr 172.21.15.49:0/1174471388 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:49.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a75400700 1 --2- 172.21.15.49:0/1174471388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xefc570 0xefdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a75e00700 1 --2- 172.21.15.49:0/1174471388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xef54d0 0xf58850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a76800700 1 -- 172.21.15.49:0/1174471388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xef54d0 msgr2=0xf58850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a76800700 1 --2- 172.21.15.49:0/1174471388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xef54d0 0xf58850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a76800700 1 -- 172.21.15.49:0/1174471388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xefc570 msgr2=0xefdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a76800700 1 --2- 172.21.15.49:0/1174471388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xefc570 0xefdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a76800700 1 -- 172.21.15.49:0/1174471388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xe3b4c0 con 0xefcee0 2024-01-22T05:15:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a76800700 1 --2- 172.21.15.49:0/1174471388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefcee0 0xed2c10 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f0a7000c010 tx=0x7f0a70020000).ready entity=mon.0 client_cookie=a40d1f6322dd7115 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a5e000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:15:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a5e000700 1 -- 172.21.15.49:0/1174471388 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70028810 con 0xefcee0 2024-01-22T05:15:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 1 -- 172.21.15.49:0/1174471388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a60051740 con 0xefcee0 2024-01-22T05:15:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a5e000700 1 -- 172.21.15.49:0/1174471388 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0a70013a90 con 0xefcee0 2024-01-22T05:15:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a5e000700 1 -- 172.21.15.49:0/1174471388 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a70013c50 con 0xefcee0 2024-01-22T05:15:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 10 client.8631 fetch_fsmap learned FSMap version 106 2024-01-22T05:15:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 1 -- 172.21.15.49:0/1174471388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0xe259f0 con 0xefcee0 2024-01-22T05:15:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a5e000700 1 -- 172.21.15.49:0/1174471388 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a60051740 con 0xefcee0 2024-01-22T05:15:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a5e000700 1 -- 172.21.15.49:0/1174471388 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0a70028b40 con 0xefcee0 2024-01-22T05:15:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 10 client.8631 fetch_fsmap finished waiting for FSMap version 106 2024-01-22T05:15:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 10 client.8631 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-01-22T05:15:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 20 client.8631 populate_metadata read hostname 'smithi049' 2024-01-22T05:15:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 1 --2- 172.21.15.49:0/1174471388 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xed3100 0xf04b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 4 client.8631 mds_command: new command op to 8292 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:15:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a87014740 1 -- 172.21.15.49:0/1174471388 --> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xce6610 con 0xed3100 2024-01-22T05:15:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.589+0000 7f0a75e00700 1 --2- 172.21.15.49:0/1174471388 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xed3100 0xf04b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a5e000700 10 client.8631 ms_handle_connect on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a75e00700 1 --2- 172.21.15.49:0/1174471388 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xed3100 0xf04b70 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7479efb890ec748d server_cookie=96e802bf587b3031 in_seq=0 out_seq=0 2024-01-22T05:15:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a5e000700 1 -- 172.21.15.49:0/1174471388 <== mds.0 v2:172.21.15.49:6835/3036262557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0xce6610 con 0xed3100 2024-01-22T05:15:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a5e000700 10 client.8631 handle_command_reply: tid=0 2024-01-22T05:15:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a87014740 1 client.8631 shutdown 2024-01-22T05:15:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a87014740 1 -- 172.21.15.49:0/1174471388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefcee0 msgr2=0xed2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a87014740 1 --2- 172.21.15.49:0/1174471388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefcee0 0xed2c10 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f0a7000c010 tx=0x7f0a70020000).stop 2024-01-22T05:15:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a87014740 1 -- 172.21.15.49:0/1174471388 shutdown_connections 2024-01-22T05:15:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a87014740 1 --2- 172.21.15.49:0/1174471388 >> [v2:172.21.15.49:6835/3036262557,v1:172.21.15.49:6837/3036262557] conn(0xed3100 0xf04b70 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a87014740 1 --2- 172.21.15.49:0/1174471388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xefcee0 0xed2c10 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a87014740 1 --2- 172.21.15.49:0/1174471388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xefc570 0xefdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a87014740 1 --2- 172.21.15.49:0/1174471388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xef54d0 0xf58850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a87014740 1 -- 172.21.15.49:0/1174471388 >> 172.21.15.49:0/1174471388 conn(0xc8f680 msgr2=0xef64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a5e000700 0 client.8631 ms_handle_reset on v2:172.21.15.49:6835/3036262557 2024-01-22T05:15:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a87014740 1 -- 172.21.15.49:0/1174471388 shutdown_connections 2024-01-22T05:15:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a87014740 1 -- 172.21.15.49:0/1174471388 wait complete. 2024-01-22T05:15:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a87014740 20 client.8631 trim_cache size 0 max 16384 2024-01-22T05:15:49.599 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:15:49.599 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-01-22T05:15:49.599 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-01-22T05:15:49.599 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:15:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a7cc00700 1 -- 172.21.15.49:0/2179598610 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a5005a510 msgr2=0x7f0a5005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a7cc00700 1 --2- 172.21.15.49:0/2179598610 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a5005a510 0x7f0a5005c9d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f0a680011e0 tx=0x7f0a68007180).stop 2024-01-22T05:15:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a7cc00700 1 -- 172.21.15.49:0/2179598610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a781524f0 msgr2=0x7f0a7814cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.593+0000 7f0a7cc00700 1 --2- 172.21.15.49:0/2179598610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a781524f0 0x7f0a7814cb90 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f0a6000e900 tx=0x7f0a60009060).stop 2024-01-22T05:15:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.597+0000 7f0a7cc00700 1 -- 172.21.15.49:0/2179598610 shutdown_connections 2024-01-22T05:15:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.597+0000 7f0a7cc00700 1 --2- 172.21.15.49:0/2179598610 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0a5005a510 0x7f0a5005c9d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.597+0000 7f0a7cc00700 1 --2- 172.21.15.49:0/2179598610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a7815bad0 0x7f0a7815a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.597+0000 7f0a7cc00700 1 --2- 172.21.15.49:0/2179598610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a781524f0 0x7f0a7814cb90 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.597+0000 7f0a7cc00700 1 --2- 172.21.15.49:0/2179598610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a780a8760 0x7f0a780bff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.597+0000 7f0a7cc00700 1 -- 172.21.15.49:0/2179598610 >> 172.21.15.49:0/2179598610 conn(0x7f0a780c6560 msgr2=0x7f0a780c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.597+0000 7f0a7cc00700 1 -- 172.21.15.49:0/2179598610 shutdown_connections 2024-01-22T05:15:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.597+0000 7f0a7cc00700 1 -- 172.21.15.49:0/2179598610 wait complete. 2024-01-22T05:15:49.620 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-22T05:15:49.620 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:15:49.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.789+0000 7fb10b600700 1 Processor -- start 2024-01-22T05:15:49.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.789+0000 7fb10b600700 1 -- start start 2024-01-22T05:15:49.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb10b600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb104157ed0 0x7fb10415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb10b600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb1041582b0 0x7fb10415c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb10b600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1040be810 con 0x7fb104062c40 2024-01-22T05:15:49.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb10b600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1040c4fb0 con 0x7fb104157ed0 2024-01-22T05:15:49.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb10b600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10415c630 con 0x7fb1041582b0 2024-01-22T05:15:49.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb108c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb104157ed0 0x7fb10415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb108c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb104157ed0 0x7fb10415bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45462/0 (socket says 172.21.15.49:45462) 2024-01-22T05:15:49.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb108c00700 1 -- 172.21.15.49:0/3018174298 learned_addr learned my addr 172.21.15.49:0/3018174298 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:49.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb103e00700 1 --2- 172.21.15.49:0/3018174298 >> v2:172.21.15.110:3300/0 conn(0x7fb1041582b0 0x7fb10415c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb108c00700 1 -- 172.21.15.49:0/3018174298 >> v2:172.21.15.110:3300/0 conn(0x7fb1041582b0 msgr2=0x7fb10415c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:49.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb108c00700 1 --2- 172.21.15.49:0/3018174298 >> v2:172.21.15.110:3300/0 conn(0x7fb1041582b0 0x7fb10415c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb108c00700 1 -- 172.21.15.49:0/3018174298 >> v1:172.21.15.110:6789/0 conn(0x7fb104062c40 legacy=0x7fb1040630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb108c00700 1 -- 172.21.15.49:0/3018174298 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1040beca0 con 0x7fb104157ed0 2024-01-22T05:15:49.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb108c00700 1 --2- 172.21.15.49:0/3018174298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb104157ed0 0x7fb10415bc50 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fb1040a7f80 tx=0x7fb0f40090f0).ready entity=mon.0 client_cookie=45608bdc757c560 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb103400700 1 -- 172.21.15.49:0/3018174298 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400b520 con 0x7fb104157ed0 2024-01-22T05:15:49.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb103400700 1 -- 172.21.15.49:0/3018174298 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f400b680 con 0x7fb104157ed0 2024-01-22T05:15:49.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.793+0000 7fb103400700 1 -- 172.21.15.49:0/3018174298 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400ba00 con 0x7fb104157ed0 2024-01-22T05:15:49.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.797+0000 7fb10b600700 1 -- 172.21.15.49:0/3018174298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb104157ed0 msgr2=0x7fb10415bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.797+0000 7fb10b600700 1 --2- 172.21.15.49:0/3018174298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb104157ed0 0x7fb10415bc50 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fb1040a7f80 tx=0x7fb0f40090f0).stop 2024-01-22T05:15:49.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.797+0000 7fb10b600700 1 -- 172.21.15.49:0/3018174298 shutdown_connections 2024-01-22T05:15:49.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.797+0000 7fb10b600700 1 --2- 172.21.15.49:0/3018174298 >> v2:172.21.15.110:3300/0 conn(0x7fb1041582b0 0x7fb10415c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.797+0000 7fb10b600700 1 --2- 172.21.15.49:0/3018174298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb104157ed0 0x7fb10415bc50 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.797+0000 7fb10b600700 1 -- 172.21.15.49:0/3018174298 >> 172.21.15.49:0/3018174298 conn(0x7fb104064080 msgr2=0x7fb104064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:49.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.797+0000 7fb10b600700 1 -- 172.21.15.49:0/3018174298 shutdown_connections 2024-01-22T05:15:49.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.797+0000 7fb10b600700 1 -- 172.21.15.49:0/3018174298 wait complete. 2024-01-22T05:15:49.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.801+0000 7fb10b600700 1 Processor -- start 2024-01-22T05:15:49.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.801+0000 7fb10b600700 1 -- start start 2024-01-22T05:15:49.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb10b600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb104062c40 0x7fb104145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb10b600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb104157ed0 0x7fb104153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb10b600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1041582b0 0x7fb10415d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb10b600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1040a9010 con 0x7fb1041582b0 2024-01-22T05:15:49.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb10b600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10415eac0 con 0x7fb104157ed0 2024-01-22T05:15:49.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb10b600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10415dc30 con 0x7fb104062c40 2024-01-22T05:15:49.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb103e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb104157ed0 0x7fb104153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb10a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1041582b0 0x7fb10415d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb103e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb104157ed0 0x7fb104153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:44256/0 (socket says 172.21.15.49:44256) 2024-01-22T05:15:49.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb103e00700 1 -- 172.21.15.49:0/3668629427 learned_addr learned my addr 172.21.15.49:0/3668629427 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:49.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb108c00700 1 --2- 172.21.15.49:0/3668629427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb104062c40 0x7fb104145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb103e00700 1 -- 172.21.15.49:0/3668629427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb104062c40 msgr2=0x7fb104145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb103e00700 1 --2- 172.21.15.49:0/3668629427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb104062c40 0x7fb104145ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb103e00700 1 -- 172.21.15.49:0/3668629427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1041582b0 msgr2=0x7fb10415d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:49.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb103e00700 1 --2- 172.21.15.49:0/3668629427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1041582b0 0x7fb10415d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:49.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb103e00700 1 -- 172.21.15.49:0/3668629427 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4009370 con 0x7fb104157ed0 2024-01-22T05:15:49.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb108c00700 1 --2- 172.21.15.49:0/3668629427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb104062c40 0x7fb104145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:49.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb103e00700 1 --2- 172.21.15.49:0/3668629427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb104157ed0 0x7fb104153430 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fb0ec00e960 tx=0x7fb0ec009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb0fbe00700 1 -- 172.21.15.49:0/3668629427 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec012600 con 0x7fb104157ed0 2024-01-22T05:15:49.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb0fbe00700 1 -- 172.21.15.49:0/3668629427 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec012760 con 0x7fb104157ed0 2024-01-22T05:15:49.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb10b600700 1 -- 172.21.15.49:0/3668629427 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10415deb0 con 0x7fb104157ed0 2024-01-22T05:15:49.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb0fbe00700 1 -- 172.21.15.49:0/3668629427 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec012ae0 con 0x7fb104157ed0 2024-01-22T05:15:49.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.805+0000 7fb10b600700 1 -- 172.21.15.49:0/3668629427 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10415e470 con 0x7fb104157ed0 2024-01-22T05:15:49.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.809+0000 7fb10b600700 1 -- 172.21.15.49:0/3668629427 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10415ec70 con 0x7fb104157ed0 2024-01-22T05:15:49.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.809+0000 7fb0fbe00700 1 -- 172.21.15.49:0/3668629427 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb0ec01b400 con 0x7fb104157ed0 2024-01-22T05:15:49.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.809+0000 7fb0fbe00700 1 --2- 172.21.15.49:0/3668629427 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb0dc05a510 0x7fb0dc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:49.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.809+0000 7fb0fbe00700 1 -- 172.21.15.49:0/3668629427 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb0ec074c90 con 0x7fb104157ed0 2024-01-22T05:15:49.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.809+0000 7fb108c00700 1 --2- 172.21.15.49:0/3668629427 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb0dc05a510 0x7fb0dc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:49.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.813+0000 7fb108c00700 1 --2- 172.21.15.49:0/3668629427 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb0dc05a510 0x7fb0dc05c9d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fb0f4009130 tx=0x7fb0f4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:49.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:49.817+0000 7fb0fbe00700 1 -- 172.21.15.49:0/3668629427 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb0ec048270 con 0x7fb104157ed0 2024-01-22T05:15:50.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.057+0000 7fb10b600700 1 -- 172.21.15.49:0/3668629427 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb104047060 con 0x7fb104157ed0 2024-01-22T05:15:50.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.057+0000 7fb0fbe00700 1 -- 172.21.15.49:0/3668629427 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4503 (secure 0 0 0) 0x7fb0ec016030 con 0x7fb104157ed0 2024-01-22T05:15:50.062 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:50.062 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:14:58.925818+0000","modified":"2024-01-22T05:15:02.323695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8292":{"gid":8292,"name":"a","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3036262557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3036262557},{"type":"v1","addr":"172.21.15.49:6837","nonce":3036262557}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-22T05:15:50.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.061+0000 7fb10b600700 1 -- 172.21.15.49:0/3668629427 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb0dc05a510 msgr2=0x7fb0dc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:50.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.061+0000 7fb10b600700 1 --2- 172.21.15.49:0/3668629427 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb0dc05a510 0x7fb0dc05c9d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fb0f4009130 tx=0x7fb0f4017000).stop 2024-01-22T05:15:50.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.061+0000 7fb10b600700 1 -- 172.21.15.49:0/3668629427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb104157ed0 msgr2=0x7fb104153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:50.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.061+0000 7fb10b600700 1 --2- 172.21.15.49:0/3668629427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb104157ed0 0x7fb104153430 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fb0ec00e960 tx=0x7fb0ec009060).stop 2024-01-22T05:15:50.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.065+0000 7fb10b600700 1 -- 172.21.15.49:0/3668629427 shutdown_connections 2024-01-22T05:15:50.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.065+0000 7fb10b600700 1 --2- 172.21.15.49:0/3668629427 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb0dc05a510 0x7fb0dc05c9d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:50.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.065+0000 7fb10b600700 1 --2- 172.21.15.49:0/3668629427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1041582b0 0x7fb10415d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:50.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.065+0000 7fb10b600700 1 --2- 172.21.15.49:0/3668629427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb104157ed0 0x7fb104153430 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:50.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.065+0000 7fb10b600700 1 --2- 172.21.15.49:0/3668629427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb104062c40 0x7fb104145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:50.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.065+0000 7fb10b600700 1 -- 172.21.15.49:0/3668629427 >> 172.21.15.49:0/3668629427 conn(0x7fb104064080 msgr2=0x7fb10415b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:50.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.065+0000 7fb10b600700 1 -- 172.21.15.49:0/3668629427 shutdown_connections 2024-01-22T05:15:50.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.065+0000 7fb10b600700 1 -- 172.21.15.49:0/3668629427 wait complete. 2024-01-22T05:15:50.071 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2024-01-22T05:15:50.090 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-01-22T05:15:50.090 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:15:50.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.249+0000 7fb270800700 1 Processor -- start 2024-01-22T05:15:50.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.249+0000 7fb270800700 1 -- start start 2024-01-22T05:15:50.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb270800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb268065240 0x7fb2680644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:50.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb270800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb268065620 0x7fb2680649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:50.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb270800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2680c2700 con 0x7fb26815b9b0 2024-01-22T05:15:50.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb270800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb268064ed0 con 0x7fb268065620 2024-01-22T05:15:50.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb270800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680c29a0 con 0x7fb268065240 2024-01-22T05:15:50.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb26d400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb268065620 0x7fb2680649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:50.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb26f200700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb26815b9b0 0x7fb26815be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:54584/0 (socket says 172.21.15.49:54584) 2024-01-22T05:15:50.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb26d400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb268065620 0x7fb2680649e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45478/0 (socket says 172.21.15.49:45478) 2024-01-22T05:15:50.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb26f200700 1 -- 172.21.15.49:0/1431713575 learned_addr learned my addr 172.21.15.49:0/1431713575 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:50.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb26de00700 1 --2- 172.21.15.49:0/1431713575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb268065240 0x7fb2680644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:50.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb26ca00700 1 -- 172.21.15.49:0/1431713575 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698167461 0 0) 0x7fb2680c2700 con 0x7fb26815b9b0 2024-01-22T05:15:50.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb26ca00700 1 -- 172.21.15.49:0/1431713575 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2480033f0 con 0x7fb26815b9b0 2024-01-22T05:15:50.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb26d400700 1 -- 172.21.15.49:0/1431713575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb268065240 msgr2=0x7fb2680644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:50.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb26d400700 1 --2- 172.21.15.49:0/1431713575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb268065240 0x7fb2680644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:50.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb26d400700 1 -- 172.21.15.49:0/1431713575 >> v1:172.21.15.110:6789/0 conn(0x7fb26815b9b0 legacy=0x7fb26815be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:50.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb26d400700 1 -- 172.21.15.49:0/1431713575 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2680c2c80 con 0x7fb268065620 2024-01-22T05:15:50.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb26d400700 1 --2- 172.21.15.49:0/1431713575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065620 0x7fb2680649e0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7fb250009760 tx=0x7fb250009060).ready entity=mon.0 client_cookie=f458a0177b8e1a11 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:50.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb26ca00700 1 -- 172.21.15.49:0/1431713575 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25000d4a0 con 0x7fb268065620 2024-01-22T05:15:50.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb26ca00700 1 -- 172.21.15.49:0/1431713575 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25000d600 con 0x7fb268065620 2024-01-22T05:15:50.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.253+0000 7fb26ca00700 1 -- 172.21.15.49:0/1431713575 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25000d980 con 0x7fb268065620 2024-01-22T05:15:50.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.257+0000 7fb270800700 1 -- 172.21.15.49:0/1431713575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065620 msgr2=0x7fb2680649e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:50.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.257+0000 7fb270800700 1 --2- 172.21.15.49:0/1431713575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065620 0x7fb2680649e0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7fb250009760 tx=0x7fb250009060).stop 2024-01-22T05:15:50.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.257+0000 7fb270800700 1 -- 172.21.15.49:0/1431713575 shutdown_connections 2024-01-22T05:15:50.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.257+0000 7fb270800700 1 --2- 172.21.15.49:0/1431713575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065620 0x7fb2680649e0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:50.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.257+0000 7fb270800700 1 --2- 172.21.15.49:0/1431713575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb268065240 0x7fb2680644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:50.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.257+0000 7fb270800700 1 -- 172.21.15.49:0/1431713575 >> 172.21.15.49:0/1431713575 conn(0x7fb2680c87f0 msgr2=0x7fb2680c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:50.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.257+0000 7fb270800700 1 -- 172.21.15.49:0/1431713575 shutdown_connections 2024-01-22T05:15:50.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.257+0000 7fb270800700 1 -- 172.21.15.49:0/1431713575 wait complete. 2024-01-22T05:15:50.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.261+0000 7fb270800700 1 Processor -- start 2024-01-22T05:15:50.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.261+0000 7fb270800700 1 -- start start 2024-01-22T05:15:50.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.261+0000 7fb270800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065240 0x7fb268153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:50.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.261+0000 7fb270800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268065620 0x7fb268159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.261+0000 7fb270800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb26815b9b0 0x7fb2680a8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.261+0000 7fb270800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680ab480 con 0x7fb268065240 2024-01-22T05:15:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.261+0000 7fb270800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb268154cc0 con 0x7fb268065620 2024-01-22T05:15:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.261+0000 7fb270800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb268159f20 con 0x7fb26815b9b0 2024-01-22T05:15:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.261+0000 7fb26de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065240 0x7fb268153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.261+0000 7fb26de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065240 0x7fb268153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45490/0 (socket says 172.21.15.49:45490) 2024-01-22T05:15:50.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.261+0000 7fb26de00700 1 -- 172.21.15.49:0/1706815796 learned_addr learned my addr 172.21.15.49:0/1706815796 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:50.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.261+0000 7fb26d400700 1 --2- 172.21.15.49:0/1706815796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268065620 0x7fb268159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:50.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.265+0000 7fb26f200700 1 --2- 172.21.15.49:0/1706815796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb26815b9b0 0x7fb2680a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:50.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.265+0000 7fb26de00700 1 -- 172.21.15.49:0/1706815796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb26815b9b0 msgr2=0x7fb2680a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:50.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.265+0000 7fb26de00700 1 --2- 172.21.15.49:0/1706815796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb26815b9b0 0x7fb2680a8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:50.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.265+0000 7fb26de00700 1 -- 172.21.15.49:0/1706815796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268065620 msgr2=0x7fb268159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:50.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.265+0000 7fb26de00700 1 --2- 172.21.15.49:0/1706815796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268065620 0x7fb268159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:50.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.265+0000 7fb26de00700 1 -- 172.21.15.49:0/1706815796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2500092a0 con 0x7fb268065240 2024-01-22T05:15:50.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.265+0000 7fb26f200700 1 --2- 172.21.15.49:0/1706815796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb26815b9b0 0x7fb2680a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.265+0000 7fb26de00700 1 --2- 172.21.15.49:0/1706815796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065240 0x7fb268153d70 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fb25800e930 tx=0x7fb258009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.265+0000 7fb265600700 1 -- 172.21.15.49:0/1706815796 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25800c670 con 0x7fb268065240 2024-01-22T05:15:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.265+0000 7fb265600700 1 -- 172.21.15.49:0/1706815796 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25800c7d0 con 0x7fb268065240 2024-01-22T05:15:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.265+0000 7fb265600700 1 -- 172.21.15.49:0/1706815796 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25800cb50 con 0x7fb268065240 2024-01-22T05:15:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.265+0000 7fb270800700 1 -- 172.21.15.49:0/1706815796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26815a200 con 0x7fb268065240 2024-01-22T05:15:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.265+0000 7fb270800700 1 -- 172.21.15.49:0/1706815796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26815a7c0 con 0x7fb268065240 2024-01-22T05:15:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.265+0000 7fb270800700 1 -- 172.21.15.49:0/1706815796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb268047060 con 0x7fb268065240 2024-01-22T05:15:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.269+0000 7fb265600700 1 -- 172.21.15.49:0/1706815796 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb25801b400 con 0x7fb268065240 2024-01-22T05:15:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.269+0000 7fb265600700 1 --2- 172.21.15.49:0/1706815796 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb24005a510 0x7fb24005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.269+0000 7fb265600700 1 -- 172.21.15.49:0/1706815796 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb258074ea0 con 0x7fb268065240 2024-01-22T05:15:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.269+0000 7fb26d400700 1 --2- 172.21.15.49:0/1706815796 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb24005a510 0x7fb24005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.269+0000 7fb26d400700 1 --2- 172.21.15.49:0/1706815796 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb24005a510 0x7fb24005c9d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fb268065d80 tx=0x7fb250016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.273+0000 7fb265600700 1 -- 172.21.15.49:0/1706815796 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb258048530 con 0x7fb268065240 2024-01-22T05:15:50.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.497+0000 7fb270800700 1 -- 172.21.15.49:0/1706815796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb2680c2f60 con 0x7fb268065240 2024-01-22T05:15:50.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.497+0000 7fb265600700 1 -- 172.21.15.49:0/1706815796 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1622 (secure 0 0 0) 0x7fb25804bb50 con 0x7fb268065240 2024-01-22T05:15:50.502 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:50.502 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":694,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":133,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1078,"data_bytes":1075905752,"bytes_used":4675461120,"bytes_avail":768418652160,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":7950743,"read_op_per_sec":0,"write_op_per_sec":181},"fsmap":{"epoch":106,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8292}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-01-22T05:15:49.482989+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:15:50.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.501+0000 7fb270800700 1 -- 172.21.15.49:0/1706815796 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb24005a510 msgr2=0x7fb24005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:50.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.501+0000 7fb270800700 1 --2- 172.21.15.49:0/1706815796 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb24005a510 0x7fb24005c9d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fb268065d80 tx=0x7fb250016000).stop 2024-01-22T05:15:50.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.501+0000 7fb270800700 1 -- 172.21.15.49:0/1706815796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065240 msgr2=0x7fb268153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:50.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.501+0000 7fb270800700 1 --2- 172.21.15.49:0/1706815796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065240 0x7fb268153d70 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fb25800e930 tx=0x7fb258009060).stop 2024-01-22T05:15:50.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.501+0000 7fb270800700 1 -- 172.21.15.49:0/1706815796 shutdown_connections 2024-01-22T05:15:50.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.501+0000 7fb270800700 1 --2- 172.21.15.49:0/1706815796 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb24005a510 0x7fb24005c9d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:50.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.501+0000 7fb270800700 1 --2- 172.21.15.49:0/1706815796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb26815b9b0 0x7fb2680a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:50.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.501+0000 7fb270800700 1 --2- 172.21.15.49:0/1706815796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268065620 0x7fb268159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:50.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.501+0000 7fb270800700 1 --2- 172.21.15.49:0/1706815796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065240 0x7fb268153d70 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:50.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.501+0000 7fb270800700 1 -- 172.21.15.49:0/1706815796 >> 172.21.15.49:0/1706815796 conn(0x7fb2680c87f0 msgr2=0x7fb2680636c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:50.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.501+0000 7fb270800700 1 -- 172.21.15.49:0/1706815796 shutdown_connections 2024-01-22T05:15:50.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:50.501+0000 7fb270800700 1 -- 172.21.15.49:0/1706815796 wait complete. 2024-01-22T05:15:50.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused'} 2024-01-22T05:15:51.529 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:15:51.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.693+0000 7f2984e00700 1 Processor -- start 2024-01-22T05:15:51.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.693+0000 7f2984e00700 1 -- start start 2024-01-22T05:15:51.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f2984e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2980067eb0 0x7f29800a7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:51.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f2984e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2980063080 0x7f29801551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:51.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f2984e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2980068290 con 0x7f29800a7c40 2024-01-22T05:15:51.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f2984e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29800a80b0 con 0x7f2980063080 2024-01-22T05:15:51.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f2984e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2980068510 con 0x7f2980067eb0 2024-01-22T05:15:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f297d400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f29800a7c40 0x7f2980062970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59802/0 (socket says 172.21.15.49:59802) 2024-01-22T05:15:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f297d400700 1 -- 172.21.15.49:0/1078799044 learned_addr learned my addr 172.21.15.49:0/1078799044 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f297e800700 1 --2- 172.21.15.49:0/1078799044 >> v2:172.21.15.49:3300/0 conn(0x7f2980063080 0x7f29801551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f297de00700 1 --2- 172.21.15.49:0/1078799044 >> v2:172.21.15.110:3300/0 conn(0x7f2980067eb0 0x7f29800a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f297ca00700 1 -- 172.21.15.49:0/1078799044 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29469723 0 0) 0x7f2980068290 con 0x7f29800a7c40 2024-01-22T05:15:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f297ca00700 1 -- 172.21.15.49:0/1078799044 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29600033f0 con 0x7f29800a7c40 2024-01-22T05:15:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f297e800700 1 -- 172.21.15.49:0/1078799044 >> v2:172.21.15.110:3300/0 conn(0x7f2980067eb0 msgr2=0x7f29800a7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f297e800700 1 --2- 172.21.15.49:0/1078799044 >> v2:172.21.15.110:3300/0 conn(0x7f2980067eb0 0x7f29800a7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f297e800700 1 -- 172.21.15.49:0/1078799044 >> v1:172.21.15.49:6789/0 conn(0x7f29800a7c40 legacy=0x7f2980062970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f297e800700 1 -- 172.21.15.49:0/1078799044 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29800687f0 con 0x7f2980063080 2024-01-22T05:15:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f297e800700 1 --2- 172.21.15.49:0/1078799044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2980063080 0x7f29801551e0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f2980066a10 tx=0x7f2978009780).ready entity=mon.0 client_cookie=b7977b2d15d46b84 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f297ca00700 1 -- 172.21.15.49:0/1078799044 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297800e070 con 0x7f2980063080 2024-01-22T05:15:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f297ca00700 1 -- 172.21.15.49:0/1078799044 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297800bab0 con 0x7f2980063080 2024-01-22T05:15:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.697+0000 7f297ca00700 1 -- 172.21.15.49:0/1078799044 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297800be30 con 0x7f2980063080 2024-01-22T05:15:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.701+0000 7f2984e00700 1 -- 172.21.15.49:0/1078799044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2980063080 msgr2=0x7f29801551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.701+0000 7f2984e00700 1 --2- 172.21.15.49:0/1078799044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2980063080 0x7f29801551e0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f2980066a10 tx=0x7f2978009780).stop 2024-01-22T05:15:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.701+0000 7f2984e00700 1 -- 172.21.15.49:0/1078799044 shutdown_connections 2024-01-22T05:15:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.701+0000 7f2984e00700 1 --2- 172.21.15.49:0/1078799044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2980063080 0x7f29801551e0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.701+0000 7f2984e00700 1 --2- 172.21.15.49:0/1078799044 >> v2:172.21.15.110:3300/0 conn(0x7f2980067eb0 0x7f29800a7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.701+0000 7f2984e00700 1 -- 172.21.15.49:0/1078799044 >> 172.21.15.49:0/1078799044 conn(0x7f29800c8740 msgr2=0x7f29800c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.701+0000 7f2984e00700 1 -- 172.21.15.49:0/1078799044 shutdown_connections 2024-01-22T05:15:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.701+0000 7f2984e00700 1 -- 172.21.15.49:0/1078799044 wait complete. 2024-01-22T05:15:51.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.705+0000 7f2984e00700 1 Processor -- start 2024-01-22T05:15:51.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.705+0000 7f2984e00700 1 -- start start 2024-01-22T05:15:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.705+0000 7f2984e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2980063080 0x7f2980149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.705+0000 7f2984e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2980067eb0 0x7f29800ab6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.705+0000 7f2984e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29800a7c40 0x7f29800c1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.705+0000 7f2984e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800aa2d0 con 0x7f2980063080 2024-01-22T05:15:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.705+0000 7f2984e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800a93e0 con 0x7f29800a7c40 2024-01-22T05:15:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.705+0000 7f2984e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29800a96c0 con 0x7f2980067eb0 2024-01-22T05:15:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f297de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2980063080 0x7f2980149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f297de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2980063080 0x7f2980149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45512/0 (socket says 172.21.15.49:45512) 2024-01-22T05:15:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f297de00700 1 -- 172.21.15.49:0/3156174987 learned_addr learned my addr 172.21.15.49:0/3156174987 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f297e800700 1 --2- 172.21.15.49:0/3156174987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29800a7c40 0x7f29800c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f297d400700 1 --2- 172.21.15.49:0/3156174987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2980067eb0 0x7f29800ab6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f297de00700 1 -- 172.21.15.49:0/3156174987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2980067eb0 msgr2=0x7f29800ab6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f297de00700 1 --2- 172.21.15.49:0/3156174987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2980067eb0 0x7f29800ab6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f297de00700 1 -- 172.21.15.49:0/3156174987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29800a7c40 msgr2=0x7f29800c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f297de00700 1 --2- 172.21.15.49:0/3156174987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29800a7c40 0x7f29800c1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f297de00700 1 -- 172.21.15.49:0/3156174987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2978009a20 con 0x7f2980063080 2024-01-22T05:15:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f297d400700 1 --2- 172.21.15.49:0/3156174987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2980067eb0 0x7f29800ab6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f297de00700 1 --2- 172.21.15.49:0/3156174987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2980063080 0x7f2980149990 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f297000e930 tx=0x7f2970009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f2975600700 1 -- 172.21.15.49:0/3156174987 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297000c670 con 0x7f2980063080 2024-01-22T05:15:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f2975600700 1 -- 172.21.15.49:0/3156174987 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297000c7d0 con 0x7f2980063080 2024-01-22T05:15:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f2984e00700 1 -- 172.21.15.49:0/3156174987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29800a99a0 con 0x7f2980063080 2024-01-22T05:15:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f2975600700 1 -- 172.21.15.49:0/3156174987 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297000cb50 con 0x7f2980063080 2024-01-22T05:15:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.709+0000 7f2984e00700 1 -- 172.21.15.49:0/3156174987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29800a9f60 con 0x7f2980063080 2024-01-22T05:15:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.713+0000 7f2984e00700 1 -- 172.21.15.49:0/3156174987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2980066560 con 0x7f2980063080 2024-01-22T05:15:51.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.713+0000 7f2975600700 1 -- 172.21.15.49:0/3156174987 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f297001b400 con 0x7f2980063080 2024-01-22T05:15:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.713+0000 7f2975600700 1 --2- 172.21.15.49:0/3156174987 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f295805a510 0x7f295805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.713+0000 7f2975600700 1 -- 172.21.15.49:0/3156174987 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2970074e20 con 0x7f2980063080 2024-01-22T05:15:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.713+0000 7f297d400700 1 --2- 172.21.15.49:0/3156174987 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f295805a510 0x7f295805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.713+0000 7f297d400700 1 --2- 172.21.15.49:0/3156174987 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f295805a510 0x7f295805c9d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f2968007fd0 tx=0x7f2968009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:51.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.721+0000 7f2975600700 1 -- 172.21.15.49:0/3156174987 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2970048400 con 0x7f2980063080 2024-01-22T05:15:51.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.921+0000 7f2984e00700 1 -- 172.21.15.49:0/3156174987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2980068ad0 con 0x7f2980063080 2024-01-22T05:15:51.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.925+0000 7f2975600700 1 -- 172.21.15.49:0/3156174987 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4503 (secure 0 0 0) 0x7f297004ba20 con 0x7f2980063080 2024-01-22T05:15:51.928 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:51.928 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:14:58.925818+0000","modified":"2024-01-22T05:15:02.323695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8292":{"gid":8292,"name":"a","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3036262557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3036262557},{"type":"v1","addr":"172.21.15.49:6837","nonce":3036262557}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-22T05:15:51.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.925+0000 7f2984e00700 1 -- 172.21.15.49:0/3156174987 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f295805a510 msgr2=0x7f295805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:51.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.925+0000 7f2984e00700 1 --2- 172.21.15.49:0/3156174987 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f295805a510 0x7f295805c9d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f2968007fd0 tx=0x7f2968009040).stop 2024-01-22T05:15:51.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.925+0000 7f2984e00700 1 -- 172.21.15.49:0/3156174987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2980063080 msgr2=0x7f2980149990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:51.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.925+0000 7f2984e00700 1 --2- 172.21.15.49:0/3156174987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2980063080 0x7f2980149990 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f297000e930 tx=0x7f2970009060).stop 2024-01-22T05:15:51.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.925+0000 7f2984e00700 1 -- 172.21.15.49:0/3156174987 shutdown_connections 2024-01-22T05:15:51.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.925+0000 7f2984e00700 1 --2- 172.21.15.49:0/3156174987 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f295805a510 0x7f295805c9d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:51.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.925+0000 7f2984e00700 1 --2- 172.21.15.49:0/3156174987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29800a7c40 0x7f29800c1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:51.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.925+0000 7f2984e00700 1 --2- 172.21.15.49:0/3156174987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2980067eb0 0x7f29800ab6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:51.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.925+0000 7f2984e00700 1 --2- 172.21.15.49:0/3156174987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2980063080 0x7f2980149990 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:51.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.925+0000 7f2984e00700 1 -- 172.21.15.49:0/3156174987 >> 172.21.15.49:0/3156174987 conn(0x7f29800c8740 msgr2=0x7f29800c5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:51.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.929+0000 7f2984e00700 1 -- 172.21.15.49:0/3156174987 shutdown_connections 2024-01-22T05:15:51.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:51.929+0000 7f2984e00700 1 -- 172.21.15.49:0/3156174987 wait complete. 2024-01-22T05:15:51.936 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2024-01-22T05:15:51.955 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-01-22T05:15:51.955 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:15:52.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.117+0000 7f958bc00700 1 Processor -- start 2024-01-22T05:15:52.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.121+0000 7f958bc00700 1 -- start start 2024-01-22T05:15:52.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.121+0000 7f958bc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9584065660 0x7f95840a6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:52.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.121+0000 7f958bc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f95840644f0 0x7f9584064950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:52.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.121+0000 7f958bc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95841575b0 0x7f9584157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:52.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.121+0000 7f958bc00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95840c2700 con 0x7f9584065660 2024-01-22T05:15:52.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.121+0000 7f958bc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9584064e40 con 0x7f95840644f0 2024-01-22T05:15:52.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.121+0000 7f958bc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95840c2930 con 0x7f95841575b0 2024-01-22T05:15:52.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f9589200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9584065660 0x7f95840a6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:52.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f9589200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9584065660 0x7f95840a6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45528/0 (socket says 172.21.15.49:45528) 2024-01-22T05:15:52.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f9589200700 1 -- 172.21.15.49:0/1159790969 learned_addr learned my addr 172.21.15.49:0/1159790969 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:52.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f9583e00700 1 --2- 172.21.15.49:0/1159790969 >> v2:172.21.15.110:3300/0 conn(0x7f95840644f0 0x7f9584064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:52.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f958a600700 1 --2- 172.21.15.49:0/1159790969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95841575b0 0x7f9584157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:52.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f9589200700 1 -- 172.21.15.49:0/1159790969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95841575b0 msgr2=0x7f9584157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:52.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f9589200700 1 --2- 172.21.15.49:0/1159790969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95841575b0 0x7f9584157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:52.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f9589200700 1 -- 172.21.15.49:0/1159790969 >> v2:172.21.15.110:3300/0 conn(0x7f95840644f0 msgr2=0x7f9584064950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:52.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f9589200700 1 --2- 172.21.15.49:0/1159790969 >> v2:172.21.15.110:3300/0 conn(0x7f95840644f0 0x7f9584064950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:52.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f9589200700 1 -- 172.21.15.49:0/1159790969 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95840c2c10 con 0x7f9584065660 2024-01-22T05:15:52.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f9583e00700 1 --2- 172.21.15.49:0/1159790969 >> v2:172.21.15.110:3300/0 conn(0x7f95840644f0 0x7f9584064950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:52.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f9589200700 1 --2- 172.21.15.49:0/1159790969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9584065660 0x7f95840a6f40 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f9584065d80 tx=0x7f95740090f0).ready entity=mon.0 client_cookie=9b0992a536d17eea server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:52.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f9583400700 1 -- 172.21.15.49:0/1159790969 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957400b600 con 0x7f9584065660 2024-01-22T05:15:52.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f9583400700 1 -- 172.21.15.49:0/1159790969 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957400b760 con 0x7f9584065660 2024-01-22T05:15:52.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f9583400700 1 -- 172.21.15.49:0/1159790969 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957400bae0 con 0x7f9584065660 2024-01-22T05:15:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f958bc00700 1 -- 172.21.15.49:0/1159790969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9584065660 msgr2=0x7f95840a6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f958bc00700 1 --2- 172.21.15.49:0/1159790969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9584065660 0x7f95840a6f40 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f9584065d80 tx=0x7f95740090f0).stop 2024-01-22T05:15:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f958bc00700 1 -- 172.21.15.49:0/1159790969 shutdown_connections 2024-01-22T05:15:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f958bc00700 1 --2- 172.21.15.49:0/1159790969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95841575b0 0x7f9584157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f958bc00700 1 --2- 172.21.15.49:0/1159790969 >> v2:172.21.15.110:3300/0 conn(0x7f95840644f0 0x7f9584064950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f958bc00700 1 --2- 172.21.15.49:0/1159790969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9584065660 0x7f95840a6f40 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.125+0000 7f958bc00700 1 -- 172.21.15.49:0/1159790969 >> 172.21.15.49:0/1159790969 conn(0x7f95840c87f0 msgr2=0x7f95840c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.129+0000 7f958bc00700 1 -- 172.21.15.49:0/1159790969 shutdown_connections 2024-01-22T05:15:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.129+0000 7f958bc00700 1 -- 172.21.15.49:0/1159790969 wait complete. 2024-01-22T05:15:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.129+0000 7f958bc00700 1 Processor -- start 2024-01-22T05:15:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.129+0000 7f958bc00700 1 -- start start 2024-01-22T05:15:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f958bc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95840644f0 0x7f95840a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f958bc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9584065660 0x7f95840a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f958bc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95841575b0 0x7f958414bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f958bc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95840a51e0 con 0x7f9584065660 2024-01-22T05:15:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f958bc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95840a5460 con 0x7f95841575b0 2024-01-22T05:15:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f958bc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95840a5740 con 0x7f95840644f0 2024-01-22T05:15:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f9583e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9584065660 0x7f95840a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f9583e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9584065660 0x7f95840a4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45532/0 (socket says 172.21.15.49:45532) 2024-01-22T05:15:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f9583e00700 1 -- 172.21.15.49:0/641934732 learned_addr learned my addr 172.21.15.49:0/641934732 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f9589200700 1 --2- 172.21.15.49:0/641934732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95840644f0 0x7f95840a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f958a600700 1 --2- 172.21.15.49:0/641934732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95841575b0 0x7f958414bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f9583e00700 1 -- 172.21.15.49:0/641934732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95840644f0 msgr2=0x7f95840a8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f9583e00700 1 --2- 172.21.15.49:0/641934732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95840644f0 0x7f95840a8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f9583e00700 1 -- 172.21.15.49:0/641934732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95841575b0 msgr2=0x7f958414bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f9583e00700 1 --2- 172.21.15.49:0/641934732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95841575b0 0x7f958414bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f9583e00700 1 -- 172.21.15.49:0/641934732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9574009370 con 0x7f9584065660 2024-01-22T05:15:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f9589200700 1 --2- 172.21.15.49:0/641934732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95840644f0 0x7f95840a8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f9583e00700 1 --2- 172.21.15.49:0/641934732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9584065660 0x7f95840a4cf0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f956c00d860 tx=0x7f956c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f957be00700 1 -- 172.21.15.49:0/641934732 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c011590 con 0x7f9584065660 2024-01-22T05:15:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f957be00700 1 -- 172.21.15.49:0/641934732 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956c0116f0 con 0x7f9584065660 2024-01-22T05:15:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f958bc00700 1 -- 172.21.15.49:0/641934732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95840a5a20 con 0x7f9584065660 2024-01-22T05:15:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f957be00700 1 -- 172.21.15.49:0/641934732 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c011a70 con 0x7f9584065660 2024-01-22T05:15:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.133+0000 7f958bc00700 1 -- 172.21.15.49:0/641934732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95840a5fe0 con 0x7f9584065660 2024-01-22T05:15:52.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.137+0000 7f958bc00700 1 -- 172.21.15.49:0/641934732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9584047060 con 0x7f9584065660 2024-01-22T05:15:52.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.137+0000 7f957be00700 1 -- 172.21.15.49:0/641934732 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f956c01c460 con 0x7f9584065660 2024-01-22T05:15:52.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.137+0000 7f957be00700 1 --2- 172.21.15.49:0/641934732 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f955c05a4e0 0x7f955c05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:52.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.137+0000 7f957be00700 1 -- 172.21.15.49:0/641934732 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f956c0748d0 con 0x7f9584065660 2024-01-22T05:15:52.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.137+0000 7f9589200700 1 --2- 172.21.15.49:0/641934732 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f955c05a4e0 0x7f955c05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:52.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.141+0000 7f9589200700 1 --2- 172.21.15.49:0/641934732 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f955c05a4e0 0x7f955c05c9a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f9574009130 tx=0x7f9574017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:52.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.145+0000 7f957be00700 1 -- 172.21.15.49:0/641934732 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f956c047eb0 con 0x7f9584065660 2024-01-22T05:15:52.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.361+0000 7f958bc00700 1 -- 172.21.15.49:0/641934732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f95840c2ef0 con 0x7f9584065660 2024-01-22T05:15:52.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.365+0000 7f957be00700 1 -- 172.21.15.49:0/641934732 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1622 (secure 0 0 0) 0x7f956c04b4d0 con 0x7f9584065660 2024-01-22T05:15:52.368 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:52.368 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":696,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":133,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1078,"data_bytes":1075905752,"bytes_used":4675461120,"bytes_avail":768418652160,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":7950743,"read_op_per_sec":0,"write_op_per_sec":181},"fsmap":{"epoch":106,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8292}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-01-22T05:15:49.482989+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:15:52.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.365+0000 7f958bc00700 1 -- 172.21.15.49:0/641934732 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f955c05a4e0 msgr2=0x7f955c05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:52.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.365+0000 7f958bc00700 1 --2- 172.21.15.49:0/641934732 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f955c05a4e0 0x7f955c05c9a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f9574009130 tx=0x7f9574017000).stop 2024-01-22T05:15:52.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.365+0000 7f958bc00700 1 -- 172.21.15.49:0/641934732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9584065660 msgr2=0x7f95840a4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:52.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.365+0000 7f958bc00700 1 --2- 172.21.15.49:0/641934732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9584065660 0x7f95840a4cf0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f956c00d860 tx=0x7f956c008040).stop 2024-01-22T05:15:52.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.369+0000 7f958bc00700 1 -- 172.21.15.49:0/641934732 shutdown_connections 2024-01-22T05:15:52.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.369+0000 7f958bc00700 1 --2- 172.21.15.49:0/641934732 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f955c05a4e0 0x7f955c05c9a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:52.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.369+0000 7f958bc00700 1 --2- 172.21.15.49:0/641934732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95841575b0 0x7f958414bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:52.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.369+0000 7f958bc00700 1 --2- 172.21.15.49:0/641934732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9584065660 0x7f95840a4cf0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:52.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.369+0000 7f958bc00700 1 --2- 172.21.15.49:0/641934732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95840644f0 0x7f95840a8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:52.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.369+0000 7f958bc00700 1 -- 172.21.15.49:0/641934732 >> 172.21.15.49:0/641934732 conn(0x7f95840c87f0 msgr2=0x7f9584156360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:52.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.369+0000 7f958bc00700 1 -- 172.21.15.49:0/641934732 shutdown_connections 2024-01-22T05:15:52.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:52.369+0000 7f958bc00700 1 -- 172.21.15.49:0/641934732 wait complete. 2024-01-22T05:15:52.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused'} 2024-01-22T05:15:53.397 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:15:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.565+0000 7f4a41200700 1 Processor -- start 2024-01-22T05:15:53.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.565+0000 7f4a41200700 1 -- start start 2024-01-22T05:15:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a41200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4a3c062230 0x7f4a3c1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a41200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4a3c153ae0 0x7f4a3c0c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a41200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3c0632d0 con 0x7f4a3c0c3ff0 2024-01-22T05:15:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a41200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3c1586a0 con 0x7f4a3c062230 2024-01-22T05:15:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a41200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3c0c4480 con 0x7f4a3c153ae0 2024-01-22T05:15:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a39e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4a3c062230 0x7f4a3c1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:53.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a39e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4a3c062230 0x7f4a3c1581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37036/0 (socket says 172.21.15.49:37036) 2024-01-22T05:15:53.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a39e00700 1 -- 172.21.15.49:0/2502632570 learned_addr learned my addr 172.21.15.49:0/2502632570 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:53.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a39400700 1 --2- 172.21.15.49:0/2502632570 >> v2:172.21.15.110:3300/0 conn(0x7f4a3c153ae0 0x7f4a3c0c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:53.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a39e00700 1 -- 172.21.15.49:0/2502632570 >> v2:172.21.15.110:3300/0 conn(0x7f4a3c153ae0 msgr2=0x7f4a3c0c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:53.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a39e00700 1 --2- 172.21.15.49:0/2502632570 >> v2:172.21.15.110:3300/0 conn(0x7f4a3c153ae0 0x7f4a3c0c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:53.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a39e00700 1 -- 172.21.15.49:0/2502632570 >> v1:172.21.15.110:6789/0 conn(0x7f4a3c0c3ff0 legacy=0x7f4a3c067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:53.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a39e00700 1 -- 172.21.15.49:0/2502632570 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c0bfa30 con 0x7f4a3c062230 2024-01-22T05:15:53.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a39e00700 1 --2- 172.21.15.49:0/2502632570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a3c062230 0x7f4a3c1581b0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f4a3c0677b0 tx=0x7f4a2c0090f0).ready entity=mon.0 client_cookie=2b6e3a1bf599cff1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:53.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a38a00700 1 -- 172.21.15.49:0/2502632570 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00b600 con 0x7f4a3c062230 2024-01-22T05:15:53.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a38a00700 1 -- 172.21.15.49:0/2502632570 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c00b760 con 0x7f4a3c062230 2024-01-22T05:15:53.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a38a00700 1 -- 172.21.15.49:0/2502632570 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00bae0 con 0x7f4a3c062230 2024-01-22T05:15:53.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a41200700 1 -- 172.21.15.49:0/2502632570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a3c062230 msgr2=0x7f4a3c1581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:53.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.569+0000 7f4a41200700 1 --2- 172.21.15.49:0/2502632570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a3c062230 0x7f4a3c1581b0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f4a3c0677b0 tx=0x7f4a2c0090f0).stop 2024-01-22T05:15:53.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.573+0000 7f4a41200700 1 -- 172.21.15.49:0/2502632570 shutdown_connections 2024-01-22T05:15:53.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.573+0000 7f4a41200700 1 --2- 172.21.15.49:0/2502632570 >> v2:172.21.15.110:3300/0 conn(0x7f4a3c153ae0 0x7f4a3c0c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:53.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.573+0000 7f4a41200700 1 --2- 172.21.15.49:0/2502632570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a3c062230 0x7f4a3c1581b0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:53.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.573+0000 7f4a41200700 1 -- 172.21.15.49:0/2502632570 >> 172.21.15.49:0/2502632570 conn(0x7f4a3c0c5860 msgr2=0x7f4a3c0c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:53.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.573+0000 7f4a41200700 1 -- 172.21.15.49:0/2502632570 shutdown_connections 2024-01-22T05:15:53.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.573+0000 7f4a41200700 1 -- 172.21.15.49:0/2502632570 wait complete. 2024-01-22T05:15:53.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.573+0000 7f4a41200700 1 Processor -- start 2024-01-22T05:15:53.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a41200700 1 -- start start 2024-01-22T05:15:53.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a41200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a3c0c3ff0 0x7f4a3c152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:53.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a41200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a3c153ae0 0x7f4a3c155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:53.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a41200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a3c145760 0x7f4a3c0bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:53.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a41200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c0aee30 con 0x7f4a3c0c3ff0 2024-01-22T05:15:53.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a41200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c156910 con 0x7f4a3c153ae0 2024-01-22T05:15:53.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a41200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c0ac770 con 0x7f4a3c145760 2024-01-22T05:15:53.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a39e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a3c0c3ff0 0x7f4a3c152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:53.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a39e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a3c0c3ff0 0x7f4a3c152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37040/0 (socket says 172.21.15.49:37040) 2024-01-22T05:15:53.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a39e00700 1 -- 172.21.15.49:0/1792248683 learned_addr learned my addr 172.21.15.49:0/1792248683 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:53.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a39400700 1 --2- 172.21.15.49:0/1792248683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a3c153ae0 0x7f4a3c155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:53.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a3b200700 1 --2- 172.21.15.49:0/1792248683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a3c145760 0x7f4a3c0bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:53.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a39e00700 1 -- 172.21.15.49:0/1792248683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a3c145760 msgr2=0x7f4a3c0bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:53.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a39e00700 1 --2- 172.21.15.49:0/1792248683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a3c145760 0x7f4a3c0bfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:53.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a39e00700 1 -- 172.21.15.49:0/1792248683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a3c153ae0 msgr2=0x7f4a3c155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:53.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a39e00700 1 --2- 172.21.15.49:0/1792248683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a3c153ae0 0x7f4a3c155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:53.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a39e00700 1 -- 172.21.15.49:0/1792248683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c009370 con 0x7f4a3c0c3ff0 2024-01-22T05:15:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a3b200700 1 --2- 172.21.15.49:0/1792248683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a3c145760 0x7f4a3c0bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a39e00700 1 --2- 172.21.15.49:0/1792248683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a3c0c3ff0 0x7f4a3c152690 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f4a3c05f460 tx=0x7f4a2c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a31600700 1 -- 172.21.15.49:0/1792248683 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00b8d0 con 0x7f4a3c0c3ff0 2024-01-22T05:15:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a31600700 1 -- 172.21.15.49:0/1792248683 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c00ba30 con 0x7f4a3c0c3ff0 2024-01-22T05:15:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.577+0000 7f4a41200700 1 -- 172.21.15.49:0/1792248683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3c156070 con 0x7f4a3c0c3ff0 2024-01-22T05:15:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.581+0000 7f4a31600700 1 -- 172.21.15.49:0/1792248683 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c01b660 con 0x7f4a3c0c3ff0 2024-01-22T05:15:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.581+0000 7f4a41200700 1 -- 172.21.15.49:0/1792248683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3c156630 con 0x7f4a3c0c3ff0 2024-01-22T05:15:53.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.581+0000 7f4a41200700 1 -- 172.21.15.49:0/1792248683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a3c0ac540 con 0x7f4a3c0c3ff0 2024-01-22T05:15:53.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.581+0000 7f4a31600700 1 -- 172.21.15.49:0/1792248683 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4a2c01ba10 con 0x7f4a3c0c3ff0 2024-01-22T05:15:53.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.585+0000 7f4a31600700 1 --2- 172.21.15.49:0/1792248683 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4a1405a510 0x7f4a1405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:53.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.585+0000 7f4a31600700 1 -- 172.21.15.49:0/1792248683 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4a2c076430 con 0x7f4a3c0c3ff0 2024-01-22T05:15:53.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.585+0000 7f4a39400700 1 --2- 172.21.15.49:0/1792248683 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4a1405a510 0x7f4a1405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:53.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.585+0000 7f4a39400700 1 --2- 172.21.15.49:0/1792248683 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4a1405a510 0x7f4a1405c9d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f4a24006fd0 tx=0x7f4a24008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:53.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.589+0000 7f4a31600700 1 -- 172.21.15.49:0/1792248683 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4a3c0ac540 con 0x7f4a3c0c3ff0 2024-01-22T05:15:53.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.785+0000 7f4a41200700 1 -- 172.21.15.49:0/1792248683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a3c0ac540 con 0x7f4a3c0c3ff0 2024-01-22T05:15:53.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.785+0000 7f4a31600700 1 -- 172.21.15.49:0/1792248683 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4503 (secure 0 0 0) 0x7f4a3c0ac540 con 0x7f4a3c0c3ff0 2024-01-22T05:15:53.791 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:53.791 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:14:58.925818+0000","modified":"2024-01-22T05:15:02.323695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8292":{"gid":8292,"name":"a","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3036262557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3036262557},{"type":"v1","addr":"172.21.15.49:6837","nonce":3036262557}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-22T05:15:53.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.789+0000 7f4a41200700 1 -- 172.21.15.49:0/1792248683 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4a1405a510 msgr2=0x7f4a1405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:53.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.789+0000 7f4a41200700 1 --2- 172.21.15.49:0/1792248683 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4a1405a510 0x7f4a1405c9d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f4a24006fd0 tx=0x7f4a24008040).stop 2024-01-22T05:15:53.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.789+0000 7f4a41200700 1 -- 172.21.15.49:0/1792248683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a3c0c3ff0 msgr2=0x7f4a3c152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:53.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.789+0000 7f4a41200700 1 --2- 172.21.15.49:0/1792248683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a3c0c3ff0 0x7f4a3c152690 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f4a3c05f460 tx=0x7f4a2c017000).stop 2024-01-22T05:15:53.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.789+0000 7f4a41200700 1 -- 172.21.15.49:0/1792248683 shutdown_connections 2024-01-22T05:15:53.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.789+0000 7f4a41200700 1 --2- 172.21.15.49:0/1792248683 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4a1405a510 0x7f4a1405c9d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:53.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.789+0000 7f4a41200700 1 --2- 172.21.15.49:0/1792248683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a3c145760 0x7f4a3c0bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:53.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.789+0000 7f4a41200700 1 --2- 172.21.15.49:0/1792248683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a3c153ae0 0x7f4a3c155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:53.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.789+0000 7f4a41200700 1 --2- 172.21.15.49:0/1792248683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a3c0c3ff0 0x7f4a3c152690 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:53.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.789+0000 7f4a41200700 1 -- 172.21.15.49:0/1792248683 >> 172.21.15.49:0/1792248683 conn(0x7f4a3c0c5860 msgr2=0x7f4a3c157d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:53.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.789+0000 7f4a41200700 1 -- 172.21.15.49:0/1792248683 shutdown_connections 2024-01-22T05:15:53.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.789+0000 7f4a41200700 1 -- 172.21.15.49:0/1792248683 wait complete. 2024-01-22T05:15:53.797 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2024-01-22T05:15:53.817 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-01-22T05:15:53.817 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:15:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.977+0000 7f6188800700 1 Processor -- start 2024-01-22T05:15:53.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.977+0000 7f6188800700 1 -- start start 2024-01-22T05:15:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.981+0000 7f6188800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6180065620 0x7f61800bd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.981+0000 7f6188800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61800c2700 con 0x7f6180064c00 2024-01-22T05:15:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.981+0000 7f6188800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61800c29a0 con 0x7f6180065240 2024-01-22T05:15:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.981+0000 7f6188800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61800c2c80 con 0x7f6180065620 2024-01-22T05:15:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.981+0000 7f6185400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6180064c00 0x7f61800bcc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44612/0 (socket says 172.21.15.49:44612) 2024-01-22T05:15:53.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.981+0000 7f6185400700 1 -- 172.21.15.49:0/3952242204 learned_addr learned my addr 172.21.15.49:0/3952242204 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:53.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.981+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304152238 0 0) 0x7f61800c2700 con 0x7f6180064c00 2024-01-22T05:15:53.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.981+0000 7f6187200700 1 --2- 172.21.15.49:0/3952242204 >> v2:172.21.15.110:3300/0 conn(0x7f6180065620 0x7f61800bd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:53.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.981+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61600033f0 con 0x7f6180064c00 2024-01-22T05:15:53.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.981+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286688764 0 0) 0x7f61800c29a0 con 0x7f6180065240 2024-01-22T05:15:53.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.981+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61800c2700 con 0x7f6180065240 2024-01-22T05:15:53.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.981+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 181512384 0 0) 0x7f61600033f0 con 0x7f6180064c00 2024-01-22T05:15:53.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.981+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 >> v2:172.21.15.110:3300/0 conn(0x7f6180065620 msgr2=0x7f61800bd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:53.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6184a00700 1 --2- 172.21.15.49:0/3952242204 >> v2:172.21.15.110:3300/0 conn(0x7f6180065620 0x7f61800bd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:53.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 >> v1:172.21.15.110:6789/0 conn(0x7f6180065240 legacy=0x7f61800644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:53.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61800c2f60 con 0x7f6180064c00 2024-01-22T05:15:53.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f6168001470 con 0x7f6180064c00 2024-01-22T05:15:53.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 >> v1:172.21.15.49:6789/0 conn(0x7f6180064c00 legacy=0x7f61800bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:53.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6184a00700 1 --2- 172.21.15.49:0/3952242204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6160003a70 0x7f6160003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:53.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6184a00700 1 --2- 172.21.15.49:0/3952242204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6160004690 0x7f6160004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:53.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6184a00700 1 --2- 172.21.15.49:0/3952242204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160005000 0x7f616000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:53.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61800c2c80 con 0x7f6160005000 2024-01-22T05:15:53.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616000be80 con 0x7f6160003a70 2024-01-22T05:15:53.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616000c040 con 0x7f6160004690 2024-01-22T05:15:53.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6185e00700 1 --2- 172.21.15.49:0/3952242204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6160003a70 0x7f6160003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:53.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6187200700 1 --2- 172.21.15.49:0/3952242204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160005000 0x7f616000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:53.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6185400700 1 --2- 172.21.15.49:0/3952242204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6160004690 0x7f6160004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:53.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6187200700 1 -- 172.21.15.49:0/3952242204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6160004690 msgr2=0x7f6160004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:53.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6187200700 1 --2- 172.21.15.49:0/3952242204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6160004690 0x7f6160004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:53.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6187200700 1 -- 172.21.15.49:0/3952242204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6160003a70 msgr2=0x7f6160003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:53.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6187200700 1 --2- 172.21.15.49:0/3952242204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6160003a70 0x7f6160003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:53.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6187200700 1 -- 172.21.15.49:0/3952242204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61600033f0 con 0x7f6160005000 2024-01-22T05:15:53.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6187200700 1 -- 172.21.15.49:0/3952242204 reap_dead start 2024-01-22T05:15:53.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6187200700 1 --2- 172.21.15.49:0/3952242204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160005000 0x7f616000b8e0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f61780094d0 tx=0x7f617800b040).ready entity=mon.0 client_cookie=51c1a642ba0fb2d4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:53.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6178017070 con 0x7f6160005000 2024-01-22T05:15:53.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617800f040 con 0x7f6160005000 2024-01-22T05:15:53.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.985+0000 7f6184a00700 1 -- 172.21.15.49:0/3952242204 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6178009b00 con 0x7f6160005000 2024-01-22T05:15:53.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.989+0000 7f6188800700 1 -- 172.21.15.49:0/3952242204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160005000 msgr2=0x7f616000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:53.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.989+0000 7f6188800700 1 --2- 172.21.15.49:0/3952242204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160005000 0x7f616000b8e0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f61780094d0 tx=0x7f617800b040).stop 2024-01-22T05:15:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.989+0000 7f6188800700 1 -- 172.21.15.49:0/3952242204 shutdown_connections 2024-01-22T05:15:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.989+0000 7f6188800700 1 --2- 172.21.15.49:0/3952242204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160005000 0x7f616000b8e0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.989+0000 7f6188800700 1 -- 172.21.15.49:0/3952242204 >> 172.21.15.49:0/3952242204 conn(0x7f61800c87f0 msgr2=0x7f61800c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.989+0000 7f6188800700 1 -- 172.21.15.49:0/3952242204 shutdown_connections 2024-01-22T05:15:53.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.989+0000 7f6188800700 1 -- 172.21.15.49:0/3952242204 wait complete. 2024-01-22T05:15:53.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.989+0000 7f6188800700 1 Processor -- start 2024-01-22T05:15:53.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.993+0000 7f6188800700 1 -- start start 2024-01-22T05:15:53.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.993+0000 7f6188800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160005000 0x7f618013ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:53.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.993+0000 7f6188800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f618016b750 0x7f618016bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:53.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.993+0000 7f6188800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61800a83a0 0x7f61800a8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:53.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.993+0000 7f6188800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61800a9110 con 0x7f6160005000 2024-01-22T05:15:53.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.993+0000 7f6188800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6180169350 con 0x7f61800a83a0 2024-01-22T05:15:53.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.993+0000 7f6188800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61800c0ad0 con 0x7f618016b750 2024-01-22T05:15:53.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.993+0000 7f6185e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160005000 0x7f618013ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:53.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.993+0000 7f6185e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160005000 0x7f618013ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37056/0 (socket says 172.21.15.49:37056) 2024-01-22T05:15:53.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.993+0000 7f6185e00700 1 -- 172.21.15.49:0/1459026761 learned_addr learned my addr 172.21.15.49:0/1459026761 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:53.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.993+0000 7f6185400700 1 --2- 172.21.15.49:0/1459026761 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f618016b750 0x7f618016bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:54.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.993+0000 7f6187200700 1 --2- 172.21.15.49:0/1459026761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61800a83a0 0x7f61800a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:54.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.997+0000 7f6185e00700 1 -- 172.21.15.49:0/1459026761 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f618016b750 msgr2=0x7f618016bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:54.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.997+0000 7f6185e00700 1 --2- 172.21.15.49:0/1459026761 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f618016b750 0x7f618016bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:54.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.997+0000 7f6185e00700 1 -- 172.21.15.49:0/1459026761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61800a83a0 msgr2=0x7f61800a8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:54.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.997+0000 7f6185e00700 1 --2- 172.21.15.49:0/1459026761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61800a83a0 0x7f61800a8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:54.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.997+0000 7f6185e00700 1 -- 172.21.15.49:0/1459026761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618016c0c0 con 0x7f6160005000 2024-01-22T05:15:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.997+0000 7f6185e00700 1 --2- 172.21.15.49:0/1459026761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160005000 0x7f618013ff90 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f61700029d0 tx=0x7f6170007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.997+0000 7f617d600700 1 -- 172.21.15.49:0/1459026761 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000f6c0 con 0x7f6160005000 2024-01-22T05:15:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.997+0000 7f617d600700 1 -- 172.21.15.49:0/1459026761 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617000f820 con 0x7f6160005000 2024-01-22T05:15:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.997+0000 7f6188800700 1 -- 172.21.15.49:0/1459026761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61800bff00 con 0x7f6160005000 2024-01-22T05:15:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.997+0000 7f617d600700 1 -- 172.21.15.49:0/1459026761 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000fbc0 con 0x7f6160005000 2024-01-22T05:15:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.997+0000 7f6188800700 1 -- 172.21.15.49:0/1459026761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61800c01a0 con 0x7f6160005000 2024-01-22T05:15:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:53.997+0000 7f6188800700 1 -- 172.21.15.49:0/1459026761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61800c20c0 con 0x7f6160005000 2024-01-22T05:15:54.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.001+0000 7f617d600700 1 -- 172.21.15.49:0/1459026761 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f617001d3b0 con 0x7f6160005000 2024-01-22T05:15:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.001+0000 7f617d600700 1 --2- 172.21.15.49:0/1459026761 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f615805a510 0x7f615805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.001+0000 7f617d600700 1 -- 172.21.15.49:0/1459026761 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f61700748d0 con 0x7f6160005000 2024-01-22T05:15:54.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.001+0000 7f6185400700 1 --2- 172.21.15.49:0/1459026761 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f615805a510 0x7f615805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:54.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.001+0000 7f6185400700 1 --2- 172.21.15.49:0/1459026761 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f615805a510 0x7f615805c9d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f6168001120 tx=0x7f6168001df0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:54.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.009+0000 7f617d600700 1 -- 172.21.15.49:0/1459026761 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6170047df0 con 0x7f6160005000 2024-01-22T05:15:54.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.225+0000 7f6188800700 1 -- 172.21.15.49:0/1459026761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6180047060 con 0x7f6160005000 2024-01-22T05:15:54.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.229+0000 7f617d600700 1 -- 172.21.15.49:0/1459026761 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1622 (secure 0 0 0) 0x7f617004b410 con 0x7f6160005000 2024-01-22T05:15:54.232 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:54.233 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":697,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":133,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1078,"data_bytes":1076208419,"bytes_used":4676067328,"bytes_avail":768418045952,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":7976858,"read_op_per_sec":0,"write_op_per_sec":181},"fsmap":{"epoch":106,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8292}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-01-22T05:15:49.482989+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:15:54.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.229+0000 7f6188800700 1 -- 172.21.15.49:0/1459026761 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f615805a510 msgr2=0x7f615805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:54.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.229+0000 7f6188800700 1 --2- 172.21.15.49:0/1459026761 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f615805a510 0x7f615805c9d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f6168001120 tx=0x7f6168001df0).stop 2024-01-22T05:15:54.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.229+0000 7f6188800700 1 -- 172.21.15.49:0/1459026761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160005000 msgr2=0x7f618013ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:54.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.229+0000 7f6188800700 1 --2- 172.21.15.49:0/1459026761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160005000 0x7f618013ff90 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f61700029d0 tx=0x7f6170007bb0).stop 2024-01-22T05:15:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.233+0000 7f6188800700 1 -- 172.21.15.49:0/1459026761 shutdown_connections 2024-01-22T05:15:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.233+0000 7f6188800700 1 --2- 172.21.15.49:0/1459026761 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f615805a510 0x7f615805c9d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.233+0000 7f6188800700 1 --2- 172.21.15.49:0/1459026761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61800a83a0 0x7f61800a8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.233+0000 7f6188800700 1 --2- 172.21.15.49:0/1459026761 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f618016b750 0x7f618016bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.233+0000 7f6188800700 1 --2- 172.21.15.49:0/1459026761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160005000 0x7f618013ff90 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.233+0000 7f6188800700 1 -- 172.21.15.49:0/1459026761 >> 172.21.15.49:0/1459026761 conn(0x7f61800c87f0 msgr2=0x7f61800ad6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.233+0000 7f6188800700 1 -- 172.21.15.49:0/1459026761 shutdown_connections 2024-01-22T05:15:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:54.233+0000 7f6188800700 1 -- 172.21.15.49:0/1459026761 wait complete. 2024-01-22T05:15:54.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused'} 2024-01-22T05:15:55.259 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:15:55.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.425+0000 7feb4aa00700 1 Processor -- start 2024-01-22T05:15:55.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.425+0000 7feb4aa00700 1 -- start start 2024-01-22T05:15:55.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.429+0000 7feb4aa00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feb44155d20 0x7feb44065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:55.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.429+0000 7feb4aa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb44066070 0x7feb440a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:55.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.429+0000 7feb4aa00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb440c1a40 con 0x7feb440a8c30 2024-01-22T05:15:55.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.429+0000 7feb4aa00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb440a90c0 con 0x7feb44066070 2024-01-22T05:15:55.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.429+0000 7feb4aa00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb44159310 con 0x7feb44155d20 2024-01-22T05:15:55.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.429+0000 7feb43400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb44066070 0x7feb440a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:55.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.429+0000 7feb43400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb44066070 0x7feb440a8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37072/0 (socket says 172.21.15.49:37072) 2024-01-22T05:15:55.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.429+0000 7feb43400700 1 -- 172.21.15.49:0/2998765705 learned_addr learned my addr 172.21.15.49:0/2998765705 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:55.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.429+0000 7feb43e00700 1 --2- 172.21.15.49:0/2998765705 >> v2:172.21.15.110:3300/0 conn(0x7feb44155d20 0x7feb44065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:55.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.429+0000 7feb43400700 1 -- 172.21.15.49:0/2998765705 >> v2:172.21.15.110:3300/0 conn(0x7feb44155d20 msgr2=0x7feb44065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:55.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.429+0000 7feb43400700 1 --2- 172.21.15.49:0/2998765705 >> v2:172.21.15.110:3300/0 conn(0x7feb44155d20 0x7feb44065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:55.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.429+0000 7feb43400700 1 -- 172.21.15.49:0/2998765705 >> v1:172.21.15.110:6789/0 conn(0x7feb440a8c30 legacy=0x7feb440c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:55.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.429+0000 7feb43400700 1 -- 172.21.15.49:0/2998765705 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb440c13f0 con 0x7feb44066070 2024-01-22T05:15:55.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.429+0000 7feb43400700 1 --2- 172.21.15.49:0/2998765705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb44066070 0x7feb440a8740 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7feb4405ff40 tx=0x7feb2c0090f0).ready entity=mon.0 client_cookie=4c289aae4ae51503 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:55.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.429+0000 7feb42a00700 1 -- 172.21.15.49:0/2998765705 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c00b600 con 0x7feb44066070 2024-01-22T05:15:55.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.433+0000 7feb42a00700 1 -- 172.21.15.49:0/2998765705 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2c00b760 con 0x7feb44066070 2024-01-22T05:15:55.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.433+0000 7feb42a00700 1 -- 172.21.15.49:0/2998765705 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c00bae0 con 0x7feb44066070 2024-01-22T05:15:55.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.433+0000 7feb4aa00700 1 -- 172.21.15.49:0/2998765705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb44066070 msgr2=0x7feb440a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:55.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.433+0000 7feb4aa00700 1 --2- 172.21.15.49:0/2998765705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb44066070 0x7feb440a8740 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7feb4405ff40 tx=0x7feb2c0090f0).stop 2024-01-22T05:15:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.433+0000 7feb4aa00700 1 -- 172.21.15.49:0/2998765705 shutdown_connections 2024-01-22T05:15:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.433+0000 7feb4aa00700 1 --2- 172.21.15.49:0/2998765705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb44066070 0x7feb440a8740 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.433+0000 7feb4aa00700 1 --2- 172.21.15.49:0/2998765705 >> v2:172.21.15.110:3300/0 conn(0x7feb44155d20 0x7feb44065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.433+0000 7feb4aa00700 1 -- 172.21.15.49:0/2998765705 >> 172.21.15.49:0/2998765705 conn(0x7feb440c6540 msgr2=0x7feb440c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.433+0000 7feb4aa00700 1 -- 172.21.15.49:0/2998765705 shutdown_connections 2024-01-22T05:15:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.433+0000 7feb4aa00700 1 -- 172.21.15.49:0/2998765705 wait complete. 2024-01-22T05:15:55.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb4aa00700 1 Processor -- start 2024-01-22T05:15:55.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb4aa00700 1 -- start start 2024-01-22T05:15:55.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb4aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb44066070 0x7feb4415b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:55.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb4aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb440a8c30 0x7feb4416beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:55.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb4aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb44155d20 0x7feb440be390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:55.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb4aa00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb440bf3b0 con 0x7feb44066070 2024-01-22T05:15:55.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb4aa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4416ce10 con 0x7feb440a8c30 2024-01-22T05:15:55.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb4aa00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4416c570 con 0x7feb44155d20 2024-01-22T05:15:55.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb43e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb44066070 0x7feb4415b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:55.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb43e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb44066070 0x7feb4415b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37080/0 (socket says 172.21.15.49:37080) 2024-01-22T05:15:55.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb43e00700 1 -- 172.21.15.49:0/387210699 learned_addr learned my addr 172.21.15.49:0/387210699 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:55.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb43400700 1 --2- 172.21.15.49:0/387210699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb440a8c30 0x7feb4416beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:55.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb48a00700 1 --2- 172.21.15.49:0/387210699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb44155d20 0x7feb440be390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:55.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb43e00700 1 -- 172.21.15.49:0/387210699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb44155d20 msgr2=0x7feb440be390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:55.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb43e00700 1 --2- 172.21.15.49:0/387210699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb44155d20 0x7feb440be390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:55.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb43e00700 1 -- 172.21.15.49:0/387210699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb440a8c30 msgr2=0x7feb4416beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:55.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb43e00700 1 --2- 172.21.15.49:0/387210699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb440a8c30 0x7feb4416beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:55.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb43e00700 1 -- 172.21.15.49:0/387210699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c009370 con 0x7feb44066070 2024-01-22T05:15:55.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.437+0000 7feb48a00700 1 --2- 172.21.15.49:0/387210699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb44155d20 0x7feb440be390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:15:55.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.441+0000 7feb43e00700 1 --2- 172.21.15.49:0/387210699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb44066070 0x7feb4415b120 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7feb3400d860 tx=0x7feb34008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:55.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.441+0000 7feb3b400700 1 -- 172.21.15.49:0/387210699 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb34011590 con 0x7feb44066070 2024-01-22T05:15:55.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.441+0000 7feb3b400700 1 -- 172.21.15.49:0/387210699 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb340116f0 con 0x7feb44066070 2024-01-22T05:15:55.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.441+0000 7feb4aa00700 1 -- 172.21.15.49:0/387210699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4416c850 con 0x7feb44066070 2024-01-22T05:15:55.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.441+0000 7feb3b400700 1 -- 172.21.15.49:0/387210699 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb34011a70 con 0x7feb44066070 2024-01-22T05:15:55.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.441+0000 7feb4aa00700 1 -- 172.21.15.49:0/387210699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb44168a80 con 0x7feb44066070 2024-01-22T05:15:55.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.441+0000 7feb4aa00700 1 -- 172.21.15.49:0/387210699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb441688e0 con 0x7feb44066070 2024-01-22T05:15:55.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.445+0000 7feb3b400700 1 -- 172.21.15.49:0/387210699 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7feb34012420 con 0x7feb44066070 2024-01-22T05:15:55.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.445+0000 7feb3b400700 1 --2- 172.21.15.49:0/387210699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feb1c05a540 0x7feb1c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:55.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.445+0000 7feb3b400700 1 -- 172.21.15.49:0/387210699 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7feb340743d0 con 0x7feb44066070 2024-01-22T05:15:55.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.445+0000 7feb43400700 1 --2- 172.21.15.49:0/387210699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feb1c05a540 0x7feb1c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:55.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.445+0000 7feb43400700 1 --2- 172.21.15.49:0/387210699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feb1c05a540 0x7feb1c05ca00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7feb2c009fd0 tx=0x7feb2c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:55.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.453+0000 7feb3b400700 1 -- 172.21.15.49:0/387210699 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feb441688e0 con 0x7feb44066070 2024-01-22T05:15:55.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.653+0000 7feb4aa00700 1 -- 172.21.15.49:0/387210699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb441688e0 con 0x7feb44066070 2024-01-22T05:15:55.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.653+0000 7feb3b400700 1 -- 172.21.15.49:0/387210699 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4503 (secure 0 0 0) 0x7feb441688e0 con 0x7feb44066070 2024-01-22T05:15:55.657 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:55.657 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:14:58.925818+0000","modified":"2024-01-22T05:15:02.323695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8292":{"gid":8292,"name":"a","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3036262557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3036262557},{"type":"v1","addr":"172.21.15.49:6837","nonce":3036262557}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-22T05:15:55.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.657+0000 7feb4aa00700 1 -- 172.21.15.49:0/387210699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feb1c05a540 msgr2=0x7feb1c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:55.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.657+0000 7feb4aa00700 1 --2- 172.21.15.49:0/387210699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feb1c05a540 0x7feb1c05ca00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7feb2c009fd0 tx=0x7feb2c017000).stop 2024-01-22T05:15:55.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.657+0000 7feb4aa00700 1 -- 172.21.15.49:0/387210699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb44066070 msgr2=0x7feb4415b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:55.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.657+0000 7feb4aa00700 1 --2- 172.21.15.49:0/387210699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb44066070 0x7feb4415b120 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7feb3400d860 tx=0x7feb34008040).stop 2024-01-22T05:15:55.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.657+0000 7feb4aa00700 1 -- 172.21.15.49:0/387210699 shutdown_connections 2024-01-22T05:15:55.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.657+0000 7feb4aa00700 1 --2- 172.21.15.49:0/387210699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feb1c05a540 0x7feb1c05ca00 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:55.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.657+0000 7feb4aa00700 1 --2- 172.21.15.49:0/387210699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb44155d20 0x7feb440be390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:55.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.657+0000 7feb4aa00700 1 --2- 172.21.15.49:0/387210699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb440a8c30 0x7feb4416beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:55.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.657+0000 7feb4aa00700 1 --2- 172.21.15.49:0/387210699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb44066070 0x7feb4415b120 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:55.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.657+0000 7feb4aa00700 1 -- 172.21.15.49:0/387210699 >> 172.21.15.49:0/387210699 conn(0x7feb440c6540 msgr2=0x7feb440c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:55.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.657+0000 7feb4aa00700 1 -- 172.21.15.49:0/387210699 shutdown_connections 2024-01-22T05:15:55.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.657+0000 7feb4aa00700 1 -- 172.21.15.49:0/387210699 wait complete. 2024-01-22T05:15:55.664 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2024-01-22T05:15:55.683 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-01-22T05:15:55.683 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:15:55.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.845+0000 7fb483600700 1 Processor -- start 2024-01-22T05:15:55.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.845+0000 7fb483600700 1 -- start start 2024-01-22T05:15:55.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.849+0000 7fb483600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb47c0a8f90 0x7fb47c065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:55.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.849+0000 7fb483600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47c0c1ee0 con 0x7fb47c0a8b10 2024-01-22T05:15:55.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.849+0000 7fb483600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47c0c12f0 con 0x7fb47c066fb0 2024-01-22T05:15:55.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.849+0000 7fb483600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47c0c15b0 con 0x7fb47c0a8f90 2024-01-22T05:15:55.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.849+0000 7fb47be00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb47c0a8b10 0x7fb47c157740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44618/0 (socket says 172.21.15.49:44618) 2024-01-22T05:15:55.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.849+0000 7fb47be00700 1 -- 172.21.15.49:0/941655334 learned_addr learned my addr 172.21.15.49:0/941655334 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:55.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.849+0000 7fb480c00700 1 --1- 172.21.15.49:0/941655334 >> v1:172.21.15.110:6789/0 conn(0x7fb47c066fb0 0x7fb47c0c2370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:51168/0 (socket says 172.21.15.49:51168) 2024-01-22T05:15:55.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.849+0000 7fb481600700 1 --2- 172.21.15.49:0/941655334 >> v2:172.21.15.110:3300/0 conn(0x7fb47c0a8f90 0x7fb47c065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:55.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.849+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115555792 0 0) 0x7fb47c0c12f0 con 0x7fb47c066fb0 2024-01-22T05:15:55.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb45c0033f0 con 0x7fb47c066fb0 2024-01-22T05:15:55.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261692185 0 0) 0x7fb47c0c1ee0 con 0x7fb47c0a8b10 2024-01-22T05:15:55.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb47c0c12f0 con 0x7fb47c0a8b10 2024-01-22T05:15:55.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4051482152 0 0) 0x7fb45c0033f0 con 0x7fb47c066fb0 2024-01-22T05:15:55.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 >> v2:172.21.15.110:3300/0 conn(0x7fb47c0a8f90 msgr2=0x7fb47c065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:55.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 --2- 172.21.15.49:0/941655334 >> v2:172.21.15.110:3300/0 conn(0x7fb47c0a8f90 0x7fb47c065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:55.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 >> v1:172.21.15.49:6789/0 conn(0x7fb47c0a8b10 legacy=0x7fb47c157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:55.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c0c1890 con 0x7fb47c066fb0 2024-01-22T05:15:55.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fb46c001470 con 0x7fb47c066fb0 2024-01-22T05:15:55.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 >> v1:172.21.15.110:6789/0 conn(0x7fb47c066fb0 legacy=0x7fb47c0c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:55.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 --2- 172.21.15.49:0/941655334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb45c004ad0 0x7fb45c004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:55.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 --2- 172.21.15.49:0/941655334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb45c003630 0x7fb45c003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:55.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 --2- 172.21.15.49:0/941655334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45c003fa0 0x7fb45c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:55.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c0c15b0 con 0x7fb45c003630 2024-01-22T05:15:55.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c00be80 con 0x7fb45c004ad0 2024-01-22T05:15:55.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c00c040 con 0x7fb45c003fa0 2024-01-22T05:15:55.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47be00700 1 --2- 172.21.15.49:0/941655334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb45c003630 0x7fb45c003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:55.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb480c00700 1 --2- 172.21.15.49:0/941655334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb45c004ad0 0x7fb45c004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:55.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb481600700 1 --2- 172.21.15.49:0/941655334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45c003fa0 0x7fb45c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:55.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47be00700 1 -- 172.21.15.49:0/941655334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45c003fa0 msgr2=0x7fb45c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:55.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47be00700 1 --2- 172.21.15.49:0/941655334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45c003fa0 0x7fb45c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:55.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47be00700 1 -- 172.21.15.49:0/941655334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb45c004ad0 msgr2=0x7fb45c004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:55.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47be00700 1 --2- 172.21.15.49:0/941655334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb45c004ad0 0x7fb45c004ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:55.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb481600700 1 -- 172.21.15.49:0/941655334 reap_dead start 2024-01-22T05:15:55.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47be00700 1 -- 172.21.15.49:0/941655334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c0033f0 con 0x7fb45c003630 2024-01-22T05:15:55.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47be00700 1 --2- 172.21.15.49:0/941655334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb45c003630 0x7fb45c003ab0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7fb464007fd0 tx=0x7fb464007ca0).ready entity=mon.0 client_cookie=346ccc6ad4109e4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:55.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464001d60 con 0x7fb45c003630 2024-01-22T05:15:55.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4640070d0 con 0x7fb45c003630 2024-01-22T05:15:55.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.853+0000 7fb47b400700 1 -- 172.21.15.49:0/941655334 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464007470 con 0x7fb45c003630 2024-01-22T05:15:55.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.857+0000 7fb483600700 1 -- 172.21.15.49:0/941655334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb45c003630 msgr2=0x7fb45c003ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:55.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.857+0000 7fb483600700 1 --2- 172.21.15.49:0/941655334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb45c003630 0x7fb45c003ab0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7fb464007fd0 tx=0x7fb464007ca0).stop 2024-01-22T05:15:55.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.857+0000 7fb483600700 1 -- 172.21.15.49:0/941655334 shutdown_connections 2024-01-22T05:15:55.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.857+0000 7fb483600700 1 --2- 172.21.15.49:0/941655334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb45c003630 0x7fb45c003ab0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:55.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.857+0000 7fb483600700 1 -- 172.21.15.49:0/941655334 >> 172.21.15.49:0/941655334 conn(0x7fb47c0c6540 msgr2=0x7fb47c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:55.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.857+0000 7fb483600700 1 -- 172.21.15.49:0/941655334 shutdown_connections 2024-01-22T05:15:55.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.857+0000 7fb483600700 1 -- 172.21.15.49:0/941655334 wait complete. 2024-01-22T05:15:55.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.861+0000 7fb483600700 1 Processor -- start 2024-01-22T05:15:55.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.861+0000 7fb483600700 1 -- start start 2024-01-22T05:15:55.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.861+0000 7fb483600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45c003630 0x7fb47c1693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:55.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.861+0000 7fb483600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb47c156070 0x7fb47c14b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:55.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.861+0000 7fb483600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb47c0bbb00 0x7fb47c0bbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:55.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.861+0000 7fb483600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c1698a0 con 0x7fb47c156070 2024-01-22T05:15:55.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.861+0000 7fb483600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c0bc470 con 0x7fb47c0bbb00 2024-01-22T05:15:55.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.861+0000 7fb483600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c16bf20 con 0x7fb45c003630 2024-01-22T05:15:55.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.861+0000 7fb47be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb47c156070 0x7fb47c14b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:55.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.861+0000 7fb47be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb47c156070 0x7fb47c14b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37092/0 (socket says 172.21.15.49:37092) 2024-01-22T05:15:55.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.861+0000 7fb47be00700 1 -- 172.21.15.49:0/1488227826 learned_addr learned my addr 172.21.15.49:0/1488227826 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:55.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb480c00700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45c003630 0x7fb47c1693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:55.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb481600700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb47c0bbb00 0x7fb47c0bbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:55.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb47be00700 1 -- 172.21.15.49:0/1488227826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45c003630 msgr2=0x7fb47c1693b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:55.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb47be00700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45c003630 0x7fb47c1693b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:55.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb47be00700 1 -- 172.21.15.49:0/1488227826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb47c0bbb00 msgr2=0x7fb47c0bbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:55.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb47be00700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb47c0bbb00 0x7fb47c0bbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:55.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb47be00700 1 -- 172.21.15.49:0/1488227826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c16c200 con 0x7fb47c156070 2024-01-22T05:15:55.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb480c00700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45c003630 0x7fb47c1693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:55.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb481600700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb47c0bbb00 0x7fb47c0bbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:55.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb47be00700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb47c156070 0x7fb47c14b4f0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7fb464001360 tx=0x7fb464015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:55.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb473e00700 1 -- 172.21.15.49:0/1488227826 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400c590 con 0x7fb47c156070 2024-01-22T05:15:55.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb473e00700 1 -- 172.21.15.49:0/1488227826 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46400c6f0 con 0x7fb47c156070 2024-01-22T05:15:55.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb483600700 1 -- 172.21.15.49:0/1488227826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47c16c4e0 con 0x7fb47c156070 2024-01-22T05:15:55.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb473e00700 1 -- 172.21.15.49:0/1488227826 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400cab0 con 0x7fb47c156070 2024-01-22T05:15:55.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb483600700 1 -- 172.21.15.49:0/1488227826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47c16caa0 con 0x7fb47c156070 2024-01-22T05:15:55.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.865+0000 7fb483600700 1 -- 172.21.15.49:0/1488227826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47c047060 con 0x7fb47c156070 2024-01-22T05:15:55.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.869+0000 7fb473e00700 1 -- 172.21.15.49:0/1488227826 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb464020480 con 0x7fb47c156070 2024-01-22T05:15:55.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.869+0000 7fb473e00700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb45405a510 0x7fb45405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:55.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.869+0000 7fb473e00700 1 -- 172.21.15.49:0/1488227826 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb4640759b0 con 0x7fb47c156070 2024-01-22T05:15:55.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.869+0000 7fb480c00700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb45405a510 0x7fb45405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:55.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.873+0000 7fb480c00700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb45405a510 0x7fb45405c9d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fb47c0478e0 tx=0x7fb46c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:55.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:55.877+0000 7fb473e00700 1 -- 172.21.15.49:0/1488227826 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb464048f80 con 0x7fb47c156070 2024-01-22T05:15:56.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:56.089+0000 7fb483600700 1 -- 172.21.15.49:0/1488227826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb47c0c1b70 con 0x7fb47c156070 2024-01-22T05:15:56.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:56.093+0000 7fb473e00700 1 -- 172.21.15.49:0/1488227826 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1210 (secure 0 0 0) 0x7fb46404c5a0 con 0x7fb47c156070 2024-01-22T05:15:56.095 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:56.095 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":699,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":133,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1078,"data_bytes":1076208419,"bytes_used":4676067328,"bytes_avail":768418045952,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":88626,"read_op_per_sec":0,"write_op_per_sec":173},"fsmap":{"epoch":106,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8292}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-01-22T05:15:55.484931+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:15:56.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:56.093+0000 7fb483600700 1 -- 172.21.15.49:0/1488227826 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb45405a510 msgr2=0x7fb45405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:56.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:56.093+0000 7fb483600700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb45405a510 0x7fb45405c9d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fb47c0478e0 tx=0x7fb46c009040).stop 2024-01-22T05:15:56.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:56.093+0000 7fb483600700 1 -- 172.21.15.49:0/1488227826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb47c156070 msgr2=0x7fb47c14b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:56.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:56.093+0000 7fb483600700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb47c156070 0x7fb47c14b4f0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7fb464001360 tx=0x7fb464015000).stop 2024-01-22T05:15:56.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:56.093+0000 7fb483600700 1 -- 172.21.15.49:0/1488227826 shutdown_connections 2024-01-22T05:15:56.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:56.093+0000 7fb483600700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb45405a510 0x7fb45405c9d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:56.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:56.093+0000 7fb483600700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb47c0bbb00 0x7fb47c0bbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:56.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:56.093+0000 7fb483600700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb47c156070 0x7fb47c14b4f0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:56.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:56.093+0000 7fb483600700 1 --2- 172.21.15.49:0/1488227826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45c003630 0x7fb47c1693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:56.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:56.093+0000 7fb483600700 1 -- 172.21.15.49:0/1488227826 >> 172.21.15.49:0/1488227826 conn(0x7fb47c0c6540 msgr2=0x7fb47c0ab5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:56.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:56.097+0000 7fb483600700 1 -- 172.21.15.49:0/1488227826 shutdown_connections 2024-01-22T05:15:56.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:56.097+0000 7fb483600700 1 -- 172.21.15.49:0/1488227826 wait complete. 2024-01-22T05:15:56.124 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-01-22T05:15:56.124 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:15:56.124 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:15:56.164 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:15:56.208 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:15:56.208 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T05:15:56.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:15:56.209 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-22T05:15:56.869 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:15:56.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:15:56.869 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:15:56.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:15:57.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.085+0000 7f980d400700 1 Processor -- start 2024-01-22T05:15:57.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.085+0000 7f980d400700 1 -- start start 2024-01-22T05:15:57.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.085+0000 7f980d400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f98080631b0 0x7f98080bd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:57.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.085+0000 7f980d400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98080c41d0 con 0x7f98080c4660 2024-01-22T05:15:57.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.085+0000 7f980d400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98080c35c0 con 0x7f98080c4a40 2024-01-22T05:15:57.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.085+0000 7f980d400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98080c38a0 con 0x7f98080631b0 2024-01-22T05:15:57.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.089+0000 7f9807200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f98080631b0 0x7f98080bd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:57.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.089+0000 7f9806800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f98080c4660 0x7f9808068c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44632/0 (socket says 172.21.15.49:44632) 2024-01-22T05:15:57.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.089+0000 7f9806800700 1 -- 172.21.15.49:0/2060236881 learned_addr learned my addr 172.21.15.49:0/2060236881 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:57.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.089+0000 7f9807200700 1 -- 172.21.15.49:0/2060236881 >> v1:172.21.15.110:6789/0 conn(0x7f98080c4a40 legacy=0x7f9808062aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.089+0000 7f9807200700 1 -- 172.21.15.49:0/2060236881 >> v1:172.21.15.49:6789/0 conn(0x7f98080c4660 legacy=0x7f9808068c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.089+0000 7f9807200700 1 -- 172.21.15.49:0/2060236881 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98080c3b80 con 0x7f98080631b0 2024-01-22T05:15:57.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.089+0000 7f9805400700 1 -- 172.21.15.49:0/2060236881 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034894112 0 0) 0x7f98080c35c0 con 0x7f98080c4a40 2024-01-22T05:15:57.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.089+0000 7f9807200700 1 --2- 172.21.15.49:0/2060236881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98080631b0 0x7f98080bd8a0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f9800009e60 tx=0x7f9800009780).ready entity=mon.0 client_cookie=54fea9fce29af7ea server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:57.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.089+0000 7f9805400700 1 -- 172.21.15.49:0/2060236881 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980000e070 con 0x7f98080631b0 2024-01-22T05:15:57.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.089+0000 7f9805400700 1 -- 172.21.15.49:0/2060236881 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980000bc30 con 0x7f98080631b0 2024-01-22T05:15:57.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.089+0000 7f9805400700 1 -- 172.21.15.49:0/2060236881 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800012410 con 0x7f98080631b0 2024-01-22T05:15:57.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.089+0000 7f980d400700 1 -- 172.21.15.49:0/2060236881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98080631b0 msgr2=0x7f98080bd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.089+0000 7f980d400700 1 --2- 172.21.15.49:0/2060236881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98080631b0 0x7f98080bd8a0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f9800009e60 tx=0x7f9800009780).stop 2024-01-22T05:15:57.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.093+0000 7f980d400700 1 -- 172.21.15.49:0/2060236881 shutdown_connections 2024-01-22T05:15:57.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.093+0000 7f980d400700 1 --2- 172.21.15.49:0/2060236881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98080631b0 0x7f98080bd8a0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.093+0000 7f980d400700 1 -- 172.21.15.49:0/2060236881 >> 172.21.15.49:0/2060236881 conn(0x7f98080c51c0 msgr2=0x7f98080c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:57.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.093+0000 7f980d400700 1 -- 172.21.15.49:0/2060236881 shutdown_connections 2024-01-22T05:15:57.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.093+0000 7f980d400700 1 -- 172.21.15.49:0/2060236881 wait complete. 2024-01-22T05:15:57.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.093+0000 7f980d400700 1 Processor -- start 2024-01-22T05:15:57.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f980d400700 1 -- start start 2024-01-22T05:15:57.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f980d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98080631b0 0x7f98080c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:57.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f980d400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98080c4660 0x7f980816c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:57.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f980d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98080c4a40 0x7f98080a8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:57.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f980d400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98081697d0 con 0x7f98080c4a40 2024-01-22T05:15:57.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f980d400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9808169340 con 0x7f98080631b0 2024-01-22T05:15:57.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f980d400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98080a8630 con 0x7f98080c4660 2024-01-22T05:15:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f9807200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98080c4a40 0x7f98080a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f9807200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98080c4a40 0x7f98080a8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37108/0 (socket says 172.21.15.49:37108) 2024-01-22T05:15:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f9807200700 1 -- 172.21.15.49:0/1621102531 learned_addr learned my addr 172.21.15.49:0/1621102531 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f9806800700 1 --2- 172.21.15.49:0/1621102531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98080631b0 0x7f98080c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f9805e00700 1 --2- 172.21.15.49:0/1621102531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98080c4660 0x7f980816c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f9807200700 1 -- 172.21.15.49:0/1621102531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98080c4660 msgr2=0x7f980816c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f9807200700 1 --2- 172.21.15.49:0/1621102531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98080c4660 0x7f980816c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f9807200700 1 -- 172.21.15.49:0/1621102531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98080631b0 msgr2=0x7f98080c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f9807200700 1 --2- 172.21.15.49:0/1621102531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98080631b0 0x7f98080c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f9807200700 1 -- 172.21.15.49:0/1621102531 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9800009a20 con 0x7f98080c4a40 2024-01-22T05:15:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.097+0000 7f9805e00700 1 --2- 172.21.15.49:0/1621102531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98080c4660 0x7f980816c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.101+0000 7f9807200700 1 --2- 172.21.15.49:0/1621102531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98080c4a40 0x7f98080a8140 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f9808066c40 tx=0x7f9800009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:57.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.101+0000 7f97fe000700 1 -- 172.21.15.49:0/1621102531 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98000064a0 con 0x7f98080c4a40 2024-01-22T05:15:57.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.101+0000 7f97fe000700 1 -- 172.21.15.49:0/1621102531 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800006600 con 0x7f98080c4a40 2024-01-22T05:15:57.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.101+0000 7f97fe000700 1 -- 172.21.15.49:0/1621102531 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98000069a0 con 0x7f98080c4a40 2024-01-22T05:15:57.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.101+0000 7f980d400700 1 -- 172.21.15.49:0/1621102531 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98081687a0 con 0x7f98080c4a40 2024-01-22T05:15:57.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.101+0000 7f980d400700 1 -- 172.21.15.49:0/1621102531 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9808168cf0 con 0x7f98080c4a40 2024-01-22T05:15:57.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.101+0000 7f980d400700 1 -- 172.21.15.49:0/1621102531 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98081694f0 con 0x7f98080c4a40 2024-01-22T05:15:57.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.105+0000 7f97fe000700 1 -- 172.21.15.49:0/1621102531 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f980001d630 con 0x7f98080c4a40 2024-01-22T05:15:57.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.105+0000 7f97fe000700 1 --2- 172.21.15.49:0/1621102531 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f97e005a510 0x7f97e005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:57.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.105+0000 7f97fe000700 1 -- 172.21.15.49:0/1621102531 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9800076f00 con 0x7f98080c4a40 2024-01-22T05:15:57.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.105+0000 7f9806800700 1 --2- 172.21.15.49:0/1621102531 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f97e005a510 0x7f97e005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:57.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.105+0000 7f9806800700 1 --2- 172.21.15.49:0/1621102531 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f97e005a510 0x7f97e005c9d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f97f8007fd0 tx=0x7f97f8007d30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:57.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.109+0000 7f97fe000700 1 -- 172.21.15.49:0/1621102531 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f98081694f0 con 0x7f98080c4a40 2024-01-22T05:15:57.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.305+0000 7f980d400700 1 -- 172.21.15.49:0/1621102531 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98081694b0 con 0x7f98080c4a40 2024-01-22T05:15:57.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.305+0000 7f97fe000700 1 -- 172.21.15.49:0/1621102531 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4503 (secure 0 0 0) 0x7f980004a480 con 0x7f98080c4a40 2024-01-22T05:15:57.307 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:57.307 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:14:58.925818+0000","modified":"2024-01-22T05:15:02.323695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8292":{"gid":8292,"name":"a","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3036262557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3036262557},{"type":"v1","addr":"172.21.15.49:6837","nonce":3036262557}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-22T05:15:57.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.309+0000 7f980d400700 1 -- 172.21.15.49:0/1621102531 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f97e005a510 msgr2=0x7f97e005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.309+0000 7f980d400700 1 --2- 172.21.15.49:0/1621102531 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f97e005a510 0x7f97e005c9d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f97f8007fd0 tx=0x7f97f8007d30).stop 2024-01-22T05:15:57.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.309+0000 7f980d400700 1 -- 172.21.15.49:0/1621102531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98080c4a40 msgr2=0x7f98080a8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.309+0000 7f980d400700 1 --2- 172.21.15.49:0/1621102531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98080c4a40 0x7f98080a8140 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f9808066c40 tx=0x7f9800009780).stop 2024-01-22T05:15:57.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.309+0000 7f980d400700 1 -- 172.21.15.49:0/1621102531 shutdown_connections 2024-01-22T05:15:57.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.309+0000 7f980d400700 1 --2- 172.21.15.49:0/1621102531 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f97e005a510 0x7f97e005c9d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.309+0000 7f980d400700 1 --2- 172.21.15.49:0/1621102531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98080c4a40 0x7f98080a8140 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.309+0000 7f980d400700 1 --2- 172.21.15.49:0/1621102531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98080c4660 0x7f980816c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.309+0000 7f980d400700 1 --2- 172.21.15.49:0/1621102531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98080631b0 0x7f98080c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.309+0000 7f980d400700 1 -- 172.21.15.49:0/1621102531 >> 172.21.15.49:0/1621102531 conn(0x7f98080c51c0 msgr2=0x7f98080641d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:57.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.313+0000 7f980d400700 1 -- 172.21.15.49:0/1621102531 shutdown_connections 2024-01-22T05:15:57.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.313+0000 7f980d400700 1 -- 172.21.15.49:0/1621102531 wait complete. 2024-01-22T05:15:57.314 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2024-01-22T05:15:57.332 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:15:57.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.505+0000 7fcc66000700 1 Processor -- start 2024-01-22T05:15:57.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.505+0000 7fcc66000700 1 -- start start 2024-01-22T05:15:57.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.505+0000 7fcc66000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc600c25e0 0x7fcc600a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:57.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.505+0000 7fcc66000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc600c1a40 con 0x7fcc600a8740 2024-01-22T05:15:57.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.505+0000 7fcc66000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc600a90b0 con 0x7fcc60155d20 2024-01-22T05:15:57.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.505+0000 7fcc66000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc60159310 con 0x7fcc600c25e0 2024-01-22T05:15:57.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.509+0000 7fcc5fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc600c25e0 0x7fcc600a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:57.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.509+0000 7fcc5ea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcc600a8740 0x7fcc600c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44646/0 (socket says 172.21.15.49:44646) 2024-01-22T05:15:57.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.509+0000 7fcc5ea00700 1 -- 172.21.15.49:0/9636491 learned_addr learned my addr 172.21.15.49:0/9636491 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:57.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.509+0000 7fcc5f400700 1 --1- 172.21.15.49:0/9636491 >> v1:172.21.15.110:6789/0 conn(0x7fcc60155d20 0x7fcc60065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:51188/0 (socket says 172.21.15.49:51188) 2024-01-22T05:15:57.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.509+0000 7fcc5fe00700 1 -- 172.21.15.49:0/9636491 >> v1:172.21.15.110:6789/0 conn(0x7fcc60155d20 legacy=0x7fcc60065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.509+0000 7fcc5fe00700 1 -- 172.21.15.49:0/9636491 >> v1:172.21.15.49:6789/0 conn(0x7fcc600a8740 legacy=0x7fcc600c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.509+0000 7fcc5fe00700 1 -- 172.21.15.49:0/9636491 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc600c13f0 con 0x7fcc600c25e0 2024-01-22T05:15:57.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.509+0000 7fcc5fe00700 1 --2- 172.21.15.49:0/9636491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc600c25e0 0x7fcc600a8bc0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7fcc58009e60 tx=0x7fcc58009780).ready entity=mon.0 client_cookie=db3dc020f92dddea server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:57.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.509+0000 7fcc5e000700 1 -- 172.21.15.49:0/9636491 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5800e070 con 0x7fcc600c25e0 2024-01-22T05:15:57.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.509+0000 7fcc5e000700 1 -- 172.21.15.49:0/9636491 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5800bc30 con 0x7fcc600c25e0 2024-01-22T05:15:57.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.509+0000 7fcc5e000700 1 -- 172.21.15.49:0/9636491 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58012410 con 0x7fcc600c25e0 2024-01-22T05:15:57.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.509+0000 7fcc66000700 1 -- 172.21.15.49:0/9636491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc600c25e0 msgr2=0x7fcc600a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.509+0000 7fcc66000700 1 --2- 172.21.15.49:0/9636491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc600c25e0 0x7fcc600a8bc0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7fcc58009e60 tx=0x7fcc58009780).stop 2024-01-22T05:15:57.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.513+0000 7fcc66000700 1 -- 172.21.15.49:0/9636491 shutdown_connections 2024-01-22T05:15:57.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.513+0000 7fcc66000700 1 --2- 172.21.15.49:0/9636491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc600c25e0 0x7fcc600a8bc0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.513+0000 7fcc66000700 1 -- 172.21.15.49:0/9636491 >> 172.21.15.49:0/9636491 conn(0x7fcc600c6540 msgr2=0x7fcc600c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:57.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.513+0000 7fcc66000700 1 -- 172.21.15.49:0/9636491 shutdown_connections 2024-01-22T05:15:57.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.513+0000 7fcc66000700 1 -- 172.21.15.49:0/9636491 wait complete. 2024-01-22T05:15:57.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.513+0000 7fcc66000700 1 Processor -- start 2024-01-22T05:15:57.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.513+0000 7fcc66000700 1 -- start start 2024-01-22T05:15:57.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc66000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc600a8740 0x7fcc600bf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:57.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc66000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc600c25e0 0x7fcc6016c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:57.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc66000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc60155d20 0x7fcc60168060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:57.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc66000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6016ce80 con 0x7fcc600a8740 2024-01-22T05:15:57.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc66000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc600bfb70 con 0x7fcc60155d20 2024-01-22T05:15:57.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc66000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc600bfe50 con 0x7fcc600c25e0 2024-01-22T05:15:57.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc5f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc600a8740 0x7fcc600bf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:57.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc5f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc600a8740 0x7fcc600bf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37130/0 (socket says 172.21.15.49:37130) 2024-01-22T05:15:57.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc5f400700 1 -- 172.21.15.49:0/710454843 learned_addr learned my addr 172.21.15.49:0/710454843 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:57.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc5fe00700 1 --2- 172.21.15.49:0/710454843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc60155d20 0x7fcc60168060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:57.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc5ea00700 1 --2- 172.21.15.49:0/710454843 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc600c25e0 0x7fcc6016c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:57.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc5f400700 1 -- 172.21.15.49:0/710454843 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc600c25e0 msgr2=0x7fcc6016c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc5f400700 1 --2- 172.21.15.49:0/710454843 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc600c25e0 0x7fcc6016c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc5f400700 1 -- 172.21.15.49:0/710454843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc60155d20 msgr2=0x7fcc60168060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc5f400700 1 --2- 172.21.15.49:0/710454843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc60155d20 0x7fcc60168060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc5f400700 1 -- 172.21.15.49:0/710454843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc58009a20 con 0x7fcc600a8740 2024-01-22T05:15:57.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc5f400700 1 --2- 172.21.15.49:0/710454843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc600a8740 0x7fcc600bf520 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7fcc50001eb0 tx=0x7fcc50007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:57.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc56a00700 1 -- 172.21.15.49:0/710454843 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc500070d0 con 0x7fcc600a8740 2024-01-22T05:15:57.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc56a00700 1 -- 172.21.15.49:0/710454843 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc50007230 con 0x7fcc600a8740 2024-01-22T05:15:57.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc66000700 1 -- 172.21.15.49:0/710454843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc600c0130 con 0x7fcc600a8740 2024-01-22T05:15:57.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.517+0000 7fcc56a00700 1 -- 172.21.15.49:0/710454843 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc500075b0 con 0x7fcc600a8740 2024-01-22T05:15:57.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.521+0000 7fcc66000700 1 -- 172.21.15.49:0/710454843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc600c06f0 con 0x7fcc600a8740 2024-01-22T05:15:57.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.521+0000 7fcc66000700 1 -- 172.21.15.49:0/710454843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc600a9c80 con 0x7fcc600a8740 2024-01-22T05:15:57.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.521+0000 7fcc56a00700 1 -- 172.21.15.49:0/710454843 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcc500058f0 con 0x7fcc600a8740 2024-01-22T05:15:57.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.521+0000 7fcc56a00700 1 --2- 172.21.15.49:0/710454843 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc3805a510 0x7fcc3805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:57.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.521+0000 7fcc56a00700 1 -- 172.21.15.49:0/710454843 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcc50073f00 con 0x7fcc600a8740 2024-01-22T05:15:57.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.521+0000 7fcc5ea00700 1 --2- 172.21.15.49:0/710454843 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc3805a510 0x7fcc3805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:57.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.525+0000 7fcc5ea00700 1 --2- 172.21.15.49:0/710454843 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc3805a510 0x7fcc3805c9d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fcc600672b0 tx=0x7fcc48007d30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:57.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.529+0000 7fcc56a00700 1 -- 172.21.15.49:0/710454843 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcc50047540 con 0x7fcc600a8740 2024-01-22T05:15:57.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.745+0000 7fcc66000700 1 -- 172.21.15.49:0/710454843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc60047060 con 0x7fcc600a8740 2024-01-22T05:15:57.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.745+0000 7fcc56a00700 1 -- 172.21.15.49:0/710454843 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+17274 (secure 0 0 0) 0x7fcc5004ab60 con 0x7fcc600a8740 2024-01-22T05:15:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:57.746 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":133,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:15:28.343446+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:14:57.007984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-01-22T05:14:57.955380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.3","mappings":[{"from":2,"to":0}]},{"pgid":"19.a","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:15:57.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.749+0000 7fcc66000700 1 -- 172.21.15.49:0/710454843 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc3805a510 msgr2=0x7fcc3805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.749+0000 7fcc66000700 1 --2- 172.21.15.49:0/710454843 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc3805a510 0x7fcc3805c9d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fcc600672b0 tx=0x7fcc48007d30).stop 2024-01-22T05:15:57.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.749+0000 7fcc66000700 1 -- 172.21.15.49:0/710454843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc600a8740 msgr2=0x7fcc600bf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.749+0000 7fcc66000700 1 --2- 172.21.15.49:0/710454843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc600a8740 0x7fcc600bf520 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7fcc50001eb0 tx=0x7fcc50007df0).stop 2024-01-22T05:15:57.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.749+0000 7fcc66000700 1 -- 172.21.15.49:0/710454843 shutdown_connections 2024-01-22T05:15:57.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.749+0000 7fcc66000700 1 --2- 172.21.15.49:0/710454843 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc3805a510 0x7fcc3805c9d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.749+0000 7fcc66000700 1 --2- 172.21.15.49:0/710454843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc60155d20 0x7fcc60168060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.749+0000 7fcc66000700 1 --2- 172.21.15.49:0/710454843 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc600c25e0 0x7fcc6016c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.749+0000 7fcc66000700 1 --2- 172.21.15.49:0/710454843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc600a8740 0x7fcc600bf520 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.749+0000 7fcc66000700 1 -- 172.21.15.49:0/710454843 >> 172.21.15.49:0/710454843 conn(0x7fcc600c6540 msgr2=0x7fcc601583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:57.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.749+0000 7fcc66000700 1 -- 172.21.15.49:0/710454843 shutdown_connections 2024-01-22T05:15:57.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.749+0000 7fcc66000700 1 -- 172.21.15.49:0/710454843 wait complete. 2024-01-22T05:15:57.773 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:14:57.007984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:14:57.955380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:15:57.773 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:15:57.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.941+0000 7febfe200700 1 Processor -- start 2024-01-22T05:15:57.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.941+0000 7febfe200700 1 -- start start 2024-01-22T05:15:57.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.945+0000 7febfe200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7febf80c6330 0x7febf80a7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:57.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.945+0000 7febfe200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf80c42f0 con 0x7febf815c140 2024-01-22T05:15:57.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.945+0000 7febfe200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf80c3460 con 0x7febf80a7e50 2024-01-22T05:15:57.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.945+0000 7febfe200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf80c36e0 con 0x7febf80c6330 2024-01-22T05:15:57.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.945+0000 7febf6a00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7febf80a7e50 0x7febf815ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:51204/0 (socket says 172.21.15.49:51204) 2024-01-22T05:15:57.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.945+0000 7febf6a00700 1 -- 172.21.15.49:0/933024969 learned_addr learned my addr 172.21.15.49:0/933024969 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:57.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.945+0000 7febf7400700 1 --2- 172.21.15.49:0/933024969 >> v2:172.21.15.110:3300/0 conn(0x7febf80c6330 0x7febf80a7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:57.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.945+0000 7febf6000700 1 -- 172.21.15.49:0/933024969 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174213784 0 0) 0x7febf80c3460 con 0x7febf80a7e50 2024-01-22T05:15:57.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.945+0000 7febf6000700 1 -- 172.21.15.49:0/933024969 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febd80033f0 con 0x7febf80a7e50 2024-01-22T05:15:57.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.945+0000 7febf7400700 1 -- 172.21.15.49:0/933024969 >> v1:172.21.15.110:6789/0 conn(0x7febf80a7e50 legacy=0x7febf815ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.945+0000 7febf7400700 1 -- 172.21.15.49:0/933024969 >> v1:172.21.15.49:6789/0 conn(0x7febf815c140 legacy=0x7febf8155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.945+0000 7febf6000700 1 -- 172.21.15.49:0/933024969 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499510276 0 0) 0x7febf80c42f0 con 0x7febf815c140 2024-01-22T05:15:57.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.945+0000 7febf7400700 1 -- 172.21.15.49:0/933024969 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf80c39c0 con 0x7febf80c6330 2024-01-22T05:15:57.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.945+0000 7febf7400700 1 --2- 172.21.15.49:0/933024969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf80c6330 0x7febf80a7960 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7febe8009760 tx=0x7febe8009060).ready entity=mon.1 client_cookie=fbc033209fbc7ee9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:57.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.949+0000 7febf6000700 1 -- 172.21.15.49:0/933024969 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe800f510 con 0x7febf80c6330 2024-01-22T05:15:57.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.949+0000 7febf6000700 1 -- 172.21.15.49:0/933024969 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe800f670 con 0x7febf80c6330 2024-01-22T05:15:57.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.949+0000 7febf6000700 1 -- 172.21.15.49:0/933024969 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe800f9f0 con 0x7febf80c6330 2024-01-22T05:15:57.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.949+0000 7febfe200700 1 -- 172.21.15.49:0/933024969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf80c6330 msgr2=0x7febf80a7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.949+0000 7febfe200700 1 --2- 172.21.15.49:0/933024969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf80c6330 0x7febf80a7960 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7febe8009760 tx=0x7febe8009060).stop 2024-01-22T05:15:57.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.949+0000 7febfe200700 1 -- 172.21.15.49:0/933024969 shutdown_connections 2024-01-22T05:15:57.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.949+0000 7febfe200700 1 --2- 172.21.15.49:0/933024969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf80c6330 0x7febf80a7960 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.949+0000 7febfe200700 1 -- 172.21.15.49:0/933024969 >> 172.21.15.49:0/933024969 conn(0x7febf8064f10 msgr2=0x7febf80c8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:57.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.949+0000 7febfe200700 1 -- 172.21.15.49:0/933024969 shutdown_connections 2024-01-22T05:15:57.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.949+0000 7febfe200700 1 -- 172.21.15.49:0/933024969 wait complete. 2024-01-22T05:15:57.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.953+0000 7febfe200700 1 Processor -- start 2024-01-22T05:15:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.953+0000 7febfe200700 1 -- start start 2024-01-22T05:15:57.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febfe200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febf80c6330 0x7febf80add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:57.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febfe200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf815c140 0x7febf80ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:57.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febfe200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febf80bf800 0x7febf80aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:57.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febfe200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf81545c0 con 0x7febf80c6330 2024-01-22T05:15:57.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febfe200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf80a9d20 con 0x7febf815c140 2024-01-22T05:15:57.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febfe200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf80a93f0 con 0x7febf80bf800 2024-01-22T05:15:57.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febf7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febf80c6330 0x7febf80add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:57.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febf7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febf80c6330 0x7febf80add20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37140/0 (socket says 172.21.15.49:37140) 2024-01-22T05:15:57.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febf7400700 1 -- 172.21.15.49:0/2255802570 learned_addr learned my addr 172.21.15.49:0/2255802570 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:57.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febf6a00700 1 --2- 172.21.15.49:0/2255802570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf815c140 0x7febf80ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:57.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febf7e00700 1 --2- 172.21.15.49:0/2255802570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febf80bf800 0x7febf80aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:57.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febf7400700 1 -- 172.21.15.49:0/2255802570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febf80bf800 msgr2=0x7febf80aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febf7400700 1 --2- 172.21.15.49:0/2255802570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febf80bf800 0x7febf80aa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febf7400700 1 -- 172.21.15.49:0/2255802570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf815c140 msgr2=0x7febf80ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:57.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febf7400700 1 --2- 172.21.15.49:0/2255802570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf815c140 0x7febf80ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:57.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febf7400700 1 -- 172.21.15.49:0/2255802570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe80092a0 con 0x7febf80c6330 2024-01-22T05:15:57.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febf7e00700 1 --2- 172.21.15.49:0/2255802570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febf80bf800 0x7febf80aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:57.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febf7400700 1 --2- 172.21.15.49:0/2255802570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febf80c6330 0x7febf80add20 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7febe8009e00 tx=0x7febe8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:57.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febeea00700 1 -- 172.21.15.49:0/2255802570 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe800f7e0 con 0x7febf80c6330 2024-01-22T05:15:57.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febeea00700 1 -- 172.21.15.49:0/2255802570 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe800f940 con 0x7febf80c6330 2024-01-22T05:15:57.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febfe200700 1 -- 172.21.15.49:0/2255802570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf80a96d0 con 0x7febf80c6330 2024-01-22T05:15:57.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febeea00700 1 -- 172.21.15.49:0/2255802570 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe801b660 con 0x7febf80c6330 2024-01-22T05:15:57.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.957+0000 7febfe200700 1 -- 172.21.15.49:0/2255802570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf8156780 con 0x7febf80c6330 2024-01-22T05:15:57.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.961+0000 7febfe200700 1 -- 172.21.15.49:0/2255802570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf8156970 con 0x7febf80c6330 2024-01-22T05:15:57.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.961+0000 7febeea00700 1 -- 172.21.15.49:0/2255802570 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7febe801b9d0 con 0x7febf80c6330 2024-01-22T05:15:57.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.961+0000 7febeea00700 1 --2- 172.21.15.49:0/2255802570 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7febd005a510 0x7febd005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:57.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.961+0000 7febeea00700 1 -- 172.21.15.49:0/2255802570 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7febe8076310 con 0x7febf80c6330 2024-01-22T05:15:57.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.961+0000 7febf6a00700 1 --2- 172.21.15.49:0/2255802570 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7febd005a510 0x7febd005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:57.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.965+0000 7febf6a00700 1 --2- 172.21.15.49:0/2255802570 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7febd005a510 0x7febd005c9d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7febf80a7760 tx=0x7febe0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:57.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:57.969+0000 7febeea00700 1 -- 172.21.15.49:0/2255802570 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7febe8049890 con 0x7febf80c6330 2024-01-22T05:15:58.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.133+0000 7febfe200700 1 -- 172.21.15.49:0/2255802570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7febf80c3ca0 con 0x7febf80c6330 2024-01-22T05:15:58.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.137+0000 7febeea00700 1 -- 172.21.15.49:0/2255802570 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v133) v1 ==== 110+0+10 (secure 0 0 0) 0x7febe80290b0 con 0x7febf80c6330 2024-01-22T05:15:58.135 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:15:58.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.137+0000 7febfe200700 1 -- 172.21.15.49:0/2255802570 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7febd005a510 msgr2=0x7febd005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:58.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.137+0000 7febfe200700 1 --2- 172.21.15.49:0/2255802570 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7febd005a510 0x7febd005c9d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7febf80a7760 tx=0x7febe0009040).stop 2024-01-22T05:15:58.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.137+0000 7febfe200700 1 -- 172.21.15.49:0/2255802570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febf80c6330 msgr2=0x7febf80add20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:58.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.137+0000 7febfe200700 1 --2- 172.21.15.49:0/2255802570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febf80c6330 0x7febf80add20 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7febe8009e00 tx=0x7febe8017000).stop 2024-01-22T05:15:58.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.137+0000 7febfe200700 1 -- 172.21.15.49:0/2255802570 shutdown_connections 2024-01-22T05:15:58.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.137+0000 7febfe200700 1 --2- 172.21.15.49:0/2255802570 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7febd005a510 0x7febd005c9d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.137+0000 7febfe200700 1 --2- 172.21.15.49:0/2255802570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febf80bf800 0x7febf80aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.137+0000 7febfe200700 1 --2- 172.21.15.49:0/2255802570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf815c140 0x7febf80ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.137+0000 7febfe200700 1 --2- 172.21.15.49:0/2255802570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febf80c6330 0x7febf80add20 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.137+0000 7febfe200700 1 -- 172.21.15.49:0/2255802570 >> 172.21.15.49:0/2255802570 conn(0x7febf8064f10 msgr2=0x7febf80c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:58.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.141+0000 7febfe200700 1 -- 172.21.15.49:0/2255802570 shutdown_connections 2024-01-22T05:15:58.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.141+0000 7febfe200700 1 -- 172.21.15.49:0/2255802570 wait complete. 2024-01-22T05:15:58.163 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:15:58.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.337+0000 7fd43ae00700 1 Processor -- start 2024-01-22T05:15:58.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.337+0000 7fd43ae00700 1 -- start start 2024-01-22T05:15:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd43ae00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd4340c1ce0 0x7fd4340bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd43ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4340bc9c0 0x7fd434068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd43ae00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd434158650 con 0x7fd4340a8c20 2024-01-22T05:15:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd43ae00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4340bd170 con 0x7fd4340c1ce0 2024-01-22T05:15:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd43ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd434067c30 con 0x7fd4340bc9c0 2024-01-22T05:15:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd433e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd4340a8c20 0x7fd4340c15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44674/0 (socket says 172.21.15.49:44674) 2024-01-22T05:15:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd433e00700 1 -- 172.21.15.49:0/2920194196 learned_addr learned my addr 172.21.15.49:0/2920194196 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:58.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd433400700 1 --2- 172.21.15.49:0/2920194196 >> v2:172.21.15.110:3300/0 conn(0x7fd4340c1ce0 0x7fd4340bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:58.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd438e00700 1 --2- 172.21.15.49:0/2920194196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4340bc9c0 0x7fd434068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:58.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd432a00700 1 -- 172.21.15.49:0/2920194196 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495301133 0 0) 0x7fd424001110 con 0x7fd4340a8c20 2024-01-22T05:15:58.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd432a00700 1 -- 172.21.15.49:0/2920194196 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4140033f0 con 0x7fd4340a8c20 2024-01-22T05:15:58.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd433400700 1 -- 172.21.15.49:0/2920194196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4340bc9c0 msgr2=0x7fd434068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:58.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd433400700 1 --2- 172.21.15.49:0/2920194196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4340bc9c0 0x7fd434068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd433400700 1 -- 172.21.15.49:0/2920194196 >> v1:172.21.15.49:6789/0 conn(0x7fd4340a8c20 legacy=0x7fd4340c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:58.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd433400700 1 -- 172.21.15.49:0/2920194196 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd434067f10 con 0x7fd4340c1ce0 2024-01-22T05:15:58.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd433400700 1 --2- 172.21.15.49:0/2920194196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4340c1ce0 0x7fd4340bc4d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fd41c006fd0 tx=0x7fd41c006f40).ready entity=mon.1 client_cookie=84f4533275353805 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:58.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd432a00700 1 -- 172.21.15.49:0/2920194196 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c005880 con 0x7fd4340c1ce0 2024-01-22T05:15:58.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd432a00700 1 -- 172.21.15.49:0/2920194196 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c0059e0 con 0x7fd4340c1ce0 2024-01-22T05:15:58.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.341+0000 7fd432a00700 1 -- 172.21.15.49:0/2920194196 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c005d60 con 0x7fd4340c1ce0 2024-01-22T05:15:58.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.345+0000 7fd43ae00700 1 -- 172.21.15.49:0/2920194196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4340c1ce0 msgr2=0x7fd4340bc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:58.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.345+0000 7fd43ae00700 1 --2- 172.21.15.49:0/2920194196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4340c1ce0 0x7fd4340bc4d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fd41c006fd0 tx=0x7fd41c006f40).stop 2024-01-22T05:15:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.345+0000 7fd43ae00700 1 -- 172.21.15.49:0/2920194196 shutdown_connections 2024-01-22T05:15:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.345+0000 7fd43ae00700 1 --2- 172.21.15.49:0/2920194196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4340bc9c0 0x7fd434068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.345+0000 7fd43ae00700 1 --2- 172.21.15.49:0/2920194196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4340c1ce0 0x7fd4340bc4d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.345+0000 7fd43ae00700 1 -- 172.21.15.49:0/2920194196 >> 172.21.15.49:0/2920194196 conn(0x7fd434062cb0 msgr2=0x7fd4340c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.345+0000 7fd43ae00700 1 -- 172.21.15.49:0/2920194196 shutdown_connections 2024-01-22T05:15:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.345+0000 7fd43ae00700 1 -- 172.21.15.49:0/2920194196 wait complete. 2024-01-22T05:15:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.349+0000 7fd43ae00700 1 Processor -- start 2024-01-22T05:15:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.349+0000 7fd43ae00700 1 -- start start 2024-01-22T05:15:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.349+0000 7fd43ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4340a8c20 0x7fd43409f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.349+0000 7fd43ae00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4340bc9c0 0x7fd434156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.349+0000 7fd43ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4340c1ce0 0x7fd4340c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.349+0000 7fd43ae00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340a82f0 con 0x7fd4340bc9c0 2024-01-22T05:15:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.349+0000 7fd43ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340be650 con 0x7fd4340c1ce0 2024-01-22T05:15:58.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.349+0000 7fd43ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340bda40 con 0x7fd4340a8c20 2024-01-22T05:15:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.349+0000 7fd433400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4340bc9c0 0x7fd434156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.349+0000 7fd433400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4340bc9c0 0x7fd434156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37144/0 (socket says 172.21.15.49:37144) 2024-01-22T05:15:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.349+0000 7fd433400700 1 -- 172.21.15.49:0/1733049547 learned_addr learned my addr 172.21.15.49:0/1733049547 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.349+0000 7fd438e00700 1 --2- 172.21.15.49:0/1733049547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4340c1ce0 0x7fd4340c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.349+0000 7fd433e00700 1 --2- 172.21.15.49:0/1733049547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4340a8c20 0x7fd43409f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.353+0000 7fd433400700 1 -- 172.21.15.49:0/1733049547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4340a8c20 msgr2=0x7fd43409f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.353+0000 7fd433400700 1 --2- 172.21.15.49:0/1733049547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4340a8c20 0x7fd43409f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.353+0000 7fd433400700 1 -- 172.21.15.49:0/1733049547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4340c1ce0 msgr2=0x7fd4340c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.353+0000 7fd433400700 1 --2- 172.21.15.49:0/1733049547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4340c1ce0 0x7fd4340c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.353+0000 7fd433400700 1 -- 172.21.15.49:0/1733049547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c009250 con 0x7fd4340bc9c0 2024-01-22T05:15:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.353+0000 7fd433400700 1 --2- 172.21.15.49:0/1733049547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4340bc9c0 0x7fd434156700 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fd41c006000 tx=0x7fd41c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.353+0000 7fd42b400700 1 -- 172.21.15.49:0/1733049547 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c00d6b0 con 0x7fd4340bc9c0 2024-01-22T05:15:58.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.353+0000 7fd42b400700 1 -- 172.21.15.49:0/1733049547 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c00d830 con 0x7fd4340bc9c0 2024-01-22T05:15:58.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.353+0000 7fd43ae00700 1 -- 172.21.15.49:0/1733049547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4340bdd20 con 0x7fd4340bc9c0 2024-01-22T05:15:58.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.353+0000 7fd42b400700 1 -- 172.21.15.49:0/1733049547 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c00dbf0 con 0x7fd4340bc9c0 2024-01-22T05:15:58.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.353+0000 7fd43ae00700 1 -- 172.21.15.49:0/1733049547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4340be2e0 con 0x7fd4340bc9c0 2024-01-22T05:15:58.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.353+0000 7fd43ae00700 1 -- 172.21.15.49:0/1733049547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4340bea80 con 0x7fd4340bc9c0 2024-01-22T05:15:58.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.353+0000 7fd42b400700 1 -- 172.21.15.49:0/1733049547 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd41c0113f0 con 0x7fd4340bc9c0 2024-01-22T05:15:58.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.357+0000 7fd42b400700 1 --2- 172.21.15.49:0/1733049547 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd40c05a510 0x7fd40c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:58.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.357+0000 7fd42b400700 1 -- 172.21.15.49:0/1733049547 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd41c075fb0 con 0x7fd4340bc9c0 2024-01-22T05:15:58.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.357+0000 7fd433e00700 1 --2- 172.21.15.49:0/1733049547 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd40c05a510 0x7fd40c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:58.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.357+0000 7fd433e00700 1 --2- 172.21.15.49:0/1733049547 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd40c05a510 0x7fd40c05c9d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fd424001270 tx=0x7fd424007a70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:58.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.365+0000 7fd42b400700 1 -- 172.21.15.49:0/1733049547 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd41c0a4b00 con 0x7fd4340bc9c0 2024-01-22T05:15:58.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.529+0000 7fd43ae00700 1 -- 172.21.15.49:0/1733049547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd4340c0c00 con 0x7fd4340bc9c0 2024-01-22T05:15:58.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.533+0000 7fd42b400700 1 -- 172.21.15.49:0/1733049547 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v133) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd41c0230a0 con 0x7fd4340bc9c0 2024-01-22T05:15:58.531 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:15:58.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.533+0000 7fd43ae00700 1 -- 172.21.15.49:0/1733049547 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd40c05a510 msgr2=0x7fd40c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:58.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.533+0000 7fd43ae00700 1 --2- 172.21.15.49:0/1733049547 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd40c05a510 0x7fd40c05c9d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fd424001270 tx=0x7fd424007a70).stop 2024-01-22T05:15:58.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.533+0000 7fd43ae00700 1 -- 172.21.15.49:0/1733049547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4340bc9c0 msgr2=0x7fd434156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:58.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.533+0000 7fd43ae00700 1 --2- 172.21.15.49:0/1733049547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4340bc9c0 0x7fd434156700 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fd41c006000 tx=0x7fd41c015000).stop 2024-01-22T05:15:58.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.533+0000 7fd43ae00700 1 -- 172.21.15.49:0/1733049547 shutdown_connections 2024-01-22T05:15:58.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.533+0000 7fd43ae00700 1 --2- 172.21.15.49:0/1733049547 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd40c05a510 0x7fd40c05c9d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.533+0000 7fd43ae00700 1 --2- 172.21.15.49:0/1733049547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4340c1ce0 0x7fd4340c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.533+0000 7fd43ae00700 1 --2- 172.21.15.49:0/1733049547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4340bc9c0 0x7fd434156700 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.533+0000 7fd43ae00700 1 --2- 172.21.15.49:0/1733049547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4340a8c20 0x7fd43409f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.533+0000 7fd43ae00700 1 -- 172.21.15.49:0/1733049547 >> 172.21.15.49:0/1733049547 conn(0x7fd434062cb0 msgr2=0x7fd4340bbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:58.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.533+0000 7fd43ae00700 1 -- 172.21.15.49:0/1733049547 shutdown_connections 2024-01-22T05:15:58.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.533+0000 7fd43ae00700 1 -- 172.21.15.49:0/1733049547 wait complete. 2024-01-22T05:15:58.555 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:15:58.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.721+0000 7f1d7c000700 1 Processor -- start 2024-01-22T05:15:58.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.725+0000 7f1d7c000700 1 -- start start 2024-01-22T05:15:58.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.725+0000 7f1d7c000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d74153a00 0x7f1d740c3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:58.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.725+0000 7f1d7c000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1d74153de0 0x7f1d740c3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:58.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.725+0000 7f1d7c000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d740657a0 0x7f1d74065c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:58.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.725+0000 7f1d7c000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d74066120 con 0x7f1d74153a00 2024-01-22T05:15:58.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.725+0000 7f1d7c000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d740c4840 con 0x7f1d74153de0 2024-01-22T05:15:58.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.725+0000 7f1d7c000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740be770 con 0x7f1d740657a0 2024-01-22T05:15:58.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.725+0000 7f1d79600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d74153a00 0x7f1d740c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:58.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.725+0000 7f1d7aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d740657a0 0x7f1d74065c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:58.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.725+0000 7f1d78c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1d74153de0 0x7f1d740c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:58.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.725+0000 7f1d7aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d740657a0 0x7f1d74065c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:39424/0 (socket says 172.21.15.49:39424) 2024-01-22T05:15:58.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.725+0000 7f1d78c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1d74153de0 0x7f1d740c3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:43356/0 (socket says 172.21.15.49:43356) 2024-01-22T05:15:58.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.725+0000 7f1d7aa00700 1 -- 172.21.15.49:0/2161212393 learned_addr learned my addr 172.21.15.49:0/2161212393 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:58.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d7aa00700 1 -- 172.21.15.49:0/2161212393 >> v2:172.21.15.110:3300/0 conn(0x7f1d74153de0 msgr2=0x7f1d740c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:58.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d7aa00700 1 --2- 172.21.15.49:0/2161212393 >> v2:172.21.15.110:3300/0 conn(0x7f1d74153de0 0x7f1d740c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d7aa00700 1 -- 172.21.15.49:0/2161212393 >> v2:172.21.15.49:3300/0 conn(0x7f1d74153a00 msgr2=0x7f1d740c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:58.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d7aa00700 1 --2- 172.21.15.49:0/2161212393 >> v2:172.21.15.49:3300/0 conn(0x7f1d74153a00 0x7f1d740c3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d7aa00700 1 -- 172.21.15.49:0/2161212393 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d740bd9d0 con 0x7f1d740657a0 2024-01-22T05:15:58.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d78c00700 1 --2- 172.21.15.49:0/2161212393 >> v2:172.21.15.110:3300/0 conn(0x7f1d74153de0 0x7f1d740c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:15:58.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d79600700 1 --2- 172.21.15.49:0/2161212393 >> v2:172.21.15.49:3300/0 conn(0x7f1d74153a00 0x7f1d740c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:15:58.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d7aa00700 1 --2- 172.21.15.49:0/2161212393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d740657a0 0x7f1d74065c30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1d741576e0 tx=0x7f1d6c009840).ready entity=mon.2 client_cookie=2357448edf4f643d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:58.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d73e00700 1 -- 172.21.15.49:0/2161212393 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00e070 con 0x7f1d740657a0 2024-01-22T05:15:58.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d73e00700 1 -- 172.21.15.49:0/2161212393 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c00b970 con 0x7f1d740657a0 2024-01-22T05:15:58.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d73e00700 1 -- 172.21.15.49:0/2161212393 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00bcf0 con 0x7f1d740657a0 2024-01-22T05:15:58.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d7c000700 1 -- 172.21.15.49:0/2161212393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d740657a0 msgr2=0x7f1d74065c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:58.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d7c000700 1 --2- 172.21.15.49:0/2161212393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d740657a0 0x7f1d74065c30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1d741576e0 tx=0x7f1d6c009840).stop 2024-01-22T05:15:58.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d7c000700 1 -- 172.21.15.49:0/2161212393 shutdown_connections 2024-01-22T05:15:58.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d7c000700 1 --2- 172.21.15.49:0/2161212393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d740657a0 0x7f1d74065c30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d7c000700 1 --2- 172.21.15.49:0/2161212393 >> v2:172.21.15.110:3300/0 conn(0x7f1d74153de0 0x7f1d740c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d7c000700 1 --2- 172.21.15.49:0/2161212393 >> v2:172.21.15.49:3300/0 conn(0x7f1d74153a00 0x7f1d740c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.729+0000 7f1d7c000700 1 -- 172.21.15.49:0/2161212393 >> 172.21.15.49:0/2161212393 conn(0x7f1d740c9070 msgr2=0x7f1d740c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:58.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.733+0000 7f1d7c000700 1 -- 172.21.15.49:0/2161212393 shutdown_connections 2024-01-22T05:15:58.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.733+0000 7f1d7c000700 1 -- 172.21.15.49:0/2161212393 wait complete. 2024-01-22T05:15:58.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.733+0000 7f1d7c000700 1 Processor -- start 2024-01-22T05:15:58.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.733+0000 7f1d7c000700 1 -- start start 2024-01-22T05:15:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d7c000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d740657a0 0x7f1d740c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d7c000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d74153a00 0x7f1d740c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d7c000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d74153de0 0x7f1d740c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d7c000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740c8210 con 0x7f1d74153a00 2024-01-22T05:15:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d7c000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740ac490 con 0x7f1d740657a0 2024-01-22T05:15:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d7c000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740ab880 con 0x7f1d74153de0 2024-01-22T05:15:58.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d78c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d74153a00 0x7f1d740c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:58.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d78c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d74153a00 0x7f1d740c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37156/0 (socket says 172.21.15.49:37156) 2024-01-22T05:15:58.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d78c00700 1 -- 172.21.15.49:0/189074790 learned_addr learned my addr 172.21.15.49:0/189074790 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:58.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d79600700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d740657a0 0x7f1d740c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:58.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d7aa00700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d74153de0 0x7f1d740c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:58.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d78c00700 1 -- 172.21.15.49:0/189074790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d74153de0 msgr2=0x7f1d740c1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:58.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d78c00700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d74153de0 0x7f1d740c1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d78c00700 1 -- 172.21.15.49:0/189074790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d740657a0 msgr2=0x7f1d740c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:58.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d78c00700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d740657a0 0x7f1d740c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d78c00700 1 -- 172.21.15.49:0/189074790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d640092a0 con 0x7f1d74153a00 2024-01-22T05:15:58.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d79600700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d740657a0 0x7f1d740c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:58.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d7aa00700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d74153de0 0x7f1d740c1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:15:58.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d78c00700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d74153a00 0x7f1d740c7d20 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f1d5c00ea20 tx=0x7f1d5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:58.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d70c00700 1 -- 172.21.15.49:0/189074790 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c00c850 con 0x7f1d74153a00 2024-01-22T05:15:58.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d70c00700 1 -- 172.21.15.49:0/189074790 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c00c9b0 con 0x7f1d74153a00 2024-01-22T05:15:58.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d7c000700 1 -- 172.21.15.49:0/189074790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5c0092a0 con 0x7f1d74153a00 2024-01-22T05:15:58.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d70c00700 1 -- 172.21.15.49:0/189074790 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c00cd30 con 0x7f1d74153a00 2024-01-22T05:15:58.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.737+0000 7f1d7c000700 1 -- 172.21.15.49:0/189074790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6c009ae0 con 0x7f1d74153a00 2024-01-22T05:15:58.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.741+0000 7f1d7c000700 1 -- 172.21.15.49:0/189074790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d740ac640 con 0x7f1d74153a00 2024-01-22T05:15:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.741+0000 7f1d70c00700 1 -- 172.21.15.49:0/189074790 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1d5c012600 con 0x7f1d74153a00 2024-01-22T05:15:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.741+0000 7f1d70c00700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d4c05a510 0x7f1d4c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:58.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.741+0000 7f1d70c00700 1 -- 172.21.15.49:0/189074790 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1d5c074fe0 con 0x7f1d74153a00 2024-01-22T05:15:58.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.745+0000 7f1d79600700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d4c05a510 0x7f1d4c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:58.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.745+0000 7f1d79600700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d4c05a510 0x7f1d4c05c9d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f1d64009270 tx=0x7f1d64008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:58.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.749+0000 7f1d70c00700 1 -- 172.21.15.49:0/189074790 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1d740ac640 con 0x7f1d74153a00 2024-01-22T05:15:58.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.909+0000 7f1d7c000700 1 -- 172.21.15.49:0/189074790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d740ac600 con 0x7f1d74153a00 2024-01-22T05:15:58.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.909+0000 7f1d70c00700 1 -- 172.21.15.49:0/189074790 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v133) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d5c0485a0 con 0x7f1d74153a00 2024-01-22T05:15:58.909 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:15:58.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.913+0000 7f1d7c000700 1 -- 172.21.15.49:0/189074790 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d4c05a510 msgr2=0x7f1d4c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:58.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.913+0000 7f1d7c000700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d4c05a510 0x7f1d4c05c9d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f1d64009270 tx=0x7f1d64008040).stop 2024-01-22T05:15:58.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.913+0000 7f1d7c000700 1 -- 172.21.15.49:0/189074790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d74153a00 msgr2=0x7f1d740c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:58.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.913+0000 7f1d7c000700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d74153a00 0x7f1d740c7d20 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f1d5c00ea20 tx=0x7f1d5c009060).stop 2024-01-22T05:15:58.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.913+0000 7f1d7c000700 1 -- 172.21.15.49:0/189074790 shutdown_connections 2024-01-22T05:15:58.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.913+0000 7f1d7c000700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d4c05a510 0x7f1d4c05c9d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.913+0000 7f1d7c000700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d74153de0 0x7f1d740c1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.913+0000 7f1d7c000700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d74153a00 0x7f1d740c7d20 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.913+0000 7f1d7c000700 1 --2- 172.21.15.49:0/189074790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d740657a0 0x7f1d740c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:58.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.913+0000 7f1d7c000700 1 -- 172.21.15.49:0/189074790 >> 172.21.15.49:0/189074790 conn(0x7f1d740c9070 msgr2=0x7f1d741524b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:58.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.913+0000 7f1d7c000700 1 -- 172.21.15.49:0/189074790 shutdown_connections 2024-01-22T05:15:58.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:58.913+0000 7f1d7c000700 1 -- 172.21.15.49:0/189074790 wait complete. 2024-01-22T05:15:58.936 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:15:59.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.097+0000 7f6b8fe00700 1 Processor -- start 2024-01-22T05:15:59.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.097+0000 7f6b8fe00700 1 -- start start 2024-01-22T05:15:59.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8fe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6b900c2d00 0x7f6b90068210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6b90153a10 0x7f6b90153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8fe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b90068830 con 0x7f6b90157b30 2024-01-22T05:15:59.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8fe00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b90068b10 con 0x7f6b90153a10 2024-01-22T05:15:59.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8fe00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b90068df0 con 0x7f6b900c2d00 2024-01-22T05:15:59.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6b90153a10 0x7f6b90153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8e000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6b900c2d00 0x7f6b90068210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8e000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6b900c2d00 0x7f6b90068210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:43384/0 (socket says 172.21.15.49:43384) 2024-01-22T05:15:59.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8e000700 1 -- 172.21.15.49:0/326688053 learned_addr learned my addr 172.21.15.49:0/326688053 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:59.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8ea00700 1 --1- 172.21.15.49:0/326688053 >> v1:172.21.15.110:6789/0 conn(0x7f6b90157b30 0x7f6b90067b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:51214/0 (socket says 172.21.15.49:51214) 2024-01-22T05:15:59.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8e000700 1 -- 172.21.15.49:0/326688053 >> v2:172.21.15.49:3300/0 conn(0x7f6b90153a10 msgr2=0x7f6b90153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:59.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8e000700 1 --2- 172.21.15.49:0/326688053 >> v2:172.21.15.49:3300/0 conn(0x7f6b90153a10 0x7f6b90153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8e000700 1 -- 172.21.15.49:0/326688053 >> v1:172.21.15.110:6789/0 conn(0x7f6b90157b30 legacy=0x7f6b90067b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8e000700 1 -- 172.21.15.49:0/326688053 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b900690d0 con 0x7f6b900c2d00 2024-01-22T05:15:59.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8e000700 1 --2- 172.21.15.49:0/326688053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b900c2d00 0x7f6b90068210 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f6b901552e0 tx=0x7f6b780090f0).ready entity=mon.1 client_cookie=6f1d0fb0fd6fd662 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:59.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8d600700 1 -- 172.21.15.49:0/326688053 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7800b520 con 0x7f6b900c2d00 2024-01-22T05:15:59.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8d600700 1 -- 172.21.15.49:0/326688053 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7800b680 con 0x7f6b900c2d00 2024-01-22T05:15:59.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8d600700 1 -- 172.21.15.49:0/326688053 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7800ba00 con 0x7f6b900c2d00 2024-01-22T05:15:59.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8fe00700 1 -- 172.21.15.49:0/326688053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b900c2d00 msgr2=0x7f6b90068210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.101+0000 7f6b8fe00700 1 --2- 172.21.15.49:0/326688053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b900c2d00 0x7f6b90068210 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f6b901552e0 tx=0x7f6b780090f0).stop 2024-01-22T05:15:59.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.105+0000 7f6b8fe00700 1 -- 172.21.15.49:0/326688053 shutdown_connections 2024-01-22T05:15:59.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.105+0000 7f6b8fe00700 1 --2- 172.21.15.49:0/326688053 >> v2:172.21.15.49:3300/0 conn(0x7f6b90153a10 0x7f6b90153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.105+0000 7f6b8fe00700 1 --2- 172.21.15.49:0/326688053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b900c2d00 0x7f6b90068210 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.105+0000 7f6b8fe00700 1 -- 172.21.15.49:0/326688053 >> 172.21.15.49:0/326688053 conn(0x7f6b900c3880 msgr2=0x7f6b900c3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:59.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.105+0000 7f6b8fe00700 1 -- 172.21.15.49:0/326688053 shutdown_connections 2024-01-22T05:15:59.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.105+0000 7f6b8fe00700 1 -- 172.21.15.49:0/326688053 wait complete. 2024-01-22T05:15:59.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.105+0000 7f6b8fe00700 1 Processor -- start 2024-01-22T05:15:59.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.105+0000 7f6b8fe00700 1 -- start start 2024-01-22T05:15:59.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b900c2d00 0x7f6b900a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b90153a10 0x7f6b90147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b90157b30 0x7f6b900a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8fe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b900a6760 con 0x7f6b900c2d00 2024-01-22T05:15:59.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b900a3c40 con 0x7f6b90153a10 2024-01-22T05:15:59.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b90168e10 con 0x7f6b90157b30 2024-01-22T05:15:59.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b900c2d00 0x7f6b900a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b900c2d00 0x7f6b900a6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37172/0 (socket says 172.21.15.49:37172) 2024-01-22T05:15:59.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8ea00700 1 -- 172.21.15.49:0/1549331939 learned_addr learned my addr 172.21.15.49:0/1549331939 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:59.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8e000700 1 --2- 172.21.15.49:0/1549331939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b90153a10 0x7f6b90147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8f400700 1 --2- 172.21.15.49:0/1549331939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b90157b30 0x7f6b900a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8ea00700 1 -- 172.21.15.49:0/1549331939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b90157b30 msgr2=0x7f6b900a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8ea00700 1 --2- 172.21.15.49:0/1549331939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b90157b30 0x7f6b900a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8ea00700 1 -- 172.21.15.49:0/1549331939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b90153a10 msgr2=0x7f6b90147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8ea00700 1 --2- 172.21.15.49:0/1549331939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b90153a10 0x7f6b90147530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8ea00700 1 -- 172.21.15.49:0/1549331939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b78009370 con 0x7f6b900c2d00 2024-01-22T05:15:59.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8ea00700 1 --2- 172.21.15.49:0/1549331939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b900c2d00 0x7f6b900a6270 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f6b80007fd0 tx=0x7f6b80007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:59.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b86000700 1 -- 172.21.15.49:0/1549331939 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b800072e0 con 0x7f6b900c2d00 2024-01-22T05:15:59.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b86000700 1 -- 172.21.15.49:0/1549331939 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b80007440 con 0x7f6b900c2d00 2024-01-22T05:15:59.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b86000700 1 -- 172.21.15.49:0/1549331939 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b800058f0 con 0x7f6b900c2d00 2024-01-22T05:15:59.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8fe00700 1 -- 172.21.15.49:0/1549331939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b900a3f00 con 0x7f6b900c2d00 2024-01-22T05:15:59.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.109+0000 7f6b8fe00700 1 -- 172.21.15.49:0/1549331939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b90147a20 con 0x7f6b900c2d00 2024-01-22T05:15:59.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.113+0000 7f6b8fe00700 1 -- 172.21.15.49:0/1549331939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b90157320 con 0x7f6b900c2d00 2024-01-22T05:15:59.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.113+0000 7f6b86000700 1 -- 172.21.15.49:0/1549331939 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6b80005ce0 con 0x7f6b900c2d00 2024-01-22T05:15:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.113+0000 7f6b86000700 1 --2- 172.21.15.49:0/1549331939 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b6805a510 0x7f6b6805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.117+0000 7f6b86000700 1 -- 172.21.15.49:0/1549331939 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6b80074140 con 0x7f6b900c2d00 2024-01-22T05:15:59.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.117+0000 7f6b8e000700 1 --2- 172.21.15.49:0/1549331939 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b6805a510 0x7f6b6805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.117+0000 7f6b8e000700 1 --2- 172.21.15.49:0/1549331939 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b6805a510 0x7f6b6805c9d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f6b901552e0 tx=0x7f6b78017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.121+0000 7f6b86000700 1 -- 172.21.15.49:0/1549331939 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6b90157320 con 0x7f6b900c2d00 2024-01-22T05:15:59.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.281+0000 7f6b8fe00700 1 -- 172.21.15.49:0/1549331939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b90157320 con 0x7f6b900c2d00 2024-01-22T05:15:59.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.285+0000 7f6b86000700 1 -- 172.21.15.49:0/1549331939 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v133) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b90157320 con 0x7f6b900c2d00 2024-01-22T05:15:59.284 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:15:59.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.285+0000 7f6b8fe00700 1 -- 172.21.15.49:0/1549331939 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b6805a510 msgr2=0x7f6b6805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.285+0000 7f6b8fe00700 1 --2- 172.21.15.49:0/1549331939 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b6805a510 0x7f6b6805c9d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f6b901552e0 tx=0x7f6b78017000).stop 2024-01-22T05:15:59.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.285+0000 7f6b8fe00700 1 -- 172.21.15.49:0/1549331939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b900c2d00 msgr2=0x7f6b900a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.285+0000 7f6b8fe00700 1 --2- 172.21.15.49:0/1549331939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b900c2d00 0x7f6b900a6270 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f6b80007fd0 tx=0x7f6b80007df0).stop 2024-01-22T05:15:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.285+0000 7f6b8fe00700 1 -- 172.21.15.49:0/1549331939 shutdown_connections 2024-01-22T05:15:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.285+0000 7f6b8fe00700 1 --2- 172.21.15.49:0/1549331939 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6b6805a510 0x7f6b6805c9d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.285+0000 7f6b8fe00700 1 --2- 172.21.15.49:0/1549331939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b90157b30 0x7f6b900a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.285+0000 7f6b8fe00700 1 --2- 172.21.15.49:0/1549331939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b90153a10 0x7f6b90147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.285+0000 7f6b8fe00700 1 --2- 172.21.15.49:0/1549331939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b900c2d00 0x7f6b900a6270 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.285+0000 7f6b8fe00700 1 -- 172.21.15.49:0/1549331939 >> 172.21.15.49:0/1549331939 conn(0x7f6b900c3880 msgr2=0x7f6b90063520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.289+0000 7f6b8fe00700 1 -- 172.21.15.49:0/1549331939 shutdown_connections 2024-01-22T05:15:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.289+0000 7f6b8fe00700 1 -- 172.21.15.49:0/1549331939 wait complete. 2024-01-22T05:15:59.311 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:15:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.473+0000 7f5e09600700 1 Processor -- start 2024-01-22T05:15:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.473+0000 7f5e09600700 1 -- start start 2024-01-22T05:15:59.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e09600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5e040671d0 0x7f5e04153810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e09600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5e04153d00 0x7f5e04157690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e09600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e040680e0 con 0x7f5e04157b80 2024-01-22T05:15:59.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e09600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e04066c50 con 0x7f5e04153d00 2024-01-22T05:15:59.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e09600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e04157fb0 con 0x7f5e040671d0 2024-01-22T05:15:59.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e03400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5e04153d00 0x7f5e04157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e03e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5e040671d0 0x7f5e04153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e08c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5e04157b80 0x7f5e04068570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44690/0 (socket says 172.21.15.49:44690) 2024-01-22T05:15:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e08c00700 1 -- 172.21.15.49:0/1131854449 learned_addr learned my addr 172.21.15.49:0/1131854449 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:15:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e03400700 1 -- 172.21.15.49:0/1131854449 >> v2:172.21.15.110:3300/0 conn(0x7f5e040671d0 msgr2=0x7f5e04153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e03400700 1 --2- 172.21.15.49:0/1131854449 >> v2:172.21.15.110:3300/0 conn(0x7f5e040671d0 0x7f5e04153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e03400700 1 -- 172.21.15.49:0/1131854449 >> v1:172.21.15.49:6789/0 conn(0x7f5e04157b80 legacy=0x7f5e04068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e02a00700 1 -- 172.21.15.49:0/1131854449 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597851626 0 0) 0x7f5e040680e0 con 0x7f5e04157b80 2024-01-22T05:15:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e03400700 1 -- 172.21.15.49:0/1131854449 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e040a8df0 con 0x7f5e04153d00 2024-01-22T05:15:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e03400700 1 --2- 172.21.15.49:0/1131854449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e04153d00 0x7f5e04157690 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f5e04064470 tx=0x7f5dec009060).ready entity=mon.0 client_cookie=5034a81b213fc1ac server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e02a00700 1 -- 172.21.15.49:0/1131854449 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00f510 con 0x7f5e04153d00 2024-01-22T05:15:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e02a00700 1 -- 172.21.15.49:0/1131854449 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec00f670 con 0x7f5e04153d00 2024-01-22T05:15:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.477+0000 7f5e02a00700 1 -- 172.21.15.49:0/1131854449 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00f9f0 con 0x7f5e04153d00 2024-01-22T05:15:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.481+0000 7f5e09600700 1 -- 172.21.15.49:0/1131854449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e04153d00 msgr2=0x7f5e04157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.481+0000 7f5e09600700 1 --2- 172.21.15.49:0/1131854449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e04153d00 0x7f5e04157690 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f5e04064470 tx=0x7f5dec009060).stop 2024-01-22T05:15:59.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.481+0000 7f5e09600700 1 -- 172.21.15.49:0/1131854449 shutdown_connections 2024-01-22T05:15:59.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.481+0000 7f5e09600700 1 --2- 172.21.15.49:0/1131854449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e04153d00 0x7f5e04157690 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.481+0000 7f5e09600700 1 --2- 172.21.15.49:0/1131854449 >> v2:172.21.15.110:3300/0 conn(0x7f5e040671d0 0x7f5e04153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.481+0000 7f5e09600700 1 -- 172.21.15.49:0/1131854449 >> 172.21.15.49:0/1131854449 conn(0x7f5e040c6530 msgr2=0x7f5e040c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:59.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.481+0000 7f5e09600700 1 -- 172.21.15.49:0/1131854449 shutdown_connections 2024-01-22T05:15:59.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.481+0000 7f5e09600700 1 -- 172.21.15.49:0/1131854449 wait complete. 2024-01-22T05:15:59.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.485+0000 7f5e09600700 1 Processor -- start 2024-01-22T05:15:59.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.485+0000 7f5e09600700 1 -- start start 2024-01-22T05:15:59.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.485+0000 7f5e09600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e040671d0 0x7f5e0414b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.485+0000 7f5e09600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e04153d00 0x7f5e0414bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.485+0000 7f5e09600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e04157b80 0x7f5e0414c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.485+0000 7f5e09600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0414d5e0 con 0x7f5e040671d0 2024-01-22T05:15:59.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.485+0000 7f5e09600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0414c9d0 con 0x7f5e04153d00 2024-01-22T05:15:59.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.485+0000 7f5e09600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0414ccb0 con 0x7f5e04157b80 2024-01-22T05:15:59.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5e03e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e040671d0 0x7f5e0414b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5e03e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e040671d0 0x7f5e0414b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37184/0 (socket says 172.21.15.49:37184) 2024-01-22T05:15:59.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5e03e00700 1 -- 172.21.15.49:0/2369353413 learned_addr learned my addr 172.21.15.49:0/2369353413 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5e03400700 1 --2- 172.21.15.49:0/2369353413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e04153d00 0x7f5e0414bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5e08c00700 1 --2- 172.21.15.49:0/2369353413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e04157b80 0x7f5e0414c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5e03e00700 1 -- 172.21.15.49:0/2369353413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e04157b80 msgr2=0x7f5e0414c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5e03e00700 1 --2- 172.21.15.49:0/2369353413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e04157b80 0x7f5e0414c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5e03e00700 1 -- 172.21.15.49:0/2369353413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e04153d00 msgr2=0x7f5e0414bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5e03e00700 1 --2- 172.21.15.49:0/2369353413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e04153d00 0x7f5e0414bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5e03e00700 1 -- 172.21.15.49:0/2369353413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec0092a0 con 0x7f5e040671d0 2024-01-22T05:15:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5e03e00700 1 --2- 172.21.15.49:0/2369353413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e040671d0 0x7f5e0414b040 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f5df400e930 tx=0x7f5df4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5dfb400700 1 -- 172.21.15.49:0/2369353413 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400eed0 con 0x7f5e040671d0 2024-01-22T05:15:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5dfb400700 1 -- 172.21.15.49:0/2369353413 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df400c850 con 0x7f5e040671d0 2024-01-22T05:15:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5e09600700 1 -- 172.21.15.49:0/2369353413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0414cf90 con 0x7f5e040671d0 2024-01-22T05:15:59.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5dfb400700 1 -- 172.21.15.49:0/2369353413 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400cbd0 con 0x7f5e040671d0 2024-01-22T05:15:59.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5e09600700 1 -- 172.21.15.49:0/2369353413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e04154300 con 0x7f5e040671d0 2024-01-22T05:15:59.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.489+0000 7f5e09600700 1 -- 172.21.15.49:0/2369353413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0405fd40 con 0x7f5e040671d0 2024-01-22T05:15:59.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.493+0000 7f5dfb400700 1 -- 172.21.15.49:0/2369353413 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5df401b400 con 0x7f5e040671d0 2024-01-22T05:15:59.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.493+0000 7f5dfb400700 1 --2- 172.21.15.49:0/2369353413 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5ddc05a510 0x7f5ddc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.493+0000 7f5dfb400700 1 -- 172.21.15.49:0/2369353413 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5df4074fd0 con 0x7f5e040671d0 2024-01-22T05:15:59.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.493+0000 7f5e03400700 1 --2- 172.21.15.49:0/2369353413 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5ddc05a510 0x7f5ddc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.497+0000 7f5e03400700 1 --2- 172.21.15.49:0/2369353413 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5ddc05a510 0x7f5ddc05c9d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f5e04154100 tx=0x7f5dec017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:59.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.501+0000 7f5dfb400700 1 -- 172.21.15.49:0/2369353413 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5df40484f0 con 0x7f5e040671d0 2024-01-22T05:15:59.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.709+0000 7f5e09600700 1 -- 172.21.15.49:0/2369353413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e040a90d0 con 0x7f5e040671d0 2024-01-22T05:15:59.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.709+0000 7f5dfb400700 1 -- 172.21.15.49:0/2369353413 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4503 (secure 0 0 0) 0x7f5df404bb10 con 0x7f5e040671d0 2024-01-22T05:15:59.711 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:15:59.711 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:14:58.925818+0000","modified":"2024-01-22T05:15:02.323695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8292":{"gid":8292,"name":"a","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3036262557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3036262557},{"type":"v1","addr":"172.21.15.49:6837","nonce":3036262557}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-22T05:15:59.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.713+0000 7f5e09600700 1 -- 172.21.15.49:0/2369353413 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5ddc05a510 msgr2=0x7f5ddc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.713+0000 7f5e09600700 1 --2- 172.21.15.49:0/2369353413 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5ddc05a510 0x7f5ddc05c9d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f5e04154100 tx=0x7f5dec017000).stop 2024-01-22T05:15:59.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.713+0000 7f5e09600700 1 -- 172.21.15.49:0/2369353413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e040671d0 msgr2=0x7f5e0414b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.713+0000 7f5e09600700 1 --2- 172.21.15.49:0/2369353413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e040671d0 0x7f5e0414b040 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f5df400e930 tx=0x7f5df4009060).stop 2024-01-22T05:15:59.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.713+0000 7f5e09600700 1 -- 172.21.15.49:0/2369353413 shutdown_connections 2024-01-22T05:15:59.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.713+0000 7f5e09600700 1 --2- 172.21.15.49:0/2369353413 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5ddc05a510 0x7f5ddc05c9d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.713+0000 7f5e09600700 1 --2- 172.21.15.49:0/2369353413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e04157b80 0x7f5e0414c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.713+0000 7f5e09600700 1 --2- 172.21.15.49:0/2369353413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e04153d00 0x7f5e0414bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.713+0000 7f5e09600700 1 --2- 172.21.15.49:0/2369353413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e040671d0 0x7f5e0414b040 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.713+0000 7f5e09600700 1 -- 172.21.15.49:0/2369353413 >> 172.21.15.49:0/2369353413 conn(0x7f5e040c6530 msgr2=0x7f5e040659b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:59.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.713+0000 7f5e09600700 1 -- 172.21.15.49:0/2369353413 shutdown_connections 2024-01-22T05:15:59.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.713+0000 7f5e09600700 1 -- 172.21.15.49:0/2369353413 wait complete. 2024-01-22T05:15:59.719 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2024-01-22T05:15:59.737 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:15:59.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.905+0000 7ff661a00700 1 Processor -- start 2024-01-22T05:15:59.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.905+0000 7ff661a00700 1 -- start start 2024-01-22T05:15:59.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.909+0000 7ff661a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff65c065240 0x7ff65c0644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.909+0000 7ff661a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff65c0649e0 0x7ff65c15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.909+0000 7ff661a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65c0c2700 con 0x7ff65c065620 2024-01-22T05:15:59.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.909+0000 7ff661a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65c0c29a0 con 0x7ff65c0649e0 2024-01-22T05:15:59.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.909+0000 7ff661a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65c0c2c80 con 0x7ff65c065240 2024-01-22T05:15:59.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.909+0000 7ff65be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff65c0649e0 0x7ff65c15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.909+0000 7ff65be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff65c0649e0 0x7ff65c15c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37186/0 (socket says 172.21.15.49:37186) 2024-01-22T05:15:59.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.909+0000 7ff65be00700 1 -- 172.21.15.49:0/2775519375 learned_addr learned my addr 172.21.15.49:0/2775519375 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:59.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.909+0000 7ff65a000700 1 --1- 172.21.15.49:0/2775519375 >> v1:172.21.15.49:6789/0 conn(0x7ff65c065620 0x7ff65c15b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44692/0 (socket says 172.21.15.49:44692) 2024-01-22T05:15:59.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.909+0000 7ff65aa00700 1 --2- 172.21.15.49:0/2775519375 >> v2:172.21.15.110:3300/0 conn(0x7ff65c065240 0x7ff65c0644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.909+0000 7ff65be00700 1 -- 172.21.15.49:0/2775519375 >> v2:172.21.15.110:3300/0 conn(0x7ff65c065240 msgr2=0x7ff65c0644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:15:59.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.909+0000 7ff65be00700 1 --2- 172.21.15.49:0/2775519375 >> v2:172.21.15.110:3300/0 conn(0x7ff65c065240 0x7ff65c0644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.909+0000 7ff65be00700 1 -- 172.21.15.49:0/2775519375 >> v1:172.21.15.49:6789/0 conn(0x7ff65c065620 legacy=0x7ff65c15b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.909+0000 7ff65be00700 1 -- 172.21.15.49:0/2775519375 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c0c2f60 con 0x7ff65c0649e0 2024-01-22T05:15:59.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.913+0000 7ff65be00700 1 --2- 172.21.15.49:0/2775519375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff65c0649e0 0x7ff65c15c0c0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7ff65c060220 tx=0x7ff654009840).ready entity=mon.0 client_cookie=2d8fe5cace2fffb7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:59.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.913+0000 7ff659600700 1 -- 172.21.15.49:0/2775519375 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65400e070 con 0x7ff65c0649e0 2024-01-22T05:15:59.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.913+0000 7ff659600700 1 -- 172.21.15.49:0/2775519375 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65400ba20 con 0x7ff65c0649e0 2024-01-22T05:15:59.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.913+0000 7ff659600700 1 -- 172.21.15.49:0/2775519375 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65400bda0 con 0x7ff65c0649e0 2024-01-22T05:15:59.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.913+0000 7ff661a00700 1 -- 172.21.15.49:0/2775519375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff65c0649e0 msgr2=0x7ff65c15c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.913+0000 7ff661a00700 1 --2- 172.21.15.49:0/2775519375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff65c0649e0 0x7ff65c15c0c0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7ff65c060220 tx=0x7ff654009840).stop 2024-01-22T05:15:59.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.913+0000 7ff661a00700 1 -- 172.21.15.49:0/2775519375 shutdown_connections 2024-01-22T05:15:59.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.913+0000 7ff661a00700 1 --2- 172.21.15.49:0/2775519375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff65c0649e0 0x7ff65c15c0c0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.913+0000 7ff661a00700 1 --2- 172.21.15.49:0/2775519375 >> v2:172.21.15.110:3300/0 conn(0x7ff65c065240 0x7ff65c0644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.913+0000 7ff661a00700 1 -- 172.21.15.49:0/2775519375 >> 172.21.15.49:0/2775519375 conn(0x7ff65c0c87f0 msgr2=0x7ff65c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:15:59.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.913+0000 7ff661a00700 1 -- 172.21.15.49:0/2775519375 shutdown_connections 2024-01-22T05:15:59.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.913+0000 7ff661a00700 1 -- 172.21.15.49:0/2775519375 wait complete. 2024-01-22T05:15:59.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.917+0000 7ff661a00700 1 Processor -- start 2024-01-22T05:15:59.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.917+0000 7ff661a00700 1 -- start start 2024-01-22T05:15:59.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff661a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff65c0649e0 0x7ff65c140b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff661a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff65c065240 0x7ff65c0a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff661a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff65c065620 0x7ff65c0a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff661a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0bfdb0 con 0x7ff65c065620 2024-01-22T05:15:59.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff661a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c153ab0 con 0x7ff65c065240 2024-01-22T05:15:59.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff661a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0aa230 con 0x7ff65c0649e0 2024-01-22T05:15:59.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff65be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff65c065620 0x7ff65c0a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff65be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff65c065620 0x7ff65c0a9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37202/0 (socket says 172.21.15.49:37202) 2024-01-22T05:15:59.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff65be00700 1 -- 172.21.15.49:0/679023597 learned_addr learned my addr 172.21.15.49:0/679023597 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:15:59.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff65a000700 1 --2- 172.21.15.49:0/679023597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff65c065240 0x7ff65c0a7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff65aa00700 1 --2- 172.21.15.49:0/679023597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff65c0649e0 0x7ff65c140b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff65be00700 1 -- 172.21.15.49:0/679023597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff65c0649e0 msgr2=0x7ff65c140b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff65be00700 1 --2- 172.21.15.49:0/679023597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff65c0649e0 0x7ff65c140b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff65be00700 1 -- 172.21.15.49:0/679023597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff65c065240 msgr2=0x7ff65c0a7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:15:59.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff65be00700 1 --2- 172.21.15.49:0/679023597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff65c065240 0x7ff65c0a7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:15:59.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff65be00700 1 -- 172.21.15.49:0/679023597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654009ae0 con 0x7ff65c065620 2024-01-22T05:15:59.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff65be00700 1 --2- 172.21.15.49:0/679023597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff65c065620 0x7ff65c0a9330 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7ff65c066be0 tx=0x7ff65c0c2890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:59.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff652000700 1 -- 172.21.15.49:0/679023597 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540092e0 con 0x7ff65c065620 2024-01-22T05:15:59.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff652000700 1 -- 172.21.15.49:0/679023597 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65401e470 con 0x7ff65c065620 2024-01-22T05:15:59.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff661a00700 1 -- 172.21.15.49:0/679023597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65c0aa510 con 0x7ff65c065620 2024-01-22T05:15:59.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff652000700 1 -- 172.21.15.49:0/679023597 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65401e830 con 0x7ff65c065620 2024-01-22T05:15:59.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.921+0000 7ff661a00700 1 -- 172.21.15.49:0/679023597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c141070 con 0x7ff65c065620 2024-01-22T05:15:59.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.925+0000 7ff661a00700 1 -- 172.21.15.49:0/679023597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65c0bf880 con 0x7ff65c065620 2024-01-22T05:15:59.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.925+0000 7ff652000700 1 -- 172.21.15.49:0/679023597 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff654003040 con 0x7ff65c065620 2024-01-22T05:15:59.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.929+0000 7ff652000700 1 --2- 172.21.15.49:0/679023597 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff63405a540 0x7ff63405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:15:59.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.929+0000 7ff652000700 1 -- 172.21.15.49:0/679023597 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff654075f70 con 0x7ff65c065620 2024-01-22T05:15:59.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.929+0000 7ff65aa00700 1 --2- 172.21.15.49:0/679023597 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff63405a540 0x7ff63405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:15:59.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.929+0000 7ff65aa00700 1 --2- 172.21.15.49:0/679023597 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff63405a540 0x7ff63405ca00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7ff64c009bc0 tx=0x7ff64c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:15:59.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:15:59.933+0000 7ff652000700 1 -- 172.21.15.49:0/679023597 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff6540a4b00 con 0x7ff65c065620 2024-01-22T05:16:00.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.105+0000 7ff661a00700 1 -- 172.21.15.49:0/679023597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff65c047060 con 0x7ff65c065620 2024-01-22T05:16:00.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.105+0000 7ff652000700 1 -- 172.21.15.49:0/679023597 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+17274 (secure 0 0 0) 0x7ff654023030 con 0x7ff65c065620 2024-01-22T05:16:00.106 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:00.107 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":133,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:15:28.343446+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:14:57.007984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-01-22T05:14:57.955380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.3","mappings":[{"from":2,"to":0}]},{"pgid":"19.a","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:16:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.109+0000 7ff661a00700 1 -- 172.21.15.49:0/679023597 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff63405a540 msgr2=0x7ff63405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.109+0000 7ff661a00700 1 --2- 172.21.15.49:0/679023597 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff63405a540 0x7ff63405ca00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7ff64c009bc0 tx=0x7ff64c008040).stop 2024-01-22T05:16:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.109+0000 7ff661a00700 1 -- 172.21.15.49:0/679023597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff65c065620 msgr2=0x7ff65c0a9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:00.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.109+0000 7ff661a00700 1 --2- 172.21.15.49:0/679023597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff65c065620 0x7ff65c0a9330 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7ff65c066be0 tx=0x7ff65c0c2890).stop 2024-01-22T05:16:00.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.109+0000 7ff661a00700 1 -- 172.21.15.49:0/679023597 shutdown_connections 2024-01-22T05:16:00.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.109+0000 7ff661a00700 1 --2- 172.21.15.49:0/679023597 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff63405a540 0x7ff63405ca00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.109+0000 7ff661a00700 1 --2- 172.21.15.49:0/679023597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff65c065620 0x7ff65c0a9330 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.109+0000 7ff661a00700 1 --2- 172.21.15.49:0/679023597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff65c065240 0x7ff65c0a7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.109+0000 7ff661a00700 1 --2- 172.21.15.49:0/679023597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff65c0649e0 0x7ff65c140b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.109+0000 7ff661a00700 1 -- 172.21.15.49:0/679023597 >> 172.21.15.49:0/679023597 conn(0x7ff65c0c87f0 msgr2=0x7ff65c1554b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:00.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.109+0000 7ff661a00700 1 -- 172.21.15.49:0/679023597 shutdown_connections 2024-01-22T05:16:00.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.109+0000 7ff661a00700 1 -- 172.21.15.49:0/679023597 wait complete. 2024-01-22T05:16:00.132 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:16:00.132 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:16:00.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.289+0000 7f87b3400700 1 Processor -- start 2024-01-22T05:16:00.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.289+0000 7f87b3400700 1 -- start start 2024-01-22T05:16:00.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87ac065240 0x7f87ac0644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:00.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87ac065620 0x7f87ac0649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:00.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b3400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f87ac15b9b0 0x7f87ac15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:00.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b3400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac064ed0 con 0x7f87ac065240 2024-01-22T05:16:00.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b3400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac0c2700 con 0x7f87ac15b9b0 2024-01-22T05:16:00.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b3400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0c29a0 con 0x7f87ac065620 2024-01-22T05:16:00.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b0a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87ac065240 0x7f87ac0644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:00.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b0a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87ac065240 0x7f87ac0644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37218/0 (socket says 172.21.15.49:37218) 2024-01-22T05:16:00.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b0a00700 1 -- 172.21.15.49:0/2452235671 learned_addr learned my addr 172.21.15.49:0/2452235671 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:00.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87abe00700 1 --2- 172.21.15.49:0/2452235671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87ac065620 0x7f87ac0649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:00.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b1e00700 1 --2- 172.21.15.49:0/2452235671 >> v2:172.21.15.110:3300/0 conn(0x7f87ac15b9b0 0x7f87ac15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:00.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b0a00700 1 -- 172.21.15.49:0/2452235671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87ac065620 msgr2=0x7f87ac0649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:00.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b0a00700 1 --2- 172.21.15.49:0/2452235671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87ac065620 0x7f87ac0649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b0a00700 1 -- 172.21.15.49:0/2452235671 >> v2:172.21.15.110:3300/0 conn(0x7f87ac15b9b0 msgr2=0x7f87ac15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:00.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b0a00700 1 --2- 172.21.15.49:0/2452235671 >> v2:172.21.15.110:3300/0 conn(0x7f87ac15b9b0 0x7f87ac15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b0a00700 1 -- 172.21.15.49:0/2452235671 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac0c2c80 con 0x7f87ac065240 2024-01-22T05:16:00.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87b0a00700 1 --2- 172.21.15.49:0/2452235671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87ac065240 0x7f87ac0644f0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f87ac0665c0 tx=0x7f879c0090f0).ready entity=mon.0 client_cookie=e1b680e9a2bc79a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:00.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87ab400700 1 -- 172.21.15.49:0/2452235671 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c00f510 con 0x7f87ac065240 2024-01-22T05:16:00.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87ab400700 1 -- 172.21.15.49:0/2452235671 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c00f670 con 0x7f87ac065240 2024-01-22T05:16:00.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.293+0000 7f87ab400700 1 -- 172.21.15.49:0/2452235671 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c00f9f0 con 0x7f87ac065240 2024-01-22T05:16:00.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.297+0000 7f87b3400700 1 -- 172.21.15.49:0/2452235671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87ac065240 msgr2=0x7f87ac0644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:00.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.297+0000 7f87b3400700 1 --2- 172.21.15.49:0/2452235671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87ac065240 0x7f87ac0644f0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f87ac0665c0 tx=0x7f879c0090f0).stop 2024-01-22T05:16:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.297+0000 7f87b3400700 1 -- 172.21.15.49:0/2452235671 shutdown_connections 2024-01-22T05:16:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.297+0000 7f87b3400700 1 --2- 172.21.15.49:0/2452235671 >> v2:172.21.15.110:3300/0 conn(0x7f87ac15b9b0 0x7f87ac15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.297+0000 7f87b3400700 1 --2- 172.21.15.49:0/2452235671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87ac065620 0x7f87ac0649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.297+0000 7f87b3400700 1 --2- 172.21.15.49:0/2452235671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87ac065240 0x7f87ac0644f0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.297+0000 7f87b3400700 1 -- 172.21.15.49:0/2452235671 >> 172.21.15.49:0/2452235671 conn(0x7f87ac0c87f0 msgr2=0x7f87ac0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.297+0000 7f87b3400700 1 -- 172.21.15.49:0/2452235671 shutdown_connections 2024-01-22T05:16:00.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.297+0000 7f87b3400700 1 -- 172.21.15.49:0/2452235671 wait complete. 2024-01-22T05:16:00.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87b3400700 1 Processor -- start 2024-01-22T05:16:00.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87b3400700 1 -- start start 2024-01-22T05:16:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87b3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87ac065240 0x7f87ac169710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87b3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87ac065620 0x7f87ac168570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:00.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87b3400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87ac15b9b0 0x7f87ac0a6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:00.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87b3400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0a7100 con 0x7f87ac065620 2024-01-22T05:16:00.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87b3400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac15a660 con 0x7f87ac15b9b0 2024-01-22T05:16:00.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87b3400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac168bf0 con 0x7f87ac065240 2024-01-22T05:16:00.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87abe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87ac065620 0x7f87ac168570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:00.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87abe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87ac065620 0x7f87ac168570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37222/0 (socket says 172.21.15.49:37222) 2024-01-22T05:16:00.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87abe00700 1 -- 172.21.15.49:0/2280214215 learned_addr learned my addr 172.21.15.49:0/2280214215 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:00.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87b0a00700 1 --2- 172.21.15.49:0/2280214215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87ac065240 0x7f87ac169710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:00.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87b1e00700 1 --2- 172.21.15.49:0/2280214215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87ac15b9b0 0x7f87ac0a6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:00.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87abe00700 1 -- 172.21.15.49:0/2280214215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87ac065240 msgr2=0x7f87ac169710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:00.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87abe00700 1 --2- 172.21.15.49:0/2280214215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87ac065240 0x7f87ac169710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87abe00700 1 -- 172.21.15.49:0/2280214215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87ac15b9b0 msgr2=0x7f87ac0a6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:00.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87abe00700 1 --2- 172.21.15.49:0/2280214215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87ac15b9b0 0x7f87ac0a6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.301+0000 7f87abe00700 1 -- 172.21.15.49:0/2280214215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c009370 con 0x7f87ac065620 2024-01-22T05:16:00.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.305+0000 7f87abe00700 1 --2- 172.21.15.49:0/2280214215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87ac065620 0x7f87ac168570 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f879400e930 tx=0x7f8794009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:00.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.305+0000 7f87a3e00700 1 -- 172.21.15.49:0/2280214215 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794012600 con 0x7f87ac065620 2024-01-22T05:16:00.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.305+0000 7f87a3e00700 1 -- 172.21.15.49:0/2280214215 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8794012760 con 0x7f87ac065620 2024-01-22T05:16:00.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.305+0000 7f87a3e00700 1 -- 172.21.15.49:0/2280214215 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794012ae0 con 0x7f87ac065620 2024-01-22T05:16:00.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.305+0000 7f87b3400700 1 -- 172.21.15.49:0/2280214215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac168ed0 con 0x7f87ac065620 2024-01-22T05:16:00.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.305+0000 7f87b3400700 1 -- 172.21.15.49:0/2280214215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac169490 con 0x7f87ac065620 2024-01-22T05:16:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.305+0000 7f87b3400700 1 -- 172.21.15.49:0/2280214215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac15a430 con 0x7f87ac065620 2024-01-22T05:16:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.309+0000 7f87a3e00700 1 -- 172.21.15.49:0/2280214215 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f879401b400 con 0x7f87ac065620 2024-01-22T05:16:00.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.309+0000 7f87a3e00700 1 --2- 172.21.15.49:0/2280214215 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f878405a560 0x7f878405ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:00.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.309+0000 7f87a3e00700 1 -- 172.21.15.49:0/2280214215 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8794074c90 con 0x7f87ac065620 2024-01-22T05:16:00.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.309+0000 7f87b0a00700 1 --2- 172.21.15.49:0/2280214215 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f878405a560 0x7f878405ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:00.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.309+0000 7f87b0a00700 1 --2- 172.21.15.49:0/2280214215 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f878405a560 0x7f878405ca20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f879c009130 tx=0x7f879c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:00.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.317+0000 7f87a3e00700 1 -- 172.21.15.49:0/2280214215 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8794048310 con 0x7f87ac065620 2024-01-22T05:16:00.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.513+0000 7f87b3400700 1 -- 172.21.15.49:0/2280214215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87ac047060 con 0x7f87ac065620 2024-01-22T05:16:00.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.513+0000 7f87a3e00700 1 -- 172.21.15.49:0/2280214215 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4503 (secure 0 0 0) 0x7f879404b930 con 0x7f87ac065620 2024-01-22T05:16:00.515 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:00.515 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:14:58.925818+0000","modified":"2024-01-22T05:15:02.323695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8292":{"gid":8292,"name":"a","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3036262557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3036262557},{"type":"v1","addr":"172.21.15.49:6837","nonce":3036262557}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-22T05:16:00.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.517+0000 7f87b3400700 1 -- 172.21.15.49:0/2280214215 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f878405a560 msgr2=0x7f878405ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:00.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.517+0000 7f87b3400700 1 --2- 172.21.15.49:0/2280214215 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f878405a560 0x7f878405ca20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f879c009130 tx=0x7f879c017000).stop 2024-01-22T05:16:00.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.517+0000 7f87b3400700 1 -- 172.21.15.49:0/2280214215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87ac065620 msgr2=0x7f87ac168570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:00.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.517+0000 7f87b3400700 1 --2- 172.21.15.49:0/2280214215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87ac065620 0x7f87ac168570 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f879400e930 tx=0x7f8794009060).stop 2024-01-22T05:16:00.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.517+0000 7f87b3400700 1 -- 172.21.15.49:0/2280214215 shutdown_connections 2024-01-22T05:16:00.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.517+0000 7f87b3400700 1 --2- 172.21.15.49:0/2280214215 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f878405a560 0x7f878405ca20 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.517+0000 7f87b3400700 1 --2- 172.21.15.49:0/2280214215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87ac15b9b0 0x7f87ac0a6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.517+0000 7f87b3400700 1 --2- 172.21.15.49:0/2280214215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87ac065620 0x7f87ac168570 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.517+0000 7f87b3400700 1 --2- 172.21.15.49:0/2280214215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87ac065240 0x7f87ac169710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.517+0000 7f87b3400700 1 -- 172.21.15.49:0/2280214215 >> 172.21.15.49:0/2280214215 conn(0x7f87ac0c87f0 msgr2=0x7f87ac155e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:00.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.517+0000 7f87b3400700 1 -- 172.21.15.49:0/2280214215 shutdown_connections 2024-01-22T05:16:00.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.517+0000 7f87b3400700 1 -- 172.21.15.49:0/2280214215 wait complete. 2024-01-22T05:16:00.522 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2024-01-22T05:16:00.542 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:16:00.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.697+0000 7f6762600700 1 Processor -- start 2024-01-22T05:16:00.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.697+0000 7f6762600700 1 -- start start 2024-01-22T05:16:00.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f6762600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f675c0c25e0 0x7f675c0a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:00.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f6762600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675c0c1a40 con 0x7f675c0a8740 2024-01-22T05:16:00.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f6762600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675c0a90b0 con 0x7f675c155d20 2024-01-22T05:16:00.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f6762600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675c159310 con 0x7f675c0c25e0 2024-01-22T05:16:00.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f675aa00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f675c0a8740 0x7f675c0c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44698/0 (socket says 172.21.15.49:44698) 2024-01-22T05:16:00.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f675aa00700 1 -- 172.21.15.49:0/3898979768 learned_addr learned my addr 172.21.15.49:0/3898979768 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:00.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f675be00700 1 --2- 172.21.15.49:0/3898979768 >> v2:172.21.15.110:3300/0 conn(0x7f675c0c25e0 0x7f675c0a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:00.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f675be00700 1 -- 172.21.15.49:0/3898979768 >> v1:172.21.15.110:6789/0 conn(0x7f675c155d20 legacy=0x7f675c065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:00.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f675be00700 1 -- 172.21.15.49:0/3898979768 >> v1:172.21.15.49:6789/0 conn(0x7f675c0a8740 legacy=0x7f675c0c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:00.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f675be00700 1 -- 172.21.15.49:0/3898979768 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c0c13f0 con 0x7f675c0c25e0 2024-01-22T05:16:00.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f675be00700 1 --2- 172.21.15.49:0/3898979768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f675c0c25e0 0x7f675c0a8bc0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f6754009e60 tx=0x7f6754009780).ready entity=mon.1 client_cookie=2d9b6a05362de686 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:00.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f675a000700 1 -- 172.21.15.49:0/3898979768 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675400e070 con 0x7f675c0c25e0 2024-01-22T05:16:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f675a000700 1 -- 172.21.15.49:0/3898979768 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675400bc30 con 0x7f675c0c25e0 2024-01-22T05:16:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f675a000700 1 -- 172.21.15.49:0/3898979768 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754012410 con 0x7f675c0c25e0 2024-01-22T05:16:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f6762600700 1 -- 172.21.15.49:0/3898979768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f675c0c25e0 msgr2=0x7f675c0a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.701+0000 7f6762600700 1 --2- 172.21.15.49:0/3898979768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f675c0c25e0 0x7f675c0a8bc0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f6754009e60 tx=0x7f6754009780).stop 2024-01-22T05:16:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.705+0000 7f6762600700 1 -- 172.21.15.49:0/3898979768 shutdown_connections 2024-01-22T05:16:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.705+0000 7f6762600700 1 --2- 172.21.15.49:0/3898979768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f675c0c25e0 0x7f675c0a8bc0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.705+0000 7f6762600700 1 -- 172.21.15.49:0/3898979768 >> 172.21.15.49:0/3898979768 conn(0x7f675c0c6540 msgr2=0x7f675c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.705+0000 7f6762600700 1 -- 172.21.15.49:0/3898979768 shutdown_connections 2024-01-22T05:16:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.705+0000 7f6762600700 1 -- 172.21.15.49:0/3898979768 wait complete. 2024-01-22T05:16:00.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.705+0000 7f6762600700 1 Processor -- start 2024-01-22T05:16:00.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.705+0000 7f6762600700 1 -- start start 2024-01-22T05:16:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f6762600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f675c0a8740 0x7f675c0bf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f6762600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f675c0c25e0 0x7f675c16c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f6762600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f675c155d20 0x7f675c168060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f6762600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c16ce80 con 0x7f675c155d20 2024-01-22T05:16:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f6762600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0bfb70 con 0x7f675c0c25e0 2024-01-22T05:16:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f6762600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0bfe50 con 0x7f675c0a8740 2024-01-22T05:16:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f675be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f675c155d20 0x7f675c168060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f675be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f675c155d20 0x7f675c168060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37238/0 (socket says 172.21.15.49:37238) 2024-01-22T05:16:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f675be00700 1 -- 172.21.15.49:0/568136441 learned_addr learned my addr 172.21.15.49:0/568136441 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f675aa00700 1 --2- 172.21.15.49:0/568136441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f675c0c25e0 0x7f675c16c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f675b400700 1 --2- 172.21.15.49:0/568136441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f675c0a8740 0x7f675c0bf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f675be00700 1 -- 172.21.15.49:0/568136441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f675c0a8740 msgr2=0x7f675c0bf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f675be00700 1 --2- 172.21.15.49:0/568136441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f675c0a8740 0x7f675c0bf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f675be00700 1 -- 172.21.15.49:0/568136441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f675c0c25e0 msgr2=0x7f675c16c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f675be00700 1 --2- 172.21.15.49:0/568136441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f675c0c25e0 0x7f675c16c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f675be00700 1 -- 172.21.15.49:0/568136441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6754009a20 con 0x7f675c155d20 2024-01-22T05:16:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f675aa00700 1 --2- 172.21.15.49:0/568136441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f675c0c25e0 0x7f675c16c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f675be00700 1 --2- 172.21.15.49:0/568136441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f675c155d20 0x7f675c168060 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f675400b6c0 tx=0x7f6754009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f6752a00700 1 -- 172.21.15.49:0/568136441 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67540065d0 con 0x7f675c155d20 2024-01-22T05:16:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f6752a00700 1 -- 172.21.15.49:0/568136441 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6754006730 con 0x7f675c155d20 2024-01-22T05:16:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f6762600700 1 -- 172.21.15.49:0/568136441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675c0c0130 con 0x7f675c155d20 2024-01-22T05:16:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f6752a00700 1 -- 172.21.15.49:0/568136441 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754006ad0 con 0x7f675c155d20 2024-01-22T05:16:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.709+0000 7f6762600700 1 -- 172.21.15.49:0/568136441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675c0c06f0 con 0x7f675c155d20 2024-01-22T05:16:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.713+0000 7f6762600700 1 -- 172.21.15.49:0/568136441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675c047060 con 0x7f675c155d20 2024-01-22T05:16:00.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.713+0000 7f6752a00700 1 -- 172.21.15.49:0/568136441 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f675401d630 con 0x7f675c155d20 2024-01-22T05:16:00.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.717+0000 7f6752a00700 1 --2- 172.21.15.49:0/568136441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f673405a510 0x7f673405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:00.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.717+0000 7f6752a00700 1 -- 172.21.15.49:0/568136441 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6754076f70 con 0x7f675c155d20 2024-01-22T05:16:00.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.717+0000 7f675b400700 1 --2- 172.21.15.49:0/568136441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f673405a510 0x7f673405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:00.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.717+0000 7f675b400700 1 --2- 172.21.15.49:0/568136441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f673405a510 0x7f673405c9d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f674c003630 tx=0x7f674c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:00.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.721+0000 7f6752a00700 1 -- 172.21.15.49:0/568136441 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f675404a4f0 con 0x7f675c155d20 2024-01-22T05:16:00.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.917+0000 7f6762600700 1 -- 172.21.15.49:0/568136441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f675c0c16d0 con 0x7f675c155d20 2024-01-22T05:16:00.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.917+0000 7f6752a00700 1 -- 172.21.15.49:0/568136441 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4503 (secure 0 0 0) 0x7f675404db10 con 0x7f675c155d20 2024-01-22T05:16:00.919 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:00.919 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:14:58.925818+0000","modified":"2024-01-22T05:15:02.323695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8292":{"gid":8292,"name":"a","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3036262557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3036262557},{"type":"v1","addr":"172.21.15.49:6837","nonce":3036262557}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-22T05:16:00.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.921+0000 7f6762600700 1 -- 172.21.15.49:0/568136441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f673405a510 msgr2=0x7f673405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:00.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.921+0000 7f6762600700 1 --2- 172.21.15.49:0/568136441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f673405a510 0x7f673405c9d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f674c003630 tx=0x7f674c009040).stop 2024-01-22T05:16:00.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.921+0000 7f6762600700 1 -- 172.21.15.49:0/568136441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f675c155d20 msgr2=0x7f675c168060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:00.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.921+0000 7f6762600700 1 --2- 172.21.15.49:0/568136441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f675c155d20 0x7f675c168060 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f675400b6c0 tx=0x7f6754009780).stop 2024-01-22T05:16:00.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.921+0000 7f6762600700 1 -- 172.21.15.49:0/568136441 shutdown_connections 2024-01-22T05:16:00.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.921+0000 7f6762600700 1 --2- 172.21.15.49:0/568136441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f673405a510 0x7f673405c9d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.921+0000 7f6762600700 1 --2- 172.21.15.49:0/568136441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f675c155d20 0x7f675c168060 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.921+0000 7f6762600700 1 --2- 172.21.15.49:0/568136441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f675c0c25e0 0x7f675c16c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.921+0000 7f6762600700 1 --2- 172.21.15.49:0/568136441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f675c0a8740 0x7f675c0bf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:00.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.921+0000 7f6762600700 1 -- 172.21.15.49:0/568136441 >> 172.21.15.49:0/568136441 conn(0x7f675c0c6540 msgr2=0x7f675c1583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:00.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.925+0000 7f6762600700 1 -- 172.21.15.49:0/568136441 shutdown_connections 2024-01-22T05:16:00.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:00.925+0000 7f6762600700 1 -- 172.21.15.49:0/568136441 wait complete. 2024-01-22T05:16:00.927 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2024-01-22T05:16:00.944 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:16:01.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.109+0000 7fb508c00700 1 Processor -- start 2024-01-22T05:16:01.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.109+0000 7fb508c00700 1 -- start start 2024-01-22T05:16:01.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb508c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb504155d20 0x7fb504065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:01.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb508c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb504066070 0x7fb5040a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:01.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb508c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb5040a8c30 0x7fb5040c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:01.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb508c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5040a90e0 con 0x7fb504066070 2024-01-22T05:16:01.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb508c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5040c1a40 con 0x7fb5040a8c30 2024-01-22T05:16:01.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb508c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb504159310 con 0x7fb504155d20 2024-01-22T05:16:01.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb501400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb504066070 0x7fb5040a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:01.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb502800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb5040a8c30 0x7fb5040c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:01.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb501e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb504155d20 0x7fb504065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb501400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb504066070 0x7fb5040a8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37246/0 (socket says 172.21.15.49:37246) 2024-01-22T05:16:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb502800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb5040a8c30 0x7fb5040c1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:43486/0 (socket says 172.21.15.49:43486) 2024-01-22T05:16:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb501400700 1 -- 172.21.15.49:0/1820518090 learned_addr learned my addr 172.21.15.49:0/1820518090 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb502800700 1 -- 172.21.15.49:0/1820518090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb504155d20 msgr2=0x7fb504065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb502800700 1 --2- 172.21.15.49:0/1820518090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb504155d20 0x7fb504065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb502800700 1 -- 172.21.15.49:0/1820518090 >> v2:172.21.15.49:3300/0 conn(0x7fb504066070 msgr2=0x7fb5040a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb502800700 1 --2- 172.21.15.49:0/1820518090 >> v2:172.21.15.49:3300/0 conn(0x7fb504066070 0x7fb5040a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb502800700 1 -- 172.21.15.49:0/1820518090 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040c13f0 con 0x7fb5040a8c30 2024-01-22T05:16:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb502800700 1 --2- 172.21.15.49:0/1820518090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5040a8c30 0x7fb5040c1ed0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fb5040c2fb0 tx=0x7fb4fc009780).ready entity=mon.1 client_cookie=9a28930152f6ac9b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb500a00700 1 -- 172.21.15.49:0/1820518090 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc00e070 con 0x7fb5040a8c30 2024-01-22T05:16:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb500a00700 1 -- 172.21.15.49:0/1820518090 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc00bab0 con 0x7fb5040a8c30 2024-01-22T05:16:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.113+0000 7fb500a00700 1 -- 172.21.15.49:0/1820518090 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc00be30 con 0x7fb5040a8c30 2024-01-22T05:16:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.117+0000 7fb508c00700 1 -- 172.21.15.49:0/1820518090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5040a8c30 msgr2=0x7fb5040c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.117+0000 7fb508c00700 1 --2- 172.21.15.49:0/1820518090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5040a8c30 0x7fb5040c1ed0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fb5040c2fb0 tx=0x7fb4fc009780).stop 2024-01-22T05:16:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.117+0000 7fb508c00700 1 -- 172.21.15.49:0/1820518090 shutdown_connections 2024-01-22T05:16:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.117+0000 7fb508c00700 1 --2- 172.21.15.49:0/1820518090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5040a8c30 0x7fb5040c1ed0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.117+0000 7fb508c00700 1 --2- 172.21.15.49:0/1820518090 >> v2:172.21.15.49:3300/0 conn(0x7fb504066070 0x7fb5040a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.117+0000 7fb508c00700 1 --2- 172.21.15.49:0/1820518090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb504155d20 0x7fb504065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.117+0000 7fb508c00700 1 -- 172.21.15.49:0/1820518090 >> 172.21.15.49:0/1820518090 conn(0x7fb5040c6540 msgr2=0x7fb5040c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.117+0000 7fb508c00700 1 -- 172.21.15.49:0/1820518090 shutdown_connections 2024-01-22T05:16:01.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.117+0000 7fb508c00700 1 -- 172.21.15.49:0/1820518090 wait complete. 2024-01-22T05:16:01.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.121+0000 7fb508c00700 1 Processor -- start 2024-01-22T05:16:01.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.121+0000 7fb508c00700 1 -- start start 2024-01-22T05:16:01.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.121+0000 7fb508c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb504066070 0x7fb504169960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:01.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.121+0000 7fb508c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5040a8c30 0x7fb50416b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:01.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.121+0000 7fb508c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb504155d20 0x7fb5041533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:01.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.121+0000 7fb508c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50415ad90 con 0x7fb504066070 2024-01-22T05:16:01.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.121+0000 7fb508c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50416bba0 con 0x7fb504155d20 2024-01-22T05:16:01.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.121+0000 7fb508c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb504169710 con 0x7fb5040a8c30 2024-01-22T05:16:01.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb501e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb504066070 0x7fb504169960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:01.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb501e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb504066070 0x7fb504169960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37252/0 (socket says 172.21.15.49:37252) 2024-01-22T05:16:01.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb501e00700 1 -- 172.21.15.49:0/2730687443 learned_addr learned my addr 172.21.15.49:0/2730687443 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:01.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb501400700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5040a8c30 0x7fb50416b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:01.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb502800700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb504155d20 0x7fb5041533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:01.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb501e00700 1 -- 172.21.15.49:0/2730687443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5040a8c30 msgr2=0x7fb50416b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:01.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb501e00700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5040a8c30 0x7fb50416b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb501e00700 1 -- 172.21.15.49:0/2730687443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb504155d20 msgr2=0x7fb5041533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:01.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb501e00700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb504155d20 0x7fb5041533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb501e00700 1 -- 172.21.15.49:0/2730687443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc009a20 con 0x7fb504066070 2024-01-22T05:16:01.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb501400700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5040a8c30 0x7fb50416b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:01.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb502800700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb504155d20 0x7fb5041533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:01.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb501e00700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb504066070 0x7fb504169960 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7fb4f400e900 tx=0x7fb4f4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:01.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb4f9600700 1 -- 172.21.15.49:0/2730687443 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40093b0 con 0x7fb504066070 2024-01-22T05:16:01.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb4f9600700 1 -- 172.21.15.49:0/2730687443 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f400c640 con 0x7fb504066070 2024-01-22T05:16:01.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb508c00700 1 -- 172.21.15.49:0/2730687443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5040a9ca0 con 0x7fb504066070 2024-01-22T05:16:01.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb4f9600700 1 -- 172.21.15.49:0/2730687443 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400c9c0 con 0x7fb504066070 2024-01-22T05:16:01.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.125+0000 7fb508c00700 1 -- 172.21.15.49:0/2730687443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5040a9650 con 0x7fb504066070 2024-01-22T05:16:01.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.129+0000 7fb508c00700 1 -- 172.21.15.49:0/2730687443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb504047060 con 0x7fb504066070 2024-01-22T05:16:01.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.129+0000 7fb4f9600700 1 -- 172.21.15.49:0/2730687443 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb4f400cd70 con 0x7fb504066070 2024-01-22T05:16:01.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.129+0000 7fb4f9600700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb4dc05a4e0 0x7fb4dc05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:01.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.129+0000 7fb4f9600700 1 -- 172.21.15.49:0/2730687443 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb4f4074dc0 con 0x7fb504066070 2024-01-22T05:16:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.129+0000 7fb501400700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb4dc05a4e0 0x7fb4dc05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.129+0000 7fb501400700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb4dc05a4e0 0x7fb4dc05c9a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fb4ec006bc0 tx=0x7fb4ec008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:01.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.137+0000 7fb4f9600700 1 -- 172.21.15.49:0/2730687443 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb4f4048340 con 0x7fb504066070 2024-01-22T05:16:01.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.301+0000 7fb508c00700 1 -- 172.21.15.49:0/2730687443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb504159050 con 0x7fb504066070 2024-01-22T05:16:01.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.301+0000 7fb4f9600700 1 -- 172.21.15.49:0/2730687443 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+17274 (secure 0 0 0) 0x7fb4f404b960 con 0x7fb504066070 2024-01-22T05:16:01.303 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:01.303 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":133,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:15:28.343446+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:14:57.007984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-01-22T05:14:57.955380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.3","mappings":[{"from":2,"to":0}]},{"pgid":"19.a","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:16:01.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.305+0000 7fb508c00700 1 -- 172.21.15.49:0/2730687443 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb4dc05a4e0 msgr2=0x7fb4dc05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:01.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.305+0000 7fb508c00700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb4dc05a4e0 0x7fb4dc05c9a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fb4ec006bc0 tx=0x7fb4ec008040).stop 2024-01-22T05:16:01.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.305+0000 7fb508c00700 1 -- 172.21.15.49:0/2730687443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb504066070 msgr2=0x7fb504169960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:01.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.305+0000 7fb508c00700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb504066070 0x7fb504169960 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7fb4f400e900 tx=0x7fb4f4009060).stop 2024-01-22T05:16:01.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.305+0000 7fb508c00700 1 -- 172.21.15.49:0/2730687443 shutdown_connections 2024-01-22T05:16:01.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.305+0000 7fb508c00700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb4dc05a4e0 0x7fb4dc05c9a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.305+0000 7fb508c00700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb504155d20 0x7fb5041533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.305+0000 7fb508c00700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5040a8c30 0x7fb50416b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.305+0000 7fb508c00700 1 --2- 172.21.15.49:0/2730687443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb504066070 0x7fb504169960 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.305+0000 7fb508c00700 1 -- 172.21.15.49:0/2730687443 >> 172.21.15.49:0/2730687443 conn(0x7fb5040c6540 msgr2=0x7fb504067f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:01.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.305+0000 7fb508c00700 1 -- 172.21.15.49:0/2730687443 shutdown_connections 2024-01-22T05:16:01.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.305+0000 7fb508c00700 1 -- 172.21.15.49:0/2730687443 wait complete. 2024-01-22T05:16:01.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:16:01.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.493+0000 7fdae6600700 1 Processor -- start 2024-01-22T05:16:01.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.497+0000 7fdae6600700 1 -- start start 2024-01-22T05:16:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.497+0000 7fdae6600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae0155d20 0x7fdae0065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.497+0000 7fdae6600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdae0066070 0x7fdae00a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.497+0000 7fdae6600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae00a90e0 con 0x7fdae00a8c30 2024-01-22T05:16:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.497+0000 7fdae6600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae00c1a40 con 0x7fdae0066070 2024-01-22T05:16:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.497+0000 7fdae6600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae0159310 con 0x7fdae0155d20 2024-01-22T05:16:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.497+0000 7fdadf400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae0155d20 0x7fdae0065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.497+0000 7fdadf400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae0155d20 0x7fdae0065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:39520/0 (socket says 172.21.15.49:39520) 2024-01-22T05:16:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.497+0000 7fdadf400700 1 -- 172.21.15.49:0/2459908562 learned_addr learned my addr 172.21.15.49:0/2459908562 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.497+0000 7fdadea00700 1 --2- 172.21.15.49:0/2459908562 >> v2:172.21.15.110:3300/0 conn(0x7fdae0066070 0x7fdae00a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdadf400700 1 -- 172.21.15.49:0/2459908562 >> v2:172.21.15.110:3300/0 conn(0x7fdae0066070 msgr2=0x7fdae00a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdadf400700 1 --2- 172.21.15.49:0/2459908562 >> v2:172.21.15.110:3300/0 conn(0x7fdae0066070 0x7fdae00a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdadf400700 1 -- 172.21.15.49:0/2459908562 >> v1:172.21.15.110:6789/0 conn(0x7fdae00a8c30 legacy=0x7fdae00c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdadf400700 1 -- 172.21.15.49:0/2459908562 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae00c13f0 con 0x7fdae0155d20 2024-01-22T05:16:01.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdade000700 1 -- 172.21.15.49:0/2459908562 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941273047 0 0) 0x7fdad8001490 con 0x7fdae00a8c30 2024-01-22T05:16:01.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdadf400700 1 --2- 172.21.15.49:0/2459908562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae0155d20 0x7fdae0065b80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fdad0006fd0 tx=0x7fdad00090f0).ready entity=mon.2 client_cookie=8a3726792ca3634b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:01.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdade000700 1 -- 172.21.15.49:0/2459908562 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad000b580 con 0x7fdae0155d20 2024-01-22T05:16:01.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdade000700 1 -- 172.21.15.49:0/2459908562 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad000b6e0 con 0x7fdae0155d20 2024-01-22T05:16:01.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdade000700 1 -- 172.21.15.49:0/2459908562 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad000ba60 con 0x7fdae0155d20 2024-01-22T05:16:01.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdae6600700 1 -- 172.21.15.49:0/2459908562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae0155d20 msgr2=0x7fdae0065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:01.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdae6600700 1 --2- 172.21.15.49:0/2459908562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae0155d20 0x7fdae0065b80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fdad0006fd0 tx=0x7fdad00090f0).stop 2024-01-22T05:16:01.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdae6600700 1 -- 172.21.15.49:0/2459908562 shutdown_connections 2024-01-22T05:16:01.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdae6600700 1 --2- 172.21.15.49:0/2459908562 >> v2:172.21.15.110:3300/0 conn(0x7fdae0066070 0x7fdae00a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdae6600700 1 --2- 172.21.15.49:0/2459908562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae0155d20 0x7fdae0065b80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdae6600700 1 -- 172.21.15.49:0/2459908562 >> 172.21.15.49:0/2459908562 conn(0x7fdae00c6540 msgr2=0x7fdae00c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:01.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdae6600700 1 -- 172.21.15.49:0/2459908562 shutdown_connections 2024-01-22T05:16:01.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.501+0000 7fdae6600700 1 -- 172.21.15.49:0/2459908562 wait complete. 2024-01-22T05:16:01.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.505+0000 7fdae6600700 1 Processor -- start 2024-01-22T05:16:01.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.505+0000 7fdae6600700 1 -- start start 2024-01-22T05:16:01.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdae6600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae0066070 0x7fdae014d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:01.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdae6600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae00a8c30 0x7fdae0169710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:01.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdae6600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdae0155d20 0x7fdae015bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:01.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdae6600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00be980 con 0x7fdae0155d20 2024-01-22T05:16:01.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdae6600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae014db40 con 0x7fdae00a8c30 2024-01-22T05:16:01.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdae6600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae0169c00 con 0x7fdae0066070 2024-01-22T05:16:01.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdadfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdae0155d20 0x7fdae015bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:01.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdadea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae00a8c30 0x7fdae0169710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:01.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdadf400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae0066070 0x7fdae014d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:01.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdadfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdae0155d20 0x7fdae015bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37256/0 (socket says 172.21.15.49:37256) 2024-01-22T05:16:01.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdadfe00700 1 -- 172.21.15.49:0/2729652756 learned_addr learned my addr 172.21.15.49:0/2729652756 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:01.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdadfe00700 1 -- 172.21.15.49:0/2729652756 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae0066070 msgr2=0x7fdae014d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:01.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdadfe00700 1 --2- 172.21.15.49:0/2729652756 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae0066070 0x7fdae014d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdadfe00700 1 -- 172.21.15.49:0/2729652756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae00a8c30 msgr2=0x7fdae0169710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:01.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdadfe00700 1 --2- 172.21.15.49:0/2729652756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae00a8c30 0x7fdae0169710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:01.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdadfe00700 1 -- 172.21.15.49:0/2729652756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad0009370 con 0x7fdae0155d20 2024-01-22T05:16:01.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdadfe00700 1 --2- 172.21.15.49:0/2729652756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdae0155d20 0x7fdae015bd70 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7fdad800c7c0 tx=0x7fdad8007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:01.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdad6a00700 1 -- 172.21.15.49:0/2729652756 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8010510 con 0x7fdae0155d20 2024-01-22T05:16:01.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdad6a00700 1 -- 172.21.15.49:0/2729652756 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad8010670 con 0x7fdae0155d20 2024-01-22T05:16:01.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdae6600700 1 -- 172.21.15.49:0/2729652756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae00bdd70 con 0x7fdae0155d20 2024-01-22T05:16:01.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.509+0000 7fdad6a00700 1 -- 172.21.15.49:0/2729652756 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad80109f0 con 0x7fdae0155d20 2024-01-22T05:16:01.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.513+0000 7fdae6600700 1 -- 172.21.15.49:0/2729652756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae00be330 con 0x7fdae0155d20 2024-01-22T05:16:01.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.513+0000 7fdae6600700 1 -- 172.21.15.49:0/2729652756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae0159f20 con 0x7fdae0155d20 2024-01-22T05:16:01.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.513+0000 7fdad6a00700 1 -- 172.21.15.49:0/2729652756 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdad801b400 con 0x7fdae0155d20 2024-01-22T05:16:01.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.513+0000 7fdad6a00700 1 --2- 172.21.15.49:0/2729652756 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdab805a4e0 0x7fdab805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:01.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.517+0000 7fdad6a00700 1 -- 172.21.15.49:0/2729652756 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fdad80744d0 con 0x7fdae0155d20 2024-01-22T05:16:01.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.517+0000 7fdadf400700 1 --2- 172.21.15.49:0/2729652756 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdab805a4e0 0x7fdab805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:01.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.517+0000 7fdadf400700 1 --2- 172.21.15.49:0/2729652756 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdab805a4e0 0x7fdab805c9a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fdad0009130 tx=0x7fdad0017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:01.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.521+0000 7fdad6a00700 1 -- 172.21.15.49:0/2729652756 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdad8047ab0 con 0x7fdae0155d20 2024-01-22T05:16:01.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:01.721+0000 7fdae6600700 1 -- 172.21.15.49:0/2729652756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdae00a90e0 con 0x7fdae0155d20 2024-01-22T05:16:02.546 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:16:02.545+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:16:02.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.557+0000 7fdad6a00700 1 -- 172.21.15.49:0/2729652756 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v107) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdae00a90e0 con 0x7fdae0155d20 2024-01-22T05:16:02.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.565+0000 7fdae6600700 1 -- 172.21.15.49:0/2729652756 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdab805a4e0 msgr2=0x7fdab805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:02.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.565+0000 7fdae6600700 1 --2- 172.21.15.49:0/2729652756 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdab805a4e0 0x7fdab805c9a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fdad0009130 tx=0x7fdad0017000).stop 2024-01-22T05:16:02.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.565+0000 7fdae6600700 1 -- 172.21.15.49:0/2729652756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdae0155d20 msgr2=0x7fdae015bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:02.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.565+0000 7fdae6600700 1 --2- 172.21.15.49:0/2729652756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdae0155d20 0x7fdae015bd70 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7fdad800c7c0 tx=0x7fdad8007de0).stop 2024-01-22T05:16:02.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.565+0000 7fdae6600700 1 -- 172.21.15.49:0/2729652756 shutdown_connections 2024-01-22T05:16:02.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.565+0000 7fdae6600700 1 --2- 172.21.15.49:0/2729652756 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdab805a4e0 0x7fdab805c9a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:02.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.565+0000 7fdae6600700 1 --2- 172.21.15.49:0/2729652756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdae0155d20 0x7fdae015bd70 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:02.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.565+0000 7fdae6600700 1 --2- 172.21.15.49:0/2729652756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae00a8c30 0x7fdae0169710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:02.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.565+0000 7fdae6600700 1 --2- 172.21.15.49:0/2729652756 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae0066070 0x7fdae014d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:02.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.565+0000 7fdae6600700 1 -- 172.21.15.49:0/2729652756 >> 172.21.15.49:0/2729652756 conn(0x7fdae00c6540 msgr2=0x7fdae0067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:02.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.565+0000 7fdae6600700 1 -- 172.21.15.49:0/2729652756 shutdown_connections 2024-01-22T05:16:02.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.565+0000 7fdae6600700 1 -- 172.21.15.49:0/2729652756 wait complete. 2024-01-22T05:16:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:16:02.588 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:16:02.631 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:16:02.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.745+0000 7fa31ae00700 1 Processor -- start 2024-01-22T05:16:02.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.745+0000 7fa31ae00700 1 -- start start 2024-01-22T05:16:02.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa31ae00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa3141581e0 0x7fa3140c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:02.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa31ae00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3140c13d0 0x7fa3140a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:02.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa31ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3140a8c30 0x7fa31415bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:02.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa31ae00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3140a90c0 con 0x7fa3140c13d0 2024-01-22T05:16:02.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa31ae00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa314065bd0 con 0x7fa3141581e0 2024-01-22T05:16:02.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa31ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140c18c0 con 0x7fa3140a8c30 2024-01-22T05:16:02.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa319000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3140c13d0 0x7fa3140a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:02.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa319000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa3140c13d0 0x7fa3140a8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37286/0 (socket says 172.21.15.49:37286) 2024-01-22T05:16:02.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa319000700 1 -- 172.21.15.49:0/1500449033 learned_addr learned my addr 172.21.15.49:0/1500449033 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:02.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa319a00700 1 --2- 172.21.15.49:0/1500449033 >> v2:172.21.15.110:3300/0 conn(0x7fa3141581e0 0x7fa3140c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:02.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa31a400700 1 --2- 172.21.15.49:0/1500449033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3140a8c30 0x7fa31415bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:02.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa319000700 1 -- 172.21.15.49:0/1500449033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3140a8c30 msgr2=0x7fa31415bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa319000700 1 --2- 172.21.15.49:0/1500449033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3140a8c30 0x7fa31415bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa319000700 1 -- 172.21.15.49:0/1500449033 >> v2:172.21.15.110:3300/0 conn(0x7fa3141581e0 msgr2=0x7fa3140c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa319000700 1 --2- 172.21.15.49:0/1500449033 >> v2:172.21.15.110:3300/0 conn(0x7fa3141581e0 0x7fa3140c0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa319000700 1 -- 172.21.15.49:0/1500449033 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3140c1ba0 con 0x7fa3140c13d0 2024-01-22T05:16:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa319000700 1 --2- 172.21.15.49:0/1500449033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3140c13d0 0x7fa3140a8740 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fa31405f4a0 tx=0x7fa2fc0090f0).ready entity=mon.0 client_cookie=f54351ae5845b5a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa313e00700 1 -- 172.21.15.49:0/1500449033 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc00f510 con 0x7fa3140c13d0 2024-01-22T05:16:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa313e00700 1 -- 172.21.15.49:0/1500449033 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc00f670 con 0x7fa3140c13d0 2024-01-22T05:16:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.749+0000 7fa313e00700 1 -- 172.21.15.49:0/1500449033 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc00fa10 con 0x7fa3140c13d0 2024-01-22T05:16:02.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.753+0000 7fa31ae00700 1 -- 172.21.15.49:0/1500449033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3140c13d0 msgr2=0x7fa3140a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:02.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.753+0000 7fa31ae00700 1 --2- 172.21.15.49:0/1500449033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3140c13d0 0x7fa3140a8740 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fa31405f4a0 tx=0x7fa2fc0090f0).stop 2024-01-22T05:16:02.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.753+0000 7fa31ae00700 1 -- 172.21.15.49:0/1500449033 shutdown_connections 2024-01-22T05:16:02.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.753+0000 7fa31ae00700 1 --2- 172.21.15.49:0/1500449033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3140a8c30 0x7fa31415bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:02.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.753+0000 7fa31ae00700 1 --2- 172.21.15.49:0/1500449033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3140c13d0 0x7fa3140a8740 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:02.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.753+0000 7fa31ae00700 1 --2- 172.21.15.49:0/1500449033 >> v2:172.21.15.110:3300/0 conn(0x7fa3141581e0 0x7fa3140c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:02.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.753+0000 7fa31ae00700 1 -- 172.21.15.49:0/1500449033 >> 172.21.15.49:0/1500449033 conn(0x7fa3140c6540 msgr2=0x7fa3140c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:02.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.753+0000 7fa31ae00700 1 -- 172.21.15.49:0/1500449033 shutdown_connections 2024-01-22T05:16:02.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.753+0000 7fa31ae00700 1 -- 172.21.15.49:0/1500449033 wait complete. 2024-01-22T05:16:02.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.753+0000 7fa31ae00700 1 Processor -- start 2024-01-22T05:16:02.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa31ae00700 1 -- start start 2024-01-22T05:16:02.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa31ae00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3140a8c30 0x7fa314153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:02.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa31ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3140c13d0 0x7fa3140bf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:02.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa31ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3141581e0 0x7fa3140bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:02.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa31ae00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140c0110 con 0x7fa3140a8c30 2024-01-22T05:16:02.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa31ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa314153a90 con 0x7fa3140c13d0 2024-01-22T05:16:02.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa31ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa314169a20 con 0x7fa3141581e0 2024-01-22T05:16:02.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa319a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3140a8c30 0x7fa314153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:02.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa319a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3140a8c30 0x7fa314153160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37300/0 (socket says 172.21.15.49:37300) 2024-01-22T05:16:02.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa319a00700 1 -- 172.21.15.49:0/1644431275 learned_addr learned my addr 172.21.15.49:0/1644431275 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:02.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa319000700 1 --2- 172.21.15.49:0/1644431275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3140c13d0 0x7fa3140bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:02.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa31a400700 1 --2- 172.21.15.49:0/1644431275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3141581e0 0x7fa3140bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:02.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa319a00700 1 -- 172.21.15.49:0/1644431275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3141581e0 msgr2=0x7fa3140bfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:02.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa319a00700 1 --2- 172.21.15.49:0/1644431275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3141581e0 0x7fa3140bfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:02.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa319a00700 1 -- 172.21.15.49:0/1644431275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3140c13d0 msgr2=0x7fa3140bf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:02.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa319a00700 1 --2- 172.21.15.49:0/1644431275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3140c13d0 0x7fa3140bf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:02.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa319a00700 1 -- 172.21.15.49:0/1644431275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc009370 con 0x7fa3140a8c30 2024-01-22T05:16:02.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa319a00700 1 --2- 172.21.15.49:0/1644431275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3140a8c30 0x7fa314153160 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fa30400e900 tx=0x7fa304009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:02.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa310c00700 1 -- 172.21.15.49:0/1644431275 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304012600 con 0x7fa3140a8c30 2024-01-22T05:16:02.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa310c00700 1 -- 172.21.15.49:0/1644431275 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa304012760 con 0x7fa3140a8c30 2024-01-22T05:16:02.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.757+0000 7fa31ae00700 1 -- 172.21.15.49:0/1644431275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa314169740 con 0x7fa3140a8c30 2024-01-22T05:16:02.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.761+0000 7fa310c00700 1 -- 172.21.15.49:0/1644431275 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304012ae0 con 0x7fa3140a8c30 2024-01-22T05:16:02.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.761+0000 7fa31ae00700 1 -- 172.21.15.49:0/1644431275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3141589d0 con 0x7fa3140a8c30 2024-01-22T05:16:02.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.761+0000 7fa31ae00700 1 -- 172.21.15.49:0/1644431275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa314047060 con 0x7fa3140a8c30 2024-01-22T05:16:02.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.761+0000 7fa310c00700 1 -- 172.21.15.49:0/1644431275 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa30401b400 con 0x7fa3140a8c30 2024-01-22T05:16:02.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.765+0000 7fa310c00700 1 --2- 172.21.15.49:0/1644431275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa2ec05a510 0x7fa2ec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:02.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.765+0000 7fa310c00700 1 -- 172.21.15.49:0/1644431275 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fa304074cf0 con 0x7fa3140a8c30 2024-01-22T05:16:02.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.765+0000 7fa319000700 1 --2- 172.21.15.49:0/1644431275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa2ec05a510 0x7fa2ec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:02.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.765+0000 7fa319000700 1 --2- 172.21.15.49:0/1644431275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa2ec05a510 0x7fa2ec05c9d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fa3140c17f0 tx=0x7fa2fc016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:02.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.769+0000 7fa310c00700 1 -- 172.21.15.49:0/1644431275 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa3040481c0 con 0x7fa3140a8c30 2024-01-22T05:16:02.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:02.973+0000 7fa31ae00700 1 -- 172.21.15.49:0/1644431275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa3140bc2a0 con 0x7fa3140a8c30 2024-01-22T05:16:03.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.565+0000 7fa310c00700 1 -- 172.21.15.49:0/1644431275 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v108) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa30404b7e0 con 0x7fa3140a8c30 2024-01-22T05:16:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.569+0000 7fa31ae00700 1 -- 172.21.15.49:0/1644431275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa2ec05a510 msgr2=0x7fa2ec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.569+0000 7fa31ae00700 1 --2- 172.21.15.49:0/1644431275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa2ec05a510 0x7fa2ec05c9d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fa3140c17f0 tx=0x7fa2fc016000).stop 2024-01-22T05:16:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.569+0000 7fa31ae00700 1 -- 172.21.15.49:0/1644431275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3140a8c30 msgr2=0x7fa314153160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.569+0000 7fa31ae00700 1 --2- 172.21.15.49:0/1644431275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3140a8c30 0x7fa314153160 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fa30400e900 tx=0x7fa304009060).stop 2024-01-22T05:16:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.569+0000 7fa31ae00700 1 -- 172.21.15.49:0/1644431275 shutdown_connections 2024-01-22T05:16:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.569+0000 7fa31ae00700 1 --2- 172.21.15.49:0/1644431275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa2ec05a510 0x7fa2ec05c9d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.569+0000 7fa31ae00700 1 --2- 172.21.15.49:0/1644431275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3141581e0 0x7fa3140bfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.569+0000 7fa31ae00700 1 --2- 172.21.15.49:0/1644431275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3140c13d0 0x7fa3140bf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.569+0000 7fa31ae00700 1 --2- 172.21.15.49:0/1644431275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3140a8c30 0x7fa314153160 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.569+0000 7fa31ae00700 1 -- 172.21.15.49:0/1644431275 >> 172.21.15.49:0/1644431275 conn(0x7fa3140c6540 msgr2=0x7fa3140c53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.569+0000 7fa31ae00700 1 -- 172.21.15.49:0/1644431275 shutdown_connections 2024-01-22T05:16:03.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.569+0000 7fa31ae00700 1 -- 172.21.15.49:0/1644431275 wait complete. 2024-01-22T05:16:03.589 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:16:03.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.801+0000 7f4577e00700 1 Processor -- start 2024-01-22T05:16:03.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.801+0000 7f4577e00700 1 -- start start 2024-01-22T05:16:03.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.805+0000 7f4577e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45780bc640 0x7f45781539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:03.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.805+0000 7f4577e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4578153ee0 0x7f45781577a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:03.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.805+0000 7f4577e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4578157c90 0x7f45780c1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:03.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.805+0000 7f4577e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4578068460 con 0x7f4578157c90 2024-01-22T05:16:03.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.805+0000 7f4577e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4578068c90 con 0x7f4578153ee0 2024-01-22T05:16:03.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.805+0000 7f4577e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45780bcbb0 con 0x7f45780bc640 2024-01-22T05:16:03.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.805+0000 7f4577400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4578157c90 0x7f45780c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:03.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4577400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4578157c90 0x7f45780c1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45624/0 (socket says 172.21.15.49:45624) 2024-01-22T05:16:03.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4577400700 1 -- 172.21.15.49:0/1728404771 learned_addr learned my addr 172.21.15.49:0/1728404771 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:03.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4576000700 1 --2- 172.21.15.49:0/1728404771 >> v2:172.21.15.110:3300/0 conn(0x7f4578153ee0 0x7f45781577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:03.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4576a00700 1 --2- 172.21.15.49:0/1728404771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45780bc640 0x7f45781539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:03.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4577400700 1 -- 172.21.15.49:0/1728404771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45780bc640 msgr2=0x7f45781539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:03.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4577400700 1 --2- 172.21.15.49:0/1728404771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45780bc640 0x7f45781539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4577400700 1 -- 172.21.15.49:0/1728404771 >> v2:172.21.15.110:3300/0 conn(0x7f4578153ee0 msgr2=0x7f45781577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4577400700 1 --2- 172.21.15.49:0/1728404771 >> v2:172.21.15.110:3300/0 conn(0x7f4578153ee0 0x7f45781577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4577400700 1 -- 172.21.15.49:0/1728404771 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45780bce90 con 0x7f4578157c90 2024-01-22T05:16:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4577400700 1 --2- 172.21.15.49:0/1728404771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4578157c90 0x7f45780c1930 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f45780657a0 tx=0x7f4570009840).ready entity=mon.0 client_cookie=dfad4966d4aa62b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4575600700 1 -- 172.21.15.49:0/1728404771 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000e070 con 0x7f4578157c90 2024-01-22T05:16:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4575600700 1 -- 172.21.15.49:0/1728404771 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457000b970 con 0x7f4578157c90 2024-01-22T05:16:03.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4575600700 1 -- 172.21.15.49:0/1728404771 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000bcf0 con 0x7f4578157c90 2024-01-22T05:16:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4577e00700 1 -- 172.21.15.49:0/1728404771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4578157c90 msgr2=0x7f45780c1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4577e00700 1 --2- 172.21.15.49:0/1728404771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4578157c90 0x7f45780c1930 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f45780657a0 tx=0x7f4570009840).stop 2024-01-22T05:16:03.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4577e00700 1 -- 172.21.15.49:0/1728404771 shutdown_connections 2024-01-22T05:16:03.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4577e00700 1 --2- 172.21.15.49:0/1728404771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4578157c90 0x7f45780c1930 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:03.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4577e00700 1 --2- 172.21.15.49:0/1728404771 >> v2:172.21.15.110:3300/0 conn(0x7f4578153ee0 0x7f45781577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:03.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4577e00700 1 --2- 172.21.15.49:0/1728404771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45780bc640 0x7f45781539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:03.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.809+0000 7f4577e00700 1 -- 172.21.15.49:0/1728404771 >> 172.21.15.49:0/1728404771 conn(0x7f45780c3880 msgr2=0x7f45780c3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:03.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.813+0000 7f4577e00700 1 -- 172.21.15.49:0/1728404771 shutdown_connections 2024-01-22T05:16:03.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.813+0000 7f4577e00700 1 -- 172.21.15.49:0/1728404771 wait complete. 2024-01-22T05:16:03.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.813+0000 7f4577e00700 1 Processor -- start 2024-01-22T05:16:03.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.813+0000 7f4577e00700 1 -- start start 2024-01-22T05:16:03.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45780bc640 0x7f4578145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:03.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4578153ee0 0x7f45780ab300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:03.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4578157c90 0x7f45780ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:03.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45780abce0 con 0x7f4578157c90 2024-01-22T05:16:03.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45780acaf0 con 0x7f4578153ee0 2024-01-22T05:16:03.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4578154ea0 con 0x7f45780bc640 2024-01-22T05:16:03.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4578157c90 0x7f45780ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:03.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4578157c90 0x7f45780ab7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45636/0 (socket says 172.21.15.49:45636) 2024-01-22T05:16:03.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577400700 1 -- 172.21.15.49:0/1209525249 learned_addr learned my addr 172.21.15.49:0/1209525249 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:03.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4576a00700 1 --2- 172.21.15.49:0/1209525249 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45780bc640 0x7f4578145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:03.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4576000700 1 --2- 172.21.15.49:0/1209525249 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4578153ee0 0x7f45780ab300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:03.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577400700 1 -- 172.21.15.49:0/1209525249 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45780bc640 msgr2=0x7f4578145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:03.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577400700 1 --2- 172.21.15.49:0/1209525249 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45780bc640 0x7f4578145e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:03.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577400700 1 -- 172.21.15.49:0/1209525249 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4578153ee0 msgr2=0x7f45780ab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:03.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577400700 1 --2- 172.21.15.49:0/1209525249 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4578153ee0 0x7f45780ab300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:03.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577400700 1 -- 172.21.15.49:0/1209525249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4570009ae0 con 0x7f4578157c90 2024-01-22T05:16:03.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577400700 1 --2- 172.21.15.49:0/1209525249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4578157c90 0x7f45780ab7f0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f457000b610 tx=0x7f4570009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:03.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f456e000700 1 -- 172.21.15.49:0/1209525249 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000bee0 con 0x7f4578157c90 2024-01-22T05:16:03.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f456e000700 1 -- 172.21.15.49:0/1209525249 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4570013e60 con 0x7f4578157c90 2024-01-22T05:16:03.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f4577e00700 1 -- 172.21.15.49:0/1209525249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45780abee0 con 0x7f4578157c90 2024-01-22T05:16:03.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.817+0000 7f456e000700 1 -- 172.21.15.49:0/1209525249 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4570007860 con 0x7f4578157c90 2024-01-22T05:16:03.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.821+0000 7f4577e00700 1 -- 172.21.15.49:0/1209525249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45780ac4a0 con 0x7f4578157c90 2024-01-22T05:16:03.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.821+0000 7f4577e00700 1 -- 172.21.15.49:0/1209525249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45780acca0 con 0x7f4578157c90 2024-01-22T05:16:03.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.821+0000 7f456e000700 1 -- 172.21.15.49:0/1209525249 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4570003040 con 0x7f4578157c90 2024-01-22T05:16:03.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.825+0000 7f456e000700 1 --2- 172.21.15.49:0/1209525249 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f455005a4e0 0x7f455005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:03.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.825+0000 7f456e000700 1 -- 172.21.15.49:0/1209525249 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f45700760d0 con 0x7f4578157c90 2024-01-22T05:16:03.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.825+0000 7f4576a00700 1 --2- 172.21.15.49:0/1209525249 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f455005a4e0 0x7f455005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:03.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.825+0000 7f4576a00700 1 --2- 172.21.15.49:0/1209525249 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f455005a4e0 0x7f455005c9a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f4568009c30 tx=0x7f4568009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:03.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.829+0000 7f456e000700 1 -- 172.21.15.49:0/1209525249 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f45780acca0 con 0x7f4578157c90 2024-01-22T05:16:03.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:03.993+0000 7f4577e00700 1 -- 172.21.15.49:0/1209525249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f45780acca0 con 0x7f4578157c90 2024-01-22T05:16:04.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.573+0000 7f456e000700 1 -- 172.21.15.49:0/1209525249 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v135) v1 ==== 181+0+0 (secure 0 0 0) 0x7f45780acca0 con 0x7f4578157c90 2024-01-22T05:16:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.577+0000 7f4577e00700 1 -- 172.21.15.49:0/1209525249 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f455005a4e0 msgr2=0x7f455005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:04.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.577+0000 7f4577e00700 1 --2- 172.21.15.49:0/1209525249 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f455005a4e0 0x7f455005c9a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f4568009c30 tx=0x7f4568009060).stop 2024-01-22T05:16:04.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.577+0000 7f4577e00700 1 -- 172.21.15.49:0/1209525249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4578157c90 msgr2=0x7f45780ab7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:04.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.577+0000 7f4577e00700 1 --2- 172.21.15.49:0/1209525249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4578157c90 0x7f45780ab7f0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f457000b610 tx=0x7f4570009840).stop 2024-01-22T05:16:04.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.581+0000 7f4577e00700 1 -- 172.21.15.49:0/1209525249 shutdown_connections 2024-01-22T05:16:04.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.581+0000 7f4577e00700 1 --2- 172.21.15.49:0/1209525249 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f455005a4e0 0x7f455005c9a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:04.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.581+0000 7f4577e00700 1 --2- 172.21.15.49:0/1209525249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4578157c90 0x7f45780ab7f0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:04.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.581+0000 7f4577e00700 1 --2- 172.21.15.49:0/1209525249 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4578153ee0 0x7f45780ab300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:04.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.581+0000 7f4577e00700 1 --2- 172.21.15.49:0/1209525249 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45780bc640 0x7f4578145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:04.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.581+0000 7f4577e00700 1 -- 172.21.15.49:0/1209525249 >> 172.21.15.49:0/1209525249 conn(0x7f45780c3880 msgr2=0x7f45780c5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:04.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.581+0000 7f4577e00700 1 -- 172.21.15.49:0/1209525249 shutdown_connections 2024-01-22T05:16:04.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.581+0000 7f4577e00700 1 -- 172.21.15.49:0/1209525249 wait complete. 2024-01-22T05:16:04.583 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:16:04.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:16:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.781+0000 7f12b8600700 1 Processor -- start 2024-01-22T05:16:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.781+0000 7f12b8600700 1 -- start start 2024-01-22T05:16:04.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.785+0000 7f12b8600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b0066690 0x7f12b0066af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:04.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.785+0000 7f12b8600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f12b015fbc0 0x7f12b0161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:04.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.785+0000 7f12b8600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b00a7cb0 con 0x7f12b00ac3b0 2024-01-22T05:16:04.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.785+0000 7f12b8600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b00a8b10 con 0x7f12b015fbc0 2024-01-22T05:16:04.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.785+0000 7f12b8600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b00a7f00 con 0x7f12b0066690 2024-01-22T05:16:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.785+0000 7f12b6600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f12b015fbc0 0x7f12b0161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.785+0000 7f12b6600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f12b015fbc0 0x7f12b0161fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45650/0 (socket says 172.21.15.49:45650) 2024-01-22T05:16:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.785+0000 7f12b6600700 1 -- 172.21.15.49:0/232366470 learned_addr learned my addr 172.21.15.49:0/232366470 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.785+0000 7f12b5200700 1 --2- 172.21.15.49:0/232366470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b0066690 0x7f12b0066af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.785+0000 7f12b5c00700 1 --1- 172.21.15.49:0/232366470 >> v1:172.21.15.110:6789/0 conn(0x7f12b00ac3b0 0x7f12b0159000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:49308/0 (socket says 172.21.15.49:49308) 2024-01-22T05:16:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.785+0000 7f12b6600700 1 -- 172.21.15.49:0/232366470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b0066690 msgr2=0x7f12b0066af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:04.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.785+0000 7f12b6600700 1 --2- 172.21.15.49:0/232366470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b0066690 0x7f12b0066af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:04.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.785+0000 7f12b6600700 1 -- 172.21.15.49:0/232366470 >> v1:172.21.15.110:6789/0 conn(0x7f12b00ac3b0 legacy=0x7f12b0159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:04.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.785+0000 7f12b6600700 1 -- 172.21.15.49:0/232366470 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b00a81e0 con 0x7f12b015fbc0 2024-01-22T05:16:04.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.789+0000 7f12b6600700 1 --2- 172.21.15.49:0/232366470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b015fbc0 0x7f12b0161fb0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f12a8009f20 tx=0x7f12a8009840).ready entity=mon.0 client_cookie=5c40e9b3625bcd9d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:04.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.789+0000 7f12afe00700 1 -- 172.21.15.49:0/232366470 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a800e070 con 0x7f12b015fbc0 2024-01-22T05:16:04.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.789+0000 7f12afe00700 1 -- 172.21.15.49:0/232366470 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a800b9d0 con 0x7f12b015fbc0 2024-01-22T05:16:04.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.789+0000 7f12afe00700 1 -- 172.21.15.49:0/232366470 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a800bd50 con 0x7f12b015fbc0 2024-01-22T05:16:04.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.789+0000 7f12b8600700 1 -- 172.21.15.49:0/232366470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b015fbc0 msgr2=0x7f12b0161fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:04.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.789+0000 7f12b8600700 1 --2- 172.21.15.49:0/232366470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b015fbc0 0x7f12b0161fb0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f12a8009f20 tx=0x7f12a8009840).stop 2024-01-22T05:16:04.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.789+0000 7f12b8600700 1 -- 172.21.15.49:0/232366470 shutdown_connections 2024-01-22T05:16:04.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.789+0000 7f12b8600700 1 --2- 172.21.15.49:0/232366470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b015fbc0 0x7f12b0161fb0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:04.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.789+0000 7f12b8600700 1 --2- 172.21.15.49:0/232366470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b0066690 0x7f12b0066af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:04.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.789+0000 7f12b8600700 1 -- 172.21.15.49:0/232366470 >> 172.21.15.49:0/232366470 conn(0x7f12b00c6500 msgr2=0x7f12b00c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:04.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.789+0000 7f12b8600700 1 -- 172.21.15.49:0/232366470 shutdown_connections 2024-01-22T05:16:04.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.789+0000 7f12b8600700 1 -- 172.21.15.49:0/232366470 wait complete. 2024-01-22T05:16:04.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.793+0000 7f12b8600700 1 Processor -- start 2024-01-22T05:16:04.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.793+0000 7f12b8600700 1 -- start start 2024-01-22T05:16:04.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.793+0000 7f12b8600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b0066690 0x7f12b015f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:04.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.793+0000 7f12b8600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b00ac3b0 0x7f12b00c1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:04.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.793+0000 7f12b8600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12b015fbc0 0x7f12b00c1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:04.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.793+0000 7f12b8600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b015fa80 con 0x7f12b00ac3b0 2024-01-22T05:16:04.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.793+0000 7f12b8600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b00c1a30 con 0x7f12b015fbc0 2024-01-22T05:16:04.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.793+0000 7f12b8600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b01689c0 con 0x7f12b0066690 2024-01-22T05:16:04.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12b5200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b00ac3b0 0x7f12b00c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:04.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12b5200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b00ac3b0 0x7f12b00c1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45662/0 (socket says 172.21.15.49:45662) 2024-01-22T05:16:04.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12b5200700 1 -- 172.21.15.49:0/1880378131 learned_addr learned my addr 172.21.15.49:0/1880378131 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:04.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12b5c00700 1 --2- 172.21.15.49:0/1880378131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b0066690 0x7f12b015f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:04.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12b6600700 1 --2- 172.21.15.49:0/1880378131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12b015fbc0 0x7f12b00c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:04.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12b5200700 1 -- 172.21.15.49:0/1880378131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b0066690 msgr2=0x7f12b015f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:04.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12b5200700 1 --2- 172.21.15.49:0/1880378131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b0066690 0x7f12b015f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:04.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12b5200700 1 -- 172.21.15.49:0/1880378131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12b015fbc0 msgr2=0x7f12b00c1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:04.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12b5200700 1 --2- 172.21.15.49:0/1880378131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12b015fbc0 0x7f12b00c1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:04.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12b5200700 1 -- 172.21.15.49:0/1880378131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a8009ae0 con 0x7f12b00ac3b0 2024-01-22T05:16:04.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12b5200700 1 --2- 172.21.15.49:0/1880378131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b00ac3b0 0x7f12b00c1050 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f129800e960 tx=0x7f1298009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:04.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12acc00700 1 -- 172.21.15.49:0/1880378131 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298012600 con 0x7f12b00ac3b0 2024-01-22T05:16:04.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12acc00700 1 -- 172.21.15.49:0/1880378131 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1298012760 con 0x7f12b00ac3b0 2024-01-22T05:16:04.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12acc00700 1 -- 172.21.15.49:0/1880378131 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298012ae0 con 0x7f12b00ac3b0 2024-01-22T05:16:04.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12b8600700 1 -- 172.21.15.49:0/1880378131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b015dc00 con 0x7f12b00ac3b0 2024-01-22T05:16:04.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.797+0000 7f12b8600700 1 -- 172.21.15.49:0/1880378131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b015e1c0 con 0x7f12b00ac3b0 2024-01-22T05:16:04.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.801+0000 7f12b8600700 1 -- 172.21.15.49:0/1880378131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b00c0ba0 con 0x7f12b00ac3b0 2024-01-22T05:16:04.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.801+0000 7f12acc00700 1 -- 172.21.15.49:0/1880378131 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f129801b400 con 0x7f12b00ac3b0 2024-01-22T05:16:04.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.801+0000 7f12acc00700 1 --2- 172.21.15.49:0/1880378131 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f128805a510 0x7f128805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:04.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.801+0000 7f12acc00700 1 -- 172.21.15.49:0/1880378131 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f1298074c30 con 0x7f12b00ac3b0 2024-01-22T05:16:04.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.801+0000 7f12b5c00700 1 --2- 172.21.15.49:0/1880378131 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f128805a510 0x7f128805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:04.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.805+0000 7f12b5c00700 1 --2- 172.21.15.49:0/1880378131 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f128805a510 0x7f128805c9d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f12a0007fd0 tx=0x7f12a0007d30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:04.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.809+0000 7f12acc00700 1 -- 172.21.15.49:0/1880378131 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1298048370 con 0x7f12b00ac3b0 2024-01-22T05:16:04.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:04.969+0000 7f12b8600700 1 -- 172.21.15.49:0/1880378131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f12b00ac190 con 0x7f12b00ac3b0 2024-01-22T05:16:05.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.585+0000 7f12acc00700 1 -- 172.21.15.49:0/1880378131 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v136) v1 ==== 169+0+0 (secure 0 0 0) 0x7f129804b990 con 0x7f12b00ac3b0 2024-01-22T05:16:05.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.589+0000 7f12b8600700 1 -- 172.21.15.49:0/1880378131 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f128805a510 msgr2=0x7f128805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:05.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.589+0000 7f12b8600700 1 --2- 172.21.15.49:0/1880378131 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f128805a510 0x7f128805c9d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f12a0007fd0 tx=0x7f12a0007d30).stop 2024-01-22T05:16:05.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.589+0000 7f12b8600700 1 -- 172.21.15.49:0/1880378131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b00ac3b0 msgr2=0x7f12b00c1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:05.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.589+0000 7f12b8600700 1 --2- 172.21.15.49:0/1880378131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b00ac3b0 0x7f12b00c1050 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f129800e960 tx=0x7f1298009060).stop 2024-01-22T05:16:05.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.589+0000 7f12b8600700 1 -- 172.21.15.49:0/1880378131 shutdown_connections 2024-01-22T05:16:05.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.589+0000 7f12b8600700 1 --2- 172.21.15.49:0/1880378131 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f128805a510 0x7f128805c9d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:05.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.589+0000 7f12b8600700 1 --2- 172.21.15.49:0/1880378131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12b015fbc0 0x7f12b00c1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:05.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.589+0000 7f12b8600700 1 --2- 172.21.15.49:0/1880378131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12b00ac3b0 0x7f12b00c1050 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:05.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.589+0000 7f12b8600700 1 --2- 172.21.15.49:0/1880378131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12b0066690 0x7f12b015f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:05.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.589+0000 7f12b8600700 1 -- 172.21.15.49:0/1880378131 >> 172.21.15.49:0/1880378131 conn(0x7f12b00c6500 msgr2=0x7f12b00aab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:05.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.589+0000 7f12b8600700 1 -- 172.21.15.49:0/1880378131 shutdown_connections 2024-01-22T05:16:05.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.589+0000 7f12b8600700 1 -- 172.21.15.49:0/1880378131 wait complete. 2024-01-22T05:16:05.601 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-01-22T05:16:05.627 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-22T05:16:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.793+0000 7fafda600700 1 Processor -- start 2024-01-22T05:16:05.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.793+0000 7fafda600700 1 -- start start 2024-01-22T05:16:05.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.797+0000 7fafda600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fafd40bc3d0 0x7fafd41576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:05.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.797+0000 7fafda600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fafd40bc7b0 0x7fafd4157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:05.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.797+0000 7fafda600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd4067a90 con 0x7fafd414d820 2024-01-22T05:16:05.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.797+0000 7fafda600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd41580b0 con 0x7fafd40bc3d0 2024-01-22T05:16:05.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.797+0000 7fafda600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd40c1160 con 0x7fafd40bc7b0 2024-01-22T05:16:05.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.797+0000 7fafd3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fafd40bc3d0 0x7fafd41576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:05.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.797+0000 7fafd3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fafd40bc3d0 0x7fafd41576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45676/0 (socket says 172.21.15.49:45676) 2024-01-22T05:16:05.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.797+0000 7fafd3400700 1 -- 172.21.15.49:0/1946380149 learned_addr learned my addr 172.21.15.49:0/1946380149 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:05.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.797+0000 7fafd2a00700 1 --2- 172.21.15.49:0/1946380149 >> v2:172.21.15.110:3300/0 conn(0x7fafd40bc7b0 0x7fafd4157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.797+0000 7fafd3400700 1 -- 172.21.15.49:0/1946380149 >> v2:172.21.15.110:3300/0 conn(0x7fafd40bc7b0 msgr2=0x7fafd4157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.797+0000 7fafd3400700 1 --2- 172.21.15.49:0/1946380149 >> v2:172.21.15.110:3300/0 conn(0x7fafd40bc7b0 0x7fafd4157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.797+0000 7fafd3400700 1 -- 172.21.15.49:0/1946380149 >> v1:172.21.15.110:6789/0 conn(0x7fafd414d820 legacy=0x7fafd414dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.797+0000 7fafd3400700 1 -- 172.21.15.49:0/1946380149 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd4067d70 con 0x7fafd40bc3d0 2024-01-22T05:16:05.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.797+0000 7fafd3400700 1 --2- 172.21.15.49:0/1946380149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd40bc3d0 0x7fafd41576d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7fafd4060200 tx=0x7fafc40090f0).ready entity=mon.0 client_cookie=6868f871e57bda4c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:05.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.801+0000 7fafd2000700 1 -- 172.21.15.49:0/1946380149 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc400b600 con 0x7fafd40bc3d0 2024-01-22T05:16:05.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.801+0000 7fafd2000700 1 -- 172.21.15.49:0/1946380149 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc400b760 con 0x7fafd40bc3d0 2024-01-22T05:16:05.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.801+0000 7fafd2000700 1 -- 172.21.15.49:0/1946380149 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc400bae0 con 0x7fafd40bc3d0 2024-01-22T05:16:05.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.801+0000 7fafda600700 1 -- 172.21.15.49:0/1946380149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd40bc3d0 msgr2=0x7fafd41576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:05.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.801+0000 7fafda600700 1 --2- 172.21.15.49:0/1946380149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd40bc3d0 0x7fafd41576d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7fafd4060200 tx=0x7fafc40090f0).stop 2024-01-22T05:16:05.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.801+0000 7fafda600700 1 -- 172.21.15.49:0/1946380149 shutdown_connections 2024-01-22T05:16:05.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.801+0000 7fafda600700 1 --2- 172.21.15.49:0/1946380149 >> v2:172.21.15.110:3300/0 conn(0x7fafd40bc7b0 0x7fafd4157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:05.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.801+0000 7fafda600700 1 --2- 172.21.15.49:0/1946380149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd40bc3d0 0x7fafd41576d0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:05.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.801+0000 7fafda600700 1 -- 172.21.15.49:0/1946380149 >> 172.21.15.49:0/1946380149 conn(0x7fafd40c6560 msgr2=0x7fafd40c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:05.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.801+0000 7fafda600700 1 -- 172.21.15.49:0/1946380149 shutdown_connections 2024-01-22T05:16:05.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.801+0000 7fafda600700 1 -- 172.21.15.49:0/1946380149 wait complete. 2024-01-22T05:16:05.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.805+0000 7fafda600700 1 Processor -- start 2024-01-22T05:16:05.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.805+0000 7fafda600700 1 -- start start 2024-01-22T05:16:05.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.805+0000 7fafda600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafd40bc3d0 0x7fafd414b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:05.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.805+0000 7fafda600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd40bc7b0 0x7fafd4151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:05.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.805+0000 7fafda600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafd414d820 0x7fafd40bf750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:05.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.805+0000 7fafda600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd4164470 con 0x7fafd40bc7b0 2024-01-22T05:16:05.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.805+0000 7fafda600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd4152530 con 0x7fafd40bc3d0 2024-01-22T05:16:05.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.805+0000 7fafda600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd4152810 con 0x7fafd414d820 2024-01-22T05:16:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.805+0000 7fafd2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd40bc7b0 0x7fafd4151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.805+0000 7fafd2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd40bc7b0 0x7fafd4151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45678/0 (socket says 172.21.15.49:45678) 2024-01-22T05:16:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.805+0000 7fafd2a00700 1 -- 172.21.15.49:0/665557859 learned_addr learned my addr 172.21.15.49:0/665557859 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.805+0000 7fafd3400700 1 --2- 172.21.15.49:0/665557859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafd40bc3d0 0x7fafd414b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:05.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.805+0000 7fafd3e00700 1 --2- 172.21.15.49:0/665557859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafd414d820 0x7fafd40bf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.809+0000 7fafd2a00700 1 -- 172.21.15.49:0/665557859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafd414d820 msgr2=0x7fafd40bf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.809+0000 7fafd2a00700 1 --2- 172.21.15.49:0/665557859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafd414d820 0x7fafd40bf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.809+0000 7fafd2a00700 1 -- 172.21.15.49:0/665557859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafd40bc3d0 msgr2=0x7fafd414b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.809+0000 7fafd2a00700 1 --2- 172.21.15.49:0/665557859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafd40bc3d0 0x7fafd414b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.809+0000 7fafd2a00700 1 -- 172.21.15.49:0/665557859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009370 con 0x7fafd40bc7b0 2024-01-22T05:16:05.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.809+0000 7fafd2a00700 1 --2- 172.21.15.49:0/665557859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd40bc7b0 0x7fafd4151d50 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7fafbc00d890 tx=0x7fafbc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.809+0000 7fafcaa00700 1 -- 172.21.15.49:0/665557859 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc011590 con 0x7fafd40bc7b0 2024-01-22T05:16:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.809+0000 7fafcaa00700 1 -- 172.21.15.49:0/665557859 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc0116f0 con 0x7fafd40bc7b0 2024-01-22T05:16:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.809+0000 7fafda600700 1 -- 172.21.15.49:0/665557859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd4152af0 con 0x7fafd40bc7b0 2024-01-22T05:16:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.809+0000 7fafcaa00700 1 -- 172.21.15.49:0/665557859 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc011a70 con 0x7fafd40bc7b0 2024-01-22T05:16:05.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.809+0000 7fafda600700 1 -- 172.21.15.49:0/665557859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd41640d0 con 0x7fafd40bc7b0 2024-01-22T05:16:05.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.809+0000 7fafda600700 1 -- 172.21.15.49:0/665557859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd4047060 con 0x7fafd40bc7b0 2024-01-22T05:16:05.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.813+0000 7fafcaa00700 1 -- 172.21.15.49:0/665557859 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fafbc01c460 con 0x7fafd40bc7b0 2024-01-22T05:16:05.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.813+0000 7fafcaa00700 1 --2- 172.21.15.49:0/665557859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fafac05a510 0x7fafac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:05.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.813+0000 7fafcaa00700 1 -- 172.21.15.49:0/665557859 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fafbc074720 con 0x7fafd40bc7b0 2024-01-22T05:16:05.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.813+0000 7fafd3400700 1 --2- 172.21.15.49:0/665557859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fafac05a510 0x7fafac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:05.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.813+0000 7fafd3400700 1 --2- 172.21.15.49:0/665557859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fafac05a510 0x7fafac05c9d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fafc4009130 tx=0x7fafc4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:05.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.817+0000 7fafcaa00700 1 -- 172.21.15.49:0/665557859 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fafbc047f80 con 0x7fafd40bc7b0 2024-01-22T05:16:05.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.985+0000 7fafda600700 1 -- 172.21.15.49:0/665557859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fafd4152c80 con 0x7fafd40bc7b0 2024-01-22T05:16:05.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:05.997+0000 7fafcaa00700 1 -- 172.21.15.49:0/665557859 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fafbc04b5a0 con 0x7fafd40bc7b0 2024-01-22T05:16:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.001+0000 7fafda600700 1 -- 172.21.15.49:0/665557859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fafac05a510 msgr2=0x7fafac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.001+0000 7fafda600700 1 --2- 172.21.15.49:0/665557859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fafac05a510 0x7fafac05c9d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fafc4009130 tx=0x7fafc4017000).stop 2024-01-22T05:16:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.001+0000 7fafda600700 1 -- 172.21.15.49:0/665557859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd40bc7b0 msgr2=0x7fafd4151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:05.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.001+0000 7fafda600700 1 --2- 172.21.15.49:0/665557859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd40bc7b0 0x7fafd4151d50 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7fafbc00d890 tx=0x7fafbc008040).stop 2024-01-22T05:16:06.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.001+0000 7fafda600700 1 -- 172.21.15.49:0/665557859 shutdown_connections 2024-01-22T05:16:06.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.001+0000 7fafda600700 1 --2- 172.21.15.49:0/665557859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fafac05a510 0x7fafac05c9d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.001+0000 7fafda600700 1 --2- 172.21.15.49:0/665557859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafd414d820 0x7fafd40bf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.001+0000 7fafda600700 1 --2- 172.21.15.49:0/665557859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd40bc7b0 0x7fafd4151d50 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.001+0000 7fafda600700 1 --2- 172.21.15.49:0/665557859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafd40bc3d0 0x7fafd414b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.001+0000 7fafda600700 1 -- 172.21.15.49:0/665557859 >> 172.21.15.49:0/665557859 conn(0x7fafd40c6560 msgr2=0x7fafd4155b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:06.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.001+0000 7fafda600700 1 -- 172.21.15.49:0/665557859 shutdown_connections 2024-01-22T05:16:06.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.001+0000 7fafda600700 1 -- 172.21.15.49:0/665557859 wait complete. 2024-01-22T05:16:06.025 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-01-22T05:16:06.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.193+0000 7f7cad600700 1 Processor -- start 2024-01-22T05:16:06.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.193+0000 7f7cad600700 1 -- start start 2024-01-22T05:16:06.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7cad600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ca81554f0 0x7f7ca81558d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:06.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7cad600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca8067a90 0x7f7ca8067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:06.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7cad600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca80693b0 con 0x7f7ca8151dc0 2024-01-22T05:16:06.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7cad600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca80687a0 con 0x7f7ca81554f0 2024-01-22T05:16:06.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7cad600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca8068a80 con 0x7f7ca8067a90 2024-01-22T05:16:06.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7ca6a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ca81554f0 0x7f7ca81558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:06.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7ca7400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7ca8151dc0 0x7f7ca8152250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33180/0 (socket says 172.21.15.49:33180) 2024-01-22T05:16:06.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7ca7400700 1 -- 172.21.15.49:0/2604740551 learned_addr learned my addr 172.21.15.49:0/2604740551 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:06.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7ca6000700 1 --2- 172.21.15.49:0/2604740551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca8067a90 0x7f7ca8067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:06.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7ca6a00700 1 -- 172.21.15.49:0/2604740551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca8067a90 msgr2=0x7f7ca8067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:06.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7ca6a00700 1 --2- 172.21.15.49:0/2604740551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca8067a90 0x7f7ca8067ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7ca6a00700 1 -- 172.21.15.49:0/2604740551 >> v1:172.21.15.49:6789/0 conn(0x7f7ca8151dc0 legacy=0x7f7ca8152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:06.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7ca6a00700 1 -- 172.21.15.49:0/2604740551 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca8068d60 con 0x7f7ca81554f0 2024-01-22T05:16:06.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7ca5600700 1 -- 172.21.15.49:0/2604740551 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386567660 0 0) 0x7f7ca80693b0 con 0x7f7ca8151dc0 2024-01-22T05:16:06.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7ca6000700 1 --2- 172.21.15.49:0/2604740551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca8067a90 0x7f7ca8067ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:06.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7ca6a00700 1 --2- 172.21.15.49:0/2604740551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca81554f0 0x7f7ca81558d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f7c98006fd0 tx=0x7f7c98006f40).ready entity=mon.1 client_cookie=b1e6ed28181ec93c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:06.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7ca5600700 1 -- 172.21.15.49:0/2604740551 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98005880 con 0x7f7ca81554f0 2024-01-22T05:16:06.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7ca5600700 1 -- 172.21.15.49:0/2604740551 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c980059e0 con 0x7f7ca81554f0 2024-01-22T05:16:06.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.197+0000 7f7ca5600700 1 -- 172.21.15.49:0/2604740551 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98005d60 con 0x7f7ca81554f0 2024-01-22T05:16:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.201+0000 7f7cad600700 1 -- 172.21.15.49:0/2604740551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca81554f0 msgr2=0x7f7ca81558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.201+0000 7f7cad600700 1 --2- 172.21.15.49:0/2604740551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca81554f0 0x7f7ca81558d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f7c98006fd0 tx=0x7f7c98006f40).stop 2024-01-22T05:16:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.201+0000 7f7cad600700 1 -- 172.21.15.49:0/2604740551 shutdown_connections 2024-01-22T05:16:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.201+0000 7f7cad600700 1 --2- 172.21.15.49:0/2604740551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca8067a90 0x7f7ca8067ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.201+0000 7f7cad600700 1 --2- 172.21.15.49:0/2604740551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca81554f0 0x7f7ca81558d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.201+0000 7f7cad600700 1 -- 172.21.15.49:0/2604740551 >> 172.21.15.49:0/2604740551 conn(0x7f7ca80c8710 msgr2=0x7f7ca80c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:06.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.201+0000 7f7cad600700 1 -- 172.21.15.49:0/2604740551 shutdown_connections 2024-01-22T05:16:06.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.201+0000 7f7cad600700 1 -- 172.21.15.49:0/2604740551 wait complete. 2024-01-22T05:16:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.205+0000 7f7cad600700 1 Processor -- start 2024-01-22T05:16:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.205+0000 7f7cad600700 1 -- start start 2024-01-22T05:16:06.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7cad600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca8067a90 0x7f7ca80c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:06.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7cad600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca8151dc0 0x7f7ca8150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:06.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7cad600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca81554f0 0x7f7ca80bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:06.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7cad600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80bfb30 con 0x7f7ca8151dc0 2024-01-22T05:16:06.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7cad600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80bfe10 con 0x7f7ca81554f0 2024-01-22T05:16:06.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7cad600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80c00f0 con 0x7f7ca8067a90 2024-01-22T05:16:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7ca6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca8151dc0 0x7f7ca8150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7ca6a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca8067a90 0x7f7ca80c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7ca6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca8151dc0 0x7f7ca8150db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45692/0 (socket says 172.21.15.49:45692) 2024-01-22T05:16:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7ca6000700 1 -- 172.21.15.49:0/3783034540 learned_addr learned my addr 172.21.15.49:0/3783034540 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7ca7400700 1 --2- 172.21.15.49:0/3783034540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca81554f0 0x7f7ca80bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7ca6a00700 1 -- 172.21.15.49:0/3783034540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca81554f0 msgr2=0x7f7ca80bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7ca6a00700 1 --2- 172.21.15.49:0/3783034540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca81554f0 0x7f7ca80bf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7ca6a00700 1 -- 172.21.15.49:0/3783034540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca8151dc0 msgr2=0x7f7ca8150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7ca6a00700 1 --2- 172.21.15.49:0/3783034540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca8151dc0 0x7f7ca8150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7ca6a00700 1 -- 172.21.15.49:0/3783034540 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c98009250 con 0x7f7ca8067a90 2024-01-22T05:16:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7ca6a00700 1 --2- 172.21.15.49:0/3783034540 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca8067a90 0x7f7ca80c0bb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f7c98013000 tx=0x7f7c98016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7c9e000700 1 -- 172.21.15.49:0/3783034540 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98006770 con 0x7f7ca8067a90 2024-01-22T05:16:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7c9e000700 1 -- 172.21.15.49:0/3783034540 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9800b790 con 0x7f7ca8067a90 2024-01-22T05:16:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7cad600700 1 -- 172.21.15.49:0/3783034540 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca80c03d0 con 0x7f7ca8067a90 2024-01-22T05:16:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7c9e000700 1 -- 172.21.15.49:0/3783034540 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9800bb50 con 0x7f7ca8067a90 2024-01-22T05:16:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.209+0000 7f7cad600700 1 -- 172.21.15.49:0/3783034540 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca80c10a0 con 0x7f7ca8067a90 2024-01-22T05:16:06.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.213+0000 7f7cad600700 1 -- 172.21.15.49:0/3783034540 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca8047060 con 0x7f7ca8067a90 2024-01-22T05:16:06.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.213+0000 7f7c9e000700 1 -- 172.21.15.49:0/3783034540 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7c98018070 con 0x7f7ca8067a90 2024-01-22T05:16:06.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.217+0000 7f7c9e000700 1 --2- 172.21.15.49:0/3783034540 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c8005a4e0 0x7f7c8005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:06.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.217+0000 7f7c9e000700 1 -- 172.21.15.49:0/3783034540 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f7c98074bf0 con 0x7f7ca8067a90 2024-01-22T05:16:06.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.217+0000 7f7ca6000700 1 --2- 172.21.15.49:0/3783034540 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c8005a4e0 0x7f7c8005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:06.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.217+0000 7f7ca6000700 1 --2- 172.21.15.49:0/3783034540 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c8005a4e0 0x7f7c8005c9a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f7ca8154070 tx=0x7f7c90008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:06.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.221+0000 7f7c9e000700 1 -- 172.21.15.49:0/3783034540 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7c980484b0 con 0x7f7ca8067a90 2024-01-22T05:16:06.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.445+0000 7f7cad600700 1 -- 172.21.15.49:0/3783034540 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) v1 -- 0x7f7ca8069a00 con 0x7f7ca8067a90 2024-01-22T05:16:06.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.589+0000 7f7c9e000700 1 -- 172.21.15.49:0/3783034540 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v537) v1 ==== 166+0+0 (secure 0 0 0) 0x7f7c9804bad0 con 0x7f7ca8067a90 2024-01-22T05:16:06.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.593+0000 7f7cad600700 1 -- 172.21.15.49:0/3783034540 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c8005a4e0 msgr2=0x7f7c8005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:06.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.593+0000 7f7cad600700 1 --2- 172.21.15.49:0/3783034540 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c8005a4e0 0x7f7c8005c9a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f7ca8154070 tx=0x7f7c90008040).stop 2024-01-22T05:16:06.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.593+0000 7f7cad600700 1 -- 172.21.15.49:0/3783034540 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca8067a90 msgr2=0x7f7ca80c0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:06.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.593+0000 7f7cad600700 1 --2- 172.21.15.49:0/3783034540 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca8067a90 0x7f7ca80c0bb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f7c98013000 tx=0x7f7c98016000).stop 2024-01-22T05:16:06.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.597+0000 7f7cad600700 1 -- 172.21.15.49:0/3783034540 shutdown_connections 2024-01-22T05:16:06.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.597+0000 7f7cad600700 1 --2- 172.21.15.49:0/3783034540 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c8005a4e0 0x7f7c8005c9a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.597+0000 7f7cad600700 1 --2- 172.21.15.49:0/3783034540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca81554f0 0x7f7ca80bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.597+0000 7f7cad600700 1 --2- 172.21.15.49:0/3783034540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ca8151dc0 0x7f7ca8150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.597+0000 7f7cad600700 1 --2- 172.21.15.49:0/3783034540 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca8067a90 0x7f7ca80c0bb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.597+0000 7f7cad600700 1 -- 172.21.15.49:0/3783034540 >> 172.21.15.49:0/3783034540 conn(0x7f7ca80c8710 msgr2=0x7f7ca8153050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:06.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.597+0000 7f7cad600700 1 -- 172.21.15.49:0/3783034540 shutdown_connections 2024-01-22T05:16:06.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.597+0000 7f7cad600700 1 -- 172.21.15.49:0/3783034540 wait complete. 2024-01-22T05:16:06.622 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-01-22T05:16:06.622 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-01-22T05:16:06.622 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-01-22T05:16:06.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.793+0000 7fb3ba000700 1 Processor -- start 2024-01-22T05:16:06.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.793+0000 7fb3ba000700 1 -- start start 2024-01-22T05:16:06.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.797+0000 7fb3ba000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3b40623d0 0x7fb3b40627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:06.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.797+0000 7fb3ba000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb3b41571f0 0x7fb3b40bd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:06.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.797+0000 7fb3ba000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b40c3520 con 0x7fb3b40bd4c0 2024-01-22T05:16:06.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.797+0000 7fb3ba000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b40bdf10 con 0x7fb3b40623d0 2024-01-22T05:16:06.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.797+0000 7fb3ba000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b40be1f0 con 0x7fb3b41571f0 2024-01-22T05:16:06.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.797+0000 7fb3b3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3b40623d0 0x7fb3b40627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:06.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.797+0000 7fb3b3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3b40623d0 0x7fb3b40627b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45694/0 (socket says 172.21.15.49:45694) 2024-01-22T05:16:06.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.797+0000 7fb3b3400700 1 -- 172.21.15.49:0/931732412 learned_addr learned my addr 172.21.15.49:0/931732412 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:06.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.797+0000 7fb3b8a00700 1 --2- 172.21.15.49:0/931732412 >> v2:172.21.15.110:3300/0 conn(0x7fb3b41571f0 0x7fb3b40bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:06.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.801+0000 7fb3b3400700 1 -- 172.21.15.49:0/931732412 >> v2:172.21.15.110:3300/0 conn(0x7fb3b41571f0 msgr2=0x7fb3b40bd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:06.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.801+0000 7fb3b3400700 1 --2- 172.21.15.49:0/931732412 >> v2:172.21.15.110:3300/0 conn(0x7fb3b41571f0 0x7fb3b40bd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.801+0000 7fb3b3400700 1 -- 172.21.15.49:0/931732412 >> v1:172.21.15.110:6789/0 conn(0x7fb3b40bd4c0 legacy=0x7fb3b4156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:06.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.801+0000 7fb3b3400700 1 -- 172.21.15.49:0/931732412 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b40be4d0 con 0x7fb3b40623d0 2024-01-22T05:16:06.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.801+0000 7fb3b3400700 1 --2- 172.21.15.49:0/931732412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b40623d0 0x7fb3b40627b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fb3b40c9430 tx=0x7fb3a40090f0).ready entity=mon.0 client_cookie=c77b1c3b290bb729 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:06.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.805+0000 7fb3b2000700 1 -- 172.21.15.49:0/931732412 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a400b520 con 0x7fb3b40623d0 2024-01-22T05:16:06.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.805+0000 7fb3b2000700 1 -- 172.21.15.49:0/931732412 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a400b680 con 0x7fb3b40623d0 2024-01-22T05:16:06.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.805+0000 7fb3b2000700 1 -- 172.21.15.49:0/931732412 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a400ba00 con 0x7fb3b40623d0 2024-01-22T05:16:06.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.805+0000 7fb3ba000700 1 -- 172.21.15.49:0/931732412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b40623d0 msgr2=0x7fb3b40627b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:06.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.805+0000 7fb3ba000700 1 --2- 172.21.15.49:0/931732412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b40623d0 0x7fb3b40627b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fb3b40c9430 tx=0x7fb3a40090f0).stop 2024-01-22T05:16:06.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.805+0000 7fb3ba000700 1 -- 172.21.15.49:0/931732412 shutdown_connections 2024-01-22T05:16:06.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.805+0000 7fb3ba000700 1 --2- 172.21.15.49:0/931732412 >> v2:172.21.15.110:3300/0 conn(0x7fb3b41571f0 0x7fb3b40bd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.805+0000 7fb3ba000700 1 --2- 172.21.15.49:0/931732412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b40623d0 0x7fb3b40627b0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.805+0000 7fb3ba000700 1 -- 172.21.15.49:0/931732412 >> 172.21.15.49:0/931732412 conn(0x7fb3b40c8560 msgr2=0x7fb3b40c8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:06.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.805+0000 7fb3ba000700 1 -- 172.21.15.49:0/931732412 shutdown_connections 2024-01-22T05:16:06.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.805+0000 7fb3ba000700 1 -- 172.21.15.49:0/931732412 wait complete. 2024-01-22T05:16:06.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.809+0000 7fb3ba000700 1 Processor -- start 2024-01-22T05:16:06.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.809+0000 7fb3ba000700 1 -- start start 2024-01-22T05:16:06.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3ba000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3b40623d0 0x7fb3b4151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:06.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3ba000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3b40bd4c0 0x7fb3b40a8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:06.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3ba000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b41571f0 0x7fb3b41535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:06.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3ba000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b40a9d10 con 0x7fb3b41571f0 2024-01-22T05:16:06.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3ba000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b4152f10 con 0x7fb3b40bd4c0 2024-01-22T05:16:06.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3ba000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b40c0ae0 con 0x7fb3b40623d0 2024-01-22T05:16:06.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3b8a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b41571f0 0x7fb3b41535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:06.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3b8a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b41571f0 0x7fb3b41535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45704/0 (socket says 172.21.15.49:45704) 2024-01-22T05:16:06.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3b8a00700 1 -- 172.21.15.49:0/3941026579 learned_addr learned my addr 172.21.15.49:0/3941026579 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:06.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3b3400700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3b40623d0 0x7fb3b4151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:06.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3b2a00700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3b40bd4c0 0x7fb3b40a8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:06.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3b8a00700 1 -- 172.21.15.49:0/3941026579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3b40623d0 msgr2=0x7fb3b4151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:06.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3b8a00700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3b40623d0 0x7fb3b4151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3b8a00700 1 -- 172.21.15.49:0/3941026579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3b40bd4c0 msgr2=0x7fb3b40a8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:06.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3b8a00700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3b40bd4c0 0x7fb3b40a8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:06.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3b8a00700 1 -- 172.21.15.49:0/3941026579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a4009370 con 0x7fb3b41571f0 2024-01-22T05:16:06.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3b2a00700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3b40bd4c0 0x7fb3b40a8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:06.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3b3400700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3b40623d0 0x7fb3b4151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:06.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3b8a00700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b41571f0 0x7fb3b41535e0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7fb3ac009d70 tx=0x7fb3ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:06.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3aaa00700 1 -- 172.21.15.49:0/3941026579 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac00cb50 con 0x7fb3b41571f0 2024-01-22T05:16:06.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3aaa00700 1 -- 172.21.15.49:0/3941026579 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ac00f040 con 0x7fb3b41571f0 2024-01-22T05:16:06.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3ba000700 1 -- 172.21.15.49:0/3941026579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b40a9f90 con 0x7fb3b41571f0 2024-01-22T05:16:06.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.813+0000 7fb3aaa00700 1 -- 172.21.15.49:0/3941026579 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac013400 con 0x7fb3b41571f0 2024-01-22T05:16:06.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.817+0000 7fb3ba000700 1 -- 172.21.15.49:0/3941026579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b40aa550 con 0x7fb3b41571f0 2024-01-22T05:16:06.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.817+0000 7fb3ba000700 1 -- 172.21.15.49:0/3941026579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b40c0d00 con 0x7fb3b41571f0 2024-01-22T05:16:06.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.817+0000 7fb3aaa00700 1 -- 172.21.15.49:0/3941026579 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb3ac0137b0 con 0x7fb3b41571f0 2024-01-22T05:16:06.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.817+0000 7fb3aaa00700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb38c05a510 0x7fb38c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:06.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.817+0000 7fb3aaa00700 1 -- 172.21.15.49:0/3941026579 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fb3ac074e10 con 0x7fb3b41571f0 2024-01-22T05:16:06.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.821+0000 7fb3b3400700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb38c05a510 0x7fb38c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:06.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.821+0000 7fb3b3400700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb38c05a510 0x7fb38c05c9d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fb3a4009130 tx=0x7fb3a4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:06.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:06.825+0000 7fb3aaa00700 1 -- 172.21.15.49:0/3941026579 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb3b40c0d00 con 0x7fb3b41571f0 2024-01-22T05:16:07.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.081+0000 7fb3ba000700 1 -- 172.21.15.49:0/3941026579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) v1 -- 0x7fb3b4047060 con 0x7fb3b41571f0 2024-01-22T05:16:07.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.593+0000 7fb3aaa00700 1 -- 172.21.15.49:0/3941026579 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v538) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb3ac048790 con 0x7fb3b41571f0 2024-01-22T05:16:07.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.597+0000 7fb3ba000700 1 -- 172.21.15.49:0/3941026579 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb38c05a510 msgr2=0x7fb38c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:07.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.597+0000 7fb3ba000700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb38c05a510 0x7fb38c05c9d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fb3a4009130 tx=0x7fb3a4017000).stop 2024-01-22T05:16:07.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.597+0000 7fb3ba000700 1 -- 172.21.15.49:0/3941026579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b41571f0 msgr2=0x7fb3b41535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:07.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.597+0000 7fb3ba000700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b41571f0 0x7fb3b41535e0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7fb3ac009d70 tx=0x7fb3ac00b040).stop 2024-01-22T05:16:07.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.597+0000 7fb3ba000700 1 -- 172.21.15.49:0/3941026579 shutdown_connections 2024-01-22T05:16:07.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.597+0000 7fb3ba000700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb38c05a510 0x7fb38c05c9d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:07.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.597+0000 7fb3ba000700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b41571f0 0x7fb3b41535e0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:07.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.597+0000 7fb3ba000700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3b40bd4c0 0x7fb3b40a8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:07.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.597+0000 7fb3ba000700 1 --2- 172.21.15.49:0/3941026579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3b40623d0 0x7fb3b4151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:07.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.597+0000 7fb3ba000700 1 -- 172.21.15.49:0/3941026579 >> 172.21.15.49:0/3941026579 conn(0x7fb3b40c8560 msgr2=0x7fb3b40adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:07.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.597+0000 7fb3ba000700 1 -- 172.21.15.49:0/3941026579 shutdown_connections 2024-01-22T05:16:07.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.597+0000 7fb3ba000700 1 -- 172.21.15.49:0/3941026579 wait complete. 2024-01-22T05:16:07.622 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-22T05:16:07.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.801+0000 7f5d3fe00700 1 Processor -- start 2024-01-22T05:16:07.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.801+0000 7f5d3fe00700 1 -- start start 2024-01-22T05:16:07.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d40068fa0 0x7f5d40150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:07.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3fe00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d400c3430 con 0x7f5d400bcad0 2024-01-22T05:16:07.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3fe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d40154970 con 0x7f5d400639d0 2024-01-22T05:16:07.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400bc130 con 0x7f5d40068fa0 2024-01-22T05:16:07.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3e000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5d400bcad0 0x7f5d40153b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33190/0 (socket says 172.21.15.49:33190) 2024-01-22T05:16:07.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3e000700 1 -- 172.21.15.49:0/2334664699 learned_addr learned my addr 172.21.15.49:0/2334664699 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:07.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3ea00700 1 --2- 172.21.15.49:0/2334664699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d40068fa0 0x7f5d40150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:07.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3d600700 1 -- 172.21.15.49:0/2334664699 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448934307 0 0) 0x7f5d400c3430 con 0x7f5d400bcad0 2024-01-22T05:16:07.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3d600700 1 -- 172.21.15.49:0/2334664699 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d20004500 con 0x7f5d400bcad0 2024-01-22T05:16:07.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3d600700 1 -- 172.21.15.49:0/2334664699 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918463708 0 0) 0x7f5d40154970 con 0x7f5d400639d0 2024-01-22T05:16:07.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3d600700 1 -- 172.21.15.49:0/2334664699 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d400c3430 con 0x7f5d400639d0 2024-01-22T05:16:07.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3ea00700 1 -- 172.21.15.49:0/2334664699 >> v1:172.21.15.110:6789/0 conn(0x7f5d400639d0 legacy=0x7f5d40154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:07.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3ea00700 1 -- 172.21.15.49:0/2334664699 >> v1:172.21.15.49:6789/0 conn(0x7f5d400bcad0 legacy=0x7f5d40153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:07.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3ea00700 1 -- 172.21.15.49:0/2334664699 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d400c2820 con 0x7f5d40068fa0 2024-01-22T05:16:07.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3ea00700 1 --2- 172.21.15.49:0/2334664699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d40068fa0 0x7f5d40150fc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f5d30009790 tx=0x7f5d30009060).ready entity=mon.2 client_cookie=58142fdf4a56960d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:07.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3d600700 1 -- 172.21.15.49:0/2334664699 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3000f510 con 0x7f5d40068fa0 2024-01-22T05:16:07.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3d600700 1 -- 172.21.15.49:0/2334664699 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3000f670 con 0x7f5d40068fa0 2024-01-22T05:16:07.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.805+0000 7f5d3d600700 1 -- 172.21.15.49:0/2334664699 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3000f9f0 con 0x7f5d40068fa0 2024-01-22T05:16:07.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.809+0000 7f5d3fe00700 1 -- 172.21.15.49:0/2334664699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d40068fa0 msgr2=0x7f5d40150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:07.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.809+0000 7f5d3fe00700 1 --2- 172.21.15.49:0/2334664699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d40068fa0 0x7f5d40150fc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f5d30009790 tx=0x7f5d30009060).stop 2024-01-22T05:16:07.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.809+0000 7f5d3fe00700 1 -- 172.21.15.49:0/2334664699 shutdown_connections 2024-01-22T05:16:07.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.809+0000 7f5d3fe00700 1 --2- 172.21.15.49:0/2334664699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d40068fa0 0x7f5d40150fc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:07.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.809+0000 7f5d3fe00700 1 -- 172.21.15.49:0/2334664699 >> 172.21.15.49:0/2334664699 conn(0x7f5d400c3880 msgr2=0x7f5d400c3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:07.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.809+0000 7f5d3fe00700 1 -- 172.21.15.49:0/2334664699 shutdown_connections 2024-01-22T05:16:07.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.809+0000 7f5d3fe00700 1 -- 172.21.15.49:0/2334664699 wait complete. 2024-01-22T05:16:07.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.813+0000 7f5d3fe00700 1 Processor -- start 2024-01-22T05:16:07.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.813+0000 7f5d3fe00700 1 -- start start 2024-01-22T05:16:07.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d400639d0 0x7f5d400bde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:07.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d40068fa0 0x7f5d400be370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:07.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d400bcad0 0x7f5d401680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:07.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3fe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4014ef10 con 0x7f5d400639d0 2024-01-22T05:16:07.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4014f1f0 con 0x7f5d400bcad0 2024-01-22T05:16:07.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4014f4d0 con 0x7f5d40068fa0 2024-01-22T05:16:07.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d400639d0 0x7f5d400bde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:07.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d400639d0 0x7f5d400bde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45706/0 (socket says 172.21.15.49:45706) 2024-01-22T05:16:07.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3ea00700 1 -- 172.21.15.49:0/1752406817 learned_addr learned my addr 172.21.15.49:0/1752406817 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:07.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3f400700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d400bcad0 0x7f5d401680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:07.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3e000700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d40068fa0 0x7f5d400be370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:07.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3ea00700 1 -- 172.21.15.49:0/1752406817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d40068fa0 msgr2=0x7f5d400be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:07.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3ea00700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d40068fa0 0x7f5d400be370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:07.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3ea00700 1 -- 172.21.15.49:0/1752406817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d400bcad0 msgr2=0x7f5d401680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:07.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3ea00700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d400bcad0 0x7f5d401680b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:07.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3ea00700 1 -- 172.21.15.49:0/1752406817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d300092a0 con 0x7f5d400639d0 2024-01-22T05:16:07.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3e000700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d40068fa0 0x7f5d400be370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:07.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3f400700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d400bcad0 0x7f5d401680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:07.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3ea00700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d400639d0 0x7f5d400bde80 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f5d400bde30 tx=0x7f5d30017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:07.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d36000700 1 -- 172.21.15.49:0/1752406817 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3000f7e0 con 0x7f5d400639d0 2024-01-22T05:16:07.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d36000700 1 -- 172.21.15.49:0/1752406817 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3000f940 con 0x7f5d400639d0 2024-01-22T05:16:07.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3fe00700 1 -- 172.21.15.49:0/1752406817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4014f7b0 con 0x7f5d400639d0 2024-01-22T05:16:07.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d36000700 1 -- 172.21.15.49:0/1752406817 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3001b660 con 0x7f5d400639d0 2024-01-22T05:16:07.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.817+0000 7f5d3fe00700 1 -- 172.21.15.49:0/1752406817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4014ebe0 con 0x7f5d400639d0 2024-01-22T05:16:07.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.821+0000 7f5d3fe00700 1 -- 172.21.15.49:0/1752406817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d40064eb0 con 0x7f5d400639d0 2024-01-22T05:16:07.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.821+0000 7f5d36000700 1 -- 172.21.15.49:0/1752406817 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5d3001ba10 con 0x7f5d400639d0 2024-01-22T05:16:07.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.825+0000 7f5d36000700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d1805a510 0x7f5d1805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:07.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.825+0000 7f5d36000700 1 -- 172.21.15.49:0/1752406817 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f5d30075f10 con 0x7f5d400639d0 2024-01-22T05:16:07.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.825+0000 7f5d3e000700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d1805a510 0x7f5d1805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:07.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.825+0000 7f5d3e000700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d1805a510 0x7f5d1805c9d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f5d400acf90 tx=0x7f5d28009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:07.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:07.829+0000 7f5d36000700 1 -- 172.21.15.49:0/1752406817 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5d300497d0 con 0x7f5d400639d0 2024-01-22T05:16:08.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.001+0000 7f5d3fe00700 1 -- 172.21.15.49:0/1752406817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5d40062710 con 0x7f5d400639d0 2024-01-22T05:16:08.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.009+0000 7f5d36000700 1 -- 172.21.15.49:0/1752406817 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5d30029070 con 0x7f5d400639d0 2024-01-22T05:16:08.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.013+0000 7f5d3fe00700 1 -- 172.21.15.49:0/1752406817 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d1805a510 msgr2=0x7f5d1805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:08.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.013+0000 7f5d3fe00700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d1805a510 0x7f5d1805c9d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f5d400acf90 tx=0x7f5d28009040).stop 2024-01-22T05:16:08.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.013+0000 7f5d3fe00700 1 -- 172.21.15.49:0/1752406817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d400639d0 msgr2=0x7f5d400bde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:08.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.013+0000 7f5d3fe00700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d400639d0 0x7f5d400bde80 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f5d400bde30 tx=0x7f5d30017000).stop 2024-01-22T05:16:08.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.013+0000 7f5d3fe00700 1 -- 172.21.15.49:0/1752406817 shutdown_connections 2024-01-22T05:16:08.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.013+0000 7f5d3fe00700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5d1805a510 0x7f5d1805c9d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.013+0000 7f5d3fe00700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d400bcad0 0x7f5d401680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.013+0000 7f5d3fe00700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d40068fa0 0x7f5d400be370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.013+0000 7f5d3fe00700 1 --2- 172.21.15.49:0/1752406817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d400639d0 0x7f5d400bde80 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.013+0000 7f5d3fe00700 1 -- 172.21.15.49:0/1752406817 >> 172.21.15.49:0/1752406817 conn(0x7f5d400c3880 msgr2=0x7f5d400c6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:08.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.013+0000 7f5d3fe00700 1 -- 172.21.15.49:0/1752406817 shutdown_connections 2024-01-22T05:16:08.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.013+0000 7f5d3fe00700 1 -- 172.21.15.49:0/1752406817 wait complete. 2024-01-22T05:16:08.036 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:16:08.036 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:16:08.076 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:16:08.123 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:16:08.123 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-22T05:16:08.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:16:08.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.293+0000 7fe40da00700 1 Processor -- start 2024-01-22T05:16:08.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.293+0000 7fe40da00700 1 -- start start 2024-01-22T05:16:08.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.297+0000 7fe40da00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe40806a1c0 0x7fe4081508e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:08.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.297+0000 7fe40da00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe4080a6720 0x7fe408063e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:08.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.297+0000 7fe40da00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4080c3dd0 con 0x7fe408064310 2024-01-22T05:16:08.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.297+0000 7fe40da00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4080a6f00 con 0x7fe4080a6720 2024-01-22T05:16:08.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.297+0000 7fe40da00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe408150dd0 con 0x7fe40806a1c0 2024-01-22T05:16:08.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.297+0000 7fe407400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe408064310 0x7fe408154600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33200/0 (socket says 172.21.15.49:33200) 2024-01-22T05:16:08.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.297+0000 7fe407400700 1 -- 172.21.15.49:0/1260767856 learned_addr learned my addr 172.21.15.49:0/1260767856 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:08.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.297+0000 7fe406a00700 1 --2- 172.21.15.49:0/1260767856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe40806a1c0 0x7fe4081508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:08.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.297+0000 7fe406000700 1 --2- 172.21.15.49:0/1260767856 >> v2:172.21.15.110:3300/0 conn(0x7fe4080a6720 0x7fe408063e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:08.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.297+0000 7fe405600700 1 -- 172.21.15.49:0/1260767856 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315070059 0 0) 0x7fe4080c3dd0 con 0x7fe408064310 2024-01-22T05:16:08.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.297+0000 7fe405600700 1 -- 172.21.15.49:0/1260767856 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e80033f0 con 0x7fe408064310 2024-01-22T05:16:08.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe406a00700 1 -- 172.21.15.49:0/1260767856 >> v2:172.21.15.110:3300/0 conn(0x7fe4080a6720 msgr2=0x7fe408063e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:08.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe405600700 1 -- 172.21.15.49:0/1260767856 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 784048175 0 0) 0x7fe3e80033f0 con 0x7fe408064310 2024-01-22T05:16:08.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe406a00700 1 --2- 172.21.15.49:0/1260767856 >> v2:172.21.15.110:3300/0 conn(0x7fe4080a6720 0x7fe408063e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe406a00700 1 -- 172.21.15.49:0/1260767856 >> v1:172.21.15.49:6789/0 conn(0x7fe408064310 legacy=0x7fe408154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:08.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe406a00700 1 -- 172.21.15.49:0/1260767856 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4080647c0 con 0x7fe40806a1c0 2024-01-22T05:16:08.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe406a00700 1 --2- 172.21.15.49:0/1260767856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe40806a1c0 0x7fe4081508e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fe3f8009760 tx=0x7fe3f8009060).ready entity=mon.2 client_cookie=fcaa361322e37172 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:08.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe405600700 1 -- 172.21.15.49:0/1260767856 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4000017f0 con 0x7fe40806a1c0 2024-01-22T05:16:08.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe405600700 1 -- 172.21.15.49:0/1260767856 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f8011400 con 0x7fe40806a1c0 2024-01-22T05:16:08.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe405600700 1 -- 172.21.15.49:0/1260767856 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8011780 con 0x7fe40806a1c0 2024-01-22T05:16:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe40da00700 1 -- 172.21.15.49:0/1260767856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe40806a1c0 msgr2=0x7fe4081508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe40da00700 1 --2- 172.21.15.49:0/1260767856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe40806a1c0 0x7fe4081508e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fe3f8009760 tx=0x7fe3f8009060).stop 2024-01-22T05:16:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe40da00700 1 -- 172.21.15.49:0/1260767856 shutdown_connections 2024-01-22T05:16:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe40da00700 1 --2- 172.21.15.49:0/1260767856 >> v2:172.21.15.110:3300/0 conn(0x7fe4080a6720 0x7fe408063e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe40da00700 1 --2- 172.21.15.49:0/1260767856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe40806a1c0 0x7fe4081508e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe40da00700 1 -- 172.21.15.49:0/1260767856 >> 172.21.15.49:0/1260767856 conn(0x7fe408066830 msgr2=0x7fe408066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe40da00700 1 -- 172.21.15.49:0/1260767856 shutdown_connections 2024-01-22T05:16:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.301+0000 7fe40da00700 1 -- 172.21.15.49:0/1260767856 wait complete. 2024-01-22T05:16:08.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.305+0000 7fe40da00700 1 Processor -- start 2024-01-22T05:16:08.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.305+0000 7fe40da00700 1 -- start start 2024-01-22T05:16:08.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe40da00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe408064310 0x7fe40814f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe40da00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe40806a1c0 0x7fe4080c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe40da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4080a6720 0x7fe4080c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe40da00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4080c7390 con 0x7fe4080a6720 2024-01-22T05:16:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe40da00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4080a4ff0 con 0x7fe408064310 2024-01-22T05:16:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe40da00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4080a52d0 con 0x7fe40806a1c0 2024-01-22T05:16:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe407400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4080a6720 0x7fe4080c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe407400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4080a6720 0x7fe4080c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45710/0 (socket says 172.21.15.49:45710) 2024-01-22T05:16:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe407400700 1 -- 172.21.15.49:0/3724515565 learned_addr learned my addr 172.21.15.49:0/3724515565 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe406a00700 1 --2- 172.21.15.49:0/3724515565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe408064310 0x7fe40814f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe406000700 1 --2- 172.21.15.49:0/3724515565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe40806a1c0 0x7fe4080c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe407400700 1 -- 172.21.15.49:0/3724515565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe40806a1c0 msgr2=0x7fe4080c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe407400700 1 --2- 172.21.15.49:0/3724515565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe40806a1c0 0x7fe4080c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe407400700 1 -- 172.21.15.49:0/3724515565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe408064310 msgr2=0x7fe40814f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe407400700 1 --2- 172.21.15.49:0/3724515565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe408064310 0x7fe40814f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe407400700 1 -- 172.21.15.49:0/3724515565 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f80092a0 con 0x7fe4080a6720 2024-01-22T05:16:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.309+0000 7fe407400700 1 --2- 172.21.15.49:0/3724515565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4080a6720 0x7fe4080c6ea0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7fe40000cb40 tx=0x7fe400001e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.313+0000 7fe3fe000700 1 -- 172.21.15.49:0/3724515565 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400004c40 con 0x7fe4080a6720 2024-01-22T05:16:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.313+0000 7fe3fe000700 1 -- 172.21.15.49:0/3724515565 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe400004da0 con 0x7fe4080a6720 2024-01-22T05:16:08.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.313+0000 7fe40da00700 1 -- 172.21.15.49:0/3724515565 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4080a55b0 con 0x7fe4080a6720 2024-01-22T05:16:08.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.313+0000 7fe3fe000700 1 -- 172.21.15.49:0/3724515565 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400007380 con 0x7fe4080a6720 2024-01-22T05:16:08.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.313+0000 7fe40da00700 1 -- 172.21.15.49:0/3724515565 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4080a5b70 con 0x7fe4080a6720 2024-01-22T05:16:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.313+0000 7fe40da00700 1 -- 172.21.15.49:0/3724515565 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4080657b0 con 0x7fe4080a6720 2024-01-22T05:16:08.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.313+0000 7fe3fe000700 1 -- 172.21.15.49:0/3724515565 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe400007770 con 0x7fe4080a6720 2024-01-22T05:16:08.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.317+0000 7fe3fe000700 1 --2- 172.21.15.49:0/3724515565 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe3e005a510 0x7fe3e005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:08.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.317+0000 7fe3fe000700 1 -- 172.21.15.49:0/3724515565 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fe400074550 con 0x7fe4080a6720 2024-01-22T05:16:08.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.317+0000 7fe406a00700 1 --2- 172.21.15.49:0/3724515565 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe3e005a510 0x7fe3e005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:08.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.317+0000 7fe406a00700 1 --2- 172.21.15.49:0/3724515565 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe3e005a510 0x7fe3e005c9d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fe3f8006be0 tx=0x7fe3f8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:08.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.325+0000 7fe3fe000700 1 -- 172.21.15.49:0/3724515565 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe400047e10 con 0x7fe4080a6720 2024-01-22T05:16:08.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.521+0000 7fe40da00700 1 -- 172.21.15.49:0/3724515565 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe408064f70 con 0x7fe4080a6720 2024-01-22T05:16:08.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.525+0000 7fe3fe000700 1 -- 172.21.15.49:0/3724515565 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+3537 (secure 0 0 0) 0x7fe40004b430 con 0x7fe4080a6720 2024-01-22T05:16:08.523 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:08.524 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":108,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7172,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/2526926778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2526926778},{"type":"v1","addr":"172.21.15.110:6833","nonce":2526926778}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2770362881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2770362881},{"type":"v1","addr":"172.21.15.110:6835","nonce":2770362881}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/1020091780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1020091780},{"type":"v1","addr":"172.21.15.49:6836","nonce":1020091780}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":8769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/482534181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":482534181},{"type":"v1","addr":"172.21.15.49:6837","nonce":482534181}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":108}],"filesystems":[]} 2024-01-22T05:16:08.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.525+0000 7fe40da00700 1 -- 172.21.15.49:0/3724515565 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe3e005a510 msgr2=0x7fe3e005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:08.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.525+0000 7fe40da00700 1 --2- 172.21.15.49:0/3724515565 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe3e005a510 0x7fe3e005c9d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fe3f8006be0 tx=0x7fe3f8016000).stop 2024-01-22T05:16:08.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.525+0000 7fe40da00700 1 -- 172.21.15.49:0/3724515565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4080a6720 msgr2=0x7fe4080c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:08.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.525+0000 7fe40da00700 1 --2- 172.21.15.49:0/3724515565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4080a6720 0x7fe4080c6ea0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7fe40000cb40 tx=0x7fe400001e20).stop 2024-01-22T05:16:08.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.525+0000 7fe40da00700 1 -- 172.21.15.49:0/3724515565 shutdown_connections 2024-01-22T05:16:08.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.525+0000 7fe40da00700 1 --2- 172.21.15.49:0/3724515565 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe3e005a510 0x7fe3e005c9d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.525+0000 7fe40da00700 1 --2- 172.21.15.49:0/3724515565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4080a6720 0x7fe4080c6ea0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.525+0000 7fe40da00700 1 --2- 172.21.15.49:0/3724515565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe40806a1c0 0x7fe4080c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.525+0000 7fe40da00700 1 --2- 172.21.15.49:0/3724515565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe408064310 0x7fe40814f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.525+0000 7fe40da00700 1 -- 172.21.15.49:0/3724515565 >> 172.21.15.49:0/3724515565 conn(0x7fe408066830 msgr2=0x7fe4080a7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:08.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.529+0000 7fe40da00700 1 -- 172.21.15.49:0/3724515565 shutdown_connections 2024-01-22T05:16:08.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.529+0000 7fe40da00700 1 -- 172.21.15.49:0/3724515565 wait complete. 2024-01-22T05:16:08.531 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 108 2024-01-22T05:16:08.549 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:16:08.549 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-22T05:16:08.549 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:16:08.549 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:16:08.549 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:16:08.550 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-22T05:16:08.550 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:16:08.550 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:16:08.550 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:16:08.550 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-22T05:16:08.550 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:16:08.550 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:16:08.551 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:16:08.551 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-22T05:16:08.551 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:16:08.551 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:16:08.574 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:16:08.574 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:16:08.575 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:16:08.575 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:16:08.580 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:16:08.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:16:08.581 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:16:08.581 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:16:08.623 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:16:08.624 DEBUG:teuthology.parallel:result is None 2024-01-22T05:16:08.628 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:16:08.628 DEBUG:teuthology.parallel:result is None 2024-01-22T05:16:08.631 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:16:08.631 DEBUG:teuthology.parallel:result is None 2024-01-22T05:16:08.635 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:16:08.635 DEBUG:teuthology.parallel:result is None 2024-01-22T05:16:08.635 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-22T05:16:08.738 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:16:08.740 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:16:08.742 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-22T05:16:08.753 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:16:08.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.801+0000 7f5ca7400700 1 Processor -- start 2024-01-22T05:16:08.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.801+0000 7f5ca7400700 1 -- start start 2024-01-22T05:16:08.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.801+0000 7f5ca7400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca0064530 0x7f5ca0154600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:08.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.801+0000 7f5ca7400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca00c3dd0 con 0x7f5ca01508e0 2024-01-22T05:16:08.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5ca7400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca006a5a0 con 0x7f5ca006a1c0 2024-01-22T05:16:08.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5ca7400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca00a6f00 con 0x7f5ca0064530 2024-01-22T05:16:08.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5c9fe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5ca01508e0 0x7f5ca0063e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33222/0 (socket says 172.21.15.49:33222) 2024-01-22T05:16:08.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5c9fe00700 1 -- 172.21.15.49:0/3753126932 learned_addr learned my addr 172.21.15.49:0/3753126932 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:08.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5ca4a00700 1 --1- 172.21.15.49:0/3753126932 >> v1:172.21.15.110:6789/0 conn(0x7f5ca006a1c0 0x7f5ca00a6720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:49358/0 (socket says 172.21.15.49:49358) 2024-01-22T05:16:08.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5ca5400700 1 --2- 172.21.15.49:0/3753126932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca0064530 0x7f5ca0154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:08.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5c9f400700 1 -- 172.21.15.49:0/3753126932 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332936354 0 0) 0x7f5ca00c3dd0 con 0x7f5ca01508e0 2024-01-22T05:16:08.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5c9f400700 1 -- 172.21.15.49:0/3753126932 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c800033f0 con 0x7f5ca01508e0 2024-01-22T05:16:08.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5c9f400700 1 -- 172.21.15.49:0/3753126932 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907160274 0 0) 0x7f5ca006a5a0 con 0x7f5ca006a1c0 2024-01-22T05:16:08.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5c9f400700 1 -- 172.21.15.49:0/3753126932 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ca00c3dd0 con 0x7f5ca006a1c0 2024-01-22T05:16:08.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5ca5400700 1 -- 172.21.15.49:0/3753126932 >> v1:172.21.15.110:6789/0 conn(0x7f5ca006a1c0 legacy=0x7f5ca00a6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:08.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5ca5400700 1 -- 172.21.15.49:0/3753126932 >> v1:172.21.15.49:6789/0 conn(0x7f5ca01508e0 legacy=0x7f5ca0063e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:08.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5ca5400700 1 -- 172.21.15.49:0/3753126932 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca00c3200 con 0x7f5ca0064530 2024-01-22T05:16:08.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5ca5400700 1 --2- 172.21.15.49:0/3753126932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca0064530 0x7f5ca0154600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f5c98009e90 tx=0x7f5c98009780).ready entity=mon.2 client_cookie=8ccac0e573538ecd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:08.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5c9f400700 1 -- 172.21.15.49:0/3753126932 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9800e070 con 0x7f5ca0064530 2024-01-22T05:16:08.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5c9f400700 1 -- 172.21.15.49:0/3753126932 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9800bab0 con 0x7f5ca0064530 2024-01-22T05:16:08.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5c9f400700 1 -- 172.21.15.49:0/3753126932 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9800be30 con 0x7f5ca0064530 2024-01-22T05:16:08.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5ca7400700 1 -- 172.21.15.49:0/3753126932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca0064530 msgr2=0x7f5ca0154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:08.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.805+0000 7f5ca7400700 1 --2- 172.21.15.49:0/3753126932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca0064530 0x7f5ca0154600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f5c98009e90 tx=0x7f5c98009780).stop 2024-01-22T05:16:08.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.809+0000 7f5ca7400700 1 -- 172.21.15.49:0/3753126932 shutdown_connections 2024-01-22T05:16:08.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.809+0000 7f5ca7400700 1 --2- 172.21.15.49:0/3753126932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca0064530 0x7f5ca0154600 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.809+0000 7f5ca7400700 1 -- 172.21.15.49:0/3753126932 >> 172.21.15.49:0/3753126932 conn(0x7f5ca0066830 msgr2=0x7f5ca0066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:08.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.809+0000 7f5ca7400700 1 -- 172.21.15.49:0/3753126932 shutdown_connections 2024-01-22T05:16:08.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.809+0000 7f5ca7400700 1 -- 172.21.15.49:0/3753126932 wait complete. 2024-01-22T05:16:08.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.809+0000 7f5ca7400700 1 Processor -- start 2024-01-22T05:16:08.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.809+0000 7f5ca7400700 1 -- start start 2024-01-22T05:16:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5ca7400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca0064530 0x7f5ca0153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5ca7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca006a1c0 0x7f5ca00ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5ca7400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca01508e0 0x7f5ca00c1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5ca7400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca0154240 con 0x7f5ca006a1c0 2024-01-22T05:16:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5ca7400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca00ab5a0 con 0x7f5ca01508e0 2024-01-22T05:16:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5ca7400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca00ac3c0 con 0x7f5ca0064530 2024-01-22T05:16:08.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5c9fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca006a1c0 0x7f5ca00ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:08.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5c9fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca006a1c0 0x7f5ca00ac850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45720/0 (socket says 172.21.15.49:45720) 2024-01-22T05:16:08.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5c9fe00700 1 -- 172.21.15.49:0/3442483738 learned_addr learned my addr 172.21.15.49:0/3442483738 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:08.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5ca5400700 1 --2- 172.21.15.49:0/3442483738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca01508e0 0x7f5ca00c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:08.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5ca4a00700 1 --2- 172.21.15.49:0/3442483738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca0064530 0x7f5ca0153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:08.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5c9fe00700 1 -- 172.21.15.49:0/3442483738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca0064530 msgr2=0x7f5ca0153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:08.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5c9fe00700 1 --2- 172.21.15.49:0/3442483738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca0064530 0x7f5ca0153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5c9fe00700 1 -- 172.21.15.49:0/3442483738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca01508e0 msgr2=0x7f5ca00c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:08.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5c9fe00700 1 --2- 172.21.15.49:0/3442483738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca01508e0 0x7f5ca00c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:08.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5c9fe00700 1 -- 172.21.15.49:0/3442483738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c98009a20 con 0x7f5ca006a1c0 2024-01-22T05:16:08.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5ca5400700 1 --2- 172.21.15.49:0/3442483738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca01508e0 0x7f5ca00c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:08.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5c9fe00700 1 --2- 172.21.15.49:0/3442483738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca006a1c0 0x7f5ca00ac850 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f5c8800c490 tx=0x7f5c88007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:08.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5c97e00700 1 -- 172.21.15.49:0/3442483738 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c880070d0 con 0x7f5ca006a1c0 2024-01-22T05:16:08.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5c97e00700 1 -- 172.21.15.49:0/3442483738 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c88007230 con 0x7f5ca006a1c0 2024-01-22T05:16:08.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5ca7400700 1 -- 172.21.15.49:0/3442483738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca00ab7b0 con 0x7f5ca006a1c0 2024-01-22T05:16:08.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.813+0000 7f5c97e00700 1 -- 172.21.15.49:0/3442483738 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c880075b0 con 0x7f5ca006a1c0 2024-01-22T05:16:08.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.817+0000 7f5ca7400700 1 -- 172.21.15.49:0/3442483738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca00abd70 con 0x7f5ca006a1c0 2024-01-22T05:16:08.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.817+0000 7f5ca7400700 1 -- 172.21.15.49:0/3442483738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca00657b0 con 0x7f5ca006a1c0 2024-01-22T05:16:08.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.817+0000 7f5c97e00700 1 -- 172.21.15.49:0/3442483738 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5c880059b0 con 0x7f5ca006a1c0 2024-01-22T05:16:08.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.821+0000 7f5c97e00700 1 --2- 172.21.15.49:0/3442483738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5c7805a4e0 0x7f5c7805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:08.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.821+0000 7f5c97e00700 1 -- 172.21.15.49:0/3442483738 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f5c88073d90 con 0x7f5ca006a1c0 2024-01-22T05:16:08.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.821+0000 7f5ca4a00700 1 --2- 172.21.15.49:0/3442483738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5c7805a4e0 0x7f5c7805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:08.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.821+0000 7f5ca4a00700 1 --2- 172.21.15.49:0/3442483738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5c7805a4e0 0x7f5c7805c9a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f5c90007640 tx=0x7f5c90007bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:08.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.829+0000 7f5c97e00700 1 -- 172.21.15.49:0/3442483738 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5c88047650 con 0x7f5ca006a1c0 2024-01-22T05:16:08.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:08.997+0000 7f5ca7400700 1 -- 172.21.15.49:0/3442483738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5ca0064f70 con 0x7f5ca006a1c0 2024-01-22T05:16:09.520 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:16:09.527 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:16:09.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.785+0000 7f5c97e00700 1 -- 172.21.15.49:0/3442483738 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v141) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5c8804ac70 con 0x7f5ca006a1c0 2024-01-22T05:16:09.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.789+0000 7f5ca7400700 1 -- 172.21.15.49:0/3442483738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5c7805a4e0 msgr2=0x7f5c7805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:09.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.789+0000 7f5ca7400700 1 --2- 172.21.15.49:0/3442483738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5c7805a4e0 0x7f5c7805c9a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f5c90007640 tx=0x7f5c90007bc0).stop 2024-01-22T05:16:09.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.789+0000 7f5ca7400700 1 -- 172.21.15.49:0/3442483738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca006a1c0 msgr2=0x7f5ca00ac850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:09.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.789+0000 7f5ca7400700 1 --2- 172.21.15.49:0/3442483738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca006a1c0 0x7f5ca00ac850 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f5c8800c490 tx=0x7f5c88007d20).stop 2024-01-22T05:16:09.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.789+0000 7f5ca7400700 1 -- 172.21.15.49:0/3442483738 shutdown_connections 2024-01-22T05:16:09.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.789+0000 7f5ca7400700 1 --2- 172.21.15.49:0/3442483738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5c7805a4e0 0x7f5c7805c9a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:09.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.789+0000 7f5ca7400700 1 --2- 172.21.15.49:0/3442483738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca01508e0 0x7f5ca00c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:09.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.789+0000 7f5ca7400700 1 --2- 172.21.15.49:0/3442483738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca006a1c0 0x7f5ca00ac850 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:09.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.789+0000 7f5ca7400700 1 --2- 172.21.15.49:0/3442483738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca0064530 0x7f5ca0153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:09.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.789+0000 7f5ca7400700 1 -- 172.21.15.49:0/3442483738 >> 172.21.15.49:0/3442483738 conn(0x7f5ca0066830 msgr2=0x7f5ca00c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:09.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.789+0000 7f5ca7400700 1 -- 172.21.15.49:0/3442483738 shutdown_connections 2024-01-22T05:16:09.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.789+0000 7f5ca7400700 1 -- 172.21.15.49:0/3442483738 wait complete. 2024-01-22T05:16:09.791 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-01-22T05:16:09.813 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-22T05:16:09.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.981+0000 7f6dff400700 1 Processor -- start 2024-01-22T05:16:09.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.981+0000 7f6dff400700 1 -- start start 2024-01-22T05:16:09.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.981+0000 7f6dff400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6df80c25e0 0x7f6df80a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:09.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.981+0000 7f6dff400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df80c1a40 con 0x7f6df8155d20 2024-01-22T05:16:09.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.981+0000 7f6dff400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df80a90b0 con 0x7f6df80a8740 2024-01-22T05:16:09.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.981+0000 7f6dff400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df8159310 con 0x7f6df80c25e0 2024-01-22T05:16:09.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.981+0000 7f6dfca00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6df8155d20 0x7f6df8065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33232/0 (socket says 172.21.15.49:33232) 2024-01-22T05:16:09.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.981+0000 7f6dfca00700 1 -- 172.21.15.49:0/1424385290 learned_addr learned my addr 172.21.15.49:0/1424385290 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:09.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.981+0000 7f6dfd400700 1 --2- 172.21.15.49:0/1424385290 >> v2:172.21.15.110:3300/0 conn(0x7f6df80c25e0 0x7f6df80a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:09.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422237139 0 0) 0x7f6df80c1a40 con 0x7f6df8155d20 2024-01-22T05:16:09.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dd80033f0 con 0x7f6df8155d20 2024-01-22T05:16:09.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340819256 0 0) 0x7f6df80a90b0 con 0x7f6df80a8740 2024-01-22T05:16:09.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6df80c1a40 con 0x7f6df80a8740 2024-01-22T05:16:09.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 105116841 0 0) 0x7f6dd80033f0 con 0x7f6df8155d20 2024-01-22T05:16:09.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 >> v2:172.21.15.110:3300/0 conn(0x7f6df80c25e0 msgr2=0x7f6df80a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:09.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 --2- 172.21.15.49:0/1424385290 >> v2:172.21.15.110:3300/0 conn(0x7f6df80c25e0 0x7f6df80a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:09.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 >> v1:172.21.15.110:6789/0 conn(0x7f6df80a8740 legacy=0x7f6df80c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:09.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df80c13f0 con 0x7f6df8155d20 2024-01-22T05:16:09.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f6de8001470 con 0x7f6df8155d20 2024-01-22T05:16:09.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 >> v1:172.21.15.49:6789/0 conn(0x7f6df8155d20 legacy=0x7f6df8065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:09.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 --2- 172.21.15.49:0/1424385290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd8003ac0 0x7f6dd8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:09.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 --2- 172.21.15.49:0/1424385290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd8004690 0x7f6dd8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:09.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 --2- 172.21.15.49:0/1424385290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8005000 0x7f6dd800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:09.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df8159310 con 0x7f6dd8004690 2024-01-22T05:16:09.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd800bf60 con 0x7f6dd8005000 2024-01-22T05:16:09.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd800c120 con 0x7f6dd8003ac0 2024-01-22T05:16:09.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7e00700 1 --2- 172.21.15.49:0/1424385290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd8004690 0x7f6dd8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:09.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6dfca00700 1 --2- 172.21.15.49:0/1424385290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd8003ac0 0x7f6dd8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:09.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6dfd400700 1 --2- 172.21.15.49:0/1424385290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8005000 0x7f6dd800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:09.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7e00700 1 -- 172.21.15.49:0/1424385290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd8003ac0 msgr2=0x7f6dd8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:09.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7e00700 1 --2- 172.21.15.49:0/1424385290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd8003ac0 0x7f6dd8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:09.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7e00700 1 -- 172.21.15.49:0/1424385290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8005000 msgr2=0x7f6dd800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:09.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7e00700 1 --2- 172.21.15.49:0/1424385290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8005000 0x7f6dd800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:09.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7e00700 1 -- 172.21.15.49:0/1424385290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd80033f0 con 0x7f6dd8004690 2024-01-22T05:16:09.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6dfd400700 1 -- 172.21.15.49:0/1424385290 reap_dead start 2024-01-22T05:16:09.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6dfca00700 1 --2- 172.21.15.49:0/1424385290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd8003ac0 0x7f6dd8003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7e00700 1 --2- 172.21.15.49:0/1424385290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd8004690 0x7f6dd8004b10 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f6de0001890 tx=0x7f6de0007bb0).ready entity=mon.0 client_cookie=c9931704094f1269 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0007020 con 0x7f6dd8004690 2024-01-22T05:16:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de0007180 con 0x7f6dd8004690 2024-01-22T05:16:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.985+0000 7f6df7400700 1 -- 172.21.15.49:0/1424385290 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0007500 con 0x7f6dd8004690 2024-01-22T05:16:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.989+0000 7f6dff400700 1 -- 172.21.15.49:0/1424385290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd8004690 msgr2=0x7f6dd8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.989+0000 7f6dff400700 1 --2- 172.21.15.49:0/1424385290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd8004690 0x7f6dd8004b10 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f6de0001890 tx=0x7f6de0007bb0).stop 2024-01-22T05:16:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.989+0000 7f6dff400700 1 -- 172.21.15.49:0/1424385290 shutdown_connections 2024-01-22T05:16:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.989+0000 7f6dff400700 1 --2- 172.21.15.49:0/1424385290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd8004690 0x7f6dd8004b10 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:09.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.989+0000 7f6dff400700 1 -- 172.21.15.49:0/1424385290 >> 172.21.15.49:0/1424385290 conn(0x7f6df80c6540 msgr2=0x7f6df80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:09.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.989+0000 7f6dff400700 1 -- 172.21.15.49:0/1424385290 shutdown_connections 2024-01-22T05:16:09.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.989+0000 7f6dff400700 1 -- 172.21.15.49:0/1424385290 wait complete. 2024-01-22T05:16:09.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dff400700 1 Processor -- start 2024-01-22T05:16:09.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dff400700 1 -- start start 2024-01-22T05:16:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dff400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8004690 0x7f6df8152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dff400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df8153e00 0x7f6df8150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dff400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df8151370 0x7f6df815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dff400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df80be040 con 0x7f6df8151370 2024-01-22T05:16:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dff400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df81527c0 con 0x7f6dd8004690 2024-01-22T05:16:09.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dff400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df8152aa0 con 0x7f6df8153e00 2024-01-22T05:16:09.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dfd400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df8151370 0x7f6df815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:09.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dfd400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df8151370 0x7f6df815a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45742/0 (socket says 172.21.15.49:45742) 2024-01-22T05:16:09.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dfd400700 1 -- 172.21.15.49:0/3058580684 learned_addr learned my addr 172.21.15.49:0/3058580684 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:09.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dfca00700 1 --2- 172.21.15.49:0/3058580684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8004690 0x7f6df8152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:09.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6df7e00700 1 --2- 172.21.15.49:0/3058580684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df8153e00 0x7f6df8150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:09.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dfd400700 1 -- 172.21.15.49:0/3058580684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df8153e00 msgr2=0x7f6df8150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:09.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dfd400700 1 --2- 172.21.15.49:0/3058580684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df8153e00 0x7f6df8150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:09.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dfd400700 1 -- 172.21.15.49:0/3058580684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8004690 msgr2=0x7f6df8152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:09.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dfd400700 1 --2- 172.21.15.49:0/3058580684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8004690 0x7f6df8152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:09.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dfd400700 1 -- 172.21.15.49:0/3058580684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df8152d80 con 0x7f6df8151370 2024-01-22T05:16:09.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.993+0000 7f6dfca00700 1 --2- 172.21.15.49:0/3058580684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8004690 0x7f6df8152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:09.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.997+0000 7f6dfd400700 1 --2- 172.21.15.49:0/3058580684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df8151370 0x7f6df815a5c0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7f6df8064620 tx=0x7f6df000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:09.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.997+0000 7f6defe00700 1 -- 172.21.15.49:0/3058580684 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df000e040 con 0x7f6df8151370 2024-01-22T05:16:09.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.997+0000 7f6defe00700 1 -- 172.21.15.49:0/3058580684 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df000f040 con 0x7f6df8151370 2024-01-22T05:16:09.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.997+0000 7f6dff400700 1 -- 172.21.15.49:0/3058580684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df8153060 con 0x7f6df8151370 2024-01-22T05:16:09.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.997+0000 7f6defe00700 1 -- 172.21.15.49:0/3058580684 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df000fe20 con 0x7f6df8151370 2024-01-22T05:16:09.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.997+0000 7f6dff400700 1 -- 172.21.15.49:0/3058580684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df815aab0 con 0x7f6df8151370 2024-01-22T05:16:09.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:09.997+0000 7f6dff400700 1 -- 172.21.15.49:0/3058580684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df80bde10 con 0x7f6df8151370 2024-01-22T05:16:09.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.001+0000 7f6defe00700 1 -- 172.21.15.49:0/3058580684 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6df0015660 con 0x7f6df8151370 2024-01-22T05:16:10.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.001+0000 7f6defe00700 1 --2- 172.21.15.49:0/3058580684 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6dd005a540 0x7f6dd005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:10.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.001+0000 7f6defe00700 1 -- 172.21.15.49:0/3058580684 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f6df0075180 con 0x7f6df8151370 2024-01-22T05:16:10.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.001+0000 7f6dfca00700 1 --2- 172.21.15.49:0/3058580684 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6dd005a540 0x7f6dd005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:10.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.001+0000 7f6dfca00700 1 --2- 172.21.15.49:0/3058580684 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6dd005a540 0x7f6dd005ca00 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f6de80015a0 tx=0x7f6de8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:10.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.009+0000 7f6defe00700 1 -- 172.21.15.49:0/3058580684 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6df80bde10 con 0x7f6df8151370 2024-01-22T05:16:10.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.221+0000 7f6dff400700 1 -- 172.21.15.49:0/3058580684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6df80bde10 con 0x7f6df8151370 2024-01-22T05:16:10.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.221+0000 7f6defe00700 1 -- 172.21.15.49:0/3058580684 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6df80bde10 con 0x7f6df8151370 2024-01-22T05:16:10.220 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:10.220 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:16:10.221 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-01-22T05:16:10.221 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.221 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-01-22T05:16:10.221 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lTCfoJxAAxDGvXKXgooA9/f0J70s6AA==", 2024-01-22T05:16:10.221 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.221 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:16:10.221 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:16:10.221 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:16:10.221 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:16:10.221 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.221 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.221 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.221 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-01-22T05:16:10.221 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lHqV6ORAA1DwpPV2PyDBF/6/ePTdQJw==", 2024-01-22T05:16:10.221 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lPo86MhAAonfC3M+AkLldljODYNGzyA==", 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.222 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lLwvMBxAAFm52HWeGbTH1gbWVm6r5zQ==", 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAt961lH2F9NBAAHm8R9/Q5IuFUvb0o1GyD4Q==", 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:16:10.223 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:16:10.224 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:16:10.224 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.224 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.224 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.224 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-01-22T05:16:10.224 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAx961lS1lEIhAAuDm2OYfTYff1kVEq5vXvFw==", 2024-01-22T05:16:10.224 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.224 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:16:10.224 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:16:10.224 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:16:10.224 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.224 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.224 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.224 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-01-22T05:16:10.224 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA1961limLvERAAv23crKrwjLIg84u48BHHbg==", 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA5961lShJiABAAnvyhz0ggDaITaMgwzi9kAA==", 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.225 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.226 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2024-01-22T05:16:10.226 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA9961lcopfNRAAAZgHzI1t7YHI5cAjaCMiNw==", 2024-01-22T05:16:10.226 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.226 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:16:10.226 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:16:10.226 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:16:10.226 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.226 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.226 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2024-01-22T05:16:10.226 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBB961lX+nTIxAAtP3YQypuFWM5O/LADjvybA==", 2024-01-22T05:16:10.226 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.226 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:16:10.226 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:16:10.226 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:16:10.227 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.227 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.227 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.227 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2024-01-22T05:16:10.227 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBF961lQ4/XERAARZPqENsV3jokk2g3OXUI5w==", 2024-01-22T05:16:10.227 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.227 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:16:10.227 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:16:10.227 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:16:10.227 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.227 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.227 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.227 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2024-01-22T05:16:10.227 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBI961luxnqOhAAGsV74DKQda5cetNA/woOnA==", 2024-01-22T05:16:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:16:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:16:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:16:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-01-22T05:16:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lmrM6DhAAYU09HviWyrUIz4lio15wFw==", 2024-01-22T05:16:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:16:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-01-22T05:16:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-22T05:16:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-01-22T05:16:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lIhYRGRAAFG+YtkDLFsra6zU44xKCHw==", 2024-01-22T05:16:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:16:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:16:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:16:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:16:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2024-01-22T05:16:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lRuyaExAAQO3a7ahOEcuE+WVfXYEBTg==", 2024-01-22T05:16:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:16:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:16:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:16:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:16:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2024-01-22T05:16:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lMiMkHhAAxPdKpcHdtqSphbc/2agq9Q==", 2024-01-22T05:16:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:16:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:16:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:16:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:16:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961ljsweARAAJrY3z/sBjayjB2BRQNrJew==", 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961l0DwDIhAAeuCu79LxNMEJvWiW/BfDhA==", 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:16:10.231 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:16:10.232 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:16:10.232 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.232 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:10.232 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:10.232 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2024-01-22T05:16:10.232 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lZlmPGxAA1KVZR+XzNdoFVo/980hD8w==", 2024-01-22T05:16:10.232 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:16:10.232 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:16:10.232 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:16:10.232 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:16:10.232 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.232 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:10.232 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-01-22T05:16:10.232 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:16:10.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.221+0000 7f6dff400700 1 -- 172.21.15.49:0/3058580684 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6dd005a540 msgr2=0x7f6dd005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:10.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.225+0000 7f6dff400700 1 --2- 172.21.15.49:0/3058580684 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6dd005a540 0x7f6dd005ca00 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f6de80015a0 tx=0x7f6de8009040).stop 2024-01-22T05:16:10.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.225+0000 7f6dff400700 1 -- 172.21.15.49:0/3058580684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df8151370 msgr2=0x7f6df815a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:10.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.225+0000 7f6dff400700 1 --2- 172.21.15.49:0/3058580684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df8151370 0x7f6df815a5c0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7f6df8064620 tx=0x7f6df000b040).stop 2024-01-22T05:16:10.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.225+0000 7f6dff400700 1 -- 172.21.15.49:0/3058580684 shutdown_connections 2024-01-22T05:16:10.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.225+0000 7f6dff400700 1 --2- 172.21.15.49:0/3058580684 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6dd005a540 0x7f6dd005ca00 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.225+0000 7f6dff400700 1 --2- 172.21.15.49:0/3058580684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df8151370 0x7f6df815a5c0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.225+0000 7f6dff400700 1 --2- 172.21.15.49:0/3058580684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6df8153e00 0x7f6df8150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.225+0000 7f6dff400700 1 --2- 172.21.15.49:0/3058580684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8004690 0x7f6df8152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.225+0000 7f6dff400700 1 -- 172.21.15.49:0/3058580684 >> 172.21.15.49:0/3058580684 conn(0x7f6df80c6540 msgr2=0x7f6df80c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:10.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.225+0000 7f6dff400700 1 -- 172.21.15.49:0/3058580684 shutdown_connections 2024-01-22T05:16:10.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.225+0000 7f6dff400700 1 -- 172.21.15.49:0/3058580684 wait complete. 2024-01-22T05:16:10.246 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:16:10.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.405+0000 7f7dc2e00700 1 Processor -- start 2024-01-22T05:16:10.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.405+0000 7f7dc2e00700 1 -- start start 2024-01-22T05:16:10.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.405+0000 7f7dc2e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dbc0c25e0 0x7f7dbc0a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:10.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.405+0000 7f7dc2e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dbc0c1a40 con 0x7f7dbc155d20 2024-01-22T05:16:10.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dc2e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dbc0a90b0 con 0x7f7dbc0a8740 2024-01-22T05:16:10.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dc2e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc159310 con 0x7f7dbc0c25e0 2024-01-22T05:16:10.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbbe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7dbc155d20 0x7f7dbc065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33242/0 (socket says 172.21.15.49:33242) 2024-01-22T05:16:10.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbbe00700 1 -- 172.21.15.49:0/294492660 learned_addr learned my addr 172.21.15.49:0/294492660 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:10.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dc0e00700 1 --2- 172.21.15.49:0/294492660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dbc0c25e0 0x7f7dbc0a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:10.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728718537 0 0) 0x7f7dbc0c1a40 con 0x7f7dbc155d20 2024-01-22T05:16:10.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d9c0033f0 con 0x7f7dbc155d20 2024-01-22T05:16:10.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563589403 0 0) 0x7f7dbc0a90b0 con 0x7f7dbc0a8740 2024-01-22T05:16:10.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dbc0c1a40 con 0x7f7dbc0a8740 2024-01-22T05:16:10.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 464801582 0 0) 0x7f7d9c0033f0 con 0x7f7dbc155d20 2024-01-22T05:16:10.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dbc0c25e0 msgr2=0x7f7dbc0a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:10.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 --2- 172.21.15.49:0/294492660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dbc0c25e0 0x7f7dbc0a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 >> v1:172.21.15.110:6789/0 conn(0x7f7dbc0a8740 legacy=0x7f7dbc0c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc0c13f0 con 0x7f7dbc155d20 2024-01-22T05:16:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f7dac001470 con 0x7f7dbc155d20 2024-01-22T05:16:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 >> v1:172.21.15.49:6789/0 conn(0x7f7dbc155d20 legacy=0x7f7dbc065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 --2- 172.21.15.49:0/294492660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9c003aa0 0x7f7d9c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 --2- 172.21.15.49:0/294492660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dbc0c25e0 0x7f7d9c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 --2- 172.21.15.49:0/294492660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c004b80 0x7f7d9c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc159310 con 0x7f7d9c004b80 2024-01-22T05:16:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c00b940 con 0x7f7d9c003aa0 2024-01-22T05:16:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c00bb00 con 0x7f7dbc0c25e0 2024-01-22T05:16:10.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dc0e00700 1 --2- 172.21.15.49:0/294492660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c004b80 0x7f7d9c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:10.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbb400700 1 --2- 172.21.15.49:0/294492660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dbc0c25e0 0x7f7d9c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:10.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbbe00700 1 --2- 172.21.15.49:0/294492660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9c003aa0 0x7f7d9c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:10.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dc0e00700 1 -- 172.21.15.49:0/294492660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dbc0c25e0 msgr2=0x7f7d9c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dc0e00700 1 --2- 172.21.15.49:0/294492660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dbc0c25e0 0x7f7d9c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dc0e00700 1 -- 172.21.15.49:0/294492660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9c003aa0 msgr2=0x7f7d9c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dc0e00700 1 --2- 172.21.15.49:0/294492660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9c003aa0 0x7f7d9c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dc0e00700 1 -- 172.21.15.49:0/294492660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c0033f0 con 0x7f7d9c004b80 2024-01-22T05:16:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.409+0000 7f7dbb400700 1 --2- 172.21.15.49:0/294492660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dbc0c25e0 0x7f7d9c004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.413+0000 7f7dc0e00700 1 --2- 172.21.15.49:0/294492660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c004b80 0x7f7d9c005000 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f7db400e210 tx=0x7f7db400b040).ready entity=mon.0 client_cookie=dba48163abc704b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.413+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db4009ac0 con 0x7f7d9c004b80 2024-01-22T05:16:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.413+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db400f040 con 0x7f7d9c004b80 2024-01-22T05:16:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.413+0000 7f7dbaa00700 1 -- 172.21.15.49:0/294492660 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db400ecd0 con 0x7f7d9c004b80 2024-01-22T05:16:10.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.413+0000 7f7dc2e00700 1 -- 172.21.15.49:0/294492660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c004b80 msgr2=0x7f7d9c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:10.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.413+0000 7f7dc2e00700 1 --2- 172.21.15.49:0/294492660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d9c004b80 0x7f7d9c005000 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f7db400e210 tx=0x7f7db400b040).stop 2024-01-22T05:16:10.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.413+0000 7f7dc0e00700 1 -- 172.21.15.49:0/294492660 reap_dead start 2024-01-22T05:16:10.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.413+0000 7f7dc2e00700 1 -- 172.21.15.49:0/294492660 shutdown_connections 2024-01-22T05:16:10.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.413+0000 7f7dc2e00700 1 -- 172.21.15.49:0/294492660 >> 172.21.15.49:0/294492660 conn(0x7f7dbc0c6540 msgr2=0x7f7dbc0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:10.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.413+0000 7f7dc2e00700 1 -- 172.21.15.49:0/294492660 shutdown_connections 2024-01-22T05:16:10.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.413+0000 7f7dc2e00700 1 -- 172.21.15.49:0/294492660 wait complete. 2024-01-22T05:16:10.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.417+0000 7f7dc2e00700 1 Processor -- start 2024-01-22T05:16:10.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.417+0000 7f7dc2e00700 1 -- start start 2024-01-22T05:16:10.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dc2e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9c004b80 0x7f7dbc146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:10.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dc2e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dbc146b30 0x7f7dbc15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:10.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dc2e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dbc15aa10 0x7f7dbc0be450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:10.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dc2e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc16c9c0 con 0x7f7dbc146b30 2024-01-22T05:16:10.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dc2e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc15ae50 con 0x7f7d9c004b80 2024-01-22T05:16:10.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dc2e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc16c020 con 0x7f7dbc15aa10 2024-01-22T05:16:10.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dbb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dbc146b30 0x7f7dbc15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:10.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dbb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dbc146b30 0x7f7dbc15a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45758/0 (socket says 172.21.15.49:45758) 2024-01-22T05:16:10.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dbb400700 1 -- 172.21.15.49:0/3671639645 learned_addr learned my addr 172.21.15.49:0/3671639645 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:10.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dbbe00700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9c004b80 0x7f7dbc146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:10.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dc0e00700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dbc15aa10 0x7f7dbc0be450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:10.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dbb400700 1 -- 172.21.15.49:0/3671639645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dbc15aa10 msgr2=0x7f7dbc0be450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:10.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dbb400700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dbc15aa10 0x7f7dbc0be450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dbb400700 1 -- 172.21.15.49:0/3671639645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9c004b80 msgr2=0x7f7dbc146640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dbb400700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9c004b80 0x7f7dbc146640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dbb400700 1 -- 172.21.15.49:0/3671639645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc16c300 con 0x7f7dbc146b30 2024-01-22T05:16:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dbbe00700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9c004b80 0x7f7dbc146640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dc0e00700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dbc15aa10 0x7f7dbc0be450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dbb400700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dbc146b30 0x7f7dbc15a520 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f7da400f8b0 tx=0x7f7da4007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7db3400700 1 -- 172.21.15.49:0/3671639645 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4011590 con 0x7f7dbc146b30 2024-01-22T05:16:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7db3400700 1 -- 172.21.15.49:0/3671639645 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da40116f0 con 0x7f7dbc146b30 2024-01-22T05:16:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dc2e00700 1 -- 172.21.15.49:0/3671639645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dbc16c5e0 con 0x7f7dbc146b30 2024-01-22T05:16:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7db3400700 1 -- 172.21.15.49:0/3671639645 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4011a70 con 0x7f7dbc146b30 2024-01-22T05:16:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.421+0000 7f7dc2e00700 1 -- 172.21.15.49:0/3671639645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dbc0be940 con 0x7f7dbc146b30 2024-01-22T05:16:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.425+0000 7f7dc2e00700 1 -- 172.21.15.49:0/3671639645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dbc064b70 con 0x7f7dbc146b30 2024-01-22T05:16:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.425+0000 7f7db3400700 1 -- 172.21.15.49:0/3671639645 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7da401d3b0 con 0x7f7dbc146b30 2024-01-22T05:16:10.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.425+0000 7f7db3400700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7d9405a510 0x7f7d9405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:10.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.429+0000 7f7db3400700 1 -- 172.21.15.49:0/3671639645 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f7da4073fe0 con 0x7f7dbc146b30 2024-01-22T05:16:10.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.429+0000 7f7dbbe00700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7d9405a510 0x7f7d9405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:10.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.429+0000 7f7dbbe00700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7d9405a510 0x7f7d9405c9d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f7dac007270 tx=0x7f7dac001df0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:10.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.433+0000 7f7db3400700 1 -- 172.21.15.49:0/3671639645 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7dbc064b70 con 0x7f7dbc146b30 2024-01-22T05:16:10.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.609+0000 7f7dc2e00700 1 -- 172.21.15.49:0/3671639645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7dbc16cb00 con 0x7f7dbc146b30 2024-01-22T05:16:10.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.613+0000 7f7db3400700 1 -- 172.21.15.49:0/3671639645 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+13958 (secure 0 0 0) 0x7f7dbc16cb00 con 0x7f7dbc146b30 2024-01-22T05:16:10.613 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:10.614 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":141,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:16:09.779091+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:16:10.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.617+0000 7f7dc2e00700 1 -- 172.21.15.49:0/3671639645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7d9405a510 msgr2=0x7f7d9405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:10.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.617+0000 7f7dc2e00700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7d9405a510 0x7f7d9405c9d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f7dac007270 tx=0x7f7dac001df0).stop 2024-01-22T05:16:10.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.617+0000 7f7dc2e00700 1 -- 172.21.15.49:0/3671639645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dbc146b30 msgr2=0x7f7dbc15a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:10.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.617+0000 7f7dc2e00700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dbc146b30 0x7f7dbc15a520 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f7da400f8b0 tx=0x7f7da4007bb0).stop 2024-01-22T05:16:10.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.617+0000 7f7dc2e00700 1 -- 172.21.15.49:0/3671639645 shutdown_connections 2024-01-22T05:16:10.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.617+0000 7f7dc2e00700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7d9405a510 0x7f7d9405c9d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.617+0000 7f7dc2e00700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dbc15aa10 0x7f7dbc0be450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.617+0000 7f7dc2e00700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dbc146b30 0x7f7dbc15a520 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.617+0000 7f7dc2e00700 1 --2- 172.21.15.49:0/3671639645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9c004b80 0x7f7dbc146640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.617+0000 7f7dc2e00700 1 -- 172.21.15.49:0/3671639645 >> 172.21.15.49:0/3671639645 conn(0x7f7dbc0c6540 msgr2=0x7f7dbc0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:10.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.617+0000 7f7dc2e00700 1 -- 172.21.15.49:0/3671639645 shutdown_connections 2024-01-22T05:16:10.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.617+0000 7f7dc2e00700 1 -- 172.21.15.49:0/3671639645 wait complete. 2024-01-22T05:16:10.640 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:16:10.640 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:16:10.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.813+0000 7f71cb200700 1 Processor -- start 2024-01-22T05:16:10.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.813+0000 7f71cb200700 1 -- start start 2024-01-22T05:16:10.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.817+0000 7f71cb200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f71cc157ee0 0x7f71cc065590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:10.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.817+0000 7f71cb200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f71cc068af0 0x7f71cc065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:10.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.817+0000 7f71cb200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71cc068280 con 0x7f71cc068710 2024-01-22T05:16:10.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.817+0000 7f71cb200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71cc069600 con 0x7f71cc068af0 2024-01-22T05:16:10.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.817+0000 7f71cb200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71cc0c1cc0 con 0x7f71cc157ee0 2024-01-22T05:16:10.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.817+0000 7f71ca800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f71cc068af0 0x7f71cc065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:10.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.817+0000 7f71c9400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f71cc157ee0 0x7f71cc065590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:10.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.817+0000 7f71c9e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f71cc068710 0x7f71cc1577d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:49390/0 (socket says 172.21.15.49:49390) 2024-01-22T05:16:10.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.817+0000 7f71c9e00700 1 -- 172.21.15.49:0/2190451388 learned_addr learned my addr 172.21.15.49:0/2190451388 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:10.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.817+0000 7f71ca800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f71cc068af0 0x7f71cc065a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45768/0 (socket says 172.21.15.49:45768) 2024-01-22T05:16:10.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71ca800700 1 -- 172.21.15.49:0/2190451388 >> v2:172.21.15.110:3300/0 conn(0x7f71cc157ee0 msgr2=0x7f71cc065590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:10.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71ca800700 1 --2- 172.21.15.49:0/2190451388 >> v2:172.21.15.110:3300/0 conn(0x7f71cc157ee0 0x7f71cc065590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71ca800700 1 -- 172.21.15.49:0/2190451388 >> v1:172.21.15.110:6789/0 conn(0x7f71cc068710 legacy=0x7f71cc1577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:10.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71c8a00700 1 -- 172.21.15.49:0/2190451388 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231478651 0 0) 0x7f71cc068280 con 0x7f71cc068710 2024-01-22T05:16:10.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71ca800700 1 -- 172.21.15.49:0/2190451388 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc067c30 con 0x7f71cc068af0 2024-01-22T05:16:10.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71ca800700 1 --2- 172.21.15.49:0/2190451388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71cc068af0 0x7f71cc065a80 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f71cc0c2fa0 tx=0x7f71c4009780).ready entity=mon.0 client_cookie=de8a8e9dbb0b886f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:10.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71c8a00700 1 -- 172.21.15.49:0/2190451388 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400e070 con 0x7f71cc068af0 2024-01-22T05:16:10.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71c8a00700 1 -- 172.21.15.49:0/2190451388 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c400bb60 con 0x7f71cc068af0 2024-01-22T05:16:10.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71c8a00700 1 -- 172.21.15.49:0/2190451388 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4012410 con 0x7f71cc068af0 2024-01-22T05:16:10.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71cb200700 1 -- 172.21.15.49:0/2190451388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71cc068af0 msgr2=0x7f71cc065a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:10.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71cb200700 1 --2- 172.21.15.49:0/2190451388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71cc068af0 0x7f71cc065a80 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f71cc0c2fa0 tx=0x7f71c4009780).stop 2024-01-22T05:16:10.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71cb200700 1 -- 172.21.15.49:0/2190451388 shutdown_connections 2024-01-22T05:16:10.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71cb200700 1 --2- 172.21.15.49:0/2190451388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71cc068af0 0x7f71cc065a80 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71cb200700 1 --2- 172.21.15.49:0/2190451388 >> v2:172.21.15.110:3300/0 conn(0x7f71cc157ee0 0x7f71cc065590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71cb200700 1 -- 172.21.15.49:0/2190451388 >> 172.21.15.49:0/2190451388 conn(0x7f71cc0c6fc0 msgr2=0x7f71cc0c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:10.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71cb200700 1 -- 172.21.15.49:0/2190451388 shutdown_connections 2024-01-22T05:16:10.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.821+0000 7f71cb200700 1 -- 172.21.15.49:0/2190451388 wait complete. 2024-01-22T05:16:10.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.825+0000 7f71cb200700 1 Processor -- start 2024-01-22T05:16:10.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.829+0000 7f71cb200700 1 -- start start 2024-01-22T05:16:10.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.829+0000 7f71cb200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71cc068710 0x7f71cc0bf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:10.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.829+0000 7f71cb200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71cc068af0 0x7f71cc14f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:10.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.829+0000 7f71cb200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71cc157ee0 0x7f71cc1563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:10.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.829+0000 7f71cb200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc0a87b0 con 0x7f71cc157ee0 2024-01-22T05:16:10.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.829+0000 7f71cb200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc0bfd50 con 0x7f71cc068710 2024-01-22T05:16:10.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.829+0000 7f71cb200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc0c0890 con 0x7f71cc068af0 2024-01-22T05:16:10.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.829+0000 7f71ca800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71cc157ee0 0x7f71cc1563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:10.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.829+0000 7f71c9e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71cc068710 0x7f71cc0bf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:10.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.829+0000 7f71ca800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71cc157ee0 0x7f71cc1563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45782/0 (socket says 172.21.15.49:45782) 2024-01-22T05:16:10.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.829+0000 7f71ca800700 1 -- 172.21.15.49:0/2633340051 learned_addr learned my addr 172.21.15.49:0/2633340051 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:10.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.829+0000 7f71c9400700 1 --2- 172.21.15.49:0/2633340051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71cc068af0 0x7f71cc14f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:10.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.833+0000 7f71ca800700 1 -- 172.21.15.49:0/2633340051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71cc068af0 msgr2=0x7f71cc14f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:10.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.833+0000 7f71ca800700 1 --2- 172.21.15.49:0/2633340051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71cc068af0 0x7f71cc14f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.833+0000 7f71ca800700 1 -- 172.21.15.49:0/2633340051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71cc068710 msgr2=0x7f71cc0bf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:10.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.833+0000 7f71ca800700 1 --2- 172.21.15.49:0/2633340051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71cc068710 0x7f71cc0bf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:10.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.833+0000 7f71ca800700 1 -- 172.21.15.49:0/2633340051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4009a20 con 0x7f71cc157ee0 2024-01-22T05:16:10.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.833+0000 7f71ca800700 1 --2- 172.21.15.49:0/2633340051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71cc157ee0 0x7f71cc1563c0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f71cc064dc0 tx=0x7f71c4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:10.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.833+0000 7f71c1600700 1 -- 172.21.15.49:0/2633340051 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4012410 con 0x7f71cc157ee0 2024-01-22T05:16:10.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.833+0000 7f71c1600700 1 -- 172.21.15.49:0/2633340051 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c4009440 con 0x7f71cc157ee0 2024-01-22T05:16:10.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.833+0000 7f71cb200700 1 -- 172.21.15.49:0/2633340051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71cc0bfff0 con 0x7f71cc157ee0 2024-01-22T05:16:10.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.833+0000 7f71c1600700 1 -- 172.21.15.49:0/2633340051 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c401d840 con 0x7f71cc157ee0 2024-01-22T05:16:10.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.833+0000 7f71cb200700 1 -- 172.21.15.49:0/2633340051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71cc0c05b0 con 0x7f71cc157ee0 2024-01-22T05:16:10.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.833+0000 7f71cb200700 1 -- 172.21.15.49:0/2633340051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71cc047060 con 0x7f71cc157ee0 2024-01-22T05:16:10.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.837+0000 7f71c1600700 1 -- 172.21.15.49:0/2633340051 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f71c401dbb0 con 0x7f71cc157ee0 2024-01-22T05:16:10.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.837+0000 7f71c1600700 1 --2- 172.21.15.49:0/2633340051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71a405a560 0x7f71a405ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:10.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.837+0000 7f71c1600700 1 -- 172.21.15.49:0/2633340051 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f71c4076270 con 0x7f71cc157ee0 2024-01-22T05:16:10.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.837+0000 7f71c9e00700 1 --2- 172.21.15.49:0/2633340051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71a405a560 0x7f71a405ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:10.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.841+0000 7f71c9e00700 1 --2- 172.21.15.49:0/2633340051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71a405a560 0x7f71a405ca20 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f71bc004820 tx=0x7f71bc007dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:10.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:10.845+0000 7f71c1600700 1 -- 172.21.15.49:0/2633340051 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f71c4049c00 con 0x7f71cc157ee0 2024-01-22T05:16:11.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.013+0000 7f71cb200700 1 -- 172.21.15.49:0/2633340051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f71cc067f10 con 0x7f71cc157ee0 2024-01-22T05:16:11.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.013+0000 7f71c1600700 1 -- 172.21.15.49:0/2633340051 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v141) v1 ==== 110+0+10 (secure 0 0 0) 0x7f71c401de60 con 0x7f71cc157ee0 2024-01-22T05:16:11.015 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:16:11.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.017+0000 7f71cb200700 1 -- 172.21.15.49:0/2633340051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71a405a560 msgr2=0x7f71a405ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:11.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.017+0000 7f71cb200700 1 --2- 172.21.15.49:0/2633340051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71a405a560 0x7f71a405ca20 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f71bc004820 tx=0x7f71bc007dc0).stop 2024-01-22T05:16:11.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.017+0000 7f71cb200700 1 -- 172.21.15.49:0/2633340051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71cc157ee0 msgr2=0x7f71cc1563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.017+0000 7f71cb200700 1 --2- 172.21.15.49:0/2633340051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71cc157ee0 0x7f71cc1563c0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f71cc064dc0 tx=0x7f71c4009780).stop 2024-01-22T05:16:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.017+0000 7f71cb200700 1 -- 172.21.15.49:0/2633340051 shutdown_connections 2024-01-22T05:16:11.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.017+0000 7f71cb200700 1 --2- 172.21.15.49:0/2633340051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71a405a560 0x7f71a405ca20 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.017+0000 7f71cb200700 1 --2- 172.21.15.49:0/2633340051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71cc157ee0 0x7f71cc1563c0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.017+0000 7f71cb200700 1 --2- 172.21.15.49:0/2633340051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71cc068af0 0x7f71cc14f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.017+0000 7f71cb200700 1 --2- 172.21.15.49:0/2633340051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71cc068710 0x7f71cc0bf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.017+0000 7f71cb200700 1 -- 172.21.15.49:0/2633340051 >> 172.21.15.49:0/2633340051 conn(0x7f71cc0c6fc0 msgr2=0x7f71cc150510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:11.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.017+0000 7f71cb200700 1 -- 172.21.15.49:0/2633340051 shutdown_connections 2024-01-22T05:16:11.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.017+0000 7f71cb200700 1 -- 172.21.15.49:0/2633340051 wait complete. 2024-01-22T05:16:11.040 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:16:11.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.213+0000 7f3a2cc00700 1 Processor -- start 2024-01-22T05:16:11.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.217+0000 7f3a2cc00700 1 -- start start 2024-01-22T05:16:11.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.217+0000 7f3a2cc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3a280bcaa0 0x7f3a280c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:11.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a2cc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3a28150b30 0x7f3a28067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:11.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a2cc00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a280bd0a0 con 0x7f3a281506a0 2024-01-22T05:16:11.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a2cc00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a280bce80 con 0x7f3a280bcaa0 2024-01-22T05:16:11.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a2cc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a280c0fa0 con 0x7f3a28150b30 2024-01-22T05:16:11.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a25e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3a280bcaa0 0x7f3a280c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:11.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a25e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3a280bcaa0 0x7f3a280c1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45792/0 (socket says 172.21.15.49:45792) 2024-01-22T05:16:11.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a25e00700 1 -- 172.21.15.49:0/1854027111 learned_addr learned my addr 172.21.15.49:0/1854027111 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:11.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a26800700 1 --2- 172.21.15.49:0/1854027111 >> v2:172.21.15.110:3300/0 conn(0x7f3a28150b30 0x7f3a28067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:11.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a26800700 1 -- 172.21.15.49:0/1854027111 >> v2:172.21.15.49:3300/0 conn(0x7f3a280bcaa0 msgr2=0x7f3a280c1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:11.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a26800700 1 --2- 172.21.15.49:0/1854027111 >> v2:172.21.15.49:3300/0 conn(0x7f3a280bcaa0 0x7f3a280c1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a26800700 1 -- 172.21.15.49:0/1854027111 >> v1:172.21.15.110:6789/0 conn(0x7f3a281506a0 legacy=0x7f3a280a87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:11.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a26800700 1 -- 172.21.15.49:0/1854027111 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a280c1280 con 0x7f3a28150b30 2024-01-22T05:16:11.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a25e00700 1 --2- 172.21.15.49:0/1854027111 >> v2:172.21.15.49:3300/0 conn(0x7f3a280bcaa0 0x7f3a280c1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:11.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a24a00700 1 -- 172.21.15.49:0/1854027111 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960345087 0 0) 0x7f3a280bd0a0 con 0x7f3a281506a0 2024-01-22T05:16:11.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a26800700 1 --2- 172.21.15.49:0/1854027111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a28150b30 0x7f3a28067a90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f3a280bc050 tx=0x7f3a20009780).ready entity=mon.1 client_cookie=c9e19dfc4f12fe69 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:11.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a24a00700 1 -- 172.21.15.49:0/1854027111 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2000e070 con 0x7f3a28150b30 2024-01-22T05:16:11.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a24a00700 1 -- 172.21.15.49:0/1854027111 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2000bb60 con 0x7f3a28150b30 2024-01-22T05:16:11.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.221+0000 7f3a24a00700 1 -- 172.21.15.49:0/1854027111 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20012410 con 0x7f3a28150b30 2024-01-22T05:16:11.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.225+0000 7f3a2cc00700 1 -- 172.21.15.49:0/1854027111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a28150b30 msgr2=0x7f3a28067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:11.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.225+0000 7f3a2cc00700 1 --2- 172.21.15.49:0/1854027111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a28150b30 0x7f3a28067a90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f3a280bc050 tx=0x7f3a20009780).stop 2024-01-22T05:16:11.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.225+0000 7f3a2cc00700 1 -- 172.21.15.49:0/1854027111 shutdown_connections 2024-01-22T05:16:11.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.225+0000 7f3a2cc00700 1 --2- 172.21.15.49:0/1854027111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a28150b30 0x7f3a28067a90 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.225+0000 7f3a2cc00700 1 --2- 172.21.15.49:0/1854027111 >> v2:172.21.15.49:3300/0 conn(0x7f3a280bcaa0 0x7f3a280c1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.225+0000 7f3a2cc00700 1 -- 172.21.15.49:0/1854027111 >> 172.21.15.49:0/1854027111 conn(0x7f3a28062cb0 msgr2=0x7f3a280c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:11.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.225+0000 7f3a2cc00700 1 -- 172.21.15.49:0/1854027111 shutdown_connections 2024-01-22T05:16:11.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.225+0000 7f3a2cc00700 1 -- 172.21.15.49:0/1854027111 wait complete. 2024-01-22T05:16:11.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.229+0000 7f3a2cc00700 1 Processor -- start 2024-01-22T05:16:11.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.229+0000 7f3a2cc00700 1 -- start start 2024-01-22T05:16:11.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.229+0000 7f3a2cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a280bcaa0 0x7f3a28143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:11.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.229+0000 7f3a2cc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a281506a0 0x7f3a2809fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:11.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.229+0000 7f3a2cc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a28150b30 0x7f3a280a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:11.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.229+0000 7f3a2cc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280a07d0 con 0x7f3a280bcaa0 2024-01-22T05:16:11.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.229+0000 7f3a2cc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a28165410 con 0x7f3a281506a0 2024-01-22T05:16:11.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.229+0000 7f3a2cc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a281656f0 con 0x7f3a28150b30 2024-01-22T05:16:11.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a25e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a280bcaa0 0x7f3a28143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:11.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a25e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a280bcaa0 0x7f3a28143de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45794/0 (socket says 172.21.15.49:45794) 2024-01-22T05:16:11.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a25e00700 1 -- 172.21.15.49:0/1642897433 learned_addr learned my addr 172.21.15.49:0/1642897433 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:11.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a25400700 1 --2- 172.21.15.49:0/1642897433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a281506a0 0x7f3a2809fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:11.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a26800700 1 --2- 172.21.15.49:0/1642897433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a28150b30 0x7f3a280a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:11.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a25e00700 1 -- 172.21.15.49:0/1642897433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a28150b30 msgr2=0x7f3a280a02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:11.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a25e00700 1 --2- 172.21.15.49:0/1642897433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a28150b30 0x7f3a280a02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a25e00700 1 -- 172.21.15.49:0/1642897433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a281506a0 msgr2=0x7f3a2809fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:11.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a25e00700 1 --2- 172.21.15.49:0/1642897433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a281506a0 0x7f3a2809fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a25e00700 1 -- 172.21.15.49:0/1642897433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a18009370 con 0x7f3a280bcaa0 2024-01-22T05:16:11.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a25400700 1 --2- 172.21.15.49:0/1642897433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a281506a0 0x7f3a2809fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:11.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a25e00700 1 --2- 172.21.15.49:0/1642897433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a280bcaa0 0x7f3a28143de0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f3a18006d00 tx=0x7f3a180090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:11.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a1d600700 1 -- 172.21.15.49:0/1642897433 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1800eee0 con 0x7f3a280bcaa0 2024-01-22T05:16:11.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a1d600700 1 -- 172.21.15.49:0/1642897433 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1800c850 con 0x7f3a280bcaa0 2024-01-22T05:16:11.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a2cc00700 1 -- 172.21.15.49:0/1642897433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a20009a20 con 0x7f3a280bcaa0 2024-01-22T05:16:11.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a1d600700 1 -- 172.21.15.49:0/1642897433 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1800cbd0 con 0x7f3a280bcaa0 2024-01-22T05:16:11.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a2cc00700 1 -- 172.21.15.49:0/1642897433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a28165cb0 con 0x7f3a280bcaa0 2024-01-22T05:16:11.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.233+0000 7f3a2cc00700 1 -- 172.21.15.49:0/1642897433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a280c0c00 con 0x7f3a280bcaa0 2024-01-22T05:16:11.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.237+0000 7f3a1d600700 1 -- 172.21.15.49:0/1642897433 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3a1801b400 con 0x7f3a280bcaa0 2024-01-22T05:16:11.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.237+0000 7f3a1d600700 1 --2- 172.21.15.49:0/1642897433 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3a0005a510 0x7f3a0005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:11.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.237+0000 7f3a1d600700 1 -- 172.21.15.49:0/1642897433 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f3a18074b50 con 0x7f3a280bcaa0 2024-01-22T05:16:11.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.237+0000 7f3a25400700 1 --2- 172.21.15.49:0/1642897433 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3a0005a510 0x7f3a0005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:11.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.241+0000 7f3a25400700 1 --2- 172.21.15.49:0/1642897433 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3a0005a510 0x7f3a0005c9d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f3a2814a840 tx=0x7f3a10009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:11.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.245+0000 7f3a1d600700 1 -- 172.21.15.49:0/1642897433 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3a180484c0 con 0x7f3a280bcaa0 2024-01-22T05:16:11.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.413+0000 7f3a2cc00700 1 -- 172.21.15.49:0/1642897433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3a28060060 con 0x7f3a280bcaa0 2024-01-22T05:16:11.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.417+0000 7f3a1d600700 1 -- 172.21.15.49:0/1642897433 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v141) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3a18016070 con 0x7f3a280bcaa0 2024-01-22T05:16:11.415 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:16:11.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.417+0000 7f3a2cc00700 1 -- 172.21.15.49:0/1642897433 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3a0005a510 msgr2=0x7f3a0005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:11.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.417+0000 7f3a2cc00700 1 --2- 172.21.15.49:0/1642897433 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3a0005a510 0x7f3a0005c9d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f3a2814a840 tx=0x7f3a10009040).stop 2024-01-22T05:16:11.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.417+0000 7f3a2cc00700 1 -- 172.21.15.49:0/1642897433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a280bcaa0 msgr2=0x7f3a28143de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:11.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.417+0000 7f3a2cc00700 1 --2- 172.21.15.49:0/1642897433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a280bcaa0 0x7f3a28143de0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f3a18006d00 tx=0x7f3a180090f0).stop 2024-01-22T05:16:11.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.417+0000 7f3a2cc00700 1 -- 172.21.15.49:0/1642897433 shutdown_connections 2024-01-22T05:16:11.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.417+0000 7f3a2cc00700 1 --2- 172.21.15.49:0/1642897433 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3a0005a510 0x7f3a0005c9d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.417+0000 7f3a2cc00700 1 --2- 172.21.15.49:0/1642897433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a28150b30 0x7f3a280a02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.417+0000 7f3a2cc00700 1 --2- 172.21.15.49:0/1642897433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a281506a0 0x7f3a2809fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.417+0000 7f3a2cc00700 1 --2- 172.21.15.49:0/1642897433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a280bcaa0 0x7f3a28143de0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.417+0000 7f3a2cc00700 1 -- 172.21.15.49:0/1642897433 >> 172.21.15.49:0/1642897433 conn(0x7f3a28062cb0 msgr2=0x7f3a280a8890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:11.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.421+0000 7f3a2cc00700 1 -- 172.21.15.49:0/1642897433 shutdown_connections 2024-01-22T05:16:11.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.421+0000 7f3a2cc00700 1 -- 172.21.15.49:0/1642897433 wait complete. 2024-01-22T05:16:11.443 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:16:11.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.601+0000 7f84eaa00700 1 Processor -- start 2024-01-22T05:16:11.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.601+0000 7f84eaa00700 1 -- start start 2024-01-22T05:16:11.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.605+0000 7f84eaa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e4066fb0 0x7f84e40c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:11.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.605+0000 7f84eaa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f84e40a8b10 0x7f84e4157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:11.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.605+0000 7f84eaa00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e40c1ee0 con 0x7f84e40a8f90 2024-01-22T05:16:11.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.605+0000 7f84eaa00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e40c12f0 con 0x7f84e40a8b10 2024-01-22T05:16:11.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.605+0000 7f84eaa00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40c15b0 con 0x7f84e4066fb0 2024-01-22T05:16:11.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.605+0000 7f84e3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f84e40a8b10 0x7f84e4157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:11.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.605+0000 7f84e8a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f84e40a8f90 0x7f84e4065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33254/0 (socket says 172.21.15.49:33254) 2024-01-22T05:16:11.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.605+0000 7f84e8a00700 1 -- 172.21.15.49:0/271698399 learned_addr learned my addr 172.21.15.49:0/271698399 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:11.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.605+0000 7f84e3e00700 1 --2- 172.21.15.49:0/271698399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e4066fb0 0x7f84e40c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:11.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.605+0000 7f84e2a00700 1 -- 172.21.15.49:0/271698399 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154972059 0 0) 0x7f84e40c1ee0 con 0x7f84e40a8f90 2024-01-22T05:16:11.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.605+0000 7f84e2a00700 1 -- 172.21.15.49:0/271698399 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84c40033f0 con 0x7f84e40a8f90 2024-01-22T05:16:11.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.605+0000 7f84e3400700 1 -- 172.21.15.49:0/271698399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e4066fb0 msgr2=0x7f84e40c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:11.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.605+0000 7f84e3400700 1 --2- 172.21.15.49:0/271698399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e4066fb0 0x7f84e40c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.605+0000 7f84e3400700 1 -- 172.21.15.49:0/271698399 >> v1:172.21.15.49:6789/0 conn(0x7f84e40a8f90 legacy=0x7f84e4065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:11.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.605+0000 7f84e3400700 1 -- 172.21.15.49:0/271698399 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e40c1890 con 0x7f84e40a8b10 2024-01-22T05:16:11.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.609+0000 7f84e3400700 1 --2- 172.21.15.49:0/271698399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e40a8b10 0x7f84e4157740 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f84cc009790 tx=0x7f84cc009060).ready entity=mon.0 client_cookie=5eb360a92a52153c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:11.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.609+0000 7f84e2a00700 1 -- 172.21.15.49:0/271698399 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc00d4a0 con 0x7f84e40a8b10 2024-01-22T05:16:11.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.609+0000 7f84e2a00700 1 -- 172.21.15.49:0/271698399 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc00d600 con 0x7f84e40a8b10 2024-01-22T05:16:11.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.609+0000 7f84e2a00700 1 -- 172.21.15.49:0/271698399 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc00d980 con 0x7f84e40a8b10 2024-01-22T05:16:11.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.609+0000 7f84eaa00700 1 -- 172.21.15.49:0/271698399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e40a8b10 msgr2=0x7f84e4157740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:11.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.609+0000 7f84eaa00700 1 --2- 172.21.15.49:0/271698399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e40a8b10 0x7f84e4157740 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f84cc009790 tx=0x7f84cc009060).stop 2024-01-22T05:16:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.609+0000 7f84eaa00700 1 -- 172.21.15.49:0/271698399 shutdown_connections 2024-01-22T05:16:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.609+0000 7f84eaa00700 1 --2- 172.21.15.49:0/271698399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e40a8b10 0x7f84e4157740 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.609+0000 7f84eaa00700 1 --2- 172.21.15.49:0/271698399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e4066fb0 0x7f84e40c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.609+0000 7f84eaa00700 1 -- 172.21.15.49:0/271698399 >> 172.21.15.49:0/271698399 conn(0x7f84e40c6540 msgr2=0x7f84e40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.609+0000 7f84eaa00700 1 -- 172.21.15.49:0/271698399 shutdown_connections 2024-01-22T05:16:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.609+0000 7f84eaa00700 1 -- 172.21.15.49:0/271698399 wait complete. 2024-01-22T05:16:11.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.613+0000 7f84eaa00700 1 Processor -- start 2024-01-22T05:16:11.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84eaa00700 1 -- start start 2024-01-22T05:16:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84eaa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e4066fb0 0x7f84e414b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84eaa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e40a8b10 0x7f84e4164120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84eaa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e40a8f90 0x7f84e40bf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84eaa00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40bfd40 con 0x7f84e40a8b10 2024-01-22T05:16:11.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84eaa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40be620 con 0x7f84e4066fb0 2024-01-22T05:16:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84eaa00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40a96e0 con 0x7f84e40a8f90 2024-01-22T05:16:11.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84e3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e40a8b10 0x7f84e4164120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84e3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e40a8b10 0x7f84e4164120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45816/0 (socket says 172.21.15.49:45816) 2024-01-22T05:16:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84e3400700 1 -- 172.21.15.49:0/4256720322 learned_addr learned my addr 172.21.15.49:0/4256720322 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84e8a00700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e40a8f90 0x7f84e40bf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84e3e00700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e4066fb0 0x7f84e414b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84e3400700 1 -- 172.21.15.49:0/4256720322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e40a8f90 msgr2=0x7f84e40bf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84e3400700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e40a8f90 0x7f84e40bf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84e3400700 1 -- 172.21.15.49:0/4256720322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e4066fb0 msgr2=0x7f84e414b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84e3400700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e4066fb0 0x7f84e414b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84e3400700 1 -- 172.21.15.49:0/4256720322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc0092a0 con 0x7f84e40a8b10 2024-01-22T05:16:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84e8a00700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e40a8f90 0x7f84e40bf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.617+0000 7f84e3e00700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e4066fb0 0x7f84e414b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:11.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.621+0000 7f84e3400700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e40a8b10 0x7f84e4164120 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f84cc010000 tx=0x7f84cc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:11.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.621+0000 7f84db400700 1 -- 172.21.15.49:0/4256720322 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc000c90 con 0x7f84e40a8b10 2024-01-22T05:16:11.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.621+0000 7f84db400700 1 -- 172.21.15.49:0/4256720322 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc00d770 con 0x7f84e40a8b10 2024-01-22T05:16:11.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.621+0000 7f84eaa00700 1 -- 172.21.15.49:0/4256720322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e40a99c0 con 0x7f84e40a8b10 2024-01-22T05:16:11.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.621+0000 7f84db400700 1 -- 172.21.15.49:0/4256720322 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc01d430 con 0x7f84e40a8b10 2024-01-22T05:16:11.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.621+0000 7f84eaa00700 1 -- 172.21.15.49:0/4256720322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e40a9f80 con 0x7f84e40a8b10 2024-01-22T05:16:11.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.621+0000 7f84eaa00700 1 -- 172.21.15.49:0/4256720322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e4047060 con 0x7f84e40a8b10 2024-01-22T05:16:11.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.621+0000 7f84db400700 1 -- 172.21.15.49:0/4256720322 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f84cc01d820 con 0x7f84e40a8b10 2024-01-22T05:16:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.625+0000 7f84db400700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84bc05a510 0x7f84bc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.625+0000 7f84db400700 1 -- 172.21.15.49:0/4256720322 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f84cc075400 con 0x7f84e40a8b10 2024-01-22T05:16:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.625+0000 7f84e3e00700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84bc05a510 0x7f84bc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.625+0000 7f84e3e00700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84bc05a510 0x7f84bc05c9d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f84d4009c00 tx=0x7f84d4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:11.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.629+0000 7f84db400700 1 -- 172.21.15.49:0/4256720322 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f84cc048f20 con 0x7f84e40a8b10 2024-01-22T05:16:11.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.801+0000 7f84eaa00700 1 -- 172.21.15.49:0/4256720322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f84e40c1b70 con 0x7f84e40a8b10 2024-01-22T05:16:11.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.801+0000 7f84db400700 1 -- 172.21.15.49:0/4256720322 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v141) v1 ==== 84+0+143 (secure 0 0 0) 0x7f84cc022090 con 0x7f84e40a8b10 2024-01-22T05:16:11.800 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:11.801 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-22T05:16:11.801 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:11.801 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-01-22T05:16:11.801 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2024-01-22T05:16:11.801 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:16:11.801 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:16:11.801 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2024-01-22T05:16:11.801 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2024-01-22T05:16:11.801 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:11.801 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-22T05:16:11.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.801+0000 7f84eaa00700 1 -- 172.21.15.49:0/4256720322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84bc05a510 msgr2=0x7f84bc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:11.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.801+0000 7f84eaa00700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84bc05a510 0x7f84bc05c9d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f84d4009c00 tx=0x7f84d4008040).stop 2024-01-22T05:16:11.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.801+0000 7f84eaa00700 1 -- 172.21.15.49:0/4256720322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e40a8b10 msgr2=0x7f84e4164120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:11.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.801+0000 7f84eaa00700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e40a8b10 0x7f84e4164120 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f84cc010000 tx=0x7f84cc016000).stop 2024-01-22T05:16:11.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.805+0000 7f84eaa00700 1 -- 172.21.15.49:0/4256720322 shutdown_connections 2024-01-22T05:16:11.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.805+0000 7f84eaa00700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f84bc05a510 0x7f84bc05c9d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.805+0000 7f84eaa00700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84e40a8f90 0x7f84e40bf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.805+0000 7f84eaa00700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e40a8b10 0x7f84e4164120 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.805+0000 7f84eaa00700 1 --2- 172.21.15.49:0/4256720322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e4066fb0 0x7f84e414b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:11.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.805+0000 7f84eaa00700 1 -- 172.21.15.49:0/4256720322 >> 172.21.15.49:0/4256720322 conn(0x7f84e40c6540 msgr2=0x7f84e414d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:11.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.805+0000 7f84eaa00700 1 -- 172.21.15.49:0/4256720322 shutdown_connections 2024-01-22T05:16:11.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:11.805+0000 7f84eaa00700 1 -- 172.21.15.49:0/4256720322 wait complete. 2024-01-22T05:16:11.828 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:16:11.829 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:16:12.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.005+0000 7fddb1600700 1 Processor -- start 2024-01-22T05:16:12.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.005+0000 7fddb1600700 1 -- start start 2024-01-22T05:16:12.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.009+0000 7fddb1600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fddac067a90 0x7fddac067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:12.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.009+0000 7fddb1600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddac066560 con 0x7fddac068cb0 2024-01-22T05:16:12.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.009+0000 7fddb1600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddac068840 con 0x7fddac0683e0 2024-01-22T05:16:12.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.009+0000 7fddb1600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddac0bc930 con 0x7fddac067a90 2024-01-22T05:16:12.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.009+0000 7fddab400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fddac067a90 0x7fddac067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:12.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.009+0000 7fddab400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fddac067a90 0x7fddac067ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45818/0 (socket says 172.21.15.49:45818) 2024-01-22T05:16:12.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.009+0000 7fddab400700 1 -- 172.21.15.49:0/814404498 learned_addr learned my addr 172.21.15.49:0/814404498 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:12.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.009+0000 7fddabe00700 1 --1- 172.21.15.49:0/814404498 >> v1:172.21.15.49:6789/0 conn(0x7fddac068cb0 0x7fddac15b3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33262/0 (socket says 172.21.15.49:33262) 2024-01-22T05:16:12.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.009+0000 7fddab400700 1 -- 172.21.15.49:0/814404498 >> v1:172.21.15.110:6789/0 conn(0x7fddac0683e0 legacy=0x7fddac0c1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:12.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.009+0000 7fddab400700 1 -- 172.21.15.49:0/814404498 >> v1:172.21.15.49:6789/0 conn(0x7fddac068cb0 legacy=0x7fddac15b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:12.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.009+0000 7fddab400700 1 -- 172.21.15.49:0/814404498 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac065950 con 0x7fddac067a90 2024-01-22T05:16:12.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.009+0000 7fddab400700 1 --2- 172.21.15.49:0/814404498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddac067a90 0x7fddac067ef0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7fdd94006fd0 tx=0x7fdd940090f0).ready entity=mon.0 client_cookie=da3fadf5ac709b78 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:12.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.009+0000 7fddaaa00700 1 -- 172.21.15.49:0/814404498 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9400b600 con 0x7fddac067a90 2024-01-22T05:16:12.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.013+0000 7fddaaa00700 1 -- 172.21.15.49:0/814404498 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9400b760 con 0x7fddac067a90 2024-01-22T05:16:12.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.013+0000 7fddaaa00700 1 -- 172.21.15.49:0/814404498 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9400bae0 con 0x7fddac067a90 2024-01-22T05:16:12.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.013+0000 7fddb1600700 1 -- 172.21.15.49:0/814404498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddac067a90 msgr2=0x7fddac067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:12.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.013+0000 7fddb1600700 1 --2- 172.21.15.49:0/814404498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddac067a90 0x7fddac067ef0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7fdd94006fd0 tx=0x7fdd940090f0).stop 2024-01-22T05:16:12.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.013+0000 7fddb1600700 1 -- 172.21.15.49:0/814404498 shutdown_connections 2024-01-22T05:16:12.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.013+0000 7fddb1600700 1 --2- 172.21.15.49:0/814404498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddac067a90 0x7fddac067ef0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:12.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.013+0000 7fddb1600700 1 -- 172.21.15.49:0/814404498 >> 172.21.15.49:0/814404498 conn(0x7fddac0c6f70 msgr2=0x7fddac0c2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:12.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.013+0000 7fddb1600700 1 -- 172.21.15.49:0/814404498 shutdown_connections 2024-01-22T05:16:12.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.013+0000 7fddb1600700 1 -- 172.21.15.49:0/814404498 wait complete. 2024-01-22T05:16:12.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddb1600700 1 Processor -- start 2024-01-22T05:16:12.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddb1600700 1 -- start start 2024-01-22T05:16:12.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddb1600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac067a90 0x7fddac0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:12.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddb1600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddac0683e0 0x7fddac0c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:12.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddb1600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac068cb0 0x7fddac0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:12.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddb1600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac16d220 con 0x7fddac0683e0 2024-01-22T05:16:12.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddb1600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac0c5cc0 con 0x7fddac068cb0 2024-01-22T05:16:12.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddb1600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddac16c5a0 con 0x7fddac067a90 2024-01-22T05:16:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddab400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddac0683e0 0x7fddac0c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddab400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddac0683e0 0x7fddac0c52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45832/0 (socket says 172.21.15.49:45832) 2024-01-22T05:16:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddab400700 1 -- 172.21.15.49:0/1234249830 learned_addr learned my addr 172.21.15.49:0/1234249830 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddb0c00700 1 --2- 172.21.15.49:0/1234249830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac068cb0 0x7fddac0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddabe00700 1 --2- 172.21.15.49:0/1234249830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac067a90 0x7fddac0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddab400700 1 -- 172.21.15.49:0/1234249830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac067a90 msgr2=0x7fddac0a3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddab400700 1 --2- 172.21.15.49:0/1234249830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac067a90 0x7fddac0a3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddab400700 1 -- 172.21.15.49:0/1234249830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac068cb0 msgr2=0x7fddac0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddab400700 1 --2- 172.21.15.49:0/1234249830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac068cb0 0x7fddac0c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddab400700 1 -- 172.21.15.49:0/1234249830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd94009370 con 0x7fddac0683e0 2024-01-22T05:16:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddb0c00700 1 --2- 172.21.15.49:0/1234249830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac068cb0 0x7fddac0c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.017+0000 7fddab400700 1 --2- 172.21.15.49:0/1234249830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddac0683e0 0x7fddac0c52e0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7fddac059bd0 tx=0x7fdd94017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.021+0000 7fdda3400700 1 -- 172.21.15.49:0/1234249830 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9400bae0 con 0x7fddac0683e0 2024-01-22T05:16:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.021+0000 7fdda3400700 1 -- 172.21.15.49:0/1234249830 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd94000c90 con 0x7fddac0683e0 2024-01-22T05:16:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.021+0000 7fddb1600700 1 -- 172.21.15.49:0/1234249830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddac16c880 con 0x7fddac0683e0 2024-01-22T05:16:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.021+0000 7fdda3400700 1 -- 172.21.15.49:0/1234249830 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9401c650 con 0x7fddac0683e0 2024-01-22T05:16:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.021+0000 7fddb1600700 1 -- 172.21.15.49:0/1234249830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddac16ce40 con 0x7fddac0683e0 2024-01-22T05:16:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.021+0000 7fddb1600700 1 -- 172.21.15.49:0/1234249830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddac16d360 con 0x7fddac0683e0 2024-01-22T05:16:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.021+0000 7fdda3400700 1 -- 172.21.15.49:0/1234249830 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdd9401c9c0 con 0x7fddac0683e0 2024-01-22T05:16:12.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.025+0000 7fdda3400700 1 --2- 172.21.15.49:0/1234249830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd8405a510 0x7fdd8405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:12.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.025+0000 7fdda3400700 1 -- 172.21.15.49:0/1234249830 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fdd94076520 con 0x7fddac0683e0 2024-01-22T05:16:12.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.025+0000 7fddabe00700 1 --2- 172.21.15.49:0/1234249830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd8405a510 0x7fdd8405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:12.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.025+0000 7fddabe00700 1 --2- 172.21.15.49:0/1234249830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd8405a510 0x7fdd8405c9d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fdd9c0076b0 tx=0x7fdd9c007bf0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:12.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.029+0000 7fdda3400700 1 -- 172.21.15.49:0/1234249830 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fddac16d360 con 0x7fddac0683e0 2024-01-22T05:16:12.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.197+0000 7fddb1600700 1 -- 172.21.15.49:0/1234249830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fddac16d360 con 0x7fddac0683e0 2024-01-22T05:16:12.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.621+0000 7fdda3400700 1 -- 172.21.15.49:0/1234249830 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v142) v1 ==== 152+0+0 (secure 0 0 0) 0x7fddac16d360 con 0x7fddac0683e0 2024-01-22T05:16:12.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.633+0000 7fddb1600700 1 -- 172.21.15.49:0/1234249830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd8405a510 msgr2=0x7fdd8405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:12.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.633+0000 7fddb1600700 1 --2- 172.21.15.49:0/1234249830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd8405a510 0x7fdd8405c9d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fdd9c0076b0 tx=0x7fdd9c007bf0).stop 2024-01-22T05:16:12.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.633+0000 7fddb1600700 1 -- 172.21.15.49:0/1234249830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddac0683e0 msgr2=0x7fddac0c52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:12.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.633+0000 7fddb1600700 1 --2- 172.21.15.49:0/1234249830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddac0683e0 0x7fddac0c52e0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7fddac059bd0 tx=0x7fdd94017000).stop 2024-01-22T05:16:12.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.637+0000 7fddb1600700 1 -- 172.21.15.49:0/1234249830 shutdown_connections 2024-01-22T05:16:12.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.637+0000 7fddb1600700 1 --2- 172.21.15.49:0/1234249830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdd8405a510 0x7fdd8405c9d0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:12.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.637+0000 7fddb1600700 1 --2- 172.21.15.49:0/1234249830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac068cb0 0x7fddac0c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:12.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.637+0000 7fddb1600700 1 --2- 172.21.15.49:0/1234249830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddac0683e0 0x7fddac0c52e0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:12.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.637+0000 7fddb1600700 1 --2- 172.21.15.49:0/1234249830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac067a90 0x7fddac0a3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:12.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.637+0000 7fddb1600700 1 -- 172.21.15.49:0/1234249830 >> 172.21.15.49:0/1234249830 conn(0x7fddac0c6f70 msgr2=0x7fddac0ac170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.637+0000 7fddb1600700 1 -- 172.21.15.49:0/1234249830 shutdown_connections 2024-01-22T05:16:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.637+0000 7fddb1600700 1 -- 172.21.15.49:0/1234249830 wait complete. 2024-01-22T05:16:12.642 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-01-22T05:16:12.660 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:16:12.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.825+0000 7fac51400700 1 Processor -- start 2024-01-22T05:16:12.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.825+0000 7fac51400700 1 -- start start 2024-01-22T05:16:12.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.829+0000 7fac51400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fac4c064470 0x7fac4c069e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:12.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.829+0000 7fac51400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fac4c154ef0 0x7fac4c0c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:12.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.829+0000 7fac51400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4c154320 con 0x7fac4c154a90 2024-01-22T05:16:12.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.829+0000 7fac51400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4c154600 con 0x7fac4c154ef0 2024-01-22T05:16:12.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.829+0000 7fac51400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4c0c3790 con 0x7fac4c064470 2024-01-22T05:16:12.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.829+0000 7fac50a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fac4c154ef0 0x7fac4c0c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:12.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.829+0000 7fac4b400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fac4c154a90 0x7fac4c0c5180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33270/0 (socket says 172.21.15.49:33270) 2024-01-22T05:16:12.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.829+0000 7fac4b400700 1 -- 172.21.15.49:0/2722607238 learned_addr learned my addr 172.21.15.49:0/2722607238 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:12.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.829+0000 7fac4be00700 1 --2- 172.21.15.49:0/2722607238 >> v2:172.21.15.110:3300/0 conn(0x7fac4c064470 0x7fac4c069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:12.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.829+0000 7fac50a00700 1 -- 172.21.15.49:0/2722607238 >> v2:172.21.15.110:3300/0 conn(0x7fac4c064470 msgr2=0x7fac4c069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:12.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.829+0000 7fac50a00700 1 --2- 172.21.15.49:0/2722607238 >> v2:172.21.15.110:3300/0 conn(0x7fac4c064470 0x7fac4c069e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:12.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.829+0000 7fac50a00700 1 -- 172.21.15.49:0/2722607238 >> v1:172.21.15.49:6789/0 conn(0x7fac4c154a90 legacy=0x7fac4c0c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:12.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.829+0000 7fac4aa00700 1 -- 172.21.15.49:0/2722607238 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225214340 0 0) 0x7fac4c154320 con 0x7fac4c154a90 2024-01-22T05:16:12.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.829+0000 7fac50a00700 1 -- 172.21.15.49:0/2722607238 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c0c3a70 con 0x7fac4c154ef0 2024-01-22T05:16:12.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.833+0000 7fac50a00700 1 --2- 172.21.15.49:0/2722607238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac4c154ef0 0x7fac4c0c6ae0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fac4c0be610 tx=0x7fac44009780).ready entity=mon.0 client_cookie=7a67cfa581457c24 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:12.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.833+0000 7fac4aa00700 1 -- 172.21.15.49:0/2722607238 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4400e070 con 0x7fac4c154ef0 2024-01-22T05:16:12.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.833+0000 7fac4aa00700 1 -- 172.21.15.49:0/2722607238 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4400bb60 con 0x7fac4c154ef0 2024-01-22T05:16:12.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.833+0000 7fac4aa00700 1 -- 172.21.15.49:0/2722607238 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44012410 con 0x7fac4c154ef0 2024-01-22T05:16:12.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.833+0000 7fac51400700 1 -- 172.21.15.49:0/2722607238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac4c154ef0 msgr2=0x7fac4c0c6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:12.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.833+0000 7fac51400700 1 --2- 172.21.15.49:0/2722607238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac4c154ef0 0x7fac4c0c6ae0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fac4c0be610 tx=0x7fac44009780).stop 2024-01-22T05:16:12.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.833+0000 7fac51400700 1 -- 172.21.15.49:0/2722607238 shutdown_connections 2024-01-22T05:16:12.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.833+0000 7fac51400700 1 --2- 172.21.15.49:0/2722607238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac4c154ef0 0x7fac4c0c6ae0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:12.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.833+0000 7fac51400700 1 --2- 172.21.15.49:0/2722607238 >> v2:172.21.15.110:3300/0 conn(0x7fac4c064470 0x7fac4c069e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:12.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.833+0000 7fac51400700 1 -- 172.21.15.49:0/2722607238 >> 172.21.15.49:0/2722607238 conn(0x7fac4c062760 msgr2=0x7fac4c062b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:12.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.833+0000 7fac51400700 1 -- 172.21.15.49:0/2722607238 shutdown_connections 2024-01-22T05:16:12.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.833+0000 7fac51400700 1 -- 172.21.15.49:0/2722607238 wait complete. 2024-01-22T05:16:12.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.837+0000 7fac51400700 1 Processor -- start 2024-01-22T05:16:12.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.837+0000 7fac51400700 1 -- start start 2024-01-22T05:16:12.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac51400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac4c064470 0x7fac4c14d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:12.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac51400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac4c154a90 0x7fac4c152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:12.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac51400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac4c154ef0 0x7fac4c153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:12.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac51400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c153870 con 0x7fac4c154a90 2024-01-22T05:16:12.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac51400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c0c1520 con 0x7fac4c154ef0 2024-01-22T05:16:12.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac51400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c14de70 con 0x7fac4c064470 2024-01-22T05:16:12.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac4b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac4c154a90 0x7fac4c152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:12.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac4b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac4c154a90 0x7fac4c152e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45844/0 (socket says 172.21.15.49:45844) 2024-01-22T05:16:12.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac4b400700 1 -- 172.21.15.49:0/4274098614 learned_addr learned my addr 172.21.15.49:0/4274098614 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:12.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac4be00700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac4c064470 0x7fac4c14d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:12.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac50a00700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac4c154ef0 0x7fac4c153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:12.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac4b400700 1 -- 172.21.15.49:0/4274098614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac4c064470 msgr2=0x7fac4c14d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:12.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac4b400700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac4c064470 0x7fac4c14d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:12.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac4b400700 1 -- 172.21.15.49:0/4274098614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac4c154ef0 msgr2=0x7fac4c153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:12.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac4b400700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac4c154ef0 0x7fac4c153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:12.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac4b400700 1 -- 172.21.15.49:0/4274098614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac44009a20 con 0x7fac4c154a90 2024-01-22T05:16:12.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac4be00700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac4c064470 0x7fac4c14d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:12.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac50a00700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac4c154ef0 0x7fac4c153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:12.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac4b400700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac4c154a90 0x7fac4c152e90 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7fac3400c510 tx=0x7fac34007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:12.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac43400700 1 -- 172.21.15.49:0/4274098614 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac340072e0 con 0x7fac4c154a90 2024-01-22T05:16:12.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac43400700 1 -- 172.21.15.49:0/4274098614 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac34007440 con 0x7fac4c154a90 2024-01-22T05:16:12.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac51400700 1 -- 172.21.15.49:0/4274098614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4c0c0910 con 0x7fac4c154a90 2024-01-22T05:16:12.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac43400700 1 -- 172.21.15.49:0/4274098614 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac340057a0 con 0x7fac4c154a90 2024-01-22T05:16:12.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.841+0000 7fac51400700 1 -- 172.21.15.49:0/4274098614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4c0c0ed0 con 0x7fac4c154a90 2024-01-22T05:16:12.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.845+0000 7fac51400700 1 -- 172.21.15.49:0/4274098614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4c0656d0 con 0x7fac4c154a90 2024-01-22T05:16:12.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.845+0000 7fac43400700 1 -- 172.21.15.49:0/4274098614 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fac34005b90 con 0x7fac4c154a90 2024-01-22T05:16:12.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.849+0000 7fac43400700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac2405a510 0x7fac2405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:12.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.849+0000 7fac43400700 1 -- 172.21.15.49:0/4274098614 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5992+0+0 (secure 0 0 0) 0x7fac34073ff0 con 0x7fac4c154a90 2024-01-22T05:16:12.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.849+0000 7fac4be00700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac2405a510 0x7fac2405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:12.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.849+0000 7fac4be00700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac2405a510 0x7fac2405c9d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fac3c009c00 tx=0x7fac3c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:12.853+0000 7fac43400700 1 -- 172.21.15.49:0/4274098614 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fac340477b0 con 0x7fac4c154a90 2024-01-22T05:16:13.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.021+0000 7fac51400700 1 -- 172.21.15.49:0/4274098614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fac4c0c3d50 con 0x7fac4c154a90 2024-01-22T05:16:13.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.633+0000 7fac43400700 1 -- 172.21.15.49:0/4274098614 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v143) v1 ==== 170+0+0 (secure 0 0 0) 0x7fac3404add0 con 0x7fac4c154a90 2024-01-22T05:16:13.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.641+0000 7fac51400700 1 -- 172.21.15.49:0/4274098614 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac2405a510 msgr2=0x7fac2405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:13.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.641+0000 7fac51400700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac2405a510 0x7fac2405c9d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fac3c009c00 tx=0x7fac3c008040).stop 2024-01-22T05:16:13.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.641+0000 7fac51400700 1 -- 172.21.15.49:0/4274098614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac4c154a90 msgr2=0x7fac4c152e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:13.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.641+0000 7fac51400700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac4c154a90 0x7fac4c152e90 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7fac3400c510 tx=0x7fac34007c70).stop 2024-01-22T05:16:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.645+0000 7fac51400700 1 -- 172.21.15.49:0/4274098614 shutdown_connections 2024-01-22T05:16:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.645+0000 7fac51400700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac2405a510 0x7fac2405c9d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.645+0000 7fac51400700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac4c154ef0 0x7fac4c153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.645+0000 7fac51400700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac4c154a90 0x7fac4c152e90 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.645+0000 7fac51400700 1 --2- 172.21.15.49:0/4274098614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac4c064470 0x7fac4c14d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.645+0000 7fac51400700 1 -- 172.21.15.49:0/4274098614 >> 172.21.15.49:0/4274098614 conn(0x7fac4c062760 msgr2=0x7fac4c0c6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:13.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.645+0000 7fac51400700 1 -- 172.21.15.49:0/4274098614 shutdown_connections 2024-01-22T05:16:13.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.645+0000 7fac51400700 1 -- 172.21.15.49:0/4274098614 wait complete. 2024-01-22T05:16:13.652 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-01-22T05:16:13.678 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:16:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.833+0000 7f8316a00700 1 Processor -- start 2024-01-22T05:16:13.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.833+0000 7f8316a00700 1 -- start start 2024-01-22T05:16:13.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.833+0000 7f8316a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f83100a8c20 0x7f83100c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:13.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.833+0000 7f8316a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83100c1ac0 0x7f83100bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:13.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.833+0000 7f8316a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f83100bc9c0 0x7f8310068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:13.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.833+0000 7f8316a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8310158650 con 0x7f83100a8c20 2024-01-22T05:16:13.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.833+0000 7f8316a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83100c1f20 con 0x7f83100bc9c0 2024-01-22T05:16:13.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.833+0000 7f8316a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83100bd170 con 0x7f83100c1ac0 2024-01-22T05:16:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.833+0000 7f830fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f83100a8c20 0x7f83100c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f830fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f83100a8c20 0x7f83100c15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34100/0 (socket says 172.21.15.49:34100) 2024-01-22T05:16:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f830fe00700 1 -- 172.21.15.49:0/3133208857 learned_addr learned my addr 172.21.15.49:0/3133208857 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f830f400700 1 --2- 172.21.15.49:0/3133208857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83100c1ac0 0x7f83100bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f8314a00700 1 --2- 172.21.15.49:0/3133208857 >> v2:172.21.15.110:3300/0 conn(0x7f83100bc9c0 0x7f8310068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f830fe00700 1 -- 172.21.15.49:0/3133208857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83100c1ac0 msgr2=0x7f83100bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f830fe00700 1 --2- 172.21.15.49:0/3133208857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83100c1ac0 0x7f83100bc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f830fe00700 1 -- 172.21.15.49:0/3133208857 >> v2:172.21.15.110:3300/0 conn(0x7f83100bc9c0 msgr2=0x7f8310068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f830fe00700 1 --2- 172.21.15.49:0/3133208857 >> v2:172.21.15.110:3300/0 conn(0x7f83100bc9c0 0x7f8310068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f830fe00700 1 -- 172.21.15.49:0/3133208857 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8310067c30 con 0x7f83100a8c20 2024-01-22T05:16:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f830f400700 1 --2- 172.21.15.49:0/3133208857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83100c1ac0 0x7f83100bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:13.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f830fe00700 1 --2- 172.21.15.49:0/3133208857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83100a8c20 0x7f83100c15d0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f83100c7320 tx=0x7f83000090f0).ready entity=mon.0 client_cookie=3c25420e739344af server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:13.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f830ea00700 1 -- 172.21.15.49:0/3133208857 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830000b600 con 0x7f83100a8c20 2024-01-22T05:16:13.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f830ea00700 1 -- 172.21.15.49:0/3133208857 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830000b760 con 0x7f83100a8c20 2024-01-22T05:16:13.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f830ea00700 1 -- 172.21.15.49:0/3133208857 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830000bae0 con 0x7f83100a8c20 2024-01-22T05:16:13.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f8316a00700 1 -- 172.21.15.49:0/3133208857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83100a8c20 msgr2=0x7f83100c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:13.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f8316a00700 1 --2- 172.21.15.49:0/3133208857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83100a8c20 0x7f83100c15d0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f83100c7320 tx=0x7f83000090f0).stop 2024-01-22T05:16:13.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f8316a00700 1 -- 172.21.15.49:0/3133208857 shutdown_connections 2024-01-22T05:16:13.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f8316a00700 1 --2- 172.21.15.49:0/3133208857 >> v2:172.21.15.110:3300/0 conn(0x7f83100bc9c0 0x7f8310068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:13.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f8316a00700 1 --2- 172.21.15.49:0/3133208857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83100c1ac0 0x7f83100bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:13.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f8316a00700 1 --2- 172.21.15.49:0/3133208857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83100a8c20 0x7f83100c15d0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:13.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f8316a00700 1 -- 172.21.15.49:0/3133208857 >> 172.21.15.49:0/3133208857 conn(0x7f8310062cb0 msgr2=0x7f83100c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:13.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f8316a00700 1 -- 172.21.15.49:0/3133208857 shutdown_connections 2024-01-22T05:16:13.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.837+0000 7f8316a00700 1 -- 172.21.15.49:0/3133208857 wait complete. 2024-01-22T05:16:13.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.841+0000 7f8316a00700 1 Processor -- start 2024-01-22T05:16:13.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.841+0000 7f8316a00700 1 -- start start 2024-01-22T05:16:13.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f8316a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83100a8c20 0x7f83101683c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:13.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f8316a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83100bc9c0 0x7f831016b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:13.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f8316a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83100c1ac0 0x7f831009fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:13.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f8316a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83100bf3b0 con 0x7f83100a8c20 2024-01-22T05:16:13.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f8316a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83101688b0 con 0x7f83100c1ac0 2024-01-22T05:16:13.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f8316a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83100be7a0 con 0x7f83100bc9c0 2024-01-22T05:16:13.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f830f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83100bc9c0 0x7f831016b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:13.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f830fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83100a8c20 0x7f83101683c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:13.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f830f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83100bc9c0 0x7f831016b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:50994/0 (socket says 172.21.15.49:50994) 2024-01-22T05:16:13.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f830f400700 1 -- 172.21.15.49:0/536569624 learned_addr learned my addr 172.21.15.49:0/536569624 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:13.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f8314a00700 1 --2- 172.21.15.49:0/536569624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83100c1ac0 0x7f831009fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:13.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f830fe00700 1 -- 172.21.15.49:0/536569624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83100bc9c0 msgr2=0x7f831016b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:13.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f830fe00700 1 --2- 172.21.15.49:0/536569624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83100bc9c0 0x7f831016b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:13.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f830fe00700 1 -- 172.21.15.49:0/536569624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83100c1ac0 msgr2=0x7f831009fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:13.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f830fe00700 1 --2- 172.21.15.49:0/536569624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83100c1ac0 0x7f831009fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:13.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f830fe00700 1 -- 172.21.15.49:0/536569624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300009370 con 0x7f83100a8c20 2024-01-22T05:16:13.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f830fe00700 1 --2- 172.21.15.49:0/536569624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83100a8c20 0x7f83101683c0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f83100c4300 tx=0x7f8300017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:13.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f8307400700 1 -- 172.21.15.49:0/536569624 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830000bea0 con 0x7f83100a8c20 2024-01-22T05:16:13.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f8307400700 1 -- 172.21.15.49:0/536569624 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830000b8d0 con 0x7f83100a8c20 2024-01-22T05:16:13.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f8316a00700 1 -- 172.21.15.49:0/536569624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83100bea80 con 0x7f83100a8c20 2024-01-22T05:16:13.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f8307400700 1 -- 172.21.15.49:0/536569624 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830001b660 con 0x7f83100a8c20 2024-01-22T05:16:13.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.845+0000 7f8316a00700 1 -- 172.21.15.49:0/536569624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83100bf040 con 0x7f83100a8c20 2024-01-22T05:16:13.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.849+0000 7f8316a00700 1 -- 172.21.15.49:0/536569624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83100c0c00 con 0x7f83100a8c20 2024-01-22T05:16:13.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.849+0000 7f8307400700 1 -- 172.21.15.49:0/536569624 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f830001ba10 con 0x7f83100a8c20 2024-01-22T05:16:13.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.849+0000 7f8307400700 1 --2- 172.21.15.49:0/536569624 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82e805a540 0x7f82e805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:13.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.849+0000 7f8307400700 1 -- 172.21.15.49:0/536569624 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f8300076110 con 0x7f83100a8c20 2024-01-22T05:16:13.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.853+0000 7f830f400700 1 --2- 172.21.15.49:0/536569624 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82e805a540 0x7f82e805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:13.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.853+0000 7f830f400700 1 --2- 172.21.15.49:0/536569624 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82e805a540 0x7f82e805ca00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f8310157050 tx=0x7f82f8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:13.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:13.861+0000 7f8307400700 1 -- 172.21.15.49:0/536569624 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f83000497f0 con 0x7f83100a8c20 2024-01-22T05:16:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.065+0000 7f8316a00700 1 -- 172.21.15.49:0/536569624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8310067f10 con 0x7f83100a8c20 2024-01-22T05:16:14.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.077+0000 7f8307400700 1 -- 172.21.15.49:0/536569624 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v110) v1 ==== 174+0+0 (secure 0 0 0) 0x7f83000290c0 con 0x7f83100a8c20 2024-01-22T05:16:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.085+0000 7f8316a00700 1 -- 172.21.15.49:0/536569624 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82e805a540 msgr2=0x7f82e805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.085+0000 7f8316a00700 1 --2- 172.21.15.49:0/536569624 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82e805a540 0x7f82e805ca00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f8310157050 tx=0x7f82f8008040).stop 2024-01-22T05:16:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.085+0000 7f8316a00700 1 -- 172.21.15.49:0/536569624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83100a8c20 msgr2=0x7f83101683c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.085+0000 7f8316a00700 1 --2- 172.21.15.49:0/536569624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83100a8c20 0x7f83101683c0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f83100c4300 tx=0x7f8300017000).stop 2024-01-22T05:16:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.089+0000 7f8316a00700 1 -- 172.21.15.49:0/536569624 shutdown_connections 2024-01-22T05:16:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.089+0000 7f8316a00700 1 --2- 172.21.15.49:0/536569624 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f82e805a540 0x7f82e805ca00 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.089+0000 7f8316a00700 1 --2- 172.21.15.49:0/536569624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83100c1ac0 0x7f831009fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.089+0000 7f8316a00700 1 --2- 172.21.15.49:0/536569624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83100bc9c0 0x7f831016b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.089+0000 7f8316a00700 1 --2- 172.21.15.49:0/536569624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83100a8c20 0x7f83101683c0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.089+0000 7f8316a00700 1 -- 172.21.15.49:0/536569624 >> 172.21.15.49:0/536569624 conn(0x7f8310062cb0 msgr2=0x7f83100c6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.089+0000 7f8316a00700 1 -- 172.21.15.49:0/536569624 shutdown_connections 2024-01-22T05:16:14.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.089+0000 7f8316a00700 1 -- 172.21.15.49:0/536569624 wait complete. 2024-01-22T05:16:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 20 and data pool 21 2024-01-22T05:16:14.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:16:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.273+0000 7fcf2fa00700 1 Processor -- start 2024-01-22T05:16:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.273+0000 7fcf2fa00700 1 -- start start 2024-01-22T05:16:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2fa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf28062230 0x7fcf281507c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2fa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf280681a0 0x7fcf280bf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2fa00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf280c37d0 con 0x7fcf28062610 2024-01-22T05:16:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2fa00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf280c3a20 con 0x7fcf28062230 2024-01-22T05:16:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2fa00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280c3d00 con 0x7fcf280681a0 2024-01-22T05:16:14.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2d000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf28062230 0x7fcf281507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:14.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2d000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf28062230 0x7fcf281507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34118/0 (socket says 172.21.15.49:34118) 2024-01-22T05:16:14.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2d000700 1 -- 172.21.15.49:0/2766484468 learned_addr learned my addr 172.21.15.49:0/2766484468 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:14.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2e400700 1 --2- 172.21.15.49:0/2766484468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf280681a0 0x7fcf280bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:14.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf27400700 1 -- 172.21.15.49:0/2766484468 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878001982 0 0) 0x7fcf280c37d0 con 0x7fcf28062610 2024-01-22T05:16:14.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2d000700 1 -- 172.21.15.49:0/2766484468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf280681a0 msgr2=0x7fcf280bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:14.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2d000700 1 --2- 172.21.15.49:0/2766484468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf280681a0 0x7fcf280bf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2d000700 1 -- 172.21.15.49:0/2766484468 >> v1:172.21.15.49:6789/0 conn(0x7fcf28062610 legacy=0x7fcf28067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:14.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2d000700 1 -- 172.21.15.49:0/2766484468 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf280c3fe0 con 0x7fcf28062230 2024-01-22T05:16:14.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2d000700 1 --2- 172.21.15.49:0/2766484468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf28062230 0x7fcf281507c0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7fcf18006fd0 tx=0x7fcf180090f0).ready entity=mon.0 client_cookie=154801837f9711fe server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf27400700 1 -- 172.21.15.49:0/2766484468 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800b600 con 0x7fcf28062230 2024-01-22T05:16:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf27400700 1 -- 172.21.15.49:0/2766484468 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1800b760 con 0x7fcf28062230 2024-01-22T05:16:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf27400700 1 -- 172.21.15.49:0/2766484468 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800bae0 con 0x7fcf28062230 2024-01-22T05:16:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2fa00700 1 -- 172.21.15.49:0/2766484468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf28062230 msgr2=0x7fcf281507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.277+0000 7fcf2fa00700 1 --2- 172.21.15.49:0/2766484468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf28062230 0x7fcf281507c0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7fcf18006fd0 tx=0x7fcf180090f0).stop 2024-01-22T05:16:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.281+0000 7fcf2fa00700 1 -- 172.21.15.49:0/2766484468 shutdown_connections 2024-01-22T05:16:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.281+0000 7fcf2fa00700 1 --2- 172.21.15.49:0/2766484468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf280681a0 0x7fcf280bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.281+0000 7fcf2fa00700 1 --2- 172.21.15.49:0/2766484468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf28062230 0x7fcf281507c0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.281+0000 7fcf2fa00700 1 -- 172.21.15.49:0/2766484468 >> 172.21.15.49:0/2766484468 conn(0x7fcf28064080 msgr2=0x7fcf28064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.281+0000 7fcf2fa00700 1 -- 172.21.15.49:0/2766484468 shutdown_connections 2024-01-22T05:16:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.281+0000 7fcf2fa00700 1 -- 172.21.15.49:0/2766484468 wait complete. 2024-01-22T05:16:14.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.281+0000 7fcf2fa00700 1 Processor -- start 2024-01-22T05:16:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.281+0000 7fcf2fa00700 1 -- start start 2024-01-22T05:16:14.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf2fa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf28062230 0x7fcf2814f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:14.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf2fa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf28062610 0x7fcf28062f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:14.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf2fa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf280681a0 0x7fcf28164a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:14.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf2fa00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280a5f80 con 0x7fcf28062610 2024-01-22T05:16:14.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf2fa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280a5c80 con 0x7fcf28062230 2024-01-22T05:16:14.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf2fa00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280a3f50 con 0x7fcf280681a0 2024-01-22T05:16:14.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf27e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf28062610 0x7fcf28062f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:14.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf27e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf28062610 0x7fcf28062f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34128/0 (socket says 172.21.15.49:34128) 2024-01-22T05:16:14.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf27e00700 1 -- 172.21.15.49:0/3176206811 learned_addr learned my addr 172.21.15.49:0/3176206811 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:14.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf2e400700 1 --2- 172.21.15.49:0/3176206811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf280681a0 0x7fcf28164a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:14.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf2d000700 1 --2- 172.21.15.49:0/3176206811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf28062230 0x7fcf2814f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:14.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf27e00700 1 -- 172.21.15.49:0/3176206811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf280681a0 msgr2=0x7fcf28164a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:14.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf27e00700 1 --2- 172.21.15.49:0/3176206811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf280681a0 0x7fcf28164a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf27e00700 1 -- 172.21.15.49:0/3176206811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf28062230 msgr2=0x7fcf2814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:14.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf27e00700 1 --2- 172.21.15.49:0/3176206811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf28062230 0x7fcf2814f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf27e00700 1 -- 172.21.15.49:0/3176206811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf18009370 con 0x7fcf28062610 2024-01-22T05:16:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf27e00700 1 --2- 172.21.15.49:0/3176206811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf28062610 0x7fcf28062f70 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7fcf10007fd0 tx=0x7fcf10007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf1fe00700 1 -- 172.21.15.49:0/3176206811 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000ce20 con 0x7fcf28062610 2024-01-22T05:16:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf1fe00700 1 -- 172.21.15.49:0/3176206811 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1000f470 con 0x7fcf28062610 2024-01-22T05:16:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf1fe00700 1 -- 172.21.15.49:0/3176206811 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000f830 con 0x7fcf28062610 2024-01-22T05:16:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.285+0000 7fcf2fa00700 1 -- 172.21.15.49:0/3176206811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf280a4230 con 0x7fcf28062610 2024-01-22T05:16:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.289+0000 7fcf2fa00700 1 -- 172.21.15.49:0/3176206811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf280a4510 con 0x7fcf28062610 2024-01-22T05:16:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.289+0000 7fcf2fa00700 1 -- 172.21.15.49:0/3176206811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf280a5ae0 con 0x7fcf28062610 2024-01-22T05:16:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.289+0000 7fcf1fe00700 1 -- 172.21.15.49:0/3176206811 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcf1000fba0 con 0x7fcf28062610 2024-01-22T05:16:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.289+0000 7fcf1fe00700 1 --2- 172.21.15.49:0/3176206811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcf0005a540 0x7fcf0005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.289+0000 7fcf1fe00700 1 -- 172.21.15.49:0/3176206811 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fcf10073d90 con 0x7fcf28062610 2024-01-22T05:16:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.289+0000 7fcf2d000700 1 --2- 172.21.15.49:0/3176206811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcf0005a540 0x7fcf0005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.293+0000 7fcf2d000700 1 --2- 172.21.15.49:0/3176206811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcf0005a540 0x7fcf0005ca00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fcf18009130 tx=0x7fcf18017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:14.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.297+0000 7fcf1fe00700 1 -- 172.21.15.49:0/3176206811 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcf280a5ae0 con 0x7fcf28062610 2024-01-22T05:16:14.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.461+0000 7fcf2fa00700 1 -- 172.21.15.49:0/3176206811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf28047060 con 0x7fcf28062610 2024-01-22T05:16:14.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.465+0000 7fcf1fe00700 1 -- 172.21.15.49:0/3176206811 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+17191 (secure 0 0 0) 0x7fcf10047410 con 0x7fcf28062610 2024-01-22T05:16:14.464 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:14.464 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":144,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:16:14.067221+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:16:12.266975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-01-22T05:16:13.093952+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:16:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.465+0000 7fcf2fa00700 1 -- 172.21.15.49:0/3176206811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcf0005a540 msgr2=0x7fcf0005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.465+0000 7fcf2fa00700 1 --2- 172.21.15.49:0/3176206811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcf0005a540 0x7fcf0005ca00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fcf18009130 tx=0x7fcf18017000).stop 2024-01-22T05:16:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.465+0000 7fcf2fa00700 1 -- 172.21.15.49:0/3176206811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf28062610 msgr2=0x7fcf28062f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.465+0000 7fcf2fa00700 1 --2- 172.21.15.49:0/3176206811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf28062610 0x7fcf28062f70 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7fcf10007fd0 tx=0x7fcf10007c40).stop 2024-01-22T05:16:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.465+0000 7fcf2fa00700 1 -- 172.21.15.49:0/3176206811 shutdown_connections 2024-01-22T05:16:14.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.465+0000 7fcf2fa00700 1 --2- 172.21.15.49:0/3176206811 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcf0005a540 0x7fcf0005ca00 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.465+0000 7fcf2fa00700 1 --2- 172.21.15.49:0/3176206811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf280681a0 0x7fcf28164a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.465+0000 7fcf2fa00700 1 --2- 172.21.15.49:0/3176206811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf28062610 0x7fcf28062f70 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.465+0000 7fcf2fa00700 1 --2- 172.21.15.49:0/3176206811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf28062230 0x7fcf2814f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.465+0000 7fcf2fa00700 1 -- 172.21.15.49:0/3176206811 >> 172.21.15.49:0/3176206811 conn(0x7fcf28064080 msgr2=0x7fcf280ac770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:14.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.469+0000 7fcf2fa00700 1 -- 172.21.15.49:0/3176206811 shutdown_connections 2024-01-22T05:16:14.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.469+0000 7fcf2fa00700 1 -- 172.21.15.49:0/3176206811 wait complete. 2024-01-22T05:16:14.490 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:16:14.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.645+0000 7fa23f000700 1 Processor -- start 2024-01-22T05:16:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.645+0000 7fa23f000700 1 -- start start 2024-01-22T05:16:14.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.649+0000 7fa23f000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa2380c25e0 0x7fa2380a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:14.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.649+0000 7fa23f000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2380c1a40 con 0x7fa238155d20 2024-01-22T05:16:14.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.649+0000 7fa23f000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2380a90b0 con 0x7fa2380a8740 2024-01-22T05:16:14.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.649+0000 7fa23f000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa238159310 con 0x7fa2380c25e0 2024-01-22T05:16:14.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.649+0000 7fa237e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa238155d20 0x7fa238065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45490/0 (socket says 172.21.15.49:45490) 2024-01-22T05:16:14.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.649+0000 7fa237e00700 1 -- 172.21.15.49:0/1532275026 learned_addr learned my addr 172.21.15.49:0/1532275026 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:14.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.649+0000 7fa23d000700 1 --2- 172.21.15.49:0/1532275026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa2380c25e0 0x7fa2380a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:14.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.649+0000 7fa23d000700 1 -- 172.21.15.49:0/1532275026 >> v1:172.21.15.110:6789/0 conn(0x7fa2380a8740 legacy=0x7fa2380c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:14.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.649+0000 7fa23d000700 1 -- 172.21.15.49:0/1532275026 >> v1:172.21.15.49:6789/0 conn(0x7fa238155d20 legacy=0x7fa238065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:14.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.649+0000 7fa23d000700 1 -- 172.21.15.49:0/1532275026 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2380c13f0 con 0x7fa2380c25e0 2024-01-22T05:16:14.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.649+0000 7fa23d000700 1 --2- 172.21.15.49:0/1532275026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa2380c25e0 0x7fa2380a8bc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fa230009e90 tx=0x7fa230009780).ready entity=mon.2 client_cookie=ec40c0fded7d87e5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.653+0000 7fa236a00700 1 -- 172.21.15.49:0/1532275026 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23000e070 con 0x7fa2380c25e0 2024-01-22T05:16:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.653+0000 7fa236a00700 1 -- 172.21.15.49:0/1532275026 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23000bc30 con 0x7fa2380c25e0 2024-01-22T05:16:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.653+0000 7fa236a00700 1 -- 172.21.15.49:0/1532275026 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa230012410 con 0x7fa2380c25e0 2024-01-22T05:16:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.653+0000 7fa23f000700 1 -- 172.21.15.49:0/1532275026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa2380c25e0 msgr2=0x7fa2380a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.653+0000 7fa23f000700 1 --2- 172.21.15.49:0/1532275026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa2380c25e0 0x7fa2380a8bc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fa230009e90 tx=0x7fa230009780).stop 2024-01-22T05:16:14.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.653+0000 7fa23f000700 1 -- 172.21.15.49:0/1532275026 shutdown_connections 2024-01-22T05:16:14.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.653+0000 7fa23f000700 1 --2- 172.21.15.49:0/1532275026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa2380c25e0 0x7fa2380a8bc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.653+0000 7fa23f000700 1 -- 172.21.15.49:0/1532275026 >> 172.21.15.49:0/1532275026 conn(0x7fa2380c6540 msgr2=0x7fa2380c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:14.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.657+0000 7fa23f000700 1 -- 172.21.15.49:0/1532275026 shutdown_connections 2024-01-22T05:16:14.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.657+0000 7fa23f000700 1 -- 172.21.15.49:0/1532275026 wait complete. 2024-01-22T05:16:14.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.657+0000 7fa23f000700 1 Processor -- start 2024-01-22T05:16:14.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.661+0000 7fa23f000700 1 -- start start 2024-01-22T05:16:14.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.661+0000 7fa23f000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2380a8740 0x7fa238150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:14.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.661+0000 7fa23f000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2380c25e0 0x7fa238067df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:14.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.661+0000 7fa23f000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa238155d20 0x7fa238152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:14.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.661+0000 7fa23f000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa238151b20 con 0x7fa2380c25e0 2024-01-22T05:16:14.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.661+0000 7fa23f000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2380683b0 con 0x7fa2380a8740 2024-01-22T05:16:14.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.661+0000 7fa23f000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2381511f0 con 0x7fa238155d20 2024-01-22T05:16:14.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.661+0000 7fa237400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2380c25e0 0x7fa238067df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:14.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.661+0000 7fa237400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2380c25e0 0x7fa238067df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34142/0 (socket says 172.21.15.49:34142) 2024-01-22T05:16:14.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.661+0000 7fa237400700 1 -- 172.21.15.49:0/2482662247 learned_addr learned my addr 172.21.15.49:0/2482662247 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.661+0000 7fa23d000700 1 --2- 172.21.15.49:0/2482662247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa238155d20 0x7fa238152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.661+0000 7fa237e00700 1 --2- 172.21.15.49:0/2482662247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2380a8740 0x7fa238150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.665+0000 7fa237400700 1 -- 172.21.15.49:0/2482662247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa238155d20 msgr2=0x7fa238152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.665+0000 7fa237400700 1 --2- 172.21.15.49:0/2482662247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa238155d20 0x7fa238152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.665+0000 7fa237400700 1 -- 172.21.15.49:0/2482662247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2380a8740 msgr2=0x7fa238150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.665+0000 7fa237400700 1 --2- 172.21.15.49:0/2482662247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2380a8740 0x7fa238150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.665+0000 7fa237400700 1 -- 172.21.15.49:0/2482662247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa230009a20 con 0x7fa2380c25e0 2024-01-22T05:16:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.665+0000 7fa237400700 1 --2- 172.21.15.49:0/2482662247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2380c25e0 0x7fa238067df0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fa22000c4c0 tx=0x7fa220007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.665+0000 7fa22f400700 1 -- 172.21.15.49:0/2482662247 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220007020 con 0x7fa2380c25e0 2024-01-22T05:16:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.665+0000 7fa22f400700 1 -- 172.21.15.49:0/2482662247 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa220001e90 con 0x7fa2380c25e0 2024-01-22T05:16:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.665+0000 7fa22f400700 1 -- 172.21.15.49:0/2482662247 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2200073b0 con 0x7fa2380c25e0 2024-01-22T05:16:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.665+0000 7fa23f000700 1 -- 172.21.15.49:0/2482662247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2381514d0 con 0x7fa2380c25e0 2024-01-22T05:16:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.665+0000 7fa23f000700 1 -- 172.21.15.49:0/2482662247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa238153340 con 0x7fa2380c25e0 2024-01-22T05:16:14.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.665+0000 7fa23f000700 1 -- 172.21.15.49:0/2482662247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa238151c90 con 0x7fa2380c25e0 2024-01-22T05:16:14.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.665+0000 7fa22f400700 1 -- 172.21.15.49:0/2482662247 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa2200068b0 con 0x7fa2380c25e0 2024-01-22T05:16:14.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.669+0000 7fa22f400700 1 --2- 172.21.15.49:0/2482662247 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa21005a540 0x7fa21005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:14.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.669+0000 7fa22f400700 1 -- 172.21.15.49:0/2482662247 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa2200742f0 con 0x7fa2380c25e0 2024-01-22T05:16:14.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.669+0000 7fa237e00700 1 --2- 172.21.15.49:0/2482662247 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa21005a540 0x7fa21005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:14.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.669+0000 7fa237e00700 1 --2- 172.21.15.49:0/2482662247 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa21005a540 0x7fa21005ca00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fa228007fd0 tx=0x7fa228009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.677+0000 7fa22f400700 1 -- 172.21.15.49:0/2482662247 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa220047970 con 0x7fa2380c25e0 2024-01-22T05:16:14.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.841+0000 7fa23f000700 1 -- 172.21.15.49:0/2482662247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa238047060 con 0x7fa2380c25e0 2024-01-22T05:16:14.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.841+0000 7fa22f400700 1 -- 172.21.15.49:0/2482662247 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+17191 (secure 0 0 0) 0x7fa22004af90 con 0x7fa2380c25e0 2024-01-22T05:16:14.843 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:14.843 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":144,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:16:14.067221+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:16:12.266975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-01-22T05:16:13.093952+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:16:14.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.845+0000 7fa23f000700 1 -- 172.21.15.49:0/2482662247 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa21005a540 msgr2=0x7fa21005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:14.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.845+0000 7fa23f000700 1 --2- 172.21.15.49:0/2482662247 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa21005a540 0x7fa21005ca00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fa228007fd0 tx=0x7fa228009040).stop 2024-01-22T05:16:14.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.845+0000 7fa23f000700 1 -- 172.21.15.49:0/2482662247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2380c25e0 msgr2=0x7fa238067df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:14.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.845+0000 7fa23f000700 1 --2- 172.21.15.49:0/2482662247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2380c25e0 0x7fa238067df0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fa22000c4c0 tx=0x7fa220007e00).stop 2024-01-22T05:16:14.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.845+0000 7fa23f000700 1 -- 172.21.15.49:0/2482662247 shutdown_connections 2024-01-22T05:16:14.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.845+0000 7fa23f000700 1 --2- 172.21.15.49:0/2482662247 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa21005a540 0x7fa21005ca00 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.845+0000 7fa23f000700 1 --2- 172.21.15.49:0/2482662247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa238155d20 0x7fa238152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.845+0000 7fa23f000700 1 --2- 172.21.15.49:0/2482662247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2380c25e0 0x7fa238067df0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.845+0000 7fa23f000700 1 --2- 172.21.15.49:0/2482662247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2380a8740 0x7fa238150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:14.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.845+0000 7fa23f000700 1 -- 172.21.15.49:0/2482662247 >> 172.21.15.49:0/2482662247 conn(0x7fa2380c6540 msgr2=0x7fa2380c55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:14.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.845+0000 7fa23f000700 1 -- 172.21.15.49:0/2482662247 shutdown_connections 2024-01-22T05:16:14.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:14.845+0000 7fa23f000700 1 -- 172.21.15.49:0/2482662247 wait complete. 2024-01-22T05:16:14.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:16:15.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.037+0000 7fc592e00700 1 Processor -- start 2024-01-22T05:16:15.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.037+0000 7fc592e00700 1 -- start start 2024-01-22T05:16:15.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc592e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc58c0c0760 0x7fc58c1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:15.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc592e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc58c155c00 0x7fc58c156050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc592e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c155770 con 0x7fc58c151ba0 2024-01-22T05:16:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc592e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c0c2e40 con 0x7fc58c0c0760 2024-01-22T05:16:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc592e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c156540 con 0x7fc58c155c00 2024-01-22T05:16:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc58be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc58c0c0760 0x7fc58c1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:15.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc58be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc58c0c0760 0x7fc58c1516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34158/0 (socket says 172.21.15.49:34158) 2024-01-22T05:16:15.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc58be00700 1 -- 172.21.15.49:0/3327930872 learned_addr learned my addr 172.21.15.49:0/3327930872 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:15.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc58b400700 1 --1- 172.21.15.49:0/3327930872 >> v1:172.21.15.49:6789/0 conn(0x7fc58c151ba0 0x7fc58c067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45506/0 (socket says 172.21.15.49:45506) 2024-01-22T05:16:15.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc590e00700 1 --2- 172.21.15.49:0/3327930872 >> v2:172.21.15.110:3300/0 conn(0x7fc58c155c00 0x7fc58c156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:15.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc58be00700 1 -- 172.21.15.49:0/3327930872 >> v2:172.21.15.110:3300/0 conn(0x7fc58c155c00 msgr2=0x7fc58c156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:15.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc58be00700 1 --2- 172.21.15.49:0/3327930872 >> v2:172.21.15.110:3300/0 conn(0x7fc58c155c00 0x7fc58c156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:15.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc58be00700 1 -- 172.21.15.49:0/3327930872 >> v1:172.21.15.49:6789/0 conn(0x7fc58c151ba0 legacy=0x7fc58c067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:15.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc58be00700 1 -- 172.21.15.49:0/3327930872 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c0c2880 con 0x7fc58c0c0760 2024-01-22T05:16:15.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc58be00700 1 --2- 172.21.15.49:0/3327930872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc58c0c0760 0x7fc58c1516b0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7fc58c066ec0 tx=0x7fc57c0090f0).ready entity=mon.0 client_cookie=9bb2e56b8d1ebed3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:15.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc58aa00700 1 -- 172.21.15.49:0/3327930872 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00b600 con 0x7fc58c0c0760 2024-01-22T05:16:15.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc58aa00700 1 -- 172.21.15.49:0/3327930872 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c00b760 con 0x7fc58c0c0760 2024-01-22T05:16:15.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.041+0000 7fc58aa00700 1 -- 172.21.15.49:0/3327930872 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00bb00 con 0x7fc58c0c0760 2024-01-22T05:16:15.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.045+0000 7fc592e00700 1 -- 172.21.15.49:0/3327930872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc58c0c0760 msgr2=0x7fc58c1516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:15.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.045+0000 7fc592e00700 1 --2- 172.21.15.49:0/3327930872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc58c0c0760 0x7fc58c1516b0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7fc58c066ec0 tx=0x7fc57c0090f0).stop 2024-01-22T05:16:15.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.045+0000 7fc592e00700 1 -- 172.21.15.49:0/3327930872 shutdown_connections 2024-01-22T05:16:15.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.045+0000 7fc592e00700 1 --2- 172.21.15.49:0/3327930872 >> v2:172.21.15.110:3300/0 conn(0x7fc58c155c00 0x7fc58c156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:15.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.045+0000 7fc592e00700 1 --2- 172.21.15.49:0/3327930872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc58c0c0760 0x7fc58c1516b0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:15.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.045+0000 7fc592e00700 1 -- 172.21.15.49:0/3327930872 >> 172.21.15.49:0/3327930872 conn(0x7fc58c062cb0 msgr2=0x7fc58c0c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:15.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.045+0000 7fc592e00700 1 -- 172.21.15.49:0/3327930872 shutdown_connections 2024-01-22T05:16:15.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.045+0000 7fc592e00700 1 -- 172.21.15.49:0/3327930872 wait complete. 2024-01-22T05:16:15.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.049+0000 7fc592e00700 1 Processor -- start 2024-01-22T05:16:15.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.049+0000 7fc592e00700 1 -- start start 2024-01-22T05:16:15.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.049+0000 7fc592e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc58c0c0760 0x7fc58c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:15.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.049+0000 7fc592e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc58c151ba0 0x7fc58c0c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:15.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.049+0000 7fc592e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc58c155c00 0x7fc58c14ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:15.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.049+0000 7fc592e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0bda10 con 0x7fc58c151ba0 2024-01-22T05:16:15.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.049+0000 7fc592e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0aa060 con 0x7fc58c0c0760 2024-01-22T05:16:15.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.049+0000 7fc592e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0aa340 con 0x7fc58c155c00 2024-01-22T05:16:15.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.049+0000 7fc58b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc58c151ba0 0x7fc58c0c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:15.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.049+0000 7fc58b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc58c151ba0 0x7fc58c0c4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34170/0 (socket says 172.21.15.49:34170) 2024-01-22T05:16:15.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.049+0000 7fc58b400700 1 -- 172.21.15.49:0/3630692048 learned_addr learned my addr 172.21.15.49:0/3630692048 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:15.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.049+0000 7fc58be00700 1 --2- 172.21.15.49:0/3630692048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc58c0c0760 0x7fc58c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:15.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.053+0000 7fc590e00700 1 --2- 172.21.15.49:0/3630692048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc58c155c00 0x7fc58c14ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:15.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.053+0000 7fc58b400700 1 -- 172.21.15.49:0/3630692048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc58c155c00 msgr2=0x7fc58c14ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:15.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.053+0000 7fc58b400700 1 --2- 172.21.15.49:0/3630692048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc58c155c00 0x7fc58c14ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:15.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.053+0000 7fc58b400700 1 -- 172.21.15.49:0/3630692048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc58c0c0760 msgr2=0x7fc58c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:15.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.053+0000 7fc58b400700 1 --2- 172.21.15.49:0/3630692048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc58c0c0760 0x7fc58c0a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:15.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.053+0000 7fc58b400700 1 -- 172.21.15.49:0/3630692048 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c009370 con 0x7fc58c151ba0 2024-01-22T05:16:15.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.053+0000 7fc58b400700 1 --2- 172.21.15.49:0/3630692048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc58c151ba0 0x7fc58c0c4f80 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7fc57400c440 tx=0x7fc574007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:15.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.053+0000 7fc583400700 1 -- 172.21.15.49:0/3630692048 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740070d0 con 0x7fc58c151ba0 2024-01-22T05:16:15.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.053+0000 7fc583400700 1 -- 172.21.15.49:0/3630692048 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc574001e90 con 0x7fc58c151ba0 2024-01-22T05:16:15.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.053+0000 7fc583400700 1 -- 172.21.15.49:0/3630692048 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574007440 con 0x7fc58c151ba0 2024-01-22T05:16:15.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.053+0000 7fc592e00700 1 -- 172.21.15.49:0/3630692048 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c0aa620 con 0x7fc58c151ba0 2024-01-22T05:16:15.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.053+0000 7fc592e00700 1 -- 172.21.15.49:0/3630692048 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c0a8bf0 con 0x7fc58c151ba0 2024-01-22T05:16:15.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.053+0000 7fc592e00700 1 -- 172.21.15.49:0/3630692048 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58c0bdbc0 con 0x7fc58c151ba0 2024-01-22T05:16:15.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.057+0000 7fc583400700 1 -- 172.21.15.49:0/3630692048 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc574005880 con 0x7fc58c151ba0 2024-01-22T05:16:15.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.057+0000 7fc583400700 1 --2- 172.21.15.49:0/3630692048 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc56405a510 0x7fc56405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:15.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.057+0000 7fc583400700 1 -- 172.21.15.49:0/3630692048 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc574073e10 con 0x7fc58c151ba0 2024-01-22T05:16:15.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.057+0000 7fc58be00700 1 --2- 172.21.15.49:0/3630692048 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc56405a510 0x7fc56405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:15.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.057+0000 7fc58be00700 1 --2- 172.21.15.49:0/3630692048 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc56405a510 0x7fc56405c9d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fc57c00b3c0 tx=0x7fc57c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:15.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.065+0000 7fc583400700 1 -- 172.21.15.49:0/3630692048 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc58c0bdbc0 con 0x7fc58c151ba0 2024-01-22T05:16:15.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:15.269+0000 7fc592e00700 1 -- 172.21.15.49:0/3630692048 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc58c0c0c00 con 0x7fc58c151ba0 2024-01-22T05:16:16.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.089+0000 7fc583400700 1 -- 172.21.15.49:0/3630692048 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v113) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc574047490 con 0x7fc58c151ba0 2024-01-22T05:16:16.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.093+0000 7fc592e00700 1 -- 172.21.15.49:0/3630692048 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc56405a510 msgr2=0x7fc56405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:16.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.093+0000 7fc592e00700 1 --2- 172.21.15.49:0/3630692048 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc56405a510 0x7fc56405c9d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fc57c00b3c0 tx=0x7fc57c017000).stop 2024-01-22T05:16:16.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.093+0000 7fc592e00700 1 -- 172.21.15.49:0/3630692048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc58c151ba0 msgr2=0x7fc58c0c4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:16.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.093+0000 7fc592e00700 1 --2- 172.21.15.49:0/3630692048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc58c151ba0 0x7fc58c0c4f80 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7fc57400c440 tx=0x7fc574007d40).stop 2024-01-22T05:16:16.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.093+0000 7fc592e00700 1 -- 172.21.15.49:0/3630692048 shutdown_connections 2024-01-22T05:16:16.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.093+0000 7fc592e00700 1 --2- 172.21.15.49:0/3630692048 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc56405a510 0x7fc56405c9d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:16.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.093+0000 7fc592e00700 1 --2- 172.21.15.49:0/3630692048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc58c155c00 0x7fc58c14ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:16.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.093+0000 7fc592e00700 1 --2- 172.21.15.49:0/3630692048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc58c151ba0 0x7fc58c0c4f80 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:16.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.093+0000 7fc592e00700 1 --2- 172.21.15.49:0/3630692048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc58c0c0760 0x7fc58c0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:16.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.093+0000 7fc592e00700 1 -- 172.21.15.49:0/3630692048 >> 172.21.15.49:0/3630692048 conn(0x7fc58c062cb0 msgr2=0x7fc58c0bc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:16.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.097+0000 7fc592e00700 1 -- 172.21.15.49:0/3630692048 shutdown_connections 2024-01-22T05:16:16.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.097+0000 7fc592e00700 1 -- 172.21.15.49:0/3630692048 wait complete. 2024-01-22T05:16:16.121 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T05:16:16.121 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:16:16.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.293+0000 7f1d38200700 1 Processor -- start 2024-01-22T05:16:16.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.293+0000 7f1d38200700 1 -- start start 2024-01-22T05:16:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d38200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1d300a8c20 0x7f1d300c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d38200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d300c1ac0 0x7f1d300bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d38200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d300bc9c0 0x7f1d30068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d38200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d30158650 con 0x7f1d300bc9c0 2024-01-22T05:16:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d38200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d300c1f20 con 0x7f1d300a8c20 2024-01-22T05:16:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d38200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300bd170 con 0x7f1d300c1ac0 2024-01-22T05:16:16.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d36200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d300bc9c0 0x7f1d30068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d36200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1d300bc9c0 0x7f1d30068710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34182/0 (socket says 172.21.15.49:34182) 2024-01-22T05:16:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d36200700 1 -- 172.21.15.49:0/23311964 learned_addr learned my addr 172.21.15.49:0/23311964 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d35800700 1 --2- 172.21.15.49:0/23311964 >> v2:172.21.15.110:3300/0 conn(0x7f1d300a8c20 0x7f1d300c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d34e00700 1 --2- 172.21.15.49:0/23311964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d300c1ac0 0x7f1d300bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d36200700 1 -- 172.21.15.49:0/23311964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d300c1ac0 msgr2=0x7f1d300bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d36200700 1 --2- 172.21.15.49:0/23311964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d300c1ac0 0x7f1d300bc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d36200700 1 -- 172.21.15.49:0/23311964 >> v2:172.21.15.110:3300/0 conn(0x7f1d300a8c20 msgr2=0x7f1d300c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d36200700 1 --2- 172.21.15.49:0/23311964 >> v2:172.21.15.110:3300/0 conn(0x7f1d300a8c20 0x7f1d300c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d36200700 1 -- 172.21.15.49:0/23311964 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d30067c30 con 0x7f1d300bc9c0 2024-01-22T05:16:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d35800700 1 --2- 172.21.15.49:0/23311964 >> v2:172.21.15.110:3300/0 conn(0x7f1d300a8c20 0x7f1d300c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:16.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.297+0000 7f1d36200700 1 --2- 172.21.15.49:0/23311964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d300bc9c0 0x7f1d30068710 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f1d300c4300 tx=0x7f1d28009840).ready entity=mon.0 client_cookie=3015087ea96de4af server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:16.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.301+0000 7f1d2fe00700 1 -- 172.21.15.49:0/23311964 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2800e070 con 0x7f1d300bc9c0 2024-01-22T05:16:16.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.301+0000 7f1d2fe00700 1 -- 172.21.15.49:0/23311964 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2800ba50 con 0x7f1d300bc9c0 2024-01-22T05:16:16.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.301+0000 7f1d2fe00700 1 -- 172.21.15.49:0/23311964 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2800bdd0 con 0x7f1d300bc9c0 2024-01-22T05:16:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.301+0000 7f1d38200700 1 -- 172.21.15.49:0/23311964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d300bc9c0 msgr2=0x7f1d30068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.301+0000 7f1d38200700 1 --2- 172.21.15.49:0/23311964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d300bc9c0 0x7f1d30068710 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f1d300c4300 tx=0x7f1d28009840).stop 2024-01-22T05:16:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.301+0000 7f1d38200700 1 -- 172.21.15.49:0/23311964 shutdown_connections 2024-01-22T05:16:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.301+0000 7f1d38200700 1 --2- 172.21.15.49:0/23311964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d300bc9c0 0x7f1d30068710 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.301+0000 7f1d38200700 1 --2- 172.21.15.49:0/23311964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d300c1ac0 0x7f1d300bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.301+0000 7f1d38200700 1 --2- 172.21.15.49:0/23311964 >> v2:172.21.15.110:3300/0 conn(0x7f1d300a8c20 0x7f1d300c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:16.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.301+0000 7f1d38200700 1 -- 172.21.15.49:0/23311964 >> 172.21.15.49:0/23311964 conn(0x7f1d30062cb0 msgr2=0x7f1d300c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.301+0000 7f1d38200700 1 -- 172.21.15.49:0/23311964 shutdown_connections 2024-01-22T05:16:16.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.301+0000 7f1d38200700 1 -- 172.21.15.49:0/23311964 wait complete. 2024-01-22T05:16:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.305+0000 7f1d38200700 1 Processor -- start 2024-01-22T05:16:16.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.305+0000 7f1d38200700 1 -- start start 2024-01-22T05:16:16.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d38200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d300a8c20 0x7f1d30156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:16.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d38200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d300bc9c0 0x7f1d30168600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:16.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d38200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d300c1ac0 0x7f1d300bf330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:16.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d38200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300aa5a0 con 0x7f1d300a8c20 2024-01-22T05:16:16.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d38200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300beea0 con 0x7f1d300c1ac0 2024-01-22T05:16:16.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d38200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300be290 con 0x7f1d300bc9c0 2024-01-22T05:16:16.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d35800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d300a8c20 0x7f1d30156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:16.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d35800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d300a8c20 0x7f1d30156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34190/0 (socket says 172.21.15.49:34190) 2024-01-22T05:16:16.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d35800700 1 -- 172.21.15.49:0/529032235 learned_addr learned my addr 172.21.15.49:0/529032235 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:16.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d34e00700 1 --2- 172.21.15.49:0/529032235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d300bc9c0 0x7f1d30168600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:16.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d36200700 1 --2- 172.21.15.49:0/529032235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d300c1ac0 0x7f1d300bf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:16.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d35800700 1 -- 172.21.15.49:0/529032235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d300bc9c0 msgr2=0x7f1d30168600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:16.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d35800700 1 --2- 172.21.15.49:0/529032235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d300bc9c0 0x7f1d30168600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:16.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d35800700 1 -- 172.21.15.49:0/529032235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d300c1ac0 msgr2=0x7f1d300bf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:16.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d35800700 1 --2- 172.21.15.49:0/529032235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d300c1ac0 0x7f1d300bf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:16.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d35800700 1 -- 172.21.15.49:0/529032235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d28009ae0 con 0x7f1d300a8c20 2024-01-22T05:16:16.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d35800700 1 --2- 172.21.15.49:0/529032235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d300a8c20 0x7f1d30156030 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f1d2000d860 tx=0x7f1d20008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:16.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d2cc00700 1 -- 172.21.15.49:0/529032235 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2000f520 con 0x7f1d300a8c20 2024-01-22T05:16:16.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d2cc00700 1 -- 172.21.15.49:0/529032235 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2000f680 con 0x7f1d300a8c20 2024-01-22T05:16:16.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d38200700 1 -- 172.21.15.49:0/529032235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d300be570 con 0x7f1d300a8c20 2024-01-22T05:16:16.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d2cc00700 1 -- 172.21.15.49:0/529032235 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2000fa20 con 0x7f1d300a8c20 2024-01-22T05:16:16.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.309+0000 7f1d38200700 1 -- 172.21.15.49:0/529032235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d300beb30 con 0x7f1d300a8c20 2024-01-22T05:16:16.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.313+0000 7f1d38200700 1 -- 172.21.15.49:0/529032235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d300c0c00 con 0x7f1d300a8c20 2024-01-22T05:16:16.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.313+0000 7f1d2cc00700 1 -- 172.21.15.49:0/529032235 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1d20013480 con 0x7f1d300a8c20 2024-01-22T05:16:16.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.317+0000 7f1d2cc00700 1 --2- 172.21.15.49:0/529032235 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d0805a540 0x7f1d0805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:16.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.317+0000 7f1d2cc00700 1 -- 172.21.15.49:0/529032235 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f1d20074510 con 0x7f1d300a8c20 2024-01-22T05:16:16.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.317+0000 7f1d34e00700 1 --2- 172.21.15.49:0/529032235 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d0805a540 0x7f1d0805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:16.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.317+0000 7f1d34e00700 1 --2- 172.21.15.49:0/529032235 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d0805a540 0x7f1d0805ca00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f1d30066250 tx=0x7f1d18008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.321+0000 7f1d2cc00700 1 -- 172.21.15.49:0/529032235 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1d20047a70 con 0x7f1d300a8c20 2024-01-22T05:16:16.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:16.529+0000 7f1d38200700 1 -- 172.21.15.49:0/529032235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1d30046800 con 0x7f1d300a8c20 2024-01-22T05:16:17.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.369+0000 7f1d2cc00700 1 -- 172.21.15.49:0/529032235 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v114) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1d2004b090 con 0x7f1d300a8c20 2024-01-22T05:16:17.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.373+0000 7f1d38200700 1 -- 172.21.15.49:0/529032235 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d0805a540 msgr2=0x7f1d0805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:17.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.373+0000 7f1d38200700 1 --2- 172.21.15.49:0/529032235 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d0805a540 0x7f1d0805ca00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f1d30066250 tx=0x7f1d18008040).stop 2024-01-22T05:16:17.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.373+0000 7f1d38200700 1 -- 172.21.15.49:0/529032235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d300a8c20 msgr2=0x7f1d30156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:17.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.373+0000 7f1d38200700 1 --2- 172.21.15.49:0/529032235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d300a8c20 0x7f1d30156030 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f1d2000d860 tx=0x7f1d20008040).stop 2024-01-22T05:16:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.373+0000 7f1d38200700 1 -- 172.21.15.49:0/529032235 shutdown_connections 2024-01-22T05:16:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.373+0000 7f1d38200700 1 --2- 172.21.15.49:0/529032235 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d0805a540 0x7f1d0805ca00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.373+0000 7f1d38200700 1 --2- 172.21.15.49:0/529032235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d300c1ac0 0x7f1d300bf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.373+0000 7f1d38200700 1 --2- 172.21.15.49:0/529032235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d300bc9c0 0x7f1d30168600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.373+0000 7f1d38200700 1 --2- 172.21.15.49:0/529032235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d300a8c20 0x7f1d30156030 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.373+0000 7f1d38200700 1 -- 172.21.15.49:0/529032235 >> 172.21.15.49:0/529032235 conn(0x7f1d30062cb0 msgr2=0x7f1d300ab8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.373+0000 7f1d38200700 1 -- 172.21.15.49:0/529032235 shutdown_connections 2024-01-22T05:16:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.373+0000 7f1d38200700 1 -- 172.21.15.49:0/529032235 wait complete. 2024-01-22T05:16:17.399 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:16:17.399 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:16:17.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.569+0000 7fe05b200700 1 Processor -- start 2024-01-22T05:16:17.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.573+0000 7fe05b200700 1 -- start start 2024-01-22T05:16:17.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.573+0000 7fe05b200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe0540be070 0x7fe054067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:17.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe05b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe054068410 0x7fe0540c4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:17.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe05b200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0540c38c0 con 0x7fe054067f80 2024-01-22T05:16:17.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe05b200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0540be450 con 0x7fe0540be070 2024-01-22T05:16:17.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe05b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540a8880 con 0x7fe054068410 2024-01-22T05:16:17.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe053e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe0540be070 0x7fe054067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:17.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe053e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe0540be070 0x7fe054067a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34196/0 (socket says 172.21.15.49:34196) 2024-01-22T05:16:17.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe053e00700 1 -- 172.21.15.49:0/2483573239 learned_addr learned my addr 172.21.15.49:0/2483573239 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:17.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe053e00700 1 -- 172.21.15.49:0/2483573239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe054068410 msgr2=0x7fe0540c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:17.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe059200700 1 --2- 172.21.15.49:0/2483573239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe054068410 0x7fe0540c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:17.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe053e00700 1 --2- 172.21.15.49:0/2483573239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe054068410 0x7fe0540c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:17.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe053e00700 1 -- 172.21.15.49:0/2483573239 >> v1:172.21.15.110:6789/0 conn(0x7fe054067f80 legacy=0x7fe0540c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:17.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe053e00700 1 -- 172.21.15.49:0/2483573239 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0540be650 con 0x7fe0540be070 2024-01-22T05:16:17.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe059200700 1 --2- 172.21.15.49:0/2483573239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe054068410 0x7fe0540c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:16:17.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe053e00700 1 --2- 172.21.15.49:0/2483573239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540be070 0x7fe054067a90 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7fe044006fd0 tx=0x7fe0440090f0).ready entity=mon.0 client_cookie=3836cf044bc92a1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:17.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe052a00700 1 -- 172.21.15.49:0/2483573239 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400b600 con 0x7fe0540be070 2024-01-22T05:16:17.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe052a00700 1 -- 172.21.15.49:0/2483573239 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04400b760 con 0x7fe0540be070 2024-01-22T05:16:17.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe052a00700 1 -- 172.21.15.49:0/2483573239 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400bae0 con 0x7fe0540be070 2024-01-22T05:16:17.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe05b200700 1 -- 172.21.15.49:0/2483573239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540be070 msgr2=0x7fe054067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:17.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.577+0000 7fe05b200700 1 --2- 172.21.15.49:0/2483573239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540be070 0x7fe054067a90 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7fe044006fd0 tx=0x7fe0440090f0).stop 2024-01-22T05:16:17.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.581+0000 7fe05b200700 1 -- 172.21.15.49:0/2483573239 shutdown_connections 2024-01-22T05:16:17.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.581+0000 7fe05b200700 1 --2- 172.21.15.49:0/2483573239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe054068410 0x7fe0540c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:17.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.581+0000 7fe05b200700 1 --2- 172.21.15.49:0/2483573239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540be070 0x7fe054067a90 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:17.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.581+0000 7fe05b200700 1 -- 172.21.15.49:0/2483573239 >> 172.21.15.49:0/2483573239 conn(0x7fe0540c8730 msgr2=0x7fe0540c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:17.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.581+0000 7fe05b200700 1 -- 172.21.15.49:0/2483573239 shutdown_connections 2024-01-22T05:16:17.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.581+0000 7fe05b200700 1 -- 172.21.15.49:0/2483573239 wait complete. 2024-01-22T05:16:17.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.581+0000 7fe05b200700 1 Processor -- start 2024-01-22T05:16:17.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe05b200700 1 -- start start 2024-01-22T05:16:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe05b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe054067f80 0x7fe0540c2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:17.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe05b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe054068410 0x7fe054147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe05b200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540be070 0x7fe0540ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe05b200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540c0f50 con 0x7fe0540be070 2024-01-22T05:16:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe05b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540c0360 con 0x7fe054067f80 2024-01-22T05:16:17.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe05b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540c0620 con 0x7fe054068410 2024-01-22T05:16:17.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe059200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540be070 0x7fe0540ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:17.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe059200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540be070 0x7fe0540ad0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34202/0 (socket says 172.21.15.49:34202) 2024-01-22T05:16:17.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe059200700 1 -- 172.21.15.49:0/4114418315 learned_addr learned my addr 172.21.15.49:0/4114418315 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:17.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe053e00700 1 --2- 172.21.15.49:0/4114418315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe054067f80 0x7fe0540c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:17.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe053400700 1 --2- 172.21.15.49:0/4114418315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe054068410 0x7fe054147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:17.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe059200700 1 -- 172.21.15.49:0/4114418315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe054068410 msgr2=0x7fe054147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:17.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe059200700 1 --2- 172.21.15.49:0/4114418315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe054068410 0x7fe054147d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:17.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe059200700 1 -- 172.21.15.49:0/4114418315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe054067f80 msgr2=0x7fe0540c2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:17.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe059200700 1 --2- 172.21.15.49:0/4114418315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe054067f80 0x7fe0540c2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:17.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe059200700 1 -- 172.21.15.49:0/4114418315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe044009370 con 0x7fe0540be070 2024-01-22T05:16:17.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe059200700 1 --2- 172.21.15.49:0/4114418315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540be070 0x7fe0540ad0f0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fe04c00a380 tx=0x7fe04c007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:17.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe04b400700 1 -- 172.21.15.49:0/4114418315 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c00ae10 con 0x7fe0540be070 2024-01-22T05:16:17.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe04b400700 1 -- 172.21.15.49:0/4114418315 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c00d650 con 0x7fe0540be070 2024-01-22T05:16:17.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe05b200700 1 -- 172.21.15.49:0/4114418315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0540c0900 con 0x7fe0540be070 2024-01-22T05:16:17.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.585+0000 7fe04b400700 1 -- 172.21.15.49:0/4114418315 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c00d9d0 con 0x7fe0540be070 2024-01-22T05:16:17.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.589+0000 7fe05b200700 1 -- 172.21.15.49:0/4114418315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe054148230 con 0x7fe0540be070 2024-01-22T05:16:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.589+0000 7fe05b200700 1 -- 172.21.15.49:0/4114418315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0540c1100 con 0x7fe0540be070 2024-01-22T05:16:17.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.589+0000 7fe04b400700 1 -- 172.21.15.49:0/4114418315 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe04c013070 con 0x7fe0540be070 2024-01-22T05:16:17.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.593+0000 7fe04b400700 1 --2- 172.21.15.49:0/4114418315 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe02c05a510 0x7fe02c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:17.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.593+0000 7fe04b400700 1 -- 172.21.15.49:0/4114418315 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe04c075410 con 0x7fe0540be070 2024-01-22T05:16:17.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.593+0000 7fe053e00700 1 --2- 172.21.15.49:0/4114418315 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe02c05a510 0x7fe02c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:17.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.593+0000 7fe053e00700 1 --2- 172.21.15.49:0/4114418315 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe02c05a510 0x7fe02c05c9d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fe044009130 tx=0x7fe044017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:17.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.601+0000 7fe04b400700 1 -- 172.21.15.49:0/4114418315 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe0540c1100 con 0x7fe0540be070 2024-01-22T05:16:17.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.797+0000 7fe05b200700 1 -- 172.21.15.49:0/4114418315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0540c1090 con 0x7fe0540be070 2024-01-22T05:16:17.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.801+0000 7fe04b400700 1 -- 172.21.15.49:0/4114418315 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4500 (secure 0 0 0) 0x7fe04c048a90 con 0x7fe0540be070 2024-01-22T05:16:17.800 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:17.800 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":114,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":8826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:16:17.362338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/4015076184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":4015076184},{"type":"v1","addr":"172.21.15.49:6837","nonce":4015076184}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:16:17.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.801+0000 7fe05b200700 1 -- 172.21.15.49:0/4114418315 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe02c05a510 msgr2=0x7fe02c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:17.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.801+0000 7fe05b200700 1 --2- 172.21.15.49:0/4114418315 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe02c05a510 0x7fe02c05c9d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fe044009130 tx=0x7fe044017000).stop 2024-01-22T05:16:17.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.801+0000 7fe05b200700 1 -- 172.21.15.49:0/4114418315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540be070 msgr2=0x7fe0540ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:17.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.801+0000 7fe05b200700 1 --2- 172.21.15.49:0/4114418315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540be070 0x7fe0540ad0f0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fe04c00a380 tx=0x7fe04c007900).stop 2024-01-22T05:16:17.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.805+0000 7fe05b200700 1 -- 172.21.15.49:0/4114418315 shutdown_connections 2024-01-22T05:16:17.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.805+0000 7fe05b200700 1 --2- 172.21.15.49:0/4114418315 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe02c05a510 0x7fe02c05c9d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:17.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.805+0000 7fe05b200700 1 --2- 172.21.15.49:0/4114418315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0540be070 0x7fe0540ad0f0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:17.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.805+0000 7fe05b200700 1 --2- 172.21.15.49:0/4114418315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe054068410 0x7fe054147d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:17.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.805+0000 7fe05b200700 1 --2- 172.21.15.49:0/4114418315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe054067f80 0x7fe0540c2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:17.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.805+0000 7fe05b200700 1 -- 172.21.15.49:0/4114418315 >> 172.21.15.49:0/4114418315 conn(0x7fe0540c8730 msgr2=0x7fe0540a89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:17.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.805+0000 7fe05b200700 1 -- 172.21.15.49:0/4114418315 shutdown_connections 2024-01-22T05:16:17.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:17.805+0000 7fe05b200700 1 -- 172.21.15.49:0/4114418315 wait complete. 2024-01-22T05:16:17.807 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 114 2024-01-22T05:16:17.828 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:16:18.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.001+0000 7f81c5600700 1 Processor -- start 2024-01-22T05:16:18.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.001+0000 7f81c5600700 1 -- start start 2024-01-22T05:16:18.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.005+0000 7f81c5600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f81c00c7fe0 0x7f81c00c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.005+0000 7f81c5600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c00c67a0 con 0x7f81c00bf890 2024-01-22T05:16:18.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.005+0000 7f81c5600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c00c5b90 con 0x7f81c00c01f0 2024-01-22T05:16:18.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.005+0000 7f81c5600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c01541c0 con 0x7f81c00c7fe0 2024-01-22T05:16:18.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.005+0000 7f81bea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f81c00c7fe0 0x7f81c00c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.005+0000 7f81bea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f81c00c7fe0 0x7f81c00c6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34204/0 (socket says 172.21.15.49:34204) 2024-01-22T05:16:18.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.005+0000 7f81bea00700 1 -- 172.21.15.49:0/891762301 learned_addr learned my addr 172.21.15.49:0/891762301 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:18.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.005+0000 7f81be000700 1 --1- 172.21.15.49:0/891762301 >> v1:172.21.15.49:6789/0 conn(0x7f81c00bf890 0x7f81c0068c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45510/0 (socket says 172.21.15.49:45510) 2024-01-22T05:16:18.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.005+0000 7f81bea00700 1 -- 172.21.15.49:0/891762301 >> v1:172.21.15.110:6789/0 conn(0x7f81c00c01f0 legacy=0x7f81c0067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.005+0000 7f81bea00700 1 -- 172.21.15.49:0/891762301 >> v1:172.21.15.49:6789/0 conn(0x7f81c00bf890 legacy=0x7f81c0068c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.005+0000 7f81bea00700 1 -- 172.21.15.49:0/891762301 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c00c5e70 con 0x7f81c00c7fe0 2024-01-22T05:16:18.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.005+0000 7f81bea00700 1 --2- 172.21.15.49:0/891762301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c00c7fe0 0x7f81c00c6c30 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f81b0006fd0 tx=0x7f81b00090f0).ready entity=mon.0 client_cookie=7fc1070134639639 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:18.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.005+0000 7f81bd600700 1 -- 172.21.15.49:0/891762301 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b000b600 con 0x7f81c00c7fe0 2024-01-22T05:16:18.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.005+0000 7f81bd600700 1 -- 172.21.15.49:0/891762301 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b000b760 con 0x7f81c00c7fe0 2024-01-22T05:16:18.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.005+0000 7f81bd600700 1 -- 172.21.15.49:0/891762301 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b000bb00 con 0x7f81c00c7fe0 2024-01-22T05:16:18.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.009+0000 7f81c5600700 1 -- 172.21.15.49:0/891762301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c00c7fe0 msgr2=0x7f81c00c6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.009+0000 7f81c5600700 1 --2- 172.21.15.49:0/891762301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c00c7fe0 0x7f81c00c6c30 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f81b0006fd0 tx=0x7f81b00090f0).stop 2024-01-22T05:16:18.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.009+0000 7f81c5600700 1 -- 172.21.15.49:0/891762301 shutdown_connections 2024-01-22T05:16:18.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.009+0000 7f81c5600700 1 --2- 172.21.15.49:0/891762301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c00c7fe0 0x7f81c00c6c30 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.009+0000 7f81c5600700 1 -- 172.21.15.49:0/891762301 >> 172.21.15.49:0/891762301 conn(0x7f81c00cb3a0 msgr2=0x7f81c00c73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:18.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.009+0000 7f81c5600700 1 -- 172.21.15.49:0/891762301 shutdown_connections 2024-01-22T05:16:18.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.009+0000 7f81c5600700 1 -- 172.21.15.49:0/891762301 wait complete. 2024-01-22T05:16:18.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.013+0000 7f81c5600700 1 Processor -- start 2024-01-22T05:16:18.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.013+0000 7f81c5600700 1 -- start start 2024-01-22T05:16:18.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.013+0000 7f81c5600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81c00bf890 0x7f81c00c26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.013+0000 7f81c5600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c00c01f0 0x7f81c00ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.013+0000 7f81c5600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c00c7fe0 0x7f81c0149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.013+0000 7f81c5600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00aeb40 con 0x7f81c00c7fe0 2024-01-22T05:16:18.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.013+0000 7f81c5600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00aed50 con 0x7f81c00c01f0 2024-01-22T05:16:18.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.013+0000 7f81c5600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00af030 con 0x7f81c00bf890 2024-01-22T05:16:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.013+0000 7f81bf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c00c7fe0 0x7f81c0149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.013+0000 7f81bf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c00c7fe0 0x7f81c0149440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34212/0 (socket says 172.21.15.49:34212) 2024-01-22T05:16:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.013+0000 7f81bf400700 1 -- 172.21.15.49:0/1160888319 learned_addr learned my addr 172.21.15.49:0/1160888319 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.013+0000 7f81be000700 1 --2- 172.21.15.49:0/1160888319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c00c01f0 0x7f81c00ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.013+0000 7f81bea00700 1 --2- 172.21.15.49:0/1160888319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81c00bf890 0x7f81c00c26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.017+0000 7f81bf400700 1 -- 172.21.15.49:0/1160888319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81c00bf890 msgr2=0x7f81c00c26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.017+0000 7f81bf400700 1 --2- 172.21.15.49:0/1160888319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81c00bf890 0x7f81c00c26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.017+0000 7f81bf400700 1 -- 172.21.15.49:0/1160888319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c00c01f0 msgr2=0x7f81c00ae650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.017+0000 7f81bf400700 1 --2- 172.21.15.49:0/1160888319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c00c01f0 0x7f81c00ae650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.017+0000 7f81bf400700 1 -- 172.21.15.49:0/1160888319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b0009370 con 0x7f81c00c7fe0 2024-01-22T05:16:18.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.017+0000 7f81bf400700 1 --2- 172.21.15.49:0/1160888319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c00c7fe0 0x7f81c0149440 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f81b8002230 tx=0x7f81b80015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:18.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.017+0000 7f81b6000700 1 -- 172.21.15.49:0/1160888319 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b800e4a0 con 0x7f81c00c7fe0 2024-01-22T05:16:18.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.017+0000 7f81b6000700 1 -- 172.21.15.49:0/1160888319 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b800e600 con 0x7f81c00c7fe0 2024-01-22T05:16:18.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.017+0000 7f81c5600700 1 -- 172.21.15.49:0/1160888319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c00c2f70 con 0x7f81c00c7fe0 2024-01-22T05:16:18.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.017+0000 7f81b6000700 1 -- 172.21.15.49:0/1160888319 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b800e980 con 0x7f81c00c7fe0 2024-01-22T05:16:18.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.017+0000 7f81c5600700 1 -- 172.21.15.49:0/1160888319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c00c3530 con 0x7f81c00c7fe0 2024-01-22T05:16:18.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.017+0000 7f81c5600700 1 -- 172.21.15.49:0/1160888319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c0064260 con 0x7f81c00c7fe0 2024-01-22T05:16:18.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.021+0000 7f81b6000700 1 -- 172.21.15.49:0/1160888319 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f81b801b3b0 con 0x7f81c00c7fe0 2024-01-22T05:16:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.021+0000 7f81b6000700 1 --2- 172.21.15.49:0/1160888319 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f819805a4e0 0x7f819805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.021+0000 7f81b6000700 1 -- 172.21.15.49:0/1160888319 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f81b8073f60 con 0x7f81c00c7fe0 2024-01-22T05:16:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.021+0000 7f81bea00700 1 --2- 172.21.15.49:0/1160888319 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f819805a4e0 0x7f819805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.021+0000 7f81bea00700 1 --2- 172.21.15.49:0/1160888319 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f819805a4e0 0x7f819805c9a0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f81b0009130 tx=0x7f81b0017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:18.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.029+0000 7f81b6000700 1 -- 172.21.15.49:0/1160888319 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f81b8047630 con 0x7f81c00c7fe0 2024-01-22T05:16:18.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.197+0000 7f81c5600700 1 -- 172.21.15.49:0/1160888319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81c00c6150 con 0x7f81c00c7fe0 2024-01-22T05:16:18.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.197+0000 7f81b6000700 1 -- 172.21.15.49:0/1160888319 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+17178 (secure 0 0 0) 0x7f81b804ac50 con 0x7f81c00c7fe0 2024-01-22T05:16:18.198 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:18.198 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":145,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:16:15.073439+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:16:12.266975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-01-22T05:16:13.093952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:16:18.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.201+0000 7f81c5600700 1 -- 172.21.15.49:0/1160888319 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f819805a4e0 msgr2=0x7f819805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.201+0000 7f81c5600700 1 --2- 172.21.15.49:0/1160888319 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f819805a4e0 0x7f819805c9a0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f81b0009130 tx=0x7f81b0017000).stop 2024-01-22T05:16:18.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.201+0000 7f81c5600700 1 -- 172.21.15.49:0/1160888319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c00c7fe0 msgr2=0x7f81c0149440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.201+0000 7f81c5600700 1 --2- 172.21.15.49:0/1160888319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c00c7fe0 0x7f81c0149440 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f81b8002230 tx=0x7f81b80015e0).stop 2024-01-22T05:16:18.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.201+0000 7f81c5600700 1 -- 172.21.15.49:0/1160888319 shutdown_connections 2024-01-22T05:16:18.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.201+0000 7f81c5600700 1 --2- 172.21.15.49:0/1160888319 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f819805a4e0 0x7f819805c9a0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.201+0000 7f81c5600700 1 --2- 172.21.15.49:0/1160888319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81c00c7fe0 0x7f81c0149440 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.201+0000 7f81c5600700 1 --2- 172.21.15.49:0/1160888319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c00c01f0 0x7f81c00ae650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.201+0000 7f81c5600700 1 --2- 172.21.15.49:0/1160888319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81c00bf890 0x7f81c00c26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.201+0000 7f81c5600700 1 -- 172.21.15.49:0/1160888319 >> 172.21.15.49:0/1160888319 conn(0x7f81c00cb3a0 msgr2=0x7f81c00c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:18.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.201+0000 7f81c5600700 1 -- 172.21.15.49:0/1160888319 shutdown_connections 2024-01-22T05:16:18.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.201+0000 7f81c5600700 1 -- 172.21.15.49:0/1160888319 wait complete. 2024-01-22T05:16:18.225 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:16:18.226 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:16:18.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.381+0000 7f2c39e00700 1 Processor -- start 2024-01-22T05:16:18.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.381+0000 7f2c39e00700 1 -- start start 2024-01-22T05:16:18.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c39e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2c340bca30 0x7f2c34068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c39e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c34066f60 0x7f2c34062230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c39e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c340bbd00 con 0x7f2c34151830 2024-01-22T05:16:18.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c39e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c340bce10 con 0x7f2c340bca30 2024-01-22T05:16:18.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c39e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c340bc5a0 con 0x7f2c34066f60 2024-01-22T05:16:18.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c33e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2c34151830 0x7f2c34066850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45524/0 (socket says 172.21.15.49:45524) 2024-01-22T05:16:18.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c33e00700 1 -- 172.21.15.49:0/3993605343 learned_addr learned my addr 172.21.15.49:0/3993605343 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:18.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c38a00700 1 --2- 172.21.15.49:0/3993605343 >> v2:172.21.15.110:3300/0 conn(0x7f2c340bca30 0x7f2c34068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c39400700 1 --2- 172.21.15.49:0/3993605343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c34066f60 0x7f2c34062230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c33400700 1 -- 172.21.15.49:0/3993605343 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008980836 0 0) 0x7f2c340bbd00 con 0x7f2c34151830 2024-01-22T05:16:18.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c33400700 1 -- 172.21.15.49:0/3993605343 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c140033f0 con 0x7f2c34151830 2024-01-22T05:16:18.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c39400700 1 -- 172.21.15.49:0/3993605343 >> v2:172.21.15.110:3300/0 conn(0x7f2c340bca30 msgr2=0x7f2c34068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:18.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c39400700 1 --2- 172.21.15.49:0/3993605343 >> v2:172.21.15.110:3300/0 conn(0x7f2c340bca30 0x7f2c34068aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c39400700 1 -- 172.21.15.49:0/3993605343 >> v1:172.21.15.49:6789/0 conn(0x7f2c34151830 legacy=0x7f2c34066850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c39400700 1 -- 172.21.15.49:0/3993605343 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c340692f0 con 0x7f2c34066f60 2024-01-22T05:16:18.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c38a00700 1 --2- 172.21.15.49:0/3993605343 >> v2:172.21.15.110:3300/0 conn(0x7f2c340bca30 0x7f2c34068aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:18.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c39400700 1 --2- 172.21.15.49:0/3993605343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c34066f60 0x7f2c34062230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f2c2c009e60 tx=0x7f2c2c009780).ready entity=mon.2 client_cookie=5ef6c56c3a5cfedf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:18.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.385+0000 7f2c33400700 1 -- 172.21.15.49:0/3993605343 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c00e070 con 0x7f2c34066f60 2024-01-22T05:16:18.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.389+0000 7f2c33400700 1 -- 172.21.15.49:0/3993605343 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c00bab0 con 0x7f2c34066f60 2024-01-22T05:16:18.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.389+0000 7f2c33400700 1 -- 172.21.15.49:0/3993605343 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c00be30 con 0x7f2c34066f60 2024-01-22T05:16:18.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.389+0000 7f2c39e00700 1 -- 172.21.15.49:0/3993605343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c34066f60 msgr2=0x7f2c34062230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.389+0000 7f2c39e00700 1 --2- 172.21.15.49:0/3993605343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c34066f60 0x7f2c34062230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f2c2c009e60 tx=0x7f2c2c009780).stop 2024-01-22T05:16:18.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.389+0000 7f2c39e00700 1 -- 172.21.15.49:0/3993605343 shutdown_connections 2024-01-22T05:16:18.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.389+0000 7f2c39e00700 1 --2- 172.21.15.49:0/3993605343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c34066f60 0x7f2c34062230 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.389+0000 7f2c39e00700 1 --2- 172.21.15.49:0/3993605343 >> v2:172.21.15.110:3300/0 conn(0x7f2c340bca30 0x7f2c34068aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.389+0000 7f2c39e00700 1 -- 172.21.15.49:0/3993605343 >> 172.21.15.49:0/3993605343 conn(0x7f2c340c42a0 msgr2=0x7f2c34065f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:18.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.389+0000 7f2c39e00700 1 -- 172.21.15.49:0/3993605343 shutdown_connections 2024-01-22T05:16:18.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.389+0000 7f2c39e00700 1 -- 172.21.15.49:0/3993605343 wait complete. 2024-01-22T05:16:18.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.393+0000 7f2c39e00700 1 Processor -- start 2024-01-22T05:16:18.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.393+0000 7f2c39e00700 1 -- start start 2024-01-22T05:16:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.393+0000 7f2c39e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c34066f60 0x7f2c340a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.393+0000 7f2c39e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c340bca30 0x7f2c340aa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.393+0000 7f2c39e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c34151830 0x7f2c340a8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.393+0000 7f2c39e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c340a5300 con 0x7f2c34151830 2024-01-22T05:16:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.393+0000 7f2c39e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c340c1870 con 0x7f2c34066f60 2024-01-22T05:16:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.393+0000 7f2c39e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c340a5ad0 con 0x7f2c340bca30 2024-01-22T05:16:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.393+0000 7f2c39400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c34151830 0x7f2c340a8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.393+0000 7f2c39400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c34151830 0x7f2c340a8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34222/0 (socket says 172.21.15.49:34222) 2024-01-22T05:16:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.393+0000 7f2c39400700 1 -- 172.21.15.49:0/4069266553 learned_addr learned my addr 172.21.15.49:0/4069266553 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.393+0000 7f2c33e00700 1 --2- 172.21.15.49:0/4069266553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c340bca30 0x7f2c340aa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.393+0000 7f2c38a00700 1 --2- 172.21.15.49:0/4069266553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c34066f60 0x7f2c340a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.397+0000 7f2c33e00700 1 -- 172.21.15.49:0/4069266553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c34066f60 msgr2=0x7f2c340a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.397+0000 7f2c33e00700 1 --2- 172.21.15.49:0/4069266553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c34066f60 0x7f2c340a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.397+0000 7f2c33e00700 1 -- 172.21.15.49:0/4069266553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c34151830 msgr2=0x7f2c340a8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.397+0000 7f2c33e00700 1 --2- 172.21.15.49:0/4069266553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c34151830 0x7f2c340a8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.397+0000 7f2c33e00700 1 -- 172.21.15.49:0/4069266553 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c240092a0 con 0x7f2c340bca30 2024-01-22T05:16:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.397+0000 7f2c39400700 1 --2- 172.21.15.49:0/4069266553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c34151830 0x7f2c340a8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.397+0000 7f2c33e00700 1 --2- 172.21.15.49:0/4069266553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c340bca30 0x7f2c340aa830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f2c1c00c410 tx=0x7f2c1c007bd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.397+0000 7f2c2be00700 1 -- 172.21.15.49:0/4069266553 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c0070d0 con 0x7f2c340bca30 2024-01-22T05:16:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.397+0000 7f2c2be00700 1 -- 172.21.15.49:0/4069266553 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c007230 con 0x7f2c340bca30 2024-01-22T05:16:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.397+0000 7f2c39e00700 1 -- 172.21.15.49:0/4069266553 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2c009a20 con 0x7f2c340bca30 2024-01-22T05:16:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.397+0000 7f2c2be00700 1 -- 172.21.15.49:0/4069266553 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c0075f0 con 0x7f2c340bca30 2024-01-22T05:16:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.397+0000 7f2c39e00700 1 -- 172.21.15.49:0/4069266553 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c340a55c0 con 0x7f2c340bca30 2024-01-22T05:16:18.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.397+0000 7f2c39e00700 1 -- 172.21.15.49:0/4069266553 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c340c19e0 con 0x7f2c340bca30 2024-01-22T05:16:18.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.397+0000 7f2c2be00700 1 -- 172.21.15.49:0/4069266553 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2c1c0059b0 con 0x7f2c340bca30 2024-01-22T05:16:18.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.401+0000 7f2c2be00700 1 --2- 172.21.15.49:0/4069266553 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c0c05a540 0x7f2c0c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.401+0000 7f2c2be00700 1 -- 172.21.15.49:0/4069266553 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2c1c073ea0 con 0x7f2c340bca30 2024-01-22T05:16:18.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.401+0000 7f2c38a00700 1 --2- 172.21.15.49:0/4069266553 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c0c05a540 0x7f2c0c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.401+0000 7f2c38a00700 1 --2- 172.21.15.49:0/4069266553 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c0c05a540 0x7f2c0c05ca00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f2c24009dc0 tx=0x7f2c24009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:18.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.409+0000 7f2c2be00700 1 -- 172.21.15.49:0/4069266553 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2c1c047520 con 0x7f2c340bca30 2024-01-22T05:16:18.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.573+0000 7f2c39e00700 1 -- 172.21.15.49:0/4069266553 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c340bbf50 con 0x7f2c0c05a540 2024-01-22T05:16:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.589+0000 7f2c2be00700 1 -- 172.21.15.49:0/4069266553 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359762 (secure 0 0 0) 0x7f2c340bbf50 con 0x7f2c0c05a540 2024-01-22T05:16:18.592 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:18.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.601+0000 7f2c39e00700 1 -- 172.21.15.49:0/4069266553 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c0c05a540 msgr2=0x7f2c0c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.601+0000 7f2c39e00700 1 --2- 172.21.15.49:0/4069266553 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c0c05a540 0x7f2c0c05ca00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f2c24009dc0 tx=0x7f2c24009060).stop 2024-01-22T05:16:18.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.601+0000 7f2c39e00700 1 -- 172.21.15.49:0/4069266553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c340bca30 msgr2=0x7f2c340aa830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.601+0000 7f2c39e00700 1 --2- 172.21.15.49:0/4069266553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c340bca30 0x7f2c340aa830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f2c1c00c410 tx=0x7f2c1c007bd0).stop 2024-01-22T05:16:18.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.601+0000 7f2c39e00700 1 -- 172.21.15.49:0/4069266553 shutdown_connections 2024-01-22T05:16:18.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.601+0000 7f2c39e00700 1 --2- 172.21.15.49:0/4069266553 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c0c05a540 0x7f2c0c05ca00 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.601+0000 7f2c39e00700 1 --2- 172.21.15.49:0/4069266553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c34151830 0x7f2c340a8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.601+0000 7f2c39e00700 1 --2- 172.21.15.49:0/4069266553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c340bca30 0x7f2c340aa830 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.601+0000 7f2c39e00700 1 --2- 172.21.15.49:0/4069266553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c34066f60 0x7f2c340a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.601+0000 7f2c39e00700 1 -- 172.21.15.49:0/4069266553 >> 172.21.15.49:0/4069266553 conn(0x7f2c340c42a0 msgr2=0x7f2c34067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:18.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.601+0000 7f2c39e00700 1 -- 172.21.15.49:0/4069266553 shutdown_connections 2024-01-22T05:16:18.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.601+0000 7f2c39e00700 1 -- 172.21.15.49:0/4069266553 wait complete. 2024-01-22T05:16:18.606 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:16:18.624 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":493,"stamp":"2024-01-22T05:16:17.492560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":238,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2469824,"kb_used_data":14208,"kb_used_omap":0,"kb_used_meta":2455552,"kb_avail":752504896,"statfs":{"total":773094113280,"available":770565013504,"internally_reserved":0,"allocated":14548992,"data_stored":7206356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2514485248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077823722,"num_objects":-1078,"num_object_clones":0,"num_object_copies":-2156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1078,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-3201,"num_write_kb":-1053286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-16,"num_bytes_recovered":-16777216,"num_keys_recovered":0,"num_objects_omap":-46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.097208"},"pg_stats":[{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.121524+0000","last_change":"2024-01-22T05:16:14.114071+0000","last_active":"2024-01-22T05:16:14.121524+0000","last_peered":"2024-01-22T05:16:14.121524+0000","last_clean":"2024-01-22T05:16:14.121524+0000","last_became_active":"2024-01-22T05:16:14.113738+0000","last_became_peered":"2024-01-22T05:16:14.113738+0000","last_unstale":"2024-01-22T05:16:14.121524+0000","last_undegraded":"2024-01-22T05:16:14.121524+0000","last_fullsized":"2024-01-22T05:16:14.121524+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3f","version":"144'3","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.114427+0000","last_change":"2024-01-22T05:16:13.664134+0000","last_active":"2024-01-22T05:16:14.114427+0000","last_peered":"2024-01-22T05:16:14.114427+0000","last_clean":"2024-01-22T05:16:14.114427+0000","last_became_active":"2024-01-22T05:16:13.659618+0000","last_became_peered":"2024-01-22T05:16:13.659618+0000","last_unstale":"2024-01-22T05:16:14.114427+0000","last_undegraded":"2024-01-22T05:16:14.114427+0000","last_fullsized":"2024-01-22T05:16:14.114427+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110801+0000","last_change":"2024-01-22T05:16:14.101928+0000","last_active":"2024-01-22T05:16:14.110801+0000","last_peered":"2024-01-22T05:16:14.110801+0000","last_clean":"2024-01-22T05:16:14.110801+0000","last_became_active":"2024-01-22T05:16:14.101662+0000","last_became_peered":"2024-01-22T05:16:14.101662+0000","last_unstale":"2024-01-22T05:16:14.110801+0000","last_undegraded":"2024-01-22T05:16:14.110801+0000","last_fullsized":"2024-01-22T05:16:14.110801+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.079695+0000","last_change":"2024-01-22T05:16:13.645349+0000","last_active":"2024-01-22T05:16:14.079695+0000","last_peered":"2024-01-22T05:16:14.079695+0000","last_clean":"2024-01-22T05:16:14.079695+0000","last_became_active":"2024-01-22T05:16:13.644648+0000","last_became_peered":"2024-01-22T05:16:13.644648+0000","last_unstale":"2024-01-22T05:16:14.079695+0000","last_undegraded":"2024-01-22T05:16:14.079695+0000","last_fullsized":"2024-01-22T05:16:14.079695+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110747+0000","last_change":"2024-01-22T05:16:14.105444+0000","last_active":"2024-01-22T05:16:14.110747+0000","last_peered":"2024-01-22T05:16:14.110747+0000","last_clean":"2024-01-22T05:16:14.110747+0000","last_became_active":"2024-01-22T05:16:14.105144+0000","last_became_peered":"2024-01-22T05:16:14.105144+0000","last_unstale":"2024-01-22T05:16:14.110747+0000","last_undegraded":"2024-01-22T05:16:14.110747+0000","last_fullsized":"2024-01-22T05:16:14.110747+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.095267+0000","last_change":"2024-01-22T05:16:13.665078+0000","last_active":"2024-01-22T05:16:14.095267+0000","last_peered":"2024-01-22T05:16:14.095267+0000","last_clean":"2024-01-22T05:16:14.095267+0000","last_became_active":"2024-01-22T05:16:13.664734+0000","last_became_peered":"2024-01-22T05:16:13.664734+0000","last_unstale":"2024-01-22T05:16:14.095267+0000","last_undegraded":"2024-01-22T05:16:14.095267+0000","last_fullsized":"2024-01-22T05:16:14.095267+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112078+0000","last_change":"2024-01-22T05:16:14.110410+0000","last_active":"2024-01-22T05:16:14.112078+0000","last_peered":"2024-01-22T05:16:14.112078+0000","last_clean":"2024-01-22T05:16:14.112078+0000","last_became_active":"2024-01-22T05:16:14.109190+0000","last_became_peered":"2024-01-22T05:16:14.109190+0000","last_unstale":"2024-01-22T05:16:14.112078+0000","last_undegraded":"2024-01-22T05:16:14.112078+0000","last_fullsized":"2024-01-22T05:16:14.112078+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"144'2","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.113725+0000","last_change":"2024-01-22T05:16:13.644874+0000","last_active":"2024-01-22T05:16:14.113725+0000","last_peered":"2024-01-22T05:16:14.113725+0000","last_clean":"2024-01-22T05:16:14.113725+0000","last_became_active":"2024-01-22T05:16:13.644554+0000","last_became_peered":"2024-01-22T05:16:13.644554+0000","last_unstale":"2024-01-22T05:16:14.113725+0000","last_undegraded":"2024-01-22T05:16:14.113725+0000","last_fullsized":"2024-01-22T05:16:14.113725+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.116274+0000","last_change":"2024-01-22T05:16:14.113810+0000","last_active":"2024-01-22T05:16:14.116274+0000","last_peered":"2024-01-22T05:16:14.116274+0000","last_clean":"2024-01-22T05:16:14.116274+0000","last_became_active":"2024-01-22T05:16:14.113376+0000","last_became_peered":"2024-01-22T05:16:14.113376+0000","last_unstale":"2024-01-22T05:16:14.116274+0000","last_undegraded":"2024-01-22T05:16:14.116274+0000","last_fullsized":"2024-01-22T05:16:14.116274+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3b","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112779+0000","last_change":"2024-01-22T05:16:13.663883+0000","last_active":"2024-01-22T05:16:14.112779+0000","last_peered":"2024-01-22T05:16:14.112779+0000","last_clean":"2024-01-22T05:16:14.112779+0000","last_became_active":"2024-01-22T05:16:13.663539+0000","last_became_peered":"2024-01-22T05:16:13.663539+0000","last_unstale":"2024-01-22T05:16:14.112779+0000","last_undegraded":"2024-01-22T05:16:14.112779+0000","last_fullsized":"2024-01-22T05:16:14.112779+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.104006+0000","last_change":"2024-01-22T05:16:14.097304+0000","last_active":"2024-01-22T05:16:14.104006+0000","last_peered":"2024-01-22T05:16:14.104006+0000","last_clean":"2024-01-22T05:16:14.104006+0000","last_became_active":"2024-01-22T05:16:14.097014+0000","last_became_peered":"2024-01-22T05:16:14.097014+0000","last_unstale":"2024-01-22T05:16:14.104006+0000","last_undegraded":"2024-01-22T05:16:14.104006+0000","last_fullsized":"2024-01-22T05:16:14.104006+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3a","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.113036+0000","last_change":"2024-01-22T05:16:13.670740+0000","last_active":"2024-01-22T05:16:14.113036+0000","last_peered":"2024-01-22T05:16:14.113036+0000","last_clean":"2024-01-22T05:16:14.113036+0000","last_became_active":"2024-01-22T05:16:13.670426+0000","last_became_peered":"2024-01-22T05:16:13.670426+0000","last_unstale":"2024-01-22T05:16:14.113036+0000","last_undegraded":"2024-01-22T05:16:14.113036+0000","last_fullsized":"2024-01-22T05:16:14.113036+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110683+0000","last_change":"2024-01-22T05:16:14.100502+0000","last_active":"2024-01-22T05:16:14.110683+0000","last_peered":"2024-01-22T05:16:14.110683+0000","last_clean":"2024-01-22T05:16:14.110683+0000","last_became_active":"2024-01-22T05:16:14.098029+0000","last_became_peered":"2024-01-22T05:16:14.098029+0000","last_unstale":"2024-01-22T05:16:14.110683+0000","last_undegraded":"2024-01-22T05:16:14.110683+0000","last_fullsized":"2024-01-22T05:16:14.110683+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083795+0000","last_change":"2024-01-22T05:16:13.661623+0000","last_active":"2024-01-22T05:16:14.083795+0000","last_peered":"2024-01-22T05:16:14.083795+0000","last_clean":"2024-01-22T05:16:14.083795+0000","last_became_active":"2024-01-22T05:16:13.661338+0000","last_became_peered":"2024-01-22T05:16:13.661338+0000","last_unstale":"2024-01-22T05:16:14.083795+0000","last_undegraded":"2024-01-22T05:16:14.083795+0000","last_fullsized":"2024-01-22T05:16:14.083795+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.117183+0000","last_change":"2024-01-22T05:16:14.110158+0000","last_active":"2024-01-22T05:16:14.117183+0000","last_peered":"2024-01-22T05:16:14.117183+0000","last_clean":"2024-01-22T05:16:14.117183+0000","last_became_active":"2024-01-22T05:16:14.109717+0000","last_became_peered":"2024-01-22T05:16:14.109717+0000","last_unstale":"2024-01-22T05:16:14.117183+0000","last_undegraded":"2024-01-22T05:16:14.117183+0000","last_fullsized":"2024-01-22T05:16:14.117183+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.077578+0000","last_change":"2024-01-22T05:16:13.635717+0000","last_active":"2024-01-22T05:16:14.077578+0000","last_peered":"2024-01-22T05:16:14.077578+0000","last_clean":"2024-01-22T05:16:14.077578+0000","last_became_active":"2024-01-22T05:16:13.635425+0000","last_became_peered":"2024-01-22T05:16:13.635425+0000","last_unstale":"2024-01-22T05:16:14.077578+0000","last_undegraded":"2024-01-22T05:16:14.077578+0000","last_fullsized":"2024-01-22T05:16:14.077578+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.102849+0000","last_change":"2024-01-22T05:16:14.097810+0000","last_active":"2024-01-22T05:16:14.102849+0000","last_peered":"2024-01-22T05:16:14.102849+0000","last_clean":"2024-01-22T05:16:14.102849+0000","last_became_active":"2024-01-22T05:16:14.097030+0000","last_became_peered":"2024-01-22T05:16:14.097030+0000","last_unstale":"2024-01-22T05:16:14.102849+0000","last_undegraded":"2024-01-22T05:16:14.102849+0000","last_fullsized":"2024-01-22T05:16:14.102849+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.084160+0000","last_change":"2024-01-22T05:16:13.657951+0000","last_active":"2024-01-22T05:16:14.084160+0000","last_peered":"2024-01-22T05:16:14.084160+0000","last_clean":"2024-01-22T05:16:14.084160+0000","last_became_active":"2024-01-22T05:16:13.657686+0000","last_became_peered":"2024-01-22T05:16:13.657686+0000","last_unstale":"2024-01-22T05:16:14.084160+0000","last_undegraded":"2024-01-22T05:16:14.084160+0000","last_fullsized":"2024-01-22T05:16:14.084160+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.111881+0000","last_change":"2024-01-22T05:16:14.102747+0000","last_active":"2024-01-22T05:16:14.111881+0000","last_peered":"2024-01-22T05:16:14.111881+0000","last_clean":"2024-01-22T05:16:14.111881+0000","last_became_active":"2024-01-22T05:16:14.102546+0000","last_became_peered":"2024-01-22T05:16:14.102546+0000","last_unstale":"2024-01-22T05:16:14.111881+0000","last_undegraded":"2024-01-22T05:16:14.111881+0000","last_fullsized":"2024-01-22T05:16:14.111881+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.102956+0000","last_change":"2024-01-22T05:16:13.651840+0000","last_active":"2024-01-22T05:16:14.102956+0000","last_peered":"2024-01-22T05:16:14.102956+0000","last_clean":"2024-01-22T05:16:14.102956+0000","last_became_active":"2024-01-22T05:16:13.651503+0000","last_became_peered":"2024-01-22T05:16:13.651503+0000","last_unstale":"2024-01-22T05:16:14.102956+0000","last_undegraded":"2024-01-22T05:16:14.102956+0000","last_fullsized":"2024-01-22T05:16:14.102956+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.109682+0000","last_change":"2024-01-22T05:16:14.101660+0000","last_active":"2024-01-22T05:16:14.109682+0000","last_peered":"2024-01-22T05:16:14.109682+0000","last_clean":"2024-01-22T05:16:14.109682+0000","last_became_active":"2024-01-22T05:16:14.100085+0000","last_became_peered":"2024-01-22T05:16:14.100085+0000","last_unstale":"2024-01-22T05:16:14.109682+0000","last_undegraded":"2024-01-22T05:16:14.109682+0000","last_fullsized":"2024-01-22T05:16:14.109682+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.077328+0000","last_change":"2024-01-22T05:16:13.658792+0000","last_active":"2024-01-22T05:16:14.077328+0000","last_peered":"2024-01-22T05:16:14.077328+0000","last_clean":"2024-01-22T05:16:14.077328+0000","last_became_active":"2024-01-22T05:16:13.658432+0000","last_became_peered":"2024-01-22T05:16:13.658432+0000","last_unstale":"2024-01-22T05:16:14.077328+0000","last_undegraded":"2024-01-22T05:16:14.077328+0000","last_fullsized":"2024-01-22T05:16:14.077328+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112190+0000","last_change":"2024-01-22T05:16:14.104274+0000","last_active":"2024-01-22T05:16:14.112190+0000","last_peered":"2024-01-22T05:16:14.112190+0000","last_clean":"2024-01-22T05:16:14.112190+0000","last_became_active":"2024-01-22T05:16:14.103993+0000","last_became_peered":"2024-01-22T05:16:14.103993+0000","last_unstale":"2024-01-22T05:16:14.112190+0000","last_undegraded":"2024-01-22T05:16:14.112190+0000","last_fullsized":"2024-01-22T05:16:14.112190+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.34","version":"144'4","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.122685+0000","last_change":"2024-01-22T05:16:13.668531+0000","last_active":"2024-01-22T05:16:14.122685+0000","last_peered":"2024-01-22T05:16:14.122685+0000","last_clean":"2024-01-22T05:16:14.122685+0000","last_became_active":"2024-01-22T05:16:13.668285+0000","last_became_peered":"2024-01-22T05:16:13.668285+0000","last_unstale":"2024-01-22T05:16:14.122685+0000","last_undegraded":"2024-01-22T05:16:14.122685+0000","last_fullsized":"2024-01-22T05:16:14.122685+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.099000+0000","last_change":"2024-01-22T05:16:14.094828+0000","last_active":"2024-01-22T05:16:14.099000+0000","last_peered":"2024-01-22T05:16:14.099000+0000","last_clean":"2024-01-22T05:16:14.099000+0000","last_became_active":"2024-01-22T05:16:14.094546+0000","last_became_peered":"2024-01-22T05:16:14.094546+0000","last_unstale":"2024-01-22T05:16:14.099000+0000","last_undegraded":"2024-01-22T05:16:14.099000+0000","last_fullsized":"2024-01-22T05:16:14.099000+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.33","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112937+0000","last_change":"2024-01-22T05:16:13.660559+0000","last_active":"2024-01-22T05:16:14.112937+0000","last_peered":"2024-01-22T05:16:14.112937+0000","last_clean":"2024-01-22T05:16:14.112937+0000","last_became_active":"2024-01-22T05:16:13.660268+0000","last_became_peered":"2024-01-22T05:16:13.660268+0000","last_unstale":"2024-01-22T05:16:14.112937+0000","last_undegraded":"2024-01-22T05:16:14.112937+0000","last_fullsized":"2024-01-22T05:16:14.112937+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.097199+0000","last_change":"2024-01-22T05:16:14.094117+0000","last_active":"2024-01-22T05:16:14.097199+0000","last_peered":"2024-01-22T05:16:14.097199+0000","last_clean":"2024-01-22T05:16:14.097199+0000","last_became_active":"2024-01-22T05:16:14.093837+0000","last_became_peered":"2024-01-22T05:16:14.093837+0000","last_unstale":"2024-01-22T05:16:14.097199+0000","last_undegraded":"2024-01-22T05:16:14.097199+0000","last_fullsized":"2024-01-22T05:16:14.097199+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.089146+0000","last_change":"2024-01-22T05:16:13.658358+0000","last_active":"2024-01-22T05:16:14.089146+0000","last_peered":"2024-01-22T05:16:14.089146+0000","last_clean":"2024-01-22T05:16:14.089146+0000","last_became_active":"2024-01-22T05:16:13.657959+0000","last_became_peered":"2024-01-22T05:16:13.657959+0000","last_unstale":"2024-01-22T05:16:14.089146+0000","last_undegraded":"2024-01-22T05:16:14.089146+0000","last_fullsized":"2024-01-22T05:16:14.089146+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.106961+0000","last_change":"2024-01-22T05:16:14.103374+0000","last_active":"2024-01-22T05:16:14.106961+0000","last_peered":"2024-01-22T05:16:14.106961+0000","last_clean":"2024-01-22T05:16:14.106961+0000","last_became_active":"2024-01-22T05:16:14.103040+0000","last_became_peered":"2024-01-22T05:16:14.103040+0000","last_unstale":"2024-01-22T05:16:14.106961+0000","last_undegraded":"2024-01-22T05:16:14.106961+0000","last_fullsized":"2024-01-22T05:16:14.106961+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.089696+0000","last_change":"2024-01-22T05:16:13.659177+0000","last_active":"2024-01-22T05:16:14.089696+0000","last_peered":"2024-01-22T05:16:14.089696+0000","last_clean":"2024-01-22T05:16:14.089696+0000","last_became_active":"2024-01-22T05:16:13.658617+0000","last_became_peered":"2024-01-22T05:16:13.658617+0000","last_unstale":"2024-01-22T05:16:14.089696+0000","last_undegraded":"2024-01-22T05:16:14.089696+0000","last_fullsized":"2024-01-22T05:16:14.089696+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.109607+0000","last_change":"2024-01-22T05:16:14.101893+0000","last_active":"2024-01-22T05:16:14.109607+0000","last_peered":"2024-01-22T05:16:14.109607+0000","last_clean":"2024-01-22T05:16:14.109607+0000","last_became_active":"2024-01-22T05:16:14.101497+0000","last_became_peered":"2024-01-22T05:16:14.101497+0000","last_unstale":"2024-01-22T05:16:14.109607+0000","last_undegraded":"2024-01-22T05:16:14.109607+0000","last_fullsized":"2024-01-22T05:16:14.109607+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.30","version":"144'4","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.114944+0000","last_change":"2024-01-22T05:16:13.673327+0000","last_active":"2024-01-22T05:16:14.114944+0000","last_peered":"2024-01-22T05:16:14.114944+0000","last_clean":"2024-01-22T05:16:14.114944+0000","last_became_active":"2024-01-22T05:16:13.672691+0000","last_became_peered":"2024-01-22T05:16:13.672691+0000","last_unstale":"2024-01-22T05:16:14.114944+0000","last_undegraded":"2024-01-22T05:16:14.114944+0000","last_fullsized":"2024-01-22T05:16:14.114944+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110995+0000","last_change":"2024-01-22T05:16:14.108990+0000","last_active":"2024-01-22T05:16:14.110995+0000","last_peered":"2024-01-22T05:16:14.110995+0000","last_clean":"2024-01-22T05:16:14.110995+0000","last_became_active":"2024-01-22T05:16:14.108698+0000","last_became_peered":"2024-01-22T05:16:14.108698+0000","last_unstale":"2024-01-22T05:16:14.110995+0000","last_undegraded":"2024-01-22T05:16:14.110995+0000","last_fullsized":"2024-01-22T05:16:14.110995+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.084286+0000","last_change":"2024-01-22T05:16:13.672907+0000","last_active":"2024-01-22T05:16:14.084286+0000","last_peered":"2024-01-22T05:16:14.084286+0000","last_clean":"2024-01-22T05:16:14.084286+0000","last_became_active":"2024-01-22T05:16:13.672645+0000","last_became_peered":"2024-01-22T05:16:13.672645+0000","last_unstale":"2024-01-22T05:16:14.084286+0000","last_undegraded":"2024-01-22T05:16:14.084286+0000","last_fullsized":"2024-01-22T05:16:14.084286+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.114907+0000","last_change":"2024-01-22T05:16:14.114265+0000","last_active":"2024-01-22T05:16:14.114907+0000","last_peered":"2024-01-22T05:16:14.114907+0000","last_clean":"2024-01-22T05:16:14.114907+0000","last_became_active":"2024-01-22T05:16:14.113476+0000","last_became_peered":"2024-01-22T05:16:14.113476+0000","last_unstale":"2024-01-22T05:16:14.114907+0000","last_undegraded":"2024-01-22T05:16:14.114907+0000","last_fullsized":"2024-01-22T05:16:14.114907+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.088299+0000","last_change":"2024-01-22T05:16:13.668321+0000","last_active":"2024-01-22T05:16:14.088299+0000","last_peered":"2024-01-22T05:16:14.088299+0000","last_clean":"2024-01-22T05:16:14.088299+0000","last_became_active":"2024-01-22T05:16:13.666798+0000","last_became_peered":"2024-01-22T05:16:13.666798+0000","last_unstale":"2024-01-22T05:16:14.088299+0000","last_undegraded":"2024-01-22T05:16:14.088299+0000","last_fullsized":"2024-01-22T05:16:14.088299+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.107037+0000","last_change":"2024-01-22T05:16:14.103716+0000","last_active":"2024-01-22T05:16:14.107037+0000","last_peered":"2024-01-22T05:16:14.107037+0000","last_clean":"2024-01-22T05:16:14.107037+0000","last_became_active":"2024-01-22T05:16:14.103457+0000","last_became_peered":"2024-01-22T05:16:14.103457+0000","last_unstale":"2024-01-22T05:16:14.107037+0000","last_undegraded":"2024-01-22T05:16:14.107037+0000","last_fullsized":"2024-01-22T05:16:14.107037+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2d","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.097544+0000","last_change":"2024-01-22T05:16:13.662661+0000","last_active":"2024-01-22T05:16:14.097544+0000","last_peered":"2024-01-22T05:16:14.097544+0000","last_clean":"2024-01-22T05:16:14.097544+0000","last_became_active":"2024-01-22T05:16:13.660294+0000","last_became_peered":"2024-01-22T05:16:13.660294+0000","last_unstale":"2024-01-22T05:16:14.097544+0000","last_undegraded":"2024-01-22T05:16:14.097544+0000","last_fullsized":"2024-01-22T05:16:14.097544+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112563+0000","last_change":"2024-01-22T05:16:14.105314+0000","last_active":"2024-01-22T05:16:14.112563+0000","last_peered":"2024-01-22T05:16:14.112563+0000","last_clean":"2024-01-22T05:16:14.112563+0000","last_became_active":"2024-01-22T05:16:14.105111+0000","last_became_peered":"2024-01-22T05:16:14.105111+0000","last_unstale":"2024-01-22T05:16:14.112563+0000","last_undegraded":"2024-01-22T05:16:14.112563+0000","last_fullsized":"2024-01-22T05:16:14.112563+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.088275+0000","last_change":"2024-01-22T05:16:13.667907+0000","last_active":"2024-01-22T05:16:14.088275+0000","last_peered":"2024-01-22T05:16:14.088275+0000","last_clean":"2024-01-22T05:16:14.088275+0000","last_became_active":"2024-01-22T05:16:13.667601+0000","last_became_peered":"2024-01-22T05:16:13.667601+0000","last_unstale":"2024-01-22T05:16:14.088275+0000","last_undegraded":"2024-01-22T05:16:14.088275+0000","last_fullsized":"2024-01-22T05:16:14.088275+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.094920+0000","last_change":"2024-01-22T05:16:14.089997+0000","last_active":"2024-01-22T05:16:14.094920+0000","last_peered":"2024-01-22T05:16:14.094920+0000","last_clean":"2024-01-22T05:16:14.094920+0000","last_became_active":"2024-01-22T05:16:14.089725+0000","last_became_peered":"2024-01-22T05:16:14.089725+0000","last_unstale":"2024-01-22T05:16:14.094920+0000","last_undegraded":"2024-01-22T05:16:14.094920+0000","last_fullsized":"2024-01-22T05:16:14.094920+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2b","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.102819+0000","last_change":"2024-01-22T05:16:13.653633+0000","last_active":"2024-01-22T05:16:14.102819+0000","last_peered":"2024-01-22T05:16:14.102819+0000","last_clean":"2024-01-22T05:16:14.102819+0000","last_became_active":"2024-01-22T05:16:13.653262+0000","last_became_peered":"2024-01-22T05:16:13.653262+0000","last_unstale":"2024-01-22T05:16:14.102819+0000","last_undegraded":"2024-01-22T05:16:14.102819+0000","last_fullsized":"2024-01-22T05:16:14.102819+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.103833+0000","last_change":"2024-01-22T05:16:14.096508+0000","last_active":"2024-01-22T05:16:14.103833+0000","last_peered":"2024-01-22T05:16:14.103833+0000","last_clean":"2024-01-22T05:16:14.103833+0000","last_became_active":"2024-01-22T05:16:14.096216+0000","last_became_peered":"2024-01-22T05:16:14.096216+0000","last_unstale":"2024-01-22T05:16:14.103833+0000","last_undegraded":"2024-01-22T05:16:14.103833+0000","last_fullsized":"2024-01-22T05:16:14.103833+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.098456+0000","last_change":"2024-01-22T05:16:13.658170+0000","last_active":"2024-01-22T05:16:14.098456+0000","last_peered":"2024-01-22T05:16:14.098456+0000","last_clean":"2024-01-22T05:16:14.098456+0000","last_became_active":"2024-01-22T05:16:13.657711+0000","last_became_peered":"2024-01-22T05:16:13.657711+0000","last_unstale":"2024-01-22T05:16:14.098456+0000","last_undegraded":"2024-01-22T05:16:14.098456+0000","last_fullsized":"2024-01-22T05:16:14.098456+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.099587+0000","last_change":"2024-01-22T05:16:14.094262+0000","last_active":"2024-01-22T05:16:14.099587+0000","last_peered":"2024-01-22T05:16:14.099587+0000","last_clean":"2024-01-22T05:16:14.099587+0000","last_became_active":"2024-01-22T05:16:14.093961+0000","last_became_peered":"2024-01-22T05:16:14.093961+0000","last_unstale":"2024-01-22T05:16:14.099587+0000","last_undegraded":"2024-01-22T05:16:14.099587+0000","last_fullsized":"2024-01-22T05:16:14.099587+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.077116+0000","last_change":"2024-01-22T05:16:13.650328+0000","last_active":"2024-01-22T05:16:14.077116+0000","last_peered":"2024-01-22T05:16:14.077116+0000","last_clean":"2024-01-22T05:16:14.077116+0000","last_became_active":"2024-01-22T05:16:13.648572+0000","last_became_peered":"2024-01-22T05:16:13.648572+0000","last_unstale":"2024-01-22T05:16:14.077116+0000","last_undegraded":"2024-01-22T05:16:14.077116+0000","last_fullsized":"2024-01-22T05:16:14.077116+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.111095+0000","last_change":"2024-01-22T05:16:14.107104+0000","last_active":"2024-01-22T05:16:14.111095+0000","last_peered":"2024-01-22T05:16:14.111095+0000","last_clean":"2024-01-22T05:16:14.111095+0000","last_became_active":"2024-01-22T05:16:14.105883+0000","last_became_peered":"2024-01-22T05:16:14.105883+0000","last_unstale":"2024-01-22T05:16:14.111095+0000","last_undegraded":"2024-01-22T05:16:14.111095+0000","last_fullsized":"2024-01-22T05:16:14.111095+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.081083+0000","last_change":"2024-01-22T05:16:13.657483+0000","last_active":"2024-01-22T05:16:14.081083+0000","last_peered":"2024-01-22T05:16:14.081083+0000","last_clean":"2024-01-22T05:16:14.081083+0000","last_became_active":"2024-01-22T05:16:13.657184+0000","last_became_peered":"2024-01-22T05:16:13.657184+0000","last_unstale":"2024-01-22T05:16:14.081083+0000","last_undegraded":"2024-01-22T05:16:14.081083+0000","last_fullsized":"2024-01-22T05:16:14.081083+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112793+0000","last_change":"2024-01-22T05:16:14.109218+0000","last_active":"2024-01-22T05:16:14.112793+0000","last_peered":"2024-01-22T05:16:14.112793+0000","last_clean":"2024-01-22T05:16:14.112793+0000","last_became_active":"2024-01-22T05:16:14.108900+0000","last_became_peered":"2024-01-22T05:16:14.108900+0000","last_unstale":"2024-01-22T05:16:14.112793+0000","last_undegraded":"2024-01-22T05:16:14.112793+0000","last_fullsized":"2024-01-22T05:16:14.112793+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.095486+0000","last_change":"2024-01-22T05:16:13.655473+0000","last_active":"2024-01-22T05:16:14.095486+0000","last_peered":"2024-01-22T05:16:14.095486+0000","last_clean":"2024-01-22T05:16:14.095486+0000","last_became_active":"2024-01-22T05:16:13.655219+0000","last_became_peered":"2024-01-22T05:16:13.655219+0000","last_unstale":"2024-01-22T05:16:14.095486+0000","last_undegraded":"2024-01-22T05:16:14.095486+0000","last_fullsized":"2024-01-22T05:16:14.095486+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.108231+0000","last_change":"2024-01-22T05:16:14.104693+0000","last_active":"2024-01-22T05:16:14.108231+0000","last_peered":"2024-01-22T05:16:14.108231+0000","last_clean":"2024-01-22T05:16:14.108231+0000","last_became_active":"2024-01-22T05:16:14.104263+0000","last_became_peered":"2024-01-22T05:16:14.104263+0000","last_unstale":"2024-01-22T05:16:14.108231+0000","last_undegraded":"2024-01-22T05:16:14.108231+0000","last_fullsized":"2024-01-22T05:16:14.108231+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.100407+0000","last_change":"2024-01-22T05:16:13.662789+0000","last_active":"2024-01-22T05:16:14.100407+0000","last_peered":"2024-01-22T05:16:14.100407+0000","last_clean":"2024-01-22T05:16:14.100407+0000","last_became_active":"2024-01-22T05:16:13.660818+0000","last_became_peered":"2024-01-22T05:16:13.660818+0000","last_unstale":"2024-01-22T05:16:14.100407+0000","last_undegraded":"2024-01-22T05:16:14.100407+0000","last_fullsized":"2024-01-22T05:16:14.100407+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.122335+0000","last_change":"2024-01-22T05:16:14.121438+0000","last_active":"2024-01-22T05:16:14.122335+0000","last_peered":"2024-01-22T05:16:14.122335+0000","last_clean":"2024-01-22T05:16:14.122335+0000","last_became_active":"2024-01-22T05:16:14.120693+0000","last_became_peered":"2024-01-22T05:16:14.120693+0000","last_unstale":"2024-01-22T05:16:14.122335+0000","last_undegraded":"2024-01-22T05:16:14.122335+0000","last_fullsized":"2024-01-22T05:16:14.122335+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.084569+0000","last_change":"2024-01-22T05:16:13.671358+0000","last_active":"2024-01-22T05:16:14.084569+0000","last_peered":"2024-01-22T05:16:14.084569+0000","last_clean":"2024-01-22T05:16:14.084569+0000","last_became_active":"2024-01-22T05:16:13.671093+0000","last_became_peered":"2024-01-22T05:16:13.671093+0000","last_unstale":"2024-01-22T05:16:14.084569+0000","last_undegraded":"2024-01-22T05:16:14.084569+0000","last_fullsized":"2024-01-22T05:16:14.084569+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.120861+0000","last_change":"2024-01-22T05:16:14.114418+0000","last_active":"2024-01-22T05:16:14.120861+0000","last_peered":"2024-01-22T05:16:14.120861+0000","last_clean":"2024-01-22T05:16:14.120861+0000","last_became_active":"2024-01-22T05:16:14.113765+0000","last_became_peered":"2024-01-22T05:16:14.113765+0000","last_unstale":"2024-01-22T05:16:14.120861+0000","last_undegraded":"2024-01-22T05:16:14.120861+0000","last_fullsized":"2024-01-22T05:16:14.120861+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.102745+0000","last_change":"2024-01-22T05:16:13.646807+0000","last_active":"2024-01-22T05:16:14.102745+0000","last_peered":"2024-01-22T05:16:14.102745+0000","last_clean":"2024-01-22T05:16:14.102745+0000","last_became_active":"2024-01-22T05:16:13.643861+0000","last_became_peered":"2024-01-22T05:16:13.643861+0000","last_unstale":"2024-01-22T05:16:14.102745+0000","last_undegraded":"2024-01-22T05:16:14.102745+0000","last_fullsized":"2024-01-22T05:16:14.102745+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.105631+0000","last_change":"2024-01-22T05:16:14.098218+0000","last_active":"2024-01-22T05:16:14.105631+0000","last_peered":"2024-01-22T05:16:14.105631+0000","last_clean":"2024-01-22T05:16:14.105631+0000","last_became_active":"2024-01-22T05:16:14.097899+0000","last_became_peered":"2024-01-22T05:16:14.097899+0000","last_unstale":"2024-01-22T05:16:14.105631+0000","last_undegraded":"2024-01-22T05:16:14.105631+0000","last_fullsized":"2024-01-22T05:16:14.105631+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.095621+0000","last_change":"2024-01-22T05:16:13.656818+0000","last_active":"2024-01-22T05:16:14.095621+0000","last_peered":"2024-01-22T05:16:14.095621+0000","last_clean":"2024-01-22T05:16:14.095621+0000","last_became_active":"2024-01-22T05:16:13.656160+0000","last_became_peered":"2024-01-22T05:16:13.656160+0000","last_unstale":"2024-01-22T05:16:14.095621+0000","last_undegraded":"2024-01-22T05:16:14.095621+0000","last_fullsized":"2024-01-22T05:16:14.095621+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112840+0000","last_change":"2024-01-22T05:16:14.109543+0000","last_active":"2024-01-22T05:16:14.112840+0000","last_peered":"2024-01-22T05:16:14.112840+0000","last_clean":"2024-01-22T05:16:14.112840+0000","last_became_active":"2024-01-22T05:16:14.109272+0000","last_became_peered":"2024-01-22T05:16:14.109272+0000","last_unstale":"2024-01-22T05:16:14.112840+0000","last_undegraded":"2024-01-22T05:16:14.112840+0000","last_fullsized":"2024-01-22T05:16:14.112840+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.095033+0000","last_change":"2024-01-22T05:16:13.657371+0000","last_active":"2024-01-22T05:16:14.095033+0000","last_peered":"2024-01-22T05:16:14.095033+0000","last_clean":"2024-01-22T05:16:14.095033+0000","last_became_active":"2024-01-22T05:16:13.656889+0000","last_became_peered":"2024-01-22T05:16:13.656889+0000","last_unstale":"2024-01-22T05:16:14.095033+0000","last_undegraded":"2024-01-22T05:16:14.095033+0000","last_fullsized":"2024-01-22T05:16:14.095033+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110759+0000","last_change":"2024-01-22T05:16:14.106342+0000","last_active":"2024-01-22T05:16:14.110759+0000","last_peered":"2024-01-22T05:16:14.110759+0000","last_clean":"2024-01-22T05:16:14.110759+0000","last_became_active":"2024-01-22T05:16:14.106086+0000","last_became_peered":"2024-01-22T05:16:14.106086+0000","last_unstale":"2024-01-22T05:16:14.110759+0000","last_undegraded":"2024-01-22T05:16:14.110759+0000","last_fullsized":"2024-01-22T05:16:14.110759+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.078013+0000","last_change":"2024-01-22T05:16:13.652356+0000","last_active":"2024-01-22T05:16:14.078013+0000","last_peered":"2024-01-22T05:16:14.078013+0000","last_clean":"2024-01-22T05:16:14.078013+0000","last_became_active":"2024-01-22T05:16:13.652058+0000","last_became_peered":"2024-01-22T05:16:13.652058+0000","last_unstale":"2024-01-22T05:16:14.078013+0000","last_undegraded":"2024-01-22T05:16:14.078013+0000","last_fullsized":"2024-01-22T05:16:14.078013+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.121693+0000","last_change":"2024-01-22T05:16:14.114697+0000","last_active":"2024-01-22T05:16:14.121693+0000","last_peered":"2024-01-22T05:16:14.121693+0000","last_clean":"2024-01-22T05:16:14.121693+0000","last_became_active":"2024-01-22T05:16:14.114386+0000","last_became_peered":"2024-01-22T05:16:14.114386+0000","last_unstale":"2024-01-22T05:16:14.121693+0000","last_undegraded":"2024-01-22T05:16:14.121693+0000","last_fullsized":"2024-01-22T05:16:14.121693+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.091954+0000","last_change":"2024-01-22T05:16:13.654339+0000","last_active":"2024-01-22T05:16:14.091954+0000","last_peered":"2024-01-22T05:16:14.091954+0000","last_clean":"2024-01-22T05:16:14.091954+0000","last_became_active":"2024-01-22T05:16:13.653656+0000","last_became_peered":"2024-01-22T05:16:13.653656+0000","last_unstale":"2024-01-22T05:16:14.091954+0000","last_undegraded":"2024-01-22T05:16:14.091954+0000","last_fullsized":"2024-01-22T05:16:14.091954+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.109714+0000","last_change":"2024-01-22T05:16:14.102872+0000","last_active":"2024-01-22T05:16:14.109714+0000","last_peered":"2024-01-22T05:16:14.109714+0000","last_clean":"2024-01-22T05:16:14.109714+0000","last_became_active":"2024-01-22T05:16:14.100920+0000","last_became_peered":"2024-01-22T05:16:14.100920+0000","last_unstale":"2024-01-22T05:16:14.109714+0000","last_undegraded":"2024-01-22T05:16:14.109714+0000","last_fullsized":"2024-01-22T05:16:14.109714+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.102454+0000","last_change":"2024-01-22T05:16:13.668278+0000","last_active":"2024-01-22T05:16:14.102454+0000","last_peered":"2024-01-22T05:16:14.102454+0000","last_clean":"2024-01-22T05:16:14.102454+0000","last_became_active":"2024-01-22T05:16:13.667924+0000","last_became_peered":"2024-01-22T05:16:13.667924+0000","last_unstale":"2024-01-22T05:16:14.102454+0000","last_undegraded":"2024-01-22T05:16:14.102454+0000","last_fullsized":"2024-01-22T05:16:14.102454+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.121623+0000","last_change":"2024-01-22T05:16:14.114125+0000","last_active":"2024-01-22T05:16:14.121623+0000","last_peered":"2024-01-22T05:16:14.121623+0000","last_clean":"2024-01-22T05:16:14.121623+0000","last_became_active":"2024-01-22T05:16:14.113851+0000","last_became_peered":"2024-01-22T05:16:14.113851+0000","last_unstale":"2024-01-22T05:16:14.121623+0000","last_undegraded":"2024-01-22T05:16:14.121623+0000","last_fullsized":"2024-01-22T05:16:14.121623+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112532+0000","last_change":"2024-01-22T05:16:13.668120+0000","last_active":"2024-01-22T05:16:14.112532+0000","last_peered":"2024-01-22T05:16:14.112532+0000","last_clean":"2024-01-22T05:16:14.112532+0000","last_became_active":"2024-01-22T05:16:13.667819+0000","last_became_peered":"2024-01-22T05:16:13.667819+0000","last_unstale":"2024-01-22T05:16:14.112532+0000","last_undegraded":"2024-01-22T05:16:14.112532+0000","last_fullsized":"2024-01-22T05:16:14.112532+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.107888+0000","last_change":"2024-01-22T05:16:14.099050+0000","last_active":"2024-01-22T05:16:14.107888+0000","last_peered":"2024-01-22T05:16:14.107888+0000","last_clean":"2024-01-22T05:16:14.107888+0000","last_became_active":"2024-01-22T05:16:14.097461+0000","last_became_peered":"2024-01-22T05:16:14.097461+0000","last_unstale":"2024-01-22T05:16:14.107888+0000","last_undegraded":"2024-01-22T05:16:14.107888+0000","last_fullsized":"2024-01-22T05:16:14.107888+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"144'2","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.113986+0000","last_change":"2024-01-22T05:16:13.639126+0000","last_active":"2024-01-22T05:16:14.113986+0000","last_peered":"2024-01-22T05:16:14.113986+0000","last_clean":"2024-01-22T05:16:14.113986+0000","last_became_active":"2024-01-22T05:16:13.638828+0000","last_became_peered":"2024-01-22T05:16:13.638828+0000","last_unstale":"2024-01-22T05:16:14.113986+0000","last_undegraded":"2024-01-22T05:16:14.113986+0000","last_fullsized":"2024-01-22T05:16:14.113986+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.107977+0000","last_change":"2024-01-22T05:16:14.099804+0000","last_active":"2024-01-22T05:16:14.107977+0000","last_peered":"2024-01-22T05:16:14.107977+0000","last_clean":"2024-01-22T05:16:14.107977+0000","last_became_active":"2024-01-22T05:16:14.099526+0000","last_became_peered":"2024-01-22T05:16:14.099526+0000","last_unstale":"2024-01-22T05:16:14.107977+0000","last_undegraded":"2024-01-22T05:16:14.107977+0000","last_fullsized":"2024-01-22T05:16:14.107977+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.078888+0000","last_change":"2024-01-22T05:16:13.652235+0000","last_active":"2024-01-22T05:16:14.078888+0000","last_peered":"2024-01-22T05:16:14.078888+0000","last_clean":"2024-01-22T05:16:14.078888+0000","last_became_active":"2024-01-22T05:16:13.651892+0000","last_became_peered":"2024-01-22T05:16:13.651892+0000","last_unstale":"2024-01-22T05:16:14.078888+0000","last_undegraded":"2024-01-22T05:16:14.078888+0000","last_fullsized":"2024-01-22T05:16:14.078888+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.121948+0000","last_change":"2024-01-22T05:16:14.120443+0000","last_active":"2024-01-22T05:16:14.121948+0000","last_peered":"2024-01-22T05:16:14.121948+0000","last_clean":"2024-01-22T05:16:14.121948+0000","last_became_active":"2024-01-22T05:16:14.117155+0000","last_became_peered":"2024-01-22T05:16:14.117155+0000","last_unstale":"2024-01-22T05:16:14.121948+0000","last_undegraded":"2024-01-22T05:16:14.121948+0000","last_fullsized":"2024-01-22T05:16:14.121948+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.093243+0000","last_change":"2024-01-22T05:16:13.658498+0000","last_active":"2024-01-22T05:16:14.093243+0000","last_peered":"2024-01-22T05:16:14.093243+0000","last_clean":"2024-01-22T05:16:14.093243+0000","last_became_active":"2024-01-22T05:16:13.658186+0000","last_became_peered":"2024-01-22T05:16:13.658186+0000","last_unstale":"2024-01-22T05:16:14.093243+0000","last_undegraded":"2024-01-22T05:16:14.093243+0000","last_fullsized":"2024-01-22T05:16:14.093243+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.111636+0000","last_change":"2024-01-22T05:16:14.107859+0000","last_active":"2024-01-22T05:16:14.111636+0000","last_peered":"2024-01-22T05:16:14.111636+0000","last_clean":"2024-01-22T05:16:14.111636+0000","last_became_active":"2024-01-22T05:16:14.105123+0000","last_became_peered":"2024-01-22T05:16:14.105123+0000","last_unstale":"2024-01-22T05:16:14.111636+0000","last_undegraded":"2024-01-22T05:16:14.111636+0000","last_fullsized":"2024-01-22T05:16:14.111636+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.078677+0000","last_change":"2024-01-22T05:16:13.650379+0000","last_active":"2024-01-22T05:16:14.078677+0000","last_peered":"2024-01-22T05:16:14.078677+0000","last_clean":"2024-01-22T05:16:14.078677+0000","last_became_active":"2024-01-22T05:16:13.650123+0000","last_became_peered":"2024-01-22T05:16:13.650123+0000","last_unstale":"2024-01-22T05:16:14.078677+0000","last_undegraded":"2024-01-22T05:16:14.078677+0000","last_fullsized":"2024-01-22T05:16:14.078677+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.111718+0000","last_change":"2024-01-22T05:16:14.104134+0000","last_active":"2024-01-22T05:16:14.111718+0000","last_peered":"2024-01-22T05:16:14.111718+0000","last_clean":"2024-01-22T05:16:14.111718+0000","last_became_active":"2024-01-22T05:16:14.103859+0000","last_became_peered":"2024-01-22T05:16:14.103859+0000","last_unstale":"2024-01-22T05:16:14.111718+0000","last_undegraded":"2024-01-22T05:16:14.111718+0000","last_fullsized":"2024-01-22T05:16:14.111718+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.089804+0000","last_change":"2024-01-22T05:16:13.659328+0000","last_active":"2024-01-22T05:16:14.089804+0000","last_peered":"2024-01-22T05:16:14.089804+0000","last_clean":"2024-01-22T05:16:14.089804+0000","last_became_active":"2024-01-22T05:16:13.658902+0000","last_became_peered":"2024-01-22T05:16:13.658902+0000","last_unstale":"2024-01-22T05:16:14.089804+0000","last_undegraded":"2024-01-22T05:16:14.089804+0000","last_fullsized":"2024-01-22T05:16:14.089804+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.106872+0000","last_change":"2024-01-22T05:16:14.098984+0000","last_active":"2024-01-22T05:16:14.106872+0000","last_peered":"2024-01-22T05:16:14.106872+0000","last_clean":"2024-01-22T05:16:14.106872+0000","last_became_active":"2024-01-22T05:16:14.098567+0000","last_became_peered":"2024-01-22T05:16:14.098567+0000","last_unstale":"2024-01-22T05:16:14.106872+0000","last_undegraded":"2024-01-22T05:16:14.106872+0000","last_fullsized":"2024-01-22T05:16:14.106872+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.077679+0000","last_change":"2024-01-22T05:16:13.646863+0000","last_active":"2024-01-22T05:16:14.077679+0000","last_peered":"2024-01-22T05:16:14.077679+0000","last_clean":"2024-01-22T05:16:14.077679+0000","last_became_active":"2024-01-22T05:16:13.646536+0000","last_became_peered":"2024-01-22T05:16:13.646536+0000","last_unstale":"2024-01-22T05:16:14.077679+0000","last_undegraded":"2024-01-22T05:16:14.077679+0000","last_fullsized":"2024-01-22T05:16:14.077679+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.102893+0000","last_change":"2024-01-22T05:16:14.097830+0000","last_active":"2024-01-22T05:16:14.102893+0000","last_peered":"2024-01-22T05:16:14.102893+0000","last_clean":"2024-01-22T05:16:14.102893+0000","last_became_active":"2024-01-22T05:16:14.097515+0000","last_became_peered":"2024-01-22T05:16:14.097515+0000","last_unstale":"2024-01-22T05:16:14.102893+0000","last_undegraded":"2024-01-22T05:16:14.102893+0000","last_fullsized":"2024-01-22T05:16:14.102893+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.108963+0000","last_change":"2024-01-22T05:16:13.659548+0000","last_active":"2024-01-22T05:16:14.108963+0000","last_peered":"2024-01-22T05:16:14.108963+0000","last_clean":"2024-01-22T05:16:14.108963+0000","last_became_active":"2024-01-22T05:16:13.658459+0000","last_became_peered":"2024-01-22T05:16:13.658459+0000","last_unstale":"2024-01-22T05:16:14.108963+0000","last_undegraded":"2024-01-22T05:16:14.108963+0000","last_fullsized":"2024-01-22T05:16:14.108963+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.108215+0000","last_change":"2024-01-22T05:16:14.104534+0000","last_active":"2024-01-22T05:16:14.108215+0000","last_peered":"2024-01-22T05:16:14.108215+0000","last_clean":"2024-01-22T05:16:14.108215+0000","last_became_active":"2024-01-22T05:16:14.103985+0000","last_became_peered":"2024-01-22T05:16:14.103985+0000","last_unstale":"2024-01-22T05:16:14.108215+0000","last_undegraded":"2024-01-22T05:16:14.108215+0000","last_fullsized":"2024-01-22T05:16:14.108215+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"144'2","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.117046+0000","last_change":"2024-01-22T05:16:13.669970+0000","last_active":"2024-01-22T05:16:14.117046+0000","last_peered":"2024-01-22T05:16:14.117046+0000","last_clean":"2024-01-22T05:16:14.117046+0000","last_became_active":"2024-01-22T05:16:13.669659+0000","last_became_peered":"2024-01-22T05:16:13.669659+0000","last_unstale":"2024-01-22T05:16:14.117046+0000","last_undegraded":"2024-01-22T05:16:14.117046+0000","last_fullsized":"2024-01-22T05:16:14.117046+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110960+0000","last_change":"2024-01-22T05:16:14.108764+0000","last_active":"2024-01-22T05:16:14.110960+0000","last_peered":"2024-01-22T05:16:14.110960+0000","last_clean":"2024-01-22T05:16:14.110960+0000","last_became_active":"2024-01-22T05:16:14.108445+0000","last_became_peered":"2024-01-22T05:16:14.108445+0000","last_unstale":"2024-01-22T05:16:14.110960+0000","last_undegraded":"2024-01-22T05:16:14.110960+0000","last_fullsized":"2024-01-22T05:16:14.110960+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.093659+0000","last_change":"2024-01-22T05:16:13.657219+0000","last_active":"2024-01-22T05:16:14.093659+0000","last_peered":"2024-01-22T05:16:14.093659+0000","last_clean":"2024-01-22T05:16:14.093659+0000","last_became_active":"2024-01-22T05:16:13.656868+0000","last_became_peered":"2024-01-22T05:16:13.656868+0000","last_unstale":"2024-01-22T05:16:14.093659+0000","last_undegraded":"2024-01-22T05:16:14.093659+0000","last_fullsized":"2024-01-22T05:16:14.093659+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.117259+0000","last_change":"2024-01-22T05:16:14.116326+0000","last_active":"2024-01-22T05:16:14.117259+0000","last_peered":"2024-01-22T05:16:14.117259+0000","last_clean":"2024-01-22T05:16:14.117259+0000","last_became_active":"2024-01-22T05:16:14.114909+0000","last_became_peered":"2024-01-22T05:16:14.114909+0000","last_unstale":"2024-01-22T05:16:14.117259+0000","last_undegraded":"2024-01-22T05:16:14.117259+0000","last_fullsized":"2024-01-22T05:16:14.117259+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.088372+0000","last_change":"2024-01-22T05:16:13.674905+0000","last_active":"2024-01-22T05:16:14.088372+0000","last_peered":"2024-01-22T05:16:14.088372+0000","last_clean":"2024-01-22T05:16:14.088372+0000","last_became_active":"2024-01-22T05:16:13.674632+0000","last_became_peered":"2024-01-22T05:16:13.674632+0000","last_unstale":"2024-01-22T05:16:14.088372+0000","last_undegraded":"2024-01-22T05:16:14.088372+0000","last_fullsized":"2024-01-22T05:16:14.088372+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.105650+0000","last_change":"2024-01-22T05:16:14.100257+0000","last_active":"2024-01-22T05:16:14.105650+0000","last_peered":"2024-01-22T05:16:14.105650+0000","last_clean":"2024-01-22T05:16:14.105650+0000","last_became_active":"2024-01-22T05:16:14.099688+0000","last_became_peered":"2024-01-22T05:16:14.099688+0000","last_unstale":"2024-01-22T05:16:14.105650+0000","last_undegraded":"2024-01-22T05:16:14.105650+0000","last_fullsized":"2024-01-22T05:16:14.105650+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.113204+0000","last_change":"2024-01-22T05:16:13.659980+0000","last_active":"2024-01-22T05:16:14.113204+0000","last_peered":"2024-01-22T05:16:14.113204+0000","last_clean":"2024-01-22T05:16:14.113204+0000","last_became_active":"2024-01-22T05:16:13.659696+0000","last_became_peered":"2024-01-22T05:16:13.659696+0000","last_unstale":"2024-01-22T05:16:14.113204+0000","last_undegraded":"2024-01-22T05:16:14.113204+0000","last_fullsized":"2024-01-22T05:16:14.113204+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110264+0000","last_change":"2024-01-22T05:16:14.106877+0000","last_active":"2024-01-22T05:16:14.110264+0000","last_peered":"2024-01-22T05:16:14.110264+0000","last_clean":"2024-01-22T05:16:14.110264+0000","last_became_active":"2024-01-22T05:16:14.106570+0000","last_became_peered":"2024-01-22T05:16:14.106570+0000","last_unstale":"2024-01-22T05:16:14.110264+0000","last_undegraded":"2024-01-22T05:16:14.110264+0000","last_fullsized":"2024-01-22T05:16:14.110264+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.084192+0000","last_change":"2024-01-22T05:16:13.662118+0000","last_active":"2024-01-22T05:16:14.084192+0000","last_peered":"2024-01-22T05:16:14.084192+0000","last_clean":"2024-01-22T05:16:14.084192+0000","last_became_active":"2024-01-22T05:16:13.660586+0000","last_became_peered":"2024-01-22T05:16:13.660586+0000","last_unstale":"2024-01-22T05:16:14.084192+0000","last_undegraded":"2024-01-22T05:16:14.084192+0000","last_fullsized":"2024-01-22T05:16:14.084192+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.094159+0000","last_change":"2024-01-22T05:16:14.088728+0000","last_active":"2024-01-22T05:16:14.094159+0000","last_peered":"2024-01-22T05:16:14.094159+0000","last_clean":"2024-01-22T05:16:14.094159+0000","last_became_active":"2024-01-22T05:16:14.088403+0000","last_became_peered":"2024-01-22T05:16:14.088403+0000","last_unstale":"2024-01-22T05:16:14.094159+0000","last_undegraded":"2024-01-22T05:16:14.094159+0000","last_fullsized":"2024-01-22T05:16:14.094159+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083939+0000","last_change":"2024-01-22T05:16:13.668052+0000","last_active":"2024-01-22T05:16:14.083939+0000","last_peered":"2024-01-22T05:16:14.083939+0000","last_clean":"2024-01-22T05:16:14.083939+0000","last_became_active":"2024-01-22T05:16:13.667759+0000","last_became_peered":"2024-01-22T05:16:13.667759+0000","last_unstale":"2024-01-22T05:16:14.083939+0000","last_undegraded":"2024-01-22T05:16:14.083939+0000","last_fullsized":"2024-01-22T05:16:14.083939+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.117162+0000","last_change":"2024-01-22T05:16:14.109980+0000","last_active":"2024-01-22T05:16:14.117162+0000","last_peered":"2024-01-22T05:16:14.117162+0000","last_clean":"2024-01-22T05:16:14.117162+0000","last_became_active":"2024-01-22T05:16:14.109409+0000","last_became_peered":"2024-01-22T05:16:14.109409+0000","last_unstale":"2024-01-22T05:16:14.117162+0000","last_undegraded":"2024-01-22T05:16:14.117162+0000","last_fullsized":"2024-01-22T05:16:14.117162+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.099617+0000","last_change":"2024-01-22T05:16:13.666189+0000","last_active":"2024-01-22T05:16:14.099617+0000","last_peered":"2024-01-22T05:16:14.099617+0000","last_clean":"2024-01-22T05:16:14.099617+0000","last_became_active":"2024-01-22T05:16:13.665877+0000","last_became_peered":"2024-01-22T05:16:13.665877+0000","last_unstale":"2024-01-22T05:16:14.099617+0000","last_undegraded":"2024-01-22T05:16:14.099617+0000","last_fullsized":"2024-01-22T05:16:14.099617+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.103915+0000","last_change":"2024-01-22T05:16:14.096358+0000","last_active":"2024-01-22T05:16:14.103915+0000","last_peered":"2024-01-22T05:16:14.103915+0000","last_clean":"2024-01-22T05:16:14.103915+0000","last_became_active":"2024-01-22T05:16:14.096054+0000","last_became_peered":"2024-01-22T05:16:14.096054+0000","last_unstale":"2024-01-22T05:16:14.103915+0000","last_undegraded":"2024-01-22T05:16:14.103915+0000","last_fullsized":"2024-01-22T05:16:14.103915+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"144'2","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.108582+0000","last_change":"2024-01-22T05:16:13.668266+0000","last_active":"2024-01-22T05:16:14.108582+0000","last_peered":"2024-01-22T05:16:14.108582+0000","last_clean":"2024-01-22T05:16:14.108582+0000","last_became_active":"2024-01-22T05:16:13.667848+0000","last_became_peered":"2024-01-22T05:16:13.667848+0000","last_unstale":"2024-01-22T05:16:14.108582+0000","last_undegraded":"2024-01-22T05:16:14.108582+0000","last_fullsized":"2024-01-22T05:16:14.108582+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.109615+0000","last_change":"2024-01-22T05:16:14.103271+0000","last_active":"2024-01-22T05:16:14.109615+0000","last_peered":"2024-01-22T05:16:14.109615+0000","last_clean":"2024-01-22T05:16:14.109615+0000","last_became_active":"2024-01-22T05:16:14.102223+0000","last_became_peered":"2024-01-22T05:16:14.102223+0000","last_unstale":"2024-01-22T05:16:14.109615+0000","last_undegraded":"2024-01-22T05:16:14.109615+0000","last_fullsized":"2024-01-22T05:16:14.109615+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083997+0000","last_change":"2024-01-22T05:16:13.659921+0000","last_active":"2024-01-22T05:16:14.083997+0000","last_peered":"2024-01-22T05:16:14.083997+0000","last_clean":"2024-01-22T05:16:14.083997+0000","last_became_active":"2024-01-22T05:16:13.658955+0000","last_became_peered":"2024-01-22T05:16:13.658955+0000","last_unstale":"2024-01-22T05:16:14.083997+0000","last_undegraded":"2024-01-22T05:16:14.083997+0000","last_fullsized":"2024-01-22T05:16:14.083997+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.102079+0000","last_change":"2024-01-22T05:16:14.097124+0000","last_active":"2024-01-22T05:16:14.102079+0000","last_peered":"2024-01-22T05:16:14.102079+0000","last_clean":"2024-01-22T05:16:14.102079+0000","last_became_active":"2024-01-22T05:16:14.096810+0000","last_became_peered":"2024-01-22T05:16:14.096810+0000","last_unstale":"2024-01-22T05:16:14.102079+0000","last_undegraded":"2024-01-22T05:16:14.102079+0000","last_fullsized":"2024-01-22T05:16:14.102079+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083414+0000","last_change":"2024-01-22T05:16:13.664054+0000","last_active":"2024-01-22T05:16:14.083414+0000","last_peered":"2024-01-22T05:16:14.083414+0000","last_clean":"2024-01-22T05:16:14.083414+0000","last_became_active":"2024-01-22T05:16:13.663768+0000","last_became_peered":"2024-01-22T05:16:13.663768+0000","last_unstale":"2024-01-22T05:16:14.083414+0000","last_undegraded":"2024-01-22T05:16:14.083414+0000","last_fullsized":"2024-01-22T05:16:14.083414+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110974+0000","last_change":"2024-01-22T05:16:14.101162+0000","last_active":"2024-01-22T05:16:14.110974+0000","last_peered":"2024-01-22T05:16:14.110974+0000","last_clean":"2024-01-22T05:16:14.110974+0000","last_became_active":"2024-01-22T05:16:14.100860+0000","last_became_peered":"2024-01-22T05:16:14.100860+0000","last_unstale":"2024-01-22T05:16:14.110974+0000","last_undegraded":"2024-01-22T05:16:14.110974+0000","last_fullsized":"2024-01-22T05:16:14.110974+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.082915+0000","last_change":"2024-01-22T05:16:13.668762+0000","last_active":"2024-01-22T05:16:14.082915+0000","last_peered":"2024-01-22T05:16:14.082915+0000","last_clean":"2024-01-22T05:16:14.082915+0000","last_became_active":"2024-01-22T05:16:13.668467+0000","last_became_peered":"2024-01-22T05:16:13.668467+0000","last_unstale":"2024-01-22T05:16:14.082915+0000","last_undegraded":"2024-01-22T05:16:14.082915+0000","last_fullsized":"2024-01-22T05:16:14.082915+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.107322+0000","last_change":"2024-01-22T05:16:14.103483+0000","last_active":"2024-01-22T05:16:14.107322+0000","last_peered":"2024-01-22T05:16:14.107322+0000","last_clean":"2024-01-22T05:16:14.107322+0000","last_became_active":"2024-01-22T05:16:14.103189+0000","last_became_peered":"2024-01-22T05:16:14.103189+0000","last_unstale":"2024-01-22T05:16:14.107322+0000","last_undegraded":"2024-01-22T05:16:14.107322+0000","last_fullsized":"2024-01-22T05:16:14.107322+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.099831+0000","last_change":"2024-01-22T05:16:13.648724+0000","last_active":"2024-01-22T05:16:14.099831+0000","last_peered":"2024-01-22T05:16:14.099831+0000","last_clean":"2024-01-22T05:16:14.099831+0000","last_became_active":"2024-01-22T05:16:13.647036+0000","last_became_peered":"2024-01-22T05:16:13.647036+0000","last_unstale":"2024-01-22T05:16:14.099831+0000","last_undegraded":"2024-01-22T05:16:14.099831+0000","last_fullsized":"2024-01-22T05:16:14.099831+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.111205+0000","last_change":"2024-01-22T05:16:14.106255+0000","last_active":"2024-01-22T05:16:14.111205+0000","last_peered":"2024-01-22T05:16:14.111205+0000","last_clean":"2024-01-22T05:16:14.111205+0000","last_became_active":"2024-01-22T05:16:14.104866+0000","last_became_peered":"2024-01-22T05:16:14.104866+0000","last_unstale":"2024-01-22T05:16:14.111205+0000","last_undegraded":"2024-01-22T05:16:14.111205+0000","last_fullsized":"2024-01-22T05:16:14.111205+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083735+0000","last_change":"2024-01-22T05:16:13.664682+0000","last_active":"2024-01-22T05:16:14.083735+0000","last_peered":"2024-01-22T05:16:14.083735+0000","last_clean":"2024-01-22T05:16:14.083735+0000","last_became_active":"2024-01-22T05:16:13.662595+0000","last_became_peered":"2024-01-22T05:16:13.662595+0000","last_unstale":"2024-01-22T05:16:14.083735+0000","last_undegraded":"2024-01-22T05:16:14.083735+0000","last_fullsized":"2024-01-22T05:16:14.083735+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.107176+0000","last_change":"2024-01-22T05:16:14.099474+0000","last_active":"2024-01-22T05:16:14.107176+0000","last_peered":"2024-01-22T05:16:14.107176+0000","last_clean":"2024-01-22T05:16:14.107176+0000","last_became_active":"2024-01-22T05:16:14.099041+0000","last_became_peered":"2024-01-22T05:16:14.099041+0000","last_unstale":"2024-01-22T05:16:14.107176+0000","last_undegraded":"2024-01-22T05:16:14.107176+0000","last_fullsized":"2024-01-22T05:16:14.107176+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.095083+0000","last_change":"2024-01-22T05:16:13.649506+0000","last_active":"2024-01-22T05:16:14.095083+0000","last_peered":"2024-01-22T05:16:14.095083+0000","last_clean":"2024-01-22T05:16:14.095083+0000","last_became_active":"2024-01-22T05:16:13.649249+0000","last_became_peered":"2024-01-22T05:16:13.649249+0000","last_unstale":"2024-01-22T05:16:14.095083+0000","last_undegraded":"2024-01-22T05:16:14.095083+0000","last_fullsized":"2024-01-22T05:16:14.095083+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.111174+0000","last_change":"2024-01-22T05:16:14.106720+0000","last_active":"2024-01-22T05:16:14.111174+0000","last_peered":"2024-01-22T05:16:14.111174+0000","last_clean":"2024-01-22T05:16:14.111174+0000","last_became_active":"2024-01-22T05:16:14.105481+0000","last_became_peered":"2024-01-22T05:16:14.105481+0000","last_unstale":"2024-01-22T05:16:14.111174+0000","last_undegraded":"2024-01-22T05:16:14.111174+0000","last_fullsized":"2024-01-22T05:16:14.111174+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.087388+0000","last_change":"2024-01-22T05:16:13.665915+0000","last_active":"2024-01-22T05:16:14.087388+0000","last_peered":"2024-01-22T05:16:14.087388+0000","last_clean":"2024-01-22T05:16:14.087388+0000","last_became_active":"2024-01-22T05:16:13.663498+0000","last_became_peered":"2024-01-22T05:16:13.663498+0000","last_unstale":"2024-01-22T05:16:14.087388+0000","last_undegraded":"2024-01-22T05:16:14.087388+0000","last_fullsized":"2024-01-22T05:16:14.087388+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.103417+0000","last_change":"2024-01-22T05:16:14.096348+0000","last_active":"2024-01-22T05:16:14.103417+0000","last_peered":"2024-01-22T05:16:14.103417+0000","last_clean":"2024-01-22T05:16:14.103417+0000","last_became_active":"2024-01-22T05:16:14.095999+0000","last_became_peered":"2024-01-22T05:16:14.095999+0000","last_unstale":"2024-01-22T05:16:14.103417+0000","last_undegraded":"2024-01-22T05:16:14.103417+0000","last_fullsized":"2024-01-22T05:16:14.103417+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.079038+0000","last_change":"2024-01-22T05:16:13.655070+0000","last_active":"2024-01-22T05:16:14.079038+0000","last_peered":"2024-01-22T05:16:14.079038+0000","last_clean":"2024-01-22T05:16:14.079038+0000","last_became_active":"2024-01-22T05:16:13.654768+0000","last_became_peered":"2024-01-22T05:16:13.654768+0000","last_unstale":"2024-01-22T05:16:14.079038+0000","last_undegraded":"2024-01-22T05:16:14.079038+0000","last_fullsized":"2024-01-22T05:16:14.079038+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":117,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.095620+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:16:14.095620+0000","last_peered":"2024-01-22T05:16:14.095620+0000","last_clean":"2024-01-22T05:16:14.095620+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:16:14.095620+0000","last_undegraded":"2024-01-22T05:16:14.095620+0000","last_fullsized":"2024-01-22T05:16:14.095620+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.109704+0000","last_change":"2024-01-22T05:16:14.104610+0000","last_active":"2024-01-22T05:16:14.109704+0000","last_peered":"2024-01-22T05:16:14.109704+0000","last_clean":"2024-01-22T05:16:14.109704+0000","last_became_active":"2024-01-22T05:16:14.104303+0000","last_became_peered":"2024-01-22T05:16:14.104303+0000","last_unstale":"2024-01-22T05:16:14.109704+0000","last_undegraded":"2024-01-22T05:16:14.109704+0000","last_fullsized":"2024-01-22T05:16:14.109704+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"144'4","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.114695+0000","last_change":"2024-01-22T05:16:13.665309+0000","last_active":"2024-01-22T05:16:14.114695+0000","last_peered":"2024-01-22T05:16:14.114695+0000","last_clean":"2024-01-22T05:16:14.114695+0000","last_became_active":"2024-01-22T05:16:13.665029+0000","last_became_peered":"2024-01-22T05:16:13.665029+0000","last_unstale":"2024-01-22T05:16:14.114695+0000","last_undegraded":"2024-01-22T05:16:14.114695+0000","last_fullsized":"2024-01-22T05:16:14.114695+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.084083+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:16:14.084083+0000","last_peered":"2024-01-22T05:16:14.084083+0000","last_clean":"2024-01-22T05:16:14.084083+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:16:14.084083+0000","last_undegraded":"2024-01-22T05:16:14.084083+0000","last_fullsized":"2024-01-22T05:16:14.084083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.109831+0000","last_change":"2024-01-22T05:16:14.103184+0000","last_active":"2024-01-22T05:16:14.109831+0000","last_peered":"2024-01-22T05:16:14.109831+0000","last_clean":"2024-01-22T05:16:14.109831+0000","last_became_active":"2024-01-22T05:16:14.102869+0000","last_became_peered":"2024-01-22T05:16:14.102869+0000","last_unstale":"2024-01-22T05:16:14.109831+0000","last_undegraded":"2024-01-22T05:16:14.109831+0000","last_fullsized":"2024-01-22T05:16:14.109831+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.107764+0000","last_change":"2024-01-22T05:16:13.649435+0000","last_active":"2024-01-22T05:16:14.107764+0000","last_peered":"2024-01-22T05:16:14.107764+0000","last_clean":"2024-01-22T05:16:14.107764+0000","last_became_active":"2024-01-22T05:16:13.646857+0000","last_became_peered":"2024-01-22T05:16:13.646857+0000","last_unstale":"2024-01-22T05:16:14.107764+0000","last_undegraded":"2024-01-22T05:16:14.107764+0000","last_fullsized":"2024-01-22T05:16:14.107764+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":113,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.084706+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:16:14.084706+0000","last_peered":"2024-01-22T05:16:14.084706+0000","last_clean":"2024-01-22T05:16:14.084706+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:16:14.084706+0000","last_undegraded":"2024-01-22T05:16:14.084706+0000","last_fullsized":"2024-01-22T05:16:14.084706+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.121520+0000","last_change":"2024-01-22T05:16:14.114004+0000","last_active":"2024-01-22T05:16:14.121520+0000","last_peered":"2024-01-22T05:16:14.121520+0000","last_clean":"2024-01-22T05:16:14.121520+0000","last_became_active":"2024-01-22T05:16:14.113666+0000","last_became_peered":"2024-01-22T05:16:14.113666+0000","last_unstale":"2024-01-22T05:16:14.121520+0000","last_undegraded":"2024-01-22T05:16:14.121520+0000","last_fullsized":"2024-01-22T05:16:14.121520+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.095141+0000","last_change":"2024-01-22T05:16:13.657189+0000","last_active":"2024-01-22T05:16:14.095141+0000","last_peered":"2024-01-22T05:16:14.095141+0000","last_clean":"2024-01-22T05:16:14.095141+0000","last_became_active":"2024-01-22T05:16:13.656590+0000","last_became_peered":"2024-01-22T05:16:13.656590+0000","last_unstale":"2024-01-22T05:16:14.095141+0000","last_undegraded":"2024-01-22T05:16:14.095141+0000","last_fullsized":"2024-01-22T05:16:14.095141+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083036+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:16:14.083036+0000","last_peered":"2024-01-22T05:16:14.083036+0000","last_clean":"2024-01-22T05:16:14.083036+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:16:14.083036+0000","last_undegraded":"2024-01-22T05:16:14.083036+0000","last_fullsized":"2024-01-22T05:16:14.083036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.120880+0000","last_change":"2024-01-22T05:16:14.114599+0000","last_active":"2024-01-22T05:16:14.120880+0000","last_peered":"2024-01-22T05:16:14.120880+0000","last_clean":"2024-01-22T05:16:14.120880+0000","last_became_active":"2024-01-22T05:16:14.114143+0000","last_became_peered":"2024-01-22T05:16:14.114143+0000","last_unstale":"2024-01-22T05:16:14.120880+0000","last_undegraded":"2024-01-22T05:16:14.120880+0000","last_fullsized":"2024-01-22T05:16:14.120880+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"144'2","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.122105+0000","last_change":"2024-01-22T05:16:13.665010+0000","last_active":"2024-01-22T05:16:14.122105+0000","last_peered":"2024-01-22T05:16:14.122105+0000","last_clean":"2024-01-22T05:16:14.122105+0000","last_became_active":"2024-01-22T05:16:13.664730+0000","last_became_peered":"2024-01-22T05:16:13.664730+0000","last_unstale":"2024-01-22T05:16:14.122105+0000","last_undegraded":"2024-01-22T05:16:14.122105+0000","last_fullsized":"2024-01-22T05:16:14.122105+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":137,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.079024+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:16:14.079024+0000","last_peered":"2024-01-22T05:16:14.079024+0000","last_clean":"2024-01-22T05:16:14.079024+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:16:14.079024+0000","last_undegraded":"2024-01-22T05:16:14.079024+0000","last_fullsized":"2024-01-22T05:16:14.079024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110551+0000","last_change":"2024-01-22T05:16:14.105563+0000","last_active":"2024-01-22T05:16:14.110551+0000","last_peered":"2024-01-22T05:16:14.110551+0000","last_clean":"2024-01-22T05:16:14.110551+0000","last_became_active":"2024-01-22T05:16:14.105242+0000","last_became_peered":"2024-01-22T05:16:14.105242+0000","last_unstale":"2024-01-22T05:16:14.110551+0000","last_undegraded":"2024-01-22T05:16:14.110551+0000","last_fullsized":"2024-01-22T05:16:14.110551+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.088679+0000","last_change":"2024-01-22T05:16:13.674304+0000","last_active":"2024-01-22T05:16:14.088679+0000","last_peered":"2024-01-22T05:16:14.088679+0000","last_clean":"2024-01-22T05:16:14.088679+0000","last_became_active":"2024-01-22T05:16:13.672927+0000","last_became_peered":"2024-01-22T05:16:13.672927+0000","last_unstale":"2024-01-22T05:16:14.088679+0000","last_undegraded":"2024-01-22T05:16:14.088679+0000","last_fullsized":"2024-01-22T05:16:14.088679+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":119,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.089895+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:16:14.089895+0000","last_peered":"2024-01-22T05:16:14.089895+0000","last_clean":"2024-01-22T05:16:14.089895+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:16:14.089895+0000","last_undegraded":"2024-01-22T05:16:14.089895+0000","last_fullsized":"2024-01-22T05:16:14.089895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.114888+0000","last_change":"2024-01-22T05:16:14.114093+0000","last_active":"2024-01-22T05:16:14.114888+0000","last_peered":"2024-01-22T05:16:14.114888+0000","last_clean":"2024-01-22T05:16:14.114888+0000","last_became_active":"2024-01-22T05:16:14.113342+0000","last_became_peered":"2024-01-22T05:16:14.113342+0000","last_unstale":"2024-01-22T05:16:14.114888+0000","last_undegraded":"2024-01-22T05:16:14.114888+0000","last_fullsized":"2024-01-22T05:16:14.114888+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.086017+0000","last_change":"2024-01-22T05:16:13.664313+0000","last_active":"2024-01-22T05:16:14.086017+0000","last_peered":"2024-01-22T05:16:14.086017+0000","last_clean":"2024-01-22T05:16:14.086017+0000","last_became_active":"2024-01-22T05:16:13.664034+0000","last_became_peered":"2024-01-22T05:16:13.664034+0000","last_unstale":"2024-01-22T05:16:14.086017+0000","last_undegraded":"2024-01-22T05:16:14.086017+0000","last_fullsized":"2024-01-22T05:16:14.086017+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":113,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083849+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:16:14.083849+0000","last_peered":"2024-01-22T05:16:14.083849+0000","last_clean":"2024-01-22T05:16:14.083849+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:16:14.083849+0000","last_undegraded":"2024-01-22T05:16:14.083849+0000","last_fullsized":"2024-01-22T05:16:14.083849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.119441+0000","last_change":"2024-01-22T05:16:14.111616+0000","last_active":"2024-01-22T05:16:14.119441+0000","last_peered":"2024-01-22T05:16:14.119441+0000","last_clean":"2024-01-22T05:16:14.119441+0000","last_became_active":"2024-01-22T05:16:14.111405+0000","last_became_peered":"2024-01-22T05:16:14.111405+0000","last_unstale":"2024-01-22T05:16:14.119441+0000","last_undegraded":"2024-01-22T05:16:14.119441+0000","last_fullsized":"2024-01-22T05:16:14.119441+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"144'3","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.117608+0000","last_change":"2024-01-22T05:16:13.662799+0000","last_active":"2024-01-22T05:16:14.117608+0000","last_peered":"2024-01-22T05:16:14.117608+0000","last_clean":"2024-01-22T05:16:14.117608+0000","last_became_active":"2024-01-22T05:16:13.662496+0000","last_became_peered":"2024-01-22T05:16:13.662496+0000","last_unstale":"2024-01-22T05:16:14.117608+0000","last_undegraded":"2024-01-22T05:16:14.117608+0000","last_fullsized":"2024-01-22T05:16:14.117608+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":137,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.082502+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:16:14.082502+0000","last_peered":"2024-01-22T05:16:14.082502+0000","last_clean":"2024-01-22T05:16:14.082502+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:16:14.082502+0000","last_undegraded":"2024-01-22T05:16:14.082502+0000","last_fullsized":"2024-01-22T05:16:14.082502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":114,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083937+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:16:14.083937+0000","last_peered":"2024-01-22T05:16:14.083937+0000","last_clean":"2024-01-22T05:16:14.083937+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:16:14.083937+0000","last_undegraded":"2024-01-22T05:16:14.083937+0000","last_fullsized":"2024-01-22T05:16:14.083937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307188,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064652,"statfs":{"total":96636764160,"available":96322203648,"internally_reserved":0,"allocated":1814528,"data_stored":900288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.157,"15min":1.0609999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.46500000000000002},"max":{"1min":1.3340000000000001,"5min":14.779999999999999,"15min":14.779999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":1.9199999999999999,"15min":1.3480000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2989999999999999,"5min":76.662000000000006,"15min":76.662000000000006},"last":0.66600000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0569999999999999,"15min":1.016},"min":{"1min":0.71899999999999997,"5min":0.59199999999999997,"15min":0.54400000000000004},"max":{"1min":1.27,"5min":4.9269999999999996,"15min":4.9269999999999996},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.214,"15min":1.194},"min":{"1min":0.85299999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.383,"5min":12.691000000000001,"15min":12.691000000000001},"last":1.2250000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.093,"15min":1.1080000000000001},"min":{"1min":0.79400000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3200000000000001,"5min":1.984,"15min":2.5150000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.276,"15min":1.2090000000000001},"min":{"1min":0.85499999999999998,"5min":0.73799999999999999,"15min":0.68899999999999995},"max":{"1min":1.349,"5min":15.036,"15min":15.036},"last":1.3149999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.8839999999999999,"15min":1.4510000000000001},"min":{"1min":0.89000000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3839999999999999,"5min":64.983999999999995,"15min":64.983999999999995},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.3500000000000001,"15min":1.2809999999999999},"min":{"1min":0.94299999999999995,"5min":0.78300000000000003,"15min":0.60199999999999998},"max":{"1min":1.5249999999999999,"5min":15.073,"15min":15.073},"last":1.1359999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.282,"15min":1.149},"min":{"1min":0.76000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.494,"5min":22.239000000000001,"15min":22.239000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.4039999999999999,"15min":1.2470000000000001},"min":{"1min":0.77100000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.5269999999999999,"5min":27.872,"15min":27.872},"last":0.86699999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.8799999999999999,"15min":1.431},"min":{"1min":0.86399999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.7549999999999999,"5min":65.652000000000001,"15min":65.652000000000001},"last":1.24},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.232,"15min":1.2529999999999999},"min":{"1min":0.91200000000000003,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.7749999999999999,"5min":2.1629999999999998,"15min":3.625},"last":1.0669999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.234,"15min":1.242},"min":{"1min":0.82399999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.573,"5min":6.9939999999999998,"15min":6.9939999999999998},"last":1.097},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.429,"15min":1.3839999999999999},"min":{"1min":1.02,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.7509999999999999,"5min":12.965,"15min":12.965},"last":1.202}]}]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307196,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064644,"statfs":{"total":96636764160,"available":96322195456,"internally_reserved":0,"allocated":1822720,"data_stored":900364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:15:57 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.012,"15min":1.29},"min":{"1min":0.70799999999999996,"5min":0.52400000000000002,"15min":0.35999999999999999},"max":{"1min":1.5249999999999999,"5min":1.679,"15min":77.745000000000005},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.111,"5min":1.0580000000000001,"15min":1.0800000000000001},"min":{"1min":0.75800000000000001,"5min":0.54700000000000004,"15min":0.44},"max":{"1min":1.468,"5min":5.0359999999999996,"15min":13.555999999999999},"last":1.2310000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:15:57 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.121,"15min":1.1200000000000001},"min":{"1min":0.83699999999999997,"5min":0.503,"15min":0.40000000000000002},"max":{"1min":1.4239999999999999,"5min":5.9210000000000003,"15min":15.499000000000001},"last":1.004},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0920000000000001,"15min":1.171},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.702,"5min":3.6080000000000001,"15min":7.7629999999999999},"last":1.284}]},{"osd":2,"last update":"Mon Jan 22 05:15:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.173,"15min":1.159},"min":{"1min":0.85799999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.667,"5min":2.653,"15min":3.0960000000000001},"last":1.456},{"interface":"front","average":{"1min":1.139,"5min":1.1739999999999999,"15min":1.1359999999999999},"min":{"1min":0.68999999999999995,"5min":0.68600000000000005,"15min":0.38200000000000001},"max":{"1min":1.7390000000000001,"5min":4.9660000000000002,"15min":4.9660000000000002},"last":1.345}]},{"osd":3,"last update":"Mon Jan 22 05:15:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.21,"15min":1.4790000000000001},"min":{"1min":0.80500000000000005,"5min":0.66700000000000004,"15min":0.59299999999999997},"max":{"1min":2.343,"5min":5.0750000000000002,"15min":102.08199999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.2050000000000001,"15min":1.2270000000000001},"min":{"1min":0.84399999999999997,"5min":0.66300000000000003,"15min":0.374},"max":{"1min":1.4610000000000001,"5min":6.0129999999999999,"15min":15.468},"last":0.90900000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:15:57 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.175,"15min":1.1339999999999999},"min":{"1min":0.71699999999999997,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.631,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2370000000000001,"15min":1.157},"min":{"1min":0.79000000000000004,"5min":0.60099999999999998,"15min":0.48299999999999998},"max":{"1min":2.5489999999999999,"5min":5.1200000000000001,"15min":5.1200000000000001},"last":1.4299999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:15:57 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.1679999999999999,"15min":1.2509999999999999},"min":{"1min":0.65000000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.7829999999999999,"5min":5.2930000000000001,"15min":30.533000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.80500000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5700000000000001,"5min":2.6179999999999999,"15min":3.875},"last":1.375}]},{"osd":7,"last update":"Mon Jan 22 05:15:57 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.4379999999999999,"15min":1.4399999999999999},"min":{"1min":0.82899999999999996,"5min":0.72599999999999998,"15min":0.42699999999999999},"max":{"1min":2.7490000000000001,"5min":8.4190000000000005,"15min":23.547999999999998},"last":1.583},{"interface":"front","average":{"1min":1.333,"5min":1.4490000000000001,"15min":1.579},"min":{"1min":0.92000000000000004,"5min":0.60199999999999998,"15min":0.495},"max":{"1min":1.5800000000000001,"5min":7.46,"15min":63.737000000000002},"last":1.486}]}]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307188,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064652,"statfs":{"total":96636764160,"available":96322203648,"internally_reserved":0,"allocated":1814528,"data_stored":900240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:16:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.0249999999999999,"15min":1.01},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.3939999999999999,"5min":1.651,"15min":2.0609999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.04,"15min":1.0609999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.3129999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:16:00 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.1739999999999999,"15min":1.1890000000000001},"min":{"1min":0.745,"5min":0.67300000000000004,"15min":0.50600000000000001},"max":{"1min":1.454,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.488},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.147,"15min":1.2210000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.5549999999999999,"5min":1.9930000000000001,"15min":2.0209999999999999},"last":1.53}]},{"osd":2,"last update":"Mon Jan 22 05:16:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.101,"15min":1.137},"min":{"1min":0.85299999999999998,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.8089999999999999,"5min":1.9219999999999999,"15min":1.925},"last":1.242},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.101,"15min":1.121},"min":{"1min":0.71799999999999997,"5min":0.67100000000000004,"15min":0.59899999999999998},"max":{"1min":1.375,"5min":1.982,"15min":1.982},"last":1.1950000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:16:00 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.1539999999999999,"15min":1.163},"min":{"1min":0.69799999999999995,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":3.202,"5min":3.202,"15min":3.202},"last":1.431},{"interface":"front","average":{"1min":1.153,"5min":1.1899999999999999,"15min":1.234},"min":{"1min":0.72499999999999998,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.3759999999999999,"5min":4.8819999999999997,"15min":4.8819999999999997},"last":1.3500000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:16:00 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.0509999999999999,"15min":1.1200000000000001},"min":{"1min":0.65400000000000003,"5min":0.51700000000000002,"15min":0.44400000000000001},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0960000000000001,"15min":1.206},"min":{"1min":0.68799999999999994,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.448,"5min":2.081,"15min":2.081},"last":1.1279999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:16:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.125,"15min":1.2430000000000001},"min":{"1min":0.68100000000000005,"5min":0.63600000000000001,"15min":0.58199999999999996},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":2.2010000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.204,"15min":1.26},"min":{"1min":0.70699999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"max":{"1min":1.5489999999999999,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.2829999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:16:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2270000000000001,"15min":1.3320000000000001},"min":{"1min":0.78000000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.74,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.248,"15min":1.365},"min":{"1min":0.75600000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.7330000000000001,"5min":2.04,"15min":3.1840000000000002},"last":1.474}]}]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311284,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060556,"statfs":{"total":96636764160,"available":96318009344,"internally_reserved":0,"allocated":1814528,"data_stored":900288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.0469999999999999,"15min":1.101},"min":{"1min":0.63700000000000001,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.347,"5min":1.726,"15min":2.0150000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.135,"15min":1.125},"min":{"1min":0.91300000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.3520000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:15:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.054,"15min":1.073},"min":{"1min":0.77400000000000002,"5min":0.60499999999999998,"15min":0.53100000000000003},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.7609999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1,"15min":1.095},"min":{"1min":0.52500000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4099999999999999,"5min":1.6870000000000001,"15min":2.194},"last":1.161}]},{"osd":2,"last update":"Mon Jan 22 05:15:47 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.038,"15min":1.0740000000000001},"min":{"1min":0.85499999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3089999999999999,"5min":1.7030000000000001,"15min":5.3390000000000004},"last":1.516},{"interface":"front","average":{"1min":1.129,"5min":1.113,"15min":1.1899999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.504,"5min":1.641,"15min":2.3479999999999999},"last":1.1000000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:15:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.117,"15min":1.1459999999999999},"min":{"1min":0.72899999999999998,"5min":0.59299999999999997,"15min":0.496},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.117},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1040000000000001,"15min":1.1459999999999999},"min":{"1min":0.67700000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.825,"5min":2.2959999999999998,"15min":5.3029999999999999},"last":1.611}]},{"osd":5,"last update":"Mon Jan 22 05:15:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0609999999999999,"15min":1.143},"min":{"1min":0.67700000000000005,"5min":0.57799999999999996,"15min":0.54100000000000004},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":2.0790000000000002},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.113,"15min":1.1299999999999999},"min":{"1min":0.71999999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":2.0030000000000001},"last":1.4410000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:15:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.0980000000000001,"15min":1.1499999999999999},"min":{"1min":0.745,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4650000000000001,"5min":1.5960000000000001,"15min":5.3769999999999998},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.1879999999999999,"15min":1.302},"min":{"1min":0.73699999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":4.4409999999999998},"last":1.488}]},{"osd":7,"last update":"Mon Jan 22 05:15:47 2024","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.288,"15min":1.3220000000000001},"min":{"1min":0.79900000000000004,"5min":0.62,"15min":0.59399999999999997},"max":{"1min":1.8999999999999999,"5min":1.9119999999999999,"15min":2.2839999999999998},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.2609999999999999,"15min":1.3300000000000001},"min":{"1min":0.97099999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.649,"5min":1.8100000000000001,"15min":5.2629999999999999},"last":1.718}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311288,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060552,"statfs":{"total":96636764160,"available":96318005248,"internally_reserved":0,"allocated":1818624,"data_stored":901200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:15:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81699999999999995,"15min":0.876},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.34200000000000003},"max":{"1min":1.2549999999999999,"5min":1.8440000000000001,"15min":14.859},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.90100000000000002,"15min":0.89600000000000002},"min":{"1min":0.622,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":1.804,"5min":2.3519999999999999,"15min":5.0919999999999996},"last":0.57899999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:15:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.91800000000000004,"15min":0.88400000000000001},"min":{"1min":0.64100000000000001,"5min":0.42399999999999999,"15min":0.39300000000000002},"max":{"1min":1.1870000000000001,"5min":6.5570000000000004,"15min":6.5570000000000004},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.95099999999999996,"15min":0.97299999999999998},"min":{"1min":0.53900000000000003,"5min":0.499,"15min":0.48399999999999999},"max":{"1min":1.4119999999999999,"5min":1.9510000000000001,"15min":5.7519999999999998},"last":0.83599999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:15:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.129,"15min":1.1299999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.40600000000000003},"max":{"1min":1.8680000000000001,"5min":2.391,"15min":2.391},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.2070000000000001,"15min":1.1879999999999999},"min":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.44800000000000001},"max":{"1min":1.609,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":1.6259999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:15:44 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.409,"15min":1.329},"min":{"1min":0.94999999999999996,"5min":0.82799999999999996,"15min":0.51700000000000002},"max":{"1min":2.423,"5min":10.858000000000001,"15min":10.858000000000001},"last":1.427},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3839999999999999,"15min":1.347},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.63600000000000001},"max":{"1min":2.3359999999999999,"5min":10.846,"15min":10.846},"last":1.4510000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:15:44 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.3029999999999999,"15min":1.2929999999999999},"min":{"1min":0.83399999999999996,"5min":0.76000000000000001,"15min":0.505},"max":{"1min":1.7709999999999999,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.4079999999999999,"15min":1.381},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.6459999999999999,"5min":12.128,"15min":14.523999999999999},"last":1.331}]},{"osd":6,"last update":"Mon Jan 22 05:15:44 2024","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.345,"15min":1.3740000000000001},"min":{"1min":0.84399999999999997,"5min":0.81699999999999995,"15min":0.56699999999999995},"max":{"1min":2.1819999999999999,"5min":2.2610000000000001,"15min":4.9809999999999999},"last":1.51},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3720000000000001,"15min":1.3959999999999999},"min":{"1min":1.04,"5min":0.85699999999999998,"15min":0.68500000000000005},"max":{"1min":1.71,"5min":1.923,"15min":5.4210000000000003},"last":1.5409999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:15:44 2024","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.361,"15min":1.379},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.986,"5min":2.472,"15min":5.7160000000000002},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.425,"15min":1.4199999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.71299999999999997},"max":{"1min":2.5449999999999999,"5min":6.4279999999999999,"15min":6.4279999999999999},"last":1.6000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311296,"kb_used_data":1784,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060544,"statfs":{"total":96636764160,"available":96317997056,"internally_reserved":0,"allocated":1826816,"data_stored":902308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.77100000000000002,"15min":0.75700000000000001},"min":{"1min":0.43099999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.98699999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.52900000000000003,"5min":0.44600000000000001,"15min":0.373},"max":{"1min":1.093,"5min":1.556,"15min":1.7350000000000001},"last":0.90100000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.875,"15min":0.83899999999999997},"min":{"1min":0.46800000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.534},"last":1.091},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.96899999999999997,"15min":0.94199999999999995},"min":{"1min":0.54600000000000004,"5min":0.43099999999999999,"15min":0.41599999999999998},"max":{"1min":1.2290000000000001,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.173}]},{"osd":3,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.131,"15min":1.107},"min":{"1min":0.64100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2170000000000001,"15min":1.194},"min":{"1min":0.64300000000000002,"5min":0.53900000000000003,"15min":0.51100000000000001},"max":{"1min":3.133,"5min":3.133,"15min":3.133},"last":1.3200000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.2529999999999999,"15min":1.274},"min":{"1min":0.97199999999999998,"5min":0.88500000000000001,"15min":0.59099999999999997},"max":{"1min":1.3959999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4299999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.218}]},{"osd":5,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2190000000000001,"15min":1.206},"min":{"1min":0.90900000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8400000000000001,"5min":1.8440000000000001,"15min":2.3660000000000001},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.2969999999999999,"15min":1.2909999999999999},"min":{"1min":0.94799999999999995,"5min":0.76100000000000001,"15min":0.67000000000000004},"max":{"1min":1.4810000000000001,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.464}]},{"osd":6,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.264,"15min":1.2529999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.532,"5min":1.7749999999999999,"15min":2.1920000000000002},"last":1.141},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.2909999999999999,"15min":1.29},"min":{"1min":0.98499999999999999,"5min":0.629,"15min":0.629},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.4449999999999998},"last":1.236}]},{"osd":7,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3600000000000001,"15min":1.3460000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9390000000000001,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4039999999999999,"15min":1.4079999999999999},"min":{"1min":1.05,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.5059999999999998},"last":1.647}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307184,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064656,"statfs":{"total":96636764160,"available":96322207744,"internally_reserved":0,"allocated":1810432,"data_stored":900218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:15:49 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.85399999999999998,"15min":0.86499999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.167,"5min":1.911,"15min":3.4119999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.99199999999999999,"15min":0.997},"min":{"1min":0.61699999999999999,"5min":0.42899999999999999,"15min":0.41099999999999998},"max":{"1min":1.2250000000000001,"5min":1.8680000000000001,"15min":2.101},"last":0.95699999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:15:49 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0109999999999999,"15min":1.0009999999999999},"min":{"1min":0.64600000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.492,"5min":2.169,"15min":2.169},"last":1.153},{"interface":"front","average":{"1min":1.04,"5min":1.0609999999999999,"15min":1.0449999999999999},"min":{"1min":0.63900000000000001,"5min":0.59099999999999997,"15min":0.46899999999999997},"max":{"1min":1.5,"5min":2.024,"15min":2.024},"last":1.0980000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:15:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.028,"15min":1.0229999999999999},"min":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.38900000000000001},"max":{"1min":1.3540000000000001,"5min":1.7130000000000001,"15min":4.665},"last":1.244},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.98499999999999999,"15min":0.93799999999999994},"min":{"1min":0.63300000000000001,"5min":0.45000000000000001,"15min":0.41899999999999998},"max":{"1min":1.391,"5min":4.1319999999999997,"15min":5.5830000000000002},"last":0.78100000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:15:49 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.1859999999999999,"15min":1.2470000000000001},"min":{"1min":0.80200000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5649999999999999,"5min":2.2509999999999999,"15min":15.76},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2569999999999999,"15min":1.319},"min":{"1min":0.97099999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.714,"5min":1.9630000000000001,"15min":16.975000000000001},"last":1.3100000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:15:49 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.2569999999999999,"15min":1.218},"min":{"1min":0.93100000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.7410000000000001,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.2849999999999999,"15min":1.28},"min":{"1min":1.0600000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6319999999999999,"5min":2.3330000000000002,"15min":2.52},"last":1.8420000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:15:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.242,"15min":1.256},"min":{"1min":0.96799999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6399999999999999,"5min":4.359,"15min":4.359},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.343,"15min":1.339},"min":{"1min":0.84099999999999997,"5min":0.71899999999999997,"15min":0.68799999999999994},"max":{"1min":1.6830000000000001,"5min":2.5569999999999999,"15min":2.5569999999999999},"last":1.895}]},{"osd":7,"last update":"Mon Jan 22 05:15:49 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3240000000000001,"15min":1.3560000000000001},"min":{"1min":0.92700000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.8999999999999999,"5min":2.0019999999999998,"15min":4.4329999999999998},"last":1.357},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.341,"15min":1.353},"min":{"1min":1.081,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9259999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.3240000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307200,"kb_used_data":1784,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064640,"statfs":{"total":96636764160,"available":96322191360,"internally_reserved":0,"allocated":1826816,"data_stored":901450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.876,"15min":0.92200000000000004},"min":{"1min":0.53800000000000003,"5min":0.41199999999999998,"15min":0.28699999999999998},"max":{"1min":1.4219999999999999,"5min":1.972,"15min":15.273},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.90700000000000003,"15min":0.93899999999999995},"min":{"1min":0.52500000000000002,"5min":0.502,"15min":0.34499999999999997},"max":{"1min":1.173,"5min":1.698,"15min":4.4009999999999998},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Jan 22 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.0149999999999999,"15min":1.0720000000000001},"min":{"1min":0.53200000000000003,"5min":0.48199999999999998,"15min":0.46400000000000002},"max":{"1min":1.536,"5min":1.6459999999999999,"15min":15.473000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.0269999999999999,"15min":1.018},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.248,"5min":1.794,"15min":1.7989999999999999},"last":1.0760000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.96999999999999997,"15min":0.99399999999999999},"min":{"1min":0.54800000000000004,"5min":0.40000000000000002,"15min":0.39000000000000001},"max":{"1min":1.456,"5min":1.609,"15min":5.3970000000000002},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.153,"15min":1.206},"min":{"1min":0.58199999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.79,"5min":2.2349999999999999,"15min":15.439},"last":1.103}]},{"osd":4,"last update":"Mon Jan 22 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2170000000000001,"15min":1.2829999999999999},"min":{"1min":0.81399999999999995,"5min":0.66200000000000003,"15min":0.61399999999999999},"max":{"1min":1.399,"5min":2.1280000000000001,"15min":5.1799999999999997},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.25,"5min":1.214,"15min":1.224},"min":{"1min":0.72199999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.738,"5min":1.7909999999999999,"15min":3.4340000000000002},"last":1.298}]},{"osd":5,"last update":"Mon Jan 22 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.258,"15min":1.3},"min":{"1min":0.85199999999999998,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":3.548},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3360000000000001,"15min":1.357},"min":{"1min":0.99399999999999999,"5min":0.75900000000000001,"15min":0.59499999999999997},"max":{"1min":1.7210000000000001,"5min":2.2309999999999999,"15min":2.823},"last":1.274}]},{"osd":6,"last update":"Mon Jan 22 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.367,"15min":1.4390000000000001},"min":{"1min":1.113,"5min":0.81399999999999995,"15min":0.59099999999999997},"max":{"1min":1.7909999999999999,"5min":2.0950000000000002,"15min":15.4},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.333,"15min":1.417},"min":{"1min":0.85699999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.714,"5min":2.105,"15min":7.1349999999999998},"last":1.1859999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3899999999999999,"15min":1.4870000000000001},"min":{"1min":0.95499999999999996,"5min":0.91400000000000003,"15min":0.79900000000000004},"max":{"1min":1.6659999999999999,"5min":2.1819999999999999,"15min":5.29},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.367,"15min":1.3839999999999999},"min":{"1min":1.002,"5min":0.81799999999999995,"15min":0.752},"max":{"1min":1.8360000000000001,"5min":2.1869999999999998,"15min":2.7269999999999999},"last":1.04}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:16:18.631 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:16:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.837+0000 7f6f8a200700 1 Processor -- start 2024-01-22T05:16:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.837+0000 7f6f8a200700 1 -- start start 2024-01-22T05:16:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.841+0000 7f6f8a200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6f84065240 0x7f6f840644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.841+0000 7f6f8a200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84065620 0x7f6f840649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.841+0000 7f6f8a200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f840c2700 con 0x7f6f8415b9b0 2024-01-22T05:16:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.841+0000 7f6f8a200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f84064ed0 con 0x7f6f84065240 2024-01-22T05:16:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.841+0000 7f6f8a200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840c29a0 con 0x7f6f84065620 2024-01-22T05:16:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.841+0000 7f6f82a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84065620 0x7f6f840649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.841+0000 7f6f83400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6f84065240 0x7f6f840644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.841+0000 7f6f88c00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6f8415b9b0 0x7f6f8415be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:57916/0 (socket says 172.21.15.49:57916) 2024-01-22T05:16:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.841+0000 7f6f88c00700 1 -- 172.21.15.49:0/378545277 learned_addr learned my addr 172.21.15.49:0/378545277 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f82a00700 1 -- 172.21.15.49:0/378545277 >> v2:172.21.15.110:3300/0 conn(0x7f6f84065240 msgr2=0x7f6f840644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f82000700 1 -- 172.21.15.49:0/378545277 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130881427 0 0) 0x7f6f840c2700 con 0x7f6f8415b9b0 2024-01-22T05:16:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f82a00700 1 --2- 172.21.15.49:0/378545277 >> v2:172.21.15.110:3300/0 conn(0x7f6f84065240 0x7f6f840644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f82a00700 1 -- 172.21.15.49:0/378545277 >> v1:172.21.15.110:6789/0 conn(0x7f6f8415b9b0 legacy=0x7f6f8415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f82a00700 1 -- 172.21.15.49:0/378545277 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f840c2c80 con 0x7f6f84065620 2024-01-22T05:16:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f83400700 1 --2- 172.21.15.49:0/378545277 >> v2:172.21.15.110:3300/0 conn(0x7f6f84065240 0x7f6f840644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f82a00700 1 --2- 172.21.15.49:0/378545277 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84065620 0x7f6f840649e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f6f6c009760 tx=0x7f6f6c009060).ready entity=mon.2 client_cookie=c7d588a108a73f02 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f82000700 1 -- 172.21.15.49:0/378545277 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00f510 con 0x7f6f84065620 2024-01-22T05:16:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f82000700 1 -- 172.21.15.49:0/378545277 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c00f670 con 0x7f6f84065620 2024-01-22T05:16:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f82000700 1 -- 172.21.15.49:0/378545277 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00f9f0 con 0x7f6f84065620 2024-01-22T05:16:18.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f8a200700 1 -- 172.21.15.49:0/378545277 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84065620 msgr2=0x7f6f840649e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f8a200700 1 --2- 172.21.15.49:0/378545277 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84065620 0x7f6f840649e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f6f6c009760 tx=0x7f6f6c009060).stop 2024-01-22T05:16:18.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f8a200700 1 -- 172.21.15.49:0/378545277 shutdown_connections 2024-01-22T05:16:18.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f8a200700 1 --2- 172.21.15.49:0/378545277 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84065620 0x7f6f840649e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f8a200700 1 --2- 172.21.15.49:0/378545277 >> v2:172.21.15.110:3300/0 conn(0x7f6f84065240 0x7f6f840644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f8a200700 1 -- 172.21.15.49:0/378545277 >> 172.21.15.49:0/378545277 conn(0x7f6f840c87f0 msgr2=0x7f6f840c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:18.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f8a200700 1 -- 172.21.15.49:0/378545277 shutdown_connections 2024-01-22T05:16:18.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.845+0000 7f6f8a200700 1 -- 172.21.15.49:0/378545277 wait complete. 2024-01-22T05:16:18.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.849+0000 7f6f8a200700 1 Processor -- start 2024-01-22T05:16:18.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.849+0000 7f6f8a200700 1 -- start start 2024-01-22T05:16:18.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.849+0000 7f6f8a200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f84065240 0x7f6f840a8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.849+0000 7f6f8a200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84065620 0x7f6f840a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.849+0000 7f6f8a200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f8415b9b0 0x7f6f841547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.849+0000 7f6f8a200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840a9670 con 0x7f6f8415b9b0 2024-01-22T05:16:18.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.849+0000 7f6f8a200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84158a60 con 0x7f6f84065240 2024-01-22T05:16:18.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.849+0000 7f6f8a200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84158d40 con 0x7f6f84065620 2024-01-22T05:16:18.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f88c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f8415b9b0 0x7f6f841547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f83400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f84065240 0x7f6f840a8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f88c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f8415b9b0 0x7f6f841547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34226/0 (socket says 172.21.15.49:34226) 2024-01-22T05:16:18.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f88c00700 1 -- 172.21.15.49:0/413487672 learned_addr learned my addr 172.21.15.49:0/413487672 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:18.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f82a00700 1 --2- 172.21.15.49:0/413487672 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84065620 0x7f6f840a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f88c00700 1 -- 172.21.15.49:0/413487672 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84065620 msgr2=0x7f6f840a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f88c00700 1 --2- 172.21.15.49:0/413487672 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84065620 0x7f6f840a9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f88c00700 1 -- 172.21.15.49:0/413487672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f84065240 msgr2=0x7f6f840a8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:18.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f88c00700 1 --2- 172.21.15.49:0/413487672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f84065240 0x7f6f840a8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:18.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f88c00700 1 -- 172.21.15.49:0/413487672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f740092a0 con 0x7f6f8415b9b0 2024-01-22T05:16:18.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f83400700 1 --2- 172.21.15.49:0/413487672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f84065240 0x7f6f840a8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:18.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f88c00700 1 --2- 172.21.15.49:0/413487672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f8415b9b0 0x7f6f841547a0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f6f7c00c7e0 tx=0x7f6f7c007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:18.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f7aa00700 1 -- 172.21.15.49:0/413487672 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c005d30 con 0x7f6f8415b9b0 2024-01-22T05:16:18.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f7aa00700 1 -- 172.21.15.49:0/413487672 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c005e90 con 0x7f6f8415b9b0 2024-01-22T05:16:18.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f7aa00700 1 -- 172.21.15.49:0/413487672 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c007320 con 0x7f6f8415b9b0 2024-01-22T05:16:18.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f8a200700 1 -- 172.21.15.49:0/413487672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6c0092a0 con 0x7f6f8415b9b0 2024-01-22T05:16:18.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f8a200700 1 -- 172.21.15.49:0/413487672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f840a9900 con 0x7f6f8415b9b0 2024-01-22T05:16:18.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.853+0000 7f6f8a200700 1 -- 172.21.15.49:0/413487672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f840a9af0 con 0x7f6f8415b9b0 2024-01-22T05:16:18.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.857+0000 7f6f7aa00700 1 -- 172.21.15.49:0/413487672 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6f7c007710 con 0x7f6f8415b9b0 2024-01-22T05:16:18.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.857+0000 7f6f7aa00700 1 --2- 172.21.15.49:0/413487672 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f5c05a540 0x7f6f5c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:18.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.857+0000 7f6f7aa00700 1 -- 172.21.15.49:0/413487672 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f6f7c074820 con 0x7f6f8415b9b0 2024-01-22T05:16:18.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.857+0000 7f6f83400700 1 --2- 172.21.15.49:0/413487672 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f5c05a540 0x7f6f5c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:18.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.857+0000 7f6f83400700 1 --2- 172.21.15.49:0/413487672 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f5c05a540 0x7f6f5c05ca00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f6f740113e0 tx=0x7f6f74009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:18.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:18.865+0000 7f6f7aa00700 1 -- 172.21.15.49:0/413487672 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6f7c047ea0 con 0x7f6f8415b9b0 2024-01-22T05:16:19.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.025+0000 7f6f8a200700 1 -- 172.21.15.49:0/413487672 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f84047060 con 0x7f6f5c05a540 2024-01-22T05:16:19.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.041+0000 7f6f7aa00700 1 -- 172.21.15.49:0/413487672 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359762 (secure 0 0 0) 0x7f6f84047060 con 0x7f6f5c05a540 2024-01-22T05:16:19.045 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:19.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.053+0000 7f6f8a200700 1 -- 172.21.15.49:0/413487672 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f5c05a540 msgr2=0x7f6f5c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.053+0000 7f6f8a200700 1 --2- 172.21.15.49:0/413487672 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f5c05a540 0x7f6f5c05ca00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f6f740113e0 tx=0x7f6f74009060).stop 2024-01-22T05:16:19.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.053+0000 7f6f8a200700 1 -- 172.21.15.49:0/413487672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f8415b9b0 msgr2=0x7f6f841547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.053+0000 7f6f8a200700 1 --2- 172.21.15.49:0/413487672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f8415b9b0 0x7f6f841547a0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f6f7c00c7e0 tx=0x7f6f7c007f90).stop 2024-01-22T05:16:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.053+0000 7f6f8a200700 1 -- 172.21.15.49:0/413487672 shutdown_connections 2024-01-22T05:16:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.053+0000 7f6f8a200700 1 --2- 172.21.15.49:0/413487672 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f5c05a540 0x7f6f5c05ca00 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.053+0000 7f6f8a200700 1 --2- 172.21.15.49:0/413487672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f8415b9b0 0x7f6f841547a0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.053+0000 7f6f8a200700 1 --2- 172.21.15.49:0/413487672 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84065620 0x7f6f840a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.053+0000 7f6f8a200700 1 --2- 172.21.15.49:0/413487672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f84065240 0x7f6f840a8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.053+0000 7f6f8a200700 1 -- 172.21.15.49:0/413487672 >> 172.21.15.49:0/413487672 conn(0x7f6f840c87f0 msgr2=0x7f6f84063b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.053+0000 7f6f8a200700 1 -- 172.21.15.49:0/413487672 shutdown_connections 2024-01-22T05:16:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.053+0000 7f6f8a200700 1 -- 172.21.15.49:0/413487672 wait complete. 2024-01-22T05:16:19.056 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:16:19.075 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":493,"stamp":"2024-01-22T05:16:17.492560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":238,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2469824,"kb_used_data":14208,"kb_used_omap":0,"kb_used_meta":2455552,"kb_avail":752504896,"statfs":{"total":773094113280,"available":770565013504,"internally_reserved":0,"allocated":14548992,"data_stored":7206356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2514485248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077823722,"num_objects":-1078,"num_object_clones":0,"num_object_copies":-2156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1078,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-3201,"num_write_kb":-1053286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-16,"num_bytes_recovered":-16777216,"num_keys_recovered":0,"num_objects_omap":-46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.097208"},"pg_stats":[{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.121524+0000","last_change":"2024-01-22T05:16:14.114071+0000","last_active":"2024-01-22T05:16:14.121524+0000","last_peered":"2024-01-22T05:16:14.121524+0000","last_clean":"2024-01-22T05:16:14.121524+0000","last_became_active":"2024-01-22T05:16:14.113738+0000","last_became_peered":"2024-01-22T05:16:14.113738+0000","last_unstale":"2024-01-22T05:16:14.121524+0000","last_undegraded":"2024-01-22T05:16:14.121524+0000","last_fullsized":"2024-01-22T05:16:14.121524+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3f","version":"144'3","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.114427+0000","last_change":"2024-01-22T05:16:13.664134+0000","last_active":"2024-01-22T05:16:14.114427+0000","last_peered":"2024-01-22T05:16:14.114427+0000","last_clean":"2024-01-22T05:16:14.114427+0000","last_became_active":"2024-01-22T05:16:13.659618+0000","last_became_peered":"2024-01-22T05:16:13.659618+0000","last_unstale":"2024-01-22T05:16:14.114427+0000","last_undegraded":"2024-01-22T05:16:14.114427+0000","last_fullsized":"2024-01-22T05:16:14.114427+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110801+0000","last_change":"2024-01-22T05:16:14.101928+0000","last_active":"2024-01-22T05:16:14.110801+0000","last_peered":"2024-01-22T05:16:14.110801+0000","last_clean":"2024-01-22T05:16:14.110801+0000","last_became_active":"2024-01-22T05:16:14.101662+0000","last_became_peered":"2024-01-22T05:16:14.101662+0000","last_unstale":"2024-01-22T05:16:14.110801+0000","last_undegraded":"2024-01-22T05:16:14.110801+0000","last_fullsized":"2024-01-22T05:16:14.110801+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.079695+0000","last_change":"2024-01-22T05:16:13.645349+0000","last_active":"2024-01-22T05:16:14.079695+0000","last_peered":"2024-01-22T05:16:14.079695+0000","last_clean":"2024-01-22T05:16:14.079695+0000","last_became_active":"2024-01-22T05:16:13.644648+0000","last_became_peered":"2024-01-22T05:16:13.644648+0000","last_unstale":"2024-01-22T05:16:14.079695+0000","last_undegraded":"2024-01-22T05:16:14.079695+0000","last_fullsized":"2024-01-22T05:16:14.079695+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110747+0000","last_change":"2024-01-22T05:16:14.105444+0000","last_active":"2024-01-22T05:16:14.110747+0000","last_peered":"2024-01-22T05:16:14.110747+0000","last_clean":"2024-01-22T05:16:14.110747+0000","last_became_active":"2024-01-22T05:16:14.105144+0000","last_became_peered":"2024-01-22T05:16:14.105144+0000","last_unstale":"2024-01-22T05:16:14.110747+0000","last_undegraded":"2024-01-22T05:16:14.110747+0000","last_fullsized":"2024-01-22T05:16:14.110747+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.095267+0000","last_change":"2024-01-22T05:16:13.665078+0000","last_active":"2024-01-22T05:16:14.095267+0000","last_peered":"2024-01-22T05:16:14.095267+0000","last_clean":"2024-01-22T05:16:14.095267+0000","last_became_active":"2024-01-22T05:16:13.664734+0000","last_became_peered":"2024-01-22T05:16:13.664734+0000","last_unstale":"2024-01-22T05:16:14.095267+0000","last_undegraded":"2024-01-22T05:16:14.095267+0000","last_fullsized":"2024-01-22T05:16:14.095267+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112078+0000","last_change":"2024-01-22T05:16:14.110410+0000","last_active":"2024-01-22T05:16:14.112078+0000","last_peered":"2024-01-22T05:16:14.112078+0000","last_clean":"2024-01-22T05:16:14.112078+0000","last_became_active":"2024-01-22T05:16:14.109190+0000","last_became_peered":"2024-01-22T05:16:14.109190+0000","last_unstale":"2024-01-22T05:16:14.112078+0000","last_undegraded":"2024-01-22T05:16:14.112078+0000","last_fullsized":"2024-01-22T05:16:14.112078+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"144'2","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.113725+0000","last_change":"2024-01-22T05:16:13.644874+0000","last_active":"2024-01-22T05:16:14.113725+0000","last_peered":"2024-01-22T05:16:14.113725+0000","last_clean":"2024-01-22T05:16:14.113725+0000","last_became_active":"2024-01-22T05:16:13.644554+0000","last_became_peered":"2024-01-22T05:16:13.644554+0000","last_unstale":"2024-01-22T05:16:14.113725+0000","last_undegraded":"2024-01-22T05:16:14.113725+0000","last_fullsized":"2024-01-22T05:16:14.113725+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.116274+0000","last_change":"2024-01-22T05:16:14.113810+0000","last_active":"2024-01-22T05:16:14.116274+0000","last_peered":"2024-01-22T05:16:14.116274+0000","last_clean":"2024-01-22T05:16:14.116274+0000","last_became_active":"2024-01-22T05:16:14.113376+0000","last_became_peered":"2024-01-22T05:16:14.113376+0000","last_unstale":"2024-01-22T05:16:14.116274+0000","last_undegraded":"2024-01-22T05:16:14.116274+0000","last_fullsized":"2024-01-22T05:16:14.116274+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3b","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112779+0000","last_change":"2024-01-22T05:16:13.663883+0000","last_active":"2024-01-22T05:16:14.112779+0000","last_peered":"2024-01-22T05:16:14.112779+0000","last_clean":"2024-01-22T05:16:14.112779+0000","last_became_active":"2024-01-22T05:16:13.663539+0000","last_became_peered":"2024-01-22T05:16:13.663539+0000","last_unstale":"2024-01-22T05:16:14.112779+0000","last_undegraded":"2024-01-22T05:16:14.112779+0000","last_fullsized":"2024-01-22T05:16:14.112779+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.104006+0000","last_change":"2024-01-22T05:16:14.097304+0000","last_active":"2024-01-22T05:16:14.104006+0000","last_peered":"2024-01-22T05:16:14.104006+0000","last_clean":"2024-01-22T05:16:14.104006+0000","last_became_active":"2024-01-22T05:16:14.097014+0000","last_became_peered":"2024-01-22T05:16:14.097014+0000","last_unstale":"2024-01-22T05:16:14.104006+0000","last_undegraded":"2024-01-22T05:16:14.104006+0000","last_fullsized":"2024-01-22T05:16:14.104006+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3a","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.113036+0000","last_change":"2024-01-22T05:16:13.670740+0000","last_active":"2024-01-22T05:16:14.113036+0000","last_peered":"2024-01-22T05:16:14.113036+0000","last_clean":"2024-01-22T05:16:14.113036+0000","last_became_active":"2024-01-22T05:16:13.670426+0000","last_became_peered":"2024-01-22T05:16:13.670426+0000","last_unstale":"2024-01-22T05:16:14.113036+0000","last_undegraded":"2024-01-22T05:16:14.113036+0000","last_fullsized":"2024-01-22T05:16:14.113036+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110683+0000","last_change":"2024-01-22T05:16:14.100502+0000","last_active":"2024-01-22T05:16:14.110683+0000","last_peered":"2024-01-22T05:16:14.110683+0000","last_clean":"2024-01-22T05:16:14.110683+0000","last_became_active":"2024-01-22T05:16:14.098029+0000","last_became_peered":"2024-01-22T05:16:14.098029+0000","last_unstale":"2024-01-22T05:16:14.110683+0000","last_undegraded":"2024-01-22T05:16:14.110683+0000","last_fullsized":"2024-01-22T05:16:14.110683+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083795+0000","last_change":"2024-01-22T05:16:13.661623+0000","last_active":"2024-01-22T05:16:14.083795+0000","last_peered":"2024-01-22T05:16:14.083795+0000","last_clean":"2024-01-22T05:16:14.083795+0000","last_became_active":"2024-01-22T05:16:13.661338+0000","last_became_peered":"2024-01-22T05:16:13.661338+0000","last_unstale":"2024-01-22T05:16:14.083795+0000","last_undegraded":"2024-01-22T05:16:14.083795+0000","last_fullsized":"2024-01-22T05:16:14.083795+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.117183+0000","last_change":"2024-01-22T05:16:14.110158+0000","last_active":"2024-01-22T05:16:14.117183+0000","last_peered":"2024-01-22T05:16:14.117183+0000","last_clean":"2024-01-22T05:16:14.117183+0000","last_became_active":"2024-01-22T05:16:14.109717+0000","last_became_peered":"2024-01-22T05:16:14.109717+0000","last_unstale":"2024-01-22T05:16:14.117183+0000","last_undegraded":"2024-01-22T05:16:14.117183+0000","last_fullsized":"2024-01-22T05:16:14.117183+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.077578+0000","last_change":"2024-01-22T05:16:13.635717+0000","last_active":"2024-01-22T05:16:14.077578+0000","last_peered":"2024-01-22T05:16:14.077578+0000","last_clean":"2024-01-22T05:16:14.077578+0000","last_became_active":"2024-01-22T05:16:13.635425+0000","last_became_peered":"2024-01-22T05:16:13.635425+0000","last_unstale":"2024-01-22T05:16:14.077578+0000","last_undegraded":"2024-01-22T05:16:14.077578+0000","last_fullsized":"2024-01-22T05:16:14.077578+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.102849+0000","last_change":"2024-01-22T05:16:14.097810+0000","last_active":"2024-01-22T05:16:14.102849+0000","last_peered":"2024-01-22T05:16:14.102849+0000","last_clean":"2024-01-22T05:16:14.102849+0000","last_became_active":"2024-01-22T05:16:14.097030+0000","last_became_peered":"2024-01-22T05:16:14.097030+0000","last_unstale":"2024-01-22T05:16:14.102849+0000","last_undegraded":"2024-01-22T05:16:14.102849+0000","last_fullsized":"2024-01-22T05:16:14.102849+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.084160+0000","last_change":"2024-01-22T05:16:13.657951+0000","last_active":"2024-01-22T05:16:14.084160+0000","last_peered":"2024-01-22T05:16:14.084160+0000","last_clean":"2024-01-22T05:16:14.084160+0000","last_became_active":"2024-01-22T05:16:13.657686+0000","last_became_peered":"2024-01-22T05:16:13.657686+0000","last_unstale":"2024-01-22T05:16:14.084160+0000","last_undegraded":"2024-01-22T05:16:14.084160+0000","last_fullsized":"2024-01-22T05:16:14.084160+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.111881+0000","last_change":"2024-01-22T05:16:14.102747+0000","last_active":"2024-01-22T05:16:14.111881+0000","last_peered":"2024-01-22T05:16:14.111881+0000","last_clean":"2024-01-22T05:16:14.111881+0000","last_became_active":"2024-01-22T05:16:14.102546+0000","last_became_peered":"2024-01-22T05:16:14.102546+0000","last_unstale":"2024-01-22T05:16:14.111881+0000","last_undegraded":"2024-01-22T05:16:14.111881+0000","last_fullsized":"2024-01-22T05:16:14.111881+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.102956+0000","last_change":"2024-01-22T05:16:13.651840+0000","last_active":"2024-01-22T05:16:14.102956+0000","last_peered":"2024-01-22T05:16:14.102956+0000","last_clean":"2024-01-22T05:16:14.102956+0000","last_became_active":"2024-01-22T05:16:13.651503+0000","last_became_peered":"2024-01-22T05:16:13.651503+0000","last_unstale":"2024-01-22T05:16:14.102956+0000","last_undegraded":"2024-01-22T05:16:14.102956+0000","last_fullsized":"2024-01-22T05:16:14.102956+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.109682+0000","last_change":"2024-01-22T05:16:14.101660+0000","last_active":"2024-01-22T05:16:14.109682+0000","last_peered":"2024-01-22T05:16:14.109682+0000","last_clean":"2024-01-22T05:16:14.109682+0000","last_became_active":"2024-01-22T05:16:14.100085+0000","last_became_peered":"2024-01-22T05:16:14.100085+0000","last_unstale":"2024-01-22T05:16:14.109682+0000","last_undegraded":"2024-01-22T05:16:14.109682+0000","last_fullsized":"2024-01-22T05:16:14.109682+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.077328+0000","last_change":"2024-01-22T05:16:13.658792+0000","last_active":"2024-01-22T05:16:14.077328+0000","last_peered":"2024-01-22T05:16:14.077328+0000","last_clean":"2024-01-22T05:16:14.077328+0000","last_became_active":"2024-01-22T05:16:13.658432+0000","last_became_peered":"2024-01-22T05:16:13.658432+0000","last_unstale":"2024-01-22T05:16:14.077328+0000","last_undegraded":"2024-01-22T05:16:14.077328+0000","last_fullsized":"2024-01-22T05:16:14.077328+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112190+0000","last_change":"2024-01-22T05:16:14.104274+0000","last_active":"2024-01-22T05:16:14.112190+0000","last_peered":"2024-01-22T05:16:14.112190+0000","last_clean":"2024-01-22T05:16:14.112190+0000","last_became_active":"2024-01-22T05:16:14.103993+0000","last_became_peered":"2024-01-22T05:16:14.103993+0000","last_unstale":"2024-01-22T05:16:14.112190+0000","last_undegraded":"2024-01-22T05:16:14.112190+0000","last_fullsized":"2024-01-22T05:16:14.112190+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.34","version":"144'4","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.122685+0000","last_change":"2024-01-22T05:16:13.668531+0000","last_active":"2024-01-22T05:16:14.122685+0000","last_peered":"2024-01-22T05:16:14.122685+0000","last_clean":"2024-01-22T05:16:14.122685+0000","last_became_active":"2024-01-22T05:16:13.668285+0000","last_became_peered":"2024-01-22T05:16:13.668285+0000","last_unstale":"2024-01-22T05:16:14.122685+0000","last_undegraded":"2024-01-22T05:16:14.122685+0000","last_fullsized":"2024-01-22T05:16:14.122685+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.099000+0000","last_change":"2024-01-22T05:16:14.094828+0000","last_active":"2024-01-22T05:16:14.099000+0000","last_peered":"2024-01-22T05:16:14.099000+0000","last_clean":"2024-01-22T05:16:14.099000+0000","last_became_active":"2024-01-22T05:16:14.094546+0000","last_became_peered":"2024-01-22T05:16:14.094546+0000","last_unstale":"2024-01-22T05:16:14.099000+0000","last_undegraded":"2024-01-22T05:16:14.099000+0000","last_fullsized":"2024-01-22T05:16:14.099000+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.33","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112937+0000","last_change":"2024-01-22T05:16:13.660559+0000","last_active":"2024-01-22T05:16:14.112937+0000","last_peered":"2024-01-22T05:16:14.112937+0000","last_clean":"2024-01-22T05:16:14.112937+0000","last_became_active":"2024-01-22T05:16:13.660268+0000","last_became_peered":"2024-01-22T05:16:13.660268+0000","last_unstale":"2024-01-22T05:16:14.112937+0000","last_undegraded":"2024-01-22T05:16:14.112937+0000","last_fullsized":"2024-01-22T05:16:14.112937+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.097199+0000","last_change":"2024-01-22T05:16:14.094117+0000","last_active":"2024-01-22T05:16:14.097199+0000","last_peered":"2024-01-22T05:16:14.097199+0000","last_clean":"2024-01-22T05:16:14.097199+0000","last_became_active":"2024-01-22T05:16:14.093837+0000","last_became_peered":"2024-01-22T05:16:14.093837+0000","last_unstale":"2024-01-22T05:16:14.097199+0000","last_undegraded":"2024-01-22T05:16:14.097199+0000","last_fullsized":"2024-01-22T05:16:14.097199+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.089146+0000","last_change":"2024-01-22T05:16:13.658358+0000","last_active":"2024-01-22T05:16:14.089146+0000","last_peered":"2024-01-22T05:16:14.089146+0000","last_clean":"2024-01-22T05:16:14.089146+0000","last_became_active":"2024-01-22T05:16:13.657959+0000","last_became_peered":"2024-01-22T05:16:13.657959+0000","last_unstale":"2024-01-22T05:16:14.089146+0000","last_undegraded":"2024-01-22T05:16:14.089146+0000","last_fullsized":"2024-01-22T05:16:14.089146+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.106961+0000","last_change":"2024-01-22T05:16:14.103374+0000","last_active":"2024-01-22T05:16:14.106961+0000","last_peered":"2024-01-22T05:16:14.106961+0000","last_clean":"2024-01-22T05:16:14.106961+0000","last_became_active":"2024-01-22T05:16:14.103040+0000","last_became_peered":"2024-01-22T05:16:14.103040+0000","last_unstale":"2024-01-22T05:16:14.106961+0000","last_undegraded":"2024-01-22T05:16:14.106961+0000","last_fullsized":"2024-01-22T05:16:14.106961+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.089696+0000","last_change":"2024-01-22T05:16:13.659177+0000","last_active":"2024-01-22T05:16:14.089696+0000","last_peered":"2024-01-22T05:16:14.089696+0000","last_clean":"2024-01-22T05:16:14.089696+0000","last_became_active":"2024-01-22T05:16:13.658617+0000","last_became_peered":"2024-01-22T05:16:13.658617+0000","last_unstale":"2024-01-22T05:16:14.089696+0000","last_undegraded":"2024-01-22T05:16:14.089696+0000","last_fullsized":"2024-01-22T05:16:14.089696+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.109607+0000","last_change":"2024-01-22T05:16:14.101893+0000","last_active":"2024-01-22T05:16:14.109607+0000","last_peered":"2024-01-22T05:16:14.109607+0000","last_clean":"2024-01-22T05:16:14.109607+0000","last_became_active":"2024-01-22T05:16:14.101497+0000","last_became_peered":"2024-01-22T05:16:14.101497+0000","last_unstale":"2024-01-22T05:16:14.109607+0000","last_undegraded":"2024-01-22T05:16:14.109607+0000","last_fullsized":"2024-01-22T05:16:14.109607+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.30","version":"144'4","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.114944+0000","last_change":"2024-01-22T05:16:13.673327+0000","last_active":"2024-01-22T05:16:14.114944+0000","last_peered":"2024-01-22T05:16:14.114944+0000","last_clean":"2024-01-22T05:16:14.114944+0000","last_became_active":"2024-01-22T05:16:13.672691+0000","last_became_peered":"2024-01-22T05:16:13.672691+0000","last_unstale":"2024-01-22T05:16:14.114944+0000","last_undegraded":"2024-01-22T05:16:14.114944+0000","last_fullsized":"2024-01-22T05:16:14.114944+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110995+0000","last_change":"2024-01-22T05:16:14.108990+0000","last_active":"2024-01-22T05:16:14.110995+0000","last_peered":"2024-01-22T05:16:14.110995+0000","last_clean":"2024-01-22T05:16:14.110995+0000","last_became_active":"2024-01-22T05:16:14.108698+0000","last_became_peered":"2024-01-22T05:16:14.108698+0000","last_unstale":"2024-01-22T05:16:14.110995+0000","last_undegraded":"2024-01-22T05:16:14.110995+0000","last_fullsized":"2024-01-22T05:16:14.110995+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.084286+0000","last_change":"2024-01-22T05:16:13.672907+0000","last_active":"2024-01-22T05:16:14.084286+0000","last_peered":"2024-01-22T05:16:14.084286+0000","last_clean":"2024-01-22T05:16:14.084286+0000","last_became_active":"2024-01-22T05:16:13.672645+0000","last_became_peered":"2024-01-22T05:16:13.672645+0000","last_unstale":"2024-01-22T05:16:14.084286+0000","last_undegraded":"2024-01-22T05:16:14.084286+0000","last_fullsized":"2024-01-22T05:16:14.084286+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.114907+0000","last_change":"2024-01-22T05:16:14.114265+0000","last_active":"2024-01-22T05:16:14.114907+0000","last_peered":"2024-01-22T05:16:14.114907+0000","last_clean":"2024-01-22T05:16:14.114907+0000","last_became_active":"2024-01-22T05:16:14.113476+0000","last_became_peered":"2024-01-22T05:16:14.113476+0000","last_unstale":"2024-01-22T05:16:14.114907+0000","last_undegraded":"2024-01-22T05:16:14.114907+0000","last_fullsized":"2024-01-22T05:16:14.114907+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.088299+0000","last_change":"2024-01-22T05:16:13.668321+0000","last_active":"2024-01-22T05:16:14.088299+0000","last_peered":"2024-01-22T05:16:14.088299+0000","last_clean":"2024-01-22T05:16:14.088299+0000","last_became_active":"2024-01-22T05:16:13.666798+0000","last_became_peered":"2024-01-22T05:16:13.666798+0000","last_unstale":"2024-01-22T05:16:14.088299+0000","last_undegraded":"2024-01-22T05:16:14.088299+0000","last_fullsized":"2024-01-22T05:16:14.088299+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.107037+0000","last_change":"2024-01-22T05:16:14.103716+0000","last_active":"2024-01-22T05:16:14.107037+0000","last_peered":"2024-01-22T05:16:14.107037+0000","last_clean":"2024-01-22T05:16:14.107037+0000","last_became_active":"2024-01-22T05:16:14.103457+0000","last_became_peered":"2024-01-22T05:16:14.103457+0000","last_unstale":"2024-01-22T05:16:14.107037+0000","last_undegraded":"2024-01-22T05:16:14.107037+0000","last_fullsized":"2024-01-22T05:16:14.107037+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2d","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.097544+0000","last_change":"2024-01-22T05:16:13.662661+0000","last_active":"2024-01-22T05:16:14.097544+0000","last_peered":"2024-01-22T05:16:14.097544+0000","last_clean":"2024-01-22T05:16:14.097544+0000","last_became_active":"2024-01-22T05:16:13.660294+0000","last_became_peered":"2024-01-22T05:16:13.660294+0000","last_unstale":"2024-01-22T05:16:14.097544+0000","last_undegraded":"2024-01-22T05:16:14.097544+0000","last_fullsized":"2024-01-22T05:16:14.097544+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112563+0000","last_change":"2024-01-22T05:16:14.105314+0000","last_active":"2024-01-22T05:16:14.112563+0000","last_peered":"2024-01-22T05:16:14.112563+0000","last_clean":"2024-01-22T05:16:14.112563+0000","last_became_active":"2024-01-22T05:16:14.105111+0000","last_became_peered":"2024-01-22T05:16:14.105111+0000","last_unstale":"2024-01-22T05:16:14.112563+0000","last_undegraded":"2024-01-22T05:16:14.112563+0000","last_fullsized":"2024-01-22T05:16:14.112563+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.088275+0000","last_change":"2024-01-22T05:16:13.667907+0000","last_active":"2024-01-22T05:16:14.088275+0000","last_peered":"2024-01-22T05:16:14.088275+0000","last_clean":"2024-01-22T05:16:14.088275+0000","last_became_active":"2024-01-22T05:16:13.667601+0000","last_became_peered":"2024-01-22T05:16:13.667601+0000","last_unstale":"2024-01-22T05:16:14.088275+0000","last_undegraded":"2024-01-22T05:16:14.088275+0000","last_fullsized":"2024-01-22T05:16:14.088275+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.094920+0000","last_change":"2024-01-22T05:16:14.089997+0000","last_active":"2024-01-22T05:16:14.094920+0000","last_peered":"2024-01-22T05:16:14.094920+0000","last_clean":"2024-01-22T05:16:14.094920+0000","last_became_active":"2024-01-22T05:16:14.089725+0000","last_became_peered":"2024-01-22T05:16:14.089725+0000","last_unstale":"2024-01-22T05:16:14.094920+0000","last_undegraded":"2024-01-22T05:16:14.094920+0000","last_fullsized":"2024-01-22T05:16:14.094920+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2b","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.102819+0000","last_change":"2024-01-22T05:16:13.653633+0000","last_active":"2024-01-22T05:16:14.102819+0000","last_peered":"2024-01-22T05:16:14.102819+0000","last_clean":"2024-01-22T05:16:14.102819+0000","last_became_active":"2024-01-22T05:16:13.653262+0000","last_became_peered":"2024-01-22T05:16:13.653262+0000","last_unstale":"2024-01-22T05:16:14.102819+0000","last_undegraded":"2024-01-22T05:16:14.102819+0000","last_fullsized":"2024-01-22T05:16:14.102819+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.103833+0000","last_change":"2024-01-22T05:16:14.096508+0000","last_active":"2024-01-22T05:16:14.103833+0000","last_peered":"2024-01-22T05:16:14.103833+0000","last_clean":"2024-01-22T05:16:14.103833+0000","last_became_active":"2024-01-22T05:16:14.096216+0000","last_became_peered":"2024-01-22T05:16:14.096216+0000","last_unstale":"2024-01-22T05:16:14.103833+0000","last_undegraded":"2024-01-22T05:16:14.103833+0000","last_fullsized":"2024-01-22T05:16:14.103833+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.098456+0000","last_change":"2024-01-22T05:16:13.658170+0000","last_active":"2024-01-22T05:16:14.098456+0000","last_peered":"2024-01-22T05:16:14.098456+0000","last_clean":"2024-01-22T05:16:14.098456+0000","last_became_active":"2024-01-22T05:16:13.657711+0000","last_became_peered":"2024-01-22T05:16:13.657711+0000","last_unstale":"2024-01-22T05:16:14.098456+0000","last_undegraded":"2024-01-22T05:16:14.098456+0000","last_fullsized":"2024-01-22T05:16:14.098456+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.099587+0000","last_change":"2024-01-22T05:16:14.094262+0000","last_active":"2024-01-22T05:16:14.099587+0000","last_peered":"2024-01-22T05:16:14.099587+0000","last_clean":"2024-01-22T05:16:14.099587+0000","last_became_active":"2024-01-22T05:16:14.093961+0000","last_became_peered":"2024-01-22T05:16:14.093961+0000","last_unstale":"2024-01-22T05:16:14.099587+0000","last_undegraded":"2024-01-22T05:16:14.099587+0000","last_fullsized":"2024-01-22T05:16:14.099587+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.077116+0000","last_change":"2024-01-22T05:16:13.650328+0000","last_active":"2024-01-22T05:16:14.077116+0000","last_peered":"2024-01-22T05:16:14.077116+0000","last_clean":"2024-01-22T05:16:14.077116+0000","last_became_active":"2024-01-22T05:16:13.648572+0000","last_became_peered":"2024-01-22T05:16:13.648572+0000","last_unstale":"2024-01-22T05:16:14.077116+0000","last_undegraded":"2024-01-22T05:16:14.077116+0000","last_fullsized":"2024-01-22T05:16:14.077116+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.111095+0000","last_change":"2024-01-22T05:16:14.107104+0000","last_active":"2024-01-22T05:16:14.111095+0000","last_peered":"2024-01-22T05:16:14.111095+0000","last_clean":"2024-01-22T05:16:14.111095+0000","last_became_active":"2024-01-22T05:16:14.105883+0000","last_became_peered":"2024-01-22T05:16:14.105883+0000","last_unstale":"2024-01-22T05:16:14.111095+0000","last_undegraded":"2024-01-22T05:16:14.111095+0000","last_fullsized":"2024-01-22T05:16:14.111095+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.081083+0000","last_change":"2024-01-22T05:16:13.657483+0000","last_active":"2024-01-22T05:16:14.081083+0000","last_peered":"2024-01-22T05:16:14.081083+0000","last_clean":"2024-01-22T05:16:14.081083+0000","last_became_active":"2024-01-22T05:16:13.657184+0000","last_became_peered":"2024-01-22T05:16:13.657184+0000","last_unstale":"2024-01-22T05:16:14.081083+0000","last_undegraded":"2024-01-22T05:16:14.081083+0000","last_fullsized":"2024-01-22T05:16:14.081083+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112793+0000","last_change":"2024-01-22T05:16:14.109218+0000","last_active":"2024-01-22T05:16:14.112793+0000","last_peered":"2024-01-22T05:16:14.112793+0000","last_clean":"2024-01-22T05:16:14.112793+0000","last_became_active":"2024-01-22T05:16:14.108900+0000","last_became_peered":"2024-01-22T05:16:14.108900+0000","last_unstale":"2024-01-22T05:16:14.112793+0000","last_undegraded":"2024-01-22T05:16:14.112793+0000","last_fullsized":"2024-01-22T05:16:14.112793+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.095486+0000","last_change":"2024-01-22T05:16:13.655473+0000","last_active":"2024-01-22T05:16:14.095486+0000","last_peered":"2024-01-22T05:16:14.095486+0000","last_clean":"2024-01-22T05:16:14.095486+0000","last_became_active":"2024-01-22T05:16:13.655219+0000","last_became_peered":"2024-01-22T05:16:13.655219+0000","last_unstale":"2024-01-22T05:16:14.095486+0000","last_undegraded":"2024-01-22T05:16:14.095486+0000","last_fullsized":"2024-01-22T05:16:14.095486+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.108231+0000","last_change":"2024-01-22T05:16:14.104693+0000","last_active":"2024-01-22T05:16:14.108231+0000","last_peered":"2024-01-22T05:16:14.108231+0000","last_clean":"2024-01-22T05:16:14.108231+0000","last_became_active":"2024-01-22T05:16:14.104263+0000","last_became_peered":"2024-01-22T05:16:14.104263+0000","last_unstale":"2024-01-22T05:16:14.108231+0000","last_undegraded":"2024-01-22T05:16:14.108231+0000","last_fullsized":"2024-01-22T05:16:14.108231+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.100407+0000","last_change":"2024-01-22T05:16:13.662789+0000","last_active":"2024-01-22T05:16:14.100407+0000","last_peered":"2024-01-22T05:16:14.100407+0000","last_clean":"2024-01-22T05:16:14.100407+0000","last_became_active":"2024-01-22T05:16:13.660818+0000","last_became_peered":"2024-01-22T05:16:13.660818+0000","last_unstale":"2024-01-22T05:16:14.100407+0000","last_undegraded":"2024-01-22T05:16:14.100407+0000","last_fullsized":"2024-01-22T05:16:14.100407+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.122335+0000","last_change":"2024-01-22T05:16:14.121438+0000","last_active":"2024-01-22T05:16:14.122335+0000","last_peered":"2024-01-22T05:16:14.122335+0000","last_clean":"2024-01-22T05:16:14.122335+0000","last_became_active":"2024-01-22T05:16:14.120693+0000","last_became_peered":"2024-01-22T05:16:14.120693+0000","last_unstale":"2024-01-22T05:16:14.122335+0000","last_undegraded":"2024-01-22T05:16:14.122335+0000","last_fullsized":"2024-01-22T05:16:14.122335+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.084569+0000","last_change":"2024-01-22T05:16:13.671358+0000","last_active":"2024-01-22T05:16:14.084569+0000","last_peered":"2024-01-22T05:16:14.084569+0000","last_clean":"2024-01-22T05:16:14.084569+0000","last_became_active":"2024-01-22T05:16:13.671093+0000","last_became_peered":"2024-01-22T05:16:13.671093+0000","last_unstale":"2024-01-22T05:16:14.084569+0000","last_undegraded":"2024-01-22T05:16:14.084569+0000","last_fullsized":"2024-01-22T05:16:14.084569+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.120861+0000","last_change":"2024-01-22T05:16:14.114418+0000","last_active":"2024-01-22T05:16:14.120861+0000","last_peered":"2024-01-22T05:16:14.120861+0000","last_clean":"2024-01-22T05:16:14.120861+0000","last_became_active":"2024-01-22T05:16:14.113765+0000","last_became_peered":"2024-01-22T05:16:14.113765+0000","last_unstale":"2024-01-22T05:16:14.120861+0000","last_undegraded":"2024-01-22T05:16:14.120861+0000","last_fullsized":"2024-01-22T05:16:14.120861+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.102745+0000","last_change":"2024-01-22T05:16:13.646807+0000","last_active":"2024-01-22T05:16:14.102745+0000","last_peered":"2024-01-22T05:16:14.102745+0000","last_clean":"2024-01-22T05:16:14.102745+0000","last_became_active":"2024-01-22T05:16:13.643861+0000","last_became_peered":"2024-01-22T05:16:13.643861+0000","last_unstale":"2024-01-22T05:16:14.102745+0000","last_undegraded":"2024-01-22T05:16:14.102745+0000","last_fullsized":"2024-01-22T05:16:14.102745+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.105631+0000","last_change":"2024-01-22T05:16:14.098218+0000","last_active":"2024-01-22T05:16:14.105631+0000","last_peered":"2024-01-22T05:16:14.105631+0000","last_clean":"2024-01-22T05:16:14.105631+0000","last_became_active":"2024-01-22T05:16:14.097899+0000","last_became_peered":"2024-01-22T05:16:14.097899+0000","last_unstale":"2024-01-22T05:16:14.105631+0000","last_undegraded":"2024-01-22T05:16:14.105631+0000","last_fullsized":"2024-01-22T05:16:14.105631+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.095621+0000","last_change":"2024-01-22T05:16:13.656818+0000","last_active":"2024-01-22T05:16:14.095621+0000","last_peered":"2024-01-22T05:16:14.095621+0000","last_clean":"2024-01-22T05:16:14.095621+0000","last_became_active":"2024-01-22T05:16:13.656160+0000","last_became_peered":"2024-01-22T05:16:13.656160+0000","last_unstale":"2024-01-22T05:16:14.095621+0000","last_undegraded":"2024-01-22T05:16:14.095621+0000","last_fullsized":"2024-01-22T05:16:14.095621+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112840+0000","last_change":"2024-01-22T05:16:14.109543+0000","last_active":"2024-01-22T05:16:14.112840+0000","last_peered":"2024-01-22T05:16:14.112840+0000","last_clean":"2024-01-22T05:16:14.112840+0000","last_became_active":"2024-01-22T05:16:14.109272+0000","last_became_peered":"2024-01-22T05:16:14.109272+0000","last_unstale":"2024-01-22T05:16:14.112840+0000","last_undegraded":"2024-01-22T05:16:14.112840+0000","last_fullsized":"2024-01-22T05:16:14.112840+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.095033+0000","last_change":"2024-01-22T05:16:13.657371+0000","last_active":"2024-01-22T05:16:14.095033+0000","last_peered":"2024-01-22T05:16:14.095033+0000","last_clean":"2024-01-22T05:16:14.095033+0000","last_became_active":"2024-01-22T05:16:13.656889+0000","last_became_peered":"2024-01-22T05:16:13.656889+0000","last_unstale":"2024-01-22T05:16:14.095033+0000","last_undegraded":"2024-01-22T05:16:14.095033+0000","last_fullsized":"2024-01-22T05:16:14.095033+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110759+0000","last_change":"2024-01-22T05:16:14.106342+0000","last_active":"2024-01-22T05:16:14.110759+0000","last_peered":"2024-01-22T05:16:14.110759+0000","last_clean":"2024-01-22T05:16:14.110759+0000","last_became_active":"2024-01-22T05:16:14.106086+0000","last_became_peered":"2024-01-22T05:16:14.106086+0000","last_unstale":"2024-01-22T05:16:14.110759+0000","last_undegraded":"2024-01-22T05:16:14.110759+0000","last_fullsized":"2024-01-22T05:16:14.110759+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.078013+0000","last_change":"2024-01-22T05:16:13.652356+0000","last_active":"2024-01-22T05:16:14.078013+0000","last_peered":"2024-01-22T05:16:14.078013+0000","last_clean":"2024-01-22T05:16:14.078013+0000","last_became_active":"2024-01-22T05:16:13.652058+0000","last_became_peered":"2024-01-22T05:16:13.652058+0000","last_unstale":"2024-01-22T05:16:14.078013+0000","last_undegraded":"2024-01-22T05:16:14.078013+0000","last_fullsized":"2024-01-22T05:16:14.078013+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.121693+0000","last_change":"2024-01-22T05:16:14.114697+0000","last_active":"2024-01-22T05:16:14.121693+0000","last_peered":"2024-01-22T05:16:14.121693+0000","last_clean":"2024-01-22T05:16:14.121693+0000","last_became_active":"2024-01-22T05:16:14.114386+0000","last_became_peered":"2024-01-22T05:16:14.114386+0000","last_unstale":"2024-01-22T05:16:14.121693+0000","last_undegraded":"2024-01-22T05:16:14.121693+0000","last_fullsized":"2024-01-22T05:16:14.121693+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.091954+0000","last_change":"2024-01-22T05:16:13.654339+0000","last_active":"2024-01-22T05:16:14.091954+0000","last_peered":"2024-01-22T05:16:14.091954+0000","last_clean":"2024-01-22T05:16:14.091954+0000","last_became_active":"2024-01-22T05:16:13.653656+0000","last_became_peered":"2024-01-22T05:16:13.653656+0000","last_unstale":"2024-01-22T05:16:14.091954+0000","last_undegraded":"2024-01-22T05:16:14.091954+0000","last_fullsized":"2024-01-22T05:16:14.091954+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.109714+0000","last_change":"2024-01-22T05:16:14.102872+0000","last_active":"2024-01-22T05:16:14.109714+0000","last_peered":"2024-01-22T05:16:14.109714+0000","last_clean":"2024-01-22T05:16:14.109714+0000","last_became_active":"2024-01-22T05:16:14.100920+0000","last_became_peered":"2024-01-22T05:16:14.100920+0000","last_unstale":"2024-01-22T05:16:14.109714+0000","last_undegraded":"2024-01-22T05:16:14.109714+0000","last_fullsized":"2024-01-22T05:16:14.109714+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.102454+0000","last_change":"2024-01-22T05:16:13.668278+0000","last_active":"2024-01-22T05:16:14.102454+0000","last_peered":"2024-01-22T05:16:14.102454+0000","last_clean":"2024-01-22T05:16:14.102454+0000","last_became_active":"2024-01-22T05:16:13.667924+0000","last_became_peered":"2024-01-22T05:16:13.667924+0000","last_unstale":"2024-01-22T05:16:14.102454+0000","last_undegraded":"2024-01-22T05:16:14.102454+0000","last_fullsized":"2024-01-22T05:16:14.102454+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.121623+0000","last_change":"2024-01-22T05:16:14.114125+0000","last_active":"2024-01-22T05:16:14.121623+0000","last_peered":"2024-01-22T05:16:14.121623+0000","last_clean":"2024-01-22T05:16:14.121623+0000","last_became_active":"2024-01-22T05:16:14.113851+0000","last_became_peered":"2024-01-22T05:16:14.113851+0000","last_unstale":"2024-01-22T05:16:14.121623+0000","last_undegraded":"2024-01-22T05:16:14.121623+0000","last_fullsized":"2024-01-22T05:16:14.121623+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.112532+0000","last_change":"2024-01-22T05:16:13.668120+0000","last_active":"2024-01-22T05:16:14.112532+0000","last_peered":"2024-01-22T05:16:14.112532+0000","last_clean":"2024-01-22T05:16:14.112532+0000","last_became_active":"2024-01-22T05:16:13.667819+0000","last_became_peered":"2024-01-22T05:16:13.667819+0000","last_unstale":"2024-01-22T05:16:14.112532+0000","last_undegraded":"2024-01-22T05:16:14.112532+0000","last_fullsized":"2024-01-22T05:16:14.112532+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.107888+0000","last_change":"2024-01-22T05:16:14.099050+0000","last_active":"2024-01-22T05:16:14.107888+0000","last_peered":"2024-01-22T05:16:14.107888+0000","last_clean":"2024-01-22T05:16:14.107888+0000","last_became_active":"2024-01-22T05:16:14.097461+0000","last_became_peered":"2024-01-22T05:16:14.097461+0000","last_unstale":"2024-01-22T05:16:14.107888+0000","last_undegraded":"2024-01-22T05:16:14.107888+0000","last_fullsized":"2024-01-22T05:16:14.107888+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"144'2","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.113986+0000","last_change":"2024-01-22T05:16:13.639126+0000","last_active":"2024-01-22T05:16:14.113986+0000","last_peered":"2024-01-22T05:16:14.113986+0000","last_clean":"2024-01-22T05:16:14.113986+0000","last_became_active":"2024-01-22T05:16:13.638828+0000","last_became_peered":"2024-01-22T05:16:13.638828+0000","last_unstale":"2024-01-22T05:16:14.113986+0000","last_undegraded":"2024-01-22T05:16:14.113986+0000","last_fullsized":"2024-01-22T05:16:14.113986+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.107977+0000","last_change":"2024-01-22T05:16:14.099804+0000","last_active":"2024-01-22T05:16:14.107977+0000","last_peered":"2024-01-22T05:16:14.107977+0000","last_clean":"2024-01-22T05:16:14.107977+0000","last_became_active":"2024-01-22T05:16:14.099526+0000","last_became_peered":"2024-01-22T05:16:14.099526+0000","last_unstale":"2024-01-22T05:16:14.107977+0000","last_undegraded":"2024-01-22T05:16:14.107977+0000","last_fullsized":"2024-01-22T05:16:14.107977+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.078888+0000","last_change":"2024-01-22T05:16:13.652235+0000","last_active":"2024-01-22T05:16:14.078888+0000","last_peered":"2024-01-22T05:16:14.078888+0000","last_clean":"2024-01-22T05:16:14.078888+0000","last_became_active":"2024-01-22T05:16:13.651892+0000","last_became_peered":"2024-01-22T05:16:13.651892+0000","last_unstale":"2024-01-22T05:16:14.078888+0000","last_undegraded":"2024-01-22T05:16:14.078888+0000","last_fullsized":"2024-01-22T05:16:14.078888+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.121948+0000","last_change":"2024-01-22T05:16:14.120443+0000","last_active":"2024-01-22T05:16:14.121948+0000","last_peered":"2024-01-22T05:16:14.121948+0000","last_clean":"2024-01-22T05:16:14.121948+0000","last_became_active":"2024-01-22T05:16:14.117155+0000","last_became_peered":"2024-01-22T05:16:14.117155+0000","last_unstale":"2024-01-22T05:16:14.121948+0000","last_undegraded":"2024-01-22T05:16:14.121948+0000","last_fullsized":"2024-01-22T05:16:14.121948+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.093243+0000","last_change":"2024-01-22T05:16:13.658498+0000","last_active":"2024-01-22T05:16:14.093243+0000","last_peered":"2024-01-22T05:16:14.093243+0000","last_clean":"2024-01-22T05:16:14.093243+0000","last_became_active":"2024-01-22T05:16:13.658186+0000","last_became_peered":"2024-01-22T05:16:13.658186+0000","last_unstale":"2024-01-22T05:16:14.093243+0000","last_undegraded":"2024-01-22T05:16:14.093243+0000","last_fullsized":"2024-01-22T05:16:14.093243+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.111636+0000","last_change":"2024-01-22T05:16:14.107859+0000","last_active":"2024-01-22T05:16:14.111636+0000","last_peered":"2024-01-22T05:16:14.111636+0000","last_clean":"2024-01-22T05:16:14.111636+0000","last_became_active":"2024-01-22T05:16:14.105123+0000","last_became_peered":"2024-01-22T05:16:14.105123+0000","last_unstale":"2024-01-22T05:16:14.111636+0000","last_undegraded":"2024-01-22T05:16:14.111636+0000","last_fullsized":"2024-01-22T05:16:14.111636+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.078677+0000","last_change":"2024-01-22T05:16:13.650379+0000","last_active":"2024-01-22T05:16:14.078677+0000","last_peered":"2024-01-22T05:16:14.078677+0000","last_clean":"2024-01-22T05:16:14.078677+0000","last_became_active":"2024-01-22T05:16:13.650123+0000","last_became_peered":"2024-01-22T05:16:13.650123+0000","last_unstale":"2024-01-22T05:16:14.078677+0000","last_undegraded":"2024-01-22T05:16:14.078677+0000","last_fullsized":"2024-01-22T05:16:14.078677+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.111718+0000","last_change":"2024-01-22T05:16:14.104134+0000","last_active":"2024-01-22T05:16:14.111718+0000","last_peered":"2024-01-22T05:16:14.111718+0000","last_clean":"2024-01-22T05:16:14.111718+0000","last_became_active":"2024-01-22T05:16:14.103859+0000","last_became_peered":"2024-01-22T05:16:14.103859+0000","last_unstale":"2024-01-22T05:16:14.111718+0000","last_undegraded":"2024-01-22T05:16:14.111718+0000","last_fullsized":"2024-01-22T05:16:14.111718+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.089804+0000","last_change":"2024-01-22T05:16:13.659328+0000","last_active":"2024-01-22T05:16:14.089804+0000","last_peered":"2024-01-22T05:16:14.089804+0000","last_clean":"2024-01-22T05:16:14.089804+0000","last_became_active":"2024-01-22T05:16:13.658902+0000","last_became_peered":"2024-01-22T05:16:13.658902+0000","last_unstale":"2024-01-22T05:16:14.089804+0000","last_undegraded":"2024-01-22T05:16:14.089804+0000","last_fullsized":"2024-01-22T05:16:14.089804+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.106872+0000","last_change":"2024-01-22T05:16:14.098984+0000","last_active":"2024-01-22T05:16:14.106872+0000","last_peered":"2024-01-22T05:16:14.106872+0000","last_clean":"2024-01-22T05:16:14.106872+0000","last_became_active":"2024-01-22T05:16:14.098567+0000","last_became_peered":"2024-01-22T05:16:14.098567+0000","last_unstale":"2024-01-22T05:16:14.106872+0000","last_undegraded":"2024-01-22T05:16:14.106872+0000","last_fullsized":"2024-01-22T05:16:14.106872+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.077679+0000","last_change":"2024-01-22T05:16:13.646863+0000","last_active":"2024-01-22T05:16:14.077679+0000","last_peered":"2024-01-22T05:16:14.077679+0000","last_clean":"2024-01-22T05:16:14.077679+0000","last_became_active":"2024-01-22T05:16:13.646536+0000","last_became_peered":"2024-01-22T05:16:13.646536+0000","last_unstale":"2024-01-22T05:16:14.077679+0000","last_undegraded":"2024-01-22T05:16:14.077679+0000","last_fullsized":"2024-01-22T05:16:14.077679+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.102893+0000","last_change":"2024-01-22T05:16:14.097830+0000","last_active":"2024-01-22T05:16:14.102893+0000","last_peered":"2024-01-22T05:16:14.102893+0000","last_clean":"2024-01-22T05:16:14.102893+0000","last_became_active":"2024-01-22T05:16:14.097515+0000","last_became_peered":"2024-01-22T05:16:14.097515+0000","last_unstale":"2024-01-22T05:16:14.102893+0000","last_undegraded":"2024-01-22T05:16:14.102893+0000","last_fullsized":"2024-01-22T05:16:14.102893+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.108963+0000","last_change":"2024-01-22T05:16:13.659548+0000","last_active":"2024-01-22T05:16:14.108963+0000","last_peered":"2024-01-22T05:16:14.108963+0000","last_clean":"2024-01-22T05:16:14.108963+0000","last_became_active":"2024-01-22T05:16:13.658459+0000","last_became_peered":"2024-01-22T05:16:13.658459+0000","last_unstale":"2024-01-22T05:16:14.108963+0000","last_undegraded":"2024-01-22T05:16:14.108963+0000","last_fullsized":"2024-01-22T05:16:14.108963+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.108215+0000","last_change":"2024-01-22T05:16:14.104534+0000","last_active":"2024-01-22T05:16:14.108215+0000","last_peered":"2024-01-22T05:16:14.108215+0000","last_clean":"2024-01-22T05:16:14.108215+0000","last_became_active":"2024-01-22T05:16:14.103985+0000","last_became_peered":"2024-01-22T05:16:14.103985+0000","last_unstale":"2024-01-22T05:16:14.108215+0000","last_undegraded":"2024-01-22T05:16:14.108215+0000","last_fullsized":"2024-01-22T05:16:14.108215+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"144'2","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.117046+0000","last_change":"2024-01-22T05:16:13.669970+0000","last_active":"2024-01-22T05:16:14.117046+0000","last_peered":"2024-01-22T05:16:14.117046+0000","last_clean":"2024-01-22T05:16:14.117046+0000","last_became_active":"2024-01-22T05:16:13.669659+0000","last_became_peered":"2024-01-22T05:16:13.669659+0000","last_unstale":"2024-01-22T05:16:14.117046+0000","last_undegraded":"2024-01-22T05:16:14.117046+0000","last_fullsized":"2024-01-22T05:16:14.117046+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110960+0000","last_change":"2024-01-22T05:16:14.108764+0000","last_active":"2024-01-22T05:16:14.110960+0000","last_peered":"2024-01-22T05:16:14.110960+0000","last_clean":"2024-01-22T05:16:14.110960+0000","last_became_active":"2024-01-22T05:16:14.108445+0000","last_became_peered":"2024-01-22T05:16:14.108445+0000","last_unstale":"2024-01-22T05:16:14.110960+0000","last_undegraded":"2024-01-22T05:16:14.110960+0000","last_fullsized":"2024-01-22T05:16:14.110960+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.093659+0000","last_change":"2024-01-22T05:16:13.657219+0000","last_active":"2024-01-22T05:16:14.093659+0000","last_peered":"2024-01-22T05:16:14.093659+0000","last_clean":"2024-01-22T05:16:14.093659+0000","last_became_active":"2024-01-22T05:16:13.656868+0000","last_became_peered":"2024-01-22T05:16:13.656868+0000","last_unstale":"2024-01-22T05:16:14.093659+0000","last_undegraded":"2024-01-22T05:16:14.093659+0000","last_fullsized":"2024-01-22T05:16:14.093659+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.117259+0000","last_change":"2024-01-22T05:16:14.116326+0000","last_active":"2024-01-22T05:16:14.117259+0000","last_peered":"2024-01-22T05:16:14.117259+0000","last_clean":"2024-01-22T05:16:14.117259+0000","last_became_active":"2024-01-22T05:16:14.114909+0000","last_became_peered":"2024-01-22T05:16:14.114909+0000","last_unstale":"2024-01-22T05:16:14.117259+0000","last_undegraded":"2024-01-22T05:16:14.117259+0000","last_fullsized":"2024-01-22T05:16:14.117259+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.088372+0000","last_change":"2024-01-22T05:16:13.674905+0000","last_active":"2024-01-22T05:16:14.088372+0000","last_peered":"2024-01-22T05:16:14.088372+0000","last_clean":"2024-01-22T05:16:14.088372+0000","last_became_active":"2024-01-22T05:16:13.674632+0000","last_became_peered":"2024-01-22T05:16:13.674632+0000","last_unstale":"2024-01-22T05:16:14.088372+0000","last_undegraded":"2024-01-22T05:16:14.088372+0000","last_fullsized":"2024-01-22T05:16:14.088372+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.105650+0000","last_change":"2024-01-22T05:16:14.100257+0000","last_active":"2024-01-22T05:16:14.105650+0000","last_peered":"2024-01-22T05:16:14.105650+0000","last_clean":"2024-01-22T05:16:14.105650+0000","last_became_active":"2024-01-22T05:16:14.099688+0000","last_became_peered":"2024-01-22T05:16:14.099688+0000","last_unstale":"2024-01-22T05:16:14.105650+0000","last_undegraded":"2024-01-22T05:16:14.105650+0000","last_fullsized":"2024-01-22T05:16:14.105650+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.113204+0000","last_change":"2024-01-22T05:16:13.659980+0000","last_active":"2024-01-22T05:16:14.113204+0000","last_peered":"2024-01-22T05:16:14.113204+0000","last_clean":"2024-01-22T05:16:14.113204+0000","last_became_active":"2024-01-22T05:16:13.659696+0000","last_became_peered":"2024-01-22T05:16:13.659696+0000","last_unstale":"2024-01-22T05:16:14.113204+0000","last_undegraded":"2024-01-22T05:16:14.113204+0000","last_fullsized":"2024-01-22T05:16:14.113204+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110264+0000","last_change":"2024-01-22T05:16:14.106877+0000","last_active":"2024-01-22T05:16:14.110264+0000","last_peered":"2024-01-22T05:16:14.110264+0000","last_clean":"2024-01-22T05:16:14.110264+0000","last_became_active":"2024-01-22T05:16:14.106570+0000","last_became_peered":"2024-01-22T05:16:14.106570+0000","last_unstale":"2024-01-22T05:16:14.110264+0000","last_undegraded":"2024-01-22T05:16:14.110264+0000","last_fullsized":"2024-01-22T05:16:14.110264+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.084192+0000","last_change":"2024-01-22T05:16:13.662118+0000","last_active":"2024-01-22T05:16:14.084192+0000","last_peered":"2024-01-22T05:16:14.084192+0000","last_clean":"2024-01-22T05:16:14.084192+0000","last_became_active":"2024-01-22T05:16:13.660586+0000","last_became_peered":"2024-01-22T05:16:13.660586+0000","last_unstale":"2024-01-22T05:16:14.084192+0000","last_undegraded":"2024-01-22T05:16:14.084192+0000","last_fullsized":"2024-01-22T05:16:14.084192+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.094159+0000","last_change":"2024-01-22T05:16:14.088728+0000","last_active":"2024-01-22T05:16:14.094159+0000","last_peered":"2024-01-22T05:16:14.094159+0000","last_clean":"2024-01-22T05:16:14.094159+0000","last_became_active":"2024-01-22T05:16:14.088403+0000","last_became_peered":"2024-01-22T05:16:14.088403+0000","last_unstale":"2024-01-22T05:16:14.094159+0000","last_undegraded":"2024-01-22T05:16:14.094159+0000","last_fullsized":"2024-01-22T05:16:14.094159+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083939+0000","last_change":"2024-01-22T05:16:13.668052+0000","last_active":"2024-01-22T05:16:14.083939+0000","last_peered":"2024-01-22T05:16:14.083939+0000","last_clean":"2024-01-22T05:16:14.083939+0000","last_became_active":"2024-01-22T05:16:13.667759+0000","last_became_peered":"2024-01-22T05:16:13.667759+0000","last_unstale":"2024-01-22T05:16:14.083939+0000","last_undegraded":"2024-01-22T05:16:14.083939+0000","last_fullsized":"2024-01-22T05:16:14.083939+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.117162+0000","last_change":"2024-01-22T05:16:14.109980+0000","last_active":"2024-01-22T05:16:14.117162+0000","last_peered":"2024-01-22T05:16:14.117162+0000","last_clean":"2024-01-22T05:16:14.117162+0000","last_became_active":"2024-01-22T05:16:14.109409+0000","last_became_peered":"2024-01-22T05:16:14.109409+0000","last_unstale":"2024-01-22T05:16:14.117162+0000","last_undegraded":"2024-01-22T05:16:14.117162+0000","last_fullsized":"2024-01-22T05:16:14.117162+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.099617+0000","last_change":"2024-01-22T05:16:13.666189+0000","last_active":"2024-01-22T05:16:14.099617+0000","last_peered":"2024-01-22T05:16:14.099617+0000","last_clean":"2024-01-22T05:16:14.099617+0000","last_became_active":"2024-01-22T05:16:13.665877+0000","last_became_peered":"2024-01-22T05:16:13.665877+0000","last_unstale":"2024-01-22T05:16:14.099617+0000","last_undegraded":"2024-01-22T05:16:14.099617+0000","last_fullsized":"2024-01-22T05:16:14.099617+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.103915+0000","last_change":"2024-01-22T05:16:14.096358+0000","last_active":"2024-01-22T05:16:14.103915+0000","last_peered":"2024-01-22T05:16:14.103915+0000","last_clean":"2024-01-22T05:16:14.103915+0000","last_became_active":"2024-01-22T05:16:14.096054+0000","last_became_peered":"2024-01-22T05:16:14.096054+0000","last_unstale":"2024-01-22T05:16:14.103915+0000","last_undegraded":"2024-01-22T05:16:14.103915+0000","last_fullsized":"2024-01-22T05:16:14.103915+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"144'2","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.108582+0000","last_change":"2024-01-22T05:16:13.668266+0000","last_active":"2024-01-22T05:16:14.108582+0000","last_peered":"2024-01-22T05:16:14.108582+0000","last_clean":"2024-01-22T05:16:14.108582+0000","last_became_active":"2024-01-22T05:16:13.667848+0000","last_became_peered":"2024-01-22T05:16:13.667848+0000","last_unstale":"2024-01-22T05:16:14.108582+0000","last_undegraded":"2024-01-22T05:16:14.108582+0000","last_fullsized":"2024-01-22T05:16:14.108582+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.109615+0000","last_change":"2024-01-22T05:16:14.103271+0000","last_active":"2024-01-22T05:16:14.109615+0000","last_peered":"2024-01-22T05:16:14.109615+0000","last_clean":"2024-01-22T05:16:14.109615+0000","last_became_active":"2024-01-22T05:16:14.102223+0000","last_became_peered":"2024-01-22T05:16:14.102223+0000","last_unstale":"2024-01-22T05:16:14.109615+0000","last_undegraded":"2024-01-22T05:16:14.109615+0000","last_fullsized":"2024-01-22T05:16:14.109615+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083997+0000","last_change":"2024-01-22T05:16:13.659921+0000","last_active":"2024-01-22T05:16:14.083997+0000","last_peered":"2024-01-22T05:16:14.083997+0000","last_clean":"2024-01-22T05:16:14.083997+0000","last_became_active":"2024-01-22T05:16:13.658955+0000","last_became_peered":"2024-01-22T05:16:13.658955+0000","last_unstale":"2024-01-22T05:16:14.083997+0000","last_undegraded":"2024-01-22T05:16:14.083997+0000","last_fullsized":"2024-01-22T05:16:14.083997+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.102079+0000","last_change":"2024-01-22T05:16:14.097124+0000","last_active":"2024-01-22T05:16:14.102079+0000","last_peered":"2024-01-22T05:16:14.102079+0000","last_clean":"2024-01-22T05:16:14.102079+0000","last_became_active":"2024-01-22T05:16:14.096810+0000","last_became_peered":"2024-01-22T05:16:14.096810+0000","last_unstale":"2024-01-22T05:16:14.102079+0000","last_undegraded":"2024-01-22T05:16:14.102079+0000","last_fullsized":"2024-01-22T05:16:14.102079+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083414+0000","last_change":"2024-01-22T05:16:13.664054+0000","last_active":"2024-01-22T05:16:14.083414+0000","last_peered":"2024-01-22T05:16:14.083414+0000","last_clean":"2024-01-22T05:16:14.083414+0000","last_became_active":"2024-01-22T05:16:13.663768+0000","last_became_peered":"2024-01-22T05:16:13.663768+0000","last_unstale":"2024-01-22T05:16:14.083414+0000","last_undegraded":"2024-01-22T05:16:14.083414+0000","last_fullsized":"2024-01-22T05:16:14.083414+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110974+0000","last_change":"2024-01-22T05:16:14.101162+0000","last_active":"2024-01-22T05:16:14.110974+0000","last_peered":"2024-01-22T05:16:14.110974+0000","last_clean":"2024-01-22T05:16:14.110974+0000","last_became_active":"2024-01-22T05:16:14.100860+0000","last_became_peered":"2024-01-22T05:16:14.100860+0000","last_unstale":"2024-01-22T05:16:14.110974+0000","last_undegraded":"2024-01-22T05:16:14.110974+0000","last_fullsized":"2024-01-22T05:16:14.110974+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.082915+0000","last_change":"2024-01-22T05:16:13.668762+0000","last_active":"2024-01-22T05:16:14.082915+0000","last_peered":"2024-01-22T05:16:14.082915+0000","last_clean":"2024-01-22T05:16:14.082915+0000","last_became_active":"2024-01-22T05:16:13.668467+0000","last_became_peered":"2024-01-22T05:16:13.668467+0000","last_unstale":"2024-01-22T05:16:14.082915+0000","last_undegraded":"2024-01-22T05:16:14.082915+0000","last_fullsized":"2024-01-22T05:16:14.082915+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.107322+0000","last_change":"2024-01-22T05:16:14.103483+0000","last_active":"2024-01-22T05:16:14.107322+0000","last_peered":"2024-01-22T05:16:14.107322+0000","last_clean":"2024-01-22T05:16:14.107322+0000","last_became_active":"2024-01-22T05:16:14.103189+0000","last_became_peered":"2024-01-22T05:16:14.103189+0000","last_unstale":"2024-01-22T05:16:14.107322+0000","last_undegraded":"2024-01-22T05:16:14.107322+0000","last_fullsized":"2024-01-22T05:16:14.107322+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.099831+0000","last_change":"2024-01-22T05:16:13.648724+0000","last_active":"2024-01-22T05:16:14.099831+0000","last_peered":"2024-01-22T05:16:14.099831+0000","last_clean":"2024-01-22T05:16:14.099831+0000","last_became_active":"2024-01-22T05:16:13.647036+0000","last_became_peered":"2024-01-22T05:16:13.647036+0000","last_unstale":"2024-01-22T05:16:14.099831+0000","last_undegraded":"2024-01-22T05:16:14.099831+0000","last_fullsized":"2024-01-22T05:16:14.099831+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.111205+0000","last_change":"2024-01-22T05:16:14.106255+0000","last_active":"2024-01-22T05:16:14.111205+0000","last_peered":"2024-01-22T05:16:14.111205+0000","last_clean":"2024-01-22T05:16:14.111205+0000","last_became_active":"2024-01-22T05:16:14.104866+0000","last_became_peered":"2024-01-22T05:16:14.104866+0000","last_unstale":"2024-01-22T05:16:14.111205+0000","last_undegraded":"2024-01-22T05:16:14.111205+0000","last_fullsized":"2024-01-22T05:16:14.111205+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083735+0000","last_change":"2024-01-22T05:16:13.664682+0000","last_active":"2024-01-22T05:16:14.083735+0000","last_peered":"2024-01-22T05:16:14.083735+0000","last_clean":"2024-01-22T05:16:14.083735+0000","last_became_active":"2024-01-22T05:16:13.662595+0000","last_became_peered":"2024-01-22T05:16:13.662595+0000","last_unstale":"2024-01-22T05:16:14.083735+0000","last_undegraded":"2024-01-22T05:16:14.083735+0000","last_fullsized":"2024-01-22T05:16:14.083735+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.107176+0000","last_change":"2024-01-22T05:16:14.099474+0000","last_active":"2024-01-22T05:16:14.107176+0000","last_peered":"2024-01-22T05:16:14.107176+0000","last_clean":"2024-01-22T05:16:14.107176+0000","last_became_active":"2024-01-22T05:16:14.099041+0000","last_became_peered":"2024-01-22T05:16:14.099041+0000","last_unstale":"2024-01-22T05:16:14.107176+0000","last_undegraded":"2024-01-22T05:16:14.107176+0000","last_fullsized":"2024-01-22T05:16:14.107176+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.095083+0000","last_change":"2024-01-22T05:16:13.649506+0000","last_active":"2024-01-22T05:16:14.095083+0000","last_peered":"2024-01-22T05:16:14.095083+0000","last_clean":"2024-01-22T05:16:14.095083+0000","last_became_active":"2024-01-22T05:16:13.649249+0000","last_became_peered":"2024-01-22T05:16:13.649249+0000","last_unstale":"2024-01-22T05:16:14.095083+0000","last_undegraded":"2024-01-22T05:16:14.095083+0000","last_fullsized":"2024-01-22T05:16:14.095083+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.111174+0000","last_change":"2024-01-22T05:16:14.106720+0000","last_active":"2024-01-22T05:16:14.111174+0000","last_peered":"2024-01-22T05:16:14.111174+0000","last_clean":"2024-01-22T05:16:14.111174+0000","last_became_active":"2024-01-22T05:16:14.105481+0000","last_became_peered":"2024-01-22T05:16:14.105481+0000","last_unstale":"2024-01-22T05:16:14.111174+0000","last_undegraded":"2024-01-22T05:16:14.111174+0000","last_fullsized":"2024-01-22T05:16:14.111174+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.087388+0000","last_change":"2024-01-22T05:16:13.665915+0000","last_active":"2024-01-22T05:16:14.087388+0000","last_peered":"2024-01-22T05:16:14.087388+0000","last_clean":"2024-01-22T05:16:14.087388+0000","last_became_active":"2024-01-22T05:16:13.663498+0000","last_became_peered":"2024-01-22T05:16:13.663498+0000","last_unstale":"2024-01-22T05:16:14.087388+0000","last_undegraded":"2024-01-22T05:16:14.087388+0000","last_fullsized":"2024-01-22T05:16:14.087388+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.103417+0000","last_change":"2024-01-22T05:16:14.096348+0000","last_active":"2024-01-22T05:16:14.103417+0000","last_peered":"2024-01-22T05:16:14.103417+0000","last_clean":"2024-01-22T05:16:14.103417+0000","last_became_active":"2024-01-22T05:16:14.095999+0000","last_became_peered":"2024-01-22T05:16:14.095999+0000","last_unstale":"2024-01-22T05:16:14.103417+0000","last_undegraded":"2024-01-22T05:16:14.103417+0000","last_fullsized":"2024-01-22T05:16:14.103417+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.079038+0000","last_change":"2024-01-22T05:16:13.655070+0000","last_active":"2024-01-22T05:16:14.079038+0000","last_peered":"2024-01-22T05:16:14.079038+0000","last_clean":"2024-01-22T05:16:14.079038+0000","last_became_active":"2024-01-22T05:16:13.654768+0000","last_became_peered":"2024-01-22T05:16:13.654768+0000","last_unstale":"2024-01-22T05:16:14.079038+0000","last_undegraded":"2024-01-22T05:16:14.079038+0000","last_fullsized":"2024-01-22T05:16:14.079038+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":117,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.095620+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:16:14.095620+0000","last_peered":"2024-01-22T05:16:14.095620+0000","last_clean":"2024-01-22T05:16:14.095620+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:16:14.095620+0000","last_undegraded":"2024-01-22T05:16:14.095620+0000","last_fullsized":"2024-01-22T05:16:14.095620+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.109704+0000","last_change":"2024-01-22T05:16:14.104610+0000","last_active":"2024-01-22T05:16:14.109704+0000","last_peered":"2024-01-22T05:16:14.109704+0000","last_clean":"2024-01-22T05:16:14.109704+0000","last_became_active":"2024-01-22T05:16:14.104303+0000","last_became_peered":"2024-01-22T05:16:14.104303+0000","last_unstale":"2024-01-22T05:16:14.109704+0000","last_undegraded":"2024-01-22T05:16:14.109704+0000","last_fullsized":"2024-01-22T05:16:14.109704+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"144'4","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.114695+0000","last_change":"2024-01-22T05:16:13.665309+0000","last_active":"2024-01-22T05:16:14.114695+0000","last_peered":"2024-01-22T05:16:14.114695+0000","last_clean":"2024-01-22T05:16:14.114695+0000","last_became_active":"2024-01-22T05:16:13.665029+0000","last_became_peered":"2024-01-22T05:16:13.665029+0000","last_unstale":"2024-01-22T05:16:14.114695+0000","last_undegraded":"2024-01-22T05:16:14.114695+0000","last_fullsized":"2024-01-22T05:16:14.114695+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.084083+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:16:14.084083+0000","last_peered":"2024-01-22T05:16:14.084083+0000","last_clean":"2024-01-22T05:16:14.084083+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:16:14.084083+0000","last_undegraded":"2024-01-22T05:16:14.084083+0000","last_fullsized":"2024-01-22T05:16:14.084083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.109831+0000","last_change":"2024-01-22T05:16:14.103184+0000","last_active":"2024-01-22T05:16:14.109831+0000","last_peered":"2024-01-22T05:16:14.109831+0000","last_clean":"2024-01-22T05:16:14.109831+0000","last_became_active":"2024-01-22T05:16:14.102869+0000","last_became_peered":"2024-01-22T05:16:14.102869+0000","last_unstale":"2024-01-22T05:16:14.109831+0000","last_undegraded":"2024-01-22T05:16:14.109831+0000","last_fullsized":"2024-01-22T05:16:14.109831+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"144'1","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.107764+0000","last_change":"2024-01-22T05:16:13.649435+0000","last_active":"2024-01-22T05:16:14.107764+0000","last_peered":"2024-01-22T05:16:14.107764+0000","last_clean":"2024-01-22T05:16:14.107764+0000","last_became_active":"2024-01-22T05:16:13.646857+0000","last_became_peered":"2024-01-22T05:16:13.646857+0000","last_unstale":"2024-01-22T05:16:14.107764+0000","last_undegraded":"2024-01-22T05:16:14.107764+0000","last_fullsized":"2024-01-22T05:16:14.107764+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":113,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.084706+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:16:14.084706+0000","last_peered":"2024-01-22T05:16:14.084706+0000","last_clean":"2024-01-22T05:16:14.084706+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:16:14.084706+0000","last_undegraded":"2024-01-22T05:16:14.084706+0000","last_fullsized":"2024-01-22T05:16:14.084706+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.121520+0000","last_change":"2024-01-22T05:16:14.114004+0000","last_active":"2024-01-22T05:16:14.121520+0000","last_peered":"2024-01-22T05:16:14.121520+0000","last_clean":"2024-01-22T05:16:14.121520+0000","last_became_active":"2024-01-22T05:16:14.113666+0000","last_became_peered":"2024-01-22T05:16:14.113666+0000","last_unstale":"2024-01-22T05:16:14.121520+0000","last_undegraded":"2024-01-22T05:16:14.121520+0000","last_fullsized":"2024-01-22T05:16:14.121520+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.095141+0000","last_change":"2024-01-22T05:16:13.657189+0000","last_active":"2024-01-22T05:16:14.095141+0000","last_peered":"2024-01-22T05:16:14.095141+0000","last_clean":"2024-01-22T05:16:14.095141+0000","last_became_active":"2024-01-22T05:16:13.656590+0000","last_became_peered":"2024-01-22T05:16:13.656590+0000","last_unstale":"2024-01-22T05:16:14.095141+0000","last_undegraded":"2024-01-22T05:16:14.095141+0000","last_fullsized":"2024-01-22T05:16:14.095141+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083036+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:16:14.083036+0000","last_peered":"2024-01-22T05:16:14.083036+0000","last_clean":"2024-01-22T05:16:14.083036+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:16:14.083036+0000","last_undegraded":"2024-01-22T05:16:14.083036+0000","last_fullsized":"2024-01-22T05:16:14.083036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.120880+0000","last_change":"2024-01-22T05:16:14.114599+0000","last_active":"2024-01-22T05:16:14.120880+0000","last_peered":"2024-01-22T05:16:14.120880+0000","last_clean":"2024-01-22T05:16:14.120880+0000","last_became_active":"2024-01-22T05:16:14.114143+0000","last_became_peered":"2024-01-22T05:16:14.114143+0000","last_unstale":"2024-01-22T05:16:14.120880+0000","last_undegraded":"2024-01-22T05:16:14.120880+0000","last_fullsized":"2024-01-22T05:16:14.120880+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"144'2","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.122105+0000","last_change":"2024-01-22T05:16:13.665010+0000","last_active":"2024-01-22T05:16:14.122105+0000","last_peered":"2024-01-22T05:16:14.122105+0000","last_clean":"2024-01-22T05:16:14.122105+0000","last_became_active":"2024-01-22T05:16:13.664730+0000","last_became_peered":"2024-01-22T05:16:13.664730+0000","last_unstale":"2024-01-22T05:16:14.122105+0000","last_undegraded":"2024-01-22T05:16:14.122105+0000","last_fullsized":"2024-01-22T05:16:14.122105+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":137,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.079024+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:16:14.079024+0000","last_peered":"2024-01-22T05:16:14.079024+0000","last_clean":"2024-01-22T05:16:14.079024+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:16:14.079024+0000","last_undegraded":"2024-01-22T05:16:14.079024+0000","last_fullsized":"2024-01-22T05:16:14.079024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.110551+0000","last_change":"2024-01-22T05:16:14.105563+0000","last_active":"2024-01-22T05:16:14.110551+0000","last_peered":"2024-01-22T05:16:14.110551+0000","last_clean":"2024-01-22T05:16:14.110551+0000","last_became_active":"2024-01-22T05:16:14.105242+0000","last_became_peered":"2024-01-22T05:16:14.105242+0000","last_unstale":"2024-01-22T05:16:14.110551+0000","last_undegraded":"2024-01-22T05:16:14.110551+0000","last_fullsized":"2024-01-22T05:16:14.110551+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.088679+0000","last_change":"2024-01-22T05:16:13.674304+0000","last_active":"2024-01-22T05:16:14.088679+0000","last_peered":"2024-01-22T05:16:14.088679+0000","last_clean":"2024-01-22T05:16:14.088679+0000","last_became_active":"2024-01-22T05:16:13.672927+0000","last_became_peered":"2024-01-22T05:16:13.672927+0000","last_unstale":"2024-01-22T05:16:14.088679+0000","last_undegraded":"2024-01-22T05:16:14.088679+0000","last_fullsized":"2024-01-22T05:16:14.088679+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":119,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.089895+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:16:14.089895+0000","last_peered":"2024-01-22T05:16:14.089895+0000","last_clean":"2024-01-22T05:16:14.089895+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:16:14.089895+0000","last_undegraded":"2024-01-22T05:16:14.089895+0000","last_fullsized":"2024-01-22T05:16:14.089895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.114888+0000","last_change":"2024-01-22T05:16:14.114093+0000","last_active":"2024-01-22T05:16:14.114888+0000","last_peered":"2024-01-22T05:16:14.114888+0000","last_clean":"2024-01-22T05:16:14.114888+0000","last_became_active":"2024-01-22T05:16:14.113342+0000","last_became_peered":"2024-01-22T05:16:14.113342+0000","last_unstale":"2024-01-22T05:16:14.114888+0000","last_undegraded":"2024-01-22T05:16:14.114888+0000","last_fullsized":"2024-01-22T05:16:14.114888+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.086017+0000","last_change":"2024-01-22T05:16:13.664313+0000","last_active":"2024-01-22T05:16:14.086017+0000","last_peered":"2024-01-22T05:16:14.086017+0000","last_clean":"2024-01-22T05:16:14.086017+0000","last_became_active":"2024-01-22T05:16:13.664034+0000","last_became_peered":"2024-01-22T05:16:13.664034+0000","last_unstale":"2024-01-22T05:16:14.086017+0000","last_undegraded":"2024-01-22T05:16:14.086017+0000","last_fullsized":"2024-01-22T05:16:14.086017+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":113,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083849+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:16:14.083849+0000","last_peered":"2024-01-22T05:16:14.083849+0000","last_clean":"2024-01-22T05:16:14.083849+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:16:14.083849+0000","last_undegraded":"2024-01-22T05:16:14.083849+0000","last_fullsized":"2024-01-22T05:16:14.083849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.119441+0000","last_change":"2024-01-22T05:16:14.111616+0000","last_active":"2024-01-22T05:16:14.119441+0000","last_peered":"2024-01-22T05:16:14.119441+0000","last_clean":"2024-01-22T05:16:14.119441+0000","last_became_active":"2024-01-22T05:16:14.111405+0000","last_became_peered":"2024-01-22T05:16:14.111405+0000","last_unstale":"2024-01-22T05:16:14.119441+0000","last_undegraded":"2024-01-22T05:16:14.119441+0000","last_fullsized":"2024-01-22T05:16:14.119441+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:13.617893+0000","last_clean_scrub_stamp":"2024-01-22T05:16:13.617893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"144'3","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.117608+0000","last_change":"2024-01-22T05:16:13.662799+0000","last_active":"2024-01-22T05:16:14.117608+0000","last_peered":"2024-01-22T05:16:14.117608+0000","last_clean":"2024-01-22T05:16:14.117608+0000","last_became_active":"2024-01-22T05:16:13.662496+0000","last_became_peered":"2024-01-22T05:16:13.662496+0000","last_unstale":"2024-01-22T05:16:14.117608+0000","last_undegraded":"2024-01-22T05:16:14.117608+0000","last_fullsized":"2024-01-22T05:16:14.117608+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:16:12.612793+0000","last_clean_scrub_stamp":"2024-01-22T05:16:12.612793+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":137,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.082502+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:16:14.082502+0000","last_peered":"2024-01-22T05:16:14.082502+0000","last_clean":"2024-01-22T05:16:14.082502+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:16:14.082502+0000","last_undegraded":"2024-01-22T05:16:14.082502+0000","last_fullsized":"2024-01-22T05:16:14.082502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":114,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-01-22T05:16:14.083937+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:16:14.083937+0000","last_peered":"2024-01-22T05:16:14.083937+0000","last_clean":"2024-01-22T05:16:14.083937+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:16:14.083937+0000","last_undegraded":"2024-01-22T05:16:14.083937+0000","last_fullsized":"2024-01-22T05:16:14.083937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307188,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064652,"statfs":{"total":96636764160,"available":96322203648,"internally_reserved":0,"allocated":1814528,"data_stored":900288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.157,"15min":1.0609999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.46500000000000002},"max":{"1min":1.3340000000000001,"5min":14.779999999999999,"15min":14.779999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":1.9199999999999999,"15min":1.3480000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2989999999999999,"5min":76.662000000000006,"15min":76.662000000000006},"last":0.66600000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0569999999999999,"15min":1.016},"min":{"1min":0.71899999999999997,"5min":0.59199999999999997,"15min":0.54400000000000004},"max":{"1min":1.27,"5min":4.9269999999999996,"15min":4.9269999999999996},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.214,"15min":1.194},"min":{"1min":0.85299999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.383,"5min":12.691000000000001,"15min":12.691000000000001},"last":1.2250000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.093,"15min":1.1080000000000001},"min":{"1min":0.79400000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3200000000000001,"5min":1.984,"15min":2.5150000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.276,"15min":1.2090000000000001},"min":{"1min":0.85499999999999998,"5min":0.73799999999999999,"15min":0.68899999999999995},"max":{"1min":1.349,"5min":15.036,"15min":15.036},"last":1.3149999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.8839999999999999,"15min":1.4510000000000001},"min":{"1min":0.89000000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3839999999999999,"5min":64.983999999999995,"15min":64.983999999999995},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.3500000000000001,"15min":1.2809999999999999},"min":{"1min":0.94299999999999995,"5min":0.78300000000000003,"15min":0.60199999999999998},"max":{"1min":1.5249999999999999,"5min":15.073,"15min":15.073},"last":1.1359999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.282,"15min":1.149},"min":{"1min":0.76000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.494,"5min":22.239000000000001,"15min":22.239000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.4039999999999999,"15min":1.2470000000000001},"min":{"1min":0.77100000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.5269999999999999,"5min":27.872,"15min":27.872},"last":0.86699999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.8799999999999999,"15min":1.431},"min":{"1min":0.86399999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.7549999999999999,"5min":65.652000000000001,"15min":65.652000000000001},"last":1.24},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.232,"15min":1.2529999999999999},"min":{"1min":0.91200000000000003,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.7749999999999999,"5min":2.1629999999999998,"15min":3.625},"last":1.0669999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.234,"15min":1.242},"min":{"1min":0.82399999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.573,"5min":6.9939999999999998,"15min":6.9939999999999998},"last":1.097},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.429,"15min":1.3839999999999999},"min":{"1min":1.02,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.7509999999999999,"5min":12.965,"15min":12.965},"last":1.202}]}]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307196,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064644,"statfs":{"total":96636764160,"available":96322195456,"internally_reserved":0,"allocated":1822720,"data_stored":900364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:15:57 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.012,"15min":1.29},"min":{"1min":0.70799999999999996,"5min":0.52400000000000002,"15min":0.35999999999999999},"max":{"1min":1.5249999999999999,"5min":1.679,"15min":77.745000000000005},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.111,"5min":1.0580000000000001,"15min":1.0800000000000001},"min":{"1min":0.75800000000000001,"5min":0.54700000000000004,"15min":0.44},"max":{"1min":1.468,"5min":5.0359999999999996,"15min":13.555999999999999},"last":1.2310000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:15:57 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.121,"15min":1.1200000000000001},"min":{"1min":0.83699999999999997,"5min":0.503,"15min":0.40000000000000002},"max":{"1min":1.4239999999999999,"5min":5.9210000000000003,"15min":15.499000000000001},"last":1.004},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0920000000000001,"15min":1.171},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.702,"5min":3.6080000000000001,"15min":7.7629999999999999},"last":1.284}]},{"osd":2,"last update":"Mon Jan 22 05:15:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.173,"15min":1.159},"min":{"1min":0.85799999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.667,"5min":2.653,"15min":3.0960000000000001},"last":1.456},{"interface":"front","average":{"1min":1.139,"5min":1.1739999999999999,"15min":1.1359999999999999},"min":{"1min":0.68999999999999995,"5min":0.68600000000000005,"15min":0.38200000000000001},"max":{"1min":1.7390000000000001,"5min":4.9660000000000002,"15min":4.9660000000000002},"last":1.345}]},{"osd":3,"last update":"Mon Jan 22 05:15:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.21,"15min":1.4790000000000001},"min":{"1min":0.80500000000000005,"5min":0.66700000000000004,"15min":0.59299999999999997},"max":{"1min":2.343,"5min":5.0750000000000002,"15min":102.08199999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.2050000000000001,"15min":1.2270000000000001},"min":{"1min":0.84399999999999997,"5min":0.66300000000000003,"15min":0.374},"max":{"1min":1.4610000000000001,"5min":6.0129999999999999,"15min":15.468},"last":0.90900000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:15:57 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.175,"15min":1.1339999999999999},"min":{"1min":0.71699999999999997,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.631,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2370000000000001,"15min":1.157},"min":{"1min":0.79000000000000004,"5min":0.60099999999999998,"15min":0.48299999999999998},"max":{"1min":2.5489999999999999,"5min":5.1200000000000001,"15min":5.1200000000000001},"last":1.4299999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:15:57 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.1679999999999999,"15min":1.2509999999999999},"min":{"1min":0.65000000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.7829999999999999,"5min":5.2930000000000001,"15min":30.533000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.80500000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5700000000000001,"5min":2.6179999999999999,"15min":3.875},"last":1.375}]},{"osd":7,"last update":"Mon Jan 22 05:15:57 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.4379999999999999,"15min":1.4399999999999999},"min":{"1min":0.82899999999999996,"5min":0.72599999999999998,"15min":0.42699999999999999},"max":{"1min":2.7490000000000001,"5min":8.4190000000000005,"15min":23.547999999999998},"last":1.583},{"interface":"front","average":{"1min":1.333,"5min":1.4490000000000001,"15min":1.579},"min":{"1min":0.92000000000000004,"5min":0.60199999999999998,"15min":0.495},"max":{"1min":1.5800000000000001,"5min":7.46,"15min":63.737000000000002},"last":1.486}]}]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307188,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064652,"statfs":{"total":96636764160,"available":96322203648,"internally_reserved":0,"allocated":1814528,"data_stored":900240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:16:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.0249999999999999,"15min":1.01},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.3939999999999999,"5min":1.651,"15min":2.0609999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.04,"15min":1.0609999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.3129999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:16:00 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.1739999999999999,"15min":1.1890000000000001},"min":{"1min":0.745,"5min":0.67300000000000004,"15min":0.50600000000000001},"max":{"1min":1.454,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.488},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.147,"15min":1.2210000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.5549999999999999,"5min":1.9930000000000001,"15min":2.0209999999999999},"last":1.53}]},{"osd":2,"last update":"Mon Jan 22 05:16:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.101,"15min":1.137},"min":{"1min":0.85299999999999998,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.8089999999999999,"5min":1.9219999999999999,"15min":1.925},"last":1.242},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.101,"15min":1.121},"min":{"1min":0.71799999999999997,"5min":0.67100000000000004,"15min":0.59899999999999998},"max":{"1min":1.375,"5min":1.982,"15min":1.982},"last":1.1950000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:16:00 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.1539999999999999,"15min":1.163},"min":{"1min":0.69799999999999995,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":3.202,"5min":3.202,"15min":3.202},"last":1.431},{"interface":"front","average":{"1min":1.153,"5min":1.1899999999999999,"15min":1.234},"min":{"1min":0.72499999999999998,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.3759999999999999,"5min":4.8819999999999997,"15min":4.8819999999999997},"last":1.3500000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:16:00 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.0509999999999999,"15min":1.1200000000000001},"min":{"1min":0.65400000000000003,"5min":0.51700000000000002,"15min":0.44400000000000001},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0960000000000001,"15min":1.206},"min":{"1min":0.68799999999999994,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.448,"5min":2.081,"15min":2.081},"last":1.1279999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:16:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.125,"15min":1.2430000000000001},"min":{"1min":0.68100000000000005,"5min":0.63600000000000001,"15min":0.58199999999999996},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":2.2010000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.204,"15min":1.26},"min":{"1min":0.70699999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"max":{"1min":1.5489999999999999,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.2829999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:16:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2270000000000001,"15min":1.3320000000000001},"min":{"1min":0.78000000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.74,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.248,"15min":1.365},"min":{"1min":0.75600000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.7330000000000001,"5min":2.04,"15min":3.1840000000000002},"last":1.474}]}]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311284,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060556,"statfs":{"total":96636764160,"available":96318009344,"internally_reserved":0,"allocated":1814528,"data_stored":900288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.0469999999999999,"15min":1.101},"min":{"1min":0.63700000000000001,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.347,"5min":1.726,"15min":2.0150000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.135,"15min":1.125},"min":{"1min":0.91300000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.3520000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:15:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.054,"15min":1.073},"min":{"1min":0.77400000000000002,"5min":0.60499999999999998,"15min":0.53100000000000003},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.7609999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1,"15min":1.095},"min":{"1min":0.52500000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4099999999999999,"5min":1.6870000000000001,"15min":2.194},"last":1.161}]},{"osd":2,"last update":"Mon Jan 22 05:15:47 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.038,"15min":1.0740000000000001},"min":{"1min":0.85499999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3089999999999999,"5min":1.7030000000000001,"15min":5.3390000000000004},"last":1.516},{"interface":"front","average":{"1min":1.129,"5min":1.113,"15min":1.1899999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.504,"5min":1.641,"15min":2.3479999999999999},"last":1.1000000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:15:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.117,"15min":1.1459999999999999},"min":{"1min":0.72899999999999998,"5min":0.59299999999999997,"15min":0.496},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.117},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1040000000000001,"15min":1.1459999999999999},"min":{"1min":0.67700000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.825,"5min":2.2959999999999998,"15min":5.3029999999999999},"last":1.611}]},{"osd":5,"last update":"Mon Jan 22 05:15:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0609999999999999,"15min":1.143},"min":{"1min":0.67700000000000005,"5min":0.57799999999999996,"15min":0.54100000000000004},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":2.0790000000000002},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.113,"15min":1.1299999999999999},"min":{"1min":0.71999999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":2.0030000000000001},"last":1.4410000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:15:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.0980000000000001,"15min":1.1499999999999999},"min":{"1min":0.745,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4650000000000001,"5min":1.5960000000000001,"15min":5.3769999999999998},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.1879999999999999,"15min":1.302},"min":{"1min":0.73699999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":4.4409999999999998},"last":1.488}]},{"osd":7,"last update":"Mon Jan 22 05:15:47 2024","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.288,"15min":1.3220000000000001},"min":{"1min":0.79900000000000004,"5min":0.62,"15min":0.59399999999999997},"max":{"1min":1.8999999999999999,"5min":1.9119999999999999,"15min":2.2839999999999998},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.2609999999999999,"15min":1.3300000000000001},"min":{"1min":0.97099999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.649,"5min":1.8100000000000001,"15min":5.2629999999999999},"last":1.718}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311288,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060552,"statfs":{"total":96636764160,"available":96318005248,"internally_reserved":0,"allocated":1818624,"data_stored":901200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:15:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81699999999999995,"15min":0.876},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.34200000000000003},"max":{"1min":1.2549999999999999,"5min":1.8440000000000001,"15min":14.859},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.90100000000000002,"15min":0.89600000000000002},"min":{"1min":0.622,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":1.804,"5min":2.3519999999999999,"15min":5.0919999999999996},"last":0.57899999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:15:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.91800000000000004,"15min":0.88400000000000001},"min":{"1min":0.64100000000000001,"5min":0.42399999999999999,"15min":0.39300000000000002},"max":{"1min":1.1870000000000001,"5min":6.5570000000000004,"15min":6.5570000000000004},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.95099999999999996,"15min":0.97299999999999998},"min":{"1min":0.53900000000000003,"5min":0.499,"15min":0.48399999999999999},"max":{"1min":1.4119999999999999,"5min":1.9510000000000001,"15min":5.7519999999999998},"last":0.83599999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:15:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.129,"15min":1.1299999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.40600000000000003},"max":{"1min":1.8680000000000001,"5min":2.391,"15min":2.391},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.2070000000000001,"15min":1.1879999999999999},"min":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.44800000000000001},"max":{"1min":1.609,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":1.6259999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:15:44 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.409,"15min":1.329},"min":{"1min":0.94999999999999996,"5min":0.82799999999999996,"15min":0.51700000000000002},"max":{"1min":2.423,"5min":10.858000000000001,"15min":10.858000000000001},"last":1.427},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3839999999999999,"15min":1.347},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.63600000000000001},"max":{"1min":2.3359999999999999,"5min":10.846,"15min":10.846},"last":1.4510000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:15:44 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.3029999999999999,"15min":1.2929999999999999},"min":{"1min":0.83399999999999996,"5min":0.76000000000000001,"15min":0.505},"max":{"1min":1.7709999999999999,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.4079999999999999,"15min":1.381},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.6459999999999999,"5min":12.128,"15min":14.523999999999999},"last":1.331}]},{"osd":6,"last update":"Mon Jan 22 05:15:44 2024","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.345,"15min":1.3740000000000001},"min":{"1min":0.84399999999999997,"5min":0.81699999999999995,"15min":0.56699999999999995},"max":{"1min":2.1819999999999999,"5min":2.2610000000000001,"15min":4.9809999999999999},"last":1.51},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3720000000000001,"15min":1.3959999999999999},"min":{"1min":1.04,"5min":0.85699999999999998,"15min":0.68500000000000005},"max":{"1min":1.71,"5min":1.923,"15min":5.4210000000000003},"last":1.5409999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:15:44 2024","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.361,"15min":1.379},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.986,"5min":2.472,"15min":5.7160000000000002},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.425,"15min":1.4199999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.71299999999999997},"max":{"1min":2.5449999999999999,"5min":6.4279999999999999,"15min":6.4279999999999999},"last":1.6000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311296,"kb_used_data":1784,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060544,"statfs":{"total":96636764160,"available":96317997056,"internally_reserved":0,"allocated":1826816,"data_stored":902308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.77100000000000002,"15min":0.75700000000000001},"min":{"1min":0.43099999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.98699999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.52900000000000003,"5min":0.44600000000000001,"15min":0.373},"max":{"1min":1.093,"5min":1.556,"15min":1.7350000000000001},"last":0.90100000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.875,"15min":0.83899999999999997},"min":{"1min":0.46800000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.534},"last":1.091},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.96899999999999997,"15min":0.94199999999999995},"min":{"1min":0.54600000000000004,"5min":0.43099999999999999,"15min":0.41599999999999998},"max":{"1min":1.2290000000000001,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.173}]},{"osd":3,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.131,"15min":1.107},"min":{"1min":0.64100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2170000000000001,"15min":1.194},"min":{"1min":0.64300000000000002,"5min":0.53900000000000003,"15min":0.51100000000000001},"max":{"1min":3.133,"5min":3.133,"15min":3.133},"last":1.3200000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.2529999999999999,"15min":1.274},"min":{"1min":0.97199999999999998,"5min":0.88500000000000001,"15min":0.59099999999999997},"max":{"1min":1.3959999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4299999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.218}]},{"osd":5,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2190000000000001,"15min":1.206},"min":{"1min":0.90900000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8400000000000001,"5min":1.8440000000000001,"15min":2.3660000000000001},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.2969999999999999,"15min":1.2909999999999999},"min":{"1min":0.94799999999999995,"5min":0.76100000000000001,"15min":0.67000000000000004},"max":{"1min":1.4810000000000001,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.464}]},{"osd":6,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.264,"15min":1.2529999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.532,"5min":1.7749999999999999,"15min":2.1920000000000002},"last":1.141},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.2909999999999999,"15min":1.29},"min":{"1min":0.98499999999999999,"5min":0.629,"15min":0.629},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.4449999999999998},"last":1.236}]},{"osd":7,"last update":"Mon Jan 22 05:15:50 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3600000000000001,"15min":1.3460000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9390000000000001,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4039999999999999,"15min":1.4079999999999999},"min":{"1min":1.05,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.5059999999999998},"last":1.647}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307184,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064656,"statfs":{"total":96636764160,"available":96322207744,"internally_reserved":0,"allocated":1810432,"data_stored":900218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:15:49 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.85399999999999998,"15min":0.86499999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.167,"5min":1.911,"15min":3.4119999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.99199999999999999,"15min":0.997},"min":{"1min":0.61699999999999999,"5min":0.42899999999999999,"15min":0.41099999999999998},"max":{"1min":1.2250000000000001,"5min":1.8680000000000001,"15min":2.101},"last":0.95699999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:15:49 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0109999999999999,"15min":1.0009999999999999},"min":{"1min":0.64600000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.492,"5min":2.169,"15min":2.169},"last":1.153},{"interface":"front","average":{"1min":1.04,"5min":1.0609999999999999,"15min":1.0449999999999999},"min":{"1min":0.63900000000000001,"5min":0.59099999999999997,"15min":0.46899999999999997},"max":{"1min":1.5,"5min":2.024,"15min":2.024},"last":1.0980000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:15:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.028,"15min":1.0229999999999999},"min":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.38900000000000001},"max":{"1min":1.3540000000000001,"5min":1.7130000000000001,"15min":4.665},"last":1.244},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.98499999999999999,"15min":0.93799999999999994},"min":{"1min":0.63300000000000001,"5min":0.45000000000000001,"15min":0.41899999999999998},"max":{"1min":1.391,"5min":4.1319999999999997,"15min":5.5830000000000002},"last":0.78100000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:15:49 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.1859999999999999,"15min":1.2470000000000001},"min":{"1min":0.80200000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5649999999999999,"5min":2.2509999999999999,"15min":15.76},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2569999999999999,"15min":1.319},"min":{"1min":0.97099999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.714,"5min":1.9630000000000001,"15min":16.975000000000001},"last":1.3100000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:15:49 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.2569999999999999,"15min":1.218},"min":{"1min":0.93100000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.7410000000000001,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.2849999999999999,"15min":1.28},"min":{"1min":1.0600000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6319999999999999,"5min":2.3330000000000002,"15min":2.52},"last":1.8420000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:15:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.242,"15min":1.256},"min":{"1min":0.96799999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6399999999999999,"5min":4.359,"15min":4.359},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.343,"15min":1.339},"min":{"1min":0.84099999999999997,"5min":0.71899999999999997,"15min":0.68799999999999994},"max":{"1min":1.6830000000000001,"5min":2.5569999999999999,"15min":2.5569999999999999},"last":1.895}]},{"osd":7,"last update":"Mon Jan 22 05:15:49 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3240000000000001,"15min":1.3560000000000001},"min":{"1min":0.92700000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.8999999999999999,"5min":2.0019999999999998,"15min":4.4329999999999998},"last":1.357},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.341,"15min":1.353},"min":{"1min":1.081,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9259999999999999,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":1.3240000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307200,"kb_used_data":1784,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064640,"statfs":{"total":96636764160,"available":96322191360,"internally_reserved":0,"allocated":1826816,"data_stored":901450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.876,"15min":0.92200000000000004},"min":{"1min":0.53800000000000003,"5min":0.41199999999999998,"15min":0.28699999999999998},"max":{"1min":1.4219999999999999,"5min":1.972,"15min":15.273},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.90700000000000003,"15min":0.93899999999999995},"min":{"1min":0.52500000000000002,"5min":0.502,"15min":0.34499999999999997},"max":{"1min":1.173,"5min":1.698,"15min":4.4009999999999998},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Jan 22 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.0149999999999999,"15min":1.0720000000000001},"min":{"1min":0.53200000000000003,"5min":0.48199999999999998,"15min":0.46400000000000002},"max":{"1min":1.536,"5min":1.6459999999999999,"15min":15.473000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.0269999999999999,"15min":1.018},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.248,"5min":1.794,"15min":1.7989999999999999},"last":1.0760000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.96999999999999997,"15min":0.99399999999999999},"min":{"1min":0.54800000000000004,"5min":0.40000000000000002,"15min":0.39000000000000001},"max":{"1min":1.456,"5min":1.609,"15min":5.3970000000000002},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.153,"15min":1.206},"min":{"1min":0.58199999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.79,"5min":2.2349999999999999,"15min":15.439},"last":1.103}]},{"osd":4,"last update":"Mon Jan 22 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2170000000000001,"15min":1.2829999999999999},"min":{"1min":0.81399999999999995,"5min":0.66200000000000003,"15min":0.61399999999999999},"max":{"1min":1.399,"5min":2.1280000000000001,"15min":5.1799999999999997},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.25,"5min":1.214,"15min":1.224},"min":{"1min":0.72199999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.738,"5min":1.7909999999999999,"15min":3.4340000000000002},"last":1.298}]},{"osd":5,"last update":"Mon Jan 22 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.258,"15min":1.3},"min":{"1min":0.85199999999999998,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":3.548},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3360000000000001,"15min":1.357},"min":{"1min":0.99399999999999999,"5min":0.75900000000000001,"15min":0.59499999999999997},"max":{"1min":1.7210000000000001,"5min":2.2309999999999999,"15min":2.823},"last":1.274}]},{"osd":6,"last update":"Mon Jan 22 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.367,"15min":1.4390000000000001},"min":{"1min":1.113,"5min":0.81399999999999995,"15min":0.59099999999999997},"max":{"1min":1.7909999999999999,"5min":2.0950000000000002,"15min":15.4},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.333,"15min":1.417},"min":{"1min":0.85699999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.714,"5min":2.105,"15min":7.1349999999999998},"last":1.1859999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3899999999999999,"15min":1.4870000000000001},"min":{"1min":0.95499999999999996,"5min":0.91400000000000003,"15min":0.79900000000000004},"max":{"1min":1.6659999999999999,"5min":2.1819999999999999,"15min":5.29},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.367,"15min":1.3839999999999999},"min":{"1min":1.002,"5min":0.81799999999999995,"15min":0.752},"max":{"1min":1.8360000000000001,"5min":2.1869999999999998,"15min":2.7269999999999999},"last":1.04}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:16:19.081 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:16:19.081 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-22T05:16:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.297+0000 7f050ee00700 1 Processor -- start 2024-01-22T05:16:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.297+0000 7f050ee00700 1 -- start start 2024-01-22T05:16:19.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.301+0000 7f050ee00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f05080626e0 0x7f0508062ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:19.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.301+0000 7f050ee00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0508062fb0 con 0x7f05081578a0 2024-01-22T05:16:19.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.301+0000 7f050ee00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0508158690 con 0x7f0508068e80 2024-01-22T05:16:19.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.301+0000 7f050ee00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0508063270 con 0x7f05080626e0 2024-01-22T05:16:19.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.301+0000 7f0507400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f05081578a0 0x7f0508154290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45534/0 (socket says 172.21.15.49:45534) 2024-01-22T05:16:19.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.301+0000 7f0507400700 1 -- 172.21.15.49:0/3758654459 learned_addr learned my addr 172.21.15.49:0/3758654459 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:19.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.301+0000 7f0507e00700 1 --2- 172.21.15.49:0/3758654459 >> v2:172.21.15.110:3300/0 conn(0x7f05080626e0 0x7f0508062ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:19.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.301+0000 7f0506a00700 1 -- 172.21.15.49:0/3758654459 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740697086 0 0) 0x7f0508062fb0 con 0x7f05081578a0 2024-01-22T05:16:19.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.301+0000 7f0506a00700 1 -- 172.21.15.49:0/3758654459 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04e80033f0 con 0x7f05081578a0 2024-01-22T05:16:19.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.301+0000 7f0507e00700 1 -- 172.21.15.49:0/3758654459 >> v1:172.21.15.110:6789/0 conn(0x7f0508068e80 legacy=0x7f05081549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.301+0000 7f0507e00700 1 -- 172.21.15.49:0/3758654459 >> v1:172.21.15.49:6789/0 conn(0x7f05081578a0 legacy=0x7f0508154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.301+0000 7f0507e00700 1 -- 172.21.15.49:0/3758654459 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0508063550 con 0x7f05080626e0 2024-01-22T05:16:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.301+0000 7f0507e00700 1 --2- 172.21.15.49:0/3758654459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05080626e0 0x7f0508062ac0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f04f8009760 tx=0x7f04f8009060).ready entity=mon.1 client_cookie=600c2527fa879eae server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.305+0000 7f0506a00700 1 -- 172.21.15.49:0/3758654459 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f800f510 con 0x7f05080626e0 2024-01-22T05:16:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.305+0000 7f0506a00700 1 -- 172.21.15.49:0/3758654459 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f800f670 con 0x7f05080626e0 2024-01-22T05:16:19.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.305+0000 7f0506a00700 1 -- 172.21.15.49:0/3758654459 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f800f9f0 con 0x7f05080626e0 2024-01-22T05:16:19.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.305+0000 7f050ee00700 1 -- 172.21.15.49:0/3758654459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05080626e0 msgr2=0x7f0508062ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.305+0000 7f050ee00700 1 --2- 172.21.15.49:0/3758654459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05080626e0 0x7f0508062ac0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f04f8009760 tx=0x7f04f8009060).stop 2024-01-22T05:16:19.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.305+0000 7f050ee00700 1 -- 172.21.15.49:0/3758654459 shutdown_connections 2024-01-22T05:16:19.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.305+0000 7f050ee00700 1 --2- 172.21.15.49:0/3758654459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05080626e0 0x7f0508062ac0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.305+0000 7f050ee00700 1 -- 172.21.15.49:0/3758654459 >> 172.21.15.49:0/3758654459 conn(0x7f05080c3900 msgr2=0x7f05080c3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:19.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.305+0000 7f050ee00700 1 -- 172.21.15.49:0/3758654459 shutdown_connections 2024-01-22T05:16:19.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.305+0000 7f050ee00700 1 -- 172.21.15.49:0/3758654459 wait complete. 2024-01-22T05:16:19.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.309+0000 7f050ee00700 1 Processor -- start 2024-01-22T05:16:19.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.309+0000 7f050ee00700 1 -- start start 2024-01-22T05:16:19.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.309+0000 7f050ee00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05080626e0 0x7f050814f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:19.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.309+0000 7f050ee00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0508068e80 0x7f0508156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:19.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.309+0000 7f050ee00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05081578a0 0x7f05080beed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:19.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.309+0000 7f050ee00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0508152890 con 0x7f05081578a0 2024-01-22T05:16:19.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.309+0000 7f050ee00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0508151c80 con 0x7f05080626e0 2024-01-22T05:16:19.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.309+0000 7f050ee00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0508151f60 con 0x7f0508068e80 2024-01-22T05:16:19.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.309+0000 7f050ce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05081578a0 0x7f05080beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:19.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.309+0000 7f050ce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05081578a0 0x7f05080beed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34234/0 (socket says 172.21.15.49:34234) 2024-01-22T05:16:19.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.309+0000 7f050ce00700 1 -- 172.21.15.49:0/431289374 learned_addr learned my addr 172.21.15.49:0/431289374 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:19.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.309+0000 7f0507e00700 1 --2- 172.21.15.49:0/431289374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05080626e0 0x7f050814f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:19.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.309+0000 7f0507400700 1 --2- 172.21.15.49:0/431289374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0508068e80 0x7f0508156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:19.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.313+0000 7f050ce00700 1 -- 172.21.15.49:0/431289374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0508068e80 msgr2=0x7f0508156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.313+0000 7f050ce00700 1 --2- 172.21.15.49:0/431289374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0508068e80 0x7f0508156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.313+0000 7f050ce00700 1 -- 172.21.15.49:0/431289374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05080626e0 msgr2=0x7f050814f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.313+0000 7f050ce00700 1 --2- 172.21.15.49:0/431289374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05080626e0 0x7f050814f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.313+0000 7f050ce00700 1 -- 172.21.15.49:0/431289374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f80092a0 con 0x7f05081578a0 2024-01-22T05:16:19.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.313+0000 7f0507e00700 1 --2- 172.21.15.49:0/431289374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05080626e0 0x7f050814f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:19.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.313+0000 7f050ce00700 1 --2- 172.21.15.49:0/431289374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05081578a0 0x7f05080beed0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f0500002230 tx=0x7f05000015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:19.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.313+0000 7f04ff400700 1 -- 172.21.15.49:0/431289374 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000e4a0 con 0x7f05081578a0 2024-01-22T05:16:19.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.313+0000 7f04ff400700 1 -- 172.21.15.49:0/431289374 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050000e600 con 0x7f05081578a0 2024-01-22T05:16:19.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.313+0000 7f04ff400700 1 -- 172.21.15.49:0/431289374 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000e980 con 0x7f05081578a0 2024-01-22T05:16:19.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.313+0000 7f050ee00700 1 -- 172.21.15.49:0/431289374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0508152240 con 0x7f05081578a0 2024-01-22T05:16:19.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.313+0000 7f050ee00700 1 -- 172.21.15.49:0/431289374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0508157190 con 0x7f05081578a0 2024-01-22T05:16:19.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.317+0000 7f050ee00700 1 -- 172.21.15.49:0/431289374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05081526c0 con 0x7f05081578a0 2024-01-22T05:16:19.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.317+0000 7f04ff400700 1 -- 172.21.15.49:0/431289374 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0500012400 con 0x7f05081578a0 2024-01-22T05:16:19.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.317+0000 7f04ff400700 1 --2- 172.21.15.49:0/431289374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04e005a540 0x7f04e005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:19.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.317+0000 7f04ff400700 1 -- 172.21.15.49:0/431289374 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f0500073fc0 con 0x7f05081578a0 2024-01-22T05:16:19.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.317+0000 7f0507e00700 1 --2- 172.21.15.49:0/431289374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04e005a540 0x7f04e005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:19.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.317+0000 7f0507e00700 1 --2- 172.21.15.49:0/431289374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04e005a540 0x7f04e005ca00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f04f8009760 tx=0x7f04f8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:19.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.325+0000 7f04ff400700 1 -- 172.21.15.49:0/431289374 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f05000475d0 con 0x7f05081578a0 2024-01-22T05:16:19.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.545+0000 7f050ee00700 1 -- 172.21.15.49:0/431289374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0508063830 con 0x7f05081578a0 2024-01-22T05:16:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.557+0000 7f04ff400700 1 -- 172.21.15.49:0/431289374 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7f050004abf0 con 0x7f05081578a0 2024-01-22T05:16:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.557+0000 7f050ee00700 1 -- 172.21.15.49:0/431289374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04e005a540 msgr2=0x7f04e005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.557+0000 7f050ee00700 1 --2- 172.21.15.49:0/431289374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04e005a540 0x7f04e005ca00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f04f8009760 tx=0x7f04f8017000).stop 2024-01-22T05:16:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.557+0000 7f050ee00700 1 -- 172.21.15.49:0/431289374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05081578a0 msgr2=0x7f05080beed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.557+0000 7f050ee00700 1 --2- 172.21.15.49:0/431289374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05081578a0 0x7f05080beed0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f0500002230 tx=0x7f05000015e0).stop 2024-01-22T05:16:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.561+0000 7f050ee00700 1 -- 172.21.15.49:0/431289374 shutdown_connections 2024-01-22T05:16:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.561+0000 7f050ee00700 1 --2- 172.21.15.49:0/431289374 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04e005a540 0x7f04e005ca00 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.561+0000 7f050ee00700 1 --2- 172.21.15.49:0/431289374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05081578a0 0x7f05080beed0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.561+0000 7f050ee00700 1 --2- 172.21.15.49:0/431289374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0508068e80 0x7f0508156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.561+0000 7f050ee00700 1 --2- 172.21.15.49:0/431289374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05080626e0 0x7f050814f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.561+0000 7f050ee00700 1 -- 172.21.15.49:0/431289374 >> 172.21.15.49:0/431289374 conn(0x7f05080c3900 msgr2=0x7f05080c1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:19.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.561+0000 7f050ee00700 1 -- 172.21.15.49:0/431289374 shutdown_connections 2024-01-22T05:16:19.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.561+0000 7f050ee00700 1 -- 172.21.15.49:0/431289374 wait complete. 2024-01-22T05:16:19.563 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-01-22T05:16:19.581 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:16:19.615 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-22T05:16:19.617+0000 7ff977e00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:16:19.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.733+0000 7fd33f800700 1 Processor -- start 2024-01-22T05:16:19.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.733+0000 7fd33f800700 1 -- start start 2024-01-22T05:16:19.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.737+0000 7fd33f800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd338065240 0x7fd3380644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:19.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.737+0000 7fd33f800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33815c7d0 con 0x7fd338065620 2024-01-22T05:16:19.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.737+0000 7fd33f800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3380c2700 con 0x7fd3380649e0 2024-01-22T05:16:19.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.737+0000 7fd33f800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3380c29a0 con 0x7fd338065240 2024-01-22T05:16:19.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.737+0000 7fd33ce00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd338065240 0x7fd3380644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:19.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.737+0000 7fd337e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd338065620 0x7fd33815b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45540/0 (socket says 172.21.15.49:45540) 2024-01-22T05:16:19.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.737+0000 7fd337e00700 1 -- 172.21.15.49:0/1519158613 learned_addr learned my addr 172.21.15.49:0/1519158613 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:19.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.737+0000 7fd337400700 1 -- 172.21.15.49:0/1519158613 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678870751 0 0) 0x7fd3380c2700 con 0x7fd3380649e0 2024-01-22T05:16:19.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.737+0000 7fd337400700 1 -- 172.21.15.49:0/1519158613 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3180033f0 con 0x7fd3380649e0 2024-01-22T05:16:19.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.737+0000 7fd33ce00700 1 -- 172.21.15.49:0/1519158613 >> v1:172.21.15.110:6789/0 conn(0x7fd3380649e0 legacy=0x7fd33815c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.737+0000 7fd33ce00700 1 -- 172.21.15.49:0/1519158613 >> v1:172.21.15.49:6789/0 conn(0x7fd338065620 legacy=0x7fd33815b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.737+0000 7fd33ce00700 1 -- 172.21.15.49:0/1519158613 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3380c2c80 con 0x7fd338065240 2024-01-22T05:16:19.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.737+0000 7fd33ce00700 1 --2- 172.21.15.49:0/1519158613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd338065240 0x7fd3380644f0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7fd328009760 tx=0x7fd328009060).ready entity=mon.0 client_cookie=32175defefd3ae0e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:19.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.737+0000 7fd337400700 1 -- 172.21.15.49:0/1519158613 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32800f510 con 0x7fd338065240 2024-01-22T05:16:19.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.741+0000 7fd337400700 1 -- 172.21.15.49:0/1519158613 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32800f670 con 0x7fd338065240 2024-01-22T05:16:19.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.741+0000 7fd337400700 1 -- 172.21.15.49:0/1519158613 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32800f9f0 con 0x7fd338065240 2024-01-22T05:16:19.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.741+0000 7fd33f800700 1 -- 172.21.15.49:0/1519158613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd338065240 msgr2=0x7fd3380644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.741+0000 7fd33f800700 1 --2- 172.21.15.49:0/1519158613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd338065240 0x7fd3380644f0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7fd328009760 tx=0x7fd328009060).stop 2024-01-22T05:16:19.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.741+0000 7fd33f800700 1 -- 172.21.15.49:0/1519158613 shutdown_connections 2024-01-22T05:16:19.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.741+0000 7fd33f800700 1 --2- 172.21.15.49:0/1519158613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd338065240 0x7fd3380644f0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.741+0000 7fd33f800700 1 -- 172.21.15.49:0/1519158613 >> 172.21.15.49:0/1519158613 conn(0x7fd3380c87f0 msgr2=0x7fd3380c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.741+0000 7fd33f800700 1 -- 172.21.15.49:0/1519158613 shutdown_connections 2024-01-22T05:16:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.741+0000 7fd33f800700 1 -- 172.21.15.49:0/1519158613 wait complete. 2024-01-22T05:16:19.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.745+0000 7fd33f800700 1 Processor -- start 2024-01-22T05:16:19.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.745+0000 7fd33f800700 1 -- start start 2024-01-22T05:16:19.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.745+0000 7fd33f800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3380649e0 0x7fd338067a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:19.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.745+0000 7fd33f800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd338065240 0x7fd338067f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:19.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.745+0000 7fd33f800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd338065620 0x7fd3380a8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:19.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.745+0000 7fd33f800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd338068470 con 0x7fd3380649e0 2024-01-22T05:16:19.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.745+0000 7fd33f800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33815bee0 con 0x7fd338065240 2024-01-22T05:16:19.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.745+0000 7fd33f800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33815ae40 con 0x7fd338065620 2024-01-22T05:16:19.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.745+0000 7fd33ce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3380649e0 0x7fd338067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:19.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.745+0000 7fd33ce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3380649e0 0x7fd338067a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34254/0 (socket says 172.21.15.49:34254) 2024-01-22T05:16:19.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.745+0000 7fd33ce00700 1 -- 172.21.15.49:0/4095562629 learned_addr learned my addr 172.21.15.49:0/4095562629 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:19.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.745+0000 7fd337e00700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd338065240 0x7fd338067f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:19.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.745+0000 7fd33e200700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd338065620 0x7fd3380a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:19.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.749+0000 7fd33ce00700 1 -- 172.21.15.49:0/4095562629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd338065620 msgr2=0x7fd3380a8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.749+0000 7fd33ce00700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd338065620 0x7fd3380a8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.749+0000 7fd33ce00700 1 -- 172.21.15.49:0/4095562629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd338065240 msgr2=0x7fd338067f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.749+0000 7fd33ce00700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd338065240 0x7fd338067f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.749+0000 7fd33ce00700 1 -- 172.21.15.49:0/4095562629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3280092a0 con 0x7fd3380649e0 2024-01-22T05:16:19.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.749+0000 7fd33e200700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd338065620 0x7fd3380a8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:19.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.749+0000 7fd337e00700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd338065240 0x7fd338067f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:19.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.749+0000 7fd33ce00700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3380649e0 0x7fd338067a90 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7fd328009e00 tx=0x7fd328017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:19.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.749+0000 7fd32fe00700 1 -- 172.21.15.49:0/4095562629 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32800f510 con 0x7fd3380649e0 2024-01-22T05:16:19.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.749+0000 7fd32fe00700 1 -- 172.21.15.49:0/4095562629 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32800f7e0 con 0x7fd3380649e0 2024-01-22T05:16:19.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.749+0000 7fd32fe00700 1 -- 172.21.15.49:0/4095562629 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32801b660 con 0x7fd3380649e0 2024-01-22T05:16:19.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.749+0000 7fd33f800700 1 -- 172.21.15.49:0/4095562629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33815b120 con 0x7fd3380649e0 2024-01-22T05:16:19.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.749+0000 7fd33f800700 1 -- 172.21.15.49:0/4095562629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33815b6e0 con 0x7fd3380649e0 2024-01-22T05:16:19.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.749+0000 7fd33f800700 1 -- 172.21.15.49:0/4095562629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd338047060 con 0x7fd3380649e0 2024-01-22T05:16:19.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.753+0000 7fd32fe00700 1 -- 172.21.15.49:0/4095562629 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd32801ba10 con 0x7fd3380649e0 2024-01-22T05:16:19.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.753+0000 7fd32fe00700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd31005a510 0x7fd31005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:19.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.753+0000 7fd32fe00700 1 -- 172.21.15.49:0/4095562629 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd328076360 con 0x7fd3380649e0 2024-01-22T05:16:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.753+0000 7fd337e00700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd31005a510 0x7fd31005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.753+0000 7fd337e00700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd31005a510 0x7fd31005c9d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fd33814a260 tx=0x7fd320000bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:19.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.757+0000 7fd32fe00700 1 -- 172.21.15.49:0/4095562629 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd3280499e0 con 0x7fd3380649e0 2024-01-22T05:16:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.965+0000 7fd33f800700 1 -- 172.21.15.49:0/4095562629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3380c2f60 con 0x7fd3380649e0 2024-01-22T05:16:19.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.965+0000 7fd32fe00700 1 -- 172.21.15.49:0/4095562629 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4500 (secure 0 0 0) 0x7fd32804d000 con 0x7fd3380649e0 2024-01-22T05:16:19.967 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:19.967 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":114,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":8826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:16:17.362338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/4015076184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":4015076184},{"type":"v1","addr":"172.21.15.49:6837","nonce":4015076184}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:16:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.969+0000 7fd33f800700 1 -- 172.21.15.49:0/4095562629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd31005a510 msgr2=0x7fd31005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.969+0000 7fd33f800700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd31005a510 0x7fd31005c9d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fd33814a260 tx=0x7fd320000bc0).stop 2024-01-22T05:16:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.969+0000 7fd33f800700 1 -- 172.21.15.49:0/4095562629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3380649e0 msgr2=0x7fd338067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.969+0000 7fd33f800700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3380649e0 0x7fd338067a90 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7fd328009e00 tx=0x7fd328017000).stop 2024-01-22T05:16:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.969+0000 7fd33f800700 1 -- 172.21.15.49:0/4095562629 shutdown_connections 2024-01-22T05:16:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.969+0000 7fd33f800700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd31005a510 0x7fd31005c9d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.969+0000 7fd33f800700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd338065620 0x7fd3380a8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.969+0000 7fd33f800700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd338065240 0x7fd338067f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.969+0000 7fd33f800700 1 --2- 172.21.15.49:0/4095562629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3380649e0 0x7fd338067a90 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:19.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.969+0000 7fd33f800700 1 -- 172.21.15.49:0/4095562629 >> 172.21.15.49:0/4095562629 conn(0x7fd3380c87f0 msgr2=0x7fd3380ad4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:19.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.969+0000 7fd33f800700 1 -- 172.21.15.49:0/4095562629 shutdown_connections 2024-01-22T05:16:19.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:19.969+0000 7fd33f800700 1 -- 172.21.15.49:0/4095562629 wait complete. 2024-01-22T05:16:19.974 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 114 2024-01-22T05:16:20.395 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 114, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:16:14.068057+0000', 'modified': '2024-01-22T05:16:17.362338+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8829}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8829': {'gid': 8829, 'name': 'a', 'rank': 0, 'incarnation': 110, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6837/4015076184', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6835', 'nonce': 4015076184}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 4015076184}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:16:20.395 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:16:20.395 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-22T05:16:20.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.556+0000 7f2c4e600700 1 Processor -- start 2024-01-22T05:16:20.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.556+0000 7f2c4e600700 1 -- start start 2024-01-22T05:16:20.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c4e600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c480a8740 0x7f2c480a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c4e600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c480c1a40 con 0x7f2c480c1ed0 2024-01-22T05:16:20.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c4e600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c480a90b0 con 0x7f2c48155d20 2024-01-22T05:16:20.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c4e600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48159310 con 0x7f2c480a8740 2024-01-22T05:16:20.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c47e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2c480c1ed0 0x7f2c480c2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45546/0 (socket says 172.21.15.49:45546) 2024-01-22T05:16:20.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c47e00700 1 -- 172.21.15.49:0/767829840 learned_addr learned my addr 172.21.15.49:0/767829840 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:20.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46a00700 1 --2- 172.21.15.49:0/767829840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c480a8740 0x7f2c480a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292614829 0 0) 0x7f2c480c1a40 con 0x7f2c480c1ed0 2024-01-22T05:16:20.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c280033f0 con 0x7f2c480c1ed0 2024-01-22T05:16:20.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428678880 0 0) 0x7f2c480a90b0 con 0x7f2c48155d20 2024-01-22T05:16:20.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c480c1a40 con 0x7f2c48155d20 2024-01-22T05:16:20.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1488522422 0 0) 0x7f2c280033f0 con 0x7f2c480c1ed0 2024-01-22T05:16:20.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c480a8740 msgr2=0x7f2c480a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:20.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 --2- 172.21.15.49:0/767829840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c480a8740 0x7f2c480a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 >> v1:172.21.15.110:6789/0 conn(0x7f2c48155d20 legacy=0x7f2c48065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c480c13f0 con 0x7f2c480c1ed0 2024-01-22T05:16:20.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f2c400017f0 con 0x7f2c480c1ed0 2024-01-22T05:16:20.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 >> v1:172.21.15.49:6789/0 conn(0x7f2c480c1ed0 legacy=0x7f2c480c2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 --2- 172.21.15.49:0/767829840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c28003aa0 0x7f2c28003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 --2- 172.21.15.49:0/767829840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28004690 0x7f2c28004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 --2- 172.21.15.49:0/767829840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c28005000 0x7f2c2800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48159310 con 0x7f2c28004690 2024-01-22T05:16:20.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2800bdd0 con 0x7f2c28003aa0 2024-01-22T05:16:20.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2800bf90 con 0x7f2c28005000 2024-01-22T05:16:20.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c46a00700 1 --2- 172.21.15.49:0/767829840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28004690 0x7f2c28004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c47400700 1 --2- 172.21.15.49:0/767829840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c28003aa0 0x7f2c28003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.560+0000 7f2c47e00700 1 --2- 172.21.15.49:0/767829840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c28005000 0x7f2c2800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c46a00700 1 -- 172.21.15.49:0/767829840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c28005000 msgr2=0x7f2c2800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:20.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c46a00700 1 --2- 172.21.15.49:0/767829840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c28005000 0x7f2c2800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c46a00700 1 -- 172.21.15.49:0/767829840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c28003aa0 msgr2=0x7f2c28003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:20.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c46a00700 1 --2- 172.21.15.49:0/767829840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c28003aa0 0x7f2c28003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c46a00700 1 -- 172.21.15.49:0/767829840 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c280033f0 con 0x7f2c28004690 2024-01-22T05:16:20.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c47400700 1 --2- 172.21.15.49:0/767829840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c28003aa0 0x7f2c28003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:20.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c46a00700 1 --2- 172.21.15.49:0/767829840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28004690 0x7f2c28004b10 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f2c48065450 tx=0x7f2c30009060).ready entity=mon.0 client_cookie=5ead95b631cb11f8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:20.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c300123f0 con 0x7f2c28004690 2024-01-22T05:16:20.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c30012550 con 0x7f2c28004690 2024-01-22T05:16:20.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c46000700 1 -- 172.21.15.49:0/767829840 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c300128d0 con 0x7f2c28004690 2024-01-22T05:16:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c4e600700 1 -- 172.21.15.49:0/767829840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28004690 msgr2=0x7f2c28004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c4e600700 1 --2- 172.21.15.49:0/767829840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28004690 0x7f2c28004b10 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f2c48065450 tx=0x7f2c30009060).stop 2024-01-22T05:16:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c47e00700 1 -- 172.21.15.49:0/767829840 reap_dead start 2024-01-22T05:16:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c4e600700 1 -- 172.21.15.49:0/767829840 shutdown_connections 2024-01-22T05:16:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c4e600700 1 -- 172.21.15.49:0/767829840 >> 172.21.15.49:0/767829840 conn(0x7f2c480c6540 msgr2=0x7f2c480c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c4e600700 1 -- 172.21.15.49:0/767829840 shutdown_connections 2024-01-22T05:16:20.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.564+0000 7f2c4e600700 1 -- 172.21.15.49:0/767829840 wait complete. 2024-01-22T05:16:20.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.568+0000 7f2c4e600700 1 Processor -- start 2024-01-22T05:16:20.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.568+0000 7f2c4e600700 1 -- start start 2024-01-22T05:16:20.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c4e600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28004690 0x7f2c4814eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c4e600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c48159d80 0x7f2c4815a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c4e600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c48153c30 0x7f2c481540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c4e600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4814f4e0 con 0x7f2c28004690 2024-01-22T05:16:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c4e600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4815b570 con 0x7f2c48159d80 2024-01-22T05:16:20.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c4e600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4815a6f0 con 0x7f2c48153c30 2024-01-22T05:16:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28004690 0x7f2c4814eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28004690 0x7f2c4814eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34272/0 (socket says 172.21.15.49:34272) 2024-01-22T05:16:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c47400700 1 -- 172.21.15.49:0/285508315 learned_addr learned my addr 172.21.15.49:0/285508315 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c46a00700 1 --2- 172.21.15.49:0/285508315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c48159d80 0x7f2c4815a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c47e00700 1 --2- 172.21.15.49:0/285508315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c48153c30 0x7f2c481540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c47400700 1 -- 172.21.15.49:0/285508315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c48153c30 msgr2=0x7f2c481540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c47400700 1 --2- 172.21.15.49:0/285508315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c48153c30 0x7f2c481540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c47400700 1 -- 172.21.15.49:0/285508315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c48159d80 msgr2=0x7f2c4815a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c47400700 1 --2- 172.21.15.49:0/285508315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c48159d80 0x7f2c4815a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c47400700 1 -- 172.21.15.49:0/285508315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c481545a0 con 0x7f2c28004690 2024-01-22T05:16:20.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c47e00700 1 --2- 172.21.15.49:0/285508315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c48153c30 0x7f2c481540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:20.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c47400700 1 --2- 172.21.15.49:0/285508315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28004690 0x7f2c4814eff0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f2c3800f7d0 tx=0x7f2c38007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:20.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c3ea00700 1 -- 172.21.15.49:0/285508315 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38002240 con 0x7f2c28004690 2024-01-22T05:16:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c3ea00700 1 -- 172.21.15.49:0/285508315 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c380023a0 con 0x7f2c28004690 2024-01-22T05:16:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c4e600700 1 -- 172.21.15.49:0/285508315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c481598c0 con 0x7f2c28004690 2024-01-22T05:16:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c3ea00700 1 -- 172.21.15.49:0/285508315 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38001740 con 0x7f2c28004690 2024-01-22T05:16:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.572+0000 7f2c4e600700 1 -- 172.21.15.49:0/285508315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4815ac40 con 0x7f2c28004690 2024-01-22T05:16:20.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.576+0000 7f2c3ea00700 1 -- 172.21.15.49:0/285508315 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2c38001af0 con 0x7f2c28004690 2024-01-22T05:16:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.576+0000 7f2c3ea00700 1 --2- 172.21.15.49:0/285508315 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c2005a540 0x7f2c2005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.576+0000 7f2c3ea00700 1 -- 172.21.15.49:0/285508315 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2c38074200 con 0x7f2c28004690 2024-01-22T05:16:20.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c58b19740 1 Processor -- start 2024-01-22T05:16:20.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c46a00700 1 --2- 172.21.15.49:0/285508315 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c2005a540 0x7f2c2005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c58b19740 1 -- start start 2024-01-22T05:16:20.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c46a00700 1 --2- 172.21.15.49:0/285508315 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c2005a540 0x7f2c2005ca00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f2c48067460 tx=0x7f2c3001a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:20.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c58b19740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 0x2992d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c58b19740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x2969af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c58b19740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29673a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c58b19740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x28ed410 con 0x296de40 2024-01-22T05:16:20.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c58b19740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x28ed550 con 0x29ae780 2024-01-22T05:16:20.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c58b19740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x28eda00 con 0x29ae3a0 2024-01-22T05:16:20.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c46a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x2969af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c46a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x2969af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34274/0 (socket says 172.21.15.49:34274) 2024-01-22T05:16:20.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c46a00700 1 -- 172.21.15.49:0/500034560 learned_addr learned my addr 172.21.15.49:0/500034560 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c47400700 1 --2- 172.21.15.49:0/500034560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 0x2992d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c47e00700 1 --2- 172.21.15.49:0/500034560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29673a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c46a00700 1 -- 172.21.15.49:0/500034560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 msgr2=0x2992d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c46a00700 1 --2- 172.21.15.49:0/500034560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 0x2992d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c46a00700 1 -- 172.21.15.49:0/500034560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 msgr2=0x29673a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c46a00700 1 --2- 172.21.15.49:0/500034560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29673a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c46a00700 1 -- 172.21.15.49:0/500034560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28e6730 con 0x296de40 2024-01-22T05:16:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c47e00700 1 --2- 172.21.15.49:0/500034560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29673a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.580+0000 7f2c46a00700 1 --2- 172.21.15.49:0/500034560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x2969af0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f2c30009f10 tx=0x7f2c30023000).ready entity=mon.0 client_cookie=9327f1b57a3e2174 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:20.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.584+0000 7f2c37400700 1 -- 172.21.15.49:0/500034560 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30023070 con 0x296de40 2024-01-22T05:16:20.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.584+0000 7f2c37400700 1 -- 172.21.15.49:0/500034560 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3002e070 con 0x296de40 2024-01-22T05:16:20.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.584+0000 7f2c37400700 1 -- 172.21.15.49:0/500034560 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30012e10 con 0x296de40 2024-01-22T05:16:20.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.584+0000 7f2c58b19740 1 -- 172.21.15.49:0/500034560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 msgr2=0x2969af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.584+0000 7f2c58b19740 1 --2- 172.21.15.49:0/500034560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x2969af0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f2c30009f10 tx=0x7f2c30023000).stop 2024-01-22T05:16:20.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.584+0000 7f2c58b19740 1 -- 172.21.15.49:0/500034560 shutdown_connections 2024-01-22T05:16:20.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.584+0000 7f2c58b19740 1 --2- 172.21.15.49:0/500034560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29673a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.584+0000 7f2c58b19740 1 --2- 172.21.15.49:0/500034560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x2969af0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.584+0000 7f2c58b19740 1 --2- 172.21.15.49:0/500034560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 0x2992d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.584+0000 7f2c58b19740 1 -- 172.21.15.49:0/500034560 >> 172.21.15.49:0/500034560 conn(0x274b550 msgr2=0x296d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:20.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.584+0000 7f2c58b19740 1 -- 172.21.15.49:0/500034560 shutdown_connections 2024-01-22T05:16:20.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.584+0000 7f2c58b19740 1 -- 172.21.15.49:0/500034560 wait complete. 2024-01-22T05:16:20.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.584+0000 7f2c58b19740 1 -- start start 2024-01-22T05:16:20.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.588+0000 7f2c58b19740 1 Processor -- start 2024-01-22T05:16:20.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.588+0000 7f2c58b19740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x2996860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.588+0000 7f2c58b19740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 0x2997b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.588+0000 7f2c58b19740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29993a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.588+0000 7f2c58b19740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x28b8650 con 0x296de40 2024-01-22T05:16:20.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.588+0000 7f2c58b19740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2995430 con 0x29ae780 2024-01-22T05:16:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.588+0000 7f2c58b19740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2996e20 con 0x29ae3a0 2024-01-22T05:16:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.588+0000 7f2c58b19740 10 client.0 ll_register_callbacks cb 0x2925020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:16:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.588+0000 7f2c47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x2996860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.588+0000 7f2c47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x2996860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34284/0 (socket says 172.21.15.49:34284) 2024-01-22T05:16:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.588+0000 7f2c47400700 1 -- 172.21.15.49:0/4283333273 learned_addr learned my addr 172.21.15.49:0/4283333273 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c46a00700 1 --2- 172.21.15.49:0/4283333273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 0x2997b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c47e00700 1 --2- 172.21.15.49:0/4283333273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c47400700 1 -- 172.21.15.49:0/4283333273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 msgr2=0x2997b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c47400700 1 --2- 172.21.15.49:0/4283333273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 0x2997b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c47400700 1 -- 172.21.15.49:0/4283333273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 msgr2=0x29993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c47400700 1 --2- 172.21.15.49:0/4283333273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c47400700 1 -- 172.21.15.49:0/4283333273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c280033f0 con 0x296de40 2024-01-22T05:16:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c47400700 1 --2- 172.21.15.49:0/4283333273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x2996860 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f2c38072520 tx=0x7f2c3804d040).ready entity=mon.0 client_cookie=d9f7c881cd3deba6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c2fe00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:16:20.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c2fe00700 1 -- 172.21.15.49:0/4283333273 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38050070 con 0x296de40 2024-01-22T05:16:20.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c2fe00700 1 -- 172.21.15.49:0/4283333273 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2c3804aa20 con 0x296de40 2024-01-22T05:16:20.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c58b19740 1 -- 172.21.15.49:0/4283333273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x28e31a0 con 0x296de40 2024-01-22T05:16:20.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c2fe00700 1 -- 172.21.15.49:0/4283333273 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c38047320 con 0x296de40 2024-01-22T05:16:20.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c58b19740 10 client.8982 fetch_fsmap learned FSMap version 114 2024-01-22T05:16:20.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c58b19740 1 -- 172.21.15.49:0/4283333273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) v3 -- 0x28e1960 con 0x296de40 2024-01-22T05:16:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c2fe00700 1 -- 172.21.15.49:0/4283333273 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x28e31a0 con 0x296de40 2024-01-22T05:16:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c2fe00700 1 -- 172.21.15.49:0/4283333273 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 114) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2c38047480 con 0x296de40 2024-01-22T05:16:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c58b19740 10 client.8982 fetch_fsmap finished waiting for FSMap version 114 2024-01-22T05:16:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c58b19740 10 client.8982 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:16:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c58b19740 20 client.8982 populate_metadata read hostname 'smithi049' 2024-01-22T05:16:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c58b19740 1 --2- 172.21.15.49:0/4283333273 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x2995e30 0x2994b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c58b19740 4 client.8982 mds_command: new command op to 8829 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:16:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c58b19740 1 -- 172.21.15.49:0/4283333273 --> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x28d96f0 con 0x2995e30 2024-01-22T05:16:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c46a00700 1 --2- 172.21.15.49:0/4283333273 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x2995e30 0x2994b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c46a00700 1 --2- 172.21.15.49:0/4283333273 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x2995e30 0x2994b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ed847de2f4bb5263 server_cookie=864bf1e22ebce6a0 in_seq=0 out_seq=0 2024-01-22T05:16:20.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.592+0000 7f2c2fe00700 10 client.8982 ms_handle_connect on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:20.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.596+0000 7f2c2fe00700 1 -- 172.21.15.49:0/4283333273 <== mds.0 v2:172.21.15.49:6835/4015076184 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x28d96f0 con 0x2995e30 2024-01-22T05:16:20.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.596+0000 7f2c2fe00700 10 client.8982 handle_command_reply: tid=0 2024-01-22T05:16:20.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.596+0000 7f2c58b19740 1 client.8982 shutdown 2024-01-22T05:16:20.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.596+0000 7f2c58b19740 1 -- 172.21.15.49:0/4283333273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 msgr2=0x2996860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.596+0000 7f2c58b19740 1 --2- 172.21.15.49:0/4283333273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x2996860 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f2c38072520 tx=0x7f2c3804d040).stop 2024-01-22T05:16:20.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.596+0000 7f2c58b19740 1 -- 172.21.15.49:0/4283333273 shutdown_connections 2024-01-22T05:16:20.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.596+0000 7f2c58b19740 1 --2- 172.21.15.49:0/4283333273 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x2995e30 0x2994b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.596+0000 7f2c58b19740 1 --2- 172.21.15.49:0/4283333273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.596+0000 7f2c58b19740 1 --2- 172.21.15.49:0/4283333273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 0x2997b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.596+0000 7f2c2fe00700 0 client.8982 ms_handle_reset on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.596+0000 7f2c58b19740 1 --2- 172.21.15.49:0/4283333273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x2996860 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.596+0000 7f2c58b19740 1 -- 172.21.15.49:0/4283333273 >> 172.21.15.49:0/4283333273 conn(0x274b550 msgr2=0x29b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.596+0000 7f2c58b19740 1 -- 172.21.15.49:0/4283333273 shutdown_connections 2024-01-22T05:16:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.596+0000 7f2c58b19740 1 -- 172.21.15.49:0/4283333273 wait complete. 2024-01-22T05:16:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.596+0000 7f2c58b19740 20 client.8982 trim_cache size 0 max 16384 2024-01-22T05:16:20.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c58b19740 1 Processor -- start 2024-01-22T05:16:20.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c58b19740 1 -- start start 2024-01-22T05:16:20.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c58b19740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x296c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c58b19740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 0x2991420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c58b19740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c58b19740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x29392c0 con 0x296de40 2024-01-22T05:16:20.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c58b19740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x29add50 con 0x29ae780 2024-01-22T05:16:20.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c58b19740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x28c5f80 con 0x29ae3a0 2024-01-22T05:16:20.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x296c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c47400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x296c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34292/0 (socket says 172.21.15.49:34292) 2024-01-22T05:16:20.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c47400700 1 -- 172.21.15.49:0/1174792214 learned_addr learned my addr 172.21.15.49:0/1174792214 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:20.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c46a00700 1 --2- 172.21.15.49:0/1174792214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 0x2991420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c47e00700 1 --2- 172.21.15.49:0/1174792214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c47400700 1 -- 172.21.15.49:0/1174792214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 msgr2=0x2991420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c47400700 1 --2- 172.21.15.49:0/1174792214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 0x2991420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c47400700 1 -- 172.21.15.49:0/1174792214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 msgr2=0x29c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c47400700 1 --2- 172.21.15.49:0/1174792214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29c1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c47400700 1 -- 172.21.15.49:0/1174792214 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4815b1c0 con 0x296de40 2024-01-22T05:16:20.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.616+0000 7f2c46a00700 1 --2- 172.21.15.49:0/1174792214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 0x2991420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:20.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.620+0000 7f2c47400700 1 --2- 172.21.15.49:0/1174792214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x296c5f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f2c38049880 tx=0x7f2c38050000).ready entity=mon.0 client_cookie=313b7f80ad725271 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:20.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.620+0000 7f2c37e00700 1 -- 172.21.15.49:0/1174792214 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3800f040 con 0x296de40 2024-01-22T05:16:20.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.620+0000 7f2c37e00700 1 -- 172.21.15.49:0/1174792214 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3804aa20 con 0x296de40 2024-01-22T05:16:20.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.620+0000 7f2c37e00700 1 -- 172.21.15.49:0/1174792214 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38047320 con 0x296de40 2024-01-22T05:16:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.620+0000 7f2c58b19740 1 -- 172.21.15.49:0/1174792214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 msgr2=0x296c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.620+0000 7f2c58b19740 1 --2- 172.21.15.49:0/1174792214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x296c5f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f2c38049880 tx=0x7f2c38050000).stop 2024-01-22T05:16:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.620+0000 7f2c58b19740 1 -- 172.21.15.49:0/1174792214 shutdown_connections 2024-01-22T05:16:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.620+0000 7f2c58b19740 1 --2- 172.21.15.49:0/1174792214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29c1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.620+0000 7f2c58b19740 1 --2- 172.21.15.49:0/1174792214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x29ae3a0 0x2991420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.620+0000 7f2c58b19740 1 --2- 172.21.15.49:0/1174792214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x296de40 0x296c5f0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.620+0000 7f2c58b19740 1 -- 172.21.15.49:0/1174792214 >> 172.21.15.49:0/1174792214 conn(0x274b550 msgr2=0x2968c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:20.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.620+0000 7f2c58b19740 1 -- 172.21.15.49:0/1174792214 shutdown_connections 2024-01-22T05:16:20.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.620+0000 7f2c58b19740 1 -- 172.21.15.49:0/1174792214 wait complete. 2024-01-22T05:16:20.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.624+0000 7f2c58b19740 1 -- start start 2024-01-22T05:16:20.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.624+0000 7f2c58b19740 1 Processor -- start 2024-01-22T05:16:20.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.624+0000 7f2c58b19740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x296de40 0x29b3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.624+0000 7f2c58b19740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ae3a0 0x2a0c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.624+0000 7f2c58b19740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29910b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.624+0000 7f2c58b19740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x29b3560 con 0x29ae3a0 2024-01-22T05:16:20.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.624+0000 7f2c58b19740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x296a4b0 con 0x29ae780 2024-01-22T05:16:20.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.624+0000 7f2c58b19740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x29937c0 con 0x296de40 2024-01-22T05:16:20.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.624+0000 7f2c58b19740 10 client.0 ll_register_callbacks cb 0x7f2c38001080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:16:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c46a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ae3a0 0x2a0c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c46a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ae3a0 0x2a0c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34306/0 (socket says 172.21.15.49:34306) 2024-01-22T05:16:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c46a00700 1 -- 172.21.15.49:0/3417077640 learned_addr learned my addr 172.21.15.49:0/3417077640 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c47e00700 1 --2- 172.21.15.49:0/3417077640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29910b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c47400700 1 --2- 172.21.15.49:0/3417077640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x296de40 0x29b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c46a00700 1 -- 172.21.15.49:0/3417077640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x296de40 msgr2=0x29b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c46a00700 1 --2- 172.21.15.49:0/3417077640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x296de40 0x29b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c46a00700 1 -- 172.21.15.49:0/3417077640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 msgr2=0x29910b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c46a00700 1 --2- 172.21.15.49:0/3417077640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29910b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c46a00700 1 -- 172.21.15.49:0/3417077640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x28e1960 con 0x29ae3a0 2024-01-22T05:16:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c47400700 1 --2- 172.21.15.49:0/3417077640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x296de40 0x29b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c46a00700 1 --2- 172.21.15.49:0/3417077640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ae3a0 0x2a0c370 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f2c30006c00 tx=0x7f2c3002c040).ready entity=mon.0 client_cookie=f82f0e5651f43937 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c2fe00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:16:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c2fe00700 1 -- 172.21.15.49:0/3417077640 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30038030 con 0x29ae3a0 2024-01-22T05:16:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c2fe00700 1 -- 172.21.15.49:0/3417077640 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2c3003ee10 con 0x29ae3a0 2024-01-22T05:16:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c58b19740 1 -- 172.21.15.49:0/3417077640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c3002e070 con 0x29ae3a0 2024-01-22T05:16:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c2fe00700 1 -- 172.21.15.49:0/3417077640 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c3003c280 con 0x29ae3a0 2024-01-22T05:16:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c58b19740 10 client.8988 fetch_fsmap learned FSMap version 114 2024-01-22T05:16:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c58b19740 1 -- 172.21.15.49:0/3417077640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) v3 -- 0x28e16b0 con 0x29ae3a0 2024-01-22T05:16:20.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c2fe00700 1 -- 172.21.15.49:0/3417077640 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3002e070 con 0x29ae3a0 2024-01-22T05:16:20.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c2fe00700 1 -- 172.21.15.49:0/3417077640 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 114) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2c30027af0 con 0x29ae3a0 2024-01-22T05:16:20.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c58b19740 10 client.8988 fetch_fsmap finished waiting for FSMap version 114 2024-01-22T05:16:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c58b19740 10 client.8988 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:16:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c58b19740 20 client.8988 populate_metadata read hostname 'smithi049' 2024-01-22T05:16:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c58b19740 1 --2- 172.21.15.49:0/3417077640 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x2997460 0x2997840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c58b19740 4 client.8988 mds_command: new command op to 8829 tid=0[{"prefix": "status"}] 2024-01-22T05:16:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c58b19740 1 -- 172.21.15.49:0/3417077640 --> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] -- command(tid 0: {"prefix": "status"}) v1 -- 0x27a24e0 con 0x2997460 2024-01-22T05:16:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.628+0000 7f2c47400700 1 --2- 172.21.15.49:0/3417077640 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x2997460 0x2997840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c2fe00700 10 client.8988 ms_handle_connect on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c47400700 1 --2- 172.21.15.49:0/3417077640 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x2997460 0x2997840 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fdfdbf22442bbe3 server_cookie=3d6e68e24196fb49 in_seq=0 out_seq=0 2024-01-22T05:16:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c2fe00700 1 -- 172.21.15.49:0/3417077640 <== mds.0 v2:172.21.15.49:6835/4015076184 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x27a24e0 con 0x2997460 2024-01-22T05:16:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c2fe00700 10 client.8988 handle_command_reply: tid=0 2024-01-22T05:16:20.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c58b19740 1 client.8988 shutdown 2024-01-22T05:16:20.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c58b19740 1 -- 172.21.15.49:0/3417077640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ae3a0 msgr2=0x2a0c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c58b19740 1 --2- 172.21.15.49:0/3417077640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ae3a0 0x2a0c370 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f2c30006c00 tx=0x7f2c3002c040).stop 2024-01-22T05:16:20.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c58b19740 1 -- 172.21.15.49:0/3417077640 shutdown_connections 2024-01-22T05:16:20.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c58b19740 1 --2- 172.21.15.49:0/3417077640 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x2997460 0x2997840 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c58b19740 1 --2- 172.21.15.49:0/3417077640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x29ae780 0x29910b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c2fe00700 0 client.8988 ms_handle_reset on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:20.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c58b19740 1 --2- 172.21.15.49:0/3417077640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x29ae3a0 0x2a0c370 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c58b19740 1 --2- 172.21.15.49:0/3417077640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x296de40 0x29b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c58b19740 1 -- 172.21.15.49:0/3417077640 >> 172.21.15.49:0/3417077640 conn(0x274b550 msgr2=0x296c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:20.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c58b19740 1 -- 172.21.15.49:0/3417077640 shutdown_connections 2024-01-22T05:16:20.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c58b19740 1 -- 172.21.15.49:0/3417077640 wait complete. 2024-01-22T05:16:20.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c58b19740 20 client.8988 trim_cache size 0 max 16384 2024-01-22T05:16:20.634 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:16:20.635 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:16:20.635 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:16:20.635 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 8829, 2024-01-22T05:16:20.635 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:16:20.635 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:16:20.635 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:16:20.635 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 6.5603447179999996, 2024-01-22T05:16:20.635 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 114, 2024-01-22T05:16:20.635 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 145, 2024-01-22T05:16:20.635 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 145, 2024-01-22T05:16:20.635 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 11.886025534 2024-01-22T05:16:20.635 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:16:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c4e600700 1 -- 172.21.15.49:0/285508315 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c2005a540 msgr2=0x7f2c2005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c4e600700 1 --2- 172.21.15.49:0/285508315 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c2005a540 0x7f2c2005ca00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f2c48067460 tx=0x7f2c3001a000).stop 2024-01-22T05:16:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c4e600700 1 -- 172.21.15.49:0/285508315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28004690 msgr2=0x7f2c4814eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.632+0000 7f2c4e600700 1 --2- 172.21.15.49:0/285508315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28004690 0x7f2c4814eff0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f2c3800f7d0 tx=0x7f2c38007bb0).stop 2024-01-22T05:16:20.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.636+0000 7f2c4e600700 1 -- 172.21.15.49:0/285508315 shutdown_connections 2024-01-22T05:16:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.636+0000 7f2c4e600700 1 --2- 172.21.15.49:0/285508315 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2c2005a540 0x7f2c2005ca00 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.636+0000 7f2c4e600700 1 --2- 172.21.15.49:0/285508315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c48153c30 0x7f2c481540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.636+0000 7f2c4e600700 1 --2- 172.21.15.49:0/285508315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c48159d80 0x7f2c4815a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.636+0000 7f2c4e600700 1 --2- 172.21.15.49:0/285508315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28004690 0x7f2c4814eff0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.636+0000 7f2c4e600700 1 -- 172.21.15.49:0/285508315 >> 172.21.15.49:0/285508315 conn(0x7f2c480c6540 msgr2=0x7f2c48066a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.636+0000 7f2c4e600700 1 -- 172.21.15.49:0/285508315 shutdown_connections 2024-01-22T05:16:20.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.636+0000 7f2c4e600700 1 -- 172.21.15.49:0/285508315 wait complete. 2024-01-22T05:16:20.655 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:16:20.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.796+0000 7f0928400700 1 Processor -- start 2024-01-22T05:16:20.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.796+0000 7f0928400700 1 -- start start 2024-01-22T05:16:20.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f0928400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09200c3fa0 0x7f09200c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f0928400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092015c4f0 con 0x7f09200a9e90 2024-01-22T05:16:20.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f0928400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09200c4fd0 con 0x7f0920159040 2024-01-22T05:16:20.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f0928400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09200c48f0 con 0x7f09200c3fa0 2024-01-22T05:16:20.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f0925000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09200c3fa0 0x7f09200c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f0925000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09200c3fa0 0x7f09200c4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34316/0 (socket says 172.21.15.49:34316) 2024-01-22T05:16:20.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f0925000700 1 -- 172.21.15.49:0/740791343 learned_addr learned my addr 172.21.15.49:0/740791343 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:20.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f0926e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f09200a9e90 0x7f09200aa320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45558/0 (socket says 172.21.15.49:45558) 2024-01-22T05:16:20.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f0925a00700 1 --1- 172.21.15.49:0/740791343 >> v1:172.21.15.110:6789/0 conn(0x7f0920159040 0x7f09200c7760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:57946/0 (socket says 172.21.15.49:57946) 2024-01-22T05:16:20.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f0925000700 1 -- 172.21.15.49:0/740791343 >> v1:172.21.15.110:6789/0 conn(0x7f0920159040 legacy=0x7f09200c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f0925000700 1 -- 172.21.15.49:0/740791343 >> v1:172.21.15.49:6789/0 conn(0x7f09200a9e90 legacy=0x7f09200aa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f091fe00700 1 -- 172.21.15.49:0/740791343 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264898521 0 0) 0x7f092015c4f0 con 0x7f09200a9e90 2024-01-22T05:16:20.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f0925000700 1 -- 172.21.15.49:0/740791343 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09200a8830 con 0x7f09200c3fa0 2024-01-22T05:16:20.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f0925000700 1 --2- 172.21.15.49:0/740791343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09200c3fa0 0x7f09200c4400 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f0908006fd0 tx=0x7f09080090f0).ready entity=mon.0 client_cookie=8345b56a9dff492 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:20.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f091fe00700 1 -- 172.21.15.49:0/740791343 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090800b600 con 0x7f09200c3fa0 2024-01-22T05:16:20.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f091fe00700 1 -- 172.21.15.49:0/740791343 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090800b760 con 0x7f09200c3fa0 2024-01-22T05:16:20.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.800+0000 7f091fe00700 1 -- 172.21.15.49:0/740791343 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090800bb00 con 0x7f09200c3fa0 2024-01-22T05:16:20.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.804+0000 7f0928400700 1 -- 172.21.15.49:0/740791343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09200c3fa0 msgr2=0x7f09200c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.804+0000 7f0928400700 1 --2- 172.21.15.49:0/740791343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09200c3fa0 0x7f09200c4400 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f0908006fd0 tx=0x7f09080090f0).stop 2024-01-22T05:16:20.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.804+0000 7f0928400700 1 -- 172.21.15.49:0/740791343 shutdown_connections 2024-01-22T05:16:20.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.804+0000 7f0928400700 1 --2- 172.21.15.49:0/740791343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09200c3fa0 0x7f09200c4400 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.804+0000 7f0928400700 1 -- 172.21.15.49:0/740791343 >> 172.21.15.49:0/740791343 conn(0x7f09200c5220 msgr2=0x7f09200c5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:20.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.804+0000 7f0928400700 1 -- 172.21.15.49:0/740791343 shutdown_connections 2024-01-22T05:16:20.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.804+0000 7f0928400700 1 -- 172.21.15.49:0/740791343 wait complete. 2024-01-22T05:16:20.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.808+0000 7f0928400700 1 Processor -- start 2024-01-22T05:16:20.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.808+0000 7f0928400700 1 -- start start 2024-01-22T05:16:20.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0928400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09200a9e90 0x7f0920146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0928400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09200c3fa0 0x7f09200633b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0928400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0920159040 0x7f09200638a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0928400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09201696d0 con 0x7f0920159040 2024-01-22T05:16:20.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0928400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0920063e70 con 0x7f09200a9e90 2024-01-22T05:16:20.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0928400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0920064150 con 0x7f09200c3fa0 2024-01-22T05:16:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0926e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0920159040 0x7f09200638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0926e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0920159040 0x7f09200638a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34326/0 (socket says 172.21.15.49:34326) 2024-01-22T05:16:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0926e00700 1 -- 172.21.15.49:0/3110675318 learned_addr learned my addr 172.21.15.49:0/3110675318 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0925000700 1 --2- 172.21.15.49:0/3110675318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09200c3fa0 0x7f09200633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0925a00700 1 --2- 172.21.15.49:0/3110675318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09200a9e90 0x7f0920146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0926e00700 1 -- 172.21.15.49:0/3110675318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09200c3fa0 msgr2=0x7f09200633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0926e00700 1 --2- 172.21.15.49:0/3110675318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09200c3fa0 0x7f09200633b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0926e00700 1 -- 172.21.15.49:0/3110675318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09200a9e90 msgr2=0x7f0920146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:20.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0926e00700 1 --2- 172.21.15.49:0/3110675318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09200a9e90 0x7f0920146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:20.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0926e00700 1 -- 172.21.15.49:0/3110675318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0908009370 con 0x7f0920159040 2024-01-22T05:16:20.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0926e00700 1 --2- 172.21.15.49:0/3110675318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0920159040 0x7f09200638a0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f091800c7e0 tx=0x7f0918007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:20.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f091cc00700 1 -- 172.21.15.49:0/3110675318 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0918005c70 con 0x7f0920159040 2024-01-22T05:16:20.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f091cc00700 1 -- 172.21.15.49:0/3110675318 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0918005dd0 con 0x7f0920159040 2024-01-22T05:16:20.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0928400700 1 -- 172.21.15.49:0/3110675318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0920169940 con 0x7f0920159040 2024-01-22T05:16:20.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f091cc00700 1 -- 172.21.15.49:0/3110675318 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0918007320 con 0x7f0920159040 2024-01-22T05:16:20.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.812+0000 7f0928400700 1 -- 172.21.15.49:0/3110675318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09200650a0 con 0x7f0920159040 2024-01-22T05:16:20.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.816+0000 7f0928400700 1 -- 172.21.15.49:0/3110675318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0920169e40 con 0x7f0920159040 2024-01-22T05:16:20.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.816+0000 7f091cc00700 1 -- 172.21.15.49:0/3110675318 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0918007710 con 0x7f0920159040 2024-01-22T05:16:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.816+0000 7f091cc00700 1 --2- 172.21.15.49:0/3110675318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f805a510 0x7f08f805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:20.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.816+0000 7f091cc00700 1 -- 172.21.15.49:0/3110675318 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f09180749a0 con 0x7f0920159040 2024-01-22T05:16:20.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.816+0000 7f0925a00700 1 --2- 172.21.15.49:0/3110675318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f805a510 0x7f08f805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:20.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.820+0000 7f0925a00700 1 --2- 172.21.15.49:0/3110675318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f805a510 0x7f08f805c9d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f0910000c00 tx=0x7f0910007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:20.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:20.824+0000 7f091cc00700 1 -- 172.21.15.49:0/3110675318 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0918047f80 con 0x7f0920159040 2024-01-22T05:16:21.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.024+0000 7f0928400700 1 -- 172.21.15.49:0/3110675318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0920069800 con 0x7f0920159040 2024-01-22T05:16:21.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.028+0000 7f091cc00700 1 -- 172.21.15.49:0/3110675318 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v114) v1 ==== 53+0+73 (secure 0 0 0) 0x7f091804b5a0 con 0x7f0920159040 2024-01-22T05:16:21.028 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:16:21.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.032+0000 7f0928400700 1 -- 172.21.15.49:0/3110675318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f805a510 msgr2=0x7f08f805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:21.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.032+0000 7f0928400700 1 --2- 172.21.15.49:0/3110675318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f805a510 0x7f08f805c9d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f0910000c00 tx=0x7f0910007d40).stop 2024-01-22T05:16:21.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.032+0000 7f0928400700 1 -- 172.21.15.49:0/3110675318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0920159040 msgr2=0x7f09200638a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:21.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.032+0000 7f0928400700 1 --2- 172.21.15.49:0/3110675318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0920159040 0x7f09200638a0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f091800c7e0 tx=0x7f0918007f60).stop 2024-01-22T05:16:21.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.032+0000 7f0928400700 1 -- 172.21.15.49:0/3110675318 shutdown_connections 2024-01-22T05:16:21.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.032+0000 7f0928400700 1 --2- 172.21.15.49:0/3110675318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f805a510 0x7f08f805c9d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:21.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.032+0000 7f0928400700 1 --2- 172.21.15.49:0/3110675318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0920159040 0x7f09200638a0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:21.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.032+0000 7f0928400700 1 --2- 172.21.15.49:0/3110675318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09200c3fa0 0x7f09200633b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:21.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.032+0000 7f0928400700 1 --2- 172.21.15.49:0/3110675318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09200a9e90 0x7f0920146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:21.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.032+0000 7f0928400700 1 -- 172.21.15.49:0/3110675318 >> 172.21.15.49:0/3110675318 conn(0x7f09200c5220 msgr2=0x7f09200ad720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:21.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.032+0000 7f0928400700 1 -- 172.21.15.49:0/3110675318 shutdown_connections 2024-01-22T05:16:21.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.032+0000 7f0928400700 1 -- 172.21.15.49:0/3110675318 wait complete. 2024-01-22T05:16:21.051 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-22T05:16:21.051 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:16:21.051 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:16:21.051 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:16:21.051 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:16:21.051 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-22T05:16:21.052 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-22T05:16:21.052 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:16:21.052 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:16:21.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:16:21.052 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:16:21.070 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:16:21.070 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:16:21.070 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:16:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:16:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:16:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:16:21.071 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:16:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:16:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:16:21.071 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:16:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:16:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:16:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:16:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41790sec preferred_lft 41790sec 2024-01-22T05:16:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:16:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:16:21.071 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:16:21.072 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:16:21.072 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:16:21.072 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:16:21.072 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:16:21.072 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:16:21.072 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:16:21.072 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:16:21.072 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:16:21.072 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:16:21.072 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:16:21.072 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:16:21.072 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:16:21.072 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:16:21.073 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::7ce7:e3ff:fed1:1e88/64 scope link 2024-01-22T05:16:21.073 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:16:21.073 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:16:21.073 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 82:c1:48:e7:c7:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:16:21.073 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::80c1:48ff:fee7:c731/64 scope link 2024-01-22T05:16:21.073 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:16:21.073 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:16:21.073 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:16:21.073 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3426:32ff:feee:c4c9/64 scope link 2024-01-22T05:16:21.073 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:16:21.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:16:21.074 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:16:21.151 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:16:21.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:16:21.154 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:16:21.217 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:16:21.217 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:16:21.217 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:16:21.217 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:16:21.217 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:16:21.217 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:16:21.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:16:21.218 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:16:21.218 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:21.218 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:16:21.218 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:16:21.218 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:16:21.218 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:21.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:16:21.352 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:16:21.369 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:16:21.369 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:16:21.369 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:16:21.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:16:21.370 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-22T05:16:21.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:16:21.455 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-22T05:16:21.517 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:16:21.517 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:16:21.636 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:16:21.636 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:16:21.661 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:16:21.661 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:16:21.665 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:16:21.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:16:21.666 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:16:21.695 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:16:21.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.908+0000 7fac71e00700 1 Processor -- start 2024-01-22T05:16:21.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.908+0000 7fac71e00700 1 -- start start 2024-01-22T05:16:21.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.908+0000 7fac71e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fac6c0a7ad0 0x7fac6c0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:21.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.908+0000 7fac71e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fac6c0688d0 0x7fac6c0bedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:21.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.908+0000 7fac71e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6c0c72c0 con 0x7fac6c068460 2024-01-22T05:16:21.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.908+0000 7fac71e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac6c0bdee0 con 0x7fac6c0688d0 2024-01-22T05:16:21.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.908+0000 7fac71e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac6c0c66b0 con 0x7fac6c0a7ad0 2024-01-22T05:16:21.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac6be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fac6c0688d0 0x7fac6c0bedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:21.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac6be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fac6c0688d0 0x7fac6c0bedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34344/0 (socket says 172.21.15.49:34344) 2024-01-22T05:16:21.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac6be00700 1 -- 172.21.15.49:0/2926882946 learned_addr learned my addr 172.21.15.49:0/2926882946 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:21.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac6aa00700 1 --2- 172.21.15.49:0/2926882946 >> v2:172.21.15.110:3300/0 conn(0x7fac6c0a7ad0 0x7fac6c0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:21.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac6be00700 1 -- 172.21.15.49:0/2926882946 >> v2:172.21.15.110:3300/0 conn(0x7fac6c0a7ad0 msgr2=0x7fac6c0a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:21.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac6be00700 1 --2- 172.21.15.49:0/2926882946 >> v2:172.21.15.110:3300/0 conn(0x7fac6c0a7ad0 0x7fac6c0a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:21.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac6be00700 1 -- 172.21.15.49:0/2926882946 >> v1:172.21.15.110:6789/0 conn(0x7fac6c068460 legacy=0x7fac6c0be6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:21.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac6be00700 1 -- 172.21.15.49:0/2926882946 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6c0c6990 con 0x7fac6c0688d0 2024-01-22T05:16:21.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac69600700 1 -- 172.21.15.49:0/2926882946 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252627977 0 0) 0x7fac6c0c72c0 con 0x7fac6c068460 2024-01-22T05:16:21.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac6be00700 1 --2- 172.21.15.49:0/2926882946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac6c0688d0 0x7fac6c0bedc0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7fac6c0c9620 tx=0x7fac64009840).ready entity=mon.0 client_cookie=e12ae53d09b833bc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:21.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac69600700 1 -- 172.21.15.49:0/2926882946 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6400e070 con 0x7fac6c0688d0 2024-01-22T05:16:21.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac69600700 1 -- 172.21.15.49:0/2926882946 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6400ba20 con 0x7fac6c0688d0 2024-01-22T05:16:21.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac69600700 1 -- 172.21.15.49:0/2926882946 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6400bda0 con 0x7fac6c0688d0 2024-01-22T05:16:21.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac71e00700 1 -- 172.21.15.49:0/2926882946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac6c0688d0 msgr2=0x7fac6c0bedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:21.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac71e00700 1 --2- 172.21.15.49:0/2926882946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac6c0688d0 0x7fac6c0bedc0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7fac6c0c9620 tx=0x7fac64009840).stop 2024-01-22T05:16:21.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac71e00700 1 -- 172.21.15.49:0/2926882946 shutdown_connections 2024-01-22T05:16:21.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac71e00700 1 --2- 172.21.15.49:0/2926882946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac6c0688d0 0x7fac6c0bedc0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:21.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac71e00700 1 --2- 172.21.15.49:0/2926882946 >> v2:172.21.15.110:3300/0 conn(0x7fac6c0a7ad0 0x7fac6c0a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:21.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.912+0000 7fac71e00700 1 -- 172.21.15.49:0/2926882946 >> 172.21.15.49:0/2926882946 conn(0x7fac6c062a10 msgr2=0x7fac6c081fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:21.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.916+0000 7fac71e00700 1 -- 172.21.15.49:0/2926882946 shutdown_connections 2024-01-22T05:16:21.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.916+0000 7fac71e00700 1 -- 172.21.15.49:0/2926882946 wait complete. 2024-01-22T05:16:21.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.920+0000 7fac71e00700 1 Processor -- start 2024-01-22T05:16:21.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.920+0000 7fac71e00700 1 -- start start 2024-01-22T05:16:21.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.920+0000 7fac71e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac6c068460 0x7fac6c096170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:21.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.920+0000 7fac71e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac6c0688d0 0x7fac6c0a9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:21.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.920+0000 7fac71e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac6c0a7ad0 0x7fac6c0ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:21.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.920+0000 7fac71e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c0ab710 con 0x7fac6c0688d0 2024-01-22T05:16:21.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.920+0000 7fac71e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c0ab9b0 con 0x7fac6c0a7ad0 2024-01-22T05:16:21.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.920+0000 7fac71e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c0aa840 con 0x7fac6c068460 2024-01-22T05:16:21.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.920+0000 7fac6a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac6c0688d0 0x7fac6c0a9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:21.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.920+0000 7fac6a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac6c0688d0 0x7fac6c0a9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34350/0 (socket says 172.21.15.49:34350) 2024-01-22T05:16:21.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.920+0000 7fac6aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac6c068460 0x7fac6c096170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:21.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.920+0000 7fac6a000700 1 -- 172.21.15.49:0/847473205 learned_addr learned my addr 172.21.15.49:0/847473205 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:21.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.920+0000 7fac6be00700 1 --2- 172.21.15.49:0/847473205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac6c0a7ad0 0x7fac6c0ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:21.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.924+0000 7fac6be00700 1 -- 172.21.15.49:0/847473205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac6c068460 msgr2=0x7fac6c096170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:21.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.924+0000 7fac6be00700 1 --2- 172.21.15.49:0/847473205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac6c068460 0x7fac6c096170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:21.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.924+0000 7fac6be00700 1 -- 172.21.15.49:0/847473205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac6c0688d0 msgr2=0x7fac6c0a9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:21.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.924+0000 7fac6be00700 1 --2- 172.21.15.49:0/847473205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac6c0688d0 0x7fac6c0a9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:21.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.924+0000 7fac6be00700 1 -- 172.21.15.49:0/847473205 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac64009ae0 con 0x7fac6c0a7ad0 2024-01-22T05:16:21.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.924+0000 7fac6a000700 1 --2- 172.21.15.49:0/847473205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac6c0688d0 0x7fac6c0a9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:21.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.924+0000 7fac6be00700 1 --2- 172.21.15.49:0/847473205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac6c0a7ad0 0x7fac6c0ad970 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fac64013000 tx=0x7fac64009840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:21.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.924+0000 7fac62000700 1 -- 172.21.15.49:0/847473205 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64013e60 con 0x7fac6c0a7ad0 2024-01-22T05:16:21.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.924+0000 7fac62000700 1 -- 172.21.15.49:0/847473205 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac640092e0 con 0x7fac6c0a7ad0 2024-01-22T05:16:21.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.924+0000 7fac62000700 1 -- 172.21.15.49:0/847473205 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6401e6c0 con 0x7fac6c0a7ad0 2024-01-22T05:16:21.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.924+0000 7fac71e00700 1 -- 172.21.15.49:0/847473205 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6c0aab20 con 0x7fac6c0a7ad0 2024-01-22T05:16:21.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.924+0000 7fac71e00700 1 -- 172.21.15.49:0/847473205 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6c0aa3e0 con 0x7fac6c0a7ad0 2024-01-22T05:16:21.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.928+0000 7fac71e00700 1 -- 172.21.15.49:0/847473205 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6c0abb40 con 0x7fac6c0a7ad0 2024-01-22T05:16:21.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.928+0000 7fac62000700 1 -- 172.21.15.49:0/847473205 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fac64003040 con 0x7fac6c0a7ad0 2024-01-22T05:16:21.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.928+0000 7fac62000700 1 --2- 172.21.15.49:0/847473205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac4405a4e0 0x7fac4405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:21.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.928+0000 7fac62000700 1 -- 172.21.15.49:0/847473205 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fac64075880 con 0x7fac6c0a7ad0 2024-01-22T05:16:21.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.928+0000 7fac6aa00700 1 --2- 172.21.15.49:0/847473205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac4405a4e0 0x7fac4405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:21.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.932+0000 7fac6aa00700 1 --2- 172.21.15.49:0/847473205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac4405a4e0 0x7fac4405c9a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fac5c009b90 tx=0x7fac5c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:21.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:21.940+0000 7fac62000700 1 -- 172.21.15.49:0/847473205 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fac64048fb0 con 0x7fac6c0a7ad0 2024-01-22T05:16:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.152+0000 7fac71e00700 1 -- 172.21.15.49:0/847473205 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac6c047060 con 0x7fac6c0a7ad0 2024-01-22T05:16:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.152+0000 7fac62000700 1 -- 172.21.15.49:0/847473205 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4500 (secure 0 0 0) 0x7fac64023070 con 0x7fac6c0a7ad0 2024-01-22T05:16:22.156 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:22.156 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":114,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":8826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:16:17.362338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/4015076184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":4015076184},{"type":"v1","addr":"172.21.15.49:6837","nonce":4015076184}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:16:22.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.156+0000 7fac71e00700 1 -- 172.21.15.49:0/847473205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac4405a4e0 msgr2=0x7fac4405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:22.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.156+0000 7fac71e00700 1 --2- 172.21.15.49:0/847473205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac4405a4e0 0x7fac4405c9a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fac5c009b90 tx=0x7fac5c009060).stop 2024-01-22T05:16:22.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.156+0000 7fac71e00700 1 -- 172.21.15.49:0/847473205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac6c0a7ad0 msgr2=0x7fac6c0ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:22.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.156+0000 7fac71e00700 1 --2- 172.21.15.49:0/847473205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac6c0a7ad0 0x7fac6c0ad970 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fac64013000 tx=0x7fac64009840).stop 2024-01-22T05:16:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.156+0000 7fac71e00700 1 -- 172.21.15.49:0/847473205 shutdown_connections 2024-01-22T05:16:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.156+0000 7fac71e00700 1 --2- 172.21.15.49:0/847473205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fac4405a4e0 0x7fac4405c9a0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.156+0000 7fac71e00700 1 --2- 172.21.15.49:0/847473205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac6c0a7ad0 0x7fac6c0ad970 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.156+0000 7fac71e00700 1 --2- 172.21.15.49:0/847473205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac6c0688d0 0x7fac6c0a9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.156+0000 7fac71e00700 1 --2- 172.21.15.49:0/847473205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac6c068460 0x7fac6c096170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.156+0000 7fac71e00700 1 -- 172.21.15.49:0/847473205 >> 172.21.15.49:0/847473205 conn(0x7fac6c062a10 msgr2=0x7fac6c0a6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.156+0000 7fac71e00700 1 -- 172.21.15.49:0/847473205 shutdown_connections 2024-01-22T05:16:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.156+0000 7fac71e00700 1 -- 172.21.15.49:0/847473205 wait complete. 2024-01-22T05:16:22.162 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 114 2024-01-22T05:16:22.180 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:16:22.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.336+0000 7fa289800700 1 Processor -- start 2024-01-22T05:16:22.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.336+0000 7fa289800700 1 -- start start 2024-01-22T05:16:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.336+0000 7fa289800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa2840a8740 0x7fa2840a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.336+0000 7fa289800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2840c1ed0 0x7fa2840c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.336+0000 7fa289800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2840c1a40 con 0x7fa284155d20 2024-01-22T05:16:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.336+0000 7fa289800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2840a90b0 con 0x7fa2840c1ed0 2024-01-22T05:16:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.336+0000 7fa289800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa284159310 con 0x7fa2840a8740 2024-01-22T05:16:22.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.336+0000 7fa283400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2840c1ed0 0x7fa2840c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:22.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.336+0000 7fa282a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa284155d20 0x7fa284065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45574/0 (socket says 172.21.15.49:45574) 2024-01-22T05:16:22.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.336+0000 7fa282a00700 1 -- 172.21.15.49:0/2995314048 learned_addr learned my addr 172.21.15.49:0/2995314048 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:22.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.336+0000 7fa282000700 1 --2- 172.21.15.49:0/2995314048 >> v2:172.21.15.110:3300/0 conn(0x7fa2840a8740 0x7fa2840a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa281600700 1 -- 172.21.15.49:0/2995314048 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819675639 0 0) 0x7fa2840c1a40 con 0x7fa284155d20 2024-01-22T05:16:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa281600700 1 -- 172.21.15.49:0/2995314048 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2640033f0 con 0x7fa284155d20 2024-01-22T05:16:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa282000700 1 -- 172.21.15.49:0/2995314048 >> v2:172.21.15.49:3300/0 conn(0x7fa2840c1ed0 msgr2=0x7fa2840c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa282000700 1 --2- 172.21.15.49:0/2995314048 >> v2:172.21.15.49:3300/0 conn(0x7fa2840c1ed0 0x7fa2840c2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa282000700 1 -- 172.21.15.49:0/2995314048 >> v1:172.21.15.49:6789/0 conn(0x7fa284155d20 legacy=0x7fa284065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa282000700 1 -- 172.21.15.49:0/2995314048 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2840c13f0 con 0x7fa2840a8740 2024-01-22T05:16:22.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa282000700 1 --2- 172.21.15.49:0/2995314048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2840a8740 0x7fa2840a8bc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fa2840c0ad0 tx=0x7fa26c009060).ready entity=mon.1 client_cookie=46d33f109256fb84 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:22.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa281600700 1 -- 172.21.15.49:0/2995314048 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00d4a0 con 0x7fa2840a8740 2024-01-22T05:16:22.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa281600700 1 -- 172.21.15.49:0/2995314048 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c00d600 con 0x7fa2840a8740 2024-01-22T05:16:22.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa281600700 1 -- 172.21.15.49:0/2995314048 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00d980 con 0x7fa2840a8740 2024-01-22T05:16:22.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa289800700 1 -- 172.21.15.49:0/2995314048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2840a8740 msgr2=0x7fa2840a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:22.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa289800700 1 --2- 172.21.15.49:0/2995314048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2840a8740 0x7fa2840a8bc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fa2840c0ad0 tx=0x7fa26c009060).stop 2024-01-22T05:16:22.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa289800700 1 -- 172.21.15.49:0/2995314048 shutdown_connections 2024-01-22T05:16:22.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa289800700 1 --2- 172.21.15.49:0/2995314048 >> v2:172.21.15.49:3300/0 conn(0x7fa2840c1ed0 0x7fa2840c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:22.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa289800700 1 --2- 172.21.15.49:0/2995314048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2840a8740 0x7fa2840a8bc0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.340+0000 7fa289800700 1 -- 172.21.15.49:0/2995314048 >> 172.21.15.49:0/2995314048 conn(0x7fa2840c6540 msgr2=0x7fa2840c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.344+0000 7fa289800700 1 -- 172.21.15.49:0/2995314048 shutdown_connections 2024-01-22T05:16:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.344+0000 7fa289800700 1 -- 172.21.15.49:0/2995314048 wait complete. 2024-01-22T05:16:22.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.344+0000 7fa289800700 1 Processor -- start 2024-01-22T05:16:22.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.344+0000 7fa289800700 1 -- start start 2024-01-22T05:16:22.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa289800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa2840a8740 0x7fa2840ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:22.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa289800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2840c1ed0 0x7fa2841510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:22.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa289800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa284155d20 0x7fa28415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:22.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa289800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa284154410 con 0x7fa284155d20 2024-01-22T05:16:22.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa289800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa284153800 con 0x7fa2840c1ed0 2024-01-22T05:16:22.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa289800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa284153ae0 con 0x7fa2840a8740 2024-01-22T05:16:22.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa283400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa284155d20 0x7fa28415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:22.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa283400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa284155d20 0x7fa28415a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34370/0 (socket says 172.21.15.49:34370) 2024-01-22T05:16:22.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa283400700 1 -- 172.21.15.49:0/3727762558 learned_addr learned my addr 172.21.15.49:0/3727762558 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:22.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa282a00700 1 --2- 172.21.15.49:0/3727762558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa2840a8740 0x7fa2840ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:22.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa282000700 1 --2- 172.21.15.49:0/3727762558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2840c1ed0 0x7fa2841510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:22.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa283400700 1 -- 172.21.15.49:0/3727762558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa2840a8740 msgr2=0x7fa2840ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:22.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa283400700 1 --2- 172.21.15.49:0/3727762558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa2840a8740 0x7fa2840ab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:22.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa283400700 1 -- 172.21.15.49:0/3727762558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2840c1ed0 msgr2=0x7fa2841510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:22.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa283400700 1 --2- 172.21.15.49:0/3727762558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2840c1ed0 0x7fa2841510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:22.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa283400700 1 -- 172.21.15.49:0/3727762558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c0092a0 con 0x7fa284155d20 2024-01-22T05:16:22.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa283400700 1 --2- 172.21.15.49:0/3727762558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa284155d20 0x7fa28415a4e0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7fa27c009e90 tx=0x7fa27c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:22.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa27a000700 1 -- 172.21.15.49:0/3727762558 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c00cc20 con 0x7fa284155d20 2024-01-22T05:16:22.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa27a000700 1 -- 172.21.15.49:0/3727762558 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c00f040 con 0x7fa284155d20 2024-01-22T05:16:22.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa27a000700 1 -- 172.21.15.49:0/3727762558 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c013400 con 0x7fa284155d20 2024-01-22T05:16:22.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa289800700 1 -- 172.21.15.49:0/3727762558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa284153dc0 con 0x7fa284155d20 2024-01-22T05:16:22.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.348+0000 7fa289800700 1 -- 172.21.15.49:0/3727762558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2841534f0 con 0x7fa284155d20 2024-01-22T05:16:22.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.352+0000 7fa289800700 1 -- 172.21.15.49:0/3727762558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa284047060 con 0x7fa284155d20 2024-01-22T05:16:22.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.352+0000 7fa27a000700 1 -- 172.21.15.49:0/3727762558 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa27c0137b0 con 0x7fa284155d20 2024-01-22T05:16:22.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.352+0000 7fa27a000700 1 --2- 172.21.15.49:0/3727762558 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa25c05a510 0x7fa25c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:22.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.352+0000 7fa27a000700 1 -- 172.21.15.49:0/3727762558 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa27c075320 con 0x7fa284155d20 2024-01-22T05:16:22.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.352+0000 7fa282a00700 1 --2- 172.21.15.49:0/3727762558 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa25c05a510 0x7fa25c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:22.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.352+0000 7fa282a00700 1 --2- 172.21.15.49:0/3727762558 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa25c05a510 0x7fa25c05c9d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fa274005750 tx=0x7fa274009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:22.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.360+0000 7fa27a000700 1 -- 172.21.15.49:0/3727762558 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa27c0488e0 con 0x7fa284155d20 2024-01-22T05:16:22.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.564+0000 7fa289800700 1 -- 172.21.15.49:0/3727762558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa284046800 con 0x7fa284155d20 2024-01-22T05:16:22.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.564+0000 7fa27a000700 1 -- 172.21.15.49:0/3727762558 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4500 (secure 0 0 0) 0x7fa27c04bf00 con 0x7fa284155d20 2024-01-22T05:16:22.566 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:22.566 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":114,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":8826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:16:17.362338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/4015076184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":4015076184},{"type":"v1","addr":"172.21.15.49:6837","nonce":4015076184}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:16:22.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.568+0000 7fa289800700 1 -- 172.21.15.49:0/3727762558 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa25c05a510 msgr2=0x7fa25c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:22.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.568+0000 7fa289800700 1 --2- 172.21.15.49:0/3727762558 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa25c05a510 0x7fa25c05c9d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fa274005750 tx=0x7fa274009040).stop 2024-01-22T05:16:22.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.568+0000 7fa289800700 1 -- 172.21.15.49:0/3727762558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa284155d20 msgr2=0x7fa28415a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:22.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.568+0000 7fa289800700 1 --2- 172.21.15.49:0/3727762558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa284155d20 0x7fa28415a4e0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7fa27c009e90 tx=0x7fa27c00b040).stop 2024-01-22T05:16:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.568+0000 7fa289800700 1 -- 172.21.15.49:0/3727762558 shutdown_connections 2024-01-22T05:16:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.568+0000 7fa289800700 1 --2- 172.21.15.49:0/3727762558 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa25c05a510 0x7fa25c05c9d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.568+0000 7fa289800700 1 --2- 172.21.15.49:0/3727762558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa284155d20 0x7fa28415a4e0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.568+0000 7fa289800700 1 --2- 172.21.15.49:0/3727762558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2840c1ed0 0x7fa2841510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.568+0000 7fa289800700 1 --2- 172.21.15.49:0/3727762558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa2840a8740 0x7fa2840ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.568+0000 7fa289800700 1 -- 172.21.15.49:0/3727762558 >> 172.21.15.49:0/3727762558 conn(0x7fa2840c6540 msgr2=0x7fa2840c22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.568+0000 7fa289800700 1 -- 172.21.15.49:0/3727762558 shutdown_connections 2024-01-22T05:16:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:22.568+0000 7fa289800700 1 -- 172.21.15.49:0/3727762558 wait complete. 2024-01-22T05:16:22.574 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 114 2024-01-22T05:16:22.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:22.594 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:22.594 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:22.594 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.0 2024-01-22T05:16:22.594 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:22.595 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:22.595 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:22.595 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285797 s, 36.7 MB/s 2024-01-22T05:16:22.697 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:22.697 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:22.697 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271399 s, 38.6 MB/s 2024-01-22T05:16:22.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:22.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:22.735 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333201 s, 31.5 MB/s 2024-01-22T05:16:22.777 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:22.777 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:22.777 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0368556 s, 28.5 MB/s 2024-01-22T05:16:22.810 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316564 s, 33.1 MB/s 2024-01-22T05:16:22.840 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:22.840 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:22.840 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269158 s, 39.0 MB/s 2024-01-22T05:16:22.875 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:22.875 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:22.875 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304677 s, 34.4 MB/s 2024-01-22T05:16:22.900 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:22.900 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:22.900 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206041 s, 50.9 MB/s 2024-01-22T05:16:22.935 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:22.935 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:22.935 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310261 s, 33.8 MB/s 2024-01-22T05:16:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269391 s, 38.9 MB/s 2024-01-22T05:16:22.996 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:22.997 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:22.997 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271505 s, 38.6 MB/s 2024-01-22T05:16:23.028 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.028 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.028 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270846 s, 38.7 MB/s 2024-01-22T05:16:23.055 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.056 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.056 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228861 s, 45.8 MB/s 2024-01-22T05:16:23.088 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.089 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.089 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288684 s, 36.3 MB/s 2024-01-22T05:16:23.117 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.117 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.117 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241787 s, 43.4 MB/s 2024-01-22T05:16:23.148 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.149 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.149 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279767 s, 37.5 MB/s 2024-01-22T05:16:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271764 s, 38.6 MB/s 2024-01-22T05:16:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.211 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279344 s, 37.5 MB/s 2024-01-22T05:16:23.258 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.258 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.258 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.042328 s, 24.8 MB/s 2024-01-22T05:16:23.293 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.293 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.293 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308246 s, 34.0 MB/s 2024-01-22T05:16:23.328 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.329 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.329 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312319 s, 33.6 MB/s 2024-01-22T05:16:23.358 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.358 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.358 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260341 s, 40.3 MB/s 2024-01-22T05:16:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294739 s, 35.6 MB/s 2024-01-22T05:16:23.426 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.426 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.426 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030979 s, 33.8 MB/s 2024-01-22T05:16:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.472 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.041562 s, 25.2 MB/s 2024-01-22T05:16:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291991 s, 35.9 MB/s 2024-01-22T05:16:23.541 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.542 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.542 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333059 s, 31.5 MB/s 2024-01-22T05:16:23.578 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.578 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.578 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321525 s, 32.6 MB/s 2024-01-22T05:16:23.606 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.606 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.606 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246217 s, 42.6 MB/s 2024-01-22T05:16:23.627 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.627 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.628 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193012 s, 54.3 MB/s 2024-01-22T05:16:23.663 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.663 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.664 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318489 s, 32.9 MB/s 2024-01-22T05:16:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228048 s, 46.0 MB/s 2024-01-22T05:16:23.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:23.691 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:23.691 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:23.691 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.1 2024-01-22T05:16:23.692 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:23.692 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:23.692 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:23.692 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034332 s, 30.5 MB/s 2024-01-22T05:16:23.786 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028694 s, 36.5 MB/s 2024-01-22T05:16:23.826 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.826 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.826 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0359112 s, 29.2 MB/s 2024-01-22T05:16:23.857 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.857 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.857 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274426 s, 38.2 MB/s 2024-01-22T05:16:23.896 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.896 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.897 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0352698 s, 29.7 MB/s 2024-01-22T05:16:23.928 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.929 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.929 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277463 s, 37.8 MB/s 2024-01-22T05:16:23.958 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.958 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.958 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026166 s, 40.1 MB/s 2024-01-22T05:16:23.989 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:23.989 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:23.990 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279187 s, 37.6 MB/s 2024-01-22T05:16:24.016 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.016 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.017 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225892 s, 46.4 MB/s 2024-01-22T05:16:24.052 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.052 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.052 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312459 s, 33.6 MB/s 2024-01-22T05:16:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.082 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249963 s, 41.9 MB/s 2024-01-22T05:16:24.102 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.102 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.103 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183721 s, 57.1 MB/s 2024-01-22T05:16:24.128 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.128 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.128 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223659 s, 46.9 MB/s 2024-01-22T05:16:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327767 s, 32.0 MB/s 2024-01-22T05:16:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236554 s, 44.3 MB/s 2024-01-22T05:16:24.230 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.230 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.230 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341633 s, 30.7 MB/s 2024-01-22T05:16:24.266 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.266 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.267 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324044 s, 32.4 MB/s 2024-01-22T05:16:24.295 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.295 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.295 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236312 s, 44.4 MB/s 2024-01-22T05:16:24.315 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.315 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.315 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181708 s, 57.7 MB/s 2024-01-22T05:16:24.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.352 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326552 s, 32.1 MB/s 2024-01-22T05:16:24.384 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.384 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.384 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268936 s, 39.0 MB/s 2024-01-22T05:16:24.403 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.403 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.403 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188544 s, 55.6 MB/s 2024-01-22T05:16:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.438 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305313 s, 34.3 MB/s 2024-01-22T05:16:24.469 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.469 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.469 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267148 s, 39.3 MB/s 2024-01-22T05:16:24.501 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.501 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.501 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028523 s, 36.8 MB/s 2024-01-22T05:16:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253007 s, 41.4 MB/s 2024-01-22T05:16:24.562 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.562 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.562 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289689 s, 36.2 MB/s 2024-01-22T05:16:24.595 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.595 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.595 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286679 s, 36.6 MB/s 2024-01-22T05:16:24.624 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.625 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.625 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246476 s, 42.5 MB/s 2024-01-22T05:16:24.653 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.653 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.653 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252229 s, 41.6 MB/s 2024-01-22T05:16:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309893 s, 33.8 MB/s 2024-01-22T05:16:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261286 s, 40.1 MB/s 2024-01-22T05:16:24.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:24.719 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:24.719 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:24.719 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.2 2024-01-22T05:16:24.719 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:24.719 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:24.719 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:24.719 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:24.787 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.787 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.787 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345303 s, 30.4 MB/s 2024-01-22T05:16:24.815 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.815 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.815 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237511 s, 44.1 MB/s 2024-01-22T05:16:24.850 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.850 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.850 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312708 s, 33.5 MB/s 2024-01-22T05:16:24.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.887 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322299 s, 32.5 MB/s 2024-01-22T05:16:24.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.914 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231663 s, 45.3 MB/s 2024-01-22T05:16:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032213 s, 32.6 MB/s 2024-01-22T05:16:24.981 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:24.981 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:24.981 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026913 s, 39.0 MB/s 2024-01-22T05:16:25.011 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.011 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.011 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272976 s, 38.4 MB/s 2024-01-22T05:16:25.036 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.037 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.037 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217804 s, 48.1 MB/s 2024-01-22T05:16:25.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.073 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322942 s, 32.5 MB/s 2024-01-22T05:16:25.105 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.105 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.105 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277831 s, 37.7 MB/s 2024-01-22T05:16:25.134 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.135 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.135 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261731 s, 40.1 MB/s 2024-01-22T05:16:25.163 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.163 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.163 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248998 s, 42.1 MB/s 2024-01-22T05:16:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278302 s, 37.7 MB/s 2024-01-22T05:16:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0331993 s, 31.6 MB/s 2024-01-22T05:16:25.265 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.266 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.266 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281533 s, 37.2 MB/s 2024-01-22T05:16:25.295 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.295 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.295 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257851 s, 40.7 MB/s 2024-01-22T05:16:25.328 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.329 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.329 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298564 s, 35.1 MB/s 2024-01-22T05:16:25.375 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.375 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.375 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0415815 s, 25.2 MB/s 2024-01-22T05:16:25.410 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312263 s, 33.6 MB/s 2024-01-22T05:16:25.447 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.447 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.447 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318067 s, 33.0 MB/s 2024-01-22T05:16:25.483 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.483 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.483 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317865 s, 33.0 MB/s 2024-01-22T05:16:25.517 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.517 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.517 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301499 s, 34.8 MB/s 2024-01-22T05:16:25.555 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.556 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345813 s, 30.3 MB/s 2024-01-22T05:16:25.584 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.584 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.584 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237729 s, 44.1 MB/s 2024-01-22T05:16:25.623 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.623 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.623 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0352903 s, 29.7 MB/s 2024-01-22T05:16:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281317 s, 37.3 MB/s 2024-01-22T05:16:25.693 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.694 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.694 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340812 s, 30.8 MB/s 2024-01-22T05:16:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.728 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300939 s, 34.8 MB/s 2024-01-22T05:16:25.756 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.756 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.756 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251666 s, 41.7 MB/s 2024-01-22T05:16:25.787 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.787 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.787 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273343 s, 38.4 MB/s 2024-01-22T05:16:25.819 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.820 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.820 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282825 s, 37.1 MB/s 2024-01-22T05:16:25.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:25.822 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:25.822 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:25.822 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.3 2024-01-22T05:16:25.822 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:25.822 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:25.822 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:25.822 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0369869 s, 28.3 MB/s 2024-01-22T05:16:25.920 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.920 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.920 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266272 s, 39.4 MB/s 2024-01-22T05:16:25.956 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.956 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.956 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324163 s, 32.3 MB/s 2024-01-22T05:16:25.986 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:25.986 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:25.986 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255295 s, 41.1 MB/s 2024-01-22T05:16:26.018 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.018 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.018 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290771 s, 36.1 MB/s 2024-01-22T05:16:26.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.045 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225267 s, 46.5 MB/s 2024-01-22T05:16:26.071 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.071 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232613 s, 45.1 MB/s 2024-01-22T05:16:26.100 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.100 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.100 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243419 s, 43.1 MB/s 2024-01-22T05:16:26.128 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.128 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.128 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237736 s, 44.1 MB/s 2024-01-22T05:16:26.158 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.159 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.159 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263807 s, 39.7 MB/s 2024-01-22T05:16:26.194 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.195 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.195 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318098 s, 33.0 MB/s 2024-01-22T05:16:26.230 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.230 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.231 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320768 s, 32.7 MB/s 2024-01-22T05:16:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226154 s, 46.4 MB/s 2024-01-22T05:16:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223449 s, 46.9 MB/s 2024-01-22T05:16:26.313 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.313 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.313 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254976 s, 41.1 MB/s 2024-01-22T05:16:26.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.350 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327781 s, 32.0 MB/s 2024-01-22T05:16:26.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.380 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026299 s, 39.9 MB/s 2024-01-22T05:16:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247991 s, 42.3 MB/s 2024-01-22T05:16:26.443 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.443 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.443 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293096 s, 35.8 MB/s 2024-01-22T05:16:26.477 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.477 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.477 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029907 s, 35.1 MB/s 2024-01-22T05:16:26.513 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.513 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.513 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314587 s, 33.3 MB/s 2024-01-22T05:16:26.543 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.543 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.543 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260504 s, 40.3 MB/s 2024-01-22T05:16:26.570 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.570 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.570 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232071 s, 45.2 MB/s 2024-01-22T05:16:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263428 s, 39.8 MB/s 2024-01-22T05:16:26.641 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.642 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.642 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348628 s, 30.1 MB/s 2024-01-22T05:16:26.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.669 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256356 s, 40.9 MB/s 2024-01-22T05:16:26.703 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.703 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.703 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300064 s, 34.9 MB/s 2024-01-22T05:16:26.733 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.733 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.733 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268485 s, 39.1 MB/s 2024-01-22T05:16:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333638 s, 31.4 MB/s 2024-01-22T05:16:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267323 s, 39.2 MB/s 2024-01-22T05:16:26.838 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.838 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.838 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032157 s, 32.6 MB/s 2024-01-22T05:16:26.869 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.869 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.869 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268534 s, 39.0 MB/s 2024-01-22T05:16:26.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:26.872 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:26.872 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:26.872 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.4 2024-01-22T05:16:26.872 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:26.872 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:26.872 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:26.872 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:26.944 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.944 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.944 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334131 s, 31.4 MB/s 2024-01-22T05:16:26.974 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:26.975 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:26.975 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253518 s, 41.4 MB/s 2024-01-22T05:16:27.003 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.003 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.003 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261 s, 40.2 MB/s 2024-01-22T05:16:27.028 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.028 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.028 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224133 s, 46.8 MB/s 2024-01-22T05:16:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020398 s, 51.4 MB/s 2024-01-22T05:16:27.080 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.080 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.080 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208735 s, 50.2 MB/s 2024-01-22T05:16:27.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.105 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.105 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233631 s, 44.9 MB/s 2024-01-22T05:16:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248213 s, 42.2 MB/s 2024-01-22T05:16:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0402321 s, 26.1 MB/s 2024-01-22T05:16:27.206 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.206 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.206 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231833 s, 45.2 MB/s 2024-01-22T05:16:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327812 s, 32.0 MB/s 2024-01-22T05:16:27.274 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.274 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.274 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284234 s, 36.9 MB/s 2024-01-22T05:16:27.313 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.314 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.314 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348421 s, 30.1 MB/s 2024-01-22T05:16:27.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.348 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.348 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304076 s, 34.5 MB/s 2024-01-22T05:16:27.383 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313431 s, 33.5 MB/s 2024-01-22T05:16:27.411 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.411 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.411 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229853 s, 45.6 MB/s 2024-01-22T05:16:27.441 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.441 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.442 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246908 s, 42.5 MB/s 2024-01-22T05:16:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.464 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.464 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202436 s, 51.8 MB/s 2024-01-22T05:16:27.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.489 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022685 s, 46.2 MB/s 2024-01-22T05:16:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226389 s, 46.3 MB/s 2024-01-22T05:16:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209823 s, 50.0 MB/s 2024-01-22T05:16:27.570 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.571 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.571 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026932 s, 38.9 MB/s 2024-01-22T05:16:27.597 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.597 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.597 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223609 s, 46.9 MB/s 2024-01-22T05:16:27.624 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.624 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.624 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225889 s, 46.4 MB/s 2024-01-22T05:16:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271193 s, 38.7 MB/s 2024-01-22T05:16:27.691 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.692 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.692 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314977 s, 33.3 MB/s 2024-01-22T05:16:27.720 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.720 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.720 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250232 s, 41.9 MB/s 2024-01-22T05:16:27.748 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.748 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.748 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238362 s, 44.0 MB/s 2024-01-22T05:16:27.783 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.783 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.783 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303379 s, 34.6 MB/s 2024-01-22T05:16:27.810 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.810 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.810 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245447 s, 42.7 MB/s 2024-01-22T05:16:27.840 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.840 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.840 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270977 s, 38.7 MB/s 2024-01-22T05:16:27.883 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.884 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0389722 s, 26.9 MB/s 2024-01-22T05:16:27.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:27.885 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:27.886 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:27.886 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.5 2024-01-22T05:16:27.886 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:27.886 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:27.886 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:27.886 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:27.953 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.953 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.953 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344035 s, 30.5 MB/s 2024-01-22T05:16:27.990 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:27.990 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:27.990 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333528 s, 31.4 MB/s 2024-01-22T05:16:28.025 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.025 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.025 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309029 s, 33.9 MB/s 2024-01-22T05:16:28.058 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.058 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.058 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286736 s, 36.6 MB/s 2024-01-22T05:16:28.089 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.089 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.089 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263245 s, 39.8 MB/s 2024-01-22T05:16:28.122 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.122 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.122 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290739 s, 36.1 MB/s 2024-01-22T05:16:28.142 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.142 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.142 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174165 s, 60.2 MB/s 2024-01-22T05:16:28.183 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.183 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.183 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0362352 s, 28.9 MB/s 2024-01-22T05:16:28.214 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.215 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.215 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273205 s, 38.4 MB/s 2024-01-22T05:16:28.253 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.253 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.253 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034142 s, 30.7 MB/s 2024-01-22T05:16:28.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.284 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.284 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264505 s, 39.6 MB/s 2024-01-22T05:16:28.316 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.316 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.316 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266393 s, 39.4 MB/s 2024-01-22T05:16:28.339 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.339 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.339 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232285 s, 45.1 MB/s 2024-01-22T05:16:28.367 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.367 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.367 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229199 s, 45.7 MB/s 2024-01-22T05:16:28.401 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.402 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306187 s, 34.2 MB/s 2024-01-22T05:16:28.435 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.435 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.435 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295719 s, 35.5 MB/s 2024-01-22T05:16:28.476 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.476 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.476 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.036503 s, 28.7 MB/s 2024-01-22T05:16:28.509 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.509 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.509 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305742 s, 34.3 MB/s 2024-01-22T05:16:28.540 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.540 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.541 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272529 s, 38.5 MB/s 2024-01-22T05:16:28.570 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.570 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.570 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250078 s, 41.9 MB/s 2024-01-22T05:16:28.610 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.610 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.610 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.035328 s, 29.7 MB/s 2024-01-22T05:16:28.639 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.639 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.639 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257579 s, 40.7 MB/s 2024-01-22T05:16:28.673 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.673 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.673 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306505 s, 34.2 MB/s 2024-01-22T05:16:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0368078 s, 28.5 MB/s 2024-01-22T05:16:28.748 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.748 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.748 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290336 s, 36.1 MB/s 2024-01-22T05:16:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260129 s, 40.3 MB/s 2024-01-22T05:16:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236026 s, 44.4 MB/s 2024-01-22T05:16:28.829 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.829 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.829 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221595 s, 47.3 MB/s 2024-01-22T05:16:28.861 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.861 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.861 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297017 s, 35.3 MB/s 2024-01-22T05:16:28.888 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.888 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.889 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235803 s, 44.5 MB/s 2024-01-22T05:16:28.916 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.916 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.917 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239105 s, 43.9 MB/s 2024-01-22T05:16:28.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:28.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:28.946 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260073 s, 40.3 MB/s 2024-01-22T05:16:28.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:28.948 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:28.948 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:28.948 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.6 2024-01-22T05:16:28.948 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:28.949 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:28.949 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:28.949 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:29.008 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.009 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.009 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277176 s, 37.8 MB/s 2024-01-22T05:16:29.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.043 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298587 s, 35.1 MB/s 2024-01-22T05:16:29.072 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.072 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.072 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02528 s, 41.5 MB/s 2024-01-22T05:16:29.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.108 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.108 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318532 s, 32.9 MB/s 2024-01-22T05:16:29.135 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.136 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.136 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233357 s, 44.9 MB/s 2024-01-22T05:16:29.164 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.164 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.164 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244765 s, 42.8 MB/s 2024-01-22T05:16:29.197 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.197 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.197 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029267 s, 35.8 MB/s 2024-01-22T05:16:29.226 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.226 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.226 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025785 s, 40.7 MB/s 2024-01-22T05:16:29.251 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.252 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.252 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223542 s, 46.9 MB/s 2024-01-22T05:16:29.280 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.280 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.280 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249096 s, 42.1 MB/s 2024-01-22T05:16:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.316 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313307 s, 33.5 MB/s 2024-01-22T05:16:29.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.351 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311091 s, 33.7 MB/s 2024-01-22T05:16:29.382 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.383 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.383 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274256 s, 38.2 MB/s 2024-01-22T05:16:29.406 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.407 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.407 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210849 s, 49.7 MB/s 2024-01-22T05:16:29.432 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.433 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.433 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220584 s, 47.5 MB/s 2024-01-22T05:16:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267663 s, 39.2 MB/s 2024-01-22T05:16:29.492 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.492 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.492 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264859 s, 39.6 MB/s 2024-01-22T05:16:29.524 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.524 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.524 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285263 s, 36.8 MB/s 2024-01-22T05:16:29.557 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.557 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.557 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282098 s, 37.2 MB/s 2024-01-22T05:16:29.587 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.587 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.587 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025697 s, 40.8 MB/s 2024-01-22T05:16:29.617 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.617 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.617 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255547 s, 41.0 MB/s 2024-01-22T05:16:29.650 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.650 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.650 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299783 s, 35.0 MB/s 2024-01-22T05:16:29.679 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.679 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.679 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253147 s, 41.4 MB/s 2024-01-22T05:16:29.706 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.706 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.706 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241669 s, 43.4 MB/s 2024-01-22T05:16:29.743 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.743 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.743 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334399 s, 31.4 MB/s 2024-01-22T05:16:29.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.773 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025854 s, 40.6 MB/s 2024-01-22T05:16:29.801 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.801 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.801 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246227 s, 42.6 MB/s 2024-01-22T05:16:29.828 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.828 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.829 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239581 s, 43.8 MB/s 2024-01-22T05:16:29.861 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.861 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.861 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292101 s, 35.9 MB/s 2024-01-22T05:16:29.888 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.888 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.888 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023279 s, 45.0 MB/s 2024-01-22T05:16:29.924 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.924 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.924 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306862 s, 34.2 MB/s 2024-01-22T05:16:29.960 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328832 s, 31.9 MB/s 2024-01-22T05:16:29.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:29.962 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:29.962 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:29.962 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.7 2024-01-22T05:16:29.962 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:29.963 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:29.963 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:29.963 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:30.020 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.021 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.021 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257212 s, 40.8 MB/s 2024-01-22T05:16:30.047 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.047 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.047 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233894 s, 44.8 MB/s 2024-01-22T05:16:30.072 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.072 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.072 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220623 s, 47.5 MB/s 2024-01-22T05:16:30.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.106 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302099 s, 34.7 MB/s 2024-01-22T05:16:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240188 s, 43.7 MB/s 2024-01-22T05:16:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310233 s, 33.8 MB/s 2024-01-22T05:16:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024502 s, 42.8 MB/s 2024-01-22T05:16:30.218 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.218 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.218 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192455 s, 54.5 MB/s 2024-01-22T05:16:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216968 s, 48.3 MB/s 2024-01-22T05:16:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247141 s, 42.4 MB/s 2024-01-22T05:16:30.303 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.304 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.304 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287812 s, 36.4 MB/s 2024-01-22T05:16:30.332 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.332 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.332 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244318 s, 42.9 MB/s 2024-01-22T05:16:30.361 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.361 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.361 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262741 s, 39.9 MB/s 2024-01-22T05:16:30.395 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.395 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.396 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298357 s, 35.1 MB/s 2024-01-22T05:16:30.424 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.424 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.424 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241962 s, 43.3 MB/s 2024-01-22T05:16:30.465 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.465 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.465 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.036322 s, 28.9 MB/s 2024-01-22T05:16:30.501 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.501 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.501 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032253 s, 32.5 MB/s 2024-01-22T05:16:30.527 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.528 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.528 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239429 s, 43.8 MB/s 2024-01-22T05:16:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.559 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.559 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270207 s, 38.8 MB/s 2024-01-22T05:16:30.590 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.590 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.590 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271602 s, 38.6 MB/s 2024-01-22T05:16:30.619 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.620 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.620 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026066 s, 40.2 MB/s 2024-01-22T05:16:30.649 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.650 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.650 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267677 s, 39.2 MB/s 2024-01-22T05:16:30.675 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.676 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.676 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234015 s, 44.8 MB/s 2024-01-22T05:16:30.707 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.707 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.708 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276948 s, 37.9 MB/s 2024-01-22T05:16:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273443 s, 38.3 MB/s 2024-01-22T05:16:30.768 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.768 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.768 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238416 s, 44.0 MB/s 2024-01-22T05:16:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295614 s, 35.5 MB/s 2024-01-22T05:16:30.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.827 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221262 s, 47.4 MB/s 2024-01-22T05:16:30.856 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.856 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.857 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251733 s, 41.7 MB/s 2024-01-22T05:16:30.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.884 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234668 s, 44.7 MB/s 2024-01-22T05:16:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.922 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336067 s, 31.2 MB/s 2024-01-22T05:16:30.958 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:30.959 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:30.959 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325553 s, 32.2 MB/s 2024-01-22T05:16:30.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:30.961 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:30.961 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:30.961 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.8 2024-01-22T05:16:30.961 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:30.961 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:30.961 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:30.961 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333732 s, 31.4 MB/s 2024-01-22T05:16:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0366816 s, 28.6 MB/s 2024-01-22T05:16:31.097 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.097 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.097 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024215 s, 43.3 MB/s 2024-01-22T05:16:31.134 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.134 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.134 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334438 s, 31.4 MB/s 2024-01-22T05:16:31.165 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.165 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.165 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282005 s, 37.2 MB/s 2024-01-22T05:16:31.190 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.190 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.191 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208003 s, 50.4 MB/s 2024-01-22T05:16:31.227 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.227 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.227 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336907 s, 31.1 MB/s 2024-01-22T05:16:31.253 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.253 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.253 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219949 s, 47.7 MB/s 2024-01-22T05:16:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024733 s, 42.4 MB/s 2024-01-22T05:16:31.314 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.314 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.314 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293904 s, 35.7 MB/s 2024-01-22T05:16:31.344 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.345 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.345 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263873 s, 39.7 MB/s 2024-01-22T05:16:31.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.380 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.380 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315742 s, 33.2 MB/s 2024-01-22T05:16:31.410 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.411 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.411 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249115 s, 42.1 MB/s 2024-01-22T05:16:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.450 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344795 s, 30.4 MB/s 2024-01-22T05:16:31.475 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228878 s, 45.8 MB/s 2024-01-22T05:16:31.501 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.501 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.502 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218957 s, 47.9 MB/s 2024-01-22T05:16:31.530 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.530 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.530 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258163 s, 40.6 MB/s 2024-01-22T05:16:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225455 s, 46.5 MB/s 2024-01-22T05:16:31.587 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.587 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.587 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274693 s, 38.2 MB/s 2024-01-22T05:16:31.612 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.612 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.612 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213059 s, 49.2 MB/s 2024-01-22T05:16:31.636 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.636 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.636 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206974 s, 50.7 MB/s 2024-01-22T05:16:31.665 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.665 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.665 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247365 s, 42.4 MB/s 2024-01-22T05:16:31.691 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.692 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.692 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224938 s, 46.6 MB/s 2024-01-22T05:16:31.717 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.718 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.718 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230054 s, 45.6 MB/s 2024-01-22T05:16:31.748 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.749 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.749 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271638 s, 38.6 MB/s 2024-01-22T05:16:31.778 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.778 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.778 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254541 s, 41.2 MB/s 2024-01-22T05:16:31.811 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.812 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.812 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302858 s, 34.6 MB/s 2024-01-22T05:16:31.842 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.842 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.843 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266086 s, 39.4 MB/s 2024-01-22T05:16:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284424 s, 36.9 MB/s 2024-01-22T05:16:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029299 s, 35.8 MB/s 2024-01-22T05:16:31.941 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.941 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.942 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278418 s, 37.7 MB/s 2024-01-22T05:16:31.970 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:31.970 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:31.970 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240907 s, 43.5 MB/s 2024-01-22T05:16:31.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:31.973 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:31.973 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:31.973 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.9 2024-01-22T05:16:31.973 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:31.973 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:31.973 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:31.973 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:32.032 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.032 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.032 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255529 s, 41.0 MB/s 2024-01-22T05:16:32.057 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.058 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.058 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228442 s, 45.9 MB/s 2024-01-22T05:16:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293601 s, 35.7 MB/s 2024-01-22T05:16:32.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.121 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250374 s, 41.9 MB/s 2024-01-22T05:16:32.149 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.149 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.150 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025451 s, 41.2 MB/s 2024-01-22T05:16:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.183 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288396 s, 36.4 MB/s 2024-01-22T05:16:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.216 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028185 s, 37.2 MB/s 2024-01-22T05:16:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219158 s, 47.8 MB/s 2024-01-22T05:16:32.272 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.272 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.272 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260286 s, 40.3 MB/s 2024-01-22T05:16:32.304 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.304 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.304 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285071 s, 36.8 MB/s 2024-01-22T05:16:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295061 s, 35.5 MB/s 2024-01-22T05:16:32.369 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.370 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.370 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261341 s, 40.1 MB/s 2024-01-22T05:16:32.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.402 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294299 s, 35.6 MB/s 2024-01-22T05:16:32.434 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.434 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.434 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276274 s, 38.0 MB/s 2024-01-22T05:16:32.465 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.465 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.465 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02655 s, 39.5 MB/s 2024-01-22T05:16:32.492 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.492 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.492 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226544 s, 46.3 MB/s 2024-01-22T05:16:32.530 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.530 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.530 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0346465 s, 30.3 MB/s 2024-01-22T05:16:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246889 s, 42.5 MB/s 2024-01-22T05:16:32.590 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.590 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.591 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283915 s, 36.9 MB/s 2024-01-22T05:16:32.617 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.618 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.618 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023757 s, 44.1 MB/s 2024-01-22T05:16:32.646 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.646 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.646 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246475 s, 42.5 MB/s 2024-01-22T05:16:32.673 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.673 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.673 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237652 s, 44.1 MB/s 2024-01-22T05:16:32.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.705 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280674 s, 37.4 MB/s 2024-01-22T05:16:32.729 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.729 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.729 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021546 s, 48.7 MB/s 2024-01-22T05:16:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209809 s, 50.0 MB/s 2024-01-22T05:16:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259974 s, 40.3 MB/s 2024-01-22T05:16:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253808 s, 41.3 MB/s 2024-01-22T05:16:32.841 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.841 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.841 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024043 s, 43.6 MB/s 2024-01-22T05:16:32.872 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.872 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.872 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263201 s, 39.8 MB/s 2024-01-22T05:16:32.901 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.901 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.901 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254909 s, 41.1 MB/s 2024-01-22T05:16:32.933 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291888 s, 35.9 MB/s 2024-01-22T05:16:32.961 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:32.961 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:32.961 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240576 s, 43.6 MB/s 2024-01-22T05:16:32.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:32.964 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:32.964 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:32.964 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.10 2024-01-22T05:16:32.964 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:32.964 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:32.964 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:32.964 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:33.018 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.018 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.018 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222057 s, 47.2 MB/s 2024-01-22T05:16:33.046 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.046 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.046 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248451 s, 42.2 MB/s 2024-01-22T05:16:33.068 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.068 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.068 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195585 s, 53.6 MB/s 2024-01-22T05:16:33.097 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.097 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.097 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249567 s, 42.0 MB/s 2024-01-22T05:16:33.122 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.122 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.122 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217829 s, 48.1 MB/s 2024-01-22T05:16:33.147 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.147 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.147 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225994 s, 46.4 MB/s 2024-01-22T05:16:33.180 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.180 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.180 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285703 s, 36.7 MB/s 2024-01-22T05:16:33.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.211 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.211 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265658 s, 39.5 MB/s 2024-01-22T05:16:33.247 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.247 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.247 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315614 s, 33.2 MB/s 2024-01-22T05:16:33.276 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.277 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.277 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255882 s, 41.0 MB/s 2024-01-22T05:16:33.308 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.308 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.308 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272359 s, 38.5 MB/s 2024-01-22T05:16:33.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.347 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034261 s, 30.6 MB/s 2024-01-22T05:16:33.384 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.384 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.384 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0331262 s, 31.7 MB/s 2024-01-22T05:16:33.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.412 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247637 s, 42.3 MB/s 2024-01-22T05:16:33.439 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.440 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.440 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245315 s, 42.7 MB/s 2024-01-22T05:16:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300608 s, 34.9 MB/s 2024-01-22T05:16:33.504 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.504 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.505 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279387 s, 37.5 MB/s 2024-01-22T05:16:33.533 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.533 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.533 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239348 s, 43.8 MB/s 2024-01-22T05:16:33.565 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.565 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.565 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285752 s, 36.7 MB/s 2024-01-22T05:16:33.597 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.597 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.598 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291953 s, 35.9 MB/s 2024-01-22T05:16:33.621 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.621 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.622 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208994 s, 50.2 MB/s 2024-01-22T05:16:33.651 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.651 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.651 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266715 s, 39.3 MB/s 2024-01-22T05:16:33.682 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.682 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.682 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267912 s, 39.1 MB/s 2024-01-22T05:16:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201789 s, 52.0 MB/s 2024-01-22T05:16:33.737 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.737 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.738 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286779 s, 36.6 MB/s 2024-01-22T05:16:33.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.781 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0386286 s, 27.1 MB/s 2024-01-22T05:16:33.817 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.818 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.818 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0331816 s, 31.6 MB/s 2024-01-22T05:16:33.854 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.854 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.854 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0331666 s, 31.6 MB/s 2024-01-22T05:16:33.886 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.886 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.886 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279755 s, 37.5 MB/s 2024-01-22T05:16:33.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.914 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234887 s, 44.6 MB/s 2024-01-22T05:16:33.935 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.935 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.935 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187837 s, 55.8 MB/s 2024-01-22T05:16:33.965 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:33.965 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:33.965 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270253 s, 38.8 MB/s 2024-01-22T05:16:33.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:33.968 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:33.968 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:33.968 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.11 2024-01-22T05:16:33.968 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:33.968 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:33.968 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:33.968 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:34.021 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.021 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.021 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209653 s, 50.0 MB/s 2024-01-22T05:16:34.057 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.058 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.058 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333062 s, 31.5 MB/s 2024-01-22T05:16:34.082 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.082 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.083 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219135 s, 47.9 MB/s 2024-01-22T05:16:34.113 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.113 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.113 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259634 s, 40.4 MB/s 2024-01-22T05:16:34.142 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.142 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.142 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025613 s, 40.9 MB/s 2024-01-22T05:16:34.172 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.172 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.172 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277261 s, 37.8 MB/s 2024-01-22T05:16:34.209 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.210 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.210 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332432 s, 31.5 MB/s 2024-01-22T05:16:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0335119 s, 31.3 MB/s 2024-01-22T05:16:34.278 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.278 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.278 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268437 s, 39.1 MB/s 2024-01-22T05:16:34.316 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.316 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.316 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0331977 s, 31.6 MB/s 2024-01-22T05:16:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0353853 s, 29.6 MB/s 2024-01-22T05:16:34.378 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.378 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.378 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202062 s, 51.9 MB/s 2024-01-22T05:16:34.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.412 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308633 s, 34.0 MB/s 2024-01-22T05:16:34.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.446 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.446 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288884 s, 36.3 MB/s 2024-01-22T05:16:34.482 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.482 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.482 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334943 s, 31.3 MB/s 2024-01-22T05:16:34.517 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.517 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.517 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321421 s, 32.6 MB/s 2024-01-22T05:16:34.561 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.561 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.561 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0395299 s, 26.5 MB/s 2024-01-22T05:16:34.591 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.592 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.592 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264769 s, 39.6 MB/s 2024-01-22T05:16:34.621 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.621 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.621 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252801 s, 41.5 MB/s 2024-01-22T05:16:34.656 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.657 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.657 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314777 s, 33.3 MB/s 2024-01-22T05:16:34.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.689 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.690 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291642 s, 36.0 MB/s 2024-01-22T05:16:34.718 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.718 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.718 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245345 s, 42.7 MB/s 2024-01-22T05:16:34.754 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.754 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.754 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317534 s, 33.0 MB/s 2024-01-22T05:16:34.786 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.786 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.786 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277882 s, 37.7 MB/s 2024-01-22T05:16:34.813 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.813 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.813 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235115 s, 44.6 MB/s 2024-01-22T05:16:34.843 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.843 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.843 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247016 s, 42.4 MB/s 2024-01-22T05:16:34.868 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.868 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.868 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212225 s, 49.4 MB/s 2024-01-22T05:16:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026787 s, 39.1 MB/s 2024-01-22T05:16:34.930 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.930 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.930 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280727 s, 37.4 MB/s 2024-01-22T05:16:34.965 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.965 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.965 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298042 s, 35.2 MB/s 2024-01-22T05:16:34.992 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:34.992 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:34.992 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225302 s, 46.5 MB/s 2024-01-22T05:16:35.025 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.025 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.025 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281491 s, 37.3 MB/s 2024-01-22T05:16:35.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:35.027 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:35.027 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:35.027 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.12 2024-01-22T05:16:35.027 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:35.027 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:35.027 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:35.027 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:35.081 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.082 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.082 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021908 s, 47.9 MB/s 2024-01-22T05:16:35.122 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.122 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.123 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.036797 s, 28.5 MB/s 2024-01-22T05:16:35.152 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.152 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.152 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251252 s, 41.7 MB/s 2024-01-22T05:16:35.180 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.180 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.180 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245495 s, 42.7 MB/s 2024-01-22T05:16:35.210 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.210 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.210 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263042 s, 39.9 MB/s 2024-01-22T05:16:35.237 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.237 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.237 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245162 s, 42.8 MB/s 2024-01-22T05:16:35.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.267 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262908 s, 39.9 MB/s 2024-01-22T05:16:35.298 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.298 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.298 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270659 s, 38.7 MB/s 2024-01-22T05:16:35.324 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222079 s, 47.2 MB/s 2024-01-22T05:16:35.355 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.356 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.356 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270907 s, 38.7 MB/s 2024-01-22T05:16:35.384 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.384 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.384 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240934 s, 43.5 MB/s 2024-01-22T05:16:35.417 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.417 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291662 s, 36.0 MB/s 2024-01-22T05:16:35.450 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.450 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.450 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293151 s, 35.8 MB/s 2024-01-22T05:16:35.490 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.490 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.490 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0358407 s, 29.3 MB/s 2024-01-22T05:16:35.517 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.517 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.517 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022795 s, 46.0 MB/s 2024-01-22T05:16:35.562 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.562 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.562 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0408072 s, 25.7 MB/s 2024-01-22T05:16:35.597 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.597 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.598 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303465 s, 34.6 MB/s 2024-01-22T05:16:35.634 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.634 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.635 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332274 s, 31.6 MB/s 2024-01-22T05:16:35.660 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.660 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.660 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221029 s, 47.4 MB/s 2024-01-22T05:16:35.694 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.694 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.694 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298108 s, 35.2 MB/s 2024-01-22T05:16:35.730 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.730 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.730 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321592 s, 32.6 MB/s 2024-01-22T05:16:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249253 s, 42.1 MB/s 2024-01-22T05:16:35.794 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.794 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.795 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315061 s, 33.3 MB/s 2024-01-22T05:16:35.824 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.824 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.824 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250625 s, 41.8 MB/s 2024-01-22T05:16:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0357197 s, 29.4 MB/s 2024-01-22T05:16:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236825 s, 44.3 MB/s 2024-01-22T05:16:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266838 s, 39.3 MB/s 2024-01-22T05:16:35.952 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.953 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.953 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280945 s, 37.3 MB/s 2024-01-22T05:16:35.981 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:35.982 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:35.982 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253504 s, 41.4 MB/s 2024-01-22T05:16:36.008 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.008 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.008 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223552 s, 46.9 MB/s 2024-01-22T05:16:36.029 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.029 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.029 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189094 s, 55.5 MB/s 2024-01-22T05:16:36.054 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.055 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.055 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224234 s, 46.8 MB/s 2024-01-22T05:16:36.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:36.057 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:36.057 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:36.057 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.13 2024-01-22T05:16:36.057 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:36.057 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:36.057 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:36.057 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:36.117 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.117 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.117 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280906 s, 37.3 MB/s 2024-01-22T05:16:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.149 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027843 s, 37.7 MB/s 2024-01-22T05:16:36.177 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.178 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.178 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239742 s, 43.7 MB/s 2024-01-22T05:16:36.210 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.210 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.210 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281733 s, 37.2 MB/s 2024-01-22T05:16:36.241 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.241 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.241 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275474 s, 38.1 MB/s 2024-01-22T05:16:36.271 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.271 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.271 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265396 s, 39.5 MB/s 2024-01-22T05:16:36.301 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.301 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.302 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259989 s, 40.3 MB/s 2024-01-22T05:16:36.328 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.328 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.328 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235412 s, 44.5 MB/s 2024-01-22T05:16:36.358 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.358 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.358 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027382 s, 38.3 MB/s 2024-01-22T05:16:36.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.388 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.388 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242131 s, 43.3 MB/s 2024-01-22T05:16:36.416 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.416 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.416 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245708 s, 42.7 MB/s 2024-01-22T05:16:36.449 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.449 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.450 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285815 s, 36.7 MB/s 2024-01-22T05:16:36.480 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.480 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.480 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259889 s, 40.3 MB/s 2024-01-22T05:16:36.511 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.511 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.511 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266506 s, 39.3 MB/s 2024-01-22T05:16:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.539 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236042 s, 44.4 MB/s 2024-01-22T05:16:36.567 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.567 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.567 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236926 s, 44.3 MB/s 2024-01-22T05:16:36.594 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.594 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.594 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237736 s, 44.1 MB/s 2024-01-22T05:16:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275402 s, 38.1 MB/s 2024-01-22T05:16:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248812 s, 42.1 MB/s 2024-01-22T05:16:36.684 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.684 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.684 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267257 s, 39.2 MB/s 2024-01-22T05:16:36.713 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.713 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.713 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024319 s, 43.1 MB/s 2024-01-22T05:16:36.747 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.748 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.748 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314103 s, 33.4 MB/s 2024-01-22T05:16:36.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.781 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.781 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295449 s, 35.5 MB/s 2024-01-22T05:16:36.818 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.819 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.819 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333584 s, 31.4 MB/s 2024-01-22T05:16:36.846 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.846 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.846 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233033 s, 45.0 MB/s 2024-01-22T05:16:36.879 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.879 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.879 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289771 s, 36.2 MB/s 2024-01-22T05:16:36.907 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.907 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.907 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238536 s, 44.0 MB/s 2024-01-22T05:16:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349675 s, 30.0 MB/s 2024-01-22T05:16:36.984 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:36.984 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:36.984 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333869 s, 31.4 MB/s 2024-01-22T05:16:37.023 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.023 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.023 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338578 s, 31.0 MB/s 2024-01-22T05:16:37.057 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.101 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.101 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297242 s, 35.3 MB/s 2024-01-22T05:16:37.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.105 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275859 s, 38.0 MB/s 2024-01-22T05:16:37.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:37.105 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:37.105 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:37.105 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.14 2024-01-22T05:16:37.105 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:37.105 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:37.105 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:37.105 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:37.171 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.171 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.172 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311753 s, 33.6 MB/s 2024-01-22T05:16:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308746 s, 34.0 MB/s 2024-01-22T05:16:37.238 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.239 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.239 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275043 s, 38.1 MB/s 2024-01-22T05:16:37.266 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.267 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.267 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02435 s, 43.1 MB/s 2024-01-22T05:16:37.302 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.302 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.302 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320331 s, 32.7 MB/s 2024-01-22T05:16:37.328 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.329 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.329 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233834 s, 44.8 MB/s 2024-01-22T05:16:37.358 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.358 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.358 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264137 s, 39.7 MB/s 2024-01-22T05:16:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330505 s, 31.7 MB/s 2024-01-22T05:16:37.429 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.429 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.429 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290682 s, 36.1 MB/s 2024-01-22T05:16:37.466 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.466 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.466 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326684 s, 32.1 MB/s 2024-01-22T05:16:37.503 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.503 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.503 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340666 s, 30.8 MB/s 2024-01-22T05:16:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.536 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.536 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281027 s, 37.3 MB/s 2024-01-22T05:16:37.564 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.564 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.564 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250681 s, 41.8 MB/s 2024-01-22T05:16:37.599 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.599 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.600 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307244 s, 34.1 MB/s 2024-01-22T05:16:37.638 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.638 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.638 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0339301 s, 30.9 MB/s 2024-01-22T05:16:37.667 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.668 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.668 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260413 s, 40.3 MB/s 2024-01-22T05:16:37.700 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.700 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.701 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03 s, 35.0 MB/s 2024-01-22T05:16:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315995 s, 33.2 MB/s 2024-01-22T05:16:37.763 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.763 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.763 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221131 s, 47.4 MB/s 2024-01-22T05:16:37.800 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.800 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.800 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329321 s, 31.8 MB/s 2024-01-22T05:16:37.828 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.828 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.829 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244835 s, 42.8 MB/s 2024-01-22T05:16:37.862 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.862 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.862 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293718 s, 35.7 MB/s 2024-01-22T05:16:37.897 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.897 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.897 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316518 s, 33.1 MB/s 2024-01-22T05:16:37.924 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.924 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.924 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238861 s, 43.9 MB/s 2024-01-22T05:16:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.952 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233623 s, 44.9 MB/s 2024-01-22T05:16:37.982 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:37.982 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:37.982 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267386 s, 39.2 MB/s 2024-01-22T05:16:38.012 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.012 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.012 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262425 s, 40.0 MB/s 2024-01-22T05:16:38.049 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.049 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.049 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333344 s, 31.5 MB/s 2024-01-22T05:16:38.075 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.075 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.075 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022196 s, 47.2 MB/s 2024-01-22T05:16:38.115 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.115 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.115 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0358038 s, 29.3 MB/s 2024-01-22T05:16:38.150 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.150 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.150 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325889 s, 32.2 MB/s 2024-01-22T05:16:38.177 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.177 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.177 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226375 s, 46.3 MB/s 2024-01-22T05:16:38.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:38.180 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:38.180 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:38.180 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.15 2024-01-22T05:16:38.180 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:38.180 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:38.180 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:38.180 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:38.243 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.243 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.243 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348022 s, 30.1 MB/s 2024-01-22T05:16:38.266 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.266 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.266 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192448 s, 54.5 MB/s 2024-01-22T05:16:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228754 s, 45.8 MB/s 2024-01-22T05:16:38.322 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.322 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.322 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258249 s, 40.6 MB/s 2024-01-22T05:16:38.349 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.349 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.350 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243649 s, 43.0 MB/s 2024-01-22T05:16:38.376 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.376 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.376 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239088 s, 43.9 MB/s 2024-01-22T05:16:38.410 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.410 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.410 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292025 s, 35.9 MB/s 2024-01-22T05:16:38.442 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.442 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.442 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282155 s, 37.2 MB/s 2024-01-22T05:16:38.468 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.469 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.469 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232096 s, 45.2 MB/s 2024-01-22T05:16:38.510 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.510 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.510 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0374533 s, 28.0 MB/s 2024-01-22T05:16:38.535 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.535 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.535 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218336 s, 48.0 MB/s 2024-01-22T05:16:38.562 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.562 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.562 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226419 s, 46.3 MB/s 2024-01-22T05:16:38.593 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.594 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.594 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279834 s, 37.5 MB/s 2024-01-22T05:16:38.633 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.633 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.633 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0351754 s, 29.8 MB/s 2024-01-22T05:16:38.660 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.661 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.661 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232637 s, 45.1 MB/s 2024-01-22T05:16:38.700 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.700 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.700 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.035165 s, 29.8 MB/s 2024-01-22T05:16:38.734 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.734 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.734 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296589 s, 35.4 MB/s 2024-01-22T05:16:38.766 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.766 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.766 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272304 s, 38.5 MB/s 2024-01-22T05:16:38.793 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243884 s, 43.0 MB/s 2024-01-22T05:16:38.832 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.832 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.832 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0352518 s, 29.7 MB/s 2024-01-22T05:16:38.866 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.867 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.867 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310063 s, 33.8 MB/s 2024-01-22T05:16:38.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.888 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.888 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187091 s, 56.0 MB/s 2024-01-22T05:16:38.915 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.915 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.915 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234266 s, 44.8 MB/s 2024-01-22T05:16:38.947 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.947 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.947 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292676 s, 35.8 MB/s 2024-01-22T05:16:38.976 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:38.976 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:38.976 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248154 s, 42.3 MB/s 2024-01-22T05:16:39.014 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.014 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.014 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342978 s, 30.6 MB/s 2024-01-22T05:16:39.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.043 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245471 s, 42.7 MB/s 2024-01-22T05:16:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.074 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263233 s, 39.8 MB/s 2024-01-22T05:16:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298738 s, 35.1 MB/s 2024-01-22T05:16:39.137 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.137 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.137 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250373 s, 41.9 MB/s 2024-01-22T05:16:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233832 s, 44.8 MB/s 2024-01-22T05:16:39.193 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.193 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.193 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258579 s, 40.6 MB/s 2024-01-22T05:16:39.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:39.196 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:39.196 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:39.196 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.16 2024-01-22T05:16:39.196 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:39.197 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:39.197 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:39.197 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:39.254 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.255 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.255 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258886 s, 40.5 MB/s 2024-01-22T05:16:39.283 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.283 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.283 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242052 s, 43.3 MB/s 2024-01-22T05:16:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257177 s, 40.8 MB/s 2024-01-22T05:16:39.343 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.343 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.343 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260213 s, 40.3 MB/s 2024-01-22T05:16:39.377 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.377 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.377 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290249 s, 36.1 MB/s 2024-01-22T05:16:39.406 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.406 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.406 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262333 s, 40.0 MB/s 2024-01-22T05:16:39.436 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.436 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.436 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255638 s, 41.0 MB/s 2024-01-22T05:16:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213072 s, 49.2 MB/s 2024-01-22T05:16:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.492 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268614 s, 39.0 MB/s 2024-01-22T05:16:39.523 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.523 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.523 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260634 s, 40.2 MB/s 2024-01-22T05:16:39.549 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.549 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.549 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02232 s, 47.0 MB/s 2024-01-22T05:16:39.574 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.574 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.574 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208937 s, 50.2 MB/s 2024-01-22T05:16:39.596 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:16:39.601 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:16:39.602 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.602 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.602 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239402 s, 43.8 MB/s 2024-01-22T05:16:39.630 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.630 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.630 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259492 s, 40.4 MB/s 2024-01-22T05:16:39.657 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.657 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.657 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247913 s, 42.3 MB/s 2024-01-22T05:16:39.688 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.688 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.688 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273399 s, 38.4 MB/s 2024-01-22T05:16:39.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.715 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.715 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226993 s, 46.2 MB/s 2024-01-22T05:16:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.742 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237648 s, 44.1 MB/s 2024-01-22T05:16:39.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.773 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.773 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265002 s, 39.6 MB/s 2024-01-22T05:16:39.801 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.801 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.801 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246782 s, 42.5 MB/s 2024-01-22T05:16:39.834 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.834 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.834 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284566 s, 36.8 MB/s 2024-01-22T05:16:39.862 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.862 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.862 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237961 s, 44.1 MB/s 2024-01-22T05:16:39.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.884 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.884 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187 s, 56.1 MB/s 2024-01-22T05:16:39.908 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.909 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.909 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219918 s, 47.7 MB/s 2024-01-22T05:16:39.936 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.936 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.936 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227402 s, 46.1 MB/s 2024-01-22T05:16:39.965 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.965 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.965 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252225 s, 41.6 MB/s 2024-01-22T05:16:39.993 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:39.993 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:39.993 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247157 s, 42.4 MB/s 2024-01-22T05:16:40.023 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.023 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.023 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258383 s, 40.6 MB/s 2024-01-22T05:16:40.048 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213043 s, 49.2 MB/s 2024-01-22T05:16:40.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.074 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212575 s, 49.3 MB/s 2024-01-22T05:16:40.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.107 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279112 s, 37.6 MB/s 2024-01-22T05:16:40.135 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.135 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.135 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245469 s, 42.7 MB/s 2024-01-22T05:16:40.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:40.138 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:40.138 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:40.138 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.17 2024-01-22T05:16:40.138 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:40.138 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:40.138 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:40.138 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:40.233 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.234 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.234 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224801 s, 46.6 MB/s 2024-01-22T05:16:40.259 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.259 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.259 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229815 s, 45.6 MB/s 2024-01-22T05:16:40.294 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.294 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.294 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306375 s, 34.2 MB/s 2024-01-22T05:16:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023451 s, 44.7 MB/s 2024-01-22T05:16:40.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.350 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248974 s, 42.1 MB/s 2024-01-22T05:16:40.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.380 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246815 s, 42.5 MB/s 2024-01-22T05:16:40.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.402 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.402 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201573 s, 52.0 MB/s 2024-01-22T05:16:40.433 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.433 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.433 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264541 s, 39.6 MB/s 2024-01-22T05:16:40.461 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.461 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.461 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236695 s, 44.3 MB/s 2024-01-22T05:16:40.487 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.487 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.487 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227581 s, 46.1 MB/s 2024-01-22T05:16:40.524 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.525 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.525 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337202 s, 31.1 MB/s 2024-01-22T05:16:40.552 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.552 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.552 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229321 s, 45.7 MB/s 2024-01-22T05:16:40.584 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.584 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.584 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028093 s, 37.3 MB/s 2024-01-22T05:16:40.616 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.616 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.616 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271612 s, 38.6 MB/s 2024-01-22T05:16:40.651 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.651 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.652 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328677 s, 31.9 MB/s 2024-01-22T05:16:40.681 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.681 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.681 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255097 s, 41.1 MB/s 2024-01-22T05:16:40.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.714 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.714 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295928 s, 35.4 MB/s 2024-01-22T05:16:40.747 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.748 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.748 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286219 s, 36.6 MB/s 2024-01-22T05:16:40.777 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.777 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.777 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270831 s, 38.7 MB/s 2024-01-22T05:16:40.811 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.811 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.811 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296268 s, 35.4 MB/s 2024-01-22T05:16:40.840 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253997 s, 41.3 MB/s 2024-01-22T05:16:40.869 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.869 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.869 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246988 s, 42.5 MB/s 2024-01-22T05:16:40.898 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.898 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.899 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246912 s, 42.5 MB/s 2024-01-22T05:16:40.926 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.926 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.926 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243021 s, 43.1 MB/s 2024-01-22T05:16:40.951 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.951 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.951 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213821 s, 49.0 MB/s 2024-01-22T05:16:40.980 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:40.981 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:40.981 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025128 s, 41.7 MB/s 2024-01-22T05:16:41.012 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.012 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.012 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267397 s, 39.2 MB/s 2024-01-22T05:16:41.039 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.039 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.039 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238412 s, 44.0 MB/s 2024-01-22T05:16:41.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.074 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.074 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302985 s, 34.6 MB/s 2024-01-22T05:16:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344888 s, 30.4 MB/s 2024-01-22T05:16:41.147 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.147 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.147 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304119 s, 34.5 MB/s 2024-01-22T05:16:41.173 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.173 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.173 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218575 s, 48.0 MB/s 2024-01-22T05:16:41.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:41.175 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:41.176 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:41.176 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.18 2024-01-22T05:16:41.176 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:41.176 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:41.176 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:41.176 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:41.231 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.231 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.231 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025302 s, 41.4 MB/s 2024-01-22T05:16:41.256 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.257 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.257 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222803 s, 47.1 MB/s 2024-01-22T05:16:41.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.282 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220464 s, 47.6 MB/s 2024-01-22T05:16:41.309 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.309 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.309 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230137 s, 45.6 MB/s 2024-01-22T05:16:41.342 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.342 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.342 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291866 s, 35.9 MB/s 2024-01-22T05:16:41.375 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.376 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.376 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300359 s, 34.9 MB/s 2024-01-22T05:16:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332325 s, 31.6 MB/s 2024-01-22T05:16:41.441 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.442 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242469 s, 43.2 MB/s 2024-01-22T05:16:41.465 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.466 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.466 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204544 s, 51.3 MB/s 2024-01-22T05:16:41.498 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.498 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.498 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283815 s, 36.9 MB/s 2024-01-22T05:16:41.528 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.528 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.528 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259358 s, 40.4 MB/s 2024-01-22T05:16:41.561 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.561 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.561 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287983 s, 36.4 MB/s 2024-01-22T05:16:41.598 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.598 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.598 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328076 s, 32.0 MB/s 2024-01-22T05:16:41.629 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.629 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.629 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027399 s, 38.3 MB/s 2024-01-22T05:16:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027356 s, 38.3 MB/s 2024-01-22T05:16:41.685 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.685 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.685 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208471 s, 50.3 MB/s 2024-01-22T05:16:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.712 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.713 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238139 s, 44.0 MB/s 2024-01-22T05:16:41.745 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.745 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.745 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288656 s, 36.3 MB/s 2024-01-22T05:16:41.775 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.776 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.776 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261829 s, 40.0 MB/s 2024-01-22T05:16:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320215 s, 32.7 MB/s 2024-01-22T05:16:41.841 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.841 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.841 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025233 s, 41.6 MB/s 2024-01-22T05:16:41.871 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.871 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.872 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276292 s, 38.0 MB/s 2024-01-22T05:16:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.900 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241619 s, 43.4 MB/s 2024-01-22T05:16:41.929 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.929 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.929 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251821 s, 41.6 MB/s 2024-01-22T05:16:41.955 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.955 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.955 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022411 s, 46.8 MB/s 2024-01-22T05:16:41.985 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:41.985 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:41.985 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268024 s, 39.1 MB/s 2024-01-22T05:16:42.011 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.011 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.011 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220674 s, 47.5 MB/s 2024-01-22T05:16:42.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.044 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.044 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284747 s, 36.8 MB/s 2024-01-22T05:16:42.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.073 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.073 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248895 s, 42.1 MB/s 2024-01-22T05:16:42.100 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.100 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.100 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234241 s, 44.8 MB/s 2024-01-22T05:16:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.131 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268821 s, 39.0 MB/s 2024-01-22T05:16:42.161 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.161 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.161 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266557 s, 39.3 MB/s 2024-01-22T05:16:42.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:42.164 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:42.164 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:42.164 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.19 2024-01-22T05:16:42.164 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:42.164 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:42.164 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:42.164 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:42.226 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.226 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.226 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272036 s, 38.5 MB/s 2024-01-22T05:16:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283719 s, 37.0 MB/s 2024-01-22T05:16:42.293 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.293 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.293 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297568 s, 35.2 MB/s 2024-01-22T05:16:42.324 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.324 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.324 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281264 s, 37.3 MB/s 2024-01-22T05:16:42.356 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.356 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.356 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028089 s, 37.3 MB/s 2024-01-22T05:16:42.391 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.391 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.391 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308891 s, 33.9 MB/s 2024-01-22T05:16:42.426 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.427 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.427 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322466 s, 32.5 MB/s 2024-01-22T05:16:42.462 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.462 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.462 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030698 s, 34.2 MB/s 2024-01-22T05:16:42.503 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.503 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.503 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0361884 s, 29.0 MB/s 2024-01-22T05:16:42.533 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.533 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.533 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254074 s, 41.3 MB/s 2024-01-22T05:16:42.569 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329327 s, 31.8 MB/s 2024-01-22T05:16:42.607 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.607 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.608 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334865 s, 31.3 MB/s 2024-01-22T05:16:42.640 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.640 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271419 s, 38.6 MB/s 2024-01-22T05:16:42.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.669 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249414 s, 42.0 MB/s 2024-01-22T05:16:42.698 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.698 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.698 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253129 s, 41.4 MB/s 2024-01-22T05:16:42.732 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.732 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.732 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298346 s, 35.1 MB/s 2024-01-22T05:16:42.757 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.757 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.758 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227844 s, 46.0 MB/s 2024-01-22T05:16:42.787 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.788 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.788 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257846 s, 40.7 MB/s 2024-01-22T05:16:42.814 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.814 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.814 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220975 s, 47.5 MB/s 2024-01-22T05:16:42.843 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.844 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.844 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261191 s, 40.1 MB/s 2024-01-22T05:16:42.879 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.879 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.879 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323584 s, 32.4 MB/s 2024-01-22T05:16:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.915 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310098 s, 33.8 MB/s 2024-01-22T05:16:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.947 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.947 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277314 s, 37.8 MB/s 2024-01-22T05:16:42.979 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:42.979 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:42.979 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283552 s, 37.0 MB/s 2024-01-22T05:16:43.011 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.011 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.011 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028215 s, 37.2 MB/s 2024-01-22T05:16:43.047 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.047 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.047 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313679 s, 33.4 MB/s 2024-01-22T05:16:43.081 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.081 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.081 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297626 s, 35.2 MB/s 2024-01-22T05:16:43.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.107 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.107 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217035 s, 48.3 MB/s 2024-01-22T05:16:43.140 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.140 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.140 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283437 s, 37.0 MB/s 2024-01-22T05:16:43.167 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.167 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235023 s, 44.6 MB/s 2024-01-22T05:16:43.194 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.194 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.194 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219107 s, 47.9 MB/s 2024-01-22T05:16:43.218 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.218 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.218 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217178 s, 48.3 MB/s 2024-01-22T05:16:43.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:43.220 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:43.220 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:43.220 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.20 2024-01-22T05:16:43.220 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:43.220 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:43.220 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:43.221 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238509 s, 44.0 MB/s 2024-01-22T05:16:43.311 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.311 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.311 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313259 s, 33.5 MB/s 2024-01-22T05:16:43.345 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.345 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.345 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295881 s, 35.4 MB/s 2024-01-22T05:16:43.377 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.377 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.377 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277523 s, 37.8 MB/s 2024-01-22T05:16:43.405 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.405 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.405 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242675 s, 43.2 MB/s 2024-01-22T05:16:43.435 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.435 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.436 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255778 s, 41.0 MB/s 2024-01-22T05:16:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253337 s, 41.4 MB/s 2024-01-22T05:16:43.493 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.493 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.494 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025769 s, 40.7 MB/s 2024-01-22T05:16:43.530 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.530 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.530 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328299 s, 31.9 MB/s 2024-01-22T05:16:43.568 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.568 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.568 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334253 s, 31.4 MB/s 2024-01-22T05:16:43.598 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.598 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.598 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265644 s, 39.5 MB/s 2024-01-22T05:16:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272013 s, 38.5 MB/s 2024-01-22T05:16:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222366 s, 47.2 MB/s 2024-01-22T05:16:43.682 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.682 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.682 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237826 s, 44.1 MB/s 2024-01-22T05:16:43.708 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.708 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.708 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224377 s, 46.7 MB/s 2024-01-22T05:16:43.736 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.736 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.736 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230743 s, 45.4 MB/s 2024-01-22T05:16:43.777 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.777 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.778 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0371469 s, 28.2 MB/s 2024-01-22T05:16:43.807 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.807 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.807 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266184 s, 39.4 MB/s 2024-01-22T05:16:43.832 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.832 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.832 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227664 s, 46.1 MB/s 2024-01-22T05:16:43.859 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.859 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.859 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234586 s, 44.7 MB/s 2024-01-22T05:16:43.906 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.906 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.906 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0434178 s, 24.2 MB/s 2024-01-22T05:16:43.936 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.936 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.936 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250172 s, 41.9 MB/s 2024-01-22T05:16:43.962 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.962 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.962 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224162 s, 46.8 MB/s 2024-01-22T05:16:43.989 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:43.990 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:43.990 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235043 s, 44.6 MB/s 2024-01-22T05:16:44.017 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.017 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.017 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245355 s, 42.7 MB/s 2024-01-22T05:16:44.048 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.048 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.048 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255553 s, 41.0 MB/s 2024-01-22T05:16:44.080 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.080 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.080 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288589 s, 36.3 MB/s 2024-01-22T05:16:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328923 s, 31.9 MB/s 2024-01-22T05:16:44.145 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.145 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.145 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257053 s, 40.8 MB/s 2024-01-22T05:16:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242493 s, 43.2 MB/s 2024-01-22T05:16:44.207 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.207 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.207 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292369 s, 35.9 MB/s 2024-01-22T05:16:44.242 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.242 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.242 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305027 s, 34.4 MB/s 2024-01-22T05:16:44.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:44.245 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:44.245 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:44.245 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.21 2024-01-22T05:16:44.245 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:44.245 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:44.245 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:44.245 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:44.301 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.301 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.302 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241541 s, 43.4 MB/s 2024-01-22T05:16:44.327 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.327 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.328 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222482 s, 47.1 MB/s 2024-01-22T05:16:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290873 s, 36.0 MB/s 2024-01-22T05:16:44.387 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.387 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.388 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229081 s, 45.8 MB/s 2024-01-22T05:16:44.415 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.415 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.415 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253688 s, 41.3 MB/s 2024-01-22T05:16:44.450 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.450 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.450 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311557 s, 33.7 MB/s 2024-01-22T05:16:44.478 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.478 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.478 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247895 s, 42.3 MB/s 2024-01-22T05:16:44.511 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.511 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.511 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287077 s, 36.5 MB/s 2024-01-22T05:16:44.551 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.551 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.551 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344936 s, 30.4 MB/s 2024-01-22T05:16:44.584 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.584 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.584 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291169 s, 36.0 MB/s 2024-01-22T05:16:44.616 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.616 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.616 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270406 s, 38.8 MB/s 2024-01-22T05:16:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305779 s, 34.3 MB/s 2024-01-22T05:16:44.678 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.678 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.678 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231895 s, 45.2 MB/s 2024-01-22T05:16:44.701 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.701 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.701 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203005 s, 51.7 MB/s 2024-01-22T05:16:44.730 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.730 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.730 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252514 s, 41.5 MB/s 2024-01-22T05:16:44.765 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.765 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.765 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030915 s, 33.9 MB/s 2024-01-22T05:16:44.793 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.793 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.793 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247496 s, 42.4 MB/s 2024-01-22T05:16:44.828 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.828 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.828 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304018 s, 34.5 MB/s 2024-01-22T05:16:44.860 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.861 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.861 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279596 s, 37.5 MB/s 2024-01-22T05:16:44.895 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.895 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.895 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297714 s, 35.2 MB/s 2024-01-22T05:16:44.922 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.922 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.922 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229561 s, 45.7 MB/s 2024-01-22T05:16:44.949 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.949 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.949 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022616 s, 46.4 MB/s 2024-01-22T05:16:44.976 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:44.976 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:44.976 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227292 s, 46.1 MB/s 2024-01-22T05:16:45.008 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.008 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.008 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278598 s, 37.6 MB/s 2024-01-22T05:16:45.041 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.041 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.041 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285595 s, 36.7 MB/s 2024-01-22T05:16:45.067 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.067 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.067 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222823 s, 47.1 MB/s 2024-01-22T05:16:45.097 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.097 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.097 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026964 s, 38.9 MB/s 2024-01-22T05:16:45.129 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.130 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.130 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285053 s, 36.8 MB/s 2024-01-22T05:16:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.163 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028807 s, 36.4 MB/s 2024-01-22T05:16:45.190 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238029 s, 44.1 MB/s 2024-01-22T05:16:45.231 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.232 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.232 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0368388 s, 28.5 MB/s 2024-01-22T05:16:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.260 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245893 s, 42.6 MB/s 2024-01-22T05:16:45.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:45.262 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:45.262 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:45.263 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.22 2024-01-22T05:16:45.263 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:45.263 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:45.263 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:45.263 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260639 s, 40.2 MB/s 2024-01-22T05:16:45.352 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.353 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.353 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298885 s, 35.1 MB/s 2024-01-22T05:16:45.386 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.386 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.386 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290959 s, 36.0 MB/s 2024-01-22T05:16:45.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.413 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216457 s, 48.4 MB/s 2024-01-22T05:16:45.446 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.446 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.446 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289821 s, 36.2 MB/s 2024-01-22T05:16:45.477 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.477 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.478 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275235 s, 38.1 MB/s 2024-01-22T05:16:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020887 s, 50.2 MB/s 2024-01-22T05:16:45.524 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.524 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.524 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019325 s, 54.3 MB/s 2024-01-22T05:16:45.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.558 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.558 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295319 s, 35.5 MB/s 2024-01-22T05:16:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.590 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271474 s, 38.6 MB/s 2024-01-22T05:16:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240675 s, 43.6 MB/s 2024-01-22T05:16:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239103 s, 43.9 MB/s 2024-01-22T05:16:45.676 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.676 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.676 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276811 s, 37.9 MB/s 2024-01-22T05:16:45.702 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.702 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.702 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230016 s, 45.6 MB/s 2024-01-22T05:16:45.731 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.731 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.731 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250051 s, 41.9 MB/s 2024-01-22T05:16:45.770 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.770 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.770 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0347158 s, 30.2 MB/s 2024-01-22T05:16:45.800 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.800 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.800 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254825 s, 41.1 MB/s 2024-01-22T05:16:45.829 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.829 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.829 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243514 s, 43.1 MB/s 2024-01-22T05:16:45.860 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.861 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.861 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275122 s, 38.1 MB/s 2024-01-22T05:16:45.889 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.890 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.890 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257605 s, 40.7 MB/s 2024-01-22T05:16:45.923 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.923 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.923 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292263 s, 35.9 MB/s 2024-01-22T05:16:45.954 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.955 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270437 s, 38.8 MB/s 2024-01-22T05:16:45.991 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:45.991 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:45.991 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319381 s, 32.8 MB/s 2024-01-22T05:16:46.019 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.019 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.019 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240572 s, 43.6 MB/s 2024-01-22T05:16:46.056 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.056 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.056 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326226 s, 32.1 MB/s 2024-01-22T05:16:46.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.085 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.085 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245861 s, 42.6 MB/s 2024-01-22T05:16:46.115 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.115 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.115 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269615 s, 38.9 MB/s 2024-01-22T05:16:46.141 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.141 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.141 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229883 s, 45.6 MB/s 2024-01-22T05:16:46.165 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.165 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.166 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208179 s, 50.4 MB/s 2024-01-22T05:16:46.192 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.192 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.192 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223593 s, 46.9 MB/s 2024-01-22T05:16:46.230 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.231 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.231 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344786 s, 30.4 MB/s 2024-01-22T05:16:46.264 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.264 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.264 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292607 s, 35.8 MB/s 2024-01-22T05:16:46.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:46.267 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:46.267 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:46.267 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.23 2024-01-22T05:16:46.267 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:46.267 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:46.267 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:46.267 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:46.318 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.319 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.319 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247613 s, 42.3 MB/s 2024-01-22T05:16:46.354 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.354 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.354 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309781 s, 33.8 MB/s 2024-01-22T05:16:46.373 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.373 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.373 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164832 s, 63.6 MB/s 2024-01-22T05:16:46.398 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.398 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.398 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224335 s, 46.7 MB/s 2024-01-22T05:16:46.429 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.430 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.430 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028393 s, 36.9 MB/s 2024-01-22T05:16:46.458 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.459 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.459 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264671 s, 39.6 MB/s 2024-01-22T05:16:46.497 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.497 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.497 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342305 s, 30.6 MB/s 2024-01-22T05:16:46.543 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.543 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.543 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0426247 s, 24.6 MB/s 2024-01-22T05:16:46.577 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.577 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.577 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291871 s, 35.9 MB/s 2024-01-22T05:16:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.614 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337275 s, 31.1 MB/s 2024-01-22T05:16:46.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.643 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245473 s, 42.7 MB/s 2024-01-22T05:16:46.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.669 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.670 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234051 s, 44.8 MB/s 2024-01-22T05:16:46.703 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.703 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.703 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295201 s, 35.5 MB/s 2024-01-22T05:16:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.736 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280689 s, 37.4 MB/s 2024-01-22T05:16:46.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.780 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0404578 s, 25.9 MB/s 2024-01-22T05:16:46.818 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.818 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.818 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338702 s, 31.0 MB/s 2024-01-22T05:16:46.847 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.848 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.848 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248218 s, 42.2 MB/s 2024-01-22T05:16:46.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.887 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.887 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0356485 s, 29.4 MB/s 2024-01-22T05:16:46.922 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.922 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.922 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301627 s, 34.8 MB/s 2024-01-22T05:16:46.944 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.944 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.944 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195135 s, 53.7 MB/s 2024-01-22T05:16:46.975 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:46.975 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:46.975 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269882 s, 38.9 MB/s 2024-01-22T05:16:47.009 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.010 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.010 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317192 s, 33.1 MB/s 2024-01-22T05:16:47.042 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.042 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.042 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289613 s, 36.2 MB/s 2024-01-22T05:16:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029931 s, 35.0 MB/s 2024-01-22T05:16:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248299 s, 42.2 MB/s 2024-01-22T05:16:47.132 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.132 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.132 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022097 s, 47.5 MB/s 2024-01-22T05:16:47.164 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.164 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.164 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028947 s, 36.2 MB/s 2024-01-22T05:16:47.193 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.193 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.193 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253054 s, 41.4 MB/s 2024-01-22T05:16:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286885 s, 36.6 MB/s 2024-01-22T05:16:47.253 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.254 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.254 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234537 s, 44.7 MB/s 2024-01-22T05:16:47.283 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.283 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.283 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251046 s, 41.8 MB/s 2024-01-22T05:16:47.313 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.314 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.314 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259726 s, 40.4 MB/s 2024-01-22T05:16:47.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:47.316 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:47.316 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:47.316 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.24 2024-01-22T05:16:47.316 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:47.316 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:47.317 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:47.317 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:47.378 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.378 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.378 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311553 s, 33.7 MB/s 2024-01-22T05:16:47.406 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.406 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.407 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239129 s, 43.8 MB/s 2024-01-22T05:16:47.428 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.428 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.428 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188825 s, 55.5 MB/s 2024-01-22T05:16:47.459 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.459 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.459 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279111 s, 37.6 MB/s 2024-01-22T05:16:47.492 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.492 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.492 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274534 s, 38.2 MB/s 2024-01-22T05:16:47.522 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.522 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.522 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258136 s, 40.6 MB/s 2024-01-22T05:16:47.559 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.559 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.559 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334101 s, 31.4 MB/s 2024-01-22T05:16:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300357 s, 34.9 MB/s 2024-01-22T05:16:47.628 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.628 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.628 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309068 s, 33.9 MB/s 2024-01-22T05:16:47.665 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.665 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.665 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323161 s, 32.4 MB/s 2024-01-22T05:16:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025477 s, 41.2 MB/s 2024-01-22T05:16:47.722 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.722 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.722 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232789 s, 45.0 MB/s 2024-01-22T05:16:47.747 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.747 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.747 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230612 s, 45.5 MB/s 2024-01-22T05:16:47.789 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.789 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.789 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0376258 s, 27.9 MB/s 2024-01-22T05:16:47.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.827 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.827 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345977 s, 30.3 MB/s 2024-01-22T05:16:47.862 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.862 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.862 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300663 s, 34.9 MB/s 2024-01-22T05:16:47.899 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.899 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.899 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326885 s, 32.1 MB/s 2024-01-22T05:16:47.928 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.928 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.928 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248337 s, 42.2 MB/s 2024-01-22T05:16:47.966 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:47.966 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:47.966 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0355084 s, 29.5 MB/s 2024-01-22T05:16:48.000 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.001 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.001 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298275 s, 35.2 MB/s 2024-01-22T05:16:48.031 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.031 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.031 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263513 s, 39.8 MB/s 2024-01-22T05:16:48.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.060 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264674 s, 39.6 MB/s 2024-01-22T05:16:48.094 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.094 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.095 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305488 s, 34.3 MB/s 2024-01-22T05:16:48.126 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.127 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027453 s, 38.2 MB/s 2024-01-22T05:16:48.153 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.153 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.153 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237811 s, 44.1 MB/s 2024-01-22T05:16:48.190 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.190 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.190 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321695 s, 32.6 MB/s 2024-01-22T05:16:48.221 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.221 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.221 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269277 s, 38.9 MB/s 2024-01-22T05:16:48.249 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.249 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.250 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238944 s, 43.9 MB/s 2024-01-22T05:16:48.277 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.277 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.277 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243631 s, 43.0 MB/s 2024-01-22T05:16:48.303 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.303 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.303 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222983 s, 47.0 MB/s 2024-01-22T05:16:48.331 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.332 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.332 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024516 s, 42.8 MB/s 2024-01-22T05:16:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.355 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216571 s, 48.4 MB/s 2024-01-22T05:16:48.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:48.358 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:48.358 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:48.358 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.25 2024-01-22T05:16:48.358 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:48.358 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:48.358 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:48.358 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254035 s, 41.3 MB/s 2024-01-22T05:16:48.449 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.449 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.449 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336501 s, 31.2 MB/s 2024-01-22T05:16:48.476 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.476 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.476 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228492 s, 45.9 MB/s 2024-01-22T05:16:48.508 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.508 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.508 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288884 s, 36.3 MB/s 2024-01-22T05:16:48.536 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.536 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.536 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243678 s, 43.0 MB/s 2024-01-22T05:16:48.567 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.568 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.568 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271449 s, 38.6 MB/s 2024-01-22T05:16:48.600 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.600 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.600 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279296 s, 37.5 MB/s 2024-01-22T05:16:48.626 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.626 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.626 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228063 s, 46.0 MB/s 2024-01-22T05:16:48.657 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.658 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.658 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277162 s, 37.8 MB/s 2024-01-22T05:16:48.691 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.691 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.692 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294098 s, 35.7 MB/s 2024-01-22T05:16:48.717 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.717 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.718 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225788 s, 46.4 MB/s 2024-01-22T05:16:48.753 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.754 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.754 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332514 s, 31.5 MB/s 2024-01-22T05:16:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320065 s, 32.8 MB/s 2024-01-22T05:16:48.821 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.821 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.821 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280141 s, 37.4 MB/s 2024-01-22T05:16:48.844 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.844 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.844 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193884 s, 54.1 MB/s 2024-01-22T05:16:48.880 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.880 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.880 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324977 s, 32.3 MB/s 2024-01-22T05:16:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240126 s, 43.7 MB/s 2024-01-22T05:16:48.937 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.937 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.937 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246207 s, 42.6 MB/s 2024-01-22T05:16:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220462 s, 47.6 MB/s 2024-01-22T05:16:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:48.997 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309981 s, 33.8 MB/s 2024-01-22T05:16:49.029 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.029 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.029 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276064 s, 38.0 MB/s 2024-01-22T05:16:49.068 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.069 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.069 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349806 s, 30.0 MB/s 2024-01-22T05:16:49.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.104 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.104 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312159 s, 33.6 MB/s 2024-01-22T05:16:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.141 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322643 s, 32.5 MB/s 2024-01-22T05:16:49.169 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.169 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.170 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253425 s, 41.4 MB/s 2024-01-22T05:16:49.201 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.202 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.202 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279089 s, 37.6 MB/s 2024-01-22T05:16:49.231 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.232 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.232 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260413 s, 40.3 MB/s 2024-01-22T05:16:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216242 s, 48.5 MB/s 2024-01-22T05:16:49.286 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.287 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.287 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254751 s, 41.2 MB/s 2024-01-22T05:16:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.322 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306848 s, 34.2 MB/s 2024-01-22T05:16:49.357 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.357 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.357 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321574 s, 32.6 MB/s 2024-01-22T05:16:49.385 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.385 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.385 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243513 s, 43.1 MB/s 2024-01-22T05:16:49.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:49.388 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:49.388 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:49.388 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.26 2024-01-22T05:16:49.388 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:49.388 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:49.388 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:49.388 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:49.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.445 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.445 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273639 s, 38.3 MB/s 2024-01-22T05:16:49.475 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.475 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.475 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253914 s, 41.3 MB/s 2024-01-22T05:16:49.507 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.507 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.507 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284786 s, 36.8 MB/s 2024-01-22T05:16:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0352624 s, 29.7 MB/s 2024-01-22T05:16:49.582 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.582 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.582 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300072 s, 34.9 MB/s 2024-01-22T05:16:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227372 s, 46.1 MB/s 2024-01-22T05:16:49.628 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.628 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.628 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188587 s, 55.6 MB/s 2024-01-22T05:16:49.658 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.658 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.658 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253841 s, 41.3 MB/s 2024-01-22T05:16:49.679 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.679 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.679 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193006 s, 54.3 MB/s 2024-01-22T05:16:49.718 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.719 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.719 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.035279 s, 29.7 MB/s 2024-01-22T05:16:49.743 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.743 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.743 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211181 s, 49.7 MB/s 2024-01-22T05:16:49.765 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.765 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198442 s, 52.8 MB/s 2024-01-22T05:16:49.792 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.792 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.792 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227964 s, 46.0 MB/s 2024-01-22T05:16:49.863 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.863 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.863 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0673235 s, 15.6 MB/s 2024-01-22T05:16:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247107 s, 42.4 MB/s 2024-01-22T05:16:49.924 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.924 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.925 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029468 s, 35.6 MB/s 2024-01-22T05:16:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.948 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202844 s, 51.7 MB/s 2024-01-22T05:16:49.978 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:49.978 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:49.978 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260825 s, 40.2 MB/s 2024-01-22T05:16:50.012 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.013 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.013 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311519 s, 33.7 MB/s 2024-01-22T05:16:50.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.045 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.045 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280824 s, 37.3 MB/s 2024-01-22T05:16:50.070 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.070 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.070 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207166 s, 50.6 MB/s 2024-01-22T05:16:50.090 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.090 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.090 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175949 s, 59.6 MB/s 2024-01-22T05:16:50.117 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.117 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.117 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233993 s, 44.8 MB/s 2024-01-22T05:16:50.145 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.145 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.145 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243351 s, 43.1 MB/s 2024-01-22T05:16:50.174 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.174 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.174 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259654 s, 40.4 MB/s 2024-01-22T05:16:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.203 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259745 s, 40.4 MB/s 2024-01-22T05:16:50.228 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.228 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.228 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216908 s, 48.3 MB/s 2024-01-22T05:16:50.255 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.255 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.255 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223691 s, 46.9 MB/s 2024-01-22T05:16:50.289 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.289 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.290 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030526 s, 34.4 MB/s 2024-01-22T05:16:50.323 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.323 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.323 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285909 s, 36.7 MB/s 2024-01-22T05:16:50.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.347 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.347 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204088 s, 51.4 MB/s 2024-01-22T05:16:50.383 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.383 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.384 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322639 s, 32.5 MB/s 2024-01-22T05:16:50.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:50.386 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:50.386 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:50.386 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.27 2024-01-22T05:16:50.386 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:50.386 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:50.387 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:50.387 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:50.440 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.440 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.441 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020956 s, 50.0 MB/s 2024-01-22T05:16:50.476 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.477 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.477 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329305 s, 31.8 MB/s 2024-01-22T05:16:50.510 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.510 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.510 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289775 s, 36.2 MB/s 2024-01-22T05:16:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336057 s, 31.2 MB/s 2024-01-22T05:16:50.571 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.571 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.572 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212596 s, 49.3 MB/s 2024-01-22T05:16:50.597 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.597 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.598 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219697 s, 47.7 MB/s 2024-01-22T05:16:50.627 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.627 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.627 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257932 s, 40.7 MB/s 2024-01-22T05:16:50.654 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.654 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.654 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237129 s, 44.2 MB/s 2024-01-22T05:16:50.691 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.691 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.691 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.033633 s, 31.2 MB/s 2024-01-22T05:16:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249688 s, 42.0 MB/s 2024-01-22T05:16:50.749 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.750 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.750 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244912 s, 42.8 MB/s 2024-01-22T05:16:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264012 s, 39.7 MB/s 2024-01-22T05:16:50.808 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.809 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.809 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244979 s, 42.8 MB/s 2024-01-22T05:16:50.838 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.839 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.839 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256289 s, 40.9 MB/s 2024-01-22T05:16:50.872 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.872 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.872 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295909 s, 35.4 MB/s 2024-01-22T05:16:50.903 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.903 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.903 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266668 s, 39.3 MB/s 2024-01-22T05:16:50.937 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030777 s, 34.1 MB/s 2024-01-22T05:16:50.970 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:50.971 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:50.971 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296059 s, 35.4 MB/s 2024-01-22T05:16:51.001 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.002 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.002 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267319 s, 39.2 MB/s 2024-01-22T05:16:51.037 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.038 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.038 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318685 s, 32.9 MB/s 2024-01-22T05:16:51.066 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.066 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.066 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024271 s, 43.2 MB/s 2024-01-22T05:16:51.096 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.096 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.096 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026921 s, 39.0 MB/s 2024-01-22T05:16:51.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.131 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.131 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313702 s, 33.4 MB/s 2024-01-22T05:16:51.161 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.161 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.161 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269013 s, 39.0 MB/s 2024-01-22T05:16:51.201 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.201 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.201 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0351461 s, 29.8 MB/s 2024-01-22T05:16:51.227 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.228 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.228 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220104 s, 47.6 MB/s 2024-01-22T05:16:51.264 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.264 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.264 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032566 s, 32.2 MB/s 2024-01-22T05:16:51.290 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.291 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.291 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219118 s, 47.9 MB/s 2024-01-22T05:16:51.322 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.322 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.322 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270547 s, 38.8 MB/s 2024-01-22T05:16:51.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.350 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.350 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237627 s, 44.1 MB/s 2024-01-22T05:16:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.378 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235131 s, 44.6 MB/s 2024-01-22T05:16:51.406 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.406 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.406 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245893 s, 42.6 MB/s 2024-01-22T05:16:51.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:51.408 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:51.408 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:51.408 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.28 2024-01-22T05:16:51.408 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:51.408 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:51.409 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:51.409 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291352 s, 36.0 MB/s 2024-01-22T05:16:51.497 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.498 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.498 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254754 s, 41.2 MB/s 2024-01-22T05:16:51.527 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.527 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.527 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252999 s, 41.4 MB/s 2024-01-22T05:16:51.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.556 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.556 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250261 s, 41.9 MB/s 2024-01-22T05:16:51.584 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.584 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.584 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239361 s, 43.8 MB/s 2024-01-22T05:16:51.617 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.617 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.617 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288161 s, 36.4 MB/s 2024-01-22T05:16:51.646 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.646 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.646 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251022 s, 41.8 MB/s 2024-01-22T05:16:51.676 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.676 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.676 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264384 s, 39.7 MB/s 2024-01-22T05:16:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247287 s, 42.4 MB/s 2024-01-22T05:16:51.736 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.736 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.736 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267746 s, 39.2 MB/s 2024-01-22T05:16:51.772 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.772 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.772 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320971 s, 32.7 MB/s 2024-01-22T05:16:51.811 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.811 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.811 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0351419 s, 29.8 MB/s 2024-01-22T05:16:51.843 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.843 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.843 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028233 s, 37.1 MB/s 2024-01-22T05:16:51.870 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.871 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.871 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231647 s, 45.3 MB/s 2024-01-22T05:16:51.902 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.902 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.902 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283322 s, 37.0 MB/s 2024-01-22T05:16:51.935 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.935 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.935 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289374 s, 36.2 MB/s 2024-01-22T05:16:51.965 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.965 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.965 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256824 s, 40.8 MB/s 2024-01-22T05:16:51.999 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:51.999 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:51.999 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298815 s, 35.1 MB/s 2024-01-22T05:16:52.030 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.030 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.030 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026687 s, 39.3 MB/s 2024-01-22T05:16:52.058 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.058 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.058 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248854 s, 42.1 MB/s 2024-01-22T05:16:52.087 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.087 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.087 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249168 s, 42.1 MB/s 2024-01-22T05:16:52.116 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.116 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.116 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259242 s, 40.4 MB/s 2024-01-22T05:16:52.145 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249405 s, 42.0 MB/s 2024-01-22T05:16:52.170 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.170 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.170 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205105 s, 51.1 MB/s 2024-01-22T05:16:52.205 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.205 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.205 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305244 s, 34.4 MB/s 2024-01-22T05:16:52.235 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.236 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.236 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258782 s, 40.5 MB/s 2024-01-22T05:16:52.265 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.265 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.265 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250775 s, 41.8 MB/s 2024-01-22T05:16:52.301 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.301 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.301 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322339 s, 32.5 MB/s 2024-01-22T05:16:52.328 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.328 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.328 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227586 s, 46.1 MB/s 2024-01-22T05:16:52.358 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.358 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.358 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247694 s, 42.3 MB/s 2024-01-22T05:16:52.384 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.384 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.384 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222489 s, 47.1 MB/s 2024-01-22T05:16:52.417 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.417 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.417 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296087 s, 35.4 MB/s 2024-01-22T05:16:52.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:52.419 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:52.419 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:52.419 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.29 2024-01-22T05:16:52.419 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:52.419 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:52.419 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:52.419 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:52.472 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.473 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026038 s, 40.3 MB/s 2024-01-22T05:16:52.511 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.512 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0346498 s, 30.3 MB/s 2024-01-22T05:16:52.540 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.540 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.540 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240139 s, 43.7 MB/s 2024-01-22T05:16:52.565 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.565 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.565 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220929 s, 47.5 MB/s 2024-01-22T05:16:52.594 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.594 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.594 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247336 s, 42.4 MB/s 2024-01-22T05:16:52.624 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.624 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.624 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261011 s, 40.2 MB/s 2024-01-22T05:16:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.650 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.651 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228682 s, 45.9 MB/s 2024-01-22T05:16:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0371672 s, 28.2 MB/s 2024-01-22T05:16:52.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.735 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.735 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0384576 s, 27.3 MB/s 2024-01-22T05:16:52.766 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.766 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.766 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027366 s, 38.3 MB/s 2024-01-22T05:16:52.791 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.791 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.791 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219909 s, 47.7 MB/s 2024-01-22T05:16:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272199 s, 38.5 MB/s 2024-01-22T05:16:52.859 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.859 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.859 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327855 s, 32.0 MB/s 2024-01-22T05:16:52.893 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.893 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.894 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295011 s, 35.5 MB/s 2024-01-22T05:16:52.919 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.920 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.920 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223319 s, 47.0 MB/s 2024-01-22T05:16:52.957 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.957 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.957 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332719 s, 31.5 MB/s 2024-01-22T05:16:52.991 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:52.992 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:52.992 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315642 s, 33.2 MB/s 2024-01-22T05:16:53.019 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.019 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.019 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237206 s, 44.2 MB/s 2024-01-22T05:16:53.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.060 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.060 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0361276 s, 29.0 MB/s 2024-01-22T05:16:53.088 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.088 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.088 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247165 s, 42.4 MB/s 2024-01-22T05:16:53.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.121 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.121 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298413 s, 35.1 MB/s 2024-01-22T05:16:53.153 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.153 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.153 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285395 s, 36.7 MB/s 2024-01-22T05:16:53.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.184 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291955 s, 35.9 MB/s 2024-01-22T05:16:53.225 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.225 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.225 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0356947 s, 29.4 MB/s 2024-01-22T05:16:53.257 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.257 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.257 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281006 s, 37.3 MB/s 2024-01-22T05:16:53.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.282 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.283 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021785 s, 48.1 MB/s 2024-01-22T05:16:53.305 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.305 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.305 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204461 s, 51.3 MB/s 2024-01-22T05:16:53.335 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.335 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.335 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026651 s, 39.3 MB/s 2024-01-22T05:16:53.365 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.365 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.365 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259721 s, 40.4 MB/s 2024-01-22T05:16:53.393 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.393 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.393 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240582 s, 43.6 MB/s 2024-01-22T05:16:53.425 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.425 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.425 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282096 s, 37.2 MB/s 2024-01-22T05:16:53.458 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.458 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.458 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293451 s, 35.7 MB/s 2024-01-22T05:16:53.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:53.461 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:53.461 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:53.461 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.30 2024-01-22T05:16:53.461 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:53.461 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:53.461 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:53.461 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:53.515 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.515 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.516 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229136 s, 45.8 MB/s 2024-01-22T05:16:53.541 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.542 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.542 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240779 s, 43.5 MB/s 2024-01-22T05:16:53.578 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.578 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.578 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329097 s, 31.9 MB/s 2024-01-22T05:16:53.604 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.604 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.604 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231329 s, 45.3 MB/s 2024-01-22T05:16:53.632 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.632 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.632 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241822 s, 43.4 MB/s 2024-01-22T05:16:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.664 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280766 s, 37.3 MB/s 2024-01-22T05:16:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292456 s, 35.9 MB/s 2024-01-22T05:16:53.727 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.727 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.727 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025426 s, 41.2 MB/s 2024-01-22T05:16:53.771 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.772 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.772 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0400711 s, 26.2 MB/s 2024-01-22T05:16:53.801 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.802 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.802 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267052 s, 39.3 MB/s 2024-01-22T05:16:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.834 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288774 s, 36.3 MB/s 2024-01-22T05:16:53.853 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.853 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.853 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174943 s, 59.9 MB/s 2024-01-22T05:16:53.881 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.881 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.881 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236509 s, 44.3 MB/s 2024-01-22T05:16:53.911 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.911 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.911 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265012 s, 39.6 MB/s 2024-01-22T05:16:53.938 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.939 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.939 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236314 s, 44.4 MB/s 2024-01-22T05:16:53.974 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:53.974 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:53.974 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309009 s, 33.9 MB/s 2024-01-22T05:16:54.016 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.016 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.016 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0379424 s, 27.6 MB/s 2024-01-22T05:16:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228444 s, 45.9 MB/s 2024-01-22T05:16:54.076 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.076 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.076 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290969 s, 36.0 MB/s 2024-01-22T05:16:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265972 s, 39.4 MB/s 2024-01-22T05:16:54.129 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.129 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.129 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203018 s, 51.6 MB/s 2024-01-22T05:16:54.159 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.159 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.159 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259757 s, 40.4 MB/s 2024-01-22T05:16:54.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.184 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.184 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218991 s, 47.9 MB/s 2024-01-22T05:16:54.212 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.212 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.212 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242221 s, 43.3 MB/s 2024-01-22T05:16:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217346 s, 48.2 MB/s 2024-01-22T05:16:54.270 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.270 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.270 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294087 s, 35.7 MB/s 2024-01-22T05:16:54.303 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.303 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.303 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290356 s, 36.1 MB/s 2024-01-22T05:16:54.335 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.335 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.335 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277898 s, 37.7 MB/s 2024-01-22T05:16:54.362 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024562 s, 42.7 MB/s 2024-01-22T05:16:54.395 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.395 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.395 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287879 s, 36.4 MB/s 2024-01-22T05:16:54.427 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.427 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.427 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281602 s, 37.2 MB/s 2024-01-22T05:16:54.456 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.456 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.456 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254608 s, 41.2 MB/s 2024-01-22T05:16:54.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:16:54.458 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-01-22T05:16:54.458 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:16:54.458 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p scrub_control_test_path/dir.31 2024-01-22T05:16:54.458 DEBUG:teuthology.orchestra.run.smithi049:> for ((i = 0; i < 32; i++)); do 2024-01-22T05:16:54.458 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-01-22T05:16:54.458 DEBUG:teuthology.orchestra.run.smithi049:> done 2024-01-22T05:16:54.458 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:16:54.514 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.514 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.514 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247347 s, 42.4 MB/s 2024-01-22T05:16:54.542 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.542 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.542 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246431 s, 42.6 MB/s 2024-01-22T05:16:54.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.575 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289688 s, 36.2 MB/s 2024-01-22T05:16:54.610 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.610 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.610 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305221 s, 34.4 MB/s 2024-01-22T05:16:54.643 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.644 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.644 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289357 s, 36.2 MB/s 2024-01-22T05:16:54.668 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.668 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.668 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021536 s, 48.7 MB/s 2024-01-22T05:16:54.699 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.699 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.699 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267233 s, 39.2 MB/s 2024-01-22T05:16:54.725 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.725 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.725 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228766 s, 45.8 MB/s 2024-01-22T05:16:54.754 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.754 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.754 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253976 s, 41.3 MB/s 2024-01-22T05:16:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.782 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238735 s, 43.9 MB/s 2024-01-22T05:16:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261943 s, 40.0 MB/s 2024-01-22T05:16:54.841 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.841 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.841 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264222 s, 39.7 MB/s 2024-01-22T05:16:54.876 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.876 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.876 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304605 s, 34.4 MB/s 2024-01-22T05:16:54.913 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.914 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.914 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0331315 s, 31.6 MB/s 2024-01-22T05:16:54.941 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.942 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.942 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248297 s, 42.2 MB/s 2024-01-22T05:16:54.975 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:54.975 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:54.975 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296516 s, 35.4 MB/s 2024-01-22T05:16:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267878 s, 39.1 MB/s 2024-01-22T05:16:55.036 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.037 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.037 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256556 s, 40.9 MB/s 2024-01-22T05:16:55.062 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.062 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.062 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228466 s, 45.9 MB/s 2024-01-22T05:16:55.091 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.091 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.091 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252246 s, 41.6 MB/s 2024-01-22T05:16:55.120 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.120 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.120 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246854 s, 42.5 MB/s 2024-01-22T05:16:55.147 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.147 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.147 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238763 s, 43.9 MB/s 2024-01-22T05:16:55.182 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.182 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.182 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301988 s, 34.7 MB/s 2024-01-22T05:16:55.212 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.212 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.212 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255221 s, 41.1 MB/s 2024-01-22T05:16:55.249 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.249 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.249 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032921 s, 31.9 MB/s 2024-01-22T05:16:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.278 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246315 s, 42.6 MB/s 2024-01-22T05:16:55.306 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.306 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.306 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239568 s, 43.8 MB/s 2024-01-22T05:16:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289125 s, 36.3 MB/s 2024-01-22T05:16:55.365 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.365 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.365 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217916 s, 48.1 MB/s 2024-01-22T05:16:55.391 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.392 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.392 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235168 s, 44.6 MB/s 2024-01-22T05:16:55.423 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.423 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.423 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280875 s, 37.3 MB/s 2024-01-22T05:16:55.453 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-22T05:16:55.453 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-22T05:16:55.453 INFO:teuthology.orchestra.run.smithi049.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259086 s, 40.5 MB/s 2024-01-22T05:16:55.455 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2024-01-22T05:16:55.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.624+0000 7f431d600700 1 Processor -- start 2024-01-22T05:16:55.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.628+0000 7f431d600700 1 -- start start 2024-01-22T05:16:55.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.628+0000 7f431d600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4318156260 0x7f43180c2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.628+0000 7f431d600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f43180c2b40 0x7f43181516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.628+0000 7f431d600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4318066d80 con 0x7f4318151b90 2024-01-22T05:16:55.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f431d600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43180675e0 con 0x7f43180c2b40 2024-01-22T05:16:55.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f431d600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4318067020 con 0x7f4318156260 2024-01-22T05:16:55.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f4316000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f43180c2b40 0x7f43181516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f4316000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f43180c2b40 0x7f43181516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54564/0 (socket says 172.21.15.49:54564) 2024-01-22T05:16:55.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f4316000700 1 -- 172.21.15.49:0/3379484024 learned_addr learned my addr 172.21.15.49:0/3379484024 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:55.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f4316a00700 1 --2- 172.21.15.49:0/3379484024 >> v2:172.21.15.110:3300/0 conn(0x7f4318156260 0x7f43180c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f4316000700 1 -- 172.21.15.49:0/3379484024 >> v2:172.21.15.110:3300/0 conn(0x7f4318156260 msgr2=0x7f43180c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f4316000700 1 --2- 172.21.15.49:0/3379484024 >> v2:172.21.15.110:3300/0 conn(0x7f4318156260 0x7f43180c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f4316000700 1 -- 172.21.15.49:0/3379484024 >> v1:172.21.15.49:6789/0 conn(0x7f4318151b90 legacy=0x7f43180ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f4316000700 1 -- 172.21.15.49:0/3379484024 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4318067300 con 0x7f43180c2b40 2024-01-22T05:16:55.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f4316000700 1 --2- 172.21.15.49:0/3379484024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43180c2b40 0x7f43181516a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f4318064350 tx=0x7f43000090f0).ready entity=mon.0 client_cookie=a82e601fd89aa14e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:55.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f4315600700 1 -- 172.21.15.49:0/3379484024 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000b600 con 0x7f43180c2b40 2024-01-22T05:16:55.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f4315600700 1 -- 172.21.15.49:0/3379484024 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430000b760 con 0x7f43180c2b40 2024-01-22T05:16:55.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f4315600700 1 -- 172.21.15.49:0/3379484024 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000bae0 con 0x7f43180c2b40 2024-01-22T05:16:55.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f431d600700 1 -- 172.21.15.49:0/3379484024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43180c2b40 msgr2=0x7f43181516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f431d600700 1 --2- 172.21.15.49:0/3379484024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43180c2b40 0x7f43181516a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f4318064350 tx=0x7f43000090f0).stop 2024-01-22T05:16:55.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f431d600700 1 -- 172.21.15.49:0/3379484024 shutdown_connections 2024-01-22T05:16:55.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f431d600700 1 --2- 172.21.15.49:0/3379484024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43180c2b40 0x7f43181516a0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f431d600700 1 --2- 172.21.15.49:0/3379484024 >> v2:172.21.15.110:3300/0 conn(0x7f4318156260 0x7f43180c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f431d600700 1 -- 172.21.15.49:0/3379484024 >> 172.21.15.49:0/3379484024 conn(0x7f43180c6500 msgr2=0x7f43180c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:55.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f431d600700 1 -- 172.21.15.49:0/3379484024 shutdown_connections 2024-01-22T05:16:55.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.632+0000 7f431d600700 1 -- 172.21.15.49:0/3379484024 wait complete. 2024-01-22T05:16:55.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.636+0000 7f431d600700 1 Processor -- start 2024-01-22T05:16:55.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.636+0000 7f431d600700 1 -- start start 2024-01-22T05:16:55.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f431d600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43180c2b40 0x7f43180ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f431d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4318151b90 0x7f43180abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f431d600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4318156260 0x7f431814c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f431d600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43180abfa0 con 0x7f4318151b90 2024-01-22T05:16:55.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f431d600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43180be760 con 0x7f4318156260 2024-01-22T05:16:55.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f431d600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43180bea40 con 0x7f43180c2b40 2024-01-22T05:16:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f4316000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4318151b90 0x7f43180abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f4316000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4318151b90 0x7f43180abab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54572/0 (socket says 172.21.15.49:54572) 2024-01-22T05:16:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f4316000700 1 -- 172.21.15.49:0/1903314034 learned_addr learned my addr 172.21.15.49:0/1903314034 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f4317400700 1 --2- 172.21.15.49:0/1903314034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4318156260 0x7f431814c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f4316a00700 1 --2- 172.21.15.49:0/1903314034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43180c2b40 0x7f43180ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f4316000700 1 -- 172.21.15.49:0/1903314034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43180c2b40 msgr2=0x7f43180ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f4316000700 1 --2- 172.21.15.49:0/1903314034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43180c2b40 0x7f43180ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f4316000700 1 -- 172.21.15.49:0/1903314034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4318156260 msgr2=0x7f431814c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f4316000700 1 --2- 172.21.15.49:0/1903314034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4318156260 0x7f431814c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f4316000700 1 -- 172.21.15.49:0/1903314034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4300009370 con 0x7f4318151b90 2024-01-22T05:16:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f4317400700 1 --2- 172.21.15.49:0/1903314034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4318156260 0x7f431814c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f4316000700 1 --2- 172.21.15.49:0/1903314034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4318151b90 0x7f43180abab0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f4300011000 tx=0x7f4300017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f430e000700 1 -- 172.21.15.49:0/1903314034 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000b8d0 con 0x7f4318151b90 2024-01-22T05:16:55.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f430e000700 1 -- 172.21.15.49:0/1903314034 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430000ba30 con 0x7f4318151b90 2024-01-22T05:16:55.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f431d600700 1 -- 172.21.15.49:0/1903314034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43180bed20 con 0x7f4318151b90 2024-01-22T05:16:55.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f430e000700 1 -- 172.21.15.49:0/1903314034 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430001c630 con 0x7f4318151b90 2024-01-22T05:16:55.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.640+0000 7f431d600700 1 -- 172.21.15.49:0/1903314034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43181503e0 con 0x7f4318151b90 2024-01-22T05:16:55.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.644+0000 7f430e000700 1 -- 172.21.15.49:0/1903314034 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f430001ca20 con 0x7f4318151b90 2024-01-22T05:16:55.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.644+0000 7f430e000700 1 --2- 172.21.15.49:0/1903314034 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f42f005a540 0x7f42f005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.644+0000 7f430e000700 1 -- 172.21.15.49:0/1903314034 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f4300076750 con 0x7f4318151b90 2024-01-22T05:16:55.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.644+0000 7f4316a00700 1 --2- 172.21.15.49:0/1903314034 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f42f005a540 0x7f42f005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.648+0000 7f4316a00700 1 --2- 172.21.15.49:0/1903314034 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f42f005a540 0x7f42f005ca00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f4308006fd0 tx=0x7f4308008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:55.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.648+0000 7f4327a6f740 1 Processor -- start 2024-01-22T05:16:55.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.648+0000 7f4327a6f740 1 -- start start 2024-01-22T05:16:55.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4327a6f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 0x13f1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4327a6f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13ada10 0x13eeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4327a6f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13eefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4327a6f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1318780 con 0x13d3b30 2024-01-22T05:16:55.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4327a6f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x12f9340 con 0x13f1020 2024-01-22T05:16:55.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4327a6f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x12e0530 con 0x13ada10 2024-01-22T05:16:55.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4317400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13eefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4317400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13eefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54574/0 (socket says 172.21.15.49:54574) 2024-01-22T05:16:55.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4317400700 1 -- 172.21.15.49:0/1110757284 learned_addr learned my addr 172.21.15.49:0/1110757284 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:55.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4316a00700 1 --2- 172.21.15.49:0/1110757284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 0x13f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4316000700 1 --2- 172.21.15.49:0/1110757284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13ada10 0x13eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4317400700 1 -- 172.21.15.49:0/1110757284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13ada10 msgr2=0x13eeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4317400700 1 --2- 172.21.15.49:0/1110757284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13ada10 0x13eeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4317400700 1 -- 172.21.15.49:0/1110757284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 msgr2=0x13f1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4317400700 1 --2- 172.21.15.49:0/1110757284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 0x13f1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4317400700 1 -- 172.21.15.49:0/1110757284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1339700 con 0x13d3b30 2024-01-22T05:16:55.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4317400700 1 --2- 172.21.15.49:0/1110757284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13eefd0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f4310001c50 tx=0x7f4310009040).ready entity=mon.0 client_cookie=2f13ae512de48a00 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:55.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4306600700 1 -- 172.21.15.49:0/1110757284 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000e860 con 0x13d3b30 2024-01-22T05:16:55.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4306600700 1 -- 172.21.15.49:0/1110757284 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431000e9c0 con 0x13d3b30 2024-01-22T05:16:55.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4306600700 1 -- 172.21.15.49:0/1110757284 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000ed60 con 0x13d3b30 2024-01-22T05:16:55.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4327a6f740 1 -- 172.21.15.49:0/1110757284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 msgr2=0x13eefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.652+0000 7f4327a6f740 1 --2- 172.21.15.49:0/1110757284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13eefd0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f4310001c50 tx=0x7f4310009040).stop 2024-01-22T05:16:55.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.656+0000 7f4327a6f740 1 -- 172.21.15.49:0/1110757284 shutdown_connections 2024-01-22T05:16:55.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.656+0000 7f4327a6f740 1 --2- 172.21.15.49:0/1110757284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13eefd0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.656+0000 7f4327a6f740 1 --2- 172.21.15.49:0/1110757284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13ada10 0x13eeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.656+0000 7f4327a6f740 1 --2- 172.21.15.49:0/1110757284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 0x13f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.656+0000 7f4327a6f740 1 -- 172.21.15.49:0/1110757284 >> 172.21.15.49:0/1110757284 conn(0x118c920 msgr2=0x13adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:55.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.656+0000 7f4327a6f740 1 -- 172.21.15.49:0/1110757284 shutdown_connections 2024-01-22T05:16:55.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.656+0000 7f4327a6f740 1 -- 172.21.15.49:0/1110757284 wait complete. 2024-01-22T05:16:55.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.656+0000 7f4327a6f740 1 -- start start 2024-01-22T05:16:55.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.656+0000 7f4327a6f740 1 Processor -- start 2024-01-22T05:16:55.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4327a6f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4327a6f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13f1020 0x13d7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4327a6f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13d7840 0x13d1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4327a6f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x13d4110 con 0x13d3b30 2024-01-22T05:16:55.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4327a6f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x13d7ce0 con 0x13d7840 2024-01-22T05:16:55.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4327a6f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x13d8fe0 con 0x13f1020 2024-01-22T05:16:55.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4327a6f740 10 client.0 ll_register_callbacks cb 0x1364e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:16:55.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4316a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4316a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54582/0 (socket says 172.21.15.49:54582) 2024-01-22T05:16:55.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4316a00700 1 -- 172.21.15.49:0/360912060 learned_addr learned my addr 172.21.15.49:0/360912060 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:55.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4316000700 1 --2- 172.21.15.49:0/360912060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13f1020 0x13d7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4317400700 1 --2- 172.21.15.49:0/360912060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13d7840 0x13d1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4316a00700 1 -- 172.21.15.49:0/360912060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13f1020 msgr2=0x13d7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4316a00700 1 --2- 172.21.15.49:0/360912060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13f1020 0x13d7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4316a00700 1 -- 172.21.15.49:0/360912060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13d7840 msgr2=0x13d1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4316a00700 1 --2- 172.21.15.49:0/360912060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13d7840 0x13d1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4316a00700 1 -- 172.21.15.49:0/360912060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431000f040 con 0x13d3b30 2024-01-22T05:16:55.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4316a00700 1 --2- 172.21.15.49:0/360912060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13ab860 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f4308013580 tx=0x7f4308014000).ready entity=mon.0 client_cookie=17b0631a1bb34d77 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:55.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f42fea00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:16:55.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f42fea00700 1 -- 172.21.15.49:0/360912060 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430801f3f0 con 0x13d3b30 2024-01-22T05:16:55.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f42fea00700 1 -- 172.21.15.49:0/360912060 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f430801f550 con 0x13d3b30 2024-01-22T05:16:55.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.660+0000 7f4327a6f740 1 -- 172.21.15.49:0/360912060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1323e20 con 0x13d3b30 2024-01-22T05:16:55.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f42fea00700 1 -- 172.21.15.49:0/360912060 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7f430801f920 con 0x13d3b30 2024-01-22T05:16:55.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f4327a6f740 10 client.9027 fetch_fsmap learned FSMap version 114 2024-01-22T05:16:55.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f4327a6f740 1 -- 172.21.15.49:0/360912060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) v3 -- 0x13273b0 con 0x13d3b30 2024-01-22T05:16:55.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f42fea00700 1 -- 172.21.15.49:0/360912060 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1323e20 con 0x13d3b30 2024-01-22T05:16:55.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f42fea00700 1 -- 172.21.15.49:0/360912060 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 114) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f430801fa80 con 0x13d3b30 2024-01-22T05:16:55.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f4327a6f740 10 client.9027 fetch_fsmap finished waiting for FSMap version 114 2024-01-22T05:16:55.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f4327a6f740 10 client.9027 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-01-22T05:16:55.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f4327a6f740 20 client.9027 populate_metadata read hostname 'smithi049' 2024-01-22T05:16:55.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f4327a6f740 1 --2- 172.21.15.49:0/360912060 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x1404210 0x14045f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f4327a6f740 4 client.9027 mds_command: new command op to 8829 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:16:55.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f4327a6f740 1 -- 172.21.15.49:0/360912060 --> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x131a370 con 0x1404210 2024-01-22T05:16:55.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f4316000700 1 --2- 172.21.15.49:0/360912060 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x1404210 0x14045f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f42fea00700 10 client.9027 ms_handle_connect on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f4316000700 1 --2- 172.21.15.49:0/360912060 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x1404210 0x14045f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c7f9b8db17caddeb server_cookie=484ef6cfcf20d73f in_seq=0 out_seq=0 2024-01-22T05:16:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f42fea00700 1 -- 172.21.15.49:0/360912060 <== mds.0 v2:172.21.15.49:6835/4015076184 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x131a370 con 0x1404210 2024-01-22T05:16:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f42fea00700 10 client.9027 handle_command_reply: tid=0 2024-01-22T05:16:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.664+0000 7f4327a6f740 1 client.9027 shutdown 2024-01-22T05:16:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.668+0000 7f4327a6f740 1 -- 172.21.15.49:0/360912060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 msgr2=0x13ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.668+0000 7f4327a6f740 1 --2- 172.21.15.49:0/360912060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13ab860 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f4308013580 tx=0x7f4308014000).stop 2024-01-22T05:16:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.668+0000 7f4327a6f740 1 -- 172.21.15.49:0/360912060 shutdown_connections 2024-01-22T05:16:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.668+0000 7f4327a6f740 1 --2- 172.21.15.49:0/360912060 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x1404210 0x14045f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.668+0000 7f4327a6f740 1 --2- 172.21.15.49:0/360912060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13d7840 0x13d1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.668+0000 7f4327a6f740 1 --2- 172.21.15.49:0/360912060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13f1020 0x13d7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.668+0000 7f4327a6f740 1 --2- 172.21.15.49:0/360912060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13ab860 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.668+0000 7f42fea00700 0 client.9027 ms_handle_reset on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.668+0000 7f4327a6f740 1 -- 172.21.15.49:0/360912060 >> 172.21.15.49:0/360912060 conn(0x118c920 msgr2=0x13f4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:55.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.668+0000 7f4327a6f740 1 -- 172.21.15.49:0/360912060 shutdown_connections 2024-01-22T05:16:55.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.668+0000 7f4327a6f740 1 -- 172.21.15.49:0/360912060 wait complete. 2024-01-22T05:16:55.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.668+0000 7f4327a6f740 20 client.9027 trim_cache size 0 max 16384 2024-01-22T05:16:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4327a6f740 1 Processor -- start 2024-01-22T05:16:55.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4327a6f740 1 -- start start 2024-01-22T05:16:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4327a6f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x1403340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4327a6f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 0x1402d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4327a6f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13d2e30 0x13ed490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4327a6f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x13d0db0 con 0x13d3b30 2024-01-22T05:16:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4327a6f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x13d1160 con 0x13f1020 2024-01-22T05:16:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4327a6f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x13389f0 con 0x13d2e30 2024-01-22T05:16:55.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4316a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x1403340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4316a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x1403340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54584/0 (socket says 172.21.15.49:54584) 2024-01-22T05:16:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4316a00700 1 -- 172.21.15.49:0/1245380027 learned_addr learned my addr 172.21.15.49:0/1245380027 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4316000700 1 --2- 172.21.15.49:0/1245380027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 0x1402d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4317400700 1 --2- 172.21.15.49:0/1245380027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13d2e30 0x13ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4316a00700 1 -- 172.21.15.49:0/1245380027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13d2e30 msgr2=0x13ed490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4316a00700 1 --2- 172.21.15.49:0/1245380027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13d2e30 0x13ed490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4316a00700 1 -- 172.21.15.49:0/1245380027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 msgr2=0x1402d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4316a00700 1 --2- 172.21.15.49:0/1245380027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 0x1402d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4316a00700 1 -- 172.21.15.49:0/1245380027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x13abbc0 con 0x13d3b30 2024-01-22T05:16:55.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4316000700 1 --2- 172.21.15.49:0/1245380027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 0x1402d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4316a00700 1 --2- 172.21.15.49:0/1245380027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x1403340 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f4308006f70 tx=0x7f4308021000).ready entity=mon.0 client_cookie=f400d81c76d8da29 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.688+0000 7f4307000700 1 -- 172.21.15.49:0/1245380027 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430800f630 con 0x13d3b30 2024-01-22T05:16:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.692+0000 7f4307000700 1 -- 172.21.15.49:0/1245380027 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430801f3f0 con 0x13d3b30 2024-01-22T05:16:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.692+0000 7f4307000700 1 -- 172.21.15.49:0/1245380027 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430801fb30 con 0x13d3b30 2024-01-22T05:16:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.692+0000 7f4327a6f740 1 -- 172.21.15.49:0/1245380027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 msgr2=0x1403340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.692+0000 7f4327a6f740 1 --2- 172.21.15.49:0/1245380027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x1403340 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f4308006f70 tx=0x7f4308021000).stop 2024-01-22T05:16:55.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.692+0000 7f4327a6f740 1 -- 172.21.15.49:0/1245380027 shutdown_connections 2024-01-22T05:16:55.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.692+0000 7f4327a6f740 1 --2- 172.21.15.49:0/1245380027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13d2e30 0x13ed490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.692+0000 7f4327a6f740 1 --2- 172.21.15.49:0/1245380027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 0x1402d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.692+0000 7f4327a6f740 1 --2- 172.21.15.49:0/1245380027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x1403340 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.692+0000 7f4327a6f740 1 -- 172.21.15.49:0/1245380027 >> 172.21.15.49:0/1245380027 conn(0x118c920 msgr2=0x13a8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:55.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.692+0000 7f4327a6f740 1 -- 172.21.15.49:0/1245380027 shutdown_connections 2024-01-22T05:16:55.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.692+0000 7f4327a6f740 1 -- 172.21.15.49:0/1245380027 wait complete. 2024-01-22T05:16:55.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.692+0000 7f4327a6f740 1 -- start start 2024-01-22T05:16:55.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.692+0000 7f4327a6f740 1 Processor -- start 2024-01-22T05:16:55.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4327a6f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13d2e30 0x13eee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4327a6f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13a7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4327a6f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 0x13a7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4327a6f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x13ef6c0 con 0x13d3b30 2024-01-22T05:16:55.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4327a6f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x13a7aa0 con 0x13f1020 2024-01-22T05:16:55.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4327a6f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x13ef830 con 0x13d2e30 2024-01-22T05:16:55.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4327a6f740 10 client.0 ll_register_callbacks cb 0x13d3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:16:55.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4316000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13a7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4316000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13a7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54594/0 (socket says 172.21.15.49:54594) 2024-01-22T05:16:55.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4316000700 1 -- 172.21.15.49:0/49311058 learned_addr learned my addr 172.21.15.49:0/49311058 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:55.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4317400700 1 --2- 172.21.15.49:0/49311058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 0x13a7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4316a00700 1 --2- 172.21.15.49:0/49311058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13d2e30 0x13eee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4316000700 1 -- 172.21.15.49:0/49311058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13d2e30 msgr2=0x13eee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4316000700 1 --2- 172.21.15.49:0/49311058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13d2e30 0x13eee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4316000700 1 -- 172.21.15.49:0/49311058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 msgr2=0x13a7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4316000700 1 --2- 172.21.15.49:0/49311058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 0x13a7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4316000700 1 -- 172.21.15.49:0/49311058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x13273b0 con 0x13d3b30 2024-01-22T05:16:55.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4316000700 1 --2- 172.21.15.49:0/49311058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13a7040 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f4300009fd0 tx=0x7f4300076040).ready entity=mon.0 client_cookie=9966ead401ecc62d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:55.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f42fea00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:16:55.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f42fea00700 1 -- 172.21.15.49:0/49311058 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300052040 con 0x13d3b30 2024-01-22T05:16:55.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f42fea00700 1 -- 172.21.15.49:0/49311058 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f430001ccd0 con 0x13d3b30 2024-01-22T05:16:55.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4327a6f740 1 -- 172.21.15.49:0/49311058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f431000e9c0 con 0x13d3b30 2024-01-22T05:16:55.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f42fea00700 1 -- 172.21.15.49:0/49311058 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7f430001ce90 con 0x13d3b30 2024-01-22T05:16:55.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4327a6f740 10 client.9033 fetch_fsmap learned FSMap version 114 2024-01-22T05:16:55.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.696+0000 7f4327a6f740 1 -- 172.21.15.49:0/49311058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) v3 -- 0x7f43180c32d0 con 0x13d3b30 2024-01-22T05:16:55.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.700+0000 7f42fea00700 1 -- 172.21.15.49:0/49311058 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431000e9c0 con 0x13d3b30 2024-01-22T05:16:55.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.700+0000 7f42fea00700 1 -- 172.21.15.49:0/49311058 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 114) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f430003a020 con 0x13d3b30 2024-01-22T05:16:55.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.700+0000 7f4327a6f740 10 client.9033 fetch_fsmap finished waiting for FSMap version 114 2024-01-22T05:16:55.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.700+0000 7f4327a6f740 10 client.9033 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-01-22T05:16:55.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.700+0000 7f4327a6f740 20 client.9033 populate_metadata read hostname 'smithi049' 2024-01-22T05:16:55.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.700+0000 7f4327a6f740 1 --2- 172.21.15.49:0/49311058 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x1406ca0 0x14070b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.700+0000 7f4327a6f740 4 client.9033 mds_command: new command op to 8829 tid=0[{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-01-22T05:16:55.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.700+0000 7f4327a6f740 1 -- 172.21.15.49:0/49311058 --> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x11e38b0 con 0x1406ca0 2024-01-22T05:16:55.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.700+0000 7f4316a00700 1 --2- 172.21.15.49:0/49311058 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x1406ca0 0x14070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.700+0000 7f42fea00700 10 client.9033 ms_handle_connect on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:55.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.700+0000 7f4316a00700 1 --2- 172.21.15.49:0/49311058 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x1406ca0 0x14070b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d6ef0ee9f5bf7a99 server_cookie=cf29753618f9e898 in_seq=0 out_seq=0 2024-01-22T05:16:55.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.704+0000 7f42fea00700 1 -- 172.21.15.49:0/49311058 <== mds.0 v2:172.21.15.49:6835/4015076184 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x11e38b0 con 0x1406ca0 2024-01-22T05:16:55.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.704+0000 7f42fea00700 10 client.9033 handle_command_reply: tid=0 2024-01-22T05:16:55.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.704+0000 7f4327a6f740 1 client.9033 shutdown 2024-01-22T05:16:55.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.704+0000 7f4327a6f740 1 -- 172.21.15.49:0/49311058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 msgr2=0x13a7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.704+0000 7f4327a6f740 1 --2- 172.21.15.49:0/49311058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13a7040 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f4300009fd0 tx=0x7f4300076040).stop 2024-01-22T05:16:55.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.704+0000 7f4327a6f740 1 -- 172.21.15.49:0/49311058 shutdown_connections 2024-01-22T05:16:55.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.704+0000 7f4327a6f740 1 --2- 172.21.15.49:0/49311058 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x1406ca0 0x14070b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.704+0000 7f4327a6f740 1 --2- 172.21.15.49:0/49311058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13f1020 0x13a7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.704+0000 7f4327a6f740 1 --2- 172.21.15.49:0/49311058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13d3b30 0x13a7040 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.704+0000 7f42fea00700 0 client.9033 ms_handle_reset on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:55.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.704+0000 7f4327a6f740 1 --2- 172.21.15.49:0/49311058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13d2e30 0x13eee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.704+0000 7f4327a6f740 1 -- 172.21.15.49:0/49311058 >> 172.21.15.49:0/49311058 conn(0x118c920 msgr2=0x1401a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:55.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.704+0000 7f4327a6f740 1 -- 172.21.15.49:0/49311058 shutdown_connections 2024-01-22T05:16:55.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.704+0000 7f4327a6f740 1 -- 172.21.15.49:0/49311058 wait complete. 2024-01-22T05:16:55.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.704+0000 7f4327a6f740 20 client.9033 trim_cache size 0 max 16384 2024-01-22T05:16:55.706 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:16:55.706 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:16:55.707 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "9b173eb5-f758-4dfb-8042-e5b5bdf8e38f", 2024-01-22T05:16:55.707 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:16:55.707 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:16:55.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.708+0000 7f431d600700 1 -- 172.21.15.49:0/1903314034 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f42f005a540 msgr2=0x7f42f005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.708+0000 7f431d600700 1 --2- 172.21.15.49:0/1903314034 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f42f005a540 0x7f42f005ca00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f4308006fd0 tx=0x7f4308008040).stop 2024-01-22T05:16:55.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.708+0000 7f431d600700 1 -- 172.21.15.49:0/1903314034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4318151b90 msgr2=0x7f43180abab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.708+0000 7f431d600700 1 --2- 172.21.15.49:0/1903314034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4318151b90 0x7f43180abab0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f4300011000 tx=0x7f4300017000).stop 2024-01-22T05:16:55.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.708+0000 7f431d600700 1 -- 172.21.15.49:0/1903314034 shutdown_connections 2024-01-22T05:16:55.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.708+0000 7f431d600700 1 --2- 172.21.15.49:0/1903314034 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f42f005a540 0x7f42f005ca00 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.708+0000 7f431d600700 1 --2- 172.21.15.49:0/1903314034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4318156260 0x7f431814c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.708+0000 7f431d600700 1 --2- 172.21.15.49:0/1903314034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4318151b90 0x7f43180abab0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.708+0000 7f431d600700 1 --2- 172.21.15.49:0/1903314034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43180c2b40 0x7f43180ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.708+0000 7f431d600700 1 -- 172.21.15.49:0/1903314034 >> 172.21.15.49:0/1903314034 conn(0x7f43180c6500 msgr2=0x7f43180bfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:55.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.708+0000 7f431d600700 1 -- 172.21.15.49:0/1903314034 shutdown_connections 2024-01-22T05:16:55.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.708+0000 7f431d600700 1 -- 172.21.15.49:0/1903314034 wait complete. 2024-01-22T05:16:55.731 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.9:0 scrub pause 2024-01-22T05:16:55.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.920+0000 7f19a8e00700 1 Processor -- start 2024-01-22T05:16:55.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.920+0000 7f19a8e00700 1 -- start start 2024-01-22T05:16:55.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.924+0000 7f19a8e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f19a4069060 0x7f19a4062a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.924+0000 7f19a8e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a4069440 con 0x7f19a4062f50 2024-01-22T05:16:55.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.924+0000 7f19a8e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a40642a0 con 0x7f19a4153c30 2024-01-22T05:16:55.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.924+0000 7f19a8e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a4064730 con 0x7f19a4069060 2024-01-22T05:16:55.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.924+0000 7f19a1e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f19a4069060 0x7f19a4062a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.924+0000 7f19a1e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f19a4069060 0x7f19a4062a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54610/0 (socket says 172.21.15.49:54610) 2024-01-22T05:16:55.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.924+0000 7f19a1e00700 1 -- 172.21.15.49:0/1971679068 learned_addr learned my addr 172.21.15.49:0/1971679068 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:55.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.924+0000 7f19a1e00700 1 -- 172.21.15.49:0/1971679068 >> v1:172.21.15.110:6789/0 conn(0x7f19a4153c30 legacy=0x7f19a40bbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.924+0000 7f19a1e00700 1 -- 172.21.15.49:0/1971679068 >> v1:172.21.15.49:6789/0 conn(0x7f19a4062f50 legacy=0x7f19a4153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.924+0000 7f19a1e00700 1 -- 172.21.15.49:0/1971679068 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a4066f10 con 0x7f19a4069060 2024-01-22T05:16:55.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.928+0000 7f19a1e00700 1 --2- 172.21.15.49:0/1971679068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19a4069060 0x7f19a4062a60 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f1994006fd0 tx=0x7f19940090f0).ready entity=mon.0 client_cookie=e153eade93757915 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:55.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.928+0000 7f19a0a00700 1 -- 172.21.15.49:0/1971679068 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199400b600 con 0x7f19a4069060 2024-01-22T05:16:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.928+0000 7f19a0a00700 1 -- 172.21.15.49:0/1971679068 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199400b760 con 0x7f19a4069060 2024-01-22T05:16:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.928+0000 7f19a0a00700 1 -- 172.21.15.49:0/1971679068 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199400bae0 con 0x7f19a4069060 2024-01-22T05:16:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.928+0000 7f19a8e00700 1 -- 172.21.15.49:0/1971679068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19a4069060 msgr2=0x7f19a4062a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.928+0000 7f19a8e00700 1 --2- 172.21.15.49:0/1971679068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19a4069060 0x7f19a4062a60 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f1994006fd0 tx=0x7f19940090f0).stop 2024-01-22T05:16:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.928+0000 7f19a8e00700 1 -- 172.21.15.49:0/1971679068 shutdown_connections 2024-01-22T05:16:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.928+0000 7f19a8e00700 1 --2- 172.21.15.49:0/1971679068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19a4069060 0x7f19a4062a60 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.928+0000 7f19a8e00700 1 -- 172.21.15.49:0/1971679068 >> 172.21.15.49:0/1971679068 conn(0x7f19a40c4310 msgr2=0x7f19a4065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.928+0000 7f19a8e00700 1 -- 172.21.15.49:0/1971679068 shutdown_connections 2024-01-22T05:16:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.928+0000 7f19a8e00700 1 -- 172.21.15.49:0/1971679068 wait complete. 2024-01-22T05:16:55.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.932+0000 7f19a8e00700 1 Processor -- start 2024-01-22T05:16:55.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.932+0000 7f19a8e00700 1 -- start start 2024-01-22T05:16:55.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a8e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19a4062f50 0x7f19a414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a8e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a4069060 0x7f19a40a2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a8e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19a4153c30 0x7f19a4147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a8e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a41507c0 con 0x7f19a4153c30 2024-01-22T05:16:55.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a8e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a409fe70 con 0x7f19a4069060 2024-01-22T05:16:55.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a8e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a40a3620 con 0x7f19a4062f50 2024-01-22T05:16:55.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a2800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19a4153c30 0x7f19a4147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a2800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19a4153c30 0x7f19a4147e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54618/0 (socket says 172.21.15.49:54618) 2024-01-22T05:16:55.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a1e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19a4062f50 0x7f19a414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a2800700 1 -- 172.21.15.49:0/2377829189 learned_addr learned my addr 172.21.15.49:0/2377829189 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:55.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a1400700 1 --2- 172.21.15.49:0/2377829189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a4069060 0x7f19a40a2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a2800700 1 -- 172.21.15.49:0/2377829189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19a4062f50 msgr2=0x7f19a414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a2800700 1 --2- 172.21.15.49:0/2377829189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19a4062f50 0x7f19a414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a2800700 1 -- 172.21.15.49:0/2377829189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a4069060 msgr2=0x7f19a40a2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a2800700 1 --2- 172.21.15.49:0/2377829189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a4069060 0x7f19a40a2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a2800700 1 -- 172.21.15.49:0/2377829189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1994009370 con 0x7f19a4153c30 2024-01-22T05:16:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a2800700 1 --2- 172.21.15.49:0/2377829189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19a4153c30 0x7f19a4147e60 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f199c00c7c0 tx=0x7f199c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f1999600700 1 -- 172.21.15.49:0/2377829189 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c00e4a0 con 0x7f19a4153c30 2024-01-22T05:16:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f1999600700 1 -- 172.21.15.49:0/2377829189 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c00e600 con 0x7f19a4153c30 2024-01-22T05:16:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a8e00700 1 -- 172.21.15.49:0/2377829189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a409f540 con 0x7f19a4153c30 2024-01-22T05:16:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f1999600700 1 -- 172.21.15.49:0/2377829189 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c00e980 con 0x7f19a4153c30 2024-01-22T05:16:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.936+0000 7f19a8e00700 1 -- 172.21.15.49:0/2377829189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a409fb00 con 0x7f19a4153c30 2024-01-22T05:16:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.940+0000 7f1999600700 1 -- 172.21.15.49:0/2377829189 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f199c0123f0 con 0x7f19a4153c30 2024-01-22T05:16:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.944+0000 7f1999600700 1 --2- 172.21.15.49:0/2377829189 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f197c05a510 0x7f197c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.944+0000 7f1999600700 1 -- 172.21.15.49:0/2377829189 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f199c074210 con 0x7f19a4153c30 2024-01-22T05:16:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.944+0000 7f19a1e00700 1 --2- 172.21.15.49:0/2377829189 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f197c05a510 0x7f197c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.944+0000 7f19a1e00700 1 --2- 172.21.15.49:0/2377829189 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f197c05a510 0x7f197c05c9d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f1994009130 tx=0x7f1994017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.944+0000 7f19b31d1740 1 Processor -- start 2024-01-22T05:16:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.944+0000 7f19b31d1740 1 -- start start 2024-01-22T05:16:55.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19b31d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11445c0 0x11449a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19b31d1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1145170 0x10ffcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19b31d1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11001b0 0x1100610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19b31d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x103d2a0 con 0x11445c0 2024-01-22T05:16:55.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19b31d1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x10604a0 con 0x1145170 2024-01-22T05:16:55.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19b31d1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1029ce0 con 0x11001b0 2024-01-22T05:16:55.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19a1e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11445c0 0x11449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19a1e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11445c0 0x11449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54634/0 (socket says 172.21.15.49:54634) 2024-01-22T05:16:55.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19a1e00700 1 -- 172.21.15.49:0/1924897401 learned_addr learned my addr 172.21.15.49:0/1924897401 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:55.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19a2800700 1 --2- 172.21.15.49:0/1924897401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11001b0 0x1100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19a1400700 1 --2- 172.21.15.49:0/1924897401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1145170 0x10ffcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19a1e00700 1 -- 172.21.15.49:0/1924897401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11001b0 msgr2=0x1100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19a1e00700 1 --2- 172.21.15.49:0/1924897401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11001b0 0x1100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19a1e00700 1 -- 172.21.15.49:0/1924897401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1145170 msgr2=0x10ffcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19a1e00700 1 --2- 172.21.15.49:0/1924897401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1145170 0x10ffcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19a1e00700 1 -- 172.21.15.49:0/1924897401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x108e8e0 con 0x11445c0 2024-01-22T05:16:55.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19a1400700 1 --2- 172.21.15.49:0/1924897401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1145170 0x10ffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f19a1e00700 1 --2- 172.21.15.49:0/1924897401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11445c0 0x11449a0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f19a4065730 tx=0x7f199401f040).ready entity=mon.0 client_cookie=4892cffe9ae0ac1b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f1992000700 1 -- 172.21.15.49:0/1924897401 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199401d890 con 0x11445c0 2024-01-22T05:16:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f1992000700 1 -- 172.21.15.49:0/1924897401 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199401d9f0 con 0x11445c0 2024-01-22T05:16:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.948+0000 7f1992000700 1 -- 172.21.15.49:0/1924897401 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199401dd70 con 0x11445c0 2024-01-22T05:16:55.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.952+0000 7f19b31d1740 1 -- 172.21.15.49:0/1924897401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11445c0 msgr2=0x11449a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.952+0000 7f19b31d1740 1 --2- 172.21.15.49:0/1924897401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11445c0 0x11449a0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f19a4065730 tx=0x7f199401f040).stop 2024-01-22T05:16:55.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.952+0000 7f19b31d1740 1 -- 172.21.15.49:0/1924897401 shutdown_connections 2024-01-22T05:16:55.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.952+0000 7f19b31d1740 1 --2- 172.21.15.49:0/1924897401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11001b0 0x1100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.952+0000 7f19b31d1740 1 --2- 172.21.15.49:0/1924897401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1145170 0x10ffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.952+0000 7f19b31d1740 1 --2- 172.21.15.49:0/1924897401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11445c0 0x11449a0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.952+0000 7f19b31d1740 1 -- 172.21.15.49:0/1924897401 >> 172.21.15.49:0/1924897401 conn(0xee2640 msgr2=0x1149e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:55.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.952+0000 7f19b31d1740 1 -- 172.21.15.49:0/1924897401 shutdown_connections 2024-01-22T05:16:55.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.952+0000 7f19b31d1740 1 -- 172.21.15.49:0/1924897401 wait complete. 2024-01-22T05:16:55.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.952+0000 7f19b31d1740 1 -- start start 2024-01-22T05:16:55.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.952+0000 7f19b31d1740 1 Processor -- start 2024-01-22T05:16:55.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19b31d1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11001b0 0x111b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19b31d1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11445c0 0x10fe500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19b31d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1145170 0x1140e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19b31d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1143d00 con 0x1145170 2024-01-22T05:16:55.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19b31d1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1141bb0 con 0x11001b0 2024-01-22T05:16:55.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19b31d1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1143a20 con 0x11445c0 2024-01-22T05:16:55.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19b31d1740 10 client.0 ll_register_callbacks cb 0x10ba9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:16:55.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19a2800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1145170 0x1140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19a2800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1145170 0x1140e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54640/0 (socket says 172.21.15.49:54640) 2024-01-22T05:16:55.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19a2800700 1 -- 172.21.15.49:0/1306037517 learned_addr learned my addr 172.21.15.49:0/1306037517 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:55.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19a1e00700 1 --2- 172.21.15.49:0/1306037517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11001b0 0x111b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19a1400700 1 --2- 172.21.15.49:0/1306037517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11445c0 0x10fe500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19a2800700 1 -- 172.21.15.49:0/1306037517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11445c0 msgr2=0x10fe500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19a2800700 1 --2- 172.21.15.49:0/1306037517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11445c0 0x10fe500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19a2800700 1 -- 172.21.15.49:0/1306037517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11001b0 msgr2=0x111b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19a2800700 1 --2- 172.21.15.49:0/1306037517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11001b0 0x111b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19a2800700 1 -- 172.21.15.49:0/1306037517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a4066f10 con 0x1145170 2024-01-22T05:16:55.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19a2800700 1 --2- 172.21.15.49:0/1306037517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1145170 0x1140e90 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f199c00cdb0 tx=0x7f199c00f000).ready entity=mon.0 client_cookie=d1b5d42baa24feac server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:55.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f198aa00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:16:55.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f198aa00700 1 -- 172.21.15.49:0/1306037517 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c050070 con 0x1145170 2024-01-22T05:16:55.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f198aa00700 1 -- 172.21.15.49:0/1306037517 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f199c050b50 con 0x1145170 2024-01-22T05:16:55.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19b31d1740 1 -- 172.21.15.49:0/1306037517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x107a1f0 con 0x1145170 2024-01-22T05:16:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f198aa00700 1 -- 172.21.15.49:0/1306037517 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7f199c04ab10 con 0x1145170 2024-01-22T05:16:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19b31d1740 10 client.9048 fetch_fsmap learned FSMap version 114 2024-01-22T05:16:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19b31d1740 1 -- 172.21.15.49:0/1306037517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) v3 -- 0x107d780 con 0x1145170 2024-01-22T05:16:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f198aa00700 1 -- 172.21.15.49:0/1306037517 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x107a1f0 con 0x1145170 2024-01-22T05:16:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f198aa00700 1 -- 172.21.15.49:0/1306037517 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 114) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f199c047200 con 0x1145170 2024-01-22T05:16:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19b31d1740 10 client.9048 fetch_fsmap finished waiting for FSMap version 114 2024-01-22T05:16:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.956+0000 7f19b31d1740 10 client.9048 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-01-22T05:16:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19b31d1740 20 client.9048 populate_metadata read hostname 'smithi049' 2024-01-22T05:16:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19b31d1740 1 --2- 172.21.15.49:0/1306037517 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x11555d0 0x11559e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19b31d1740 4 client.9048 mds_command: new command op to 8829 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:16:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19b31d1740 1 -- 172.21.15.49:0/1306037517 --> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1070740 con 0x11555d0 2024-01-22T05:16:55.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19a1e00700 1 --2- 172.21.15.49:0/1306037517 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x11555d0 0x11559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19a1e00700 1 --2- 172.21.15.49:0/1306037517 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x11555d0 0x11559e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b5b9edcbac70e891 server_cookie=608432198bdb331e in_seq=0 out_seq=0 2024-01-22T05:16:55.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f198aa00700 10 client.9048 ms_handle_connect on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:55.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f198aa00700 1 -- 172.21.15.49:0/1306037517 <== mds.0 v2:172.21.15.49:6835/4015076184 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1070740 con 0x11555d0 2024-01-22T05:16:55.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f198aa00700 10 client.9048 handle_command_reply: tid=0 2024-01-22T05:16:55.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19b31d1740 1 client.9048 shutdown 2024-01-22T05:16:55.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19b31d1740 1 -- 172.21.15.49:0/1306037517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1145170 msgr2=0x1140e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19b31d1740 1 --2- 172.21.15.49:0/1306037517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1145170 0x1140e90 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f199c00cdb0 tx=0x7f199c00f000).stop 2024-01-22T05:16:55.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19b31d1740 1 -- 172.21.15.49:0/1306037517 shutdown_connections 2024-01-22T05:16:55.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19b31d1740 1 --2- 172.21.15.49:0/1306037517 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x11555d0 0x11559e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19b31d1740 1 --2- 172.21.15.49:0/1306037517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1145170 0x1140e90 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19b31d1740 1 --2- 172.21.15.49:0/1306037517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11445c0 0x10fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19b31d1740 1 --2- 172.21.15.49:0/1306037517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11001b0 0x111b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19b31d1740 1 -- 172.21.15.49:0/1306037517 >> 172.21.15.49:0/1306037517 conn(0xee2640 msgr2=0x1145a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f198aa00700 0 client.9048 ms_handle_reset on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.960+0000 7f19b31d1740 1 -- 172.21.15.49:0/1306037517 shutdown_connections 2024-01-22T05:16:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.964+0000 7f19b31d1740 1 -- 172.21.15.49:0/1306037517 wait complete. 2024-01-22T05:16:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.964+0000 7f19b31d1740 20 client.9048 trim_cache size 0 max 16384 2024-01-22T05:16:55.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.984+0000 7f19b31d1740 1 Processor -- start 2024-01-22T05:16:55.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.984+0000 7f19b31d1740 1 -- start start 2024-01-22T05:16:55.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.984+0000 7f19b31d1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11001b0 0x1126980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.984+0000 7f19b31d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11445c0 0x1149c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.984+0000 7f19b31d1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1145170 0x114a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.984+0000 7f19b31d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1100780 con 0x11445c0 2024-01-22T05:16:55.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.984+0000 7f19b31d1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x108a010 con 0x1145170 2024-01-22T05:16:55.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.984+0000 7f19b31d1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1103d70 con 0x11001b0 2024-01-22T05:16:55.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19a1400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11445c0 0x1149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19a1400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11445c0 0x1149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54652/0 (socket says 172.21.15.49:54652) 2024-01-22T05:16:55.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19a1400700 1 -- 172.21.15.49:0/66868961 learned_addr learned my addr 172.21.15.49:0/66868961 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:55.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19a2800700 1 --2- 172.21.15.49:0/66868961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1145170 0x114a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19a1e00700 1 --2- 172.21.15.49:0/66868961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11001b0 0x1126980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19a1400700 1 -- 172.21.15.49:0/66868961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11001b0 msgr2=0x1126980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19a1400700 1 --2- 172.21.15.49:0/66868961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11001b0 0x1126980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19a1400700 1 -- 172.21.15.49:0/66868961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1145170 msgr2=0x114a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19a1400700 1 --2- 172.21.15.49:0/66868961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1145170 0x114a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19a1400700 1 -- 172.21.15.49:0/66868961 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x111b380 con 0x11445c0 2024-01-22T05:16:55.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19a1400700 1 --2- 172.21.15.49:0/66868961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11445c0 0x1149c10 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f198c0039d0 tx=0x7f198c009040).ready entity=mon.0 client_cookie=cfa335668984489a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:55.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f1992a00700 1 -- 172.21.15.49:0/66868961 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c01b070 con 0x11445c0 2024-01-22T05:16:55.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f1992a00700 1 -- 172.21.15.49:0/66868961 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c003560 con 0x11445c0 2024-01-22T05:16:55.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f1992a00700 1 -- 172.21.15.49:0/66868961 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c003040 con 0x11445c0 2024-01-22T05:16:55.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19b31d1740 1 -- 172.21.15.49:0/66868961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11445c0 msgr2=0x1149c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:55.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19b31d1740 1 --2- 172.21.15.49:0/66868961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11445c0 0x1149c10 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f198c0039d0 tx=0x7f198c009040).stop 2024-01-22T05:16:55.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19b31d1740 1 -- 172.21.15.49:0/66868961 shutdown_connections 2024-01-22T05:16:55.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19b31d1740 1 --2- 172.21.15.49:0/66868961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1145170 0x114a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19b31d1740 1 --2- 172.21.15.49:0/66868961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11445c0 0x1149c10 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19b31d1740 1 --2- 172.21.15.49:0/66868961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11001b0 0x1126980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19b31d1740 1 -- 172.21.15.49:0/66868961 >> 172.21.15.49:0/66868961 conn(0xee2640 msgr2=0x1140c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:55.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19b31d1740 1 -- 172.21.15.49:0/66868961 shutdown_connections 2024-01-22T05:16:55.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.988+0000 7f19b31d1740 1 -- 172.21.15.49:0/66868961 wait complete. 2024-01-22T05:16:55.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.992+0000 7f19b31d1740 1 -- start start 2024-01-22T05:16:55.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.992+0000 7f19b31d1740 1 Processor -- start 2024-01-22T05:16:55.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19b31d1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11001b0 0x1148770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19b31d1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11445c0 0x112d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19b31d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1145170 0x112dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:55.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19b31d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x114a320 con 0x1145170 2024-01-22T05:16:55.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19b31d1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1148fc0 con 0x11001b0 2024-01-22T05:16:55.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19b31d1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x11ac820 con 0x11445c0 2024-01-22T05:16:55.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19b31d1740 10 client.0 ll_register_callbacks cb 0x10ba9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:16:55.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19a2800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1145170 0x112dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19a1400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11445c0 0x112d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19a1e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11001b0 0x1148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:55.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19a2800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1145170 0x112dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54656/0 (socket says 172.21.15.49:54656) 2024-01-22T05:16:55.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19a2800700 1 -- 172.21.15.49:0/2288459056 learned_addr learned my addr 172.21.15.49:0/2288459056 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:55.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19a1400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11445c0 0x112d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:44734/0 (socket says 172.21.15.49:44734) 2024-01-22T05:16:55.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19a1e00700 1 -- 172.21.15.49:0/2288459056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11445c0 msgr2=0x112d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19a1e00700 1 --2- 172.21.15.49:0/2288459056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11445c0 0x112d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19a1e00700 1 -- 172.21.15.49:0/2288459056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1145170 msgr2=0x112dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:55.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19a1e00700 1 --2- 172.21.15.49:0/2288459056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1145170 0x112dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:55.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19a1e00700 1 -- 172.21.15.49:0/2288459056 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c003750 con 0x11001b0 2024-01-22T05:16:55.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:55.996+0000 7f19a2800700 1 --2- 172.21.15.49:0/2288459056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1145170 0x112dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:56.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f19a1e00700 1 --2- 172.21.15.49:0/2288459056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11001b0 0x1148770 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f199402d000 tx=0x7f1994035040).ready entity=mon.1 client_cookie=ca349b44deac90d9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:56.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f198aa00700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-01-22T05:16:56.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f198aa00700 1 -- 172.21.15.49:0/2288459056 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994038040 con 0x11001b0 2024-01-22T05:16:56.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f19b31d1740 1 -- 172.21.15.49:0/2288459056 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f199401d9f0 con 0x11001b0 2024-01-22T05:16:56.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f198aa00700 1 -- 172.21.15.49:0/2288459056 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f1994048e20 con 0x11001b0 2024-01-22T05:16:56.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f198aa00700 1 -- 172.21.15.49:0/2288459056 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7f199401d890 con 0x11001b0 2024-01-22T05:16:56.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f19b31d1740 10 client.8941 fetch_fsmap learned FSMap version 114 2024-01-22T05:16:56.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f19b31d1740 1 -- 172.21.15.49:0/2288459056 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) v3 -- 0x7f19a40a54d0 con 0x11001b0 2024-01-22T05:16:56.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f198aa00700 1 -- 172.21.15.49:0/2288459056 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199401d9f0 con 0x11001b0 2024-01-22T05:16:56.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f198aa00700 1 -- 172.21.15.49:0/2288459056 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 114) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f19940298a0 con 0x11001b0 2024-01-22T05:16:56.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f19b31d1740 10 client.8941 fetch_fsmap finished waiting for FSMap version 114 2024-01-22T05:16:56.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f19b31d1740 10 client.8941 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-01-22T05:16:56.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f19b31d1740 20 client.8941 populate_metadata read hostname 'smithi049' 2024-01-22T05:16:56.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f19b31d1740 1 --2- 172.21.15.49:0/2288459056 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x1142390 0x11458c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f19b31d1740 4 client.8941 mds_command: new command op to 8829 tid=0[{"prefix": "scrub pause"}] 2024-01-22T05:16:56.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f19b31d1740 1 -- 172.21.15.49:0/2288459056 --> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0xf395d0 con 0x1142390 2024-01-22T05:16:56.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.000+0000 7f19a1400700 1 --2- 172.21.15.49:0/2288459056 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x1142390 0x11458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f198aa00700 10 client.8941 ms_handle_connect on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:56.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f19a1400700 1 --2- 172.21.15.49:0/2288459056 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x1142390 0x11458c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=62fb19359a7d57bd server_cookie=2a6c32d7a14ba79b in_seq=0 out_seq=0 2024-01-22T05:16:56.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f198aa00700 1 -- 172.21.15.49:0/2288459056 <== mds.0 v2:172.21.15.49:6835/4015076184 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0xf395d0 con 0x1142390 2024-01-22T05:16:56.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f198aa00700 10 client.8941 handle_command_reply: tid=0 2024-01-22T05:16:56.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f19b31d1740 1 client.8941 shutdown 2024-01-22T05:16:56.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f19b31d1740 1 -- 172.21.15.49:0/2288459056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11001b0 msgr2=0x1148770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f19b31d1740 1 --2- 172.21.15.49:0/2288459056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11001b0 0x1148770 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f199402d000 tx=0x7f1994035040).stop 2024-01-22T05:16:56.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f19b31d1740 1 -- 172.21.15.49:0/2288459056 shutdown_connections 2024-01-22T05:16:56.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f19b31d1740 1 --2- 172.21.15.49:0/2288459056 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x1142390 0x11458c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f19b31d1740 1 --2- 172.21.15.49:0/2288459056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1145170 0x112dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f19b31d1740 1 --2- 172.21.15.49:0/2288459056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11445c0 0x112d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f19b31d1740 1 --2- 172.21.15.49:0/2288459056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11001b0 0x1148770 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f19b31d1740 1 -- 172.21.15.49:0/2288459056 >> 172.21.15.49:0/2288459056 conn(0xee2640 msgr2=0x1149c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:56.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f198aa00700 0 client.8941 ms_handle_reset on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:56.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f19b31d1740 1 -- 172.21.15.49:0/2288459056 shutdown_connections 2024-01-22T05:16:56.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f19b31d1740 1 -- 172.21.15.49:0/2288459056 wait complete. 2024-01-22T05:16:56.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.004+0000 7f19b31d1740 20 client.8941 trim_cache size 0 max 16384 2024-01-22T05:16:56.006 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:16:56.006 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0 2024-01-22T05:16:56.006 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:16:56.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.008+0000 7f19a8e00700 1 -- 172.21.15.49:0/2377829189 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f197c05a510 msgr2=0x7f197c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.008+0000 7f19a8e00700 1 --2- 172.21.15.49:0/2377829189 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f197c05a510 0x7f197c05c9d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f1994009130 tx=0x7f1994017000).stop 2024-01-22T05:16:56.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.008+0000 7f19a8e00700 1 -- 172.21.15.49:0/2377829189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19a4153c30 msgr2=0x7f19a4147e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.008+0000 7f19a8e00700 1 --2- 172.21.15.49:0/2377829189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19a4153c30 0x7f19a4147e60 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f199c00c7c0 tx=0x7f199c001510).stop 2024-01-22T05:16:56.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.008+0000 7f19a8e00700 1 -- 172.21.15.49:0/2377829189 shutdown_connections 2024-01-22T05:16:56.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.008+0000 7f19a8e00700 1 --2- 172.21.15.49:0/2377829189 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f197c05a510 0x7f197c05c9d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.008+0000 7f19a8e00700 1 --2- 172.21.15.49:0/2377829189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19a4153c30 0x7f19a4147e60 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.008+0000 7f19a8e00700 1 --2- 172.21.15.49:0/2377829189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a4069060 0x7f19a40a2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.008+0000 7f19a8e00700 1 --2- 172.21.15.49:0/2377829189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19a4062f50 0x7f19a414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.008+0000 7f19a8e00700 1 -- 172.21.15.49:0/2377829189 >> 172.21.15.49:0/2377829189 conn(0x7f19a40c4310 msgr2=0x7f19a41520d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:56.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.008+0000 7f19a8e00700 1 -- 172.21.15.49:0/2377829189 shutdown_connections 2024-01-22T05:16:56.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.008+0000 7f19a8e00700 1 -- 172.21.15.49:0/2377829189 wait complete. 2024-01-22T05:16:56.031 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.9:0 scrub status 2024-01-22T05:16:56.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.196+0000 7faf19600700 1 Processor -- start 2024-01-22T05:16:56.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.196+0000 7faf19600700 1 -- start start 2024-01-22T05:16:56.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.200+0000 7faf19600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faf14064540 0x7faf1415b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.200+0000 7faf19600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf14151780 con 0x7faf14150b00 2024-01-22T05:16:56.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.200+0000 7faf19600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf14150ee0 con 0x7faf140c3940 2024-01-22T05:16:56.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.200+0000 7faf19600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf140c3df0 con 0x7faf14064540 2024-01-22T05:16:56.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.200+0000 7faf12a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faf14150b00 0x7faf140c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60498/0 (socket says 172.21.15.49:60498) 2024-01-22T05:16:56.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.200+0000 7faf12a00700 1 -- 172.21.15.49:0/3708074579 learned_addr learned my addr 172.21.15.49:0/3708074579 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:56.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.200+0000 7faf12000700 1 --1- 172.21.15.49:0/3708074579 >> v1:172.21.15.110:6789/0 conn(0x7faf140c3940 0x7faf14063e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:53516/0 (socket says 172.21.15.49:53516) 2024-01-22T05:16:56.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.200+0000 7faf13400700 1 --2- 172.21.15.49:0/3708074579 >> v2:172.21.15.110:3300/0 conn(0x7faf14064540 0x7faf1415b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.204+0000 7faf11600700 1 -- 172.21.15.49:0/3708074579 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511138908 0 0) 0x7faf14150ee0 con 0x7faf140c3940 2024-01-22T05:16:56.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.204+0000 7faf11600700 1 -- 172.21.15.49:0/3708074579 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef40033f0 con 0x7faf140c3940 2024-01-22T05:16:56.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.204+0000 7faf11600700 1 -- 172.21.15.49:0/3708074579 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295960183 0 0) 0x7faf14151780 con 0x7faf14150b00 2024-01-22T05:16:56.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.204+0000 7faf11600700 1 -- 172.21.15.49:0/3708074579 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf14150ee0 con 0x7faf14150b00 2024-01-22T05:16:56.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.204+0000 7faf13400700 1 -- 172.21.15.49:0/3708074579 >> v1:172.21.15.110:6789/0 conn(0x7faf140c3940 legacy=0x7faf14063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.204+0000 7faf13400700 1 -- 172.21.15.49:0/3708074579 >> v1:172.21.15.49:6789/0 conn(0x7faf14150b00 legacy=0x7faf140c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.204+0000 7faf13400700 1 -- 172.21.15.49:0/3708074579 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf14151130 con 0x7faf14064540 2024-01-22T05:16:56.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.204+0000 7faf13400700 1 --2- 172.21.15.49:0/3708074579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf14064540 0x7faf1415b770 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7faf0c009e60 tx=0x7faf0c009780).ready entity=mon.1 client_cookie=e2522c367864658a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:56.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.204+0000 7faf11600700 1 -- 172.21.15.49:0/3708074579 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00e070 con 0x7faf14064540 2024-01-22T05:16:56.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.204+0000 7faf11600700 1 -- 172.21.15.49:0/3708074579 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c00bab0 con 0x7faf14064540 2024-01-22T05:16:56.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.204+0000 7faf11600700 1 -- 172.21.15.49:0/3708074579 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00be30 con 0x7faf14064540 2024-01-22T05:16:56.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.204+0000 7faf19600700 1 -- 172.21.15.49:0/3708074579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf14064540 msgr2=0x7faf1415b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.204+0000 7faf19600700 1 --2- 172.21.15.49:0/3708074579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf14064540 0x7faf1415b770 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7faf0c009e60 tx=0x7faf0c009780).stop 2024-01-22T05:16:56.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.208+0000 7faf19600700 1 -- 172.21.15.49:0/3708074579 shutdown_connections 2024-01-22T05:16:56.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.208+0000 7faf19600700 1 --2- 172.21.15.49:0/3708074579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf14064540 0x7faf1415b770 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.208+0000 7faf19600700 1 -- 172.21.15.49:0/3708074579 >> 172.21.15.49:0/3708074579 conn(0x7faf140c40f0 msgr2=0x7faf140c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:56.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.208+0000 7faf19600700 1 -- 172.21.15.49:0/3708074579 shutdown_connections 2024-01-22T05:16:56.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.208+0000 7faf19600700 1 -- 172.21.15.49:0/3708074579 wait complete. 2024-01-22T05:16:56.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.208+0000 7faf19600700 1 Processor -- start 2024-01-22T05:16:56.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.208+0000 7faf19600700 1 -- start start 2024-01-22T05:16:56.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf19600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf14064540 0x7faf140c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf19600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf140c3940 0x7faf1414a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf19600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf14150b00 0x7faf14167a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf19600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf140bfe30 con 0x7faf14064540 2024-01-22T05:16:56.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf19600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1414a6b0 con 0x7faf14150b00 2024-01-22T05:16:56.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf19600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf140c1310 con 0x7faf140c3940 2024-01-22T05:16:56.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf12a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf14064540 0x7faf140c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf12a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf14064540 0x7faf140c02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54664/0 (socket says 172.21.15.49:54664) 2024-01-22T05:16:56.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf12a00700 1 -- 172.21.15.49:0/1978354974 learned_addr learned my addr 172.21.15.49:0/1978354974 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:56.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf12000700 1 --2- 172.21.15.49:0/1978354974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf140c3940 0x7faf1414a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf13400700 1 --2- 172.21.15.49:0/1978354974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf14150b00 0x7faf14167a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf12a00700 1 -- 172.21.15.49:0/1978354974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf140c3940 msgr2=0x7faf1414a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf12a00700 1 --2- 172.21.15.49:0/1978354974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf140c3940 0x7faf1414a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf12a00700 1 -- 172.21.15.49:0/1978354974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf14150b00 msgr2=0x7faf14167a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf12a00700 1 --2- 172.21.15.49:0/1978354974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf14150b00 0x7faf14167a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf12a00700 1 -- 172.21.15.49:0/1978354974 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c009a20 con 0x7faf14064540 2024-01-22T05:16:56.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf12a00700 1 --2- 172.21.15.49:0/1978354974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf14064540 0x7faf140c02c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7faf0400c4c0 tx=0x7faf04007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:56.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf0a000700 1 -- 172.21.15.49:0/1978354974 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf040072e0 con 0x7faf14064540 2024-01-22T05:16:56.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf0a000700 1 -- 172.21.15.49:0/1978354974 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf04007440 con 0x7faf14064540 2024-01-22T05:16:56.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf19600700 1 -- 172.21.15.49:0/1978354974 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf141685c0 con 0x7faf14064540 2024-01-22T05:16:56.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.212+0000 7faf0a000700 1 -- 172.21.15.49:0/1978354974 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf040057a0 con 0x7faf14064540 2024-01-22T05:16:56.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.216+0000 7faf19600700 1 -- 172.21.15.49:0/1978354974 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf140bfac0 con 0x7faf14064540 2024-01-22T05:16:56.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.216+0000 7faf0a000700 1 -- 172.21.15.49:0/1978354974 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7faf04005bd0 con 0x7faf14064540 2024-01-22T05:16:56.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.220+0000 7faf0a000700 1 --2- 172.21.15.49:0/1978354974 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faeec05a510 0x7faeec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.220+0000 7faf0a000700 1 -- 172.21.15.49:0/1978354974 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7faf04074080 con 0x7faf14064540 2024-01-22T05:16:56.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.220+0000 7faf12000700 1 --2- 172.21.15.49:0/1978354974 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faeec05a510 0x7faeec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.220+0000 7faf12000700 1 --2- 172.21.15.49:0/1978354974 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faeec05a510 0x7faeec05c9d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7faf140c0fc0 tx=0x7faefc007140).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:56.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.220+0000 7faf23a7d740 1 Processor -- start 2024-01-22T05:16:56.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.224+0000 7faf23a7d740 1 -- start start 2024-01-22T05:16:56.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.224+0000 7faf23a7d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.224+0000 7faf23a7d740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x268d2a0 0x26b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.224+0000 7faf23a7d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x268d700 0x26b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.224+0000 7faf23a7d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x25ea540 con 0x26d2280 2024-01-22T05:16:56.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.224+0000 7faf23a7d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x25ade90 con 0x268d700 2024-01-22T05:16:56.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.224+0000 7faf23a7d740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x25b3d90 con 0x268d2a0 2024-01-22T05:16:56.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.224+0000 7faf12a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.224+0000 7faf12a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26d2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54674/0 (socket says 172.21.15.49:54674) 2024-01-22T05:16:56.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.224+0000 7faf12a00700 1 -- 172.21.15.49:0/1183099634 learned_addr learned my addr 172.21.15.49:0/1183099634 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:56.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf12000700 1 --2- 172.21.15.49:0/1183099634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x268d2a0 0x26b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf13400700 1 --2- 172.21.15.49:0/1183099634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x268d700 0x26b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf12a00700 1 -- 172.21.15.49:0/1183099634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x268d2a0 msgr2=0x26b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:56.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf12a00700 1 --2- 172.21.15.49:0/1183099634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x268d2a0 0x26b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf12a00700 1 -- 172.21.15.49:0/1183099634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x268d700 msgr2=0x26b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:56.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf12a00700 1 --2- 172.21.15.49:0/1183099634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x268d700 0x26b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf12a00700 1 -- 172.21.15.49:0/1183099634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x26184c0 con 0x26d2280 2024-01-22T05:16:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf12a00700 1 --2- 172.21.15.49:0/1183099634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26d2660 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7faf040478a0 tx=0x7faf0400f000).ready entity=mon.0 client_cookie=223e2213b1667a8f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf02600700 1 -- 172.21.15.49:0/1183099634 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0404ad00 con 0x26d2280 2024-01-22T05:16:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf02600700 1 -- 172.21.15.49:0/1183099634 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0404b340 con 0x26d2280 2024-01-22T05:16:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf02600700 1 -- 172.21.15.49:0/1183099634 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04049740 con 0x26d2280 2024-01-22T05:16:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf23a7d740 1 -- 172.21.15.49:0/1183099634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 msgr2=0x26d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf23a7d740 1 --2- 172.21.15.49:0/1183099634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26d2660 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7faf040478a0 tx=0x7faf0400f000).stop 2024-01-22T05:16:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf23a7d740 1 -- 172.21.15.49:0/1183099634 shutdown_connections 2024-01-22T05:16:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf23a7d740 1 --2- 172.21.15.49:0/1183099634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x268d700 0x26b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf23a7d740 1 --2- 172.21.15.49:0/1183099634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x268d2a0 0x26b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf23a7d740 1 --2- 172.21.15.49:0/1183099634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26d2660 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf23a7d740 1 -- 172.21.15.49:0/1183099634 >> 172.21.15.49:0/1183099634 conn(0x246c680 msgr2=0x268bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf23a7d740 1 -- 172.21.15.49:0/1183099634 shutdown_connections 2024-01-22T05:16:56.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.228+0000 7faf23a7d740 1 -- 172.21.15.49:0/1183099634 wait complete. 2024-01-22T05:16:56.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.232+0000 7faf23a7d740 1 -- start start 2024-01-22T05:16:56.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.232+0000 7faf23a7d740 1 Processor -- start 2024-01-22T05:16:56.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.232+0000 7faf23a7d740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x268d2a0 0x26afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.232+0000 7faf23a7d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d2280 0x26ebea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.232+0000 7faf23a7d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26b8a40 0x26b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.232+0000 7faf23a7d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x26b04e0 con 0x26b8a40 2024-01-22T05:16:56.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.232+0000 7faf23a7d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x268af60 con 0x26d2280 2024-01-22T05:16:56.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.232+0000 7faf23a7d740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x268b3c0 con 0x268d2a0 2024-01-22T05:16:56.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf23a7d740 10 client.0 ll_register_callbacks cb 0x26445d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:16:56.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf13400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26b8a40 0x26b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf13400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26b8a40 0x26b8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54680/0 (socket says 172.21.15.49:54680) 2024-01-22T05:16:56.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf13400700 1 -- 172.21.15.49:0/2529702210 learned_addr learned my addr 172.21.15.49:0/2529702210 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:56.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf12a00700 1 --2- 172.21.15.49:0/2529702210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x268d2a0 0x26afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf12000700 1 --2- 172.21.15.49:0/2529702210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d2280 0x26ebea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf13400700 1 -- 172.21.15.49:0/2529702210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x268d2a0 msgr2=0x26afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:56.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf13400700 1 --2- 172.21.15.49:0/2529702210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x268d2a0 0x26afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf13400700 1 -- 172.21.15.49:0/2529702210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d2280 msgr2=0x26ebea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:56.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf13400700 1 --2- 172.21.15.49:0/2529702210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d2280 0x26ebea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf13400700 1 -- 172.21.15.49:0/2529702210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf140bfac0 con 0x26b8a40 2024-01-22T05:16:56.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf13400700 1 --2- 172.21.15.49:0/2529702210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26b8a40 0x26b8ec0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7faf0c012980 tx=0x7faf0c009780).ready entity=mon.0 client_cookie=1051c8fd917e242b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:56.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faefaa00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:16:56.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faefaa00700 1 -- 172.21.15.49:0/2529702210 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c012e40 con 0x26b8a40 2024-01-22T05:16:56.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faefaa00700 1 -- 172.21.15.49:0/2529702210 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7faf0c01e400 con 0x26b8a40 2024-01-22T05:16:56.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf23a7d740 1 -- 172.21.15.49:0/2529702210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2604230 con 0x26b8a40 2024-01-22T05:16:56.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faefaa00700 1 -- 172.21.15.49:0/2529702210 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf0c01e5c0 con 0x26b8a40 2024-01-22T05:16:56.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf23a7d740 10 client.9066 fetch_fsmap learned FSMap version 114 2024-01-22T05:16:56.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf23a7d740 1 -- 172.21.15.49:0/2529702210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) v3 -- 0x26077c0 con 0x26b8a40 2024-01-22T05:16:56.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faefaa00700 1 -- 172.21.15.49:0/2529702210 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2604230 con 0x26b8a40 2024-01-22T05:16:56.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faefaa00700 1 -- 172.21.15.49:0/2529702210 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 114) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faf0c01e720 con 0x26b8a40 2024-01-22T05:16:56.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf23a7d740 10 client.9066 fetch_fsmap finished waiting for FSMap version 114 2024-01-22T05:16:56.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf23a7d740 10 client.9066 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-01-22T05:16:56.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf23a7d740 20 client.9066 populate_metadata read hostname 'smithi049' 2024-01-22T05:16:56.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2529702210 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x2689ee0 0x268a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf23a7d740 4 client.9066 mds_command: new command op to 8829 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:16:56.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.236+0000 7faf23a7d740 1 -- 172.21.15.49:0/2529702210 --> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x25fa780 con 0x2689ee0 2024-01-22T05:16:56.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faf12a00700 1 --2- 172.21.15.49:0/2529702210 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x2689ee0 0x268a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faefaa00700 10 client.9066 ms_handle_connect on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:56.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faf12a00700 1 --2- 172.21.15.49:0/2529702210 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x2689ee0 0x268a2f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7b8a81e596840574 server_cookie=10b215a0748bb4ac in_seq=0 out_seq=0 2024-01-22T05:16:56.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faefaa00700 1 -- 172.21.15.49:0/2529702210 <== mds.0 v2:172.21.15.49:6835/4015076184 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x25fa780 con 0x2689ee0 2024-01-22T05:16:56.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faefaa00700 10 client.9066 handle_command_reply: tid=0 2024-01-22T05:16:56.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faf23a7d740 1 client.9066 shutdown 2024-01-22T05:16:56.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faf23a7d740 1 -- 172.21.15.49:0/2529702210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26b8a40 msgr2=0x26b8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2529702210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26b8a40 0x26b8ec0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7faf0c012980 tx=0x7faf0c009780).stop 2024-01-22T05:16:56.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faf23a7d740 1 -- 172.21.15.49:0/2529702210 shutdown_connections 2024-01-22T05:16:56.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2529702210 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x2689ee0 0x268a2f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2529702210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26b8a40 0x26b8ec0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2529702210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26d2280 0x26ebea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2529702210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x268d2a0 0x26afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faefaa00700 0 client.9066 ms_handle_reset on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:56.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faf23a7d740 1 -- 172.21.15.49:0/2529702210 >> 172.21.15.49:0/2529702210 conn(0x246c680 msgr2=0x26872e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:56.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faf23a7d740 1 -- 172.21.15.49:0/2529702210 shutdown_connections 2024-01-22T05:16:56.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.240+0000 7faf23a7d740 1 -- 172.21.15.49:0/2529702210 wait complete. 2024-01-22T05:16:56.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.244+0000 7faf23a7d740 20 client.9066 trim_cache size 0 max 16384 2024-01-22T05:16:56.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.264+0000 7faf23a7d740 1 Processor -- start 2024-01-22T05:16:56.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.264+0000 7faf23a7d740 1 -- start start 2024-01-22T05:16:56.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.264+0000 7faf23a7d740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x268d2a0 0x268a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.264+0000 7faf23a7d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26b8a40 0x26cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.264+0000 7faf23a7d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.264+0000 7faf23a7d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x26d33b0 con 0x26d2280 2024-01-22T05:16:56.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.264+0000 7faf23a7d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x26eaae0 con 0x26b8a40 2024-01-22T05:16:56.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.264+0000 7faf23a7d740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x26dc330 con 0x268d2a0 2024-01-22T05:16:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.264+0000 7faf13400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.264+0000 7faf13400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26cd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54696/0 (socket says 172.21.15.49:54696) 2024-01-22T05:16:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.264+0000 7faf13400700 1 -- 172.21.15.49:0/2480988613 learned_addr learned my addr 172.21.15.49:0/2480988613 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.264+0000 7faf12000700 1 --2- 172.21.15.49:0/2480988613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26b8a40 0x26cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf12a00700 1 --2- 172.21.15.49:0/2480988613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x268d2a0 0x268a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf13400700 1 -- 172.21.15.49:0/2480988613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x268d2a0 msgr2=0x268a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf13400700 1 --2- 172.21.15.49:0/2480988613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x268d2a0 0x268a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf13400700 1 -- 172.21.15.49:0/2480988613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26b8a40 msgr2=0x26cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf13400700 1 --2- 172.21.15.49:0/2480988613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26b8a40 0x26cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf13400700 1 -- 172.21.15.49:0/2480988613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf141682c0 con 0x26d2280 2024-01-22T05:16:56.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf13400700 1 --2- 172.21.15.49:0/2480988613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26cd8f0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7faf0c0093f0 tx=0x7faf0c020070).ready entity=mon.0 client_cookie=3b8080a4f4fa5f07 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:56.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf03000700 1 -- 172.21.15.49:0/2480988613 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00b610 con 0x26d2280 2024-01-22T05:16:56.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf03000700 1 -- 172.21.15.49:0/2480988613 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c022070 con 0x26d2280 2024-01-22T05:16:56.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf03000700 1 -- 172.21.15.49:0/2480988613 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c007040 con 0x26d2280 2024-01-22T05:16:56.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf23a7d740 1 -- 172.21.15.49:0/2480988613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 msgr2=0x26cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2480988613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26cd8f0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7faf0c0093f0 tx=0x7faf0c020070).stop 2024-01-22T05:16:56.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf23a7d740 1 -- 172.21.15.49:0/2480988613 shutdown_connections 2024-01-22T05:16:56.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2480988613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26cd8f0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2480988613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26b8a40 0x26cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2480988613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x268d2a0 0x268a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf23a7d740 1 -- 172.21.15.49:0/2480988613 >> 172.21.15.49:0/2480988613 conn(0x246c680 msgr2=0x26ebe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf23a7d740 1 -- 172.21.15.49:0/2480988613 shutdown_connections 2024-01-22T05:16:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.268+0000 7faf23a7d740 1 -- 172.21.15.49:0/2480988613 wait complete. 2024-01-22T05:16:56.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.272+0000 7faf23a7d740 1 -- start start 2024-01-22T05:16:56.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.272+0000 7faf23a7d740 1 Processor -- start 2024-01-22T05:16:56.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf23a7d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x268d2a0 0x273e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf23a7d740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26b8a40 0x26ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf23a7d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26ae990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf23a7d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2688360 con 0x26d2280 2024-01-22T05:16:56.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf23a7d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x273ed70 con 0x268d2a0 2024-01-22T05:16:56.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf23a7d740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x26af180 con 0x26b8a40 2024-01-22T05:16:56.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf23a7d740 10 client.0 ll_register_callbacks cb 0x7faf0c012620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:16:56.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf13400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf13400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54704/0 (socket says 172.21.15.49:54704) 2024-01-22T05:16:56.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf13400700 1 -- 172.21.15.49:0/2193134073 learned_addr learned my addr 172.21.15.49:0/2193134073 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:56.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf12a00700 1 --2- 172.21.15.49:0/2193134073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x268d2a0 0x273e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf12000700 1 --2- 172.21.15.49:0/2193134073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26b8a40 0x26ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf13400700 1 -- 172.21.15.49:0/2193134073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26b8a40 msgr2=0x26ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:56.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf13400700 1 --2- 172.21.15.49:0/2193134073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26b8a40 0x26ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf13400700 1 -- 172.21.15.49:0/2193134073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x268d2a0 msgr2=0x273e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:56.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf13400700 1 --2- 172.21.15.49:0/2193134073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x268d2a0 0x273e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf13400700 1 -- 172.21.15.49:0/2193134073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x26077c0 con 0x26d2280 2024-01-22T05:16:56.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf12a00700 1 --2- 172.21.15.49:0/2193134073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x268d2a0 0x273e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:56.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf13400700 1 --2- 172.21.15.49:0/2193134073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26ae990 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7faf0c01ec00 tx=0x7faf0c033070).ready entity=mon.0 client_cookie=e2dd29874031d0dd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:56.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faefaa00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:16:56.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faefaa00700 1 -- 172.21.15.49:0/2193134073 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c01e4d0 con 0x26d2280 2024-01-22T05:16:56.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf23a7d740 1 -- 172.21.15.49:0/2193134073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf0404b340 con 0x26d2280 2024-01-22T05:16:56.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faefaa00700 1 -- 172.21.15.49:0/2193134073 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7faf0c01e630 con 0x26d2280 2024-01-22T05:16:56.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faefaa00700 1 -- 172.21.15.49:0/2193134073 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf0c027410 con 0x26d2280 2024-01-22T05:16:56.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf23a7d740 10 client.9072 fetch_fsmap learned FSMap version 114 2024-01-22T05:16:56.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.276+0000 7faf23a7d740 1 -- 172.21.15.49:0/2193134073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) v3 -- 0x26029f0 con 0x26d2280 2024-01-22T05:16:56.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faefaa00700 1 -- 172.21.15.49:0/2193134073 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0404b340 con 0x26d2280 2024-01-22T05:16:56.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faefaa00700 1 -- 172.21.15.49:0/2193134073 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 114) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faf0c027570 con 0x26d2280 2024-01-22T05:16:56.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 10 client.9072 fetch_fsmap finished waiting for FSMap version 114 2024-01-22T05:16:56.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 10 client.9072 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-01-22T05:16:56.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 20 client.9072 populate_metadata read hostname 'smithi049' 2024-01-22T05:16:56.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2193134073 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x26872c0 0x26876d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 4 client.9072 mds_command: new command op to 8829 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:16:56.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 1 -- 172.21.15.49:0/2193134073 --> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x24c3610 con 0x26872c0 2024-01-22T05:16:56.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf12a00700 1 --2- 172.21.15.49:0/2193134073 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x26872c0 0x26876d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf12a00700 1 --2- 172.21.15.49:0/2193134073 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x26872c0 0x26876d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b23cfc573ac47bd0 server_cookie=b89b2a55c3870969 in_seq=0 out_seq=0 2024-01-22T05:16:56.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faefaa00700 10 client.9072 ms_handle_connect on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:56.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faefaa00700 1 -- 172.21.15.49:0/2193134073 <== mds.0 v2:172.21.15.49:6835/4015076184 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x24c3610 con 0x26872c0 2024-01-22T05:16:56.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faefaa00700 10 client.9072 handle_command_reply: tid=0 2024-01-22T05:16:56.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 1 client.9072 shutdown 2024-01-22T05:16:56.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 1 -- 172.21.15.49:0/2193134073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 msgr2=0x26ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2193134073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26ae990 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7faf0c01ec00 tx=0x7faf0c033070).stop 2024-01-22T05:16:56.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 1 -- 172.21.15.49:0/2193134073 shutdown_connections 2024-01-22T05:16:56.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2193134073 >> [v2:172.21.15.49:6835/4015076184,v1:172.21.15.49:6837/4015076184] conn(0x26872c0 0x26876d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2193134073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26d2280 0x26ae990 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2193134073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26b8a40 0x26ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 1 --2- 172.21.15.49:0/2193134073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x268d2a0 0x273e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 1 -- 172.21.15.49:0/2193134073 >> 172.21.15.49:0/2193134073 conn(0x246c680 msgr2=0x26db290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:56.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faefaa00700 0 client.9072 ms_handle_reset on v2:172.21.15.49:6835/4015076184 2024-01-22T05:16:56.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.280+0000 7faf23a7d740 1 -- 172.21.15.49:0/2193134073 shutdown_connections 2024-01-22T05:16:56.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.284+0000 7faf23a7d740 1 -- 172.21.15.49:0/2193134073 wait complete. 2024-01-22T05:16:56.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.284+0000 7faf23a7d740 20 client.9072 trim_cache size 0 max 16384 2024-01-22T05:16:56.284 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:16:56.284 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-01-22T05:16:56.284 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-01-22T05:16:56.284 INFO:teuthology.orchestra.run.smithi049.stdout: "9b173eb5-f758-4dfb-8042-e5b5bdf8e38f": { 2024-01-22T05:16:56.284 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/scrub_control_test_path", 2024-01-22T05:16:56.284 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "9b173eb5-f758-4dfb-8042-e5b5bdf8e38f", 2024-01-22T05:16:56.284 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive" 2024-01-22T05:16:56.284 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:56.284 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:16:56.284 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:16:56.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.284+0000 7faf19600700 1 -- 172.21.15.49:0/1978354974 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faeec05a510 msgr2=0x7faeec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.284+0000 7faf19600700 1 --2- 172.21.15.49:0/1978354974 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faeec05a510 0x7faeec05c9d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7faf140c0fc0 tx=0x7faefc007140).stop 2024-01-22T05:16:56.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.284+0000 7faf19600700 1 -- 172.21.15.49:0/1978354974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf14064540 msgr2=0x7faf140c02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.284+0000 7faf19600700 1 --2- 172.21.15.49:0/1978354974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf14064540 0x7faf140c02c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7faf0400c4c0 tx=0x7faf04007d00).stop 2024-01-22T05:16:56.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.284+0000 7faf19600700 1 -- 172.21.15.49:0/1978354974 shutdown_connections 2024-01-22T05:16:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.284+0000 7faf19600700 1 --2- 172.21.15.49:0/1978354974 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7faeec05a510 0x7faeec05c9d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.284+0000 7faf19600700 1 --2- 172.21.15.49:0/1978354974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf14150b00 0x7faf14167a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.284+0000 7faf19600700 1 --2- 172.21.15.49:0/1978354974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf140c3940 0x7faf1414a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.284+0000 7faf19600700 1 --2- 172.21.15.49:0/1978354974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf14064540 0x7faf140c02c0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.284+0000 7faf19600700 1 -- 172.21.15.49:0/1978354974 >> 172.21.15.49:0/1978354974 conn(0x7faf140c40f0 msgr2=0x7faf140bc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.284+0000 7faf19600700 1 -- 172.21.15.49:0/1978354974 shutdown_connections 2024-01-22T05:16:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.284+0000 7faf19600700 1 -- 172.21.15.49:0/1978354974 wait complete. 2024-01-22T05:16:56.308 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:16:56.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.472+0000 7fdb52e00700 1 Processor -- start 2024-01-22T05:16:56.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.472+0000 7fdb52e00700 1 -- start start 2024-01-22T05:16:56.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.476+0000 7fdb52e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdb4c153d90 0x7fdb4c068cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.476+0000 7fdb52e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdb4c0bdfb0 0x7fdb4c062810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.476+0000 7fdb52e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4c068840 con 0x7fdb4c0691c0 2024-01-22T05:16:56.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.476+0000 7fdb52e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4c067c30 con 0x7fdb4c153d90 2024-01-22T05:16:56.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.476+0000 7fdb52e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4c067f10 con 0x7fdb4c0bdfb0 2024-01-22T05:16:56.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.476+0000 7fdb4be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdb4c153d90 0x7fdb4c068cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.476+0000 7fdb4be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdb4c153d90 0x7fdb4c068cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54708/0 (socket says 172.21.15.49:54708) 2024-01-22T05:16:56.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.476+0000 7fdb4be00700 1 -- 172.21.15.49:0/3398034133 learned_addr learned my addr 172.21.15.49:0/3398034133 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:56.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.476+0000 7fdb50e00700 1 --2- 172.21.15.49:0/3398034133 >> v2:172.21.15.110:3300/0 conn(0x7fdb4c0bdfb0 0x7fdb4c062810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.476+0000 7fdb4be00700 1 -- 172.21.15.49:0/3398034133 >> v2:172.21.15.110:3300/0 conn(0x7fdb4c0bdfb0 msgr2=0x7fdb4c062810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:56.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.476+0000 7fdb4be00700 1 --2- 172.21.15.49:0/3398034133 >> v2:172.21.15.110:3300/0 conn(0x7fdb4c0bdfb0 0x7fdb4c062810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.476+0000 7fdb4be00700 1 -- 172.21.15.49:0/3398034133 >> v1:172.21.15.49:6789/0 conn(0x7fdb4c0691c0 legacy=0x7fdb4c0bd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.476+0000 7fdb4be00700 1 -- 172.21.15.49:0/3398034133 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c0681f0 con 0x7fdb4c153d90 2024-01-22T05:16:56.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.476+0000 7fdb50e00700 1 --2- 172.21.15.49:0/3398034133 >> v2:172.21.15.110:3300/0 conn(0x7fdb4c0bdfb0 0x7fdb4c062810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:56.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.476+0000 7fdb4be00700 1 --2- 172.21.15.49:0/3398034133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4c153d90 0x7fdb4c068cd0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fdb4c05faf0 tx=0x7fdb3c0090f0).ready entity=mon.0 client_cookie=5fc93334a55e552c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:56.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.480+0000 7fdb4aa00700 1 -- 172.21.15.49:0/3398034133 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c00b600 con 0x7fdb4c153d90 2024-01-22T05:16:56.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.480+0000 7fdb4aa00700 1 -- 172.21.15.49:0/3398034133 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c00b760 con 0x7fdb4c153d90 2024-01-22T05:16:56.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.480+0000 7fdb4aa00700 1 -- 172.21.15.49:0/3398034133 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c00bae0 con 0x7fdb4c153d90 2024-01-22T05:16:56.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.480+0000 7fdb52e00700 1 -- 172.21.15.49:0/3398034133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4c153d90 msgr2=0x7fdb4c068cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.480+0000 7fdb52e00700 1 --2- 172.21.15.49:0/3398034133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4c153d90 0x7fdb4c068cd0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fdb4c05faf0 tx=0x7fdb3c0090f0).stop 2024-01-22T05:16:56.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.480+0000 7fdb52e00700 1 -- 172.21.15.49:0/3398034133 shutdown_connections 2024-01-22T05:16:56.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.480+0000 7fdb52e00700 1 --2- 172.21.15.49:0/3398034133 >> v2:172.21.15.110:3300/0 conn(0x7fdb4c0bdfb0 0x7fdb4c062810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.480+0000 7fdb52e00700 1 --2- 172.21.15.49:0/3398034133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4c153d90 0x7fdb4c068cd0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.480+0000 7fdb52e00700 1 -- 172.21.15.49:0/3398034133 >> 172.21.15.49:0/3398034133 conn(0x7fdb4c0c51c0 msgr2=0x7fdb4c0c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:56.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.480+0000 7fdb52e00700 1 -- 172.21.15.49:0/3398034133 shutdown_connections 2024-01-22T05:16:56.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.480+0000 7fdb52e00700 1 -- 172.21.15.49:0/3398034133 wait complete. 2024-01-22T05:16:56.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.484+0000 7fdb52e00700 1 Processor -- start 2024-01-22T05:16:56.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.484+0000 7fdb52e00700 1 -- start start 2024-01-22T05:16:56.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.484+0000 7fdb52e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb4c0691c0 0x7fdb4c0ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.484+0000 7fdb52e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb4c14f180 0x7fdb4c158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.484+0000 7fdb52e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4c159200 0x7fdb4c0646b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.484+0000 7fdb52e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c151300 con 0x7fdb4c159200 2024-01-22T05:16:56.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.484+0000 7fdb52e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0abbc0 con 0x7fdb4c0691c0 2024-01-22T05:16:56.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.484+0000 7fdb52e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c159f70 con 0x7fdb4c14f180 2024-01-22T05:16:56.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.484+0000 7fdb50e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4c159200 0x7fdb4c0646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.484+0000 7fdb50e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4c159200 0x7fdb4c0646b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54720/0 (socket says 172.21.15.49:54720) 2024-01-22T05:16:56.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.484+0000 7fdb50e00700 1 -- 172.21.15.49:0/3496896709 learned_addr learned my addr 172.21.15.49:0/3496896709 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:56.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.488+0000 7fdb4be00700 1 --2- 172.21.15.49:0/3496896709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb4c0691c0 0x7fdb4c0ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.488+0000 7fdb4b400700 1 --2- 172.21.15.49:0/3496896709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb4c14f180 0x7fdb4c158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.488+0000 7fdb50e00700 1 -- 172.21.15.49:0/3496896709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb4c14f180 msgr2=0x7fdb4c158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.488+0000 7fdb50e00700 1 --2- 172.21.15.49:0/3496896709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb4c14f180 0x7fdb4c158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.488+0000 7fdb50e00700 1 -- 172.21.15.49:0/3496896709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb4c0691c0 msgr2=0x7fdb4c0ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.488+0000 7fdb50e00700 1 --2- 172.21.15.49:0/3496896709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb4c0691c0 0x7fdb4c0ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.488+0000 7fdb50e00700 1 -- 172.21.15.49:0/3496896709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c009370 con 0x7fdb4c159200 2024-01-22T05:16:56.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.488+0000 7fdb50e00700 1 --2- 172.21.15.49:0/3496896709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4c159200 0x7fdb4c0646b0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7fdb4400d180 tx=0x7fdb44009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.488+0000 7fdb43400700 1 -- 172.21.15.49:0/3496896709 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4400dd10 con 0x7fdb4c159200 2024-01-22T05:16:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.488+0000 7fdb43400700 1 -- 172.21.15.49:0/3496896709 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4400f040 con 0x7fdb4c159200 2024-01-22T05:16:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.488+0000 7fdb52e00700 1 -- 172.21.15.49:0/3496896709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4c1596d0 con 0x7fdb4c159200 2024-01-22T05:16:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.488+0000 7fdb43400700 1 -- 172.21.15.49:0/3496896709 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44013600 con 0x7fdb4c159200 2024-01-22T05:16:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.488+0000 7fdb52e00700 1 -- 172.21.15.49:0/3496896709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4c159c90 con 0x7fdb4c159200 2024-01-22T05:16:56.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.492+0000 7fdb52e00700 1 -- 172.21.15.49:0/3496896709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4c1510d0 con 0x7fdb4c159200 2024-01-22T05:16:56.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.492+0000 7fdb43400700 1 -- 172.21.15.49:0/3496896709 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdb440139f0 con 0x7fdb4c159200 2024-01-22T05:16:56.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.492+0000 7fdb43400700 1 --2- 172.21.15.49:0/3496896709 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb2405a510 0x7fdb2405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.492+0000 7fdb43400700 1 -- 172.21.15.49:0/3496896709 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fdb44075070 con 0x7fdb4c159200 2024-01-22T05:16:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.492+0000 7fdb4be00700 1 --2- 172.21.15.49:0/3496896709 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb2405a510 0x7fdb2405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.492+0000 7fdb4be00700 1 --2- 172.21.15.49:0/3496896709 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb2405a510 0x7fdb2405c9d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fdb3c00b3c0 tx=0x7fdb3c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:56.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.500+0000 7fdb43400700 1 -- 172.21.15.49:0/3496896709 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdb4c1510d0 con 0x7fdb4c159200 2024-01-22T05:16:56.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.704+0000 7fdb52e00700 1 -- 172.21.15.49:0/3496896709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb4c1510d0 con 0x7fdb4c159200 2024-01-22T05:16:56.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.704+0000 7fdb43400700 1 -- 172.21.15.49:0/3496896709 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4500 (secure 0 0 0) 0x7fdb4c1510d0 con 0x7fdb4c159200 2024-01-22T05:16:56.705 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:56.705 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":114,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":8826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:16:17.362338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/4015076184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":4015076184},{"type":"v1","addr":"172.21.15.49:6837","nonce":4015076184}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:16:56.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.708+0000 7fdb52e00700 1 -- 172.21.15.49:0/3496896709 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb2405a510 msgr2=0x7fdb2405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.708+0000 7fdb52e00700 1 --2- 172.21.15.49:0/3496896709 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb2405a510 0x7fdb2405c9d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fdb3c00b3c0 tx=0x7fdb3c017000).stop 2024-01-22T05:16:56.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.708+0000 7fdb52e00700 1 -- 172.21.15.49:0/3496896709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4c159200 msgr2=0x7fdb4c0646b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.708+0000 7fdb52e00700 1 --2- 172.21.15.49:0/3496896709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4c159200 0x7fdb4c0646b0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7fdb4400d180 tx=0x7fdb44009a50).stop 2024-01-22T05:16:56.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.708+0000 7fdb52e00700 1 -- 172.21.15.49:0/3496896709 shutdown_connections 2024-01-22T05:16:56.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.708+0000 7fdb52e00700 1 --2- 172.21.15.49:0/3496896709 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb2405a510 0x7fdb2405c9d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.708+0000 7fdb52e00700 1 --2- 172.21.15.49:0/3496896709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb4c159200 0x7fdb4c0646b0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.708+0000 7fdb52e00700 1 --2- 172.21.15.49:0/3496896709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb4c14f180 0x7fdb4c158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.708+0000 7fdb52e00700 1 --2- 172.21.15.49:0/3496896709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb4c0691c0 0x7fdb4c0ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.708+0000 7fdb52e00700 1 -- 172.21.15.49:0/3496896709 >> 172.21.15.49:0/3496896709 conn(0x7fdb4c0c51c0 msgr2=0x7fdb4c0c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:56.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.708+0000 7fdb52e00700 1 -- 172.21.15.49:0/3496896709 shutdown_connections 2024-01-22T05:16:56.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.708+0000 7fdb52e00700 1 -- 172.21.15.49:0/3496896709 wait complete. 2024-01-22T05:16:56.714 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 114 2024-01-22T05:16:56.732 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-01-22T05:16:56.732 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:16:56.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.888+0000 7f62ee400700 1 Processor -- start 2024-01-22T05:16:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.888+0000 7f62ee400700 1 -- start start 2024-01-22T05:16:56.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.892+0000 7f62ee400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f62e8064690 0x7f62e8064af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.892+0000 7f62ee400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f62e8151370 0x7f62e81517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.892+0000 7f62ee400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e80be210 con 0x7f62e80be6a0 2024-01-22T05:16:56.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.892+0000 7f62ee400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e80bd650 con 0x7f62e8064690 2024-01-22T05:16:56.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.892+0000 7f62ee400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e80bd8e0 con 0x7f62e8151370 2024-01-22T05:16:56.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.892+0000 7f62e7400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f62e80be6a0 0x7f62e80c2cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60514/0 (socket says 172.21.15.49:60514) 2024-01-22T05:16:56.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.892+0000 7f62e7400700 1 -- 172.21.15.49:0/3460078429 learned_addr learned my addr 172.21.15.49:0/3460078429 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:56.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.892+0000 7f62e6a00700 1 --2- 172.21.15.49:0/3460078429 >> v2:172.21.15.49:3300/0 conn(0x7f62e8064690 0x7f62e8064af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.892+0000 7f62ece00700 1 --2- 172.21.15.49:0/3460078429 >> v2:172.21.15.110:3300/0 conn(0x7f62e8151370 0x7f62e81517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62e6000700 1 -- 172.21.15.49:0/3460078429 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888823168 0 0) 0x7f62e80be210 con 0x7f62e80be6a0 2024-01-22T05:16:56.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62e6000700 1 -- 172.21.15.49:0/3460078429 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62c80033f0 con 0x7f62e80be6a0 2024-01-22T05:16:56.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62e6a00700 1 -- 172.21.15.49:0/3460078429 >> v2:172.21.15.110:3300/0 conn(0x7f62e8151370 msgr2=0x7f62e81517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:56.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62e6a00700 1 --2- 172.21.15.49:0/3460078429 >> v2:172.21.15.110:3300/0 conn(0x7f62e8151370 0x7f62e81517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62e6a00700 1 -- 172.21.15.49:0/3460078429 >> v1:172.21.15.49:6789/0 conn(0x7f62e80be6a0 legacy=0x7f62e80c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62e6a00700 1 -- 172.21.15.49:0/3460078429 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e80bdbc0 con 0x7f62e8064690 2024-01-22T05:16:56.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62e6a00700 1 --2- 172.21.15.49:0/3460078429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62e8064690 0x7f62e8064af0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f62e80c51a0 tx=0x7f62d0009060).ready entity=mon.0 client_cookie=7ce1d12ba751c310 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:56.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62e6000700 1 -- 172.21.15.49:0/3460078429 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d000d4a0 con 0x7f62e8064690 2024-01-22T05:16:56.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62e6000700 1 -- 172.21.15.49:0/3460078429 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d000d600 con 0x7f62e8064690 2024-01-22T05:16:56.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62e6000700 1 -- 172.21.15.49:0/3460078429 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d000d980 con 0x7f62e8064690 2024-01-22T05:16:56.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62ee400700 1 -- 172.21.15.49:0/3460078429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62e8064690 msgr2=0x7f62e8064af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62ee400700 1 --2- 172.21.15.49:0/3460078429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62e8064690 0x7f62e8064af0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f62e80c51a0 tx=0x7f62d0009060).stop 2024-01-22T05:16:56.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62ee400700 1 -- 172.21.15.49:0/3460078429 shutdown_connections 2024-01-22T05:16:56.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62ee400700 1 --2- 172.21.15.49:0/3460078429 >> v2:172.21.15.110:3300/0 conn(0x7f62e8151370 0x7f62e81517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62ee400700 1 --2- 172.21.15.49:0/3460078429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62e8064690 0x7f62e8064af0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62ee400700 1 -- 172.21.15.49:0/3460078429 >> 172.21.15.49:0/3460078429 conn(0x7f62e80c87f0 msgr2=0x7f62e80c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:56.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62ee400700 1 -- 172.21.15.49:0/3460078429 shutdown_connections 2024-01-22T05:16:56.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.896+0000 7f62ee400700 1 -- 172.21.15.49:0/3460078429 wait complete. 2024-01-22T05:16:56.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.900+0000 7f62ee400700 1 Processor -- start 2024-01-22T05:16:56.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.900+0000 7f62ee400700 1 -- start start 2024-01-22T05:16:56.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ee400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62e8064690 0x7f62e80c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ee400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e80be6a0 0x7f62e814d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ee400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62e8151370 0x7f62e814d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ee400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e814db60 con 0x7f62e8151370 2024-01-22T05:16:56.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ee400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e80bffe0 con 0x7f62e8064690 2024-01-22T05:16:56.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ee400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8164fd0 con 0x7f62e80be6a0 2024-01-22T05:16:56.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ece00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62e8151370 0x7f62e814d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ece00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62e8151370 0x7f62e814d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54740/0 (socket says 172.21.15.49:54740) 2024-01-22T05:16:56.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ece00700 1 -- 172.21.15.49:0/1831740971 learned_addr learned my addr 172.21.15.49:0/1831740971 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:56.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62e7400700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62e8064690 0x7f62e80c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62e6a00700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e80be6a0 0x7f62e814d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ece00700 1 -- 172.21.15.49:0/1831740971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e80be6a0 msgr2=0x7f62e814d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ece00700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e80be6a0 0x7f62e814d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ece00700 1 -- 172.21.15.49:0/1831740971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62e8064690 msgr2=0x7f62e80c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:56.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ece00700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62e8064690 0x7f62e80c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:56.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ece00700 1 -- 172.21.15.49:0/1831740971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d00092a0 con 0x7f62e8151370 2024-01-22T05:16:56.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62e7400700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62e8064690 0x7f62e80c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:56.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62e6a00700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e80be6a0 0x7f62e814d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:56.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ece00700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62e8151370 0x7f62e814d670 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f62e0009df0 tx=0x7f62e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:56.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62dea00700 1 -- 172.21.15.49:0/1831740971 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e000cb50 con 0x7f62e8151370 2024-01-22T05:16:56.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ee400700 1 -- 172.21.15.49:0/1831740971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e80c0280 con 0x7f62e8151370 2024-01-22T05:16:56.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62dea00700 1 -- 172.21.15.49:0/1831740971 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e000f040 con 0x7f62e8151370 2024-01-22T05:16:56.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62dea00700 1 -- 172.21.15.49:0/1831740971 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e000cec0 con 0x7f62e8151370 2024-01-22T05:16:56.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.904+0000 7f62ee400700 1 -- 172.21.15.49:0/1831740971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e81652b0 con 0x7f62e8151370 2024-01-22T05:16:56.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.908+0000 7f62ee400700 1 -- 172.21.15.49:0/1831740971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e8047060 con 0x7f62e8151370 2024-01-22T05:16:56.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.908+0000 7f62dea00700 1 -- 172.21.15.49:0/1831740971 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f62e0013610 con 0x7f62e8151370 2024-01-22T05:16:56.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.912+0000 7f62dea00700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f62c005a510 0x7f62c005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:56.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.912+0000 7f62dea00700 1 -- 172.21.15.49:0/1831740971 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f62e00752b0 con 0x7f62e8151370 2024-01-22T05:16:56.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.912+0000 7f62e7400700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f62c005a510 0x7f62c005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:56.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.912+0000 7f62e7400700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f62c005a510 0x7f62c005c9d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f62d8007fd0 tx=0x7f62d8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:56.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:56.916+0000 7f62dea00700 1 -- 172.21.15.49:0/1831740971 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f62e00488d0 con 0x7f62e8151370 2024-01-22T05:16:57.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:57.136+0000 7f62ee400700 1 -- 172.21.15.49:0/1831740971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f62e80bdea0 con 0x7f62e8151370 2024-01-22T05:16:57.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:57.140+0000 7f62dea00700 1 -- 172.21.15.49:0/1831740971 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1030 (secure 0 0 0) 0x7f62e004bef0 con 0x7f62e8151370 2024-01-22T05:16:57.140 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:57.140 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":760,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":951,"data_bytes":975815829,"bytes_used":4444217344,"bytes_avail":768649895936,"bytes_total":773094113280,"write_bytes_sec":27396614,"read_op_per_sec":0,"write_op_per_sec":26},"fsmap":{"epoch":114,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8829}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2024-01-22T05:16:03.488533+0000","services":{}},"progress_events":{}} 2024-01-22T05:16:57.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:57.144+0000 7f62ee400700 1 -- 172.21.15.49:0/1831740971 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f62c005a510 msgr2=0x7f62c005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:57.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:57.144+0000 7f62ee400700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f62c005a510 0x7f62c005c9d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f62d8007fd0 tx=0x7f62d8009040).stop 2024-01-22T05:16:57.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:57.144+0000 7f62ee400700 1 -- 172.21.15.49:0/1831740971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62e8151370 msgr2=0x7f62e814d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:57.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:57.144+0000 7f62ee400700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62e8151370 0x7f62e814d670 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f62e0009df0 tx=0x7f62e000b040).stop 2024-01-22T05:16:57.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:57.144+0000 7f62ee400700 1 -- 172.21.15.49:0/1831740971 shutdown_connections 2024-01-22T05:16:57.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:57.144+0000 7f62ee400700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f62c005a510 0x7f62c005c9d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:57.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:57.144+0000 7f62ee400700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62e8151370 0x7f62e814d670 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:57.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:57.144+0000 7f62ee400700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62e80be6a0 0x7f62e814d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:57.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:57.144+0000 7f62ee400700 1 --2- 172.21.15.49:0/1831740971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62e8064690 0x7f62e80c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:57.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:57.144+0000 7f62ee400700 1 -- 172.21.15.49:0/1831740971 >> 172.21.15.49:0/1831740971 conn(0x7f62e80c87f0 msgr2=0x7f62e80a90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:57.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:57.144+0000 7f62ee400700 1 -- 172.21.15.49:0/1831740971 shutdown_connections 2024-01-22T05:16:57.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:57.144+0000 7f62ee400700 1 -- 172.21.15.49:0/1831740971 wait complete. 2024-01-22T05:16:58.167 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:16:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.340+0000 7f8018e00700 1 Processor -- start 2024-01-22T05:16:58.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.340+0000 7f8018e00700 1 -- start start 2024-01-22T05:16:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8018e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f801415bd20 0x7f80140629a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8018e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8014062230 con 0x7f80140c3fa0 2024-01-22T05:16:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8018e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80140c55d0 con 0x7f8014062e90 2024-01-22T05:16:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8018e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8014062580 con 0x7f801415bd20 2024-01-22T05:16:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8011e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f801415bd20 0x7f80140629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8012800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f80140c3fa0 0x7f80140c43f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60518/0 (socket says 172.21.15.49:60518) 2024-01-22T05:16:58.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8012800700 1 -- 172.21.15.49:0/2353237634 learned_addr learned my addr 172.21.15.49:0/2353237634 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:16:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8010a00700 1 -- 172.21.15.49:0/2353237634 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238062483 0 0) 0x7f8014062230 con 0x7f80140c3fa0 2024-01-22T05:16:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8010a00700 1 -- 172.21.15.49:0/2353237634 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ff40033f0 con 0x7f80140c3fa0 2024-01-22T05:16:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8011e00700 1 -- 172.21.15.49:0/2353237634 >> v1:172.21.15.110:6789/0 conn(0x7f8014062e90 legacy=0x7f80140637b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8011e00700 1 -- 172.21.15.49:0/2353237634 >> v1:172.21.15.49:6789/0 conn(0x7f80140c3fa0 legacy=0x7f80140c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8010a00700 1 -- 172.21.15.49:0/2353237634 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067552447 0 0) 0x7f80140c55d0 con 0x7f8014062e90 2024-01-22T05:16:58.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8011e00700 1 -- 172.21.15.49:0/2353237634 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801415c4c0 con 0x7f801415bd20 2024-01-22T05:16:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8011e00700 1 --2- 172.21.15.49:0/2353237634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f801415bd20 0x7f80140629a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f8004006fd0 tx=0x7f8004006f40).ready entity=mon.0 client_cookie=db44881273743e40 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8010a00700 1 -- 172.21.15.49:0/2353237634 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004005880 con 0x7f801415bd20 2024-01-22T05:16:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8010a00700 1 -- 172.21.15.49:0/2353237634 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80040059e0 con 0x7f801415bd20 2024-01-22T05:16:58.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.344+0000 7f8010a00700 1 -- 172.21.15.49:0/2353237634 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004005d60 con 0x7f801415bd20 2024-01-22T05:16:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.348+0000 7f8018e00700 1 -- 172.21.15.49:0/2353237634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f801415bd20 msgr2=0x7f80140629a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.348+0000 7f8018e00700 1 --2- 172.21.15.49:0/2353237634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f801415bd20 0x7f80140629a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f8004006fd0 tx=0x7f8004006f40).stop 2024-01-22T05:16:58.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.348+0000 7f8018e00700 1 -- 172.21.15.49:0/2353237634 shutdown_connections 2024-01-22T05:16:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.348+0000 7f8018e00700 1 --2- 172.21.15.49:0/2353237634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f801415bd20 0x7f80140629a0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.348+0000 7f8018e00700 1 -- 172.21.15.49:0/2353237634 >> 172.21.15.49:0/2353237634 conn(0x7f80140aa660 msgr2=0x7f80140aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.348+0000 7f8018e00700 1 -- 172.21.15.49:0/2353237634 shutdown_connections 2024-01-22T05:16:58.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.348+0000 7f8018e00700 1 -- 172.21.15.49:0/2353237634 wait complete. 2024-01-22T05:16:58.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.352+0000 7f8018e00700 1 Processor -- start 2024-01-22T05:16:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.352+0000 7f8018e00700 1 -- start start 2024-01-22T05:16:58.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.352+0000 7f8018e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8014062e90 0x7f80140bf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:58.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.352+0000 7f8018e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80140c3fa0 0x7f80141690d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:58.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.352+0000 7f8018e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f801415bd20 0x7f80141587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:58.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.352+0000 7f8018e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80141695c0 con 0x7f8014062e90 2024-01-22T05:16:58.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.352+0000 7f8018e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8014158cc0 con 0x7f801415bd20 2024-01-22T05:16:58.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.352+0000 7f8018e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80140bfc30 con 0x7f80140c3fa0 2024-01-22T05:16:58.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.352+0000 7f8011e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8014062e90 0x7f80140bf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:58.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.352+0000 7f8011e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8014062e90 0x7f80140bf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54750/0 (socket says 172.21.15.49:54750) 2024-01-22T05:16:58.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.352+0000 7f8011e00700 1 -- 172.21.15.49:0/2424159077 learned_addr learned my addr 172.21.15.49:0/2424159077 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:58.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.356+0000 7f8012800700 1 --2- 172.21.15.49:0/2424159077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f801415bd20 0x7f80141587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:58.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.356+0000 7f8011400700 1 --2- 172.21.15.49:0/2424159077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80140c3fa0 0x7f80141690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:58.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.356+0000 7f8011e00700 1 -- 172.21.15.49:0/2424159077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80140c3fa0 msgr2=0x7f80141690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:58.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.356+0000 7f8011e00700 1 --2- 172.21.15.49:0/2424159077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80140c3fa0 0x7f80141690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.356+0000 7f8011e00700 1 -- 172.21.15.49:0/2424159077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f801415bd20 msgr2=0x7f80141587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:58.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.356+0000 7f8011e00700 1 --2- 172.21.15.49:0/2424159077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f801415bd20 0x7f80141587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.356+0000 7f8011e00700 1 -- 172.21.15.49:0/2424159077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004009250 con 0x7f8014062e90 2024-01-22T05:16:58.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.356+0000 7f8012800700 1 --2- 172.21.15.49:0/2424159077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f801415bd20 0x7f80141587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:16:58.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.356+0000 7f8011e00700 1 --2- 172.21.15.49:0/2424159077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8014062e90 0x7f80140bf650 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f8014065e20 tx=0x7f8004016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:58.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.356+0000 7f8009600700 1 -- 172.21.15.49:0/2424159077 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800400f720 con 0x7f8014062e90 2024-01-22T05:16:58.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.356+0000 7f8009600700 1 -- 172.21.15.49:0/2424159077 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800400f880 con 0x7f8014062e90 2024-01-22T05:16:58.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.356+0000 7f8009600700 1 -- 172.21.15.49:0/2424159077 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800400fc00 con 0x7f8014062e90 2024-01-22T05:16:58.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.356+0000 7f8018e00700 1 -- 172.21.15.49:0/2424159077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80140bff10 con 0x7f8014062e90 2024-01-22T05:16:58.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.356+0000 7f8018e00700 1 -- 172.21.15.49:0/2424159077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80140c04d0 con 0x7f8014062e90 2024-01-22T05:16:58.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.356+0000 7f8018e00700 1 -- 172.21.15.49:0/2424159077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80140647e0 con 0x7f8014062e90 2024-01-22T05:16:58.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.360+0000 7f8009600700 1 -- 172.21.15.49:0/2424159077 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8004026460 con 0x7f8014062e90 2024-01-22T05:16:58.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.360+0000 7f8009600700 1 --2- 172.21.15.49:0/2424159077 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7fec05a510 0x7f7fec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:58.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.360+0000 7f8009600700 1 -- 172.21.15.49:0/2424159077 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f8004075c30 con 0x7f8014062e90 2024-01-22T05:16:58.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.360+0000 7f8011400700 1 --2- 172.21.15.49:0/2424159077 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7fec05a510 0x7f7fec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:58.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.360+0000 7f8011400700 1 --2- 172.21.15.49:0/2424159077 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7fec05a510 0x7f7fec05c9d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f7ffc007fd0 tx=0x7f7ffc007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:58.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.368+0000 7f8009600700 1 -- 172.21.15.49:0/2424159077 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8004049230 con 0x7f8014062e90 2024-01-22T05:16:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.560+0000 7f8018e00700 1 -- 172.21.15.49:0/2424159077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f801415c7a0 con 0x7f8014062e90 2024-01-22T05:16:58.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.564+0000 7f8009600700 1 -- 172.21.15.49:0/2424159077 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4500 (secure 0 0 0) 0x7f800404c850 con 0x7f8014062e90 2024-01-22T05:16:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:58.564 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":114,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":8826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:16:17.362338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/4015076184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":4015076184},{"type":"v1","addr":"172.21.15.49:6837","nonce":4015076184}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:16:58.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.564+0000 7f8018e00700 1 -- 172.21.15.49:0/2424159077 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7fec05a510 msgr2=0x7f7fec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:58.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.564+0000 7f8018e00700 1 --2- 172.21.15.49:0/2424159077 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7fec05a510 0x7f7fec05c9d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f7ffc007fd0 tx=0x7f7ffc007bb0).stop 2024-01-22T05:16:58.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.564+0000 7f8018e00700 1 -- 172.21.15.49:0/2424159077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8014062e90 msgr2=0x7f80140bf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:58.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.564+0000 7f8018e00700 1 --2- 172.21.15.49:0/2424159077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8014062e90 0x7f80140bf650 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f8014065e20 tx=0x7f8004016000).stop 2024-01-22T05:16:58.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.568+0000 7f8018e00700 1 -- 172.21.15.49:0/2424159077 shutdown_connections 2024-01-22T05:16:58.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.568+0000 7f8018e00700 1 --2- 172.21.15.49:0/2424159077 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7fec05a510 0x7f7fec05c9d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.568+0000 7f8018e00700 1 --2- 172.21.15.49:0/2424159077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f801415bd20 0x7f80141587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.568+0000 7f8018e00700 1 --2- 172.21.15.49:0/2424159077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80140c3fa0 0x7f80141690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.568+0000 7f8018e00700 1 --2- 172.21.15.49:0/2424159077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8014062e90 0x7f80140bf650 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.568+0000 7f8018e00700 1 -- 172.21.15.49:0/2424159077 >> 172.21.15.49:0/2424159077 conn(0x7f80140aa660 msgr2=0x7f8014069aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:58.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.568+0000 7f8018e00700 1 -- 172.21.15.49:0/2424159077 shutdown_connections 2024-01-22T05:16:58.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.568+0000 7f8018e00700 1 -- 172.21.15.49:0/2424159077 wait complete. 2024-01-22T05:16:58.571 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 114 2024-01-22T05:16:58.591 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-01-22T05:16:58.591 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:16:58.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.748+0000 7f81a6e00700 1 Processor -- start 2024-01-22T05:16:58.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.748+0000 7f81a6e00700 1 -- start start 2024-01-22T05:16:58.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f81a6e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f81a00be6a0 0x7f81a00c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:58.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f81a6e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81a0151a80 0x7f81a0064af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:58.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f81a6e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a00be210 con 0x7f81a0064690 2024-01-22T05:16:58.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f81a6e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a00bd650 con 0x7f81a00be6a0 2024-01-22T05:16:58.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f81a6e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00bd8e0 con 0x7f81a0151a80 2024-01-22T05:16:58.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f819fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f81a00be6a0 0x7f81a00c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:58.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f819fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f81a00be6a0 0x7f81a00c2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54764/0 (socket says 172.21.15.49:54764) 2024-01-22T05:16:58.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f819f400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f81a0064690 0x7f81a0151370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:53530/0 (socket says 172.21.15.49:53530) 2024-01-22T05:16:58.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f81a5800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81a0151a80 0x7f81a0064af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:58.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f819fe00700 1 -- 172.21.15.49:0/2183335930 learned_addr learned my addr 172.21.15.49:0/2183335930 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f81a5800700 1 -- 172.21.15.49:0/2183335930 >> v2:172.21.15.49:3300/0 conn(0x7f81a00be6a0 msgr2=0x7f81a00c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:16:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f81a5800700 1 --2- 172.21.15.49:0/2183335930 >> v2:172.21.15.49:3300/0 conn(0x7f81a00be6a0 0x7f81a00c2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f81a5800700 1 -- 172.21.15.49:0/2183335930 >> v1:172.21.15.110:6789/0 conn(0x7f81a0064690 legacy=0x7f81a0151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f81a5800700 1 -- 172.21.15.49:0/2183335930 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a00bdbc0 con 0x7f81a0151a80 2024-01-22T05:16:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f819fe00700 1 --2- 172.21.15.49:0/2183335930 >> v2:172.21.15.49:3300/0 conn(0x7f81a00be6a0 0x7f81a00c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f819ea00700 1 -- 172.21.15.49:0/2183335930 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481302375 0 0) 0x7f81a00be210 con 0x7f81a0064690 2024-01-22T05:16:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f81a5800700 1 --2- 172.21.15.49:0/2183335930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81a0151a80 0x7f81a0064af0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f8198009e60 tx=0x7f8198009780).ready entity=mon.2 client_cookie=5f4a61951b711e0f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:58.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f819ea00700 1 -- 172.21.15.49:0/2183335930 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819800e070 con 0x7f81a0151a80 2024-01-22T05:16:58.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f819ea00700 1 -- 172.21.15.49:0/2183335930 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819800bb60 con 0x7f81a0151a80 2024-01-22T05:16:58.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.752+0000 7f819ea00700 1 -- 172.21.15.49:0/2183335930 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198012410 con 0x7f81a0151a80 2024-01-22T05:16:58.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.756+0000 7f81a6e00700 1 -- 172.21.15.49:0/2183335930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81a0151a80 msgr2=0x7f81a0064af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:58.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.756+0000 7f81a6e00700 1 --2- 172.21.15.49:0/2183335930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81a0151a80 0x7f81a0064af0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f8198009e60 tx=0x7f8198009780).stop 2024-01-22T05:16:58.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.756+0000 7f81a6e00700 1 -- 172.21.15.49:0/2183335930 shutdown_connections 2024-01-22T05:16:58.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.756+0000 7f81a6e00700 1 --2- 172.21.15.49:0/2183335930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81a0151a80 0x7f81a0064af0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.756+0000 7f81a6e00700 1 --2- 172.21.15.49:0/2183335930 >> v2:172.21.15.49:3300/0 conn(0x7f81a00be6a0 0x7f81a00c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.756+0000 7f81a6e00700 1 -- 172.21.15.49:0/2183335930 >> 172.21.15.49:0/2183335930 conn(0x7f81a00c87f0 msgr2=0x7f81a00c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:58.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.756+0000 7f81a6e00700 1 -- 172.21.15.49:0/2183335930 shutdown_connections 2024-01-22T05:16:58.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.756+0000 7f81a6e00700 1 -- 172.21.15.49:0/2183335930 wait complete. 2024-01-22T05:16:58.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.760+0000 7f81a6e00700 1 Processor -- start 2024-01-22T05:16:58.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.760+0000 7f81a6e00700 1 -- start start 2024-01-22T05:16:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.760+0000 7f81a6e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81a0064690 0x7f81a013f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.760+0000 7f81a6e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81a00be6a0 0x7f81a00c1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.760+0000 7f81a6e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81a0151a80 0x7f81a00ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.760+0000 7f81a6e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a0152cc0 con 0x7f81a0064690 2024-01-22T05:16:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.760+0000 7f81a6e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a013fe70 con 0x7f81a0151a80 2024-01-22T05:16:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.760+0000 7f81a6e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a01520b0 con 0x7f81a00be6a0 2024-01-22T05:16:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.760+0000 7f819fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81a0064690 0x7f81a013f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.760+0000 7f81a5800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81a0151a80 0x7f81a00ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.760+0000 7f819fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81a0064690 0x7f81a013f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54776/0 (socket says 172.21.15.49:54776) 2024-01-22T05:16:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.760+0000 7f819fe00700 1 -- 172.21.15.49:0/1102867458 learned_addr learned my addr 172.21.15.49:0/1102867458 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:16:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.760+0000 7f819f400700 1 --2- 172.21.15.49:0/1102867458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81a00be6a0 0x7f81a00c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:58.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.764+0000 7f81a5800700 1 -- 172.21.15.49:0/1102867458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81a00be6a0 msgr2=0x7f81a00c1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:58.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.764+0000 7f81a5800700 1 --2- 172.21.15.49:0/1102867458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81a00be6a0 0x7f81a00c1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.764+0000 7f81a5800700 1 -- 172.21.15.49:0/1102867458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81a0064690 msgr2=0x7f81a013f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:58.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.764+0000 7f81a5800700 1 --2- 172.21.15.49:0/1102867458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81a0064690 0x7f81a013f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.764+0000 7f81a5800700 1 -- 172.21.15.49:0/1102867458 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8190009370 con 0x7f81a0151a80 2024-01-22T05:16:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.764+0000 7f819fe00700 1 --2- 172.21.15.49:0/1102867458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81a0064690 0x7f81a013f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:16:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.764+0000 7f81a5800700 1 --2- 172.21.15.49:0/1102867458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81a0151a80 0x7f81a00ace20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f8198014000 tx=0x7f8198009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.764+0000 7f8197400700 1 -- 172.21.15.49:0/1102867458 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198012410 con 0x7f81a0151a80 2024-01-22T05:16:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.764+0000 7f8197400700 1 -- 172.21.15.49:0/1102867458 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819801d630 con 0x7f81a0151a80 2024-01-22T05:16:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.764+0000 7f8197400700 1 -- 172.21.15.49:0/1102867458 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819801d9f0 con 0x7f81a0151a80 2024-01-22T05:16:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.764+0000 7f81a6e00700 1 -- 172.21.15.49:0/1102867458 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8198009a20 con 0x7f81a0151a80 2024-01-22T05:16:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.764+0000 7f81a6e00700 1 -- 172.21.15.49:0/1102867458 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a0152670 con 0x7f81a0151a80 2024-01-22T05:16:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.764+0000 7f81a6e00700 1 -- 172.21.15.49:0/1102867458 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a0152e70 con 0x7f81a0151a80 2024-01-22T05:16:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.768+0000 7f8197400700 1 -- 172.21.15.49:0/1102867458 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8198003040 con 0x7f81a0151a80 2024-01-22T05:16:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.768+0000 7f8197400700 1 --2- 172.21.15.49:0/1102867458 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f817805a540 0x7f817805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:16:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.768+0000 7f8197400700 1 -- 172.21.15.49:0/1102867458 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f8198076630 con 0x7f81a0151a80 2024-01-22T05:16:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.768+0000 7f819fe00700 1 --2- 172.21.15.49:0/1102867458 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f817805a540 0x7f817805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:16:58.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.768+0000 7f819fe00700 1 --2- 172.21.15.49:0/1102867458 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f817805a540 0x7f817805ca00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f8190009fd0 tx=0x7f81900090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:16:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.772+0000 7f8197400700 1 -- 172.21.15.49:0/1102867458 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f81a0152e70 con 0x7f81a0151a80 2024-01-22T05:16:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.988+0000 7f81a6e00700 1 -- 172.21.15.49:0/1102867458 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f81a0152e30 con 0x7f81a0151a80 2024-01-22T05:16:58.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.992+0000 7f8197400700 1 -- 172.21.15.49:0/1102867458 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1032 (secure 0 0 0) 0x7f8198049bd0 con 0x7f81a0151a80 2024-01-22T05:16:58.992 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:16:58.992 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":762,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075747366,"bytes_used":4676591616,"bytes_avail":768417521664,"bytes_total":773094113280,"write_bytes_sec":35724615,"read_op_per_sec":0,"write_op_per_sec":35},"fsmap":{"epoch":114,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8829}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2024-01-22T05:16:03.488533+0000","services":{}},"progress_events":{}} 2024-01-22T05:16:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.992+0000 7f81a6e00700 1 -- 172.21.15.49:0/1102867458 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f817805a540 msgr2=0x7f817805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.992+0000 7f81a6e00700 1 --2- 172.21.15.49:0/1102867458 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f817805a540 0x7f817805ca00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f8190009fd0 tx=0x7f81900090f0).stop 2024-01-22T05:16:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.992+0000 7f81a6e00700 1 -- 172.21.15.49:0/1102867458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81a0151a80 msgr2=0x7f81a00ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:16:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.992+0000 7f81a6e00700 1 --2- 172.21.15.49:0/1102867458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81a0151a80 0x7f81a00ace20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f8198014000 tx=0x7f8198009780).stop 2024-01-22T05:16:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.992+0000 7f81a6e00700 1 -- 172.21.15.49:0/1102867458 shutdown_connections 2024-01-22T05:16:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.992+0000 7f81a6e00700 1 --2- 172.21.15.49:0/1102867458 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f817805a540 0x7f817805ca00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.992+0000 7f81a6e00700 1 --2- 172.21.15.49:0/1102867458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81a0151a80 0x7f81a00ace20 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.992+0000 7f81a6e00700 1 --2- 172.21.15.49:0/1102867458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81a00be6a0 0x7f81a00c1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.992+0000 7f81a6e00700 1 --2- 172.21.15.49:0/1102867458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81a0064690 0x7f81a013f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:16:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.992+0000 7f81a6e00700 1 -- 172.21.15.49:0/1102867458 >> 172.21.15.49:0/1102867458 conn(0x7f81a00c87f0 msgr2=0x7f81a0062230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:16:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.996+0000 7f81a6e00700 1 -- 172.21.15.49:0/1102867458 shutdown_connections 2024-01-22T05:16:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:16:58.996+0000 7f81a6e00700 1 -- 172.21.15.49:0/1102867458 wait complete. 2024-01-22T05:17:00.016 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:17:00.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.180+0000 7f239ca00700 1 Processor -- start 2024-01-22T05:17:00.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.180+0000 7f239ca00700 1 -- start start 2024-01-22T05:17:00.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f239ca00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2394155d20 0x7f2394065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:00.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f239ca00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f23940a8e50 0x7f23940c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:00.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f239ca00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23940c1a40 con 0x7f2394066070 2024-01-22T05:17:00.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f239ca00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2394159310 con 0x7f23940a8e50 2024-01-22T05:17:00.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f239ca00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23940c13f0 con 0x7f2394155d20 2024-01-22T05:17:00.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f239aa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f23940a8e50 0x7f23940c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:00.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f239aa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f23940a8e50 0x7f23940c1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54788/0 (socket says 172.21.15.49:54788) 2024-01-22T05:17:00.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f239aa00700 1 -- 172.21.15.49:0/2289043023 learned_addr learned my addr 172.21.15.49:0/2289043023 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:00.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f239a000700 1 --2- 172.21.15.49:0/2289043023 >> v2:172.21.15.110:3300/0 conn(0x7f2394155d20 0x7f2394065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:00.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f239aa00700 1 -- 172.21.15.49:0/2289043023 >> v2:172.21.15.110:3300/0 conn(0x7f2394155d20 msgr2=0x7f2394065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:00.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f239aa00700 1 --2- 172.21.15.49:0/2289043023 >> v2:172.21.15.110:3300/0 conn(0x7f2394155d20 0x7f2394065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f239aa00700 1 -- 172.21.15.49:0/2289043023 >> v1:172.21.15.49:6789/0 conn(0x7f2394066070 legacy=0x7f23940a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:00.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f239aa00700 1 -- 172.21.15.49:0/2289043023 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23940c16d0 con 0x7f23940a8e50 2024-01-22T05:17:00.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f239aa00700 1 --2- 172.21.15.49:0/2289043023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23940a8e50 0x7f23940c1ed0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f239405ff40 tx=0x7f238c009840).ready entity=mon.0 client_cookie=bd161ff8fac6021 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:00.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f2398c00700 1 -- 172.21.15.49:0/2289043023 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c00e070 con 0x7f23940a8e50 2024-01-22T05:17:00.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f2398c00700 1 -- 172.21.15.49:0/2289043023 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c00ba50 con 0x7f23940a8e50 2024-01-22T05:17:00.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.184+0000 7f2398c00700 1 -- 172.21.15.49:0/2289043023 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c00bdd0 con 0x7f23940a8e50 2024-01-22T05:17:00.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.188+0000 7f239ca00700 1 -- 172.21.15.49:0/2289043023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23940a8e50 msgr2=0x7f23940c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:00.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.188+0000 7f239ca00700 1 --2- 172.21.15.49:0/2289043023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23940a8e50 0x7f23940c1ed0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f239405ff40 tx=0x7f238c009840).stop 2024-01-22T05:17:00.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.188+0000 7f239ca00700 1 -- 172.21.15.49:0/2289043023 shutdown_connections 2024-01-22T05:17:00.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.188+0000 7f239ca00700 1 --2- 172.21.15.49:0/2289043023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23940a8e50 0x7f23940c1ed0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.188+0000 7f239ca00700 1 --2- 172.21.15.49:0/2289043023 >> v2:172.21.15.110:3300/0 conn(0x7f2394155d20 0x7f2394065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.188+0000 7f239ca00700 1 -- 172.21.15.49:0/2289043023 >> 172.21.15.49:0/2289043023 conn(0x7f23940c6540 msgr2=0x7f23940c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:00.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.188+0000 7f239ca00700 1 -- 172.21.15.49:0/2289043023 shutdown_connections 2024-01-22T05:17:00.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.188+0000 7f239ca00700 1 -- 172.21.15.49:0/2289043023 wait complete. 2024-01-22T05:17:00.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.192+0000 7f239ca00700 1 Processor -- start 2024-01-22T05:17:00.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.192+0000 7f239ca00700 1 -- start start 2024-01-22T05:17:00.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239ca00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2394066070 0x7f2394151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:00.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239ca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23940a8e50 0x7f23940c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:00.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2394155d20 0x7f2394168fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:00.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239ca00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23940c62b0 con 0x7f2394155d20 2024-01-22T05:17:00.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239ca00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23940ac3f0 con 0x7f2394066070 2024-01-22T05:17:00.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239ca00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23940abf60 con 0x7f23940a8e50 2024-01-22T05:17:00.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2394155d20 0x7f2394168fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:00.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2394155d20 0x7f2394168fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54802/0 (socket says 172.21.15.49:54802) 2024-01-22T05:17:00.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239a000700 1 --2- 172.21.15.49:0/2044275309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2394066070 0x7f2394151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:00.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239aa00700 1 -- 172.21.15.49:0/2044275309 learned_addr learned my addr 172.21.15.49:0/2044275309 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:00.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f2399600700 1 --2- 172.21.15.49:0/2044275309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23940a8e50 0x7f23940c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:00.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239aa00700 1 -- 172.21.15.49:0/2044275309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23940a8e50 msgr2=0x7f23940c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:00.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239aa00700 1 --2- 172.21.15.49:0/2044275309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23940a8e50 0x7f23940c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239aa00700 1 -- 172.21.15.49:0/2044275309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2394066070 msgr2=0x7f2394151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:00.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239aa00700 1 --2- 172.21.15.49:0/2044275309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2394066070 0x7f2394151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239aa00700 1 -- 172.21.15.49:0/2044275309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c009ae0 con 0x7f2394155d20 2024-01-22T05:17:00.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239a000700 1 --2- 172.21.15.49:0/2044275309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2394066070 0x7f2394151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:00.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239aa00700 1 --2- 172.21.15.49:0/2044275309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2394155d20 0x7f2394168fe0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f238c009fd0 tx=0x7f238c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:00.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f2391600700 1 -- 172.21.15.49:0/2044275309 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c0092e0 con 0x7f2394155d20 2024-01-22T05:17:00.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f2391600700 1 -- 172.21.15.49:0/2044275309 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c01d410 con 0x7f2394155d20 2024-01-22T05:17:00.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f2391600700 1 -- 172.21.15.49:0/2044275309 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c01d7b0 con 0x7f2394155d20 2024-01-22T05:17:00.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.196+0000 7f239ca00700 1 -- 172.21.15.49:0/2044275309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23941694d0 con 0x7f2394155d20 2024-01-22T05:17:00.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.200+0000 7f239ca00700 1 -- 172.21.15.49:0/2044275309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23940ab630 con 0x7f2394155d20 2024-01-22T05:17:00.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.200+0000 7f239ca00700 1 -- 172.21.15.49:0/2044275309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2394047060 con 0x7f2394155d20 2024-01-22T05:17:00.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.200+0000 7f2391600700 1 -- 172.21.15.49:0/2044275309 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f238c01dbe0 con 0x7f2394155d20 2024-01-22T05:17:00.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.204+0000 7f2391600700 1 --2- 172.21.15.49:0/2044275309 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f236c05a510 0x7f236c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:00.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.204+0000 7f2391600700 1 -- 172.21.15.49:0/2044275309 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f238c076620 con 0x7f2394155d20 2024-01-22T05:17:00.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.204+0000 7f239a000700 1 --2- 172.21.15.49:0/2044275309 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f236c05a510 0x7f236c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:00.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.204+0000 7f239a000700 1 --2- 172.21.15.49:0/2044275309 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f236c05a510 0x7f236c05c9d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f23940c21f0 tx=0x7f2384008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.208+0000 7f2391600700 1 -- 172.21.15.49:0/2044275309 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f238c049d20 con 0x7f2394155d20 2024-01-22T05:17:00.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.404+0000 7f239ca00700 1 -- 172.21.15.49:0/2044275309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23940c23c0 con 0x7f2394155d20 2024-01-22T05:17:00.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.404+0000 7f2391600700 1 -- 172.21.15.49:0/2044275309 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4500 (secure 0 0 0) 0x7f238c04d340 con 0x7f2394155d20 2024-01-22T05:17:00.404 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:00.404 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":114,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":8826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:16:17.362338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/4015076184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":4015076184},{"type":"v1","addr":"172.21.15.49:6837","nonce":4015076184}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:17:00.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.408+0000 7f239ca00700 1 -- 172.21.15.49:0/2044275309 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f236c05a510 msgr2=0x7f236c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:00.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.408+0000 7f239ca00700 1 --2- 172.21.15.49:0/2044275309 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f236c05a510 0x7f236c05c9d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f23940c21f0 tx=0x7f2384008040).stop 2024-01-22T05:17:00.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.408+0000 7f239ca00700 1 -- 172.21.15.49:0/2044275309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2394155d20 msgr2=0x7f2394168fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:00.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.408+0000 7f239ca00700 1 --2- 172.21.15.49:0/2044275309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2394155d20 0x7f2394168fe0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f238c009fd0 tx=0x7f238c009840).stop 2024-01-22T05:17:00.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.408+0000 7f239ca00700 1 -- 172.21.15.49:0/2044275309 shutdown_connections 2024-01-22T05:17:00.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.408+0000 7f239ca00700 1 --2- 172.21.15.49:0/2044275309 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f236c05a510 0x7f236c05c9d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.408+0000 7f239ca00700 1 --2- 172.21.15.49:0/2044275309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2394155d20 0x7f2394168fe0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.408+0000 7f239ca00700 1 --2- 172.21.15.49:0/2044275309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23940a8e50 0x7f23940c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.408+0000 7f239ca00700 1 --2- 172.21.15.49:0/2044275309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2394066070 0x7f2394151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.408+0000 7f239ca00700 1 -- 172.21.15.49:0/2044275309 >> 172.21.15.49:0/2044275309 conn(0x7f23940c6540 msgr2=0x7f23940bbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:00.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.408+0000 7f239ca00700 1 -- 172.21.15.49:0/2044275309 shutdown_connections 2024-01-22T05:17:00.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.408+0000 7f239ca00700 1 -- 172.21.15.49:0/2044275309 wait complete. 2024-01-22T05:17:00.412 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 114 2024-01-22T05:17:00.432 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-01-22T05:17:00.433 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:17:00.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.600+0000 7f57c4c00700 1 Processor -- start 2024-01-22T05:17:00.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.600+0000 7f57c4c00700 1 -- start start 2024-01-22T05:17:00.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.600+0000 7f57c4c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57c0064c00 0x7f57c00bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:00.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.600+0000 7f57c4c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f57c0065620 0x7f57c00bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:00.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.600+0000 7f57c4c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c00c2700 con 0x7f57c0065240 2024-01-22T05:17:00.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.600+0000 7f57c4c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c00c29a0 con 0x7f57c0065620 2024-01-22T05:17:00.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.600+0000 7f57c4c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c00c2c80 con 0x7f57c0064c00 2024-01-22T05:17:00.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.604+0000 7f57bf200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f57c0065620 0x7f57c00bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:00.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.604+0000 7f57bf200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f57c0065620 0x7f57c00bd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54806/0 (socket says 172.21.15.49:54806) 2024-01-22T05:17:00.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.604+0000 7f57bf200700 1 -- 172.21.15.49:0/646525037 learned_addr learned my addr 172.21.15.49:0/646525037 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:00.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.604+0000 7f57bd400700 1 --2- 172.21.15.49:0/646525037 >> v2:172.21.15.110:3300/0 conn(0x7f57c0064c00 0x7f57c00bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:00.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.604+0000 7f57bf200700 1 -- 172.21.15.49:0/646525037 >> v2:172.21.15.110:3300/0 conn(0x7f57c0064c00 msgr2=0x7f57c00bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:00.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.604+0000 7f57bf200700 1 --2- 172.21.15.49:0/646525037 >> v2:172.21.15.110:3300/0 conn(0x7f57c0064c00 0x7f57c00bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.604+0000 7f57bca00700 1 -- 172.21.15.49:0/646525037 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089884771 0 0) 0x7f57c00c2700 con 0x7f57c0065240 2024-01-22T05:17:00.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.604+0000 7f57bf200700 1 -- 172.21.15.49:0/646525037 >> v1:172.21.15.110:6789/0 conn(0x7f57c0065240 legacy=0x7f57c00644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:00.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.604+0000 7f57bf200700 1 -- 172.21.15.49:0/646525037 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c00c2f60 con 0x7f57c0065620 2024-01-22T05:17:00.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.604+0000 7f57bf200700 1 --2- 172.21.15.49:0/646525037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57c0065620 0x7f57c00bd170 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f57c0064fe0 tx=0x7f57b8009840).ready entity=mon.0 client_cookie=2069c1107c5da32b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:00.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.604+0000 7f57bca00700 1 -- 172.21.15.49:0/646525037 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b800e070 con 0x7f57c0065620 2024-01-22T05:17:00.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.604+0000 7f57bca00700 1 -- 172.21.15.49:0/646525037 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b800ba20 con 0x7f57c0065620 2024-01-22T05:17:00.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.604+0000 7f57bca00700 1 -- 172.21.15.49:0/646525037 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b800bda0 con 0x7f57c0065620 2024-01-22T05:17:00.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.604+0000 7f57c4c00700 1 -- 172.21.15.49:0/646525037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57c0065620 msgr2=0x7f57c00bd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:00.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.604+0000 7f57c4c00700 1 --2- 172.21.15.49:0/646525037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57c0065620 0x7f57c00bd170 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f57c0064fe0 tx=0x7f57b8009840).stop 2024-01-22T05:17:00.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.608+0000 7f57c4c00700 1 -- 172.21.15.49:0/646525037 shutdown_connections 2024-01-22T05:17:00.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.608+0000 7f57c4c00700 1 --2- 172.21.15.49:0/646525037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57c0065620 0x7f57c00bd170 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.608+0000 7f57c4c00700 1 --2- 172.21.15.49:0/646525037 >> v2:172.21.15.110:3300/0 conn(0x7f57c0064c00 0x7f57c00bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.608+0000 7f57c4c00700 1 -- 172.21.15.49:0/646525037 >> 172.21.15.49:0/646525037 conn(0x7f57c00c87f0 msgr2=0x7f57c00c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:00.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.608+0000 7f57c4c00700 1 -- 172.21.15.49:0/646525037 shutdown_connections 2024-01-22T05:17:00.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.608+0000 7f57c4c00700 1 -- 172.21.15.49:0/646525037 wait complete. 2024-01-22T05:17:00.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.608+0000 7f57c4c00700 1 Processor -- start 2024-01-22T05:17:00.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57c4c00700 1 -- start start 2024-01-22T05:17:00.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57c4c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57c0064c00 0x7f57c016c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:00.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57c4c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57c0065240 0x7f57c0167f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:00.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57c4c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57c0065620 0x7f57c0159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:00.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57c4c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00bedc0 con 0x7f57c0064c00 2024-01-22T05:17:00.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57c4c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00bf0a0 con 0x7f57c0065620 2024-01-22T05:17:00.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57c4c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0168870 con 0x7f57c0065240 2024-01-22T05:17:00.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57bde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57c0064c00 0x7f57c016c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:00.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57bde00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57c0064c00 0x7f57c016c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54812/0 (socket says 172.21.15.49:54812) 2024-01-22T05:17:00.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57bde00700 1 -- 172.21.15.49:0/764308435 learned_addr learned my addr 172.21.15.49:0/764308435 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:00.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57bd400700 1 --2- 172.21.15.49:0/764308435 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57c0065240 0x7f57c0167f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:00.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57bf200700 1 --2- 172.21.15.49:0/764308435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57c0065620 0x7f57c0159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:00.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57bde00700 1 -- 172.21.15.49:0/764308435 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57c0065240 msgr2=0x7f57c0167f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:00.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57bde00700 1 --2- 172.21.15.49:0/764308435 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57c0065240 0x7f57c0167f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57bde00700 1 -- 172.21.15.49:0/764308435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57c0065620 msgr2=0x7f57c0159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:00.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57bde00700 1 --2- 172.21.15.49:0/764308435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57c0065620 0x7f57c0159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57bde00700 1 -- 172.21.15.49:0/764308435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b8009ae0 con 0x7f57c0064c00 2024-01-22T05:17:00.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57bde00700 1 --2- 172.21.15.49:0/764308435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57c0064c00 0x7f57c016c1e0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f57b000c4e0 tx=0x7f57b0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:00.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57b5600700 1 -- 172.21.15.49:0/764308435 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b000f470 con 0x7f57c0064c00 2024-01-22T05:17:00.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57b5600700 1 -- 172.21.15.49:0/764308435 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b000f5f0 con 0x7f57c0064c00 2024-01-22T05:17:00.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57c4c00700 1 -- 172.21.15.49:0/764308435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c0168b50 con 0x7f57c0064c00 2024-01-22T05:17:00.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57b5600700 1 -- 172.21.15.49:0/764308435 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b000f9b0 con 0x7f57c0064c00 2024-01-22T05:17:00.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.612+0000 7f57c4c00700 1 -- 172.21.15.49:0/764308435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c0168460 con 0x7f57c0064c00 2024-01-22T05:17:00.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.616+0000 7f57c4c00700 1 -- 172.21.15.49:0/764308435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c0047060 con 0x7f57c0064c00 2024-01-22T05:17:00.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.616+0000 7f57b5600700 1 -- 172.21.15.49:0/764308435 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f57b000fd20 con 0x7f57c0064c00 2024-01-22T05:17:00.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.616+0000 7f57b5600700 1 --2- 172.21.15.49:0/764308435 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f579805a510 0x7f579805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:00.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.616+0000 7f57b5600700 1 -- 172.21.15.49:0/764308435 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f57b00740a0 con 0x7f57c0064c00 2024-01-22T05:17:00.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.616+0000 7f57bd400700 1 --2- 172.21.15.49:0/764308435 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f579805a510 0x7f579805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:00.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.620+0000 7f57bd400700 1 --2- 172.21.15.49:0/764308435 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f579805a510 0x7f579805c9d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f57c00be610 tx=0x7f57a8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:00.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.624+0000 7f57b5600700 1 -- 172.21.15.49:0/764308435 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f57b0047640 con 0x7f57c0064c00 2024-01-22T05:17:00.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.840+0000 7f57c4c00700 1 -- 172.21.15.49:0/764308435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f57c00c3240 con 0x7f57c0064c00 2024-01-22T05:17:00.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.840+0000 7f57b5600700 1 -- 172.21.15.49:0/764308435 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1032 (secure 0 0 0) 0x7f57b004ac60 con 0x7f57c0064c00 2024-01-22T05:17:00.840 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:00.840 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":764,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075747366,"bytes_used":4676591616,"bytes_avail":768417521664,"bytes_total":773094113280,"write_bytes_sec":22068680,"read_op_per_sec":0,"write_op_per_sec":21},"fsmap":{"epoch":114,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8829}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2024-01-22T05:16:03.488533+0000","services":{}},"progress_events":{}} 2024-01-22T05:17:00.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.840+0000 7f57c4c00700 1 -- 172.21.15.49:0/764308435 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f579805a510 msgr2=0x7f579805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:00.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.840+0000 7f57c4c00700 1 --2- 172.21.15.49:0/764308435 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f579805a510 0x7f579805c9d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f57c00be610 tx=0x7f57a8008040).stop 2024-01-22T05:17:00.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.840+0000 7f57c4c00700 1 -- 172.21.15.49:0/764308435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57c0064c00 msgr2=0x7f57c016c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:00.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.840+0000 7f57c4c00700 1 --2- 172.21.15.49:0/764308435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57c0064c00 0x7f57c016c1e0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f57b000c4e0 tx=0x7f57b0007c70).stop 2024-01-22T05:17:00.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.844+0000 7f57c4c00700 1 -- 172.21.15.49:0/764308435 shutdown_connections 2024-01-22T05:17:00.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.844+0000 7f57c4c00700 1 --2- 172.21.15.49:0/764308435 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f579805a510 0x7f579805c9d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.844+0000 7f57c4c00700 1 --2- 172.21.15.49:0/764308435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57c0065620 0x7f57c0159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.844+0000 7f57c4c00700 1 --2- 172.21.15.49:0/764308435 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57c0065240 0x7f57c0167f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.844+0000 7f57c4c00700 1 --2- 172.21.15.49:0/764308435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57c0064c00 0x7f57c016c1e0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:00.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.844+0000 7f57c4c00700 1 -- 172.21.15.49:0/764308435 >> 172.21.15.49:0/764308435 conn(0x7f57c00c87f0 msgr2=0x7f57c00c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:00.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.844+0000 7f57c4c00700 1 -- 172.21.15.49:0/764308435 shutdown_connections 2024-01-22T05:17:00.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:00.844+0000 7f57c4c00700 1 -- 172.21.15.49:0/764308435 wait complete. 2024-01-22T05:17:01.867 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:17:02.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.032+0000 7fce67400700 1 Processor -- start 2024-01-22T05:17:02.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.036+0000 7fce67400700 1 -- start start 2024-01-22T05:17:02.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.036+0000 7fce67400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fce600a7cb0 0x7fce60157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:02.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.036+0000 7fce67400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce60066a10 con 0x7fce600c1e50 2024-01-22T05:17:02.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.036+0000 7fce67400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce600a8140 con 0x7fce601580e0 2024-01-22T05:17:02.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.036+0000 7fce67400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce600a8420 con 0x7fce600a7cb0 2024-01-22T05:17:02.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.036+0000 7fce65400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fce600c1e50 0x7fce60068580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60544/0 (socket says 172.21.15.49:60544) 2024-01-22T05:17:02.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.036+0000 7fce65400700 1 -- 172.21.15.49:0/4020660491 learned_addr learned my addr 172.21.15.49:0/4020660491 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:02.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.036+0000 7fce64a00700 1 --2- 172.21.15.49:0/4020660491 >> v2:172.21.15.110:3300/0 conn(0x7fce600a7cb0 0x7fce60157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:02.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.040+0000 7fce5f400700 1 -- 172.21.15.49:0/4020660491 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568511631 0 0) 0x7fce60066a10 con 0x7fce600c1e50 2024-01-22T05:17:02.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.040+0000 7fce5f400700 1 -- 172.21.15.49:0/4020660491 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce400033f0 con 0x7fce600c1e50 2024-01-22T05:17:02.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.040+0000 7fce64a00700 1 -- 172.21.15.49:0/4020660491 >> v1:172.21.15.110:6789/0 conn(0x7fce601580e0 legacy=0x7fce60067e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:02.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.040+0000 7fce64a00700 1 -- 172.21.15.49:0/4020660491 >> v1:172.21.15.49:6789/0 conn(0x7fce600c1e50 legacy=0x7fce60068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:02.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.040+0000 7fce64a00700 1 -- 172.21.15.49:0/4020660491 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce600a8700 con 0x7fce600a7cb0 2024-01-22T05:17:02.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.040+0000 7fce64a00700 1 --2- 172.21.15.49:0/4020660491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce600a7cb0 0x7fce60157bf0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fce50009760 tx=0x7fce50009060).ready entity=mon.1 client_cookie=66d88f0f8bcffab8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:02.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.040+0000 7fce5f400700 1 -- 172.21.15.49:0/4020660491 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5000f510 con 0x7fce600a7cb0 2024-01-22T05:17:02.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.040+0000 7fce5f400700 1 -- 172.21.15.49:0/4020660491 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5000f670 con 0x7fce600a7cb0 2024-01-22T05:17:02.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.040+0000 7fce5f400700 1 -- 172.21.15.49:0/4020660491 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5000f9f0 con 0x7fce600a7cb0 2024-01-22T05:17:02.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.040+0000 7fce67400700 1 -- 172.21.15.49:0/4020660491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce600a7cb0 msgr2=0x7fce60157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:02.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.040+0000 7fce67400700 1 --2- 172.21.15.49:0/4020660491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce600a7cb0 0x7fce60157bf0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fce50009760 tx=0x7fce50009060).stop 2024-01-22T05:17:02.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.040+0000 7fce67400700 1 -- 172.21.15.49:0/4020660491 shutdown_connections 2024-01-22T05:17:02.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.040+0000 7fce67400700 1 --2- 172.21.15.49:0/4020660491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce600a7cb0 0x7fce60157bf0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:02.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.040+0000 7fce67400700 1 -- 172.21.15.49:0/4020660491 >> 172.21.15.49:0/4020660491 conn(0x7fce600c64a0 msgr2=0x7fce600c68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:02.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.044+0000 7fce67400700 1 -- 172.21.15.49:0/4020660491 shutdown_connections 2024-01-22T05:17:02.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.044+0000 7fce67400700 1 -- 172.21.15.49:0/4020660491 wait complete. 2024-01-22T05:17:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.044+0000 7fce67400700 1 Processor -- start 2024-01-22T05:17:02.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce67400700 1 -- start start 2024-01-22T05:17:02.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce67400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce600c1e50 0x7fce600bf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:02.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce67400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce601580e0 0x7fce60168b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:02.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce67400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce600bcea0 0x7fce60169000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:02.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce67400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce600bd370 con 0x7fce601580e0 2024-01-22T05:17:02.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce67400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce600bd650 con 0x7fce600bcea0 2024-01-22T05:17:02.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce67400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce600bd930 con 0x7fce600c1e50 2024-01-22T05:17:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce5fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce601580e0 0x7fce60168b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce5fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce601580e0 0x7fce60168b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54826/0 (socket says 172.21.15.49:54826) 2024-01-22T05:17:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce5fe00700 1 -- 172.21.15.49:0/3161266726 learned_addr learned my addr 172.21.15.49:0/3161266726 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce65400700 1 --2- 172.21.15.49:0/3161266726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce600bcea0 0x7fce60169000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce64a00700 1 --2- 172.21.15.49:0/3161266726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce600c1e50 0x7fce600bf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce5fe00700 1 -- 172.21.15.49:0/3161266726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce600c1e50 msgr2=0x7fce600bf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce5fe00700 1 --2- 172.21.15.49:0/3161266726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce600c1e50 0x7fce600bf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce5fe00700 1 -- 172.21.15.49:0/3161266726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce600bcea0 msgr2=0x7fce60169000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce5fe00700 1 --2- 172.21.15.49:0/3161266726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce600bcea0 0x7fce60169000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce5fe00700 1 -- 172.21.15.49:0/3161266726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce500092a0 con 0x7fce601580e0 2024-01-22T05:17:02.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce5fe00700 1 --2- 172.21.15.49:0/3161266726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce601580e0 0x7fce60168b10 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fce4800c440 tx=0x7fce48007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce57e00700 1 -- 172.21.15.49:0/3161266726 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4800f470 con 0x7fce601580e0 2024-01-22T05:17:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce57e00700 1 -- 172.21.15.49:0/3161266726 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4800f5d0 con 0x7fce601580e0 2024-01-22T05:17:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce67400700 1 -- 172.21.15.49:0/3161266726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce600bdc10 con 0x7fce601580e0 2024-01-22T05:17:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.048+0000 7fce57e00700 1 -- 172.21.15.49:0/3161266726 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4800f970 con 0x7fce601580e0 2024-01-22T05:17:02.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.052+0000 7fce67400700 1 -- 172.21.15.49:0/3161266726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce600bf780 con 0x7fce601580e0 2024-01-22T05:17:02.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.052+0000 7fce67400700 1 -- 172.21.15.49:0/3161266726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce600c0b40 con 0x7fce601580e0 2024-01-22T05:17:02.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.052+0000 7fce57e00700 1 -- 172.21.15.49:0/3161266726 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fce4801b3b0 con 0x7fce601580e0 2024-01-22T05:17:02.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.056+0000 7fce57e00700 1 --2- 172.21.15.49:0/3161266726 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce3805a510 0x7fce3805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:02.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.056+0000 7fce57e00700 1 -- 172.21.15.49:0/3161266726 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fce48073da0 con 0x7fce601580e0 2024-01-22T05:17:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.056+0000 7fce64a00700 1 --2- 172.21.15.49:0/3161266726 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce3805a510 0x7fce3805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.056+0000 7fce64a00700 1 --2- 172.21.15.49:0/3161266726 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce3805a510 0x7fce3805c9d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fce600c6310 tx=0x7fce50017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:02.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.060+0000 7fce57e00700 1 -- 172.21.15.49:0/3161266726 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fce48047450 con 0x7fce601580e0 2024-01-22T05:17:02.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.268+0000 7fce67400700 1 -- 172.21.15.49:0/3161266726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce6005ffb0 con 0x7fce601580e0 2024-01-22T05:17:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.268+0000 7fce57e00700 1 -- 172.21.15.49:0/3161266726 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4500 (secure 0 0 0) 0x7fce48017030 con 0x7fce601580e0 2024-01-22T05:17:02.270 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:02.271 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":114,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":8826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:16:17.362338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/4015076184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":4015076184},{"type":"v1","addr":"172.21.15.49:6837","nonce":4015076184}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:17:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.272+0000 7fce67400700 1 -- 172.21.15.49:0/3161266726 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce3805a510 msgr2=0x7fce3805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.272+0000 7fce67400700 1 --2- 172.21.15.49:0/3161266726 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce3805a510 0x7fce3805c9d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fce600c6310 tx=0x7fce50017000).stop 2024-01-22T05:17:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.272+0000 7fce67400700 1 -- 172.21.15.49:0/3161266726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce601580e0 msgr2=0x7fce60168b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.272+0000 7fce67400700 1 --2- 172.21.15.49:0/3161266726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce601580e0 0x7fce60168b10 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fce4800c440 tx=0x7fce48007dc0).stop 2024-01-22T05:17:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.272+0000 7fce67400700 1 -- 172.21.15.49:0/3161266726 shutdown_connections 2024-01-22T05:17:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.272+0000 7fce67400700 1 --2- 172.21.15.49:0/3161266726 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce3805a510 0x7fce3805c9d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.272+0000 7fce67400700 1 --2- 172.21.15.49:0/3161266726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce600bcea0 0x7fce60169000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.272+0000 7fce67400700 1 --2- 172.21.15.49:0/3161266726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce601580e0 0x7fce60168b10 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.272+0000 7fce67400700 1 --2- 172.21.15.49:0/3161266726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce600c1e50 0x7fce600bf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.272+0000 7fce67400700 1 -- 172.21.15.49:0/3161266726 >> 172.21.15.49:0/3161266726 conn(0x7fce600c64a0 msgr2=0x7fce600a9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.272+0000 7fce67400700 1 -- 172.21.15.49:0/3161266726 shutdown_connections 2024-01-22T05:17:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.272+0000 7fce67400700 1 -- 172.21.15.49:0/3161266726 wait complete. 2024-01-22T05:17:02.278 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 114 2024-01-22T05:17:02.298 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-01-22T05:17:02.298 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:17:02.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.488+0000 7fbac7c00700 1 Processor -- start 2024-01-22T05:17:02.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.488+0000 7fbac7c00700 1 -- start start 2024-01-22T05:17:02.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.492+0000 7fbac7c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbac00ab890 0x7fbac00abd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:02.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.492+0000 7fbac7c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac0068a60 con 0x7fbac00bcfa0 2024-01-22T05:17:02.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.492+0000 7fbac7c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac00bd380 con 0x7fbac0065550 2024-01-22T05:17:02.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.492+0000 7fbac7c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac00bb790 con 0x7fbac00ab890 2024-01-22T05:17:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.492+0000 7fbabfe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbac00ab890 0x7fbac00abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.492+0000 7fbabfe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbac00ab890 0x7fbac00abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54834/0 (socket says 172.21.15.49:54834) 2024-01-22T05:17:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.492+0000 7fbabfe00700 1 -- 172.21.15.49:0/1740709453 learned_addr learned my addr 172.21.15.49:0/1740709453 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.492+0000 7fbac5200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbac00bcfa0 0x7fbac0151700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60558/0 (socket says 172.21.15.49:60558) 2024-01-22T05:17:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.492+0000 7fbabfe00700 1 -- 172.21.15.49:0/1740709453 >> v1:172.21.15.110:6789/0 conn(0x7fbac0065550 legacy=0x7fbac0065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.492+0000 7fbabfe00700 1 -- 172.21.15.49:0/1740709453 >> v1:172.21.15.49:6789/0 conn(0x7fbac00bcfa0 legacy=0x7fbac0151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.492+0000 7fbabfe00700 1 -- 172.21.15.49:0/1740709453 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac00ac210 con 0x7fbac00ab890 2024-01-22T05:17:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.496+0000 7fbabfe00700 1 --2- 172.21.15.49:0/1740709453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00ab890 0x7fbac00abd20 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7fbac00bb8d0 tx=0x7fbaa80090f0).ready entity=mon.0 client_cookie=9c1b51fc9adc95ce server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.496+0000 7fbabf400700 1 -- 172.21.15.49:0/1740709453 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800b600 con 0x7fbac00ab890 2024-01-22T05:17:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.496+0000 7fbabf400700 1 -- 172.21.15.49:0/1740709453 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa800b760 con 0x7fbac00ab890 2024-01-22T05:17:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.496+0000 7fbabf400700 1 -- 172.21.15.49:0/1740709453 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800bae0 con 0x7fbac00ab890 2024-01-22T05:17:02.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.496+0000 7fbac7c00700 1 -- 172.21.15.49:0/1740709453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00ab890 msgr2=0x7fbac00abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:02.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.496+0000 7fbac7c00700 1 --2- 172.21.15.49:0/1740709453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00ab890 0x7fbac00abd20 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7fbac00bb8d0 tx=0x7fbaa80090f0).stop 2024-01-22T05:17:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.496+0000 7fbac7c00700 1 -- 172.21.15.49:0/1740709453 shutdown_connections 2024-01-22T05:17:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.496+0000 7fbac7c00700 1 --2- 172.21.15.49:0/1740709453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00ab890 0x7fbac00abd20 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.496+0000 7fbac7c00700 1 -- 172.21.15.49:0/1740709453 >> 172.21.15.49:0/1740709453 conn(0x7fbac00c6540 msgr2=0x7fbac00c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.496+0000 7fbac7c00700 1 -- 172.21.15.49:0/1740709453 shutdown_connections 2024-01-22T05:17:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.496+0000 7fbac7c00700 1 -- 172.21.15.49:0/1740709453 wait complete. 2024-01-22T05:17:02.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.500+0000 7fbac7c00700 1 Processor -- start 2024-01-22T05:17:02.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.500+0000 7fbac7c00700 1 -- start start 2024-01-22T05:17:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.500+0000 7fbac7c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbac0065550 0x7fbac0162490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.500+0000 7fbac7c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00ab890 0x7fbac01652a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.500+0000 7fbac7c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbac00bcfa0 0x7fbac0164090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.500+0000 7fbac7c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac0165790 con 0x7fbac00ab890 2024-01-22T05:17:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.500+0000 7fbac7c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac0165dd0 con 0x7fbac00bcfa0 2024-01-22T05:17:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.500+0000 7fbac7c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac01660b0 con 0x7fbac0065550 2024-01-22T05:17:02.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.500+0000 7fbabfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00ab890 0x7fbac01652a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:02.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.500+0000 7fbabfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00ab890 0x7fbac01652a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54850/0 (socket says 172.21.15.49:54850) 2024-01-22T05:17:02.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.500+0000 7fbabfe00700 1 -- 172.21.15.49:0/3325105960 learned_addr learned my addr 172.21.15.49:0/3325105960 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:02.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.500+0000 7fbac5c00700 1 --2- 172.21.15.49:0/3325105960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbac00bcfa0 0x7fbac0164090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:02.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.504+0000 7fbac5200700 1 --2- 172.21.15.49:0/3325105960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbac0065550 0x7fbac0162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:02.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.504+0000 7fbabfe00700 1 -- 172.21.15.49:0/3325105960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbac0065550 msgr2=0x7fbac0162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:02.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.504+0000 7fbabfe00700 1 --2- 172.21.15.49:0/3325105960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbac0065550 0x7fbac0162490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:02.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.504+0000 7fbabfe00700 1 -- 172.21.15.49:0/3325105960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbac00bcfa0 msgr2=0x7fbac0164090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:02.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.504+0000 7fbabfe00700 1 --2- 172.21.15.49:0/3325105960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbac00bcfa0 0x7fbac0164090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:02.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.504+0000 7fbabfe00700 1 -- 172.21.15.49:0/3325105960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa8009370 con 0x7fbac00ab890 2024-01-22T05:17:02.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.504+0000 7fbac5c00700 1 --2- 172.21.15.49:0/3325105960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbac00bcfa0 0x7fbac0164090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:02.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.504+0000 7fbabfe00700 1 --2- 172.21.15.49:0/3325105960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00ab890 0x7fbac01652a0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7fbaa8009130 tx=0x7fbaa8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:02.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.504+0000 7fbab7e00700 1 -- 172.21.15.49:0/3325105960 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800bae0 con 0x7fbac00ab890 2024-01-22T05:17:02.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.504+0000 7fbab7e00700 1 -- 172.21.15.49:0/3325105960 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa8000cb0 con 0x7fbac00ab890 2024-01-22T05:17:02.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.504+0000 7fbab7e00700 1 -- 172.21.15.49:0/3325105960 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa801a430 con 0x7fbac00ab890 2024-01-22T05:17:02.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.504+0000 7fbac7c00700 1 -- 172.21.15.49:0/3325105960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac0166390 con 0x7fbac00ab890 2024-01-22T05:17:02.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.504+0000 7fbac7c00700 1 -- 172.21.15.49:0/3325105960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac0166950 con 0x7fbac00ab890 2024-01-22T05:17:02.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.504+0000 7fbac7c00700 1 -- 172.21.15.49:0/3325105960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac0047060 con 0x7fbac00ab890 2024-01-22T05:17:02.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.508+0000 7fbab7e00700 1 -- 172.21.15.49:0/3325105960 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbaa8021020 con 0x7fbac00ab890 2024-01-22T05:17:02.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.508+0000 7fbab7e00700 1 --2- 172.21.15.49:0/3325105960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fba9805a510 0x7fba9805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:02.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.508+0000 7fbab7e00700 1 -- 172.21.15.49:0/3325105960 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fbaa80760f0 con 0x7fbac00ab890 2024-01-22T05:17:02.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.508+0000 7fbac5200700 1 --2- 172.21.15.49:0/3325105960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fba9805a510 0x7fba9805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:02.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.508+0000 7fbac5200700 1 --2- 172.21.15.49:0/3325105960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fba9805a510 0x7fba9805c9d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fbab00076b0 tx=0x7fbab0007bf0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:02.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.512+0000 7fbab7e00700 1 -- 172.21.15.49:0/3325105960 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbaa8049690 con 0x7fbac00ab890 2024-01-22T05:17:02.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.739+0000 7fbac7c00700 1 -- 172.21.15.49:0/3325105960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbac0046800 con 0x7fbac00ab890 2024-01-22T05:17:02.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.739+0000 7fbab7e00700 1 -- 172.21.15.49:0/3325105960 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1636 (secure 0 0 0) 0x7fbaa8029070 con 0x7fbac00ab890 2024-01-22T05:17:02.742 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:02.742 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":766,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075747366,"bytes_used":4676591616,"bytes_avail":768417521664,"bytes_total":773094113280,"write_bytes_sec":22069314,"read_op_per_sec":0,"write_op_per_sec":21},"fsmap":{"epoch":114,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8829}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":29,"modified":"2024-01-22T05:17:01.509409+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:17:02.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.743+0000 7fbac7c00700 1 -- 172.21.15.49:0/3325105960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fba9805a510 msgr2=0x7fba9805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:02.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.743+0000 7fbac7c00700 1 --2- 172.21.15.49:0/3325105960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fba9805a510 0x7fba9805c9d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fbab00076b0 tx=0x7fbab0007bf0).stop 2024-01-22T05:17:02.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.743+0000 7fbac7c00700 1 -- 172.21.15.49:0/3325105960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00ab890 msgr2=0x7fbac01652a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:02.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.743+0000 7fbac7c00700 1 --2- 172.21.15.49:0/3325105960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00ab890 0x7fbac01652a0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7fbaa8009130 tx=0x7fbaa8017000).stop 2024-01-22T05:17:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.743+0000 7fbac7c00700 1 -- 172.21.15.49:0/3325105960 shutdown_connections 2024-01-22T05:17:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.743+0000 7fbac7c00700 1 --2- 172.21.15.49:0/3325105960 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fba9805a510 0x7fba9805c9d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.743+0000 7fbac7c00700 1 --2- 172.21.15.49:0/3325105960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbac00bcfa0 0x7fbac0164090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.743+0000 7fbac7c00700 1 --2- 172.21.15.49:0/3325105960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00ab890 0x7fbac01652a0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.743+0000 7fbac7c00700 1 --2- 172.21.15.49:0/3325105960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbac0065550 0x7fbac0162490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.743+0000 7fbac7c00700 1 -- 172.21.15.49:0/3325105960 >> 172.21.15.49:0/3325105960 conn(0x7fbac00c6540 msgr2=0x7fbac00a7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.743+0000 7fbac7c00700 1 -- 172.21.15.49:0/3325105960 shutdown_connections 2024-01-22T05:17:02.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:02.743+0000 7fbac7c00700 1 -- 172.21.15.49:0/3325105960 wait complete. 2024-01-22T05:17:02.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/scrub_control_test_path]'} 2024-01-22T05:17:02.768 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:17:02.769 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:17:02.794 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:17:02.794 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'b', 'd', 'c'} 2024-01-22T05:17:02.795 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-01-22T05:17:03.010 INFO:teuthology.orchestra.run.smithi049.stdout:{"mds_beacon_grace":"15.000000"} 2024-01-22T05:17:03.011 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-01-22T05:17:03.011 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:17:03.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.171+0000 7f4af7000700 1 Processor -- start 2024-01-22T05:17:03.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.171+0000 7f4af7000700 1 -- start start 2024-01-22T05:17:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4af7000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4af00c3690 0x7f4af00c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4af7000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4af0155550 0x7f4af01559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4af7000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4af0067a90 0x7f4af0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:03.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4af7000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af00c3f60 con 0x7f4af0155550 2024-01-22T05:17:03.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4af7000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af00bdc10 con 0x7f4af00c3690 2024-01-22T05:17:03.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4af7000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0155ea0 con 0x7f4af0067a90 2024-01-22T05:17:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4aef400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4af0155550 0x7f4af01559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4aefe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4af00c3690 0x7f4af00c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4aefe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4af00c3690 0x7f4af00c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:45562/0 (socket says 172.21.15.49:45562) 2024-01-22T05:17:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4af5000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4af0067a90 0x7f4af0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4aefe00700 1 -- 172.21.15.49:0/1094982140 learned_addr learned my addr 172.21.15.49:0/1094982140 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4aef400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4af0155550 0x7f4af01559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54858/0 (socket says 172.21.15.49:54858) 2024-01-22T05:17:03.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4aef400700 1 -- 172.21.15.49:0/1094982140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4af0067a90 msgr2=0x7f4af0067f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:03.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4aef400700 1 --2- 172.21.15.49:0/1094982140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4af0067a90 0x7f4af0067f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:03.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4aef400700 1 -- 172.21.15.49:0/1094982140 >> v2:172.21.15.110:3300/0 conn(0x7f4af00c3690 msgr2=0x7f4af00c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:03.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4aef400700 1 --2- 172.21.15.49:0/1094982140 >> v2:172.21.15.110:3300/0 conn(0x7f4af00c3690 0x7f4af00c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:03.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4aef400700 1 -- 172.21.15.49:0/1094982140 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af0068e10 con 0x7f4af0155550 2024-01-22T05:17:03.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.175+0000 7f4aef400700 1 --2- 172.21.15.49:0/1094982140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0155550 0x7f4af01559b0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f4af00c5e00 tx=0x7f4ad8009060).ready entity=mon.0 client_cookie=94d070832dd634b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:03.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.179+0000 7f4aeea00700 1 -- 172.21.15.49:0/1094982140 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800d4a0 con 0x7f4af0155550 2024-01-22T05:17:03.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.179+0000 7f4aeea00700 1 -- 172.21.15.49:0/1094982140 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad800d600 con 0x7f4af0155550 2024-01-22T05:17:03.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.179+0000 7f4aeea00700 1 -- 172.21.15.49:0/1094982140 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800d980 con 0x7f4af0155550 2024-01-22T05:17:03.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.179+0000 7f4af7000700 1 -- 172.21.15.49:0/1094982140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0155550 msgr2=0x7f4af01559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:03.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.179+0000 7f4af7000700 1 --2- 172.21.15.49:0/1094982140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0155550 0x7f4af01559b0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f4af00c5e00 tx=0x7f4ad8009060).stop 2024-01-22T05:17:03.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.179+0000 7f4af7000700 1 -- 172.21.15.49:0/1094982140 shutdown_connections 2024-01-22T05:17:03.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.179+0000 7f4af7000700 1 --2- 172.21.15.49:0/1094982140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4af0067a90 0x7f4af0067f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:03.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.179+0000 7f4af7000700 1 --2- 172.21.15.49:0/1094982140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0155550 0x7f4af01559b0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:03.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.179+0000 7f4af7000700 1 --2- 172.21.15.49:0/1094982140 >> v2:172.21.15.110:3300/0 conn(0x7f4af00c3690 0x7f4af00c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:03.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.179+0000 7f4af7000700 1 -- 172.21.15.49:0/1094982140 >> 172.21.15.49:0/1094982140 conn(0x7f4af00c51c0 msgr2=0x7f4af00c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:03.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.179+0000 7f4af7000700 1 -- 172.21.15.49:0/1094982140 shutdown_connections 2024-01-22T05:17:03.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.179+0000 7f4af7000700 1 -- 172.21.15.49:0/1094982140 wait complete. 2024-01-22T05:17:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.183+0000 7f4af7000700 1 Processor -- start 2024-01-22T05:17:03.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.183+0000 7f4af7000700 1 -- start start 2024-01-22T05:17:03.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.183+0000 7f4af7000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0067a90 0x7f4af0158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:03.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.183+0000 7f4af7000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af00c3690 0x7f4af0151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:03.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.183+0000 7f4af7000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4af0155550 0x7f4af0146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:03.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.183+0000 7f4af7000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0153070 con 0x7f4af0067a90 2024-01-22T05:17:03.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.183+0000 7f4af7000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af01521d0 con 0x7f4af00c3690 2024-01-22T05:17:03.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.183+0000 7f4af7000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0152460 con 0x7f4af0155550 2024-01-22T05:17:03.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.183+0000 7f4aefe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0067a90 0x7f4af0158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:03.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4aefe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0067a90 0x7f4af0158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54864/0 (socket says 172.21.15.49:54864) 2024-01-22T05:17:03.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4aefe00700 1 -- 172.21.15.49:0/866015151 learned_addr learned my addr 172.21.15.49:0/866015151 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:03.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4af5000700 1 --2- 172.21.15.49:0/866015151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4af0155550 0x7f4af0146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:03.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4aef400700 1 --2- 172.21.15.49:0/866015151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af00c3690 0x7f4af0151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:03.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4aefe00700 1 -- 172.21.15.49:0/866015151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4af0155550 msgr2=0x7f4af0146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:03.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4aefe00700 1 --2- 172.21.15.49:0/866015151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4af0155550 0x7f4af0146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:03.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4aefe00700 1 -- 172.21.15.49:0/866015151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af00c3690 msgr2=0x7f4af0151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:03.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4aefe00700 1 --2- 172.21.15.49:0/866015151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af00c3690 0x7f4af0151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:03.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4aefe00700 1 -- 172.21.15.49:0/866015151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad80092a0 con 0x7f4af0067a90 2024-01-22T05:17:03.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4aefe00700 1 --2- 172.21.15.49:0/866015151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0067a90 0x7f4af0158360 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f4ae000e900 tx=0x7f4ae00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:03.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4ae7400700 1 -- 172.21.15.49:0/866015151 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0012600 con 0x7f4af0067a90 2024-01-22T05:17:03.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4ae7400700 1 -- 172.21.15.49:0/866015151 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae0012760 con 0x7f4af0067a90 2024-01-22T05:17:03.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4af7000700 1 -- 172.21.15.49:0/866015151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af0152740 con 0x7f4af0067a90 2024-01-22T05:17:03.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4ae7400700 1 -- 172.21.15.49:0/866015151 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0012ae0 con 0x7f4af0067a90 2024-01-22T05:17:03.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4af7000700 1 -- 172.21.15.49:0/866015151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af0152d00 con 0x7f4af0067a90 2024-01-22T05:17:03.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.187+0000 7f4af7000700 1 -- 172.21.15.49:0/866015151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af0047060 con 0x7f4af0067a90 2024-01-22T05:17:03.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.191+0000 7f4ae7400700 1 -- 172.21.15.49:0/866015151 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4ae001b400 con 0x7f4af0067a90 2024-01-22T05:17:03.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.191+0000 7f4ae7400700 1 --2- 172.21.15.49:0/866015151 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4ac805a510 0x7f4ac805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:03.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.191+0000 7f4ae7400700 1 -- 172.21.15.49:0/866015151 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f4ae0074dc0 con 0x7f4af0067a90 2024-01-22T05:17:03.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.191+0000 7f4aef400700 1 --2- 172.21.15.49:0/866015151 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4ac805a510 0x7f4ac805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:03.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.195+0000 7f4aef400700 1 --2- 172.21.15.49:0/866015151 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4ac805a510 0x7f4ac805c9d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f4af00c86c0 tx=0x7f4ad8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:03.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.199+0000 7f4ae7400700 1 -- 172.21.15.49:0/866015151 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4ae0048300 con 0x7f4af0067a90 2024-01-22T05:17:03.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.399+0000 7f4af7000700 1 -- 172.21.15.49:0/866015151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4af00690f0 con 0x7f4af0067a90 2024-01-22T05:17:03.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.399+0000 7f4ae7400700 1 -- 172.21.15.49:0/866015151 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4500 (secure 0 0 0) 0x7f4ae004b920 con 0x7f4af0067a90 2024-01-22T05:17:03.403 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:03.403 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":114,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":8826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:16:17.362338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/4015076184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":4015076184},{"type":"v1","addr":"172.21.15.49:6837","nonce":4015076184}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:17:03.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.407+0000 7f4af7000700 1 -- 172.21.15.49:0/866015151 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4ac805a510 msgr2=0x7f4ac805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:03.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.407+0000 7f4af7000700 1 --2- 172.21.15.49:0/866015151 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4ac805a510 0x7f4ac805c9d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f4af00c86c0 tx=0x7f4ad8016000).stop 2024-01-22T05:17:03.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.407+0000 7f4af7000700 1 -- 172.21.15.49:0/866015151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0067a90 msgr2=0x7f4af0158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:03.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.407+0000 7f4af7000700 1 --2- 172.21.15.49:0/866015151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0067a90 0x7f4af0158360 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f4ae000e900 tx=0x7f4ae00090f0).stop 2024-01-22T05:17:03.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.407+0000 7f4af7000700 1 -- 172.21.15.49:0/866015151 shutdown_connections 2024-01-22T05:17:03.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.407+0000 7f4af7000700 1 --2- 172.21.15.49:0/866015151 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4ac805a510 0x7f4ac805c9d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:03.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.407+0000 7f4af7000700 1 --2- 172.21.15.49:0/866015151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4af0155550 0x7f4af0146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:03.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.407+0000 7f4af7000700 1 --2- 172.21.15.49:0/866015151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af00c3690 0x7f4af0151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:03.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.407+0000 7f4af7000700 1 --2- 172.21.15.49:0/866015151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4af0067a90 0x7f4af0158360 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:03.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.407+0000 7f4af7000700 1 -- 172.21.15.49:0/866015151 >> 172.21.15.49:0/866015151 conn(0x7f4af00c51c0 msgr2=0x7f4af014c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:03.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.407+0000 7f4af7000700 1 -- 172.21.15.49:0/866015151 shutdown_connections 2024-01-22T05:17:03.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:03.407+0000 7f4af7000700 1 -- 172.21.15.49:0/866015151 wait complete. 2024-01-22T05:17:03.411 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 114 2024-01-22T05:17:03.429 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-01-22T05:17:08.431 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:17:08.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.599+0000 7f5f8f600700 1 Processor -- start 2024-01-22T05:17:08.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.599+0000 7f5f8f600700 1 -- start start 2024-01-22T05:17:08.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.603+0000 7f5f8f600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f880a8740 0x7f5f880a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:08.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.603+0000 7f5f8f600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5f880c1ed0 0x7f5f880c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:08.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.603+0000 7f5f8f600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f880c1a40 con 0x7f5f88155d20 2024-01-22T05:17:08.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.603+0000 7f5f8f600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f880a90b0 con 0x7f5f880c1ed0 2024-01-22T05:17:08.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.603+0000 7f5f8f600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f88159310 con 0x7f5f880a8740 2024-01-22T05:17:08.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.603+0000 7f5f8d600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5f880c1ed0 0x7f5f880c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:08.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.603+0000 7f5f8d600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5f880c1ed0 0x7f5f880c2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43056/0 (socket says 172.21.15.49:43056) 2024-01-22T05:17:08.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.603+0000 7f5f8d600700 1 -- 172.21.15.49:0/3760052520 learned_addr learned my addr 172.21.15.49:0/3760052520 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:08.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.603+0000 7f5f87e00700 1 --2- 172.21.15.49:0/3760052520 >> v2:172.21.15.110:3300/0 conn(0x7f5f880a8740 0x7f5f880a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.603+0000 7f5f8d600700 1 -- 172.21.15.49:0/3760052520 >> v2:172.21.15.110:3300/0 conn(0x7f5f880a8740 msgr2=0x7f5f880a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.603+0000 7f5f8d600700 1 --2- 172.21.15.49:0/3760052520 >> v2:172.21.15.110:3300/0 conn(0x7f5f880a8740 0x7f5f880a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.603+0000 7f5f8d600700 1 -- 172.21.15.49:0/3760052520 >> v1:172.21.15.110:6789/0 conn(0x7f5f88155d20 legacy=0x7f5f88065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.603+0000 7f5f8d600700 1 -- 172.21.15.49:0/3760052520 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f880c13f0 con 0x7f5f880c1ed0 2024-01-22T05:17:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.607+0000 7f5f8d600700 1 --2- 172.21.15.49:0/3760052520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f880c1ed0 0x7f5f880c2360 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f5f880c0ad0 tx=0x7f5f80009840).ready entity=mon.0 client_cookie=8be4e5ea11d38eae server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.607+0000 7f5f87400700 1 -- 172.21.15.49:0/3760052520 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8000e070 con 0x7f5f880c1ed0 2024-01-22T05:17:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.607+0000 7f5f87400700 1 -- 172.21.15.49:0/3760052520 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8000ba20 con 0x7f5f880c1ed0 2024-01-22T05:17:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.607+0000 7f5f87400700 1 -- 172.21.15.49:0/3760052520 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8000bda0 con 0x7f5f880c1ed0 2024-01-22T05:17:08.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.607+0000 7f5f8f600700 1 -- 172.21.15.49:0/3760052520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f880c1ed0 msgr2=0x7f5f880c2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:08.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.607+0000 7f5f8f600700 1 --2- 172.21.15.49:0/3760052520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f880c1ed0 0x7f5f880c2360 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f5f880c0ad0 tx=0x7f5f80009840).stop 2024-01-22T05:17:08.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.607+0000 7f5f8f600700 1 -- 172.21.15.49:0/3760052520 shutdown_connections 2024-01-22T05:17:08.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.607+0000 7f5f8f600700 1 --2- 172.21.15.49:0/3760052520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f880c1ed0 0x7f5f880c2360 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:08.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.607+0000 7f5f8f600700 1 --2- 172.21.15.49:0/3760052520 >> v2:172.21.15.110:3300/0 conn(0x7f5f880a8740 0x7f5f880a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:08.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.607+0000 7f5f8f600700 1 -- 172.21.15.49:0/3760052520 >> 172.21.15.49:0/3760052520 conn(0x7f5f880c6540 msgr2=0x7f5f880c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:08.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.607+0000 7f5f8f600700 1 -- 172.21.15.49:0/3760052520 shutdown_connections 2024-01-22T05:17:08.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.607+0000 7f5f8f600700 1 -- 172.21.15.49:0/3760052520 wait complete. 2024-01-22T05:17:08.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.611+0000 7f5f8f600700 1 Processor -- start 2024-01-22T05:17:08.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.611+0000 7f5f8f600700 1 -- start start 2024-01-22T05:17:08.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.611+0000 7f5f8f600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f880a8740 0x7f5f880aa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:08.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.611+0000 7f5f8f600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f880c1ed0 0x7f5f88149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:08.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.611+0000 7f5f8f600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88155d20 0x7f5f8815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:08.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.611+0000 7f5f8f600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880abe30 con 0x7f5f88155d20 2024-01-22T05:17:08.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.611+0000 7f5f8f600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880ab220 con 0x7f5f880c1ed0 2024-01-22T05:17:08.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.611+0000 7f5f8f600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880ab500 con 0x7f5f880a8740 2024-01-22T05:17:08.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.611+0000 7f5f8d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88155d20 0x7f5f8815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:08.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f87e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f880c1ed0 0x7f5f88149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:08.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f8cc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f880a8740 0x7f5f880aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:08.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f87e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f880c1ed0 0x7f5f88149610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:50486/0 (socket says 172.21.15.49:50486) 2024-01-22T05:17:08.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f87e00700 1 -- 172.21.15.49:0/1717995604 learned_addr learned my addr 172.21.15.49:0/1717995604 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:08.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f8d600700 1 -- 172.21.15.49:0/1717995604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f880a8740 msgr2=0x7f5f880aa840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:08.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f8d600700 1 --2- 172.21.15.49:0/1717995604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f880a8740 0x7f5f880aa840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:08.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f8d600700 1 -- 172.21.15.49:0/1717995604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f880c1ed0 msgr2=0x7f5f88149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f8d600700 1 --2- 172.21.15.49:0/1717995604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f880c1ed0 0x7f5f88149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f8d600700 1 -- 172.21.15.49:0/1717995604 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f80009ae0 con 0x7f5f88155d20 2024-01-22T05:17:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f87e00700 1 --2- 172.21.15.49:0/1717995604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f880c1ed0 0x7f5f88149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f8d600700 1 --2- 172.21.15.49:0/1717995604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88155d20 0x7f5f8815a4e0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f5f80013000 tx=0x7f5f80009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f7fe00700 1 -- 172.21.15.49:0/1717995604 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f800092e0 con 0x7f5f88155d20 2024-01-22T05:17:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f7fe00700 1 -- 172.21.15.49:0/1717995604 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8001d410 con 0x7f5f88155d20 2024-01-22T05:17:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f7fe00700 1 -- 172.21.15.49:0/1717995604 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8001d7d0 con 0x7f5f88155d20 2024-01-22T05:17:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f8f600700 1 -- 172.21.15.49:0/1717995604 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f880ab7e0 con 0x7f5f88155d20 2024-01-22T05:17:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.615+0000 7f5f8f600700 1 -- 172.21.15.49:0/1717995604 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f880c02e0 con 0x7f5f88155d20 2024-01-22T05:17:08.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.619+0000 7f5f8f600700 1 -- 172.21.15.49:0/1717995604 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f880c04d0 con 0x7f5f88155d20 2024-01-22T05:17:08.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.619+0000 7f5f7fe00700 1 -- 172.21.15.49:0/1717995604 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5f8001dbc0 con 0x7f5f88155d20 2024-01-22T05:17:08.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.619+0000 7f5f7fe00700 1 --2- 172.21.15.49:0/1717995604 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f6005a510 0x7f5f6005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:08.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.619+0000 7f5f7fe00700 1 -- 172.21.15.49:0/1717995604 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f5f800765a0 con 0x7f5f88155d20 2024-01-22T05:17:08.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.619+0000 7f5f8cc00700 1 --2- 172.21.15.49:0/1717995604 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f6005a510 0x7f5f6005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:08.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.619+0000 7f5f8cc00700 1 --2- 172.21.15.49:0/1717995604 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f6005a510 0x7f5f6005c9d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f5f78003860 tx=0x7f5f78007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:08.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.627+0000 7f5f7fe00700 1 -- 172.21.15.49:0/1717995604 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5f880c04d0 con 0x7f5f88155d20 2024-01-22T05:17:08.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.823+0000 7f5f8f600700 1 -- 172.21.15.49:0/1717995604 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f88063fe0 con 0x7f5f88155d20 2024-01-22T05:17:08.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.823+0000 7f5f7fe00700 1 -- 172.21.15.49:0/1717995604 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4500 (secure 0 0 0) 0x7f5f88063fe0 con 0x7f5f88155d20 2024-01-22T05:17:08.825 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:08.826 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":114,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":8826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:16:17.362338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/4015076184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":4015076184},{"type":"v1","addr":"172.21.15.49:6837","nonce":4015076184}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:17:08.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.827+0000 7f5f8f600700 1 -- 172.21.15.49:0/1717995604 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f6005a510 msgr2=0x7f5f6005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:08.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.827+0000 7f5f8f600700 1 --2- 172.21.15.49:0/1717995604 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f6005a510 0x7f5f6005c9d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f5f78003860 tx=0x7f5f78007d40).stop 2024-01-22T05:17:08.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.827+0000 7f5f8f600700 1 -- 172.21.15.49:0/1717995604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88155d20 msgr2=0x7f5f8815a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:08.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.827+0000 7f5f8f600700 1 --2- 172.21.15.49:0/1717995604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88155d20 0x7f5f8815a4e0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f5f80013000 tx=0x7f5f80009840).stop 2024-01-22T05:17:08.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.827+0000 7f5f8f600700 1 -- 172.21.15.49:0/1717995604 shutdown_connections 2024-01-22T05:17:08.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.827+0000 7f5f8f600700 1 --2- 172.21.15.49:0/1717995604 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f6005a510 0x7f5f6005c9d0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:08.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.827+0000 7f5f8f600700 1 --2- 172.21.15.49:0/1717995604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88155d20 0x7f5f8815a4e0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:08.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.827+0000 7f5f8f600700 1 --2- 172.21.15.49:0/1717995604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f880c1ed0 0x7f5f88149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:08.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.827+0000 7f5f8f600700 1 --2- 172.21.15.49:0/1717995604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f880a8740 0x7f5f880aa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:08.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.827+0000 7f5f8f600700 1 -- 172.21.15.49:0/1717995604 >> 172.21.15.49:0/1717995604 conn(0x7f5f880c6540 msgr2=0x7f5f881583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:08.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.831+0000 7f5f8f600700 1 -- 172.21.15.49:0/1717995604 shutdown_connections 2024-01-22T05:17:08.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:08.831+0000 7f5f8f600700 1 -- 172.21.15.49:0/1717995604 wait complete. 2024-01-22T05:17:08.835 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 114 2024-01-22T05:17:08.855 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-01-22T05:17:09.660 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:17:09.665 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:17:13.856 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:17:14.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.027+0000 7feb2da00700 1 Processor -- start 2024-01-22T05:17:14.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.027+0000 7feb2da00700 1 -- start start 2024-01-22T05:17:14.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb2da00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb280bdf60 0x7feb28150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:14.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb2da00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb281550e0 0x7feb28069020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:14.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb2da00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb28151db0 con 0x7feb28068ba0 2024-01-22T05:17:14.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb2da00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb280a9f10 con 0x7feb280bdf60 2024-01-22T05:17:14.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb2da00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb28154580 con 0x7feb281550e0 2024-01-22T05:17:14.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb26a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb280bdf60 0x7feb28150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:14.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb26a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb280bdf60 0x7feb28150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40166/0 (socket says 172.21.15.49:40166) 2024-01-22T05:17:14.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb26a00700 1 -- 172.21.15.49:0/1794428070 learned_addr learned my addr 172.21.15.49:0/1794428070 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:14.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb27400700 1 --2- 172.21.15.49:0/1794428070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb281550e0 0x7feb28069020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:14.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb26a00700 1 -- 172.21.15.49:0/1794428070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb281550e0 msgr2=0x7feb28069020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:14.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb26a00700 1 --2- 172.21.15.49:0/1794428070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb281550e0 0x7feb28069020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:14.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb26a00700 1 -- 172.21.15.49:0/1794428070 >> v1:172.21.15.110:6789/0 conn(0x7feb28068ba0 legacy=0x7feb281549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:14.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb26a00700 1 -- 172.21.15.49:0/1794428070 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb28151510 con 0x7feb280bdf60 2024-01-22T05:17:14.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb27400700 1 --2- 172.21.15.49:0/1794428070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb281550e0 0x7feb28069020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:17:14.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb26a00700 1 --2- 172.21.15.49:0/1794428070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280bdf60 0x7feb28150cd0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7feb18006fd0 tx=0x7feb1800b3b0).ready entity=mon.0 client_cookie=b780fa7b8b78639e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:14.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb25600700 1 -- 172.21.15.49:0/1794428070 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1800db00 con 0x7feb280bdf60 2024-01-22T05:17:14.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb25600700 1 -- 172.21.15.49:0/1794428070 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1800dc60 con 0x7feb280bdf60 2024-01-22T05:17:14.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb25600700 1 -- 172.21.15.49:0/1794428070 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18010470 con 0x7feb280bdf60 2024-01-22T05:17:14.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb2da00700 1 -- 172.21.15.49:0/1794428070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280bdf60 msgr2=0x7feb28150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:14.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.031+0000 7feb2da00700 1 --2- 172.21.15.49:0/1794428070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280bdf60 0x7feb28150cd0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7feb18006fd0 tx=0x7feb1800b3b0).stop 2024-01-22T05:17:14.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.035+0000 7feb2da00700 1 -- 172.21.15.49:0/1794428070 shutdown_connections 2024-01-22T05:17:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.035+0000 7feb2da00700 1 --2- 172.21.15.49:0/1794428070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb281550e0 0x7feb28069020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.035+0000 7feb2da00700 1 --2- 172.21.15.49:0/1794428070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280bdf60 0x7feb28150cd0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.035+0000 7feb2da00700 1 -- 172.21.15.49:0/1794428070 >> 172.21.15.49:0/1794428070 conn(0x7feb280c40c0 msgr2=0x7feb280c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.035+0000 7feb2da00700 1 -- 172.21.15.49:0/1794428070 shutdown_connections 2024-01-22T05:17:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.035+0000 7feb2da00700 1 -- 172.21.15.49:0/1794428070 wait complete. 2024-01-22T05:17:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.035+0000 7feb2da00700 1 Processor -- start 2024-01-22T05:17:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.035+0000 7feb2da00700 1 -- start start 2024-01-22T05:17:14.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb2da00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb28068ba0 0x7feb281487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:14.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb2da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280bdf60 0x7feb280a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:14.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb2da00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb281550e0 0x7feb280a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:14.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb2da00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb280ac2e0 con 0x7feb280bdf60 2024-01-22T05:17:14.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb2da00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb280ab6d0 con 0x7feb281550e0 2024-01-22T05:17:14.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb2da00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb280ab9b0 con 0x7feb28068ba0 2024-01-22T05:17:14.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb26000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280bdf60 0x7feb280a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:14.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb26000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280bdf60 0x7feb280a4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40174/0 (socket says 172.21.15.49:40174) 2024-01-22T05:17:14.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb26000700 1 -- 172.21.15.49:0/560661245 learned_addr learned my addr 172.21.15.49:0/560661245 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:14.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb27400700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb281550e0 0x7feb280a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:14.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb26a00700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb28068ba0 0x7feb281487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:14.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb26000700 1 -- 172.21.15.49:0/560661245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb28068ba0 msgr2=0x7feb281487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:14.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb26000700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb28068ba0 0x7feb281487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:14.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb26000700 1 -- 172.21.15.49:0/560661245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb281550e0 msgr2=0x7feb280a5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb26000700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb281550e0 0x7feb280a5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb26000700 1 -- 172.21.15.49:0/560661245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1800b610 con 0x7feb280bdf60 2024-01-22T05:17:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb27400700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb281550e0 0x7feb280a5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb26a00700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb28068ba0 0x7feb281487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb26000700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280bdf60 0x7feb280a4790 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7feb1000c440 tx=0x7feb10007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb1e000700 1 -- 172.21.15.49:0/560661245 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1000f470 con 0x7feb280bdf60 2024-01-22T05:17:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb1e000700 1 -- 172.21.15.49:0/560661245 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1000f610 con 0x7feb280bdf60 2024-01-22T05:17:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb2da00700 1 -- 172.21.15.49:0/560661245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb280abc90 con 0x7feb280bdf60 2024-01-22T05:17:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb1e000700 1 -- 172.21.15.49:0/560661245 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1000f9d0 con 0x7feb280bdf60 2024-01-22T05:17:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.039+0000 7feb2da00700 1 -- 172.21.15.49:0/560661245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb280a3ae0 con 0x7feb280bdf60 2024-01-22T05:17:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.043+0000 7feb2da00700 1 -- 172.21.15.49:0/560661245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb28065660 con 0x7feb280bdf60 2024-01-22T05:17:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.043+0000 7feb1e000700 1 -- 172.21.15.49:0/560661245 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7feb10012400 con 0x7feb280bdf60 2024-01-22T05:17:14.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.043+0000 7feb1e000700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feb0005a510 0x7feb0005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:14.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.043+0000 7feb1e000700 1 -- 172.21.15.49:0/560661245 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7feb10073d70 con 0x7feb280bdf60 2024-01-22T05:17:14.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.043+0000 7feb26a00700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feb0005a510 0x7feb0005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:14.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.047+0000 7feb26a00700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feb0005a510 0x7feb0005c9d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7feb1800bfd0 tx=0x7feb281544f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:14.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.051+0000 7feb1e000700 1 -- 172.21.15.49:0/560661245 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feb10047420 con 0x7feb280bdf60 2024-01-22T05:17:14.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.255+0000 7feb2da00700 1 -- 172.21.15.49:0/560661245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb281517f0 con 0x7feb280bdf60 2024-01-22T05:17:14.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.259+0000 7feb1e000700 1 -- 172.21.15.49:0/560661245 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4500 (secure 0 0 0) 0x7feb1004aa40 con 0x7feb280bdf60 2024-01-22T05:17:14.260 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:14.260 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":114,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":8826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:16:17.362338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/4015076184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":4015076184},{"type":"v1","addr":"172.21.15.49:6837","nonce":4015076184}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:17:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.259+0000 7feb2da00700 1 -- 172.21.15.49:0/560661245 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feb0005a510 msgr2=0x7feb0005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.259+0000 7feb2da00700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feb0005a510 0x7feb0005c9d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7feb1800bfd0 tx=0x7feb281544f0).stop 2024-01-22T05:17:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.259+0000 7feb2da00700 1 -- 172.21.15.49:0/560661245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280bdf60 msgr2=0x7feb280a4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.259+0000 7feb2da00700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280bdf60 0x7feb280a4790 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7feb1000c440 tx=0x7feb10007de0).stop 2024-01-22T05:17:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.263+0000 7feb2da00700 1 -- 172.21.15.49:0/560661245 shutdown_connections 2024-01-22T05:17:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.263+0000 7feb2da00700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feb0005a510 0x7feb0005c9d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.263+0000 7feb2da00700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb281550e0 0x7feb280a5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.263+0000 7feb2da00700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280bdf60 0x7feb280a4790 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.263+0000 7feb2da00700 1 --2- 172.21.15.49:0/560661245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb28068ba0 0x7feb281487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.263+0000 7feb2da00700 1 -- 172.21.15.49:0/560661245 >> 172.21.15.49:0/560661245 conn(0x7feb280c40c0 msgr2=0x7feb280c3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.263+0000 7feb2da00700 1 -- 172.21.15.49:0/560661245 shutdown_connections 2024-01-22T05:17:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:14.263+0000 7feb2da00700 1 -- 172.21.15.49:0/560661245 wait complete. 2024-01-22T05:17:14.267 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 114 2024-01-22T05:17:14.285 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-01-22T05:17:19.286 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:17:19.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.447+0000 7fc640000700 1 Processor -- start 2024-01-22T05:17:19.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.447+0000 7fc640000700 1 -- start start 2024-01-22T05:17:19.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc640000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc6380a8740 0x7fc6380a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:19.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc640000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc6380c1ed0 0x7fc6380c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:19.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc640000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6380c1a40 con 0x7fc638155d20 2024-01-22T05:17:19.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc640000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6380a90b0 con 0x7fc6380a8740 2024-01-22T05:17:19.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc640000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc638159310 con 0x7fc6380c1ed0 2024-01-22T05:17:19.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc63cc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc6380a8740 0x7fc6380a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:19.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc63d600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc638155d20 0x7fc638065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53456/0 (socket says 172.21.15.49:53456) 2024-01-22T05:17:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc63d600700 1 -- 172.21.15.49:0/1579326006 learned_addr learned my addr 172.21.15.49:0/1579326006 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc63e000700 1 --2- 172.21.15.49:0/1579326006 >> v2:172.21.15.110:3300/0 conn(0x7fc6380c1ed0 0x7fc6380c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc63cc00700 1 -- 172.21.15.49:0/1579326006 >> v2:172.21.15.110:3300/0 conn(0x7fc6380c1ed0 msgr2=0x7fc6380c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc63cc00700 1 --2- 172.21.15.49:0/1579326006 >> v2:172.21.15.110:3300/0 conn(0x7fc6380c1ed0 0x7fc6380c2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc63cc00700 1 -- 172.21.15.49:0/1579326006 >> v1:172.21.15.49:6789/0 conn(0x7fc638155d20 legacy=0x7fc638065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc63cc00700 1 -- 172.21.15.49:0/1579326006 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380c13f0 con 0x7fc6380a8740 2024-01-22T05:17:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc63cc00700 1 --2- 172.21.15.49:0/1579326006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6380a8740 0x7fc6380a8bc0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fc6380c19b0 tx=0x7fc620009060).ready entity=mon.0 client_cookie=7a4ec900aba362fe server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:19.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc637e00700 1 -- 172.21.15.49:0/1579326006 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62000b580 con 0x7fc6380a8740 2024-01-22T05:17:19.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc637e00700 1 -- 172.21.15.49:0/1579326006 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62000b6e0 con 0x7fc6380a8740 2024-01-22T05:17:19.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc637e00700 1 -- 172.21.15.49:0/1579326006 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62000ba60 con 0x7fc6380a8740 2024-01-22T05:17:19.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc640000700 1 -- 172.21.15.49:0/1579326006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6380a8740 msgr2=0x7fc6380a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:19.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.451+0000 7fc640000700 1 --2- 172.21.15.49:0/1579326006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6380a8740 0x7fc6380a8bc0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fc6380c19b0 tx=0x7fc620009060).stop 2024-01-22T05:17:19.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.455+0000 7fc640000700 1 -- 172.21.15.49:0/1579326006 shutdown_connections 2024-01-22T05:17:19.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.455+0000 7fc640000700 1 --2- 172.21.15.49:0/1579326006 >> v2:172.21.15.110:3300/0 conn(0x7fc6380c1ed0 0x7fc6380c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:19.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.455+0000 7fc640000700 1 --2- 172.21.15.49:0/1579326006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6380a8740 0x7fc6380a8bc0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:19.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.455+0000 7fc640000700 1 -- 172.21.15.49:0/1579326006 >> 172.21.15.49:0/1579326006 conn(0x7fc6380c6540 msgr2=0x7fc6380c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:19.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.455+0000 7fc640000700 1 -- 172.21.15.49:0/1579326006 shutdown_connections 2024-01-22T05:17:19.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.455+0000 7fc640000700 1 -- 172.21.15.49:0/1579326006 wait complete. 2024-01-22T05:17:19.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.459+0000 7fc640000700 1 Processor -- start 2024-01-22T05:17:19.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.459+0000 7fc640000700 1 -- start start 2024-01-22T05:17:19.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.459+0000 7fc640000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6380a8740 0x7fc6380a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:19.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.459+0000 7fc640000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6380c1ed0 0x7fc63816cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:19.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.459+0000 7fc640000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc638155d20 0x7fc6380ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:19.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.459+0000 7fc640000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380bf440 con 0x7fc638155d20 2024-01-22T05:17:19.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.459+0000 7fc640000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63816d490 con 0x7fc6380a8740 2024-01-22T05:17:19.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.459+0000 7fc640000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380ac050 con 0x7fc6380c1ed0 2024-01-22T05:17:19.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.459+0000 7fc63e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc638155d20 0x7fc6380ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:19.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.459+0000 7fc63e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc638155d20 0x7fc6380ab820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40194/0 (socket says 172.21.15.49:40194) 2024-01-22T05:17:19.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.459+0000 7fc63e000700 1 -- 172.21.15.49:0/2369564247 learned_addr learned my addr 172.21.15.49:0/2369564247 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:19.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.459+0000 7fc63cc00700 1 --2- 172.21.15.49:0/2369564247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6380c1ed0 0x7fc63816cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:19.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.459+0000 7fc63d600700 1 --2- 172.21.15.49:0/2369564247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6380a8740 0x7fc6380a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:19.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.463+0000 7fc63e000700 1 -- 172.21.15.49:0/2369564247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6380c1ed0 msgr2=0x7fc63816cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:19.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.463+0000 7fc63e000700 1 --2- 172.21.15.49:0/2369564247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6380c1ed0 0x7fc63816cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:19.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.463+0000 7fc63e000700 1 -- 172.21.15.49:0/2369564247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6380a8740 msgr2=0x7fc6380a9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:19.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.463+0000 7fc63e000700 1 --2- 172.21.15.49:0/2369564247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6380a8740 0x7fc6380a9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:19.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.463+0000 7fc63e000700 1 -- 172.21.15.49:0/2369564247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6200092a0 con 0x7fc638155d20 2024-01-22T05:17:19.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.463+0000 7fc63e000700 1 --2- 172.21.15.49:0/2369564247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc638155d20 0x7fc6380ab820 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7fc630009fa0 tx=0x7fc630009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:19.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.463+0000 7fc634c00700 1 -- 172.21.15.49:0/2369564247 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000ebc0 con 0x7fc638155d20 2024-01-22T05:17:19.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.463+0000 7fc634c00700 1 -- 172.21.15.49:0/2369564247 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000ed20 con 0x7fc638155d20 2024-01-22T05:17:19.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.463+0000 7fc634c00700 1 -- 172.21.15.49:0/2369564247 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630014610 con 0x7fc638155d20 2024-01-22T05:17:19.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.463+0000 7fc640000700 1 -- 172.21.15.49:0/2369564247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6380ac330 con 0x7fc638155d20 2024-01-22T05:17:19.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.463+0000 7fc640000700 1 -- 172.21.15.49:0/2369564247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6380bedc0 con 0x7fc638155d20 2024-01-22T05:17:19.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.463+0000 7fc640000700 1 -- 172.21.15.49:0/2369564247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6380ac520 con 0x7fc638155d20 2024-01-22T05:17:19.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.463+0000 7fc634c00700 1 -- 172.21.15.49:0/2369564247 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc63001d3b0 con 0x7fc638155d20 2024-01-22T05:17:19.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.467+0000 7fc634c00700 1 --2- 172.21.15.49:0/2369564247 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc61005a510 0x7fc61005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:19.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.467+0000 7fc634c00700 1 -- 172.21.15.49:0/2369564247 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fc630074e50 con 0x7fc638155d20 2024-01-22T05:17:19.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.467+0000 7fc63d600700 1 --2- 172.21.15.49:0/2369564247 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc61005a510 0x7fc61005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:19.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.467+0000 7fc63d600700 1 --2- 172.21.15.49:0/2369564247 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc61005a510 0x7fc61005c9d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7fc628007fd0 tx=0x7fc628009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:19.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.471+0000 7fc634c00700 1 -- 172.21.15.49:0/2369564247 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc6380ac520 con 0x7fc638155d20 2024-01-22T05:17:19.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.671+0000 7fc640000700 1 -- 172.21.15.49:0/2369564247 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6380ac520 con 0x7fc638155d20 2024-01-22T05:17:19.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.675+0000 7fc634c00700 1 -- 172.21.15.49:0/2369564247 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4500 (secure 0 0 0) 0x7fc6380ac520 con 0x7fc638155d20 2024-01-22T05:17:19.675 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:19.675 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":114,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":8826,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:16:17.362338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/4015076184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":4015076184},{"type":"v1","addr":"172.21.15.49:6837","nonce":4015076184}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:17:19.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.675+0000 7fc640000700 1 -- 172.21.15.49:0/2369564247 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc61005a510 msgr2=0x7fc61005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:19.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.675+0000 7fc640000700 1 --2- 172.21.15.49:0/2369564247 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc61005a510 0x7fc61005c9d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7fc628007fd0 tx=0x7fc628009040).stop 2024-01-22T05:17:19.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.675+0000 7fc640000700 1 -- 172.21.15.49:0/2369564247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc638155d20 msgr2=0x7fc6380ab820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:19.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.675+0000 7fc640000700 1 --2- 172.21.15.49:0/2369564247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc638155d20 0x7fc6380ab820 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7fc630009fa0 tx=0x7fc630009900).stop 2024-01-22T05:17:19.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.679+0000 7fc640000700 1 -- 172.21.15.49:0/2369564247 shutdown_connections 2024-01-22T05:17:19.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.679+0000 7fc640000700 1 --2- 172.21.15.49:0/2369564247 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc61005a510 0x7fc61005c9d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:19.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.679+0000 7fc640000700 1 --2- 172.21.15.49:0/2369564247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc638155d20 0x7fc6380ab820 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:19.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.679+0000 7fc640000700 1 --2- 172.21.15.49:0/2369564247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6380c1ed0 0x7fc63816cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:19.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.679+0000 7fc640000700 1 --2- 172.21.15.49:0/2369564247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6380a8740 0x7fc6380a9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:19.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.679+0000 7fc640000700 1 -- 172.21.15.49:0/2369564247 >> 172.21.15.49:0/2369564247 conn(0x7fc6380c6540 msgr2=0x7fc6380c3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:19.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.679+0000 7fc640000700 1 -- 172.21.15.49:0/2369564247 shutdown_connections 2024-01-22T05:17:19.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:19.679+0000 7fc640000700 1 -- 172.21.15.49:0/2369564247 wait complete. 2024-01-22T05:17:19.682 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 114 2024-01-22T05:17:19.704 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-01-22T05:17:24.704 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:17:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.907+0000 7f8ac4e00700 1 Processor -- start 2024-01-22T05:17:24.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.907+0000 7f8ac4e00700 1 -- start start 2024-01-22T05:17:24.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.911+0000 7f8ac4e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ac00bc7f0 0x7f8ac00bcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:24.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.911+0000 7f8ac4e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac00bd140 con 0x7f8ac0063370 2024-01-22T05:17:24.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.911+0000 7f8ac4e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac00c20e0 con 0x7f8ac0154330 2024-01-22T05:17:24.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.911+0000 7f8ac4e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac0139bc0 con 0x7f8ac00bc7f0 2024-01-22T05:17:24.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.911+0000 7f8ab7e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ac00bc7f0 0x7f8ac00bcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:24.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.911+0000 7f8abde00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8ac0154330 0x7f8ac01394b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:45918/0 (socket says 172.21.15.49:45918) 2024-01-22T05:17:24.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.911+0000 7f8abde00700 1 -- 172.21.15.49:0/1871045800 learned_addr learned my addr 172.21.15.49:0/1871045800 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:24.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.915+0000 7f8ab7e00700 1 -- 172.21.15.49:0/1871045800 >> v1:172.21.15.110:6789/0 conn(0x7f8ac0154330 legacy=0x7f8ac01394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:24.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.915+0000 7f8abd400700 1 -- 172.21.15.49:0/1871045800 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168182884 0 0) 0x7f8ac00bd140 con 0x7f8ac0063370 2024-01-22T05:17:24.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.915+0000 7f8ab7e00700 1 -- 172.21.15.49:0/1871045800 >> v1:172.21.15.49:6789/0 conn(0x7f8ac0063370 legacy=0x7f8ac00637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:24.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.915+0000 7f8ab7e00700 1 -- 172.21.15.49:0/1871045800 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac00c14d0 con 0x7f8ac00bc7f0 2024-01-22T05:17:24.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.915+0000 7f8ab7e00700 1 --2- 172.21.15.49:0/1871045800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac00bc7f0 0x7f8ac00bcc50 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f8aa80096e0 tx=0x7f8aa8009060).ready entity=mon.0 client_cookie=6b1b0ce2cd6b5714 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:24.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.915+0000 7f8abd400700 1 -- 172.21.15.49:0/1871045800 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa800f510 con 0x7f8ac00bc7f0 2024-01-22T05:17:24.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.915+0000 7f8abd400700 1 -- 172.21.15.49:0/1871045800 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa800f670 con 0x7f8ac00bc7f0 2024-01-22T05:17:24.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.915+0000 7f8abd400700 1 -- 172.21.15.49:0/1871045800 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa800f510 con 0x7f8ac00bc7f0 2024-01-22T05:17:24.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.919+0000 7f8ac4e00700 1 -- 172.21.15.49:0/1871045800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac00bc7f0 msgr2=0x7f8ac00bcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:24.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.919+0000 7f8ac4e00700 1 --2- 172.21.15.49:0/1871045800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac00bc7f0 0x7f8ac00bcc50 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f8aa80096e0 tx=0x7f8aa8009060).stop 2024-01-22T05:17:24.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.919+0000 7f8ac4e00700 1 -- 172.21.15.49:0/1871045800 shutdown_connections 2024-01-22T05:17:24.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.919+0000 7f8ac4e00700 1 --2- 172.21.15.49:0/1871045800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac00bc7f0 0x7f8ac00bcc50 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:24.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.919+0000 7f8ac4e00700 1 -- 172.21.15.49:0/1871045800 >> 172.21.15.49:0/1871045800 conn(0x7f8ac00c3620 msgr2=0x7f8ac00c3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:24.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.919+0000 7f8ac4e00700 1 -- 172.21.15.49:0/1871045800 shutdown_connections 2024-01-22T05:17:24.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.919+0000 7f8ac4e00700 1 -- 172.21.15.49:0/1871045800 wait complete. 2024-01-22T05:17:24.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.923+0000 7f8ac4e00700 1 Processor -- start 2024-01-22T05:17:24.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.923+0000 7f8ac4e00700 1 -- start start 2024-01-22T05:17:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8ac4e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ac0063370 0x7f8ac0146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8ac4e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac00bc7f0 0x7f8ac00bf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8ac4e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ac0154330 0x7f8ac00c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8ac4e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac014d930 con 0x7f8ac00bc7f0 2024-01-22T05:17:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8ac4e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac014def0 con 0x7f8ac0063370 2024-01-22T05:17:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8ac4e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00c0220 con 0x7f8ac0154330 2024-01-22T05:17:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8abde00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ac0063370 0x7f8ac0146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8abde00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ac0063370 0x7f8ac0146650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:34114/0 (socket says 172.21.15.49:34114) 2024-01-22T05:17:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8abde00700 1 -- 172.21.15.49:0/561409022 learned_addr learned my addr 172.21.15.49:0/561409022 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8abe800700 1 --2- 172.21.15.49:0/561409022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ac0154330 0x7f8ac00c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8ab7e00700 1 --2- 172.21.15.49:0/561409022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac00bc7f0 0x7f8ac00bf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8abe800700 1 -- 172.21.15.49:0/561409022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ac0063370 msgr2=0x7f8ac0146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8abe800700 1 --2- 172.21.15.49:0/561409022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ac0063370 0x7f8ac0146650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8abe800700 1 -- 172.21.15.49:0/561409022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac00bc7f0 msgr2=0x7f8ac00bf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8abe800700 1 --2- 172.21.15.49:0/561409022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac00bc7f0 0x7f8ac00bf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.927+0000 7f8abe800700 1 -- 172.21.15.49:0/561409022 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa80092a0 con 0x7f8ac0154330 2024-01-22T05:17:24.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.931+0000 7f8ab7e00700 1 --2- 172.21.15.49:0/561409022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac00bc7f0 0x7f8ac00bf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:24.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.931+0000 7f8abe800700 1 --2- 172.21.15.49:0/561409022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ac0154330 0x7f8ac00c57f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f8ab800c410 tx=0x7f8ab8007b60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:24.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.931+0000 7f8ab5600700 1 -- 172.21.15.49:0/561409022 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8012400 con 0x7f8ac0154330 2024-01-22T05:17:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.931+0000 7f8ab5600700 1 -- 172.21.15.49:0/561409022 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab8012560 con 0x7f8ac0154330 2024-01-22T05:17:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.931+0000 7f8ab5600700 1 -- 172.21.15.49:0/561409022 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8012900 con 0x7f8ac0154330 2024-01-22T05:17:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.931+0000 7f8ac4e00700 1 -- 172.21.15.49:0/561409022 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac00c0500 con 0x7f8ac0154330 2024-01-22T05:17:24.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.931+0000 7f8ac4e00700 1 -- 172.21.15.49:0/561409022 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac0146b40 con 0x7f8ac0154330 2024-01-22T05:17:24.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.935+0000 7f8ac4e00700 1 -- 172.21.15.49:0/561409022 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac0047060 con 0x7f8ac0154330 2024-01-22T05:17:24.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.935+0000 7f8ab5600700 1 -- 172.21.15.49:0/561409022 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8ab801a360 con 0x7f8ac0154330 2024-01-22T05:17:24.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.939+0000 7f8ab5600700 1 --2- 172.21.15.49:0/561409022 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8a9805a510 0x7f8a9805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:24.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.939+0000 7f8ab5600700 1 -- 172.21.15.49:0/561409022 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f8ab8073d90 con 0x7f8ac0154330 2024-01-22T05:17:24.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.939+0000 7f8abde00700 1 --2- 172.21.15.49:0/561409022 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8a9805a510 0x7f8a9805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:24.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.939+0000 7f8abde00700 1 --2- 172.21.15.49:0/561409022 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8a9805a510 0x7f8a9805c9d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f8ab0002120 tx=0x7f8ab0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:24.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:24.943+0000 7f8ab5600700 1 -- 172.21.15.49:0/561409022 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8ab8047280 con 0x7f8ac0154330 2024-01-22T05:17:25.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.327+0000 7f8ac4e00700 1 -- 172.21.15.49:0/561409022 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ac014e030 con 0x7f8ac0154330 2024-01-22T05:17:25.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.327+0000 7f8ab5600700 1 -- 172.21.15.49:0/561409022 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+3745 (secure 0 0 0) 0x7f8ab8017030 con 0x7f8ac0154330 2024-01-22T05:17:25.329 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:25.329 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":118,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:17:24.473420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":148,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8826":{"gid":8826,"name":"c","rank":0,"incarnation":115,"state":"up:active","state_seq":22,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:17:25.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.331+0000 7f8ac4e00700 1 -- 172.21.15.49:0/561409022 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8a9805a510 msgr2=0x7f8a9805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:25.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.331+0000 7f8ac4e00700 1 --2- 172.21.15.49:0/561409022 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8a9805a510 0x7f8a9805c9d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f8ab0002120 tx=0x7f8ab0009040).stop 2024-01-22T05:17:25.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.331+0000 7f8ac4e00700 1 -- 172.21.15.49:0/561409022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ac0154330 msgr2=0x7f8ac00c57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:25.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.331+0000 7f8ac4e00700 1 --2- 172.21.15.49:0/561409022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ac0154330 0x7f8ac00c57f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f8ab800c410 tx=0x7f8ab8007b60).stop 2024-01-22T05:17:25.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.331+0000 7f8ac4e00700 1 -- 172.21.15.49:0/561409022 shutdown_connections 2024-01-22T05:17:25.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.331+0000 7f8ac4e00700 1 --2- 172.21.15.49:0/561409022 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8a9805a510 0x7f8a9805c9d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.331+0000 7f8ac4e00700 1 --2- 172.21.15.49:0/561409022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ac0154330 0x7f8ac00c57f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.331+0000 7f8ac4e00700 1 --2- 172.21.15.49:0/561409022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac00bc7f0 0x7f8ac00bf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.331+0000 7f8ac4e00700 1 --2- 172.21.15.49:0/561409022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ac0063370 0x7f8ac0146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.331+0000 7f8ac4e00700 1 -- 172.21.15.49:0/561409022 >> 172.21.15.49:0/561409022 conn(0x7f8ac00c3620 msgr2=0x7f8ac00c4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:25.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.331+0000 7f8ac4e00700 1 -- 172.21.15.49:0/561409022 shutdown_connections 2024-01-22T05:17:25.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.331+0000 7f8ac4e00700 1 -- 172.21.15.49:0/561409022 wait complete. 2024-01-22T05:17:25.337 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 118 2024-01-22T05:17:25.358 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-01-22T05:17:25.358 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:17:25.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.519+0000 7f46c3400700 1 Processor -- start 2024-01-22T05:17:25.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.523+0000 7f46c3400700 1 -- start start 2024-01-22T05:17:25.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.523+0000 7f46c3400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f46bc0be070 0x7f46bc067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:25.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.523+0000 7f46c3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46bc067f80 0x7f46bc0683e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:25.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46c3400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46bc0c38c0 con 0x7f46bc0c3d50 2024-01-22T05:17:25.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46c3400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46bc0be450 con 0x7f46bc0be070 2024-01-22T05:17:25.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46c3400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc0a8880 con 0x7f46bc067f80 2024-01-22T05:17:25.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46c1400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f46bc0c3d50 0x7f46bc0c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54426/0 (socket says 172.21.15.49:54426) 2024-01-22T05:17:25.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46c1400700 1 -- 172.21.15.49:0/802094971 learned_addr learned my addr 172.21.15.49:0/802094971 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:25.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46c0a00700 1 --2- 172.21.15.49:0/802094971 >> v2:172.21.15.110:3300/0 conn(0x7f46bc0be070 0x7f46bc067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:25.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46bbe00700 1 --2- 172.21.15.49:0/802094971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46bc067f80 0x7f46bc0683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:25.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46bb400700 1 -- 172.21.15.49:0/802094971 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912259182 0 0) 0x7f46bc0c38c0 con 0x7f46bc0c3d50 2024-01-22T05:17:25.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46bb400700 1 -- 172.21.15.49:0/802094971 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f469c0033f0 con 0x7f46bc0c3d50 2024-01-22T05:17:25.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46bb400700 1 -- 172.21.15.49:0/802094971 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1215974315 0 0) 0x7f469c0033f0 con 0x7f46bc0c3d50 2024-01-22T05:17:25.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46c0a00700 1 -- 172.21.15.49:0/802094971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46bc067f80 msgr2=0x7f46bc0683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:25.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46c0a00700 1 --2- 172.21.15.49:0/802094971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46bc067f80 0x7f46bc0683e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46c0a00700 1 -- 172.21.15.49:0/802094971 >> v1:172.21.15.49:6789/0 conn(0x7f46bc0c3d50 legacy=0x7f46bc0c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:25.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46c0a00700 1 -- 172.21.15.49:0/802094971 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc0688d0 con 0x7f46bc0be070 2024-01-22T05:17:25.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46bbe00700 1 --2- 172.21.15.49:0/802094971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46bc067f80 0x7f46bc0683e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:25.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46c0a00700 1 --2- 172.21.15.49:0/802094971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be070 0x7f46bc067a90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f46ac009760 tx=0x7f46ac009060).ready entity=mon.1 client_cookie=b70a13fe11278a5d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:25.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46bb400700 1 -- 172.21.15.49:0/802094971 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b40017f0 con 0x7f46bc0be070 2024-01-22T05:17:25.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46bb400700 1 -- 172.21.15.49:0/802094971 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac011400 con 0x7f46bc0be070 2024-01-22T05:17:25.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.527+0000 7f46bb400700 1 -- 172.21.15.49:0/802094971 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac011780 con 0x7f46bc0be070 2024-01-22T05:17:25.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.531+0000 7f46c3400700 1 -- 172.21.15.49:0/802094971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be070 msgr2=0x7f46bc067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:25.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.531+0000 7f46c3400700 1 --2- 172.21.15.49:0/802094971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be070 0x7f46bc067a90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f46ac009760 tx=0x7f46ac009060).stop 2024-01-22T05:17:25.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.531+0000 7f46c3400700 1 -- 172.21.15.49:0/802094971 shutdown_connections 2024-01-22T05:17:25.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.531+0000 7f46c3400700 1 --2- 172.21.15.49:0/802094971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46bc067f80 0x7f46bc0683e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.531+0000 7f46c3400700 1 --2- 172.21.15.49:0/802094971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be070 0x7f46bc067a90 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.531+0000 7f46c3400700 1 -- 172.21.15.49:0/802094971 >> 172.21.15.49:0/802094971 conn(0x7f46bc0c8730 msgr2=0x7f46bc0c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:25.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.531+0000 7f46c3400700 1 -- 172.21.15.49:0/802094971 shutdown_connections 2024-01-22T05:17:25.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.531+0000 7f46c3400700 1 -- 172.21.15.49:0/802094971 wait complete. 2024-01-22T05:17:25.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.535+0000 7f46c3400700 1 Processor -- start 2024-01-22T05:17:25.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.535+0000 7f46c3400700 1 -- start start 2024-01-22T05:17:25.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.535+0000 7f46c3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46bc067f80 0x7f46bc0ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:25.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.535+0000 7f46c3400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be070 0x7f46bc14a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:25.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.535+0000 7f46c3400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46bc0c3d50 0x7f46bc0c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:25.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.535+0000 7f46c3400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc0ae5a0 con 0x7f46bc067f80 2024-01-22T05:17:25.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.535+0000 7f46c3400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc0acb20 con 0x7f46bc0be070 2024-01-22T05:17:25.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.535+0000 7f46c3400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc0abf10 con 0x7f46bc0c3d50 2024-01-22T05:17:25.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.535+0000 7f46c0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46bc067f80 0x7f46bc0ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:25.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.535+0000 7f46c0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46bc067f80 0x7f46bc0ab6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53610/0 (socket says 172.21.15.49:53610) 2024-01-22T05:17:25.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.535+0000 7f46c0a00700 1 -- 172.21.15.49:0/2513847899 learned_addr learned my addr 172.21.15.49:0/2513847899 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:25.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.539+0000 7f46c1400700 1 --2- 172.21.15.49:0/2513847899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46bc0c3d50 0x7f46bc0c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:25.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.539+0000 7f46bbe00700 1 --2- 172.21.15.49:0/2513847899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be070 0x7f46bc14a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:25.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.539+0000 7f46c0a00700 1 -- 172.21.15.49:0/2513847899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46bc0c3d50 msgr2=0x7f46bc0c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:25.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.539+0000 7f46c0a00700 1 --2- 172.21.15.49:0/2513847899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46bc0c3d50 0x7f46bc0c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.539+0000 7f46c0a00700 1 -- 172.21.15.49:0/2513847899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be070 msgr2=0x7f46bc14a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:25.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.539+0000 7f46c0a00700 1 --2- 172.21.15.49:0/2513847899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be070 0x7f46bc14a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.539+0000 7f46c0a00700 1 -- 172.21.15.49:0/2513847899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a40092a0 con 0x7f46bc067f80 2024-01-22T05:17:25.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.539+0000 7f46bbe00700 1 --2- 172.21.15.49:0/2513847899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be070 0x7f46bc14a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:25.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.539+0000 7f46c0a00700 1 --2- 172.21.15.49:0/2513847899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46bc067f80 0x7f46bc0ab6e0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f46ac009d50 tx=0x7f46ac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:25.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.539+0000 7f46b3e00700 1 -- 172.21.15.49:0/2513847899 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac010920 con 0x7f46bc067f80 2024-01-22T05:17:25.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.539+0000 7f46b3e00700 1 -- 172.21.15.49:0/2513847899 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac010a80 con 0x7f46bc067f80 2024-01-22T05:17:25.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.539+0000 7f46b3e00700 1 -- 172.21.15.49:0/2513847899 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac010e00 con 0x7f46bc067f80 2024-01-22T05:17:25.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.539+0000 7f46c3400700 1 -- 172.21.15.49:0/2513847899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac0092a0 con 0x7f46bc067f80 2024-01-22T05:17:25.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.539+0000 7f46c3400700 1 -- 172.21.15.49:0/2513847899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46bc0ac4d0 con 0x7f46bc067f80 2024-01-22T05:17:25.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.543+0000 7f46c3400700 1 -- 172.21.15.49:0/2513847899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46bc0667c0 con 0x7f46bc067f80 2024-01-22T05:17:25.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.543+0000 7f46b3e00700 1 -- 172.21.15.49:0/2513847899 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f46ac01d640 con 0x7f46bc067f80 2024-01-22T05:17:25.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.543+0000 7f46b3e00700 1 --2- 172.21.15.49:0/2513847899 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f469405a510 0x7f469405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:25.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.543+0000 7f46b3e00700 1 -- 172.21.15.49:0/2513847899 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f46ac0756e0 con 0x7f46bc067f80 2024-01-22T05:17:25.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.543+0000 7f46bbe00700 1 --2- 172.21.15.49:0/2513847899 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f469405a510 0x7f469405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:25.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.547+0000 7f46bbe00700 1 --2- 172.21.15.49:0/2513847899 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f469405a510 0x7f469405c9d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f46a4009270 tx=0x7f46a4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:25.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.551+0000 7f46b3e00700 1 -- 172.21.15.49:0/2513847899 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f46ac048da0 con 0x7f46bc067f80 2024-01-22T05:17:25.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.763+0000 7f46c3400700 1 -- 172.21.15.49:0/2513847899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46bc0be650 con 0x7f46bc067f80 2024-01-22T05:17:25.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.763+0000 7f46b3e00700 1 -- 172.21.15.49:0/2513847899 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+3745 (secure 0 0 0) 0x7f46ac022070 con 0x7f46bc067f80 2024-01-22T05:17:25.765 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:25.765 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":118,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:17:24.473420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":148,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8826":{"gid":8826,"name":"c","rank":0,"incarnation":115,"state":"up:active","state_seq":22,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:17:25.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.767+0000 7f46c3400700 1 -- 172.21.15.49:0/2513847899 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f469405a510 msgr2=0x7f469405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:25.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.767+0000 7f46c3400700 1 --2- 172.21.15.49:0/2513847899 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f469405a510 0x7f469405c9d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f46a4009270 tx=0x7f46a4008040).stop 2024-01-22T05:17:25.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.767+0000 7f46c3400700 1 -- 172.21.15.49:0/2513847899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46bc067f80 msgr2=0x7f46bc0ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:25.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.767+0000 7f46c3400700 1 --2- 172.21.15.49:0/2513847899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46bc067f80 0x7f46bc0ab6e0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f46ac009d50 tx=0x7f46ac016000).stop 2024-01-22T05:17:25.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.767+0000 7f46c3400700 1 -- 172.21.15.49:0/2513847899 shutdown_connections 2024-01-22T05:17:25.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.767+0000 7f46c3400700 1 --2- 172.21.15.49:0/2513847899 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f469405a510 0x7f469405c9d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.767+0000 7f46c3400700 1 --2- 172.21.15.49:0/2513847899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46bc0c3d50 0x7f46bc0c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.767+0000 7f46c3400700 1 --2- 172.21.15.49:0/2513847899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be070 0x7f46bc14a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.767+0000 7f46c3400700 1 --2- 172.21.15.49:0/2513847899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46bc067f80 0x7f46bc0ab6e0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.767+0000 7f46c3400700 1 -- 172.21.15.49:0/2513847899 >> 172.21.15.49:0/2513847899 conn(0x7f46bc0c8730 msgr2=0x7f46bc0c74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:25.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.767+0000 7f46c3400700 1 -- 172.21.15.49:0/2513847899 shutdown_connections 2024-01-22T05:17:25.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.767+0000 7f46c3400700 1 -- 172.21.15.49:0/2513847899 wait complete. 2024-01-22T05:17:25.773 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 118 2024-01-22T05:17:25.790 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-01-22T05:17:25.790 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:17:25.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.947+0000 7fe54ae00700 1 Processor -- start 2024-01-22T05:17:25.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.951+0000 7fe54ae00700 1 -- start start 2024-01-22T05:17:25.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.951+0000 7fe54ae00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe544065240 0x7fe5440644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:25.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.951+0000 7fe54ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe544065620 0x7fe5440649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:25.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.951+0000 7fe54ae00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe54415b9b0 0x7fe54415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:25.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.951+0000 7fe54ae00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe544064ed0 con 0x7fe544065240 2024-01-22T05:17:25.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.951+0000 7fe54ae00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5440c2700 con 0x7fe54415b9b0 2024-01-22T05:17:25.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.951+0000 7fe54ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440c29a0 con 0x7fe544065620 2024-01-22T05:17:25.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.951+0000 7fe543e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe544065240 0x7fe5440644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:25.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.951+0000 7fe543e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe544065240 0x7fe5440644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53622/0 (socket says 172.21.15.49:53622) 2024-01-22T05:17:25.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.951+0000 7fe543e00700 1 -- 172.21.15.49:0/3332992081 learned_addr learned my addr 172.21.15.49:0/3332992081 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:25.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.951+0000 7fe543400700 1 --2- 172.21.15.49:0/3332992081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe544065620 0x7fe5440649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:25.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.951+0000 7fe549800700 1 --2- 172.21.15.49:0/3332992081 >> v2:172.21.15.110:3300/0 conn(0x7fe54415b9b0 0x7fe54415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:25.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe543e00700 1 -- 172.21.15.49:0/3332992081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe544065620 msgr2=0x7fe5440649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:25.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe543e00700 1 --2- 172.21.15.49:0/3332992081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe544065620 0x7fe5440649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe543e00700 1 -- 172.21.15.49:0/3332992081 >> v2:172.21.15.110:3300/0 conn(0x7fe54415b9b0 msgr2=0x7fe54415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:25.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe543e00700 1 --2- 172.21.15.49:0/3332992081 >> v2:172.21.15.110:3300/0 conn(0x7fe54415b9b0 0x7fe54415be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe543e00700 1 -- 172.21.15.49:0/3332992081 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5440c2c80 con 0x7fe544065240 2024-01-22T05:17:25.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe543e00700 1 --2- 172.21.15.49:0/3332992081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe544065240 0x7fe5440644f0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7fe5440665c0 tx=0x7fe5340090f0).ready entity=mon.0 client_cookie=619d41152fc43b71 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:25.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe542a00700 1 -- 172.21.15.49:0/3332992081 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53400f510 con 0x7fe544065240 2024-01-22T05:17:25.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe542a00700 1 -- 172.21.15.49:0/3332992081 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53400f670 con 0x7fe544065240 2024-01-22T05:17:25.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe542a00700 1 -- 172.21.15.49:0/3332992081 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53400f9f0 con 0x7fe544065240 2024-01-22T05:17:25.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe54ae00700 1 -- 172.21.15.49:0/3332992081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe544065240 msgr2=0x7fe5440644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:25.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe54ae00700 1 --2- 172.21.15.49:0/3332992081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe544065240 0x7fe5440644f0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7fe5440665c0 tx=0x7fe5340090f0).stop 2024-01-22T05:17:25.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe54ae00700 1 -- 172.21.15.49:0/3332992081 shutdown_connections 2024-01-22T05:17:25.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe54ae00700 1 --2- 172.21.15.49:0/3332992081 >> v2:172.21.15.110:3300/0 conn(0x7fe54415b9b0 0x7fe54415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe54ae00700 1 --2- 172.21.15.49:0/3332992081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe544065620 0x7fe5440649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe54ae00700 1 --2- 172.21.15.49:0/3332992081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe544065240 0x7fe5440644f0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe54ae00700 1 -- 172.21.15.49:0/3332992081 >> 172.21.15.49:0/3332992081 conn(0x7fe5440c87f0 msgr2=0x7fe5440c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:25.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe54ae00700 1 -- 172.21.15.49:0/3332992081 shutdown_connections 2024-01-22T05:17:25.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.955+0000 7fe54ae00700 1 -- 172.21.15.49:0/3332992081 wait complete. 2024-01-22T05:17:25.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.959+0000 7fe54ae00700 1 Processor -- start 2024-01-22T05:17:25.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.959+0000 7fe54ae00700 1 -- start start 2024-01-22T05:17:25.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe54ae00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe544065240 0x7fe544169100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:25.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe54ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe544065620 0x7fe54414ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:25.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe54ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe54415b9b0 0x7fe5440a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:25.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe54ae00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440aa800 con 0x7fe544065240 2024-01-22T05:17:25.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe54ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440a9760 con 0x7fe54415b9b0 2024-01-22T05:17:25.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe54ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440a9a40 con 0x7fe544065620 2024-01-22T05:17:25.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe543e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe544065240 0x7fe544169100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:25.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe543e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe544065240 0x7fe544169100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53632/0 (socket says 172.21.15.49:53632) 2024-01-22T05:17:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe543e00700 1 -- 172.21.15.49:0/1988227862 learned_addr learned my addr 172.21.15.49:0/1988227862 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe543400700 1 --2- 172.21.15.49:0/1988227862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe544065620 0x7fe54414ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe549800700 1 --2- 172.21.15.49:0/1988227862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe54415b9b0 0x7fe5440a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe543e00700 1 -- 172.21.15.49:0/1988227862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe544065620 msgr2=0x7fe54414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe543e00700 1 --2- 172.21.15.49:0/1988227862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe544065620 0x7fe54414ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe543e00700 1 -- 172.21.15.49:0/1988227862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe54415b9b0 msgr2=0x7fe5440a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe543e00700 1 --2- 172.21.15.49:0/1988227862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe54415b9b0 0x7fe5440a8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe543e00700 1 -- 172.21.15.49:0/1988227862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe534009370 con 0x7fe544065240 2024-01-22T05:17:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe543e00700 1 --2- 172.21.15.49:0/1988227862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe544065240 0x7fe544169100 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7fe544066be0 tx=0x7fe534017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:25.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe53b400700 1 -- 172.21.15.49:0/1988227862 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53400f7e0 con 0x7fe544065240 2024-01-22T05:17:25.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe53b400700 1 -- 172.21.15.49:0/1988227862 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53400f940 con 0x7fe544065240 2024-01-22T05:17:25.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe54ae00700 1 -- 172.21.15.49:0/1988227862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5440a9d20 con 0x7fe544065240 2024-01-22T05:17:25.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe53b400700 1 -- 172.21.15.49:0/1988227862 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53401c670 con 0x7fe544065240 2024-01-22T05:17:25.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.963+0000 7fe54ae00700 1 -- 172.21.15.49:0/1988227862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5440aa2e0 con 0x7fe544065240 2024-01-22T05:17:25.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.967+0000 7fe54ae00700 1 -- 172.21.15.49:0/1988227862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe544047060 con 0x7fe544065240 2024-01-22T05:17:25.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.967+0000 7fe53b400700 1 -- 172.21.15.49:0/1988227862 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe53401ca20 con 0x7fe544065240 2024-01-22T05:17:25.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.967+0000 7fe53b400700 1 --2- 172.21.15.49:0/1988227862 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe51c05a510 0x7fe51c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:25.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.967+0000 7fe53b400700 1 -- 172.21.15.49:0/1988227862 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6589+0+0 (secure 0 0 0) 0x7fe5340765a0 con 0x7fe544065240 2024-01-22T05:17:25.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.971+0000 7fe543400700 1 --2- 172.21.15.49:0/1988227862 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe51c05a510 0x7fe51c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:25.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.971+0000 7fe543400700 1 --2- 172.21.15.49:0/1988227862 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe51c05a510 0x7fe51c05c9d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fe54414d720 tx=0x7fe52c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:25.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:25.975+0000 7fe53b400700 1 -- 172.21.15.49:0/1988227862 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe534049c60 con 0x7fe544065240 2024-01-22T05:17:26.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.199+0000 7fe54ae00700 1 -- 172.21.15.49:0/1988227862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe5440c2f60 con 0x7fe544065240 2024-01-22T05:17:26.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.199+0000 7fe53b400700 1 -- 172.21.15.49:0/1988227862 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1028 (secure 0 0 0) 0x7fe534020420 con 0x7fe544065240 2024-01-22T05:17:26.200 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:26.200 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":789,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":148,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075907518,"bytes_used":4677009408,"bytes_avail":768417103872,"bytes_total":773094113280,"read_bytes_sec":224167,"read_op_per_sec":1,"write_op_per_sec":0},"fsmap":{"epoch":118,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8826}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":31,"modified":"2024-01-22T05:17:21.517693+0000","services":{}},"progress_events":{}} 2024-01-22T05:17:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.203+0000 7fe54ae00700 1 -- 172.21.15.49:0/1988227862 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe51c05a510 msgr2=0x7fe51c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.203+0000 7fe54ae00700 1 --2- 172.21.15.49:0/1988227862 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe51c05a510 0x7fe51c05c9d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fe54414d720 tx=0x7fe52c009060).stop 2024-01-22T05:17:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.203+0000 7fe54ae00700 1 -- 172.21.15.49:0/1988227862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe544065240 msgr2=0x7fe544169100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:26.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.203+0000 7fe54ae00700 1 --2- 172.21.15.49:0/1988227862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe544065240 0x7fe544169100 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7fe544066be0 tx=0x7fe534017000).stop 2024-01-22T05:17:26.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.203+0000 7fe54ae00700 1 -- 172.21.15.49:0/1988227862 shutdown_connections 2024-01-22T05:17:26.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.203+0000 7fe54ae00700 1 --2- 172.21.15.49:0/1988227862 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe51c05a510 0x7fe51c05c9d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:26.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.203+0000 7fe54ae00700 1 --2- 172.21.15.49:0/1988227862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe54415b9b0 0x7fe5440a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:26.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.203+0000 7fe54ae00700 1 --2- 172.21.15.49:0/1988227862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe544065620 0x7fe54414ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:26.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.203+0000 7fe54ae00700 1 --2- 172.21.15.49:0/1988227862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe544065240 0x7fe544169100 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:26.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.203+0000 7fe54ae00700 1 -- 172.21.15.49:0/1988227862 >> 172.21.15.49:0/1988227862 conn(0x7fe5440c87f0 msgr2=0x7fe544156760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:26.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.203+0000 7fe54ae00700 1 -- 172.21.15.49:0/1988227862 shutdown_connections 2024-01-22T05:17:26.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.203+0000 7fe54ae00700 1 -- 172.21.15.49:0/1988227862 wait complete. 2024-01-22T05:17:26.228 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:17:26.228 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:17:26.273 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:17:26.315 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:17:26.315 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T05:17:26.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:17:26.315 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-22T05:17:26.392 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:17:26.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:17:26.393 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:17:26.406 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:17:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.615+0000 7f814dc00700 1 Processor -- start 2024-01-22T05:17:26.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.615+0000 7f814dc00700 1 -- start start 2024-01-22T05:17:26.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.619+0000 7f814dc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f81480aabf0 0x7f81480ab030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:26.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.619+0000 7f814dc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8148067ee0 0x7f8148068370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:26.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.619+0000 7f814dc00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81480a7fe0 con 0x7f8148069c00 2024-01-22T05:17:26.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.619+0000 7f814dc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8148067a90 con 0x7f81480aabf0 2024-01-22T05:17:26.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.619+0000 7f814dc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81480ab520 con 0x7f8148067ee0 2024-01-22T05:17:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.619+0000 7f8146a00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8148069c00 0x7f81481518a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:45922/0 (socket says 172.21.15.49:45922) 2024-01-22T05:17:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.619+0000 7f8146a00700 1 -- 172.21.15.49:0/3010915907 learned_addr learned my addr 172.21.15.49:0/3010915907 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.619+0000 7f8147e00700 1 --2- 172.21.15.49:0/3010915907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8148067ee0 0x7f8148068370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.619+0000 7f8146000700 1 --2- 172.21.15.49:0/3010915907 >> v2:172.21.15.110:3300/0 conn(0x7f81480aabf0 0x7f81480ab030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.619+0000 7f8145600700 1 -- 172.21.15.49:0/3010915907 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757819524 0 0) 0x7f81480a7fe0 con 0x7f8148069c00 2024-01-22T05:17:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.619+0000 7f8145600700 1 -- 172.21.15.49:0/3010915907 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81280033f0 con 0x7f8148069c00 2024-01-22T05:17:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.619+0000 7f8146000700 1 -- 172.21.15.49:0/3010915907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8148067ee0 msgr2=0x7f8148068370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:26.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.619+0000 7f8146000700 1 --2- 172.21.15.49:0/3010915907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8148067ee0 0x7f8148068370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.619+0000 7f8146000700 1 -- 172.21.15.49:0/3010915907 >> v1:172.21.15.110:6789/0 conn(0x7f8148069c00 legacy=0x7f81481518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.623+0000 7f8146000700 1 -- 172.21.15.49:0/3010915907 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8148063a60 con 0x7f81480aabf0 2024-01-22T05:17:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.623+0000 7f8146000700 1 --2- 172.21.15.49:0/3010915907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81480aabf0 0x7f81480ab030 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f8130009760 tx=0x7f8130009060).ready entity=mon.1 client_cookie=901b2080897b8601 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.623+0000 7f8145600700 1 -- 172.21.15.49:0/3010915907 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813000f510 con 0x7f81480aabf0 2024-01-22T05:17:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.623+0000 7f8145600700 1 -- 172.21.15.49:0/3010915907 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813000f670 con 0x7f81480aabf0 2024-01-22T05:17:26.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.623+0000 7f8145600700 1 -- 172.21.15.49:0/3010915907 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813000f9f0 con 0x7f81480aabf0 2024-01-22T05:17:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.623+0000 7f814dc00700 1 -- 172.21.15.49:0/3010915907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81480aabf0 msgr2=0x7f81480ab030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:26.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.623+0000 7f814dc00700 1 --2- 172.21.15.49:0/3010915907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81480aabf0 0x7f81480ab030 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f8130009760 tx=0x7f8130009060).stop 2024-01-22T05:17:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.623+0000 7f814dc00700 1 -- 172.21.15.49:0/3010915907 shutdown_connections 2024-01-22T05:17:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.623+0000 7f814dc00700 1 --2- 172.21.15.49:0/3010915907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8148067ee0 0x7f8148068370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.623+0000 7f814dc00700 1 --2- 172.21.15.49:0/3010915907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81480aabf0 0x7f81480ab030 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.623+0000 7f814dc00700 1 -- 172.21.15.49:0/3010915907 >> 172.21.15.49:0/3010915907 conn(0x7f8148064080 msgr2=0x7f8148064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.623+0000 7f814dc00700 1 -- 172.21.15.49:0/3010915907 shutdown_connections 2024-01-22T05:17:26.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.623+0000 7f814dc00700 1 -- 172.21.15.49:0/3010915907 wait complete. 2024-01-22T05:17:26.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.627+0000 7f814dc00700 1 Processor -- start 2024-01-22T05:17:26.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.627+0000 7f814dc00700 1 -- start start 2024-01-22T05:17:26.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f814dc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8148067ee0 0x7f814814f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:26.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f814dc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8148069c00 0x7f8148167090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:26.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f814dc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81480aabf0 0x7f8148167580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:26.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f814dc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81480c0cc0 con 0x7f81480aabf0 2024-01-22T05:17:26.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f814dc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81480c1280 con 0x7f8148069c00 2024-01-22T05:17:26.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f814dc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814814fee0 con 0x7f8148067ee0 2024-01-22T05:17:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f8147e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81480aabf0 0x7f8148167580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f8147e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81480aabf0 0x7f8148167580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53642/0 (socket says 172.21.15.49:53642) 2024-01-22T05:17:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f8147e00700 1 -- 172.21.15.49:0/3697211896 learned_addr learned my addr 172.21.15.49:0/3697211896 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f8146a00700 1 --2- 172.21.15.49:0/3697211896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8148067ee0 0x7f814814f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:26.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f8146000700 1 --2- 172.21.15.49:0/3697211896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8148069c00 0x7f8148167090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:26.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f8147e00700 1 -- 172.21.15.49:0/3697211896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8148067ee0 msgr2=0x7f814814f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:26.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f8147e00700 1 --2- 172.21.15.49:0/3697211896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8148067ee0 0x7f814814f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:26.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f8147e00700 1 -- 172.21.15.49:0/3697211896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8148069c00 msgr2=0x7f8148167090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:26.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f8147e00700 1 --2- 172.21.15.49:0/3697211896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8148069c00 0x7f8148167090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:26.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.631+0000 7f8147e00700 1 -- 172.21.15.49:0/3697211896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81300092a0 con 0x7f81480aabf0 2024-01-22T05:17:26.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.635+0000 7f8147e00700 1 --2- 172.21.15.49:0/3697211896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81480aabf0 0x7f8148167580 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f8140009ec0 tx=0x7f814000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:26.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.635+0000 7f813e000700 1 -- 172.21.15.49:0/3697211896 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8140009bf0 con 0x7f81480aabf0 2024-01-22T05:17:26.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.635+0000 7f813e000700 1 -- 172.21.15.49:0/3697211896 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814000f040 con 0x7f81480aabf0 2024-01-22T05:17:26.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.635+0000 7f813e000700 1 -- 172.21.15.49:0/3697211896 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000cd80 con 0x7f81480aabf0 2024-01-22T05:17:26.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.635+0000 7f814dc00700 1 -- 172.21.15.49:0/3697211896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8148167b50 con 0x7f81480aabf0 2024-01-22T05:17:26.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.635+0000 7f814dc00700 1 -- 172.21.15.49:0/3697211896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81480c0f10 con 0x7f81480aabf0 2024-01-22T05:17:26.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.635+0000 7f814dc00700 1 -- 172.21.15.49:0/3697211896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81480a81a0 con 0x7f81480aabf0 2024-01-22T05:17:26.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.639+0000 7f813e000700 1 -- 172.21.15.49:0/3697211896 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8140013610 con 0x7f81480aabf0 2024-01-22T05:17:26.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.639+0000 7f813e000700 1 --2- 172.21.15.49:0/3697211896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f812005a4e0 0x7f812005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:26.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.639+0000 7f813e000700 1 -- 172.21.15.49:0/3697211896 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f8140075190 con 0x7f81480aabf0 2024-01-22T05:17:26.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.639+0000 7f8146a00700 1 --2- 172.21.15.49:0/3697211896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f812005a4e0 0x7f812005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:26.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.639+0000 7f8146a00700 1 --2- 172.21.15.49:0/3697211896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f812005a4e0 0x7f812005c9a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f8138005750 tx=0x7f8138009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.647+0000 7f813e000700 1 -- 172.21.15.49:0/3697211896 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f81400486e0 con 0x7f81480aabf0 2024-01-22T05:17:26.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.843+0000 7f814dc00700 1 -- 172.21.15.49:0/3697211896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8148047060 con 0x7f81480aabf0 2024-01-22T05:17:26.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.843+0000 7f813e000700 1 -- 172.21.15.49:0/3697211896 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+3745 (secure 0 0 0) 0x7f814004bd00 con 0x7f81480aabf0 2024-01-22T05:17:26.845 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:26.845 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":118,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:17:24.473420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":148,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8826":{"gid":8826,"name":"c","rank":0,"incarnation":115,"state":"up:active","state_seq":22,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:17:26.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.847+0000 7f814dc00700 1 -- 172.21.15.49:0/3697211896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f812005a4e0 msgr2=0x7f812005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:26.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.847+0000 7f814dc00700 1 --2- 172.21.15.49:0/3697211896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f812005a4e0 0x7f812005c9a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f8138005750 tx=0x7f8138009040).stop 2024-01-22T05:17:26.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.847+0000 7f814dc00700 1 -- 172.21.15.49:0/3697211896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81480aabf0 msgr2=0x7f8148167580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:26.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.847+0000 7f814dc00700 1 --2- 172.21.15.49:0/3697211896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81480aabf0 0x7f8148167580 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f8140009ec0 tx=0x7f814000b040).stop 2024-01-22T05:17:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.847+0000 7f814dc00700 1 -- 172.21.15.49:0/3697211896 shutdown_connections 2024-01-22T05:17:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.847+0000 7f814dc00700 1 --2- 172.21.15.49:0/3697211896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f812005a4e0 0x7f812005c9a0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.847+0000 7f814dc00700 1 --2- 172.21.15.49:0/3697211896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81480aabf0 0x7f8148167580 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.847+0000 7f814dc00700 1 --2- 172.21.15.49:0/3697211896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8148069c00 0x7f8148167090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.847+0000 7f814dc00700 1 --2- 172.21.15.49:0/3697211896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8148067ee0 0x7f814814f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.847+0000 7f814dc00700 1 -- 172.21.15.49:0/3697211896 >> 172.21.15.49:0/3697211896 conn(0x7f8148064080 msgr2=0x7f8148150bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.847+0000 7f814dc00700 1 -- 172.21.15.49:0/3697211896 shutdown_connections 2024-01-22T05:17:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:26.847+0000 7f814dc00700 1 -- 172.21.15.49:0/3697211896 wait complete. 2024-01-22T05:17:26.852 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 118 2024-01-22T05:17:26.871 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:17:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.035+0000 7fd2c1200700 1 Processor -- start 2024-01-22T05:17:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.035+0000 7fd2c1200700 1 -- start start 2024-01-22T05:17:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2c1200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2bc064c00 0x7fd2bc0bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2c1200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2bc065620 0x7fd2bc0bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2c1200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc0c2700 con 0x7fd2bc065240 2024-01-22T05:17:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2c1200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc0c29a0 con 0x7fd2bc065620 2024-01-22T05:17:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2c1200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0c2c80 con 0x7fd2bc064c00 2024-01-22T05:17:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2b9e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd2bc065240 0x7fd2bc0644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:45926/0 (socket says 172.21.15.49:45926) 2024-01-22T05:17:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2b9e00700 1 -- 172.21.15.49:0/782515800 learned_addr learned my addr 172.21.15.49:0/782515800 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2b9400700 1 --2- 172.21.15.49:0/782515800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2bc064c00 0x7fd2bc0bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2bb200700 1 --2- 172.21.15.49:0/782515800 >> v2:172.21.15.49:3300/0 conn(0x7fd2bc065620 0x7fd2bc0bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2b8a00700 1 -- 172.21.15.49:0/782515800 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262491457 0 0) 0x7fd2bc0c2700 con 0x7fd2bc065240 2024-01-22T05:17:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2b8a00700 1 -- 172.21.15.49:0/782515800 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd29c0033f0 con 0x7fd2bc065240 2024-01-22T05:17:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2b9400700 1 -- 172.21.15.49:0/782515800 >> v2:172.21.15.49:3300/0 conn(0x7fd2bc065620 msgr2=0x7fd2bc0bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:27.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2b9400700 1 --2- 172.21.15.49:0/782515800 >> v2:172.21.15.49:3300/0 conn(0x7fd2bc065620 0x7fd2bc0bd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2b9400700 1 -- 172.21.15.49:0/782515800 >> v1:172.21.15.110:6789/0 conn(0x7fd2bc065240 legacy=0x7fd2bc0644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2b9400700 1 -- 172.21.15.49:0/782515800 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc0c2f60 con 0x7fd2bc064c00 2024-01-22T05:17:27.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2b9400700 1 --2- 172.21.15.49:0/782515800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2bc064c00 0x7fd2bc0bcc80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fd2a4009760 tx=0x7fd2a4009060).ready entity=mon.2 client_cookie=6c7a86048e00c251 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:27.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2b8a00700 1 -- 172.21.15.49:0/782515800 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a400d4a0 con 0x7fd2bc064c00 2024-01-22T05:17:27.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2b8a00700 1 -- 172.21.15.49:0/782515800 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a400d600 con 0x7fd2bc064c00 2024-01-22T05:17:27.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.039+0000 7fd2b8a00700 1 -- 172.21.15.49:0/782515800 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a400d980 con 0x7fd2bc064c00 2024-01-22T05:17:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.043+0000 7fd2c1200700 1 -- 172.21.15.49:0/782515800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2bc064c00 msgr2=0x7fd2bc0bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.043+0000 7fd2c1200700 1 --2- 172.21.15.49:0/782515800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2bc064c00 0x7fd2bc0bcc80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fd2a4009760 tx=0x7fd2a4009060).stop 2024-01-22T05:17:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.043+0000 7fd2c1200700 1 -- 172.21.15.49:0/782515800 shutdown_connections 2024-01-22T05:17:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.043+0000 7fd2c1200700 1 --2- 172.21.15.49:0/782515800 >> v2:172.21.15.49:3300/0 conn(0x7fd2bc065620 0x7fd2bc0bd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.043+0000 7fd2c1200700 1 --2- 172.21.15.49:0/782515800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2bc064c00 0x7fd2bc0bcc80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.043+0000 7fd2c1200700 1 -- 172.21.15.49:0/782515800 >> 172.21.15.49:0/782515800 conn(0x7fd2bc0c87f0 msgr2=0x7fd2bc0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.043+0000 7fd2c1200700 1 -- 172.21.15.49:0/782515800 shutdown_connections 2024-01-22T05:17:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.043+0000 7fd2c1200700 1 -- 172.21.15.49:0/782515800 wait complete. 2024-01-22T05:17:27.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.047+0000 7fd2c1200700 1 Processor -- start 2024-01-22T05:17:27.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.047+0000 7fd2c1200700 1 -- start start 2024-01-22T05:17:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2c1200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2bc064c00 0x7fd2bc0bf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2c1200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2bc065240 0x7fd2bc0a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2c1200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2bc065620 0x7fd2bc156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2c1200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0c0000 con 0x7fd2bc065620 2024-01-22T05:17:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2c1200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0a78b0 con 0x7fd2bc065240 2024-01-22T05:17:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2c1200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0a7b90 con 0x7fd2bc064c00 2024-01-22T05:17:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2bb200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2bc065620 0x7fd2bc156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2bb200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2bc065620 0x7fd2bc156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53654/0 (socket says 172.21.15.49:53654) 2024-01-22T05:17:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2b9e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2bc064c00 0x7fd2bc0bf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2b9400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2bc065240 0x7fd2bc0a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2bb200700 1 -- 172.21.15.49:0/1343575220 learned_addr learned my addr 172.21.15.49:0/1343575220 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:27.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2bb200700 1 -- 172.21.15.49:0/1343575220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2bc064c00 msgr2=0x7fd2bc0bf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2bb200700 1 --2- 172.21.15.49:0/1343575220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2bc064c00 0x7fd2bc0bf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2bb200700 1 -- 172.21.15.49:0/1343575220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2bc065240 msgr2=0x7fd2bc0a9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2bb200700 1 --2- 172.21.15.49:0/1343575220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2bc065240 0x7fd2bc0a9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2bb200700 1 -- 172.21.15.49:0/1343575220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a40092a0 con 0x7fd2bc065620 2024-01-22T05:17:27.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2b9400700 1 --2- 172.21.15.49:0/1343575220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2bc065240 0x7fd2bc0a9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:27.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2b9e00700 1 --2- 172.21.15.49:0/1343575220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2bc064c00 0x7fd2bc0bf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:27.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2bb200700 1 --2- 172.21.15.49:0/1343575220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2bc065620 0x7fd2bc156070 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7fd2b4009d40 tx=0x7fd2b400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:27.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2b1600700 1 -- 172.21.15.49:0/1343575220 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4009ea0 con 0x7fd2bc065620 2024-01-22T05:17:27.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2b1600700 1 -- 172.21.15.49:0/1343575220 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b400f040 con 0x7fd2bc065620 2024-01-22T05:17:27.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2c1200700 1 -- 172.21.15.49:0/1343575220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc0a7e70 con 0x7fd2bc065620 2024-01-22T05:17:27.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2b1600700 1 -- 172.21.15.49:0/1343575220 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b400ccf0 con 0x7fd2bc065620 2024-01-22T05:17:27.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.051+0000 7fd2c1200700 1 -- 172.21.15.49:0/1343575220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc0bfd90 con 0x7fd2bc065620 2024-01-22T05:17:27.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.055+0000 7fd2c1200700 1 -- 172.21.15.49:0/1343575220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc047060 con 0x7fd2bc065620 2024-01-22T05:17:27.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.055+0000 7fd2b1600700 1 -- 172.21.15.49:0/1343575220 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd2b4013610 con 0x7fd2bc065620 2024-01-22T05:17:27.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.059+0000 7fd2b1600700 1 --2- 172.21.15.49:0/1343575220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd29405a510 0x7fd29405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.059+0000 7fd2b1600700 1 -- 172.21.15.49:0/1343575220 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6589+0+0 (secure 0 0 0) 0x7fd2b4074fe0 con 0x7fd2bc065620 2024-01-22T05:17:27.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.059+0000 7fd2b9e00700 1 --2- 172.21.15.49:0/1343575220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd29405a510 0x7fd29405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.059+0000 7fd2b9e00700 1 --2- 172.21.15.49:0/1343575220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd29405a510 0x7fd29405c9d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7fd2ac005750 tx=0x7fd2ac009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.063+0000 7fd2b1600700 1 -- 172.21.15.49:0/1343575220 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd2b4048530 con 0x7fd2bc065620 2024-01-22T05:17:27.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.231+0000 7fd2c1200700 1 -- 172.21.15.49:0/1343575220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2bc0c3240 con 0x7fd2bc065620 2024-01-22T05:17:27.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.235+0000 7fd2b1600700 1 -- 172.21.15.49:0/1343575220 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+17357 (secure 0 0 0) 0x7fd2b404bb50 con 0x7fd2bc065620 2024-01-22T05:17:27.236 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:27.236 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":148,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:17:21.374871+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:16:12.266975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-01-22T05:16:13.093952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.29","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6837/4015076184":"2024-01-23T05:17:21.374748+0000","172.21.15.49:6835/4015076184":"2024-01-23T05:17:21.374748+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:17:27.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.235+0000 7fd2c1200700 1 -- 172.21.15.49:0/1343575220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd29405a510 msgr2=0x7fd29405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.235+0000 7fd2c1200700 1 --2- 172.21.15.49:0/1343575220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd29405a510 0x7fd29405c9d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7fd2ac005750 tx=0x7fd2ac009040).stop 2024-01-22T05:17:27.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.235+0000 7fd2c1200700 1 -- 172.21.15.49:0/1343575220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2bc065620 msgr2=0x7fd2bc156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.235+0000 7fd2c1200700 1 --2- 172.21.15.49:0/1343575220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2bc065620 0x7fd2bc156070 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7fd2b4009d40 tx=0x7fd2b400b040).stop 2024-01-22T05:17:27.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.235+0000 7fd2c1200700 1 -- 172.21.15.49:0/1343575220 shutdown_connections 2024-01-22T05:17:27.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.235+0000 7fd2c1200700 1 --2- 172.21.15.49:0/1343575220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd29405a510 0x7fd29405c9d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.235+0000 7fd2c1200700 1 --2- 172.21.15.49:0/1343575220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2bc065620 0x7fd2bc156070 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.235+0000 7fd2c1200700 1 --2- 172.21.15.49:0/1343575220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2bc065240 0x7fd2bc0a9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.235+0000 7fd2c1200700 1 --2- 172.21.15.49:0/1343575220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2bc064c00 0x7fd2bc0bf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.235+0000 7fd2c1200700 1 -- 172.21.15.49:0/1343575220 >> 172.21.15.49:0/1343575220 conn(0x7fd2bc0c87f0 msgr2=0x7fd2bc0ad6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:27.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.235+0000 7fd2c1200700 1 -- 172.21.15.49:0/1343575220 shutdown_connections 2024-01-22T05:17:27.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.235+0000 7fd2c1200700 1 -- 172.21.15.49:0/1343575220 wait complete. 2024-01-22T05:17:27.262 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:16:12.266975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:16:13.093952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:17:27.262 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:17:27.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.443+0000 7fa56fa00700 1 Processor -- start 2024-01-22T05:17:27.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.443+0000 7fa56fa00700 1 -- start start 2024-01-22T05:17:27.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.447+0000 7fa56fa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa5680c1a80 0x7fa5680c1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.447+0000 7fa56fa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa568151b90 0x7fa568068e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.447+0000 7fa56fa00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa568069430 con 0x7fa5680689b0 2024-01-22T05:17:27.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.447+0000 7fa56fa00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5680a7100 con 0x7fa5680c1a80 2024-01-22T05:17:27.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.447+0000 7fa56fa00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680622d0 con 0x7fa568151b90 2024-01-22T05:17:27.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.447+0000 7fa56d000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa5680c1a80 0x7fa5680c1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.447+0000 7fa56d000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa5680c1a80 0x7fa5680c1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53662/0 (socket says 172.21.15.49:53662) 2024-01-22T05:17:27.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.447+0000 7fa56d000700 1 -- 172.21.15.49:0/680469319 learned_addr learned my addr 172.21.15.49:0/680469319 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:27.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.447+0000 7fa56da00700 1 --2- 172.21.15.49:0/680469319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa568151b90 0x7fa568068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.447+0000 7fa56d000700 1 -- 172.21.15.49:0/680469319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa568151b90 msgr2=0x7fa568068e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:27.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.447+0000 7fa56d000700 1 --2- 172.21.15.49:0/680469319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa568151b90 0x7fa568068e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.447+0000 7fa56d000700 1 -- 172.21.15.49:0/680469319 >> v1:172.21.15.110:6789/0 conn(0x7fa5680689b0 legacy=0x7fa568151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.447+0000 7fa56d000700 1 -- 172.21.15.49:0/680469319 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5680625b0 con 0x7fa5680c1a80 2024-01-22T05:17:27.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.451+0000 7fa56d000700 1 --2- 172.21.15.49:0/680469319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680c1a80 0x7fa5680c1e60 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7fa558006fd0 tx=0x7fa5580090f0).ready entity=mon.0 client_cookie=c0aa79db6da5a06b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:27.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.451+0000 7fa567400700 1 -- 172.21.15.49:0/680469319 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55800b600 con 0x7fa5680c1a80 2024-01-22T05:17:27.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.451+0000 7fa567400700 1 -- 172.21.15.49:0/680469319 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55800b760 con 0x7fa5680c1a80 2024-01-22T05:17:27.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.451+0000 7fa567400700 1 -- 172.21.15.49:0/680469319 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55800bae0 con 0x7fa5680c1a80 2024-01-22T05:17:27.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.451+0000 7fa56fa00700 1 -- 172.21.15.49:0/680469319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680c1a80 msgr2=0x7fa5680c1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.451+0000 7fa56fa00700 1 --2- 172.21.15.49:0/680469319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680c1a80 0x7fa5680c1e60 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7fa558006fd0 tx=0x7fa5580090f0).stop 2024-01-22T05:17:27.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.451+0000 7fa56fa00700 1 -- 172.21.15.49:0/680469319 shutdown_connections 2024-01-22T05:17:27.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.451+0000 7fa56fa00700 1 --2- 172.21.15.49:0/680469319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa568151b90 0x7fa568068e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.451+0000 7fa56fa00700 1 --2- 172.21.15.49:0/680469319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680c1a80 0x7fa5680c1e60 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.451+0000 7fa56fa00700 1 -- 172.21.15.49:0/680469319 >> 172.21.15.49:0/680469319 conn(0x7fa5680c3940 msgr2=0x7fa5680c3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.451+0000 7fa56fa00700 1 -- 172.21.15.49:0/680469319 shutdown_connections 2024-01-22T05:17:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.451+0000 7fa56fa00700 1 -- 172.21.15.49:0/680469319 wait complete. 2024-01-22T05:17:27.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.455+0000 7fa56fa00700 1 Processor -- start 2024-01-22T05:17:27.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.455+0000 7fa56fa00700 1 -- start start 2024-01-22T05:17:27.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.455+0000 7fa56fa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680689b0 0x7fa568165370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.455+0000 7fa56fa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5680c1a80 0x7fa56813a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.455+0000 7fa56fa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa568151b90 0x7fa5680bd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.455+0000 7fa56fa00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56813a8c0 con 0x7fa5680689b0 2024-01-22T05:17:27.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.455+0000 7fa56fa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680c4a00 con 0x7fa568151b90 2024-01-22T05:17:27.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.455+0000 7fa56fa00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680c4c50 con 0x7fa5680c1a80 2024-01-22T05:17:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa56d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680689b0 0x7fa568165370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa56d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680689b0 0x7fa568165370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53678/0 (socket says 172.21.15.49:53678) 2024-01-22T05:17:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa56d000700 1 -- 172.21.15.49:0/3798101407 learned_addr learned my addr 172.21.15.49:0/3798101407 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa56da00700 1 --2- 172.21.15.49:0/3798101407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa568151b90 0x7fa5680bd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa567e00700 1 --2- 172.21.15.49:0/3798101407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5680c1a80 0x7fa56813a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa56d000700 1 -- 172.21.15.49:0/3798101407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5680c1a80 msgr2=0x7fa56813a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa56d000700 1 --2- 172.21.15.49:0/3798101407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5680c1a80 0x7fa56813a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa56d000700 1 -- 172.21.15.49:0/3798101407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa568151b90 msgr2=0x7fa5680bd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa56d000700 1 --2- 172.21.15.49:0/3798101407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa568151b90 0x7fa5680bd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa56d000700 1 -- 172.21.15.49:0/3798101407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa558009370 con 0x7fa5680689b0 2024-01-22T05:17:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa567e00700 1 --2- 172.21.15.49:0/3798101407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5680c1a80 0x7fa56813a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa56d000700 1 --2- 172.21.15.49:0/3798101407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680689b0 0x7fa568165370 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fa5680c6c10 tx=0x7fa558017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:27.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa55fe00700 1 -- 172.21.15.49:0/3798101407 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55800bea0 con 0x7fa5680689b0 2024-01-22T05:17:27.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa55fe00700 1 -- 172.21.15.49:0/3798101407 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55800b8d0 con 0x7fa5680689b0 2024-01-22T05:17:27.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa56fa00700 1 -- 172.21.15.49:0/3798101407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5680c4f30 con 0x7fa5680689b0 2024-01-22T05:17:27.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa55fe00700 1 -- 172.21.15.49:0/3798101407 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55801c670 con 0x7fa5680689b0 2024-01-22T05:17:27.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.459+0000 7fa56fa00700 1 -- 172.21.15.49:0/3798101407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5680c5210 con 0x7fa5680689b0 2024-01-22T05:17:27.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.463+0000 7fa56fa00700 1 -- 172.21.15.49:0/3798101407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5680651f0 con 0x7fa5680689b0 2024-01-22T05:17:27.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.463+0000 7fa55fe00700 1 -- 172.21.15.49:0/3798101407 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa55801c9e0 con 0x7fa5680689b0 2024-01-22T05:17:27.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.463+0000 7fa55fe00700 1 --2- 172.21.15.49:0/3798101407 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa54005a510 0x7fa54005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.463+0000 7fa55fe00700 1 -- 172.21.15.49:0/3798101407 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6589+0+0 (secure 0 0 0) 0x7fa558076720 con 0x7fa5680689b0 2024-01-22T05:17:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.463+0000 7fa567e00700 1 --2- 172.21.15.49:0/3798101407 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa54005a510 0x7fa54005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.467+0000 7fa567e00700 1 --2- 172.21.15.49:0/3798101407 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa54005a510 0x7fa54005c9d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fa56814b460 tx=0x7fa550009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:27.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.471+0000 7fa55fe00700 1 -- 172.21.15.49:0/3798101407 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa558049c70 con 0x7fa5680689b0 2024-01-22T05:17:27.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.643+0000 7fa56fa00700 1 -- 172.21.15.49:0/3798101407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa568062890 con 0x7fa5680689b0 2024-01-22T05:17:27.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.643+0000 7fa55fe00700 1 -- 172.21.15.49:0/3798101407 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v148) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa558020020 con 0x7fa5680689b0 2024-01-22T05:17:27.644 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:17:27.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.647+0000 7fa56fa00700 1 -- 172.21.15.49:0/3798101407 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa54005a510 msgr2=0x7fa54005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.647+0000 7fa56fa00700 1 --2- 172.21.15.49:0/3798101407 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa54005a510 0x7fa54005c9d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fa56814b460 tx=0x7fa550009040).stop 2024-01-22T05:17:27.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.647+0000 7fa56fa00700 1 -- 172.21.15.49:0/3798101407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680689b0 msgr2=0x7fa568165370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.647+0000 7fa56fa00700 1 --2- 172.21.15.49:0/3798101407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680689b0 0x7fa568165370 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fa5680c6c10 tx=0x7fa558017000).stop 2024-01-22T05:17:27.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.647+0000 7fa56fa00700 1 -- 172.21.15.49:0/3798101407 shutdown_connections 2024-01-22T05:17:27.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.647+0000 7fa56fa00700 1 --2- 172.21.15.49:0/3798101407 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa54005a510 0x7fa54005c9d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.647+0000 7fa56fa00700 1 --2- 172.21.15.49:0/3798101407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa568151b90 0x7fa5680bd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.647+0000 7fa56fa00700 1 --2- 172.21.15.49:0/3798101407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5680c1a80 0x7fa56813a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.647+0000 7fa56fa00700 1 --2- 172.21.15.49:0/3798101407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5680689b0 0x7fa568165370 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.647+0000 7fa56fa00700 1 -- 172.21.15.49:0/3798101407 >> 172.21.15.49:0/3798101407 conn(0x7fa5680c3940 msgr2=0x7fa568067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:27.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.647+0000 7fa56fa00700 1 -- 172.21.15.49:0/3798101407 shutdown_connections 2024-01-22T05:17:27.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.647+0000 7fa56fa00700 1 -- 172.21.15.49:0/3798101407 wait complete. 2024-01-22T05:17:27.676 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:17:27.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.835+0000 7f0255800700 1 Processor -- start 2024-01-22T05:17:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.839+0000 7f0255800700 1 -- start start 2024-01-22T05:17:27.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.839+0000 7f0255800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0250063860 0x7f0250062440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f0255800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0250062dc0 0x7f02500681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f0255800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02500c25c0 con 0x7f0250062930 2024-01-22T05:17:27.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f0255800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02500c1a20 con 0x7f0250063860 2024-01-22T05:17:27.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f0255800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0250063250 con 0x7f0250062dc0 2024-01-22T05:17:27.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f024ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0250063860 0x7f0250062440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f024ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0250063860 0x7f0250062440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53684/0 (socket says 172.21.15.49:53684) 2024-01-22T05:17:27.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f024ea00700 1 -- 172.21.15.49:0/499902972 learned_addr learned my addr 172.21.15.49:0/499902972 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:27.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f024f400700 1 --2- 172.21.15.49:0/499902972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0250062dc0 0x7f02500681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f024ea00700 1 -- 172.21.15.49:0/499902972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0250062dc0 msgr2=0x7f02500681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:27.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f024ea00700 1 --2- 172.21.15.49:0/499902972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0250062dc0 0x7f02500681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f024ea00700 1 -- 172.21.15.49:0/499902972 >> v1:172.21.15.110:6789/0 conn(0x7f0250062930 legacy=0x7f0250067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f024ea00700 1 -- 172.21.15.49:0/499902972 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02500c1c90 con 0x7f0250063860 2024-01-22T05:17:27.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f024f400700 1 --2- 172.21.15.49:0/499902972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0250062dc0 0x7f02500681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:27.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f024ea00700 1 --2- 172.21.15.49:0/499902972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0250063860 0x7f0250062440 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f0240006fd0 tx=0x7f02400090f0).ready entity=mon.0 client_cookie=11bc9728a1e1563 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:27.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f024d600700 1 -- 172.21.15.49:0/499902972 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024000b600 con 0x7f0250063860 2024-01-22T05:17:27.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f024d600700 1 -- 172.21.15.49:0/499902972 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024000b760 con 0x7f0250063860 2024-01-22T05:17:27.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.843+0000 7f024d600700 1 -- 172.21.15.49:0/499902972 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024000bae0 con 0x7f0250063860 2024-01-22T05:17:27.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.847+0000 7f0255800700 1 -- 172.21.15.49:0/499902972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0250063860 msgr2=0x7f0250062440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.847+0000 7f0255800700 1 --2- 172.21.15.49:0/499902972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0250063860 0x7f0250062440 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f0240006fd0 tx=0x7f02400090f0).stop 2024-01-22T05:17:27.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.847+0000 7f0255800700 1 -- 172.21.15.49:0/499902972 shutdown_connections 2024-01-22T05:17:27.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.847+0000 7f0255800700 1 --2- 172.21.15.49:0/499902972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0250062dc0 0x7f02500681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.847+0000 7f0255800700 1 --2- 172.21.15.49:0/499902972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0250063860 0x7f0250062440 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.847+0000 7f0255800700 1 -- 172.21.15.49:0/499902972 >> 172.21.15.49:0/499902972 conn(0x7f02500c3940 msgr2=0x7f02500c3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:27.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.847+0000 7f0255800700 1 -- 172.21.15.49:0/499902972 shutdown_connections 2024-01-22T05:17:27.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.847+0000 7f0255800700 1 -- 172.21.15.49:0/499902972 wait complete. 2024-01-22T05:17:27.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.851+0000 7f0255800700 1 Processor -- start 2024-01-22T05:17:27.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.851+0000 7f0255800700 1 -- start start 2024-01-22T05:17:27.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.851+0000 7f0255800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0250062930 0x7f0250153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.851+0000 7f0255800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0250062dc0 0x7f0250144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.851+0000 7f0255800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0250063860 0x7f0250152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.851+0000 7f0255800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0250154370 con 0x7f0250063860 2024-01-22T05:17:27.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.851+0000 7f0255800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02500abe30 con 0x7f0250062dc0 2024-01-22T05:17:27.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.851+0000 7f0255800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02500ab220 con 0x7f0250062930 2024-01-22T05:17:27.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f024f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0250063860 0x7f0250152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f024f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0250063860 0x7f0250152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53700/0 (socket says 172.21.15.49:53700) 2024-01-22T05:17:27.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f024f400700 1 -- 172.21.15.49:0/1435080546 learned_addr learned my addr 172.21.15.49:0/1435080546 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:27.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f024e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0250062dc0 0x7f0250144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f024ea00700 1 --2- 172.21.15.49:0/1435080546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0250062930 0x7f0250153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f024f400700 1 -- 172.21.15.49:0/1435080546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0250062930 msgr2=0x7f0250153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f024f400700 1 --2- 172.21.15.49:0/1435080546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0250062930 0x7f0250153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f024f400700 1 -- 172.21.15.49:0/1435080546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0250062dc0 msgr2=0x7f0250144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:27.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f024f400700 1 --2- 172.21.15.49:0/1435080546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0250062dc0 0x7f0250144a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:27.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f024f400700 1 -- 172.21.15.49:0/1435080546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0240009370 con 0x7f0250063860 2024-01-22T05:17:27.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f024f400700 1 --2- 172.21.15.49:0/1435080546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0250063860 0x7f0250152410 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f024800d180 tx=0x7f0248009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:27.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f0246000700 1 -- 172.21.15.49:0/1435080546 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024800dcc0 con 0x7f0250063860 2024-01-22T05:17:27.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f0246000700 1 -- 172.21.15.49:0/1435080546 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024800f040 con 0x7f0250063860 2024-01-22T05:17:27.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f0246000700 1 -- 172.21.15.49:0/1435080546 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0248013600 con 0x7f0250063860 2024-01-22T05:17:27.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f0255800700 1 -- 172.21.15.49:0/1435080546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02500ab500 con 0x7f0250063860 2024-01-22T05:17:27.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.855+0000 7f0255800700 1 -- 172.21.15.49:0/1435080546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02500abac0 con 0x7f0250063860 2024-01-22T05:17:27.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.859+0000 7f0255800700 1 -- 172.21.15.49:0/1435080546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02500abfa0 con 0x7f0250063860 2024-01-22T05:17:27.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.859+0000 7f0246000700 1 -- 172.21.15.49:0/1435080546 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f02480139f0 con 0x7f0250063860 2024-01-22T05:17:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.859+0000 7f0246000700 1 --2- 172.21.15.49:0/1435080546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f022805a510 0x7f022805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.859+0000 7f0246000700 1 -- 172.21.15.49:0/1435080546 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f02480750a0 con 0x7f0250063860 2024-01-22T05:17:27.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.859+0000 7f024ea00700 1 --2- 172.21.15.49:0/1435080546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f022805a510 0x7f022805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:27.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.859+0000 7f024ea00700 1 --2- 172.21.15.49:0/1435080546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f022805a510 0x7f022805c9d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f0240009130 tx=0x7f0240017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:27.867+0000 7f0246000700 1 -- 172.21.15.49:0/1435080546 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0248048590 con 0x7f0250063860 2024-01-22T05:17:28.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.027+0000 7f0255800700 1 -- 172.21.15.49:0/1435080546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f02500c1f70 con 0x7f0250063860 2024-01-22T05:17:28.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.031+0000 7f0246000700 1 -- 172.21.15.49:0/1435080546 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v148) v1 ==== 92+0+10 (secure 0 0 0) 0x7f024804bbb0 con 0x7f0250063860 2024-01-22T05:17:28.031 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:17:28.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.031+0000 7f0255800700 1 -- 172.21.15.49:0/1435080546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f022805a510 msgr2=0x7f022805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:28.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.031+0000 7f0255800700 1 --2- 172.21.15.49:0/1435080546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f022805a510 0x7f022805c9d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f0240009130 tx=0x7f0240017000).stop 2024-01-22T05:17:28.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.031+0000 7f0255800700 1 -- 172.21.15.49:0/1435080546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0250063860 msgr2=0x7f0250152410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:28.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.031+0000 7f0255800700 1 --2- 172.21.15.49:0/1435080546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0250063860 0x7f0250152410 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f024800d180 tx=0x7f0248009a50).stop 2024-01-22T05:17:28.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.031+0000 7f0255800700 1 -- 172.21.15.49:0/1435080546 shutdown_connections 2024-01-22T05:17:28.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.031+0000 7f0255800700 1 --2- 172.21.15.49:0/1435080546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f022805a510 0x7f022805c9d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.031+0000 7f0255800700 1 --2- 172.21.15.49:0/1435080546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0250063860 0x7f0250152410 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.031+0000 7f0255800700 1 --2- 172.21.15.49:0/1435080546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0250062dc0 0x7f0250144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.031+0000 7f0255800700 1 --2- 172.21.15.49:0/1435080546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0250062930 0x7f0250153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.031+0000 7f0255800700 1 -- 172.21.15.49:0/1435080546 >> 172.21.15.49:0/1435080546 conn(0x7f02500c3940 msgr2=0x7f02500bcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:28.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.035+0000 7f0255800700 1 -- 172.21.15.49:0/1435080546 shutdown_connections 2024-01-22T05:17:28.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.035+0000 7f0255800700 1 -- 172.21.15.49:0/1435080546 wait complete. 2024-01-22T05:17:28.056 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:17:28.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.215+0000 7f5dcca00700 1 Processor -- start 2024-01-22T05:17:28.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.215+0000 7f5dcca00700 1 -- start start 2024-01-22T05:17:28.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.219+0000 7f5dcca00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5dc8153820 0x7f5dc80c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:28.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.219+0000 7f5dcca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc8153c00 0x7f5dc80c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:28.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.219+0000 7f5dcca00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc8063430 con 0x7f5dc80c5090 2024-01-22T05:17:28.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.219+0000 7f5dcca00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc8062540 con 0x7f5dc8153820 2024-01-22T05:17:28.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.219+0000 7f5dcca00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc8062820 con 0x7f5dc8153c00 2024-01-22T05:17:28.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dc6a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc8153c00 0x7f5dc80c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:28.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dc7e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5dc80c5090 0x7f5dc8067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:45958/0 (socket says 172.21.15.49:45958) 2024-01-22T05:17:28.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dc7e00700 1 -- 172.21.15.49:0/4158627967 learned_addr learned my addr 172.21.15.49:0/4158627967 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:28.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dc7400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5dc8153820 0x7f5dc80c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:28.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dc6000700 1 -- 172.21.15.49:0/4158627967 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654407695 0 0) 0x7f5dc8063430 con 0x7f5dc80c5090 2024-01-22T05:17:28.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dc6000700 1 -- 172.21.15.49:0/4158627967 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5da80033f0 con 0x7f5dc80c5090 2024-01-22T05:17:28.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dc7400700 1 -- 172.21.15.49:0/4158627967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc8153c00 msgr2=0x7f5dc80c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:28.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dc7400700 1 --2- 172.21.15.49:0/4158627967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc8153c00 0x7f5dc80c2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dc7400700 1 -- 172.21.15.49:0/4158627967 >> v1:172.21.15.110:6789/0 conn(0x7f5dc80c5090 legacy=0x7f5dc8067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:28.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dc7400700 1 -- 172.21.15.49:0/4158627967 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc8062b00 con 0x7f5dc8153820 2024-01-22T05:17:28.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dc7400700 1 --2- 172.21.15.49:0/4158627967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dc8153820 0x7f5dc80c2a40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f5db8009760 tx=0x7f5db8009060).ready entity=mon.1 client_cookie=6856972df865f091 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dc6000700 1 -- 172.21.15.49:0/4158627967 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800d4a0 con 0x7f5dc8153820 2024-01-22T05:17:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dc6000700 1 -- 172.21.15.49:0/4158627967 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db800d600 con 0x7f5dc8153820 2024-01-22T05:17:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dc6000700 1 -- 172.21.15.49:0/4158627967 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800d980 con 0x7f5dc8153820 2024-01-22T05:17:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dcca00700 1 -- 172.21.15.49:0/4158627967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dc8153820 msgr2=0x7f5dc80c2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dcca00700 1 --2- 172.21.15.49:0/4158627967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dc8153820 0x7f5dc80c2a40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f5db8009760 tx=0x7f5db8009060).stop 2024-01-22T05:17:28.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dcca00700 1 -- 172.21.15.49:0/4158627967 shutdown_connections 2024-01-22T05:17:28.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dcca00700 1 --2- 172.21.15.49:0/4158627967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc8153c00 0x7f5dc80c2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dcca00700 1 --2- 172.21.15.49:0/4158627967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dc8153820 0x7f5dc80c2a40 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dcca00700 1 -- 172.21.15.49:0/4158627967 >> 172.21.15.49:0/4158627967 conn(0x7f5dc80c3880 msgr2=0x7f5dc80c3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:28.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.223+0000 7f5dcca00700 1 -- 172.21.15.49:0/4158627967 shutdown_connections 2024-01-22T05:17:28.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.227+0000 7f5dcca00700 1 -- 172.21.15.49:0/4158627967 wait complete. 2024-01-22T05:17:28.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.227+0000 7f5dcca00700 1 Processor -- start 2024-01-22T05:17:28.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.227+0000 7f5dcca00700 1 -- start start 2024-01-22T05:17:28.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dcca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc80c5090 0x7f5dc8151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:28.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dcca00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dc8153820 0x7f5dc81642e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:28.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dcca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dc8153c00 0x7f5dc81647d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:28.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dcca00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc80bebb0 con 0x7f5dc8153c00 2024-01-22T05:17:28.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dcca00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc80bdfa0 con 0x7f5dc8153820 2024-01-22T05:17:28.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dcca00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc80be280 con 0x7f5dc80c5090 2024-01-22T05:17:28.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dc7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dc8153c00 0x7f5dc81647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:28.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dc7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dc8153c00 0x7f5dc81647d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53712/0 (socket says 172.21.15.49:53712) 2024-01-22T05:17:28.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dc7e00700 1 -- 172.21.15.49:0/884907286 learned_addr learned my addr 172.21.15.49:0/884907286 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:28.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dc6a00700 1 --2- 172.21.15.49:0/884907286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dc8153820 0x7f5dc81642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:28.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dc7400700 1 --2- 172.21.15.49:0/884907286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc80c5090 0x7f5dc8151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:28.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dc7e00700 1 -- 172.21.15.49:0/884907286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc80c5090 msgr2=0x7f5dc8151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:28.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dc7e00700 1 --2- 172.21.15.49:0/884907286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc80c5090 0x7f5dc8151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dc7e00700 1 -- 172.21.15.49:0/884907286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dc8153820 msgr2=0x7f5dc81642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:28.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dc7e00700 1 --2- 172.21.15.49:0/884907286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dc8153820 0x7f5dc81642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dc7e00700 1 -- 172.21.15.49:0/884907286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db80092a0 con 0x7f5dc8153c00 2024-01-22T05:17:28.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dc7e00700 1 --2- 172.21.15.49:0/884907286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dc8153c00 0x7f5dc81647d0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f5dc0005ad0 tx=0x7f5dc0001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:28.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dbea00700 1 -- 172.21.15.49:0/884907286 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0005d30 con 0x7f5dc8153c00 2024-01-22T05:17:28.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dbea00700 1 -- 172.21.15.49:0/884907286 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc0005e90 con 0x7f5dc8153c00 2024-01-22T05:17:28.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dcca00700 1 -- 172.21.15.49:0/884907286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc80be560 con 0x7f5dc8153c00 2024-01-22T05:17:28.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dbea00700 1 -- 172.21.15.49:0/884907286 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0007320 con 0x7f5dc8153c00 2024-01-22T05:17:28.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.231+0000 7f5dcca00700 1 -- 172.21.15.49:0/884907286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc81518f0 con 0x7f5dc8153c00 2024-01-22T05:17:28.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.235+0000 7f5dcca00700 1 -- 172.21.15.49:0/884907286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc80bed60 con 0x7f5dc8153c00 2024-01-22T05:17:28.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.235+0000 7f5dbea00700 1 -- 172.21.15.49:0/884907286 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5dc0007710 con 0x7f5dc8153c00 2024-01-22T05:17:28.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.239+0000 7f5dbea00700 1 --2- 172.21.15.49:0/884907286 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5da005a510 0x7f5da005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:28.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.239+0000 7f5dbea00700 1 -- 172.21.15.49:0/884907286 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f5dc00749f0 con 0x7f5dc8153c00 2024-01-22T05:17:28.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.239+0000 7f5dc7400700 1 --2- 172.21.15.49:0/884907286 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5da005a510 0x7f5da005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:28.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.239+0000 7f5dc7400700 1 --2- 172.21.15.49:0/884907286 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5da005a510 0x7f5da005c9d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f5db800d260 tx=0x7f5db8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:28.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.243+0000 7f5dbea00700 1 -- 172.21.15.49:0/884907286 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5dc80bed60 con 0x7f5dc8153c00 2024-01-22T05:17:28.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.411+0000 7f5dcca00700 1 -- 172.21.15.49:0/884907286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5dc80becf0 con 0x7f5dc8153c00 2024-01-22T05:17:28.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.411+0000 7f5dbea00700 1 -- 172.21.15.49:0/884907286 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v148) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5dc0047ee0 con 0x7f5dc8153c00 2024-01-22T05:17:28.413 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:17:28.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.415+0000 7f5dcca00700 1 -- 172.21.15.49:0/884907286 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5da005a510 msgr2=0x7f5da005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:28.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.415+0000 7f5dcca00700 1 --2- 172.21.15.49:0/884907286 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5da005a510 0x7f5da005c9d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f5db800d260 tx=0x7f5db8016000).stop 2024-01-22T05:17:28.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.415+0000 7f5dcca00700 1 -- 172.21.15.49:0/884907286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dc8153c00 msgr2=0x7f5dc81647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.415+0000 7f5dcca00700 1 --2- 172.21.15.49:0/884907286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dc8153c00 0x7f5dc81647d0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f5dc0005ad0 tx=0x7f5dc0001650).stop 2024-01-22T05:17:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.415+0000 7f5dcca00700 1 -- 172.21.15.49:0/884907286 shutdown_connections 2024-01-22T05:17:28.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.415+0000 7f5dcca00700 1 --2- 172.21.15.49:0/884907286 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5da005a510 0x7f5da005c9d0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.415+0000 7f5dcca00700 1 --2- 172.21.15.49:0/884907286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dc8153c00 0x7f5dc81647d0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.415+0000 7f5dcca00700 1 --2- 172.21.15.49:0/884907286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dc8153820 0x7f5dc81642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.415+0000 7f5dcca00700 1 --2- 172.21.15.49:0/884907286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc80c5090 0x7f5dc8151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.415+0000 7f5dcca00700 1 -- 172.21.15.49:0/884907286 >> 172.21.15.49:0/884907286 conn(0x7f5dc80c3880 msgr2=0x7f5dc80ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:28.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.419+0000 7f5dcca00700 1 -- 172.21.15.49:0/884907286 shutdown_connections 2024-01-22T05:17:28.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.419+0000 7f5dcca00700 1 -- 172.21.15.49:0/884907286 wait complete. 2024-01-22T05:17:28.441 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:17:28.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.603+0000 7fbbe9e00700 1 Processor -- start 2024-01-22T05:17:28.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.603+0000 7fbbe9e00700 1 -- start start 2024-01-22T05:17:28.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe9e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbe40bcba0 0x7fbbe4068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:28.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe9e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe4068280 con 0x7fbbe40c1ce0 2024-01-22T05:17:28.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe9e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe40bd190 con 0x7fbbe4153cf0 2024-01-22T05:17:28.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe9e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4067c30 con 0x7fbbe40bcba0 2024-01-22T05:17:28.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe2000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbbe40c1ce0 0x7fbbe40bc490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54442/0 (socket says 172.21.15.49:54442) 2024-01-22T05:17:28.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe2000700 1 -- 172.21.15.49:0/4074489965 learned_addr learned my addr 172.21.15.49:0/4074489965 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:28.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe3400700 1 --2- 172.21.15.49:0/4074489965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbe40bcba0 0x7fbbe4068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:28.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318050686 0 0) 0x7fbbe4068280 con 0x7fbbe40c1ce0 2024-01-22T05:17:28.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc40033f0 con 0x7fbbe40c1ce0 2024-01-22T05:17:28.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081592980 0 0) 0x7fbbe40bd190 con 0x7fbbe4153cf0 2024-01-22T05:17:28.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbe4068280 con 0x7fbbe4153cf0 2024-01-22T05:17:28.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 665220904 0 0) 0x7fbbc40033f0 con 0x7fbbe40c1ce0 2024-01-22T05:17:28.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbe40bcba0 msgr2=0x7fbbe4068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:28.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 --2- 172.21.15.49:0/4074489965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbe40bcba0 0x7fbbe4068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 >> v1:172.21.15.110:6789/0 conn(0x7fbbe4153cf0 legacy=0x7fbbe40c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe4067f10 con 0x7fbbe40c1ce0 2024-01-22T05:17:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fbbcc0015f0 con 0x7fbbe40c1ce0 2024-01-22T05:17:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 >> v1:172.21.15.49:6789/0 conn(0x7fbbe40c1ce0 legacy=0x7fbbe40bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 --2- 172.21.15.49:0/4074489965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc4003aa0 0x7fbbc4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 --2- 172.21.15.49:0/4074489965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbe40bcba0 0x7fbbc4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 --2- 172.21.15.49:0/4074489965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbc4004b80 0x7fbbc4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4067c30 con 0x7fbbc4003aa0 2024-01-22T05:17:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc400b910 con 0x7fbbc4004b80 2024-01-22T05:17:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc400bad0 con 0x7fbbe40bcba0 2024-01-22T05:17:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.607+0000 7fbbe2a00700 1 --2- 172.21.15.49:0/4074489965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc4003aa0 0x7fbbc4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe3400700 1 --2- 172.21.15.49:0/4074489965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbc4004b80 0x7fbbc4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe2000700 1 --2- 172.21.15.49:0/4074489965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbe40bcba0 0x7fbbc4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:28.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe2a00700 1 -- 172.21.15.49:0/4074489965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbe40bcba0 msgr2=0x7fbbc4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:28.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe2a00700 1 --2- 172.21.15.49:0/4074489965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbe40bcba0 0x7fbbc4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe2a00700 1 -- 172.21.15.49:0/4074489965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbc4004b80 msgr2=0x7fbbc4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:28.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe2a00700 1 --2- 172.21.15.49:0/4074489965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbc4004b80 0x7fbbc4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe2a00700 1 -- 172.21.15.49:0/4074489965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc40033f0 con 0x7fbbc4003aa0 2024-01-22T05:17:28.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe2a00700 1 --2- 172.21.15.49:0/4074489965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc4003aa0 0x7fbbc4003ea0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7fbbd4001890 tx=0x7fbbd4007bb0).ready entity=mon.0 client_cookie=399d0743821c6268 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:28.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4007020 con 0x7fbbc4003aa0 2024-01-22T05:17:28.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd4007180 con 0x7fbbc4003aa0 2024-01-22T05:17:28.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe1600700 1 -- 172.21.15.49:0/4074489965 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4007500 con 0x7fbbc4003aa0 2024-01-22T05:17:28.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe9e00700 1 -- 172.21.15.49:0/4074489965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc4003aa0 msgr2=0x7fbbc4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:28.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe9e00700 1 --2- 172.21.15.49:0/4074489965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbc4003aa0 0x7fbbc4003ea0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7fbbd4001890 tx=0x7fbbd4007bb0).stop 2024-01-22T05:17:28.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe3400700 1 -- 172.21.15.49:0/4074489965 reap_dead start 2024-01-22T05:17:28.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe9e00700 1 -- 172.21.15.49:0/4074489965 shutdown_connections 2024-01-22T05:17:28.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe9e00700 1 -- 172.21.15.49:0/4074489965 >> 172.21.15.49:0/4074489965 conn(0x7fbbe4062cb0 msgr2=0x7fbbe40c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:28.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe9e00700 1 -- 172.21.15.49:0/4074489965 shutdown_connections 2024-01-22T05:17:28.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.611+0000 7fbbe9e00700 1 -- 172.21.15.49:0/4074489965 wait complete. 2024-01-22T05:17:28.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.615+0000 7fbbe9e00700 1 Processor -- start 2024-01-22T05:17:28.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.615+0000 7fbbe9e00700 1 -- start start 2024-01-22T05:17:28.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.615+0000 7fbbe9e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbc4003aa0 0x7fbbe4166b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:28.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.615+0000 7fbbe9e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbe41483a0 0x7fbbe4164f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:28.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.615+0000 7fbbe9e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbe4165400 0x7fbbe40a76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:28.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.615+0000 7fbbe9e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4165880 con 0x7fbbe4165400 2024-01-22T05:17:28.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.615+0000 7fbbe9e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4166690 con 0x7fbbe41483a0 2024-01-22T05:17:28.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.615+0000 7fbbe9e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40c0490 con 0x7fbbc4003aa0 2024-01-22T05:17:28.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbe3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbe4165400 0x7fbbe40a76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:28.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbe2a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbc4003aa0 0x7fbbe4166b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:28.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbe3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbe4165400 0x7fbbe40a76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53728/0 (socket says 172.21.15.49:53728) 2024-01-22T05:17:28.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbe3400700 1 -- 172.21.15.49:0/2589393153 learned_addr learned my addr 172.21.15.49:0/2589393153 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:28.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbe2000700 1 --2- 172.21.15.49:0/2589393153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbe41483a0 0x7fbbe4164f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:28.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbe3400700 1 -- 172.21.15.49:0/2589393153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbc4003aa0 msgr2=0x7fbbe4166b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:28.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbe3400700 1 --2- 172.21.15.49:0/2589393153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbc4003aa0 0x7fbbe4166b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbe3400700 1 -- 172.21.15.49:0/2589393153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbe41483a0 msgr2=0x7fbbe4164f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:28.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbe3400700 1 --2- 172.21.15.49:0/2589393153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbe41483a0 0x7fbbe4164f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbe3400700 1 -- 172.21.15.49:0/2589393153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe4165a80 con 0x7fbbe4165400 2024-01-22T05:17:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbe3400700 1 --2- 172.21.15.49:0/2589393153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbe4165400 0x7fbbe40a76d0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7fbbdc0094d0 tx=0x7fbbdc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbda000700 1 -- 172.21.15.49:0/2589393153 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc00e040 con 0x7fbbe4165400 2024-01-22T05:17:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbda000700 1 -- 172.21.15.49:0/2589393153 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc00f040 con 0x7fbbe4165400 2024-01-22T05:17:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbe9e00700 1 -- 172.21.15.49:0/2589393153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe4165d60 con 0x7fbbe4165400 2024-01-22T05:17:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbda000700 1 -- 172.21.15.49:0/2589393153 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc00fda0 con 0x7fbbe4165400 2024-01-22T05:17:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbe9e00700 1 -- 172.21.15.49:0/2589393153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe4166320 con 0x7fbbe4165400 2024-01-22T05:17:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.619+0000 7fbbe9e00700 1 -- 172.21.15.49:0/2589393153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe4166820 con 0x7fbbe4165400 2024-01-22T05:17:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.623+0000 7fbbda000700 1 -- 172.21.15.49:0/2589393153 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbbdc015660 con 0x7fbbe4165400 2024-01-22T05:17:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.623+0000 7fbbda000700 1 --2- 172.21.15.49:0/2589393153 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbbc05a510 0x7fbbbc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.623+0000 7fbbda000700 1 -- 172.21.15.49:0/2589393153 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6589+0+0 (secure 0 0 0) 0x7fbbdc075470 con 0x7fbbe4165400 2024-01-22T05:17:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.623+0000 7fbbe2a00700 1 --2- 172.21.15.49:0/2589393153 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbbc05a510 0x7fbbbc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.623+0000 7fbbe2a00700 1 --2- 172.21.15.49:0/2589393153 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbbc05a510 0x7fbbbc05c9d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fbbd4001890 tx=0x7fbbd4016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:28.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.627+0000 7fbbda000700 1 -- 172.21.15.49:0/2589393153 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbbdc048960 con 0x7fbbe4165400 2024-01-22T05:17:28.892 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:17:28.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.879+0000 7fbbe9e00700 1 -- 172.21.15.49:0/2589393153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbbe40a99d0 con 0x7fbbe4165400 2024-01-22T05:17:28.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.883+0000 7fbbda000700 1 -- 172.21.15.49:0/2589393153 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v148) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbbdc04bf80 con 0x7fbbe4165400 2024-01-22T05:17:28.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.903+0000 7fbbe9e00700 1 -- 172.21.15.49:0/2589393153 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbbc05a510 msgr2=0x7fbbbc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:28.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.903+0000 7fbbe9e00700 1 --2- 172.21.15.49:0/2589393153 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbbc05a510 0x7fbbbc05c9d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fbbd4001890 tx=0x7fbbd4016000).stop 2024-01-22T05:17:28.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.903+0000 7fbbe9e00700 1 -- 172.21.15.49:0/2589393153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbe4165400 msgr2=0x7fbbe40a76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:28.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.903+0000 7fbbe9e00700 1 --2- 172.21.15.49:0/2589393153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbe4165400 0x7fbbe40a76d0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7fbbdc0094d0 tx=0x7fbbdc00b040).stop 2024-01-22T05:17:28.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.903+0000 7fbbe9e00700 1 -- 172.21.15.49:0/2589393153 shutdown_connections 2024-01-22T05:17:28.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.903+0000 7fbbe9e00700 1 --2- 172.21.15.49:0/2589393153 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbbbc05a510 0x7fbbbc05c9d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.903+0000 7fbbe9e00700 1 --2- 172.21.15.49:0/2589393153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbe4165400 0x7fbbe40a76d0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.903+0000 7fbbe9e00700 1 --2- 172.21.15.49:0/2589393153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbe41483a0 0x7fbbe4164f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.903+0000 7fbbe9e00700 1 --2- 172.21.15.49:0/2589393153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbc4003aa0 0x7fbbe4166b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:28.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.903+0000 7fbbe9e00700 1 -- 172.21.15.49:0/2589393153 >> 172.21.15.49:0/2589393153 conn(0x7fbbe4062cb0 msgr2=0x7fbbe40a9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:28.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.907+0000 7fbbe9e00700 1 -- 172.21.15.49:0/2589393153 shutdown_connections 2024-01-22T05:17:28.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:28.907+0000 7fbbe9e00700 1 -- 172.21.15.49:0/2589393153 wait complete. 2024-01-22T05:17:28.934 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:17:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.083+0000 7ff3b9600700 1 Processor -- start 2024-01-22T05:17:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.083+0000 7ff3b9600700 1 -- start start 2024-01-22T05:17:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b9600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff3b4065660 0x7ff3b40a6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b9600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3b4064950 0x7ff3b4157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b9600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b40c2700 con 0x7ff3b40644f0 2024-01-22T05:17:29.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b9600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b40bdc90 con 0x7ff3b4065660 2024-01-22T05:17:29.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b9600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b40c2930 con 0x7ff3b4064950 2024-01-22T05:17:29.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b2a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff3b4065660 0x7ff3b40a6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b2a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff3b4065660 0x7ff3b40a6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53732/0 (socket says 172.21.15.49:53732) 2024-01-22T05:17:29.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b2a00700 1 -- 172.21.15.49:0/3593796572 learned_addr learned my addr 172.21.15.49:0/3593796572 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:29.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b3e00700 1 --2- 172.21.15.49:0/3593796572 >> v2:172.21.15.110:3300/0 conn(0x7ff3b4064950 0x7ff3b4157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b2a00700 1 -- 172.21.15.49:0/3593796572 >> v2:172.21.15.110:3300/0 conn(0x7ff3b4064950 msgr2=0x7ff3b4157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:29.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b2a00700 1 --2- 172.21.15.49:0/3593796572 >> v2:172.21.15.110:3300/0 conn(0x7ff3b4064950 0x7ff3b4157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b2a00700 1 -- 172.21.15.49:0/3593796572 >> v1:172.21.15.110:6789/0 conn(0x7ff3b40644f0 legacy=0x7ff3b41575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:29.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b2a00700 1 -- 172.21.15.49:0/3593796572 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b40c2c10 con 0x7ff3b4065660 2024-01-22T05:17:29.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b2a00700 1 --2- 172.21.15.49:0/3593796572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b4065660 0x7ff3b40a6f40 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7ff3b40aaa50 tx=0x7ff3a40090f0).ready entity=mon.0 client_cookie=88fd71c9ca7f58ce server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:29.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b1600700 1 -- 172.21.15.49:0/3593796572 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a400b600 con 0x7ff3b4065660 2024-01-22T05:17:29.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b1600700 1 -- 172.21.15.49:0/3593796572 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a400b760 con 0x7ff3b4065660 2024-01-22T05:17:29.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.087+0000 7ff3b1600700 1 -- 172.21.15.49:0/3593796572 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a400bae0 con 0x7ff3b4065660 2024-01-22T05:17:29.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.091+0000 7ff3b9600700 1 -- 172.21.15.49:0/3593796572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b4065660 msgr2=0x7ff3b40a6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:29.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.091+0000 7ff3b9600700 1 --2- 172.21.15.49:0/3593796572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b4065660 0x7ff3b40a6f40 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7ff3b40aaa50 tx=0x7ff3a40090f0).stop 2024-01-22T05:17:29.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.091+0000 7ff3b9600700 1 -- 172.21.15.49:0/3593796572 shutdown_connections 2024-01-22T05:17:29.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.091+0000 7ff3b9600700 1 --2- 172.21.15.49:0/3593796572 >> v2:172.21.15.110:3300/0 conn(0x7ff3b4064950 0x7ff3b4157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.091+0000 7ff3b9600700 1 --2- 172.21.15.49:0/3593796572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b4065660 0x7ff3b40a6f40 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.091+0000 7ff3b9600700 1 -- 172.21.15.49:0/3593796572 >> 172.21.15.49:0/3593796572 conn(0x7ff3b40c87f0 msgr2=0x7ff3b40c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:29.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.091+0000 7ff3b9600700 1 -- 172.21.15.49:0/3593796572 shutdown_connections 2024-01-22T05:17:29.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.091+0000 7ff3b9600700 1 -- 172.21.15.49:0/3593796572 wait complete. 2024-01-22T05:17:29.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.095+0000 7ff3b9600700 1 Processor -- start 2024-01-22T05:17:29.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.095+0000 7ff3b9600700 1 -- start start 2024-01-22T05:17:29.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.095+0000 7ff3b9600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3b40644f0 0x7ff3b40c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.095+0000 7ff3b9600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b4064950 0x7ff3b4144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.095+0000 7ff3b9600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3b4065660 0x7ff3b40a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.095+0000 7ff3b9600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b40ad860 con 0x7ff3b4064950 2024-01-22T05:17:29.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.095+0000 7ff3b9600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b40acc90 con 0x7ff3b40644f0 2024-01-22T05:17:29.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.095+0000 7ff3b9600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b40acf30 con 0x7ff3b4065660 2024-01-22T05:17:29.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3b2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b4064950 0x7ff3b4144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3b2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b4064950 0x7ff3b4144740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53740/0 (socket says 172.21.15.49:53740) 2024-01-22T05:17:29.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3b2000700 1 -- 172.21.15.49:0/1288019409 learned_addr learned my addr 172.21.15.49:0/1288019409 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:29.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3b3e00700 1 --2- 172.21.15.49:0/1288019409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3b4065660 0x7ff3b40a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3b2a00700 1 --2- 172.21.15.49:0/1288019409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3b40644f0 0x7ff3b40c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3b2000700 1 -- 172.21.15.49:0/1288019409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3b4065660 msgr2=0x7ff3b40a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3b2000700 1 --2- 172.21.15.49:0/1288019409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3b4065660 0x7ff3b40a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3b2000700 1 -- 172.21.15.49:0/1288019409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3b40644f0 msgr2=0x7ff3b40c19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3b2000700 1 --2- 172.21.15.49:0/1288019409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3b40644f0 0x7ff3b40c19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3b2000700 1 -- 172.21.15.49:0/1288019409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a4009370 con 0x7ff3b4064950 2024-01-22T05:17:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3b2000700 1 --2- 172.21.15.49:0/1288019409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b4064950 0x7ff3b4144740 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7ff39c00c4c0 tx=0x7ff39c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3aa000700 1 -- 172.21.15.49:0/1288019409 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c00ce70 con 0x7ff3b4064950 2024-01-22T05:17:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3aa000700 1 -- 172.21.15.49:0/1288019409 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39c001e90 con 0x7ff3b4064950 2024-01-22T05:17:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3b9600700 1 -- 172.21.15.49:0/1288019409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b40ad210 con 0x7ff3b4064950 2024-01-22T05:17:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3aa000700 1 -- 172.21.15.49:0/1288019409 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c007250 con 0x7ff3b4064950 2024-01-22T05:17:29.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.099+0000 7ff3b9600700 1 -- 172.21.15.49:0/1288019409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b40adcf0 con 0x7ff3b4064950 2024-01-22T05:17:29.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.103+0000 7ff3b9600700 1 -- 172.21.15.49:0/1288019409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b40ada10 con 0x7ff3b4064950 2024-01-22T05:17:29.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.103+0000 7ff3aa000700 1 -- 172.21.15.49:0/1288019409 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff39c0066a0 con 0x7ff3b4064950 2024-01-22T05:17:29.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.103+0000 7ff3aa000700 1 --2- 172.21.15.49:0/1288019409 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff38c05a510 0x7ff38c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.103+0000 7ff3aa000700 1 -- 172.21.15.49:0/1288019409 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6589+0+0 (secure 0 0 0) 0x7ff39c0742a0 con 0x7ff3b4064950 2024-01-22T05:17:29.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.103+0000 7ff3b2a00700 1 --2- 172.21.15.49:0/1288019409 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff38c05a510 0x7ff38c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.107+0000 7ff3b2a00700 1 --2- 172.21.15.49:0/1288019409 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff38c05a510 0x7ff38c05c9d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7ff3a4009130 tx=0x7ff3a4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:29.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.111+0000 7ff3aa000700 1 -- 172.21.15.49:0/1288019409 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff3b40ada10 con 0x7ff3b4064950 2024-01-22T05:17:29.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.307+0000 7ff3b9600700 1 -- 172.21.15.49:0/1288019409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3b4047060 con 0x7ff3b4064950 2024-01-22T05:17:29.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.307+0000 7ff3aa000700 1 -- 172.21.15.49:0/1288019409 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+3745 (secure 0 0 0) 0x7ff39c0478b0 con 0x7ff3b4064950 2024-01-22T05:17:29.308 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:29.308 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":118,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:17:24.473420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":148,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8826":{"gid":8826,"name":"c","rank":0,"incarnation":115,"state":"up:active","state_seq":22,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:17:29.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.311+0000 7ff3b9600700 1 -- 172.21.15.49:0/1288019409 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff38c05a510 msgr2=0x7ff38c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:29.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.311+0000 7ff3b9600700 1 --2- 172.21.15.49:0/1288019409 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff38c05a510 0x7ff38c05c9d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7ff3a4009130 tx=0x7ff3a4017000).stop 2024-01-22T05:17:29.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.311+0000 7ff3b9600700 1 -- 172.21.15.49:0/1288019409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b4064950 msgr2=0x7ff3b4144740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:29.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.311+0000 7ff3b9600700 1 --2- 172.21.15.49:0/1288019409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b4064950 0x7ff3b4144740 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7ff39c00c4c0 tx=0x7ff39c007e00).stop 2024-01-22T05:17:29.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.311+0000 7ff3b9600700 1 -- 172.21.15.49:0/1288019409 shutdown_connections 2024-01-22T05:17:29.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.311+0000 7ff3b9600700 1 --2- 172.21.15.49:0/1288019409 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff38c05a510 0x7ff38c05c9d0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.311+0000 7ff3b9600700 1 --2- 172.21.15.49:0/1288019409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3b4065660 0x7ff3b40a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.311+0000 7ff3b9600700 1 --2- 172.21.15.49:0/1288019409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b4064950 0x7ff3b4144740 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.311+0000 7ff3b9600700 1 --2- 172.21.15.49:0/1288019409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3b40644f0 0x7ff3b40c19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.311+0000 7ff3b9600700 1 -- 172.21.15.49:0/1288019409 >> 172.21.15.49:0/1288019409 conn(0x7ff3b40c87f0 msgr2=0x7ff3b4063a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:29.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.311+0000 7ff3b9600700 1 -- 172.21.15.49:0/1288019409 shutdown_connections 2024-01-22T05:17:29.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.311+0000 7ff3b9600700 1 -- 172.21.15.49:0/1288019409 wait complete. 2024-01-22T05:17:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 118 2024-01-22T05:17:29.335 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:17:29.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.499+0000 7f319bc00700 1 Processor -- start 2024-01-22T05:17:29.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.499+0000 7f319bc00700 1 -- start start 2024-01-22T05:17:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.503+0000 7f319bc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319406a1c0 0x7f31941508e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.503+0000 7f319bc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f31940a6720 0x7f3194063e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.503+0000 7f319bc00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31940c3dd0 con 0x7f3194064310 2024-01-22T05:17:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.503+0000 7f319bc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31940a6f00 con 0x7f31940a6720 2024-01-22T05:17:29.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.503+0000 7f319bc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3194150dd0 con 0x7f319406a1c0 2024-01-22T05:17:29.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.503+0000 7f3199200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319406a1c0 0x7f31941508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.503+0000 7f3193e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f31940a6720 0x7f3194063e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.503+0000 7f3193e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f31940a6720 0x7f3194063e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:34242/0 (socket says 172.21.15.49:34242) 2024-01-22T05:17:29.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.503+0000 7f3193e00700 1 -- 172.21.15.49:0/3583903736 learned_addr learned my addr 172.21.15.49:0/3583903736 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:29.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.503+0000 7f3199c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3194064310 0x7f3194154600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54444/0 (socket says 172.21.15.49:54444) 2024-01-22T05:17:29.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.503+0000 7f3199200700 1 -- 172.21.15.49:0/3583903736 >> v2:172.21.15.110:3300/0 conn(0x7f31940a6720 msgr2=0x7f3194063e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:29.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.503+0000 7f3199200700 1 --2- 172.21.15.49:0/3583903736 >> v2:172.21.15.110:3300/0 conn(0x7f31940a6720 0x7f3194063e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.503+0000 7f3199200700 1 -- 172.21.15.49:0/3583903736 >> v1:172.21.15.49:6789/0 conn(0x7f3194064310 legacy=0x7f3194154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:29.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.503+0000 7f3199200700 1 -- 172.21.15.49:0/3583903736 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31940647c0 con 0x7f319406a1c0 2024-01-22T05:17:29.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.503+0000 7f3199200700 1 --2- 172.21.15.49:0/3583903736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319406a1c0 0x7f31941508e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f3184009760 tx=0x7f3184009060).ready entity=mon.2 client_cookie=76af134ce57dbd3e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:29.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.507+0000 7f3193400700 1 -- 172.21.15.49:0/3583903736 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318400f510 con 0x7f319406a1c0 2024-01-22T05:17:29.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.507+0000 7f3193400700 1 -- 172.21.15.49:0/3583903736 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318400f670 con 0x7f319406a1c0 2024-01-22T05:17:29.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.507+0000 7f3193400700 1 -- 172.21.15.49:0/3583903736 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318400f9f0 con 0x7f319406a1c0 2024-01-22T05:17:29.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.507+0000 7f319bc00700 1 -- 172.21.15.49:0/3583903736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319406a1c0 msgr2=0x7f31941508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:29.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.507+0000 7f319bc00700 1 --2- 172.21.15.49:0/3583903736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319406a1c0 0x7f31941508e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f3184009760 tx=0x7f3184009060).stop 2024-01-22T05:17:29.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.507+0000 7f319bc00700 1 -- 172.21.15.49:0/3583903736 shutdown_connections 2024-01-22T05:17:29.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.507+0000 7f319bc00700 1 --2- 172.21.15.49:0/3583903736 >> v2:172.21.15.110:3300/0 conn(0x7f31940a6720 0x7f3194063e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.507+0000 7f319bc00700 1 --2- 172.21.15.49:0/3583903736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319406a1c0 0x7f31941508e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.507+0000 7f319bc00700 1 -- 172.21.15.49:0/3583903736 >> 172.21.15.49:0/3583903736 conn(0x7f3194066830 msgr2=0x7f3194066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:29.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.507+0000 7f319bc00700 1 -- 172.21.15.49:0/3583903736 shutdown_connections 2024-01-22T05:17:29.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.507+0000 7f319bc00700 1 -- 172.21.15.49:0/3583903736 wait complete. 2024-01-22T05:17:29.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.511+0000 7f319bc00700 1 Processor -- start 2024-01-22T05:17:29.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.511+0000 7f319bc00700 1 -- start start 2024-01-22T05:17:29.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f319bc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3194064310 0x7f319414a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f319bc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f319406a1c0 0x7f3194146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f319bc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31940a6720 0x7f3194146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f319bc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3194146a00 con 0x7f319406a1c0 2024-01-22T05:17:29.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f319bc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31940bf840 con 0x7f3194064310 2024-01-22T05:17:29.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f319bc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31940acc90 con 0x7f31940a6720 2024-01-22T05:17:29.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f3199200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3194064310 0x7f319414a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f3193e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f319406a1c0 0x7f3194146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f3199200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3194064310 0x7f319414a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:34246/0 (socket says 172.21.15.49:34246) 2024-01-22T05:17:29.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f3199200700 1 -- 172.21.15.49:0/4255390318 learned_addr learned my addr 172.21.15.49:0/4255390318 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:29.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f3199c00700 1 --2- 172.21.15.49:0/4255390318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31940a6720 0x7f3194146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f3199200700 1 -- 172.21.15.49:0/4255390318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31940a6720 msgr2=0x7f3194146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:29.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f3199200700 1 --2- 172.21.15.49:0/4255390318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31940a6720 0x7f3194146510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f3199200700 1 -- 172.21.15.49:0/4255390318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f319406a1c0 msgr2=0x7f3194146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:29.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f3199200700 1 --2- 172.21.15.49:0/4255390318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f319406a1c0 0x7f3194146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f3199200700 1 -- 172.21.15.49:0/4255390318 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31840092a0 con 0x7f3194064310 2024-01-22T05:17:29.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f3199200700 1 --2- 172.21.15.49:0/4255390318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3194064310 0x7f319414a360 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f3194150f10 tx=0x7f3184017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:29.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f318be00700 1 -- 172.21.15.49:0/4255390318 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318400f7e0 con 0x7f3194064310 2024-01-22T05:17:29.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f318be00700 1 -- 172.21.15.49:0/4255390318 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318400f940 con 0x7f3194064310 2024-01-22T05:17:29.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f318be00700 1 -- 172.21.15.49:0/4255390318 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318401b660 con 0x7f3194064310 2024-01-22T05:17:29.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.515+0000 7f319bc00700 1 -- 172.21.15.49:0/4255390318 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31940acf70 con 0x7f3194064310 2024-01-22T05:17:29.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.519+0000 7f319bc00700 1 -- 172.21.15.49:0/4255390318 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31940ad530 con 0x7f3194064310 2024-01-22T05:17:29.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.519+0000 7f319bc00700 1 -- 172.21.15.49:0/4255390318 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31940657b0 con 0x7f3194064310 2024-01-22T05:17:29.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.519+0000 7f318be00700 1 -- 172.21.15.49:0/4255390318 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f318401ba50 con 0x7f3194064310 2024-01-22T05:17:29.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.519+0000 7f318be00700 1 --2- 172.21.15.49:0/4255390318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f316c05a510 0x7f316c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.519+0000 7f318be00700 1 -- 172.21.15.49:0/4255390318 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f3184075f50 con 0x7f3194064310 2024-01-22T05:17:29.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.523+0000 7f3193e00700 1 --2- 172.21.15.49:0/4255390318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f316c05a510 0x7f316c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.523+0000 7f3193e00700 1 --2- 172.21.15.49:0/4255390318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f316c05a510 0x7f316c05c9d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f31941420e0 tx=0x7f317c0090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:29.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.531+0000 7f318be00700 1 -- 172.21.15.49:0/4255390318 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3184049560 con 0x7f3194064310 2024-01-22T05:17:29.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.703+0000 7f319bc00700 1 -- 172.21.15.49:0/4255390318 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31940647c0 con 0x7f3194064310 2024-01-22T05:17:29.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.703+0000 7f318be00700 1 -- 172.21.15.49:0/4255390318 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+17357 (secure 0 0 0) 0x7f31940647c0 con 0x7f3194064310 2024-01-22T05:17:29.707 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:29.707 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":148,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:17:21.374871+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:16:12.266975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-01-22T05:16:13.093952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.29","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6837/4015076184":"2024-01-23T05:17:21.374748+0000","172.21.15.49:6835/4015076184":"2024-01-23T05:17:21.374748+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:17:29.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.711+0000 7f319bc00700 1 -- 172.21.15.49:0/4255390318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f316c05a510 msgr2=0x7f316c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:29.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.711+0000 7f319bc00700 1 --2- 172.21.15.49:0/4255390318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f316c05a510 0x7f316c05c9d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f31941420e0 tx=0x7f317c0090f0).stop 2024-01-22T05:17:29.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.711+0000 7f319bc00700 1 -- 172.21.15.49:0/4255390318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3194064310 msgr2=0x7f319414a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:29.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.711+0000 7f319bc00700 1 --2- 172.21.15.49:0/4255390318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3194064310 0x7f319414a360 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f3194150f10 tx=0x7f3184017000).stop 2024-01-22T05:17:29.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.711+0000 7f319bc00700 1 -- 172.21.15.49:0/4255390318 shutdown_connections 2024-01-22T05:17:29.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.711+0000 7f319bc00700 1 --2- 172.21.15.49:0/4255390318 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f316c05a510 0x7f316c05c9d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.711+0000 7f319bc00700 1 --2- 172.21.15.49:0/4255390318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31940a6720 0x7f3194146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.711+0000 7f319bc00700 1 --2- 172.21.15.49:0/4255390318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f319406a1c0 0x7f3194146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.711+0000 7f319bc00700 1 --2- 172.21.15.49:0/4255390318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3194064310 0x7f319414a360 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.711+0000 7f319bc00700 1 -- 172.21.15.49:0/4255390318 >> 172.21.15.49:0/4255390318 conn(0x7f3194066830 msgr2=0x7f31940a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:29.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.711+0000 7f319bc00700 1 -- 172.21.15.49:0/4255390318 shutdown_connections 2024-01-22T05:17:29.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.711+0000 7f319bc00700 1 -- 172.21.15.49:0/4255390318 wait complete. 2024-01-22T05:17:29.733 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:17:29.733 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:17:29.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.891+0000 7fecd7800700 1 Processor -- start 2024-01-22T05:17:29.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd7800700 1 -- start start 2024-01-22T05:17:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd7800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fecd0065240 0x7fecd00644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd7800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecd0065620 0x7fecd00649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd7800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fecd015b9b0 0x7fecd015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd7800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd0064ed0 con 0x7fecd0065240 2024-01-22T05:17:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd7800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd00c2700 con 0x7fecd015b9b0 2024-01-22T05:17:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd7800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd00c29a0 con 0x7fecd0065620 2024-01-22T05:17:29.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd4e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fecd0065240 0x7fecd00644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd4e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fecd0065240 0x7fecd00644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53770/0 (socket says 172.21.15.49:53770) 2024-01-22T05:17:29.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd4e00700 1 -- 172.21.15.49:0/3353469338 learned_addr learned my addr 172.21.15.49:0/3353469338 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd4e00700 1 -- 172.21.15.49:0/3353469338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecd0065620 msgr2=0x7fecd00649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd4e00700 1 --2- 172.21.15.49:0/3353469338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecd0065620 0x7fecd00649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:17:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd4e00700 1 -- 172.21.15.49:0/3353469338 >> v2:172.21.15.110:3300/0 conn(0x7fecd015b9b0 msgr2=0x7fecd015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd4e00700 1 --2- 172.21.15.49:0/3353469338 >> v2:172.21.15.110:3300/0 conn(0x7fecd015b9b0 0x7fecd015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:17:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd4e00700 1 -- 172.21.15.49:0/3353469338 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd00c2c80 con 0x7fecd0065240 2024-01-22T05:17:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.895+0000 7fecd4e00700 1 --2- 172.21.15.49:0/3353469338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecd0065240 0x7fecd00644f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7fecd00665c0 tx=0x7fecc00090f0).ready entity=mon.0 client_cookie=49b9fc487bdd58ae server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:29.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.899+0000 7feccf400700 1 -- 172.21.15.49:0/3353469338 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc000b600 con 0x7fecd0065240 2024-01-22T05:17:29.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.899+0000 7feccf400700 1 -- 172.21.15.49:0/3353469338 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc000b760 con 0x7fecd0065240 2024-01-22T05:17:29.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.899+0000 7feccf400700 1 -- 172.21.15.49:0/3353469338 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc000bae0 con 0x7fecd0065240 2024-01-22T05:17:29.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.899+0000 7fecd7800700 1 -- 172.21.15.49:0/3353469338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecd0065240 msgr2=0x7fecd00644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:29.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.899+0000 7fecd7800700 1 --2- 172.21.15.49:0/3353469338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecd0065240 0x7fecd00644f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7fecd00665c0 tx=0x7fecc00090f0).stop 2024-01-22T05:17:29.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.899+0000 7fecd7800700 1 -- 172.21.15.49:0/3353469338 shutdown_connections 2024-01-22T05:17:29.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.899+0000 7fecd7800700 1 --2- 172.21.15.49:0/3353469338 >> v2:172.21.15.110:3300/0 conn(0x7fecd015b9b0 0x7fecd015be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:17:29.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.899+0000 7fecd7800700 1 --2- 172.21.15.49:0/3353469338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecd0065620 0x7fecd00649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:17:29.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.899+0000 7fecd7800700 1 --2- 172.21.15.49:0/3353469338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecd0065240 0x7fecd00644f0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.899+0000 7fecd7800700 1 -- 172.21.15.49:0/3353469338 >> 172.21.15.49:0/3353469338 conn(0x7fecd00c87f0 msgr2=0x7fecd00c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:29.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.899+0000 7fecd7800700 1 -- 172.21.15.49:0/3353469338 shutdown_connections 2024-01-22T05:17:29.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.899+0000 7fecd7800700 1 -- 172.21.15.49:0/3353469338 wait complete. 2024-01-22T05:17:29.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.903+0000 7fecd7800700 1 Processor -- start 2024-01-22T05:17:29.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.903+0000 7fecd7800700 1 -- start start 2024-01-22T05:17:29.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.903+0000 7fecd7800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecd0065240 0x7fecd00a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.903+0000 7fecd7800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecd0065620 0x7fecd0148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.903+0000 7fecd7800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecd015b9b0 0x7fecd0158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecd7800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd00c0e70 con 0x7fecd0065240 2024-01-22T05:17:29.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecd7800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd00c0260 con 0x7fecd015b9b0 2024-01-22T05:17:29.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecd7800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd00c0540 con 0x7fecd0065620 2024-01-22T05:17:29.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecd4e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecd0065240 0x7fecd00a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecd4e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecd0065240 0x7fecd00a9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53780/0 (socket says 172.21.15.49:53780) 2024-01-22T05:17:29.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecd4e00700 1 -- 172.21.15.49:0/2345559684 learned_addr learned my addr 172.21.15.49:0/2345559684 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:29.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecd6200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecd015b9b0 0x7fecd0158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7feccfe00700 1 --2- 172.21.15.49:0/2345559684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecd0065620 0x7fecd0148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecd4e00700 1 -- 172.21.15.49:0/2345559684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecd0065620 msgr2=0x7fecd0148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:29.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecd4e00700 1 --2- 172.21.15.49:0/2345559684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecd0065620 0x7fecd0148fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecd4e00700 1 -- 172.21.15.49:0/2345559684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecd015b9b0 msgr2=0x7fecd0158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:29.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecd4e00700 1 --2- 172.21.15.49:0/2345559684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecd015b9b0 0x7fecd0158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:29.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecd4e00700 1 -- 172.21.15.49:0/2345559684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc0009370 con 0x7fecd0065240 2024-01-22T05:17:29.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecd4e00700 1 --2- 172.21.15.49:0/2345559684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecd0065240 0x7fecd00a9f40 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7fecd0066be0 tx=0x7fecc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:29.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecc7e00700 1 -- 172.21.15.49:0/2345559684 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc000bea0 con 0x7fecd0065240 2024-01-22T05:17:29.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecc7e00700 1 -- 172.21.15.49:0/2345559684 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc000b8d0 con 0x7fecd0065240 2024-01-22T05:17:29.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecd7800700 1 -- 172.21.15.49:0/2345559684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd00c0820 con 0x7fecd0065240 2024-01-22T05:17:29.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecc7e00700 1 -- 172.21.15.49:0/2345559684 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc00246c0 con 0x7fecd0065240 2024-01-22T05:17:29.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.907+0000 7fecd7800700 1 -- 172.21.15.49:0/2345559684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd01494d0 con 0x7fecd0065240 2024-01-22T05:17:29.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.911+0000 7fecd7800700 1 -- 172.21.15.49:0/2345559684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd0047060 con 0x7fecd0065240 2024-01-22T05:17:29.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.911+0000 7fecc7e00700 1 -- 172.21.15.49:0/2345559684 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fecc0021070 con 0x7fecd0065240 2024-01-22T05:17:29.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.911+0000 7fecc7e00700 1 --2- 172.21.15.49:0/2345559684 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feca805a510 0x7feca805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:29.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.911+0000 7fecc7e00700 1 -- 172.21.15.49:0/2345559684 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6589+0+0 (secure 0 0 0) 0x7fecc0076440 con 0x7fecd0065240 2024-01-22T05:17:29.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.911+0000 7feccfe00700 1 --2- 172.21.15.49:0/2345559684 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feca805a510 0x7feca805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:29.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.915+0000 7feccfe00700 1 --2- 172.21.15.49:0/2345559684 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feca805a510 0x7feca805c9d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fecd0063ca0 tx=0x7fecb8009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:29.919+0000 7fecc7e00700 1 -- 172.21.15.49:0/2345559684 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fecc0049a50 con 0x7fecd0065240 2024-01-22T05:17:30.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.127+0000 7fecd7800700 1 -- 172.21.15.49:0/2345559684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecd00c2f60 con 0x7fecd0065240 2024-01-22T05:17:30.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.127+0000 7fecc7e00700 1 -- 172.21.15.49:0/2345559684 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+3745 (secure 0 0 0) 0x7fecc004d070 con 0x7fecd0065240 2024-01-22T05:17:30.130 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:30.130 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":118,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:17:24.473420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":148,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8826":{"gid":8826,"name":"c","rank":0,"incarnation":115,"state":"up:active","state_seq":22,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:17:30.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.131+0000 7fecd7800700 1 -- 172.21.15.49:0/2345559684 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feca805a510 msgr2=0x7feca805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:30.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.131+0000 7fecd7800700 1 --2- 172.21.15.49:0/2345559684 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feca805a510 0x7feca805c9d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fecd0063ca0 tx=0x7fecb8009060).stop 2024-01-22T05:17:30.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.131+0000 7fecd7800700 1 -- 172.21.15.49:0/2345559684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecd0065240 msgr2=0x7fecd00a9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:30.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.131+0000 7fecd7800700 1 --2- 172.21.15.49:0/2345559684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecd0065240 0x7fecd00a9f40 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7fecd0066be0 tx=0x7fecc0017000).stop 2024-01-22T05:17:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.131+0000 7fecd7800700 1 -- 172.21.15.49:0/2345559684 shutdown_connections 2024-01-22T05:17:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.131+0000 7fecd7800700 1 --2- 172.21.15.49:0/2345559684 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feca805a510 0x7feca805c9d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.131+0000 7fecd7800700 1 --2- 172.21.15.49:0/2345559684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecd015b9b0 0x7fecd0158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.131+0000 7fecd7800700 1 --2- 172.21.15.49:0/2345559684 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecd0065620 0x7fecd0148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.131+0000 7fecd7800700 1 --2- 172.21.15.49:0/2345559684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecd0065240 0x7fecd00a9f40 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.131+0000 7fecd7800700 1 -- 172.21.15.49:0/2345559684 >> 172.21.15.49:0/2345559684 conn(0x7fecd00c87f0 msgr2=0x7fecd01566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.131+0000 7fecd7800700 1 -- 172.21.15.49:0/2345559684 shutdown_connections 2024-01-22T05:17:30.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.131+0000 7fecd7800700 1 -- 172.21.15.49:0/2345559684 wait complete. 2024-01-22T05:17:30.137 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 118 2024-01-22T05:17:30.154 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:17:30.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.311+0000 7f50b5000700 1 Processor -- start 2024-01-22T05:17:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.311+0000 7f50b5000700 1 -- start start 2024-01-22T05:17:30.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.315+0000 7f50b5000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50b0157ed0 0x7f50b015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:30.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.315+0000 7f50b5000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50b01582b0 0x7f50b015c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:30.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.315+0000 7f50b5000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b00be810 con 0x7f50b0062c40 2024-01-22T05:17:30.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.315+0000 7f50b5000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b00c4fb0 con 0x7f50b01582b0 2024-01-22T05:17:30.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.315+0000 7f50b5000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b015c630 con 0x7f50b0157ed0 2024-01-22T05:17:30.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.315+0000 7f50ad400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50b01582b0 0x7f50b015c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:30.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.315+0000 7f50ad400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50b01582b0 0x7f50b015c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53790/0 (socket says 172.21.15.49:53790) 2024-01-22T05:17:30.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.315+0000 7f50ad400700 1 -- 172.21.15.49:0/2965915598 learned_addr learned my addr 172.21.15.49:0/2965915598 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:30.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.315+0000 7f50ade00700 1 --2- 172.21.15.49:0/2965915598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50b0157ed0 0x7f50b015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:30.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.315+0000 7f50ad400700 1 -- 172.21.15.49:0/2965915598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50b0157ed0 msgr2=0x7f50b015bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:30.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.315+0000 7f50ad400700 1 --2- 172.21.15.49:0/2965915598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50b0157ed0 0x7f50b015bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.315+0000 7f50ad400700 1 -- 172.21.15.49:0/2965915598 >> v1:172.21.15.110:6789/0 conn(0x7f50b0062c40 legacy=0x7f50b00630f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:30.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.315+0000 7f50ad400700 1 -- 172.21.15.49:0/2965915598 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b00beca0 con 0x7f50b01582b0 2024-01-22T05:17:30.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.319+0000 7f50ad400700 1 --2- 172.21.15.49:0/2965915598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50b01582b0 0x7f50b015c140 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f5098006fd0 tx=0x7f50980090f0).ready entity=mon.0 client_cookie=1cd0281d58b3103c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:30.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.319+0000 7f50aca00700 1 -- 172.21.15.49:0/2965915598 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509800b580 con 0x7f50b01582b0 2024-01-22T05:17:30.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.319+0000 7f50aca00700 1 -- 172.21.15.49:0/2965915598 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509800b6e0 con 0x7f50b01582b0 2024-01-22T05:17:30.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.319+0000 7f50aca00700 1 -- 172.21.15.49:0/2965915598 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509800ba60 con 0x7f50b01582b0 2024-01-22T05:17:30.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.319+0000 7f50b5000700 1 -- 172.21.15.49:0/2965915598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50b01582b0 msgr2=0x7f50b015c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:30.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.319+0000 7f50b5000700 1 --2- 172.21.15.49:0/2965915598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50b01582b0 0x7f50b015c140 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f5098006fd0 tx=0x7f50980090f0).stop 2024-01-22T05:17:30.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.319+0000 7f50b5000700 1 -- 172.21.15.49:0/2965915598 shutdown_connections 2024-01-22T05:17:30.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.319+0000 7f50b5000700 1 --2- 172.21.15.49:0/2965915598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50b01582b0 0x7f50b015c140 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.319+0000 7f50b5000700 1 --2- 172.21.15.49:0/2965915598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50b0157ed0 0x7f50b015bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.319+0000 7f50b5000700 1 -- 172.21.15.49:0/2965915598 >> 172.21.15.49:0/2965915598 conn(0x7f50b0064080 msgr2=0x7f50b0064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:30.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.319+0000 7f50b5000700 1 -- 172.21.15.49:0/2965915598 shutdown_connections 2024-01-22T05:17:30.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.319+0000 7f50b5000700 1 -- 172.21.15.49:0/2965915598 wait complete. 2024-01-22T05:17:30.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.323+0000 7f50b5000700 1 Processor -- start 2024-01-22T05:17:30.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.323+0000 7f50b5000700 1 -- start start 2024-01-22T05:17:30.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.323+0000 7f50b5000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0062c40 0x7f50b00ab000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:30.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.323+0000 7f50b5000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50b0157ed0 0x7f50b0069750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:30.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.323+0000 7f50b5000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50b01582b0 0x7f50b0148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:30.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.323+0000 7f50b5000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b00aab70 con 0x7f50b01582b0 2024-01-22T05:17:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.323+0000 7f50b5000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b00a9f60 con 0x7f50b0062c40 2024-01-22T05:17:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.323+0000 7f50b5000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b00aa240 con 0x7f50b0157ed0 2024-01-22T05:17:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50ade00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0062c40 0x7f50b00ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50ad400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50b0157ed0 0x7f50b0069750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50ade00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0062c40 0x7f50b00ab000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:34264/0 (socket says 172.21.15.49:34264) 2024-01-22T05:17:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50af200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50b01582b0 0x7f50b0148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50ade00700 1 -- 172.21.15.49:0/3642099664 learned_addr learned my addr 172.21.15.49:0/3642099664 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50ade00700 1 -- 172.21.15.49:0/3642099664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50b0157ed0 msgr2=0x7f50b0069750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:30.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50ade00700 1 --2- 172.21.15.49:0/3642099664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50b0157ed0 0x7f50b0069750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50ade00700 1 -- 172.21.15.49:0/3642099664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50b01582b0 msgr2=0x7f50b0148220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:30.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50ade00700 1 --2- 172.21.15.49:0/3642099664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50b01582b0 0x7f50b0148220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50ade00700 1 -- 172.21.15.49:0/3642099664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5098009370 con 0x7f50b0062c40 2024-01-22T05:17:30.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50af200700 1 --2- 172.21.15.49:0/3642099664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50b01582b0 0x7f50b0148220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:30.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50ade00700 1 --2- 172.21.15.49:0/3642099664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0062c40 0x7f50b00ab000 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f50a000e930 tx=0x7f50a0009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:30.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50a5600700 1 -- 172.21.15.49:0/3642099664 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a0012600 con 0x7f50b0062c40 2024-01-22T05:17:30.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50a5600700 1 -- 172.21.15.49:0/3642099664 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a0012760 con 0x7f50b0062c40 2024-01-22T05:17:30.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50b5000700 1 -- 172.21.15.49:0/3642099664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b00aa520 con 0x7f50b0062c40 2024-01-22T05:17:30.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50a5600700 1 -- 172.21.15.49:0/3642099664 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a0012ae0 con 0x7f50b0062c40 2024-01-22T05:17:30.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.327+0000 7f50b5000700 1 -- 172.21.15.49:0/3642099664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b0069c40 con 0x7f50b0062c40 2024-01-22T05:17:30.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.331+0000 7f50b5000700 1 -- 172.21.15.49:0/3642099664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b0047060 con 0x7f50b0062c40 2024-01-22T05:17:30.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.331+0000 7f50a5600700 1 -- 172.21.15.49:0/3642099664 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f50a001b400 con 0x7f50b0062c40 2024-01-22T05:17:30.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.335+0000 7f50a5600700 1 --2- 172.21.15.49:0/3642099664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f508805a510 0x7f508805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:30.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.335+0000 7f50a5600700 1 -- 172.21.15.49:0/3642099664 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f50a0074f10 con 0x7f50b0062c40 2024-01-22T05:17:30.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.335+0000 7f50ad400700 1 --2- 172.21.15.49:0/3642099664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f508805a510 0x7f508805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:30.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.335+0000 7f50ad400700 1 --2- 172.21.15.49:0/3642099664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f508805a510 0x7f508805c9d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f5098006fd0 tx=0x7f5098017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.343+0000 7f50a5600700 1 -- 172.21.15.49:0/3642099664 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f50a0048400 con 0x7f50b0062c40 2024-01-22T05:17:30.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.543+0000 7f50b5000700 1 -- 172.21.15.49:0/3642099664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50b00c55a0 con 0x7f50b0062c40 2024-01-22T05:17:30.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.543+0000 7f50a5600700 1 -- 172.21.15.49:0/3642099664 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+3745 (secure 0 0 0) 0x7f50a004ba20 con 0x7f50b0062c40 2024-01-22T05:17:30.544 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:30.544 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":118,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:16:14.068057+0000","modified":"2024-01-22T05:17:24.473420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":148,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8826":{"gid":8826,"name":"c","rank":0,"incarnation":115,"state":"up:active","state_seq":22,"addr":"172.21.15.49:6836/3517162808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3517162808},{"type":"v1","addr":"172.21.15.49:6836","nonce":3517162808}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-22T05:17:30.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.547+0000 7f50b5000700 1 -- 172.21.15.49:0/3642099664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f508805a510 msgr2=0x7f508805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:30.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.547+0000 7f50b5000700 1 --2- 172.21.15.49:0/3642099664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f508805a510 0x7f508805c9d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f5098006fd0 tx=0x7f5098017000).stop 2024-01-22T05:17:30.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.547+0000 7f50b5000700 1 -- 172.21.15.49:0/3642099664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0062c40 msgr2=0x7f50b00ab000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:30.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.547+0000 7f50b5000700 1 --2- 172.21.15.49:0/3642099664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0062c40 0x7f50b00ab000 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f50a000e930 tx=0x7f50a0009060).stop 2024-01-22T05:17:30.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.547+0000 7f50b5000700 1 -- 172.21.15.49:0/3642099664 shutdown_connections 2024-01-22T05:17:30.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.547+0000 7f50b5000700 1 --2- 172.21.15.49:0/3642099664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f508805a510 0x7f508805c9d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.547+0000 7f50b5000700 1 --2- 172.21.15.49:0/3642099664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50b01582b0 0x7f50b0148220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.547+0000 7f50b5000700 1 --2- 172.21.15.49:0/3642099664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50b0157ed0 0x7f50b0069750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.547+0000 7f50b5000700 1 --2- 172.21.15.49:0/3642099664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0062c40 0x7f50b00ab000 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.547+0000 7f50b5000700 1 -- 172.21.15.49:0/3642099664 >> 172.21.15.49:0/3642099664 conn(0x7f50b0064080 msgr2=0x7f50b0068410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:30.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.547+0000 7f50b5000700 1 -- 172.21.15.49:0/3642099664 shutdown_connections 2024-01-22T05:17:30.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.547+0000 7f50b5000700 1 -- 172.21.15.49:0/3642099664 wait complete. 2024-01-22T05:17:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 118 2024-01-22T05:17:30.572 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:17:30.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.731+0000 7f5fa1600700 1 Processor -- start 2024-01-22T05:17:30.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.731+0000 7f5fa1600700 1 -- start start 2024-01-22T05:17:30.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.735+0000 7f5fa1600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f9c0c3690 0x7f5f9c0c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:30.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.735+0000 7f5fa1600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f9c0bf0b0 0x7f5f9c1559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:30.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.735+0000 7f5fa1600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9c0bdc10 con 0x7f5f9c155550 2024-01-22T05:17:30.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.735+0000 7f5fa1600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9c0c3f60 con 0x7f5f9c0c3690 2024-01-22T05:17:30.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.735+0000 7f5fa1600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c155ea0 con 0x7f5f9c0bf0b0 2024-01-22T05:17:30.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.735+0000 7f5f9aa00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f9c0c3690 0x7f5f9c0c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:30.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.735+0000 7f5f9aa00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f9c0c3690 0x7f5f9c0c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:34272/0 (socket says 172.21.15.49:34272) 2024-01-22T05:17:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.735+0000 7f5f9aa00700 1 -- 172.21.15.49:0/2443000861 learned_addr learned my addr 172.21.15.49:0/2443000861 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.735+0000 7f5f9b400700 1 --2- 172.21.15.49:0/2443000861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f9c0bf0b0 0x7f5f9c1559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.735+0000 7f5f9a000700 1 --1- 172.21.15.49:0/2443000861 >> v1:172.21.15.110:6789/0 conn(0x7f5f9c155550 0x7f5f9c067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:45978/0 (socket says 172.21.15.49:45978) 2024-01-22T05:17:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.735+0000 7f5f9aa00700 1 -- 172.21.15.49:0/2443000861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f9c0bf0b0 msgr2=0x7f5f9c1559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.735+0000 7f5f9aa00700 1 --2- 172.21.15.49:0/2443000861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f9c0bf0b0 0x7f5f9c1559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.735+0000 7f5f9aa00700 1 -- 172.21.15.49:0/2443000861 >> v1:172.21.15.110:6789/0 conn(0x7f5f9c155550 legacy=0x7f5f9c067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:30.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.735+0000 7f5f9aa00700 1 -- 172.21.15.49:0/2443000861 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c068e10 con 0x7f5f9c0c3690 2024-01-22T05:17:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.739+0000 7f5f9aa00700 1 --2- 172.21.15.49:0/2443000861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f9c0c3690 0x7f5f9c0c3a70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f5f8c006fd0 tx=0x7f5f8c0090f0).ready entity=mon.1 client_cookie=2f037fb1615b7155 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.739+0000 7f5f99600700 1 -- 172.21.15.49:0/2443000861 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c00b580 con 0x7f5f9c0c3690 2024-01-22T05:17:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.739+0000 7f5f99600700 1 -- 172.21.15.49:0/2443000861 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c00b6e0 con 0x7f5f9c0c3690 2024-01-22T05:17:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.739+0000 7f5f99600700 1 -- 172.21.15.49:0/2443000861 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c00ba60 con 0x7f5f9c0c3690 2024-01-22T05:17:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.739+0000 7f5fa1600700 1 -- 172.21.15.49:0/2443000861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f9c0c3690 msgr2=0x7f5f9c0c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.739+0000 7f5fa1600700 1 --2- 172.21.15.49:0/2443000861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f9c0c3690 0x7f5f9c0c3a70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f5f8c006fd0 tx=0x7f5f8c0090f0).stop 2024-01-22T05:17:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.739+0000 7f5fa1600700 1 -- 172.21.15.49:0/2443000861 shutdown_connections 2024-01-22T05:17:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.739+0000 7f5fa1600700 1 --2- 172.21.15.49:0/2443000861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f9c0bf0b0 0x7f5f9c1559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.739+0000 7f5fa1600700 1 --2- 172.21.15.49:0/2443000861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f9c0c3690 0x7f5f9c0c3a70 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.739+0000 7f5fa1600700 1 -- 172.21.15.49:0/2443000861 >> 172.21.15.49:0/2443000861 conn(0x7f5f9c0c51c0 msgr2=0x7f5f9c0c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:30.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.739+0000 7f5fa1600700 1 -- 172.21.15.49:0/2443000861 shutdown_connections 2024-01-22T05:17:30.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.739+0000 7f5fa1600700 1 -- 172.21.15.49:0/2443000861 wait complete. 2024-01-22T05:17:30.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.743+0000 7f5fa1600700 1 Processor -- start 2024-01-22T05:17:30.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.743+0000 7f5fa1600700 1 -- start start 2024-01-22T05:17:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.743+0000 7f5fa1600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f9c0bf0b0 0x7f5f9c0adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.743+0000 7f5fa1600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f9c0c3690 0x7f5f9c0be0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.743+0000 7f5fa1600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f9c155550 0x7f5f9c0be590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.743+0000 7f5fa1600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0bea80 con 0x7f5f9c155550 2024-01-22T05:17:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.743+0000 7f5fa1600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0ac0b0 con 0x7f5f9c0c3690 2024-01-22T05:17:30.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.743+0000 7f5fa1600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c154980 con 0x7f5f9c0bf0b0 2024-01-22T05:17:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5f9b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f9c155550 0x7f5f9c0be590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5f9b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f9c155550 0x7f5f9c0be590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53804/0 (socket says 172.21.15.49:53804) 2024-01-22T05:17:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5f9b400700 1 -- 172.21.15.49:0/782905444 learned_addr learned my addr 172.21.15.49:0/782905444 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5f9a000700 1 --2- 172.21.15.49:0/782905444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f9c0c3690 0x7f5f9c0be0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5f9aa00700 1 --2- 172.21.15.49:0/782905444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f9c0bf0b0 0x7f5f9c0adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5f9b400700 1 -- 172.21.15.49:0/782905444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f9c0bf0b0 msgr2=0x7f5f9c0adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5f9b400700 1 --2- 172.21.15.49:0/782905444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f9c0bf0b0 0x7f5f9c0adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5f9b400700 1 -- 172.21.15.49:0/782905444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f9c0c3690 msgr2=0x7f5f9c0be0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5f9b400700 1 --2- 172.21.15.49:0/782905444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f9c0c3690 0x7f5f9c0be0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5f9b400700 1 -- 172.21.15.49:0/782905444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8c009370 con 0x7f5f9c155550 2024-01-22T05:17:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5f9b400700 1 --2- 172.21.15.49:0/782905444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f9c155550 0x7f5f9c0be590 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f5f94009f20 tx=0x7f5f9400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5f92000700 1 -- 172.21.15.49:0/782905444 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9400cb70 con 0x7f5f9c155550 2024-01-22T05:17:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5f92000700 1 -- 172.21.15.49:0/782905444 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9400f040 con 0x7f5f9c155550 2024-01-22T05:17:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5fa1600700 1 -- 172.21.15.49:0/782905444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9c154c60 con 0x7f5f9c155550 2024-01-22T05:17:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5f92000700 1 -- 172.21.15.49:0/782905444 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9400cee0 con 0x7f5f9c155550 2024-01-22T05:17:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.747+0000 7f5fa1600700 1 -- 172.21.15.49:0/782905444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9c0ae2d0 con 0x7f5f9c155550 2024-01-22T05:17:30.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.751+0000 7f5fa1600700 1 -- 172.21.15.49:0/782905444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9c154ea0 con 0x7f5f9c155550 2024-01-22T05:17:30.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.751+0000 7f5f92000700 1 -- 172.21.15.49:0/782905444 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5f94013610 con 0x7f5f9c155550 2024-01-22T05:17:30.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.751+0000 7f5f92000700 1 --2- 172.21.15.49:0/782905444 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f7405a510 0x7f5f7405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:30.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.751+0000 7f5f92000700 1 -- 172.21.15.49:0/782905444 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6589+0+0 (secure 0 0 0) 0x7f5f940752a0 con 0x7f5f9c155550 2024-01-22T05:17:30.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.751+0000 7f5f9aa00700 1 --2- 172.21.15.49:0/782905444 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f7405a510 0x7f5f7405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:30.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.755+0000 7f5f9aa00700 1 --2- 172.21.15.49:0/782905444 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f7405a510 0x7f5f7405c9d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f5f8c009130 tx=0x7f5f8c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.759+0000 7f5f92000700 1 -- 172.21.15.49:0/782905444 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5f9c154ea0 con 0x7f5f9c155550 2024-01-22T05:17:30.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.943+0000 7f5fa1600700 1 -- 172.21.15.49:0/782905444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f9c154ea0 con 0x7f5f9c155550 2024-01-22T05:17:30.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.947+0000 7f5f92000700 1 -- 172.21.15.49:0/782905444 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+17357 (secure 0 0 0) 0x7f5f9c154ea0 con 0x7f5f9c155550 2024-01-22T05:17:30.948 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:30.948 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":148,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:17:21.374871+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:16:12.266975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-01-22T05:16:13.093952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.29","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6837/4015076184":"2024-01-23T05:17:21.374748+0000","172.21.15.49:6835/4015076184":"2024-01-23T05:17:21.374748+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:17:30.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.947+0000 7f5fa1600700 1 -- 172.21.15.49:0/782905444 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f7405a510 msgr2=0x7f5f7405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:30.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.947+0000 7f5fa1600700 1 --2- 172.21.15.49:0/782905444 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f7405a510 0x7f5f7405c9d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f5f8c009130 tx=0x7f5f8c017000).stop 2024-01-22T05:17:30.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.947+0000 7f5fa1600700 1 -- 172.21.15.49:0/782905444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f9c155550 msgr2=0x7f5f9c0be590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:30.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.947+0000 7f5fa1600700 1 --2- 172.21.15.49:0/782905444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f9c155550 0x7f5f9c0be590 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f5f94009f20 tx=0x7f5f9400b040).stop 2024-01-22T05:17:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.951+0000 7f5fa1600700 1 -- 172.21.15.49:0/782905444 shutdown_connections 2024-01-22T05:17:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.951+0000 7f5fa1600700 1 --2- 172.21.15.49:0/782905444 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f7405a510 0x7f5f7405c9d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.951+0000 7f5fa1600700 1 --2- 172.21.15.49:0/782905444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f9c155550 0x7f5f9c0be590 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.951+0000 7f5fa1600700 1 --2- 172.21.15.49:0/782905444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f9c0c3690 0x7f5f9c0be0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.951+0000 7f5fa1600700 1 --2- 172.21.15.49:0/782905444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f9c0bf0b0 0x7f5f9c0adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.951+0000 7f5fa1600700 1 -- 172.21.15.49:0/782905444 >> 172.21.15.49:0/782905444 conn(0x7f5f9c0c51c0 msgr2=0x7f5f9c0aa050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.951+0000 7f5fa1600700 1 -- 172.21.15.49:0/782905444 shutdown_connections 2024-01-22T05:17:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:30.951+0000 7f5fa1600700 1 -- 172.21.15.49:0/782905444 wait complete. 2024-01-22T05:17:30.975 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:17:31.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.131+0000 7fa559c00700 1 Processor -- start 2024-01-22T05:17:31.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.131+0000 7fa559c00700 1 -- start start 2024-01-22T05:17:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa559c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5540a8b10 0x7fa554157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa559c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa5540a8f90 0x7fa554157c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa559c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5540c1ee0 con 0x7fa554066fb0 2024-01-22T05:17:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa559c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa554158120 con 0x7fa5540a8f90 2024-01-22T05:17:31.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa559c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5540c12f0 con 0x7fa5540a8b10 2024-01-22T05:17:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa552000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5540a8b10 0x7fa554157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa553400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa5540a8f90 0x7fa554157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa552000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5540a8b10 0x7fa554157740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:47670/0 (socket says 172.21.15.49:47670) 2024-01-22T05:17:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa552a00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa554066fb0 0x7fa5540c2370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:45982/0 (socket says 172.21.15.49:45982) 2024-01-22T05:17:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa552000700 1 -- 172.21.15.49:0/1057720879 learned_addr learned my addr 172.21.15.49:0/1057720879 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:31.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa551600700 1 -- 172.21.15.49:0/1057720879 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497418914 0 0) 0x7fa5540c1ee0 con 0x7fa554066fb0 2024-01-22T05:17:31.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa553400700 1 -- 172.21.15.49:0/1057720879 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5540a8b10 msgr2=0x7fa554157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:31.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa553400700 1 --2- 172.21.15.49:0/1057720879 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5540a8b10 0x7fa554157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:31.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa553400700 1 -- 172.21.15.49:0/1057720879 >> v1:172.21.15.110:6789/0 conn(0x7fa554066fb0 legacy=0x7fa5540c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:31.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa553400700 1 -- 172.21.15.49:0/1057720879 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5540c15b0 con 0x7fa5540a8f90 2024-01-22T05:17:31.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.135+0000 7fa553400700 1 --2- 172.21.15.49:0/1057720879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5540a8f90 0x7fa554157c30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fa54c009e60 tx=0x7fa54c009780).ready entity=mon.1 client_cookie=4e29983de0ef12b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:31.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.139+0000 7fa551600700 1 -- 172.21.15.49:0/1057720879 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c00e070 con 0x7fa5540a8f90 2024-01-22T05:17:31.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.139+0000 7fa551600700 1 -- 172.21.15.49:0/1057720879 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c00bb60 con 0x7fa5540a8f90 2024-01-22T05:17:31.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.139+0000 7fa551600700 1 -- 172.21.15.49:0/1057720879 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c012410 con 0x7fa5540a8f90 2024-01-22T05:17:31.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.139+0000 7fa559c00700 1 -- 172.21.15.49:0/1057720879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5540a8f90 msgr2=0x7fa554157c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:31.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.139+0000 7fa559c00700 1 --2- 172.21.15.49:0/1057720879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5540a8f90 0x7fa554157c30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fa54c009e60 tx=0x7fa54c009780).stop 2024-01-22T05:17:31.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.139+0000 7fa559c00700 1 -- 172.21.15.49:0/1057720879 shutdown_connections 2024-01-22T05:17:31.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.139+0000 7fa559c00700 1 --2- 172.21.15.49:0/1057720879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5540a8f90 0x7fa554157c30 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:31.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.139+0000 7fa559c00700 1 --2- 172.21.15.49:0/1057720879 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5540a8b10 0x7fa554157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:31.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.139+0000 7fa559c00700 1 -- 172.21.15.49:0/1057720879 >> 172.21.15.49:0/1057720879 conn(0x7fa5540c6540 msgr2=0x7fa5540c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:31.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.139+0000 7fa559c00700 1 -- 172.21.15.49:0/1057720879 shutdown_connections 2024-01-22T05:17:31.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.139+0000 7fa559c00700 1 -- 172.21.15.49:0/1057720879 wait complete. 2024-01-22T05:17:31.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.143+0000 7fa559c00700 1 Processor -- start 2024-01-22T05:17:31.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.143+0000 7fa559c00700 1 -- start start 2024-01-22T05:17:31.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.143+0000 7fa559c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa554066fb0 0x7fa5540bf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:31.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.143+0000 7fa559c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5540a8b10 0x7fa5540bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:31.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.143+0000 7fa559c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5540a8f90 0x7fa554150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:31.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.143+0000 7fa559c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5540bf810 con 0x7fa554066fb0 2024-01-22T05:17:31.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.143+0000 7fa559c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5540c0170 con 0x7fa5540a8b10 2024-01-22T05:17:31.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.143+0000 7fa559c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5540aa040 con 0x7fa5540a8f90 2024-01-22T05:17:31.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.143+0000 7fa552a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa554066fb0 0x7fa5540bf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:31.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.143+0000 7fa552a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa554066fb0 0x7fa5540bf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53820/0 (socket says 172.21.15.49:53820) 2024-01-22T05:17:31.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.143+0000 7fa552a00700 1 -- 172.21.15.49:0/3846534373 learned_addr learned my addr 172.21.15.49:0/3846534373 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:31.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.143+0000 7fa553400700 1 --2- 172.21.15.49:0/3846534373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5540a8f90 0x7fa554150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:31.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.143+0000 7fa552000700 1 --2- 172.21.15.49:0/3846534373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5540a8b10 0x7fa5540bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.147+0000 7fa552a00700 1 -- 172.21.15.49:0/3846534373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5540a8f90 msgr2=0x7fa554150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.147+0000 7fa552a00700 1 --2- 172.21.15.49:0/3846534373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5540a8f90 0x7fa554150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.147+0000 7fa552a00700 1 -- 172.21.15.49:0/3846534373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5540a8b10 msgr2=0x7fa5540bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.147+0000 7fa552a00700 1 --2- 172.21.15.49:0/3846534373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5540a8b10 0x7fa5540bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.147+0000 7fa552a00700 1 -- 172.21.15.49:0/3846534373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c009a20 con 0x7fa554066fb0 2024-01-22T05:17:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.147+0000 7fa552a00700 1 --2- 172.21.15.49:0/3846534373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa554066fb0 0x7fa5540bf320 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7fa54400c590 tx=0x7fa544007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.147+0000 7fa54a000700 1 -- 172.21.15.49:0/3846534373 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54400ce40 con 0x7fa554066fb0 2024-01-22T05:17:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.147+0000 7fa54a000700 1 -- 172.21.15.49:0/3846534373 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5440072e0 con 0x7fa554066fb0 2024-01-22T05:17:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.147+0000 7fa54a000700 1 -- 172.21.15.49:0/3846534373 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5440056e0 con 0x7fa554066fb0 2024-01-22T05:17:31.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.147+0000 7fa559c00700 1 -- 172.21.15.49:0/3846534373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5540a9730 con 0x7fa554066fb0 2024-01-22T05:17:31.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.147+0000 7fa559c00700 1 -- 172.21.15.49:0/3846534373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5540a9cd0 con 0x7fa554066fb0 2024-01-22T05:17:31.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.147+0000 7fa559c00700 1 -- 172.21.15.49:0/3846534373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa554047060 con 0x7fa554066fb0 2024-01-22T05:17:31.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.151+0000 7fa54a000700 1 -- 172.21.15.49:0/3846534373 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa544005ad0 con 0x7fa554066fb0 2024-01-22T05:17:31.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.151+0000 7fa54a000700 1 --2- 172.21.15.49:0/3846534373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa52c05a4e0 0x7fa52c05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:31.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.151+0000 7fa54a000700 1 -- 172.21.15.49:0/3846534373 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6589+0+0 (secure 0 0 0) 0x7fa544074030 con 0x7fa554066fb0 2024-01-22T05:17:31.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.151+0000 7fa552000700 1 --2- 172.21.15.49:0/3846534373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa52c05a4e0 0x7fa52c05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:31.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.151+0000 7fa552000700 1 --2- 172.21.15.49:0/3846534373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa52c05a4e0 0x7fa52c05c9a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fa5541518f0 tx=0x7fa53c0090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:31.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.159+0000 7fa54a000700 1 -- 172.21.15.49:0/3846534373 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa544047640 con 0x7fa554066fb0 2024-01-22T05:17:31.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.359+0000 7fa559c00700 1 -- 172.21.15.49:0/3846534373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa5540c1890 con 0x7fa554066fb0 2024-01-22T05:17:31.521 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:17:31.519+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:17:31.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.535+0000 7fa54a000700 1 -- 172.21.15.49:0/3846534373 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v119) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa54404ac60 con 0x7fa554066fb0 2024-01-22T05:17:31.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.539+0000 7fa559c00700 1 -- 172.21.15.49:0/3846534373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa52c05a4e0 msgr2=0x7fa52c05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:31.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.539+0000 7fa559c00700 1 --2- 172.21.15.49:0/3846534373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa52c05a4e0 0x7fa52c05c9a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fa5541518f0 tx=0x7fa53c0090f0).stop 2024-01-22T05:17:31.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.539+0000 7fa559c00700 1 -- 172.21.15.49:0/3846534373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa554066fb0 msgr2=0x7fa5540bf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:31.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.539+0000 7fa559c00700 1 --2- 172.21.15.49:0/3846534373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa554066fb0 0x7fa5540bf320 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7fa54400c590 tx=0x7fa544007c90).stop 2024-01-22T05:17:31.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.539+0000 7fa559c00700 1 -- 172.21.15.49:0/3846534373 shutdown_connections 2024-01-22T05:17:31.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.539+0000 7fa559c00700 1 --2- 172.21.15.49:0/3846534373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa52c05a4e0 0x7fa52c05c9a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:31.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.539+0000 7fa559c00700 1 --2- 172.21.15.49:0/3846534373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5540a8f90 0x7fa554150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:31.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.539+0000 7fa559c00700 1 --2- 172.21.15.49:0/3846534373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5540a8b10 0x7fa5540bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:31.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.539+0000 7fa559c00700 1 --2- 172.21.15.49:0/3846534373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa554066fb0 0x7fa5540bf320 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:31.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.539+0000 7fa559c00700 1 -- 172.21.15.49:0/3846534373 >> 172.21.15.49:0/3846534373 conn(0x7fa5540c6540 msgr2=0x7fa554152190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:31.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.539+0000 7fa559c00700 1 -- 172.21.15.49:0/3846534373 shutdown_connections 2024-01-22T05:17:31.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.539+0000 7fa559c00700 1 -- 172.21.15.49:0/3846534373 wait complete. 2024-01-22T05:17:31.542 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:17:31.570 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:17:31.616 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:17:31.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.735+0000 7fd8ae000700 1 Processor -- start 2024-01-22T05:17:31.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.735+0000 7fd8ae000700 1 -- start start 2024-01-22T05:17:31.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8ae000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd8a80a8740 0x7fd8a80a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:31.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8ae000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd8a8066080 0x7fd8a8066510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:31.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8ae000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a8065bd0 con 0x7fd8a81581e0 2024-01-22T05:17:31.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8ae000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a80a9070 con 0x7fd8a80a8740 2024-01-22T05:17:31.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8ae000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a80c15f0 con 0x7fd8a8066080 2024-01-22T05:17:31.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8a7e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd8a80a8740 0x7fd8a80a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:31.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8a7e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd8a80a8740 0x7fd8a80a8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53836/0 (socket says 172.21.15.49:53836) 2024-01-22T05:17:31.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8a7e00700 1 -- 172.21.15.49:0/837213463 learned_addr learned my addr 172.21.15.49:0/837213463 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:31.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8ad600700 1 --2- 172.21.15.49:0/837213463 >> v2:172.21.15.110:3300/0 conn(0x7fd8a8066080 0x7fd8a8066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:31.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8a7e00700 1 -- 172.21.15.49:0/837213463 >> v2:172.21.15.110:3300/0 conn(0x7fd8a8066080 msgr2=0x7fd8a8066510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:31.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8a7e00700 1 --2- 172.21.15.49:0/837213463 >> v2:172.21.15.110:3300/0 conn(0x7fd8a8066080 0x7fd8a8066510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:31.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8a7e00700 1 -- 172.21.15.49:0/837213463 >> v1:172.21.15.110:6789/0 conn(0x7fd8a81581e0 legacy=0x7fd8a80c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:31.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8a7e00700 1 -- 172.21.15.49:0/837213463 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a80c18c0 con 0x7fd8a80a8740 2024-01-22T05:17:31.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8a7e00700 1 --2- 172.21.15.49:0/837213463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a80a8740 0x7fd8a80a8b80 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7fd8a8063550 tx=0x7fd8900090f0).ready entity=mon.0 client_cookie=3b01d898805f6568 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:31.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8a7400700 1 -- 172.21.15.49:0/837213463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89000b520 con 0x7fd8a80a8740 2024-01-22T05:17:31.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8a7400700 1 -- 172.21.15.49:0/837213463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89000b680 con 0x7fd8a80a8740 2024-01-22T05:17:31.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.739+0000 7fd8a7400700 1 -- 172.21.15.49:0/837213463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89000ba20 con 0x7fd8a80a8740 2024-01-22T05:17:31.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.743+0000 7fd8ae000700 1 -- 172.21.15.49:0/837213463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a80a8740 msgr2=0x7fd8a80a8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:31.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.743+0000 7fd8ae000700 1 --2- 172.21.15.49:0/837213463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a80a8740 0x7fd8a80a8b80 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7fd8a8063550 tx=0x7fd8900090f0).stop 2024-01-22T05:17:31.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.743+0000 7fd8ae000700 1 -- 172.21.15.49:0/837213463 shutdown_connections 2024-01-22T05:17:31.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.743+0000 7fd8ae000700 1 --2- 172.21.15.49:0/837213463 >> v2:172.21.15.110:3300/0 conn(0x7fd8a8066080 0x7fd8a8066510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:31.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.743+0000 7fd8ae000700 1 --2- 172.21.15.49:0/837213463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a80a8740 0x7fd8a80a8b80 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:31.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.743+0000 7fd8ae000700 1 -- 172.21.15.49:0/837213463 >> 172.21.15.49:0/837213463 conn(0x7fd8a80c6540 msgr2=0x7fd8a80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:31.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.743+0000 7fd8ae000700 1 -- 172.21.15.49:0/837213463 shutdown_connections 2024-01-22T05:17:31.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.743+0000 7fd8ae000700 1 -- 172.21.15.49:0/837213463 wait complete. 2024-01-22T05:17:31.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.747+0000 7fd8ae000700 1 Processor -- start 2024-01-22T05:17:31.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.747+0000 7fd8ae000700 1 -- start start 2024-01-22T05:17:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.747+0000 7fd8ae000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a8066080 0x7fd8a81411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.747+0000 7fd8ae000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a80a8740 0x7fd8a80bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.747+0000 7fd8ae000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a81581e0 0x7fd8a815dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.747+0000 7fd8ae000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8151500 con 0x7fd8a81581e0 2024-01-22T05:17:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.747+0000 7fd8ae000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8156160 con 0x7fd8a8066080 2024-01-22T05:17:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.747+0000 7fd8ae000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8156440 con 0x7fd8a80a8740 2024-01-22T05:17:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd8ad600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a81581e0 0x7fd8a815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd8ad600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a81581e0 0x7fd8a815dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53844/0 (socket says 172.21.15.49:53844) 2024-01-22T05:17:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd8ad600700 1 -- 172.21.15.49:0/3457839365 learned_addr learned my addr 172.21.15.49:0/3457839365 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd8a7e00700 1 --2- 172.21.15.49:0/3457839365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a80a8740 0x7fd8a80bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd8acc00700 1 --2- 172.21.15.49:0/3457839365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a8066080 0x7fd8a81411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:31.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd8ad600700 1 -- 172.21.15.49:0/3457839365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a80a8740 msgr2=0x7fd8a80bd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:31.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd8ad600700 1 --2- 172.21.15.49:0/3457839365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a80a8740 0x7fd8a80bd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:31.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd8ad600700 1 -- 172.21.15.49:0/3457839365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a8066080 msgr2=0x7fd8a81411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:31.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd8ad600700 1 --2- 172.21.15.49:0/3457839365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a8066080 0x7fd8a81411c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:31.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd8ad600700 1 -- 172.21.15.49:0/3457839365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd890009370 con 0x7fd8a81581e0 2024-01-22T05:17:31.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd8a7e00700 1 --2- 172.21.15.49:0/3457839365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a80a8740 0x7fd8a80bd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:31.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd8ad600700 1 --2- 172.21.15.49:0/3457839365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a81581e0 0x7fd8a815dd80 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fd8a0009e90 tx=0x7fd8a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:31.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd89fe00700 1 -- 172.21.15.49:0/3457839365 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a000caa0 con 0x7fd8a81581e0 2024-01-22T05:17:31.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd89fe00700 1 -- 172.21.15.49:0/3457839365 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a000f040 con 0x7fd8a81581e0 2024-01-22T05:17:31.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd89fe00700 1 -- 172.21.15.49:0/3457839365 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a000ce10 con 0x7fd8a81581e0 2024-01-22T05:17:31.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd8ae000700 1 -- 172.21.15.49:0/3457839365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a81416b0 con 0x7fd8a81581e0 2024-01-22T05:17:31.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.751+0000 7fd8ae000700 1 -- 172.21.15.49:0/3457839365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a815e270 con 0x7fd8a81581e0 2024-01-22T05:17:31.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.755+0000 7fd8ae000700 1 -- 172.21.15.49:0/3457839365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a8156600 con 0x7fd8a81581e0 2024-01-22T05:17:31.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.755+0000 7fd89fe00700 1 -- 172.21.15.49:0/3457839365 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd8a0013610 con 0x7fd8a81581e0 2024-01-22T05:17:31.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.755+0000 7fd89fe00700 1 --2- 172.21.15.49:0/3457839365 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd88005a510 0x7fd88005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:31.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.755+0000 7fd89fe00700 1 -- 172.21.15.49:0/3457839365 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fd8a0075320 con 0x7fd8a81581e0 2024-01-22T05:17:31.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.755+0000 7fd8acc00700 1 --2- 172.21.15.49:0/3457839365 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd88005a510 0x7fd88005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:31.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.755+0000 7fd8acc00700 1 --2- 172.21.15.49:0/3457839365 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd88005a510 0x7fd88005c9d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fd8a8153ea0 tx=0x7fd898009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:31.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.763+0000 7fd89fe00700 1 -- 172.21.15.49:0/3457839365 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd8a0048810 con 0x7fd8a81581e0 2024-01-22T05:17:31.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:31.959+0000 7fd8ae000700 1 -- 172.21.15.49:0/3457839365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd8a8047060 con 0x7fd8a81581e0 2024-01-22T05:17:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.535+0000 7fd89fe00700 1 -- 172.21.15.49:0/3457839365 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v120) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd8a004be30 con 0x7fd8a81581e0 2024-01-22T05:17:32.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.539+0000 7fd8ae000700 1 -- 172.21.15.49:0/3457839365 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd88005a510 msgr2=0x7fd88005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:32.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.539+0000 7fd8ae000700 1 --2- 172.21.15.49:0/3457839365 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd88005a510 0x7fd88005c9d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fd8a8153ea0 tx=0x7fd898009040).stop 2024-01-22T05:17:32.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.539+0000 7fd8ae000700 1 -- 172.21.15.49:0/3457839365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a81581e0 msgr2=0x7fd8a815dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:32.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.539+0000 7fd8ae000700 1 --2- 172.21.15.49:0/3457839365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a81581e0 0x7fd8a815dd80 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fd8a0009e90 tx=0x7fd8a000b040).stop 2024-01-22T05:17:32.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.539+0000 7fd8ae000700 1 -- 172.21.15.49:0/3457839365 shutdown_connections 2024-01-22T05:17:32.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.539+0000 7fd8ae000700 1 --2- 172.21.15.49:0/3457839365 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd88005a510 0x7fd88005c9d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:32.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.539+0000 7fd8ae000700 1 --2- 172.21.15.49:0/3457839365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8a81581e0 0x7fd8a815dd80 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:32.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.539+0000 7fd8ae000700 1 --2- 172.21.15.49:0/3457839365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a80a8740 0x7fd8a80bd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:32.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.539+0000 7fd8ae000700 1 --2- 172.21.15.49:0/3457839365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a8066080 0x7fd8a81411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:32.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.539+0000 7fd8ae000700 1 -- 172.21.15.49:0/3457839365 >> 172.21.15.49:0/3457839365 conn(0x7fd8a80c6540 msgr2=0x7fd8a8066510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:32.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.543+0000 7fd8ae000700 1 -- 172.21.15.49:0/3457839365 shutdown_connections 2024-01-22T05:17:32.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.543+0000 7fd8ae000700 1 -- 172.21.15.49:0/3457839365 wait complete. 2024-01-22T05:17:32.567 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:17:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.787+0000 7fe264c00700 1 Processor -- start 2024-01-22T05:17:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.791+0000 7fe264c00700 1 -- start start 2024-01-22T05:17:32.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.791+0000 7fe264c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe260068cb0 0x7fe260156f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe264c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe260066560 con 0x7fe260068600 2024-01-22T05:17:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe264c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe260065950 con 0x7fe260067a90 2024-01-22T05:17:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe264c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2600bc930 con 0x7fe260068cb0 2024-01-22T05:17:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25fe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe260068600 0x7fe2600c1280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:54456/0 (socket says 172.21.15.49:54456) 2024-01-22T05:17:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25fe00700 1 -- 172.21.15.49:0/504194131 learned_addr learned my addr 172.21.15.49:0/504194131 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:32.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25f400700 1 --2- 172.21.15.49:0/504194131 >> v2:172.21.15.110:3300/0 conn(0x7fe260068cb0 0x7fe260156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:32.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455671936 0 0) 0x7fe260066560 con 0x7fe260068600 2024-01-22T05:17:32.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2400033f0 con 0x7fe260068600 2024-01-22T05:17:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855549299 0 0) 0x7fe260065950 con 0x7fe260067a90 2024-01-22T05:17:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe260066560 con 0x7fe260067a90 2024-01-22T05:17:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2802978992 0 0) 0x7fe2400033f0 con 0x7fe260068600 2024-01-22T05:17:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 >> v2:172.21.15.110:3300/0 conn(0x7fe260068cb0 msgr2=0x7fe260156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 --2- 172.21.15.49:0/504194131 >> v2:172.21.15.110:3300/0 conn(0x7fe260068cb0 0x7fe260156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 >> v1:172.21.15.110:6789/0 conn(0x7fe260067a90 legacy=0x7fe260067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe260065c30 con 0x7fe260068600 2024-01-22T05:17:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fe2580017f0 con 0x7fe260068600 2024-01-22T05:17:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 >> v1:172.21.15.49:6789/0 conn(0x7fe260068600 legacy=0x7fe2600c1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 --2- 172.21.15.49:0/504194131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe240003a70 0x7fe240003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 --2- 172.21.15.49:0/504194131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe240004690 0x7fe240004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 --2- 172.21.15.49:0/504194131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe240005000 0x7fe24000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2600bc930 con 0x7fe240005000 2024-01-22T05:17:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24000be80 con 0x7fe240004690 2024-01-22T05:17:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24000c040 con 0x7fe240003a70 2024-01-22T05:17:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25fe00700 1 --2- 172.21.15.49:0/504194131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe240005000 0x7fe24000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25ea00700 1 --2- 172.21.15.49:0/504194131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe240004690 0x7fe240004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:32.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25f400700 1 --2- 172.21.15.49:0/504194131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe240003a70 0x7fe240003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25fe00700 1 -- 172.21.15.49:0/504194131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe240003a70 msgr2=0x7fe240003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25fe00700 1 --2- 172.21.15.49:0/504194131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe240003a70 0x7fe240003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25fe00700 1 -- 172.21.15.49:0/504194131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe240004690 msgr2=0x7fe240004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.795+0000 7fe25fe00700 1 --2- 172.21.15.49:0/504194131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe240004690 0x7fe240004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.799+0000 7fe25fe00700 1 -- 172.21.15.49:0/504194131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2400033f0 con 0x7fe240005000 2024-01-22T05:17:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.799+0000 7fe25ea00700 1 --2- 172.21.15.49:0/504194131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe240004690 0x7fe240004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.799+0000 7fe25fe00700 1 -- 172.21.15.49:0/504194131 reap_dead start 2024-01-22T05:17:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.799+0000 7fe25fe00700 1 --2- 172.21.15.49:0/504194131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe240005000 0x7fe24000b8e0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7fe258007fd0 tx=0x7fe258007f40).ready entity=mon.0 client_cookie=1ea0ad9f134b2fad server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.799+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25800cd60 con 0x7fe240005000 2024-01-22T05:17:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.799+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe258005b20 con 0x7fe240005000 2024-01-22T05:17:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.799+0000 7fe25e000700 1 -- 172.21.15.49:0/504194131 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2580070d0 con 0x7fe240005000 2024-01-22T05:17:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.799+0000 7fe264c00700 1 -- 172.21.15.49:0/504194131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe240005000 msgr2=0x7fe24000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.799+0000 7fe264c00700 1 --2- 172.21.15.49:0/504194131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe240005000 0x7fe24000b8e0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7fe258007fd0 tx=0x7fe258007f40).stop 2024-01-22T05:17:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.799+0000 7fe264c00700 1 -- 172.21.15.49:0/504194131 shutdown_connections 2024-01-22T05:17:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.799+0000 7fe264c00700 1 --2- 172.21.15.49:0/504194131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe240005000 0x7fe24000b8e0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.799+0000 7fe264c00700 1 -- 172.21.15.49:0/504194131 >> 172.21.15.49:0/504194131 conn(0x7fe2600c6f70 msgr2=0x7fe2600c2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.799+0000 7fe264c00700 1 -- 172.21.15.49:0/504194131 shutdown_connections 2024-01-22T05:17:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.799+0000 7fe264c00700 1 -- 172.21.15.49:0/504194131 wait complete. 2024-01-22T05:17:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.803+0000 7fe264c00700 1 Processor -- start 2024-01-22T05:17:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.803+0000 7fe264c00700 1 -- start start 2024-01-22T05:17:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.803+0000 7fe264c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe240005000 0x7fe2601440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.803+0000 7fe264c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe260144590 0x7fe2600a5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.803+0000 7fe264c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2600a5b30 0x7fe2600c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.803+0000 7fe264c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2600bd240 con 0x7fe2600a5b30 2024-01-22T05:17:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.803+0000 7fe264c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2600a5f70 con 0x7fe260144590 2024-01-22T05:17:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.803+0000 7fe264c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2600bfa10 con 0x7fe240005000 2024-01-22T05:17:32.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe25fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2600a5b30 0x7fe2600c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:32.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe25fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2600a5b30 0x7fe2600c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53866/0 (socket says 172.21.15.49:53866) 2024-01-22T05:17:32.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe25fe00700 1 -- 172.21.15.49:0/1103511397 learned_addr learned my addr 172.21.15.49:0/1103511397 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:32.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe25ea00700 1 --2- 172.21.15.49:0/1103511397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe260144590 0x7fe2600a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:32.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe25f400700 1 --2- 172.21.15.49:0/1103511397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe240005000 0x7fe2601440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:32.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe25fe00700 1 -- 172.21.15.49:0/1103511397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe240005000 msgr2=0x7fe2601440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:32.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe25fe00700 1 --2- 172.21.15.49:0/1103511397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe240005000 0x7fe2601440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:32.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe25fe00700 1 -- 172.21.15.49:0/1103511397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe260144590 msgr2=0x7fe2600a5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:32.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe25fe00700 1 --2- 172.21.15.49:0/1103511397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe260144590 0x7fe2600a5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:32.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe25fe00700 1 -- 172.21.15.49:0/1103511397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2600bee00 con 0x7fe2600a5b30 2024-01-22T05:17:32.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe25fe00700 1 --2- 172.21.15.49:0/1103511397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2600a5b30 0x7fe2600c57c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fe258006000 tx=0x7fe258015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:32.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe256a00700 1 -- 172.21.15.49:0/1103511397 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2580070d0 con 0x7fe2600a5b30 2024-01-22T05:17:32.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe256a00700 1 -- 172.21.15.49:0/1103511397 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2580079b0 con 0x7fe2600a5b30 2024-01-22T05:17:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe256a00700 1 -- 172.21.15.49:0/1103511397 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258005ea0 con 0x7fe2600a5b30 2024-01-22T05:17:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe264c00700 1 -- 172.21.15.49:0/1103511397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2600bf0e0 con 0x7fe2600a5b30 2024-01-22T05:17:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.807+0000 7fe264c00700 1 -- 172.21.15.49:0/1103511397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2600bf6a0 con 0x7fe2600a5b30 2024-01-22T05:17:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.811+0000 7fe264c00700 1 -- 172.21.15.49:0/1103511397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2600bfba0 con 0x7fe2600a5b30 2024-01-22T05:17:32.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.811+0000 7fe256a00700 1 -- 172.21.15.49:0/1103511397 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe258013ae0 con 0x7fe2600a5b30 2024-01-22T05:17:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.811+0000 7fe256a00700 1 --2- 172.21.15.49:0/1103511397 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe23805a540 0x7fe23805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.811+0000 7fe256a00700 1 -- 172.21.15.49:0/1103511397 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fe258075aa0 con 0x7fe2600a5b30 2024-01-22T05:17:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.811+0000 7fe25f400700 1 --2- 172.21.15.49:0/1103511397 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe23805a540 0x7fe23805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:32.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.815+0000 7fe25f400700 1 --2- 172.21.15.49:0/1103511397 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe23805a540 0x7fe23805ca00 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fe250006b00 tx=0x7fe250008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:32.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.819+0000 7fe256a00700 1 -- 172.21.15.49:0/1103511397 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe258048f90 con 0x7fe2600a5b30 2024-01-22T05:17:32.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:32.983+0000 7fe264c00700 1 -- 172.21.15.49:0/1103511397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe26005fd40 con 0x7fe2600a5b30 2024-01-22T05:17:33.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.547+0000 7fe256a00700 1 -- 172.21.15.49:0/1103511397 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v150) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe258025070 con 0x7fe2600a5b30 2024-01-22T05:17:33.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.555+0000 7fe264c00700 1 -- 172.21.15.49:0/1103511397 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe23805a540 msgr2=0x7fe23805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:33.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.555+0000 7fe264c00700 1 --2- 172.21.15.49:0/1103511397 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe23805a540 0x7fe23805ca00 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fe250006b00 tx=0x7fe250008040).stop 2024-01-22T05:17:33.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.555+0000 7fe264c00700 1 -- 172.21.15.49:0/1103511397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2600a5b30 msgr2=0x7fe2600c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:33.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.555+0000 7fe264c00700 1 --2- 172.21.15.49:0/1103511397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2600a5b30 0x7fe2600c57c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fe258006000 tx=0x7fe258015000).stop 2024-01-22T05:17:33.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.555+0000 7fe264c00700 1 -- 172.21.15.49:0/1103511397 shutdown_connections 2024-01-22T05:17:33.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.555+0000 7fe264c00700 1 --2- 172.21.15.49:0/1103511397 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe23805a540 0x7fe23805ca00 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:33.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.555+0000 7fe264c00700 1 --2- 172.21.15.49:0/1103511397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2600a5b30 0x7fe2600c57c0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:33.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.555+0000 7fe264c00700 1 --2- 172.21.15.49:0/1103511397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe260144590 0x7fe2600a5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:33.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.555+0000 7fe264c00700 1 --2- 172.21.15.49:0/1103511397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe240005000 0x7fe2601440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:33.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.555+0000 7fe264c00700 1 -- 172.21.15.49:0/1103511397 >> 172.21.15.49:0/1103511397 conn(0x7fe2600c6f70 msgr2=0x7fe2600c42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:33.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.555+0000 7fe264c00700 1 -- 172.21.15.49:0/1103511397 shutdown_connections 2024-01-22T05:17:33.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.555+0000 7fe264c00700 1 -- 172.21.15.49:0/1103511397 wait complete. 2024-01-22T05:17:33.560 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:17:33.580 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:17:33.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.751+0000 7efd82e00700 1 Processor -- start 2024-01-22T05:17:33.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.751+0000 7efd82e00700 1 -- start start 2024-01-22T05:17:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.755+0000 7efd82e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd7c154ab0 0x7efd7c0c2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.755+0000 7efd82e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efd7c139c70 0x7efd7c0bcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.755+0000 7efd82e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c067a90 con 0x7efd7c0bcb70 2024-01-22T05:17:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.755+0000 7efd82e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7c0c36b0 con 0x7efd7c139c70 2024-01-22T05:17:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.755+0000 7efd82e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0c2b30 con 0x7efd7c154ab0 2024-01-22T05:17:33.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.755+0000 7efd7b400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efd7c0bcb70 0x7efd7c139560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37206/0 (socket says 172.21.15.49:37206) 2024-01-22T05:17:33.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd7b400700 1 -- 172.21.15.49:0/3403724157 learned_addr learned my addr 172.21.15.49:0/3403724157 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:33.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd7be00700 1 --2- 172.21.15.49:0/3403724157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd7c154ab0 0x7efd7c0c2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:33.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd80e00700 1 --2- 172.21.15.49:0/3403724157 >> v2:172.21.15.49:3300/0 conn(0x7efd7c139c70 0x7efd7c0bcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:33.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd7aa00700 1 -- 172.21.15.49:0/3403724157 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137950609 0 0) 0x7efd7c067a90 con 0x7efd7c0bcb70 2024-01-22T05:17:33.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd7aa00700 1 -- 172.21.15.49:0/3403724157 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd5c0033f0 con 0x7efd7c0bcb70 2024-01-22T05:17:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd7be00700 1 -- 172.21.15.49:0/3403724157 >> v2:172.21.15.49:3300/0 conn(0x7efd7c139c70 msgr2=0x7efd7c0bcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd7be00700 1 --2- 172.21.15.49:0/3403724157 >> v2:172.21.15.49:3300/0 conn(0x7efd7c139c70 0x7efd7c0bcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd7be00700 1 -- 172.21.15.49:0/3403724157 >> v1:172.21.15.49:6789/0 conn(0x7efd7c0bcb70 legacy=0x7efd7c139560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd7be00700 1 -- 172.21.15.49:0/3403724157 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c0c2e10 con 0x7efd7c154ab0 2024-01-22T05:17:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd7be00700 1 --2- 172.21.15.49:0/3403724157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd7c154ab0 0x7efd7c0c2520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7efd6c009760 tx=0x7efd6c009060).ready entity=mon.2 client_cookie=df22e18d598410c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:33.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd7aa00700 1 -- 172.21.15.49:0/3403724157 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c00d4a0 con 0x7efd7c154ab0 2024-01-22T05:17:33.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd7aa00700 1 -- 172.21.15.49:0/3403724157 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c00d600 con 0x7efd7c154ab0 2024-01-22T05:17:33.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd7aa00700 1 -- 172.21.15.49:0/3403724157 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c00d980 con 0x7efd7c154ab0 2024-01-22T05:17:33.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd82e00700 1 -- 172.21.15.49:0/3403724157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd7c154ab0 msgr2=0x7efd7c0c2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:33.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd82e00700 1 --2- 172.21.15.49:0/3403724157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd7c154ab0 0x7efd7c0c2520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7efd6c009760 tx=0x7efd6c009060).stop 2024-01-22T05:17:33.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd82e00700 1 -- 172.21.15.49:0/3403724157 shutdown_connections 2024-01-22T05:17:33.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd82e00700 1 --2- 172.21.15.49:0/3403724157 >> v2:172.21.15.49:3300/0 conn(0x7efd7c139c70 0x7efd7c0bcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.759+0000 7efd82e00700 1 --2- 172.21.15.49:0/3403724157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd7c154ab0 0x7efd7c0c2520 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.763+0000 7efd82e00700 1 -- 172.21.15.49:0/3403724157 >> 172.21.15.49:0/3403724157 conn(0x7efd7c0c7830 msgr2=0x7efd7c0c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.763+0000 7efd82e00700 1 -- 172.21.15.49:0/3403724157 shutdown_connections 2024-01-22T05:17:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.763+0000 7efd82e00700 1 -- 172.21.15.49:0/3403724157 wait complete. 2024-01-22T05:17:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.767+0000 7efd82e00700 1 Processor -- start 2024-01-22T05:17:33.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.767+0000 7efd82e00700 1 -- start start 2024-01-22T05:17:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.767+0000 7efd82e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd7c0bcb70 0x7efd7c0ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.767+0000 7efd82e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd7c139c70 0x7efd7c0a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.767+0000 7efd82e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd7c154ab0 0x7efd7c0aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.767+0000 7efd82e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0be170 con 0x7efd7c154ab0 2024-01-22T05:17:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.767+0000 7efd82e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0be450 con 0x7efd7c0bcb70 2024-01-22T05:17:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.767+0000 7efd82e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0be730 con 0x7efd7c139c70 2024-01-22T05:17:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.767+0000 7efd80e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd7c154ab0 0x7efd7c0aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.767+0000 7efd80e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd7c154ab0 0x7efd7c0aa850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54116/0 (socket says 172.21.15.49:54116) 2024-01-22T05:17:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.767+0000 7efd80e00700 1 -- 172.21.15.49:0/1103116716 learned_addr learned my addr 172.21.15.49:0/1103116716 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:33.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.767+0000 7efd7b400700 1 --2- 172.21.15.49:0/1103116716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd7c139c70 0x7efd7c0a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:33.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.767+0000 7efd7be00700 1 --2- 172.21.15.49:0/1103116716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd7c0bcb70 0x7efd7c0ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:33.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.771+0000 7efd80e00700 1 -- 172.21.15.49:0/1103116716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd7c139c70 msgr2=0x7efd7c0a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:33.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.771+0000 7efd80e00700 1 --2- 172.21.15.49:0/1103116716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd7c139c70 0x7efd7c0a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:33.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.771+0000 7efd80e00700 1 -- 172.21.15.49:0/1103116716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd7c0bcb70 msgr2=0x7efd7c0ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:33.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.771+0000 7efd80e00700 1 --2- 172.21.15.49:0/1103116716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd7c0bcb70 0x7efd7c0ac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:33.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.771+0000 7efd80e00700 1 -- 172.21.15.49:0/1103116716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c0092a0 con 0x7efd7c154ab0 2024-01-22T05:17:33.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.771+0000 7efd7b400700 1 --2- 172.21.15.49:0/1103116716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd7c139c70 0x7efd7c0a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:33.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.771+0000 7efd80e00700 1 --2- 172.21.15.49:0/1103116716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd7c154ab0 0x7efd7c0aa850 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7efd74009ef0 tx=0x7efd7400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:33.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.771+0000 7efd73400700 1 -- 172.21.15.49:0/1103116716 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400cc50 con 0x7efd7c154ab0 2024-01-22T05:17:33.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.771+0000 7efd73400700 1 -- 172.21.15.49:0/1103116716 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7400f040 con 0x7efd7c154ab0 2024-01-22T05:17:33.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.771+0000 7efd73400700 1 -- 172.21.15.49:0/1103116716 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74013400 con 0x7efd7c154ab0 2024-01-22T05:17:33.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.771+0000 7efd82e00700 1 -- 172.21.15.49:0/1103116716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7c0bea10 con 0x7efd7c154ab0 2024-01-22T05:17:33.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.771+0000 7efd82e00700 1 -- 172.21.15.49:0/1103116716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7c0bde40 con 0x7efd7c154ab0 2024-01-22T05:17:33.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.771+0000 7efd82e00700 1 -- 172.21.15.49:0/1103116716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7c065120 con 0x7efd7c154ab0 2024-01-22T05:17:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.775+0000 7efd73400700 1 -- 172.21.15.49:0/1103116716 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7efd74013770 con 0x7efd7c154ab0 2024-01-22T05:17:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.775+0000 7efd73400700 1 --2- 172.21.15.49:0/1103116716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efd5405a510 0x7efd5405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.775+0000 7efd73400700 1 -- 172.21.15.49:0/1103116716 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6237+0+0 (secure 0 0 0) 0x7efd74075210 con 0x7efd7c154ab0 2024-01-22T05:17:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.775+0000 7efd7be00700 1 --2- 172.21.15.49:0/1103116716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efd5405a510 0x7efd5405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.775+0000 7efd7be00700 1 --2- 172.21.15.49:0/1103116716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efd5405a510 0x7efd5405c9d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7efd7c068c60 tx=0x7efd6c016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:33.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.783+0000 7efd73400700 1 -- 172.21.15.49:0/1103116716 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efd740488c0 con 0x7efd7c154ab0 2024-01-22T05:17:33.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:33.943+0000 7efd82e00700 1 -- 172.21.15.49:0/1103116716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efd7c062540 con 0x7efd7c154ab0 2024-01-22T05:17:34.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.559+0000 7efd73400700 1 -- 172.21.15.49:0/1103116716 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v151) v1 ==== 169+0+0 (secure 0 0 0) 0x7efd7404bee0 con 0x7efd7c154ab0 2024-01-22T05:17:34.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.567+0000 7efd82e00700 1 -- 172.21.15.49:0/1103116716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efd5405a510 msgr2=0x7efd5405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:34.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.567+0000 7efd82e00700 1 --2- 172.21.15.49:0/1103116716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efd5405a510 0x7efd5405c9d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7efd7c068c60 tx=0x7efd6c016000).stop 2024-01-22T05:17:34.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.567+0000 7efd82e00700 1 -- 172.21.15.49:0/1103116716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd7c154ab0 msgr2=0x7efd7c0aa850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:34.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.567+0000 7efd82e00700 1 --2- 172.21.15.49:0/1103116716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd7c154ab0 0x7efd7c0aa850 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7efd74009ef0 tx=0x7efd7400b040).stop 2024-01-22T05:17:34.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.567+0000 7efd82e00700 1 -- 172.21.15.49:0/1103116716 shutdown_connections 2024-01-22T05:17:34.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.567+0000 7efd82e00700 1 --2- 172.21.15.49:0/1103116716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efd5405a510 0x7efd5405c9d0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:34.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.567+0000 7efd82e00700 1 --2- 172.21.15.49:0/1103116716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd7c154ab0 0x7efd7c0aa850 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:34.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.567+0000 7efd82e00700 1 --2- 172.21.15.49:0/1103116716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd7c139c70 0x7efd7c0a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:34.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.567+0000 7efd82e00700 1 --2- 172.21.15.49:0/1103116716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd7c0bcb70 0x7efd7c0ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:34.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.567+0000 7efd82e00700 1 -- 172.21.15.49:0/1103116716 >> 172.21.15.49:0/1103116716 conn(0x7efd7c0c7830 msgr2=0x7efd7c062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:34.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.571+0000 7efd82e00700 1 -- 172.21.15.49:0/1103116716 shutdown_connections 2024-01-22T05:17:34.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.571+0000 7efd82e00700 1 -- 172.21.15.49:0/1103116716 wait complete. 2024-01-22T05:17:34.574 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-01-22T05:17:34.595 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-22T05:17:34.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.763+0000 7fc36b600700 1 Processor -- start 2024-01-22T05:17:34.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.767+0000 7fc36b600700 1 -- start start 2024-01-22T05:17:34.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.767+0000 7fc36b600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc3640a8ce0 0x7fc364153b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:34.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.767+0000 7fc36b600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc3640a90c0 0x7fc364062640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:34.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.767+0000 7fc36b600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc364157d30 con 0x7fc364154010 2024-01-22T05:17:34.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.767+0000 7fc36b600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc364157a30 con 0x7fc3640a8ce0 2024-01-22T05:17:34.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.767+0000 7fc36b600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3641588d0 con 0x7fc3640a90c0 2024-01-22T05:17:34.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.771+0000 7fc368c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc3640a8ce0 0x7fc364153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:34.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.771+0000 7fc368c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc3640a8ce0 0x7fc364153b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54128/0 (socket says 172.21.15.49:54128) 2024-01-22T05:17:34.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.771+0000 7fc368c00700 1 -- 172.21.15.49:0/2132422720 learned_addr learned my addr 172.21.15.49:0/2132422720 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:34.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.771+0000 7fc368c00700 1 -- 172.21.15.49:0/2132422720 >> v2:172.21.15.110:3300/0 conn(0x7fc3640a90c0 msgr2=0x7fc364062640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:34.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.771+0000 7fc368c00700 1 --2- 172.21.15.49:0/2132422720 >> v2:172.21.15.110:3300/0 conn(0x7fc3640a90c0 0x7fc364062640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:17:34.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.771+0000 7fc368c00700 1 -- 172.21.15.49:0/2132422720 >> v1:172.21.15.110:6789/0 conn(0x7fc364154010 legacy=0x7fc3641581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:34.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.771+0000 7fc368c00700 1 -- 172.21.15.49:0/2132422720 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3640c42c0 con 0x7fc3640a8ce0 2024-01-22T05:17:34.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.771+0000 7fc368c00700 1 --2- 172.21.15.49:0/2132422720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640a8ce0 0x7fc364153b20 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7fc3640643b0 tx=0x7fc3540090f0).ready entity=mon.0 client_cookie=148763743707b3e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:34.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.771+0000 7fc363400700 1 -- 172.21.15.49:0/2132422720 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35400b600 con 0x7fc3640a8ce0 2024-01-22T05:17:34.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.771+0000 7fc363400700 1 -- 172.21.15.49:0/2132422720 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35400b760 con 0x7fc3640a8ce0 2024-01-22T05:17:34.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.771+0000 7fc363400700 1 -- 172.21.15.49:0/2132422720 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35400bae0 con 0x7fc3640a8ce0 2024-01-22T05:17:34.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.775+0000 7fc36b600700 1 -- 172.21.15.49:0/2132422720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640a8ce0 msgr2=0x7fc364153b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:34.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.775+0000 7fc36b600700 1 --2- 172.21.15.49:0/2132422720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640a8ce0 0x7fc364153b20 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7fc3640643b0 tx=0x7fc3540090f0).stop 2024-01-22T05:17:34.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.775+0000 7fc36b600700 1 -- 172.21.15.49:0/2132422720 shutdown_connections 2024-01-22T05:17:34.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.775+0000 7fc36b600700 1 --2- 172.21.15.49:0/2132422720 >> v2:172.21.15.110:3300/0 conn(0x7fc3640a90c0 0x7fc364062640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:17:34.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.775+0000 7fc36b600700 1 --2- 172.21.15.49:0/2132422720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640a8ce0 0x7fc364153b20 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:34.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.775+0000 7fc36b600700 1 -- 172.21.15.49:0/2132422720 >> 172.21.15.49:0/2132422720 conn(0x7fc364062230 msgr2=0x7fc3640ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:34.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.775+0000 7fc36b600700 1 -- 172.21.15.49:0/2132422720 shutdown_connections 2024-01-22T05:17:34.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.775+0000 7fc36b600700 1 -- 172.21.15.49:0/2132422720 wait complete. 2024-01-22T05:17:34.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.779+0000 7fc36b600700 1 Processor -- start 2024-01-22T05:17:34.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.779+0000 7fc36b600700 1 -- start start 2024-01-22T05:17:34.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc36b600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3640a8ce0 0x7fc3640a20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:34.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc36b600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640a90c0 0x7fc36409fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:34.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc36b600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc364154010 0x7fc3640a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:34.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc36b600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640a0ec0 con 0x7fc3640a90c0 2024-01-22T05:17:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc36b600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3641647c0 con 0x7fc3640a8ce0 2024-01-22T05:17:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc36b600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640a0360 con 0x7fc364154010 2024-01-22T05:17:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc369600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc364154010 0x7fc3640a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc369600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc364154010 0x7fc3640a7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:48710/0 (socket says 172.21.15.49:48710) 2024-01-22T05:17:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc369600700 1 -- 172.21.15.49:0/3915151778 learned_addr learned my addr 172.21.15.49:0/3915151778 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc363e00700 1 --2- 172.21.15.49:0/3915151778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640a90c0 0x7fc36409fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc368c00700 1 --2- 172.21.15.49:0/3915151778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3640a8ce0 0x7fc3640a20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc369600700 1 -- 172.21.15.49:0/3915151778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3640a8ce0 msgr2=0x7fc3640a20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:34.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc369600700 1 --2- 172.21.15.49:0/3915151778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3640a8ce0 0x7fc3640a20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:34.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc369600700 1 -- 172.21.15.49:0/3915151778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640a90c0 msgr2=0x7fc36409fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:34.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc369600700 1 --2- 172.21.15.49:0/3915151778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640a90c0 0x7fc36409fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:34.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc369600700 1 -- 172.21.15.49:0/3915151778 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354009370 con 0x7fc364154010 2024-01-22T05:17:34.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc363e00700 1 --2- 172.21.15.49:0/3915151778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640a90c0 0x7fc36409fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:34.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.783+0000 7fc369600700 1 --2- 172.21.15.49:0/3915151778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc364154010 0x7fc3640a7fb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc35c00bc30 tx=0x7fc35c009840).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:34.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.787+0000 7fc35be00700 1 -- 172.21.15.49:0/3915151778 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c00c7a0 con 0x7fc364154010 2024-01-22T05:17:34.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.787+0000 7fc35be00700 1 -- 172.21.15.49:0/3915151778 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c010070 con 0x7fc364154010 2024-01-22T05:17:34.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.787+0000 7fc35be00700 1 -- 172.21.15.49:0/3915151778 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c00c960 con 0x7fc364154010 2024-01-22T05:17:34.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.787+0000 7fc36b600700 1 -- 172.21.15.49:0/3915151778 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3640a0620 con 0x7fc364154010 2024-01-22T05:17:34.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.787+0000 7fc36b600700 1 -- 172.21.15.49:0/3915151778 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3640a0be0 con 0x7fc364154010 2024-01-22T05:17:34.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.791+0000 7fc36b600700 1 -- 172.21.15.49:0/3915151778 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc364164590 con 0x7fc364154010 2024-01-22T05:17:34.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.791+0000 7fc35be00700 1 -- 172.21.15.49:0/3915151778 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc35c00cd10 con 0x7fc364154010 2024-01-22T05:17:34.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.791+0000 7fc35be00700 1 --2- 172.21.15.49:0/3915151778 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc33c05a510 0x7fc33c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:34.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.791+0000 7fc35be00700 1 -- 172.21.15.49:0/3915151778 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5794+0+0 (secure 0 0 0) 0x7fc35c074010 con 0x7fc364154010 2024-01-22T05:17:34.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.795+0000 7fc368c00700 1 --2- 172.21.15.49:0/3915151778 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc33c05a510 0x7fc33c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:34.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.795+0000 7fc368c00700 1 --2- 172.21.15.49:0/3915151778 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc33c05a510 0x7fc33c05c9d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fc354009130 tx=0x7fc354017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.799+0000 7fc35be00700 1 -- 172.21.15.49:0/3915151778 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc364164590 con 0x7fc364154010 2024-01-22T05:17:34.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.979+0000 7fc36b600700 1 -- 172.21.15.49:0/3915151778 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc364164590 con 0x7fc364154010 2024-01-22T05:17:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.991+0000 7fc35be00700 1 -- 172.21.15.49:0/3915151778 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc364164590 con 0x7fc364154010 2024-01-22T05:17:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.991+0000 7fc36b600700 1 -- 172.21.15.49:0/3915151778 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc33c05a510 msgr2=0x7fc33c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.991+0000 7fc36b600700 1 --2- 172.21.15.49:0/3915151778 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc33c05a510 0x7fc33c05c9d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fc354009130 tx=0x7fc354017000).stop 2024-01-22T05:17:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.991+0000 7fc36b600700 1 -- 172.21.15.49:0/3915151778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc364154010 msgr2=0x7fc3640a7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.991+0000 7fc36b600700 1 --2- 172.21.15.49:0/3915151778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc364154010 0x7fc3640a7fb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc35c00bc30 tx=0x7fc35c009840).stop 2024-01-22T05:17:34.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.991+0000 7fc36b600700 1 -- 172.21.15.49:0/3915151778 shutdown_connections 2024-01-22T05:17:34.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.991+0000 7fc36b600700 1 --2- 172.21.15.49:0/3915151778 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc33c05a510 0x7fc33c05c9d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:34.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.991+0000 7fc36b600700 1 --2- 172.21.15.49:0/3915151778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc364154010 0x7fc3640a7fb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:34.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.991+0000 7fc36b600700 1 --2- 172.21.15.49:0/3915151778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640a90c0 0x7fc36409fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:34.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.991+0000 7fc36b600700 1 --2- 172.21.15.49:0/3915151778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3640a8ce0 0x7fc3640a20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:34.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.991+0000 7fc36b600700 1 -- 172.21.15.49:0/3915151778 >> 172.21.15.49:0/3915151778 conn(0x7fc364062230 msgr2=0x7fc364151cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:34.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.991+0000 7fc36b600700 1 -- 172.21.15.49:0/3915151778 shutdown_connections 2024-01-22T05:17:34.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:34.991+0000 7fc36b600700 1 -- 172.21.15.49:0/3915151778 wait complete. 2024-01-22T05:17:35.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-01-22T05:17:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.171+0000 7f969ec00700 1 Processor -- start 2024-01-22T05:17:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.175+0000 7f969ec00700 1 -- start start 2024-01-22T05:17:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f969ec00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9698151d70 0x7f96980be360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f969ec00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f96980be850 0x7f96980a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f969ec00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96980bf4f0 con 0x7f9698151990 2024-01-22T05:17:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f969ec00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96980ab8b0 con 0x7f96980be850 2024-01-22T05:17:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f969ec00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9698067e00 con 0x7f9698151d70 2024-01-22T05:17:35.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f9697e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9698151990 0x7f96980684a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37210/0 (socket says 172.21.15.49:37210) 2024-01-22T05:17:35.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f9697e00700 1 -- 172.21.15.49:0/616321606 learned_addr learned my addr 172.21.15.49:0/616321606 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:35.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f9697400700 1 --2- 172.21.15.49:0/616321606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9698151d70 0x7f96980be360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:35.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f969d600700 1 --2- 172.21.15.49:0/616321606 >> v2:172.21.15.110:3300/0 conn(0x7f96980be850 0x7f96980a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:35.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f9696a00700 1 -- 172.21.15.49:0/616321606 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1526581632 0 0) 0x7f96980bf4f0 con 0x7f9698151990 2024-01-22T05:17:35.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f969d600700 1 -- 172.21.15.49:0/616321606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9698151d70 msgr2=0x7f96980be360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:35.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f969d600700 1 --2- 172.21.15.49:0/616321606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9698151d70 0x7f96980be360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:35.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f969d600700 1 -- 172.21.15.49:0/616321606 >> v1:172.21.15.49:6789/0 conn(0x7f9698151990 legacy=0x7f96980684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:35.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f969d600700 1 -- 172.21.15.49:0/616321606 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96980680e0 con 0x7f96980be850 2024-01-22T05:17:35.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f9697400700 1 --2- 172.21.15.49:0/616321606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9698151d70 0x7f96980be360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:35.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f969d600700 1 --2- 172.21.15.49:0/616321606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96980be850 0x7f96980a8970 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f9690009e60 tx=0x7f9690009780).ready entity=mon.1 client_cookie=4f0e2a7e19d81a1c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:35.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f9696a00700 1 -- 172.21.15.49:0/616321606 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969000e070 con 0x7f96980be850 2024-01-22T05:17:35.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f9696a00700 1 -- 172.21.15.49:0/616321606 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969000bb60 con 0x7f96980be850 2024-01-22T05:17:35.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.179+0000 7f9696a00700 1 -- 172.21.15.49:0/616321606 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690012410 con 0x7f96980be850 2024-01-22T05:17:35.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.183+0000 7f969ec00700 1 -- 172.21.15.49:0/616321606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96980be850 msgr2=0x7f96980a8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:35.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.183+0000 7f969ec00700 1 --2- 172.21.15.49:0/616321606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96980be850 0x7f96980a8970 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f9690009e60 tx=0x7f9690009780).stop 2024-01-22T05:17:35.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.183+0000 7f969ec00700 1 -- 172.21.15.49:0/616321606 shutdown_connections 2024-01-22T05:17:35.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.183+0000 7f969ec00700 1 --2- 172.21.15.49:0/616321606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96980be850 0x7f96980a8970 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:35.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.183+0000 7f969ec00700 1 --2- 172.21.15.49:0/616321606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9698151d70 0x7f96980be360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:35.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.183+0000 7f969ec00700 1 -- 172.21.15.49:0/616321606 >> 172.21.15.49:0/616321606 conn(0x7f96980c5860 msgr2=0x7f96980c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:35.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.183+0000 7f969ec00700 1 -- 172.21.15.49:0/616321606 shutdown_connections 2024-01-22T05:17:35.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.183+0000 7f969ec00700 1 -- 172.21.15.49:0/616321606 wait complete. 2024-01-22T05:17:35.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.187+0000 7f969ec00700 1 Processor -- start 2024-01-22T05:17:35.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.187+0000 7f969ec00700 1 -- start start 2024-01-22T05:17:35.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.187+0000 7f969ec00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96980be850 0x7f9698156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:35.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.187+0000 7f969ec00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9698151990 0x7f96980ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:35.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.187+0000 7f969ec00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9698151d70 0x7f969814ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:35.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.187+0000 7f969ec00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9698156600 con 0x7f9698151d70 2024-01-22T05:17:35.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.187+0000 7f969ec00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9698063b70 con 0x7f9698151990 2024-01-22T05:17:35.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.187+0000 7f969ec00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9698152480 con 0x7f96980be850 2024-01-22T05:17:35.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.187+0000 7f969d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9698151d70 0x7f969814ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:35.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.187+0000 7f969d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9698151d70 0x7f969814ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54148/0 (socket says 172.21.15.49:54148) 2024-01-22T05:17:35.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.187+0000 7f969d600700 1 -- 172.21.15.49:0/2359903745 learned_addr learned my addr 172.21.15.49:0/2359903745 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:35.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.191+0000 7f9697e00700 1 --2- 172.21.15.49:0/2359903745 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96980be850 0x7f9698156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:35.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.191+0000 7f9697400700 1 --2- 172.21.15.49:0/2359903745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9698151990 0x7f96980ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:35.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.191+0000 7f969d600700 1 -- 172.21.15.49:0/2359903745 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96980be850 msgr2=0x7f9698156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:35.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.191+0000 7f969d600700 1 --2- 172.21.15.49:0/2359903745 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96980be850 0x7f9698156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:35.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.191+0000 7f969d600700 1 -- 172.21.15.49:0/2359903745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9698151990 msgr2=0x7f96980ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:35.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.191+0000 7f969d600700 1 --2- 172.21.15.49:0/2359903745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9698151990 0x7f96980ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:35.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.191+0000 7f969d600700 1 -- 172.21.15.49:0/2359903745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96800092a0 con 0x7f9698151d70 2024-01-22T05:17:35.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.191+0000 7f969d600700 1 --2- 172.21.15.49:0/2359903745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9698151d70 0x7f969814ea70 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f96900094c0 tx=0x7f9690009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:35.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.191+0000 7f968f400700 1 -- 172.21.15.49:0/2359903745 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690012410 con 0x7f9698151d70 2024-01-22T05:17:35.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.191+0000 7f968f400700 1 -- 172.21.15.49:0/2359903745 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969001d630 con 0x7f9698151d70 2024-01-22T05:17:35.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.191+0000 7f968f400700 1 -- 172.21.15.49:0/2359903745 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969001d9f0 con 0x7f9698151d70 2024-01-22T05:17:35.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.191+0000 7f969ec00700 1 -- 172.21.15.49:0/2359903745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9690009a20 con 0x7f9698151d70 2024-01-22T05:17:35.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.191+0000 7f969ec00700 1 -- 172.21.15.49:0/2359903745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9698152150 con 0x7f9698151d70 2024-01-22T05:17:35.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.195+0000 7f969ec00700 1 -- 172.21.15.49:0/2359903745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9698047060 con 0x7f9698151d70 2024-01-22T05:17:35.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.195+0000 7f968f400700 1 -- 172.21.15.49:0/2359903745 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9690003040 con 0x7f9698151d70 2024-01-22T05:17:35.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.195+0000 7f968f400700 1 --2- 172.21.15.49:0/2359903745 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f967005a510 0x7f967005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:35.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.195+0000 7f968f400700 1 -- 172.21.15.49:0/2359903745 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f9690076530 con 0x7f9698151d70 2024-01-22T05:17:35.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.195+0000 7f9697e00700 1 --2- 172.21.15.49:0/2359903745 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f967005a510 0x7f967005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:35.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.199+0000 7f9697e00700 1 --2- 172.21.15.49:0/2359903745 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f967005a510 0x7f967005c9d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f96880011e0 tx=0x7f9688007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:35.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.203+0000 7f968f400700 1 -- 172.21.15.49:0/2359903745 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9690049e10 con 0x7f9698151d70 2024-01-22T05:17:35.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.419+0000 7f969ec00700 1 -- 172.21.15.49:0/2359903745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) v1 -- 0x7f96980bf180 con 0x7f9698151d70 2024-01-22T05:17:35.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.567+0000 7f968f400700 1 -- 172.21.15.49:0/2359903745 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v601) v1 ==== 166+0+0 (secure 0 0 0) 0x7f969004d430 con 0x7f9698151d70 2024-01-22T05:17:35.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.571+0000 7f969ec00700 1 -- 172.21.15.49:0/2359903745 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f967005a510 msgr2=0x7f967005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:35.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.571+0000 7f969ec00700 1 --2- 172.21.15.49:0/2359903745 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f967005a510 0x7f967005c9d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f96880011e0 tx=0x7f9688007bb0).stop 2024-01-22T05:17:35.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.571+0000 7f969ec00700 1 -- 172.21.15.49:0/2359903745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9698151d70 msgr2=0x7f969814ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:35.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.571+0000 7f969ec00700 1 --2- 172.21.15.49:0/2359903745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9698151d70 0x7f969814ea70 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f96900094c0 tx=0x7f9690009780).stop 2024-01-22T05:17:35.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.571+0000 7f969ec00700 1 -- 172.21.15.49:0/2359903745 shutdown_connections 2024-01-22T05:17:35.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.571+0000 7f969ec00700 1 --2- 172.21.15.49:0/2359903745 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f967005a510 0x7f967005c9d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:35.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.571+0000 7f969ec00700 1 --2- 172.21.15.49:0/2359903745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9698151d70 0x7f969814ea70 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:35.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.571+0000 7f969ec00700 1 --2- 172.21.15.49:0/2359903745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9698151990 0x7f96980ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:35.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.571+0000 7f969ec00700 1 --2- 172.21.15.49:0/2359903745 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96980be850 0x7f9698156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:35.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.571+0000 7f969ec00700 1 -- 172.21.15.49:0/2359903745 >> 172.21.15.49:0/2359903745 conn(0x7f96980c5860 msgr2=0x7f96980a8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:35.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.571+0000 7f969ec00700 1 -- 172.21.15.49:0/2359903745 shutdown_connections 2024-01-22T05:17:35.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.571+0000 7f969ec00700 1 -- 172.21.15.49:0/2359903745 wait complete. 2024-01-22T05:17:35.599 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-01-22T05:17:35.599 INFO:tasks.cephfs_test_runner:Starting test: test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-01-22T05:17:35.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-01-22T05:17:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.751+0000 7f7ef9400700 1 Processor -- start 2024-01-22T05:17:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.751+0000 7f7ef9400700 1 -- start start 2024-01-22T05:17:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.755+0000 7f7ef9400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef40c3a70 0x7f7ef40be7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.755+0000 7f7ef9400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef40c3f00 con 0x7f7ef4155c60 2024-01-22T05:17:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.755+0000 7f7ef9400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef40bdc10 con 0x7f7ef40c3690 2024-01-22T05:17:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.755+0000 7f7ef9400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef4068e10 con 0x7f7ef40c3a70 2024-01-22T05:17:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.755+0000 7f7ef1e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7ef4155c60 0x7f7ef40be0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37216/0 (socket says 172.21.15.49:37216) 2024-01-22T05:17:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.755+0000 7f7ef1e00700 1 -- 172.21.15.49:0/2088084651 learned_addr learned my addr 172.21.15.49:0/2088084651 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.755+0000 7f7ef3200700 1 --2- 172.21.15.49:0/2088084651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef40c3a70 0x7f7ef40be7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.755+0000 7f7ef1400700 1 -- 172.21.15.49:0/2088084651 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701471411 0 0) 0x7f7edc001110 con 0x7f7ef4155c60 2024-01-22T05:17:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.755+0000 7f7ef1400700 1 -- 172.21.15.49:0/2088084651 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed40033f0 con 0x7f7ef4155c60 2024-01-22T05:17:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.755+0000 7f7ef1400700 1 -- 172.21.15.49:0/2088084651 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408009729 0 0) 0x7f7ef40bdc10 con 0x7f7ef40c3690 2024-01-22T05:17:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.755+0000 7f7ef1400700 1 -- 172.21.15.49:0/2088084651 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7edc001110 con 0x7f7ef40c3690 2024-01-22T05:17:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.755+0000 7f7ef3200700 1 -- 172.21.15.49:0/2088084651 >> v1:172.21.15.110:6789/0 conn(0x7f7ef40c3690 legacy=0x7f7ef4155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.755+0000 7f7ef3200700 1 -- 172.21.15.49:0/2088084651 >> v1:172.21.15.49:6789/0 conn(0x7f7ef4155c60 legacy=0x7f7ef40be0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.755+0000 7f7ef3200700 1 -- 172.21.15.49:0/2088084651 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef40690f0 con 0x7f7ef40c3a70 2024-01-22T05:17:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.755+0000 7f7ef3200700 1 --2- 172.21.15.49:0/2088084651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef40c3a70 0x7f7ef40be7b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f7eec009e90 tx=0x7f7eec009780).ready entity=mon.2 client_cookie=431d43ab6018e5d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.759+0000 7f7ef1400700 1 -- 172.21.15.49:0/2088084651 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00e070 con 0x7f7ef40c3a70 2024-01-22T05:17:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.759+0000 7f7ef1400700 1 -- 172.21.15.49:0/2088084651 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec00bab0 con 0x7f7ef40c3a70 2024-01-22T05:17:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.759+0000 7f7ef1400700 1 -- 172.21.15.49:0/2088084651 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00be30 con 0x7f7ef40c3a70 2024-01-22T05:17:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.759+0000 7f7ef9400700 1 -- 172.21.15.49:0/2088084651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef40c3a70 msgr2=0x7f7ef40be7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.759+0000 7f7ef9400700 1 --2- 172.21.15.49:0/2088084651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef40c3a70 0x7f7ef40be7b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f7eec009e90 tx=0x7f7eec009780).stop 2024-01-22T05:17:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.759+0000 7f7ef9400700 1 -- 172.21.15.49:0/2088084651 shutdown_connections 2024-01-22T05:17:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.759+0000 7f7ef9400700 1 --2- 172.21.15.49:0/2088084651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef40c3a70 0x7f7ef40be7b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.759+0000 7f7ef9400700 1 -- 172.21.15.49:0/2088084651 >> 172.21.15.49:0/2088084651 conn(0x7f7ef40c51c0 msgr2=0x7f7ef40c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.759+0000 7f7ef9400700 1 -- 172.21.15.49:0/2088084651 shutdown_connections 2024-01-22T05:17:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.759+0000 7f7ef9400700 1 -- 172.21.15.49:0/2088084651 wait complete. 2024-01-22T05:17:35.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.763+0000 7f7ef9400700 1 Processor -- start 2024-01-22T05:17:35.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.763+0000 7f7ef9400700 1 -- start start 2024-01-22T05:17:35.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.763+0000 7f7ef9400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ef40c3690 0x7f7ef4168580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:35.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.763+0000 7f7ef9400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ef40c3a70 0x7f7ef4163da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:35.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.763+0000 7f7ef9400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef4155c60 0x7f7ef40adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:35.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.763+0000 7f7ef9400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40adb50 con 0x7f7ef40c3a70 2024-01-22T05:17:35.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.763+0000 7f7ef9400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40641f0 con 0x7f7ef40c3690 2024-01-22T05:17:35.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.763+0000 7f7ef9400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef4168a70 con 0x7f7ef4155c60 2024-01-22T05:17:35.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.763+0000 7f7ef1e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ef40c3a70 0x7f7ef4163da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:35.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.763+0000 7f7ef2800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ef40c3690 0x7f7ef4168580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:35.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.763+0000 7f7ef1e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ef40c3a70 0x7f7ef4163da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54150/0 (socket says 172.21.15.49:54150) 2024-01-22T05:17:35.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.763+0000 7f7ef1e00700 1 -- 172.21.15.49:0/4151741499 learned_addr learned my addr 172.21.15.49:0/4151741499 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:35.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.763+0000 7f7ef3200700 1 --2- 172.21.15.49:0/4151741499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef4155c60 0x7f7ef40adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:35.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.767+0000 7f7ef1e00700 1 -- 172.21.15.49:0/4151741499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef4155c60 msgr2=0x7f7ef40adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:35.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.767+0000 7f7ef1e00700 1 --2- 172.21.15.49:0/4151741499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef4155c60 0x7f7ef40adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:35.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.767+0000 7f7ef1e00700 1 -- 172.21.15.49:0/4151741499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ef40c3690 msgr2=0x7f7ef4168580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:35.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.767+0000 7f7ef1e00700 1 --2- 172.21.15.49:0/4151741499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ef40c3690 0x7f7ef4168580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:35.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.767+0000 7f7ef1e00700 1 -- 172.21.15.49:0/4151741499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec009a20 con 0x7f7ef40c3a70 2024-01-22T05:17:35.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.767+0000 7f7ef2800700 1 --2- 172.21.15.49:0/4151741499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ef40c3690 0x7f7ef4168580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:35.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.767+0000 7f7ef1e00700 1 --2- 172.21.15.49:0/4151741499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ef40c3a70 0x7f7ef4163da0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f7edc00c7c0 tx=0x7f7edc007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:35.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.767+0000 7f7eea000700 1 -- 172.21.15.49:0/4151741499 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0072e0 con 0x7f7ef40c3a70 2024-01-22T05:17:35.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.767+0000 7f7eea000700 1 -- 172.21.15.49:0/4151741499 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc007440 con 0x7f7ef40c3a70 2024-01-22T05:17:35.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.767+0000 7f7eea000700 1 -- 172.21.15.49:0/4151741499 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0057a0 con 0x7f7ef40c3a70 2024-01-22T05:17:35.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.767+0000 7f7ef9400700 1 -- 172.21.15.49:0/4151741499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef40ad820 con 0x7f7ef40c3a70 2024-01-22T05:17:35.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.767+0000 7f7ef9400700 1 -- 172.21.15.49:0/4151741499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef40abe20 con 0x7f7ef40c3a70 2024-01-22T05:17:35.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.767+0000 7f7ef9400700 1 -- 172.21.15.49:0/4151741499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef40ad680 con 0x7f7ef40c3a70 2024-01-22T05:17:35.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.771+0000 7f7eea000700 1 -- 172.21.15.49:0/4151741499 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7edc005b90 con 0x7f7ef40c3a70 2024-01-22T05:17:35.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.771+0000 7f7eea000700 1 --2- 172.21.15.49:0/4151741499 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ecc05a540 0x7f7ecc05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:35.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.771+0000 7f7eea000700 1 -- 172.21.15.49:0/4151741499 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f7edc073ce0 con 0x7f7ef40c3a70 2024-01-22T05:17:35.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.771+0000 7f7ef2800700 1 --2- 172.21.15.49:0/4151741499 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ecc05a540 0x7f7ecc05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:35.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.771+0000 7f7ef2800700 1 --2- 172.21.15.49:0/4151741499 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ecc05a540 0x7f7ecc05ca00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f7ee4001010 tx=0x7f7ee4007c60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:35.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:35.775+0000 7f7eea000700 1 -- 172.21.15.49:0/4151741499 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7ef40ad680 con 0x7f7ef40c3a70 2024-01-22T05:17:36.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.007+0000 7f7ef9400700 1 -- 172.21.15.49:0/4151741499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) v1 -- 0x7f7ef40c3f00 con 0x7f7ef40c3a70 2024-01-22T05:17:36.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.571+0000 7f7eea000700 1 -- 172.21.15.49:0/4151741499 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v602) v1 ==== 143+0+0 (secure 0 0 0) 0x7f7ef40c3f00 con 0x7f7ef40c3a70 2024-01-22T05:17:36.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.575+0000 7f7ef9400700 1 -- 172.21.15.49:0/4151741499 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ecc05a540 msgr2=0x7f7ecc05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:36.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.575+0000 7f7ef9400700 1 --2- 172.21.15.49:0/4151741499 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ecc05a540 0x7f7ecc05ca00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f7ee4001010 tx=0x7f7ee4007c60).stop 2024-01-22T05:17:36.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.575+0000 7f7ef9400700 1 -- 172.21.15.49:0/4151741499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ef40c3a70 msgr2=0x7f7ef4163da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:36.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.575+0000 7f7ef9400700 1 --2- 172.21.15.49:0/4151741499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ef40c3a70 0x7f7ef4163da0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f7edc00c7c0 tx=0x7f7edc007cc0).stop 2024-01-22T05:17:36.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.575+0000 7f7ef9400700 1 -- 172.21.15.49:0/4151741499 shutdown_connections 2024-01-22T05:17:36.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.575+0000 7f7ef9400700 1 --2- 172.21.15.49:0/4151741499 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ecc05a540 0x7f7ecc05ca00 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:36.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.575+0000 7f7ef9400700 1 --2- 172.21.15.49:0/4151741499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef4155c60 0x7f7ef40adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:36.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.575+0000 7f7ef9400700 1 --2- 172.21.15.49:0/4151741499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ef40c3a70 0x7f7ef4163da0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:36.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.575+0000 7f7ef9400700 1 --2- 172.21.15.49:0/4151741499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ef40c3690 0x7f7ef4168580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:36.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.575+0000 7f7ef9400700 1 -- 172.21.15.49:0/4151741499 >> 172.21.15.49:0/4151741499 conn(0x7f7ef40c51c0 msgr2=0x7f7ef40bdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:36.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.575+0000 7f7ef9400700 1 -- 172.21.15.49:0/4151741499 shutdown_connections 2024-01-22T05:17:36.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.575+0000 7f7ef9400700 1 -- 172.21.15.49:0/4151741499 wait complete. 2024-01-22T05:17:36.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-22T05:17:36.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.779+0000 7fe7c2c00700 1 Processor -- start 2024-01-22T05:17:36.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.779+0000 7fe7c2c00700 1 -- start start 2024-01-22T05:17:36.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.783+0000 7fe7c2c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7bc154b50 0x7fe7bc063e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:36.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.783+0000 7fe7c2c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe7bc069c70 0x7fe7bc0c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:36.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.783+0000 7fe7c2c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7bc158640 con 0x7fe7bc064370 2024-01-22T05:17:36.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.783+0000 7fe7c2c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7bc064800 con 0x7fe7bc154b50 2024-01-22T05:17:36.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.783+0000 7fe7c2c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7bc157a30 con 0x7fe7bc069c70 2024-01-22T05:17:36.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.783+0000 7fe7bbe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7bc154b50 0x7fe7bc063e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:36.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.783+0000 7fe7bbe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7bc154b50 0x7fe7bc063e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54160/0 (socket says 172.21.15.49:54160) 2024-01-22T05:17:36.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.783+0000 7fe7bbe00700 1 -- 172.21.15.49:0/3761558264 learned_addr learned my addr 172.21.15.49:0/3761558264 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:36.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.783+0000 7fe7bbe00700 1 -- 172.21.15.49:0/3761558264 >> v2:172.21.15.110:3300/0 conn(0x7fe7bc069c70 msgr2=0x7fe7bc0c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:36.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.783+0000 7fe7c0c00700 1 --2- 172.21.15.49:0/3761558264 >> v2:172.21.15.110:3300/0 conn(0x7fe7bc069c70 0x7fe7bc0c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:36.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7bbe00700 1 --2- 172.21.15.49:0/3761558264 >> v2:172.21.15.110:3300/0 conn(0x7fe7bc069c70 0x7fe7bc0c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:36.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7bbe00700 1 -- 172.21.15.49:0/3761558264 >> v1:172.21.15.49:6789/0 conn(0x7fe7bc064370 legacy=0x7fe7bc0c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:36.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7bbe00700 1 -- 172.21.15.49:0/3761558264 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc157d10 con 0x7fe7bc154b50 2024-01-22T05:17:36.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.783+0000 7fe7baa00700 1 -- 172.21.15.49:0/3761558264 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913378269 0 0) 0x7fe7bc158640 con 0x7fe7bc064370 2024-01-22T05:17:36.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7c0c00700 1 --2- 172.21.15.49:0/3761558264 >> v2:172.21.15.110:3300/0 conn(0x7fe7bc069c70 0x7fe7bc0c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:17:36.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7bbe00700 1 --2- 172.21.15.49:0/3761558264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc154b50 0x7fe7bc063e80 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fe7bc06c120 tx=0x7fe7ac0090f0).ready entity=mon.0 client_cookie=27044bf67a1dc413 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:36.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7baa00700 1 -- 172.21.15.49:0/3761558264 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00b600 con 0x7fe7bc154b50 2024-01-22T05:17:36.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7baa00700 1 -- 172.21.15.49:0/3761558264 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac00b760 con 0x7fe7bc154b50 2024-01-22T05:17:36.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7baa00700 1 -- 172.21.15.49:0/3761558264 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00bae0 con 0x7fe7bc154b50 2024-01-22T05:17:36.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7c2c00700 1 -- 172.21.15.49:0/3761558264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc154b50 msgr2=0x7fe7bc063e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:36.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7c2c00700 1 --2- 172.21.15.49:0/3761558264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc154b50 0x7fe7bc063e80 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fe7bc06c120 tx=0x7fe7ac0090f0).stop 2024-01-22T05:17:36.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7c2c00700 1 -- 172.21.15.49:0/3761558264 shutdown_connections 2024-01-22T05:17:36.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7c2c00700 1 --2- 172.21.15.49:0/3761558264 >> v2:172.21.15.110:3300/0 conn(0x7fe7bc069c70 0x7fe7bc0c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:36.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7c2c00700 1 --2- 172.21.15.49:0/3761558264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc154b50 0x7fe7bc063e80 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:36.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7c2c00700 1 -- 172.21.15.49:0/3761558264 >> 172.21.15.49:0/3761558264 conn(0x7fe7bc0c76b0 msgr2=0x7fe7bc0c7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:36.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7c2c00700 1 -- 172.21.15.49:0/3761558264 shutdown_connections 2024-01-22T05:17:36.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.787+0000 7fe7c2c00700 1 -- 172.21.15.49:0/3761558264 wait complete. 2024-01-22T05:17:36.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.791+0000 7fe7c2c00700 1 Processor -- start 2024-01-22T05:17:36.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.791+0000 7fe7c2c00700 1 -- start start 2024-01-22T05:17:36.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.791+0000 7fe7c2c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7bc064370 0x7fe7bc1379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:36.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.791+0000 7fe7c2c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc069c70 0x7fe7bc0a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:36.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.791+0000 7fe7c2c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7bc154b50 0x7fe7bc0a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:36.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.791+0000 7fe7c2c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0ab080 con 0x7fe7bc069c70 2024-01-22T05:17:36.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.791+0000 7fe7c2c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc137e90 con 0x7fe7bc154b50 2024-01-22T05:17:36.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.791+0000 7fe7c2c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0a92e0 con 0x7fe7bc064370 2024-01-22T05:17:36.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.791+0000 7fe7bb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc069c70 0x7fe7bc0a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:36.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.791+0000 7fe7bb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc069c70 0x7fe7bc0a87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54172/0 (socket says 172.21.15.49:54172) 2024-01-22T05:17:36.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.791+0000 7fe7bb400700 1 -- 172.21.15.49:0/2056958600 learned_addr learned my addr 172.21.15.49:0/2056958600 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:36.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.791+0000 7fe7bbe00700 1 --2- 172.21.15.49:0/2056958600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7bc064370 0x7fe7bc1379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:36.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.795+0000 7fe7c0c00700 1 --2- 172.21.15.49:0/2056958600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7bc154b50 0x7fe7bc0a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:36.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.795+0000 7fe7bb400700 1 -- 172.21.15.49:0/2056958600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7bc064370 msgr2=0x7fe7bc1379a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:36.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.795+0000 7fe7bb400700 1 --2- 172.21.15.49:0/2056958600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7bc064370 0x7fe7bc1379a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:36.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.795+0000 7fe7bb400700 1 -- 172.21.15.49:0/2056958600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7bc154b50 msgr2=0x7fe7bc0a8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:36.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.795+0000 7fe7bb400700 1 --2- 172.21.15.49:0/2056958600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7bc154b50 0x7fe7bc0a8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:36.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.795+0000 7fe7bb400700 1 -- 172.21.15.49:0/2056958600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac009370 con 0x7fe7bc069c70 2024-01-22T05:17:36.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.795+0000 7fe7bb400700 1 --2- 172.21.15.49:0/2056958600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc069c70 0x7fe7bc0a87f0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7fe7a4001eb0 tx=0x7fe7a4007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:36.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.795+0000 7fe7b3400700 1 -- 172.21.15.49:0/2056958600 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a400ce60 con 0x7fe7bc069c70 2024-01-22T05:17:36.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.795+0000 7fe7b3400700 1 -- 172.21.15.49:0/2056958600 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a400f470 con 0x7fe7bc069c70 2024-01-22T05:17:36.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.795+0000 7fe7c2c00700 1 -- 172.21.15.49:0/2056958600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7bc0a95c0 con 0x7fe7bc069c70 2024-01-22T05:17:36.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.795+0000 7fe7b3400700 1 -- 172.21.15.49:0/2056958600 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a400f810 con 0x7fe7bc069c70 2024-01-22T05:17:36.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.795+0000 7fe7c2c00700 1 -- 172.21.15.49:0/2056958600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7bc0aad10 con 0x7fe7bc069c70 2024-01-22T05:17:36.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.795+0000 7fe7b3400700 1 -- 172.21.15.49:0/2056958600 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe7a400fb80 con 0x7fe7bc069c70 2024-01-22T05:17:36.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.799+0000 7fe7c2c00700 1 -- 172.21.15.49:0/2056958600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7bc0654d0 con 0x7fe7bc069c70 2024-01-22T05:17:36.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.799+0000 7fe7b3400700 1 --2- 172.21.15.49:0/2056958600 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe79405a510 0x7fe79405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:36.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.799+0000 7fe7b3400700 1 -- 172.21.15.49:0/2056958600 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5794+0+0 (secure 0 0 0) 0x7fe7a4073a40 con 0x7fe7bc069c70 2024-01-22T05:17:36.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.799+0000 7fe7bbe00700 1 --2- 172.21.15.49:0/2056958600 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe79405a510 0x7fe79405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:36.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.799+0000 7fe7bbe00700 1 --2- 172.21.15.49:0/2056958600 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe79405a510 0x7fe79405c9d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fe7ac009fd0 tx=0x7fe7ac017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:36.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.807+0000 7fe7b3400700 1 -- 172.21.15.49:0/2056958600 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe7a4075e60 con 0x7fe7bc069c70 2024-01-22T05:17:36.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.975+0000 7fe7c2c00700 1 -- 172.21.15.49:0/2056958600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe7bc157ff0 con 0x7fe7bc069c70 2024-01-22T05:17:36.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.983+0000 7fe7b3400700 1 -- 172.21.15.49:0/2056958600 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe7a4047410 con 0x7fe7bc069c70 2024-01-22T05:17:36.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.987+0000 7fe7c2c00700 1 -- 172.21.15.49:0/2056958600 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe79405a510 msgr2=0x7fe79405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:36.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.987+0000 7fe7c2c00700 1 --2- 172.21.15.49:0/2056958600 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe79405a510 0x7fe79405c9d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fe7ac009fd0 tx=0x7fe7ac017000).stop 2024-01-22T05:17:36.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.987+0000 7fe7c2c00700 1 -- 172.21.15.49:0/2056958600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc069c70 msgr2=0x7fe7bc0a87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:36.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.987+0000 7fe7c2c00700 1 --2- 172.21.15.49:0/2056958600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc069c70 0x7fe7bc0a87f0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7fe7a4001eb0 tx=0x7fe7a4007c70).stop 2024-01-22T05:17:36.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.987+0000 7fe7c2c00700 1 -- 172.21.15.49:0/2056958600 shutdown_connections 2024-01-22T05:17:36.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.987+0000 7fe7c2c00700 1 --2- 172.21.15.49:0/2056958600 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe79405a510 0x7fe79405c9d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:36.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.987+0000 7fe7c2c00700 1 --2- 172.21.15.49:0/2056958600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7bc154b50 0x7fe7bc0a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:36.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.987+0000 7fe7c2c00700 1 --2- 172.21.15.49:0/2056958600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc069c70 0x7fe7bc0a87f0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:36.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.987+0000 7fe7c2c00700 1 --2- 172.21.15.49:0/2056958600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7bc064370 0x7fe7bc1379a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:36.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.987+0000 7fe7c2c00700 1 -- 172.21.15.49:0/2056958600 >> 172.21.15.49:0/2056958600 conn(0x7fe7bc0c76b0 msgr2=0x7fe7bc156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:36.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.987+0000 7fe7c2c00700 1 -- 172.21.15.49:0/2056958600 shutdown_connections 2024-01-22T05:17:36.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:36.987+0000 7fe7c2c00700 1 -- 172.21.15.49:0/2056958600 wait complete. 2024-01-22T05:17:37.012 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:17:37.012 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:17:37.053 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:17:37.094 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:17:37.095 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-22T05:17:37.095 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:17:37.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.275+0000 7fea25800700 1 Processor -- start 2024-01-22T05:17:37.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.275+0000 7fea25800700 1 -- start start 2024-01-22T05:17:37.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.275+0000 7fea25800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fea20065240 0x7fea200644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:37.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.275+0000 7fea25800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fea200649e0 0x7fea2015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.275+0000 7fea25800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea200c2700 con 0x7fea20065620 2024-01-22T05:17:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.275+0000 7fea25800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea200c29a0 con 0x7fea200649e0 2024-01-22T05:17:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.275+0000 7fea25800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea200c2c80 con 0x7fea20065240 2024-01-22T05:17:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.275+0000 7fea1fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fea200649e0 0x7fea2015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.275+0000 7fea1fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fea200649e0 0x7fea2015c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54178/0 (socket says 172.21.15.49:54178) 2024-01-22T05:17:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.275+0000 7fea1fe00700 1 -- 172.21.15.49:0/700974186 learned_addr learned my addr 172.21.15.49:0/700974186 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:37.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.275+0000 7fea1ea00700 1 --2- 172.21.15.49:0/700974186 >> v2:172.21.15.110:3300/0 conn(0x7fea20065240 0x7fea200644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:37.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea1fe00700 1 -- 172.21.15.49:0/700974186 >> v2:172.21.15.110:3300/0 conn(0x7fea20065240 msgr2=0x7fea200644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:37.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea1fe00700 1 --2- 172.21.15.49:0/700974186 >> v2:172.21.15.110:3300/0 conn(0x7fea20065240 0x7fea200644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea1fe00700 1 -- 172.21.15.49:0/700974186 >> v1:172.21.15.110:6789/0 conn(0x7fea20065620 legacy=0x7fea2015b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:37.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea1fe00700 1 -- 172.21.15.49:0/700974186 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea200c2f60 con 0x7fea200649e0 2024-01-22T05:17:37.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea1fe00700 1 --2- 172.21.15.49:0/700974186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea200649e0 0x7fea2015c0c0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fea20060220 tx=0x7fea18009840).ready entity=mon.0 client_cookie=406ed3995651bdea server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:37.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea1d600700 1 -- 172.21.15.49:0/700974186 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1800e070 con 0x7fea200649e0 2024-01-22T05:17:37.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea1d600700 1 -- 172.21.15.49:0/700974186 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1800ba20 con 0x7fea200649e0 2024-01-22T05:17:37.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea1d600700 1 -- 172.21.15.49:0/700974186 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1800bda0 con 0x7fea200649e0 2024-01-22T05:17:37.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea25800700 1 -- 172.21.15.49:0/700974186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea200649e0 msgr2=0x7fea2015c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:37.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea25800700 1 --2- 172.21.15.49:0/700974186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea200649e0 0x7fea2015c0c0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fea20060220 tx=0x7fea18009840).stop 2024-01-22T05:17:37.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea25800700 1 -- 172.21.15.49:0/700974186 shutdown_connections 2024-01-22T05:17:37.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea25800700 1 --2- 172.21.15.49:0/700974186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea200649e0 0x7fea2015c0c0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea25800700 1 --2- 172.21.15.49:0/700974186 >> v2:172.21.15.110:3300/0 conn(0x7fea20065240 0x7fea200644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea25800700 1 -- 172.21.15.49:0/700974186 >> 172.21.15.49:0/700974186 conn(0x7fea200c87f0 msgr2=0x7fea200c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:37.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea25800700 1 -- 172.21.15.49:0/700974186 shutdown_connections 2024-01-22T05:17:37.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.279+0000 7fea25800700 1 -- 172.21.15.49:0/700974186 wait complete. 2024-01-22T05:17:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.283+0000 7fea25800700 1 Processor -- start 2024-01-22T05:17:37.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea25800700 1 -- start start 2024-01-22T05:17:37.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea25800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea200649e0 0x7fea200a8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:37.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea25800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea20065240 0x7fea20153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:37.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea25800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea20065620 0x7fea2015da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:37.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea25800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea200bedc0 con 0x7fea20065240 2024-01-22T05:17:37.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea25800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea20153c80 con 0x7fea20065620 2024-01-22T05:17:37.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea25800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2015df10 con 0x7fea200649e0 2024-01-22T05:17:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea1e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea20065240 0x7fea20153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea1e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea20065240 0x7fea20153790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54182/0 (socket says 172.21.15.49:54182) 2024-01-22T05:17:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea1e000700 1 -- 172.21.15.49:0/2328852900 learned_addr learned my addr 172.21.15.49:0/2328852900 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea1ea00700 1 --2- 172.21.15.49:0/2328852900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea200649e0 0x7fea200a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea1fe00700 1 --2- 172.21.15.49:0/2328852900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea20065620 0x7fea2015da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea1e000700 1 -- 172.21.15.49:0/2328852900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea200649e0 msgr2=0x7fea200a8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea1e000700 1 --2- 172.21.15.49:0/2328852900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea200649e0 0x7fea200a8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea1e000700 1 -- 172.21.15.49:0/2328852900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea20065620 msgr2=0x7fea2015da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea1e000700 1 --2- 172.21.15.49:0/2328852900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea20065620 0x7fea2015da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea1e000700 1 -- 172.21.15.49:0/2328852900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea18009ae0 con 0x7fea20065240 2024-01-22T05:17:37.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.287+0000 7fea1e000700 1 --2- 172.21.15.49:0/2328852900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea20065240 0x7fea20153790 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7fea0800c470 tx=0x7fea08007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:37.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.291+0000 7fea16000700 1 -- 172.21.15.49:0/2328852900 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08007020 con 0x7fea20065240 2024-01-22T05:17:37.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.291+0000 7fea16000700 1 -- 172.21.15.49:0/2328852900 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea08007180 con 0x7fea20065240 2024-01-22T05:17:37.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.291+0000 7fea25800700 1 -- 172.21.15.49:0/2328852900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea200a8720 con 0x7fea20065240 2024-01-22T05:17:37.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.291+0000 7fea16000700 1 -- 172.21.15.49:0/2328852900 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08007520 con 0x7fea20065240 2024-01-22T05:17:37.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.291+0000 7fea25800700 1 -- 172.21.15.49:0/2328852900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea200a8ce0 con 0x7fea20065240 2024-01-22T05:17:37.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.291+0000 7fea25800700 1 -- 172.21.15.49:0/2328852900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea200bef70 con 0x7fea20065240 2024-01-22T05:17:37.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.295+0000 7fea16000700 1 -- 172.21.15.49:0/2328852900 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fea080068b0 con 0x7fea20065240 2024-01-22T05:17:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.295+0000 7fea16000700 1 --2- 172.21.15.49:0/2328852900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe9f805a510 0x7fe9f805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.295+0000 7fea16000700 1 -- 172.21.15.49:0/2328852900 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5794+0+0 (secure 0 0 0) 0x7fea08073f30 con 0x7fea20065240 2024-01-22T05:17:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.295+0000 7fea1ea00700 1 --2- 172.21.15.49:0/2328852900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe9f805a510 0x7fe9f805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.295+0000 7fea1ea00700 1 --2- 172.21.15.49:0/2328852900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe9f805a510 0x7fe9f805c9d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fea10009c30 tx=0x7fea10009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:37.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.303+0000 7fea16000700 1 -- 172.21.15.49:0/2328852900 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fea08047900 con 0x7fea20065240 2024-01-22T05:17:37.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.503+0000 7fea25800700 1 -- 172.21.15.49:0/2328852900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea20047060 con 0x7fea20065240 2024-01-22T05:17:37.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.503+0000 7fea16000700 1 -- 172.21.15.49:0/2328852900 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) v1 ==== 95+0+2779 (secure 0 0 0) 0x7fea0804af20 con 0x7fea20065240 2024-01-22T05:17:37.506 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:37.506 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":120,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/661609424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":661609424},{"type":"v1","addr":"172.21.15.110:6833","nonce":661609424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3403660712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3403660712},{"type":"v1","addr":"172.21.15.110:6835","nonce":3403660712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":9246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1296851327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1296851327},{"type":"v1","addr":"172.21.15.49:6835","nonce":1296851327}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":120}],"filesystems":[]} 2024-01-22T05:17:37.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.507+0000 7fea25800700 1 -- 172.21.15.49:0/2328852900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe9f805a510 msgr2=0x7fe9f805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:37.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.507+0000 7fea25800700 1 --2- 172.21.15.49:0/2328852900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe9f805a510 0x7fe9f805c9d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fea10009c30 tx=0x7fea10009060).stop 2024-01-22T05:17:37.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.507+0000 7fea25800700 1 -- 172.21.15.49:0/2328852900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea20065240 msgr2=0x7fea20153790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:37.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.507+0000 7fea25800700 1 --2- 172.21.15.49:0/2328852900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea20065240 0x7fea20153790 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7fea0800c470 tx=0x7fea08007dd0).stop 2024-01-22T05:17:37.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.507+0000 7fea25800700 1 -- 172.21.15.49:0/2328852900 shutdown_connections 2024-01-22T05:17:37.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.507+0000 7fea25800700 1 --2- 172.21.15.49:0/2328852900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe9f805a510 0x7fe9f805c9d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.507+0000 7fea25800700 1 --2- 172.21.15.49:0/2328852900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea20065620 0x7fea2015da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.507+0000 7fea25800700 1 --2- 172.21.15.49:0/2328852900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea20065240 0x7fea20153790 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.507+0000 7fea25800700 1 --2- 172.21.15.49:0/2328852900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea200649e0 0x7fea200a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.507+0000 7fea25800700 1 -- 172.21.15.49:0/2328852900 >> 172.21.15.49:0/2328852900 conn(0x7fea200c87f0 msgr2=0x7fea201554a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:37.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.507+0000 7fea25800700 1 -- 172.21.15.49:0/2328852900 shutdown_connections 2024-01-22T05:17:37.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.507+0000 7fea25800700 1 -- 172.21.15.49:0/2328852900 wait complete. 2024-01-22T05:17:37.514 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 120 2024-01-22T05:17:37.533 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:17:37.534 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:17:37.534 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:17:37.534 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-22T05:17:37.534 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:17:37.534 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:17:37.535 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:17:37.535 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-22T05:17:37.535 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:17:37.535 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:17:37.535 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:17:37.535 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-22T05:17:37.535 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:17:37.535 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:17:37.554 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:17:37.554 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:17:37.557 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:17:37.557 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:17:37.557 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:17:37.558 DEBUG:teuthology.parallel:result is None 2024-01-22T05:17:37.559 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:17:37.559 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:17:37.561 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:17:37.561 DEBUG:teuthology.parallel:result is None 2024-01-22T05:17:37.606 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:17:37.606 DEBUG:teuthology.parallel:result is None 2024-01-22T05:17:37.609 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:17:37.610 DEBUG:teuthology.parallel:result is None 2024-01-22T05:17:37.610 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-22T05:17:37.662 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:17:37.665 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:17:37.714 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:17:37.718 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-22T05:17:37.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.771+0000 7f768d600700 1 Processor -- start 2024-01-22T05:17:37.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.771+0000 7f768d600700 1 -- start start 2024-01-22T05:17:37.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.771+0000 7f768d600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7688151850 0x7f7688151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:37.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.771+0000 7f768d600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7688155670 0x7f7688155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:37.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.771+0000 7f768d600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7688155fa0 0x7f7688062230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:37.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.771+0000 7f768d600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76880bdfd0 con 0x7f7688155fa0 2024-01-22T05:17:37.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.771+0000 7f768d600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7688063490 con 0x7f7688155670 2024-01-22T05:17:37.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.771+0000 7f768d600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7688063770 con 0x7f7688151850 2024-01-22T05:17:37.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.771+0000 7f7687e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7688155fa0 0x7f7688062230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:37.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f7687e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7688155fa0 0x7f7688062230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54226/0 (socket says 172.21.15.49:54226) 2024-01-22T05:17:37.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f7687e00700 1 -- 172.21.15.49:0/3956081267 learned_addr learned my addr 172.21.15.49:0/3956081267 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:37.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f7686000700 1 --2- 172.21.15.49:0/3956081267 >> v2:172.21.15.110:3300/0 conn(0x7f7688155670 0x7f7688155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f7686a00700 1 --2- 172.21.15.49:0/3956081267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7688151850 0x7f7688151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f7687e00700 1 -- 172.21.15.49:0/3956081267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7688151850 msgr2=0x7f7688151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f7687e00700 1 --2- 172.21.15.49:0/3956081267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7688151850 0x7f7688151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f7687e00700 1 -- 172.21.15.49:0/3956081267 >> v2:172.21.15.110:3300/0 conn(0x7f7688155670 msgr2=0x7f7688155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f7687e00700 1 --2- 172.21.15.49:0/3956081267 >> v2:172.21.15.110:3300/0 conn(0x7f7688155670 0x7f7688155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f7687e00700 1 -- 172.21.15.49:0/3956081267 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7688063a50 con 0x7f7688155fa0 2024-01-22T05:17:37.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f7686000700 1 --2- 172.21.15.49:0/3956081267 >> v2:172.21.15.110:3300/0 conn(0x7f7688155670 0x7f7688155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:37.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f7687e00700 1 --2- 172.21.15.49:0/3956081267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688155fa0 0x7f7688062230 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f7688082460 tx=0x7f7680009840).ready entity=mon.0 client_cookie=7f1b46f7b338088 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:37.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f7685600700 1 -- 172.21.15.49:0/3956081267 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768000e070 con 0x7f7688155fa0 2024-01-22T05:17:37.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f7685600700 1 -- 172.21.15.49:0/3956081267 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768000b970 con 0x7f7688155fa0 2024-01-22T05:17:37.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f7685600700 1 -- 172.21.15.49:0/3956081267 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768000bcf0 con 0x7f7688155fa0 2024-01-22T05:17:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f768d600700 1 -- 172.21.15.49:0/3956081267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688155fa0 msgr2=0x7f7688062230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f768d600700 1 --2- 172.21.15.49:0/3956081267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688155fa0 0x7f7688062230 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f7688082460 tx=0x7f7680009840).stop 2024-01-22T05:17:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f768d600700 1 -- 172.21.15.49:0/3956081267 shutdown_connections 2024-01-22T05:17:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f768d600700 1 --2- 172.21.15.49:0/3956081267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688155fa0 0x7f7688062230 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f768d600700 1 --2- 172.21.15.49:0/3956081267 >> v2:172.21.15.110:3300/0 conn(0x7f7688155670 0x7f7688155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f768d600700 1 --2- 172.21.15.49:0/3956081267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7688151850 0x7f7688151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.775+0000 7f768d600700 1 -- 172.21.15.49:0/3956081267 >> 172.21.15.49:0/3956081267 conn(0x7f76880c5860 msgr2=0x7f76880c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.779+0000 7f768d600700 1 -- 172.21.15.49:0/3956081267 shutdown_connections 2024-01-22T05:17:37.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.779+0000 7f768d600700 1 -- 172.21.15.49:0/3956081267 wait complete. 2024-01-22T05:17:37.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.779+0000 7f768d600700 1 Processor -- start 2024-01-22T05:17:37.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.783+0000 7f768d600700 1 -- start start 2024-01-22T05:17:37.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.783+0000 7f768d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688151850 0x7f768814ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:37.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.783+0000 7f768d600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7688155670 0x7f76880ad730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:37.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.783+0000 7f768d600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7688155fa0 0x7f76880adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:37.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.783+0000 7f768d600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76880bfe60 con 0x7f7688151850 2024-01-22T05:17:37.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.783+0000 7f768d600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76880ae3f0 con 0x7f7688155670 2024-01-22T05:17:37.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.783+0000 7f768d600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76880ae6d0 con 0x7f7688155fa0 2024-01-22T05:17:37.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.783+0000 7f7686a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688151850 0x7f768814ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:37.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.783+0000 7f7686a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688151850 0x7f768814ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54232/0 (socket says 172.21.15.49:54232) 2024-01-22T05:17:37.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.783+0000 7f7686a00700 1 -- 172.21.15.49:0/2918105969 learned_addr learned my addr 172.21.15.49:0/2918105969 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:37.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.783+0000 7f7687e00700 1 --2- 172.21.15.49:0/2918105969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7688155fa0 0x7f76880adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:37.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.783+0000 7f7686000700 1 --2- 172.21.15.49:0/2918105969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7688155670 0x7f76880ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:37.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.787+0000 7f7686a00700 1 -- 172.21.15.49:0/2918105969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7688155fa0 msgr2=0x7f76880adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:37.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.787+0000 7f7686a00700 1 --2- 172.21.15.49:0/2918105969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7688155fa0 0x7f76880adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.787+0000 7f7686a00700 1 -- 172.21.15.49:0/2918105969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7688155670 msgr2=0x7f76880ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:37.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.787+0000 7f7686a00700 1 --2- 172.21.15.49:0/2918105969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7688155670 0x7f76880ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:37.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.787+0000 7f7686a00700 1 -- 172.21.15.49:0/2918105969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76700092a0 con 0x7f7688151850 2024-01-22T05:17:37.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.787+0000 7f7686a00700 1 --2- 172.21.15.49:0/2918105969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688151850 0x7f768814ae50 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f767800e900 tx=0x7f7678009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:37.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.787+0000 7f767e000700 1 -- 172.21.15.49:0/2918105969 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7678012600 con 0x7f7688151850 2024-01-22T05:17:37.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.787+0000 7f767e000700 1 -- 172.21.15.49:0/2918105969 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7678012760 con 0x7f7688151850 2024-01-22T05:17:37.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.787+0000 7f768d600700 1 -- 172.21.15.49:0/2918105969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7680009ae0 con 0x7f7688151850 2024-01-22T05:17:37.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.787+0000 7f767e000700 1 -- 172.21.15.49:0/2918105969 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7678012ae0 con 0x7f7688151850 2024-01-22T05:17:37.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.787+0000 7f768d600700 1 -- 172.21.15.49:0/2918105969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76880aec90 con 0x7f7688151850 2024-01-22T05:17:37.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.787+0000 7f768d600700 1 -- 172.21.15.49:0/2918105969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7688047060 con 0x7f7688151850 2024-01-22T05:17:37.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.791+0000 7f767e000700 1 -- 172.21.15.49:0/2918105969 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f767801b400 con 0x7f7688151850 2024-01-22T05:17:37.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.791+0000 7f767e000700 1 --2- 172.21.15.49:0/2918105969 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f766005a510 0x7f766005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:37.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.791+0000 7f767e000700 1 -- 172.21.15.49:0/2918105969 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f7678074b80 con 0x7f7688151850 2024-01-22T05:17:37.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.791+0000 7f7686000700 1 --2- 172.21.15.49:0/2918105969 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f766005a510 0x7f766005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:37.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.791+0000 7f7686000700 1 --2- 172.21.15.49:0/2918105969 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f766005a510 0x7f766005c9d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f7688150f40 tx=0x7f7670009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.799+0000 7f767e000700 1 -- 172.21.15.49:0/2918105969 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7678048380 con 0x7f7688151850 2024-01-22T05:17:37.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:37.971+0000 7f768d600700 1 -- 172.21.15.49:0/2918105969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f76880bdd20 con 0x7f7688151850 2024-01-22T05:17:38.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.759+0000 7f767e000700 1 -- 172.21.15.49:0/2918105969 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v155) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7678074e60 con 0x7f7688151850 2024-01-22T05:17:38.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.763+0000 7f768d600700 1 -- 172.21.15.49:0/2918105969 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f766005a510 msgr2=0x7f766005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:38.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.763+0000 7f768d600700 1 --2- 172.21.15.49:0/2918105969 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f766005a510 0x7f766005c9d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f7688150f40 tx=0x7f7670009060).stop 2024-01-22T05:17:38.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.763+0000 7f768d600700 1 -- 172.21.15.49:0/2918105969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688151850 msgr2=0x7f768814ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:38.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.763+0000 7f768d600700 1 --2- 172.21.15.49:0/2918105969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688151850 0x7f768814ae50 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f767800e900 tx=0x7f7678009060).stop 2024-01-22T05:17:38.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.763+0000 7f768d600700 1 -- 172.21.15.49:0/2918105969 shutdown_connections 2024-01-22T05:17:38.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.763+0000 7f768d600700 1 --2- 172.21.15.49:0/2918105969 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f766005a510 0x7f766005c9d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:38.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.763+0000 7f768d600700 1 --2- 172.21.15.49:0/2918105969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7688155fa0 0x7f76880adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:38.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.763+0000 7f768d600700 1 --2- 172.21.15.49:0/2918105969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7688155670 0x7f76880ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:38.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.763+0000 7f768d600700 1 --2- 172.21.15.49:0/2918105969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7688151850 0x7f768814ae50 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:38.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.763+0000 7f768d600700 1 -- 172.21.15.49:0/2918105969 >> 172.21.15.49:0/2918105969 conn(0x7f76880c5860 msgr2=0x7f7688062230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:38.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.763+0000 7f768d600700 1 -- 172.21.15.49:0/2918105969 shutdown_connections 2024-01-22T05:17:38.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.763+0000 7f768d600700 1 -- 172.21.15.49:0/2918105969 wait complete. 2024-01-22T05:17:38.767 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-01-22T05:17:38.788 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-22T05:17:38.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.999+0000 7f8b9ac00700 1 Processor -- start 2024-01-22T05:17:38.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.999+0000 7f8b9ac00700 1 -- start start 2024-01-22T05:17:39.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.999+0000 7f8b9ac00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8b94155d20 0x7f8b94065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.999+0000 7f8b9ac00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8b94066070 0x7f8b940a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.999+0000 7f8b9ac00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b940c1a40 con 0x7f8b940a8c30 2024-01-22T05:17:39.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.999+0000 7f8b9ac00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b940a90c0 con 0x7f8b94155d20 2024-01-22T05:17:39.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.999+0000 7f8b9ac00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b94159310 con 0x7f8b94066070 2024-01-22T05:17:39.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:38.999+0000 7f8b93e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8b94155d20 0x7f8b94065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b93e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8b94155d20 0x7f8b94065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54240/0 (socket says 172.21.15.49:54240) 2024-01-22T05:17:39.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b93e00700 1 -- 172.21.15.49:0/3130639484 learned_addr learned my addr 172.21.15.49:0/3130639484 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:39.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b93400700 1 --2- 172.21.15.49:0/3130639484 >> v2:172.21.15.110:3300/0 conn(0x7f8b94066070 0x7f8b940a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b93e00700 1 -- 172.21.15.49:0/3130639484 >> v2:172.21.15.110:3300/0 conn(0x7f8b94066070 msgr2=0x7f8b940a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:39.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b93e00700 1 --2- 172.21.15.49:0/3130639484 >> v2:172.21.15.110:3300/0 conn(0x7f8b94066070 0x7f8b940a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b93e00700 1 -- 172.21.15.49:0/3130639484 >> v1:172.21.15.110:6789/0 conn(0x7f8b940a8c30 legacy=0x7f8b940c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b93e00700 1 -- 172.21.15.49:0/3130639484 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b940c13f0 con 0x7f8b94155d20 2024-01-22T05:17:39.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b93e00700 1 --2- 172.21.15.49:0/3130639484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b94155d20 0x7f8b94065b80 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f8b940c0ad0 tx=0x7f8b840090f0).ready entity=mon.0 client_cookie=8318673ee1e52594 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:39.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b92a00700 1 -- 172.21.15.49:0/3130639484 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8400b520 con 0x7f8b94155d20 2024-01-22T05:17:39.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b92a00700 1 -- 172.21.15.49:0/3130639484 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8400b680 con 0x7f8b94155d20 2024-01-22T05:17:39.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b92a00700 1 -- 172.21.15.49:0/3130639484 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8400ba00 con 0x7f8b94155d20 2024-01-22T05:17:39.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b9ac00700 1 -- 172.21.15.49:0/3130639484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b94155d20 msgr2=0x7f8b94065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b9ac00700 1 --2- 172.21.15.49:0/3130639484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b94155d20 0x7f8b94065b80 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f8b940c0ad0 tx=0x7f8b840090f0).stop 2024-01-22T05:17:39.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b9ac00700 1 -- 172.21.15.49:0/3130639484 shutdown_connections 2024-01-22T05:17:39.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b9ac00700 1 --2- 172.21.15.49:0/3130639484 >> v2:172.21.15.110:3300/0 conn(0x7f8b94066070 0x7f8b940a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b9ac00700 1 --2- 172.21.15.49:0/3130639484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b94155d20 0x7f8b94065b80 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.003+0000 7f8b9ac00700 1 -- 172.21.15.49:0/3130639484 >> 172.21.15.49:0/3130639484 conn(0x7f8b940c6540 msgr2=0x7f8b940c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:39.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.007+0000 7f8b9ac00700 1 -- 172.21.15.49:0/3130639484 shutdown_connections 2024-01-22T05:17:39.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.007+0000 7f8b9ac00700 1 -- 172.21.15.49:0/3130639484 wait complete. 2024-01-22T05:17:39.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.007+0000 7f8b9ac00700 1 Processor -- start 2024-01-22T05:17:39.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.007+0000 7f8b9ac00700 1 -- start start 2024-01-22T05:17:39.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b9ac00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b94066070 0x7f8b9416c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b9ac00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b940a8c30 0x7f8b94169840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b9ac00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b94155d20 0x7f8b94141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b9ac00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b94169d30 con 0x7f8b94155d20 2024-01-22T05:17:39.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b9ac00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b94169f10 con 0x7f8b94066070 2024-01-22T05:17:39.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b9ac00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940bf100 con 0x7f8b940a8c30 2024-01-22T05:17:39.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b98c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b94155d20 0x7f8b94141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b98c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b94155d20 0x7f8b94141ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54256/0 (socket says 172.21.15.49:54256) 2024-01-22T05:17:39.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b98c00700 1 -- 172.21.15.49:0/1921197757 learned_addr learned my addr 172.21.15.49:0/1921197757 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:39.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b93400700 1 --2- 172.21.15.49:0/1921197757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b940a8c30 0x7f8b94169840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b93e00700 1 --2- 172.21.15.49:0/1921197757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b94066070 0x7f8b9416c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b98c00700 1 -- 172.21.15.49:0/1921197757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b940a8c30 msgr2=0x7f8b94169840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b98c00700 1 --2- 172.21.15.49:0/1921197757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b940a8c30 0x7f8b94169840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b98c00700 1 -- 172.21.15.49:0/1921197757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b94066070 msgr2=0x7f8b9416c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b98c00700 1 --2- 172.21.15.49:0/1921197757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b94066070 0x7f8b9416c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b98c00700 1 -- 172.21.15.49:0/1921197757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84009370 con 0x7f8b94155d20 2024-01-22T05:17:39.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b98c00700 1 --2- 172.21.15.49:0/1921197757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b94155d20 0x7f8b94141ed0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f8b8c002230 tx=0x7f8b8c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:39.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b8b400700 1 -- 172.21.15.49:0/1921197757 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00e4a0 con 0x7f8b94155d20 2024-01-22T05:17:39.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b8b400700 1 -- 172.21.15.49:0/1921197757 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c00e600 con 0x7f8b94155d20 2024-01-22T05:17:39.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b9ac00700 1 -- 172.21.15.49:0/1921197757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b940bedf0 con 0x7f8b94155d20 2024-01-22T05:17:39.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b8b400700 1 -- 172.21.15.49:0/1921197757 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00e980 con 0x7f8b94155d20 2024-01-22T05:17:39.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.011+0000 7f8b9ac00700 1 -- 172.21.15.49:0/1921197757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9416ca60 con 0x7f8b94155d20 2024-01-22T05:17:39.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.015+0000 7f8b9ac00700 1 -- 172.21.15.49:0/1921197757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b94047060 con 0x7f8b94155d20 2024-01-22T05:17:39.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.015+0000 7f8b8b400700 1 -- 172.21.15.49:0/1921197757 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8b8c00ed30 con 0x7f8b94155d20 2024-01-22T05:17:39.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.019+0000 7f8b8b400700 1 --2- 172.21.15.49:0/1921197757 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8b6c05a510 0x7f8b6c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.019+0000 7f8b8b400700 1 -- 172.21.15.49:0/1921197757 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f8b8c073c60 con 0x7f8b94155d20 2024-01-22T05:17:39.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.019+0000 7f8b93e00700 1 --2- 172.21.15.49:0/1921197757 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8b6c05a510 0x7f8b6c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.019+0000 7f8b93e00700 1 --2- 172.21.15.49:0/1921197757 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8b6c05a510 0x7f8b6c05c9d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f8b84009130 tx=0x7f8b84017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:39.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.023+0000 7f8b8b400700 1 -- 172.21.15.49:0/1921197757 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8b8c047620 con 0x7f8b94155d20 2024-01-22T05:17:39.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.243+0000 7f8b9ac00700 1 -- 172.21.15.49:0/1921197757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8b940c16d0 con 0x7f8b94155d20 2024-01-22T05:17:39.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.247+0000 7f8b8b400700 1 -- 172.21.15.49:0/1921197757 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8b8c04ac40 con 0x7f8b94155d20 2024-01-22T05:17:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:39.247 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:17:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-01-22T05:17:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-01-22T05:17:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lTCfoJxAAxDGvXKXgooA9/f0J70s6AA==", 2024-01-22T05:17:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:17:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:17:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:17:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:17:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-01-22T05:17:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lHqV6ORAA1DwpPV2PyDBF/6/ePTdQJw==", 2024-01-22T05:17:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:17:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:17:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:17:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:17:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-01-22T05:17:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lPo86MhAAonfC3M+AkLldljODYNGzyA==", 2024-01-22T05:17:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:17:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:17:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:17:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:17:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-01-22T05:17:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lLwvMBxAAFm52HWeGbTH1gbWVm6r5zQ==", 2024-01-22T05:17:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:17:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:17:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:17:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:17:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-01-22T05:17:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAt961lH2F9NBAAHm8R9/Q5IuFUvb0o1GyD4Q==", 2024-01-22T05:17:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:17:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:17:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:17:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-01-22T05:17:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAx961lS1lEIhAAuDm2OYfTYff1kVEq5vXvFw==", 2024-01-22T05:17:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:17:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA1961limLvERAAv23crKrwjLIg84u48BHHbg==", 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA5961lShJiABAAnvyhz0ggDaITaMgwzi9kAA==", 2024-01-22T05:17:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:17:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:17:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:17:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2024-01-22T05:17:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA9961lcopfNRAAAZgHzI1t7YHI5cAjaCMiNw==", 2024-01-22T05:17:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:17:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:17:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:17:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBB961lX+nTIxAAtP3YQypuFWM5O/LADjvybA==", 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBF961lQ4/XERAARZPqENsV3jokk2g3OXUI5w==", 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBI961luxnqOhAAGsV74DKQda5cetNA/woOnA==", 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lmrM6DhAAYU09HviWyrUIz4lio15wFw==", 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-01-22T05:17:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lIhYRGRAAFG+YtkDLFsra6zU44xKCHw==", 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lRuyaExAAQO3a7ahOEcuE+WVfXYEBTg==", 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:17:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:17:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:17:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:17:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2024-01-22T05:17:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lMiMkHhAAxPdKpcHdtqSphbc/2agq9Q==", 2024-01-22T05:17:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:17:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:17:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:17:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:17:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-01-22T05:17:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961ljsweARAAJrY3z/sBjayjB2BRQNrJew==", 2024-01-22T05:17:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:17:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:17:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:17:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:17:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-01-22T05:17:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961l0DwDIhAAeuCu79LxNMEJvWiW/BfDhA==", 2024-01-22T05:17:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:17:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:17:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:17:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2024-01-22T05:17:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lZlmPGxAA1KVZR+XzNdoFVo/980hD8w==", 2024-01-22T05:17:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:17:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:17:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:17:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:17:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-01-22T05:17:39.259 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:17:39.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.247+0000 7f8b9ac00700 1 -- 172.21.15.49:0/1921197757 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8b6c05a510 msgr2=0x7f8b6c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.247+0000 7f8b9ac00700 1 --2- 172.21.15.49:0/1921197757 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8b6c05a510 0x7f8b6c05c9d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f8b84009130 tx=0x7f8b84017000).stop 2024-01-22T05:17:39.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.247+0000 7f8b9ac00700 1 -- 172.21.15.49:0/1921197757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b94155d20 msgr2=0x7f8b94141ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.247+0000 7f8b9ac00700 1 --2- 172.21.15.49:0/1921197757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b94155d20 0x7f8b94141ed0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f8b8c002230 tx=0x7f8b8c0015e0).stop 2024-01-22T05:17:39.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.247+0000 7f8b9ac00700 1 -- 172.21.15.49:0/1921197757 shutdown_connections 2024-01-22T05:17:39.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.247+0000 7f8b9ac00700 1 --2- 172.21.15.49:0/1921197757 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8b6c05a510 0x7f8b6c05c9d0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.247+0000 7f8b9ac00700 1 --2- 172.21.15.49:0/1921197757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b94155d20 0x7f8b94141ed0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.247+0000 7f8b9ac00700 1 --2- 172.21.15.49:0/1921197757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b940a8c30 0x7f8b94169840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.247+0000 7f8b9ac00700 1 --2- 172.21.15.49:0/1921197757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b94066070 0x7f8b9416c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.247+0000 7f8b9ac00700 1 -- 172.21.15.49:0/1921197757 >> 172.21.15.49:0/1921197757 conn(0x7f8b940c6540 msgr2=0x7f8b94158680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:39.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.251+0000 7f8b9ac00700 1 -- 172.21.15.49:0/1921197757 shutdown_connections 2024-01-22T05:17:39.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.251+0000 7f8b9ac00700 1 -- 172.21.15.49:0/1921197757 wait complete. 2024-01-22T05:17:39.275 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:17:39.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.439+0000 7f79d8a00700 1 Processor -- start 2024-01-22T05:17:39.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.439+0000 7f79d8a00700 1 -- start start 2024-01-22T05:17:39.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.443+0000 7f79d8a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f79d0065240 0x7f79d00644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.443+0000 7f79d8a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79d0065620 0x7f79d00649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.443+0000 7f79d8a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d00c2700 con 0x7f79d015b9b0 2024-01-22T05:17:39.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.443+0000 7f79d8a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d0064ed0 con 0x7f79d0065240 2024-01-22T05:17:39.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.443+0000 7f79d8a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00c29a0 con 0x7f79d0065620 2024-01-22T05:17:39.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.443+0000 7f79d5600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79d0065620 0x7f79d00649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.443+0000 7f79d6000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f79d0065240 0x7f79d00644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.443+0000 7f79d7400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f79d015b9b0 0x7f79d015be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:59124/0 (socket says 172.21.15.49:59124) 2024-01-22T05:17:39.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.443+0000 7f79d5600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79d0065620 0x7f79d00649e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:48826/0 (socket says 172.21.15.49:48826) 2024-01-22T05:17:39.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.443+0000 7f79d7400700 1 -- 172.21.15.49:0/1609006528 learned_addr learned my addr 172.21.15.49:0/1609006528 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:39.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.443+0000 7f79d6000700 1 -- 172.21.15.49:0/1609006528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79d0065620 msgr2=0x7f79d00649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:39.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.443+0000 7f79d6000700 1 --2- 172.21.15.49:0/1609006528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79d0065620 0x7f79d00649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.443+0000 7f79d6000700 1 -- 172.21.15.49:0/1609006528 >> v1:172.21.15.110:6789/0 conn(0x7f79d015b9b0 legacy=0x7f79d015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.443+0000 7f79d6000700 1 -- 172.21.15.49:0/1609006528 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d00c2c80 con 0x7f79d0065240 2024-01-22T05:17:39.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.443+0000 7f79d5600700 1 --2- 172.21.15.49:0/1609006528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79d0065620 0x7f79d00649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:39.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.447+0000 7f79d6000700 1 --2- 172.21.15.49:0/1609006528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79d0065240 0x7f79d00644f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f79c0009760 tx=0x7f79c0009060).ready entity=mon.1 client_cookie=a44264c5f4c528ea server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:39.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.447+0000 7f79d4c00700 1 -- 172.21.15.49:0/1609006528 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c000f510 con 0x7f79d0065240 2024-01-22T05:17:39.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.447+0000 7f79d4c00700 1 -- 172.21.15.49:0/1609006528 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c000f670 con 0x7f79d0065240 2024-01-22T05:17:39.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.447+0000 7f79d4c00700 1 -- 172.21.15.49:0/1609006528 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c000f9f0 con 0x7f79d0065240 2024-01-22T05:17:39.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.447+0000 7f79d8a00700 1 -- 172.21.15.49:0/1609006528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79d0065240 msgr2=0x7f79d00644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.447+0000 7f79d8a00700 1 --2- 172.21.15.49:0/1609006528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79d0065240 0x7f79d00644f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f79c0009760 tx=0x7f79c0009060).stop 2024-01-22T05:17:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.447+0000 7f79d8a00700 1 -- 172.21.15.49:0/1609006528 shutdown_connections 2024-01-22T05:17:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.447+0000 7f79d8a00700 1 --2- 172.21.15.49:0/1609006528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79d0065620 0x7f79d00649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.447+0000 7f79d8a00700 1 --2- 172.21.15.49:0/1609006528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79d0065240 0x7f79d00644f0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.447+0000 7f79d8a00700 1 -- 172.21.15.49:0/1609006528 >> 172.21.15.49:0/1609006528 conn(0x7f79d00c87f0 msgr2=0x7f79d00c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:39.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.447+0000 7f79d8a00700 1 -- 172.21.15.49:0/1609006528 shutdown_connections 2024-01-22T05:17:39.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.447+0000 7f79d8a00700 1 -- 172.21.15.49:0/1609006528 wait complete. 2024-01-22T05:17:39.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.451+0000 7f79d8a00700 1 Processor -- start 2024-01-22T05:17:39.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.451+0000 7f79d8a00700 1 -- start start 2024-01-22T05:17:39.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.451+0000 7f79d8a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79d0065240 0x7f79d0147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.451+0000 7f79d8a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79d0065620 0x7f79d00bedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d8a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d015b9b0 0x7f79d00a9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d8a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d015af60 con 0x7f79d015b9b0 2024-01-22T05:17:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d8a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00c0dc0 con 0x7f79d0065240 2024-01-22T05:17:39.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d8a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00c10a0 con 0x7f79d0065620 2024-01-22T05:17:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d015b9b0 0x7f79d00a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d6000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79d0065240 0x7f79d0147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d015b9b0 0x7f79d00a9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54272/0 (socket says 172.21.15.49:54272) 2024-01-22T05:17:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d5600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79d0065620 0x7f79d00bedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d7400700 1 -- 172.21.15.49:0/949112141 learned_addr learned my addr 172.21.15.49:0/949112141 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d7400700 1 -- 172.21.15.49:0/949112141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79d0065620 msgr2=0x7f79d00bedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d7400700 1 --2- 172.21.15.49:0/949112141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79d0065620 0x7f79d00bedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d7400700 1 -- 172.21.15.49:0/949112141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79d0065240 msgr2=0x7f79d0147e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d7400700 1 --2- 172.21.15.49:0/949112141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79d0065240 0x7f79d0147e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d7400700 1 -- 172.21.15.49:0/949112141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b80092a0 con 0x7f79d015b9b0 2024-01-22T05:17:39.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d7400700 1 --2- 172.21.15.49:0/949112141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d015b9b0 0x7f79d00a9880 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f79c800c7c0 tx=0x7f79c8001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:39.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79cd600700 1 -- 172.21.15.49:0/949112141 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8005d30 con 0x7f79d015b9b0 2024-01-22T05:17:39.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79cd600700 1 -- 172.21.15.49:0/949112141 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c8005e90 con 0x7f79d015b9b0 2024-01-22T05:17:39.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79cd600700 1 -- 172.21.15.49:0/949112141 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c80072e0 con 0x7f79d015b9b0 2024-01-22T05:17:39.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d8a00700 1 -- 172.21.15.49:0/949112141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c00092a0 con 0x7f79d015b9b0 2024-01-22T05:17:39.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.455+0000 7f79d8a00700 1 -- 172.21.15.49:0/949112141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d00c1940 con 0x7f79d015b9b0 2024-01-22T05:17:39.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.459+0000 7f79d8a00700 1 -- 172.21.15.49:0/949112141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d00c1b60 con 0x7f79d015b9b0 2024-01-22T05:17:39.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.459+0000 7f79cd600700 1 -- 172.21.15.49:0/949112141 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f79c8007710 con 0x7f79d015b9b0 2024-01-22T05:17:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.459+0000 7f79cd600700 1 --2- 172.21.15.49:0/949112141 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79a805a510 0x7f79a805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.459+0000 7f79cd600700 1 -- 172.21.15.49:0/949112141 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f79c8073fa0 con 0x7f79d015b9b0 2024-01-22T05:17:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.459+0000 7f79d6000700 1 --2- 172.21.15.49:0/949112141 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79a805a510 0x7f79a805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.463+0000 7f79d6000700 1 --2- 172.21.15.49:0/949112141 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79a805a510 0x7f79a805c9d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f79c0009fd0 tx=0x7f79c0017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:39.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.467+0000 7f79cd600700 1 -- 172.21.15.49:0/949112141 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f79c80478b0 con 0x7f79d015b9b0 2024-01-22T05:17:39.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.635+0000 7f79d8a00700 1 -- 172.21.15.49:0/949112141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79d00c1490 con 0x7f79d015b9b0 2024-01-22T05:17:39.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.635+0000 7f79cd600700 1 -- 172.21.15.49:0/949112141 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+13958 (secure 0 0 0) 0x7f79c804aed0 con 0x7f79d015b9b0 2024-01-22T05:17:39.638 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:39.638 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":155,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:17:38.750961+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:17:39.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.639+0000 7f79d8a00700 1 -- 172.21.15.49:0/949112141 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79a805a510 msgr2=0x7f79a805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.639+0000 7f79d8a00700 1 --2- 172.21.15.49:0/949112141 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79a805a510 0x7f79a805c9d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f79c0009fd0 tx=0x7f79c0017000).stop 2024-01-22T05:17:39.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.639+0000 7f79d8a00700 1 -- 172.21.15.49:0/949112141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d015b9b0 msgr2=0x7f79d00a9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.639+0000 7f79d8a00700 1 --2- 172.21.15.49:0/949112141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d015b9b0 0x7f79d00a9880 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f79c800c7c0 tx=0x7f79c8001510).stop 2024-01-22T05:17:39.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.643+0000 7f79d8a00700 1 -- 172.21.15.49:0/949112141 shutdown_connections 2024-01-22T05:17:39.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.643+0000 7f79d8a00700 1 --2- 172.21.15.49:0/949112141 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f79a805a510 0x7f79a805c9d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.643+0000 7f79d8a00700 1 --2- 172.21.15.49:0/949112141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79d015b9b0 0x7f79d00a9880 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.643+0000 7f79d8a00700 1 --2- 172.21.15.49:0/949112141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79d0065620 0x7f79d00bedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.643+0000 7f79d8a00700 1 --2- 172.21.15.49:0/949112141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79d0065240 0x7f79d0147e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.643+0000 7f79d8a00700 1 -- 172.21.15.49:0/949112141 >> 172.21.15.49:0/949112141 conn(0x7f79d00c87f0 msgr2=0x7f79d00ad400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:39.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.643+0000 7f79d8a00700 1 -- 172.21.15.49:0/949112141 shutdown_connections 2024-01-22T05:17:39.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.643+0000 7f79d8a00700 1 -- 172.21.15.49:0/949112141 wait complete. 2024-01-22T05:17:39.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:17:39.665 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:17:39.776 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:17:39.782 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:17:39.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.815+0000 7fd5a2600700 1 Processor -- start 2024-01-22T05:17:39.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.819+0000 7fd5a2600700 1 -- start start 2024-01-22T05:17:39.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.819+0000 7fd5a2600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd59c067a90 0x7fd59c067ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.819+0000 7fd5a2600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd59c155c00 0x7fd59c156050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.819+0000 7fd5a2600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59c155770 con 0x7fd59c0c0760 2024-01-22T05:17:39.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.819+0000 7fd5a2600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59c0c2e40 con 0x7fd59c067a90 2024-01-22T05:17:39.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.819+0000 7fd5a2600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c156540 con 0x7fd59c155c00 2024-01-22T05:17:39.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.819+0000 7fd59b400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd59c0c0760 0x7fd59c1516b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37254/0 (socket says 172.21.15.49:37254) 2024-01-22T05:17:39.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.819+0000 7fd59b400700 1 -- 172.21.15.49:0/2229725348 learned_addr learned my addr 172.21.15.49:0/2229725348 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:39.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.819+0000 7fd59aa00700 1 --2- 172.21.15.49:0/2229725348 >> v2:172.21.15.49:3300/0 conn(0x7fd59c067a90 0x7fd59c067ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.819+0000 7fd59be00700 1 --2- 172.21.15.49:0/2229725348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd59c155c00 0x7fd59c156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd59aa00700 1 -- 172.21.15.49:0/2229725348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd59c155c00 msgr2=0x7fd59c156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:39.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd59aa00700 1 --2- 172.21.15.49:0/2229725348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd59c155c00 0x7fd59c156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd59aa00700 1 -- 172.21.15.49:0/2229725348 >> v1:172.21.15.49:6789/0 conn(0x7fd59c0c0760 legacy=0x7fd59c1516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd59a000700 1 -- 172.21.15.49:0/2229725348 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291217746 0 0) 0x7fd59c155770 con 0x7fd59c0c0760 2024-01-22T05:17:39.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd59aa00700 1 -- 172.21.15.49:0/2229725348 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c0c2880 con 0x7fd59c067a90 2024-01-22T05:17:39.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd59aa00700 1 --2- 172.21.15.49:0/2229725348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd59c067a90 0x7fd59c067ed0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7fd584006fd0 tx=0x7fd584006f40).ready entity=mon.0 client_cookie=964b412d741d855c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:39.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd59a000700 1 -- 172.21.15.49:0/2229725348 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584005880 con 0x7fd59c067a90 2024-01-22T05:17:39.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd59a000700 1 -- 172.21.15.49:0/2229725348 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5840059e0 con 0x7fd59c067a90 2024-01-22T05:17:39.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd59a000700 1 -- 172.21.15.49:0/2229725348 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584005d60 con 0x7fd59c067a90 2024-01-22T05:17:39.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd5a2600700 1 -- 172.21.15.49:0/2229725348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd59c067a90 msgr2=0x7fd59c067ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd5a2600700 1 --2- 172.21.15.49:0/2229725348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd59c067a90 0x7fd59c067ed0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7fd584006fd0 tx=0x7fd584006f40).stop 2024-01-22T05:17:39.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd5a2600700 1 -- 172.21.15.49:0/2229725348 shutdown_connections 2024-01-22T05:17:39.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd5a2600700 1 --2- 172.21.15.49:0/2229725348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd59c155c00 0x7fd59c156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd5a2600700 1 --2- 172.21.15.49:0/2229725348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd59c067a90 0x7fd59c067ed0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd5a2600700 1 -- 172.21.15.49:0/2229725348 >> 172.21.15.49:0/2229725348 conn(0x7fd59c062cb0 msgr2=0x7fd59c0c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:39.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd5a2600700 1 -- 172.21.15.49:0/2229725348 shutdown_connections 2024-01-22T05:17:39.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.823+0000 7fd5a2600700 1 -- 172.21.15.49:0/2229725348 wait complete. 2024-01-22T05:17:39.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd5a2600700 1 Processor -- start 2024-01-22T05:17:39.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd5a2600700 1 -- start start 2024-01-22T05:17:39.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd5a2600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd59c067a90 0x7fd59c1491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd5a2600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd59c0c0760 0x7fd59c0bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd5a2600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd59c155c00 0x7fd59c153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd5a2600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0be1d0 con 0x7fd59c0c0760 2024-01-22T05:17:39.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd5a2600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c1496d0 con 0x7fd59c067a90 2024-01-22T05:17:39.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd5a2600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0be9b0 con 0x7fd59c155c00 2024-01-22T05:17:39.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd59aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd59c0c0760 0x7fd59c0bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd59aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd59c0c0760 0x7fd59c0bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54288/0 (socket says 172.21.15.49:54288) 2024-01-22T05:17:39.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd59aa00700 1 -- 172.21.15.49:0/1010953574 learned_addr learned my addr 172.21.15.49:0/1010953574 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:39.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd59be00700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd59c155c00 0x7fd59c153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd59b400700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd59c067a90 0x7fd59c1491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd59aa00700 1 -- 172.21.15.49:0/1010953574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd59c155c00 msgr2=0x7fd59c153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd59aa00700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd59c155c00 0x7fd59c153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd59aa00700 1 -- 172.21.15.49:0/1010953574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd59c067a90 msgr2=0x7fd59c1491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:39.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd59aa00700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd59c067a90 0x7fd59c1491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:39.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.827+0000 7fd59aa00700 1 -- 172.21.15.49:0/1010953574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd584009250 con 0x7fd59c0c0760 2024-01-22T05:17:39.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.831+0000 7fd59be00700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd59c155c00 0x7fd59c153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:39.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.831+0000 7fd59b400700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd59c067a90 0x7fd59c1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:39.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.831+0000 7fd59aa00700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd59c0c0760 0x7fd59c0bfc80 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7fd59c066bc0 tx=0x7fd584015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:39.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.831+0000 7fd592a00700 1 -- 172.21.15.49:0/1010953574 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584006920 con 0x7fd59c0c0760 2024-01-22T05:17:39.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.831+0000 7fd592a00700 1 -- 172.21.15.49:0/1010953574 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58400f510 con 0x7fd59c0c0760 2024-01-22T05:17:39.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.831+0000 7fd5a2600700 1 -- 172.21.15.49:0/1010953574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59c0bf7f0 con 0x7fd59c0c0760 2024-01-22T05:17:39.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.831+0000 7fd592a00700 1 -- 172.21.15.49:0/1010953574 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58400f8d0 con 0x7fd59c0c0760 2024-01-22T05:17:39.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.831+0000 7fd5a2600700 1 -- 172.21.15.49:0/1010953574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59c0bf1a0 con 0x7fd59c0c0760 2024-01-22T05:17:39.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.831+0000 7fd5a2600700 1 -- 172.21.15.49:0/1010953574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59c0c0c00 con 0x7fd59c0c0760 2024-01-22T05:17:39.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.831+0000 7fd592a00700 1 -- 172.21.15.49:0/1010953574 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd58400fcc0 con 0x7fd59c0c0760 2024-01-22T05:17:39.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.835+0000 7fd592a00700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd57405a510 0x7fd57405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:39.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.835+0000 7fd592a00700 1 -- 172.21.15.49:0/1010953574 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fd5840753b0 con 0x7fd59c0c0760 2024-01-22T05:17:39.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.835+0000 7fd59b400700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd57405a510 0x7fd57405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:39.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.835+0000 7fd59b400700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd57405a510 0x7fd57405c9d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fd58c001710 tx=0x7fd58c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:39.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:39.839+0000 7fd592a00700 1 -- 172.21.15.49:0/1010953574 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd584048e30 con 0x7fd59c0c0760 2024-01-22T05:17:40.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.003+0000 7fd5a2600700 1 -- 172.21.15.49:0/1010953574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd59c14bc00 con 0x7fd59c0c0760 2024-01-22T05:17:40.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.003+0000 7fd592a00700 1 -- 172.21.15.49:0/1010953574 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v155) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd584022070 con 0x7fd59c0c0760 2024-01-22T05:17:40.005 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:17:40.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.007+0000 7fd5a2600700 1 -- 172.21.15.49:0/1010953574 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd57405a510 msgr2=0x7fd57405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.007+0000 7fd5a2600700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd57405a510 0x7fd57405c9d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fd58c001710 tx=0x7fd58c009040).stop 2024-01-22T05:17:40.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.007+0000 7fd5a2600700 1 -- 172.21.15.49:0/1010953574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd59c0c0760 msgr2=0x7fd59c0bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.007+0000 7fd5a2600700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd59c0c0760 0x7fd59c0bfc80 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7fd59c066bc0 tx=0x7fd584015000).stop 2024-01-22T05:17:40.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.007+0000 7fd5a2600700 1 -- 172.21.15.49:0/1010953574 shutdown_connections 2024-01-22T05:17:40.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.007+0000 7fd5a2600700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd57405a510 0x7fd57405c9d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.007+0000 7fd5a2600700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd59c155c00 0x7fd59c153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.007+0000 7fd5a2600700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd59c0c0760 0x7fd59c0bfc80 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.007+0000 7fd5a2600700 1 --2- 172.21.15.49:0/1010953574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd59c067a90 0x7fd59c1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.007+0000 7fd5a2600700 1 -- 172.21.15.49:0/1010953574 >> 172.21.15.49:0/1010953574 conn(0x7fd59c062cb0 msgr2=0x7fd59c14c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:40.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.011+0000 7fd5a2600700 1 -- 172.21.15.49:0/1010953574 shutdown_connections 2024-01-22T05:17:40.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.011+0000 7fd5a2600700 1 -- 172.21.15.49:0/1010953574 wait complete. 2024-01-22T05:17:40.033 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:17:40.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.203+0000 7fa0a7200700 1 Processor -- start 2024-01-22T05:17:40.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.203+0000 7fa0a7200700 1 -- start start 2024-01-22T05:17:40.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a7200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0a80bdea0 0x7fa0a80be280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a7200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa0a8068fc0 0x7fa0a8152590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a7200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a80bebf0 con 0x7fa0a80be770 2024-01-22T05:17:40.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a7200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a80beed0 con 0x7fa0a8068fc0 2024-01-22T05:17:40.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a7200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a80bf1b0 con 0x7fa0a80bdea0 2024-01-22T05:17:40.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a6800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa0a8068fc0 0x7fa0a8152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a5e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0a80bdea0 0x7fa0a80be280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a5400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa0a80be770 0x7fa0a8151e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:59130/0 (socket says 172.21.15.49:59130) 2024-01-22T05:17:40.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a5400700 1 -- 172.21.15.49:0/2792988785 learned_addr learned my addr 172.21.15.49:0/2792988785 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:40.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a4a00700 1 -- 172.21.15.49:0/2792988785 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787538300 0 0) 0x7fa0a80bebf0 con 0x7fa0a80be770 2024-01-22T05:17:40.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a4a00700 1 -- 172.21.15.49:0/2792988785 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0880033f0 con 0x7fa0a80be770 2024-01-22T05:17:40.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a6800700 1 -- 172.21.15.49:0/2792988785 >> v2:172.21.15.110:3300/0 conn(0x7fa0a80bdea0 msgr2=0x7fa0a80be280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:40.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a6800700 1 --2- 172.21.15.49:0/2792988785 >> v2:172.21.15.110:3300/0 conn(0x7fa0a80bdea0 0x7fa0a80be280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a6800700 1 -- 172.21.15.49:0/2792988785 >> v1:172.21.15.110:6789/0 conn(0x7fa0a80be770 legacy=0x7fa0a8151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a6800700 1 -- 172.21.15.49:0/2792988785 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a80bf490 con 0x7fa0a8068fc0 2024-01-22T05:17:40.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a5e00700 1 --2- 172.21.15.49:0/2792988785 >> v2:172.21.15.110:3300/0 conn(0x7fa0a80bdea0 0x7fa0a80be280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.207+0000 7fa0a6800700 1 --2- 172.21.15.49:0/2792988785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8068fc0 0x7fa0a8152590 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7fa0a8066700 tx=0x7fa0a0009780).ready entity=mon.0 client_cookie=4df279c49c6816da server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.211+0000 7fa0a4a00700 1 -- 172.21.15.49:0/2792988785 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a000e070 con 0x7fa0a8068fc0 2024-01-22T05:17:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.211+0000 7fa0a4a00700 1 -- 172.21.15.49:0/2792988785 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a000bab0 con 0x7fa0a8068fc0 2024-01-22T05:17:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.211+0000 7fa0a4a00700 1 -- 172.21.15.49:0/2792988785 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a000be30 con 0x7fa0a8068fc0 2024-01-22T05:17:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.211+0000 7fa0a7200700 1 -- 172.21.15.49:0/2792988785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8068fc0 msgr2=0x7fa0a8152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.211+0000 7fa0a7200700 1 --2- 172.21.15.49:0/2792988785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8068fc0 0x7fa0a8152590 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7fa0a8066700 tx=0x7fa0a0009780).stop 2024-01-22T05:17:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.211+0000 7fa0a7200700 1 -- 172.21.15.49:0/2792988785 shutdown_connections 2024-01-22T05:17:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.211+0000 7fa0a7200700 1 --2- 172.21.15.49:0/2792988785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8068fc0 0x7fa0a8152590 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.211+0000 7fa0a7200700 1 --2- 172.21.15.49:0/2792988785 >> v2:172.21.15.110:3300/0 conn(0x7fa0a80bdea0 0x7fa0a80be280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.211+0000 7fa0a7200700 1 -- 172.21.15.49:0/2792988785 >> 172.21.15.49:0/2792988785 conn(0x7fa0a80c8750 msgr2=0x7fa0a80c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:40.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.211+0000 7fa0a7200700 1 -- 172.21.15.49:0/2792988785 shutdown_connections 2024-01-22T05:17:40.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.211+0000 7fa0a7200700 1 -- 172.21.15.49:0/2792988785 wait complete. 2024-01-22T05:17:40.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.215+0000 7fa0a7200700 1 Processor -- start 2024-01-22T05:17:40.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.215+0000 7fa0a7200700 1 -- start start 2024-01-22T05:17:40.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.215+0000 7fa0a7200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8068fc0 0x7fa0a80a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a7200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a80bdea0 0x7fa0a80a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a7200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a80be770 0x7fa0a80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a7200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a80a40f0 con 0x7fa0a8068fc0 2024-01-22T05:17:40.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a7200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a80a48f0 con 0x7fa0a80bdea0 2024-01-22T05:17:40.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a7200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a80a4330 con 0x7fa0a80be770 2024-01-22T05:17:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8068fc0 0x7fa0a80a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8068fc0 0x7fa0a80a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54308/0 (socket says 172.21.15.49:54308) 2024-01-22T05:17:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a5e00700 1 -- 172.21.15.49:0/3243180111 learned_addr learned my addr 172.21.15.49:0/3243180111 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a6800700 1 --2- 172.21.15.49:0/3243180111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a80be770 0x7fa0a80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a5400700 1 --2- 172.21.15.49:0/3243180111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a80bdea0 0x7fa0a80a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a5e00700 1 -- 172.21.15.49:0/3243180111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a80be770 msgr2=0x7fa0a80a60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a5e00700 1 --2- 172.21.15.49:0/3243180111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a80be770 0x7fa0a80a60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a5e00700 1 -- 172.21.15.49:0/3243180111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a80bdea0 msgr2=0x7fa0a80a3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a5e00700 1 --2- 172.21.15.49:0/3243180111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a80bdea0 0x7fa0a80a3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a5e00700 1 -- 172.21.15.49:0/3243180111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0980092a0 con 0x7fa0a8068fc0 2024-01-22T05:17:40.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a5e00700 1 --2- 172.21.15.49:0/3243180111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8068fc0 0x7fa0a80a6fb0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7fa09800ea20 tx=0x7fa098009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:40.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa09d600700 1 -- 172.21.15.49:0/3243180111 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09800ee60 con 0x7fa0a8068fc0 2024-01-22T05:17:40.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a7200700 1 -- 172.21.15.49:0/3243180111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a0009a20 con 0x7fa0a8068fc0 2024-01-22T05:17:40.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa09d600700 1 -- 172.21.15.49:0/3243180111 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09800c850 con 0x7fa0a8068fc0 2024-01-22T05:17:40.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa09d600700 1 -- 172.21.15.49:0/3243180111 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09800cbd0 con 0x7fa0a8068fc0 2024-01-22T05:17:40.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a7200700 1 -- 172.21.15.49:0/3243180111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a8062360 con 0x7fa0a8068fc0 2024-01-22T05:17:40.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.219+0000 7fa0a7200700 1 -- 172.21.15.49:0/3243180111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a8066840 con 0x7fa0a8068fc0 2024-01-22T05:17:40.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.223+0000 7fa09d600700 1 -- 172.21.15.49:0/3243180111 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa09801b400 con 0x7fa0a8068fc0 2024-01-22T05:17:40.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.223+0000 7fa09d600700 1 --2- 172.21.15.49:0/3243180111 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa08005a510 0x7fa08005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.223+0000 7fa09d600700 1 -- 172.21.15.49:0/3243180111 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fa098074b00 con 0x7fa0a8068fc0 2024-01-22T05:17:40.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.223+0000 7fa0a5400700 1 --2- 172.21.15.49:0/3243180111 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa08005a510 0x7fa08005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.227+0000 7fa0a5400700 1 --2- 172.21.15.49:0/3243180111 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa08005a510 0x7fa08005c9d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fa0a80ae1e0 tx=0x7fa090009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:40.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.231+0000 7fa09d600700 1 -- 172.21.15.49:0/3243180111 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa0980485c0 con 0x7fa0a8068fc0 2024-01-22T05:17:40.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.395+0000 7fa0a7200700 1 -- 172.21.15.49:0/3243180111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa0a80671a0 con 0x7fa0a8068fc0 2024-01-22T05:17:40.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.399+0000 7fa09d600700 1 -- 172.21.15.49:0/3243180111 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v155) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa09804bbe0 con 0x7fa0a8068fc0 2024-01-22T05:17:40.399 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:17:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.403+0000 7fa0a7200700 1 -- 172.21.15.49:0/3243180111 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa08005a510 msgr2=0x7fa08005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.403+0000 7fa0a7200700 1 --2- 172.21.15.49:0/3243180111 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa08005a510 0x7fa08005c9d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fa0a80ae1e0 tx=0x7fa090009040).stop 2024-01-22T05:17:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.403+0000 7fa0a7200700 1 -- 172.21.15.49:0/3243180111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8068fc0 msgr2=0x7fa0a80a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.403+0000 7fa0a7200700 1 --2- 172.21.15.49:0/3243180111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8068fc0 0x7fa0a80a6fb0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7fa09800ea20 tx=0x7fa098009060).stop 2024-01-22T05:17:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.403+0000 7fa0a7200700 1 -- 172.21.15.49:0/3243180111 shutdown_connections 2024-01-22T05:17:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.403+0000 7fa0a7200700 1 --2- 172.21.15.49:0/3243180111 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa08005a510 0x7fa08005c9d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.403+0000 7fa0a7200700 1 --2- 172.21.15.49:0/3243180111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a80be770 0x7fa0a80a60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.403+0000 7fa0a7200700 1 --2- 172.21.15.49:0/3243180111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a80bdea0 0x7fa0a80a3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.403+0000 7fa0a7200700 1 --2- 172.21.15.49:0/3243180111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0a8068fc0 0x7fa0a80a6fb0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.403+0000 7fa0a7200700 1 -- 172.21.15.49:0/3243180111 >> 172.21.15.49:0/3243180111 conn(0x7fa0a80c8750 msgr2=0x7fa0a80c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:40.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.403+0000 7fa0a7200700 1 -- 172.21.15.49:0/3243180111 shutdown_connections 2024-01-22T05:17:40.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.403+0000 7fa0a7200700 1 -- 172.21.15.49:0/3243180111 wait complete. 2024-01-22T05:17:40.429 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:17:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.595+0000 7f533ee00700 1 Processor -- start 2024-01-22T05:17:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.595+0000 7f533ee00700 1 -- start start 2024-01-22T05:17:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f533ee00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5338063f40 0x7f5338064380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f533ee00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5338153650 0x7f5338153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f533ee00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5338157b40 con 0x7f53380bdfa0 2024-01-22T05:17:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f533ee00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5338069000 con 0x7f5338063f40 2024-01-22T05:17:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f533ee00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5338158610 con 0x7f5338153650 2024-01-22T05:17:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f5337e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f53380bdfa0 0x7f53380688f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37260/0 (socket says 172.21.15.49:37260) 2024-01-22T05:17:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f5337e00700 1 -- 172.21.15.49:0/3457171961 learned_addr learned my addr 172.21.15.49:0/3457171961 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f533ce00700 1 --2- 172.21.15.49:0/3457171961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5338153650 0x7f5338153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f5337400700 1 --2- 172.21.15.49:0/3457171961 >> v2:172.21.15.110:3300/0 conn(0x7f5338063f40 0x7f5338064380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f5336a00700 1 -- 172.21.15.49:0/3457171961 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959815640 0 0) 0x7f5338157b40 con 0x7f53380bdfa0 2024-01-22T05:17:40.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f5336a00700 1 -- 172.21.15.49:0/3457171961 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53180033f0 con 0x7f53380bdfa0 2024-01-22T05:17:40.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f533ce00700 1 -- 172.21.15.49:0/3457171961 >> v2:172.21.15.110:3300/0 conn(0x7f5338063f40 msgr2=0x7f5338064380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:40.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f533ce00700 1 --2- 172.21.15.49:0/3457171961 >> v2:172.21.15.110:3300/0 conn(0x7f5338063f40 0x7f5338064380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f533ce00700 1 -- 172.21.15.49:0/3457171961 >> v1:172.21.15.49:6789/0 conn(0x7f53380bdfa0 legacy=0x7f53380688f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f533ce00700 1 -- 172.21.15.49:0/3457171961 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53380bc740 con 0x7f5338153650 2024-01-22T05:17:40.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f533ce00700 1 --2- 172.21.15.49:0/3457171961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5338153650 0x7f5338153ae0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f5330009e60 tx=0x7f5330009780).ready entity=mon.2 client_cookie=a69e05d906ae73d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:40.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f5336a00700 1 -- 172.21.15.49:0/3457171961 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533000e070 con 0x7f5338153650 2024-01-22T05:17:40.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f5336a00700 1 -- 172.21.15.49:0/3457171961 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533000bab0 con 0x7f5338153650 2024-01-22T05:17:40.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.599+0000 7f5336a00700 1 -- 172.21.15.49:0/3457171961 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533000be30 con 0x7f5338153650 2024-01-22T05:17:40.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.603+0000 7f533ee00700 1 -- 172.21.15.49:0/3457171961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5338153650 msgr2=0x7f5338153ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.603+0000 7f533ee00700 1 --2- 172.21.15.49:0/3457171961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5338153650 0x7f5338153ae0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f5330009e60 tx=0x7f5330009780).stop 2024-01-22T05:17:40.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.603+0000 7f533ee00700 1 -- 172.21.15.49:0/3457171961 shutdown_connections 2024-01-22T05:17:40.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.603+0000 7f533ee00700 1 --2- 172.21.15.49:0/3457171961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5338153650 0x7f5338153ae0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.603+0000 7f533ee00700 1 --2- 172.21.15.49:0/3457171961 >> v2:172.21.15.110:3300/0 conn(0x7f5338063f40 0x7f5338064380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.603+0000 7f533ee00700 1 -- 172.21.15.49:0/3457171961 >> 172.21.15.49:0/3457171961 conn(0x7f53380c40c0 msgr2=0x7f53380c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:40.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.603+0000 7f533ee00700 1 -- 172.21.15.49:0/3457171961 shutdown_connections 2024-01-22T05:17:40.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.603+0000 7f533ee00700 1 -- 172.21.15.49:0/3457171961 wait complete. 2024-01-22T05:17:40.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.603+0000 7f533ee00700 1 Processor -- start 2024-01-22T05:17:40.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.603+0000 7f533ee00700 1 -- start start 2024-01-22T05:17:40.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f533ee00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5338063f40 0x7f53381441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f533ee00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53380bdfa0 0x7f53380c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f533ee00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5338153650 0x7f53380c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f533ee00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53380c1b40 con 0x7f53380bdfa0 2024-01-22T05:17:40.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f533ee00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53380be950 con 0x7f5338153650 2024-01-22T05:17:40.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f533ee00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5338164a90 con 0x7f5338063f40 2024-01-22T05:17:40.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f5337400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53380bdfa0 0x7f53380c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f5337400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53380bdfa0 0x7f53380c1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54322/0 (socket says 172.21.15.49:54322) 2024-01-22T05:17:40.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f5337400700 1 -- 172.21.15.49:0/1235311238 learned_addr learned my addr 172.21.15.49:0/1235311238 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:40.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f5337e00700 1 --2- 172.21.15.49:0/1235311238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5338063f40 0x7f53381441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f533ce00700 1 --2- 172.21.15.49:0/1235311238 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5338153650 0x7f53380c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f5337400700 1 -- 172.21.15.49:0/1235311238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5338063f40 msgr2=0x7f53381441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f5337400700 1 --2- 172.21.15.49:0/1235311238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5338063f40 0x7f53381441d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f5337400700 1 -- 172.21.15.49:0/1235311238 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5338153650 msgr2=0x7f53380c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f5337400700 1 --2- 172.21.15.49:0/1235311238 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5338153650 0x7f53380c24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f5337400700 1 -- 172.21.15.49:0/1235311238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5330009a20 con 0x7f53380bdfa0 2024-01-22T05:17:40.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f533ce00700 1 --2- 172.21.15.49:0/1235311238 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5338153650 0x7f53380c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:40.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f5337400700 1 --2- 172.21.15.49:0/1235311238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53380bdfa0 0x7f53380c1fd0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f532000e930 tx=0x7f5320009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:40.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f532f400700 1 -- 172.21.15.49:0/1235311238 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532000c670 con 0x7f53380bdfa0 2024-01-22T05:17:40.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f532f400700 1 -- 172.21.15.49:0/1235311238 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532000c7d0 con 0x7f53380bdfa0 2024-01-22T05:17:40.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f533ee00700 1 -- 172.21.15.49:0/1235311238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5338164d70 con 0x7f53380bdfa0 2024-01-22T05:17:40.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f532f400700 1 -- 172.21.15.49:0/1235311238 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532000cb50 con 0x7f53380bdfa0 2024-01-22T05:17:40.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.607+0000 7f533ee00700 1 -- 172.21.15.49:0/1235311238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53381446c0 con 0x7f53380bdfa0 2024-01-22T05:17:40.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.611+0000 7f533ee00700 1 -- 172.21.15.49:0/1235311238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53380c1cf0 con 0x7f53380bdfa0 2024-01-22T05:17:40.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.611+0000 7f532f400700 1 -- 172.21.15.49:0/1235311238 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f532001b400 con 0x7f53380bdfa0 2024-01-22T05:17:40.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.615+0000 7f532f400700 1 --2- 172.21.15.49:0/1235311238 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f531005a510 0x7f531005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.615+0000 7f532f400700 1 -- 172.21.15.49:0/1235311238 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f5320074b50 con 0x7f53380bdfa0 2024-01-22T05:17:40.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.615+0000 7f5337e00700 1 --2- 172.21.15.49:0/1235311238 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f531005a510 0x7f531005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.615+0000 7f5337e00700 1 --2- 172.21.15.49:0/1235311238 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f531005a510 0x7f531005c9d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f5328005750 tx=0x7f5328009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:40.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.619+0000 7f532f400700 1 -- 172.21.15.49:0/1235311238 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f53380c1cf0 con 0x7f53380bdfa0 2024-01-22T05:17:40.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.783+0000 7f533ee00700 1 -- 172.21.15.49:0/1235311238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5338065660 con 0x7f53380bdfa0 2024-01-22T05:17:40.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.783+0000 7f532f400700 1 -- 172.21.15.49:0/1235311238 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v155) v1 ==== 84+0+143 (secure 0 0 0) 0x7f5320048400 con 0x7f53380bdfa0 2024-01-22T05:17:40.787 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:40.787 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-22T05:17:40.787 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:40.787 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-01-22T05:17:40.787 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2024-01-22T05:17:40.787 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:17:40.787 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:17:40.787 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2024-01-22T05:17:40.787 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2024-01-22T05:17:40.787 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:40.787 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-22T05:17:40.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.787+0000 7f533ee00700 1 -- 172.21.15.49:0/1235311238 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f531005a510 msgr2=0x7f531005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.787+0000 7f533ee00700 1 --2- 172.21.15.49:0/1235311238 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f531005a510 0x7f531005c9d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f5328005750 tx=0x7f5328009040).stop 2024-01-22T05:17:40.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.787+0000 7f533ee00700 1 -- 172.21.15.49:0/1235311238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53380bdfa0 msgr2=0x7f53380c1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.787+0000 7f533ee00700 1 --2- 172.21.15.49:0/1235311238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53380bdfa0 0x7f53380c1fd0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f532000e930 tx=0x7f5320009060).stop 2024-01-22T05:17:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.787+0000 7f533ee00700 1 -- 172.21.15.49:0/1235311238 shutdown_connections 2024-01-22T05:17:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.787+0000 7f533ee00700 1 --2- 172.21.15.49:0/1235311238 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f531005a510 0x7f531005c9d0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.787+0000 7f533ee00700 1 --2- 172.21.15.49:0/1235311238 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5338153650 0x7f53380c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.787+0000 7f533ee00700 1 --2- 172.21.15.49:0/1235311238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53380bdfa0 0x7f53380c1fd0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.787+0000 7f533ee00700 1 --2- 172.21.15.49:0/1235311238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5338063f40 0x7f53381441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.787+0000 7f533ee00700 1 -- 172.21.15.49:0/1235311238 >> 172.21.15.49:0/1235311238 conn(0x7f53380c40c0 msgr2=0x7f5338156d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.787+0000 7f533ee00700 1 -- 172.21.15.49:0/1235311238 shutdown_connections 2024-01-22T05:17:40.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.787+0000 7f533ee00700 1 -- 172.21.15.49:0/1235311238 wait complete. 2024-01-22T05:17:40.812 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:17:40.812 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:17:40.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.983+0000 7f579be00700 1 Processor -- start 2024-01-22T05:17:40.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.983+0000 7f579be00700 1 -- start start 2024-01-22T05:17:40.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.983+0000 7f579be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f579c14dc20 0x7f579c0bc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f579be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f579c0c2720 0x7f579c062d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f579be00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579c067a90 con 0x7f579c0c22a0 2024-01-22T05:17:40.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f579be00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c062230 con 0x7f579c0c2720 2024-01-22T05:17:40.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f579be00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c0c2bb0 con 0x7f579c14dc20 2024-01-22T05:17:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f579a000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f579c0c22a0 0x7f579c062680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37268/0 (socket says 172.21.15.49:37268) 2024-01-22T05:17:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f579a000700 1 -- 172.21.15.49:0/2604776368 learned_addr learned my addr 172.21.15.49:0/2604776368 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f579b400700 1 --2- 172.21.15.49:0/2604776368 >> v2:172.21.15.49:3300/0 conn(0x7f579c0c2720 0x7f579c062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f579aa00700 1 --2- 172.21.15.49:0/2604776368 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f579c14dc20 0x7f579c0bc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f579b400700 1 -- 172.21.15.49:0/2604776368 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f579c14dc20 msgr2=0x7f579c0bc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f579b400700 1 --2- 172.21.15.49:0/2604776368 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f579c14dc20 0x7f579c0bc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f579b400700 1 -- 172.21.15.49:0/2604776368 >> v1:172.21.15.49:6789/0 conn(0x7f579c0c22a0 legacy=0x7f579c062680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f579b400700 1 -- 172.21.15.49:0/2604776368 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c0bd190 con 0x7f579c0c2720 2024-01-22T05:17:40.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f579b400700 1 --2- 172.21.15.49:0/2604776368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c0c2720 0x7f579c062d90 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f579400af70 tx=0x7f579400a890).ready entity=mon.0 client_cookie=d2735cfb5df0fb8f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:40.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f5799600700 1 -- 172.21.15.49:0/2604776368 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579400f070 con 0x7f579c0c2720 2024-01-22T05:17:40.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f5799600700 1 -- 172.21.15.49:0/2604776368 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579400a2e0 con 0x7f579c0c2720 2024-01-22T05:17:40.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f5799600700 1 -- 172.21.15.49:0/2604776368 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579400cc30 con 0x7f579c0c2720 2024-01-22T05:17:40.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f579be00700 1 -- 172.21.15.49:0/2604776368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c0c2720 msgr2=0x7f579c062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.987+0000 7f579be00700 1 --2- 172.21.15.49:0/2604776368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c0c2720 0x7f579c062d90 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f579400af70 tx=0x7f579400a890).stop 2024-01-22T05:17:40.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.991+0000 7f579be00700 1 -- 172.21.15.49:0/2604776368 shutdown_connections 2024-01-22T05:17:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.991+0000 7f579be00700 1 --2- 172.21.15.49:0/2604776368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c0c2720 0x7f579c062d90 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.991+0000 7f579be00700 1 --2- 172.21.15.49:0/2604776368 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f579c14dc20 0x7f579c0bc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.991+0000 7f579be00700 1 -- 172.21.15.49:0/2604776368 >> 172.21.15.49:0/2604776368 conn(0x7f579c0c7850 msgr2=0x7f579c0c3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.991+0000 7f579be00700 1 -- 172.21.15.49:0/2604776368 shutdown_connections 2024-01-22T05:17:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.991+0000 7f579be00700 1 -- 172.21.15.49:0/2604776368 wait complete. 2024-01-22T05:17:40.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.991+0000 7f579be00700 1 Processor -- start 2024-01-22T05:17:40.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.991+0000 7f579be00700 1 -- start start 2024-01-22T05:17:40.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f579c0c22a0 0x7f579c0abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c0c2720 0x7f579c0aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f579c14dc20 0x7f579c148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579be00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c154c60 con 0x7f579c0c2720 2024-01-22T05:17:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579be00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c154070 con 0x7f579c0c22a0 2024-01-22T05:17:40.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579be00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c154330 con 0x7f579c14dc20 2024-01-22T05:17:40.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c0c2720 0x7f579c0aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c0c2720 0x7f579c0aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54348/0 (socket says 172.21.15.49:54348) 2024-01-22T05:17:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579a000700 1 -- 172.21.15.49:0/1120626702 learned_addr learned my addr 172.21.15.49:0/1120626702 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579aa00700 1 --2- 172.21.15.49:0/1120626702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f579c0c22a0 0x7f579c0abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579b400700 1 --2- 172.21.15.49:0/1120626702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f579c14dc20 0x7f579c148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579a000700 1 -- 172.21.15.49:0/1120626702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f579c14dc20 msgr2=0x7f579c148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579a000700 1 --2- 172.21.15.49:0/1120626702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f579c14dc20 0x7f579c148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579a000700 1 -- 172.21.15.49:0/1120626702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f579c0c22a0 msgr2=0x7f579c0abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579a000700 1 --2- 172.21.15.49:0/1120626702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f579c0c22a0 0x7f579c0abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579a000700 1 -- 172.21.15.49:0/1120626702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579400ab30 con 0x7f579c0c2720 2024-01-22T05:17:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579a000700 1 --2- 172.21.15.49:0/1120626702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c0c2720 0x7f579c0aafa0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f578400c4c0 tx=0x7f5784007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f5792000700 1 -- 172.21.15.49:0/1120626702 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57840072e0 con 0x7f579c0c2720 2024-01-22T05:17:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f5792000700 1 -- 172.21.15.49:0/1120626702 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5784007440 con 0x7f579c0c2720 2024-01-22T05:17:40.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579be00700 1 -- 172.21.15.49:0/1120626702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579c154610 con 0x7f579c0c2720 2024-01-22T05:17:40.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f5792000700 1 -- 172.21.15.49:0/1120626702 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57840057a0 con 0x7f579c0c2720 2024-01-22T05:17:40.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.995+0000 7f579be00700 1 -- 172.21.15.49:0/1120626702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579c149100 con 0x7f579c0c2720 2024-01-22T05:17:40.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.999+0000 7f579be00700 1 -- 172.21.15.49:0/1120626702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579c154dd0 con 0x7f579c0c2720 2024-01-22T05:17:41.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:40.999+0000 7f5792000700 1 -- 172.21.15.49:0/1120626702 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5784005bd0 con 0x7f579c0c2720 2024-01-22T05:17:41.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.003+0000 7f5792000700 1 --2- 172.21.15.49:0/1120626702 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f577405a4e0 0x7f577405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:41.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.003+0000 7f5792000700 1 -- 172.21.15.49:0/1120626702 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f5784073e10 con 0x7f579c0c2720 2024-01-22T05:17:41.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.003+0000 7f579aa00700 1 --2- 172.21.15.49:0/1120626702 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f577405a4e0 0x7f577405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:41.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.003+0000 7f579aa00700 1 --2- 172.21.15.49:0/1120626702 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f577405a4e0 0x7f577405c9a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f578c009b20 tx=0x7f578c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:41.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.007+0000 7f5792000700 1 -- 172.21.15.49:0/1120626702 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5784077030 con 0x7f579c0c2720 2024-01-22T05:17:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.175+0000 7f579be00700 1 -- 172.21.15.49:0/1120626702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f579c0bd470 con 0x7f579c0c2720 2024-01-22T05:17:41.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.607+0000 7f5792000700 1 -- 172.21.15.49:0/1120626702 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v156) v1 ==== 152+0+0 (secure 0 0 0) 0x7f57840476c0 con 0x7f579c0c2720 2024-01-22T05:17:41.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.615+0000 7f579be00700 1 -- 172.21.15.49:0/1120626702 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f577405a4e0 msgr2=0x7f577405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:41.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.615+0000 7f579be00700 1 --2- 172.21.15.49:0/1120626702 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f577405a4e0 0x7f577405c9a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f578c009b20 tx=0x7f578c008040).stop 2024-01-22T05:17:41.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.615+0000 7f579be00700 1 -- 172.21.15.49:0/1120626702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c0c2720 msgr2=0x7f579c0aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:41.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.615+0000 7f579be00700 1 --2- 172.21.15.49:0/1120626702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c0c2720 0x7f579c0aafa0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f578400c4c0 tx=0x7f5784007dc0).stop 2024-01-22T05:17:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.615+0000 7f579be00700 1 -- 172.21.15.49:0/1120626702 shutdown_connections 2024-01-22T05:17:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.615+0000 7f579be00700 1 --2- 172.21.15.49:0/1120626702 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f577405a4e0 0x7f577405c9a0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.615+0000 7f579be00700 1 --2- 172.21.15.49:0/1120626702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f579c14dc20 0x7f579c148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.615+0000 7f579be00700 1 --2- 172.21.15.49:0/1120626702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c0c2720 0x7f579c0aafa0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.615+0000 7f579be00700 1 --2- 172.21.15.49:0/1120626702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f579c0c22a0 0x7f579c0abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.615+0000 7f579be00700 1 -- 172.21.15.49:0/1120626702 >> 172.21.15.49:0/1120626702 conn(0x7f579c0c7850 msgr2=0x7f579c14cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.619+0000 7f579be00700 1 -- 172.21.15.49:0/1120626702 shutdown_connections 2024-01-22T05:17:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.619+0000 7f579be00700 1 -- 172.21.15.49:0/1120626702 wait complete. 2024-01-22T05:17:41.626 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-01-22T05:17:41.642 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:17:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.803+0000 7fcd84600700 1 Processor -- start 2024-01-22T05:17:41.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.803+0000 7fcd84600700 1 -- start start 2024-01-22T05:17:41.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd84600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcd7c0a8c20 0x7fcd7c0c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:41.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd84600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0c1ac0 0x7fcd7c0bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:41.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd84600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c158650 con 0x7fcd7c0bc9c0 2024-01-22T05:17:41.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd84600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c0c1f20 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd84600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0bd170 con 0x7fcd7c0c1ac0 2024-01-22T05:17:41.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd82600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcd7c0bc9c0 0x7fcd7c068710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37274/0 (socket says 172.21.15.49:37274) 2024-01-22T05:17:41.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd82600700 1 -- 172.21.15.49:0/840071358 learned_addr learned my addr 172.21.15.49:0/840071358 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:41.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd81c00700 1 --2- 172.21.15.49:0/840071358 >> v2:172.21.15.110:3300/0 conn(0x7fcd7c0a8c20 0x7fcd7c0c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:41.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd81200700 1 --2- 172.21.15.49:0/840071358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0c1ac0 0x7fcd7c0bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:41.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd7be00700 1 -- 172.21.15.49:0/840071358 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124174142 0 0) 0x7fcd74001490 con 0x7fcd7c0bc9c0 2024-01-22T05:17:41.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd7be00700 1 -- 172.21.15.49:0/840071358 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd5c0033f0 con 0x7fcd7c0bc9c0 2024-01-22T05:17:41.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd81c00700 1 -- 172.21.15.49:0/840071358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0c1ac0 msgr2=0x7fcd7c0bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:41.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd81c00700 1 --2- 172.21.15.49:0/840071358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0c1ac0 0x7fcd7c0bc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:41.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd81c00700 1 -- 172.21.15.49:0/840071358 >> v1:172.21.15.49:6789/0 conn(0x7fcd7c0bc9c0 legacy=0x7fcd7c068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:41.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd81c00700 1 -- 172.21.15.49:0/840071358 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c067c30 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.807+0000 7fcd81c00700 1 --2- 172.21.15.49:0/840071358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c0a8c20 0x7fcd7c0c15d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fcd6c009760 tx=0x7fcd6c009060).ready entity=mon.1 client_cookie=cd8f213629619ef3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:41.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.811+0000 7fcd7be00700 1 -- 172.21.15.49:0/840071358 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c00d4a0 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.811+0000 7fcd7be00700 1 -- 172.21.15.49:0/840071358 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c00d600 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.811+0000 7fcd7be00700 1 -- 172.21.15.49:0/840071358 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c00d980 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.811+0000 7fcd84600700 1 -- 172.21.15.49:0/840071358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c0a8c20 msgr2=0x7fcd7c0c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.811+0000 7fcd84600700 1 --2- 172.21.15.49:0/840071358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c0a8c20 0x7fcd7c0c15d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fcd6c009760 tx=0x7fcd6c009060).stop 2024-01-22T05:17:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.811+0000 7fcd84600700 1 -- 172.21.15.49:0/840071358 shutdown_connections 2024-01-22T05:17:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.811+0000 7fcd84600700 1 --2- 172.21.15.49:0/840071358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0c1ac0 0x7fcd7c0bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:41.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.811+0000 7fcd84600700 1 --2- 172.21.15.49:0/840071358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c0a8c20 0x7fcd7c0c15d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:41.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.811+0000 7fcd84600700 1 -- 172.21.15.49:0/840071358 >> 172.21.15.49:0/840071358 conn(0x7fcd7c062cb0 msgr2=0x7fcd7c0c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:41.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.811+0000 7fcd84600700 1 -- 172.21.15.49:0/840071358 shutdown_connections 2024-01-22T05:17:41.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.811+0000 7fcd84600700 1 -- 172.21.15.49:0/840071358 wait complete. 2024-01-22T05:17:41.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.815+0000 7fcd84600700 1 Processor -- start 2024-01-22T05:17:41.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.815+0000 7fcd84600700 1 -- start start 2024-01-22T05:17:41.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd84600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd7c0a8c20 0x7fcd7c1680c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:41.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd84600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0bc9c0 0x7fcd7c14f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:41.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd84600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c0c1ac0 0x7fcd7c0bf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:41.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd84600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c159580 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd84600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c158970 con 0x7fcd7c0c1ac0 2024-01-22T05:17:41.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd84600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c158c50 con 0x7fcd7c0bc9c0 2024-01-22T05:17:41.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd81c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd7c0a8c20 0x7fcd7c1680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:41.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd81c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd7c0a8c20 0x7fcd7c1680c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54350/0 (socket says 172.21.15.49:54350) 2024-01-22T05:17:41.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd81c00700 1 -- 172.21.15.49:0/2851774978 learned_addr learned my addr 172.21.15.49:0/2851774978 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:41.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd82600700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c0c1ac0 0x7fcd7c0bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:41.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd81200700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0bc9c0 0x7fcd7c14f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:41.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd81c00700 1 -- 172.21.15.49:0/2851774978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0bc9c0 msgr2=0x7fcd7c14f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd81c00700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0bc9c0 0x7fcd7c14f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd81c00700 1 -- 172.21.15.49:0/2851774978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c0c1ac0 msgr2=0x7fcd7c0bf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd81c00700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c0c1ac0 0x7fcd7c0bf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd81c00700 1 -- 172.21.15.49:0/2851774978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c0092a0 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd82600700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c0c1ac0 0x7fcd7c0bf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd81200700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0bc9c0 0x7fcd7c14f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd81c00700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd7c0a8c20 0x7fcd7c1680c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7fcd6c009d50 tx=0x7fcd6c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd78c00700 1 -- 172.21.15.49:0/2851774978 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c000c90 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd78c00700 1 -- 172.21.15.49:0/2851774978 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c00d770 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd84600700 1 -- 172.21.15.49:0/2851774978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c158f30 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd78c00700 1 -- 172.21.15.49:0/2851774978 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c01d640 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.819+0000 7fcd84600700 1 -- 172.21.15.49:0/2851774978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c1685b0 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.823+0000 7fcd84600700 1 -- 172.21.15.49:0/2851774978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c0c0c00 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.823+0000 7fcd78c00700 1 -- 172.21.15.49:0/2851774978 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcd6c01da70 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.823+0000 7fcd78c00700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5405a510 0x7fcd5405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:41.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.823+0000 7fcd78c00700 1 -- 172.21.15.49:0/2851774978 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5992+0+0 (secure 0 0 0) 0x7fcd6c076000 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.823+0000 7fcd81200700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5405a510 0x7fcd5405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:41.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.827+0000 7fcd81200700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5405a510 0x7fcd5405c9d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fcd64009200 tx=0x7fcd64008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.831+0000 7fcd78c00700 1 -- 172.21.15.49:0/2851774978 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcd6c049860 con 0x7fcd7c0a8c20 2024-01-22T05:17:41.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:41.995+0000 7fcd84600700 1 -- 172.21.15.49:0/2851774978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcd7c067f10 con 0x7fcd7c0a8c20 2024-01-22T05:17:42.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.619+0000 7fcd78c00700 1 -- 172.21.15.49:0/2851774978 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v157) v1 ==== 170+0+0 (secure 0 0 0) 0x7fcd6c04ce80 con 0x7fcd7c0a8c20 2024-01-22T05:17:42.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.627+0000 7fcd84600700 1 -- 172.21.15.49:0/2851774978 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5405a510 msgr2=0x7fcd5405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:42.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.627+0000 7fcd84600700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5405a510 0x7fcd5405c9d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fcd64009200 tx=0x7fcd64008040).stop 2024-01-22T05:17:42.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.627+0000 7fcd84600700 1 -- 172.21.15.49:0/2851774978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd7c0a8c20 msgr2=0x7fcd7c1680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:42.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.627+0000 7fcd84600700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd7c0a8c20 0x7fcd7c1680c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7fcd6c009d50 tx=0x7fcd6c016000).stop 2024-01-22T05:17:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.635+0000 7fcd84600700 1 -- 172.21.15.49:0/2851774978 shutdown_connections 2024-01-22T05:17:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.635+0000 7fcd84600700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcd5405a510 0x7fcd5405c9d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.635+0000 7fcd84600700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c0c1ac0 0x7fcd7c0bf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.635+0000 7fcd84600700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0bc9c0 0x7fcd7c14f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.635+0000 7fcd84600700 1 --2- 172.21.15.49:0/2851774978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd7c0a8c20 0x7fcd7c1680c0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:42.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.635+0000 7fcd84600700 1 -- 172.21.15.49:0/2851774978 >> 172.21.15.49:0/2851774978 conn(0x7fcd7c062cb0 msgr2=0x7fcd7c0656d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:42.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.635+0000 7fcd84600700 1 -- 172.21.15.49:0/2851774978 shutdown_connections 2024-01-22T05:17:42.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.635+0000 7fcd84600700 1 -- 172.21.15.49:0/2851774978 wait complete. 2024-01-22T05:17:42.651 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-01-22T05:17:42.672 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:17:42.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.851+0000 7f9d95e00700 1 Processor -- start 2024-01-22T05:17:42.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.851+0000 7f9d95e00700 1 -- start start 2024-01-22T05:17:42.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.855+0000 7f9d95e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d90153930 0x7f9d90063da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:42.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.855+0000 7f9d95e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9d90064290 0x7f9d900c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:42.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.855+0000 7f9d95e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d900696a0 con 0x7f9d900c6080 2024-01-22T05:17:42.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.855+0000 7f9d95e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d900c3970 con 0x7f9d90153930 2024-01-22T05:17:42.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.855+0000 7f9d95e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d90069f50 con 0x7f9d90064290 2024-01-22T05:17:42.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.855+0000 7f9d94a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d90153930 0x7f9d90063da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:42.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.855+0000 7f9d94a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9d90153930 0x7f9d90063da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54358/0 (socket says 172.21.15.49:54358) 2024-01-22T05:17:42.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.855+0000 7f9d94a00700 1 -- 172.21.15.49:0/2737222348 learned_addr learned my addr 172.21.15.49:0/2737222348 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:42.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.855+0000 7f9d8fe00700 1 --2- 172.21.15.49:0/2737222348 >> v2:172.21.15.110:3300/0 conn(0x7f9d90064290 0x7f9d900c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:42.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d94a00700 1 -- 172.21.15.49:0/2737222348 >> v2:172.21.15.110:3300/0 conn(0x7f9d90064290 msgr2=0x7f9d900c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:42.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d94a00700 1 --2- 172.21.15.49:0/2737222348 >> v2:172.21.15.110:3300/0 conn(0x7f9d90064290 0x7f9d900c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:42.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d94a00700 1 -- 172.21.15.49:0/2737222348 >> v1:172.21.15.110:6789/0 conn(0x7f9d900c6080 legacy=0x7f9d900c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:42.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d94a00700 1 -- 172.21.15.49:0/2737222348 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d90064720 con 0x7f9d90153930 2024-01-22T05:17:42.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d94a00700 1 --2- 172.21.15.49:0/2737222348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d90153930 0x7f9d90063da0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f9d900ad7f0 tx=0x7f9d800090f0).ready entity=mon.0 client_cookie=c28e596214e65462 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:42.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d8f400700 1 -- 172.21.15.49:0/2737222348 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000b520 con 0x7f9d90153930 2024-01-22T05:17:42.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d8f400700 1 -- 172.21.15.49:0/2737222348 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8000b680 con 0x7f9d90153930 2024-01-22T05:17:42.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d8f400700 1 -- 172.21.15.49:0/2737222348 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000ba00 con 0x7f9d90153930 2024-01-22T05:17:42.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d95e00700 1 -- 172.21.15.49:0/2737222348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d90153930 msgr2=0x7f9d90063da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:42.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d95e00700 1 --2- 172.21.15.49:0/2737222348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d90153930 0x7f9d90063da0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f9d900ad7f0 tx=0x7f9d800090f0).stop 2024-01-22T05:17:42.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d95e00700 1 -- 172.21.15.49:0/2737222348 shutdown_connections 2024-01-22T05:17:42.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d95e00700 1 --2- 172.21.15.49:0/2737222348 >> v2:172.21.15.110:3300/0 conn(0x7f9d90064290 0x7f9d900c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:42.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d95e00700 1 --2- 172.21.15.49:0/2737222348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d90153930 0x7f9d90063da0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:42.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d95e00700 1 -- 172.21.15.49:0/2737222348 >> 172.21.15.49:0/2737222348 conn(0x7f9d90062760 msgr2=0x7f9d90062b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:42.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d95e00700 1 -- 172.21.15.49:0/2737222348 shutdown_connections 2024-01-22T05:17:42.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.859+0000 7f9d95e00700 1 -- 172.21.15.49:0/2737222348 wait complete. 2024-01-22T05:17:42.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.863+0000 7f9d95e00700 1 Processor -- start 2024-01-22T05:17:42.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.863+0000 7f9d95e00700 1 -- start start 2024-01-22T05:17:42.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.863+0000 7f9d95e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d90064290 0x7f9d901572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:42.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.863+0000 7f9d95e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900c6080 0x7f9d900bd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:42.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.863+0000 7f9d95e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d90153930 0x7f9d900bdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:42.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.863+0000 7f9d95e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900be030 con 0x7f9d900c6080 2024-01-22T05:17:42.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.863+0000 7f9d95e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900a76b0 con 0x7f9d90064290 2024-01-22T05:17:42.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.863+0000 7f9d95e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d90159ea0 con 0x7f9d90153930 2024-01-22T05:17:42.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.863+0000 7f9d8fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900c6080 0x7f9d900bd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:42.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d8fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900c6080 0x7f9d900bd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54368/0 (socket says 172.21.15.49:54368) 2024-01-22T05:17:42.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d8fe00700 1 -- 172.21.15.49:0/193918223 learned_addr learned my addr 172.21.15.49:0/193918223 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:42.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d94a00700 1 --2- 172.21.15.49:0/193918223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d90064290 0x7f9d901572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:42.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d95400700 1 --2- 172.21.15.49:0/193918223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d90153930 0x7f9d900bdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:42.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d8fe00700 1 -- 172.21.15.49:0/193918223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d90153930 msgr2=0x7f9d900bdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:42.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d8fe00700 1 --2- 172.21.15.49:0/193918223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d90153930 0x7f9d900bdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:42.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d8fe00700 1 -- 172.21.15.49:0/193918223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d90064290 msgr2=0x7f9d901572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:42.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d8fe00700 1 --2- 172.21.15.49:0/193918223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d90064290 0x7f9d901572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:42.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d8fe00700 1 -- 172.21.15.49:0/193918223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d80009370 con 0x7f9d900c6080 2024-01-22T05:17:42.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d8fe00700 1 --2- 172.21.15.49:0/193918223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900c6080 0x7f9d900bd650 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f9d7800e900 tx=0x7f9d78009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:42.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d87e00700 1 -- 172.21.15.49:0/193918223 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78012600 con 0x7f9d900c6080 2024-01-22T05:17:42.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d87e00700 1 -- 172.21.15.49:0/193918223 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d78012760 con 0x7f9d900c6080 2024-01-22T05:17:42.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d87e00700 1 -- 172.21.15.49:0/193918223 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78012ae0 con 0x7f9d900c6080 2024-01-22T05:17:42.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d95e00700 1 -- 172.21.15.49:0/193918223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d900a7970 con 0x7f9d900c6080 2024-01-22T05:17:42.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d95e00700 1 -- 172.21.15.49:0/193918223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d900a7f30 con 0x7f9d900c6080 2024-01-22T05:17:42.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.867+0000 7f9d95e00700 1 -- 172.21.15.49:0/193918223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d900c2980 con 0x7f9d900c6080 2024-01-22T05:17:42.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.871+0000 7f9d87e00700 1 -- 172.21.15.49:0/193918223 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9d7801b400 con 0x7f9d900c6080 2024-01-22T05:17:42.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.871+0000 7f9d87e00700 1 --2- 172.21.15.49:0/193918223 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d6805a510 0x7f9d6805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:42.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.871+0000 7f9d87e00700 1 -- 172.21.15.49:0/193918223 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f9d78074c00 con 0x7f9d900c6080 2024-01-22T05:17:42.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.871+0000 7f9d94a00700 1 --2- 172.21.15.49:0/193918223 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d6805a510 0x7f9d6805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:42.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.871+0000 7f9d94a00700 1 --2- 172.21.15.49:0/193918223 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d6805a510 0x7f9d6805c9d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f9d80009130 tx=0x7f9d80015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:42.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:42.879+0000 7f9d87e00700 1 -- 172.21.15.49:0/193918223 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9d780481c0 con 0x7f9d900c6080 2024-01-22T05:17:43.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.083+0000 7f9d95e00700 1 -- 172.21.15.49:0/193918223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9d90046800 con 0x7f9d900c6080 2024-01-22T05:17:43.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.095+0000 7f9d87e00700 1 -- 172.21.15.49:0/193918223 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v122) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9d7804b7e0 con 0x7f9d900c6080 2024-01-22T05:17:43.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.103+0000 7f9d95e00700 1 -- 172.21.15.49:0/193918223 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d6805a510 msgr2=0x7f9d6805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.103+0000 7f9d95e00700 1 --2- 172.21.15.49:0/193918223 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d6805a510 0x7f9d6805c9d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f9d80009130 tx=0x7f9d80015000).stop 2024-01-22T05:17:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.103+0000 7f9d95e00700 1 -- 172.21.15.49:0/193918223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900c6080 msgr2=0x7f9d900bd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.103+0000 7f9d95e00700 1 --2- 172.21.15.49:0/193918223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900c6080 0x7f9d900bd650 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f9d7800e900 tx=0x7f9d78009060).stop 2024-01-22T05:17:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.103+0000 7f9d95e00700 1 -- 172.21.15.49:0/193918223 shutdown_connections 2024-01-22T05:17:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.103+0000 7f9d95e00700 1 --2- 172.21.15.49:0/193918223 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d6805a510 0x7f9d6805c9d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.103+0000 7f9d95e00700 1 --2- 172.21.15.49:0/193918223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d90153930 0x7f9d900bdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.103+0000 7f9d95e00700 1 --2- 172.21.15.49:0/193918223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900c6080 0x7f9d900bd650 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.103+0000 7f9d95e00700 1 --2- 172.21.15.49:0/193918223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d90064290 0x7f9d901572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.103+0000 7f9d95e00700 1 -- 172.21.15.49:0/193918223 >> 172.21.15.49:0/193918223 conn(0x7f9d90062760 msgr2=0x7f9d900bc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:43.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.107+0000 7f9d95e00700 1 -- 172.21.15.49:0/193918223 shutdown_connections 2024-01-22T05:17:43.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.107+0000 7f9d95e00700 1 -- 172.21.15.49:0/193918223 wait complete. 2024-01-22T05:17:43.125 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 22 and data pool 23 2024-01-22T05:17:43.148 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:17:43.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.307+0000 7f9881a00700 1 Processor -- start 2024-01-22T05:17:43.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.307+0000 7f9881a00700 1 -- start start 2024-01-22T05:17:43.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f9881a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f987c064c00 0x7f987c0bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:43.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f9881a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987c0c2700 con 0x7f987c065240 2024-01-22T05:17:43.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f9881a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987c0c29a0 con 0x7f987c065620 2024-01-22T05:17:43.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f9881a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987c0c2c80 con 0x7f987c064c00 2024-01-22T05:17:43.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f987a000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f987c064c00 0x7f987c0bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:43.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f987aa00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f987c065240 0x7f987c0644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44568/0 (socket says 172.21.15.49:44568) 2024-01-22T05:17:43.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f987aa00700 1 -- 172.21.15.49:0/2350423407 learned_addr learned my addr 172.21.15.49:0/2350423407 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:43.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f9879600700 1 -- 172.21.15.49:0/2350423407 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666145630 0 0) 0x7f987c0c2700 con 0x7f987c065240 2024-01-22T05:17:43.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f9879600700 1 -- 172.21.15.49:0/2350423407 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f985c0033f0 con 0x7f987c065240 2024-01-22T05:17:43.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f987a000700 1 -- 172.21.15.49:0/2350423407 >> v1:172.21.15.110:6789/0 conn(0x7f987c065620 legacy=0x7f987c0bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:43.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f987a000700 1 -- 172.21.15.49:0/2350423407 >> v1:172.21.15.49:6789/0 conn(0x7f987c065240 legacy=0x7f987c0644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:43.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f987a000700 1 -- 172.21.15.49:0/2350423407 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c0c2f60 con 0x7f987c064c00 2024-01-22T05:17:43.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f987a000700 1 --2- 172.21.15.49:0/2350423407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f987c064c00 0x7f987c0bcc80 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7f9864009760 tx=0x7f9864009060).ready entity=mon.0 client_cookie=bcd72418adac091f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:43.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f9879600700 1 -- 172.21.15.49:0/2350423407 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986400f510 con 0x7f987c064c00 2024-01-22T05:17:43.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f9879600700 1 -- 172.21.15.49:0/2350423407 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986400f670 con 0x7f987c064c00 2024-01-22T05:17:43.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.311+0000 7f9879600700 1 -- 172.21.15.49:0/2350423407 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986400f9f0 con 0x7f987c064c00 2024-01-22T05:17:43.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.315+0000 7f9881a00700 1 -- 172.21.15.49:0/2350423407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f987c064c00 msgr2=0x7f987c0bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:43.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.315+0000 7f9881a00700 1 --2- 172.21.15.49:0/2350423407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f987c064c00 0x7f987c0bcc80 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7f9864009760 tx=0x7f9864009060).stop 2024-01-22T05:17:43.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.315+0000 7f9881a00700 1 -- 172.21.15.49:0/2350423407 shutdown_connections 2024-01-22T05:17:43.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.315+0000 7f9881a00700 1 --2- 172.21.15.49:0/2350423407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f987c064c00 0x7f987c0bcc80 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.315+0000 7f9881a00700 1 -- 172.21.15.49:0/2350423407 >> 172.21.15.49:0/2350423407 conn(0x7f987c0c87f0 msgr2=0x7f987c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:43.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.315+0000 7f9881a00700 1 -- 172.21.15.49:0/2350423407 shutdown_connections 2024-01-22T05:17:43.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.315+0000 7f9881a00700 1 -- 172.21.15.49:0/2350423407 wait complete. 2024-01-22T05:17:43.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.319+0000 7f9881a00700 1 Processor -- start 2024-01-22T05:17:43.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.319+0000 7f9881a00700 1 -- start start 2024-01-22T05:17:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f9881a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f987c064c00 0x7f987c0c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f9881a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f987c065240 0x7f987c0bedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f9881a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f987c065620 0x7f987c0ac600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f9881a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c16c8c0 con 0x7f987c064c00 2024-01-22T05:17:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f9881a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c16bcd0 con 0x7f987c065240 2024-01-22T05:17:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f9881a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c16bf90 con 0x7f987c065620 2024-01-22T05:17:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f987aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f987c064c00 0x7f987c0c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f987aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f987c064c00 0x7f987c0c1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48978/0 (socket says 172.21.15.49:48978) 2024-01-22T05:17:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f987aa00700 1 -- 172.21.15.49:0/3646399177 learned_addr learned my addr 172.21.15.49:0/3646399177 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f987a000700 1 --2- 172.21.15.49:0/3646399177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f987c065240 0x7f987c0bedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:43.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f987be00700 1 --2- 172.21.15.49:0/3646399177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f987c065620 0x7f987c0ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f987aa00700 1 -- 172.21.15.49:0/3646399177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f987c065620 msgr2=0x7f987c0ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f987aa00700 1 --2- 172.21.15.49:0/3646399177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f987c065620 0x7f987c0ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f987aa00700 1 -- 172.21.15.49:0/3646399177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f987c065240 msgr2=0x7f987c0bedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f987aa00700 1 --2- 172.21.15.49:0/3646399177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f987c065240 0x7f987c0bedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f987aa00700 1 -- 172.21.15.49:0/3646399177 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98640092a0 con 0x7f987c064c00 2024-01-22T05:17:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f987aa00700 1 --2- 172.21.15.49:0/3646399177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f987c064c00 0x7f987c0c1b80 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7f986c00c590 tx=0x7f986c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f9872000700 1 -- 172.21.15.49:0/3646399177 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c0072e0 con 0x7f987c064c00 2024-01-22T05:17:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f9872000700 1 -- 172.21.15.49:0/3646399177 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c007440 con 0x7f987c064c00 2024-01-22T05:17:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f9872000700 1 -- 172.21.15.49:0/3646399177 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c0057a0 con 0x7f987c064c00 2024-01-22T05:17:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f9881a00700 1 -- 172.21.15.49:0/3646399177 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987c16c270 con 0x7f987c064c00 2024-01-22T05:17:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.323+0000 7f9881a00700 1 -- 172.21.15.49:0/3646399177 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987c0bf2b0 con 0x7f987c064c00 2024-01-22T05:17:43.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.327+0000 7f9881a00700 1 -- 172.21.15.49:0/3646399177 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987c047060 con 0x7f987c064c00 2024-01-22T05:17:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.327+0000 7f9872000700 1 -- 172.21.15.49:0/3646399177 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f986c005bd0 con 0x7f987c064c00 2024-01-22T05:17:43.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.327+0000 7f9872000700 1 --2- 172.21.15.49:0/3646399177 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f985405a510 0x7f985405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:43.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.327+0000 7f9872000700 1 -- 172.21.15.49:0/3646399177 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f986c074160 con 0x7f987c064c00 2024-01-22T05:17:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.327+0000 7f987a000700 1 --2- 172.21.15.49:0/3646399177 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f985405a510 0x7f985405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.331+0000 7f987a000700 1 --2- 172.21.15.49:0/3646399177 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f985405a510 0x7f985405c9d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f9864009630 tx=0x7f9864017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:43.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.335+0000 7f9872000700 1 -- 172.21.15.49:0/3646399177 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f986c0477e0 con 0x7f987c064c00 2024-01-22T05:17:43.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.499+0000 7f9881a00700 1 -- 172.21.15.49:0/3646399177 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f987c0c3240 con 0x7f987c064c00 2024-01-22T05:17:43.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.499+0000 7f9872000700 1 -- 172.21.15.49:0/3646399177 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+17191 (secure 0 0 0) 0x7f986c04ae00 con 0x7f987c064c00 2024-01-22T05:17:43.502 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:43.502 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":158,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:17:43.086633+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:17:41.253119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-01-22T05:17:42.073279+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:17:43.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.503+0000 7f9881a00700 1 -- 172.21.15.49:0/3646399177 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f985405a510 msgr2=0x7f985405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:43.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.503+0000 7f9881a00700 1 --2- 172.21.15.49:0/3646399177 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f985405a510 0x7f985405c9d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f9864009630 tx=0x7f9864017000).stop 2024-01-22T05:17:43.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.503+0000 7f9881a00700 1 -- 172.21.15.49:0/3646399177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f987c064c00 msgr2=0x7f987c0c1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:43.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.503+0000 7f9881a00700 1 --2- 172.21.15.49:0/3646399177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f987c064c00 0x7f987c0c1b80 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7f986c00c590 tx=0x7f986c007c80).stop 2024-01-22T05:17:43.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.503+0000 7f9881a00700 1 -- 172.21.15.49:0/3646399177 shutdown_connections 2024-01-22T05:17:43.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.503+0000 7f9881a00700 1 --2- 172.21.15.49:0/3646399177 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f985405a510 0x7f985405c9d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.503+0000 7f9881a00700 1 --2- 172.21.15.49:0/3646399177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f987c065620 0x7f987c0ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.503+0000 7f9881a00700 1 --2- 172.21.15.49:0/3646399177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f987c065240 0x7f987c0bedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.503+0000 7f9881a00700 1 --2- 172.21.15.49:0/3646399177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f987c064c00 0x7f987c0c1b80 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.503+0000 7f9881a00700 1 -- 172.21.15.49:0/3646399177 >> 172.21.15.49:0/3646399177 conn(0x7f987c0c87f0 msgr2=0x7f987c063850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:43.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.503+0000 7f9881a00700 1 -- 172.21.15.49:0/3646399177 shutdown_connections 2024-01-22T05:17:43.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.503+0000 7f9881a00700 1 -- 172.21.15.49:0/3646399177 wait complete. 2024-01-22T05:17:43.530 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:17:43.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.687+0000 7fe96b000700 1 Processor -- start 2024-01-22T05:17:43.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe96b000700 1 -- start start 2024-01-22T05:17:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe96b000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe964064690 0x7fe964064af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe96b000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe964151370 0x7fe964151800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe96b000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9640be210 con 0x7fe9640be6a0 2024-01-22T05:17:43.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe96b000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9640bd650 con 0x7fe964151370 2024-01-22T05:17:43.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe96b000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640bd8e0 con 0x7fe964064690 2024-01-22T05:17:43.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe969a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe964151370 0x7fe964151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:43.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe963e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe9640be6a0 0x7fe9640c2cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:35876/0 (socket says 172.21.15.49:35876) 2024-01-22T05:17:43.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe963e00700 1 -- 172.21.15.49:0/2092974184 learned_addr learned my addr 172.21.15.49:0/2092974184 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:43.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe963400700 1 --2- 172.21.15.49:0/2092974184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe964064690 0x7fe964064af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:43.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe962a00700 1 -- 172.21.15.49:0/2092974184 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322747193 0 0) 0x7fe9640be210 con 0x7fe9640be6a0 2024-01-22T05:17:43.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe962a00700 1 -- 172.21.15.49:0/2092974184 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9440033f0 con 0x7fe9640be6a0 2024-01-22T05:17:43.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe969a00700 1 -- 172.21.15.49:0/2092974184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe964064690 msgr2=0x7fe964064af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:43.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe969a00700 1 --2- 172.21.15.49:0/2092974184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe964064690 0x7fe964064af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe969a00700 1 -- 172.21.15.49:0/2092974184 >> v1:172.21.15.110:6789/0 conn(0x7fe9640be6a0 legacy=0x7fe9640c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:43.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.691+0000 7fe969a00700 1 -- 172.21.15.49:0/2092974184 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9640bdbc0 con 0x7fe964151370 2024-01-22T05:17:43.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.695+0000 7fe969a00700 1 --2- 172.21.15.49:0/2092974184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe964151370 0x7fe964151800 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fe95c009e60 tx=0x7fe95c009780).ready entity=mon.0 client_cookie=6c1d3808b4204319 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:43.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.695+0000 7fe962a00700 1 -- 172.21.15.49:0/2092974184 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c00e070 con 0x7fe964151370 2024-01-22T05:17:43.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.695+0000 7fe962a00700 1 -- 172.21.15.49:0/2092974184 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c00bab0 con 0x7fe964151370 2024-01-22T05:17:43.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.695+0000 7fe962a00700 1 -- 172.21.15.49:0/2092974184 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c00be30 con 0x7fe964151370 2024-01-22T05:17:43.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.695+0000 7fe96b000700 1 -- 172.21.15.49:0/2092974184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe964151370 msgr2=0x7fe964151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:43.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.695+0000 7fe96b000700 1 --2- 172.21.15.49:0/2092974184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe964151370 0x7fe964151800 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fe95c009e60 tx=0x7fe95c009780).stop 2024-01-22T05:17:43.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.695+0000 7fe96b000700 1 -- 172.21.15.49:0/2092974184 shutdown_connections 2024-01-22T05:17:43.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.695+0000 7fe96b000700 1 --2- 172.21.15.49:0/2092974184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe964151370 0x7fe964151800 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.695+0000 7fe96b000700 1 --2- 172.21.15.49:0/2092974184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe964064690 0x7fe964064af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.695+0000 7fe96b000700 1 -- 172.21.15.49:0/2092974184 >> 172.21.15.49:0/2092974184 conn(0x7fe9640c87f0 msgr2=0x7fe9640c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:43.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.695+0000 7fe96b000700 1 -- 172.21.15.49:0/2092974184 shutdown_connections 2024-01-22T05:17:43.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.695+0000 7fe96b000700 1 -- 172.21.15.49:0/2092974184 wait complete. 2024-01-22T05:17:43.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.699+0000 7fe96b000700 1 Processor -- start 2024-01-22T05:17:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.699+0000 7fe96b000700 1 -- start start 2024-01-22T05:17:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe96b000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe964064690 0x7fe9640bf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe96b000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9640be6a0 0x7fe964157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe96b000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe964151370 0x7fe964157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe96b000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe964158100 con 0x7fe964151370 2024-01-22T05:17:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe96b000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96416c6c0 con 0x7fe9640be6a0 2024-01-22T05:17:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe96b000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640c1880 con 0x7fe964064690 2024-01-22T05:17:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe969a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe964151370 0x7fe964157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe969a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe964151370 0x7fe964157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48998/0 (socket says 172.21.15.49:48998) 2024-01-22T05:17:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe969a00700 1 -- 172.21.15.49:0/2916217306 learned_addr learned my addr 172.21.15.49:0/2916217306 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe963e00700 1 --2- 172.21.15.49:0/2916217306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe964064690 0x7fe9640bf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe963400700 1 --2- 172.21.15.49:0/2916217306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9640be6a0 0x7fe964157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:43.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe969a00700 1 -- 172.21.15.49:0/2916217306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe964064690 msgr2=0x7fe9640bf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:43.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe969a00700 1 --2- 172.21.15.49:0/2916217306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe964064690 0x7fe9640bf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe969a00700 1 -- 172.21.15.49:0/2916217306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9640be6a0 msgr2=0x7fe964157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:43.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe969a00700 1 --2- 172.21.15.49:0/2916217306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9640be6a0 0x7fe964157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe969a00700 1 -- 172.21.15.49:0/2916217306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c009a20 con 0x7fe964151370 2024-01-22T05:17:43.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe969a00700 1 --2- 172.21.15.49:0/2916217306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe964151370 0x7fe964157c10 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7fe964066900 tx=0x7fe9640c2710).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:43.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe95b400700 1 -- 172.21.15.49:0/2916217306 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c012e50 con 0x7fe964151370 2024-01-22T05:17:43.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe95b400700 1 -- 172.21.15.49:0/2916217306 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c01d630 con 0x7fe964151370 2024-01-22T05:17:43.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe96b000700 1 -- 172.21.15.49:0/2916217306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9640c0f50 con 0x7fe964151370 2024-01-22T05:17:43.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe95b400700 1 -- 172.21.15.49:0/2916217306 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c01d9f0 con 0x7fe964151370 2024-01-22T05:17:43.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.703+0000 7fe96b000700 1 -- 172.21.15.49:0/2916217306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9640c1510 con 0x7fe964151370 2024-01-22T05:17:43.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.707+0000 7fe96b000700 1 -- 172.21.15.49:0/2916217306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9640c19f0 con 0x7fe964151370 2024-01-22T05:17:43.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.707+0000 7fe95b400700 1 -- 172.21.15.49:0/2916217306 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe95c027460 con 0x7fe964151370 2024-01-22T05:17:43.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.711+0000 7fe95b400700 1 --2- 172.21.15.49:0/2916217306 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe93c05a510 0x7fe93c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:43.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.711+0000 7fe95b400700 1 -- 172.21.15.49:0/2916217306 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe95c0766f0 con 0x7fe964151370 2024-01-22T05:17:43.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.711+0000 7fe963e00700 1 --2- 172.21.15.49:0/2916217306 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe93c05a510 0x7fe93c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:43.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.711+0000 7fe963e00700 1 --2- 172.21.15.49:0/2916217306 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe93c05a510 0x7fe93c05c9d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fe954005750 tx=0x7fe954009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:43.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.715+0000 7fe95b400700 1 -- 172.21.15.49:0/2916217306 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe95c049c50 con 0x7fe964151370 2024-01-22T05:17:43.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.883+0000 7fe96b000700 1 -- 172.21.15.49:0/2916217306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe964047060 con 0x7fe964151370 2024-01-22T05:17:43.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.887+0000 7fe95b400700 1 -- 172.21.15.49:0/2916217306 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+17191 (secure 0 0 0) 0x7fe95c04d270 con 0x7fe964151370 2024-01-22T05:17:43.887 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:43.887 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":158,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:17:43.086633+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:17:41.253119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-01-22T05:17:42.073279+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:17:43.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.887+0000 7fe96b000700 1 -- 172.21.15.49:0/2916217306 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe93c05a510 msgr2=0x7fe93c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:43.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.887+0000 7fe96b000700 1 --2- 172.21.15.49:0/2916217306 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe93c05a510 0x7fe93c05c9d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fe954005750 tx=0x7fe954009040).stop 2024-01-22T05:17:43.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.887+0000 7fe96b000700 1 -- 172.21.15.49:0/2916217306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe964151370 msgr2=0x7fe964157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:43.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.887+0000 7fe96b000700 1 --2- 172.21.15.49:0/2916217306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe964151370 0x7fe964157c10 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7fe964066900 tx=0x7fe9640c2710).stop 2024-01-22T05:17:43.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.887+0000 7fe96b000700 1 -- 172.21.15.49:0/2916217306 shutdown_connections 2024-01-22T05:17:43.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.887+0000 7fe96b000700 1 --2- 172.21.15.49:0/2916217306 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe93c05a510 0x7fe93c05c9d0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.887+0000 7fe96b000700 1 --2- 172.21.15.49:0/2916217306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe964151370 0x7fe964157c10 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.887+0000 7fe96b000700 1 --2- 172.21.15.49:0/2916217306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9640be6a0 0x7fe964157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.887+0000 7fe96b000700 1 --2- 172.21.15.49:0/2916217306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe964064690 0x7fe9640bf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:43.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.887+0000 7fe96b000700 1 -- 172.21.15.49:0/2916217306 >> 172.21.15.49:0/2916217306 conn(0x7fe9640c87f0 msgr2=0x7fe9640a7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:43.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.891+0000 7fe96b000700 1 -- 172.21.15.49:0/2916217306 shutdown_connections 2024-01-22T05:17:43.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:43.891+0000 7fe96b000700 1 -- 172.21.15.49:0/2916217306 wait complete. 2024-01-22T05:17:43.915 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:17:44.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.079+0000 7fadc3e00700 1 Processor -- start 2024-01-22T05:17:44.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.079+0000 7fadc3e00700 1 -- start start 2024-01-22T05:17:44.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.083+0000 7fadc3e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fadbc153cf0 0x7fadbc0c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.083+0000 7fadc3e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadbc068280 con 0x7fadbc0bcba0 2024-01-22T05:17:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.083+0000 7fadc3e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadbc0c1f30 con 0x7fadbc0c1ac0 2024-01-22T05:17:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.083+0000 7fadc3e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadbc0bd190 con 0x7fadbc153cf0 2024-01-22T05:17:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.083+0000 7fadc1e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fadbc0bcba0 0x7fadbc068710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44574/0 (socket says 172.21.15.49:44574) 2024-01-22T05:17:44.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.083+0000 7fadc1e00700 1 -- 172.21.15.49:0/3391906121 learned_addr learned my addr 172.21.15.49:0/3391906121 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:44.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.083+0000 7fadc1400700 1 --2- 172.21.15.49:0/3391906121 >> v2:172.21.15.110:3300/0 conn(0x7fadbc153cf0 0x7fadbc0c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadbbe00700 1 -- 172.21.15.49:0/3391906121 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448952959 0 0) 0x7fadbc068280 con 0x7fadbc0bcba0 2024-01-22T05:17:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadbbe00700 1 -- 172.21.15.49:0/3391906121 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad9c0033f0 con 0x7fadbc0bcba0 2024-01-22T05:17:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadbbe00700 1 -- 172.21.15.49:0/3391906121 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084116093 0 0) 0x7fadbc0c1f30 con 0x7fadbc0c1ac0 2024-01-22T05:17:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadbbe00700 1 -- 172.21.15.49:0/3391906121 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadbc068280 con 0x7fadbc0c1ac0 2024-01-22T05:17:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadc1400700 1 -- 172.21.15.49:0/3391906121 >> v1:172.21.15.110:6789/0 conn(0x7fadbc0c1ac0 legacy=0x7fadbc0bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadc1400700 1 -- 172.21.15.49:0/3391906121 >> v1:172.21.15.49:6789/0 conn(0x7fadbc0bcba0 legacy=0x7fadbc068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadc1400700 1 -- 172.21.15.49:0/3391906121 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc067c30 con 0x7fadbc153cf0 2024-01-22T05:17:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadc1400700 1 --2- 172.21.15.49:0/3391906121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadbc153cf0 0x7fadbc0c15d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fadac009760 tx=0x7fadac009060).ready entity=mon.1 client_cookie=d06ee22f7dcf1685 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadbbe00700 1 -- 172.21.15.49:0/3391906121 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac00f510 con 0x7fadbc153cf0 2024-01-22T05:17:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadbbe00700 1 -- 172.21.15.49:0/3391906121 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac00f670 con 0x7fadbc153cf0 2024-01-22T05:17:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadbbe00700 1 -- 172.21.15.49:0/3391906121 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac00f9f0 con 0x7fadbc153cf0 2024-01-22T05:17:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadc3e00700 1 -- 172.21.15.49:0/3391906121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadbc153cf0 msgr2=0x7fadbc0c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadc3e00700 1 --2- 172.21.15.49:0/3391906121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadbc153cf0 0x7fadbc0c15d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fadac009760 tx=0x7fadac009060).stop 2024-01-22T05:17:44.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadc3e00700 1 -- 172.21.15.49:0/3391906121 shutdown_connections 2024-01-22T05:17:44.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadc3e00700 1 --2- 172.21.15.49:0/3391906121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadbc153cf0 0x7fadbc0c15d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:44.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.087+0000 7fadc3e00700 1 -- 172.21.15.49:0/3391906121 >> 172.21.15.49:0/3391906121 conn(0x7fadbc062cb0 msgr2=0x7fadbc0c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:44.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.091+0000 7fadc3e00700 1 -- 172.21.15.49:0/3391906121 shutdown_connections 2024-01-22T05:17:44.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.091+0000 7fadc3e00700 1 -- 172.21.15.49:0/3391906121 wait complete. 2024-01-22T05:17:44.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.091+0000 7fadc3e00700 1 Processor -- start 2024-01-22T05:17:44.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.091+0000 7fadc3e00700 1 -- start start 2024-01-22T05:17:44.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc3e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadbc0bcba0 0x7fadbc0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:44.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadbc0c1ac0 0x7fadbc164750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:44.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadbc153cf0 0x7fadbc151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:44.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc3e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc0a71d0 con 0x7fadbc0c1ac0 2024-01-22T05:17:44.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc3e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc164ff0 con 0x7fadbc153cf0 2024-01-22T05:17:44.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc3e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc1652d0 con 0x7fadbc0bcba0 2024-01-22T05:17:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadbc0c1ac0 0x7fadbc164750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadbc0c1ac0 0x7fadbc164750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49014/0 (socket says 172.21.15.49:49014) 2024-01-22T05:17:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc0a00700 1 -- 172.21.15.49:0/2462507471 learned_addr learned my addr 172.21.15.49:0/2462507471 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc1e00700 1 --2- 172.21.15.49:0/2462507471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadbc153cf0 0x7fadbc151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc1400700 1 --2- 172.21.15.49:0/2462507471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadbc0bcba0 0x7fadbc0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc0a00700 1 -- 172.21.15.49:0/2462507471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadbc0bcba0 msgr2=0x7fadbc0a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc0a00700 1 --2- 172.21.15.49:0/2462507471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadbc0bcba0 0x7fadbc0a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc0a00700 1 -- 172.21.15.49:0/2462507471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadbc153cf0 msgr2=0x7fadbc151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc0a00700 1 --2- 172.21.15.49:0/2462507471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadbc153cf0 0x7fadbc151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc0a00700 1 -- 172.21.15.49:0/2462507471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac0092a0 con 0x7fadbc0c1ac0 2024-01-22T05:17:44.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc0a00700 1 --2- 172.21.15.49:0/2462507471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadbc0c1ac0 0x7fadbc164750 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7fada400c4c0 tx=0x7fada4007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:44.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadb8c00700 1 -- 172.21.15.49:0/2462507471 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada400ce30 con 0x7fadbc0c1ac0 2024-01-22T05:17:44.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadb8c00700 1 -- 172.21.15.49:0/2462507471 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada400f470 con 0x7fadbc0c1ac0 2024-01-22T05:17:44.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc3e00700 1 -- 172.21.15.49:0/2462507471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadbc1655b0 con 0x7fadbc0c1ac0 2024-01-22T05:17:44.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadb8c00700 1 -- 172.21.15.49:0/2462507471 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada400f810 con 0x7fadbc0c1ac0 2024-01-22T05:17:44.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.095+0000 7fadc3e00700 1 -- 172.21.15.49:0/2462507471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadbc0a6df0 con 0x7fadbc0c1ac0 2024-01-22T05:17:44.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.099+0000 7fadc3e00700 1 -- 172.21.15.49:0/2462507471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadbc0c0c00 con 0x7fadbc0c1ac0 2024-01-22T05:17:44.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.099+0000 7fadb8c00700 1 -- 172.21.15.49:0/2462507471 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fada400fbc0 con 0x7fadbc0c1ac0 2024-01-22T05:17:44.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.103+0000 7fadb8c00700 1 --2- 172.21.15.49:0/2462507471 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad9405a510 0x7fad9405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:44.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.103+0000 7fadb8c00700 1 -- 172.21.15.49:0/2462507471 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fada4073e00 con 0x7fadbc0c1ac0 2024-01-22T05:17:44.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.103+0000 7fadc1400700 1 --2- 172.21.15.49:0/2462507471 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad9405a510 0x7fad9405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:44.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.103+0000 7fadc1400700 1 --2- 172.21.15.49:0/2462507471 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad9405a510 0x7fad9405c9d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fadac006e00 tx=0x7fadac017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:44.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.111+0000 7fadb8c00700 1 -- 172.21.15.49:0/2462507471 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fada4047480 con 0x7fadbc0c1ac0 2024-01-22T05:17:44.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:44.315+0000 7fadc3e00700 1 -- 172.21.15.49:0/2462507471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fadbc1575a0 con 0x7fadbc0c1ac0 2024-01-22T05:17:45.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.107+0000 7fadb8c00700 1 -- 172.21.15.49:0/2462507471 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v125) v1 ==== 118+0+0 (secure 0 0 0) 0x7fada404aaa0 con 0x7fadbc0c1ac0 2024-01-22T05:17:45.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.111+0000 7fadc3e00700 1 -- 172.21.15.49:0/2462507471 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad9405a510 msgr2=0x7fad9405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:45.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.111+0000 7fadc3e00700 1 --2- 172.21.15.49:0/2462507471 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad9405a510 0x7fad9405c9d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fadac006e00 tx=0x7fadac017000).stop 2024-01-22T05:17:45.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.111+0000 7fadc3e00700 1 -- 172.21.15.49:0/2462507471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadbc0c1ac0 msgr2=0x7fadbc164750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:45.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.111+0000 7fadc3e00700 1 --2- 172.21.15.49:0/2462507471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadbc0c1ac0 0x7fadbc164750 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7fada400c4c0 tx=0x7fada4007c80).stop 2024-01-22T05:17:45.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.115+0000 7fadc3e00700 1 -- 172.21.15.49:0/2462507471 shutdown_connections 2024-01-22T05:17:45.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.115+0000 7fadc3e00700 1 --2- 172.21.15.49:0/2462507471 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fad9405a510 0x7fad9405c9d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:45.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.115+0000 7fadc3e00700 1 --2- 172.21.15.49:0/2462507471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadbc153cf0 0x7fadbc151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:45.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.115+0000 7fadc3e00700 1 --2- 172.21.15.49:0/2462507471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadbc0c1ac0 0x7fadbc164750 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:45.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.115+0000 7fadc3e00700 1 --2- 172.21.15.49:0/2462507471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadbc0bcba0 0x7fadbc0a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:45.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.115+0000 7fadc3e00700 1 -- 172.21.15.49:0/2462507471 >> 172.21.15.49:0/2462507471 conn(0x7fadbc062cb0 msgr2=0x7fadbc0c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:45.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.115+0000 7fadc3e00700 1 -- 172.21.15.49:0/2462507471 shutdown_connections 2024-01-22T05:17:45.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.115+0000 7fadc3e00700 1 -- 172.21.15.49:0/2462507471 wait complete. 2024-01-22T05:17:45.141 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T05:17:45.141 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:17:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.314+0000 7f6f88a00700 1 Processor -- start 2024-01-22T05:17:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.314+0000 7f6f88a00700 1 -- start start 2024-01-22T05:17:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.318+0000 7f6f88a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6f84068710 0x7f6f841577d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.318+0000 7f6f88a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84068af0 0x7f6f84157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.318+0000 7f6f88a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f84068280 con 0x7f6f84065590 2024-01-22T05:17:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.318+0000 7f6f88a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f841581b0 con 0x7f6f84068710 2024-01-22T05:17:45.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.318+0000 7f6f88a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84069600 con 0x7f6f84068af0 2024-01-22T05:17:45.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.322+0000 7f6f83400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6f84068710 0x7f6f841577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:45.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.322+0000 7f6f83400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6f84068710 0x7f6f841577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49024/0 (socket says 172.21.15.49:49024) 2024-01-22T05:17:45.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.322+0000 7f6f83400700 1 -- 172.21.15.49:0/1801114788 learned_addr learned my addr 172.21.15.49:0/1801114788 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:45.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.322+0000 7f6f82a00700 1 --2- 172.21.15.49:0/1801114788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84068af0 0x7f6f84157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:45.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.322+0000 7f6f82000700 1 -- 172.21.15.49:0/1801114788 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147775527 0 0) 0x7f6f84068280 con 0x7f6f84065590 2024-01-22T05:17:45.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.322+0000 7f6f83400700 1 -- 172.21.15.49:0/1801114788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84068af0 msgr2=0x7f6f84157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:45.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.322+0000 7f6f83400700 1 --2- 172.21.15.49:0/1801114788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84068af0 0x7f6f84157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:45.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.322+0000 7f6f83400700 1 -- 172.21.15.49:0/1801114788 >> v1:172.21.15.110:6789/0 conn(0x7f6f84065590 legacy=0x7f6f84065a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:45.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.322+0000 7f6f83400700 1 -- 172.21.15.49:0/1801114788 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f840c1cc0 con 0x7f6f84068710 2024-01-22T05:17:45.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.322+0000 7f6f83400700 1 --2- 172.21.15.49:0/1801114788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f84068710 0x7f6f841577d0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f6f74009810 tx=0x7f6f74009060).ready entity=mon.0 client_cookie=d53cd3cc43fa49d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:45.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.322+0000 7f6f82000700 1 -- 172.21.15.49:0/1801114788 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74005880 con 0x7f6f84068710 2024-01-22T05:17:45.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.322+0000 7f6f82000700 1 -- 172.21.15.49:0/1801114788 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f740059e0 con 0x7f6f84068710 2024-01-22T05:17:45.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.322+0000 7f6f82000700 1 -- 172.21.15.49:0/1801114788 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74005d60 con 0x7f6f84068710 2024-01-22T05:17:45.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.322+0000 7f6f88a00700 1 -- 172.21.15.49:0/1801114788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f84068710 msgr2=0x7f6f841577d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:45.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.322+0000 7f6f88a00700 1 --2- 172.21.15.49:0/1801114788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f84068710 0x7f6f841577d0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f6f74009810 tx=0x7f6f74009060).stop 2024-01-22T05:17:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.326+0000 7f6f88a00700 1 -- 172.21.15.49:0/1801114788 shutdown_connections 2024-01-22T05:17:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.326+0000 7f6f88a00700 1 --2- 172.21.15.49:0/1801114788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84068af0 0x7f6f84157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.326+0000 7f6f88a00700 1 --2- 172.21.15.49:0/1801114788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f84068710 0x7f6f841577d0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.326+0000 7f6f88a00700 1 -- 172.21.15.49:0/1801114788 >> 172.21.15.49:0/1801114788 conn(0x7f6f840c6fc0 msgr2=0x7f6f840c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.326+0000 7f6f88a00700 1 -- 172.21.15.49:0/1801114788 shutdown_connections 2024-01-22T05:17:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.326+0000 7f6f88a00700 1 -- 172.21.15.49:0/1801114788 wait complete. 2024-01-22T05:17:45.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.326+0000 7f6f88a00700 1 Processor -- start 2024-01-22T05:17:45.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f88a00700 1 -- start start 2024-01-22T05:17:45.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f88a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f84065590 0x7f6f8414e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:45.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f88a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84068710 0x7f6f84153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:45.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f88a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f84068af0 0x7f6f84154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:45.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f88a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8414ea40 con 0x7f6f84065590 2024-01-22T05:17:45.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f88a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84152d70 con 0x7f6f84068af0 2024-01-22T05:17:45.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f88a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84153050 con 0x7f6f84068710 2024-01-22T05:17:45.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f83400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f84065590 0x7f6f8414e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:45.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f83400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f84065590 0x7f6f8414e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49030/0 (socket says 172.21.15.49:49030) 2024-01-22T05:17:45.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f83400700 1 -- 172.21.15.49:0/302635739 learned_addr learned my addr 172.21.15.49:0/302635739 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:45.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f83e00700 1 --2- 172.21.15.49:0/302635739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f84068af0 0x7f6f84154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:45.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f82a00700 1 --2- 172.21.15.49:0/302635739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84068710 0x7f6f84153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:45.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f83400700 1 -- 172.21.15.49:0/302635739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84068710 msgr2=0x7f6f84153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:45.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f83400700 1 --2- 172.21.15.49:0/302635739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84068710 0x7f6f84153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:45.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f83400700 1 -- 172.21.15.49:0/302635739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f84068af0 msgr2=0x7f6f84154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:45.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f83400700 1 --2- 172.21.15.49:0/302635739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f84068af0 0x7f6f84154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:45.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f83400700 1 -- 172.21.15.49:0/302635739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f74009300 con 0x7f6f84065590 2024-01-22T05:17:45.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.330+0000 7f6f83400700 1 --2- 172.21.15.49:0/302635739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f84065590 0x7f6f8414e550 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7f6f84064dc0 tx=0x7f6f74016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:45.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.334+0000 7f6f7aa00700 1 -- 172.21.15.49:0/302635739 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f740067c0 con 0x7f6f84065590 2024-01-22T05:17:45.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.334+0000 7f6f7aa00700 1 -- 172.21.15.49:0/302635739 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7400b790 con 0x7f6f84065590 2024-01-22T05:17:45.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.334+0000 7f6f88a00700 1 -- 172.21.15.49:0/302635739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f84153330 con 0x7f6f84065590 2024-01-22T05:17:45.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.334+0000 7f6f7aa00700 1 -- 172.21.15.49:0/302635739 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7400bb10 con 0x7f6f84065590 2024-01-22T05:17:45.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.334+0000 7f6f88a00700 1 -- 172.21.15.49:0/302635739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f841538f0 con 0x7f6f84065590 2024-01-22T05:17:45.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.334+0000 7f6f88a00700 1 -- 172.21.15.49:0/302635739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f84047060 con 0x7f6f84065590 2024-01-22T05:17:45.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.334+0000 7f6f7aa00700 1 -- 172.21.15.49:0/302635739 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6f74018070 con 0x7f6f84065590 2024-01-22T05:17:45.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.338+0000 7f6f7aa00700 1 --2- 172.21.15.49:0/302635739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f5c05a540 0x7f6f5c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:45.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.338+0000 7f6f7aa00700 1 -- 172.21.15.49:0/302635739 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f6f74075950 con 0x7f6f84065590 2024-01-22T05:17:45.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.338+0000 7f6f82a00700 1 --2- 172.21.15.49:0/302635739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f5c05a540 0x7f6f5c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:45.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.338+0000 7f6f82a00700 1 --2- 172.21.15.49:0/302635739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f5c05a540 0x7f6f5c05ca00 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f6f84066930 tx=0x7f6f6c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:45.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.342+0000 7f6f7aa00700 1 -- 172.21.15.49:0/302635739 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6f74048fd0 con 0x7f6f84065590 2024-01-22T05:17:45.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:45.542+0000 7f6f88a00700 1 -- 172.21.15.49:0/302635739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6f84067c30 con 0x7f6f84065590 2024-01-22T05:17:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.118+0000 7f6f7aa00700 1 -- 172.21.15.49:0/302635739 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v126) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6f7404c5f0 con 0x7f6f84065590 2024-01-22T05:17:46.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.122+0000 7f6f88a00700 1 -- 172.21.15.49:0/302635739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f5c05a540 msgr2=0x7f6f5c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:46.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.122+0000 7f6f88a00700 1 --2- 172.21.15.49:0/302635739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f5c05a540 0x7f6f5c05ca00 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f6f84066930 tx=0x7f6f6c008040).stop 2024-01-22T05:17:46.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.122+0000 7f6f88a00700 1 -- 172.21.15.49:0/302635739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f84065590 msgr2=0x7f6f8414e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:46.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.122+0000 7f6f88a00700 1 --2- 172.21.15.49:0/302635739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f84065590 0x7f6f8414e550 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7f6f84064dc0 tx=0x7f6f74016000).stop 2024-01-22T05:17:46.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.122+0000 7f6f88a00700 1 -- 172.21.15.49:0/302635739 shutdown_connections 2024-01-22T05:17:46.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.122+0000 7f6f88a00700 1 --2- 172.21.15.49:0/302635739 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f5c05a540 0x7f6f5c05ca00 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.122+0000 7f6f88a00700 1 --2- 172.21.15.49:0/302635739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f84068af0 0x7f6f84154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.122+0000 7f6f88a00700 1 --2- 172.21.15.49:0/302635739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f84068710 0x7f6f84153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.122+0000 7f6f88a00700 1 --2- 172.21.15.49:0/302635739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f84065590 0x7f6f8414e550 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.122+0000 7f6f88a00700 1 -- 172.21.15.49:0/302635739 >> 172.21.15.49:0/302635739 conn(0x7f6f840c6fc0 msgr2=0x7f6f840c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:46.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.122+0000 7f6f88a00700 1 -- 172.21.15.49:0/302635739 shutdown_connections 2024-01-22T05:17:46.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.122+0000 7f6f88a00700 1 -- 172.21.15.49:0/302635739 wait complete. 2024-01-22T05:17:46.144 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:17:46.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:17:46.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.310+0000 7f93b1400700 1 Processor -- start 2024-01-22T05:17:46.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.310+0000 7f93b1400700 1 -- start start 2024-01-22T05:17:46.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93b1400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f93ac0c3050 0x7f93ac0c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:46.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93b1400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93ac0bdee0 0x7f93ac0ace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:46.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93b1400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac0ab520 con 0x7f93ac0bda70 2024-01-22T05:17:46.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93b1400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac0c3430 con 0x7f93ac0bdee0 2024-01-22T05:17:46.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93b1400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac0c1cd0 con 0x7f93ac0c3050 2024-01-22T05:17:46.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93b0a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93ac0bdee0 0x7f93ac0ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:46.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93b0a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93ac0bdee0 0x7f93ac0ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49042/0 (socket says 172.21.15.49:49042) 2024-01-22T05:17:46.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93b0a00700 1 -- 172.21.15.49:0/3304231436 learned_addr learned my addr 172.21.15.49:0/3304231436 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:46.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93ab400700 1 --1- 172.21.15.49:0/3304231436 >> v1:172.21.15.49:6789/0 conn(0x7f93ac0bda70 0x7f93ac0ac700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44582/0 (socket says 172.21.15.49:44582) 2024-01-22T05:17:46.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93abe00700 1 --2- 172.21.15.49:0/3304231436 >> v2:172.21.15.110:3300/0 conn(0x7f93ac0c3050 0x7f93ac0c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:46.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93b0a00700 1 -- 172.21.15.49:0/3304231436 >> v2:172.21.15.110:3300/0 conn(0x7f93ac0c3050 msgr2=0x7f93ac0c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:46.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93b0a00700 1 --2- 172.21.15.49:0/3304231436 >> v2:172.21.15.110:3300/0 conn(0x7f93ac0c3050 0x7f93ac0c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93b0a00700 1 -- 172.21.15.49:0/3304231436 >> v1:172.21.15.49:6789/0 conn(0x7f93ac0bda70 legacy=0x7f93ac0ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:46.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93b0a00700 1 -- 172.21.15.49:0/3304231436 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0c1fb0 con 0x7f93ac0bdee0 2024-01-22T05:17:46.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93b0a00700 1 --2- 172.21.15.49:0/3304231436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ac0bdee0 0x7f93ac0ace10 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f93ac067720 tx=0x7f93a4009840).ready entity=mon.0 client_cookie=18c8e5a87797f748 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:46.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93aaa00700 1 -- 172.21.15.49:0/3304231436 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400e070 con 0x7f93ac0bdee0 2024-01-22T05:17:46.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93aaa00700 1 -- 172.21.15.49:0/3304231436 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a400ba50 con 0x7f93ac0bdee0 2024-01-22T05:17:46.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.314+0000 7f93aaa00700 1 -- 172.21.15.49:0/3304231436 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400bdd0 con 0x7f93ac0bdee0 2024-01-22T05:17:46.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.318+0000 7f93b1400700 1 -- 172.21.15.49:0/3304231436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ac0bdee0 msgr2=0x7f93ac0ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:46.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.318+0000 7f93b1400700 1 --2- 172.21.15.49:0/3304231436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ac0bdee0 0x7f93ac0ace10 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f93ac067720 tx=0x7f93a4009840).stop 2024-01-22T05:17:46.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.318+0000 7f93b1400700 1 -- 172.21.15.49:0/3304231436 shutdown_connections 2024-01-22T05:17:46.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.318+0000 7f93b1400700 1 --2- 172.21.15.49:0/3304231436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ac0bdee0 0x7f93ac0ace10 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.318+0000 7f93b1400700 1 --2- 172.21.15.49:0/3304231436 >> v2:172.21.15.110:3300/0 conn(0x7f93ac0c3050 0x7f93ac0c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.318+0000 7f93b1400700 1 -- 172.21.15.49:0/3304231436 >> 172.21.15.49:0/3304231436 conn(0x7f93ac0aa6b0 msgr2=0x7f93ac0aaac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:46.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.318+0000 7f93b1400700 1 -- 172.21.15.49:0/3304231436 shutdown_connections 2024-01-22T05:17:46.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.318+0000 7f93b1400700 1 -- 172.21.15.49:0/3304231436 wait complete. 2024-01-22T05:17:46.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.322+0000 7f93b1400700 1 Processor -- start 2024-01-22T05:17:46.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.322+0000 7f93b1400700 1 -- start start 2024-01-22T05:17:46.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.322+0000 7f93b1400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0bda70 0x7f93ac0a7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:46.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.322+0000 7f93b1400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac0bdee0 0x7f93ac1675f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:46.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.322+0000 7f93b1400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ac0c3050 0x7f93ac167ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:46.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.322+0000 7f93b1400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac167fd0 con 0x7f93ac0c3050 2024-01-22T05:17:46.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.322+0000 7f93b1400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac165390 con 0x7f93ac0bdee0 2024-01-22T05:17:46.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.322+0000 7f93b1400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac165670 con 0x7f93ac0bda70 2024-01-22T05:17:46.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.322+0000 7f93b0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ac0c3050 0x7f93ac167ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:46.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.322+0000 7f93abe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0bda70 0x7f93ac0a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:46.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.322+0000 7f93b0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ac0c3050 0x7f93ac167ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49054/0 (socket says 172.21.15.49:49054) 2024-01-22T05:17:46.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.322+0000 7f93b0a00700 1 -- 172.21.15.49:0/632491205 learned_addr learned my addr 172.21.15.49:0/632491205 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:46.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.322+0000 7f93ab400700 1 --2- 172.21.15.49:0/632491205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac0bdee0 0x7f93ac1675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:46.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.326+0000 7f93abe00700 1 -- 172.21.15.49:0/632491205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac0bdee0 msgr2=0x7f93ac1675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:46.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.326+0000 7f93abe00700 1 --2- 172.21.15.49:0/632491205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac0bdee0 0x7f93ac1675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.326+0000 7f93abe00700 1 -- 172.21.15.49:0/632491205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ac0c3050 msgr2=0x7f93ac167ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:46.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.326+0000 7f93abe00700 1 --2- 172.21.15.49:0/632491205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ac0c3050 0x7f93ac167ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.326+0000 7f93abe00700 1 -- 172.21.15.49:0/632491205 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a4009ae0 con 0x7f93ac0bda70 2024-01-22T05:17:46.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.326+0000 7f93b0a00700 1 --2- 172.21.15.49:0/632491205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ac0c3050 0x7f93ac167ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:46.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.326+0000 7f93abe00700 1 --2- 172.21.15.49:0/632491205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0bda70 0x7f93ac0a7110 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f939c00d5e0 tx=0x7f939c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:46.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.326+0000 7f93a3400700 1 -- 172.21.15.49:0/632491205 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c011590 con 0x7f93ac0bda70 2024-01-22T05:17:46.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.326+0000 7f93a3400700 1 -- 172.21.15.49:0/632491205 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c0116f0 con 0x7f93ac0bda70 2024-01-22T05:17:46.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.326+0000 7f93b1400700 1 -- 172.21.15.49:0/632491205 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac165950 con 0x7f93ac0bda70 2024-01-22T05:17:46.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.326+0000 7f93a3400700 1 -- 172.21.15.49:0/632491205 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c011a70 con 0x7f93ac0bda70 2024-01-22T05:17:46.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.326+0000 7f93b1400700 1 -- 172.21.15.49:0/632491205 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac165f10 con 0x7f93ac0bda70 2024-01-22T05:17:46.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.326+0000 7f93b1400700 1 -- 172.21.15.49:0/632491205 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac0c2290 con 0x7f93ac0bda70 2024-01-22T05:17:46.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.330+0000 7f93a3400700 1 -- 172.21.15.49:0/632491205 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f939c012420 con 0x7f93ac0bda70 2024-01-22T05:17:46.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.330+0000 7f93a3400700 1 --2- 172.21.15.49:0/632491205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f938405a4e0 0x7f938405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:46.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.330+0000 7f93a3400700 1 -- 172.21.15.49:0/632491205 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f939c074200 con 0x7f93ac0bda70 2024-01-22T05:17:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.330+0000 7f93ab400700 1 --2- 172.21.15.49:0/632491205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f938405a4e0 0x7f938405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.330+0000 7f93ab400700 1 --2- 172.21.15.49:0/632491205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f938405a4e0 0x7f938405c9a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f93ac0a9f80 tx=0x7f9394007d30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:46.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.342+0000 7f93a3400700 1 -- 172.21.15.49:0/632491205 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f939c047760 con 0x7f93ac0bda70 2024-01-22T05:17:46.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.542+0000 7f93b1400700 1 -- 172.21.15.49:0/632491205 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93ac05fd40 con 0x7f93ac0bda70 2024-01-22T05:17:46.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.546+0000 7f93a3400700 1 -- 172.21.15.49:0/632491205 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f939c04ad80 con 0x7f93ac0bda70 2024-01-22T05:17:46.547 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:46.547 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":126,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3010799828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3010799828},{"type":"v1","addr":"172.21.15.110:6833","nonce":3010799828}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":7940,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2071707351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2071707351},{"type":"v1","addr":"172.21.15.110:6835","nonce":2071707351}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":9309,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3579312059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3579312059},{"type":"v1","addr":"172.21.15.49:6835","nonce":3579312059}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":126,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:17:43.087426+0000","modified":"2024-01-22T05:17:46.108388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9312":{"gid":9312,"name":"c","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3762397937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3762397937},{"type":"v1","addr":"172.21.15.49:6837","nonce":3762397937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2024-01-22T05:17:46.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.550+0000 7f93b1400700 1 -- 172.21.15.49:0/632491205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f938405a4e0 msgr2=0x7f938405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:46.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.550+0000 7f93b1400700 1 --2- 172.21.15.49:0/632491205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f938405a4e0 0x7f938405c9a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f93ac0a9f80 tx=0x7f9394007d30).stop 2024-01-22T05:17:46.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.550+0000 7f93b1400700 1 -- 172.21.15.49:0/632491205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0bda70 msgr2=0x7f93ac0a7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:46.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.550+0000 7f93b1400700 1 --2- 172.21.15.49:0/632491205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0bda70 0x7f93ac0a7110 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f939c00d5e0 tx=0x7f939c008040).stop 2024-01-22T05:17:46.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.550+0000 7f93b1400700 1 -- 172.21.15.49:0/632491205 shutdown_connections 2024-01-22T05:17:46.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.550+0000 7f93b1400700 1 --2- 172.21.15.49:0/632491205 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f938405a4e0 0x7f938405c9a0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.550+0000 7f93b1400700 1 --2- 172.21.15.49:0/632491205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ac0c3050 0x7f93ac167ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.550+0000 7f93b1400700 1 --2- 172.21.15.49:0/632491205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac0bdee0 0x7f93ac1675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.550+0000 7f93b1400700 1 --2- 172.21.15.49:0/632491205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0bda70 0x7f93ac0a7110 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.550+0000 7f93b1400700 1 -- 172.21.15.49:0/632491205 >> 172.21.15.49:0/632491205 conn(0x7f93ac0aa6b0 msgr2=0x7f93ac0c3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:46.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.550+0000 7f93b1400700 1 -- 172.21.15.49:0/632491205 shutdown_connections 2024-01-22T05:17:46.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.550+0000 7f93b1400700 1 -- 172.21.15.49:0/632491205 wait complete. 2024-01-22T05:17:46.555 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 126 2024-01-22T05:17:46.576 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:17:46.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.738+0000 7fcbb8200700 1 Processor -- start 2024-01-22T05:17:46.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.738+0000 7fcbb8200700 1 -- start start 2024-01-22T05:17:46.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.742+0000 7fcbb8200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcbb01554f0 0x7fcbb01558d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:46.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.742+0000 7fcbb8200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcbb0067a90 0x7fcbb0067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:46.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.742+0000 7fcbb8200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb00693b0 con 0x7fcbb0151dc0 2024-01-22T05:17:46.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.742+0000 7fcbb8200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb00687a0 con 0x7fcbb0067a90 2024-01-22T05:17:46.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.742+0000 7fcbb8200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb0068a80 con 0x7fcbb01554f0 2024-01-22T05:17:46.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.742+0000 7fcbb4e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcbb0067a90 0x7fcbb0067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:46.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.742+0000 7fcbb4e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcbb0067a90 0x7fcbb0067ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49056/0 (socket says 172.21.15.49:49056) 2024-01-22T05:17:46.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.742+0000 7fcbb4e00700 1 -- 172.21.15.49:0/2304469603 learned_addr learned my addr 172.21.15.49:0/2304469603 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:46.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.742+0000 7fcbb5800700 1 --2- 172.21.15.49:0/2304469603 >> v2:172.21.15.110:3300/0 conn(0x7fcbb01554f0 0x7fcbb01558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:46.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.742+0000 7fcbb4e00700 1 -- 172.21.15.49:0/2304469603 >> v2:172.21.15.110:3300/0 conn(0x7fcbb01554f0 msgr2=0x7fcbb01558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:46.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.742+0000 7fcbb4e00700 1 --2- 172.21.15.49:0/2304469603 >> v2:172.21.15.110:3300/0 conn(0x7fcbb01554f0 0x7fcbb01558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.742+0000 7fcbb4e00700 1 -- 172.21.15.49:0/2304469603 >> v1:172.21.15.110:6789/0 conn(0x7fcbb0151dc0 legacy=0x7fcbb01521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:46.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.742+0000 7fcbb4e00700 1 -- 172.21.15.49:0/2304469603 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb0068d60 con 0x7fcbb0067a90 2024-01-22T05:17:46.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.742+0000 7fcbb4e00700 1 --2- 172.21.15.49:0/2304469603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb0067a90 0x7fcbb0067ef0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7fcbb0156620 tx=0x7fcb980090f0).ready entity=mon.0 client_cookie=359d994ba500ac9e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:46.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.742+0000 7fcbafe00700 1 -- 172.21.15.49:0/2304469603 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9800b600 con 0x7fcbb0067a90 2024-01-22T05:17:46.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.746+0000 7fcbafe00700 1 -- 172.21.15.49:0/2304469603 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9800b760 con 0x7fcbb0067a90 2024-01-22T05:17:46.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.746+0000 7fcbafe00700 1 -- 172.21.15.49:0/2304469603 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9800bae0 con 0x7fcbb0067a90 2024-01-22T05:17:46.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.746+0000 7fcbb8200700 1 -- 172.21.15.49:0/2304469603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb0067a90 msgr2=0x7fcbb0067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:46.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.746+0000 7fcbb8200700 1 --2- 172.21.15.49:0/2304469603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb0067a90 0x7fcbb0067ef0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7fcbb0156620 tx=0x7fcb980090f0).stop 2024-01-22T05:17:46.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.746+0000 7fcbb8200700 1 -- 172.21.15.49:0/2304469603 shutdown_connections 2024-01-22T05:17:46.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.746+0000 7fcbb8200700 1 --2- 172.21.15.49:0/2304469603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb0067a90 0x7fcbb0067ef0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.746+0000 7fcbb8200700 1 --2- 172.21.15.49:0/2304469603 >> v2:172.21.15.110:3300/0 conn(0x7fcbb01554f0 0x7fcbb01558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.746+0000 7fcbb8200700 1 -- 172.21.15.49:0/2304469603 >> 172.21.15.49:0/2304469603 conn(0x7fcbb00c8710 msgr2=0x7fcbb00c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:46.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.746+0000 7fcbb8200700 1 -- 172.21.15.49:0/2304469603 shutdown_connections 2024-01-22T05:17:46.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.746+0000 7fcbb8200700 1 -- 172.21.15.49:0/2304469603 wait complete. 2024-01-22T05:17:46.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.750+0000 7fcbb8200700 1 Processor -- start 2024-01-22T05:17:46.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.750+0000 7fcbb8200700 1 -- start start 2024-01-22T05:17:46.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.750+0000 7fcbb8200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb0067a90 0x7fcbb0152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:46.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.750+0000 7fcbb8200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb0151dc0 0x7fcbb01687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:46.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.750+0000 7fcbb8200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbb01554f0 0x7fcbb0168ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:46.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.750+0000 7fcbb8200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb00ad3c0 con 0x7fcbb0067a90 2024-01-22T05:17:46.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.750+0000 7fcbb8200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb00ad6a0 con 0x7fcbb0151dc0 2024-01-22T05:17:46.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.750+0000 7fcbb8200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb00623d0 con 0x7fcbb01554f0 2024-01-22T05:17:46.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.750+0000 7fcbb5800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb0067a90 0x7fcbb0152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:46.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.750+0000 7fcbb5800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb0067a90 0x7fcbb0152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49058/0 (socket says 172.21.15.49:49058) 2024-01-22T05:17:46.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.750+0000 7fcbb5800700 1 -- 172.21.15.49:0/1185017494 learned_addr learned my addr 172.21.15.49:0/1185017494 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.754+0000 7fcbb4e00700 1 --2- 172.21.15.49:0/1185017494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb0151dc0 0x7fcbb01687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.754+0000 7fcbb6200700 1 --2- 172.21.15.49:0/1185017494 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbb01554f0 0x7fcbb0168ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.754+0000 7fcbb5800700 1 -- 172.21.15.49:0/1185017494 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbb01554f0 msgr2=0x7fcbb0168ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.754+0000 7fcbb5800700 1 --2- 172.21.15.49:0/1185017494 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbb01554f0 0x7fcbb0168ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.754+0000 7fcbb5800700 1 -- 172.21.15.49:0/1185017494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb0151dc0 msgr2=0x7fcbb01687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.754+0000 7fcbb5800700 1 --2- 172.21.15.49:0/1185017494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb0151dc0 0x7fcbb01687b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.754+0000 7fcbb5800700 1 -- 172.21.15.49:0/1185017494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb98009370 con 0x7fcbb0067a90 2024-01-22T05:17:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.754+0000 7fcbb6200700 1 --2- 172.21.15.49:0/1185017494 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbb01554f0 0x7fcbb0168ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:17:46.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.754+0000 7fcbb5800700 1 --2- 172.21.15.49:0/1185017494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb0067a90 0x7fcbb0152500 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7fcba000d860 tx=0x7fcba0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:46.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.754+0000 7fcbacc00700 1 -- 172.21.15.49:0/1185017494 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba00125f0 con 0x7fcbb0067a90 2024-01-22T05:17:46.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.754+0000 7fcbacc00700 1 -- 172.21.15.49:0/1185017494 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba0012750 con 0x7fcbb0067a90 2024-01-22T05:17:46.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.754+0000 7fcbacc00700 1 -- 172.21.15.49:0/1185017494 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0012ad0 con 0x7fcbb0067a90 2024-01-22T05:17:46.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.754+0000 7fcbb8200700 1 -- 172.21.15.49:0/1185017494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb00626b0 con 0x7fcbb0067a90 2024-01-22T05:17:46.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.754+0000 7fcbb8200700 1 -- 172.21.15.49:0/1185017494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb01529f0 con 0x7fcbb0067a90 2024-01-22T05:17:46.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.758+0000 7fcbb8200700 1 -- 172.21.15.49:0/1185017494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb0047060 con 0x7fcbb0067a90 2024-01-22T05:17:46.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.758+0000 7fcbacc00700 1 -- 172.21.15.49:0/1185017494 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcba0013480 con 0x7fcbb0067a90 2024-01-22T05:17:46.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.758+0000 7fcbacc00700 1 --2- 172.21.15.49:0/1185017494 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcb8805a510 0x7fcb8805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:46.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.758+0000 7fcbacc00700 1 -- 172.21.15.49:0/1185017494 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fcba0074d80 con 0x7fcbb0067a90 2024-01-22T05:17:46.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.758+0000 7fcbb4e00700 1 --2- 172.21.15.49:0/1185017494 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcb8805a510 0x7fcb8805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:46.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.762+0000 7fcbb4e00700 1 --2- 172.21.15.49:0/1185017494 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcb8805a510 0x7fcb8805c9d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fcb98009130 tx=0x7fcb98017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:46.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.766+0000 7fcbacc00700 1 -- 172.21.15.49:0/1185017494 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcba00483a0 con 0x7fcbb0067a90 2024-01-22T05:17:46.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.930+0000 7fcbb8200700 1 -- 172.21.15.49:0/1185017494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbb0046800 con 0x7fcbb0067a90 2024-01-22T05:17:46.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.934+0000 7fcbacc00700 1 -- 172.21.15.49:0/1185017494 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+17178 (secure 0 0 0) 0x7fcba004b9c0 con 0x7fcbb0067a90 2024-01-22T05:17:46.937 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:46.937 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":159,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:17:44.092750+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:17:41.253119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-01-22T05:17:42.073279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:17:46.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.938+0000 7fcbb8200700 1 -- 172.21.15.49:0/1185017494 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcb8805a510 msgr2=0x7fcb8805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:46.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.938+0000 7fcbb8200700 1 --2- 172.21.15.49:0/1185017494 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcb8805a510 0x7fcb8805c9d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fcb98009130 tx=0x7fcb98017000).stop 2024-01-22T05:17:46.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.938+0000 7fcbb8200700 1 -- 172.21.15.49:0/1185017494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb0067a90 msgr2=0x7fcbb0152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:46.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.938+0000 7fcbb8200700 1 --2- 172.21.15.49:0/1185017494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb0067a90 0x7fcbb0152500 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7fcba000d860 tx=0x7fcba0008040).stop 2024-01-22T05:17:46.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.938+0000 7fcbb8200700 1 -- 172.21.15.49:0/1185017494 shutdown_connections 2024-01-22T05:17:46.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.938+0000 7fcbb8200700 1 --2- 172.21.15.49:0/1185017494 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcb8805a510 0x7fcb8805c9d0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.938+0000 7fcbb8200700 1 --2- 172.21.15.49:0/1185017494 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbb01554f0 0x7fcbb0168ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.938+0000 7fcbb8200700 1 --2- 172.21.15.49:0/1185017494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb0151dc0 0x7fcbb01687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.938+0000 7fcbb8200700 1 --2- 172.21.15.49:0/1185017494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb0067a90 0x7fcbb0152500 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:46.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.938+0000 7fcbb8200700 1 -- 172.21.15.49:0/1185017494 >> 172.21.15.49:0/1185017494 conn(0x7fcbb00c8710 msgr2=0x7fcbb0153de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:46.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.938+0000 7fcbb8200700 1 -- 172.21.15.49:0/1185017494 shutdown_connections 2024-01-22T05:17:46.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:46.938+0000 7fcbb8200700 1 -- 172.21.15.49:0/1185017494 wait complete. 2024-01-22T05:17:46.963 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:17:46.963 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:17:47.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.138+0000 7f9d49e00700 1 Processor -- start 2024-01-22T05:17:47.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.138+0000 7f9d49e00700 1 -- start start 2024-01-22T05:17:47.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.138+0000 7f9d49e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9d441515f0 0x7f9d441519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:47.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.138+0000 7f9d49e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d440681a0 0x7f9d44155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:47.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.138+0000 7f9d49e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d440a9790 con 0x7f9d441554d0 2024-01-22T05:17:47.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.138+0000 7f9d49e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d440c0b60 con 0x7f9d441515f0 2024-01-22T05:17:47.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.138+0000 7f9d49e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d44155e20 con 0x7f9d440681a0 2024-01-22T05:17:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d42000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9d441554d0 0x7f9d44067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44592/0 (socket says 172.21.15.49:44592) 2024-01-22T05:17:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d42000700 1 -- 172.21.15.49:0/98478173 learned_addr learned my addr 172.21.15.49:0/98478173 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d42a00700 1 --2- 172.21.15.49:0/98478173 >> v2:172.21.15.110:3300/0 conn(0x7f9d441515f0 0x7f9d441519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d43e00700 1 --2- 172.21.15.49:0/98478173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d440681a0 0x7f9d44155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:47.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d41600700 1 -- 172.21.15.49:0/98478173 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803226342 0 0) 0x7f9d440a9790 con 0x7f9d441554d0 2024-01-22T05:17:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d41600700 1 -- 172.21.15.49:0/98478173 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d240033f0 con 0x7f9d441554d0 2024-01-22T05:17:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d42a00700 1 -- 172.21.15.49:0/98478173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d440681a0 msgr2=0x7f9d44155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d42a00700 1 --2- 172.21.15.49:0/98478173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d440681a0 0x7f9d44155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d42a00700 1 -- 172.21.15.49:0/98478173 >> v1:172.21.15.49:6789/0 conn(0x7f9d441554d0 legacy=0x7f9d44067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d42a00700 1 -- 172.21.15.49:0/98478173 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d440c5690 con 0x7f9d441515f0 2024-01-22T05:17:47.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d42a00700 1 --2- 172.21.15.49:0/98478173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d441515f0 0x7f9d441519d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f9d34009760 tx=0x7f9d34009060).ready entity=mon.1 client_cookie=69ececd3dbaea62e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:47.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d41600700 1 -- 172.21.15.49:0/98478173 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400d4a0 con 0x7f9d441515f0 2024-01-22T05:17:47.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d41600700 1 -- 172.21.15.49:0/98478173 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3400d600 con 0x7f9d441515f0 2024-01-22T05:17:47.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d41600700 1 -- 172.21.15.49:0/98478173 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400d980 con 0x7f9d441515f0 2024-01-22T05:17:47.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d49e00700 1 -- 172.21.15.49:0/98478173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d441515f0 msgr2=0x7f9d441519d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:47.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d49e00700 1 --2- 172.21.15.49:0/98478173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d441515f0 0x7f9d441519d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f9d34009760 tx=0x7f9d34009060).stop 2024-01-22T05:17:47.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d49e00700 1 -- 172.21.15.49:0/98478173 shutdown_connections 2024-01-22T05:17:47.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d49e00700 1 --2- 172.21.15.49:0/98478173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d440681a0 0x7f9d44155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d49e00700 1 --2- 172.21.15.49:0/98478173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d441515f0 0x7f9d441519d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.142+0000 7f9d49e00700 1 -- 172.21.15.49:0/98478173 >> 172.21.15.49:0/98478173 conn(0x7f9d440c9eb0 msgr2=0x7f9d440ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:47.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.146+0000 7f9d49e00700 1 -- 172.21.15.49:0/98478173 shutdown_connections 2024-01-22T05:17:47.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.146+0000 7f9d49e00700 1 -- 172.21.15.49:0/98478173 wait complete. 2024-01-22T05:17:47.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d49e00700 1 Processor -- start 2024-01-22T05:17:47.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d49e00700 1 -- start start 2024-01-22T05:17:47.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d49e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d440681a0 0x7f9d44162d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:47.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d49e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d441515f0 0x7f9d44154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:47.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d49e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d441554d0 0x7f9d44165940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:47.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d49e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d44166930 con 0x7f9d441554d0 2024-01-22T05:17:47.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d49e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d44162370 con 0x7f9d441515f0 2024-01-22T05:17:47.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d49e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d441628f0 con 0x7f9d440681a0 2024-01-22T05:17:47.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d43e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d441554d0 0x7f9d44165940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:47.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d43e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d441554d0 0x7f9d44165940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49068/0 (socket says 172.21.15.49:49068) 2024-01-22T05:17:47.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d43e00700 1 -- 172.21.15.49:0/2421572526 learned_addr learned my addr 172.21.15.49:0/2421572526 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:47.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d42a00700 1 --2- 172.21.15.49:0/2421572526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d440681a0 0x7f9d44162d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:47.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d42000700 1 --2- 172.21.15.49:0/2421572526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d441515f0 0x7f9d44154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:47.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d43e00700 1 -- 172.21.15.49:0/2421572526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d440681a0 msgr2=0x7f9d44162d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:47.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d43e00700 1 --2- 172.21.15.49:0/2421572526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d440681a0 0x7f9d44162d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d43e00700 1 -- 172.21.15.49:0/2421572526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d441515f0 msgr2=0x7f9d44154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:47.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d43e00700 1 --2- 172.21.15.49:0/2421572526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d441515f0 0x7f9d44154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.150+0000 7f9d43e00700 1 -- 172.21.15.49:0/2421572526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d340092a0 con 0x7f9d441554d0 2024-01-22T05:17:47.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.154+0000 7f9d43e00700 1 --2- 172.21.15.49:0/2421572526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d441554d0 0x7f9d44165940 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f9d3c009ef0 tx=0x7f9d3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:47.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.154+0000 7f9d3a000700 1 -- 172.21.15.49:0/2421572526 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c00cb70 con 0x7f9d441554d0 2024-01-22T05:17:47.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.154+0000 7f9d3a000700 1 -- 172.21.15.49:0/2421572526 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3c00f040 con 0x7f9d441554d0 2024-01-22T05:17:47.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.154+0000 7f9d49e00700 1 -- 172.21.15.49:0/2421572526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d44166370 con 0x7f9d441554d0 2024-01-22T05:17:47.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.154+0000 7f9d3a000700 1 -- 172.21.15.49:0/2421572526 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c013400 con 0x7f9d441554d0 2024-01-22T05:17:47.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.154+0000 7f9d49e00700 1 -- 172.21.15.49:0/2421572526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d44162580 con 0x7f9d441554d0 2024-01-22T05:17:47.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.154+0000 7f9d49e00700 1 -- 172.21.15.49:0/2421572526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d440c5e50 con 0x7f9d441554d0 2024-01-22T05:17:47.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.158+0000 7f9d3a000700 1 -- 172.21.15.49:0/2421572526 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9d3c0137b0 con 0x7f9d441554d0 2024-01-22T05:17:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.158+0000 7f9d3a000700 1 --2- 172.21.15.49:0/2421572526 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d1c05a540 0x7f9d1c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.158+0000 7f9d3a000700 1 -- 172.21.15.49:0/2421572526 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9d3c075140 con 0x7f9d441554d0 2024-01-22T05:17:47.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.158+0000 7f9d42a00700 1 --2- 172.21.15.49:0/2421572526 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d1c05a540 0x7f9d1c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:47.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.162+0000 7f9d42a00700 1 --2- 172.21.15.49:0/2421572526 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d1c05a540 0x7f9d1c05ca00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f9d3400d260 tx=0x7f9d34016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:47.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.166+0000 7f9d3a000700 1 -- 172.21.15.49:0/2421572526 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9d440c5e50 con 0x7f9d441554d0 2024-01-22T05:17:47.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.334+0000 7f9d49e00700 1 -- 172.21.15.49:0/2421572526 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d440c5e50 con 0x7f9d1c05a540 2024-01-22T05:17:47.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.346+0000 7f9d3a000700 1 -- 172.21.15.49:0/2421572526 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350844 (secure 0 0 0) 0x7f9d440c5e50 con 0x7f9d1c05a540 2024-01-22T05:17:47.354 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:47.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.354+0000 7f9d49e00700 1 -- 172.21.15.49:0/2421572526 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d1c05a540 msgr2=0x7f9d1c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:47.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.354+0000 7f9d49e00700 1 --2- 172.21.15.49:0/2421572526 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d1c05a540 0x7f9d1c05ca00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f9d3400d260 tx=0x7f9d34016000).stop 2024-01-22T05:17:47.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.354+0000 7f9d49e00700 1 -- 172.21.15.49:0/2421572526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d441554d0 msgr2=0x7f9d44165940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:47.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.354+0000 7f9d49e00700 1 --2- 172.21.15.49:0/2421572526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d441554d0 0x7f9d44165940 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f9d3c009ef0 tx=0x7f9d3c00b040).stop 2024-01-22T05:17:47.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.354+0000 7f9d49e00700 1 -- 172.21.15.49:0/2421572526 shutdown_connections 2024-01-22T05:17:47.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.354+0000 7f9d49e00700 1 --2- 172.21.15.49:0/2421572526 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d1c05a540 0x7f9d1c05ca00 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.354+0000 7f9d49e00700 1 --2- 172.21.15.49:0/2421572526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d441554d0 0x7f9d44165940 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.354+0000 7f9d49e00700 1 --2- 172.21.15.49:0/2421572526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d441515f0 0x7f9d44154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.354+0000 7f9d49e00700 1 --2- 172.21.15.49:0/2421572526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d440681a0 0x7f9d44162d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.354+0000 7f9d49e00700 1 -- 172.21.15.49:0/2421572526 >> 172.21.15.49:0/2421572526 conn(0x7f9d440c9eb0 msgr2=0x7f9d440aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:47.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.354+0000 7f9d49e00700 1 -- 172.21.15.49:0/2421572526 shutdown_connections 2024-01-22T05:17:47.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.354+0000 7f9d49e00700 1 -- 172.21.15.49:0/2421572526 wait complete. 2024-01-22T05:17:47.360 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:17:47.380 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":551,"stamp":"2024-01-22T05:17:45.526072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2450376,"kb_used_data":15240,"kb_used_omap":0,"kb_used_meta":2435072,"kb_avail":752524344,"statfs":{"total":773094113280,"available":770584928256,"internally_reserved":0,"allocated":15605760,"data_stored":7756860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2493513728},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1078643966,"num_objects":-1047,"num_object_clones":0,"num_object_copies":-2094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1047,"num_whiteouts":0,"num_read":-55,"num_read_kb":-2229,"num_write":-2114,"num_write_kb":-1054398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-2097152,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.042996"},"pg_stats":[{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.610273+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.626462+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.627703+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.614920+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.617399+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.616148+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.610445+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.618504+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.616552+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.615390+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.622287+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.614426+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.616917+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.615256+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.628086+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.615389+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.614485+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.622373+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.611326+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.620044+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.616362+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.609209+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.616038+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.622289+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.609737+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.611859+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.615666+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.620486+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.617062+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.620598+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.615189+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.618003+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.610384+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.616571+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.626477+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.626505+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.609472+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.627944+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.614979+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.620120+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.609005+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.611124+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.611869+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.610819+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.626391+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.611882+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.626386+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.612253+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.614282+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.609339+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.614184+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.614173+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.616543+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.626386+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.614130+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.615897+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.627999+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":127,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-22T05:17:38.756360+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:17:38.756360+0000","last_peered":"2024-01-22T05:17:38.756360+0000","last_clean":"2024-01-22T05:17:38.756360+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:17:38.756360+0000","last_undegraded":"2024-01-22T05:17:38.756360+0000","last_fullsized":"2024-01-22T05:17:38.756360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.615078+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":131,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-22T05:17:38.761393+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:17:38.761393+0000","last_peered":"2024-01-22T05:17:38.761393+0000","last_clean":"2024-01-22T05:17:38.761393+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:17:38.761393+0000","last_undegraded":"2024-01-22T05:17:38.761393+0000","last_fullsized":"2024-01-22T05:17:38.761393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.627247+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-22T05:17:39.338040+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:17:39.338040+0000","last_peered":"2024-01-22T05:17:39.338040+0000","last_clean":"2024-01-22T05:17:39.338040+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:17:39.338040+0000","last_undegraded":"2024-01-22T05:17:39.338040+0000","last_fullsized":"2024-01-22T05:17:39.338040+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.617458+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":131,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-22T05:17:38.761439+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:17:38.761439+0000","last_peered":"2024-01-22T05:17:38.761439+0000","last_clean":"2024-01-22T05:17:38.761439+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:17:38.761439+0000","last_undegraded":"2024-01-22T05:17:38.761439+0000","last_fullsized":"2024-01-22T05:17:38.761439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.621319+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":148,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-22T05:17:38.755941+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:17:38.755941+0000","last_peered":"2024-01-22T05:17:38.755941+0000","last_clean":"2024-01-22T05:17:38.755941+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:17:38.755941+0000","last_undegraded":"2024-01-22T05:17:38.755941+0000","last_fullsized":"2024-01-22T05:17:38.755941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.621774+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":129,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-22T05:17:39.343303+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:17:39.343303+0000","last_peered":"2024-01-22T05:17:39.343303+0000","last_clean":"2024-01-22T05:17:39.343303+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:17:39.343303+0000","last_undegraded":"2024-01-22T05:17:39.343303+0000","last_fullsized":"2024-01-22T05:17:39.343303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.615892+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":123,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-22T05:17:39.337977+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:17:39.337977+0000","last_peered":"2024-01-22T05:17:39.337977+0000","last_clean":"2024-01-22T05:17:39.337977+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:17:39.337977+0000","last_undegraded":"2024-01-22T05:17:39.337977+0000","last_fullsized":"2024-01-22T05:17:39.337977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:17:42.609127+0000","last_change":"2024-01-22T05:17:42.609127+0000","last_active":"2024-01-22T05:17:42.609127+0000","last_peered":"2024-01-22T05:17:42.609127+0000","last_clean":"2024-01-22T05:17:42.609127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:42.609127+0000","last_undegraded":"2024-01-22T05:17:42.609127+0000","last_fullsized":"2024-01-22T05:17:42.609127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:17:41.597094+0000","last_change":"2024-01-22T05:17:41.616617+0000","last_active":"2024-01-22T05:17:41.597094+0000","last_peered":"2024-01-22T05:17:41.597094+0000","last_clean":"2024-01-22T05:17:41.597094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:17:41.597094+0000","last_undegraded":"2024-01-22T05:17:41.597094+0000","last_fullsized":"2024-01-22T05:17:41.597094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":148,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-22T05:17:38.756000+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:17:38.756000+0000","last_peered":"2024-01-22T05:17:38.756000+0000","last_clean":"2024-01-22T05:17:38.756000+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:17:38.756000+0000","last_undegraded":"2024-01-22T05:17:38.756000+0000","last_fullsized":"2024-01-22T05:17:38.756000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-22T05:17:39.337996+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:17:39.337996+0000","last_peered":"2024-01-22T05:17:39.337996+0000","last_clean":"2024-01-22T05:17:39.337996+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:17:39.337996+0000","last_undegraded":"2024-01-22T05:17:39.337996+0000","last_fullsized":"2024-01-22T05:17:39.337996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575009,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307324,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064516,"statfs":{"total":96636764160,"available":96322064384,"internally_reserved":0,"allocated":1953792,"data_stored":971251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1830000000000001,"15min":1.0620000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.6419999999999999,"5min":14.779999999999999,"15min":14.779999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.137,"5min":1.9530000000000001,"15min":1.355},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.7989999999999999,"5min":76.662000000000006,"15min":76.662000000000006},"last":1.512}]},{"osd":1,"last update":"Mon Jan 22 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.115,"15min":1.03},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.6100000000000001,"5min":4.9269999999999996,"15min":4.9269999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2689999999999999,"15min":1.1990000000000001},"min":{"1min":0.71599999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.5499999999999998,"5min":12.691000000000001,"15min":12.691000000000001},"last":0.83099999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1080000000000001,"15min":1.107},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5289999999999999,"5min":1.984,"15min":2.5150000000000001},"last":1.623},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.3149999999999999,"15min":1.208},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5089999999999999,"5min":15.036,"15min":15.036},"last":1.55}]},{"osd":3,"last update":"Mon Jan 22 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.905,"15min":1.448},"min":{"1min":0.82399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.752,"5min":64.983999999999995,"15min":64.983999999999995},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.3839999999999999,"15min":1.2829999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":1.8109999999999999,"5min":15.073,"15min":15.073},"last":1.1000000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.3660000000000001,"15min":1.163},"min":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.32900000000000001},"max":{"1min":2.8599999999999999,"5min":22.239000000000001,"15min":22.239000000000001},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.466,"15min":1.2509999999999999},"min":{"1min":0.68799999999999994,"5min":0.66500000000000004,"15min":0.52200000000000002},"max":{"1min":1.891,"5min":27.872,"15min":27.872},"last":1.4750000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.9470000000000001,"15min":1.4350000000000001},"min":{"1min":0.76200000000000001,"5min":0.64400000000000002,"15min":0.40400000000000003},"max":{"1min":1.8839999999999999,"5min":65.652000000000001,"15min":65.652000000000001},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.292,"15min":1.2609999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":1.9590000000000001,"5min":2.1629999999999998,"15min":3.625},"last":1.734}]},{"osd":6,"last update":"Mon Jan 22 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3169999999999999,"15min":1.248},"min":{"1min":0.85299999999999998,"5min":0.64800000000000002,"15min":0.53400000000000003},"max":{"1min":2.899,"5min":6.9939999999999998,"15min":6.9939999999999998},"last":1.2},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.5069999999999999,"15min":1.393},"min":{"1min":0.82999999999999996,"5min":0.80800000000000005,"15min":0.56100000000000005},"max":{"1min":2.246,"5min":12.965,"15min":12.965},"last":1.8069999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575009,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307324,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064516,"statfs":{"total":96636764160,"available":96322064384,"internally_reserved":0,"allocated":1953792,"data_stored":971251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:17:01 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.026,"15min":1.2849999999999999},"min":{"1min":0.66600000000000004,"5min":0.52400000000000002,"15min":0.35999999999999999},"max":{"1min":1.4450000000000001,"5min":1.679,"15min":77.745000000000005},"last":1.4039999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.0669999999999999,"15min":1.073},"min":{"1min":0.66000000000000003,"5min":0.54700000000000004,"15min":0.44},"max":{"1min":1.3069999999999999,"5min":5.0359999999999996,"15min":13.555999999999999},"last":0.90000000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:17:01 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.093,"15min":1.1160000000000001},"min":{"1min":0.629,"5min":0.503,"15min":0.40000000000000002},"max":{"1min":1.3879999999999999,"5min":5.9210000000000003,"15min":15.499000000000001},"last":1.349},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1020000000000001,"15min":1.163},"min":{"1min":0.76600000000000001,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.55,"5min":3.6080000000000001,"15min":7.7629999999999999},"last":1.2829999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:17:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1759999999999999,"15min":1.159},"min":{"1min":0.84999999999999998,"5min":0.70999999999999996,"15min":0.57399999999999995},"max":{"1min":1.4810000000000001,"5min":1.823,"15min":3.0960000000000001},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.2030000000000001,"15min":1.137},"min":{"1min":0.77400000000000002,"5min":0.68600000000000005,"15min":0.38200000000000001},"max":{"1min":1.4430000000000001,"5min":4.9660000000000002,"15min":4.9660000000000002},"last":1.3080000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:17:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.2110000000000001,"15min":1.476},"min":{"1min":0.72699999999999998,"5min":0.66700000000000004,"15min":0.59299999999999997},"max":{"1min":1.5189999999999999,"5min":5.0750000000000002,"15min":102.08199999999999},"last":1.444},{"interface":"front","average":{"1min":1.085,"5min":1.1659999999999999,"15min":1.218},"min":{"1min":0.81799999999999995,"5min":0.66300000000000003,"15min":0.374},"max":{"1min":1.3660000000000001,"5min":2.9620000000000002,"15min":15.468},"last":1.256}]},{"osd":4,"last update":"Mon Jan 22 05:17:01 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.2150000000000001,"15min":1.139},"min":{"1min":0.80600000000000005,"5min":0.65500000000000003,"15min":0.495},"max":{"1min":1.3919999999999999,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.339},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.2569999999999999,"15min":1.1539999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.4299999999999999,"5min":5.1200000000000001,"15min":5.1200000000000001},"last":1.377}]},{"osd":5,"last update":"Mon Jan 22 05:17:01 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1539999999999999,"15min":1.244},"min":{"1min":0.68400000000000005,"5min":0.58699999999999997,"15min":0.48099999999999998},"max":{"1min":1.478,"5min":2.9100000000000001,"15min":30.533000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.292,"15min":1.276},"min":{"1min":0.79500000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.53,"5min":1.8759999999999999,"15min":3.875},"last":1.175}]},{"osd":7,"last update":"Mon Jan 22 05:17:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.462,"15min":1.4299999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":1.583,"5min":8.4190000000000005,"15min":23.547999999999998},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.423,"15min":1.5660000000000001},"min":{"1min":0.77700000000000002,"5min":0.73099999999999998,"15min":0.495},"max":{"1min":1.6020000000000001,"5min":7.46,"15min":63.737000000000002},"last":1.429}]}]},{"osd":5,"up_from":13,"seq":55834575009,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307312,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064528,"statfs":{"total":96636764160,"available":96322076672,"internally_reserved":0,"allocated":1941504,"data_stored":964677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.03,"15min":1.0069999999999999},"min":{"1min":0.63700000000000001,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.2849999999999999,"5min":1.651,"15min":2.0609999999999999},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.0409999999999999,"15min":1.0529999999999999},"min":{"1min":0.58699999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.325,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.84499999999999997}]},{"osd":1,"last update":"Mon Jan 22 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2110000000000001,"15min":1.1879999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.732,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.504},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.1930000000000001,"15min":1.216},"min":{"1min":0.80700000000000005,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.7989999999999999,"5min":1.9930000000000001,"15min":2.0209999999999999},"last":1.163}]},{"osd":2,"last update":"Mon Jan 22 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.6279999999999999,"5min":1.9219999999999999,"15min":1.925},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.143,"15min":1.123},"min":{"1min":0.78700000000000003,"5min":0.71799999999999997,"15min":0.59899999999999998},"max":{"1min":1.6459999999999999,"5min":1.982,"15min":1.982},"last":1.0149999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.175,"15min":1.1599999999999999},"min":{"1min":0.72099999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5389999999999999,"5min":3.202,"15min":3.202},"last":1.411},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2230000000000001,"15min":1.224},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.621,"5min":4.8819999999999997,"15min":4.8819999999999997},"last":1.6830000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.085,"15min":1.1120000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.8240000000000001,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.333},{"interface":"front","average":{"1min":1.222,"5min":1.1559999999999999,"15min":1.1990000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.8779999999999999,"5min":2.081,"15min":2.081},"last":1.589}]},{"osd":6,"last update":"Mon Jan 22 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.1950000000000001,"15min":1.2370000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.2010000000000001},"last":1.776},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2430000000000001,"15min":1.2529999999999999},"min":{"1min":0.71399999999999997,"5min":0.69599999999999995,"15min":0.55900000000000005},"max":{"1min":1.927,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.609}]},{"osd":7,"last update":"Mon Jan 22 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.2889999999999999,"15min":1.323},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.7909999999999999,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.8069999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.304,"15min":1.353},"min":{"1min":0.80000000000000004,"5min":0.64200000000000002,"15min":0.60799999999999998},"max":{"1min":1.806,"5min":2.04,"15min":3.1840000000000002},"last":1.8859999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575009,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299132,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072708,"statfs":{"total":96636764160,"available":96330452992,"internally_reserved":0,"allocated":1953792,"data_stored":971251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.1120000000000001,"15min":1.1060000000000001},"min":{"1min":0.86899999999999999,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.696,"5min":1.726,"15min":2.0150000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.1830000000000001,"15min":1.1359999999999999},"min":{"1min":0.85799999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.55,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.359}]},{"osd":1,"last update":"Mon Jan 22 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.071,"15min":1.075},"min":{"1min":0.90700000000000003,"5min":0.60499999999999998,"15min":0.53100000000000003},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.7609999999999999},"last":1.093},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0009999999999999,"15min":1.079},"min":{"1min":0.72299999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.516,"5min":1.6870000000000001,"15min":2.194},"last":0.89100000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.0660000000000001,"15min":1.077},"min":{"1min":0.71099999999999997,"5min":0.52800000000000002,"15min":0.49199999999999999},"max":{"1min":1.516,"5min":1.516,"15min":5.3390000000000004},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1439999999999999,"15min":1.1799999999999999},"min":{"1min":0.97699999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6140000000000001,"5min":1.641,"15min":2.3479999999999999},"last":1.242}]},{"osd":3,"last update":"Mon Jan 22 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.129,"15min":1.143},"min":{"1min":0.79300000000000004,"5min":0.65700000000000003,"15min":0.496},"max":{"1min":1.4419999999999999,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.022},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1539999999999999,"15min":1.151},"min":{"1min":0.745,"5min":0.66200000000000003,"15min":0.53100000000000003},"max":{"1min":1.647,"5min":2.2959999999999998,"15min":5.3029999999999999},"last":1.198}]},{"osd":5,"last update":"Mon Jan 22 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.107,"15min":1.1359999999999999},"min":{"1min":0.71299999999999997,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.415,"5min":1.6899999999999999,"15min":2.0790000000000002},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.161,"15min":1.1319999999999999},"min":{"1min":1.0209999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.544,"5min":1.8240000000000001,"15min":2.0030000000000001},"last":1.2789999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.149,"15min":1.1539999999999999},"min":{"1min":0.78000000000000003,"5min":0.63100000000000001,"15min":0.44500000000000001},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":1.05},{"interface":"front","average":{"1min":1.363,"5min":1.2609999999999999,"15min":1.296},"min":{"1min":1.0760000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":1.153}]},{"osd":7,"last update":"Mon Jan 22 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3460000000000001,"15min":1.3220000000000001},"min":{"1min":0.97399999999999998,"5min":0.62,"15min":0.59399999999999997},"max":{"1min":1.7949999999999999,"5min":1.9119999999999999,"15min":2.2839999999999998},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3169999999999999,"15min":1.3300000000000001},"min":{"1min":1.046,"5min":0.88800000000000001,"15min":0.56899999999999995},"max":{"1min":1.843,"5min":1.843,"15min":5.2629999999999999},"last":0.95099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575009,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299132,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072708,"statfs":{"total":96636764160,"available":96330452992,"internally_reserved":0,"allocated":1953792,"data_stored":971251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.79000000000000004,"15min":0.86499999999999999},"min":{"1min":0.47899999999999998,"5min":0.41099999999999998,"15min":0.34200000000000003},"max":{"1min":1.512,"5min":1.8440000000000001,"15min":14.859},"last":1.163},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.86499999999999999,"15min":0.89100000000000001},"min":{"1min":0.42699999999999999,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":1.486,"5min":1.804,"15min":5.0919999999999996},"last":0.77000000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.85999999999999999,"15min":0.88800000000000001},"min":{"1min":0.50600000000000001,"5min":0.42399999999999999,"15min":0.39300000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":6.5570000000000004},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.94099999999999995,"15min":0.96699999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3129999999999999,"5min":1.9510000000000001,"15min":5.7519999999999998},"last":0.81899999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0880000000000001,"15min":1.119},"min":{"1min":0.55000000000000004,"5min":0.48599999999999999,"15min":0.40600000000000003},"max":{"1min":1.45,"5min":1.8680000000000001,"15min":2.391},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1319999999999999,"15min":1.177},"min":{"1min":0.63900000000000001,"5min":0.59199999999999997,"15min":0.44800000000000001},"max":{"1min":1.6259999999999999,"5min":1.7030000000000001,"15min":4.1429999999999998},"last":0.873}]},{"osd":4,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.294,"15min":1.319},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.5649999999999999,"5min":2.423,"15min":10.858000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.2729999999999999,"15min":1.333},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5509999999999999,"5min":2.3359999999999999,"15min":10.846},"last":1.466}]},{"osd":5,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.234,"15min":1.2849999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.6739999999999999,"5min":1.9910000000000001,"15min":7.3639999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.284,"15min":1.373},"min":{"1min":0.85599999999999998,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.796,"5min":6.3220000000000001,"15min":14.523999999999999},"last":1.413}]},{"osd":6,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.339,"15min":1.363},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.6659999999999999,"5min":2.1819999999999999,"15min":4.9809999999999999},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3720000000000001,"15min":1.3879999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.819,"5min":1.923,"15min":5.4210000000000003},"last":1.3149999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.3240000000000001,"15min":1.3660000000000001},"min":{"1min":0.92700000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6339999999999999,"5min":2.0539999999999998,"15min":5.7160000000000002},"last":1.25},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.351,"15min":1.4099999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.748,"5min":2.5449999999999999,"15min":6.4279999999999999},"last":1.3520000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575009,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311408,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060432,"statfs":{"total":96636764160,"available":96317882368,"internally_reserved":0,"allocated":1941504,"data_stored":964677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:16:50 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77100000000000002,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.378,"15min":0.378},"max":{"1min":1.1299999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.754},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.45300000000000001,"5min":0.44600000000000001,"15min":0.373},"max":{"1min":1.1779999999999999,"5min":1.556,"15min":1.7350000000000001},"last":0.64000000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:16:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.89000000000000001,"15min":0.84799999999999998},"min":{"1min":0.60999999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.96899999999999997,"15min":0.94099999999999995},"min":{"1min":0.55200000000000005,"5min":0.43099999999999999,"15min":0.41599999999999998},"max":{"1min":1.6279999999999999,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.2849999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:16:50 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.125,"15min":1.1160000000000001},"min":{"1min":0.72699999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.3090000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.153},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.224,"15min":1.1990000000000001},"min":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.51100000000000001},"max":{"1min":1.571,"5min":3.133,"15min":3.133},"last":1.468}]},{"osd":4,"last update":"Mon Jan 22 05:16:50 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.282,"15min":1.27},"min":{"1min":0.90400000000000003,"5min":0.88500000000000001,"15min":0.59099999999999997},"max":{"1min":1.8600000000000001,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.034},{"interface":"front","average":{"1min":1.123,"5min":1.214,"15min":1.1930000000000001},"min":{"1min":0.71699999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.6659999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.84099999999999997}]},{"osd":5,"last update":"Mon Jan 22 05:16:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.238,"15min":1.2090000000000001},"min":{"1min":0.84099999999999997,"5min":0.70799999999999996,"15min":0.63800000000000001},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3120000000000001,"15min":1.2849999999999999},"min":{"1min":0.84799999999999998,"5min":0.76100000000000001,"15min":0.67000000000000004},"max":{"1min":1.6080000000000001,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.3799999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:16:50 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.266,"15min":1.248},"min":{"1min":0.82299999999999995,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.6819999999999999,"5min":1.7749999999999999,"15min":2.1920000000000002},"last":0.88},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.331,"15min":1.3},"min":{"1min":0.91300000000000003,"5min":0.629,"15min":0.629},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.113}]},{"osd":7,"last update":"Mon Jan 22 05:16:50 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.3660000000000001,"15min":1.343},"min":{"1min":0.98599999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6759999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.385,"5min":1.413,"15min":1.4059999999999999},"min":{"1min":0.89700000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.0209999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311420,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060420,"statfs":{"total":96636764160,"available":96317870080,"internally_reserved":0,"allocated":1953792,"data_stored":971251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85599999999999998,"15min":0.86399999999999999},"min":{"1min":0.46200000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.3240000000000001,"5min":1.911,"15min":3.4119999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.98299999999999998,"15min":0.995},"min":{"1min":0.59699999999999998,"5min":0.42899999999999999,"15min":0.41099999999999998},"max":{"1min":1.26,"5min":1.8680000000000001,"15min":2.101},"last":0.69499999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.997,"15min":0.995},"min":{"1min":0.49399999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4470000000000001,"5min":2.169,"15min":2.169},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0640000000000001,"15min":1.0449999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.474,"5min":2.024,"15min":2.024},"last":0.96499999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0209999999999999,"15min":1.0249999999999999},"min":{"1min":0.65800000000000003,"5min":0.59399999999999997,"15min":0.38900000000000001},"max":{"1min":1.5649999999999999,"5min":1.7130000000000001,"15min":4.665},"last":0.879},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.97799999999999998,"15min":0.93899999999999995},"min":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.41899999999999998},"max":{"1min":1.357,"5min":4.1319999999999997,"15min":5.5830000000000002},"last":0.84599999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.212,"15min":1.2470000000000001},"min":{"1min":0.83699999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.7769999999999999,"5min":2.2509999999999999,"15min":15.76},"last":0.873},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.264,"15min":1.319},"min":{"1min":0.92000000000000004,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.484,"5min":1.9630000000000001,"15min":16.975000000000001},"last":1.139}]},{"osd":5,"last update":"Mon Jan 22 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3149999999999999,"15min":1.2290000000000001},"min":{"1min":0.83899999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":5.3159999999999998,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.117},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2889999999999999,"15min":1.2769999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8420000000000001,"5min":2.3330000000000002,"15min":2.52},"last":1.2430000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.3,"15min":1.2649999999999999},"min":{"1min":0.78700000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":5.3979999999999997,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.218},{"interface":"front","average":{"1min":1.246,"5min":1.3320000000000001,"15min":1.333},"min":{"1min":0.76200000000000001,"5min":0.71899999999999997,"15min":0.68799999999999994},"max":{"1min":1.895,"5min":2.5569999999999999,"15min":2.5569999999999999},"last":0.82099999999999995}]},{"osd":7,"last update":"Mon Jan 22 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.321,"15min":1.3520000000000001},"min":{"1min":0.77200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6990000000000001,"5min":1.8999999999999999,"15min":4.4329999999999998},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.395,"15min":1.3600000000000001},"min":{"1min":0.96699999999999997,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":5.4939999999999998,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":0.93300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575009,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307324,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064516,"statfs":{"total":96636764160,"available":96322064384,"internally_reserved":0,"allocated":1953792,"data_stored":971251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.877,"15min":0.91000000000000003},"min":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.28699999999999998},"max":{"1min":1.1120000000000001,"5min":1.972,"15min":15.273},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91100000000000003,"15min":0.93300000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.34499999999999997},"max":{"1min":1.625,"5min":1.698,"15min":4.4009999999999998},"last":0.66900000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.03,"15min":1.0669999999999999},"min":{"1min":0.61599999999999999,"5min":0.53200000000000003,"15min":0.46400000000000002},"max":{"1min":1.6299999999999999,"5min":1.6459999999999999,"15min":15.473000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.03,"5min":1.0349999999999999,"15min":1.018},"min":{"1min":0.68799999999999994,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.518,"5min":1.794,"15min":1.7989999999999999},"last":0.98499999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.96999999999999997,"15min":0.99199999999999999},"min":{"1min":0.63600000000000001,"5min":0.54800000000000004,"15min":0.39000000000000001},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":5.3970000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.167,"5min":1.171,"15min":1.2},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.7210000000000001,"5min":2.2349999999999999,"15min":15.439},"last":0.84099999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.232,"15min":1.2669999999999999},"min":{"1min":0.85799999999999998,"5min":0.66200000000000003,"15min":0.61399999999999999},"max":{"1min":1.7270000000000001,"5min":2.1280000000000001,"15min":5.1799999999999997},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.238,"15min":1.222},"min":{"1min":0.85299999999999998,"5min":0.59399999999999997,"15min":0.56200000000000006},"max":{"1min":1.706,"5min":1.7909999999999999,"15min":3.4340000000000002},"last":1.3149999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.296,"15min":1.2949999999999999},"min":{"1min":0.88600000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.75,"5min":1.9099999999999999,"15min":3.548},"last":1.266},{"interface":"front","average":{"1min":1.304,"5min":1.3740000000000001,"15min":1.3460000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.6259999999999999,"5min":2.2309999999999999,"15min":2.823},"last":0.95299999999999996}]},{"osd":6,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.391,"15min":1.4299999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.59099999999999997},"max":{"1min":1.746,"5min":2.0950000000000002,"15min":15.4},"last":1.371},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3580000000000001,"15min":1.403},"min":{"1min":1.038,"5min":0.85699999999999998,"15min":0.72499999999999998},"max":{"1min":1.8919999999999999,"5min":2.105,"15min":7.1349999999999998},"last":1.339}]},{"osd":7,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.413,"15min":1.4670000000000001},"min":{"1min":1.0569999999999999,"5min":0.95499999999999996,"15min":0.79900000000000004},"max":{"1min":2.145,"5min":2.1819999999999999,"15min":5.29},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.393,"15min":1.3819999999999999},"min":{"1min":1.04,"5min":1.002,"15min":0.752},"max":{"1min":2.0470000000000002,"5min":2.1869999999999998,"15min":2.7269999999999999},"last":1.4590000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:17:47.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:17:47.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.586+0000 7f2d8c600700 1 Processor -- start 2024-01-22T05:17:47.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.586+0000 7f2d8c600700 1 -- start start 2024-01-22T05:17:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.590+0000 7f2d8c600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2d84155d20 0x7f2d84065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.590+0000 7f2d8c600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d84066070 0x7f2d840a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.590+0000 7f2d8c600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d840c1a40 con 0x7f2d840a8c30 2024-01-22T05:17:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.590+0000 7f2d8c600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d840a9090 con 0x7f2d84155d20 2024-01-22T05:17:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.590+0000 7f2d8c600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84159310 con 0x7f2d84066070 2024-01-22T05:17:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.590+0000 7f2d8a600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2d840a8c30 0x7f2d840c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44604/0 (socket says 172.21.15.49:44604) 2024-01-22T05:17:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.590+0000 7f2d8a600700 1 -- 172.21.15.49:0/1816433710 learned_addr learned my addr 172.21.15.49:0/1816433710 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.590+0000 7f2d89c00700 1 --2- 172.21.15.49:0/1816433710 >> v2:172.21.15.110:3300/0 conn(0x7f2d84155d20 0x7f2d84065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.590+0000 7f2d89200700 1 --2- 172.21.15.49:0/1816433710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d84066070 0x7f2d840a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:47.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.590+0000 7f2d83e00700 1 -- 172.21.15.49:0/1816433710 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071998077 0 0) 0x7f2d840c1a40 con 0x7f2d840a8c30 2024-01-22T05:17:47.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.590+0000 7f2d83e00700 1 -- 172.21.15.49:0/1816433710 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d640033f0 con 0x7f2d840a8c30 2024-01-22T05:17:47.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.590+0000 7f2d89c00700 1 -- 172.21.15.49:0/1816433710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d84066070 msgr2=0x7f2d840a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:47.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.590+0000 7f2d89c00700 1 --2- 172.21.15.49:0/1816433710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d84066070 0x7f2d840a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.590+0000 7f2d89c00700 1 -- 172.21.15.49:0/1816433710 >> v1:172.21.15.49:6789/0 conn(0x7f2d840a8c30 legacy=0x7f2d840c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:47.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.590+0000 7f2d89c00700 1 -- 172.21.15.49:0/1816433710 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d840c13f0 con 0x7f2d84155d20 2024-01-22T05:17:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.594+0000 7f2d89c00700 1 --2- 172.21.15.49:0/1816433710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d84155d20 0x7f2d84065b80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f2d74009760 tx=0x7f2d74009060).ready entity=mon.1 client_cookie=68f0de151746a4f5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.594+0000 7f2d83e00700 1 -- 172.21.15.49:0/1816433710 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7400d4a0 con 0x7f2d84155d20 2024-01-22T05:17:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.594+0000 7f2d83e00700 1 -- 172.21.15.49:0/1816433710 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7400d600 con 0x7f2d84155d20 2024-01-22T05:17:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.594+0000 7f2d83e00700 1 -- 172.21.15.49:0/1816433710 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7400d980 con 0x7f2d84155d20 2024-01-22T05:17:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.594+0000 7f2d8c600700 1 -- 172.21.15.49:0/1816433710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d84155d20 msgr2=0x7f2d84065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.594+0000 7f2d8c600700 1 --2- 172.21.15.49:0/1816433710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d84155d20 0x7f2d84065b80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f2d74009760 tx=0x7f2d74009060).stop 2024-01-22T05:17:47.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.594+0000 7f2d8c600700 1 -- 172.21.15.49:0/1816433710 shutdown_connections 2024-01-22T05:17:47.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.594+0000 7f2d8c600700 1 --2- 172.21.15.49:0/1816433710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d84066070 0x7f2d840a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.594+0000 7f2d8c600700 1 --2- 172.21.15.49:0/1816433710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d84155d20 0x7f2d84065b80 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.594+0000 7f2d8c600700 1 -- 172.21.15.49:0/1816433710 >> 172.21.15.49:0/1816433710 conn(0x7f2d840c6540 msgr2=0x7f2d840c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:47.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.594+0000 7f2d8c600700 1 -- 172.21.15.49:0/1816433710 shutdown_connections 2024-01-22T05:17:47.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.594+0000 7f2d8c600700 1 -- 172.21.15.49:0/1816433710 wait complete. 2024-01-22T05:17:47.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.598+0000 7f2d8c600700 1 Processor -- start 2024-01-22T05:17:47.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.602+0000 7f2d8c600700 1 -- start start 2024-01-22T05:17:47.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.602+0000 7f2d8c600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d84066070 0x7f2d84156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:47.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.602+0000 7f2d8c600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d840a8c30 0x7f2d841528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:47.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.602+0000 7f2d8c600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d84155d20 0x7f2d8415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:47.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.602+0000 7f2d8c600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84157230 con 0x7f2d84155d20 2024-01-22T05:17:47.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.602+0000 7f2d8c600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d840ac540 con 0x7f2d84066070 2024-01-22T05:17:47.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.602+0000 7f2d8c600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d840ac260 con 0x7f2d840a8c30 2024-01-22T05:17:47.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.602+0000 7f2d89c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d84066070 0x7f2d84156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:47.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.602+0000 7f2d89200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d840a8c30 0x7f2d841528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:47.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.602+0000 7f2d8a600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d84155d20 0x7f2d8415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:47.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.602+0000 7f2d89c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d84066070 0x7f2d84156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:39288/0 (socket says 172.21.15.49:39288) 2024-01-22T05:17:47.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.602+0000 7f2d89c00700 1 -- 172.21.15.49:0/3057272789 learned_addr learned my addr 172.21.15.49:0/3057272789 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:47.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.602+0000 7f2d89c00700 1 -- 172.21.15.49:0/3057272789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d840a8c30 msgr2=0x7f2d841528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:47.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.606+0000 7f2d89c00700 1 --2- 172.21.15.49:0/3057272789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d840a8c30 0x7f2d841528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.606+0000 7f2d89c00700 1 -- 172.21.15.49:0/3057272789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d84155d20 msgr2=0x7f2d8415c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:47.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.606+0000 7f2d89c00700 1 --2- 172.21.15.49:0/3057272789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d84155d20 0x7f2d8415c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.606+0000 7f2d89c00700 1 -- 172.21.15.49:0/3057272789 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740092a0 con 0x7f2d84066070 2024-01-22T05:17:47.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.606+0000 7f2d89200700 1 --2- 172.21.15.49:0/3057272789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d840a8c30 0x7f2d841528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:47.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.606+0000 7f2d8a600700 1 --2- 172.21.15.49:0/3057272789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d84155d20 0x7f2d8415c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:47.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.606+0000 7f2d89c00700 1 --2- 172.21.15.49:0/3057272789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d84066070 0x7f2d84156d40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f2d74009d50 tx=0x7f2d74016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:47.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.606+0000 7f2d80c00700 1 -- 172.21.15.49:0/3057272789 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7400dd30 con 0x7f2d84066070 2024-01-22T05:17:47.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.606+0000 7f2d80c00700 1 -- 172.21.15.49:0/3057272789 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7400de90 con 0x7f2d84066070 2024-01-22T05:17:47.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.606+0000 7f2d8c600700 1 -- 172.21.15.49:0/3057272789 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d84156260 con 0x7f2d84066070 2024-01-22T05:17:47.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.606+0000 7f2d80c00700 1 -- 172.21.15.49:0/3057272789 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7400d980 con 0x7f2d84066070 2024-01-22T05:17:47.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.606+0000 7f2d8c600700 1 -- 172.21.15.49:0/3057272789 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d84156820 con 0x7f2d84066070 2024-01-22T05:17:47.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.606+0000 7f2d8c600700 1 -- 172.21.15.49:0/3057272789 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d84047060 con 0x7f2d84066070 2024-01-22T05:17:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.610+0000 7f2d80c00700 1 -- 172.21.15.49:0/3057272789 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2d7401d640 con 0x7f2d84066070 2024-01-22T05:17:47.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.610+0000 7f2d80c00700 1 --2- 172.21.15.49:0/3057272789 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d5c05a560 0x7f2d5c05ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:47.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.610+0000 7f2d80c00700 1 -- 172.21.15.49:0/3057272789 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2d74075f70 con 0x7f2d84066070 2024-01-22T05:17:47.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.610+0000 7f2d89200700 1 --2- 172.21.15.49:0/3057272789 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d5c05a560 0x7f2d5c05ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:47.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.610+0000 7f2d89200700 1 --2- 172.21.15.49:0/3057272789 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d5c05a560 0x7f2d5c05ca20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f2d84154f70 tx=0x7f2d6c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:47.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.622+0000 7f2d80c00700 1 -- 172.21.15.49:0/3057272789 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2d740a4b00 con 0x7f2d84066070 2024-01-22T05:17:47.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.790+0000 7f2d8c600700 1 -- 172.21.15.49:0/3057272789 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d84046800 con 0x7f2d5c05a560 2024-01-22T05:17:47.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.802+0000 7f2d80c00700 1 -- 172.21.15.49:0/3057272789 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359697 (secure 0 0 0) 0x7f2d84046800 con 0x7f2d5c05a560 2024-01-22T05:17:47.811 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:47.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.814+0000 7f2d8c600700 1 -- 172.21.15.49:0/3057272789 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d5c05a560 msgr2=0x7f2d5c05ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:47.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.814+0000 7f2d8c600700 1 --2- 172.21.15.49:0/3057272789 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d5c05a560 0x7f2d5c05ca20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f2d84154f70 tx=0x7f2d6c009060).stop 2024-01-22T05:17:47.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.814+0000 7f2d8c600700 1 -- 172.21.15.49:0/3057272789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d84066070 msgr2=0x7f2d84156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:47.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.814+0000 7f2d8c600700 1 --2- 172.21.15.49:0/3057272789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d84066070 0x7f2d84156d40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f2d74009d50 tx=0x7f2d74016000).stop 2024-01-22T05:17:47.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.814+0000 7f2d8c600700 1 -- 172.21.15.49:0/3057272789 shutdown_connections 2024-01-22T05:17:47.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.814+0000 7f2d8c600700 1 --2- 172.21.15.49:0/3057272789 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d5c05a560 0x7f2d5c05ca20 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.814+0000 7f2d8c600700 1 --2- 172.21.15.49:0/3057272789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d84155d20 0x7f2d8415c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.814+0000 7f2d8c600700 1 --2- 172.21.15.49:0/3057272789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d840a8c30 0x7f2d841528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.814+0000 7f2d8c600700 1 --2- 172.21.15.49:0/3057272789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d84066070 0x7f2d84156d40 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:47.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.814+0000 7f2d8c600700 1 -- 172.21.15.49:0/3057272789 >> 172.21.15.49:0/3057272789 conn(0x7f2d840c6540 msgr2=0x7f2d84067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:47.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.814+0000 7f2d8c600700 1 -- 172.21.15.49:0/3057272789 shutdown_connections 2024-01-22T05:17:47.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:47.814+0000 7f2d8c600700 1 -- 172.21.15.49:0/3057272789 wait complete. 2024-01-22T05:17:47.820 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:17:47.843 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":552,"stamp":"2024-01-22T05:17:47.526704+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":262,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454848,"kb_used_data":15616,"kb_used_omap":0,"kb_used_meta":2439168,"kb_avail":752519872,"statfs":{"total":773094113280,"available":770580348928,"internally_reserved":0,"allocated":15990784,"data_stored":7947588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2497708032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1078643966,"num_objects":-1047,"num_object_clones":0,"num_object_copies":-2094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1047,"num_whiteouts":0,"num_read":-55,"num_read_kb":-2229,"num_write":-2114,"num_write_kb":-1054398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-2097152,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.042996"},"pg_stats":[{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.117230+0000","last_change":"2024-01-22T05:17:43.112485+0000","last_active":"2024-01-22T05:17:43.117230+0000","last_peered":"2024-01-22T05:17:43.117230+0000","last_clean":"2024-01-22T05:17:43.117230+0000","last_became_active":"2024-01-22T05:17:43.112208+0000","last_became_peered":"2024-01-22T05:17:43.112208+0000","last_unstale":"2024-01-22T05:17:43.117230+0000","last_undegraded":"2024-01-22T05:17:43.117230+0000","last_fullsized":"2024-01-22T05:17:43.117230+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"158'3","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.130576+0000","last_change":"2024-01-22T05:17:42.639031+0000","last_active":"2024-01-22T05:17:43.130576+0000","last_peered":"2024-01-22T05:17:43.130576+0000","last_clean":"2024-01-22T05:17:43.130576+0000","last_became_active":"2024-01-22T05:17:42.638760+0000","last_became_peered":"2024-01-22T05:17:42.638760+0000","last_unstale":"2024-01-22T05:17:43.130576+0000","last_undegraded":"2024-01-22T05:17:43.130576+0000","last_fullsized":"2024-01-22T05:17:43.130576+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.121014+0000","last_change":"2024-01-22T05:17:43.114913+0000","last_active":"2024-01-22T05:17:43.121014+0000","last_peered":"2024-01-22T05:17:43.121014+0000","last_clean":"2024-01-22T05:17:43.121014+0000","last_became_active":"2024-01-22T05:17:43.114650+0000","last_became_peered":"2024-01-22T05:17:43.114650+0000","last_unstale":"2024-01-22T05:17:43.121014+0000","last_undegraded":"2024-01-22T05:17:43.121014+0000","last_fullsized":"2024-01-22T05:17:43.121014+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.118570+0000","last_change":"2024-01-22T05:17:42.653758+0000","last_active":"2024-01-22T05:17:43.118570+0000","last_peered":"2024-01-22T05:17:43.118570+0000","last_clean":"2024-01-22T05:17:43.118570+0000","last_became_active":"2024-01-22T05:17:42.653430+0000","last_became_peered":"2024-01-22T05:17:42.653430+0000","last_unstale":"2024-01-22T05:17:43.118570+0000","last_undegraded":"2024-01-22T05:17:43.118570+0000","last_fullsized":"2024-01-22T05:17:43.118570+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.142051+0000","last_change":"2024-01-22T05:17:43.140730+0000","last_active":"2024-01-22T05:17:43.142051+0000","last_peered":"2024-01-22T05:17:43.142051+0000","last_clean":"2024-01-22T05:17:43.142051+0000","last_became_active":"2024-01-22T05:17:43.140430+0000","last_became_peered":"2024-01-22T05:17:43.140430+0000","last_unstale":"2024-01-22T05:17:43.142051+0000","last_undegraded":"2024-01-22T05:17:43.142051+0000","last_fullsized":"2024-01-22T05:17:43.142051+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.118422+0000","last_change":"2024-01-22T05:17:42.650110+0000","last_active":"2024-01-22T05:17:43.118422+0000","last_peered":"2024-01-22T05:17:43.118422+0000","last_clean":"2024-01-22T05:17:43.118422+0000","last_became_active":"2024-01-22T05:17:42.649825+0000","last_became_peered":"2024-01-22T05:17:42.649825+0000","last_unstale":"2024-01-22T05:17:43.118422+0000","last_undegraded":"2024-01-22T05:17:43.118422+0000","last_fullsized":"2024-01-22T05:17:43.118422+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.130128+0000","last_change":"2024-01-22T05:17:43.128671+0000","last_active":"2024-01-22T05:17:43.130128+0000","last_peered":"2024-01-22T05:17:43.130128+0000","last_clean":"2024-01-22T05:17:43.130128+0000","last_became_active":"2024-01-22T05:17:43.128341+0000","last_became_peered":"2024-01-22T05:17:43.128341+0000","last_unstale":"2024-01-22T05:17:43.130128+0000","last_undegraded":"2024-01-22T05:17:43.130128+0000","last_fullsized":"2024-01-22T05:17:43.130128+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3c","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.127919+0000","last_change":"2024-01-22T05:17:42.644679+0000","last_active":"2024-01-22T05:17:43.127919+0000","last_peered":"2024-01-22T05:17:43.127919+0000","last_clean":"2024-01-22T05:17:43.127919+0000","last_became_active":"2024-01-22T05:17:42.644123+0000","last_became_peered":"2024-01-22T05:17:42.644123+0000","last_unstale":"2024-01-22T05:17:43.127919+0000","last_undegraded":"2024-01-22T05:17:43.127919+0000","last_fullsized":"2024-01-22T05:17:43.127919+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.128525+0000","last_change":"2024-01-22T05:17:43.127574+0000","last_active":"2024-01-22T05:17:43.128525+0000","last_peered":"2024-01-22T05:17:43.128525+0000","last_clean":"2024-01-22T05:17:43.128525+0000","last_became_active":"2024-01-22T05:17:43.127302+0000","last_became_peered":"2024-01-22T05:17:43.127302+0000","last_unstale":"2024-01-22T05:17:43.128525+0000","last_undegraded":"2024-01-22T05:17:43.128525+0000","last_fullsized":"2024-01-22T05:17:43.128525+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.3b","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.129761+0000","last_change":"2024-01-22T05:17:42.642707+0000","last_active":"2024-01-22T05:17:43.129761+0000","last_peered":"2024-01-22T05:17:43.129761+0000","last_clean":"2024-01-22T05:17:43.129761+0000","last_became_active":"2024-01-22T05:17:42.638591+0000","last_became_peered":"2024-01-22T05:17:42.638591+0000","last_unstale":"2024-01-22T05:17:43.129761+0000","last_undegraded":"2024-01-22T05:17:43.129761+0000","last_fullsized":"2024-01-22T05:17:43.129761+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.126787+0000","last_change":"2024-01-22T05:17:43.121426+0000","last_active":"2024-01-22T05:17:43.126787+0000","last_peered":"2024-01-22T05:17:43.126787+0000","last_clean":"2024-01-22T05:17:43.126787+0000","last_became_active":"2024-01-22T05:17:43.121169+0000","last_became_peered":"2024-01-22T05:17:43.121169+0000","last_unstale":"2024-01-22T05:17:43.126787+0000","last_undegraded":"2024-01-22T05:17:43.126787+0000","last_fullsized":"2024-01-22T05:17:43.126787+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3a","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.133810+0000","last_change":"2024-01-22T05:17:42.639337+0000","last_active":"2024-01-22T05:17:43.133810+0000","last_peered":"2024-01-22T05:17:43.133810+0000","last_clean":"2024-01-22T05:17:43.133810+0000","last_became_active":"2024-01-22T05:17:42.638960+0000","last_became_peered":"2024-01-22T05:17:42.638960+0000","last_unstale":"2024-01-22T05:17:43.133810+0000","last_undegraded":"2024-01-22T05:17:43.133810+0000","last_fullsized":"2024-01-22T05:17:43.133810+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.125293+0000","last_change":"2024-01-22T05:17:43.118609+0000","last_active":"2024-01-22T05:17:43.125293+0000","last_peered":"2024-01-22T05:17:43.125293+0000","last_clean":"2024-01-22T05:17:43.125293+0000","last_became_active":"2024-01-22T05:17:43.118334+0000","last_became_peered":"2024-01-22T05:17:43.118334+0000","last_unstale":"2024-01-22T05:17:43.125293+0000","last_undegraded":"2024-01-22T05:17:43.125293+0000","last_fullsized":"2024-01-22T05:17:43.125293+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.100591+0000","last_change":"2024-01-22T05:17:42.645406+0000","last_active":"2024-01-22T05:17:43.100591+0000","last_peered":"2024-01-22T05:17:43.100591+0000","last_clean":"2024-01-22T05:17:43.100591+0000","last_became_active":"2024-01-22T05:17:42.645084+0000","last_became_peered":"2024-01-22T05:17:42.645084+0000","last_unstale":"2024-01-22T05:17:43.100591+0000","last_undegraded":"2024-01-22T05:17:43.100591+0000","last_fullsized":"2024-01-22T05:17:43.100591+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.139143+0000","last_change":"2024-01-22T05:17:43.137064+0000","last_active":"2024-01-22T05:17:43.139143+0000","last_peered":"2024-01-22T05:17:43.139143+0000","last_clean":"2024-01-22T05:17:43.139143+0000","last_became_active":"2024-01-22T05:17:43.136788+0000","last_became_peered":"2024-01-22T05:17:43.136788+0000","last_unstale":"2024-01-22T05:17:43.139143+0000","last_undegraded":"2024-01-22T05:17:43.139143+0000","last_fullsized":"2024-01-22T05:17:43.139143+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.109428+0000","last_change":"2024-01-22T05:17:42.648211+0000","last_active":"2024-01-22T05:17:43.109428+0000","last_peered":"2024-01-22T05:17:43.109428+0000","last_clean":"2024-01-22T05:17:43.109428+0000","last_became_active":"2024-01-22T05:17:42.644020+0000","last_became_peered":"2024-01-22T05:17:42.644020+0000","last_unstale":"2024-01-22T05:17:43.109428+0000","last_undegraded":"2024-01-22T05:17:43.109428+0000","last_fullsized":"2024-01-22T05:17:43.109428+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.125998+0000","last_change":"2024-01-22T05:17:43.123011+0000","last_active":"2024-01-22T05:17:43.125998+0000","last_peered":"2024-01-22T05:17:43.125998+0000","last_clean":"2024-01-22T05:17:43.125998+0000","last_became_active":"2024-01-22T05:17:43.122736+0000","last_became_peered":"2024-01-22T05:17:43.122736+0000","last_unstale":"2024-01-22T05:17:43.125998+0000","last_undegraded":"2024-01-22T05:17:43.125998+0000","last_fullsized":"2024-01-22T05:17:43.125998+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.110419+0000","last_change":"2024-01-22T05:17:42.650563+0000","last_active":"2024-01-22T05:17:43.110419+0000","last_peered":"2024-01-22T05:17:43.110419+0000","last_clean":"2024-01-22T05:17:43.110419+0000","last_became_active":"2024-01-22T05:17:42.650291+0000","last_became_peered":"2024-01-22T05:17:42.650291+0000","last_unstale":"2024-01-22T05:17:43.110419+0000","last_undegraded":"2024-01-22T05:17:43.110419+0000","last_fullsized":"2024-01-22T05:17:43.110419+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.121946+0000","last_change":"2024-01-22T05:17:43.113094+0000","last_active":"2024-01-22T05:17:43.121946+0000","last_peered":"2024-01-22T05:17:43.121946+0000","last_clean":"2024-01-22T05:17:43.121946+0000","last_became_active":"2024-01-22T05:17:43.112827+0000","last_became_peered":"2024-01-22T05:17:43.112827+0000","last_unstale":"2024-01-22T05:17:43.121946+0000","last_undegraded":"2024-01-22T05:17:43.121946+0000","last_fullsized":"2024-01-22T05:17:43.121946+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.109307+0000","last_change":"2024-01-22T05:17:42.659998+0000","last_active":"2024-01-22T05:17:43.109307+0000","last_peered":"2024-01-22T05:17:43.109307+0000","last_clean":"2024-01-22T05:17:43.109307+0000","last_became_active":"2024-01-22T05:17:42.651848+0000","last_became_peered":"2024-01-22T05:17:42.651848+0000","last_unstale":"2024-01-22T05:17:43.109307+0000","last_undegraded":"2024-01-22T05:17:43.109307+0000","last_fullsized":"2024-01-22T05:17:43.109307+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.122959+0000","last_change":"2024-01-22T05:17:43.115607+0000","last_active":"2024-01-22T05:17:43.122959+0000","last_peered":"2024-01-22T05:17:43.122959+0000","last_clean":"2024-01-22T05:17:43.122959+0000","last_became_active":"2024-01-22T05:17:43.115338+0000","last_became_peered":"2024-01-22T05:17:43.115338+0000","last_unstale":"2024-01-22T05:17:43.122959+0000","last_undegraded":"2024-01-22T05:17:43.122959+0000","last_fullsized":"2024-01-22T05:17:43.122959+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.099566+0000","last_change":"2024-01-22T05:17:42.660045+0000","last_active":"2024-01-22T05:17:43.099566+0000","last_peered":"2024-01-22T05:17:43.099566+0000","last_clean":"2024-01-22T05:17:43.099566+0000","last_became_active":"2024-01-22T05:17:42.659715+0000","last_became_peered":"2024-01-22T05:17:42.659715+0000","last_unstale":"2024-01-22T05:17:43.099566+0000","last_undegraded":"2024-01-22T05:17:43.099566+0000","last_fullsized":"2024-01-22T05:17:43.099566+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.130663+0000","last_change":"2024-01-22T05:17:43.129479+0000","last_active":"2024-01-22T05:17:43.130663+0000","last_peered":"2024-01-22T05:17:43.130663+0000","last_clean":"2024-01-22T05:17:43.130663+0000","last_became_active":"2024-01-22T05:17:43.129193+0000","last_became_peered":"2024-01-22T05:17:43.129193+0000","last_unstale":"2024-01-22T05:17:43.130663+0000","last_undegraded":"2024-01-22T05:17:43.130663+0000","last_fullsized":"2024-01-22T05:17:43.130663+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.34","version":"158'4","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.138968+0000","last_change":"2024-01-22T05:17:42.639712+0000","last_active":"2024-01-22T05:17:43.138968+0000","last_peered":"2024-01-22T05:17:43.138968+0000","last_clean":"2024-01-22T05:17:43.138968+0000","last_became_active":"2024-01-22T05:17:42.639416+0000","last_became_peered":"2024-01-22T05:17:42.639416+0000","last_unstale":"2024-01-22T05:17:43.138968+0000","last_undegraded":"2024-01-22T05:17:43.138968+0000","last_fullsized":"2024-01-22T05:17:43.138968+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.118257+0000","last_change":"2024-01-22T05:17:43.109439+0000","last_active":"2024-01-22T05:17:43.118257+0000","last_peered":"2024-01-22T05:17:43.118257+0000","last_clean":"2024-01-22T05:17:43.118257+0000","last_became_active":"2024-01-22T05:17:43.109167+0000","last_became_peered":"2024-01-22T05:17:43.109167+0000","last_unstale":"2024-01-22T05:17:43.118257+0000","last_undegraded":"2024-01-22T05:17:43.118257+0000","last_fullsized":"2024-01-22T05:17:43.118257+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.33","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.141462+0000","last_change":"2024-01-22T05:17:42.636481+0000","last_active":"2024-01-22T05:17:43.141462+0000","last_peered":"2024-01-22T05:17:43.141462+0000","last_clean":"2024-01-22T05:17:43.141462+0000","last_became_active":"2024-01-22T05:17:42.636146+0000","last_became_peered":"2024-01-22T05:17:42.636146+0000","last_unstale":"2024-01-22T05:17:43.141462+0000","last_undegraded":"2024-01-22T05:17:43.141462+0000","last_fullsized":"2024-01-22T05:17:43.141462+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.117185+0000","last_change":"2024-01-22T05:17:43.108143+0000","last_active":"2024-01-22T05:17:43.117185+0000","last_peered":"2024-01-22T05:17:43.117185+0000","last_clean":"2024-01-22T05:17:43.117185+0000","last_became_active":"2024-01-22T05:17:43.107315+0000","last_became_peered":"2024-01-22T05:17:43.107315+0000","last_unstale":"2024-01-22T05:17:43.117185+0000","last_undegraded":"2024-01-22T05:17:43.117185+0000","last_fullsized":"2024-01-22T05:17:43.117185+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.100327+0000","last_change":"2024-01-22T05:17:42.654833+0000","last_active":"2024-01-22T05:17:43.100327+0000","last_peered":"2024-01-22T05:17:43.100327+0000","last_clean":"2024-01-22T05:17:43.100327+0000","last_became_active":"2024-01-22T05:17:42.651462+0000","last_became_peered":"2024-01-22T05:17:42.651462+0000","last_unstale":"2024-01-22T05:17:43.100327+0000","last_undegraded":"2024-01-22T05:17:43.100327+0000","last_fullsized":"2024-01-22T05:17:43.100327+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.131541+0000","last_change":"2024-01-22T05:17:43.123313+0000","last_active":"2024-01-22T05:17:43.131541+0000","last_peered":"2024-01-22T05:17:43.131541+0000","last_clean":"2024-01-22T05:17:43.131541+0000","last_became_active":"2024-01-22T05:17:43.123026+0000","last_became_peered":"2024-01-22T05:17:43.123026+0000","last_unstale":"2024-01-22T05:17:43.131541+0000","last_undegraded":"2024-01-22T05:17:43.131541+0000","last_fullsized":"2024-01-22T05:17:43.131541+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.118116+0000","last_change":"2024-01-22T05:17:42.648175+0000","last_active":"2024-01-22T05:17:43.118116+0000","last_peered":"2024-01-22T05:17:43.118116+0000","last_clean":"2024-01-22T05:17:43.118116+0000","last_became_active":"2024-01-22T05:17:42.646162+0000","last_became_peered":"2024-01-22T05:17:42.646162+0000","last_unstale":"2024-01-22T05:17:43.118116+0000","last_undegraded":"2024-01-22T05:17:43.118116+0000","last_fullsized":"2024-01-22T05:17:43.118116+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.123306+0000","last_change":"2024-01-22T05:17:43.120730+0000","last_active":"2024-01-22T05:17:43.123306+0000","last_peered":"2024-01-22T05:17:43.123306+0000","last_clean":"2024-01-22T05:17:43.123306+0000","last_became_active":"2024-01-22T05:17:43.119613+0000","last_became_peered":"2024-01-22T05:17:43.119613+0000","last_unstale":"2024-01-22T05:17:43.123306+0000","last_undegraded":"2024-01-22T05:17:43.123306+0000","last_fullsized":"2024-01-22T05:17:43.123306+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"158'4","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.140460+0000","last_change":"2024-01-22T05:17:42.641131+0000","last_active":"2024-01-22T05:17:43.140460+0000","last_peered":"2024-01-22T05:17:43.140460+0000","last_clean":"2024-01-22T05:17:43.140460+0000","last_became_active":"2024-01-22T05:17:42.640315+0000","last_became_peered":"2024-01-22T05:17:42.640315+0000","last_unstale":"2024-01-22T05:17:43.140460+0000","last_undegraded":"2024-01-22T05:17:43.140460+0000","last_fullsized":"2024-01-22T05:17:43.140460+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.139763+0000","last_change":"2024-01-22T05:17:43.122042+0000","last_active":"2024-01-22T05:17:43.139763+0000","last_peered":"2024-01-22T05:17:43.139763+0000","last_clean":"2024-01-22T05:17:43.139763+0000","last_became_active":"2024-01-22T05:17:43.120492+0000","last_became_peered":"2024-01-22T05:17:43.120492+0000","last_unstale":"2024-01-22T05:17:43.139763+0000","last_undegraded":"2024-01-22T05:17:43.139763+0000","last_fullsized":"2024-01-22T05:17:43.139763+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.100715+0000","last_change":"2024-01-22T05:17:42.647662+0000","last_active":"2024-01-22T05:17:43.100715+0000","last_peered":"2024-01-22T05:17:43.100715+0000","last_clean":"2024-01-22T05:17:43.100715+0000","last_became_active":"2024-01-22T05:17:42.647339+0000","last_became_peered":"2024-01-22T05:17:42.647339+0000","last_unstale":"2024-01-22T05:17:43.100715+0000","last_undegraded":"2024-01-22T05:17:43.100715+0000","last_fullsized":"2024-01-22T05:17:43.100715+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.112234+0000","last_change":"2024-01-22T05:17:43.108479+0000","last_active":"2024-01-22T05:17:43.112234+0000","last_peered":"2024-01-22T05:17:43.112234+0000","last_clean":"2024-01-22T05:17:43.112234+0000","last_became_active":"2024-01-22T05:17:43.108188+0000","last_became_peered":"2024-01-22T05:17:43.108188+0000","last_unstale":"2024-01-22T05:17:43.112234+0000","last_undegraded":"2024-01-22T05:17:43.112234+0000","last_fullsized":"2024-01-22T05:17:43.112234+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.098918+0000","last_change":"2024-01-22T05:17:42.658758+0000","last_active":"2024-01-22T05:17:43.098918+0000","last_peered":"2024-01-22T05:17:43.098918+0000","last_clean":"2024-01-22T05:17:43.098918+0000","last_became_active":"2024-01-22T05:17:42.658472+0000","last_became_peered":"2024-01-22T05:17:42.658472+0000","last_unstale":"2024-01-22T05:17:43.098918+0000","last_undegraded":"2024-01-22T05:17:43.098918+0000","last_fullsized":"2024-01-22T05:17:43.098918+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.120332+0000","last_change":"2024-01-22T05:17:43.114510+0000","last_active":"2024-01-22T05:17:43.120332+0000","last_peered":"2024-01-22T05:17:43.120332+0000","last_clean":"2024-01-22T05:17:43.120332+0000","last_became_active":"2024-01-22T05:17:43.114204+0000","last_became_peered":"2024-01-22T05:17:43.114204+0000","last_unstale":"2024-01-22T05:17:43.120332+0000","last_undegraded":"2024-01-22T05:17:43.120332+0000","last_fullsized":"2024-01-22T05:17:43.120332+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2d","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.131244+0000","last_change":"2024-01-22T05:17:42.653624+0000","last_active":"2024-01-22T05:17:43.131244+0000","last_peered":"2024-01-22T05:17:43.131244+0000","last_clean":"2024-01-22T05:17:43.131244+0000","last_became_active":"2024-01-22T05:17:42.653273+0000","last_became_peered":"2024-01-22T05:17:42.653273+0000","last_unstale":"2024-01-22T05:17:43.131244+0000","last_undegraded":"2024-01-22T05:17:43.131244+0000","last_fullsized":"2024-01-22T05:17:43.131244+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.137008+0000","last_change":"2024-01-22T05:17:43.135584+0000","last_active":"2024-01-22T05:17:43.137008+0000","last_peered":"2024-01-22T05:17:43.137008+0000","last_clean":"2024-01-22T05:17:43.137008+0000","last_became_active":"2024-01-22T05:17:43.134058+0000","last_became_peered":"2024-01-22T05:17:43.134058+0000","last_unstale":"2024-01-22T05:17:43.137008+0000","last_undegraded":"2024-01-22T05:17:43.137008+0000","last_fullsized":"2024-01-22T05:17:43.137008+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.124185+0000","last_change":"2024-01-22T05:17:42.656193+0000","last_active":"2024-01-22T05:17:43.124185+0000","last_peered":"2024-01-22T05:17:43.124185+0000","last_clean":"2024-01-22T05:17:43.124185+0000","last_became_active":"2024-01-22T05:17:42.653606+0000","last_became_peered":"2024-01-22T05:17:42.653606+0000","last_unstale":"2024-01-22T05:17:43.124185+0000","last_undegraded":"2024-01-22T05:17:43.124185+0000","last_fullsized":"2024-01-22T05:17:43.124185+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.125928+0000","last_change":"2024-01-22T05:17:43.122294+0000","last_active":"2024-01-22T05:17:43.125928+0000","last_peered":"2024-01-22T05:17:43.125928+0000","last_clean":"2024-01-22T05:17:43.125928+0000","last_became_active":"2024-01-22T05:17:43.122015+0000","last_became_peered":"2024-01-22T05:17:43.122015+0000","last_unstale":"2024-01-22T05:17:43.125928+0000","last_undegraded":"2024-01-22T05:17:43.125928+0000","last_fullsized":"2024-01-22T05:17:43.125928+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2b","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.127987+0000","last_change":"2024-01-22T05:17:42.643372+0000","last_active":"2024-01-22T05:17:43.127987+0000","last_peered":"2024-01-22T05:17:43.127987+0000","last_clean":"2024-01-22T05:17:43.127987+0000","last_became_active":"2024-01-22T05:17:42.643077+0000","last_became_peered":"2024-01-22T05:17:42.643077+0000","last_unstale":"2024-01-22T05:17:43.127987+0000","last_undegraded":"2024-01-22T05:17:43.127987+0000","last_fullsized":"2024-01-22T05:17:43.127987+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.117246+0000","last_change":"2024-01-22T05:17:43.113187+0000","last_active":"2024-01-22T05:17:43.117246+0000","last_peered":"2024-01-22T05:17:43.117246+0000","last_clean":"2024-01-22T05:17:43.117246+0000","last_became_active":"2024-01-22T05:17:43.112891+0000","last_became_peered":"2024-01-22T05:17:43.112891+0000","last_unstale":"2024-01-22T05:17:43.117246+0000","last_undegraded":"2024-01-22T05:17:43.117246+0000","last_fullsized":"2024-01-22T05:17:43.117246+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.096880+0000","last_change":"2024-01-22T05:17:42.646051+0000","last_active":"2024-01-22T05:17:43.096880+0000","last_peered":"2024-01-22T05:17:43.096880+0000","last_clean":"2024-01-22T05:17:43.096880+0000","last_became_active":"2024-01-22T05:17:42.645770+0000","last_became_peered":"2024-01-22T05:17:42.645770+0000","last_unstale":"2024-01-22T05:17:43.096880+0000","last_undegraded":"2024-01-22T05:17:43.096880+0000","last_fullsized":"2024-01-22T05:17:43.096880+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.111182+0000","last_change":"2024-01-22T05:17:43.106286+0000","last_active":"2024-01-22T05:17:43.111182+0000","last_peered":"2024-01-22T05:17:43.111182+0000","last_clean":"2024-01-22T05:17:43.111182+0000","last_became_active":"2024-01-22T05:17:43.105967+0000","last_became_peered":"2024-01-22T05:17:43.105967+0000","last_unstale":"2024-01-22T05:17:43.111182+0000","last_undegraded":"2024-01-22T05:17:43.111182+0000","last_fullsized":"2024-01-22T05:17:43.111182+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.109671+0000","last_change":"2024-01-22T05:17:42.630822+0000","last_active":"2024-01-22T05:17:43.109671+0000","last_peered":"2024-01-22T05:17:43.109671+0000","last_clean":"2024-01-22T05:17:43.109671+0000","last_became_active":"2024-01-22T05:17:42.630477+0000","last_became_peered":"2024-01-22T05:17:42.630477+0000","last_unstale":"2024-01-22T05:17:43.109671+0000","last_undegraded":"2024-01-22T05:17:43.109671+0000","last_fullsized":"2024-01-22T05:17:43.109671+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.112941+0000","last_change":"2024-01-22T05:17:43.109355+0000","last_active":"2024-01-22T05:17:43.112941+0000","last_peered":"2024-01-22T05:17:43.112941+0000","last_clean":"2024-01-22T05:17:43.112941+0000","last_became_active":"2024-01-22T05:17:43.109021+0000","last_became_peered":"2024-01-22T05:17:43.109021+0000","last_unstale":"2024-01-22T05:17:43.112941+0000","last_undegraded":"2024-01-22T05:17:43.112941+0000","last_fullsized":"2024-01-22T05:17:43.112941+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.097980+0000","last_change":"2024-01-22T05:17:42.657308+0000","last_active":"2024-01-22T05:17:43.097980+0000","last_peered":"2024-01-22T05:17:43.097980+0000","last_clean":"2024-01-22T05:17:43.097980+0000","last_became_active":"2024-01-22T05:17:42.657017+0000","last_became_peered":"2024-01-22T05:17:42.657017+0000","last_unstale":"2024-01-22T05:17:43.097980+0000","last_undegraded":"2024-01-22T05:17:43.097980+0000","last_fullsized":"2024-01-22T05:17:43.097980+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.138512+0000","last_change":"2024-01-22T05:17:43.135130+0000","last_active":"2024-01-22T05:17:43.138512+0000","last_peered":"2024-01-22T05:17:43.138512+0000","last_clean":"2024-01-22T05:17:43.138512+0000","last_became_active":"2024-01-22T05:17:43.134426+0000","last_became_peered":"2024-01-22T05:17:43.134426+0000","last_unstale":"2024-01-22T05:17:43.138512+0000","last_undegraded":"2024-01-22T05:17:43.138512+0000","last_fullsized":"2024-01-22T05:17:43.138512+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.097394+0000","last_change":"2024-01-22T05:17:42.652178+0000","last_active":"2024-01-22T05:17:43.097394+0000","last_peered":"2024-01-22T05:17:43.097394+0000","last_clean":"2024-01-22T05:17:43.097394+0000","last_became_active":"2024-01-22T05:17:42.650368+0000","last_became_peered":"2024-01-22T05:17:42.650368+0000","last_unstale":"2024-01-22T05:17:43.097394+0000","last_undegraded":"2024-01-22T05:17:43.097394+0000","last_fullsized":"2024-01-22T05:17:43.097394+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.122983+0000","last_change":"2024-01-22T05:17:43.121330+0000","last_active":"2024-01-22T05:17:43.122983+0000","last_peered":"2024-01-22T05:17:43.122983+0000","last_clean":"2024-01-22T05:17:43.122983+0000","last_became_active":"2024-01-22T05:17:43.121061+0000","last_became_peered":"2024-01-22T05:17:43.121061+0000","last_unstale":"2024-01-22T05:17:43.122983+0000","last_undegraded":"2024-01-22T05:17:43.122983+0000","last_fullsized":"2024-01-22T05:17:43.122983+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.095490+0000","last_change":"2024-01-22T05:17:42.647507+0000","last_active":"2024-01-22T05:17:43.095490+0000","last_peered":"2024-01-22T05:17:43.095490+0000","last_clean":"2024-01-22T05:17:43.095490+0000","last_became_active":"2024-01-22T05:17:42.647000+0000","last_became_peered":"2024-01-22T05:17:42.647000+0000","last_unstale":"2024-01-22T05:17:43.095490+0000","last_undegraded":"2024-01-22T05:17:43.095490+0000","last_fullsized":"2024-01-22T05:17:43.095490+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.138678+0000","last_change":"2024-01-22T05:17:43.137272+0000","last_active":"2024-01-22T05:17:43.138678+0000","last_peered":"2024-01-22T05:17:43.138678+0000","last_clean":"2024-01-22T05:17:43.138678+0000","last_became_active":"2024-01-22T05:17:43.136973+0000","last_became_peered":"2024-01-22T05:17:43.136973+0000","last_unstale":"2024-01-22T05:17:43.138678+0000","last_undegraded":"2024-01-22T05:17:43.138678+0000","last_fullsized":"2024-01-22T05:17:43.138678+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.108537+0000","last_change":"2024-01-22T05:17:42.649985+0000","last_active":"2024-01-22T05:17:43.108537+0000","last_peered":"2024-01-22T05:17:43.108537+0000","last_clean":"2024-01-22T05:17:43.108537+0000","last_became_active":"2024-01-22T05:17:42.649707+0000","last_became_peered":"2024-01-22T05:17:42.649707+0000","last_unstale":"2024-01-22T05:17:43.108537+0000","last_undegraded":"2024-01-22T05:17:43.108537+0000","last_fullsized":"2024-01-22T05:17:43.108537+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.123016+0000","last_change":"2024-01-22T05:17:43.121398+0000","last_active":"2024-01-22T05:17:43.123016+0000","last_peered":"2024-01-22T05:17:43.123016+0000","last_clean":"2024-01-22T05:17:43.123016+0000","last_became_active":"2024-01-22T05:17:43.121113+0000","last_became_peered":"2024-01-22T05:17:43.121113+0000","last_unstale":"2024-01-22T05:17:43.123016+0000","last_undegraded":"2024-01-22T05:17:43.123016+0000","last_fullsized":"2024-01-22T05:17:43.123016+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.099423+0000","last_change":"2024-01-22T05:17:42.656174+0000","last_active":"2024-01-22T05:17:43.099423+0000","last_peered":"2024-01-22T05:17:43.099423+0000","last_clean":"2024-01-22T05:17:43.099423+0000","last_became_active":"2024-01-22T05:17:42.655893+0000","last_became_peered":"2024-01-22T05:17:42.655893+0000","last_unstale":"2024-01-22T05:17:43.099423+0000","last_undegraded":"2024-01-22T05:17:43.099423+0000","last_fullsized":"2024-01-22T05:17:43.099423+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.130297+0000","last_change":"2024-01-22T05:17:43.115887+0000","last_active":"2024-01-22T05:17:43.130297+0000","last_peered":"2024-01-22T05:17:43.130297+0000","last_clean":"2024-01-22T05:17:43.130297+0000","last_became_active":"2024-01-22T05:17:43.115619+0000","last_became_peered":"2024-01-22T05:17:43.115619+0000","last_unstale":"2024-01-22T05:17:43.130297+0000","last_undegraded":"2024-01-22T05:17:43.130297+0000","last_fullsized":"2024-01-22T05:17:43.130297+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.109612+0000","last_change":"2024-01-22T05:17:42.651013+0000","last_active":"2024-01-22T05:17:43.109612+0000","last_peered":"2024-01-22T05:17:43.109612+0000","last_clean":"2024-01-22T05:17:43.109612+0000","last_became_active":"2024-01-22T05:17:42.650501+0000","last_became_peered":"2024-01-22T05:17:42.650501+0000","last_unstale":"2024-01-22T05:17:43.109612+0000","last_undegraded":"2024-01-22T05:17:43.109612+0000","last_fullsized":"2024-01-22T05:17:43.109612+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.122918+0000","last_change":"2024-01-22T05:17:43.120874+0000","last_active":"2024-01-22T05:17:43.122918+0000","last_peered":"2024-01-22T05:17:43.122918+0000","last_clean":"2024-01-22T05:17:43.122918+0000","last_became_active":"2024-01-22T05:17:43.120609+0000","last_became_peered":"2024-01-22T05:17:43.120609+0000","last_unstale":"2024-01-22T05:17:43.122918+0000","last_undegraded":"2024-01-22T05:17:43.122918+0000","last_fullsized":"2024-01-22T05:17:43.122918+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.098470+0000","last_change":"2024-01-22T05:17:42.655071+0000","last_active":"2024-01-22T05:17:43.098470+0000","last_peered":"2024-01-22T05:17:43.098470+0000","last_clean":"2024-01-22T05:17:43.098470+0000","last_became_active":"2024-01-22T05:17:42.653483+0000","last_became_peered":"2024-01-22T05:17:42.653483+0000","last_unstale":"2024-01-22T05:17:43.098470+0000","last_undegraded":"2024-01-22T05:17:43.098470+0000","last_fullsized":"2024-01-22T05:17:43.098470+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.130960+0000","last_change":"2024-01-22T05:17:43.114151+0000","last_active":"2024-01-22T05:17:43.130960+0000","last_peered":"2024-01-22T05:17:43.130960+0000","last_clean":"2024-01-22T05:17:43.130960+0000","last_became_active":"2024-01-22T05:17:43.113467+0000","last_became_peered":"2024-01-22T05:17:43.113467+0000","last_unstale":"2024-01-22T05:17:43.130960+0000","last_undegraded":"2024-01-22T05:17:43.130960+0000","last_fullsized":"2024-01-22T05:17:43.130960+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.107410+0000","last_change":"2024-01-22T05:17:42.639336+0000","last_active":"2024-01-22T05:17:43.107410+0000","last_peered":"2024-01-22T05:17:43.107410+0000","last_clean":"2024-01-22T05:17:43.107410+0000","last_became_active":"2024-01-22T05:17:42.638660+0000","last_became_peered":"2024-01-22T05:17:42.638660+0000","last_unstale":"2024-01-22T05:17:43.107410+0000","last_undegraded":"2024-01-22T05:17:43.107410+0000","last_fullsized":"2024-01-22T05:17:43.107410+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.130538+0000","last_change":"2024-01-22T05:17:43.126351+0000","last_active":"2024-01-22T05:17:43.130538+0000","last_peered":"2024-01-22T05:17:43.130538+0000","last_clean":"2024-01-22T05:17:43.130538+0000","last_became_active":"2024-01-22T05:17:43.126002+0000","last_became_peered":"2024-01-22T05:17:43.126002+0000","last_unstale":"2024-01-22T05:17:43.130538+0000","last_undegraded":"2024-01-22T05:17:43.130538+0000","last_fullsized":"2024-01-22T05:17:43.130538+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.109546+0000","last_change":"2024-01-22T05:17:42.636492+0000","last_active":"2024-01-22T05:17:43.109546+0000","last_peered":"2024-01-22T05:17:43.109546+0000","last_clean":"2024-01-22T05:17:43.109546+0000","last_became_active":"2024-01-22T05:17:42.634964+0000","last_became_peered":"2024-01-22T05:17:42.634964+0000","last_unstale":"2024-01-22T05:17:43.109546+0000","last_undegraded":"2024-01-22T05:17:43.109546+0000","last_fullsized":"2024-01-22T05:17:43.109546+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.138531+0000","last_change":"2024-01-22T05:17:43.135313+0000","last_active":"2024-01-22T05:17:43.138531+0000","last_peered":"2024-01-22T05:17:43.138531+0000","last_clean":"2024-01-22T05:17:43.138531+0000","last_became_active":"2024-01-22T05:17:43.134770+0000","last_became_peered":"2024-01-22T05:17:43.134770+0000","last_unstale":"2024-01-22T05:17:43.138531+0000","last_undegraded":"2024-01-22T05:17:43.138531+0000","last_fullsized":"2024-01-22T05:17:43.138531+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.122437+0000","last_change":"2024-01-22T05:17:42.653362+0000","last_active":"2024-01-22T05:17:43.122437+0000","last_peered":"2024-01-22T05:17:43.122437+0000","last_clean":"2024-01-22T05:17:43.122437+0000","last_became_active":"2024-01-22T05:17:42.653055+0000","last_became_peered":"2024-01-22T05:17:42.653055+0000","last_unstale":"2024-01-22T05:17:43.122437+0000","last_undegraded":"2024-01-22T05:17:43.122437+0000","last_fullsized":"2024-01-22T05:17:43.122437+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.130276+0000","last_change":"2024-01-22T05:17:43.117873+0000","last_active":"2024-01-22T05:17:43.130276+0000","last_peered":"2024-01-22T05:17:43.130276+0000","last_clean":"2024-01-22T05:17:43.130276+0000","last_became_active":"2024-01-22T05:17:43.117555+0000","last_became_peered":"2024-01-22T05:17:43.117555+0000","last_unstale":"2024-01-22T05:17:43.130276+0000","last_undegraded":"2024-01-22T05:17:43.130276+0000","last_fullsized":"2024-01-22T05:17:43.130276+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.128973+0000","last_change":"2024-01-22T05:17:42.651725+0000","last_active":"2024-01-22T05:17:43.128973+0000","last_peered":"2024-01-22T05:17:43.128973+0000","last_clean":"2024-01-22T05:17:43.128973+0000","last_became_active":"2024-01-22T05:17:42.651432+0000","last_became_peered":"2024-01-22T05:17:42.651432+0000","last_unstale":"2024-01-22T05:17:43.128973+0000","last_undegraded":"2024-01-22T05:17:43.128973+0000","last_fullsized":"2024-01-22T05:17:43.128973+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.129610+0000","last_change":"2024-01-22T05:17:43.119862+0000","last_active":"2024-01-22T05:17:43.129610+0000","last_peered":"2024-01-22T05:17:43.129610+0000","last_clean":"2024-01-22T05:17:43.129610+0000","last_became_active":"2024-01-22T05:17:43.118661+0000","last_became_peered":"2024-01-22T05:17:43.118661+0000","last_unstale":"2024-01-22T05:17:43.129610+0000","last_undegraded":"2024-01-22T05:17:43.129610+0000","last_fullsized":"2024-01-22T05:17:43.129610+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.134391+0000","last_change":"2024-01-22T05:17:42.653496+0000","last_active":"2024-01-22T05:17:43.134391+0000","last_peered":"2024-01-22T05:17:43.134391+0000","last_clean":"2024-01-22T05:17:43.134391+0000","last_became_active":"2024-01-22T05:17:42.653219+0000","last_became_peered":"2024-01-22T05:17:42.653219+0000","last_unstale":"2024-01-22T05:17:43.134391+0000","last_undegraded":"2024-01-22T05:17:43.134391+0000","last_fullsized":"2024-01-22T05:17:43.134391+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.121501+0000","last_change":"2024-01-22T05:17:43.114965+0000","last_active":"2024-01-22T05:17:43.121501+0000","last_peered":"2024-01-22T05:17:43.121501+0000","last_clean":"2024-01-22T05:17:43.121501+0000","last_became_active":"2024-01-22T05:17:43.109764+0000","last_became_peered":"2024-01-22T05:17:43.109764+0000","last_unstale":"2024-01-22T05:17:43.121501+0000","last_undegraded":"2024-01-22T05:17:43.121501+0000","last_fullsized":"2024-01-22T05:17:43.121501+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.120050+0000","last_change":"2024-01-22T05:17:42.657038+0000","last_active":"2024-01-22T05:17:43.120050+0000","last_peered":"2024-01-22T05:17:43.120050+0000","last_clean":"2024-01-22T05:17:43.120050+0000","last_became_active":"2024-01-22T05:17:42.656714+0000","last_became_peered":"2024-01-22T05:17:42.656714+0000","last_unstale":"2024-01-22T05:17:43.120050+0000","last_undegraded":"2024-01-22T05:17:43.120050+0000","last_fullsized":"2024-01-22T05:17:43.120050+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.132167+0000","last_change":"2024-01-22T05:17:43.127561+0000","last_active":"2024-01-22T05:17:43.132167+0000","last_peered":"2024-01-22T05:17:43.132167+0000","last_clean":"2024-01-22T05:17:43.132167+0000","last_became_active":"2024-01-22T05:17:43.127297+0000","last_became_peered":"2024-01-22T05:17:43.127297+0000","last_unstale":"2024-01-22T05:17:43.132167+0000","last_undegraded":"2024-01-22T05:17:43.132167+0000","last_fullsized":"2024-01-22T05:17:43.132167+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.098504+0000","last_change":"2024-01-22T05:17:42.632573+0000","last_active":"2024-01-22T05:17:43.098504+0000","last_peered":"2024-01-22T05:17:43.098504+0000","last_clean":"2024-01-22T05:17:43.098504+0000","last_became_active":"2024-01-22T05:17:42.632299+0000","last_became_peered":"2024-01-22T05:17:42.632299+0000","last_unstale":"2024-01-22T05:17:43.098504+0000","last_undegraded":"2024-01-22T05:17:43.098504+0000","last_fullsized":"2024-01-22T05:17:43.098504+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.139070+0000","last_change":"2024-01-22T05:17:43.137871+0000","last_active":"2024-01-22T05:17:43.139070+0000","last_peered":"2024-01-22T05:17:43.139070+0000","last_clean":"2024-01-22T05:17:43.139070+0000","last_became_active":"2024-01-22T05:17:43.136024+0000","last_became_peered":"2024-01-22T05:17:43.136024+0000","last_unstale":"2024-01-22T05:17:43.139070+0000","last_undegraded":"2024-01-22T05:17:43.139070+0000","last_fullsized":"2024-01-22T05:17:43.139070+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.118259+0000","last_change":"2024-01-22T05:17:42.655597+0000","last_active":"2024-01-22T05:17:43.118259+0000","last_peered":"2024-01-22T05:17:43.118259+0000","last_clean":"2024-01-22T05:17:43.118259+0000","last_became_active":"2024-01-22T05:17:42.655353+0000","last_became_peered":"2024-01-22T05:17:42.655353+0000","last_unstale":"2024-01-22T05:17:43.118259+0000","last_undegraded":"2024-01-22T05:17:43.118259+0000","last_fullsized":"2024-01-22T05:17:43.118259+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.138084+0000","last_change":"2024-01-22T05:17:43.133568+0000","last_active":"2024-01-22T05:17:43.138084+0000","last_peered":"2024-01-22T05:17:43.138084+0000","last_clean":"2024-01-22T05:17:43.138084+0000","last_became_active":"2024-01-22T05:17:43.133324+0000","last_became_peered":"2024-01-22T05:17:43.133324+0000","last_unstale":"2024-01-22T05:17:43.138084+0000","last_undegraded":"2024-01-22T05:17:43.138084+0000","last_fullsized":"2024-01-22T05:17:43.138084+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.095470+0000","last_change":"2024-01-22T05:17:42.650705+0000","last_active":"2024-01-22T05:17:43.095470+0000","last_peered":"2024-01-22T05:17:43.095470+0000","last_clean":"2024-01-22T05:17:43.095470+0000","last_became_active":"2024-01-22T05:17:42.650325+0000","last_became_peered":"2024-01-22T05:17:42.650325+0000","last_unstale":"2024-01-22T05:17:43.095470+0000","last_undegraded":"2024-01-22T05:17:43.095470+0000","last_fullsized":"2024-01-22T05:17:43.095470+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.132800+0000","last_change":"2024-01-22T05:17:43.128600+0000","last_active":"2024-01-22T05:17:43.132800+0000","last_peered":"2024-01-22T05:17:43.132800+0000","last_clean":"2024-01-22T05:17:43.132800+0000","last_became_active":"2024-01-22T05:17:43.128288+0000","last_became_peered":"2024-01-22T05:17:43.128288+0000","last_unstale":"2024-01-22T05:17:43.132800+0000","last_undegraded":"2024-01-22T05:17:43.132800+0000","last_fullsized":"2024-01-22T05:17:43.132800+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.116612+0000","last_change":"2024-01-22T05:17:42.647568+0000","last_active":"2024-01-22T05:17:43.116612+0000","last_peered":"2024-01-22T05:17:43.116612+0000","last_clean":"2024-01-22T05:17:43.116612+0000","last_became_active":"2024-01-22T05:17:42.647130+0000","last_became_peered":"2024-01-22T05:17:42.647130+0000","last_unstale":"2024-01-22T05:17:43.116612+0000","last_undegraded":"2024-01-22T05:17:43.116612+0000","last_fullsized":"2024-01-22T05:17:43.116612+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.137147+0000","last_change":"2024-01-22T05:17:43.130581+0000","last_active":"2024-01-22T05:17:43.137147+0000","last_peered":"2024-01-22T05:17:43.137147+0000","last_clean":"2024-01-22T05:17:43.137147+0000","last_became_active":"2024-01-22T05:17:43.130147+0000","last_became_peered":"2024-01-22T05:17:43.130147+0000","last_unstale":"2024-01-22T05:17:43.137147+0000","last_undegraded":"2024-01-22T05:17:43.137147+0000","last_fullsized":"2024-01-22T05:17:43.137147+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.125846+0000","last_change":"2024-01-22T05:17:42.648285+0000","last_active":"2024-01-22T05:17:43.125846+0000","last_peered":"2024-01-22T05:17:43.125846+0000","last_clean":"2024-01-22T05:17:43.125846+0000","last_became_active":"2024-01-22T05:17:42.648005+0000","last_became_peered":"2024-01-22T05:17:42.648005+0000","last_unstale":"2024-01-22T05:17:43.125846+0000","last_undegraded":"2024-01-22T05:17:43.125846+0000","last_fullsized":"2024-01-22T05:17:43.125846+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.141212+0000","last_change":"2024-01-22T05:17:43.130528+0000","last_active":"2024-01-22T05:17:43.141212+0000","last_peered":"2024-01-22T05:17:43.141212+0000","last_clean":"2024-01-22T05:17:43.141212+0000","last_became_active":"2024-01-22T05:17:43.124537+0000","last_became_peered":"2024-01-22T05:17:43.124537+0000","last_unstale":"2024-01-22T05:17:43.141212+0000","last_undegraded":"2024-01-22T05:17:43.141212+0000","last_fullsized":"2024-01-22T05:17:43.141212+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.135757+0000","last_change":"2024-01-22T05:17:42.655100+0000","last_active":"2024-01-22T05:17:43.135757+0000","last_peered":"2024-01-22T05:17:43.135757+0000","last_clean":"2024-01-22T05:17:43.135757+0000","last_became_active":"2024-01-22T05:17:42.654714+0000","last_became_peered":"2024-01-22T05:17:42.654714+0000","last_unstale":"2024-01-22T05:17:43.135757+0000","last_undegraded":"2024-01-22T05:17:43.135757+0000","last_fullsized":"2024-01-22T05:17:43.135757+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.131627+0000","last_change":"2024-01-22T05:17:43.126957+0000","last_active":"2024-01-22T05:17:43.131627+0000","last_peered":"2024-01-22T05:17:43.131627+0000","last_clean":"2024-01-22T05:17:43.131627+0000","last_became_active":"2024-01-22T05:17:43.126669+0000","last_became_peered":"2024-01-22T05:17:43.126669+0000","last_unstale":"2024-01-22T05:17:43.131627+0000","last_undegraded":"2024-01-22T05:17:43.131627+0000","last_fullsized":"2024-01-22T05:17:43.131627+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.103919+0000","last_change":"2024-01-22T05:17:42.653351+0000","last_active":"2024-01-22T05:17:43.103919+0000","last_peered":"2024-01-22T05:17:43.103919+0000","last_clean":"2024-01-22T05:17:43.103919+0000","last_became_active":"2024-01-22T05:17:42.652893+0000","last_became_peered":"2024-01-22T05:17:42.652893+0000","last_unstale":"2024-01-22T05:17:43.103919+0000","last_undegraded":"2024-01-22T05:17:43.103919+0000","last_fullsized":"2024-01-22T05:17:43.103919+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.139285+0000","last_change":"2024-01-22T05:17:43.136152+0000","last_active":"2024-01-22T05:17:43.139285+0000","last_peered":"2024-01-22T05:17:43.139285+0000","last_clean":"2024-01-22T05:17:43.139285+0000","last_became_active":"2024-01-22T05:17:43.135871+0000","last_became_peered":"2024-01-22T05:17:43.135871+0000","last_unstale":"2024-01-22T05:17:43.139285+0000","last_undegraded":"2024-01-22T05:17:43.139285+0000","last_fullsized":"2024-01-22T05:17:43.139285+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.104068+0000","last_change":"2024-01-22T05:17:42.652837+0000","last_active":"2024-01-22T05:17:43.104068+0000","last_peered":"2024-01-22T05:17:43.104068+0000","last_clean":"2024-01-22T05:17:43.104068+0000","last_became_active":"2024-01-22T05:17:42.652491+0000","last_became_peered":"2024-01-22T05:17:42.652491+0000","last_unstale":"2024-01-22T05:17:43.104068+0000","last_undegraded":"2024-01-22T05:17:43.104068+0000","last_fullsized":"2024-01-22T05:17:43.104068+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.115083+0000","last_change":"2024-01-22T05:17:43.108789+0000","last_active":"2024-01-22T05:17:43.115083+0000","last_peered":"2024-01-22T05:17:43.115083+0000","last_clean":"2024-01-22T05:17:43.115083+0000","last_became_active":"2024-01-22T05:17:43.107636+0000","last_became_peered":"2024-01-22T05:17:43.107636+0000","last_unstale":"2024-01-22T05:17:43.115083+0000","last_undegraded":"2024-01-22T05:17:43.115083+0000","last_fullsized":"2024-01-22T05:17:43.115083+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.132393+0000","last_change":"2024-01-22T05:17:42.654078+0000","last_active":"2024-01-22T05:17:43.132393+0000","last_peered":"2024-01-22T05:17:43.132393+0000","last_clean":"2024-01-22T05:17:43.132393+0000","last_became_active":"2024-01-22T05:17:42.653796+0000","last_became_peered":"2024-01-22T05:17:42.653796+0000","last_unstale":"2024-01-22T05:17:43.132393+0000","last_undegraded":"2024-01-22T05:17:43.132393+0000","last_fullsized":"2024-01-22T05:17:43.132393+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.134502+0000","last_change":"2024-01-22T05:17:43.131864+0000","last_active":"2024-01-22T05:17:43.134502+0000","last_peered":"2024-01-22T05:17:43.134502+0000","last_clean":"2024-01-22T05:17:43.134502+0000","last_became_active":"2024-01-22T05:17:43.130864+0000","last_became_peered":"2024-01-22T05:17:43.130864+0000","last_unstale":"2024-01-22T05:17:43.134502+0000","last_undegraded":"2024-01-22T05:17:43.134502+0000","last_fullsized":"2024-01-22T05:17:43.134502+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.104165+0000","last_change":"2024-01-22T05:17:42.649537+0000","last_active":"2024-01-22T05:17:43.104165+0000","last_peered":"2024-01-22T05:17:43.104165+0000","last_clean":"2024-01-22T05:17:43.104165+0000","last_became_active":"2024-01-22T05:17:42.648943+0000","last_became_peered":"2024-01-22T05:17:42.648943+0000","last_unstale":"2024-01-22T05:17:43.104165+0000","last_undegraded":"2024-01-22T05:17:43.104165+0000","last_fullsized":"2024-01-22T05:17:43.104165+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.126134+0000","last_change":"2024-01-22T05:17:43.119367+0000","last_active":"2024-01-22T05:17:43.126134+0000","last_peered":"2024-01-22T05:17:43.126134+0000","last_clean":"2024-01-22T05:17:43.126134+0000","last_became_active":"2024-01-22T05:17:43.112936+0000","last_became_peered":"2024-01-22T05:17:43.112936+0000","last_unstale":"2024-01-22T05:17:43.126134+0000","last_undegraded":"2024-01-22T05:17:43.126134+0000","last_fullsized":"2024-01-22T05:17:43.126134+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.118309+0000","last_change":"2024-01-22T05:17:42.646402+0000","last_active":"2024-01-22T05:17:43.118309+0000","last_peered":"2024-01-22T05:17:43.118309+0000","last_clean":"2024-01-22T05:17:43.118309+0000","last_became_active":"2024-01-22T05:17:42.643080+0000","last_became_peered":"2024-01-22T05:17:42.643080+0000","last_unstale":"2024-01-22T05:17:43.118309+0000","last_undegraded":"2024-01-22T05:17:43.118309+0000","last_fullsized":"2024-01-22T05:17:43.118309+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.117264+0000","last_change":"2024-01-22T05:17:43.112543+0000","last_active":"2024-01-22T05:17:43.117264+0000","last_peered":"2024-01-22T05:17:43.117264+0000","last_clean":"2024-01-22T05:17:43.117264+0000","last_became_active":"2024-01-22T05:17:43.112265+0000","last_became_peered":"2024-01-22T05:17:43.112265+0000","last_unstale":"2024-01-22T05:17:43.117264+0000","last_undegraded":"2024-01-22T05:17:43.117264+0000","last_fullsized":"2024-01-22T05:17:43.117264+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.103649+0000","last_change":"2024-01-22T05:17:42.652964+0000","last_active":"2024-01-22T05:17:43.103649+0000","last_peered":"2024-01-22T05:17:43.103649+0000","last_clean":"2024-01-22T05:17:43.103649+0000","last_became_active":"2024-01-22T05:17:42.652651+0000","last_became_peered":"2024-01-22T05:17:42.652651+0000","last_unstale":"2024-01-22T05:17:43.103649+0000","last_undegraded":"2024-01-22T05:17:43.103649+0000","last_fullsized":"2024-01-22T05:17:43.103649+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.141145+0000","last_change":"2024-01-22T05:17:43.129900+0000","last_active":"2024-01-22T05:17:43.141145+0000","last_peered":"2024-01-22T05:17:43.141145+0000","last_clean":"2024-01-22T05:17:43.141145+0000","last_became_active":"2024-01-22T05:17:43.129609+0000","last_became_peered":"2024-01-22T05:17:43.129609+0000","last_unstale":"2024-01-22T05:17:43.141145+0000","last_undegraded":"2024-01-22T05:17:43.141145+0000","last_fullsized":"2024-01-22T05:17:43.141145+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.140369+0000","last_change":"2024-01-22T05:17:42.652466+0000","last_active":"2024-01-22T05:17:43.140369+0000","last_peered":"2024-01-22T05:17:43.140369+0000","last_clean":"2024-01-22T05:17:43.140369+0000","last_became_active":"2024-01-22T05:17:42.652194+0000","last_became_peered":"2024-01-22T05:17:42.652194+0000","last_unstale":"2024-01-22T05:17:43.140369+0000","last_undegraded":"2024-01-22T05:17:43.140369+0000","last_fullsized":"2024-01-22T05:17:43.140369+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.139010+0000","last_change":"2024-01-22T05:17:43.136931+0000","last_active":"2024-01-22T05:17:43.139010+0000","last_peered":"2024-01-22T05:17:43.139010+0000","last_clean":"2024-01-22T05:17:43.139010+0000","last_became_active":"2024-01-22T05:17:43.136638+0000","last_became_peered":"2024-01-22T05:17:43.136638+0000","last_unstale":"2024-01-22T05:17:43.139010+0000","last_undegraded":"2024-01-22T05:17:43.139010+0000","last_fullsized":"2024-01-22T05:17:43.139010+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.095757+0000","last_change":"2024-01-22T05:17:42.639663+0000","last_active":"2024-01-22T05:17:43.095757+0000","last_peered":"2024-01-22T05:17:43.095757+0000","last_clean":"2024-01-22T05:17:43.095757+0000","last_became_active":"2024-01-22T05:17:42.639408+0000","last_became_peered":"2024-01-22T05:17:42.639408+0000","last_unstale":"2024-01-22T05:17:43.095757+0000","last_undegraded":"2024-01-22T05:17:43.095757+0000","last_fullsized":"2024-01-22T05:17:43.095757+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.129675+0000","last_change":"2024-01-22T05:17:43.126374+0000","last_active":"2024-01-22T05:17:43.129675+0000","last_peered":"2024-01-22T05:17:43.129675+0000","last_clean":"2024-01-22T05:17:43.129675+0000","last_became_active":"2024-01-22T05:17:43.125030+0000","last_became_peered":"2024-01-22T05:17:43.125030+0000","last_unstale":"2024-01-22T05:17:43.129675+0000","last_undegraded":"2024-01-22T05:17:43.129675+0000","last_fullsized":"2024-01-22T05:17:43.129675+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.099305+0000","last_change":"2024-01-22T05:17:42.641366+0000","last_active":"2024-01-22T05:17:43.099305+0000","last_peered":"2024-01-22T05:17:43.099305+0000","last_clean":"2024-01-22T05:17:43.099305+0000","last_became_active":"2024-01-22T05:17:42.641088+0000","last_became_peered":"2024-01-22T05:17:42.641088+0000","last_unstale":"2024-01-22T05:17:43.099305+0000","last_undegraded":"2024-01-22T05:17:43.099305+0000","last_fullsized":"2024-01-22T05:17:43.099305+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.139905+0000","last_change":"2024-01-22T05:17:43.122233+0000","last_active":"2024-01-22T05:17:43.139905+0000","last_peered":"2024-01-22T05:17:43.139905+0000","last_clean":"2024-01-22T05:17:43.139905+0000","last_became_active":"2024-01-22T05:17:43.120808+0000","last_became_peered":"2024-01-22T05:17:43.120808+0000","last_unstale":"2024-01-22T05:17:43.139905+0000","last_undegraded":"2024-01-22T05:17:43.139905+0000","last_fullsized":"2024-01-22T05:17:43.139905+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.107485+0000","last_change":"2024-01-22T05:17:42.639514+0000","last_active":"2024-01-22T05:17:43.107485+0000","last_peered":"2024-01-22T05:17:43.107485+0000","last_clean":"2024-01-22T05:17:43.107485+0000","last_became_active":"2024-01-22T05:17:42.638376+0000","last_became_peered":"2024-01-22T05:17:42.638376+0000","last_unstale":"2024-01-22T05:17:43.107485+0000","last_undegraded":"2024-01-22T05:17:43.107485+0000","last_fullsized":"2024-01-22T05:17:43.107485+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.123790+0000","last_change":"2024-01-22T05:17:43.114821+0000","last_active":"2024-01-22T05:17:43.123790+0000","last_peered":"2024-01-22T05:17:43.123790+0000","last_clean":"2024-01-22T05:17:43.123790+0000","last_became_active":"2024-01-22T05:17:43.113772+0000","last_became_peered":"2024-01-22T05:17:43.113772+0000","last_unstale":"2024-01-22T05:17:43.123790+0000","last_undegraded":"2024-01-22T05:17:43.123790+0000","last_fullsized":"2024-01-22T05:17:43.123790+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.109706+0000","last_change":"2024-01-22T05:17:42.650813+0000","last_active":"2024-01-22T05:17:43.109706+0000","last_peered":"2024-01-22T05:17:43.109706+0000","last_clean":"2024-01-22T05:17:43.109706+0000","last_became_active":"2024-01-22T05:17:42.650137+0000","last_became_peered":"2024-01-22T05:17:42.650137+0000","last_unstale":"2024-01-22T05:17:43.109706+0000","last_undegraded":"2024-01-22T05:17:43.109706+0000","last_fullsized":"2024-01-22T05:17:43.109706+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.130527+0000","last_change":"2024-01-22T05:17:43.126274+0000","last_active":"2024-01-22T05:17:43.130527+0000","last_peered":"2024-01-22T05:17:43.130527+0000","last_clean":"2024-01-22T05:17:43.130527+0000","last_became_active":"2024-01-22T05:17:43.125962+0000","last_became_peered":"2024-01-22T05:17:43.125962+0000","last_unstale":"2024-01-22T05:17:43.130527+0000","last_undegraded":"2024-01-22T05:17:43.130527+0000","last_fullsized":"2024-01-22T05:17:43.130527+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.118334+0000","last_change":"2024-01-22T05:17:42.652609+0000","last_active":"2024-01-22T05:17:43.118334+0000","last_peered":"2024-01-22T05:17:43.118334+0000","last_clean":"2024-01-22T05:17:43.118334+0000","last_became_active":"2024-01-22T05:17:42.650529+0000","last_became_peered":"2024-01-22T05:17:42.650529+0000","last_unstale":"2024-01-22T05:17:43.118334+0000","last_undegraded":"2024-01-22T05:17:43.118334+0000","last_fullsized":"2024-01-22T05:17:43.118334+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.131873+0000","last_change":"2024-01-22T05:17:43.124766+0000","last_active":"2024-01-22T05:17:43.131873+0000","last_peered":"2024-01-22T05:17:43.131873+0000","last_clean":"2024-01-22T05:17:43.131873+0000","last_became_active":"2024-01-22T05:17:43.124506+0000","last_became_peered":"2024-01-22T05:17:43.124506+0000","last_unstale":"2024-01-22T05:17:43.131873+0000","last_undegraded":"2024-01-22T05:17:43.131873+0000","last_fullsized":"2024-01-22T05:17:43.131873+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.095615+0000","last_change":"2024-01-22T05:17:42.640363+0000","last_active":"2024-01-22T05:17:43.095615+0000","last_peered":"2024-01-22T05:17:43.095615+0000","last_clean":"2024-01-22T05:17:43.095615+0000","last_became_active":"2024-01-22T05:17:42.640048+0000","last_became_peered":"2024-01-22T05:17:42.640048+0000","last_unstale":"2024-01-22T05:17:43.095615+0000","last_undegraded":"2024-01-22T05:17:43.095615+0000","last_fullsized":"2024-01-22T05:17:43.095615+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.121547+0000","last_change":"2024-01-22T05:17:43.115397+0000","last_active":"2024-01-22T05:17:43.121547+0000","last_peered":"2024-01-22T05:17:43.121547+0000","last_clean":"2024-01-22T05:17:43.121547+0000","last_became_active":"2024-01-22T05:17:43.113582+0000","last_became_peered":"2024-01-22T05:17:43.113582+0000","last_unstale":"2024-01-22T05:17:43.121547+0000","last_undegraded":"2024-01-22T05:17:43.121547+0000","last_fullsized":"2024-01-22T05:17:43.121547+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.110997+0000","last_change":"2024-01-22T05:17:42.634615+0000","last_active":"2024-01-22T05:17:43.110997+0000","last_peered":"2024-01-22T05:17:43.110997+0000","last_clean":"2024-01-22T05:17:43.110997+0000","last_became_active":"2024-01-22T05:17:42.633133+0000","last_became_peered":"2024-01-22T05:17:42.633133+0000","last_unstale":"2024-01-22T05:17:43.110997+0000","last_undegraded":"2024-01-22T05:17:43.110997+0000","last_fullsized":"2024-01-22T05:17:43.110997+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.124029+0000","last_change":"2024-01-22T05:17:43.115002+0000","last_active":"2024-01-22T05:17:43.124029+0000","last_peered":"2024-01-22T05:17:43.124029+0000","last_clean":"2024-01-22T05:17:43.124029+0000","last_became_active":"2024-01-22T05:17:43.114550+0000","last_became_peered":"2024-01-22T05:17:43.114550+0000","last_unstale":"2024-01-22T05:17:43.124029+0000","last_undegraded":"2024-01-22T05:17:43.124029+0000","last_fullsized":"2024-01-22T05:17:43.124029+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.141343+0000","last_change":"2024-01-22T05:17:42.659480+0000","last_active":"2024-01-22T05:17:43.141343+0000","last_peered":"2024-01-22T05:17:43.141343+0000","last_clean":"2024-01-22T05:17:43.141343+0000","last_became_active":"2024-01-22T05:17:42.659214+0000","last_became_peered":"2024-01-22T05:17:42.659214+0000","last_unstale":"2024-01-22T05:17:43.141343+0000","last_undegraded":"2024-01-22T05:17:43.141343+0000","last_fullsized":"2024-01-22T05:17:43.141343+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.100750+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:17:43.100750+0000","last_peered":"2024-01-22T05:17:43.100750+0000","last_clean":"2024-01-22T05:17:43.100750+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:17:43.100750+0000","last_undegraded":"2024-01-22T05:17:43.100750+0000","last_fullsized":"2024-01-22T05:17:43.100750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.134481+0000","last_change":"2024-01-22T05:17:43.131173+0000","last_active":"2024-01-22T05:17:43.134481+0000","last_peered":"2024-01-22T05:17:43.134481+0000","last_clean":"2024-01-22T05:17:43.134481+0000","last_became_active":"2024-01-22T05:17:43.130824+0000","last_became_peered":"2024-01-22T05:17:43.130824+0000","last_unstale":"2024-01-22T05:17:43.134481+0000","last_undegraded":"2024-01-22T05:17:43.134481+0000","last_fullsized":"2024-01-22T05:17:43.134481+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.109220+0000","last_change":"2024-01-22T05:17:42.660630+0000","last_active":"2024-01-22T05:17:43.109220+0000","last_peered":"2024-01-22T05:17:43.109220+0000","last_clean":"2024-01-22T05:17:43.109220+0000","last_became_active":"2024-01-22T05:17:42.651492+0000","last_became_peered":"2024-01-22T05:17:42.651492+0000","last_unstale":"2024-01-22T05:17:43.109220+0000","last_undegraded":"2024-01-22T05:17:43.109220+0000","last_fullsized":"2024-01-22T05:17:43.109220+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":134,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.118747+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:17:43.118747+0000","last_peered":"2024-01-22T05:17:43.118747+0000","last_clean":"2024-01-22T05:17:43.118747+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:17:43.118747+0000","last_undegraded":"2024-01-22T05:17:43.118747+0000","last_fullsized":"2024-01-22T05:17:43.118747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.135049+0000","last_change":"2024-01-22T05:17:43.130789+0000","last_active":"2024-01-22T05:17:43.135049+0000","last_peered":"2024-01-22T05:17:43.135049+0000","last_clean":"2024-01-22T05:17:43.135049+0000","last_became_active":"2024-01-22T05:17:43.130487+0000","last_became_peered":"2024-01-22T05:17:43.130487+0000","last_unstale":"2024-01-22T05:17:43.135049+0000","last_undegraded":"2024-01-22T05:17:43.135049+0000","last_fullsized":"2024-01-22T05:17:43.135049+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.118215+0000","last_change":"2024-01-22T05:17:42.646645+0000","last_active":"2024-01-22T05:17:43.118215+0000","last_peered":"2024-01-22T05:17:43.118215+0000","last_clean":"2024-01-22T05:17:43.118215+0000","last_became_active":"2024-01-22T05:17:42.645703+0000","last_became_peered":"2024-01-22T05:17:42.645703+0000","last_unstale":"2024-01-22T05:17:43.118215+0000","last_undegraded":"2024-01-22T05:17:43.118215+0000","last_fullsized":"2024-01-22T05:17:43.118215+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":126,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.104132+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:17:43.104132+0000","last_peered":"2024-01-22T05:17:43.104132+0000","last_clean":"2024-01-22T05:17:43.104132+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:17:43.104132+0000","last_undegraded":"2024-01-22T05:17:43.104132+0000","last_fullsized":"2024-01-22T05:17:43.104132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.129915+0000","last_change":"2024-01-22T05:17:43.127446+0000","last_active":"2024-01-22T05:17:43.129915+0000","last_peered":"2024-01-22T05:17:43.129915+0000","last_clean":"2024-01-22T05:17:43.129915+0000","last_became_active":"2024-01-22T05:17:43.126832+0000","last_became_peered":"2024-01-22T05:17:43.126832+0000","last_unstale":"2024-01-22T05:17:43.129915+0000","last_undegraded":"2024-01-22T05:17:43.129915+0000","last_fullsized":"2024-01-22T05:17:43.129915+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"158'4","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.130600+0000","last_change":"2024-01-22T05:17:42.648406+0000","last_active":"2024-01-22T05:17:43.130600+0000","last_peered":"2024-01-22T05:17:43.130600+0000","last_clean":"2024-01-22T05:17:43.130600+0000","last_became_active":"2024-01-22T05:17:42.644335+0000","last_became_peered":"2024-01-22T05:17:42.644335+0000","last_unstale":"2024-01-22T05:17:43.130600+0000","last_undegraded":"2024-01-22T05:17:43.130600+0000","last_fullsized":"2024-01-22T05:17:43.130600+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":134,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.120207+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:17:43.120207+0000","last_peered":"2024-01-22T05:17:43.120207+0000","last_clean":"2024-01-22T05:17:43.120207+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:17:43.120207+0000","last_undegraded":"2024-01-22T05:17:43.120207+0000","last_fullsized":"2024-01-22T05:17:43.120207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.141235+0000","last_change":"2024-01-22T05:17:43.130715+0000","last_active":"2024-01-22T05:17:43.141235+0000","last_peered":"2024-01-22T05:17:43.141235+0000","last_clean":"2024-01-22T05:17:43.141235+0000","last_became_active":"2024-01-22T05:17:43.130269+0000","last_became_peered":"2024-01-22T05:17:43.130269+0000","last_unstale":"2024-01-22T05:17:43.141235+0000","last_undegraded":"2024-01-22T05:17:43.141235+0000","last_fullsized":"2024-01-22T05:17:43.141235+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.099017+0000","last_change":"2024-01-22T05:17:42.658629+0000","last_active":"2024-01-22T05:17:43.099017+0000","last_peered":"2024-01-22T05:17:43.099017+0000","last_clean":"2024-01-22T05:17:43.099017+0000","last_became_active":"2024-01-22T05:17:42.658320+0000","last_became_peered":"2024-01-22T05:17:42.658320+0000","last_unstale":"2024-01-22T05:17:43.099017+0000","last_undegraded":"2024-01-22T05:17:43.099017+0000","last_fullsized":"2024-01-22T05:17:43.099017+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":151,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.097016+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:17:43.097016+0000","last_peered":"2024-01-22T05:17:43.097016+0000","last_clean":"2024-01-22T05:17:43.097016+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:17:43.097016+0000","last_undegraded":"2024-01-22T05:17:43.097016+0000","last_fullsized":"2024-01-22T05:17:43.097016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.141521+0000","last_change":"2024-01-22T05:17:43.129766+0000","last_active":"2024-01-22T05:17:43.141521+0000","last_peered":"2024-01-22T05:17:43.141521+0000","last_clean":"2024-01-22T05:17:43.141521+0000","last_became_active":"2024-01-22T05:17:43.129452+0000","last_became_peered":"2024-01-22T05:17:43.129452+0000","last_unstale":"2024-01-22T05:17:43.141521+0000","last_undegraded":"2024-01-22T05:17:43.141521+0000","last_fullsized":"2024-01-22T05:17:43.141521+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"158'3","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.124999+0000","last_change":"2024-01-22T05:17:42.660021+0000","last_active":"2024-01-22T05:17:43.124999+0000","last_peered":"2024-01-22T05:17:43.124999+0000","last_clean":"2024-01-22T05:17:43.124999+0000","last_became_active":"2024-01-22T05:17:42.659310+0000","last_became_peered":"2024-01-22T05:17:42.659310+0000","last_unstale":"2024-01-22T05:17:43.124999+0000","last_undegraded":"2024-01-22T05:17:43.124999+0000","last_fullsized":"2024-01-22T05:17:43.124999+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.099821+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:17:43.099821+0000","last_peered":"2024-01-22T05:17:43.099821+0000","last_clean":"2024-01-22T05:17:43.099821+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:17:43.099821+0000","last_undegraded":"2024-01-22T05:17:43.099821+0000","last_fullsized":"2024-01-22T05:17:43.099821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.130956+0000","last_change":"2024-01-22T05:17:43.125170+0000","last_active":"2024-01-22T05:17:43.130956+0000","last_peered":"2024-01-22T05:17:43.130956+0000","last_clean":"2024-01-22T05:17:43.130956+0000","last_became_active":"2024-01-22T05:17:43.124260+0000","last_became_peered":"2024-01-22T05:17:43.124260+0000","last_unstale":"2024-01-22T05:17:43.130956+0000","last_undegraded":"2024-01-22T05:17:43.130956+0000","last_fullsized":"2024-01-22T05:17:43.130956+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.127847+0000","last_change":"2024-01-22T05:17:42.644610+0000","last_active":"2024-01-22T05:17:43.127847+0000","last_peered":"2024-01-22T05:17:43.127847+0000","last_clean":"2024-01-22T05:17:43.127847+0000","last_became_active":"2024-01-22T05:17:42.644315+0000","last_became_peered":"2024-01-22T05:17:42.644315+0000","last_unstale":"2024-01-22T05:17:43.127847+0000","last_undegraded":"2024-01-22T05:17:43.127847+0000","last_fullsized":"2024-01-22T05:17:43.127847+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":126,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.104091+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:17:43.104091+0000","last_peered":"2024-01-22T05:17:43.104091+0000","last_clean":"2024-01-22T05:17:43.104091+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:17:43.104091+0000","last_undegraded":"2024-01-22T05:17:43.104091+0000","last_fullsized":"2024-01-22T05:17:43.104091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.141239+0000","last_change":"2024-01-22T05:17:43.131647+0000","last_active":"2024-01-22T05:17:43.141239+0000","last_peered":"2024-01-22T05:17:43.141239+0000","last_clean":"2024-01-22T05:17:43.141239+0000","last_became_active":"2024-01-22T05:17:43.129855+0000","last_became_peered":"2024-01-22T05:17:43.129855+0000","last_unstale":"2024-01-22T05:17:43.141239+0000","last_undegraded":"2024-01-22T05:17:43.141239+0000","last_fullsized":"2024-01-22T05:17:43.141239+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:42.609127+0000","last_clean_scrub_stamp":"2024-01-22T05:17:42.609127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.111501+0000","last_change":"2024-01-22T05:17:42.647545+0000","last_active":"2024-01-22T05:17:43.111501+0000","last_peered":"2024-01-22T05:17:43.111501+0000","last_clean":"2024-01-22T05:17:43.111501+0000","last_became_active":"2024-01-22T05:17:42.647265+0000","last_became_peered":"2024-01-22T05:17:42.647265+0000","last_unstale":"2024-01-22T05:17:43.111501+0000","last_undegraded":"2024-01-22T05:17:43.111501+0000","last_fullsized":"2024-01-22T05:17:43.111501+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:17:41.597094+0000","last_clean_scrub_stamp":"2024-01-22T05:17:41.597094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":151,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.098592+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:17:43.098592+0000","last_peered":"2024-01-22T05:17:43.098592+0000","last_clean":"2024-01-22T05:17:43.098592+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:17:43.098592+0000","last_undegraded":"2024-01-22T05:17:43.098592+0000","last_fullsized":"2024-01-22T05:17:43.098592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":127,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-01-22T05:17:43.103783+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:17:43.103783+0000","last_peered":"2024-01-22T05:17:43.103783+0000","last_clean":"2024-01-22T05:17:43.103783+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:17:43.103783+0000","last_undegraded":"2024-01-22T05:17:43.103783+0000","last_fullsized":"2024-01-22T05:17:43.103783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307376,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064464,"statfs":{"total":96636764160,"available":96322011136,"internally_reserved":0,"allocated":2007040,"data_stored":993676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1830000000000001,"15min":1.0620000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.6419999999999999,"5min":14.779999999999999,"15min":14.779999999999999},"last":1.9590000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.9530000000000001,"15min":1.355},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.7989999999999999,"5min":76.662000000000006,"15min":76.662000000000006},"last":3.7789999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.115,"15min":1.03},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.6100000000000001,"5min":4.9269999999999996,"15min":4.9269999999999996},"last":1.657},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2689999999999999,"15min":1.1990000000000001},"min":{"1min":0.71599999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.5499999999999998,"5min":12.691000000000001,"15min":12.691000000000001},"last":3.6040000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1080000000000001,"15min":1.107},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5289999999999999,"5min":1.984,"15min":2.5150000000000001},"last":2.1589999999999998},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.3149999999999999,"15min":1.208},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5089999999999999,"5min":15.036,"15min":15.036},"last":2.3199999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.905,"15min":1.448},"min":{"1min":0.82399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.752,"5min":64.983999999999995,"15min":64.983999999999995},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.3839999999999999,"15min":1.2829999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":1.8109999999999999,"5min":15.073,"15min":15.073},"last":2.2770000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.3660000000000001,"15min":1.163},"min":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.32900000000000001},"max":{"1min":2.8599999999999999,"5min":22.239000000000001,"15min":22.239000000000001},"last":3.1840000000000002},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.466,"15min":1.2509999999999999},"min":{"1min":0.68799999999999994,"5min":0.66500000000000004,"15min":0.52200000000000002},"max":{"1min":1.891,"5min":27.872,"15min":27.872},"last":1.7949999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.9470000000000001,"15min":1.4350000000000001},"min":{"1min":0.76200000000000001,"5min":0.64400000000000002,"15min":0.40400000000000003},"max":{"1min":1.8839999999999999,"5min":65.652000000000001,"15min":65.652000000000001},"last":2.3530000000000002},{"interface":"front","average":{"1min":1.323,"5min":1.292,"15min":1.2609999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":1.9590000000000001,"5min":2.1629999999999998,"15min":3.625},"last":1.7629999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3169999999999999,"15min":1.248},"min":{"1min":0.85299999999999998,"5min":0.64800000000000002,"15min":0.53400000000000003},"max":{"1min":2.899,"5min":6.9939999999999998,"15min":6.9939999999999998},"last":3.3439999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.5069999999999999,"15min":1.393},"min":{"1min":0.82999999999999996,"5min":0.80800000000000005,"15min":0.56100000000000005},"max":{"1min":2.246,"5min":12.965,"15min":12.965},"last":2.1219999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575010,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307368,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064472,"statfs":{"total":96636764160,"available":96322019328,"internally_reserved":0,"allocated":1998848,"data_stored":993786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:17:01 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.026,"15min":1.2849999999999999},"min":{"1min":0.66600000000000004,"5min":0.52400000000000002,"15min":0.35999999999999999},"max":{"1min":1.4450000000000001,"5min":1.679,"15min":77.745000000000005},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.0669999999999999,"15min":1.073},"min":{"1min":0.66000000000000003,"5min":0.54700000000000004,"15min":0.44},"max":{"1min":1.3069999999999999,"5min":5.0359999999999996,"15min":13.555999999999999},"last":1.123}]},{"osd":1,"last update":"Mon Jan 22 05:17:01 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.093,"15min":1.1160000000000001},"min":{"1min":0.629,"5min":0.503,"15min":0.40000000000000002},"max":{"1min":1.3879999999999999,"5min":5.9210000000000003,"15min":15.499000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1020000000000001,"15min":1.163},"min":{"1min":0.76600000000000001,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.55,"5min":3.6080000000000001,"15min":7.7629999999999999},"last":1.167}]},{"osd":2,"last update":"Mon Jan 22 05:17:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1759999999999999,"15min":1.159},"min":{"1min":0.84999999999999998,"5min":0.70999999999999996,"15min":0.57399999999999995},"max":{"1min":1.4810000000000001,"5min":1.823,"15min":3.0960000000000001},"last":1.319},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.2030000000000001,"15min":1.137},"min":{"1min":0.77400000000000002,"5min":0.68600000000000005,"15min":0.38200000000000001},"max":{"1min":1.4430000000000001,"5min":4.9660000000000002,"15min":4.9660000000000002},"last":1.04}]},{"osd":3,"last update":"Mon Jan 22 05:17:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.2110000000000001,"15min":1.476},"min":{"1min":0.72699999999999998,"5min":0.66700000000000004,"15min":0.59299999999999997},"max":{"1min":1.5189999999999999,"5min":5.0750000000000002,"15min":102.08199999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.085,"5min":1.1659999999999999,"15min":1.218},"min":{"1min":0.81799999999999995,"5min":0.66300000000000003,"15min":0.374},"max":{"1min":1.3660000000000001,"5min":2.9620000000000002,"15min":15.468},"last":0.82499999999999996}]},{"osd":4,"last update":"Mon Jan 22 05:17:01 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.2150000000000001,"15min":1.139},"min":{"1min":0.80600000000000005,"5min":0.65500000000000003,"15min":0.495},"max":{"1min":1.3919999999999999,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.2569999999999999,"15min":1.1539999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.4299999999999999,"5min":5.1200000000000001,"15min":5.1200000000000001},"last":1.1930000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:17:01 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1539999999999999,"15min":1.244},"min":{"1min":0.68400000000000005,"5min":0.58699999999999997,"15min":0.48099999999999998},"max":{"1min":1.478,"5min":2.9100000000000001,"15min":30.533000000000001},"last":1.095},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.292,"15min":1.276},"min":{"1min":0.79500000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.53,"5min":1.8759999999999999,"15min":3.875},"last":1.2410000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:17:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.462,"15min":1.4299999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":1.583,"5min":8.4190000000000005,"15min":23.547999999999998},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.423,"15min":1.5660000000000001},"min":{"1min":0.77700000000000002,"5min":0.73099999999999998,"15min":0.495},"max":{"1min":1.6020000000000001,"5min":7.46,"15min":63.737000000000002},"last":1.151}]}]},{"osd":5,"up_from":13,"seq":55834575010,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307368,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064472,"statfs":{"total":96636764160,"available":96322019328,"internally_reserved":0,"allocated":1998848,"data_stored":993448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.03,"15min":1.0069999999999999},"min":{"1min":0.63700000000000001,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.2849999999999999,"5min":1.651,"15min":2.0609999999999999},"last":0.877},{"interface":"front","average":{"1min":1.012,"5min":1.0409999999999999,"15min":1.0529999999999999},"min":{"1min":0.58699999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.325,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.1180000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2110000000000001,"15min":1.1879999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.732,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.349},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.1930000000000001,"15min":1.216},"min":{"1min":0.80700000000000005,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.7989999999999999,"5min":1.9930000000000001,"15min":2.0209999999999999},"last":1.143}]},{"osd":2,"last update":"Mon Jan 22 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.6279999999999999,"5min":1.9219999999999999,"15min":1.925},"last":1.04},{"interface":"front","average":{"1min":1.196,"5min":1.143,"15min":1.123},"min":{"1min":0.78700000000000003,"5min":0.71799999999999997,"15min":0.59899999999999998},"max":{"1min":1.6459999999999999,"5min":1.982,"15min":1.982},"last":0.98899999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.175,"15min":1.1599999999999999},"min":{"1min":0.72099999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5389999999999999,"5min":3.202,"15min":3.202},"last":1.28},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2230000000000001,"15min":1.224},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.621,"5min":4.8819999999999997,"15min":4.8819999999999997},"last":0.77600000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.085,"15min":1.1120000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.8240000000000001,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.093},{"interface":"front","average":{"1min":1.222,"5min":1.1559999999999999,"15min":1.1990000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.8779999999999999,"5min":2.081,"15min":2.081},"last":1.0169999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.1950000000000001,"15min":1.2370000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.2010000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2430000000000001,"15min":1.2529999999999999},"min":{"1min":0.71399999999999997,"5min":0.69599999999999995,"15min":0.55900000000000005},"max":{"1min":1.927,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.169}]},{"osd":7,"last update":"Mon Jan 22 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.2889999999999999,"15min":1.323},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.7909999999999999,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.21},{"interface":"front","average":{"1min":1.331,"5min":1.304,"15min":1.353},"min":{"1min":0.80000000000000004,"5min":0.64200000000000002,"15min":0.60799999999999998},"max":{"1min":1.806,"5min":2.04,"15min":3.1840000000000002},"last":1.2509999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575010,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299184,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072656,"statfs":{"total":96636764160,"available":96330399744,"internally_reserved":0,"allocated":2007040,"data_stored":994140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.1120000000000001,"15min":1.1060000000000001},"min":{"1min":0.86899999999999999,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.696,"5min":1.726,"15min":2.0150000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.1830000000000001,"15min":1.1359999999999999},"min":{"1min":0.85799999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.55,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.097}]},{"osd":1,"last update":"Mon Jan 22 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.071,"15min":1.075},"min":{"1min":0.90700000000000003,"5min":0.60499999999999998,"15min":0.53100000000000003},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.7609999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0009999999999999,"15min":1.079},"min":{"1min":0.72299999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.516,"5min":1.6870000000000001,"15min":2.194},"last":1.0649999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.0660000000000001,"15min":1.077},"min":{"1min":0.71099999999999997,"5min":0.52800000000000002,"15min":0.49199999999999999},"max":{"1min":1.516,"5min":1.516,"15min":5.3390000000000004},"last":1.212},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1439999999999999,"15min":1.1799999999999999},"min":{"1min":0.97699999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6140000000000001,"5min":1.641,"15min":2.3479999999999999},"last":1.2250000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.129,"15min":1.143},"min":{"1min":0.79300000000000004,"5min":0.65700000000000003,"15min":0.496},"max":{"1min":1.4419999999999999,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1539999999999999,"15min":1.151},"min":{"1min":0.745,"5min":0.66200000000000003,"15min":0.53100000000000003},"max":{"1min":1.647,"5min":2.2959999999999998,"15min":5.3029999999999999},"last":1.131}]},{"osd":5,"last update":"Mon Jan 22 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.107,"15min":1.1359999999999999},"min":{"1min":0.71299999999999997,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.415,"5min":1.6899999999999999,"15min":2.0790000000000002},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.161,"15min":1.1319999999999999},"min":{"1min":1.0209999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.544,"5min":1.8240000000000001,"15min":2.0030000000000001},"last":0.95399999999999996}]},{"osd":6,"last update":"Mon Jan 22 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.149,"15min":1.1539999999999999},"min":{"1min":0.78000000000000003,"5min":0.63100000000000001,"15min":0.44500000000000001},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":0.996},{"interface":"front","average":{"1min":1.363,"5min":1.2609999999999999,"15min":1.296},"min":{"1min":1.0760000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":1.327}]},{"osd":7,"last update":"Mon Jan 22 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3460000000000001,"15min":1.3220000000000001},"min":{"1min":0.97399999999999998,"5min":0.62,"15min":0.59399999999999997},"max":{"1min":1.7949999999999999,"5min":1.9119999999999999,"15min":2.2839999999999998},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3169999999999999,"15min":1.3300000000000001},"min":{"1min":1.046,"5min":0.88800000000000001,"15min":0.56899999999999995},"max":{"1min":1.843,"5min":1.843,"15min":5.2629999999999999},"last":1.286}]}]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299176,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072664,"statfs":{"total":96636764160,"available":96330407936,"internally_reserved":0,"allocated":1998848,"data_stored":993798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.77500000000000002,"15min":0.86099999999999999},"min":{"1min":0.58899999999999997,"5min":0.41099999999999998,"15min":0.34200000000000003},"max":{"1min":1.3540000000000001,"5min":1.512,"15min":14.859},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.877,"15min":0.89700000000000002},"min":{"1min":0.51600000000000001,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":1.6879999999999999,"5min":1.804,"15min":5.0919999999999996},"last":0.69599999999999995}]},{"osd":1,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.873,"15min":0.89600000000000002},"min":{"1min":0.65900000000000003,"5min":0.42399999999999999,"15min":0.39300000000000002},"max":{"1min":1.466,"5min":1.466,"15min":6.5570000000000004},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.94299999999999995,"15min":0.96999999999999997},"min":{"1min":0.79300000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.361,"5min":1.7669999999999999,"15min":5.7519999999999998},"last":1.0249999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0720000000000001,"15min":1.111},"min":{"1min":0.65800000000000003,"5min":0.48599999999999999,"15min":0.40600000000000003},"max":{"1min":1.5940000000000001,"5min":1.8680000000000001,"15min":2.391},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.1200000000000001,"15min":1.1779999999999999},"min":{"1min":0.72099999999999997,"5min":0.59199999999999997,"15min":0.44800000000000001},"max":{"1min":1.625,"5min":1.6259999999999999,"15min":4.1429999999999998},"last":1.4179999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3029999999999999,"15min":1.325},"min":{"1min":1.1559999999999999,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.6619999999999999,"5min":2.423,"15min":10.858000000000001},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.2749999999999999,"15min":1.337},"min":{"1min":1.1259999999999999,"5min":0.75600000000000001,"15min":0.63600000000000001},"max":{"1min":1.728,"5min":2.3359999999999999,"15min":10.846},"last":1.2430000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.24,"15min":1.2849999999999999},"min":{"1min":1.069,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.5249999999999999,"5min":1.9910000000000001,"15min":7.3639999999999999},"last":1.335},{"interface":"front","average":{"1min":1.323,"5min":1.286,"15min":1.3759999999999999},"min":{"1min":0.88200000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.649,"5min":6.3220000000000001,"15min":14.523999999999999},"last":1.1519999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.3580000000000001,"15min":1.363},"min":{"1min":1.022,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.698,"5min":2.1819999999999999,"15min":4.9809999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.425,"5min":1.367,"15min":1.3879999999999999},"min":{"1min":1.1399999999999999,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.667,"5min":1.883,"15min":5.4210000000000003},"last":1.472}]},{"osd":7,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3,"15min":1.359},"min":{"1min":1.028,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.599,"5min":1.986,"15min":5.7160000000000002},"last":1.099},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3560000000000001,"15min":1.4079999999999999},"min":{"1min":1.133,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9470000000000001,"5min":2.5449999999999999,"15min":6.4279999999999999},"last":1.3819999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575010,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311460,"kb_used_data":1948,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060380,"statfs":{"total":96636764160,"available":96317829120,"internally_reserved":0,"allocated":1994752,"data_stored":992962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:16:50 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77100000000000002,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.378,"15min":0.378},"max":{"1min":1.1299999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.45300000000000001,"5min":0.44600000000000001,"15min":0.373},"max":{"1min":1.1779999999999999,"5min":1.556,"15min":1.7350000000000001},"last":0.81399999999999995}]},{"osd":1,"last update":"Mon Jan 22 05:16:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.89000000000000001,"15min":0.84799999999999998},"min":{"1min":0.60999999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.96899999999999997,"15min":0.94099999999999995},"min":{"1min":0.55200000000000005,"5min":0.43099999999999999,"15min":0.41599999999999998},"max":{"1min":1.6279999999999999,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.89700000000000002}]},{"osd":3,"last update":"Mon Jan 22 05:16:50 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.125,"15min":1.1160000000000001},"min":{"1min":0.72699999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.3090000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.224,"15min":1.1990000000000001},"min":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.51100000000000001},"max":{"1min":1.571,"5min":3.133,"15min":3.133},"last":1.3919999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:16:50 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.282,"15min":1.27},"min":{"1min":0.90400000000000003,"5min":0.88500000000000001,"15min":0.59099999999999997},"max":{"1min":1.8600000000000001,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.131},{"interface":"front","average":{"1min":1.123,"5min":1.214,"15min":1.1930000000000001},"min":{"1min":0.71699999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.6659999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.3440000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:16:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.238,"15min":1.2090000000000001},"min":{"1min":0.84099999999999997,"5min":0.70799999999999996,"15min":0.63800000000000001},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3120000000000001,"15min":1.2849999999999999},"min":{"1min":0.84799999999999998,"5min":0.76100000000000001,"15min":0.67000000000000004},"max":{"1min":1.6080000000000001,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.488}]},{"osd":6,"last update":"Mon Jan 22 05:16:50 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.266,"15min":1.248},"min":{"1min":0.82299999999999995,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.6819999999999999,"5min":1.7749999999999999,"15min":2.1920000000000002},"last":1.278},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.331,"15min":1.3},"min":{"1min":0.91300000000000003,"5min":0.629,"15min":0.629},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.5900000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:16:50 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.3660000000000001,"15min":1.343},"min":{"1min":0.98599999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6759999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.464},{"interface":"front","average":{"1min":1.385,"5min":1.413,"15min":1.4059999999999999},"min":{"1min":0.89700000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.649}]}]},{"osd":1,"up_from":13,"seq":55834575011,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311460,"kb_used_data":1948,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060380,"statfs":{"total":96636764160,"available":96317829120,"internally_reserved":0,"allocated":1994752,"data_stored":992906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85599999999999998,"15min":0.86399999999999999},"min":{"1min":0.46200000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.3240000000000001,"5min":1.911,"15min":3.4119999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.98299999999999998,"15min":0.995},"min":{"1min":0.59699999999999998,"5min":0.42899999999999999,"15min":0.41099999999999998},"max":{"1min":1.26,"5min":1.8680000000000001,"15min":2.101},"last":0.71099999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.997,"15min":0.995},"min":{"1min":0.49399999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4470000000000001,"5min":2.169,"15min":2.169},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0640000000000001,"15min":1.0449999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.474,"5min":2.024,"15min":2.024},"last":0.85199999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0209999999999999,"15min":1.0249999999999999},"min":{"1min":0.65800000000000003,"5min":0.59399999999999997,"15min":0.38900000000000001},"max":{"1min":1.5649999999999999,"5min":1.7130000000000001,"15min":4.665},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.97799999999999998,"15min":0.93899999999999995},"min":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.41899999999999998},"max":{"1min":1.357,"5min":4.1319999999999997,"15min":5.5830000000000002},"last":0.78600000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.212,"15min":1.2470000000000001},"min":{"1min":0.83699999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.7769999999999999,"5min":2.2509999999999999,"15min":15.76},"last":1.109},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.264,"15min":1.319},"min":{"1min":0.92000000000000004,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.484,"5min":1.9630000000000001,"15min":16.975000000000001},"last":0.91000000000000003}]},{"osd":5,"last update":"Mon Jan 22 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3149999999999999,"15min":1.2290000000000001},"min":{"1min":0.83899999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":5.3159999999999998,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2889999999999999,"15min":1.2769999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8420000000000001,"5min":2.3330000000000002,"15min":2.52},"last":1.0389999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.3,"15min":1.2649999999999999},"min":{"1min":0.78700000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":5.3979999999999997,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.129},{"interface":"front","average":{"1min":1.246,"5min":1.3320000000000001,"15min":1.333},"min":{"1min":0.76200000000000001,"5min":0.71899999999999997,"15min":0.68799999999999994},"max":{"1min":1.895,"5min":2.5569999999999999,"15min":2.5569999999999999},"last":1.2430000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.321,"15min":1.3520000000000001},"min":{"1min":0.77200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6990000000000001,"5min":1.8999999999999999,"15min":4.4329999999999998},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.478,"5min":1.395,"15min":1.3600000000000001},"min":{"1min":0.96699999999999997,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":5.4939999999999998,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":0.99399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575010,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311456,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060384,"statfs":{"total":96636764160,"available":96317833216,"internally_reserved":0,"allocated":1990656,"data_stored":992872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.877,"15min":0.91000000000000003},"min":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.28699999999999998},"max":{"1min":1.1120000000000001,"5min":1.972,"15min":15.273},"last":0.501},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91100000000000003,"15min":0.93300000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.34499999999999997},"max":{"1min":1.625,"5min":1.698,"15min":4.4009999999999998},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.03,"15min":1.0669999999999999},"min":{"1min":0.61599999999999999,"5min":0.53200000000000003,"15min":0.46400000000000002},"max":{"1min":1.6299999999999999,"5min":1.6459999999999999,"15min":15.473000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.03,"5min":1.0349999999999999,"15min":1.018},"min":{"1min":0.68799999999999994,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.518,"5min":1.794,"15min":1.7989999999999999},"last":0.76900000000000002}]},{"osd":3,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.96999999999999997,"15min":0.99199999999999999},"min":{"1min":0.63600000000000001,"5min":0.54800000000000004,"15min":0.39000000000000001},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":5.3970000000000002},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.171,"15min":1.2},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.7210000000000001,"5min":2.2349999999999999,"15min":15.439},"last":0.72499999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.232,"15min":1.2669999999999999},"min":{"1min":0.85799999999999998,"5min":0.66200000000000003,"15min":0.61399999999999999},"max":{"1min":1.7270000000000001,"5min":2.1280000000000001,"15min":5.1799999999999997},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.238,"15min":1.222},"min":{"1min":0.85299999999999998,"5min":0.59399999999999997,"15min":0.56200000000000006},"max":{"1min":1.706,"5min":1.7909999999999999,"15min":3.4340000000000002},"last":1.3080000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.296,"15min":1.2949999999999999},"min":{"1min":0.88600000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.75,"5min":1.9099999999999999,"15min":3.548},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.3740000000000001,"15min":1.3460000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.6259999999999999,"5min":2.2309999999999999,"15min":2.823},"last":1.294}]},{"osd":6,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.391,"15min":1.4299999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.59099999999999997},"max":{"1min":1.746,"5min":2.0950000000000002,"15min":15.4},"last":1.216},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3580000000000001,"15min":1.403},"min":{"1min":1.038,"5min":0.85699999999999998,"15min":0.72499999999999998},"max":{"1min":1.8919999999999999,"5min":2.105,"15min":7.1349999999999998},"last":1.0669999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:16:47 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.413,"15min":1.4670000000000001},"min":{"1min":1.0569999999999999,"5min":0.95499999999999996,"15min":0.79900000000000004},"max":{"1min":2.145,"5min":2.1819999999999999,"15min":5.29},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.393,"15min":1.3819999999999999},"min":{"1min":1.04,"5min":1.002,"15min":0.752},"max":{"1min":2.0470000000000002,"5min":2.1869999999999998,"15min":2.7269999999999999},"last":1.034}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:17:47.849 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:17:47.850 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-22T05:17:48.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.062+0000 7f4d2b200700 1 Processor -- start 2024-01-22T05:17:48.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.062+0000 7f4d2b200700 1 -- start start 2024-01-22T05:17:48.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.066+0000 7f4d2b200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d2c141aa0 0x7f4d2c063d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:48.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.066+0000 7f4d2b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d2c064270 0x7f4d2c0c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:48.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.066+0000 7f4d2b200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c15ba30 con 0x7f4d2c0c3210 2024-01-22T05:17:48.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.066+0000 7f4d2b200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c141e80 con 0x7f4d2c141aa0 2024-01-22T05:17:48.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.066+0000 7f4d2b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0646b0 con 0x7f4d2c064270 2024-01-22T05:17:48.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.066+0000 7f4d29e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d2c141aa0 0x7f4d2c063d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:48.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d29e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d2c141aa0 0x7f4d2c063d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49084/0 (socket says 172.21.15.49:49084) 2024-01-22T05:17:48.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d29e00700 1 -- 172.21.15.49:0/1838386413 learned_addr learned my addr 172.21.15.49:0/1838386413 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:48.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d29400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d2c064270 0x7f4d2c0c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:48.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d29e00700 1 -- 172.21.15.49:0/1838386413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d2c064270 msgr2=0x7f4d2c0c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:48.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d28a00700 1 -- 172.21.15.49:0/1838386413 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056519112 0 0) 0x7f4d2c15ba30 con 0x7f4d2c0c3210 2024-01-22T05:17:48.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d29e00700 1 --2- 172.21.15.49:0/1838386413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d2c064270 0x7f4d2c0c2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d29e00700 1 -- 172.21.15.49:0/1838386413 >> v1:172.21.15.110:6789/0 conn(0x7f4d2c0c3210 legacy=0x7f4d2c0c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:48.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d29e00700 1 -- 172.21.15.49:0/1838386413 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c15bcc0 con 0x7f4d2c141aa0 2024-01-22T05:17:48.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d29e00700 1 --2- 172.21.15.49:0/1838386413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d2c141aa0 0x7f4d2c063d80 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7f4d1c009810 tx=0x7f4d1c009060).ready entity=mon.0 client_cookie=d8f82b34b5dc0b5e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:48.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d28a00700 1 -- 172.21.15.49:0/1838386413 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c005880 con 0x7f4d2c141aa0 2024-01-22T05:17:48.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d28a00700 1 -- 172.21.15.49:0/1838386413 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c0059e0 con 0x7f4d2c141aa0 2024-01-22T05:17:48.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d28a00700 1 -- 172.21.15.49:0/1838386413 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c005d60 con 0x7f4d2c141aa0 2024-01-22T05:17:48.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d2b200700 1 -- 172.21.15.49:0/1838386413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d2c141aa0 msgr2=0x7f4d2c063d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:48.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d2b200700 1 --2- 172.21.15.49:0/1838386413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d2c141aa0 0x7f4d2c063d80 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7f4d1c009810 tx=0x7f4d1c009060).stop 2024-01-22T05:17:48.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d2b200700 1 -- 172.21.15.49:0/1838386413 shutdown_connections 2024-01-22T05:17:48.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d2b200700 1 --2- 172.21.15.49:0/1838386413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d2c064270 0x7f4d2c0c2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d2b200700 1 --2- 172.21.15.49:0/1838386413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d2c141aa0 0x7f4d2c063d80 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.070+0000 7f4d2b200700 1 -- 172.21.15.49:0/1838386413 >> 172.21.15.49:0/1838386413 conn(0x7f4d2c0c40e0 msgr2=0x7f4d2c0c44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:48.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.074+0000 7f4d2b200700 1 -- 172.21.15.49:0/1838386413 shutdown_connections 2024-01-22T05:17:48.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.074+0000 7f4d2b200700 1 -- 172.21.15.49:0/1838386413 wait complete. 2024-01-22T05:17:48.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.074+0000 7f4d2b200700 1 Processor -- start 2024-01-22T05:17:48.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.074+0000 7f4d2b200700 1 -- start start 2024-01-22T05:17:48.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d2b200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d2c064270 0x7f4d2c0ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d2b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d2c0c3210 0x7f4d2c0a80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d2b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d2c141aa0 0x7f4d2c13c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d2b200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0acb20 con 0x7f4d2c064270 2024-01-22T05:17:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d2b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0abf10 con 0x7f4d2c0c3210 2024-01-22T05:17:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d2b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0ac1f0 con 0x7f4d2c141aa0 2024-01-22T05:17:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d29e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d2c064270 0x7f4d2c0ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d29e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d2c064270 0x7f4d2c0ab980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49098/0 (socket says 172.21.15.49:49098) 2024-01-22T05:17:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d29e00700 1 -- 172.21.15.49:0/2963966578 learned_addr learned my addr 172.21.15.49:0/2963966578 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d29400700 1 --2- 172.21.15.49:0/2963966578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d2c0c3210 0x7f4d2c0a80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d2a800700 1 --2- 172.21.15.49:0/2963966578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d2c141aa0 0x7f4d2c13c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d29e00700 1 -- 172.21.15.49:0/2963966578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d2c141aa0 msgr2=0x7f4d2c13c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d29e00700 1 --2- 172.21.15.49:0/2963966578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d2c141aa0 0x7f4d2c13c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d29e00700 1 -- 172.21.15.49:0/2963966578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d2c0c3210 msgr2=0x7f4d2c0a80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d29e00700 1 --2- 172.21.15.49:0/2963966578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d2c0c3210 0x7f4d2c0a80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d29e00700 1 -- 172.21.15.49:0/2963966578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c009300 con 0x7f4d2c064270 2024-01-22T05:17:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d29400700 1 --2- 172.21.15.49:0/2963966578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d2c0c3210 0x7f4d2c0a80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d29e00700 1 --2- 172.21.15.49:0/2963966578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d2c064270 0x7f4d2c0ab980 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f4d1c009eb0 tx=0x7f4d1c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d21600700 1 -- 172.21.15.49:0/2963966578 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c00b790 con 0x7f4d2c064270 2024-01-22T05:17:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d21600700 1 -- 172.21.15.49:0/2963966578 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c00b8f0 con 0x7f4d2c064270 2024-01-22T05:17:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d2b200700 1 -- 172.21.15.49:0/2963966578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c0ac4d0 con 0x7f4d2c064270 2024-01-22T05:17:48.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d21600700 1 -- 172.21.15.49:0/2963966578 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c00bc90 con 0x7f4d2c064270 2024-01-22T05:17:48.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.078+0000 7f4d2b200700 1 -- 172.21.15.49:0/2963966578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c13ce00 con 0x7f4d2c064270 2024-01-22T05:17:48.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.082+0000 7f4d2b200700 1 -- 172.21.15.49:0/2963966578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2c046800 con 0x7f4d2c064270 2024-01-22T05:17:48.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.082+0000 7f4d21600700 1 -- 172.21.15.49:0/2963966578 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4d1c018070 con 0x7f4d2c064270 2024-01-22T05:17:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.082+0000 7f4d21600700 1 --2- 172.21.15.49:0/2963966578 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d0405a510 0x7f4d0405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.082+0000 7f4d21600700 1 -- 172.21.15.49:0/2963966578 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4d1c075880 con 0x7f4d2c064270 2024-01-22T05:17:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.082+0000 7f4d29400700 1 --2- 172.21.15.49:0/2963966578 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d0405a510 0x7f4d0405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.086+0000 7f4d29400700 1 --2- 172.21.15.49:0/2963966578 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d0405a510 0x7f4d0405c9d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f4d2c159f50 tx=0x7f4d14008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:48.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.090+0000 7f4d21600700 1 -- 172.21.15.49:0/2963966578 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4d1c048f00 con 0x7f4d2c064270 2024-01-22T05:17:48.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.310+0000 7f4d2b200700 1 -- 172.21.15.49:0/2963966578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4d2c064dc0 con 0x7f4d2c064270 2024-01-22T05:17:48.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.322+0000 7f4d21600700 1 -- 172.21.15.49:0/2963966578 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4d1c04c520 con 0x7f4d2c064270 2024-01-22T05:17:48.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.326+0000 7f4d2b200700 1 -- 172.21.15.49:0/2963966578 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d0405a510 msgr2=0x7f4d0405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:48.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.326+0000 7f4d2b200700 1 --2- 172.21.15.49:0/2963966578 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d0405a510 0x7f4d0405c9d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f4d2c159f50 tx=0x7f4d14008040).stop 2024-01-22T05:17:48.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.326+0000 7f4d2b200700 1 -- 172.21.15.49:0/2963966578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d2c064270 msgr2=0x7f4d2c0ab980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:48.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.326+0000 7f4d2b200700 1 --2- 172.21.15.49:0/2963966578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d2c064270 0x7f4d2c0ab980 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f4d1c009eb0 tx=0x7f4d1c016000).stop 2024-01-22T05:17:48.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.326+0000 7f4d2b200700 1 -- 172.21.15.49:0/2963966578 shutdown_connections 2024-01-22T05:17:48.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.326+0000 7f4d2b200700 1 --2- 172.21.15.49:0/2963966578 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d0405a510 0x7f4d0405c9d0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.326+0000 7f4d2b200700 1 --2- 172.21.15.49:0/2963966578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d2c141aa0 0x7f4d2c13c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.326+0000 7f4d2b200700 1 --2- 172.21.15.49:0/2963966578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d2c0c3210 0x7f4d2c0a80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.326+0000 7f4d2b200700 1 --2- 172.21.15.49:0/2963966578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d2c064270 0x7f4d2c0ab980 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.326+0000 7f4d2b200700 1 -- 172.21.15.49:0/2963966578 >> 172.21.15.49:0/2963966578 conn(0x7f4d2c0c40e0 msgr2=0x7f4d2c15b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:48.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.326+0000 7f4d2b200700 1 -- 172.21.15.49:0/2963966578 shutdown_connections 2024-01-22T05:17:48.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.326+0000 7f4d2b200700 1 -- 172.21.15.49:0/2963966578 wait complete. 2024-01-22T05:17:48.332 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-01-22T05:17:48.351 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:17:48.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.514+0000 7efe04200700 1 Processor -- start 2024-01-22T05:17:48.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.514+0000 7efe04200700 1 -- start start 2024-01-22T05:17:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.518+0000 7efe04200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efdfc155d20 0x7efdfc065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.518+0000 7efe04200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdfc0a8e50 0x7efdfc0c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.518+0000 7efe04200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc0c1a40 con 0x7efdfc066070 2024-01-22T05:17:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.518+0000 7efe04200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc159310 con 0x7efdfc155d20 2024-01-22T05:17:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.518+0000 7efe04200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0c13f0 con 0x7efdfc0a8e50 2024-01-22T05:17:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.518+0000 7efe01800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efdfc155d20 0x7efdfc065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.518+0000 7efe01800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efdfc155d20 0x7efdfc065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49104/0 (socket says 172.21.15.49:49104) 2024-01-22T05:17:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.518+0000 7efe00e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efdfc066070 0x7efdfc0a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44610/0 (socket says 172.21.15.49:44610) 2024-01-22T05:17:48.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.518+0000 7efe01800700 1 -- 172.21.15.49:0/2000356890 learned_addr learned my addr 172.21.15.49:0/2000356890 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.518+0000 7efe02200700 1 --2- 172.21.15.49:0/2000356890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdfc0a8e50 0x7efdfc0c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.518+0000 7efe01800700 1 -- 172.21.15.49:0/2000356890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdfc0a8e50 msgr2=0x7efdfc0c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.518+0000 7efe01800700 1 --2- 172.21.15.49:0/2000356890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdfc0a8e50 0x7efdfc0c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.518+0000 7efe01800700 1 -- 172.21.15.49:0/2000356890 >> v1:172.21.15.49:6789/0 conn(0x7efdfc066070 legacy=0x7efdfc0a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.518+0000 7efe01800700 1 -- 172.21.15.49:0/2000356890 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc0c16d0 con 0x7efdfc155d20 2024-01-22T05:17:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.518+0000 7efe01800700 1 --2- 172.21.15.49:0/2000356890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc155d20 0x7efdfc065b80 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7efdec006fd0 tx=0x7efdec0090f0).ready entity=mon.0 client_cookie=5030ab5315be57d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.522+0000 7efdfbe00700 1 -- 172.21.15.49:0/2000356890 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec00b580 con 0x7efdfc155d20 2024-01-22T05:17:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.522+0000 7efdfbe00700 1 -- 172.21.15.49:0/2000356890 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec00b6e0 con 0x7efdfc155d20 2024-01-22T05:17:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.522+0000 7efdfbe00700 1 -- 172.21.15.49:0/2000356890 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec00ba60 con 0x7efdfc155d20 2024-01-22T05:17:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.522+0000 7efe04200700 1 -- 172.21.15.49:0/2000356890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc155d20 msgr2=0x7efdfc065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.522+0000 7efe04200700 1 --2- 172.21.15.49:0/2000356890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc155d20 0x7efdfc065b80 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7efdec006fd0 tx=0x7efdec0090f0).stop 2024-01-22T05:17:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.522+0000 7efe04200700 1 -- 172.21.15.49:0/2000356890 shutdown_connections 2024-01-22T05:17:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.522+0000 7efe04200700 1 --2- 172.21.15.49:0/2000356890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdfc0a8e50 0x7efdfc0c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.522+0000 7efe04200700 1 --2- 172.21.15.49:0/2000356890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc155d20 0x7efdfc065b80 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.522+0000 7efe04200700 1 -- 172.21.15.49:0/2000356890 >> 172.21.15.49:0/2000356890 conn(0x7efdfc0c6540 msgr2=0x7efdfc0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.522+0000 7efe04200700 1 -- 172.21.15.49:0/2000356890 shutdown_connections 2024-01-22T05:17:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.522+0000 7efe04200700 1 -- 172.21.15.49:0/2000356890 wait complete. 2024-01-22T05:17:48.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.526+0000 7efe04200700 1 Processor -- start 2024-01-22T05:17:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.526+0000 7efe04200700 1 -- start start 2024-01-22T05:17:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.526+0000 7efe04200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdfc066070 0x7efdfc0a9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.526+0000 7efe04200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdfc0a8e50 0x7efdfc144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.526+0000 7efe04200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc155d20 0x7efdfc066520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.526+0000 7efe04200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0aae80 con 0x7efdfc155d20 2024-01-22T05:17:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.526+0000 7efe04200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0aa270 con 0x7efdfc0a8e50 2024-01-22T05:17:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.526+0000 7efe04200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0aa550 con 0x7efdfc066070 2024-01-22T05:17:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.526+0000 7efe02200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc155d20 0x7efdfc066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.526+0000 7efe01800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdfc066070 0x7efdfc0a9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.526+0000 7efe02200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc155d20 0x7efdfc066520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49116/0 (socket says 172.21.15.49:49116) 2024-01-22T05:17:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.526+0000 7efe02200700 1 -- 172.21.15.49:0/3854797855 learned_addr learned my addr 172.21.15.49:0/3854797855 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.526+0000 7efe00e00700 1 --2- 172.21.15.49:0/3854797855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdfc0a8e50 0x7efdfc144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.530+0000 7efe01800700 1 -- 172.21.15.49:0/3854797855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdfc0a8e50 msgr2=0x7efdfc144690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.530+0000 7efe01800700 1 --2- 172.21.15.49:0/3854797855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdfc0a8e50 0x7efdfc144690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.530+0000 7efe01800700 1 -- 172.21.15.49:0/3854797855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc155d20 msgr2=0x7efdfc066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.530+0000 7efe01800700 1 --2- 172.21.15.49:0/3854797855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc155d20 0x7efdfc066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.530+0000 7efe01800700 1 -- 172.21.15.49:0/3854797855 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec009370 con 0x7efdfc066070 2024-01-22T05:17:48.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.530+0000 7efe02200700 1 --2- 172.21.15.49:0/3854797855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc155d20 0x7efdfc066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:48.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.530+0000 7efe01800700 1 --2- 172.21.15.49:0/3854797855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdfc066070 0x7efdfc0a9a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7efdec014000 tx=0x7efdec017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:48.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.530+0000 7efdf8c00700 1 -- 172.21.15.49:0/3854797855 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec00bea0 con 0x7efdfc066070 2024-01-22T05:17:48.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.530+0000 7efdf8c00700 1 -- 172.21.15.49:0/3854797855 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec00b850 con 0x7efdfc066070 2024-01-22T05:17:48.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.530+0000 7efdf8c00700 1 -- 172.21.15.49:0/3854797855 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec01b660 con 0x7efdfc066070 2024-01-22T05:17:48.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.530+0000 7efe04200700 1 -- 172.21.15.49:0/3854797855 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc0aa830 con 0x7efdfc066070 2024-01-22T05:17:48.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.530+0000 7efe04200700 1 -- 172.21.15.49:0/3854797855 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc0a9f10 con 0x7efdfc066070 2024-01-22T05:17:48.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.530+0000 7efe04200700 1 -- 172.21.15.49:0/3854797855 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc047060 con 0x7efdfc066070 2024-01-22T05:17:48.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.534+0000 7efdf8c00700 1 -- 172.21.15.49:0/3854797855 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7efdec01b9d0 con 0x7efdfc066070 2024-01-22T05:17:48.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.534+0000 7efdf8c00700 1 --2- 172.21.15.49:0/3854797855 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efdd405a510 0x7efdd405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:48.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.534+0000 7efdf8c00700 1 -- 172.21.15.49:0/3854797855 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7efdec076020 con 0x7efdfc066070 2024-01-22T05:17:48.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.534+0000 7efe00e00700 1 --2- 172.21.15.49:0/3854797855 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efdd405a510 0x7efdd405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:48.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.534+0000 7efe00e00700 1 --2- 172.21.15.49:0/3854797855 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efdd405a510 0x7efdd405c9d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7efdfc148430 tx=0x7efde4007d30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:48.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.546+0000 7efdf8c00700 1 -- 172.21.15.49:0/3854797855 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efdec0496a0 con 0x7efdfc066070 2024-01-22T05:17:48.594 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-22T05:17:48.590+0000 7f2d12c00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:17:48.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.746+0000 7efe04200700 1 -- 172.21.15.49:0/3854797855 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdfc0c23c0 con 0x7efdfc066070 2024-01-22T05:17:48.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.746+0000 7efdf8c00700 1 -- 172.21.15.49:0/3854797855 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+4505 (secure 0 0 0) 0x7efdec04ccc0 con 0x7efdfc066070 2024-01-22T05:17:48.748 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:48.748 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":126,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3010799828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3010799828},{"type":"v1","addr":"172.21.15.110:6833","nonce":3010799828}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":7940,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2071707351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2071707351},{"type":"v1","addr":"172.21.15.110:6835","nonce":2071707351}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":9309,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3579312059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3579312059},{"type":"v1","addr":"172.21.15.49:6835","nonce":3579312059}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":126,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:17:43.087426+0000","modified":"2024-01-22T05:17:46.108388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9312":{"gid":9312,"name":"c","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3762397937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3762397937},{"type":"v1","addr":"172.21.15.49:6837","nonce":3762397937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2024-01-22T05:17:48.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.750+0000 7efe04200700 1 -- 172.21.15.49:0/3854797855 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efdd405a510 msgr2=0x7efdd405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.750+0000 7efe04200700 1 --2- 172.21.15.49:0/3854797855 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efdd405a510 0x7efdd405c9d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7efdfc148430 tx=0x7efde4007d30).stop 2024-01-22T05:17:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.750+0000 7efe04200700 1 -- 172.21.15.49:0/3854797855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdfc066070 msgr2=0x7efdfc0a9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.750+0000 7efe04200700 1 --2- 172.21.15.49:0/3854797855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdfc066070 0x7efdfc0a9a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7efdec014000 tx=0x7efdec017000).stop 2024-01-22T05:17:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.750+0000 7efe04200700 1 -- 172.21.15.49:0/3854797855 shutdown_connections 2024-01-22T05:17:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.750+0000 7efe04200700 1 --2- 172.21.15.49:0/3854797855 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efdd405a510 0x7efdd405c9d0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.750+0000 7efe04200700 1 --2- 172.21.15.49:0/3854797855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc155d20 0x7efdfc066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.750+0000 7efe04200700 1 --2- 172.21.15.49:0/3854797855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdfc0a8e50 0x7efdfc144690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.750+0000 7efe04200700 1 --2- 172.21.15.49:0/3854797855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdfc066070 0x7efdfc0a9a20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:48.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.750+0000 7efe04200700 1 -- 172.21.15.49:0/3854797855 >> 172.21.15.49:0/3854797855 conn(0x7efdfc0c6540 msgr2=0x7efdfc0c5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:48.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.750+0000 7efe04200700 1 -- 172.21.15.49:0/3854797855 shutdown_connections 2024-01-22T05:17:48.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:48.750+0000 7efe04200700 1 -- 172.21.15.49:0/3854797855 wait complete. 2024-01-22T05:17:48.755 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 126 2024-01-22T05:17:49.179 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 126, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:17:43.087426+0000', 'modified': '2024-01-22T05:17:46.108388+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9312}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9312': {'gid': 9312, 'name': 'c', 'rank': 0, 'incarnation': 122, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6837/3762397937', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6836', 'nonce': 3762397937}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 3762397937}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:17:49.180 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:17:49.180 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-22T05:17:49.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.358+0000 7f86bfc00700 1 Processor -- start 2024-01-22T05:17:49.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.358+0000 7f86bfc00700 1 -- start start 2024-01-22T05:17:49.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86bfc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86b8155d20 0x7f86b8065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86bfc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f86b8066070 0x7f86b80a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86bfc00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b80c1a40 con 0x7f86b80a8c30 2024-01-22T05:17:49.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86bfc00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b80a90c0 con 0x7f86b8155d20 2024-01-22T05:17:49.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86bfc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b8159310 con 0x7f86b8066070 2024-01-22T05:17:49.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86bd200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86b8155d20 0x7f86b8065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86bd200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f86b8155d20 0x7f86b8065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49124/0 (socket says 172.21.15.49:49124) 2024-01-22T05:17:49.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86bd200700 1 -- 172.21.15.49:0/125251906 learned_addr learned my addr 172.21.15.49:0/125251906 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:49.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86b7e00700 1 --2- 172.21.15.49:0/125251906 >> v2:172.21.15.110:3300/0 conn(0x7f86b8066070 0x7f86b80a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86bd200700 1 -- 172.21.15.49:0/125251906 >> v2:172.21.15.110:3300/0 conn(0x7f86b8066070 msgr2=0x7f86b80a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86bd200700 1 --2- 172.21.15.49:0/125251906 >> v2:172.21.15.110:3300/0 conn(0x7f86b8066070 0x7f86b80a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86bd200700 1 -- 172.21.15.49:0/125251906 >> v1:172.21.15.110:6789/0 conn(0x7f86b80a8c30 legacy=0x7f86b80c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86bd200700 1 -- 172.21.15.49:0/125251906 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b80c13f0 con 0x7f86b8155d20 2024-01-22T05:17:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86bd200700 1 --2- 172.21.15.49:0/125251906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86b8155d20 0x7f86b8065b80 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7f86b80c0ad0 tx=0x7f86a80090f0).ready entity=mon.0 client_cookie=5a8a76470691802 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86b7400700 1 -- 172.21.15.49:0/125251906 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a800b600 con 0x7f86b8155d20 2024-01-22T05:17:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86b7400700 1 -- 172.21.15.49:0/125251906 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a800b760 con 0x7f86b8155d20 2024-01-22T05:17:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.362+0000 7f86b7400700 1 -- 172.21.15.49:0/125251906 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a800bae0 con 0x7f86b8155d20 2024-01-22T05:17:49.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.366+0000 7f86bfc00700 1 -- 172.21.15.49:0/125251906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86b8155d20 msgr2=0x7f86b8065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.366+0000 7f86bfc00700 1 --2- 172.21.15.49:0/125251906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86b8155d20 0x7f86b8065b80 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7f86b80c0ad0 tx=0x7f86a80090f0).stop 2024-01-22T05:17:49.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.366+0000 7f86bfc00700 1 -- 172.21.15.49:0/125251906 shutdown_connections 2024-01-22T05:17:49.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.366+0000 7f86bfc00700 1 --2- 172.21.15.49:0/125251906 >> v2:172.21.15.110:3300/0 conn(0x7f86b8066070 0x7f86b80a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.366+0000 7f86bfc00700 1 --2- 172.21.15.49:0/125251906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86b8155d20 0x7f86b8065b80 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.366+0000 7f86bfc00700 1 -- 172.21.15.49:0/125251906 >> 172.21.15.49:0/125251906 conn(0x7f86b80c6540 msgr2=0x7f86b80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:49.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.366+0000 7f86bfc00700 1 -- 172.21.15.49:0/125251906 shutdown_connections 2024-01-22T05:17:49.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.366+0000 7f86bfc00700 1 -- 172.21.15.49:0/125251906 wait complete. 2024-01-22T05:17:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.370+0000 7f86bfc00700 1 Processor -- start 2024-01-22T05:17:49.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.370+0000 7f86bfc00700 1 -- start start 2024-01-22T05:17:49.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.370+0000 7f86bfc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86b8066070 0x7f86b816c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.370+0000 7f86bfc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86b80a8c30 0x7f86b8169840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.370+0000 7f86bfc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86b8155d20 0x7f86b8141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.370+0000 7f86bfc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8169d30 con 0x7f86b80a8c30 2024-01-22T05:17:49.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.370+0000 7f86bfc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8169f10 con 0x7f86b8066070 2024-01-22T05:17:49.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.370+0000 7f86bfc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b80bf100 con 0x7f86b8155d20 2024-01-22T05:17:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.370+0000 7f86b7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86b80a8c30 0x7f86b8169840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.370+0000 7f86b7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86b80a8c30 0x7f86b8169840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49140/0 (socket says 172.21.15.49:49140) 2024-01-22T05:17:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.370+0000 7f86b7e00700 1 -- 172.21.15.49:0/2170344486 learned_addr learned my addr 172.21.15.49:0/2170344486 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.370+0000 7f86bd200700 1 --2- 172.21.15.49:0/2170344486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86b8066070 0x7f86b816c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.370+0000 7f86bdc00700 1 --2- 172.21.15.49:0/2170344486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86b8155d20 0x7f86b8141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.370+0000 7f86b7e00700 1 -- 172.21.15.49:0/2170344486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86b8155d20 msgr2=0x7f86b8141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.370+0000 7f86b7e00700 1 --2- 172.21.15.49:0/2170344486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86b8155d20 0x7f86b8141ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.374+0000 7f86b7e00700 1 -- 172.21.15.49:0/2170344486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86b8066070 msgr2=0x7f86b816c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.374+0000 7f86b7e00700 1 --2- 172.21.15.49:0/2170344486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86b8066070 0x7f86b816c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.374+0000 7f86b7e00700 1 -- 172.21.15.49:0/2170344486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a8009370 con 0x7f86b80a8c30 2024-01-22T05:17:49.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.374+0000 7f86bdc00700 1 --2- 172.21.15.49:0/2170344486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86b8155d20 0x7f86b8141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:17:49.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.374+0000 7f86b7e00700 1 --2- 172.21.15.49:0/2170344486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86b80a8c30 0x7f86b8169840 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f86a000d890 tx=0x7f86a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:49.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.374+0000 7f86afe00700 1 -- 172.21.15.49:0/2170344486 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a00125f0 con 0x7f86b80a8c30 2024-01-22T05:17:49.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.374+0000 7f86afe00700 1 -- 172.21.15.49:0/2170344486 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a0012750 con 0x7f86b80a8c30 2024-01-22T05:17:49.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.374+0000 7f86bfc00700 1 -- 172.21.15.49:0/2170344486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b80bedf0 con 0x7f86b80a8c30 2024-01-22T05:17:49.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.374+0000 7f86afe00700 1 -- 172.21.15.49:0/2170344486 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a0012ad0 con 0x7f86b80a8c30 2024-01-22T05:17:49.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.374+0000 7f86bfc00700 1 -- 172.21.15.49:0/2170344486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b816ca60 con 0x7f86b80a8c30 2024-01-22T05:17:49.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.374+0000 7f86afe00700 1 -- 172.21.15.49:0/2170344486 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f86a0013480 con 0x7f86b80a8c30 2024-01-22T05:17:49.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.378+0000 7f86afe00700 1 --2- 172.21.15.49:0/2170344486 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f869005a510 0x7f869005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.378+0000 7f86afe00700 1 -- 172.21.15.49:0/2170344486 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f86a0074700 con 0x7f86b80a8c30 2024-01-22T05:17:49.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.378+0000 7f86bd200700 1 --2- 172.21.15.49:0/2170344486 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f869005a510 0x7f869005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.378+0000 7f86bd200700 1 --2- 172.21.15.49:0/2170344486 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f869005a510 0x7f869005c9d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f86a8009130 tx=0x7f86a8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:49.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.382+0000 7f86ca0cb740 1 Processor -- start 2024-01-22T05:17:49.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.382+0000 7f86ca0cb740 1 -- start start 2024-01-22T05:17:49.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.382+0000 7f86ca0cb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 0x1670d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.382+0000 7f86ca0cb740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x164be40 0x1647af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.382+0000 7f86ca0cb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x16453a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.382+0000 7f86ca0cb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x15cb410 con 0x168c780 2024-01-22T05:17:49.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.382+0000 7f86ca0cb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x15cb550 con 0x168c3a0 2024-01-22T05:17:49.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.382+0000 7f86ca0cb740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x15cba00 con 0x164be40 2024-01-22T05:17:49.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.382+0000 7f86bdc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x16453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.382+0000 7f86bdc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x16453a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49144/0 (socket says 172.21.15.49:49144) 2024-01-22T05:17:49.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.382+0000 7f86bdc00700 1 -- 172.21.15.49:0/3110580139 learned_addr learned my addr 172.21.15.49:0/3110580139 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:49.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.382+0000 7f86b7e00700 1 --2- 172.21.15.49:0/3110580139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x164be40 0x1647af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.382+0000 7f86bd200700 1 --2- 172.21.15.49:0/3110580139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 0x1670d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86bdc00700 1 -- 172.21.15.49:0/3110580139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x164be40 msgr2=0x1647af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:49.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86bdc00700 1 --2- 172.21.15.49:0/3110580139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x164be40 0x1647af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86bdc00700 1 -- 172.21.15.49:0/3110580139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 msgr2=0x1670d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:49.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86bdc00700 1 --2- 172.21.15.49:0/3110580139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 0x1670d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86bdc00700 1 -- 172.21.15.49:0/3110580139 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x15c4730 con 0x168c780 2024-01-22T05:17:49.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86bd200700 1 --2- 172.21.15.49:0/3110580139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 0x1670d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:49.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86bdc00700 1 --2- 172.21.15.49:0/3110580139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x16453a0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7f86b0001c00 tx=0x7f86b0009040).ready entity=mon.0 client_cookie=4754ab1072043409 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:49.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86acc00700 1 -- 172.21.15.49:0/3110580139 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b00020f0 con 0x168c780 2024-01-22T05:17:49.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86acc00700 1 -- 172.21.15.49:0/3110580139 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b000d7f0 con 0x168c780 2024-01-22T05:17:49.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86acc00700 1 -- 172.21.15.49:0/3110580139 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000db90 con 0x168c780 2024-01-22T05:17:49.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3110580139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 msgr2=0x16453a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/3110580139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x16453a0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7f86b0001c00 tx=0x7f86b0009040).stop 2024-01-22T05:17:49.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3110580139 shutdown_connections 2024-01-22T05:17:49.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/3110580139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x16453a0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/3110580139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x164be40 0x1647af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/3110580139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 0x1670d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3110580139 >> 172.21.15.49:0/3110580139 conn(0x1429550 msgr2=0x164b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:49.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3110580139 shutdown_connections 2024-01-22T05:17:49.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3110580139 wait complete. 2024-01-22T05:17:49.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.386+0000 7f86ca0cb740 1 -- start start 2024-01-22T05:17:49.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.390+0000 7f86ca0cb740 1 Processor -- start 2024-01-22T05:17:49.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.390+0000 7f86ca0cb740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x164be40 0x1676f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.390+0000 7f86ca0cb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 0x1675df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.390+0000 7f86ca0cb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x16762e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.390+0000 7f86ca0cb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1596650 con 0x168c780 2024-01-22T05:17:49.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.390+0000 7f86ca0cb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x16767d0 con 0x168c3a0 2024-01-22T05:17:49.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.390+0000 7f86ca0cb740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x168ae70 con 0x164be40 2024-01-22T05:17:49.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.390+0000 7f86ca0cb740 10 client.0 ll_register_callbacks cb 0x1603020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:17:49.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.390+0000 7f86bdc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x16762e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.390+0000 7f86bdc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x16762e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49152/0 (socket says 172.21.15.49:49152) 2024-01-22T05:17:49.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.390+0000 7f86bdc00700 1 -- 172.21.15.49:0/209859970 learned_addr learned my addr 172.21.15.49:0/209859970 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:49.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.390+0000 7f86bd200700 1 --2- 172.21.15.49:0/209859970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x164be40 0x1676f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.390+0000 7f86b7e00700 1 --2- 172.21.15.49:0/209859970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 0x1675df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86bdc00700 1 -- 172.21.15.49:0/209859970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x164be40 msgr2=0x1676f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:49.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86bdc00700 1 --2- 172.21.15.49:0/209859970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x164be40 0x1676f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86bdc00700 1 -- 172.21.15.49:0/209859970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 msgr2=0x1675df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:49.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86bdc00700 1 --2- 172.21.15.49:0/209859970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 0x1675df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86bdc00700 1 -- 172.21.15.49:0/209859970 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b80c1a40 con 0x168c780 2024-01-22T05:17:49.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86b7e00700 1 --2- 172.21.15.49:0/209859970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 0x1675df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:49.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86bdc00700 1 --2- 172.21.15.49:0/209859970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x16762e0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7f86b000d430 tx=0x7f86b0009040).ready entity=mon.0 client_cookie=6be0bec0b0955c0b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:49.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86a5600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:17:49.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86a5600700 1 -- 172.21.15.49:0/209859970 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0007c30 con 0x168c780 2024-01-22T05:17:49.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86a5600700 1 -- 172.21.15.49:0/209859970 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f86b0013800 con 0x168c780 2024-01-22T05:17:49.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86ca0cb740 1 -- 172.21.15.49:0/209859970 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x15c11a0 con 0x168c780 2024-01-22T05:17:49.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86a5600700 1 -- 172.21.15.49:0/209859970 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86b0013bd0 con 0x168c780 2024-01-22T05:17:49.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86ca0cb740 10 client.9462 fetch_fsmap learned FSMap version 126 2024-01-22T05:17:49.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86ca0cb740 1 -- 172.21.15.49:0/209859970 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=126,monmap=2+}) v3 -- 0x15bf960 con 0x168c780 2024-01-22T05:17:49.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86a5600700 1 -- 172.21.15.49:0/209859970 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x15c11a0 con 0x168c780 2024-01-22T05:17:49.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86a5600700 1 -- 172.21.15.49:0/209859970 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 126) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f86b0027350 con 0x168c780 2024-01-22T05:17:49.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86ca0cb740 10 client.9462 fetch_fsmap finished waiting for FSMap version 126 2024-01-22T05:17:49.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86ca0cb740 10 client.9462 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-22T05:17:49.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86ca0cb740 20 client.9462 populate_metadata read hostname 'smithi049' 2024-01-22T05:17:49.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/209859970 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x168a880 0x16452f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86ca0cb740 4 client.9462 mds_command: new command op to 9312 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:17:49.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86ca0cb740 1 -- 172.21.15.49:0/209859970 --> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x15b76f0 con 0x168a880 2024-01-22T05:17:49.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.394+0000 7f86bd200700 1 --2- 172.21.15.49:0/209859970 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x168a880 0x16452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86bd200700 1 --2- 172.21.15.49:0/209859970 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x168a880 0x16452f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=43e9fb17dd20e78d server_cookie=7e264b010f753c94 in_seq=0 out_seq=0 2024-01-22T05:17:49.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86a5600700 10 client.9462 ms_handle_connect on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:49.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86a5600700 1 -- 172.21.15.49:0/209859970 <== mds.0 v2:172.21.15.49:6836/3762397937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x15b76f0 con 0x168a880 2024-01-22T05:17:49.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86a5600700 10 client.9462 handle_command_reply: tid=0 2024-01-22T05:17:49.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86ca0cb740 1 client.9462 shutdown 2024-01-22T05:17:49.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86ca0cb740 1 -- 172.21.15.49:0/209859970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 msgr2=0x16762e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/209859970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x16762e0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7f86b000d430 tx=0x7f86b0009040).stop 2024-01-22T05:17:49.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86ca0cb740 1 -- 172.21.15.49:0/209859970 shutdown_connections 2024-01-22T05:17:49.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/209859970 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x168a880 0x16452f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/209859970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x16762e0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/209859970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 0x1675df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/209859970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x164be40 0x1676f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86a5600700 0 client.9462 ms_handle_reset on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:49.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86ca0cb740 1 -- 172.21.15.49:0/209859970 >> 172.21.15.49:0/209859970 conn(0x1429550 msgr2=0x164a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:49.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86ca0cb740 1 -- 172.21.15.49:0/209859970 shutdown_connections 2024-01-22T05:17:49.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.398+0000 7f86ca0cb740 1 -- 172.21.15.49:0/209859970 wait complete. 2024-01-22T05:17:49.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.402+0000 7f86ca0cb740 20 client.9462 trim_cache size 0 max 16384 2024-01-22T05:17:49.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86ca0cb740 1 Processor -- start 2024-01-22T05:17:49.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86ca0cb740 1 -- start start 2024-01-22T05:17:49.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86ca0cb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x164be40 0x168b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86ca0cb740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x168c3a0 0x16452f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86ca0cb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x166e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86ca0cb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x16714f0 con 0x168c780 2024-01-22T05:17:49.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86ca0cb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1646760 con 0x164be40 2024-01-22T05:17:49.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86ca0cb740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1649720 con 0x168c3a0 2024-01-22T05:17:49.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86bdc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x166e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86b7e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x168c3a0 0x16452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86bdc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x166e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49162/0 (socket says 172.21.15.49:49162) 2024-01-22T05:17:49.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86bdc00700 1 -- 172.21.15.49:0/3204227468 learned_addr learned my addr 172.21.15.49:0/3204227468 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:49.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86bd200700 1 --2- 172.21.15.49:0/3204227468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x164be40 0x168b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86bdc00700 1 -- 172.21.15.49:0/3204227468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x168c3a0 msgr2=0x16452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:49.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86bdc00700 1 --2- 172.21.15.49:0/3204227468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x168c3a0 0x16452f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86bdc00700 1 -- 172.21.15.49:0/3204227468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x164be40 msgr2=0x168b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:49.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86bdc00700 1 --2- 172.21.15.49:0/3204227468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x164be40 0x168b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86bdc00700 1 -- 172.21.15.49:0/3204227468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b816cfa0 con 0x168c780 2024-01-22T05:17:49.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.422+0000 7f86bdc00700 1 --2- 172.21.15.49:0/3204227468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x166e400 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7f86b000d430 tx=0x7f86b001f000).ready entity=mon.0 client_cookie=1f5d2925bcfcb8cf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:49.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.426+0000 7f86ad600700 1 -- 172.21.15.49:0/3204227468 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0013800 con 0x168c780 2024-01-22T05:17:49.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.426+0000 7f86ad600700 1 -- 172.21.15.49:0/3204227468 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b0007bd0 con 0x168c780 2024-01-22T05:17:49.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.426+0000 7f86ad600700 1 -- 172.21.15.49:0/3204227468 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0027350 con 0x168c780 2024-01-22T05:17:49.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.426+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3204227468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 msgr2=0x166e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.426+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/3204227468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x166e400 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7f86b000d430 tx=0x7f86b001f000).stop 2024-01-22T05:17:49.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.426+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3204227468 shutdown_connections 2024-01-22T05:17:49.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.426+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/3204227468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x168c780 0x166e400 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.426+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/3204227468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x168c3a0 0x16452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.426+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/3204227468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x164be40 0x168b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.426+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3204227468 >> 172.21.15.49:0/3204227468 conn(0x1429550 msgr2=0x164a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:49.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.426+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3204227468 shutdown_connections 2024-01-22T05:17:49.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.426+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3204227468 wait complete. 2024-01-22T05:17:49.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.426+0000 7f86ca0cb740 1 -- start start 2024-01-22T05:17:49.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.430+0000 7f86ca0cb740 1 Processor -- start 2024-01-22T05:17:49.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.430+0000 7f86ca0cb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x164be40 0x166e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.430+0000 7f86ca0cb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 0x1648070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.430+0000 7f86ca0cb740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x168c780 0x1648560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.430+0000 7f86ca0cb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x16edfd0 con 0x164be40 2024-01-22T05:17:49.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.430+0000 7f86ca0cb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1649180 con 0x168c3a0 2024-01-22T05:17:49.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.430+0000 7f86ca0cb740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x16eb630 con 0x168c780 2024-01-22T05:17:49.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.430+0000 7f86ca0cb740 10 client.0 ll_register_callbacks cb 0x7f86b0001870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:17:49.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.430+0000 7f86bd200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x164be40 0x166e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.430+0000 7f86bd200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x164be40 0x166e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49178/0 (socket says 172.21.15.49:49178) 2024-01-22T05:17:49.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.430+0000 7f86bd200700 1 -- 172.21.15.49:0/3086318829 learned_addr learned my addr 172.21.15.49:0/3086318829 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:49.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86bdc00700 1 --2- 172.21.15.49:0/3086318829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x168c780 0x1648560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86b7e00700 1 --2- 172.21.15.49:0/3086318829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 0x1648070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86bd200700 1 -- 172.21.15.49:0/3086318829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x168c780 msgr2=0x1648560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:49.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86bd200700 1 --2- 172.21.15.49:0/3086318829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x168c780 0x1648560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86bd200700 1 -- 172.21.15.49:0/3086318829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 msgr2=0x1648070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:49.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86bd200700 1 --2- 172.21.15.49:0/3086318829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 0x1648070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86bd200700 1 -- 172.21.15.49:0/3086318829 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x15bf960 con 0x164be40 2024-01-22T05:17:49.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86bdc00700 1 --2- 172.21.15.49:0/3086318829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x168c780 0x1648560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:49.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86bd200700 1 --2- 172.21.15.49:0/3086318829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x164be40 0x166e7c0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f86a8006fd0 tx=0x7f86a801e040).ready entity=mon.0 client_cookie=b8e5436543c536b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:49.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86a5600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:17:49.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86a5600700 1 -- 172.21.15.49:0/3086318829 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a802c040 con 0x164be40 2024-01-22T05:17:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3086318829 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86b000d7f0 con 0x164be40 2024-01-22T05:17:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86a5600700 1 -- 172.21.15.49:0/3086318829 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f86a8031a70 con 0x164be40 2024-01-22T05:17:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86a5600700 1 -- 172.21.15.49:0/3086318829 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86a8031e40 con 0x164be40 2024-01-22T05:17:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86ca0cb740 10 client.9468 fetch_fsmap learned FSMap version 126 2024-01-22T05:17:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3086318829 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=126,monmap=2+}) v3 -- 0x15bf6b0 con 0x164be40 2024-01-22T05:17:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86a5600700 1 -- 172.21.15.49:0/3086318829 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b000d7f0 con 0x164be40 2024-01-22T05:17:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86a5600700 1 -- 172.21.15.49:0/3086318829 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 126) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f86a8038280 con 0x164be40 2024-01-22T05:17:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86ca0cb740 10 client.9468 fetch_fsmap finished waiting for FSMap version 126 2024-01-22T05:17:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86ca0cb740 10 client.9468 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-22T05:17:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86ca0cb740 20 client.9468 populate_metadata read hostname 'smithi049' 2024-01-22T05:17:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/3086318829 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x168e030 0x168e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86ca0cb740 4 client.9468 mds_command: new command op to 9312 tid=0[{"prefix": "status"}] 2024-01-22T05:17:49.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3086318829 --> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] -- command(tid 0: {"prefix": "status"}) v1 -- 0x14804e0 con 0x168e030 2024-01-22T05:17:49.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.434+0000 7f86b7e00700 1 --2- 172.21.15.49:0/3086318829 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x168e030 0x168e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86a5600700 10 client.9468 ms_handle_connect on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:49.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86b7e00700 1 --2- 172.21.15.49:0/3086318829 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x168e030 0x168e410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ce8f35b7fde6138e server_cookie=de0b4b5f76d91c5b in_seq=0 out_seq=0 2024-01-22T05:17:49.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86a5600700 1 -- 172.21.15.49:0/3086318829 <== mds.0 v2:172.21.15.49:6836/3762397937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x14804e0 con 0x168e030 2024-01-22T05:17:49.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86a5600700 10 client.9468 handle_command_reply: tid=0 2024-01-22T05:17:49.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86ca0cb740 1 client.9468 shutdown 2024-01-22T05:17:49.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3086318829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x164be40 msgr2=0x166e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/3086318829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x164be40 0x166e7c0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f86a8006fd0 tx=0x7f86a801e040).stop 2024-01-22T05:17:49.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3086318829 shutdown_connections 2024-01-22T05:17:49.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/3086318829 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x168e030 0x168e410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/3086318829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x168c780 0x1648560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86a5600700 0 client.9468 ms_handle_reset on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:49.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/3086318829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x168c3a0 0x1648070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86ca0cb740 1 --2- 172.21.15.49:0/3086318829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x164be40 0x166e7c0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3086318829 >> 172.21.15.49:0/3086318829 conn(0x1429550 msgr2=0x1675a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:49.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3086318829 shutdown_connections 2024-01-22T05:17:49.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86ca0cb740 1 -- 172.21.15.49:0/3086318829 wait complete. 2024-01-22T05:17:49.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.438+0000 7f86ca0cb740 20 client.9468 trim_cache size 0 max 16384 2024-01-22T05:17:49.442 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:17:49.442 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:17:49.442 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:17:49.442 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 9312, 2024-01-22T05:17:49.442 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:17:49.442 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:17:49.442 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:17:49.442 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 6.3484287950000002, 2024-01-22T05:17:49.442 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 126, 2024-01-22T05:17:49.442 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 159, 2024-01-22T05:17:49.443 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 159, 2024-01-22T05:17:49.443 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 11.767787602 2024-01-22T05:17:49.443 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:17:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.442+0000 7f86bfc00700 1 -- 172.21.15.49:0/2170344486 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f869005a510 msgr2=0x7f869005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.442+0000 7f86bfc00700 1 --2- 172.21.15.49:0/2170344486 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f869005a510 0x7f869005c9d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f86a8009130 tx=0x7f86a8017000).stop 2024-01-22T05:17:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.442+0000 7f86bfc00700 1 -- 172.21.15.49:0/2170344486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86b80a8c30 msgr2=0x7f86b8169840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.442+0000 7f86bfc00700 1 --2- 172.21.15.49:0/2170344486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86b80a8c30 0x7f86b8169840 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f86a000d890 tx=0x7f86a0008040).stop 2024-01-22T05:17:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.442+0000 7f86bfc00700 1 -- 172.21.15.49:0/2170344486 shutdown_connections 2024-01-22T05:17:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.442+0000 7f86bfc00700 1 --2- 172.21.15.49:0/2170344486 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f869005a510 0x7f869005c9d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.442+0000 7f86bfc00700 1 --2- 172.21.15.49:0/2170344486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86b8155d20 0x7f86b8141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.442+0000 7f86bfc00700 1 --2- 172.21.15.49:0/2170344486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86b80a8c30 0x7f86b8169840 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.442+0000 7f86bfc00700 1 --2- 172.21.15.49:0/2170344486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86b8066070 0x7f86b816c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.442+0000 7f86bfc00700 1 -- 172.21.15.49:0/2170344486 >> 172.21.15.49:0/2170344486 conn(0x7f86b80c6540 msgr2=0x7f86b8158680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.442+0000 7f86bfc00700 1 -- 172.21.15.49:0/2170344486 shutdown_connections 2024-01-22T05:17:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.442+0000 7f86bfc00700 1 -- 172.21.15.49:0/2170344486 wait complete. 2024-01-22T05:17:49.466 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:17:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.594+0000 7f45fb600700 1 Processor -- start 2024-01-22T05:17:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.598+0000 7f45fb600700 1 -- start start 2024-01-22T05:17:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.598+0000 7f45fb600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f45f40c3830 0x7f45f40c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.598+0000 7f45fb600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45f4155550 0x7f45f41559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.598+0000 7f45fb600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f40674a0 con 0x7f45f4151fb0 2024-01-22T05:17:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.598+0000 7f45fb600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f4155ea0 con 0x7f45f4155550 2024-01-22T05:17:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.598+0000 7f45fb600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f4066890 con 0x7f45f40c3830 2024-01-22T05:17:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.598+0000 7f45f3e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45f4155550 0x7f45f41559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.598+0000 7f45f3e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45f4155550 0x7f45f41559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49182/0 (socket says 172.21.15.49:49182) 2024-01-22T05:17:49.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.598+0000 7f45f3e00700 1 -- 172.21.15.49:0/3372652176 learned_addr learned my addr 172.21.15.49:0/3372652176 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:49.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.598+0000 7f45f8c00700 1 --2- 172.21.15.49:0/3372652176 >> v2:172.21.15.110:3300/0 conn(0x7f45f40c3830 0x7f45f40c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.598+0000 7f45f9600700 1 --1- 172.21.15.49:0/3372652176 >> v1:172.21.15.110:6789/0 conn(0x7f45f4151fb0 0x7f45f4152400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:35934/0 (socket says 172.21.15.49:35934) 2024-01-22T05:17:49.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45f3e00700 1 -- 172.21.15.49:0/3372652176 >> v2:172.21.15.110:3300/0 conn(0x7f45f40c3830 msgr2=0x7f45f40c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45f3e00700 1 --2- 172.21.15.49:0/3372652176 >> v2:172.21.15.110:3300/0 conn(0x7f45f40c3830 0x7f45f40c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45f3e00700 1 -- 172.21.15.49:0/3372652176 >> v1:172.21.15.110:6789/0 conn(0x7f45f4151fb0 legacy=0x7f45f4152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45f3e00700 1 -- 172.21.15.49:0/3372652176 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4066b70 con 0x7f45f4155550 2024-01-22T05:17:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45f3e00700 1 --2- 172.21.15.49:0/3372652176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f4155550 0x7f45f41559b0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7f45f406a2f0 tx=0x7f45dc0090f0).ready entity=mon.0 client_cookie=e5c7fd86c28eda36 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:49.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45f3400700 1 -- 172.21.15.49:0/3372652176 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc00b520 con 0x7f45f4155550 2024-01-22T05:17:49.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45f3400700 1 -- 172.21.15.49:0/3372652176 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc00b680 con 0x7f45f4155550 2024-01-22T05:17:49.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45f3400700 1 -- 172.21.15.49:0/3372652176 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc00ba00 con 0x7f45f4155550 2024-01-22T05:17:49.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45fb600700 1 -- 172.21.15.49:0/3372652176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f4155550 msgr2=0x7f45f41559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45fb600700 1 --2- 172.21.15.49:0/3372652176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f4155550 0x7f45f41559b0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7f45f406a2f0 tx=0x7f45dc0090f0).stop 2024-01-22T05:17:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45fb600700 1 -- 172.21.15.49:0/3372652176 shutdown_connections 2024-01-22T05:17:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45fb600700 1 --2- 172.21.15.49:0/3372652176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f4155550 0x7f45f41559b0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45fb600700 1 --2- 172.21.15.49:0/3372652176 >> v2:172.21.15.110:3300/0 conn(0x7f45f40c3830 0x7f45f40c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45fb600700 1 -- 172.21.15.49:0/3372652176 >> 172.21.15.49:0/3372652176 conn(0x7f45f40c52c0 msgr2=0x7f45f40c56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45fb600700 1 -- 172.21.15.49:0/3372652176 shutdown_connections 2024-01-22T05:17:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.602+0000 7f45fb600700 1 -- 172.21.15.49:0/3372652176 wait complete. 2024-01-22T05:17:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.606+0000 7f45fb600700 1 Processor -- start 2024-01-22T05:17:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.606+0000 7f45fb600700 1 -- start start 2024-01-22T05:17:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.606+0000 7f45fb600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f40c3830 0x7f45f4151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.606+0000 7f45fb600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45f4151fb0 0x7f45f4064350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.606+0000 7f45fb600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f4155550 0x7f45f4156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.606+0000 7f45fb600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40659b0 con 0x7f45f4155550 2024-01-22T05:17:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.606+0000 7f45fb600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4064da0 con 0x7f45f4151fb0 2024-01-22T05:17:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.606+0000 7f45fb600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4065080 con 0x7f45f40c3830 2024-01-22T05:17:49.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45f9600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f4155550 0x7f45f4156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45f8c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f40c3830 0x7f45f4151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45f9600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f4155550 0x7f45f4156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49190/0 (socket says 172.21.15.49:49190) 2024-01-22T05:17:49.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45f9600700 1 -- 172.21.15.49:0/3408162352 learned_addr learned my addr 172.21.15.49:0/3408162352 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:49.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45f3e00700 1 --2- 172.21.15.49:0/3408162352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45f4151fb0 0x7f45f4064350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45f9600700 1 -- 172.21.15.49:0/3408162352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f40c3830 msgr2=0x7f45f4151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45f9600700 1 --2- 172.21.15.49:0/3408162352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f40c3830 0x7f45f4151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45f9600700 1 -- 172.21.15.49:0/3408162352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45f4151fb0 msgr2=0x7f45f4064350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45f9600700 1 --2- 172.21.15.49:0/3408162352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45f4151fb0 0x7f45f4064350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45f9600700 1 -- 172.21.15.49:0/3408162352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc009370 con 0x7f45f4155550 2024-01-22T05:17:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45f9600700 1 --2- 172.21.15.49:0/3408162352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f4155550 0x7f45f4156f10 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f45ec00c790 tx=0x7f45ec0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45ebe00700 1 -- 172.21.15.49:0/3408162352 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec005c70 con 0x7f45f4155550 2024-01-22T05:17:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45ebe00700 1 -- 172.21.15.49:0/3408162352 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec005dd0 con 0x7f45f4155550 2024-01-22T05:17:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45fb600700 1 -- 172.21.15.49:0/3408162352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f4065360 con 0x7f45f4155550 2024-01-22T05:17:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45ebe00700 1 -- 172.21.15.49:0/3408162352 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec007320 con 0x7f45f4155550 2024-01-22T05:17:49.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.610+0000 7f45fb600700 1 -- 172.21.15.49:0/3408162352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f40a74c0 con 0x7f45f4155550 2024-01-22T05:17:49.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.614+0000 7f45fb600700 1 -- 172.21.15.49:0/3408162352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f4069990 con 0x7f45f4155550 2024-01-22T05:17:49.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.614+0000 7f45ebe00700 1 -- 172.21.15.49:0/3408162352 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f45ec0076d0 con 0x7f45f4155550 2024-01-22T05:17:49.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.614+0000 7f45ebe00700 1 --2- 172.21.15.49:0/3408162352 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45cc05a540 0x7f45cc05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:49.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.618+0000 7f45ebe00700 1 -- 172.21.15.49:0/3408162352 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f45ec074890 con 0x7f45f4155550 2024-01-22T05:17:49.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.618+0000 7f45f8c00700 1 --2- 172.21.15.49:0/3408162352 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45cc05a540 0x7f45cc05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:49.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.618+0000 7f45f8c00700 1 --2- 172.21.15.49:0/3408162352 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45cc05a540 0x7f45cc05ca00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f45e4009c30 tx=0x7f45e4009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:49.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.622+0000 7f45ebe00700 1 -- 172.21.15.49:0/3408162352 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f45ec047e50 con 0x7f45f4155550 2024-01-22T05:17:49.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.822+0000 7f45fb600700 1 -- 172.21.15.49:0/3408162352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f45f40c0890 con 0x7f45f4155550 2024-01-22T05:17:49.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.822+0000 7f45ebe00700 1 -- 172.21.15.49:0/3408162352 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v126) v1 ==== 53+0+73 (secure 0 0 0) 0x7f45ec04b470 con 0x7f45f4155550 2024-01-22T05:17:49.826 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:17:49.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.826+0000 7f45fb600700 1 -- 172.21.15.49:0/3408162352 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45cc05a540 msgr2=0x7f45cc05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.826+0000 7f45fb600700 1 --2- 172.21.15.49:0/3408162352 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45cc05a540 0x7f45cc05ca00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f45e4009c30 tx=0x7f45e4009060).stop 2024-01-22T05:17:49.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.826+0000 7f45fb600700 1 -- 172.21.15.49:0/3408162352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f4155550 msgr2=0x7f45f4156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:49.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.826+0000 7f45fb600700 1 --2- 172.21.15.49:0/3408162352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f4155550 0x7f45f4156f10 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f45ec00c790 tx=0x7f45ec0015e0).stop 2024-01-22T05:17:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.826+0000 7f45fb600700 1 -- 172.21.15.49:0/3408162352 shutdown_connections 2024-01-22T05:17:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.826+0000 7f45fb600700 1 --2- 172.21.15.49:0/3408162352 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45cc05a540 0x7f45cc05ca00 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.826+0000 7f45fb600700 1 --2- 172.21.15.49:0/3408162352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45f4155550 0x7f45f4156f10 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.826+0000 7f45fb600700 1 --2- 172.21.15.49:0/3408162352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45f4151fb0 0x7f45f4064350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.826+0000 7f45fb600700 1 --2- 172.21.15.49:0/3408162352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45f40c3830 0x7f45f4151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:49.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.826+0000 7f45fb600700 1 -- 172.21.15.49:0/3408162352 >> 172.21.15.49:0/3408162352 conn(0x7f45f40c52c0 msgr2=0x7f45f40c7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:49.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.826+0000 7f45fb600700 1 -- 172.21.15.49:0/3408162352 shutdown_connections 2024-01-22T05:17:49.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:49.826+0000 7f45fb600700 1 -- 172.21.15.49:0/3408162352 wait complete. 2024-01-22T05:17:49.851 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-22T05:17:49.851 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:17:49.851 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:17:49.851 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:17:49.851 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:17:49.851 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-22T05:17:49.851 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-22T05:17:49.851 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:17:49.851 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:17:49.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:17:49.851 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:17:49.867 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:17:49.867 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:17:49.867 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:17:49.867 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:17:49.867 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:17:49.867 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:17:49.867 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:17:49.867 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:17:49.867 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:17:49.867 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:17:49.868 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:17:49.868 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:17:49.868 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:17:49.868 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41701sec preferred_lft 41701sec 2024-01-22T05:17:49.868 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:17:49.868 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:17:49.868 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:17:49.868 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:17:49.868 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:17:49.868 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:17:49.868 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:17:49.868 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:17:49.868 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:17:49.868 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:17:49.869 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:17:49.869 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:17:49.869 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:17:49.869 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:17:49.869 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:17:49.869 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:17:49.869 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::7ce7:e3ff:fed1:1e88/64 scope link 2024-01-22T05:17:49.869 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:17:49.869 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:17:49.869 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 82:c1:48:e7:c7:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:17:49.869 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::80c1:48ff:fee7:c731/64 scope link 2024-01-22T05:17:49.869 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:17:49.869 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:17:49.869 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:17:49.869 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3426:32ff:feee:c4c9/64 scope link 2024-01-22T05:17:49.870 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:17:49.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:17:49.871 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:17:49.947 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:17:49.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:17:49.950 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:17:50.017 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:17:50.017 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:17:50.017 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:17:50.017 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:17:50.018 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:17:50.018 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:17:50.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:17:50.018 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:17:50.018 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:17:50.018 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:17:50.018 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:17:50.018 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:17:50.018 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:17:50.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:17:50.148 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:17:50.161 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:17:50.161 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:17:50.162 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:17:50.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:17:50.162 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-22T05:17:50.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:17:50.240 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-22T05:17:50.299 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:17:50.299 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:17:50.416 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:17:50.417 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:17:50.440 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:17:50.440 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:17:50.447 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:17:50.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:17:50.447 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:17:50.478 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.10:0 damage ls 2024-01-22T05:17:50.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.694+0000 7fc972e00700 1 Processor -- start 2024-01-22T05:17:50.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.694+0000 7fc972e00700 1 -- start start 2024-01-22T05:17:50.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc972e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc96c1524f0 0x7fc96c066400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc972e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c15bad0 0x7fc96c15bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc972e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc96c0a8760 0x7fc96c0a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc972e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c0bd3e0 con 0x7fc96c0a8760 2024-01-22T05:17:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc972e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c067c50 con 0x7fc96c1524f0 2024-01-22T05:17:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc972e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c15c440 con 0x7fc96c15bad0 2024-01-22T05:17:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc970e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc96c0a8760 0x7fc96c0a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc96b400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c15bad0 0x7fc96c15bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc96be00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc96c1524f0 0x7fc96c066400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc970e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc96c0a8760 0x7fc96c0a8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49198/0 (socket says 172.21.15.49:49198) 2024-01-22T05:17:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc970e00700 1 -- 172.21.15.49:0/3799687649 learned_addr learned my addr 172.21.15.49:0/3799687649 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc970e00700 1 -- 172.21.15.49:0/3799687649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c15bad0 msgr2=0x7fc96c15bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc970e00700 1 --2- 172.21.15.49:0/3799687649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c15bad0 0x7fc96c15bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc970e00700 1 -- 172.21.15.49:0/3799687649 >> v2:172.21.15.110:3300/0 conn(0x7fc96c1524f0 msgr2=0x7fc96c066400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc970e00700 1 --2- 172.21.15.49:0/3799687649 >> v2:172.21.15.110:3300/0 conn(0x7fc96c1524f0 0x7fc96c066400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc970e00700 1 -- 172.21.15.49:0/3799687649 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c0bcb40 con 0x7fc96c0a8760 2024-01-22T05:17:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc96b400700 1 --2- 172.21.15.49:0/3799687649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c15bad0 0x7fc96c15bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:50.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc970e00700 1 --2- 172.21.15.49:0/3799687649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc96c0a8760 0x7fc96c0a8bf0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7fc96c0c4050 tx=0x7fc964009840).ready entity=mon.0 client_cookie=52f5dc904af10ef7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:50.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc96aa00700 1 -- 172.21.15.49:0/3799687649 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400e070 con 0x7fc96c0a8760 2024-01-22T05:17:50.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc96aa00700 1 -- 172.21.15.49:0/3799687649 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96400b970 con 0x7fc96c0a8760 2024-01-22T05:17:50.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.698+0000 7fc96aa00700 1 -- 172.21.15.49:0/3799687649 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400bcf0 con 0x7fc96c0a8760 2024-01-22T05:17:50.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.702+0000 7fc972e00700 1 -- 172.21.15.49:0/3799687649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc96c0a8760 msgr2=0x7fc96c0a8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:50.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.702+0000 7fc972e00700 1 --2- 172.21.15.49:0/3799687649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc96c0a8760 0x7fc96c0a8bf0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7fc96c0c4050 tx=0x7fc964009840).stop 2024-01-22T05:17:50.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.702+0000 7fc972e00700 1 -- 172.21.15.49:0/3799687649 shutdown_connections 2024-01-22T05:17:50.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.702+0000 7fc972e00700 1 --2- 172.21.15.49:0/3799687649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc96c0a8760 0x7fc96c0a8bf0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.702+0000 7fc972e00700 1 --2- 172.21.15.49:0/3799687649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c15bad0 0x7fc96c15bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.702+0000 7fc972e00700 1 --2- 172.21.15.49:0/3799687649 >> v2:172.21.15.110:3300/0 conn(0x7fc96c1524f0 0x7fc96c066400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.702+0000 7fc972e00700 1 -- 172.21.15.49:0/3799687649 >> 172.21.15.49:0/3799687649 conn(0x7fc96c0c6560 msgr2=0x7fc96c0c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:50.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.702+0000 7fc972e00700 1 -- 172.21.15.49:0/3799687649 shutdown_connections 2024-01-22T05:17:50.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.702+0000 7fc972e00700 1 -- 172.21.15.49:0/3799687649 wait complete. 2024-01-22T05:17:50.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.706+0000 7fc972e00700 1 Processor -- start 2024-01-22T05:17:50.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.706+0000 7fc972e00700 1 -- start start 2024-01-22T05:17:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.706+0000 7fc972e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c0a8760 0x7fc96c13c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.706+0000 7fc972e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c1524f0 0x7fc96c15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.706+0000 7fc972e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc96c15bad0 0x7fc96c15c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.706+0000 7fc972e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c14fe00 con 0x7fc96c15bad0 2024-01-22T05:17:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.706+0000 7fc972e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c13cb80 con 0x7fc96c1524f0 2024-01-22T05:17:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.706+0000 7fc972e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c13ce60 con 0x7fc96c0a8760 2024-01-22T05:17:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.706+0000 7fc970e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc96c15bad0 0x7fc96c15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.706+0000 7fc96b400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c1524f0 0x7fc96c15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.706+0000 7fc96b400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c1524f0 0x7fc96c15d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:39368/0 (socket says 172.21.15.49:39368) 2024-01-22T05:17:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.706+0000 7fc96b400700 1 -- 172.21.15.49:0/372477116 learned_addr learned my addr 172.21.15.49:0/372477116 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.706+0000 7fc96be00700 1 --2- 172.21.15.49:0/372477116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c0a8760 0x7fc96c13c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.710+0000 7fc96b400700 1 -- 172.21.15.49:0/372477116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c0a8760 msgr2=0x7fc96c13c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:50.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.710+0000 7fc96b400700 1 --2- 172.21.15.49:0/372477116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c0a8760 0x7fc96c13c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.710+0000 7fc96b400700 1 -- 172.21.15.49:0/372477116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc96c15bad0 msgr2=0x7fc96c15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:50.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.710+0000 7fc96b400700 1 --2- 172.21.15.49:0/372477116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc96c15bad0 0x7fc96c15c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.710+0000 7fc96b400700 1 -- 172.21.15.49:0/372477116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9540092a0 con 0x7fc96c1524f0 2024-01-22T05:17:50.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.710+0000 7fc96b400700 1 --2- 172.21.15.49:0/372477116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c1524f0 0x7fc96c15d9b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fc95400e980 tx=0x7fc954009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:50.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.710+0000 7fc963400700 1 -- 172.21.15.49:0/372477116 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954012600 con 0x7fc96c1524f0 2024-01-22T05:17:50.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.710+0000 7fc963400700 1 -- 172.21.15.49:0/372477116 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc954012760 con 0x7fc96c1524f0 2024-01-22T05:17:50.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.710+0000 7fc963400700 1 -- 172.21.15.49:0/372477116 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954012ae0 con 0x7fc96c1524f0 2024-01-22T05:17:50.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.710+0000 7fc972e00700 1 -- 172.21.15.49:0/372477116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc964009ae0 con 0x7fc96c1524f0 2024-01-22T05:17:50.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.710+0000 7fc972e00700 1 -- 172.21.15.49:0/372477116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c13d420 con 0x7fc96c1524f0 2024-01-22T05:17:50.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.714+0000 7fc963400700 1 -- 172.21.15.49:0/372477116 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc95401b400 con 0x7fc96c1524f0 2024-01-22T05:17:50.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.714+0000 7fc963400700 1 --2- 172.21.15.49:0/372477116 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc94405a510 0x7fc94405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.714+0000 7fc963400700 1 -- 172.21.15.49:0/372477116 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc954074d60 con 0x7fc96c1524f0 2024-01-22T05:17:50.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.714+0000 7fc96be00700 1 --2- 172.21.15.49:0/372477116 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc94405a510 0x7fc94405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.714+0000 7fc96be00700 1 --2- 172.21.15.49:0/372477116 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc94405a510 0x7fc94405c9d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fc95c009c30 tx=0x7fc95c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:50.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc97d207740 1 Processor -- start 2024-01-22T05:17:50.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc97d207740 1 -- start start 2024-01-22T05:17:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc97d207740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fe86a0 0x1fe8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc97d207740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fed7b0 0x1fa17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc97d207740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1fa38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc97d207740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ee1340 con 0x1fccd60 2024-01-22T05:17:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc97d207740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f044e0 con 0x1fed7b0 2024-01-22T05:17:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc97d207740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ecdce0 con 0x1fe86a0 2024-01-22T05:17:50.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc970e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1fa38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc970e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1fa38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49226/0 (socket says 172.21.15.49:49226) 2024-01-22T05:17:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc970e00700 1 -- 172.21.15.49:0/269327084 learned_addr learned my addr 172.21.15.49:0/269327084 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc96b400700 1 --2- 172.21.15.49:0/269327084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fed7b0 0x1fa17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc96be00700 1 --2- 172.21.15.49:0/269327084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fe86a0 0x1fe8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc970e00700 1 -- 172.21.15.49:0/269327084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fe86a0 msgr2=0x1fe8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc970e00700 1 --2- 172.21.15.49:0/269327084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fe86a0 0x1fe8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc970e00700 1 -- 172.21.15.49:0/269327084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fed7b0 msgr2=0x1fa17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc970e00700 1 --2- 172.21.15.49:0/269327084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fed7b0 0x1fa17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.718+0000 7fc970e00700 1 -- 172.21.15.49:0/269327084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1ed4ed0 con 0x1fccd60 2024-01-22T05:17:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.722+0000 7fc96b400700 1 --2- 172.21.15.49:0/269327084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fed7b0 0x1fa17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.722+0000 7fc970e00700 1 --2- 172.21.15.49:0/269327084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1fa38f0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7fc96400b900 tx=0x7fc964009840).ready entity=mon.0 client_cookie=e841ed655f8d5037 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:50.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.722+0000 7fc95be00700 1 -- 172.21.15.49:0/269327084 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400bae0 con 0x1fccd60 2024-01-22T05:17:50.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.722+0000 7fc95be00700 1 -- 172.21.15.49:0/269327084 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96400bc40 con 0x1fccd60 2024-01-22T05:17:50.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.722+0000 7fc95be00700 1 -- 172.21.15.49:0/269327084 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964013630 con 0x1fccd60 2024-01-22T05:17:50.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.722+0000 7fc97d207740 1 -- 172.21.15.49:0/269327084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 msgr2=0x1fa38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:50.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.722+0000 7fc97d207740 1 --2- 172.21.15.49:0/269327084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1fa38f0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7fc96400b900 tx=0x7fc964009840).stop 2024-01-22T05:17:50.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.722+0000 7fc97d207740 1 -- 172.21.15.49:0/269327084 shutdown_connections 2024-01-22T05:17:50.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.722+0000 7fc97d207740 1 --2- 172.21.15.49:0/269327084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1fa38f0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.722+0000 7fc97d207740 1 --2- 172.21.15.49:0/269327084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fed7b0 0x1fa17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.722+0000 7fc97d207740 1 --2- 172.21.15.49:0/269327084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fe86a0 0x1fe8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.722+0000 7fc97d207740 1 -- 172.21.15.49:0/269327084 >> 172.21.15.49:0/269327084 conn(0x1d86680 msgr2=0x1fa7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:50.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.722+0000 7fc97d207740 1 -- 172.21.15.49:0/269327084 shutdown_connections 2024-01-22T05:17:50.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.722+0000 7fc97d207740 1 -- 172.21.15.49:0/269327084 wait complete. 2024-01-22T05:17:50.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.722+0000 7fc97d207740 1 -- start start 2024-01-22T05:17:50.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.726+0000 7fc97d207740 1 Processor -- start 2024-01-22T05:17:50.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.726+0000 7fc97d207740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fccd60 0x1fe4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.726+0000 7fc97d207740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fe86a0 0x1fcd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.726+0000 7fc97d207740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fed7b0 0x1fbfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.726+0000 7fc97d207740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fe5f30 con 0x1fe86a0 2024-01-22T05:17:50.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.726+0000 7fc97d207740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fcdf70 con 0x1fed7b0 2024-01-22T05:17:50.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.726+0000 7fc97d207740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fce250 con 0x1fccd60 2024-01-22T05:17:50.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.726+0000 7fc97d207740 10 client.0 ll_register_callbacks cb 0x1f5e7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:17:50.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc96b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fe86a0 0x1fcd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc96be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fccd60 0x1fe4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc96b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fe86a0 0x1fcd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49240/0 (socket says 172.21.15.49:49240) 2024-01-22T05:17:50.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc96be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fccd60 0x1fe4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:51100/0 (socket says 172.21.15.49:51100) 2024-01-22T05:17:50.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc96b400700 1 -- 172.21.15.49:0/2292918955 learned_addr learned my addr 172.21.15.49:0/2292918955 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:50.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc970e00700 1 --2- 172.21.15.49:0/2292918955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fed7b0 0x1fbfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc96b400700 1 -- 172.21.15.49:0/2292918955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fccd60 msgr2=0x1fe4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:50.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc96b400700 1 --2- 172.21.15.49:0/2292918955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fccd60 0x1fe4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc96b400700 1 -- 172.21.15.49:0/2292918955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fed7b0 msgr2=0x1fbfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:50.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc96b400700 1 --2- 172.21.15.49:0/2292918955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fed7b0 0x1fbfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc96b400700 1 -- 172.21.15.49:0/2292918955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c0bcb40 con 0x1fe86a0 2024-01-22T05:17:50.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc96be00700 1 --2- 172.21.15.49:0/2292918955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fccd60 0x1fe4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:17:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc96b400700 1 --2- 172.21.15.49:0/2292918955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fe86a0 0x1fcd420 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7fc95404bf70 tx=0x7fc95401d040).ready entity=mon.0 client_cookie=5bcd99c23f1e5e7d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc958c00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:17:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc958c00700 1 -- 172.21.15.49:0/2292918955 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954019be0 con 0x1fe86a0 2024-01-22T05:17:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc958c00700 1 -- 172.21.15.49:0/2292918955 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc954019d40 con 0x1fe86a0 2024-01-22T05:17:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc97d207740 1 -- 172.21.15.49:0/2292918955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1f1e230 con 0x1fe86a0 2024-01-22T05:17:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc958c00700 1 -- 172.21.15.49:0/2292918955 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc95404b740 con 0x1fe86a0 2024-01-22T05:17:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc97d207740 10 client.9486 fetch_fsmap learned FSMap version 126 2024-01-22T05:17:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc97d207740 1 -- 172.21.15.49:0/2292918955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=126,monmap=2+}) v3 -- 0x1f217c0 con 0x1fe86a0 2024-01-22T05:17:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc958c00700 1 -- 172.21.15.49:0/2292918955 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1f1e230 con 0x1fe86a0 2024-01-22T05:17:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc958c00700 1 -- 172.21.15.49:0/2292918955 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 126) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc954047e30 con 0x1fe86a0 2024-01-22T05:17:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc97d207740 10 client.9486 fetch_fsmap finished waiting for FSMap version 126 2024-01-22T05:17:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc97d207740 10 client.9486 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-01-22T05:17:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc97d207740 20 client.9486 populate_metadata read hostname 'smithi049' 2024-01-22T05:17:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc97d207740 1 --2- 172.21.15.49:0/2292918955 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x2003f90 0x2006380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc97d207740 4 client.9486 mds_command: new command op to 9312 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:17:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc97d207740 1 -- 172.21.15.49:0/2292918955 --> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1f14780 con 0x2003f90 2024-01-22T05:17:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.730+0000 7fc96be00700 1 --2- 172.21.15.49:0/2292918955 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x2003f90 0x2006380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc96be00700 1 --2- 172.21.15.49:0/2292918955 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x2003f90 0x2006380 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=75a001c3e1298f8e server_cookie=3cc0225ce120477f in_seq=0 out_seq=0 2024-01-22T05:17:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc958c00700 10 client.9486 ms_handle_connect on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc958c00700 1 -- 172.21.15.49:0/2292918955 <== mds.0 v2:172.21.15.49:6836/3762397937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1f14780 con 0x2003f90 2024-01-22T05:17:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc958c00700 10 client.9486 handle_command_reply: tid=0 2024-01-22T05:17:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc97d207740 1 client.9486 shutdown 2024-01-22T05:17:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc97d207740 1 -- 172.21.15.49:0/2292918955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fe86a0 msgr2=0x1fcd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc97d207740 1 --2- 172.21.15.49:0/2292918955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fe86a0 0x1fcd420 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7fc95404bf70 tx=0x7fc95401d040).stop 2024-01-22T05:17:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc97d207740 1 -- 172.21.15.49:0/2292918955 shutdown_connections 2024-01-22T05:17:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc97d207740 1 --2- 172.21.15.49:0/2292918955 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x2003f90 0x2006380 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc97d207740 1 --2- 172.21.15.49:0/2292918955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fed7b0 0x1fbfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc958c00700 0 client.9486 ms_handle_reset on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc97d207740 1 --2- 172.21.15.49:0/2292918955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fe86a0 0x1fcd420 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc97d207740 1 --2- 172.21.15.49:0/2292918955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fccd60 0x1fe4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc97d207740 1 -- 172.21.15.49:0/2292918955 >> 172.21.15.49:0/2292918955 conn(0x1d86680 msgr2=0x1fedc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:50.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc97d207740 1 -- 172.21.15.49:0/2292918955 shutdown_connections 2024-01-22T05:17:50.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.734+0000 7fc97d207740 1 -- 172.21.15.49:0/2292918955 wait complete. 2024-01-22T05:17:50.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.738+0000 7fc97d207740 20 client.9486 trim_cache size 0 max 16384 2024-01-22T05:17:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.750+0000 7fc97d207740 1 Processor -- start 2024-01-22T05:17:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.750+0000 7fc97d207740 1 -- start start 2024-01-22T05:17:50.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.750+0000 7fc97d207740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1fe51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.750+0000 7fc97d207740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fe86a0 0x1fe56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.750+0000 7fc97d207740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fed7b0 0x1ffbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.750+0000 7fc97d207740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fa2540 con 0x1fccd60 2024-01-22T05:17:50.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.750+0000 7fc97d207740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f6a600 con 0x1fe86a0 2024-01-22T05:17:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.750+0000 7fc97d207740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fec9b0 con 0x1fed7b0 2024-01-22T05:17:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc96be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1fe51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc96be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1fe51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49252/0 (socket says 172.21.15.49:49252) 2024-01-22T05:17:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc96be00700 1 -- 172.21.15.49:0/914385792 learned_addr learned my addr 172.21.15.49:0/914385792 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc970e00700 1 --2- 172.21.15.49:0/914385792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fed7b0 0x1ffbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc96b400700 1 --2- 172.21.15.49:0/914385792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fe86a0 0x1fe56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc96be00700 1 -- 172.21.15.49:0/914385792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fed7b0 msgr2=0x1ffbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:50.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc96be00700 1 --2- 172.21.15.49:0/914385792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fed7b0 0x1ffbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc96be00700 1 -- 172.21.15.49:0/914385792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fe86a0 msgr2=0x1fe56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:50.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc96be00700 1 --2- 172.21.15.49:0/914385792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fe86a0 0x1fe56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc96be00700 1 -- 172.21.15.49:0/914385792 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1fe5020 con 0x1fccd60 2024-01-22T05:17:50.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc96be00700 1 --2- 172.21.15.49:0/914385792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1fe51d0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7fc95c014600 tx=0x7fc95c017000).ready entity=mon.0 client_cookie=c0ecb8fde71a8828 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:50.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc960c00700 1 -- 172.21.15.49:0/914385792 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c027070 con 0x1fccd60 2024-01-22T05:17:50.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc960c00700 1 -- 172.21.15.49:0/914385792 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c02a470 con 0x1fccd60 2024-01-22T05:17:50.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc960c00700 1 -- 172.21.15.49:0/914385792 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c02a5e0 con 0x1fccd60 2024-01-22T05:17:50.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc97d207740 1 -- 172.21.15.49:0/914385792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 msgr2=0x1fe51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:50.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.754+0000 7fc97d207740 1 --2- 172.21.15.49:0/914385792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1fe51d0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7fc95c014600 tx=0x7fc95c017000).stop 2024-01-22T05:17:50.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.758+0000 7fc97d207740 1 -- 172.21.15.49:0/914385792 shutdown_connections 2024-01-22T05:17:50.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.758+0000 7fc97d207740 1 --2- 172.21.15.49:0/914385792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fed7b0 0x1ffbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.758+0000 7fc97d207740 1 --2- 172.21.15.49:0/914385792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fe86a0 0x1fe56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.758+0000 7fc97d207740 1 --2- 172.21.15.49:0/914385792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1fe51d0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.758+0000 7fc97d207740 1 -- 172.21.15.49:0/914385792 >> 172.21.15.49:0/914385792 conn(0x1d86680 msgr2=0x1fe44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:50.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.758+0000 7fc97d207740 1 -- 172.21.15.49:0/914385792 shutdown_connections 2024-01-22T05:17:50.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.758+0000 7fc97d207740 1 -- 172.21.15.49:0/914385792 wait complete. 2024-01-22T05:17:50.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.758+0000 7fc97d207740 1 -- start start 2024-01-22T05:17:50.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.758+0000 7fc97d207740 1 Processor -- start 2024-01-22T05:17:50.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1ffbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fe86a0 0x1ffc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fed7b0 0x1ffc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fe6d80 con 0x1fccd60 2024-01-22T05:17:50.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ffb730 con 0x1fe86a0 2024-01-22T05:17:50.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2000300 con 0x1fed7b0 2024-01-22T05:17:50.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 10 client.0 ll_register_callbacks cb 0x7fc95404ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:17:50.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc96be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1ffbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc96be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1ffbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49254/0 (socket says 172.21.15.49:49254) 2024-01-22T05:17:50.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc96be00700 1 -- 172.21.15.49:0/3046565075 learned_addr learned my addr 172.21.15.49:0/3046565075 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:50.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc970e00700 1 --2- 172.21.15.49:0/3046565075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fed7b0 0x1ffc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc96b400700 1 --2- 172.21.15.49:0/3046565075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fe86a0 0x1ffc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc96be00700 1 -- 172.21.15.49:0/3046565075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fed7b0 msgr2=0x1ffc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:50.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc96be00700 1 --2- 172.21.15.49:0/3046565075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fed7b0 0x1ffc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc96be00700 1 -- 172.21.15.49:0/3046565075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fe86a0 msgr2=0x1ffc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:50.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc96be00700 1 --2- 172.21.15.49:0/3046565075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fe86a0 0x1ffc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc96be00700 1 -- 172.21.15.49:0/3046565075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95c014770 con 0x1fccd60 2024-01-22T05:17:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc96be00700 1 --2- 172.21.15.49:0/3046565075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1ffbb50 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7fc95c014600 tx=0x7fc95c02a000).ready entity=mon.0 client_cookie=d4c9c83f43cfcb9d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc958c00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:17:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc958c00700 1 -- 172.21.15.49:0/3046565075 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c02abe0 con 0x1fccd60 2024-01-22T05:17:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc958c00700 1 -- 172.21.15.49:0/3046565075 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc95c02ad40 con 0x1fccd60 2024-01-22T05:17:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 1 -- 172.21.15.49:0/3046565075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc96400bc40 con 0x1fccd60 2024-01-22T05:17:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc958c00700 1 -- 172.21.15.49:0/3046565075 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc95c021660 con 0x1fccd60 2024-01-22T05:17:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 10 client.9492 fetch_fsmap learned FSMap version 126 2024-01-22T05:17:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 1 -- 172.21.15.49:0/3046565075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=126,monmap=2+}) v3 -- 0x7fc96c150bd0 con 0x1fccd60 2024-01-22T05:17:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc958c00700 1 -- 172.21.15.49:0/3046565075 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96400bc40 con 0x1fccd60 2024-01-22T05:17:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc958c00700 1 -- 172.21.15.49:0/3046565075 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 126) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc95c0217c0 con 0x1fccd60 2024-01-22T05:17:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 10 client.9492 fetch_fsmap finished waiting for FSMap version 126 2024-01-22T05:17:50.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 10 client.9492 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-01-22T05:17:50.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 20 client.9492 populate_metadata read hostname 'smithi049' 2024-01-22T05:17:50.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 1 --2- 172.21.15.49:0/3046565075 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x1fbe470 0x1fbe850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 4 client.9492 mds_command: new command op to 9312 tid=0[{"prefix": "damage ls"}] 2024-01-22T05:17:50.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.762+0000 7fc97d207740 1 -- 172.21.15.49:0/3046565075 --> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x1ddd610 con 0x1fbe470 2024-01-22T05:17:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc96b400700 1 --2- 172.21.15.49:0/3046565075 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x1fbe470 0x1fbe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc96b400700 1 --2- 172.21.15.49:0/3046565075 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x1fbe470 0x1fbe850 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=bcec5f6f912cb55b server_cookie=950d902a86b3d038 in_seq=0 out_seq=0 2024-01-22T05:17:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc958c00700 10 client.9492 ms_handle_connect on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc958c00700 1 -- 172.21.15.49:0/3046565075 <== mds.0 v2:172.21.15.49:6836/3762397937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x1ddd610 con 0x1fbe470 2024-01-22T05:17:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc958c00700 10 client.9492 handle_command_reply: tid=0 2024-01-22T05:17:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc97d207740 1 client.9492 shutdown 2024-01-22T05:17:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc97d207740 1 -- 172.21.15.49:0/3046565075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 msgr2=0x1ffbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc97d207740 1 --2- 172.21.15.49:0/3046565075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1ffbb50 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7fc95c014600 tx=0x7fc95c02a000).stop 2024-01-22T05:17:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc97d207740 1 -- 172.21.15.49:0/3046565075 shutdown_connections 2024-01-22T05:17:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc97d207740 1 --2- 172.21.15.49:0/3046565075 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x1fbe470 0x1fbe850 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc97d207740 1 --2- 172.21.15.49:0/3046565075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1fed7b0 0x1ffc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc97d207740 1 --2- 172.21.15.49:0/3046565075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1fe86a0 0x1ffc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc97d207740 1 --2- 172.21.15.49:0/3046565075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1fccd60 0x1ffbb50 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc97d207740 1 -- 172.21.15.49:0/3046565075 >> 172.21.15.49:0/3046565075 conn(0x1d86680 msgr2=0x1fcc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc958c00700 0 client.9492 ms_handle_reset on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc97d207740 1 -- 172.21.15.49:0/3046565075 shutdown_connections 2024-01-22T05:17:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc97d207740 1 -- 172.21.15.49:0/3046565075 wait complete. 2024-01-22T05:17:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.766+0000 7fc97d207740 20 client.9492 trim_cache size 0 max 16384 2024-01-22T05:17:50.771 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-01-22T05:17:50.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.770+0000 7fc972e00700 1 -- 172.21.15.49:0/372477116 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc94405a510 msgr2=0x7fc94405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.770+0000 7fc972e00700 1 --2- 172.21.15.49:0/372477116 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc94405a510 0x7fc94405c9d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fc95c009c30 tx=0x7fc95c009060).stop 2024-01-22T05:17:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.770+0000 7fc972e00700 1 -- 172.21.15.49:0/372477116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c1524f0 msgr2=0x7fc96c15d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.770+0000 7fc972e00700 1 --2- 172.21.15.49:0/372477116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c1524f0 0x7fc96c15d9b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fc95400e980 tx=0x7fc954009060).stop 2024-01-22T05:17:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.770+0000 7fc972e00700 1 -- 172.21.15.49:0/372477116 shutdown_connections 2024-01-22T05:17:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.770+0000 7fc972e00700 1 --2- 172.21.15.49:0/372477116 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc94405a510 0x7fc94405c9d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.770+0000 7fc972e00700 1 --2- 172.21.15.49:0/372477116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc96c15bad0 0x7fc96c15c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.770+0000 7fc972e00700 1 --2- 172.21.15.49:0/372477116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c1524f0 0x7fc96c15d9b0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.770+0000 7fc972e00700 1 --2- 172.21.15.49:0/372477116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c0a8760 0x7fc96c13c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.770+0000 7fc972e00700 1 -- 172.21.15.49:0/372477116 >> 172.21.15.49:0/372477116 conn(0x7fc96c0c6560 msgr2=0x7fc96c0c46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:50.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.770+0000 7fc972e00700 1 -- 172.21.15.49:0/372477116 shutdown_connections 2024-01-22T05:17:50.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.770+0000 7fc972e00700 1 -- 172.21.15.49:0/372477116 wait complete. 2024-01-22T05:17:50.793 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-22T05:17:50.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.958+0000 7f2d19c00700 1 Processor -- start 2024-01-22T05:17:50.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.958+0000 7f2d19c00700 1 -- start start 2024-01-22T05:17:50.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.962+0000 7f2d19c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2d140bc590 0x7f2d140bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.962+0000 7f2d19c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d140bcee0 0x7f2d1415a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.962+0000 7f2d19c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d14069a90 con 0x7f2d140c5530 2024-01-22T05:17:50.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.962+0000 7f2d19c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d14150d70 con 0x7f2d140bcee0 2024-01-22T05:17:50.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.962+0000 7f2d19c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d14068ba0 con 0x7f2d140bc590 2024-01-22T05:17:50.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.962+0000 7f2d13400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d140bcee0 0x7f2d1415a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.962+0000 7f2d13400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d140bcee0 0x7f2d1415a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49266/0 (socket says 172.21.15.49:49266) 2024-01-22T05:17:50.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.962+0000 7f2d13400700 1 -- 172.21.15.49:0/4114148220 learned_addr learned my addr 172.21.15.49:0/4114148220 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:50.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.962+0000 7f2d12a00700 1 --1- 172.21.15.49:0/4114148220 >> v1:172.21.15.49:6789/0 conn(0x7f2d140c5530 0x7f2d14069f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44614/0 (socket says 172.21.15.49:44614) 2024-01-22T05:17:50.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.962+0000 7f2d12000700 1 --2- 172.21.15.49:0/4114148220 >> v2:172.21.15.110:3300/0 conn(0x7f2d140bc590 0x7f2d140bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.962+0000 7f2d13400700 1 -- 172.21.15.49:0/4114148220 >> v2:172.21.15.110:3300/0 conn(0x7f2d140bc590 msgr2=0x7f2d140bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:50.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.962+0000 7f2d13400700 1 --2- 172.21.15.49:0/4114148220 >> v2:172.21.15.110:3300/0 conn(0x7f2d140bc590 0x7f2d140bc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.962+0000 7f2d13400700 1 -- 172.21.15.49:0/4114148220 >> v1:172.21.15.49:6789/0 conn(0x7f2d140c5530 legacy=0x7f2d14069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:50.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.962+0000 7f2d13400700 1 -- 172.21.15.49:0/4114148220 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d14068e80 con 0x7f2d140bcee0 2024-01-22T05:17:50.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.962+0000 7f2d13400700 1 --2- 172.21.15.49:0/4114148220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d140bcee0 0x7f2d1415a480 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7f2d140c7490 tx=0x7f2d0c009840).ready entity=mon.0 client_cookie=9106061000da50ed server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:50.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.966+0000 7f2d11600700 1 -- 172.21.15.49:0/4114148220 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c00e070 con 0x7f2d140bcee0 2024-01-22T05:17:50.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.966+0000 7f2d11600700 1 -- 172.21.15.49:0/4114148220 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0c00ba20 con 0x7f2d140bcee0 2024-01-22T05:17:50.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.966+0000 7f2d11600700 1 -- 172.21.15.49:0/4114148220 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c00bda0 con 0x7f2d140bcee0 2024-01-22T05:17:50.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.966+0000 7f2d19c00700 1 -- 172.21.15.49:0/4114148220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d140bcee0 msgr2=0x7f2d1415a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:50.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.966+0000 7f2d19c00700 1 --2- 172.21.15.49:0/4114148220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d140bcee0 0x7f2d1415a480 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7f2d140c7490 tx=0x7f2d0c009840).stop 2024-01-22T05:17:50.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.966+0000 7f2d19c00700 1 -- 172.21.15.49:0/4114148220 shutdown_connections 2024-01-22T05:17:50.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.966+0000 7f2d19c00700 1 --2- 172.21.15.49:0/4114148220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d140bcee0 0x7f2d1415a480 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.966+0000 7f2d19c00700 1 --2- 172.21.15.49:0/4114148220 >> v2:172.21.15.110:3300/0 conn(0x7f2d140bc590 0x7f2d140bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.966+0000 7f2d19c00700 1 -- 172.21.15.49:0/4114148220 >> 172.21.15.49:0/4114148220 conn(0x7f2d140aa6b0 msgr2=0x7f2d140aaac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:50.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.966+0000 7f2d19c00700 1 -- 172.21.15.49:0/4114148220 shutdown_connections 2024-01-22T05:17:50.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.966+0000 7f2d19c00700 1 -- 172.21.15.49:0/4114148220 wait complete. 2024-01-22T05:17:50.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.970+0000 7f2d19c00700 1 Processor -- start 2024-01-22T05:17:50.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.970+0000 7f2d19c00700 1 -- start start 2024-01-22T05:17:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d19c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d140bc590 0x7f2d14143a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d19c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d140bcee0 0x7f2d14167810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d19c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d140c5530 0x7f2d14094090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d19c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140bf320 con 0x7f2d140c5530 2024-01-22T05:17:50.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d19c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d14167d00 con 0x7f2d140bc590 2024-01-22T05:17:50.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d19c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140be9f0 con 0x7f2d140bcee0 2024-01-22T05:17:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d13400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d140c5530 0x7f2d14094090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d13400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d140c5530 0x7f2d14094090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49270/0 (socket says 172.21.15.49:49270) 2024-01-22T05:17:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d13400700 1 -- 172.21.15.49:0/663145441 learned_addr learned my addr 172.21.15.49:0/663145441 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d12a00700 1 --2- 172.21.15.49:0/663145441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d140bc590 0x7f2d14143a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d12000700 1 --2- 172.21.15.49:0/663145441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d140bcee0 0x7f2d14167810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d13400700 1 -- 172.21.15.49:0/663145441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d140bcee0 msgr2=0x7f2d14167810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d13400700 1 --2- 172.21.15.49:0/663145441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d140bcee0 0x7f2d14167810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d13400700 1 -- 172.21.15.49:0/663145441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d140bc590 msgr2=0x7f2d14143a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d13400700 1 --2- 172.21.15.49:0/663145441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d140bc590 0x7f2d14143a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d13400700 1 -- 172.21.15.49:0/663145441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c009ae0 con 0x7f2d140c5530 2024-01-22T05:17:50.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d13400700 1 --2- 172.21.15.49:0/663145441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d140c5530 0x7f2d14094090 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f2d0c010000 tx=0x7f2d0c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:50.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d0a000700 1 -- 172.21.15.49:0/663145441 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c007170 con 0x7f2d140c5530 2024-01-22T05:17:50.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d0a000700 1 -- 172.21.15.49:0/663145441 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0c0092e0 con 0x7f2d140c5530 2024-01-22T05:17:50.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d0a000700 1 -- 172.21.15.49:0/663145441 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c01d640 con 0x7f2d140c5530 2024-01-22T05:17:50.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d19c00700 1 -- 172.21.15.49:0/663145441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d140becd0 con 0x7f2d140c5530 2024-01-22T05:17:50.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.974+0000 7f2d19c00700 1 -- 172.21.15.49:0/663145441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d14094580 con 0x7f2d140c5530 2024-01-22T05:17:50.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.978+0000 7f2d19c00700 1 -- 172.21.15.49:0/663145441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d140bf490 con 0x7f2d140c5530 2024-01-22T05:17:50.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.978+0000 7f2d0a000700 1 -- 172.21.15.49:0/663145441 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2d0c01da70 con 0x7f2d140c5530 2024-01-22T05:17:50.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.978+0000 7f2d0a000700 1 --2- 172.21.15.49:0/663145441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2cec05a540 0x7f2cec05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:50.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.978+0000 7f2d0a000700 1 -- 172.21.15.49:0/663145441 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2d0c0764f0 con 0x7f2d140c5530 2024-01-22T05:17:50.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.978+0000 7f2d12a00700 1 --2- 172.21.15.49:0/663145441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2cec05a540 0x7f2cec05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:50.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.978+0000 7f2d12a00700 1 --2- 172.21.15.49:0/663145441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2cec05a540 0x7f2cec05ca00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f2d04007fd0 tx=0x7f2d04007d30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:50.982+0000 7f2d0a000700 1 -- 172.21.15.49:0/663145441 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2d0c049ab0 con 0x7f2d140c5530 2024-01-22T05:17:51.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.182+0000 7f2d19c00700 1 -- 172.21.15.49:0/663145441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2d14069160 con 0x7f2d140c5530 2024-01-22T05:17:51.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.182+0000 7f2d0a000700 1 -- 172.21.15.49:0/663145441 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f2d0c04d0d0 con 0x7f2d140c5530 2024-01-22T05:17:51.187 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:17:51.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.186+0000 7f2d19c00700 1 -- 172.21.15.49:0/663145441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2cec05a540 msgr2=0x7f2cec05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.186+0000 7f2d19c00700 1 --2- 172.21.15.49:0/663145441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2cec05a540 0x7f2cec05ca00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f2d04007fd0 tx=0x7f2d04007d30).stop 2024-01-22T05:17:51.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.186+0000 7f2d19c00700 1 -- 172.21.15.49:0/663145441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d140c5530 msgr2=0x7f2d14094090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.186+0000 7f2d19c00700 1 --2- 172.21.15.49:0/663145441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d140c5530 0x7f2d14094090 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f2d0c010000 tx=0x7f2d0c009840).stop 2024-01-22T05:17:51.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.190+0000 7f2d19c00700 1 -- 172.21.15.49:0/663145441 shutdown_connections 2024-01-22T05:17:51.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.190+0000 7f2d19c00700 1 --2- 172.21.15.49:0/663145441 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2cec05a540 0x7f2cec05ca00 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.190+0000 7f2d19c00700 1 --2- 172.21.15.49:0/663145441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d140c5530 0x7f2d14094090 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.190+0000 7f2d19c00700 1 --2- 172.21.15.49:0/663145441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d140bcee0 0x7f2d14167810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.190+0000 7f2d19c00700 1 --2- 172.21.15.49:0/663145441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d140bc590 0x7f2d14143a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.190+0000 7f2d19c00700 1 -- 172.21.15.49:0/663145441 >> 172.21.15.49:0/663145441 conn(0x7f2d140aa6b0 msgr2=0x7f2d140633a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:51.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.190+0000 7f2d19c00700 1 -- 172.21.15.49:0/663145441 shutdown_connections 2024-01-22T05:17:51.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.190+0000 7f2d19c00700 1 -- 172.21.15.49:0/663145441 wait complete. 2024-01-22T05:17:51.213 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-22T05:17:51.214 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.10:0 scrub start '~mdsdir' recursive 2024-01-22T05:17:51.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.382+0000 7fec02a00700 1 Processor -- start 2024-01-22T05:17:51.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.382+0000 7fec02a00700 1 -- start start 2024-01-22T05:17:51.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.386+0000 7fec02a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febfc150f90 0x7febfc067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.386+0000 7fec02a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7febfc0bcfb0 0x7febfc0c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.386+0000 7fec02a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febfc0c23c0 con 0x7febfc0bcb30 2024-01-22T05:17:51.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.386+0000 7fec02a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febfc068b10 con 0x7febfc0bcfb0 2024-01-22T05:17:51.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.386+0000 7fec02a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc062650 con 0x7febfc150f90 2024-01-22T05:17:51.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.386+0000 7febfb400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7febfc0bcb30 0x7febfc0c2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44620/0 (socket says 172.21.15.49:44620) 2024-01-22T05:17:51.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.386+0000 7febfb400700 1 -- 172.21.15.49:0/1695853067 learned_addr learned my addr 172.21.15.49:0/1695853067 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:51.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.386+0000 7fec00a00700 1 --2- 172.21.15.49:0/1695853067 >> v2:172.21.15.110:3300/0 conn(0x7febfc0bcfb0 0x7febfc0c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.386+0000 7febfaa00700 1 -- 172.21.15.49:0/1695853067 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380764134 0 0) 0x7febfc0c23c0 con 0x7febfc0bcb30 2024-01-22T05:17:51.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.386+0000 7febfaa00700 1 -- 172.21.15.49:0/1695853067 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febdc0033f0 con 0x7febfc0bcb30 2024-01-22T05:17:51.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.386+0000 7febfbe00700 1 --2- 172.21.15.49:0/1695853067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febfc150f90 0x7febfc067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.386+0000 7febfaa00700 1 -- 172.21.15.49:0/1695853067 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1105403436 0 0) 0x7febdc0033f0 con 0x7febfc0bcb30 2024-01-22T05:17:51.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 -- 172.21.15.49:0/1695853067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febfc150f90 msgr2=0x7febfc067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 --2- 172.21.15.49:0/1695853067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febfc150f90 0x7febfc067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 -- 172.21.15.49:0/1695853067 >> v2:172.21.15.110:3300/0 conn(0x7febfc0bcfb0 msgr2=0x7febfc0c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 --2- 172.21.15.49:0/1695853067 >> v2:172.21.15.110:3300/0 conn(0x7febfc0bcfb0 0x7febfc0c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 -- 172.21.15.49:0/1695853067 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc1473b0 con 0x7febfc0bcb30 2024-01-22T05:17:51.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 -- 172.21.15.49:0/1695853067 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7febe4001470 con 0x7febfc0bcb30 2024-01-22T05:17:51.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7fec00a00700 1 --2- 172.21.15.49:0/1695853067 >> v2:172.21.15.110:3300/0 conn(0x7febfc0bcfb0 0x7febfc0c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:51.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 -- 172.21.15.49:0/1695853067 >> v1:172.21.15.49:6789/0 conn(0x7febfc0bcb30 legacy=0x7febfc0c2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 --2- 172.21.15.49:0/1695853067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febfc150f90 0x7febdc003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 --2- 172.21.15.49:0/1695853067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febdc003ef0 0x7febdc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 --2- 172.21.15.49:0/1695853067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febdc004b80 0x7febdc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 -- 172.21.15.49:0/1695853067 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc068b10 con 0x7febdc004b80 2024-01-22T05:17:51.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 -- 172.21.15.49:0/1695853067 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc062650 con 0x7febdc003ef0 2024-01-22T05:17:51.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 -- 172.21.15.49:0/1695853067 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febdc00b9c0 con 0x7febfc150f90 2024-01-22T05:17:51.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7fec00a00700 1 --2- 172.21.15.49:0/1695853067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febdc004b80 0x7febdc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfb400700 1 --2- 172.21.15.49:0/1695853067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febdc003ef0 0x7febdc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfbe00700 1 --2- 172.21.15.49:0/1695853067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febfc150f90 0x7febdc003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7fec00a00700 1 -- 172.21.15.49:0/1695853067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febfc150f90 msgr2=0x7febdc003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7fec00a00700 1 --2- 172.21.15.49:0/1695853067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febfc150f90 0x7febdc003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7fec00a00700 1 -- 172.21.15.49:0/1695853067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febdc003ef0 msgr2=0x7febdc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7fec00a00700 1 --2- 172.21.15.49:0/1695853067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febdc003ef0 0x7febdc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7fec00a00700 1 -- 172.21.15.49:0/1695853067 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc0033f0 con 0x7febdc004b80 2024-01-22T05:17:51.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7fec00a00700 1 --2- 172.21.15.49:0/1695853067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febdc004b80 0x7febdc005000 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7febf4007580 tx=0x7febf40097d0).ready entity=mon.0 client_cookie=9d96659d837b6537 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:51.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 -- 172.21.15.49:0/1695853067 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4009ae0 con 0x7febdc004b80 2024-01-22T05:17:51.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 -- 172.21.15.49:0/1695853067 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf4007dd0 con 0x7febdc004b80 2024-01-22T05:17:51.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.390+0000 7febfaa00700 1 -- 172.21.15.49:0/1695853067 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4015620 con 0x7febdc004b80 2024-01-22T05:17:51.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.394+0000 7fec02a00700 1 -- 172.21.15.49:0/1695853067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febdc004b80 msgr2=0x7febdc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.394+0000 7fec02a00700 1 --2- 172.21.15.49:0/1695853067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febdc004b80 0x7febdc005000 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7febf4007580 tx=0x7febf40097d0).stop 2024-01-22T05:17:51.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.394+0000 7fec00a00700 1 -- 172.21.15.49:0/1695853067 reap_dead start 2024-01-22T05:17:51.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.394+0000 7fec02a00700 1 -- 172.21.15.49:0/1695853067 shutdown_connections 2024-01-22T05:17:51.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.394+0000 7fec02a00700 1 -- 172.21.15.49:0/1695853067 >> 172.21.15.49:0/1695853067 conn(0x7febfc0c3830 msgr2=0x7febfc0c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:51.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.394+0000 7fec02a00700 1 -- 172.21.15.49:0/1695853067 shutdown_connections 2024-01-22T05:17:51.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.394+0000 7fec02a00700 1 -- 172.21.15.49:0/1695853067 wait complete. 2024-01-22T05:17:51.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.394+0000 7fec02a00700 1 Processor -- start 2024-01-22T05:17:51.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7fec02a00700 1 -- start start 2024-01-22T05:17:51.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7fec02a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febdc004b80 0x7febfc13ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7fec02a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc146de0 0x7febfc149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7fec02a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febfc149a40 0x7febfc0a7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7fec02a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc0a6bc0 con 0x7febfc146de0 2024-01-22T05:17:51.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7fec02a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc149f70 con 0x7febfc149a40 2024-01-22T05:17:51.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7fec02a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc14a250 con 0x7febdc004b80 2024-01-22T05:17:51.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7febfb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc146de0 0x7febfc149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7febfb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc146de0 0x7febfc149550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49294/0 (socket says 172.21.15.49:49294) 2024-01-22T05:17:51.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7febfb400700 1 -- 172.21.15.49:0/785852089 learned_addr learned my addr 172.21.15.49:0/785852089 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:51.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7febfbe00700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febdc004b80 0x7febfc13ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7febfb400700 1 -- 172.21.15.49:0/785852089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febdc004b80 msgr2=0x7febfc13ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7fec00a00700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febfc149a40 0x7febfc0a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7febfb400700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febdc004b80 0x7febfc13ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7febfb400700 1 -- 172.21.15.49:0/785852089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febfc149a40 msgr2=0x7febfc0a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7febfb400700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febfc149a40 0x7febfc0a7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7febfb400700 1 -- 172.21.15.49:0/785852089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc14a530 con 0x7febfc146de0 2024-01-22T05:17:51.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7fec00a00700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febfc149a40 0x7febfc0a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:17:51.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7febfbe00700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febdc004b80 0x7febfc13ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:17:51.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7febfb400700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc146de0 0x7febfc149550 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7febe400e780 tx=0x7febe4000d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:51.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.398+0000 7febf3400700 1 -- 172.21.15.49:0/785852089 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4010490 con 0x7febfc146de0 2024-01-22T05:17:51.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.402+0000 7febf3400700 1 -- 172.21.15.49:0/785852089 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe4010040 con 0x7febfc146de0 2024-01-22T05:17:51.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.402+0000 7fec02a00700 1 -- 172.21.15.49:0/785852089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febfc0a6850 con 0x7febfc146de0 2024-01-22T05:17:51.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.402+0000 7febf3400700 1 -- 172.21.15.49:0/785852089 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4010840 con 0x7febfc146de0 2024-01-22T05:17:51.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.402+0000 7fec02a00700 1 -- 172.21.15.49:0/785852089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febfc0a76e0 con 0x7febfc146de0 2024-01-22T05:17:51.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.402+0000 7febf3400700 1 -- 172.21.15.49:0/785852089 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7febe4010bb0 con 0x7febfc146de0 2024-01-22T05:17:51.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.402+0000 7febf3400700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7febd405a510 0x7febd405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.402+0000 7febf3400700 1 -- 172.21.15.49:0/785852089 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7febe40740c0 con 0x7febfc146de0 2024-01-22T05:17:51.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.406+0000 7febfbe00700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7febd405a510 0x7febd405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.406+0000 7febfbe00700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7febd405a510 0x7febd405c9d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7febec00b9a0 tx=0x7febec008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:51.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.406+0000 7fec0cf86740 1 Processor -- start 2024-01-22T05:17:51.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.406+0000 7fec0cf86740 1 -- start start 2024-01-22T05:17:51.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7fec0cf86740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xfb8df0 0xf9d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7fec0cf86740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf9daa0 0xf71f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7fec0cf86740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb91d0 0xf74030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7fec0cf86740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xeb2160 con 0xfb91d0 2024-01-22T05:17:51.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7fec0cf86740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xeb2400 con 0xf9daa0 2024-01-22T05:17:51.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7fec0cf86740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xe9ee00 con 0xfb8df0 2024-01-22T05:17:51.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7fec00a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb91d0 0xf74030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7fec00a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb91d0 0xf74030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49306/0 (socket says 172.21.15.49:49306) 2024-01-22T05:17:51.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7fec00a00700 1 -- 172.21.15.49:0/1594925667 learned_addr learned my addr 172.21.15.49:0/1594925667 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:51.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7febfb400700 1 --2- 172.21.15.49:0/1594925667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf9daa0 0xf71f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7febfbe00700 1 --2- 172.21.15.49:0/1594925667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xfb8df0 0xf9d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7fec00a00700 1 -- 172.21.15.49:0/1594925667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xfb8df0 msgr2=0xf9d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7fec00a00700 1 --2- 172.21.15.49:0/1594925667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xfb8df0 0xf9d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7fec00a00700 1 -- 172.21.15.49:0/1594925667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf9daa0 msgr2=0xf71f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7fec00a00700 1 --2- 172.21.15.49:0/1594925667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf9daa0 0xf71f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7fec00a00700 1 -- 172.21.15.49:0/1594925667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xef28e0 con 0xfb91d0 2024-01-22T05:17:51.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7fec00a00700 1 --2- 172.21.15.49:0/1594925667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb91d0 0xf74030 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7febf4007b70 tx=0x7febf4018000).ready entity=mon.0 client_cookie=5051d66818608b0c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:51.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7febeb400700 1 -- 172.21.15.49:0/1594925667 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4009ae0 con 0xfb91d0 2024-01-22T05:17:51.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7febeb400700 1 -- 172.21.15.49:0/1594925667 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf4009740 con 0xfb91d0 2024-01-22T05:17:51.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.410+0000 7febeb400700 1 -- 172.21.15.49:0/1594925667 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4015410 con 0xfb91d0 2024-01-22T05:17:51.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.414+0000 7fec0cf86740 1 -- 172.21.15.49:0/1594925667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb91d0 msgr2=0xf74030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.414+0000 7fec0cf86740 1 --2- 172.21.15.49:0/1594925667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb91d0 0xf74030 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7febf4007b70 tx=0x7febf4018000).stop 2024-01-22T05:17:51.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.414+0000 7fec0cf86740 1 -- 172.21.15.49:0/1594925667 shutdown_connections 2024-01-22T05:17:51.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.414+0000 7fec0cf86740 1 --2- 172.21.15.49:0/1594925667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb91d0 0xf74030 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.414+0000 7fec0cf86740 1 --2- 172.21.15.49:0/1594925667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf9daa0 0xf71f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.414+0000 7fec0cf86740 1 --2- 172.21.15.49:0/1594925667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xfb8df0 0xf9d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.414+0000 7fec0cf86740 1 -- 172.21.15.49:0/1594925667 >> 172.21.15.49:0/1594925667 conn(0xd577c0 msgr2=0xf77de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:51.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.414+0000 7fec0cf86740 1 -- 172.21.15.49:0/1594925667 shutdown_connections 2024-01-22T05:17:51.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.414+0000 7fec0cf86740 1 -- 172.21.15.49:0/1594925667 wait complete. 2024-01-22T05:17:51.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.414+0000 7fec0cf86740 1 -- start start 2024-01-22T05:17:51.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.414+0000 7fec0cf86740 1 Processor -- start 2024-01-22T05:17:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7fec0cf86740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf9daa0 0xfa3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7fec0cf86740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb8df0 0xfcaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7fec0cf86740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb91d0 0xf9ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7fec0cf86740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xfa4440 con 0xfb8df0 2024-01-22T05:17:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7fec0cf86740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xf9f9b0 con 0xfb91d0 2024-01-22T05:17:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7fec0cf86740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xfa3c30 con 0xf9daa0 2024-01-22T05:17:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7fec0cf86740 10 client.0 ll_register_callbacks cb 0xf2efa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:17:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7febfb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb8df0 0xfcaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7febfb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb8df0 0xfcaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49312/0 (socket says 172.21.15.49:49312) 2024-01-22T05:17:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7febfb400700 1 -- 172.21.15.49:0/4154543458 learned_addr learned my addr 172.21.15.49:0/4154543458 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:51.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7febfbe00700 1 --2- 172.21.15.49:0/4154543458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf9daa0 0xfa3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7fec00a00700 1 --2- 172.21.15.49:0/4154543458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb91d0 0xf9ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7febfb400700 1 -- 172.21.15.49:0/4154543458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf9daa0 msgr2=0xfa3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7febfb400700 1 --2- 172.21.15.49:0/4154543458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf9daa0 0xfa3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7febfb400700 1 -- 172.21.15.49:0/4154543458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb91d0 msgr2=0xf9ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7febfb400700 1 --2- 172.21.15.49:0/4154543458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb91d0 0xf9ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7febfb400700 1 -- 172.21.15.49:0/4154543458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf4019040 con 0xfb8df0 2024-01-22T05:17:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7febfbe00700 1 --2- 172.21.15.49:0/4154543458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf9daa0 0xfa3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:17:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7febfb400700 1 --2- 172.21.15.49:0/4154543458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb8df0 0xfcaa00 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7febe4001ed0 tx=0x7febe404f040).ready entity=mon.0 client_cookie=2fa0014424e6ddce server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7febe3e00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:17:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7febe3e00700 1 -- 172.21.15.49:0/4154543458 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4055070 con 0xfb8df0 2024-01-22T05:17:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7febe3e00700 1 -- 172.21.15.49:0/4154543458 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7febe401cbc0 con 0xfb8df0 2024-01-22T05:17:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7fec0cf86740 1 -- 172.21.15.49:0/4154543458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xeef350 con 0xfb8df0 2024-01-22T05:17:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7febe3e00700 1 -- 172.21.15.49:0/4154543458 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7febe4047130 con 0xfb8df0 2024-01-22T05:17:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7fec0cf86740 10 client.9513 fetch_fsmap learned FSMap version 126 2024-01-22T05:17:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.418+0000 7fec0cf86740 1 -- 172.21.15.49:0/4154543458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=126,monmap=2+}) v3 -- 0xeedb10 con 0xfb8df0 2024-01-22T05:17:51.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7febe3e00700 1 -- 172.21.15.49:0/4154543458 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xeef350 con 0xfb8df0 2024-01-22T05:17:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7febe3e00700 1 -- 172.21.15.49:0/4154543458 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 126) v1 ==== 3100+0+0 (secure 0 0 0) 0x7febe4047290 con 0xfb8df0 2024-01-22T05:17:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7fec0cf86740 10 client.9513 fetch_fsmap finished waiting for FSMap version 126 2024-01-22T05:17:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7fec0cf86740 10 client.9513 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-01-22T05:17:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7fec0cf86740 20 client.9513 populate_metadata read hostname 'smithi049' 2024-01-22T05:17:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7fec0cf86740 1 --2- 172.21.15.49:0/4154543458 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0xf9e960 0xfbb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7fec0cf86740 4 client.9513 mds_command: new command op to 9312 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:17:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7fec0cf86740 1 -- 172.21.15.49:0/4154543458 --> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xee58a0 con 0xf9e960 2024-01-22T05:17:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7febfbe00700 1 --2- 172.21.15.49:0/4154543458 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0xf9e960 0xfbb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7febfbe00700 1 --2- 172.21.15.49:0/4154543458 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0xf9e960 0xfbb350 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4974d86c0687252a server_cookie=b6e02dc7143cd94c in_seq=0 out_seq=0 2024-01-22T05:17:51.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7febe3e00700 10 client.9513 ms_handle_connect on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:51.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7febe3e00700 1 -- 172.21.15.49:0/4154543458 <== mds.0 v2:172.21.15.49:6836/3762397937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xee58a0 con 0xf9e960 2024-01-22T05:17:51.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7febe3e00700 10 client.9513 handle_command_reply: tid=0 2024-01-22T05:17:51.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7fec0cf86740 1 client.9513 shutdown 2024-01-22T05:17:51.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7fec0cf86740 1 -- 172.21.15.49:0/4154543458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb8df0 msgr2=0xfcaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7fec0cf86740 1 --2- 172.21.15.49:0/4154543458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb8df0 0xfcaa00 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7febe4001ed0 tx=0x7febe404f040).stop 2024-01-22T05:17:51.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7fec0cf86740 1 -- 172.21.15.49:0/4154543458 shutdown_connections 2024-01-22T05:17:51.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7fec0cf86740 1 --2- 172.21.15.49:0/4154543458 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0xf9e960 0xfbb350 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7fec0cf86740 1 --2- 172.21.15.49:0/4154543458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb91d0 0xf9ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7fec0cf86740 1 --2- 172.21.15.49:0/4154543458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb8df0 0xfcaa00 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7fec0cf86740 1 --2- 172.21.15.49:0/4154543458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf9daa0 0xfa3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7fec0cf86740 1 -- 172.21.15.49:0/4154543458 >> 172.21.15.49:0/4154543458 conn(0xd577c0 msgr2=0xf9c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:51.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.422+0000 7febe3e00700 0 client.9513 ms_handle_reset on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.426+0000 7fec0cf86740 1 -- 172.21.15.49:0/4154543458 shutdown_connections 2024-01-22T05:17:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.426+0000 7fec0cf86740 1 -- 172.21.15.49:0/4154543458 wait complete. 2024-01-22T05:17:51.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.426+0000 7fec0cf86740 20 client.9513 trim_cache size 0 max 16384 2024-01-22T05:17:51.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.442+0000 7fec0cf86740 1 Processor -- start 2024-01-22T05:17:51.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.442+0000 7fec0cf86740 1 -- start start 2024-01-22T05:17:51.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7fec0cf86740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf9daa0 0x1017fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7fec0cf86740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb8df0 0xf8c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7fec0cf86740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb91d0 0xf9c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7fec0cf86740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xfca200 con 0xfb91d0 2024-01-22T05:17:51.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7fec0cf86740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xf72840 con 0xfb8df0 2024-01-22T05:17:51.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7fec0cf86740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xfc9e60 con 0xf9daa0 2024-01-22T05:17:51.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7fec00a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb91d0 0xf9c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7fec00a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb91d0 0xf9c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49314/0 (socket says 172.21.15.49:49314) 2024-01-22T05:17:51.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7fec00a00700 1 -- 172.21.15.49:0/237328989 learned_addr learned my addr 172.21.15.49:0/237328989 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7febfb400700 1 --2- 172.21.15.49:0/237328989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb8df0 0xf8c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7febfbe00700 1 --2- 172.21.15.49:0/237328989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf9daa0 0x1017fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7fec00a00700 1 -- 172.21.15.49:0/237328989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf9daa0 msgr2=0x1017fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7fec00a00700 1 --2- 172.21.15.49:0/237328989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf9daa0 0x1017fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7fec00a00700 1 -- 172.21.15.49:0/237328989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb8df0 msgr2=0xf8c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7fec00a00700 1 --2- 172.21.15.49:0/237328989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb8df0 0xf8c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7fec00a00700 1 -- 172.21.15.49:0/237328989 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc13f760 con 0xfb91d0 2024-01-22T05:17:51.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7fec00a00700 1 --2- 172.21.15.49:0/237328989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb91d0 0xf9c300 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7febdc00b910 tx=0x7febf401f000).ready entity=mon.0 client_cookie=e097facf314a2559 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:51.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7febebe00700 1 -- 172.21.15.49:0/237328989 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf40032f0 con 0xfb91d0 2024-01-22T05:17:51.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7febebe00700 1 -- 172.21.15.49:0/237328989 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf4007ba0 con 0xfb91d0 2024-01-22T05:17:51.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.446+0000 7febebe00700 1 -- 172.21.15.49:0/237328989 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4015ba0 con 0xfb91d0 2024-01-22T05:17:51.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.450+0000 7fec0cf86740 1 -- 172.21.15.49:0/237328989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb91d0 msgr2=0xf9c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.450+0000 7fec0cf86740 1 --2- 172.21.15.49:0/237328989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb91d0 0xf9c300 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7febdc00b910 tx=0x7febf401f000).stop 2024-01-22T05:17:51.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.450+0000 7fec0cf86740 1 -- 172.21.15.49:0/237328989 shutdown_connections 2024-01-22T05:17:51.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.450+0000 7fec0cf86740 1 --2- 172.21.15.49:0/237328989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xfb91d0 0xf9c300 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.450+0000 7fec0cf86740 1 --2- 172.21.15.49:0/237328989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb8df0 0xf8c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.450+0000 7fec0cf86740 1 --2- 172.21.15.49:0/237328989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf9daa0 0x1017fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.450+0000 7fec0cf86740 1 -- 172.21.15.49:0/237328989 >> 172.21.15.49:0/237328989 conn(0xd577c0 msgr2=0xf77c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:51.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.450+0000 7fec0cf86740 1 -- 172.21.15.49:0/237328989 shutdown_connections 2024-01-22T05:17:51.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.450+0000 7fec0cf86740 1 -- 172.21.15.49:0/237328989 wait complete. 2024-01-22T05:17:51.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.450+0000 7fec0cf86740 1 -- start start 2024-01-22T05:17:51.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.450+0000 7fec0cf86740 1 Processor -- start 2024-01-22T05:17:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf9daa0 0xf8bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb8df0 0x1020a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xfb91d0 0x1020f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x10213f0 con 0xf9daa0 2024-01-22T05:17:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1021550 con 0xfb8df0 2024-01-22T05:17:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xfdc360 con 0xfb91d0 2024-01-22T05:17:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 10 client.0 ll_register_callbacks cb 0x7febe404ad50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:17:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febfbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf9daa0 0xf8bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febfbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf9daa0 0xf8bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49330/0 (socket says 172.21.15.49:49330) 2024-01-22T05:17:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febfbe00700 1 -- 172.21.15.49:0/808951314 learned_addr learned my addr 172.21.15.49:0/808951314 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec00a00700 1 --2- 172.21.15.49:0/808951314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xfb91d0 0x1020f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febfb400700 1 --2- 172.21.15.49:0/808951314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb8df0 0x1020a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febfbe00700 1 -- 172.21.15.49:0/808951314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xfb91d0 msgr2=0x1020f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febfbe00700 1 --2- 172.21.15.49:0/808951314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xfb91d0 0x1020f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febfbe00700 1 -- 172.21.15.49:0/808951314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb8df0 msgr2=0x1020a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febfbe00700 1 --2- 172.21.15.49:0/808951314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb8df0 0x1020a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febfbe00700 1 -- 172.21.15.49:0/808951314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xef28e0 con 0xf9daa0 2024-01-22T05:17:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febfb400700 1 --2- 172.21.15.49:0/808951314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb8df0 0x1020a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:17:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec00a00700 1 --2- 172.21.15.49:0/808951314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xfb91d0 0x1020f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:17:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febfbe00700 1 --2- 172.21.15.49:0/808951314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf9daa0 0xf8bc00 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7febec00bfd0 tx=0x7febec015000).ready entity=mon.0 client_cookie=bdce8d4f90079903 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febe3e00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:17:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febe3e00700 1 -- 172.21.15.49:0/808951314 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec029030 con 0xf9daa0 2024-01-22T05:17:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febe3e00700 1 -- 172.21.15.49:0/808951314 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7febec02a070 con 0xf9daa0 2024-01-22T05:17:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 1 -- 172.21.15.49:0/808951314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7febf4009740 con 0xf9daa0 2024-01-22T05:17:51.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febe3e00700 1 -- 172.21.15.49:0/808951314 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7febec005880 con 0xf9daa0 2024-01-22T05:17:51.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 10 client.9519 fetch_fsmap learned FSMap version 126 2024-01-22T05:17:51.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 1 -- 172.21.15.49:0/808951314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=126,monmap=2+}) v3 -- 0xeed860 con 0xf9daa0 2024-01-22T05:17:51.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febe3e00700 1 -- 172.21.15.49:0/808951314 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf4009740 con 0xf9daa0 2024-01-22T05:17:51.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7febe3e00700 1 -- 172.21.15.49:0/808951314 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 126) v1 ==== 3100+0+0 (secure 0 0 0) 0x7febec0059e0 con 0xf9daa0 2024-01-22T05:17:51.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 10 client.9519 fetch_fsmap finished waiting for FSMap version 126 2024-01-22T05:17:51.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 10 client.9519 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-01-22T05:17:51.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 20 client.9519 populate_metadata read hostname 'smithi049' 2024-01-22T05:17:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 1 --2- 172.21.15.49:0/808951314 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0xf8ac30 0xfa1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 4 client.9519 mds_command: new command op to 9312 tid=0[{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-01-22T05:17:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.454+0000 7fec0cf86740 1 -- 172.21.15.49:0/808951314 --> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) v1 -- 0xdae750 con 0xf8ac30 2024-01-22T05:17:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7febfb400700 1 --2- 172.21.15.49:0/808951314 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0xf8ac30 0xfa1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7febe3e00700 10 client.9519 ms_handle_connect on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7febfb400700 1 --2- 172.21.15.49:0/808951314 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0xf8ac30 0xfa1130 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fbbd7836b94cb942 server_cookie=916c2e0c64d815e in_seq=0 out_seq=0 2024-01-22T05:17:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7febe3e00700 1 -- 172.21.15.49:0/808951314 <== mds.0 v2:172.21.15.49:6836/3762397937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0xdae750 con 0xf8ac30 2024-01-22T05:17:51.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7febe3e00700 10 client.9519 handle_command_reply: tid=0 2024-01-22T05:17:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7fec0cf86740 1 client.9519 shutdown 2024-01-22T05:17:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7fec0cf86740 1 -- 172.21.15.49:0/808951314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf9daa0 msgr2=0xf8bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7fec0cf86740 1 --2- 172.21.15.49:0/808951314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf9daa0 0xf8bc00 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7febec00bfd0 tx=0x7febec015000).stop 2024-01-22T05:17:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7fec0cf86740 1 -- 172.21.15.49:0/808951314 shutdown_connections 2024-01-22T05:17:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7fec0cf86740 1 --2- 172.21.15.49:0/808951314 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0xf8ac30 0xfa1130 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7fec0cf86740 1 --2- 172.21.15.49:0/808951314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xfb91d0 0x1020f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7fec0cf86740 1 --2- 172.21.15.49:0/808951314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xfb8df0 0x1020a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7fec0cf86740 1 --2- 172.21.15.49:0/808951314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf9daa0 0xf8bc00 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7fec0cf86740 1 -- 172.21.15.49:0/808951314 >> 172.21.15.49:0/808951314 conn(0xd577c0 msgr2=0xf9c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7febe3e00700 0 client.9519 ms_handle_reset on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7fec0cf86740 1 -- 172.21.15.49:0/808951314 shutdown_connections 2024-01-22T05:17:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.458+0000 7fec0cf86740 1 -- 172.21.15.49:0/808951314 wait complete. 2024-01-22T05:17:51.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.462+0000 7fec0cf86740 20 client.9519 trim_cache size 0 max 16384 2024-01-22T05:17:51.465 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:17:51.465 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:17:51.465 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "54cedd7f-8a8a-4fdf-ae16-74d9bbdd64d0", 2024-01-22T05:17:51.465 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:17:51.465 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:17:51.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.462+0000 7fec02a00700 1 -- 172.21.15.49:0/785852089 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7febd405a510 msgr2=0x7febd405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.462+0000 7fec02a00700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7febd405a510 0x7febd405c9d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7febec00b9a0 tx=0x7febec008040).stop 2024-01-22T05:17:51.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.462+0000 7fec02a00700 1 -- 172.21.15.49:0/785852089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc146de0 msgr2=0x7febfc149550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.462+0000 7fec02a00700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc146de0 0x7febfc149550 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7febe400e780 tx=0x7febe4000d00).stop 2024-01-22T05:17:51.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.462+0000 7fec02a00700 1 -- 172.21.15.49:0/785852089 shutdown_connections 2024-01-22T05:17:51.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.462+0000 7fec02a00700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7febd405a510 0x7febd405c9d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.462+0000 7fec02a00700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febfc149a40 0x7febfc0a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.462+0000 7fec02a00700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc146de0 0x7febfc149550 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.462+0000 7fec02a00700 1 --2- 172.21.15.49:0/785852089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febdc004b80 0x7febfc13ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.462+0000 7fec02a00700 1 -- 172.21.15.49:0/785852089 >> 172.21.15.49:0/785852089 conn(0x7febfc0c3830 msgr2=0x7febfc062bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:51.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.462+0000 7fec02a00700 1 -- 172.21.15.49:0/785852089 shutdown_connections 2024-01-22T05:17:51.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.462+0000 7fec02a00700 1 -- 172.21.15.49:0/785852089 wait complete. 2024-01-22T05:17:51.485 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.10:0 scrub status 2024-01-22T05:17:51.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.642+0000 7f69e2a00700 1 Processor -- start 2024-01-22T05:17:51.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.642+0000 7f69e2a00700 1 -- start start 2024-01-22T05:17:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69e2a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69dc0bf1d0 0x7f69dc0be0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69e2a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f69dc0be5a0 0x7f69dc151e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69e2a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69dc068070 con 0x7f69dc067a90 2024-01-22T05:17:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69e2a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69dc1564d0 con 0x7f69dc0be5a0 2024-01-22T05:17:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69e2a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc0a7e20 con 0x7f69dc0bf1d0 2024-01-22T05:17:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69dbe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f69dc067a90 0x7f69dc0bd9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44622/0 (socket says 172.21.15.49:44622) 2024-01-22T05:17:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69dbe00700 1 -- 172.21.15.49:0/4142957924 learned_addr learned my addr 172.21.15.49:0/4142957924 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:17:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69db400700 1 --2- 172.21.15.49:0/4142957924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69dc0bf1d0 0x7f69dc0be0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69e0a00700 1 --2- 172.21.15.49:0/4142957924 >> v2:172.21.15.110:3300/0 conn(0x7f69dc0be5a0 0x7f69dc151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 -- 172.21.15.49:0/4142957924 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155459745 0 0) 0x7f69dc068070 con 0x7f69dc067a90 2024-01-22T05:17:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 -- 172.21.15.49:0/4142957924 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69bc0033f0 con 0x7f69dc067a90 2024-01-22T05:17:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 -- 172.21.15.49:0/4142957924 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4250986461 0 0) 0x7f69bc0033f0 con 0x7f69dc067a90 2024-01-22T05:17:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 -- 172.21.15.49:0/4142957924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69dc0bf1d0 msgr2=0x7f69dc0be0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 --2- 172.21.15.49:0/4142957924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69dc0bf1d0 0x7f69dc0be0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 -- 172.21.15.49:0/4142957924 >> v2:172.21.15.110:3300/0 conn(0x7f69dc0be5a0 msgr2=0x7f69dc151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 --2- 172.21.15.49:0/4142957924 >> v2:172.21.15.110:3300/0 conn(0x7f69dc0be5a0 0x7f69dc151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 -- 172.21.15.49:0/4142957924 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc068350 con 0x7f69dc067a90 2024-01-22T05:17:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 -- 172.21.15.49:0/4142957924 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f69cc001470 con 0x7f69dc067a90 2024-01-22T05:17:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 -- 172.21.15.49:0/4142957924 >> v1:172.21.15.49:6789/0 conn(0x7f69dc067a90 legacy=0x7f69dc0bd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 --2- 172.21.15.49:0/4142957924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69bc003910 0x7f69bc003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 --2- 172.21.15.49:0/4142957924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc004690 0x7f69bc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 --2- 172.21.15.49:0/4142957924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69dc0bf1d0 0x7f69bc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 -- 172.21.15.49:0/4142957924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc0a7e20 con 0x7f69bc004690 2024-01-22T05:17:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 -- 172.21.15.49:0/4142957924 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc005540 con 0x7f69bc003910 2024-01-22T05:17:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69daa00700 1 -- 172.21.15.49:0/4142957924 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc00b960 con 0x7f69dc0bf1d0 2024-01-22T05:17:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69db400700 1 --2- 172.21.15.49:0/4142957924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc004690 0x7f69bc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69dbe00700 1 --2- 172.21.15.49:0/4142957924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69bc003910 0x7f69bc003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69e0a00700 1 --2- 172.21.15.49:0/4142957924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69dc0bf1d0 0x7f69bc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69db400700 1 -- 172.21.15.49:0/4142957924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69dc0bf1d0 msgr2=0x7f69bc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69db400700 1 --2- 172.21.15.49:0/4142957924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69dc0bf1d0 0x7f69bc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69db400700 1 -- 172.21.15.49:0/4142957924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69bc003910 msgr2=0x7f69bc003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69db400700 1 --2- 172.21.15.49:0/4142957924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69bc003910 0x7f69bc003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69db400700 1 -- 172.21.15.49:0/4142957924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc0033f0 con 0x7f69bc004690 2024-01-22T05:17:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.646+0000 7f69db400700 1 --2- 172.21.15.49:0/4142957924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc004690 0x7f69bc004b10 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f69c4009a80 tx=0x7f69c4009060).ready entity=mon.0 client_cookie=9e04b426158e3443 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.650+0000 7f69daa00700 1 -- 172.21.15.49:0/4142957924 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c4009430 con 0x7f69bc004690 2024-01-22T05:17:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.650+0000 7f69daa00700 1 -- 172.21.15.49:0/4142957924 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c400e640 con 0x7f69bc004690 2024-01-22T05:17:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.650+0000 7f69daa00700 1 -- 172.21.15.49:0/4142957924 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c400e9c0 con 0x7f69bc004690 2024-01-22T05:17:51.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.650+0000 7f69e2a00700 1 -- 172.21.15.49:0/4142957924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc004690 msgr2=0x7f69bc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.650+0000 7f69e2a00700 1 --2- 172.21.15.49:0/4142957924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc004690 0x7f69bc004b10 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f69c4009a80 tx=0x7f69c4009060).stop 2024-01-22T05:17:51.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.650+0000 7f69e0a00700 1 -- 172.21.15.49:0/4142957924 reap_dead start 2024-01-22T05:17:51.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.650+0000 7f69e2a00700 1 -- 172.21.15.49:0/4142957924 shutdown_connections 2024-01-22T05:17:51.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.650+0000 7f69e2a00700 1 -- 172.21.15.49:0/4142957924 >> 172.21.15.49:0/4142957924 conn(0x7f69dc0c8750 msgr2=0x7f69dc0c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:51.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.650+0000 7f69e2a00700 1 -- 172.21.15.49:0/4142957924 shutdown_connections 2024-01-22T05:17:51.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.650+0000 7f69e2a00700 1 -- 172.21.15.49:0/4142957924 wait complete. 2024-01-22T05:17:51.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.650+0000 7f69e2a00700 1 Processor -- start 2024-01-22T05:17:51.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69e2a00700 1 -- start start 2024-01-22T05:17:51.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69e2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc004690 0x7f69dc161c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69e2a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69dc0ade40 0x7f69dc0ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69e2a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69dc1407b0 0x7f69dc140c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69e2a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc141120 con 0x7f69bc004690 2024-01-22T05:17:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69e2a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc0acda0 con 0x7f69dc1407b0 2024-01-22T05:17:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69e2a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc0ad080 con 0x7f69dc0ade40 2024-01-22T05:17:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69dbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc004690 0x7f69dc161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69dbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc004690 0x7f69dc161c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49344/0 (socket says 172.21.15.49:49344) 2024-01-22T05:17:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69dbe00700 1 -- 172.21.15.49:0/3587169896 learned_addr learned my addr 172.21.15.49:0/3587169896 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69db400700 1 --2- 172.21.15.49:0/3587169896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69dc0ade40 0x7f69dc0ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69e0a00700 1 --2- 172.21.15.49:0/3587169896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69dc1407b0 0x7f69dc140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69dbe00700 1 -- 172.21.15.49:0/3587169896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69dc0ade40 msgr2=0x7f69dc0ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69dbe00700 1 --2- 172.21.15.49:0/3587169896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69dc0ade40 0x7f69dc0ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69dbe00700 1 -- 172.21.15.49:0/3587169896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69dc1407b0 msgr2=0x7f69dc140c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69dbe00700 1 --2- 172.21.15.49:0/3587169896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69dc1407b0 0x7f69dc140c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69dbe00700 1 -- 172.21.15.49:0/3587169896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc0ad360 con 0x7f69bc004690 2024-01-22T05:17:51.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69dbe00700 1 --2- 172.21.15.49:0/3587169896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc004690 0x7f69dc161c40 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f69cc0047e0 tx=0x7f69dc0a7fa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:51.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69d3400700 1 -- 172.21.15.49:0/3587169896 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc011590 con 0x7f69bc004690 2024-01-22T05:17:51.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69d3400700 1 -- 172.21.15.49:0/3587169896 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc0116f0 con 0x7f69bc004690 2024-01-22T05:17:51.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69e2a00700 1 -- 172.21.15.49:0/3587169896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69dc0ad640 con 0x7f69bc004690 2024-01-22T05:17:51.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69d3400700 1 -- 172.21.15.49:0/3587169896 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc011a70 con 0x7f69bc004690 2024-01-22T05:17:51.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.654+0000 7f69e2a00700 1 -- 172.21.15.49:0/3587169896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69dc165770 con 0x7f69bc004690 2024-01-22T05:17:51.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.658+0000 7f69d3400700 1 -- 172.21.15.49:0/3587169896 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f69cc01d3b0 con 0x7f69bc004690 2024-01-22T05:17:51.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.658+0000 7f69d3400700 1 --2- 172.21.15.49:0/3587169896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f69b405a510 0x7f69b405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.658+0000 7f69d3400700 1 -- 172.21.15.49:0/3587169896 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f69cc074120 con 0x7f69bc004690 2024-01-22T05:17:51.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.658+0000 7f69db400700 1 --2- 172.21.15.49:0/3587169896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f69b405a510 0x7f69b405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.658+0000 7f69db400700 1 --2- 172.21.15.49:0/3587169896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f69b405a510 0x7f69b405c9d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f69dc0abb60 tx=0x7f69c401a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.658+0000 7f69ecf09740 1 Processor -- start 2024-01-22T05:17:51.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69ecf09740 1 -- start start 2024-01-22T05:17:51.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69ecf09740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x283f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69ecf09740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27f6aa0 0x27f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69ecf09740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27fb810 0x27f5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69ecf09740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2758540 con 0x283ed00 2024-01-22T05:17:51.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69ecf09740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x271be90 con 0x27fb810 2024-01-22T05:17:51.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69ecf09740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2721d90 con 0x27f6aa0 2024-01-22T05:17:51.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69dbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x283f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69dbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x283f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49356/0 (socket says 172.21.15.49:49356) 2024-01-22T05:17:51.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69dbe00700 1 -- 172.21.15.49:0/2589157184 learned_addr learned my addr 172.21.15.49:0/2589157184 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:51.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69db400700 1 --2- 172.21.15.49:0/2589157184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27f6aa0 0x27f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69e0a00700 1 --2- 172.21.15.49:0/2589157184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27fb810 0x27f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69dbe00700 1 -- 172.21.15.49:0/2589157184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27f6aa0 msgr2=0x27f53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69dbe00700 1 --2- 172.21.15.49:0/2589157184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27f6aa0 0x27f53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69dbe00700 1 -- 172.21.15.49:0/2589157184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27fb810 msgr2=0x27f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69dbe00700 1 --2- 172.21.15.49:0/2589157184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27fb810 0x27f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69dbe00700 1 -- 172.21.15.49:0/2589157184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x27864c0 con 0x283ed00 2024-01-22T05:17:51.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69dbe00700 1 --2- 172.21.15.49:0/2589157184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x283f0e0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f69cc04b070 tx=0x7f69cc012000).ready entity=mon.0 client_cookie=cd9a15ec47c57d9a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:51.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69cb400700 1 -- 172.21.15.49:0/2589157184 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc050b40 con 0x283ed00 2024-01-22T05:17:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69cb400700 1 -- 172.21.15.49:0/2589157184 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc049850 con 0x283ed00 2024-01-22T05:17:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.662+0000 7f69cb400700 1 -- 172.21.15.49:0/2589157184 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc047bc0 con 0x283ed00 2024-01-22T05:17:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.666+0000 7f69ecf09740 1 -- 172.21.15.49:0/2589157184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 msgr2=0x283f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.666+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2589157184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x283f0e0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f69cc04b070 tx=0x7f69cc012000).stop 2024-01-22T05:17:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.666+0000 7f69ecf09740 1 -- 172.21.15.49:0/2589157184 shutdown_connections 2024-01-22T05:17:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.666+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2589157184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27fb810 0x27f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.666+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2589157184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27f6aa0 0x27f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.666+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2589157184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x283f0e0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.666+0000 7f69ecf09740 1 -- 172.21.15.49:0/2589157184 >> 172.21.15.49:0/2589157184 conn(0x25da680 msgr2=0x27f9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.666+0000 7f69ecf09740 1 -- 172.21.15.49:0/2589157184 shutdown_connections 2024-01-22T05:17:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.666+0000 7f69ecf09740 1 -- 172.21.15.49:0/2589157184 wait complete. 2024-01-22T05:17:51.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.666+0000 7f69ecf09740 1 -- start start 2024-01-22T05:17:51.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.666+0000 7f69ecf09740 1 Processor -- start 2024-01-22T05:17:51.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27f6aa0 0x2821e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27fb810 0x283c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x284def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2822380 con 0x283ed00 2024-01-22T05:17:51.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x284ebb0 con 0x27f6aa0 2024-01-22T05:17:51.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2823a30 con 0x27fb810 2024-01-22T05:17:51.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 10 client.0 ll_register_callbacks cb 0x27b25d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:17:51.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69e0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x284def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69e0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x284def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49360/0 (socket says 172.21.15.49:49360) 2024-01-22T05:17:51.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69e0a00700 1 -- 172.21.15.49:0/2068217804 learned_addr learned my addr 172.21.15.49:0/2068217804 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:51.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69dbe00700 1 --2- 172.21.15.49:0/2068217804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27f6aa0 0x2821e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69db400700 1 --2- 172.21.15.49:0/2068217804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27fb810 0x283c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69e0a00700 1 -- 172.21.15.49:0/2068217804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27fb810 msgr2=0x283c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69e0a00700 1 --2- 172.21.15.49:0/2068217804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27fb810 0x283c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69e0a00700 1 -- 172.21.15.49:0/2068217804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27f6aa0 msgr2=0x2821e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69e0a00700 1 --2- 172.21.15.49:0/2068217804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27f6aa0 0x2821e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69e0a00700 1 -- 172.21.15.49:0/2068217804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69dc165770 con 0x283ed00 2024-01-22T05:17:51.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69dbe00700 1 --2- 172.21.15.49:0/2068217804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27f6aa0 0x2821e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:17:51.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69e0a00700 1 --2- 172.21.15.49:0/2068217804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x284def0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f69dc0c9830 tx=0x7f69d400b040).ready entity=mon.0 client_cookie=53bab0343c232929 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:51.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69c3e00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:17:51.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69c3e00700 1 -- 172.21.15.49:0/2068217804 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d400e070 con 0x283ed00 2024-01-22T05:17:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69c3e00700 1 -- 172.21.15.49:0/2068217804 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f69d4015b20 con 0x283ed00 2024-01-22T05:17:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 1 -- 172.21.15.49:0/2068217804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2772230 con 0x283ed00 2024-01-22T05:17:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69c3e00700 1 -- 172.21.15.49:0/2068217804 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69d4018450 con 0x283ed00 2024-01-22T05:17:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 10 client.9531 fetch_fsmap learned FSMap version 126 2024-01-22T05:17:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 1 -- 172.21.15.49:0/2068217804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=126,monmap=2+}) v3 -- 0x27757c0 con 0x283ed00 2024-01-22T05:17:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69c3e00700 1 -- 172.21.15.49:0/2068217804 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2772230 con 0x283ed00 2024-01-22T05:17:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69c3e00700 1 -- 172.21.15.49:0/2068217804 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 126) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f69d4018880 con 0x283ed00 2024-01-22T05:17:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 10 client.9531 fetch_fsmap finished waiting for FSMap version 126 2024-01-22T05:17:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 10 client.9531 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-01-22T05:17:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 20 client.9531 populate_metadata read hostname 'smithi049' 2024-01-22T05:17:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2068217804 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x2824230 0x2824610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 4 client.9531 mds_command: new command op to 9312 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:17:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69ecf09740 1 -- 172.21.15.49:0/2068217804 --> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2768780 con 0x2824230 2024-01-22T05:17:51.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69dbe00700 1 --2- 172.21.15.49:0/2068217804 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x2824230 0x2824610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69c3e00700 10 client.9531 ms_handle_connect on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:51.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.670+0000 7f69dbe00700 1 --2- 172.21.15.49:0/2068217804 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x2824230 0x2824610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f29922c2fd11a059 server_cookie=f4ef79aad87f79cf in_seq=0 out_seq=0 2024-01-22T05:17:51.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.674+0000 7f69c3e00700 1 -- 172.21.15.49:0/2068217804 <== mds.0 v2:172.21.15.49:6836/3762397937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2768780 con 0x2824230 2024-01-22T05:17:51.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.674+0000 7f69c3e00700 10 client.9531 handle_command_reply: tid=0 2024-01-22T05:17:51.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.674+0000 7f69ecf09740 1 client.9531 shutdown 2024-01-22T05:17:51.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.674+0000 7f69ecf09740 1 -- 172.21.15.49:0/2068217804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 msgr2=0x284def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.674+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2068217804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x284def0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f69dc0c9830 tx=0x7f69d400b040).stop 2024-01-22T05:17:51.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.674+0000 7f69ecf09740 1 -- 172.21.15.49:0/2068217804 shutdown_connections 2024-01-22T05:17:51.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.674+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2068217804 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x2824230 0x2824610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.674+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2068217804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x284def0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.674+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2068217804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27fb810 0x283c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.674+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2068217804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27f6aa0 0x2821e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.674+0000 7f69ecf09740 1 -- 172.21.15.49:0/2068217804 >> 172.21.15.49:0/2068217804 conn(0x25da680 msgr2=0x2821080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:51.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.674+0000 7f69c3e00700 0 client.9531 ms_handle_reset on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:51.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.674+0000 7f69ecf09740 1 -- 172.21.15.49:0/2068217804 shutdown_connections 2024-01-22T05:17:51.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.674+0000 7f69ecf09740 1 -- 172.21.15.49:0/2068217804 wait complete. 2024-01-22T05:17:51.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.674+0000 7f69ecf09740 20 client.9531 trim_cache size 0 max 16384 2024-01-22T05:17:51.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69ecf09740 1 Processor -- start 2024-01-22T05:17:51.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69ecf09740 1 -- start start 2024-01-22T05:17:51.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69ecf09740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27f6aa0 0x2821df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69ecf09740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27fb810 0x2841b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69ecf09740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x283ed00 0x27fb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69ecf09740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x27fb600 con 0x27f6aa0 2024-01-22T05:17:51.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69ecf09740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x27f52d0 con 0x283ed00 2024-01-22T05:17:51.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69ecf09740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2785710 con 0x27fb810 2024-01-22T05:17:51.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69dbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27f6aa0 0x2821df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69dbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27f6aa0 0x2821df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49362/0 (socket says 172.21.15.49:49362) 2024-01-22T05:17:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69dbe00700 1 -- 172.21.15.49:0/1347099631 learned_addr learned my addr 172.21.15.49:0/1347099631 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69e0a00700 1 --2- 172.21.15.49:0/1347099631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x283ed00 0x27fb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69db400700 1 --2- 172.21.15.49:0/1347099631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27fb810 0x2841b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69dbe00700 1 -- 172.21.15.49:0/1347099631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27fb810 msgr2=0x2841b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69dbe00700 1 --2- 172.21.15.49:0/1347099631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27fb810 0x2841b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69dbe00700 1 -- 172.21.15.49:0/1347099631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x283ed00 msgr2=0x27fb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69dbe00700 1 --2- 172.21.15.49:0/1347099631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x283ed00 0x27fb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69dbe00700 1 -- 172.21.15.49:0/1347099631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x27709f0 con 0x27f6aa0 2024-01-22T05:17:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69e0a00700 1 --2- 172.21.15.49:0/1347099631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x283ed00 0x27fb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:17:51.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69db400700 1 --2- 172.21.15.49:0/1347099631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27fb810 0x2841b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:17:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69dbe00700 1 --2- 172.21.15.49:0/1347099631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27f6aa0 0x2821df0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7f69cc04aea0 tx=0x7f69cc050000).ready entity=mon.0 client_cookie=63136712915bf0b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69cbe00700 1 -- 172.21.15.49:0/1347099631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc05e0c0 con 0x27f6aa0 2024-01-22T05:17:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69cbe00700 1 -- 172.21.15.49:0/1347099631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc04abb0 con 0x27f6aa0 2024-01-22T05:17:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.690+0000 7f69cbe00700 1 -- 172.21.15.49:0/1347099631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc072110 con 0x27f6aa0 2024-01-22T05:17:51.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.694+0000 7f69ecf09740 1 -- 172.21.15.49:0/1347099631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27f6aa0 msgr2=0x2821df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.694+0000 7f69ecf09740 1 --2- 172.21.15.49:0/1347099631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27f6aa0 0x2821df0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7f69cc04aea0 tx=0x7f69cc050000).stop 2024-01-22T05:17:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.694+0000 7f69ecf09740 1 -- 172.21.15.49:0/1347099631 shutdown_connections 2024-01-22T05:17:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.694+0000 7f69ecf09740 1 --2- 172.21.15.49:0/1347099631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x283ed00 0x27fb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.694+0000 7f69ecf09740 1 --2- 172.21.15.49:0/1347099631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27fb810 0x2841b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.694+0000 7f69ecf09740 1 --2- 172.21.15.49:0/1347099631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x27f6aa0 0x2821df0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.694+0000 7f69ecf09740 1 -- 172.21.15.49:0/1347099631 >> 172.21.15.49:0/1347099631 conn(0x25da680 msgr2=0x2825db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.694+0000 7f69ecf09740 1 -- 172.21.15.49:0/1347099631 shutdown_connections 2024-01-22T05:17:51.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.694+0000 7f69ecf09740 1 -- 172.21.15.49:0/1347099631 wait complete. 2024-01-22T05:17:51.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.694+0000 7f69ecf09740 1 -- start start 2024-01-22T05:17:51.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.694+0000 7f69ecf09740 1 Processor -- start 2024-01-22T05:17:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27f6aa0 0x28a0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27fb810 0x28224c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x28229b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x27f60d0 con 0x283ed00 2024-01-22T05:17:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x281f8e0 con 0x27f6aa0 2024-01-22T05:17:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x28a3c40 con 0x27fb810 2024-01-22T05:17:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 10 client.0 ll_register_callbacks cb 0x7f69d40079f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:17:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69e0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x28229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69e0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x28229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49364/0 (socket says 172.21.15.49:49364) 2024-01-22T05:17:51.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69e0a00700 1 -- 172.21.15.49:0/2252670939 learned_addr learned my addr 172.21.15.49:0/2252670939 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:17:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69e0a00700 1 -- 172.21.15.49:0/2252670939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27fb810 msgr2=0x28224c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69e0a00700 1 --2- 172.21.15.49:0/2252670939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27fb810 0x28224c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:17:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69e0a00700 1 -- 172.21.15.49:0/2252670939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27f6aa0 msgr2=0x28a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:17:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69e0a00700 1 --2- 172.21.15.49:0/2252670939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27f6aa0 0x28a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:17:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69e0a00700 1 -- 172.21.15.49:0/2252670939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69cc056040 con 0x283ed00 2024-01-22T05:17:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69e0a00700 1 --2- 172.21.15.49:0/2252670939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x28229b0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f69d4009930 tx=0x7f69d4024000).ready entity=mon.0 client_cookie=8d8465f8a8760009 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:17:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69c3e00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:17:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69c3e00700 1 -- 172.21.15.49:0/2252670939 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d40070d0 con 0x283ed00 2024-01-22T05:17:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 1 -- 172.21.15.49:0/2252670939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f69cc049850 con 0x283ed00 2024-01-22T05:17:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69c3e00700 1 -- 172.21.15.49:0/2252670939 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f69d4015b20 con 0x283ed00 2024-01-22T05:17:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69c3e00700 1 -- 172.21.15.49:0/2252670939 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69d4015940 con 0x283ed00 2024-01-22T05:17:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 10 client.9537 fetch_fsmap learned FSMap version 126 2024-01-22T05:17:51.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 1 -- 172.21.15.49:0/2252670939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=126,monmap=2+}) v3 -- 0x2770740 con 0x283ed00 2024-01-22T05:17:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69c3e00700 1 -- 172.21.15.49:0/2252670939 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc049850 con 0x283ed00 2024-01-22T05:17:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69c3e00700 1 -- 172.21.15.49:0/2252670939 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 126) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f69d4031320 con 0x283ed00 2024-01-22T05:17:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 10 client.9537 fetch_fsmap finished waiting for FSMap version 126 2024-01-22T05:17:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 10 client.9537 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-01-22T05:17:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 20 client.9537 populate_metadata read hostname 'smithi049' 2024-01-22T05:17:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2252670939 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x28a12a0 0x28a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:17:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 4 client.9537 mds_command: new command op to 9312 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:17:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69ecf09740 1 -- 172.21.15.49:0/2252670939 --> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x2631610 con 0x28a12a0 2024-01-22T05:17:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69dbe00700 1 --2- 172.21.15.49:0/2252670939 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x28a12a0 0x28a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:17:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69dbe00700 1 --2- 172.21.15.49:0/2252670939 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x28a12a0 0x28a16b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=283d1a2ae60e3e01 server_cookie=80dfd29749787462 in_seq=0 out_seq=0 2024-01-22T05:17:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.698+0000 7f69c3e00700 10 client.9537 ms_handle_connect on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69c3e00700 1 -- 172.21.15.49:0/2252670939 <== mds.0 v2:172.21.15.49:6836/3762397937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+257 (crc 0 0 0) 0x2631610 con 0x28a12a0 2024-01-22T05:17:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69c3e00700 10 client.9537 handle_command_reply: tid=0 2024-01-22T05:17:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69ecf09740 1 client.9537 shutdown 2024-01-22T05:17:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69ecf09740 1 -- 172.21.15.49:0/2252670939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 msgr2=0x28229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2252670939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x28229b0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f69d4009930 tx=0x7f69d4024000).stop 2024-01-22T05:17:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69ecf09740 1 -- 172.21.15.49:0/2252670939 shutdown_connections 2024-01-22T05:17:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2252670939 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x28a12a0 0x28a16b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2252670939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x283ed00 0x28229b0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2252670939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x27fb810 0x28224c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:17:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69c3e00700 0 client.9537 ms_handle_reset on v2:172.21.15.49:6836/3762397937 2024-01-22T05:17:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69ecf09740 1 --2- 172.21.15.49:0/2252670939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x27f6aa0 0x28a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:17:51.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69ecf09740 1 -- 172.21.15.49:0/2252670939 >> 172.21.15.49:0/2252670939 conn(0x25da680 msgr2=0x27f5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69ecf09740 1 -- 172.21.15.49:0/2252670939 shutdown_connections 2024-01-22T05:17:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69ecf09740 1 -- 172.21.15.49:0/2252670939 wait complete. 2024-01-22T05:17:51.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69ecf09740 20 client.9537 trim_cache size 0 max 16384 2024-01-22T05:17:51.705 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:17:51.705 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-01-22T05:17:51.705 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-01-22T05:17:51.705 INFO:teuthology.orchestra.run.smithi049.stdout: "54cedd7f-8a8a-4fdf-ae16-74d9bbdd64d0": { 2024-01-22T05:17:51.705 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "~mds0", 2024-01-22T05:17:51.705 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "54cedd7f-8a8a-4fdf-ae16-74d9bbdd64d0", 2024-01-22T05:17:51.705 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive" 2024-01-22T05:17:51.706 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:51.706 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:17:51.706 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:17:51.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69e2a00700 1 -- 172.21.15.49:0/3587169896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f69b405a510 msgr2=0x7f69b405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69e2a00700 1 --2- 172.21.15.49:0/3587169896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f69b405a510 0x7f69b405c9d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f69dc0abb60 tx=0x7f69c401a000).stop 2024-01-22T05:17:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69e2a00700 1 -- 172.21.15.49:0/3587169896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc004690 msgr2=0x7f69dc161c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:17:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69e2a00700 1 --2- 172.21.15.49:0/3587169896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc004690 0x7f69dc161c40 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f69cc0047e0 tx=0x7f69dc0a7fa0).stop 2024-01-22T05:17:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69e2a00700 1 -- 172.21.15.49:0/3587169896 shutdown_connections 2024-01-22T05:17:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69e2a00700 1 --2- 172.21.15.49:0/3587169896 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f69b405a510 0x7f69b405c9d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69e2a00700 1 --2- 172.21.15.49:0/3587169896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69dc1407b0 0x7f69dc140c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69e2a00700 1 --2- 172.21.15.49:0/3587169896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69dc0ade40 0x7f69dc0ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69e2a00700 1 --2- 172.21.15.49:0/3587169896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc004690 0x7f69dc161c40 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:17:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69e2a00700 1 -- 172.21.15.49:0/3587169896 >> 172.21.15.49:0/3587169896 conn(0x7f69dc0c8750 msgr2=0x7f69dc0c64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:17:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69e2a00700 1 -- 172.21.15.49:0/3587169896 shutdown_connections 2024-01-22T05:17:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:17:51.702+0000 7f69e2a00700 1 -- 172.21.15.49:0/3587169896 wait complete. 2024-01-22T05:17:51.724 INFO:tasks.cephfs.filesystem:scrub status for tag:54cedd7f-8a8a-4fdf-ae16-74d9bbdd64d0 - {'path': '~mds0', 'tag': '54cedd7f-8a8a-4fdf-ae16-74d9bbdd64d0', 'options': 'recursive'} 2024-01-22T05:18:09.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:18:09.875 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:18:21.725 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.10:0 scrub status 2024-01-22T05:18:21.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.898+0000 7fc8b2e00700 1 Processor -- start 2024-01-22T05:18:21.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.902+0000 7fc8b2e00700 1 -- start start 2024-01-22T05:18:21.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8b2e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc8ac14b100 0x7fc8ac0beae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8b2e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8ac0befd0 0x7fc8ac0c4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8b2e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc8ac0c4540 0x7fc8ac067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8b2e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8ac0c3b40 con 0x7fc8ac0c4540 2024-01-22T05:18:21.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8b2e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8ac155110 con 0x7fc8ac14b100 2024-01-22T05:18:21.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8b2e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac154500 con 0x7fc8ac0befd0 2024-01-22T05:18:21.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8b1800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc8ac0c4540 0x7fc8ac067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8ab400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8ac0befd0 0x7fc8ac0c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8ab400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8ac0befd0 0x7fc8ac0c4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:59562/0 (socket says 172.21.15.49:59562) 2024-01-22T05:18:21.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8ab400700 1 -- 172.21.15.49:0/3928577552 learned_addr learned my addr 172.21.15.49:0/3928577552 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:21.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8abe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc8ac14b100 0x7fc8ac0beae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8b1800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc8ac0c4540 0x7fc8ac067a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40926/0 (socket says 172.21.15.49:40926) 2024-01-22T05:18:21.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8ab400700 1 -- 172.21.15.49:0/3928577552 >> v2:172.21.15.110:3300/0 conn(0x7fc8ac14b100 msgr2=0x7fc8ac0beae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:21.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8ab400700 1 --2- 172.21.15.49:0/3928577552 >> v2:172.21.15.110:3300/0 conn(0x7fc8ac14b100 0x7fc8ac0beae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8ab400700 1 -- 172.21.15.49:0/3928577552 >> v2:172.21.15.49:3300/0 conn(0x7fc8ac0c4540 msgr2=0x7fc8ac067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:21.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8ab400700 1 --2- 172.21.15.49:0/3928577552 >> v2:172.21.15.49:3300/0 conn(0x7fc8ac0c4540 0x7fc8ac067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8ab400700 1 -- 172.21.15.49:0/3928577552 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac1547e0 con 0x7fc8ac0befd0 2024-01-22T05:18:21.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8ab400700 1 --2- 172.21.15.49:0/3928577552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8ac0befd0 0x7fc8ac0c4050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fc8ac0632d0 tx=0x7fc8940090f0).ready entity=mon.2 client_cookie=5159c8c775b37a36 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:21.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8aaa00700 1 -- 172.21.15.49:0/3928577552 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89400f510 con 0x7fc8ac0befd0 2024-01-22T05:18:21.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8aaa00700 1 -- 172.21.15.49:0/3928577552 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89400f670 con 0x7fc8ac0befd0 2024-01-22T05:18:21.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8aaa00700 1 -- 172.21.15.49:0/3928577552 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89400fa10 con 0x7fc8ac0befd0 2024-01-22T05:18:21.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8b2e00700 1 -- 172.21.15.49:0/3928577552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8ac0befd0 msgr2=0x7fc8ac0c4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:21.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.906+0000 7fc8b2e00700 1 --2- 172.21.15.49:0/3928577552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8ac0befd0 0x7fc8ac0c4050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fc8ac0632d0 tx=0x7fc8940090f0).stop 2024-01-22T05:18:21.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.910+0000 7fc8b2e00700 1 -- 172.21.15.49:0/3928577552 shutdown_connections 2024-01-22T05:18:21.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.910+0000 7fc8b2e00700 1 --2- 172.21.15.49:0/3928577552 >> v2:172.21.15.49:3300/0 conn(0x7fc8ac0c4540 0x7fc8ac067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.910+0000 7fc8b2e00700 1 --2- 172.21.15.49:0/3928577552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8ac0befd0 0x7fc8ac0c4050 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.910+0000 7fc8b2e00700 1 --2- 172.21.15.49:0/3928577552 >> v2:172.21.15.110:3300/0 conn(0x7fc8ac14b100 0x7fc8ac0beae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.910+0000 7fc8b2e00700 1 -- 172.21.15.49:0/3928577552 >> 172.21.15.49:0/3928577552 conn(0x7fc8ac0c8fb0 msgr2=0x7fc8ac0c4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:21.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.910+0000 7fc8b2e00700 1 -- 172.21.15.49:0/3928577552 shutdown_connections 2024-01-22T05:18:21.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.910+0000 7fc8b2e00700 1 -- 172.21.15.49:0/3928577552 wait complete. 2024-01-22T05:18:21.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.910+0000 7fc8b2e00700 1 Processor -- start 2024-01-22T05:18:21.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.910+0000 7fc8b2e00700 1 -- start start 2024-01-22T05:18:21.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8b2e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8ac0befd0 0x7fc8ac164870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8b2e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8ac0c4540 0x7fc8ac164d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8b2e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8ac14b100 0x7fc8ac0c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8b2e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac0ae340 con 0x7fc8ac0c4540 2024-01-22T05:18:21.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8b2e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac0c0670 con 0x7fc8ac0befd0 2024-01-22T05:18:21.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8b2e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac0bfa60 con 0x7fc8ac14b100 2024-01-22T05:18:21.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8ab400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8ac0c4540 0x7fc8ac164d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8ab400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8ac0c4540 0x7fc8ac164d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40932/0 (socket says 172.21.15.49:40932) 2024-01-22T05:18:21.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8ab400700 1 -- 172.21.15.49:0/4133291013 learned_addr learned my addr 172.21.15.49:0/4133291013 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:21.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8b1800700 1 --2- 172.21.15.49:0/4133291013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8ac14b100 0x7fc8ac0c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8abe00700 1 --2- 172.21.15.49:0/4133291013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8ac0befd0 0x7fc8ac164870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8ab400700 1 -- 172.21.15.49:0/4133291013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8ac14b100 msgr2=0x7fc8ac0c16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:21.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8ab400700 1 --2- 172.21.15.49:0/4133291013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8ac14b100 0x7fc8ac0c16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8ab400700 1 -- 172.21.15.49:0/4133291013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8ac0befd0 msgr2=0x7fc8ac164870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:21.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8ab400700 1 --2- 172.21.15.49:0/4133291013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8ac0befd0 0x7fc8ac164870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8ab400700 1 -- 172.21.15.49:0/4133291013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc894009370 con 0x7fc8ac0c4540 2024-01-22T05:18:21.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8ab400700 1 --2- 172.21.15.49:0/4133291013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8ac0c4540 0x7fc8ac164d60 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7fc894011fc0 tx=0x7fc894017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:21.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8a3400700 1 -- 172.21.15.49:0/4133291013 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894000bc0 con 0x7fc8ac0c4540 2024-01-22T05:18:21.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8a3400700 1 -- 172.21.15.49:0/4133291013 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89400f7e0 con 0x7fc8ac0c4540 2024-01-22T05:18:21.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.914+0000 7fc8b2e00700 1 -- 172.21.15.49:0/4133291013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ac0bfd40 con 0x7fc8ac0c4540 2024-01-22T05:18:21.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.918+0000 7fc8a3400700 1 -- 172.21.15.49:0/4133291013 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894024470 con 0x7fc8ac0c4540 2024-01-22T05:18:21.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.918+0000 7fc8b2e00700 1 -- 172.21.15.49:0/4133291013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ac0c0300 con 0x7fc8ac0c4540 2024-01-22T05:18:21.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.918+0000 7fc8a3400700 1 -- 172.21.15.49:0/4133291013 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc894021070 con 0x7fc8ac0c4540 2024-01-22T05:18:21.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.922+0000 7fc8a3400700 1 --2- 172.21.15.49:0/4133291013 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc88405a510 0x7fc88405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.922+0000 7fc8a3400700 1 -- 172.21.15.49:0/4133291013 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc894076240 con 0x7fc8ac0c4540 2024-01-22T05:18:21.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.922+0000 7fc8abe00700 1 --2- 172.21.15.49:0/4133291013 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc88405a510 0x7fc88405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.922+0000 7fc8abe00700 1 --2- 172.21.15.49:0/4133291013 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc88405a510 0x7fc88405c9d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fc89c009b90 tx=0x7fc89c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:21.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.922+0000 7fc8bd308740 1 Processor -- start 2024-01-22T05:18:21.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.926+0000 7fc8bd308740 1 -- start start 2024-01-22T05:18:21.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.926+0000 7fc8bd308740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11034d0 0x11038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.926+0000 7fc8bd308740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x110a570 0x110a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.926+0000 7fc8bd308740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110aee0 0x10e94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.926+0000 7fc8bd308740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x101b540 con 0x11034d0 2024-01-22T05:18:21.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.926+0000 7fc8bd308740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xfdee90 con 0x110aee0 2024-01-22T05:18:21.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.926+0000 7fc8bd308740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xfe4d90 con 0x110a570 2024-01-22T05:18:21.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.926+0000 7fc8abe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11034d0 0x11038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.926+0000 7fc8abe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11034d0 0x11038b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40936/0 (socket says 172.21.15.49:40936) 2024-01-22T05:18:21.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.926+0000 7fc8abe00700 1 -- 172.21.15.49:0/4222360520 learned_addr learned my addr 172.21.15.49:0/4222360520 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:21.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.926+0000 7fc8b1800700 1 --2- 172.21.15.49:0/4222360520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110aee0 0x10e94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.926+0000 7fc8ab400700 1 --2- 172.21.15.49:0/4222360520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x110a570 0x110a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8abe00700 1 -- 172.21.15.49:0/4222360520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x110a570 msgr2=0x110a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:21.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8abe00700 1 --2- 172.21.15.49:0/4222360520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x110a570 0x110a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8abe00700 1 -- 172.21.15.49:0/4222360520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110aee0 msgr2=0x10e94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:21.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8abe00700 1 --2- 172.21.15.49:0/4222360520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110aee0 0x10e94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8abe00700 1 -- 172.21.15.49:0/4222360520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10494c0 con 0x11034d0 2024-01-22T05:18:21.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8abe00700 1 --2- 172.21.15.49:0/4222360520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11034d0 0x11038b0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7fc89c011cf0 tx=0x7fc89c017000).ready entity=mon.0 client_cookie=7f08d19fbbd342cd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:21.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc89be00700 1 -- 172.21.15.49:0/4222360520 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c011ea0 con 0x11034d0 2024-01-22T05:18:21.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc89be00700 1 -- 172.21.15.49:0/4222360520 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c014be0 con 0x11034d0 2024-01-22T05:18:21.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc89be00700 1 -- 172.21.15.49:0/4222360520 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c01e3f0 con 0x11034d0 2024-01-22T05:18:21.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8bd308740 1 -- 172.21.15.49:0/4222360520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11034d0 msgr2=0x11038b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:21.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8bd308740 1 --2- 172.21.15.49:0/4222360520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11034d0 0x11038b0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7fc89c011cf0 tx=0x7fc89c017000).stop 2024-01-22T05:18:21.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8bd308740 1 -- 172.21.15.49:0/4222360520 shutdown_connections 2024-01-22T05:18:21.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8bd308740 1 --2- 172.21.15.49:0/4222360520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110aee0 0x10e94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8bd308740 1 --2- 172.21.15.49:0/4222360520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x110a570 0x110a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8bd308740 1 --2- 172.21.15.49:0/4222360520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11034d0 0x11038b0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8bd308740 1 -- 172.21.15.49:0/4222360520 >> 172.21.15.49:0/4222360520 conn(0xe9d680 msgr2=0x10bcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:21.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8bd308740 1 -- 172.21.15.49:0/4222360520 shutdown_connections 2024-01-22T05:18:21.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8bd308740 1 -- 172.21.15.49:0/4222360520 wait complete. 2024-01-22T05:18:21.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.930+0000 7fc8bd308740 1 -- start start 2024-01-22T05:18:21.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.934+0000 7fc8bd308740 1 Processor -- start 2024-01-22T05:18:21.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.934+0000 7fc8bd308740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11034d0 0x1111d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.934+0000 7fc8bd308740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x110a570 0x11027b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.934+0000 7fc8bd308740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110aee0 0x10e69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.934+0000 7fc8bd308740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1112260 con 0x110a570 2024-01-22T05:18:21.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.934+0000 7fc8bd308740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x11126a0 con 0x110aee0 2024-01-22T05:18:21.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.934+0000 7fc8bd308740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x10e58f0 con 0x11034d0 2024-01-22T05:18:21.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.934+0000 7fc8bd308740 10 client.0 ll_register_callbacks cb 0x10755d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:18:21.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.934+0000 7fc8ab400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x110a570 0x11027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.934+0000 7fc8ab400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x110a570 0x11027b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40952/0 (socket says 172.21.15.49:40952) 2024-01-22T05:18:21.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.934+0000 7fc8ab400700 1 -- 172.21.15.49:0/104159163 learned_addr learned my addr 172.21.15.49:0/104159163 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:21.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.934+0000 7fc8b1800700 1 --2- 172.21.15.49:0/104159163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110aee0 0x10e69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.934+0000 7fc8abe00700 1 --2- 172.21.15.49:0/104159163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11034d0 0x1111d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8ab400700 1 -- 172.21.15.49:0/104159163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11034d0 msgr2=0x1111d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:21.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8ab400700 1 --2- 172.21.15.49:0/104159163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11034d0 0x1111d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8ab400700 1 -- 172.21.15.49:0/104159163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110aee0 msgr2=0x10e69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:21.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8ab400700 1 --2- 172.21.15.49:0/104159163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110aee0 0x10e69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8ab400700 1 -- 172.21.15.49:0/104159163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89c0118e0 con 0x110a570 2024-01-22T05:18:21.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8ab400700 1 --2- 172.21.15.49:0/104159163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x110a570 0x11027b0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7fc89404d3f0 tx=0x7fc894076040).ready entity=mon.0 client_cookie=85e3ec9cd5f8cf9e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:21.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc898c00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:18:21.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc898c00700 1 -- 172.21.15.49:0/104159163 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89404ce20 con 0x110a570 2024-01-22T05:18:21.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc898c00700 1 -- 172.21.15.49:0/104159163 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc89404d460 con 0x110a570 2024-01-22T05:18:21.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8bd308740 1 -- 172.21.15.49:0/104159163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1035230 con 0x110a570 2024-01-22T05:18:21.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc898c00700 1 -- 172.21.15.49:0/104159163 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc894022580 con 0x110a570 2024-01-22T05:18:21.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8bd308740 10 client.9549 fetch_fsmap learned FSMap version 126 2024-01-22T05:18:21.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8bd308740 1 -- 172.21.15.49:0/104159163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=126,monmap=2+}) v3 -- 0x10387c0 con 0x110a570 2024-01-22T05:18:21.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc898c00700 1 -- 172.21.15.49:0/104159163 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1035230 con 0x110a570 2024-01-22T05:18:21.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc898c00700 1 -- 172.21.15.49:0/104159163 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 126) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc89404c9b0 con 0x110a570 2024-01-22T05:18:21.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8bd308740 10 client.9549 fetch_fsmap finished waiting for FSMap version 126 2024-01-22T05:18:21.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8bd308740 10 client.9549 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-01-22T05:18:21.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8bd308740 20 client.9549 populate_metadata read hostname 'smithi049' 2024-01-22T05:18:21.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8bd308740 1 --2- 172.21.15.49:0/104159163 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x10e4000 0x1110b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8bd308740 4 client.9549 mds_command: new command op to 9312 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:18:21.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8bd308740 1 -- 172.21.15.49:0/104159163 --> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x102b780 con 0x10e4000 2024-01-22T05:18:21.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8abe00700 1 --2- 172.21.15.49:0/104159163 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x10e4000 0x1110b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc8abe00700 1 --2- 172.21.15.49:0/104159163 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x10e4000 0x1110b80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8d07e3564d9f56b6 server_cookie=7d0b9eed97b1834f in_seq=0 out_seq=0 2024-01-22T05:18:21.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.938+0000 7fc898c00700 10 client.9549 ms_handle_connect on v2:172.21.15.49:6836/3762397937 2024-01-22T05:18:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.942+0000 7fc898c00700 1 -- 172.21.15.49:0/104159163 <== mds.0 v2:172.21.15.49:6836/3762397937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x102b780 con 0x10e4000 2024-01-22T05:18:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.942+0000 7fc898c00700 10 client.9549 handle_command_reply: tid=0 2024-01-22T05:18:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.942+0000 7fc8bd308740 1 client.9549 shutdown 2024-01-22T05:18:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.942+0000 7fc8bd308740 1 -- 172.21.15.49:0/104159163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x110a570 msgr2=0x11027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.942+0000 7fc8bd308740 1 --2- 172.21.15.49:0/104159163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x110a570 0x11027b0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7fc89404d3f0 tx=0x7fc894076040).stop 2024-01-22T05:18:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.942+0000 7fc8bd308740 1 -- 172.21.15.49:0/104159163 shutdown_connections 2024-01-22T05:18:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.942+0000 7fc8bd308740 1 --2- 172.21.15.49:0/104159163 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x10e4000 0x1110b80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.942+0000 7fc8bd308740 1 --2- 172.21.15.49:0/104159163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110aee0 0x10e69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.942+0000 7fc8bd308740 1 --2- 172.21.15.49:0/104159163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x110a570 0x11027b0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.942+0000 7fc8bd308740 1 --2- 172.21.15.49:0/104159163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x11034d0 0x1111d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.942+0000 7fc898c00700 0 client.9549 ms_handle_reset on v2:172.21.15.49:6836/3762397937 2024-01-22T05:18:21.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.942+0000 7fc8bd308740 1 -- 172.21.15.49:0/104159163 >> 172.21.15.49:0/104159163 conn(0xe9d680 msgr2=0x11038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:21.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.942+0000 7fc8bd308740 1 -- 172.21.15.49:0/104159163 shutdown_connections 2024-01-22T05:18:21.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.942+0000 7fc8bd308740 1 -- 172.21.15.49:0/104159163 wait complete. 2024-01-22T05:18:21.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.942+0000 7fc8bd308740 20 client.9549 trim_cache size 0 max 16384 2024-01-22T05:18:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8bd308740 1 Processor -- start 2024-01-22T05:18:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8bd308740 1 -- start start 2024-01-22T05:18:21.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8bd308740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11034d0 0x10e6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8bd308740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x110a570 0x10fe8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8bd308740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x110aee0 0x10e6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8bd308740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x10b3e00 con 0x110a570 2024-01-22T05:18:21.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8bd308740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x10b3330 con 0x11034d0 2024-01-22T05:18:21.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8bd308740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x10e7af0 con 0x110aee0 2024-01-22T05:18:21.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8ab400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x110a570 0x10fe8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8abe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11034d0 0x10e6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8abe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11034d0 0x10e6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:52946/0 (socket says 172.21.15.49:52946) 2024-01-22T05:18:21.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8abe00700 1 -- 172.21.15.49:0/2876995602 learned_addr learned my addr 172.21.15.49:0/2876995602 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:21.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8b1800700 1 --2- 172.21.15.49:0/2876995602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x110aee0 0x10e6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8abe00700 1 -- 172.21.15.49:0/2876995602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x110aee0 msgr2=0x10e6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:21.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8abe00700 1 --2- 172.21.15.49:0/2876995602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x110aee0 0x10e6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8abe00700 1 -- 172.21.15.49:0/2876995602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x110a570 msgr2=0x10fe8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:21.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8abe00700 1 --2- 172.21.15.49:0/2876995602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x110a570 0x10fe8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.962+0000 7fc8abe00700 1 -- 172.21.15.49:0/2876995602 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1102b10 con 0x11034d0 2024-01-22T05:18:21.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.966+0000 7fc8abe00700 1 --2- 172.21.15.49:0/2876995602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11034d0 0x10e6610 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x102a520 tx=0x7fc89c021000).ready entity=mon.1 client_cookie=f0116524cbccf415 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:21.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.966+0000 7fc8a0c00700 1 -- 172.21.15.49:0/2876995602 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c030040 con 0x11034d0 2024-01-22T05:18:21.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.966+0000 7fc8a0c00700 1 -- 172.21.15.49:0/2876995602 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c011b10 con 0x11034d0 2024-01-22T05:18:21.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.966+0000 7fc8a0c00700 1 -- 172.21.15.49:0/2876995602 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c011dd0 con 0x11034d0 2024-01-22T05:18:21.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.966+0000 7fc8bd308740 1 -- 172.21.15.49:0/2876995602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11034d0 msgr2=0x10e6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:21.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.966+0000 7fc8bd308740 1 --2- 172.21.15.49:0/2876995602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11034d0 0x10e6610 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x102a520 tx=0x7fc89c021000).stop 2024-01-22T05:18:21.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.966+0000 7fc8bd308740 1 -- 172.21.15.49:0/2876995602 shutdown_connections 2024-01-22T05:18:21.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.966+0000 7fc8bd308740 1 --2- 172.21.15.49:0/2876995602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x110aee0 0x10e6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.966+0000 7fc8bd308740 1 --2- 172.21.15.49:0/2876995602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x110a570 0x10fe8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.966+0000 7fc8bd308740 1 --2- 172.21.15.49:0/2876995602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x11034d0 0x10e6610 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.966+0000 7fc8bd308740 1 -- 172.21.15.49:0/2876995602 >> 172.21.15.49:0/2876995602 conn(0xe9d680 msgr2=0x10ea840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:21.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.966+0000 7fc8bd308740 1 -- 172.21.15.49:0/2876995602 shutdown_connections 2024-01-22T05:18:21.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.966+0000 7fc8bd308740 1 -- 172.21.15.49:0/2876995602 wait complete. 2024-01-22T05:18:21.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.966+0000 7fc8bd308740 1 -- start start 2024-01-22T05:18:21.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.966+0000 7fc8bd308740 1 Processor -- start 2024-01-22T05:18:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8bd308740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11034d0 0x11662b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8bd308740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110a570 0x11115b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8bd308740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x110aee0 0x1111aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8bd308740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1168800 con 0x11034d0 2024-01-22T05:18:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8bd308740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1167030 con 0x110a570 2024-01-22T05:18:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8bd308740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1111f90 con 0x110aee0 2024-01-22T05:18:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8bd308740 10 client.0 ll_register_callbacks cb 0x7fc894000d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:18:21.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8abe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11034d0 0x11662b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8ab400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110a570 0x11115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8ab400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110a570 0x11115b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:52960/0 (socket says 172.21.15.49:52960) 2024-01-22T05:18:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8abe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11034d0 0x11662b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40958/0 (socket says 172.21.15.49:40958) 2024-01-22T05:18:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8ab400700 1 -- 172.21.15.49:0/1103090040 learned_addr learned my addr 172.21.15.49:0/1103090040 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8b1800700 1 --2- 172.21.15.49:0/1103090040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x110aee0 0x1111aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8ab400700 1 -- 172.21.15.49:0/1103090040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x110aee0 msgr2=0x1111aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8ab400700 1 --2- 172.21.15.49:0/1103090040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x110aee0 0x1111aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8ab400700 1 -- 172.21.15.49:0/1103090040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11034d0 msgr2=0x11662b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8ab400700 1 --2- 172.21.15.49:0/1103090040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11034d0 0x11662b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8ab400700 1 -- 172.21.15.49:0/1103090040 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x10494c0 con 0x110a570 2024-01-22T05:18:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8ab400700 1 --2- 172.21.15.49:0/1103090040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110a570 0x11115b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fc8940090f0 tx=0x7fc894050000).ready entity=mon.1 client_cookie=3cec625e12ab8c9c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc898c00700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-01-22T05:18:21.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc898c00700 1 -- 172.21.15.49:0/1103090040 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894049800 con 0x110a570 2024-01-22T05:18:21.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc898c00700 1 -- 172.21.15.49:0/1103090040 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc89404d460 con 0x110a570 2024-01-22T05:18:21.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.970+0000 7fc8bd308740 1 -- 172.21.15.49:0/1103090040 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc89c014be0 con 0x110a570 2024-01-22T05:18:21.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc898c00700 1 -- 172.21.15.49:0/1103090040 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc89404d000 con 0x110a570 2024-01-22T05:18:21.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 10 client.9439 fetch_fsmap learned FSMap version 126 2024-01-22T05:18:21.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 1 -- 172.21.15.49:0/1103090040 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=126,monmap=2+}) v3 -- 0x7fc8ac0bf7b0 con 0x110a570 2024-01-22T05:18:21.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc898c00700 1 -- 172.21.15.49:0/1103090040 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c014be0 con 0x110a570 2024-01-22T05:18:21.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc898c00700 1 -- 172.21.15.49:0/1103090040 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 126) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc894022c50 con 0x110a570 2024-01-22T05:18:21.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 10 client.9439 fetch_fsmap finished waiting for FSMap version 126 2024-01-22T05:18:21.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 10 client.9439 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-01-22T05:18:21.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 20 client.9439 populate_metadata read hostname 'smithi049' 2024-01-22T05:18:21.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 1 --2- 172.21.15.49:0/1103090040 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x10e4ef0 0x10dd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:21.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 4 client.9439 mds_command: new command op to 9312 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:18:21.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 1 -- 172.21.15.49:0/1103090040 --> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xef4610 con 0x10e4ef0 2024-01-22T05:18:21.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8abe00700 1 --2- 172.21.15.49:0/1103090040 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x10e4ef0 0x10dd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:21.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc898c00700 10 client.9439 ms_handle_connect on v2:172.21.15.49:6836/3762397937 2024-01-22T05:18:21.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8abe00700 1 --2- 172.21.15.49:0/1103090040 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x10e4ef0 0x10dd490 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7bc48745580971ca server_cookie=7a0af686e3541d74 in_seq=0 out_seq=0 2024-01-22T05:18:21.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc898c00700 1 -- 172.21.15.49:0/1103090040 <== mds.0 v2:172.21.15.49:6836/3762397937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0xef4610 con 0x10e4ef0 2024-01-22T05:18:21.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc898c00700 10 client.9439 handle_command_reply: tid=0 2024-01-22T05:18:21.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 1 client.9439 shutdown 2024-01-22T05:18:21.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 1 -- 172.21.15.49:0/1103090040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110a570 msgr2=0x11115b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:21.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 1 --2- 172.21.15.49:0/1103090040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110a570 0x11115b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fc8940090f0 tx=0x7fc894050000).stop 2024-01-22T05:18:21.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 1 -- 172.21.15.49:0/1103090040 shutdown_connections 2024-01-22T05:18:21.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 1 --2- 172.21.15.49:0/1103090040 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x10e4ef0 0x10dd490 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 1 --2- 172.21.15.49:0/1103090040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x110aee0 0x1111aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc898c00700 0 client.9439 ms_handle_reset on v2:172.21.15.49:6836/3762397937 2024-01-22T05:18:21.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 1 --2- 172.21.15.49:0/1103090040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x110a570 0x11115b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 1 --2- 172.21.15.49:0/1103090040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x11034d0 0x11662b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 1 -- 172.21.15.49:0/1103090040 >> 172.21.15.49:0/1103090040 conn(0xe9d680 msgr2=0x10e43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:21.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.974+0000 7fc8bd308740 1 -- 172.21.15.49:0/1103090040 shutdown_connections 2024-01-22T05:18:21.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.978+0000 7fc8bd308740 1 -- 172.21.15.49:0/1103090040 wait complete. 2024-01-22T05:18:21.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.978+0000 7fc8bd308740 20 client.9439 trim_cache size 0 max 16384 2024-01-22T05:18:21.980 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:18:21.980 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-01-22T05:18:21.980 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-01-22T05:18:21.980 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:18:21.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.978+0000 7fc8b2e00700 1 -- 172.21.15.49:0/4133291013 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc88405a510 msgr2=0x7fc88405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:21.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.978+0000 7fc8b2e00700 1 --2- 172.21.15.49:0/4133291013 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc88405a510 0x7fc88405c9d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fc89c009b90 tx=0x7fc89c009060).stop 2024-01-22T05:18:21.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.978+0000 7fc8b2e00700 1 -- 172.21.15.49:0/4133291013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8ac0c4540 msgr2=0x7fc8ac164d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:21.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.978+0000 7fc8b2e00700 1 --2- 172.21.15.49:0/4133291013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8ac0c4540 0x7fc8ac164d60 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7fc894011fc0 tx=0x7fc894017000).stop 2024-01-22T05:18:21.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.978+0000 7fc8b2e00700 1 -- 172.21.15.49:0/4133291013 shutdown_connections 2024-01-22T05:18:21.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.978+0000 7fc8b2e00700 1 --2- 172.21.15.49:0/4133291013 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc88405a510 0x7fc88405c9d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.978+0000 7fc8b2e00700 1 --2- 172.21.15.49:0/4133291013 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8ac14b100 0x7fc8ac0c16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.978+0000 7fc8b2e00700 1 --2- 172.21.15.49:0/4133291013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8ac0c4540 0x7fc8ac164d60 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.978+0000 7fc8b2e00700 1 --2- 172.21.15.49:0/4133291013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8ac0befd0 0x7fc8ac164870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:21.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.978+0000 7fc8b2e00700 1 -- 172.21.15.49:0/4133291013 >> 172.21.15.49:0/4133291013 conn(0x7fc8ac0c8fb0 msgr2=0x7fc8ac0bd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:21.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.978+0000 7fc8b2e00700 1 -- 172.21.15.49:0/4133291013 shutdown_connections 2024-01-22T05:18:21.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:21.978+0000 7fc8b2e00700 1 -- 172.21.15.49:0/4133291013 wait complete. 2024-01-22T05:18:22.006 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-22T05:18:22.006 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.10:0 damage ls 2024-01-22T05:18:22.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.174+0000 7f4e5de00700 1 Processor -- start 2024-01-22T05:18:22.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.178+0000 7f4e5de00700 1 -- start start 2024-01-22T05:18:22.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.178+0000 7f4e5de00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4e5815a810 0x7f4e5815cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.178+0000 7f4e5de00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e58155e50 con 0x7f4e58067a90 2024-01-22T05:18:22.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.178+0000 7f4e5de00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e580a9620 con 0x7f4e58152040 2024-01-22T05:18:22.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.178+0000 7f4e5de00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e58152da0 con 0x7f4e5815a810 2024-01-22T05:18:22.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.178+0000 7f4e57e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4e5815a810 0x7f4e5815cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.178+0000 7f4e57e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4e5815a810 0x7f4e5815cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40968/0 (socket says 172.21.15.49:40968) 2024-01-22T05:18:22.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.178+0000 7f4e57e00700 1 -- 172.21.15.49:0/1614133848 learned_addr learned my addr 172.21.15.49:0/1614133848 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:22.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.178+0000 7f4e56a00700 1 --1- 172.21.15.49:0/1614133848 >> v1:172.21.15.49:6789/0 conn(0x7f4e58067a90 0x7f4e58067e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59930/0 (socket says 172.21.15.49:59930) 2024-01-22T05:18:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.182+0000 7f4e57e00700 1 -- 172.21.15.49:0/1614133848 >> v1:172.21.15.110:6789/0 conn(0x7f4e58152040 legacy=0x7f4e581524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.182+0000 7f4e57e00700 1 -- 172.21.15.49:0/1614133848 >> v1:172.21.15.49:6789/0 conn(0x7f4e58067a90 legacy=0x7f4e58067e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.182+0000 7f4e57e00700 1 -- 172.21.15.49:0/1614133848 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e58155520 con 0x7f4e5815a810 2024-01-22T05:18:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.182+0000 7f4e57e00700 1 --2- 172.21.15.49:0/1614133848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e5815a810 0x7f4e5815cc00 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7f4e50009f20 tx=0x7f4e50009840).ready entity=mon.0 client_cookie=e06f8cfd7567f07b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:22.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.182+0000 7f4e55600700 1 -- 172.21.15.49:0/1614133848 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5000e070 con 0x7f4e5815a810 2024-01-22T05:18:22.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.182+0000 7f4e55600700 1 -- 172.21.15.49:0/1614133848 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5000ba80 con 0x7f4e5815a810 2024-01-22T05:18:22.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.182+0000 7f4e55600700 1 -- 172.21.15.49:0/1614133848 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5000be00 con 0x7f4e5815a810 2024-01-22T05:18:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.182+0000 7f4e5de00700 1 -- 172.21.15.49:0/1614133848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e5815a810 msgr2=0x7f4e5815cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.182+0000 7f4e5de00700 1 --2- 172.21.15.49:0/1614133848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e5815a810 0x7f4e5815cc00 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7f4e50009f20 tx=0x7f4e50009840).stop 2024-01-22T05:18:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.182+0000 7f4e5de00700 1 -- 172.21.15.49:0/1614133848 shutdown_connections 2024-01-22T05:18:22.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.182+0000 7f4e5de00700 1 --2- 172.21.15.49:0/1614133848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e5815a810 0x7f4e5815cc00 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.182+0000 7f4e5de00700 1 -- 172.21.15.49:0/1614133848 >> 172.21.15.49:0/1614133848 conn(0x7f4e580c6920 msgr2=0x7f4e580c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:22.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.186+0000 7f4e5de00700 1 -- 172.21.15.49:0/1614133848 shutdown_connections 2024-01-22T05:18:22.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.186+0000 7f4e5de00700 1 -- 172.21.15.49:0/1614133848 wait complete. 2024-01-22T05:18:22.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.186+0000 7f4e5de00700 1 Processor -- start 2024-01-22T05:18:22.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e5de00700 1 -- start start 2024-01-22T05:18:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e5de00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e58067a90 0x7f4e581658d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e5de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e58152040 0x7f4e58148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e5de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e5815a810 0x7f4e581480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e5de00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e580c1ec0 con 0x7f4e5815a810 2024-01-22T05:18:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e5de00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e581662b0 con 0x7f4e58152040 2024-01-22T05:18:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e5de00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e58166590 con 0x7f4e58067a90 2024-01-22T05:18:22.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e57e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e5815a810 0x7f4e581480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e57e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e5815a810 0x7f4e581480b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40976/0 (socket says 172.21.15.49:40976) 2024-01-22T05:18:22.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e57e00700 1 -- 172.21.15.49:0/3336530201 learned_addr learned my addr 172.21.15.49:0/3336530201 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:22.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e56000700 1 --2- 172.21.15.49:0/3336530201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e58152040 0x7f4e58148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e56a00700 1 --2- 172.21.15.49:0/3336530201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e58067a90 0x7f4e581658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e57e00700 1 -- 172.21.15.49:0/3336530201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e58067a90 msgr2=0x7f4e581658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e57e00700 1 --2- 172.21.15.49:0/3336530201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e58067a90 0x7f4e581658d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e57e00700 1 -- 172.21.15.49:0/3336530201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e58152040 msgr2=0x7f4e58148aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.190+0000 7f4e57e00700 1 --2- 172.21.15.49:0/3336530201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e58152040 0x7f4e58148aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.194+0000 7f4e57e00700 1 -- 172.21.15.49:0/3336530201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e50009ae0 con 0x7f4e5815a810 2024-01-22T05:18:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.194+0000 7f4e56000700 1 --2- 172.21.15.49:0/3336530201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e58152040 0x7f4e58148aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.194+0000 7f4e57e00700 1 --2- 172.21.15.49:0/3336530201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e5815a810 0x7f4e581480b0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f4e50009590 tx=0x7f4e50009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.194+0000 7f4e4e000700 1 -- 172.21.15.49:0/3336530201 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5001d410 con 0x7f4e5815a810 2024-01-22T05:18:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.194+0000 7f4e4e000700 1 -- 172.21.15.49:0/3336530201 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5001d570 con 0x7f4e5815a810 2024-01-22T05:18:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.194+0000 7f4e5de00700 1 -- 172.21.15.49:0/3336530201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e580c2120 con 0x7f4e5815a810 2024-01-22T05:18:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.194+0000 7f4e4e000700 1 -- 172.21.15.49:0/3336530201 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5001d910 con 0x7f4e5815a810 2024-01-22T05:18:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.194+0000 7f4e5de00700 1 -- 172.21.15.49:0/3336530201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e580ab960 con 0x7f4e5815a810 2024-01-22T05:18:22.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.198+0000 7f4e4e000700 1 -- 172.21.15.49:0/3336530201 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4e5001dd00 con 0x7f4e5815a810 2024-01-22T05:18:22.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.198+0000 7f4e4e000700 1 --2- 172.21.15.49:0/3336530201 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e3005a540 0x7f4e3005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.198+0000 7f4e4e000700 1 -- 172.21.15.49:0/3336530201 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4e50076750 con 0x7f4e5815a810 2024-01-22T05:18:22.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.198+0000 7f4e56a00700 1 --2- 172.21.15.49:0/3336530201 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e3005a540 0x7f4e3005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.202+0000 7f4e56a00700 1 --2- 172.21.15.49:0/3336530201 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e3005a540 0x7f4e3005ca00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f4e480076b0 tx=0x7f4e48007bf0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:22.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.202+0000 7f4e68317740 1 Processor -- start 2024-01-22T05:18:22.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.202+0000 7f4e68317740 1 -- start start 2024-01-22T05:18:22.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.202+0000 7f4e68317740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b55820 0x1b380a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.202+0000 7f4e68317740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b58840 0x1b0c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.202+0000 7f4e68317740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b0c9b0 0x1b55c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.202+0000 7f4e68317740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a4c340 con 0x1b58840 2024-01-22T05:18:22.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e68317740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a6f4e0 con 0x1b55820 2024-01-22T05:18:22.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e68317740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a38ce0 con 0x1b0c9b0 2024-01-22T05:18:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e56000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b58840 0x1b0c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e56a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b55820 0x1b380a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e56000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b58840 0x1b0c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40986/0 (socket says 172.21.15.49:40986) 2024-01-22T05:18:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e56000700 1 -- 172.21.15.49:0/63503812 learned_addr learned my addr 172.21.15.49:0/63503812 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e57e00700 1 --2- 172.21.15.49:0/63503812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b0c9b0 0x1b55c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e56000700 1 -- 172.21.15.49:0/63503812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b0c9b0 msgr2=0x1b55c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e56000700 1 --2- 172.21.15.49:0/63503812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b0c9b0 0x1b55c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e56000700 1 -- 172.21.15.49:0/63503812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b55820 msgr2=0x1b380a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e56000700 1 --2- 172.21.15.49:0/63503812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b55820 0x1b380a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e56000700 1 -- 172.21.15.49:0/63503812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a3fed0 con 0x1b58840 2024-01-22T05:18:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e56000700 1 --2- 172.21.15.49:0/63503812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b58840 0x1b0c4c0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f4e40001550 tx=0x7f4e40009040).ready entity=mon.0 client_cookie=a86e905843d57b65 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e46a00700 1 -- 172.21.15.49:0/63503812 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40010450 con 0x1b58840 2024-01-22T05:18:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e46a00700 1 -- 172.21.15.49:0/63503812 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e400105b0 con 0x1b58840 2024-01-22T05:18:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e46a00700 1 -- 172.21.15.49:0/63503812 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40010930 con 0x1b58840 2024-01-22T05:18:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e68317740 1 -- 172.21.15.49:0/63503812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b58840 msgr2=0x1b0c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e68317740 1 --2- 172.21.15.49:0/63503812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b58840 0x1b0c4c0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f4e40001550 tx=0x7f4e40009040).stop 2024-01-22T05:18:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e68317740 1 -- 172.21.15.49:0/63503812 shutdown_connections 2024-01-22T05:18:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e68317740 1 --2- 172.21.15.49:0/63503812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b0c9b0 0x1b55c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e68317740 1 --2- 172.21.15.49:0/63503812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b58840 0x1b0c4c0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e68317740 1 --2- 172.21.15.49:0/63503812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b55820 0x1b380a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e68317740 1 -- 172.21.15.49:0/63503812 >> 172.21.15.49:0/63503812 conn(0x18f1680 msgr2=0x1b12620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e68317740 1 -- 172.21.15.49:0/63503812 shutdown_connections 2024-01-22T05:18:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.206+0000 7f4e68317740 1 -- 172.21.15.49:0/63503812 wait complete. 2024-01-22T05:18:22.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.210+0000 7f4e68317740 1 -- start start 2024-01-22T05:18:22.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.210+0000 7f4e68317740 1 Processor -- start 2024-01-22T05:18:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b0c9b0 0x1b50c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b55820 0x1b0fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b58840 0x1b10060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b10550 con 0x1b55820 2024-01-22T05:18:22.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b38ba0 con 0x1b0c9b0 2024-01-22T05:18:22.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b39000 con 0x1b58840 2024-01-22T05:18:22.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 10 client.0 ll_register_callbacks cb 0x1ac97c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:18:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e56000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b55820 0x1b0fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e56000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b55820 0x1b0fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40992/0 (socket says 172.21.15.49:40992) 2024-01-22T05:18:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e56000700 1 -- 172.21.15.49:0/1130488903 learned_addr learned my addr 172.21.15.49:0/1130488903 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e56a00700 1 --2- 172.21.15.49:0/1130488903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b0c9b0 0x1b50c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e57e00700 1 --2- 172.21.15.49:0/1130488903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b58840 0x1b10060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e56000700 1 -- 172.21.15.49:0/1130488903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b58840 msgr2=0x1b10060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e56000700 1 --2- 172.21.15.49:0/1130488903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b58840 0x1b10060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e56000700 1 -- 172.21.15.49:0/1130488903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b0c9b0 msgr2=0x1b50c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e56000700 1 --2- 172.21.15.49:0/1130488903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b0c9b0 0x1b50c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e56000700 1 -- 172.21.15.49:0/1130488903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4000f040 con 0x1b55820 2024-01-22T05:18:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e56a00700 1 --2- 172.21.15.49:0/1130488903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b0c9b0 0x1b50c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e56000700 1 --2- 172.21.15.49:0/1130488903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b55820 0x1b0fb70 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x1a89900 tx=0x1b0e840).ready entity=mon.0 client_cookie=fd6a233310b55d77 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e3f400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:18:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e3f400700 1 -- 172.21.15.49:0/1130488903 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40015440 con 0x1b55820 2024-01-22T05:18:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e3f400700 1 -- 172.21.15.49:0/1130488903 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4e40021de0 con 0x1b55820 2024-01-22T05:18:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 1 -- 172.21.15.49:0/1130488903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a89230 con 0x1b55820 2024-01-22T05:18:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e3f400700 1 -- 172.21.15.49:0/1130488903 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e400157b0 con 0x1b55820 2024-01-22T05:18:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 10 client.9570 fetch_fsmap learned FSMap version 126 2024-01-22T05:18:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 1 -- 172.21.15.49:0/1130488903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=126,monmap=2+}) v3 -- 0x1a8c7c0 con 0x1b55820 2024-01-22T05:18:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e3f400700 1 -- 172.21.15.49:0/1130488903 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a89230 con 0x1b55820 2024-01-22T05:18:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e3f400700 1 -- 172.21.15.49:0/1130488903 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 126) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4e40015910 con 0x1b55820 2024-01-22T05:18:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 10 client.9570 fetch_fsmap finished waiting for FSMap version 126 2024-01-22T05:18:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 10 client.9570 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-01-22T05:18:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 20 client.9570 populate_metadata read hostname 'smithi049' 2024-01-22T05:18:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 1 --2- 172.21.15.49:0/1130488903 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x1b3dab0 0x1b3de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 4 client.9570 mds_command: new command op to 9312 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:18:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.214+0000 7f4e68317740 1 -- 172.21.15.49:0/1130488903 --> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a7f780 con 0x1b3dab0 2024-01-22T05:18:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.218+0000 7f4e56a00700 1 --2- 172.21.15.49:0/1130488903 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x1b3dab0 0x1b3de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.218+0000 7f4e3f400700 10 client.9570 ms_handle_connect on v2:172.21.15.49:6836/3762397937 2024-01-22T05:18:22.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.218+0000 7f4e56a00700 1 --2- 172.21.15.49:0/1130488903 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x1b3dab0 0x1b3de90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=78bf15912f4774a9 server_cookie=b97135ea09531f0c in_seq=0 out_seq=0 2024-01-22T05:18:22.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.218+0000 7f4e3f400700 1 -- 172.21.15.49:0/1130488903 <== mds.0 v2:172.21.15.49:6836/3762397937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1a7f780 con 0x1b3dab0 2024-01-22T05:18:22.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.218+0000 7f4e3f400700 10 client.9570 handle_command_reply: tid=0 2024-01-22T05:18:22.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.218+0000 7f4e68317740 1 client.9570 shutdown 2024-01-22T05:18:22.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.218+0000 7f4e68317740 1 -- 172.21.15.49:0/1130488903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b55820 msgr2=0x1b0fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.218+0000 7f4e68317740 1 --2- 172.21.15.49:0/1130488903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b55820 0x1b0fb70 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x1a89900 tx=0x1b0e840).stop 2024-01-22T05:18:22.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.218+0000 7f4e68317740 1 -- 172.21.15.49:0/1130488903 shutdown_connections 2024-01-22T05:18:22.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.218+0000 7f4e68317740 1 --2- 172.21.15.49:0/1130488903 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x1b3dab0 0x1b3de90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.218+0000 7f4e68317740 1 --2- 172.21.15.49:0/1130488903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b58840 0x1b10060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.218+0000 7f4e68317740 1 --2- 172.21.15.49:0/1130488903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b55820 0x1b0fb70 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.218+0000 7f4e68317740 1 --2- 172.21.15.49:0/1130488903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b0c9b0 0x1b50c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.218+0000 7f4e3f400700 0 client.9570 ms_handle_reset on v2:172.21.15.49:6836/3762397937 2024-01-22T05:18:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.218+0000 7f4e68317740 1 -- 172.21.15.49:0/1130488903 >> 172.21.15.49:0/1130488903 conn(0x18f1680 msgr2=0x1b0b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.222+0000 7f4e68317740 1 -- 172.21.15.49:0/1130488903 shutdown_connections 2024-01-22T05:18:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.222+0000 7f4e68317740 1 -- 172.21.15.49:0/1130488903 wait complete. 2024-01-22T05:18:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.222+0000 7f4e68317740 20 client.9570 trim_cache size 0 max 16384 2024-01-22T05:18:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.234+0000 7f4e68317740 1 Processor -- start 2024-01-22T05:18:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e68317740 1 -- start start 2024-01-22T05:18:22.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e68317740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b0c9b0 0x1b0d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e68317740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b55820 0x1b10b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e68317740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b58840 0x1b3bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e68317740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b51520 con 0x1b58840 2024-01-22T05:18:22.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e68317740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b52610 con 0x1b55820 2024-01-22T05:18:22.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e68317740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b386c0 con 0x1b0c9b0 2024-01-22T05:18:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e57e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b58840 0x1b3bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e57e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b58840 0x1b3bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41002/0 (socket says 172.21.15.49:41002) 2024-01-22T05:18:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e57e00700 1 -- 172.21.15.49:0/523248363 learned_addr learned my addr 172.21.15.49:0/523248363 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e56a00700 1 --2- 172.21.15.49:0/523248363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b0c9b0 0x1b0d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e56000700 1 --2- 172.21.15.49:0/523248363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b55820 0x1b10b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e57e00700 1 -- 172.21.15.49:0/523248363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b0c9b0 msgr2=0x1b0d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e57e00700 1 --2- 172.21.15.49:0/523248363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b0c9b0 0x1b0d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e57e00700 1 -- 172.21.15.49:0/523248363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b55820 msgr2=0x1b10b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e57e00700 1 --2- 172.21.15.49:0/523248363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b55820 0x1b10b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e57e00700 1 -- 172.21.15.49:0/523248363 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e58166120 con 0x1b58840 2024-01-22T05:18:22.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e56a00700 1 --2- 172.21.15.49:0/523248363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b0c9b0 0x1b0d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:22.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e57e00700 1 --2- 172.21.15.49:0/523248363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b58840 0x1b3bbf0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7f4e50074aa0 tx=0x7f4e5004f040).ready entity=mon.0 client_cookie=2617c7a92e0ef01 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e47400700 1 -- 172.21.15.49:0/523248363 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50052030 con 0x1b58840 2024-01-22T05:18:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e47400700 1 -- 172.21.15.49:0/523248363 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e50053040 con 0x1b58840 2024-01-22T05:18:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.238+0000 7f4e47400700 1 -- 172.21.15.49:0/523248363 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5004d970 con 0x1b58840 2024-01-22T05:18:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.242+0000 7f4e68317740 1 -- 172.21.15.49:0/523248363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b58840 msgr2=0x1b3bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.242+0000 7f4e68317740 1 --2- 172.21.15.49:0/523248363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b58840 0x1b3bbf0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7f4e50074aa0 tx=0x7f4e5004f040).stop 2024-01-22T05:18:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.242+0000 7f4e68317740 1 -- 172.21.15.49:0/523248363 shutdown_connections 2024-01-22T05:18:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.242+0000 7f4e68317740 1 --2- 172.21.15.49:0/523248363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b58840 0x1b3bbf0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.242+0000 7f4e68317740 1 --2- 172.21.15.49:0/523248363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b55820 0x1b10b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.242+0000 7f4e68317740 1 --2- 172.21.15.49:0/523248363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b0c9b0 0x1b0d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.242+0000 7f4e68317740 1 -- 172.21.15.49:0/523248363 >> 172.21.15.49:0/523248363 conn(0x18f1680 msgr2=0x1b37de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:22.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.242+0000 7f4e68317740 1 -- 172.21.15.49:0/523248363 shutdown_connections 2024-01-22T05:18:22.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.242+0000 7f4e68317740 1 -- 172.21.15.49:0/523248363 wait complete. 2024-01-22T05:18:22.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.242+0000 7f4e68317740 1 -- start start 2024-01-22T05:18:22.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.242+0000 7f4e68317740 1 Processor -- start 2024-01-22T05:18:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e68317740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b0c9b0 0x1bc0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e68317740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b55820 0x1b50240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e68317740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b58840 0x1bc3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e68317740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bc3ff0 con 0x1b0c9b0 2024-01-22T05:18:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e68317740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b67fc0 con 0x1b55820 2024-01-22T05:18:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e68317740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b4fdb0 con 0x1b58840 2024-01-22T05:18:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e68317740 10 client.0 ll_register_callbacks cb 0x7f4e40010a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:18:22.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e56a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b0c9b0 0x1bc0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e57e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b58840 0x1bc3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e56a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b0c9b0 0x1bc0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41008/0 (socket says 172.21.15.49:41008) 2024-01-22T05:18:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e57e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b58840 0x1bc3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:59638/0 (socket says 172.21.15.49:59638) 2024-01-22T05:18:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e56a00700 1 -- 172.21.15.49:0/2961394498 learned_addr learned my addr 172.21.15.49:0/2961394498 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e56000700 1 --2- 172.21.15.49:0/2961394498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b55820 0x1b50240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e57e00700 1 -- 172.21.15.49:0/2961394498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b55820 msgr2=0x1b50240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e57e00700 1 --2- 172.21.15.49:0/2961394498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b55820 0x1b50240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e57e00700 1 -- 172.21.15.49:0/2961394498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b0c9b0 msgr2=0x1bc0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e57e00700 1 --2- 172.21.15.49:0/2961394498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b0c9b0 0x1bc0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e57e00700 1 -- 172.21.15.49:0/2961394498 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e580ab960 con 0x1b58840 2024-01-22T05:18:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e56a00700 1 --2- 172.21.15.49:0/2961394498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b0c9b0 0x1bc0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e57e00700 1 --2- 172.21.15.49:0/2961394498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b58840 0x1bc3340 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f4e50031000 tx=0x7f4e50032000).ready entity=mon.2 client_cookie=bf9171f0cd5c145b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e3f400700 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2024-01-22T05:18:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e3f400700 1 -- 172.21.15.49:0/2961394498 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50052030 con 0x1b58840 2024-01-22T05:18:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e3f400700 1 -- 172.21.15.49:0/2961394498 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4e5004d970 con 0x1b58840 2024-01-22T05:18:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e68317740 1 -- 172.21.15.49:0/2961394498 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e400105b0 con 0x1b58840 2024-01-22T05:18:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e3f400700 1 -- 172.21.15.49:0/2961394498 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e5001cc40 con 0x1b58840 2024-01-22T05:18:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e68317740 10 client.8117 fetch_fsmap learned FSMap version 126 2024-01-22T05:18:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e68317740 1 -- 172.21.15.49:0/2961394498 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=126,monmap=2+}) v3 -- 0x1a879f0 con 0x1b58840 2024-01-22T05:18:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.246+0000 7f4e3f400700 1 -- 172.21.15.49:0/2961394498 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e400105b0 con 0x1b58840 2024-01-22T05:18:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e3f400700 1 -- 172.21.15.49:0/2961394498 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 126) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4e500493f0 con 0x1b58840 2024-01-22T05:18:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 10 client.8117 fetch_fsmap finished waiting for FSMap version 126 2024-01-22T05:18:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 10 client.8117 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-01-22T05:18:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 20 client.8117 populate_metadata read hostname 'smithi049' 2024-01-22T05:18:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 1 --2- 172.21.15.49:0/2961394498 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x1bc3830 0x1b11a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 4 client.8117 mds_command: new command op to 9312 tid=0[{"prefix": "damage ls"}] 2024-01-22T05:18:22.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 1 -- 172.21.15.49:0/2961394498 --> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x1948610 con 0x1bc3830 2024-01-22T05:18:22.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e56a00700 1 --2- 172.21.15.49:0/2961394498 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x1bc3830 0x1b11a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e56a00700 1 --2- 172.21.15.49:0/2961394498 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x1bc3830 0x1b11a30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=999127aaab44617f server_cookie=1a73a176510cac8a in_seq=0 out_seq=0 2024-01-22T05:18:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e3f400700 10 client.8117 ms_handle_connect on v2:172.21.15.49:6836/3762397937 2024-01-22T05:18:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e3f400700 1 -- 172.21.15.49:0/2961394498 <== mds.0 v2:172.21.15.49:6836/3762397937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x1948610 con 0x1bc3830 2024-01-22T05:18:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e3f400700 10 client.8117 handle_command_reply: tid=0 2024-01-22T05:18:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 1 client.8117 shutdown 2024-01-22T05:18:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 1 -- 172.21.15.49:0/2961394498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b58840 msgr2=0x1bc3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 1 --2- 172.21.15.49:0/2961394498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b58840 0x1bc3340 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f4e50031000 tx=0x7f4e50032000).stop 2024-01-22T05:18:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 1 -- 172.21.15.49:0/2961394498 shutdown_connections 2024-01-22T05:18:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 1 --2- 172.21.15.49:0/2961394498 >> [v2:172.21.15.49:6836/3762397937,v1:172.21.15.49:6837/3762397937] conn(0x1bc3830 0x1b11a30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 1 --2- 172.21.15.49:0/2961394498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1b58840 0x1bc3340 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 1 --2- 172.21.15.49:0/2961394498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1b55820 0x1b50240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 1 --2- 172.21.15.49:0/2961394498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1b0c9b0 0x1bc0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 1 -- 172.21.15.49:0/2961394498 >> 172.21.15.49:0/2961394498 conn(0x18f1680 msgr2=0x1b0bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e3f400700 0 client.8117 ms_handle_reset on v2:172.21.15.49:6836/3762397937 2024-01-22T05:18:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 1 -- 172.21.15.49:0/2961394498 shutdown_connections 2024-01-22T05:18:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 1 -- 172.21.15.49:0/2961394498 wait complete. 2024-01-22T05:18:22.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.250+0000 7f4e68317740 20 client.8117 trim_cache size 0 max 16384 2024-01-22T05:18:22.255 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-01-22T05:18:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.254+0000 7f4e5de00700 1 -- 172.21.15.49:0/3336530201 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e3005a540 msgr2=0x7f4e3005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.254+0000 7f4e5de00700 1 --2- 172.21.15.49:0/3336530201 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e3005a540 0x7f4e3005ca00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f4e480076b0 tx=0x7f4e48007bf0).stop 2024-01-22T05:18:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.254+0000 7f4e5de00700 1 -- 172.21.15.49:0/3336530201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e5815a810 msgr2=0x7f4e581480b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.254+0000 7f4e5de00700 1 --2- 172.21.15.49:0/3336530201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e5815a810 0x7f4e581480b0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f4e50009590 tx=0x7f4e50009840).stop 2024-01-22T05:18:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.254+0000 7f4e5de00700 1 -- 172.21.15.49:0/3336530201 shutdown_connections 2024-01-22T05:18:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.254+0000 7f4e5de00700 1 --2- 172.21.15.49:0/3336530201 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e3005a540 0x7f4e3005ca00 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.254+0000 7f4e5de00700 1 --2- 172.21.15.49:0/3336530201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e5815a810 0x7f4e581480b0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.254+0000 7f4e5de00700 1 --2- 172.21.15.49:0/3336530201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e58152040 0x7f4e58148aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.254+0000 7f4e5de00700 1 --2- 172.21.15.49:0/3336530201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e58067a90 0x7f4e581658d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.254+0000 7f4e5de00700 1 -- 172.21.15.49:0/3336530201 >> 172.21.15.49:0/3336530201 conn(0x7f4e580c6920 msgr2=0x7f4e580c5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:22.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.254+0000 7f4e5de00700 1 -- 172.21.15.49:0/3336530201 shutdown_connections 2024-01-22T05:18:22.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.254+0000 7f4e5de00700 1 -- 172.21.15.49:0/3336530201 wait complete. 2024-01-22T05:18:22.283 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-22T05:18:22.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.446+0000 7f9f57400700 1 Processor -- start 2024-01-22T05:18:22.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.446+0000 7f9f57400700 1 -- start start 2024-01-22T05:18:22.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.446+0000 7f9f57400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f500abe40 0x7f9f500c4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.446+0000 7f9f57400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f500c5680 con 0x7f9f500c49f0 2024-01-22T05:18:22.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.446+0000 7f9f57400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f500626d0 con 0x7f9f500bf650 2024-01-22T05:18:22.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.446+0000 7f9f57400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f500c3d10 con 0x7f9f500abe40 2024-01-22T05:18:22.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.450+0000 7f9f4fe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9f500c49f0 0x7f9f500bef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59938/0 (socket says 172.21.15.49:59938) 2024-01-22T05:18:22.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.450+0000 7f9f4fe00700 1 -- 172.21.15.49:0/2386459321 learned_addr learned my addr 172.21.15.49:0/2386459321 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:22.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.450+0000 7f9f54a00700 1 --2- 172.21.15.49:0/2386459321 >> v2:172.21.15.110:3300/0 conn(0x7f9f500abe40 0x7f9f500c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.450+0000 7f9f4f400700 1 -- 172.21.15.49:0/2386459321 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326254824 0 0) 0x7f9f500c5680 con 0x7f9f500c49f0 2024-01-22T05:18:22.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.450+0000 7f9f4f400700 1 -- 172.21.15.49:0/2386459321 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f300033f0 con 0x7f9f500c49f0 2024-01-22T05:18:22.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.450+0000 7f9f4f400700 1 -- 172.21.15.49:0/2386459321 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461970829 0 0) 0x7f9f500626d0 con 0x7f9f500bf650 2024-01-22T05:18:22.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.450+0000 7f9f4f400700 1 -- 172.21.15.49:0/2386459321 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f500c5680 con 0x7f9f500bf650 2024-01-22T05:18:22.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.450+0000 7f9f54a00700 1 -- 172.21.15.49:0/2386459321 >> v1:172.21.15.110:6789/0 conn(0x7f9f500bf650 legacy=0x7f9f50062b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.450+0000 7f9f4f400700 1 -- 172.21.15.49:0/2386459321 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3824635696 0 0) 0x7f9f300033f0 con 0x7f9f500c49f0 2024-01-22T05:18:22.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.450+0000 7f9f54a00700 1 -- 172.21.15.49:0/2386459321 >> v1:172.21.15.49:6789/0 conn(0x7f9f500c49f0 legacy=0x7f9f500bef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.450+0000 7f9f54a00700 1 -- 172.21.15.49:0/2386459321 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f500c4e50 con 0x7f9f500abe40 2024-01-22T05:18:22.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.450+0000 7f9f54a00700 1 --2- 172.21.15.49:0/2386459321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f500abe40 0x7f9f500c4500 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f9f40009760 tx=0x7f9f40009060).ready entity=mon.1 client_cookie=af230a4e8e69e707 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:22.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.450+0000 7f9f4f400700 1 -- 172.21.15.49:0/2386459321 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38001470 con 0x7f9f500abe40 2024-01-22T05:18:22.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.450+0000 7f9f4f400700 1 -- 172.21.15.49:0/2386459321 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f40011400 con 0x7f9f500abe40 2024-01-22T05:18:22.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.450+0000 7f9f4f400700 1 -- 172.21.15.49:0/2386459321 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40011780 con 0x7f9f500abe40 2024-01-22T05:18:22.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.454+0000 7f9f57400700 1 -- 172.21.15.49:0/2386459321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f500abe40 msgr2=0x7f9f500c4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.454+0000 7f9f57400700 1 --2- 172.21.15.49:0/2386459321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f500abe40 0x7f9f500c4500 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f9f40009760 tx=0x7f9f40009060).stop 2024-01-22T05:18:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.454+0000 7f9f57400700 1 -- 172.21.15.49:0/2386459321 shutdown_connections 2024-01-22T05:18:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.454+0000 7f9f57400700 1 --2- 172.21.15.49:0/2386459321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f500abe40 0x7f9f500c4500 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.454+0000 7f9f57400700 1 -- 172.21.15.49:0/2386459321 >> 172.21.15.49:0/2386459321 conn(0x7f9f500c5860 msgr2=0x7f9f500c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.454+0000 7f9f57400700 1 -- 172.21.15.49:0/2386459321 shutdown_connections 2024-01-22T05:18:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.454+0000 7f9f57400700 1 -- 172.21.15.49:0/2386459321 wait complete. 2024-01-22T05:18:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.454+0000 7f9f57400700 1 Processor -- start 2024-01-22T05:18:22.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f57400700 1 -- start start 2024-01-22T05:18:22.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f57400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f500abe40 0x7f9f5014e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f57400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f500bf650 0x7f9f50164df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f57400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f500c49f0 0x7f9f500c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f57400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500c27f0 con 0x7f9f500bf650 2024-01-22T05:18:22.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f57400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500c1f40 con 0x7f9f500c49f0 2024-01-22T05:18:22.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f57400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f501652e0 con 0x7f9f500abe40 2024-01-22T05:18:22.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f4fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f500bf650 0x7f9f50164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f4fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f500bf650 0x7f9f50164df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41012/0 (socket says 172.21.15.49:41012) 2024-01-22T05:18:22.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f4fe00700 1 -- 172.21.15.49:0/2830423794 learned_addr learned my addr 172.21.15.49:0/2830423794 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:22.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f54a00700 1 --2- 172.21.15.49:0/2830423794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f500abe40 0x7f9f5014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f55e00700 1 --2- 172.21.15.49:0/2830423794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f500c49f0 0x7f9f500c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f4fe00700 1 -- 172.21.15.49:0/2830423794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f500abe40 msgr2=0x7f9f5014e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f4fe00700 1 --2- 172.21.15.49:0/2830423794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f500abe40 0x7f9f5014e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f4fe00700 1 -- 172.21.15.49:0/2830423794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f500c49f0 msgr2=0x7f9f500c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f4fe00700 1 --2- 172.21.15.49:0/2830423794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f500c49f0 0x7f9f500c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f4fe00700 1 -- 172.21.15.49:0/2830423794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f400092a0 con 0x7f9f500bf650 2024-01-22T05:18:22.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f4fe00700 1 --2- 172.21.15.49:0/2830423794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f500bf650 0x7f9f50164df0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7f9f3800c800 tx=0x7f9f38001ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:22.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f47e00700 1 -- 172.21.15.49:0/2830423794 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38007170 con 0x7f9f500bf650 2024-01-22T05:18:22.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f47e00700 1 -- 172.21.15.49:0/2830423794 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f380072d0 con 0x7f9f500bf650 2024-01-22T05:18:22.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f57400700 1 -- 172.21.15.49:0/2830423794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f500c1330 con 0x7f9f500bf650 2024-01-22T05:18:22.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.458+0000 7f9f47e00700 1 -- 172.21.15.49:0/2830423794 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f380048c0 con 0x7f9f500bf650 2024-01-22T05:18:22.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.462+0000 7f9f57400700 1 -- 172.21.15.49:0/2830423794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f500c18f0 con 0x7f9f500bf650 2024-01-22T05:18:22.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.462+0000 7f9f57400700 1 -- 172.21.15.49:0/2830423794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f50153ad0 con 0x7f9f500bf650 2024-01-22T05:18:22.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.462+0000 7f9f47e00700 1 -- 172.21.15.49:0/2830423794 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9f38004c30 con 0x7f9f500bf650 2024-01-22T05:18:22.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.462+0000 7f9f47e00700 1 --2- 172.21.15.49:0/2830423794 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f2805a510 0x7f9f2805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:22.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.462+0000 7f9f47e00700 1 -- 172.21.15.49:0/2830423794 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9f38074390 con 0x7f9f500bf650 2024-01-22T05:18:22.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.466+0000 7f9f54a00700 1 --2- 172.21.15.49:0/2830423794 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f2805a510 0x7f9f2805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:22.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.466+0000 7f9f54a00700 1 --2- 172.21.15.49:0/2830423794 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f2805a510 0x7f9f2805c9d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f9f501535a0 tx=0x7f9f40016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:22.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.474+0000 7f9f47e00700 1 -- 172.21.15.49:0/2830423794 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9f50153ad0 con 0x7f9f500bf650 2024-01-22T05:18:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.674+0000 7f9f57400700 1 -- 172.21.15.49:0/2830423794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9f50153ad0 con 0x7f9f500bf650 2024-01-22T05:18:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.678+0000 7f9f47e00700 1 -- 172.21.15.49:0/2830423794 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f9f50153ad0 con 0x7f9f500bf650 2024-01-22T05:18:22.679 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.682+0000 7f9f57400700 1 -- 172.21.15.49:0/2830423794 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f2805a510 msgr2=0x7f9f2805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.682+0000 7f9f57400700 1 --2- 172.21.15.49:0/2830423794 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f2805a510 0x7f9f2805c9d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f9f501535a0 tx=0x7f9f40016000).stop 2024-01-22T05:18:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.682+0000 7f9f57400700 1 -- 172.21.15.49:0/2830423794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f500bf650 msgr2=0x7f9f50164df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.682+0000 7f9f57400700 1 --2- 172.21.15.49:0/2830423794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f500bf650 0x7f9f50164df0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7f9f3800c800 tx=0x7f9f38001ab0).stop 2024-01-22T05:18:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.682+0000 7f9f57400700 1 -- 172.21.15.49:0/2830423794 shutdown_connections 2024-01-22T05:18:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.682+0000 7f9f57400700 1 --2- 172.21.15.49:0/2830423794 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9f2805a510 0x7f9f2805c9d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.682+0000 7f9f57400700 1 --2- 172.21.15.49:0/2830423794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f500c49f0 0x7f9f500c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.682+0000 7f9f57400700 1 --2- 172.21.15.49:0/2830423794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f500bf650 0x7f9f50164df0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.682+0000 7f9f57400700 1 --2- 172.21.15.49:0/2830423794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f500abe40 0x7f9f5014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.682+0000 7f9f57400700 1 -- 172.21.15.49:0/2830423794 >> 172.21.15.49:0/2830423794 conn(0x7f9f500c5860 msgr2=0x7f9f50067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.682+0000 7f9f57400700 1 -- 172.21.15.49:0/2830423794 shutdown_connections 2024-01-22T05:18:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:22.682+0000 7f9f57400700 1 -- 172.21.15.49:0/2830423794 wait complete. 2024-01-22T05:18:22.707 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-22T05:18:22.707 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:18:22.707 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:18:22.747 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:18:22.788 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:18:22.788 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T05:18:22.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:18:22.788 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-22T05:18:22.836 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:18:22.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:18:22.836 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:18:22.901 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:18:23.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.106+0000 7fc061e00700 1 Processor -- start 2024-01-22T05:18:23.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.110+0000 7fc061e00700 1 -- start start 2024-01-22T05:18:23.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.110+0000 7fc061e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc05c064690 0x7fc05c064af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.110+0000 7fc061e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05c0be210 con 0x7fc05c151370 2024-01-22T05:18:23.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.110+0000 7fc061e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05c0bd650 con 0x7fc05c0be6a0 2024-01-22T05:18:23.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.110+0000 7fc061e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05c0bd8e0 con 0x7fc05c064690 2024-01-22T05:18:23.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc05a000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc05c064690 0x7fc05c064af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc05a000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc05c064690 0x7fc05c064af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41022/0 (socket says 172.21.15.49:41022) 2024-01-22T05:18:23.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc05a000700 1 -- 172.21.15.49:0/187693378 learned_addr learned my addr 172.21.15.49:0/187693378 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:23.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc05be00700 1 --1- 172.21.15.49:0/187693378 >> v1:172.21.15.49:6789/0 conn(0x7fc05c151370 0x7fc05c1517c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59942/0 (socket says 172.21.15.49:59942) 2024-01-22T05:18:23.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc059600700 1 -- 172.21.15.49:0/187693378 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356257586 0 0) 0x7fc05c0bd650 con 0x7fc05c0be6a0 2024-01-22T05:18:23.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc05a000700 1 -- 172.21.15.49:0/187693378 >> v1:172.21.15.110:6789/0 conn(0x7fc05c0be6a0 legacy=0x7fc05c0c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc05a000700 1 -- 172.21.15.49:0/187693378 >> v1:172.21.15.49:6789/0 conn(0x7fc05c151370 legacy=0x7fc05c1517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc05a000700 1 -- 172.21.15.49:0/187693378 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c0bdbc0 con 0x7fc05c064690 2024-01-22T05:18:23.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc05a000700 1 --2- 172.21.15.49:0/187693378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc05c064690 0x7fc05c064af0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7fc044006fd0 tx=0x7fc0440090f0).ready entity=mon.0 client_cookie=6841504a8ef90838 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:23.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc059600700 1 -- 172.21.15.49:0/187693378 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04400b600 con 0x7fc05c064690 2024-01-22T05:18:23.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc059600700 1 -- 172.21.15.49:0/187693378 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04400b760 con 0x7fc05c064690 2024-01-22T05:18:23.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc059600700 1 -- 172.21.15.49:0/187693378 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04400bae0 con 0x7fc05c064690 2024-01-22T05:18:23.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc061e00700 1 -- 172.21.15.49:0/187693378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc05c064690 msgr2=0x7fc05c064af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc061e00700 1 --2- 172.21.15.49:0/187693378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc05c064690 0x7fc05c064af0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7fc044006fd0 tx=0x7fc0440090f0).stop 2024-01-22T05:18:23.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc061e00700 1 -- 172.21.15.49:0/187693378 shutdown_connections 2024-01-22T05:18:23.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc061e00700 1 --2- 172.21.15.49:0/187693378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc05c064690 0x7fc05c064af0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.114+0000 7fc061e00700 1 -- 172.21.15.49:0/187693378 >> 172.21.15.49:0/187693378 conn(0x7fc05c0c87f0 msgr2=0x7fc05c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:23.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.118+0000 7fc061e00700 1 -- 172.21.15.49:0/187693378 shutdown_connections 2024-01-22T05:18:23.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.118+0000 7fc061e00700 1 -- 172.21.15.49:0/187693378 wait complete. 2024-01-22T05:18:23.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.118+0000 7fc061e00700 1 Processor -- start 2024-01-22T05:18:23.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.122+0000 7fc061e00700 1 -- start start 2024-01-22T05:18:23.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.122+0000 7fc061e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc05c064690 0x7fc05c0aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.122+0000 7fc061e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc05c0be6a0 0x7fc05c152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.122+0000 7fc061e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc05c151370 0x7fc05c1683c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.122+0000 7fc061e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c1688b0 con 0x7fc05c064690 2024-01-22T05:18:23.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.122+0000 7fc061e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c1532e0 con 0x7fc05c151370 2024-01-22T05:18:23.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.122+0000 7fc061e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c1535c0 con 0x7fc05c0be6a0 2024-01-22T05:18:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.122+0000 7fc05aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc05c064690 0x7fc05c0aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.122+0000 7fc05a000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc05c0be6a0 0x7fc05c152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.122+0000 7fc05aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc05c064690 0x7fc05c0aacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41024/0 (socket says 172.21.15.49:41024) 2024-01-22T05:18:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.122+0000 7fc05aa00700 1 -- 172.21.15.49:0/3916864636 learned_addr learned my addr 172.21.15.49:0/3916864636 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.122+0000 7fc05be00700 1 --2- 172.21.15.49:0/3916864636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc05c151370 0x7fc05c1683c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.126+0000 7fc05aa00700 1 -- 172.21.15.49:0/3916864636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc05c0be6a0 msgr2=0x7fc05c152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.126+0000 7fc05aa00700 1 --2- 172.21.15.49:0/3916864636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc05c0be6a0 0x7fc05c152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.126+0000 7fc05aa00700 1 -- 172.21.15.49:0/3916864636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc05c151370 msgr2=0x7fc05c1683c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.126+0000 7fc05aa00700 1 --2- 172.21.15.49:0/3916864636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc05c151370 0x7fc05c1683c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.126+0000 7fc05aa00700 1 -- 172.21.15.49:0/3916864636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc044009370 con 0x7fc05c064690 2024-01-22T05:18:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.126+0000 7fc05aa00700 1 --2- 172.21.15.49:0/3916864636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc05c064690 0x7fc05c0aacd0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fc04c007fd0 tx=0x7fc04c007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.126+0000 7fc052000700 1 -- 172.21.15.49:0/3916864636 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00ce10 con 0x7fc05c064690 2024-01-22T05:18:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.126+0000 7fc052000700 1 -- 172.21.15.49:0/3916864636 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c00f470 con 0x7fc05c064690 2024-01-22T05:18:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.126+0000 7fc052000700 1 -- 172.21.15.49:0/3916864636 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00f830 con 0x7fc05c064690 2024-01-22T05:18:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.126+0000 7fc061e00700 1 -- 172.21.15.49:0/3916864636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05c1538a0 con 0x7fc05c064690 2024-01-22T05:18:23.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.126+0000 7fc061e00700 1 -- 172.21.15.49:0/3916864636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05c153e60 con 0x7fc05c064690 2024-01-22T05:18:23.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.126+0000 7fc061e00700 1 -- 172.21.15.49:0/3916864636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05c065200 con 0x7fc05c064690 2024-01-22T05:18:23.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.130+0000 7fc052000700 1 -- 172.21.15.49:0/3916864636 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc04c00fbe0 con 0x7fc05c064690 2024-01-22T05:18:23.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.130+0000 7fc052000700 1 --2- 172.21.15.49:0/3916864636 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc03405a510 0x7fc03405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.130+0000 7fc052000700 1 -- 172.21.15.49:0/3916864636 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc04c073ed0 con 0x7fc05c064690 2024-01-22T05:18:23.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.130+0000 7fc05a000700 1 --2- 172.21.15.49:0/3916864636 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc03405a510 0x7fc03405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.130+0000 7fc05a000700 1 --2- 172.21.15.49:0/3916864636 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc03405a510 0x7fc03405c9d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fc044009130 tx=0x7fc044017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:23.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.134+0000 7fc052000700 1 -- 172.21.15.49:0/3916864636 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc05c065200 con 0x7fc05c064690 2024-01-22T05:18:23.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.330+0000 7fc061e00700 1 -- 172.21.15.49:0/3916864636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc05c065200 con 0x7fc05c064690 2024-01-22T05:18:23.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.334+0000 7fc052000700 1 -- 172.21.15.49:0/3916864636 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+4505 (secure 0 0 0) 0x7fc05c065200 con 0x7fc05c064690 2024-01-22T05:18:23.335 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:23.335 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":126,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3010799828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3010799828},{"type":"v1","addr":"172.21.15.110:6833","nonce":3010799828}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":7940,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2071707351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2071707351},{"type":"v1","addr":"172.21.15.110:6835","nonce":2071707351}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":9309,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3579312059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3579312059},{"type":"v1","addr":"172.21.15.49:6835","nonce":3579312059}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":126,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:17:43.087426+0000","modified":"2024-01-22T05:17:46.108388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9312":{"gid":9312,"name":"c","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3762397937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3762397937},{"type":"v1","addr":"172.21.15.49:6837","nonce":3762397937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2024-01-22T05:18:23.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.334+0000 7fc061e00700 1 -- 172.21.15.49:0/3916864636 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc03405a510 msgr2=0x7fc03405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.334+0000 7fc061e00700 1 --2- 172.21.15.49:0/3916864636 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc03405a510 0x7fc03405c9d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fc044009130 tx=0x7fc044017000).stop 2024-01-22T05:18:23.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.334+0000 7fc061e00700 1 -- 172.21.15.49:0/3916864636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc05c064690 msgr2=0x7fc05c0aacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.334+0000 7fc061e00700 1 --2- 172.21.15.49:0/3916864636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc05c064690 0x7fc05c0aacd0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fc04c007fd0 tx=0x7fc04c007c20).stop 2024-01-22T05:18:23.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.334+0000 7fc061e00700 1 -- 172.21.15.49:0/3916864636 shutdown_connections 2024-01-22T05:18:23.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.334+0000 7fc061e00700 1 --2- 172.21.15.49:0/3916864636 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc03405a510 0x7fc03405c9d0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.334+0000 7fc061e00700 1 --2- 172.21.15.49:0/3916864636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc05c151370 0x7fc05c1683c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.334+0000 7fc061e00700 1 --2- 172.21.15.49:0/3916864636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc05c0be6a0 0x7fc05c152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.334+0000 7fc061e00700 1 --2- 172.21.15.49:0/3916864636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc05c064690 0x7fc05c0aacd0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.334+0000 7fc061e00700 1 -- 172.21.15.49:0/3916864636 >> 172.21.15.49:0/3916864636 conn(0x7fc05c0c87f0 msgr2=0x7fc05c067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:23.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.338+0000 7fc061e00700 1 -- 172.21.15.49:0/3916864636 shutdown_connections 2024-01-22T05:18:23.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.338+0000 7fc061e00700 1 -- 172.21.15.49:0/3916864636 wait complete. 2024-01-22T05:18:23.343 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 126 2024-01-22T05:18:23.362 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:18:23.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.526+0000 7f963dc00700 1 Processor -- start 2024-01-22T05:18:23.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.526+0000 7f963dc00700 1 -- start start 2024-01-22T05:18:23.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.526+0000 7f963dc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9638065240 0x7f96380644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.526+0000 7f963dc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9638065620 0x7f96380649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.526+0000 7f963dc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f963815b9b0 0x7f963815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.526+0000 7f963dc00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9638064ed0 con 0x7f9638065240 2024-01-22T05:18:23.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.526+0000 7f963dc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96380c2700 con 0x7f9638065620 2024-01-22T05:18:23.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.526+0000 7f963dc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96380c29a0 con 0x7f963815b9b0 2024-01-22T05:18:23.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.526+0000 7f9636a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9638065240 0x7f96380644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f9636a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9638065240 0x7f96380644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55470/0 (socket says 172.21.15.49:55470) 2024-01-22T05:18:23.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f9636a00700 1 -- 172.21.15.49:0/1706662774 learned_addr learned my addr 172.21.15.49:0/1706662774 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f9636000700 1 --2- 172.21.15.49:0/1706662774 >> v2:172.21.15.110:3300/0 conn(0x7f9638065620 0x7f96380649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f9637e00700 1 --2- 172.21.15.49:0/1706662774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f963815b9b0 0x7f963815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f9636a00700 1 -- 172.21.15.49:0/1706662774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f963815b9b0 msgr2=0x7f963815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f9636a00700 1 --2- 172.21.15.49:0/1706662774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f963815b9b0 0x7f963815be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f9636a00700 1 -- 172.21.15.49:0/1706662774 >> v2:172.21.15.110:3300/0 conn(0x7f9638065620 msgr2=0x7f96380649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f9636a00700 1 --2- 172.21.15.49:0/1706662774 >> v2:172.21.15.110:3300/0 conn(0x7f9638065620 0x7f96380649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f9636a00700 1 -- 172.21.15.49:0/1706662774 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96380c2c80 con 0x7f9638065240 2024-01-22T05:18:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f9636000700 1 --2- 172.21.15.49:0/1706662774 >> v2:172.21.15.110:3300/0 conn(0x7f9638065620 0x7f96380649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f9636a00700 1 --2- 172.21.15.49:0/1706662774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9638065240 0x7f96380644f0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7f96380c4770 tx=0x7f96280090f0).ready entity=mon.0 client_cookie=2e3ce3ea863b9403 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f9635600700 1 -- 172.21.15.49:0/1706662774 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962800b600 con 0x7f9638065240 2024-01-22T05:18:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f9635600700 1 -- 172.21.15.49:0/1706662774 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962800b760 con 0x7f9638065240 2024-01-22T05:18:23.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f9635600700 1 -- 172.21.15.49:0/1706662774 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962800bae0 con 0x7f9638065240 2024-01-22T05:18:23.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f963dc00700 1 -- 172.21.15.49:0/1706662774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9638065240 msgr2=0x7f96380644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f963dc00700 1 --2- 172.21.15.49:0/1706662774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9638065240 0x7f96380644f0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7f96380c4770 tx=0x7f96280090f0).stop 2024-01-22T05:18:23.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f963dc00700 1 -- 172.21.15.49:0/1706662774 shutdown_connections 2024-01-22T05:18:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f963dc00700 1 --2- 172.21.15.49:0/1706662774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f963815b9b0 0x7f963815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f963dc00700 1 --2- 172.21.15.49:0/1706662774 >> v2:172.21.15.110:3300/0 conn(0x7f9638065620 0x7f96380649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f963dc00700 1 --2- 172.21.15.49:0/1706662774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9638065240 0x7f96380644f0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f963dc00700 1 -- 172.21.15.49:0/1706662774 >> 172.21.15.49:0/1706662774 conn(0x7f96380c87f0 msgr2=0x7f96380c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.530+0000 7f963dc00700 1 -- 172.21.15.49:0/1706662774 shutdown_connections 2024-01-22T05:18:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.534+0000 7f963dc00700 1 -- 172.21.15.49:0/1706662774 wait complete. 2024-01-22T05:18:23.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.534+0000 7f963dc00700 1 Processor -- start 2024-01-22T05:18:23.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f963dc00700 1 -- start start 2024-01-22T05:18:23.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f963dc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9638065240 0x7f9638168480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f963dc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9638065620 0x7f96381562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f963dc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f963815b9b0 0x7f96381695a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f963dc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9638168970 con 0x7f9638065240 2024-01-22T05:18:23.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f963dc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96380a7960 con 0x7f9638065620 2024-01-22T05:18:23.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f963dc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963815a890 con 0x7f963815b9b0 2024-01-22T05:18:23.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f9636a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9638065240 0x7f9638168480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f9636a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9638065240 0x7f9638168480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55472/0 (socket says 172.21.15.49:55472) 2024-01-22T05:18:23.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f9636a00700 1 -- 172.21.15.49:0/866874711 learned_addr learned my addr 172.21.15.49:0/866874711 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:23.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f9637e00700 1 --2- 172.21.15.49:0/866874711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f963815b9b0 0x7f96381695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f9636000700 1 --2- 172.21.15.49:0/866874711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9638065620 0x7f96381562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f9636a00700 1 -- 172.21.15.49:0/866874711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f963815b9b0 msgr2=0x7f96381695a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f9636a00700 1 --2- 172.21.15.49:0/866874711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f963815b9b0 0x7f96381695a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f9636a00700 1 -- 172.21.15.49:0/866874711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9638065620 msgr2=0x7f96381562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f9636a00700 1 --2- 172.21.15.49:0/866874711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9638065620 0x7f96381562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.538+0000 7f9636a00700 1 -- 172.21.15.49:0/866874711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9628009370 con 0x7f9638065240 2024-01-22T05:18:23.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.542+0000 7f9636a00700 1 --2- 172.21.15.49:0/866874711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9638065240 0x7f9638168480 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f9628006fd0 tx=0x7f9628017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:23.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.542+0000 7f962e000700 1 -- 172.21.15.49:0/866874711 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962800bea0 con 0x7f9638065240 2024-01-22T05:18:23.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.542+0000 7f962e000700 1 -- 172.21.15.49:0/866874711 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962800b8d0 con 0x7f9638065240 2024-01-22T05:18:23.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.542+0000 7f963dc00700 1 -- 172.21.15.49:0/866874711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9638168b80 con 0x7f9638065240 2024-01-22T05:18:23.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.542+0000 7f962e000700 1 -- 172.21.15.49:0/866874711 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962801b660 con 0x7f9638065240 2024-01-22T05:18:23.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.542+0000 7f963dc00700 1 -- 172.21.15.49:0/866874711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9638169140 con 0x7f9638065240 2024-01-22T05:18:23.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.542+0000 7f963dc00700 1 -- 172.21.15.49:0/866874711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96380a7730 con 0x7f9638065240 2024-01-22T05:18:23.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.546+0000 7f962e000700 1 -- 172.21.15.49:0/866874711 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f962801b9d0 con 0x7f9638065240 2024-01-22T05:18:23.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.546+0000 7f962e000700 1 --2- 172.21.15.49:0/866874711 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f961005a510 0x7f961005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.546+0000 7f962e000700 1 -- 172.21.15.49:0/866874711 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9628076200 con 0x7f9638065240 2024-01-22T05:18:23.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.546+0000 7f9636000700 1 --2- 172.21.15.49:0/866874711 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f961005a510 0x7f961005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.546+0000 7f9636000700 1 --2- 172.21.15.49:0/866874711 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f961005a510 0x7f961005c9d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f9620006d80 tx=0x7f9620008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:23.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.554+0000 7f962e000700 1 -- 172.21.15.49:0/866874711 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f96380a7730 con 0x7f9638065240 2024-01-22T05:18:23.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.726+0000 7f963dc00700 1 -- 172.21.15.49:0/866874711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96380a7730 con 0x7f9638065240 2024-01-22T05:18:23.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.726+0000 7f962e000700 1 -- 172.21.15.49:0/866874711 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+17178 (secure 0 0 0) 0x7f96380a7730 con 0x7f9638065240 2024-01-22T05:18:23.728 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:23.728 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":159,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:17:44.092750+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:17:41.253119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-01-22T05:17:42.073279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:18:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.730+0000 7f963dc00700 1 -- 172.21.15.49:0/866874711 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f961005a510 msgr2=0x7f961005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.730+0000 7f963dc00700 1 --2- 172.21.15.49:0/866874711 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f961005a510 0x7f961005c9d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f9620006d80 tx=0x7f9620008040).stop 2024-01-22T05:18:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.730+0000 7f963dc00700 1 -- 172.21.15.49:0/866874711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9638065240 msgr2=0x7f9638168480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.730+0000 7f963dc00700 1 --2- 172.21.15.49:0/866874711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9638065240 0x7f9638168480 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f9628006fd0 tx=0x7f9628017000).stop 2024-01-22T05:18:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.730+0000 7f963dc00700 1 -- 172.21.15.49:0/866874711 shutdown_connections 2024-01-22T05:18:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.730+0000 7f963dc00700 1 --2- 172.21.15.49:0/866874711 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f961005a510 0x7f961005c9d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.730+0000 7f963dc00700 1 --2- 172.21.15.49:0/866874711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f963815b9b0 0x7f96381695a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.730+0000 7f963dc00700 1 --2- 172.21.15.49:0/866874711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9638065620 0x7f96381562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.730+0000 7f963dc00700 1 --2- 172.21.15.49:0/866874711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9638065240 0x7f9638168480 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.730+0000 7f963dc00700 1 -- 172.21.15.49:0/866874711 >> 172.21.15.49:0/866874711 conn(0x7f96380c87f0 msgr2=0x7f96380ad370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.730+0000 7f963dc00700 1 -- 172.21.15.49:0/866874711 shutdown_connections 2024-01-22T05:18:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.730+0000 7f963dc00700 1 -- 172.21.15.49:0/866874711 wait complete. 2024-01-22T05:18:23.754 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:17:41.253119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '158', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:17:42.073279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:18:23.755 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:18:23.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.930+0000 7f3c2ca00700 1 Processor -- start 2024-01-22T05:18:23.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.930+0000 7f3c2ca00700 1 -- start start 2024-01-22T05:18:23.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c2ca00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3c280beeb0 0x7f3c280c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c2ca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c280c3b40 0x7f3c280a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c2ca00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c28068bd0 con 0x7f3c28069060 2024-01-22T05:18:23.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c2ca00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c280c3fd0 con 0x7f3c280beeb0 2024-01-22T05:18:23.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c2ca00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c28067fc0 con 0x7f3c280c3b40 2024-01-22T05:18:23.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c26a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3c280beeb0 0x7f3c280c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c26a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3c280beeb0 0x7f3c280c3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55476/0 (socket says 172.21.15.49:55476) 2024-01-22T05:18:23.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c26a00700 1 -- 172.21.15.49:0/512005766 learned_addr learned my addr 172.21.15.49:0/512005766 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:23.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c27400700 1 --1- 172.21.15.49:0/512005766 >> v1:172.21.15.110:6789/0 conn(0x7f3c28069060 0x7f3c280aad00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:41318/0 (socket says 172.21.15.49:41318) 2024-01-22T05:18:23.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c27e00700 1 --2- 172.21.15.49:0/512005766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c280c3b40 0x7f3c280a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c26a00700 1 -- 172.21.15.49:0/512005766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c280c3b40 msgr2=0x7f3c280a8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:23.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c26a00700 1 --2- 172.21.15.49:0/512005766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c280c3b40 0x7f3c280a8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c26a00700 1 -- 172.21.15.49:0/512005766 >> v1:172.21.15.110:6789/0 conn(0x7f3c28069060 legacy=0x7f3c280aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c26000700 1 -- 172.21.15.49:0/512005766 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152086410 0 0) 0x7f3c28068bd0 con 0x7f3c28069060 2024-01-22T05:18:23.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c26a00700 1 -- 172.21.15.49:0/512005766 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c280682a0 con 0x7f3c280beeb0 2024-01-22T05:18:23.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c26a00700 1 --2- 172.21.15.49:0/512005766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c280beeb0 0x7f3c280c3650 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f3c10006fd0 tx=0x7f3c100090f0).ready entity=mon.0 client_cookie=4aab2614a9f6d29d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:23.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c26000700 1 -- 172.21.15.49:0/512005766 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1000b600 con 0x7f3c280beeb0 2024-01-22T05:18:23.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c26000700 1 -- 172.21.15.49:0/512005766 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1000b760 con 0x7f3c280beeb0 2024-01-22T05:18:23.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c26000700 1 -- 172.21.15.49:0/512005766 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1000bae0 con 0x7f3c280beeb0 2024-01-22T05:18:23.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c2ca00700 1 -- 172.21.15.49:0/512005766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c280beeb0 msgr2=0x7f3c280c3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.934+0000 7f3c2ca00700 1 --2- 172.21.15.49:0/512005766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c280beeb0 0x7f3c280c3650 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f3c10006fd0 tx=0x7f3c100090f0).stop 2024-01-22T05:18:23.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.938+0000 7f3c2ca00700 1 -- 172.21.15.49:0/512005766 shutdown_connections 2024-01-22T05:18:23.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.938+0000 7f3c2ca00700 1 --2- 172.21.15.49:0/512005766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c280c3b40 0x7f3c280a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.938+0000 7f3c2ca00700 1 --2- 172.21.15.49:0/512005766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c280beeb0 0x7f3c280c3650 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.938+0000 7f3c2ca00700 1 -- 172.21.15.49:0/512005766 >> 172.21.15.49:0/512005766 conn(0x7f3c280c8750 msgr2=0x7f3c280c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.938+0000 7f3c2ca00700 1 -- 172.21.15.49:0/512005766 shutdown_connections 2024-01-22T05:18:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.938+0000 7f3c2ca00700 1 -- 172.21.15.49:0/512005766 wait complete. 2024-01-22T05:18:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.938+0000 7f3c2ca00700 1 Processor -- start 2024-01-22T05:18:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.942+0000 7f3c2ca00700 1 -- start start 2024-01-22T05:18:23.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.942+0000 7f3c2ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c28069060 0x7f3c280c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.942+0000 7f3c2ca00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c280beeb0 0x7f3c280c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.942+0000 7f3c2ca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c280c3b40 0x7f3c280c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.942+0000 7f3c2ca00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280c2970 con 0x7f3c28069060 2024-01-22T05:18:23.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.942+0000 7f3c2ca00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c28168630 con 0x7f3c280beeb0 2024-01-22T05:18:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.942+0000 7f3c2ca00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c281681a0 con 0x7f3c280c3b40 2024-01-22T05:18:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.942+0000 7f3c27400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c28069060 0x7f3c280c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.942+0000 7f3c27400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c28069060 0x7f3c280c04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55484/0 (socket says 172.21.15.49:55484) 2024-01-22T05:18:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.942+0000 7f3c27400700 1 -- 172.21.15.49:0/537972275 learned_addr learned my addr 172.21.15.49:0/537972275 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.942+0000 7f3c27e00700 1 --2- 172.21.15.49:0/537972275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c280c3b40 0x7f3c280c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.942+0000 7f3c26a00700 1 --2- 172.21.15.49:0/537972275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c280beeb0 0x7f3c280c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.946+0000 7f3c27400700 1 -- 172.21.15.49:0/537972275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c280c3b40 msgr2=0x7f3c280c2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.946+0000 7f3c27400700 1 --2- 172.21.15.49:0/537972275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c280c3b40 0x7f3c280c2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.946+0000 7f3c27400700 1 -- 172.21.15.49:0/537972275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c280beeb0 msgr2=0x7f3c280c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.946+0000 7f3c27400700 1 --2- 172.21.15.49:0/537972275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c280beeb0 0x7f3c280c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.946+0000 7f3c27400700 1 -- 172.21.15.49:0/537972275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c10009370 con 0x7f3c28069060 2024-01-22T05:18:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.946+0000 7f3c27400700 1 --2- 172.21.15.49:0/537972275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c28069060 0x7f3c280c04a0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f3c1800c470 tx=0x7f3c18007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.946+0000 7f3c1ea00700 1 -- 172.21.15.49:0/537972275 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c180070d0 con 0x7f3c28069060 2024-01-22T05:18:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.946+0000 7f3c1ea00700 1 -- 172.21.15.49:0/537972275 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c18007250 con 0x7f3c28069060 2024-01-22T05:18:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.946+0000 7f3c1ea00700 1 -- 172.21.15.49:0/537972275 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c180056e0 con 0x7f3c28069060 2024-01-22T05:18:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.946+0000 7f3c2ca00700 1 -- 172.21.15.49:0/537972275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c28167870 con 0x7f3c28069060 2024-01-22T05:18:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.946+0000 7f3c2ca00700 1 -- 172.21.15.49:0/537972275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c28167e30 con 0x7f3c28069060 2024-01-22T05:18:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.946+0000 7f3c2ca00700 1 -- 172.21.15.49:0/537972275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c28066840 con 0x7f3c28069060 2024-01-22T05:18:23.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.950+0000 7f3c1ea00700 1 -- 172.21.15.49:0/537972275 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3c18005ca0 con 0x7f3c28069060 2024-01-22T05:18:23.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.950+0000 7f3c1ea00700 1 --2- 172.21.15.49:0/537972275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c0005a540 0x7f3c0005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:23.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.950+0000 7f3c1ea00700 1 -- 172.21.15.49:0/537972275 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3c18073f70 con 0x7f3c28069060 2024-01-22T05:18:23.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.950+0000 7f3c26a00700 1 --2- 172.21.15.49:0/537972275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c0005a540 0x7f3c0005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:23.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.950+0000 7f3c26a00700 1 --2- 172.21.15.49:0/537972275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c0005a540 0x7f3c0005ca00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f3c10009130 tx=0x7f3c10017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:23.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:23.958+0000 7f3c1ea00700 1 -- 172.21.15.49:0/537972275 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3c180475f0 con 0x7f3c28069060 2024-01-22T05:18:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.122+0000 7f3c2ca00700 1 -- 172.21.15.49:0/537972275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3c28046800 con 0x7f3c28069060 2024-01-22T05:18:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.122+0000 7f3c1ea00700 1 -- 172.21.15.49:0/537972275 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v159) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3c18018020 con 0x7f3c28069060 2024-01-22T05:18:24.124 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:18:24.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.126+0000 7f3c2ca00700 1 -- 172.21.15.49:0/537972275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c0005a540 msgr2=0x7f3c0005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:24.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.126+0000 7f3c2ca00700 1 --2- 172.21.15.49:0/537972275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c0005a540 0x7f3c0005ca00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f3c10009130 tx=0x7f3c10017000).stop 2024-01-22T05:18:24.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.126+0000 7f3c2ca00700 1 -- 172.21.15.49:0/537972275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c28069060 msgr2=0x7f3c280c04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:24.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.126+0000 7f3c2ca00700 1 --2- 172.21.15.49:0/537972275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c28069060 0x7f3c280c04a0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f3c1800c470 tx=0x7f3c18007e30).stop 2024-01-22T05:18:24.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.126+0000 7f3c2ca00700 1 -- 172.21.15.49:0/537972275 shutdown_connections 2024-01-22T05:18:24.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.126+0000 7f3c2ca00700 1 --2- 172.21.15.49:0/537972275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3c0005a540 0x7f3c0005ca00 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.126+0000 7f3c2ca00700 1 --2- 172.21.15.49:0/537972275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c280c3b40 0x7f3c280c2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.126+0000 7f3c2ca00700 1 --2- 172.21.15.49:0/537972275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c280beeb0 0x7f3c280c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.126+0000 7f3c2ca00700 1 --2- 172.21.15.49:0/537972275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c28069060 0x7f3c280c04a0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.126+0000 7f3c2ca00700 1 -- 172.21.15.49:0/537972275 >> 172.21.15.49:0/537972275 conn(0x7f3c280c8750 msgr2=0x7f3c280623e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:24.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.126+0000 7f3c2ca00700 1 -- 172.21.15.49:0/537972275 shutdown_connections 2024-01-22T05:18:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.126+0000 7f3c2ca00700 1 -- 172.21.15.49:0/537972275 wait complete. 2024-01-22T05:18:24.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:18:24.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.318+0000 7f7105e00700 1 Processor -- start 2024-01-22T05:18:24.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.318+0000 7f7105e00700 1 -- start start 2024-01-22T05:18:24.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f7105e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f71000bbdc0 0x7f7100157890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:24.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f7105e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7100158230 0x7f7100154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:24.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f7105e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71000bcea0 con 0x7f7100157d80 2024-01-22T05:18:24.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f7105e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71000c2310 con 0x7f71000bbdc0 2024-01-22T05:18:24.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f7105e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71000c2860 con 0x7f7100158230 2024-01-22T05:18:24.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f70fea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f71000bbdc0 0x7f7100157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:24.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f70fe000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7100157d80 0x7f7100154270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47098/0 (socket says 172.21.15.49:47098) 2024-01-22T05:18:24.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f70fe000700 1 -- 172.21.15.49:0/2887557385 learned_addr learned my addr 172.21.15.49:0/2887557385 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:24.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f70ff400700 1 --2- 172.21.15.49:0/2887557385 >> v2:172.21.15.110:3300/0 conn(0x7f7100158230 0x7f7100154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f70fd600700 1 -- 172.21.15.49:0/2887557385 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549623231 0 0) 0x7f70e8001110 con 0x7f7100157d80 2024-01-22T05:18:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f70fd600700 1 -- 172.21.15.49:0/2887557385 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e00033f0 con 0x7f7100157d80 2024-01-22T05:18:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f70fea00700 1 -- 172.21.15.49:0/2887557385 >> v2:172.21.15.110:3300/0 conn(0x7f7100158230 msgr2=0x7f7100154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f70fea00700 1 --2- 172.21.15.49:0/2887557385 >> v2:172.21.15.110:3300/0 conn(0x7f7100158230 0x7f7100154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f70fea00700 1 -- 172.21.15.49:0/2887557385 >> v1:172.21.15.49:6789/0 conn(0x7f7100157d80 legacy=0x7f7100154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f70fd600700 1 -- 172.21.15.49:0/2887557385 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2208278145 0 0) 0x7f70e00033f0 con 0x7f7100157d80 2024-01-22T05:18:24.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.322+0000 7f70fea00700 1 -- 172.21.15.49:0/2887557385 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71000bc8e0 con 0x7f71000bbdc0 2024-01-22T05:18:24.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.326+0000 7f70fea00700 1 --2- 172.21.15.49:0/2887557385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71000bbdc0 0x7f7100157890 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f7100065ce0 tx=0x7f70f0009060).ready entity=mon.0 client_cookie=b334d5e0d6babb0d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:24.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.326+0000 7f70fd600700 1 -- 172.21.15.49:0/2887557385 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8001600 con 0x7f71000bbdc0 2024-01-22T05:18:24.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.326+0000 7f70fd600700 1 -- 172.21.15.49:0/2887557385 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f0011400 con 0x7f71000bbdc0 2024-01-22T05:18:24.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.326+0000 7f70fd600700 1 -- 172.21.15.49:0/2887557385 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0011780 con 0x7f71000bbdc0 2024-01-22T05:18:24.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.326+0000 7f7105e00700 1 -- 172.21.15.49:0/2887557385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71000bbdc0 msgr2=0x7f7100157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:24.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.326+0000 7f7105e00700 1 --2- 172.21.15.49:0/2887557385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71000bbdc0 0x7f7100157890 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f7100065ce0 tx=0x7f70f0009060).stop 2024-01-22T05:18:24.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.326+0000 7f7105e00700 1 -- 172.21.15.49:0/2887557385 shutdown_connections 2024-01-22T05:18:24.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.326+0000 7f7105e00700 1 --2- 172.21.15.49:0/2887557385 >> v2:172.21.15.110:3300/0 conn(0x7f7100158230 0x7f7100154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.326+0000 7f7105e00700 1 --2- 172.21.15.49:0/2887557385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71000bbdc0 0x7f7100157890 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.326+0000 7f7105e00700 1 -- 172.21.15.49:0/2887557385 >> 172.21.15.49:0/2887557385 conn(0x7f71000c3900 msgr2=0x7f71000c3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:24.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.326+0000 7f7105e00700 1 -- 172.21.15.49:0/2887557385 shutdown_connections 2024-01-22T05:18:24.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.326+0000 7f7105e00700 1 -- 172.21.15.49:0/2887557385 wait complete. 2024-01-22T05:18:24.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f7105e00700 1 Processor -- start 2024-01-22T05:18:24.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f7105e00700 1 -- start start 2024-01-22T05:18:24.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f7105e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71000bbdc0 0x7f7100144440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:24.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f7105e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7100157d80 0x7f71001514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:24.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f7105e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7100158230 0x7f710015aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:24.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f7105e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7100169920 con 0x7f7100158230 2024-01-22T05:18:24.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f7105e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7100169e10 con 0x7f71000bbdc0 2024-01-22T05:18:24.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f7105e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7100168d50 con 0x7f7100157d80 2024-01-22T05:18:24.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f70ff400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7100158230 0x7f710015aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:24.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f70ff400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7100158230 0x7f710015aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55502/0 (socket says 172.21.15.49:55502) 2024-01-22T05:18:24.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f70ff400700 1 -- 172.21.15.49:0/439654400 learned_addr learned my addr 172.21.15.49:0/439654400 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:24.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f70fea00700 1 --2- 172.21.15.49:0/439654400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71000bbdc0 0x7f7100144440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:24.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f70fe000700 1 --2- 172.21.15.49:0/439654400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7100157d80 0x7f71001514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:24.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f70ff400700 1 -- 172.21.15.49:0/439654400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7100157d80 msgr2=0x7f71001514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:24.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f70ff400700 1 --2- 172.21.15.49:0/439654400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7100157d80 0x7f71001514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f70ff400700 1 -- 172.21.15.49:0/439654400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71000bbdc0 msgr2=0x7f7100144440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:24.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f70ff400700 1 --2- 172.21.15.49:0/439654400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71000bbdc0 0x7f7100144440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.330+0000 7f70ff400700 1 -- 172.21.15.49:0/439654400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f00092a0 con 0x7f7100158230 2024-01-22T05:18:24.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.334+0000 7f70ff400700 1 --2- 172.21.15.49:0/439654400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7100158230 0x7f710015aac0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f70f8009e20 tx=0x7f70f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:24.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.334+0000 7f70f6000700 1 -- 172.21.15.49:0/439654400 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f800caa0 con 0x7f7100158230 2024-01-22T05:18:24.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.334+0000 7f70f6000700 1 -- 172.21.15.49:0/439654400 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f800f040 con 0x7f7100158230 2024-01-22T05:18:24.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.334+0000 7f70f6000700 1 -- 172.21.15.49:0/439654400 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f800ce10 con 0x7f7100158230 2024-01-22T05:18:24.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.334+0000 7f7105e00700 1 -- 172.21.15.49:0/439654400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7100168ff0 con 0x7f7100158230 2024-01-22T05:18:24.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.334+0000 7f7105e00700 1 -- 172.21.15.49:0/439654400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71001695b0 con 0x7f7100158230 2024-01-22T05:18:24.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.334+0000 7f7105e00700 1 -- 172.21.15.49:0/439654400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7100169ad0 con 0x7f7100158230 2024-01-22T05:18:24.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.334+0000 7f70f6000700 1 -- 172.21.15.49:0/439654400 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f70f8013610 con 0x7f7100158230 2024-01-22T05:18:24.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.338+0000 7f70f6000700 1 --2- 172.21.15.49:0/439654400 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f70d805a510 0x7f70d805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:24.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.338+0000 7f70f6000700 1 -- 172.21.15.49:0/439654400 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f70f8075000 con 0x7f7100158230 2024-01-22T05:18:24.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.338+0000 7f70fea00700 1 --2- 172.21.15.49:0/439654400 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f70d805a510 0x7f70d805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:24.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.338+0000 7f70fea00700 1 --2- 172.21.15.49:0/439654400 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f70d805a510 0x7f70d805c9d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f7100065ce0 tx=0x7f70f0016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:24.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.346+0000 7f70f6000700 1 -- 172.21.15.49:0/439654400 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7100169ad0 con 0x7f7100158230 2024-01-22T05:18:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.506+0000 7f7105e00700 1 -- 172.21.15.49:0/439654400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7100169ad0 con 0x7f7100158230 2024-01-22T05:18:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.506+0000 7f70f6000700 1 -- 172.21.15.49:0/439654400 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v159) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7100169ad0 con 0x7f7100158230 2024-01-22T05:18:24.508 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:18:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.510+0000 7f7105e00700 1 -- 172.21.15.49:0/439654400 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f70d805a510 msgr2=0x7f70d805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.510+0000 7f7105e00700 1 --2- 172.21.15.49:0/439654400 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f70d805a510 0x7f70d805c9d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f7100065ce0 tx=0x7f70f0016000).stop 2024-01-22T05:18:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.510+0000 7f7105e00700 1 -- 172.21.15.49:0/439654400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7100158230 msgr2=0x7f710015aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.510+0000 7f7105e00700 1 --2- 172.21.15.49:0/439654400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7100158230 0x7f710015aac0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f70f8009e20 tx=0x7f70f800b040).stop 2024-01-22T05:18:24.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.510+0000 7f7105e00700 1 -- 172.21.15.49:0/439654400 shutdown_connections 2024-01-22T05:18:24.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.510+0000 7f7105e00700 1 --2- 172.21.15.49:0/439654400 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f70d805a510 0x7f70d805c9d0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.510+0000 7f7105e00700 1 --2- 172.21.15.49:0/439654400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7100158230 0x7f710015aac0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.510+0000 7f7105e00700 1 --2- 172.21.15.49:0/439654400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7100157d80 0x7f71001514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.510+0000 7f7105e00700 1 --2- 172.21.15.49:0/439654400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71000bbdc0 0x7f7100144440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.510+0000 7f7105e00700 1 -- 172.21.15.49:0/439654400 >> 172.21.15.49:0/439654400 conn(0x7f71000c3900 msgr2=0x7f71000c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:24.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.510+0000 7f7105e00700 1 -- 172.21.15.49:0/439654400 shutdown_connections 2024-01-22T05:18:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.510+0000 7f7105e00700 1 -- 172.21.15.49:0/439654400 wait complete. 2024-01-22T05:18:24.536 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:18:24.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.698+0000 7fd4aa000700 1 Processor -- start 2024-01-22T05:18:24.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.698+0000 7fd4aa000700 1 -- start start 2024-01-22T05:18:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.702+0000 7fd4aa000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd4a4067a90 0x7fd4a40a87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.702+0000 7fd4aa000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4a40a8cd0 0x7fd4a4151a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.702+0000 7fd4aa000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a40659a0 con 0x7fd4a4151f30 2024-01-22T05:18:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.702+0000 7fd4aa000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a40a9130 con 0x7fd4a4067a90 2024-01-22T05:18:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.702+0000 7fd4aa000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a4152930 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.702+0000 7fd4a8c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd4a4067a90 0x7fd4a40a87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:24.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.702+0000 7fd4a3e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4a40a8cd0 0x7fd4a4151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:24.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.702+0000 7fd4a8c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd4a4067a90 0x7fd4a40a87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55512/0 (socket says 172.21.15.49:55512) 2024-01-22T05:18:24.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.702+0000 7fd4a8c00700 1 -- 172.21.15.49:0/1121632047 learned_addr learned my addr 172.21.15.49:0/1121632047 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:24.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4a3e00700 1 -- 172.21.15.49:0/1121632047 >> v2:172.21.15.49:3300/0 conn(0x7fd4a4067a90 msgr2=0x7fd4a40a87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:24.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4a3e00700 1 --2- 172.21.15.49:0/1121632047 >> v2:172.21.15.49:3300/0 conn(0x7fd4a4067a90 0x7fd4a40a87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4a3e00700 1 -- 172.21.15.49:0/1121632047 >> v1:172.21.15.110:6789/0 conn(0x7fd4a4151f30 legacy=0x7fd4a4065e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:24.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4a3e00700 1 -- 172.21.15.49:0/1121632047 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a4152c10 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4a3e00700 1 --2- 172.21.15.49:0/1121632047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4a40a8cd0 0x7fd4a4151a40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fd48c009760 tx=0x7fd48c009060).ready entity=mon.2 client_cookie=b78f5e60ecbfb484 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:24.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4a3400700 1 -- 172.21.15.49:0/1121632047 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00f510 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4a3400700 1 -- 172.21.15.49:0/1121632047 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c00f670 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4a3400700 1 -- 172.21.15.49:0/1121632047 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00f9f0 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4aa000700 1 -- 172.21.15.49:0/1121632047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4a40a8cd0 msgr2=0x7fd4a4151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:24.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4aa000700 1 --2- 172.21.15.49:0/1121632047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4a40a8cd0 0x7fd4a4151a40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fd48c009760 tx=0x7fd48c009060).stop 2024-01-22T05:18:24.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4aa000700 1 -- 172.21.15.49:0/1121632047 shutdown_connections 2024-01-22T05:18:24.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4aa000700 1 --2- 172.21.15.49:0/1121632047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4a40a8cd0 0x7fd4a4151a40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4aa000700 1 --2- 172.21.15.49:0/1121632047 >> v2:172.21.15.49:3300/0 conn(0x7fd4a4067a90 0x7fd4a40a87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4aa000700 1 -- 172.21.15.49:0/1121632047 >> 172.21.15.49:0/1121632047 conn(0x7fd4a40c6fc0 msgr2=0x7fd4a40c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:24.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4aa000700 1 -- 172.21.15.49:0/1121632047 shutdown_connections 2024-01-22T05:18:24.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.706+0000 7fd4aa000700 1 -- 172.21.15.49:0/1121632047 wait complete. 2024-01-22T05:18:24.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.710+0000 7fd4aa000700 1 Processor -- start 2024-01-22T05:18:24.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.710+0000 7fd4aa000700 1 -- start start 2024-01-22T05:18:24.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4aa000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4a4067a90 0x7fd4a4164a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:24.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4aa000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a40a8cd0 0x7fd4a4157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:24.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4aa000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4a4151f30 0x7fd4a40c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:24.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4aa000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a4157ff0 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4aa000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a40bd970 con 0x7fd4a4151f30 2024-01-22T05:18:24.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4aa000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a40bdc50 con 0x7fd4a4067a90 2024-01-22T05:18:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4a3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a40a8cd0 0x7fd4a4157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4a3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a40a8cd0 0x7fd4a4157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55518/0 (socket says 172.21.15.49:55518) 2024-01-22T05:18:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4a3e00700 1 -- 172.21.15.49:0/981962142 learned_addr learned my addr 172.21.15.49:0/981962142 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4a8c00700 1 --2- 172.21.15.49:0/981962142 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4a4067a90 0x7fd4a4164a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4a9600700 1 --2- 172.21.15.49:0/981962142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4a4151f30 0x7fd4a40c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4a3e00700 1 -- 172.21.15.49:0/981962142 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4a4067a90 msgr2=0x7fd4a4164a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4a3e00700 1 --2- 172.21.15.49:0/981962142 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4a4067a90 0x7fd4a4164a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4a3e00700 1 -- 172.21.15.49:0/981962142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4a4151f30 msgr2=0x7fd4a40c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4a3e00700 1 --2- 172.21.15.49:0/981962142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4a4151f30 0x7fd4a40c4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4a3e00700 1 -- 172.21.15.49:0/981962142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c0092a0 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4a9600700 1 --2- 172.21.15.49:0/981962142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4a4151f30 0x7fd4a40c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4a3e00700 1 --2- 172.21.15.49:0/981962142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a40a8cd0 0x7fd4a4157b00 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7fd48c009e00 tx=0x7fd48c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd49be00700 1 -- 172.21.15.49:0/981962142 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00f7e0 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd49be00700 1 -- 172.21.15.49:0/981962142 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c00f940 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4aa000700 1 -- 172.21.15.49:0/981962142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a40bdf30 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd49be00700 1 -- 172.21.15.49:0/981962142 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c01b660 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.714+0000 7fd4aa000700 1 -- 172.21.15.49:0/981962142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a40be4f0 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.718+0000 7fd4aa000700 1 -- 172.21.15.49:0/981962142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a4047060 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.718+0000 7fd49be00700 1 -- 172.21.15.49:0/981962142 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd48c01ba10 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.722+0000 7fd49be00700 1 --2- 172.21.15.49:0/981962142 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd47c05a4e0 0x7fd47c05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:24.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.722+0000 7fd49be00700 1 -- 172.21.15.49:0/981962142 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd48c0763e0 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.722+0000 7fd4a8c00700 1 --2- 172.21.15.49:0/981962142 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd47c05a4e0 0x7fd47c05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:24.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.722+0000 7fd4a8c00700 1 --2- 172.21.15.49:0/981962142 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd47c05a4e0 0x7fd47c05c9a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fd494009c20 tx=0x7fd494009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:24.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.726+0000 7fd49be00700 1 -- 172.21.15.49:0/981962142 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd48c0499a0 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.894+0000 7fd4aa000700 1 -- 172.21.15.49:0/981962142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4a4065630 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.894+0000 7fd49be00700 1 -- 172.21.15.49:0/981962142 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v159) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd48c0280a0 con 0x7fd4a40a8cd0 2024-01-22T05:18:24.895 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:18:24.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.898+0000 7fd4aa000700 1 -- 172.21.15.49:0/981962142 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd47c05a4e0 msgr2=0x7fd47c05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:24.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.898+0000 7fd4aa000700 1 --2- 172.21.15.49:0/981962142 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd47c05a4e0 0x7fd47c05c9a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fd494009c20 tx=0x7fd494009060).stop 2024-01-22T05:18:24.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.898+0000 7fd4aa000700 1 -- 172.21.15.49:0/981962142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a40a8cd0 msgr2=0x7fd4a4157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:24.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.898+0000 7fd4aa000700 1 --2- 172.21.15.49:0/981962142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a40a8cd0 0x7fd4a4157b00 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7fd48c009e00 tx=0x7fd48c017000).stop 2024-01-22T05:18:24.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.898+0000 7fd4aa000700 1 -- 172.21.15.49:0/981962142 shutdown_connections 2024-01-22T05:18:24.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.898+0000 7fd4aa000700 1 --2- 172.21.15.49:0/981962142 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd47c05a4e0 0x7fd47c05c9a0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.898+0000 7fd4aa000700 1 --2- 172.21.15.49:0/981962142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4a4151f30 0x7fd4a40c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.898+0000 7fd4aa000700 1 --2- 172.21.15.49:0/981962142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4a40a8cd0 0x7fd4a4157b00 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.898+0000 7fd4aa000700 1 --2- 172.21.15.49:0/981962142 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4a4067a90 0x7fd4a4164a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:24.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.898+0000 7fd4aa000700 1 -- 172.21.15.49:0/981962142 >> 172.21.15.49:0/981962142 conn(0x7fd4a40c6fc0 msgr2=0x7fd4a41498e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:24.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.898+0000 7fd4aa000700 1 -- 172.21.15.49:0/981962142 shutdown_connections 2024-01-22T05:18:24.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:24.898+0000 7fd4aa000700 1 -- 172.21.15.49:0/981962142 wait complete. 2024-01-22T05:18:24.922 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:18:25.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.090+0000 7fd557200700 1 Processor -- start 2024-01-22T05:18:25.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.090+0000 7fd557200700 1 -- start start 2024-01-22T05:18:25.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.094+0000 7fd557200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd558063080 0x7fd558067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.094+0000 7fd557200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5580beb80 con 0x7fd5580a79f0 2024-01-22T05:18:25.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.094+0000 7fd557200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5580bf3e0 con 0x7fd5580a7dd0 2024-01-22T05:18:25.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.094+0000 7fd557200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5581583e0 con 0x7fd558063080 2024-01-22T05:18:25.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.094+0000 7fd555400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd558063080 0x7fd558067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.094+0000 7fd555400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd558063080 0x7fd558067a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55534/0 (socket says 172.21.15.49:55534) 2024-01-22T05:18:25.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.094+0000 7fd555400700 1 -- 172.21.15.49:0/1308231796 learned_addr learned my addr 172.21.15.49:0/1308231796 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:25.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.094+0000 7fd555e00700 1 --1- 172.21.15.49:0/1308231796 >> v1:172.21.15.49:6789/0 conn(0x7fd5580a79f0 0x7fd558062970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47102/0 (socket says 172.21.15.49:47102) 2024-01-22T05:18:25.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.094+0000 7fd555400700 1 -- 172.21.15.49:0/1308231796 >> v1:172.21.15.110:6789/0 conn(0x7fd5580a7dd0 legacy=0x7fd558067f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.094+0000 7fd555400700 1 -- 172.21.15.49:0/1308231796 >> v1:172.21.15.49:6789/0 conn(0x7fd5580a79f0 legacy=0x7fd558062970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.094+0000 7fd555400700 1 -- 172.21.15.49:0/1308231796 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5580bdf70 con 0x7fd558063080 2024-01-22T05:18:25.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.098+0000 7fd555400700 1 --2- 172.21.15.49:0/1308231796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd558063080 0x7fd558067a90 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7fd540006fd0 tx=0x7fd5400090f0).ready entity=mon.0 client_cookie=d08b8b2bb090a1e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:25.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.098+0000 7fd554a00700 1 -- 172.21.15.49:0/1308231796 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54000b600 con 0x7fd558063080 2024-01-22T05:18:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.098+0000 7fd554a00700 1 -- 172.21.15.49:0/1308231796 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54000b760 con 0x7fd558063080 2024-01-22T05:18:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.098+0000 7fd554a00700 1 -- 172.21.15.49:0/1308231796 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54000bae0 con 0x7fd558063080 2024-01-22T05:18:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.098+0000 7fd557200700 1 -- 172.21.15.49:0/1308231796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd558063080 msgr2=0x7fd558067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.098+0000 7fd557200700 1 --2- 172.21.15.49:0/1308231796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd558063080 0x7fd558067a90 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7fd540006fd0 tx=0x7fd5400090f0).stop 2024-01-22T05:18:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.098+0000 7fd557200700 1 -- 172.21.15.49:0/1308231796 shutdown_connections 2024-01-22T05:18:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.098+0000 7fd557200700 1 --2- 172.21.15.49:0/1308231796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd558063080 0x7fd558067a90 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.098+0000 7fd557200700 1 -- 172.21.15.49:0/1308231796 >> 172.21.15.49:0/1308231796 conn(0x7fd5580c8770 msgr2=0x7fd5580c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:25.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.098+0000 7fd557200700 1 -- 172.21.15.49:0/1308231796 shutdown_connections 2024-01-22T05:18:25.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.098+0000 7fd557200700 1 -- 172.21.15.49:0/1308231796 wait complete. 2024-01-22T05:18:25.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.102+0000 7fd557200700 1 Processor -- start 2024-01-22T05:18:25.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.102+0000 7fd557200700 1 -- start start 2024-01-22T05:18:25.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd557200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd558063080 0x7fd5580c1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd557200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5580a79f0 0x7fd55815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd557200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5580a7dd0 0x7fd5580bf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd557200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5580c26a0 con 0x7fd5580a7dd0 2024-01-22T05:18:25.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd557200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5580c1b20 con 0x7fd558063080 2024-01-22T05:18:25.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd557200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5580c1e00 con 0x7fd5580a79f0 2024-01-22T05:18:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd556800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5580a7dd0 0x7fd5580bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd556800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5580a7dd0 0x7fd5580bf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55548/0 (socket says 172.21.15.49:55548) 2024-01-22T05:18:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd556800700 1 -- 172.21.15.49:0/2076104859 learned_addr learned my addr 172.21.15.49:0/2076104859 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd555e00700 1 --2- 172.21.15.49:0/2076104859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd558063080 0x7fd5580c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd555400700 1 --2- 172.21.15.49:0/2076104859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5580a79f0 0x7fd55815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd556800700 1 -- 172.21.15.49:0/2076104859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5580a79f0 msgr2=0x7fd55815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd556800700 1 --2- 172.21.15.49:0/2076104859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5580a79f0 0x7fd55815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd556800700 1 -- 172.21.15.49:0/2076104859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd558063080 msgr2=0x7fd5580c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd556800700 1 --2- 172.21.15.49:0/2076104859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd558063080 0x7fd5580c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd556800700 1 -- 172.21.15.49:0/2076104859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd540009370 con 0x7fd5580a7dd0 2024-01-22T05:18:25.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd555e00700 1 --2- 172.21.15.49:0/2076104859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd558063080 0x7fd5580c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:25.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd556800700 1 --2- 172.21.15.49:0/2076104859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5580a7dd0 0x7fd5580bf810 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7fd550002230 tx=0x7fd5500015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:25.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd54d600700 1 -- 172.21.15.49:0/2076104859 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550010510 con 0x7fd5580a7dd0 2024-01-22T05:18:25.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd54d600700 1 -- 172.21.15.49:0/2076104859 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd550010670 con 0x7fd5580a7dd0 2024-01-22T05:18:25.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd54d600700 1 -- 172.21.15.49:0/2076104859 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5500109f0 con 0x7fd5580a7dd0 2024-01-22T05:18:25.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd557200700 1 -- 172.21.15.49:0/2076104859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5580c20e0 con 0x7fd5580a7dd0 2024-01-22T05:18:25.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.106+0000 7fd557200700 1 -- 172.21.15.49:0/2076104859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5580c0cf0 con 0x7fd5580a7dd0 2024-01-22T05:18:25.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.110+0000 7fd557200700 1 -- 172.21.15.49:0/2076104859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5580665a0 con 0x7fd5580a7dd0 2024-01-22T05:18:25.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.110+0000 7fd54d600700 1 -- 172.21.15.49:0/2076104859 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd55001b400 con 0x7fd5580a7dd0 2024-01-22T05:18:25.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.110+0000 7fd54d600700 1 --2- 172.21.15.49:0/2076104859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd53005a510 0x7fd53005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.110+0000 7fd54d600700 1 -- 172.21.15.49:0/2076104859 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd550074760 con 0x7fd5580a7dd0 2024-01-22T05:18:25.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.110+0000 7fd555e00700 1 --2- 172.21.15.49:0/2076104859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd53005a510 0x7fd53005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.114+0000 7fd555e00700 1 --2- 172.21.15.49:0/2076104859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd53005a510 0x7fd53005c9d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7fd548005790 tx=0x7fd548007c90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:25.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.118+0000 7fd54d600700 1 -- 172.21.15.49:0/2076104859 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd550047d80 con 0x7fd5580a7dd0 2024-01-22T05:18:25.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.286+0000 7fd557200700 1 -- 172.21.15.49:0/2076104859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5580ab720 con 0x7fd5580a7dd0 2024-01-22T05:18:25.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.286+0000 7fd54d600700 1 -- 172.21.15.49:0/2076104859 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v159) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd55004b3a0 con 0x7fd5580a7dd0 2024-01-22T05:18:25.289 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:18:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.290+0000 7fd557200700 1 -- 172.21.15.49:0/2076104859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd53005a510 msgr2=0x7fd53005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.290+0000 7fd557200700 1 --2- 172.21.15.49:0/2076104859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd53005a510 0x7fd53005c9d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7fd548005790 tx=0x7fd548007c90).stop 2024-01-22T05:18:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.290+0000 7fd557200700 1 -- 172.21.15.49:0/2076104859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5580a7dd0 msgr2=0x7fd5580bf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.290+0000 7fd557200700 1 --2- 172.21.15.49:0/2076104859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5580a7dd0 0x7fd5580bf810 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7fd550002230 tx=0x7fd5500015e0).stop 2024-01-22T05:18:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.290+0000 7fd557200700 1 -- 172.21.15.49:0/2076104859 shutdown_connections 2024-01-22T05:18:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.290+0000 7fd557200700 1 --2- 172.21.15.49:0/2076104859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd53005a510 0x7fd53005c9d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.290+0000 7fd557200700 1 --2- 172.21.15.49:0/2076104859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5580a7dd0 0x7fd5580bf810 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.290+0000 7fd557200700 1 --2- 172.21.15.49:0/2076104859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5580a79f0 0x7fd55815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.290+0000 7fd557200700 1 --2- 172.21.15.49:0/2076104859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd558063080 0x7fd5580c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.290+0000 7fd557200700 1 -- 172.21.15.49:0/2076104859 >> 172.21.15.49:0/2076104859 conn(0x7fd5580c8770 msgr2=0x7fd5580c32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.290+0000 7fd557200700 1 -- 172.21.15.49:0/2076104859 shutdown_connections 2024-01-22T05:18:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.290+0000 7fd557200700 1 -- 172.21.15.49:0/2076104859 wait complete. 2024-01-22T05:18:25.314 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:18:25.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.470+0000 7f05f7e00700 1 Processor -- start 2024-01-22T05:18:25.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.470+0000 7f05f7e00700 1 -- start start 2024-01-22T05:18:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.474+0000 7f05f7e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f05f00bd650 0x7f05f01503c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.474+0000 7f05f7e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05f01508b0 0x7f05f00c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.474+0000 7f05f7e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f00c5880 con 0x7f05f00c3cc0 2024-01-22T05:18:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.474+0000 7f05f7e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f00c5220 con 0x7f05f00bd650 2024-01-22T05:18:25.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.474+0000 7f05f7e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f00bdd90 con 0x7f05f01508b0 2024-01-22T05:18:25.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.474+0000 7f05f6800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f05f00c3cc0 0x7f05f01542a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47112/0 (socket says 172.21.15.49:47112) 2024-01-22T05:18:25.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.474+0000 7f05f6800700 1 -- 172.21.15.49:0/2922787582 learned_addr learned my addr 172.21.15.49:0/2922787582 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:25.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.474+0000 7f05f5400700 1 --2- 172.21.15.49:0/2922787582 >> v2:172.21.15.110:3300/0 conn(0x7f05f00bd650 0x7f05f01503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.474+0000 7f05f4a00700 1 --2- 172.21.15.49:0/2922787582 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05f01508b0 0x7f05f00c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.478+0000 7f05f5400700 1 -- 172.21.15.49:0/2922787582 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05f01508b0 msgr2=0x7f05f00c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:25.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.478+0000 7f05efe00700 1 -- 172.21.15.49:0/2922787582 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025560620 0 0) 0x7f05f00c5880 con 0x7f05f00c3cc0 2024-01-22T05:18:25.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.478+0000 7f05f5400700 1 --2- 172.21.15.49:0/2922787582 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05f01508b0 0x7f05f00c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.478+0000 7f05f5400700 1 -- 172.21.15.49:0/2922787582 >> v1:172.21.15.49:6789/0 conn(0x7f05f00c3cc0 legacy=0x7f05f01542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.478+0000 7f05f5400700 1 -- 172.21.15.49:0/2922787582 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f00be070 con 0x7f05f00bd650 2024-01-22T05:18:25.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.478+0000 7f05f5400700 1 --2- 172.21.15.49:0/2922787582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f00bd650 0x7f05f01503c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f05e0009760 tx=0x7f05e0009060).ready entity=mon.1 client_cookie=e6eaee28f7cb91da server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:25.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.478+0000 7f05efe00700 1 -- 172.21.15.49:0/2922787582 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e000f510 con 0x7f05f00bd650 2024-01-22T05:18:25.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.478+0000 7f05efe00700 1 -- 172.21.15.49:0/2922787582 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e000f670 con 0x7f05f00bd650 2024-01-22T05:18:25.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.478+0000 7f05efe00700 1 -- 172.21.15.49:0/2922787582 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e000f9f0 con 0x7f05f00bd650 2024-01-22T05:18:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.478+0000 7f05f7e00700 1 -- 172.21.15.49:0/2922787582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f00bd650 msgr2=0x7f05f01503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.478+0000 7f05f7e00700 1 --2- 172.21.15.49:0/2922787582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f00bd650 0x7f05f01503c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f05e0009760 tx=0x7f05e0009060).stop 2024-01-22T05:18:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.478+0000 7f05f7e00700 1 -- 172.21.15.49:0/2922787582 shutdown_connections 2024-01-22T05:18:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.478+0000 7f05f7e00700 1 --2- 172.21.15.49:0/2922787582 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05f01508b0 0x7f05f00c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.478+0000 7f05f7e00700 1 --2- 172.21.15.49:0/2922787582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f00bd650 0x7f05f01503c0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.478+0000 7f05f7e00700 1 -- 172.21.15.49:0/2922787582 >> 172.21.15.49:0/2922787582 conn(0x7f05f00c87f0 msgr2=0x7f05f00c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:25.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.482+0000 7f05f7e00700 1 -- 172.21.15.49:0/2922787582 shutdown_connections 2024-01-22T05:18:25.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.482+0000 7f05f7e00700 1 -- 172.21.15.49:0/2922787582 wait complete. 2024-01-22T05:18:25.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.482+0000 7f05f7e00700 1 Processor -- start 2024-01-22T05:18:25.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.482+0000 7f05f7e00700 1 -- start start 2024-01-22T05:18:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05f00bd650 0x7f05f00ad130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f00c3cc0 0x7f05f00c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f7e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05f01508b0 0x7f05f0150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f7e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f00abca0 con 0x7f05f00bd650 2024-01-22T05:18:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f7e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f00abf80 con 0x7f05f00c3cc0 2024-01-22T05:18:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f7e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f00ac260 con 0x7f05f01508b0 2024-01-22T05:18:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05f00bd650 0x7f05f00ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05f00bd650 0x7f05f00ad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55556/0 (socket says 172.21.15.49:55556) 2024-01-22T05:18:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f5400700 1 -- 172.21.15.49:0/629413625 learned_addr learned my addr 172.21.15.49:0/629413625 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f6800700 1 --2- 172.21.15.49:0/629413625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05f01508b0 0x7f05f0150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f4a00700 1 --2- 172.21.15.49:0/629413625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f00c3cc0 0x7f05f00c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f5400700 1 -- 172.21.15.49:0/629413625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05f01508b0 msgr2=0x7f05f0150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f5400700 1 --2- 172.21.15.49:0/629413625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05f01508b0 0x7f05f0150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f5400700 1 -- 172.21.15.49:0/629413625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f00c3cc0 msgr2=0x7f05f00c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f5400700 1 --2- 172.21.15.49:0/629413625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f00c3cc0 0x7f05f00c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f5400700 1 -- 172.21.15.49:0/629413625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e00092a0 con 0x7f05f00bd650 2024-01-22T05:18:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f4a00700 1 --2- 172.21.15.49:0/629413625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f00c3cc0 0x7f05f00c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:18:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f5400700 1 --2- 172.21.15.49:0/629413625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05f00bd650 0x7f05f00ad130 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f05f0066410 tx=0x7f05e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:25.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05ecc00700 1 -- 172.21.15.49:0/629413625 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e000f7e0 con 0x7f05f00bd650 2024-01-22T05:18:25.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05ecc00700 1 -- 172.21.15.49:0/629413625 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e000f940 con 0x7f05f00bd650 2024-01-22T05:18:25.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f7e00700 1 -- 172.21.15.49:0/629413625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f00ac540 con 0x7f05f00bd650 2024-01-22T05:18:25.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05ecc00700 1 -- 172.21.15.49:0/629413625 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e001b660 con 0x7f05f00bd650 2024-01-22T05:18:25.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.486+0000 7f05f7e00700 1 -- 172.21.15.49:0/629413625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f00ad620 con 0x7f05f00bd650 2024-01-22T05:18:25.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.490+0000 7f05f7e00700 1 -- 172.21.15.49:0/629413625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f0150720 con 0x7f05f00bd650 2024-01-22T05:18:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.490+0000 7f05ecc00700 1 -- 172.21.15.49:0/629413625 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f05e001ba50 con 0x7f05f00bd650 2024-01-22T05:18:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.490+0000 7f05ecc00700 1 --2- 172.21.15.49:0/629413625 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05c805a510 0x7f05c805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.490+0000 7f05ecc00700 1 -- 172.21.15.49:0/629413625 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f05e00764a0 con 0x7f05f00bd650 2024-01-22T05:18:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.490+0000 7f05f4a00700 1 --2- 172.21.15.49:0/629413625 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05c805a510 0x7f05c805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.490+0000 7f05f4a00700 1 --2- 172.21.15.49:0/629413625 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05c805a510 0x7f05c805c9d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f05d8006d80 tx=0x7f05d8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:25.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.498+0000 7f05ecc00700 1 -- 172.21.15.49:0/629413625 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f05e0049ae0 con 0x7f05f00bd650 2024-01-22T05:18:25.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.698+0000 7f05f7e00700 1 -- 172.21.15.49:0/629413625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05f0047060 con 0x7f05f00bd650 2024-01-22T05:18:25.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.698+0000 7f05ecc00700 1 -- 172.21.15.49:0/629413625 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f05e0006b30 con 0x7f05f00bd650 2024-01-22T05:18:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:25.700 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":126,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3010799828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3010799828},{"type":"v1","addr":"172.21.15.110:6833","nonce":3010799828}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":7940,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2071707351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2071707351},{"type":"v1","addr":"172.21.15.110:6835","nonce":2071707351}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":9309,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3579312059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3579312059},{"type":"v1","addr":"172.21.15.49:6835","nonce":3579312059}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":126,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:17:43.087426+0000","modified":"2024-01-22T05:17:46.108388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9312":{"gid":9312,"name":"c","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3762397937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3762397937},{"type":"v1","addr":"172.21.15.49:6837","nonce":3762397937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2024-01-22T05:18:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.702+0000 7f05f7e00700 1 -- 172.21.15.49:0/629413625 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05c805a510 msgr2=0x7f05c805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.702+0000 7f05f7e00700 1 --2- 172.21.15.49:0/629413625 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05c805a510 0x7f05c805c9d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f05d8006d80 tx=0x7f05d8008040).stop 2024-01-22T05:18:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.702+0000 7f05f7e00700 1 -- 172.21.15.49:0/629413625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05f00bd650 msgr2=0x7f05f00ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.702+0000 7f05f7e00700 1 --2- 172.21.15.49:0/629413625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05f00bd650 0x7f05f00ad130 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f05f0066410 tx=0x7f05e0017000).stop 2024-01-22T05:18:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.702+0000 7f05f7e00700 1 -- 172.21.15.49:0/629413625 shutdown_connections 2024-01-22T05:18:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.702+0000 7f05f7e00700 1 --2- 172.21.15.49:0/629413625 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05c805a510 0x7f05c805c9d0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.702+0000 7f05f7e00700 1 --2- 172.21.15.49:0/629413625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05f01508b0 0x7f05f0150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.702+0000 7f05f7e00700 1 --2- 172.21.15.49:0/629413625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f00c3cc0 0x7f05f00c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.702+0000 7f05f7e00700 1 --2- 172.21.15.49:0/629413625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05f00bd650 0x7f05f00ad130 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.702+0000 7f05f7e00700 1 -- 172.21.15.49:0/629413625 >> 172.21.15.49:0/629413625 conn(0x7f05f00c87f0 msgr2=0x7f05f0154c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.702+0000 7f05f7e00700 1 -- 172.21.15.49:0/629413625 shutdown_connections 2024-01-22T05:18:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.702+0000 7f05f7e00700 1 -- 172.21.15.49:0/629413625 wait complete. 2024-01-22T05:18:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 126 2024-01-22T05:18:25.729 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:18:25.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.886+0000 7fc402400700 1 Processor -- start 2024-01-22T05:18:25.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.886+0000 7fc402400700 1 -- start start 2024-01-22T05:18:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.886+0000 7fc402400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc3fc155d20 0x7fc3fc065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.886+0000 7fc402400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc3fc066070 0x7fc3fc0a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.886+0000 7fc402400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3fc0c1a40 con 0x7fc3fc0a8c30 2024-01-22T05:18:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.886+0000 7fc402400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3fc0a90c0 con 0x7fc3fc066070 2024-01-22T05:18:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.886+0000 7fc402400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3fc159310 con 0x7fc3fc155d20 2024-01-22T05:18:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc3faa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc3fc066070 0x7fc3fc0a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc3faa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc3fc066070 0x7fc3fc0a8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55562/0 (socket says 172.21.15.49:55562) 2024-01-22T05:18:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc3faa00700 1 -- 172.21.15.49:0/378488157 learned_addr learned my addr 172.21.15.49:0/378488157 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc3fb400700 1 --2- 172.21.15.49:0/378488157 >> v2:172.21.15.110:3300/0 conn(0x7fc3fc155d20 0x7fc3fc065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc3faa00700 1 -- 172.21.15.49:0/378488157 >> v2:172.21.15.110:3300/0 conn(0x7fc3fc155d20 msgr2=0x7fc3fc065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc3faa00700 1 --2- 172.21.15.49:0/378488157 >> v2:172.21.15.110:3300/0 conn(0x7fc3fc155d20 0x7fc3fc065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc3faa00700 1 -- 172.21.15.49:0/378488157 >> v1:172.21.15.110:6789/0 conn(0x7fc3fc0a8c30 legacy=0x7fc3fc0c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc3faa00700 1 -- 172.21.15.49:0/378488157 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc0c13f0 con 0x7fc3fc066070 2024-01-22T05:18:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc3fa000700 1 -- 172.21.15.49:0/378488157 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864117527 0 0) 0x7fc3fc0c1a40 con 0x7fc3fc0a8c30 2024-01-22T05:18:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc3faa00700 1 --2- 172.21.15.49:0/378488157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3fc066070 0x7fc3fc0a8740 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7fc3fc05ff40 tx=0x7fc3e40090f0).ready entity=mon.0 client_cookie=1a3b8a638d0747d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc3fa000700 1 -- 172.21.15.49:0/378488157 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e400b520 con 0x7fc3fc066070 2024-01-22T05:18:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc3fa000700 1 -- 172.21.15.49:0/378488157 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e400b680 con 0x7fc3fc066070 2024-01-22T05:18:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc3fa000700 1 -- 172.21.15.49:0/378488157 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e400ba00 con 0x7fc3fc066070 2024-01-22T05:18:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc402400700 1 -- 172.21.15.49:0/378488157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3fc066070 msgr2=0x7fc3fc0a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc402400700 1 --2- 172.21.15.49:0/378488157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3fc066070 0x7fc3fc0a8740 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7fc3fc05ff40 tx=0x7fc3e40090f0).stop 2024-01-22T05:18:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc402400700 1 -- 172.21.15.49:0/378488157 shutdown_connections 2024-01-22T05:18:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc402400700 1 --2- 172.21.15.49:0/378488157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3fc066070 0x7fc3fc0a8740 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc402400700 1 --2- 172.21.15.49:0/378488157 >> v2:172.21.15.110:3300/0 conn(0x7fc3fc155d20 0x7fc3fc065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.890+0000 7fc402400700 1 -- 172.21.15.49:0/378488157 >> 172.21.15.49:0/378488157 conn(0x7fc3fc0c6540 msgr2=0x7fc3fc0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.894+0000 7fc402400700 1 -- 172.21.15.49:0/378488157 shutdown_connections 2024-01-22T05:18:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.894+0000 7fc402400700 1 -- 172.21.15.49:0/378488157 wait complete. 2024-01-22T05:18:25.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.894+0000 7fc402400700 1 Processor -- start 2024-01-22T05:18:25.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.894+0000 7fc402400700 1 -- start start 2024-01-22T05:18:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc402400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3fc066070 0x7fc3fc159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc402400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3fc0a8c30 0x7fc3fc16bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc402400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3fc155d20 0x7fc3fc157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc402400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc159a40 con 0x7fc3fc155d20 2024-01-22T05:18:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc402400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc16c510 con 0x7fc3fc066070 2024-01-22T05:18:25.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc402400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc16c7f0 con 0x7fc3fc0a8c30 2024-01-22T05:18:25.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc3fbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3fc155d20 0x7fc3fc157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc3fbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3fc155d20 0x7fc3fc157330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55570/0 (socket says 172.21.15.49:55570) 2024-01-22T05:18:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc3fbe00700 1 -- 172.21.15.49:0/2755989010 learned_addr learned my addr 172.21.15.49:0/2755989010 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc3fb400700 1 --2- 172.21.15.49:0/2755989010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3fc066070 0x7fc3fc159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc3faa00700 1 --2- 172.21.15.49:0/2755989010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3fc0a8c30 0x7fc3fc16bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc3fbe00700 1 -- 172.21.15.49:0/2755989010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3fc0a8c30 msgr2=0x7fc3fc16bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc3fbe00700 1 --2- 172.21.15.49:0/2755989010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3fc0a8c30 0x7fc3fc16bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc3fbe00700 1 -- 172.21.15.49:0/2755989010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3fc066070 msgr2=0x7fc3fc159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc3fbe00700 1 --2- 172.21.15.49:0/2755989010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3fc066070 0x7fc3fc159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc3fbe00700 1 -- 172.21.15.49:0/2755989010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e4009370 con 0x7fc3fc155d20 2024-01-22T05:18:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc3fbe00700 1 --2- 172.21.15.49:0/2755989010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3fc155d20 0x7fc3fc157330 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7fc3f4002230 tx=0x7fc3f4007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:25.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc3f2a00700 1 -- 172.21.15.49:0/2755989010 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4010510 con 0x7fc3fc155d20 2024-01-22T05:18:25.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc3f2a00700 1 -- 172.21.15.49:0/2755989010 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f4010670 con 0x7fc3fc155d20 2024-01-22T05:18:25.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc402400700 1 -- 172.21.15.49:0/2755989010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3fc1596d0 con 0x7fc3fc155d20 2024-01-22T05:18:25.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.898+0000 7fc3f2a00700 1 -- 172.21.15.49:0/2755989010 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4010a10 con 0x7fc3fc155d20 2024-01-22T05:18:25.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.902+0000 7fc402400700 1 -- 172.21.15.49:0/2755989010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3fc15aed0 con 0x7fc3fc155d20 2024-01-22T05:18:25.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.902+0000 7fc402400700 1 -- 172.21.15.49:0/2755989010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3fc159bf0 con 0x7fc3fc155d20 2024-01-22T05:18:25.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.902+0000 7fc3f2a00700 1 -- 172.21.15.49:0/2755989010 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc3f401b400 con 0x7fc3fc155d20 2024-01-22T05:18:25.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.906+0000 7fc3f2a00700 1 --2- 172.21.15.49:0/2755989010 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc3d405a510 0x7fc3d405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:25.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.906+0000 7fc3f2a00700 1 -- 172.21.15.49:0/2755989010 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc3f4074760 con 0x7fc3fc155d20 2024-01-22T05:18:25.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.906+0000 7fc3fb400700 1 --2- 172.21.15.49:0/2755989010 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc3d405a510 0x7fc3d405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:25.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.906+0000 7fc3fb400700 1 --2- 172.21.15.49:0/2755989010 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc3d405a510 0x7fc3d405c9d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7fc3ec009b90 tx=0x7fc3ec009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:25.910+0000 7fc3f2a00700 1 -- 172.21.15.49:0/2755989010 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc3fc159bf0 con 0x7fc3fc155d20 2024-01-22T05:18:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.074+0000 7fc402400700 1 -- 172.21.15.49:0/2755989010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3fc159bf0 con 0x7fc3fc155d20 2024-01-22T05:18:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.078+0000 7fc3f2a00700 1 -- 172.21.15.49:0/2755989010 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+17178 (secure 0 0 0) 0x7fc3fc159bf0 con 0x7fc3fc155d20 2024-01-22T05:18:26.080 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:26.080 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":159,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:17:44.092750+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:17:41.253119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-01-22T05:17:42.073279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:18:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.082+0000 7fc402400700 1 -- 172.21.15.49:0/2755989010 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc3d405a510 msgr2=0x7fc3d405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.082+0000 7fc402400700 1 --2- 172.21.15.49:0/2755989010 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc3d405a510 0x7fc3d405c9d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7fc3ec009b90 tx=0x7fc3ec009060).stop 2024-01-22T05:18:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.082+0000 7fc402400700 1 -- 172.21.15.49:0/2755989010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3fc155d20 msgr2=0x7fc3fc157330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.082+0000 7fc402400700 1 --2- 172.21.15.49:0/2755989010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3fc155d20 0x7fc3fc157330 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7fc3f4002230 tx=0x7fc3f4007f70).stop 2024-01-22T05:18:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.082+0000 7fc402400700 1 -- 172.21.15.49:0/2755989010 shutdown_connections 2024-01-22T05:18:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.082+0000 7fc402400700 1 --2- 172.21.15.49:0/2755989010 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc3d405a510 0x7fc3d405c9d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.082+0000 7fc402400700 1 --2- 172.21.15.49:0/2755989010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3fc155d20 0x7fc3fc157330 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.082+0000 7fc402400700 1 --2- 172.21.15.49:0/2755989010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3fc0a8c30 0x7fc3fc16bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.082+0000 7fc402400700 1 --2- 172.21.15.49:0/2755989010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3fc066070 0x7fc3fc159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.082+0000 7fc402400700 1 -- 172.21.15.49:0/2755989010 >> 172.21.15.49:0/2755989010 conn(0x7fc3fc0c6540 msgr2=0x7fc3fc154170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:26.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.082+0000 7fc402400700 1 -- 172.21.15.49:0/2755989010 shutdown_connections 2024-01-22T05:18:26.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.082+0000 7fc402400700 1 -- 172.21.15.49:0/2755989010 wait complete. 2024-01-22T05:18:26.107 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:18:26.107 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:18:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.266+0000 7f58d6200700 1 Processor -- start 2024-01-22T05:18:26.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.266+0000 7f58d6200700 1 -- start start 2024-01-22T05:18:26.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.270+0000 7f58d6200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58d0068be0 0x7f58d00bdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:26.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.270+0000 7f58d6200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d00be060 0x7f58d00c3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:26.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.270+0000 7f58d6200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d0067a90 con 0x7f58d00c3610 2024-01-22T05:18:26.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.270+0000 7f58d6200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d0068330 con 0x7f58d0068be0 2024-01-22T05:18:26.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.270+0000 7f58d6200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00be4c0 con 0x7f58d00be060 2024-01-22T05:18:26.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.270+0000 7f58cf400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58d0068be0 0x7f58d00bdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:26.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.270+0000 7f58d4c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f58d00c3610 0x7f58d0064dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47118/0 (socket says 172.21.15.49:47118) 2024-01-22T05:18:26.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.270+0000 7f58d4c00700 1 -- 172.21.15.49:0/3692012753 learned_addr learned my addr 172.21.15.49:0/3692012753 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:26.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.270+0000 7f58cea00700 1 --2- 172.21.15.49:0/3692012753 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d00be060 0x7f58d00c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:26.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.270+0000 7f58ce000700 1 -- 172.21.15.49:0/3692012753 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554344352 0 0) 0x7f58d0067a90 con 0x7f58d00c3610 2024-01-22T05:18:26.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.270+0000 7f58cea00700 1 -- 172.21.15.49:0/3692012753 >> v2:172.21.15.49:3300/0 conn(0x7f58d0068be0 msgr2=0x7f58d00bdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:26.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.270+0000 7f58cea00700 1 --2- 172.21.15.49:0/3692012753 >> v2:172.21.15.49:3300/0 conn(0x7f58d0068be0 0x7f58d00bdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.270+0000 7f58cea00700 1 -- 172.21.15.49:0/3692012753 >> v1:172.21.15.49:6789/0 conn(0x7f58d00c3610 legacy=0x7f58d0064dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:26.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.270+0000 7f58cea00700 1 -- 172.21.15.49:0/3692012753 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d015c840 con 0x7f58d00be060 2024-01-22T05:18:26.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.270+0000 7f58cea00700 1 --2- 172.21.15.49:0/3692012753 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d00be060 0x7f58d00c3120 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f58b8009760 tx=0x7f58b8009060).ready entity=mon.2 client_cookie=ca7c18b788886bbb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:26.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.274+0000 7f58ce000700 1 -- 172.21.15.49:0/3692012753 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b800f510 con 0x7f58d00be060 2024-01-22T05:18:26.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.274+0000 7f58ce000700 1 -- 172.21.15.49:0/3692012753 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b800f670 con 0x7f58d00be060 2024-01-22T05:18:26.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.274+0000 7f58ce000700 1 -- 172.21.15.49:0/3692012753 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b800f9f0 con 0x7f58d00be060 2024-01-22T05:18:26.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.274+0000 7f58d6200700 1 -- 172.21.15.49:0/3692012753 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d00be060 msgr2=0x7f58d00c3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:26.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.274+0000 7f58d6200700 1 --2- 172.21.15.49:0/3692012753 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d00be060 0x7f58d00c3120 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f58b8009760 tx=0x7f58b8009060).stop 2024-01-22T05:18:26.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.274+0000 7f58d6200700 1 -- 172.21.15.49:0/3692012753 shutdown_connections 2024-01-22T05:18:26.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.274+0000 7f58d6200700 1 --2- 172.21.15.49:0/3692012753 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d00be060 0x7f58d00c3120 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.274+0000 7f58d6200700 1 --2- 172.21.15.49:0/3692012753 >> v2:172.21.15.49:3300/0 conn(0x7f58d0068be0 0x7f58d00bdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.274+0000 7f58d6200700 1 -- 172.21.15.49:0/3692012753 >> 172.21.15.49:0/3692012753 conn(0x7f58d00c8560 msgr2=0x7f58d00c8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:26.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.274+0000 7f58d6200700 1 -- 172.21.15.49:0/3692012753 shutdown_connections 2024-01-22T05:18:26.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.274+0000 7f58d6200700 1 -- 172.21.15.49:0/3692012753 wait complete. 2024-01-22T05:18:26.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.278+0000 7f58d6200700 1 Processor -- start 2024-01-22T05:18:26.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.278+0000 7f58d6200700 1 -- start start 2024-01-22T05:18:26.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.278+0000 7f58d6200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58d0068be0 0x7f58d0149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:26.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.278+0000 7f58d6200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d00be060 0x7f58d00c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:26.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.278+0000 7f58d6200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d00c3610 0x7f58d00c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:26.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.278+0000 7f58d6200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d009ff70 con 0x7f58d00c3610 2024-01-22T05:18:26.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.278+0000 7f58d6200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00c69e0 con 0x7f58d0068be0 2024-01-22T05:18:26.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.278+0000 7f58d6200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00c5290 con 0x7f58d00be060 2024-01-22T05:18:26.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.278+0000 7f58d4c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d00c3610 0x7f58d00c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:26.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.278+0000 7f58cea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d00be060 0x7f58d00c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:26.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.278+0000 7f58cf400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58d0068be0 0x7f58d0149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:26.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.278+0000 7f58cea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d00be060 0x7f58d00c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:58680/0 (socket says 172.21.15.49:58680) 2024-01-22T05:18:26.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.278+0000 7f58cea00700 1 -- 172.21.15.49:0/3150526196 learned_addr learned my addr 172.21.15.49:0/3150526196 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:26.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.282+0000 7f58cea00700 1 -- 172.21.15.49:0/3150526196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58d0068be0 msgr2=0x7f58d0149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:26.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.282+0000 7f58cea00700 1 --2- 172.21.15.49:0/3150526196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58d0068be0 0x7f58d0149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.282+0000 7f58cea00700 1 -- 172.21.15.49:0/3150526196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d00c3610 msgr2=0x7f58d00c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:26.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.282+0000 7f58cea00700 1 --2- 172.21.15.49:0/3150526196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d00c3610 0x7f58d00c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.282+0000 7f58cea00700 1 -- 172.21.15.49:0/3150526196 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b80092a0 con 0x7f58d00be060 2024-01-22T05:18:26.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.282+0000 7f58cea00700 1 --2- 172.21.15.49:0/3150526196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d00be060 0x7f58d00c5f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f58b800f610 tx=0x7f58b8017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.282+0000 7f58c6a00700 1 -- 172.21.15.49:0/3150526196 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b800fe80 con 0x7f58d00be060 2024-01-22T05:18:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.282+0000 7f58c6a00700 1 -- 172.21.15.49:0/3150526196 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b800f7e0 con 0x7f58d00be060 2024-01-22T05:18:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.282+0000 7f58d6200700 1 -- 172.21.15.49:0/3150526196 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d009f5d0 con 0x7f58d00be060 2024-01-22T05:18:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.282+0000 7f58c6a00700 1 -- 172.21.15.49:0/3150526196 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b801b640 con 0x7f58d00be060 2024-01-22T05:18:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.282+0000 7f58d6200700 1 -- 172.21.15.49:0/3150526196 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d009fb90 con 0x7f58d00be060 2024-01-22T05:18:26.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.282+0000 7f58d6200700 1 -- 172.21.15.49:0/3150526196 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d00a01e0 con 0x7f58d00be060 2024-01-22T05:18:26.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.286+0000 7f58c6a00700 1 -- 172.21.15.49:0/3150526196 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f58b801ba30 con 0x7f58d00be060 2024-01-22T05:18:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.286+0000 7f58c6a00700 1 --2- 172.21.15.49:0/3150526196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f58a805a560 0x7f58a805ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.286+0000 7f58c6a00700 1 -- 172.21.15.49:0/3150526196 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f58b8076080 con 0x7f58d00be060 2024-01-22T05:18:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.286+0000 7f58cf400700 1 --2- 172.21.15.49:0/3150526196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f58a805a560 0x7f58a805ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:26.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.286+0000 7f58cf400700 1 --2- 172.21.15.49:0/3150526196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f58a805a560 0x7f58a805ca20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f58c0009c30 tx=0x7f58c0009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:26.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.294+0000 7f58c6a00700 1 -- 172.21.15.49:0/3150526196 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f58b80a4b00 con 0x7f58d00be060 2024-01-22T05:18:26.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.498+0000 7f58d6200700 1 -- 172.21.15.49:0/3150526196 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58d0047060 con 0x7f58d00be060 2024-01-22T05:18:26.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.498+0000 7f58c6a00700 1 -- 172.21.15.49:0/3150526196 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f58b8029070 con 0x7f58d00be060 2024-01-22T05:18:26.500 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:26.500 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":126,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3010799828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3010799828},{"type":"v1","addr":"172.21.15.110:6833","nonce":3010799828}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":7940,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2071707351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2071707351},{"type":"v1","addr":"172.21.15.110:6835","nonce":2071707351}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":9309,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3579312059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3579312059},{"type":"v1","addr":"172.21.15.49:6835","nonce":3579312059}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":126,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:17:43.087426+0000","modified":"2024-01-22T05:17:46.108388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9312":{"gid":9312,"name":"c","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3762397937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3762397937},{"type":"v1","addr":"172.21.15.49:6837","nonce":3762397937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2024-01-22T05:18:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.502+0000 7f58d6200700 1 -- 172.21.15.49:0/3150526196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f58a805a560 msgr2=0x7f58a805ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.502+0000 7f58d6200700 1 --2- 172.21.15.49:0/3150526196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f58a805a560 0x7f58a805ca20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f58c0009c30 tx=0x7f58c0009060).stop 2024-01-22T05:18:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.502+0000 7f58d6200700 1 -- 172.21.15.49:0/3150526196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d00be060 msgr2=0x7f58d00c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.502+0000 7f58d6200700 1 --2- 172.21.15.49:0/3150526196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d00be060 0x7f58d00c5f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f58b800f610 tx=0x7f58b8017000).stop 2024-01-22T05:18:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.502+0000 7f58d6200700 1 -- 172.21.15.49:0/3150526196 shutdown_connections 2024-01-22T05:18:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.502+0000 7f58d6200700 1 --2- 172.21.15.49:0/3150526196 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f58a805a560 0x7f58a805ca20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.502+0000 7f58d6200700 1 --2- 172.21.15.49:0/3150526196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d00c3610 0x7f58d00c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.502+0000 7f58d6200700 1 --2- 172.21.15.49:0/3150526196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d00be060 0x7f58d00c5f20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.502+0000 7f58d6200700 1 --2- 172.21.15.49:0/3150526196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58d0068be0 0x7f58d0149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.502+0000 7f58d6200700 1 -- 172.21.15.49:0/3150526196 >> 172.21.15.49:0/3150526196 conn(0x7f58d00c8560 msgr2=0x7f58d00ad520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.502+0000 7f58d6200700 1 -- 172.21.15.49:0/3150526196 shutdown_connections 2024-01-22T05:18:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.502+0000 7f58d6200700 1 -- 172.21.15.49:0/3150526196 wait complete. 2024-01-22T05:18:26.507 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 126 2024-01-22T05:18:26.525 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:18:26.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.686+0000 7ff671600700 1 Processor -- start 2024-01-22T05:18:26.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.686+0000 7ff671600700 1 -- start start 2024-01-22T05:18:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.690+0000 7ff671600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66c0644f0 0x7ff66c064950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.690+0000 7ff671600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff66c0bcc80 0x7ff66c0bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.690+0000 7ff671600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c0c2700 con 0x7ff66c065660 2024-01-22T05:18:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.690+0000 7ff671600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c0a7650 con 0x7ff66c0bcc80 2024-01-22T05:18:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.690+0000 7ff671600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c064e40 con 0x7ff66c0644f0 2024-01-22T05:18:26.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.690+0000 7ff66aa00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff66c065660 0x7ff66c0a6f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:41344/0 (socket says 172.21.15.49:41344) 2024-01-22T05:18:26.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.690+0000 7ff66aa00700 1 -- 172.21.15.49:0/4217670062 learned_addr learned my addr 172.21.15.49:0/4217670062 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:26.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.690+0000 7ff66a000700 1 --2- 172.21.15.49:0/4217670062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66c0644f0 0x7ff66c064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:26.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.690+0000 7ff66be00700 1 --2- 172.21.15.49:0/4217670062 >> v2:172.21.15.110:3300/0 conn(0x7ff66c0bcc80 0x7ff66c0bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:26.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.690+0000 7ff66a000700 1 -- 172.21.15.49:0/4217670062 >> v2:172.21.15.110:3300/0 conn(0x7ff66c0bcc80 msgr2=0x7ff66c0bd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:26.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.690+0000 7ff66a000700 1 --2- 172.21.15.49:0/4217670062 >> v2:172.21.15.110:3300/0 conn(0x7ff66c0bcc80 0x7ff66c0bd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.690+0000 7ff66a000700 1 -- 172.21.15.49:0/4217670062 >> v1:172.21.15.110:6789/0 conn(0x7ff66c065660 legacy=0x7ff66c0a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:26.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.690+0000 7ff669600700 1 -- 172.21.15.49:0/4217670062 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917983604 0 0) 0x7ff66c0c2700 con 0x7ff66c065660 2024-01-22T05:18:26.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.690+0000 7ff66a000700 1 -- 172.21.15.49:0/4217670062 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c0c2930 con 0x7ff66c0644f0 2024-01-22T05:18:26.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.690+0000 7ff66a000700 1 --2- 172.21.15.49:0/4217670062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66c0644f0 0x7ff66c064950 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7ff654009790 tx=0x7ff654009060).ready entity=mon.2 client_cookie=8255dc019c68ae2b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:26.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.694+0000 7ff669600700 1 -- 172.21.15.49:0/4217670062 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65400f510 con 0x7ff66c0644f0 2024-01-22T05:18:26.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.694+0000 7ff669600700 1 -- 172.21.15.49:0/4217670062 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65400f670 con 0x7ff66c0644f0 2024-01-22T05:18:26.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.694+0000 7ff669600700 1 -- 172.21.15.49:0/4217670062 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65400f9f0 con 0x7ff66c0644f0 2024-01-22T05:18:26.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.694+0000 7ff671600700 1 -- 172.21.15.49:0/4217670062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66c0644f0 msgr2=0x7ff66c064950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:26.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.694+0000 7ff671600700 1 --2- 172.21.15.49:0/4217670062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66c0644f0 0x7ff66c064950 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7ff654009790 tx=0x7ff654009060).stop 2024-01-22T05:18:26.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.694+0000 7ff671600700 1 -- 172.21.15.49:0/4217670062 shutdown_connections 2024-01-22T05:18:26.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.694+0000 7ff671600700 1 --2- 172.21.15.49:0/4217670062 >> v2:172.21.15.110:3300/0 conn(0x7ff66c0bcc80 0x7ff66c0bd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.694+0000 7ff671600700 1 --2- 172.21.15.49:0/4217670062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66c0644f0 0x7ff66c064950 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.694+0000 7ff671600700 1 -- 172.21.15.49:0/4217670062 >> 172.21.15.49:0/4217670062 conn(0x7ff66c0c87f0 msgr2=0x7ff66c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:26.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.694+0000 7ff671600700 1 -- 172.21.15.49:0/4217670062 shutdown_connections 2024-01-22T05:18:26.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.694+0000 7ff671600700 1 -- 172.21.15.49:0/4217670062 wait complete. 2024-01-22T05:18:26.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.698+0000 7ff671600700 1 Processor -- start 2024-01-22T05:18:26.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.698+0000 7ff671600700 1 -- start start 2024-01-22T05:18:26.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.698+0000 7ff671600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff66c0644f0 0x7ff66c1673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:26.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.698+0000 7ff671600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff66c065660 0x7ff66c1678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:26.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.698+0000 7ff671600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66c0bcc80 0x7ff66c0a9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:26.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.698+0000 7ff671600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0bf230 con 0x7ff66c065660 2024-01-22T05:18:26.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.698+0000 7ff671600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c167d90 con 0x7ff66c0644f0 2024-01-22T05:18:26.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.698+0000 7ff671600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0aa3b0 con 0x7ff66c0bcc80 2024-01-22T05:18:26.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff66a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff66c065660 0x7ff66c1678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:26.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff66a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff66c065660 0x7ff66c1678a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55594/0 (socket says 172.21.15.49:55594) 2024-01-22T05:18:26.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff66a000700 1 -- 172.21.15.49:0/2979231700 learned_addr learned my addr 172.21.15.49:0/2979231700 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:26.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff66be00700 1 --2- 172.21.15.49:0/2979231700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66c0bcc80 0x7ff66c0a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:26.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff66aa00700 1 --2- 172.21.15.49:0/2979231700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff66c0644f0 0x7ff66c1673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:26.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff66a000700 1 -- 172.21.15.49:0/2979231700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66c0bcc80 msgr2=0x7ff66c0a9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:26.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff66a000700 1 --2- 172.21.15.49:0/2979231700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66c0bcc80 0x7ff66c0a9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff66a000700 1 -- 172.21.15.49:0/2979231700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff66c0644f0 msgr2=0x7ff66c1673b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:26.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff66a000700 1 --2- 172.21.15.49:0/2979231700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff66c0644f0 0x7ff66c1673b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff66a000700 1 -- 172.21.15.49:0/2979231700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6540092a0 con 0x7ff66c065660 2024-01-22T05:18:26.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff66a000700 1 --2- 172.21.15.49:0/2979231700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff66c065660 0x7ff66c1678a0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7ff654009e30 tx=0x7ff654017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:26.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff662000700 1 -- 172.21.15.49:0/2979231700 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65400f7e0 con 0x7ff66c065660 2024-01-22T05:18:26.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff662000700 1 -- 172.21.15.49:0/2979231700 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65400f960 con 0x7ff66c065660 2024-01-22T05:18:26.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff662000700 1 -- 172.21.15.49:0/2979231700 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65401b660 con 0x7ff66c065660 2024-01-22T05:18:26.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff671600700 1 -- 172.21.15.49:0/2979231700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c13a460 con 0x7ff66c065660 2024-01-22T05:18:26.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.702+0000 7ff671600700 1 -- 172.21.15.49:0/2979231700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c13aa20 con 0x7ff66c065660 2024-01-22T05:18:26.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.706+0000 7ff671600700 1 -- 172.21.15.49:0/2979231700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c13a2c0 con 0x7ff66c065660 2024-01-22T05:18:26.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.706+0000 7ff662000700 1 -- 172.21.15.49:0/2979231700 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff65401b9d0 con 0x7ff66c065660 2024-01-22T05:18:26.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.706+0000 7ff662000700 1 --2- 172.21.15.49:0/2979231700 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff64405a510 0x7ff64405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:26.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.706+0000 7ff662000700 1 -- 172.21.15.49:0/2979231700 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff654076070 con 0x7ff66c065660 2024-01-22T05:18:26.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.706+0000 7ff66aa00700 1 --2- 172.21.15.49:0/2979231700 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff64405a510 0x7ff64405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:26.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.710+0000 7ff66aa00700 1 --2- 172.21.15.49:0/2979231700 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff64405a510 0x7ff64405c9d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7ff65c0011e0 tx=0x7ff65c007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:26.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.714+0000 7ff662000700 1 -- 172.21.15.49:0/2979231700 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff66c13a2c0 con 0x7ff66c065660 2024-01-22T05:18:26.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.914+0000 7ff671600700 1 -- 172.21.15.49:0/2979231700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff66c13a2c0 con 0x7ff66c065660 2024-01-22T05:18:26.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.914+0000 7ff662000700 1 -- 172.21.15.49:0/2979231700 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+4505 (secure 0 0 0) 0x7ff66c13a2c0 con 0x7ff66c065660 2024-01-22T05:18:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:26.917 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":126,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3010799828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3010799828},{"type":"v1","addr":"172.21.15.110:6833","nonce":3010799828}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":7940,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2071707351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2071707351},{"type":"v1","addr":"172.21.15.110:6835","nonce":2071707351}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":9309,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3579312059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3579312059},{"type":"v1","addr":"172.21.15.49:6835","nonce":3579312059}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":126,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:17:43.087426+0000","modified":"2024-01-22T05:17:46.108388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9312":{"gid":9312,"name":"c","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3762397937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3762397937},{"type":"v1","addr":"172.21.15.49:6837","nonce":3762397937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2024-01-22T05:18:26.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.918+0000 7ff671600700 1 -- 172.21.15.49:0/2979231700 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff64405a510 msgr2=0x7ff64405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:26.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.918+0000 7ff671600700 1 --2- 172.21.15.49:0/2979231700 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff64405a510 0x7ff64405c9d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7ff65c0011e0 tx=0x7ff65c007bb0).stop 2024-01-22T05:18:26.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.918+0000 7ff671600700 1 -- 172.21.15.49:0/2979231700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff66c065660 msgr2=0x7ff66c1678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:26.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.918+0000 7ff671600700 1 --2- 172.21.15.49:0/2979231700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff66c065660 0x7ff66c1678a0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7ff654009e30 tx=0x7ff654017000).stop 2024-01-22T05:18:26.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.922+0000 7ff671600700 1 -- 172.21.15.49:0/2979231700 shutdown_connections 2024-01-22T05:18:26.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.922+0000 7ff671600700 1 --2- 172.21.15.49:0/2979231700 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff64405a510 0x7ff64405c9d0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.922+0000 7ff671600700 1 --2- 172.21.15.49:0/2979231700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66c0bcc80 0x7ff66c0a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.922+0000 7ff671600700 1 --2- 172.21.15.49:0/2979231700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff66c065660 0x7ff66c1678a0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.922+0000 7ff671600700 1 --2- 172.21.15.49:0/2979231700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff66c0644f0 0x7ff66c1673b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:26.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.922+0000 7ff671600700 1 -- 172.21.15.49:0/2979231700 >> 172.21.15.49:0/2979231700 conn(0x7ff66c0c87f0 msgr2=0x7ff66c0c4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:26.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.922+0000 7ff671600700 1 -- 172.21.15.49:0/2979231700 shutdown_connections 2024-01-22T05:18:26.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:26.922+0000 7ff671600700 1 -- 172.21.15.49:0/2979231700 wait complete. 2024-01-22T05:18:26.927 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 126 2024-01-22T05:18:26.946 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:18:27.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.106+0000 7fe365600700 1 Processor -- start 2024-01-22T05:18:27.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.106+0000 7fe365600700 1 -- start start 2024-01-22T05:18:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe365600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe3600c37d0 0x7fe3600c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe365600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe360153bd0 0x7fe360067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe365600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3600c4db0 con 0x7fe360154030 2024-01-22T05:18:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe365600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3600c5240 con 0x7fe3600c37d0 2024-01-22T05:18:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe365600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe360062230 con 0x7fe360153bd0 2024-01-22T05:18:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe35ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe3600c37d0 0x7fe3600c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe35ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe3600c37d0 0x7fe3600c3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55598/0 (socket says 172.21.15.49:55598) 2024-01-22T05:18:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe35ea00700 1 -- 172.21.15.49:0/2564894429 learned_addr learned my addr 172.21.15.49:0/2564894429 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe35e000700 1 --2- 172.21.15.49:0/2564894429 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe360153bd0 0x7fe360067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe35ea00700 1 -- 172.21.15.49:0/2564894429 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe360153bd0 msgr2=0x7fe360067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe35ea00700 1 --2- 172.21.15.49:0/2564894429 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe360153bd0 0x7fe360067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe35ea00700 1 -- 172.21.15.49:0/2564894429 >> v1:172.21.15.110:6789/0 conn(0x7fe360154030 legacy=0x7fe360154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe35ea00700 1 -- 172.21.15.49:0/2564894429 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3600c4140 con 0x7fe3600c37d0 2024-01-22T05:18:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe35e000700 1 --2- 172.21.15.49:0/2564894429 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe360153bd0 0x7fe360067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:18:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe35ea00700 1 --2- 172.21.15.49:0/2564894429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3600c37d0 0x7fe3600c3bb0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7fe350006fd0 tx=0x7fe3500090f0).ready entity=mon.0 client_cookie=9c8f46b012992ca8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe35d600700 1 -- 172.21.15.49:0/2564894429 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35000b690 con 0x7fe3600c37d0 2024-01-22T05:18:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe35d600700 1 -- 172.21.15.49:0/2564894429 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35000b7f0 con 0x7fe3600c37d0 2024-01-22T05:18:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.110+0000 7fe35d600700 1 -- 172.21.15.49:0/2564894429 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35000bb70 con 0x7fe3600c37d0 2024-01-22T05:18:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.114+0000 7fe365600700 1 -- 172.21.15.49:0/2564894429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3600c37d0 msgr2=0x7fe3600c3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.114+0000 7fe365600700 1 --2- 172.21.15.49:0/2564894429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3600c37d0 0x7fe3600c3bb0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7fe350006fd0 tx=0x7fe3500090f0).stop 2024-01-22T05:18:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.114+0000 7fe365600700 1 -- 172.21.15.49:0/2564894429 shutdown_connections 2024-01-22T05:18:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.114+0000 7fe365600700 1 --2- 172.21.15.49:0/2564894429 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe360153bd0 0x7fe360067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.114+0000 7fe365600700 1 --2- 172.21.15.49:0/2564894429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3600c37d0 0x7fe3600c3bb0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.114+0000 7fe365600700 1 -- 172.21.15.49:0/2564894429 >> 172.21.15.49:0/2564894429 conn(0x7fe360064080 msgr2=0x7fe360064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.114+0000 7fe365600700 1 -- 172.21.15.49:0/2564894429 shutdown_connections 2024-01-22T05:18:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.114+0000 7fe365600700 1 -- 172.21.15.49:0/2564894429 wait complete. 2024-01-22T05:18:27.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.118+0000 7fe365600700 1 Processor -- start 2024-01-22T05:18:27.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.118+0000 7fe365600700 1 -- start start 2024-01-22T05:18:27.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe365600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3600c37d0 0x7fe360163110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:27.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe365600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe360153bd0 0x7fe36014d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:27.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe365600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360154030 0x7fe3600623a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:27.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe365600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3600a7a60 con 0x7fe360154030 2024-01-22T05:18:27.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe365600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe360162c80 con 0x7fe360153bd0 2024-01-22T05:18:27.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe365600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3601666e0 con 0x7fe3600c37d0 2024-01-22T05:18:27.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe35fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360154030 0x7fe3600623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:27.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe35fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360154030 0x7fe3600623a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55612/0 (socket says 172.21.15.49:55612) 2024-01-22T05:18:27.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe35fe00700 1 -- 172.21.15.49:0/4100792112 learned_addr learned my addr 172.21.15.49:0/4100792112 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:27.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe35ea00700 1 --2- 172.21.15.49:0/4100792112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3600c37d0 0x7fe360163110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:27.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe35e000700 1 --2- 172.21.15.49:0/4100792112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe360153bd0 0x7fe36014d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:27.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe35fe00700 1 -- 172.21.15.49:0/4100792112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3600c37d0 msgr2=0x7fe360163110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:27.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe35fe00700 1 --2- 172.21.15.49:0/4100792112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3600c37d0 0x7fe360163110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe35fe00700 1 -- 172.21.15.49:0/4100792112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe360153bd0 msgr2=0x7fe36014d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:27.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe35fe00700 1 --2- 172.21.15.49:0/4100792112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe360153bd0 0x7fe36014d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe35fe00700 1 -- 172.21.15.49:0/4100792112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe350009370 con 0x7fe360154030 2024-01-22T05:18:27.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe35fe00700 1 --2- 172.21.15.49:0/4100792112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360154030 0x7fe3600623a0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7fe35800c7c0 tx=0x7fe3580014e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:27.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe356000700 1 -- 172.21.15.49:0/4100792112 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe358010510 con 0x7fe360154030 2024-01-22T05:18:27.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe356000700 1 -- 172.21.15.49:0/4100792112 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe358010670 con 0x7fe360154030 2024-01-22T05:18:27.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe365600700 1 -- 172.21.15.49:0/4100792112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3601669c0 con 0x7fe360154030 2024-01-22T05:18:27.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe356000700 1 -- 172.21.15.49:0/4100792112 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3580109f0 con 0x7fe360154030 2024-01-22T05:18:27.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.122+0000 7fe365600700 1 -- 172.21.15.49:0/4100792112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe360162910 con 0x7fe360154030 2024-01-22T05:18:27.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.126+0000 7fe365600700 1 -- 172.21.15.49:0/4100792112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe360162df0 con 0x7fe360154030 2024-01-22T05:18:27.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.126+0000 7fe356000700 1 -- 172.21.15.49:0/4100792112 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe358012440 con 0x7fe360154030 2024-01-22T05:18:27.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.126+0000 7fe356000700 1 --2- 172.21.15.49:0/4100792112 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe33805a540 0x7fe33805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:27.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.126+0000 7fe356000700 1 -- 172.21.15.49:0/4100792112 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe358074210 con 0x7fe360154030 2024-01-22T05:18:27.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.130+0000 7fe35ea00700 1 --2- 172.21.15.49:0/4100792112 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe33805a540 0x7fe33805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:27.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.130+0000 7fe35ea00700 1 --2- 172.21.15.49:0/4100792112 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe33805a540 0x7fe33805ca00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fe350009130 tx=0x7fe350017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.134+0000 7fe356000700 1 -- 172.21.15.49:0/4100792112 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe358047820 con 0x7fe360154030 2024-01-22T05:18:27.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.302+0000 7fe365600700 1 -- 172.21.15.49:0/4100792112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe360047060 con 0x7fe360154030 2024-01-22T05:18:27.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.306+0000 7fe356000700 1 -- 172.21.15.49:0/4100792112 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+17178 (secure 0 0 0) 0x7fe35804ae40 con 0x7fe360154030 2024-01-22T05:18:27.308 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:27.308 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":159,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:17:44.092750+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:17:41.253119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-01-22T05:17:42.073279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:18:27.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.310+0000 7fe365600700 1 -- 172.21.15.49:0/4100792112 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe33805a540 msgr2=0x7fe33805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:27.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.310+0000 7fe365600700 1 --2- 172.21.15.49:0/4100792112 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe33805a540 0x7fe33805ca00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fe350009130 tx=0x7fe350017000).stop 2024-01-22T05:18:27.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.310+0000 7fe365600700 1 -- 172.21.15.49:0/4100792112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360154030 msgr2=0x7fe3600623a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:27.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.310+0000 7fe365600700 1 --2- 172.21.15.49:0/4100792112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360154030 0x7fe3600623a0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7fe35800c7c0 tx=0x7fe3580014e0).stop 2024-01-22T05:18:27.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.310+0000 7fe365600700 1 -- 172.21.15.49:0/4100792112 shutdown_connections 2024-01-22T05:18:27.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.310+0000 7fe365600700 1 --2- 172.21.15.49:0/4100792112 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe33805a540 0x7fe33805ca00 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.310+0000 7fe365600700 1 --2- 172.21.15.49:0/4100792112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360154030 0x7fe3600623a0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.310+0000 7fe365600700 1 --2- 172.21.15.49:0/4100792112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe360153bd0 0x7fe36014d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.310+0000 7fe365600700 1 --2- 172.21.15.49:0/4100792112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3600c37d0 0x7fe360163110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.310+0000 7fe365600700 1 -- 172.21.15.49:0/4100792112 >> 172.21.15.49:0/4100792112 conn(0x7fe360064080 msgr2=0x7fe3600c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:27.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.310+0000 7fe365600700 1 -- 172.21.15.49:0/4100792112 shutdown_connections 2024-01-22T05:18:27.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.310+0000 7fe365600700 1 -- 172.21.15.49:0/4100792112 wait complete. 2024-01-22T05:18:27.334 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:18:27.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.494+0000 7f7ccc600700 1 Processor -- start 2024-01-22T05:18:27.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7ccc600700 1 -- start start 2024-01-22T05:18:27.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7ccc600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7cc40c3690 0x7f7cc40c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:27.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7ccc600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cc4155550 0x7f7cc41559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:27.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7ccc600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7cc4067a90 0x7f7cc4067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:27.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7ccc600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc40c3f60 con 0x7f7cc4067a90 2024-01-22T05:18:27.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7ccc600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc40bdc10 con 0x7f7cc40c3690 2024-01-22T05:18:27.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7ccc600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4155ea0 con 0x7f7cc4155550 2024-01-22T05:18:27.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7cca600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7cc4067a90 0x7f7cc4067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:27.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7cca600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7cc4067a90 0x7f7cc4067ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55614/0 (socket says 172.21.15.49:55614) 2024-01-22T05:18:27.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7cca600700 1 -- 172.21.15.49:0/251409827 learned_addr learned my addr 172.21.15.49:0/251409827 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:27.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7cc9200700 1 --2- 172.21.15.49:0/251409827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cc4155550 0x7f7cc41559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:27.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7cc9c00700 1 --2- 172.21.15.49:0/251409827 >> v2:172.21.15.110:3300/0 conn(0x7f7cc40c3690 0x7f7cc40c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:27.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7cca600700 1 -- 172.21.15.49:0/251409827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cc4155550 msgr2=0x7f7cc41559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:27.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7cca600700 1 --2- 172.21.15.49:0/251409827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cc4155550 0x7f7cc41559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7cca600700 1 -- 172.21.15.49:0/251409827 >> v2:172.21.15.110:3300/0 conn(0x7f7cc40c3690 msgr2=0x7f7cc40c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:27.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7cca600700 1 --2- 172.21.15.49:0/251409827 >> v2:172.21.15.110:3300/0 conn(0x7f7cc40c3690 0x7f7cc40c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7cca600700 1 -- 172.21.15.49:0/251409827 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc4068e10 con 0x7f7cc4067a90 2024-01-22T05:18:27.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7cca600700 1 --2- 172.21.15.49:0/251409827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cc4067a90 0x7f7cc4067ef0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7f7cc40c5e00 tx=0x7f7cbc009840).ready entity=mon.0 client_cookie=bd68703e31a33d0b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:27.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7cc3e00700 1 -- 172.21.15.49:0/251409827 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc00e070 con 0x7f7cc4067a90 2024-01-22T05:18:27.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7cc3e00700 1 -- 172.21.15.49:0/251409827 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc00b970 con 0x7f7cc4067a90 2024-01-22T05:18:27.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.498+0000 7f7cc3e00700 1 -- 172.21.15.49:0/251409827 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc00bcf0 con 0x7f7cc4067a90 2024-01-22T05:18:27.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.502+0000 7f7ccc600700 1 -- 172.21.15.49:0/251409827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cc4067a90 msgr2=0x7f7cc4067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:27.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.502+0000 7f7ccc600700 1 --2- 172.21.15.49:0/251409827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cc4067a90 0x7f7cc4067ef0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7f7cc40c5e00 tx=0x7f7cbc009840).stop 2024-01-22T05:18:27.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.502+0000 7f7ccc600700 1 -- 172.21.15.49:0/251409827 shutdown_connections 2024-01-22T05:18:27.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.502+0000 7f7ccc600700 1 --2- 172.21.15.49:0/251409827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cc4067a90 0x7f7cc4067ef0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.502+0000 7f7ccc600700 1 --2- 172.21.15.49:0/251409827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cc4155550 0x7f7cc41559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.502+0000 7f7ccc600700 1 --2- 172.21.15.49:0/251409827 >> v2:172.21.15.110:3300/0 conn(0x7f7cc40c3690 0x7f7cc40c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.502+0000 7f7ccc600700 1 -- 172.21.15.49:0/251409827 >> 172.21.15.49:0/251409827 conn(0x7f7cc40c51c0 msgr2=0x7f7cc40c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:27.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.502+0000 7f7ccc600700 1 -- 172.21.15.49:0/251409827 shutdown_connections 2024-01-22T05:18:27.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.502+0000 7f7ccc600700 1 -- 172.21.15.49:0/251409827 wait complete. 2024-01-22T05:18:27.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.506+0000 7f7ccc600700 1 Processor -- start 2024-01-22T05:18:27.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.506+0000 7f7ccc600700 1 -- start start 2024-01-22T05:18:27.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.506+0000 7f7ccc600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cc4067a90 0x7f7cc4146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:27.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.506+0000 7f7ccc600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cc40c3690 0x7f7cc40ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:27.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.506+0000 7f7ccc600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cc4155550 0x7f7cc40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:27.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.506+0000 7f7ccc600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4149db0 con 0x7f7cc40c3690 2024-01-22T05:18:27.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.506+0000 7f7ccc600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4062cb0 con 0x7f7cc4155550 2024-01-22T05:18:27.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.506+0000 7f7ccc600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc40ac2c0 con 0x7f7cc4067a90 2024-01-22T05:18:27.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.506+0000 7f7cc9200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cc40c3690 0x7f7cc40ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:27.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.506+0000 7f7cc9200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cc40c3690 0x7f7cc40ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55618/0 (socket says 172.21.15.49:55618) 2024-01-22T05:18:27.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.506+0000 7f7cc9200700 1 -- 172.21.15.49:0/1192510459 learned_addr learned my addr 172.21.15.49:0/1192510459 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:27.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.506+0000 7f7cca600700 1 --2- 172.21.15.49:0/1192510459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cc4155550 0x7f7cc40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:27.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.506+0000 7f7cc9c00700 1 --2- 172.21.15.49:0/1192510459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cc4067a90 0x7f7cc4146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:27.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.510+0000 7f7cc9200700 1 -- 172.21.15.49:0/1192510459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cc4067a90 msgr2=0x7f7cc4146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:27.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.510+0000 7f7cc9200700 1 --2- 172.21.15.49:0/1192510459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cc4067a90 0x7f7cc4146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.510+0000 7f7cc9200700 1 -- 172.21.15.49:0/1192510459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cc4155550 msgr2=0x7f7cc40abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:27.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.510+0000 7f7cc9200700 1 --2- 172.21.15.49:0/1192510459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cc4155550 0x7f7cc40abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:27.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.510+0000 7f7cc9200700 1 -- 172.21.15.49:0/1192510459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cbc009ae0 con 0x7f7cc40c3690 2024-01-22T05:18:27.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.510+0000 7f7cc9200700 1 --2- 172.21.15.49:0/1192510459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cc40c3690 0x7f7cc40ab8e0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f7cac00e930 tx=0x7f7cac009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:27.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.510+0000 7f7cc0c00700 1 -- 172.21.15.49:0/1192510459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac012600 con 0x7f7cc40c3690 2024-01-22T05:18:27.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.510+0000 7f7cc0c00700 1 -- 172.21.15.49:0/1192510459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac012760 con 0x7f7cc40c3690 2024-01-22T05:18:27.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.510+0000 7f7ccc600700 1 -- 172.21.15.49:0/1192510459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc4146df0 con 0x7f7cc40c3690 2024-01-22T05:18:27.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.510+0000 7f7cc0c00700 1 -- 172.21.15.49:0/1192510459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac012ae0 con 0x7f7cc40c3690 2024-01-22T05:18:27.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.510+0000 7f7ccc600700 1 -- 172.21.15.49:0/1192510459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc4062380 con 0x7f7cc40c3690 2024-01-22T05:18:27.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.510+0000 7f7ccc600700 1 -- 172.21.15.49:0/1192510459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc4047060 con 0x7f7cc40c3690 2024-01-22T05:18:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.510+0000 7f7cc0c00700 1 -- 172.21.15.49:0/1192510459 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7cac01b400 con 0x7f7cc40c3690 2024-01-22T05:18:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.514+0000 7f7cc0c00700 1 --2- 172.21.15.49:0/1192510459 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c9c05a510 0x7f7c9c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.514+0000 7f7cc0c00700 1 -- 172.21.15.49:0/1192510459 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f7cac074c10 con 0x7f7cc40c3690 2024-01-22T05:18:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.514+0000 7f7cc9c00700 1 --2- 172.21.15.49:0/1192510459 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c9c05a510 0x7f7c9c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.514+0000 7f7cc9c00700 1 --2- 172.21.15.49:0/1192510459 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c9c05a510 0x7f7c9c05c9d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f7cb4009c30 tx=0x7f7cb4009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:27.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.518+0000 7f7cc0c00700 1 -- 172.21.15.49:0/1192510459 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7cac0481c0 con 0x7f7cc40c3690 2024-01-22T05:18:27.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:27.714+0000 7f7ccc600700 1 -- 172.21.15.49:0/1192510459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7cc40690f0 con 0x7f7cc40c3690 2024-01-22T05:18:28.480 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:18:28.477+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:18:28.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.489+0000 7f7cc0c00700 1 -- 172.21.15.49:0/1192510459 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v127) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7cac04b7e0 con 0x7f7cc40c3690 2024-01-22T05:18:28.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.497+0000 7f7ccc600700 1 -- 172.21.15.49:0/1192510459 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c9c05a510 msgr2=0x7f7c9c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:28.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.497+0000 7f7ccc600700 1 --2- 172.21.15.49:0/1192510459 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c9c05a510 0x7f7c9c05c9d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f7cb4009c30 tx=0x7f7cb4009060).stop 2024-01-22T05:18:28.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.497+0000 7f7ccc600700 1 -- 172.21.15.49:0/1192510459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cc40c3690 msgr2=0x7f7cc40ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:28.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.497+0000 7f7ccc600700 1 --2- 172.21.15.49:0/1192510459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cc40c3690 0x7f7cc40ab8e0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f7cac00e930 tx=0x7f7cac009060).stop 2024-01-22T05:18:28.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.497+0000 7f7ccc600700 1 -- 172.21.15.49:0/1192510459 shutdown_connections 2024-01-22T05:18:28.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.497+0000 7f7ccc600700 1 --2- 172.21.15.49:0/1192510459 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7c9c05a510 0x7f7c9c05c9d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:28.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.497+0000 7f7ccc600700 1 --2- 172.21.15.49:0/1192510459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cc4155550 0x7f7cc40abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:28.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.497+0000 7f7ccc600700 1 --2- 172.21.15.49:0/1192510459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cc40c3690 0x7f7cc40ab8e0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:28.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.497+0000 7f7ccc600700 1 --2- 172.21.15.49:0/1192510459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cc4067a90 0x7f7cc4146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:28.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.497+0000 7f7ccc600700 1 -- 172.21.15.49:0/1192510459 >> 172.21.15.49:0/1192510459 conn(0x7f7cc40c51c0 msgr2=0x7f7cc40be0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:28.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.497+0000 7f7ccc600700 1 -- 172.21.15.49:0/1192510459 shutdown_connections 2024-01-22T05:18:28.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.497+0000 7f7ccc600700 1 -- 172.21.15.49:0/1192510459 wait complete. 2024-01-22T05:18:28.505 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:18:28.507 INFO:tasks.ceph.mds.c.smithi049.stderr: -1971> 2024-01-22T05:17:48.590+0000 7f2d12c00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:18:28.526 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:18:28.560 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:18:28.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.697+0000 7f3043000700 1 Processor -- start 2024-01-22T05:18:28.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.697+0000 7f3043000700 1 -- start start 2024-01-22T05:18:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f3043000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f303c0a8b80 0x7f303c066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f3043000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c065bd0 con 0x7f303c0a8740 2024-01-22T05:18:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f3043000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c0c15f0 con 0x7f303c1581e0 2024-01-22T05:18:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f3043000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303c0c18c0 con 0x7f303c0a8b80 2024-01-22T05:18:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f3042600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f303c0a8b80 0x7f303c066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f3041200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f303c0a8740 0x7f303c066080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47134/0 (socket says 172.21.15.49:47134) 2024-01-22T05:18:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f3041c00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f303c1581e0 0x7f303c0c0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:41374/0 (socket says 172.21.15.49:41374) 2024-01-22T05:18:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f3041200700 1 -- 172.21.15.49:0/2968851325 learned_addr learned my addr 172.21.15.49:0/2968851325 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f303be00700 1 -- 172.21.15.49:0/2968851325 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308680108 0 0) 0x7f303c0c15f0 con 0x7f303c1581e0 2024-01-22T05:18:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f303be00700 1 -- 172.21.15.49:0/2968851325 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f301c0033f0 con 0x7f303c1581e0 2024-01-22T05:18:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f3042600700 1 -- 172.21.15.49:0/2968851325 >> v1:172.21.15.110:6789/0 conn(0x7f303c1581e0 legacy=0x7f303c0c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f3042600700 1 -- 172.21.15.49:0/2968851325 >> v1:172.21.15.49:6789/0 conn(0x7f303c0a8740 legacy=0x7f303c066080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f303be00700 1 -- 172.21.15.49:0/2968851325 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544778530 0 0) 0x7f303c065bd0 con 0x7f303c0a8740 2024-01-22T05:18:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f3042600700 1 -- 172.21.15.49:0/2968851325 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0c1ba0 con 0x7f303c0a8b80 2024-01-22T05:18:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f3042600700 1 --2- 172.21.15.49:0/2968851325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f303c0a8b80 0x7f303c066790 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7f3034009e60 tx=0x7f3034009780).ready entity=mon.0 client_cookie=34a32ee3382ab18e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f303be00700 1 -- 172.21.15.49:0/2968851325 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303400e070 con 0x7f303c0a8b80 2024-01-22T05:18:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f303be00700 1 -- 172.21.15.49:0/2968851325 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303400bb60 con 0x7f303c0a8b80 2024-01-22T05:18:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.701+0000 7f303be00700 1 -- 172.21.15.49:0/2968851325 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303400bee0 con 0x7f303c0a8b80 2024-01-22T05:18:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.705+0000 7f3043000700 1 -- 172.21.15.49:0/2968851325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f303c0a8b80 msgr2=0x7f303c066790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.705+0000 7f3043000700 1 --2- 172.21.15.49:0/2968851325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f303c0a8b80 0x7f303c066790 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7f3034009e60 tx=0x7f3034009780).stop 2024-01-22T05:18:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.705+0000 7f3043000700 1 -- 172.21.15.49:0/2968851325 shutdown_connections 2024-01-22T05:18:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.705+0000 7f3043000700 1 --2- 172.21.15.49:0/2968851325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f303c0a8b80 0x7f303c066790 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.705+0000 7f3043000700 1 -- 172.21.15.49:0/2968851325 >> 172.21.15.49:0/2968851325 conn(0x7f303c0c6540 msgr2=0x7f303c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.705+0000 7f3043000700 1 -- 172.21.15.49:0/2968851325 shutdown_connections 2024-01-22T05:18:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.705+0000 7f3043000700 1 -- 172.21.15.49:0/2968851325 wait complete. 2024-01-22T05:18:28.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.709+0000 7f3043000700 1 Processor -- start 2024-01-22T05:18:28.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.709+0000 7f3043000700 1 -- start start 2024-01-22T05:18:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.709+0000 7f3043000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f303c0a8740 0x7f303c09f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.709+0000 7f3043000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f303c0a8b80 0x7f303c16b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.709+0000 7f3043000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f303c1581e0 0x7f303c16bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.709+0000 7f3043000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c16c2a0 con 0x7f303c0a8740 2024-01-22T05:18:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.709+0000 7f3043000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c1695f0 con 0x7f303c1581e0 2024-01-22T05:18:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.709+0000 7f3043000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c09fa00 con 0x7f303c0a8b80 2024-01-22T05:18:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.709+0000 7f3041c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f303c0a8740 0x7f303c09f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.709+0000 7f3041c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f303c0a8740 0x7f303c09f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55656/0 (socket says 172.21.15.49:55656) 2024-01-22T05:18:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.709+0000 7f3041c00700 1 -- 172.21.15.49:0/3145130809 learned_addr learned my addr 172.21.15.49:0/3145130809 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.709+0000 7f3041200700 1 --2- 172.21.15.49:0/3145130809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f303c0a8b80 0x7f303c16b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.709+0000 7f3042600700 1 --2- 172.21.15.49:0/3145130809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f303c1581e0 0x7f303c16bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.713+0000 7f3041c00700 1 -- 172.21.15.49:0/3145130809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f303c0a8b80 msgr2=0x7f303c16b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.713+0000 7f3041c00700 1 --2- 172.21.15.49:0/3145130809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f303c0a8b80 0x7f303c16b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.713+0000 7f3041c00700 1 -- 172.21.15.49:0/3145130809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f303c1581e0 msgr2=0x7f303c16bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.713+0000 7f3041c00700 1 --2- 172.21.15.49:0/3145130809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f303c1581e0 0x7f303c16bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.713+0000 7f3041c00700 1 -- 172.21.15.49:0/3145130809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3034009a20 con 0x7f303c0a8740 2024-01-22T05:18:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.713+0000 7f3041c00700 1 --2- 172.21.15.49:0/3145130809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f303c0a8740 0x7f303c09f510 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f302c00c450 tx=0x7f302c007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.713+0000 7f3038c00700 1 -- 172.21.15.49:0/3145130809 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0070d0 con 0x7f303c0a8740 2024-01-22T05:18:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.713+0000 7f3038c00700 1 -- 172.21.15.49:0/3145130809 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c007230 con 0x7f303c0a8740 2024-01-22T05:18:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.713+0000 7f3043000700 1 -- 172.21.15.49:0/3145130809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c0bf650 con 0x7f303c0a8740 2024-01-22T05:18:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.713+0000 7f3038c00700 1 -- 172.21.15.49:0/3145130809 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0056e0 con 0x7f303c0a8740 2024-01-22T05:18:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.713+0000 7f3043000700 1 -- 172.21.15.49:0/3145130809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303c0bfef0 con 0x7f303c0a8740 2024-01-22T05:18:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.713+0000 7f3043000700 1 -- 172.21.15.49:0/3145130809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303c047060 con 0x7f303c0a8740 2024-01-22T05:18:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.713+0000 7f3038c00700 1 -- 172.21.15.49:0/3145130809 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f302c005a50 con 0x7f303c0a8740 2024-01-22T05:18:28.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.717+0000 7f3038c00700 1 --2- 172.21.15.49:0/3145130809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f301405a510 0x7f301405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:28.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.717+0000 7f3038c00700 1 -- 172.21.15.49:0/3145130809 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6676+0+0 (secure 0 0 0) 0x7f302c073eb0 con 0x7f303c0a8740 2024-01-22T05:18:28.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.717+0000 7f3041200700 1 --2- 172.21.15.49:0/3145130809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f301405a510 0x7f301405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:28.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.717+0000 7f3041200700 1 --2- 172.21.15.49:0/3145130809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f301405a510 0x7f301405c9d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f303c165f10 tx=0x7f3024007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:28.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.721+0000 7f3038c00700 1 -- 172.21.15.49:0/3145130809 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f302c047460 con 0x7f303c0a8740 2024-01-22T05:18:28.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:28.925+0000 7f3043000700 1 -- 172.21.15.49:0/3145130809 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f303c046800 con 0x7f303c0a8740 2024-01-22T05:18:29.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.493+0000 7f3038c00700 1 -- 172.21.15.49:0/3145130809 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v128) v1 ==== 104+0+0 (secure 0 0 0) 0x7f302c007d80 con 0x7f303c0a8740 2024-01-22T05:18:29.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.497+0000 7f3043000700 1 -- 172.21.15.49:0/3145130809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f301405a510 msgr2=0x7f301405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:29.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.497+0000 7f3043000700 1 --2- 172.21.15.49:0/3145130809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f301405a510 0x7f301405c9d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f303c165f10 tx=0x7f3024007bb0).stop 2024-01-22T05:18:29.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.497+0000 7f3043000700 1 -- 172.21.15.49:0/3145130809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f303c0a8740 msgr2=0x7f303c09f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:29.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.497+0000 7f3043000700 1 --2- 172.21.15.49:0/3145130809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f303c0a8740 0x7f303c09f510 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f302c00c450 tx=0x7f302c007c40).stop 2024-01-22T05:18:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.501+0000 7f3043000700 1 -- 172.21.15.49:0/3145130809 shutdown_connections 2024-01-22T05:18:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.501+0000 7f3043000700 1 --2- 172.21.15.49:0/3145130809 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f301405a510 0x7f301405c9d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.501+0000 7f3043000700 1 --2- 172.21.15.49:0/3145130809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f303c1581e0 0x7f303c16bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.501+0000 7f3043000700 1 --2- 172.21.15.49:0/3145130809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f303c0a8b80 0x7f303c16b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.501+0000 7f3043000700 1 --2- 172.21.15.49:0/3145130809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f303c0a8740 0x7f303c09f510 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.501+0000 7f3043000700 1 -- 172.21.15.49:0/3145130809 >> 172.21.15.49:0/3145130809 conn(0x7f303c0c6540 msgr2=0x7f303c0ab5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.501+0000 7f3043000700 1 -- 172.21.15.49:0/3145130809 shutdown_connections 2024-01-22T05:18:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.501+0000 7f3043000700 1 -- 172.21.15.49:0/3145130809 wait complete. 2024-01-22T05:18:29.529 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:18:29.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.733+0000 7fdb97200700 1 Processor -- start 2024-01-22T05:18:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.733+0000 7fdb97200700 1 -- start start 2024-01-22T05:18:29.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb97200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb98068600 0x7fdb98162f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:29.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb97200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb98066560 con 0x7fdb98067a90 2024-01-22T05:18:29.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb97200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb98065950 con 0x7fdb98068cb0 2024-01-22T05:18:29.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb97200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980bc930 con 0x7fdb98068600 2024-01-22T05:18:29.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb95400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdb98067a90 0x7fdb98067ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47144/0 (socket says 172.21.15.49:47144) 2024-01-22T05:18:29.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb95400700 1 -- 172.21.15.49:0/751341550 learned_addr learned my addr 172.21.15.49:0/751341550 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:29.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb96800700 1 --2- 172.21.15.49:0/751341550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb98068600 0x7fdb98162f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:29.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989045505 0 0) 0x7fdb98066560 con 0x7fdb98067a90 2024-01-22T05:18:29.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb780033f0 con 0x7fdb98067a90 2024-01-22T05:18:29.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041811753 0 0) 0x7fdb98065950 con 0x7fdb98068cb0 2024-01-22T05:18:29.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb98066560 con 0x7fdb98068cb0 2024-01-22T05:18:29.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3616991835 0 0) 0x7fdb780033f0 con 0x7fdb98067a90 2024-01-22T05:18:29.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb98068600 msgr2=0x7fdb98162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:29.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 --2- 172.21.15.49:0/751341550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb98068600 0x7fdb98162f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:29.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 >> v1:172.21.15.110:6789/0 conn(0x7fdb98068cb0 legacy=0x7fdb9815b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:29.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb98065c30 con 0x7fdb98067a90 2024-01-22T05:18:29.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fdb80001470 con 0x7fdb98067a90 2024-01-22T05:18:29.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 >> v1:172.21.15.49:6789/0 conn(0x7fdb98067a90 legacy=0x7fdb98067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:29.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 --2- 172.21.15.49:0/751341550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb78003aa0 0x7fdb78003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:29.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 --2- 172.21.15.49:0/751341550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb98068600 0x7fdb78004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:29.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 --2- 172.21.15.49:0/751341550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb78004b80 0x7fdb78005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:29.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980bc930 con 0x7fdb78003aa0 2024-01-22T05:18:29.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7800b940 con 0x7fdb78004b80 2024-01-22T05:18:29.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7800bb00 con 0x7fdb98068600 2024-01-22T05:18:29.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.737+0000 7fdb95e00700 1 --2- 172.21.15.49:0/751341550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb78003aa0 0x7fdb78003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:29.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb95400700 1 --2- 172.21.15.49:0/751341550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb98068600 0x7fdb78004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:29.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb96800700 1 --2- 172.21.15.49:0/751341550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb78004b80 0x7fdb78005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:29.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb95e00700 1 -- 172.21.15.49:0/751341550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb98068600 msgr2=0x7fdb78004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:29.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb95e00700 1 --2- 172.21.15.49:0/751341550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb98068600 0x7fdb78004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:29.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb95e00700 1 -- 172.21.15.49:0/751341550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb78004b80 msgr2=0x7fdb78005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:29.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb95e00700 1 --2- 172.21.15.49:0/751341550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb78004b80 0x7fdb78005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:29.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb95e00700 1 -- 172.21.15.49:0/751341550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb780033f0 con 0x7fdb78003aa0 2024-01-22T05:18:29.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb95e00700 1 --2- 172.21.15.49:0/751341550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb78003aa0 0x7fdb78003ea0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7fdb88001890 tx=0x7fdb88007bb0).ready entity=mon.0 client_cookie=170dead2492ff1a6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:29.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb88007020 con 0x7fdb78003aa0 2024-01-22T05:18:29.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb88007180 con 0x7fdb78003aa0 2024-01-22T05:18:29.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb94a00700 1 -- 172.21.15.49:0/751341550 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb88007500 con 0x7fdb78003aa0 2024-01-22T05:18:29.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb97200700 1 -- 172.21.15.49:0/751341550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb78003aa0 msgr2=0x7fdb78003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:29.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb97200700 1 --2- 172.21.15.49:0/751341550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb78003aa0 0x7fdb78003ea0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7fdb88001890 tx=0x7fdb88007bb0).stop 2024-01-22T05:18:29.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb96800700 1 -- 172.21.15.49:0/751341550 reap_dead start 2024-01-22T05:18:29.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb97200700 1 -- 172.21.15.49:0/751341550 shutdown_connections 2024-01-22T05:18:29.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb97200700 1 -- 172.21.15.49:0/751341550 >> 172.21.15.49:0/751341550 conn(0x7fdb980c6f70 msgr2=0x7fdb980c2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:29.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb97200700 1 -- 172.21.15.49:0/751341550 shutdown_connections 2024-01-22T05:18:29.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.741+0000 7fdb97200700 1 -- 172.21.15.49:0/751341550 wait complete. 2024-01-22T05:18:29.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.745+0000 7fdb97200700 1 Processor -- start 2024-01-22T05:18:29.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.745+0000 7fdb97200700 1 -- start start 2024-01-22T05:18:29.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb97200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb78003aa0 0x7fdb98154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:29.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb97200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb9815e1e0 0x7fdb9815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:29.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb97200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb9815ca00 0x7fdb980be700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:29.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb97200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980bd6a0 con 0x7fdb9815ca00 2024-01-22T05:18:29.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb97200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980bd940 con 0x7fdb9815e1e0 2024-01-22T05:18:29.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb97200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980bdc20 con 0x7fdb78003aa0 2024-01-22T05:18:29.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb96800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb9815ca00 0x7fdb980be700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:29.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb96800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb9815ca00 0x7fdb980be700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55672/0 (socket says 172.21.15.49:55672) 2024-01-22T05:18:29.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb95e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb78003aa0 0x7fdb98154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:29.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb96800700 1 -- 172.21.15.49:0/2503574598 learned_addr learned my addr 172.21.15.49:0/2503574598 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:29.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb95400700 1 --2- 172.21.15.49:0/2503574598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb9815e1e0 0x7fdb9815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:29.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb95e00700 1 -- 172.21.15.49:0/2503574598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb9815e1e0 msgr2=0x7fdb9815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:29.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb95e00700 1 --2- 172.21.15.49:0/2503574598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb9815e1e0 0x7fdb9815c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:29.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb95e00700 1 -- 172.21.15.49:0/2503574598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb9815ca00 msgr2=0x7fdb980be700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:29.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb95e00700 1 --2- 172.21.15.49:0/2503574598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb9815ca00 0x7fdb980be700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:29.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb95e00700 1 -- 172.21.15.49:0/2503574598 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb980bdf00 con 0x7fdb78003aa0 2024-01-22T05:18:29.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb95e00700 1 --2- 172.21.15.49:0/2503574598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb78003aa0 0x7fdb98154930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fdb88013000 tx=0x7fdb88016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:29.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb8d600700 1 -- 172.21.15.49:0/2503574598 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb88006fb0 con 0x7fdb78003aa0 2024-01-22T05:18:29.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb8d600700 1 -- 172.21.15.49:0/2503574598 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8801e480 con 0x7fdb78003aa0 2024-01-22T05:18:29.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb97200700 1 -- 172.21.15.49:0/2503574598 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb980be1e0 con 0x7fdb78003aa0 2024-01-22T05:18:29.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb8d600700 1 -- 172.21.15.49:0/2503574598 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8801e840 con 0x7fdb78003aa0 2024-01-22T05:18:29.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.749+0000 7fdb97200700 1 -- 172.21.15.49:0/2503574598 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb980bebf0 con 0x7fdb78003aa0 2024-01-22T05:18:29.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.753+0000 7fdb97200700 1 -- 172.21.15.49:0/2503574598 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9805fd40 con 0x7fdb78003aa0 2024-01-22T05:18:29.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.753+0000 7fdb8d600700 1 -- 172.21.15.49:0/2503574598 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdb88012400 con 0x7fdb78003aa0 2024-01-22T05:18:29.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.757+0000 7fdb8d600700 1 --2- 172.21.15.49:0/2503574598 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb7005a510 0x7fdb7005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:29.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.757+0000 7fdb8d600700 1 -- 172.21.15.49:0/2503574598 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6676+0+0 (secure 0 0 0) 0x7fdb88075870 con 0x7fdb78003aa0 2024-01-22T05:18:29.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.757+0000 7fdb95400700 1 --2- 172.21.15.49:0/2503574598 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb7005a510 0x7fdb7005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:29.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.757+0000 7fdb95400700 1 --2- 172.21.15.49:0/2503574598 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb7005a510 0x7fdb7005c9d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fdb9815cf60 tx=0x7fdb80007040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:29.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.761+0000 7fdb8d600700 1 -- 172.21.15.49:0/2503574598 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdb88048d00 con 0x7fdb78003aa0 2024-01-22T05:18:29.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:29.929+0000 7fdb97200700 1 -- 172.21.15.49:0/2503574598 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdb98046800 con 0x7fdb78003aa0 2024-01-22T05:18:30.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.509+0000 7fdb8d600700 1 -- 172.21.15.49:0/2503574598 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v162) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdb88023070 con 0x7fdb78003aa0 2024-01-22T05:18:30.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.513+0000 7fdb97200700 1 -- 172.21.15.49:0/2503574598 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb7005a510 msgr2=0x7fdb7005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:30.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.513+0000 7fdb97200700 1 --2- 172.21.15.49:0/2503574598 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb7005a510 0x7fdb7005c9d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fdb9815cf60 tx=0x7fdb80007040).stop 2024-01-22T05:18:30.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.513+0000 7fdb97200700 1 -- 172.21.15.49:0/2503574598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb78003aa0 msgr2=0x7fdb98154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:30.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.513+0000 7fdb97200700 1 --2- 172.21.15.49:0/2503574598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb78003aa0 0x7fdb98154930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fdb88013000 tx=0x7fdb88016000).stop 2024-01-22T05:18:30.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.513+0000 7fdb97200700 1 -- 172.21.15.49:0/2503574598 shutdown_connections 2024-01-22T05:18:30.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.513+0000 7fdb97200700 1 --2- 172.21.15.49:0/2503574598 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb7005a510 0x7fdb7005c9d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:30.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.513+0000 7fdb97200700 1 --2- 172.21.15.49:0/2503574598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb9815ca00 0x7fdb980be700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:30.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.513+0000 7fdb97200700 1 --2- 172.21.15.49:0/2503574598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb9815e1e0 0x7fdb9815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:30.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.513+0000 7fdb97200700 1 --2- 172.21.15.49:0/2503574598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb78003aa0 0x7fdb98154930 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:30.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.513+0000 7fdb97200700 1 -- 172.21.15.49:0/2503574598 >> 172.21.15.49:0/2503574598 conn(0x7fdb980c6f70 msgr2=0x7fdb980ac170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:30.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.513+0000 7fdb97200700 1 -- 172.21.15.49:0/2503574598 shutdown_connections 2024-01-22T05:18:30.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.513+0000 7fdb97200700 1 -- 172.21.15.49:0/2503574598 wait complete. 2024-01-22T05:18:30.519 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:18:30.539 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:18:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.701+0000 7fbe7f200700 1 Processor -- start 2024-01-22T05:18:30.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.701+0000 7fbe7f200700 1 -- start start 2024-01-22T05:18:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.705+0000 7fbe7f200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe80065a50 0x7fbe8014f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.705+0000 7fbe7f200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbe800633c0 0x7fbe800c5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.705+0000 7fbe7f200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe800c5400 con 0x7fbe8014faf0 2024-01-22T05:18:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.705+0000 7fbe7f200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe80064310 con 0x7fbe80065a50 2024-01-22T05:18:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.705+0000 7fbe7f200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe80063850 con 0x7fbe800633c0 2024-01-22T05:18:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7de00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe80065a50 0x7fbe8014f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:30.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7de00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe80065a50 0x7fbe8014f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55680/0 (socket says 172.21.15.49:55680) 2024-01-22T05:18:30.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7de00700 1 -- 172.21.15.49:0/2454269017 learned_addr learned my addr 172.21.15.49:0/2454269017 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:30.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7d400700 1 --1- 172.21.15.49:0/2454269017 >> v1:172.21.15.110:6789/0 conn(0x7fbe8014faf0 0x7fbe80062cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:41396/0 (socket says 172.21.15.49:41396) 2024-01-22T05:18:30.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7e800700 1 --2- 172.21.15.49:0/2454269017 >> v2:172.21.15.110:3300/0 conn(0x7fbe800633c0 0x7fbe800c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:30.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7de00700 1 -- 172.21.15.49:0/2454269017 >> v2:172.21.15.110:3300/0 conn(0x7fbe800633c0 msgr2=0x7fbe800c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:30.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7de00700 1 --2- 172.21.15.49:0/2454269017 >> v2:172.21.15.110:3300/0 conn(0x7fbe800633c0 0x7fbe800c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:30.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7de00700 1 -- 172.21.15.49:0/2454269017 >> v1:172.21.15.110:6789/0 conn(0x7fbe8014faf0 legacy=0x7fbe80062cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:30.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7de00700 1 -- 172.21.15.49:0/2454269017 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe80063a70 con 0x7fbe80065a50 2024-01-22T05:18:30.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7ca00700 1 -- 172.21.15.49:0/2454269017 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332433954 0 0) 0x7fbe800c5400 con 0x7fbe8014faf0 2024-01-22T05:18:30.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7de00700 1 --2- 172.21.15.49:0/2454269017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe80065a50 0x7fbe8014f600 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fbe80064700 tx=0x7fbe7000b370).ready entity=mon.0 client_cookie=2bb89b2e9ac65716 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:30.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7ca00700 1 -- 172.21.15.49:0/2454269017 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7000db30 con 0x7fbe80065a50 2024-01-22T05:18:30.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7ca00700 1 -- 172.21.15.49:0/2454269017 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7000dc90 con 0x7fbe80065a50 2024-01-22T05:18:30.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7ca00700 1 -- 172.21.15.49:0/2454269017 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe70015600 con 0x7fbe80065a50 2024-01-22T05:18:30.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7f200700 1 -- 172.21.15.49:0/2454269017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe80065a50 msgr2=0x7fbe8014f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:30.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.709+0000 7fbe7f200700 1 --2- 172.21.15.49:0/2454269017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe80065a50 0x7fbe8014f600 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fbe80064700 tx=0x7fbe7000b370).stop 2024-01-22T05:18:30.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.713+0000 7fbe7f200700 1 -- 172.21.15.49:0/2454269017 shutdown_connections 2024-01-22T05:18:30.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.713+0000 7fbe7f200700 1 --2- 172.21.15.49:0/2454269017 >> v2:172.21.15.110:3300/0 conn(0x7fbe800633c0 0x7fbe800c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:30.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.713+0000 7fbe7f200700 1 --2- 172.21.15.49:0/2454269017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe80065a50 0x7fbe8014f600 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:30.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.713+0000 7fbe7f200700 1 -- 172.21.15.49:0/2454269017 >> 172.21.15.49:0/2454269017 conn(0x7fbe80067a90 msgr2=0x7fbe80067ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:30.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.713+0000 7fbe7f200700 1 -- 172.21.15.49:0/2454269017 shutdown_connections 2024-01-22T05:18:30.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.713+0000 7fbe7f200700 1 -- 172.21.15.49:0/2454269017 wait complete. 2024-01-22T05:18:30.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.713+0000 7fbe7f200700 1 Processor -- start 2024-01-22T05:18:30.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.713+0000 7fbe7f200700 1 -- start start 2024-01-22T05:18:30.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7f200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe800633c0 0x7fbe80148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:30.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7f200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe80065a50 0x7fbe800a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:30.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7f200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe8014faf0 0x7fbe800c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:30.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7f200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe800be4e0 con 0x7fbe8014faf0 2024-01-22T05:18:30.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7f200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe800be780 con 0x7fbe800633c0 2024-01-22T05:18:30.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7f200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe800bea60 con 0x7fbe80065a50 2024-01-22T05:18:30.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe8014faf0 0x7fbe800c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:30.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe8014faf0 0x7fbe800c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55692/0 (socket says 172.21.15.49:55692) 2024-01-22T05:18:30.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7e800700 1 -- 172.21.15.49:0/3838668389 learned_addr learned my addr 172.21.15.49:0/3838668389 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:30.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7de00700 1 --2- 172.21.15.49:0/3838668389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe800633c0 0x7fbe80148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:30.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7d400700 1 --2- 172.21.15.49:0/3838668389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe80065a50 0x7fbe800a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:30.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7e800700 1 -- 172.21.15.49:0/3838668389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe80065a50 msgr2=0x7fbe800a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:30.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7e800700 1 --2- 172.21.15.49:0/3838668389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe80065a50 0x7fbe800a5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:30.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7e800700 1 -- 172.21.15.49:0/3838668389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe800633c0 msgr2=0x7fbe80148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:30.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7e800700 1 --2- 172.21.15.49:0/3838668389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe800633c0 0x7fbe80148010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:30.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7e800700 1 -- 172.21.15.49:0/3838668389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7000b6a0 con 0x7fbe8014faf0 2024-01-22T05:18:30.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7de00700 1 --2- 172.21.15.49:0/3838668389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe800633c0 0x7fbe80148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:30.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.717+0000 7fbe7e800700 1 --2- 172.21.15.49:0/3838668389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe8014faf0 0x7fbe800c5790 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7fbe78009e90 tx=0x7fbe7800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:30.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.721+0000 7fbe75600700 1 -- 172.21.15.49:0/3838668389 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7800caa0 con 0x7fbe8014faf0 2024-01-22T05:18:30.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.721+0000 7fbe75600700 1 -- 172.21.15.49:0/3838668389 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7800f040 con 0x7fbe8014faf0 2024-01-22T05:18:30.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.721+0000 7fbe75600700 1 -- 172.21.15.49:0/3838668389 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7800ce10 con 0x7fbe8014faf0 2024-01-22T05:18:30.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.721+0000 7fbe7f200700 1 -- 172.21.15.49:0/3838668389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe800bed40 con 0x7fbe8014faf0 2024-01-22T05:18:30.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.721+0000 7fbe7f200700 1 -- 172.21.15.49:0/3838668389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe80148500 con 0x7fbe8014faf0 2024-01-22T05:18:30.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.725+0000 7fbe7f200700 1 -- 172.21.15.49:0/3838668389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe80148720 con 0x7fbe8014faf0 2024-01-22T05:18:30.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.725+0000 7fbe75600700 1 -- 172.21.15.49:0/3838668389 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbe78013610 con 0x7fbe8014faf0 2024-01-22T05:18:30.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.725+0000 7fbe75600700 1 --2- 172.21.15.49:0/3838668389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe5805a510 0x7fbe5805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.725+0000 7fbe75600700 1 -- 172.21.15.49:0/3838668389 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6122+0+0 (secure 0 0 0) 0x7fbe780750f0 con 0x7fbe8014faf0 2024-01-22T05:18:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.725+0000 7fbe7de00700 1 --2- 172.21.15.49:0/3838668389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe5805a510 0x7fbe5805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:30.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.729+0000 7fbe7de00700 1 --2- 172.21.15.49:0/3838668389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe5805a510 0x7fbe5805c9d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fbe7000ba40 tx=0x7fbe7001a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:30.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.733+0000 7fbe75600700 1 -- 172.21.15.49:0/3838668389 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbe80148720 con 0x7fbe8014faf0 2024-01-22T05:18:30.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:30.893+0000 7fbe7f200700 1 -- 172.21.15.49:0/3838668389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbe80148720 con 0x7fbe8014faf0 2024-01-22T05:18:31.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.517+0000 7fbe75600700 1 -- 172.21.15.49:0/3838668389 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v163) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbe80148720 con 0x7fbe8014faf0 2024-01-22T05:18:31.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.525+0000 7fbe7f200700 1 -- 172.21.15.49:0/3838668389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe5805a510 msgr2=0x7fbe5805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:31.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.525+0000 7fbe7f200700 1 --2- 172.21.15.49:0/3838668389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe5805a510 0x7fbe5805c9d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fbe7000ba40 tx=0x7fbe7001a000).stop 2024-01-22T05:18:31.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.525+0000 7fbe7f200700 1 -- 172.21.15.49:0/3838668389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe8014faf0 msgr2=0x7fbe800c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:31.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.525+0000 7fbe7f200700 1 --2- 172.21.15.49:0/3838668389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe8014faf0 0x7fbe800c5790 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7fbe78009e90 tx=0x7fbe7800b040).stop 2024-01-22T05:18:31.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.525+0000 7fbe7f200700 1 -- 172.21.15.49:0/3838668389 shutdown_connections 2024-01-22T05:18:31.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.525+0000 7fbe7f200700 1 --2- 172.21.15.49:0/3838668389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe5805a510 0x7fbe5805c9d0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:31.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.525+0000 7fbe7f200700 1 --2- 172.21.15.49:0/3838668389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe8014faf0 0x7fbe800c5790 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:31.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.525+0000 7fbe7f200700 1 --2- 172.21.15.49:0/3838668389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe80065a50 0x7fbe800a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:31.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.525+0000 7fbe7f200700 1 --2- 172.21.15.49:0/3838668389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe800633c0 0x7fbe80148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:31.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.525+0000 7fbe7f200700 1 -- 172.21.15.49:0/3838668389 >> 172.21.15.49:0/3838668389 conn(0x7fbe80067a90 msgr2=0x7fbe800bc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:31.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.525+0000 7fbe7f200700 1 -- 172.21.15.49:0/3838668389 shutdown_connections 2024-01-22T05:18:31.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.525+0000 7fbe7f200700 1 -- 172.21.15.49:0/3838668389 wait complete. 2024-01-22T05:18:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-01-22T05:18:31.550 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-22T05:18:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.721+0000 7f4da2200700 1 Processor -- start 2024-01-22T05:18:31.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.721+0000 7f4da2200700 1 -- start start 2024-01-22T05:18:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4da2200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4d9c153d40 0x7f4d9c0bcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4da2200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d9c0696a0 con 0x7f4d9c153960 2024-01-22T05:18:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4da2200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d9c0687f0 con 0x7f4d9c064550 2024-01-22T05:18:31.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4da2200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d9c068a90 con 0x7f4d9c153d40 2024-01-22T05:18:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4d9b400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4d9c153960 0x7f4d9c063e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47148/0 (socket says 172.21.15.49:47148) 2024-01-22T05:18:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4d9b400700 1 -- 172.21.15.49:0/3121253604 learned_addr learned my addr 172.21.15.49:0/3121253604 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4d9be00700 1 --1- 172.21.15.49:0/3121253604 >> v1:172.21.15.110:6789/0 conn(0x7f4d9c064550 0x7f4d9c0c1c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:41408/0 (socket says 172.21.15.49:41408) 2024-01-22T05:18:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4d9aa00700 1 --2- 172.21.15.49:0/3121253604 >> v2:172.21.15.110:3300/0 conn(0x7f4d9c153d40 0x7f4d9c0bcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4d9a000700 1 -- 172.21.15.49:0/3121253604 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845572156 0 0) 0x7f4d9c0687f0 con 0x7f4d9c064550 2024-01-22T05:18:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4d9a000700 1 -- 172.21.15.49:0/3121253604 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d7c0033f0 con 0x7f4d9c064550 2024-01-22T05:18:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4d9a000700 1 -- 172.21.15.49:0/3121253604 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188765921 0 0) 0x7f4d9c0696a0 con 0x7f4d9c153960 2024-01-22T05:18:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4d9a000700 1 -- 172.21.15.49:0/3121253604 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d9c0687f0 con 0x7f4d9c153960 2024-01-22T05:18:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4d9aa00700 1 -- 172.21.15.49:0/3121253604 >> v1:172.21.15.110:6789/0 conn(0x7f4d9c064550 legacy=0x7f4d9c0c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4d9aa00700 1 -- 172.21.15.49:0/3121253604 >> v1:172.21.15.49:6789/0 conn(0x7f4d9c153960 legacy=0x7f4d9c063e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4d9aa00700 1 -- 172.21.15.49:0/3121253604 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c068d70 con 0x7f4d9c153d40 2024-01-22T05:18:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4d9aa00700 1 --2- 172.21.15.49:0/3121253604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d9c153d40 0x7f4d9c0bcf80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f4d84009760 tx=0x7f4d84009060).ready entity=mon.1 client_cookie=6c4a40704c71a7b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4d9a000700 1 -- 172.21.15.49:0/3121253604 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8400d4a0 con 0x7f4d9c153d40 2024-01-22T05:18:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4d9a000700 1 -- 172.21.15.49:0/3121253604 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8400d600 con 0x7f4d9c153d40 2024-01-22T05:18:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.725+0000 7f4d9a000700 1 -- 172.21.15.49:0/3121253604 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8400d980 con 0x7f4d9c153d40 2024-01-22T05:18:31.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.729+0000 7f4da2200700 1 -- 172.21.15.49:0/3121253604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d9c153d40 msgr2=0x7f4d9c0bcf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:31.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.729+0000 7f4da2200700 1 --2- 172.21.15.49:0/3121253604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d9c153d40 0x7f4d9c0bcf80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f4d84009760 tx=0x7f4d84009060).stop 2024-01-22T05:18:31.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.729+0000 7f4da2200700 1 -- 172.21.15.49:0/3121253604 shutdown_connections 2024-01-22T05:18:31.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.729+0000 7f4da2200700 1 --2- 172.21.15.49:0/3121253604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d9c153d40 0x7f4d9c0bcf80 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:31.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.729+0000 7f4da2200700 1 -- 172.21.15.49:0/3121253604 >> 172.21.15.49:0/3121253604 conn(0x7f4d9c0c4bc0 msgr2=0x7f4d9c062830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:31.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.729+0000 7f4da2200700 1 -- 172.21.15.49:0/3121253604 shutdown_connections 2024-01-22T05:18:31.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.729+0000 7f4da2200700 1 -- 172.21.15.49:0/3121253604 wait complete. 2024-01-22T05:18:31.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.729+0000 7f4da2200700 1 Processor -- start 2024-01-22T05:18:31.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4da2200700 1 -- start start 2024-01-22T05:18:31.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4da2200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d9c064550 0x7f4d9c151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:31.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4da2200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d9c153960 0x7f4d9c1642c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:31.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4da2200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d9c153d40 0x7f4d9c0bee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:31.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4da2200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c0a5120 con 0x7f4d9c153960 2024-01-22T05:18:31.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4da2200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c0a5860 con 0x7f4d9c153d40 2024-01-22T05:18:31.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4da2200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c0a5530 con 0x7f4d9c064550 2024-01-22T05:18:31.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4d9aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d9c153960 0x7f4d9c1642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:31.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4d9aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d9c153960 0x7f4d9c1642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55702/0 (socket says 172.21.15.49:55702) 2024-01-22T05:18:31.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4d9aa00700 1 -- 172.21.15.49:0/1795323575 learned_addr learned my addr 172.21.15.49:0/1795323575 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:31.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4d9be00700 1 --2- 172.21.15.49:0/1795323575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d9c153d40 0x7f4d9c0bee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:31.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4d9b400700 1 --2- 172.21.15.49:0/1795323575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d9c064550 0x7f4d9c151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:31.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4d9aa00700 1 -- 172.21.15.49:0/1795323575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d9c064550 msgr2=0x7f4d9c151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:31.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4d9aa00700 1 --2- 172.21.15.49:0/1795323575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d9c064550 0x7f4d9c151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:31.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4d9aa00700 1 -- 172.21.15.49:0/1795323575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d9c153d40 msgr2=0x7f4d9c0bee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:31.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4d9aa00700 1 --2- 172.21.15.49:0/1795323575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d9c153d40 0x7f4d9c0bee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:31.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4d9aa00700 1 -- 172.21.15.49:0/1795323575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d840092a0 con 0x7f4d9c153960 2024-01-22T05:18:31.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.733+0000 7f4d9aa00700 1 --2- 172.21.15.49:0/1795323575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d9c153960 0x7f4d9c1642c0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f4d84010000 tx=0x7f4d84016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:31.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.737+0000 7f4d92a00700 1 -- 172.21.15.49:0/1795323575 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8400dcf0 con 0x7f4d9c153960 2024-01-22T05:18:31.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.737+0000 7f4d92a00700 1 -- 172.21.15.49:0/1795323575 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8400de50 con 0x7f4d9c153960 2024-01-22T05:18:31.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.737+0000 7f4d92a00700 1 -- 172.21.15.49:0/1795323575 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8400d980 con 0x7f4d9c153960 2024-01-22T05:18:31.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.737+0000 7f4da2200700 1 -- 172.21.15.49:0/1795323575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9c0bffd0 con 0x7f4d9c153960 2024-01-22T05:18:31.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.737+0000 7f4da2200700 1 -- 172.21.15.49:0/1795323575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9c0bfcf0 con 0x7f4d9c153960 2024-01-22T05:18:31.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.737+0000 7f4da2200700 1 -- 172.21.15.49:0/1795323575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9c0a5390 con 0x7f4d9c153960 2024-01-22T05:18:31.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.737+0000 7f4d92a00700 1 -- 172.21.15.49:0/1795323575 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4d8401d640 con 0x7f4d9c153960 2024-01-22T05:18:31.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.737+0000 7f4d92a00700 1 --2- 172.21.15.49:0/1795323575 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d7405a510 0x7f4d7405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:31.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.741+0000 7f4d92a00700 1 -- 172.21.15.49:0/1795323575 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f4d84075db0 con 0x7f4d9c153960 2024-01-22T05:18:31.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.741+0000 7f4d9b400700 1 --2- 172.21.15.49:0/1795323575 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d7405a510 0x7f4d7405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:31.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.741+0000 7f4d9b400700 1 --2- 172.21.15.49:0/1795323575 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d7405a510 0x7f4d7405c9d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f4d8c005750 tx=0x7f4d8c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:31.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.745+0000 7f4d92a00700 1 -- 172.21.15.49:0/1795323575 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4d9c0a5390 con 0x7f4d9c153960 2024-01-22T05:18:31.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.917+0000 7f4da2200700 1 -- 172.21.15.49:0/1795323575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4d9c0a5390 con 0x7f4d9c153960 2024-01-22T05:18:31.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.925+0000 7f4d92a00700 1 -- 172.21.15.49:0/1795323575 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4d9c0a5390 con 0x7f4d9c153960 2024-01-22T05:18:31.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.929+0000 7f4da2200700 1 -- 172.21.15.49:0/1795323575 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d7405a510 msgr2=0x7f4d7405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:31.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.929+0000 7f4da2200700 1 --2- 172.21.15.49:0/1795323575 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d7405a510 0x7f4d7405c9d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f4d8c005750 tx=0x7f4d8c009040).stop 2024-01-22T05:18:31.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.929+0000 7f4da2200700 1 -- 172.21.15.49:0/1795323575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d9c153960 msgr2=0x7f4d9c1642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:31.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.929+0000 7f4da2200700 1 --2- 172.21.15.49:0/1795323575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d9c153960 0x7f4d9c1642c0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f4d84010000 tx=0x7f4d84016000).stop 2024-01-22T05:18:31.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.929+0000 7f4da2200700 1 -- 172.21.15.49:0/1795323575 shutdown_connections 2024-01-22T05:18:31.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.929+0000 7f4da2200700 1 --2- 172.21.15.49:0/1795323575 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4d7405a510 0x7f4d7405c9d0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:31.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.929+0000 7f4da2200700 1 --2- 172.21.15.49:0/1795323575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d9c153d40 0x7f4d9c0bee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:31.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.929+0000 7f4da2200700 1 --2- 172.21.15.49:0/1795323575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d9c153960 0x7f4d9c1642c0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:31.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.929+0000 7f4da2200700 1 --2- 172.21.15.49:0/1795323575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d9c064550 0x7f4d9c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:31.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.929+0000 7f4da2200700 1 -- 172.21.15.49:0/1795323575 >> 172.21.15.49:0/1795323575 conn(0x7f4d9c0c4bc0 msgr2=0x7f4d9c0c2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:31.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.929+0000 7f4da2200700 1 -- 172.21.15.49:0/1795323575 shutdown_connections 2024-01-22T05:18:31.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:31.929+0000 7f4da2200700 1 -- 172.21.15.49:0/1795323575 wait complete. 2024-01-22T05:18:31.953 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-01-22T05:18:32.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.109+0000 7f3479a00700 1 Processor -- start 2024-01-22T05:18:32.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.109+0000 7f3479a00700 1 -- start start 2024-01-22T05:18:32.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.109+0000 7f3479a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f34740a8740 0x7f34740a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:32.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.109+0000 7f3479a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34740c1a40 con 0x7f34740c1ed0 2024-01-22T05:18:32.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.109+0000 7f3479a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34740a90b0 con 0x7f3474155d20 2024-01-22T05:18:32.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.109+0000 7f3479a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3474159310 con 0x7f34740a8740 2024-01-22T05:18:32.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3473400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f34740c1ed0 0x7f34740c2360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47160/0 (socket says 172.21.15.49:47160) 2024-01-22T05:18:32.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3473400700 1 -- 172.21.15.49:0/4275299078 learned_addr learned my addr 172.21.15.49:0/4275299078 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:32.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3472000700 1 --2- 172.21.15.49:0/4275299078 >> v2:172.21.15.110:3300/0 conn(0x7f34740a8740 0x7f34740a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:32.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965094774 0 0) 0x7f34740c1a40 con 0x7f34740c1ed0 2024-01-22T05:18:32.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34540033f0 con 0x7f34740c1ed0 2024-01-22T05:18:32.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228169036 0 0) 0x7f34740a90b0 con 0x7f3474155d20 2024-01-22T05:18:32.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34740c1a40 con 0x7f3474155d20 2024-01-22T05:18:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2148169864 0 0) 0x7f34540033f0 con 0x7f34740c1ed0 2024-01-22T05:18:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 >> v2:172.21.15.110:3300/0 conn(0x7f34740a8740 msgr2=0x7f34740a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 --2- 172.21.15.49:0/4275299078 >> v2:172.21.15.110:3300/0 conn(0x7f34740a8740 0x7f34740a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 >> v1:172.21.15.110:6789/0 conn(0x7f3474155d20 legacy=0x7f3474065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34740c13f0 con 0x7f34740c1ed0 2024-01-22T05:18:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3472000700 1 --2- 172.21.15.49:0/4275299078 >> v2:172.21.15.110:3300/0 conn(0x7f34740a8740 0x7f34740a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f346c0017f0 con 0x7f34740c1ed0 2024-01-22T05:18:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 >> v1:172.21.15.49:6789/0 conn(0x7f34740c1ed0 legacy=0x7f34740c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 --2- 172.21.15.49:0/4275299078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3454003a70 0x7f3454003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 --2- 172.21.15.49:0/4275299078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3454004690 0x7f3454004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 --2- 172.21.15.49:0/4275299078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3454005000 0x7f345400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3474159310 con 0x7f3454005000 2024-01-22T05:18:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345400bf60 con 0x7f3454004690 2024-01-22T05:18:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345400c0d0 con 0x7f3454003a70 2024-01-22T05:18:32.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3473400700 1 --2- 172.21.15.49:0/4275299078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3454005000 0x7f345400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:32.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3473400700 1 -- 172.21.15.49:0/4275299078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3454003a70 msgr2=0x7f3454003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:32.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3472a00700 1 --2- 172.21.15.49:0/4275299078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3454003a70 0x7f3454003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3472000700 1 --2- 172.21.15.49:0/4275299078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3454004690 0x7f3454004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3473400700 1 --2- 172.21.15.49:0/4275299078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3454003a70 0x7f3454003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3473400700 1 -- 172.21.15.49:0/4275299078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3454004690 msgr2=0x7f3454004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3473400700 1 --2- 172.21.15.49:0/4275299078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3454004690 0x7f3454004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3473400700 1 -- 172.21.15.49:0/4275299078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34540033f0 con 0x7f3454005000 2024-01-22T05:18:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3472000700 1 --2- 172.21.15.49:0/4275299078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3454004690 0x7f3454004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:18:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3472a00700 1 --2- 172.21.15.49:0/4275299078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3454003a70 0x7f3454003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:18:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3473400700 1 -- 172.21.15.49:0/4275299078 reap_dead start 2024-01-22T05:18:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3473400700 1 --2- 172.21.15.49:0/4275299078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3454005000 0x7f345400b8e0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7f346c00c5c0 tx=0x7f346c007f40).ready entity=mon.0 client_cookie=cbca9d9e173ccb33 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c00cdc0 con 0x7f3454005000 2024-01-22T05:18:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346c005b20 con 0x7f3454005000 2024-01-22T05:18:32.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.113+0000 7f3471600700 1 -- 172.21.15.49:0/4275299078 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c0070d0 con 0x7f3454005000 2024-01-22T05:18:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.117+0000 7f3479a00700 1 -- 172.21.15.49:0/4275299078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3454005000 msgr2=0x7f345400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.117+0000 7f3479a00700 1 --2- 172.21.15.49:0/4275299078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3454005000 0x7f345400b8e0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7f346c00c5c0 tx=0x7f346c007f40).stop 2024-01-22T05:18:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.117+0000 7f3479a00700 1 -- 172.21.15.49:0/4275299078 shutdown_connections 2024-01-22T05:18:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.117+0000 7f3479a00700 1 --2- 172.21.15.49:0/4275299078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3454005000 0x7f345400b8e0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.117+0000 7f3479a00700 1 -- 172.21.15.49:0/4275299078 >> 172.21.15.49:0/4275299078 conn(0x7f34740c6540 msgr2=0x7f34740c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.117+0000 7f3479a00700 1 -- 172.21.15.49:0/4275299078 shutdown_connections 2024-01-22T05:18:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.117+0000 7f3479a00700 1 -- 172.21.15.49:0/4275299078 wait complete. 2024-01-22T05:18:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.121+0000 7f3479a00700 1 Processor -- start 2024-01-22T05:18:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.121+0000 7f3479a00700 1 -- start start 2024-01-22T05:18:32.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.121+0000 7f3479a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3454005000 0x7f34740c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:32.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.121+0000 7f3479a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34740c5980 0x7f34740abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:32.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.121+0000 7f3479a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34740ac190 0x7f3474152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:32.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.121+0000 7f3479a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3474169410 con 0x7f34740ac190 2024-01-22T05:18:32.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.121+0000 7f3479a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3474169af0 con 0x7f3454005000 2024-01-22T05:18:32.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.121+0000 7f3479a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34740aa840 con 0x7f34740c5980 2024-01-22T05:18:32.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.121+0000 7f3473400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34740ac190 0x7f3474152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:32.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.121+0000 7f3472a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3454005000 0x7f34740c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:32.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.121+0000 7f3473400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34740ac190 0x7f3474152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55716/0 (socket says 172.21.15.49:55716) 2024-01-22T05:18:32.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.121+0000 7f3473400700 1 -- 172.21.15.49:0/2788620192 learned_addr learned my addr 172.21.15.49:0/2788620192 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:32.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.121+0000 7f3472000700 1 --2- 172.21.15.49:0/2788620192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34740c5980 0x7f34740abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:32.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.125+0000 7f3473400700 1 -- 172.21.15.49:0/2788620192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34740c5980 msgr2=0x7f34740abca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:32.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.125+0000 7f3473400700 1 --2- 172.21.15.49:0/2788620192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34740c5980 0x7f34740abca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:32.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.125+0000 7f3473400700 1 -- 172.21.15.49:0/2788620192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3454005000 msgr2=0x7f34740c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:32.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.125+0000 7f3473400700 1 --2- 172.21.15.49:0/2788620192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3454005000 0x7f34740c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:32.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.125+0000 7f3473400700 1 -- 172.21.15.49:0/2788620192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34740aa280 con 0x7f34740ac190 2024-01-22T05:18:32.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.125+0000 7f3473400700 1 --2- 172.21.15.49:0/2788620192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34740ac190 0x7f3474152e00 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7f346c00c5c0 tx=0x7f346c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:32.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.125+0000 7f346a000700 1 -- 172.21.15.49:0/2788620192 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c0070d0 con 0x7f34740ac190 2024-01-22T05:18:32.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.125+0000 7f346a000700 1 -- 172.21.15.49:0/2788620192 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346c001250 con 0x7f34740ac190 2024-01-22T05:18:32.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.125+0000 7f3479a00700 1 -- 172.21.15.49:0/2788620192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34740aa560 con 0x7f34740ac190 2024-01-22T05:18:32.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.125+0000 7f346a000700 1 -- 172.21.15.49:0/2788620192 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c001900 con 0x7f34740ac190 2024-01-22T05:18:32.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.125+0000 7f3479a00700 1 -- 172.21.15.49:0/2788620192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34740a9f80 con 0x7f34740ac190 2024-01-22T05:18:32.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.125+0000 7f3479a00700 1 -- 172.21.15.49:0/2788620192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34741695e0 con 0x7f34740ac190 2024-01-22T05:18:32.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.129+0000 7f346a000700 1 -- 172.21.15.49:0/2788620192 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f346c0138d0 con 0x7f34740ac190 2024-01-22T05:18:32.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.129+0000 7f346a000700 1 --2- 172.21.15.49:0/2788620192 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f344c05a540 0x7f344c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:32.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.129+0000 7f346a000700 1 -- 172.21.15.49:0/2788620192 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f346c0757f0 con 0x7f34740ac190 2024-01-22T05:18:32.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.129+0000 7f3472a00700 1 --2- 172.21.15.49:0/2788620192 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f344c05a540 0x7f344c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:32.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.133+0000 7f3472a00700 1 --2- 172.21.15.49:0/2788620192 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f344c05a540 0x7f344c05ca00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f3464007fd0 tx=0x7f3464009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:32.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.137+0000 7f346a000700 1 -- 172.21.15.49:0/2788620192 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f34741695e0 con 0x7f34740ac190 2024-01-22T05:18:32.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.425+0000 7f3479a00700 1 -- 172.21.15.49:0/2788620192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) v1 -- 0x7f34741695e0 con 0x7f34740ac190 2024-01-22T05:18:32.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.529+0000 7f346a000700 1 -- 172.21.15.49:0/2788620192 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v643) v1 ==== 140+0+0 (secure 0 0 0) 0x7f34741695e0 con 0x7f34740ac190 2024-01-22T05:18:32.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.533+0000 7f3479a00700 1 -- 172.21.15.49:0/2788620192 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f344c05a540 msgr2=0x7f344c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:32.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.533+0000 7f3479a00700 1 --2- 172.21.15.49:0/2788620192 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f344c05a540 0x7f344c05ca00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f3464007fd0 tx=0x7f3464009040).stop 2024-01-22T05:18:32.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.533+0000 7f3479a00700 1 -- 172.21.15.49:0/2788620192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34740ac190 msgr2=0x7f3474152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:32.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.533+0000 7f3479a00700 1 --2- 172.21.15.49:0/2788620192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34740ac190 0x7f3474152e00 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7f346c00c5c0 tx=0x7f346c015000).stop 2024-01-22T05:18:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.533+0000 7f3479a00700 1 -- 172.21.15.49:0/2788620192 shutdown_connections 2024-01-22T05:18:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.533+0000 7f3479a00700 1 --2- 172.21.15.49:0/2788620192 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f344c05a540 0x7f344c05ca00 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.533+0000 7f3479a00700 1 --2- 172.21.15.49:0/2788620192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34740ac190 0x7f3474152e00 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.533+0000 7f3479a00700 1 --2- 172.21.15.49:0/2788620192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34740c5980 0x7f34740abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.533+0000 7f3479a00700 1 --2- 172.21.15.49:0/2788620192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3454005000 0x7f34740c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.533+0000 7f3479a00700 1 -- 172.21.15.49:0/2788620192 >> 172.21.15.49:0/2788620192 conn(0x7f34740c6540 msgr2=0x7f34740c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:32.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.537+0000 7f3479a00700 1 -- 172.21.15.49:0/2788620192 shutdown_connections 2024-01-22T05:18:32.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.537+0000 7f3479a00700 1 -- 172.21.15.49:0/2788620192 wait complete. 2024-01-22T05:18:32.562 INFO:tasks.cephfs_test_runner:test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-01-22T05:18:32.563 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-01-22T05:18:32.563 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-01-22T05:18:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.729+0000 7f6f3f400700 1 Processor -- start 2024-01-22T05:18:32.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.733+0000 7f6f3f400700 1 -- start start 2024-01-22T05:18:32.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.733+0000 7f6f3f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38155880 0x7f6f380a8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:32.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.733+0000 7f6f3f400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6f380a7260 0x7f6f380659b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.733+0000 7f6f3f400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f38068a60 con 0x7f6f38155c60 2024-01-22T05:18:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.733+0000 7f6f3f400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f38067e50 con 0x7f6f380a7260 2024-01-22T05:18:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.733+0000 7f6f3f400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38068130 con 0x7f6f38155880 2024-01-22T05:18:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.737+0000 7f6f3e000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38155880 0x7f6f380a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.737+0000 7f6f3ea00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6f380a7260 0x7f6f380659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.737+0000 7f6f3e000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38155880 0x7f6f380a8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:58840/0 (socket says 172.21.15.49:58840) 2024-01-22T05:18:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.737+0000 7f6f3e000700 1 -- 172.21.15.49:0/1214931214 learned_addr learned my addr 172.21.15.49:0/1214931214 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.737+0000 7f6f3d600700 1 --1- 172.21.15.49:0/1214931214 >> v1:172.21.15.110:6789/0 conn(0x7f6f38155c60 0x7f6f380a6b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:41428/0 (socket says 172.21.15.49:41428) 2024-01-22T05:18:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.737+0000 7f6f3e000700 1 -- 172.21.15.49:0/1214931214 >> v2:172.21.15.110:3300/0 conn(0x7f6f380a7260 msgr2=0x7f6f380659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.737+0000 7f6f3e000700 1 --2- 172.21.15.49:0/1214931214 >> v2:172.21.15.110:3300/0 conn(0x7f6f380a7260 0x7f6f380659b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.737+0000 7f6f3e000700 1 -- 172.21.15.49:0/1214931214 >> v1:172.21.15.110:6789/0 conn(0x7f6f38155c60 legacy=0x7f6f380a6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.737+0000 7f6f3e000700 1 -- 172.21.15.49:0/1214931214 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f38068410 con 0x7f6f38155880 2024-01-22T05:18:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.737+0000 7f6f3e000700 1 --2- 172.21.15.49:0/1214931214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38155880 0x7f6f380a8990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f6f28006fd0 tx=0x7f6f280090f0).ready entity=mon.2 client_cookie=a542a5af600f284a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:32.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.737+0000 7f6f3cc00700 1 -- 172.21.15.49:0/1214931214 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2800b580 con 0x7f6f38155880 2024-01-22T05:18:32.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.737+0000 7f6f3cc00700 1 -- 172.21.15.49:0/1214931214 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2800b6e0 con 0x7f6f38155880 2024-01-22T05:18:32.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.737+0000 7f6f3cc00700 1 -- 172.21.15.49:0/1214931214 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2800ba60 con 0x7f6f38155880 2024-01-22T05:18:32.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.737+0000 7f6f3f400700 1 -- 172.21.15.49:0/1214931214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38155880 msgr2=0x7f6f380a8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:32.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.737+0000 7f6f3f400700 1 --2- 172.21.15.49:0/1214931214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38155880 0x7f6f380a8990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f6f28006fd0 tx=0x7f6f280090f0).stop 2024-01-22T05:18:32.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.741+0000 7f6f3f400700 1 -- 172.21.15.49:0/1214931214 shutdown_connections 2024-01-22T05:18:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.741+0000 7f6f3f400700 1 --2- 172.21.15.49:0/1214931214 >> v2:172.21.15.110:3300/0 conn(0x7f6f380a7260 0x7f6f380659b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.741+0000 7f6f3f400700 1 --2- 172.21.15.49:0/1214931214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38155880 0x7f6f380a8990 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.741+0000 7f6f3f400700 1 -- 172.21.15.49:0/1214931214 >> 172.21.15.49:0/1214931214 conn(0x7f6f380c6530 msgr2=0x7f6f380c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.741+0000 7f6f3f400700 1 -- 172.21.15.49:0/1214931214 shutdown_connections 2024-01-22T05:18:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.741+0000 7f6f3f400700 1 -- 172.21.15.49:0/1214931214 wait complete. 2024-01-22T05:18:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.741+0000 7f6f3f400700 1 Processor -- start 2024-01-22T05:18:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3f400700 1 -- start start 2024-01-22T05:18:32.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f380a7260 0x7f6f380a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:32.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38155880 0x7f6f380a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:32.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f38155c60 0x7f6f38169d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:32.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3f400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380a9e40 con 0x7f6f38155c60 2024-01-22T05:18:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3f400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380aa120 con 0x7f6f380a7260 2024-01-22T05:18:32.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3f400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380aa400 con 0x7f6f38155880 2024-01-22T05:18:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f38155c60 0x7f6f38169d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f38155c60 0x7f6f38169d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55728/0 (socket says 172.21.15.49:55728) 2024-01-22T05:18:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3ea00700 1 -- 172.21.15.49:0/1762651051 learned_addr learned my addr 172.21.15.49:0/1762651051 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3e000700 1 --2- 172.21.15.49:0/1762651051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f380a7260 0x7f6f380a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3d600700 1 --2- 172.21.15.49:0/1762651051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38155880 0x7f6f380a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3ea00700 1 -- 172.21.15.49:0/1762651051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38155880 msgr2=0x7f6f380a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3ea00700 1 --2- 172.21.15.49:0/1762651051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38155880 0x7f6f380a9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3ea00700 1 -- 172.21.15.49:0/1762651051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f380a7260 msgr2=0x7f6f380a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3ea00700 1 --2- 172.21.15.49:0/1762651051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f380a7260 0x7f6f380a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.745+0000 7f6f3ea00700 1 -- 172.21.15.49:0/1762651051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f28009370 con 0x7f6f38155c60 2024-01-22T05:18:32.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.749+0000 7f6f3ea00700 1 --2- 172.21.15.49:0/1762651051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f38155c60 0x7f6f38169d00 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f6f30009df0 tx=0x7f6f3000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:32.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.749+0000 7f6f35600700 1 -- 172.21.15.49:0/1762651051 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3000caa0 con 0x7f6f38155c60 2024-01-22T05:18:32.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.749+0000 7f6f35600700 1 -- 172.21.15.49:0/1762651051 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3000f040 con 0x7f6f38155c60 2024-01-22T05:18:32.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.749+0000 7f6f35600700 1 -- 172.21.15.49:0/1762651051 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3000ce10 con 0x7f6f38155c60 2024-01-22T05:18:32.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.749+0000 7f6f3f400700 1 -- 172.21.15.49:0/1762651051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f380aa6e0 con 0x7f6f38155c60 2024-01-22T05:18:32.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.749+0000 7f6f3f400700 1 -- 172.21.15.49:0/1762651051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f380a5240 con 0x7f6f38155c60 2024-01-22T05:18:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.749+0000 7f6f3f400700 1 -- 172.21.15.49:0/1762651051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3805fd40 con 0x7f6f38155c60 2024-01-22T05:18:32.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.749+0000 7f6f35600700 1 -- 172.21.15.49:0/1762651051 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6f30013610 con 0x7f6f38155c60 2024-01-22T05:18:32.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.753+0000 7f6f35600700 1 --2- 172.21.15.49:0/1762651051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f1005a4e0 0x7f6f1005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:32.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.753+0000 7f6f35600700 1 -- 172.21.15.49:0/1762651051 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f6f30074d90 con 0x7f6f38155c60 2024-01-22T05:18:32.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.753+0000 7f6f3e000700 1 --2- 172.21.15.49:0/1762651051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f1005a4e0 0x7f6f1005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:32.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.753+0000 7f6f3e000700 1 --2- 172.21.15.49:0/1762651051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f1005a4e0 0x7f6f1005c9a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f6f28009130 tx=0x7f6f28017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:32.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.757+0000 7f6f35600700 1 -- 172.21.15.49:0/1762651051 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6f300487b0 con 0x7f6f38155c60 2024-01-22T05:18:32.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:32.977+0000 7f6f3f400700 1 -- 172.21.15.49:0/1762651051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) v1 -- 0x7f6f38046800 con 0x7f6f38155c60 2024-01-22T05:18:33.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.537+0000 7f6f35600700 1 -- 172.21.15.49:0/1762651051 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v644) v1 ==== 136+0+0 (secure 0 0 0) 0x7f6f3004bdd0 con 0x7f6f38155c60 2024-01-22T05:18:33.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.541+0000 7f6f3f400700 1 -- 172.21.15.49:0/1762651051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f1005a4e0 msgr2=0x7f6f1005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:33.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.541+0000 7f6f3f400700 1 --2- 172.21.15.49:0/1762651051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f1005a4e0 0x7f6f1005c9a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f6f28009130 tx=0x7f6f28017000).stop 2024-01-22T05:18:33.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.541+0000 7f6f3f400700 1 -- 172.21.15.49:0/1762651051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f38155c60 msgr2=0x7f6f38169d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:33.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.541+0000 7f6f3f400700 1 --2- 172.21.15.49:0/1762651051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f38155c60 0x7f6f38169d00 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f6f30009df0 tx=0x7f6f3000b040).stop 2024-01-22T05:18:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.541+0000 7f6f3f400700 1 -- 172.21.15.49:0/1762651051 shutdown_connections 2024-01-22T05:18:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.541+0000 7f6f3f400700 1 --2- 172.21.15.49:0/1762651051 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6f1005a4e0 0x7f6f1005c9a0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.541+0000 7f6f3f400700 1 --2- 172.21.15.49:0/1762651051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f38155c60 0x7f6f38169d00 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.541+0000 7f6f3f400700 1 --2- 172.21.15.49:0/1762651051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f38155880 0x7f6f380a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.541+0000 7f6f3f400700 1 --2- 172.21.15.49:0/1762651051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f380a7260 0x7f6f380a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.541+0000 7f6f3f400700 1 -- 172.21.15.49:0/1762651051 >> 172.21.15.49:0/1762651051 conn(0x7f6f380c6530 msgr2=0x7f6f381564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:33.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.541+0000 7f6f3f400700 1 -- 172.21.15.49:0/1762651051 shutdown_connections 2024-01-22T05:18:33.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.541+0000 7f6f3f400700 1 -- 172.21.15.49:0/1762651051 wait complete. 2024-01-22T05:18:33.574 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-22T05:18:33.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.745+0000 7f191b400700 1 Processor -- start 2024-01-22T05:18:33.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.745+0000 7f191b400700 1 -- start start 2024-01-22T05:18:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f191b400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1914064490 0x7f19140c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f191b400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19140c3210 0x7f19140687c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f191b400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191415ba30 con 0x7f1914141aa0 2024-01-22T05:18:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f191b400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1914141e80 con 0x7f1914064490 2024-01-22T05:18:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f191b400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191415bcc0 con 0x7f19140c3210 2024-01-22T05:18:33.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f191a000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1914141aa0 0x7f1914063d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53644/0 (socket says 172.21.15.49:53644) 2024-01-22T05:18:33.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f191a000700 1 -- 172.21.15.49:0/2095925928 learned_addr learned my addr 172.21.15.49:0/2095925928 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:33.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1919600700 1 --2- 172.21.15.49:0/2095925928 >> v2:172.21.15.110:3300/0 conn(0x7f1914064490 0x7f19140c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:33.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f191aa00700 1 --2- 172.21.15.49:0/2095925928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19140c3210 0x7f19140687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:33.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 -- 172.21.15.49:0/2095925928 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556430452 0 0) 0x7f191415ba30 con 0x7f1914141aa0 2024-01-22T05:18:33.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 -- 172.21.15.49:0/2095925928 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18f40033f0 con 0x7f1914141aa0 2024-01-22T05:18:33.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 -- 172.21.15.49:0/2095925928 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3524791340 0 0) 0x7f18f40033f0 con 0x7f1914141aa0 2024-01-22T05:18:33.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 -- 172.21.15.49:0/2095925928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19140c3210 msgr2=0x7f19140687c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:33.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 --2- 172.21.15.49:0/2095925928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19140c3210 0x7f19140687c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:33.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 -- 172.21.15.49:0/2095925928 >> v2:172.21.15.110:3300/0 conn(0x7f1914064490 msgr2=0x7f19140c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:33.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 --2- 172.21.15.49:0/2095925928 >> v2:172.21.15.110:3300/0 conn(0x7f1914064490 0x7f19140c2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:33.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 -- 172.21.15.49:0/2095925928 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191415bfa0 con 0x7f1914141aa0 2024-01-22T05:18:33.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 -- 172.21.15.49:0/2095925928 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f1904001470 con 0x7f1914141aa0 2024-01-22T05:18:33.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 -- 172.21.15.49:0/2095925928 >> v1:172.21.15.49:6789/0 conn(0x7f1914141aa0 legacy=0x7f1914063d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:33.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 --2- 172.21.15.49:0/2095925928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18f40038e0 0x7f18f4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:33.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 --2- 172.21.15.49:0/2095925928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18f4004690 0x7f18f4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:33.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 --2- 172.21.15.49:0/2095925928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18f4005000 0x7f18f400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:33.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 -- 172.21.15.49:0/2095925928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1914141e80 con 0x7f18f40038e0 2024-01-22T05:18:33.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 -- 172.21.15.49:0/2095925928 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191415bcc0 con 0x7f18f4005000 2024-01-22T05:18:33.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.749+0000 7f1918c00700 1 -- 172.21.15.49:0/2095925928 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f400bdd0 con 0x7f18f4004690 2024-01-22T05:18:33.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f191a000700 1 --2- 172.21.15.49:0/2095925928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18f40038e0 0x7f18f4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:33.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f1919600700 1 --2- 172.21.15.49:0/2095925928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18f4004690 0x7f18f4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:33.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f191aa00700 1 --2- 172.21.15.49:0/2095925928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18f4005000 0x7f18f400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:33.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f191a000700 1 -- 172.21.15.49:0/2095925928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18f4004690 msgr2=0x7f18f4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:33.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f191a000700 1 --2- 172.21.15.49:0/2095925928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18f4004690 0x7f18f4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:33.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f191a000700 1 -- 172.21.15.49:0/2095925928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18f4005000 msgr2=0x7f18f400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:33.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f191a000700 1 --2- 172.21.15.49:0/2095925928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18f4005000 0x7f18f400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:33.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f191a000700 1 -- 172.21.15.49:0/2095925928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f40033f0 con 0x7f18f40038e0 2024-01-22T05:18:33.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f191a000700 1 --2- 172.21.15.49:0/2095925928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18f40038e0 0x7f18f4003d00 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f190400c210 tx=0x7f1904001e90).ready entity=mon.0 client_cookie=9aea9c70d5e1761d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:33.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f1918c00700 1 -- 172.21.15.49:0/2095925928 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1904007a60 con 0x7f18f40038e0 2024-01-22T05:18:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f1918c00700 1 -- 172.21.15.49:0/2095925928 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190400cae0 con 0x7f18f40038e0 2024-01-22T05:18:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f1918c00700 1 -- 172.21.15.49:0/2095925928 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190400ce80 con 0x7f18f40038e0 2024-01-22T05:18:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f191b400700 1 -- 172.21.15.49:0/2095925928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18f40038e0 msgr2=0x7f18f4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:33.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f191b400700 1 --2- 172.21.15.49:0/2095925928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18f40038e0 0x7f18f4003d00 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f190400c210 tx=0x7f1904001e90).stop 2024-01-22T05:18:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f191aa00700 1 -- 172.21.15.49:0/2095925928 reap_dead start 2024-01-22T05:18:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f191b400700 1 -- 172.21.15.49:0/2095925928 shutdown_connections 2024-01-22T05:18:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.753+0000 7f191b400700 1 -- 172.21.15.49:0/2095925928 >> 172.21.15.49:0/2095925928 conn(0x7f19140c40e0 msgr2=0x7f19140c44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.757+0000 7f191b400700 1 -- 172.21.15.49:0/2095925928 shutdown_connections 2024-01-22T05:18:33.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.757+0000 7f191b400700 1 -- 172.21.15.49:0/2095925928 wait complete. 2024-01-22T05:18:33.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.761+0000 7f191b400700 1 Processor -- start 2024-01-22T05:18:33.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.761+0000 7f191b400700 1 -- start start 2024-01-22T05:18:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.761+0000 7f191b400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18f40038e0 0x7f19140aca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.761+0000 7f191b400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f191416c810 0x7f19140c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.761+0000 7f191b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19140c2260 0x7f19140c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.761+0000 7f191b400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1914156960 con 0x7f19140c2260 2024-01-22T05:18:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.761+0000 7f191b400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191412df50 con 0x7f191416c810 2024-01-22T05:18:33.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.761+0000 7f191b400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1914156050 con 0x7f18f40038e0 2024-01-22T05:18:33.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.761+0000 7f191aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19140c2260 0x7f19140c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:33.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.761+0000 7f191aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19140c2260 0x7f19140c6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41762/0 (socket says 172.21.15.49:41762) 2024-01-22T05:18:33.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.761+0000 7f191aa00700 1 -- 172.21.15.49:0/3365774298 learned_addr learned my addr 172.21.15.49:0/3365774298 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:33.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.761+0000 7f191a000700 1 --2- 172.21.15.49:0/3365774298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18f40038e0 0x7f19140aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:33.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.761+0000 7f1919600700 1 --2- 172.21.15.49:0/3365774298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f191416c810 0x7f19140c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.761+0000 7f191aa00700 1 -- 172.21.15.49:0/3365774298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18f40038e0 msgr2=0x7f19140aca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.761+0000 7f191aa00700 1 --2- 172.21.15.49:0/3365774298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18f40038e0 0x7f19140aca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.765+0000 7f191aa00700 1 -- 172.21.15.49:0/3365774298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f191416c810 msgr2=0x7f19140c1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.765+0000 7f191aa00700 1 --2- 172.21.15.49:0/3365774298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f191416c810 0x7f19140c1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.765+0000 7f191aa00700 1 -- 172.21.15.49:0/3365774298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19140ad350 con 0x7f19140c2260 2024-01-22T05:18:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.765+0000 7f191aa00700 1 --2- 172.21.15.49:0/3365774298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19140c2260 0x7f19140c6690 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7f1914065ad0 tx=0x7f190c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.765+0000 7f1911600700 1 -- 172.21.15.49:0/3365774298 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c00e040 con 0x7f19140c2260 2024-01-22T05:18:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.765+0000 7f1911600700 1 -- 172.21.15.49:0/3365774298 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c00f040 con 0x7f19140c2260 2024-01-22T05:18:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.765+0000 7f191b400700 1 -- 172.21.15.49:0/3365774298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19141562a0 con 0x7f19140c2260 2024-01-22T05:18:33.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.765+0000 7f1911600700 1 -- 172.21.15.49:0/3365774298 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c00fb80 con 0x7f19140c2260 2024-01-22T05:18:33.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.765+0000 7f191b400700 1 -- 172.21.15.49:0/3365774298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19140acf40 con 0x7f19140c2260 2024-01-22T05:18:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.765+0000 7f191b400700 1 -- 172.21.15.49:0/3365774298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19141593c0 con 0x7f19140c2260 2024-01-22T05:18:33.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.769+0000 7f1911600700 1 -- 172.21.15.49:0/3365774298 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f190c01f460 con 0x7f19140c2260 2024-01-22T05:18:33.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.769+0000 7f1911600700 1 --2- 172.21.15.49:0/3365774298 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f18ec05a510 0x7f18ec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:33.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.769+0000 7f1911600700 1 -- 172.21.15.49:0/3365774298 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f190c075020 con 0x7f19140c2260 2024-01-22T05:18:33.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.769+0000 7f191a000700 1 --2- 172.21.15.49:0/3365774298 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f18ec05a510 0x7f18ec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:33.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.769+0000 7f191a000700 1 --2- 172.21.15.49:0/3365774298 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f18ec05a510 0x7f18ec05c9d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f1904001ed0 tx=0x7f1904015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.773+0000 7f1911600700 1 -- 172.21.15.49:0/3365774298 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f190c048940 con 0x7f19140c2260 2024-01-22T05:18:33.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.941+0000 7f191b400700 1 -- 172.21.15.49:0/3365774298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1914046800 con 0x7f19140c2260 2024-01-22T05:18:33.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.945+0000 7f1911600700 1 -- 172.21.15.49:0/3365774298 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f190c04bf60 con 0x7f19140c2260 2024-01-22T05:18:33.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.953+0000 7f191b400700 1 -- 172.21.15.49:0/3365774298 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f18ec05a510 msgr2=0x7f18ec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:33.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.953+0000 7f191b400700 1 --2- 172.21.15.49:0/3365774298 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f18ec05a510 0x7f18ec05c9d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f1904001ed0 tx=0x7f1904015000).stop 2024-01-22T05:18:33.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.953+0000 7f191b400700 1 -- 172.21.15.49:0/3365774298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19140c2260 msgr2=0x7f19140c6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:33.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.953+0000 7f191b400700 1 --2- 172.21.15.49:0/3365774298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19140c2260 0x7f19140c6690 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7f1914065ad0 tx=0x7f190c00b040).stop 2024-01-22T05:18:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.953+0000 7f191b400700 1 -- 172.21.15.49:0/3365774298 shutdown_connections 2024-01-22T05:18:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.953+0000 7f191b400700 1 --2- 172.21.15.49:0/3365774298 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f18ec05a510 0x7f18ec05c9d0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.953+0000 7f191b400700 1 --2- 172.21.15.49:0/3365774298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19140c2260 0x7f19140c6690 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.953+0000 7f191b400700 1 --2- 172.21.15.49:0/3365774298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f191416c810 0x7f19140c1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.953+0000 7f191b400700 1 --2- 172.21.15.49:0/3365774298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18f40038e0 0x7f19140aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.953+0000 7f191b400700 1 -- 172.21.15.49:0/3365774298 >> 172.21.15.49:0/3365774298 conn(0x7f19140c40e0 msgr2=0x7f191415b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:33.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.953+0000 7f191b400700 1 -- 172.21.15.49:0/3365774298 shutdown_connections 2024-01-22T05:18:33.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:33.953+0000 7f191b400700 1 -- 172.21.15.49:0/3365774298 wait complete. 2024-01-22T05:18:33.979 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:18:33.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:18:34.017 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:18:34.063 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:18:34.063 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-22T05:18:34.063 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:18:34.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.229+0000 7f07cf200700 1 Processor -- start 2024-01-22T05:18:34.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.233+0000 7f07cf200700 1 -- start start 2024-01-22T05:18:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.233+0000 7f07cf200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07d0157e80 0x7f07d00c1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.233+0000 7f07cf200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07d0068aa0 0x7f07d0068f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.233+0000 7f07cf200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d0062eb0 con 0x7f07d015bac0 2024-01-22T05:18:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.233+0000 7f07cf200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d00c2c70 con 0x7f07d0068aa0 2024-01-22T05:18:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.233+0000 7f07cf200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00693f0 con 0x7f07d0157e80 2024-01-22T05:18:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.233+0000 7f07ce800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f07d015bac0 0x7f07d015bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53648/0 (socket says 172.21.15.49:53648) 2024-01-22T05:18:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.233+0000 7f07ce800700 1 -- 172.21.15.49:0/1400984765 learned_addr learned my addr 172.21.15.49:0/1400984765 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.233+0000 7f07cd400700 1 --2- 172.21.15.49:0/1400984765 >> v2:172.21.15.49:3300/0 conn(0x7f07d0068aa0 0x7f07d0068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.233+0000 7f07cde00700 1 --2- 172.21.15.49:0/1400984765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07d0157e80 0x7f07d00c1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.233+0000 7f07cca00700 1 -- 172.21.15.49:0/1400984765 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906067157 0 0) 0x7f07d0062eb0 con 0x7f07d015bac0 2024-01-22T05:18:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.233+0000 7f07cca00700 1 -- 172.21.15.49:0/1400984765 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07b00033f0 con 0x7f07d015bac0 2024-01-22T05:18:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 -- 172.21.15.49:0/1400984765 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3658040906 0 0) 0x7f07b00033f0 con 0x7f07d015bac0 2024-01-22T05:18:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 -- 172.21.15.49:0/1400984765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07d0157e80 msgr2=0x7f07d00c1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 --2- 172.21.15.49:0/1400984765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07d0157e80 0x7f07d00c1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 -- 172.21.15.49:0/1400984765 >> v2:172.21.15.49:3300/0 conn(0x7f07d0068aa0 msgr2=0x7f07d0068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 --2- 172.21.15.49:0/1400984765 >> v2:172.21.15.49:3300/0 conn(0x7f07d0068aa0 0x7f07d0068f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 -- 172.21.15.49:0/1400984765 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d0062b80 con 0x7f07d015bac0 2024-01-22T05:18:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 -- 172.21.15.49:0/1400984765 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f07c80017f0 con 0x7f07d015bac0 2024-01-22T05:18:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cd400700 1 --2- 172.21.15.49:0/1400984765 >> v2:172.21.15.49:3300/0 conn(0x7f07d0068aa0 0x7f07d0068f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 -- 172.21.15.49:0/1400984765 >> v1:172.21.15.49:6789/0 conn(0x7f07d015bac0 legacy=0x7f07d015bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 --2- 172.21.15.49:0/1400984765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07b00038e0 0x7f07b0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 --2- 172.21.15.49:0/1400984765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b0004690 0x7f07b0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 --2- 172.21.15.49:0/1400984765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07d0157e80 0x7f07b0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 -- 172.21.15.49:0/1400984765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00c2c70 con 0x7f07b0004690 2024-01-22T05:18:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 -- 172.21.15.49:0/1400984765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00693f0 con 0x7f07b00038e0 2024-01-22T05:18:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 -- 172.21.15.49:0/1400984765 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b000b8e0 con 0x7f07d0157e80 2024-01-22T05:18:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cd400700 1 --2- 172.21.15.49:0/1400984765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b0004690 0x7f07b0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cde00700 1 --2- 172.21.15.49:0/1400984765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07b00038e0 0x7f07b0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07ce800700 1 --2- 172.21.15.49:0/1400984765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07d0157e80 0x7f07b0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cd400700 1 -- 172.21.15.49:0/1400984765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07d0157e80 msgr2=0x7f07b0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cd400700 1 --2- 172.21.15.49:0/1400984765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07d0157e80 0x7f07b0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cd400700 1 -- 172.21.15.49:0/1400984765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07b00038e0 msgr2=0x7f07b0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cd400700 1 --2- 172.21.15.49:0/1400984765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07b00038e0 0x7f07b0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cd400700 1 -- 172.21.15.49:0/1400984765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b00033f0 con 0x7f07b0004690 2024-01-22T05:18:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07ce800700 1 --2- 172.21.15.49:0/1400984765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07d0157e80 0x7f07b0005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:18:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cd400700 1 --2- 172.21.15.49:0/1400984765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b0004690 0x7f07b0004b10 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f07d015cbd0 tx=0x7f07b8009060).ready entity=mon.0 client_cookie=2274072b5537c75 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 -- 172.21.15.49:0/1400984765 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b80095c0 con 0x7f07b0004690 2024-01-22T05:18:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 -- 172.21.15.49:0/1400984765 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b800e710 con 0x7f07b0004690 2024-01-22T05:18:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cca00700 1 -- 172.21.15.49:0/1400984765 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b800ea90 con 0x7f07b0004690 2024-01-22T05:18:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cf200700 1 -- 172.21.15.49:0/1400984765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b0004690 msgr2=0x7f07b0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07cf200700 1 --2- 172.21.15.49:0/1400984765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b0004690 0x7f07b0004b10 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f07d015cbd0 tx=0x7f07b8009060).stop 2024-01-22T05:18:34.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.237+0000 7f07ce800700 1 -- 172.21.15.49:0/1400984765 reap_dead start 2024-01-22T05:18:34.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.241+0000 7f07cf200700 1 -- 172.21.15.49:0/1400984765 shutdown_connections 2024-01-22T05:18:34.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.241+0000 7f07cf200700 1 -- 172.21.15.49:0/1400984765 >> 172.21.15.49:0/1400984765 conn(0x7f07d00c42c0 msgr2=0x7f07d0065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:34.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.241+0000 7f07cf200700 1 -- 172.21.15.49:0/1400984765 shutdown_connections 2024-01-22T05:18:34.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.241+0000 7f07cf200700 1 -- 172.21.15.49:0/1400984765 wait complete. 2024-01-22T05:18:34.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.241+0000 7f07cf200700 1 Processor -- start 2024-01-22T05:18:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.241+0000 7f07cf200700 1 -- start start 2024-01-22T05:18:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cf200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07b0004690 0x7f07d0140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cf200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07d0168280 0x7f07d0159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cf200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07d01686e0 0x7f07d015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cf200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d015a7d0 con 0x7f07d0168280 2024-01-22T05:18:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cf200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00bf8c0 con 0x7f07b0004690 2024-01-22T05:18:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cf200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00becb0 con 0x7f07d01686e0 2024-01-22T05:18:34.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cd400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07d0168280 0x7f07d0159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:34.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cd400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07d0168280 0x7f07d0159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41800/0 (socket says 172.21.15.49:41800) 2024-01-22T05:18:34.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cd400700 1 -- 172.21.15.49:0/2560025337 learned_addr learned my addr 172.21.15.49:0/2560025337 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:34.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cde00700 1 --2- 172.21.15.49:0/2560025337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07b0004690 0x7f07d0140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:34.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07ce800700 1 --2- 172.21.15.49:0/2560025337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07d01686e0 0x7f07d015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:34.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cd400700 1 -- 172.21.15.49:0/2560025337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07d01686e0 msgr2=0x7f07d015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:34.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cd400700 1 --2- 172.21.15.49:0/2560025337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07d01686e0 0x7f07d015a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:34.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cd400700 1 -- 172.21.15.49:0/2560025337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07b0004690 msgr2=0x7f07d0140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:34.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cd400700 1 --2- 172.21.15.49:0/2560025337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07b0004690 0x7f07d0140af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:34.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cd400700 1 -- 172.21.15.49:0/2560025337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00bef90 con 0x7f07d0168280 2024-01-22T05:18:34.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cde00700 1 --2- 172.21.15.49:0/2560025337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07b0004690 0x7f07d0140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:34.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cd400700 1 --2- 172.21.15.49:0/2560025337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07d0168280 0x7f07d0159df0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f07b0004480 tx=0x7f07b8019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:34.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07c5600700 1 -- 172.21.15.49:0/2560025337 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b800e880 con 0x7f07d0168280 2024-01-22T05:18:34.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07c5600700 1 -- 172.21.15.49:0/2560025337 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b800e9e0 con 0x7f07d0168280 2024-01-22T05:18:34.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cf200700 1 -- 172.21.15.49:0/2560025337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d00bf270 con 0x7f07d0168280 2024-01-22T05:18:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07c5600700 1 -- 172.21.15.49:0/2560025337 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b801b6a0 con 0x7f07d0168280 2024-01-22T05:18:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.245+0000 7f07cf200700 1 -- 172.21.15.49:0/2560025337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d00bdf60 con 0x7f07d0168280 2024-01-22T05:18:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.249+0000 7f07cf200700 1 -- 172.21.15.49:0/2560025337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d00bf6f0 con 0x7f07d0168280 2024-01-22T05:18:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.249+0000 7f07c5600700 1 -- 172.21.15.49:0/2560025337 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f07b801ba90 con 0x7f07d0168280 2024-01-22T05:18:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.249+0000 7f07c5600700 1 --2- 172.21.15.49:0/2560025337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07a805a510 0x7f07a805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.249+0000 7f07c5600700 1 -- 172.21.15.49:0/2560025337 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f07b8076370 con 0x7f07d0168280 2024-01-22T05:18:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.249+0000 7f07cde00700 1 --2- 172.21.15.49:0/2560025337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07a805a510 0x7f07a805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.253+0000 7f07cde00700 1 --2- 172.21.15.49:0/2560025337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07a805a510 0x7f07a805c9d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f07c0006be0 tx=0x7f07c0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:34.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.257+0000 7f07c5600700 1 -- 172.21.15.49:0/2560025337 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f07b8049d30 con 0x7f07d0168280 2024-01-22T05:18:34.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.461+0000 7f07cf200700 1 -- 172.21.15.49:0/2560025337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07d00bfa00 con 0x7f07d0168280 2024-01-22T05:18:34.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.461+0000 7f07c5600700 1 -- 172.21.15.49:0/2560025337 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+3540 (secure 0 0 0) 0x7f07b802b070 con 0x7f07d0168280 2024-01-22T05:18:34.466 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:34.466 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":128,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3010799828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3010799828},{"type":"v1","addr":"172.21.15.110:6833","nonce":3010799828}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":7940,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2071707351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2071707351},{"type":"v1","addr":"172.21.15.110:6835","nonce":2071707351}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":9309,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3579312059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3579312059},{"type":"v1","addr":"172.21.15.49:6835","nonce":3579312059}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":9672,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1060317477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1060317477},{"type":"v1","addr":"172.21.15.49:6837","nonce":1060317477}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128}],"filesystems":[]} 2024-01-22T05:18:34.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.465+0000 7f07cf200700 1 -- 172.21.15.49:0/2560025337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07a805a510 msgr2=0x7f07a805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:34.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.465+0000 7f07cf200700 1 --2- 172.21.15.49:0/2560025337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07a805a510 0x7f07a805c9d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f07c0006be0 tx=0x7f07c0008040).stop 2024-01-22T05:18:34.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.465+0000 7f07cf200700 1 -- 172.21.15.49:0/2560025337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07d0168280 msgr2=0x7f07d0159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:34.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.465+0000 7f07cf200700 1 --2- 172.21.15.49:0/2560025337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07d0168280 0x7f07d0159df0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f07b0004480 tx=0x7f07b8019000).stop 2024-01-22T05:18:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.465+0000 7f07cf200700 1 -- 172.21.15.49:0/2560025337 shutdown_connections 2024-01-22T05:18:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.465+0000 7f07cf200700 1 --2- 172.21.15.49:0/2560025337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f07a805a510 0x7f07a805c9d0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.465+0000 7f07cf200700 1 --2- 172.21.15.49:0/2560025337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07d01686e0 0x7f07d015a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.465+0000 7f07cf200700 1 --2- 172.21.15.49:0/2560025337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07d0168280 0x7f07d0159df0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.465+0000 7f07cf200700 1 --2- 172.21.15.49:0/2560025337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07b0004690 0x7f07d0140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.465+0000 7f07cf200700 1 -- 172.21.15.49:0/2560025337 >> 172.21.15.49:0/2560025337 conn(0x7f07d00c42c0 msgr2=0x7f07d00c62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:34.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.465+0000 7f07cf200700 1 -- 172.21.15.49:0/2560025337 shutdown_connections 2024-01-22T05:18:34.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.465+0000 7f07cf200700 1 -- 172.21.15.49:0/2560025337 wait complete. 2024-01-22T05:18:34.473 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 128 2024-01-22T05:18:34.494 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:18:34.494 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-22T05:18:34.495 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:18:34.495 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:18:34.495 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:18:34.495 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-22T05:18:34.495 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:18:34.495 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:18:34.495 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:18:34.496 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-22T05:18:34.496 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:18:34.496 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:18:34.496 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:18:34.496 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-22T05:18:34.496 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:18:34.496 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:18:34.516 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:18:34.516 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:18:34.518 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:18:34.518 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:18:34.519 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:18:34.519 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:18:34.521 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:18:34.521 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:18:34.566 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:18:34.567 DEBUG:teuthology.parallel:result is None 2024-01-22T05:18:34.570 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:18:34.571 DEBUG:teuthology.parallel:result is None 2024-01-22T05:18:34.571 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:18:34.572 DEBUG:teuthology.parallel:result is None 2024-01-22T05:18:34.574 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:18:34.574 DEBUG:teuthology.parallel:result is None 2024-01-22T05:18:34.575 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-22T05:18:34.675 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-22T05:18:34.676 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:18:34.676 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:18:34.686 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:18:34.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.741+0000 7f578c800700 1 Processor -- start 2024-01-22T05:18:34.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.741+0000 7f578c800700 1 -- start start 2024-01-22T05:18:34.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f578c800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57840644f0 0x7f5784064950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:34.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f578c800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f57840bcc80 0x7f57840bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:34.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f578c800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57840c2700 con 0x7f5784065660 2024-01-22T05:18:34.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f578c800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57840a7650 con 0x7f57840bcc80 2024-01-22T05:18:34.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f578c800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5784064e40 con 0x7f57840644f0 2024-01-22T05:18:34.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f578b200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f57840bcc80 0x7f57840bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:34.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f578b200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f57840bcc80 0x7f57840bd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41850/0 (socket says 172.21.15.49:41850) 2024-01-22T05:18:34.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f578b200700 1 -- 172.21.15.49:0/703872489 learned_addr learned my addr 172.21.15.49:0/703872489 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:34.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f5789e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5784065660 0x7f57840a6f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53678/0 (socket says 172.21.15.49:53678) 2024-01-22T05:18:34.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f5789400700 1 --2- 172.21.15.49:0/703872489 >> v2:172.21.15.110:3300/0 conn(0x7f57840644f0 0x7f5784064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:34.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f578b200700 1 -- 172.21.15.49:0/703872489 >> v2:172.21.15.110:3300/0 conn(0x7f57840644f0 msgr2=0x7f5784064950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:34.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f578b200700 1 --2- 172.21.15.49:0/703872489 >> v2:172.21.15.110:3300/0 conn(0x7f57840644f0 0x7f5784064950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:34.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f578b200700 1 -- 172.21.15.49:0/703872489 >> v1:172.21.15.49:6789/0 conn(0x7f5784065660 legacy=0x7f57840a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:34.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f578b200700 1 -- 172.21.15.49:0/703872489 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57840c2930 con 0x7f57840bcc80 2024-01-22T05:18:34.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f5788a00700 1 -- 172.21.15.49:0/703872489 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710407354 0 0) 0x7f57840c2700 con 0x7f5784065660 2024-01-22T05:18:34.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f5789400700 1 --2- 172.21.15.49:0/703872489 >> v2:172.21.15.110:3300/0 conn(0x7f57840644f0 0x7f5784064950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:34.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.745+0000 7f578b200700 1 --2- 172.21.15.49:0/703872489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57840bcc80 0x7f57840bd110 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f5784065d80 tx=0x7f577c009840).ready entity=mon.0 client_cookie=a212f2858b971e87 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:34.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.749+0000 7f5788a00700 1 -- 172.21.15.49:0/703872489 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c00e070 con 0x7f57840bcc80 2024-01-22T05:18:34.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.749+0000 7f5788a00700 1 -- 172.21.15.49:0/703872489 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c00ba20 con 0x7f57840bcc80 2024-01-22T05:18:34.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.749+0000 7f5788a00700 1 -- 172.21.15.49:0/703872489 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c00bda0 con 0x7f57840bcc80 2024-01-22T05:18:34.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.749+0000 7f578c800700 1 -- 172.21.15.49:0/703872489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57840bcc80 msgr2=0x7f57840bd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:34.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.749+0000 7f578c800700 1 --2- 172.21.15.49:0/703872489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57840bcc80 0x7f57840bd110 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f5784065d80 tx=0x7f577c009840).stop 2024-01-22T05:18:34.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.749+0000 7f578c800700 1 -- 172.21.15.49:0/703872489 shutdown_connections 2024-01-22T05:18:34.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.749+0000 7f578c800700 1 --2- 172.21.15.49:0/703872489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57840bcc80 0x7f57840bd110 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:34.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.749+0000 7f578c800700 1 --2- 172.21.15.49:0/703872489 >> v2:172.21.15.110:3300/0 conn(0x7f57840644f0 0x7f5784064950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:34.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.749+0000 7f578c800700 1 -- 172.21.15.49:0/703872489 >> 172.21.15.49:0/703872489 conn(0x7f57840c87f0 msgr2=0x7f57840c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:34.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.749+0000 7f578c800700 1 -- 172.21.15.49:0/703872489 shutdown_connections 2024-01-22T05:18:34.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.749+0000 7f578c800700 1 -- 172.21.15.49:0/703872489 wait complete. 2024-01-22T05:18:34.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.753+0000 7f578c800700 1 Processor -- start 2024-01-22T05:18:34.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.753+0000 7f578c800700 1 -- start start 2024-01-22T05:18:34.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f578c800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57840644f0 0x7f5784167e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:34.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f578c800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5784065660 0x7f57840a9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:34.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f578c800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57840bcc80 0x7f5784163d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:34.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f578c800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57840aacd0 con 0x7f5784065660 2024-01-22T05:18:34.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f578c800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57840ab810 con 0x7f57840bcc80 2024-01-22T05:18:34.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f578c800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57840a9560 con 0x7f57840644f0 2024-01-22T05:18:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f5789400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5784065660 0x7f57840a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f5789400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5784065660 0x7f57840a9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41852/0 (socket says 172.21.15.49:41852) 2024-01-22T05:18:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f5789400700 1 -- 172.21.15.49:0/647322546 learned_addr learned my addr 172.21.15.49:0/647322546 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f578b200700 1 --2- 172.21.15.49:0/647322546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57840bcc80 0x7f5784163d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f5789e00700 1 --2- 172.21.15.49:0/647322546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57840644f0 0x7f5784167e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f5789400700 1 -- 172.21.15.49:0/647322546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57840644f0 msgr2=0x7f5784167e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f5789400700 1 --2- 172.21.15.49:0/647322546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57840644f0 0x7f5784167e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:34.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f5789400700 1 -- 172.21.15.49:0/647322546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57840bcc80 msgr2=0x7f5784163d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:34.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f5789400700 1 --2- 172.21.15.49:0/647322546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57840bcc80 0x7f5784163d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:34.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f5789400700 1 -- 172.21.15.49:0/647322546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c0092a0 con 0x7f5784065660 2024-01-22T05:18:34.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f5789400700 1 --2- 172.21.15.49:0/647322546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5784065660 0x7f57840a9070 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7f576c00ea20 tx=0x7f576c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:34.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f5781600700 1 -- 172.21.15.49:0/647322546 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00ee60 con 0x7f5784065660 2024-01-22T05:18:34.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f5781600700 1 -- 172.21.15.49:0/647322546 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c00c850 con 0x7f5784065660 2024-01-22T05:18:34.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f578c800700 1 -- 172.21.15.49:0/647322546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577c009ae0 con 0x7f5784065660 2024-01-22T05:18:34.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.757+0000 7f5781600700 1 -- 172.21.15.49:0/647322546 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00cbd0 con 0x7f5784065660 2024-01-22T05:18:34.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.761+0000 7f578c800700 1 -- 172.21.15.49:0/647322546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57840ab1c0 con 0x7f5784065660 2024-01-22T05:18:34.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.761+0000 7f578c800700 1 -- 172.21.15.49:0/647322546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57840ab9a0 con 0x7f5784065660 2024-01-22T05:18:34.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.761+0000 7f5781600700 1 -- 172.21.15.49:0/647322546 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f576c01b400 con 0x7f5784065660 2024-01-22T05:18:34.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.765+0000 7f5781600700 1 --2- 172.21.15.49:0/647322546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f575c05a510 0x7f575c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:34.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.765+0000 7f5781600700 1 -- 172.21.15.49:0/647322546 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f576c074ba0 con 0x7f5784065660 2024-01-22T05:18:34.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.765+0000 7f5789e00700 1 --2- 172.21.15.49:0/647322546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f575c05a510 0x7f575c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:34.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.765+0000 7f5789e00700 1 --2- 172.21.15.49:0/647322546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f575c05a510 0x7f575c05c9d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f57740011e0 tx=0x7f5774007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:34.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.769+0000 7f5781600700 1 -- 172.21.15.49:0/647322546 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f576c048400 con 0x7f5784065660 2024-01-22T05:18:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:34.953+0000 7f578c800700 1 -- 172.21.15.49:0/647322546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5784047060 con 0x7f5784065660 2024-01-22T05:18:35.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.725+0000 7f5781600700 1 -- 172.21.15.49:0/647322546 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v168) v1 ==== 97+0+0 (secure 0 0 0) 0x7f576c04ba20 con 0x7f5784065660 2024-01-22T05:18:35.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.729+0000 7f578c800700 1 -- 172.21.15.49:0/647322546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f575c05a510 msgr2=0x7f575c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:35.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.729+0000 7f578c800700 1 --2- 172.21.15.49:0/647322546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f575c05a510 0x7f575c05c9d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f57740011e0 tx=0x7f5774007bd0).stop 2024-01-22T05:18:35.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.729+0000 7f578c800700 1 -- 172.21.15.49:0/647322546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5784065660 msgr2=0x7f57840a9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:35.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.729+0000 7f578c800700 1 --2- 172.21.15.49:0/647322546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5784065660 0x7f57840a9070 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7f576c00ea20 tx=0x7f576c009060).stop 2024-01-22T05:18:35.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.729+0000 7f578c800700 1 -- 172.21.15.49:0/647322546 shutdown_connections 2024-01-22T05:18:35.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.729+0000 7f578c800700 1 --2- 172.21.15.49:0/647322546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f575c05a510 0x7f575c05c9d0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:35.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.729+0000 7f578c800700 1 --2- 172.21.15.49:0/647322546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57840bcc80 0x7f5784163d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:35.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.729+0000 7f578c800700 1 --2- 172.21.15.49:0/647322546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5784065660 0x7f57840a9070 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:35.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.729+0000 7f578c800700 1 --2- 172.21.15.49:0/647322546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57840644f0 0x7f5784167e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:35.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.729+0000 7f578c800700 1 -- 172.21.15.49:0/647322546 >> 172.21.15.49:0/647322546 conn(0x7f57840c87f0 msgr2=0x7f57840c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:35.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.729+0000 7f578c800700 1 -- 172.21.15.49:0/647322546 shutdown_connections 2024-01-22T05:18:35.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.729+0000 7f578c800700 1 -- 172.21.15.49:0/647322546 wait complete. 2024-01-22T05:18:35.735 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-01-22T05:18:35.756 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-22T05:18:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.917+0000 7ff994a00700 1 Processor -- start 2024-01-22T05:18:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff994a00700 1 -- start start 2024-01-22T05:18:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff994a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff98c0bcfa0 0x7ff98c151700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff994a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff98c151bf0 0x7ff98c0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff994a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff98c0abd80 0x7ff98c1555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff994a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98c0bb790 con 0x7ff98c0abd80 2024-01-22T05:18:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff994a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98c068a60 con 0x7ff98c151bf0 2024-01-22T05:18:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff994a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0bd380 con 0x7ff98c0bcfa0 2024-01-22T05:18:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff992a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff98c0abd80 0x7ff98c1555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff992a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff98c0abd80 0x7ff98c1555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41854/0 (socket says 172.21.15.49:41854) 2024-01-22T05:18:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff992a00700 1 -- 172.21.15.49:0/2354703330 learned_addr learned my addr 172.21.15.49:0/2354703330 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff992000700 1 --2- 172.21.15.49:0/2354703330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff98c0bcfa0 0x7ff98c151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff991600700 1 --2- 172.21.15.49:0/2354703330 >> v2:172.21.15.110:3300/0 conn(0x7ff98c151bf0 0x7ff98c0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff992a00700 1 -- 172.21.15.49:0/2354703330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff98c0bcfa0 msgr2=0x7ff98c151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff992a00700 1 --2- 172.21.15.49:0/2354703330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff98c0bcfa0 0x7ff98c151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff992a00700 1 -- 172.21.15.49:0/2354703330 >> v2:172.21.15.110:3300/0 conn(0x7ff98c151bf0 msgr2=0x7ff98c0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff992a00700 1 --2- 172.21.15.49:0/2354703330 >> v2:172.21.15.110:3300/0 conn(0x7ff98c151bf0 0x7ff98c0ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.921+0000 7ff992a00700 1 -- 172.21.15.49:0/2354703330 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c0ac210 con 0x7ff98c0abd80 2024-01-22T05:18:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.925+0000 7ff992a00700 1 --2- 172.21.15.49:0/2354703330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c0abd80 0x7ff98c1555c0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7ff98c0c4340 tx=0x7ff984009840).ready entity=mon.0 client_cookie=dd447487fd6ebac4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.925+0000 7ff990c00700 1 -- 172.21.15.49:0/2354703330 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98400e070 con 0x7ff98c0abd80 2024-01-22T05:18:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.925+0000 7ff990c00700 1 -- 172.21.15.49:0/2354703330 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98400b970 con 0x7ff98c0abd80 2024-01-22T05:18:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.925+0000 7ff990c00700 1 -- 172.21.15.49:0/2354703330 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98400bcf0 con 0x7ff98c0abd80 2024-01-22T05:18:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.925+0000 7ff994a00700 1 -- 172.21.15.49:0/2354703330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c0abd80 msgr2=0x7ff98c1555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.925+0000 7ff994a00700 1 --2- 172.21.15.49:0/2354703330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c0abd80 0x7ff98c1555c0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7ff98c0c4340 tx=0x7ff984009840).stop 2024-01-22T05:18:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.925+0000 7ff994a00700 1 -- 172.21.15.49:0/2354703330 shutdown_connections 2024-01-22T05:18:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.925+0000 7ff994a00700 1 --2- 172.21.15.49:0/2354703330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c0abd80 0x7ff98c1555c0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.925+0000 7ff994a00700 1 --2- 172.21.15.49:0/2354703330 >> v2:172.21.15.110:3300/0 conn(0x7ff98c151bf0 0x7ff98c0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.925+0000 7ff994a00700 1 --2- 172.21.15.49:0/2354703330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff98c0bcfa0 0x7ff98c151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:35.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.925+0000 7ff994a00700 1 -- 172.21.15.49:0/2354703330 >> 172.21.15.49:0/2354703330 conn(0x7ff98c0c6540 msgr2=0x7ff98c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:35.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.925+0000 7ff994a00700 1 -- 172.21.15.49:0/2354703330 shutdown_connections 2024-01-22T05:18:35.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.925+0000 7ff994a00700 1 -- 172.21.15.49:0/2354703330 wait complete. 2024-01-22T05:18:35.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.929+0000 7ff994a00700 1 Processor -- start 2024-01-22T05:18:35.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.929+0000 7ff994a00700 1 -- start start 2024-01-22T05:18:35.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.929+0000 7ff994a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff98c0abd80 0x7ff98c1485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:35.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.929+0000 7ff994a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff98c0bcfa0 0x7ff98c0c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:35.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.929+0000 7ff994a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c151bf0 0x7ff98c0c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:35.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.929+0000 7ff994a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0c3920 con 0x7ff98c151bf0 2024-01-22T05:18:35.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.929+0000 7ff994a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0a6de0 con 0x7ff98c0abd80 2024-01-22T05:18:35.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.929+0000 7ff994a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0a61d0 con 0x7ff98c0bcfa0 2024-01-22T05:18:35.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.929+0000 7ff992a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c151bf0 0x7ff98c0c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:35.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.929+0000 7ff992a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c151bf0 0x7ff98c0c3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41864/0 (socket says 172.21.15.49:41864) 2024-01-22T05:18:35.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.929+0000 7ff992a00700 1 -- 172.21.15.49:0/1631858098 learned_addr learned my addr 172.21.15.49:0/1631858098 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:35.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.933+0000 7ff991600700 1 --2- 172.21.15.49:0/1631858098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff98c0bcfa0 0x7ff98c0c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:35.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.933+0000 7ff992000700 1 --2- 172.21.15.49:0/1631858098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff98c0abd80 0x7ff98c1485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:35.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.933+0000 7ff992a00700 1 -- 172.21.15.49:0/1631858098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff98c0bcfa0 msgr2=0x7ff98c0c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:35.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.933+0000 7ff992a00700 1 --2- 172.21.15.49:0/1631858098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff98c0bcfa0 0x7ff98c0c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:35.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.933+0000 7ff992a00700 1 -- 172.21.15.49:0/1631858098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff98c0abd80 msgr2=0x7ff98c1485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:35.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.933+0000 7ff992a00700 1 --2- 172.21.15.49:0/1631858098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff98c0abd80 0x7ff98c1485a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:35.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.933+0000 7ff992a00700 1 -- 172.21.15.49:0/1631858098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff984009ae0 con 0x7ff98c151bf0 2024-01-22T05:18:35.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.933+0000 7ff992000700 1 --2- 172.21.15.49:0/1631858098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff98c0abd80 0x7ff98c1485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:35.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.933+0000 7ff992a00700 1 --2- 172.21.15.49:0/1631858098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c151bf0 0x7ff98c0c3430 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7ff98400b610 tx=0x7ff98c0689d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:35.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.933+0000 7ff989600700 1 -- 172.21.15.49:0/1631858098 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98400bee0 con 0x7ff98c151bf0 2024-01-22T05:18:35.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.933+0000 7ff989600700 1 -- 172.21.15.49:0/1631858098 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff984007080 con 0x7ff98c151bf0 2024-01-22T05:18:35.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.933+0000 7ff994a00700 1 -- 172.21.15.49:0/1631858098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98c0a64b0 con 0x7ff98c151bf0 2024-01-22T05:18:35.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.933+0000 7ff989600700 1 -- 172.21.15.49:0/1631858098 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98401e6c0 con 0x7ff98c151bf0 2024-01-22T05:18:35.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.933+0000 7ff994a00700 1 -- 172.21.15.49:0/1631858098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98c0a6a70 con 0x7ff98c151bf0 2024-01-22T05:18:35.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.933+0000 7ff994a00700 1 -- 172.21.15.49:0/1631858098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98c0a6f50 con 0x7ff98c151bf0 2024-01-22T05:18:35.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.937+0000 7ff989600700 1 -- 172.21.15.49:0/1631858098 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff984003040 con 0x7ff98c151bf0 2024-01-22T05:18:35.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.937+0000 7ff989600700 1 --2- 172.21.15.49:0/1631858098 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff96405a540 0x7ff96405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:35.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.937+0000 7ff989600700 1 -- 172.21.15.49:0/1631858098 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5622+0+0 (secure 0 0 0) 0x7ff9840758a0 con 0x7ff98c151bf0 2024-01-22T05:18:35.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.937+0000 7ff992000700 1 --2- 172.21.15.49:0/1631858098 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff96405a540 0x7ff96405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:35.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.937+0000 7ff992000700 1 --2- 172.21.15.49:0/1631858098 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff96405a540 0x7ff96405ca00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7ff97c009c00 tx=0x7ff97c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:35.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:35.945+0000 7ff989600700 1 -- 172.21.15.49:0/1631858098 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff984049260 con 0x7ff98c151bf0 2024-01-22T05:18:36.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.165+0000 7ff994a00700 1 -- 172.21.15.49:0/1631858098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff98c046800 con 0x7ff98c151bf0 2024-01-22T05:18:36.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.165+0000 7ff989600700 1 -- 172.21.15.49:0/1631858098 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff984023030 con 0x7ff98c151bf0 2024-01-22T05:18:36.168 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:36.168 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:18:36.169 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-01-22T05:18:36.169 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.169 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-01-22T05:18:36.169 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lTCfoJxAAxDGvXKXgooA9/f0J70s6AA==", 2024-01-22T05:18:36.169 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.169 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:18:36.169 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:18:36.169 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:18:36.169 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:18:36.169 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.169 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.169 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.170 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-01-22T05:18:36.170 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lHqV6ORAA1DwpPV2PyDBF/6/ePTdQJw==", 2024-01-22T05:18:36.170 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.170 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:18:36.170 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:18:36.170 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:18:36.170 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:18:36.170 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.170 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.170 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.170 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-01-22T05:18:36.170 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lPo86MhAAonfC3M+AkLldljODYNGzyA==", 2024-01-22T05:18:36.171 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.171 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:18:36.171 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:18:36.171 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:18:36.171 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:18:36.171 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.171 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.171 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.171 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-01-22T05:18:36.171 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lLwvMBxAAFm52HWeGbTH1gbWVm6r5zQ==", 2024-01-22T05:18:36.171 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.171 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:18:36.172 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:18:36.172 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:18:36.172 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:18:36.172 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.172 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.172 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.172 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-01-22T05:18:36.172 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAt961lH2F9NBAAHm8R9/Q5IuFUvb0o1GyD4Q==", 2024-01-22T05:18:36.172 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.172 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:18:36.172 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:18:36.172 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:18:36.173 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.173 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.173 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.173 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-01-22T05:18:36.173 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAx961lS1lEIhAAuDm2OYfTYff1kVEq5vXvFw==", 2024-01-22T05:18:36.173 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.173 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:18:36.173 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:18:36.173 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:18:36.173 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.173 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.173 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.174 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-01-22T05:18:36.174 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA1961limLvERAAv23crKrwjLIg84u48BHHbg==", 2024-01-22T05:18:36.174 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.174 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:18:36.174 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:18:36.174 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:18:36.174 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.174 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.174 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.174 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2024-01-22T05:18:36.174 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA5961lShJiABAAnvyhz0ggDaITaMgwzi9kAA==", 2024-01-22T05:18:36.174 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.175 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:18:36.175 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:18:36.175 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:18:36.175 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.175 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.175 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.175 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2024-01-22T05:18:36.175 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA9961lcopfNRAAAZgHzI1t7YHI5cAjaCMiNw==", 2024-01-22T05:18:36.175 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.175 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:18:36.175 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:18:36.175 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:18:36.175 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.176 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.176 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.176 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2024-01-22T05:18:36.176 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBB961lX+nTIxAAtP3YQypuFWM5O/LADjvybA==", 2024-01-22T05:18:36.176 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.176 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:18:36.176 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:18:36.176 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:18:36.176 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.176 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.176 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.176 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2024-01-22T05:18:36.176 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBF961lQ4/XERAARZPqENsV3jokk2g3OXUI5w==", 2024-01-22T05:18:36.177 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.177 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:18:36.177 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:18:36.177 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:18:36.177 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.177 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.177 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.177 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2024-01-22T05:18:36.177 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBI961luxnqOhAAGsV74DKQda5cetNA/woOnA==", 2024-01-22T05:18:36.177 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.177 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:18:36.177 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:18:36.177 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:18:36.178 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.178 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.178 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.178 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-01-22T05:18:36.178 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lmrM6DhAAYU09HviWyrUIz4lio15wFw==", 2024-01-22T05:18:36.178 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.178 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:18:36.178 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-01-22T05:18:36.178 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-22T05:18:36.178 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.178 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.178 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.178 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-01-22T05:18:36.179 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lIhYRGRAAFG+YtkDLFsra6zU44xKCHw==", 2024-01-22T05:18:36.179 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.179 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:18:36.179 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:18:36.179 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:18:36.179 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:18:36.179 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.179 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.179 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.179 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2024-01-22T05:18:36.179 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lRuyaExAAQO3a7ahOEcuE+WVfXYEBTg==", 2024-01-22T05:18:36.179 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.180 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:18:36.180 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:18:36.180 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:18:36.180 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:18:36.180 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.180 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.180 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.180 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2024-01-22T05:18:36.180 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lMiMkHhAAxPdKpcHdtqSphbc/2agq9Q==", 2024-01-22T05:18:36.180 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.180 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:18:36.180 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:18:36.181 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:18:36.181 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:18:36.181 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.181 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.181 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.181 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-01-22T05:18:36.181 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961ljsweARAAJrY3z/sBjayjB2BRQNrJew==", 2024-01-22T05:18:36.181 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.181 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:18:36.181 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:18:36.181 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:18:36.181 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:18:36.181 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.182 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.182 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.182 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-01-22T05:18:36.182 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961l0DwDIhAAeuCu79LxNMEJvWiW/BfDhA==", 2024-01-22T05:18:36.182 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.182 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:18:36.182 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:18:36.182 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:18:36.182 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.182 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:36.182 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:36.182 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2024-01-22T05:18:36.182 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lZlmPGxAA1KVZR+XzNdoFVo/980hD8w==", 2024-01-22T05:18:36.183 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:18:36.183 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:18:36.183 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:18:36.183 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:18:36.183 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.183 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:36.183 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-01-22T05:18:36.183 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:18:36.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.169+0000 7ff994a00700 1 -- 172.21.15.49:0/1631858098 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff96405a540 msgr2=0x7ff96405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:36.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.169+0000 7ff994a00700 1 --2- 172.21.15.49:0/1631858098 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff96405a540 0x7ff96405ca00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7ff97c009c00 tx=0x7ff97c008040).stop 2024-01-22T05:18:36.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.169+0000 7ff994a00700 1 -- 172.21.15.49:0/1631858098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c151bf0 msgr2=0x7ff98c0c3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:36.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.169+0000 7ff994a00700 1 --2- 172.21.15.49:0/1631858098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c151bf0 0x7ff98c0c3430 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7ff98400b610 tx=0x7ff98c0689d0).stop 2024-01-22T05:18:36.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.169+0000 7ff994a00700 1 -- 172.21.15.49:0/1631858098 shutdown_connections 2024-01-22T05:18:36.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.169+0000 7ff994a00700 1 --2- 172.21.15.49:0/1631858098 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff96405a540 0x7ff96405ca00 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.169+0000 7ff994a00700 1 --2- 172.21.15.49:0/1631858098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c151bf0 0x7ff98c0c3430 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.169+0000 7ff994a00700 1 --2- 172.21.15.49:0/1631858098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff98c0bcfa0 0x7ff98c0c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.169+0000 7ff994a00700 1 --2- 172.21.15.49:0/1631858098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff98c0abd80 0x7ff98c1485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.169+0000 7ff994a00700 1 -- 172.21.15.49:0/1631858098 >> 172.21.15.49:0/1631858098 conn(0x7ff98c0c6540 msgr2=0x7ff98c0a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:36.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.169+0000 7ff994a00700 1 -- 172.21.15.49:0/1631858098 shutdown_connections 2024-01-22T05:18:36.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.169+0000 7ff994a00700 1 -- 172.21.15.49:0/1631858098 wait complete. 2024-01-22T05:18:36.196 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:18:36.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.353+0000 7f1b1d200700 1 Processor -- start 2024-01-22T05:18:36.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b1d200700 1 -- start start 2024-01-22T05:18:36.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b1d200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b18157e50 0x7f1b180bcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:36.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b1d200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1b180be170 0x7f1b18069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:36.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b1d200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b18068b40 con 0x7f1b18158230 2024-01-22T05:18:36.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b1d200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b18068e20 con 0x7f1b180be170 2024-01-22T05:18:36.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b1d200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b18069100 con 0x7f1b18157e50 2024-01-22T05:18:36.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b15400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1b18158230 0x7f1b180bda60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53680/0 (socket says 172.21.15.49:53680) 2024-01-22T05:18:36.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b15400700 1 -- 172.21.15.49:0/514498490 learned_addr learned my addr 172.21.15.49:0/514498490 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:36.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b16800700 1 --2- 172.21.15.49:0/514498490 >> v2:172.21.15.110:3300/0 conn(0x7f1b180be170 0x7f1b18069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:36.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b15e00700 1 --2- 172.21.15.49:0/514498490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b18157e50 0x7f1b180bcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:36.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b14a00700 1 -- 172.21.15.49:0/514498490 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850019411 0 0) 0x7f1b18068b40 con 0x7f1b18158230 2024-01-22T05:18:36.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b14a00700 1 -- 172.21.15.49:0/514498490 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1af80033f0 con 0x7f1b18158230 2024-01-22T05:18:36.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b16800700 1 -- 172.21.15.49:0/514498490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b18157e50 msgr2=0x7f1b180bcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:36.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b16800700 1 --2- 172.21.15.49:0/514498490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b18157e50 0x7f1b180bcf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b16800700 1 -- 172.21.15.49:0/514498490 >> v1:172.21.15.49:6789/0 conn(0x7f1b18158230 legacy=0x7f1b180bda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:36.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.357+0000 7f1b16800700 1 -- 172.21.15.49:0/514498490 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b180693e0 con 0x7f1b180be170 2024-01-22T05:18:36.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.361+0000 7f1b16800700 1 --2- 172.21.15.49:0/514498490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b180be170 0x7f1b18069900 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f1b10009e60 tx=0x7f1b10009780).ready entity=mon.1 client_cookie=a2d1fb1b04341b02 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:36.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.361+0000 7f1b14a00700 1 -- 172.21.15.49:0/514498490 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1000e070 con 0x7f1b180be170 2024-01-22T05:18:36.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.361+0000 7f1b14a00700 1 -- 172.21.15.49:0/514498490 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1000bab0 con 0x7f1b180be170 2024-01-22T05:18:36.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.361+0000 7f1b14a00700 1 -- 172.21.15.49:0/514498490 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1000be30 con 0x7f1b180be170 2024-01-22T05:18:36.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.361+0000 7f1b1d200700 1 -- 172.21.15.49:0/514498490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b180be170 msgr2=0x7f1b18069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:36.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.361+0000 7f1b1d200700 1 --2- 172.21.15.49:0/514498490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b180be170 0x7f1b18069900 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f1b10009e60 tx=0x7f1b10009780).stop 2024-01-22T05:18:36.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.361+0000 7f1b1d200700 1 -- 172.21.15.49:0/514498490 shutdown_connections 2024-01-22T05:18:36.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.361+0000 7f1b1d200700 1 --2- 172.21.15.49:0/514498490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b180be170 0x7f1b18069900 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.361+0000 7f1b1d200700 1 --2- 172.21.15.49:0/514498490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b18157e50 0x7f1b180bcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.361+0000 7f1b1d200700 1 -- 172.21.15.49:0/514498490 >> 172.21.15.49:0/514498490 conn(0x7f1b18066830 msgr2=0x7f1b18066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:36.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.361+0000 7f1b1d200700 1 -- 172.21.15.49:0/514498490 shutdown_connections 2024-01-22T05:18:36.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.361+0000 7f1b1d200700 1 -- 172.21.15.49:0/514498490 wait complete. 2024-01-22T05:18:36.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.365+0000 7f1b1d200700 1 Processor -- start 2024-01-22T05:18:36.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.365+0000 7f1b1d200700 1 -- start start 2024-01-22T05:18:36.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.365+0000 7f1b1d200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b180be170 0x7f1b18151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:36.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.365+0000 7f1b1d200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b18157e50 0x7f1b1815adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:36.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.365+0000 7f1b1d200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b18158230 0x7f1b180be6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:36.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.365+0000 7f1b1d200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b18151c50 con 0x7f1b180be170 2024-01-22T05:18:36.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.365+0000 7f1b1d200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1816ba10 con 0x7f1b18158230 2024-01-22T05:18:36.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.365+0000 7f1b1d200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b18159e10 con 0x7f1b18157e50 2024-01-22T05:18:36.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b15e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b180be170 0x7f1b18151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:36.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b15e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b180be170 0x7f1b18151760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41868/0 (socket says 172.21.15.49:41868) 2024-01-22T05:18:36.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b15e00700 1 -- 172.21.15.49:0/3231662637 learned_addr learned my addr 172.21.15.49:0/3231662637 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:36.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b16800700 1 --2- 172.21.15.49:0/3231662637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b18158230 0x7f1b180be6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:36.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b15400700 1 --2- 172.21.15.49:0/3231662637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b18157e50 0x7f1b1815adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:36.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b15e00700 1 -- 172.21.15.49:0/3231662637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b18157e50 msgr2=0x7f1b1815adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:36.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b15e00700 1 --2- 172.21.15.49:0/3231662637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b18157e50 0x7f1b1815adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b15e00700 1 -- 172.21.15.49:0/3231662637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b18158230 msgr2=0x7f1b180be6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:36.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b15e00700 1 --2- 172.21.15.49:0/3231662637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b18158230 0x7f1b180be6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b15e00700 1 -- 172.21.15.49:0/3231662637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b10009a20 con 0x7f1b180be170 2024-01-22T05:18:36.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b15400700 1 --2- 172.21.15.49:0/3231662637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b18157e50 0x7f1b1815adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:36.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b15e00700 1 --2- 172.21.15.49:0/3231662637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b180be170 0x7f1b18151760 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7f1b0800e930 tx=0x7f1b08009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:36.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b0d600700 1 -- 172.21.15.49:0/3231662637 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0800c670 con 0x7f1b180be170 2024-01-22T05:18:36.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b0d600700 1 -- 172.21.15.49:0/3231662637 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0800c7d0 con 0x7f1b180be170 2024-01-22T05:18:36.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b1d200700 1 -- 172.21.15.49:0/3231662637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1815a0f0 con 0x7f1b180be170 2024-01-22T05:18:36.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b0d600700 1 -- 172.21.15.49:0/3231662637 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0800cb50 con 0x7f1b180be170 2024-01-22T05:18:36.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.369+0000 7f1b1d200700 1 -- 172.21.15.49:0/3231662637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1815b2b0 con 0x7f1b180be170 2024-01-22T05:18:36.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.373+0000 7f1b1d200700 1 -- 172.21.15.49:0/3231662637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b180c2cc0 con 0x7f1b180be170 2024-01-22T05:18:36.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.373+0000 7f1b0d600700 1 -- 172.21.15.49:0/3231662637 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1b0801b400 con 0x7f1b180be170 2024-01-22T05:18:36.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.377+0000 7f1b0d600700 1 --2- 172.21.15.49:0/3231662637 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1af005a540 0x7f1af005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:36.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.377+0000 7f1b0d600700 1 -- 172.21.15.49:0/3231662637 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f1b08074b00 con 0x7f1b180be170 2024-01-22T05:18:36.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.377+0000 7f1b15400700 1 --2- 172.21.15.49:0/3231662637 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1af005a540 0x7f1af005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:36.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.377+0000 7f1b15400700 1 --2- 172.21.15.49:0/3231662637 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1af005a540 0x7f1af005ca00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f1b00007fd0 tx=0x7f1b00009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:36.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.381+0000 7f1b0d600700 1 -- 172.21.15.49:0/3231662637 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1b180c2cc0 con 0x7f1b180be170 2024-01-22T05:18:36.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.541+0000 7f1b1d200700 1 -- 172.21.15.49:0/3231662637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b180c2cc0 con 0x7f1b180be170 2024-01-22T05:18:36.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.545+0000 7f1b0d600700 1 -- 172.21.15.49:0/3231662637 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+13958 (secure 0 0 0) 0x7f1b180c2cc0 con 0x7f1b180be170 2024-01-22T05:18:36.548 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:36.549 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":168,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:18:35.715800+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:18:36.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.549+0000 7f1b1d200700 1 -- 172.21.15.49:0/3231662637 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1af005a540 msgr2=0x7f1af005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:36.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.549+0000 7f1b1d200700 1 --2- 172.21.15.49:0/3231662637 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1af005a540 0x7f1af005ca00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f1b00007fd0 tx=0x7f1b00009040).stop 2024-01-22T05:18:36.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.549+0000 7f1b1d200700 1 -- 172.21.15.49:0/3231662637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b180be170 msgr2=0x7f1b18151760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:36.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.549+0000 7f1b1d200700 1 --2- 172.21.15.49:0/3231662637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b180be170 0x7f1b18151760 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7f1b0800e930 tx=0x7f1b08009060).stop 2024-01-22T05:18:36.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.549+0000 7f1b1d200700 1 -- 172.21.15.49:0/3231662637 shutdown_connections 2024-01-22T05:18:36.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.549+0000 7f1b1d200700 1 --2- 172.21.15.49:0/3231662637 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1af005a540 0x7f1af005ca00 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.549+0000 7f1b1d200700 1 --2- 172.21.15.49:0/3231662637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b18158230 0x7f1b180be6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.549+0000 7f1b1d200700 1 --2- 172.21.15.49:0/3231662637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b18157e50 0x7f1b1815adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.549+0000 7f1b1d200700 1 --2- 172.21.15.49:0/3231662637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b180be170 0x7f1b18151760 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.549+0000 7f1b1d200700 1 -- 172.21.15.49:0/3231662637 >> 172.21.15.49:0/3231662637 conn(0x7f1b18066830 msgr2=0x7f1b1815c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:36.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.549+0000 7f1b1d200700 1 -- 172.21.15.49:0/3231662637 shutdown_connections 2024-01-22T05:18:36.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.549+0000 7f1b1d200700 1 -- 172.21.15.49:0/3231662637 wait complete. 2024-01-22T05:18:36.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:18:36.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:18:36.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.741+0000 7f69ec600700 1 Processor -- start 2024-01-22T05:18:36.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.745+0000 7f69ec600700 1 -- start start 2024-01-22T05:18:36.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.745+0000 7f69ec600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f69e40a8c20 0x7f69e40c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:36.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.745+0000 7f69ec600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69e40bcbe0 0x7f69e4068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:36.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.745+0000 7f69ec600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e4158650 con 0x7f69e40c1ac0 2024-01-22T05:18:36.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.745+0000 7f69ec600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e40c1f20 con 0x7f69e40a8c20 2024-01-22T05:18:36.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.745+0000 7f69ec600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40bd170 con 0x7f69e40bcbe0 2024-01-22T05:18:36.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69e9c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f69e40a8c20 0x7f69e40c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:36.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69e9c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f69e40a8c20 0x7f69e40c15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41870/0 (socket says 172.21.15.49:41870) 2024-01-22T05:18:36.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69e9c00700 1 -- 172.21.15.49:0/3606427224 learned_addr learned my addr 172.21.15.49:0/3606427224 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:36.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69e9200700 1 --1- 172.21.15.49:0/3606427224 >> v1:172.21.15.110:6789/0 conn(0x7f69e40c1ac0 0x7f69e40bc4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:56984/0 (socket says 172.21.15.49:56984) 2024-01-22T05:18:36.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69ea600700 1 --2- 172.21.15.49:0/3606427224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69e40bcbe0 0x7f69e4068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:36.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69e9c00700 1 -- 172.21.15.49:0/3606427224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69e40bcbe0 msgr2=0x7f69e4068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:36.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69e9c00700 1 --2- 172.21.15.49:0/3606427224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69e40bcbe0 0x7f69e4068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69e9c00700 1 -- 172.21.15.49:0/3606427224 >> v1:172.21.15.110:6789/0 conn(0x7f69e40c1ac0 legacy=0x7f69e40bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:36.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69e9c00700 1 -- 172.21.15.49:0/3606427224 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e4067c30 con 0x7f69e40a8c20 2024-01-22T05:18:36.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69e9c00700 1 --2- 172.21.15.49:0/3606427224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40a8c20 0x7f69e40c15d0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f69d4006fd0 tx=0x7f69d40090f0).ready entity=mon.0 client_cookie=76d490ab9f7b5635 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:36.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69e3e00700 1 -- 172.21.15.49:0/3606427224 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d400b580 con 0x7f69e40a8c20 2024-01-22T05:18:36.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69e3e00700 1 -- 172.21.15.49:0/3606427224 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d400b6e0 con 0x7f69e40a8c20 2024-01-22T05:18:36.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69e3e00700 1 -- 172.21.15.49:0/3606427224 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d400ba60 con 0x7f69e40a8c20 2024-01-22T05:18:36.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69ec600700 1 -- 172.21.15.49:0/3606427224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40a8c20 msgr2=0x7f69e40c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:36.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69ec600700 1 --2- 172.21.15.49:0/3606427224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40a8c20 0x7f69e40c15d0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f69d4006fd0 tx=0x7f69d40090f0).stop 2024-01-22T05:18:36.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69ec600700 1 -- 172.21.15.49:0/3606427224 shutdown_connections 2024-01-22T05:18:36.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.749+0000 7f69ec600700 1 --2- 172.21.15.49:0/3606427224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69e40bcbe0 0x7f69e4068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.753+0000 7f69ec600700 1 --2- 172.21.15.49:0/3606427224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40a8c20 0x7f69e40c15d0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.753+0000 7f69ec600700 1 -- 172.21.15.49:0/3606427224 >> 172.21.15.49:0/3606427224 conn(0x7f69e4062cb0 msgr2=0x7f69e40c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:36.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.753+0000 7f69ec600700 1 -- 172.21.15.49:0/3606427224 shutdown_connections 2024-01-22T05:18:36.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.753+0000 7f69ec600700 1 -- 172.21.15.49:0/3606427224 wait complete. 2024-01-22T05:18:36.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.753+0000 7f69ec600700 1 Processor -- start 2024-01-22T05:18:36.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.753+0000 7f69ec600700 1 -- start start 2024-01-22T05:18:36.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ec600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69e40a8c20 0x7f69e415b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:36.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ec600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69e40bcbe0 0x7f69e40bff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:36.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ec600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40c1ac0 0x7f69e416b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:36.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ec600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e4156430 con 0x7f69e40c1ac0 2024-01-22T05:18:36.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ec600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e4156710 con 0x7f69e40bcbe0 2024-01-22T05:18:36.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ec600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e41569f0 con 0x7f69e40a8c20 2024-01-22T05:18:36.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ea600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40c1ac0 0x7f69e416b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:36.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ea600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40c1ac0 0x7f69e416b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41872/0 (socket says 172.21.15.49:41872) 2024-01-22T05:18:36.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ea600700 1 -- 172.21.15.49:0/3309353872 learned_addr learned my addr 172.21.15.49:0/3309353872 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:36.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69e9c00700 1 --2- 172.21.15.49:0/3309353872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69e40a8c20 0x7f69e415b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69e9200700 1 --2- 172.21.15.49:0/3309353872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69e40bcbe0 0x7f69e40bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ea600700 1 -- 172.21.15.49:0/3309353872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69e40a8c20 msgr2=0x7f69e415b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ea600700 1 --2- 172.21.15.49:0/3309353872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69e40a8c20 0x7f69e415b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ea600700 1 -- 172.21.15.49:0/3309353872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69e40bcbe0 msgr2=0x7f69e40bff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ea600700 1 --2- 172.21.15.49:0/3309353872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69e40bcbe0 0x7f69e40bff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ea600700 1 -- 172.21.15.49:0/3309353872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d4009370 con 0x7f69e40c1ac0 2024-01-22T05:18:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ea600700 1 --2- 172.21.15.49:0/3309353872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40c1ac0 0x7f69e416b940 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7f69dc009e90 tx=0x7f69dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69e0c00700 1 -- 172.21.15.49:0/3309353872 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc00caa0 con 0x7f69e40c1ac0 2024-01-22T05:18:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69e0c00700 1 -- 172.21.15.49:0/3309353872 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc00f040 con 0x7f69e40c1ac0 2024-01-22T05:18:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69e0c00700 1 -- 172.21.15.49:0/3309353872 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc00ce10 con 0x7f69e40c1ac0 2024-01-22T05:18:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ec600700 1 -- 172.21.15.49:0/3309353872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e4156cd0 con 0x7f69e40c1ac0 2024-01-22T05:18:36.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.757+0000 7f69ec600700 1 -- 172.21.15.49:0/3309353872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e416c600 con 0x7f69e40c1ac0 2024-01-22T05:18:36.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.761+0000 7f69ec600700 1 -- 172.21.15.49:0/3309353872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e40c2290 con 0x7f69e40c1ac0 2024-01-22T05:18:36.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.761+0000 7f69e0c00700 1 -- 172.21.15.49:0/3309353872 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f69dc013610 con 0x7f69e40c1ac0 2024-01-22T05:18:36.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.765+0000 7f69e0c00700 1 --2- 172.21.15.49:0/3309353872 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f69bc05a540 0x7f69bc05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:36.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.765+0000 7f69e0c00700 1 -- 172.21.15.49:0/3309353872 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f69dc074f00 con 0x7f69e40c1ac0 2024-01-22T05:18:36.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.765+0000 7f69e9c00700 1 --2- 172.21.15.49:0/3309353872 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f69bc05a540 0x7f69bc05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:36.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.765+0000 7f69e9c00700 1 --2- 172.21.15.49:0/3309353872 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f69bc05a540 0x7f69bc05ca00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f69d4009130 tx=0x7f69d4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:36.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.769+0000 7f69e0c00700 1 -- 172.21.15.49:0/3309353872 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f69e40c2290 con 0x7f69e40c1ac0 2024-01-22T05:18:36.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.929+0000 7f69ec600700 1 -- 172.21.15.49:0/3309353872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f69e40c2290 con 0x7f69e40c1ac0 2024-01-22T05:18:36.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.933+0000 7f69e0c00700 1 -- 172.21.15.49:0/3309353872 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v168) v1 ==== 110+0+10 (secure 0 0 0) 0x7f69e40c2290 con 0x7f69e40c1ac0 2024-01-22T05:18:36.935 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:18:36.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.937+0000 7f69ec600700 1 -- 172.21.15.49:0/3309353872 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f69bc05a540 msgr2=0x7f69bc05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:36.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.937+0000 7f69ec600700 1 --2- 172.21.15.49:0/3309353872 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f69bc05a540 0x7f69bc05ca00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f69d4009130 tx=0x7f69d4017000).stop 2024-01-22T05:18:36.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.937+0000 7f69ec600700 1 -- 172.21.15.49:0/3309353872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40c1ac0 msgr2=0x7f69e416b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:36.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.937+0000 7f69ec600700 1 --2- 172.21.15.49:0/3309353872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40c1ac0 0x7f69e416b940 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7f69dc009e90 tx=0x7f69dc00b040).stop 2024-01-22T05:18:36.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.937+0000 7f69ec600700 1 -- 172.21.15.49:0/3309353872 shutdown_connections 2024-01-22T05:18:36.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.937+0000 7f69ec600700 1 --2- 172.21.15.49:0/3309353872 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f69bc05a540 0x7f69bc05ca00 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.937+0000 7f69ec600700 1 --2- 172.21.15.49:0/3309353872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40c1ac0 0x7f69e416b940 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.937+0000 7f69ec600700 1 --2- 172.21.15.49:0/3309353872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69e40bcbe0 0x7f69e40bff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.937+0000 7f69ec600700 1 --2- 172.21.15.49:0/3309353872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69e40a8c20 0x7f69e415b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:36.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.937+0000 7f69ec600700 1 -- 172.21.15.49:0/3309353872 >> 172.21.15.49:0/3309353872 conn(0x7f69e4062cb0 msgr2=0x7f69e40c64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:36.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.937+0000 7f69ec600700 1 -- 172.21.15.49:0/3309353872 shutdown_connections 2024-01-22T05:18:36.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:36.937+0000 7f69ec600700 1 -- 172.21.15.49:0/3309353872 wait complete. 2024-01-22T05:18:36.963 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:18:37.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.141+0000 7f26c9c00700 1 Processor -- start 2024-01-22T05:18:37.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.141+0000 7f26c9c00700 1 -- start start 2024-01-22T05:18:37.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c9c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f26c40bbdc0 0x7f26c40bc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c9c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f26c40bc730 0x7f26c41512a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c9c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c40631b0 con 0x7f26c40c2ab0 2024-01-22T05:18:37.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c9c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c40c35a0 con 0x7f26c40bc730 2024-01-22T05:18:37.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c9c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c40c1fe0 con 0x7f26c40bbdc0 2024-01-22T05:18:37.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f26c40bc730 0x7f26c41512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f26c40bc730 0x7f26c41512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41874/0 (socket says 172.21.15.49:41874) 2024-01-22T05:18:37.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c3400700 1 -- 172.21.15.49:0/3817801570 learned_addr learned my addr 172.21.15.49:0/3817801570 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:37.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c2000700 1 --2- 172.21.15.49:0/3817801570 >> v2:172.21.15.110:3300/0 conn(0x7f26c40bbdc0 0x7f26c40bc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c1600700 1 -- 172.21.15.49:0/3817801570 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910157843 0 0) 0x7f26c40631b0 con 0x7f26c40c2ab0 2024-01-22T05:18:37.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c3400700 1 -- 172.21.15.49:0/3817801570 >> v2:172.21.15.110:3300/0 conn(0x7f26c40bbdc0 msgr2=0x7f26c40bc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:37.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c3400700 1 --2- 172.21.15.49:0/3817801570 >> v2:172.21.15.110:3300/0 conn(0x7f26c40bbdc0 0x7f26c40bc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c3400700 1 -- 172.21.15.49:0/3817801570 >> v1:172.21.15.110:6789/0 conn(0x7f26c40c2ab0 legacy=0x7f26c40c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c3400700 1 -- 172.21.15.49:0/3817801570 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c40625a0 con 0x7f26c40bc730 2024-01-22T05:18:37.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c3400700 1 --2- 172.21.15.49:0/3817801570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c40bc730 0x7f26c41512a0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f26c405ff40 tx=0x7f26bc00ba50).ready entity=mon.0 client_cookie=f90dede89ec8d1f5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:37.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c1600700 1 -- 172.21.15.49:0/3817801570 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc010070 con 0x7f26c40bc730 2024-01-22T05:18:37.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c1600700 1 -- 172.21.15.49:0/3817801570 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc00dde0 con 0x7f26c40bc730 2024-01-22T05:18:37.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.145+0000 7f26c1600700 1 -- 172.21.15.49:0/3817801570 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00b2e0 con 0x7f26c40bc730 2024-01-22T05:18:37.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.149+0000 7f26c9c00700 1 -- 172.21.15.49:0/3817801570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c40bc730 msgr2=0x7f26c41512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.149+0000 7f26c9c00700 1 --2- 172.21.15.49:0/3817801570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c40bc730 0x7f26c41512a0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f26c405ff40 tx=0x7f26bc00ba50).stop 2024-01-22T05:18:37.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.149+0000 7f26c9c00700 1 -- 172.21.15.49:0/3817801570 shutdown_connections 2024-01-22T05:18:37.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.149+0000 7f26c9c00700 1 --2- 172.21.15.49:0/3817801570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c40bc730 0x7f26c41512a0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.149+0000 7f26c9c00700 1 --2- 172.21.15.49:0/3817801570 >> v2:172.21.15.110:3300/0 conn(0x7f26c40bbdc0 0x7f26c40bc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.149+0000 7f26c9c00700 1 -- 172.21.15.49:0/3817801570 >> 172.21.15.49:0/3817801570 conn(0x7f26c40c3900 msgr2=0x7f26c40c3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:37.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.149+0000 7f26c9c00700 1 -- 172.21.15.49:0/3817801570 shutdown_connections 2024-01-22T05:18:37.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.149+0000 7f26c9c00700 1 -- 172.21.15.49:0/3817801570 wait complete. 2024-01-22T05:18:37.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c9c00700 1 Processor -- start 2024-01-22T05:18:37.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c9c00700 1 -- start start 2024-01-22T05:18:37.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c9c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c40bbdc0 0x7f26c40bce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c9c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26c40bc730 0x7f26c414f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c9c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26c40c2ab0 0x7f26c4146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c9c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c41505e0 con 0x7f26c40bbdc0 2024-01-22T05:18:37.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c9c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c414fa60 con 0x7f26c40bc730 2024-01-22T05:18:37.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c9c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c414fd40 con 0x7f26c40c2ab0 2024-01-22T05:18:37.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c40bbdc0 0x7f26c40bce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c40bbdc0 0x7f26c40bce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41876/0 (socket says 172.21.15.49:41876) 2024-01-22T05:18:37.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c2a00700 1 -- 172.21.15.49:0/2418542927 learned_addr learned my addr 172.21.15.49:0/2418542927 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:37.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c2000700 1 --2- 172.21.15.49:0/2418542927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26c40bc730 0x7f26c414f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c3400700 1 --2- 172.21.15.49:0/2418542927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26c40c2ab0 0x7f26c4146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c2a00700 1 -- 172.21.15.49:0/2418542927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26c40c2ab0 msgr2=0x7f26c4146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c2a00700 1 --2- 172.21.15.49:0/2418542927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26c40c2ab0 0x7f26c4146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c2a00700 1 -- 172.21.15.49:0/2418542927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26c40bc730 msgr2=0x7f26c414f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c2a00700 1 --2- 172.21.15.49:0/2418542927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26c40bc730 0x7f26c414f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.153+0000 7f26c2a00700 1 -- 172.21.15.49:0/2418542927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc00bcf0 con 0x7f26c40bbdc0 2024-01-22T05:18:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.157+0000 7f26c2a00700 1 --2- 172.21.15.49:0/2418542927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c40bbdc0 0x7f26c40bce30 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f26b400c410 tx=0x7f26b4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.157+0000 7f26ba000700 1 -- 172.21.15.49:0/2418542927 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4007020 con 0x7f26c40bbdc0 2024-01-22T05:18:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.157+0000 7f26ba000700 1 -- 172.21.15.49:0/2418542927 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b40071a0 con 0x7f26c40bbdc0 2024-01-22T05:18:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.157+0000 7f26ba000700 1 -- 172.21.15.49:0/2418542927 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4007560 con 0x7f26c40bbdc0 2024-01-22T05:18:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.157+0000 7f26c9c00700 1 -- 172.21.15.49:0/2418542927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c4150020 con 0x7f26c40bbdc0 2024-01-22T05:18:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.157+0000 7f26c9c00700 1 -- 172.21.15.49:0/2418542927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c414f670 con 0x7f26c40bbdc0 2024-01-22T05:18:37.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.157+0000 7f26c9c00700 1 -- 172.21.15.49:0/2418542927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c4065280 con 0x7f26c40bbdc0 2024-01-22T05:18:37.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.161+0000 7f26ba000700 1 -- 172.21.15.49:0/2418542927 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f26b40068b0 con 0x7f26c40bbdc0 2024-01-22T05:18:37.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.161+0000 7f26ba000700 1 --2- 172.21.15.49:0/2418542927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f269c05a510 0x7f269c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.161+0000 7f26ba000700 1 -- 172.21.15.49:0/2418542927 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f26b40737c0 con 0x7f26c40bbdc0 2024-01-22T05:18:37.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.161+0000 7f26c2000700 1 --2- 172.21.15.49:0/2418542927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f269c05a510 0x7f269c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.161+0000 7f26c2000700 1 --2- 172.21.15.49:0/2418542927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f269c05a510 0x7f269c05c9d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f26c40bd9f0 tx=0x7f26ac009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:37.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.165+0000 7f26ba000700 1 -- 172.21.15.49:0/2418542927 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f26b4047190 con 0x7f26c40bbdc0 2024-01-22T05:18:37.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.329+0000 7f26c9c00700 1 -- 172.21.15.49:0/2418542927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f26c4062880 con 0x7f26c40bbdc0 2024-01-22T05:18:37.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.329+0000 7f26ba000700 1 -- 172.21.15.49:0/2418542927 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v168) v1 ==== 92+0+10 (secure 0 0 0) 0x7f26b404a7b0 con 0x7f26c40bbdc0 2024-01-22T05:18:37.334 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:18:37.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.333+0000 7f26c9c00700 1 -- 172.21.15.49:0/2418542927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f269c05a510 msgr2=0x7f269c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.333+0000 7f26c9c00700 1 --2- 172.21.15.49:0/2418542927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f269c05a510 0x7f269c05c9d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f26c40bd9f0 tx=0x7f26ac009060).stop 2024-01-22T05:18:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.333+0000 7f26c9c00700 1 -- 172.21.15.49:0/2418542927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c40bbdc0 msgr2=0x7f26c40bce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.333+0000 7f26c9c00700 1 --2- 172.21.15.49:0/2418542927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c40bbdc0 0x7f26c40bce30 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f26b400c410 tx=0x7f26b4007e00).stop 2024-01-22T05:18:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.333+0000 7f26c9c00700 1 -- 172.21.15.49:0/2418542927 shutdown_connections 2024-01-22T05:18:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.333+0000 7f26c9c00700 1 --2- 172.21.15.49:0/2418542927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f269c05a510 0x7f269c05c9d0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.333+0000 7f26c9c00700 1 --2- 172.21.15.49:0/2418542927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26c40c2ab0 0x7f26c4146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.333+0000 7f26c9c00700 1 --2- 172.21.15.49:0/2418542927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26c40bc730 0x7f26c414f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.333+0000 7f26c9c00700 1 --2- 172.21.15.49:0/2418542927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c40bbdc0 0x7f26c40bce30 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.333+0000 7f26c9c00700 1 -- 172.21.15.49:0/2418542927 >> 172.21.15.49:0/2418542927 conn(0x7f26c40c3900 msgr2=0x7f26c41509b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.333+0000 7f26c9c00700 1 -- 172.21.15.49:0/2418542927 shutdown_connections 2024-01-22T05:18:37.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.333+0000 7f26c9c00700 1 -- 172.21.15.49:0/2418542927 wait complete. 2024-01-22T05:18:37.361 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:18:37.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.517+0000 7f14c8e00700 1 Processor -- start 2024-01-22T05:18:37.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.517+0000 7f14c8e00700 1 -- start start 2024-01-22T05:18:37.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.517+0000 7f14c8e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f14c4062940 0x7f14c40c1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.517+0000 7f14c8e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14c40c1c40 0x7f14c40c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.517+0000 7f14c8e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c4067e30 con 0x7f14c40a5d30 2024-01-22T05:18:37.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.517+0000 7f14c8e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c4068c90 con 0x7f14c4062940 2024-01-22T05:18:37.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.517+0000 7f14c8e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4069120 con 0x7f14c40c1c40 2024-01-22T05:18:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.521+0000 7f14c1400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f14c4062940 0x7f14c40c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.521+0000 7f14c1400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f14c4062940 0x7f14c40c1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:39412/0 (socket says 172.21.15.49:39412) 2024-01-22T05:18:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.521+0000 7f14c1400700 1 -- 172.21.15.49:0/3848850002 learned_addr learned my addr 172.21.15.49:0/3848850002 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.521+0000 7f14c1e00700 1 --1- 172.21.15.49:0/3848850002 >> v1:172.21.15.110:6789/0 conn(0x7f14c40a5d30 0x7f14c4062230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:57002/0 (socket says 172.21.15.49:57002) 2024-01-22T05:18:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.521+0000 7f14c2800700 1 --2- 172.21.15.49:0/3848850002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14c40c1c40 0x7f14c40c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.521+0000 7f14c1400700 1 -- 172.21.15.49:0/3848850002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14c40c1c40 msgr2=0x7f14c40c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.521+0000 7f14c1400700 1 --2- 172.21.15.49:0/3848850002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14c40c1c40 0x7f14c40c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.521+0000 7f14c1400700 1 -- 172.21.15.49:0/3848850002 >> v1:172.21.15.110:6789/0 conn(0x7f14c40a5d30 legacy=0x7f14c4062230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.521+0000 7f14c0a00700 1 -- 172.21.15.49:0/3848850002 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892900505 0 0) 0x7f14c4067e30 con 0x7f14c40a5d30 2024-01-22T05:18:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.521+0000 7f14c1400700 1 -- 172.21.15.49:0/3848850002 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c4068080 con 0x7f14c4062940 2024-01-22T05:18:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.521+0000 7f14c1400700 1 --2- 172.21.15.49:0/3848850002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14c4062940 0x7f14c40c1750 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f14ac006fd0 tx=0x7f14ac009980).ready entity=mon.1 client_cookie=20a7b16fc045fd86 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:37.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.521+0000 7f14c0a00700 1 -- 172.21.15.49:0/3848850002 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00bde0 con 0x7f14c4062940 2024-01-22T05:18:37.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.521+0000 7f14c0a00700 1 -- 172.21.15.49:0/3848850002 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac011400 con 0x7f14c4062940 2024-01-22T05:18:37.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.521+0000 7f14c0a00700 1 -- 172.21.15.49:0/3848850002 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac011780 con 0x7f14c4062940 2024-01-22T05:18:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.525+0000 7f14c8e00700 1 -- 172.21.15.49:0/3848850002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14c4062940 msgr2=0x7f14c40c1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.525+0000 7f14c8e00700 1 --2- 172.21.15.49:0/3848850002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14c4062940 0x7f14c40c1750 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f14ac006fd0 tx=0x7f14ac009980).stop 2024-01-22T05:18:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.525+0000 7f14c8e00700 1 -- 172.21.15.49:0/3848850002 shutdown_connections 2024-01-22T05:18:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.525+0000 7f14c8e00700 1 --2- 172.21.15.49:0/3848850002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14c40c1c40 0x7f14c40c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.525+0000 7f14c8e00700 1 --2- 172.21.15.49:0/3848850002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14c4062940 0x7f14c40c1750 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.525+0000 7f14c8e00700 1 -- 172.21.15.49:0/3848850002 >> 172.21.15.49:0/3848850002 conn(0x7f14c40c6920 msgr2=0x7f14c40c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.525+0000 7f14c8e00700 1 -- 172.21.15.49:0/3848850002 shutdown_connections 2024-01-22T05:18:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.525+0000 7f14c8e00700 1 -- 172.21.15.49:0/3848850002 wait complete. 2024-01-22T05:18:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.525+0000 7f14c8e00700 1 Processor -- start 2024-01-22T05:18:37.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c8e00700 1 -- start start 2024-01-22T05:18:37.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c8e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14c4062940 0x7f14c41375a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c8e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14c40a5d30 0x7f14c40ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c8e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14c40c1c40 0x7f14c40abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c8e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c40aca00 con 0x7f14c40c1c40 2024-01-22T05:18:37.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c8e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c414b510 con 0x7f14c4062940 2024-01-22T05:18:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c8e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c40ac440 con 0x7f14c40a5d30 2024-01-22T05:18:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c2800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14c40c1c40 0x7f14c40abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c2800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14c40c1c40 0x7f14c40abdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41880/0 (socket says 172.21.15.49:41880) 2024-01-22T05:18:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c2800700 1 -- 172.21.15.49:0/3237298207 learned_addr learned my addr 172.21.15.49:0/3237298207 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c1e00700 1 --2- 172.21.15.49:0/3237298207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14c4062940 0x7f14c41375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c1400700 1 --2- 172.21.15.49:0/3237298207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14c40a5d30 0x7f14c40ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c1e00700 1 -- 172.21.15.49:0/3237298207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14c40a5d30 msgr2=0x7f14c40ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c1e00700 1 --2- 172.21.15.49:0/3237298207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14c40a5d30 0x7f14c40ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c1e00700 1 -- 172.21.15.49:0/3237298207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14c40c1c40 msgr2=0x7f14c40abdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c1e00700 1 --2- 172.21.15.49:0/3237298207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14c40c1c40 0x7f14c40abdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c1e00700 1 -- 172.21.15.49:0/3237298207 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac009c00 con 0x7f14c4062940 2024-01-22T05:18:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c2800700 1 --2- 172.21.15.49:0/3237298207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14c40c1c40 0x7f14c40abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.529+0000 7f14c1e00700 1 --2- 172.21.15.49:0/3237298207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14c4062940 0x7f14c41375a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f14b400c410 tx=0x7f14b4007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:37.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.533+0000 7f14b9600700 1 -- 172.21.15.49:0/3237298207 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40070d0 con 0x7f14c4062940 2024-01-22T05:18:37.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.533+0000 7f14b9600700 1 -- 172.21.15.49:0/3237298207 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b4007230 con 0x7f14c4062940 2024-01-22T05:18:37.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.533+0000 7f14b9600700 1 -- 172.21.15.49:0/3237298207 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40056e0 con 0x7f14c4062940 2024-01-22T05:18:37.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.533+0000 7f14c8e00700 1 -- 172.21.15.49:0/3237298207 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c40ac720 con 0x7f14c4062940 2024-01-22T05:18:37.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.533+0000 7f14c8e00700 1 -- 172.21.15.49:0/3237298207 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c40a6520 con 0x7f14c4062940 2024-01-22T05:18:37.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.533+0000 7f14c8e00700 1 -- 172.21.15.49:0/3237298207 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c40a6710 con 0x7f14c4062940 2024-01-22T05:18:37.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.533+0000 7f14b9600700 1 -- 172.21.15.49:0/3237298207 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f14b4005a90 con 0x7f14c4062940 2024-01-22T05:18:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.537+0000 7f14b9600700 1 --2- 172.21.15.49:0/3237298207 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f149c05a510 0x7f149c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.537+0000 7f14b9600700 1 -- 172.21.15.49:0/3237298207 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f14b4073cf0 con 0x7f14c4062940 2024-01-22T05:18:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.537+0000 7f14c1400700 1 --2- 172.21.15.49:0/3237298207 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f149c05a510 0x7f149c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.537+0000 7f14c1400700 1 --2- 172.21.15.49:0/3237298207 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f149c05a510 0x7f149c05c9d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f14c4062d40 tx=0x7f14ac017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:37.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.545+0000 7f14b9600700 1 -- 172.21.15.49:0/3237298207 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f14b4047600 con 0x7f14c4062940 2024-01-22T05:18:37.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.713+0000 7f14c8e00700 1 -- 172.21.15.49:0/3237298207 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f14c4064f50 con 0x7f14c4062940 2024-01-22T05:18:37.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.713+0000 7f14b9600700 1 -- 172.21.15.49:0/3237298207 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v168) v1 ==== 84+0+143 (secure 0 0 0) 0x7f14b404ac20 con 0x7f14c4062940 2024-01-22T05:18:37.717 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:37.717 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-22T05:18:37.717 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:37.717 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-01-22T05:18:37.717 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2024-01-22T05:18:37.717 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:37.717 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:37.717 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2024-01-22T05:18:37.717 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2024-01-22T05:18:37.717 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:37.718 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-22T05:18:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.717+0000 7f14c8e00700 1 -- 172.21.15.49:0/3237298207 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f149c05a510 msgr2=0x7f149c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.717+0000 7f14c8e00700 1 --2- 172.21.15.49:0/3237298207 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f149c05a510 0x7f149c05c9d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f14c4062d40 tx=0x7f14ac017000).stop 2024-01-22T05:18:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.717+0000 7f14c8e00700 1 -- 172.21.15.49:0/3237298207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14c4062940 msgr2=0x7f14c41375a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.717+0000 7f14c8e00700 1 --2- 172.21.15.49:0/3237298207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14c4062940 0x7f14c41375a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f14b400c410 tx=0x7f14b4007bd0).stop 2024-01-22T05:18:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.717+0000 7f14c8e00700 1 -- 172.21.15.49:0/3237298207 shutdown_connections 2024-01-22T05:18:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.717+0000 7f14c8e00700 1 --2- 172.21.15.49:0/3237298207 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f149c05a510 0x7f149c05c9d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.717+0000 7f14c8e00700 1 --2- 172.21.15.49:0/3237298207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14c40c1c40 0x7f14c40abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.717+0000 7f14c8e00700 1 --2- 172.21.15.49:0/3237298207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14c40a5d30 0x7f14c40ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.717+0000 7f14c8e00700 1 --2- 172.21.15.49:0/3237298207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14c4062940 0x7f14c41375a0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.717+0000 7f14c8e00700 1 -- 172.21.15.49:0/3237298207 >> 172.21.15.49:0/3237298207 conn(0x7f14c40c6920 msgr2=0x7f14c40bcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.717+0000 7f14c8e00700 1 -- 172.21.15.49:0/3237298207 shutdown_connections 2024-01-22T05:18:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.717+0000 7f14c8e00700 1 -- 172.21.15.49:0/3237298207 wait complete. 2024-01-22T05:18:37.743 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:18:37.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:18:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.909+0000 7fd25b200700 1 Processor -- start 2024-01-22T05:18:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.909+0000 7fd25b200700 1 -- start start 2024-01-22T05:18:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.909+0000 7fd25b200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd25c0bc4f0 0x7fd25c0655e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.909+0000 7fd25b200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd25c065f40 0x7fd25c0681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.909+0000 7fd25b200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd25c0663b0 con 0x7fd25c065ad0 2024-01-22T05:18:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.909+0000 7fd25b200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25c0bc8d0 con 0x7fd25c065f40 2024-01-22T05:18:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.909+0000 7fd25b200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25c0665e0 con 0x7fd25c0bc4f0 2024-01-22T05:18:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.909+0000 7fd25a800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd25c065f40 0x7fd25c0681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.909+0000 7fd25a800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd25c065f40 0x7fd25c0681a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41894/0 (socket says 172.21.15.49:41894) 2024-01-22T05:18:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.909+0000 7fd25a800700 1 -- 172.21.15.49:0/639771341 learned_addr learned my addr 172.21.15.49:0/639771341 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.909+0000 7fd259400700 1 --1- 172.21.15.49:0/639771341 >> v1:172.21.15.49:6789/0 conn(0x7fd25c065ad0 0x7fd25c067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53688/0 (socket says 172.21.15.49:53688) 2024-01-22T05:18:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.909+0000 7fd258a00700 1 -- 172.21.15.49:0/639771341 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167816975 0 0) 0x7fd25c0663b0 con 0x7fd25c065ad0 2024-01-22T05:18:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.909+0000 7fd259e00700 1 --2- 172.21.15.49:0/639771341 >> v2:172.21.15.110:3300/0 conn(0x7fd25c0bc4f0 0x7fd25c0655e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.933+0000 7fd258a00700 1 -- 172.21.15.49:0/639771341 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd23c0033d0 con 0x7fd25c065ad0 2024-01-22T05:18:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.933+0000 7fd25a800700 1 -- 172.21.15.49:0/639771341 >> v2:172.21.15.110:3300/0 conn(0x7fd25c0bc4f0 msgr2=0x7fd25c0655e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.933+0000 7fd25a800700 1 --2- 172.21.15.49:0/639771341 >> v2:172.21.15.110:3300/0 conn(0x7fd25c0bc4f0 0x7fd25c0655e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.933+0000 7fd25a800700 1 -- 172.21.15.49:0/639771341 >> v1:172.21.15.49:6789/0 conn(0x7fd25c065ad0 legacy=0x7fd25c067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.933+0000 7fd25a800700 1 -- 172.21.15.49:0/639771341 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c0668c0 con 0x7fd25c065f40 2024-01-22T05:18:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.933+0000 7fd25a800700 1 --2- 172.21.15.49:0/639771341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd25c065f40 0x7fd25c0681a0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7fd25c059be0 tx=0x7fd25400b040).ready entity=mon.0 client_cookie=5c5fae2aa9c9bec8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.937+0000 7fd258a00700 1 -- 172.21.15.49:0/639771341 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25400aaa0 con 0x7fd25c065f40 2024-01-22T05:18:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.937+0000 7fd258a00700 1 -- 172.21.15.49:0/639771341 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25400ac00 con 0x7fd25c065f40 2024-01-22T05:18:37.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.937+0000 7fd258a00700 1 -- 172.21.15.49:0/639771341 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254010480 con 0x7fd25c065f40 2024-01-22T05:18:37.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.937+0000 7fd25b200700 1 -- 172.21.15.49:0/639771341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd25c065f40 msgr2=0x7fd25c0681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.937+0000 7fd25b200700 1 --2- 172.21.15.49:0/639771341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd25c065f40 0x7fd25c0681a0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7fd25c059be0 tx=0x7fd25400b040).stop 2024-01-22T05:18:37.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.937+0000 7fd25b200700 1 -- 172.21.15.49:0/639771341 shutdown_connections 2024-01-22T05:18:37.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.937+0000 7fd25b200700 1 --2- 172.21.15.49:0/639771341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd25c065f40 0x7fd25c0681a0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.937+0000 7fd25b200700 1 --2- 172.21.15.49:0/639771341 >> v2:172.21.15.110:3300/0 conn(0x7fd25c0bc4f0 0x7fd25c0655e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.937+0000 7fd25b200700 1 -- 172.21.15.49:0/639771341 >> 172.21.15.49:0/639771341 conn(0x7fd25c0c6fb0 msgr2=0x7fd25c0c2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.937+0000 7fd25b200700 1 -- 172.21.15.49:0/639771341 shutdown_connections 2024-01-22T05:18:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.937+0000 7fd25b200700 1 -- 172.21.15.49:0/639771341 wait complete. 2024-01-22T05:18:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.941+0000 7fd25b200700 1 Processor -- start 2024-01-22T05:18:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.941+0000 7fd25b200700 1 -- start start 2024-01-22T05:18:37.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.941+0000 7fd25b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd25c065ad0 0x7fd25c17c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.941+0000 7fd25b200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd25c065f40 0x7fd25c179390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.941+0000 7fd25b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd25c0bc4f0 0x7fd25c0bdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.941+0000 7fd25b200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c0bf730 con 0x7fd25c065f40 2024-01-22T05:18:37.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.941+0000 7fd25b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c079a70 con 0x7fd25c065ad0 2024-01-22T05:18:37.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.941+0000 7fd25b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c0beb20 con 0x7fd25c0bc4f0 2024-01-22T05:18:37.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd259400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd25c065f40 0x7fd25c179390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd259400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd25c065f40 0x7fd25c179390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41898/0 (socket says 172.21.15.49:41898) 2024-01-22T05:18:37.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd259400700 1 -- 172.21.15.49:0/3203719514 learned_addr learned my addr 172.21.15.49:0/3203719514 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:37.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd25a800700 1 --2- 172.21.15.49:0/3203719514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd25c0bc4f0 0x7fd25c0bdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd259e00700 1 --2- 172.21.15.49:0/3203719514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd25c065ad0 0x7fd25c17c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd259400700 1 -- 172.21.15.49:0/3203719514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd25c0bc4f0 msgr2=0x7fd25c0bdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd259400700 1 --2- 172.21.15.49:0/3203719514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd25c0bc4f0 0x7fd25c0bdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd259400700 1 -- 172.21.15.49:0/3203719514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd25c065ad0 msgr2=0x7fd25c17c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:37.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd259400700 1 --2- 172.21.15.49:0/3203719514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd25c065ad0 0x7fd25c17c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:37.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd259400700 1 -- 172.21.15.49:0/3203719514 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd254009a40 con 0x7fd25c065f40 2024-01-22T05:18:37.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd259400700 1 --2- 172.21.15.49:0/3203719514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd25c065f40 0x7fd25c179390 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7fd24400c590 tx=0x7fd244007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:37.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd251600700 1 -- 172.21.15.49:0/3203719514 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2440072e0 con 0x7fd25c065f40 2024-01-22T05:18:37.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd251600700 1 -- 172.21.15.49:0/3203719514 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd244007440 con 0x7fd25c065f40 2024-01-22T05:18:37.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd25b200700 1 -- 172.21.15.49:0/3203719514 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25c0bee00 con 0x7fd25c065f40 2024-01-22T05:18:37.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd251600700 1 -- 172.21.15.49:0/3203719514 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244005910 con 0x7fd25c065f40 2024-01-22T05:18:37.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd25b200700 1 -- 172.21.15.49:0/3203719514 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25c0bf3c0 con 0x7fd25c065f40 2024-01-22T05:18:37.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.945+0000 7fd25b200700 1 -- 172.21.15.49:0/3203719514 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25c0bf8e0 con 0x7fd25c065f40 2024-01-22T05:18:37.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.949+0000 7fd251600700 1 -- 172.21.15.49:0/3203719514 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd244005d40 con 0x7fd25c065f40 2024-01-22T05:18:37.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.949+0000 7fd251600700 1 --2- 172.21.15.49:0/3203719514 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd23405a4e0 0x7fd23405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:37.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.949+0000 7fd251600700 1 -- 172.21.15.49:0/3203719514 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fd244073a10 con 0x7fd25c065f40 2024-01-22T05:18:37.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.949+0000 7fd259e00700 1 --2- 172.21.15.49:0/3203719514 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd23405a4e0 0x7fd23405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:37.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.949+0000 7fd259e00700 1 --2- 172.21.15.49:0/3203719514 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd23405a4e0 0x7fd23405c9a0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7fd24c00bb10 tx=0x7fd24c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:37.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:37.957+0000 7fd251600700 1 -- 172.21.15.49:0/3203719514 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd25c0bf8e0 con 0x7fd25c065f40 2024-01-22T05:18:38.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.121+0000 7fd25b200700 1 -- 172.21.15.49:0/3203719514 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fd25c05fd40 con 0x7fd25c065f40 2024-01-22T05:18:38.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.589+0000 7fd251600700 1 -- 172.21.15.49:0/3203719514 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v169) v1 ==== 152+0+0 (secure 0 0 0) 0x7fd244018070 con 0x7fd25c065f40 2024-01-22T05:18:38.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.597+0000 7fd25b200700 1 -- 172.21.15.49:0/3203719514 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd23405a4e0 msgr2=0x7fd23405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:38.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.597+0000 7fd25b200700 1 --2- 172.21.15.49:0/3203719514 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd23405a4e0 0x7fd23405c9a0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7fd24c00bb10 tx=0x7fd24c008040).stop 2024-01-22T05:18:38.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.597+0000 7fd25b200700 1 -- 172.21.15.49:0/3203719514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd25c065f40 msgr2=0x7fd25c179390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:38.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.597+0000 7fd25b200700 1 --2- 172.21.15.49:0/3203719514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd25c065f40 0x7fd25c179390 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7fd24400c590 tx=0x7fd244007c80).stop 2024-01-22T05:18:38.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.597+0000 7fd25b200700 1 -- 172.21.15.49:0/3203719514 shutdown_connections 2024-01-22T05:18:38.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.597+0000 7fd25b200700 1 --2- 172.21.15.49:0/3203719514 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd23405a4e0 0x7fd23405c9a0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:38.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.597+0000 7fd25b200700 1 --2- 172.21.15.49:0/3203719514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd25c0bc4f0 0x7fd25c0bdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:38.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.597+0000 7fd25b200700 1 --2- 172.21.15.49:0/3203719514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd25c065f40 0x7fd25c179390 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:38.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.597+0000 7fd25b200700 1 --2- 172.21.15.49:0/3203719514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd25c065ad0 0x7fd25c17c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:38.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.597+0000 7fd25b200700 1 -- 172.21.15.49:0/3203719514 >> 172.21.15.49:0/3203719514 conn(0x7fd25c0c6fb0 msgr2=0x7fd25c0c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:38.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.601+0000 7fd25b200700 1 -- 172.21.15.49:0/3203719514 shutdown_connections 2024-01-22T05:18:38.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.601+0000 7fd25b200700 1 -- 172.21.15.49:0/3203719514 wait complete. 2024-01-22T05:18:38.610 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-01-22T05:18:38.627 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:18:38.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.797+0000 7f04ed200700 1 Processor -- start 2024-01-22T05:18:38.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.797+0000 7f04ed200700 1 -- start start 2024-01-22T05:18:38.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.801+0000 7f04ed200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f04e8062e30 0x7f04e8063210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.801+0000 7f04ed200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04e8139d00 0x7f04e80c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.801+0000 7f04ed200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e8154b90 con 0x7f04e80c5c50 2024-01-22T05:18:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.801+0000 7f04ed200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e80c2160 con 0x7f04e8062e30 2024-01-22T05:18:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.801+0000 7f04ed200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80c23e0 con 0x7f04e8139d00 2024-01-22T05:18:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.801+0000 7f04e5e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f04e8062e30 0x7f04e8063210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:38.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.801+0000 7f04e5e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f04e8062e30 0x7f04e8063210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41902/0 (socket says 172.21.15.49:41902) 2024-01-22T05:18:38.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.801+0000 7f04e5e00700 1 -- 172.21.15.49:0/2930460940 learned_addr learned my addr 172.21.15.49:0/2930460940 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:38.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.805+0000 7f04e6800700 1 --2- 172.21.15.49:0/2930460940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04e8139d00 0x7f04e80c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:38.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.805+0000 7f04e5e00700 1 -- 172.21.15.49:0/2930460940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04e8139d00 msgr2=0x7f04e80c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:38.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.805+0000 7f04e5e00700 1 --2- 172.21.15.49:0/2930460940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04e8139d00 0x7f04e80c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:38.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.805+0000 7f04e5e00700 1 -- 172.21.15.49:0/2930460940 >> v1:172.21.15.110:6789/0 conn(0x7f04e80c5c50 legacy=0x7f04e81395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:38.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.805+0000 7f04e5e00700 1 -- 172.21.15.49:0/2930460940 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e80c26c0 con 0x7f04e8062e30 2024-01-22T05:18:38.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.805+0000 7f04e5e00700 1 --2- 172.21.15.49:0/2930460940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04e8062e30 0x7f04e8063210 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f04d800bac0 tx=0x7f04d800b370).ready entity=mon.0 client_cookie=d95bc82ccbfa5374 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:38.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.805+0000 7f04e4a00700 1 -- 172.21.15.49:0/2930460940 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d800db70 con 0x7f04e8062e30 2024-01-22T05:18:38.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.805+0000 7f04e4a00700 1 -- 172.21.15.49:0/2930460940 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d800dcd0 con 0x7f04e8062e30 2024-01-22T05:18:38.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.805+0000 7f04e4a00700 1 -- 172.21.15.49:0/2930460940 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8015600 con 0x7f04e8062e30 2024-01-22T05:18:38.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.805+0000 7f04ed200700 1 -- 172.21.15.49:0/2930460940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04e8062e30 msgr2=0x7f04e8063210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:38.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.805+0000 7f04ed200700 1 --2- 172.21.15.49:0/2930460940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04e8062e30 0x7f04e8063210 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f04d800bac0 tx=0x7f04d800b370).stop 2024-01-22T05:18:38.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.805+0000 7f04ed200700 1 -- 172.21.15.49:0/2930460940 shutdown_connections 2024-01-22T05:18:38.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.805+0000 7f04ed200700 1 --2- 172.21.15.49:0/2930460940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04e8139d00 0x7f04e80c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:38.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.805+0000 7f04ed200700 1 --2- 172.21.15.49:0/2930460940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04e8062e30 0x7f04e8063210 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:38.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.805+0000 7f04ed200700 1 -- 172.21.15.49:0/2930460940 >> 172.21.15.49:0/2930460940 conn(0x7f04e80c3940 msgr2=0x7f04e80c3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:38.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.809+0000 7f04ed200700 1 -- 172.21.15.49:0/2930460940 shutdown_connections 2024-01-22T05:18:38.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.809+0000 7f04ed200700 1 -- 172.21.15.49:0/2930460940 wait complete. 2024-01-22T05:18:38.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.813+0000 7f04ed200700 1 Processor -- start 2024-01-22T05:18:38.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.813+0000 7f04ed200700 1 -- start start 2024-01-22T05:18:38.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.813+0000 7f04ed200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04e8062e30 0x7f04e80ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:38.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.813+0000 7f04ed200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04e80c5c50 0x7f04e80bf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:38.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.813+0000 7f04ed200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04e8139d00 0x7f04e80c0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:38.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.813+0000 7f04ed200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80c02b0 con 0x7f04e8139d00 2024-01-22T05:18:38.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.813+0000 7f04ed200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80a7190 con 0x7f04e80c5c50 2024-01-22T05:18:38.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.813+0000 7f04ed200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80c1050 con 0x7f04e8062e30 2024-01-22T05:18:38.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.813+0000 7f04e6800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04e8139d00 0x7f04e80c0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:38.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.813+0000 7f04e6800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04e8139d00 0x7f04e80c0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41904/0 (socket says 172.21.15.49:41904) 2024-01-22T05:18:38.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.813+0000 7f04e6800700 1 -- 172.21.15.49:0/2657402116 learned_addr learned my addr 172.21.15.49:0/2657402116 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:38.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.813+0000 7f04e5e00700 1 --2- 172.21.15.49:0/2657402116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04e8062e30 0x7f04e80ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:38.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.813+0000 7f04e5400700 1 --2- 172.21.15.49:0/2657402116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04e80c5c50 0x7f04e80bf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:38.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.817+0000 7f04e6800700 1 -- 172.21.15.49:0/2657402116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04e8062e30 msgr2=0x7f04e80ab820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:38.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.817+0000 7f04e6800700 1 --2- 172.21.15.49:0/2657402116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04e8062e30 0x7f04e80ab820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:38.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.817+0000 7f04e6800700 1 -- 172.21.15.49:0/2657402116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04e80c5c50 msgr2=0x7f04e80bf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:38.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.817+0000 7f04e6800700 1 --2- 172.21.15.49:0/2657402116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04e80c5c50 0x7f04e80bf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.817+0000 7f04e6800700 1 -- 172.21.15.49:0/2657402116 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d800b6a0 con 0x7f04e8139d00 2024-01-22T05:18:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.817+0000 7f04e6800700 1 --2- 172.21.15.49:0/2657402116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04e8139d00 0x7f04e80c0b60 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f04e0009e90 tx=0x7f04e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.817+0000 7f04dd600700 1 -- 172.21.15.49:0/2657402116 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e000caa0 con 0x7f04e8139d00 2024-01-22T05:18:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.817+0000 7f04dd600700 1 -- 172.21.15.49:0/2657402116 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e000f040 con 0x7f04e8139d00 2024-01-22T05:18:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.817+0000 7f04ed200700 1 -- 172.21.15.49:0/2657402116 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e80bffd0 con 0x7f04e8139d00 2024-01-22T05:18:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.817+0000 7f04dd600700 1 -- 172.21.15.49:0/2657402116 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e000ce10 con 0x7f04e8139d00 2024-01-22T05:18:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.817+0000 7f04ed200700 1 -- 172.21.15.49:0/2657402116 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e80a6e20 con 0x7f04e8139d00 2024-01-22T05:18:38.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.817+0000 7f04ed200700 1 -- 172.21.15.49:0/2657402116 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e80a69a0 con 0x7f04e8139d00 2024-01-22T05:18:38.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.821+0000 7f04dd600700 1 -- 172.21.15.49:0/2657402116 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f04e0013610 con 0x7f04e8139d00 2024-01-22T05:18:38.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.821+0000 7f04dd600700 1 --2- 172.21.15.49:0/2657402116 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04c005a510 0x7f04c005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:38.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.825+0000 7f04dd600700 1 -- 172.21.15.49:0/2657402116 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5992+0+0 (secure 0 0 0) 0x7f04e0075990 con 0x7f04e8139d00 2024-01-22T05:18:38.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.825+0000 7f04e5e00700 1 --2- 172.21.15.49:0/2657402116 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04c005a510 0x7f04c005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:38.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.825+0000 7f04e5e00700 1 --2- 172.21.15.49:0/2657402116 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04c005a510 0x7f04c005c9d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f04d800bfd0 tx=0x7f04d801a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:38.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.829+0000 7f04dd600700 1 -- 172.21.15.49:0/2657402116 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f04e00491b0 con 0x7f04e8139d00 2024-01-22T05:18:38.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:38.993+0000 7f04ed200700 1 -- 172.21.15.49:0/2657402116 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f04e80a69a0 con 0x7f04e8139d00 2024-01-22T05:18:39.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.609+0000 7f04dd600700 1 -- 172.21.15.49:0/2657402116 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v170) v1 ==== 170+0+0 (secure 0 0 0) 0x7f04e80a69a0 con 0x7f04e8139d00 2024-01-22T05:18:39.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.621+0000 7f04ed200700 1 -- 172.21.15.49:0/2657402116 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04c005a510 msgr2=0x7f04c005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:39.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.621+0000 7f04ed200700 1 --2- 172.21.15.49:0/2657402116 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04c005a510 0x7f04c005c9d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f04d800bfd0 tx=0x7f04d801a000).stop 2024-01-22T05:18:39.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.621+0000 7f04ed200700 1 -- 172.21.15.49:0/2657402116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04e8139d00 msgr2=0x7f04e80c0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:39.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.621+0000 7f04ed200700 1 --2- 172.21.15.49:0/2657402116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04e8139d00 0x7f04e80c0b60 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f04e0009e90 tx=0x7f04e000b040).stop 2024-01-22T05:18:39.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.621+0000 7f04ed200700 1 -- 172.21.15.49:0/2657402116 shutdown_connections 2024-01-22T05:18:39.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.621+0000 7f04ed200700 1 --2- 172.21.15.49:0/2657402116 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04c005a510 0x7f04c005c9d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:39.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.621+0000 7f04ed200700 1 --2- 172.21.15.49:0/2657402116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04e8139d00 0x7f04e80c0b60 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:39.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.625+0000 7f04ed200700 1 --2- 172.21.15.49:0/2657402116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04e80c5c50 0x7f04e80bf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:39.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.625+0000 7f04ed200700 1 --2- 172.21.15.49:0/2657402116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04e8062e30 0x7f04e80ab820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:39.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.625+0000 7f04ed200700 1 -- 172.21.15.49:0/2657402116 >> 172.21.15.49:0/2657402116 conn(0x7f04e80c3940 msgr2=0x7f04e81368d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:39.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.629+0000 7f04ed200700 1 -- 172.21.15.49:0/2657402116 shutdown_connections 2024-01-22T05:18:39.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.629+0000 7f04ed200700 1 -- 172.21.15.49:0/2657402116 wait complete. 2024-01-22T05:18:39.654 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-01-22T05:18:39.671 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:18:39.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.837+0000 7f462f400700 1 Processor -- start 2024-01-22T05:18:39.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.837+0000 7f462f400700 1 -- start start 2024-01-22T05:18:39.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f462f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46280c1ce0 0x7f46280bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:39.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f462f400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4628158650 con 0x7f46280bc9c0 2024-01-22T05:18:39.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f462f400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46280bd170 con 0x7f46280a8c20 2024-01-22T05:18:39.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f462f400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4628067c30 con 0x7f46280c1ce0 2024-01-22T05:18:39.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f4627e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46280c1ce0 0x7f46280bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:39.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f462d400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f46280bc9c0 0x7f4628068710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53696/0 (socket says 172.21.15.49:53696) 2024-01-22T05:18:39.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f462d400700 1 -- 172.21.15.49:0/3466571359 learned_addr learned my addr 172.21.15.49:0/3466571359 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:39.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f4627400700 1 -- 172.21.15.49:0/3466571359 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829010865 0 0) 0x7f4620001490 con 0x7f46280bc9c0 2024-01-22T05:18:39.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f4627400700 1 -- 172.21.15.49:0/3466571359 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46080033f0 con 0x7f46280bc9c0 2024-01-22T05:18:39.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f4627400700 1 -- 172.21.15.49:0/3466571359 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196592366 0 0) 0x7f46280bd170 con 0x7f46280a8c20 2024-01-22T05:18:39.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f4627400700 1 -- 172.21.15.49:0/3466571359 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4620001490 con 0x7f46280a8c20 2024-01-22T05:18:39.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f4627e00700 1 -- 172.21.15.49:0/3466571359 >> v1:172.21.15.110:6789/0 conn(0x7f46280a8c20 legacy=0x7f46280c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:39.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f4627e00700 1 -- 172.21.15.49:0/3466571359 >> v1:172.21.15.49:6789/0 conn(0x7f46280bc9c0 legacy=0x7f4628068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:39.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f4627e00700 1 -- 172.21.15.49:0/3466571359 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4628067f10 con 0x7f46280c1ce0 2024-01-22T05:18:39.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f4627e00700 1 --2- 172.21.15.49:0/3466571359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46280c1ce0 0x7f46280bc4d0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f4610006fd0 tx=0x7f4610006f40).ready entity=mon.0 client_cookie=da55b41e77f51cc3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:39.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f4627400700 1 -- 172.21.15.49:0/3466571359 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610005880 con 0x7f46280c1ce0 2024-01-22T05:18:39.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f4627400700 1 -- 172.21.15.49:0/3466571359 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46100059e0 con 0x7f46280c1ce0 2024-01-22T05:18:39.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.841+0000 7f4627400700 1 -- 172.21.15.49:0/3466571359 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610005d60 con 0x7f46280c1ce0 2024-01-22T05:18:39.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.845+0000 7f462f400700 1 -- 172.21.15.49:0/3466571359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46280c1ce0 msgr2=0x7f46280bc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:39.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.845+0000 7f462f400700 1 --2- 172.21.15.49:0/3466571359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46280c1ce0 0x7f46280bc4d0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f4610006fd0 tx=0x7f4610006f40).stop 2024-01-22T05:18:39.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.845+0000 7f462f400700 1 -- 172.21.15.49:0/3466571359 shutdown_connections 2024-01-22T05:18:39.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.845+0000 7f462f400700 1 --2- 172.21.15.49:0/3466571359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46280c1ce0 0x7f46280bc4d0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:39.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.845+0000 7f462f400700 1 -- 172.21.15.49:0/3466571359 >> 172.21.15.49:0/3466571359 conn(0x7f4628062cb0 msgr2=0x7f46280c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:39.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.845+0000 7f462f400700 1 -- 172.21.15.49:0/3466571359 shutdown_connections 2024-01-22T05:18:39.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.845+0000 7f462f400700 1 -- 172.21.15.49:0/3466571359 wait complete. 2024-01-22T05:18:39.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.849+0000 7f462f400700 1 Processor -- start 2024-01-22T05:18:39.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.849+0000 7f462f400700 1 -- start start 2024-01-22T05:18:39.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f462f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46280a8c20 0x7f46280a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:39.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f462f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46280bc9c0 0x7f46280be090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:39.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f462f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46280c1ce0 0x7f462814a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:39.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f462f400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46280a07f0 con 0x7f46280bc9c0 2024-01-22T05:18:39.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f462f400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46280bf410 con 0x7f46280a8c20 2024-01-22T05:18:39.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f462f400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46280be580 con 0x7f46280c1ce0 2024-01-22T05:18:39.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f4627e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46280bc9c0 0x7f46280be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:39.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f4627e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46280bc9c0 0x7f46280be090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41926/0 (socket says 172.21.15.49:41926) 2024-01-22T05:18:39.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f4627e00700 1 -- 172.21.15.49:0/3655668510 learned_addr learned my addr 172.21.15.49:0/3655668510 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:39.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f462ca00700 1 --2- 172.21.15.49:0/3655668510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46280a8c20 0x7f46280a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:39.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f462d400700 1 --2- 172.21.15.49:0/3655668510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46280c1ce0 0x7f462814a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:39.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f4627e00700 1 -- 172.21.15.49:0/3655668510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46280c1ce0 msgr2=0x7f462814a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:39.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f4627e00700 1 --2- 172.21.15.49:0/3655668510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46280c1ce0 0x7f462814a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:39.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f4627e00700 1 -- 172.21.15.49:0/3655668510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46280a8c20 msgr2=0x7f46280a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:39.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f4627e00700 1 --2- 172.21.15.49:0/3655668510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46280a8c20 0x7f46280a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:39.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f4627e00700 1 -- 172.21.15.49:0/3655668510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4610009250 con 0x7f46280bc9c0 2024-01-22T05:18:39.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f4627e00700 1 --2- 172.21.15.49:0/3655668510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46280bc9c0 0x7f46280be090 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f4610006fa0 tx=0x7f4610015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:39.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f461fe00700 1 -- 172.21.15.49:0/3655668510 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610005880 con 0x7f46280bc9c0 2024-01-22T05:18:39.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f461fe00700 1 -- 172.21.15.49:0/3655668510 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461000d6b0 con 0x7f46280bc9c0 2024-01-22T05:18:39.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f462f400700 1 -- 172.21.15.49:0/3655668510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462814a530 con 0x7f46280bc9c0 2024-01-22T05:18:39.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f461fe00700 1 -- 172.21.15.49:0/3655668510 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461000da50 con 0x7f46280bc9c0 2024-01-22T05:18:39.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.853+0000 7f462f400700 1 -- 172.21.15.49:0/3655668510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46280beb60 con 0x7f46280bc9c0 2024-01-22T05:18:39.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.857+0000 7f462f400700 1 -- 172.21.15.49:0/3655668510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46280c0c00 con 0x7f46280bc9c0 2024-01-22T05:18:39.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.857+0000 7f461fe00700 1 -- 172.21.15.49:0/3655668510 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f46100113f0 con 0x7f46280bc9c0 2024-01-22T05:18:39.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.857+0000 7f461fe00700 1 --2- 172.21.15.49:0/3655668510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f460005a540 0x7f460005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:39.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.857+0000 7f461fe00700 1 -- 172.21.15.49:0/3655668510 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f46100758c0 con 0x7f46280bc9c0 2024-01-22T05:18:39.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.857+0000 7f462ca00700 1 --2- 172.21.15.49:0/3655668510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f460005a540 0x7f460005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:39.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.861+0000 7f462ca00700 1 --2- 172.21.15.49:0/3655668510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f460005a540 0x7f460005ca00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f4618003890 tx=0x7f4618007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:39.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:39.865+0000 7f461fe00700 1 -- 172.21.15.49:0/3655668510 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4610048ff0 con 0x7f46280bc9c0 2024-01-22T05:18:39.989 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:18:40.009 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:18:40.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.069+0000 7f462f400700 1 -- 172.21.15.49:0/3655668510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f46280c3df0 con 0x7f46280bc9c0 2024-01-22T05:18:40.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.081+0000 7f461fe00700 1 -- 172.21.15.49:0/3655668510 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v130) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4610023070 con 0x7f46280bc9c0 2024-01-22T05:18:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.089+0000 7f462f400700 1 -- 172.21.15.49:0/3655668510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f460005a540 msgr2=0x7f460005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.089+0000 7f462f400700 1 --2- 172.21.15.49:0/3655668510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f460005a540 0x7f460005ca00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f4618003890 tx=0x7f4618007bd0).stop 2024-01-22T05:18:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.089+0000 7f462f400700 1 -- 172.21.15.49:0/3655668510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46280bc9c0 msgr2=0x7f46280be090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.089+0000 7f462f400700 1 --2- 172.21.15.49:0/3655668510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46280bc9c0 0x7f46280be090 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f4610006fa0 tx=0x7f4610015000).stop 2024-01-22T05:18:40.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.093+0000 7f462f400700 1 -- 172.21.15.49:0/3655668510 shutdown_connections 2024-01-22T05:18:40.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.093+0000 7f462f400700 1 --2- 172.21.15.49:0/3655668510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f460005a540 0x7f460005ca00 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.093+0000 7f462f400700 1 --2- 172.21.15.49:0/3655668510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46280c1ce0 0x7f462814a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.093+0000 7f462f400700 1 --2- 172.21.15.49:0/3655668510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46280bc9c0 0x7f46280be090 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.093+0000 7f462f400700 1 --2- 172.21.15.49:0/3655668510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46280a8c20 0x7f46280a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.093+0000 7f462f400700 1 -- 172.21.15.49:0/3655668510 >> 172.21.15.49:0/3655668510 conn(0x7f4628062cb0 msgr2=0x7f46280c5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:40.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.093+0000 7f462f400700 1 -- 172.21.15.49:0/3655668510 shutdown_connections 2024-01-22T05:18:40.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.093+0000 7f462f400700 1 -- 172.21.15.49:0/3655668510 wait complete. 2024-01-22T05:18:40.107 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 24 and data pool 25 2024-01-22T05:18:40.129 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:18:40.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.329+0000 7f5e76a00700 1 Processor -- start 2024-01-22T05:18:40.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.329+0000 7f5e76a00700 1 -- start start 2024-01-22T05:18:40.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.333+0000 7f5e76a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e70153280 0x7f5e70153660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:40.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.333+0000 7f5e76a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5e70068aa0 0x7f5e70068f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:40.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.333+0000 7f5e76a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e70067a90 con 0x7f5e70155470 2024-01-22T05:18:40.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.333+0000 7f5e76a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e70068610 con 0x7f5e70068aa0 2024-01-22T05:18:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.333+0000 7f5e76a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e70069410 con 0x7f5e70153280 2024-01-22T05:18:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.333+0000 7f5e75600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e70153280 0x7f5e70153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.333+0000 7f5e74c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5e70068aa0 0x7f5e70068f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.333+0000 7f5e75600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e70153280 0x7f5e70153660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:51864/0 (socket says 172.21.15.49:51864) 2024-01-22T05:18:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.333+0000 7f5e75600700 1 -- 172.21.15.49:0/609047837 learned_addr learned my addr 172.21.15.49:0/609047837 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:40.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.333+0000 7f5e75600700 1 -- 172.21.15.49:0/609047837 >> v2:172.21.15.110:3300/0 conn(0x7f5e70068aa0 msgr2=0x7f5e70068f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:40.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.333+0000 7f5e75600700 1 --2- 172.21.15.49:0/609047837 >> v2:172.21.15.110:3300/0 conn(0x7f5e70068aa0 0x7f5e70068f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.337+0000 7f5e75600700 1 -- 172.21.15.49:0/609047837 >> v1:172.21.15.110:6789/0 conn(0x7f5e70155470 legacy=0x7f5e700ab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:40.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.337+0000 7f5e75600700 1 -- 172.21.15.49:0/609047837 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e700a99e0 con 0x7f5e70153280 2024-01-22T05:18:40.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.337+0000 7f5e75600700 1 --2- 172.21.15.49:0/609047837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e70153280 0x7f5e70153660 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f5e60006fd0 tx=0x7f5e600090f0).ready entity=mon.2 client_cookie=9705227a48230d5d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.337+0000 7f5e6fe00700 1 -- 172.21.15.49:0/609047837 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000b580 con 0x7f5e70153280 2024-01-22T05:18:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.337+0000 7f5e6fe00700 1 -- 172.21.15.49:0/609047837 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6000b6e0 con 0x7f5e70153280 2024-01-22T05:18:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.337+0000 7f5e6fe00700 1 -- 172.21.15.49:0/609047837 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000ba60 con 0x7f5e70153280 2024-01-22T05:18:40.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.337+0000 7f5e76a00700 1 -- 172.21.15.49:0/609047837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e70153280 msgr2=0x7f5e70153660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:40.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.337+0000 7f5e76a00700 1 --2- 172.21.15.49:0/609047837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e70153280 0x7f5e70153660 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f5e60006fd0 tx=0x7f5e600090f0).stop 2024-01-22T05:18:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.337+0000 7f5e76a00700 1 -- 172.21.15.49:0/609047837 shutdown_connections 2024-01-22T05:18:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.337+0000 7f5e76a00700 1 --2- 172.21.15.49:0/609047837 >> v2:172.21.15.110:3300/0 conn(0x7f5e70068aa0 0x7f5e70068f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.337+0000 7f5e76a00700 1 --2- 172.21.15.49:0/609047837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e70153280 0x7f5e70153660 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.337+0000 7f5e76a00700 1 -- 172.21.15.49:0/609047837 >> 172.21.15.49:0/609047837 conn(0x7f5e700c6530 msgr2=0x7f5e700c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.337+0000 7f5e76a00700 1 -- 172.21.15.49:0/609047837 shutdown_connections 2024-01-22T05:18:40.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.337+0000 7f5e76a00700 1 -- 172.21.15.49:0/609047837 wait complete. 2024-01-22T05:18:40.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.341+0000 7f5e76a00700 1 Processor -- start 2024-01-22T05:18:40.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.341+0000 7f5e76a00700 1 -- start start 2024-01-22T05:18:40.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e76a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e70068aa0 0x7f5e7014a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:40.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e76a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e70153280 0x7f5e70066e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:40.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e76a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e70155470 0x7f5e70168f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:40.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e76a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e70067330 con 0x7f5e70153280 2024-01-22T05:18:40.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e76a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e701693f0 con 0x7f5e70068aa0 2024-01-22T05:18:40.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e76a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7014db50 con 0x7f5e70155470 2024-01-22T05:18:40.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e74c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e70153280 0x7f5e70066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:40.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e74c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e70153280 0x7f5e70066e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41932/0 (socket says 172.21.15.49:41932) 2024-01-22T05:18:40.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e74c00700 1 -- 172.21.15.49:0/661693793 learned_addr learned my addr 172.21.15.49:0/661693793 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:40.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e75600700 1 --2- 172.21.15.49:0/661693793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e70068aa0 0x7f5e7014a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:40.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e76000700 1 --2- 172.21.15.49:0/661693793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e70155470 0x7f5e70168f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:40.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e74c00700 1 -- 172.21.15.49:0/661693793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e70155470 msgr2=0x7f5e70168f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:40.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e74c00700 1 --2- 172.21.15.49:0/661693793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e70155470 0x7f5e70168f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e74c00700 1 -- 172.21.15.49:0/661693793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e70068aa0 msgr2=0x7f5e7014a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:40.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e74c00700 1 --2- 172.21.15.49:0/661693793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e70068aa0 0x7f5e7014a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e74c00700 1 -- 172.21.15.49:0/661693793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60009370 con 0x7f5e70153280 2024-01-22T05:18:40.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e75600700 1 --2- 172.21.15.49:0/661693793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e70068aa0 0x7f5e7014a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:40.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e74c00700 1 --2- 172.21.15.49:0/661693793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e70153280 0x7f5e70066e40 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7f5e5800e900 tx=0x7f5e58009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:40.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e6cc00700 1 -- 172.21.15.49:0/661693793 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5800eea0 con 0x7f5e70153280 2024-01-22T05:18:40.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e6cc00700 1 -- 172.21.15.49:0/661693793 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5800c850 con 0x7f5e70153280 2024-01-22T05:18:40.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.345+0000 7f5e76a00700 1 -- 172.21.15.49:0/661693793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e70067520 con 0x7f5e70153280 2024-01-22T05:18:40.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.349+0000 7f5e6cc00700 1 -- 172.21.15.49:0/661693793 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5800cbd0 con 0x7f5e70153280 2024-01-22T05:18:40.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.349+0000 7f5e76a00700 1 -- 172.21.15.49:0/661693793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7014d500 con 0x7f5e70153280 2024-01-22T05:18:40.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.349+0000 7f5e76a00700 1 -- 172.21.15.49:0/661693793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7005fd40 con 0x7f5e70153280 2024-01-22T05:18:40.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.353+0000 7f5e6cc00700 1 -- 172.21.15.49:0/661693793 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5e5801b400 con 0x7f5e70153280 2024-01-22T05:18:40.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.353+0000 7f5e6cc00700 1 --2- 172.21.15.49:0/661693793 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e4805a510 0x7f5e4805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:40.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.353+0000 7f5e6cc00700 1 -- 172.21.15.49:0/661693793 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f5e58074e80 con 0x7f5e70153280 2024-01-22T05:18:40.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.353+0000 7f5e75600700 1 --2- 172.21.15.49:0/661693793 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e4805a510 0x7f5e4805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:40.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.353+0000 7f5e75600700 1 --2- 172.21.15.49:0/661693793 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e4805a510 0x7f5e4805c9d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f5e60009130 tx=0x7f5e60017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:40.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.357+0000 7f5e6cc00700 1 -- 172.21.15.49:0/661693793 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5e580483e0 con 0x7f5e70153280 2024-01-22T05:18:40.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.525+0000 7f5e76a00700 1 -- 172.21.15.49:0/661693793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e7014e880 con 0x7f5e70153280 2024-01-22T05:18:40.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.525+0000 7f5e6cc00700 1 -- 172.21.15.49:0/661693793 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+17191 (secure 0 0 0) 0x7f5e5804ba00 con 0x7f5e70153280 2024-01-22T05:18:40.529 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:40.529 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":171,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:18:40.075883+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:18:38.197050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-01-22T05:18:39.072620+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:18:40.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.533+0000 7f5e76a00700 1 -- 172.21.15.49:0/661693793 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e4805a510 msgr2=0x7f5e4805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:40.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.533+0000 7f5e76a00700 1 --2- 172.21.15.49:0/661693793 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e4805a510 0x7f5e4805c9d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f5e60009130 tx=0x7f5e60017000).stop 2024-01-22T05:18:40.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.533+0000 7f5e76a00700 1 -- 172.21.15.49:0/661693793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e70153280 msgr2=0x7f5e70066e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:40.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.533+0000 7f5e76a00700 1 --2- 172.21.15.49:0/661693793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e70153280 0x7f5e70066e40 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7f5e5800e900 tx=0x7f5e58009060).stop 2024-01-22T05:18:40.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.533+0000 7f5e76a00700 1 -- 172.21.15.49:0/661693793 shutdown_connections 2024-01-22T05:18:40.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.533+0000 7f5e76a00700 1 --2- 172.21.15.49:0/661693793 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e4805a510 0x7f5e4805c9d0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.533+0000 7f5e76a00700 1 --2- 172.21.15.49:0/661693793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e70155470 0x7f5e70168f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.533+0000 7f5e76a00700 1 --2- 172.21.15.49:0/661693793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e70153280 0x7f5e70066e40 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.533+0000 7f5e76a00700 1 --2- 172.21.15.49:0/661693793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e70068aa0 0x7f5e7014a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.533+0000 7f5e76a00700 1 -- 172.21.15.49:0/661693793 >> 172.21.15.49:0/661693793 conn(0x7f5e700c6530 msgr2=0x7f5e700c5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:40.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.533+0000 7f5e76a00700 1 -- 172.21.15.49:0/661693793 shutdown_connections 2024-01-22T05:18:40.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.533+0000 7f5e76a00700 1 -- 172.21.15.49:0/661693793 wait complete. 2024-01-22T05:18:40.560 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:18:40.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.717+0000 7fd22fe00700 1 Processor -- start 2024-01-22T05:18:40.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.717+0000 7fd22fe00700 1 -- start start 2024-01-22T05:18:40.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.721+0000 7fd22fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2300a7760 0x7fd2300a7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:40.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.721+0000 7fd22fe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd230068900 0x7fd2300a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:40.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.721+0000 7fd22fe00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2300a72d0 con 0x7fd2300684c0 2024-01-22T05:18:40.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.721+0000 7fd22fe00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2300a66c0 con 0x7fd2300a7760 2024-01-22T05:18:40.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.721+0000 7fd22fe00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2300a69a0 con 0x7fd230068900 2024-01-22T05:18:40.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.721+0000 7fd22ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2300a7760 0x7fd2300a7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:40.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.721+0000 7fd22e000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd2300684c0 0x7fd2300a96e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53712/0 (socket says 172.21.15.49:53712) 2024-01-22T05:18:40.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.721+0000 7fd22e000700 1 -- 172.21.15.49:0/2066386517 learned_addr learned my addr 172.21.15.49:0/2066386517 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:40.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22f400700 1 --2- 172.21.15.49:0/2066386517 >> v2:172.21.15.110:3300/0 conn(0x7fd230068900 0x7fd2300a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:40.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22ea00700 1 -- 172.21.15.49:0/2066386517 >> v2:172.21.15.110:3300/0 conn(0x7fd230068900 msgr2=0x7fd2300a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:40.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22ea00700 1 --2- 172.21.15.49:0/2066386517 >> v2:172.21.15.110:3300/0 conn(0x7fd230068900 0x7fd2300a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22ea00700 1 -- 172.21.15.49:0/2066386517 >> v1:172.21.15.49:6789/0 conn(0x7fd2300684c0 legacy=0x7fd2300a96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:40.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22ea00700 1 -- 172.21.15.49:0/2066386517 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300a6c80 con 0x7fd2300a7760 2024-01-22T05:18:40.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22f400700 1 --2- 172.21.15.49:0/2066386517 >> v2:172.21.15.110:3300/0 conn(0x7fd230068900 0x7fd2300a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22ea00700 1 --2- 172.21.15.49:0/2066386517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2300a7760 0x7fd2300a7b40 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7fd2300a93b0 tx=0x7fd220009060).ready entity=mon.0 client_cookie=37b4ec04af1384e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22d600700 1 -- 172.21.15.49:0/2066386517 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000b580 con 0x7fd2300a7760 2024-01-22T05:18:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22d600700 1 -- 172.21.15.49:0/2066386517 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22000b6e0 con 0x7fd2300a7760 2024-01-22T05:18:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22d600700 1 -- 172.21.15.49:0/2066386517 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000ba60 con 0x7fd2300a7760 2024-01-22T05:18:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22fe00700 1 -- 172.21.15.49:0/2066386517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2300a7760 msgr2=0x7fd2300a7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22fe00700 1 --2- 172.21.15.49:0/2066386517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2300a7760 0x7fd2300a7b40 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7fd2300a93b0 tx=0x7fd220009060).stop 2024-01-22T05:18:40.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22fe00700 1 -- 172.21.15.49:0/2066386517 shutdown_connections 2024-01-22T05:18:40.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22fe00700 1 --2- 172.21.15.49:0/2066386517 >> v2:172.21.15.110:3300/0 conn(0x7fd230068900 0x7fd2300a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22fe00700 1 --2- 172.21.15.49:0/2066386517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2300a7760 0x7fd2300a7b40 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22fe00700 1 -- 172.21.15.49:0/2066386517 >> 172.21.15.49:0/2066386517 conn(0x7fd2300c6530 msgr2=0x7fd2300c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:40.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22fe00700 1 -- 172.21.15.49:0/2066386517 shutdown_connections 2024-01-22T05:18:40.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.725+0000 7fd22fe00700 1 -- 172.21.15.49:0/2066386517 wait complete. 2024-01-22T05:18:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.729+0000 7fd22fe00700 1 Processor -- start 2024-01-22T05:18:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.729+0000 7fd22fe00700 1 -- start start 2024-01-22T05:18:40.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.729+0000 7fd22fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2300684c0 0x7fd2301639f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:40.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.729+0000 7fd22fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd230068900 0x7fd23013f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:40.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2300a7760 0x7fd23013f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:40.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22fe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd230164e50 con 0x7fd2300684c0 2024-01-22T05:18:40.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd230164240 con 0x7fd2300a7760 2024-01-22T05:18:40.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd230164520 con 0x7fd230068900 2024-01-22T05:18:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2300684c0 0x7fd2301639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2300684c0 0x7fd2301639f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41936/0 (socket says 172.21.15.49:41936) 2024-01-22T05:18:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22ea00700 1 -- 172.21.15.49:0/1482711916 learned_addr learned my addr 172.21.15.49:0/1482711916 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22e000700 1 --2- 172.21.15.49:0/1482711916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd230068900 0x7fd23013f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22f400700 1 --2- 172.21.15.49:0/1482711916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2300a7760 0x7fd23013f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:40.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22ea00700 1 -- 172.21.15.49:0/1482711916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd230068900 msgr2=0x7fd23013f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:40.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22ea00700 1 --2- 172.21.15.49:0/1482711916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd230068900 0x7fd23013f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22ea00700 1 -- 172.21.15.49:0/1482711916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2300a7760 msgr2=0x7fd23013f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22ea00700 1 --2- 172.21.15.49:0/1482711916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2300a7760 0x7fd23013f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22ea00700 1 -- 172.21.15.49:0/1482711916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2200092a0 con 0x7fd2300684c0 2024-01-22T05:18:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22f400700 1 --2- 172.21.15.49:0/1482711916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2300a7760 0x7fd23013f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22ea00700 1 --2- 172.21.15.49:0/1482711916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2300684c0 0x7fd2301639f0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7fd220009fd0 tx=0x7fd220017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd226000700 1 -- 172.21.15.49:0/1482711916 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000b850 con 0x7fd2300684c0 2024-01-22T05:18:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd226000700 1 -- 172.21.15.49:0/1482711916 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22000b9b0 con 0x7fd2300684c0 2024-01-22T05:18:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22fe00700 1 -- 172.21.15.49:0/1482711916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd230164800 con 0x7fd2300684c0 2024-01-22T05:18:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd226000700 1 -- 172.21.15.49:0/1482711916 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22001b660 con 0x7fd2300684c0 2024-01-22T05:18:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.733+0000 7fd22fe00700 1 -- 172.21.15.49:0/1482711916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd230163ee0 con 0x7fd2300684c0 2024-01-22T05:18:40.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.737+0000 7fd22fe00700 1 -- 172.21.15.49:0/1482711916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23005fd40 con 0x7fd2300684c0 2024-01-22T05:18:40.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.737+0000 7fd226000700 1 -- 172.21.15.49:0/1482711916 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd22001ba90 con 0x7fd2300684c0 2024-01-22T05:18:40.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.737+0000 7fd226000700 1 --2- 172.21.15.49:0/1482711916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd20805a510 0x7fd20805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:40.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.741+0000 7fd226000700 1 -- 172.21.15.49:0/1482711916 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd220075e80 con 0x7fd2300684c0 2024-01-22T05:18:40.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.741+0000 7fd22e000700 1 --2- 172.21.15.49:0/1482711916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd20805a510 0x7fd20805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:40.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.741+0000 7fd22e000700 1 --2- 172.21.15.49:0/1482711916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd20805a510 0x7fd20805c9d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fd2300c61a0 tx=0x7fd218009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:40.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.745+0000 7fd226000700 1 -- 172.21.15.49:0/1482711916 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd220049440 con 0x7fd2300684c0 2024-01-22T05:18:40.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.905+0000 7fd22fe00700 1 -- 172.21.15.49:0/1482711916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd230066f30 con 0x7fd2300684c0 2024-01-22T05:18:40.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.905+0000 7fd226000700 1 -- 172.21.15.49:0/1482711916 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+17191 (secure 0 0 0) 0x7fd220006b30 con 0x7fd2300684c0 2024-01-22T05:18:40.910 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:40.910 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":171,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:18:40.075883+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:18:38.197050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-01-22T05:18:39.072620+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:18:40.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.913+0000 7fd22fe00700 1 -- 172.21.15.49:0/1482711916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd20805a510 msgr2=0x7fd20805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:40.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.913+0000 7fd22fe00700 1 --2- 172.21.15.49:0/1482711916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd20805a510 0x7fd20805c9d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fd2300c61a0 tx=0x7fd218009040).stop 2024-01-22T05:18:40.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.913+0000 7fd22fe00700 1 -- 172.21.15.49:0/1482711916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2300684c0 msgr2=0x7fd2301639f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:40.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.913+0000 7fd22fe00700 1 --2- 172.21.15.49:0/1482711916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2300684c0 0x7fd2301639f0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7fd220009fd0 tx=0x7fd220017000).stop 2024-01-22T05:18:40.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.913+0000 7fd22fe00700 1 -- 172.21.15.49:0/1482711916 shutdown_connections 2024-01-22T05:18:40.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.913+0000 7fd22fe00700 1 --2- 172.21.15.49:0/1482711916 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd20805a510 0x7fd20805c9d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.913+0000 7fd22fe00700 1 --2- 172.21.15.49:0/1482711916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2300a7760 0x7fd23013f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.913+0000 7fd22fe00700 1 --2- 172.21.15.49:0/1482711916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd230068900 0x7fd23013f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.913+0000 7fd22fe00700 1 --2- 172.21.15.49:0/1482711916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2300684c0 0x7fd2301639f0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:40.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.913+0000 7fd22fe00700 1 -- 172.21.15.49:0/1482711916 >> 172.21.15.49:0/1482711916 conn(0x7fd2300c6530 msgr2=0x7fd2300a1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:40.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.913+0000 7fd22fe00700 1 -- 172.21.15.49:0/1482711916 shutdown_connections 2024-01-22T05:18:40.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:40.913+0000 7fd22fe00700 1 -- 172.21.15.49:0/1482711916 wait complete. 2024-01-22T05:18:40.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:18:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.101+0000 7f2d39c00700 1 Processor -- start 2024-01-22T05:18:41.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.101+0000 7f2d39c00700 1 -- start start 2024-01-22T05:18:41.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.101+0000 7f2d39c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2d34068460 0x7f2d340a7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:41.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.101+0000 7f2d39c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d340bdc70 con 0x7f2d340a7c40 2024-01-22T05:18:41.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.101+0000 7f2d39c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d340c4040 con 0x7f2d34155be0 2024-01-22T05:18:41.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.101+0000 7f2d39c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d340bd9d0 con 0x7f2d34068460 2024-01-22T05:18:41.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.101+0000 7f2d32000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2d340a7c40 0x7f2d341554d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53722/0 (socket says 172.21.15.49:53722) 2024-01-22T05:18:41.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.101+0000 7f2d32000700 1 -- 172.21.15.49:0/691349689 learned_addr learned my addr 172.21.15.49:0/691349689 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:41.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.101+0000 7f2d32a00700 1 --2- 172.21.15.49:0/691349689 >> v2:172.21.15.110:3300/0 conn(0x7f2d34068460 0x7f2d340a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:41.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d31600700 1 -- 172.21.15.49:0/691349689 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410392361 0 0) 0x7f2d340bdc70 con 0x7f2d340a7c40 2024-01-22T05:18:41.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d31600700 1 -- 172.21.15.49:0/691349689 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d140033f0 con 0x7f2d340a7c40 2024-01-22T05:18:41.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d31600700 1 -- 172.21.15.49:0/691349689 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478144645 0 0) 0x7f2d340c4040 con 0x7f2d34155be0 2024-01-22T05:18:41.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d31600700 1 -- 172.21.15.49:0/691349689 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d340bdc70 con 0x7f2d34155be0 2024-01-22T05:18:41.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d32a00700 1 -- 172.21.15.49:0/691349689 >> v1:172.21.15.110:6789/0 conn(0x7f2d34155be0 legacy=0x7f2d340aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:41.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d32a00700 1 -- 172.21.15.49:0/691349689 >> v1:172.21.15.49:6789/0 conn(0x7f2d340a7c40 legacy=0x7f2d341554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:41.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d31600700 1 -- 172.21.15.49:0/691349689 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1923714465 0 0) 0x7f2d140033f0 con 0x7f2d340a7c40 2024-01-22T05:18:41.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d32a00700 1 -- 172.21.15.49:0/691349689 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d340a8040 con 0x7f2d34068460 2024-01-22T05:18:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d32a00700 1 --2- 172.21.15.49:0/691349689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d34068460 0x7f2d340a7750 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f2d24009760 tx=0x7f2d24009060).ready entity=mon.1 client_cookie=4d3beeb97e7d43f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d31600700 1 -- 172.21.15.49:0/691349689 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2400d4a0 con 0x7f2d34068460 2024-01-22T05:18:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d31600700 1 -- 172.21.15.49:0/691349689 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2400d600 con 0x7f2d34068460 2024-01-22T05:18:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d31600700 1 -- 172.21.15.49:0/691349689 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2400d980 con 0x7f2d34068460 2024-01-22T05:18:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d39c00700 1 -- 172.21.15.49:0/691349689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d34068460 msgr2=0x7f2d340a7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d39c00700 1 --2- 172.21.15.49:0/691349689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d34068460 0x7f2d340a7750 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f2d24009760 tx=0x7f2d24009060).stop 2024-01-22T05:18:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d39c00700 1 -- 172.21.15.49:0/691349689 shutdown_connections 2024-01-22T05:18:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d39c00700 1 --2- 172.21.15.49:0/691349689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d34068460 0x7f2d340a7750 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d39c00700 1 -- 172.21.15.49:0/691349689 >> 172.21.15.49:0/691349689 conn(0x7f2d340c8780 msgr2=0x7f2d340c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d39c00700 1 -- 172.21.15.49:0/691349689 shutdown_connections 2024-01-22T05:18:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.105+0000 7f2d39c00700 1 -- 172.21.15.49:0/691349689 wait complete. 2024-01-22T05:18:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.109+0000 7f2d39c00700 1 Processor -- start 2024-01-22T05:18:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.109+0000 7f2d39c00700 1 -- start start 2024-01-22T05:18:41.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d39c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d34068460 0x7f2d34164000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:41.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d39c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d340a7c40 0x7f2d340ab710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d39c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d34155be0 0x7f2d340a9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d39c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340ac8b0 con 0x7f2d34068460 2024-01-22T05:18:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d39c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3414cdb0 con 0x7f2d34155be0 2024-01-22T05:18:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d39c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340ac010 con 0x7f2d340a7c40 2024-01-22T05:18:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d32a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d34068460 0x7f2d34164000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d32a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d34068460 0x7f2d34164000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41942/0 (socket says 172.21.15.49:41942) 2024-01-22T05:18:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d32a00700 1 -- 172.21.15.49:0/2088748017 learned_addr learned my addr 172.21.15.49:0/2088748017 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:41.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d32000700 1 --2- 172.21.15.49:0/2088748017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d340a7c40 0x7f2d340ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:41.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d33400700 1 --2- 172.21.15.49:0/2088748017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d34155be0 0x7f2d340a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:41.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d32a00700 1 -- 172.21.15.49:0/2088748017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d340a7c40 msgr2=0x7f2d340ab710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:41.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d32a00700 1 --2- 172.21.15.49:0/2088748017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d340a7c40 0x7f2d340ab710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:41.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d32a00700 1 -- 172.21.15.49:0/2088748017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d34155be0 msgr2=0x7f2d340a9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:41.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d32a00700 1 --2- 172.21.15.49:0/2088748017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d34155be0 0x7f2d340a9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:41.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d32a00700 1 -- 172.21.15.49:0/2088748017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d240092a0 con 0x7f2d34068460 2024-01-22T05:18:41.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d32a00700 1 --2- 172.21.15.49:0/2088748017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d34068460 0x7f2d34164000 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7f2d340c62c0 tx=0x7f2d24016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:41.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d2a000700 1 -- 172.21.15.49:0/2088748017 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2400dcf0 con 0x7f2d34068460 2024-01-22T05:18:41.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d2a000700 1 -- 172.21.15.49:0/2088748017 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2400de50 con 0x7f2d34068460 2024-01-22T05:18:41.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d2a000700 1 -- 172.21.15.49:0/2088748017 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2400d980 con 0x7f2d34068460 2024-01-22T05:18:41.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d39c00700 1 -- 172.21.15.49:0/2088748017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d340ac2f0 con 0x7f2d34068460 2024-01-22T05:18:41.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.113+0000 7f2d39c00700 1 -- 172.21.15.49:0/2088748017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3414cfe0 con 0x7f2d34068460 2024-01-22T05:18:41.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.117+0000 7f2d39c00700 1 -- 172.21.15.49:0/2088748017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3414d200 con 0x7f2d34068460 2024-01-22T05:18:41.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.117+0000 7f2d2a000700 1 -- 172.21.15.49:0/2088748017 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2d2401d640 con 0x7f2d34068460 2024-01-22T05:18:41.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.117+0000 7f2d2a000700 1 --2- 172.21.15.49:0/2088748017 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d0c05a510 0x7f2d0c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:41.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.117+0000 7f2d2a000700 1 -- 172.21.15.49:0/2088748017 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2d24075fe0 con 0x7f2d34068460 2024-01-22T05:18:41.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.121+0000 7f2d32000700 1 --2- 172.21.15.49:0/2088748017 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d0c05a510 0x7f2d0c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:41.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.121+0000 7f2d32000700 1 --2- 172.21.15.49:0/2088748017 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d0c05a510 0x7f2d0c05c9d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f2d34153590 tx=0x7f2d1c007940).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:41.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.125+0000 7f2d2a000700 1 -- 172.21.15.49:0/2088748017 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2d240a4b00 con 0x7f2d34068460 2024-01-22T05:18:41.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:41.325+0000 7f2d39c00700 1 -- 172.21.15.49:0/2088748017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2d340689d0 con 0x7f2d34068460 2024-01-22T05:18:42.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.105+0000 7f2d2a000700 1 -- 172.21.15.49:0/2088748017 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v133) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2d240495a0 con 0x7f2d34068460 2024-01-22T05:18:42.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.109+0000 7f2d39c00700 1 -- 172.21.15.49:0/2088748017 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d0c05a510 msgr2=0x7f2d0c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:42.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.109+0000 7f2d39c00700 1 --2- 172.21.15.49:0/2088748017 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d0c05a510 0x7f2d0c05c9d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f2d34153590 tx=0x7f2d1c007940).stop 2024-01-22T05:18:42.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.109+0000 7f2d39c00700 1 -- 172.21.15.49:0/2088748017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d34068460 msgr2=0x7f2d34164000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:42.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.109+0000 7f2d39c00700 1 --2- 172.21.15.49:0/2088748017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d34068460 0x7f2d34164000 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7f2d340c62c0 tx=0x7f2d24016000).stop 2024-01-22T05:18:42.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.109+0000 7f2d39c00700 1 -- 172.21.15.49:0/2088748017 shutdown_connections 2024-01-22T05:18:42.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.109+0000 7f2d39c00700 1 --2- 172.21.15.49:0/2088748017 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d0c05a510 0x7f2d0c05c9d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:42.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.109+0000 7f2d39c00700 1 --2- 172.21.15.49:0/2088748017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d34155be0 0x7f2d340a9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:42.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.109+0000 7f2d39c00700 1 --2- 172.21.15.49:0/2088748017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d340a7c40 0x7f2d340ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:42.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.109+0000 7f2d39c00700 1 --2- 172.21.15.49:0/2088748017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d34068460 0x7f2d34164000 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:42.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.109+0000 7f2d39c00700 1 -- 172.21.15.49:0/2088748017 >> 172.21.15.49:0/2088748017 conn(0x7f2d340c8780 msgr2=0x7f2d340c3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:42.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.109+0000 7f2d39c00700 1 -- 172.21.15.49:0/2088748017 shutdown_connections 2024-01-22T05:18:42.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.109+0000 7f2d39c00700 1 -- 172.21.15.49:0/2088748017 wait complete. 2024-01-22T05:18:42.136 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T05:18:42.136 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:18:42.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.305+0000 7f04c4c00700 1 Processor -- start 2024-01-22T05:18:42.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.305+0000 7f04c4c00700 1 -- start start 2024-01-22T05:18:42.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.309+0000 7f04c4c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04c00c58c0 0x7f04c00c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:42.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.309+0000 7f04c4c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c00c36f0 con 0x7f04c0068f00 2024-01-22T05:18:42.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.309+0000 7f04c4c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c00c64a0 con 0x7f04c0068aa0 2024-01-22T05:18:42.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.309+0000 7f04c4c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0154180 con 0x7f04c00c58c0 2024-01-22T05:18:42.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.309+0000 7f04be800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f04c0068f00 0x7f04c0157ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53724/0 (socket says 172.21.15.49:53724) 2024-01-22T05:18:42.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.309+0000 7f04be800700 1 -- 172.21.15.49:0/598235971 learned_addr learned my addr 172.21.15.49:0/598235971 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:42.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.309+0000 7f04bde00700 1 --2- 172.21.15.49:0/598235971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04c00c58c0 0x7f04c00c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:42.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.309+0000 7f04bca00700 1 -- 172.21.15.49:0/598235971 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154124906 0 0) 0x7f04c00c36f0 con 0x7f04c0068f00 2024-01-22T05:18:42.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.313+0000 7f04bca00700 1 -- 172.21.15.49:0/598235971 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04a00033f0 con 0x7f04c0068f00 2024-01-22T05:18:42.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.313+0000 7f04bca00700 1 -- 172.21.15.49:0/598235971 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031774067 0 0) 0x7f04c00c64a0 con 0x7f04c0068aa0 2024-01-22T05:18:42.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.313+0000 7f04bde00700 1 -- 172.21.15.49:0/598235971 >> v1:172.21.15.110:6789/0 conn(0x7f04c0068aa0 legacy=0x7f04c01577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:42.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.313+0000 7f04bde00700 1 -- 172.21.15.49:0/598235971 >> v1:172.21.15.49:6789/0 conn(0x7f04c0068f00 legacy=0x7f04c0157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:42.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.313+0000 7f04bde00700 1 -- 172.21.15.49:0/598235971 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c00c14b0 con 0x7f04c00c58c0 2024-01-22T05:18:42.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.313+0000 7f04bde00700 1 --2- 172.21.15.49:0/598235971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04c00c58c0 0x7f04c00c5ca0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f04b0009760 tx=0x7f04b0006f40).ready entity=mon.2 client_cookie=aa4a5a9645dbad39 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:42.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.313+0000 7f04bca00700 1 -- 172.21.15.49:0/598235971 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0005880 con 0x7f04c00c58c0 2024-01-22T05:18:42.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.313+0000 7f04bca00700 1 -- 172.21.15.49:0/598235971 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b00059e0 con 0x7f04c00c58c0 2024-01-22T05:18:42.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.313+0000 7f04bca00700 1 -- 172.21.15.49:0/598235971 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0005d60 con 0x7f04c00c58c0 2024-01-22T05:18:42.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.313+0000 7f04c4c00700 1 -- 172.21.15.49:0/598235971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04c00c58c0 msgr2=0x7f04c00c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:42.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.313+0000 7f04c4c00700 1 --2- 172.21.15.49:0/598235971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04c00c58c0 0x7f04c00c5ca0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f04b0009760 tx=0x7f04b0006f40).stop 2024-01-22T05:18:42.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.313+0000 7f04c4c00700 1 -- 172.21.15.49:0/598235971 shutdown_connections 2024-01-22T05:18:42.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.313+0000 7f04c4c00700 1 --2- 172.21.15.49:0/598235971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04c00c58c0 0x7f04c00c5ca0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:42.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.313+0000 7f04c4c00700 1 -- 172.21.15.49:0/598235971 >> 172.21.15.49:0/598235971 conn(0x7f04c0065f90 msgr2=0x7f04c00663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:42.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.317+0000 7f04c4c00700 1 -- 172.21.15.49:0/598235971 shutdown_connections 2024-01-22T05:18:42.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.317+0000 7f04c4c00700 1 -- 172.21.15.49:0/598235971 wait complete. 2024-01-22T05:18:42.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.317+0000 7f04c4c00700 1 Processor -- start 2024-01-22T05:18:42.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.317+0000 7f04c4c00700 1 -- start start 2024-01-22T05:18:42.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04c4c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04c0068aa0 0x7f04c01403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:42.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04c4c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c0068f00 0x7f04c0156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:42.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04c4c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c00c58c0 0x7f04c00a9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:42.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04c4c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c013f7f0 con 0x7f04c0068f00 2024-01-22T05:18:42.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04c4c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0141570 con 0x7f04c00c58c0 2024-01-22T05:18:42.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04c4c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0140960 con 0x7f04c0068aa0 2024-01-22T05:18:42.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04bd400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c0068f00 0x7f04c0156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:42.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04bd400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c0068f00 0x7f04c0156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41948/0 (socket says 172.21.15.49:41948) 2024-01-22T05:18:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04bd400700 1 -- 172.21.15.49:0/1703479314 learned_addr learned my addr 172.21.15.49:0/1703479314 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04be800700 1 --2- 172.21.15.49:0/1703479314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c00c58c0 0x7f04c00a9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04bde00700 1 --2- 172.21.15.49:0/1703479314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04c0068aa0 0x7f04c01403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04bd400700 1 -- 172.21.15.49:0/1703479314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04c0068aa0 msgr2=0x7f04c01403d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04bd400700 1 --2- 172.21.15.49:0/1703479314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04c0068aa0 0x7f04c01403d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04bd400700 1 -- 172.21.15.49:0/1703479314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c00c58c0 msgr2=0x7f04c00a9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04bd400700 1 --2- 172.21.15.49:0/1703479314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c00c58c0 0x7f04c00a9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04bd400700 1 -- 172.21.15.49:0/1703479314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b0009250 con 0x7f04c0068f00 2024-01-22T05:18:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04bde00700 1 --2- 172.21.15.49:0/1703479314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04c0068aa0 0x7f04c01403d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:42.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04bd400700 1 --2- 172.21.15.49:0/1703479314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c0068f00 0x7f04c0156120 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7f04a800c490 tx=0x7f04a8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04b5600700 1 -- 172.21.15.49:0/1703479314 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8001ea0 con 0x7f04c0068f00 2024-01-22T05:18:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04b5600700 1 -- 172.21.15.49:0/1703479314 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a8007020 con 0x7f04c0068f00 2024-01-22T05:18:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04c4c00700 1 -- 172.21.15.49:0/1703479314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c0140c40 con 0x7f04c0068f00 2024-01-22T05:18:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04b5600700 1 -- 172.21.15.49:0/1703479314 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a80073c0 con 0x7f04c0068f00 2024-01-22T05:18:42.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.321+0000 7f04c4c00700 1 -- 172.21.15.49:0/1703479314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c0141200 con 0x7f04c0068f00 2024-01-22T05:18:42.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.325+0000 7f04c4c00700 1 -- 172.21.15.49:0/1703479314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c0141700 con 0x7f04c0068f00 2024-01-22T05:18:42.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.325+0000 7f04b5600700 1 -- 172.21.15.49:0/1703479314 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f04a80068b0 con 0x7f04c0068f00 2024-01-22T05:18:42.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.329+0000 7f04b5600700 1 --2- 172.21.15.49:0/1703479314 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f049805a510 0x7f049805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:42.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.329+0000 7f04b5600700 1 -- 172.21.15.49:0/1703479314 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f04a80743f0 con 0x7f04c0068f00 2024-01-22T05:18:42.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.329+0000 7f04bde00700 1 --2- 172.21.15.49:0/1703479314 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f049805a510 0x7f049805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:42.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.329+0000 7f04bde00700 1 --2- 172.21.15.49:0/1703479314 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f049805a510 0x7f049805c9d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f04b0006f80 tx=0x7f04b0016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:42.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.337+0000 7f04b5600700 1 -- 172.21.15.49:0/1703479314 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f04a80479b0 con 0x7f04c0068f00 2024-01-22T05:18:42.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:42.545+0000 7f04c4c00700 1 -- 172.21.15.49:0/1703479314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f04c0046800 con 0x7f04c0068f00 2024-01-22T05:18:43.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.417+0000 7f04b5600700 1 -- 172.21.15.49:0/1703479314 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v134) v1 ==== 122+0+0 (secure 0 0 0) 0x7f04a804afd0 con 0x7f04c0068f00 2024-01-22T05:18:43.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.425+0000 7f04c4c00700 1 -- 172.21.15.49:0/1703479314 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f049805a510 msgr2=0x7f049805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:43.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.425+0000 7f04c4c00700 1 --2- 172.21.15.49:0/1703479314 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f049805a510 0x7f049805c9d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f04b0006f80 tx=0x7f04b0016000).stop 2024-01-22T05:18:43.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.425+0000 7f04c4c00700 1 -- 172.21.15.49:0/1703479314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c0068f00 msgr2=0x7f04c0156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:43.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.425+0000 7f04c4c00700 1 --2- 172.21.15.49:0/1703479314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c0068f00 0x7f04c0156120 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7f04a800c490 tx=0x7f04a8007dd0).stop 2024-01-22T05:18:43.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.425+0000 7f04c4c00700 1 -- 172.21.15.49:0/1703479314 shutdown_connections 2024-01-22T05:18:43.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.425+0000 7f04c4c00700 1 --2- 172.21.15.49:0/1703479314 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f049805a510 0x7f049805c9d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:43.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.425+0000 7f04c4c00700 1 --2- 172.21.15.49:0/1703479314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c00c58c0 0x7f04c00a9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:43.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.425+0000 7f04c4c00700 1 --2- 172.21.15.49:0/1703479314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04c0068f00 0x7f04c0156120 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:43.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.425+0000 7f04c4c00700 1 --2- 172.21.15.49:0/1703479314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04c0068aa0 0x7f04c01403d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:43.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.425+0000 7f04c4c00700 1 -- 172.21.15.49:0/1703479314 >> 172.21.15.49:0/1703479314 conn(0x7f04c0065f90 msgr2=0x7f04c0157530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:43.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.425+0000 7f04c4c00700 1 -- 172.21.15.49:0/1703479314 shutdown_connections 2024-01-22T05:18:43.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.425+0000 7f04c4c00700 1 -- 172.21.15.49:0/1703479314 wait complete. 2024-01-22T05:18:43.454 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:18:43.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:18:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.621+0000 7f5ebd200700 1 Processor -- start 2024-01-22T05:18:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.621+0000 7f5ebd200700 1 -- start start 2024-01-22T05:18:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5ebd200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5eb8065240 0x7f5eb80644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5ebd200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb8064e90 con 0x7f5eb8065620 2024-01-22T05:18:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5ebd200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb815c7d0 con 0x7f5eb80649e0 2024-01-22T05:18:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5ebd200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80c2700 con 0x7f5eb8065240 2024-01-22T05:18:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5eb5400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5eb8065620 0x7f5eb815b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55572/0 (socket says 172.21.15.49:55572) 2024-01-22T05:18:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5eb5400700 1 -- 172.21.15.49:0/3480511914 learned_addr learned my addr 172.21.15.49:0/3480511914 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5eb5e00700 1 --2- 172.21.15.49:0/3480511914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5eb8065240 0x7f5eb80644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5eb4a00700 1 -- 172.21.15.49:0/3480511914 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386649895 0 0) 0x7f5ea0001110 con 0x7f5eb8065620 2024-01-22T05:18:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5eb4a00700 1 -- 172.21.15.49:0/3480511914 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e980033f0 con 0x7f5eb8065620 2024-01-22T05:18:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5eb4a00700 1 -- 172.21.15.49:0/3480511914 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486019633 0 0) 0x7f5eb815c7d0 con 0x7f5eb80649e0 2024-01-22T05:18:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5eb4a00700 1 -- 172.21.15.49:0/3480511914 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ea0001110 con 0x7f5eb80649e0 2024-01-22T05:18:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5eb5e00700 1 -- 172.21.15.49:0/3480511914 >> v1:172.21.15.110:6789/0 conn(0x7f5eb80649e0 legacy=0x7f5eb815c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5eb4a00700 1 -- 172.21.15.49:0/3480511914 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 937070780 0 0) 0x7f5e980033f0 con 0x7f5eb8065620 2024-01-22T05:18:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5eb5e00700 1 -- 172.21.15.49:0/3480511914 >> v1:172.21.15.49:6789/0 conn(0x7f5eb8065620 legacy=0x7f5eb815b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5eb5e00700 1 -- 172.21.15.49:0/3480511914 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb80c29a0 con 0x7f5eb8065240 2024-01-22T05:18:43.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.625+0000 7f5eb5e00700 1 --2- 172.21.15.49:0/3480511914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5eb8065240 0x7f5eb80644f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f5ea8009790 tx=0x7f5ea8009060).ready entity=mon.2 client_cookie=73bffa7632aac8bb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:43.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.629+0000 7f5eb4a00700 1 -- 172.21.15.49:0/3480511914 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0001600 con 0x7f5eb8065240 2024-01-22T05:18:43.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.629+0000 7f5eb4a00700 1 -- 172.21.15.49:0/3480511914 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea8011400 con 0x7f5eb8065240 2024-01-22T05:18:43.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.629+0000 7f5eb4a00700 1 -- 172.21.15.49:0/3480511914 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8011780 con 0x7f5eb8065240 2024-01-22T05:18:43.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.629+0000 7f5ebd200700 1 -- 172.21.15.49:0/3480511914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5eb8065240 msgr2=0x7f5eb80644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:43.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.629+0000 7f5ebd200700 1 --2- 172.21.15.49:0/3480511914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5eb8065240 0x7f5eb80644f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f5ea8009790 tx=0x7f5ea8009060).stop 2024-01-22T05:18:43.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.629+0000 7f5ebd200700 1 -- 172.21.15.49:0/3480511914 shutdown_connections 2024-01-22T05:18:43.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.629+0000 7f5ebd200700 1 --2- 172.21.15.49:0/3480511914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5eb8065240 0x7f5eb80644f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:43.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.629+0000 7f5ebd200700 1 -- 172.21.15.49:0/3480511914 >> 172.21.15.49:0/3480511914 conn(0x7f5eb80c87f0 msgr2=0x7f5eb80c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:43.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.629+0000 7f5ebd200700 1 -- 172.21.15.49:0/3480511914 shutdown_connections 2024-01-22T05:18:43.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.629+0000 7f5ebd200700 1 -- 172.21.15.49:0/3480511914 wait complete. 2024-01-22T05:18:43.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.633+0000 7f5ebd200700 1 Processor -- start 2024-01-22T05:18:43.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.633+0000 7f5ebd200700 1 -- start start 2024-01-22T05:18:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5ebd200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5eb80649e0 0x7f5eb8167ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5ebd200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb8065240 0x7f5eb80ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5ebd200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5eb8065620 0x7f5eb80accb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5ebd200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8152d10 con 0x7f5eb80649e0 2024-01-22T05:18:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5ebd200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80ad1a0 con 0x7f5eb8065240 2024-01-22T05:18:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5ebd200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80a84c0 con 0x7f5eb8065620 2024-01-22T05:18:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5eb5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5eb80649e0 0x7f5eb8167ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5eb5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5eb80649e0 0x7f5eb8167ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39116/0 (socket says 172.21.15.49:39116) 2024-01-22T05:18:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5eb5e00700 1 -- 172.21.15.49:0/4063864822 learned_addr learned my addr 172.21.15.49:0/4063864822 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5eb5400700 1 --2- 172.21.15.49:0/4063864822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb8065240 0x7f5eb80ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5eb7200700 1 --2- 172.21.15.49:0/4063864822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5eb8065620 0x7f5eb80accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5eb5e00700 1 -- 172.21.15.49:0/4063864822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5eb8065620 msgr2=0x7f5eb80accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5eb5e00700 1 --2- 172.21.15.49:0/4063864822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5eb8065620 0x7f5eb80accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5eb5e00700 1 -- 172.21.15.49:0/4063864822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb8065240 msgr2=0x7f5eb80ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5eb5e00700 1 --2- 172.21.15.49:0/4063864822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb8065240 0x7f5eb80ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.637+0000 7f5eb5e00700 1 -- 172.21.15.49:0/4063864822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea80092a0 con 0x7f5eb80649e0 2024-01-22T05:18:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.641+0000 7f5eb5e00700 1 --2- 172.21.15.49:0/4063864822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5eb80649e0 0x7f5eb8167ea0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7f5eb8066be0 tx=0x7f5ea8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.641+0000 7f5ead600700 1 -- 172.21.15.49:0/4063864822 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea80106c0 con 0x7f5eb80649e0 2024-01-22T05:18:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.641+0000 7f5ead600700 1 -- 172.21.15.49:0/4063864822 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea8010840 con 0x7f5eb80649e0 2024-01-22T05:18:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.641+0000 7f5ebd200700 1 -- 172.21.15.49:0/4063864822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb80a78b0 con 0x7f5eb80649e0 2024-01-22T05:18:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.641+0000 7f5ead600700 1 -- 172.21.15.49:0/4063864822 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8010c00 con 0x7f5eb80649e0 2024-01-22T05:18:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.641+0000 7f5ebd200700 1 -- 172.21.15.49:0/4063864822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb80a7e70 con 0x7f5eb80649e0 2024-01-22T05:18:43.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.641+0000 7f5ebd200700 1 -- 172.21.15.49:0/4063864822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb8047060 con 0x7f5eb80649e0 2024-01-22T05:18:43.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.645+0000 7f5ead600700 1 -- 172.21.15.49:0/4063864822 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5ea8027460 con 0x7f5eb80649e0 2024-01-22T05:18:43.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.645+0000 7f5ead600700 1 --2- 172.21.15.49:0/4063864822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e9005a510 0x7f5e9005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:43.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.645+0000 7f5ead600700 1 -- 172.21.15.49:0/4063864822 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f5ea8075db0 con 0x7f5eb80649e0 2024-01-22T05:18:43.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.645+0000 7f5eb5400700 1 --2- 172.21.15.49:0/4063864822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e9005a510 0x7f5e9005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:43.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.645+0000 7f5eb5400700 1 --2- 172.21.15.49:0/4063864822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e9005a510 0x7f5e9005c9d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f5ea0001ed0 tx=0x7f5ea0000bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:43.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.649+0000 7f5ead600700 1 -- 172.21.15.49:0/4063864822 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5ea8049450 con 0x7f5eb80649e0 2024-01-22T05:18:43.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.849+0000 7f5ebd200700 1 -- 172.21.15.49:0/4063864822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5eb80c2c80 con 0x7f5eb80649e0 2024-01-22T05:18:43.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.849+0000 7f5ead600700 1 -- 172.21.15.49:0/4063864822 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f5ea804c9f0 con 0x7f5eb80649e0 2024-01-22T05:18:43.852 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:43.852 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":134,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3995018890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3995018890},{"type":"v1","addr":"172.21.15.110:6833","nonce":3995018890}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2248654659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2248654659},{"type":"v1","addr":"172.21.15.49:6837","nonce":2248654659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931981528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1931981528},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931981528}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:18:40.076218+0000","modified":"2024-01-22T05:18:43.416474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9610":{"gid":9610,"name":"b","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/2192470330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2192470330},{"type":"v1","addr":"172.21.15.110:6835","nonce":2192470330}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2024-01-22T05:18:43.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.853+0000 7f5ebd200700 1 -- 172.21.15.49:0/4063864822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e9005a510 msgr2=0x7f5e9005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:43.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.853+0000 7f5ebd200700 1 --2- 172.21.15.49:0/4063864822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e9005a510 0x7f5e9005c9d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f5ea0001ed0 tx=0x7f5ea0000bc0).stop 2024-01-22T05:18:43.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.853+0000 7f5ebd200700 1 -- 172.21.15.49:0/4063864822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5eb80649e0 msgr2=0x7f5eb8167ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:43.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.853+0000 7f5ebd200700 1 --2- 172.21.15.49:0/4063864822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5eb80649e0 0x7f5eb8167ea0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7f5eb8066be0 tx=0x7f5ea8016000).stop 2024-01-22T05:18:43.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.853+0000 7f5ebd200700 1 -- 172.21.15.49:0/4063864822 shutdown_connections 2024-01-22T05:18:43.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.853+0000 7f5ebd200700 1 --2- 172.21.15.49:0/4063864822 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5e9005a510 0x7f5e9005c9d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:43.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.853+0000 7f5ebd200700 1 --2- 172.21.15.49:0/4063864822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5eb8065620 0x7f5eb80accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:43.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.853+0000 7f5ebd200700 1 --2- 172.21.15.49:0/4063864822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb8065240 0x7f5eb80ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:43.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.853+0000 7f5ebd200700 1 --2- 172.21.15.49:0/4063864822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5eb80649e0 0x7f5eb8167ea0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:43.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.853+0000 7f5ebd200700 1 -- 172.21.15.49:0/4063864822 >> 172.21.15.49:0/4063864822 conn(0x7f5eb80c87f0 msgr2=0x7f5eb8063a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:43.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.853+0000 7f5ebd200700 1 -- 172.21.15.49:0/4063864822 shutdown_connections 2024-01-22T05:18:43.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:43.853+0000 7f5ebd200700 1 -- 172.21.15.49:0/4063864822 wait complete. 2024-01-22T05:18:43.860 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 134 2024-01-22T05:18:43.877 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:18:44.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.033+0000 7fef62400700 1 Processor -- start 2024-01-22T05:18:44.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.033+0000 7fef62400700 1 -- start start 2024-01-22T05:18:44.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.033+0000 7fef62400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fef5c0c25e0 0x7fef5c0a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef62400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c0c1a40 con 0x7fef5c0a8740 2024-01-22T05:18:44.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef62400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c0a90b0 con 0x7fef5c155d20 2024-01-22T05:18:44.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef62400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5c159310 con 0x7fef5c0c25e0 2024-01-22T05:18:44.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef5aa00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fef5c0a8740 0x7fef5c0c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55578/0 (socket says 172.21.15.49:55578) 2024-01-22T05:18:44.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef5aa00700 1 -- 172.21.15.49:0/2374462750 learned_addr learned my addr 172.21.15.49:0/2374462750 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:44.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef5be00700 1 --2- 172.21.15.49:0/2374462750 >> v2:172.21.15.110:3300/0 conn(0x7fef5c0c25e0 0x7fef5c0a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef5a000700 1 -- 172.21.15.49:0/2374462750 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888482068 0 0) 0x7fef5c0c1a40 con 0x7fef5c0a8740 2024-01-22T05:18:44.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef5a000700 1 -- 172.21.15.49:0/2374462750 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef3c0033f0 con 0x7fef5c0a8740 2024-01-22T05:18:44.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef5a000700 1 -- 172.21.15.49:0/2374462750 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4014881171 0 0) 0x7fef3c0033f0 con 0x7fef5c0a8740 2024-01-22T05:18:44.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef5be00700 1 -- 172.21.15.49:0/2374462750 >> v1:172.21.15.110:6789/0 conn(0x7fef5c155d20 legacy=0x7fef5c065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef5be00700 1 -- 172.21.15.49:0/2374462750 >> v1:172.21.15.49:6789/0 conn(0x7fef5c0a8740 legacy=0x7fef5c0c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef5be00700 1 -- 172.21.15.49:0/2374462750 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c0c13f0 con 0x7fef5c0c25e0 2024-01-22T05:18:44.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef5be00700 1 --2- 172.21.15.49:0/2374462750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5c0c25e0 0x7fef5c0a8bc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fef54009e60 tx=0x7fef54009780).ready entity=mon.1 client_cookie=6c9cd3e725c62d6d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:44.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef5a000700 1 -- 172.21.15.49:0/2374462750 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5400e070 con 0x7fef5c0c25e0 2024-01-22T05:18:44.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef5a000700 1 -- 172.21.15.49:0/2374462750 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5400b850 con 0x7fef5c0c25e0 2024-01-22T05:18:44.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.037+0000 7fef5a000700 1 -- 172.21.15.49:0/2374462750 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44001470 con 0x7fef5c0c25e0 2024-01-22T05:18:44.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.041+0000 7fef62400700 1 -- 172.21.15.49:0/2374462750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5c0c25e0 msgr2=0x7fef5c0a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.041+0000 7fef62400700 1 --2- 172.21.15.49:0/2374462750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5c0c25e0 0x7fef5c0a8bc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fef54009e60 tx=0x7fef54009780).stop 2024-01-22T05:18:44.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.041+0000 7fef62400700 1 -- 172.21.15.49:0/2374462750 shutdown_connections 2024-01-22T05:18:44.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.041+0000 7fef62400700 1 --2- 172.21.15.49:0/2374462750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5c0c25e0 0x7fef5c0a8bc0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.041+0000 7fef62400700 1 -- 172.21.15.49:0/2374462750 >> 172.21.15.49:0/2374462750 conn(0x7fef5c0c6540 msgr2=0x7fef5c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:44.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.041+0000 7fef62400700 1 -- 172.21.15.49:0/2374462750 shutdown_connections 2024-01-22T05:18:44.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.041+0000 7fef62400700 1 -- 172.21.15.49:0/2374462750 wait complete. 2024-01-22T05:18:44.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.045+0000 7fef62400700 1 Processor -- start 2024-01-22T05:18:44.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.045+0000 7fef62400700 1 -- start start 2024-01-22T05:18:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.045+0000 7fef62400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5c0a8740 0x7fef5c1520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.045+0000 7fef62400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef5c0c25e0 0x7fef5c0beac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.045+0000 7fef62400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef5c155d20 0x7fef5c0befb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.045+0000 7fef62400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0bfd10 con 0x7fef5c0c25e0 2024-01-22T05:18:44.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.045+0000 7fef62400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0bf4a0 con 0x7fef5c0a8740 2024-01-22T05:18:44.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.045+0000 7fef62400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0bd5e0 con 0x7fef5c155d20 2024-01-22T05:18:44.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.045+0000 7fef5aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef5c0c25e0 0x7fef5c0beac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.045+0000 7fef5aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef5c0c25e0 0x7fef5c0beac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39130/0 (socket says 172.21.15.49:39130) 2024-01-22T05:18:44.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.045+0000 7fef5aa00700 1 -- 172.21.15.49:0/123051890 learned_addr learned my addr 172.21.15.49:0/123051890 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:44.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.045+0000 7fef5be00700 1 --2- 172.21.15.49:0/123051890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef5c155d20 0x7fef5c0befb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.045+0000 7fef5b400700 1 --2- 172.21.15.49:0/123051890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5c0a8740 0x7fef5c1520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.049+0000 7fef5aa00700 1 -- 172.21.15.49:0/123051890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef5c155d20 msgr2=0x7fef5c0befb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.049+0000 7fef5aa00700 1 --2- 172.21.15.49:0/123051890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef5c155d20 0x7fef5c0befb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.049+0000 7fef5aa00700 1 -- 172.21.15.49:0/123051890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5c0a8740 msgr2=0x7fef5c1520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.049+0000 7fef5aa00700 1 --2- 172.21.15.49:0/123051890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5c0a8740 0x7fef5c1520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.049+0000 7fef5aa00700 1 -- 172.21.15.49:0/123051890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef54009a20 con 0x7fef5c0c25e0 2024-01-22T05:18:44.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.049+0000 7fef5b400700 1 --2- 172.21.15.49:0/123051890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5c0a8740 0x7fef5c1520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:44.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.049+0000 7fef5aa00700 1 --2- 172.21.15.49:0/123051890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef5c0c25e0 0x7fef5c0beac0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7fef4400c7e0 tx=0x7fef44001ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:44.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.049+0000 7fef52a00700 1 -- 172.21.15.49:0/123051890 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44007170 con 0x7fef5c0c25e0 2024-01-22T05:18:44.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.049+0000 7fef52a00700 1 -- 172.21.15.49:0/123051890 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef440072f0 con 0x7fef5c0c25e0 2024-01-22T05:18:44.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.049+0000 7fef52a00700 1 -- 172.21.15.49:0/123051890 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef440048c0 con 0x7fef5c0c25e0 2024-01-22T05:18:44.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.049+0000 7fef62400700 1 -- 172.21.15.49:0/123051890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5c0bd7f0 con 0x7fef5c0c25e0 2024-01-22T05:18:44.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.049+0000 7fef62400700 1 -- 172.21.15.49:0/123051890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5c0be090 con 0x7fef5c0c25e0 2024-01-22T05:18:44.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.049+0000 7fef62400700 1 -- 172.21.15.49:0/123051890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5c0be280 con 0x7fef5c0c25e0 2024-01-22T05:18:44.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.049+0000 7fef52a00700 1 -- 172.21.15.49:0/123051890 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fef44004c70 con 0x7fef5c0c25e0 2024-01-22T05:18:44.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.053+0000 7fef52a00700 1 --2- 172.21.15.49:0/123051890 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fef3405a510 0x7fef3405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.053+0000 7fef52a00700 1 -- 172.21.15.49:0/123051890 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fef44074410 con 0x7fef5c0c25e0 2024-01-22T05:18:44.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.053+0000 7fef5b400700 1 --2- 172.21.15.49:0/123051890 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fef3405a510 0x7fef3405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.053+0000 7fef5b400700 1 --2- 172.21.15.49:0/123051890 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fef3405a510 0x7fef3405c9d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7fef4c0017b0 tx=0x7fef4c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:44.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.061+0000 7fef52a00700 1 -- 172.21.15.49:0/123051890 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fef44047a90 con 0x7fef5c0c25e0 2024-01-22T05:18:44.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.225+0000 7fef62400700 1 -- 172.21.15.49:0/123051890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef5c047060 con 0x7fef5c0c25e0 2024-01-22T05:18:44.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.229+0000 7fef52a00700 1 -- 172.21.15.49:0/123051890 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+17178 (secure 0 0 0) 0x7fef4404b0b0 con 0x7fef5c0c25e0 2024-01-22T05:18:44.231 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:44.231 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":172,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:18:41.079736+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:18:38.197050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-01-22T05:18:39.072620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:18:44.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.229+0000 7fef62400700 1 -- 172.21.15.49:0/123051890 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fef3405a510 msgr2=0x7fef3405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.229+0000 7fef62400700 1 --2- 172.21.15.49:0/123051890 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fef3405a510 0x7fef3405c9d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7fef4c0017b0 tx=0x7fef4c009040).stop 2024-01-22T05:18:44.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.229+0000 7fef62400700 1 -- 172.21.15.49:0/123051890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef5c0c25e0 msgr2=0x7fef5c0beac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.229+0000 7fef62400700 1 --2- 172.21.15.49:0/123051890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef5c0c25e0 0x7fef5c0beac0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7fef4400c7e0 tx=0x7fef44001ad0).stop 2024-01-22T05:18:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.229+0000 7fef62400700 1 -- 172.21.15.49:0/123051890 shutdown_connections 2024-01-22T05:18:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.229+0000 7fef62400700 1 --2- 172.21.15.49:0/123051890 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fef3405a510 0x7fef3405c9d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.229+0000 7fef62400700 1 --2- 172.21.15.49:0/123051890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef5c155d20 0x7fef5c0befb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.229+0000 7fef62400700 1 --2- 172.21.15.49:0/123051890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef5c0c25e0 0x7fef5c0beac0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.229+0000 7fef62400700 1 --2- 172.21.15.49:0/123051890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5c0a8740 0x7fef5c1520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.229+0000 7fef62400700 1 -- 172.21.15.49:0/123051890 >> 172.21.15.49:0/123051890 conn(0x7fef5c0c6540 msgr2=0x7fef5c066aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:44.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.233+0000 7fef62400700 1 -- 172.21.15.49:0/123051890 shutdown_connections 2024-01-22T05:18:44.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.233+0000 7fef62400700 1 -- 172.21.15.49:0/123051890 wait complete. 2024-01-22T05:18:44.256 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:18:44.256 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:18:44.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.417+0000 7f54d1600700 1 Processor -- start 2024-01-22T05:18:44.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.421+0000 7f54d1600700 1 -- start start 2024-01-22T05:18:44.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54d1600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f54cc151990 0x7f54cc067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54d1600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54cc0c93e0 0x7f54cc155400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54d1600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54cc0bf960 con 0x7f54cc067f80 2024-01-22T05:18:44.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54d1600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54cc0c9a00 con 0x7f54cc151990 2024-01-22T05:18:44.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54d1600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc0bee20 con 0x7f54cc0c93e0 2024-01-22T05:18:44.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54ca000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f54cc067f80 0x7f54cc0c8cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55592/0 (socket says 172.21.15.49:55592) 2024-01-22T05:18:44.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54ca000700 1 -- 172.21.15.49:0/3061760023 learned_addr learned my addr 172.21.15.49:0/3061760023 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:44.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54caa00700 1 --2- 172.21.15.49:0/3061760023 >> v2:172.21.15.110:3300/0 conn(0x7f54cc151990 0x7f54cc067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54cbe00700 1 --2- 172.21.15.49:0/3061760023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54cc0c93e0 0x7f54cc155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54c9600700 1 -- 172.21.15.49:0/3061760023 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593809012 0 0) 0x7f54cc0bf960 con 0x7f54cc067f80 2024-01-22T05:18:44.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54c9600700 1 -- 172.21.15.49:0/3061760023 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54ac0033f0 con 0x7f54cc067f80 2024-01-22T05:18:44.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54cbe00700 1 -- 172.21.15.49:0/3061760023 >> v2:172.21.15.110:3300/0 conn(0x7f54cc151990 msgr2=0x7f54cc067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:44.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54cbe00700 1 --2- 172.21.15.49:0/3061760023 >> v2:172.21.15.110:3300/0 conn(0x7f54cc151990 0x7f54cc067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54cbe00700 1 -- 172.21.15.49:0/3061760023 >> v1:172.21.15.49:6789/0 conn(0x7f54cc067f80 legacy=0x7f54cc0c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54cbe00700 1 -- 172.21.15.49:0/3061760023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc0683e0 con 0x7f54cc0c93e0 2024-01-22T05:18:44.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54caa00700 1 --2- 172.21.15.49:0/3061760023 >> v2:172.21.15.110:3300/0 conn(0x7f54cc151990 0x7f54cc067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:44.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.425+0000 7f54cbe00700 1 --2- 172.21.15.49:0/3061760023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54cc0c93e0 0x7f54cc155400 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f54c4009e60 tx=0x7f54c4009780).ready entity=mon.2 client_cookie=f8bb490b3c87d119 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:44.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.429+0000 7f54c9600700 1 -- 172.21.15.49:0/3061760023 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c400e070 con 0x7f54cc0c93e0 2024-01-22T05:18:44.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.429+0000 7f54c9600700 1 -- 172.21.15.49:0/3061760023 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c400bab0 con 0x7f54cc0c93e0 2024-01-22T05:18:44.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.429+0000 7f54c9600700 1 -- 172.21.15.49:0/3061760023 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c400be30 con 0x7f54cc0c93e0 2024-01-22T05:18:44.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.429+0000 7f54d1600700 1 -- 172.21.15.49:0/3061760023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54cc0c93e0 msgr2=0x7f54cc155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.429+0000 7f54d1600700 1 --2- 172.21.15.49:0/3061760023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54cc0c93e0 0x7f54cc155400 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f54c4009e60 tx=0x7f54c4009780).stop 2024-01-22T05:18:44.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.429+0000 7f54d1600700 1 -- 172.21.15.49:0/3061760023 shutdown_connections 2024-01-22T05:18:44.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.429+0000 7f54d1600700 1 --2- 172.21.15.49:0/3061760023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54cc0c93e0 0x7f54cc155400 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.429+0000 7f54d1600700 1 --2- 172.21.15.49:0/3061760023 >> v2:172.21.15.110:3300/0 conn(0x7f54cc151990 0x7f54cc067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.429+0000 7f54d1600700 1 -- 172.21.15.49:0/3061760023 >> 172.21.15.49:0/3061760023 conn(0x7f54cc0c6960 msgr2=0x7f54cc0c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:44.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.429+0000 7f54d1600700 1 -- 172.21.15.49:0/3061760023 shutdown_connections 2024-01-22T05:18:44.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.429+0000 7f54d1600700 1 -- 172.21.15.49:0/3061760023 wait complete. 2024-01-22T05:18:44.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.433+0000 7f54d1600700 1 Processor -- start 2024-01-22T05:18:44.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.433+0000 7f54d1600700 1 -- start start 2024-01-22T05:18:44.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54d1600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54cc067f80 0x7f54cc154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54d1600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54cc0c93e0 0x7f54cc14f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54d1600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54cc151990 0x7f54cc168c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54d1600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc14fa40 con 0x7f54cc151990 2024-01-22T05:18:44.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54d1600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc150840 con 0x7f54cc0c93e0 2024-01-22T05:18:44.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54d1600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc14fc30 con 0x7f54cc067f80 2024-01-22T05:18:44.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54cbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54cc151990 0x7f54cc168c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54cbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54cc151990 0x7f54cc168c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39136/0 (socket says 172.21.15.49:39136) 2024-01-22T05:18:44.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54cbe00700 1 -- 172.21.15.49:0/2901527009 learned_addr learned my addr 172.21.15.49:0/2901527009 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:44.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54caa00700 1 --2- 172.21.15.49:0/2901527009 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54cc067f80 0x7f54cc154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54ca000700 1 --2- 172.21.15.49:0/2901527009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54cc0c93e0 0x7f54cc14f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54cbe00700 1 -- 172.21.15.49:0/2901527009 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54cc067f80 msgr2=0x7f54cc154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54cbe00700 1 --2- 172.21.15.49:0/2901527009 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54cc067f80 0x7f54cc154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54cbe00700 1 -- 172.21.15.49:0/2901527009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54cc0c93e0 msgr2=0x7f54cc14f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54cbe00700 1 --2- 172.21.15.49:0/2901527009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54cc0c93e0 0x7f54cc14f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54cbe00700 1 -- 172.21.15.49:0/2901527009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc0092a0 con 0x7f54cc151990 2024-01-22T05:18:44.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54cbe00700 1 --2- 172.21.15.49:0/2901527009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54cc151990 0x7f54cc168c90 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f54c4013cc0 tx=0x7f54c4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:44.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54c2000700 1 -- 172.21.15.49:0/2901527009 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4013ea0 con 0x7f54cc151990 2024-01-22T05:18:44.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54c2000700 1 -- 172.21.15.49:0/2901527009 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c401d630 con 0x7f54cc151990 2024-01-22T05:18:44.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54d1600700 1 -- 172.21.15.49:0/2901527009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c4009a20 con 0x7f54cc151990 2024-01-22T05:18:44.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54c2000700 1 -- 172.21.15.49:0/2901527009 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c401d9f0 con 0x7f54cc151990 2024-01-22T05:18:44.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54d1600700 1 -- 172.21.15.49:0/2901527009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54cc1501f0 con 0x7f54cc151990 2024-01-22T05:18:44.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.437+0000 7f54d1600700 1 -- 172.21.15.49:0/2901527009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54cc047060 con 0x7f54cc151990 2024-01-22T05:18:44.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.441+0000 7f54c2000700 1 -- 172.21.15.49:0/2901527009 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f54c4003040 con 0x7f54cc151990 2024-01-22T05:18:44.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.441+0000 7f54c2000700 1 --2- 172.21.15.49:0/2901527009 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54a405a510 0x7f54a405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.441+0000 7f54c2000700 1 -- 172.21.15.49:0/2901527009 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f54c4076790 con 0x7f54cc151990 2024-01-22T05:18:44.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.441+0000 7f54caa00700 1 --2- 172.21.15.49:0/2901527009 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54a405a510 0x7f54a405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.445+0000 7f54caa00700 1 --2- 172.21.15.49:0/2901527009 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54a405a510 0x7f54a405c9d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f54cc149aa0 tx=0x7f54bc009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:44.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.449+0000 7f54c2000700 1 -- 172.21.15.49:0/2901527009 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f54c4049cf0 con 0x7f54cc151990 2024-01-22T05:18:44.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.617+0000 7f54d1600700 1 -- 172.21.15.49:0/2901527009 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54cc169180 con 0x7f54a405a510 2024-01-22T05:18:44.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.633+0000 7f54c2000700 1 -- 172.21.15.49:0/2901527009 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359582 (secure 0 0 0) 0x7f54cc169180 con 0x7f54a405a510 2024-01-22T05:18:44.643 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.641+0000 7f54d1600700 1 -- 172.21.15.49:0/2901527009 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54a405a510 msgr2=0x7f54a405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.641+0000 7f54d1600700 1 --2- 172.21.15.49:0/2901527009 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54a405a510 0x7f54a405c9d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f54cc149aa0 tx=0x7f54bc009060).stop 2024-01-22T05:18:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.641+0000 7f54d1600700 1 -- 172.21.15.49:0/2901527009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54cc151990 msgr2=0x7f54cc168c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.641+0000 7f54d1600700 1 --2- 172.21.15.49:0/2901527009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54cc151990 0x7f54cc168c90 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f54c4013cc0 tx=0x7f54c4009780).stop 2024-01-22T05:18:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.641+0000 7f54d1600700 1 -- 172.21.15.49:0/2901527009 shutdown_connections 2024-01-22T05:18:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.641+0000 7f54d1600700 1 --2- 172.21.15.49:0/2901527009 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f54a405a510 0x7f54a405c9d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.641+0000 7f54d1600700 1 --2- 172.21.15.49:0/2901527009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54cc151990 0x7f54cc168c90 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.641+0000 7f54d1600700 1 --2- 172.21.15.49:0/2901527009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54cc0c93e0 0x7f54cc14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.641+0000 7f54d1600700 1 --2- 172.21.15.49:0/2901527009 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54cc067f80 0x7f54cc154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.641+0000 7f54d1600700 1 -- 172.21.15.49:0/2901527009 >> 172.21.15.49:0/2901527009 conn(0x7f54cc0c6960 msgr2=0x7f54cc0ad450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.641+0000 7f54d1600700 1 -- 172.21.15.49:0/2901527009 shutdown_connections 2024-01-22T05:18:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.641+0000 7f54d1600700 1 -- 172.21.15.49:0/2901527009 wait complete. 2024-01-22T05:18:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:18:44.666 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":593,"stamp":"2024-01-22T05:18:43.547796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":226,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2464340,"kb_used_data":16916,"kb_used_omap":0,"kb_used_meta":2447360,"kb_avail":752510380,"statfs":{"total":773094113280,"available":770570629120,"internally_reserved":0,"allocated":17321984,"data_stored":8618171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506096640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3519,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-47,"num_write_kb":-15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.968318"},"pg_stats":[{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.120007+0000","last_change":"2024-01-22T05:18:40.115553+0000","last_active":"2024-01-22T05:18:40.120007+0000","last_peered":"2024-01-22T05:18:40.120007+0000","last_clean":"2024-01-22T05:18:40.120007+0000","last_became_active":"2024-01-22T05:18:40.115044+0000","last_became_peered":"2024-01-22T05:18:40.115044+0000","last_unstale":"2024-01-22T05:18:40.120007+0000","last_undegraded":"2024-01-22T05:18:40.120007+0000","last_fullsized":"2024-01-22T05:18:40.120007+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3f","version":"171'3","reported_seq":13,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.099017+0000","last_change":"2024-01-22T05:18:39.638468+0000","last_active":"2024-01-22T05:18:40.099017+0000","last_peered":"2024-01-22T05:18:40.099017+0000","last_clean":"2024-01-22T05:18:40.099017+0000","last_became_active":"2024-01-22T05:18:39.637668+0000","last_became_peered":"2024-01-22T05:18:39.637668+0000","last_unstale":"2024-01-22T05:18:40.099017+0000","last_undegraded":"2024-01-22T05:18:40.099017+0000","last_fullsized":"2024-01-22T05:18:40.099017+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.119644+0000","last_change":"2024-01-22T05:18:40.114838+0000","last_active":"2024-01-22T05:18:40.119644+0000","last_peered":"2024-01-22T05:18:40.119644+0000","last_clean":"2024-01-22T05:18:40.119644+0000","last_became_active":"2024-01-22T05:18:40.113111+0000","last_became_peered":"2024-01-22T05:18:40.113111+0000","last_unstale":"2024-01-22T05:18:40.119644+0000","last_undegraded":"2024-01-22T05:18:40.119644+0000","last_fullsized":"2024-01-22T05:18:40.119644+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.103034+0000","last_change":"2024-01-22T05:18:39.646954+0000","last_active":"2024-01-22T05:18:40.103034+0000","last_peered":"2024-01-22T05:18:40.103034+0000","last_clean":"2024-01-22T05:18:40.103034+0000","last_became_active":"2024-01-22T05:18:39.646474+0000","last_became_peered":"2024-01-22T05:18:39.646474+0000","last_unstale":"2024-01-22T05:18:40.103034+0000","last_undegraded":"2024-01-22T05:18:40.103034+0000","last_fullsized":"2024-01-22T05:18:40.103034+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.120933+0000","last_change":"2024-01-22T05:18:40.116608+0000","last_active":"2024-01-22T05:18:40.120933+0000","last_peered":"2024-01-22T05:18:40.120933+0000","last_clean":"2024-01-22T05:18:40.120933+0000","last_became_active":"2024-01-22T05:18:40.116324+0000","last_became_peered":"2024-01-22T05:18:40.116324+0000","last_unstale":"2024-01-22T05:18:40.120933+0000","last_undegraded":"2024-01-22T05:18:40.120933+0000","last_fullsized":"2024-01-22T05:18:40.120933+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.087357+0000","last_change":"2024-01-22T05:18:39.628757+0000","last_active":"2024-01-22T05:18:40.087357+0000","last_peered":"2024-01-22T05:18:40.087357+0000","last_clean":"2024-01-22T05:18:40.087357+0000","last_became_active":"2024-01-22T05:18:39.628462+0000","last_became_peered":"2024-01-22T05:18:39.628462+0000","last_unstale":"2024-01-22T05:18:40.087357+0000","last_undegraded":"2024-01-22T05:18:40.087357+0000","last_fullsized":"2024-01-22T05:18:40.087357+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.109500+0000","last_change":"2024-01-22T05:18:40.107465+0000","last_active":"2024-01-22T05:18:40.109500+0000","last_peered":"2024-01-22T05:18:40.109500+0000","last_clean":"2024-01-22T05:18:40.109500+0000","last_became_active":"2024-01-22T05:18:40.107208+0000","last_became_peered":"2024-01-22T05:18:40.107208+0000","last_unstale":"2024-01-22T05:18:40.109500+0000","last_undegraded":"2024-01-22T05:18:40.109500+0000","last_fullsized":"2024-01-22T05:18:40.109500+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3c","version":"171'2","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.101411+0000","last_change":"2024-01-22T05:18:39.632984+0000","last_active":"2024-01-22T05:18:40.101411+0000","last_peered":"2024-01-22T05:18:40.101411+0000","last_clean":"2024-01-22T05:18:40.101411+0000","last_became_active":"2024-01-22T05:18:39.632685+0000","last_became_peered":"2024-01-22T05:18:39.632685+0000","last_unstale":"2024-01-22T05:18:40.101411+0000","last_undegraded":"2024-01-22T05:18:40.101411+0000","last_fullsized":"2024-01-22T05:18:40.101411+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.119992+0000","last_change":"2024-01-22T05:18:40.114704+0000","last_active":"2024-01-22T05:18:40.119992+0000","last_peered":"2024-01-22T05:18:40.119992+0000","last_clean":"2024-01-22T05:18:40.119992+0000","last_became_active":"2024-01-22T05:18:40.114415+0000","last_became_peered":"2024-01-22T05:18:40.114415+0000","last_unstale":"2024-01-22T05:18:40.119992+0000","last_undegraded":"2024-01-22T05:18:40.119992+0000","last_fullsized":"2024-01-22T05:18:40.119992+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3b","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.112980+0000","last_change":"2024-01-22T05:18:39.649147+0000","last_active":"2024-01-22T05:18:40.112980+0000","last_peered":"2024-01-22T05:18:40.112980+0000","last_clean":"2024-01-22T05:18:40.112980+0000","last_became_active":"2024-01-22T05:18:39.647794+0000","last_became_peered":"2024-01-22T05:18:39.647794+0000","last_unstale":"2024-01-22T05:18:40.112980+0000","last_undegraded":"2024-01-22T05:18:40.112980+0000","last_fullsized":"2024-01-22T05:18:40.112980+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.110776+0000","last_change":"2024-01-22T05:18:40.106821+0000","last_active":"2024-01-22T05:18:40.110776+0000","last_peered":"2024-01-22T05:18:40.110776+0000","last_clean":"2024-01-22T05:18:40.110776+0000","last_became_active":"2024-01-22T05:18:40.106229+0000","last_became_peered":"2024-01-22T05:18:40.106229+0000","last_unstale":"2024-01-22T05:18:40.110776+0000","last_undegraded":"2024-01-22T05:18:40.110776+0000","last_fullsized":"2024-01-22T05:18:40.110776+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.3a","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.107880+0000","last_change":"2024-01-22T05:18:39.643989+0000","last_active":"2024-01-22T05:18:40.107880+0000","last_peered":"2024-01-22T05:18:40.107880+0000","last_clean":"2024-01-22T05:18:40.107880+0000","last_became_active":"2024-01-22T05:18:39.643366+0000","last_became_peered":"2024-01-22T05:18:39.643366+0000","last_unstale":"2024-01-22T05:18:40.107880+0000","last_undegraded":"2024-01-22T05:18:40.107880+0000","last_fullsized":"2024-01-22T05:18:40.107880+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.102194+0000","last_change":"2024-01-22T05:18:40.097871+0000","last_active":"2024-01-22T05:18:40.102194+0000","last_peered":"2024-01-22T05:18:40.102194+0000","last_clean":"2024-01-22T05:18:40.102194+0000","last_became_active":"2024-01-22T05:18:40.096443+0000","last_became_peered":"2024-01-22T05:18:40.096443+0000","last_unstale":"2024-01-22T05:18:40.102194+0000","last_undegraded":"2024-01-22T05:18:40.102194+0000","last_fullsized":"2024-01-22T05:18:40.102194+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.092859+0000","last_change":"2024-01-22T05:18:39.631939+0000","last_active":"2024-01-22T05:18:40.092859+0000","last_peered":"2024-01-22T05:18:40.092859+0000","last_clean":"2024-01-22T05:18:40.092859+0000","last_became_active":"2024-01-22T05:18:39.630930+0000","last_became_peered":"2024-01-22T05:18:39.630930+0000","last_unstale":"2024-01-22T05:18:40.092859+0000","last_undegraded":"2024-01-22T05:18:40.092859+0000","last_fullsized":"2024-01-22T05:18:40.092859+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116202+0000","last_change":"2024-01-22T05:18:40.109719+0000","last_active":"2024-01-22T05:18:40.116202+0000","last_peered":"2024-01-22T05:18:40.116202+0000","last_clean":"2024-01-22T05:18:40.116202+0000","last_became_active":"2024-01-22T05:18:40.108835+0000","last_became_peered":"2024-01-22T05:18:40.108835+0000","last_unstale":"2024-01-22T05:18:40.116202+0000","last_undegraded":"2024-01-22T05:18:40.116202+0000","last_fullsized":"2024-01-22T05:18:40.116202+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.091768+0000","last_change":"2024-01-22T05:18:39.643517+0000","last_active":"2024-01-22T05:18:40.091768+0000","last_peered":"2024-01-22T05:18:40.091768+0000","last_clean":"2024-01-22T05:18:40.091768+0000","last_became_active":"2024-01-22T05:18:39.643216+0000","last_became_peered":"2024-01-22T05:18:39.643216+0000","last_unstale":"2024-01-22T05:18:40.091768+0000","last_undegraded":"2024-01-22T05:18:40.091768+0000","last_fullsized":"2024-01-22T05:18:40.091768+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116696+0000","last_change":"2024-01-22T05:18:40.112132+0000","last_active":"2024-01-22T05:18:40.116696+0000","last_peered":"2024-01-22T05:18:40.116696+0000","last_clean":"2024-01-22T05:18:40.116696+0000","last_became_active":"2024-01-22T05:18:40.111684+0000","last_became_peered":"2024-01-22T05:18:40.111684+0000","last_unstale":"2024-01-22T05:18:40.116696+0000","last_undegraded":"2024-01-22T05:18:40.116696+0000","last_fullsized":"2024-01-22T05:18:40.116696+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.093239+0000","last_change":"2024-01-22T05:18:39.644774+0000","last_active":"2024-01-22T05:18:40.093239+0000","last_peered":"2024-01-22T05:18:40.093239+0000","last_clean":"2024-01-22T05:18:40.093239+0000","last_became_active":"2024-01-22T05:18:39.644478+0000","last_became_peered":"2024-01-22T05:18:39.644478+0000","last_unstale":"2024-01-22T05:18:40.093239+0000","last_undegraded":"2024-01-22T05:18:40.093239+0000","last_fullsized":"2024-01-22T05:18:40.093239+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.118659+0000","last_change":"2024-01-22T05:18:40.115086+0000","last_active":"2024-01-22T05:18:40.118659+0000","last_peered":"2024-01-22T05:18:40.118659+0000","last_clean":"2024-01-22T05:18:40.118659+0000","last_became_active":"2024-01-22T05:18:40.114660+0000","last_became_peered":"2024-01-22T05:18:40.114660+0000","last_unstale":"2024-01-22T05:18:40.118659+0000","last_undegraded":"2024-01-22T05:18:40.118659+0000","last_fullsized":"2024-01-22T05:18:40.118659+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.094666+0000","last_change":"2024-01-22T05:18:39.648055+0000","last_active":"2024-01-22T05:18:40.094666+0000","last_peered":"2024-01-22T05:18:40.094666+0000","last_clean":"2024-01-22T05:18:40.094666+0000","last_became_active":"2024-01-22T05:18:39.647774+0000","last_became_peered":"2024-01-22T05:18:39.647774+0000","last_unstale":"2024-01-22T05:18:40.094666+0000","last_undegraded":"2024-01-22T05:18:40.094666+0000","last_fullsized":"2024-01-22T05:18:40.094666+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.117833+0000","last_change":"2024-01-22T05:18:40.110916+0000","last_active":"2024-01-22T05:18:40.117833+0000","last_peered":"2024-01-22T05:18:40.117833+0000","last_clean":"2024-01-22T05:18:40.117833+0000","last_became_active":"2024-01-22T05:18:40.110608+0000","last_became_peered":"2024-01-22T05:18:40.110608+0000","last_unstale":"2024-01-22T05:18:40.117833+0000","last_undegraded":"2024-01-22T05:18:40.117833+0000","last_fullsized":"2024-01-22T05:18:40.117833+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.092787+0000","last_change":"2024-01-22T05:18:39.642497+0000","last_active":"2024-01-22T05:18:40.092787+0000","last_peered":"2024-01-22T05:18:40.092787+0000","last_clean":"2024-01-22T05:18:40.092787+0000","last_became_active":"2024-01-22T05:18:39.642157+0000","last_became_peered":"2024-01-22T05:18:39.642157+0000","last_unstale":"2024-01-22T05:18:40.092787+0000","last_undegraded":"2024-01-22T05:18:40.092787+0000","last_fullsized":"2024-01-22T05:18:40.092787+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116325+0000","last_change":"2024-01-22T05:18:40.111984+0000","last_active":"2024-01-22T05:18:40.116325+0000","last_peered":"2024-01-22T05:18:40.116325+0000","last_clean":"2024-01-22T05:18:40.116325+0000","last_became_active":"2024-01-22T05:18:40.109100+0000","last_became_peered":"2024-01-22T05:18:40.109100+0000","last_unstale":"2024-01-22T05:18:40.116325+0000","last_undegraded":"2024-01-22T05:18:40.116325+0000","last_fullsized":"2024-01-22T05:18:40.116325+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.34","version":"171'4","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.120341+0000","last_change":"2024-01-22T05:18:39.645165+0000","last_active":"2024-01-22T05:18:40.120341+0000","last_peered":"2024-01-22T05:18:40.120341+0000","last_clean":"2024-01-22T05:18:40.120341+0000","last_became_active":"2024-01-22T05:18:39.644599+0000","last_became_peered":"2024-01-22T05:18:39.644599+0000","last_unstale":"2024-01-22T05:18:40.120341+0000","last_undegraded":"2024-01-22T05:18:40.120341+0000","last_fullsized":"2024-01-22T05:18:40.120341+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.118724+0000","last_change":"2024-01-22T05:18:40.115866+0000","last_active":"2024-01-22T05:18:40.118724+0000","last_peered":"2024-01-22T05:18:40.118724+0000","last_clean":"2024-01-22T05:18:40.118724+0000","last_became_active":"2024-01-22T05:18:40.115588+0000","last_became_peered":"2024-01-22T05:18:40.115588+0000","last_unstale":"2024-01-22T05:18:40.118724+0000","last_undegraded":"2024-01-22T05:18:40.118724+0000","last_fullsized":"2024-01-22T05:18:40.118724+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.117860+0000","last_change":"2024-01-22T05:18:39.646886+0000","last_active":"2024-01-22T05:18:40.117860+0000","last_peered":"2024-01-22T05:18:40.117860+0000","last_clean":"2024-01-22T05:18:40.117860+0000","last_became_active":"2024-01-22T05:18:39.646604+0000","last_became_peered":"2024-01-22T05:18:39.646604+0000","last_unstale":"2024-01-22T05:18:40.117860+0000","last_undegraded":"2024-01-22T05:18:40.117860+0000","last_fullsized":"2024-01-22T05:18:40.117860+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.117748+0000","last_change":"2024-01-22T05:18:40.110221+0000","last_active":"2024-01-22T05:18:40.117748+0000","last_peered":"2024-01-22T05:18:40.117748+0000","last_clean":"2024-01-22T05:18:40.117748+0000","last_became_active":"2024-01-22T05:18:40.109927+0000","last_became_peered":"2024-01-22T05:18:40.109927+0000","last_unstale":"2024-01-22T05:18:40.117748+0000","last_undegraded":"2024-01-22T05:18:40.117748+0000","last_fullsized":"2024-01-22T05:18:40.117748+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.096344+0000","last_change":"2024-01-22T05:18:39.650862+0000","last_active":"2024-01-22T05:18:40.096344+0000","last_peered":"2024-01-22T05:18:40.096344+0000","last_clean":"2024-01-22T05:18:40.096344+0000","last_became_active":"2024-01-22T05:18:39.650069+0000","last_became_peered":"2024-01-22T05:18:39.650069+0000","last_unstale":"2024-01-22T05:18:40.096344+0000","last_undegraded":"2024-01-22T05:18:40.096344+0000","last_fullsized":"2024-01-22T05:18:40.096344+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116406+0000","last_change":"2024-01-22T05:18:40.108938+0000","last_active":"2024-01-22T05:18:40.116406+0000","last_peered":"2024-01-22T05:18:40.116406+0000","last_clean":"2024-01-22T05:18:40.116406+0000","last_became_active":"2024-01-22T05:18:40.108638+0000","last_became_peered":"2024-01-22T05:18:40.108638+0000","last_unstale":"2024-01-22T05:18:40.116406+0000","last_undegraded":"2024-01-22T05:18:40.116406+0000","last_fullsized":"2024-01-22T05:18:40.116406+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.091584+0000","last_change":"2024-01-22T05:18:39.647731+0000","last_active":"2024-01-22T05:18:40.091584+0000","last_peered":"2024-01-22T05:18:40.091584+0000","last_clean":"2024-01-22T05:18:40.091584+0000","last_became_active":"2024-01-22T05:18:39.645128+0000","last_became_peered":"2024-01-22T05:18:39.645128+0000","last_unstale":"2024-01-22T05:18:40.091584+0000","last_undegraded":"2024-01-22T05:18:40.091584+0000","last_fullsized":"2024-01-22T05:18:40.091584+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.118158+0000","last_change":"2024-01-22T05:18:40.109698+0000","last_active":"2024-01-22T05:18:40.118158+0000","last_peered":"2024-01-22T05:18:40.118158+0000","last_clean":"2024-01-22T05:18:40.118158+0000","last_became_active":"2024-01-22T05:18:40.109405+0000","last_became_peered":"2024-01-22T05:18:40.109405+0000","last_unstale":"2024-01-22T05:18:40.118158+0000","last_undegraded":"2024-01-22T05:18:40.118158+0000","last_fullsized":"2024-01-22T05:18:40.118158+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.30","version":"171'4","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.111712+0000","last_change":"2024-01-22T05:18:39.634043+0000","last_active":"2024-01-22T05:18:40.111712+0000","last_peered":"2024-01-22T05:18:40.111712+0000","last_clean":"2024-01-22T05:18:40.111712+0000","last_became_active":"2024-01-22T05:18:39.632670+0000","last_became_peered":"2024-01-22T05:18:39.632670+0000","last_unstale":"2024-01-22T05:18:40.111712+0000","last_undegraded":"2024-01-22T05:18:40.111712+0000","last_fullsized":"2024-01-22T05:18:40.111712+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116364+0000","last_change":"2024-01-22T05:18:40.112827+0000","last_active":"2024-01-22T05:18:40.116364+0000","last_peered":"2024-01-22T05:18:40.116364+0000","last_clean":"2024-01-22T05:18:40.116364+0000","last_became_active":"2024-01-22T05:18:40.112514+0000","last_became_peered":"2024-01-22T05:18:40.112514+0000","last_unstale":"2024-01-22T05:18:40.116364+0000","last_undegraded":"2024-01-22T05:18:40.116364+0000","last_fullsized":"2024-01-22T05:18:40.116364+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.093330+0000","last_change":"2024-01-22T05:18:39.634999+0000","last_active":"2024-01-22T05:18:40.093330+0000","last_peered":"2024-01-22T05:18:40.093330+0000","last_clean":"2024-01-22T05:18:40.093330+0000","last_became_active":"2024-01-22T05:18:39.634720+0000","last_became_peered":"2024-01-22T05:18:39.634720+0000","last_unstale":"2024-01-22T05:18:40.093330+0000","last_undegraded":"2024-01-22T05:18:40.093330+0000","last_fullsized":"2024-01-22T05:18:40.093330+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.125476+0000","last_change":"2024-01-22T05:18:40.123889+0000","last_active":"2024-01-22T05:18:40.125476+0000","last_peered":"2024-01-22T05:18:40.125476+0000","last_clean":"2024-01-22T05:18:40.125476+0000","last_became_active":"2024-01-22T05:18:40.123039+0000","last_became_peered":"2024-01-22T05:18:40.123039+0000","last_unstale":"2024-01-22T05:18:40.125476+0000","last_undegraded":"2024-01-22T05:18:40.125476+0000","last_fullsized":"2024-01-22T05:18:40.125476+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.099885+0000","last_change":"2024-01-22T05:18:39.648262+0000","last_active":"2024-01-22T05:18:40.099885+0000","last_peered":"2024-01-22T05:18:40.099885+0000","last_clean":"2024-01-22T05:18:40.099885+0000","last_became_active":"2024-01-22T05:18:39.647570+0000","last_became_peered":"2024-01-22T05:18:39.647570+0000","last_unstale":"2024-01-22T05:18:40.099885+0000","last_undegraded":"2024-01-22T05:18:40.099885+0000","last_fullsized":"2024-01-22T05:18:40.099885+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.125527+0000","last_change":"2024-01-22T05:18:40.123919+0000","last_active":"2024-01-22T05:18:40.125527+0000","last_peered":"2024-01-22T05:18:40.125527+0000","last_clean":"2024-01-22T05:18:40.125527+0000","last_became_active":"2024-01-22T05:18:40.123644+0000","last_became_peered":"2024-01-22T05:18:40.123644+0000","last_unstale":"2024-01-22T05:18:40.125527+0000","last_undegraded":"2024-01-22T05:18:40.125527+0000","last_fullsized":"2024-01-22T05:18:40.125527+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2d","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.104746+0000","last_change":"2024-01-22T05:18:39.647771+0000","last_active":"2024-01-22T05:18:40.104746+0000","last_peered":"2024-01-22T05:18:40.104746+0000","last_clean":"2024-01-22T05:18:40.104746+0000","last_became_active":"2024-01-22T05:18:39.647382+0000","last_became_peered":"2024-01-22T05:18:39.647382+0000","last_unstale":"2024-01-22T05:18:40.104746+0000","last_undegraded":"2024-01-22T05:18:40.104746+0000","last_fullsized":"2024-01-22T05:18:40.104746+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.118204+0000","last_change":"2024-01-22T05:18:40.111082+0000","last_active":"2024-01-22T05:18:40.118204+0000","last_peered":"2024-01-22T05:18:40.118204+0000","last_clean":"2024-01-22T05:18:40.118204+0000","last_became_active":"2024-01-22T05:18:40.110506+0000","last_became_peered":"2024-01-22T05:18:40.110506+0000","last_unstale":"2024-01-22T05:18:40.118204+0000","last_undegraded":"2024-01-22T05:18:40.118204+0000","last_fullsized":"2024-01-22T05:18:40.118204+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.100001+0000","last_change":"2024-01-22T05:18:39.646341+0000","last_active":"2024-01-22T05:18:40.100001+0000","last_peered":"2024-01-22T05:18:40.100001+0000","last_clean":"2024-01-22T05:18:40.100001+0000","last_became_active":"2024-01-22T05:18:39.646055+0000","last_became_peered":"2024-01-22T05:18:39.646055+0000","last_unstale":"2024-01-22T05:18:40.100001+0000","last_undegraded":"2024-01-22T05:18:40.100001+0000","last_fullsized":"2024-01-22T05:18:40.100001+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115875+0000","last_change":"2024-01-22T05:18:40.112408+0000","last_active":"2024-01-22T05:18:40.115875+0000","last_peered":"2024-01-22T05:18:40.115875+0000","last_clean":"2024-01-22T05:18:40.115875+0000","last_became_active":"2024-01-22T05:18:40.112141+0000","last_became_peered":"2024-01-22T05:18:40.112141+0000","last_unstale":"2024-01-22T05:18:40.115875+0000","last_undegraded":"2024-01-22T05:18:40.115875+0000","last_fullsized":"2024-01-22T05:18:40.115875+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2b","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.114838+0000","last_change":"2024-01-22T05:18:39.651930+0000","last_active":"2024-01-22T05:18:40.114838+0000","last_peered":"2024-01-22T05:18:40.114838+0000","last_clean":"2024-01-22T05:18:40.114838+0000","last_became_active":"2024-01-22T05:18:39.651607+0000","last_became_peered":"2024-01-22T05:18:39.651607+0000","last_unstale":"2024-01-22T05:18:40.114838+0000","last_undegraded":"2024-01-22T05:18:40.114838+0000","last_fullsized":"2024-01-22T05:18:40.114838+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.110795+0000","last_change":"2024-01-22T05:18:40.106996+0000","last_active":"2024-01-22T05:18:40.110795+0000","last_peered":"2024-01-22T05:18:40.110795+0000","last_clean":"2024-01-22T05:18:40.110795+0000","last_became_active":"2024-01-22T05:18:40.106592+0000","last_became_peered":"2024-01-22T05:18:40.106592+0000","last_unstale":"2024-01-22T05:18:40.110795+0000","last_undegraded":"2024-01-22T05:18:40.110795+0000","last_fullsized":"2024-01-22T05:18:40.110795+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.100971+0000","last_change":"2024-01-22T05:18:39.644188+0000","last_active":"2024-01-22T05:18:40.100971+0000","last_peered":"2024-01-22T05:18:40.100971+0000","last_clean":"2024-01-22T05:18:40.100971+0000","last_became_active":"2024-01-22T05:18:39.643711+0000","last_became_peered":"2024-01-22T05:18:39.643711+0000","last_unstale":"2024-01-22T05:18:40.100971+0000","last_undegraded":"2024-01-22T05:18:40.100971+0000","last_fullsized":"2024-01-22T05:18:40.100971+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.109080+0000","last_change":"2024-01-22T05:18:40.102045+0000","last_active":"2024-01-22T05:18:40.109080+0000","last_peered":"2024-01-22T05:18:40.109080+0000","last_clean":"2024-01-22T05:18:40.109080+0000","last_became_active":"2024-01-22T05:18:40.101757+0000","last_became_peered":"2024-01-22T05:18:40.101757+0000","last_unstale":"2024-01-22T05:18:40.109080+0000","last_undegraded":"2024-01-22T05:18:40.109080+0000","last_fullsized":"2024-01-22T05:18:40.109080+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.095315+0000","last_change":"2024-01-22T05:18:39.644880+0000","last_active":"2024-01-22T05:18:40.095315+0000","last_peered":"2024-01-22T05:18:40.095315+0000","last_clean":"2024-01-22T05:18:40.095315+0000","last_became_active":"2024-01-22T05:18:39.644522+0000","last_became_peered":"2024-01-22T05:18:39.644522+0000","last_unstale":"2024-01-22T05:18:40.095315+0000","last_undegraded":"2024-01-22T05:18:40.095315+0000","last_fullsized":"2024-01-22T05:18:40.095315+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.120282+0000","last_change":"2024-01-22T05:18:40.116161+0000","last_active":"2024-01-22T05:18:40.120282+0000","last_peered":"2024-01-22T05:18:40.120282+0000","last_clean":"2024-01-22T05:18:40.120282+0000","last_became_active":"2024-01-22T05:18:40.115878+0000","last_became_peered":"2024-01-22T05:18:40.115878+0000","last_unstale":"2024-01-22T05:18:40.120282+0000","last_undegraded":"2024-01-22T05:18:40.120282+0000","last_fullsized":"2024-01-22T05:18:40.120282+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.085479+0000","last_change":"2024-01-22T05:18:39.633663+0000","last_active":"2024-01-22T05:18:40.085479+0000","last_peered":"2024-01-22T05:18:40.085479+0000","last_clean":"2024-01-22T05:18:40.085479+0000","last_became_active":"2024-01-22T05:18:39.633087+0000","last_became_peered":"2024-01-22T05:18:39.633087+0000","last_unstale":"2024-01-22T05:18:40.085479+0000","last_undegraded":"2024-01-22T05:18:40.085479+0000","last_fullsized":"2024-01-22T05:18:40.085479+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115958+0000","last_change":"2024-01-22T05:18:40.109758+0000","last_active":"2024-01-22T05:18:40.115958+0000","last_peered":"2024-01-22T05:18:40.115958+0000","last_clean":"2024-01-22T05:18:40.115958+0000","last_became_active":"2024-01-22T05:18:40.108362+0000","last_became_peered":"2024-01-22T05:18:40.108362+0000","last_unstale":"2024-01-22T05:18:40.115958+0000","last_undegraded":"2024-01-22T05:18:40.115958+0000","last_fullsized":"2024-01-22T05:18:40.115958+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.084481+0000","last_change":"2024-01-22T05:18:39.645511+0000","last_active":"2024-01-22T05:18:40.084481+0000","last_peered":"2024-01-22T05:18:40.084481+0000","last_clean":"2024-01-22T05:18:40.084481+0000","last_became_active":"2024-01-22T05:18:39.645227+0000","last_became_peered":"2024-01-22T05:18:39.645227+0000","last_unstale":"2024-01-22T05:18:40.084481+0000","last_undegraded":"2024-01-22T05:18:40.084481+0000","last_fullsized":"2024-01-22T05:18:40.084481+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.119787+0000","last_change":"2024-01-22T05:18:40.114186+0000","last_active":"2024-01-22T05:18:40.119787+0000","last_peered":"2024-01-22T05:18:40.119787+0000","last_clean":"2024-01-22T05:18:40.119787+0000","last_became_active":"2024-01-22T05:18:40.111525+0000","last_became_peered":"2024-01-22T05:18:40.111525+0000","last_unstale":"2024-01-22T05:18:40.119787+0000","last_undegraded":"2024-01-22T05:18:40.119787+0000","last_fullsized":"2024-01-22T05:18:40.119787+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.098758+0000","last_change":"2024-01-22T05:18:39.650338+0000","last_active":"2024-01-22T05:18:40.098758+0000","last_peered":"2024-01-22T05:18:40.098758+0000","last_clean":"2024-01-22T05:18:40.098758+0000","last_became_active":"2024-01-22T05:18:39.649152+0000","last_became_peered":"2024-01-22T05:18:39.649152+0000","last_unstale":"2024-01-22T05:18:40.098758+0000","last_undegraded":"2024-01-22T05:18:40.098758+0000","last_fullsized":"2024-01-22T05:18:40.098758+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116798+0000","last_change":"2024-01-22T05:18:40.115783+0000","last_active":"2024-01-22T05:18:40.116798+0000","last_peered":"2024-01-22T05:18:40.116798+0000","last_clean":"2024-01-22T05:18:40.116798+0000","last_became_active":"2024-01-22T05:18:40.115494+0000","last_became_peered":"2024-01-22T05:18:40.115494+0000","last_unstale":"2024-01-22T05:18:40.116798+0000","last_undegraded":"2024-01-22T05:18:40.116798+0000","last_fullsized":"2024-01-22T05:18:40.116798+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.102958+0000","last_change":"2024-01-22T05:18:39.646087+0000","last_active":"2024-01-22T05:18:40.102958+0000","last_peered":"2024-01-22T05:18:40.102958+0000","last_clean":"2024-01-22T05:18:40.102958+0000","last_became_active":"2024-01-22T05:18:39.645724+0000","last_became_peered":"2024-01-22T05:18:39.645724+0000","last_unstale":"2024-01-22T05:18:40.102958+0000","last_undegraded":"2024-01-22T05:18:40.102958+0000","last_fullsized":"2024-01-22T05:18:40.102958+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.120500+0000","last_change":"2024-01-22T05:18:40.115428+0000","last_active":"2024-01-22T05:18:40.120500+0000","last_peered":"2024-01-22T05:18:40.120500+0000","last_clean":"2024-01-22T05:18:40.120500+0000","last_became_active":"2024-01-22T05:18:40.115142+0000","last_became_peered":"2024-01-22T05:18:40.115142+0000","last_unstale":"2024-01-22T05:18:40.120500+0000","last_undegraded":"2024-01-22T05:18:40.120500+0000","last_fullsized":"2024-01-22T05:18:40.120500+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.085281+0000","last_change":"2024-01-22T05:18:39.653534+0000","last_active":"2024-01-22T05:18:40.085281+0000","last_peered":"2024-01-22T05:18:40.085281+0000","last_clean":"2024-01-22T05:18:40.085281+0000","last_became_active":"2024-01-22T05:18:39.647883+0000","last_became_peered":"2024-01-22T05:18:39.647883+0000","last_unstale":"2024-01-22T05:18:40.085281+0000","last_undegraded":"2024-01-22T05:18:40.085281+0000","last_fullsized":"2024-01-22T05:18:40.085281+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.117491+0000","last_change":"2024-01-22T05:18:40.107647+0000","last_active":"2024-01-22T05:18:40.117491+0000","last_peered":"2024-01-22T05:18:40.117491+0000","last_clean":"2024-01-22T05:18:40.117491+0000","last_became_active":"2024-01-22T05:18:40.107256+0000","last_became_peered":"2024-01-22T05:18:40.107256+0000","last_unstale":"2024-01-22T05:18:40.117491+0000","last_undegraded":"2024-01-22T05:18:40.117491+0000","last_fullsized":"2024-01-22T05:18:40.117491+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.105958+0000","last_change":"2024-01-22T05:18:39.651974+0000","last_active":"2024-01-22T05:18:40.105958+0000","last_peered":"2024-01-22T05:18:40.105958+0000","last_clean":"2024-01-22T05:18:40.105958+0000","last_became_active":"2024-01-22T05:18:39.650797+0000","last_became_peered":"2024-01-22T05:18:39.650797+0000","last_unstale":"2024-01-22T05:18:40.105958+0000","last_undegraded":"2024-01-22T05:18:40.105958+0000","last_fullsized":"2024-01-22T05:18:40.105958+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.120984+0000","last_change":"2024-01-22T05:18:40.116934+0000","last_active":"2024-01-22T05:18:40.120984+0000","last_peered":"2024-01-22T05:18:40.120984+0000","last_clean":"2024-01-22T05:18:40.120984+0000","last_became_active":"2024-01-22T05:18:40.116647+0000","last_became_peered":"2024-01-22T05:18:40.116647+0000","last_unstale":"2024-01-22T05:18:40.120984+0000","last_undegraded":"2024-01-22T05:18:40.120984+0000","last_fullsized":"2024-01-22T05:18:40.120984+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.104788+0000","last_change":"2024-01-22T05:18:39.639583+0000","last_active":"2024-01-22T05:18:40.104788+0000","last_peered":"2024-01-22T05:18:40.104788+0000","last_clean":"2024-01-22T05:18:40.104788+0000","last_became_active":"2024-01-22T05:18:39.639235+0000","last_became_peered":"2024-01-22T05:18:39.639235+0000","last_unstale":"2024-01-22T05:18:40.104788+0000","last_undegraded":"2024-01-22T05:18:40.104788+0000","last_fullsized":"2024-01-22T05:18:40.104788+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.114004+0000","last_change":"2024-01-22T05:18:40.110282+0000","last_active":"2024-01-22T05:18:40.114004+0000","last_peered":"2024-01-22T05:18:40.114004+0000","last_clean":"2024-01-22T05:18:40.114004+0000","last_became_active":"2024-01-22T05:18:40.109989+0000","last_became_peered":"2024-01-22T05:18:40.109989+0000","last_unstale":"2024-01-22T05:18:40.114004+0000","last_undegraded":"2024-01-22T05:18:40.114004+0000","last_fullsized":"2024-01-22T05:18:40.114004+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.091696+0000","last_change":"2024-01-22T05:18:39.637562+0000","last_active":"2024-01-22T05:18:40.091696+0000","last_peered":"2024-01-22T05:18:40.091696+0000","last_clean":"2024-01-22T05:18:40.091696+0000","last_became_active":"2024-01-22T05:18:39.637243+0000","last_became_peered":"2024-01-22T05:18:39.637243+0000","last_unstale":"2024-01-22T05:18:40.091696+0000","last_undegraded":"2024-01-22T05:18:40.091696+0000","last_fullsized":"2024-01-22T05:18:40.091696+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.124595+0000","last_change":"2024-01-22T05:18:40.121592+0000","last_active":"2024-01-22T05:18:40.124595+0000","last_peered":"2024-01-22T05:18:40.124595+0000","last_clean":"2024-01-22T05:18:40.124595+0000","last_became_active":"2024-01-22T05:18:40.120922+0000","last_became_peered":"2024-01-22T05:18:40.120922+0000","last_unstale":"2024-01-22T05:18:40.124595+0000","last_undegraded":"2024-01-22T05:18:40.124595+0000","last_fullsized":"2024-01-22T05:18:40.124595+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.100183+0000","last_change":"2024-01-22T05:18:39.649665+0000","last_active":"2024-01-22T05:18:40.100183+0000","last_peered":"2024-01-22T05:18:40.100183+0000","last_clean":"2024-01-22T05:18:40.100183+0000","last_became_active":"2024-01-22T05:18:39.649391+0000","last_became_peered":"2024-01-22T05:18:39.649391+0000","last_unstale":"2024-01-22T05:18:40.100183+0000","last_undegraded":"2024-01-22T05:18:40.100183+0000","last_fullsized":"2024-01-22T05:18:40.100183+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.106073+0000","last_change":"2024-01-22T05:18:40.101935+0000","last_active":"2024-01-22T05:18:40.106073+0000","last_peered":"2024-01-22T05:18:40.106073+0000","last_clean":"2024-01-22T05:18:40.106073+0000","last_became_active":"2024-01-22T05:18:40.101517+0000","last_became_peered":"2024-01-22T05:18:40.101517+0000","last_unstale":"2024-01-22T05:18:40.106073+0000","last_undegraded":"2024-01-22T05:18:40.106073+0000","last_fullsized":"2024-01-22T05:18:40.106073+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.087676+0000","last_change":"2024-01-22T05:18:39.625233+0000","last_active":"2024-01-22T05:18:40.087676+0000","last_peered":"2024-01-22T05:18:40.087676+0000","last_clean":"2024-01-22T05:18:40.087676+0000","last_became_active":"2024-01-22T05:18:39.624912+0000","last_became_peered":"2024-01-22T05:18:39.624912+0000","last_unstale":"2024-01-22T05:18:40.087676+0000","last_undegraded":"2024-01-22T05:18:40.087676+0000","last_fullsized":"2024-01-22T05:18:40.087676+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.121429+0000","last_change":"2024-01-22T05:18:40.119689+0000","last_active":"2024-01-22T05:18:40.121429+0000","last_peered":"2024-01-22T05:18:40.121429+0000","last_clean":"2024-01-22T05:18:40.121429+0000","last_became_active":"2024-01-22T05:18:40.119436+0000","last_became_peered":"2024-01-22T05:18:40.119436+0000","last_unstale":"2024-01-22T05:18:40.121429+0000","last_undegraded":"2024-01-22T05:18:40.121429+0000","last_fullsized":"2024-01-22T05:18:40.121429+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.098854+0000","last_change":"2024-01-22T05:18:39.643047+0000","last_active":"2024-01-22T05:18:40.098854+0000","last_peered":"2024-01-22T05:18:40.098854+0000","last_clean":"2024-01-22T05:18:40.098854+0000","last_became_active":"2024-01-22T05:18:39.642733+0000","last_became_peered":"2024-01-22T05:18:39.642733+0000","last_unstale":"2024-01-22T05:18:40.098854+0000","last_undegraded":"2024-01-22T05:18:40.098854+0000","last_fullsized":"2024-01-22T05:18:40.098854+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.104557+0000","last_change":"2024-01-22T05:18:40.101138+0000","last_active":"2024-01-22T05:18:40.104557+0000","last_peered":"2024-01-22T05:18:40.104557+0000","last_clean":"2024-01-22T05:18:40.104557+0000","last_became_active":"2024-01-22T05:18:40.100868+0000","last_became_peered":"2024-01-22T05:18:40.100868+0000","last_unstale":"2024-01-22T05:18:40.104557+0000","last_undegraded":"2024-01-22T05:18:40.104557+0000","last_fullsized":"2024-01-22T05:18:40.104557+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"171'3","reported_seq":13,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.121258+0000","last_change":"2024-01-22T05:18:39.650031+0000","last_active":"2024-01-22T05:18:40.121258+0000","last_peered":"2024-01-22T05:18:40.121258+0000","last_clean":"2024-01-22T05:18:40.121258+0000","last_became_active":"2024-01-22T05:18:39.649738+0000","last_became_peered":"2024-01-22T05:18:39.649738+0000","last_unstale":"2024-01-22T05:18:40.121258+0000","last_undegraded":"2024-01-22T05:18:40.121258+0000","last_fullsized":"2024-01-22T05:18:40.121258+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115753+0000","last_change":"2024-01-22T05:18:40.111361+0000","last_active":"2024-01-22T05:18:40.115753+0000","last_peered":"2024-01-22T05:18:40.115753+0000","last_clean":"2024-01-22T05:18:40.115753+0000","last_became_active":"2024-01-22T05:18:40.110801+0000","last_became_peered":"2024-01-22T05:18:40.110801+0000","last_unstale":"2024-01-22T05:18:40.115753+0000","last_undegraded":"2024-01-22T05:18:40.115753+0000","last_fullsized":"2024-01-22T05:18:40.115753+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"171'2","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.113371+0000","last_change":"2024-01-22T05:18:39.645144+0000","last_active":"2024-01-22T05:18:40.113371+0000","last_peered":"2024-01-22T05:18:40.113371+0000","last_clean":"2024-01-22T05:18:40.113371+0000","last_became_active":"2024-01-22T05:18:39.639581+0000","last_became_peered":"2024-01-22T05:18:39.639581+0000","last_unstale":"2024-01-22T05:18:40.113371+0000","last_undegraded":"2024-01-22T05:18:40.113371+0000","last_fullsized":"2024-01-22T05:18:40.113371+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.121797+0000","last_change":"2024-01-22T05:18:40.119639+0000","last_active":"2024-01-22T05:18:40.121797+0000","last_peered":"2024-01-22T05:18:40.121797+0000","last_clean":"2024-01-22T05:18:40.121797+0000","last_became_active":"2024-01-22T05:18:40.119326+0000","last_became_peered":"2024-01-22T05:18:40.119326+0000","last_unstale":"2024-01-22T05:18:40.121797+0000","last_undegraded":"2024-01-22T05:18:40.121797+0000","last_fullsized":"2024-01-22T05:18:40.121797+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.114629+0000","last_change":"2024-01-22T05:18:39.646639+0000","last_active":"2024-01-22T05:18:40.114629+0000","last_peered":"2024-01-22T05:18:40.114629+0000","last_clean":"2024-01-22T05:18:40.114629+0000","last_became_active":"2024-01-22T05:18:39.646318+0000","last_became_peered":"2024-01-22T05:18:39.646318+0000","last_unstale":"2024-01-22T05:18:40.114629+0000","last_undegraded":"2024-01-22T05:18:40.114629+0000","last_fullsized":"2024-01-22T05:18:40.114629+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115992+0000","last_change":"2024-01-22T05:18:40.109778+0000","last_active":"2024-01-22T05:18:40.115992+0000","last_peered":"2024-01-22T05:18:40.115992+0000","last_clean":"2024-01-22T05:18:40.115992+0000","last_became_active":"2024-01-22T05:18:40.109515+0000","last_became_peered":"2024-01-22T05:18:40.109515+0000","last_unstale":"2024-01-22T05:18:40.115992+0000","last_undegraded":"2024-01-22T05:18:40.115992+0000","last_fullsized":"2024-01-22T05:18:40.115992+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.096439+0000","last_change":"2024-01-22T05:18:39.651070+0000","last_active":"2024-01-22T05:18:40.096439+0000","last_peered":"2024-01-22T05:18:40.096439+0000","last_clean":"2024-01-22T05:18:40.096439+0000","last_became_active":"2024-01-22T05:18:39.650415+0000","last_became_peered":"2024-01-22T05:18:39.650415+0000","last_unstale":"2024-01-22T05:18:40.096439+0000","last_undegraded":"2024-01-22T05:18:40.096439+0000","last_fullsized":"2024-01-22T05:18:40.096439+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.117316+0000","last_change":"2024-01-22T05:18:40.114065+0000","last_active":"2024-01-22T05:18:40.117316+0000","last_peered":"2024-01-22T05:18:40.117316+0000","last_clean":"2024-01-22T05:18:40.117316+0000","last_became_active":"2024-01-22T05:18:40.113808+0000","last_became_peered":"2024-01-22T05:18:40.113808+0000","last_unstale":"2024-01-22T05:18:40.117316+0000","last_undegraded":"2024-01-22T05:18:40.117316+0000","last_fullsized":"2024-01-22T05:18:40.117316+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.083685+0000","last_change":"2024-01-22T05:18:39.646052+0000","last_active":"2024-01-22T05:18:40.083685+0000","last_peered":"2024-01-22T05:18:40.083685+0000","last_clean":"2024-01-22T05:18:40.083685+0000","last_became_active":"2024-01-22T05:18:39.645731+0000","last_became_peered":"2024-01-22T05:18:39.645731+0000","last_unstale":"2024-01-22T05:18:40.083685+0000","last_undegraded":"2024-01-22T05:18:40.083685+0000","last_fullsized":"2024-01-22T05:18:40.083685+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.118316+0000","last_change":"2024-01-22T05:18:40.110847+0000","last_active":"2024-01-22T05:18:40.118316+0000","last_peered":"2024-01-22T05:18:40.118316+0000","last_clean":"2024-01-22T05:18:40.118316+0000","last_became_active":"2024-01-22T05:18:40.110451+0000","last_became_peered":"2024-01-22T05:18:40.110451+0000","last_unstale":"2024-01-22T05:18:40.118316+0000","last_undegraded":"2024-01-22T05:18:40.118316+0000","last_fullsized":"2024-01-22T05:18:40.118316+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"171'4","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.111360+0000","last_change":"2024-01-22T05:18:39.644693+0000","last_active":"2024-01-22T05:18:40.111360+0000","last_peered":"2024-01-22T05:18:40.111360+0000","last_clean":"2024-01-22T05:18:40.111360+0000","last_became_active":"2024-01-22T05:18:39.643817+0000","last_became_peered":"2024-01-22T05:18:39.643817+0000","last_unstale":"2024-01-22T05:18:40.111360+0000","last_undegraded":"2024-01-22T05:18:40.111360+0000","last_fullsized":"2024-01-22T05:18:40.111360+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116678+0000","last_change":"2024-01-22T05:18:40.111966+0000","last_active":"2024-01-22T05:18:40.116678+0000","last_peered":"2024-01-22T05:18:40.116678+0000","last_clean":"2024-01-22T05:18:40.116678+0000","last_became_active":"2024-01-22T05:18:40.111410+0000","last_became_peered":"2024-01-22T05:18:40.111410+0000","last_unstale":"2024-01-22T05:18:40.116678+0000","last_undegraded":"2024-01-22T05:18:40.116678+0000","last_fullsized":"2024-01-22T05:18:40.116678+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116301+0000","last_change":"2024-01-22T05:18:39.644813+0000","last_active":"2024-01-22T05:18:40.116301+0000","last_peered":"2024-01-22T05:18:40.116301+0000","last_clean":"2024-01-22T05:18:40.116301+0000","last_became_active":"2024-01-22T05:18:39.644494+0000","last_became_peered":"2024-01-22T05:18:39.644494+0000","last_unstale":"2024-01-22T05:18:40.116301+0000","last_undegraded":"2024-01-22T05:18:40.116301+0000","last_fullsized":"2024-01-22T05:18:40.116301+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.118637+0000","last_change":"2024-01-22T05:18:40.114918+0000","last_active":"2024-01-22T05:18:40.118637+0000","last_peered":"2024-01-22T05:18:40.118637+0000","last_clean":"2024-01-22T05:18:40.118637+0000","last_became_active":"2024-01-22T05:18:40.114338+0000","last_became_peered":"2024-01-22T05:18:40.114338+0000","last_unstale":"2024-01-22T05:18:40.118637+0000","last_undegraded":"2024-01-22T05:18:40.118637+0000","last_fullsized":"2024-01-22T05:18:40.118637+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"171'2","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116887+0000","last_change":"2024-01-22T05:18:39.647960+0000","last_active":"2024-01-22T05:18:40.116887+0000","last_peered":"2024-01-22T05:18:40.116887+0000","last_clean":"2024-01-22T05:18:40.116887+0000","last_became_active":"2024-01-22T05:18:39.647667+0000","last_became_peered":"2024-01-22T05:18:39.647667+0000","last_unstale":"2024-01-22T05:18:40.116887+0000","last_undegraded":"2024-01-22T05:18:40.116887+0000","last_fullsized":"2024-01-22T05:18:40.116887+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.117225+0000","last_change":"2024-01-22T05:18:40.107625+0000","last_active":"2024-01-22T05:18:40.117225+0000","last_peered":"2024-01-22T05:18:40.117225+0000","last_clean":"2024-01-22T05:18:40.117225+0000","last_became_active":"2024-01-22T05:18:40.107358+0000","last_became_peered":"2024-01-22T05:18:40.107358+0000","last_unstale":"2024-01-22T05:18:40.117225+0000","last_undegraded":"2024-01-22T05:18:40.117225+0000","last_fullsized":"2024-01-22T05:18:40.117225+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.102746+0000","last_change":"2024-01-22T05:18:39.651466+0000","last_active":"2024-01-22T05:18:40.102746+0000","last_peered":"2024-01-22T05:18:40.102746+0000","last_clean":"2024-01-22T05:18:40.102746+0000","last_became_active":"2024-01-22T05:18:39.650799+0000","last_became_peered":"2024-01-22T05:18:39.650799+0000","last_unstale":"2024-01-22T05:18:40.102746+0000","last_undegraded":"2024-01-22T05:18:40.102746+0000","last_fullsized":"2024-01-22T05:18:40.102746+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.119725+0000","last_change":"2024-01-22T05:18:40.112592+0000","last_active":"2024-01-22T05:18:40.119725+0000","last_peered":"2024-01-22T05:18:40.119725+0000","last_clean":"2024-01-22T05:18:40.119725+0000","last_became_active":"2024-01-22T05:18:40.112330+0000","last_became_peered":"2024-01-22T05:18:40.112330+0000","last_unstale":"2024-01-22T05:18:40.119725+0000","last_undegraded":"2024-01-22T05:18:40.119725+0000","last_fullsized":"2024-01-22T05:18:40.119725+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.086821+0000","last_change":"2024-01-22T05:18:39.643299+0000","last_active":"2024-01-22T05:18:40.086821+0000","last_peered":"2024-01-22T05:18:40.086821+0000","last_clean":"2024-01-22T05:18:40.086821+0000","last_became_active":"2024-01-22T05:18:39.642158+0000","last_became_peered":"2024-01-22T05:18:39.642158+0000","last_unstale":"2024-01-22T05:18:40.086821+0000","last_undegraded":"2024-01-22T05:18:40.086821+0000","last_fullsized":"2024-01-22T05:18:40.086821+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115859+0000","last_change":"2024-01-22T05:18:40.112326+0000","last_active":"2024-01-22T05:18:40.115859+0000","last_peered":"2024-01-22T05:18:40.115859+0000","last_clean":"2024-01-22T05:18:40.115859+0000","last_became_active":"2024-01-22T05:18:40.111170+0000","last_became_peered":"2024-01-22T05:18:40.111170+0000","last_unstale":"2024-01-22T05:18:40.115859+0000","last_undegraded":"2024-01-22T05:18:40.115859+0000","last_fullsized":"2024-01-22T05:18:40.115859+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.113034+0000","last_change":"2024-01-22T05:18:39.644133+0000","last_active":"2024-01-22T05:18:40.113034+0000","last_peered":"2024-01-22T05:18:40.113034+0000","last_clean":"2024-01-22T05:18:40.113034+0000","last_became_active":"2024-01-22T05:18:39.636375+0000","last_became_peered":"2024-01-22T05:18:39.636375+0000","last_unstale":"2024-01-22T05:18:40.113034+0000","last_undegraded":"2024-01-22T05:18:40.113034+0000","last_fullsized":"2024-01-22T05:18:40.113034+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.090717+0000","last_change":"2024-01-22T05:18:40.089132+0000","last_active":"2024-01-22T05:18:40.090717+0000","last_peered":"2024-01-22T05:18:40.090717+0000","last_clean":"2024-01-22T05:18:40.090717+0000","last_became_active":"2024-01-22T05:18:40.088829+0000","last_became_peered":"2024-01-22T05:18:40.088829+0000","last_unstale":"2024-01-22T05:18:40.090717+0000","last_undegraded":"2024-01-22T05:18:40.090717+0000","last_fullsized":"2024-01-22T05:18:40.090717+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.093806+0000","last_change":"2024-01-22T05:18:39.643888+0000","last_active":"2024-01-22T05:18:40.093806+0000","last_peered":"2024-01-22T05:18:40.093806+0000","last_clean":"2024-01-22T05:18:40.093806+0000","last_became_active":"2024-01-22T05:18:39.643156+0000","last_became_peered":"2024-01-22T05:18:39.643156+0000","last_unstale":"2024-01-22T05:18:40.093806+0000","last_undegraded":"2024-01-22T05:18:40.093806+0000","last_fullsized":"2024-01-22T05:18:40.093806+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.119447+0000","last_change":"2024-01-22T05:18:40.111926+0000","last_active":"2024-01-22T05:18:40.119447+0000","last_peered":"2024-01-22T05:18:40.119447+0000","last_clean":"2024-01-22T05:18:40.119447+0000","last_became_active":"2024-01-22T05:18:40.111155+0000","last_became_peered":"2024-01-22T05:18:40.111155+0000","last_unstale":"2024-01-22T05:18:40.119447+0000","last_undegraded":"2024-01-22T05:18:40.119447+0000","last_fullsized":"2024-01-22T05:18:40.119447+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.092983+0000","last_change":"2024-01-22T05:18:39.631758+0000","last_active":"2024-01-22T05:18:40.092983+0000","last_peered":"2024-01-22T05:18:40.092983+0000","last_clean":"2024-01-22T05:18:40.092983+0000","last_became_active":"2024-01-22T05:18:39.630549+0000","last_became_peered":"2024-01-22T05:18:39.630549+0000","last_unstale":"2024-01-22T05:18:40.092983+0000","last_undegraded":"2024-01-22T05:18:40.092983+0000","last_fullsized":"2024-01-22T05:18:40.092983+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.111478+0000","last_change":"2024-01-22T05:18:40.105296+0000","last_active":"2024-01-22T05:18:40.111478+0000","last_peered":"2024-01-22T05:18:40.111478+0000","last_clean":"2024-01-22T05:18:40.111478+0000","last_became_active":"2024-01-22T05:18:40.101340+0000","last_became_peered":"2024-01-22T05:18:40.101340+0000","last_unstale":"2024-01-22T05:18:40.111478+0000","last_undegraded":"2024-01-22T05:18:40.111478+0000","last_fullsized":"2024-01-22T05:18:40.111478+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.091388+0000","last_change":"2024-01-22T05:18:39.641272+0000","last_active":"2024-01-22T05:18:40.091388+0000","last_peered":"2024-01-22T05:18:40.091388+0000","last_clean":"2024-01-22T05:18:40.091388+0000","last_became_active":"2024-01-22T05:18:39.640728+0000","last_became_peered":"2024-01-22T05:18:39.640728+0000","last_unstale":"2024-01-22T05:18:40.091388+0000","last_undegraded":"2024-01-22T05:18:40.091388+0000","last_fullsized":"2024-01-22T05:18:40.091388+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.105112+0000","last_change":"2024-01-22T05:18:40.102850+0000","last_active":"2024-01-22T05:18:40.105112+0000","last_peered":"2024-01-22T05:18:40.105112+0000","last_clean":"2024-01-22T05:18:40.105112+0000","last_became_active":"2024-01-22T05:18:40.102416+0000","last_became_peered":"2024-01-22T05:18:40.102416+0000","last_unstale":"2024-01-22T05:18:40.105112+0000","last_undegraded":"2024-01-22T05:18:40.105112+0000","last_fullsized":"2024-01-22T05:18:40.105112+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"171'2","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.112650+0000","last_change":"2024-01-22T05:18:39.646150+0000","last_active":"2024-01-22T05:18:40.112650+0000","last_peered":"2024-01-22T05:18:40.112650+0000","last_clean":"2024-01-22T05:18:40.112650+0000","last_became_active":"2024-01-22T05:18:39.645801+0000","last_became_peered":"2024-01-22T05:18:39.645801+0000","last_unstale":"2024-01-22T05:18:40.112650+0000","last_undegraded":"2024-01-22T05:18:40.112650+0000","last_fullsized":"2024-01-22T05:18:40.112650+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.118237+0000","last_change":"2024-01-22T05:18:40.113099+0000","last_active":"2024-01-22T05:18:40.118237+0000","last_peered":"2024-01-22T05:18:40.118237+0000","last_clean":"2024-01-22T05:18:40.118237+0000","last_became_active":"2024-01-22T05:18:40.112665+0000","last_became_peered":"2024-01-22T05:18:40.112665+0000","last_unstale":"2024-01-22T05:18:40.118237+0000","last_undegraded":"2024-01-22T05:18:40.118237+0000","last_fullsized":"2024-01-22T05:18:40.118237+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.098937+0000","last_change":"2024-01-22T05:18:39.656479+0000","last_active":"2024-01-22T05:18:40.098937+0000","last_peered":"2024-01-22T05:18:40.098937+0000","last_clean":"2024-01-22T05:18:40.098937+0000","last_became_active":"2024-01-22T05:18:39.656203+0000","last_became_peered":"2024-01-22T05:18:39.656203+0000","last_unstale":"2024-01-22T05:18:40.098937+0000","last_undegraded":"2024-01-22T05:18:40.098937+0000","last_fullsized":"2024-01-22T05:18:40.098937+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.102269+0000","last_change":"2024-01-22T05:18:40.096149+0000","last_active":"2024-01-22T05:18:40.102269+0000","last_peered":"2024-01-22T05:18:40.102269+0000","last_clean":"2024-01-22T05:18:40.102269+0000","last_became_active":"2024-01-22T05:18:40.095863+0000","last_became_peered":"2024-01-22T05:18:40.095863+0000","last_unstale":"2024-01-22T05:18:40.102269+0000","last_undegraded":"2024-01-22T05:18:40.102269+0000","last_fullsized":"2024-01-22T05:18:40.102269+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.097992+0000","last_change":"2024-01-22T05:18:39.655539+0000","last_active":"2024-01-22T05:18:40.097992+0000","last_peered":"2024-01-22T05:18:40.097992+0000","last_clean":"2024-01-22T05:18:40.097992+0000","last_became_active":"2024-01-22T05:18:39.655204+0000","last_became_peered":"2024-01-22T05:18:39.655204+0000","last_unstale":"2024-01-22T05:18:40.097992+0000","last_undegraded":"2024-01-22T05:18:40.097992+0000","last_fullsized":"2024-01-22T05:18:40.097992+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115485+0000","last_change":"2024-01-22T05:18:40.108827+0000","last_active":"2024-01-22T05:18:40.115485+0000","last_peered":"2024-01-22T05:18:40.115485+0000","last_clean":"2024-01-22T05:18:40.115485+0000","last_became_active":"2024-01-22T05:18:40.108551+0000","last_became_peered":"2024-01-22T05:18:40.108551+0000","last_unstale":"2024-01-22T05:18:40.115485+0000","last_undegraded":"2024-01-22T05:18:40.115485+0000","last_fullsized":"2024-01-22T05:18:40.115485+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.085486+0000","last_change":"2024-01-22T05:18:39.653334+0000","last_active":"2024-01-22T05:18:40.085486+0000","last_peered":"2024-01-22T05:18:40.085486+0000","last_clean":"2024-01-22T05:18:40.085486+0000","last_became_active":"2024-01-22T05:18:39.651733+0000","last_became_peered":"2024-01-22T05:18:39.651733+0000","last_unstale":"2024-01-22T05:18:40.085486+0000","last_undegraded":"2024-01-22T05:18:40.085486+0000","last_fullsized":"2024-01-22T05:18:40.085486+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115359+0000","last_change":"2024-01-22T05:18:40.112715+0000","last_active":"2024-01-22T05:18:40.115359+0000","last_peered":"2024-01-22T05:18:40.115359+0000","last_clean":"2024-01-22T05:18:40.115359+0000","last_became_active":"2024-01-22T05:18:40.112319+0000","last_became_peered":"2024-01-22T05:18:40.112319+0000","last_unstale":"2024-01-22T05:18:40.115359+0000","last_undegraded":"2024-01-22T05:18:40.115359+0000","last_fullsized":"2024-01-22T05:18:40.115359+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.091584+0000","last_change":"2024-01-22T05:18:39.635661+0000","last_active":"2024-01-22T05:18:40.091584+0000","last_peered":"2024-01-22T05:18:40.091584+0000","last_clean":"2024-01-22T05:18:40.091584+0000","last_became_active":"2024-01-22T05:18:39.635383+0000","last_became_peered":"2024-01-22T05:18:39.635383+0000","last_unstale":"2024-01-22T05:18:40.091584+0000","last_undegraded":"2024-01-22T05:18:40.091584+0000","last_fullsized":"2024-01-22T05:18:40.091584+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116589+0000","last_change":"2024-01-22T05:18:40.113796+0000","last_active":"2024-01-22T05:18:40.116589+0000","last_peered":"2024-01-22T05:18:40.116589+0000","last_clean":"2024-01-22T05:18:40.116589+0000","last_became_active":"2024-01-22T05:18:40.113434+0000","last_became_peered":"2024-01-22T05:18:40.113434+0000","last_unstale":"2024-01-22T05:18:40.116589+0000","last_undegraded":"2024-01-22T05:18:40.116589+0000","last_fullsized":"2024-01-22T05:18:40.116589+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.094215+0000","last_change":"2024-01-22T05:18:39.623208+0000","last_active":"2024-01-22T05:18:40.094215+0000","last_peered":"2024-01-22T05:18:40.094215+0000","last_clean":"2024-01-22T05:18:40.094215+0000","last_became_active":"2024-01-22T05:18:39.622890+0000","last_became_peered":"2024-01-22T05:18:39.622890+0000","last_unstale":"2024-01-22T05:18:40.094215+0000","last_undegraded":"2024-01-22T05:18:40.094215+0000","last_fullsized":"2024-01-22T05:18:40.094215+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.119465+0000","last_change":"2024-01-22T05:18:40.112108+0000","last_active":"2024-01-22T05:18:40.119465+0000","last_peered":"2024-01-22T05:18:40.119465+0000","last_clean":"2024-01-22T05:18:40.119465+0000","last_became_active":"2024-01-22T05:18:40.111487+0000","last_became_peered":"2024-01-22T05:18:40.111487+0000","last_unstale":"2024-01-22T05:18:40.119465+0000","last_undegraded":"2024-01-22T05:18:40.119465+0000","last_fullsized":"2024-01-22T05:18:40.119465+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.104380+0000","last_change":"2024-01-22T05:18:39.635821+0000","last_active":"2024-01-22T05:18:40.104380+0000","last_peered":"2024-01-22T05:18:40.104380+0000","last_clean":"2024-01-22T05:18:40.104380+0000","last_became_active":"2024-01-22T05:18:39.635470+0000","last_became_peered":"2024-01-22T05:18:39.635470+0000","last_unstale":"2024-01-22T05:18:40.104380+0000","last_undegraded":"2024-01-22T05:18:40.104380+0000","last_fullsized":"2024-01-22T05:18:40.104380+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.125800+0000","last_change":"2024-01-22T05:18:40.123491+0000","last_active":"2024-01-22T05:18:40.125800+0000","last_peered":"2024-01-22T05:18:40.125800+0000","last_clean":"2024-01-22T05:18:40.125800+0000","last_became_active":"2024-01-22T05:18:40.123181+0000","last_became_peered":"2024-01-22T05:18:40.123181+0000","last_unstale":"2024-01-22T05:18:40.125800+0000","last_undegraded":"2024-01-22T05:18:40.125800+0000","last_fullsized":"2024-01-22T05:18:40.125800+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.091868+0000","last_change":"2024-01-22T05:18:39.643208+0000","last_active":"2024-01-22T05:18:40.091868+0000","last_peered":"2024-01-22T05:18:40.091868+0000","last_clean":"2024-01-22T05:18:40.091868+0000","last_became_active":"2024-01-22T05:18:39.635672+0000","last_became_peered":"2024-01-22T05:18:39.635672+0000","last_unstale":"2024-01-22T05:18:40.091868+0000","last_undegraded":"2024-01-22T05:18:40.091868+0000","last_fullsized":"2024-01-22T05:18:40.091868+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.102761+0000","last_change":"2024-01-22T05:18:40.100554+0000","last_active":"2024-01-22T05:18:40.102761+0000","last_peered":"2024-01-22T05:18:40.102761+0000","last_clean":"2024-01-22T05:18:40.102761+0000","last_became_active":"2024-01-22T05:18:40.100277+0000","last_became_peered":"2024-01-22T05:18:40.100277+0000","last_unstale":"2024-01-22T05:18:40.102761+0000","last_undegraded":"2024-01-22T05:18:40.102761+0000","last_fullsized":"2024-01-22T05:18:40.102761+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"171'2","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.119207+0000","last_change":"2024-01-22T05:18:39.646024+0000","last_active":"2024-01-22T05:18:40.119207+0000","last_peered":"2024-01-22T05:18:40.119207+0000","last_clean":"2024-01-22T05:18:40.119207+0000","last_became_active":"2024-01-22T05:18:39.645738+0000","last_became_peered":"2024-01-22T05:18:39.645738+0000","last_unstale":"2024-01-22T05:18:40.119207+0000","last_undegraded":"2024-01-22T05:18:40.119207+0000","last_fullsized":"2024-01-22T05:18:40.119207+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":140,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.100025+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:18:40.100025+0000","last_peered":"2024-01-22T05:18:40.100025+0000","last_clean":"2024-01-22T05:18:40.100025+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:18:40.100025+0000","last_undegraded":"2024-01-22T05:18:40.100025+0000","last_fullsized":"2024-01-22T05:18:40.100025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.104836+0000","last_change":"2024-01-22T05:18:40.098979+0000","last_active":"2024-01-22T05:18:40.104836+0000","last_peered":"2024-01-22T05:18:40.104836+0000","last_clean":"2024-01-22T05:18:40.104836+0000","last_became_active":"2024-01-22T05:18:40.098688+0000","last_became_peered":"2024-01-22T05:18:40.098688+0000","last_unstale":"2024-01-22T05:18:40.104836+0000","last_undegraded":"2024-01-22T05:18:40.104836+0000","last_fullsized":"2024-01-22T05:18:40.104836+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.103598+0000","last_change":"2024-01-22T05:18:39.648849+0000","last_active":"2024-01-22T05:18:40.103598+0000","last_peered":"2024-01-22T05:18:40.103598+0000","last_clean":"2024-01-22T05:18:40.103598+0000","last_became_active":"2024-01-22T05:18:39.648547+0000","last_became_peered":"2024-01-22T05:18:39.648547+0000","last_unstale":"2024-01-22T05:18:40.103598+0000","last_undegraded":"2024-01-22T05:18:40.103598+0000","last_fullsized":"2024-01-22T05:18:40.103598+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":144,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.094719+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:18:40.094719+0000","last_peered":"2024-01-22T05:18:40.094719+0000","last_clean":"2024-01-22T05:18:40.094719+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:18:40.094719+0000","last_undegraded":"2024-01-22T05:18:40.094719+0000","last_fullsized":"2024-01-22T05:18:40.094719+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116282+0000","last_change":"2024-01-22T05:18:40.108699+0000","last_active":"2024-01-22T05:18:40.116282+0000","last_peered":"2024-01-22T05:18:40.116282+0000","last_clean":"2024-01-22T05:18:40.116282+0000","last_became_active":"2024-01-22T05:18:40.108431+0000","last_became_peered":"2024-01-22T05:18:40.108431+0000","last_unstale":"2024-01-22T05:18:40.116282+0000","last_undegraded":"2024-01-22T05:18:40.116282+0000","last_fullsized":"2024-01-22T05:18:40.116282+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.117398+0000","last_change":"2024-01-22T05:18:39.648930+0000","last_active":"2024-01-22T05:18:40.117398+0000","last_peered":"2024-01-22T05:18:40.117398+0000","last_clean":"2024-01-22T05:18:40.117398+0000","last_became_active":"2024-01-22T05:18:39.648631+0000","last_became_peered":"2024-01-22T05:18:39.648631+0000","last_unstale":"2024-01-22T05:18:40.117398+0000","last_undegraded":"2024-01-22T05:18:40.117398+0000","last_fullsized":"2024-01-22T05:18:40.117398+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":135,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.102834+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:18:40.102834+0000","last_peered":"2024-01-22T05:18:40.102834+0000","last_clean":"2024-01-22T05:18:40.102834+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:18:40.102834+0000","last_undegraded":"2024-01-22T05:18:40.102834+0000","last_fullsized":"2024-01-22T05:18:40.102834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.121635+0000","last_change":"2024-01-22T05:18:40.113859+0000","last_active":"2024-01-22T05:18:40.121635+0000","last_peered":"2024-01-22T05:18:40.121635+0000","last_clean":"2024-01-22T05:18:40.121635+0000","last_became_active":"2024-01-22T05:18:40.113531+0000","last_became_peered":"2024-01-22T05:18:40.113531+0000","last_unstale":"2024-01-22T05:18:40.121635+0000","last_undegraded":"2024-01-22T05:18:40.121635+0000","last_fullsized":"2024-01-22T05:18:40.121635+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.107152+0000","last_change":"2024-01-22T05:18:39.644256+0000","last_active":"2024-01-22T05:18:40.107152+0000","last_peered":"2024-01-22T05:18:40.107152+0000","last_clean":"2024-01-22T05:18:40.107152+0000","last_became_active":"2024-01-22T05:18:39.643899+0000","last_became_peered":"2024-01-22T05:18:39.643899+0000","last_unstale":"2024-01-22T05:18:40.107152+0000","last_undegraded":"2024-01-22T05:18:40.107152+0000","last_fullsized":"2024-01-22T05:18:40.107152+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.093102+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:18:40.093102+0000","last_peered":"2024-01-22T05:18:40.093102+0000","last_clean":"2024-01-22T05:18:40.093102+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:18:40.093102+0000","last_undegraded":"2024-01-22T05:18:40.093102+0000","last_fullsized":"2024-01-22T05:18:40.093102+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.109823+0000","last_change":"2024-01-22T05:18:40.107389+0000","last_active":"2024-01-22T05:18:40.109823+0000","last_peered":"2024-01-22T05:18:40.109823+0000","last_clean":"2024-01-22T05:18:40.109823+0000","last_became_active":"2024-01-22T05:18:40.106966+0000","last_became_peered":"2024-01-22T05:18:40.106966+0000","last_unstale":"2024-01-22T05:18:40.109823+0000","last_undegraded":"2024-01-22T05:18:40.109823+0000","last_fullsized":"2024-01-22T05:18:40.109823+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.095571+0000","last_change":"2024-01-22T05:18:39.644098+0000","last_active":"2024-01-22T05:18:40.095571+0000","last_peered":"2024-01-22T05:18:40.095571+0000","last_clean":"2024-01-22T05:18:40.095571+0000","last_became_active":"2024-01-22T05:18:39.643472+0000","last_became_peered":"2024-01-22T05:18:39.643472+0000","last_unstale":"2024-01-22T05:18:40.095571+0000","last_undegraded":"2024-01-22T05:18:40.095571+0000","last_fullsized":"2024-01-22T05:18:40.095571+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":164,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.094294+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:18:40.094294+0000","last_peered":"2024-01-22T05:18:40.094294+0000","last_clean":"2024-01-22T05:18:40.094294+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:18:40.094294+0000","last_undegraded":"2024-01-22T05:18:40.094294+0000","last_fullsized":"2024-01-22T05:18:40.094294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115840+0000","last_change":"2024-01-22T05:18:40.110862+0000","last_active":"2024-01-22T05:18:40.115840+0000","last_peered":"2024-01-22T05:18:40.115840+0000","last_clean":"2024-01-22T05:18:40.115840+0000","last_became_active":"2024-01-22T05:18:40.110598+0000","last_became_peered":"2024-01-22T05:18:40.110598+0000","last_unstale":"2024-01-22T05:18:40.115840+0000","last_undegraded":"2024-01-22T05:18:40.115840+0000","last_fullsized":"2024-01-22T05:18:40.115840+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.100355+0000","last_change":"2024-01-22T05:18:39.645719+0000","last_active":"2024-01-22T05:18:40.100355+0000","last_peered":"2024-01-22T05:18:40.100355+0000","last_clean":"2024-01-22T05:18:40.100355+0000","last_became_active":"2024-01-22T05:18:39.645401+0000","last_became_peered":"2024-01-22T05:18:39.645401+0000","last_unstale":"2024-01-22T05:18:40.100355+0000","last_undegraded":"2024-01-22T05:18:40.100355+0000","last_fullsized":"2024-01-22T05:18:40.100355+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":143,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.098480+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:18:40.098480+0000","last_peered":"2024-01-22T05:18:40.098480+0000","last_clean":"2024-01-22T05:18:40.098480+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:18:40.098480+0000","last_undegraded":"2024-01-22T05:18:40.098480+0000","last_fullsized":"2024-01-22T05:18:40.098480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.114928+0000","last_change":"2024-01-22T05:18:40.108121+0000","last_active":"2024-01-22T05:18:40.114928+0000","last_peered":"2024-01-22T05:18:40.114928+0000","last_clean":"2024-01-22T05:18:40.114928+0000","last_became_active":"2024-01-22T05:18:40.107861+0000","last_became_peered":"2024-01-22T05:18:40.107861+0000","last_unstale":"2024-01-22T05:18:40.114928+0000","last_undegraded":"2024-01-22T05:18:40.114928+0000","last_fullsized":"2024-01-22T05:18:40.114928+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.083689+0000","last_change":"2024-01-22T05:18:39.654778+0000","last_active":"2024-01-22T05:18:40.083689+0000","last_peered":"2024-01-22T05:18:40.083689+0000","last_clean":"2024-01-22T05:18:40.083689+0000","last_became_active":"2024-01-22T05:18:39.654503+0000","last_became_peered":"2024-01-22T05:18:39.654503+0000","last_unstale":"2024-01-22T05:18:40.083689+0000","last_undegraded":"2024-01-22T05:18:40.083689+0000","last_fullsized":"2024-01-22T05:18:40.083689+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.097129+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:18:40.097129+0000","last_peered":"2024-01-22T05:18:40.097129+0000","last_clean":"2024-01-22T05:18:40.097129+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:18:40.097129+0000","last_undegraded":"2024-01-22T05:18:40.097129+0000","last_fullsized":"2024-01-22T05:18:40.097129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.125038+0000","last_change":"2024-01-22T05:18:40.122120+0000","last_active":"2024-01-22T05:18:40.125038+0000","last_peered":"2024-01-22T05:18:40.125038+0000","last_clean":"2024-01-22T05:18:40.125038+0000","last_became_active":"2024-01-22T05:18:40.121866+0000","last_became_peered":"2024-01-22T05:18:40.121866+0000","last_unstale":"2024-01-22T05:18:40.125038+0000","last_undegraded":"2024-01-22T05:18:40.125038+0000","last_fullsized":"2024-01-22T05:18:40.125038+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.103080+0000","last_change":"2024-01-22T05:18:39.643564+0000","last_active":"2024-01-22T05:18:40.103080+0000","last_peered":"2024-01-22T05:18:40.103080+0000","last_clean":"2024-01-22T05:18:40.103080+0000","last_became_active":"2024-01-22T05:18:39.643273+0000","last_became_peered":"2024-01-22T05:18:39.643273+0000","last_unstale":"2024-01-22T05:18:40.103080+0000","last_undegraded":"2024-01-22T05:18:40.103080+0000","last_fullsized":"2024-01-22T05:18:40.103080+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":164,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.091568+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:18:40.091568+0000","last_peered":"2024-01-22T05:18:40.091568+0000","last_clean":"2024-01-22T05:18:40.091568+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:18:40.091568+0000","last_undegraded":"2024-01-22T05:18:40.091568+0000","last_fullsized":"2024-01-22T05:18:40.091568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.097245+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:18:40.097245+0000","last_peered":"2024-01-22T05:18:40.097245+0000","last_clean":"2024-01-22T05:18:40.097245+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:18:40.097245+0000","last_undegraded":"2024-01-22T05:18:40.097245+0000","last_fullsized":"2024-01-22T05:18:40.097245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575021,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307520,"kb_used_data":2104,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064320,"statfs":{"total":96636764160,"available":96321863680,"internally_reserved":0,"allocated":2154496,"data_stored":1071446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:17:57 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.21,"15min":1.0669999999999999},"min":{"1min":0.73799999999999999,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.9590000000000001,"5min":14.779999999999999,"15min":14.779999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":2.0049999999999999,"15min":1.369},"min":{"1min":0.76100000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":3.7789999999999999,"5min":76.662000000000006,"15min":76.662000000000006},"last":1.0620000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:17:57 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.1559999999999999,"15min":1.0469999999999999},"min":{"1min":0.70999999999999996,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.657,"5min":4.9269999999999996,"15min":4.9269999999999996},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.3,"15min":1.2050000000000001},"min":{"1min":0.81399999999999995,"5min":0.71599999999999997,"15min":0.58999999999999997},"max":{"1min":3.6040000000000001,"5min":12.691000000000001,"15min":12.691000000000001},"last":0.96699999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:17:57 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.157,"15min":1.123},"min":{"1min":0.88300000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.5150000000000001},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.337,"15min":1.2150000000000001},"min":{"1min":0.95399999999999996,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.3199999999999998,"5min":15.036,"15min":15.036},"last":1.3169999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:17:57 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.919,"15min":1.448},"min":{"1min":0.95399999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7030000000000001,"5min":64.983999999999995,"15min":64.983999999999995},"last":1.165},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.413,"15min":1.292},"min":{"1min":1.1000000000000001,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":2.2770000000000001,"5min":15.073,"15min":15.073},"last":1.383}]},{"osd":4,"last update":"Mon Jan 22 05:17:57 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.4179999999999999,"15min":1.1819999999999999},"min":{"1min":0.876,"5min":0.53000000000000003,"15min":0.32900000000000001},"max":{"1min":3.1840000000000002,"5min":22.239000000000001,"15min":22.239000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.282,"5min":1.502,"15min":1.2589999999999999},"min":{"1min":0.94399999999999995,"5min":0.68799999999999994,"15min":0.52200000000000002},"max":{"1min":1.7949999999999999,"5min":27.872,"15min":27.872},"last":1.2709999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:17:57 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.9870000000000001,"15min":1.448},"min":{"1min":0.85599999999999998,"5min":0.67400000000000004,"15min":0.40400000000000003},"max":{"1min":2.3530000000000002,"5min":65.652000000000001,"15min":65.652000000000001},"last":1.226},{"interface":"front","average":{"1min":1.377,"5min":1.3169999999999999,"15min":1.274},"min":{"1min":1.0700000000000001,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":1.7629999999999999,"5min":2.1629999999999998,"15min":3.625},"last":1.4239999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:17:57 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3460000000000001,"15min":1.256},"min":{"1min":0.94099999999999995,"5min":0.80700000000000005,"15min":0.53400000000000003},"max":{"1min":3.3439999999999999,"5min":6.9939999999999998,"15min":6.9939999999999998},"last":1.194},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.522,"15min":1.403},"min":{"1min":1.1080000000000001,"5min":0.82999999999999996,"15min":0.56100000000000005},"max":{"1min":2.1219999999999999,"5min":12.965,"15min":12.965},"last":1.486}]}]},{"osd":6,"up_from":13,"seq":55834575021,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307528,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064312,"statfs":{"total":96636764160,"available":96321855488,"internally_reserved":0,"allocated":2162688,"data_stored":1078131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0409999999999999,"15min":1.286},"min":{"1min":0.89700000000000002,"5min":0.66600000000000004,"15min":0.35999999999999999},"max":{"1min":1.466,"5min":1.5740000000000001,"15min":77.745000000000005},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.081,"15min":1.075},"min":{"1min":0.79500000000000004,"5min":0.57499999999999996,"15min":0.44},"max":{"1min":1.74,"5min":5.0359999999999996,"15min":13.555999999999999},"last":1.1040000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:18:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1020000000000001,"15min":1.1180000000000001},"min":{"1min":0.73299999999999998,"5min":0.56999999999999995,"15min":0.40000000000000002},"max":{"1min":1.554,"5min":5.9210000000000003,"15min":15.499000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1060000000000001,"15min":1.1579999999999999},"min":{"1min":0.78300000000000003,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.46,"5min":1.702,"15min":7.7629999999999999},"last":1.054}]},{"osd":2,"last update":"Mon Jan 22 05:18:01 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1930000000000001,"15min":1.1619999999999999},"min":{"1min":0.95399999999999996,"5min":0.82699999999999996,"15min":0.57399999999999995},"max":{"1min":1.4590000000000001,"5min":1.667,"15min":3.0960000000000001},"last":1.262},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2070000000000001,"15min":1.1419999999999999},"min":{"1min":0.90600000000000003,"5min":0.68999999999999995,"15min":0.38200000000000001},"max":{"1min":1.522,"5min":4.9660000000000002,"15min":4.9660000000000002},"last":0.96799999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:18:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2110000000000001,"15min":1.48},"min":{"1min":0.90200000000000002,"5min":0.66700000000000004,"15min":0.59299999999999997},"max":{"1min":1.444,"5min":5.0750000000000002,"15min":102.08199999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.1659999999999999,"15min":1.2150000000000001},"min":{"1min":0.82499999999999996,"5min":0.66300000000000003,"15min":0.374},"max":{"1min":1.4770000000000001,"5min":2.9620000000000002,"15min":15.468},"last":1.3879999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:18:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.224,"15min":1.143},"min":{"1min":0.72599999999999998,"5min":0.71699999999999997,"15min":0.495},"max":{"1min":1.5529999999999999,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.2549999999999999,"15min":1.1579999999999999},"min":{"1min":0.88900000000000001,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.865,"5min":5.1200000000000001,"15min":5.1200000000000001},"last":1.234}]},{"osd":5,"last update":"Mon Jan 22 05:18:01 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.155,"15min":1.2410000000000001},"min":{"1min":0.873,"5min":0.58699999999999997,"15min":0.48099999999999998},"max":{"1min":1.4179999999999999,"5min":2.9100000000000001,"15min":30.533000000000001},"last":1.198},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.282,"15min":1.2729999999999999},"min":{"1min":0.90800000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.718,"5min":1.804,"15min":3.875},"last":1.3360000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:18:01 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.4570000000000001,"15min":1.429},"min":{"1min":0.94499999999999995,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":2.0009999999999999,"5min":8.4190000000000005,"15min":23.547999999999998},"last":1.474},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.4059999999999999,"15min":1.5569999999999999},"min":{"1min":0.86899999999999999,"5min":0.77700000000000002,"15min":0.495},"max":{"1min":1.6559999999999999,"5min":7.46,"15min":63.737000000000002},"last":1.55}]}]},{"osd":5,"up_from":13,"seq":55834575021,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307528,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064312,"statfs":{"total":96636764160,"available":96321855488,"internally_reserved":0,"allocated":2162688,"data_stored":1077647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.018,"15min":1.01},"min":{"1min":0.66500000000000004,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.5369999999999999,"5min":1.651,"15min":2.0609999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0489999999999999,"15min":1.048},"min":{"1min":0.78100000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4350000000000001,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.84999999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:18:05 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.218,"15min":1.1879999999999999},"min":{"1min":0.70299999999999996,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.744,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.1910000000000001,"15min":1.2070000000000001},"min":{"1min":0.78800000000000003,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.694,"5min":1.9930000000000001,"15min":2.0209999999999999},"last":1.5329999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1339999999999999,"15min":1.133},"min":{"1min":0.90100000000000002,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.4430000000000001,"5min":1.9219999999999999,"15min":1.925},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.1419999999999999,"15min":1.1200000000000001},"min":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.59899999999999998},"max":{"1min":1.456,"5min":1.982,"15min":1.982},"last":1.0149999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:18:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.1919999999999999,"15min":1.1599999999999999},"min":{"1min":0.95799999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4510000000000001,"5min":3.202,"15min":3.202},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.22,"5min":1.1830000000000001,"15min":1.2150000000000001},"min":{"1min":0.77600000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":4.8819999999999997},"last":1.474}]},{"osd":4,"last update":"Mon Jan 22 05:18:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1120000000000001,"15min":1.107},"min":{"1min":0.82399999999999995,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.579,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1890000000000001},"min":{"1min":0.77600000000000002,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.589,"5min":2.081,"15min":2.081},"last":1.214}]},{"osd":6,"last update":"Mon Jan 22 05:18:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.214,"15min":1.228},"min":{"1min":0.88600000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.776,"5min":2.0099999999999998,"15min":2.2010000000000001},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2470000000000001,"15min":1.2490000000000001},"min":{"1min":0.94899999999999995,"5min":0.69599999999999995,"15min":0.55900000000000005},"max":{"1min":1.6719999999999999,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.2709999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:18:05 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3069999999999999,"15min":1.3140000000000001},"min":{"1min":0.95299999999999996,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.8069999999999999,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.46},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.335,"15min":1.3460000000000001},"min":{"1min":1.1140000000000001,"5min":0.72699999999999998,"15min":0.60799999999999998},"max":{"1min":1.8859999999999999,"5min":2.04,"15min":3.1840000000000002},"last":1.583}]}]},{"osd":4,"up_from":13,"seq":55834575021,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299348,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072492,"statfs":{"total":96636764160,"available":96330231808,"internally_reserved":0,"allocated":2174976,"data_stored":1079667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:17:50 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0980000000000001,"15min":1.1000000000000001},"min":{"1min":0.71099999999999997,"5min":0.63700000000000001,"15min":0.47799999999999998},"max":{"1min":1.569,"5min":1.696,"15min":2.0150000000000001},"last":1.206},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1839999999999999,"15min":1.1379999999999999},"min":{"1min":0.75700000000000001,"5min":0.68300000000000005,"15min":0.48899999999999999},"max":{"1min":1.5429999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.94599999999999995}]},{"osd":1,"last update":"Mon Jan 22 05:17:50 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0669999999999999,"15min":1.071},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.53100000000000003},"max":{"1min":1.5249999999999999,"5min":1.6759999999999999,"15min":1.7609999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.0449999999999999,"15min":1.081},"min":{"1min":0.69199999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.1440000000000001,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":1.1120000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:17:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0609999999999999,"15min":1.0740000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.49199999999999999},"max":{"1min":1.3089999999999999,"5min":1.516,"15min":5.3390000000000004},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.151,"5min":1.1459999999999999,"15min":1.1679999999999999},"min":{"1min":0.71099999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5009999999999999,"5min":1.6140000000000001,"15min":2.3479999999999999},"last":0.96699999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:17:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.143,"15min":1.1379999999999999},"min":{"1min":0.69799999999999995,"5min":0.65700000000000003,"15min":0.496},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.149,"15min":1.147},"min":{"1min":0.73899999999999999,"5min":0.66200000000000003,"15min":0.53100000000000003},"max":{"1min":1.407,"5min":2.2959999999999998,"15min":5.3029999999999999},"last":1.141}]},{"osd":5,"last update":"Mon Jan 22 05:17:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1140000000000001,"15min":1.1279999999999999},"min":{"1min":0.63500000000000001,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.581,"5min":1.6899999999999999,"15min":2.0790000000000002},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.1819999999999999,"15min":1.129},"min":{"1min":0.70099999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.518,"5min":1.8240000000000001,"15min":2.0030000000000001},"last":1.0229999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:17:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1459999999999999,"15min":1.149},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.44500000000000001},"max":{"1min":1.304,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.272,"15min":1.2829999999999999},"min":{"1min":0.91100000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.617,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":1.3899999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:17:50 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.343,"15min":1.3120000000000001},"min":{"1min":0.74099999999999999,"5min":0.62,"15min":0.59399999999999997},"max":{"1min":1.5920000000000001,"5min":1.9119999999999999,"15min":2.2839999999999998},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.3089999999999999,"15min":1.3200000000000001},"min":{"1min":0.89300000000000002,"5min":0.88800000000000001,"15min":0.56899999999999995},"max":{"1min":1.516,"5min":1.843,"15min":5.2629999999999999},"last":1.2869999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575021,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303436,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068404,"statfs":{"total":96636764160,"available":96326045696,"internally_reserved":0,"allocated":2166784,"data_stored":1077701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.77500000000000002,"15min":0.86099999999999999},"min":{"1min":0.58899999999999997,"5min":0.41099999999999998,"15min":0.34200000000000003},"max":{"1min":1.3540000000000001,"5min":1.512,"15min":14.859},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.877,"15min":0.89700000000000002},"min":{"1min":0.51600000000000001,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":1.6879999999999999,"5min":1.804,"15min":5.0919999999999996},"last":0.86899999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.873,"15min":0.89600000000000002},"min":{"1min":0.65900000000000003,"5min":0.42399999999999999,"15min":0.39300000000000002},"max":{"1min":1.466,"5min":1.466,"15min":6.5570000000000004},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.94299999999999995,"15min":0.96999999999999997},"min":{"1min":0.79300000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.361,"5min":1.7669999999999999,"15min":5.7519999999999998},"last":1.024}]},{"osd":2,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0720000000000001,"15min":1.111},"min":{"1min":0.65800000000000003,"5min":0.48599999999999999,"15min":0.40600000000000003},"max":{"1min":1.5940000000000001,"5min":1.8680000000000001,"15min":2.391},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.1200000000000001,"15min":1.1779999999999999},"min":{"1min":0.72099999999999997,"5min":0.59199999999999997,"15min":0.44800000000000001},"max":{"1min":1.625,"5min":1.6259999999999999,"15min":4.1429999999999998},"last":1.46}]},{"osd":4,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3029999999999999,"15min":1.325},"min":{"1min":1.1559999999999999,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.6619999999999999,"5min":2.423,"15min":10.858000000000001},"last":1.234},{"interface":"front","average":{"1min":1.399,"5min":1.2749999999999999,"15min":1.337},"min":{"1min":1.1259999999999999,"5min":0.75600000000000001,"15min":0.63600000000000001},"max":{"1min":1.728,"5min":2.3359999999999999,"15min":10.846},"last":1.546}]},{"osd":5,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.24,"15min":1.2849999999999999},"min":{"1min":1.069,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.5249999999999999,"5min":1.9910000000000001,"15min":7.3639999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.286,"15min":1.3759999999999999},"min":{"1min":0.88200000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.649,"5min":6.3220000000000001,"15min":14.523999999999999},"last":1.6739999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.3580000000000001,"15min":1.363},"min":{"1min":1.022,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.698,"5min":2.1819999999999999,"15min":4.9809999999999999},"last":1.3},{"interface":"front","average":{"1min":1.425,"5min":1.367,"15min":1.3879999999999999},"min":{"1min":1.1399999999999999,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.667,"5min":1.883,"15min":5.4210000000000003},"last":1.8340000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3,"15min":1.359},"min":{"1min":1.028,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.599,"5min":1.986,"15min":5.7160000000000002},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3560000000000001,"15min":1.4079999999999999},"min":{"1min":1.133,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9470000000000001,"5min":2.5449999999999999,"15min":6.4279999999999999},"last":1.488}]}]},{"osd":2,"up_from":13,"seq":55834575021,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315724,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":94056116,"statfs":{"total":96636764160,"available":96313462784,"internally_reserved":0,"allocated":2166784,"data_stored":1077689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.76800000000000002,"15min":0.76400000000000001},"min":{"1min":0.621,"5min":0.378,"15min":0.378},"max":{"1min":1.373,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.84499999999999997,"15min":0.85099999999999998},"min":{"1min":0.64000000000000001,"5min":0.44600000000000001,"15min":0.373},"max":{"1min":1.1819999999999999,"5min":1.556,"15min":1.7350000000000001},"last":1.028}]},{"osd":1,"last update":"Mon Jan 22 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.89400000000000002,"15min":0.85899999999999999},"min":{"1min":0.60499999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.573,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.05,"5min":0.97199999999999998,"15min":0.94799999999999995},"min":{"1min":0.73899999999999999,"5min":0.43099999999999999,"15min":0.41599999999999998},"max":{"1min":1.496,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.671}]},{"osd":3,"last update":"Mon Jan 22 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.1379999999999999,"15min":1.127},"min":{"1min":0.69499999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6459999999999999,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2070000000000001,"15min":1.204},"min":{"1min":0.83499999999999996,"5min":0.53900000000000003,"15min":0.51100000000000001},"max":{"1min":1.554,"5min":3.133,"15min":3.133},"last":1.3460000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.2829999999999999,"15min":1.2709999999999999},"min":{"1min":0.95099999999999996,"5min":0.88500000000000001,"15min":0.59099999999999997},"max":{"1min":1.7270000000000001,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.206,"15min":1.198},"min":{"1min":0.84099999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.732,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.5800000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.232,"15min":1.2170000000000001},"min":{"1min":0.94399999999999995,"5min":0.70799999999999996,"15min":0.63800000000000001},"max":{"1min":1.6379999999999999,"5min":2.379,"15min":2.379},"last":1.8120000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.302,"15min":1.284},"min":{"1min":1.125,"5min":0.76100000000000001,"15min":0.67000000000000004},"max":{"1min":1.7769999999999999,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.774}]},{"osd":6,"last update":"Mon Jan 22 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.2430000000000001,"15min":1.248},"min":{"1min":0.88,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.6870000000000001,"5min":1.7749999999999999,"15min":2.1920000000000002},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.3160000000000001,"15min":1.304},"min":{"1min":0.91100000000000003,"5min":0.629,"15min":0.629},"max":{"1min":1.7,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.7110000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3460000000000001,"15min":1.3440000000000001},"min":{"1min":0.92300000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4059999999999999,"15min":1.4099999999999999},"min":{"1min":1.0209999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.762,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":2.0019999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575022,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311632,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060208,"statfs":{"total":96636764160,"available":96317652992,"internally_reserved":0,"allocated":2170880,"data_stored":1078291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:17:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.85199999999999998,"15min":0.86899999999999999},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":3.4119999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.96999999999999997,"15min":0.99399999999999999},"min":{"1min":0.64200000000000002,"5min":0.48599999999999999,"15min":0.41099999999999998},"max":{"1min":1.6160000000000001,"5min":1.6850000000000001,"15min":2.101},"last":1.119}]},{"osd":2,"last update":"Mon Jan 22 05:17:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.98899999999999999,"15min":0.99199999999999999},"min":{"1min":0.58299999999999996,"5min":0.49399999999999999,"15min":0.45500000000000002},"max":{"1min":1.3799999999999999,"5min":1.512,"15min":2.169},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0780000000000001,"15min":1.052},"min":{"1min":0.73899999999999999,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.46,"5min":2.024,"15min":2.024},"last":0.84199999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:17:51 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.034,"15min":1.034},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.38900000000000001},"max":{"1min":1.972,"5min":1.972,"15min":4.665},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.90700000000000003,"15min":0.93799999999999994},"min":{"1min":0.55200000000000005,"5min":0.45000000000000001,"15min":0.41899999999999998},"max":{"1min":1.659,"5min":1.659,"15min":5.5830000000000002},"last":0.67700000000000005}]},{"osd":4,"last update":"Mon Jan 22 05:17:51 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.204,"15min":1.25},"min":{"1min":0.873,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.724,"5min":1.958,"15min":15.76},"last":1.143},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2669999999999999,"15min":1.3260000000000001},"min":{"1min":0.91000000000000003,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.673,"5min":1.9630000000000001,"15min":16.975000000000001},"last":1.0529999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:17:51 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.2609999999999999,"15min":1.23},"min":{"1min":0.72599999999999998,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.536,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.88500000000000001,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8340000000000001,"5min":2.2730000000000001,"15min":2.52},"last":1.0249999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:17:51 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2430000000000001,"15min":1.26},"min":{"1min":0.77400000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.496,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.321,"15min":1.3320000000000001},"min":{"1min":0.82099999999999995,"5min":0.71899999999999997,"15min":0.68799999999999994},"max":{"1min":2.008,"5min":2.222,"15min":2.5569999999999999},"last":1.073}]},{"osd":7,"last update":"Mon Jan 22 05:17:51 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.321,"15min":1.353},"min":{"1min":1.0600000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.8200000000000001,"5min":1.8999999999999999,"15min":4.4329999999999998},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.248,"5min":1.333,"15min":1.3520000000000001},"min":{"1min":0.81100000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.6739999999999999,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":1.1779999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575021,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311624,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060216,"statfs":{"total":96636764160,"available":96317661184,"internally_reserved":0,"allocated":2162688,"data_stored":1077599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.84699999999999998,"15min":0.89900000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.28699999999999998},"max":{"1min":1.361,"5min":1.452,"15min":15.273},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88600000000000001,"15min":0.92200000000000004},"min":{"1min":0.60499999999999998,"5min":0.5,"15min":0.34499999999999997},"max":{"1min":1.1279999999999999,"5min":1.698,"15min":4.4009999999999998},"last":0.68700000000000006}]},{"osd":2,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.002,"15min":1.0569999999999999},"min":{"1min":0.60299999999999998,"5min":0.53200000000000003,"15min":0.46400000000000002},"max":{"1min":1.6080000000000001,"5min":1.6459999999999999,"15min":15.473000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.0389999999999999,"15min":1.0249999999999999},"min":{"1min":0.72799999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6850000000000001,"5min":1.794,"15min":1.7989999999999999},"last":1.075}]},{"osd":3,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96899999999999997,"15min":0.98599999999999999},"min":{"1min":0.64500000000000002,"5min":0.54800000000000004,"15min":0.39000000000000001},"max":{"1min":1.417,"5min":1.5049999999999999,"15min":5.3970000000000002},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.1539999999999999,"15min":1.1890000000000001},"min":{"1min":0.63400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":1.5189999999999999,"5min":2.2349999999999999,"15min":15.439},"last":0.83999999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2270000000000001,"15min":1.258},"min":{"1min":0.999,"5min":0.66200000000000003,"15min":0.61399999999999999},"max":{"1min":1.7090000000000001,"5min":1.986,"15min":5.1799999999999997},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.2310000000000001,"15min":1.22},"min":{"1min":0.95999999999999996,"5min":0.59399999999999997,"15min":0.56200000000000006},"max":{"1min":1.6220000000000001,"5min":1.738,"15min":3.4340000000000002},"last":1.113}]},{"osd":5,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2829999999999999,"15min":1.282},"min":{"1min":0.94999999999999996,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6459999999999999,"5min":1.9099999999999999,"15min":3.548},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.337,"15min":1.3340000000000001},"min":{"1min":0.89700000000000002,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.6140000000000001,"5min":1.8009999999999999,"15min":2.823},"last":1.587}]},{"osd":6,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.363,"15min":1.4179999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.59099999999999997},"max":{"1min":1.681,"5min":1.8740000000000001,"15min":15.4},"last":1.232},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.389},"min":{"1min":1.0349999999999999,"5min":0.85699999999999998,"15min":0.72499999999999998},"max":{"1min":1.6990000000000001,"5min":2.105,"15min":7.1349999999999998},"last":1.1679999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.411,"15min":1.4470000000000001},"min":{"1min":1.125,"5min":0.95499999999999996,"15min":0.79900000000000004},"max":{"1min":1.78,"5min":2.1819999999999999,"15min":5.29},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.3819999999999999,"15min":1.375},"min":{"1min":1.034,"5min":1.002,"15min":0.752},"max":{"1min":1.8169999999999999,"5min":2.0470000000000002,"15min":2.7269999999999999},"last":1.21}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:18:44.672 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:18:44.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.869+0000 7efc88200700 1 Processor -- start 2024-01-22T05:18:44.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.869+0000 7efc88200700 1 -- start start 2024-01-22T05:18:44.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc88200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efc80065240 0x7efc800644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc88200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc800649e0 0x7efc8015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc88200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc800c2700 con 0x7efc80065620 2024-01-22T05:18:44.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc88200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc80064e30 con 0x7efc80065240 2024-01-22T05:18:44.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc88200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc800c29a0 con 0x7efc800649e0 2024-01-22T05:18:44.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc84e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efc80065620 0x7efc8015b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55608/0 (socket says 172.21.15.49:55608) 2024-01-22T05:18:44.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc84e00700 1 -- 172.21.15.49:0/138448221 learned_addr learned my addr 172.21.15.49:0/138448221 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:44.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc85800700 1 --2- 172.21.15.49:0/138448221 >> v2:172.21.15.110:3300/0 conn(0x7efc80065240 0x7efc800644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc86c00700 1 --2- 172.21.15.49:0/138448221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc800649e0 0x7efc8015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc7fe00700 1 -- 172.21.15.49:0/138448221 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301393712 0 0) 0x7efc800c2700 con 0x7efc80065620 2024-01-22T05:18:44.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc7fe00700 1 -- 172.21.15.49:0/138448221 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc600033f0 con 0x7efc80065620 2024-01-22T05:18:44.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc85800700 1 -- 172.21.15.49:0/138448221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc800649e0 msgr2=0x7efc8015c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:44.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc85800700 1 --2- 172.21.15.49:0/138448221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc800649e0 0x7efc8015c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc85800700 1 -- 172.21.15.49:0/138448221 >> v1:172.21.15.49:6789/0 conn(0x7efc80065620 legacy=0x7efc8015b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc85800700 1 -- 172.21.15.49:0/138448221 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc800c2c80 con 0x7efc80065240 2024-01-22T05:18:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc85800700 1 --2- 172.21.15.49:0/138448221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc80065240 0x7efc800644f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7efc70009760 tx=0x7efc70009060).ready entity=mon.1 client_cookie=cdd233be0f409288 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc7fe00700 1 -- 172.21.15.49:0/138448221 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7000d4a0 con 0x7efc80065240 2024-01-22T05:18:44.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc7fe00700 1 -- 172.21.15.49:0/138448221 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7000d600 con 0x7efc80065240 2024-01-22T05:18:44.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.873+0000 7efc7fe00700 1 -- 172.21.15.49:0/138448221 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7000d980 con 0x7efc80065240 2024-01-22T05:18:44.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.877+0000 7efc88200700 1 -- 172.21.15.49:0/138448221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc80065240 msgr2=0x7efc800644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.877+0000 7efc88200700 1 --2- 172.21.15.49:0/138448221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc80065240 0x7efc800644f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7efc70009760 tx=0x7efc70009060).stop 2024-01-22T05:18:44.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.877+0000 7efc88200700 1 -- 172.21.15.49:0/138448221 shutdown_connections 2024-01-22T05:18:44.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.877+0000 7efc88200700 1 --2- 172.21.15.49:0/138448221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc800649e0 0x7efc8015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.877+0000 7efc88200700 1 --2- 172.21.15.49:0/138448221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc80065240 0x7efc800644f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.877+0000 7efc88200700 1 -- 172.21.15.49:0/138448221 >> 172.21.15.49:0/138448221 conn(0x7efc800c87f0 msgr2=0x7efc800c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:44.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.877+0000 7efc88200700 1 -- 172.21.15.49:0/138448221 shutdown_connections 2024-01-22T05:18:44.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.877+0000 7efc88200700 1 -- 172.21.15.49:0/138448221 wait complete. 2024-01-22T05:18:44.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.881+0000 7efc88200700 1 Processor -- start 2024-01-22T05:18:44.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.881+0000 7efc88200700 1 -- start start 2024-01-22T05:18:44.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.881+0000 7efc88200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc800649e0 0x7efc80146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.881+0000 7efc88200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80065240 0x7efc800a8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.881+0000 7efc88200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc80065620 0x7efc800a8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.881+0000 7efc88200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc800a9880 con 0x7efc80065240 2024-01-22T05:18:44.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.881+0000 7efc88200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc800a8b20 con 0x7efc800649e0 2024-01-22T05:18:44.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.881+0000 7efc88200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc800c1110 con 0x7efc80065620 2024-01-22T05:18:44.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc84e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80065240 0x7efc800a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc84e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80065240 0x7efc800a8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39152/0 (socket says 172.21.15.49:39152) 2024-01-22T05:18:44.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc84e00700 1 -- 172.21.15.49:0/2493797607 learned_addr learned my addr 172.21.15.49:0/2493797607 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:44.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc85800700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc800649e0 0x7efc80146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc86c00700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc80065620 0x7efc800a8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc84e00700 1 -- 172.21.15.49:0/2493797607 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc80065620 msgr2=0x7efc800a8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc84e00700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc80065620 0x7efc800a8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc84e00700 1 -- 172.21.15.49:0/2493797607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc800649e0 msgr2=0x7efc80146e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:44.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc84e00700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc800649e0 0x7efc80146e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:44.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc84e00700 1 -- 172.21.15.49:0/2493797607 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc700092a0 con 0x7efc80065240 2024-01-22T05:18:44.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc85800700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc800649e0 0x7efc80146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:44.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc86c00700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc80065620 0x7efc800a8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:44.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc84e00700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80065240 0x7efc800a8140 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7efc6800c410 tx=0x7efc68007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:44.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc7cc00700 1 -- 172.21.15.49:0/2493797607 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc680072e0 con 0x7efc80065240 2024-01-22T05:18:44.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc7cc00700 1 -- 172.21.15.49:0/2493797607 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc68007440 con 0x7efc80065240 2024-01-22T05:18:44.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc88200700 1 -- 172.21.15.49:0/2493797607 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc800a8d00 con 0x7efc80065240 2024-01-22T05:18:44.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc7cc00700 1 -- 172.21.15.49:0/2493797607 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc680057a0 con 0x7efc80065240 2024-01-22T05:18:44.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.885+0000 7efc88200700 1 -- 172.21.15.49:0/2493797607 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc800a92c0 con 0x7efc80065240 2024-01-22T05:18:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.889+0000 7efc88200700 1 -- 172.21.15.49:0/2493797607 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc801585e0 con 0x7efc80065240 2024-01-22T05:18:44.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.889+0000 7efc7cc00700 1 -- 172.21.15.49:0/2493797607 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7efc68005bd0 con 0x7efc80065240 2024-01-22T05:18:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.889+0000 7efc7cc00700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc5805a510 0x7efc5805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.889+0000 7efc7cc00700 1 -- 172.21.15.49:0/2493797607 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7efc68074250 con 0x7efc80065240 2024-01-22T05:18:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.889+0000 7efc85800700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc5805a510 0x7efc5805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.893+0000 7efc85800700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc5805a510 0x7efc5805c9d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7efc7000d260 tx=0x7efc70016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:44.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:44.897+0000 7efc7cc00700 1 -- 172.21.15.49:0/2493797607 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efc68047810 con 0x7efc80065240 2024-01-22T05:18:45.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.061+0000 7efc88200700 1 -- 172.21.15.49:0/2493797607 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc80047060 con 0x7efc5805a510 2024-01-22T05:18:45.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.081+0000 7efc7cc00700 1 -- 172.21.15.49:0/2493797607 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359582 (secure 0 0 0) 0x7efc80047060 con 0x7efc5805a510 2024-01-22T05:18:45.089 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:45.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.089+0000 7efc88200700 1 -- 172.21.15.49:0/2493797607 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc5805a510 msgr2=0x7efc5805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:45.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.089+0000 7efc88200700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc5805a510 0x7efc5805c9d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7efc7000d260 tx=0x7efc70016000).stop 2024-01-22T05:18:45.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.089+0000 7efc88200700 1 -- 172.21.15.49:0/2493797607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80065240 msgr2=0x7efc800a8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:45.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.089+0000 7efc88200700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80065240 0x7efc800a8140 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7efc6800c410 tx=0x7efc68007c30).stop 2024-01-22T05:18:45.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.089+0000 7efc88200700 1 -- 172.21.15.49:0/2493797607 shutdown_connections 2024-01-22T05:18:45.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.089+0000 7efc88200700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efc5805a510 0x7efc5805c9d0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.089+0000 7efc88200700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc80065620 0x7efc800a8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.089+0000 7efc88200700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80065240 0x7efc800a8140 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.089+0000 7efc88200700 1 --2- 172.21.15.49:0/2493797607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc800649e0 0x7efc80146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.089+0000 7efc88200700 1 -- 172.21.15.49:0/2493797607 >> 172.21.15.49:0/2493797607 conn(0x7efc800c87f0 msgr2=0x7efc80063940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:45.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.089+0000 7efc88200700 1 -- 172.21.15.49:0/2493797607 shutdown_connections 2024-01-22T05:18:45.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.089+0000 7efc88200700 1 -- 172.21.15.49:0/2493797607 wait complete. 2024-01-22T05:18:45.096 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:18:45.118 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":593,"stamp":"2024-01-22T05:18:43.547796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":226,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2464340,"kb_used_data":16916,"kb_used_omap":0,"kb_used_meta":2447360,"kb_avail":752510380,"statfs":{"total":773094113280,"available":770570629120,"internally_reserved":0,"allocated":17321984,"data_stored":8618171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506096640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3519,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-47,"num_write_kb":-15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.968318"},"pg_stats":[{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.120007+0000","last_change":"2024-01-22T05:18:40.115553+0000","last_active":"2024-01-22T05:18:40.120007+0000","last_peered":"2024-01-22T05:18:40.120007+0000","last_clean":"2024-01-22T05:18:40.120007+0000","last_became_active":"2024-01-22T05:18:40.115044+0000","last_became_peered":"2024-01-22T05:18:40.115044+0000","last_unstale":"2024-01-22T05:18:40.120007+0000","last_undegraded":"2024-01-22T05:18:40.120007+0000","last_fullsized":"2024-01-22T05:18:40.120007+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3f","version":"171'3","reported_seq":13,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.099017+0000","last_change":"2024-01-22T05:18:39.638468+0000","last_active":"2024-01-22T05:18:40.099017+0000","last_peered":"2024-01-22T05:18:40.099017+0000","last_clean":"2024-01-22T05:18:40.099017+0000","last_became_active":"2024-01-22T05:18:39.637668+0000","last_became_peered":"2024-01-22T05:18:39.637668+0000","last_unstale":"2024-01-22T05:18:40.099017+0000","last_undegraded":"2024-01-22T05:18:40.099017+0000","last_fullsized":"2024-01-22T05:18:40.099017+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.119644+0000","last_change":"2024-01-22T05:18:40.114838+0000","last_active":"2024-01-22T05:18:40.119644+0000","last_peered":"2024-01-22T05:18:40.119644+0000","last_clean":"2024-01-22T05:18:40.119644+0000","last_became_active":"2024-01-22T05:18:40.113111+0000","last_became_peered":"2024-01-22T05:18:40.113111+0000","last_unstale":"2024-01-22T05:18:40.119644+0000","last_undegraded":"2024-01-22T05:18:40.119644+0000","last_fullsized":"2024-01-22T05:18:40.119644+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.103034+0000","last_change":"2024-01-22T05:18:39.646954+0000","last_active":"2024-01-22T05:18:40.103034+0000","last_peered":"2024-01-22T05:18:40.103034+0000","last_clean":"2024-01-22T05:18:40.103034+0000","last_became_active":"2024-01-22T05:18:39.646474+0000","last_became_peered":"2024-01-22T05:18:39.646474+0000","last_unstale":"2024-01-22T05:18:40.103034+0000","last_undegraded":"2024-01-22T05:18:40.103034+0000","last_fullsized":"2024-01-22T05:18:40.103034+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.120933+0000","last_change":"2024-01-22T05:18:40.116608+0000","last_active":"2024-01-22T05:18:40.120933+0000","last_peered":"2024-01-22T05:18:40.120933+0000","last_clean":"2024-01-22T05:18:40.120933+0000","last_became_active":"2024-01-22T05:18:40.116324+0000","last_became_peered":"2024-01-22T05:18:40.116324+0000","last_unstale":"2024-01-22T05:18:40.120933+0000","last_undegraded":"2024-01-22T05:18:40.120933+0000","last_fullsized":"2024-01-22T05:18:40.120933+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.087357+0000","last_change":"2024-01-22T05:18:39.628757+0000","last_active":"2024-01-22T05:18:40.087357+0000","last_peered":"2024-01-22T05:18:40.087357+0000","last_clean":"2024-01-22T05:18:40.087357+0000","last_became_active":"2024-01-22T05:18:39.628462+0000","last_became_peered":"2024-01-22T05:18:39.628462+0000","last_unstale":"2024-01-22T05:18:40.087357+0000","last_undegraded":"2024-01-22T05:18:40.087357+0000","last_fullsized":"2024-01-22T05:18:40.087357+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.109500+0000","last_change":"2024-01-22T05:18:40.107465+0000","last_active":"2024-01-22T05:18:40.109500+0000","last_peered":"2024-01-22T05:18:40.109500+0000","last_clean":"2024-01-22T05:18:40.109500+0000","last_became_active":"2024-01-22T05:18:40.107208+0000","last_became_peered":"2024-01-22T05:18:40.107208+0000","last_unstale":"2024-01-22T05:18:40.109500+0000","last_undegraded":"2024-01-22T05:18:40.109500+0000","last_fullsized":"2024-01-22T05:18:40.109500+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3c","version":"171'2","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.101411+0000","last_change":"2024-01-22T05:18:39.632984+0000","last_active":"2024-01-22T05:18:40.101411+0000","last_peered":"2024-01-22T05:18:40.101411+0000","last_clean":"2024-01-22T05:18:40.101411+0000","last_became_active":"2024-01-22T05:18:39.632685+0000","last_became_peered":"2024-01-22T05:18:39.632685+0000","last_unstale":"2024-01-22T05:18:40.101411+0000","last_undegraded":"2024-01-22T05:18:40.101411+0000","last_fullsized":"2024-01-22T05:18:40.101411+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.119992+0000","last_change":"2024-01-22T05:18:40.114704+0000","last_active":"2024-01-22T05:18:40.119992+0000","last_peered":"2024-01-22T05:18:40.119992+0000","last_clean":"2024-01-22T05:18:40.119992+0000","last_became_active":"2024-01-22T05:18:40.114415+0000","last_became_peered":"2024-01-22T05:18:40.114415+0000","last_unstale":"2024-01-22T05:18:40.119992+0000","last_undegraded":"2024-01-22T05:18:40.119992+0000","last_fullsized":"2024-01-22T05:18:40.119992+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3b","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.112980+0000","last_change":"2024-01-22T05:18:39.649147+0000","last_active":"2024-01-22T05:18:40.112980+0000","last_peered":"2024-01-22T05:18:40.112980+0000","last_clean":"2024-01-22T05:18:40.112980+0000","last_became_active":"2024-01-22T05:18:39.647794+0000","last_became_peered":"2024-01-22T05:18:39.647794+0000","last_unstale":"2024-01-22T05:18:40.112980+0000","last_undegraded":"2024-01-22T05:18:40.112980+0000","last_fullsized":"2024-01-22T05:18:40.112980+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.110776+0000","last_change":"2024-01-22T05:18:40.106821+0000","last_active":"2024-01-22T05:18:40.110776+0000","last_peered":"2024-01-22T05:18:40.110776+0000","last_clean":"2024-01-22T05:18:40.110776+0000","last_became_active":"2024-01-22T05:18:40.106229+0000","last_became_peered":"2024-01-22T05:18:40.106229+0000","last_unstale":"2024-01-22T05:18:40.110776+0000","last_undegraded":"2024-01-22T05:18:40.110776+0000","last_fullsized":"2024-01-22T05:18:40.110776+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.3a","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.107880+0000","last_change":"2024-01-22T05:18:39.643989+0000","last_active":"2024-01-22T05:18:40.107880+0000","last_peered":"2024-01-22T05:18:40.107880+0000","last_clean":"2024-01-22T05:18:40.107880+0000","last_became_active":"2024-01-22T05:18:39.643366+0000","last_became_peered":"2024-01-22T05:18:39.643366+0000","last_unstale":"2024-01-22T05:18:40.107880+0000","last_undegraded":"2024-01-22T05:18:40.107880+0000","last_fullsized":"2024-01-22T05:18:40.107880+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.102194+0000","last_change":"2024-01-22T05:18:40.097871+0000","last_active":"2024-01-22T05:18:40.102194+0000","last_peered":"2024-01-22T05:18:40.102194+0000","last_clean":"2024-01-22T05:18:40.102194+0000","last_became_active":"2024-01-22T05:18:40.096443+0000","last_became_peered":"2024-01-22T05:18:40.096443+0000","last_unstale":"2024-01-22T05:18:40.102194+0000","last_undegraded":"2024-01-22T05:18:40.102194+0000","last_fullsized":"2024-01-22T05:18:40.102194+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.092859+0000","last_change":"2024-01-22T05:18:39.631939+0000","last_active":"2024-01-22T05:18:40.092859+0000","last_peered":"2024-01-22T05:18:40.092859+0000","last_clean":"2024-01-22T05:18:40.092859+0000","last_became_active":"2024-01-22T05:18:39.630930+0000","last_became_peered":"2024-01-22T05:18:39.630930+0000","last_unstale":"2024-01-22T05:18:40.092859+0000","last_undegraded":"2024-01-22T05:18:40.092859+0000","last_fullsized":"2024-01-22T05:18:40.092859+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116202+0000","last_change":"2024-01-22T05:18:40.109719+0000","last_active":"2024-01-22T05:18:40.116202+0000","last_peered":"2024-01-22T05:18:40.116202+0000","last_clean":"2024-01-22T05:18:40.116202+0000","last_became_active":"2024-01-22T05:18:40.108835+0000","last_became_peered":"2024-01-22T05:18:40.108835+0000","last_unstale":"2024-01-22T05:18:40.116202+0000","last_undegraded":"2024-01-22T05:18:40.116202+0000","last_fullsized":"2024-01-22T05:18:40.116202+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.091768+0000","last_change":"2024-01-22T05:18:39.643517+0000","last_active":"2024-01-22T05:18:40.091768+0000","last_peered":"2024-01-22T05:18:40.091768+0000","last_clean":"2024-01-22T05:18:40.091768+0000","last_became_active":"2024-01-22T05:18:39.643216+0000","last_became_peered":"2024-01-22T05:18:39.643216+0000","last_unstale":"2024-01-22T05:18:40.091768+0000","last_undegraded":"2024-01-22T05:18:40.091768+0000","last_fullsized":"2024-01-22T05:18:40.091768+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116696+0000","last_change":"2024-01-22T05:18:40.112132+0000","last_active":"2024-01-22T05:18:40.116696+0000","last_peered":"2024-01-22T05:18:40.116696+0000","last_clean":"2024-01-22T05:18:40.116696+0000","last_became_active":"2024-01-22T05:18:40.111684+0000","last_became_peered":"2024-01-22T05:18:40.111684+0000","last_unstale":"2024-01-22T05:18:40.116696+0000","last_undegraded":"2024-01-22T05:18:40.116696+0000","last_fullsized":"2024-01-22T05:18:40.116696+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.093239+0000","last_change":"2024-01-22T05:18:39.644774+0000","last_active":"2024-01-22T05:18:40.093239+0000","last_peered":"2024-01-22T05:18:40.093239+0000","last_clean":"2024-01-22T05:18:40.093239+0000","last_became_active":"2024-01-22T05:18:39.644478+0000","last_became_peered":"2024-01-22T05:18:39.644478+0000","last_unstale":"2024-01-22T05:18:40.093239+0000","last_undegraded":"2024-01-22T05:18:40.093239+0000","last_fullsized":"2024-01-22T05:18:40.093239+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.118659+0000","last_change":"2024-01-22T05:18:40.115086+0000","last_active":"2024-01-22T05:18:40.118659+0000","last_peered":"2024-01-22T05:18:40.118659+0000","last_clean":"2024-01-22T05:18:40.118659+0000","last_became_active":"2024-01-22T05:18:40.114660+0000","last_became_peered":"2024-01-22T05:18:40.114660+0000","last_unstale":"2024-01-22T05:18:40.118659+0000","last_undegraded":"2024-01-22T05:18:40.118659+0000","last_fullsized":"2024-01-22T05:18:40.118659+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.094666+0000","last_change":"2024-01-22T05:18:39.648055+0000","last_active":"2024-01-22T05:18:40.094666+0000","last_peered":"2024-01-22T05:18:40.094666+0000","last_clean":"2024-01-22T05:18:40.094666+0000","last_became_active":"2024-01-22T05:18:39.647774+0000","last_became_peered":"2024-01-22T05:18:39.647774+0000","last_unstale":"2024-01-22T05:18:40.094666+0000","last_undegraded":"2024-01-22T05:18:40.094666+0000","last_fullsized":"2024-01-22T05:18:40.094666+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.117833+0000","last_change":"2024-01-22T05:18:40.110916+0000","last_active":"2024-01-22T05:18:40.117833+0000","last_peered":"2024-01-22T05:18:40.117833+0000","last_clean":"2024-01-22T05:18:40.117833+0000","last_became_active":"2024-01-22T05:18:40.110608+0000","last_became_peered":"2024-01-22T05:18:40.110608+0000","last_unstale":"2024-01-22T05:18:40.117833+0000","last_undegraded":"2024-01-22T05:18:40.117833+0000","last_fullsized":"2024-01-22T05:18:40.117833+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.092787+0000","last_change":"2024-01-22T05:18:39.642497+0000","last_active":"2024-01-22T05:18:40.092787+0000","last_peered":"2024-01-22T05:18:40.092787+0000","last_clean":"2024-01-22T05:18:40.092787+0000","last_became_active":"2024-01-22T05:18:39.642157+0000","last_became_peered":"2024-01-22T05:18:39.642157+0000","last_unstale":"2024-01-22T05:18:40.092787+0000","last_undegraded":"2024-01-22T05:18:40.092787+0000","last_fullsized":"2024-01-22T05:18:40.092787+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116325+0000","last_change":"2024-01-22T05:18:40.111984+0000","last_active":"2024-01-22T05:18:40.116325+0000","last_peered":"2024-01-22T05:18:40.116325+0000","last_clean":"2024-01-22T05:18:40.116325+0000","last_became_active":"2024-01-22T05:18:40.109100+0000","last_became_peered":"2024-01-22T05:18:40.109100+0000","last_unstale":"2024-01-22T05:18:40.116325+0000","last_undegraded":"2024-01-22T05:18:40.116325+0000","last_fullsized":"2024-01-22T05:18:40.116325+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.34","version":"171'4","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.120341+0000","last_change":"2024-01-22T05:18:39.645165+0000","last_active":"2024-01-22T05:18:40.120341+0000","last_peered":"2024-01-22T05:18:40.120341+0000","last_clean":"2024-01-22T05:18:40.120341+0000","last_became_active":"2024-01-22T05:18:39.644599+0000","last_became_peered":"2024-01-22T05:18:39.644599+0000","last_unstale":"2024-01-22T05:18:40.120341+0000","last_undegraded":"2024-01-22T05:18:40.120341+0000","last_fullsized":"2024-01-22T05:18:40.120341+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.118724+0000","last_change":"2024-01-22T05:18:40.115866+0000","last_active":"2024-01-22T05:18:40.118724+0000","last_peered":"2024-01-22T05:18:40.118724+0000","last_clean":"2024-01-22T05:18:40.118724+0000","last_became_active":"2024-01-22T05:18:40.115588+0000","last_became_peered":"2024-01-22T05:18:40.115588+0000","last_unstale":"2024-01-22T05:18:40.118724+0000","last_undegraded":"2024-01-22T05:18:40.118724+0000","last_fullsized":"2024-01-22T05:18:40.118724+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.117860+0000","last_change":"2024-01-22T05:18:39.646886+0000","last_active":"2024-01-22T05:18:40.117860+0000","last_peered":"2024-01-22T05:18:40.117860+0000","last_clean":"2024-01-22T05:18:40.117860+0000","last_became_active":"2024-01-22T05:18:39.646604+0000","last_became_peered":"2024-01-22T05:18:39.646604+0000","last_unstale":"2024-01-22T05:18:40.117860+0000","last_undegraded":"2024-01-22T05:18:40.117860+0000","last_fullsized":"2024-01-22T05:18:40.117860+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.117748+0000","last_change":"2024-01-22T05:18:40.110221+0000","last_active":"2024-01-22T05:18:40.117748+0000","last_peered":"2024-01-22T05:18:40.117748+0000","last_clean":"2024-01-22T05:18:40.117748+0000","last_became_active":"2024-01-22T05:18:40.109927+0000","last_became_peered":"2024-01-22T05:18:40.109927+0000","last_unstale":"2024-01-22T05:18:40.117748+0000","last_undegraded":"2024-01-22T05:18:40.117748+0000","last_fullsized":"2024-01-22T05:18:40.117748+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.096344+0000","last_change":"2024-01-22T05:18:39.650862+0000","last_active":"2024-01-22T05:18:40.096344+0000","last_peered":"2024-01-22T05:18:40.096344+0000","last_clean":"2024-01-22T05:18:40.096344+0000","last_became_active":"2024-01-22T05:18:39.650069+0000","last_became_peered":"2024-01-22T05:18:39.650069+0000","last_unstale":"2024-01-22T05:18:40.096344+0000","last_undegraded":"2024-01-22T05:18:40.096344+0000","last_fullsized":"2024-01-22T05:18:40.096344+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116406+0000","last_change":"2024-01-22T05:18:40.108938+0000","last_active":"2024-01-22T05:18:40.116406+0000","last_peered":"2024-01-22T05:18:40.116406+0000","last_clean":"2024-01-22T05:18:40.116406+0000","last_became_active":"2024-01-22T05:18:40.108638+0000","last_became_peered":"2024-01-22T05:18:40.108638+0000","last_unstale":"2024-01-22T05:18:40.116406+0000","last_undegraded":"2024-01-22T05:18:40.116406+0000","last_fullsized":"2024-01-22T05:18:40.116406+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.091584+0000","last_change":"2024-01-22T05:18:39.647731+0000","last_active":"2024-01-22T05:18:40.091584+0000","last_peered":"2024-01-22T05:18:40.091584+0000","last_clean":"2024-01-22T05:18:40.091584+0000","last_became_active":"2024-01-22T05:18:39.645128+0000","last_became_peered":"2024-01-22T05:18:39.645128+0000","last_unstale":"2024-01-22T05:18:40.091584+0000","last_undegraded":"2024-01-22T05:18:40.091584+0000","last_fullsized":"2024-01-22T05:18:40.091584+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.118158+0000","last_change":"2024-01-22T05:18:40.109698+0000","last_active":"2024-01-22T05:18:40.118158+0000","last_peered":"2024-01-22T05:18:40.118158+0000","last_clean":"2024-01-22T05:18:40.118158+0000","last_became_active":"2024-01-22T05:18:40.109405+0000","last_became_peered":"2024-01-22T05:18:40.109405+0000","last_unstale":"2024-01-22T05:18:40.118158+0000","last_undegraded":"2024-01-22T05:18:40.118158+0000","last_fullsized":"2024-01-22T05:18:40.118158+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.30","version":"171'4","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.111712+0000","last_change":"2024-01-22T05:18:39.634043+0000","last_active":"2024-01-22T05:18:40.111712+0000","last_peered":"2024-01-22T05:18:40.111712+0000","last_clean":"2024-01-22T05:18:40.111712+0000","last_became_active":"2024-01-22T05:18:39.632670+0000","last_became_peered":"2024-01-22T05:18:39.632670+0000","last_unstale":"2024-01-22T05:18:40.111712+0000","last_undegraded":"2024-01-22T05:18:40.111712+0000","last_fullsized":"2024-01-22T05:18:40.111712+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116364+0000","last_change":"2024-01-22T05:18:40.112827+0000","last_active":"2024-01-22T05:18:40.116364+0000","last_peered":"2024-01-22T05:18:40.116364+0000","last_clean":"2024-01-22T05:18:40.116364+0000","last_became_active":"2024-01-22T05:18:40.112514+0000","last_became_peered":"2024-01-22T05:18:40.112514+0000","last_unstale":"2024-01-22T05:18:40.116364+0000","last_undegraded":"2024-01-22T05:18:40.116364+0000","last_fullsized":"2024-01-22T05:18:40.116364+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.093330+0000","last_change":"2024-01-22T05:18:39.634999+0000","last_active":"2024-01-22T05:18:40.093330+0000","last_peered":"2024-01-22T05:18:40.093330+0000","last_clean":"2024-01-22T05:18:40.093330+0000","last_became_active":"2024-01-22T05:18:39.634720+0000","last_became_peered":"2024-01-22T05:18:39.634720+0000","last_unstale":"2024-01-22T05:18:40.093330+0000","last_undegraded":"2024-01-22T05:18:40.093330+0000","last_fullsized":"2024-01-22T05:18:40.093330+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.125476+0000","last_change":"2024-01-22T05:18:40.123889+0000","last_active":"2024-01-22T05:18:40.125476+0000","last_peered":"2024-01-22T05:18:40.125476+0000","last_clean":"2024-01-22T05:18:40.125476+0000","last_became_active":"2024-01-22T05:18:40.123039+0000","last_became_peered":"2024-01-22T05:18:40.123039+0000","last_unstale":"2024-01-22T05:18:40.125476+0000","last_undegraded":"2024-01-22T05:18:40.125476+0000","last_fullsized":"2024-01-22T05:18:40.125476+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.099885+0000","last_change":"2024-01-22T05:18:39.648262+0000","last_active":"2024-01-22T05:18:40.099885+0000","last_peered":"2024-01-22T05:18:40.099885+0000","last_clean":"2024-01-22T05:18:40.099885+0000","last_became_active":"2024-01-22T05:18:39.647570+0000","last_became_peered":"2024-01-22T05:18:39.647570+0000","last_unstale":"2024-01-22T05:18:40.099885+0000","last_undegraded":"2024-01-22T05:18:40.099885+0000","last_fullsized":"2024-01-22T05:18:40.099885+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.125527+0000","last_change":"2024-01-22T05:18:40.123919+0000","last_active":"2024-01-22T05:18:40.125527+0000","last_peered":"2024-01-22T05:18:40.125527+0000","last_clean":"2024-01-22T05:18:40.125527+0000","last_became_active":"2024-01-22T05:18:40.123644+0000","last_became_peered":"2024-01-22T05:18:40.123644+0000","last_unstale":"2024-01-22T05:18:40.125527+0000","last_undegraded":"2024-01-22T05:18:40.125527+0000","last_fullsized":"2024-01-22T05:18:40.125527+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2d","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.104746+0000","last_change":"2024-01-22T05:18:39.647771+0000","last_active":"2024-01-22T05:18:40.104746+0000","last_peered":"2024-01-22T05:18:40.104746+0000","last_clean":"2024-01-22T05:18:40.104746+0000","last_became_active":"2024-01-22T05:18:39.647382+0000","last_became_peered":"2024-01-22T05:18:39.647382+0000","last_unstale":"2024-01-22T05:18:40.104746+0000","last_undegraded":"2024-01-22T05:18:40.104746+0000","last_fullsized":"2024-01-22T05:18:40.104746+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.118204+0000","last_change":"2024-01-22T05:18:40.111082+0000","last_active":"2024-01-22T05:18:40.118204+0000","last_peered":"2024-01-22T05:18:40.118204+0000","last_clean":"2024-01-22T05:18:40.118204+0000","last_became_active":"2024-01-22T05:18:40.110506+0000","last_became_peered":"2024-01-22T05:18:40.110506+0000","last_unstale":"2024-01-22T05:18:40.118204+0000","last_undegraded":"2024-01-22T05:18:40.118204+0000","last_fullsized":"2024-01-22T05:18:40.118204+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.100001+0000","last_change":"2024-01-22T05:18:39.646341+0000","last_active":"2024-01-22T05:18:40.100001+0000","last_peered":"2024-01-22T05:18:40.100001+0000","last_clean":"2024-01-22T05:18:40.100001+0000","last_became_active":"2024-01-22T05:18:39.646055+0000","last_became_peered":"2024-01-22T05:18:39.646055+0000","last_unstale":"2024-01-22T05:18:40.100001+0000","last_undegraded":"2024-01-22T05:18:40.100001+0000","last_fullsized":"2024-01-22T05:18:40.100001+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115875+0000","last_change":"2024-01-22T05:18:40.112408+0000","last_active":"2024-01-22T05:18:40.115875+0000","last_peered":"2024-01-22T05:18:40.115875+0000","last_clean":"2024-01-22T05:18:40.115875+0000","last_became_active":"2024-01-22T05:18:40.112141+0000","last_became_peered":"2024-01-22T05:18:40.112141+0000","last_unstale":"2024-01-22T05:18:40.115875+0000","last_undegraded":"2024-01-22T05:18:40.115875+0000","last_fullsized":"2024-01-22T05:18:40.115875+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2b","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.114838+0000","last_change":"2024-01-22T05:18:39.651930+0000","last_active":"2024-01-22T05:18:40.114838+0000","last_peered":"2024-01-22T05:18:40.114838+0000","last_clean":"2024-01-22T05:18:40.114838+0000","last_became_active":"2024-01-22T05:18:39.651607+0000","last_became_peered":"2024-01-22T05:18:39.651607+0000","last_unstale":"2024-01-22T05:18:40.114838+0000","last_undegraded":"2024-01-22T05:18:40.114838+0000","last_fullsized":"2024-01-22T05:18:40.114838+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.110795+0000","last_change":"2024-01-22T05:18:40.106996+0000","last_active":"2024-01-22T05:18:40.110795+0000","last_peered":"2024-01-22T05:18:40.110795+0000","last_clean":"2024-01-22T05:18:40.110795+0000","last_became_active":"2024-01-22T05:18:40.106592+0000","last_became_peered":"2024-01-22T05:18:40.106592+0000","last_unstale":"2024-01-22T05:18:40.110795+0000","last_undegraded":"2024-01-22T05:18:40.110795+0000","last_fullsized":"2024-01-22T05:18:40.110795+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.100971+0000","last_change":"2024-01-22T05:18:39.644188+0000","last_active":"2024-01-22T05:18:40.100971+0000","last_peered":"2024-01-22T05:18:40.100971+0000","last_clean":"2024-01-22T05:18:40.100971+0000","last_became_active":"2024-01-22T05:18:39.643711+0000","last_became_peered":"2024-01-22T05:18:39.643711+0000","last_unstale":"2024-01-22T05:18:40.100971+0000","last_undegraded":"2024-01-22T05:18:40.100971+0000","last_fullsized":"2024-01-22T05:18:40.100971+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.109080+0000","last_change":"2024-01-22T05:18:40.102045+0000","last_active":"2024-01-22T05:18:40.109080+0000","last_peered":"2024-01-22T05:18:40.109080+0000","last_clean":"2024-01-22T05:18:40.109080+0000","last_became_active":"2024-01-22T05:18:40.101757+0000","last_became_peered":"2024-01-22T05:18:40.101757+0000","last_unstale":"2024-01-22T05:18:40.109080+0000","last_undegraded":"2024-01-22T05:18:40.109080+0000","last_fullsized":"2024-01-22T05:18:40.109080+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.095315+0000","last_change":"2024-01-22T05:18:39.644880+0000","last_active":"2024-01-22T05:18:40.095315+0000","last_peered":"2024-01-22T05:18:40.095315+0000","last_clean":"2024-01-22T05:18:40.095315+0000","last_became_active":"2024-01-22T05:18:39.644522+0000","last_became_peered":"2024-01-22T05:18:39.644522+0000","last_unstale":"2024-01-22T05:18:40.095315+0000","last_undegraded":"2024-01-22T05:18:40.095315+0000","last_fullsized":"2024-01-22T05:18:40.095315+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.120282+0000","last_change":"2024-01-22T05:18:40.116161+0000","last_active":"2024-01-22T05:18:40.120282+0000","last_peered":"2024-01-22T05:18:40.120282+0000","last_clean":"2024-01-22T05:18:40.120282+0000","last_became_active":"2024-01-22T05:18:40.115878+0000","last_became_peered":"2024-01-22T05:18:40.115878+0000","last_unstale":"2024-01-22T05:18:40.120282+0000","last_undegraded":"2024-01-22T05:18:40.120282+0000","last_fullsized":"2024-01-22T05:18:40.120282+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.085479+0000","last_change":"2024-01-22T05:18:39.633663+0000","last_active":"2024-01-22T05:18:40.085479+0000","last_peered":"2024-01-22T05:18:40.085479+0000","last_clean":"2024-01-22T05:18:40.085479+0000","last_became_active":"2024-01-22T05:18:39.633087+0000","last_became_peered":"2024-01-22T05:18:39.633087+0000","last_unstale":"2024-01-22T05:18:40.085479+0000","last_undegraded":"2024-01-22T05:18:40.085479+0000","last_fullsized":"2024-01-22T05:18:40.085479+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115958+0000","last_change":"2024-01-22T05:18:40.109758+0000","last_active":"2024-01-22T05:18:40.115958+0000","last_peered":"2024-01-22T05:18:40.115958+0000","last_clean":"2024-01-22T05:18:40.115958+0000","last_became_active":"2024-01-22T05:18:40.108362+0000","last_became_peered":"2024-01-22T05:18:40.108362+0000","last_unstale":"2024-01-22T05:18:40.115958+0000","last_undegraded":"2024-01-22T05:18:40.115958+0000","last_fullsized":"2024-01-22T05:18:40.115958+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.084481+0000","last_change":"2024-01-22T05:18:39.645511+0000","last_active":"2024-01-22T05:18:40.084481+0000","last_peered":"2024-01-22T05:18:40.084481+0000","last_clean":"2024-01-22T05:18:40.084481+0000","last_became_active":"2024-01-22T05:18:39.645227+0000","last_became_peered":"2024-01-22T05:18:39.645227+0000","last_unstale":"2024-01-22T05:18:40.084481+0000","last_undegraded":"2024-01-22T05:18:40.084481+0000","last_fullsized":"2024-01-22T05:18:40.084481+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.119787+0000","last_change":"2024-01-22T05:18:40.114186+0000","last_active":"2024-01-22T05:18:40.119787+0000","last_peered":"2024-01-22T05:18:40.119787+0000","last_clean":"2024-01-22T05:18:40.119787+0000","last_became_active":"2024-01-22T05:18:40.111525+0000","last_became_peered":"2024-01-22T05:18:40.111525+0000","last_unstale":"2024-01-22T05:18:40.119787+0000","last_undegraded":"2024-01-22T05:18:40.119787+0000","last_fullsized":"2024-01-22T05:18:40.119787+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.098758+0000","last_change":"2024-01-22T05:18:39.650338+0000","last_active":"2024-01-22T05:18:40.098758+0000","last_peered":"2024-01-22T05:18:40.098758+0000","last_clean":"2024-01-22T05:18:40.098758+0000","last_became_active":"2024-01-22T05:18:39.649152+0000","last_became_peered":"2024-01-22T05:18:39.649152+0000","last_unstale":"2024-01-22T05:18:40.098758+0000","last_undegraded":"2024-01-22T05:18:40.098758+0000","last_fullsized":"2024-01-22T05:18:40.098758+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116798+0000","last_change":"2024-01-22T05:18:40.115783+0000","last_active":"2024-01-22T05:18:40.116798+0000","last_peered":"2024-01-22T05:18:40.116798+0000","last_clean":"2024-01-22T05:18:40.116798+0000","last_became_active":"2024-01-22T05:18:40.115494+0000","last_became_peered":"2024-01-22T05:18:40.115494+0000","last_unstale":"2024-01-22T05:18:40.116798+0000","last_undegraded":"2024-01-22T05:18:40.116798+0000","last_fullsized":"2024-01-22T05:18:40.116798+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.102958+0000","last_change":"2024-01-22T05:18:39.646087+0000","last_active":"2024-01-22T05:18:40.102958+0000","last_peered":"2024-01-22T05:18:40.102958+0000","last_clean":"2024-01-22T05:18:40.102958+0000","last_became_active":"2024-01-22T05:18:39.645724+0000","last_became_peered":"2024-01-22T05:18:39.645724+0000","last_unstale":"2024-01-22T05:18:40.102958+0000","last_undegraded":"2024-01-22T05:18:40.102958+0000","last_fullsized":"2024-01-22T05:18:40.102958+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.120500+0000","last_change":"2024-01-22T05:18:40.115428+0000","last_active":"2024-01-22T05:18:40.120500+0000","last_peered":"2024-01-22T05:18:40.120500+0000","last_clean":"2024-01-22T05:18:40.120500+0000","last_became_active":"2024-01-22T05:18:40.115142+0000","last_became_peered":"2024-01-22T05:18:40.115142+0000","last_unstale":"2024-01-22T05:18:40.120500+0000","last_undegraded":"2024-01-22T05:18:40.120500+0000","last_fullsized":"2024-01-22T05:18:40.120500+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.085281+0000","last_change":"2024-01-22T05:18:39.653534+0000","last_active":"2024-01-22T05:18:40.085281+0000","last_peered":"2024-01-22T05:18:40.085281+0000","last_clean":"2024-01-22T05:18:40.085281+0000","last_became_active":"2024-01-22T05:18:39.647883+0000","last_became_peered":"2024-01-22T05:18:39.647883+0000","last_unstale":"2024-01-22T05:18:40.085281+0000","last_undegraded":"2024-01-22T05:18:40.085281+0000","last_fullsized":"2024-01-22T05:18:40.085281+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.117491+0000","last_change":"2024-01-22T05:18:40.107647+0000","last_active":"2024-01-22T05:18:40.117491+0000","last_peered":"2024-01-22T05:18:40.117491+0000","last_clean":"2024-01-22T05:18:40.117491+0000","last_became_active":"2024-01-22T05:18:40.107256+0000","last_became_peered":"2024-01-22T05:18:40.107256+0000","last_unstale":"2024-01-22T05:18:40.117491+0000","last_undegraded":"2024-01-22T05:18:40.117491+0000","last_fullsized":"2024-01-22T05:18:40.117491+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.105958+0000","last_change":"2024-01-22T05:18:39.651974+0000","last_active":"2024-01-22T05:18:40.105958+0000","last_peered":"2024-01-22T05:18:40.105958+0000","last_clean":"2024-01-22T05:18:40.105958+0000","last_became_active":"2024-01-22T05:18:39.650797+0000","last_became_peered":"2024-01-22T05:18:39.650797+0000","last_unstale":"2024-01-22T05:18:40.105958+0000","last_undegraded":"2024-01-22T05:18:40.105958+0000","last_fullsized":"2024-01-22T05:18:40.105958+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.120984+0000","last_change":"2024-01-22T05:18:40.116934+0000","last_active":"2024-01-22T05:18:40.120984+0000","last_peered":"2024-01-22T05:18:40.120984+0000","last_clean":"2024-01-22T05:18:40.120984+0000","last_became_active":"2024-01-22T05:18:40.116647+0000","last_became_peered":"2024-01-22T05:18:40.116647+0000","last_unstale":"2024-01-22T05:18:40.120984+0000","last_undegraded":"2024-01-22T05:18:40.120984+0000","last_fullsized":"2024-01-22T05:18:40.120984+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.104788+0000","last_change":"2024-01-22T05:18:39.639583+0000","last_active":"2024-01-22T05:18:40.104788+0000","last_peered":"2024-01-22T05:18:40.104788+0000","last_clean":"2024-01-22T05:18:40.104788+0000","last_became_active":"2024-01-22T05:18:39.639235+0000","last_became_peered":"2024-01-22T05:18:39.639235+0000","last_unstale":"2024-01-22T05:18:40.104788+0000","last_undegraded":"2024-01-22T05:18:40.104788+0000","last_fullsized":"2024-01-22T05:18:40.104788+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.114004+0000","last_change":"2024-01-22T05:18:40.110282+0000","last_active":"2024-01-22T05:18:40.114004+0000","last_peered":"2024-01-22T05:18:40.114004+0000","last_clean":"2024-01-22T05:18:40.114004+0000","last_became_active":"2024-01-22T05:18:40.109989+0000","last_became_peered":"2024-01-22T05:18:40.109989+0000","last_unstale":"2024-01-22T05:18:40.114004+0000","last_undegraded":"2024-01-22T05:18:40.114004+0000","last_fullsized":"2024-01-22T05:18:40.114004+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.091696+0000","last_change":"2024-01-22T05:18:39.637562+0000","last_active":"2024-01-22T05:18:40.091696+0000","last_peered":"2024-01-22T05:18:40.091696+0000","last_clean":"2024-01-22T05:18:40.091696+0000","last_became_active":"2024-01-22T05:18:39.637243+0000","last_became_peered":"2024-01-22T05:18:39.637243+0000","last_unstale":"2024-01-22T05:18:40.091696+0000","last_undegraded":"2024-01-22T05:18:40.091696+0000","last_fullsized":"2024-01-22T05:18:40.091696+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.124595+0000","last_change":"2024-01-22T05:18:40.121592+0000","last_active":"2024-01-22T05:18:40.124595+0000","last_peered":"2024-01-22T05:18:40.124595+0000","last_clean":"2024-01-22T05:18:40.124595+0000","last_became_active":"2024-01-22T05:18:40.120922+0000","last_became_peered":"2024-01-22T05:18:40.120922+0000","last_unstale":"2024-01-22T05:18:40.124595+0000","last_undegraded":"2024-01-22T05:18:40.124595+0000","last_fullsized":"2024-01-22T05:18:40.124595+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.100183+0000","last_change":"2024-01-22T05:18:39.649665+0000","last_active":"2024-01-22T05:18:40.100183+0000","last_peered":"2024-01-22T05:18:40.100183+0000","last_clean":"2024-01-22T05:18:40.100183+0000","last_became_active":"2024-01-22T05:18:39.649391+0000","last_became_peered":"2024-01-22T05:18:39.649391+0000","last_unstale":"2024-01-22T05:18:40.100183+0000","last_undegraded":"2024-01-22T05:18:40.100183+0000","last_fullsized":"2024-01-22T05:18:40.100183+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.106073+0000","last_change":"2024-01-22T05:18:40.101935+0000","last_active":"2024-01-22T05:18:40.106073+0000","last_peered":"2024-01-22T05:18:40.106073+0000","last_clean":"2024-01-22T05:18:40.106073+0000","last_became_active":"2024-01-22T05:18:40.101517+0000","last_became_peered":"2024-01-22T05:18:40.101517+0000","last_unstale":"2024-01-22T05:18:40.106073+0000","last_undegraded":"2024-01-22T05:18:40.106073+0000","last_fullsized":"2024-01-22T05:18:40.106073+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.087676+0000","last_change":"2024-01-22T05:18:39.625233+0000","last_active":"2024-01-22T05:18:40.087676+0000","last_peered":"2024-01-22T05:18:40.087676+0000","last_clean":"2024-01-22T05:18:40.087676+0000","last_became_active":"2024-01-22T05:18:39.624912+0000","last_became_peered":"2024-01-22T05:18:39.624912+0000","last_unstale":"2024-01-22T05:18:40.087676+0000","last_undegraded":"2024-01-22T05:18:40.087676+0000","last_fullsized":"2024-01-22T05:18:40.087676+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.121429+0000","last_change":"2024-01-22T05:18:40.119689+0000","last_active":"2024-01-22T05:18:40.121429+0000","last_peered":"2024-01-22T05:18:40.121429+0000","last_clean":"2024-01-22T05:18:40.121429+0000","last_became_active":"2024-01-22T05:18:40.119436+0000","last_became_peered":"2024-01-22T05:18:40.119436+0000","last_unstale":"2024-01-22T05:18:40.121429+0000","last_undegraded":"2024-01-22T05:18:40.121429+0000","last_fullsized":"2024-01-22T05:18:40.121429+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.098854+0000","last_change":"2024-01-22T05:18:39.643047+0000","last_active":"2024-01-22T05:18:40.098854+0000","last_peered":"2024-01-22T05:18:40.098854+0000","last_clean":"2024-01-22T05:18:40.098854+0000","last_became_active":"2024-01-22T05:18:39.642733+0000","last_became_peered":"2024-01-22T05:18:39.642733+0000","last_unstale":"2024-01-22T05:18:40.098854+0000","last_undegraded":"2024-01-22T05:18:40.098854+0000","last_fullsized":"2024-01-22T05:18:40.098854+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.104557+0000","last_change":"2024-01-22T05:18:40.101138+0000","last_active":"2024-01-22T05:18:40.104557+0000","last_peered":"2024-01-22T05:18:40.104557+0000","last_clean":"2024-01-22T05:18:40.104557+0000","last_became_active":"2024-01-22T05:18:40.100868+0000","last_became_peered":"2024-01-22T05:18:40.100868+0000","last_unstale":"2024-01-22T05:18:40.104557+0000","last_undegraded":"2024-01-22T05:18:40.104557+0000","last_fullsized":"2024-01-22T05:18:40.104557+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"171'3","reported_seq":13,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.121258+0000","last_change":"2024-01-22T05:18:39.650031+0000","last_active":"2024-01-22T05:18:40.121258+0000","last_peered":"2024-01-22T05:18:40.121258+0000","last_clean":"2024-01-22T05:18:40.121258+0000","last_became_active":"2024-01-22T05:18:39.649738+0000","last_became_peered":"2024-01-22T05:18:39.649738+0000","last_unstale":"2024-01-22T05:18:40.121258+0000","last_undegraded":"2024-01-22T05:18:40.121258+0000","last_fullsized":"2024-01-22T05:18:40.121258+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115753+0000","last_change":"2024-01-22T05:18:40.111361+0000","last_active":"2024-01-22T05:18:40.115753+0000","last_peered":"2024-01-22T05:18:40.115753+0000","last_clean":"2024-01-22T05:18:40.115753+0000","last_became_active":"2024-01-22T05:18:40.110801+0000","last_became_peered":"2024-01-22T05:18:40.110801+0000","last_unstale":"2024-01-22T05:18:40.115753+0000","last_undegraded":"2024-01-22T05:18:40.115753+0000","last_fullsized":"2024-01-22T05:18:40.115753+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"171'2","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.113371+0000","last_change":"2024-01-22T05:18:39.645144+0000","last_active":"2024-01-22T05:18:40.113371+0000","last_peered":"2024-01-22T05:18:40.113371+0000","last_clean":"2024-01-22T05:18:40.113371+0000","last_became_active":"2024-01-22T05:18:39.639581+0000","last_became_peered":"2024-01-22T05:18:39.639581+0000","last_unstale":"2024-01-22T05:18:40.113371+0000","last_undegraded":"2024-01-22T05:18:40.113371+0000","last_fullsized":"2024-01-22T05:18:40.113371+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.121797+0000","last_change":"2024-01-22T05:18:40.119639+0000","last_active":"2024-01-22T05:18:40.121797+0000","last_peered":"2024-01-22T05:18:40.121797+0000","last_clean":"2024-01-22T05:18:40.121797+0000","last_became_active":"2024-01-22T05:18:40.119326+0000","last_became_peered":"2024-01-22T05:18:40.119326+0000","last_unstale":"2024-01-22T05:18:40.121797+0000","last_undegraded":"2024-01-22T05:18:40.121797+0000","last_fullsized":"2024-01-22T05:18:40.121797+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.114629+0000","last_change":"2024-01-22T05:18:39.646639+0000","last_active":"2024-01-22T05:18:40.114629+0000","last_peered":"2024-01-22T05:18:40.114629+0000","last_clean":"2024-01-22T05:18:40.114629+0000","last_became_active":"2024-01-22T05:18:39.646318+0000","last_became_peered":"2024-01-22T05:18:39.646318+0000","last_unstale":"2024-01-22T05:18:40.114629+0000","last_undegraded":"2024-01-22T05:18:40.114629+0000","last_fullsized":"2024-01-22T05:18:40.114629+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115992+0000","last_change":"2024-01-22T05:18:40.109778+0000","last_active":"2024-01-22T05:18:40.115992+0000","last_peered":"2024-01-22T05:18:40.115992+0000","last_clean":"2024-01-22T05:18:40.115992+0000","last_became_active":"2024-01-22T05:18:40.109515+0000","last_became_peered":"2024-01-22T05:18:40.109515+0000","last_unstale":"2024-01-22T05:18:40.115992+0000","last_undegraded":"2024-01-22T05:18:40.115992+0000","last_fullsized":"2024-01-22T05:18:40.115992+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.096439+0000","last_change":"2024-01-22T05:18:39.651070+0000","last_active":"2024-01-22T05:18:40.096439+0000","last_peered":"2024-01-22T05:18:40.096439+0000","last_clean":"2024-01-22T05:18:40.096439+0000","last_became_active":"2024-01-22T05:18:39.650415+0000","last_became_peered":"2024-01-22T05:18:39.650415+0000","last_unstale":"2024-01-22T05:18:40.096439+0000","last_undegraded":"2024-01-22T05:18:40.096439+0000","last_fullsized":"2024-01-22T05:18:40.096439+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.117316+0000","last_change":"2024-01-22T05:18:40.114065+0000","last_active":"2024-01-22T05:18:40.117316+0000","last_peered":"2024-01-22T05:18:40.117316+0000","last_clean":"2024-01-22T05:18:40.117316+0000","last_became_active":"2024-01-22T05:18:40.113808+0000","last_became_peered":"2024-01-22T05:18:40.113808+0000","last_unstale":"2024-01-22T05:18:40.117316+0000","last_undegraded":"2024-01-22T05:18:40.117316+0000","last_fullsized":"2024-01-22T05:18:40.117316+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.083685+0000","last_change":"2024-01-22T05:18:39.646052+0000","last_active":"2024-01-22T05:18:40.083685+0000","last_peered":"2024-01-22T05:18:40.083685+0000","last_clean":"2024-01-22T05:18:40.083685+0000","last_became_active":"2024-01-22T05:18:39.645731+0000","last_became_peered":"2024-01-22T05:18:39.645731+0000","last_unstale":"2024-01-22T05:18:40.083685+0000","last_undegraded":"2024-01-22T05:18:40.083685+0000","last_fullsized":"2024-01-22T05:18:40.083685+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.118316+0000","last_change":"2024-01-22T05:18:40.110847+0000","last_active":"2024-01-22T05:18:40.118316+0000","last_peered":"2024-01-22T05:18:40.118316+0000","last_clean":"2024-01-22T05:18:40.118316+0000","last_became_active":"2024-01-22T05:18:40.110451+0000","last_became_peered":"2024-01-22T05:18:40.110451+0000","last_unstale":"2024-01-22T05:18:40.118316+0000","last_undegraded":"2024-01-22T05:18:40.118316+0000","last_fullsized":"2024-01-22T05:18:40.118316+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"171'4","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.111360+0000","last_change":"2024-01-22T05:18:39.644693+0000","last_active":"2024-01-22T05:18:40.111360+0000","last_peered":"2024-01-22T05:18:40.111360+0000","last_clean":"2024-01-22T05:18:40.111360+0000","last_became_active":"2024-01-22T05:18:39.643817+0000","last_became_peered":"2024-01-22T05:18:39.643817+0000","last_unstale":"2024-01-22T05:18:40.111360+0000","last_undegraded":"2024-01-22T05:18:40.111360+0000","last_fullsized":"2024-01-22T05:18:40.111360+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116678+0000","last_change":"2024-01-22T05:18:40.111966+0000","last_active":"2024-01-22T05:18:40.116678+0000","last_peered":"2024-01-22T05:18:40.116678+0000","last_clean":"2024-01-22T05:18:40.116678+0000","last_became_active":"2024-01-22T05:18:40.111410+0000","last_became_peered":"2024-01-22T05:18:40.111410+0000","last_unstale":"2024-01-22T05:18:40.116678+0000","last_undegraded":"2024-01-22T05:18:40.116678+0000","last_fullsized":"2024-01-22T05:18:40.116678+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116301+0000","last_change":"2024-01-22T05:18:39.644813+0000","last_active":"2024-01-22T05:18:40.116301+0000","last_peered":"2024-01-22T05:18:40.116301+0000","last_clean":"2024-01-22T05:18:40.116301+0000","last_became_active":"2024-01-22T05:18:39.644494+0000","last_became_peered":"2024-01-22T05:18:39.644494+0000","last_unstale":"2024-01-22T05:18:40.116301+0000","last_undegraded":"2024-01-22T05:18:40.116301+0000","last_fullsized":"2024-01-22T05:18:40.116301+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.118637+0000","last_change":"2024-01-22T05:18:40.114918+0000","last_active":"2024-01-22T05:18:40.118637+0000","last_peered":"2024-01-22T05:18:40.118637+0000","last_clean":"2024-01-22T05:18:40.118637+0000","last_became_active":"2024-01-22T05:18:40.114338+0000","last_became_peered":"2024-01-22T05:18:40.114338+0000","last_unstale":"2024-01-22T05:18:40.118637+0000","last_undegraded":"2024-01-22T05:18:40.118637+0000","last_fullsized":"2024-01-22T05:18:40.118637+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"171'2","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116887+0000","last_change":"2024-01-22T05:18:39.647960+0000","last_active":"2024-01-22T05:18:40.116887+0000","last_peered":"2024-01-22T05:18:40.116887+0000","last_clean":"2024-01-22T05:18:40.116887+0000","last_became_active":"2024-01-22T05:18:39.647667+0000","last_became_peered":"2024-01-22T05:18:39.647667+0000","last_unstale":"2024-01-22T05:18:40.116887+0000","last_undegraded":"2024-01-22T05:18:40.116887+0000","last_fullsized":"2024-01-22T05:18:40.116887+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.117225+0000","last_change":"2024-01-22T05:18:40.107625+0000","last_active":"2024-01-22T05:18:40.117225+0000","last_peered":"2024-01-22T05:18:40.117225+0000","last_clean":"2024-01-22T05:18:40.117225+0000","last_became_active":"2024-01-22T05:18:40.107358+0000","last_became_peered":"2024-01-22T05:18:40.107358+0000","last_unstale":"2024-01-22T05:18:40.117225+0000","last_undegraded":"2024-01-22T05:18:40.117225+0000","last_fullsized":"2024-01-22T05:18:40.117225+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.102746+0000","last_change":"2024-01-22T05:18:39.651466+0000","last_active":"2024-01-22T05:18:40.102746+0000","last_peered":"2024-01-22T05:18:40.102746+0000","last_clean":"2024-01-22T05:18:40.102746+0000","last_became_active":"2024-01-22T05:18:39.650799+0000","last_became_peered":"2024-01-22T05:18:39.650799+0000","last_unstale":"2024-01-22T05:18:40.102746+0000","last_undegraded":"2024-01-22T05:18:40.102746+0000","last_fullsized":"2024-01-22T05:18:40.102746+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.119725+0000","last_change":"2024-01-22T05:18:40.112592+0000","last_active":"2024-01-22T05:18:40.119725+0000","last_peered":"2024-01-22T05:18:40.119725+0000","last_clean":"2024-01-22T05:18:40.119725+0000","last_became_active":"2024-01-22T05:18:40.112330+0000","last_became_peered":"2024-01-22T05:18:40.112330+0000","last_unstale":"2024-01-22T05:18:40.119725+0000","last_undegraded":"2024-01-22T05:18:40.119725+0000","last_fullsized":"2024-01-22T05:18:40.119725+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.086821+0000","last_change":"2024-01-22T05:18:39.643299+0000","last_active":"2024-01-22T05:18:40.086821+0000","last_peered":"2024-01-22T05:18:40.086821+0000","last_clean":"2024-01-22T05:18:40.086821+0000","last_became_active":"2024-01-22T05:18:39.642158+0000","last_became_peered":"2024-01-22T05:18:39.642158+0000","last_unstale":"2024-01-22T05:18:40.086821+0000","last_undegraded":"2024-01-22T05:18:40.086821+0000","last_fullsized":"2024-01-22T05:18:40.086821+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115859+0000","last_change":"2024-01-22T05:18:40.112326+0000","last_active":"2024-01-22T05:18:40.115859+0000","last_peered":"2024-01-22T05:18:40.115859+0000","last_clean":"2024-01-22T05:18:40.115859+0000","last_became_active":"2024-01-22T05:18:40.111170+0000","last_became_peered":"2024-01-22T05:18:40.111170+0000","last_unstale":"2024-01-22T05:18:40.115859+0000","last_undegraded":"2024-01-22T05:18:40.115859+0000","last_fullsized":"2024-01-22T05:18:40.115859+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.113034+0000","last_change":"2024-01-22T05:18:39.644133+0000","last_active":"2024-01-22T05:18:40.113034+0000","last_peered":"2024-01-22T05:18:40.113034+0000","last_clean":"2024-01-22T05:18:40.113034+0000","last_became_active":"2024-01-22T05:18:39.636375+0000","last_became_peered":"2024-01-22T05:18:39.636375+0000","last_unstale":"2024-01-22T05:18:40.113034+0000","last_undegraded":"2024-01-22T05:18:40.113034+0000","last_fullsized":"2024-01-22T05:18:40.113034+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.090717+0000","last_change":"2024-01-22T05:18:40.089132+0000","last_active":"2024-01-22T05:18:40.090717+0000","last_peered":"2024-01-22T05:18:40.090717+0000","last_clean":"2024-01-22T05:18:40.090717+0000","last_became_active":"2024-01-22T05:18:40.088829+0000","last_became_peered":"2024-01-22T05:18:40.088829+0000","last_unstale":"2024-01-22T05:18:40.090717+0000","last_undegraded":"2024-01-22T05:18:40.090717+0000","last_fullsized":"2024-01-22T05:18:40.090717+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.093806+0000","last_change":"2024-01-22T05:18:39.643888+0000","last_active":"2024-01-22T05:18:40.093806+0000","last_peered":"2024-01-22T05:18:40.093806+0000","last_clean":"2024-01-22T05:18:40.093806+0000","last_became_active":"2024-01-22T05:18:39.643156+0000","last_became_peered":"2024-01-22T05:18:39.643156+0000","last_unstale":"2024-01-22T05:18:40.093806+0000","last_undegraded":"2024-01-22T05:18:40.093806+0000","last_fullsized":"2024-01-22T05:18:40.093806+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.119447+0000","last_change":"2024-01-22T05:18:40.111926+0000","last_active":"2024-01-22T05:18:40.119447+0000","last_peered":"2024-01-22T05:18:40.119447+0000","last_clean":"2024-01-22T05:18:40.119447+0000","last_became_active":"2024-01-22T05:18:40.111155+0000","last_became_peered":"2024-01-22T05:18:40.111155+0000","last_unstale":"2024-01-22T05:18:40.119447+0000","last_undegraded":"2024-01-22T05:18:40.119447+0000","last_fullsized":"2024-01-22T05:18:40.119447+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.092983+0000","last_change":"2024-01-22T05:18:39.631758+0000","last_active":"2024-01-22T05:18:40.092983+0000","last_peered":"2024-01-22T05:18:40.092983+0000","last_clean":"2024-01-22T05:18:40.092983+0000","last_became_active":"2024-01-22T05:18:39.630549+0000","last_became_peered":"2024-01-22T05:18:39.630549+0000","last_unstale":"2024-01-22T05:18:40.092983+0000","last_undegraded":"2024-01-22T05:18:40.092983+0000","last_fullsized":"2024-01-22T05:18:40.092983+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.111478+0000","last_change":"2024-01-22T05:18:40.105296+0000","last_active":"2024-01-22T05:18:40.111478+0000","last_peered":"2024-01-22T05:18:40.111478+0000","last_clean":"2024-01-22T05:18:40.111478+0000","last_became_active":"2024-01-22T05:18:40.101340+0000","last_became_peered":"2024-01-22T05:18:40.101340+0000","last_unstale":"2024-01-22T05:18:40.111478+0000","last_undegraded":"2024-01-22T05:18:40.111478+0000","last_fullsized":"2024-01-22T05:18:40.111478+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.091388+0000","last_change":"2024-01-22T05:18:39.641272+0000","last_active":"2024-01-22T05:18:40.091388+0000","last_peered":"2024-01-22T05:18:40.091388+0000","last_clean":"2024-01-22T05:18:40.091388+0000","last_became_active":"2024-01-22T05:18:39.640728+0000","last_became_peered":"2024-01-22T05:18:39.640728+0000","last_unstale":"2024-01-22T05:18:40.091388+0000","last_undegraded":"2024-01-22T05:18:40.091388+0000","last_fullsized":"2024-01-22T05:18:40.091388+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.105112+0000","last_change":"2024-01-22T05:18:40.102850+0000","last_active":"2024-01-22T05:18:40.105112+0000","last_peered":"2024-01-22T05:18:40.105112+0000","last_clean":"2024-01-22T05:18:40.105112+0000","last_became_active":"2024-01-22T05:18:40.102416+0000","last_became_peered":"2024-01-22T05:18:40.102416+0000","last_unstale":"2024-01-22T05:18:40.105112+0000","last_undegraded":"2024-01-22T05:18:40.105112+0000","last_fullsized":"2024-01-22T05:18:40.105112+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"171'2","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.112650+0000","last_change":"2024-01-22T05:18:39.646150+0000","last_active":"2024-01-22T05:18:40.112650+0000","last_peered":"2024-01-22T05:18:40.112650+0000","last_clean":"2024-01-22T05:18:40.112650+0000","last_became_active":"2024-01-22T05:18:39.645801+0000","last_became_peered":"2024-01-22T05:18:39.645801+0000","last_unstale":"2024-01-22T05:18:40.112650+0000","last_undegraded":"2024-01-22T05:18:40.112650+0000","last_fullsized":"2024-01-22T05:18:40.112650+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.118237+0000","last_change":"2024-01-22T05:18:40.113099+0000","last_active":"2024-01-22T05:18:40.118237+0000","last_peered":"2024-01-22T05:18:40.118237+0000","last_clean":"2024-01-22T05:18:40.118237+0000","last_became_active":"2024-01-22T05:18:40.112665+0000","last_became_peered":"2024-01-22T05:18:40.112665+0000","last_unstale":"2024-01-22T05:18:40.118237+0000","last_undegraded":"2024-01-22T05:18:40.118237+0000","last_fullsized":"2024-01-22T05:18:40.118237+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.098937+0000","last_change":"2024-01-22T05:18:39.656479+0000","last_active":"2024-01-22T05:18:40.098937+0000","last_peered":"2024-01-22T05:18:40.098937+0000","last_clean":"2024-01-22T05:18:40.098937+0000","last_became_active":"2024-01-22T05:18:39.656203+0000","last_became_peered":"2024-01-22T05:18:39.656203+0000","last_unstale":"2024-01-22T05:18:40.098937+0000","last_undegraded":"2024-01-22T05:18:40.098937+0000","last_fullsized":"2024-01-22T05:18:40.098937+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.102269+0000","last_change":"2024-01-22T05:18:40.096149+0000","last_active":"2024-01-22T05:18:40.102269+0000","last_peered":"2024-01-22T05:18:40.102269+0000","last_clean":"2024-01-22T05:18:40.102269+0000","last_became_active":"2024-01-22T05:18:40.095863+0000","last_became_peered":"2024-01-22T05:18:40.095863+0000","last_unstale":"2024-01-22T05:18:40.102269+0000","last_undegraded":"2024-01-22T05:18:40.102269+0000","last_fullsized":"2024-01-22T05:18:40.102269+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.097992+0000","last_change":"2024-01-22T05:18:39.655539+0000","last_active":"2024-01-22T05:18:40.097992+0000","last_peered":"2024-01-22T05:18:40.097992+0000","last_clean":"2024-01-22T05:18:40.097992+0000","last_became_active":"2024-01-22T05:18:39.655204+0000","last_became_peered":"2024-01-22T05:18:39.655204+0000","last_unstale":"2024-01-22T05:18:40.097992+0000","last_undegraded":"2024-01-22T05:18:40.097992+0000","last_fullsized":"2024-01-22T05:18:40.097992+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115485+0000","last_change":"2024-01-22T05:18:40.108827+0000","last_active":"2024-01-22T05:18:40.115485+0000","last_peered":"2024-01-22T05:18:40.115485+0000","last_clean":"2024-01-22T05:18:40.115485+0000","last_became_active":"2024-01-22T05:18:40.108551+0000","last_became_peered":"2024-01-22T05:18:40.108551+0000","last_unstale":"2024-01-22T05:18:40.115485+0000","last_undegraded":"2024-01-22T05:18:40.115485+0000","last_fullsized":"2024-01-22T05:18:40.115485+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.085486+0000","last_change":"2024-01-22T05:18:39.653334+0000","last_active":"2024-01-22T05:18:40.085486+0000","last_peered":"2024-01-22T05:18:40.085486+0000","last_clean":"2024-01-22T05:18:40.085486+0000","last_became_active":"2024-01-22T05:18:39.651733+0000","last_became_peered":"2024-01-22T05:18:39.651733+0000","last_unstale":"2024-01-22T05:18:40.085486+0000","last_undegraded":"2024-01-22T05:18:40.085486+0000","last_fullsized":"2024-01-22T05:18:40.085486+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115359+0000","last_change":"2024-01-22T05:18:40.112715+0000","last_active":"2024-01-22T05:18:40.115359+0000","last_peered":"2024-01-22T05:18:40.115359+0000","last_clean":"2024-01-22T05:18:40.115359+0000","last_became_active":"2024-01-22T05:18:40.112319+0000","last_became_peered":"2024-01-22T05:18:40.112319+0000","last_unstale":"2024-01-22T05:18:40.115359+0000","last_undegraded":"2024-01-22T05:18:40.115359+0000","last_fullsized":"2024-01-22T05:18:40.115359+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.091584+0000","last_change":"2024-01-22T05:18:39.635661+0000","last_active":"2024-01-22T05:18:40.091584+0000","last_peered":"2024-01-22T05:18:40.091584+0000","last_clean":"2024-01-22T05:18:40.091584+0000","last_became_active":"2024-01-22T05:18:39.635383+0000","last_became_peered":"2024-01-22T05:18:39.635383+0000","last_unstale":"2024-01-22T05:18:40.091584+0000","last_undegraded":"2024-01-22T05:18:40.091584+0000","last_fullsized":"2024-01-22T05:18:40.091584+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116589+0000","last_change":"2024-01-22T05:18:40.113796+0000","last_active":"2024-01-22T05:18:40.116589+0000","last_peered":"2024-01-22T05:18:40.116589+0000","last_clean":"2024-01-22T05:18:40.116589+0000","last_became_active":"2024-01-22T05:18:40.113434+0000","last_became_peered":"2024-01-22T05:18:40.113434+0000","last_unstale":"2024-01-22T05:18:40.116589+0000","last_undegraded":"2024-01-22T05:18:40.116589+0000","last_fullsized":"2024-01-22T05:18:40.116589+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.094215+0000","last_change":"2024-01-22T05:18:39.623208+0000","last_active":"2024-01-22T05:18:40.094215+0000","last_peered":"2024-01-22T05:18:40.094215+0000","last_clean":"2024-01-22T05:18:40.094215+0000","last_became_active":"2024-01-22T05:18:39.622890+0000","last_became_peered":"2024-01-22T05:18:39.622890+0000","last_unstale":"2024-01-22T05:18:40.094215+0000","last_undegraded":"2024-01-22T05:18:40.094215+0000","last_fullsized":"2024-01-22T05:18:40.094215+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.119465+0000","last_change":"2024-01-22T05:18:40.112108+0000","last_active":"2024-01-22T05:18:40.119465+0000","last_peered":"2024-01-22T05:18:40.119465+0000","last_clean":"2024-01-22T05:18:40.119465+0000","last_became_active":"2024-01-22T05:18:40.111487+0000","last_became_peered":"2024-01-22T05:18:40.111487+0000","last_unstale":"2024-01-22T05:18:40.119465+0000","last_undegraded":"2024-01-22T05:18:40.119465+0000","last_fullsized":"2024-01-22T05:18:40.119465+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.104380+0000","last_change":"2024-01-22T05:18:39.635821+0000","last_active":"2024-01-22T05:18:40.104380+0000","last_peered":"2024-01-22T05:18:40.104380+0000","last_clean":"2024-01-22T05:18:40.104380+0000","last_became_active":"2024-01-22T05:18:39.635470+0000","last_became_peered":"2024-01-22T05:18:39.635470+0000","last_unstale":"2024-01-22T05:18:40.104380+0000","last_undegraded":"2024-01-22T05:18:40.104380+0000","last_fullsized":"2024-01-22T05:18:40.104380+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.125800+0000","last_change":"2024-01-22T05:18:40.123491+0000","last_active":"2024-01-22T05:18:40.125800+0000","last_peered":"2024-01-22T05:18:40.125800+0000","last_clean":"2024-01-22T05:18:40.125800+0000","last_became_active":"2024-01-22T05:18:40.123181+0000","last_became_peered":"2024-01-22T05:18:40.123181+0000","last_unstale":"2024-01-22T05:18:40.125800+0000","last_undegraded":"2024-01-22T05:18:40.125800+0000","last_fullsized":"2024-01-22T05:18:40.125800+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.091868+0000","last_change":"2024-01-22T05:18:39.643208+0000","last_active":"2024-01-22T05:18:40.091868+0000","last_peered":"2024-01-22T05:18:40.091868+0000","last_clean":"2024-01-22T05:18:40.091868+0000","last_became_active":"2024-01-22T05:18:39.635672+0000","last_became_peered":"2024-01-22T05:18:39.635672+0000","last_unstale":"2024-01-22T05:18:40.091868+0000","last_undegraded":"2024-01-22T05:18:40.091868+0000","last_fullsized":"2024-01-22T05:18:40.091868+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.102761+0000","last_change":"2024-01-22T05:18:40.100554+0000","last_active":"2024-01-22T05:18:40.102761+0000","last_peered":"2024-01-22T05:18:40.102761+0000","last_clean":"2024-01-22T05:18:40.102761+0000","last_became_active":"2024-01-22T05:18:40.100277+0000","last_became_peered":"2024-01-22T05:18:40.100277+0000","last_unstale":"2024-01-22T05:18:40.102761+0000","last_undegraded":"2024-01-22T05:18:40.102761+0000","last_fullsized":"2024-01-22T05:18:40.102761+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"171'2","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.119207+0000","last_change":"2024-01-22T05:18:39.646024+0000","last_active":"2024-01-22T05:18:40.119207+0000","last_peered":"2024-01-22T05:18:40.119207+0000","last_clean":"2024-01-22T05:18:40.119207+0000","last_became_active":"2024-01-22T05:18:39.645738+0000","last_became_peered":"2024-01-22T05:18:39.645738+0000","last_unstale":"2024-01-22T05:18:40.119207+0000","last_undegraded":"2024-01-22T05:18:40.119207+0000","last_fullsized":"2024-01-22T05:18:40.119207+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":140,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.100025+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:18:40.100025+0000","last_peered":"2024-01-22T05:18:40.100025+0000","last_clean":"2024-01-22T05:18:40.100025+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:18:40.100025+0000","last_undegraded":"2024-01-22T05:18:40.100025+0000","last_fullsized":"2024-01-22T05:18:40.100025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.104836+0000","last_change":"2024-01-22T05:18:40.098979+0000","last_active":"2024-01-22T05:18:40.104836+0000","last_peered":"2024-01-22T05:18:40.104836+0000","last_clean":"2024-01-22T05:18:40.104836+0000","last_became_active":"2024-01-22T05:18:40.098688+0000","last_became_peered":"2024-01-22T05:18:40.098688+0000","last_unstale":"2024-01-22T05:18:40.104836+0000","last_undegraded":"2024-01-22T05:18:40.104836+0000","last_fullsized":"2024-01-22T05:18:40.104836+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.103598+0000","last_change":"2024-01-22T05:18:39.648849+0000","last_active":"2024-01-22T05:18:40.103598+0000","last_peered":"2024-01-22T05:18:40.103598+0000","last_clean":"2024-01-22T05:18:40.103598+0000","last_became_active":"2024-01-22T05:18:39.648547+0000","last_became_peered":"2024-01-22T05:18:39.648547+0000","last_unstale":"2024-01-22T05:18:40.103598+0000","last_undegraded":"2024-01-22T05:18:40.103598+0000","last_fullsized":"2024-01-22T05:18:40.103598+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":144,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.094719+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:18:40.094719+0000","last_peered":"2024-01-22T05:18:40.094719+0000","last_clean":"2024-01-22T05:18:40.094719+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:18:40.094719+0000","last_undegraded":"2024-01-22T05:18:40.094719+0000","last_fullsized":"2024-01-22T05:18:40.094719+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.116282+0000","last_change":"2024-01-22T05:18:40.108699+0000","last_active":"2024-01-22T05:18:40.116282+0000","last_peered":"2024-01-22T05:18:40.116282+0000","last_clean":"2024-01-22T05:18:40.116282+0000","last_became_active":"2024-01-22T05:18:40.108431+0000","last_became_peered":"2024-01-22T05:18:40.108431+0000","last_unstale":"2024-01-22T05:18:40.116282+0000","last_undegraded":"2024-01-22T05:18:40.116282+0000","last_fullsized":"2024-01-22T05:18:40.116282+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.117398+0000","last_change":"2024-01-22T05:18:39.648930+0000","last_active":"2024-01-22T05:18:40.117398+0000","last_peered":"2024-01-22T05:18:40.117398+0000","last_clean":"2024-01-22T05:18:40.117398+0000","last_became_active":"2024-01-22T05:18:39.648631+0000","last_became_peered":"2024-01-22T05:18:39.648631+0000","last_unstale":"2024-01-22T05:18:40.117398+0000","last_undegraded":"2024-01-22T05:18:40.117398+0000","last_fullsized":"2024-01-22T05:18:40.117398+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":135,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.102834+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:18:40.102834+0000","last_peered":"2024-01-22T05:18:40.102834+0000","last_clean":"2024-01-22T05:18:40.102834+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:18:40.102834+0000","last_undegraded":"2024-01-22T05:18:40.102834+0000","last_fullsized":"2024-01-22T05:18:40.102834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.121635+0000","last_change":"2024-01-22T05:18:40.113859+0000","last_active":"2024-01-22T05:18:40.121635+0000","last_peered":"2024-01-22T05:18:40.121635+0000","last_clean":"2024-01-22T05:18:40.121635+0000","last_became_active":"2024-01-22T05:18:40.113531+0000","last_became_peered":"2024-01-22T05:18:40.113531+0000","last_unstale":"2024-01-22T05:18:40.121635+0000","last_undegraded":"2024-01-22T05:18:40.121635+0000","last_fullsized":"2024-01-22T05:18:40.121635+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"171'1","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.107152+0000","last_change":"2024-01-22T05:18:39.644256+0000","last_active":"2024-01-22T05:18:40.107152+0000","last_peered":"2024-01-22T05:18:40.107152+0000","last_clean":"2024-01-22T05:18:40.107152+0000","last_became_active":"2024-01-22T05:18:39.643899+0000","last_became_peered":"2024-01-22T05:18:39.643899+0000","last_unstale":"2024-01-22T05:18:40.107152+0000","last_undegraded":"2024-01-22T05:18:40.107152+0000","last_fullsized":"2024-01-22T05:18:40.107152+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.093102+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:18:40.093102+0000","last_peered":"2024-01-22T05:18:40.093102+0000","last_clean":"2024-01-22T05:18:40.093102+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:18:40.093102+0000","last_undegraded":"2024-01-22T05:18:40.093102+0000","last_fullsized":"2024-01-22T05:18:40.093102+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.109823+0000","last_change":"2024-01-22T05:18:40.107389+0000","last_active":"2024-01-22T05:18:40.109823+0000","last_peered":"2024-01-22T05:18:40.109823+0000","last_clean":"2024-01-22T05:18:40.109823+0000","last_became_active":"2024-01-22T05:18:40.106966+0000","last_became_peered":"2024-01-22T05:18:40.106966+0000","last_unstale":"2024-01-22T05:18:40.109823+0000","last_undegraded":"2024-01-22T05:18:40.109823+0000","last_fullsized":"2024-01-22T05:18:40.109823+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.095571+0000","last_change":"2024-01-22T05:18:39.644098+0000","last_active":"2024-01-22T05:18:40.095571+0000","last_peered":"2024-01-22T05:18:40.095571+0000","last_clean":"2024-01-22T05:18:40.095571+0000","last_became_active":"2024-01-22T05:18:39.643472+0000","last_became_peered":"2024-01-22T05:18:39.643472+0000","last_unstale":"2024-01-22T05:18:40.095571+0000","last_undegraded":"2024-01-22T05:18:40.095571+0000","last_fullsized":"2024-01-22T05:18:40.095571+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":164,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.094294+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:18:40.094294+0000","last_peered":"2024-01-22T05:18:40.094294+0000","last_clean":"2024-01-22T05:18:40.094294+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:18:40.094294+0000","last_undegraded":"2024-01-22T05:18:40.094294+0000","last_fullsized":"2024-01-22T05:18:40.094294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.115840+0000","last_change":"2024-01-22T05:18:40.110862+0000","last_active":"2024-01-22T05:18:40.115840+0000","last_peered":"2024-01-22T05:18:40.115840+0000","last_clean":"2024-01-22T05:18:40.115840+0000","last_became_active":"2024-01-22T05:18:40.110598+0000","last_became_peered":"2024-01-22T05:18:40.110598+0000","last_unstale":"2024-01-22T05:18:40.115840+0000","last_undegraded":"2024-01-22T05:18:40.115840+0000","last_fullsized":"2024-01-22T05:18:40.115840+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.100355+0000","last_change":"2024-01-22T05:18:39.645719+0000","last_active":"2024-01-22T05:18:40.100355+0000","last_peered":"2024-01-22T05:18:40.100355+0000","last_clean":"2024-01-22T05:18:40.100355+0000","last_became_active":"2024-01-22T05:18:39.645401+0000","last_became_peered":"2024-01-22T05:18:39.645401+0000","last_unstale":"2024-01-22T05:18:40.100355+0000","last_undegraded":"2024-01-22T05:18:40.100355+0000","last_fullsized":"2024-01-22T05:18:40.100355+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":143,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.098480+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:18:40.098480+0000","last_peered":"2024-01-22T05:18:40.098480+0000","last_clean":"2024-01-22T05:18:40.098480+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:18:40.098480+0000","last_undegraded":"2024-01-22T05:18:40.098480+0000","last_fullsized":"2024-01-22T05:18:40.098480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.114928+0000","last_change":"2024-01-22T05:18:40.108121+0000","last_active":"2024-01-22T05:18:40.114928+0000","last_peered":"2024-01-22T05:18:40.114928+0000","last_clean":"2024-01-22T05:18:40.114928+0000","last_became_active":"2024-01-22T05:18:40.107861+0000","last_became_peered":"2024-01-22T05:18:40.107861+0000","last_unstale":"2024-01-22T05:18:40.114928+0000","last_undegraded":"2024-01-22T05:18:40.114928+0000","last_fullsized":"2024-01-22T05:18:40.114928+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.083689+0000","last_change":"2024-01-22T05:18:39.654778+0000","last_active":"2024-01-22T05:18:40.083689+0000","last_peered":"2024-01-22T05:18:40.083689+0000","last_clean":"2024-01-22T05:18:40.083689+0000","last_became_active":"2024-01-22T05:18:39.654503+0000","last_became_peered":"2024-01-22T05:18:39.654503+0000","last_unstale":"2024-01-22T05:18:40.083689+0000","last_undegraded":"2024-01-22T05:18:40.083689+0000","last_fullsized":"2024-01-22T05:18:40.083689+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.097129+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:18:40.097129+0000","last_peered":"2024-01-22T05:18:40.097129+0000","last_clean":"2024-01-22T05:18:40.097129+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:18:40.097129+0000","last_undegraded":"2024-01-22T05:18:40.097129+0000","last_fullsized":"2024-01-22T05:18:40.097129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.125038+0000","last_change":"2024-01-22T05:18:40.122120+0000","last_active":"2024-01-22T05:18:40.125038+0000","last_peered":"2024-01-22T05:18:40.125038+0000","last_clean":"2024-01-22T05:18:40.125038+0000","last_became_active":"2024-01-22T05:18:40.121866+0000","last_became_peered":"2024-01-22T05:18:40.121866+0000","last_unstale":"2024-01-22T05:18:40.125038+0000","last_undegraded":"2024-01-22T05:18:40.125038+0000","last_fullsized":"2024-01-22T05:18:40.125038+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:39.594369+0000","last_clean_scrub_stamp":"2024-01-22T05:18:39.594369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.103080+0000","last_change":"2024-01-22T05:18:39.643564+0000","last_active":"2024-01-22T05:18:40.103080+0000","last_peered":"2024-01-22T05:18:40.103080+0000","last_clean":"2024-01-22T05:18:40.103080+0000","last_became_active":"2024-01-22T05:18:39.643273+0000","last_became_peered":"2024-01-22T05:18:39.643273+0000","last_unstale":"2024-01-22T05:18:40.103080+0000","last_undegraded":"2024-01-22T05:18:40.103080+0000","last_fullsized":"2024-01-22T05:18:40.103080+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:18:38.578354+0000","last_clean_scrub_stamp":"2024-01-22T05:18:38.578354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":164,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.091568+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:18:40.091568+0000","last_peered":"2024-01-22T05:18:40.091568+0000","last_clean":"2024-01-22T05:18:40.091568+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:18:40.091568+0000","last_undegraded":"2024-01-22T05:18:40.091568+0000","last_fullsized":"2024-01-22T05:18:40.091568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-01-22T05:18:40.097245+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:18:40.097245+0000","last_peered":"2024-01-22T05:18:40.097245+0000","last_clean":"2024-01-22T05:18:40.097245+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:18:40.097245+0000","last_undegraded":"2024-01-22T05:18:40.097245+0000","last_fullsized":"2024-01-22T05:18:40.097245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575021,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307520,"kb_used_data":2104,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064320,"statfs":{"total":96636764160,"available":96321863680,"internally_reserved":0,"allocated":2154496,"data_stored":1071446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:17:57 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.21,"15min":1.0669999999999999},"min":{"1min":0.73799999999999999,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.9590000000000001,"5min":14.779999999999999,"15min":14.779999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":2.0049999999999999,"15min":1.369},"min":{"1min":0.76100000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":3.7789999999999999,"5min":76.662000000000006,"15min":76.662000000000006},"last":1.0620000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:17:57 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.1559999999999999,"15min":1.0469999999999999},"min":{"1min":0.70999999999999996,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.657,"5min":4.9269999999999996,"15min":4.9269999999999996},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.3,"15min":1.2050000000000001},"min":{"1min":0.81399999999999995,"5min":0.71599999999999997,"15min":0.58999999999999997},"max":{"1min":3.6040000000000001,"5min":12.691000000000001,"15min":12.691000000000001},"last":0.96699999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:17:57 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.157,"15min":1.123},"min":{"1min":0.88300000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.5150000000000001},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.337,"15min":1.2150000000000001},"min":{"1min":0.95399999999999996,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.3199999999999998,"5min":15.036,"15min":15.036},"last":1.3169999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:17:57 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.919,"15min":1.448},"min":{"1min":0.95399999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7030000000000001,"5min":64.983999999999995,"15min":64.983999999999995},"last":1.165},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.413,"15min":1.292},"min":{"1min":1.1000000000000001,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":2.2770000000000001,"5min":15.073,"15min":15.073},"last":1.383}]},{"osd":4,"last update":"Mon Jan 22 05:17:57 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.4179999999999999,"15min":1.1819999999999999},"min":{"1min":0.876,"5min":0.53000000000000003,"15min":0.32900000000000001},"max":{"1min":3.1840000000000002,"5min":22.239000000000001,"15min":22.239000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.282,"5min":1.502,"15min":1.2589999999999999},"min":{"1min":0.94399999999999995,"5min":0.68799999999999994,"15min":0.52200000000000002},"max":{"1min":1.7949999999999999,"5min":27.872,"15min":27.872},"last":1.2709999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:17:57 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.9870000000000001,"15min":1.448},"min":{"1min":0.85599999999999998,"5min":0.67400000000000004,"15min":0.40400000000000003},"max":{"1min":2.3530000000000002,"5min":65.652000000000001,"15min":65.652000000000001},"last":1.226},{"interface":"front","average":{"1min":1.377,"5min":1.3169999999999999,"15min":1.274},"min":{"1min":1.0700000000000001,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":1.7629999999999999,"5min":2.1629999999999998,"15min":3.625},"last":1.4239999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:17:57 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3460000000000001,"15min":1.256},"min":{"1min":0.94099999999999995,"5min":0.80700000000000005,"15min":0.53400000000000003},"max":{"1min":3.3439999999999999,"5min":6.9939999999999998,"15min":6.9939999999999998},"last":1.194},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.522,"15min":1.403},"min":{"1min":1.1080000000000001,"5min":0.82999999999999996,"15min":0.56100000000000005},"max":{"1min":2.1219999999999999,"5min":12.965,"15min":12.965},"last":1.486}]}]},{"osd":6,"up_from":13,"seq":55834575021,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307528,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064312,"statfs":{"total":96636764160,"available":96321855488,"internally_reserved":0,"allocated":2162688,"data_stored":1078131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0409999999999999,"15min":1.286},"min":{"1min":0.89700000000000002,"5min":0.66600000000000004,"15min":0.35999999999999999},"max":{"1min":1.466,"5min":1.5740000000000001,"15min":77.745000000000005},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.081,"15min":1.075},"min":{"1min":0.79500000000000004,"5min":0.57499999999999996,"15min":0.44},"max":{"1min":1.74,"5min":5.0359999999999996,"15min":13.555999999999999},"last":1.1040000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:18:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1020000000000001,"15min":1.1180000000000001},"min":{"1min":0.73299999999999998,"5min":0.56999999999999995,"15min":0.40000000000000002},"max":{"1min":1.554,"5min":5.9210000000000003,"15min":15.499000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1060000000000001,"15min":1.1579999999999999},"min":{"1min":0.78300000000000003,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.46,"5min":1.702,"15min":7.7629999999999999},"last":1.054}]},{"osd":2,"last update":"Mon Jan 22 05:18:01 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1930000000000001,"15min":1.1619999999999999},"min":{"1min":0.95399999999999996,"5min":0.82699999999999996,"15min":0.57399999999999995},"max":{"1min":1.4590000000000001,"5min":1.667,"15min":3.0960000000000001},"last":1.262},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2070000000000001,"15min":1.1419999999999999},"min":{"1min":0.90600000000000003,"5min":0.68999999999999995,"15min":0.38200000000000001},"max":{"1min":1.522,"5min":4.9660000000000002,"15min":4.9660000000000002},"last":0.96799999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:18:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2110000000000001,"15min":1.48},"min":{"1min":0.90200000000000002,"5min":0.66700000000000004,"15min":0.59299999999999997},"max":{"1min":1.444,"5min":5.0750000000000002,"15min":102.08199999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.1659999999999999,"15min":1.2150000000000001},"min":{"1min":0.82499999999999996,"5min":0.66300000000000003,"15min":0.374},"max":{"1min":1.4770000000000001,"5min":2.9620000000000002,"15min":15.468},"last":1.3879999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:18:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.224,"15min":1.143},"min":{"1min":0.72599999999999998,"5min":0.71699999999999997,"15min":0.495},"max":{"1min":1.5529999999999999,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.2549999999999999,"15min":1.1579999999999999},"min":{"1min":0.88900000000000001,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.865,"5min":5.1200000000000001,"15min":5.1200000000000001},"last":1.234}]},{"osd":5,"last update":"Mon Jan 22 05:18:01 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.155,"15min":1.2410000000000001},"min":{"1min":0.873,"5min":0.58699999999999997,"15min":0.48099999999999998},"max":{"1min":1.4179999999999999,"5min":2.9100000000000001,"15min":30.533000000000001},"last":1.198},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.282,"15min":1.2729999999999999},"min":{"1min":0.90800000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.718,"5min":1.804,"15min":3.875},"last":1.3360000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:18:01 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.4570000000000001,"15min":1.429},"min":{"1min":0.94499999999999995,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":2.0009999999999999,"5min":8.4190000000000005,"15min":23.547999999999998},"last":1.474},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.4059999999999999,"15min":1.5569999999999999},"min":{"1min":0.86899999999999999,"5min":0.77700000000000002,"15min":0.495},"max":{"1min":1.6559999999999999,"5min":7.46,"15min":63.737000000000002},"last":1.55}]}]},{"osd":5,"up_from":13,"seq":55834575021,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307528,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064312,"statfs":{"total":96636764160,"available":96321855488,"internally_reserved":0,"allocated":2162688,"data_stored":1077647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.018,"15min":1.01},"min":{"1min":0.66500000000000004,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.5369999999999999,"5min":1.651,"15min":2.0609999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0489999999999999,"15min":1.048},"min":{"1min":0.78100000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4350000000000001,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.84999999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:18:05 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.218,"15min":1.1879999999999999},"min":{"1min":0.70299999999999996,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.744,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.1910000000000001,"15min":1.2070000000000001},"min":{"1min":0.78800000000000003,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.694,"5min":1.9930000000000001,"15min":2.0209999999999999},"last":1.5329999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1339999999999999,"15min":1.133},"min":{"1min":0.90100000000000002,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.4430000000000001,"5min":1.9219999999999999,"15min":1.925},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.1419999999999999,"15min":1.1200000000000001},"min":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.59899999999999998},"max":{"1min":1.456,"5min":1.982,"15min":1.982},"last":1.0149999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:18:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.1919999999999999,"15min":1.1599999999999999},"min":{"1min":0.95799999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4510000000000001,"5min":3.202,"15min":3.202},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.22,"5min":1.1830000000000001,"15min":1.2150000000000001},"min":{"1min":0.77600000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":4.8819999999999997},"last":1.474}]},{"osd":4,"last update":"Mon Jan 22 05:18:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1120000000000001,"15min":1.107},"min":{"1min":0.82399999999999995,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.579,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1890000000000001},"min":{"1min":0.77600000000000002,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.589,"5min":2.081,"15min":2.081},"last":1.214}]},{"osd":6,"last update":"Mon Jan 22 05:18:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.214,"15min":1.228},"min":{"1min":0.88600000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.776,"5min":2.0099999999999998,"15min":2.2010000000000001},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2470000000000001,"15min":1.2490000000000001},"min":{"1min":0.94899999999999995,"5min":0.69599999999999995,"15min":0.55900000000000005},"max":{"1min":1.6719999999999999,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.2709999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:18:05 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3069999999999999,"15min":1.3140000000000001},"min":{"1min":0.95299999999999996,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.8069999999999999,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.46},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.335,"15min":1.3460000000000001},"min":{"1min":1.1140000000000001,"5min":0.72699999999999998,"15min":0.60799999999999998},"max":{"1min":1.8859999999999999,"5min":2.04,"15min":3.1840000000000002},"last":1.583}]}]},{"osd":4,"up_from":13,"seq":55834575021,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299348,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072492,"statfs":{"total":96636764160,"available":96330231808,"internally_reserved":0,"allocated":2174976,"data_stored":1079667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:17:50 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0980000000000001,"15min":1.1000000000000001},"min":{"1min":0.71099999999999997,"5min":0.63700000000000001,"15min":0.47799999999999998},"max":{"1min":1.569,"5min":1.696,"15min":2.0150000000000001},"last":1.206},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1839999999999999,"15min":1.1379999999999999},"min":{"1min":0.75700000000000001,"5min":0.68300000000000005,"15min":0.48899999999999999},"max":{"1min":1.5429999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.94599999999999995}]},{"osd":1,"last update":"Mon Jan 22 05:17:50 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0669999999999999,"15min":1.071},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.53100000000000003},"max":{"1min":1.5249999999999999,"5min":1.6759999999999999,"15min":1.7609999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.0449999999999999,"15min":1.081},"min":{"1min":0.69199999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.1440000000000001,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":1.1120000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:17:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0609999999999999,"15min":1.0740000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.49199999999999999},"max":{"1min":1.3089999999999999,"5min":1.516,"15min":5.3390000000000004},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.151,"5min":1.1459999999999999,"15min":1.1679999999999999},"min":{"1min":0.71099999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5009999999999999,"5min":1.6140000000000001,"15min":2.3479999999999999},"last":0.96699999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:17:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.143,"15min":1.1379999999999999},"min":{"1min":0.69799999999999995,"5min":0.65700000000000003,"15min":0.496},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.149,"15min":1.147},"min":{"1min":0.73899999999999999,"5min":0.66200000000000003,"15min":0.53100000000000003},"max":{"1min":1.407,"5min":2.2959999999999998,"15min":5.3029999999999999},"last":1.141}]},{"osd":5,"last update":"Mon Jan 22 05:17:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1140000000000001,"15min":1.1279999999999999},"min":{"1min":0.63500000000000001,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.581,"5min":1.6899999999999999,"15min":2.0790000000000002},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.1819999999999999,"15min":1.129},"min":{"1min":0.70099999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.518,"5min":1.8240000000000001,"15min":2.0030000000000001},"last":1.0229999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:17:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1459999999999999,"15min":1.149},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.44500000000000001},"max":{"1min":1.304,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.272,"15min":1.2829999999999999},"min":{"1min":0.91100000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.617,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":1.3899999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:17:50 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.343,"15min":1.3120000000000001},"min":{"1min":0.74099999999999999,"5min":0.62,"15min":0.59399999999999997},"max":{"1min":1.5920000000000001,"5min":1.9119999999999999,"15min":2.2839999999999998},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.3089999999999999,"15min":1.3200000000000001},"min":{"1min":0.89300000000000002,"5min":0.88800000000000001,"15min":0.56899999999999995},"max":{"1min":1.516,"5min":1.843,"15min":5.2629999999999999},"last":1.2869999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575021,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303436,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068404,"statfs":{"total":96636764160,"available":96326045696,"internally_reserved":0,"allocated":2166784,"data_stored":1077701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.77500000000000002,"15min":0.86099999999999999},"min":{"1min":0.58899999999999997,"5min":0.41099999999999998,"15min":0.34200000000000003},"max":{"1min":1.3540000000000001,"5min":1.512,"15min":14.859},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.877,"15min":0.89700000000000002},"min":{"1min":0.51600000000000001,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":1.6879999999999999,"5min":1.804,"15min":5.0919999999999996},"last":0.86899999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.873,"15min":0.89600000000000002},"min":{"1min":0.65900000000000003,"5min":0.42399999999999999,"15min":0.39300000000000002},"max":{"1min":1.466,"5min":1.466,"15min":6.5570000000000004},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.94299999999999995,"15min":0.96999999999999997},"min":{"1min":0.79300000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.361,"5min":1.7669999999999999,"15min":5.7519999999999998},"last":1.024}]},{"osd":2,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0720000000000001,"15min":1.111},"min":{"1min":0.65800000000000003,"5min":0.48599999999999999,"15min":0.40600000000000003},"max":{"1min":1.5940000000000001,"5min":1.8680000000000001,"15min":2.391},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.1200000000000001,"15min":1.1779999999999999},"min":{"1min":0.72099999999999997,"5min":0.59199999999999997,"15min":0.44800000000000001},"max":{"1min":1.625,"5min":1.6259999999999999,"15min":4.1429999999999998},"last":1.46}]},{"osd":4,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3029999999999999,"15min":1.325},"min":{"1min":1.1559999999999999,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.6619999999999999,"5min":2.423,"15min":10.858000000000001},"last":1.234},{"interface":"front","average":{"1min":1.399,"5min":1.2749999999999999,"15min":1.337},"min":{"1min":1.1259999999999999,"5min":0.75600000000000001,"15min":0.63600000000000001},"max":{"1min":1.728,"5min":2.3359999999999999,"15min":10.846},"last":1.546}]},{"osd":5,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.24,"15min":1.2849999999999999},"min":{"1min":1.069,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.5249999999999999,"5min":1.9910000000000001,"15min":7.3639999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.286,"15min":1.3759999999999999},"min":{"1min":0.88200000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.649,"5min":6.3220000000000001,"15min":14.523999999999999},"last":1.6739999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.3580000000000001,"15min":1.363},"min":{"1min":1.022,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.698,"5min":2.1819999999999999,"15min":4.9809999999999999},"last":1.3},{"interface":"front","average":{"1min":1.425,"5min":1.367,"15min":1.3879999999999999},"min":{"1min":1.1399999999999999,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.667,"5min":1.883,"15min":5.4210000000000003},"last":1.8340000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3,"15min":1.359},"min":{"1min":1.028,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.599,"5min":1.986,"15min":5.7160000000000002},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3560000000000001,"15min":1.4079999999999999},"min":{"1min":1.133,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9470000000000001,"5min":2.5449999999999999,"15min":6.4279999999999999},"last":1.488}]}]},{"osd":2,"up_from":13,"seq":55834575021,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315724,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":94056116,"statfs":{"total":96636764160,"available":96313462784,"internally_reserved":0,"allocated":2166784,"data_stored":1077689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.76800000000000002,"15min":0.76400000000000001},"min":{"1min":0.621,"5min":0.378,"15min":0.378},"max":{"1min":1.373,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.84499999999999997,"15min":0.85099999999999998},"min":{"1min":0.64000000000000001,"5min":0.44600000000000001,"15min":0.373},"max":{"1min":1.1819999999999999,"5min":1.556,"15min":1.7350000000000001},"last":1.028}]},{"osd":1,"last update":"Mon Jan 22 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.89400000000000002,"15min":0.85899999999999999},"min":{"1min":0.60499999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.573,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.05,"5min":0.97199999999999998,"15min":0.94799999999999995},"min":{"1min":0.73899999999999999,"5min":0.43099999999999999,"15min":0.41599999999999998},"max":{"1min":1.496,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.671}]},{"osd":3,"last update":"Mon Jan 22 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.1379999999999999,"15min":1.127},"min":{"1min":0.69499999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6459999999999999,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2070000000000001,"15min":1.204},"min":{"1min":0.83499999999999996,"5min":0.53900000000000003,"15min":0.51100000000000001},"max":{"1min":1.554,"5min":3.133,"15min":3.133},"last":1.3460000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.2829999999999999,"15min":1.2709999999999999},"min":{"1min":0.95099999999999996,"5min":0.88500000000000001,"15min":0.59099999999999997},"max":{"1min":1.7270000000000001,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.206,"15min":1.198},"min":{"1min":0.84099999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.732,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.5800000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.232,"15min":1.2170000000000001},"min":{"1min":0.94399999999999995,"5min":0.70799999999999996,"15min":0.63800000000000001},"max":{"1min":1.6379999999999999,"5min":2.379,"15min":2.379},"last":1.8120000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.302,"15min":1.284},"min":{"1min":1.125,"5min":0.76100000000000001,"15min":0.67000000000000004},"max":{"1min":1.7769999999999999,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.774}]},{"osd":6,"last update":"Mon Jan 22 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.2430000000000001,"15min":1.248},"min":{"1min":0.88,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.6870000000000001,"5min":1.7749999999999999,"15min":2.1920000000000002},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.3160000000000001,"15min":1.304},"min":{"1min":0.91100000000000003,"5min":0.629,"15min":0.629},"max":{"1min":1.7,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.7110000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3460000000000001,"15min":1.3440000000000001},"min":{"1min":0.92300000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4059999999999999,"15min":1.4099999999999999},"min":{"1min":1.0209999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.762,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":2.0019999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575022,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311632,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060208,"statfs":{"total":96636764160,"available":96317652992,"internally_reserved":0,"allocated":2170880,"data_stored":1078291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:17:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.85199999999999998,"15min":0.86899999999999999},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":3.4119999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.96999999999999997,"15min":0.99399999999999999},"min":{"1min":0.64200000000000002,"5min":0.48599999999999999,"15min":0.41099999999999998},"max":{"1min":1.6160000000000001,"5min":1.6850000000000001,"15min":2.101},"last":1.119}]},{"osd":2,"last update":"Mon Jan 22 05:17:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.98899999999999999,"15min":0.99199999999999999},"min":{"1min":0.58299999999999996,"5min":0.49399999999999999,"15min":0.45500000000000002},"max":{"1min":1.3799999999999999,"5min":1.512,"15min":2.169},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0780000000000001,"15min":1.052},"min":{"1min":0.73899999999999999,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.46,"5min":2.024,"15min":2.024},"last":0.84199999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:17:51 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.034,"15min":1.034},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.38900000000000001},"max":{"1min":1.972,"5min":1.972,"15min":4.665},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.90700000000000003,"15min":0.93799999999999994},"min":{"1min":0.55200000000000005,"5min":0.45000000000000001,"15min":0.41899999999999998},"max":{"1min":1.659,"5min":1.659,"15min":5.5830000000000002},"last":0.67700000000000005}]},{"osd":4,"last update":"Mon Jan 22 05:17:51 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.204,"15min":1.25},"min":{"1min":0.873,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.724,"5min":1.958,"15min":15.76},"last":1.143},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2669999999999999,"15min":1.3260000000000001},"min":{"1min":0.91000000000000003,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.673,"5min":1.9630000000000001,"15min":16.975000000000001},"last":1.0529999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:17:51 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.2609999999999999,"15min":1.23},"min":{"1min":0.72599999999999998,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.536,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.88500000000000001,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8340000000000001,"5min":2.2730000000000001,"15min":2.52},"last":1.0249999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:17:51 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2430000000000001,"15min":1.26},"min":{"1min":0.77400000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.496,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.321,"15min":1.3320000000000001},"min":{"1min":0.82099999999999995,"5min":0.71899999999999997,"15min":0.68799999999999994},"max":{"1min":2.008,"5min":2.222,"15min":2.5569999999999999},"last":1.073}]},{"osd":7,"last update":"Mon Jan 22 05:17:51 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.321,"15min":1.353},"min":{"1min":1.0600000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.8200000000000001,"5min":1.8999999999999999,"15min":4.4329999999999998},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.248,"5min":1.333,"15min":1.3520000000000001},"min":{"1min":0.81100000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.6739999999999999,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":1.1779999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575021,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311624,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060216,"statfs":{"total":96636764160,"available":96317661184,"internally_reserved":0,"allocated":2162688,"data_stored":1077599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.84699999999999998,"15min":0.89900000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.28699999999999998},"max":{"1min":1.361,"5min":1.452,"15min":15.273},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88600000000000001,"15min":0.92200000000000004},"min":{"1min":0.60499999999999998,"5min":0.5,"15min":0.34499999999999997},"max":{"1min":1.1279999999999999,"5min":1.698,"15min":4.4009999999999998},"last":0.68700000000000006}]},{"osd":2,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.002,"15min":1.0569999999999999},"min":{"1min":0.60299999999999998,"5min":0.53200000000000003,"15min":0.46400000000000002},"max":{"1min":1.6080000000000001,"5min":1.6459999999999999,"15min":15.473000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.0389999999999999,"15min":1.0249999999999999},"min":{"1min":0.72799999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6850000000000001,"5min":1.794,"15min":1.7989999999999999},"last":1.075}]},{"osd":3,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96899999999999997,"15min":0.98599999999999999},"min":{"1min":0.64500000000000002,"5min":0.54800000000000004,"15min":0.39000000000000001},"max":{"1min":1.417,"5min":1.5049999999999999,"15min":5.3970000000000002},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.1539999999999999,"15min":1.1890000000000001},"min":{"1min":0.63400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":1.5189999999999999,"5min":2.2349999999999999,"15min":15.439},"last":0.83999999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2270000000000001,"15min":1.258},"min":{"1min":0.999,"5min":0.66200000000000003,"15min":0.61399999999999999},"max":{"1min":1.7090000000000001,"5min":1.986,"15min":5.1799999999999997},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.2310000000000001,"15min":1.22},"min":{"1min":0.95999999999999996,"5min":0.59399999999999997,"15min":0.56200000000000006},"max":{"1min":1.6220000000000001,"5min":1.738,"15min":3.4340000000000002},"last":1.113}]},{"osd":5,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2829999999999999,"15min":1.282},"min":{"1min":0.94999999999999996,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6459999999999999,"5min":1.9099999999999999,"15min":3.548},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.337,"15min":1.3340000000000001},"min":{"1min":0.89700000000000002,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.6140000000000001,"5min":1.8009999999999999,"15min":2.823},"last":1.587}]},{"osd":6,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.363,"15min":1.4179999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.59099999999999997},"max":{"1min":1.681,"5min":1.8740000000000001,"15min":15.4},"last":1.232},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.389},"min":{"1min":1.0349999999999999,"5min":0.85699999999999998,"15min":0.72499999999999998},"max":{"1min":1.6990000000000001,"5min":2.105,"15min":7.1349999999999998},"last":1.1679999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:17:47 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.411,"15min":1.4470000000000001},"min":{"1min":1.125,"5min":0.95499999999999996,"15min":0.79900000000000004},"max":{"1min":1.78,"5min":2.1819999999999999,"15min":5.29},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.3819999999999999,"15min":1.375},"min":{"1min":1.034,"5min":1.002,"15min":0.752},"max":{"1min":1.8169999999999999,"5min":2.0470000000000002,"15min":2.7269999999999999},"last":1.21}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:18:45.124 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:18:45.124 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-22T05:18:45.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.333+0000 7f19bc800700 1 Processor -- start 2024-01-22T05:18:45.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.337+0000 7f19bc800700 1 -- start start 2024-01-22T05:18:45.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19bc800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b4153cf0 0x7f19b40c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:45.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19bc800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f19b40bcba0 0x7f19b4068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19bc800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b4068280 con 0x7f19b40c1ac0 2024-01-22T05:18:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19bc800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b40c1f00 con 0x7f19b40bcba0 2024-01-22T05:18:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19bc800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40bd190 con 0x7f19b4153cf0 2024-01-22T05:18:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b9400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f19b40c1ac0 0x7f19b40bc490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55612/0 (socket says 172.21.15.49:55612) 2024-01-22T05:18:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b9400700 1 -- 172.21.15.49:0/1177376671 learned_addr learned my addr 172.21.15.49:0/1177376671 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b9e00700 1 --2- 172.21.15.49:0/1177376671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b4153cf0 0x7f19b40c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19ba800700 1 --2- 172.21.15.49:0/1177376671 >> v2:172.21.15.110:3300/0 conn(0x7f19b40bcba0 0x7f19b4068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 -- 172.21.15.49:0/1177376671 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833951461 0 0) 0x7f19b4068280 con 0x7f19b40c1ac0 2024-01-22T05:18:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 -- 172.21.15.49:0/1177376671 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19940033f0 con 0x7f19b40c1ac0 2024-01-22T05:18:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 -- 172.21.15.49:0/1177376671 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 821887248 0 0) 0x7f19940033f0 con 0x7f19b40c1ac0 2024-01-22T05:18:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 -- 172.21.15.49:0/1177376671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b4153cf0 msgr2=0x7f19b40c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 --2- 172.21.15.49:0/1177376671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b4153cf0 0x7f19b40c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 -- 172.21.15.49:0/1177376671 >> v2:172.21.15.110:3300/0 conn(0x7f19b40bcba0 msgr2=0x7f19b4068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 --2- 172.21.15.49:0/1177376671 >> v2:172.21.15.110:3300/0 conn(0x7f19b40bcba0 0x7f19b4068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 -- 172.21.15.49:0/1177376671 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4067c30 con 0x7f19b40c1ac0 2024-01-22T05:18:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 -- 172.21.15.49:0/1177376671 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f199c0015f0 con 0x7f19b40c1ac0 2024-01-22T05:18:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 -- 172.21.15.49:0/1177376671 >> v1:172.21.15.49:6789/0 conn(0x7f19b40c1ac0 legacy=0x7f19b40bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 --2- 172.21.15.49:0/1177376671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19940038e0 0x7f1994003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 --2- 172.21.15.49:0/1177376671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b4153cf0 0x7f1994004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 --2- 172.21.15.49:0/1177376671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1994004b80 0x7f1994005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 -- 172.21.15.49:0/1177376671 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40c1f00 con 0x7f1994004b80 2024-01-22T05:18:45.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 -- 172.21.15.49:0/1177376671 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40bd190 con 0x7f19940038e0 2024-01-22T05:18:45.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b8a00700 1 -- 172.21.15.49:0/1177376671 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199400b8e0 con 0x7f19b4153cf0 2024-01-22T05:18:45.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b9e00700 1 --2- 172.21.15.49:0/1177376671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19940038e0 0x7f1994003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:45.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b9400700 1 --2- 172.21.15.49:0/1177376671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b4153cf0 0x7f1994004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:45.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19ba800700 1 --2- 172.21.15.49:0/1177376671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1994004b80 0x7f1994005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:45.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b9e00700 1 -- 172.21.15.49:0/1177376671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b4153cf0 msgr2=0x7f1994004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:45.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b9e00700 1 --2- 172.21.15.49:0/1177376671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b4153cf0 0x7f1994004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b9e00700 1 -- 172.21.15.49:0/1177376671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1994004b80 msgr2=0x7f1994005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:45.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b9e00700 1 --2- 172.21.15.49:0/1177376671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1994004b80 0x7f1994005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.341+0000 7f19b9e00700 1 -- 172.21.15.49:0/1177376671 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19940033f0 con 0x7f19940038e0 2024-01-22T05:18:45.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.345+0000 7f19b9e00700 1 --2- 172.21.15.49:0/1177376671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19940038e0 0x7f1994003d00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f19a4009a80 tx=0x7f19a4009060).ready entity=mon.1 client_cookie=3c14065a9d0b283b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:45.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.345+0000 7f19b8a00700 1 -- 172.21.15.49:0/1177376671 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4009430 con 0x7f19940038e0 2024-01-22T05:18:45.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.345+0000 7f19b8a00700 1 -- 172.21.15.49:0/1177376671 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a400e640 con 0x7f19940038e0 2024-01-22T05:18:45.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.345+0000 7f19b8a00700 1 -- 172.21.15.49:0/1177376671 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a400e9c0 con 0x7f19940038e0 2024-01-22T05:18:45.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.345+0000 7f19bc800700 1 -- 172.21.15.49:0/1177376671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19940038e0 msgr2=0x7f1994003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:45.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.345+0000 7f19bc800700 1 --2- 172.21.15.49:0/1177376671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19940038e0 0x7f1994003d00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f19a4009a80 tx=0x7f19a4009060).stop 2024-01-22T05:18:45.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.345+0000 7f19ba800700 1 -- 172.21.15.49:0/1177376671 reap_dead start 2024-01-22T05:18:45.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.345+0000 7f19bc800700 1 -- 172.21.15.49:0/1177376671 shutdown_connections 2024-01-22T05:18:45.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.345+0000 7f19bc800700 1 -- 172.21.15.49:0/1177376671 >> 172.21.15.49:0/1177376671 conn(0x7f19b4062cb0 msgr2=0x7f19b40c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:45.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.345+0000 7f19bc800700 1 -- 172.21.15.49:0/1177376671 shutdown_connections 2024-01-22T05:18:45.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.345+0000 7f19bc800700 1 -- 172.21.15.49:0/1177376671 wait complete. 2024-01-22T05:18:45.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.349+0000 7f19bc800700 1 Processor -- start 2024-01-22T05:18:45.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.349+0000 7f19bc800700 1 -- start start 2024-01-22T05:18:45.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19bc800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19940038e0 0x7f19b40a8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:45.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19bc800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19b40a4d30 0x7f19b41500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:45.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19bc800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b41505d0 0x7f19b40a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:45.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19bc800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40bc990 con 0x7f19940038e0 2024-01-22T05:18:45.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19bc800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40a48a0 con 0x7f19b40a4d30 2024-01-22T05:18:45.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19bc800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40a3c90 con 0x7f19b41505d0 2024-01-22T05:18:45.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19b9e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19940038e0 0x7f19b40a8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:45.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19b9e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19940038e0 0x7f19b40a8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39184/0 (socket says 172.21.15.49:39184) 2024-01-22T05:18:45.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19b9e00700 1 -- 172.21.15.49:0/697202021 learned_addr learned my addr 172.21.15.49:0/697202021 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:45.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19b9400700 1 --2- 172.21.15.49:0/697202021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19b40a4d30 0x7f19b41500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:45.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19ba800700 1 --2- 172.21.15.49:0/697202021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b41505d0 0x7f19b40a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:45.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19b9e00700 1 -- 172.21.15.49:0/697202021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b41505d0 msgr2=0x7f19b40a99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:45.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19b9e00700 1 --2- 172.21.15.49:0/697202021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b41505d0 0x7f19b40a99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19b9e00700 1 -- 172.21.15.49:0/697202021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19b40a4d30 msgr2=0x7f19b41500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:45.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19b9e00700 1 --2- 172.21.15.49:0/697202021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19b40a4d30 0x7f19b41500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19b9e00700 1 -- 172.21.15.49:0/697202021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b40a3f70 con 0x7f19940038e0 2024-01-22T05:18:45.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19b9e00700 1 --2- 172.21.15.49:0/697202021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19940038e0 0x7f19b40a8110 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f1994004510 tx=0x7f19a401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:45.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19b1600700 1 -- 172.21.15.49:0/697202021 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4009ec0 con 0x7f19940038e0 2024-01-22T05:18:45.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19b1600700 1 -- 172.21.15.49:0/697202021 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a400ed30 con 0x7f19940038e0 2024-01-22T05:18:45.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19bc800700 1 -- 172.21.15.49:0/697202021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b40a4250 con 0x7f19940038e0 2024-01-22T05:18:45.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.353+0000 7f19b1600700 1 -- 172.21.15.49:0/697202021 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a400eea0 con 0x7f19940038e0 2024-01-22T05:18:45.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.357+0000 7f19bc800700 1 -- 172.21.15.49:0/697202021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b40a8600 con 0x7f19940038e0 2024-01-22T05:18:45.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.357+0000 7f19bc800700 1 -- 172.21.15.49:0/697202021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b40c0c00 con 0x7f19940038e0 2024-01-22T05:18:45.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.357+0000 7f19b1600700 1 -- 172.21.15.49:0/697202021 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f19a402f440 con 0x7f19940038e0 2024-01-22T05:18:45.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.361+0000 7f19b1600700 1 --2- 172.21.15.49:0/697202021 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f198c05a540 0x7f198c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:45.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.361+0000 7f19b1600700 1 -- 172.21.15.49:0/697202021 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f19a4076410 con 0x7f19940038e0 2024-01-22T05:18:45.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.361+0000 7f19b9400700 1 --2- 172.21.15.49:0/697202021 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f198c05a540 0x7f198c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:45.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.361+0000 7f19b9400700 1 --2- 172.21.15.49:0/697202021 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f198c05a540 0x7f198c05ca00 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f199c002eb0 tx=0x7f199c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:45.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.365+0000 7f19b1600700 1 -- 172.21.15.49:0/697202021 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f19a4049a30 con 0x7f19940038e0 2024-01-22T05:18:45.571 INFO:tasks.ceph.mds.b.smithi110.stderr:2024-01-22T05:18:45.563+0000 7f61c0a00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:18:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.585+0000 7f19bc800700 1 -- 172.21.15.49:0/697202021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f19b4067f10 con 0x7f19940038e0 2024-01-22T05:18:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.593+0000 7f19b1600700 1 -- 172.21.15.49:0/697202021 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+0 (secure 0 0 0) 0x7f19a4016020 con 0x7f19940038e0 2024-01-22T05:18:45.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.601+0000 7f19bc800700 1 -- 172.21.15.49:0/697202021 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f198c05a540 msgr2=0x7f198c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:45.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.601+0000 7f19bc800700 1 --2- 172.21.15.49:0/697202021 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f198c05a540 0x7f198c05ca00 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f199c002eb0 tx=0x7f199c009040).stop 2024-01-22T05:18:45.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.601+0000 7f19bc800700 1 -- 172.21.15.49:0/697202021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19940038e0 msgr2=0x7f19b40a8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:45.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.601+0000 7f19bc800700 1 --2- 172.21.15.49:0/697202021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19940038e0 0x7f19b40a8110 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f1994004510 tx=0x7f19a401a000).stop 2024-01-22T05:18:45.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.601+0000 7f19bc800700 1 -- 172.21.15.49:0/697202021 shutdown_connections 2024-01-22T05:18:45.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.601+0000 7f19bc800700 1 --2- 172.21.15.49:0/697202021 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f198c05a540 0x7f198c05ca00 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.601+0000 7f19bc800700 1 --2- 172.21.15.49:0/697202021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b41505d0 0x7f19b40a99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.601+0000 7f19bc800700 1 --2- 172.21.15.49:0/697202021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19b40a4d30 0x7f19b41500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.601+0000 7f19bc800700 1 --2- 172.21.15.49:0/697202021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19940038e0 0x7f19b40a8110 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.601+0000 7f19bc800700 1 -- 172.21.15.49:0/697202021 >> 172.21.15.49:0/697202021 conn(0x7f19b4062cb0 msgr2=0x7f19b40c4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:45.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.601+0000 7f19bc800700 1 -- 172.21.15.49:0/697202021 shutdown_connections 2024-01-22T05:18:45.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.601+0000 7f19bc800700 1 -- 172.21.15.49:0/697202021 wait complete. 2024-01-22T05:18:45.606 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-01-22T05:18:45.628 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:18:45.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.785+0000 7f6e9ba00700 1 Processor -- start 2024-01-22T05:18:45.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.785+0000 7f6e9ba00700 1 -- start start 2024-01-22T05:18:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.789+0000 7f6e9ba00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e94155d20 0x7f6e94065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.789+0000 7f6e9ba00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6e94066070 0x7f6e940a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.789+0000 7f6e9ba00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e940a90e0 con 0x7f6e940a8c30 2024-01-22T05:18:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.789+0000 7f6e9ba00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e940c1a40 con 0x7f6e94066070 2024-01-22T05:18:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.789+0000 7f6e9ba00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94159310 con 0x7f6e94155d20 2024-01-22T05:18:45.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.789+0000 7f6e99a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6e940a8c30 0x7f6e940c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55626/0 (socket says 172.21.15.49:55626) 2024-01-22T05:18:45.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.789+0000 7f6e99a00700 1 -- 172.21.15.49:0/1338503286 learned_addr learned my addr 172.21.15.49:0/1338503286 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:45.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.789+0000 7f6e93e00700 1 --2- 172.21.15.49:0/1338503286 >> v2:172.21.15.110:3300/0 conn(0x7f6e94066070 0x7f6e940a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:45.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.789+0000 7f6e99000700 1 --2- 172.21.15.49:0/1338503286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e94155d20 0x7f6e94065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:45.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.789+0000 7f6e93400700 1 -- 172.21.15.49:0/1338503286 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386962982 0 0) 0x7f6e8c001490 con 0x7f6e940a8c30 2024-01-22T05:18:45.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.789+0000 7f6e93400700 1 -- 172.21.15.49:0/1338503286 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e740033f0 con 0x7f6e940a8c30 2024-01-22T05:18:45.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.789+0000 7f6e93e00700 1 -- 172.21.15.49:0/1338503286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e94155d20 msgr2=0x7f6e94065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:45.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.789+0000 7f6e93e00700 1 --2- 172.21.15.49:0/1338503286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e94155d20 0x7f6e94065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.789+0000 7f6e93e00700 1 -- 172.21.15.49:0/1338503286 >> v1:172.21.15.49:6789/0 conn(0x7f6e940a8c30 legacy=0x7f6e940c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:45.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.789+0000 7f6e93e00700 1 -- 172.21.15.49:0/1338503286 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e940c13f0 con 0x7f6e94066070 2024-01-22T05:18:45.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.793+0000 7f6e93e00700 1 --2- 172.21.15.49:0/1338503286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e94066070 0x7f6e940a8740 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f6e7c009760 tx=0x7f6e7c009060).ready entity=mon.1 client_cookie=703c4d5c4d066d9c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:45.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.793+0000 7f6e93400700 1 -- 172.21.15.49:0/1338503286 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c00d4a0 con 0x7f6e94066070 2024-01-22T05:18:45.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.793+0000 7f6e93400700 1 -- 172.21.15.49:0/1338503286 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c00d600 con 0x7f6e94066070 2024-01-22T05:18:45.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.793+0000 7f6e93400700 1 -- 172.21.15.49:0/1338503286 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c00d980 con 0x7f6e94066070 2024-01-22T05:18:45.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.793+0000 7f6e9ba00700 1 -- 172.21.15.49:0/1338503286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e94066070 msgr2=0x7f6e940a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:45.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.793+0000 7f6e9ba00700 1 --2- 172.21.15.49:0/1338503286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e94066070 0x7f6e940a8740 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f6e7c009760 tx=0x7f6e7c009060).stop 2024-01-22T05:18:45.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.793+0000 7f6e9ba00700 1 -- 172.21.15.49:0/1338503286 shutdown_connections 2024-01-22T05:18:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.793+0000 7f6e9ba00700 1 --2- 172.21.15.49:0/1338503286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e94066070 0x7f6e940a8740 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.793+0000 7f6e9ba00700 1 --2- 172.21.15.49:0/1338503286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e94155d20 0x7f6e94065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.793+0000 7f6e9ba00700 1 -- 172.21.15.49:0/1338503286 >> 172.21.15.49:0/1338503286 conn(0x7f6e940c6540 msgr2=0x7f6e940c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.793+0000 7f6e9ba00700 1 -- 172.21.15.49:0/1338503286 shutdown_connections 2024-01-22T05:18:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.793+0000 7f6e9ba00700 1 -- 172.21.15.49:0/1338503286 wait complete. 2024-01-22T05:18:45.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.797+0000 7f6e9ba00700 1 Processor -- start 2024-01-22T05:18:45.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.797+0000 7f6e9ba00700 1 -- start start 2024-01-22T05:18:45.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.797+0000 7f6e9ba00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e94066070 0x7f6e940bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:45.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.797+0000 7f6e9ba00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e940a8c30 0x7f6e94152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:45.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.797+0000 7f6e9ba00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e94155d20 0x7f6e94168960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:45.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.797+0000 7f6e9ba00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e940bf1d0 con 0x7f6e94155d20 2024-01-22T05:18:45.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.797+0000 7f6e9ba00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e940bf790 con 0x7f6e940a8c30 2024-01-22T05:18:45.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.797+0000 7f6e9ba00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e941694c0 con 0x7f6e94066070 2024-01-22T05:18:45.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e99a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e94155d20 0x7f6e94168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:45.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e99000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e94066070 0x7f6e940bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:45.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e99a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e94155d20 0x7f6e94168960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39188/0 (socket says 172.21.15.49:39188) 2024-01-22T05:18:45.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e99a00700 1 -- 172.21.15.49:0/833016323 learned_addr learned my addr 172.21.15.49:0/833016323 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:45.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e93e00700 1 --2- 172.21.15.49:0/833016323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e940a8c30 0x7f6e94152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e99a00700 1 -- 172.21.15.49:0/833016323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e94066070 msgr2=0x7f6e940bfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e99a00700 1 --2- 172.21.15.49:0/833016323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e94066070 0x7f6e940bfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e99a00700 1 -- 172.21.15.49:0/833016323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e940a8c30 msgr2=0x7f6e94152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e99a00700 1 --2- 172.21.15.49:0/833016323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e940a8c30 0x7f6e94152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e99a00700 1 -- 172.21.15.49:0/833016323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c0092a0 con 0x7f6e94155d20 2024-01-22T05:18:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e99a00700 1 --2- 172.21.15.49:0/833016323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e94155d20 0x7f6e94168960 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f6e8c00c840 tx=0x7f6e8c007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e8be00700 1 -- 172.21.15.49:0/833016323 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c005d30 con 0x7f6e94155d20 2024-01-22T05:18:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e8be00700 1 -- 172.21.15.49:0/833016323 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8c005e90 con 0x7f6e94155d20 2024-01-22T05:18:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e9ba00700 1 -- 172.21.15.49:0/833016323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e941697a0 con 0x7f6e94155d20 2024-01-22T05:18:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e8be00700 1 -- 172.21.15.49:0/833016323 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c007320 con 0x7f6e94155d20 2024-01-22T05:18:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.801+0000 7f6e9ba00700 1 -- 172.21.15.49:0/833016323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9415b150 con 0x7f6e94155d20 2024-01-22T05:18:45.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.805+0000 7f6e9ba00700 1 -- 172.21.15.49:0/833016323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e940bf920 con 0x7f6e94155d20 2024-01-22T05:18:45.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.805+0000 7f6e8be00700 1 -- 172.21.15.49:0/833016323 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6e8c007750 con 0x7f6e94155d20 2024-01-22T05:18:45.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.805+0000 7f6e8be00700 1 --2- 172.21.15.49:0/833016323 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e6c05a510 0x7f6e6c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:45.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.805+0000 7f6e8be00700 1 -- 172.21.15.49:0/833016323 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f6e8c074800 con 0x7f6e94155d20 2024-01-22T05:18:45.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.805+0000 7f6e99000700 1 --2- 172.21.15.49:0/833016323 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e6c05a510 0x7f6e6c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:45.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.809+0000 7f6e99000700 1 --2- 172.21.15.49:0/833016323 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e6c05a510 0x7f6e6c05c9d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f6e84009b90 tx=0x7f6e84009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:45.813+0000 7f6e8be00700 1 -- 172.21.15.49:0/833016323 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6e8c047dc0 con 0x7f6e94155d20 2024-01-22T05:18:46.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.021+0000 7f6e9ba00700 1 -- 172.21.15.49:0/833016323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e940a90e0 con 0x7f6e94155d20 2024-01-22T05:18:46.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.021+0000 7f6e8be00700 1 -- 172.21.15.49:0/833016323 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f6e940a90e0 con 0x7f6e94155d20 2024-01-22T05:18:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:46.025 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":134,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3995018890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3995018890},{"type":"v1","addr":"172.21.15.110:6833","nonce":3995018890}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2248654659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2248654659},{"type":"v1","addr":"172.21.15.49:6837","nonce":2248654659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931981528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1931981528},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931981528}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:18:40.076218+0000","modified":"2024-01-22T05:18:43.416474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9610":{"gid":9610,"name":"b","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/2192470330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2192470330},{"type":"v1","addr":"172.21.15.110:6835","nonce":2192470330}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2024-01-22T05:18:46.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.025+0000 7f6e9ba00700 1 -- 172.21.15.49:0/833016323 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e6c05a510 msgr2=0x7f6e6c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.025+0000 7f6e9ba00700 1 --2- 172.21.15.49:0/833016323 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e6c05a510 0x7f6e6c05c9d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f6e84009b90 tx=0x7f6e84009060).stop 2024-01-22T05:18:46.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.025+0000 7f6e9ba00700 1 -- 172.21.15.49:0/833016323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e94155d20 msgr2=0x7f6e94168960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.025+0000 7f6e9ba00700 1 --2- 172.21.15.49:0/833016323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e94155d20 0x7f6e94168960 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f6e8c00c840 tx=0x7f6e8c007e30).stop 2024-01-22T05:18:46.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.025+0000 7f6e9ba00700 1 -- 172.21.15.49:0/833016323 shutdown_connections 2024-01-22T05:18:46.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.025+0000 7f6e9ba00700 1 --2- 172.21.15.49:0/833016323 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e6c05a510 0x7f6e6c05c9d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.025+0000 7f6e9ba00700 1 --2- 172.21.15.49:0/833016323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e94155d20 0x7f6e94168960 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.025+0000 7f6e9ba00700 1 --2- 172.21.15.49:0/833016323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e940a8c30 0x7f6e94152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.025+0000 7f6e9ba00700 1 --2- 172.21.15.49:0/833016323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e94066070 0x7f6e940bfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.025+0000 7f6e9ba00700 1 -- 172.21.15.49:0/833016323 >> 172.21.15.49:0/833016323 conn(0x7f6e940c6540 msgr2=0x7f6e94067b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:46.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.025+0000 7f6e9ba00700 1 -- 172.21.15.49:0/833016323 shutdown_connections 2024-01-22T05:18:46.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.025+0000 7f6e9ba00700 1 -- 172.21.15.49:0/833016323 wait complete. 2024-01-22T05:18:46.033 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 134 2024-01-22T05:18:46.455 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 134, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:18:40.076218+0000', 'modified': '2024-01-22T05:18:43.416474+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9610}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9610': {'gid': 9610, 'name': 'b', 'rank': 0, 'incarnation': 130, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.110:6835/2192470330', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6834', 'nonce': 2192470330}, {'type': 'v1', 'addr': '172.21.15.110:6835', 'nonce': 2192470330}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:18:46.455 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:18:46.455 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-22T05:18:46.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.617+0000 7f441d600700 1 Processor -- start 2024-01-22T05:18:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.617+0000 7f441d600700 1 -- start start 2024-01-22T05:18:46.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.621+0000 7f441d600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44180644b0 0x7f44180bdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.621+0000 7f441d600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441815bb10 con 0x7f4418157dc0 2024-01-22T05:18:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.621+0000 7f441d600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441815c970 con 0x7f44181581a0 2024-01-22T05:18:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.621+0000 7f441d600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441815bd60 con 0x7f44180644b0 2024-01-22T05:18:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.621+0000 7f4416a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4418157dc0 0x7f4418063da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55628/0 (socket says 172.21.15.49:55628) 2024-01-22T05:18:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.621+0000 7f4416a00700 1 -- 172.21.15.49:0/795652097 learned_addr learned my addr 172.21.15.49:0/795652097 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.621+0000 7f4416000700 1 --2- 172.21.15.49:0/795652097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44180644b0 0x7f44180bdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.621+0000 7f4415600700 1 -- 172.21.15.49:0/795652097 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593512811 0 0) 0x7f441815bb10 con 0x7f4418157dc0 2024-01-22T05:18:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.621+0000 7f4415600700 1 -- 172.21.15.49:0/795652097 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43f80033f0 con 0x7f4418157dc0 2024-01-22T05:18:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 -- 172.21.15.49:0/795652097 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1323259514 0 0) 0x7f43f80033f0 con 0x7f4418157dc0 2024-01-22T05:18:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 -- 172.21.15.49:0/795652097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44180644b0 msgr2=0x7f44180bdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 --2- 172.21.15.49:0/795652097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44180644b0 0x7f44180bdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 -- 172.21.15.49:0/795652097 >> v1:172.21.15.110:6789/0 conn(0x7f44181581a0 legacy=0x7f44180bc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 -- 172.21.15.49:0/795652097 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441815c040 con 0x7f4418157dc0 2024-01-22T05:18:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 -- 172.21.15.49:0/795652097 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f4408001470 con 0x7f4418157dc0 2024-01-22T05:18:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 -- 172.21.15.49:0/795652097 >> v1:172.21.15.49:6789/0 conn(0x7f4418157dc0 legacy=0x7f4418063da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 --2- 172.21.15.49:0/795652097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43f8003910 0x7f43f8003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 --2- 172.21.15.49:0/795652097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43f8004690 0x7f43f8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 --2- 172.21.15.49:0/795652097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43f8005000 0x7f43f800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 -- 172.21.15.49:0/795652097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441815bd60 con 0x7f43f8003910 2024-01-22T05:18:46.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 -- 172.21.15.49:0/795652097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f800beb0 con 0x7f43f8005000 2024-01-22T05:18:46.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 -- 172.21.15.49:0/795652097 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f800c070 con 0x7f43f8004690 2024-01-22T05:18:46.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4416a00700 1 --2- 172.21.15.49:0/795652097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43f8003910 0x7f43f8003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4416000700 1 --2- 172.21.15.49:0/795652097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43f8004690 0x7f43f8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4417400700 1 --2- 172.21.15.49:0/795652097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43f8005000 0x7f43f800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4416a00700 1 -- 172.21.15.49:0/795652097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43f8004690 msgr2=0x7f43f8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4416a00700 1 --2- 172.21.15.49:0/795652097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43f8004690 0x7f43f8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4416a00700 1 -- 172.21.15.49:0/795652097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43f8005000 msgr2=0x7f43f800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4416a00700 1 --2- 172.21.15.49:0/795652097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43f8005000 0x7f43f800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4416a00700 1 -- 172.21.15.49:0/795652097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f80033f0 con 0x7f43f8003910 2024-01-22T05:18:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4417400700 1 --2- 172.21.15.49:0/795652097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43f8005000 0x7f43f800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4416a00700 1 --2- 172.21.15.49:0/795652097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43f8003910 0x7f43f8003d30 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f440800c190 tx=0x7f4408001e50).ready entity=mon.0 client_cookie=d3342b70bf53d17 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 -- 172.21.15.49:0/795652097 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408007a20 con 0x7f43f8003910 2024-01-22T05:18:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 -- 172.21.15.49:0/795652097 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440800cac0 con 0x7f43f8003910 2024-01-22T05:18:46.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4415600700 1 -- 172.21.15.49:0/795652097 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440800ce40 con 0x7f43f8003910 2024-01-22T05:18:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f441d600700 1 -- 172.21.15.49:0/795652097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43f8003910 msgr2=0x7f43f8003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f441d600700 1 --2- 172.21.15.49:0/795652097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43f8003910 0x7f43f8003d30 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f440800c190 tx=0x7f4408001e50).stop 2024-01-22T05:18:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.625+0000 7f4417400700 1 -- 172.21.15.49:0/795652097 reap_dead start 2024-01-22T05:18:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.629+0000 7f441d600700 1 -- 172.21.15.49:0/795652097 shutdown_connections 2024-01-22T05:18:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.629+0000 7f441d600700 1 -- 172.21.15.49:0/795652097 >> 172.21.15.49:0/795652097 conn(0x7f44180c40c0 msgr2=0x7f44180c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.629+0000 7f441d600700 1 -- 172.21.15.49:0/795652097 shutdown_connections 2024-01-22T05:18:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.629+0000 7f441d600700 1 -- 172.21.15.49:0/795652097 wait complete. 2024-01-22T05:18:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.629+0000 7f441d600700 1 Processor -- start 2024-01-22T05:18:46.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f441d600700 1 -- start start 2024-01-22T05:18:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f441d600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43f8003910 0x7f44180aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f441d600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44180ad050 0x7f441816c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f441d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4418167d70 0x7f44181681f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f441d600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441816cbb0 con 0x7f4418167d70 2024-01-22T05:18:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f441d600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44180aab90 con 0x7f43f8003910 2024-01-22T05:18:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f441d600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44180ac570 con 0x7f44180ad050 2024-01-22T05:18:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f4417400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4418167d70 0x7f44181681f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f4417400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4418167d70 0x7f44181681f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39202/0 (socket says 172.21.15.49:39202) 2024-01-22T05:18:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f4417400700 1 -- 172.21.15.49:0/2857897489 learned_addr learned my addr 172.21.15.49:0/2857897489 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f4416a00700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43f8003910 0x7f44180aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f4416000700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44180ad050 0x7f441816c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f4417400700 1 -- 172.21.15.49:0/2857897489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44180ad050 msgr2=0x7f441816c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f4417400700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44180ad050 0x7f441816c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f4417400700 1 -- 172.21.15.49:0/2857897489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43f8003910 msgr2=0x7f44180aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f4417400700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43f8003910 0x7f44180aa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f4417400700 1 -- 172.21.15.49:0/2857897489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44180ac850 con 0x7f4418167d70 2024-01-22T05:18:46.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f4416000700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44180ad050 0x7f441816c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:46.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f4416a00700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43f8003910 0x7f44180aa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:46.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f4417400700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4418167d70 0x7f44181681f0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7f4410000f80 tx=0x7f4410009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:46.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.633+0000 7f440e000700 1 -- 172.21.15.49:0/2857897489 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410010520 con 0x7f4418167d70 2024-01-22T05:18:46.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.637+0000 7f440e000700 1 -- 172.21.15.49:0/2857897489 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4410010680 con 0x7f4418167d70 2024-01-22T05:18:46.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.637+0000 7f441d600700 1 -- 172.21.15.49:0/2857897489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44180acb30 con 0x7f4418167d70 2024-01-22T05:18:46.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.637+0000 7f440e000700 1 -- 172.21.15.49:0/2857897489 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410010a20 con 0x7f4418167d70 2024-01-22T05:18:46.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.637+0000 7f441d600700 1 -- 172.21.15.49:0/2857897489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44180c5690 con 0x7f4418167d70 2024-01-22T05:18:46.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.641+0000 7f440e000700 1 -- 172.21.15.49:0/2857897489 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4410003070 con 0x7f4418167d70 2024-01-22T05:18:46.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.641+0000 7f440e000700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f43f005a540 0x7f43f005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.641+0000 7f440e000700 1 -- 172.21.15.49:0/2857897489 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f4410074240 con 0x7f4418167d70 2024-01-22T05:18:46.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.641+0000 7f4416a00700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f43f005a540 0x7f43f005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.641+0000 7f4416a00700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f43f005a540 0x7f43f005ca00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f440800ca90 tx=0x7f4408015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:46.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.641+0000 7f4427a91740 1 Processor -- start 2024-01-22T05:18:46.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4427a91740 1 -- start start 2024-01-22T05:18:46.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4427a91740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x271e3a0 0x2702d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4427a91740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26dde40 0x26d9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4427a91740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e780 0x26d73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4427a91740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x265d410 con 0x271e3a0 2024-01-22T05:18:46.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4427a91740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x265d550 con 0x271e780 2024-01-22T05:18:46.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4427a91740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x265da00 con 0x26dde40 2024-01-22T05:18:46.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4416a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x271e3a0 0x2702d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4416000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26dde40 0x26d9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4416a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x271e3a0 0x2702d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39212/0 (socket says 172.21.15.49:39212) 2024-01-22T05:18:46.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4416a00700 1 -- 172.21.15.49:0/4120648659 learned_addr learned my addr 172.21.15.49:0/4120648659 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:46.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4417400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e780 0x26d73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4417400700 1 -- 172.21.15.49:0/4120648659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26dde40 msgr2=0x26d9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:46.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4417400700 1 --2- 172.21.15.49:0/4120648659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26dde40 0x26d9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4417400700 1 -- 172.21.15.49:0/4120648659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x271e3a0 msgr2=0x2702d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:46.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4417400700 1 --2- 172.21.15.49:0/4120648659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x271e3a0 0x2702d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.645+0000 7f4417400700 1 -- 172.21.15.49:0/4120648659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2656730 con 0x271e780 2024-01-22T05:18:46.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.649+0000 7f4417400700 1 --2- 172.21.15.49:0/4120648659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e780 0x26d73a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f4410007dc0 tx=0x7f4410011000).ready entity=mon.1 client_cookie=97372720eef99931 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:46.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.649+0000 7f4406600700 1 -- 172.21.15.49:0/4120648659 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44100740d0 con 0x271e780 2024-01-22T05:18:46.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.649+0000 7f4406600700 1 -- 172.21.15.49:0/4120648659 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4410054070 con 0x271e780 2024-01-22T05:18:46.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.649+0000 7f4406600700 1 -- 172.21.15.49:0/4120648659 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441004b520 con 0x271e780 2024-01-22T05:18:46.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.649+0000 7f4427a91740 1 -- 172.21.15.49:0/4120648659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e780 msgr2=0x26d73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.649+0000 7f4427a91740 1 --2- 172.21.15.49:0/4120648659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e780 0x26d73a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f4410007dc0 tx=0x7f4410011000).stop 2024-01-22T05:18:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.649+0000 7f4427a91740 1 -- 172.21.15.49:0/4120648659 shutdown_connections 2024-01-22T05:18:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.649+0000 7f4427a91740 1 --2- 172.21.15.49:0/4120648659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e780 0x26d73a0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.649+0000 7f4427a91740 1 --2- 172.21.15.49:0/4120648659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x26dde40 0x26d9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.649+0000 7f4427a91740 1 --2- 172.21.15.49:0/4120648659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x271e3a0 0x2702d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.649+0000 7f4427a91740 1 -- 172.21.15.49:0/4120648659 >> 172.21.15.49:0/4120648659 conn(0x24bb550 msgr2=0x26dd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:46.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.649+0000 7f4427a91740 1 -- 172.21.15.49:0/4120648659 shutdown_connections 2024-01-22T05:18:46.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.649+0000 7f4427a91740 1 -- 172.21.15.49:0/4120648659 wait complete. 2024-01-22T05:18:46.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.649+0000 7f4427a91740 1 -- start start 2024-01-22T05:18:46.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4427a91740 1 Processor -- start 2024-01-22T05:18:46.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4427a91740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26dde40 0x27216d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4427a91740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e3a0 0x271dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4427a91740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e780 0x2705c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4427a91740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2628650 con 0x26dde40 2024-01-22T05:18:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4427a91740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2709320 con 0x271e780 2024-01-22T05:18:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4427a91740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2733e30 con 0x271e3a0 2024-01-22T05:18:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4427a91740 10 client.0 ll_register_callbacks cb 0x2695020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:18:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4416a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26dde40 0x27216d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4416000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e3a0 0x271dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4417400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e780 0x2705c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4416000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e3a0 0x271dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:48516/0 (socket says 172.21.15.49:48516) 2024-01-22T05:18:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4417400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e780 0x2705c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:60234/0 (socket says 172.21.15.49:60234) 2024-01-22T05:18:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4416000700 1 -- 172.21.15.49:0/2844488262 learned_addr learned my addr 172.21.15.49:0/2844488262 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:46.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4417400700 1 -- 172.21.15.49:0/2844488262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e3a0 msgr2=0x271dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:46.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4417400700 1 --2- 172.21.15.49:0/2844488262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e3a0 0x271dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4417400700 1 -- 172.21.15.49:0/2844488262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26dde40 msgr2=0x27216d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:46.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4417400700 1 --2- 172.21.15.49:0/2844488262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26dde40 0x27216d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.653+0000 7f4417400700 1 -- 172.21.15.49:0/2844488262 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44180c5690 con 0x271e780 2024-01-22T05:18:46.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f4417400700 1 --2- 172.21.15.49:0/2844488262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e780 0x2705c20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f441004b4b0 tx=0x7f4410054000).ready entity=mon.1 client_cookie=6667417af05c8fd7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f43fea00700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-01-22T05:18:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f43fea00700 1 -- 172.21.15.49:0/2844488262 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410002280 con 0x271e780 2024-01-22T05:18:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f43fea00700 1 -- 172.21.15.49:0/2844488262 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f44100023e0 con 0x271e780 2024-01-22T05:18:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f4427a91740 1 -- 172.21.15.49:0/2844488262 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x26531a0 con 0x271e780 2024-01-22T05:18:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f43fea00700 1 -- 172.21.15.49:0/2844488262 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7f441004aa70 con 0x271e780 2024-01-22T05:18:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f4427a91740 10 client.9754 fetch_fsmap learned FSMap version 134 2024-01-22T05:18:46.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f4427a91740 1 -- 172.21.15.49:0/2844488262 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=2+}) v3 -- 0x2651960 con 0x271e780 2024-01-22T05:18:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f43fea00700 1 -- 172.21.15.49:0/2844488262 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x26531a0 con 0x271e780 2024-01-22T05:18:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f43fea00700 1 -- 172.21.15.49:0/2844488262 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 134) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4410047370 con 0x271e780 2024-01-22T05:18:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f4427a91740 10 client.9754 fetch_fsmap finished waiting for FSMap version 134 2024-01-22T05:18:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f4427a91740 10 client.9754 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-22T05:18:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f4427a91740 20 client.9754 populate_metadata read hostname 'smithi049' 2024-01-22T05:18:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f4427a91740 1 --2- 172.21.15.49:0/2844488262 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x2733140 0x2733520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f4427a91740 4 client.9754 mds_command: new command op to 9610 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:18:46.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f4427a91740 1 -- 172.21.15.49:0/2844488262 --> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x26496f0 con 0x2733140 2024-01-22T05:18:46.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f4416a00700 1 --2- 172.21.15.49:0/2844488262 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x2733140 0x2733520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f4416a00700 1 --2- 172.21.15.49:0/2844488262 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x2733140 0x2733520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1fd02b8938745488 server_cookie=3e76de516220bb6e in_seq=0 out_seq=0 2024-01-22T05:18:46.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.657+0000 7f43fea00700 10 client.9754 ms_handle_connect on v2:172.21.15.110:6834/2192470330 2024-01-22T05:18:46.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.661+0000 7f43fea00700 1 -- 172.21.15.49:0/2844488262 <== mds.0 v2:172.21.15.110:6834/2192470330 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x26496f0 con 0x2733140 2024-01-22T05:18:46.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.661+0000 7f43fea00700 10 client.9754 handle_command_reply: tid=0 2024-01-22T05:18:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.661+0000 7f4427a91740 1 client.9754 shutdown 2024-01-22T05:18:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.661+0000 7f4427a91740 1 -- 172.21.15.49:0/2844488262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e780 msgr2=0x2705c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.661+0000 7f4427a91740 1 --2- 172.21.15.49:0/2844488262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e780 0x2705c20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f441004b4b0 tx=0x7f4410054000).stop 2024-01-22T05:18:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.661+0000 7f4427a91740 1 -- 172.21.15.49:0/2844488262 shutdown_connections 2024-01-22T05:18:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.661+0000 7f4427a91740 1 --2- 172.21.15.49:0/2844488262 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x2733140 0x2733520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.661+0000 7f4427a91740 1 --2- 172.21.15.49:0/2844488262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e780 0x2705c20 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.661+0000 7f4427a91740 1 --2- 172.21.15.49:0/2844488262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e3a0 0x271dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.661+0000 7f43fea00700 0 client.9754 ms_handle_reset on v2:172.21.15.110:6834/2192470330 2024-01-22T05:18:46.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.661+0000 7f4427a91740 1 --2- 172.21.15.49:0/2844488262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26dde40 0x27216d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.661+0000 7f4427a91740 1 -- 172.21.15.49:0/2844488262 >> 172.21.15.49:0/2844488262 conn(0x24bb550 msgr2=0x2724350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:46.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.661+0000 7f4427a91740 1 -- 172.21.15.49:0/2844488262 shutdown_connections 2024-01-22T05:18:46.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.661+0000 7f4427a91740 1 -- 172.21.15.49:0/2844488262 wait complete. 2024-01-22T05:18:46.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.665+0000 7f4427a91740 20 client.9754 trim_cache size 0 max 16384 2024-01-22T05:18:46.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.685+0000 7f4427a91740 1 Processor -- start 2024-01-22T05:18:46.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.685+0000 7f4427a91740 1 -- start start 2024-01-22T05:18:46.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.685+0000 7f4427a91740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26dde40 0x26dc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.685+0000 7f4427a91740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e3a0 0x2720640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.685+0000 7f4427a91740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x271e780 0x2720b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.685+0000 7f4427a91740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x26a0e60 con 0x271e780 2024-01-22T05:18:46.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.685+0000 7f4427a91740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x262cc50 con 0x26dde40 2024-01-22T05:18:46.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.685+0000 7f4427a91740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x26d92b0 con 0x271e3a0 2024-01-22T05:18:46.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.685+0000 7f4417400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x271e780 0x2720b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.685+0000 7f4416000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e3a0 0x2720640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.685+0000 7f4416a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26dde40 0x26dc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.685+0000 7f4417400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x271e780 0x2720b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39228/0 (socket says 172.21.15.49:39228) 2024-01-22T05:18:46.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.685+0000 7f4417400700 1 -- 172.21.15.49:0/236278136 learned_addr learned my addr 172.21.15.49:0/236278136 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:46.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4416000700 1 -- 172.21.15.49:0/236278136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26dde40 msgr2=0x26dc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:46.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4416000700 1 --2- 172.21.15.49:0/236278136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26dde40 0x26dc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4416000700 1 -- 172.21.15.49:0/236278136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x271e780 msgr2=0x2720b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:46.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4416000700 1 --2- 172.21.15.49:0/236278136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x271e780 0x2720b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4416000700 1 -- 172.21.15.49:0/236278136 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44180bdd80 con 0x271e3a0 2024-01-22T05:18:46.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4417400700 1 --2- 172.21.15.49:0/236278136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x271e780 0x2720b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:46.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4416000700 1 --2- 172.21.15.49:0/236278136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e3a0 0x2720640 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f4418064db0 tx=0x7f4400008040).ready entity=mon.2 client_cookie=df07f8500c626e09 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:46.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4407000700 1 -- 172.21.15.49:0/236278136 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440001c070 con 0x271e3a0 2024-01-22T05:18:46.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4407000700 1 -- 172.21.15.49:0/236278136 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44000099d0 con 0x271e3a0 2024-01-22T05:18:46.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4407000700 1 -- 172.21.15.49:0/236278136 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400017ba0 con 0x271e3a0 2024-01-22T05:18:46.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4427a91740 1 -- 172.21.15.49:0/236278136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e3a0 msgr2=0x2720640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4427a91740 1 --2- 172.21.15.49:0/236278136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e3a0 0x2720640 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f4418064db0 tx=0x7f4400008040).stop 2024-01-22T05:18:46.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4427a91740 1 -- 172.21.15.49:0/236278136 shutdown_connections 2024-01-22T05:18:46.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4427a91740 1 --2- 172.21.15.49:0/236278136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x271e780 0x2720b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4427a91740 1 --2- 172.21.15.49:0/236278136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e3a0 0x2720640 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4427a91740 1 --2- 172.21.15.49:0/236278136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x26dde40 0x26dc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4427a91740 1 -- 172.21.15.49:0/236278136 >> 172.21.15.49:0/236278136 conn(0x24bb550 msgr2=0x26dcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:46.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.689+0000 7f4427a91740 1 -- 172.21.15.49:0/236278136 shutdown_connections 2024-01-22T05:18:46.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.693+0000 7f4427a91740 1 -- 172.21.15.49:0/236278136 wait complete. 2024-01-22T05:18:46.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.693+0000 7f4427a91740 1 -- start start 2024-01-22T05:18:46.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.693+0000 7f4427a91740 1 Processor -- start 2024-01-22T05:18:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4427a91740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26dde40 0x277f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4427a91740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e3a0 0x2786120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4427a91740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e780 0x27003d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4427a91740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x27010f0 con 0x26dde40 2024-01-22T05:18:46.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4427a91740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x27397e0 con 0x271e3a0 2024-01-22T05:18:46.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4427a91740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2785660 con 0x271e780 2024-01-22T05:18:46.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4427a91740 10 client.0 ll_register_callbacks cb 0x7f4410072710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:18:46.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4416a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26dde40 0x277f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4416a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26dde40 0x277f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39244/0 (socket says 172.21.15.49:39244) 2024-01-22T05:18:46.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4416a00700 1 -- 172.21.15.49:0/2795798805 learned_addr learned my addr 172.21.15.49:0/2795798805 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:46.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4416000700 1 --2- 172.21.15.49:0/2795798805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e3a0 0x2786120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4417400700 1 --2- 172.21.15.49:0/2795798805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e780 0x27003d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4416a00700 1 -- 172.21.15.49:0/2795798805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e780 msgr2=0x27003d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:46.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4416a00700 1 --2- 172.21.15.49:0/2795798805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e780 0x27003d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4416a00700 1 -- 172.21.15.49:0/2795798805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e3a0 msgr2=0x2786120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:46.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4416a00700 1 --2- 172.21.15.49:0/2795798805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e3a0 0x2786120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4416a00700 1 -- 172.21.15.49:0/2795798805 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2651960 con 0x26dde40 2024-01-22T05:18:46.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f4416a00700 1 --2- 172.21.15.49:0/2795798805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26dde40 0x277f6e0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f4408001ed0 tx=0x7f4408024040).ready entity=mon.0 client_cookie=11140950308ef44b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:46.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f43fea00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:18:46.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.697+0000 7f43fea00700 1 -- 172.21.15.49:0/2795798805 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408034060 con 0x26dde40 2024-01-22T05:18:46.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f4427a91740 1 -- 172.21.15.49:0/2795798805 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4410054070 con 0x26dde40 2024-01-22T05:18:46.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f43fea00700 1 -- 172.21.15.49:0/2795798805 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f440801c040 con 0x26dde40 2024-01-22T05:18:46.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f43fea00700 1 -- 172.21.15.49:0/2795798805 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44080079c0 con 0x26dde40 2024-01-22T05:18:46.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f4427a91740 10 client.9888 fetch_fsmap learned FSMap version 134 2024-01-22T05:18:46.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f4427a91740 1 -- 172.21.15.49:0/2795798805 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=2+}) v3 -- 0x7f4400009b60 con 0x26dde40 2024-01-22T05:18:46.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f43fea00700 1 -- 172.21.15.49:0/2795798805 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4410054070 con 0x26dde40 2024-01-22T05:18:46.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f43fea00700 1 -- 172.21.15.49:0/2795798805 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 134) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f44080046b0 con 0x26dde40 2024-01-22T05:18:46.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f4427a91740 10 client.9888 fetch_fsmap finished waiting for FSMap version 134 2024-01-22T05:18:46.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f4427a91740 10 client.9888 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-22T05:18:46.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f4427a91740 20 client.9888 populate_metadata read hostname 'smithi049' 2024-01-22T05:18:46.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f4427a91740 1 --2- 172.21.15.49:0/2795798805 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x2731c80 0x2732060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f4427a91740 4 client.9888 mds_command: new command op to 9610 tid=0[{"prefix": "status"}] 2024-01-22T05:18:46.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f4427a91740 1 -- 172.21.15.49:0/2795798805 --> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] -- command(tid 0: {"prefix": "status"}) v1 -- 0x25124e0 con 0x2731c80 2024-01-22T05:18:46.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f4416000700 1 --2- 172.21.15.49:0/2795798805 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x2731c80 0x2732060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f4416000700 1 --2- 172.21.15.49:0/2795798805 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x2731c80 0x2732060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e48981aded1f0135 server_cookie=1c4e2af72e9570bb in_seq=0 out_seq=0 2024-01-22T05:18:46.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f43fea00700 10 client.9888 ms_handle_connect on v2:172.21.15.110:6834/2192470330 2024-01-22T05:18:46.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f43fea00700 1 -- 172.21.15.49:0/2795798805 <== mds.0 v2:172.21.15.110:6834/2192470330 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x25124e0 con 0x2731c80 2024-01-22T05:18:46.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f43fea00700 10 client.9888 handle_command_reply: tid=0 2024-01-22T05:18:46.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.701+0000 7f4427a91740 1 client.9888 shutdown 2024-01-22T05:18:46.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f4427a91740 1 -- 172.21.15.49:0/2795798805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26dde40 msgr2=0x277f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f4427a91740 1 --2- 172.21.15.49:0/2795798805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26dde40 0x277f6e0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f4408001ed0 tx=0x7f4408024040).stop 2024-01-22T05:18:46.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f4427a91740 1 -- 172.21.15.49:0/2795798805 shutdown_connections 2024-01-22T05:18:46.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f4427a91740 1 --2- 172.21.15.49:0/2795798805 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x2731c80 0x2732060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f4427a91740 1 --2- 172.21.15.49:0/2795798805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x271e780 0x27003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f4427a91740 1 --2- 172.21.15.49:0/2795798805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x271e3a0 0x2786120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f43fea00700 0 client.9888 ms_handle_reset on v2:172.21.15.110:6834/2192470330 2024-01-22T05:18:46.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f4427a91740 1 --2- 172.21.15.49:0/2795798805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x26dde40 0x277f6e0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f4427a91740 1 -- 172.21.15.49:0/2795798805 >> 172.21.15.49:0/2795798805 conn(0x24bb550 msgr2=0x26dd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:46.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f4427a91740 1 -- 172.21.15.49:0/2795798805 shutdown_connections 2024-01-22T05:18:46.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f4427a91740 1 -- 172.21.15.49:0/2795798805 wait complete. 2024-01-22T05:18:46.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f4427a91740 20 client.9888 trim_cache size 0 max 16384 2024-01-22T05:18:46.712 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:18:46.712 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:18:46.713 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:18:46.713 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 9610, 2024-01-22T05:18:46.713 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:18:46.713 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:18:46.713 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:18:46.713 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 6.6263878519999997, 2024-01-22T05:18:46.713 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 134, 2024-01-22T05:18:46.713 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 172, 2024-01-22T05:18:46.713 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 172, 2024-01-22T05:18:46.713 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 12.023412242999999 2024-01-22T05:18:46.713 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:18:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f441d600700 1 -- 172.21.15.49:0/2857897489 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f43f005a540 msgr2=0x7f43f005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f441d600700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f43f005a540 0x7f43f005ca00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f440800ca90 tx=0x7f4408015000).stop 2024-01-22T05:18:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f441d600700 1 -- 172.21.15.49:0/2857897489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4418167d70 msgr2=0x7f44181681f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f441d600700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4418167d70 0x7f44181681f0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7f4410000f80 tx=0x7f4410009040).stop 2024-01-22T05:18:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f441d600700 1 -- 172.21.15.49:0/2857897489 shutdown_connections 2024-01-22T05:18:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f441d600700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f43f005a540 0x7f43f005ca00 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f441d600700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4418167d70 0x7f44181681f0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f441d600700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44180ad050 0x7f441816c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f441d600700 1 --2- 172.21.15.49:0/2857897489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43f8003910 0x7f44180aa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.705+0000 7f441d600700 1 -- 172.21.15.49:0/2857897489 >> 172.21.15.49:0/2857897489 conn(0x7f44180c40c0 msgr2=0x7f4418069b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:46.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.709+0000 7f441d600700 1 -- 172.21.15.49:0/2857897489 shutdown_connections 2024-01-22T05:18:46.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.709+0000 7f441d600700 1 -- 172.21.15.49:0/2857897489 wait complete. 2024-01-22T05:18:46.734 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:18:46.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2587600700 1 Processor -- start 2024-01-22T05:18:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2587600700 1 -- start start 2024-01-22T05:18:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2587600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2580067210 0x7f25800aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2587600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25800c6150 0x7f25800bebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2587600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25800a8900 con 0x7f25800a8490 2024-01-22T05:18:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2587600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25800675f0 con 0x7f2580067210 2024-01-22T05:18:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2587600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2580065f80 con 0x7f25800c6150 2024-01-22T05:18:46.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2586000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25800c6150 0x7f25800bebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2584c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2580067210 0x7f25800aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2586000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25800c6150 0x7f25800bebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:48544/0 (socket says 172.21.15.49:48544) 2024-01-22T05:18:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2586000700 1 -- 172.21.15.49:0/2666690320 learned_addr learned my addr 172.21.15.49:0/2666690320 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2586000700 1 -- 172.21.15.49:0/2666690320 >> v2:172.21.15.110:3300/0 conn(0x7f2580067210 msgr2=0x7f25800aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2586000700 1 --2- 172.21.15.49:0/2666690320 >> v2:172.21.15.110:3300/0 conn(0x7f2580067210 0x7f25800aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2586000700 1 -- 172.21.15.49:0/2666690320 >> v1:172.21.15.110:6789/0 conn(0x7f25800a8490 legacy=0x7f25800c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2586000700 1 -- 172.21.15.49:0/2666690320 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25800656e0 con 0x7f25800c6150 2024-01-22T05:18:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f2586000700 1 --2- 172.21.15.49:0/2666690320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25800c6150 0x7f25800bebb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f257800d1a0 tx=0x7f257800ba50).ready entity=mon.2 client_cookie=9ceff74728e97db1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f257f400700 1 -- 172.21.15.49:0/2666690320 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2578010070 con 0x7f25800c6150 2024-01-22T05:18:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f257f400700 1 -- 172.21.15.49:0/2666690320 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257800de10 con 0x7f25800c6150 2024-01-22T05:18:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.877+0000 7f257f400700 1 -- 172.21.15.49:0/2666690320 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257800b2e0 con 0x7f25800c6150 2024-01-22T05:18:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.881+0000 7f2587600700 1 -- 172.21.15.49:0/2666690320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25800c6150 msgr2=0x7f25800bebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.881+0000 7f2587600700 1 --2- 172.21.15.49:0/2666690320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25800c6150 0x7f25800bebb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f257800d1a0 tx=0x7f257800ba50).stop 2024-01-22T05:18:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.881+0000 7f2587600700 1 -- 172.21.15.49:0/2666690320 shutdown_connections 2024-01-22T05:18:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.881+0000 7f2587600700 1 --2- 172.21.15.49:0/2666690320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25800c6150 0x7f25800bebb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.881+0000 7f2587600700 1 --2- 172.21.15.49:0/2666690320 >> v2:172.21.15.110:3300/0 conn(0x7f2580067210 0x7f25800aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.881+0000 7f2587600700 1 -- 172.21.15.49:0/2666690320 >> 172.21.15.49:0/2666690320 conn(0x7f25800ac090 msgr2=0x7f25800ac4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.881+0000 7f2587600700 1 -- 172.21.15.49:0/2666690320 shutdown_connections 2024-01-22T05:18:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.881+0000 7f2587600700 1 -- 172.21.15.49:0/2666690320 wait complete. 2024-01-22T05:18:46.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.885+0000 7f2587600700 1 Processor -- start 2024-01-22T05:18:46.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.885+0000 7f2587600700 1 -- start start 2024-01-22T05:18:46.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f2587600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2580067210 0x7f2580093930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f2587600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25800a8490 0x7f2580095ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f2587600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25800c6150 0x7f2580150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f2587600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25800a8e90 con 0x7f2580067210 2024-01-22T05:18:46.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f2587600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25800a8b60 con 0x7f25800c6150 2024-01-22T05:18:46.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f2587600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25800964f0 con 0x7f25800a8490 2024-01-22T05:18:46.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f2584c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2580067210 0x7f2580093930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f2584c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2580067210 0x7f2580093930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39248/0 (socket says 172.21.15.49:39248) 2024-01-22T05:18:46.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f2584c00700 1 -- 172.21.15.49:0/2515047583 learned_addr learned my addr 172.21.15.49:0/2515047583 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:46.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f257fe00700 1 --2- 172.21.15.49:0/2515047583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25800a8490 0x7f2580095ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f2586000700 1 --2- 172.21.15.49:0/2515047583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25800c6150 0x7f2580150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f257fe00700 1 -- 172.21.15.49:0/2515047583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25800c6150 msgr2=0x7f2580150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f257fe00700 1 --2- 172.21.15.49:0/2515047583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25800c6150 0x7f2580150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f257fe00700 1 -- 172.21.15.49:0/2515047583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2580067210 msgr2=0x7f2580093930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:46.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f257fe00700 1 --2- 172.21.15.49:0/2515047583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2580067210 0x7f2580093930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:46.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f257fe00700 1 -- 172.21.15.49:0/2515047583 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257800bcf0 con 0x7f25800a8490 2024-01-22T05:18:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f257fe00700 1 --2- 172.21.15.49:0/2515047583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25800a8490 0x7f2580095ce0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f256800c440 tx=0x7f2568007d40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f2577e00700 1 -- 172.21.15.49:0/2515047583 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2568007020 con 0x7f25800a8490 2024-01-22T05:18:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f2577e00700 1 -- 172.21.15.49:0/2515047583 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2568007180 con 0x7f25800a8490 2024-01-22T05:18:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f2577e00700 1 -- 172.21.15.49:0/2515047583 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2568007520 con 0x7f25800a8490 2024-01-22T05:18:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f2587600700 1 -- 172.21.15.49:0/2515047583 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25800967d0 con 0x7f25800a8490 2024-01-22T05:18:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.889+0000 7f2587600700 1 -- 172.21.15.49:0/2515047583 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25800961d0 con 0x7f25800a8490 2024-01-22T05:18:46.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.897+0000 7f2587600700 1 -- 172.21.15.49:0/2515047583 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25800827b0 con 0x7f25800a8490 2024-01-22T05:18:46.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.897+0000 7f2577e00700 1 -- 172.21.15.49:0/2515047583 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f25680068b0 con 0x7f25800a8490 2024-01-22T05:18:46.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.897+0000 7f2577e00700 1 --2- 172.21.15.49:0/2515047583 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f255805a510 0x7f255805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:46.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.897+0000 7f2577e00700 1 -- 172.21.15.49:0/2515047583 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f2568073b90 con 0x7f25800a8490 2024-01-22T05:18:46.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.897+0000 7f2584c00700 1 --2- 172.21.15.49:0/2515047583 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f255805a510 0x7f255805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:46.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.897+0000 7f2584c00700 1 --2- 172.21.15.49:0/2515047583 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f255805a510 0x7f255805c9d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f2570009c50 tx=0x7f2570009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:46.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:46.905+0000 7f2577e00700 1 -- 172.21.15.49:0/2515047583 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2568047150 con 0x7f25800a8490 2024-01-22T05:18:47.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:47.101+0000 7f2587600700 1 -- 172.21.15.49:0/2515047583 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2580066480 con 0x7f25800a8490 2024-01-22T05:18:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:47.101+0000 7f2577e00700 1 -- 172.21.15.49:0/2515047583 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v134) v1 ==== 53+0+73 (secure 0 0 0) 0x7f256804a770 con 0x7f25800a8490 2024-01-22T05:18:47.104 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:18:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:47.105+0000 7f2587600700 1 -- 172.21.15.49:0/2515047583 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f255805a510 msgr2=0x7f255805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:47.105+0000 7f2587600700 1 --2- 172.21.15.49:0/2515047583 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f255805a510 0x7f255805c9d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f2570009c50 tx=0x7f2570009060).stop 2024-01-22T05:18:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:47.105+0000 7f2587600700 1 -- 172.21.15.49:0/2515047583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25800a8490 msgr2=0x7f2580095ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:47.105+0000 7f2587600700 1 --2- 172.21.15.49:0/2515047583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25800a8490 0x7f2580095ce0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f256800c440 tx=0x7f2568007d40).stop 2024-01-22T05:18:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:47.105+0000 7f2587600700 1 -- 172.21.15.49:0/2515047583 shutdown_connections 2024-01-22T05:18:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:47.105+0000 7f2587600700 1 --2- 172.21.15.49:0/2515047583 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f255805a510 0x7f255805c9d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:47.105+0000 7f2587600700 1 --2- 172.21.15.49:0/2515047583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25800c6150 0x7f2580150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:47.105+0000 7f2587600700 1 --2- 172.21.15.49:0/2515047583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25800a8490 0x7f2580095ce0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:47.105+0000 7f2587600700 1 --2- 172.21.15.49:0/2515047583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2580067210 0x7f2580093930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:47.105+0000 7f2587600700 1 -- 172.21.15.49:0/2515047583 >> 172.21.15.49:0/2515047583 conn(0x7f25800ac090 msgr2=0x7f2580151b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:47.105+0000 7f2587600700 1 -- 172.21.15.49:0/2515047583 shutdown_connections 2024-01-22T05:18:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:47.105+0000 7f2587600700 1 -- 172.21.15.49:0/2515047583 wait complete. 2024-01-22T05:18:47.127 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-22T05:18:47.127 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:18:47.127 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:18:47.127 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:18:47.127 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:18:47.127 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-22T05:18:47.127 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-22T05:18:47.128 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:18:47.128 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:18:47.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:18:47.128 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:18:47.147 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:18:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:18:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:18:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:18:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:18:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:18:47.148 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:18:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:18:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:18:47.148 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:18:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:18:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:18:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:18:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41644sec preferred_lft 41644sec 2024-01-22T05:18:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:18:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:18:47.148 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:18:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:18:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:18:47.149 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:18:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:18:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:18:47.149 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:18:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:18:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:18:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:18:47.149 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:18:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:18:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:18:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:18:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::7ce7:e3ff:fed1:1e88/64 scope link 2024-01-22T05:18:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:18:47.150 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:18:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 82:c1:48:e7:c7:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:18:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::80c1:48ff:fee7:c731/64 scope link 2024-01-22T05:18:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:18:47.150 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:18:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:18:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3426:32ff:feee:c4c9/64 scope link 2024-01-22T05:18:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:18:47.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:18:47.151 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:18:47.236 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:18:47.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:18:47.239 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:18:47.304 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:18:47.304 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:18:47.304 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:18:47.304 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:18:47.304 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:18:47.304 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:18:47.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:18:47.306 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:18:47.306 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:18:47.306 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:18:47.306 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:18:47.306 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:18:47.306 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:18:47.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:18:47.431 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:18:47.451 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:18:47.451 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:18:47.452 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:18:47.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:18:47.452 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-22T05:18:47.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:18:47.533 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-22T05:18:47.592 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:18:47.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:18:47.710 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:18:47.710 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:18:47.734 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:18:47.734 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:18:47.742 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:18:47.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:18:47.742 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:18:47.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:18:47.774 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-01-22T05:18:47.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:18:47.851 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-01-22T05:18:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:6+0 records in 2024-01-22T05:18:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:6+0 records out 2024-01-22T05:18:48.038 INFO:teuthology.orchestra.run.smithi049.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.116249 s, 54.1 MB/s 2024-01-22T05:18:48.040 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-22T05:18:48.045 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-22T05:18:48.117 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2024-01-22T05:18:48.117 INFO:teuthology.orchestra.run.smithi049.stdout: chdir = "" 2024-01-22T05:18:48.117 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: auth supported = cephx 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: filestore xattr use omap = true 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: mon clock drift allowed = 1.000 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: osd crush chooseleaf type = 0 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: auth debug = true 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on old message = true 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on bug = true 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: mon pg warn max object skew = 0 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: # disable pg_autoscaler by default for new pools 2024-01-22T05:18:48.118 INFO:teuthology.orchestra.run.smithi049.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-22T05:18:48.119 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.119 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default size = 2 2024-01-22T05:18:48.119 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.119 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow primary affinity = true 2024-01-22T05:18:48.119 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow pg remap = true 2024-01-22T05:18:48.119 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on legacy crush tunables = false 2024-01-22T05:18:48.119 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on crush straw calc version zero = false 2024-01-22T05:18:48.119 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on no sortbitwise = false 2024-01-22T05:18:48.119 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on osd down out interval zero = false 2024-01-22T05:18:48.119 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on too few osds = false 2024-01-22T05:18:48.119 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-22T05:18:48.119 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-22T05:18:48.119 INFO:teuthology.orchestra.run.smithi049.stdout: mon_allow_pool_size_one = true 2024-01-22T05:18:48.119 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.119 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2024-01-22T05:18:48.120 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.120 INFO:teuthology.orchestra.run.smithi049.stdout: osd default data pool replay window = 5 2024-01-22T05:18:48.120 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.120 INFO:teuthology.orchestra.run.smithi049.stdout: mon allow pool delete = true 2024-01-22T05:18:48.120 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.120 INFO:teuthology.orchestra.run.smithi049.stdout: mon cluster log file level = debug 2024-01-22T05:18:48.120 INFO:teuthology.orchestra.run.smithi049.stdout: debug asserts on shutdown = true 2024-01-22T05:18:48.120 INFO:teuthology.orchestra.run.smithi049.stdout: mon health detail to clog = false 2024-01-22T05:18:48.120 INFO:teuthology.orchestra.run.smithi049.stdout: mon host = "172.21.15.49,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-01-22T05:18:48.120 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on skipped message = False 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = f4203cdb-f79e-4d7b-b9de-f994381af719 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout:[osd] 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: osd journal size = 100 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub load threshold = 5.0 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub max interval = 600 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: osd recover clone overlap = true 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: osd recovery max chunk = 1048576 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug shutdown = true 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug op order = true 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug verify stray on activate = true 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: osd open classes on start = true 2024-01-22T05:18:48.121 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug pg log writeout = true 2024-01-22T05:18:48.122 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.122 INFO:teuthology.orchestra.run.smithi049.stdout: osd deep scrub update digest min age = 30 2024-01-22T05:18:48.122 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.122 INFO:teuthology.orchestra.run.smithi049.stdout: osd map max advance = 10 2024-01-22T05:18:48.122 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.122 INFO:teuthology.orchestra.run.smithi049.stdout: journal zero on create = true 2024-01-22T05:18:48.122 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.122 INFO:teuthology.orchestra.run.smithi049.stdout: filestore ondisk finisher threads = 3 2024-01-22T05:18:48.122 INFO:teuthology.orchestra.run.smithi049.stdout: filestore apply finisher threads = 3 2024-01-22T05:18:48.122 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.122 INFO:teuthology.orchestra.run.smithi049.stdout: bdev debug aio = true 2024-01-22T05:18:48.123 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug misdirected ops = true 2024-01-22T05:18:48.123 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore block size = 96636764160 2024-01-22T05:18:48.123 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore fsck on mount = True 2024-01-22T05:18:48.123 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluefs = 20 2024-01-22T05:18:48.123 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluestore = 20 2024-01-22T05:18:48.123 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:18:48.123 INFO:teuthology.orchestra.run.smithi049.stdout: debug osd = 20 2024-01-22T05:18:48.123 INFO:teuthology.orchestra.run.smithi049.stdout: debug rocksdb = 10 2024-01-22T05:18:48.123 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd backfillfull_ratio = 0.85 2024-01-22T05:18:48.124 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd full ratio = 0.9 2024-01-22T05:18:48.124 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd nearfull ratio = 0.8 2024-01-22T05:18:48.124 INFO:teuthology.orchestra.run.smithi049.stdout: osd failsafe full ratio = 0.95 2024-01-22T05:18:48.124 INFO:teuthology.orchestra.run.smithi049.stdout: osd objectstore = bluestore 2024-01-22T05:18:48.124 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2024-01-22T05:18:48.124 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.124 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr] 2024-01-22T05:18:48.124 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:18:48.125 INFO:teuthology.orchestra.run.smithi049.stdout: debug mgr = 20 2024-01-22T05:18:48.125 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-01-22T05:18:48.125 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-01-22T05:18:48.125 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:18:48.125 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:18:48.125 INFO:teuthology.orchestra.run.smithi049.stdout: mgr/telemetry/nag = false 2024-01-22T05:18:48.125 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.125 INFO:teuthology.orchestra.run.smithi049.stdout:[mon] 2024-01-22T05:18:48.125 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:18:48.126 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-01-22T05:18:48.126 INFO:teuthology.orchestra.run.smithi049.stdout: debug paxos = 20 2024-01-22T05:18:48.126 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-01-22T05:18:48.126 INFO:teuthology.orchestra.run.smithi049.stdout: mon data avail warn = 5 2024-01-22T05:18:48.126 INFO:teuthology.orchestra.run.smithi049.stdout: mon mgr mkfs grace = 240 2024-01-22T05:18:48.126 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:18:48.126 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd reporter subtree level = osd 2024-01-22T05:18:48.126 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd prime pg temp = true 2024-01-22T05:18:48.126 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:18:48.127 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.127 INFO:teuthology.orchestra.run.smithi049.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-22T05:18:48.127 INFO:teuthology.orchestra.run.smithi049.stdout: auth mon ticket ttl = 660 # 11m 2024-01-22T05:18:48.127 INFO:teuthology.orchestra.run.smithi049.stdout: auth service ticket ttl = 240 # 4m 2024-01-22T05:18:48.127 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.127 INFO:teuthology.orchestra.run.smithi049.stdout: # don't complain about insecure global_id in the test suite 2024-01-22T05:18:48.127 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-22T05:18:48.127 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-22T05:18:48.128 INFO:teuthology.orchestra.run.smithi049.stdout: mon op complaint time = 120 2024-01-22T05:18:48.128 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.128 INFO:teuthology.orchestra.run.smithi049.stdout:[client] 2024-01-22T05:18:48.128 INFO:teuthology.orchestra.run.smithi049.stdout: rgw cache enabled = true 2024-01-22T05:18:48.128 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable ops log = true 2024-01-22T05:18:48.128 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable usage log = true 2024-01-22T05:18:48.128 INFO:teuthology.orchestra.run.smithi049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-22T05:18:48.128 INFO:teuthology.orchestra.run.smithi049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-22T05:18:48.129 INFO:teuthology.orchestra.run.smithi049.stdout: client mount timeout = 600 2024-01-22T05:18:48.129 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 20 2024-01-22T05:18:48.129 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:18:48.129 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = "" 2024-01-22T05:18:48.129 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2024-01-22T05:18:48.129 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2024-01-22T05:18:48.129 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.a] 2024-01-22T05:18:48.129 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.b] 2024-01-22T05:18:48.129 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.c] 2024-01-22T05:18:48.129 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2024-01-22T05:18:48.130 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2024-01-22T05:18:48.130 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2024-01-22T05:18:48.130 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2024-01-22T05:18:48.130 INFO:teuthology.orchestra.run.smithi049.stdout:[mds] 2024-01-22T05:18:48.130 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds = 20 2024-01-22T05:18:48.130 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds balancer = 20 2024-01-22T05:18:48.130 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:18:48.130 INFO:teuthology.orchestra.run.smithi049.stdout: mds cache max size = 1000 2024-01-22T05:18:48.130 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug frag = True 2024-01-22T05:18:48.131 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug scatterstat = True 2024-01-22T05:18:48.131 INFO:teuthology.orchestra.run.smithi049.stdout: mds log max segments = 1 2024-01-22T05:18:48.131 INFO:teuthology.orchestra.run.smithi049.stdout: mds op complaint time = 180 2024-01-22T05:18:48.131 INFO:teuthology.orchestra.run.smithi049.stdout: mds verify scatter = False 2024-01-22T05:18:48.131 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2024-01-22T05:18:48.131 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2024-01-22T05:18:48.131 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2024-01-22T05:18:48.132 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-01-22T05:18:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-01-22T05:18:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-22T05:18:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-01-22T05:18:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-01-22T05:18:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-01-22T05:18:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-01-22T05:18:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-01-22T05:18:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-01-22T05:18:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-01-22T05:18:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-22T05:18:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-01-22T05:18:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-01-22T05:18:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-22T05:18:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-01-22T05:18:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-01-22T05:18:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-01-22T05:18:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-01-22T05:18:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-01-22T05:18:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-01-22T05:18:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-01-22T05:18:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-01-22T05:18:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-22T05:18:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-22T05:18:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-01-22T05:18:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2024-01-22T05:18:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-01-22T05:18:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-01-22T05:18:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-01-22T05:18:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-01-22T05:18:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-01-22T05:18:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.49,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-01-22T05:18:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on skipped message = False 2024-01-22T05:18:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = f4203cdb-f79e-4d7b-b9de-f994381af719 2024-01-22T05:18:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.137 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-01-22T05:18:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-01-22T05:18:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-01-22T05:18:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-01-22T05:18:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-01-22T05:18:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-01-22T05:18:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-01-22T05:18:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-01-22T05:18:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-01-22T05:18:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-01-22T05:18:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-01-22T05:18:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-01-22T05:18:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-01-22T05:18:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-01-22T05:18:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 20 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 20 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 10 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-01-22T05:18:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-01-22T05:18:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-01-22T05:18:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-01-22T05:18:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.140 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-01-22T05:18:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:18:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-01-22T05:18:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-01-22T05:18:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-01-22T05:18:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:18:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:18:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-01-22T05:18:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.140 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-01-22T05:18:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-01-22T05:18:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-22T05:18:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-22T05:18:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2024-01-22T05:18:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.142 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-01-22T05:18:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-01-22T05:18:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-01-22T05:18:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-01-22T05:18:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-22T05:18:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-22T05:18:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2024-01-22T05:18:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2024-01-22T05:18:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:18:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = "" 2024-01-22T05:18:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-01-22T05:18:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds balancer = 20 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: mds cache max size = 1000 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = True 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: mds log max segments = 1 2024-01-22T05:18:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2024-01-22T05:18:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = False 2024-01-22T05:18:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-01-22T05:18:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-01-22T05:18:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-01-22T05:18:48.146 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-22T05:18:48.195 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-22T05:18:48.264 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2024-01-22T05:18:48.264 INFO:teuthology.orchestra.run.smithi049.stdout: chdir = "" 2024-01-22T05:18:48.264 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-22T05:18:48.264 INFO:teuthology.orchestra.run.smithi049.stdout: auth supported = cephx 2024-01-22T05:18:48.264 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: filestore xattr use omap = true 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: mon clock drift allowed = 1.000 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: osd crush chooseleaf type = 0 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: auth debug = true 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on old message = true 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on bug = true 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: mon pg warn max object skew = 0 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: # disable pg_autoscaler by default for new pools 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-22T05:18:48.265 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.266 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default size = 2 2024-01-22T05:18:48.266 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.266 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow primary affinity = true 2024-01-22T05:18:48.266 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow pg remap = true 2024-01-22T05:18:48.266 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on legacy crush tunables = false 2024-01-22T05:18:48.266 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on crush straw calc version zero = false 2024-01-22T05:18:48.266 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on no sortbitwise = false 2024-01-22T05:18:48.266 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on osd down out interval zero = false 2024-01-22T05:18:48.266 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on too few osds = false 2024-01-22T05:18:48.266 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-22T05:18:48.266 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-22T05:18:48.266 INFO:teuthology.orchestra.run.smithi049.stdout: mon_allow_pool_size_one = true 2024-01-22T05:18:48.266 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.266 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2024-01-22T05:18:48.266 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.267 INFO:teuthology.orchestra.run.smithi049.stdout: osd default data pool replay window = 5 2024-01-22T05:18:48.267 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.267 INFO:teuthology.orchestra.run.smithi049.stdout: mon allow pool delete = true 2024-01-22T05:18:48.267 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.267 INFO:teuthology.orchestra.run.smithi049.stdout: mon cluster log file level = debug 2024-01-22T05:18:48.267 INFO:teuthology.orchestra.run.smithi049.stdout: debug asserts on shutdown = true 2024-01-22T05:18:48.267 INFO:teuthology.orchestra.run.smithi049.stdout: mon health detail to clog = false 2024-01-22T05:18:48.267 INFO:teuthology.orchestra.run.smithi049.stdout: mon host = "172.21.15.49,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-01-22T05:18:48.267 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on skipped message = False 2024-01-22T05:18:48.267 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = f4203cdb-f79e-4d7b-b9de-f994381af719 2024-01-22T05:18:48.268 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.268 INFO:teuthology.orchestra.run.smithi049.stdout:[osd] 2024-01-22T05:18:48.268 INFO:teuthology.orchestra.run.smithi049.stdout: osd journal size = 100 2024-01-22T05:18:48.268 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.268 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub load threshold = 5.0 2024-01-22T05:18:48.268 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub max interval = 600 2024-01-22T05:18:48.268 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.268 INFO:teuthology.orchestra.run.smithi049.stdout: osd recover clone overlap = true 2024-01-22T05:18:48.268 INFO:teuthology.orchestra.run.smithi049.stdout: osd recovery max chunk = 1048576 2024-01-22T05:18:48.268 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.268 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug shutdown = true 2024-01-22T05:18:48.268 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug op order = true 2024-01-22T05:18:48.268 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug verify stray on activate = true 2024-01-22T05:18:48.268 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.268 INFO:teuthology.orchestra.run.smithi049.stdout: osd open classes on start = true 2024-01-22T05:18:48.269 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug pg log writeout = true 2024-01-22T05:18:48.269 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.269 INFO:teuthology.orchestra.run.smithi049.stdout: osd deep scrub update digest min age = 30 2024-01-22T05:18:48.269 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.269 INFO:teuthology.orchestra.run.smithi049.stdout: osd map max advance = 10 2024-01-22T05:18:48.269 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.269 INFO:teuthology.orchestra.run.smithi049.stdout: journal zero on create = true 2024-01-22T05:18:48.269 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.269 INFO:teuthology.orchestra.run.smithi049.stdout: filestore ondisk finisher threads = 3 2024-01-22T05:18:48.269 INFO:teuthology.orchestra.run.smithi049.stdout: filestore apply finisher threads = 3 2024-01-22T05:18:48.269 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.269 INFO:teuthology.orchestra.run.smithi049.stdout: bdev debug aio = true 2024-01-22T05:18:48.269 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug misdirected ops = true 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore block size = 96636764160 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore fsck on mount = True 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluefs = 20 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluestore = 20 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout: debug osd = 20 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout: debug rocksdb = 10 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd backfillfull_ratio = 0.85 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd full ratio = 0.9 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd nearfull ratio = 0.8 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout: osd failsafe full ratio = 0.95 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout: osd objectstore = bluestore 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr] 2024-01-22T05:18:48.270 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: debug mgr = 20 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: mgr/telemetry/nag = false 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout:[mon] 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: debug paxos = 20 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: mon data avail warn = 5 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: mon mgr mkfs grace = 240 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd reporter subtree level = osd 2024-01-22T05:18:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd prime pg temp = true 2024-01-22T05:18:48.272 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:18:48.272 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.272 INFO:teuthology.orchestra.run.smithi049.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-22T05:18:48.272 INFO:teuthology.orchestra.run.smithi049.stdout: auth mon ticket ttl = 660 # 11m 2024-01-22T05:18:48.272 INFO:teuthology.orchestra.run.smithi049.stdout: auth service ticket ttl = 240 # 4m 2024-01-22T05:18:48.272 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.272 INFO:teuthology.orchestra.run.smithi049.stdout: # don't complain about insecure global_id in the test suite 2024-01-22T05:18:48.272 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-22T05:18:48.272 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-22T05:18:48.272 INFO:teuthology.orchestra.run.smithi049.stdout: mon op complaint time = 120 2024-01-22T05:18:48.272 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:48.272 INFO:teuthology.orchestra.run.smithi049.stdout:[client] 2024-01-22T05:18:48.272 INFO:teuthology.orchestra.run.smithi049.stdout: rgw cache enabled = true 2024-01-22T05:18:48.272 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable ops log = true 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable usage log = true 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout: client mount timeout = 600 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 20 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = "" 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.a] 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.b] 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.c] 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2024-01-22T05:18:48.273 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2024-01-22T05:18:48.274 INFO:teuthology.orchestra.run.smithi049.stdout:[mds] 2024-01-22T05:18:48.274 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds = 20 2024-01-22T05:18:48.274 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds balancer = 20 2024-01-22T05:18:48.274 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:18:48.274 INFO:teuthology.orchestra.run.smithi049.stdout: mds cache max size = 1000 2024-01-22T05:18:48.274 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug frag = True 2024-01-22T05:18:48.274 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug scatterstat = False 2024-01-22T05:18:48.274 INFO:teuthology.orchestra.run.smithi049.stdout: mds log max segments = 1 2024-01-22T05:18:48.274 INFO:teuthology.orchestra.run.smithi049.stdout: mds op complaint time = 180 2024-01-22T05:18:48.274 INFO:teuthology.orchestra.run.smithi049.stdout: mds verify scatter = False 2024-01-22T05:18:48.274 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2024-01-22T05:18:48.274 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2024-01-22T05:18:48.274 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2024-01-22T05:18:48.275 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-01-22T05:18:48.275 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-01-22T05:18:48.275 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-22T05:18:48.275 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-01-22T05:18:48.275 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.275 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-01-22T05:18:48.275 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.275 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-01-22T05:18:48.275 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.275 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-01-22T05:18:48.275 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-01-22T05:18:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-01-22T05:18:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-01-22T05:18:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-22T05:18:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-01-22T05:18:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-01-22T05:18:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-22T05:18:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-01-22T05:18:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-01-22T05:18:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-01-22T05:18:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-01-22T05:18:48.277 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-01-22T05:18:48.277 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-01-22T05:18:48.277 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-01-22T05:18:48.277 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-01-22T05:18:48.277 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-22T05:18:48.277 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-22T05:18:48.277 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-01-22T05:18:48.277 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.277 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2024-01-22T05:18:48.277 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.277 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.49,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on skipped message = False 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = f4203cdb-f79e-4d7b-b9de-f994381af719 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-01-22T05:18:48.278 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-01-22T05:18:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-01-22T05:18:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-01-22T05:18:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-01-22T05:18:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-01-22T05:18:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-01-22T05:18:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-01-22T05:18:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 20 2024-01-22T05:18:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 20 2024-01-22T05:18:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:18:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-01-22T05:18:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 10 2024-01-22T05:18:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-01-22T05:18:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-01-22T05:18:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-22T05:18:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-22T05:18:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2024-01-22T05:18:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:18:48.283 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-01-22T05:18:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-01-22T05:18:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-01-22T05:18:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-01-22T05:18:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-22T05:18:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-22T05:18:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2024-01-22T05:18:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2024-01-22T05:18:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:18:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = "" 2024-01-22T05:18:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-01-22T05:18:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-01-22T05:18:48.284 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-01-22T05:18:48.284 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-01-22T05:18:48.284 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-01-22T05:18:48.284 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-01-22T05:18:48.284 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-01-22T05:18:48.284 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-01-22T05:18:48.284 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-01-22T05:18:48.284 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2024-01-22T05:18:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2024-01-22T05:18:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds balancer = 20 2024-01-22T05:18:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:18:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: mds cache max size = 1000 2024-01-22T05:18:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2024-01-22T05:18:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = False 2024-01-22T05:18:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: mds log max segments = 1 2024-01-22T05:18:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2024-01-22T05:18:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = False 2024-01-22T05:18:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-01-22T05:18:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-01-22T05:18:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-01-22T05:18:48.293 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:18:48.293 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-01-22T05:18:48.293 DEBUG:teuthology.orchestra.run.smithi049:> import stat 2024-01-22T05:18:48.293 DEBUG:teuthology.orchestra.run.smithi049:> import json 2024-01-22T05:18:48.293 DEBUG:teuthology.orchestra.run.smithi049:> import sys 2024-01-22T05:18:48.293 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:18:48.293 DEBUG:teuthology.orchestra.run.smithi049:> try: 2024-01-22T05:18:48.294 DEBUG:teuthology.orchestra.run.smithi049:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-01-22T05:18:48.294 DEBUG:teuthology.orchestra.run.smithi049:> except OSError as e: 2024-01-22T05:18:48.294 DEBUG:teuthology.orchestra.run.smithi049:> sys.exit(e.errno) 2024-01-22T05:18:48.294 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:18:48.294 DEBUG:teuthology.orchestra.run.smithi049:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-01-22T05:18:48.294 DEBUG:teuthology.orchestra.run.smithi049:> print(json.dumps( 2024-01-22T05:18:48.294 DEBUG:teuthology.orchestra.run.smithi049:> dict([(a, getattr(s, a)) for a in attrs]), 2024-01-22T05:18:48.294 DEBUG:teuthology.orchestra.run.smithi049:> indent=2)) 2024-01-22T05:18:48.294 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-01-22T05:18:48.432 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:18:48.432 INFO:teuthology.orchestra.run.smithi049.stdout: "st_mode": 33204, 2024-01-22T05:18:48.432 INFO:teuthology.orchestra.run.smithi049.stdout: "st_ino": 1099511627777, 2024-01-22T05:18:48.432 INFO:teuthology.orchestra.run.smithi049.stdout: "st_dev": 49, 2024-01-22T05:18:48.432 INFO:teuthology.orchestra.run.smithi049.stdout: "st_nlink": 1, 2024-01-22T05:18:48.432 INFO:teuthology.orchestra.run.smithi049.stdout: "st_uid": 1000, 2024-01-22T05:18:48.432 INFO:teuthology.orchestra.run.smithi049.stdout: "st_gid": 1267, 2024-01-22T05:18:48.432 INFO:teuthology.orchestra.run.smithi049.stdout: "st_size": 6291456, 2024-01-22T05:18:48.432 INFO:teuthology.orchestra.run.smithi049.stdout: "st_atime": 1705900727.92153, 2024-01-22T05:18:48.433 INFO:teuthology.orchestra.run.smithi049.stdout: "st_mtime": 1705900727.9735289, 2024-01-22T05:18:48.433 INFO:teuthology.orchestra.run.smithi049.stdout: "st_ctime": 1705900727.9735289 2024-01-22T05:18:48.433 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:18:48.613 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:18:48.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.829+0000 7fea1be00700 1 Processor -- start 2024-01-22T05:18:48.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.829+0000 7fea1be00700 1 -- start start 2024-01-22T05:18:48.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.833+0000 7fea1be00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fea1c0a7260 0x7fea1c0659b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:48.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.833+0000 7fea1be00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c068a60 con 0x7fea1c155c60 2024-01-22T05:18:48.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.833+0000 7fea1be00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c067e50 con 0x7fea1c155880 2024-01-22T05:18:48.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.833+0000 7fea1be00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c068130 con 0x7fea1c0a7260 2024-01-22T05:18:48.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.833+0000 7fea1a000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fea1c155c60 0x7fea1c0a6b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55640/0 (socket says 172.21.15.49:55640) 2024-01-22T05:18:48.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.833+0000 7fea1a000700 1 -- 172.21.15.49:0/1289585025 learned_addr learned my addr 172.21.15.49:0/1289585025 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:48.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.833+0000 7fea1b400700 1 --2- 172.21.15.49:0/1289585025 >> v2:172.21.15.110:3300/0 conn(0x7fea1c0a7260 0x7fea1c0659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:48.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.833+0000 7fea19600700 1 -- 172.21.15.49:0/1289585025 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545581892 0 0) 0x7fea1c068a60 con 0x7fea1c155c60 2024-01-22T05:18:48.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.833+0000 7fea19600700 1 -- 172.21.15.49:0/1289585025 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9fc0033f0 con 0x7fea1c155c60 2024-01-22T05:18:48.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.833+0000 7fea1b400700 1 -- 172.21.15.49:0/1289585025 >> v1:172.21.15.110:6789/0 conn(0x7fea1c155880 legacy=0x7fea1c0a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:48.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.833+0000 7fea1b400700 1 -- 172.21.15.49:0/1289585025 >> v1:172.21.15.49:6789/0 conn(0x7fea1c155c60 legacy=0x7fea1c0a6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:48.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.833+0000 7fea1b400700 1 -- 172.21.15.49:0/1289585025 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c068410 con 0x7fea1c0a7260 2024-01-22T05:18:48.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.833+0000 7fea1b400700 1 --2- 172.21.15.49:0/1289585025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea1c0a7260 0x7fea1c0659b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7fea1c0a7700 tx=0x7fea14009780).ready entity=mon.1 client_cookie=990edd56d991e8b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:48.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.837+0000 7fea19600700 1 -- 172.21.15.49:0/1289585025 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400e070 con 0x7fea1c0a7260 2024-01-22T05:18:48.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.837+0000 7fea19600700 1 -- 172.21.15.49:0/1289585025 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1400bb60 con 0x7fea1c0a7260 2024-01-22T05:18:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.837+0000 7fea19600700 1 -- 172.21.15.49:0/1289585025 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14012410 con 0x7fea1c0a7260 2024-01-22T05:18:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.837+0000 7fea1be00700 1 -- 172.21.15.49:0/1289585025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea1c0a7260 msgr2=0x7fea1c0659b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:48.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.837+0000 7fea1be00700 1 --2- 172.21.15.49:0/1289585025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea1c0a7260 0x7fea1c0659b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7fea1c0a7700 tx=0x7fea14009780).stop 2024-01-22T05:18:48.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.837+0000 7fea1be00700 1 -- 172.21.15.49:0/1289585025 shutdown_connections 2024-01-22T05:18:48.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.837+0000 7fea1be00700 1 --2- 172.21.15.49:0/1289585025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea1c0a7260 0x7fea1c0659b0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:48.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.837+0000 7fea1be00700 1 -- 172.21.15.49:0/1289585025 >> 172.21.15.49:0/1289585025 conn(0x7fea1c0c6530 msgr2=0x7fea1c0c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:48.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.837+0000 7fea1be00700 1 -- 172.21.15.49:0/1289585025 shutdown_connections 2024-01-22T05:18:48.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.837+0000 7fea1be00700 1 -- 172.21.15.49:0/1289585025 wait complete. 2024-01-22T05:18:48.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.841+0000 7fea1be00700 1 Processor -- start 2024-01-22T05:18:48.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.841+0000 7fea1be00700 1 -- start start 2024-01-22T05:18:48.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.841+0000 7fea1be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1c0a7260 0x7fea1c09f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:48.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.841+0000 7fea1be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea1c155880 0x7fea1c09fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:48.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.841+0000 7fea1be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea1c155c60 0x7fea1c168910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:48.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.841+0000 7fea1be00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0a04b0 con 0x7fea1c0a7260 2024-01-22T05:18:48.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.841+0000 7fea1be00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0a0790 con 0x7fea1c155c60 2024-01-22T05:18:48.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.841+0000 7fea1be00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0a0a70 con 0x7fea1c155880 2024-01-22T05:18:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea1aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1c0a7260 0x7fea1c09f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea1aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1c0a7260 0x7fea1c09f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39260/0 (socket says 172.21.15.49:39260) 2024-01-22T05:18:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea1aa00700 1 -- 172.21.15.49:0/3724897298 learned_addr learned my addr 172.21.15.49:0/3724897298 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea1b400700 1 --2- 172.21.15.49:0/3724897298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea1c155c60 0x7fea1c168910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea1a000700 1 --2- 172.21.15.49:0/3724897298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea1c155880 0x7fea1c09fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea1aa00700 1 -- 172.21.15.49:0/3724897298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea1c155880 msgr2=0x7fea1c09fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea1aa00700 1 --2- 172.21.15.49:0/3724897298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea1c155880 0x7fea1c09fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea1aa00700 1 -- 172.21.15.49:0/3724897298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea1c155c60 msgr2=0x7fea1c168910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea1aa00700 1 --2- 172.21.15.49:0/3724897298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea1c155c60 0x7fea1c168910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:48.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea1aa00700 1 -- 172.21.15.49:0/3724897298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea14009a20 con 0x7fea1c0a7260 2024-01-22T05:18:48.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea1aa00700 1 --2- 172.21.15.49:0/3724897298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1c0a7260 0x7fea1c09f780 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7fea0c00c4c0 tx=0x7fea0c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:48.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea12000700 1 -- 172.21.15.49:0/3724897298 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00ce70 con 0x7fea1c0a7260 2024-01-22T05:18:48.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea12000700 1 -- 172.21.15.49:0/3724897298 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c001e90 con 0x7fea1c0a7260 2024-01-22T05:18:48.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea1be00700 1 -- 172.21.15.49:0/3724897298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c0a0d50 con 0x7fea1c0a7260 2024-01-22T05:18:48.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea12000700 1 -- 172.21.15.49:0/3724897298 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c007270 con 0x7fea1c0a7260 2024-01-22T05:18:48.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea1be00700 1 -- 172.21.15.49:0/3724897298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c0a0160 con 0x7fea1c0a7260 2024-01-22T05:18:48.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.845+0000 7fea1be00700 1 -- 172.21.15.49:0/3724897298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1c05fd40 con 0x7fea1c0a7260 2024-01-22T05:18:48.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.849+0000 7fea12000700 1 -- 172.21.15.49:0/3724897298 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fea0c0066a0 con 0x7fea1c0a7260 2024-01-22T05:18:48.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.853+0000 7fea12000700 1 --2- 172.21.15.49:0/3724897298 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe9f405a510 0x7fe9f405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:48.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.853+0000 7fea12000700 1 -- 172.21.15.49:0/3724897298 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fea0c074200 con 0x7fea1c0a7260 2024-01-22T05:18:48.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.853+0000 7fea1a000700 1 --2- 172.21.15.49:0/3724897298 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe9f405a510 0x7fe9f405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:48.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.853+0000 7fea1a000700 1 --2- 172.21.15.49:0/3724897298 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe9f405a510 0x7fe9f405c9d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fea04007fd0 tx=0x7fea04009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:48.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:48.857+0000 7fea12000700 1 -- 172.21.15.49:0/3724897298 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fea0c0477c0 con 0x7fea1c0a7260 2024-01-22T05:18:49.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.061+0000 7fea1be00700 1 -- 172.21.15.49:0/3724897298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea1c046800 con 0x7fea1c0a7260 2024-01-22T05:18:49.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.061+0000 7fea12000700 1 -- 172.21.15.49:0/3724897298 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+4505 (secure 0 0 0) 0x7fea0c04ade0 con 0x7fea1c0a7260 2024-01-22T05:18:49.061 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:49.061 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":134,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3995018890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3995018890},{"type":"v1","addr":"172.21.15.110:6833","nonce":3995018890}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2248654659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2248654659},{"type":"v1","addr":"172.21.15.49:6837","nonce":2248654659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931981528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1931981528},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931981528}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:18:40.076218+0000","modified":"2024-01-22T05:18:43.416474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9610":{"gid":9610,"name":"b","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/2192470330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2192470330},{"type":"v1","addr":"172.21.15.110:6835","nonce":2192470330}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2024-01-22T05:18:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.065+0000 7fea1be00700 1 -- 172.21.15.49:0/3724897298 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe9f405a510 msgr2=0x7fe9f405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.065+0000 7fea1be00700 1 --2- 172.21.15.49:0/3724897298 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe9f405a510 0x7fe9f405c9d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fea04007fd0 tx=0x7fea04009040).stop 2024-01-22T05:18:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.065+0000 7fea1be00700 1 -- 172.21.15.49:0/3724897298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1c0a7260 msgr2=0x7fea1c09f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.065+0000 7fea1be00700 1 --2- 172.21.15.49:0/3724897298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1c0a7260 0x7fea1c09f780 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7fea0c00c4c0 tx=0x7fea0c007e00).stop 2024-01-22T05:18:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.065+0000 7fea1be00700 1 -- 172.21.15.49:0/3724897298 shutdown_connections 2024-01-22T05:18:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.065+0000 7fea1be00700 1 --2- 172.21.15.49:0/3724897298 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe9f405a510 0x7fe9f405c9d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.065+0000 7fea1be00700 1 --2- 172.21.15.49:0/3724897298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea1c155c60 0x7fea1c168910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.065+0000 7fea1be00700 1 --2- 172.21.15.49:0/3724897298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fea1c155880 0x7fea1c09fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.065+0000 7fea1be00700 1 --2- 172.21.15.49:0/3724897298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1c0a7260 0x7fea1c09f780 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.065+0000 7fea1be00700 1 -- 172.21.15.49:0/3724897298 >> 172.21.15.49:0/3724897298 conn(0x7fea1c0c6530 msgr2=0x7fea1c0659b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:49.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.069+0000 7fea1be00700 1 -- 172.21.15.49:0/3724897298 shutdown_connections 2024-01-22T05:18:49.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.069+0000 7fea1be00700 1 -- 172.21.15.49:0/3724897298 wait complete. 2024-01-22T05:18:49.069 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 134 2024-01-22T05:18:49.090 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-01-22T05:18:49.267 INFO:teuthology.orchestra.run.smithi110.stdout:{"message":"","return_code":0} 2024-01-22T05:18:49.267 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-01-22T05:18:49.268 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent '' 2024-01-22T05:18:49.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f412798ed00 1 Processor -- start 2024-01-22T05:18:49.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f412798ed00 1 -- start start 2024-01-22T05:18:49.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f412798ed00 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef566299e0 0x55ef566cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f412798ed00 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ef566d02a0 0x55ef566ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f412798ed00 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef566ccee0 0x55ef566cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f412798ed00 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef56570220 con 0x55ef566299e0 2024-01-22T05:18:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f412798ed00 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef566286a0 con 0x55ef566ccee0 2024-01-22T05:18:49.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f412798ed00 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef566cd850 con 0x55ef566d02a0 2024-01-22T05:18:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f4124a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef566299e0 0x55ef566cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f4124a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef566299e0 0x55ef566cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39288/0 (socket says 172.21.15.49:39288) 2024-01-22T05:18:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f4125400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef566ccee0 0x55ef566cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f4124a00700 1 -- 172.21.15.49:0/897353651 learned_addr learned my addr 172.21.15.49:0/897353651 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f4124000700 1 --2- 172.21.15.49:0/897353651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ef566d02a0 0x55ef566ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f4124a00700 1 -- 172.21.15.49:0/897353651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ef566d02a0 msgr2=0x55ef566ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f4124a00700 1 --2- 172.21.15.49:0/897353651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ef566d02a0 0x55ef566ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f4124a00700 1 -- 172.21.15.49:0/897353651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef566ccee0 msgr2=0x55ef566cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f4124a00700 1 --2- 172.21.15.49:0/897353651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef566ccee0 0x55ef566cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f4124a00700 1 -- 172.21.15.49:0/897353651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4114005db0 con 0x55ef566299e0 2024-01-22T05:18:49.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f4125400700 1 --2- 172.21.15.49:0/897353651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef566ccee0 0x55ef566cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:49.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f4124a00700 1 --2- 172.21.15.49:0/897353651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef566299e0 0x55ef566cb1f0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f4114005860 tx=0x7f4114016000).ready entity=mon.0 client_cookie=6b214d340223a32a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f4122c00700 1 -- 172.21.15.49:0/897353651 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114000bc0 con 0x55ef566299e0 2024-01-22T05:18:49.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f4122c00700 1 -- 172.21.15.49:0/897353651 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41140089d0 con 0x55ef566299e0 2024-01-22T05:18:49.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.333+0000 7f4122c00700 1 -- 172.21.15.49:0/897353651 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114000d20 con 0x55ef566299e0 2024-01-22T05:18:49.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 -- 172.21.15.49:0/897353651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef566299e0 msgr2=0x55ef566cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 --2- 172.21.15.49:0/897353651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef566299e0 0x55ef566cb1f0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f4114005860 tx=0x7f4114016000).stop 2024-01-22T05:18:49.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 -- 172.21.15.49:0/897353651 shutdown_connections 2024-01-22T05:18:49.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 --2- 172.21.15.49:0/897353651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef566ccee0 0x55ef566cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 --2- 172.21.15.49:0/897353651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ef566d02a0 0x55ef566ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 --2- 172.21.15.49:0/897353651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef566299e0 0x55ef566cb1f0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 -- 172.21.15.49:0/897353651 >> 172.21.15.49:0/897353651 conn(0x55ef56647b20 msgr2=0x55ef566cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:49.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 -- 172.21.15.49:0/897353651 shutdown_connections 2024-01-22T05:18:49.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 -- 172.21.15.49:0/897353651 wait complete. 2024-01-22T05:18:49.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 Processor -- start 2024-01-22T05:18:49.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 -- start start 2024-01-22T05:18:49.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ef566299e0 0x55ef566c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef566ccee0 0x55ef566c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef566d02a0 0x55ef566c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef566cd660 con 0x55ef566d02a0 2024-01-22T05:18:49.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef566c7a80 con 0x55ef566ccee0 2024-01-22T05:18:49.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.337+0000 7f412798ed00 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef56643530 con 0x55ef566299e0 2024-01-22T05:18:49.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f4125400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef566d02a0 0x55ef566c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f4125400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef566d02a0 0x55ef566c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39292/0 (socket says 172.21.15.49:39292) 2024-01-22T05:18:49.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f4125400700 1 -- 172.21.15.49:0/3787893180 learned_addr learned my addr 172.21.15.49:0/3787893180 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:49.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f4124000700 1 --2- 172.21.15.49:0/3787893180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef566ccee0 0x55ef566c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f4124a00700 1 --2- 172.21.15.49:0/3787893180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ef566299e0 0x55ef566c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f4125400700 1 -- 172.21.15.49:0/3787893180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ef566299e0 msgr2=0x55ef566c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f4125400700 1 --2- 172.21.15.49:0/3787893180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ef566299e0 0x55ef566c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f4125400700 1 -- 172.21.15.49:0/3787893180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef566ccee0 msgr2=0x55ef566c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f4125400700 1 --2- 172.21.15.49:0/3787893180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef566ccee0 0x55ef566c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f4125400700 1 -- 172.21.15.49:0/3787893180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c0024c0 con 0x55ef566d02a0 2024-01-22T05:18:49.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f4124000700 1 --2- 172.21.15.49:0/3787893180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef566ccee0 0x55ef566c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:49.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f4125400700 1 --2- 172.21.15.49:0/3787893180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef566d02a0 0x55ef566c9010 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f411c010a60 tx=0x7f411c005d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f4120e00700 1 -- 172.21.15.49:0/3787893180 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c010ea0 con 0x55ef566d02a0 2024-01-22T05:18:49.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f4120e00700 1 -- 172.21.15.49:0/3787893180 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c002700 con 0x55ef566d02a0 2024-01-22T05:18:49.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f412798ed00 1 -- 172.21.15.49:0/3787893180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ef56599a20 con 0x55ef566d02a0 2024-01-22T05:18:49.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f4120e00700 1 -- 172.21.15.49:0/3787893180 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c00eb70 con 0x55ef566d02a0 2024-01-22T05:18:49.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.341+0000 7f412798ed00 1 -- 172.21.15.49:0/3787893180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef56599770 con 0x55ef566d02a0 2024-01-22T05:18:49.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.345+0000 7f4120e00700 1 -- 172.21.15.49:0/3787893180 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f411c003040 con 0x55ef566d02a0 2024-01-22T05:18:49.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.345+0000 7f4120e00700 1 --2- 172.21.15.49:0/3787893180 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40fc059020 0x7f40fc05b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.345+0000 7f4120e00700 1 -- 172.21.15.49:0/3787893180 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f411c074190 con 0x55ef566d02a0 2024-01-22T05:18:49.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.345+0000 7f4124a00700 1 --2- 172.21.15.49:0/3787893180 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40fc059020 0x7f40fc05b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.345+0000 7f412798ed00 1 --2- 172.21.15.49:0/3787893180 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x55ef566c20e0 0x55ef566c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.345+0000 7f412798ed00 1 -- 172.21.15.49:0/3787893180 --> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] -- osd_op(unknown.0.0:1 25.7 25:e2e07930:::10000000001.00000000:head [setxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected e172) v8 -- 0x55ef56645000 con 0x55ef566c20e0 2024-01-22T05:18:49.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.345+0000 7f4124000700 1 --2- 172.21.15.49:0/3787893180 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x55ef566c20e0 0x55ef566c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.345+0000 7f4124a00700 1 --2- 172.21.15.49:0/3787893180 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40fc059020 0x7f40fc05b4e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f411400a650 tx=0x7f411401c000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.349+0000 7f4124000700 1 --2- 172.21.15.49:0/3787893180 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x55ef566c20e0 0x55ef566c36b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.349+0000 7f4124000700 1 -- 172.21.15.49:0/3787893180 <== osd.0 v2:172.21.15.49:6808/22975 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr] v172'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f410c00eac0 con 0x55ef566c20e0 2024-01-22T05:18:49.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.349+0000 7f412798ed00 1 -- 172.21.15.49:0/3787893180 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x55ef566c20e0 msgr2=0x55ef566c36b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.349+0000 7f412798ed00 1 --2- 172.21.15.49:0/3787893180 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x55ef566c20e0 0x55ef566c36b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.349+0000 7f412798ed00 1 -- 172.21.15.49:0/3787893180 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40fc059020 msgr2=0x7f40fc05b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.349+0000 7f412798ed00 1 --2- 172.21.15.49:0/3787893180 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40fc059020 0x7f40fc05b4e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f411400a650 tx=0x7f411401c000).stop 2024-01-22T05:18:49.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.349+0000 7f412798ed00 1 -- 172.21.15.49:0/3787893180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef566d02a0 msgr2=0x55ef566c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.349+0000 7f412798ed00 1 --2- 172.21.15.49:0/3787893180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef566d02a0 0x55ef566c9010 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f411c010a60 tx=0x7f411c005d40).stop 2024-01-22T05:18:49.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.349+0000 7f4125400700 1 -- 172.21.15.49:0/3787893180 reap_dead start 2024-01-22T05:18:49.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.349+0000 7f412798ed00 1 -- 172.21.15.49:0/3787893180 shutdown_connections 2024-01-22T05:18:49.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.349+0000 7f412798ed00 1 -- 172.21.15.49:0/3787893180 >> 172.21.15.49:0/3787893180 conn(0x55ef56647b20 msgr2=0x55ef565f8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:49.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.353+0000 7f412798ed00 1 -- 172.21.15.49:0/3787893180 shutdown_connections 2024-01-22T05:18:49.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.353+0000 7f412798ed00 1 -- 172.21.15.49:0/3787893180 wait complete. 2024-01-22T05:18:49.356 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.11:0 scrub start / recursive,repair 2024-01-22T05:18:49.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.529+0000 7ff2e5c00700 1 Processor -- start 2024-01-22T05:18:49.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.529+0000 7ff2e5c00700 1 -- start start 2024-01-22T05:18:49.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.533+0000 7ff2e5c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff2e00c1d40 0x7ff2e00c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.533+0000 7ff2e5c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2e00bdab0 0x7ff2e00bdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.533+0000 7ff2e5c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e00c2de0 con 0x7ff2e00c3c10 2024-01-22T05:18:49.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.533+0000 7ff2e5c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e00c21d0 con 0x7ff2e00c1d40 2024-01-22T05:18:49.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.533+0000 7ff2e5c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e00c24b0 con 0x7ff2e00bdab0 2024-01-22T05:18:49.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.533+0000 7ff2dea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff2e00c1d40 0x7ff2e00c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.533+0000 7ff2dea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff2e00c1d40 0x7ff2e00c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39294/0 (socket says 172.21.15.49:39294) 2024-01-22T05:18:49.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.533+0000 7ff2dea00700 1 -- 172.21.15.49:0/838482918 learned_addr learned my addr 172.21.15.49:0/838482918 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:49.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.533+0000 7ff2de000700 1 --2- 172.21.15.49:0/838482918 >> v2:172.21.15.110:3300/0 conn(0x7ff2e00bdab0 0x7ff2e00bdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.533+0000 7ff2dea00700 1 -- 172.21.15.49:0/838482918 >> v2:172.21.15.110:3300/0 conn(0x7ff2e00bdab0 msgr2=0x7ff2e00bdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.533+0000 7ff2dea00700 1 --2- 172.21.15.49:0/838482918 >> v2:172.21.15.110:3300/0 conn(0x7ff2e00bdab0 0x7ff2e00bdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.533+0000 7ff2dea00700 1 -- 172.21.15.49:0/838482918 >> v1:172.21.15.110:6789/0 conn(0x7ff2e00c3c10 legacy=0x7ff2e00c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.533+0000 7ff2dea00700 1 -- 172.21.15.49:0/838482918 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e00c2790 con 0x7ff2e00c1d40 2024-01-22T05:18:49.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.533+0000 7ff2dea00700 1 --2- 172.21.15.49:0/838482918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2e00c1d40 0x7ff2e00c7eb0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7ff2e0095780 tx=0x7ff2d00090f0).ready entity=mon.0 client_cookie=46bc80a5e8537124 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.537+0000 7ff2dd600700 1 -- 172.21.15.49:0/838482918 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000b600 con 0x7ff2e00c1d40 2024-01-22T05:18:49.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.537+0000 7ff2dd600700 1 -- 172.21.15.49:0/838482918 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d000b760 con 0x7ff2e00c1d40 2024-01-22T05:18:49.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.537+0000 7ff2dd600700 1 -- 172.21.15.49:0/838482918 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000bb00 con 0x7ff2e00c1d40 2024-01-22T05:18:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.537+0000 7ff2e5c00700 1 -- 172.21.15.49:0/838482918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2e00c1d40 msgr2=0x7ff2e00c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.537+0000 7ff2e5c00700 1 --2- 172.21.15.49:0/838482918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2e00c1d40 0x7ff2e00c7eb0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7ff2e0095780 tx=0x7ff2d00090f0).stop 2024-01-22T05:18:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.537+0000 7ff2e5c00700 1 -- 172.21.15.49:0/838482918 shutdown_connections 2024-01-22T05:18:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.537+0000 7ff2e5c00700 1 --2- 172.21.15.49:0/838482918 >> v2:172.21.15.110:3300/0 conn(0x7ff2e00bdab0 0x7ff2e00bdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.537+0000 7ff2e5c00700 1 --2- 172.21.15.49:0/838482918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2e00c1d40 0x7ff2e00c7eb0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.537+0000 7ff2e5c00700 1 -- 172.21.15.49:0/838482918 >> 172.21.15.49:0/838482918 conn(0x7ff2e00aa720 msgr2=0x7ff2e00aab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.537+0000 7ff2e5c00700 1 -- 172.21.15.49:0/838482918 shutdown_connections 2024-01-22T05:18:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.537+0000 7ff2e5c00700 1 -- 172.21.15.49:0/838482918 wait complete. 2024-01-22T05:18:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.541+0000 7ff2e5c00700 1 Processor -- start 2024-01-22T05:18:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.545+0000 7ff2e5c00700 1 -- start start 2024-01-22T05:18:49.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.545+0000 7ff2e5c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2e00bdab0 0x7ff2e00c01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.545+0000 7ff2e5c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e00c3c10 0x7ff2e00bdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.545+0000 7ff2e5c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e00be400 0x7ff2e0069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.545+0000 7ff2e5c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00bf5a0 con 0x7ff2e00bdab0 2024-01-22T05:18:49.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.545+0000 7ff2e5c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00be990 con 0x7ff2e00be400 2024-01-22T05:18:49.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.545+0000 7ff2e5c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00bec70 con 0x7ff2e00c3c10 2024-01-22T05:18:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.545+0000 7ff2dea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2e00bdab0 0x7ff2e00c01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.545+0000 7ff2dea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2e00bdab0 0x7ff2e00c01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39298/0 (socket says 172.21.15.49:39298) 2024-01-22T05:18:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.545+0000 7ff2de000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e00c3c10 0x7ff2e00bdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.545+0000 7ff2dea00700 1 -- 172.21.15.49:0/3934076475 learned_addr learned my addr 172.21.15.49:0/3934076475 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.545+0000 7ff2df400700 1 --2- 172.21.15.49:0/3934076475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e00be400 0x7ff2e0069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.549+0000 7ff2dea00700 1 -- 172.21.15.49:0/3934076475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e00c3c10 msgr2=0x7ff2e00bdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.549+0000 7ff2dea00700 1 --2- 172.21.15.49:0/3934076475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e00c3c10 0x7ff2e00bdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.549+0000 7ff2dea00700 1 -- 172.21.15.49:0/3934076475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e00be400 msgr2=0x7ff2e0069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.549+0000 7ff2dea00700 1 --2- 172.21.15.49:0/3934076475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e00be400 0x7ff2e0069aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.549+0000 7ff2dea00700 1 -- 172.21.15.49:0/3934076475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d0009370 con 0x7ff2e00bdab0 2024-01-22T05:18:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.549+0000 7ff2dea00700 1 --2- 172.21.15.49:0/3934076475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2e00bdab0 0x7ff2e00c01d0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7ff2e0065ff0 tx=0x7ff2d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.549+0000 7ff2d6000700 1 -- 172.21.15.49:0/3934076475 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0006d90 con 0x7ff2e00bdab0 2024-01-22T05:18:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.549+0000 7ff2d6000700 1 -- 172.21.15.49:0/3934076475 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d000bec0 con 0x7ff2e00bdab0 2024-01-22T05:18:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.549+0000 7ff2e5c00700 1 -- 172.21.15.49:0/3934076475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e00bef50 con 0x7ff2e00bdab0 2024-01-22T05:18:49.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.549+0000 7ff2d6000700 1 -- 172.21.15.49:0/3934076475 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0024470 con 0x7ff2e00bdab0 2024-01-22T05:18:49.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.549+0000 7ff2e5c00700 1 -- 172.21.15.49:0/3934076475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e00a9a30 con 0x7ff2e00bdab0 2024-01-22T05:18:49.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.553+0000 7ff2d6000700 1 -- 172.21.15.49:0/3934076475 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff2d0021070 con 0x7ff2e00bdab0 2024-01-22T05:18:49.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.553+0000 7ff2d6000700 1 --2- 172.21.15.49:0/3934076475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff2b805a510 0x7ff2b805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.553+0000 7ff2d6000700 1 -- 172.21.15.49:0/3934076475 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff2d0076230 con 0x7ff2e00bdab0 2024-01-22T05:18:49.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.553+0000 7ff2de000700 1 --2- 172.21.15.49:0/3934076475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff2b805a510 0x7ff2b805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.557+0000 7ff2de000700 1 --2- 172.21.15.49:0/3934076475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff2b805a510 0x7ff2b805c9d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7ff2e0154140 tx=0x7ff2c8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.557+0000 7ff2f013c740 1 Processor -- start 2024-01-22T05:18:49.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.557+0000 7ff2f013c740 1 -- start start 2024-01-22T05:18:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.557+0000 7ff2f013c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf53b10 0xf53ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.557+0000 7ff2f013c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf0e540 0xf0e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.557+0000 7ff2f013c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf080d0 0xf08550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2f013c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xe6c5b0 con 0xf080d0 2024-01-22T05:18:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2f013c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xe30000 con 0xf0e540 2024-01-22T05:18:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2f013c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xe5b0c0 con 0xf53b10 2024-01-22T05:18:49.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2df400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf080d0 0xf08550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2dea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf53b10 0xf53ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2df400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf080d0 0xf08550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39312/0 (socket says 172.21.15.49:39312) 2024-01-22T05:18:49.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2dea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf53b10 0xf53ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:48590/0 (socket says 172.21.15.49:48590) 2024-01-22T05:18:49.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2df400700 1 -- 172.21.15.49:0/2020898415 learned_addr learned my addr 172.21.15.49:0/2020898415 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:49.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2de000700 1 --2- 172.21.15.49:0/2020898415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf0e540 0xf0e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2df400700 1 -- 172.21.15.49:0/2020898415 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf53b10 msgr2=0xf53ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2df400700 1 --2- 172.21.15.49:0/2020898415 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf53b10 0xf53ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2df400700 1 -- 172.21.15.49:0/2020898415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf0e540 msgr2=0xf0e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2df400700 1 --2- 172.21.15.49:0/2020898415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf0e540 0xf0e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2df400700 1 -- 172.21.15.49:0/2020898415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe89890 con 0xf080d0 2024-01-22T05:18:49.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2df400700 1 --2- 172.21.15.49:0/2020898415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf080d0 0xf08550 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7ff2d8001be0 tx=0x7ff2d8009040).ready entity=mon.0 client_cookie=dbd89a15e3793e5b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2cea00700 1 -- 172.21.15.49:0/2020898415 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8001820 con 0xf080d0 2024-01-22T05:18:49.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2cea00700 1 -- 172.21.15.49:0/2020898415 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d800f630 con 0xf080d0 2024-01-22T05:18:49.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2cea00700 1 -- 172.21.15.49:0/2020898415 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d800f9b0 con 0xf080d0 2024-01-22T05:18:49.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2f013c740 1 -- 172.21.15.49:0/2020898415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf080d0 msgr2=0xf08550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2f013c740 1 --2- 172.21.15.49:0/2020898415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf080d0 0xf08550 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7ff2d8001be0 tx=0x7ff2d8009040).stop 2024-01-22T05:18:49.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2f013c740 1 -- 172.21.15.49:0/2020898415 shutdown_connections 2024-01-22T05:18:49.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2f013c740 1 --2- 172.21.15.49:0/2020898415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf080d0 0xf08550 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2f013c740 1 --2- 172.21.15.49:0/2020898415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf0e540 0xf0e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2f013c740 1 --2- 172.21.15.49:0/2020898415 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf53b10 0xf53ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2f013c740 1 -- 172.21.15.49:0/2020898415 >> 172.21.15.49:0/2020898415 conn(0xcee7f0 msgr2=0xf0d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:49.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2f013c740 1 -- 172.21.15.49:0/2020898415 shutdown_connections 2024-01-22T05:18:49.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.561+0000 7ff2f013c740 1 -- 172.21.15.49:0/2020898415 wait complete. 2024-01-22T05:18:49.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.565+0000 7ff2f013c740 1 -- start start 2024-01-22T05:18:49.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.565+0000 7ff2f013c740 1 Processor -- start 2024-01-22T05:18:49.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.565+0000 7ff2f013c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf080d0 0xf4d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.565+0000 7ff2f013c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf0e540 0xf4d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.565+0000 7ff2f013c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf53b10 0xf51700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.565+0000 7ff2f013c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xf61250 con 0xf0e540 2024-01-22T05:18:49.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.565+0000 7ff2f013c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xf0cbc0 con 0xf080d0 2024-01-22T05:18:49.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.565+0000 7ff2f013c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xf0bff0 con 0xf53b10 2024-01-22T05:18:49.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.565+0000 7ff2f013c740 10 client.0 ll_register_callbacks cb 0xe86710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:18:49.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.565+0000 7ff2de000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf0e540 0xf4d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2de000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf0e540 0xf4d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39328/0 (socket says 172.21.15.49:39328) 2024-01-22T05:18:49.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2de000700 1 -- 172.21.15.49:0/406001267 learned_addr learned my addr 172.21.15.49:0/406001267 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:49.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2dea00700 1 --2- 172.21.15.49:0/406001267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf080d0 0xf4d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2df400700 1 --2- 172.21.15.49:0/406001267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf53b10 0xf51700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2de000700 1 -- 172.21.15.49:0/406001267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf53b10 msgr2=0xf51700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2de000700 1 --2- 172.21.15.49:0/406001267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf53b10 0xf51700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2de000700 1 -- 172.21.15.49:0/406001267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf080d0 msgr2=0xf4d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2de000700 1 --2- 172.21.15.49:0/406001267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf080d0 0xf4d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2de000700 1 -- 172.21.15.49:0/406001267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e00c2de0 con 0xf0e540 2024-01-22T05:18:49.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2de000700 1 --2- 172.21.15.49:0/406001267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf0e540 0xf4d5f0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7ff2e014d090 tx=0x7ff2c8015000).ready entity=mon.0 client_cookie=3db7c356e014bed server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2c7400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:18:49.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2c7400700 1 -- 172.21.15.49:0/406001267 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c80136b0 con 0xf0e540 2024-01-22T05:18:49.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2f013c740 1 -- 172.21.15.49:0/406001267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe86300 con 0xf0e540 2024-01-22T05:18:49.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2c7400700 1 -- 172.21.15.49:0/406001267 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff2c8013810 con 0xf0e540 2024-01-22T05:18:49.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2c7400700 1 -- 172.21.15.49:0/406001267 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2c8013c30 con 0xf0e540 2024-01-22T05:18:49.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2f013c740 10 client.9918 fetch_fsmap learned FSMap version 134 2024-01-22T05:18:49.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2f013c740 1 -- 172.21.15.49:0/406001267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=2+}) v3 -- 0xe84ac0 con 0xf0e540 2024-01-22T05:18:49.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2c7400700 1 -- 172.21.15.49:0/406001267 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe86300 con 0xf0e540 2024-01-22T05:18:49.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2c7400700 1 -- 172.21.15.49:0/406001267 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 134) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff2c8028350 con 0xf0e540 2024-01-22T05:18:49.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2f013c740 10 client.9918 fetch_fsmap finished waiting for FSMap version 134 2024-01-22T05:18:49.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2f013c740 10 client.9918 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.b 2024-01-22T05:18:49.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2f013c740 20 client.9918 populate_metadata read hostname 'smithi049' 2024-01-22T05:18:49.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2f013c740 1 --2- 172.21.15.49:0/406001267 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0xf0d0f0 0xf0d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2f013c740 4 client.9918 mds_command: new command op to 9610 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:18:49.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2f013c740 1 -- 172.21.15.49:0/406001267 --> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xe7c850 con 0xf0d0f0 2024-01-22T05:18:49.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.569+0000 7ff2dea00700 1 --2- 172.21.15.49:0/406001267 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0xf0d0f0 0xf0d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2dea00700 1 --2- 172.21.15.49:0/406001267 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0xf0d0f0 0xf0d4d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=41ebda603eed89f7 server_cookie=45f5b739f5caf320 in_seq=0 out_seq=0 2024-01-22T05:18:49.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2c7400700 10 client.9918 ms_handle_connect on v2:172.21.15.110:6834/2192470330 2024-01-22T05:18:49.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2c7400700 1 -- 172.21.15.49:0/406001267 <== mds.0 v2:172.21.15.110:6834/2192470330 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xe7c850 con 0xf0d0f0 2024-01-22T05:18:49.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2c7400700 10 client.9918 handle_command_reply: tid=0 2024-01-22T05:18:49.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2f013c740 1 client.9918 shutdown 2024-01-22T05:18:49.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2f013c740 1 -- 172.21.15.49:0/406001267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf0e540 msgr2=0xf4d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2f013c740 1 --2- 172.21.15.49:0/406001267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf0e540 0xf4d5f0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7ff2e014d090 tx=0x7ff2c8015000).stop 2024-01-22T05:18:49.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2f013c740 1 -- 172.21.15.49:0/406001267 shutdown_connections 2024-01-22T05:18:49.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2f013c740 1 --2- 172.21.15.49:0/406001267 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0xf0d0f0 0xf0d4d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2f013c740 1 --2- 172.21.15.49:0/406001267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf53b10 0xf51700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2f013c740 1 --2- 172.21.15.49:0/406001267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf0e540 0xf4d5f0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2f013c740 1 --2- 172.21.15.49:0/406001267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf080d0 0xf4d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2c7400700 0 client.9918 ms_handle_reset on v2:172.21.15.110:6834/2192470330 2024-01-22T05:18:49.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2f013c740 1 -- 172.21.15.49:0/406001267 >> 172.21.15.49:0/406001267 conn(0xcee7f0 msgr2=0xf55e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:49.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2f013c740 1 -- 172.21.15.49:0/406001267 shutdown_connections 2024-01-22T05:18:49.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.573+0000 7ff2f013c740 1 -- 172.21.15.49:0/406001267 wait complete. 2024-01-22T05:18:49.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.577+0000 7ff2f013c740 20 client.9918 trim_cache size 0 max 16384 2024-01-22T05:18:49.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.593+0000 7ff2f013c740 1 Processor -- start 2024-01-22T05:18:49.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.593+0000 7ff2f013c740 1 -- start start 2024-01-22T05:18:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.593+0000 7ff2f013c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf080d0 0xf4f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.593+0000 7ff2f013c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf0e540 0xf08a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.593+0000 7ff2f013c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf53b10 0xf08f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.593+0000 7ff2f013c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xf32120 con 0xf0e540 2024-01-22T05:18:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.593+0000 7ff2f013c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xf4f6c0 con 0xf53b10 2024-01-22T05:18:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.593+0000 7ff2f013c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xf4cb40 con 0xf080d0 2024-01-22T05:18:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2de000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf0e540 0xf08a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2df400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf53b10 0xf08f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2dea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf080d0 0xf4f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2df400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf53b10 0xf08f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:60376/0 (socket says 172.21.15.49:60376) 2024-01-22T05:18:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2df400700 1 -- 172.21.15.49:0/1351829753 learned_addr learned my addr 172.21.15.49:0/1351829753 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2df400700 1 -- 172.21.15.49:0/1351829753 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf080d0 msgr2=0xf4f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2df400700 1 --2- 172.21.15.49:0/1351829753 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf080d0 0xf4f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2df400700 1 -- 172.21.15.49:0/1351829753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf0e540 msgr2=0xf08a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2df400700 1 --2- 172.21.15.49:0/1351829753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf0e540 0xf08a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2df400700 1 -- 172.21.15.49:0/1351829753 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e006a2f0 con 0xf53b10 2024-01-22T05:18:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2df400700 1 --2- 172.21.15.49:0/1351829753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf53b10 0xf08f40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7ff2d800f350 tx=0x7ff2d8019000).ready entity=mon.1 client_cookie=61bd425499a8166d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2cf400700 1 -- 172.21.15.49:0/1351829753 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d800fd20 con 0xf53b10 2024-01-22T05:18:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2cf400700 1 -- 172.21.15.49:0/1351829753 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d800fe80 con 0xf53b10 2024-01-22T05:18:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2cf400700 1 -- 172.21.15.49:0/1351829753 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8006a20 con 0xf53b10 2024-01-22T05:18:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2f013c740 1 -- 172.21.15.49:0/1351829753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf53b10 msgr2=0xf08f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2f013c740 1 --2- 172.21.15.49:0/1351829753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf53b10 0xf08f40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7ff2d800f350 tx=0x7ff2d8019000).stop 2024-01-22T05:18:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2f013c740 1 -- 172.21.15.49:0/1351829753 shutdown_connections 2024-01-22T05:18:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2f013c740 1 --2- 172.21.15.49:0/1351829753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf53b10 0xf08f40 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2f013c740 1 --2- 172.21.15.49:0/1351829753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf0e540 0xf08a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2f013c740 1 --2- 172.21.15.49:0/1351829753 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf080d0 0xf4f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2f013c740 1 -- 172.21.15.49:0/1351829753 >> 172.21.15.49:0/1351829753 conn(0xcee7f0 msgr2=0xf31670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2f013c740 1 -- 172.21.15.49:0/1351829753 shutdown_connections 2024-01-22T05:18:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.597+0000 7ff2f013c740 1 -- 172.21.15.49:0/1351829753 wait complete. 2024-01-22T05:18:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.601+0000 7ff2f013c740 1 -- start start 2024-01-22T05:18:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.601+0000 7ff2f013c740 1 Processor -- start 2024-01-22T05:18:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.601+0000 7ff2f013c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf080d0 0xf6f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.601+0000 7ff2f013c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf0e540 0xf6fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.601+0000 7ff2f013c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf53b10 0xfb7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.601+0000 7ff2f013c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0xf70110 con 0xf080d0 2024-01-22T05:18:49.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.601+0000 7ff2f013c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0xf33800 con 0xf53b10 2024-01-22T05:18:49.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.601+0000 7ff2f013c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0xf729c0 con 0xf0e540 2024-01-22T05:18:49.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.601+0000 7ff2f013c740 10 client.0 ll_register_callbacks cb 0x7ff2c8010c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:18:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.601+0000 7ff2dea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf080d0 0xf6f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.601+0000 7ff2dea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf080d0 0xf6f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39342/0 (socket says 172.21.15.49:39342) 2024-01-22T05:18:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.601+0000 7ff2dea00700 1 -- 172.21.15.49:0/3772567512 learned_addr learned my addr 172.21.15.49:0/3772567512 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.601+0000 7ff2df400700 1 --2- 172.21.15.49:0/3772567512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf53b10 0xfb7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2de000700 1 --2- 172.21.15.49:0/3772567512 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf0e540 0xf6fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2dea00700 1 -- 172.21.15.49:0/3772567512 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf0e540 msgr2=0xf6fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2dea00700 1 --2- 172.21.15.49:0/3772567512 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf0e540 0xf6fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2dea00700 1 -- 172.21.15.49:0/3772567512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf53b10 msgr2=0xfb7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2dea00700 1 --2- 172.21.15.49:0/3772567512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf53b10 0xfb7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2dea00700 1 -- 172.21.15.49:0/3772567512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xe89890 con 0xf080d0 2024-01-22T05:18:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2dea00700 1 --2- 172.21.15.49:0/3772567512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf080d0 0xf6f730 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7ff2d0049a70 tx=0x7ff2d004f040).ready entity=mon.0 client_cookie=42b791593871d9c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2c7400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:18:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2c7400700 1 -- 172.21.15.49:0/3772567512 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0033040 con 0xf080d0 2024-01-22T05:18:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2c7400700 1 -- 172.21.15.49:0/3772567512 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7ff2d0010e30 con 0xf080d0 2024-01-22T05:18:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2f013c740 1 -- 172.21.15.49:0/3772567512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xf537f0 con 0xf080d0 2024-01-22T05:18:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2c7400700 1 -- 172.21.15.49:0/3772567512 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2d004d510 con 0xf080d0 2024-01-22T05:18:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2f013c740 10 client.9924 fetch_fsmap learned FSMap version 134 2024-01-22T05:18:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2f013c740 1 -- 172.21.15.49:0/3772567512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=2+}) v3 -- 0xe84810 con 0xf080d0 2024-01-22T05:18:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2c7400700 1 -- 172.21.15.49:0/3772567512 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xf537f0 con 0xf080d0 2024-01-22T05:18:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2c7400700 1 -- 172.21.15.49:0/3772567512 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 134) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff2d0049c80 con 0xf080d0 2024-01-22T05:18:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2f013c740 10 client.9924 fetch_fsmap finished waiting for FSMap version 134 2024-01-22T05:18:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2f013c740 10 client.9924 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.b 2024-01-22T05:18:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2f013c740 20 client.9924 populate_metadata read hostname 'smithi049' 2024-01-22T05:18:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2f013c740 1 --2- 172.21.15.49:0/3772567512 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0xf63de0 0xfb81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2f013c740 4 client.9924 mds_command: new command op to 9610 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-01-22T05:18:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2f013c740 1 -- 172.21.15.49:0/3772567512 --> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) v1 -- 0x7ff2d800f630 con 0xf63de0 2024-01-22T05:18:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2de000700 1 --2- 172.21.15.49:0/3772567512 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0xf63de0 0xfb81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2c7400700 10 client.9924 ms_handle_connect on v2:172.21.15.110:6834/2192470330 2024-01-22T05:18:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.605+0000 7ff2de000700 1 --2- 172.21.15.49:0/3772567512 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0xf63de0 0xfb81f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b0a6a0095411e1a3 server_cookie=1484a62bcf60e36b in_seq=0 out_seq=0 2024-01-22T05:18:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.609+0000 7ff2c7400700 1 -- 172.21.15.49:0/3772567512 <== mds.0 v2:172.21.15.110:6834/2192470330 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7ff2d800f630 con 0xf63de0 2024-01-22T05:18:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.609+0000 7ff2c7400700 10 client.9924 handle_command_reply: tid=0 2024-01-22T05:18:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.609+0000 7ff2f013c740 1 client.9924 shutdown 2024-01-22T05:18:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.609+0000 7ff2f013c740 1 -- 172.21.15.49:0/3772567512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf080d0 msgr2=0xf6f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.609+0000 7ff2f013c740 1 --2- 172.21.15.49:0/3772567512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf080d0 0xf6f730 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7ff2d0049a70 tx=0x7ff2d004f040).stop 2024-01-22T05:18:49.609 INFO:tasks.ceph.mds.b.smithi110.stderr:2024-01-22T05:18:49.599+0000 7f61bc400700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2024-01-22T05:18:47.965529+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={8357=0-12582912@1} caps={8357=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=8357 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5610bb9ff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(25)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-22T05:18:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.609+0000 7ff2f013c740 1 -- 172.21.15.49:0/3772567512 shutdown_connections 2024-01-22T05:18:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.609+0000 7ff2f013c740 1 --2- 172.21.15.49:0/3772567512 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0xf63de0 0xfb81f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.609+0000 7ff2f013c740 1 --2- 172.21.15.49:0/3772567512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0xf53b10 0xfb7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.609+0000 7ff2f013c740 1 --2- 172.21.15.49:0/3772567512 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0xf0e540 0xf6fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.609+0000 7ff2f013c740 1 --2- 172.21.15.49:0/3772567512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0xf080d0 0xf6f730 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.609+0000 7ff2c7400700 0 client.9924 ms_handle_reset on v2:172.21.15.110:6834/2192470330 2024-01-22T05:18:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.609+0000 7ff2f013c740 1 -- 172.21.15.49:0/3772567512 >> 172.21.15.49:0/3772567512 conn(0xcee7f0 msgr2=0xf08bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.609+0000 7ff2f013c740 1 -- 172.21.15.49:0/3772567512 shutdown_connections 2024-01-22T05:18:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.609+0000 7ff2f013c740 1 -- 172.21.15.49:0/3772567512 wait complete. 2024-01-22T05:18:49.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.609+0000 7ff2f013c740 20 client.9924 trim_cache size 0 max 16384 2024-01-22T05:18:49.610 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:18:49.610 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:18:49.610 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "e2c31bd5-1b4c-4c41-8c91-d05653da9877", 2024-01-22T05:18:49.610 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:18:49.611 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:18:49.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.613+0000 7ff2e5c00700 1 -- 172.21.15.49:0/3934076475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff2b805a510 msgr2=0x7ff2b805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.613+0000 7ff2e5c00700 1 --2- 172.21.15.49:0/3934076475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff2b805a510 0x7ff2b805c9d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7ff2e0154140 tx=0x7ff2c8008040).stop 2024-01-22T05:18:49.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.613+0000 7ff2e5c00700 1 -- 172.21.15.49:0/3934076475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2e00bdab0 msgr2=0x7ff2e00c01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.613+0000 7ff2e5c00700 1 --2- 172.21.15.49:0/3934076475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2e00bdab0 0x7ff2e00c01d0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7ff2e0065ff0 tx=0x7ff2d0017000).stop 2024-01-22T05:18:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.613+0000 7ff2e5c00700 1 -- 172.21.15.49:0/3934076475 shutdown_connections 2024-01-22T05:18:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.613+0000 7ff2e5c00700 1 --2- 172.21.15.49:0/3934076475 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff2b805a510 0x7ff2b805c9d0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.613+0000 7ff2e5c00700 1 --2- 172.21.15.49:0/3934076475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e00be400 0x7ff2e0069aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.613+0000 7ff2e5c00700 1 --2- 172.21.15.49:0/3934076475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e00c3c10 0x7ff2e00bdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.613+0000 7ff2e5c00700 1 --2- 172.21.15.49:0/3934076475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2e00bdab0 0x7ff2e00c01d0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.613+0000 7ff2e5c00700 1 -- 172.21.15.49:0/3934076475 >> 172.21.15.49:0/3934076475 conn(0x7ff2e00aa720 msgr2=0x7ff2e00c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.613+0000 7ff2e5c00700 1 -- 172.21.15.49:0/3934076475 shutdown_connections 2024-01-22T05:18:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.613+0000 7ff2e5c00700 1 -- 172.21.15.49:0/3934076475 wait complete. 2024-01-22T05:18:49.638 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.11:0 scrub status 2024-01-22T05:18:49.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.813+0000 7fc2b5e00700 1 Processor -- start 2024-01-22T05:18:49.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.813+0000 7fc2b5e00700 1 -- start start 2024-01-22T05:18:49.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.817+0000 7fc2b5e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc2b00a8b10 0x7fc2b0066d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.817+0000 7fc2b5e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2b0067220 0x7fc2b0067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.817+0000 7fc2b5e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b00683d0 con 0x7fc2b0067f80 2024-01-22T05:18:49.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.817+0000 7fc2b5e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b00bc680 con 0x7fc2b0067220 2024-01-22T05:18:49.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.817+0000 7fc2b5e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b0066600 con 0x7fc2b00a8b10 2024-01-22T05:18:49.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.821+0000 7fc2afe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2b0067220 0x7fc2b0067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.821+0000 7fc2afe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2b0067220 0x7fc2b0067a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39350/0 (socket says 172.21.15.49:39350) 2024-01-22T05:18:49.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.821+0000 7fc2afe00700 1 -- 172.21.15.49:0/2358414481 learned_addr learned my addr 172.21.15.49:0/2358414481 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:49.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.821+0000 7fc2b5400700 1 --1- 172.21.15.49:0/2358414481 >> v1:172.21.15.49:6789/0 conn(0x7fc2b0067f80 0x7fc2b0157760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55642/0 (socket says 172.21.15.49:55642) 2024-01-22T05:18:49.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.821+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/2358414481 >> v2:172.21.15.110:3300/0 conn(0x7fc2b00a8b10 0x7fc2b0066d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.821+0000 7fc2afe00700 1 -- 172.21.15.49:0/2358414481 >> v2:172.21.15.110:3300/0 conn(0x7fc2b00a8b10 msgr2=0x7fc2b0066d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.821+0000 7fc2afe00700 1 --2- 172.21.15.49:0/2358414481 >> v2:172.21.15.110:3300/0 conn(0x7fc2b00a8b10 0x7fc2b0066d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.821+0000 7fc2afe00700 1 -- 172.21.15.49:0/2358414481 >> v1:172.21.15.49:6789/0 conn(0x7fc2b0067f80 legacy=0x7fc2b0157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.821+0000 7fc2af400700 1 -- 172.21.15.49:0/2358414481 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942864300 0 0) 0x7fc2b00683d0 con 0x7fc2b0067f80 2024-01-22T05:18:49.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.821+0000 7fc2afe00700 1 -- 172.21.15.49:0/2358414481 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b00bbde0 con 0x7fc2b0067220 2024-01-22T05:18:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.821+0000 7fc2afe00700 1 --2- 172.21.15.49:0/2358414481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b0067220 0x7fc2b0067a90 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7fc2b00651e0 tx=0x7fc2980090f0).ready entity=mon.0 client_cookie=8f47a35b134f27d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.821+0000 7fc2af400700 1 -- 172.21.15.49:0/2358414481 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29800b520 con 0x7fc2b0067220 2024-01-22T05:18:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.821+0000 7fc2af400700 1 -- 172.21.15.49:0/2358414481 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29800b680 con 0x7fc2b0067220 2024-01-22T05:18:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.821+0000 7fc2af400700 1 -- 172.21.15.49:0/2358414481 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29800ba00 con 0x7fc2b0067220 2024-01-22T05:18:49.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.825+0000 7fc2b5e00700 1 -- 172.21.15.49:0/2358414481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b0067220 msgr2=0x7fc2b0067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.825+0000 7fc2b5e00700 1 --2- 172.21.15.49:0/2358414481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b0067220 0x7fc2b0067a90 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7fc2b00651e0 tx=0x7fc2980090f0).stop 2024-01-22T05:18:49.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.825+0000 7fc2b5e00700 1 -- 172.21.15.49:0/2358414481 shutdown_connections 2024-01-22T05:18:49.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.825+0000 7fc2b5e00700 1 --2- 172.21.15.49:0/2358414481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b0067220 0x7fc2b0067a90 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.825+0000 7fc2b5e00700 1 --2- 172.21.15.49:0/2358414481 >> v2:172.21.15.110:3300/0 conn(0x7fc2b00a8b10 0x7fc2b0066d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.825+0000 7fc2b5e00700 1 -- 172.21.15.49:0/2358414481 >> 172.21.15.49:0/2358414481 conn(0x7fc2b00c6540 msgr2=0x7fc2b00c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:49.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.825+0000 7fc2b5e00700 1 -- 172.21.15.49:0/2358414481 shutdown_connections 2024-01-22T05:18:49.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.825+0000 7fc2b5e00700 1 -- 172.21.15.49:0/2358414481 wait complete. 2024-01-22T05:18:49.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.829+0000 7fc2b5e00700 1 Processor -- start 2024-01-22T05:18:49.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.829+0000 7fc2b5e00700 1 -- start start 2024-01-22T05:18:49.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b0067220 0x7fc2b00be4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2b0067f80 0x7fc2b0148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b5e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b00a8b10 0x7fc2b00aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b5e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00be9c0 con 0x7fc2b0067220 2024-01-22T05:18:49.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b5e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00abb50 con 0x7fc2b00a8b10 2024-01-22T05:18:49.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00aaf40 con 0x7fc2b0067f80 2024-01-22T05:18:49.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b4a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b0067220 0x7fc2b00be4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b4a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b0067220 0x7fc2b00be4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39364/0 (socket says 172.21.15.49:39364) 2024-01-22T05:18:49.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b4a00700 1 -- 172.21.15.49:0/3701652566 learned_addr learned my addr 172.21.15.49:0/3701652566 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:49.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b5400700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b00a8b10 0x7fc2b00aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2afe00700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2b0067f80 0x7fc2b0148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b4a00700 1 -- 172.21.15.49:0/3701652566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2b0067f80 msgr2=0x7fc2b0148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2b0067f80 0x7fc2b0148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b4a00700 1 -- 172.21.15.49:0/3701652566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b00a8b10 msgr2=0x7fc2b00aa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b00a8b10 0x7fc2b00aa6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b4a00700 1 -- 172.21.15.49:0/3701652566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc298009370 con 0x7fc2b0067220 2024-01-22T05:18:49.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b5400700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b00a8b10 0x7fc2b00aa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:49.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2afe00700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2b0067f80 0x7fc2b0148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:49.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b0067220 0x7fc2b00be4d0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7fc2a000e930 tx=0x7fc2a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2a7e00700 1 -- 172.21.15.49:0/3701652566 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000eed0 con 0x7fc2b0067220 2024-01-22T05:18:49.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2a7e00700 1 -- 172.21.15.49:0/3701652566 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a000c850 con 0x7fc2b0067220 2024-01-22T05:18:49.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b5e00700 1 -- 172.21.15.49:0/3701652566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b00ab220 con 0x7fc2b0067220 2024-01-22T05:18:49.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2a7e00700 1 -- 172.21.15.49:0/3701652566 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000cbd0 con 0x7fc2b0067220 2024-01-22T05:18:49.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.833+0000 7fc2b5e00700 1 -- 172.21.15.49:0/3701652566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b00ab7e0 con 0x7fc2b0067220 2024-01-22T05:18:49.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.837+0000 7fc2a7e00700 1 -- 172.21.15.49:0/3701652566 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc2a001b400 con 0x7fc2b0067220 2024-01-22T05:18:49.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.837+0000 7fc2a7e00700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc28805a540 0x7fc28805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.837+0000 7fc2a7e00700 1 -- 172.21.15.49:0/3701652566 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc2a0074f00 con 0x7fc2b0067220 2024-01-22T05:18:49.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.837+0000 7fc2afe00700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc28805a540 0x7fc28805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.837+0000 7fc2afe00700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc28805a540 0x7fc28805ca00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7fc298009130 tx=0x7fc298017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.841+0000 7fc2c18c1740 1 Processor -- start 2024-01-22T05:18:49.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.841+0000 7fc2c18c1740 1 -- start start 2024-01-22T05:18:49.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2c18c1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cbf4d0 0x1cbf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2c18c1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6570 0x1cc69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2c18c1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cc6ee0 0x1ca54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2c18c1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bd7540 con 0x1cbf4d0 2024-01-22T05:18:49.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2c18c1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b9ae90 con 0x1cc6ee0 2024-01-22T05:18:49.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2c18c1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ba0d90 con 0x1cc6570 2024-01-22T05:18:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2b4a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cbf4d0 0x1cbf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2b4a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cbf4d0 0x1cbf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39374/0 (socket says 172.21.15.49:39374) 2024-01-22T05:18:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2b4a00700 1 -- 172.21.15.49:0/2189966733 learned_addr learned my addr 172.21.15.49:0/2189966733 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2afe00700 1 --2- 172.21.15.49:0/2189966733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6570 0x1cc69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2b5400700 1 --2- 172.21.15.49:0/2189966733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cc6ee0 0x1ca54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2b4a00700 1 -- 172.21.15.49:0/2189966733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6570 msgr2=0x1cc69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/2189966733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6570 0x1cc69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2b4a00700 1 -- 172.21.15.49:0/2189966733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cc6ee0 msgr2=0x1ca54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/2189966733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cc6ee0 0x1ca54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2b4a00700 1 -- 172.21.15.49:0/2189966733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c054c0 con 0x1cbf4d0 2024-01-22T05:18:49.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/2189966733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cbf4d0 0x1cbf8b0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7fc2a004bf00 tx=0x7fc2a0011000).ready entity=mon.0 client_cookie=d5959716c991dd39 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc29fe00700 1 -- 172.21.15.49:0/2189966733 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0072ef0 con 0x1cbf4d0 2024-01-22T05:18:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc29fe00700 1 -- 172.21.15.49:0/2189966733 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a0073050 con 0x1cbf4d0 2024-01-22T05:18:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.845+0000 7fc29fe00700 1 -- 172.21.15.49:0/2189966733 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a004b780 con 0x1cbf4d0 2024-01-22T05:18:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.849+0000 7fc2c18c1740 1 -- 172.21.15.49:0/2189966733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cbf4d0 msgr2=0x1cbf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.849+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/2189966733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cbf4d0 0x1cbf8b0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7fc2a004bf00 tx=0x7fc2a0011000).stop 2024-01-22T05:18:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.849+0000 7fc2c18c1740 1 -- 172.21.15.49:0/2189966733 shutdown_connections 2024-01-22T05:18:49.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.849+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/2189966733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cc6ee0 0x1ca54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.849+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/2189966733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6570 0x1cc69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.849+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/2189966733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cbf4d0 0x1cbf8b0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.849+0000 7fc2c18c1740 1 -- 172.21.15.49:0/2189966733 >> 172.21.15.49:0/2189966733 conn(0x1a59680 msgr2=0x1c78de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:49.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.849+0000 7fc2c18c1740 1 -- 172.21.15.49:0/2189966733 shutdown_connections 2024-01-22T05:18:49.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.849+0000 7fc2c18c1740 1 -- 172.21.15.49:0/2189966733 wait complete. 2024-01-22T05:18:49.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.849+0000 7fc2c18c1740 1 -- start start 2024-01-22T05:18:49.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.849+0000 7fc2c18c1740 1 Processor -- start 2024-01-22T05:18:49.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.853+0000 7fc2c18c1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cbf4d0 0x1ca0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.853+0000 7fc2c18c1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cc6570 0x1c99040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.853+0000 7fc2c18c1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6ee0 0x1cbbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.853+0000 7fc2c18c1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cbc9c0 con 0x1cc6570 2024-01-22T05:18:49.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.853+0000 7fc2c18c1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ca12a0 con 0x1cbf4d0 2024-01-22T05:18:49.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.853+0000 7fc2c18c1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ca2100 con 0x1cc6ee0 2024-01-22T05:18:49.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.853+0000 7fc2c18c1740 10 client.0 ll_register_callbacks cb 0x1c315d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:18:49.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.853+0000 7fc2afe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cc6570 0x1c99040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.853+0000 7fc2afe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cc6570 0x1c99040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39390/0 (socket says 172.21.15.49:39390) 2024-01-22T05:18:49.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.853+0000 7fc2afe00700 1 -- 172.21.15.49:0/3426593737 learned_addr learned my addr 172.21.15.49:0/3426593737 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:49.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/3426593737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cbf4d0 0x1ca0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2b5400700 1 --2- 172.21.15.49:0/3426593737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6ee0 0x1cbbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2afe00700 1 -- 172.21.15.49:0/3426593737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6ee0 msgr2=0x1cbbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2afe00700 1 --2- 172.21.15.49:0/3426593737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6ee0 0x1cbbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2afe00700 1 -- 172.21.15.49:0/3426593737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cbf4d0 msgr2=0x1ca0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2afe00700 1 --2- 172.21.15.49:0/3426593737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cbf4d0 0x1ca0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2afe00700 1 -- 172.21.15.49:0/3426593737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b00ab7e0 con 0x1cc6570 2024-01-22T05:18:49.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2afe00700 1 --2- 172.21.15.49:0/3426593737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cc6570 0x1c99040 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7fc298011000 tx=0x7fc29801e070).ready entity=mon.0 client_cookie=baac72ccb49ae2ee server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc29cc00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:18:49.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc29cc00700 1 -- 172.21.15.49:0/3426593737 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298030420 con 0x1cc6570 2024-01-22T05:18:49.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc29cc00700 1 -- 172.21.15.49:0/3426593737 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc298030580 con 0x1cc6570 2024-01-22T05:18:49.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2c18c1740 1 -- 172.21.15.49:0/3426593737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1bf1230 con 0x1cc6570 2024-01-22T05:18:49.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc29cc00700 1 -- 172.21.15.49:0/3426593737 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc298030740 con 0x1cc6570 2024-01-22T05:18:49.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2c18c1740 10 client.9939 fetch_fsmap learned FSMap version 134 2024-01-22T05:18:49.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2c18c1740 1 -- 172.21.15.49:0/3426593737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=2+}) v3 -- 0x1bf47c0 con 0x1cc6570 2024-01-22T05:18:49.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc29cc00700 1 -- 172.21.15.49:0/3426593737 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1bf1230 con 0x1cc6570 2024-01-22T05:18:49.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc29cc00700 1 -- 172.21.15.49:0/3426593737 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 134) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc2980308a0 con 0x1cc6570 2024-01-22T05:18:49.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2c18c1740 10 client.9939 fetch_fsmap finished waiting for FSMap version 134 2024-01-22T05:18:49.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2c18c1740 10 client.9939 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.b 2024-01-22T05:18:49.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2c18c1740 20 client.9939 populate_metadata read hostname 'smithi049' 2024-01-22T05:18:49.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/3426593737 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x1c9fa10 0x1c9fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2c18c1740 4 client.9939 mds_command: new command op to 9610 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:18:49.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2c18c1740 1 -- 172.21.15.49:0/3426593737 --> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1be7780 con 0x1c9fa10 2024-01-22T05:18:49.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/3426593737 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x1c9fa10 0x1c9fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/3426593737 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x1c9fa10 0x1c9fe20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c8f80efb876265d5 server_cookie=4d672fb22d3d3572 in_seq=0 out_seq=0 2024-01-22T05:18:49.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.857+0000 7fc29cc00700 10 client.9939 ms_handle_connect on v2:172.21.15.110:6834/2192470330 2024-01-22T05:18:49.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.861+0000 7fc29cc00700 1 -- 172.21.15.49:0/3426593737 <== mds.0 v2:172.21.15.110:6834/2192470330 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1be7780 con 0x1c9fa10 2024-01-22T05:18:49.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.861+0000 7fc29cc00700 10 client.9939 handle_command_reply: tid=0 2024-01-22T05:18:49.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.861+0000 7fc2c18c1740 1 client.9939 shutdown 2024-01-22T05:18:49.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.861+0000 7fc2c18c1740 1 -- 172.21.15.49:0/3426593737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cc6570 msgr2=0x1c99040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.861+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/3426593737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cc6570 0x1c99040 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7fc298011000 tx=0x7fc29801e070).stop 2024-01-22T05:18:49.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.861+0000 7fc2c18c1740 1 -- 172.21.15.49:0/3426593737 shutdown_connections 2024-01-22T05:18:49.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.861+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/3426593737 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x1c9fa10 0x1c9fe20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.861+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/3426593737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6ee0 0x1cbbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.861+0000 7fc29cc00700 0 client.9939 ms_handle_reset on v2:172.21.15.110:6834/2192470330 2024-01-22T05:18:49.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.861+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/3426593737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cc6570 0x1c99040 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.861+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/3426593737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cbf4d0 0x1ca0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.861+0000 7fc2c18c1740 1 -- 172.21.15.49:0/3426593737 >> 172.21.15.49:0/3426593737 conn(0x1a59680 msgr2=0x1cc02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:49.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.861+0000 7fc2c18c1740 1 -- 172.21.15.49:0/3426593737 shutdown_connections 2024-01-22T05:18:49.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.861+0000 7fc2c18c1740 1 -- 172.21.15.49:0/3426593737 wait complete. 2024-01-22T05:18:49.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.865+0000 7fc2c18c1740 20 client.9939 trim_cache size 0 max 16384 2024-01-22T05:18:49.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.889+0000 7fc2c18c1740 1 Processor -- start 2024-01-22T05:18:49.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.889+0000 7fc2c18c1740 1 -- start start 2024-01-22T05:18:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.889+0000 7fc2c18c1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cbf4d0 0x1ca06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.889+0000 7fc2c18c1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6570 0x1c76ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.889+0000 7fc2c18c1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cc6ee0 0x1c773d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.889+0000 7fc2c18c1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cbf8b0 con 0x1cc6ee0 2024-01-22T05:18:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.889+0000 7fc2c18c1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c79a80 con 0x1cbf4d0 2024-01-22T05:18:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.889+0000 7fc2c18c1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c76c90 con 0x1cc6570 2024-01-22T05:18:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.889+0000 7fc2b5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cc6ee0 0x1c773d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.889+0000 7fc2b4a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cbf4d0 0x1ca06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.889+0000 7fc2b4a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cbf4d0 0x1ca06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:60452/0 (socket says 172.21.15.49:60452) 2024-01-22T05:18:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.889+0000 7fc2b4a00700 1 -- 172.21.15.49:0/881653673 learned_addr learned my addr 172.21.15.49:0/881653673 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.889+0000 7fc2afe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6570 0x1c76ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2b4a00700 1 -- 172.21.15.49:0/881653673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6570 msgr2=0x1c76ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/881653673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6570 0x1c76ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2b4a00700 1 -- 172.21.15.49:0/881653673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cc6ee0 msgr2=0x1c773d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/881653673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cc6ee0 0x1c773d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2b4a00700 1 -- 172.21.15.49:0/881653673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b00c5ad0 con 0x1cbf4d0 2024-01-22T05:18:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/881653673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cbf4d0 0x1ca06e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7fc2a0048790 tx=0x7fc2a0052000).ready entity=mon.1 client_cookie=52962bcab7d2e4fe server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2a5200700 1 -- 172.21.15.49:0/881653673 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0072ef0 con 0x1cbf4d0 2024-01-22T05:18:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2a5200700 1 -- 172.21.15.49:0/881653673 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a000cd30 con 0x1cbf4d0 2024-01-22T05:18:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2a5200700 1 -- 172.21.15.49:0/881653673 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a00489a0 con 0x1cbf4d0 2024-01-22T05:18:49.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2c18c1740 1 -- 172.21.15.49:0/881653673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cbf4d0 msgr2=0x1ca06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/881653673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cbf4d0 0x1ca06e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7fc2a0048790 tx=0x7fc2a0052000).stop 2024-01-22T05:18:49.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2c18c1740 1 -- 172.21.15.49:0/881653673 shutdown_connections 2024-01-22T05:18:49.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/881653673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cc6ee0 0x1c773d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/881653673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6570 0x1c76ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/881653673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cbf4d0 0x1ca06e0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2c18c1740 1 -- 172.21.15.49:0/881653673 >> 172.21.15.49:0/881653673 conn(0x1a59680 msgr2=0x1c78370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2c18c1740 1 -- 172.21.15.49:0/881653673 shutdown_connections 2024-01-22T05:18:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.893+0000 7fc2c18c1740 1 -- 172.21.15.49:0/881653673 wait complete. 2024-01-22T05:18:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.897+0000 7fc2c18c1740 1 -- start start 2024-01-22T05:18:49.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.897+0000 7fc2c18c1740 1 Processor -- start 2024-01-22T05:18:49.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2c18c1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cbf4d0 0x1d1a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2c18c1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cc6570 0x1cbcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2c18c1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6ee0 0x1cbcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2c18c1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c95c30 con 0x1cbf4d0 2024-01-22T05:18:49.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2c18c1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cbd4e0 con 0x1cc6570 2024-01-22T05:18:49.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2c18c1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c99410 con 0x1cc6ee0 2024-01-22T05:18:49.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2c18c1740 10 client.0 ll_register_callbacks cb 0x7fc298000cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:18:49.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2b4a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cbf4d0 0x1d1a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2b4a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cbf4d0 0x1d1a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39404/0 (socket says 172.21.15.49:39404) 2024-01-22T05:18:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2b4a00700 1 -- 172.21.15.49:0/4023467086 learned_addr learned my addr 172.21.15.49:0/4023467086 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2b5400700 1 --2- 172.21.15.49:0/4023467086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6ee0 0x1cbcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2afe00700 1 --2- 172.21.15.49:0/4023467086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cc6570 0x1cbcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2b4a00700 1 -- 172.21.15.49:0/4023467086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6ee0 msgr2=0x1cbcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/4023467086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6ee0 0x1cbcff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2b4a00700 1 -- 172.21.15.49:0/4023467086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cc6570 msgr2=0x1cbcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/4023467086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cc6570 0x1cbcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2b4a00700 1 -- 172.21.15.49:0/4023467086 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1c054c0 con 0x1cbf4d0 2024-01-22T05:18:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2b4a00700 1 --2- 172.21.15.49:0/4023467086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cbf4d0 0x1d1a7a0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7fc2a000c430 tx=0x7fc2a005e000).ready entity=mon.0 client_cookie=fcfb56e93e2471a1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc29cc00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:18:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc29cc00700 1 -- 172.21.15.49:0/4023467086 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0048080 con 0x1cbf4d0 2024-01-22T05:18:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc29cc00700 1 -- 172.21.15.49:0/4023467086 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc2a00481e0 con 0x1cbf4d0 2024-01-22T05:18:49.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc2c18c1740 1 -- 172.21.15.49:0/4023467086 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc2a0073050 con 0x1cbf4d0 2024-01-22T05:18:49.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.901+0000 7fc29cc00700 1 -- 172.21.15.49:0/4023467086 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2a00483a0 con 0x1cbf4d0 2024-01-22T05:18:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc2c18c1740 10 client.9945 fetch_fsmap learned FSMap version 134 2024-01-22T05:18:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc2c18c1740 1 -- 172.21.15.49:0/4023467086 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=2+}) v3 -- 0x1bef9f0 con 0x1cbf4d0 2024-01-22T05:18:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc29cc00700 1 -- 172.21.15.49:0/4023467086 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a0073050 con 0x1cbf4d0 2024-01-22T05:18:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc29cc00700 1 -- 172.21.15.49:0/4023467086 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 134) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc2a004b400 con 0x1cbf4d0 2024-01-22T05:18:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc2c18c1740 10 client.9945 fetch_fsmap finished waiting for FSMap version 134 2024-01-22T05:18:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc2c18c1740 10 client.9945 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.b 2024-01-22T05:18:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc2c18c1740 20 client.9945 populate_metadata read hostname 'smithi049' 2024-01-22T05:18:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/4023467086 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x1c78410 0x1c938f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc2c18c1740 4 client.9945 mds_command: new command op to 9610 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:18:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc2c18c1740 1 -- 172.21.15.49:0/4023467086 --> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1ab0610 con 0x1c78410 2024-01-22T05:18:49.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc2afe00700 1 --2- 172.21.15.49:0/4023467086 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x1c78410 0x1c938f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:49.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc2afe00700 1 --2- 172.21.15.49:0/4023467086 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x1c78410 0x1c938f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e64565859306676d server_cookie=c4acd5614b29ab44 in_seq=0 out_seq=0 2024-01-22T05:18:49.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc29cc00700 10 client.9945 ms_handle_connect on v2:172.21.15.110:6834/2192470330 2024-01-22T05:18:49.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc29cc00700 1 -- 172.21.15.49:0/4023467086 <== mds.0 v2:172.21.15.110:6834/2192470330 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1ab0610 con 0x1c78410 2024-01-22T05:18:49.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc29cc00700 10 client.9945 handle_command_reply: tid=0 2024-01-22T05:18:49.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc2c18c1740 1 client.9945 shutdown 2024-01-22T05:18:49.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc2c18c1740 1 -- 172.21.15.49:0/4023467086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cbf4d0 msgr2=0x1d1a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.905+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/4023467086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cbf4d0 0x1d1a7a0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7fc2a000c430 tx=0x7fc2a005e000).stop 2024-01-22T05:18:49.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2c18c1740 1 -- 172.21.15.49:0/4023467086 shutdown_connections 2024-01-22T05:18:49.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/4023467086 >> [v2:172.21.15.110:6834/2192470330,v1:172.21.15.110:6835/2192470330] conn(0x1c78410 0x1c938f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/4023467086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1cc6ee0 0x1cbcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/4023467086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1cc6570 0x1cbcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2c18c1740 1 --2- 172.21.15.49:0/4023467086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1cbf4d0 0x1d1a7a0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc29cc00700 0 client.9945 ms_handle_reset on v2:172.21.15.110:6834/2192470330 2024-01-22T05:18:49.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2c18c1740 1 -- 172.21.15.49:0/4023467086 >> 172.21.15.49:0/4023467086 conn(0x1a59680 msgr2=0x1ca06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:49.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2c18c1740 1 -- 172.21.15.49:0/4023467086 shutdown_connections 2024-01-22T05:18:49.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2c18c1740 1 -- 172.21.15.49:0/4023467086 wait complete. 2024-01-22T05:18:49.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2c18c1740 20 client.9945 trim_cache size 0 max 16384 2024-01-22T05:18:49.908 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:18:49.908 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-01-22T05:18:49.908 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-01-22T05:18:49.908 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:18:49.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2b5e00700 1 -- 172.21.15.49:0/3701652566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc28805a540 msgr2=0x7fc28805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2b5e00700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc28805a540 0x7fc28805ca00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7fc298009130 tx=0x7fc298017000).stop 2024-01-22T05:18:49.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2b5e00700 1 -- 172.21.15.49:0/3701652566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b0067220 msgr2=0x7fc2b00be4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:49.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2b5e00700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b0067220 0x7fc2b00be4d0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7fc2a000e930 tx=0x7fc2a0009060).stop 2024-01-22T05:18:49.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2b5e00700 1 -- 172.21.15.49:0/3701652566 shutdown_connections 2024-01-22T05:18:49.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2b5e00700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc28805a540 0x7fc28805ca00 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2b5e00700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b00a8b10 0x7fc2b00aa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2b5e00700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2b0067f80 0x7fc2b0148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2b5e00700 1 --2- 172.21.15.49:0/3701652566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2b0067220 0x7fc2b00be4d0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:49.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2b5e00700 1 -- 172.21.15.49:0/3701652566 >> 172.21.15.49:0/3701652566 conn(0x7fc2b00c6540 msgr2=0x7fc2b00c1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:49.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2b5e00700 1 -- 172.21.15.49:0/3701652566 shutdown_connections 2024-01-22T05:18:49.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:49.909+0000 7fc2b5e00700 1 -- 172.21.15.49:0/3701652566 wait complete. 2024-01-22T05:18:49.932 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-22T05:18:49.933 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:18:49.933 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-01-22T05:18:49.933 DEBUG:teuthology.orchestra.run.smithi049:> import stat 2024-01-22T05:18:49.933 DEBUG:teuthology.orchestra.run.smithi049:> import json 2024-01-22T05:18:49.933 DEBUG:teuthology.orchestra.run.smithi049:> import sys 2024-01-22T05:18:49.933 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:18:49.933 DEBUG:teuthology.orchestra.run.smithi049:> try: 2024-01-22T05:18:49.933 DEBUG:teuthology.orchestra.run.smithi049:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-01-22T05:18:49.933 DEBUG:teuthology.orchestra.run.smithi049:> except OSError as e: 2024-01-22T05:18:49.933 DEBUG:teuthology.orchestra.run.smithi049:> sys.exit(e.errno) 2024-01-22T05:18:49.933 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:18:49.933 DEBUG:teuthology.orchestra.run.smithi049:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-01-22T05:18:49.933 DEBUG:teuthology.orchestra.run.smithi049:> print(json.dumps( 2024-01-22T05:18:49.933 DEBUG:teuthology.orchestra.run.smithi049:> dict([(a, getattr(s, a)) for a in attrs]), 2024-01-22T05:18:49.933 DEBUG:teuthology.orchestra.run.smithi049:> indent=2)) 2024-01-22T05:18:49.934 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-01-22T05:18:50.046 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:18:50.047 INFO:teuthology.orchestra.run.smithi049.stdout: "st_mode": 33204, 2024-01-22T05:18:50.047 INFO:teuthology.orchestra.run.smithi049.stdout: "st_ino": 1099511627777, 2024-01-22T05:18:50.047 INFO:teuthology.orchestra.run.smithi049.stdout: "st_dev": 49, 2024-01-22T05:18:50.047 INFO:teuthology.orchestra.run.smithi049.stdout: "st_nlink": 1, 2024-01-22T05:18:50.047 INFO:teuthology.orchestra.run.smithi049.stdout: "st_uid": 1000, 2024-01-22T05:18:50.047 INFO:teuthology.orchestra.run.smithi049.stdout: "st_gid": 1267, 2024-01-22T05:18:50.047 INFO:teuthology.orchestra.run.smithi049.stdout: "st_size": 6291456, 2024-01-22T05:18:50.047 INFO:teuthology.orchestra.run.smithi049.stdout: "st_atime": 1705900727.92153, 2024-01-22T05:18:50.047 INFO:teuthology.orchestra.run.smithi049.stdout: "st_mtime": 1705900727.9735289, 2024-01-22T05:18:50.047 INFO:teuthology.orchestra.run.smithi049.stdout: "st_ctime": 1705900727.9735289 2024-01-22T05:18:50.047 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:18:50.229 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:18:50.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.441+0000 7fc389200700 1 Processor -- start 2024-01-22T05:18:50.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.441+0000 7fc389200700 1 -- start start 2024-01-22T05:18:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.445+0000 7fc389200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc384153b90 0x7fc3840a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:50.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.445+0000 7fc389200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3840c6eb0 0x7fc3840c7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.445+0000 7fc389200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3840c6a20 con 0x7fc3840c7800 2024-01-22T05:18:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.445+0000 7fc389200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3840bf230 con 0x7fc384153b90 2024-01-22T05:18:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.445+0000 7fc389200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840bec70 con 0x7fc3840c6eb0 2024-01-22T05:18:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.445+0000 7fc381e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc384153b90 0x7fc3840a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.445+0000 7fc381e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc384153b90 0x7fc3840a5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39416/0 (socket says 172.21.15.49:39416) 2024-01-22T05:18:50.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.445+0000 7fc381e00700 1 -- 172.21.15.49:0/973297526 learned_addr learned my addr 172.21.15.49:0/973297526 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:50.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.445+0000 7fc381400700 1 --2- 172.21.15.49:0/973297526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3840c6eb0 0x7fc3840c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:50.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.445+0000 7fc381e00700 1 -- 172.21.15.49:0/973297526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3840c6eb0 msgr2=0x7fc3840c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:50.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.445+0000 7fc381e00700 1 --2- 172.21.15.49:0/973297526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3840c6eb0 0x7fc3840c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.445+0000 7fc381e00700 1 -- 172.21.15.49:0/973297526 >> v1:172.21.15.110:6789/0 conn(0x7fc3840c7800 legacy=0x7fc384067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.445+0000 7fc381e00700 1 -- 172.21.15.49:0/973297526 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3840bef50 con 0x7fc384153b90 2024-01-22T05:18:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.449+0000 7fc381e00700 1 --2- 172.21.15.49:0/973297526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc384153b90 0x7fc3840a5360 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7fc374006fd0 tx=0x7fc3740090f0).ready entity=mon.0 client_cookie=9c9261662a2a0747 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.449+0000 7fc380a00700 1 -- 172.21.15.49:0/973297526 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37400b580 con 0x7fc384153b90 2024-01-22T05:18:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.449+0000 7fc380a00700 1 -- 172.21.15.49:0/973297526 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37400b6e0 con 0x7fc384153b90 2024-01-22T05:18:50.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.449+0000 7fc380a00700 1 -- 172.21.15.49:0/973297526 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37400ba60 con 0x7fc384153b90 2024-01-22T05:18:50.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.449+0000 7fc389200700 1 -- 172.21.15.49:0/973297526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc384153b90 msgr2=0x7fc3840a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:50.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.449+0000 7fc389200700 1 --2- 172.21.15.49:0/973297526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc384153b90 0x7fc3840a5360 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7fc374006fd0 tx=0x7fc3740090f0).stop 2024-01-22T05:18:50.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.449+0000 7fc389200700 1 -- 172.21.15.49:0/973297526 shutdown_connections 2024-01-22T05:18:50.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.449+0000 7fc389200700 1 --2- 172.21.15.49:0/973297526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3840c6eb0 0x7fc3840c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.449+0000 7fc389200700 1 --2- 172.21.15.49:0/973297526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc384153b90 0x7fc3840a5360 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.449+0000 7fc389200700 1 -- 172.21.15.49:0/973297526 >> 172.21.15.49:0/973297526 conn(0x7fc384062a10 msgr2=0x7fc384081fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:50.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.449+0000 7fc389200700 1 -- 172.21.15.49:0/973297526 shutdown_connections 2024-01-22T05:18:50.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.449+0000 7fc389200700 1 -- 172.21.15.49:0/973297526 wait complete. 2024-01-22T05:18:50.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.453+0000 7fc389200700 1 Processor -- start 2024-01-22T05:18:50.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.453+0000 7fc389200700 1 -- start start 2024-01-22T05:18:50.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc389200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3840c6eb0 0x7fc3840c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:50.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc389200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3840c7800 0x7fc3840a86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:50.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc389200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc384153b90 0x7fc3840a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:50.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc389200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840a6060 con 0x7fc3840c6eb0 2024-01-22T05:18:50.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc389200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840a5490 con 0x7fc3840c7800 2024-01-22T05:18:50.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc389200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840a5730 con 0x7fc384153b90 2024-01-22T05:18:50.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc381e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3840c6eb0 0x7fc3840c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:50.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc381e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3840c6eb0 0x7fc3840c4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39432/0 (socket says 172.21.15.49:39432) 2024-01-22T05:18:50.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc381e00700 1 -- 172.21.15.49:0/2509990729 learned_addr learned my addr 172.21.15.49:0/2509990729 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:50.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc381400700 1 --2- 172.21.15.49:0/2509990729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3840c7800 0x7fc3840a86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:50.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc383200700 1 --2- 172.21.15.49:0/2509990729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc384153b90 0x7fc3840a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:50.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc381e00700 1 -- 172.21.15.49:0/2509990729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc384153b90 msgr2=0x7fc3840a64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:50.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc381e00700 1 --2- 172.21.15.49:0/2509990729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc384153b90 0x7fc3840a64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc381e00700 1 -- 172.21.15.49:0/2509990729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3840c7800 msgr2=0x7fc3840a86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:50.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc381e00700 1 --2- 172.21.15.49:0/2509990729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3840c7800 0x7fc3840a86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc381e00700 1 -- 172.21.15.49:0/2509990729 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc374009370 con 0x7fc3840c6eb0 2024-01-22T05:18:50.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc381400700 1 --2- 172.21.15.49:0/2509990729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3840c7800 0x7fc3840a86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:50.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc381e00700 1 --2- 172.21.15.49:0/2509990729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3840c6eb0 0x7fc3840c4f90 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7fc374009130 tx=0x7fc374017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:50.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc379600700 1 -- 172.21.15.49:0/2509990729 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374000bc0 con 0x7fc3840c6eb0 2024-01-22T05:18:50.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc379600700 1 -- 172.21.15.49:0/2509990729 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37400b850 con 0x7fc3840c6eb0 2024-01-22T05:18:50.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc389200700 1 -- 172.21.15.49:0/2509990729 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3840a5a10 con 0x7fc3840c6eb0 2024-01-22T05:18:50.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc379600700 1 -- 172.21.15.49:0/2509990729 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374000d20 con 0x7fc3840c6eb0 2024-01-22T05:18:50.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.457+0000 7fc389200700 1 -- 172.21.15.49:0/2509990729 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3840a79b0 con 0x7fc3840c6eb0 2024-01-22T05:18:50.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.461+0000 7fc389200700 1 -- 172.21.15.49:0/2509990729 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc384065b50 con 0x7fc3840c6eb0 2024-01-22T05:18:50.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.461+0000 7fc379600700 1 -- 172.21.15.49:0/2509990729 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc37401ba80 con 0x7fc3840c6eb0 2024-01-22T05:18:50.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.465+0000 7fc379600700 1 --2- 172.21.15.49:0/2509990729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc35c05a510 0x7fc35c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:50.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.465+0000 7fc379600700 1 -- 172.21.15.49:0/2509990729 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc3740763e0 con 0x7fc3840c6eb0 2024-01-22T05:18:50.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.465+0000 7fc381400700 1 --2- 172.21.15.49:0/2509990729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc35c05a510 0x7fc35c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:50.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.465+0000 7fc381400700 1 --2- 172.21.15.49:0/2509990729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc35c05a510 0x7fc35c05c9d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fc3840c5d40 tx=0x7fc36c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.469+0000 7fc379600700 1 -- 172.21.15.49:0/2509990729 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc384065b50 con 0x7fc3840c6eb0 2024-01-22T05:18:50.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.669+0000 7fc389200700 1 -- 172.21.15.49:0/2509990729 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc384065b50 con 0x7fc3840c6eb0 2024-01-22T05:18:50.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.673+0000 7fc379600700 1 -- 172.21.15.49:0/2509990729 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+4505 (secure 0 0 0) 0x7fc384065b50 con 0x7fc3840c6eb0 2024-01-22T05:18:50.672 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:50.672 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":134,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3995018890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3995018890},{"type":"v1","addr":"172.21.15.110:6833","nonce":3995018890}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2248654659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2248654659},{"type":"v1","addr":"172.21.15.49:6837","nonce":2248654659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931981528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1931981528},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931981528}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:18:40.076218+0000","modified":"2024-01-22T05:18:43.416474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9610":{"gid":9610,"name":"b","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/2192470330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2192470330},{"type":"v1","addr":"172.21.15.110:6835","nonce":2192470330}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2024-01-22T05:18:50.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.677+0000 7fc389200700 1 -- 172.21.15.49:0/2509990729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc35c05a510 msgr2=0x7fc35c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:50.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.677+0000 7fc389200700 1 --2- 172.21.15.49:0/2509990729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc35c05a510 0x7fc35c05c9d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fc3840c5d40 tx=0x7fc36c009060).stop 2024-01-22T05:18:50.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.677+0000 7fc389200700 1 -- 172.21.15.49:0/2509990729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3840c6eb0 msgr2=0x7fc3840c4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:50.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.677+0000 7fc389200700 1 --2- 172.21.15.49:0/2509990729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3840c6eb0 0x7fc3840c4f90 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7fc374009130 tx=0x7fc374017000).stop 2024-01-22T05:18:50.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.677+0000 7fc389200700 1 -- 172.21.15.49:0/2509990729 shutdown_connections 2024-01-22T05:18:50.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.677+0000 7fc389200700 1 --2- 172.21.15.49:0/2509990729 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc35c05a510 0x7fc35c05c9d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.677+0000 7fc389200700 1 --2- 172.21.15.49:0/2509990729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc384153b90 0x7fc3840a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.677+0000 7fc389200700 1 --2- 172.21.15.49:0/2509990729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3840c7800 0x7fc3840a86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.677+0000 7fc389200700 1 --2- 172.21.15.49:0/2509990729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3840c6eb0 0x7fc3840c4f90 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.677+0000 7fc389200700 1 -- 172.21.15.49:0/2509990729 >> 172.21.15.49:0/2509990729 conn(0x7fc384062a10 msgr2=0x7fc384067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:50.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.681+0000 7fc389200700 1 -- 172.21.15.49:0/2509990729 shutdown_connections 2024-01-22T05:18:50.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.681+0000 7fc389200700 1 -- 172.21.15.49:0/2509990729 wait complete. 2024-01-22T05:18:50.681 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 134 2024-01-22T05:18:50.698 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-01-22T05:18:50.876 INFO:teuthology.orchestra.run.smithi110.stdout:{"message":"","return_code":0} 2024-01-22T05:18:50.876 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-01-22T05:18:50.877 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-01-22T05:18:50.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d5916cd00 1 Processor -- start 2024-01-22T05:18:50.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d5916cd00 1 -- start start 2024-01-22T05:18:50.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d5916cd00 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5624d9a5d690 0x5624d9a79950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:50.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d5916cd00 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624d9b02eb0 0x5624d9afe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:50.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d5916cd00 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624d9aff420 0x5624d9aff8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:50.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d5916cd00 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624d99a3220 con 0x5624d9b02eb0 2024-01-22T05:18:50.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d5916cd00 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624d9b0ca00 con 0x5624d9aff420 2024-01-22T05:18:50.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d5916cd00 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624d9affd90 con 0x5624d9a5d690 2024-01-22T05:18:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d44400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624d9b02eb0 0x5624d9afe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d44400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624d9b02eb0 0x5624d9afe7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39460/0 (socket says 172.21.15.49:39460) 2024-01-22T05:18:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d44400700 1 -- 172.21.15.49:0/1255612266 learned_addr learned my addr 172.21.15.49:0/1255612266 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d4da00700 1 --2- 172.21.15.49:0/1255612266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624d9aff420 0x5624d9aff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d4d000700 1 --2- 172.21.15.49:0/1255612266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5624d9a5d690 0x5624d9a79950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d44400700 1 -- 172.21.15.49:0/1255612266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5624d9a5d690 msgr2=0x5624d9a79950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d44400700 1 --2- 172.21.15.49:0/1255612266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5624d9a5d690 0x5624d9a79950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d44400700 1 -- 172.21.15.49:0/1255612266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624d9aff420 msgr2=0x5624d9aff8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d44400700 1 --2- 172.21.15.49:0/1255612266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624d9aff420 0x5624d9aff8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d44400700 1 -- 172.21.15.49:0/1255612266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d34005cf0 con 0x5624d9b02eb0 2024-01-22T05:18:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.937+0000 7f1d44400700 1 --2- 172.21.15.49:0/1255612266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624d9b02eb0 0x5624d9afe7f0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x5624d9a17860 tx=0x7f1d34015000).ready entity=mon.0 client_cookie=213e15dee123d336 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:50.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d47400700 1 -- 172.21.15.49:0/1255612266 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34007ea0 con 0x5624d9b02eb0 2024-01-22T05:18:50.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d47400700 1 -- 172.21.15.49:0/1255612266 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d34000be0 con 0x5624d9b02eb0 2024-01-22T05:18:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d47400700 1 -- 172.21.15.49:0/1255612266 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34007610 con 0x5624d9b02eb0 2024-01-22T05:18:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 -- 172.21.15.49:0/1255612266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624d9b02eb0 msgr2=0x5624d9afe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 --2- 172.21.15.49:0/1255612266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624d9b02eb0 0x5624d9afe7f0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x5624d9a17860 tx=0x7f1d34015000).stop 2024-01-22T05:18:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 -- 172.21.15.49:0/1255612266 shutdown_connections 2024-01-22T05:18:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 --2- 172.21.15.49:0/1255612266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624d9aff420 0x5624d9aff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 --2- 172.21.15.49:0/1255612266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624d9b02eb0 0x5624d9afe7f0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 --2- 172.21.15.49:0/1255612266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5624d9a5d690 0x5624d9a79950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 -- 172.21.15.49:0/1255612266 >> 172.21.15.49:0/1255612266 conn(0x5624d9a7ab10 msgr2=0x5624d9a5bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 -- 172.21.15.49:0/1255612266 shutdown_connections 2024-01-22T05:18:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 -- 172.21.15.49:0/1255612266 wait complete. 2024-01-22T05:18:50.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 Processor -- start 2024-01-22T05:18:50.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 -- start start 2024-01-22T05:18:50.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624d9a5d690 0x5624d9a79140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:50.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5624d9aff420 0x5624d9af4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:50.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624d9b02eb0 0x5624d9afc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:50.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624d9afabb0 con 0x5624d9b02eb0 2024-01-22T05:18:50.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624d9af5cc0 con 0x5624d9a5d690 2024-01-22T05:18:50.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.941+0000 7f1d5916cd00 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624d9a79630 con 0x5624d9aff420 2024-01-22T05:18:50.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d4da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624d9b02eb0 0x5624d9afc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:50.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d4d000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624d9a5d690 0x5624d9a79140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:50.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d4da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624d9b02eb0 0x5624d9afc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39468/0 (socket says 172.21.15.49:39468) 2024-01-22T05:18:50.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d44400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5624d9aff420 0x5624d9af4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:50.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d4da00700 1 -- 172.21.15.49:0/2725873651 learned_addr learned my addr 172.21.15.49:0/2725873651 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:50.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d4da00700 1 -- 172.21.15.49:0/2725873651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5624d9aff420 msgr2=0x5624d9af4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:50.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d4da00700 1 --2- 172.21.15.49:0/2725873651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5624d9aff420 0x5624d9af4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d4da00700 1 -- 172.21.15.49:0/2725873651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624d9a5d690 msgr2=0x5624d9a79140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:50.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d4da00700 1 --2- 172.21.15.49:0/2725873651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624d9a5d690 0x5624d9a79140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d4da00700 1 -- 172.21.15.49:0/2725873651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624d99cca20 con 0x5624d9b02eb0 2024-01-22T05:18:50.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d4da00700 1 --2- 172.21.15.49:0/2725873651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624d9b02eb0 0x5624d9afc770 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7f1d48005f90 tx=0x7f1d48000f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:50.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d45600700 1 -- 172.21.15.49:0/2725873651 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48002120 con 0x5624d9b02eb0 2024-01-22T05:18:50.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d45600700 1 -- 172.21.15.49:0/2725873651 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d480123f0 con 0x5624d9b02eb0 2024-01-22T05:18:50.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d45600700 1 -- 172.21.15.49:0/2725873651 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48012790 con 0x5624d9b02eb0 2024-01-22T05:18:50.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d5916cd00 1 -- 172.21.15.49:0/2725873651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5624d99cc770 con 0x5624d9b02eb0 2024-01-22T05:18:50.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.945+0000 7f1d5916cd00 1 -- 172.21.15.49:0/2725873651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5624d999ba70 con 0x5624d9b02eb0 2024-01-22T05:18:50.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.949+0000 7f1d45600700 1 -- 172.21.15.49:0/2725873651 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1d4801b3b0 con 0x5624d9b02eb0 2024-01-22T05:18:50.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.949+0000 7f1d45600700 1 --2- 172.21.15.49:0/2725873651 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d24058ff0 0x7f1d2405b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:50.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.949+0000 7f1d45600700 1 -- 172.21.15.49:0/2725873651 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f1d48072ed0 con 0x5624d9b02eb0 2024-01-22T05:18:50.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.949+0000 7f1d4d000700 1 --2- 172.21.15.49:0/2725873651 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d24058ff0 0x7f1d2405b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:50.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.949+0000 7f1d5916cd00 1 --2- 172.21.15.49:0/2725873651 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x5624d9a5db10 0x5624d9af9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:50.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.949+0000 7f1d5916cd00 1 -- 172.21.15.49:0/2725873651 --> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] -- osd_op(unknown.0.0:1 25.7 25:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected e172) v8 -- 0x5624d9afd150 con 0x5624d9a5db10 2024-01-22T05:18:50.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.949+0000 7f1d44400700 1 --2- 172.21.15.49:0/2725873651 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x5624d9a5db10 0x5624d9af9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:50.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.949+0000 7f1d4d000700 1 --2- 172.21.15.49:0/2725873651 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d24058ff0 0x7f1d2405b4b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f1d3c005fd0 tx=0x7f1d3c00c040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:50.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.953+0000 7f1d44400700 1 --2- 172.21.15.49:0/2725873651 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x5624d9a5db10 0x5624d9af9f50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:50.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.953+0000 7f1d44400700 1 -- 172.21.15.49:0/2725873651 <== osd.0 v2:172.21.15.49:6808/22975 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f1d34007400 con 0x5624d9a5db10 2024-01-22T05:18:50.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.953+0000 7f1d5916cd00 1 -- 172.21.15.49:0/2725873651 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x5624d9a5db10 msgr2=0x5624d9af9f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:50.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.953+0000 7f1d5916cd00 1 --2- 172.21.15.49:0/2725873651 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x5624d9a5db10 0x5624d9af9f50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:50.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.953+0000 7f1d5916cd00 1 -- 172.21.15.49:0/2725873651 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d24058ff0 msgr2=0x7f1d2405b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:50.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.953+0000 7f1d5916cd00 1 --2- 172.21.15.49:0/2725873651 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d24058ff0 0x7f1d2405b4b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f1d3c005fd0 tx=0x7f1d3c00c040).stop 2024-01-22T05:18:50.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.953+0000 7f1d5916cd00 1 -- 172.21.15.49:0/2725873651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624d9b02eb0 msgr2=0x5624d9afc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:50.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.953+0000 7f1d5916cd00 1 --2- 172.21.15.49:0/2725873651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624d9b02eb0 0x5624d9afc770 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7f1d48005f90 tx=0x7f1d48000f40).stop 2024-01-22T05:18:50.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.953+0000 7f1d4da00700 1 -- 172.21.15.49:0/2725873651 reap_dead start 2024-01-22T05:18:50.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.953+0000 7f1d5916cd00 1 -- 172.21.15.49:0/2725873651 shutdown_connections 2024-01-22T05:18:50.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.953+0000 7f1d5916cd00 1 -- 172.21.15.49:0/2725873651 >> 172.21.15.49:0/2725873651 conn(0x5624d9a7ab10 msgr2=0x5624d9a6f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:50.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.953+0000 7f1d5916cd00 1 -- 172.21.15.49:0/2725873651 shutdown_connections 2024-01-22T05:18:50.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:50.953+0000 7f1d5916cd00 1 -- 172.21.15.49:0/2725873651 wait complete. 2024-01-22T05:18:50.956 INFO:teuthology.orchestra.run.smithi049.stdout:Ysixmegssubdir 2024-01-22T05:18:50.957 DEBUG:teuthology.orchestra.run.smithi049:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-01-22T05:18:51.027 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:18:51.027 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511627777, 2024-01-22T05:18:51.027 INFO:teuthology.orchestra.run.smithi049.stdout: "ancestors": [ 2024-01-22T05:18:51.027 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:51.028 INFO:teuthology.orchestra.run.smithi049.stdout: "dirino": 1099511627776, 2024-01-22T05:18:51.028 INFO:teuthology.orchestra.run.smithi049.stdout: "dname": "sixmegs", 2024-01-22T05:18:51.028 INFO:teuthology.orchestra.run.smithi049.stdout: "version": 6 2024-01-22T05:18:51.028 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:18:51.028 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:18:51.028 INFO:teuthology.orchestra.run.smithi049.stdout: "dirino": 1, 2024-01-22T05:18:51.028 INFO:teuthology.orchestra.run.smithi049.stdout: "dname": "subdir", 2024-01-22T05:18:51.028 INFO:teuthology.orchestra.run.smithi049.stdout: "version": 8 2024-01-22T05:18:51.028 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:18:51.028 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-01-22T05:18:51.028 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 25, 2024-01-22T05:18:51.028 INFO:teuthology.orchestra.run.smithi049.stdout: "old_pools": [] 2024-01-22T05:18:51.028 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:18:51.028 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:51.033 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:18:51.033 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:18:51.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:18:51.157 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:18:51.157 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T05:18:51.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:18:51.157 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-22T05:18:51.238 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:18:51.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:18:51.239 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:18:51.255 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:18:51.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.469+0000 7f7d90a00700 1 Processor -- start 2024-01-22T05:18:51.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.469+0000 7f7d90a00700 1 -- start start 2024-01-22T05:18:51.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.473+0000 7f7d90a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d88066fb0 0x7f7d880c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.473+0000 7f7d90a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d880c1ee0 con 0x7f7d880a8b10 2024-01-22T05:18:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.473+0000 7f7d90a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d880c12f0 con 0x7f7d880a8f90 2024-01-22T05:18:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.473+0000 7f7d90a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d880c15b0 con 0x7f7d88066fb0 2024-01-22T05:18:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.473+0000 7f7d8d600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7d880a8b10 0x7f7d88157740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55654/0 (socket says 172.21.15.49:55654) 2024-01-22T05:18:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.473+0000 7f7d8d600700 1 -- 172.21.15.49:0/548119659 learned_addr learned my addr 172.21.15.49:0/548119659 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.473+0000 7f7d8e000700 1 --2- 172.21.15.49:0/548119659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d88066fb0 0x7f7d880c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.473+0000 7f7d8cc00700 1 -- 172.21.15.49:0/548119659 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769598118 0 0) 0x7f7d880c1ee0 con 0x7f7d880a8b10 2024-01-22T05:18:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.473+0000 7f7d8cc00700 1 -- 172.21.15.49:0/548119659 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d680033f0 con 0x7f7d880a8b10 2024-01-22T05:18:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.473+0000 7f7d8e000700 1 -- 172.21.15.49:0/548119659 >> v1:172.21.15.110:6789/0 conn(0x7f7d880a8f90 legacy=0x7f7d88065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.473+0000 7f7d8e000700 1 -- 172.21.15.49:0/548119659 >> v1:172.21.15.49:6789/0 conn(0x7f7d880a8b10 legacy=0x7f7d88157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.473+0000 7f7d8e000700 1 -- 172.21.15.49:0/548119659 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d880c1890 con 0x7f7d88066fb0 2024-01-22T05:18:51.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.473+0000 7f7d8e000700 1 --2- 172.21.15.49:0/548119659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d88066fb0 0x7f7d880c2370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f7d780097c0 tx=0x7f7d78009060).ready entity=mon.2 client_cookie=f89c304749de5c51 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:51.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.481+0000 7f7d8cc00700 1 -- 172.21.15.49:0/548119659 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7800f510 con 0x7f7d88066fb0 2024-01-22T05:18:51.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.481+0000 7f7d8cc00700 1 -- 172.21.15.49:0/548119659 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7800f670 con 0x7f7d88066fb0 2024-01-22T05:18:51.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.481+0000 7f7d8cc00700 1 -- 172.21.15.49:0/548119659 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7800f9f0 con 0x7f7d88066fb0 2024-01-22T05:18:51.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.481+0000 7f7d90a00700 1 -- 172.21.15.49:0/548119659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d88066fb0 msgr2=0x7f7d880c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:51.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.481+0000 7f7d90a00700 1 --2- 172.21.15.49:0/548119659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d88066fb0 0x7f7d880c2370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f7d780097c0 tx=0x7f7d78009060).stop 2024-01-22T05:18:51.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.481+0000 7f7d90a00700 1 -- 172.21.15.49:0/548119659 shutdown_connections 2024-01-22T05:18:51.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.481+0000 7f7d90a00700 1 --2- 172.21.15.49:0/548119659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d88066fb0 0x7f7d880c2370 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:51.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.481+0000 7f7d90a00700 1 -- 172.21.15.49:0/548119659 >> 172.21.15.49:0/548119659 conn(0x7f7d880c6540 msgr2=0x7f7d880c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:51.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.485+0000 7f7d90a00700 1 -- 172.21.15.49:0/548119659 shutdown_connections 2024-01-22T05:18:51.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.485+0000 7f7d90a00700 1 -- 172.21.15.49:0/548119659 wait complete. 2024-01-22T05:18:51.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.485+0000 7f7d90a00700 1 Processor -- start 2024-01-22T05:18:51.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d90a00700 1 -- start start 2024-01-22T05:18:51.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d90a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d88066fb0 0x7f7d88149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:51.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d90a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d880a8b10 0x7f7d880bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:51.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d90a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d880a8f90 0x7f7d880bdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:51.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d90a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d880bdfc0 con 0x7f7d880a8f90 2024-01-22T05:18:51.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d90a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8814a410 con 0x7f7d88066fb0 2024-01-22T05:18:51.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d90a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8814b230 con 0x7f7d880a8b10 2024-01-22T05:18:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d8d600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d880a8b10 0x7f7d880bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d8e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d88066fb0 0x7f7d88149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d8d600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d880a8b10 0x7f7d880bd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:48736/0 (socket says 172.21.15.49:48736) 2024-01-22T05:18:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d8d600700 1 -- 172.21.15.49:0/3832230574 learned_addr learned my addr 172.21.15.49:0/3832230574 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d8ea00700 1 --2- 172.21.15.49:0/3832230574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d880a8f90 0x7f7d880bdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:51.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d8d600700 1 -- 172.21.15.49:0/3832230574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d88066fb0 msgr2=0x7f7d88149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:51.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d8d600700 1 --2- 172.21.15.49:0/3832230574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d88066fb0 0x7f7d88149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:51.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d8d600700 1 -- 172.21.15.49:0/3832230574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d880a8f90 msgr2=0x7f7d880bdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:51.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d8d600700 1 --2- 172.21.15.49:0/3832230574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d880a8f90 0x7f7d880bdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:51.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d8d600700 1 -- 172.21.15.49:0/3832230574 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d780092a0 con 0x7f7d880a8b10 2024-01-22T05:18:51.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.489+0000 7f7d8e000700 1 --2- 172.21.15.49:0/3832230574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d88066fb0 0x7f7d88149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:51.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.493+0000 7f7d8d600700 1 --2- 172.21.15.49:0/3832230574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d880a8b10 0x7f7d880bd5e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f7d7000c4c0 tx=0x7f7d70007c50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:51.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.493+0000 7f7d85600700 1 -- 172.21.15.49:0/3832230574 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7000ce70 con 0x7f7d880a8b10 2024-01-22T05:18:51.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.493+0000 7f7d85600700 1 -- 172.21.15.49:0/3832230574 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d700072e0 con 0x7f7d880a8b10 2024-01-22T05:18:51.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.493+0000 7f7d85600700 1 -- 172.21.15.49:0/3832230574 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d700057a0 con 0x7f7d880a8b10 2024-01-22T05:18:51.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.493+0000 7f7d90a00700 1 -- 172.21.15.49:0/3832230574 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8814a620 con 0x7f7d880a8b10 2024-01-22T05:18:51.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.493+0000 7f7d90a00700 1 -- 172.21.15.49:0/3832230574 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8814abe0 con 0x7f7d880a8b10 2024-01-22T05:18:51.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.493+0000 7f7d90a00700 1 -- 172.21.15.49:0/3832230574 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8814b3c0 con 0x7f7d880a8b10 2024-01-22T05:18:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.497+0000 7f7d85600700 1 -- 172.21.15.49:0/3832230574 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7d70005bd0 con 0x7f7d880a8b10 2024-01-22T05:18:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.497+0000 7f7d85600700 1 --2- 172.21.15.49:0/3832230574 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7d6005a4e0 0x7f7d6005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.497+0000 7f7d85600700 1 -- 172.21.15.49:0/3832230574 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7d70073fd0 con 0x7f7d880a8b10 2024-01-22T05:18:51.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.497+0000 7f7d8e000700 1 --2- 172.21.15.49:0/3832230574 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7d6005a4e0 0x7f7d6005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:51.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.497+0000 7f7d8e000700 1 --2- 172.21.15.49:0/3832230574 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7d6005a4e0 0x7f7d6005c9a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f7d78009790 tx=0x7f7d78017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:51.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.505+0000 7f7d85600700 1 -- 172.21.15.49:0/3832230574 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7d70047650 con 0x7f7d880a8b10 2024-01-22T05:18:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.713+0000 7f7d90a00700 1 -- 172.21.15.49:0/3832230574 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d880c1b70 con 0x7f7d880a8b10 2024-01-22T05:18:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.713+0000 7f7d85600700 1 -- 172.21.15.49:0/3832230574 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f7d7004ac70 con 0x7f7d880a8b10 2024-01-22T05:18:51.713 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:51.713 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":134,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3995018890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3995018890},{"type":"v1","addr":"172.21.15.110:6833","nonce":3995018890}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2248654659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2248654659},{"type":"v1","addr":"172.21.15.49:6837","nonce":2248654659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931981528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1931981528},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931981528}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:18:40.076218+0000","modified":"2024-01-22T05:18:43.416474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9610":{"gid":9610,"name":"b","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/2192470330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2192470330},{"type":"v1","addr":"172.21.15.110:6835","nonce":2192470330}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2024-01-22T05:18:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.717+0000 7f7d90a00700 1 -- 172.21.15.49:0/3832230574 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7d6005a4e0 msgr2=0x7f7d6005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.717+0000 7f7d90a00700 1 --2- 172.21.15.49:0/3832230574 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7d6005a4e0 0x7f7d6005c9a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f7d78009790 tx=0x7f7d78017000).stop 2024-01-22T05:18:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.717+0000 7f7d90a00700 1 -- 172.21.15.49:0/3832230574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d880a8b10 msgr2=0x7f7d880bd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.717+0000 7f7d90a00700 1 --2- 172.21.15.49:0/3832230574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d880a8b10 0x7f7d880bd5e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f7d7000c4c0 tx=0x7f7d70007c50).stop 2024-01-22T05:18:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.717+0000 7f7d90a00700 1 -- 172.21.15.49:0/3832230574 shutdown_connections 2024-01-22T05:18:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.717+0000 7f7d90a00700 1 --2- 172.21.15.49:0/3832230574 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7d6005a4e0 0x7f7d6005c9a0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.717+0000 7f7d90a00700 1 --2- 172.21.15.49:0/3832230574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d880a8f90 0x7f7d880bdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.717+0000 7f7d90a00700 1 --2- 172.21.15.49:0/3832230574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d880a8b10 0x7f7d880bd5e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.717+0000 7f7d90a00700 1 --2- 172.21.15.49:0/3832230574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d88066fb0 0x7f7d88149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.717+0000 7f7d90a00700 1 -- 172.21.15.49:0/3832230574 >> 172.21.15.49:0/3832230574 conn(0x7f7d880c6540 msgr2=0x7f7d880c3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.721+0000 7f7d90a00700 1 -- 172.21.15.49:0/3832230574 shutdown_connections 2024-01-22T05:18:51.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.721+0000 7f7d90a00700 1 -- 172.21.15.49:0/3832230574 wait complete. 2024-01-22T05:18:51.722 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 134 2024-01-22T05:18:51.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:18:51.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.901+0000 7f76eba00700 1 Processor -- start 2024-01-22T05:18:51.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.901+0000 7f76eba00700 1 -- start start 2024-01-22T05:18:51.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.905+0000 7f76eba00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e4065660 0x7f76e40a6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:51.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.905+0000 7f76eba00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76e40644f0 0x7f76e4064950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:51.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.905+0000 7f76eba00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e40c2700 con 0x7f76e41575b0 2024-01-22T05:18:51.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.905+0000 7f76eba00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e4064e40 con 0x7f76e40644f0 2024-01-22T05:18:51.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.905+0000 7f76eba00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40bdc90 con 0x7f76e4065660 2024-01-22T05:18:51.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.905+0000 7f76ea400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f76e41575b0 0x7f76e4157a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55670/0 (socket says 172.21.15.49:55670) 2024-01-22T05:18:51.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.905+0000 7f76ea400700 1 -- 172.21.15.49:0/838568284 learned_addr learned my addr 172.21.15.49:0/838568284 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:51.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.905+0000 7f76e3e00700 1 --2- 172.21.15.49:0/838568284 >> v2:172.21.15.49:3300/0 conn(0x7f76e40644f0 0x7f76e4064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:51.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76e9000700 1 --2- 172.21.15.49:0/838568284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e4065660 0x7f76e40a6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:51.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76e3400700 1 -- 172.21.15.49:0/838568284 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931811947 0 0) 0x7f76e40c2700 con 0x7f76e41575b0 2024-01-22T05:18:51.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76e3400700 1 -- 172.21.15.49:0/838568284 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76c40033f0 con 0x7f76e41575b0 2024-01-22T05:18:51.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76e9000700 1 -- 172.21.15.49:0/838568284 >> v2:172.21.15.49:3300/0 conn(0x7f76e40644f0 msgr2=0x7f76e4064950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:51.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76e9000700 1 --2- 172.21.15.49:0/838568284 >> v2:172.21.15.49:3300/0 conn(0x7f76e40644f0 0x7f76e4064950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:51.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76e9000700 1 -- 172.21.15.49:0/838568284 >> v1:172.21.15.49:6789/0 conn(0x7f76e41575b0 legacy=0x7f76e4157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:51.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76e9000700 1 -- 172.21.15.49:0/838568284 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e40c2930 con 0x7f76e4065660 2024-01-22T05:18:51.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76e3e00700 1 --2- 172.21.15.49:0/838568284 >> v2:172.21.15.49:3300/0 conn(0x7f76e40644f0 0x7f76e4064950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:51.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76e9000700 1 --2- 172.21.15.49:0/838568284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e4065660 0x7f76e40a6f40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f76d4009790 tx=0x7f76d4009060).ready entity=mon.2 client_cookie=f1defe6a06a992e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:51.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76e3400700 1 -- 172.21.15.49:0/838568284 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d400d4a0 con 0x7f76e4065660 2024-01-22T05:18:51.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76e3400700 1 -- 172.21.15.49:0/838568284 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d400d600 con 0x7f76e4065660 2024-01-22T05:18:51.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76e3400700 1 -- 172.21.15.49:0/838568284 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d400d980 con 0x7f76e4065660 2024-01-22T05:18:51.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76eba00700 1 -- 172.21.15.49:0/838568284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e4065660 msgr2=0x7f76e40a6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:51.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76eba00700 1 --2- 172.21.15.49:0/838568284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e4065660 0x7f76e40a6f40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f76d4009790 tx=0x7f76d4009060).stop 2024-01-22T05:18:51.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76eba00700 1 -- 172.21.15.49:0/838568284 shutdown_connections 2024-01-22T05:18:51.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76eba00700 1 --2- 172.21.15.49:0/838568284 >> v2:172.21.15.49:3300/0 conn(0x7f76e40644f0 0x7f76e4064950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:51.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76eba00700 1 --2- 172.21.15.49:0/838568284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e4065660 0x7f76e40a6f40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:51.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76eba00700 1 -- 172.21.15.49:0/838568284 >> 172.21.15.49:0/838568284 conn(0x7f76e40c87f0 msgr2=0x7f76e40c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:51.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76eba00700 1 -- 172.21.15.49:0/838568284 shutdown_connections 2024-01-22T05:18:51.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.909+0000 7f76eba00700 1 -- 172.21.15.49:0/838568284 wait complete. 2024-01-22T05:18:51.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.913+0000 7f76eba00700 1 Processor -- start 2024-01-22T05:18:51.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.913+0000 7f76eba00700 1 -- start start 2024-01-22T05:18:51.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76eba00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76e40644f0 0x7f76e40bf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:51.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76eba00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76e4065660 0x7f76e40aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:51.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76eba00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e41575b0 0x7f76e40c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:51.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76eba00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40bfcc0 con 0x7f76e40644f0 2024-01-22T05:18:51.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76eba00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40bf230 con 0x7f76e4065660 2024-01-22T05:18:51.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76eba00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40bf510 con 0x7f76e41575b0 2024-01-22T05:18:51.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76e9000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76e40644f0 0x7f76e40bf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:51.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76e9000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76e40644f0 0x7f76e40bf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39484/0 (socket says 172.21.15.49:39484) 2024-01-22T05:18:51.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76e9000700 1 -- 172.21.15.49:0/2416174387 learned_addr learned my addr 172.21.15.49:0/2416174387 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:51.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76ea400700 1 --2- 172.21.15.49:0/2416174387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e41575b0 0x7f76e40c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:51.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76e3e00700 1 --2- 172.21.15.49:0/2416174387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76e4065660 0x7f76e40aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:51.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76e9000700 1 -- 172.21.15.49:0/2416174387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e41575b0 msgr2=0x7f76e40c11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:51.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76e9000700 1 --2- 172.21.15.49:0/2416174387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e41575b0 0x7f76e40c11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:51.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76e9000700 1 -- 172.21.15.49:0/2416174387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76e4065660 msgr2=0x7f76e40aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:51.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76e9000700 1 --2- 172.21.15.49:0/2416174387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76e4065660 0x7f76e40aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:51.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76e9000700 1 -- 172.21.15.49:0/2416174387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc0092a0 con 0x7f76e40644f0 2024-01-22T05:18:51.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76e9000700 1 --2- 172.21.15.49:0/2416174387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76e40644f0 0x7f76e40bf7d0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7f76e40bddd0 tx=0x7f76d4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:51.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76dbe00700 1 -- 172.21.15.49:0/2416174387 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d400dd30 con 0x7f76e40644f0 2024-01-22T05:18:51.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76dbe00700 1 -- 172.21.15.49:0/2416174387 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d400de90 con 0x7f76e40644f0 2024-01-22T05:18:51.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76eba00700 1 -- 172.21.15.49:0/2416174387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d40092a0 con 0x7f76e40644f0 2024-01-22T05:18:51.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76dbe00700 1 -- 172.21.15.49:0/2416174387 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d400d9c0 con 0x7f76e40644f0 2024-01-22T05:18:51.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.917+0000 7f76eba00700 1 -- 172.21.15.49:0/2416174387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e40ac6f0 con 0x7f76e40644f0 2024-01-22T05:18:51.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.921+0000 7f76eba00700 1 -- 172.21.15.49:0/2416174387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e40c34b0 con 0x7f76e40644f0 2024-01-22T05:18:51.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.921+0000 7f76dbe00700 1 -- 172.21.15.49:0/2416174387 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f76d40263b0 con 0x7f76e40644f0 2024-01-22T05:18:51.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.925+0000 7f76dbe00700 1 --2- 172.21.15.49:0/2416174387 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f76bc05a510 0x7f76bc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:51.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.925+0000 7f76dbe00700 1 -- 172.21.15.49:0/2416174387 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f76d4075750 con 0x7f76e40644f0 2024-01-22T05:18:51.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.925+0000 7f76e3e00700 1 --2- 172.21.15.49:0/2416174387 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f76bc05a510 0x7f76bc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:51.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.925+0000 7f76e3e00700 1 --2- 172.21.15.49:0/2416174387 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f76bc05a510 0x7f76bc05c9d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f76e40c2150 tx=0x7f76cc009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:51.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:51.929+0000 7f76dbe00700 1 -- 172.21.15.49:0/2416174387 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f76e40c34b0 con 0x7f76e40644f0 2024-01-22T05:18:52.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.093+0000 7f76eba00700 1 -- 172.21.15.49:0/2416174387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76e40c34b0 con 0x7f76e40644f0 2024-01-22T05:18:52.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.093+0000 7f76dbe00700 1 -- 172.21.15.49:0/2416174387 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+17178 (secure 0 0 0) 0x7f76e40c34b0 con 0x7f76e40644f0 2024-01-22T05:18:52.095 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:52.095 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":172,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:18:41.079736+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:18:38.197050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-01-22T05:18:39.072620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:18:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.101+0000 7f76eba00700 1 -- 172.21.15.49:0/2416174387 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f76bc05a510 msgr2=0x7f76bc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.101+0000 7f76eba00700 1 --2- 172.21.15.49:0/2416174387 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f76bc05a510 0x7f76bc05c9d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f76e40c2150 tx=0x7f76cc009060).stop 2024-01-22T05:18:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.101+0000 7f76eba00700 1 -- 172.21.15.49:0/2416174387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76e40644f0 msgr2=0x7f76e40bf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.101+0000 7f76eba00700 1 --2- 172.21.15.49:0/2416174387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76e40644f0 0x7f76e40bf7d0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7f76e40bddd0 tx=0x7f76d4016000).stop 2024-01-22T05:18:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.101+0000 7f76eba00700 1 -- 172.21.15.49:0/2416174387 shutdown_connections 2024-01-22T05:18:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.101+0000 7f76eba00700 1 --2- 172.21.15.49:0/2416174387 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f76bc05a510 0x7f76bc05c9d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.101+0000 7f76eba00700 1 --2- 172.21.15.49:0/2416174387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e41575b0 0x7f76e40c11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.101+0000 7f76eba00700 1 --2- 172.21.15.49:0/2416174387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76e4065660 0x7f76e40aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.101+0000 7f76eba00700 1 --2- 172.21.15.49:0/2416174387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76e40644f0 0x7f76e40bf7d0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.101+0000 7f76eba00700 1 -- 172.21.15.49:0/2416174387 >> 172.21.15.49:0/2416174387 conn(0x7f76e40c87f0 msgr2=0x7f76e4063ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:52.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.101+0000 7f76eba00700 1 -- 172.21.15.49:0/2416174387 shutdown_connections 2024-01-22T05:18:52.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.101+0000 7f76eba00700 1 -- 172.21.15.49:0/2416174387 wait complete. 2024-01-22T05:18:52.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:18:38.197050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:18:39.072620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:18:52.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:18:52.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.289+0000 7f764d000700 1 Processor -- start 2024-01-22T05:18:52.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.289+0000 7f764d000700 1 -- start start 2024-01-22T05:18:52.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f764d000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f76480a8c20 0x7f76480c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:52.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f764d000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76480c1ac0 0x7f76480bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:52.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f764d000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76480bc9c0 0x7f7648068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:52.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f764d000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7648158650 con 0x7f76480c1ac0 2024-01-22T05:18:52.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f764d000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76480c1f20 con 0x7f76480a8c20 2024-01-22T05:18:52.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f764d000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76480bd170 con 0x7f76480bc9c0 2024-01-22T05:18:52.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f7645400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76480c1ac0 0x7f76480bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:52.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f7645400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76480c1ac0 0x7f76480bc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39500/0 (socket says 172.21.15.49:39500) 2024-01-22T05:18:52.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f7645400700 1 -- 172.21.15.49:0/1413571814 learned_addr learned my addr 172.21.15.49:0/1413571814 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:52.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f7646800700 1 --2- 172.21.15.49:0/1413571814 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76480bc9c0 0x7f7648068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:52.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f7645e00700 1 --2- 172.21.15.49:0/1413571814 >> v2:172.21.15.110:3300/0 conn(0x7f76480a8c20 0x7f76480c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:52.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f7645400700 1 -- 172.21.15.49:0/1413571814 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76480bc9c0 msgr2=0x7f7648068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:52.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f7645400700 1 --2- 172.21.15.49:0/1413571814 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76480bc9c0 0x7f7648068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f7645400700 1 -- 172.21.15.49:0/1413571814 >> v2:172.21.15.110:3300/0 conn(0x7f76480a8c20 msgr2=0x7f76480c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:52.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f7645400700 1 --2- 172.21.15.49:0/1413571814 >> v2:172.21.15.110:3300/0 conn(0x7f76480a8c20 0x7f76480c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f7645400700 1 -- 172.21.15.49:0/1413571814 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7648067c30 con 0x7f76480c1ac0 2024-01-22T05:18:52.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f7645e00700 1 --2- 172.21.15.49:0/1413571814 >> v2:172.21.15.110:3300/0 conn(0x7f76480a8c20 0x7f76480c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:52.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f7645400700 1 --2- 172.21.15.49:0/1413571814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76480c1ac0 0x7f76480bc4d0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f76480c4300 tx=0x7f7630009060).ready entity=mon.0 client_cookie=95895133fe4179f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:52.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f7644a00700 1 -- 172.21.15.49:0/1413571814 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630005880 con 0x7f76480c1ac0 2024-01-22T05:18:52.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.293+0000 7f7644a00700 1 -- 172.21.15.49:0/1413571814 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76300059e0 con 0x7f76480c1ac0 2024-01-22T05:18:52.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.297+0000 7f7644a00700 1 -- 172.21.15.49:0/1413571814 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630005d60 con 0x7f76480c1ac0 2024-01-22T05:18:52.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.297+0000 7f764d000700 1 -- 172.21.15.49:0/1413571814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76480c1ac0 msgr2=0x7f76480bc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:52.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.297+0000 7f764d000700 1 --2- 172.21.15.49:0/1413571814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76480c1ac0 0x7f76480bc4d0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f76480c4300 tx=0x7f7630009060).stop 2024-01-22T05:18:52.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.297+0000 7f764d000700 1 -- 172.21.15.49:0/1413571814 shutdown_connections 2024-01-22T05:18:52.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.297+0000 7f764d000700 1 --2- 172.21.15.49:0/1413571814 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76480bc9c0 0x7f7648068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.297+0000 7f764d000700 1 --2- 172.21.15.49:0/1413571814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76480c1ac0 0x7f76480bc4d0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.297+0000 7f764d000700 1 --2- 172.21.15.49:0/1413571814 >> v2:172.21.15.110:3300/0 conn(0x7f76480a8c20 0x7f76480c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.297+0000 7f764d000700 1 -- 172.21.15.49:0/1413571814 >> 172.21.15.49:0/1413571814 conn(0x7f7648062cb0 msgr2=0x7f76480c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:52.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.297+0000 7f764d000700 1 -- 172.21.15.49:0/1413571814 shutdown_connections 2024-01-22T05:18:52.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.297+0000 7f764d000700 1 -- 172.21.15.49:0/1413571814 wait complete. 2024-01-22T05:18:52.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.301+0000 7f764d000700 1 Processor -- start 2024-01-22T05:18:52.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.301+0000 7f764d000700 1 -- start start 2024-01-22T05:18:52.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.301+0000 7f764d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76480a8c20 0x7f7648156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:52.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f764d000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76480bc9c0 0x7f76480c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:52.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f764d000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76480c1ac0 0x7f76480c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:52.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f764d000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76480c39c0 con 0x7f76480a8c20 2024-01-22T05:18:52.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f764d000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7648168640 con 0x7f76480c1ac0 2024-01-22T05:18:52.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f764d000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764815b2d0 con 0x7f76480bc9c0 2024-01-22T05:18:52.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f7645e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76480a8c20 0x7f7648156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:52.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f7645e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76480a8c20 0x7f7648156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39514/0 (socket says 172.21.15.49:39514) 2024-01-22T05:18:52.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f7645e00700 1 -- 172.21.15.49:0/3643145057 learned_addr learned my addr 172.21.15.49:0/3643145057 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:52.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f7645400700 1 --2- 172.21.15.49:0/3643145057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76480bc9c0 0x7f76480c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:52.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f7646800700 1 --2- 172.21.15.49:0/3643145057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76480c1ac0 0x7f76480c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:52.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f7645e00700 1 -- 172.21.15.49:0/3643145057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76480bc9c0 msgr2=0x7f76480c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:52.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f7645e00700 1 --2- 172.21.15.49:0/3643145057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76480bc9c0 0x7f76480c2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f7645e00700 1 -- 172.21.15.49:0/3643145057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76480c1ac0 msgr2=0x7f76480c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:52.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f7645e00700 1 --2- 172.21.15.49:0/3643145057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76480c1ac0 0x7f76480c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f7645e00700 1 -- 172.21.15.49:0/3643145057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7630009300 con 0x7f76480a8c20 2024-01-22T05:18:52.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f7645e00700 1 --2- 172.21.15.49:0/3643145057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76480a8c20 0x7f7648156400 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f763800d860 tx=0x7f7638008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:52.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f763d600700 1 -- 172.21.15.49:0/3643145057 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638011590 con 0x7f76480a8c20 2024-01-22T05:18:52.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f763d600700 1 -- 172.21.15.49:0/3643145057 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76380116f0 con 0x7f76480a8c20 2024-01-22T05:18:52.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f764d000700 1 -- 172.21.15.49:0/3643145057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76480bf2a0 con 0x7f76480a8c20 2024-01-22T05:18:52.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f763d600700 1 -- 172.21.15.49:0/3643145057 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638011a70 con 0x7f76480a8c20 2024-01-22T05:18:52.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f764d000700 1 -- 172.21.15.49:0/3643145057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76480bf860 con 0x7f76480a8c20 2024-01-22T05:18:52.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.305+0000 7f764d000700 1 -- 172.21.15.49:0/3643145057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76480c0c00 con 0x7f76480a8c20 2024-01-22T05:18:52.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.309+0000 7f763d600700 1 -- 172.21.15.49:0/3643145057 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7638012420 con 0x7f76480a8c20 2024-01-22T05:18:52.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.309+0000 7f763d600700 1 --2- 172.21.15.49:0/3643145057 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f762005a510 0x7f762005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:52.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.309+0000 7f763d600700 1 -- 172.21.15.49:0/3643145057 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7638074540 con 0x7f76480a8c20 2024-01-22T05:18:52.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.313+0000 7f7645400700 1 --2- 172.21.15.49:0/3643145057 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f762005a510 0x7f762005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:52.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.313+0000 7f7645400700 1 --2- 172.21.15.49:0/3643145057 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f762005a510 0x7f762005c9d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f76480bfd30 tx=0x7f7630016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:52.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.317+0000 7f763d600700 1 -- 172.21.15.49:0/3643145057 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7638047aa0 con 0x7f76480a8c20 2024-01-22T05:18:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.481+0000 7f764d000700 1 -- 172.21.15.49:0/3643145057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7648046800 con 0x7f76480a8c20 2024-01-22T05:18:52.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.485+0000 7f763d600700 1 -- 172.21.15.49:0/3643145057 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v172) v1 ==== 110+0+10 (secure 0 0 0) 0x7f763804b0c0 con 0x7f76480a8c20 2024-01-22T05:18:52.484 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:18:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.489+0000 7f764d000700 1 -- 172.21.15.49:0/3643145057 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f762005a510 msgr2=0x7f762005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.489+0000 7f764d000700 1 --2- 172.21.15.49:0/3643145057 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f762005a510 0x7f762005c9d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f76480bfd30 tx=0x7f7630016000).stop 2024-01-22T05:18:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.489+0000 7f764d000700 1 -- 172.21.15.49:0/3643145057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76480a8c20 msgr2=0x7f7648156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:52.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.489+0000 7f764d000700 1 --2- 172.21.15.49:0/3643145057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76480a8c20 0x7f7648156400 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f763800d860 tx=0x7f7638008040).stop 2024-01-22T05:18:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.489+0000 7f764d000700 1 -- 172.21.15.49:0/3643145057 shutdown_connections 2024-01-22T05:18:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.489+0000 7f764d000700 1 --2- 172.21.15.49:0/3643145057 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f762005a510 0x7f762005c9d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.489+0000 7f764d000700 1 --2- 172.21.15.49:0/3643145057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76480c1ac0 0x7f76480c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.489+0000 7f764d000700 1 --2- 172.21.15.49:0/3643145057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76480bc9c0 0x7f76480c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.489+0000 7f764d000700 1 --2- 172.21.15.49:0/3643145057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76480a8c20 0x7f7648156400 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.489+0000 7f764d000700 1 -- 172.21.15.49:0/3643145057 >> 172.21.15.49:0/3643145057 conn(0x7f7648062cb0 msgr2=0x7f76480c64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.489+0000 7f764d000700 1 -- 172.21.15.49:0/3643145057 shutdown_connections 2024-01-22T05:18:52.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.489+0000 7f764d000700 1 -- 172.21.15.49:0/3643145057 wait complete. 2024-01-22T05:18:52.508 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:18:52.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.685+0000 7fa9c8a00700 1 Processor -- start 2024-01-22T05:18:52.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.685+0000 7fa9c8a00700 1 -- start start 2024-01-22T05:18:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.689+0000 7fa9c8a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa9c4139f50 0x7fa9c4063d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.689+0000 7fa9c8a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa9c413a3c0 0x7fa9c4064270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.689+0000 7fa9c8a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c40c2ff0 con 0x7fa9c4069c10 2024-01-22T05:18:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.689+0000 7fa9c8a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c4064760 con 0x7fa9c4139f50 2024-01-22T05:18:52.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.689+0000 7fa9c8a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c40c23e0 con 0x7fa9c413a3c0 2024-01-22T05:18:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.689+0000 7fa9c2a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa9c4139f50 0x7fa9c4063d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.689+0000 7fa9c2a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa9c4139f50 0x7fa9c4063d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39520/0 (socket says 172.21.15.49:39520) 2024-01-22T05:18:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.689+0000 7fa9c2a00700 1 -- 172.21.15.49:0/160396906 learned_addr learned my addr 172.21.15.49:0/160396906 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.689+0000 7fa9c3400700 1 --1- 172.21.15.49:0/160396906 >> v1:172.21.15.110:6789/0 conn(0x7fa9c4069c10 0x7fa9c40c3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:37076/0 (socket says 172.21.15.49:37076) 2024-01-22T05:18:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.689+0000 7fa9c3e00700 1 --2- 172.21.15.49:0/160396906 >> v2:172.21.15.110:3300/0 conn(0x7fa9c413a3c0 0x7fa9c4064270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:52.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c2a00700 1 -- 172.21.15.49:0/160396906 >> v2:172.21.15.110:3300/0 conn(0x7fa9c413a3c0 msgr2=0x7fa9c4064270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c2a00700 1 --2- 172.21.15.49:0/160396906 >> v2:172.21.15.110:3300/0 conn(0x7fa9c413a3c0 0x7fa9c4064270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c2a00700 1 -- 172.21.15.49:0/160396906 >> v1:172.21.15.110:6789/0 conn(0x7fa9c4069c10 legacy=0x7fa9c40c3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c2000700 1 -- 172.21.15.49:0/160396906 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349763994 0 0) 0x7fa9c40c2ff0 con 0x7fa9c4069c10 2024-01-22T05:18:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c2a00700 1 -- 172.21.15.49:0/160396906 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c40c26c0 con 0x7fa9c4139f50 2024-01-22T05:18:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c2a00700 1 --2- 172.21.15.49:0/160396906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c4139f50 0x7fa9c4063d80 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7fa9c40aa2b0 tx=0x7fa9ac0090f0).ready entity=mon.0 client_cookie=d883e55e94831765 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c2000700 1 -- 172.21.15.49:0/160396906 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac00b520 con 0x7fa9c4139f50 2024-01-22T05:18:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c2000700 1 -- 172.21.15.49:0/160396906 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ac00b680 con 0x7fa9c4139f50 2024-01-22T05:18:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c2000700 1 -- 172.21.15.49:0/160396906 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac00ba00 con 0x7fa9c4139f50 2024-01-22T05:18:52.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c8a00700 1 -- 172.21.15.49:0/160396906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c4139f50 msgr2=0x7fa9c4063d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:52.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c8a00700 1 --2- 172.21.15.49:0/160396906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c4139f50 0x7fa9c4063d80 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7fa9c40aa2b0 tx=0x7fa9ac0090f0).stop 2024-01-22T05:18:52.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c8a00700 1 -- 172.21.15.49:0/160396906 shutdown_connections 2024-01-22T05:18:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c8a00700 1 --2- 172.21.15.49:0/160396906 >> v2:172.21.15.110:3300/0 conn(0x7fa9c413a3c0 0x7fa9c4064270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c8a00700 1 --2- 172.21.15.49:0/160396906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c4139f50 0x7fa9c4063d80 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c8a00700 1 -- 172.21.15.49:0/160396906 >> 172.21.15.49:0/160396906 conn(0x7fa9c40c40e0 msgr2=0x7fa9c40c44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c8a00700 1 -- 172.21.15.49:0/160396906 shutdown_connections 2024-01-22T05:18:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.693+0000 7fa9c8a00700 1 -- 172.21.15.49:0/160396906 wait complete. 2024-01-22T05:18:52.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.697+0000 7fa9c8a00700 1 Processor -- start 2024-01-22T05:18:52.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c8a00700 1 -- start start 2024-01-22T05:18:52.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c8a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9c4069c10 0x7fa9c416bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:52.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c8a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9c4139f50 0x7fa9c4169370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:52.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c8a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c413a3c0 0x7fa9c4157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:52.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c8a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c4169c70 con 0x7fa9c413a3c0 2024-01-22T05:18:52.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c8a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c416c5c0 con 0x7fa9c4069c10 2024-01-22T05:18:52.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c8a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c416c8a0 con 0x7fa9c4139f50 2024-01-22T05:18:52.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c413a3c0 0x7fa9c4157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:52.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c413a3c0 0x7fa9c4157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39530/0 (socket says 172.21.15.49:39530) 2024-01-22T05:18:52.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c3e00700 1 -- 172.21.15.49:0/2847575803 learned_addr learned my addr 172.21.15.49:0/2847575803 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:52.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c2a00700 1 --2- 172.21.15.49:0/2847575803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9c4139f50 0x7fa9c4169370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:52.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c3400700 1 --2- 172.21.15.49:0/2847575803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9c4069c10 0x7fa9c416bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:52.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c3e00700 1 -- 172.21.15.49:0/2847575803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9c4139f50 msgr2=0x7fa9c4169370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:52.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c3e00700 1 --2- 172.21.15.49:0/2847575803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9c4139f50 0x7fa9c4169370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c3e00700 1 -- 172.21.15.49:0/2847575803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9c4069c10 msgr2=0x7fa9c416bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:52.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c3e00700 1 --2- 172.21.15.49:0/2847575803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9c4069c10 0x7fa9c416bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c3e00700 1 -- 172.21.15.49:0/2847575803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ac009370 con 0x7fa9c413a3c0 2024-01-22T05:18:52.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c3400700 1 --2- 172.21.15.49:0/2847575803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9c4069c10 0x7fa9c416bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:52.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9c3e00700 1 --2- 172.21.15.49:0/2847575803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c413a3c0 0x7fa9c4157830 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7fa9bc009df0 tx=0x7fa9bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:52.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.701+0000 7fa9baa00700 1 -- 172.21.15.49:0/2847575803 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc00cb50 con 0x7fa9c413a3c0 2024-01-22T05:18:52.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.705+0000 7fa9baa00700 1 -- 172.21.15.49:0/2847575803 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9bc00f040 con 0x7fa9c413a3c0 2024-01-22T05:18:52.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.705+0000 7fa9baa00700 1 -- 172.21.15.49:0/2847575803 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc00cec0 con 0x7fa9c413a3c0 2024-01-22T05:18:52.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.705+0000 7fa9c8a00700 1 -- 172.21.15.49:0/2847575803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c416cb80 con 0x7fa9c413a3c0 2024-01-22T05:18:52.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.705+0000 7fa9c8a00700 1 -- 172.21.15.49:0/2847575803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c4157d20 con 0x7fa9c413a3c0 2024-01-22T05:18:52.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.705+0000 7fa9c8a00700 1 -- 172.21.15.49:0/2847575803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c416cd70 con 0x7fa9c413a3c0 2024-01-22T05:18:52.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.705+0000 7fa9baa00700 1 -- 172.21.15.49:0/2847575803 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa9bc013610 con 0x7fa9c413a3c0 2024-01-22T05:18:52.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.709+0000 7fa9baa00700 1 --2- 172.21.15.49:0/2847575803 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa99c05a510 0x7fa99c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:52.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.709+0000 7fa9baa00700 1 -- 172.21.15.49:0/2847575803 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa9bc0750a0 con 0x7fa9c413a3c0 2024-01-22T05:18:52.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.709+0000 7fa9c3400700 1 --2- 172.21.15.49:0/2847575803 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa99c05a510 0x7fa99c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:52.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.709+0000 7fa9c3400700 1 --2- 172.21.15.49:0/2847575803 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa99c05a510 0x7fa99c05c9d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7fa9b40011e0 tx=0x7fa9b4007b10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:52.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.713+0000 7fa9baa00700 1 -- 172.21.15.49:0/2847575803 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa9bc048720 con 0x7fa9c413a3c0 2024-01-22T05:18:52.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.877+0000 7fa9c8a00700 1 -- 172.21.15.49:0/2847575803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa9c40c29a0 con 0x7fa9c413a3c0 2024-01-22T05:18:52.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.877+0000 7fa9baa00700 1 -- 172.21.15.49:0/2847575803 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v172) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa9bc04bd40 con 0x7fa9c413a3c0 2024-01-22T05:18:52.878 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:18:52.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.881+0000 7fa9c8a00700 1 -- 172.21.15.49:0/2847575803 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa99c05a510 msgr2=0x7fa99c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.881+0000 7fa9c8a00700 1 --2- 172.21.15.49:0/2847575803 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa99c05a510 0x7fa99c05c9d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7fa9b40011e0 tx=0x7fa9b4007b10).stop 2024-01-22T05:18:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.881+0000 7fa9c8a00700 1 -- 172.21.15.49:0/2847575803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c413a3c0 msgr2=0x7fa9c4157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.881+0000 7fa9c8a00700 1 --2- 172.21.15.49:0/2847575803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c413a3c0 0x7fa9c4157830 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7fa9bc009df0 tx=0x7fa9bc00b040).stop 2024-01-22T05:18:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.881+0000 7fa9c8a00700 1 -- 172.21.15.49:0/2847575803 shutdown_connections 2024-01-22T05:18:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.881+0000 7fa9c8a00700 1 --2- 172.21.15.49:0/2847575803 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa99c05a510 0x7fa99c05c9d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.881+0000 7fa9c8a00700 1 --2- 172.21.15.49:0/2847575803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9c413a3c0 0x7fa9c4157830 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.881+0000 7fa9c8a00700 1 --2- 172.21.15.49:0/2847575803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9c4139f50 0x7fa9c4169370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.881+0000 7fa9c8a00700 1 --2- 172.21.15.49:0/2847575803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9c4069c10 0x7fa9c416bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:52.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.881+0000 7fa9c8a00700 1 -- 172.21.15.49:0/2847575803 >> 172.21.15.49:0/2847575803 conn(0x7fa9c40c40e0 msgr2=0x7fa9c40c5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:52.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.881+0000 7fa9c8a00700 1 -- 172.21.15.49:0/2847575803 shutdown_connections 2024-01-22T05:18:52.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:52.881+0000 7fa9c8a00700 1 -- 172.21.15.49:0/2847575803 wait complete. 2024-01-22T05:18:52.905 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:18:53.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.073+0000 7f8ead000700 1 Processor -- start 2024-01-22T05:18:53.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.073+0000 7f8ead000700 1 -- start start 2024-01-22T05:18:53.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.077+0000 7f8ead000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8ea80a8c20 0x7f8ea80c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.077+0000 7f8ead000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea80c1ac0 0x7f8ea80bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.077+0000 7f8ead000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ea80bc9c0 0x7f8ea8068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.077+0000 7f8ead000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea8158650 con 0x7f8ea80bc9c0 2024-01-22T05:18:53.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.077+0000 7f8ead000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea80c1f20 con 0x7f8ea80a8c20 2024-01-22T05:18:53.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.077+0000 7f8ead000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea80bd170 con 0x7f8ea80c1ac0 2024-01-22T05:18:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ea6800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ea80bc9c0 0x7f8ea8068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ea6800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ea80bc9c0 0x7f8ea8068710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39544/0 (socket says 172.21.15.49:39544) 2024-01-22T05:18:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ea6800700 1 -- 172.21.15.49:0/4222537172 learned_addr learned my addr 172.21.15.49:0/4222537172 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ea5400700 1 --2- 172.21.15.49:0/4222537172 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea80c1ac0 0x7f8ea80bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ea5e00700 1 --2- 172.21.15.49:0/4222537172 >> v2:172.21.15.110:3300/0 conn(0x7f8ea80a8c20 0x7f8ea80c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ea6800700 1 -- 172.21.15.49:0/4222537172 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea80c1ac0 msgr2=0x7f8ea80bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:53.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ea6800700 1 --2- 172.21.15.49:0/4222537172 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea80c1ac0 0x7f8ea80bc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ea6800700 1 -- 172.21.15.49:0/4222537172 >> v2:172.21.15.110:3300/0 conn(0x7f8ea80a8c20 msgr2=0x7f8ea80c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:53.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ea6800700 1 --2- 172.21.15.49:0/4222537172 >> v2:172.21.15.110:3300/0 conn(0x7f8ea80a8c20 0x7f8ea80c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ea6800700 1 -- 172.21.15.49:0/4222537172 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea8067c30 con 0x7f8ea80bc9c0 2024-01-22T05:18:53.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ea5e00700 1 --2- 172.21.15.49:0/4222537172 >> v2:172.21.15.110:3300/0 conn(0x7f8ea80a8c20 0x7f8ea80c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:53.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ea6800700 1 --2- 172.21.15.49:0/4222537172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea80bc9c0 0x7f8ea8068710 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f8ea80c4300 tx=0x7f8ea0009840).ready entity=mon.0 client_cookie=b169658ab76ffcb4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:53.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ea4a00700 1 -- 172.21.15.49:0/4222537172 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000e070 con 0x7f8ea80bc9c0 2024-01-22T05:18:53.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ea4a00700 1 -- 172.21.15.49:0/4222537172 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea000b970 con 0x7f8ea80bc9c0 2024-01-22T05:18:53.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ea4a00700 1 -- 172.21.15.49:0/4222537172 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000bcf0 con 0x7f8ea80bc9c0 2024-01-22T05:18:53.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ead000700 1 -- 172.21.15.49:0/4222537172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea80bc9c0 msgr2=0x7f8ea8068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:53.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.081+0000 7f8ead000700 1 --2- 172.21.15.49:0/4222537172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea80bc9c0 0x7f8ea8068710 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f8ea80c4300 tx=0x7f8ea0009840).stop 2024-01-22T05:18:53.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.085+0000 7f8ead000700 1 -- 172.21.15.49:0/4222537172 shutdown_connections 2024-01-22T05:18:53.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.085+0000 7f8ead000700 1 --2- 172.21.15.49:0/4222537172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea80bc9c0 0x7f8ea8068710 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.085+0000 7f8ead000700 1 --2- 172.21.15.49:0/4222537172 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea80c1ac0 0x7f8ea80bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.085+0000 7f8ead000700 1 --2- 172.21.15.49:0/4222537172 >> v2:172.21.15.110:3300/0 conn(0x7f8ea80a8c20 0x7f8ea80c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.085+0000 7f8ead000700 1 -- 172.21.15.49:0/4222537172 >> 172.21.15.49:0/4222537172 conn(0x7f8ea8062cb0 msgr2=0x7f8ea80c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:53.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.085+0000 7f8ead000700 1 -- 172.21.15.49:0/4222537172 shutdown_connections 2024-01-22T05:18:53.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.085+0000 7f8ead000700 1 -- 172.21.15.49:0/4222537172 wait complete. 2024-01-22T05:18:53.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.085+0000 7f8ead000700 1 Processor -- start 2024-01-22T05:18:53.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.085+0000 7f8ead000700 1 -- start start 2024-01-22T05:18:53.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ead000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea80a8c20 0x7f8ea809feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ead000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea80bc9c0 0x7f8ea8168fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ead000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ea80c1ac0 0x7f8ea8155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ead000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea816a1c0 con 0x7f8ea80a8c20 2024-01-22T05:18:53.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ead000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea8169890 con 0x7f8ea80c1ac0 2024-01-22T05:18:53.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ead000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea8169b70 con 0x7f8ea80bc9c0 2024-01-22T05:18:53.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ea5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea80a8c20 0x7f8ea809feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ea5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea80a8c20 0x7f8ea809feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39556/0 (socket says 172.21.15.49:39556) 2024-01-22T05:18:53.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ea5e00700 1 -- 172.21.15.49:0/659584899 learned_addr learned my addr 172.21.15.49:0/659584899 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:53.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ea5400700 1 --2- 172.21.15.49:0/659584899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea80bc9c0 0x7f8ea8168fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ea6800700 1 --2- 172.21.15.49:0/659584899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ea80c1ac0 0x7f8ea8155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ea5e00700 1 -- 172.21.15.49:0/659584899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea80bc9c0 msgr2=0x7f8ea8168fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:53.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ea5e00700 1 --2- 172.21.15.49:0/659584899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea80bc9c0 0x7f8ea8168fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ea5e00700 1 -- 172.21.15.49:0/659584899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ea80c1ac0 msgr2=0x7f8ea8155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:53.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ea5e00700 1 --2- 172.21.15.49:0/659584899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ea80c1ac0 0x7f8ea8155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ea5e00700 1 -- 172.21.15.49:0/659584899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e980092a0 con 0x7f8ea80a8c20 2024-01-22T05:18:53.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ea5e00700 1 --2- 172.21.15.49:0/659584899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea80a8c20 0x7f8ea809feb0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f8e9800ea20 tx=0x7f8e98009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:53.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8e9d600700 1 -- 172.21.15.49:0/659584899 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800ee60 con 0x7f8ea80a8c20 2024-01-22T05:18:53.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8e9d600700 1 -- 172.21.15.49:0/659584899 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9800c850 con 0x7f8ea80a8c20 2024-01-22T05:18:53.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8ead000700 1 -- 172.21.15.49:0/659584899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea0009ae0 con 0x7f8ea80a8c20 2024-01-22T05:18:53.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.089+0000 7f8e9d600700 1 -- 172.21.15.49:0/659584899 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800cbd0 con 0x7f8ea80a8c20 2024-01-22T05:18:53.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.093+0000 7f8ead000700 1 -- 172.21.15.49:0/659584899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea80a0490 con 0x7f8ea80a8c20 2024-01-22T05:18:53.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.093+0000 7f8ead000700 1 -- 172.21.15.49:0/659584899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea80c0c00 con 0x7f8ea80a8c20 2024-01-22T05:18:53.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.093+0000 7f8e9d600700 1 -- 172.21.15.49:0/659584899 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8e9801b400 con 0x7f8ea80a8c20 2024-01-22T05:18:53.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.097+0000 7f8e9d600700 1 --2- 172.21.15.49:0/659584899 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8e8005a510 0x7f8e8005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.097+0000 7f8e9d600700 1 -- 172.21.15.49:0/659584899 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f8e98074ea0 con 0x7f8ea80a8c20 2024-01-22T05:18:53.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.097+0000 7f8ea5400700 1 --2- 172.21.15.49:0/659584899 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8e8005a510 0x7f8e8005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.097+0000 7f8ea5400700 1 --2- 172.21.15.49:0/659584899 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8e8005a510 0x7f8e8005c9d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f8ea81661b0 tx=0x7f8e90006f40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:53.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.101+0000 7f8e9d600700 1 -- 172.21.15.49:0/659584899 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8e98048400 con 0x7f8ea80a8c20 2024-01-22T05:18:53.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.301+0000 7f8ead000700 1 -- 172.21.15.49:0/659584899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ea8067f10 con 0x7f8ea80a8c20 2024-01-22T05:18:53.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.305+0000 7f8e9d600700 1 -- 172.21.15.49:0/659584899 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v172) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e9804ba20 con 0x7f8ea80a8c20 2024-01-22T05:18:53.303 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:18:53.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.305+0000 7f8ead000700 1 -- 172.21.15.49:0/659584899 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8e8005a510 msgr2=0x7f8e8005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:53.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.305+0000 7f8ead000700 1 --2- 172.21.15.49:0/659584899 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8e8005a510 0x7f8e8005c9d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f8ea81661b0 tx=0x7f8e90006f40).stop 2024-01-22T05:18:53.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.305+0000 7f8ead000700 1 -- 172.21.15.49:0/659584899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea80a8c20 msgr2=0x7f8ea809feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:53.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.305+0000 7f8ead000700 1 --2- 172.21.15.49:0/659584899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea80a8c20 0x7f8ea809feb0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f8e9800ea20 tx=0x7f8e98009060).stop 2024-01-22T05:18:53.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.305+0000 7f8ead000700 1 -- 172.21.15.49:0/659584899 shutdown_connections 2024-01-22T05:18:53.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.305+0000 7f8ead000700 1 --2- 172.21.15.49:0/659584899 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8e8005a510 0x7f8e8005c9d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.305+0000 7f8ead000700 1 --2- 172.21.15.49:0/659584899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ea80c1ac0 0x7f8ea8155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.305+0000 7f8ead000700 1 --2- 172.21.15.49:0/659584899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ea80bc9c0 0x7f8ea8168fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.305+0000 7f8ead000700 1 --2- 172.21.15.49:0/659584899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ea80a8c20 0x7f8ea809feb0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.305+0000 7f8ead000700 1 -- 172.21.15.49:0/659584899 >> 172.21.15.49:0/659584899 conn(0x7f8ea8062cb0 msgr2=0x7f8ea81579d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:53.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.305+0000 7f8ead000700 1 -- 172.21.15.49:0/659584899 shutdown_connections 2024-01-22T05:18:53.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.305+0000 7f8ead000700 1 -- 172.21.15.49:0/659584899 wait complete. 2024-01-22T05:18:53.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:18:53.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.501+0000 7efc00200700 1 Processor -- start 2024-01-22T05:18:53.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.501+0000 7efc00200700 1 -- start start 2024-01-22T05:18:53.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.505+0000 7efc00200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efbf8153cf0 0x7efbf80c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.505+0000 7efc00200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbf80bcba0 0x7efbf8068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.505+0000 7efc00200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf8068280 con 0x7efbf80c1ac0 2024-01-22T05:18:53.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.505+0000 7efc00200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf80c1f30 con 0x7efbf8153cf0 2024-01-22T05:18:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.505+0000 7efc00200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80bd190 con 0x7efbf80bcba0 2024-01-22T05:18:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.505+0000 7efbfce00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efbf80c1ac0 0x7efbf80bc490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50914/0 (socket says 172.21.15.49:50914) 2024-01-22T05:18:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.505+0000 7efbfce00700 1 -- 172.21.15.49:0/4095201756 learned_addr learned my addr 172.21.15.49:0/4095201756 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.505+0000 7efbfe200700 1 --2- 172.21.15.49:0/4095201756 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbf80bcba0 0x7efbf8068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.505+0000 7efbfd800700 1 --2- 172.21.15.49:0/4095201756 >> v2:172.21.15.49:3300/0 conn(0x7efbf8153cf0 0x7efbf80c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.505+0000 7efbf7e00700 1 -- 172.21.15.49:0/4095201756 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278249966 0 0) 0x7efbf8068280 con 0x7efbf80c1ac0 2024-01-22T05:18:53.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.505+0000 7efbf7e00700 1 -- 172.21.15.49:0/4095201756 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbd80033f0 con 0x7efbf80c1ac0 2024-01-22T05:18:53.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efbfd800700 1 -- 172.21.15.49:0/4095201756 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbf80bcba0 msgr2=0x7efbf8068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:53.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efbfd800700 1 --2- 172.21.15.49:0/4095201756 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbf80bcba0 0x7efbf8068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efbfd800700 1 -- 172.21.15.49:0/4095201756 >> v1:172.21.15.49:6789/0 conn(0x7efbf80c1ac0 legacy=0x7efbf80bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:53.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efbf7e00700 1 -- 172.21.15.49:0/4095201756 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4004217355 0 0) 0x7efbd80033f0 con 0x7efbf80c1ac0 2024-01-22T05:18:53.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efbfd800700 1 -- 172.21.15.49:0/4095201756 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf8067c30 con 0x7efbf8153cf0 2024-01-22T05:18:53.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efbfe200700 1 --2- 172.21.15.49:0/4095201756 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbf80bcba0 0x7efbf8068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:53.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efbfd800700 1 --2- 172.21.15.49:0/4095201756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efbf8153cf0 0x7efbf80c15d0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7efbe8009760 tx=0x7efbe8009060).ready entity=mon.0 client_cookie=60d43621150c341b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:53.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efbf7e00700 1 -- 172.21.15.49:0/4095201756 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe00015f0 con 0x7efbf8153cf0 2024-01-22T05:18:53.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efbf7e00700 1 -- 172.21.15.49:0/4095201756 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe8011400 con 0x7efbf8153cf0 2024-01-22T05:18:53.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efbf7e00700 1 -- 172.21.15.49:0/4095201756 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8011780 con 0x7efbf8153cf0 2024-01-22T05:18:53.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efc00200700 1 -- 172.21.15.49:0/4095201756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efbf8153cf0 msgr2=0x7efbf80c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:53.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efc00200700 1 --2- 172.21.15.49:0/4095201756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efbf8153cf0 0x7efbf80c15d0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7efbe8009760 tx=0x7efbe8009060).stop 2024-01-22T05:18:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efc00200700 1 -- 172.21.15.49:0/4095201756 shutdown_connections 2024-01-22T05:18:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efc00200700 1 --2- 172.21.15.49:0/4095201756 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbf80bcba0 0x7efbf8068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efc00200700 1 --2- 172.21.15.49:0/4095201756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efbf8153cf0 0x7efbf80c15d0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efc00200700 1 -- 172.21.15.49:0/4095201756 >> 172.21.15.49:0/4095201756 conn(0x7efbf8062cb0 msgr2=0x7efbf80c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efc00200700 1 -- 172.21.15.49:0/4095201756 shutdown_connections 2024-01-22T05:18:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.509+0000 7efc00200700 1 -- 172.21.15.49:0/4095201756 wait complete. 2024-01-22T05:18:53.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.513+0000 7efc00200700 1 Processor -- start 2024-01-22T05:18:53.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.513+0000 7efc00200700 1 -- start start 2024-01-22T05:18:53.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efc00200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efbf80bcba0 0x7efbf80a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efc00200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efbf80c1ac0 0x7efbf8151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efc00200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbf8153cf0 0x7efbf80a4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efc00200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80a6fb0 con 0x7efbf80c1ac0 2024-01-22T05:18:53.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efc00200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80a63a0 con 0x7efbf80bcba0 2024-01-22T05:18:53.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efc00200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80a6680 con 0x7efbf8153cf0 2024-01-22T05:18:53.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efbfce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efbf80c1ac0 0x7efbf8151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efbfce00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efbf80c1ac0 0x7efbf8151600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49980/0 (socket says 172.21.15.49:49980) 2024-01-22T05:18:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efbfce00700 1 -- 172.21.15.49:0/587604268 learned_addr learned my addr 172.21.15.49:0/587604268 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efbfe200700 1 --2- 172.21.15.49:0/587604268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbf8153cf0 0x7efbf80a4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efbfd800700 1 --2- 172.21.15.49:0/587604268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efbf80bcba0 0x7efbf80a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efbfe200700 1 -- 172.21.15.49:0/587604268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efbf80bcba0 msgr2=0x7efbf80a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efbfe200700 1 --2- 172.21.15.49:0/587604268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efbf80bcba0 0x7efbf80a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efbfe200700 1 -- 172.21.15.49:0/587604268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efbf80c1ac0 msgr2=0x7efbf8151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efbfe200700 1 --2- 172.21.15.49:0/587604268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efbf80c1ac0 0x7efbf8151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efbfe200700 1 -- 172.21.15.49:0/587604268 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf0009a20 con 0x7efbf8153cf0 2024-01-22T05:18:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efbfe200700 1 --2- 172.21.15.49:0/587604268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbf8153cf0 0x7efbf80a4190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7efbf0009f10 tx=0x7efbf000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:53.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efbf4c00700 1 -- 172.21.15.49:0/587604268 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf000cc20 con 0x7efbf8153cf0 2024-01-22T05:18:53.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efbf4c00700 1 -- 172.21.15.49:0/587604268 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf000f040 con 0x7efbf8153cf0 2024-01-22T05:18:53.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efc00200700 1 -- 172.21.15.49:0/587604268 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbe80092a0 con 0x7efbf8153cf0 2024-01-22T05:18:53.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efbf4c00700 1 -- 172.21.15.49:0/587604268 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0013400 con 0x7efbf8153cf0 2024-01-22T05:18:53.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.517+0000 7efc00200700 1 -- 172.21.15.49:0/587604268 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf80a6c40 con 0x7efbf8153cf0 2024-01-22T05:18:53.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.521+0000 7efc00200700 1 -- 172.21.15.49:0/587604268 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf80a7160 con 0x7efbf8153cf0 2024-01-22T05:18:53.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.521+0000 7efbf4c00700 1 -- 172.21.15.49:0/587604268 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7efbf00137f0 con 0x7efbf8153cf0 2024-01-22T05:18:53.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.521+0000 7efbf4c00700 1 --2- 172.21.15.49:0/587604268 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efbd005a4e0 0x7efbd005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.521+0000 7efbf4c00700 1 -- 172.21.15.49:0/587604268 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7efbf0075300 con 0x7efbf8153cf0 2024-01-22T05:18:53.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.521+0000 7efbfd800700 1 --2- 172.21.15.49:0/587604268 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efbd005a4e0 0x7efbd005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.525+0000 7efbfd800700 1 --2- 172.21.15.49:0/587604268 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efbd005a4e0 0x7efbd005c9a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7efbe800a010 tx=0x7efbe8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:53.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.529+0000 7efbf4c00700 1 -- 172.21.15.49:0/587604268 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efbf00488c0 con 0x7efbf8153cf0 2024-01-22T05:18:53.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.693+0000 7efc00200700 1 -- 172.21.15.49:0/587604268 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efbf8067f10 con 0x7efbf8153cf0 2024-01-22T05:18:53.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.697+0000 7efbf4c00700 1 -- 172.21.15.49:0/587604268 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v172) v1 ==== 100+0+11 (secure 0 0 0) 0x7efbf004bee0 con 0x7efbf8153cf0 2024-01-22T05:18:53.695 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:18:53.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.701+0000 7efc00200700 1 -- 172.21.15.49:0/587604268 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efbd005a4e0 msgr2=0x7efbd005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:53.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.701+0000 7efc00200700 1 --2- 172.21.15.49:0/587604268 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efbd005a4e0 0x7efbd005c9a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7efbe800a010 tx=0x7efbe8016000).stop 2024-01-22T05:18:53.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.701+0000 7efc00200700 1 -- 172.21.15.49:0/587604268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbf8153cf0 msgr2=0x7efbf80a4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:53.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.701+0000 7efc00200700 1 --2- 172.21.15.49:0/587604268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbf8153cf0 0x7efbf80a4190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7efbf0009f10 tx=0x7efbf000b040).stop 2024-01-22T05:18:53.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.701+0000 7efc00200700 1 -- 172.21.15.49:0/587604268 shutdown_connections 2024-01-22T05:18:53.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.701+0000 7efc00200700 1 --2- 172.21.15.49:0/587604268 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efbd005a4e0 0x7efbd005c9a0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.701+0000 7efc00200700 1 --2- 172.21.15.49:0/587604268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbf8153cf0 0x7efbf80a4190 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.701+0000 7efc00200700 1 --2- 172.21.15.49:0/587604268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efbf80c1ac0 0x7efbf8151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.701+0000 7efc00200700 1 --2- 172.21.15.49:0/587604268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efbf80bcba0 0x7efbf80a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.701+0000 7efc00200700 1 -- 172.21.15.49:0/587604268 >> 172.21.15.49:0/587604268 conn(0x7efbf8062cb0 msgr2=0x7efbf80ab0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:53.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.701+0000 7efc00200700 1 -- 172.21.15.49:0/587604268 shutdown_connections 2024-01-22T05:18:53.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.701+0000 7efc00200700 1 -- 172.21.15.49:0/587604268 wait complete. 2024-01-22T05:18:53.724 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:18:53.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.885+0000 7f3e5b200700 1 Processor -- start 2024-01-22T05:18:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.885+0000 7f3e5b200700 1 -- start start 2024-01-22T05:18:53.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.889+0000 7f3e5b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e5c139af0 0x7f3e5c0bbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.889+0000 7f3e5b200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3e5c0bc1a0 0x7f3e5c068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.889+0000 7f3e5b200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c0bd430 con 0x7f3e5c068f90 2024-01-22T05:18:53.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.889+0000 7f3e5b200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5c0bc600 con 0x7f3e5c0bc1a0 2024-01-22T05:18:53.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.889+0000 7f3e5b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c063790 con 0x7f3e5c139af0 2024-01-22T05:18:53.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.889+0000 7f3e5a800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3e5c068f90 0x7f3e5c153b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50922/0 (socket says 172.21.15.49:50922) 2024-01-22T05:18:53.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.889+0000 7f3e5a800700 1 -- 172.21.15.49:0/3182509314 learned_addr learned my addr 172.21.15.49:0/3182509314 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.889+0000 7f3e59e00700 1 --2- 172.21.15.49:0/3182509314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e5c139af0 0x7f3e5c0bbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e59400700 1 --2- 172.21.15.49:0/3182509314 >> v2:172.21.15.110:3300/0 conn(0x7f3e5c0bc1a0 0x7f3e5c068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 -- 172.21.15.49:0/3182509314 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062962556 0 0) 0x7f3e5c0bd430 con 0x7f3e5c068f90 2024-01-22T05:18:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 -- 172.21.15.49:0/3182509314 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e3c0033f0 con 0x7f3e5c068f90 2024-01-22T05:18:53.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 -- 172.21.15.49:0/3182509314 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4147362520 0 0) 0x7f3e3c0033f0 con 0x7f3e5c068f90 2024-01-22T05:18:53.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 -- 172.21.15.49:0/3182509314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e5c139af0 msgr2=0x7f3e5c0bbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:53.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 --2- 172.21.15.49:0/3182509314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e5c139af0 0x7f3e5c0bbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 -- 172.21.15.49:0/3182509314 >> v2:172.21.15.110:3300/0 conn(0x7f3e5c0bc1a0 msgr2=0x7f3e5c068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 --2- 172.21.15.49:0/3182509314 >> v2:172.21.15.110:3300/0 conn(0x7f3e5c0bc1a0 0x7f3e5c068aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 -- 172.21.15.49:0/3182509314 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c069420 con 0x7f3e5c068f90 2024-01-22T05:18:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 -- 172.21.15.49:0/3182509314 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f3e540017f0 con 0x7f3e5c068f90 2024-01-22T05:18:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 -- 172.21.15.49:0/3182509314 >> v1:172.21.15.49:6789/0 conn(0x7f3e5c068f90 legacy=0x7f3e5c153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 --2- 172.21.15.49:0/3182509314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e3c0038e0 0x7f3e3c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 --2- 172.21.15.49:0/3182509314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e5c139af0 0x7f3e3c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 --2- 172.21.15.49:0/3182509314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c004b80 0x7f3e3c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 -- 172.21.15.49:0/3182509314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0bc600 con 0x7f3e3c004b80 2024-01-22T05:18:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 -- 172.21.15.49:0/3182509314 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c063790 con 0x7f3e3c0038e0 2024-01-22T05:18:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 -- 172.21.15.49:0/3182509314 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c00b8e0 con 0x7f3e5c139af0 2024-01-22T05:18:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e5a800700 1 --2- 172.21.15.49:0/3182509314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c004b80 0x7f3e3c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e59e00700 1 --2- 172.21.15.49:0/3182509314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e3c0038e0 0x7f3e3c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e59400700 1 --2- 172.21.15.49:0/3182509314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e5c139af0 0x7f3e3c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e5a800700 1 -- 172.21.15.49:0/3182509314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e5c139af0 msgr2=0x7f3e3c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:53.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e5a800700 1 --2- 172.21.15.49:0/3182509314 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e5c139af0 0x7f3e3c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e5a800700 1 -- 172.21.15.49:0/3182509314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e3c0038e0 msgr2=0x7f3e3c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:53.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e5a800700 1 --2- 172.21.15.49:0/3182509314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e3c0038e0 0x7f3e3c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e5a800700 1 -- 172.21.15.49:0/3182509314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c0033f0 con 0x7f3e3c004b80 2024-01-22T05:18:53.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e5a800700 1 --2- 172.21.15.49:0/3182509314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c004b80 0x7f3e3c005000 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f3e5400c530 tx=0x7f3e5c1505d0).ready entity=mon.0 client_cookie=3c799c1636076356 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:53.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 -- 172.21.15.49:0/3182509314 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e54007de0 con 0x7f3e3c004b80 2024-01-22T05:18:53.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.893+0000 7f3e58a00700 1 -- 172.21.15.49:0/3182509314 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5400ce60 con 0x7f3e3c004b80 2024-01-22T05:18:53.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.897+0000 7f3e58a00700 1 -- 172.21.15.49:0/3182509314 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e54005d30 con 0x7f3e3c004b80 2024-01-22T05:18:53.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.897+0000 7f3e5b200700 1 -- 172.21.15.49:0/3182509314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c004b80 msgr2=0x7f3e3c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:53.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.897+0000 7f3e5b200700 1 --2- 172.21.15.49:0/3182509314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c004b80 0x7f3e3c005000 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f3e5400c530 tx=0x7f3e5c1505d0).stop 2024-01-22T05:18:53.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.897+0000 7f3e5a800700 1 -- 172.21.15.49:0/3182509314 reap_dead start 2024-01-22T05:18:53.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.897+0000 7f3e5b200700 1 -- 172.21.15.49:0/3182509314 shutdown_connections 2024-01-22T05:18:53.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.897+0000 7f3e5b200700 1 -- 172.21.15.49:0/3182509314 >> 172.21.15.49:0/3182509314 conn(0x7f3e5c0c42c0 msgr2=0x7f3e5c065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:53.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.897+0000 7f3e5b200700 1 -- 172.21.15.49:0/3182509314 shutdown_connections 2024-01-22T05:18:53.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.897+0000 7f3e5b200700 1 -- 172.21.15.49:0/3182509314 wait complete. 2024-01-22T05:18:53.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.901+0000 7f3e5b200700 1 Processor -- start 2024-01-22T05:18:53.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.901+0000 7f3e5b200700 1 -- start start 2024-01-22T05:18:53.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e5b200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c004b80 0x7f3e5c14ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e5b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e5c14f950 0x7f3e5c0a67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e5b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e5c155190 0x7f3e5c155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e5b200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0a81a0 con 0x7f3e3c004b80 2024-01-22T05:18:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e5b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c155b00 con 0x7f3e5c14f950 2024-01-22T05:18:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e5b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0a7100 con 0x7f3e5c155190 2024-01-22T05:18:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e59e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c004b80 0x7f3e5c14ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e59e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c004b80 0x7f3e5c14ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50000/0 (socket says 172.21.15.49:50000) 2024-01-22T05:18:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e5a800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e5c155190 0x7f3e5c155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e59e00700 1 -- 172.21.15.49:0/3564771522 learned_addr learned my addr 172.21.15.49:0/3564771522 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e59400700 1 --2- 172.21.15.49:0/3564771522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e5c14f950 0x7f3e5c0a67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e59e00700 1 -- 172.21.15.49:0/3564771522 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e5c155190 msgr2=0x7f3e5c155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:53.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e59e00700 1 --2- 172.21.15.49:0/3564771522 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e5c155190 0x7f3e5c155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e59e00700 1 -- 172.21.15.49:0/3564771522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e5c14f950 msgr2=0x7f3e5c0a67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:53.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e59e00700 1 --2- 172.21.15.49:0/3564771522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e5c14f950 0x7f3e5c0a67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:53.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e59e00700 1 -- 172.21.15.49:0/3564771522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c0a73e0 con 0x7f3e3c004b80 2024-01-22T05:18:53.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e5a800700 1 --2- 172.21.15.49:0/3564771522 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e5c155190 0x7f3e5c155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:53.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e59e00700 1 --2- 172.21.15.49:0/3564771522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c004b80 0x7f3e5c14ee40 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f3e4c0119f0 tx=0x7f3e4c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:53.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e51600700 1 -- 172.21.15.49:0/3564771522 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c00f760 con 0x7f3e3c004b80 2024-01-22T05:18:53.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e51600700 1 -- 172.21.15.49:0/3564771522 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c00f8c0 con 0x7f3e3c004b80 2024-01-22T05:18:53.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e5b200700 1 -- 172.21.15.49:0/3564771522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5c0a76c0 con 0x7f3e3c004b80 2024-01-22T05:18:53.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e51600700 1 -- 172.21.15.49:0/3564771522 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c00fc40 con 0x7f3e3c004b80 2024-01-22T05:18:53.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.905+0000 7f3e5b200700 1 -- 172.21.15.49:0/3564771522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5c0a7c80 con 0x7f3e3c004b80 2024-01-22T05:18:53.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.909+0000 7f3e5b200700 1 -- 172.21.15.49:0/3564771522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5c065120 con 0x7f3e3c004b80 2024-01-22T05:18:53.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.909+0000 7f3e51600700 1 -- 172.21.15.49:0/3564771522 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3e4c014440 con 0x7f3e3c004b80 2024-01-22T05:18:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.913+0000 7f3e51600700 1 --2- 172.21.15.49:0/3564771522 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e3405a540 0x7f3e3405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.913+0000 7f3e51600700 1 -- 172.21.15.49:0/3564771522 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3e4c075440 con 0x7f3e3c004b80 2024-01-22T05:18:53.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.913+0000 7f3e59400700 1 --2- 172.21.15.49:0/3564771522 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e3405a540 0x7f3e3405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:53.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.913+0000 7f3e59400700 1 --2- 172.21.15.49:0/3564771522 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e3405a540 0x7f3e3405ca00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f3e5c0c1360 tx=0x7f3e4400a200).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:53.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:53.917+0000 7f3e51600700 1 -- 172.21.15.49:0/3564771522 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3e4c0489a0 con 0x7f3e3c004b80 2024-01-22T05:18:54.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.125+0000 7f3e5b200700 1 -- 172.21.15.49:0/3564771522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e5c0bc820 con 0x7f3e3c004b80 2024-01-22T05:18:54.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.125+0000 7f3e51600700 1 -- 172.21.15.49:0/3564771522 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f3e4c04bfc0 con 0x7f3e3c004b80 2024-01-22T05:18:54.125 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:54.125 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":134,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3995018890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3995018890},{"type":"v1","addr":"172.21.15.110:6833","nonce":3995018890}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2248654659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2248654659},{"type":"v1","addr":"172.21.15.49:6837","nonce":2248654659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931981528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1931981528},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931981528}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:18:40.076218+0000","modified":"2024-01-22T05:18:43.416474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9610":{"gid":9610,"name":"b","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/2192470330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2192470330},{"type":"v1","addr":"172.21.15.110:6835","nonce":2192470330}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2024-01-22T05:18:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.129+0000 7f3e5b200700 1 -- 172.21.15.49:0/3564771522 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e3405a540 msgr2=0x7f3e3405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.129+0000 7f3e5b200700 1 --2- 172.21.15.49:0/3564771522 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e3405a540 0x7f3e3405ca00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f3e5c0c1360 tx=0x7f3e4400a200).stop 2024-01-22T05:18:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.129+0000 7f3e5b200700 1 -- 172.21.15.49:0/3564771522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c004b80 msgr2=0x7f3e5c14ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.129+0000 7f3e5b200700 1 --2- 172.21.15.49:0/3564771522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c004b80 0x7f3e5c14ee40 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f3e4c0119f0 tx=0x7f3e4c009060).stop 2024-01-22T05:18:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.133+0000 7f3e5b200700 1 -- 172.21.15.49:0/3564771522 shutdown_connections 2024-01-22T05:18:54.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.133+0000 7f3e5b200700 1 --2- 172.21.15.49:0/3564771522 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e3405a540 0x7f3e3405ca00 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.133+0000 7f3e5b200700 1 --2- 172.21.15.49:0/3564771522 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e5c155190 0x7f3e5c155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.133+0000 7f3e5b200700 1 --2- 172.21.15.49:0/3564771522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e5c14f950 0x7f3e5c0a67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.133+0000 7f3e5b200700 1 --2- 172.21.15.49:0/3564771522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c004b80 0x7f3e5c14ee40 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.133+0000 7f3e5b200700 1 -- 172.21.15.49:0/3564771522 >> 172.21.15.49:0/3564771522 conn(0x7f3e5c0c42c0 msgr2=0x7f3e5c0c6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:54.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.133+0000 7f3e5b200700 1 -- 172.21.15.49:0/3564771522 shutdown_connections 2024-01-22T05:18:54.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.133+0000 7f3e5b200700 1 -- 172.21.15.49:0/3564771522 wait complete. 2024-01-22T05:18:54.134 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 134 2024-01-22T05:18:54.151 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:18:54.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.325+0000 7fbdf7800700 1 Processor -- start 2024-01-22T05:18:54.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.329+0000 7fbdf7800700 1 -- start start 2024-01-22T05:18:54.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.329+0000 7fbdf7800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf0066d10 0x7fbdf0068f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:54.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.329+0000 7fbdf7800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf00c1960 con 0x7fbdf0068aa0 2024-01-22T05:18:54.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.329+0000 7fbdf7800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf00672c0 con 0x7fbdf00c2d70 2024-01-22T05:18:54.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.329+0000 7fbdf7800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c24c0 con 0x7fbdf0066d10 2024-01-22T05:18:54.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.329+0000 7fbdefe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbdf0068aa0 0x7fbdf0066600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50932/0 (socket says 172.21.15.49:50932) 2024-01-22T05:18:54.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.329+0000 7fbdefe00700 1 -- 172.21.15.49:0/2558930272 learned_addr learned my addr 172.21.15.49:0/2558930272 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:54.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.329+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572304593 0 0) 0x7fbdf00c1960 con 0x7fbdf0068aa0 2024-01-22T05:18:54.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.329+0000 7fbdf5800700 1 --2- 172.21.15.49:0/2558930272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf0066d10 0x7fbdf0068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:54.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd00033f0 con 0x7fbdf0068aa0 2024-01-22T05:18:54.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482853968 0 0) 0x7fbdf00672c0 con 0x7fbdf00c2d70 2024-01-22T05:18:54.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf00c1960 con 0x7fbdf00c2d70 2024-01-22T05:18:54.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1771420952 0 0) 0x7fbdd00033f0 con 0x7fbdf0068aa0 2024-01-22T05:18:54.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf0066d10 msgr2=0x7fbdf0068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:54.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 --2- 172.21.15.49:0/2558930272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf0066d10 0x7fbdf0068f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 >> v1:172.21.15.110:6789/0 conn(0x7fbdf00c2d70 legacy=0x7fbdf0157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf01586e0 con 0x7fbdf0068aa0 2024-01-22T05:18:54.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fbdd8001470 con 0x7fbdf0068aa0 2024-01-22T05:18:54.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 >> v1:172.21.15.49:6789/0 conn(0x7fbdf0068aa0 legacy=0x7fbdf0066600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 --2- 172.21.15.49:0/2558930272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf0066d10 0x7fbdd0003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:54.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 --2- 172.21.15.49:0/2558930272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd0003fb0 0x7fbdd0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:54.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 --2- 172.21.15.49:0/2558930272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdd0004b80 0x7fbdd0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:54.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c24c0 con 0x7fbdd0004b80 2024-01-22T05:18:54.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd000b990 con 0x7fbdd0003fb0 2024-01-22T05:18:54.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd000bb50 con 0x7fbdf0066d10 2024-01-22T05:18:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdf4e00700 1 --2- 172.21.15.49:0/2558930272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf0066d10 0x7fbdd0003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdf5800700 1 --2- 172.21.15.49:0/2558930272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdd0004b80 0x7fbdd0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:54.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdefe00700 1 --2- 172.21.15.49:0/2558930272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd0003fb0 0x7fbdd0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:54.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdf5800700 1 -- 172.21.15.49:0/2558930272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf0066d10 msgr2=0x7fbdd0003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:54.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdf5800700 1 --2- 172.21.15.49:0/2558930272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf0066d10 0x7fbdd0003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdf5800700 1 -- 172.21.15.49:0/2558930272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd0003fb0 msgr2=0x7fbdd0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:54.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdf5800700 1 --2- 172.21.15.49:0/2558930272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd0003fb0 0x7fbdd0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdf5800700 1 -- 172.21.15.49:0/2558930272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd00033f0 con 0x7fbdd0004b80 2024-01-22T05:18:54.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdefe00700 1 --2- 172.21.15.49:0/2558930272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd0003fb0 0x7fbdd0004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:54.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdf5800700 1 --2- 172.21.15.49:0/2558930272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdd0004b80 0x7fbdd0005000 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7fbde800e210 tx=0x7fbde800b040).ready entity=mon.0 client_cookie=bbe021677fe46c52 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:54.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8009ac0 con 0x7fbdd0004b80 2024-01-22T05:18:54.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde800f040 con 0x7fbdd0004b80 2024-01-22T05:18:54.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.333+0000 7fbdef400700 1 -- 172.21.15.49:0/2558930272 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde800ecd0 con 0x7fbdd0004b80 2024-01-22T05:18:54.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.337+0000 7fbdf7800700 1 -- 172.21.15.49:0/2558930272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdd0004b80 msgr2=0x7fbdd0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.337+0000 7fbdf7800700 1 --2- 172.21.15.49:0/2558930272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdd0004b80 0x7fbdd0005000 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7fbde800e210 tx=0x7fbde800b040).stop 2024-01-22T05:18:54.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.337+0000 7fbdf5800700 1 -- 172.21.15.49:0/2558930272 reap_dead start 2024-01-22T05:18:54.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.337+0000 7fbdf7800700 1 -- 172.21.15.49:0/2558930272 shutdown_connections 2024-01-22T05:18:54.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.337+0000 7fbdf7800700 1 -- 172.21.15.49:0/2558930272 >> 172.21.15.49:0/2558930272 conn(0x7fbdf00c4300 msgr2=0x7fbdf0065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:54.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.337+0000 7fbdf7800700 1 -- 172.21.15.49:0/2558930272 shutdown_connections 2024-01-22T05:18:54.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.337+0000 7fbdf7800700 1 -- 172.21.15.49:0/2558930272 wait complete. 2024-01-22T05:18:54.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.341+0000 7fbdf7800700 1 Processor -- start 2024-01-22T05:18:54.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.341+0000 7fbdf7800700 1 -- start start 2024-01-22T05:18:54.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdf7800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd0004b80 0x7fbdf00bf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:54.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdf7800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf00a9e20 0x7fbdf014c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:54.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdf7800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf015a880 0x7fbdf015ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:54.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdf7800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00bfe80 con 0x7fbdf00a9e20 2024-01-22T05:18:54.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdf7800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c0930 con 0x7fbdf015a880 2024-01-22T05:18:54.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdf7800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf0158c20 con 0x7fbdd0004b80 2024-01-22T05:18:54.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdefe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf00a9e20 0x7fbdf014c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:54.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdefe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf00a9e20 0x7fbdf014c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50022/0 (socket says 172.21.15.49:50022) 2024-01-22T05:18:54.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdefe00700 1 -- 172.21.15.49:0/676681075 learned_addr learned my addr 172.21.15.49:0/676681075 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:54.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdf5800700 1 --2- 172.21.15.49:0/676681075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf015a880 0x7fbdf015ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:54.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdf4e00700 1 --2- 172.21.15.49:0/676681075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd0004b80 0x7fbdf00bf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:54.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdefe00700 1 -- 172.21.15.49:0/676681075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd0004b80 msgr2=0x7fbdf00bf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdefe00700 1 --2- 172.21.15.49:0/676681075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd0004b80 0x7fbdf00bf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdefe00700 1 -- 172.21.15.49:0/676681075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf015a880 msgr2=0x7fbdf015ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdefe00700 1 --2- 172.21.15.49:0/676681075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf015a880 0x7fbdf015ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdefe00700 1 -- 172.21.15.49:0/676681075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf015b1f0 con 0x7fbdf00a9e20 2024-01-22T05:18:54.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdefe00700 1 --2- 172.21.15.49:0/676681075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf00a9e20 0x7fbdf014c200 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7fbdd800e7b0 tx=0x7fbdd8001060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:54.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbde7e00700 1 -- 172.21.15.49:0/676681075 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8015440 con 0x7fbdf00a9e20 2024-01-22T05:18:54.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbde7e00700 1 -- 172.21.15.49:0/676681075 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd8010040 con 0x7fbdf00a9e20 2024-01-22T05:18:54.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdf7800700 1 -- 172.21.15.49:0/676681075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf00c0090 con 0x7fbdf00a9e20 2024-01-22T05:18:54.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbde7e00700 1 -- 172.21.15.49:0/676681075 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd80157f0 con 0x7fbdf00a9e20 2024-01-22T05:18:54.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.345+0000 7fbdf7800700 1 -- 172.21.15.49:0/676681075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf00c0650 con 0x7fbdf00a9e20 2024-01-22T05:18:54.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.349+0000 7fbdf7800700 1 -- 172.21.15.49:0/676681075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf0064b90 con 0x7fbdf00a9e20 2024-01-22T05:18:54.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.349+0000 7fbde7e00700 1 -- 172.21.15.49:0/676681075 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbdd8015be0 con 0x7fbdf00a9e20 2024-01-22T05:18:54.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.353+0000 7fbde7e00700 1 --2- 172.21.15.49:0/676681075 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbdc805a510 0x7fbdc805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:54.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.353+0000 7fbde7e00700 1 -- 172.21.15.49:0/676681075 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fbdd8073fe0 con 0x7fbdf00a9e20 2024-01-22T05:18:54.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.353+0000 7fbdf4e00700 1 --2- 172.21.15.49:0/676681075 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbdc805a510 0x7fbdc805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:54.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.353+0000 7fbdf4e00700 1 --2- 172.21.15.49:0/676681075 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbdc805a510 0x7fbdc805c9d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7fbde0007fd0 tx=0x7fbde0007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:54.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.357+0000 7fbde7e00700 1 -- 172.21.15.49:0/676681075 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbdd8047560 con 0x7fbdf00a9e20 2024-01-22T05:18:54.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.529+0000 7fbdf7800700 1 -- 172.21.15.49:0/676681075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdf0158d60 con 0x7fbdf00a9e20 2024-01-22T05:18:54.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.529+0000 7fbde7e00700 1 -- 172.21.15.49:0/676681075 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+17178 (secure 0 0 0) 0x7fbdd804ab80 con 0x7fbdf00a9e20 2024-01-22T05:18:54.529 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:54.529 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":172,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:18:41.079736+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:18:38.197050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-01-22T05:18:39.072620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:18:54.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.533+0000 7fbdf7800700 1 -- 172.21.15.49:0/676681075 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbdc805a510 msgr2=0x7fbdc805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.533+0000 7fbdf7800700 1 --2- 172.21.15.49:0/676681075 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbdc805a510 0x7fbdc805c9d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7fbde0007fd0 tx=0x7fbde0007bb0).stop 2024-01-22T05:18:54.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.533+0000 7fbdf7800700 1 -- 172.21.15.49:0/676681075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf00a9e20 msgr2=0x7fbdf014c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.533+0000 7fbdf7800700 1 --2- 172.21.15.49:0/676681075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf00a9e20 0x7fbdf014c200 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7fbdd800e7b0 tx=0x7fbdd8001060).stop 2024-01-22T05:18:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.533+0000 7fbdf7800700 1 -- 172.21.15.49:0/676681075 shutdown_connections 2024-01-22T05:18:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.533+0000 7fbdf7800700 1 --2- 172.21.15.49:0/676681075 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbdc805a510 0x7fbdc805c9d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.533+0000 7fbdf7800700 1 --2- 172.21.15.49:0/676681075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf015a880 0x7fbdf015ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.533+0000 7fbdf7800700 1 --2- 172.21.15.49:0/676681075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdf00a9e20 0x7fbdf014c200 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.533+0000 7fbdf7800700 1 --2- 172.21.15.49:0/676681075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd0004b80 0x7fbdf00bf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.533+0000 7fbdf7800700 1 -- 172.21.15.49:0/676681075 >> 172.21.15.49:0/676681075 conn(0x7fbdf00c4300 msgr2=0x7fbdf0067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:54.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.533+0000 7fbdf7800700 1 -- 172.21.15.49:0/676681075 shutdown_connections 2024-01-22T05:18:54.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.533+0000 7fbdf7800700 1 -- 172.21.15.49:0/676681075 wait complete. 2024-01-22T05:18:54.558 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:18:54.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:18:54.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.717+0000 7fe5dbe00700 1 Processor -- start 2024-01-22T05:18:54.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.717+0000 7fe5dbe00700 1 -- start start 2024-01-22T05:18:54.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.717+0000 7fe5dbe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe5d40c25e0 0x7fe5d40a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:54.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.717+0000 7fe5dbe00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d40c1a40 con 0x7fe5d4155d20 2024-01-22T05:18:54.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.717+0000 7fe5dbe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d40a90b0 con 0x7fe5d40a8740 2024-01-22T05:18:54.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.717+0000 7fe5dbe00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d4159310 con 0x7fe5d40c25e0 2024-01-22T05:18:54.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.717+0000 7fe5d9400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe5d4155d20 0x7fe5d4065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50940/0 (socket says 172.21.15.49:50940) 2024-01-22T05:18:54.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.717+0000 7fe5d9400700 1 -- 172.21.15.49:0/1343598683 learned_addr learned my addr 172.21.15.49:0/1343598683 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:54.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.717+0000 7fe5d9e00700 1 --2- 172.21.15.49:0/1343598683 >> v2:172.21.15.110:3300/0 conn(0x7fe5d40c25e0 0x7fe5d40a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:54.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5d3e00700 1 -- 172.21.15.49:0/1343598683 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160471284 0 0) 0x7fe5d40a90b0 con 0x7fe5d40a8740 2024-01-22T05:18:54.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5d3e00700 1 -- 172.21.15.49:0/1343598683 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5b40033f0 con 0x7fe5d40a8740 2024-01-22T05:18:54.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5d3e00700 1 -- 172.21.15.49:0/1343598683 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151868 0 0) 0x7fe5d40c1a40 con 0x7fe5d4155d20 2024-01-22T05:18:54.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5d3e00700 1 -- 172.21.15.49:0/1343598683 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5d40a90b0 con 0x7fe5d4155d20 2024-01-22T05:18:54.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5d9e00700 1 -- 172.21.15.49:0/1343598683 >> v1:172.21.15.110:6789/0 conn(0x7fe5d40a8740 legacy=0x7fe5d40c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5d9e00700 1 -- 172.21.15.49:0/1343598683 >> v1:172.21.15.49:6789/0 conn(0x7fe5d4155d20 legacy=0x7fe5d4065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5d9e00700 1 -- 172.21.15.49:0/1343598683 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d40c13f0 con 0x7fe5d40c25e0 2024-01-22T05:18:54.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5d9e00700 1 --2- 172.21.15.49:0/1343598683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5d40c25e0 0x7fe5d40a8bc0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fe5cc009e60 tx=0x7fe5cc009780).ready entity=mon.1 client_cookie=ad8ae10c3b50f0ab server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:54.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5d3e00700 1 -- 172.21.15.49:0/1343598683 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc00e070 con 0x7fe5d40c25e0 2024-01-22T05:18:54.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5d3e00700 1 -- 172.21.15.49:0/1343598683 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc00bab0 con 0x7fe5d40c25e0 2024-01-22T05:18:54.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5d3e00700 1 -- 172.21.15.49:0/1343598683 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc00be30 con 0x7fe5d40c25e0 2024-01-22T05:18:54.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5dbe00700 1 -- 172.21.15.49:0/1343598683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5d40c25e0 msgr2=0x7fe5d40a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5dbe00700 1 --2- 172.21.15.49:0/1343598683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5d40c25e0 0x7fe5d40a8bc0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fe5cc009e60 tx=0x7fe5cc009780).stop 2024-01-22T05:18:54.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5dbe00700 1 -- 172.21.15.49:0/1343598683 shutdown_connections 2024-01-22T05:18:54.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5dbe00700 1 --2- 172.21.15.49:0/1343598683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5d40c25e0 0x7fe5d40a8bc0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.721+0000 7fe5dbe00700 1 -- 172.21.15.49:0/1343598683 >> 172.21.15.49:0/1343598683 conn(0x7fe5d40c6540 msgr2=0x7fe5d40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:54.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.725+0000 7fe5dbe00700 1 -- 172.21.15.49:0/1343598683 shutdown_connections 2024-01-22T05:18:54.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.725+0000 7fe5dbe00700 1 -- 172.21.15.49:0/1343598683 wait complete. 2024-01-22T05:18:54.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.725+0000 7fe5dbe00700 1 Processor -- start 2024-01-22T05:18:54.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.725+0000 7fe5dbe00700 1 -- start start 2024-01-22T05:18:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5dbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5d40a8740 0x7fe5d41499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5dbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d40c25e0 0x7fe5d40bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5dbe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5d4155d20 0x7fe5d40bdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5dbe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d40bdfc0 con 0x7fe5d40c25e0 2024-01-22T05:18:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5dbe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d40ac550 con 0x7fe5d40a8740 2024-01-22T05:18:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5dbe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d4146ff0 con 0x7fe5d4155d20 2024-01-22T05:18:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5d8a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d40c25e0 0x7fe5d40bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5d8a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d40c25e0 0x7fe5d40bd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50034/0 (socket says 172.21.15.49:50034) 2024-01-22T05:18:54.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5d8a00700 1 -- 172.21.15.49:0/2653012858 learned_addr learned my addr 172.21.15.49:0/2653012858 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:54.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5d9e00700 1 --2- 172.21.15.49:0/2653012858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5d4155d20 0x7fe5d40bdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:54.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5d9400700 1 --2- 172.21.15.49:0/2653012858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5d40a8740 0x7fe5d41499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5d8a00700 1 -- 172.21.15.49:0/2653012858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5d4155d20 msgr2=0x7fe5d40bdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5d8a00700 1 --2- 172.21.15.49:0/2653012858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5d4155d20 0x7fe5d40bdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5d8a00700 1 -- 172.21.15.49:0/2653012858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5d40a8740 msgr2=0x7fe5d41499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5d8a00700 1 --2- 172.21.15.49:0/2653012858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5d40a8740 0x7fe5d41499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5d8a00700 1 -- 172.21.15.49:0/2653012858 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5cc009a20 con 0x7fe5d40c25e0 2024-01-22T05:18:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5d8a00700 1 --2- 172.21.15.49:0/2653012858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d40c25e0 0x7fe5d40bd5e0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7fe5bc00c5c0 tx=0x7fe5bc007cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5d0c00700 1 -- 172.21.15.49:0/2653012858 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc007e50 con 0x7fe5d40c25e0 2024-01-22T05:18:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5d0c00700 1 -- 172.21.15.49:0/2653012858 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc00f470 con 0x7fe5d40c25e0 2024-01-22T05:18:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5dbe00700 1 -- 172.21.15.49:0/2653012858 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d40bee10 con 0x7fe5d40c25e0 2024-01-22T05:18:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5d0c00700 1 -- 172.21.15.49:0/2653012858 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc00f810 con 0x7fe5d40c25e0 2024-01-22T05:18:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.729+0000 7fe5dbe00700 1 -- 172.21.15.49:0/2653012858 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d40be4a0 con 0x7fe5d40c25e0 2024-01-22T05:18:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.733+0000 7fe5dbe00700 1 -- 172.21.15.49:0/2653012858 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d40befa0 con 0x7fe5d40c25e0 2024-01-22T05:18:54.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.733+0000 7fe5d0c00700 1 -- 172.21.15.49:0/2653012858 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe5bc00fc00 con 0x7fe5d40c25e0 2024-01-22T05:18:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.733+0000 7fe5d0c00700 1 --2- 172.21.15.49:0/2653012858 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe5ac05a540 0x7fe5ac05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.737+0000 7fe5d0c00700 1 -- 172.21.15.49:0/2653012858 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe5bc073da0 con 0x7fe5d40c25e0 2024-01-22T05:18:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.737+0000 7fe5d9400700 1 --2- 172.21.15.49:0/2653012858 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe5ac05a540 0x7fe5ac05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.737+0000 7fe5d9400700 1 --2- 172.21.15.49:0/2653012858 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe5ac05a540 0x7fe5ac05ca00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fe5c4007760 tx=0x7fe5c4007c40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:54.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.741+0000 7fe5d0c00700 1 -- 172.21.15.49:0/2653012858 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe5bc047410 con 0x7fe5d40c25e0 2024-01-22T05:18:54.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.937+0000 7fe5dbe00700 1 -- 172.21.15.49:0/2653012858 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5d40c16d0 con 0x7fe5d40c25e0 2024-01-22T05:18:54.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.937+0000 7fe5d0c00700 1 -- 172.21.15.49:0/2653012858 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+4505 (secure 0 0 0) 0x7fe5bc017030 con 0x7fe5d40c25e0 2024-01-22T05:18:54.936 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:54.936 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":134,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3995018890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3995018890},{"type":"v1","addr":"172.21.15.110:6833","nonce":3995018890}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2248654659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2248654659},{"type":"v1","addr":"172.21.15.49:6837","nonce":2248654659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931981528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1931981528},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931981528}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:18:40.076218+0000","modified":"2024-01-22T05:18:43.416474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9610":{"gid":9610,"name":"b","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/2192470330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2192470330},{"type":"v1","addr":"172.21.15.110:6835","nonce":2192470330}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2024-01-22T05:18:54.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.941+0000 7fe5dbe00700 1 -- 172.21.15.49:0/2653012858 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe5ac05a540 msgr2=0x7fe5ac05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.941+0000 7fe5dbe00700 1 --2- 172.21.15.49:0/2653012858 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe5ac05a540 0x7fe5ac05ca00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fe5c4007760 tx=0x7fe5c4007c40).stop 2024-01-22T05:18:54.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.941+0000 7fe5dbe00700 1 -- 172.21.15.49:0/2653012858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d40c25e0 msgr2=0x7fe5d40bd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:54.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.941+0000 7fe5dbe00700 1 --2- 172.21.15.49:0/2653012858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d40c25e0 0x7fe5d40bd5e0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7fe5bc00c5c0 tx=0x7fe5bc007cb0).stop 2024-01-22T05:18:54.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.941+0000 7fe5dbe00700 1 -- 172.21.15.49:0/2653012858 shutdown_connections 2024-01-22T05:18:54.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.941+0000 7fe5dbe00700 1 --2- 172.21.15.49:0/2653012858 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe5ac05a540 0x7fe5ac05ca00 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.941+0000 7fe5dbe00700 1 --2- 172.21.15.49:0/2653012858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5d4155d20 0x7fe5d40bdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.941+0000 7fe5dbe00700 1 --2- 172.21.15.49:0/2653012858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5d40c25e0 0x7fe5d40bd5e0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.941+0000 7fe5dbe00700 1 --2- 172.21.15.49:0/2653012858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5d40a8740 0x7fe5d41499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:54.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.941+0000 7fe5dbe00700 1 -- 172.21.15.49:0/2653012858 >> 172.21.15.49:0/2653012858 conn(0x7fe5d40c6540 msgr2=0x7fe5d4065b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:54.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.941+0000 7fe5dbe00700 1 -- 172.21.15.49:0/2653012858 shutdown_connections 2024-01-22T05:18:54.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:54.941+0000 7fe5dbe00700 1 -- 172.21.15.49:0/2653012858 wait complete. 2024-01-22T05:18:54.942 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 134 2024-01-22T05:18:54.961 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:18:55.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.121+0000 7fc440000700 1 Processor -- start 2024-01-22T05:18:55.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.121+0000 7fc440000700 1 -- start start 2024-01-22T05:18:55.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc440000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc438065240 0x7fc4380644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc440000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc438064e90 con 0x7fc4380649e0 2024-01-22T05:18:55.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc440000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43815c7d0 con 0x7fc438065620 2024-01-22T05:18:55.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc440000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4380c2700 con 0x7fc438065240 2024-01-22T05:18:55.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc43ea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc4380649e0 0x7fc43815c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50944/0 (socket says 172.21.15.49:50944) 2024-01-22T05:18:55.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc43ea00700 1 -- 172.21.15.49:0/782987531 learned_addr learned my addr 172.21.15.49:0/782987531 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:55.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc43d600700 1 --2- 172.21.15.49:0/782987531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc438065240 0x7fc4380644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc437e00700 1 -- 172.21.15.49:0/782987531 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991969826 0 0) 0x7fc430001490 con 0x7fc4380649e0 2024-01-22T05:18:55.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc437e00700 1 -- 172.21.15.49:0/782987531 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4180033f0 con 0x7fc4380649e0 2024-01-22T05:18:55.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc43d600700 1 -- 172.21.15.49:0/782987531 >> v1:172.21.15.110:6789/0 conn(0x7fc438065620 legacy=0x7fc43815b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc43d600700 1 -- 172.21.15.49:0/782987531 >> v1:172.21.15.49:6789/0 conn(0x7fc4380649e0 legacy=0x7fc43815c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc43d600700 1 -- 172.21.15.49:0/782987531 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4380c29a0 con 0x7fc438065240 2024-01-22T05:18:55.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc43d600700 1 --2- 172.21.15.49:0/782987531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc438065240 0x7fc4380644f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fc428009790 tx=0x7fc428009060).ready entity=mon.2 client_cookie=e1e4e6476e049f5e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:55.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc437e00700 1 -- 172.21.15.49:0/782987531 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42800f510 con 0x7fc438065240 2024-01-22T05:18:55.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc437e00700 1 -- 172.21.15.49:0/782987531 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42800f670 con 0x7fc438065240 2024-01-22T05:18:55.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.125+0000 7fc437e00700 1 -- 172.21.15.49:0/782987531 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42800f9f0 con 0x7fc438065240 2024-01-22T05:18:55.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.129+0000 7fc440000700 1 -- 172.21.15.49:0/782987531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc438065240 msgr2=0x7fc4380644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.129+0000 7fc440000700 1 --2- 172.21.15.49:0/782987531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc438065240 0x7fc4380644f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fc428009790 tx=0x7fc428009060).stop 2024-01-22T05:18:55.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.129+0000 7fc440000700 1 -- 172.21.15.49:0/782987531 shutdown_connections 2024-01-22T05:18:55.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.129+0000 7fc440000700 1 --2- 172.21.15.49:0/782987531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc438065240 0x7fc4380644f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.129+0000 7fc440000700 1 -- 172.21.15.49:0/782987531 >> 172.21.15.49:0/782987531 conn(0x7fc4380c87f0 msgr2=0x7fc4380c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:55.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.129+0000 7fc440000700 1 -- 172.21.15.49:0/782987531 shutdown_connections 2024-01-22T05:18:55.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.129+0000 7fc440000700 1 -- 172.21.15.49:0/782987531 wait complete. 2024-01-22T05:18:55.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc440000700 1 Processor -- start 2024-01-22T05:18:55.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc440000700 1 -- start start 2024-01-22T05:18:55.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc440000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4380649e0 0x7fc438144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc440000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc438065240 0x7fc438158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc440000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc438065620 0x7fc438158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc440000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc438158a60 con 0x7fc4380649e0 2024-01-22T05:18:55.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc440000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc438169e20 con 0x7fc438065240 2024-01-22T05:18:55.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc440000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4380a9fb0 con 0x7fc438065620 2024-01-22T05:18:55.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc43d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4380649e0 0x7fc438144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc43d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4380649e0 0x7fc438144150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50048/0 (socket says 172.21.15.49:50048) 2024-01-22T05:18:55.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc43d600700 1 -- 172.21.15.49:0/242737110 learned_addr learned my addr 172.21.15.49:0/242737110 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:55.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc43cc00700 1 --2- 172.21.15.49:0/242737110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc438065240 0x7fc438158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc43ea00700 1 --2- 172.21.15.49:0/242737110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc438065620 0x7fc438158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc43d600700 1 -- 172.21.15.49:0/242737110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc438065620 msgr2=0x7fc438158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc43d600700 1 --2- 172.21.15.49:0/242737110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc438065620 0x7fc438158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc43d600700 1 -- 172.21.15.49:0/242737110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc438065240 msgr2=0x7fc438158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc43d600700 1 --2- 172.21.15.49:0/242737110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc438065240 0x7fc438158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc43d600700 1 -- 172.21.15.49:0/242737110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4280092a0 con 0x7fc4380649e0 2024-01-22T05:18:55.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.133+0000 7fc43d600700 1 --2- 172.21.15.49:0/242737110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4380649e0 0x7fc438144150 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7fc428009e30 tx=0x7fc428017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:55.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.137+0000 7fc434c00700 1 -- 172.21.15.49:0/242737110 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42801a4d0 con 0x7fc4380649e0 2024-01-22T05:18:55.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.137+0000 7fc434c00700 1 -- 172.21.15.49:0/242737110 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42801e070 con 0x7fc4380649e0 2024-01-22T05:18:55.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.137+0000 7fc440000700 1 -- 172.21.15.49:0/242737110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43815a330 con 0x7fc4380649e0 2024-01-22T05:18:55.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.137+0000 7fc434c00700 1 -- 172.21.15.49:0/242737110 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42801a8a0 con 0x7fc4380649e0 2024-01-22T05:18:55.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.137+0000 7fc440000700 1 -- 172.21.15.49:0/242737110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43815a970 con 0x7fc4380649e0 2024-01-22T05:18:55.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.137+0000 7fc440000700 1 -- 172.21.15.49:0/242737110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc438047060 con 0x7fc4380649e0 2024-01-22T05:18:55.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.137+0000 7fc434c00700 1 -- 172.21.15.49:0/242737110 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc428020030 con 0x7fc4380649e0 2024-01-22T05:18:55.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.141+0000 7fc434c00700 1 --2- 172.21.15.49:0/242737110 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc41005a510 0x7fc41005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.141+0000 7fc434c00700 1 -- 172.21.15.49:0/242737110 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fc428075940 con 0x7fc4380649e0 2024-01-22T05:18:55.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.141+0000 7fc43cc00700 1 --2- 172.21.15.49:0/242737110 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc41005a510 0x7fc41005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.141+0000 7fc43cc00700 1 --2- 172.21.15.49:0/242737110 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc41005a510 0x7fc41005c9d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fc4380bef90 tx=0x7fc420007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:55.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.145+0000 7fc434c00700 1 -- 172.21.15.49:0/242737110 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc428048f60 con 0x7fc4380649e0 2024-01-22T05:18:55.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.345+0000 7fc440000700 1 -- 172.21.15.49:0/242737110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4380c2c80 con 0x7fc4380649e0 2024-01-22T05:18:55.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.345+0000 7fc434c00700 1 -- 172.21.15.49:0/242737110 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+4505 (secure 0 0 0) 0x7fc42804c580 con 0x7fc4380649e0 2024-01-22T05:18:55.346 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:55.346 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":134,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3995018890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3995018890},{"type":"v1","addr":"172.21.15.110:6833","nonce":3995018890}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2248654659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2248654659},{"type":"v1","addr":"172.21.15.49:6837","nonce":2248654659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":9607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931981528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1931981528},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931981528}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:18:40.076218+0000","modified":"2024-01-22T05:18:43.416474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9610":{"gid":9610,"name":"b","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/2192470330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2192470330},{"type":"v1","addr":"172.21.15.110:6835","nonce":2192470330}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2024-01-22T05:18:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.349+0000 7fc440000700 1 -- 172.21.15.49:0/242737110 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc41005a510 msgr2=0x7fc41005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.349+0000 7fc440000700 1 --2- 172.21.15.49:0/242737110 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc41005a510 0x7fc41005c9d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fc4380bef90 tx=0x7fc420007d40).stop 2024-01-22T05:18:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.349+0000 7fc440000700 1 -- 172.21.15.49:0/242737110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4380649e0 msgr2=0x7fc438144150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.349+0000 7fc440000700 1 --2- 172.21.15.49:0/242737110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4380649e0 0x7fc438144150 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7fc428009e30 tx=0x7fc428017000).stop 2024-01-22T05:18:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.349+0000 7fc440000700 1 -- 172.21.15.49:0/242737110 shutdown_connections 2024-01-22T05:18:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.349+0000 7fc440000700 1 --2- 172.21.15.49:0/242737110 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc41005a510 0x7fc41005c9d0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.349+0000 7fc440000700 1 --2- 172.21.15.49:0/242737110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc438065620 0x7fc438158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.349+0000 7fc440000700 1 --2- 172.21.15.49:0/242737110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc438065240 0x7fc438158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.349+0000 7fc440000700 1 --2- 172.21.15.49:0/242737110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4380649e0 0x7fc438144150 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.349+0000 7fc440000700 1 -- 172.21.15.49:0/242737110 >> 172.21.15.49:0/242737110 conn(0x7fc4380c87f0 msgr2=0x7fc4380ad650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:55.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.349+0000 7fc440000700 1 -- 172.21.15.49:0/242737110 shutdown_connections 2024-01-22T05:18:55.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.349+0000 7fc440000700 1 -- 172.21.15.49:0/242737110 wait complete. 2024-01-22T05:18:55.353 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 134 2024-01-22T05:18:55.372 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:18:55.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.533+0000 7f6a43600700 1 Processor -- start 2024-01-22T05:18:55.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.533+0000 7f6a43600700 1 -- start start 2024-01-22T05:18:55.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.533+0000 7f6a43600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a3c062610 0x7f6a3c067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.533+0000 7f6a43600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6a3c067f80 0x7f6a3c0bf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.533+0000 7f6a43600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c068430 con 0x7f6a3c062230 2024-01-22T05:18:55.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.533+0000 7f6a43600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3c0c37d0 con 0x7f6a3c067f80 2024-01-22T05:18:55.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.533+0000 7f6a43600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0c3a20 con 0x7f6a3c062610 2024-01-22T05:18:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a40c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6a3c062230 0x7f6a3c1507c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50956/0 (socket says 172.21.15.49:50956) 2024-01-22T05:18:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a40c00700 1 -- 172.21.15.49:0/3328073059 learned_addr learned my addr 172.21.15.49:0/3328073059 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a3be00700 1 --2- 172.21.15.49:0/3328073059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a3c062610 0x7f6a3c067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a42000700 1 --2- 172.21.15.49:0/3328073059 >> v2:172.21.15.110:3300/0 conn(0x7f6a3c067f80 0x7f6a3c0bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a3b400700 1 -- 172.21.15.49:0/3328073059 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252273467 0 0) 0x7f6a2c001110 con 0x7f6a3c062230 2024-01-22T05:18:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a3b400700 1 -- 172.21.15.49:0/3328073059 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a1c0033f0 con 0x7f6a3c062230 2024-01-22T05:18:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a3be00700 1 -- 172.21.15.49:0/3328073059 >> v2:172.21.15.110:3300/0 conn(0x7f6a3c067f80 msgr2=0x7f6a3c0bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a3be00700 1 --2- 172.21.15.49:0/3328073059 >> v2:172.21.15.110:3300/0 conn(0x7f6a3c067f80 0x7f6a3c0bf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a3be00700 1 -- 172.21.15.49:0/3328073059 >> v1:172.21.15.49:6789/0 conn(0x7f6a3c062230 legacy=0x7f6a3c1507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a3be00700 1 -- 172.21.15.49:0/3328073059 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0c3d00 con 0x7f6a3c062610 2024-01-22T05:18:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a42000700 1 --2- 172.21.15.49:0/3328073059 >> v2:172.21.15.110:3300/0 conn(0x7f6a3c067f80 0x7f6a3c0bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a3be00700 1 --2- 172.21.15.49:0/3328073059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a3c062610 0x7f6a3c067a90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f6a24009760 tx=0x7f6a24009060).ready entity=mon.2 client_cookie=8142a6b87896a951 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a3b400700 1 -- 172.21.15.49:0/3328073059 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2400d4a0 con 0x7f6a3c062610 2024-01-22T05:18:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a3b400700 1 -- 172.21.15.49:0/3328073059 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2400d600 con 0x7f6a3c062610 2024-01-22T05:18:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a3b400700 1 -- 172.21.15.49:0/3328073059 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2400d980 con 0x7f6a3c062610 2024-01-22T05:18:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a43600700 1 -- 172.21.15.49:0/3328073059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a3c062610 msgr2=0x7f6a3c067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.537+0000 7f6a43600700 1 --2- 172.21.15.49:0/3328073059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a3c062610 0x7f6a3c067a90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f6a24009760 tx=0x7f6a24009060).stop 2024-01-22T05:18:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.541+0000 7f6a43600700 1 -- 172.21.15.49:0/3328073059 shutdown_connections 2024-01-22T05:18:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.541+0000 7f6a43600700 1 --2- 172.21.15.49:0/3328073059 >> v2:172.21.15.110:3300/0 conn(0x7f6a3c067f80 0x7f6a3c0bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.541+0000 7f6a43600700 1 --2- 172.21.15.49:0/3328073059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a3c062610 0x7f6a3c067a90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.541+0000 7f6a43600700 1 -- 172.21.15.49:0/3328073059 >> 172.21.15.49:0/3328073059 conn(0x7f6a3c064080 msgr2=0x7f6a3c064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:55.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.541+0000 7f6a43600700 1 -- 172.21.15.49:0/3328073059 shutdown_connections 2024-01-22T05:18:55.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.541+0000 7f6a43600700 1 -- 172.21.15.49:0/3328073059 wait complete. 2024-01-22T05:18:55.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.545+0000 7f6a43600700 1 Processor -- start 2024-01-22T05:18:55.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.545+0000 7f6a43600700 1 -- start start 2024-01-22T05:18:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a43600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a3c062230 0x7f6a3c161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a43600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a3c062610 0x7f6a3c0aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a43600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a3c067f80 0x7f6a3c1621c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a43600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0c2650 con 0x7f6a3c062610 2024-01-22T05:18:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a43600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0aaa90 con 0x7f6a3c062230 2024-01-22T05:18:55.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a43600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0a95a0 con 0x7f6a3c067f80 2024-01-22T05:18:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a3be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a3c062610 0x7f6a3c0aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a3be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a3c062610 0x7f6a3c0aaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50054/0 (socket says 172.21.15.49:50054) 2024-01-22T05:18:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a3be00700 1 -- 172.21.15.49:0/1075186859 learned_addr learned my addr 172.21.15.49:0/1075186859 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a42000700 1 --2- 172.21.15.49:0/1075186859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a3c067f80 0x7f6a3c1621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a40c00700 1 --2- 172.21.15.49:0/1075186859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a3c062230 0x7f6a3c161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a3be00700 1 -- 172.21.15.49:0/1075186859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a3c067f80 msgr2=0x7f6a3c1621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a3be00700 1 --2- 172.21.15.49:0/1075186859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a3c067f80 0x7f6a3c1621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a3be00700 1 -- 172.21.15.49:0/1075186859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a3c062230 msgr2=0x7f6a3c161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a3be00700 1 --2- 172.21.15.49:0/1075186859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a3c062230 0x7f6a3c161010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a3be00700 1 -- 172.21.15.49:0/1075186859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34009a20 con 0x7f6a3c062610 2024-01-22T05:18:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a40c00700 1 --2- 172.21.15.49:0/1075186859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a3c062230 0x7f6a3c161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a3be00700 1 --2- 172.21.15.49:0/1075186859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a3c062610 0x7f6a3c0aaed0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f6a3c0c3b60 tx=0x7f6a24016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a33e00700 1 -- 172.21.15.49:0/1075186859 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a24000c90 con 0x7f6a3c062610 2024-01-22T05:18:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a33e00700 1 -- 172.21.15.49:0/1075186859 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a24021070 con 0x7f6a3c062610 2024-01-22T05:18:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a43600700 1 -- 172.21.15.49:0/1075186859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a240092a0 con 0x7f6a3c062610 2024-01-22T05:18:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a33e00700 1 -- 172.21.15.49:0/1075186859 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2400d770 con 0x7f6a3c062610 2024-01-22T05:18:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.549+0000 7f6a43600700 1 -- 172.21.15.49:0/1075186859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c161950 con 0x7f6a3c062610 2024-01-22T05:18:55.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.553+0000 7f6a43600700 1 -- 172.21.15.49:0/1075186859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c06a1f0 con 0x7f6a3c062610 2024-01-22T05:18:55.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.553+0000 7f6a33e00700 1 -- 172.21.15.49:0/1075186859 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6a2401d740 con 0x7f6a3c062610 2024-01-22T05:18:55.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.557+0000 7f6a33e00700 1 --2- 172.21.15.49:0/1075186859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6a1405a510 0x7f6a1405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.557+0000 7f6a33e00700 1 -- 172.21.15.49:0/1075186859 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f6a24077e90 con 0x7f6a3c062610 2024-01-22T05:18:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.557+0000 7f6a40c00700 1 --2- 172.21.15.49:0/1075186859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6a1405a510 0x7f6a1405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.557+0000 7f6a40c00700 1 --2- 172.21.15.49:0/1075186859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6a1405a510 0x7f6a1405c9d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f6a2c007fd0 tx=0x7f6a2c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:55.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.565+0000 7f6a33e00700 1 -- 172.21.15.49:0/1075186859 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6a2404b490 con 0x7f6a3c062610 2024-01-22T05:18:55.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.733+0000 7f6a43600700 1 -- 172.21.15.49:0/1075186859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a3c0a96e0 con 0x7f6a3c062610 2024-01-22T05:18:55.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.737+0000 7f6a33e00700 1 -- 172.21.15.49:0/1075186859 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+17178 (secure 0 0 0) 0x7f6a24079090 con 0x7f6a3c062610 2024-01-22T05:18:55.736 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:18:55.737 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":172,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:18:41.079736+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:18:38.197050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-01-22T05:18:39.072620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:18:55.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.741+0000 7f6a43600700 1 -- 172.21.15.49:0/1075186859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6a1405a510 msgr2=0x7f6a1405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.741+0000 7f6a43600700 1 --2- 172.21.15.49:0/1075186859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6a1405a510 0x7f6a1405c9d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f6a2c007fd0 tx=0x7f6a2c009040).stop 2024-01-22T05:18:55.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.741+0000 7f6a43600700 1 -- 172.21.15.49:0/1075186859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a3c062610 msgr2=0x7f6a3c0aaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.741+0000 7f6a43600700 1 --2- 172.21.15.49:0/1075186859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a3c062610 0x7f6a3c0aaed0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f6a3c0c3b60 tx=0x7f6a24016000).stop 2024-01-22T05:18:55.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.741+0000 7f6a43600700 1 -- 172.21.15.49:0/1075186859 shutdown_connections 2024-01-22T05:18:55.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.741+0000 7f6a43600700 1 --2- 172.21.15.49:0/1075186859 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6a1405a510 0x7f6a1405c9d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.741+0000 7f6a43600700 1 --2- 172.21.15.49:0/1075186859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a3c067f80 0x7f6a3c1621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.741+0000 7f6a43600700 1 --2- 172.21.15.49:0/1075186859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a3c062610 0x7f6a3c0aaed0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.741+0000 7f6a43600700 1 --2- 172.21.15.49:0/1075186859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a3c062230 0x7f6a3c161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.741+0000 7f6a43600700 1 -- 172.21.15.49:0/1075186859 >> 172.21.15.49:0/1075186859 conn(0x7f6a3c064080 msgr2=0x7f6a3c0ac370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:55.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.741+0000 7f6a43600700 1 -- 172.21.15.49:0/1075186859 shutdown_connections 2024-01-22T05:18:55.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.741+0000 7f6a43600700 1 -- 172.21.15.49:0/1075186859 wait complete. 2024-01-22T05:18:55.764 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:18:55.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.925+0000 7f65d8e00700 1 Processor -- start 2024-01-22T05:18:55.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.925+0000 7f65d8e00700 1 -- start start 2024-01-22T05:18:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d8e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4065240 0x7f65d40644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d8e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f65d4065620 0x7f65d40649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d8e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f65d415b9b0 0x7f65d415be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d8e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d4064ed0 con 0x7f65d4065620 2024-01-22T05:18:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d8e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d40c2700 con 0x7f65d415b9b0 2024-01-22T05:18:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d8e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40c29a0 con 0x7f65d4065240 2024-01-22T05:18:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d1400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f65d4065620 0x7f65d40649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d1400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f65d4065620 0x7f65d40649e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50058/0 (socket says 172.21.15.49:50058) 2024-01-22T05:18:55.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d1400700 1 -- 172.21.15.49:0/1684107615 learned_addr learned my addr 172.21.15.49:0/1684107615 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d1e00700 1 --2- 172.21.15.49:0/1684107615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4065240 0x7f65d40644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d3200700 1 --2- 172.21.15.49:0/1684107615 >> v2:172.21.15.110:3300/0 conn(0x7f65d415b9b0 0x7f65d415be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d1400700 1 -- 172.21.15.49:0/1684107615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4065240 msgr2=0x7f65d40644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d1400700 1 --2- 172.21.15.49:0/1684107615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4065240 0x7f65d40644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d1400700 1 -- 172.21.15.49:0/1684107615 >> v2:172.21.15.110:3300/0 conn(0x7f65d415b9b0 msgr2=0x7f65d415be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d1400700 1 --2- 172.21.15.49:0/1684107615 >> v2:172.21.15.110:3300/0 conn(0x7f65d415b9b0 0x7f65d415be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d1400700 1 -- 172.21.15.49:0/1684107615 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d40c2c80 con 0x7f65d4065620 2024-01-22T05:18:55.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.929+0000 7f65d1400700 1 --2- 172.21.15.49:0/1684107615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d4065620 0x7f65d40649e0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7f65d40665c0 tx=0x7f65bc0090f0).ready entity=mon.0 client_cookie=396632fae3a1ebbb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:55.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.933+0000 7f65d0a00700 1 -- 172.21.15.49:0/1684107615 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc00f510 con 0x7f65d4065620 2024-01-22T05:18:55.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.933+0000 7f65d0a00700 1 -- 172.21.15.49:0/1684107615 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65bc00f670 con 0x7f65d4065620 2024-01-22T05:18:55.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.933+0000 7f65d0a00700 1 -- 172.21.15.49:0/1684107615 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc00f9f0 con 0x7f65d4065620 2024-01-22T05:18:55.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.933+0000 7f65d8e00700 1 -- 172.21.15.49:0/1684107615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d4065620 msgr2=0x7f65d40649e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.933+0000 7f65d8e00700 1 --2- 172.21.15.49:0/1684107615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d4065620 0x7f65d40649e0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7f65d40665c0 tx=0x7f65bc0090f0).stop 2024-01-22T05:18:55.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.933+0000 7f65d8e00700 1 -- 172.21.15.49:0/1684107615 shutdown_connections 2024-01-22T05:18:55.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.933+0000 7f65d8e00700 1 --2- 172.21.15.49:0/1684107615 >> v2:172.21.15.110:3300/0 conn(0x7f65d415b9b0 0x7f65d415be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.933+0000 7f65d8e00700 1 --2- 172.21.15.49:0/1684107615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d4065620 0x7f65d40649e0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.933+0000 7f65d8e00700 1 --2- 172.21.15.49:0/1684107615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4065240 0x7f65d40644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.933+0000 7f65d8e00700 1 -- 172.21.15.49:0/1684107615 >> 172.21.15.49:0/1684107615 conn(0x7f65d40c87f0 msgr2=0x7f65d40c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:55.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.933+0000 7f65d8e00700 1 -- 172.21.15.49:0/1684107615 shutdown_connections 2024-01-22T05:18:55.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.933+0000 7f65d8e00700 1 -- 172.21.15.49:0/1684107615 wait complete. 2024-01-22T05:18:55.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d8e00700 1 Processor -- start 2024-01-22T05:18:55.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d8e00700 1 -- start start 2024-01-22T05:18:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d8e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4065240 0x7f65d4155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d8e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d4065620 0x7f65d40c0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d8e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65d415b9b0 0x7f65d4063450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d8e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d4155a10 con 0x7f65d4065620 2024-01-22T05:18:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d8e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40c1480 con 0x7f65d415b9b0 2024-01-22T05:18:55.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d8e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40c1760 con 0x7f65d4065240 2024-01-22T05:18:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d1400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d4065620 0x7f65d40c0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d1400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d4065620 0x7f65d40c0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50074/0 (socket says 172.21.15.49:50074) 2024-01-22T05:18:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d1400700 1 -- 172.21.15.49:0/1195801623 learned_addr learned my addr 172.21.15.49:0/1195801623 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d3200700 1 --2- 172.21.15.49:0/1195801623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65d415b9b0 0x7f65d4063450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d1e00700 1 --2- 172.21.15.49:0/1195801623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4065240 0x7f65d4155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d1400700 1 -- 172.21.15.49:0/1195801623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4065240 msgr2=0x7f65d4155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d1400700 1 --2- 172.21.15.49:0/1195801623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4065240 0x7f65d4155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d1400700 1 -- 172.21.15.49:0/1195801623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65d415b9b0 msgr2=0x7f65d4063450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.937+0000 7f65d1400700 1 --2- 172.21.15.49:0/1195801623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65d415b9b0 0x7f65d4063450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.941+0000 7f65d1400700 1 -- 172.21.15.49:0/1195801623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc009370 con 0x7f65d4065620 2024-01-22T05:18:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.941+0000 7f65d1e00700 1 --2- 172.21.15.49:0/1195801623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4065240 0x7f65d4155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:18:55.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.941+0000 7f65d1400700 1 --2- 172.21.15.49:0/1195801623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d4065620 0x7f65d40c0c30 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7f65bc011000 tx=0x7f65bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.941+0000 7f65c9600700 1 -- 172.21.15.49:0/1195801623 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc00f7e0 con 0x7f65d4065620 2024-01-22T05:18:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.941+0000 7f65c9600700 1 -- 172.21.15.49:0/1195801623 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65bc00f940 con 0x7f65d4065620 2024-01-22T05:18:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.941+0000 7f65d8e00700 1 -- 172.21.15.49:0/1195801623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d416b9a0 con 0x7f65d4065620 2024-01-22T05:18:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.941+0000 7f65c9600700 1 -- 172.21.15.49:0/1195801623 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc01c670 con 0x7f65d4065620 2024-01-22T05:18:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.941+0000 7f65d8e00700 1 -- 172.21.15.49:0/1195801623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d416bf60 con 0x7f65d4065620 2024-01-22T05:18:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.941+0000 7f65d8e00700 1 -- 172.21.15.49:0/1195801623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d416c1b0 con 0x7f65d4065620 2024-01-22T05:18:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.941+0000 7f65c9600700 1 -- 172.21.15.49:0/1195801623 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f65bc01ca20 con 0x7f65d4065620 2024-01-22T05:18:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.945+0000 7f65c9600700 1 --2- 172.21.15.49:0/1195801623 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f65ac05a510 0x7f65ac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.945+0000 7f65c9600700 1 -- 172.21.15.49:0/1195801623 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f65bc0768e0 con 0x7f65d4065620 2024-01-22T05:18:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.945+0000 7f65d1e00700 1 --2- 172.21.15.49:0/1195801623 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f65ac05a510 0x7f65ac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.945+0000 7f65d1e00700 1 --2- 172.21.15.49:0/1195801623 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f65ac05a510 0x7f65ac05c9d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f65c4006d80 tx=0x7f65c4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:55.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:55.953+0000 7f65c9600700 1 -- 172.21.15.49:0/1195801623 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f65bc049ea0 con 0x7f65d4065620 2024-01-22T05:18:56.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.165+0000 7f65d8e00700 1 -- 172.21.15.49:0/1195801623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f65d416b800 con 0x7f65d4065620 2024-01-22T05:18:56.497 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:18:56.497+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:18:56.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.513+0000 7f65c9600700 1 -- 172.21.15.49:0/1195801623 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v135) v1 ==== 161+0+0 (secure 0 0 0) 0x7f65d416b800 con 0x7f65d4065620 2024-01-22T05:18:56.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.517+0000 7f65d8e00700 1 -- 172.21.15.49:0/1195801623 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f65ac05a510 msgr2=0x7f65ac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:56.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.517+0000 7f65d8e00700 1 --2- 172.21.15.49:0/1195801623 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f65ac05a510 0x7f65ac05c9d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f65c4006d80 tx=0x7f65c4008040).stop 2024-01-22T05:18:56.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.517+0000 7f65d8e00700 1 -- 172.21.15.49:0/1195801623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d4065620 msgr2=0x7f65d40c0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:56.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.517+0000 7f65d8e00700 1 --2- 172.21.15.49:0/1195801623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d4065620 0x7f65d40c0c30 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7f65bc011000 tx=0x7f65bc017000).stop 2024-01-22T05:18:56.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.517+0000 7f65d8e00700 1 -- 172.21.15.49:0/1195801623 shutdown_connections 2024-01-22T05:18:56.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.517+0000 7f65d8e00700 1 --2- 172.21.15.49:0/1195801623 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f65ac05a510 0x7f65ac05c9d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:56.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.517+0000 7f65d8e00700 1 --2- 172.21.15.49:0/1195801623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65d415b9b0 0x7f65d4063450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:56.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.517+0000 7f65d8e00700 1 --2- 172.21.15.49:0/1195801623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65d4065620 0x7f65d40c0c30 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:56.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.517+0000 7f65d8e00700 1 --2- 172.21.15.49:0/1195801623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4065240 0x7f65d4155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:56.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.517+0000 7f65d8e00700 1 -- 172.21.15.49:0/1195801623 >> 172.21.15.49:0/1195801623 conn(0x7f65d40c87f0 msgr2=0x7f65d4156bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:56.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.517+0000 7f65d8e00700 1 -- 172.21.15.49:0/1195801623 shutdown_connections 2024-01-22T05:18:56.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.517+0000 7f65d8e00700 1 -- 172.21.15.49:0/1195801623 wait complete. 2024-01-22T05:18:56.519 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:18:56.524 INFO:tasks.ceph.mds.b.smithi110.stderr: -3594> 2024-01-22T05:18:45.563+0000 7f61c0a00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:18:56.528 INFO:tasks.ceph.mds.b.smithi110.stderr: -1811> 2024-01-22T05:18:49.599+0000 7f61bc400700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2024-01-22T05:18:47.965529+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={8357=0-12582912@1} caps={8357=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=8357 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5610bb9ff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(25)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-22T05:18:56.541 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:18:56.569 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:18:56.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.713+0000 7f8d1a600700 1 Processor -- start 2024-01-22T05:18:56.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.717+0000 7f8d1a600700 1 -- start start 2024-01-22T05:18:56.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d1a600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d14151780 0x7f8d14062c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:56.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d1a600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8d14067ca0 0x7f8d14068100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:56.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d1a600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d140c3990 con 0x7f8d140c3e20 2024-01-22T05:18:56.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d1a600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d140685f0 con 0x7f8d14067ca0 2024-01-22T05:18:56.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d1a600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14063490 con 0x7f8d14151780 2024-01-22T05:18:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d13400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d14151780 0x7f8d14062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d12a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8d14067ca0 0x7f8d14068100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d19000700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8d140c3e20 0x7f8d140c42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:46086/0 (socket says 172.21.15.49:46086) 2024-01-22T05:18:56.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d19000700 1 -- 172.21.15.49:0/3797622907 learned_addr learned my addr 172.21.15.49:0/3797622907 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d12000700 1 -- 172.21.15.49:0/3797622907 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479460353 0 0) 0x7f8d140c3990 con 0x7f8d140c3e20 2024-01-22T05:18:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d12000700 1 -- 172.21.15.49:0/3797622907 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cf40033f0 con 0x7f8d140c3e20 2024-01-22T05:18:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d13400700 1 -- 172.21.15.49:0/3797622907 >> v2:172.21.15.110:3300/0 conn(0x7f8d14067ca0 msgr2=0x7f8d14068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d13400700 1 --2- 172.21.15.49:0/3797622907 >> v2:172.21.15.110:3300/0 conn(0x7f8d14067ca0 0x7f8d14068100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d13400700 1 -- 172.21.15.49:0/3797622907 >> v1:172.21.15.110:6789/0 conn(0x7f8d140c3e20 legacy=0x7f8d140c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d13400700 1 -- 172.21.15.49:0/3797622907 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d14063770 con 0x7f8d14151780 2024-01-22T05:18:56.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d13400700 1 --2- 172.21.15.49:0/3797622907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d14151780 0x7f8d14062c00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f8d04009760 tx=0x7f8d04009060).ready entity=mon.2 client_cookie=67923b4d449f3dbd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.721+0000 7f8d12000700 1 -- 172.21.15.49:0/3797622907 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0400d4a0 con 0x7f8d14151780 2024-01-22T05:18:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.725+0000 7f8d12000700 1 -- 172.21.15.49:0/3797622907 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0400d600 con 0x7f8d14151780 2024-01-22T05:18:56.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.725+0000 7f8d12000700 1 -- 172.21.15.49:0/3797622907 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0400d980 con 0x7f8d14151780 2024-01-22T05:18:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.725+0000 7f8d1a600700 1 -- 172.21.15.49:0/3797622907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d14151780 msgr2=0x7f8d14062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.725+0000 7f8d1a600700 1 --2- 172.21.15.49:0/3797622907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d14151780 0x7f8d14062c00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f8d04009760 tx=0x7f8d04009060).stop 2024-01-22T05:18:56.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.725+0000 7f8d1a600700 1 -- 172.21.15.49:0/3797622907 shutdown_connections 2024-01-22T05:18:56.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.725+0000 7f8d1a600700 1 --2- 172.21.15.49:0/3797622907 >> v2:172.21.15.110:3300/0 conn(0x7f8d14067ca0 0x7f8d14068100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:56.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.725+0000 7f8d1a600700 1 --2- 172.21.15.49:0/3797622907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d14151780 0x7f8d14062c00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:56.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.725+0000 7f8d1a600700 1 -- 172.21.15.49:0/3797622907 >> 172.21.15.49:0/3797622907 conn(0x7f8d14064080 msgr2=0x7f8d14064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:56.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.725+0000 7f8d1a600700 1 -- 172.21.15.49:0/3797622907 shutdown_connections 2024-01-22T05:18:56.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.725+0000 7f8d1a600700 1 -- 172.21.15.49:0/3797622907 wait complete. 2024-01-22T05:18:56.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.729+0000 7f8d1a600700 1 Processor -- start 2024-01-22T05:18:56.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.729+0000 7f8d1a600700 1 -- start start 2024-01-22T05:18:56.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.729+0000 7f8d1a600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d14067ca0 0x7f8d14150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:56.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.729+0000 7f8d1a600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140c3e20 0x7f8d140a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:56.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.729+0000 7f8d1a600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d14151780 0x7f8d141389e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:56.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.729+0000 7f8d1a600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140a9230 con 0x7f8d140c3e20 2024-01-22T05:18:56.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.729+0000 7f8d1a600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140c2520 con 0x7f8d14067ca0 2024-01-22T05:18:56.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.729+0000 7f8d1a600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140c2800 con 0x7f8d14151780 2024-01-22T05:18:56.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.729+0000 7f8d12a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140c3e20 0x7f8d140a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:56.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.729+0000 7f8d12a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140c3e20 0x7f8d140a8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50082/0 (socket says 172.21.15.49:50082) 2024-01-22T05:18:56.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.729+0000 7f8d12a00700 1 -- 172.21.15.49:0/2425128709 learned_addr learned my addr 172.21.15.49:0/2425128709 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:56.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.729+0000 7f8d19000700 1 --2- 172.21.15.49:0/2425128709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d14151780 0x7f8d141389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:56.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.729+0000 7f8d13400700 1 --2- 172.21.15.49:0/2425128709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d14067ca0 0x7f8d14150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:56.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.733+0000 7f8d12a00700 1 -- 172.21.15.49:0/2425128709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d14151780 msgr2=0x7f8d141389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:56.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.733+0000 7f8d12a00700 1 --2- 172.21.15.49:0/2425128709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d14151780 0x7f8d141389e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:56.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.733+0000 7f8d12a00700 1 -- 172.21.15.49:0/2425128709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d14067ca0 msgr2=0x7f8d14150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:56.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.733+0000 7f8d12a00700 1 --2- 172.21.15.49:0/2425128709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d14067ca0 0x7f8d14150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:56.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.733+0000 7f8d12a00700 1 -- 172.21.15.49:0/2425128709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d040092a0 con 0x7f8d140c3e20 2024-01-22T05:18:56.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.733+0000 7f8d19000700 1 --2- 172.21.15.49:0/2425128709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d14151780 0x7f8d141389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:18:56.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.733+0000 7f8d12a00700 1 --2- 172.21.15.49:0/2425128709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140c3e20 0x7f8d140a8d40 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7f8cfc00e900 tx=0x7f8cfc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:56.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.733+0000 7f8d0aa00700 1 -- 172.21.15.49:0/2425128709 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc012600 con 0x7f8d140c3e20 2024-01-22T05:18:56.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.733+0000 7f8d0aa00700 1 -- 172.21.15.49:0/2425128709 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cfc012760 con 0x7f8d140c3e20 2024-01-22T05:18:56.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.733+0000 7f8d0aa00700 1 -- 172.21.15.49:0/2425128709 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc012ae0 con 0x7f8d140c3e20 2024-01-22T05:18:56.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.733+0000 7f8d1a600700 1 -- 172.21.15.49:0/2425128709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d141503b0 con 0x7f8d140c3e20 2024-01-22T05:18:56.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.733+0000 7f8d1a600700 1 -- 172.21.15.49:0/2425128709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d14138ed0 con 0x7f8d140c3e20 2024-01-22T05:18:56.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.737+0000 7f8d1a600700 1 -- 172.21.15.49:0/2425128709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d140c2a20 con 0x7f8d140c3e20 2024-01-22T05:18:56.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.737+0000 7f8d0aa00700 1 -- 172.21.15.49:0/2425128709 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8cfc01b400 con 0x7f8d140c3e20 2024-01-22T05:18:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.737+0000 7f8d0aa00700 1 --2- 172.21.15.49:0/2425128709 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8cec05a540 0x7f8cec05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.741+0000 7f8d0aa00700 1 -- 172.21.15.49:0/2425128709 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f8cfc074de0 con 0x7f8d140c3e20 2024-01-22T05:18:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.741+0000 7f8d13400700 1 --2- 172.21.15.49:0/2425128709 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8cec05a540 0x7f8cec05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:56.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.741+0000 7f8d13400700 1 --2- 172.21.15.49:0/2425128709 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8cec05a540 0x7f8cec05ca00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f8d0400d260 tx=0x7f8d04016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:56.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.745+0000 7f8d0aa00700 1 -- 172.21.15.49:0/2425128709 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8cfc048310 con 0x7f8d140c3e20 2024-01-22T05:18:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:56.937+0000 7f8d1a600700 1 -- 172.21.15.49:0/2425128709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8d14047060 con 0x7f8d140c3e20 2024-01-22T05:18:57.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.525+0000 7f8d0aa00700 1 -- 172.21.15.49:0/2425128709 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v136) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8cfc04b930 con 0x7f8d140c3e20 2024-01-22T05:18:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.529+0000 7f8d1a600700 1 -- 172.21.15.49:0/2425128709 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8cec05a540 msgr2=0x7f8cec05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.529+0000 7f8d1a600700 1 --2- 172.21.15.49:0/2425128709 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8cec05a540 0x7f8cec05ca00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f8d0400d260 tx=0x7f8d04016000).stop 2024-01-22T05:18:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.529+0000 7f8d1a600700 1 -- 172.21.15.49:0/2425128709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140c3e20 msgr2=0x7f8d140a8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:57.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.529+0000 7f8d1a600700 1 --2- 172.21.15.49:0/2425128709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140c3e20 0x7f8d140a8d40 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7f8cfc00e900 tx=0x7f8cfc009060).stop 2024-01-22T05:18:57.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.529+0000 7f8d1a600700 1 -- 172.21.15.49:0/2425128709 shutdown_connections 2024-01-22T05:18:57.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.529+0000 7f8d1a600700 1 --2- 172.21.15.49:0/2425128709 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8cec05a540 0x7f8cec05ca00 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:57.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.529+0000 7f8d1a600700 1 --2- 172.21.15.49:0/2425128709 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d14151780 0x7f8d141389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:57.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.529+0000 7f8d1a600700 1 --2- 172.21.15.49:0/2425128709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140c3e20 0x7f8d140a8d40 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:57.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.529+0000 7f8d1a600700 1 --2- 172.21.15.49:0/2425128709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d14067ca0 0x7f8d14150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:57.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.529+0000 7f8d1a600700 1 -- 172.21.15.49:0/2425128709 >> 172.21.15.49:0/2425128709 conn(0x7f8d14064080 msgr2=0x7f8d140c77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:57.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.529+0000 7f8d1a600700 1 -- 172.21.15.49:0/2425128709 shutdown_connections 2024-01-22T05:18:57.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.529+0000 7f8d1a600700 1 -- 172.21.15.49:0/2425128709 wait complete. 2024-01-22T05:18:57.553 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:18:57.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.721+0000 7f89ca600700 1 Processor -- start 2024-01-22T05:18:57.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.721+0000 7f89ca600700 1 -- start start 2024-01-22T05:18:57.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.725+0000 7f89ca600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89c414f9b0 0x7f89c40c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:57.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.725+0000 7f89ca600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89c40c5b40 0x7f89c4153d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:57.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.725+0000 7f89ca600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c4067750 con 0x7f89c40c56e0 2024-01-22T05:18:57.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.725+0000 7f89ca600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c4066b40 con 0x7f89c414f9b0 2024-01-22T05:18:57.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.725+0000 7f89ca600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c4066e20 con 0x7f89c40c5b40 2024-01-22T05:18:57.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.725+0000 7f89c3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89c414f9b0 0x7f89c40c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:57.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.725+0000 7f89c3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89c414f9b0 0x7f89c40c51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50098/0 (socket says 172.21.15.49:50098) 2024-01-22T05:18:57.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.725+0000 7f89c3400700 1 -- 172.21.15.49:0/539187214 learned_addr learned my addr 172.21.15.49:0/539187214 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:57.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.725+0000 7f89c3e00700 1 --2- 172.21.15.49:0/539187214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89c40c5b40 0x7f89c4153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:57.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89c3400700 1 -- 172.21.15.49:0/539187214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89c40c5b40 msgr2=0x7f89c4153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:57.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89c3400700 1 --2- 172.21.15.49:0/539187214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89c40c5b40 0x7f89c4153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:57.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89c3400700 1 -- 172.21.15.49:0/539187214 >> v1:172.21.15.110:6789/0 conn(0x7f89c40c56e0 legacy=0x7f89c4153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:57.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89c3400700 1 -- 172.21.15.49:0/539187214 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c4067100 con 0x7f89c414f9b0 2024-01-22T05:18:57.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89c3400700 1 --2- 172.21.15.49:0/539187214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89c414f9b0 0x7f89c40c51f0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f89b4009810 tx=0x7f89b4009060).ready entity=mon.0 client_cookie=713e3b0d9436b6ce server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:57.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89c2000700 1 -- 172.21.15.49:0/539187214 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4005880 con 0x7f89c414f9b0 2024-01-22T05:18:57.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89c2000700 1 -- 172.21.15.49:0/539187214 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b40059e0 con 0x7f89c414f9b0 2024-01-22T05:18:57.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89c2000700 1 -- 172.21.15.49:0/539187214 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4005d60 con 0x7f89c414f9b0 2024-01-22T05:18:57.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89ca600700 1 -- 172.21.15.49:0/539187214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89c414f9b0 msgr2=0x7f89c40c51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:57.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89ca600700 1 --2- 172.21.15.49:0/539187214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89c414f9b0 0x7f89c40c51f0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f89b4009810 tx=0x7f89b4009060).stop 2024-01-22T05:18:57.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89ca600700 1 -- 172.21.15.49:0/539187214 shutdown_connections 2024-01-22T05:18:57.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89ca600700 1 --2- 172.21.15.49:0/539187214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89c40c5b40 0x7f89c4153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:57.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89ca600700 1 --2- 172.21.15.49:0/539187214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89c414f9b0 0x7f89c40c51f0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:57.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89ca600700 1 -- 172.21.15.49:0/539187214 >> 172.21.15.49:0/539187214 conn(0x7f89c40c3420 msgr2=0x7f89c40c3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:57.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89ca600700 1 -- 172.21.15.49:0/539187214 shutdown_connections 2024-01-22T05:18:57.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.729+0000 7f89ca600700 1 -- 172.21.15.49:0/539187214 wait complete. 2024-01-22T05:18:57.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.733+0000 7f89ca600700 1 Processor -- start 2024-01-22T05:18:57.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.733+0000 7f89ca600700 1 -- start start 2024-01-22T05:18:57.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89ca600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89c40c56e0 0x7f89c414d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:57.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89ca600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89c40c5b40 0x7f89c414c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:57.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89ca600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89c414f9b0 0x7f89c414a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:57.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89ca600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c414d600 con 0x7f89c414f9b0 2024-01-22T05:18:57.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89ca600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c414d8e0 con 0x7f89c40c56e0 2024-01-22T05:18:57.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89ca600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40a75e0 con 0x7f89c40c5b40 2024-01-22T05:18:57.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89c3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89c414f9b0 0x7f89c414a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:57.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89c3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89c414f9b0 0x7f89c414a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50102/0 (socket says 172.21.15.49:50102) 2024-01-22T05:18:57.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89c3e00700 1 -- 172.21.15.49:0/2247774764 learned_addr learned my addr 172.21.15.49:0/2247774764 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:57.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89c3400700 1 --2- 172.21.15.49:0/2247774764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89c40c56e0 0x7f89c414d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:57.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89c2a00700 1 --2- 172.21.15.49:0/2247774764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89c40c5b40 0x7f89c414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:57.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89c3e00700 1 -- 172.21.15.49:0/2247774764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89c40c5b40 msgr2=0x7f89c414c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:57.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89c3e00700 1 --2- 172.21.15.49:0/2247774764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89c40c5b40 0x7f89c414c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:57.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89c3e00700 1 -- 172.21.15.49:0/2247774764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89c40c56e0 msgr2=0x7f89c414d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:57.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89c3e00700 1 --2- 172.21.15.49:0/2247774764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89c40c56e0 0x7f89c414d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:57.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89c3e00700 1 -- 172.21.15.49:0/2247774764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b4009300 con 0x7f89c414f9b0 2024-01-22T05:18:57.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89c3e00700 1 --2- 172.21.15.49:0/2247774764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89c414f9b0 0x7f89c414a430 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7f89bc007f20 tx=0x7f89bc0098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:57.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.737+0000 7f89baa00700 1 -- 172.21.15.49:0/2247774764 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc00eb90 con 0x7f89c414f9b0 2024-01-22T05:18:57.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.741+0000 7f89baa00700 1 -- 172.21.15.49:0/2247774764 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc00ecf0 con 0x7f89c414f9b0 2024-01-22T05:18:57.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.741+0000 7f89baa00700 1 -- 172.21.15.49:0/2247774764 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc014610 con 0x7f89c414f9b0 2024-01-22T05:18:57.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.741+0000 7f89ca600700 1 -- 172.21.15.49:0/2247774764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c40a78c0 con 0x7f89c414f9b0 2024-01-22T05:18:57.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.741+0000 7f89ca600700 1 -- 172.21.15.49:0/2247774764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c414cd50 con 0x7f89c414f9b0 2024-01-22T05:18:57.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.741+0000 7f89ca600700 1 -- 172.21.15.49:0/2247774764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c40a7ae0 con 0x7f89c414f9b0 2024-01-22T05:18:57.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.741+0000 7f89baa00700 1 -- 172.21.15.49:0/2247774764 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f89bc01d3b0 con 0x7f89c414f9b0 2024-01-22T05:18:57.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.745+0000 7f89baa00700 1 --2- 172.21.15.49:0/2247774764 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f899c05a4e0 0x7f899c05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:57.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.745+0000 7f89baa00700 1 -- 172.21.15.49:0/2247774764 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f89bc074e20 con 0x7f89c414f9b0 2024-01-22T05:18:57.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.745+0000 7f89c3400700 1 --2- 172.21.15.49:0/2247774764 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f899c05a4e0 0x7f899c05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:57.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.745+0000 7f89c3400700 1 --2- 172.21.15.49:0/2247774764 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f899c05a4e0 0x7f899c05c9a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f89b4009fd0 tx=0x7f89b4016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:57.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.749+0000 7f89baa00700 1 -- 172.21.15.49:0/2247774764 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f89bc0483f0 con 0x7f89c414f9b0 2024-01-22T05:18:57.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:57.921+0000 7f89ca600700 1 -- 172.21.15.49:0/2247774764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f89c40673e0 con 0x7f89c414f9b0 2024-01-22T05:18:58.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.537+0000 7f89baa00700 1 -- 172.21.15.49:0/2247774764 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v174) v1 ==== 181+0+0 (secure 0 0 0) 0x7f89bc00ee60 con 0x7f89c414f9b0 2024-01-22T05:18:58.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.545+0000 7f89ca600700 1 -- 172.21.15.49:0/2247774764 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f899c05a4e0 msgr2=0x7f899c05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:58.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.545+0000 7f89ca600700 1 --2- 172.21.15.49:0/2247774764 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f899c05a4e0 0x7f899c05c9a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f89b4009fd0 tx=0x7f89b4016000).stop 2024-01-22T05:18:58.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.545+0000 7f89ca600700 1 -- 172.21.15.49:0/2247774764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89c414f9b0 msgr2=0x7f89c414a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:58.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.545+0000 7f89ca600700 1 --2- 172.21.15.49:0/2247774764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89c414f9b0 0x7f89c414a430 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7f89bc007f20 tx=0x7f89bc0098a0).stop 2024-01-22T05:18:58.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.545+0000 7f89ca600700 1 -- 172.21.15.49:0/2247774764 shutdown_connections 2024-01-22T05:18:58.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.545+0000 7f89ca600700 1 --2- 172.21.15.49:0/2247774764 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f899c05a4e0 0x7f899c05c9a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:58.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.545+0000 7f89ca600700 1 --2- 172.21.15.49:0/2247774764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89c414f9b0 0x7f89c414a430 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:58.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.545+0000 7f89ca600700 1 --2- 172.21.15.49:0/2247774764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89c40c5b40 0x7f89c414c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:58.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.545+0000 7f89ca600700 1 --2- 172.21.15.49:0/2247774764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89c40c56e0 0x7f89c414d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:58.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.545+0000 7f89ca600700 1 -- 172.21.15.49:0/2247774764 >> 172.21.15.49:0/2247774764 conn(0x7f89c40c3420 msgr2=0x7f89c4068e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:58.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.545+0000 7f89ca600700 1 -- 172.21.15.49:0/2247774764 shutdown_connections 2024-01-22T05:18:58.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.545+0000 7f89ca600700 1 -- 172.21.15.49:0/2247774764 wait complete. 2024-01-22T05:18:58.547 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:18:58.566 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:18:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.745+0000 7f35acc00700 1 Processor -- start 2024-01-22T05:18:58.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.745+0000 7f35acc00700 1 -- start start 2024-01-22T05:18:58.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35acc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35a8068600 0x7f35a815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:58.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35acc00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a8066560 con 0x7f35a8068cb0 2024-01-22T05:18:58.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35acc00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a8065950 con 0x7f35a8067a90 2024-01-22T05:18:58.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35acc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80bc930 con 0x7f35a8068600 2024-01-22T05:18:58.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35a7400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f35a8068cb0 0x7f35a8156f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50968/0 (socket says 172.21.15.49:50968) 2024-01-22T05:18:58.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35a7400700 1 -- 172.21.15.49:0/1553184768 learned_addr learned my addr 172.21.15.49:0/1553184768 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:18:58.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35a7e00700 1 --2- 172.21.15.49:0/1553184768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35a8068600 0x7f35a815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:58.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264294823 0 0) 0x7f35a8066560 con 0x7f35a8068cb0 2024-01-22T05:18:58.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35880033f0 con 0x7f35a8068cb0 2024-01-22T05:18:58.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797685801 0 0) 0x7f35a8065950 con 0x7f35a8067a90 2024-01-22T05:18:58.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35a8066560 con 0x7f35a8067a90 2024-01-22T05:18:58.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3629054340 0 0) 0x7f35880033f0 con 0x7f35a8068cb0 2024-01-22T05:18:58.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35a8068600 msgr2=0x7f35a815eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:58.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35a6000700 1 --2- 172.21.15.49:0/1553184768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35a8068600 0x7f35a815eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:58.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 >> v1:172.21.15.110:6789/0 conn(0x7f35a8067a90 legacy=0x7f35a8067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:58.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a8065c30 con 0x7f35a8068cb0 2024-01-22T05:18:58.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f3598001470 con 0x7f35a8068cb0 2024-01-22T05:18:58.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.749+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 >> v1:172.21.15.49:6789/0 conn(0x7f35a8068cb0 legacy=0x7f35a8156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:58.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a6000700 1 --2- 172.21.15.49:0/1553184768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3588003aa0 0x7f3588003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:58.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a6000700 1 --2- 172.21.15.49:0/1553184768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3588004690 0x7f3588004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:58.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a6000700 1 --2- 172.21.15.49:0/1553184768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35a8068600 0x7f3588005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:58.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80bc930 con 0x7f3588003aa0 2024-01-22T05:18:58.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358800b910 con 0x7f3588004690 2024-01-22T05:18:58.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358800bad0 con 0x7f35a8068600 2024-01-22T05:18:58.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a7400700 1 --2- 172.21.15.49:0/1553184768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3588003aa0 0x7f3588003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:58.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a7e00700 1 --2- 172.21.15.49:0/1553184768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35a8068600 0x7f3588005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a6a00700 1 --2- 172.21.15.49:0/1553184768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3588004690 0x7f3588004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a7400700 1 -- 172.21.15.49:0/1553184768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35a8068600 msgr2=0x7f3588005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a7400700 1 --2- 172.21.15.49:0/1553184768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35a8068600 0x7f3588005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a7400700 1 -- 172.21.15.49:0/1553184768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3588004690 msgr2=0x7f3588004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a7400700 1 --2- 172.21.15.49:0/1553184768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3588004690 0x7f3588004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a7400700 1 -- 172.21.15.49:0/1553184768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35880033f0 con 0x7f3588003aa0 2024-01-22T05:18:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a7400700 1 --2- 172.21.15.49:0/1553184768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3588003aa0 0x7f3588003ea0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f359800c190 tx=0x7f3598001e10).ready entity=mon.0 client_cookie=102602129e0c6310 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800ca00 con 0x7f3588003aa0 2024-01-22T05:18:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359800cb60 con 0x7f3588003aa0 2024-01-22T05:18:58.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a6000700 1 -- 172.21.15.49:0/1553184768 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35980070d0 con 0x7f3588003aa0 2024-01-22T05:18:58.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35acc00700 1 -- 172.21.15.49:0/1553184768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3588003aa0 msgr2=0x7f3588003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:58.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35acc00700 1 --2- 172.21.15.49:0/1553184768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3588003aa0 0x7f3588003ea0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f359800c190 tx=0x7f3598001e10).stop 2024-01-22T05:18:58.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35a7e00700 1 -- 172.21.15.49:0/1553184768 reap_dead start 2024-01-22T05:18:58.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35acc00700 1 -- 172.21.15.49:0/1553184768 shutdown_connections 2024-01-22T05:18:58.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.753+0000 7f35acc00700 1 -- 172.21.15.49:0/1553184768 >> 172.21.15.49:0/1553184768 conn(0x7f35a80c6f70 msgr2=0x7f35a80c2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:58.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.757+0000 7f35acc00700 1 -- 172.21.15.49:0/1553184768 shutdown_connections 2024-01-22T05:18:58.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.757+0000 7f35acc00700 1 -- 172.21.15.49:0/1553184768 wait complete. 2024-01-22T05:18:58.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.757+0000 7f35acc00700 1 Processor -- start 2024-01-22T05:18:58.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.757+0000 7f35acc00700 1 -- start start 2024-01-22T05:18:58.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35acc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3588003aa0 0x7f35a8155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:58.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35acc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a815b2c0 0x7f35a8141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:58.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35acc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35a81422a0 0x7f35a8158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:58.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35acc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80bd240 con 0x7f35a815b2c0 2024-01-22T05:18:58.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35acc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8168300 con 0x7f3588003aa0 2024-01-22T05:18:58.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35acc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8168550 con 0x7f35a81422a0 2024-01-22T05:18:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35a6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a815b2c0 0x7f35a8141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35a6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a815b2c0 0x7f35a8141db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50122/0 (socket says 172.21.15.49:50122) 2024-01-22T05:18:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35a6a00700 1 -- 172.21.15.49:0/3166643794 learned_addr learned my addr 172.21.15.49:0/3166643794 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35a7400700 1 --2- 172.21.15.49:0/3166643794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3588003aa0 0x7f35a8155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35a7e00700 1 --2- 172.21.15.49:0/3166643794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35a81422a0 0x7f35a8158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35a6a00700 1 -- 172.21.15.49:0/3166643794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35a81422a0 msgr2=0x7f35a8158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35a6a00700 1 --2- 172.21.15.49:0/3166643794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35a81422a0 0x7f35a8158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35a6a00700 1 -- 172.21.15.49:0/3166643794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3588003aa0 msgr2=0x7f35a8155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35a6a00700 1 --2- 172.21.15.49:0/3166643794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3588003aa0 0x7f35a8155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35a6a00700 1 -- 172.21.15.49:0/3166643794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a8168830 con 0x7f35a815b2c0 2024-01-22T05:18:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35a7e00700 1 --2- 172.21.15.49:0/3166643794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35a81422a0 0x7f35a8158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:18:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35a6a00700 1 --2- 172.21.15.49:0/3166643794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a815b2c0 0x7f35a8141db0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7f359000e810 tx=0x7f3590009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f359ea00700 1 -- 172.21.15.49:0/3166643794 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590001570 con 0x7f35a815b2c0 2024-01-22T05:18:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f359ea00700 1 -- 172.21.15.49:0/3166643794 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35900016d0 con 0x7f35a815b2c0 2024-01-22T05:18:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35acc00700 1 -- 172.21.15.49:0/3166643794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a8168b10 con 0x7f35a815b2c0 2024-01-22T05:18:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f359ea00700 1 -- 172.21.15.49:0/3166643794 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590001a50 con 0x7f35a815b2c0 2024-01-22T05:18:58.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.761+0000 7f35acc00700 1 -- 172.21.15.49:0/3166643794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a81690d0 con 0x7f35a815b2c0 2024-01-22T05:18:58.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.765+0000 7f35acc00700 1 -- 172.21.15.49:0/3166643794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a8157610 con 0x7f35a815b2c0 2024-01-22T05:18:58.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.765+0000 7f359ea00700 1 -- 172.21.15.49:0/3166643794 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3590014430 con 0x7f35a815b2c0 2024-01-22T05:18:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.765+0000 7f359ea00700 1 --2- 172.21.15.49:0/3166643794 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f358005a510 0x7f358005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.765+0000 7f359ea00700 1 -- 172.21.15.49:0/3166643794 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6122+0+0 (secure 0 0 0) 0x7f3590074590 con 0x7f35a815b2c0 2024-01-22T05:18:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.769+0000 7f35a7400700 1 --2- 172.21.15.49:0/3166643794 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f358005a510 0x7f358005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.769+0000 7f35a7400700 1 --2- 172.21.15.49:0/3166643794 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f358005a510 0x7f358005c9d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f3598001120 tx=0x7f3598015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.773+0000 7f359ea00700 1 -- 172.21.15.49:0/3166643794 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f35a8157610 con 0x7f35a815b2c0 2024-01-22T05:18:58.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:58.937+0000 7f35acc00700 1 -- 172.21.15.49:0/3166643794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f35a8157610 con 0x7f35a815b2c0 2024-01-22T05:18:59.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.549+0000 7f359ea00700 1 -- 172.21.15.49:0/3166643794 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v175) v1 ==== 169+0+0 (secure 0 0 0) 0x7f35a8157610 con 0x7f35a815b2c0 2024-01-22T05:18:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.557+0000 7f35acc00700 1 -- 172.21.15.49:0/3166643794 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f358005a510 msgr2=0x7f358005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.557+0000 7f35acc00700 1 --2- 172.21.15.49:0/3166643794 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f358005a510 0x7f358005c9d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f3598001120 tx=0x7f3598015000).stop 2024-01-22T05:18:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.557+0000 7f35acc00700 1 -- 172.21.15.49:0/3166643794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a815b2c0 msgr2=0x7f35a8141db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.557+0000 7f35acc00700 1 --2- 172.21.15.49:0/3166643794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a815b2c0 0x7f35a8141db0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7f359000e810 tx=0x7f3590009040).stop 2024-01-22T05:18:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.557+0000 7f35acc00700 1 -- 172.21.15.49:0/3166643794 shutdown_connections 2024-01-22T05:18:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.557+0000 7f35acc00700 1 --2- 172.21.15.49:0/3166643794 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f358005a510 0x7f358005c9d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:59.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.557+0000 7f35acc00700 1 --2- 172.21.15.49:0/3166643794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35a81422a0 0x7f35a8158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:59.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.557+0000 7f35acc00700 1 --2- 172.21.15.49:0/3166643794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a815b2c0 0x7f35a8141db0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:59.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.557+0000 7f35acc00700 1 --2- 172.21.15.49:0/3166643794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3588003aa0 0x7f35a8155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:59.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.557+0000 7f35acc00700 1 -- 172.21.15.49:0/3166643794 >> 172.21.15.49:0/3166643794 conn(0x7f35a80c6f70 msgr2=0x7f35a80c23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:59.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.557+0000 7f35acc00700 1 -- 172.21.15.49:0/3166643794 shutdown_connections 2024-01-22T05:18:59.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.557+0000 7f35acc00700 1 -- 172.21.15.49:0/3166643794 wait complete. 2024-01-22T05:18:59.560 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-01-22T05:18:59.580 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-22T05:18:59.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.769+0000 7f4f65e00700 1 Processor -- start 2024-01-22T05:18:59.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.769+0000 7f4f65e00700 1 -- start start 2024-01-22T05:18:59.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.773+0000 7f4f65e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4f60153cc0 0x7f4f600c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:59.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.773+0000 7f4f65e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f600681a0 0x7f4f6015d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:59.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.773+0000 7f4f65e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f600c6620 con 0x7f4f600c6050 2024-01-22T05:18:59.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.773+0000 7f4f65e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f601540a0 con 0x7f4f600681a0 2024-01-22T05:18:59.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.773+0000 7f4f65e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f600c6900 con 0x7f4f60153cc0 2024-01-22T05:18:59.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.773+0000 7f4f5fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f600681a0 0x7f4f6015d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:59.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.773+0000 7f4f5fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f600681a0 0x7f4f6015d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50130/0 (socket says 172.21.15.49:50130) 2024-01-22T05:18:59.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.773+0000 7f4f5fe00700 1 -- 172.21.15.49:0/330925375 learned_addr learned my addr 172.21.15.49:0/330925375 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:59.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.773+0000 7f4f5ea00700 1 --2- 172.21.15.49:0/330925375 >> v2:172.21.15.110:3300/0 conn(0x7f4f60153cc0 0x7f4f600c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:59.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.773+0000 7f4f5fe00700 1 -- 172.21.15.49:0/330925375 >> v2:172.21.15.110:3300/0 conn(0x7f4f60153cc0 msgr2=0x7f4f600c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:18:59.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.773+0000 7f4f5fe00700 1 --2- 172.21.15.49:0/330925375 >> v2:172.21.15.110:3300/0 conn(0x7f4f60153cc0 0x7f4f600c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:59.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.773+0000 7f4f5fe00700 1 -- 172.21.15.49:0/330925375 >> v1:172.21.15.110:6789/0 conn(0x7f4f600c6050 legacy=0x7f4f60067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:59.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.773+0000 7f4f5fe00700 1 -- 172.21.15.49:0/330925375 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f600c6be0 con 0x7f4f600681a0 2024-01-22T05:18:59.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.773+0000 7f4f5d600700 1 -- 172.21.15.49:0/330925375 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865476703 0 0) 0x7f4f600c6620 con 0x7f4f600c6050 2024-01-22T05:18:59.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.777+0000 7f4f5fe00700 1 --2- 172.21.15.49:0/330925375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f600681a0 0x7f4f6015d730 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7f4f600664e0 tx=0x7f4f58009840).ready entity=mon.0 client_cookie=46c5a4cc18775629 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:59.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.777+0000 7f4f5d600700 1 -- 172.21.15.49:0/330925375 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5800e070 con 0x7f4f600681a0 2024-01-22T05:18:59.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.777+0000 7f4f5d600700 1 -- 172.21.15.49:0/330925375 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5800ba20 con 0x7f4f600681a0 2024-01-22T05:18:59.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.777+0000 7f4f5d600700 1 -- 172.21.15.49:0/330925375 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5800bda0 con 0x7f4f600681a0 2024-01-22T05:18:59.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.777+0000 7f4f65e00700 1 -- 172.21.15.49:0/330925375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f600681a0 msgr2=0x7f4f6015d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:59.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.777+0000 7f4f65e00700 1 --2- 172.21.15.49:0/330925375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f600681a0 0x7f4f6015d730 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7f4f600664e0 tx=0x7f4f58009840).stop 2024-01-22T05:18:59.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.777+0000 7f4f65e00700 1 -- 172.21.15.49:0/330925375 shutdown_connections 2024-01-22T05:18:59.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.777+0000 7f4f65e00700 1 --2- 172.21.15.49:0/330925375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f600681a0 0x7f4f6015d730 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:59.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.777+0000 7f4f65e00700 1 --2- 172.21.15.49:0/330925375 >> v2:172.21.15.110:3300/0 conn(0x7f4f60153cc0 0x7f4f600c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:59.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.777+0000 7f4f65e00700 1 -- 172.21.15.49:0/330925375 >> 172.21.15.49:0/330925375 conn(0x7f4f600c8720 msgr2=0x7f4f600c4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:59.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.777+0000 7f4f65e00700 1 -- 172.21.15.49:0/330925375 shutdown_connections 2024-01-22T05:18:59.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.777+0000 7f4f65e00700 1 -- 172.21.15.49:0/330925375 wait complete. 2024-01-22T05:18:59.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.781+0000 7f4f65e00700 1 Processor -- start 2024-01-22T05:18:59.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f65e00700 1 -- start start 2024-01-22T05:18:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f65e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f600681a0 0x7f4f6014f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f65e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f600c6050 0x7f4f601513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f65e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f60153cc0 0x7f4f60151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f65e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60151d80 con 0x7f4f60153cc0 2024-01-22T05:18:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f65e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60157ca0 con 0x7f4f600681a0 2024-01-22T05:18:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f65e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6014fdc0 con 0x7f4f600c6050 2024-01-22T05:18:59.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f5fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f60153cc0 0x7f4f60151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:59.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f5fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f60153cc0 0x7f4f60151890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50134/0 (socket says 172.21.15.49:50134) 2024-01-22T05:18:59.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f5fe00700 1 -- 172.21.15.49:0/2336841356 learned_addr learned my addr 172.21.15.49:0/2336841356 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:18:59.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f5ea00700 1 --2- 172.21.15.49:0/2336841356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f600681a0 0x7f4f6014f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:59.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f5e000700 1 --2- 172.21.15.49:0/2336841356 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f600c6050 0x7f4f601513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:59.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f5fe00700 1 -- 172.21.15.49:0/2336841356 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f600c6050 msgr2=0x7f4f601513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:59.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f5fe00700 1 --2- 172.21.15.49:0/2336841356 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f600c6050 0x7f4f601513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:59.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f5fe00700 1 -- 172.21.15.49:0/2336841356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f600681a0 msgr2=0x7f4f6014f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:59.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f5fe00700 1 --2- 172.21.15.49:0/2336841356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f600681a0 0x7f4f6014f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:59.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f5fe00700 1 -- 172.21.15.49:0/2336841356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f58009ae0 con 0x7f4f60153cc0 2024-01-22T05:18:59.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.785+0000 7f4f5fe00700 1 --2- 172.21.15.49:0/2336841356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f60153cc0 0x7f4f60151890 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f4f5800b6c0 tx=0x7f4f58009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:59.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.789+0000 7f4f56000700 1 -- 172.21.15.49:0/2336841356 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f58013e60 con 0x7f4f60153cc0 2024-01-22T05:18:59.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.789+0000 7f4f56000700 1 -- 172.21.15.49:0/2336841356 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f580092e0 con 0x7f4f60153cc0 2024-01-22T05:18:59.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.789+0000 7f4f65e00700 1 -- 172.21.15.49:0/2336841356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f600c0bc0 con 0x7f4f60153cc0 2024-01-22T05:18:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.789+0000 7f4f56000700 1 -- 172.21.15.49:0/2336841356 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5801e6c0 con 0x7f4f60153cc0 2024-01-22T05:18:59.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.789+0000 7f4f65e00700 1 -- 172.21.15.49:0/2336841356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f60157930 con 0x7f4f60153cc0 2024-01-22T05:18:59.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.789+0000 7f4f65e00700 1 -- 172.21.15.49:0/2336841356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f60157e10 con 0x7f4f60153cc0 2024-01-22T05:18:59.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.789+0000 7f4f56000700 1 -- 172.21.15.49:0/2336841356 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4f58003040 con 0x7f4f60153cc0 2024-01-22T05:18:59.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.793+0000 7f4f56000700 1 --2- 172.21.15.49:0/2336841356 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f3805a510 0x7f4f3805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:18:59.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.793+0000 7f4f56000700 1 -- 172.21.15.49:0/2336841356 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f4f58075c60 con 0x7f4f60153cc0 2024-01-22T05:18:59.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.793+0000 7f4f5ea00700 1 --2- 172.21.15.49:0/2336841356 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f3805a510 0x7f4f3805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:18:59.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.793+0000 7f4f5ea00700 1 --2- 172.21.15.49:0/2336841356 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f3805a510 0x7f4f3805c9d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f4f50009b90 tx=0x7f4f50009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:18:59.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.801+0000 7f4f56000700 1 -- 172.21.15.49:0/2336841356 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4f58049520 con 0x7f4f60153cc0 2024-01-22T05:18:59.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.965+0000 7f4f65e00700 1 -- 172.21.15.49:0/2336841356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4f60047060 con 0x7f4f60153cc0 2024-01-22T05:18:59.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.977+0000 7f4f56000700 1 -- 172.21.15.49:0/2336841356 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4f58023020 con 0x7f4f60153cc0 2024-01-22T05:18:59.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.981+0000 7f4f65e00700 1 -- 172.21.15.49:0/2336841356 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f3805a510 msgr2=0x7f4f3805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:59.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.981+0000 7f4f65e00700 1 --2- 172.21.15.49:0/2336841356 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f3805a510 0x7f4f3805c9d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f4f50009b90 tx=0x7f4f50009060).stop 2024-01-22T05:18:59.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.981+0000 7f4f65e00700 1 -- 172.21.15.49:0/2336841356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f60153cc0 msgr2=0x7f4f60151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:18:59.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.981+0000 7f4f65e00700 1 --2- 172.21.15.49:0/2336841356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f60153cc0 0x7f4f60151890 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f4f5800b6c0 tx=0x7f4f58009840).stop 2024-01-22T05:18:59.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.981+0000 7f4f65e00700 1 -- 172.21.15.49:0/2336841356 shutdown_connections 2024-01-22T05:18:59.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.981+0000 7f4f65e00700 1 --2- 172.21.15.49:0/2336841356 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f3805a510 0x7f4f3805c9d0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:59.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.981+0000 7f4f65e00700 1 --2- 172.21.15.49:0/2336841356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f60153cc0 0x7f4f60151890 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:59.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.981+0000 7f4f65e00700 1 --2- 172.21.15.49:0/2336841356 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f600c6050 0x7f4f601513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:59.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.981+0000 7f4f65e00700 1 --2- 172.21.15.49:0/2336841356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f600681a0 0x7f4f6014f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:18:59.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.981+0000 7f4f65e00700 1 -- 172.21.15.49:0/2336841356 >> 172.21.15.49:0/2336841356 conn(0x7f4f600c8720 msgr2=0x7f4f601529a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:18:59.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.981+0000 7f4f65e00700 1 -- 172.21.15.49:0/2336841356 shutdown_connections 2024-01-22T05:18:59.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:18:59.981+0000 7f4f65e00700 1 -- 172.21.15.49:0/2336841356 wait complete. 2024-01-22T05:19:00.002 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-01-22T05:19:00.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.165+0000 7fc10b200700 1 Processor -- start 2024-01-22T05:19:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.165+0000 7fc10b200700 1 -- start start 2024-01-22T05:19:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc10b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1040691b0 0x7fc104151a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc10b200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc104151f30 con 0x7fc104154a70 2024-01-22T05:19:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc10b200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1040c2b90 con 0x7fc104067060 2024-01-22T05:19:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc10b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc104154e50 con 0x7fc1040691b0 2024-01-22T05:19:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc103e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc104154a70 0x7fc104066950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50970/0 (socket says 172.21.15.49:50970) 2024-01-22T05:19:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc103e00700 1 -- 172.21.15.49:0/2393039176 learned_addr learned my addr 172.21.15.49:0/2393039176 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:00.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc109200700 1 --2- 172.21.15.49:0/2393039176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1040691b0 0x7fc104151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:00.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153187426 0 0) 0x7fc104151f30 con 0x7fc104154a70 2024-01-22T05:19:00.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0e40033f0 con 0x7fc104154a70 2024-01-22T05:19:00.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130813325 0 0) 0x7fc1040c2b90 con 0x7fc104067060 2024-01-22T05:19:00.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc104151f30 con 0x7fc104067060 2024-01-22T05:19:00.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1771570225 0 0) 0x7fc0e40033f0 con 0x7fc104154a70 2024-01-22T05:19:00.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1040691b0 msgr2=0x7fc104151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:00.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 --2- 172.21.15.49:0/2393039176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1040691b0 0x7fc104151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:00.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 >> v1:172.21.15.110:6789/0 conn(0x7fc104067060 legacy=0x7fc104068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:00.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1040c2e70 con 0x7fc104154a70 2024-01-22T05:19:00.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fc0f4001470 con 0x7fc104154a70 2024-01-22T05:19:00.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 >> v1:172.21.15.49:6789/0 conn(0x7fc104154a70 legacy=0x7fc104066950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:00.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 --2- 172.21.15.49:0/2393039176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0e4003aa0 0x7fc0e4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:00.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 --2- 172.21.15.49:0/2393039176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0e4004690 0x7fc0e4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:00.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 --2- 172.21.15.49:0/2393039176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1040691b0 0x7fc0e4005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:00.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e400b990 con 0x7fc0e4003aa0 2024-01-22T05:19:00.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e400bad0 con 0x7fc0e4004690 2024-01-22T05:19:00.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e400bc60 con 0x7fc1040691b0 2024-01-22T05:19:00.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc103e00700 1 --2- 172.21.15.49:0/2393039176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0e4003aa0 0x7fc0e4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:00.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc109200700 1 --2- 172.21.15.49:0/2393039176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1040691b0 0x7fc0e4005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:00.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.169+0000 7fc103400700 1 --2- 172.21.15.49:0/2393039176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0e4004690 0x7fc0e4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:00.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc103e00700 1 -- 172.21.15.49:0/2393039176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1040691b0 msgr2=0x7fc0e4005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:00.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc103e00700 1 --2- 172.21.15.49:0/2393039176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1040691b0 0x7fc0e4005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:00.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc103e00700 1 -- 172.21.15.49:0/2393039176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0e4004690 msgr2=0x7fc0e4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:00.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc103e00700 1 --2- 172.21.15.49:0/2393039176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0e4004690 0x7fc0e4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:00.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc103e00700 1 -- 172.21.15.49:0/2393039176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e40033f0 con 0x7fc0e4003aa0 2024-01-22T05:19:00.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc103e00700 1 --2- 172.21.15.49:0/2393039176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0e4003aa0 0x7fc0e4003ea0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7fc0f4007fb0 tx=0x7fc0f4001d40).ready entity=mon.0 client_cookie=e3cd1426ca9b426e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:00.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f400c9a0 con 0x7fc0e4003aa0 2024-01-22T05:19:00.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f400cb00 con 0x7fc0e4003aa0 2024-01-22T05:19:00.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc102a00700 1 -- 172.21.15.49:0/2393039176 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40070d0 con 0x7fc0e4003aa0 2024-01-22T05:19:00.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc10b200700 1 -- 172.21.15.49:0/2393039176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0e4003aa0 msgr2=0x7fc0e4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:00.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc10b200700 1 --2- 172.21.15.49:0/2393039176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0e4003aa0 0x7fc0e4003ea0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7fc0f4007fb0 tx=0x7fc0f4001d40).stop 2024-01-22T05:19:00.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc109200700 1 -- 172.21.15.49:0/2393039176 reap_dead start 2024-01-22T05:19:00.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc10b200700 1 -- 172.21.15.49:0/2393039176 shutdown_connections 2024-01-22T05:19:00.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc10b200700 1 -- 172.21.15.49:0/2393039176 >> 172.21.15.49:0/2393039176 conn(0x7fc1040c4300 msgr2=0x7fc104065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:00.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc10b200700 1 -- 172.21.15.49:0/2393039176 shutdown_connections 2024-01-22T05:19:00.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.173+0000 7fc10b200700 1 -- 172.21.15.49:0/2393039176 wait complete. 2024-01-22T05:19:00.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.177+0000 7fc10b200700 1 Processor -- start 2024-01-22T05:19:00.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.177+0000 7fc10b200700 1 -- start start 2024-01-22T05:19:00.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc10b200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0e4003aa0 0x7fc104168900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:00.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc10b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc10414d9f0 0x7fc1040a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:00.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc10b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1041529d0 0x7fc104152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:00.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc10b200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040a8230 con 0x7fc0e4003aa0 2024-01-22T05:19:00.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc10b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc104153340 con 0x7fc1041529d0 2024-01-22T05:19:00.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc10b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040a7190 con 0x7fc10414d9f0 2024-01-22T05:19:00.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc103e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0e4003aa0 0x7fc104168900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:00.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc103e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0e4003aa0 0x7fc104168900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50146/0 (socket says 172.21.15.49:50146) 2024-01-22T05:19:00.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc103e00700 1 -- 172.21.15.49:0/205312720 learned_addr learned my addr 172.21.15.49:0/205312720 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:00.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc103400700 1 --2- 172.21.15.49:0/205312720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc10414d9f0 0x7fc1040a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:00.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc109200700 1 --2- 172.21.15.49:0/205312720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1041529d0 0x7fc104152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:00.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc103e00700 1 -- 172.21.15.49:0/205312720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc10414d9f0 msgr2=0x7fc1040a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:00.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc103e00700 1 --2- 172.21.15.49:0/205312720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc10414d9f0 0x7fc1040a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:00.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc103e00700 1 -- 172.21.15.49:0/205312720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1041529d0 msgr2=0x7fc104152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:00.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc103e00700 1 --2- 172.21.15.49:0/205312720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1041529d0 0x7fc104152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:00.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc103e00700 1 -- 172.21.15.49:0/205312720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1040a7470 con 0x7fc0e4003aa0 2024-01-22T05:19:00.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc103e00700 1 --2- 172.21.15.49:0/205312720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0e4003aa0 0x7fc104168900 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7fc0f400c6a0 tx=0x7fc0f4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:00.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc0fb400700 1 -- 172.21.15.49:0/205312720 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4001b00 con 0x7fc0e4003aa0 2024-01-22T05:19:00.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc0fb400700 1 -- 172.21.15.49:0/205312720 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f400ce80 con 0x7fc0e4003aa0 2024-01-22T05:19:00.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc10b200700 1 -- 172.21.15.49:0/205312720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1040a7750 con 0x7fc0e4003aa0 2024-01-22T05:19:00.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc0fb400700 1 -- 172.21.15.49:0/205312720 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4001650 con 0x7fc0e4003aa0 2024-01-22T05:19:00.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.181+0000 7fc10b200700 1 -- 172.21.15.49:0/205312720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1040a7d10 con 0x7fc0e4003aa0 2024-01-22T05:19:00.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.185+0000 7fc10b200700 1 -- 172.21.15.49:0/205312720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1040bef60 con 0x7fc0e4003aa0 2024-01-22T05:19:00.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.185+0000 7fc0fb400700 1 -- 172.21.15.49:0/205312720 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc0f4007440 con 0x7fc0e4003aa0 2024-01-22T05:19:00.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.185+0000 7fc0fb400700 1 --2- 172.21.15.49:0/205312720 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc0dc05a510 0x7fc0dc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:00.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.185+0000 7fc0fb400700 1 -- 172.21.15.49:0/205312720 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fc0f40753a0 con 0x7fc0e4003aa0 2024-01-22T05:19:00.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.185+0000 7fc103400700 1 --2- 172.21.15.49:0/205312720 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc0dc05a510 0x7fc0dc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:00.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.189+0000 7fc103400700 1 --2- 172.21.15.49:0/205312720 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc0dc05a510 0x7fc0dc05c9d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fc0ec007fd0 tx=0x7fc0ec007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:00.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.193+0000 7fc0fb400700 1 -- 172.21.15.49:0/205312720 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc0f4048c60 con 0x7fc0e4003aa0 2024-01-22T05:19:00.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.413+0000 7fc10b200700 1 -- 172.21.15.49:0/205312720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) v1 -- 0x7fc104046800 con 0x7fc0e4003aa0 2024-01-22T05:19:00.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.561+0000 7fc0fb400700 1 -- 172.21.15.49:0/205312720 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v669) v1 ==== 133+0+0 (secure 0 0 0) 0x7fc0f404c280 con 0x7fc0e4003aa0 2024-01-22T05:19:00.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.565+0000 7fc10b200700 1 -- 172.21.15.49:0/205312720 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc0dc05a510 msgr2=0x7fc0dc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:00.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.565+0000 7fc10b200700 1 --2- 172.21.15.49:0/205312720 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc0dc05a510 0x7fc0dc05c9d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fc0ec007fd0 tx=0x7fc0ec007bb0).stop 2024-01-22T05:19:00.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.565+0000 7fc10b200700 1 -- 172.21.15.49:0/205312720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0e4003aa0 msgr2=0x7fc104168900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:00.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.565+0000 7fc10b200700 1 --2- 172.21.15.49:0/205312720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0e4003aa0 0x7fc104168900 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7fc0f400c6a0 tx=0x7fc0f4015000).stop 2024-01-22T05:19:00.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.569+0000 7fc10b200700 1 -- 172.21.15.49:0/205312720 shutdown_connections 2024-01-22T05:19:00.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.569+0000 7fc10b200700 1 --2- 172.21.15.49:0/205312720 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc0dc05a510 0x7fc0dc05c9d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:00.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.569+0000 7fc10b200700 1 --2- 172.21.15.49:0/205312720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1041529d0 0x7fc104152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:00.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.569+0000 7fc10b200700 1 --2- 172.21.15.49:0/205312720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc10414d9f0 0x7fc1040a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:00.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.569+0000 7fc10b200700 1 --2- 172.21.15.49:0/205312720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0e4003aa0 0x7fc104168900 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:00.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.569+0000 7fc10b200700 1 -- 172.21.15.49:0/205312720 >> 172.21.15.49:0/205312720 conn(0x7fc1040c4300 msgr2=0x7fc1040bbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:00.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.569+0000 7fc10b200700 1 -- 172.21.15.49:0/205312720 shutdown_connections 2024-01-22T05:19:00.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.569+0000 7fc10b200700 1 -- 172.21.15.49:0/205312720 wait complete. 2024-01-22T05:19:00.589 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-01-22T05:19:00.590 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace_for_new_files (tasks.cephfs.test_scrub.TestScrub) 2024-01-22T05:19:00.590 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files' 2024-01-22T05:19:00.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.757+0000 7fd2cec00700 1 Processor -- start 2024-01-22T05:19:00.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.757+0000 7fd2cec00700 1 -- start start 2024-01-22T05:19:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.757+0000 7fd2cec00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd2c8155d20 0x7fd2c8065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.757+0000 7fd2cec00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2c80a8e50 0x7fd2c80c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.757+0000 7fd2cec00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c80c1a40 con 0x7fd2c8066070 2024-01-22T05:19:00.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.757+0000 7fd2cec00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c8159310 con 0x7fd2c80a8e50 2024-01-22T05:19:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.757+0000 7fd2cec00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c80c13f0 con 0x7fd2c8155d20 2024-01-22T05:19:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.757+0000 7fd2ccc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2c80a8e50 0x7fd2c80c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.761+0000 7fd2ccc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd2c80a8e50 0x7fd2c80c1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50154/0 (socket says 172.21.15.49:50154) 2024-01-22T05:19:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.761+0000 7fd2ccc00700 1 -- 172.21.15.49:0/2750909141 learned_addr learned my addr 172.21.15.49:0/2750909141 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:00.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.761+0000 7fd2c7e00700 1 --2- 172.21.15.49:0/2750909141 >> v2:172.21.15.110:3300/0 conn(0x7fd2c8155d20 0x7fd2c8065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:00.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.761+0000 7fd2c6a00700 1 -- 172.21.15.49:0/2750909141 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478643936 0 0) 0x7fd2c80c1a40 con 0x7fd2c8066070 2024-01-22T05:19:00.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.761+0000 7fd2c6a00700 1 -- 172.21.15.49:0/2750909141 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2a80033f0 con 0x7fd2c8066070 2024-01-22T05:19:00.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.761+0000 7fd2ccc00700 1 -- 172.21.15.49:0/2750909141 >> v2:172.21.15.110:3300/0 conn(0x7fd2c8155d20 msgr2=0x7fd2c8065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:00.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.761+0000 7fd2ccc00700 1 --2- 172.21.15.49:0/2750909141 >> v2:172.21.15.110:3300/0 conn(0x7fd2c8155d20 0x7fd2c8065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:00.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.761+0000 7fd2ccc00700 1 -- 172.21.15.49:0/2750909141 >> v1:172.21.15.110:6789/0 conn(0x7fd2c8066070 legacy=0x7fd2c80a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:00.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.761+0000 7fd2ccc00700 1 -- 172.21.15.49:0/2750909141 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c80c16d0 con 0x7fd2c80a8e50 2024-01-22T05:19:00.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.761+0000 7fd2ccc00700 1 --2- 172.21.15.49:0/2750909141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c80a8e50 0x7fd2c80c1ed0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7fd2c805ff40 tx=0x7fd2c0009840).ready entity=mon.0 client_cookie=47161d74dd7d51 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:00.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.761+0000 7fd2c6a00700 1 -- 172.21.15.49:0/2750909141 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c000e070 con 0x7fd2c80a8e50 2024-01-22T05:19:00.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.761+0000 7fd2c6a00700 1 -- 172.21.15.49:0/2750909141 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c000b970 con 0x7fd2c80a8e50 2024-01-22T05:19:00.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.761+0000 7fd2c6a00700 1 -- 172.21.15.49:0/2750909141 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c000bcf0 con 0x7fd2c80a8e50 2024-01-22T05:19:00.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.761+0000 7fd2cec00700 1 -- 172.21.15.49:0/2750909141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c80a8e50 msgr2=0x7fd2c80c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:00.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.761+0000 7fd2cec00700 1 --2- 172.21.15.49:0/2750909141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c80a8e50 0x7fd2c80c1ed0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7fd2c805ff40 tx=0x7fd2c0009840).stop 2024-01-22T05:19:00.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.765+0000 7fd2cec00700 1 -- 172.21.15.49:0/2750909141 shutdown_connections 2024-01-22T05:19:00.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.765+0000 7fd2cec00700 1 --2- 172.21.15.49:0/2750909141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c80a8e50 0x7fd2c80c1ed0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:00.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.765+0000 7fd2cec00700 1 --2- 172.21.15.49:0/2750909141 >> v2:172.21.15.110:3300/0 conn(0x7fd2c8155d20 0x7fd2c8065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:00.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.765+0000 7fd2cec00700 1 -- 172.21.15.49:0/2750909141 >> 172.21.15.49:0/2750909141 conn(0x7fd2c80c6540 msgr2=0x7fd2c80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:00.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.765+0000 7fd2cec00700 1 -- 172.21.15.49:0/2750909141 shutdown_connections 2024-01-22T05:19:00.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.765+0000 7fd2cec00700 1 -- 172.21.15.49:0/2750909141 wait complete. 2024-01-22T05:19:00.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.765+0000 7fd2cec00700 1 Processor -- start 2024-01-22T05:19:00.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2cec00700 1 -- start start 2024-01-22T05:19:00.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2cec00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2c8066070 0x7fd2c8153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:00.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2cec00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c80a8e50 0x7fd2c8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:00.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2cec00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2c8155d20 0x7fd2c80684d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:00.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2cec00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c8153850 con 0x7fd2c80a8e50 2024-01-22T05:19:00.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2cec00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c80689c0 con 0x7fd2c8155d20 2024-01-22T05:19:00.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2cec00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c81694f0 con 0x7fd2c8066070 2024-01-22T05:19:00.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2c7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c80a8e50 0x7fd2c8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:00.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2c7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c80a8e50 0x7fd2c8067fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50160/0 (socket says 172.21.15.49:50160) 2024-01-22T05:19:00.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2c7400700 1 -- 172.21.15.49:0/160924045 learned_addr learned my addr 172.21.15.49:0/160924045 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:00.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2ccc00700 1 --2- 172.21.15.49:0/160924045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2c8155d20 0x7fd2c80684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:00.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2c7e00700 1 --2- 172.21.15.49:0/160924045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2c8066070 0x7fd2c8153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:00.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2c7400700 1 -- 172.21.15.49:0/160924045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2c8066070 msgr2=0x7fd2c8153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:00.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2c7400700 1 --2- 172.21.15.49:0/160924045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2c8066070 0x7fd2c8153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:00.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2c7400700 1 -- 172.21.15.49:0/160924045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2c8155d20 msgr2=0x7fd2c80684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:00.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2c7400700 1 --2- 172.21.15.49:0/160924045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2c8155d20 0x7fd2c80684d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:00.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2c7400700 1 -- 172.21.15.49:0/160924045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c0009ae0 con 0x7fd2c80a8e50 2024-01-22T05:19:00.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.769+0000 7fd2c7400700 1 --2- 172.21.15.49:0/160924045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c80a8e50 0x7fd2c8067fe0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7fd2b000c490 tx=0x7fd2b0007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:00.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.773+0000 7fd2bf400700 1 -- 172.21.15.49:0/160924045 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b000f470 con 0x7fd2c80a8e50 2024-01-22T05:19:00.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.773+0000 7fd2bf400700 1 -- 172.21.15.49:0/160924045 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b000f5d0 con 0x7fd2c80a8e50 2024-01-22T05:19:00.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.773+0000 7fd2cec00700 1 -- 172.21.15.49:0/160924045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c816a150 con 0x7fd2c80a8e50 2024-01-22T05:19:00.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.773+0000 7fd2bf400700 1 -- 172.21.15.49:0/160924045 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b000f970 con 0x7fd2c80a8e50 2024-01-22T05:19:00.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.773+0000 7fd2cec00700 1 -- 172.21.15.49:0/160924045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c8169b00 con 0x7fd2c80a8e50 2024-01-22T05:19:00.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.773+0000 7fd2cec00700 1 -- 172.21.15.49:0/160924045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c8047060 con 0x7fd2c80a8e50 2024-01-22T05:19:00.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.773+0000 7fd2bf400700 1 -- 172.21.15.49:0/160924045 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd2b000fd20 con 0x7fd2c80a8e50 2024-01-22T05:19:00.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.777+0000 7fd2bf400700 1 --2- 172.21.15.49:0/160924045 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd2a005a4e0 0x7fd2a005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:00.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.777+0000 7fd2bf400700 1 -- 172.21.15.49:0/160924045 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fd2b0073cc0 con 0x7fd2c80a8e50 2024-01-22T05:19:00.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.777+0000 7fd2c7e00700 1 --2- 172.21.15.49:0/160924045 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd2a005a4e0 0x7fd2a005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:00.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.777+0000 7fd2c7e00700 1 --2- 172.21.15.49:0/160924045 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd2a005a4e0 0x7fd2a005c9a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7fd2b8009b20 tx=0x7fd2b8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:00.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:00.781+0000 7fd2bf400700 1 -- 172.21.15.49:0/160924045 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd2b0047600 con 0x7fd2c80a8e50 2024-01-22T05:19:01.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.001+0000 7fd2cec00700 1 -- 172.21.15.49:0/160924045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]} v 0) v1 -- 0x7fd2c8046800 con 0x7fd2c80a8e50 2024-01-22T05:19:01.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.569+0000 7fd2bf400700 1 -- 172.21.15.49:0/160924045 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]}]=0 v670) v1 ==== 150+0+0 (secure 0 0 0) 0x7fd2b004ac20 con 0x7fd2c80a8e50 2024-01-22T05:19:01.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.573+0000 7fd2cec00700 1 -- 172.21.15.49:0/160924045 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd2a005a4e0 msgr2=0x7fd2a005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:01.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.573+0000 7fd2cec00700 1 --2- 172.21.15.49:0/160924045 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd2a005a4e0 0x7fd2a005c9a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7fd2b8009b20 tx=0x7fd2b8008040).stop 2024-01-22T05:19:01.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.573+0000 7fd2cec00700 1 -- 172.21.15.49:0/160924045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c80a8e50 msgr2=0x7fd2c8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:01.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.573+0000 7fd2cec00700 1 --2- 172.21.15.49:0/160924045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c80a8e50 0x7fd2c8067fe0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7fd2b000c490 tx=0x7fd2b0007c90).stop 2024-01-22T05:19:01.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.573+0000 7fd2cec00700 1 -- 172.21.15.49:0/160924045 shutdown_connections 2024-01-22T05:19:01.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.573+0000 7fd2cec00700 1 --2- 172.21.15.49:0/160924045 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd2a005a4e0 0x7fd2a005c9a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:01.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.573+0000 7fd2cec00700 1 --2- 172.21.15.49:0/160924045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2c8155d20 0x7fd2c80684d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:01.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.573+0000 7fd2cec00700 1 --2- 172.21.15.49:0/160924045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c80a8e50 0x7fd2c8067fe0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:01.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.573+0000 7fd2cec00700 1 --2- 172.21.15.49:0/160924045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2c8066070 0x7fd2c8153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:01.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.573+0000 7fd2cec00700 1 -- 172.21.15.49:0/160924045 >> 172.21.15.49:0/160924045 conn(0x7fd2c80c6540 msgr2=0x7fd2c8068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:01.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.573+0000 7fd2cec00700 1 -- 172.21.15.49:0/160924045 shutdown_connections 2024-01-22T05:19:01.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.573+0000 7fd2cec00700 1 -- 172.21.15.49:0/160924045 wait complete. 2024-01-22T05:19:01.598 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-22T05:19:01.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.777+0000 7f8873200700 1 Processor -- start 2024-01-22T05:19:01.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.777+0000 7f8873200700 1 -- start start 2024-01-22T05:19:01.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.781+0000 7f8873200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874157ee0 0x7f8874065590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:01.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.781+0000 7f8873200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8874068af0 0x7f8874065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:01.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.781+0000 7f8873200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8874068280 con 0x7f8874068710 2024-01-22T05:19:01.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.781+0000 7f8873200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8874069600 con 0x7f8874068af0 2024-01-22T05:19:01.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.781+0000 7f8873200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88740c1cc0 con 0x7f8874157ee0 2024-01-22T05:19:01.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8872800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8874068af0 0x7f8874065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:01.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8871400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874157ee0 0x7f8874065590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:01.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8871400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874157ee0 0x7f8874065590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:54314/0 (socket says 172.21.15.49:54314) 2024-01-22T05:19:01.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8872800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8874068af0 0x7f8874065a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:52570/0 (socket says 172.21.15.49:52570) 2024-01-22T05:19:01.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8871400700 1 -- 172.21.15.49:0/3002809976 learned_addr learned my addr 172.21.15.49:0/3002809976 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:01.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8871e00700 1 --1- 172.21.15.49:0/3002809976 >> v1:172.21.15.110:6789/0 conn(0x7f8874068710 0x7f88741577d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:46128/0 (socket says 172.21.15.49:46128) 2024-01-22T05:19:01.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8871400700 1 -- 172.21.15.49:0/3002809976 >> v2:172.21.15.110:3300/0 conn(0x7f8874068af0 msgr2=0x7f8874065a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:01.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8871400700 1 --2- 172.21.15.49:0/3002809976 >> v2:172.21.15.110:3300/0 conn(0x7f8874068af0 0x7f8874065a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:01.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8871400700 1 -- 172.21.15.49:0/3002809976 >> v1:172.21.15.110:6789/0 conn(0x7f8874068710 legacy=0x7f88741577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:01.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8871400700 1 -- 172.21.15.49:0/3002809976 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8874067c30 con 0x7f8874157ee0 2024-01-22T05:19:01.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8872800700 1 --2- 172.21.15.49:0/3002809976 >> v2:172.21.15.110:3300/0 conn(0x7f8874068af0 0x7f8874065a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:01.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8871400700 1 --2- 172.21.15.49:0/3002809976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874157ee0 0x7f8874065590 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f885c006fd0 tx=0x7f885c0090f0).ready entity=mon.2 client_cookie=47eb920e55d6b26a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:01.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8870a00700 1 -- 172.21.15.49:0/3002809976 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00b580 con 0x7f8874157ee0 2024-01-22T05:19:01.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8870a00700 1 -- 172.21.15.49:0/3002809976 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c00b6e0 con 0x7f8874157ee0 2024-01-22T05:19:01.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8870a00700 1 -- 172.21.15.49:0/3002809976 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00ba60 con 0x7f8874157ee0 2024-01-22T05:19:01.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8873200700 1 -- 172.21.15.49:0/3002809976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874157ee0 msgr2=0x7f8874065590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:01.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.785+0000 7f8873200700 1 --2- 172.21.15.49:0/3002809976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874157ee0 0x7f8874065590 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f885c006fd0 tx=0x7f885c0090f0).stop 2024-01-22T05:19:01.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.789+0000 7f8873200700 1 -- 172.21.15.49:0/3002809976 shutdown_connections 2024-01-22T05:19:01.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.789+0000 7f8873200700 1 --2- 172.21.15.49:0/3002809976 >> v2:172.21.15.110:3300/0 conn(0x7f8874068af0 0x7f8874065a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:01.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.789+0000 7f8873200700 1 --2- 172.21.15.49:0/3002809976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874157ee0 0x7f8874065590 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:01.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.789+0000 7f8873200700 1 -- 172.21.15.49:0/3002809976 >> 172.21.15.49:0/3002809976 conn(0x7f88740c6fc0 msgr2=0x7f88740c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:01.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.789+0000 7f8873200700 1 -- 172.21.15.49:0/3002809976 shutdown_connections 2024-01-22T05:19:01.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.789+0000 7f8873200700 1 -- 172.21.15.49:0/3002809976 wait complete. 2024-01-22T05:19:01.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.789+0000 7f8873200700 1 Processor -- start 2024-01-22T05:19:01.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8873200700 1 -- start start 2024-01-22T05:19:01.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8873200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8874068710 0x7f887413edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:01.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8873200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874068af0 0x7f887413f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:01.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8873200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8874157ee0 0x7f887413fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:01.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8873200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88741401c0 con 0x7f8874068710 2024-01-22T05:19:01.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8873200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88740bd920 con 0x7f8874157ee0 2024-01-22T05:19:01.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8873200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8874140fd0 con 0x7f8874068af0 2024-01-22T05:19:01.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8871e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8874068710 0x7f887413edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:01.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8871e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8874068710 0x7f887413edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50170/0 (socket says 172.21.15.49:50170) 2024-01-22T05:19:01.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8871e00700 1 -- 172.21.15.49:0/202467878 learned_addr learned my addr 172.21.15.49:0/202467878 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:01.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8872800700 1 --2- 172.21.15.49:0/202467878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8874157ee0 0x7f887413fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:01.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8871400700 1 --2- 172.21.15.49:0/202467878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874068af0 0x7f887413f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:01.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8871e00700 1 -- 172.21.15.49:0/202467878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874068af0 msgr2=0x7f887413f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:01.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8871e00700 1 --2- 172.21.15.49:0/202467878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874068af0 0x7f887413f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:01.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8871e00700 1 -- 172.21.15.49:0/202467878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8874157ee0 msgr2=0x7f887413fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:01.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8871e00700 1 --2- 172.21.15.49:0/202467878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8874157ee0 0x7f887413fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:01.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.793+0000 7f8871e00700 1 -- 172.21.15.49:0/202467878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c009a20 con 0x7f8874068710 2024-01-22T05:19:01.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.797+0000 7f8871e00700 1 --2- 172.21.15.49:0/202467878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8874068710 0x7f887413edc0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f886400c440 tx=0x7f8864007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:01.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.797+0000 7f8869600700 1 -- 172.21.15.49:0/202467878 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88640072e0 con 0x7f8874068710 2024-01-22T05:19:01.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.797+0000 7f8869600700 1 -- 172.21.15.49:0/202467878 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8864007440 con 0x7f8874068710 2024-01-22T05:19:01.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.797+0000 7f8873200700 1 -- 172.21.15.49:0/202467878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c009370 con 0x7f8874068710 2024-01-22T05:19:01.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.797+0000 7f8869600700 1 -- 172.21.15.49:0/202467878 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8864005940 con 0x7f8874068710 2024-01-22T05:19:01.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.797+0000 7f8873200700 1 -- 172.21.15.49:0/202467878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8874140720 con 0x7f8874068710 2024-01-22T05:19:01.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.797+0000 7f8873200700 1 -- 172.21.15.49:0/202467878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8874047060 con 0x7f8874068710 2024-01-22T05:19:01.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.801+0000 7f8869600700 1 -- 172.21.15.49:0/202467878 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f886401c3f0 con 0x7f8874068710 2024-01-22T05:19:01.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.805+0000 7f8869600700 1 --2- 172.21.15.49:0/202467878 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f884c05a510 0x7f884c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:01.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.805+0000 7f8869600700 1 -- 172.21.15.49:0/202467878 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f8864073cc0 con 0x7f8874068710 2024-01-22T05:19:01.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.805+0000 7f8871400700 1 --2- 172.21.15.49:0/202467878 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f884c05a510 0x7f884c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:01.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.805+0000 7f8871400700 1 --2- 172.21.15.49:0/202467878 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f884c05a510 0x7f884c05c9d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f88741582e0 tx=0x7f885c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:01.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.809+0000 7f8869600700 1 -- 172.21.15.49:0/202467878 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f886407a080 con 0x7f8874068710 2024-01-22T05:19:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.973+0000 7f8873200700 1 -- 172.21.15.49:0/202467878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8874067f10 con 0x7f8874068710 2024-01-22T05:19:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.981+0000 7f8869600700 1 -- 172.21.15.49:0/202467878 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8864047520 con 0x7f8874068710 2024-01-22T05:19:01.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.985+0000 7f8873200700 1 -- 172.21.15.49:0/202467878 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f884c05a510 msgr2=0x7f884c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:01.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.985+0000 7f8873200700 1 --2- 172.21.15.49:0/202467878 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f884c05a510 0x7f884c05c9d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f88741582e0 tx=0x7f885c017000).stop 2024-01-22T05:19:01.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.985+0000 7f8873200700 1 -- 172.21.15.49:0/202467878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8874068710 msgr2=0x7f887413edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:01.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.985+0000 7f8873200700 1 --2- 172.21.15.49:0/202467878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8874068710 0x7f887413edc0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f886400c440 tx=0x7f8864007e40).stop 2024-01-22T05:19:01.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.985+0000 7f8873200700 1 -- 172.21.15.49:0/202467878 shutdown_connections 2024-01-22T05:19:01.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.985+0000 7f8873200700 1 --2- 172.21.15.49:0/202467878 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f884c05a510 0x7f884c05c9d0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:01.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.985+0000 7f8873200700 1 --2- 172.21.15.49:0/202467878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8874157ee0 0x7f887413fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:01.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.985+0000 7f8873200700 1 --2- 172.21.15.49:0/202467878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874068af0 0x7f887413f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:01.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.985+0000 7f8873200700 1 --2- 172.21.15.49:0/202467878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8874068710 0x7f887413edc0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:01.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.985+0000 7f8873200700 1 -- 172.21.15.49:0/202467878 >> 172.21.15.49:0/202467878 conn(0x7f88740c6fc0 msgr2=0x7f88741503d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:01.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.989+0000 7f8873200700 1 -- 172.21.15.49:0/202467878 shutdown_connections 2024-01-22T05:19:01.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:01.989+0000 7f8873200700 1 -- 172.21.15.49:0/202467878 wait complete. 2024-01-22T05:19:02.010 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:19:02.010 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:19:02.052 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:19:02.100 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:19:02.100 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-22T05:19:02.101 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:19:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.265+0000 7f583e400700 1 Processor -- start 2024-01-22T05:19:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.265+0000 7f583e400700 1 -- start start 2024-01-22T05:19:02.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.269+0000 7f583e400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5838062c10 0x7f58380c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:02.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.269+0000 7f583e400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58380691b0 0x7f58380bbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:02.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.269+0000 7f583e400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58380632f0 con 0x7f5838157c00 2024-01-22T05:19:02.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.269+0000 7f583e400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58380635d0 con 0x7f5838062c10 2024-01-22T05:19:02.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.269+0000 7f583e400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58380638b0 con 0x7f58380691b0 2024-01-22T05:19:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.269+0000 7f583d000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5838062c10 0x7f58380c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.273+0000 7f583d000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5838062c10 0x7f58380c2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:52588/0 (socket says 172.21.15.49:52588) 2024-01-22T05:19:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.273+0000 7f583d000700 1 -- 172.21.15.49:0/464721157 learned_addr learned my addr 172.21.15.49:0/464721157 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.273+0000 7f583da00700 1 --2- 172.21.15.49:0/464721157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58380691b0 0x7f58380bbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.273+0000 7f583d000700 1 -- 172.21.15.49:0/464721157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58380691b0 msgr2=0x7f58380bbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.273+0000 7f583d000700 1 --2- 172.21.15.49:0/464721157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58380691b0 0x7f58380bbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.273+0000 7f583d000700 1 -- 172.21.15.49:0/464721157 >> v1:172.21.15.110:6789/0 conn(0x7f5838157c00 legacy=0x7f5838068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.273+0000 7f583d000700 1 -- 172.21.15.49:0/464721157 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5838063b90 con 0x7f5838062c10 2024-01-22T05:19:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.273+0000 7f5837400700 1 -- 172.21.15.49:0/464721157 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976286728 0 0) 0x7f58380632f0 con 0x7f5838157c00 2024-01-22T05:19:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.273+0000 7f583d000700 1 --2- 172.21.15.49:0/464721157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838062c10 0x7f58380c2610 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f5828006fd0 tx=0x7f58280090f0).ready entity=mon.1 client_cookie=b4c8d88308dc657f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.273+0000 7f5837400700 1 -- 172.21.15.49:0/464721157 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582800b580 con 0x7f5838062c10 2024-01-22T05:19:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.273+0000 7f5837400700 1 -- 172.21.15.49:0/464721157 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582800b6e0 con 0x7f5838062c10 2024-01-22T05:19:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.273+0000 7f5837400700 1 -- 172.21.15.49:0/464721157 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582800ba60 con 0x7f5838062c10 2024-01-22T05:19:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.273+0000 7f583e400700 1 -- 172.21.15.49:0/464721157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838062c10 msgr2=0x7f58380c2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.273+0000 7f583e400700 1 --2- 172.21.15.49:0/464721157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838062c10 0x7f58380c2610 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f5828006fd0 tx=0x7f58280090f0).stop 2024-01-22T05:19:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.277+0000 7f583e400700 1 -- 172.21.15.49:0/464721157 shutdown_connections 2024-01-22T05:19:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.277+0000 7f583e400700 1 --2- 172.21.15.49:0/464721157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58380691b0 0x7f58380bbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.277+0000 7f583e400700 1 --2- 172.21.15.49:0/464721157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838062c10 0x7f58380c2610 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.277+0000 7f583e400700 1 -- 172.21.15.49:0/464721157 >> 172.21.15.49:0/464721157 conn(0x7f58380c42c0 msgr2=0x7f5838065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.277+0000 7f583e400700 1 -- 172.21.15.49:0/464721157 shutdown_connections 2024-01-22T05:19:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.277+0000 7f583e400700 1 -- 172.21.15.49:0/464721157 wait complete. 2024-01-22T05:19:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.277+0000 7f583e400700 1 Processor -- start 2024-01-22T05:19:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.277+0000 7f583e400700 1 -- start start 2024-01-22T05:19:02.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583e400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5838062c10 0x7f5838153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:02.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583e400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58380691b0 0x7f58380a8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583e400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838157c00 0x7f5838169000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583e400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5838153670 con 0x7f5838062c10 2024-01-22T05:19:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583e400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5838168b70 con 0x7f5838157c00 2024-01-22T05:19:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583e400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5838168820 con 0x7f58380691b0 2024-01-22T05:19:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5838062c10 0x7f5838153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5838062c10 0x7f5838153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50184/0 (socket says 172.21.15.49:50184) 2024-01-22T05:19:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583d000700 1 -- 172.21.15.49:0/1595503979 learned_addr learned my addr 172.21.15.49:0/1595503979 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:02.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583da00700 1 --2- 172.21.15.49:0/1595503979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838157c00 0x7f5838169000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:02.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f5837e00700 1 --2- 172.21.15.49:0/1595503979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58380691b0 0x7f58380a8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:02.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583d000700 1 -- 172.21.15.49:0/1595503979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58380691b0 msgr2=0x7f58380a8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:02.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583d000700 1 --2- 172.21.15.49:0/1595503979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58380691b0 0x7f58380a8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:02.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583d000700 1 -- 172.21.15.49:0/1595503979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838157c00 msgr2=0x7f5838169000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:02.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583d000700 1 --2- 172.21.15.49:0/1595503979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838157c00 0x7f5838169000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:02.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583d000700 1 -- 172.21.15.49:0/1595503979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5828009370 con 0x7f5838062c10 2024-01-22T05:19:02.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583d000700 1 --2- 172.21.15.49:0/1595503979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5838062c10 0x7f5838153180 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f5828009fd0 tx=0x7f5828017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:02.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f582fe00700 1 -- 172.21.15.49:0/1595503979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582800b850 con 0x7f5838062c10 2024-01-22T05:19:02.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f582fe00700 1 -- 172.21.15.49:0/1595503979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582800b9b0 con 0x7f5838062c10 2024-01-22T05:19:02.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f583e400700 1 -- 172.21.15.49:0/1595503979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5838155140 con 0x7f5838062c10 2024-01-22T05:19:02.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.281+0000 7f582fe00700 1 -- 172.21.15.49:0/1595503979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582801c670 con 0x7f5838062c10 2024-01-22T05:19:02.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.285+0000 7f583e400700 1 -- 172.21.15.49:0/1595503979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5838155700 con 0x7f5838062c10 2024-01-22T05:19:02.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.285+0000 7f583e400700 1 -- 172.21.15.49:0/1595503979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5838155920 con 0x7f5838062c10 2024-01-22T05:19:02.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.285+0000 7f582fe00700 1 -- 172.21.15.49:0/1595503979 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f582801ca20 con 0x7f5838062c10 2024-01-22T05:19:02.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.289+0000 7f582fe00700 1 --2- 172.21.15.49:0/1595503979 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f581005a540 0x7f581005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:02.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.289+0000 7f582fe00700 1 -- 172.21.15.49:0/1595503979 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f5828076130 con 0x7f5838062c10 2024-01-22T05:19:02.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.289+0000 7f5837e00700 1 --2- 172.21.15.49:0/1595503979 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f581005a540 0x7f581005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:02.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.289+0000 7f5837e00700 1 --2- 172.21.15.49:0/1595503979 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f581005a540 0x7f581005ca00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f58380c08c0 tx=0x7f5820009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:02.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.297+0000 7f582fe00700 1 -- 172.21.15.49:0/1595503979 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5828049ab0 con 0x7f5838062c10 2024-01-22T05:19:02.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.501+0000 7f583e400700 1 -- 172.21.15.49:0/1595503979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5838063e70 con 0x7f5838062c10 2024-01-22T05:19:02.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.501+0000 7f582fe00700 1 -- 172.21.15.49:0/1595503979 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) v1 ==== 95+0+3540 (secure 0 0 0) 0x7f5828020df0 con 0x7f5838062c10 2024-01-22T05:19:02.501 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:02.501 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":136,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/3995018890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":3995018890},{"type":"v1","addr":"172.21.15.110:6833","nonce":3995018890}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2248654659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2248654659},{"type":"v1","addr":"172.21.15.49:6837","nonce":2248654659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":8480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1470343024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1470343024},{"type":"v1","addr":"172.21.15.110:6835","nonce":1470343024}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":136},{"gid":9607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1931981528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1931981528},{"type":"v1","addr":"172.21.15.49:6835","nonce":1931981528}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129}],"filesystems":[]} 2024-01-22T05:19:02.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.505+0000 7f583e400700 1 -- 172.21.15.49:0/1595503979 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f581005a540 msgr2=0x7f581005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:02.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.505+0000 7f583e400700 1 --2- 172.21.15.49:0/1595503979 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f581005a540 0x7f581005ca00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f58380c08c0 tx=0x7f5820009040).stop 2024-01-22T05:19:02.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.505+0000 7f583e400700 1 -- 172.21.15.49:0/1595503979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5838062c10 msgr2=0x7f5838153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:02.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.505+0000 7f583e400700 1 --2- 172.21.15.49:0/1595503979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5838062c10 0x7f5838153180 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f5828009fd0 tx=0x7f5828017000).stop 2024-01-22T05:19:02.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.505+0000 7f583e400700 1 -- 172.21.15.49:0/1595503979 shutdown_connections 2024-01-22T05:19:02.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.505+0000 7f583e400700 1 --2- 172.21.15.49:0/1595503979 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f581005a540 0x7f581005ca00 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:02.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.505+0000 7f583e400700 1 --2- 172.21.15.49:0/1595503979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838157c00 0x7f5838169000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:02.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.505+0000 7f583e400700 1 --2- 172.21.15.49:0/1595503979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58380691b0 0x7f58380a8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:02.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.505+0000 7f583e400700 1 --2- 172.21.15.49:0/1595503979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5838062c10 0x7f5838153180 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:02.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.505+0000 7f583e400700 1 -- 172.21.15.49:0/1595503979 >> 172.21.15.49:0/1595503979 conn(0x7f58380c42c0 msgr2=0x7f58380a9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:02.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.505+0000 7f583e400700 1 -- 172.21.15.49:0/1595503979 shutdown_connections 2024-01-22T05:19:02.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.505+0000 7f583e400700 1 -- 172.21.15.49:0/1595503979 wait complete. 2024-01-22T05:19:02.509 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 136 2024-01-22T05:19:02.528 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:19:02.528 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-22T05:19:02.529 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:19:02.529 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:19:02.529 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:19:02.529 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-22T05:19:02.529 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:19:02.529 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:19:02.529 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:19:02.529 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-22T05:19:02.530 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:19:02.530 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:19:02.530 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:19:02.530 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-22T05:19:02.530 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:19:02.530 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:19:02.550 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:19:02.550 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:19:02.551 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:19:02.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:19:02.552 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:19:02.553 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:19:02.553 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:19:02.553 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:19:02.599 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:19:02.599 DEBUG:teuthology.parallel:result is None 2024-01-22T05:19:02.599 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:19:02.600 DEBUG:teuthology.parallel:result is None 2024-01-22T05:19:02.603 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:19:02.603 DEBUG:teuthology.parallel:result is None 2024-01-22T05:19:02.604 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:19:02.604 DEBUG:teuthology.parallel:result is None 2024-01-22T05:19:02.604 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-22T05:19:02.705 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:19:02.715 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:19:02.715 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-22T05:19:02.715 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:19:02.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.769+0000 7f16e2a00700 1 Processor -- start 2024-01-22T05:19:02.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.773+0000 7f16e2a00700 1 -- start start 2024-01-22T05:19:02.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16e2a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16dc0c3a70 0x7f16dc0be7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16e2a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc0c3f00 con 0x7f16dc155c60 2024-01-22T05:19:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16e2a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc0bdc10 con 0x7f16dc0c3690 2024-01-22T05:19:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16e2a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc068e10 con 0x7f16dc0c3a70 2024-01-22T05:19:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16db400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f16dc155c60 0x7f16dc0be0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50984/0 (socket says 172.21.15.49:50984) 2024-01-22T05:19:02.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16db400700 1 -- 172.21.15.49:0/2642557235 learned_addr learned my addr 172.21.15.49:0/2642557235 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16e0a00700 1 --2- 172.21.15.49:0/2642557235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16dc0c3a70 0x7f16dc0be7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 -- 172.21.15.49:0/2642557235 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168548362 0 0) 0x7f16c4001110 con 0x7f16dc155c60 2024-01-22T05:19:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 -- 172.21.15.49:0/2642557235 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16bc0033f0 con 0x7f16dc155c60 2024-01-22T05:19:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 -- 172.21.15.49:0/2642557235 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1759762213 0 0) 0x7f16bc0033f0 con 0x7f16dc155c60 2024-01-22T05:19:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 -- 172.21.15.49:0/2642557235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16dc0c3a70 msgr2=0x7f16dc0be7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 --2- 172.21.15.49:0/2642557235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16dc0c3a70 0x7f16dc0be7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 -- 172.21.15.49:0/2642557235 >> v1:172.21.15.110:6789/0 conn(0x7f16dc0c3690 legacy=0x7f16dc155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 -- 172.21.15.49:0/2642557235 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0690f0 con 0x7f16dc155c60 2024-01-22T05:19:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 -- 172.21.15.49:0/2642557235 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f16c4001600 con 0x7f16dc155c60 2024-01-22T05:19:02.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 -- 172.21.15.49:0/2642557235 >> v1:172.21.15.49:6789/0 conn(0x7f16dc155c60 legacy=0x7f16dc0be0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 --2- 172.21.15.49:0/2642557235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16bc003910 0x7f16bc003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 --2- 172.21.15.49:0/2642557235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16bc004690 0x7f16bc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 --2- 172.21.15.49:0/2642557235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16dc0c3a70 0x7f16bc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 -- 172.21.15.49:0/2642557235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc068e10 con 0x7f16bc004690 2024-01-22T05:19:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 -- 172.21.15.49:0/2642557235 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc00b8e0 con 0x7f16bc003910 2024-01-22T05:19:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 -- 172.21.15.49:0/2642557235 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc00ba70 con 0x7f16dc0c3a70 2024-01-22T05:19:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16db400700 1 --2- 172.21.15.49:0/2642557235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16bc004690 0x7f16bc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16e0a00700 1 --2- 172.21.15.49:0/2642557235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16dc0c3a70 0x7f16bc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16db400700 1 -- 172.21.15.49:0/2642557235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16dc0c3a70 msgr2=0x7f16bc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16db400700 1 --2- 172.21.15.49:0/2642557235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16dc0c3a70 0x7f16bc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16dbe00700 1 --2- 172.21.15.49:0/2642557235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16bc003910 0x7f16bc003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16db400700 1 -- 172.21.15.49:0/2642557235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16bc003910 msgr2=0x7f16bc003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16db400700 1 --2- 172.21.15.49:0/2642557235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16bc003910 0x7f16bc003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16db400700 1 -- 172.21.15.49:0/2642557235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc0033f0 con 0x7f16bc004690 2024-01-22T05:19:02.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16dbe00700 1 --2- 172.21.15.49:0/2642557235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16bc003910 0x7f16bc003cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:19:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16db400700 1 --2- 172.21.15.49:0/2642557235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16bc004690 0x7f16bc004b10 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f16c4005090 tx=0x7f16c4008c10).ready entity=mon.0 client_cookie=ec593255f68e536e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 -- 172.21.15.49:0/2642557235 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c4008170 con 0x7f16bc004690 2024-01-22T05:19:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.777+0000 7f16daa00700 1 -- 172.21.15.49:0/2642557235 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c40082d0 con 0x7f16bc004690 2024-01-22T05:19:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.781+0000 7f16daa00700 1 -- 172.21.15.49:0/2642557235 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c4008650 con 0x7f16bc004690 2024-01-22T05:19:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.781+0000 7f16e2a00700 1 -- 172.21.15.49:0/2642557235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16bc004690 msgr2=0x7f16bc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.781+0000 7f16e2a00700 1 --2- 172.21.15.49:0/2642557235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16bc004690 0x7f16bc004b10 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f16c4005090 tx=0x7f16c4008c10).stop 2024-01-22T05:19:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.781+0000 7f16e0a00700 1 -- 172.21.15.49:0/2642557235 reap_dead start 2024-01-22T05:19:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.781+0000 7f16e2a00700 1 -- 172.21.15.49:0/2642557235 shutdown_connections 2024-01-22T05:19:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.781+0000 7f16e2a00700 1 -- 172.21.15.49:0/2642557235 >> 172.21.15.49:0/2642557235 conn(0x7f16dc0c51c0 msgr2=0x7f16dc0c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.781+0000 7f16e2a00700 1 -- 172.21.15.49:0/2642557235 shutdown_connections 2024-01-22T05:19:02.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.781+0000 7f16e2a00700 1 -- 172.21.15.49:0/2642557235 wait complete. 2024-01-22T05:19:02.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.785+0000 7f16e2a00700 1 Processor -- start 2024-01-22T05:19:02.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.785+0000 7f16e2a00700 1 -- start start 2024-01-22T05:19:02.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.785+0000 7f16e2a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16bc004690 0x7f16dc14b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:02.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.785+0000 7f16e2a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16dc063c20 0x7f16dc16c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.785+0000 7f16e2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16dc152540 0x7f16dc1529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.785+0000 7f16e2a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc152eb0 con 0x7f16dc152540 2024-01-22T05:19:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.785+0000 7f16e2a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc1520b0 con 0x7f16dc063c20 2024-01-22T05:19:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.785+0000 7f16e2a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc151d80 con 0x7f16bc004690 2024-01-22T05:19:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.785+0000 7f16e0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16dc152540 0x7f16dc1529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.785+0000 7f16dbe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16bc004690 0x7f16dc14b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.789+0000 7f16e0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16dc152540 0x7f16dc1529c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50232/0 (socket says 172.21.15.49:50232) 2024-01-22T05:19:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.789+0000 7f16e0a00700 1 -- 172.21.15.49:0/1940739546 learned_addr learned my addr 172.21.15.49:0/1940739546 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.789+0000 7f16db400700 1 --2- 172.21.15.49:0/1940739546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16dc063c20 0x7f16dc16c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.789+0000 7f16e0a00700 1 -- 172.21.15.49:0/1940739546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16bc004690 msgr2=0x7f16dc14b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.789+0000 7f16e0a00700 1 --2- 172.21.15.49:0/1940739546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16bc004690 0x7f16dc14b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.789+0000 7f16e0a00700 1 -- 172.21.15.49:0/1940739546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16dc063c20 msgr2=0x7f16dc16c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.789+0000 7f16e0a00700 1 --2- 172.21.15.49:0/1940739546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16dc063c20 0x7f16dc16c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.789+0000 7f16e0a00700 1 -- 172.21.15.49:0/1940739546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc16cb80 con 0x7f16dc152540 2024-01-22T05:19:02.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.789+0000 7f16e0a00700 1 --2- 172.21.15.49:0/1940739546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16dc152540 0x7f16dc1529c0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7f16dc0c6230 tx=0x7f16d400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:02.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.789+0000 7f16d3400700 1 -- 172.21.15.49:0/1940739546 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d400e070 con 0x7f16dc152540 2024-01-22T05:19:02.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.789+0000 7f16d3400700 1 -- 172.21.15.49:0/1940739546 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d4011b80 con 0x7f16dc152540 2024-01-22T05:19:02.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.789+0000 7f16e2a00700 1 -- 172.21.15.49:0/1940739546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc16ce60 con 0x7f16dc152540 2024-01-22T05:19:02.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.789+0000 7f16d3400700 1 -- 172.21.15.49:0/1940739546 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4016450 con 0x7f16dc152540 2024-01-22T05:19:02.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.789+0000 7f16e2a00700 1 -- 172.21.15.49:0/1940739546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc16d140 con 0x7f16dc152540 2024-01-22T05:19:02.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.789+0000 7f16e2a00700 1 -- 172.21.15.49:0/1940739546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16dc152220 con 0x7f16dc152540 2024-01-22T05:19:02.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.793+0000 7f16d3400700 1 -- 172.21.15.49:0/1940739546 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f16d4016800 con 0x7f16dc152540 2024-01-22T05:19:02.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.793+0000 7f16d3400700 1 --2- 172.21.15.49:0/1940739546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f16b405a510 0x7f16b405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:02.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.797+0000 7f16d3400700 1 -- 172.21.15.49:0/1940739546 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f16d4074a60 con 0x7f16dc152540 2024-01-22T05:19:02.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.797+0000 7f16dbe00700 1 --2- 172.21.15.49:0/1940739546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f16b405a510 0x7f16b405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:02.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.797+0000 7f16dbe00700 1 --2- 172.21.15.49:0/1940739546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f16b405a510 0x7f16b405c9d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f16cc007fd0 tx=0x7f16cc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:02.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.801+0000 7f16d3400700 1 -- 172.21.15.49:0/1940739546 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f16d4048370 con 0x7f16dc152540 2024-01-22T05:19:02.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:02.977+0000 7f16e2a00700 1 -- 172.21.15.49:0/1940739546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f16dc0693d0 con 0x7f16dc152540 2024-01-22T05:19:03.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.765+0000 7f16d3400700 1 -- 172.21.15.49:0/1940739546 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v180) v1 ==== 97+0+0 (secure 0 0 0) 0x7f16d404b990 con 0x7f16dc152540 2024-01-22T05:19:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.769+0000 7f16e2a00700 1 -- 172.21.15.49:0/1940739546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f16b405a510 msgr2=0x7f16b405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.769+0000 7f16e2a00700 1 --2- 172.21.15.49:0/1940739546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f16b405a510 0x7f16b405c9d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f16cc007fd0 tx=0x7f16cc009040).stop 2024-01-22T05:19:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.769+0000 7f16e2a00700 1 -- 172.21.15.49:0/1940739546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16dc152540 msgr2=0x7f16dc1529c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:03.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.769+0000 7f16e2a00700 1 --2- 172.21.15.49:0/1940739546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16dc152540 0x7f16dc1529c0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7f16dc0c6230 tx=0x7f16d400b040).stop 2024-01-22T05:19:03.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.769+0000 7f16e2a00700 1 -- 172.21.15.49:0/1940739546 shutdown_connections 2024-01-22T05:19:03.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.769+0000 7f16e2a00700 1 --2- 172.21.15.49:0/1940739546 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f16b405a510 0x7f16b405c9d0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:03.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.769+0000 7f16e2a00700 1 --2- 172.21.15.49:0/1940739546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16dc152540 0x7f16dc1529c0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:03.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.769+0000 7f16e2a00700 1 --2- 172.21.15.49:0/1940739546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16dc063c20 0x7f16dc16c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:03.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.769+0000 7f16e2a00700 1 --2- 172.21.15.49:0/1940739546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16bc004690 0x7f16dc14b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:03.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.769+0000 7f16e2a00700 1 -- 172.21.15.49:0/1940739546 >> 172.21.15.49:0/1940739546 conn(0x7f16dc0c51c0 msgr2=0x7f16dc0c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:03.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.769+0000 7f16e2a00700 1 -- 172.21.15.49:0/1940739546 shutdown_connections 2024-01-22T05:19:03.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.769+0000 7f16e2a00700 1 -- 172.21.15.49:0/1940739546 wait complete. 2024-01-22T05:19:03.771 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-01-22T05:19:03.792 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-22T05:19:03.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.957+0000 7fcbeba00700 1 Processor -- start 2024-01-22T05:19:03.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.957+0000 7fcbeba00700 1 -- start start 2024-01-22T05:19:03.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbeba00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcbe4155d20 0x7fcbe4065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:03.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbeba00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcbe4066070 0x7fcbe40a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:03.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbeba00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbe40a8c30 0x7fcbe40c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:03.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbeba00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe40c1a40 con 0x7fcbe4155d20 2024-01-22T05:19:03.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbeba00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe40a90c0 con 0x7fcbe4066070 2024-01-22T05:19:03.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbeba00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe4159310 con 0x7fcbe40a8c30 2024-01-22T05:19:03.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbe9000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcbe4155d20 0x7fcbe4065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:03.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbe9000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcbe4155d20 0x7fcbe4065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47728/0 (socket says 172.21.15.49:47728) 2024-01-22T05:19:03.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbe9000700 1 -- 172.21.15.49:0/2557348198 learned_addr learned my addr 172.21.15.49:0/2557348198 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:03.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbe3e00700 1 --2- 172.21.15.49:0/2557348198 >> v2:172.21.15.110:3300/0 conn(0x7fcbe4066070 0x7fcbe40a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:03.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbe9a00700 1 --2- 172.21.15.49:0/2557348198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbe40a8c30 0x7fcbe40c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:03.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbe9000700 1 -- 172.21.15.49:0/2557348198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbe40a8c30 msgr2=0x7fcbe40c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:03.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbe9000700 1 --2- 172.21.15.49:0/2557348198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbe40a8c30 0x7fcbe40c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:03.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbe9000700 1 -- 172.21.15.49:0/2557348198 >> v2:172.21.15.110:3300/0 conn(0x7fcbe4066070 msgr2=0x7fcbe40a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:03.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbe9000700 1 --2- 172.21.15.49:0/2557348198 >> v2:172.21.15.110:3300/0 conn(0x7fcbe4066070 0x7fcbe40a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:03.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbe9000700 1 -- 172.21.15.49:0/2557348198 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe40c13f0 con 0x7fcbe4155d20 2024-01-22T05:19:03.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.961+0000 7fcbe9000700 1 --2- 172.21.15.49:0/2557348198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe4155d20 0x7fcbe4065b80 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fcbe40c0ad0 tx=0x7fcbd40090f0).ready entity=mon.0 client_cookie=e366cd4e56c9fdf0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.965+0000 7fcbe3400700 1 -- 172.21.15.49:0/2557348198 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400b520 con 0x7fcbe4155d20 2024-01-22T05:19:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.965+0000 7fcbe3400700 1 -- 172.21.15.49:0/2557348198 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd400b680 con 0x7fcbe4155d20 2024-01-22T05:19:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.965+0000 7fcbe3400700 1 -- 172.21.15.49:0/2557348198 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400ba00 con 0x7fcbe4155d20 2024-01-22T05:19:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.965+0000 7fcbeba00700 1 -- 172.21.15.49:0/2557348198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe4155d20 msgr2=0x7fcbe4065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.965+0000 7fcbeba00700 1 --2- 172.21.15.49:0/2557348198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe4155d20 0x7fcbe4065b80 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fcbe40c0ad0 tx=0x7fcbd40090f0).stop 2024-01-22T05:19:03.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.965+0000 7fcbeba00700 1 -- 172.21.15.49:0/2557348198 shutdown_connections 2024-01-22T05:19:03.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.965+0000 7fcbeba00700 1 --2- 172.21.15.49:0/2557348198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbe40a8c30 0x7fcbe40c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:03.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.965+0000 7fcbeba00700 1 --2- 172.21.15.49:0/2557348198 >> v2:172.21.15.110:3300/0 conn(0x7fcbe4066070 0x7fcbe40a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:03.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.965+0000 7fcbeba00700 1 --2- 172.21.15.49:0/2557348198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe4155d20 0x7fcbe4065b80 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:03.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.965+0000 7fcbeba00700 1 -- 172.21.15.49:0/2557348198 >> 172.21.15.49:0/2557348198 conn(0x7fcbe40c6540 msgr2=0x7fcbe40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.965+0000 7fcbeba00700 1 -- 172.21.15.49:0/2557348198 shutdown_connections 2024-01-22T05:19:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.965+0000 7fcbeba00700 1 -- 172.21.15.49:0/2557348198 wait complete. 2024-01-22T05:19:03.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.969+0000 7fcbeba00700 1 Processor -- start 2024-01-22T05:19:03.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.969+0000 7fcbeba00700 1 -- start start 2024-01-22T05:19:03.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbeba00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbe4066070 0x7fcbe40a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:03.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbeba00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbe40a8c30 0x7fcbe40a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:03.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbeba00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe4155d20 0x7fcbe40aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:03.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbeba00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe4159f20 con 0x7fcbe4155d20 2024-01-22T05:19:03.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbeba00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe415a780 con 0x7fcbe4066070 2024-01-22T05:19:03.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbeba00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40ac410 con 0x7fcbe40a8c30 2024-01-22T05:19:03.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbe9a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe4155d20 0x7fcbe40aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:03.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbe9a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe4155d20 0x7fcbe40aa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47740/0 (socket says 172.21.15.49:47740) 2024-01-22T05:19:03.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbe9a00700 1 -- 172.21.15.49:0/3395269789 learned_addr learned my addr 172.21.15.49:0/3395269789 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:03.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbe3e00700 1 --2- 172.21.15.49:0/3395269789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbe40a8c30 0x7fcbe40a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:03.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbe9000700 1 --2- 172.21.15.49:0/3395269789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbe4066070 0x7fcbe40a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:03.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbe9a00700 1 -- 172.21.15.49:0/3395269789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbe40a8c30 msgr2=0x7fcbe40a9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:03.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbe9a00700 1 --2- 172.21.15.49:0/3395269789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbe40a8c30 0x7fcbe40a9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:03.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbe9a00700 1 -- 172.21.15.49:0/3395269789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbe4066070 msgr2=0x7fcbe40a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:03.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbe9a00700 1 --2- 172.21.15.49:0/3395269789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbe4066070 0x7fcbe40a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:03.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbe9a00700 1 -- 172.21.15.49:0/3395269789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd4009370 con 0x7fcbe4155d20 2024-01-22T05:19:03.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbe9a00700 1 --2- 172.21.15.49:0/3395269789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe4155d20 0x7fcbe40aa2a0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7fcbdc009fa0 tx=0x7fcbdc009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:03.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbdbe00700 1 -- 172.21.15.49:0/3395269789 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc00ebc0 con 0x7fcbe4155d20 2024-01-22T05:19:03.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbdbe00700 1 -- 172.21.15.49:0/3395269789 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc00ed20 con 0x7fcbe4155d20 2024-01-22T05:19:03.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbdbe00700 1 -- 172.21.15.49:0/3395269789 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc014610 con 0x7fcbe4155d20 2024-01-22T05:19:03.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbeba00700 1 -- 172.21.15.49:0/3395269789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe415a130 con 0x7fcbe4155d20 2024-01-22T05:19:03.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.973+0000 7fcbeba00700 1 -- 172.21.15.49:0/3395269789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe40a9aa0 con 0x7fcbe4155d20 2024-01-22T05:19:03.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.977+0000 7fcbeba00700 1 -- 172.21.15.49:0/3395269789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe4047060 con 0x7fcbe4155d20 2024-01-22T05:19:03.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.977+0000 7fcbdbe00700 1 -- 172.21.15.49:0/3395269789 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcbdc01d3b0 con 0x7fcbe4155d20 2024-01-22T05:19:03.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.977+0000 7fcbdbe00700 1 --2- 172.21.15.49:0/3395269789 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcbbc05a510 0x7fcbbc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:03.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.977+0000 7fcbdbe00700 1 -- 172.21.15.49:0/3395269789 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fcbdc074990 con 0x7fcbe4155d20 2024-01-22T05:19:03.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.981+0000 7fcbe9000700 1 --2- 172.21.15.49:0/3395269789 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcbbc05a510 0x7fcbbc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:03.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.981+0000 7fcbe9000700 1 --2- 172.21.15.49:0/3395269789 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcbbc05a510 0x7fcbbc05c9d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fcbd4009130 tx=0x7fcbd4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:03.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:03.985+0000 7fcbdbe00700 1 -- 172.21.15.49:0/3395269789 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcbdc048300 con 0x7fcbe4155d20 2024-01-22T05:19:04.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.201+0000 7fcbeba00700 1 -- 172.21.15.49:0/3395269789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcbe40c16d0 con 0x7fcbe4155d20 2024-01-22T05:19:04.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.201+0000 7fcbdbe00700 1 -- 172.21.15.49:0/3395269789 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fcbdc04b920 con 0x7fcbe4155d20 2024-01-22T05:19:04.202 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:04.202 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:19:04.202 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-01-22T05:19:04.202 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.202 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-01-22T05:19:04.202 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lTCfoJxAAxDGvXKXgooA9/f0J70s6AA==", 2024-01-22T05:19:04.202 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.202 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:04.202 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:19:04.202 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:19:04.202 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:04.202 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.203 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.203 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.203 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-01-22T05:19:04.203 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lHqV6ORAA1DwpPV2PyDBF/6/ePTdQJw==", 2024-01-22T05:19:04.203 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.203 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:04.203 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:19:04.203 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:19:04.203 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:04.203 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.203 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.203 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.203 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-01-22T05:19:04.203 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lPo86MhAAonfC3M+AkLldljODYNGzyA==", 2024-01-22T05:19:04.203 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.204 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:04.204 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:19:04.204 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:19:04.204 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:04.204 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.204 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.204 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.204 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-01-22T05:19:04.204 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lLwvMBxAAFm52HWeGbTH1gbWVm6r5zQ==", 2024-01-22T05:19:04.204 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.204 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:04.204 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:19:04.204 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:19:04.204 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:04.205 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.205 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.205 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.205 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-01-22T05:19:04.205 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAt961lH2F9NBAAHm8R9/Q5IuFUvb0o1GyD4Q==", 2024-01-22T05:19:04.205 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.205 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:04.205 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:04.205 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:04.205 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.205 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.205 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.206 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-01-22T05:19:04.206 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAx961lS1lEIhAAuDm2OYfTYff1kVEq5vXvFw==", 2024-01-22T05:19:04.206 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.206 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:04.206 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:04.206 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:04.206 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.206 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.206 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.206 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-01-22T05:19:04.206 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA1961limLvERAAv23crKrwjLIg84u48BHHbg==", 2024-01-22T05:19:04.206 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.206 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:04.206 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:04.207 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:04.207 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.207 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.207 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.207 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2024-01-22T05:19:04.207 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA5961lShJiABAAnvyhz0ggDaITaMgwzi9kAA==", 2024-01-22T05:19:04.207 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.207 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:04.207 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:04.207 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:04.207 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.207 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.207 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.207 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2024-01-22T05:19:04.208 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA9961lcopfNRAAAZgHzI1t7YHI5cAjaCMiNw==", 2024-01-22T05:19:04.208 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.208 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:04.208 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:04.208 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:04.208 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.208 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.208 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.208 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2024-01-22T05:19:04.208 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBB961lX+nTIxAAtP3YQypuFWM5O/LADjvybA==", 2024-01-22T05:19:04.208 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.208 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:04.208 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:04.208 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:04.209 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.209 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.209 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.209 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2024-01-22T05:19:04.209 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBF961lQ4/XERAARZPqENsV3jokk2g3OXUI5w==", 2024-01-22T05:19:04.209 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.209 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:04.209 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:04.209 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:04.209 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.209 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.209 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.209 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2024-01-22T05:19:04.209 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBI961luxnqOhAAGsV74DKQda5cetNA/woOnA==", 2024-01-22T05:19:04.210 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.210 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:04.210 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:04.210 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:04.210 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.210 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.210 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.210 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-01-22T05:19:04.210 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lmrM6DhAAYU09HviWyrUIz4lio15wFw==", 2024-01-22T05:19:04.210 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.210 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:04.210 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-01-22T05:19:04.210 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-22T05:19:04.210 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.210 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lIhYRGRAAFG+YtkDLFsra6zU44xKCHw==", 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lRuyaExAAQO3a7ahOEcuE+WVfXYEBTg==", 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:04.211 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:19:04.212 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:19:04.212 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:19:04.212 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.212 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.212 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.212 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2024-01-22T05:19:04.212 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lMiMkHhAAxPdKpcHdtqSphbc/2agq9Q==", 2024-01-22T05:19:04.212 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.212 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:04.212 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:19:04.212 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:19:04.212 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:19:04.212 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.212 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.212 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.213 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-01-22T05:19:04.213 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961ljsweARAAJrY3z/sBjayjB2BRQNrJew==", 2024-01-22T05:19:04.213 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.213 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:19:04.213 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:19:04.213 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:19:04.213 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:04.213 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.213 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.213 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.213 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-01-22T05:19:04.213 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961l0DwDIhAAeuCu79LxNMEJvWiW/BfDhA==", 2024-01-22T05:19:04.213 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.214 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:19:04.214 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:19:04.214 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:04.214 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.214 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:04.214 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:04.214 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2024-01-22T05:19:04.214 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lZlmPGxAA1KVZR+XzNdoFVo/980hD8w==", 2024-01-22T05:19:04.214 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:04.214 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:19:04.214 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:19:04.214 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:04.215 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.215 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:04.215 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-01-22T05:19:04.215 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:19:04.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.205+0000 7fcbeba00700 1 -- 172.21.15.49:0/3395269789 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcbbc05a510 msgr2=0x7fcbbc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:04.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.205+0000 7fcbeba00700 1 --2- 172.21.15.49:0/3395269789 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcbbc05a510 0x7fcbbc05c9d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fcbd4009130 tx=0x7fcbd4017000).stop 2024-01-22T05:19:04.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.205+0000 7fcbeba00700 1 -- 172.21.15.49:0/3395269789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe4155d20 msgr2=0x7fcbe40aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:04.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.205+0000 7fcbeba00700 1 --2- 172.21.15.49:0/3395269789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe4155d20 0x7fcbe40aa2a0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7fcbdc009fa0 tx=0x7fcbdc009900).stop 2024-01-22T05:19:04.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.209+0000 7fcbeba00700 1 -- 172.21.15.49:0/3395269789 shutdown_connections 2024-01-22T05:19:04.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.209+0000 7fcbeba00700 1 --2- 172.21.15.49:0/3395269789 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcbbc05a510 0x7fcbbc05c9d0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.209+0000 7fcbeba00700 1 --2- 172.21.15.49:0/3395269789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe4155d20 0x7fcbe40aa2a0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.209+0000 7fcbeba00700 1 --2- 172.21.15.49:0/3395269789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbe40a8c30 0x7fcbe40a9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.209+0000 7fcbeba00700 1 --2- 172.21.15.49:0/3395269789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbe4066070 0x7fcbe40a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.209+0000 7fcbeba00700 1 -- 172.21.15.49:0/3395269789 >> 172.21.15.49:0/3395269789 conn(0x7fcbe40c6540 msgr2=0x7fcbe40c4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:04.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.209+0000 7fcbeba00700 1 -- 172.21.15.49:0/3395269789 shutdown_connections 2024-01-22T05:19:04.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.209+0000 7fcbeba00700 1 -- 172.21.15.49:0/3395269789 wait complete. 2024-01-22T05:19:04.230 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:19:04.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.389+0000 7f2d2ea00700 1 Processor -- start 2024-01-22T05:19:04.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.389+0000 7f2d2ea00700 1 -- start start 2024-01-22T05:19:04.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d2ea00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2d280c5710 0x7f2d28064dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:04.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d2ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d280652c0 0x7f2d28153e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:04.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d2ea00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d280bd4c0 con 0x7f2d280c38c0 2024-01-22T05:19:04.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d2ea00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d280a7ec0 con 0x7f2d280652c0 2024-01-22T05:19:04.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d2ea00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d280be040 con 0x7f2d280c5710 2024-01-22T05:19:04.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d2d400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d280652c0 0x7f2d28153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:04.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d27400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2d280c5710 0x7f2d28064dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:04.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d27e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2d280c38c0 0x7f2d2814fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58264/0 (socket says 172.21.15.49:58264) 2024-01-22T05:19:04.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d27400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2d280c5710 0x7f2d28064dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:41070/0 (socket says 172.21.15.49:41070) 2024-01-22T05:19:04.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d27e00700 1 -- 172.21.15.49:0/3623347452 learned_addr learned my addr 172.21.15.49:0/3623347452 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:04.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d2d400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d280652c0 0x7f2d28153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47744/0 (socket says 172.21.15.49:47744) 2024-01-22T05:19:04.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d2d400700 1 -- 172.21.15.49:0/3623347452 >> v2:172.21.15.110:3300/0 conn(0x7f2d280c5710 msgr2=0x7f2d28064dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:04.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d2d400700 1 --2- 172.21.15.49:0/3623347452 >> v2:172.21.15.110:3300/0 conn(0x7f2d280c5710 0x7f2d28064dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d2d400700 1 -- 172.21.15.49:0/3623347452 >> v1:172.21.15.49:6789/0 conn(0x7f2d280c38c0 legacy=0x7f2d2814fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:04.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d2d400700 1 -- 172.21.15.49:0/3623347452 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d28065730 con 0x7f2d280652c0 2024-01-22T05:19:04.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d27400700 1 --2- 172.21.15.49:0/3623347452 >> v2:172.21.15.110:3300/0 conn(0x7f2d280c5710 0x7f2d28064dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:04.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d2d400700 1 --2- 172.21.15.49:0/3623347452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d280652c0 0x7f2d28153e00 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f2d28069b20 tx=0x7f2d20009780).ready entity=mon.0 client_cookie=ee3a8643cfa36228 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:04.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.393+0000 7f2d26a00700 1 -- 172.21.15.49:0/3623347452 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000e070 con 0x7f2d280652c0 2024-01-22T05:19:04.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.397+0000 7f2d26a00700 1 -- 172.21.15.49:0/3623347452 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2000bb20 con 0x7f2d280652c0 2024-01-22T05:19:04.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.397+0000 7f2d26a00700 1 -- 172.21.15.49:0/3623347452 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000bea0 con 0x7f2d280652c0 2024-01-22T05:19:04.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.397+0000 7f2d2ea00700 1 -- 172.21.15.49:0/3623347452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d280652c0 msgr2=0x7f2d28153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:04.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.397+0000 7f2d2ea00700 1 --2- 172.21.15.49:0/3623347452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d280652c0 0x7f2d28153e00 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f2d28069b20 tx=0x7f2d20009780).stop 2024-01-22T05:19:04.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.397+0000 7f2d2ea00700 1 -- 172.21.15.49:0/3623347452 shutdown_connections 2024-01-22T05:19:04.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.397+0000 7f2d2ea00700 1 --2- 172.21.15.49:0/3623347452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d280652c0 0x7f2d28153e00 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.397+0000 7f2d2ea00700 1 --2- 172.21.15.49:0/3623347452 >> v2:172.21.15.110:3300/0 conn(0x7f2d280c5710 0x7f2d28064dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.397+0000 7f2d2ea00700 1 -- 172.21.15.49:0/3623347452 >> 172.21.15.49:0/3623347452 conn(0x7f2d280c9030 msgr2=0x7f2d280c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:04.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.397+0000 7f2d2ea00700 1 -- 172.21.15.49:0/3623347452 shutdown_connections 2024-01-22T05:19:04.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.397+0000 7f2d2ea00700 1 -- 172.21.15.49:0/3623347452 wait complete. 2024-01-22T05:19:04.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d2ea00700 1 Processor -- start 2024-01-22T05:19:04.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d2ea00700 1 -- start start 2024-01-22T05:19:04.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d2ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d280652c0 0x7f2d28148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:04.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d2ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d280c38c0 0x7f2d28152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:04.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d2ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d280c5710 0x7f2d280a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:04.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d2ea00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d28151670 con 0x7f2d280652c0 2024-01-22T05:19:04.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d2ea00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d28151950 con 0x7f2d280c5710 2024-01-22T05:19:04.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d2ea00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d28151c30 con 0x7f2d280c38c0 2024-01-22T05:19:04.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d27e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d280652c0 0x7f2d28148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:04.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d27e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d280652c0 0x7f2d28148d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47750/0 (socket says 172.21.15.49:47750) 2024-01-22T05:19:04.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d27e00700 1 -- 172.21.15.49:0/1725132749 learned_addr learned my addr 172.21.15.49:0/1725132749 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:04.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d27400700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d280c38c0 0x7f2d28152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:04.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d2d400700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d280c5710 0x7f2d280a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:04.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d27e00700 1 -- 172.21.15.49:0/1725132749 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d280c38c0 msgr2=0x7f2d28152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:04.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d27e00700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d280c38c0 0x7f2d28152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d27e00700 1 -- 172.21.15.49:0/1725132749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d280c5710 msgr2=0x7f2d280a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:04.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.401+0000 7f2d27e00700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d280c5710 0x7f2d280a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.405+0000 7f2d27e00700 1 -- 172.21.15.49:0/1725132749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d100092a0 con 0x7f2d280652c0 2024-01-22T05:19:04.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.405+0000 7f2d2d400700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d280c5710 0x7f2d280a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:04.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.405+0000 7f2d27400700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d280c38c0 0x7f2d28152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:04.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.405+0000 7f2d27e00700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d280652c0 0x7f2d28148d80 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7f2d18007fd0 tx=0x7f2d18007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:04.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.405+0000 7f2d1f400700 1 -- 172.21.15.49:0/1725132749 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d180072e0 con 0x7f2d280652c0 2024-01-22T05:19:04.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.405+0000 7f2d1f400700 1 -- 172.21.15.49:0/1725132749 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d18007440 con 0x7f2d280652c0 2024-01-22T05:19:04.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.405+0000 7f2d2ea00700 1 -- 172.21.15.49:0/1725132749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d20009a20 con 0x7f2d280652c0 2024-01-22T05:19:04.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.405+0000 7f2d1f400700 1 -- 172.21.15.49:0/1725132749 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d180057a0 con 0x7f2d280652c0 2024-01-22T05:19:04.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.405+0000 7f2d2ea00700 1 -- 172.21.15.49:0/1725132749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d281521f0 con 0x7f2d280652c0 2024-01-22T05:19:04.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.405+0000 7f2d2ea00700 1 -- 172.21.15.49:0/1725132749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d28047060 con 0x7f2d280652c0 2024-01-22T05:19:04.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.409+0000 7f2d1f400700 1 -- 172.21.15.49:0/1725132749 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2d18005b90 con 0x7f2d280652c0 2024-01-22T05:19:04.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.409+0000 7f2d1f400700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d0005a510 0x7f2d0005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:04.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.409+0000 7f2d1f400700 1 -- 172.21.15.49:0/1725132749 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f2d18073db0 con 0x7f2d280652c0 2024-01-22T05:19:04.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.409+0000 7f2d27400700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d0005a510 0x7f2d0005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:04.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.409+0000 7f2d27400700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d0005a510 0x7f2d0005c9d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f2d10009270 tx=0x7f2d10008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:04.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.413+0000 7f2d1f400700 1 -- 172.21.15.49:0/1725132749 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2d18047780 con 0x7f2d280652c0 2024-01-22T05:19:04.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.581+0000 7f2d2ea00700 1 -- 172.21.15.49:0/1725132749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d280bd710 con 0x7f2d280652c0 2024-01-22T05:19:04.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.581+0000 7f2d1f400700 1 -- 172.21.15.49:0/1725132749 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+13958 (secure 0 0 0) 0x7f2d1804ada0 con 0x7f2d280652c0 2024-01-22T05:19:04.581 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:04.581 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":180,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:19:03.750985+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:19:04.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.585+0000 7f2d2ea00700 1 -- 172.21.15.49:0/1725132749 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d0005a510 msgr2=0x7f2d0005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:04.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.585+0000 7f2d2ea00700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d0005a510 0x7f2d0005c9d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f2d10009270 tx=0x7f2d10008040).stop 2024-01-22T05:19:04.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.585+0000 7f2d2ea00700 1 -- 172.21.15.49:0/1725132749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d280652c0 msgr2=0x7f2d28148d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:04.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.585+0000 7f2d2ea00700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d280652c0 0x7f2d28148d80 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7f2d18007fd0 tx=0x7f2d18007df0).stop 2024-01-22T05:19:04.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.585+0000 7f2d2ea00700 1 -- 172.21.15.49:0/1725132749 shutdown_connections 2024-01-22T05:19:04.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.585+0000 7f2d2ea00700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2d0005a510 0x7f2d0005c9d0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.585+0000 7f2d2ea00700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d280c5710 0x7f2d280a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.585+0000 7f2d2ea00700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d280c38c0 0x7f2d28152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.585+0000 7f2d2ea00700 1 --2- 172.21.15.49:0/1725132749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d280652c0 0x7f2d28148d80 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.585+0000 7f2d2ea00700 1 -- 172.21.15.49:0/1725132749 >> 172.21.15.49:0/1725132749 conn(0x7f2d280c9030 msgr2=0x7f2d280c3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:04.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.585+0000 7f2d2ea00700 1 -- 172.21.15.49:0/1725132749 shutdown_connections 2024-01-22T05:19:04.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.585+0000 7f2d2ea00700 1 -- 172.21.15.49:0/1725132749 wait complete. 2024-01-22T05:19:04.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:19:04.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:19:04.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.769+0000 7f0045800700 1 Processor -- start 2024-01-22T05:19:04.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.769+0000 7f0045800700 1 -- start start 2024-01-22T05:19:04.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f0045800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00400bb500 0x7f00400665b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:04.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f0045800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f00400c1140 0x7f00400c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:04.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f0045800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00400bbce0 con 0x7f0040066aa0 2024-01-22T05:19:04.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f0045800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0040066120 con 0x7f00400c1140 2024-01-22T05:19:04.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f0045800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00400bc040 con 0x7f00400bb500 2024-01-22T05:19:04.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f003e000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0040066aa0 0x7f0040067c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58266/0 (socket says 172.21.15.49:58266) 2024-01-22T05:19:04.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f003e000700 1 -- 172.21.15.49:0/2874395935 learned_addr learned my addr 172.21.15.49:0/2874395935 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:04.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f003f400700 1 --2- 172.21.15.49:0/2874395935 >> v2:172.21.15.110:3300/0 conn(0x7f00400c1140 0x7f00400c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:04.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f003ea00700 1 --2- 172.21.15.49:0/2874395935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00400bb500 0x7f00400665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f003d600700 1 -- 172.21.15.49:0/2874395935 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176043657 0 0) 0x7f00400bbce0 con 0x7f0040066aa0 2024-01-22T05:19:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f003ea00700 1 -- 172.21.15.49:0/2874395935 >> v2:172.21.15.110:3300/0 conn(0x7f00400c1140 msgr2=0x7f00400c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f003ea00700 1 --2- 172.21.15.49:0/2874395935 >> v2:172.21.15.110:3300/0 conn(0x7f00400c1140 0x7f00400c15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f003ea00700 1 -- 172.21.15.49:0/2874395935 >> v1:172.21.15.49:6789/0 conn(0x7f0040066aa0 legacy=0x7f0040067c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f003ea00700 1 -- 172.21.15.49:0/2874395935 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00400bc320 con 0x7f00400bb500 2024-01-22T05:19:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f003ea00700 1 --2- 172.21.15.49:0/2874395935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00400bb500 0x7f00400665b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f0030009790 tx=0x7f0030009060).ready entity=mon.2 client_cookie=3eda8e1201e10af9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:04.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f003d600700 1 -- 172.21.15.49:0/2874395935 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003000f510 con 0x7f00400bb500 2024-01-22T05:19:04.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f003d600700 1 -- 172.21.15.49:0/2874395935 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003000f670 con 0x7f00400bb500 2024-01-22T05:19:04.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.773+0000 7f003d600700 1 -- 172.21.15.49:0/2874395935 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003000f9f0 con 0x7f00400bb500 2024-01-22T05:19:04.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.777+0000 7f0045800700 1 -- 172.21.15.49:0/2874395935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00400bb500 msgr2=0x7f00400665b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:04.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.777+0000 7f0045800700 1 --2- 172.21.15.49:0/2874395935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00400bb500 0x7f00400665b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f0030009790 tx=0x7f0030009060).stop 2024-01-22T05:19:04.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.777+0000 7f0045800700 1 -- 172.21.15.49:0/2874395935 shutdown_connections 2024-01-22T05:19:04.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.777+0000 7f0045800700 1 --2- 172.21.15.49:0/2874395935 >> v2:172.21.15.110:3300/0 conn(0x7f00400c1140 0x7f00400c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.777+0000 7f0045800700 1 --2- 172.21.15.49:0/2874395935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00400bb500 0x7f00400665b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.777+0000 7f0045800700 1 -- 172.21.15.49:0/2874395935 >> 172.21.15.49:0/2874395935 conn(0x7f00400c6f90 msgr2=0x7f00400c2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:04.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.777+0000 7f0045800700 1 -- 172.21.15.49:0/2874395935 shutdown_connections 2024-01-22T05:19:04.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.777+0000 7f0045800700 1 -- 172.21.15.49:0/2874395935 wait complete. 2024-01-22T05:19:04.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.777+0000 7f0045800700 1 Processor -- start 2024-01-22T05:19:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f0045800700 1 -- start start 2024-01-22T05:19:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f0045800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0040066aa0 0x7f00400a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f0045800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00400bb500 0x7f0040150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f0045800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00400c1140 0x7f004014d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f0045800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00400aa830 con 0x7f00400c1140 2024-01-22T05:19:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f0045800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0040151390 con 0x7f00400bb500 2024-01-22T05:19:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f0045800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004014de40 con 0x7f0040066aa0 2024-01-22T05:19:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f003f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00400c1140 0x7f004014d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f003f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00400c1140 0x7f004014d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47754/0 (socket says 172.21.15.49:47754) 2024-01-22T05:19:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f003f400700 1 -- 172.21.15.49:0/1056741554 learned_addr learned my addr 172.21.15.49:0/1056741554 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f003ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0040066aa0 0x7f00400a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f003e000700 1 --2- 172.21.15.49:0/1056741554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00400bb500 0x7f0040150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f003f400700 1 -- 172.21.15.49:0/1056741554 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0040066aa0 msgr2=0x7f00400a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f003f400700 1 --2- 172.21.15.49:0/1056741554 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0040066aa0 0x7f00400a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f003f400700 1 -- 172.21.15.49:0/1056741554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00400bb500 msgr2=0x7f0040150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f003f400700 1 --2- 172.21.15.49:0/1056741554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00400bb500 0x7f0040150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f003f400700 1 -- 172.21.15.49:0/1056741554 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00300092a0 con 0x7f00400c1140 2024-01-22T05:19:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.781+0000 7f003f400700 1 --2- 172.21.15.49:0/1056741554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00400c1140 0x7f004014d950 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f0038009df0 tx=0x7f003800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.785+0000 7f0036000700 1 -- 172.21.15.49:0/1056741554 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003800caa0 con 0x7f00400c1140 2024-01-22T05:19:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.785+0000 7f0036000700 1 -- 172.21.15.49:0/1056741554 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003800f040 con 0x7f00400c1140 2024-01-22T05:19:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.785+0000 7f0036000700 1 -- 172.21.15.49:0/1056741554 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003800ce10 con 0x7f00400c1140 2024-01-22T05:19:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.785+0000 7f0045800700 1 -- 172.21.15.49:0/1056741554 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00400a9c20 con 0x7f00400c1140 2024-01-22T05:19:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.785+0000 7f0045800700 1 -- 172.21.15.49:0/1056741554 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00400aa1e0 con 0x7f00400c1140 2024-01-22T05:19:04.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.785+0000 7f0045800700 1 -- 172.21.15.49:0/1056741554 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00400bbd40 con 0x7f00400c1140 2024-01-22T05:19:04.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.785+0000 7f0036000700 1 -- 172.21.15.49:0/1056741554 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0038013610 con 0x7f00400c1140 2024-01-22T05:19:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.789+0000 7f0036000700 1 --2- 172.21.15.49:0/1056741554 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f001805a540 0x7f001805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.789+0000 7f0036000700 1 -- 172.21.15.49:0/1056741554 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f0038074c80 con 0x7f00400c1140 2024-01-22T05:19:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.789+0000 7f003ea00700 1 --2- 172.21.15.49:0/1056741554 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f001805a540 0x7f001805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:04.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.789+0000 7f003ea00700 1 --2- 172.21.15.49:0/1056741554 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f001805a540 0x7f001805ca00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f0030006d30 tx=0x7f0030017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:04.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.793+0000 7f0036000700 1 -- 172.21.15.49:0/1056741554 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f00400bbd40 con 0x7f00400c1140 2024-01-22T05:19:04.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.961+0000 7f0045800700 1 -- 172.21.15.49:0/1056741554 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f00400bbd40 con 0x7f00400c1140 2024-01-22T05:19:04.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.961+0000 7f0036000700 1 -- 172.21.15.49:0/1056741554 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v180) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0038048650 con 0x7f00400c1140 2024-01-22T05:19:04.961 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:19:04.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.965+0000 7f0045800700 1 -- 172.21.15.49:0/1056741554 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f001805a540 msgr2=0x7f001805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:04.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.965+0000 7f0045800700 1 --2- 172.21.15.49:0/1056741554 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f001805a540 0x7f001805ca00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f0030006d30 tx=0x7f0030017000).stop 2024-01-22T05:19:04.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.965+0000 7f0045800700 1 -- 172.21.15.49:0/1056741554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00400c1140 msgr2=0x7f004014d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:04.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.965+0000 7f0045800700 1 --2- 172.21.15.49:0/1056741554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00400c1140 0x7f004014d950 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f0038009df0 tx=0x7f003800b040).stop 2024-01-22T05:19:04.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.965+0000 7f0045800700 1 -- 172.21.15.49:0/1056741554 shutdown_connections 2024-01-22T05:19:04.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.965+0000 7f0045800700 1 --2- 172.21.15.49:0/1056741554 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f001805a540 0x7f001805ca00 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.965+0000 7f0045800700 1 --2- 172.21.15.49:0/1056741554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00400c1140 0x7f004014d950 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.965+0000 7f0045800700 1 --2- 172.21.15.49:0/1056741554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00400bb500 0x7f0040150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.965+0000 7f0045800700 1 --2- 172.21.15.49:0/1056741554 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0040066aa0 0x7f00400a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:04.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.965+0000 7f0045800700 1 -- 172.21.15.49:0/1056741554 >> 172.21.15.49:0/1056741554 conn(0x7f00400c6f90 msgr2=0x7f00400a8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:04.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.965+0000 7f0045800700 1 -- 172.21.15.49:0/1056741554 shutdown_connections 2024-01-22T05:19:04.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:04.965+0000 7f0045800700 1 -- 172.21.15.49:0/1056741554 wait complete. 2024-01-22T05:19:04.990 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:19:05.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.157+0000 7f5162600700 1 Processor -- start 2024-01-22T05:19:05.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.157+0000 7f5162600700 1 -- start start 2024-01-22T05:19:05.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f5162600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f515c0a9590 0x7f515c0be410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f5162600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f515c0be900 0x7f515c15b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f5162600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515c069100 con 0x7f515c067eb0 2024-01-22T05:19:05.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f5162600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515c068290 con 0x7f515c0a9590 2024-01-22T05:19:05.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f5162600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515c0a8100 con 0x7f515c0be900 2024-01-22T05:19:05.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f515aa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f515c0a9590 0x7f515c0be410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f515aa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f515c0a9590 0x7f515c0be410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47758/0 (socket says 172.21.15.49:47758) 2024-01-22T05:19:05.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f515aa00700 1 -- 172.21.15.49:0/3861396372 learned_addr learned my addr 172.21.15.49:0/3861396372 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:05.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f515be00700 1 --2- 172.21.15.49:0/3861396372 >> v2:172.21.15.110:3300/0 conn(0x7f515c0be900 0x7f515c15b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f515aa00700 1 -- 172.21.15.49:0/3861396372 >> v2:172.21.15.110:3300/0 conn(0x7f515c0be900 msgr2=0x7f515c15b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:05.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f515aa00700 1 --2- 172.21.15.49:0/3861396372 >> v2:172.21.15.110:3300/0 conn(0x7f515c0be900 0x7f515c15b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f515aa00700 1 -- 172.21.15.49:0/3861396372 >> v1:172.21.15.49:6789/0 conn(0x7f515c067eb0 legacy=0x7f515c0bdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f515aa00700 1 -- 172.21.15.49:0/3861396372 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c0684f0 con 0x7f515c0a9590 2024-01-22T05:19:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f515aa00700 1 --2- 172.21.15.49:0/3861396372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515c0a9590 0x7f515c0be410 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f515c06bff0 tx=0x7f51440090f0).ready entity=mon.0 client_cookie=da87706a79b06eee server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f515a000700 1 -- 172.21.15.49:0/3861396372 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514400b600 con 0x7f515c0a9590 2024-01-22T05:19:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f515a000700 1 -- 172.21.15.49:0/3861396372 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514400b760 con 0x7f515c0a9590 2024-01-22T05:19:05.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.161+0000 7f515a000700 1 -- 172.21.15.49:0/3861396372 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514400bae0 con 0x7f515c0a9590 2024-01-22T05:19:05.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.165+0000 7f5162600700 1 -- 172.21.15.49:0/3861396372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515c0a9590 msgr2=0x7f515c0be410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.165+0000 7f5162600700 1 --2- 172.21.15.49:0/3861396372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515c0a9590 0x7f515c0be410 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f515c06bff0 tx=0x7f51440090f0).stop 2024-01-22T05:19:05.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.165+0000 7f5162600700 1 -- 172.21.15.49:0/3861396372 shutdown_connections 2024-01-22T05:19:05.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.165+0000 7f5162600700 1 --2- 172.21.15.49:0/3861396372 >> v2:172.21.15.110:3300/0 conn(0x7f515c0be900 0x7f515c15b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.165+0000 7f5162600700 1 --2- 172.21.15.49:0/3861396372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515c0a9590 0x7f515c0be410 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.165+0000 7f5162600700 1 -- 172.21.15.49:0/3861396372 >> 172.21.15.49:0/3861396372 conn(0x7f515c064ee0 msgr2=0x7f515c0c87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:05.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.165+0000 7f5162600700 1 -- 172.21.15.49:0/3861396372 shutdown_connections 2024-01-22T05:19:05.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.165+0000 7f5162600700 1 -- 172.21.15.49:0/3861396372 wait complete. 2024-01-22T05:19:05.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.169+0000 7f5162600700 1 Processor -- start 2024-01-22T05:19:05.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.169+0000 7f5162600700 1 -- start start 2024-01-22T05:19:05.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.169+0000 7f5162600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f515c067eb0 0x7f515c162d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.169+0000 7f5162600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515c0a9590 0x7f515c165100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.169+0000 7f5162600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f515c0be900 0x7f515c1634b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.169+0000 7f5162600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c163250 con 0x7f515c0a9590 2024-01-22T05:19:05.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.169+0000 7f5162600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c0abaf0 con 0x7f515c067eb0 2024-01-22T05:19:05.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.169+0000 7f5162600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c0abdd0 con 0x7f515c0be900 2024-01-22T05:19:05.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.169+0000 7f515aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515c0a9590 0x7f515c165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f515aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515c0a9590 0x7f515c165100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47768/0 (socket says 172.21.15.49:47768) 2024-01-22T05:19:05.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f515aa00700 1 -- 172.21.15.49:0/3646657511 learned_addr learned my addr 172.21.15.49:0/3646657511 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:05.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f515b400700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f515c067eb0 0x7f515c162d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f515be00700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f515c0be900 0x7f515c1634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f515aa00700 1 -- 172.21.15.49:0/3646657511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f515c0be900 msgr2=0x7f515c1634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f515aa00700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f515c0be900 0x7f515c1634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f515aa00700 1 -- 172.21.15.49:0/3646657511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f515c067eb0 msgr2=0x7f515c162d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f515aa00700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f515c067eb0 0x7f515c162d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f515aa00700 1 -- 172.21.15.49:0/3646657511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5144009370 con 0x7f515c0a9590 2024-01-22T05:19:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f515be00700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f515c0be900 0x7f515c1634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f515b400700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f515c067eb0 0x7f515c162d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:05.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f515aa00700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515c0a9590 0x7f515c165100 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7f515c05f3b0 tx=0x7f5144017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f5152a00700 1 -- 172.21.15.49:0/3646657511 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514400b8d0 con 0x7f515c0a9590 2024-01-22T05:19:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f5152a00700 1 -- 172.21.15.49:0/3646657511 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514400ba30 con 0x7f515c0a9590 2024-01-22T05:19:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f5162600700 1 -- 172.21.15.49:0/3646657511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515c0ac0b0 con 0x7f515c0a9590 2024-01-22T05:19:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f5152a00700 1 -- 172.21.15.49:0/3646657511 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514401c630 con 0x7f515c0a9590 2024-01-22T05:19:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.173+0000 7f5162600700 1 -- 172.21.15.49:0/3646657511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515c0ac670 con 0x7f515c0a9590 2024-01-22T05:19:05.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.177+0000 7f5162600700 1 -- 172.21.15.49:0/3646657511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515c0ac890 con 0x7f515c0a9590 2024-01-22T05:19:05.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.177+0000 7f5152a00700 1 -- 172.21.15.49:0/3646657511 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f514401ca20 con 0x7f515c0a9590 2024-01-22T05:19:05.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.177+0000 7f5152a00700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f513405a510 0x7f513405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.177+0000 7f5152a00700 1 -- 172.21.15.49:0/3646657511 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f5144075e20 con 0x7f515c0a9590 2024-01-22T05:19:05.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.177+0000 7f515b400700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f513405a510 0x7f513405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.181+0000 7f515b400700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f513405a510 0x7f513405c9d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f514c001730 tx=0x7f514c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:05.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.185+0000 7f5152a00700 1 -- 172.21.15.49:0/3646657511 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f51440497f0 con 0x7f515c0a9590 2024-01-22T05:19:05.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.357+0000 7f5162600700 1 -- 172.21.15.49:0/3646657511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f515c0687d0 con 0x7f515c0a9590 2024-01-22T05:19:05.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.357+0000 7f5152a00700 1 -- 172.21.15.49:0/3646657511 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v180) v1 ==== 92+0+10 (secure 0 0 0) 0x7f514404ce10 con 0x7f515c0a9590 2024-01-22T05:19:05.356 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:19:05.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.361+0000 7f5162600700 1 -- 172.21.15.49:0/3646657511 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f513405a510 msgr2=0x7f513405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.361+0000 7f5162600700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f513405a510 0x7f513405c9d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f514c001730 tx=0x7f514c009040).stop 2024-01-22T05:19:05.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.361+0000 7f5162600700 1 -- 172.21.15.49:0/3646657511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515c0a9590 msgr2=0x7f515c165100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.361+0000 7f5162600700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515c0a9590 0x7f515c165100 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7f515c05f3b0 tx=0x7f5144017000).stop 2024-01-22T05:19:05.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.361+0000 7f5162600700 1 -- 172.21.15.49:0/3646657511 shutdown_connections 2024-01-22T05:19:05.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.361+0000 7f5162600700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f513405a510 0x7f513405c9d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.361+0000 7f5162600700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f515c0be900 0x7f515c1634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.361+0000 7f5162600700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f515c0a9590 0x7f515c165100 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.361+0000 7f5162600700 1 --2- 172.21.15.49:0/3646657511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f515c067eb0 0x7f515c162d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.361+0000 7f5162600700 1 -- 172.21.15.49:0/3646657511 >> 172.21.15.49:0/3646657511 conn(0x7f515c064ee0 msgr2=0x7f515c0aabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:05.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.361+0000 7f5162600700 1 -- 172.21.15.49:0/3646657511 shutdown_connections 2024-01-22T05:19:05.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.361+0000 7f5162600700 1 -- 172.21.15.49:0/3646657511 wait complete. 2024-01-22T05:19:05.383 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:19:05.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.549+0000 7f22cc800700 1 Processor -- start 2024-01-22T05:19:05.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.549+0000 7f22cc800700 1 -- start start 2024-01-22T05:19:05.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22cc800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c4157ed0 0x7f22c415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22cc800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f22c415c140 0x7f22c4063350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22cc800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c415c5f0 con 0x7f22c41582b0 2024-01-22T05:19:05.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22cc800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c40c4fb0 con 0x7f22c415c140 2024-01-22T05:19:05.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22cc800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c40be810 con 0x7f22c4157ed0 2024-01-22T05:19:05.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22cb200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f22c415c140 0x7f22c4063350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22c9e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c4157ed0 0x7f22c415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22cb200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f22c415c140 0x7f22c4063350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47770/0 (socket says 172.21.15.49:47770) 2024-01-22T05:19:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22cb200700 1 -- 172.21.15.49:0/709402658 learned_addr learned my addr 172.21.15.49:0/709402658 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22c9e00700 1 -- 172.21.15.49:0/709402658 >> v2:172.21.15.49:3300/0 conn(0x7f22c415c140 msgr2=0x7f22c4063350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22c9e00700 1 --2- 172.21.15.49:0/709402658 >> v2:172.21.15.49:3300/0 conn(0x7f22c415c140 0x7f22c4063350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22c9e00700 1 -- 172.21.15.49:0/709402658 >> v1:172.21.15.49:6789/0 conn(0x7f22c41582b0 legacy=0x7f22c4062c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22c9e00700 1 -- 172.21.15.49:0/709402658 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c40beca0 con 0x7f22c4157ed0 2024-01-22T05:19:05.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22c9e00700 1 --2- 172.21.15.49:0/709402658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c4157ed0 0x7f22c415bc50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f22b4009760 tx=0x7f22b4009060).ready entity=mon.2 client_cookie=f621d61af65b8369 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:05.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22c8a00700 1 -- 172.21.15.49:0/709402658 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b400f510 con 0x7f22c4157ed0 2024-01-22T05:19:05.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22c8a00700 1 -- 172.21.15.49:0/709402658 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b400f670 con 0x7f22c4157ed0 2024-01-22T05:19:05.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.553+0000 7f22c8a00700 1 -- 172.21.15.49:0/709402658 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b400f9f0 con 0x7f22c4157ed0 2024-01-22T05:19:05.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.557+0000 7f22cc800700 1 -- 172.21.15.49:0/709402658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c4157ed0 msgr2=0x7f22c415bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.557+0000 7f22cc800700 1 --2- 172.21.15.49:0/709402658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c4157ed0 0x7f22c415bc50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f22b4009760 tx=0x7f22b4009060).stop 2024-01-22T05:19:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.557+0000 7f22cc800700 1 -- 172.21.15.49:0/709402658 shutdown_connections 2024-01-22T05:19:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.557+0000 7f22cc800700 1 --2- 172.21.15.49:0/709402658 >> v2:172.21.15.49:3300/0 conn(0x7f22c415c140 0x7f22c4063350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.557+0000 7f22cc800700 1 --2- 172.21.15.49:0/709402658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c4157ed0 0x7f22c415bc50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.557+0000 7f22cc800700 1 -- 172.21.15.49:0/709402658 >> 172.21.15.49:0/709402658 conn(0x7f22c4064080 msgr2=0x7f22c4064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:05.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.557+0000 7f22cc800700 1 -- 172.21.15.49:0/709402658 shutdown_connections 2024-01-22T05:19:05.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.557+0000 7f22cc800700 1 -- 172.21.15.49:0/709402658 wait complete. 2024-01-22T05:19:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.557+0000 7f22cc800700 1 Processor -- start 2024-01-22T05:19:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22cc800700 1 -- start start 2024-01-22T05:19:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22cc800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22c4157ed0 0x7f22c40bff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22cc800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c41582b0 0x7f22c40c2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22cc800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c415c140 0x7f22c40c2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22cc800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c40c2af0 con 0x7f22c41582b0 2024-01-22T05:19:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22cc800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c40c2dd0 con 0x7f22c4157ed0 2024-01-22T05:19:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22cc800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c40c30b0 con 0x7f22c415c140 2024-01-22T05:19:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22c9400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c41582b0 0x7f22c40c2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22c9400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c41582b0 0x7f22c40c2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47774/0 (socket says 172.21.15.49:47774) 2024-01-22T05:19:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22c9400700 1 -- 172.21.15.49:0/924429513 learned_addr learned my addr 172.21.15.49:0/924429513 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22c9e00700 1 --2- 172.21.15.49:0/924429513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22c4157ed0 0x7f22c40bff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22cb200700 1 --2- 172.21.15.49:0/924429513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c415c140 0x7f22c40c2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22c9400700 1 -- 172.21.15.49:0/924429513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c415c140 msgr2=0x7f22c40c2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22c9400700 1 --2- 172.21.15.49:0/924429513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c415c140 0x7f22c40c2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22c9400700 1 -- 172.21.15.49:0/924429513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22c4157ed0 msgr2=0x7f22c40bff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22c9400700 1 --2- 172.21.15.49:0/924429513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22c4157ed0 0x7f22c40bff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.561+0000 7f22c9400700 1 -- 172.21.15.49:0/924429513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b40092a0 con 0x7f22c41582b0 2024-01-22T05:19:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.565+0000 7f22c9400700 1 --2- 172.21.15.49:0/924429513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c41582b0 0x7f22c40c2060 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7f22ac00c4c0 tx=0x7f22ac007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.565+0000 7f22c1600700 1 -- 172.21.15.49:0/924429513 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00ce10 con 0x7f22c41582b0 2024-01-22T05:19:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.565+0000 7f22c1600700 1 -- 172.21.15.49:0/924429513 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac007020 con 0x7f22c41582b0 2024-01-22T05:19:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.565+0000 7f22cc800700 1 -- 172.21.15.49:0/924429513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c40c3390 con 0x7f22c41582b0 2024-01-22T05:19:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.565+0000 7f22c1600700 1 -- 172.21.15.49:0/924429513 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0073c0 con 0x7f22c41582b0 2024-01-22T05:19:05.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.565+0000 7f22cc800700 1 -- 172.21.15.49:0/924429513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c40c0690 con 0x7f22c41582b0 2024-01-22T05:19:05.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.565+0000 7f22cc800700 1 -- 172.21.15.49:0/924429513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c40abee0 con 0x7f22c41582b0 2024-01-22T05:19:05.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.565+0000 7f22c1600700 1 -- 172.21.15.49:0/924429513 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f22ac0068b0 con 0x7f22c41582b0 2024-01-22T05:19:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.569+0000 7f22c1600700 1 --2- 172.21.15.49:0/924429513 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f229c05a540 0x7f229c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.569+0000 7f22c1600700 1 -- 172.21.15.49:0/924429513 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f22ac073740 con 0x7f22c41582b0 2024-01-22T05:19:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.569+0000 7f22c9e00700 1 --2- 172.21.15.49:0/924429513 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f229c05a540 0x7f229c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.569+0000 7f22c9e00700 1 --2- 172.21.15.49:0/924429513 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f229c05a540 0x7f229c05ca00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f22b4009fd0 tx=0x7f22b4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:05.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.577+0000 7f22c1600700 1 -- 172.21.15.49:0/924429513 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f22c40abee0 con 0x7f22c41582b0 2024-01-22T05:19:05.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.749+0000 7f22cc800700 1 -- 172.21.15.49:0/924429513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f22c415c5f0 con 0x7f22c41582b0 2024-01-22T05:19:05.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.749+0000 7f22c1600700 1 -- 172.21.15.49:0/924429513 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v180) v1 ==== 84+0+143 (secure 0 0 0) 0x7f22c415c5f0 con 0x7f22c41582b0 2024-01-22T05:19:05.748 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:05.748 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-22T05:19:05.749 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:05.749 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-01-22T05:19:05.749 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2024-01-22T05:19:05.749 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:05.749 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:05.749 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2024-01-22T05:19:05.749 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2024-01-22T05:19:05.749 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:05.749 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-22T05:19:05.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.753+0000 7f22cc800700 1 -- 172.21.15.49:0/924429513 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f229c05a540 msgr2=0x7f229c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.753+0000 7f22cc800700 1 --2- 172.21.15.49:0/924429513 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f229c05a540 0x7f229c05ca00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f22b4009fd0 tx=0x7f22b4017000).stop 2024-01-22T05:19:05.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.753+0000 7f22cc800700 1 -- 172.21.15.49:0/924429513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c41582b0 msgr2=0x7f22c40c2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.753+0000 7f22cc800700 1 --2- 172.21.15.49:0/924429513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c41582b0 0x7f22c40c2060 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7f22ac00c4c0 tx=0x7f22ac007dd0).stop 2024-01-22T05:19:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.753+0000 7f22cc800700 1 -- 172.21.15.49:0/924429513 shutdown_connections 2024-01-22T05:19:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.753+0000 7f22cc800700 1 --2- 172.21.15.49:0/924429513 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f229c05a540 0x7f229c05ca00 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.753+0000 7f22cc800700 1 --2- 172.21.15.49:0/924429513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c415c140 0x7f22c40c2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.753+0000 7f22cc800700 1 --2- 172.21.15.49:0/924429513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22c41582b0 0x7f22c40c2060 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.753+0000 7f22cc800700 1 --2- 172.21.15.49:0/924429513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22c4157ed0 0x7f22c40bff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.753+0000 7f22cc800700 1 -- 172.21.15.49:0/924429513 >> 172.21.15.49:0/924429513 conn(0x7f22c4064080 msgr2=0x7f22c415a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.753+0000 7f22cc800700 1 -- 172.21.15.49:0/924429513 shutdown_connections 2024-01-22T05:19:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.753+0000 7f22cc800700 1 -- 172.21.15.49:0/924429513 wait complete. 2024-01-22T05:19:05.774 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:19:05.775 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:19:05.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.949+0000 7febd3600700 1 Processor -- start 2024-01-22T05:19:05.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.949+0000 7febd3600700 1 -- start start 2024-01-22T05:19:05.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.953+0000 7febd3600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc0ac3b0 0x7febcc159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.953+0000 7febd3600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7febcc066690 0x7febcc066af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.953+0000 7febd3600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febcc0a7cb0 con 0x7febcc067a90 2024-01-22T05:19:05.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.953+0000 7febd3600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febcc0a8b10 con 0x7febcc066690 2024-01-22T05:19:05.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.953+0000 7febd3600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc0a7f00 con 0x7febcc0ac3b0 2024-01-22T05:19:05.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.953+0000 7febd0c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc0ac3b0 0x7febcc159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.953+0000 7febcbe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7febcc066690 0x7febcc066af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.953+0000 7febd0c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc0ac3b0 0x7febcc159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:35584/0 (socket says 172.21.15.49:35584) 2024-01-22T05:19:05.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.953+0000 7febd0c00700 1 -- 172.21.15.49:0/2107917503 learned_addr learned my addr 172.21.15.49:0/2107917503 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:05.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.957+0000 7febd0c00700 1 -- 172.21.15.49:0/2107917503 >> v2:172.21.15.49:3300/0 conn(0x7febcc066690 msgr2=0x7febcc066af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:05.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.957+0000 7febd0c00700 1 --2- 172.21.15.49:0/2107917503 >> v2:172.21.15.49:3300/0 conn(0x7febcc066690 0x7febcc066af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.957+0000 7febd0c00700 1 -- 172.21.15.49:0/2107917503 >> v1:172.21.15.110:6789/0 conn(0x7febcc067a90 legacy=0x7febcc067f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.957+0000 7febd0c00700 1 -- 172.21.15.49:0/2107917503 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc0a81e0 con 0x7febcc0ac3b0 2024-01-22T05:19:05.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.957+0000 7febd0c00700 1 --2- 172.21.15.49:0/2107917503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc0ac3b0 0x7febcc159000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7febbc006fd0 tx=0x7febbc0090f0).ready entity=mon.2 client_cookie=62545815957623e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:05.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.957+0000 7febcb400700 1 -- 172.21.15.49:0/2107917503 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc00b580 con 0x7febcc0ac3b0 2024-01-22T05:19:05.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.957+0000 7febcb400700 1 -- 172.21.15.49:0/2107917503 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc00b6e0 con 0x7febcc0ac3b0 2024-01-22T05:19:05.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.957+0000 7febcb400700 1 -- 172.21.15.49:0/2107917503 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc00ba60 con 0x7febcc0ac3b0 2024-01-22T05:19:05.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.957+0000 7febd3600700 1 -- 172.21.15.49:0/2107917503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc0ac3b0 msgr2=0x7febcc159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.957+0000 7febd3600700 1 --2- 172.21.15.49:0/2107917503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc0ac3b0 0x7febcc159000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7febbc006fd0 tx=0x7febbc0090f0).stop 2024-01-22T05:19:05.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.957+0000 7febd3600700 1 -- 172.21.15.49:0/2107917503 shutdown_connections 2024-01-22T05:19:05.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.957+0000 7febd3600700 1 --2- 172.21.15.49:0/2107917503 >> v2:172.21.15.49:3300/0 conn(0x7febcc066690 0x7febcc066af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.957+0000 7febd3600700 1 --2- 172.21.15.49:0/2107917503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc0ac3b0 0x7febcc159000 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.957+0000 7febd3600700 1 -- 172.21.15.49:0/2107917503 >> 172.21.15.49:0/2107917503 conn(0x7febcc0c6500 msgr2=0x7febcc0c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:05.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.961+0000 7febd3600700 1 -- 172.21.15.49:0/2107917503 shutdown_connections 2024-01-22T05:19:05.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.961+0000 7febd3600700 1 -- 172.21.15.49:0/2107917503 wait complete. 2024-01-22T05:19:05.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.961+0000 7febd3600700 1 Processor -- start 2024-01-22T05:19:05.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.965+0000 7febd3600700 1 -- start start 2024-01-22T05:19:05.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.965+0000 7febd3600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febcc066690 0x7febcc168f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.965+0000 7febd3600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc067a90 0x7febcc157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.965+0000 7febd3600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc0ac3b0 0x7febcc169580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.965+0000 7febd3600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc157b80 con 0x7febcc066690 2024-01-22T05:19:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.965+0000 7febd3600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc150bc0 con 0x7febcc0ac3b0 2024-01-22T05:19:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.965+0000 7febd3600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc16a950 con 0x7febcc067a90 2024-01-22T05:19:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.965+0000 7febd0c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febcc066690 0x7febcc168f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.965+0000 7febd0c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febcc066690 0x7febcc168f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47790/0 (socket says 172.21.15.49:47790) 2024-01-22T05:19:05.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.965+0000 7febd0c00700 1 -- 172.21.15.49:0/985290627 learned_addr learned my addr 172.21.15.49:0/985290627 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:05.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.969+0000 7febcbe00700 1 --2- 172.21.15.49:0/985290627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc067a90 0x7febcc157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.969+0000 7febd1600700 1 --2- 172.21.15.49:0/985290627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc0ac3b0 0x7febcc169580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.969+0000 7febd0c00700 1 -- 172.21.15.49:0/985290627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc067a90 msgr2=0x7febcc157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.969+0000 7febd0c00700 1 --2- 172.21.15.49:0/985290627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc067a90 0x7febcc157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.969+0000 7febd0c00700 1 -- 172.21.15.49:0/985290627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc0ac3b0 msgr2=0x7febcc169580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:05.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.969+0000 7febd0c00700 1 --2- 172.21.15.49:0/985290627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc0ac3b0 0x7febcc169580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:05.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.969+0000 7febd0c00700 1 -- 172.21.15.49:0/985290627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc009370 con 0x7febcc066690 2024-01-22T05:19:05.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.969+0000 7febd0c00700 1 --2- 172.21.15.49:0/985290627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febcc066690 0x7febcc168f80 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7febcc0a8040 tx=0x7febbc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:05.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.969+0000 7febc3e00700 1 -- 172.21.15.49:0/985290627 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc000bc0 con 0x7febcc066690 2024-01-22T05:19:05.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.969+0000 7febc3e00700 1 -- 172.21.15.49:0/985290627 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc00b850 con 0x7febcc066690 2024-01-22T05:19:05.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.969+0000 7febd3600700 1 -- 172.21.15.49:0/985290627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febcc169a70 con 0x7febcc066690 2024-01-22T05:19:05.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.969+0000 7febc3e00700 1 -- 172.21.15.49:0/985290627 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc000d20 con 0x7febcc066690 2024-01-22T05:19:05.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.969+0000 7febd3600700 1 -- 172.21.15.49:0/985290627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febcc16a020 con 0x7febcc066690 2024-01-22T05:19:05.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.973+0000 7febd3600700 1 -- 172.21.15.49:0/985290627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febcc0c0ba0 con 0x7febcc066690 2024-01-22T05:19:05.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.973+0000 7febc3e00700 1 -- 172.21.15.49:0/985290627 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7febbc01c900 con 0x7febcc066690 2024-01-22T05:19:05.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.977+0000 7febc3e00700 1 --2- 172.21.15.49:0/985290627 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feba405a510 0x7feba405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:05.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.977+0000 7febc3e00700 1 -- 172.21.15.49:0/985290627 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5622+0+0 (secure 0 0 0) 0x7febbc075c50 con 0x7febcc066690 2024-01-22T05:19:05.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.977+0000 7febcbe00700 1 --2- 172.21.15.49:0/985290627 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feba405a510 0x7feba405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:05.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.977+0000 7febcbe00700 1 --2- 172.21.15.49:0/985290627 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feba405a510 0x7feba405c9d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7febcc068e50 tx=0x7febb4009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:05.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:05.981+0000 7febc3e00700 1 -- 172.21.15.49:0/985290627 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7febbc049620 con 0x7febcc066690 2024-01-22T05:19:06.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.149+0000 7febd3600700 1 -- 172.21.15.49:0/985290627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7febcc0a84c0 con 0x7febcc066690 2024-01-22T05:19:06.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.613+0000 7febc3e00700 1 -- 172.21.15.49:0/985290627 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v181) v1 ==== 152+0+0 (secure 0 0 0) 0x7febbc020070 con 0x7febcc066690 2024-01-22T05:19:06.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.621+0000 7febd3600700 1 -- 172.21.15.49:0/985290627 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feba405a510 msgr2=0x7feba405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:06.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.621+0000 7febd3600700 1 --2- 172.21.15.49:0/985290627 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feba405a510 0x7feba405c9d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7febcc068e50 tx=0x7febb4009060).stop 2024-01-22T05:19:06.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.621+0000 7febd3600700 1 -- 172.21.15.49:0/985290627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febcc066690 msgr2=0x7febcc168f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:06.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.621+0000 7febd3600700 1 --2- 172.21.15.49:0/985290627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febcc066690 0x7febcc168f80 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7febcc0a8040 tx=0x7febbc017000).stop 2024-01-22T05:19:06.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.625+0000 7febd3600700 1 -- 172.21.15.49:0/985290627 shutdown_connections 2024-01-22T05:19:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.625+0000 7febd3600700 1 --2- 172.21.15.49:0/985290627 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feba405a510 0x7feba405c9d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.625+0000 7febd3600700 1 --2- 172.21.15.49:0/985290627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc0ac3b0 0x7febcc169580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.625+0000 7febd3600700 1 --2- 172.21.15.49:0/985290627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc067a90 0x7febcc157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.625+0000 7febd3600700 1 --2- 172.21.15.49:0/985290627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febcc066690 0x7febcc168f80 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.625+0000 7febd3600700 1 -- 172.21.15.49:0/985290627 >> 172.21.15.49:0/985290627 conn(0x7febcc0c6500 msgr2=0x7febcc0c0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:06.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.629+0000 7febd3600700 1 -- 172.21.15.49:0/985290627 shutdown_connections 2024-01-22T05:19:06.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.629+0000 7febd3600700 1 -- 172.21.15.49:0/985290627 wait complete. 2024-01-22T05:19:06.632 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-01-22T05:19:06.650 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:19:06.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.829+0000 7f409fe00700 1 Processor -- start 2024-01-22T05:19:06.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.829+0000 7f409fe00700 1 -- start start 2024-01-22T05:19:06.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.833+0000 7f409fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40a0067a90 0x7f40a00a7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:06.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.833+0000 7f409fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40a00bd8f0 0x7f40a00bdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:06.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.833+0000 7f409fe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a0156480 con 0x7f40a0155450 2024-01-22T05:19:06.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.833+0000 7f409fe00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a0068e60 con 0x7f40a00bd8f0 2024-01-22T05:19:06.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.833+0000 7f409fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a0068250 con 0x7f40a0067a90 2024-01-22T05:19:06.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.833+0000 7f409f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40a00bd8f0 0x7f40a00bdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:06.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.833+0000 7f409ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40a0067a90 0x7f40a00a7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:06.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.833+0000 7f409f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40a00bd8f0 0x7f40a00bdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47798/0 (socket says 172.21.15.49:47798) 2024-01-22T05:19:06.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.833+0000 7f409f400700 1 -- 172.21.15.49:0/2140517802 learned_addr learned my addr 172.21.15.49:0/2140517802 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:06.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.833+0000 7f409f400700 1 -- 172.21.15.49:0/2140517802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40a0067a90 msgr2=0x7f40a00a7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:06.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.833+0000 7f409f400700 1 --2- 172.21.15.49:0/2140517802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40a0067a90 0x7f40a00a7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:06.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.833+0000 7f409f400700 1 -- 172.21.15.49:0/2140517802 >> v1:172.21.15.110:6789/0 conn(0x7f40a0155450 legacy=0x7f40a01558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:06.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.833+0000 7f409f400700 1 -- 172.21.15.49:0/2140517802 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a0068530 con 0x7f40a00bd8f0 2024-01-22T05:19:06.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.833+0000 7f409ea00700 1 --2- 172.21.15.49:0/2140517802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40a0067a90 0x7f40a00a7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:06.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.833+0000 7f409f400700 1 --2- 172.21.15.49:0/2140517802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40a00bd8f0 0x7f40a00bdda0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7f4098009f20 tx=0x7f4098009840).ready entity=mon.0 client_cookie=4d9e2118daa6b271 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:06.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.837+0000 7f409d600700 1 -- 172.21.15.49:0/2140517802 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409800e070 con 0x7f40a00bd8f0 2024-01-22T05:19:06.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.837+0000 7f409d600700 1 -- 172.21.15.49:0/2140517802 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409800b9d0 con 0x7f40a00bd8f0 2024-01-22T05:19:06.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.837+0000 7f409d600700 1 -- 172.21.15.49:0/2140517802 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409800bd50 con 0x7f40a00bd8f0 2024-01-22T05:19:06.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.837+0000 7f409fe00700 1 -- 172.21.15.49:0/2140517802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40a00bd8f0 msgr2=0x7f40a00bdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:06.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.837+0000 7f409fe00700 1 --2- 172.21.15.49:0/2140517802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40a00bd8f0 0x7f40a00bdda0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7f4098009f20 tx=0x7f4098009840).stop 2024-01-22T05:19:06.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.837+0000 7f409fe00700 1 -- 172.21.15.49:0/2140517802 shutdown_connections 2024-01-22T05:19:06.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.837+0000 7f409fe00700 1 --2- 172.21.15.49:0/2140517802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40a00bd8f0 0x7f40a00bdda0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:06.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.837+0000 7f409fe00700 1 --2- 172.21.15.49:0/2140517802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40a0067a90 0x7f40a00a7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:06.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.837+0000 7f409fe00700 1 -- 172.21.15.49:0/2140517802 >> 172.21.15.49:0/2140517802 conn(0x7f40a00c8770 msgr2=0x7f40a00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:06.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.837+0000 7f409fe00700 1 -- 172.21.15.49:0/2140517802 shutdown_connections 2024-01-22T05:19:06.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.837+0000 7f409fe00700 1 -- 172.21.15.49:0/2140517802 wait complete. 2024-01-22T05:19:06.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.841+0000 7f409fe00700 1 Processor -- start 2024-01-22T05:19:06.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.841+0000 7f409fe00700 1 -- start start 2024-01-22T05:19:06.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.841+0000 7f409fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40a0067a90 0x7f40a0141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:06.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.841+0000 7f409fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40a00bd8f0 0x7f40a00bdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:06.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.841+0000 7f409fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40a0155450 0x7f40a00be1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:06.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.841+0000 7f409fe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a00be6b0 con 0x7f40a0155450 2024-01-22T05:19:06.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.841+0000 7f409fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a0162d90 con 0x7f40a0067a90 2024-01-22T05:19:06.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.841+0000 7f409fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a0141760 con 0x7f40a00bd8f0 2024-01-22T05:19:06.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.841+0000 7f409f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40a0155450 0x7f40a00be1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:06.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.845+0000 7f409ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40a0067a90 0x7f40a0141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:06.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.845+0000 7f409f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40a0155450 0x7f40a00be1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47810/0 (socket says 172.21.15.49:47810) 2024-01-22T05:19:06.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.845+0000 7f409f400700 1 -- 172.21.15.49:0/2432574559 learned_addr learned my addr 172.21.15.49:0/2432574559 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:06.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.845+0000 7f409e000700 1 --2- 172.21.15.49:0/2432574559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40a00bd8f0 0x7f40a00bdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:06.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.845+0000 7f409ea00700 1 -- 172.21.15.49:0/2432574559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40a00bd8f0 msgr2=0x7f40a00bdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:06.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.845+0000 7f409ea00700 1 --2- 172.21.15.49:0/2432574559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40a00bd8f0 0x7f40a00bdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:06.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.845+0000 7f409ea00700 1 -- 172.21.15.49:0/2432574559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40a0155450 msgr2=0x7f40a00be1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:06.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.845+0000 7f409ea00700 1 --2- 172.21.15.49:0/2432574559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40a0155450 0x7f40a00be1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:06.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.845+0000 7f409ea00700 1 -- 172.21.15.49:0/2432574559 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40900092a0 con 0x7f40a0067a90 2024-01-22T05:19:06.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.845+0000 7f409ea00700 1 --2- 172.21.15.49:0/2432574559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40a0067a90 0x7f40a0141270 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f409000e880 tx=0x7f4090009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:06.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.845+0000 7f4096000700 1 -- 172.21.15.49:0/2432574559 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090012600 con 0x7f40a0067a90 2024-01-22T05:19:06.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.845+0000 7f4096000700 1 -- 172.21.15.49:0/2432574559 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4090012760 con 0x7f40a0067a90 2024-01-22T05:19:06.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.845+0000 7f4096000700 1 -- 172.21.15.49:0/2432574559 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090012ae0 con 0x7f40a0067a90 2024-01-22T05:19:06.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.845+0000 7f409fe00700 1 -- 172.21.15.49:0/2432574559 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4098009ae0 con 0x7f40a0067a90 2024-01-22T05:19:06.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.845+0000 7f409fe00700 1 -- 172.21.15.49:0/2432574559 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a0162740 con 0x7f40a0067a90 2024-01-22T05:19:06.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.849+0000 7f409fe00700 1 -- 172.21.15.49:0/2432574559 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a00665a0 con 0x7f40a0067a90 2024-01-22T05:19:06.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.849+0000 7f4096000700 1 -- 172.21.15.49:0/2432574559 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f409001b400 con 0x7f40a0067a90 2024-01-22T05:19:06.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.849+0000 7f4096000700 1 --2- 172.21.15.49:0/2432574559 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f407805a510 0x7f407805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:06.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.849+0000 7f4096000700 1 -- 172.21.15.49:0/2432574559 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5992+0+0 (secure 0 0 0) 0x7f4090074ad0 con 0x7f40a0067a90 2024-01-22T05:19:06.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.849+0000 7f409e000700 1 --2- 172.21.15.49:0/2432574559 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f407805a510 0x7f407805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:06.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.849+0000 7f409e000700 1 --2- 172.21.15.49:0/2432574559 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f407805a510 0x7f407805c9d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f40a0154090 tx=0x7f4088007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:06.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:06.861+0000 7f4096000700 1 -- 172.21.15.49:0/2432574559 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f40900482d0 con 0x7f40a0067a90 2024-01-22T05:19:07.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.029+0000 7f409fe00700 1 -- 172.21.15.49:0/2432574559 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f40a0046800 con 0x7f40a0067a90 2024-01-22T05:19:07.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.633+0000 7f4096000700 1 -- 172.21.15.49:0/2432574559 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v182) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4090016070 con 0x7f40a0067a90 2024-01-22T05:19:07.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.637+0000 7f409fe00700 1 -- 172.21.15.49:0/2432574559 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f407805a510 msgr2=0x7f407805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:07.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.637+0000 7f409fe00700 1 --2- 172.21.15.49:0/2432574559 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f407805a510 0x7f407805c9d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f40a0154090 tx=0x7f4088007d40).stop 2024-01-22T05:19:07.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.637+0000 7f409fe00700 1 -- 172.21.15.49:0/2432574559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40a0067a90 msgr2=0x7f40a0141270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:07.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.637+0000 7f409fe00700 1 --2- 172.21.15.49:0/2432574559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40a0067a90 0x7f40a0141270 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f409000e880 tx=0x7f4090009060).stop 2024-01-22T05:19:07.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.645+0000 7f409fe00700 1 -- 172.21.15.49:0/2432574559 shutdown_connections 2024-01-22T05:19:07.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.645+0000 7f409fe00700 1 --2- 172.21.15.49:0/2432574559 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f407805a510 0x7f407805c9d0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:07.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.645+0000 7f409fe00700 1 --2- 172.21.15.49:0/2432574559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40a0155450 0x7f40a00be1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:07.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.645+0000 7f409fe00700 1 --2- 172.21.15.49:0/2432574559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40a00bd8f0 0x7f40a00bdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:07.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.645+0000 7f409fe00700 1 --2- 172.21.15.49:0/2432574559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40a0067a90 0x7f40a0141270 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:07.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.645+0000 7f409fe00700 1 -- 172.21.15.49:0/2432574559 >> 172.21.15.49:0/2432574559 conn(0x7f40a00c8770 msgr2=0x7f40a00c7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:07.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.645+0000 7f409fe00700 1 -- 172.21.15.49:0/2432574559 shutdown_connections 2024-01-22T05:19:07.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.645+0000 7f409fe00700 1 -- 172.21.15.49:0/2432574559 wait complete. 2024-01-22T05:19:07.656 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-01-22T05:19:07.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:19:07.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.841+0000 7f6242400700 1 Processor -- start 2024-01-22T05:19:07.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.841+0000 7f6242400700 1 -- start start 2024-01-22T05:19:07.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.845+0000 7f6242400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f623c063080 0x7f623c067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:07.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.845+0000 7f6242400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f623c0a7dd0 0x7f623c067f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:07.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.845+0000 7f6242400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623c0beb80 con 0x7f623c0a79f0 2024-01-22T05:19:07.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.845+0000 7f6242400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623c1583e0 con 0x7f623c0a7dd0 2024-01-22T05:19:07.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.845+0000 7f6242400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623c0bf3e0 con 0x7f623c063080 2024-01-22T05:19:07.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.845+0000 7f6241000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f623c0a79f0 0x7f623c062970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58288/0 (socket says 172.21.15.49:58288) 2024-01-22T05:19:07.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f6241000700 1 -- 172.21.15.49:0/3664463595 learned_addr learned my addr 172.21.15.49:0/3664463595 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:07.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f6241a00700 1 --2- 172.21.15.49:0/3664463595 >> v2:172.21.15.49:3300/0 conn(0x7f623c0a7dd0 0x7f623c067f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:07.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f623be00700 1 --2- 172.21.15.49:0/3664463595 >> v2:172.21.15.110:3300/0 conn(0x7f623c063080 0x7f623c067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:07.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f6241a00700 1 -- 172.21.15.49:0/3664463595 >> v2:172.21.15.110:3300/0 conn(0x7f623c063080 msgr2=0x7f623c067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:07.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f6241a00700 1 --2- 172.21.15.49:0/3664463595 >> v2:172.21.15.110:3300/0 conn(0x7f623c063080 0x7f623c067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:07.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f6241a00700 1 -- 172.21.15.49:0/3664463595 >> v1:172.21.15.49:6789/0 conn(0x7f623c0a79f0 legacy=0x7f623c062970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:07.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f6241a00700 1 -- 172.21.15.49:0/3664463595 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c0bdf70 con 0x7f623c0a7dd0 2024-01-22T05:19:07.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f6241a00700 1 --2- 172.21.15.49:0/3664463595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0a7dd0 0x7f623c067f80 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7f623c0664d0 tx=0x7f6234009780).ready entity=mon.0 client_cookie=73a0af14a60bd846 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:07.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f623b400700 1 -- 172.21.15.49:0/3664463595 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623400e070 con 0x7f623c0a7dd0 2024-01-22T05:19:07.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f623b400700 1 -- 172.21.15.49:0/3664463595 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623400bb60 con 0x7f623c0a7dd0 2024-01-22T05:19:07.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f623b400700 1 -- 172.21.15.49:0/3664463595 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6234012410 con 0x7f623c0a7dd0 2024-01-22T05:19:07.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f6242400700 1 -- 172.21.15.49:0/3664463595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0a7dd0 msgr2=0x7f623c067f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:07.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f6242400700 1 --2- 172.21.15.49:0/3664463595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0a7dd0 0x7f623c067f80 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7f623c0664d0 tx=0x7f6234009780).stop 2024-01-22T05:19:07.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f6242400700 1 -- 172.21.15.49:0/3664463595 shutdown_connections 2024-01-22T05:19:07.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f6242400700 1 --2- 172.21.15.49:0/3664463595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0a7dd0 0x7f623c067f80 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:07.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f6242400700 1 --2- 172.21.15.49:0/3664463595 >> v2:172.21.15.110:3300/0 conn(0x7f623c063080 0x7f623c067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:07.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f6242400700 1 -- 172.21.15.49:0/3664463595 >> 172.21.15.49:0/3664463595 conn(0x7f623c0c8770 msgr2=0x7f623c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:07.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f6242400700 1 -- 172.21.15.49:0/3664463595 shutdown_connections 2024-01-22T05:19:07.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.849+0000 7f6242400700 1 -- 172.21.15.49:0/3664463595 wait complete. 2024-01-22T05:19:07.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.853+0000 7f6242400700 1 Processor -- start 2024-01-22T05:19:07.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.853+0000 7f6242400700 1 -- start start 2024-01-22T05:19:07.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.853+0000 7f6242400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f623c063080 0x7f623c14c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:07.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.853+0000 7f6242400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0a79f0 0x7f623c168360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:07.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.853+0000 7f6242400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f623c0a7dd0 0x7f623c0c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.853+0000 7f6242400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c1695d0 con 0x7f623c0a79f0 2024-01-22T05:19:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.853+0000 7f6242400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c168cd0 con 0x7f623c0a7dd0 2024-01-22T05:19:07.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.853+0000 7f6242400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623c168fb0 con 0x7f623c063080 2024-01-22T05:19:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f623be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0a79f0 0x7f623c168360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f623be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0a79f0 0x7f623c168360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47820/0 (socket says 172.21.15.49:47820) 2024-01-22T05:19:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f623be00700 1 -- 172.21.15.49:0/129463645 learned_addr learned my addr 172.21.15.49:0/129463645 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f6241a00700 1 --2- 172.21.15.49:0/129463645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f623c0a7dd0 0x7f623c0c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f6241000700 1 --2- 172.21.15.49:0/129463645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f623c063080 0x7f623c14c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f623be00700 1 -- 172.21.15.49:0/129463645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f623c063080 msgr2=0x7f623c14c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f623be00700 1 --2- 172.21.15.49:0/129463645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f623c063080 0x7f623c14c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f623be00700 1 -- 172.21.15.49:0/129463645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f623c0a7dd0 msgr2=0x7f623c0c32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f623be00700 1 --2- 172.21.15.49:0/129463645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f623c0a7dd0 0x7f623c0c32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:07.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f623be00700 1 -- 172.21.15.49:0/129463645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6234009a20 con 0x7f623c0a79f0 2024-01-22T05:19:07.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f6241a00700 1 --2- 172.21.15.49:0/129463645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f623c0a7dd0 0x7f623c0c32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:07.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f623be00700 1 --2- 172.21.15.49:0/129463645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0a79f0 0x7f623c168360 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f622400e8d0 tx=0x7f6224009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:07.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f6233e00700 1 -- 172.21.15.49:0/129463645 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622400c640 con 0x7f623c0a79f0 2024-01-22T05:19:07.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f6233e00700 1 -- 172.21.15.49:0/129463645 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622400c7a0 con 0x7f623c0a79f0 2024-01-22T05:19:07.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f6233e00700 1 -- 172.21.15.49:0/129463645 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622400cb20 con 0x7f623c0a79f0 2024-01-22T05:19:07.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f6242400700 1 -- 172.21.15.49:0/129463645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623c169870 con 0x7f623c0a79f0 2024-01-22T05:19:07.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f6242400700 1 -- 172.21.15.49:0/129463645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623c14cea0 con 0x7f623c0a79f0 2024-01-22T05:19:07.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.857+0000 7f6242400700 1 -- 172.21.15.49:0/129463645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623c0665a0 con 0x7f623c0a79f0 2024-01-22T05:19:07.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.861+0000 7f6233e00700 1 -- 172.21.15.49:0/129463645 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f622401b400 con 0x7f623c0a79f0 2024-01-22T05:19:07.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.861+0000 7f6233e00700 1 --2- 172.21.15.49:0/129463645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f621405a510 0x7f621405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:07.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.861+0000 7f6233e00700 1 -- 172.21.15.49:0/129463645 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f6224074d80 con 0x7f623c0a79f0 2024-01-22T05:19:07.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.861+0000 7f6241000700 1 --2- 172.21.15.49:0/129463645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f621405a510 0x7f621405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:07.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.861+0000 7f6241000700 1 --2- 172.21.15.49:0/129463645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f621405a510 0x7f621405c9d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f622c007fd0 tx=0x7f622c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:07.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:07.869+0000 7f6233e00700 1 -- 172.21.15.49:0/129463645 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6224048340 con 0x7f623c0a79f0 2024-01-22T05:19:08.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.065+0000 7f6242400700 1 -- 172.21.15.49:0/129463645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f623c0be250 con 0x7f623c0a79f0 2024-01-22T05:19:08.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.081+0000 7f6233e00700 1 -- 172.21.15.49:0/129463645 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v138) v1 ==== 174+0+0 (secure 0 0 0) 0x7f622404b960 con 0x7f623c0a79f0 2024-01-22T05:19:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.093+0000 7f6242400700 1 -- 172.21.15.49:0/129463645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f621405a510 msgr2=0x7f621405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.093+0000 7f6242400700 1 --2- 172.21.15.49:0/129463645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f621405a510 0x7f621405c9d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f622c007fd0 tx=0x7f622c009040).stop 2024-01-22T05:19:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.093+0000 7f6242400700 1 -- 172.21.15.49:0/129463645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0a79f0 msgr2=0x7f623c168360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.093+0000 7f6242400700 1 --2- 172.21.15.49:0/129463645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0a79f0 0x7f623c168360 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f622400e8d0 tx=0x7f6224009060).stop 2024-01-22T05:19:08.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.093+0000 7f6242400700 1 -- 172.21.15.49:0/129463645 shutdown_connections 2024-01-22T05:19:08.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.093+0000 7f6242400700 1 --2- 172.21.15.49:0/129463645 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f621405a510 0x7f621405c9d0 secure :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0x7f622c007fd0 tx=0x7f622c009040).stop 2024-01-22T05:19:08.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.093+0000 7f6242400700 1 --2- 172.21.15.49:0/129463645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f623c0a7dd0 0x7f623c0c32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.093+0000 7f6242400700 1 --2- 172.21.15.49:0/129463645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0a79f0 0x7f623c168360 secure :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 rx=0x7f622400e8d0 tx=0x7f6224009060).stop 2024-01-22T05:19:08.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.093+0000 7f6242400700 1 --2- 172.21.15.49:0/129463645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f623c063080 0x7f623c14c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.093+0000 7f6242400700 1 -- 172.21.15.49:0/129463645 >> 172.21.15.49:0/129463645 conn(0x7f623c0c8770 msgr2=0x7f623c0c6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:08.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.101+0000 7f6242400700 1 -- 172.21.15.49:0/129463645 shutdown_connections 2024-01-22T05:19:08.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.101+0000 7f6242400700 1 -- 172.21.15.49:0/129463645 wait complete. 2024-01-22T05:19:08.113 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 26 and data pool 27 2024-01-22T05:19:08.131 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:19:08.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.297+0000 7fda50400700 1 Processor -- start 2024-01-22T05:19:08.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.297+0000 7fda50400700 1 -- start start 2024-01-22T05:19:08.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.297+0000 7fda50400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fda480ab890 0x7fda480abd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:08.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.297+0000 7fda50400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fda48065550 0x7fda48065980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:08.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.297+0000 7fda50400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda48068a60 con 0x7fda480bcfa0 2024-01-22T05:19:08.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda50400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda480bb790 con 0x7fda48065550 2024-01-22T05:19:08.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda50400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda480bd380 con 0x7fda480ab890 2024-01-22T05:19:08.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda4da00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fda480bcfa0 0x7fda48151700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58304/0 (socket says 172.21.15.49:58304) 2024-01-22T05:19:08.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda4da00700 1 -- 172.21.15.49:0/427545748 learned_addr learned my addr 172.21.15.49:0/427545748 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:08.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda4e400700 1 --2- 172.21.15.49:0/427545748 >> v2:172.21.15.49:3300/0 conn(0x7fda48065550 0x7fda48065980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:08.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda4d000700 1 --2- 172.21.15.49:0/427545748 >> v2:172.21.15.110:3300/0 conn(0x7fda480ab890 0x7fda480abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:08.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda4e400700 1 -- 172.21.15.49:0/427545748 >> v2:172.21.15.110:3300/0 conn(0x7fda480ab890 msgr2=0x7fda480abd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:08.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda4e400700 1 --2- 172.21.15.49:0/427545748 >> v2:172.21.15.110:3300/0 conn(0x7fda480ab890 0x7fda480abd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda4e400700 1 -- 172.21.15.49:0/427545748 >> v1:172.21.15.49:6789/0 conn(0x7fda480bcfa0 legacy=0x7fda48151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:08.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda4e400700 1 -- 172.21.15.49:0/427545748 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda480ac210 con 0x7fda48065550 2024-01-22T05:19:08.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda47e00700 1 -- 172.21.15.49:0/427545748 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945528972 0 0) 0x7fda48068a60 con 0x7fda480bcfa0 2024-01-22T05:19:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda4e400700 1 --2- 172.21.15.49:0/427545748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda48065550 0x7fda48065980 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7fda480c75b0 tx=0x7fda40009780).ready entity=mon.0 client_cookie=7281ed2115e82c3d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda47e00700 1 -- 172.21.15.49:0/427545748 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4000e070 con 0x7fda48065550 2024-01-22T05:19:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda47e00700 1 -- 172.21.15.49:0/427545748 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4000bb60 con 0x7fda48065550 2024-01-22T05:19:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda47e00700 1 -- 172.21.15.49:0/427545748 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40012410 con 0x7fda48065550 2024-01-22T05:19:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda50400700 1 -- 172.21.15.49:0/427545748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda48065550 msgr2=0x7fda48065980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda50400700 1 --2- 172.21.15.49:0/427545748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda48065550 0x7fda48065980 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7fda480c75b0 tx=0x7fda40009780).stop 2024-01-22T05:19:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda50400700 1 -- 172.21.15.49:0/427545748 shutdown_connections 2024-01-22T05:19:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda50400700 1 --2- 172.21.15.49:0/427545748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda48065550 0x7fda48065980 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda50400700 1 --2- 172.21.15.49:0/427545748 >> v2:172.21.15.110:3300/0 conn(0x7fda480ab890 0x7fda480abd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.301+0000 7fda50400700 1 -- 172.21.15.49:0/427545748 >> 172.21.15.49:0/427545748 conn(0x7fda480c6540 msgr2=0x7fda480c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:08.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.305+0000 7fda50400700 1 -- 172.21.15.49:0/427545748 shutdown_connections 2024-01-22T05:19:08.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.305+0000 7fda50400700 1 -- 172.21.15.49:0/427545748 wait complete. 2024-01-22T05:19:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.305+0000 7fda50400700 1 Processor -- start 2024-01-22T05:19:08.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.305+0000 7fda50400700 1 -- start start 2024-01-22T05:19:08.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda50400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda48065550 0x7fda4813cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:08.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda50400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda480ab890 0x7fda480c2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:08.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda50400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda480bcfa0 0x7fda481505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:08.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda50400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda481572f0 con 0x7fda480ab890 2024-01-22T05:19:08.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda50400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda481566e0 con 0x7fda48065550 2024-01-22T05:19:08.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda50400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda481569c0 con 0x7fda480bcfa0 2024-01-22T05:19:08.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda4d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda480ab890 0x7fda480c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:08.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda4d000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda480ab890 0x7fda480c2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47832/0 (socket says 172.21.15.49:47832) 2024-01-22T05:19:08.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda4d000700 1 -- 172.21.15.49:0/2345442927 learned_addr learned my addr 172.21.15.49:0/2345442927 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda4da00700 1 --2- 172.21.15.49:0/2345442927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda48065550 0x7fda4813cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda4e400700 1 --2- 172.21.15.49:0/2345442927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda480bcfa0 0x7fda481505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda4d000700 1 -- 172.21.15.49:0/2345442927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda480bcfa0 msgr2=0x7fda481505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda4d000700 1 --2- 172.21.15.49:0/2345442927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda480bcfa0 0x7fda481505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda4d000700 1 -- 172.21.15.49:0/2345442927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda48065550 msgr2=0x7fda4813cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda4d000700 1 --2- 172.21.15.49:0/2345442927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda48065550 0x7fda4813cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda4d000700 1 -- 172.21.15.49:0/2345442927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda40009a20 con 0x7fda480ab890 2024-01-22T05:19:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda4e400700 1 --2- 172.21.15.49:0/2345442927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda480bcfa0 0x7fda481505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:19:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda4d000700 1 --2- 172.21.15.49:0/2345442927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda480ab890 0x7fda480c2940 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7fda3000e930 tx=0x7fda30009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda44c00700 1 -- 172.21.15.49:0/2345442927 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000eed0 con 0x7fda480ab890 2024-01-22T05:19:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda44c00700 1 -- 172.21.15.49:0/2345442927 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3000c850 con 0x7fda480ab890 2024-01-22T05:19:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda50400700 1 -- 172.21.15.49:0/2345442927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda48156ca0 con 0x7fda480ab890 2024-01-22T05:19:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda44c00700 1 -- 172.21.15.49:0/2345442927 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000cbd0 con 0x7fda480ab890 2024-01-22T05:19:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.309+0000 7fda50400700 1 -- 172.21.15.49:0/2345442927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda48154550 con 0x7fda480ab890 2024-01-22T05:19:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.313+0000 7fda50400700 1 -- 172.21.15.49:0/2345442927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda48157460 con 0x7fda480ab890 2024-01-22T05:19:08.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.313+0000 7fda44c00700 1 -- 172.21.15.49:0/2345442927 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fda3001b400 con 0x7fda480ab890 2024-01-22T05:19:08.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.313+0000 7fda44c00700 1 --2- 172.21.15.49:0/2345442927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fda2005a510 0x7fda2005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:08.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.313+0000 7fda44c00700 1 -- 172.21.15.49:0/2345442927 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fda30074df0 con 0x7fda480ab890 2024-01-22T05:19:08.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.313+0000 7fda4da00700 1 --2- 172.21.15.49:0/2345442927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fda2005a510 0x7fda2005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:08.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.317+0000 7fda4da00700 1 --2- 172.21.15.49:0/2345442927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fda2005a510 0x7fda2005c9d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fda3800c7d0 tx=0x7fda38009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:08.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.317+0000 7fda44c00700 1 -- 172.21.15.49:0/2345442927 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fda30048410 con 0x7fda480ab890 2024-01-22T05:19:08.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.481+0000 7fda50400700 1 -- 172.21.15.49:0/2345442927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda48046800 con 0x7fda480ab890 2024-01-22T05:19:08.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.481+0000 7fda44c00700 1 -- 172.21.15.49:0/2345442927 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+17191 (secure 0 0 0) 0x7fda3004ba30 con 0x7fda480ab890 2024-01-22T05:19:08.481 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:08.481 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":183,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:19:08.067794+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:19:06.223141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-01-22T05:19:07.103306+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:19:08.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.485+0000 7fda50400700 1 -- 172.21.15.49:0/2345442927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fda2005a510 msgr2=0x7fda2005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:08.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.485+0000 7fda50400700 1 --2- 172.21.15.49:0/2345442927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fda2005a510 0x7fda2005c9d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fda3800c7d0 tx=0x7fda38009040).stop 2024-01-22T05:19:08.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.485+0000 7fda50400700 1 -- 172.21.15.49:0/2345442927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda480ab890 msgr2=0x7fda480c2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:08.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.485+0000 7fda50400700 1 --2- 172.21.15.49:0/2345442927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda480ab890 0x7fda480c2940 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7fda3000e930 tx=0x7fda30009060).stop 2024-01-22T05:19:08.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.485+0000 7fda50400700 1 -- 172.21.15.49:0/2345442927 shutdown_connections 2024-01-22T05:19:08.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.485+0000 7fda50400700 1 --2- 172.21.15.49:0/2345442927 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fda2005a510 0x7fda2005c9d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.485+0000 7fda50400700 1 --2- 172.21.15.49:0/2345442927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda480bcfa0 0x7fda481505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.485+0000 7fda50400700 1 --2- 172.21.15.49:0/2345442927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda480ab890 0x7fda480c2940 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.485+0000 7fda50400700 1 --2- 172.21.15.49:0/2345442927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda48065550 0x7fda4813cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.485+0000 7fda50400700 1 -- 172.21.15.49:0/2345442927 >> 172.21.15.49:0/2345442927 conn(0x7fda480c6540 msgr2=0x7fda480be200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:08.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.485+0000 7fda50400700 1 -- 172.21.15.49:0/2345442927 shutdown_connections 2024-01-22T05:19:08.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.485+0000 7fda50400700 1 -- 172.21.15.49:0/2345442927 wait complete. 2024-01-22T05:19:08.506 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:19:08.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.669+0000 7fe2f2000700 1 Processor -- start 2024-01-22T05:19:08.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.669+0000 7fe2f2000700 1 -- start start 2024-01-22T05:19:08.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2f2000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe2ec062230 0x7fe2ec066350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:08.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2f2000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ec157e30 0x7fe2ec0654b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:08.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2f2000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe2ec158290 0x7fe2ec0659a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:08.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2f2000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ec065e90 con 0x7fe2ec062230 2024-01-22T05:19:08.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2f2000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ec062610 con 0x7fe2ec158290 2024-01-22T05:19:08.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2f2000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0c3780 con 0x7fe2ec157e30 2024-01-22T05:19:08.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2eb400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe2ec062230 0x7fe2ec066350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:08.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2eb400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe2ec062230 0x7fe2ec066350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47838/0 (socket says 172.21.15.49:47838) 2024-01-22T05:19:08.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2eb400700 1 -- 172.21.15.49:0/3233229881 learned_addr learned my addr 172.21.15.49:0/3233229881 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:08.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2eaa00700 1 --2- 172.21.15.49:0/3233229881 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ec157e30 0x7fe2ec0654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:08.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2f0a00700 1 --2- 172.21.15.49:0/3233229881 >> v2:172.21.15.110:3300/0 conn(0x7fe2ec158290 0x7fe2ec0659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2eb400700 1 -- 172.21.15.49:0/3233229881 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ec157e30 msgr2=0x7fe2ec0654b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2eb400700 1 --2- 172.21.15.49:0/3233229881 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ec157e30 0x7fe2ec0654b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2eb400700 1 -- 172.21.15.49:0/3233229881 >> v2:172.21.15.110:3300/0 conn(0x7fe2ec158290 msgr2=0x7fe2ec0659a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2eb400700 1 --2- 172.21.15.49:0/3233229881 >> v2:172.21.15.110:3300/0 conn(0x7fe2ec158290 0x7fe2ec0659a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2eb400700 1 -- 172.21.15.49:0/3233229881 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec066840 con 0x7fe2ec062230 2024-01-22T05:19:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.673+0000 7fe2f0a00700 1 --2- 172.21.15.49:0/3233229881 >> v2:172.21.15.110:3300/0 conn(0x7fe2ec158290 0x7fe2ec0659a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.677+0000 7fe2eb400700 1 --2- 172.21.15.49:0/3233229881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ec062230 0x7fe2ec066350 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7fe2ec063d30 tx=0x7fe2dc009060).ready entity=mon.0 client_cookie=c9fa7b730f96e7e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.677+0000 7fe2ea000700 1 -- 172.21.15.49:0/3233229881 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc005880 con 0x7fe2ec062230 2024-01-22T05:19:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.677+0000 7fe2ea000700 1 -- 172.21.15.49:0/3233229881 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc0059e0 con 0x7fe2ec062230 2024-01-22T05:19:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.677+0000 7fe2ea000700 1 -- 172.21.15.49:0/3233229881 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc005d60 con 0x7fe2ec062230 2024-01-22T05:19:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.677+0000 7fe2f2000700 1 -- 172.21.15.49:0/3233229881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ec062230 msgr2=0x7fe2ec066350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.677+0000 7fe2f2000700 1 --2- 172.21.15.49:0/3233229881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ec062230 0x7fe2ec066350 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7fe2ec063d30 tx=0x7fe2dc009060).stop 2024-01-22T05:19:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.677+0000 7fe2f2000700 1 -- 172.21.15.49:0/3233229881 shutdown_connections 2024-01-22T05:19:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.677+0000 7fe2f2000700 1 --2- 172.21.15.49:0/3233229881 >> v2:172.21.15.110:3300/0 conn(0x7fe2ec158290 0x7fe2ec0659a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.677+0000 7fe2f2000700 1 --2- 172.21.15.49:0/3233229881 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ec157e30 0x7fe2ec0654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.677+0000 7fe2f2000700 1 --2- 172.21.15.49:0/3233229881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ec062230 0x7fe2ec066350 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.677+0000 7fe2f2000700 1 -- 172.21.15.49:0/3233229881 >> 172.21.15.49:0/3233229881 conn(0x7fe2ec0c5810 msgr2=0x7fe2ec0c5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:08.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.677+0000 7fe2f2000700 1 -- 172.21.15.49:0/3233229881 shutdown_connections 2024-01-22T05:19:08.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.677+0000 7fe2f2000700 1 -- 172.21.15.49:0/3233229881 wait complete. 2024-01-22T05:19:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.681+0000 7fe2f2000700 1 Processor -- start 2024-01-22T05:19:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.681+0000 7fe2f2000700 1 -- start start 2024-01-22T05:19:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.681+0000 7fe2f2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ec062230 0x7fe2ec0c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.681+0000 7fe2f2000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2ec157e30 0x7fe2ec16bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.681+0000 7fe2f2000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ec158290 0x7fe2ec16c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.681+0000 7fe2f2000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0c27c0 con 0x7fe2ec062230 2024-01-22T05:19:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.681+0000 7fe2f2000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec16c710 con 0x7fe2ec157e30 2024-01-22T05:19:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.681+0000 7fe2f2000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec158f50 con 0x7fe2ec158290 2024-01-22T05:19:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.681+0000 7fe2eb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ec062230 0x7fe2ec0c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.681+0000 7fe2eb400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ec062230 0x7fe2ec0c17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47854/0 (socket says 172.21.15.49:47854) 2024-01-22T05:19:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.681+0000 7fe2eb400700 1 -- 172.21.15.49:0/1496362258 learned_addr learned my addr 172.21.15.49:0/1496362258 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.681+0000 7fe2f0a00700 1 --2- 172.21.15.49:0/1496362258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ec158290 0x7fe2ec16c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.681+0000 7fe2eaa00700 1 --2- 172.21.15.49:0/1496362258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2ec157e30 0x7fe2ec16bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.685+0000 7fe2eb400700 1 -- 172.21.15.49:0/1496362258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ec158290 msgr2=0x7fe2ec16c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.685+0000 7fe2eb400700 1 --2- 172.21.15.49:0/1496362258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ec158290 0x7fe2ec16c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.685+0000 7fe2eb400700 1 -- 172.21.15.49:0/1496362258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2ec157e30 msgr2=0x7fe2ec16bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:08.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.685+0000 7fe2eb400700 1 --2- 172.21.15.49:0/1496362258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2ec157e30 0x7fe2ec16bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.685+0000 7fe2eb400700 1 -- 172.21.15.49:0/1496362258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e4009a20 con 0x7fe2ec062230 2024-01-22T05:19:08.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.685+0000 7fe2eb400700 1 --2- 172.21.15.49:0/1496362258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ec062230 0x7fe2ec0c17b0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 rx=0x7fe2dc005f10 tx=0x7fe2dc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:08.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.685+0000 7fe2e2a00700 1 -- 172.21.15.49:0/1496362258 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc00f720 con 0x7fe2ec062230 2024-01-22T05:19:08.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.685+0000 7fe2f2000700 1 -- 172.21.15.49:0/1496362258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc009300 con 0x7fe2ec062230 2024-01-22T05:19:08.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.685+0000 7fe2e2a00700 1 -- 172.21.15.49:0/1496362258 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc00f8a0 con 0x7fe2ec062230 2024-01-22T05:19:08.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.685+0000 7fe2e2a00700 1 -- 172.21.15.49:0/1496362258 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc00fc60 con 0x7fe2ec062230 2024-01-22T05:19:08.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.685+0000 7fe2f2000700 1 -- 172.21.15.49:0/1496362258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ec0c24e0 con 0x7fe2ec062230 2024-01-22T05:19:08.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.685+0000 7fe2f2000700 1 -- 172.21.15.49:0/1496362258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ec047060 con 0x7fe2ec062230 2024-01-22T05:19:08.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.689+0000 7fe2e2a00700 1 -- 172.21.15.49:0/1496362258 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe2dc018070 con 0x7fe2ec062230 2024-01-22T05:19:08.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.689+0000 7fe2e2a00700 1 --2- 172.21.15.49:0/1496362258 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe2c405a4e0 0x7fe2c405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:08.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.689+0000 7fe2e2a00700 1 -- 172.21.15.49:0/1496362258 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe2dc075a10 con 0x7fe2ec062230 2024-01-22T05:19:08.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.689+0000 7fe2eaa00700 1 --2- 172.21.15.49:0/1496362258 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe2c405a4e0 0x7fe2c405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:08.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.689+0000 7fe2eaa00700 1 --2- 172.21.15.49:0/1496362258 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe2c405a4e0 0x7fe2c405c9a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fe2ec153f00 tx=0x7fe2d4009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:08.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.697+0000 7fe2e2a00700 1 -- 172.21.15.49:0/1496362258 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe2dc049050 con 0x7fe2ec062230 2024-01-22T05:19:08.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.861+0000 7fe2f2000700 1 -- 172.21.15.49:0/1496362258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2ec066130 con 0x7fe2ec062230 2024-01-22T05:19:08.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.865+0000 7fe2e2a00700 1 -- 172.21.15.49:0/1496362258 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+17191 (secure 0 0 0) 0x7fe2dc073e60 con 0x7fe2ec062230 2024-01-22T05:19:08.863 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:08.864 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":183,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:19:08.067794+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:19:06.223141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-01-22T05:19:07.103306+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:19:08.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.869+0000 7fe2f2000700 1 -- 172.21.15.49:0/1496362258 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe2c405a4e0 msgr2=0x7fe2c405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:08.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.869+0000 7fe2f2000700 1 --2- 172.21.15.49:0/1496362258 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe2c405a4e0 0x7fe2c405c9a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fe2ec153f00 tx=0x7fe2d4009060).stop 2024-01-22T05:19:08.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.869+0000 7fe2f2000700 1 -- 172.21.15.49:0/1496362258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ec062230 msgr2=0x7fe2ec0c17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:08.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.869+0000 7fe2f2000700 1 --2- 172.21.15.49:0/1496362258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ec062230 0x7fe2ec0c17b0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 rx=0x7fe2dc005f10 tx=0x7fe2dc016000).stop 2024-01-22T05:19:08.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.869+0000 7fe2f2000700 1 -- 172.21.15.49:0/1496362258 shutdown_connections 2024-01-22T05:19:08.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.869+0000 7fe2f2000700 1 --2- 172.21.15.49:0/1496362258 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe2c405a4e0 0x7fe2c405c9a0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.869+0000 7fe2f2000700 1 --2- 172.21.15.49:0/1496362258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ec158290 0x7fe2ec16c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.869+0000 7fe2f2000700 1 --2- 172.21.15.49:0/1496362258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2ec157e30 0x7fe2ec16bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.869+0000 7fe2f2000700 1 --2- 172.21.15.49:0/1496362258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2ec062230 0x7fe2ec0c17b0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:08.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.869+0000 7fe2f2000700 1 -- 172.21.15.49:0/1496362258 >> 172.21.15.49:0/1496362258 conn(0x7fe2ec0c5810 msgr2=0x7fe2ec0656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:08.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.869+0000 7fe2f2000700 1 -- 172.21.15.49:0/1496362258 shutdown_connections 2024-01-22T05:19:08.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:08.869+0000 7fe2f2000700 1 -- 172.21.15.49:0/1496362258 wait complete. 2024-01-22T05:19:08.892 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:19:09.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.057+0000 7f0979200700 1 Processor -- start 2024-01-22T05:19:09.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.057+0000 7f0979200700 1 -- start start 2024-01-22T05:19:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.061+0000 7f0979200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0974062970 0x7f097415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:09.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.061+0000 7f0979200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09740bda70 con 0x7f0974062e00 2024-01-22T05:19:09.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.061+0000 7f0979200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09740bdd50 con 0x7f09740c3700 2024-01-22T05:19:09.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.061+0000 7f0979200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0974158410 con 0x7f0974062970 2024-01-22T05:19:09.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.061+0000 7f0971400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0974062970 0x7f097415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:09.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.061+0000 7f0971400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0974062970 0x7f097415bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47866/0 (socket says 172.21.15.49:47866) 2024-01-22T05:19:09.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.061+0000 7f0971400700 1 -- 172.21.15.49:0/1378148594 learned_addr learned my addr 172.21.15.49:0/1378148594 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.061+0000 7f0971400700 1 -- 172.21.15.49:0/1378148594 >> v1:172.21.15.110:6789/0 conn(0x7f09740c3700 legacy=0x7f0974157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.061+0000 7f0971400700 1 -- 172.21.15.49:0/1378148594 >> v1:172.21.15.49:6789/0 conn(0x7f0974062e00 legacy=0x7f09740be830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.061+0000 7f0971400700 1 -- 172.21.15.49:0/1378148594 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09740be030 con 0x7f0974062970 2024-01-22T05:19:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.061+0000 7f0971400700 1 --2- 172.21.15.49:0/1378148594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0974062970 0x7f097415bae0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f095c006fd0 tx=0x7f095c0090f0).ready entity=mon.0 client_cookie=31358c7e205fcc32 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.061+0000 7f0970a00700 1 -- 172.21.15.49:0/1378148594 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c00b600 con 0x7f0974062970 2024-01-22T05:19:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.061+0000 7f0970a00700 1 -- 172.21.15.49:0/1378148594 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c00b760 con 0x7f0974062970 2024-01-22T05:19:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.061+0000 7f0970a00700 1 -- 172.21.15.49:0/1378148594 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c00bae0 con 0x7f0974062970 2024-01-22T05:19:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.065+0000 7f0979200700 1 -- 172.21.15.49:0/1378148594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0974062970 msgr2=0x7f097415bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.065+0000 7f0979200700 1 --2- 172.21.15.49:0/1378148594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0974062970 0x7f097415bae0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f095c006fd0 tx=0x7f095c0090f0).stop 2024-01-22T05:19:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.065+0000 7f0979200700 1 -- 172.21.15.49:0/1378148594 shutdown_connections 2024-01-22T05:19:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.065+0000 7f0979200700 1 --2- 172.21.15.49:0/1378148594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0974062970 0x7f097415bae0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.065+0000 7f0979200700 1 -- 172.21.15.49:0/1378148594 >> 172.21.15.49:0/1378148594 conn(0x7f09740c8780 msgr2=0x7f09740c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.065+0000 7f0979200700 1 -- 172.21.15.49:0/1378148594 shutdown_connections 2024-01-22T05:19:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.065+0000 7f0979200700 1 -- 172.21.15.49:0/1378148594 wait complete. 2024-01-22T05:19:09.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.069+0000 7f0979200700 1 Processor -- start 2024-01-22T05:19:09.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.069+0000 7f0979200700 1 -- start start 2024-01-22T05:19:09.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.069+0000 7f0979200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0974062970 0x7f09741686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:09.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.069+0000 7f0979200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0974062e00 0x7f09741428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:09.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.069+0000 7f0979200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09740c3700 0x7f09740a8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:09.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.069+0000 7f0979200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09740a98c0 con 0x7f0974062970 2024-01-22T05:19:09.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.069+0000 7f0979200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09740a8cb0 con 0x7f09740c3700 2024-01-22T05:19:09.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.069+0000 7f0979200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09740a8f90 con 0x7f0974062e00 2024-01-22T05:19:09.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.069+0000 7f0971e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0974062970 0x7f09741686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:09.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.069+0000 7f0971e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0974062970 0x7f09741686f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47870/0 (socket says 172.21.15.49:47870) 2024-01-22T05:19:09.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.069+0000 7f0971e00700 1 -- 172.21.15.49:0/1816661259 learned_addr learned my addr 172.21.15.49:0/1816661259 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:09.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.069+0000 7f0971400700 1 --2- 172.21.15.49:0/1816661259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0974062e00 0x7f09741428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:09.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.069+0000 7f0972800700 1 --2- 172.21.15.49:0/1816661259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09740c3700 0x7f09740a8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:09.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.073+0000 7f0971e00700 1 -- 172.21.15.49:0/1816661259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0974062e00 msgr2=0x7f09741428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:09.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.073+0000 7f0971e00700 1 --2- 172.21.15.49:0/1816661259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0974062e00 0x7f09741428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:09.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.073+0000 7f0971e00700 1 -- 172.21.15.49:0/1816661259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09740c3700 msgr2=0x7f09740a8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:09.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.073+0000 7f0971e00700 1 --2- 172.21.15.49:0/1816661259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09740c3700 0x7f09740a8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:09.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.073+0000 7f0971e00700 1 -- 172.21.15.49:0/1816661259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095c009370 con 0x7f0974062970 2024-01-22T05:19:09.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.073+0000 7f0971e00700 1 --2- 172.21.15.49:0/1816661259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0974062970 0x7f09741686f0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 rx=0x7f096400c440 tx=0x7f0964007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:09.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.073+0000 7f0969600700 1 -- 172.21.15.49:0/1816661259 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0964007020 con 0x7f0974062970 2024-01-22T05:19:09.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.073+0000 7f0969600700 1 -- 172.21.15.49:0/1816661259 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0964007180 con 0x7f0974062970 2024-01-22T05:19:09.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.073+0000 7f0979200700 1 -- 172.21.15.49:0/1816661259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09740a9270 con 0x7f0974062970 2024-01-22T05:19:09.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.073+0000 7f0969600700 1 -- 172.21.15.49:0/1816661259 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0964007520 con 0x7f0974062970 2024-01-22T05:19:09.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.073+0000 7f0979200700 1 -- 172.21.15.49:0/1816661259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0974168be0 con 0x7f0974062970 2024-01-22T05:19:09.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.073+0000 7f0979200700 1 -- 172.21.15.49:0/1816661259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09740be310 con 0x7f0974062970 2024-01-22T05:19:09.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.077+0000 7f0969600700 1 -- 172.21.15.49:0/1816661259 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f09640068b0 con 0x7f0974062970 2024-01-22T05:19:09.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.077+0000 7f0969600700 1 --2- 172.21.15.49:0/1816661259 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f094c05a510 0x7f094c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:09.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.077+0000 7f0969600700 1 -- 172.21.15.49:0/1816661259 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f0964073c60 con 0x7f0974062970 2024-01-22T05:19:09.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.077+0000 7f0971400700 1 --2- 172.21.15.49:0/1816661259 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f094c05a510 0x7f094c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:09.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.081+0000 7f0971400700 1 --2- 172.21.15.49:0/1816661259 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f094c05a510 0x7f094c05c9d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f095c009130 tx=0x7f095c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:09.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.085+0000 7f0969600700 1 -- 172.21.15.49:0/1816661259 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0964047220 con 0x7f0974062970 2024-01-22T05:19:09.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:09.285+0000 7f0979200700 1 -- 172.21.15.49:0/1816661259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0974046800 con 0x7f0974062970 2024-01-22T05:19:10.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.101+0000 7f0969600700 1 -- 172.21.15.49:0/1816661259 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v141) v1 ==== 118+0+0 (secure 0 0 0) 0x7f096404a840 con 0x7f0974062970 2024-01-22T05:19:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.105+0000 7f0979200700 1 -- 172.21.15.49:0/1816661259 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f094c05a510 msgr2=0x7f094c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.105+0000 7f0979200700 1 --2- 172.21.15.49:0/1816661259 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f094c05a510 0x7f094c05c9d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f095c009130 tx=0x7f095c017000).stop 2024-01-22T05:19:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.105+0000 7f0979200700 1 -- 172.21.15.49:0/1816661259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0974062970 msgr2=0x7f09741686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.105+0000 7f0979200700 1 --2- 172.21.15.49:0/1816661259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0974062970 0x7f09741686f0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 rx=0x7f096400c440 tx=0x7f0964007e00).stop 2024-01-22T05:19:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.105+0000 7f0979200700 1 -- 172.21.15.49:0/1816661259 shutdown_connections 2024-01-22T05:19:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.105+0000 7f0979200700 1 --2- 172.21.15.49:0/1816661259 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f094c05a510 0x7f094c05c9d0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.105+0000 7f0979200700 1 --2- 172.21.15.49:0/1816661259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09740c3700 0x7f09740a8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.105+0000 7f0979200700 1 --2- 172.21.15.49:0/1816661259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0974062e00 0x7f09741428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.105+0000 7f0979200700 1 --2- 172.21.15.49:0/1816661259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0974062970 0x7f09741686f0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.105+0000 7f0979200700 1 -- 172.21.15.49:0/1816661259 >> 172.21.15.49:0/1816661259 conn(0x7f09740c8780 msgr2=0x7f09740c7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.109+0000 7f0979200700 1 -- 172.21.15.49:0/1816661259 shutdown_connections 2024-01-22T05:19:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.109+0000 7f0979200700 1 -- 172.21.15.49:0/1816661259 wait complete. 2024-01-22T05:19:10.131 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T05:19:10.131 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:19:10.191 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:19:10.197 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:19:10.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.289+0000 7f7a4e000700 1 Processor -- start 2024-01-22T05:19:10.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.289+0000 7f7a4e000700 1 -- start start 2024-01-22T05:19:10.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a4e000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7a48157ee0 0x7f7a48065590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:10.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a4e000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7a48068af0 0x7f7a48065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:10.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a4e000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a48068280 con 0x7f7a48068710 2024-01-22T05:19:10.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a4e000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a48069600 con 0x7f7a48068af0 2024-01-22T05:19:10.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a4e000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a480c1cc0 con 0x7f7a48157ee0 2024-01-22T05:19:10.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a4cc00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7a48068710 0x7f7a481577d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58316/0 (socket says 172.21.15.49:58316) 2024-01-22T05:19:10.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a4cc00700 1 -- 172.21.15.49:0/1745277925 learned_addr learned my addr 172.21.15.49:0/1745277925 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:10.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a4d600700 1 --2- 172.21.15.49:0/1745277925 >> v2:172.21.15.49:3300/0 conn(0x7f7a48068af0 0x7f7a48065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:10.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a47e00700 1 --2- 172.21.15.49:0/1745277925 >> v2:172.21.15.110:3300/0 conn(0x7f7a48157ee0 0x7f7a48065590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:10.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a4d600700 1 -- 172.21.15.49:0/1745277925 >> v2:172.21.15.110:3300/0 conn(0x7f7a48157ee0 msgr2=0x7f7a48065590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:10.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a4d600700 1 --2- 172.21.15.49:0/1745277925 >> v2:172.21.15.110:3300/0 conn(0x7f7a48157ee0 0x7f7a48065590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:10.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a4d600700 1 -- 172.21.15.49:0/1745277925 >> v1:172.21.15.49:6789/0 conn(0x7f7a48068710 legacy=0x7f7a481577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:10.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a4d600700 1 -- 172.21.15.49:0/1745277925 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a48067c30 con 0x7f7a48068af0 2024-01-22T05:19:10.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a47400700 1 -- 172.21.15.49:0/1745277925 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270802058 0 0) 0x7f7a48068280 con 0x7f7a48068710 2024-01-22T05:19:10.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a4d600700 1 --2- 172.21.15.49:0/1745277925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a48068af0 0x7f7a48065a80 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7f7a480c2fa0 tx=0x7f7a40009780).ready entity=mon.0 client_cookie=1c38323169ee3568 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:10.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a47400700 1 -- 172.21.15.49:0/1745277925 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4000e070 con 0x7f7a48068af0 2024-01-22T05:19:10.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a47400700 1 -- 172.21.15.49:0/1745277925 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4000bb60 con 0x7f7a48068af0 2024-01-22T05:19:10.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.293+0000 7f7a47400700 1 -- 172.21.15.49:0/1745277925 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a40012410 con 0x7f7a48068af0 2024-01-22T05:19:10.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.297+0000 7f7a4e000700 1 -- 172.21.15.49:0/1745277925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a48068af0 msgr2=0x7f7a48065a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:10.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.297+0000 7f7a4e000700 1 --2- 172.21.15.49:0/1745277925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a48068af0 0x7f7a48065a80 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7f7a480c2fa0 tx=0x7f7a40009780).stop 2024-01-22T05:19:10.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.297+0000 7f7a4e000700 1 -- 172.21.15.49:0/1745277925 shutdown_connections 2024-01-22T05:19:10.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.297+0000 7f7a4e000700 1 --2- 172.21.15.49:0/1745277925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a48068af0 0x7f7a48065a80 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:10.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.297+0000 7f7a4e000700 1 --2- 172.21.15.49:0/1745277925 >> v2:172.21.15.110:3300/0 conn(0x7f7a48157ee0 0x7f7a48065590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:10.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.297+0000 7f7a4e000700 1 -- 172.21.15.49:0/1745277925 >> 172.21.15.49:0/1745277925 conn(0x7f7a480c6fc0 msgr2=0x7f7a480c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:10.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.297+0000 7f7a4e000700 1 -- 172.21.15.49:0/1745277925 shutdown_connections 2024-01-22T05:19:10.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.297+0000 7f7a4e000700 1 -- 172.21.15.49:0/1745277925 wait complete. 2024-01-22T05:19:10.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.297+0000 7f7a4e000700 1 Processor -- start 2024-01-22T05:19:10.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4e000700 1 -- start start 2024-01-22T05:19:10.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4e000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a48068710 0x7f7a48145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:10.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a48068af0 0x7f7a481563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:10.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4e000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a48157ee0 0x7f7a481568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:10.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4e000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a48156da0 con 0x7f7a48157ee0 2024-01-22T05:19:10.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4e000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a480a9e70 con 0x7f7a48068af0 2024-01-22T05:19:10.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4e000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a48145d00 con 0x7f7a48068710 2024-01-22T05:19:10.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a48157ee0 0x7f7a481568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:10.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a48157ee0 0x7f7a481568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47880/0 (socket says 172.21.15.49:47880) 2024-01-22T05:19:10.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4d600700 1 -- 172.21.15.49:0/3281023220 learned_addr learned my addr 172.21.15.49:0/3281023220 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:10.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4cc00700 1 --2- 172.21.15.49:0/3281023220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a48068710 0x7f7a48145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:10.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a47e00700 1 --2- 172.21.15.49:0/3281023220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a48068af0 0x7f7a481563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:10.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4d600700 1 -- 172.21.15.49:0/3281023220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a48068710 msgr2=0x7f7a48145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:10.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4d600700 1 --2- 172.21.15.49:0/3281023220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a48068710 0x7f7a48145810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:10.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4d600700 1 -- 172.21.15.49:0/3281023220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a48068af0 msgr2=0x7f7a481563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:10.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4d600700 1 --2- 172.21.15.49:0/3281023220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a48068af0 0x7f7a481563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:10.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4d600700 1 -- 172.21.15.49:0/3281023220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a40009a20 con 0x7f7a48157ee0 2024-01-22T05:19:10.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a47e00700 1 --2- 172.21.15.49:0/3281023220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a48068af0 0x7f7a481563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:10.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.301+0000 7f7a4d600700 1 --2- 172.21.15.49:0/3281023220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a48157ee0 0x7f7a481568b0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f7a4000b6c0 tx=0x7f7a40009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:10.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.305+0000 7f7a3fe00700 1 -- 172.21.15.49:0/3281023220 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4001d630 con 0x7f7a48157ee0 2024-01-22T05:19:10.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.305+0000 7f7a3fe00700 1 -- 172.21.15.49:0/3281023220 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4001d790 con 0x7f7a48157ee0 2024-01-22T05:19:10.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.305+0000 7f7a4e000700 1 -- 172.21.15.49:0/3281023220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a480c0800 con 0x7f7a48157ee0 2024-01-22T05:19:10.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.305+0000 7f7a3fe00700 1 -- 172.21.15.49:0/3281023220 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4001db10 con 0x7f7a48157ee0 2024-01-22T05:19:10.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.305+0000 7f7a4e000700 1 -- 172.21.15.49:0/3281023220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a480a9820 con 0x7f7a48157ee0 2024-01-22T05:19:10.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.305+0000 7f7a4e000700 1 -- 172.21.15.49:0/3281023220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a48047060 con 0x7f7a48157ee0 2024-01-22T05:19:10.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.305+0000 7f7a3fe00700 1 -- 172.21.15.49:0/3281023220 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7a40026410 con 0x7f7a48157ee0 2024-01-22T05:19:10.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.309+0000 7f7a3fe00700 1 --2- 172.21.15.49:0/3281023220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7a2005a510 0x7f7a2005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:10.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.309+0000 7f7a3fe00700 1 -- 172.21.15.49:0/3281023220 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7a40076870 con 0x7f7a48157ee0 2024-01-22T05:19:10.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.309+0000 7f7a4cc00700 1 --2- 172.21.15.49:0/3281023220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7a2005a510 0x7f7a2005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:10.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.309+0000 7f7a4cc00700 1 --2- 172.21.15.49:0/3281023220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7a2005a510 0x7f7a2005c9d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f7a38002670 tx=0x7f7a38009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:10.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.313+0000 7f7a3fe00700 1 -- 172.21.15.49:0/3281023220 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7a40049dd0 con 0x7f7a48157ee0 2024-01-22T05:19:10.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:10.513+0000 7f7a4e000700 1 -- 172.21.15.49:0/3281023220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7a480a9fb0 con 0x7f7a48157ee0 2024-01-22T05:19:11.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.104+0000 7f7a3fe00700 1 -- 172.21.15.49:0/3281023220 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v142) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7a4004d3f0 con 0x7f7a48157ee0 2024-01-22T05:19:11.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.112+0000 7f7a4e000700 1 -- 172.21.15.49:0/3281023220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7a2005a510 msgr2=0x7f7a2005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:11.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.112+0000 7f7a4e000700 1 --2- 172.21.15.49:0/3281023220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7a2005a510 0x7f7a2005c9d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f7a38002670 tx=0x7f7a38009040).stop 2024-01-22T05:19:11.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.112+0000 7f7a4e000700 1 -- 172.21.15.49:0/3281023220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a48157ee0 msgr2=0x7f7a481568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:11.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.112+0000 7f7a4e000700 1 --2- 172.21.15.49:0/3281023220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a48157ee0 0x7f7a481568b0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f7a4000b6c0 tx=0x7f7a40009780).stop 2024-01-22T05:19:11.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.112+0000 7f7a4e000700 1 -- 172.21.15.49:0/3281023220 shutdown_connections 2024-01-22T05:19:11.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.112+0000 7f7a4e000700 1 --2- 172.21.15.49:0/3281023220 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7a2005a510 0x7f7a2005c9d0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.112+0000 7f7a4e000700 1 --2- 172.21.15.49:0/3281023220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a48157ee0 0x7f7a481568b0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.112+0000 7f7a4e000700 1 --2- 172.21.15.49:0/3281023220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a48068af0 0x7f7a481563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.112+0000 7f7a4e000700 1 --2- 172.21.15.49:0/3281023220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a48068710 0x7f7a48145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.112+0000 7f7a4e000700 1 -- 172.21.15.49:0/3281023220 >> 172.21.15.49:0/3281023220 conn(0x7f7a480c6fc0 msgr2=0x7f7a48150510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:11.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.112+0000 7f7a4e000700 1 -- 172.21.15.49:0/3281023220 shutdown_connections 2024-01-22T05:19:11.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.112+0000 7f7a4e000700 1 -- 172.21.15.49:0/3281023220 wait complete. 2024-01-22T05:19:11.136 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:19:11.136 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:19:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.360+0000 7f6271800700 1 Processor -- start 2024-01-22T05:19:11.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.360+0000 7f6271800700 1 -- start start 2024-01-22T05:19:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.364+0000 7f6271800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f626c1587f0 0x7f626c0660a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.364+0000 7f6271800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f626c066590 0x7f626c0c1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.364+0000 7f6271800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626c065930 con 0x7f626c158410 2024-01-22T05:19:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.364+0000 7f6271800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626c066a10 con 0x7f626c1587f0 2024-01-22T05:19:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.364+0000 7f6271800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626c158ce0 con 0x7f626c066590 2024-01-22T05:19:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.364+0000 7f626aa00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f626c158410 0x7f626c0c4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58328/0 (socket says 172.21.15.49:58328) 2024-01-22T05:19:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.364+0000 7f626aa00700 1 -- 172.21.15.49:0/711523254 learned_addr learned my addr 172.21.15.49:0/711523254 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:11.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.364+0000 7f626a000700 1 --2- 172.21.15.49:0/711523254 >> v2:172.21.15.110:3300/0 conn(0x7f626c1587f0 0x7f626c0660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:11.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.364+0000 7f626b400700 1 --2- 172.21.15.49:0/711523254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f626c066590 0x7f626c0c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:11.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.364+0000 7f6269600700 1 -- 172.21.15.49:0/711523254 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045441054 0 0) 0x7f626c065930 con 0x7f626c158410 2024-01-22T05:19:11.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.364+0000 7f6269600700 1 -- 172.21.15.49:0/711523254 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f624c0033f0 con 0x7f626c158410 2024-01-22T05:19:11.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.364+0000 7f6269600700 1 -- 172.21.15.49:0/711523254 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1197210091 0 0) 0x7f624c0033f0 con 0x7f626c158410 2024-01-22T05:19:11.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.364+0000 7f626a000700 1 -- 172.21.15.49:0/711523254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f626c066590 msgr2=0x7f626c0c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:11.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.364+0000 7f626a000700 1 --2- 172.21.15.49:0/711523254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f626c066590 0x7f626c0c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.364+0000 7f626a000700 1 -- 172.21.15.49:0/711523254 >> v1:172.21.15.49:6789/0 conn(0x7f626c158410 legacy=0x7f626c0c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:11.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.368+0000 7f626a000700 1 -- 172.21.15.49:0/711523254 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c158fc0 con 0x7f626c1587f0 2024-01-22T05:19:11.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.368+0000 7f626b400700 1 --2- 172.21.15.49:0/711523254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f626c066590 0x7f626c0c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:11.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.368+0000 7f626a000700 1 --2- 172.21.15.49:0/711523254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f626c1587f0 0x7f626c0660a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f6254009760 tx=0x7f6254009060).ready entity=mon.1 client_cookie=738abea565ab8b1a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:11.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.368+0000 7f6269600700 1 -- 172.21.15.49:0/711523254 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c001470 con 0x7f626c1587f0 2024-01-22T05:19:11.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.368+0000 7f6269600700 1 -- 172.21.15.49:0/711523254 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6254011400 con 0x7f626c1587f0 2024-01-22T05:19:11.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.368+0000 7f6269600700 1 -- 172.21.15.49:0/711523254 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254011780 con 0x7f626c1587f0 2024-01-22T05:19:11.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.368+0000 7f6271800700 1 -- 172.21.15.49:0/711523254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f626c1587f0 msgr2=0x7f626c0660a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:11.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.368+0000 7f6271800700 1 --2- 172.21.15.49:0/711523254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f626c1587f0 0x7f626c0660a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f6254009760 tx=0x7f6254009060).stop 2024-01-22T05:19:11.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.368+0000 7f6271800700 1 -- 172.21.15.49:0/711523254 shutdown_connections 2024-01-22T05:19:11.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.368+0000 7f6271800700 1 --2- 172.21.15.49:0/711523254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f626c066590 0x7f626c0c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.368+0000 7f6271800700 1 --2- 172.21.15.49:0/711523254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f626c1587f0 0x7f626c0660a0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.368+0000 7f6271800700 1 -- 172.21.15.49:0/711523254 >> 172.21.15.49:0/711523254 conn(0x7f626c0c6920 msgr2=0x7f626c0c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:11.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.368+0000 7f6271800700 1 -- 172.21.15.49:0/711523254 shutdown_connections 2024-01-22T05:19:11.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.368+0000 7f6271800700 1 -- 172.21.15.49:0/711523254 wait complete. 2024-01-22T05:19:11.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.372+0000 7f6271800700 1 Processor -- start 2024-01-22T05:19:11.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.372+0000 7f6271800700 1 -- start start 2024-01-22T05:19:11.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f6271800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f626c066590 0x7f626c1692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:11.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f6271800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f626c158410 0x7f626c155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:11.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f6271800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f626c1587f0 0x7f626c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:11.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f6271800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c0a6b90 con 0x7f626c066590 2024-01-22T05:19:11.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f6271800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c155510 con 0x7f626c1587f0 2024-01-22T05:19:11.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f6271800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626c0a5f80 con 0x7f626c158410 2024-01-22T05:19:11.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f626aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f626c066590 0x7f626c1692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:11.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f626aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f626c066590 0x7f626c1692e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47886/0 (socket says 172.21.15.49:47886) 2024-01-22T05:19:11.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f626aa00700 1 -- 172.21.15.49:0/2325295339 learned_addr learned my addr 172.21.15.49:0/2325295339 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:11.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f626a000700 1 --2- 172.21.15.49:0/2325295339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f626c158410 0x7f626c155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:11.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f626b400700 1 --2- 172.21.15.49:0/2325295339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f626c1587f0 0x7f626c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:11.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f626aa00700 1 -- 172.21.15.49:0/2325295339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f626c158410 msgr2=0x7f626c155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:11.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f626aa00700 1 --2- 172.21.15.49:0/2325295339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f626c158410 0x7f626c155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f626aa00700 1 -- 172.21.15.49:0/2325295339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f626c1587f0 msgr2=0x7f626c0a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:11.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f626aa00700 1 --2- 172.21.15.49:0/2325295339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f626c1587f0 0x7f626c0a5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f626aa00700 1 -- 172.21.15.49:0/2325295339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6264009a20 con 0x7f626c066590 2024-01-22T05:19:11.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f626b400700 1 --2- 172.21.15.49:0/2325295339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f626c1587f0 0x7f626c0a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:11.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.376+0000 7f626aa00700 1 --2- 172.21.15.49:0/2325295339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f626c066590 0x7f626c1692e0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7f625c00c810 tx=0x7f625c001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:11.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.380+0000 7f6262000700 1 -- 172.21.15.49:0/2325295339 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c007170 con 0x7f626c066590 2024-01-22T05:19:11.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.380+0000 7f6262000700 1 -- 172.21.15.49:0/2325295339 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c0072d0 con 0x7f626c066590 2024-01-22T05:19:11.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.380+0000 7f6271800700 1 -- 172.21.15.49:0/2325295339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62540092a0 con 0x7f626c066590 2024-01-22T05:19:11.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.380+0000 7f6262000700 1 -- 172.21.15.49:0/2325295339 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c0048c0 con 0x7f626c066590 2024-01-22T05:19:11.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.380+0000 7f6271800700 1 -- 172.21.15.49:0/2325295339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626c0a6540 con 0x7f626c066590 2024-01-22T05:19:11.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.380+0000 7f6271800700 1 -- 172.21.15.49:0/2325295339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626c064c70 con 0x7f626c066590 2024-01-22T05:19:11.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.384+0000 7f6262000700 1 -- 172.21.15.49:0/2325295339 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f625c004c70 con 0x7f626c066590 2024-01-22T05:19:11.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.384+0000 7f6262000700 1 --2- 172.21.15.49:0/2325295339 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f624405a540 0x7f624405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:11.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.384+0000 7f6262000700 1 -- 172.21.15.49:0/2325295339 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f625c0747d0 con 0x7f626c066590 2024-01-22T05:19:11.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.384+0000 7f626a000700 1 --2- 172.21.15.49:0/2325295339 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f624405a540 0x7f624405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.384+0000 7f626a000700 1 --2- 172.21.15.49:0/2325295339 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f624405a540 0x7f624405ca00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f626c158c10 tx=0x7f6254016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:11.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.388+0000 7f6262000700 1 -- 172.21.15.49:0/2325295339 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f625c047d90 con 0x7f626c066590 2024-01-22T05:19:11.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.592+0000 7f6271800700 1 -- 172.21.15.49:0/2325295339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f626c1592a0 con 0x7f626c066590 2024-01-22T05:19:11.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.592+0000 7f6262000700 1 -- 172.21.15.49:0/2325295339 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 142 v142) v1 ==== 95+0+4506 (secure 0 0 0) 0x7f625c04b3b0 con 0x7f626c066590 2024-01-22T05:19:11.594 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:11.594 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":142,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1331200361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1331200361},{"type":"v1","addr":"172.21.15.110:6835","nonce":1331200361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137},{"gid":9994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/377934467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":377934467},{"type":"v1","addr":"172.21.15.110:6834","nonce":377934467}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137},{"gid":10101,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3482770597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3482770597},{"type":"v1","addr":"172.21.15.49:6835","nonce":3482770597}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137}],"filesystems":[{"mdsmap":{"epoch":142,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:08.068628+0000","modified":"2024-01-22T05:19:11.100914+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10104},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10104":{"gid":10104,"name":"a","rank":0,"incarnation":138,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3574461601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3574461601},{"type":"v1","addr":"172.21.15.49:6837","nonce":3574461601}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2024-01-22T05:19:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.596+0000 7f6271800700 1 -- 172.21.15.49:0/2325295339 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f624405a540 msgr2=0x7f624405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.596+0000 7f6271800700 1 --2- 172.21.15.49:0/2325295339 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f624405a540 0x7f624405ca00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f626c158c10 tx=0x7f6254016000).stop 2024-01-22T05:19:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.596+0000 7f6271800700 1 -- 172.21.15.49:0/2325295339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f626c066590 msgr2=0x7f626c1692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.596+0000 7f6271800700 1 --2- 172.21.15.49:0/2325295339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f626c066590 0x7f626c1692e0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7f625c00c810 tx=0x7f625c001b50).stop 2024-01-22T05:19:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.596+0000 7f6271800700 1 -- 172.21.15.49:0/2325295339 shutdown_connections 2024-01-22T05:19:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.596+0000 7f6271800700 1 --2- 172.21.15.49:0/2325295339 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f624405a540 0x7f624405ca00 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.596+0000 7f6271800700 1 --2- 172.21.15.49:0/2325295339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f626c1587f0 0x7f626c0a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.596+0000 7f6271800700 1 --2- 172.21.15.49:0/2325295339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f626c158410 0x7f626c155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.596+0000 7f6271800700 1 --2- 172.21.15.49:0/2325295339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f626c066590 0x7f626c1692e0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.596+0000 7f6271800700 1 -- 172.21.15.49:0/2325295339 >> 172.21.15.49:0/2325295339 conn(0x7f626c0c6920 msgr2=0x7f626c0bcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.596+0000 7f6271800700 1 -- 172.21.15.49:0/2325295339 shutdown_connections 2024-01-22T05:19:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.596+0000 7f6271800700 1 -- 172.21.15.49:0/2325295339 wait complete. 2024-01-22T05:19:11.601 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 142 2024-01-22T05:19:11.622 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:19:11.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.780+0000 7fb4ba800700 1 Processor -- start 2024-01-22T05:19:11.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.780+0000 7fb4ba800700 1 -- start start 2024-01-22T05:19:11.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.784+0000 7fb4ba800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4b40a8b10 0x7fb4b4157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:11.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.784+0000 7fb4ba800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b40a8f90 0x7fb4b4157c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:11.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.784+0000 7fb4ba800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b40c1ee0 con 0x7fb4b4066fb0 2024-01-22T05:19:11.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.784+0000 7fb4ba800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b4158120 con 0x7fb4b40a8b10 2024-01-22T05:19:11.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.784+0000 7fb4ba800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b40c12f0 con 0x7fb4b40a8f90 2024-01-22T05:19:11.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.784+0000 7fb4b2a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4b40a8b10 0x7fb4b4157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:11.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.784+0000 7fb4b2a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4b40a8b10 0x7fb4b4157740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47892/0 (socket says 172.21.15.49:47892) 2024-01-22T05:19:11.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.784+0000 7fb4b2a00700 1 -- 172.21.15.49:0/620750238 learned_addr learned my addr 172.21.15.49:0/620750238 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:11.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.784+0000 7fb4b3e00700 1 --2- 172.21.15.49:0/620750238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b40a8f90 0x7fb4b4157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:11.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.788+0000 7fb4b2a00700 1 -- 172.21.15.49:0/620750238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b40a8f90 msgr2=0x7fb4b4157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:11.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.788+0000 7fb4b2a00700 1 --2- 172.21.15.49:0/620750238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b40a8f90 0x7fb4b4157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.788+0000 7fb4b2a00700 1 -- 172.21.15.49:0/620750238 >> v1:172.21.15.110:6789/0 conn(0x7fb4b4066fb0 legacy=0x7fb4b40c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:11.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.788+0000 7fb4b2a00700 1 -- 172.21.15.49:0/620750238 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b40c15b0 con 0x7fb4b40a8b10 2024-01-22T05:19:11.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.788+0000 7fb4b2a00700 1 --2- 172.21.15.49:0/620750238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4b40a8b10 0x7fb4b4157740 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7fb49c006fd0 tx=0x7fb49c0090f0).ready entity=mon.0 client_cookie=760f332467923765 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.788+0000 7fb4b2000700 1 -- 172.21.15.49:0/620750238 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00b580 con 0x7fb4b40a8b10 2024-01-22T05:19:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.788+0000 7fb4b2000700 1 -- 172.21.15.49:0/620750238 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c00b6e0 con 0x7fb4b40a8b10 2024-01-22T05:19:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.788+0000 7fb4b2000700 1 -- 172.21.15.49:0/620750238 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00ba60 con 0x7fb4b40a8b10 2024-01-22T05:19:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.788+0000 7fb4ba800700 1 -- 172.21.15.49:0/620750238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4b40a8b10 msgr2=0x7fb4b4157740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:11.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.788+0000 7fb4ba800700 1 --2- 172.21.15.49:0/620750238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4b40a8b10 0x7fb4b4157740 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7fb49c006fd0 tx=0x7fb49c0090f0).stop 2024-01-22T05:19:11.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.788+0000 7fb4ba800700 1 -- 172.21.15.49:0/620750238 shutdown_connections 2024-01-22T05:19:11.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.788+0000 7fb4ba800700 1 --2- 172.21.15.49:0/620750238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b40a8f90 0x7fb4b4157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.788+0000 7fb4ba800700 1 --2- 172.21.15.49:0/620750238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4b40a8b10 0x7fb4b4157740 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.788+0000 7fb4ba800700 1 -- 172.21.15.49:0/620750238 >> 172.21.15.49:0/620750238 conn(0x7fb4b40c6540 msgr2=0x7fb4b40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:11.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.788+0000 7fb4ba800700 1 -- 172.21.15.49:0/620750238 shutdown_connections 2024-01-22T05:19:11.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.792+0000 7fb4ba800700 1 -- 172.21.15.49:0/620750238 wait complete. 2024-01-22T05:19:11.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.792+0000 7fb4ba800700 1 Processor -- start 2024-01-22T05:19:11.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.792+0000 7fb4ba800700 1 -- start start 2024-01-22T05:19:11.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4ba800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4b4066fb0 0x7fb4b40be940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:11.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4ba800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b40a8b10 0x7fb4b4168e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:11.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4ba800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4b40a8f90 0x7fb4b416ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:11.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4ba800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b40bf5a0 con 0x7fb4b4066fb0 2024-01-22T05:19:11.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4ba800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b40bd8c0 con 0x7fb4b40a8f90 2024-01-22T05:19:11.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4ba800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b416c900 con 0x7fb4b40a8b10 2024-01-22T05:19:11.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4b3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4b4066fb0 0x7fb4b40be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4b3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4b4066fb0 0x7fb4b40be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47902/0 (socket says 172.21.15.49:47902) 2024-01-22T05:19:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4b3400700 1 -- 172.21.15.49:0/3932103209 learned_addr learned my addr 172.21.15.49:0/3932103209 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4b3e00700 1 --2- 172.21.15.49:0/3932103209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4b40a8f90 0x7fb4b416ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4b2a00700 1 --2- 172.21.15.49:0/3932103209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b40a8b10 0x7fb4b4168e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4b3400700 1 -- 172.21.15.49:0/3932103209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b40a8b10 msgr2=0x7fb4b4168e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4b3400700 1 --2- 172.21.15.49:0/3932103209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b40a8b10 0x7fb4b4168e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4b3400700 1 -- 172.21.15.49:0/3932103209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4b40a8f90 msgr2=0x7fb4b416ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4b3400700 1 --2- 172.21.15.49:0/3932103209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4b40a8f90 0x7fb4b416ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4b3400700 1 -- 172.21.15.49:0/3932103209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c009370 con 0x7fb4b4066fb0 2024-01-22T05:19:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4b3e00700 1 --2- 172.21.15.49:0/3932103209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4b40a8f90 0x7fb4b416ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4b3400700 1 --2- 172.21.15.49:0/3932103209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4b4066fb0 0x7fb4b40be940 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7fb4a400c4c0 tx=0x7fb4a4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:11.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4aaa00700 1 -- 172.21.15.49:0/3932103209 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4007020 con 0x7fb4b4066fb0 2024-01-22T05:19:11.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4aaa00700 1 -- 172.21.15.49:0/3932103209 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a4001e90 con 0x7fb4b4066fb0 2024-01-22T05:19:11.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4ba800700 1 -- 172.21.15.49:0/3932103209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b416cbe0 con 0x7fb4b4066fb0 2024-01-22T05:19:11.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4aaa00700 1 -- 172.21.15.49:0/3932103209 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a40073b0 con 0x7fb4b4066fb0 2024-01-22T05:19:11.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.796+0000 7fb4ba800700 1 -- 172.21.15.49:0/3932103209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b416d1a0 con 0x7fb4b4066fb0 2024-01-22T05:19:11.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.800+0000 7fb4ba800700 1 -- 172.21.15.49:0/3932103209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b4047060 con 0x7fb4b4066fb0 2024-01-22T05:19:11.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.800+0000 7fb4aaa00700 1 -- 172.21.15.49:0/3932103209 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb4a40068b0 con 0x7fb4b4066fb0 2024-01-22T05:19:11.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.800+0000 7fb4aaa00700 1 --2- 172.21.15.49:0/3932103209 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb48c05a4e0 0x7fb48c05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:11.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.800+0000 7fb4aaa00700 1 -- 172.21.15.49:0/3932103209 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb4a4074320 con 0x7fb4b4066fb0 2024-01-22T05:19:11.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.800+0000 7fb4b2a00700 1 --2- 172.21.15.49:0/3932103209 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb48c05a4e0 0x7fb48c05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:11.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.800+0000 7fb4b2a00700 1 --2- 172.21.15.49:0/3932103209 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb48c05a4e0 0x7fb48c05c9a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fb49c009fd0 tx=0x7fb49c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:11.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.808+0000 7fb4aaa00700 1 -- 172.21.15.49:0/3932103209 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb4a40479a0 con 0x7fb4b4066fb0 2024-01-22T05:19:11.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.976+0000 7fb4ba800700 1 -- 172.21.15.49:0/3932103209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4b40c1890 con 0x7fb4b4066fb0 2024-01-22T05:19:11.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.976+0000 7fb4aaa00700 1 -- 172.21.15.49:0/3932103209 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+17178 (secure 0 0 0) 0x7fb4a404afc0 con 0x7fb4b4066fb0 2024-01-22T05:19:11.978 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:11.978 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":184,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:19:09.074168+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:19:06.223141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-01-22T05:19:07.103306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:19:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.980+0000 7fb4ba800700 1 -- 172.21.15.49:0/3932103209 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb48c05a4e0 msgr2=0x7fb48c05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.980+0000 7fb4ba800700 1 --2- 172.21.15.49:0/3932103209 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb48c05a4e0 0x7fb48c05c9a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fb49c009fd0 tx=0x7fb49c017000).stop 2024-01-22T05:19:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.980+0000 7fb4ba800700 1 -- 172.21.15.49:0/3932103209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4b4066fb0 msgr2=0x7fb4b40be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.980+0000 7fb4ba800700 1 --2- 172.21.15.49:0/3932103209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4b4066fb0 0x7fb4b40be940 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7fb4a400c4c0 tx=0x7fb4a4007e00).stop 2024-01-22T05:19:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.980+0000 7fb4ba800700 1 -- 172.21.15.49:0/3932103209 shutdown_connections 2024-01-22T05:19:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.980+0000 7fb4ba800700 1 --2- 172.21.15.49:0/3932103209 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb48c05a4e0 0x7fb48c05c9a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.980+0000 7fb4ba800700 1 --2- 172.21.15.49:0/3932103209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4b40a8f90 0x7fb4b416ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.980+0000 7fb4ba800700 1 --2- 172.21.15.49:0/3932103209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b40a8b10 0x7fb4b4168e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.980+0000 7fb4ba800700 1 --2- 172.21.15.49:0/3932103209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4b4066fb0 0x7fb4b40be940 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.980+0000 7fb4ba800700 1 -- 172.21.15.49:0/3932103209 >> 172.21.15.49:0/3932103209 conn(0x7fb4b40c6540 msgr2=0x7fb4b4154930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.980+0000 7fb4ba800700 1 -- 172.21.15.49:0/3932103209 shutdown_connections 2024-01-22T05:19:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:11.980+0000 7fb4ba800700 1 -- 172.21.15.49:0/3932103209 wait complete. 2024-01-22T05:19:12.003 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:19:12.004 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:19:12.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.180+0000 7fba03000700 1 Processor -- start 2024-01-22T05:19:12.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.180+0000 7fba03000700 1 -- start start 2024-01-22T05:19:12.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fba03000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9fc155d20 0x7fb9fc065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:12.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fba03000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc0c1a40 con 0x7fb9fc066070 2024-01-22T05:19:12.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fba03000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc159310 con 0x7fb9fc0a8e50 2024-01-22T05:19:12.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fba03000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0c13f0 con 0x7fb9fc155d20 2024-01-22T05:19:12.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fb9fb400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb9fc066070 0x7fb9fc0a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58336/0 (socket says 172.21.15.49:58336) 2024-01-22T05:19:12.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fb9fb400700 1 -- 172.21.15.49:0/3880207778 learned_addr learned my addr 172.21.15.49:0/3880207778 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:12.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fb9fbe00700 1 --2- 172.21.15.49:0/3880207778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9fc155d20 0x7fb9fc065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:12.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fb9faa00700 1 -- 172.21.15.49:0/3880207778 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831516821 0 0) 0x7fb9fc0c1a40 con 0x7fb9fc066070 2024-01-22T05:19:12.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fb9faa00700 1 -- 172.21.15.49:0/3880207778 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9dc0033f0 con 0x7fb9fc066070 2024-01-22T05:19:12.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fb9faa00700 1 -- 172.21.15.49:0/3880207778 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226808656 0 0) 0x7fb9fc159310 con 0x7fb9fc0a8e50 2024-01-22T05:19:12.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fb9faa00700 1 -- 172.21.15.49:0/3880207778 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9fc0c1a40 con 0x7fb9fc0a8e50 2024-01-22T05:19:12.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fb9fbe00700 1 -- 172.21.15.49:0/3880207778 >> v1:172.21.15.110:6789/0 conn(0x7fb9fc0a8e50 legacy=0x7fb9fc0c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:12.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fb9fbe00700 1 -- 172.21.15.49:0/3880207778 >> v1:172.21.15.49:6789/0 conn(0x7fb9fc066070 legacy=0x7fb9fc0a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:12.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fb9fbe00700 1 -- 172.21.15.49:0/3880207778 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc0c16d0 con 0x7fb9fc155d20 2024-01-22T05:19:12.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fb9fbe00700 1 --2- 172.21.15.49:0/3880207778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9fc155d20 0x7fb9fc065b80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fb9ec009790 tx=0x7fb9ec009060).ready entity=mon.2 client_cookie=cb8690c4b0fdc78e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:12.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.184+0000 7fb9faa00700 1 -- 172.21.15.49:0/3880207778 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00f510 con 0x7fb9fc155d20 2024-01-22T05:19:12.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.188+0000 7fb9faa00700 1 -- 172.21.15.49:0/3880207778 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec00f670 con 0x7fb9fc155d20 2024-01-22T05:19:12.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.188+0000 7fb9faa00700 1 -- 172.21.15.49:0/3880207778 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00f9f0 con 0x7fb9fc155d20 2024-01-22T05:19:12.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.188+0000 7fba03000700 1 -- 172.21.15.49:0/3880207778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9fc155d20 msgr2=0x7fb9fc065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:12.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.188+0000 7fba03000700 1 --2- 172.21.15.49:0/3880207778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9fc155d20 0x7fb9fc065b80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fb9ec009790 tx=0x7fb9ec009060).stop 2024-01-22T05:19:12.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.188+0000 7fba03000700 1 -- 172.21.15.49:0/3880207778 shutdown_connections 2024-01-22T05:19:12.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.188+0000 7fba03000700 1 --2- 172.21.15.49:0/3880207778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9fc155d20 0x7fb9fc065b80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.188+0000 7fba03000700 1 -- 172.21.15.49:0/3880207778 >> 172.21.15.49:0/3880207778 conn(0x7fb9fc0c6540 msgr2=0x7fb9fc0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:12.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.188+0000 7fba03000700 1 -- 172.21.15.49:0/3880207778 shutdown_connections 2024-01-22T05:19:12.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.188+0000 7fba03000700 1 -- 172.21.15.49:0/3880207778 wait complete. 2024-01-22T05:19:12.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.192+0000 7fba03000700 1 Processor -- start 2024-01-22T05:19:12.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.192+0000 7fba03000700 1 -- start start 2024-01-22T05:19:12.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.192+0000 7fba03000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9fc066070 0x7fb9fc14bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:12.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.192+0000 7fba03000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9fc0a8e50 0x7fb9fc0bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:12.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.192+0000 7fba03000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9fc155d20 0x7fb9fc168660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:12.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.192+0000 7fba03000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0ab0c0 con 0x7fb9fc066070 2024-01-22T05:19:12.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.192+0000 7fba03000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc169500 con 0x7fb9fc155d20 2024-01-22T05:19:12.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.192+0000 7fba03000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0ac190 con 0x7fb9fc0a8e50 2024-01-22T05:19:12.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.192+0000 7fb9fbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9fc066070 0x7fb9fc14bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:12.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.192+0000 7fb9fbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9fc066070 0x7fb9fc14bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47912/0 (socket says 172.21.15.49:47912) 2024-01-22T05:19:12.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.192+0000 7fb9fbe00700 1 -- 172.21.15.49:0/4273764563 learned_addr learned my addr 172.21.15.49:0/4273764563 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:12.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.192+0000 7fba01000700 1 --2- 172.21.15.49:0/4273764563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9fc155d20 0x7fb9fc168660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:12.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.192+0000 7fb9fb400700 1 --2- 172.21.15.49:0/4273764563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9fc0a8e50 0x7fb9fc0bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:12.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.196+0000 7fb9fbe00700 1 -- 172.21.15.49:0/4273764563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9fc0a8e50 msgr2=0x7fb9fc0bd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:12.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.196+0000 7fb9fbe00700 1 --2- 172.21.15.49:0/4273764563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9fc0a8e50 0x7fb9fc0bd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.196+0000 7fb9fbe00700 1 -- 172.21.15.49:0/4273764563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9fc155d20 msgr2=0x7fb9fc168660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:12.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.196+0000 7fb9fbe00700 1 --2- 172.21.15.49:0/4273764563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9fc155d20 0x7fb9fc168660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.196+0000 7fb9fbe00700 1 -- 172.21.15.49:0/4273764563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec0092a0 con 0x7fb9fc066070 2024-01-22T05:19:12.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.196+0000 7fb9fb400700 1 --2- 172.21.15.49:0/4273764563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9fc0a8e50 0x7fb9fc0bd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:12.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.196+0000 7fb9fbe00700 1 --2- 172.21.15.49:0/4273764563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9fc066070 0x7fb9fc14bb60 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 rx=0x7fb9fc059c60 tx=0x7fb9ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:12.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.196+0000 7fb9f3400700 1 -- 172.21.15.49:0/4273764563 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00f7e0 con 0x7fb9fc066070 2024-01-22T05:19:12.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.196+0000 7fb9f3400700 1 -- 172.21.15.49:0/4273764563 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec00f940 con 0x7fb9fc066070 2024-01-22T05:19:12.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.196+0000 7fba03000700 1 -- 172.21.15.49:0/4273764563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9fc0ac470 con 0x7fb9fc066070 2024-01-22T05:19:12.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.196+0000 7fb9f3400700 1 -- 172.21.15.49:0/4273764563 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec01b660 con 0x7fb9fc066070 2024-01-22T05:19:12.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.196+0000 7fba03000700 1 -- 172.21.15.49:0/4273764563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc0aad50 con 0x7fb9fc066070 2024-01-22T05:19:12.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.196+0000 7fba03000700 1 -- 172.21.15.49:0/4273764563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9fc047060 con 0x7fb9fc066070 2024-01-22T05:19:12.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.200+0000 7fb9f3400700 1 -- 172.21.15.49:0/4273764563 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb9ec01b9d0 con 0x7fb9fc066070 2024-01-22T05:19:12.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.200+0000 7fb9f3400700 1 --2- 172.21.15.49:0/4273764563 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9d405a510 0x7fb9d405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:12.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.200+0000 7fb9f3400700 1 -- 172.21.15.49:0/4273764563 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb9ec076150 con 0x7fb9fc066070 2024-01-22T05:19:12.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.200+0000 7fb9fb400700 1 --2- 172.21.15.49:0/4273764563 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9d405a510 0x7fb9d405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:12.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.200+0000 7fb9fb400700 1 --2- 172.21.15.49:0/4273764563 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9d405a510 0x7fb9d405c9d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7fb9fc154d10 tx=0x7fb9e4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:12.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.208+0000 7fb9f3400700 1 -- 172.21.15.49:0/4273764563 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb9ec049710 con 0x7fb9fc066070 2024-01-22T05:19:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.384+0000 7fba03000700 1 -- 172.21.15.49:0/4273764563 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9fc0ab200 con 0x7fb9d405a510 2024-01-22T05:19:12.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.392+0000 7fb9f3400700 1 -- 172.21.15.49:0/4273764563 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350721 (secure 0 0 0) 0x7fb9e4001d50 con 0x7fb9d405a510 2024-01-22T05:19:12.400 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:12.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.404+0000 7fba03000700 1 -- 172.21.15.49:0/4273764563 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9d405a510 msgr2=0x7fb9d405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:12.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.404+0000 7fba03000700 1 --2- 172.21.15.49:0/4273764563 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9d405a510 0x7fb9d405c9d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7fb9fc154d10 tx=0x7fb9e4009040).stop 2024-01-22T05:19:12.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.404+0000 7fba03000700 1 -- 172.21.15.49:0/4273764563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9fc066070 msgr2=0x7fb9fc14bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:12.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.404+0000 7fba03000700 1 --2- 172.21.15.49:0/4273764563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9fc066070 0x7fb9fc14bb60 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 rx=0x7fb9fc059c60 tx=0x7fb9ec017000).stop 2024-01-22T05:19:12.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.404+0000 7fba03000700 1 -- 172.21.15.49:0/4273764563 shutdown_connections 2024-01-22T05:19:12.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.404+0000 7fba03000700 1 --2- 172.21.15.49:0/4273764563 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb9d405a510 0x7fb9d405c9d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.404+0000 7fba03000700 1 --2- 172.21.15.49:0/4273764563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9fc155d20 0x7fb9fc168660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.404+0000 7fba03000700 1 --2- 172.21.15.49:0/4273764563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9fc0a8e50 0x7fb9fc0bd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.404+0000 7fba03000700 1 --2- 172.21.15.49:0/4273764563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9fc066070 0x7fb9fc14bb60 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.404+0000 7fba03000700 1 -- 172.21.15.49:0/4273764563 >> 172.21.15.49:0/4273764563 conn(0x7fb9fc0c6540 msgr2=0x7fb9fc0c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:12.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.404+0000 7fba03000700 1 -- 172.21.15.49:0/4273764563 shutdown_connections 2024-01-22T05:19:12.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.404+0000 7fba03000700 1 -- 172.21.15.49:0/4273764563 wait complete. 2024-01-22T05:19:12.406 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:19:12.428 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":619,"stamp":"2024-01-22T05:19:11.558064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2465168,"kb_used_data":17744,"kb_used_omap":0,"kb_used_meta":2447360,"kb_avail":752509552,"statfs":{"total":773094113280,"available":770569781248,"internally_reserved":0,"allocated":18169856,"data_stored":9042144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506096640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2306,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.000570"},"pg_stats":[{"pgid":"27.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.627188+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.622888+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.616928+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.621457+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625146+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.626417+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624310+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.618599+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.626590+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.627158+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.614615+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.619225+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.613626+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624094+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624184+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625894+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.629403+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.613091+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612444+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.626225+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.623467+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624717+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.620053+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.623496+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.631976+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.615221+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.621414+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625540+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.615113+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.613952+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.623520+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625306+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.626029+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612442+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.626503+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.619306+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612690+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612395+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624566+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.623630+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625462+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.613870+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625840+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.631029+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624399+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.619505+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.619190+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.622733+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.631398+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.620053+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624150+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.631464+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.620132+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625236+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612396+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.616919+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.616806+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":147,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.233265+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:19:04.233265+0000","last_peered":"2024-01-22T05:19:04.233265+0000","last_clean":"2024-01-22T05:19:04.233265+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:19:04.233265+0000","last_undegraded":"2024-01-22T05:19:04.233265+0000","last_fullsized":"2024-01-22T05:19:04.233265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.614588+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.011159+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:19:04.011159+0000","last_peered":"2024-01-22T05:19:04.011159+0000","last_clean":"2024-01-22T05:19:04.011159+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:19:04.011159+0000","last_undegraded":"2024-01-22T05:19:04.011159+0000","last_fullsized":"2024-01-22T05:19:04.011159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.632258+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.232965+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:19:04.232965+0000","last_peered":"2024-01-22T05:19:04.232965+0000","last_clean":"2024-01-22T05:19:04.232965+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:19:04.232965+0000","last_undegraded":"2024-01-22T05:19:04.232965+0000","last_fullsized":"2024-01-22T05:19:04.232965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.621207+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.011129+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:19:04.011129+0000","last_peered":"2024-01-22T05:19:04.011129+0000","last_clean":"2024-01-22T05:19:04.011129+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:19:04.011129+0000","last_undegraded":"2024-01-22T05:19:04.011129+0000","last_fullsized":"2024-01-22T05:19:04.011129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624185+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":173,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:03.761763+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:19:03.761763+0000","last_peered":"2024-01-22T05:19:03.761763+0000","last_clean":"2024-01-22T05:19:03.761763+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:19:03.761763+0000","last_undegraded":"2024-01-22T05:19:03.761763+0000","last_fullsized":"2024-01-22T05:19:03.761763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624794+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:03.766367+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:19:03.766367+0000","last_peered":"2024-01-22T05:19:03.766367+0000","last_clean":"2024-01-22T05:19:03.766367+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:19:03.766367+0000","last_undegraded":"2024-01-22T05:19:03.766367+0000","last_fullsized":"2024-01-22T05:19:03.766367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612989+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":141,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.232984+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:19:04.232984+0000","last_peered":"2024-01-22T05:19:04.232984+0000","last_clean":"2024-01-22T05:19:04.232984+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:19:04.232984+0000","last_undegraded":"2024-01-22T05:19:04.232984+0000","last_fullsized":"2024-01-22T05:19:04.232984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.617386+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":173,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:03.761747+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:19:03.761747+0000","last_peered":"2024-01-22T05:19:03.761747+0000","last_clean":"2024-01-22T05:19:03.761747+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:19:03.761747+0000","last_undegraded":"2024-01-22T05:19:03.761747+0000","last_fullsized":"2024-01-22T05:19:03.761747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":142,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.232985+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:19:04.232985+0000","last_peered":"2024-01-22T05:19:04.232985+0000","last_clean":"2024-01-22T05:19:04.232985+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:19:04.232985+0000","last_undegraded":"2024-01-22T05:19:04.232985+0000","last_fullsized":"2024-01-22T05:19:04.232985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575026,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307628,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064212,"statfs":{"total":96636764160,"available":96321753088,"internally_reserved":0,"allocated":2265088,"data_stored":1126981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2450000000000001,"15min":1.0760000000000001},"min":{"1min":0.83299999999999996,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.5209999999999999,"5min":14.779999999999999,"15min":14.779999999999999},"last":1.196},{"interface":"front","average":{"1min":1.145,"5min":2.0070000000000001,"15min":1.3759999999999999},"min":{"1min":0.80000000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.55,"5min":76.662000000000006,"15min":76.662000000000006},"last":1.1539999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.167,"15min":1.0589999999999999},"min":{"1min":0.86199999999999999,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.4650000000000001,"5min":4.9269999999999996,"15min":4.9269999999999996},"last":1.107},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2989999999999999,"15min":1.2030000000000001},"min":{"1min":0.88,"5min":0.71599999999999997,"15min":0.58999999999999997},"max":{"1min":1.655,"5min":12.691000000000001,"15min":12.691000000000001},"last":1.28}]},{"osd":2,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1579999999999999,"15min":1.125},"min":{"1min":0.77800000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5700000000000001,"5min":2.1589999999999998,"15min":2.5150000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.355,"15min":1.2210000000000001},"min":{"1min":0.97699999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5449999999999999,"5min":15.036,"15min":15.036},"last":1.256}]},{"osd":3,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.9339999999999999,"15min":1.4470000000000001},"min":{"1min":0.92300000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.748,"5min":64.983999999999995,"15min":64.983999999999995},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.4299999999999999,"15min":1.2949999999999999},"min":{"1min":1.0029999999999999,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":1.714,"5min":15.073,"15min":15.073},"last":1.393}]},{"osd":4,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.415,"15min":1.1850000000000001},"min":{"1min":0.77900000000000003,"5min":0.53000000000000003,"15min":0.32900000000000001},"max":{"1min":1.504,"5min":22.239000000000001,"15min":22.239000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.28,"5min":1.5269999999999999,"15min":1.2669999999999999},"min":{"1min":0.92000000000000004,"5min":0.68799999999999994,"15min":0.52200000000000002},"max":{"1min":1.9830000000000001,"5min":27.872,"15min":27.872},"last":1.042}]},{"osd":5,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":2.0110000000000001,"15min":1.452},"min":{"1min":0.88100000000000001,"5min":0.67400000000000004,"15min":0.40400000000000003},"max":{"1min":1.6279999999999999,"5min":65.652000000000001,"15min":65.652000000000001},"last":1.331},{"interface":"front","average":{"1min":1.387,"5min":1.341,"15min":1.2869999999999999},"min":{"1min":1.0589999999999999,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":2.1539999999999999,"5min":2.1629999999999998,"15min":3.625},"last":1.456}]},{"osd":6,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.363,"15min":1.262},"min":{"1min":0.997,"5min":0.80700000000000005,"15min":0.53400000000000003},"max":{"1min":2.3580000000000001,"5min":6.9939999999999998,"15min":6.9939999999999998},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.54,"15min":1.411},"min":{"1min":1.224,"5min":0.82999999999999996,"15min":0.56100000000000005},"max":{"1min":2.0600000000000001,"5min":12.965,"15min":12.965},"last":1.6240000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575026,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307628,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064212,"statfs":{"total":96636764160,"available":96321753088,"internally_reserved":0,"allocated":2265088,"data_stored":1126981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.0580000000000001,"15min":1.2849999999999999},"min":{"1min":0.72999999999999998,"5min":0.66600000000000004,"15min":0.35999999999999999},"max":{"1min":1.927,"5min":1.927,"15min":77.745000000000005},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0429999999999999,"15min":1.0780000000000001},"min":{"1min":0.64500000000000002,"5min":0.57499999999999996,"15min":0.44},"max":{"1min":1.5,"5min":1.74,"15min":13.555999999999999},"last":0.90200000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.0740000000000001,"15min":1.125},"min":{"1min":0.91300000000000003,"5min":0.56999999999999995,"15min":0.40000000000000002},"max":{"1min":1.3240000000000001,"5min":1.554,"15min":15.499000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.117,"15min":1.155},"min":{"1min":0.76200000000000001,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.6379999999999999,"5min":1.702,"15min":7.7629999999999999},"last":1.1599999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1850000000000001,"15min":1.165},"min":{"1min":0.89000000000000001,"5min":0.84999999999999998,"15min":0.57399999999999995},"max":{"1min":1.4199999999999999,"5min":1.667,"15min":3.0960000000000001},"last":1.24},{"interface":"front","average":{"1min":1.161,"5min":1.1359999999999999,"15min":1.145},"min":{"1min":0.747,"5min":0.68999999999999995,"15min":0.38200000000000001},"max":{"1min":1.401,"5min":1.7390000000000001,"15min":4.9660000000000002},"last":1.1140000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.173,"15min":1.486},"min":{"1min":0.97899999999999998,"5min":0.66700000000000004,"15min":0.59299999999999997},"max":{"1min":1.4610000000000001,"5min":2.343,"15min":102.08199999999999},"last":1.014},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.82599999999999996,"5min":0.66300000000000003,"15min":0.374},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":15.468},"last":0.86299999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1799999999999999,"15min":1.147},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.495},"max":{"1min":1.6040000000000001,"5min":1.631,"15min":3.1749999999999998},"last":1.089},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.204,"15min":1.165},"min":{"1min":0.82799999999999996,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.6910000000000001,"5min":2.5489999999999999,"15min":5.1200000000000001},"last":1.2629999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1499999999999999,"15min":1.2430000000000001},"min":{"1min":0.93000000000000005,"5min":0.58699999999999997,"15min":0.48099999999999998},"max":{"1min":1.6020000000000001,"5min":1.7829999999999999,"15min":30.533000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.294,"15min":1.278},"min":{"1min":1.0029999999999999,"5min":0.79500000000000004,"15min":0.46600000000000003},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":3.875},"last":1.3100000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3500000000000001,"15min":1.4279999999999999},"min":{"1min":0.97999999999999998,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":1.6379999999999999,"5min":2.7490000000000001,"15min":23.547999999999998},"last":1.204},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3149999999999999,"15min":1.5509999999999999},"min":{"1min":0.80200000000000005,"5min":0.77700000000000002,"15min":0.495},"max":{"1min":1.7110000000000001,"5min":1.9019999999999999,"15min":63.737000000000002},"last":0.93600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575026,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307628,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064212,"statfs":{"total":96636764160,"available":96321753088,"internally_reserved":0,"allocated":2265088,"data_stored":1126981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0089999999999999,"15min":1.0129999999999999},"min":{"1min":0.58599999999999997,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.556,"5min":1.651,"15min":2.0609999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0529999999999999,"15min":1.042},"min":{"1min":0.61699999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5840000000000001,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.1539999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.224,"15min":1.1850000000000001},"min":{"1min":0.85099999999999998,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.6619999999999999,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2050000000000001,"15min":1.2},"min":{"1min":0.879,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.6140000000000001,"5min":1.9930000000000001,"15min":2.0209999999999999},"last":1.2030000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1479999999999999,"15min":1.135},"min":{"1min":0.80700000000000005,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.4370000000000001,"5min":1.9219999999999999,"15min":1.925},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.145,"15min":1.115},"min":{"1min":0.82499999999999996,"5min":0.71799999999999997,"15min":0.59899999999999998},"max":{"1min":1.4410000000000001,"5min":1.982,"15min":1.982},"last":1.097}]},{"osd":3,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.216,"15min":1.1599999999999999},"min":{"1min":0.71199999999999997,"5min":0.69799999999999995,"15min":0.66900000000000004},"max":{"1min":1.5660000000000001,"5min":3.202,"15min":3.202},"last":1.516},{"interface":"front","average":{"1min":1.246,"5min":1.1899999999999999,"15min":1.2090000000000001},"min":{"1min":0.98199999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.546,"5min":1.6830000000000001,"15min":4.8819999999999997},"last":1.0720000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.103,"15min":1.097},"min":{"1min":0.77700000000000002,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.5369999999999999,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.006},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1950000000000001,"15min":1.1779999999999999},"min":{"1min":0.78000000000000003,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.4430000000000001,"5min":2.081,"15min":2.081},"last":1.333}]},{"osd":6,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.226,"15min":1.2190000000000001},"min":{"1min":0.97999999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.482,"5min":2.0099999999999998,"15min":2.2010000000000001},"last":1.431},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.24,"15min":1.2410000000000001},"min":{"1min":0.71899999999999997,"5min":0.70699999999999996,"15min":0.55900000000000005},"max":{"1min":1.4530000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.22}]},{"osd":7,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3169999999999999,"15min":1.304},"min":{"1min":0.91400000000000003,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.7410000000000001,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.458},{"interface":"front","average":{"1min":1.371,"5min":1.3420000000000001,"15min":1.3360000000000001},"min":{"1min":0.96099999999999997,"5min":0.72699999999999998,"15min":0.60799999999999998},"max":{"1min":1.6819999999999999,"5min":1.8859999999999999,"15min":3.1840000000000002},"last":1.367}]}]},{"osd":4,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299436,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072404,"statfs":{"total":96636764160,"available":96330141696,"internally_reserved":0,"allocated":2265088,"data_stored":1126981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1279999999999999,"15min":1.103},"min":{"1min":0.81000000000000005,"5min":0.63700000000000001,"15min":0.47799999999999998},"max":{"1min":1.4379999999999999,"5min":1.696,"15min":2.0150000000000001},"last":1.7809999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1950000000000001,"15min":1.147},"min":{"1min":0.92100000000000004,"5min":0.75700000000000001,"15min":0.48899999999999999},"max":{"1min":1.548,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.639}]},{"osd":1,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.091,"15min":1.0760000000000001},"min":{"1min":0.77800000000000002,"5min":0.59899999999999998,"15min":0.53100000000000003},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.125},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.82199999999999995,"5min":0.52500000000000002,"15min":0.46000000000000002},"max":{"1min":1.3879999999999999,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":1.4139999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0760000000000001,"15min":1.0720000000000001},"min":{"1min":0.79500000000000004,"5min":0.66400000000000003,"15min":0.49199999999999999},"max":{"1min":1.361,"5min":1.516,"15min":5.3390000000000004},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.204,"5min":1.149,"15min":1.161},"min":{"1min":0.88,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5089999999999999,"5min":1.6140000000000001,"15min":2.3479999999999999},"last":1.621}]},{"osd":3,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.149,"15min":1.135},"min":{"1min":0.86799999999999999,"5min":0.65700000000000003,"15min":0.496},"max":{"1min":1.478,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.522},{"interface":"front","average":{"1min":1.2,"5min":1.1719999999999999,"15min":1.1499999999999999},"min":{"1min":0.97199999999999998,"5min":0.67700000000000005,"15min":0.53100000000000003},"max":{"1min":1.4039999999999999,"5min":2.2959999999999998,"15min":5.3029999999999999},"last":1.452}]},{"osd":5,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.113,"15min":1.1180000000000001},"min":{"1min":0.76200000000000001,"5min":0.63500000000000001,"15min":0.54100000000000004},"max":{"1min":1.365,"5min":1.6899999999999999,"15min":2.0790000000000002},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.2070000000000001,"15min":1.133},"min":{"1min":0.94299999999999995,"5min":0.68200000000000005,"15min":0.52200000000000002},"max":{"1min":1.583,"5min":1.8240000000000001,"15min":2.0030000000000001},"last":1.7150000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.149,"15min":1.1439999999999999},"min":{"1min":0.88100000000000001,"5min":0.67400000000000004,"15min":0.44500000000000001},"max":{"1min":1.387,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.28,"15min":1.27},"min":{"1min":0.98999999999999999,"5min":0.73699999999999999,"15min":0.51900000000000002},"max":{"1min":1.45,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":1.6899999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3500000000000001,"15min":1.3120000000000001},"min":{"1min":1.0700000000000001,"5min":0.74099999999999999,"15min":0.59399999999999997},"max":{"1min":1.6299999999999999,"5min":1.8999999999999999,"15min":2.2839999999999998},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.94999999999999996,"5min":0.89300000000000002,"15min":0.56899999999999995},"max":{"1min":1.5049999999999999,"5min":1.843,"15min":5.2629999999999999},"last":1.5920000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575026,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303544,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068296,"statfs":{"total":96636764160,"available":96325935104,"internally_reserved":0,"allocated":2277376,"data_stored":1133555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.85699999999999998},"min":{"1min":0.50800000000000001,"5min":0.41099999999999998,"15min":0.34200000000000003},"max":{"1min":1.175,"5min":1.512,"15min":14.859},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.63400000000000001,"5min":0.42699999999999999,"15min":0.317},"max":{"1min":1.371,"5min":1.804,"15min":5.0919999999999996},"last":1.1579999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.90900000000000003,"15min":0.90300000000000002},"min":{"1min":0.62,"5min":0.50600000000000001,"15min":0.39300000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":6.5570000000000004},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.95699999999999996,"15min":0.97099999999999997},"min":{"1min":0.55800000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.482,"5min":1.7669999999999999,"15min":5.7519999999999998},"last":1.0349999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.085,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48599999999999999,"15min":0.40600000000000003},"max":{"1min":1.6910000000000001,"5min":1.8680000000000001,"15min":2.391},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.157,"15min":1.1819999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.44800000000000001},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":4.1429999999999998},"last":1.3360000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.323,"15min":1.331},"min":{"1min":0.86699999999999999,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.831,"5min":2.423,"15min":10.858000000000001},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.292,"15min":1.337},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.63600000000000001},"max":{"1min":1.6379999999999999,"5min":2.3359999999999999,"15min":10.846},"last":1.4410000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.238,"15min":1.2829999999999999},"min":{"1min":0.99399999999999999,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.595,"5min":1.7709999999999999,"15min":7.3639999999999999},"last":1.208},{"interface":"front","average":{"1min":1.351,"5min":1.3089999999999999,"15min":1.381},"min":{"1min":0.92700000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.738,"5min":6.3220000000000001,"15min":14.523999999999999},"last":1.292}]},{"osd":6,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.369,"15min":1.357},"min":{"1min":0.92700000000000005,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.77,"5min":2.1819999999999999,"15min":4.9809999999999999},"last":1.665},{"interface":"front","average":{"1min":1.413,"5min":1.3720000000000001,"15min":1.3879999999999999},"min":{"1min":1.113,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":5.4210000000000003},"last":1.284}]},{"osd":7,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.3340000000000001,"15min":1.363},"min":{"1min":0.96999999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.004,"5min":2.004,"15min":5.7160000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.381,"15min":1.409},"min":{"1min":1.0860000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8839999999999999,"5min":2.5449999999999999,"15min":6.4279999999999999},"last":1.7430000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575026,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315832,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":94056008,"statfs":{"total":96636764160,"available":96313352192,"internally_reserved":0,"allocated":2277376,"data_stored":1133555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.54100000000000004,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":1.1919999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85499999999999998,"15min":0.85399999999999998},"min":{"1min":0.53900000000000003,"5min":0.45300000000000001,"15min":0.373},"max":{"1min":1.1899999999999999,"5min":1.556,"15min":1.7350000000000001},"last":1.2430000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92600000000000005,"15min":0.86899999999999999},"min":{"1min":0.55400000000000005,"5min":0.46800000000000003,"15min":0.41299999999999998},"max":{"1min":1.8400000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.109,"5min":1,"15min":0.95799999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.41599999999999998},"max":{"1min":1.671,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.2010000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1659999999999999,"15min":1.137},"min":{"1min":0.66700000000000004,"5min":0.56200000000000006,"15min":0.47099999999999997},"max":{"1min":1.984,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.284},{"interface":"front","average":{"1min":1.296,"5min":1.2370000000000001,"15min":1.212},"min":{"1min":0.85999999999999999,"5min":0.64300000000000002,"15min":0.51100000000000001},"max":{"1min":1.7609999999999999,"5min":3.133,"15min":3.133},"last":1.5529999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.3140000000000001,"15min":1.278},"min":{"1min":1.0029999999999999,"5min":0.88500000000000001,"15min":0.59099999999999997},"max":{"1min":2.101,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.458},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.206,"15min":1.2010000000000001},"min":{"1min":0.74099999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":2.2829999999999999},"last":1.159}]},{"osd":5,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.2649999999999999,"15min":1.228},"min":{"1min":0.94699999999999995,"5min":0.84099999999999997,"15min":0.63800000000000001},"max":{"1min":2.1680000000000001,"5min":2.379,"15min":2.379},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.45,"5min":1.329,"15min":1.2909999999999999},"min":{"1min":1.181,"5min":0.84799999999999998,"15min":0.67000000000000004},"max":{"1min":2.1880000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.6479999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2609999999999999,"15min":1.254},"min":{"1min":0.79500000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":2.1920000000000002},"last":1.502},{"interface":"front","average":{"1min":1.47,"5min":1.3720000000000001,"15min":1.3160000000000001},"min":{"1min":0.98899999999999999,"5min":0.629,"15min":0.629},"max":{"1min":2.2759999999999998,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.673}]},{"osd":7,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3560000000000001,"15min":1.345},"min":{"1min":0.88500000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8200000000000001,"5min":1.9390000000000001,"15min":2.1749999999999998},"last":1.605},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.452,"15min":1.4219999999999999},"min":{"1min":1.121,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.2280000000000002,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.8819999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575027,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2277376,"data_stored":1133555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84899999999999998,"15min":0.86599999999999999},"min":{"1min":0.53500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.032,"5min":1.4830000000000001,"15min":3.4119999999999999},"last":0.997},{"interface":"front","average":{"1min":1.054,"5min":0.98099999999999998,"15min":0.997},"min":{"1min":0.66100000000000003,"5min":0.56999999999999995,"15min":0.41099999999999998},"max":{"1min":1.5089999999999999,"5min":1.6160000000000001,"15min":2.101},"last":0.81699999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.97499999999999998,"15min":0.98899999999999999},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.45500000000000002},"max":{"1min":1.3180000000000001,"5min":1.492,"15min":2.169},"last":1.095},{"interface":"front","average":{"1min":1.075,"5min":1.0589999999999999,"15min":1.0549999999999999},"min":{"1min":0.64900000000000002,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.478,"5min":1.5780000000000001,"15min":2.024},"last":1.0229999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.052,"15min":1.0429999999999999},"min":{"1min":0.73999999999999999,"5min":0.57399999999999995,"15min":0.38900000000000001},"max":{"1min":1.502,"5min":1.972,"15min":4.665},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.64600000000000002,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.2629999999999999,"5min":1.659,"15min":5.5830000000000002},"last":1.0620000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2110000000000001,"15min":1.2490000000000001},"min":{"1min":0.86299999999999999,"5min":0.60299999999999998,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":1.958,"15min":15.76},"last":1.173},{"interface":"front","average":{"1min":1.341,"5min":1.2809999999999999,"15min":1.333},"min":{"1min":0.90400000000000003,"5min":0.74099999999999999,"15min":0.63500000000000001},"max":{"1min":1.649,"5min":1.714,"15min":16.975000000000001},"last":1.3380000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.264,"15min":1.232},"min":{"1min":0.88200000000000001,"5min":0.72599999999999998,"15min":0.55700000000000005},"max":{"1min":1.6240000000000001,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.274,"15min":1.2789999999999999},"min":{"1min":0.97199999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.784,"5min":2.1309999999999998,"15min":2.52},"last":1.3740000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.266,"15min":1.2609999999999999},"min":{"1min":0.95099999999999996,"5min":0.68999999999999995,"15min":0.55600000000000005},"max":{"1min":1.53,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3,"15min":1.327},"min":{"1min":1.056,"5min":0.76200000000000001,"15min":0.68799999999999994},"max":{"1min":1.6459999999999999,"5min":2.0609999999999999,"15min":2.5569999999999999},"last":1.3}]},{"osd":7,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.339,"15min":1.355},"min":{"1min":0.96299999999999997,"5min":0.69999999999999996,"15min":0.68100000000000005},"max":{"1min":1.754,"5min":1.8999999999999999,"15min":4.4329999999999998},"last":1.133},{"interface":"front","average":{"1min":1.369,"5min":1.355,"15min":1.3520000000000001},"min":{"1min":1.0109999999999999,"5min":0.81100000000000005,"15min":0.64900000000000002},"max":{"1min":1.7010000000000001,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":1.395}]}]},{"osd":0,"up_from":13,"seq":55834575026,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2277376,"data_stored":1133555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.81799999999999995,"15min":0.88500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.28699999999999998},"max":{"1min":1.0609999999999999,"5min":1.4219999999999999,"15min":15.273},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.877,"5min":0.874,"15min":0.91300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.34499999999999997},"max":{"1min":1.3680000000000001,"5min":1.625,"15min":4.4009999999999998},"last":1.1399999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.97799999999999998,"15min":1.0449999999999999},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.46400000000000002},"max":{"1min":1.363,"5min":1.6299999999999999,"15min":15.473000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.069,"5min":1.0249999999999999,"15min":1.0269999999999999},"min":{"1min":0.67400000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5509999999999999,"5min":1.6850000000000001,"15min":1.7989999999999999},"last":1.3100000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.95899999999999996,"15min":0.97699999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.39000000000000001},"max":{"1min":1.302,"5min":1.5049999999999999,"15min":5.3970000000000002},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.069,"5min":1.1100000000000001,"15min":1.177},"min":{"1min":0.67200000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.5529999999999999,"5min":1.79,"15min":15.439},"last":1.2509999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.208,"15min":1.2470000000000001},"min":{"1min":0.81999999999999995,"5min":0.81399999999999995,"15min":0.61399999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":5.1799999999999997},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.214,"15min":1.216},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.56200000000000006},"max":{"1min":1.615,"5min":1.738,"15min":3.4340000000000002},"last":1.421}]},{"osd":5,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.272,"15min":1.27},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.67600000000000005},"max":{"1min":1.579,"5min":1.9099999999999999,"15min":3.548},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.306,"15min":1.321},"min":{"1min":0.90300000000000002,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.587,"5min":1.7210000000000001,"15min":2.823},"last":1.4590000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3300000000000001,"15min":1.407},"min":{"1min":0.91700000000000004,"5min":0.879,"15min":0.59099999999999997},"max":{"1min":1.6559999999999999,"5min":1.7909999999999999,"15min":15.4},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3200000000000001,"15min":1.3720000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.72499999999999998},"max":{"1min":1.7010000000000001,"5min":1.8919999999999999,"15min":7.1349999999999998},"last":1.371}]},{"osd":7,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3740000000000001,"15min":1.4219999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.79900000000000004},"max":{"1min":1.7969999999999999,"5min":2.145,"15min":5.29},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.3680000000000001,"15min":1.367},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.752},"max":{"1min":1.7230000000000001,"5min":2.0470000000000002,"15min":2.7269999999999999},"last":1.359}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:19:12.436 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:19:12.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.632+0000 7f9927a00700 1 Processor -- start 2024-01-22T05:19:12.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.632+0000 7f9927a00700 1 -- start start 2024-01-22T05:19:12.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.632+0000 7f9927a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99200ab890 0x7f99200abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:12.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.632+0000 7f9927a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9920065550 0x7f99200659c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:12.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.632+0000 7f9927a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9920068a60 con 0x7f99200bcfa0 2024-01-22T05:19:12.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.632+0000 7f9927a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200bb790 con 0x7f9920065550 2024-01-22T05:19:12.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.632+0000 7f9927a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99200bd380 con 0x7f99200ab890 2024-01-22T05:19:12.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f991fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99200ab890 0x7f99200abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:12.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f9925000700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f99200bcfa0 0x7f9920151700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:36852/0 (socket says 172.21.15.49:36852) 2024-01-22T05:19:12.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f991fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99200ab890 0x7f99200abcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:35720/0 (socket says 172.21.15.49:35720) 2024-01-22T05:19:12.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f9925000700 1 -- 172.21.15.49:0/1249828925 learned_addr learned my addr 172.21.15.49:0/1249828925 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:12.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f9925a00700 1 --2- 172.21.15.49:0/1249828925 >> v2:172.21.15.110:3300/0 conn(0x7f9920065550 0x7f99200659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:12.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f991fe00700 1 -- 172.21.15.49:0/1249828925 >> v2:172.21.15.110:3300/0 conn(0x7f9920065550 msgr2=0x7f99200659c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:12.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f991fe00700 1 --2- 172.21.15.49:0/1249828925 >> v2:172.21.15.110:3300/0 conn(0x7f9920065550 0x7f99200659c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f991fe00700 1 -- 172.21.15.49:0/1249828925 >> v1:172.21.15.110:6789/0 conn(0x7f99200bcfa0 legacy=0x7f9920151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:12.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f991fe00700 1 -- 172.21.15.49:0/1249828925 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920068460 con 0x7f99200ab890 2024-01-22T05:19:12.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f991fe00700 1 --2- 172.21.15.49:0/1249828925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99200ab890 0x7f99200abcf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f9908009760 tx=0x7f9908009060).ready entity=mon.2 client_cookie=41fb766ec04c11b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:12.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f991f400700 1 -- 172.21.15.49:0/1249828925 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800f510 con 0x7f99200ab890 2024-01-22T05:19:12.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f991f400700 1 -- 172.21.15.49:0/1249828925 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990800f670 con 0x7f99200ab890 2024-01-22T05:19:12.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f991f400700 1 -- 172.21.15.49:0/1249828925 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800f9f0 con 0x7f99200ab890 2024-01-22T05:19:12.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f9927a00700 1 -- 172.21.15.49:0/1249828925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99200ab890 msgr2=0x7f99200abcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:12.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f9927a00700 1 --2- 172.21.15.49:0/1249828925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99200ab890 0x7f99200abcf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f9908009760 tx=0x7f9908009060).stop 2024-01-22T05:19:12.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f9927a00700 1 -- 172.21.15.49:0/1249828925 shutdown_connections 2024-01-22T05:19:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f9927a00700 1 --2- 172.21.15.49:0/1249828925 >> v2:172.21.15.110:3300/0 conn(0x7f9920065550 0x7f99200659c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f9927a00700 1 --2- 172.21.15.49:0/1249828925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99200ab890 0x7f99200abcf0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.636+0000 7f9927a00700 1 -- 172.21.15.49:0/1249828925 >> 172.21.15.49:0/1249828925 conn(0x7f99200c6540 msgr2=0x7f99200c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.640+0000 7f9927a00700 1 -- 172.21.15.49:0/1249828925 shutdown_connections 2024-01-22T05:19:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.640+0000 7f9927a00700 1 -- 172.21.15.49:0/1249828925 wait complete. 2024-01-22T05:19:12.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.640+0000 7f9927a00700 1 Processor -- start 2024-01-22T05:19:12.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.640+0000 7f9927a00700 1 -- start start 2024-01-22T05:19:12.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f9927a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9920065550 0x7f9920157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:12.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f9927a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99200ab890 0x7f9920151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:12.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f9927a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99200bcfa0 0x7f99201422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:12.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f9927a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920152b60 con 0x7f99200ab890 2024-01-22T05:19:12.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f9927a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920152f80 con 0x7f9920065550 2024-01-22T05:19:12.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f9927a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9920151ee0 con 0x7f99200bcfa0 2024-01-22T05:19:12.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f991fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99200ab890 0x7f9920151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:12.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f991fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99200ab890 0x7f9920151700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47916/0 (socket says 172.21.15.49:47916) 2024-01-22T05:19:12.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f991fe00700 1 -- 172.21.15.49:0/2283514184 learned_addr learned my addr 172.21.15.49:0/2283514184 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:12.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f9925a00700 1 --2- 172.21.15.49:0/2283514184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99200bcfa0 0x7f99201422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:12.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f9925000700 1 --2- 172.21.15.49:0/2283514184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9920065550 0x7f9920157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:12.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f991fe00700 1 -- 172.21.15.49:0/2283514184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99200bcfa0 msgr2=0x7f99201422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:12.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f991fe00700 1 --2- 172.21.15.49:0/2283514184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99200bcfa0 0x7f99201422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f991fe00700 1 -- 172.21.15.49:0/2283514184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9920065550 msgr2=0x7f9920157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:12.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f991fe00700 1 --2- 172.21.15.49:0/2283514184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9920065550 0x7f9920157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f991fe00700 1 -- 172.21.15.49:0/2283514184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99080092a0 con 0x7f99200ab890 2024-01-22T05:19:12.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f991fe00700 1 --2- 172.21.15.49:0/2283514184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99200ab890 0x7f9920151700 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7f99200bb8d0 tx=0x7f9908017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:12.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f9917e00700 1 -- 172.21.15.49:0/2283514184 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800f7e0 con 0x7f99200ab890 2024-01-22T05:19:12.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f9917e00700 1 -- 172.21.15.49:0/2283514184 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990800f940 con 0x7f99200ab890 2024-01-22T05:19:12.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f9927a00700 1 -- 172.21.15.49:0/2283514184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99201521c0 con 0x7f99200ab890 2024-01-22T05:19:12.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.644+0000 7f9917e00700 1 -- 172.21.15.49:0/2283514184 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990801b660 con 0x7f99200ab890 2024-01-22T05:19:12.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.648+0000 7f9927a00700 1 -- 172.21.15.49:0/2283514184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9920152780 con 0x7f99200ab890 2024-01-22T05:19:12.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.648+0000 7f9927a00700 1 -- 172.21.15.49:0/2283514184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920047060 con 0x7f99200ab890 2024-01-22T05:19:12.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.648+0000 7f9917e00700 1 -- 172.21.15.49:0/2283514184 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f990801ba90 con 0x7f99200ab890 2024-01-22T05:19:12.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.652+0000 7f9917e00700 1 --2- 172.21.15.49:0/2283514184 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f98f805a510 0x7f98f805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:12.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.652+0000 7f9917e00700 1 -- 172.21.15.49:0/2283514184 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f9908076420 con 0x7f99200ab890 2024-01-22T05:19:12.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.652+0000 7f9925000700 1 --2- 172.21.15.49:0/2283514184 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f98f805a510 0x7f98f805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:12.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.652+0000 7f9925000700 1 --2- 172.21.15.49:0/2283514184 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f98f805a510 0x7f98f805c9d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f99100016a0 tx=0x7f9910009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:12.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.656+0000 7f9917e00700 1 -- 172.21.15.49:0/2283514184 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f99080499e0 con 0x7f99200ab890 2024-01-22T05:19:12.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.820+0000 7f9927a00700 1 -- 172.21.15.49:0/2283514184 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9920046800 con 0x7f98f805a510 2024-01-22T05:19:12.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.840+0000 7f9917e00700 1 -- 172.21.15.49:0/2283514184 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350721 (secure 0 0 0) 0x7f9920046800 con 0x7f98f805a510 2024-01-22T05:19:12.844 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:12.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.852+0000 7f9927a00700 1 -- 172.21.15.49:0/2283514184 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f98f805a510 msgr2=0x7f98f805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:12.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.852+0000 7f9927a00700 1 --2- 172.21.15.49:0/2283514184 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f98f805a510 0x7f98f805c9d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f99100016a0 tx=0x7f9910009040).stop 2024-01-22T05:19:12.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.852+0000 7f9927a00700 1 -- 172.21.15.49:0/2283514184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99200ab890 msgr2=0x7f9920151700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:12.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.852+0000 7f9927a00700 1 --2- 172.21.15.49:0/2283514184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99200ab890 0x7f9920151700 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7f99200bb8d0 tx=0x7f9908017000).stop 2024-01-22T05:19:12.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.852+0000 7f9927a00700 1 -- 172.21.15.49:0/2283514184 shutdown_connections 2024-01-22T05:19:12.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.852+0000 7f9927a00700 1 --2- 172.21.15.49:0/2283514184 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f98f805a510 0x7f98f805c9d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.852+0000 7f9927a00700 1 --2- 172.21.15.49:0/2283514184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99200bcfa0 0x7f99201422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.852+0000 7f9927a00700 1 --2- 172.21.15.49:0/2283514184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99200ab890 0x7f9920151700 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.852+0000 7f9927a00700 1 --2- 172.21.15.49:0/2283514184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9920065550 0x7f9920157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:12.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.852+0000 7f9927a00700 1 -- 172.21.15.49:0/2283514184 >> 172.21.15.49:0/2283514184 conn(0x7f99200c6540 msgr2=0x7f99200c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:12.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.852+0000 7f9927a00700 1 -- 172.21.15.49:0/2283514184 shutdown_connections 2024-01-22T05:19:12.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:12.852+0000 7f9927a00700 1 -- 172.21.15.49:0/2283514184 wait complete. 2024-01-22T05:19:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:19:12.874 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":619,"stamp":"2024-01-22T05:19:11.558064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2465168,"kb_used_data":17744,"kb_used_omap":0,"kb_used_meta":2447360,"kb_avail":752509552,"statfs":{"total":773094113280,"available":770569781248,"internally_reserved":0,"allocated":18169856,"data_stored":9042144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506096640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2306,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.000570"},"pg_stats":[{"pgid":"27.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.627188+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.622888+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.616928+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.621457+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625146+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.626417+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624310+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.618599+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.626590+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.627158+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.614615+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.619225+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.613626+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624094+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624184+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625894+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.629403+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.613091+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612444+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.626225+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.623467+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624717+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.620053+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.623496+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.631976+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.615221+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.621414+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625540+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.615113+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.613952+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.623520+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625306+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.626029+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612442+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.626503+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.619306+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612690+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612395+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624566+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.623630+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625462+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.613870+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625840+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.631029+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624399+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.619505+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.619190+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.622733+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.631398+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.620053+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624150+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.631464+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.620132+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625236+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612396+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.616919+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.616806+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":147,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.233265+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:19:04.233265+0000","last_peered":"2024-01-22T05:19:04.233265+0000","last_clean":"2024-01-22T05:19:04.233265+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:19:04.233265+0000","last_undegraded":"2024-01-22T05:19:04.233265+0000","last_fullsized":"2024-01-22T05:19:04.233265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.614588+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.011159+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:19:04.011159+0000","last_peered":"2024-01-22T05:19:04.011159+0000","last_clean":"2024-01-22T05:19:04.011159+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:19:04.011159+0000","last_undegraded":"2024-01-22T05:19:04.011159+0000","last_fullsized":"2024-01-22T05:19:04.011159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.632258+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.232965+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:19:04.232965+0000","last_peered":"2024-01-22T05:19:04.232965+0000","last_clean":"2024-01-22T05:19:04.232965+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:19:04.232965+0000","last_undegraded":"2024-01-22T05:19:04.232965+0000","last_fullsized":"2024-01-22T05:19:04.232965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.621207+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.011129+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:19:04.011129+0000","last_peered":"2024-01-22T05:19:04.011129+0000","last_clean":"2024-01-22T05:19:04.011129+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:19:04.011129+0000","last_undegraded":"2024-01-22T05:19:04.011129+0000","last_fullsized":"2024-01-22T05:19:04.011129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624185+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":173,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:03.761763+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:19:03.761763+0000","last_peered":"2024-01-22T05:19:03.761763+0000","last_clean":"2024-01-22T05:19:03.761763+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:19:03.761763+0000","last_undegraded":"2024-01-22T05:19:03.761763+0000","last_fullsized":"2024-01-22T05:19:03.761763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624794+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:03.766367+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:19:03.766367+0000","last_peered":"2024-01-22T05:19:03.766367+0000","last_clean":"2024-01-22T05:19:03.766367+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:19:03.766367+0000","last_undegraded":"2024-01-22T05:19:03.766367+0000","last_fullsized":"2024-01-22T05:19:03.766367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612989+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":141,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.232984+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:19:04.232984+0000","last_peered":"2024-01-22T05:19:04.232984+0000","last_clean":"2024-01-22T05:19:04.232984+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:19:04.232984+0000","last_undegraded":"2024-01-22T05:19:04.232984+0000","last_fullsized":"2024-01-22T05:19:04.232984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.617386+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":173,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:03.761747+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:19:03.761747+0000","last_peered":"2024-01-22T05:19:03.761747+0000","last_clean":"2024-01-22T05:19:03.761747+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:19:03.761747+0000","last_undegraded":"2024-01-22T05:19:03.761747+0000","last_fullsized":"2024-01-22T05:19:03.761747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":142,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.232985+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:19:04.232985+0000","last_peered":"2024-01-22T05:19:04.232985+0000","last_clean":"2024-01-22T05:19:04.232985+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:19:04.232985+0000","last_undegraded":"2024-01-22T05:19:04.232985+0000","last_fullsized":"2024-01-22T05:19:04.232985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575026,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307628,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064212,"statfs":{"total":96636764160,"available":96321753088,"internally_reserved":0,"allocated":2265088,"data_stored":1126981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2450000000000001,"15min":1.0760000000000001},"min":{"1min":0.83299999999999996,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.5209999999999999,"5min":14.779999999999999,"15min":14.779999999999999},"last":1.196},{"interface":"front","average":{"1min":1.145,"5min":2.0070000000000001,"15min":1.3759999999999999},"min":{"1min":0.80000000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.55,"5min":76.662000000000006,"15min":76.662000000000006},"last":1.1539999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.167,"15min":1.0589999999999999},"min":{"1min":0.86199999999999999,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.4650000000000001,"5min":4.9269999999999996,"15min":4.9269999999999996},"last":1.107},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2989999999999999,"15min":1.2030000000000001},"min":{"1min":0.88,"5min":0.71599999999999997,"15min":0.58999999999999997},"max":{"1min":1.655,"5min":12.691000000000001,"15min":12.691000000000001},"last":1.28}]},{"osd":2,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1579999999999999,"15min":1.125},"min":{"1min":0.77800000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5700000000000001,"5min":2.1589999999999998,"15min":2.5150000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.355,"15min":1.2210000000000001},"min":{"1min":0.97699999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5449999999999999,"5min":15.036,"15min":15.036},"last":1.256}]},{"osd":3,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.9339999999999999,"15min":1.4470000000000001},"min":{"1min":0.92300000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.748,"5min":64.983999999999995,"15min":64.983999999999995},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.4299999999999999,"15min":1.2949999999999999},"min":{"1min":1.0029999999999999,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":1.714,"5min":15.073,"15min":15.073},"last":1.393}]},{"osd":4,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.415,"15min":1.1850000000000001},"min":{"1min":0.77900000000000003,"5min":0.53000000000000003,"15min":0.32900000000000001},"max":{"1min":1.504,"5min":22.239000000000001,"15min":22.239000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.28,"5min":1.5269999999999999,"15min":1.2669999999999999},"min":{"1min":0.92000000000000004,"5min":0.68799999999999994,"15min":0.52200000000000002},"max":{"1min":1.9830000000000001,"5min":27.872,"15min":27.872},"last":1.042}]},{"osd":5,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":2.0110000000000001,"15min":1.452},"min":{"1min":0.88100000000000001,"5min":0.67400000000000004,"15min":0.40400000000000003},"max":{"1min":1.6279999999999999,"5min":65.652000000000001,"15min":65.652000000000001},"last":1.331},{"interface":"front","average":{"1min":1.387,"5min":1.341,"15min":1.2869999999999999},"min":{"1min":1.0589999999999999,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":2.1539999999999999,"5min":2.1629999999999998,"15min":3.625},"last":1.456}]},{"osd":6,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.363,"15min":1.262},"min":{"1min":0.997,"5min":0.80700000000000005,"15min":0.53400000000000003},"max":{"1min":2.3580000000000001,"5min":6.9939999999999998,"15min":6.9939999999999998},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.54,"15min":1.411},"min":{"1min":1.224,"5min":0.82999999999999996,"15min":0.56100000000000005},"max":{"1min":2.0600000000000001,"5min":12.965,"15min":12.965},"last":1.6240000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575026,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307628,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064212,"statfs":{"total":96636764160,"available":96321753088,"internally_reserved":0,"allocated":2265088,"data_stored":1126981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.0580000000000001,"15min":1.2849999999999999},"min":{"1min":0.72999999999999998,"5min":0.66600000000000004,"15min":0.35999999999999999},"max":{"1min":1.927,"5min":1.927,"15min":77.745000000000005},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0429999999999999,"15min":1.0780000000000001},"min":{"1min":0.64500000000000002,"5min":0.57499999999999996,"15min":0.44},"max":{"1min":1.5,"5min":1.74,"15min":13.555999999999999},"last":0.90200000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.0740000000000001,"15min":1.125},"min":{"1min":0.91300000000000003,"5min":0.56999999999999995,"15min":0.40000000000000002},"max":{"1min":1.3240000000000001,"5min":1.554,"15min":15.499000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.117,"15min":1.155},"min":{"1min":0.76200000000000001,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.6379999999999999,"5min":1.702,"15min":7.7629999999999999},"last":1.1599999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1850000000000001,"15min":1.165},"min":{"1min":0.89000000000000001,"5min":0.84999999999999998,"15min":0.57399999999999995},"max":{"1min":1.4199999999999999,"5min":1.667,"15min":3.0960000000000001},"last":1.24},{"interface":"front","average":{"1min":1.161,"5min":1.1359999999999999,"15min":1.145},"min":{"1min":0.747,"5min":0.68999999999999995,"15min":0.38200000000000001},"max":{"1min":1.401,"5min":1.7390000000000001,"15min":4.9660000000000002},"last":1.1140000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.173,"15min":1.486},"min":{"1min":0.97899999999999998,"5min":0.66700000000000004,"15min":0.59299999999999997},"max":{"1min":1.4610000000000001,"5min":2.343,"15min":102.08199999999999},"last":1.014},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.82599999999999996,"5min":0.66300000000000003,"15min":0.374},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":15.468},"last":0.86299999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1799999999999999,"15min":1.147},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.495},"max":{"1min":1.6040000000000001,"5min":1.631,"15min":3.1749999999999998},"last":1.089},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.204,"15min":1.165},"min":{"1min":0.82799999999999996,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.6910000000000001,"5min":2.5489999999999999,"15min":5.1200000000000001},"last":1.2629999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1499999999999999,"15min":1.2430000000000001},"min":{"1min":0.93000000000000005,"5min":0.58699999999999997,"15min":0.48099999999999998},"max":{"1min":1.6020000000000001,"5min":1.7829999999999999,"15min":30.533000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.294,"15min":1.278},"min":{"1min":1.0029999999999999,"5min":0.79500000000000004,"15min":0.46600000000000003},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":3.875},"last":1.3100000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3500000000000001,"15min":1.4279999999999999},"min":{"1min":0.97999999999999998,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":1.6379999999999999,"5min":2.7490000000000001,"15min":23.547999999999998},"last":1.204},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3149999999999999,"15min":1.5509999999999999},"min":{"1min":0.80200000000000005,"5min":0.77700000000000002,"15min":0.495},"max":{"1min":1.7110000000000001,"5min":1.9019999999999999,"15min":63.737000000000002},"last":0.93600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575026,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307628,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064212,"statfs":{"total":96636764160,"available":96321753088,"internally_reserved":0,"allocated":2265088,"data_stored":1126981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0089999999999999,"15min":1.0129999999999999},"min":{"1min":0.58599999999999997,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.556,"5min":1.651,"15min":2.0609999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0529999999999999,"15min":1.042},"min":{"1min":0.61699999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5840000000000001,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.1539999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.224,"15min":1.1850000000000001},"min":{"1min":0.85099999999999998,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.6619999999999999,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2050000000000001,"15min":1.2},"min":{"1min":0.879,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.6140000000000001,"5min":1.9930000000000001,"15min":2.0209999999999999},"last":1.2030000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1479999999999999,"15min":1.135},"min":{"1min":0.80700000000000005,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.4370000000000001,"5min":1.9219999999999999,"15min":1.925},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.145,"15min":1.115},"min":{"1min":0.82499999999999996,"5min":0.71799999999999997,"15min":0.59899999999999998},"max":{"1min":1.4410000000000001,"5min":1.982,"15min":1.982},"last":1.097}]},{"osd":3,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.216,"15min":1.1599999999999999},"min":{"1min":0.71199999999999997,"5min":0.69799999999999995,"15min":0.66900000000000004},"max":{"1min":1.5660000000000001,"5min":3.202,"15min":3.202},"last":1.516},{"interface":"front","average":{"1min":1.246,"5min":1.1899999999999999,"15min":1.2090000000000001},"min":{"1min":0.98199999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.546,"5min":1.6830000000000001,"15min":4.8819999999999997},"last":1.0720000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.103,"15min":1.097},"min":{"1min":0.77700000000000002,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.5369999999999999,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.006},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1950000000000001,"15min":1.1779999999999999},"min":{"1min":0.78000000000000003,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.4430000000000001,"5min":2.081,"15min":2.081},"last":1.333}]},{"osd":6,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.226,"15min":1.2190000000000001},"min":{"1min":0.97999999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.482,"5min":2.0099999999999998,"15min":2.2010000000000001},"last":1.431},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.24,"15min":1.2410000000000001},"min":{"1min":0.71899999999999997,"5min":0.70699999999999996,"15min":0.55900000000000005},"max":{"1min":1.4530000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.22}]},{"osd":7,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3169999999999999,"15min":1.304},"min":{"1min":0.91400000000000003,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.7410000000000001,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.458},{"interface":"front","average":{"1min":1.371,"5min":1.3420000000000001,"15min":1.3360000000000001},"min":{"1min":0.96099999999999997,"5min":0.72699999999999998,"15min":0.60799999999999998},"max":{"1min":1.6819999999999999,"5min":1.8859999999999999,"15min":3.1840000000000002},"last":1.367}]}]},{"osd":4,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299436,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072404,"statfs":{"total":96636764160,"available":96330141696,"internally_reserved":0,"allocated":2265088,"data_stored":1126981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1279999999999999,"15min":1.103},"min":{"1min":0.81000000000000005,"5min":0.63700000000000001,"15min":0.47799999999999998},"max":{"1min":1.4379999999999999,"5min":1.696,"15min":2.0150000000000001},"last":1.7809999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1950000000000001,"15min":1.147},"min":{"1min":0.92100000000000004,"5min":0.75700000000000001,"15min":0.48899999999999999},"max":{"1min":1.548,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.639}]},{"osd":1,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.091,"15min":1.0760000000000001},"min":{"1min":0.77800000000000002,"5min":0.59899999999999998,"15min":0.53100000000000003},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.125},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.82199999999999995,"5min":0.52500000000000002,"15min":0.46000000000000002},"max":{"1min":1.3879999999999999,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":1.4139999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0760000000000001,"15min":1.0720000000000001},"min":{"1min":0.79500000000000004,"5min":0.66400000000000003,"15min":0.49199999999999999},"max":{"1min":1.361,"5min":1.516,"15min":5.3390000000000004},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.204,"5min":1.149,"15min":1.161},"min":{"1min":0.88,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5089999999999999,"5min":1.6140000000000001,"15min":2.3479999999999999},"last":1.621}]},{"osd":3,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.149,"15min":1.135},"min":{"1min":0.86799999999999999,"5min":0.65700000000000003,"15min":0.496},"max":{"1min":1.478,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.522},{"interface":"front","average":{"1min":1.2,"5min":1.1719999999999999,"15min":1.1499999999999999},"min":{"1min":0.97199999999999998,"5min":0.67700000000000005,"15min":0.53100000000000003},"max":{"1min":1.4039999999999999,"5min":2.2959999999999998,"15min":5.3029999999999999},"last":1.452}]},{"osd":5,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.113,"15min":1.1180000000000001},"min":{"1min":0.76200000000000001,"5min":0.63500000000000001,"15min":0.54100000000000004},"max":{"1min":1.365,"5min":1.6899999999999999,"15min":2.0790000000000002},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.2070000000000001,"15min":1.133},"min":{"1min":0.94299999999999995,"5min":0.68200000000000005,"15min":0.52200000000000002},"max":{"1min":1.583,"5min":1.8240000000000001,"15min":2.0030000000000001},"last":1.7150000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.149,"15min":1.1439999999999999},"min":{"1min":0.88100000000000001,"5min":0.67400000000000004,"15min":0.44500000000000001},"max":{"1min":1.387,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.28,"15min":1.27},"min":{"1min":0.98999999999999999,"5min":0.73699999999999999,"15min":0.51900000000000002},"max":{"1min":1.45,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":1.6899999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3500000000000001,"15min":1.3120000000000001},"min":{"1min":1.0700000000000001,"5min":0.74099999999999999,"15min":0.59399999999999997},"max":{"1min":1.6299999999999999,"5min":1.8999999999999999,"15min":2.2839999999999998},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.94999999999999996,"5min":0.89300000000000002,"15min":0.56899999999999995},"max":{"1min":1.5049999999999999,"5min":1.843,"15min":5.2629999999999999},"last":1.5920000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575026,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303544,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068296,"statfs":{"total":96636764160,"available":96325935104,"internally_reserved":0,"allocated":2277376,"data_stored":1133555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.85699999999999998},"min":{"1min":0.50800000000000001,"5min":0.41099999999999998,"15min":0.34200000000000003},"max":{"1min":1.175,"5min":1.512,"15min":14.859},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.63400000000000001,"5min":0.42699999999999999,"15min":0.317},"max":{"1min":1.371,"5min":1.804,"15min":5.0919999999999996},"last":1.1579999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.90900000000000003,"15min":0.90300000000000002},"min":{"1min":0.62,"5min":0.50600000000000001,"15min":0.39300000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":6.5570000000000004},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.95699999999999996,"15min":0.97099999999999997},"min":{"1min":0.55800000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.482,"5min":1.7669999999999999,"15min":5.7519999999999998},"last":1.0349999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.085,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48599999999999999,"15min":0.40600000000000003},"max":{"1min":1.6910000000000001,"5min":1.8680000000000001,"15min":2.391},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.157,"15min":1.1819999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.44800000000000001},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":4.1429999999999998},"last":1.3360000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.323,"15min":1.331},"min":{"1min":0.86699999999999999,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.831,"5min":2.423,"15min":10.858000000000001},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.292,"15min":1.337},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.63600000000000001},"max":{"1min":1.6379999999999999,"5min":2.3359999999999999,"15min":10.846},"last":1.4410000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.238,"15min":1.2829999999999999},"min":{"1min":0.99399999999999999,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.595,"5min":1.7709999999999999,"15min":7.3639999999999999},"last":1.208},{"interface":"front","average":{"1min":1.351,"5min":1.3089999999999999,"15min":1.381},"min":{"1min":0.92700000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.738,"5min":6.3220000000000001,"15min":14.523999999999999},"last":1.292}]},{"osd":6,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.369,"15min":1.357},"min":{"1min":0.92700000000000005,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.77,"5min":2.1819999999999999,"15min":4.9809999999999999},"last":1.665},{"interface":"front","average":{"1min":1.413,"5min":1.3720000000000001,"15min":1.3879999999999999},"min":{"1min":1.113,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":5.4210000000000003},"last":1.284}]},{"osd":7,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.3340000000000001,"15min":1.363},"min":{"1min":0.96999999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.004,"5min":2.004,"15min":5.7160000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.381,"15min":1.409},"min":{"1min":1.0860000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8839999999999999,"5min":2.5449999999999999,"15min":6.4279999999999999},"last":1.7430000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575026,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315832,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":94056008,"statfs":{"total":96636764160,"available":96313352192,"internally_reserved":0,"allocated":2277376,"data_stored":1133555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.54100000000000004,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":1.1919999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85499999999999998,"15min":0.85399999999999998},"min":{"1min":0.53900000000000003,"5min":0.45300000000000001,"15min":0.373},"max":{"1min":1.1899999999999999,"5min":1.556,"15min":1.7350000000000001},"last":1.2430000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92600000000000005,"15min":0.86899999999999999},"min":{"1min":0.55400000000000005,"5min":0.46800000000000003,"15min":0.41299999999999998},"max":{"1min":1.8400000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.109,"5min":1,"15min":0.95799999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.41599999999999998},"max":{"1min":1.671,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.2010000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1659999999999999,"15min":1.137},"min":{"1min":0.66700000000000004,"5min":0.56200000000000006,"15min":0.47099999999999997},"max":{"1min":1.984,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.284},{"interface":"front","average":{"1min":1.296,"5min":1.2370000000000001,"15min":1.212},"min":{"1min":0.85999999999999999,"5min":0.64300000000000002,"15min":0.51100000000000001},"max":{"1min":1.7609999999999999,"5min":3.133,"15min":3.133},"last":1.5529999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.3140000000000001,"15min":1.278},"min":{"1min":1.0029999999999999,"5min":0.88500000000000001,"15min":0.59099999999999997},"max":{"1min":2.101,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.458},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.206,"15min":1.2010000000000001},"min":{"1min":0.74099999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":2.2829999999999999},"last":1.159}]},{"osd":5,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.2649999999999999,"15min":1.228},"min":{"1min":0.94699999999999995,"5min":0.84099999999999997,"15min":0.63800000000000001},"max":{"1min":2.1680000000000001,"5min":2.379,"15min":2.379},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.45,"5min":1.329,"15min":1.2909999999999999},"min":{"1min":1.181,"5min":0.84799999999999998,"15min":0.67000000000000004},"max":{"1min":2.1880000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.6479999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2609999999999999,"15min":1.254},"min":{"1min":0.79500000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":2.1920000000000002},"last":1.502},{"interface":"front","average":{"1min":1.47,"5min":1.3720000000000001,"15min":1.3160000000000001},"min":{"1min":0.98899999999999999,"5min":0.629,"15min":0.629},"max":{"1min":2.2759999999999998,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.673}]},{"osd":7,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3560000000000001,"15min":1.345},"min":{"1min":0.88500000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8200000000000001,"5min":1.9390000000000001,"15min":2.1749999999999998},"last":1.605},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.452,"15min":1.4219999999999999},"min":{"1min":1.121,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.2280000000000002,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.8819999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575027,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2277376,"data_stored":1133555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84899999999999998,"15min":0.86599999999999999},"min":{"1min":0.53500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.032,"5min":1.4830000000000001,"15min":3.4119999999999999},"last":0.997},{"interface":"front","average":{"1min":1.054,"5min":0.98099999999999998,"15min":0.997},"min":{"1min":0.66100000000000003,"5min":0.56999999999999995,"15min":0.41099999999999998},"max":{"1min":1.5089999999999999,"5min":1.6160000000000001,"15min":2.101},"last":0.81699999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.97499999999999998,"15min":0.98899999999999999},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.45500000000000002},"max":{"1min":1.3180000000000001,"5min":1.492,"15min":2.169},"last":1.095},{"interface":"front","average":{"1min":1.075,"5min":1.0589999999999999,"15min":1.0549999999999999},"min":{"1min":0.64900000000000002,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.478,"5min":1.5780000000000001,"15min":2.024},"last":1.0229999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.052,"15min":1.0429999999999999},"min":{"1min":0.73999999999999999,"5min":0.57399999999999995,"15min":0.38900000000000001},"max":{"1min":1.502,"5min":1.972,"15min":4.665},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.64600000000000002,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.2629999999999999,"5min":1.659,"15min":5.5830000000000002},"last":1.0620000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2110000000000001,"15min":1.2490000000000001},"min":{"1min":0.86299999999999999,"5min":0.60299999999999998,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":1.958,"15min":15.76},"last":1.173},{"interface":"front","average":{"1min":1.341,"5min":1.2809999999999999,"15min":1.333},"min":{"1min":0.90400000000000003,"5min":0.74099999999999999,"15min":0.63500000000000001},"max":{"1min":1.649,"5min":1.714,"15min":16.975000000000001},"last":1.3380000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.264,"15min":1.232},"min":{"1min":0.88200000000000001,"5min":0.72599999999999998,"15min":0.55700000000000005},"max":{"1min":1.6240000000000001,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.274,"15min":1.2789999999999999},"min":{"1min":0.97199999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.784,"5min":2.1309999999999998,"15min":2.52},"last":1.3740000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.266,"15min":1.2609999999999999},"min":{"1min":0.95099999999999996,"5min":0.68999999999999995,"15min":0.55600000000000005},"max":{"1min":1.53,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3,"15min":1.327},"min":{"1min":1.056,"5min":0.76200000000000001,"15min":0.68799999999999994},"max":{"1min":1.6459999999999999,"5min":2.0609999999999999,"15min":2.5569999999999999},"last":1.3}]},{"osd":7,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.339,"15min":1.355},"min":{"1min":0.96299999999999997,"5min":0.69999999999999996,"15min":0.68100000000000005},"max":{"1min":1.754,"5min":1.8999999999999999,"15min":4.4329999999999998},"last":1.133},{"interface":"front","average":{"1min":1.369,"5min":1.355,"15min":1.3520000000000001},"min":{"1min":1.0109999999999999,"5min":0.81100000000000005,"15min":0.64900000000000002},"max":{"1min":1.7010000000000001,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":1.395}]}]},{"osd":0,"up_from":13,"seq":55834575026,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2277376,"data_stored":1133555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.81799999999999995,"15min":0.88500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.28699999999999998},"max":{"1min":1.0609999999999999,"5min":1.4219999999999999,"15min":15.273},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.877,"5min":0.874,"15min":0.91300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.34499999999999997},"max":{"1min":1.3680000000000001,"5min":1.625,"15min":4.4009999999999998},"last":1.1399999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.97799999999999998,"15min":1.0449999999999999},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.46400000000000002},"max":{"1min":1.363,"5min":1.6299999999999999,"15min":15.473000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.069,"5min":1.0249999999999999,"15min":1.0269999999999999},"min":{"1min":0.67400000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5509999999999999,"5min":1.6850000000000001,"15min":1.7989999999999999},"last":1.3100000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.95899999999999996,"15min":0.97699999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.39000000000000001},"max":{"1min":1.302,"5min":1.5049999999999999,"15min":5.3970000000000002},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.069,"5min":1.1100000000000001,"15min":1.177},"min":{"1min":0.67200000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.5529999999999999,"5min":1.79,"15min":15.439},"last":1.2509999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.208,"15min":1.2470000000000001},"min":{"1min":0.81999999999999995,"5min":0.81399999999999995,"15min":0.61399999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":5.1799999999999997},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.214,"15min":1.216},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.56200000000000006},"max":{"1min":1.615,"5min":1.738,"15min":3.4340000000000002},"last":1.421}]},{"osd":5,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.272,"15min":1.27},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.67600000000000005},"max":{"1min":1.579,"5min":1.9099999999999999,"15min":3.548},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.306,"15min":1.321},"min":{"1min":0.90300000000000002,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.587,"5min":1.7210000000000001,"15min":2.823},"last":1.4590000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3300000000000001,"15min":1.407},"min":{"1min":0.91700000000000004,"5min":0.879,"15min":0.59099999999999997},"max":{"1min":1.6559999999999999,"5min":1.7909999999999999,"15min":15.4},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3200000000000001,"15min":1.3720000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.72499999999999998},"max":{"1min":1.7010000000000001,"5min":1.8919999999999999,"15min":7.1349999999999998},"last":1.371}]},{"osd":7,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3740000000000001,"15min":1.4219999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.79900000000000004},"max":{"1min":1.7969999999999999,"5min":2.145,"15min":5.29},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.3680000000000001,"15min":1.367},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.752},"max":{"1min":1.7230000000000001,"5min":2.0470000000000002,"15min":2.7269999999999999},"last":1.359}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:19:12.880 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:19:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.080+0000 7fd6f6000700 1 Processor -- start 2024-01-22T05:19:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.080+0000 7fd6f6000700 1 -- start start 2024-01-22T05:19:13.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.084+0000 7fd6f6000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd6f00c25e0 0x7fd6f00a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.084+0000 7fd6f6000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f00c1a40 con 0x7fd6f00a8740 2024-01-22T05:19:13.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.084+0000 7fd6f6000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f00a90b0 con 0x7fd6f0155d20 2024-01-22T05:19:13.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.084+0000 7fd6f6000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f0159310 con 0x7fd6f00c25e0 2024-01-22T05:19:13.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.084+0000 7fd6eea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd6f00a8740 0x7fd6f00c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58350/0 (socket says 172.21.15.49:58350) 2024-01-22T05:19:13.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.084+0000 7fd6eea00700 1 -- 172.21.15.49:0/1971553615 learned_addr learned my addr 172.21.15.49:0/1971553615 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:13.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.084+0000 7fd6efe00700 1 --2- 172.21.15.49:0/1971553615 >> v2:172.21.15.49:3300/0 conn(0x7fd6f00c25e0 0x7fd6f00a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.084+0000 7fd6ee000700 1 -- 172.21.15.49:0/1971553615 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430354105 0 0) 0x7fd6f00a90b0 con 0x7fd6f0155d20 2024-01-22T05:19:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.084+0000 7fd6ee000700 1 -- 172.21.15.49:0/1971553615 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d00033f0 con 0x7fd6f0155d20 2024-01-22T05:19:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.084+0000 7fd6ee000700 1 -- 172.21.15.49:0/1971553615 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259724104 0 0) 0x7fd6f00c1a40 con 0x7fd6f00a8740 2024-01-22T05:19:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.084+0000 7fd6ee000700 1 -- 172.21.15.49:0/1971553615 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6f00a90b0 con 0x7fd6f00a8740 2024-01-22T05:19:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.084+0000 7fd6efe00700 1 -- 172.21.15.49:0/1971553615 >> v1:172.21.15.110:6789/0 conn(0x7fd6f0155d20 legacy=0x7fd6f0065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.084+0000 7fd6efe00700 1 -- 172.21.15.49:0/1971553615 >> v1:172.21.15.49:6789/0 conn(0x7fd6f00a8740 legacy=0x7fd6f00c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.084+0000 7fd6efe00700 1 -- 172.21.15.49:0/1971553615 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00c13f0 con 0x7fd6f00c25e0 2024-01-22T05:19:13.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.084+0000 7fd6efe00700 1 --2- 172.21.15.49:0/1971553615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6f00c25e0 0x7fd6f00a8bc0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7fd6e8009e60 tx=0x7fd6e8009780).ready entity=mon.0 client_cookie=3bc7d6408a67b0c3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:13.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.088+0000 7fd6ee000700 1 -- 172.21.15.49:0/1971553615 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e800e070 con 0x7fd6f00c25e0 2024-01-22T05:19:13.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.088+0000 7fd6ee000700 1 -- 172.21.15.49:0/1971553615 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e800bab0 con 0x7fd6f00c25e0 2024-01-22T05:19:13.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.088+0000 7fd6ee000700 1 -- 172.21.15.49:0/1971553615 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e800be30 con 0x7fd6f00c25e0 2024-01-22T05:19:13.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.088+0000 7fd6f6000700 1 -- 172.21.15.49:0/1971553615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6f00c25e0 msgr2=0x7fd6f00a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.088+0000 7fd6f6000700 1 --2- 172.21.15.49:0/1971553615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6f00c25e0 0x7fd6f00a8bc0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7fd6e8009e60 tx=0x7fd6e8009780).stop 2024-01-22T05:19:13.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.088+0000 7fd6f6000700 1 -- 172.21.15.49:0/1971553615 shutdown_connections 2024-01-22T05:19:13.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.088+0000 7fd6f6000700 1 --2- 172.21.15.49:0/1971553615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6f00c25e0 0x7fd6f00a8bc0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.088+0000 7fd6f6000700 1 -- 172.21.15.49:0/1971553615 >> 172.21.15.49:0/1971553615 conn(0x7fd6f00c6540 msgr2=0x7fd6f00c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:13.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.088+0000 7fd6f6000700 1 -- 172.21.15.49:0/1971553615 shutdown_connections 2024-01-22T05:19:13.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.088+0000 7fd6f6000700 1 -- 172.21.15.49:0/1971553615 wait complete. 2024-01-22T05:19:13.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.092+0000 7fd6f6000700 1 Processor -- start 2024-01-22T05:19:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.092+0000 7fd6f6000700 1 -- start start 2024-01-22T05:19:13.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.092+0000 7fd6f6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6f00a8740 0x7fd6f00c0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.092+0000 7fd6f6000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f00c25e0 0x7fd6f00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.092+0000 7fd6f6000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6f0155d20 0x7fd6f00bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.092+0000 7fd6f6000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01530f0 con 0x7fd6f00a8740 2024-01-22T05:19:13.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.092+0000 7fd6f6000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01524e0 con 0x7fd6f00c25e0 2024-01-22T05:19:13.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.092+0000 7fd6f6000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01527c0 con 0x7fd6f0155d20 2024-01-22T05:19:13.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.092+0000 7fd6ef400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6f00a8740 0x7fd6f00c0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.092+0000 7fd6ef400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6f00a8740 0x7fd6f00c0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47928/0 (socket says 172.21.15.49:47928) 2024-01-22T05:19:13.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.092+0000 7fd6ef400700 1 -- 172.21.15.49:0/376236886 learned_addr learned my addr 172.21.15.49:0/376236886 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:13.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.092+0000 7fd6efe00700 1 --2- 172.21.15.49:0/376236886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6f0155d20 0x7fd6f00bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.092+0000 7fd6eea00700 1 --2- 172.21.15.49:0/376236886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f00c25e0 0x7fd6f00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.096+0000 7fd6ef400700 1 -- 172.21.15.49:0/376236886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6f0155d20 msgr2=0x7fd6f00bd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.096+0000 7fd6ef400700 1 --2- 172.21.15.49:0/376236886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6f0155d20 0x7fd6f00bd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.096+0000 7fd6ef400700 1 -- 172.21.15.49:0/376236886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f00c25e0 msgr2=0x7fd6f00abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.096+0000 7fd6ef400700 1 --2- 172.21.15.49:0/376236886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f00c25e0 0x7fd6f00abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.096+0000 7fd6ef400700 1 -- 172.21.15.49:0/376236886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e8009a20 con 0x7fd6f00a8740 2024-01-22T05:19:13.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.096+0000 7fd6ef400700 1 --2- 172.21.15.49:0/376236886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6f00a8740 0x7fd6f00c0060 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7fd6e000c440 tx=0x7fd6e0007cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:13.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.096+0000 7fd6e6a00700 1 -- 172.21.15.49:0/376236886 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e000ce60 con 0x7fd6f00a8740 2024-01-22T05:19:13.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.096+0000 7fd6e6a00700 1 -- 172.21.15.49:0/376236886 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e000f470 con 0x7fd6f00a8740 2024-01-22T05:19:13.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.096+0000 7fd6f6000700 1 -- 172.21.15.49:0/376236886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f0152aa0 con 0x7fd6f00a8740 2024-01-22T05:19:13.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.096+0000 7fd6e6a00700 1 -- 172.21.15.49:0/376236886 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e000f810 con 0x7fd6f00a8740 2024-01-22T05:19:13.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.096+0000 7fd6f6000700 1 -- 172.21.15.49:0/376236886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f00ac2c0 con 0x7fd6f00a8740 2024-01-22T05:19:13.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.096+0000 7fd6f6000700 1 -- 172.21.15.49:0/376236886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f0047060 con 0x7fd6f00a8740 2024-01-22T05:19:13.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.100+0000 7fd6e6a00700 1 -- 172.21.15.49:0/376236886 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd6e000fc00 con 0x7fd6f00a8740 2024-01-22T05:19:13.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.100+0000 7fd6e6a00700 1 --2- 172.21.15.49:0/376236886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd6c805a510 0x7fd6c805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.100+0000 7fd6e6a00700 1 -- 172.21.15.49:0/376236886 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd6e0073e90 con 0x7fd6f00a8740 2024-01-22T05:19:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.100+0000 7fd6eea00700 1 --2- 172.21.15.49:0/376236886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd6c805a510 0x7fd6c805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.100+0000 7fd6eea00700 1 --2- 172.21.15.49:0/376236886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd6c805a510 0x7fd6c805c9d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7fd6f00c0550 tx=0x7fd6d8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:13.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.108+0000 7fd6e6a00700 1 -- 172.21.15.49:0/376236886 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd6e0047510 con 0x7fd6f00a8740 2024-01-22T05:19:13.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.272+0000 7fd6f6000700 1 -- 172.21.15.49:0/376236886 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd6f0153230 con 0x7fd6c805a510 2024-01-22T05:19:13.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.288+0000 7fd6e6a00700 1 -- 172.21.15.49:0/376236886 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350721 (secure 0 0 0) 0x7fd6d8001370 con 0x7fd6c805a510 2024-01-22T05:19:13.294 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:13.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.296+0000 7fd6f6000700 1 -- 172.21.15.49:0/376236886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd6c805a510 msgr2=0x7fd6c805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.296+0000 7fd6f6000700 1 --2- 172.21.15.49:0/376236886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd6c805a510 0x7fd6c805c9d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7fd6f00c0550 tx=0x7fd6d8009040).stop 2024-01-22T05:19:13.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.300+0000 7fd6f6000700 1 -- 172.21.15.49:0/376236886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6f00a8740 msgr2=0x7fd6f00c0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.300+0000 7fd6f6000700 1 --2- 172.21.15.49:0/376236886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6f00a8740 0x7fd6f00c0060 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7fd6e000c440 tx=0x7fd6e0007cb0).stop 2024-01-22T05:19:13.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.300+0000 7fd6f6000700 1 -- 172.21.15.49:0/376236886 shutdown_connections 2024-01-22T05:19:13.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.300+0000 7fd6f6000700 1 --2- 172.21.15.49:0/376236886 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd6c805a510 0x7fd6c805c9d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.300+0000 7fd6f6000700 1 --2- 172.21.15.49:0/376236886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6f0155d20 0x7fd6f00bd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.300+0000 7fd6f6000700 1 --2- 172.21.15.49:0/376236886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f00c25e0 0x7fd6f00abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.300+0000 7fd6f6000700 1 --2- 172.21.15.49:0/376236886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6f00a8740 0x7fd6f00c0060 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.300+0000 7fd6f6000700 1 -- 172.21.15.49:0/376236886 >> 172.21.15.49:0/376236886 conn(0x7fd6f00c6540 msgr2=0x7fd6f0066f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:13.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.300+0000 7fd6f6000700 1 -- 172.21.15.49:0/376236886 shutdown_connections 2024-01-22T05:19:13.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.300+0000 7fd6f6000700 1 -- 172.21.15.49:0/376236886 wait complete. 2024-01-22T05:19:13.302 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:19:13.323 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":619,"stamp":"2024-01-22T05:19:11.558064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2465168,"kb_used_data":17744,"kb_used_omap":0,"kb_used_meta":2447360,"kb_avail":752509552,"statfs":{"total":773094113280,"available":770569781248,"internally_reserved":0,"allocated":18169856,"data_stored":9042144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506096640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2306,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.000570"},"pg_stats":[{"pgid":"27.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.627188+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.622888+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.616928+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.621457+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625146+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.626417+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624310+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.618599+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.626590+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.627158+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.614615+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.619225+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.613626+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624094+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624184+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625894+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.629403+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.613091+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612444+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.626225+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.623467+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624717+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.620053+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.623496+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.631976+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.615221+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.621414+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625540+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.615113+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.613952+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.623520+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625306+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.626029+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612442+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.626503+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.619306+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612690+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612395+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624566+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.623630+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625462+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.613870+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625840+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.631029+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624399+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.619505+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.619190+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.622733+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.631398+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.620053+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624150+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.631464+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.620132+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.625236+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612396+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.616919+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.616806+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":147,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.233265+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:19:04.233265+0000","last_peered":"2024-01-22T05:19:04.233265+0000","last_clean":"2024-01-22T05:19:04.233265+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:19:04.233265+0000","last_undegraded":"2024-01-22T05:19:04.233265+0000","last_fullsized":"2024-01-22T05:19:04.233265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.614588+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.011159+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:19:04.011159+0000","last_peered":"2024-01-22T05:19:04.011159+0000","last_clean":"2024-01-22T05:19:04.011159+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:19:04.011159+0000","last_undegraded":"2024-01-22T05:19:04.011159+0000","last_fullsized":"2024-01-22T05:19:04.011159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.632258+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.232965+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:19:04.232965+0000","last_peered":"2024-01-22T05:19:04.232965+0000","last_clean":"2024-01-22T05:19:04.232965+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:19:04.232965+0000","last_undegraded":"2024-01-22T05:19:04.232965+0000","last_fullsized":"2024-01-22T05:19:04.232965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.621207+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.011129+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:19:04.011129+0000","last_peered":"2024-01-22T05:19:04.011129+0000","last_clean":"2024-01-22T05:19:04.011129+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:19:04.011129+0000","last_undegraded":"2024-01-22T05:19:04.011129+0000","last_fullsized":"2024-01-22T05:19:04.011129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624185+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":173,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:03.761763+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:19:03.761763+0000","last_peered":"2024-01-22T05:19:03.761763+0000","last_clean":"2024-01-22T05:19:03.761763+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:19:03.761763+0000","last_undegraded":"2024-01-22T05:19:03.761763+0000","last_fullsized":"2024-01-22T05:19:03.761763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.624794+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:03.766367+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:19:03.766367+0000","last_peered":"2024-01-22T05:19:03.766367+0000","last_clean":"2024-01-22T05:19:03.766367+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:19:03.766367+0000","last_undegraded":"2024-01-22T05:19:03.766367+0000","last_fullsized":"2024-01-22T05:19:03.766367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.612989+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":141,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.232984+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:19:04.232984+0000","last_peered":"2024-01-22T05:19:04.232984+0000","last_clean":"2024-01-22T05:19:04.232984+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:19:04.232984+0000","last_undegraded":"2024-01-22T05:19:04.232984+0000","last_fullsized":"2024-01-22T05:19:04.232984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:19:07.612991+0000","last_change":"2024-01-22T05:19:07.612991+0000","last_active":"2024-01-22T05:19:07.612991+0000","last_peered":"2024-01-22T05:19:07.612991+0000","last_clean":"2024-01-22T05:19:07.612991+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:07.612991+0000","last_undegraded":"2024-01-22T05:19:07.612991+0000","last_fullsized":"2024-01-22T05:19:07.612991+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:19:06.601696+0000","last_change":"2024-01-22T05:19:06.617386+0000","last_active":"2024-01-22T05:19:06.601696+0000","last_peered":"2024-01-22T05:19:06.601696+0000","last_clean":"2024-01-22T05:19:06.601696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:19:06.601696+0000","last_undegraded":"2024-01-22T05:19:06.601696+0000","last_fullsized":"2024-01-22T05:19:06.601696+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":173,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:03.761747+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:19:03.761747+0000","last_peered":"2024-01-22T05:19:03.761747+0000","last_clean":"2024-01-22T05:19:03.761747+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:19:03.761747+0000","last_undegraded":"2024-01-22T05:19:03.761747+0000","last_fullsized":"2024-01-22T05:19:03.761747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":142,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-01-22T05:19:04.232985+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:19:04.232985+0000","last_peered":"2024-01-22T05:19:04.232985+0000","last_clean":"2024-01-22T05:19:04.232985+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:19:04.232985+0000","last_undegraded":"2024-01-22T05:19:04.232985+0000","last_fullsized":"2024-01-22T05:19:04.232985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575026,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307628,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064212,"statfs":{"total":96636764160,"available":96321753088,"internally_reserved":0,"allocated":2265088,"data_stored":1126981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2450000000000001,"15min":1.0760000000000001},"min":{"1min":0.83299999999999996,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.5209999999999999,"5min":14.779999999999999,"15min":14.779999999999999},"last":1.196},{"interface":"front","average":{"1min":1.145,"5min":2.0070000000000001,"15min":1.3759999999999999},"min":{"1min":0.80000000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.55,"5min":76.662000000000006,"15min":76.662000000000006},"last":1.1539999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.167,"15min":1.0589999999999999},"min":{"1min":0.86199999999999999,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.4650000000000001,"5min":4.9269999999999996,"15min":4.9269999999999996},"last":1.107},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2989999999999999,"15min":1.2030000000000001},"min":{"1min":0.88,"5min":0.71599999999999997,"15min":0.58999999999999997},"max":{"1min":1.655,"5min":12.691000000000001,"15min":12.691000000000001},"last":1.28}]},{"osd":2,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1579999999999999,"15min":1.125},"min":{"1min":0.77800000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5700000000000001,"5min":2.1589999999999998,"15min":2.5150000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.355,"15min":1.2210000000000001},"min":{"1min":0.97699999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5449999999999999,"5min":15.036,"15min":15.036},"last":1.256}]},{"osd":3,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.9339999999999999,"15min":1.4470000000000001},"min":{"1min":0.92300000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.748,"5min":64.983999999999995,"15min":64.983999999999995},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.4299999999999999,"15min":1.2949999999999999},"min":{"1min":1.0029999999999999,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":1.714,"5min":15.073,"15min":15.073},"last":1.393}]},{"osd":4,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.415,"15min":1.1850000000000001},"min":{"1min":0.77900000000000003,"5min":0.53000000000000003,"15min":0.32900000000000001},"max":{"1min":1.504,"5min":22.239000000000001,"15min":22.239000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.28,"5min":1.5269999999999999,"15min":1.2669999999999999},"min":{"1min":0.92000000000000004,"5min":0.68799999999999994,"15min":0.52200000000000002},"max":{"1min":1.9830000000000001,"5min":27.872,"15min":27.872},"last":1.042}]},{"osd":5,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":2.0110000000000001,"15min":1.452},"min":{"1min":0.88100000000000001,"5min":0.67400000000000004,"15min":0.40400000000000003},"max":{"1min":1.6279999999999999,"5min":65.652000000000001,"15min":65.652000000000001},"last":1.331},{"interface":"front","average":{"1min":1.387,"5min":1.341,"15min":1.2869999999999999},"min":{"1min":1.0589999999999999,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":2.1539999999999999,"5min":2.1629999999999998,"15min":3.625},"last":1.456}]},{"osd":6,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.363,"15min":1.262},"min":{"1min":0.997,"5min":0.80700000000000005,"15min":0.53400000000000003},"max":{"1min":2.3580000000000001,"5min":6.9939999999999998,"15min":6.9939999999999998},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.54,"15min":1.411},"min":{"1min":1.224,"5min":0.82999999999999996,"15min":0.56100000000000005},"max":{"1min":2.0600000000000001,"5min":12.965,"15min":12.965},"last":1.6240000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575026,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307628,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064212,"statfs":{"total":96636764160,"available":96321753088,"internally_reserved":0,"allocated":2265088,"data_stored":1126981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.0580000000000001,"15min":1.2849999999999999},"min":{"1min":0.72999999999999998,"5min":0.66600000000000004,"15min":0.35999999999999999},"max":{"1min":1.927,"5min":1.927,"15min":77.745000000000005},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0429999999999999,"15min":1.0780000000000001},"min":{"1min":0.64500000000000002,"5min":0.57499999999999996,"15min":0.44},"max":{"1min":1.5,"5min":1.74,"15min":13.555999999999999},"last":0.90200000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.0740000000000001,"15min":1.125},"min":{"1min":0.91300000000000003,"5min":0.56999999999999995,"15min":0.40000000000000002},"max":{"1min":1.3240000000000001,"5min":1.554,"15min":15.499000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.117,"15min":1.155},"min":{"1min":0.76200000000000001,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.6379999999999999,"5min":1.702,"15min":7.7629999999999999},"last":1.1599999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1850000000000001,"15min":1.165},"min":{"1min":0.89000000000000001,"5min":0.84999999999999998,"15min":0.57399999999999995},"max":{"1min":1.4199999999999999,"5min":1.667,"15min":3.0960000000000001},"last":1.24},{"interface":"front","average":{"1min":1.161,"5min":1.1359999999999999,"15min":1.145},"min":{"1min":0.747,"5min":0.68999999999999995,"15min":0.38200000000000001},"max":{"1min":1.401,"5min":1.7390000000000001,"15min":4.9660000000000002},"last":1.1140000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.173,"15min":1.486},"min":{"1min":0.97899999999999998,"5min":0.66700000000000004,"15min":0.59299999999999997},"max":{"1min":1.4610000000000001,"5min":2.343,"15min":102.08199999999999},"last":1.014},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.82599999999999996,"5min":0.66300000000000003,"15min":0.374},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":15.468},"last":0.86299999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1799999999999999,"15min":1.147},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.495},"max":{"1min":1.6040000000000001,"5min":1.631,"15min":3.1749999999999998},"last":1.089},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.204,"15min":1.165},"min":{"1min":0.82799999999999996,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.6910000000000001,"5min":2.5489999999999999,"15min":5.1200000000000001},"last":1.2629999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1499999999999999,"15min":1.2430000000000001},"min":{"1min":0.93000000000000005,"5min":0.58699999999999997,"15min":0.48099999999999998},"max":{"1min":1.6020000000000001,"5min":1.7829999999999999,"15min":30.533000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.294,"15min":1.278},"min":{"1min":1.0029999999999999,"5min":0.79500000000000004,"15min":0.46600000000000003},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":3.875},"last":1.3100000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3500000000000001,"15min":1.4279999999999999},"min":{"1min":0.97999999999999998,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":1.6379999999999999,"5min":2.7490000000000001,"15min":23.547999999999998},"last":1.204},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3149999999999999,"15min":1.5509999999999999},"min":{"1min":0.80200000000000005,"5min":0.77700000000000002,"15min":0.495},"max":{"1min":1.7110000000000001,"5min":1.9019999999999999,"15min":63.737000000000002},"last":0.93600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575026,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307628,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064212,"statfs":{"total":96636764160,"available":96321753088,"internally_reserved":0,"allocated":2265088,"data_stored":1126981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0089999999999999,"15min":1.0129999999999999},"min":{"1min":0.58599999999999997,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.556,"5min":1.651,"15min":2.0609999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0529999999999999,"15min":1.042},"min":{"1min":0.61699999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5840000000000001,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.1539999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.224,"15min":1.1850000000000001},"min":{"1min":0.85099999999999998,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.6619999999999999,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2050000000000001,"15min":1.2},"min":{"1min":0.879,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.6140000000000001,"5min":1.9930000000000001,"15min":2.0209999999999999},"last":1.2030000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1479999999999999,"15min":1.135},"min":{"1min":0.80700000000000005,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.4370000000000001,"5min":1.9219999999999999,"15min":1.925},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.145,"15min":1.115},"min":{"1min":0.82499999999999996,"5min":0.71799999999999997,"15min":0.59899999999999998},"max":{"1min":1.4410000000000001,"5min":1.982,"15min":1.982},"last":1.097}]},{"osd":3,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.216,"15min":1.1599999999999999},"min":{"1min":0.71199999999999997,"5min":0.69799999999999995,"15min":0.66900000000000004},"max":{"1min":1.5660000000000001,"5min":3.202,"15min":3.202},"last":1.516},{"interface":"front","average":{"1min":1.246,"5min":1.1899999999999999,"15min":1.2090000000000001},"min":{"1min":0.98199999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.546,"5min":1.6830000000000001,"15min":4.8819999999999997},"last":1.0720000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.103,"15min":1.097},"min":{"1min":0.77700000000000002,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.5369999999999999,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.006},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1950000000000001,"15min":1.1779999999999999},"min":{"1min":0.78000000000000003,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.4430000000000001,"5min":2.081,"15min":2.081},"last":1.333}]},{"osd":6,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.226,"15min":1.2190000000000001},"min":{"1min":0.97999999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.482,"5min":2.0099999999999998,"15min":2.2010000000000001},"last":1.431},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.24,"15min":1.2410000000000001},"min":{"1min":0.71899999999999997,"5min":0.70699999999999996,"15min":0.55900000000000005},"max":{"1min":1.4530000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.22}]},{"osd":7,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3169999999999999,"15min":1.304},"min":{"1min":0.91400000000000003,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.7410000000000001,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.458},{"interface":"front","average":{"1min":1.371,"5min":1.3420000000000001,"15min":1.3360000000000001},"min":{"1min":0.96099999999999997,"5min":0.72699999999999998,"15min":0.60799999999999998},"max":{"1min":1.6819999999999999,"5min":1.8859999999999999,"15min":3.1840000000000002},"last":1.367}]}]},{"osd":4,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299436,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072404,"statfs":{"total":96636764160,"available":96330141696,"internally_reserved":0,"allocated":2265088,"data_stored":1126981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1279999999999999,"15min":1.103},"min":{"1min":0.81000000000000005,"5min":0.63700000000000001,"15min":0.47799999999999998},"max":{"1min":1.4379999999999999,"5min":1.696,"15min":2.0150000000000001},"last":1.7809999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1950000000000001,"15min":1.147},"min":{"1min":0.92100000000000004,"5min":0.75700000000000001,"15min":0.48899999999999999},"max":{"1min":1.548,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.639}]},{"osd":1,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.091,"15min":1.0760000000000001},"min":{"1min":0.77800000000000002,"5min":0.59899999999999998,"15min":0.53100000000000003},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.125},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.82199999999999995,"5min":0.52500000000000002,"15min":0.46000000000000002},"max":{"1min":1.3879999999999999,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":1.4139999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0760000000000001,"15min":1.0720000000000001},"min":{"1min":0.79500000000000004,"5min":0.66400000000000003,"15min":0.49199999999999999},"max":{"1min":1.361,"5min":1.516,"15min":5.3390000000000004},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.204,"5min":1.149,"15min":1.161},"min":{"1min":0.88,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5089999999999999,"5min":1.6140000000000001,"15min":2.3479999999999999},"last":1.621}]},{"osd":3,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.149,"15min":1.135},"min":{"1min":0.86799999999999999,"5min":0.65700000000000003,"15min":0.496},"max":{"1min":1.478,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.522},{"interface":"front","average":{"1min":1.2,"5min":1.1719999999999999,"15min":1.1499999999999999},"min":{"1min":0.97199999999999998,"5min":0.67700000000000005,"15min":0.53100000000000003},"max":{"1min":1.4039999999999999,"5min":2.2959999999999998,"15min":5.3029999999999999},"last":1.452}]},{"osd":5,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.113,"15min":1.1180000000000001},"min":{"1min":0.76200000000000001,"5min":0.63500000000000001,"15min":0.54100000000000004},"max":{"1min":1.365,"5min":1.6899999999999999,"15min":2.0790000000000002},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.2070000000000001,"15min":1.133},"min":{"1min":0.94299999999999995,"5min":0.68200000000000005,"15min":0.52200000000000002},"max":{"1min":1.583,"5min":1.8240000000000001,"15min":2.0030000000000001},"last":1.7150000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.149,"15min":1.1439999999999999},"min":{"1min":0.88100000000000001,"5min":0.67400000000000004,"15min":0.44500000000000001},"max":{"1min":1.387,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.28,"15min":1.27},"min":{"1min":0.98999999999999999,"5min":0.73699999999999999,"15min":0.51900000000000002},"max":{"1min":1.45,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":1.6899999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3500000000000001,"15min":1.3120000000000001},"min":{"1min":1.0700000000000001,"5min":0.74099999999999999,"15min":0.59399999999999997},"max":{"1min":1.6299999999999999,"5min":1.8999999999999999,"15min":2.2839999999999998},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.94999999999999996,"5min":0.89300000000000002,"15min":0.56899999999999995},"max":{"1min":1.5049999999999999,"5min":1.843,"15min":5.2629999999999999},"last":1.5920000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575026,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303544,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068296,"statfs":{"total":96636764160,"available":96325935104,"internally_reserved":0,"allocated":2277376,"data_stored":1133555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.85699999999999998},"min":{"1min":0.50800000000000001,"5min":0.41099999999999998,"15min":0.34200000000000003},"max":{"1min":1.175,"5min":1.512,"15min":14.859},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.63400000000000001,"5min":0.42699999999999999,"15min":0.317},"max":{"1min":1.371,"5min":1.804,"15min":5.0919999999999996},"last":1.1579999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.90900000000000003,"15min":0.90300000000000002},"min":{"1min":0.62,"5min":0.50600000000000001,"15min":0.39300000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":6.5570000000000004},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.95699999999999996,"15min":0.97099999999999997},"min":{"1min":0.55800000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.482,"5min":1.7669999999999999,"15min":5.7519999999999998},"last":1.0349999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.085,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48599999999999999,"15min":0.40600000000000003},"max":{"1min":1.6910000000000001,"5min":1.8680000000000001,"15min":2.391},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.157,"15min":1.1819999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.44800000000000001},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":4.1429999999999998},"last":1.3360000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.323,"15min":1.331},"min":{"1min":0.86699999999999999,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.831,"5min":2.423,"15min":10.858000000000001},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.292,"15min":1.337},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.63600000000000001},"max":{"1min":1.6379999999999999,"5min":2.3359999999999999,"15min":10.846},"last":1.4410000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.238,"15min":1.2829999999999999},"min":{"1min":0.99399999999999999,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.595,"5min":1.7709999999999999,"15min":7.3639999999999999},"last":1.208},{"interface":"front","average":{"1min":1.351,"5min":1.3089999999999999,"15min":1.381},"min":{"1min":0.92700000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.738,"5min":6.3220000000000001,"15min":14.523999999999999},"last":1.292}]},{"osd":6,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.369,"15min":1.357},"min":{"1min":0.92700000000000005,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.77,"5min":2.1819999999999999,"15min":4.9809999999999999},"last":1.665},{"interface":"front","average":{"1min":1.413,"5min":1.3720000000000001,"15min":1.3879999999999999},"min":{"1min":1.113,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":5.4210000000000003},"last":1.284}]},{"osd":7,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.3340000000000001,"15min":1.363},"min":{"1min":0.96999999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.004,"5min":2.004,"15min":5.7160000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.381,"15min":1.409},"min":{"1min":1.0860000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8839999999999999,"5min":2.5449999999999999,"15min":6.4279999999999999},"last":1.7430000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575026,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315832,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":94056008,"statfs":{"total":96636764160,"available":96313352192,"internally_reserved":0,"allocated":2277376,"data_stored":1133555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.54100000000000004,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":1.1919999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85499999999999998,"15min":0.85399999999999998},"min":{"1min":0.53900000000000003,"5min":0.45300000000000001,"15min":0.373},"max":{"1min":1.1899999999999999,"5min":1.556,"15min":1.7350000000000001},"last":1.2430000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92600000000000005,"15min":0.86899999999999999},"min":{"1min":0.55400000000000005,"5min":0.46800000000000003,"15min":0.41299999999999998},"max":{"1min":1.8400000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.109,"5min":1,"15min":0.95799999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.41599999999999998},"max":{"1min":1.671,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.2010000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1659999999999999,"15min":1.137},"min":{"1min":0.66700000000000004,"5min":0.56200000000000006,"15min":0.47099999999999997},"max":{"1min":1.984,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.284},{"interface":"front","average":{"1min":1.296,"5min":1.2370000000000001,"15min":1.212},"min":{"1min":0.85999999999999999,"5min":0.64300000000000002,"15min":0.51100000000000001},"max":{"1min":1.7609999999999999,"5min":3.133,"15min":3.133},"last":1.5529999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.3140000000000001,"15min":1.278},"min":{"1min":1.0029999999999999,"5min":0.88500000000000001,"15min":0.59099999999999997},"max":{"1min":2.101,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.458},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.206,"15min":1.2010000000000001},"min":{"1min":0.74099999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":2.2829999999999999},"last":1.159}]},{"osd":5,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.2649999999999999,"15min":1.228},"min":{"1min":0.94699999999999995,"5min":0.84099999999999997,"15min":0.63800000000000001},"max":{"1min":2.1680000000000001,"5min":2.379,"15min":2.379},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.45,"5min":1.329,"15min":1.2909999999999999},"min":{"1min":1.181,"5min":0.84799999999999998,"15min":0.67000000000000004},"max":{"1min":2.1880000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.6479999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2609999999999999,"15min":1.254},"min":{"1min":0.79500000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":2.1920000000000002},"last":1.502},{"interface":"front","average":{"1min":1.47,"5min":1.3720000000000001,"15min":1.3160000000000001},"min":{"1min":0.98899999999999999,"5min":0.629,"15min":0.629},"max":{"1min":2.2759999999999998,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.673}]},{"osd":7,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3560000000000001,"15min":1.345},"min":{"1min":0.88500000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8200000000000001,"5min":1.9390000000000001,"15min":2.1749999999999998},"last":1.605},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.452,"15min":1.4219999999999999},"min":{"1min":1.121,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.2280000000000002,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.8819999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575027,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2277376,"data_stored":1133555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84899999999999998,"15min":0.86599999999999999},"min":{"1min":0.53500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.032,"5min":1.4830000000000001,"15min":3.4119999999999999},"last":0.997},{"interface":"front","average":{"1min":1.054,"5min":0.98099999999999998,"15min":0.997},"min":{"1min":0.66100000000000003,"5min":0.56999999999999995,"15min":0.41099999999999998},"max":{"1min":1.5089999999999999,"5min":1.6160000000000001,"15min":2.101},"last":0.81699999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.97499999999999998,"15min":0.98899999999999999},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.45500000000000002},"max":{"1min":1.3180000000000001,"5min":1.492,"15min":2.169},"last":1.095},{"interface":"front","average":{"1min":1.075,"5min":1.0589999999999999,"15min":1.0549999999999999},"min":{"1min":0.64900000000000002,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.478,"5min":1.5780000000000001,"15min":2.024},"last":1.0229999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.052,"15min":1.0429999999999999},"min":{"1min":0.73999999999999999,"5min":0.57399999999999995,"15min":0.38900000000000001},"max":{"1min":1.502,"5min":1.972,"15min":4.665},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.64600000000000002,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.2629999999999999,"5min":1.659,"15min":5.5830000000000002},"last":1.0620000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2110000000000001,"15min":1.2490000000000001},"min":{"1min":0.86299999999999999,"5min":0.60299999999999998,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":1.958,"15min":15.76},"last":1.173},{"interface":"front","average":{"1min":1.341,"5min":1.2809999999999999,"15min":1.333},"min":{"1min":0.90400000000000003,"5min":0.74099999999999999,"15min":0.63500000000000001},"max":{"1min":1.649,"5min":1.714,"15min":16.975000000000001},"last":1.3380000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.264,"15min":1.232},"min":{"1min":0.88200000000000001,"5min":0.72599999999999998,"15min":0.55700000000000005},"max":{"1min":1.6240000000000001,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.274,"15min":1.2789999999999999},"min":{"1min":0.97199999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.784,"5min":2.1309999999999998,"15min":2.52},"last":1.3740000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.266,"15min":1.2609999999999999},"min":{"1min":0.95099999999999996,"5min":0.68999999999999995,"15min":0.55600000000000005},"max":{"1min":1.53,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3,"15min":1.327},"min":{"1min":1.056,"5min":0.76200000000000001,"15min":0.68799999999999994},"max":{"1min":1.6459999999999999,"5min":2.0609999999999999,"15min":2.5569999999999999},"last":1.3}]},{"osd":7,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.339,"15min":1.355},"min":{"1min":0.96299999999999997,"5min":0.69999999999999996,"15min":0.68100000000000005},"max":{"1min":1.754,"5min":1.8999999999999999,"15min":4.4329999999999998},"last":1.133},{"interface":"front","average":{"1min":1.369,"5min":1.355,"15min":1.3520000000000001},"min":{"1min":1.0109999999999999,"5min":0.81100000000000005,"15min":0.64900000000000002},"max":{"1min":1.7010000000000001,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":1.395}]}]},{"osd":0,"up_from":13,"seq":55834575026,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2277376,"data_stored":1133555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.81799999999999995,"15min":0.88500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.28699999999999998},"max":{"1min":1.0609999999999999,"5min":1.4219999999999999,"15min":15.273},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.877,"5min":0.874,"15min":0.91300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.34499999999999997},"max":{"1min":1.3680000000000001,"5min":1.625,"15min":4.4009999999999998},"last":1.1399999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.97799999999999998,"15min":1.0449999999999999},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.46400000000000002},"max":{"1min":1.363,"5min":1.6299999999999999,"15min":15.473000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.069,"5min":1.0249999999999999,"15min":1.0269999999999999},"min":{"1min":0.67400000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5509999999999999,"5min":1.6850000000000001,"15min":1.7989999999999999},"last":1.3100000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.95899999999999996,"15min":0.97699999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.39000000000000001},"max":{"1min":1.302,"5min":1.5049999999999999,"15min":5.3970000000000002},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.069,"5min":1.1100000000000001,"15min":1.177},"min":{"1min":0.67200000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.5529999999999999,"5min":1.79,"15min":15.439},"last":1.2509999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.208,"15min":1.2470000000000001},"min":{"1min":0.81999999999999995,"5min":0.81399999999999995,"15min":0.61399999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":5.1799999999999997},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.214,"15min":1.216},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.56200000000000006},"max":{"1min":1.615,"5min":1.738,"15min":3.4340000000000002},"last":1.421}]},{"osd":5,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.272,"15min":1.27},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.67600000000000005},"max":{"1min":1.579,"5min":1.9099999999999999,"15min":3.548},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.306,"15min":1.321},"min":{"1min":0.90300000000000002,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.587,"5min":1.7210000000000001,"15min":2.823},"last":1.4590000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3300000000000001,"15min":1.407},"min":{"1min":0.91700000000000004,"5min":0.879,"15min":0.59099999999999997},"max":{"1min":1.6559999999999999,"5min":1.7909999999999999,"15min":15.4},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3200000000000001,"15min":1.3720000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.72499999999999998},"max":{"1min":1.7010000000000001,"5min":1.8919999999999999,"15min":7.1349999999999998},"last":1.371}]},{"osd":7,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3740000000000001,"15min":1.4219999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.79900000000000004},"max":{"1min":1.7969999999999999,"5min":2.145,"15min":5.29},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.3680000000000001,"15min":1.367},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.752},"max":{"1min":1.7230000000000001,"5min":2.0470000000000002,"15min":2.7269999999999999},"last":1.359}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:19:13.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.3e is not active+clean 2024-01-22T05:19:13.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3f is not active+clean 2024-01-22T05:19:13.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.627188+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:19:13.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.3f is not active+clean 2024-01-22T05:19:13.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3e is not active+clean 2024-01-22T05:19:13.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.622888+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:19:13.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.3c is not active+clean 2024-01-22T05:19:13.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3d is not active+clean 2024-01-22T05:19:13.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.616928+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:19:13.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.3d is not active+clean 2024-01-22T05:19:13.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3c is not active+clean 2024-01-22T05:19:13.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.621457+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:19:13.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.3a is not active+clean 2024-01-22T05:19:13.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3b is not active+clean 2024-01-22T05:19:13.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.625146+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:19:13.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.3b is not active+clean 2024-01-22T05:19:13.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3a is not active+clean 2024-01-22T05:19:13.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.626417+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:19:13.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.38 is not active+clean 2024-01-22T05:19:13.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.39 is not active+clean 2024-01-22T05:19:13.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.624310+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:19:13.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.39 is not active+clean 2024-01-22T05:19:13.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.38 is not active+clean 2024-01-22T05:19:13.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.618599+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:19:13.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.36 is not active+clean 2024-01-22T05:19:13.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.37 is not active+clean 2024-01-22T05:19:13.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.626590+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:19:13.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.37 is not active+clean 2024-01-22T05:19:13.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.36 is not active+clean 2024-01-22T05:19:13.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.627158+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:19:13.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.34 is not active+clean 2024-01-22T05:19:13.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.35 is not active+clean 2024-01-22T05:19:13.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.614615+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:19:13.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.35 is not active+clean 2024-01-22T05:19:13.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.34 is not active+clean 2024-01-22T05:19:13.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.619225+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:19:13.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.32 is not active+clean 2024-01-22T05:19:13.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.33 is not active+clean 2024-01-22T05:19:13.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.613626+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:19:13.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.33 is not active+clean 2024-01-22T05:19:13.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.32 is not active+clean 2024-01-22T05:19:13.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.624094+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:19:13.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.30 is not active+clean 2024-01-22T05:19:13.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.31 is not active+clean 2024-01-22T05:19:13.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.624184+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:19:13.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.31 is not active+clean 2024-01-22T05:19:13.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.30 is not active+clean 2024-01-22T05:19:13.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.625894+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:19:13.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.2e is not active+clean 2024-01-22T05:19:13.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2f is not active+clean 2024-01-22T05:19:13.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.629403+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:19:13.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.2f is not active+clean 2024-01-22T05:19:13.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2e is not active+clean 2024-01-22T05:19:13.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.613091+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:19:13.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.2c is not active+clean 2024-01-22T05:19:13.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2d is not active+clean 2024-01-22T05:19:13.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.612444+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:19:13.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.2d is not active+clean 2024-01-22T05:19:13.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2c is not active+clean 2024-01-22T05:19:13.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.626225+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:19:13.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.2a is not active+clean 2024-01-22T05:19:13.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2b is not active+clean 2024-01-22T05:19:13.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.623467+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:19:13.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.2b is not active+clean 2024-01-22T05:19:13.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2a is not active+clean 2024-01-22T05:19:13.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.624717+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:19:13.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.28 is not active+clean 2024-01-22T05:19:13.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.29 is not active+clean 2024-01-22T05:19:13.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.620053+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:19:13.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.29 is not active+clean 2024-01-22T05:19:13.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.28 is not active+clean 2024-01-22T05:19:13.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.623496+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:19:13.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.26 is not active+clean 2024-01-22T05:19:13.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.27 is not active+clean 2024-01-22T05:19:13.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.631976+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:19:13.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.27 is not active+clean 2024-01-22T05:19:13.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.26 is not active+clean 2024-01-22T05:19:13.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.615221+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:19:13.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.24 is not active+clean 2024-01-22T05:19:13.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.25 is not active+clean 2024-01-22T05:19:13.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.621414+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:19:13.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.25 is not active+clean 2024-01-22T05:19:13.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.24 is not active+clean 2024-01-22T05:19:13.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.625540+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:19:13.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.22 is not active+clean 2024-01-22T05:19:13.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.23 is not active+clean 2024-01-22T05:19:13.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.615113+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:19:13.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.23 is not active+clean 2024-01-22T05:19:13.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.22 is not active+clean 2024-01-22T05:19:13.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.613952+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:19:13.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.20 is not active+clean 2024-01-22T05:19:13.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.21 is not active+clean 2024-01-22T05:19:13.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.623520+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:19:13.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.21 is not active+clean 2024-01-22T05:19:13.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.20 is not active+clean 2024-01-22T05:19:13.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.625306+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:19:13.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.16 is not active+clean 2024-01-22T05:19:13.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.17 is not active+clean 2024-01-22T05:19:13.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.626029+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:19:13.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.17 is not active+clean 2024-01-22T05:19:13.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.16 is not active+clean 2024-01-22T05:19:13.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.612442+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:19:13.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.14 is not active+clean 2024-01-22T05:19:13.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.15 is not active+clean 2024-01-22T05:19:13.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.626503+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:19:13.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.15 is not active+clean 2024-01-22T05:19:13.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.14 is not active+clean 2024-01-22T05:19:13.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.619306+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:19:13.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.12 is not active+clean 2024-01-22T05:19:13.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.13 is not active+clean 2024-01-22T05:19:13.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.612690+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:19:13.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.13 is not active+clean 2024-01-22T05:19:13.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.12 is not active+clean 2024-01-22T05:19:13.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.612395+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:19:13.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.10 is not active+clean 2024-01-22T05:19:13.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.11 is not active+clean 2024-01-22T05:19:13.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.624566+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:19:13.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.11 is not active+clean 2024-01-22T05:19:13.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.10 is not active+clean 2024-01-22T05:19:13.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.623630+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:19:13.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.e is not active+clean 2024-01-22T05:19:13.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.f is not active+clean 2024-01-22T05:19:13.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.625462+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:19:13.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.f is not active+clean 2024-01-22T05:19:13.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.e is not active+clean 2024-01-22T05:19:13.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.613870+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:19:13.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.c is not active+clean 2024-01-22T05:19:13.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.d is not active+clean 2024-01-22T05:19:13.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.625840+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:19:13.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.d is not active+clean 2024-01-22T05:19:13.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.c is not active+clean 2024-01-22T05:19:13.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.631029+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:19:13.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.a is not active+clean 2024-01-22T05:19:13.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.b is not active+clean 2024-01-22T05:19:13.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.624399+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:19:13.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.b is not active+clean 2024-01-22T05:19:13.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.a is not active+clean 2024-01-22T05:19:13.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.619505+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:19:13.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.8 is not active+clean 2024-01-22T05:19:13.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.9 is not active+clean 2024-01-22T05:19:13.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.619190+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:19:13.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.9 is not active+clean 2024-01-22T05:19:13.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.8 is not active+clean 2024-01-22T05:19:13.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.622733+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:19:13.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.6 is not active+clean 2024-01-22T05:19:13.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.7 is not active+clean 2024-01-22T05:19:13.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.631398+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:19:13.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.7 is not active+clean 2024-01-22T05:19:13.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.6 is not active+clean 2024-01-22T05:19:13.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.620053+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:19:13.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.4 is not active+clean 2024-01-22T05:19:13.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.5 is not active+clean 2024-01-22T05:19:13.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.624150+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:19:13.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.5 is not active+clean 2024-01-22T05:19:13.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.4 is not active+clean 2024-01-22T05:19:13.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.631464+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:19:13.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.2 is not active+clean 2024-01-22T05:19:13.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3 is not active+clean 2024-01-22T05:19:13.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.620132+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:19:13.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.3 is not active+clean 2024-01-22T05:19:13.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2 is not active+clean 2024-01-22T05:19:13.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.625236+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:19:13.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.0 is not active+clean 2024-01-22T05:19:13.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1 is not active+clean 2024-01-22T05:19:13.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.612396+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:19:13.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.1 is not active+clean 2024-01-22T05:19:13.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.0 is not active+clean 2024-01-22T05:19:13.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.616919+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:19:13.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.1e is not active+clean 2024-01-22T05:19:13.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1f is not active+clean 2024-01-22T05:19:13.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.616806+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:19:13.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.1f is not active+clean 2024-01-22T05:19:13.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1e is not active+clean 2024-01-22T05:19:13.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.614588+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:19:13.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.1c is not active+clean 2024-01-22T05:19:13.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1d is not active+clean 2024-01-22T05:19:13.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.632258+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:19:13.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.1d is not active+clean 2024-01-22T05:19:13.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1c is not active+clean 2024-01-22T05:19:13.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.621207+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:19:13.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.1b is not active+clean 2024-01-22T05:19:13.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1a is not active+clean 2024-01-22T05:19:13.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.624185+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:19:13.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.18 is not active+clean 2024-01-22T05:19:13.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.19 is not active+clean 2024-01-22T05:19:13.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.624794+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:19:13.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.19 is not active+clean 2024-01-22T05:19:13.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.18 is not active+clean 2024-01-22T05:19:13.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.612989+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-22T05:19:13.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.1a is not active+clean 2024-01-22T05:19:13.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:19:07.612991+0000', 'last_change': '2024-01-22T05:19:07.612991+0000', 'last_active': '2024-01-22T05:19:07.612991+0000', 'last_peered': '2024-01-22T05:19:07.612991+0000', 'last_clean': '2024-01-22T05:19:07.612991+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:07.612991+0000', 'last_undegraded': '2024-01-22T05:19:07.612991+0000', 'last_fullsized': '2024-01-22T05:19:07.612991+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:07.612991+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:19:13.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1b is not active+clean 2024-01-22T05:19:13.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:19:06.601696+0000', 'last_change': '2024-01-22T05:19:06.617386+0000', 'last_active': '2024-01-22T05:19:06.601696+0000', 'last_peered': '2024-01-22T05:19:06.601696+0000', 'last_clean': '2024-01-22T05:19:06.601696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:19:06.601696+0000', 'last_undegraded': '2024-01-22T05:19:06.601696+0000', 'last_fullsized': '2024-01-22T05:19:06.601696+0000', 'mapping_epoch': 181, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 181, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'last_clean_scrub_stamp': '2024-01-22T05:19:06.601696+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:19:13.355 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:19:13.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.528+0000 7fcf1e800700 1 Processor -- start 2024-01-22T05:19:13.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.532+0000 7fcf1e800700 1 -- start start 2024-01-22T05:19:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf1e800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf180bc580 0x7fcf180bca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf1e800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf18153930 0x7fcf18153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf1e800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf180c2130 con 0x7fcf180c2d90 2024-01-22T05:19:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf1e800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf18154c50 con 0x7fcf18153930 2024-01-22T05:19:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf1e800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf18154f30 con 0x7fcf180bc580 2024-01-22T05:19:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf17400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcf180c2d90 0x7fcf180c3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48136/0 (socket says 172.21.15.49:48136) 2024-01-22T05:19:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf17400700 1 -- 172.21.15.49:0/3630515038 learned_addr learned my addr 172.21.15.49:0/3630515038 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf17e00700 1 --2- 172.21.15.49:0/3630515038 >> v2:172.21.15.49:3300/0 conn(0x7fcf18153930 0x7fcf18153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf16a00700 1 --2- 172.21.15.49:0/3630515038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf180bc580 0x7fcf180bca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf16000700 1 -- 172.21.15.49:0/3630515038 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596414901 0 0) 0x7fcf180c2130 con 0x7fcf180c2d90 2024-01-22T05:19:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf16000700 1 -- 172.21.15.49:0/3630515038 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcef80033f0 con 0x7fcf180c2d90 2024-01-22T05:19:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf17e00700 1 -- 172.21.15.49:0/3630515038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf180bc580 msgr2=0x7fcf180bca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf17e00700 1 --2- 172.21.15.49:0/3630515038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf180bc580 0x7fcf180bca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf17e00700 1 -- 172.21.15.49:0/3630515038 >> v1:172.21.15.49:6789/0 conn(0x7fcf180c2d90 legacy=0x7fcf180c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf17e00700 1 -- 172.21.15.49:0/3630515038 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf180c1dc0 con 0x7fcf18153930 2024-01-22T05:19:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf17e00700 1 --2- 172.21.15.49:0/3630515038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf18153930 0x7fcf18153dc0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7fcf10009e60 tx=0x7fcf10009780).ready entity=mon.0 client_cookie=2d5b1478b7ce4627 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf16000700 1 -- 172.21.15.49:0/3630515038 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000e070 con 0x7fcf18153930 2024-01-22T05:19:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf16000700 1 -- 172.21.15.49:0/3630515038 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1000bab0 con 0x7fcf18153930 2024-01-22T05:19:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.536+0000 7fcf16000700 1 -- 172.21.15.49:0/3630515038 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000be30 con 0x7fcf18153930 2024-01-22T05:19:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.540+0000 7fcf1e800700 1 -- 172.21.15.49:0/3630515038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf18153930 msgr2=0x7fcf18153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.540+0000 7fcf1e800700 1 --2- 172.21.15.49:0/3630515038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf18153930 0x7fcf18153dc0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7fcf10009e60 tx=0x7fcf10009780).stop 2024-01-22T05:19:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.540+0000 7fcf1e800700 1 -- 172.21.15.49:0/3630515038 shutdown_connections 2024-01-22T05:19:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.540+0000 7fcf1e800700 1 --2- 172.21.15.49:0/3630515038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf18153930 0x7fcf18153dc0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.540+0000 7fcf1e800700 1 --2- 172.21.15.49:0/3630515038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf180bc580 0x7fcf180bca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.540+0000 7fcf1e800700 1 -- 172.21.15.49:0/3630515038 >> 172.21.15.49:0/3630515038 conn(0x7fcf18066830 msgr2=0x7fcf18066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.540+0000 7fcf1e800700 1 -- 172.21.15.49:0/3630515038 shutdown_connections 2024-01-22T05:19:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.540+0000 7fcf1e800700 1 -- 172.21.15.49:0/3630515038 wait complete. 2024-01-22T05:19:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.540+0000 7fcf1e800700 1 Processor -- start 2024-01-22T05:19:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf1e800700 1 -- start start 2024-01-22T05:19:13.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf1e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf180bc580 0x7fcf180ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf1e800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf180c2d90 0x7fcf180c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf1e800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf18153930 0x7fcf1814ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf1e800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180ab4f0 con 0x7fcf180bc580 2024-01-22T05:19:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf1e800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180ad200 con 0x7fcf180c2d90 2024-01-22T05:19:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf1e800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180aa8e0 con 0x7fcf18153930 2024-01-22T05:19:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf17400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf180bc580 0x7fcf180ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf17400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf180bc580 0x7fcf180ab980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56142/0 (socket says 172.21.15.49:56142) 2024-01-22T05:19:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf17400700 1 -- 172.21.15.49:0/2050072575 learned_addr learned my addr 172.21.15.49:0/2050072575 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf17e00700 1 --2- 172.21.15.49:0/2050072575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf18153930 0x7fcf1814ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf16a00700 1 --2- 172.21.15.49:0/2050072575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf180c2d90 0x7fcf180c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf17400700 1 -- 172.21.15.49:0/2050072575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf18153930 msgr2=0x7fcf1814ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf17400700 1 --2- 172.21.15.49:0/2050072575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf18153930 0x7fcf1814ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf17400700 1 -- 172.21.15.49:0/2050072575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf180c2d90 msgr2=0x7fcf180c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.544+0000 7fcf17400700 1 --2- 172.21.15.49:0/2050072575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf180c2d90 0x7fcf180c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.548+0000 7fcf17400700 1 -- 172.21.15.49:0/2050072575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10009a20 con 0x7fcf180bc580 2024-01-22T05:19:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.548+0000 7fcf17400700 1 --2- 172.21.15.49:0/2050072575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf180bc580 0x7fcf180ab980 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7fcf0800c590 tx=0x7fcf08007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.548+0000 7fcf0ea00700 1 -- 172.21.15.49:0/2050072575 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf080072e0 con 0x7fcf180bc580 2024-01-22T05:19:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.548+0000 7fcf0ea00700 1 -- 172.21.15.49:0/2050072575 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf08007440 con 0x7fcf180bc580 2024-01-22T05:19:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.548+0000 7fcf1e800700 1 -- 172.21.15.49:0/2050072575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf180aabc0 con 0x7fcf180bc580 2024-01-22T05:19:13.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.548+0000 7fcf0ea00700 1 -- 172.21.15.49:0/2050072575 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf080057a0 con 0x7fcf180bc580 2024-01-22T05:19:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.548+0000 7fcf1e800700 1 -- 172.21.15.49:0/2050072575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf180ab180 con 0x7fcf180bc580 2024-01-22T05:19:13.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.548+0000 7fcf1e800700 1 -- 172.21.15.49:0/2050072575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf180657b0 con 0x7fcf180bc580 2024-01-22T05:19:13.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.548+0000 7fcf0ea00700 1 -- 172.21.15.49:0/2050072575 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcf08005bd0 con 0x7fcf180bc580 2024-01-22T05:19:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.552+0000 7fcf0ea00700 1 --2- 172.21.15.49:0/2050072575 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcef005a510 0x7fcef005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.552+0000 7fcf0ea00700 1 -- 172.21.15.49:0/2050072575 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fcf08073d40 con 0x7fcf180bc580 2024-01-22T05:19:13.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.552+0000 7fcf16a00700 1 --2- 172.21.15.49:0/2050072575 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcef005a510 0x7fcef005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.552+0000 7fcf16a00700 1 --2- 172.21.15.49:0/2050072575 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcef005a510 0x7fcef005c9d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7fcf180bfe00 tx=0x7fcf00009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:13.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.556+0000 7fcf0ea00700 1 -- 172.21.15.49:0/2050072575 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcf080473c0 con 0x7fcf180bc580 2024-01-22T05:19:13.590 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-22T05:19:13.588+0000 7f2230800700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:19:13.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.768+0000 7fcf1e800700 1 -- 172.21.15.49:0/2050072575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fcf180bdf40 con 0x7fcf180bc580 2024-01-22T05:19:13.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.772+0000 7fcf0ea00700 1 -- 172.21.15.49:0/2050072575 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1114 (secure 0 0 0) 0x7fcf08018020 con 0x7fcf180bc580 2024-01-22T05:19:13.771 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:13.771 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":897,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":184,"num_osds":8,"num_up_osds":8,"osd_up_since":1705899866,"num_in_osds":8,"osd_in_since":1705899859,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2524332032,"bytes_avail":770569781248,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":142,"id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"a","status":"up:active","gid":10104}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":31,"modified":"2024-01-22T05:17:21.517693+0000","services":{}},"progress_events":{}} 2024-01-22T05:19:13.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.772+0000 7fcf1e800700 1 -- 172.21.15.49:0/2050072575 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcef005a510 msgr2=0x7fcef005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.772+0000 7fcf1e800700 1 --2- 172.21.15.49:0/2050072575 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcef005a510 0x7fcef005c9d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7fcf180bfe00 tx=0x7fcf00009060).stop 2024-01-22T05:19:13.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.772+0000 7fcf1e800700 1 -- 172.21.15.49:0/2050072575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf180bc580 msgr2=0x7fcf180ab980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.772+0000 7fcf1e800700 1 --2- 172.21.15.49:0/2050072575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf180bc580 0x7fcf180ab980 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7fcf0800c590 tx=0x7fcf08007c80).stop 2024-01-22T05:19:13.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.776+0000 7fcf1e800700 1 -- 172.21.15.49:0/2050072575 shutdown_connections 2024-01-22T05:19:13.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.776+0000 7fcf1e800700 1 --2- 172.21.15.49:0/2050072575 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcef005a510 0x7fcef005c9d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.776+0000 7fcf1e800700 1 --2- 172.21.15.49:0/2050072575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf18153930 0x7fcf1814ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.776+0000 7fcf1e800700 1 --2- 172.21.15.49:0/2050072575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf180c2d90 0x7fcf180c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.776+0000 7fcf1e800700 1 --2- 172.21.15.49:0/2050072575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf180bc580 0x7fcf180ab980 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.776+0000 7fcf1e800700 1 -- 172.21.15.49:0/2050072575 >> 172.21.15.49:0/2050072575 conn(0x7fcf18066830 msgr2=0x7fcf180c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:13.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.776+0000 7fcf1e800700 1 -- 172.21.15.49:0/2050072575 shutdown_connections 2024-01-22T05:19:13.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.776+0000 7fcf1e800700 1 -- 172.21.15.49:0/2050072575 wait complete. 2024-01-22T05:19:13.796 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-22T05:19:13.796 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:19:13.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.960+0000 7f7d0e200700 1 Processor -- start 2024-01-22T05:19:13.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.960+0000 7f7d0e200700 1 -- start start 2024-01-22T05:19:13.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.960+0000 7f7d0e200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d08155d20 0x7f7d08065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.960+0000 7f7d0e200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7d080a8e50 0x7f7d080c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.960+0000 7f7d0e200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d080c1a40 con 0x7f7d08066070 2024-01-22T05:19:13.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.960+0000 7f7d0e200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d08159310 con 0x7f7d080a8e50 2024-01-22T05:19:13.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.960+0000 7f7d0e200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080c13f0 con 0x7f7d08155d20 2024-01-22T05:19:13.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.964+0000 7f7d07e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7d080a8e50 0x7f7d080c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.964+0000 7f7d07400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d08155d20 0x7f7d08065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.964+0000 7f7d06a00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7d08066070 0x7f7d080a8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:57750/0 (socket says 172.21.15.49:57750) 2024-01-22T05:19:13.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.964+0000 7f7d06a00700 1 -- 172.21.15.49:0/3764250846 learned_addr learned my addr 172.21.15.49:0/3764250846 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:13.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.964+0000 7f7d06000700 1 -- 172.21.15.49:0/3764250846 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721171554 0 0) 0x7f7d080c1a40 con 0x7f7d08066070 2024-01-22T05:19:13.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.964+0000 7f7d06000700 1 -- 172.21.15.49:0/3764250846 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce80033f0 con 0x7f7d08066070 2024-01-22T05:19:13.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.964+0000 7f7d07e00700 1 -- 172.21.15.49:0/3764250846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d08155d20 msgr2=0x7f7d08065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:13.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.964+0000 7f7d07e00700 1 --2- 172.21.15.49:0/3764250846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d08155d20 0x7f7d08065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.964+0000 7f7d07e00700 1 -- 172.21.15.49:0/3764250846 >> v1:172.21.15.110:6789/0 conn(0x7f7d08066070 legacy=0x7f7d080a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.964+0000 7f7d07e00700 1 -- 172.21.15.49:0/3764250846 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d080c16d0 con 0x7f7d080a8e50 2024-01-22T05:19:13.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.964+0000 7f7d07400700 1 --2- 172.21.15.49:0/3764250846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d08155d20 0x7f7d08065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:13.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.964+0000 7f7d07e00700 1 --2- 172.21.15.49:0/3764250846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d080a8e50 0x7f7d080c1ed0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f7d00009e60 tx=0x7f7d00009780).ready entity=mon.1 client_cookie=d6d06a933ecbb5f9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:13.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.964+0000 7f7d06000700 1 -- 172.21.15.49:0/3764250846 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000e070 con 0x7f7d080a8e50 2024-01-22T05:19:13.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.964+0000 7f7d06000700 1 -- 172.21.15.49:0/3764250846 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0000bab0 con 0x7f7d080a8e50 2024-01-22T05:19:13.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.964+0000 7f7d06000700 1 -- 172.21.15.49:0/3764250846 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000be30 con 0x7f7d080a8e50 2024-01-22T05:19:13.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.968+0000 7f7d0e200700 1 -- 172.21.15.49:0/3764250846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d080a8e50 msgr2=0x7f7d080c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.968+0000 7f7d0e200700 1 --2- 172.21.15.49:0/3764250846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d080a8e50 0x7f7d080c1ed0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f7d00009e60 tx=0x7f7d00009780).stop 2024-01-22T05:19:13.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.968+0000 7f7d0e200700 1 -- 172.21.15.49:0/3764250846 shutdown_connections 2024-01-22T05:19:13.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.968+0000 7f7d0e200700 1 --2- 172.21.15.49:0/3764250846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d080a8e50 0x7f7d080c1ed0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.968+0000 7f7d0e200700 1 --2- 172.21.15.49:0/3764250846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d08155d20 0x7f7d08065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.968+0000 7f7d0e200700 1 -- 172.21.15.49:0/3764250846 >> 172.21.15.49:0/3764250846 conn(0x7f7d080c6540 msgr2=0x7f7d080c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:13.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.968+0000 7f7d0e200700 1 -- 172.21.15.49:0/3764250846 shutdown_connections 2024-01-22T05:19:13.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.968+0000 7f7d0e200700 1 -- 172.21.15.49:0/3764250846 wait complete. 2024-01-22T05:19:13.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.972+0000 7f7d0e200700 1 Processor -- start 2024-01-22T05:19:13.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.972+0000 7f7d0e200700 1 -- start start 2024-01-22T05:19:13.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.972+0000 7f7d0e200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d08066070 0x7f7d0814eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.972+0000 7f7d0e200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d080a8e50 0x7f7d08153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.972+0000 7f7d0e200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d08155d20 0x7f7d080bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.972+0000 7f7d0e200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080aad50 con 0x7f7d08066070 2024-01-22T05:19:13.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.972+0000 7f7d0e200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080aa720 con 0x7f7d08155d20 2024-01-22T05:19:13.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.972+0000 7f7d0e200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080be3d0 con 0x7f7d080a8e50 2024-01-22T05:19:13.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.972+0000 7f7d07400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d08066070 0x7f7d0814eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.972+0000 7f7d07400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d08066070 0x7f7d0814eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56144/0 (socket says 172.21.15.49:56144) 2024-01-22T05:19:13.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.972+0000 7f7d07400700 1 -- 172.21.15.49:0/627784882 learned_addr learned my addr 172.21.15.49:0/627784882 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:13.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.972+0000 7f7d06a00700 1 --2- 172.21.15.49:0/627784882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d080a8e50 0x7f7d08153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.976+0000 7f7d07e00700 1 --2- 172.21.15.49:0/627784882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d08155d20 0x7f7d080bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.976+0000 7f7d07400700 1 -- 172.21.15.49:0/627784882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d080a8e50 msgr2=0x7f7d08153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.976+0000 7f7d07400700 1 --2- 172.21.15.49:0/627784882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d080a8e50 0x7f7d08153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.976+0000 7f7d07400700 1 -- 172.21.15.49:0/627784882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d08155d20 msgr2=0x7f7d080bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:13.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.976+0000 7f7d07400700 1 --2- 172.21.15.49:0/627784882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d08155d20 0x7f7d080bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:13.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.976+0000 7f7d07400700 1 -- 172.21.15.49:0/627784882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf80092a0 con 0x7f7d08066070 2024-01-22T05:19:13.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.976+0000 7f7d07e00700 1 --2- 172.21.15.49:0/627784882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d08155d20 0x7f7d080bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:13.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.976+0000 7f7d07400700 1 --2- 172.21.15.49:0/627784882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d08066070 0x7f7d0814eac0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f7cf800e980 tx=0x7f7cf8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:13.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.976+0000 7f7cfea00700 1 -- 172.21.15.49:0/627784882 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800ee70 con 0x7f7d08066070 2024-01-22T05:19:13.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.976+0000 7f7cfea00700 1 -- 172.21.15.49:0/627784882 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf800c850 con 0x7f7d08066070 2024-01-22T05:19:13.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.976+0000 7f7d0e200700 1 -- 172.21.15.49:0/627784882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d00009a20 con 0x7f7d08066070 2024-01-22T05:19:13.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.976+0000 7f7cfea00700 1 -- 172.21.15.49:0/627784882 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800cbd0 con 0x7f7d08066070 2024-01-22T05:19:13.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.976+0000 7f7d0e200700 1 -- 172.21.15.49:0/627784882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d080aa9e0 con 0x7f7d08066070 2024-01-22T05:19:13.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.976+0000 7f7d0e200700 1 -- 172.21.15.49:0/627784882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d08047060 con 0x7f7d08066070 2024-01-22T05:19:13.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.980+0000 7f7cfea00700 1 -- 172.21.15.49:0/627784882 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7cf801b400 con 0x7f7d08066070 2024-01-22T05:19:13.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.980+0000 7f7cfea00700 1 --2- 172.21.15.49:0/627784882 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ce005a540 0x7f7ce005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:13.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.980+0000 7f7cfea00700 1 -- 172.21.15.49:0/627784882 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7cf8074e50 con 0x7f7d08066070 2024-01-22T05:19:13.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.980+0000 7f7d06a00700 1 --2- 172.21.15.49:0/627784882 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ce005a540 0x7f7ce005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:13.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.980+0000 7f7d06a00700 1 --2- 172.21.15.49:0/627784882 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ce005a540 0x7f7ce005ca00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f7d080a8cc0 tx=0x7f7cf0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:13.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:13.988+0000 7f7cfea00700 1 -- 172.21.15.49:0/627784882 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7cf8048520 con 0x7f7d08066070 2024-01-22T05:19:14.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:14.152+0000 7f7d0e200700 1 -- 172.21.15.49:0/627784882 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d080aae90 con 0x7f7ce005a540 2024-01-22T05:19:14.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:14.164+0000 7f7cfea00700 1 -- 172.21.15.49:0/627784882 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359638 (secure 0 0 0) 0x7f7cf00015a0 con 0x7f7ce005a540 2024-01-22T05:19:14.170 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:14.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:14.172+0000 7f7d0e200700 1 -- 172.21.15.49:0/627784882 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ce005a540 msgr2=0x7f7ce005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:14.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:14.172+0000 7f7d0e200700 1 --2- 172.21.15.49:0/627784882 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ce005a540 0x7f7ce005ca00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f7d080a8cc0 tx=0x7f7cf0009040).stop 2024-01-22T05:19:14.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:14.172+0000 7f7d0e200700 1 -- 172.21.15.49:0/627784882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d08066070 msgr2=0x7f7d0814eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:14.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:14.172+0000 7f7d0e200700 1 --2- 172.21.15.49:0/627784882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d08066070 0x7f7d0814eac0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f7cf800e980 tx=0x7f7cf8009060).stop 2024-01-22T05:19:14.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:14.172+0000 7f7d0e200700 1 -- 172.21.15.49:0/627784882 shutdown_connections 2024-01-22T05:19:14.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:14.172+0000 7f7d0e200700 1 --2- 172.21.15.49:0/627784882 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7ce005a540 0x7f7ce005ca00 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:14.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:14.172+0000 7f7d0e200700 1 --2- 172.21.15.49:0/627784882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d08155d20 0x7f7d080bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:14.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:14.172+0000 7f7d0e200700 1 --2- 172.21.15.49:0/627784882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d080a8e50 0x7f7d08153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:14.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:14.172+0000 7f7d0e200700 1 --2- 172.21.15.49:0/627784882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d08066070 0x7f7d0814eac0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:14.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:14.172+0000 7f7d0e200700 1 -- 172.21.15.49:0/627784882 >> 172.21.15.49:0/627784882 conn(0x7f7d080c6540 msgr2=0x7f7d080c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:14.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:14.176+0000 7f7d0e200700 1 -- 172.21.15.49:0/627784882 shutdown_connections 2024-01-22T05:19:14.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:14.176+0000 7f7d0e200700 1 -- 172.21.15.49:0/627784882 wait complete. 2024-01-22T05:19:14.178 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:19:14.196 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":620,"stamp":"2024-01-22T05:19:13.558628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2469664,"kb_used_data":18144,"kb_used_omap":0,"kb_used_meta":2451456,"kb_avail":752505056,"statfs":{"total":773094113280,"available":770565177344,"internally_reserved":0,"allocated":18579456,"data_stored":9246020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510290944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2306,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.000570"},"pg_stats":[{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.089268+0000","last_change":"2024-01-22T05:19:08.084948+0000","last_active":"2024-01-22T05:19:08.089268+0000","last_peered":"2024-01-22T05:19:08.089268+0000","last_clean":"2024-01-22T05:19:08.089268+0000","last_became_active":"2024-01-22T05:19:08.084684+0000","last_became_peered":"2024-01-22T05:19:08.084684+0000","last_unstale":"2024-01-22T05:19:08.089268+0000","last_undegraded":"2024-01-22T05:19:08.089268+0000","last_fullsized":"2024-01-22T05:19:08.089268+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3f","version":"183'3","reported_seq":13,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.112597+0000","last_change":"2024-01-22T05:19:07.656070+0000","last_active":"2024-01-22T05:19:08.112597+0000","last_peered":"2024-01-22T05:19:08.112597+0000","last_clean":"2024-01-22T05:19:08.112597+0000","last_became_active":"2024-01-22T05:19:07.655574+0000","last_became_peered":"2024-01-22T05:19:07.655574+0000","last_unstale":"2024-01-22T05:19:08.112597+0000","last_undegraded":"2024-01-22T05:19:08.112597+0000","last_fullsized":"2024-01-22T05:19:08.112597+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.113399+0000","last_change":"2024-01-22T05:19:08.105745+0000","last_active":"2024-01-22T05:19:08.113399+0000","last_peered":"2024-01-22T05:19:08.113399+0000","last_clean":"2024-01-22T05:19:08.113399+0000","last_became_active":"2024-01-22T05:19:08.105444+0000","last_became_peered":"2024-01-22T05:19:08.105444+0000","last_unstale":"2024-01-22T05:19:08.113399+0000","last_undegraded":"2024-01-22T05:19:08.113399+0000","last_fullsized":"2024-01-22T05:19:08.113399+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.093907+0000","last_change":"2024-01-22T05:19:07.669270+0000","last_active":"2024-01-22T05:19:08.093907+0000","last_peered":"2024-01-22T05:19:08.093907+0000","last_clean":"2024-01-22T05:19:08.093907+0000","last_became_active":"2024-01-22T05:19:07.668953+0000","last_became_peered":"2024-01-22T05:19:07.668953+0000","last_unstale":"2024-01-22T05:19:08.093907+0000","last_undegraded":"2024-01-22T05:19:08.093907+0000","last_fullsized":"2024-01-22T05:19:08.093907+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.108064+0000","last_change":"2024-01-22T05:19:08.104194+0000","last_active":"2024-01-22T05:19:08.108064+0000","last_peered":"2024-01-22T05:19:08.108064+0000","last_clean":"2024-01-22T05:19:08.108064+0000","last_became_active":"2024-01-22T05:19:08.103042+0000","last_became_peered":"2024-01-22T05:19:08.103042+0000","last_unstale":"2024-01-22T05:19:08.108064+0000","last_undegraded":"2024-01-22T05:19:08.108064+0000","last_fullsized":"2024-01-22T05:19:08.108064+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.090735+0000","last_change":"2024-01-22T05:19:07.651051+0000","last_active":"2024-01-22T05:19:08.090735+0000","last_peered":"2024-01-22T05:19:08.090735+0000","last_clean":"2024-01-22T05:19:08.090735+0000","last_became_active":"2024-01-22T05:19:07.650703+0000","last_became_peered":"2024-01-22T05:19:07.650703+0000","last_unstale":"2024-01-22T05:19:08.090735+0000","last_undegraded":"2024-01-22T05:19:08.090735+0000","last_fullsized":"2024-01-22T05:19:08.090735+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110577+0000","last_change":"2024-01-22T05:19:08.097453+0000","last_active":"2024-01-22T05:19:08.110577+0000","last_peered":"2024-01-22T05:19:08.110577+0000","last_clean":"2024-01-22T05:19:08.110577+0000","last_became_active":"2024-01-22T05:19:08.097164+0000","last_became_peered":"2024-01-22T05:19:08.097164+0000","last_unstale":"2024-01-22T05:19:08.110577+0000","last_undegraded":"2024-01-22T05:19:08.110577+0000","last_fullsized":"2024-01-22T05:19:08.110577+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3c","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.114566+0000","last_change":"2024-01-22T05:19:07.650060+0000","last_active":"2024-01-22T05:19:08.114566+0000","last_peered":"2024-01-22T05:19:08.114566+0000","last_clean":"2024-01-22T05:19:08.114566+0000","last_became_active":"2024-01-22T05:19:07.649797+0000","last_became_peered":"2024-01-22T05:19:07.649797+0000","last_unstale":"2024-01-22T05:19:08.114566+0000","last_undegraded":"2024-01-22T05:19:08.114566+0000","last_fullsized":"2024-01-22T05:19:08.114566+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.107902+0000","last_change":"2024-01-22T05:19:08.105224+0000","last_active":"2024-01-22T05:19:08.107902+0000","last_peered":"2024-01-22T05:19:08.107902+0000","last_clean":"2024-01-22T05:19:08.107902+0000","last_became_active":"2024-01-22T05:19:08.104957+0000","last_became_peered":"2024-01-22T05:19:08.104957+0000","last_unstale":"2024-01-22T05:19:08.107902+0000","last_undegraded":"2024-01-22T05:19:08.107902+0000","last_fullsized":"2024-01-22T05:19:08.107902+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.119110+0000","last_change":"2024-01-22T05:19:07.670474+0000","last_active":"2024-01-22T05:19:08.119110+0000","last_peered":"2024-01-22T05:19:08.119110+0000","last_clean":"2024-01-22T05:19:08.119110+0000","last_became_active":"2024-01-22T05:19:07.670188+0000","last_became_peered":"2024-01-22T05:19:07.670188+0000","last_unstale":"2024-01-22T05:19:08.119110+0000","last_undegraded":"2024-01-22T05:19:08.119110+0000","last_fullsized":"2024-01-22T05:19:08.119110+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.123392+0000","last_change":"2024-01-22T05:19:08.121080+0000","last_active":"2024-01-22T05:19:08.123392+0000","last_peered":"2024-01-22T05:19:08.123392+0000","last_clean":"2024-01-22T05:19:08.123392+0000","last_became_active":"2024-01-22T05:19:08.120818+0000","last_became_peered":"2024-01-22T05:19:08.120818+0000","last_unstale":"2024-01-22T05:19:08.123392+0000","last_undegraded":"2024-01-22T05:19:08.123392+0000","last_fullsized":"2024-01-22T05:19:08.123392+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.119989+0000","last_change":"2024-01-22T05:19:07.671413+0000","last_active":"2024-01-22T05:19:08.119989+0000","last_peered":"2024-01-22T05:19:08.119989+0000","last_clean":"2024-01-22T05:19:08.119989+0000","last_became_active":"2024-01-22T05:19:07.671100+0000","last_became_peered":"2024-01-22T05:19:07.671100+0000","last_unstale":"2024-01-22T05:19:08.119989+0000","last_undegraded":"2024-01-22T05:19:08.119989+0000","last_fullsized":"2024-01-22T05:19:08.119989+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.120711+0000","last_change":"2024-01-22T05:19:08.117346+0000","last_active":"2024-01-22T05:19:08.120711+0000","last_peered":"2024-01-22T05:19:08.120711+0000","last_clean":"2024-01-22T05:19:08.120711+0000","last_became_active":"2024-01-22T05:19:08.117050+0000","last_became_peered":"2024-01-22T05:19:08.117050+0000","last_unstale":"2024-01-22T05:19:08.120711+0000","last_undegraded":"2024-01-22T05:19:08.120711+0000","last_fullsized":"2024-01-22T05:19:08.120711+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.080440+0000","last_change":"2024-01-22T05:19:07.666450+0000","last_active":"2024-01-22T05:19:08.080440+0000","last_peered":"2024-01-22T05:19:08.080440+0000","last_clean":"2024-01-22T05:19:08.080440+0000","last_became_active":"2024-01-22T05:19:07.666151+0000","last_became_peered":"2024-01-22T05:19:07.666151+0000","last_unstale":"2024-01-22T05:19:08.080440+0000","last_undegraded":"2024-01-22T05:19:08.080440+0000","last_fullsized":"2024-01-22T05:19:08.080440+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.122008+0000","last_change":"2024-01-22T05:19:08.120496+0000","last_active":"2024-01-22T05:19:08.122008+0000","last_peered":"2024-01-22T05:19:08.122008+0000","last_clean":"2024-01-22T05:19:08.122008+0000","last_became_active":"2024-01-22T05:19:08.120211+0000","last_became_peered":"2024-01-22T05:19:08.120211+0000","last_unstale":"2024-01-22T05:19:08.122008+0000","last_undegraded":"2024-01-22T05:19:08.122008+0000","last_fullsized":"2024-01-22T05:19:08.122008+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.088836+0000","last_change":"2024-01-22T05:19:07.657604+0000","last_active":"2024-01-22T05:19:08.088836+0000","last_peered":"2024-01-22T05:19:08.088836+0000","last_clean":"2024-01-22T05:19:08.088836+0000","last_became_active":"2024-01-22T05:19:07.657049+0000","last_became_peered":"2024-01-22T05:19:07.657049+0000","last_unstale":"2024-01-22T05:19:08.088836+0000","last_undegraded":"2024-01-22T05:19:08.088836+0000","last_fullsized":"2024-01-22T05:19:08.088836+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117103+0000","last_change":"2024-01-22T05:19:08.107237+0000","last_active":"2024-01-22T05:19:08.117103+0000","last_peered":"2024-01-22T05:19:08.117103+0000","last_clean":"2024-01-22T05:19:08.117103+0000","last_became_active":"2024-01-22T05:19:08.106872+0000","last_became_peered":"2024-01-22T05:19:08.106872+0000","last_unstale":"2024-01-22T05:19:08.117103+0000","last_undegraded":"2024-01-22T05:19:08.117103+0000","last_fullsized":"2024-01-22T05:19:08.117103+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094858+0000","last_change":"2024-01-22T05:19:07.655847+0000","last_active":"2024-01-22T05:19:08.094858+0000","last_peered":"2024-01-22T05:19:08.094858+0000","last_clean":"2024-01-22T05:19:08.094858+0000","last_became_active":"2024-01-22T05:19:07.655215+0000","last_became_peered":"2024-01-22T05:19:07.655215+0000","last_unstale":"2024-01-22T05:19:08.094858+0000","last_undegraded":"2024-01-22T05:19:08.094858+0000","last_fullsized":"2024-01-22T05:19:08.094858+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.102212+0000","last_change":"2024-01-22T05:19:08.096055+0000","last_active":"2024-01-22T05:19:08.102212+0000","last_peered":"2024-01-22T05:19:08.102212+0000","last_clean":"2024-01-22T05:19:08.102212+0000","last_became_active":"2024-01-22T05:19:08.095727+0000","last_became_peered":"2024-01-22T05:19:08.095727+0000","last_unstale":"2024-01-22T05:19:08.102212+0000","last_undegraded":"2024-01-22T05:19:08.102212+0000","last_fullsized":"2024-01-22T05:19:08.102212+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.091263+0000","last_change":"2024-01-22T05:19:07.670516+0000","last_active":"2024-01-22T05:19:08.091263+0000","last_peered":"2024-01-22T05:19:08.091263+0000","last_clean":"2024-01-22T05:19:08.091263+0000","last_became_active":"2024-01-22T05:19:07.670199+0000","last_became_peered":"2024-01-22T05:19:07.670199+0000","last_unstale":"2024-01-22T05:19:08.091263+0000","last_undegraded":"2024-01-22T05:19:08.091263+0000","last_fullsized":"2024-01-22T05:19:08.091263+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.109610+0000","last_change":"2024-01-22T05:19:08.103330+0000","last_active":"2024-01-22T05:19:08.109610+0000","last_peered":"2024-01-22T05:19:08.109610+0000","last_clean":"2024-01-22T05:19:08.109610+0000","last_became_active":"2024-01-22T05:19:08.101344+0000","last_became_peered":"2024-01-22T05:19:08.101344+0000","last_unstale":"2024-01-22T05:19:08.109610+0000","last_undegraded":"2024-01-22T05:19:08.109610+0000","last_fullsized":"2024-01-22T05:19:08.109610+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.079329+0000","last_change":"2024-01-22T05:19:07.635899+0000","last_active":"2024-01-22T05:19:08.079329+0000","last_peered":"2024-01-22T05:19:08.079329+0000","last_clean":"2024-01-22T05:19:08.079329+0000","last_became_active":"2024-01-22T05:19:07.634902+0000","last_became_peered":"2024-01-22T05:19:07.634902+0000","last_unstale":"2024-01-22T05:19:08.079329+0000","last_undegraded":"2024-01-22T05:19:08.079329+0000","last_fullsized":"2024-01-22T05:19:08.079329+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.111140+0000","last_change":"2024-01-22T05:19:08.103939+0000","last_active":"2024-01-22T05:19:08.111140+0000","last_peered":"2024-01-22T05:19:08.111140+0000","last_clean":"2024-01-22T05:19:08.111140+0000","last_became_active":"2024-01-22T05:19:08.103677+0000","last_became_peered":"2024-01-22T05:19:08.103677+0000","last_unstale":"2024-01-22T05:19:08.111140+0000","last_undegraded":"2024-01-22T05:19:08.111140+0000","last_fullsized":"2024-01-22T05:19:08.111140+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.34","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.124565+0000","last_change":"2024-01-22T05:19:07.654867+0000","last_active":"2024-01-22T05:19:08.124565+0000","last_peered":"2024-01-22T05:19:08.124565+0000","last_clean":"2024-01-22T05:19:08.124565+0000","last_became_active":"2024-01-22T05:19:07.654182+0000","last_became_peered":"2024-01-22T05:19:07.654182+0000","last_unstale":"2024-01-22T05:19:08.124565+0000","last_undegraded":"2024-01-22T05:19:08.124565+0000","last_fullsized":"2024-01-22T05:19:08.124565+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.119873+0000","last_change":"2024-01-22T05:19:08.116385+0000","last_active":"2024-01-22T05:19:08.119873+0000","last_peered":"2024-01-22T05:19:08.119873+0000","last_clean":"2024-01-22T05:19:08.119873+0000","last_became_active":"2024-01-22T05:19:08.116107+0000","last_became_peered":"2024-01-22T05:19:08.116107+0000","last_unstale":"2024-01-22T05:19:08.119873+0000","last_undegraded":"2024-01-22T05:19:08.119873+0000","last_fullsized":"2024-01-22T05:19:08.119873+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110117+0000","last_change":"2024-01-22T05:19:07.642633+0000","last_active":"2024-01-22T05:19:08.110117+0000","last_peered":"2024-01-22T05:19:08.110117+0000","last_clean":"2024-01-22T05:19:08.110117+0000","last_became_active":"2024-01-22T05:19:07.641864+0000","last_became_peered":"2024-01-22T05:19:07.641864+0000","last_unstale":"2024-01-22T05:19:08.110117+0000","last_undegraded":"2024-01-22T05:19:08.110117+0000","last_fullsized":"2024-01-22T05:19:08.110117+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.111153+0000","last_change":"2024-01-22T05:19:08.108136+0000","last_active":"2024-01-22T05:19:08.111153+0000","last_peered":"2024-01-22T05:19:08.111153+0000","last_clean":"2024-01-22T05:19:08.111153+0000","last_became_active":"2024-01-22T05:19:08.106570+0000","last_became_peered":"2024-01-22T05:19:08.106570+0000","last_unstale":"2024-01-22T05:19:08.111153+0000","last_undegraded":"2024-01-22T05:19:08.111153+0000","last_fullsized":"2024-01-22T05:19:08.111153+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.079410+0000","last_change":"2024-01-22T05:19:07.659977+0000","last_active":"2024-01-22T05:19:08.079410+0000","last_peered":"2024-01-22T05:19:08.079410+0000","last_clean":"2024-01-22T05:19:08.079410+0000","last_became_active":"2024-01-22T05:19:07.659689+0000","last_became_peered":"2024-01-22T05:19:07.659689+0000","last_unstale":"2024-01-22T05:19:08.079410+0000","last_undegraded":"2024-01-22T05:19:08.079410+0000","last_fullsized":"2024-01-22T05:19:08.079410+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117980+0000","last_change":"2024-01-22T05:19:08.113752+0000","last_active":"2024-01-22T05:19:08.117980+0000","last_peered":"2024-01-22T05:19:08.117980+0000","last_clean":"2024-01-22T05:19:08.117980+0000","last_became_active":"2024-01-22T05:19:08.113446+0000","last_became_peered":"2024-01-22T05:19:08.113446+0000","last_unstale":"2024-01-22T05:19:08.117980+0000","last_undegraded":"2024-01-22T05:19:08.117980+0000","last_fullsized":"2024-01-22T05:19:08.117980+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094990+0000","last_change":"2024-01-22T05:19:07.663889+0000","last_active":"2024-01-22T05:19:08.094990+0000","last_peered":"2024-01-22T05:19:08.094990+0000","last_clean":"2024-01-22T05:19:08.094990+0000","last_became_active":"2024-01-22T05:19:07.663562+0000","last_became_peered":"2024-01-22T05:19:07.663562+0000","last_unstale":"2024-01-22T05:19:08.094990+0000","last_undegraded":"2024-01-22T05:19:08.094990+0000","last_fullsized":"2024-01-22T05:19:08.094990+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.120067+0000","last_change":"2024-01-22T05:19:08.112048+0000","last_active":"2024-01-22T05:19:08.120067+0000","last_peered":"2024-01-22T05:19:08.120067+0000","last_clean":"2024-01-22T05:19:08.120067+0000","last_became_active":"2024-01-22T05:19:08.111758+0000","last_became_peered":"2024-01-22T05:19:08.111758+0000","last_unstale":"2024-01-22T05:19:08.120067+0000","last_undegraded":"2024-01-22T05:19:08.120067+0000","last_fullsized":"2024-01-22T05:19:08.120067+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.30","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.118827+0000","last_change":"2024-01-22T05:19:07.662875+0000","last_active":"2024-01-22T05:19:08.118827+0000","last_peered":"2024-01-22T05:19:08.118827+0000","last_clean":"2024-01-22T05:19:08.118827+0000","last_became_active":"2024-01-22T05:19:07.662369+0000","last_became_peered":"2024-01-22T05:19:07.662369+0000","last_unstale":"2024-01-22T05:19:08.118827+0000","last_undegraded":"2024-01-22T05:19:08.118827+0000","last_fullsized":"2024-01-22T05:19:08.118827+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117083+0000","last_change":"2024-01-22T05:19:08.103341+0000","last_active":"2024-01-22T05:19:08.117083+0000","last_peered":"2024-01-22T05:19:08.117083+0000","last_clean":"2024-01-22T05:19:08.117083+0000","last_became_active":"2024-01-22T05:19:08.103044+0000","last_became_peered":"2024-01-22T05:19:08.103044+0000","last_unstale":"2024-01-22T05:19:08.117083+0000","last_undegraded":"2024-01-22T05:19:08.117083+0000","last_fullsized":"2024-01-22T05:19:08.117083+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.092456+0000","last_change":"2024-01-22T05:19:07.668441+0000","last_active":"2024-01-22T05:19:08.092456+0000","last_peered":"2024-01-22T05:19:08.092456+0000","last_clean":"2024-01-22T05:19:08.092456+0000","last_became_active":"2024-01-22T05:19:07.668160+0000","last_became_peered":"2024-01-22T05:19:07.668160+0000","last_unstale":"2024-01-22T05:19:08.092456+0000","last_undegraded":"2024-01-22T05:19:08.092456+0000","last_fullsized":"2024-01-22T05:19:08.092456+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.113416+0000","last_change":"2024-01-22T05:19:08.107290+0000","last_active":"2024-01-22T05:19:08.113416+0000","last_peered":"2024-01-22T05:19:08.113416+0000","last_clean":"2024-01-22T05:19:08.113416+0000","last_became_active":"2024-01-22T05:19:08.107019+0000","last_became_peered":"2024-01-22T05:19:08.107019+0000","last_unstale":"2024-01-22T05:19:08.113416+0000","last_undegraded":"2024-01-22T05:19:08.113416+0000","last_fullsized":"2024-01-22T05:19:08.113416+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.081618+0000","last_change":"2024-01-22T05:19:07.649987+0000","last_active":"2024-01-22T05:19:08.081618+0000","last_peered":"2024-01-22T05:19:08.081618+0000","last_clean":"2024-01-22T05:19:08.081618+0000","last_became_active":"2024-01-22T05:19:07.649673+0000","last_became_peered":"2024-01-22T05:19:07.649673+0000","last_unstale":"2024-01-22T05:19:08.081618+0000","last_undegraded":"2024-01-22T05:19:08.081618+0000","last_fullsized":"2024-01-22T05:19:08.081618+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.122514+0000","last_change":"2024-01-22T05:19:08.120697+0000","last_active":"2024-01-22T05:19:08.122514+0000","last_peered":"2024-01-22T05:19:08.122514+0000","last_clean":"2024-01-22T05:19:08.122514+0000","last_became_active":"2024-01-22T05:19:08.120328+0000","last_became_peered":"2024-01-22T05:19:08.120328+0000","last_unstale":"2024-01-22T05:19:08.122514+0000","last_undegraded":"2024-01-22T05:19:08.122514+0000","last_fullsized":"2024-01-22T05:19:08.122514+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2d","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.109944+0000","last_change":"2024-01-22T05:19:07.655048+0000","last_active":"2024-01-22T05:19:08.109944+0000","last_peered":"2024-01-22T05:19:08.109944+0000","last_clean":"2024-01-22T05:19:08.109944+0000","last_became_active":"2024-01-22T05:19:07.654764+0000","last_became_peered":"2024-01-22T05:19:07.654764+0000","last_unstale":"2024-01-22T05:19:08.109944+0000","last_undegraded":"2024-01-22T05:19:08.109944+0000","last_fullsized":"2024-01-22T05:19:08.109944+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117175+0000","last_change":"2024-01-22T05:19:08.108885+0000","last_active":"2024-01-22T05:19:08.117175+0000","last_peered":"2024-01-22T05:19:08.117175+0000","last_clean":"2024-01-22T05:19:08.117175+0000","last_became_active":"2024-01-22T05:19:08.108611+0000","last_became_peered":"2024-01-22T05:19:08.108611+0000","last_unstale":"2024-01-22T05:19:08.117175+0000","last_undegraded":"2024-01-22T05:19:08.117175+0000","last_fullsized":"2024-01-22T05:19:08.117175+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.092028+0000","last_change":"2024-01-22T05:19:07.671996+0000","last_active":"2024-01-22T05:19:08.092028+0000","last_peered":"2024-01-22T05:19:08.092028+0000","last_clean":"2024-01-22T05:19:08.092028+0000","last_became_active":"2024-01-22T05:19:07.669870+0000","last_became_peered":"2024-01-22T05:19:07.669870+0000","last_unstale":"2024-01-22T05:19:08.092028+0000","last_undegraded":"2024-01-22T05:19:08.092028+0000","last_fullsized":"2024-01-22T05:19:08.092028+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.109689+0000","last_change":"2024-01-22T05:19:08.102102+0000","last_active":"2024-01-22T05:19:08.109689+0000","last_peered":"2024-01-22T05:19:08.109689+0000","last_clean":"2024-01-22T05:19:08.109689+0000","last_became_active":"2024-01-22T05:19:08.101800+0000","last_became_peered":"2024-01-22T05:19:08.101800+0000","last_unstale":"2024-01-22T05:19:08.109689+0000","last_undegraded":"2024-01-22T05:19:08.109689+0000","last_fullsized":"2024-01-22T05:19:08.109689+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.106054+0000","last_change":"2024-01-22T05:19:07.650195+0000","last_active":"2024-01-22T05:19:08.106054+0000","last_peered":"2024-01-22T05:19:08.106054+0000","last_clean":"2024-01-22T05:19:08.106054+0000","last_became_active":"2024-01-22T05:19:07.648467+0000","last_became_peered":"2024-01-22T05:19:07.648467+0000","last_unstale":"2024-01-22T05:19:08.106054+0000","last_undegraded":"2024-01-22T05:19:08.106054+0000","last_fullsized":"2024-01-22T05:19:08.106054+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110751+0000","last_change":"2024-01-22T05:19:08.108142+0000","last_active":"2024-01-22T05:19:08.110751+0000","last_peered":"2024-01-22T05:19:08.110751+0000","last_clean":"2024-01-22T05:19:08.110751+0000","last_became_active":"2024-01-22T05:19:08.107822+0000","last_became_peered":"2024-01-22T05:19:08.107822+0000","last_unstale":"2024-01-22T05:19:08.110751+0000","last_undegraded":"2024-01-22T05:19:08.110751+0000","last_fullsized":"2024-01-22T05:19:08.110751+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.093978+0000","last_change":"2024-01-22T05:19:07.654513+0000","last_active":"2024-01-22T05:19:08.093978+0000","last_peered":"2024-01-22T05:19:08.093978+0000","last_clean":"2024-01-22T05:19:08.093978+0000","last_became_active":"2024-01-22T05:19:07.654248+0000","last_became_peered":"2024-01-22T05:19:07.654248+0000","last_unstale":"2024-01-22T05:19:08.093978+0000","last_undegraded":"2024-01-22T05:19:08.093978+0000","last_fullsized":"2024-01-22T05:19:08.093978+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110560+0000","last_change":"2024-01-22T05:19:08.107784+0000","last_active":"2024-01-22T05:19:08.110560+0000","last_peered":"2024-01-22T05:19:08.110560+0000","last_clean":"2024-01-22T05:19:08.110560+0000","last_became_active":"2024-01-22T05:19:08.107467+0000","last_became_peered":"2024-01-22T05:19:08.107467+0000","last_unstale":"2024-01-22T05:19:08.110560+0000","last_undegraded":"2024-01-22T05:19:08.110560+0000","last_fullsized":"2024-01-22T05:19:08.110560+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.092082+0000","last_change":"2024-01-22T05:19:07.656150+0000","last_active":"2024-01-22T05:19:08.092082+0000","last_peered":"2024-01-22T05:19:08.092082+0000","last_clean":"2024-01-22T05:19:08.092082+0000","last_became_active":"2024-01-22T05:19:07.655806+0000","last_became_peered":"2024-01-22T05:19:07.655806+0000","last_unstale":"2024-01-22T05:19:08.092082+0000","last_undegraded":"2024-01-22T05:19:08.092082+0000","last_fullsized":"2024-01-22T05:19:08.092082+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.109130+0000","last_change":"2024-01-22T05:19:08.105164+0000","last_active":"2024-01-22T05:19:08.109130+0000","last_peered":"2024-01-22T05:19:08.109130+0000","last_clean":"2024-01-22T05:19:08.109130+0000","last_became_active":"2024-01-22T05:19:08.104882+0000","last_became_peered":"2024-01-22T05:19:08.104882+0000","last_unstale":"2024-01-22T05:19:08.109130+0000","last_undegraded":"2024-01-22T05:19:08.109130+0000","last_fullsized":"2024-01-22T05:19:08.109130+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094631+0000","last_change":"2024-01-22T05:19:07.656269+0000","last_active":"2024-01-22T05:19:08.094631+0000","last_peered":"2024-01-22T05:19:08.094631+0000","last_clean":"2024-01-22T05:19:08.094631+0000","last_became_active":"2024-01-22T05:19:07.655975+0000","last_became_peered":"2024-01-22T05:19:07.655975+0000","last_unstale":"2024-01-22T05:19:08.094631+0000","last_undegraded":"2024-01-22T05:19:08.094631+0000","last_fullsized":"2024-01-22T05:19:08.094631+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110205+0000","last_change":"2024-01-22T05:19:08.101703+0000","last_active":"2024-01-22T05:19:08.110205+0000","last_peered":"2024-01-22T05:19:08.110205+0000","last_clean":"2024-01-22T05:19:08.110205+0000","last_became_active":"2024-01-22T05:19:08.101432+0000","last_became_peered":"2024-01-22T05:19:08.101432+0000","last_unstale":"2024-01-22T05:19:08.110205+0000","last_undegraded":"2024-01-22T05:19:08.110205+0000","last_fullsized":"2024-01-22T05:19:08.110205+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.080556+0000","last_change":"2024-01-22T05:19:07.672992+0000","last_active":"2024-01-22T05:19:08.080556+0000","last_peered":"2024-01-22T05:19:08.080556+0000","last_clean":"2024-01-22T05:19:08.080556+0000","last_became_active":"2024-01-22T05:19:07.672708+0000","last_became_peered":"2024-01-22T05:19:07.672708+0000","last_unstale":"2024-01-22T05:19:08.080556+0000","last_undegraded":"2024-01-22T05:19:08.080556+0000","last_fullsized":"2024-01-22T05:19:08.080556+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110664+0000","last_change":"2024-01-22T05:19:08.103409+0000","last_active":"2024-01-22T05:19:08.110664+0000","last_peered":"2024-01-22T05:19:08.110664+0000","last_clean":"2024-01-22T05:19:08.110664+0000","last_became_active":"2024-01-22T05:19:08.103111+0000","last_became_peered":"2024-01-22T05:19:08.103111+0000","last_unstale":"2024-01-22T05:19:08.110664+0000","last_undegraded":"2024-01-22T05:19:08.110664+0000","last_fullsized":"2024-01-22T05:19:08.110664+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.080069+0000","last_change":"2024-01-22T05:19:07.667371+0000","last_active":"2024-01-22T05:19:08.080069+0000","last_peered":"2024-01-22T05:19:08.080069+0000","last_clean":"2024-01-22T05:19:08.080069+0000","last_became_active":"2024-01-22T05:19:07.667040+0000","last_became_peered":"2024-01-22T05:19:07.667040+0000","last_unstale":"2024-01-22T05:19:08.080069+0000","last_undegraded":"2024-01-22T05:19:08.080069+0000","last_fullsized":"2024-01-22T05:19:08.080069+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.112535+0000","last_change":"2024-01-22T05:19:08.106616+0000","last_active":"2024-01-22T05:19:08.112535+0000","last_peered":"2024-01-22T05:19:08.112535+0000","last_clean":"2024-01-22T05:19:08.112535+0000","last_became_active":"2024-01-22T05:19:08.106349+0000","last_became_peered":"2024-01-22T05:19:08.106349+0000","last_unstale":"2024-01-22T05:19:08.112535+0000","last_undegraded":"2024-01-22T05:19:08.112535+0000","last_fullsized":"2024-01-22T05:19:08.112535+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.090170+0000","last_change":"2024-01-22T05:19:07.658712+0000","last_active":"2024-01-22T05:19:08.090170+0000","last_peered":"2024-01-22T05:19:08.090170+0000","last_clean":"2024-01-22T05:19:08.090170+0000","last_became_active":"2024-01-22T05:19:07.658420+0000","last_became_peered":"2024-01-22T05:19:07.658420+0000","last_unstale":"2024-01-22T05:19:08.090170+0000","last_undegraded":"2024-01-22T05:19:08.090170+0000","last_fullsized":"2024-01-22T05:19:08.090170+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.107422+0000","last_change":"2024-01-22T05:19:08.102544+0000","last_active":"2024-01-22T05:19:08.107422+0000","last_peered":"2024-01-22T05:19:08.107422+0000","last_clean":"2024-01-22T05:19:08.107422+0000","last_became_active":"2024-01-22T05:19:08.102244+0000","last_became_peered":"2024-01-22T05:19:08.102244+0000","last_unstale":"2024-01-22T05:19:08.107422+0000","last_undegraded":"2024-01-22T05:19:08.107422+0000","last_fullsized":"2024-01-22T05:19:08.107422+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.092124+0000","last_change":"2024-01-22T05:19:07.671577+0000","last_active":"2024-01-22T05:19:08.092124+0000","last_peered":"2024-01-22T05:19:08.092124+0000","last_clean":"2024-01-22T05:19:08.092124+0000","last_became_active":"2024-01-22T05:19:07.671271+0000","last_became_peered":"2024-01-22T05:19:07.671271+0000","last_unstale":"2024-01-22T05:19:08.092124+0000","last_undegraded":"2024-01-22T05:19:08.092124+0000","last_fullsized":"2024-01-22T05:19:08.092124+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.097328+0000","last_change":"2024-01-22T05:19:08.090067+0000","last_active":"2024-01-22T05:19:08.097328+0000","last_peered":"2024-01-22T05:19:08.097328+0000","last_clean":"2024-01-22T05:19:08.097328+0000","last_became_active":"2024-01-22T05:19:08.089777+0000","last_became_peered":"2024-01-22T05:19:08.089777+0000","last_unstale":"2024-01-22T05:19:08.097328+0000","last_undegraded":"2024-01-22T05:19:08.097328+0000","last_fullsized":"2024-01-22T05:19:08.097328+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.079352+0000","last_change":"2024-01-22T05:19:07.655218+0000","last_active":"2024-01-22T05:19:08.079352+0000","last_peered":"2024-01-22T05:19:08.079352+0000","last_clean":"2024-01-22T05:19:08.079352+0000","last_became_active":"2024-01-22T05:19:07.654869+0000","last_became_peered":"2024-01-22T05:19:07.654869+0000","last_unstale":"2024-01-22T05:19:08.079352+0000","last_undegraded":"2024-01-22T05:19:08.079352+0000","last_fullsized":"2024-01-22T05:19:08.079352+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.108842+0000","last_change":"2024-01-22T05:19:08.103189+0000","last_active":"2024-01-22T05:19:08.108842+0000","last_peered":"2024-01-22T05:19:08.108842+0000","last_clean":"2024-01-22T05:19:08.108842+0000","last_became_active":"2024-01-22T05:19:08.102796+0000","last_became_peered":"2024-01-22T05:19:08.102796+0000","last_unstale":"2024-01-22T05:19:08.108842+0000","last_undegraded":"2024-01-22T05:19:08.108842+0000","last_fullsized":"2024-01-22T05:19:08.108842+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.079528+0000","last_change":"2024-01-22T05:19:07.656104+0000","last_active":"2024-01-22T05:19:08.079528+0000","last_peered":"2024-01-22T05:19:08.079528+0000","last_clean":"2024-01-22T05:19:08.079528+0000","last_became_active":"2024-01-22T05:19:07.655842+0000","last_became_peered":"2024-01-22T05:19:07.655842+0000","last_unstale":"2024-01-22T05:19:08.079528+0000","last_undegraded":"2024-01-22T05:19:08.079528+0000","last_fullsized":"2024-01-22T05:19:08.079528+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.113353+0000","last_change":"2024-01-22T05:19:08.105794+0000","last_active":"2024-01-22T05:19:08.113353+0000","last_peered":"2024-01-22T05:19:08.113353+0000","last_clean":"2024-01-22T05:19:08.113353+0000","last_became_active":"2024-01-22T05:19:08.105425+0000","last_became_peered":"2024-01-22T05:19:08.105425+0000","last_unstale":"2024-01-22T05:19:08.113353+0000","last_undegraded":"2024-01-22T05:19:08.113353+0000","last_fullsized":"2024-01-22T05:19:08.113353+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.079782+0000","last_change":"2024-01-22T05:19:07.661508+0000","last_active":"2024-01-22T05:19:08.079782+0000","last_peered":"2024-01-22T05:19:08.079782+0000","last_clean":"2024-01-22T05:19:08.079782+0000","last_became_active":"2024-01-22T05:19:07.661230+0000","last_became_peered":"2024-01-22T05:19:07.661230+0000","last_unstale":"2024-01-22T05:19:08.079782+0000","last_undegraded":"2024-01-22T05:19:08.079782+0000","last_fullsized":"2024-01-22T05:19:08.079782+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.112725+0000","last_change":"2024-01-22T05:19:08.101524+0000","last_active":"2024-01-22T05:19:08.112725+0000","last_peered":"2024-01-22T05:19:08.112725+0000","last_clean":"2024-01-22T05:19:08.112725+0000","last_became_active":"2024-01-22T05:19:08.101243+0000","last_became_peered":"2024-01-22T05:19:08.101243+0000","last_unstale":"2024-01-22T05:19:08.112725+0000","last_undegraded":"2024-01-22T05:19:08.112725+0000","last_fullsized":"2024-01-22T05:19:08.112725+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.093238+0000","last_change":"2024-01-22T05:19:07.662674+0000","last_active":"2024-01-22T05:19:08.093238+0000","last_peered":"2024-01-22T05:19:08.093238+0000","last_clean":"2024-01-22T05:19:08.093238+0000","last_became_active":"2024-01-22T05:19:07.661955+0000","last_became_peered":"2024-01-22T05:19:07.661955+0000","last_unstale":"2024-01-22T05:19:08.093238+0000","last_undegraded":"2024-01-22T05:19:08.093238+0000","last_fullsized":"2024-01-22T05:19:08.093238+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.107778+0000","last_change":"2024-01-22T05:19:08.101783+0000","last_active":"2024-01-22T05:19:08.107778+0000","last_peered":"2024-01-22T05:19:08.107778+0000","last_clean":"2024-01-22T05:19:08.107778+0000","last_became_active":"2024-01-22T05:19:08.101495+0000","last_became_peered":"2024-01-22T05:19:08.101495+0000","last_unstale":"2024-01-22T05:19:08.107778+0000","last_undegraded":"2024-01-22T05:19:08.107778+0000","last_fullsized":"2024-01-22T05:19:08.107778+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094860+0000","last_change":"2024-01-22T05:19:07.669424+0000","last_active":"2024-01-22T05:19:08.094860+0000","last_peered":"2024-01-22T05:19:08.094860+0000","last_clean":"2024-01-22T05:19:08.094860+0000","last_became_active":"2024-01-22T05:19:07.669031+0000","last_became_peered":"2024-01-22T05:19:07.669031+0000","last_unstale":"2024-01-22T05:19:08.094860+0000","last_undegraded":"2024-01-22T05:19:08.094860+0000","last_fullsized":"2024-01-22T05:19:08.094860+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.111017+0000","last_change":"2024-01-22T05:19:08.101248+0000","last_active":"2024-01-22T05:19:08.111017+0000","last_peered":"2024-01-22T05:19:08.111017+0000","last_clean":"2024-01-22T05:19:08.111017+0000","last_became_active":"2024-01-22T05:19:08.100964+0000","last_became_peered":"2024-01-22T05:19:08.100964+0000","last_unstale":"2024-01-22T05:19:08.111017+0000","last_undegraded":"2024-01-22T05:19:08.111017+0000","last_fullsized":"2024-01-22T05:19:08.111017+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.081575+0000","last_change":"2024-01-22T05:19:07.637578+0000","last_active":"2024-01-22T05:19:08.081575+0000","last_peered":"2024-01-22T05:19:08.081575+0000","last_clean":"2024-01-22T05:19:08.081575+0000","last_became_active":"2024-01-22T05:19:07.636741+0000","last_became_peered":"2024-01-22T05:19:07.636741+0000","last_unstale":"2024-01-22T05:19:08.081575+0000","last_undegraded":"2024-01-22T05:19:08.081575+0000","last_fullsized":"2024-01-22T05:19:08.081575+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.108083+0000","last_change":"2024-01-22T05:19:08.104706+0000","last_active":"2024-01-22T05:19:08.108083+0000","last_peered":"2024-01-22T05:19:08.108083+0000","last_clean":"2024-01-22T05:19:08.108083+0000","last_became_active":"2024-01-22T05:19:08.104347+0000","last_became_peered":"2024-01-22T05:19:08.104347+0000","last_unstale":"2024-01-22T05:19:08.108083+0000","last_undegraded":"2024-01-22T05:19:08.108083+0000","last_fullsized":"2024-01-22T05:19:08.108083+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"183'3","reported_seq":13,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.115625+0000","last_change":"2024-01-22T05:19:07.665545+0000","last_active":"2024-01-22T05:19:08.115625+0000","last_peered":"2024-01-22T05:19:08.115625+0000","last_clean":"2024-01-22T05:19:08.115625+0000","last_became_active":"2024-01-22T05:19:07.665244+0000","last_became_peered":"2024-01-22T05:19:07.665244+0000","last_unstale":"2024-01-22T05:19:08.115625+0000","last_undegraded":"2024-01-22T05:19:08.115625+0000","last_fullsized":"2024-01-22T05:19:08.115625+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.118698+0000","last_change":"2024-01-22T05:19:08.112006+0000","last_active":"2024-01-22T05:19:08.118698+0000","last_peered":"2024-01-22T05:19:08.118698+0000","last_clean":"2024-01-22T05:19:08.118698+0000","last_became_active":"2024-01-22T05:19:08.111731+0000","last_became_peered":"2024-01-22T05:19:08.111731+0000","last_unstale":"2024-01-22T05:19:08.118698+0000","last_undegraded":"2024-01-22T05:19:08.118698+0000","last_fullsized":"2024-01-22T05:19:08.118698+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.108974+0000","last_change":"2024-01-22T05:19:07.653326+0000","last_active":"2024-01-22T05:19:08.108974+0000","last_peered":"2024-01-22T05:19:08.108974+0000","last_clean":"2024-01-22T05:19:08.108974+0000","last_became_active":"2024-01-22T05:19:07.653033+0000","last_became_peered":"2024-01-22T05:19:07.653033+0000","last_unstale":"2024-01-22T05:19:08.108974+0000","last_undegraded":"2024-01-22T05:19:08.108974+0000","last_fullsized":"2024-01-22T05:19:08.108974+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.123382+0000","last_change":"2024-01-22T05:19:08.120922+0000","last_active":"2024-01-22T05:19:08.123382+0000","last_peered":"2024-01-22T05:19:08.123382+0000","last_clean":"2024-01-22T05:19:08.123382+0000","last_became_active":"2024-01-22T05:19:08.120325+0000","last_became_peered":"2024-01-22T05:19:08.120325+0000","last_unstale":"2024-01-22T05:19:08.123382+0000","last_undegraded":"2024-01-22T05:19:08.123382+0000","last_fullsized":"2024-01-22T05:19:08.123382+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.105890+0000","last_change":"2024-01-22T05:19:07.652901+0000","last_active":"2024-01-22T05:19:08.105890+0000","last_peered":"2024-01-22T05:19:08.105890+0000","last_clean":"2024-01-22T05:19:08.105890+0000","last_became_active":"2024-01-22T05:19:07.652390+0000","last_became_peered":"2024-01-22T05:19:07.652390+0000","last_unstale":"2024-01-22T05:19:08.105890+0000","last_undegraded":"2024-01-22T05:19:08.105890+0000","last_fullsized":"2024-01-22T05:19:08.105890+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117380+0000","last_change":"2024-01-22T05:19:08.110361+0000","last_active":"2024-01-22T05:19:08.117380+0000","last_peered":"2024-01-22T05:19:08.117380+0000","last_clean":"2024-01-22T05:19:08.117380+0000","last_became_active":"2024-01-22T05:19:08.110106+0000","last_became_peered":"2024-01-22T05:19:08.110106+0000","last_unstale":"2024-01-22T05:19:08.117380+0000","last_undegraded":"2024-01-22T05:19:08.117380+0000","last_fullsized":"2024-01-22T05:19:08.117380+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.081286+0000","last_change":"2024-01-22T05:19:07.654238+0000","last_active":"2024-01-22T05:19:08.081286+0000","last_peered":"2024-01-22T05:19:08.081286+0000","last_clean":"2024-01-22T05:19:08.081286+0000","last_became_active":"2024-01-22T05:19:07.653955+0000","last_became_peered":"2024-01-22T05:19:07.653955+0000","last_unstale":"2024-01-22T05:19:08.081286+0000","last_undegraded":"2024-01-22T05:19:08.081286+0000","last_fullsized":"2024-01-22T05:19:08.081286+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.114393+0000","last_change":"2024-01-22T05:19:08.108649+0000","last_active":"2024-01-22T05:19:08.114393+0000","last_peered":"2024-01-22T05:19:08.114393+0000","last_clean":"2024-01-22T05:19:08.114393+0000","last_became_active":"2024-01-22T05:19:08.108186+0000","last_became_peered":"2024-01-22T05:19:08.108186+0000","last_unstale":"2024-01-22T05:19:08.114393+0000","last_undegraded":"2024-01-22T05:19:08.114393+0000","last_fullsized":"2024-01-22T05:19:08.114393+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.089608+0000","last_change":"2024-01-22T05:19:07.660725+0000","last_active":"2024-01-22T05:19:08.089608+0000","last_peered":"2024-01-22T05:19:08.089608+0000","last_clean":"2024-01-22T05:19:08.089608+0000","last_became_active":"2024-01-22T05:19:07.660417+0000","last_became_peered":"2024-01-22T05:19:07.660417+0000","last_unstale":"2024-01-22T05:19:08.089608+0000","last_undegraded":"2024-01-22T05:19:08.089608+0000","last_fullsized":"2024-01-22T05:19:08.089608+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117485+0000","last_change":"2024-01-22T05:19:08.108355+0000","last_active":"2024-01-22T05:19:08.117485+0000","last_peered":"2024-01-22T05:19:08.117485+0000","last_clean":"2024-01-22T05:19:08.117485+0000","last_became_active":"2024-01-22T05:19:08.108099+0000","last_became_peered":"2024-01-22T05:19:08.108099+0000","last_unstale":"2024-01-22T05:19:08.117485+0000","last_undegraded":"2024-01-22T05:19:08.117485+0000","last_fullsized":"2024-01-22T05:19:08.117485+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.113791+0000","last_change":"2024-01-22T05:19:07.667771+0000","last_active":"2024-01-22T05:19:08.113791+0000","last_peered":"2024-01-22T05:19:08.113791+0000","last_clean":"2024-01-22T05:19:08.113791+0000","last_became_active":"2024-01-22T05:19:07.667502+0000","last_became_peered":"2024-01-22T05:19:07.667502+0000","last_unstale":"2024-01-22T05:19:08.113791+0000","last_undegraded":"2024-01-22T05:19:08.113791+0000","last_fullsized":"2024-01-22T05:19:08.113791+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.099030+0000","last_change":"2024-01-22T05:19:08.090714+0000","last_active":"2024-01-22T05:19:08.099030+0000","last_peered":"2024-01-22T05:19:08.099030+0000","last_clean":"2024-01-22T05:19:08.099030+0000","last_became_active":"2024-01-22T05:19:08.088222+0000","last_became_peered":"2024-01-22T05:19:08.088222+0000","last_unstale":"2024-01-22T05:19:08.099030+0000","last_undegraded":"2024-01-22T05:19:08.099030+0000","last_fullsized":"2024-01-22T05:19:08.099030+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.120403+0000","last_change":"2024-01-22T05:19:07.673987+0000","last_active":"2024-01-22T05:19:08.120403+0000","last_peered":"2024-01-22T05:19:08.120403+0000","last_clean":"2024-01-22T05:19:08.120403+0000","last_became_active":"2024-01-22T05:19:07.673724+0000","last_became_peered":"2024-01-22T05:19:07.673724+0000","last_unstale":"2024-01-22T05:19:08.120403+0000","last_undegraded":"2024-01-22T05:19:08.120403+0000","last_fullsized":"2024-01-22T05:19:08.120403+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110802+0000","last_change":"2024-01-22T05:19:08.104127+0000","last_active":"2024-01-22T05:19:08.110802+0000","last_peered":"2024-01-22T05:19:08.110802+0000","last_clean":"2024-01-22T05:19:08.110802+0000","last_became_active":"2024-01-22T05:19:08.103848+0000","last_became_peered":"2024-01-22T05:19:08.103848+0000","last_unstale":"2024-01-22T05:19:08.110802+0000","last_undegraded":"2024-01-22T05:19:08.110802+0000","last_fullsized":"2024-01-22T05:19:08.110802+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.113436+0000","last_change":"2024-01-22T05:19:07.667361+0000","last_active":"2024-01-22T05:19:08.113436+0000","last_peered":"2024-01-22T05:19:08.113436+0000","last_clean":"2024-01-22T05:19:08.113436+0000","last_became_active":"2024-01-22T05:19:07.667056+0000","last_became_peered":"2024-01-22T05:19:07.667056+0000","last_unstale":"2024-01-22T05:19:08.113436+0000","last_undegraded":"2024-01-22T05:19:08.113436+0000","last_fullsized":"2024-01-22T05:19:08.113436+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.099964+0000","last_change":"2024-01-22T05:19:08.093695+0000","last_active":"2024-01-22T05:19:08.099964+0000","last_peered":"2024-01-22T05:19:08.099964+0000","last_clean":"2024-01-22T05:19:08.099964+0000","last_became_active":"2024-01-22T05:19:08.093396+0000","last_became_peered":"2024-01-22T05:19:08.093396+0000","last_unstale":"2024-01-22T05:19:08.099964+0000","last_undegraded":"2024-01-22T05:19:08.099964+0000","last_fullsized":"2024-01-22T05:19:08.099964+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.091300+0000","last_change":"2024-01-22T05:19:07.670213+0000","last_active":"2024-01-22T05:19:08.091300+0000","last_peered":"2024-01-22T05:19:08.091300+0000","last_clean":"2024-01-22T05:19:08.091300+0000","last_became_active":"2024-01-22T05:19:07.669903+0000","last_became_peered":"2024-01-22T05:19:07.669903+0000","last_unstale":"2024-01-22T05:19:08.091300+0000","last_undegraded":"2024-01-22T05:19:08.091300+0000","last_fullsized":"2024-01-22T05:19:08.091300+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117630+0000","last_change":"2024-01-22T05:19:08.114287+0000","last_active":"2024-01-22T05:19:08.117630+0000","last_peered":"2024-01-22T05:19:08.117630+0000","last_clean":"2024-01-22T05:19:08.117630+0000","last_became_active":"2024-01-22T05:19:08.114015+0000","last_became_peered":"2024-01-22T05:19:08.114015+0000","last_unstale":"2024-01-22T05:19:08.117630+0000","last_undegraded":"2024-01-22T05:19:08.117630+0000","last_fullsized":"2024-01-22T05:19:08.117630+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.080962+0000","last_change":"2024-01-22T05:19:07.664586+0000","last_active":"2024-01-22T05:19:08.080962+0000","last_peered":"2024-01-22T05:19:08.080962+0000","last_clean":"2024-01-22T05:19:08.080962+0000","last_became_active":"2024-01-22T05:19:07.664286+0000","last_became_peered":"2024-01-22T05:19:07.664286+0000","last_unstale":"2024-01-22T05:19:08.080962+0000","last_undegraded":"2024-01-22T05:19:08.080962+0000","last_fullsized":"2024-01-22T05:19:08.080962+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.122568+0000","last_change":"2024-01-22T05:19:08.119871+0000","last_active":"2024-01-22T05:19:08.122568+0000","last_peered":"2024-01-22T05:19:08.122568+0000","last_clean":"2024-01-22T05:19:08.122568+0000","last_became_active":"2024-01-22T05:19:08.119624+0000","last_became_peered":"2024-01-22T05:19:08.119624+0000","last_unstale":"2024-01-22T05:19:08.122568+0000","last_undegraded":"2024-01-22T05:19:08.122568+0000","last_fullsized":"2024-01-22T05:19:08.122568+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.114072+0000","last_change":"2024-01-22T05:19:07.666365+0000","last_active":"2024-01-22T05:19:08.114072+0000","last_peered":"2024-01-22T05:19:08.114072+0000","last_clean":"2024-01-22T05:19:08.114072+0000","last_became_active":"2024-01-22T05:19:07.666092+0000","last_became_peered":"2024-01-22T05:19:07.666092+0000","last_unstale":"2024-01-22T05:19:08.114072+0000","last_undegraded":"2024-01-22T05:19:08.114072+0000","last_fullsized":"2024-01-22T05:19:08.114072+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.112378+0000","last_change":"2024-01-22T05:19:08.106605+0000","last_active":"2024-01-22T05:19:08.112378+0000","last_peered":"2024-01-22T05:19:08.112378+0000","last_clean":"2024-01-22T05:19:08.112378+0000","last_became_active":"2024-01-22T05:19:08.106327+0000","last_became_peered":"2024-01-22T05:19:08.106327+0000","last_unstale":"2024-01-22T05:19:08.112378+0000","last_undegraded":"2024-01-22T05:19:08.112378+0000","last_fullsized":"2024-01-22T05:19:08.112378+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.099032+0000","last_change":"2024-01-22T05:19:07.638691+0000","last_active":"2024-01-22T05:19:08.099032+0000","last_peered":"2024-01-22T05:19:08.099032+0000","last_clean":"2024-01-22T05:19:08.099032+0000","last_became_active":"2024-01-22T05:19:07.635620+0000","last_became_peered":"2024-01-22T05:19:07.635620+0000","last_unstale":"2024-01-22T05:19:08.099032+0000","last_undegraded":"2024-01-22T05:19:08.099032+0000","last_fullsized":"2024-01-22T05:19:08.099032+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.088612+0000","last_change":"2024-01-22T05:19:08.083410+0000","last_active":"2024-01-22T05:19:08.088612+0000","last_peered":"2024-01-22T05:19:08.088612+0000","last_clean":"2024-01-22T05:19:08.088612+0000","last_became_active":"2024-01-22T05:19:08.083072+0000","last_became_peered":"2024-01-22T05:19:08.083072+0000","last_unstale":"2024-01-22T05:19:08.088612+0000","last_undegraded":"2024-01-22T05:19:08.088612+0000","last_fullsized":"2024-01-22T05:19:08.088612+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.097875+0000","last_change":"2024-01-22T05:19:07.649462+0000","last_active":"2024-01-22T05:19:08.097875+0000","last_peered":"2024-01-22T05:19:08.097875+0000","last_clean":"2024-01-22T05:19:08.097875+0000","last_became_active":"2024-01-22T05:19:07.649182+0000","last_became_peered":"2024-01-22T05:19:07.649182+0000","last_unstale":"2024-01-22T05:19:08.097875+0000","last_undegraded":"2024-01-22T05:19:08.097875+0000","last_fullsized":"2024-01-22T05:19:08.097875+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.108800+0000","last_change":"2024-01-22T05:19:08.098506+0000","last_active":"2024-01-22T05:19:08.108800+0000","last_peered":"2024-01-22T05:19:08.108800+0000","last_clean":"2024-01-22T05:19:08.108800+0000","last_became_active":"2024-01-22T05:19:08.098232+0000","last_became_peered":"2024-01-22T05:19:08.098232+0000","last_unstale":"2024-01-22T05:19:08.108800+0000","last_undegraded":"2024-01-22T05:19:08.108800+0000","last_fullsized":"2024-01-22T05:19:08.108800+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094729+0000","last_change":"2024-01-22T05:19:07.673127+0000","last_active":"2024-01-22T05:19:08.094729+0000","last_peered":"2024-01-22T05:19:08.094729+0000","last_clean":"2024-01-22T05:19:08.094729+0000","last_became_active":"2024-01-22T05:19:07.672849+0000","last_became_peered":"2024-01-22T05:19:07.672849+0000","last_unstale":"2024-01-22T05:19:08.094729+0000","last_undegraded":"2024-01-22T05:19:08.094729+0000","last_fullsized":"2024-01-22T05:19:08.094729+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.109873+0000","last_change":"2024-01-22T05:19:08.103601+0000","last_active":"2024-01-22T05:19:08.109873+0000","last_peered":"2024-01-22T05:19:08.109873+0000","last_clean":"2024-01-22T05:19:08.109873+0000","last_became_active":"2024-01-22T05:19:08.102826+0000","last_became_peered":"2024-01-22T05:19:08.102826+0000","last_unstale":"2024-01-22T05:19:08.109873+0000","last_undegraded":"2024-01-22T05:19:08.109873+0000","last_fullsized":"2024-01-22T05:19:08.109873+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110785+0000","last_change":"2024-01-22T05:19:07.663194+0000","last_active":"2024-01-22T05:19:08.110785+0000","last_peered":"2024-01-22T05:19:08.110785+0000","last_clean":"2024-01-22T05:19:08.110785+0000","last_became_active":"2024-01-22T05:19:07.662920+0000","last_became_peered":"2024-01-22T05:19:07.662920+0000","last_unstale":"2024-01-22T05:19:08.110785+0000","last_undegraded":"2024-01-22T05:19:08.110785+0000","last_fullsized":"2024-01-22T05:19:08.110785+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.119776+0000","last_change":"2024-01-22T05:19:08.115826+0000","last_active":"2024-01-22T05:19:08.119776+0000","last_peered":"2024-01-22T05:19:08.119776+0000","last_clean":"2024-01-22T05:19:08.119776+0000","last_became_active":"2024-01-22T05:19:08.115563+0000","last_became_peered":"2024-01-22T05:19:08.115563+0000","last_unstale":"2024-01-22T05:19:08.119776+0000","last_undegraded":"2024-01-22T05:19:08.119776+0000","last_fullsized":"2024-01-22T05:19:08.119776+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.090249+0000","last_change":"2024-01-22T05:19:07.653389+0000","last_active":"2024-01-22T05:19:08.090249+0000","last_peered":"2024-01-22T05:19:08.090249+0000","last_clean":"2024-01-22T05:19:08.090249+0000","last_became_active":"2024-01-22T05:19:07.653107+0000","last_became_peered":"2024-01-22T05:19:07.653107+0000","last_unstale":"2024-01-22T05:19:08.090249+0000","last_undegraded":"2024-01-22T05:19:08.090249+0000","last_fullsized":"2024-01-22T05:19:08.090249+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.108028+0000","last_change":"2024-01-22T05:19:08.100660+0000","last_active":"2024-01-22T05:19:08.108028+0000","last_peered":"2024-01-22T05:19:08.108028+0000","last_clean":"2024-01-22T05:19:08.108028+0000","last_became_active":"2024-01-22T05:19:08.100384+0000","last_became_peered":"2024-01-22T05:19:08.100384+0000","last_unstale":"2024-01-22T05:19:08.108028+0000","last_undegraded":"2024-01-22T05:19:08.108028+0000","last_fullsized":"2024-01-22T05:19:08.108028+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.093737+0000","last_change":"2024-01-22T05:19:07.674870+0000","last_active":"2024-01-22T05:19:08.093737+0000","last_peered":"2024-01-22T05:19:08.093737+0000","last_clean":"2024-01-22T05:19:08.093737+0000","last_became_active":"2024-01-22T05:19:07.674587+0000","last_became_peered":"2024-01-22T05:19:07.674587+0000","last_unstale":"2024-01-22T05:19:08.093737+0000","last_undegraded":"2024-01-22T05:19:08.093737+0000","last_fullsized":"2024-01-22T05:19:08.093737+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.108885+0000","last_change":"2024-01-22T05:19:08.105909+0000","last_active":"2024-01-22T05:19:08.108885+0000","last_peered":"2024-01-22T05:19:08.108885+0000","last_clean":"2024-01-22T05:19:08.108885+0000","last_became_active":"2024-01-22T05:19:08.105599+0000","last_became_peered":"2024-01-22T05:19:08.105599+0000","last_unstale":"2024-01-22T05:19:08.108885+0000","last_undegraded":"2024-01-22T05:19:08.108885+0000","last_fullsized":"2024-01-22T05:19:08.108885+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.080927+0000","last_change":"2024-01-22T05:19:07.658170+0000","last_active":"2024-01-22T05:19:08.080927+0000","last_peered":"2024-01-22T05:19:08.080927+0000","last_clean":"2024-01-22T05:19:08.080927+0000","last_became_active":"2024-01-22T05:19:07.655485+0000","last_became_peered":"2024-01-22T05:19:07.655485+0000","last_unstale":"2024-01-22T05:19:08.080927+0000","last_undegraded":"2024-01-22T05:19:08.080927+0000","last_fullsized":"2024-01-22T05:19:08.080927+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117726+0000","last_change":"2024-01-22T05:19:08.109690+0000","last_active":"2024-01-22T05:19:08.117726+0000","last_peered":"2024-01-22T05:19:08.117726+0000","last_clean":"2024-01-22T05:19:08.117726+0000","last_became_active":"2024-01-22T05:19:08.109382+0000","last_became_peered":"2024-01-22T05:19:08.109382+0000","last_unstale":"2024-01-22T05:19:08.117726+0000","last_undegraded":"2024-01-22T05:19:08.117726+0000","last_fullsized":"2024-01-22T05:19:08.117726+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.089675+0000","last_change":"2024-01-22T05:19:07.656175+0000","last_active":"2024-01-22T05:19:08.089675+0000","last_peered":"2024-01-22T05:19:08.089675+0000","last_clean":"2024-01-22T05:19:08.089675+0000","last_became_active":"2024-01-22T05:19:07.655925+0000","last_became_peered":"2024-01-22T05:19:07.655925+0000","last_unstale":"2024-01-22T05:19:08.089675+0000","last_undegraded":"2024-01-22T05:19:08.089675+0000","last_fullsized":"2024-01-22T05:19:08.089675+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.111797+0000","last_change":"2024-01-22T05:19:08.110545+0000","last_active":"2024-01-22T05:19:08.111797+0000","last_peered":"2024-01-22T05:19:08.111797+0000","last_clean":"2024-01-22T05:19:08.111797+0000","last_became_active":"2024-01-22T05:19:08.110230+0000","last_became_peered":"2024-01-22T05:19:08.110230+0000","last_unstale":"2024-01-22T05:19:08.111797+0000","last_undegraded":"2024-01-22T05:19:08.111797+0000","last_fullsized":"2024-01-22T05:19:08.111797+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.093871+0000","last_change":"2024-01-22T05:19:07.673375+0000","last_active":"2024-01-22T05:19:08.093871+0000","last_peered":"2024-01-22T05:19:08.093871+0000","last_clean":"2024-01-22T05:19:08.093871+0000","last_became_active":"2024-01-22T05:19:07.672880+0000","last_became_peered":"2024-01-22T05:19:07.672880+0000","last_unstale":"2024-01-22T05:19:08.093871+0000","last_undegraded":"2024-01-22T05:19:08.093871+0000","last_fullsized":"2024-01-22T05:19:08.093871+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.114376+0000","last_change":"2024-01-22T05:19:08.108472+0000","last_active":"2024-01-22T05:19:08.114376+0000","last_peered":"2024-01-22T05:19:08.114376+0000","last_clean":"2024-01-22T05:19:08.114376+0000","last_became_active":"2024-01-22T05:19:08.108159+0000","last_became_peered":"2024-01-22T05:19:08.108159+0000","last_unstale":"2024-01-22T05:19:08.114376+0000","last_undegraded":"2024-01-22T05:19:08.114376+0000","last_fullsized":"2024-01-22T05:19:08.114376+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.081012+0000","last_change":"2024-01-22T05:19:07.639511+0000","last_active":"2024-01-22T05:19:08.081012+0000","last_peered":"2024-01-22T05:19:08.081012+0000","last_clean":"2024-01-22T05:19:08.081012+0000","last_became_active":"2024-01-22T05:19:07.639209+0000","last_became_peered":"2024-01-22T05:19:07.639209+0000","last_unstale":"2024-01-22T05:19:08.081012+0000","last_undegraded":"2024-01-22T05:19:08.081012+0000","last_fullsized":"2024-01-22T05:19:08.081012+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.102224+0000","last_change":"2024-01-22T05:19:08.096650+0000","last_active":"2024-01-22T05:19:08.102224+0000","last_peered":"2024-01-22T05:19:08.102224+0000","last_clean":"2024-01-22T05:19:08.102224+0000","last_became_active":"2024-01-22T05:19:08.096368+0000","last_became_peered":"2024-01-22T05:19:08.096368+0000","last_unstale":"2024-01-22T05:19:08.102224+0000","last_undegraded":"2024-01-22T05:19:08.102224+0000","last_fullsized":"2024-01-22T05:19:08.102224+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.087986+0000","last_change":"2024-01-22T05:19:07.646932+0000","last_active":"2024-01-22T05:19:08.087986+0000","last_peered":"2024-01-22T05:19:08.087986+0000","last_clean":"2024-01-22T05:19:08.087986+0000","last_became_active":"2024-01-22T05:19:07.646654+0000","last_became_peered":"2024-01-22T05:19:07.646654+0000","last_unstale":"2024-01-22T05:19:08.087986+0000","last_undegraded":"2024-01-22T05:19:08.087986+0000","last_fullsized":"2024-01-22T05:19:08.087986+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.092518+0000","last_change":"2024-01-22T05:19:08.085441+0000","last_active":"2024-01-22T05:19:08.092518+0000","last_peered":"2024-01-22T05:19:08.092518+0000","last_clean":"2024-01-22T05:19:08.092518+0000","last_became_active":"2024-01-22T05:19:08.085053+0000","last_became_peered":"2024-01-22T05:19:08.085053+0000","last_unstale":"2024-01-22T05:19:08.092518+0000","last_undegraded":"2024-01-22T05:19:08.092518+0000","last_fullsized":"2024-01-22T05:19:08.092518+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.103184+0000","last_change":"2024-01-22T05:19:07.644729+0000","last_active":"2024-01-22T05:19:08.103184+0000","last_peered":"2024-01-22T05:19:08.103184+0000","last_clean":"2024-01-22T05:19:08.103184+0000","last_became_active":"2024-01-22T05:19:07.642034+0000","last_became_peered":"2024-01-22T05:19:07.642034+0000","last_unstale":"2024-01-22T05:19:08.103184+0000","last_undegraded":"2024-01-22T05:19:08.103184+0000","last_fullsized":"2024-01-22T05:19:08.103184+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":150,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.091348+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:19:08.091348+0000","last_peered":"2024-01-22T05:19:08.091348+0000","last_clean":"2024-01-22T05:19:08.091348+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:19:08.091348+0000","last_undegraded":"2024-01-22T05:19:08.091348+0000","last_fullsized":"2024-01-22T05:19:08.091348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.105832+0000","last_change":"2024-01-22T05:19:08.097395+0000","last_active":"2024-01-22T05:19:08.105832+0000","last_peered":"2024-01-22T05:19:08.105832+0000","last_clean":"2024-01-22T05:19:08.105832+0000","last_became_active":"2024-01-22T05:19:08.097117+0000","last_became_peered":"2024-01-22T05:19:08.097117+0000","last_unstale":"2024-01-22T05:19:08.105832+0000","last_undegraded":"2024-01-22T05:19:08.105832+0000","last_fullsized":"2024-01-22T05:19:08.105832+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.096832+0000","last_change":"2024-01-22T05:19:07.650218+0000","last_active":"2024-01-22T05:19:08.096832+0000","last_peered":"2024-01-22T05:19:08.096832+0000","last_clean":"2024-01-22T05:19:08.096832+0000","last_became_active":"2024-01-22T05:19:07.649606+0000","last_became_peered":"2024-01-22T05:19:07.649606+0000","last_unstale":"2024-01-22T05:19:08.096832+0000","last_undegraded":"2024-01-22T05:19:08.096832+0000","last_fullsized":"2024-01-22T05:19:08.096832+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":155,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.093995+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:19:08.093995+0000","last_peered":"2024-01-22T05:19:08.093995+0000","last_clean":"2024-01-22T05:19:08.093995+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:19:08.093995+0000","last_undegraded":"2024-01-22T05:19:08.093995+0000","last_fullsized":"2024-01-22T05:19:08.093995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.113374+0000","last_change":"2024-01-22T05:19:08.107188+0000","last_active":"2024-01-22T05:19:08.113374+0000","last_peered":"2024-01-22T05:19:08.113374+0000","last_clean":"2024-01-22T05:19:08.113374+0000","last_became_active":"2024-01-22T05:19:08.106919+0000","last_became_peered":"2024-01-22T05:19:08.106919+0000","last_unstale":"2024-01-22T05:19:08.113374+0000","last_undegraded":"2024-01-22T05:19:08.113374+0000","last_fullsized":"2024-01-22T05:19:08.113374+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.114878+0000","last_change":"2024-01-22T05:19:07.667134+0000","last_active":"2024-01-22T05:19:08.114878+0000","last_peered":"2024-01-22T05:19:08.114878+0000","last_clean":"2024-01-22T05:19:08.114878+0000","last_became_active":"2024-01-22T05:19:07.666847+0000","last_became_peered":"2024-01-22T05:19:07.666847+0000","last_unstale":"2024-01-22T05:19:08.114878+0000","last_undegraded":"2024-01-22T05:19:08.114878+0000","last_fullsized":"2024-01-22T05:19:08.114878+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":144,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.092136+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:19:08.092136+0000","last_peered":"2024-01-22T05:19:08.092136+0000","last_clean":"2024-01-22T05:19:08.092136+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:19:08.092136+0000","last_undegraded":"2024-01-22T05:19:08.092136+0000","last_fullsized":"2024-01-22T05:19:08.092136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117648+0000","last_change":"2024-01-22T05:19:08.114417+0000","last_active":"2024-01-22T05:19:08.117648+0000","last_peered":"2024-01-22T05:19:08.117648+0000","last_clean":"2024-01-22T05:19:08.117648+0000","last_became_active":"2024-01-22T05:19:08.114118+0000","last_became_peered":"2024-01-22T05:19:08.114118+0000","last_unstale":"2024-01-22T05:19:08.117648+0000","last_undegraded":"2024-01-22T05:19:08.117648+0000","last_fullsized":"2024-01-22T05:19:08.117648+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094678+0000","last_change":"2024-01-22T05:19:07.659047+0000","last_active":"2024-01-22T05:19:08.094678+0000","last_peered":"2024-01-22T05:19:08.094678+0000","last_clean":"2024-01-22T05:19:08.094678+0000","last_became_active":"2024-01-22T05:19:07.658127+0000","last_became_peered":"2024-01-22T05:19:07.658127+0000","last_unstale":"2024-01-22T05:19:08.094678+0000","last_undegraded":"2024-01-22T05:19:08.094678+0000","last_fullsized":"2024-01-22T05:19:08.094678+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":155,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094483+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:19:08.094483+0000","last_peered":"2024-01-22T05:19:08.094483+0000","last_clean":"2024-01-22T05:19:08.094483+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:19:08.094483+0000","last_undegraded":"2024-01-22T05:19:08.094483+0000","last_fullsized":"2024-01-22T05:19:08.094483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.109462+0000","last_change":"2024-01-22T05:19:08.106088+0000","last_active":"2024-01-22T05:19:08.109462+0000","last_peered":"2024-01-22T05:19:08.109462+0000","last_clean":"2024-01-22T05:19:08.109462+0000","last_became_active":"2024-01-22T05:19:08.105814+0000","last_became_peered":"2024-01-22T05:19:08.105814+0000","last_unstale":"2024-01-22T05:19:08.109462+0000","last_undegraded":"2024-01-22T05:19:08.109462+0000","last_fullsized":"2024-01-22T05:19:08.109462+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094068+0000","last_change":"2024-01-22T05:19:07.664950+0000","last_active":"2024-01-22T05:19:08.094068+0000","last_peered":"2024-01-22T05:19:08.094068+0000","last_clean":"2024-01-22T05:19:08.094068+0000","last_became_active":"2024-01-22T05:19:07.664413+0000","last_became_peered":"2024-01-22T05:19:07.664413+0000","last_unstale":"2024-01-22T05:19:08.094068+0000","last_undegraded":"2024-01-22T05:19:08.094068+0000","last_fullsized":"2024-01-22T05:19:08.094068+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.079557+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:19:08.079557+0000","last_peered":"2024-01-22T05:19:08.079557+0000","last_clean":"2024-01-22T05:19:08.079557+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:19:08.079557+0000","last_undegraded":"2024-01-22T05:19:08.079557+0000","last_fullsized":"2024-01-22T05:19:08.079557+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.118163+0000","last_change":"2024-01-22T05:19:08.104533+0000","last_active":"2024-01-22T05:19:08.118163+0000","last_peered":"2024-01-22T05:19:08.118163+0000","last_clean":"2024-01-22T05:19:08.118163+0000","last_became_active":"2024-01-22T05:19:08.104242+0000","last_became_peered":"2024-01-22T05:19:08.104242+0000","last_unstale":"2024-01-22T05:19:08.118163+0000","last_undegraded":"2024-01-22T05:19:08.118163+0000","last_fullsized":"2024-01-22T05:19:08.118163+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.093434+0000","last_change":"2024-01-22T05:19:07.673651+0000","last_active":"2024-01-22T05:19:08.093434+0000","last_peered":"2024-01-22T05:19:08.093434+0000","last_clean":"2024-01-22T05:19:08.093434+0000","last_became_active":"2024-01-22T05:19:07.673373+0000","last_became_peered":"2024-01-22T05:19:07.673373+0000","last_unstale":"2024-01-22T05:19:08.093434+0000","last_undegraded":"2024-01-22T05:19:08.093434+0000","last_fullsized":"2024-01-22T05:19:08.093434+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":153,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.080204+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:19:08.080204+0000","last_peered":"2024-01-22T05:19:08.080204+0000","last_clean":"2024-01-22T05:19:08.080204+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:19:08.080204+0000","last_undegraded":"2024-01-22T05:19:08.080204+0000","last_fullsized":"2024-01-22T05:19:08.080204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.111393+0000","last_change":"2024-01-22T05:19:08.109868+0000","last_active":"2024-01-22T05:19:08.111393+0000","last_peered":"2024-01-22T05:19:08.111393+0000","last_clean":"2024-01-22T05:19:08.111393+0000","last_became_active":"2024-01-22T05:19:08.109574+0000","last_became_peered":"2024-01-22T05:19:08.109574+0000","last_unstale":"2024-01-22T05:19:08.111393+0000","last_undegraded":"2024-01-22T05:19:08.111393+0000","last_fullsized":"2024-01-22T05:19:08.111393+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.078986+0000","last_change":"2024-01-22T05:19:07.657425+0000","last_active":"2024-01-22T05:19:08.078986+0000","last_peered":"2024-01-22T05:19:08.078986+0000","last_clean":"2024-01-22T05:19:08.078986+0000","last_became_active":"2024-01-22T05:19:07.657039+0000","last_became_peered":"2024-01-22T05:19:07.657039+0000","last_unstale":"2024-01-22T05:19:08.078986+0000","last_undegraded":"2024-01-22T05:19:08.078986+0000","last_fullsized":"2024-01-22T05:19:08.078986+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":144,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.088932+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:19:08.088932+0000","last_peered":"2024-01-22T05:19:08.088932+0000","last_clean":"2024-01-22T05:19:08.088932+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:19:08.088932+0000","last_undegraded":"2024-01-22T05:19:08.088932+0000","last_fullsized":"2024-01-22T05:19:08.088932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117744+0000","last_change":"2024-01-22T05:19:08.110252+0000","last_active":"2024-01-22T05:19:08.117744+0000","last_peered":"2024-01-22T05:19:08.117744+0000","last_clean":"2024-01-22T05:19:08.117744+0000","last_became_active":"2024-01-22T05:19:08.109965+0000","last_became_peered":"2024-01-22T05:19:08.109965+0000","last_unstale":"2024-01-22T05:19:08.117744+0000","last_undegraded":"2024-01-22T05:19:08.117744+0000","last_fullsized":"2024-01-22T05:19:08.117744+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.089260+0000","last_change":"2024-01-22T05:19:07.657569+0000","last_active":"2024-01-22T05:19:08.089260+0000","last_peered":"2024-01-22T05:19:08.089260+0000","last_clean":"2024-01-22T05:19:08.089260+0000","last_became_active":"2024-01-22T05:19:07.657272+0000","last_became_peered":"2024-01-22T05:19:07.657272+0000","last_unstale":"2024-01-22T05:19:08.089260+0000","last_undegraded":"2024-01-22T05:19:08.089260+0000","last_fullsized":"2024-01-22T05:19:08.089260+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":176,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.079450+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:19:08.079450+0000","last_peered":"2024-01-22T05:19:08.079450+0000","last_clean":"2024-01-22T05:19:08.079450+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:19:08.079450+0000","last_undegraded":"2024-01-22T05:19:08.079450+0000","last_fullsized":"2024-01-22T05:19:08.079450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":145,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.089023+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:19:08.089023+0000","last_peered":"2024-01-22T05:19:08.089023+0000","last_clean":"2024-01-22T05:19:08.089023+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:19:08.089023+0000","last_undegraded":"2024-01-22T05:19:08.089023+0000","last_fullsized":"2024-01-22T05:19:08.089023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575027,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311788,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060052,"statfs":{"total":96636764160,"available":96317493248,"internally_reserved":0,"allocated":2330624,"data_stored":1157266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2450000000000001,"15min":1.0760000000000001},"min":{"1min":0.83299999999999996,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.5209999999999999,"5min":14.779999999999999,"15min":14.779999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.145,"5min":2.0070000000000001,"15min":1.3759999999999999},"min":{"1min":0.80000000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.55,"5min":76.662000000000006,"15min":76.662000000000006},"last":1.117}]},{"osd":1,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.167,"15min":1.0589999999999999},"min":{"1min":0.86199999999999999,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.4650000000000001,"5min":4.9269999999999996,"15min":4.9269999999999996},"last":1.022},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2989999999999999,"15min":1.2030000000000001},"min":{"1min":0.88,"5min":0.71599999999999997,"15min":0.58999999999999997},"max":{"1min":1.655,"5min":12.691000000000001,"15min":12.691000000000001},"last":0.83499999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1579999999999999,"15min":1.125},"min":{"1min":0.77800000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5700000000000001,"5min":2.1589999999999998,"15min":2.5150000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.355,"15min":1.2210000000000001},"min":{"1min":0.97699999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5449999999999999,"5min":15.036,"15min":15.036},"last":1.335}]},{"osd":3,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.9339999999999999,"15min":1.4470000000000001},"min":{"1min":0.92300000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.748,"5min":64.983999999999995,"15min":64.983999999999995},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.4299999999999999,"15min":1.2949999999999999},"min":{"1min":1.0029999999999999,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":1.714,"5min":15.073,"15min":15.073},"last":1.161}]},{"osd":4,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.415,"15min":1.1850000000000001},"min":{"1min":0.77900000000000003,"5min":0.53000000000000003,"15min":0.32900000000000001},"max":{"1min":1.504,"5min":22.239000000000001,"15min":22.239000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.28,"5min":1.5269999999999999,"15min":1.2669999999999999},"min":{"1min":0.92000000000000004,"5min":0.68799999999999994,"15min":0.52200000000000002},"max":{"1min":1.9830000000000001,"5min":27.872,"15min":27.872},"last":1.2210000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":2.0110000000000001,"15min":1.452},"min":{"1min":0.88100000000000001,"5min":0.67400000000000004,"15min":0.40400000000000003},"max":{"1min":1.6279999999999999,"5min":65.652000000000001,"15min":65.652000000000001},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.387,"5min":1.341,"15min":1.2869999999999999},"min":{"1min":1.0589999999999999,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":2.1539999999999999,"5min":2.1629999999999998,"15min":3.625},"last":1.296}]},{"osd":6,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.363,"15min":1.262},"min":{"1min":0.997,"5min":0.80700000000000005,"15min":0.53400000000000003},"max":{"1min":2.3580000000000001,"5min":6.9939999999999998,"15min":6.9939999999999998},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.54,"15min":1.411},"min":{"1min":1.224,"5min":0.82999999999999996,"15min":0.56100000000000005},"max":{"1min":2.0600000000000001,"5min":12.965,"15min":12.965},"last":1.359}]}]},{"osd":6,"up_from":13,"seq":55834575027,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307676,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064164,"statfs":{"total":96636764160,"available":96321703936,"internally_reserved":0,"allocated":2314240,"data_stored":1155176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.0580000000000001,"15min":1.2849999999999999},"min":{"1min":0.72999999999999998,"5min":0.66600000000000004,"15min":0.35999999999999999},"max":{"1min":1.927,"5min":1.927,"15min":77.745000000000005},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0429999999999999,"15min":1.0780000000000001},"min":{"1min":0.64500000000000002,"5min":0.57499999999999996,"15min":0.44},"max":{"1min":1.5,"5min":1.74,"15min":13.555999999999999},"last":0.94899999999999995}]},{"osd":1,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.0740000000000001,"15min":1.125},"min":{"1min":0.91300000000000003,"5min":0.56999999999999995,"15min":0.40000000000000002},"max":{"1min":1.3240000000000001,"5min":1.554,"15min":15.499000000000001},"last":1.177},{"interface":"front","average":{"1min":1.206,"5min":1.117,"15min":1.155},"min":{"1min":0.76200000000000001,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.6379999999999999,"5min":1.702,"15min":7.7629999999999999},"last":0.86199999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1850000000000001,"15min":1.165},"min":{"1min":0.89000000000000001,"5min":0.84999999999999998,"15min":0.57399999999999995},"max":{"1min":1.4199999999999999,"5min":1.667,"15min":3.0960000000000001},"last":1.296},{"interface":"front","average":{"1min":1.161,"5min":1.1359999999999999,"15min":1.145},"min":{"1min":0.747,"5min":0.68999999999999995,"15min":0.38200000000000001},"max":{"1min":1.401,"5min":1.7390000000000001,"15min":4.9660000000000002},"last":1.2270000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.173,"15min":1.486},"min":{"1min":0.97899999999999998,"5min":0.66700000000000004,"15min":0.59299999999999997},"max":{"1min":1.4610000000000001,"5min":2.343,"15min":102.08199999999999},"last":1.345},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.82599999999999996,"5min":0.66300000000000003,"15min":0.374},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":15.468},"last":1.488}]},{"osd":4,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1799999999999999,"15min":1.147},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.495},"max":{"1min":1.6040000000000001,"5min":1.631,"15min":3.1749999999999998},"last":1.45},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.204,"15min":1.165},"min":{"1min":0.82799999999999996,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.6910000000000001,"5min":2.5489999999999999,"15min":5.1200000000000001},"last":1.0680000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1499999999999999,"15min":1.2430000000000001},"min":{"1min":0.93000000000000005,"5min":0.58699999999999997,"15min":0.48099999999999998},"max":{"1min":1.6020000000000001,"5min":1.7829999999999999,"15min":30.533000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.294,"15min":1.278},"min":{"1min":1.0029999999999999,"5min":0.79500000000000004,"15min":0.46600000000000003},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":3.875},"last":1.6439999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3500000000000001,"15min":1.4279999999999999},"min":{"1min":0.97999999999999998,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":1.6379999999999999,"5min":2.7490000000000001,"15min":23.547999999999998},"last":1.387},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3149999999999999,"15min":1.5509999999999999},"min":{"1min":0.80200000000000005,"5min":0.77700000000000002,"15min":0.495},"max":{"1min":1.7110000000000001,"5min":1.9019999999999999,"15min":63.737000000000002},"last":1.6060000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575027,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307676,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064164,"statfs":{"total":96636764160,"available":96321703936,"internally_reserved":0,"allocated":2314240,"data_stored":1155176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0089999999999999,"15min":1.0129999999999999},"min":{"1min":0.58599999999999997,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.556,"5min":1.651,"15min":2.0609999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0529999999999999,"15min":1.042},"min":{"1min":0.61699999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5840000000000001,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.88500000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.224,"15min":1.1850000000000001},"min":{"1min":0.85099999999999998,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.6619999999999999,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2050000000000001,"15min":1.2},"min":{"1min":0.879,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.6140000000000001,"5min":1.9930000000000001,"15min":2.0209999999999999},"last":1.212}]},{"osd":2,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1479999999999999,"15min":1.135},"min":{"1min":0.80700000000000005,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.4370000000000001,"5min":1.9219999999999999,"15min":1.925},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.145,"15min":1.115},"min":{"1min":0.82499999999999996,"5min":0.71799999999999997,"15min":0.59899999999999998},"max":{"1min":1.4410000000000001,"5min":1.982,"15min":1.982},"last":1.0089999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.216,"15min":1.1599999999999999},"min":{"1min":0.71199999999999997,"5min":0.69799999999999995,"15min":0.66900000000000004},"max":{"1min":1.5660000000000001,"5min":3.202,"15min":3.202},"last":1.383},{"interface":"front","average":{"1min":1.246,"5min":1.1899999999999999,"15min":1.2090000000000001},"min":{"1min":0.98199999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.546,"5min":1.6830000000000001,"15min":4.8819999999999997},"last":1.125}]},{"osd":4,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.103,"15min":1.097},"min":{"1min":0.77700000000000002,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.5369999999999999,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.085},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1950000000000001,"15min":1.1779999999999999},"min":{"1min":0.78000000000000003,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.4430000000000001,"5min":2.081,"15min":2.081},"last":1.165}]},{"osd":6,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.226,"15min":1.2190000000000001},"min":{"1min":0.97999999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.482,"5min":2.0099999999999998,"15min":2.2010000000000001},"last":1.046},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.24,"15min":1.2410000000000001},"min":{"1min":0.71899999999999997,"5min":0.70699999999999996,"15min":0.55900000000000005},"max":{"1min":1.4530000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.26}]},{"osd":7,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3169999999999999,"15min":1.304},"min":{"1min":0.91400000000000003,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.7410000000000001,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.371,"5min":1.3420000000000001,"15min":1.3360000000000001},"min":{"1min":0.96099999999999997,"5min":0.72699999999999998,"15min":0.60799999999999998},"max":{"1min":1.6819999999999999,"5min":1.8859999999999999,"15min":3.1840000000000002},"last":1.3660000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575027,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299500,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072340,"statfs":{"total":96636764160,"available":96330076160,"internally_reserved":0,"allocated":2330624,"data_stored":1155924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1279999999999999,"15min":1.103},"min":{"1min":0.81000000000000005,"5min":0.63700000000000001,"15min":0.47799999999999998},"max":{"1min":1.4379999999999999,"5min":1.696,"15min":2.0150000000000001},"last":1.02},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1950000000000001,"15min":1.147},"min":{"1min":0.92100000000000004,"5min":0.75700000000000001,"15min":0.48899999999999999},"max":{"1min":1.548,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.091}]},{"osd":1,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.091,"15min":1.0760000000000001},"min":{"1min":0.77800000000000002,"5min":0.59899999999999998,"15min":0.53100000000000003},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.131},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.82199999999999995,"5min":0.52500000000000002,"15min":0.46000000000000002},"max":{"1min":1.3879999999999999,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.79900000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0760000000000001,"15min":1.0720000000000001},"min":{"1min":0.79500000000000004,"5min":0.66400000000000003,"15min":0.49199999999999999},"max":{"1min":1.361,"5min":1.516,"15min":5.3390000000000004},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.204,"5min":1.149,"15min":1.161},"min":{"1min":0.88,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5089999999999999,"5min":1.6140000000000001,"15min":2.3479999999999999},"last":0.89600000000000002}]},{"osd":3,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.149,"15min":1.135},"min":{"1min":0.86799999999999999,"5min":0.65700000000000003,"15min":0.496},"max":{"1min":1.478,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.2,"5min":1.1719999999999999,"15min":1.1499999999999999},"min":{"1min":0.97199999999999998,"5min":0.67700000000000005,"15min":0.53100000000000003},"max":{"1min":1.4039999999999999,"5min":2.2959999999999998,"15min":5.3029999999999999},"last":0.94199999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.113,"15min":1.1180000000000001},"min":{"1min":0.76200000000000001,"5min":0.63500000000000001,"15min":0.54100000000000004},"max":{"1min":1.365,"5min":1.6899999999999999,"15min":2.0790000000000002},"last":1.113},{"interface":"front","average":{"1min":1.244,"5min":1.2070000000000001,"15min":1.133},"min":{"1min":0.94299999999999995,"5min":0.68200000000000005,"15min":0.52200000000000002},"max":{"1min":1.583,"5min":1.8240000000000001,"15min":2.0030000000000001},"last":1.048}]},{"osd":6,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.149,"15min":1.1439999999999999},"min":{"1min":0.88100000000000001,"5min":0.67400000000000004,"15min":0.44500000000000001},"max":{"1min":1.387,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":1.012},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.28,"15min":1.27},"min":{"1min":0.98999999999999999,"5min":0.73699999999999999,"15min":0.51900000000000002},"max":{"1min":1.45,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":1.1839999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3500000000000001,"15min":1.3120000000000001},"min":{"1min":1.0700000000000001,"5min":0.74099999999999999,"15min":0.59399999999999997},"max":{"1min":1.6299999999999999,"5min":1.8999999999999999,"15min":2.2839999999999998},"last":1.169},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.94999999999999996,"5min":0.89300000000000002,"15min":0.56899999999999995},"max":{"1min":1.5049999999999999,"5min":1.843,"15min":5.2629999999999999},"last":1.0569999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575027,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303588,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068252,"statfs":{"total":96636764160,"available":96325890048,"internally_reserved":0,"allocated":2322432,"data_stored":1155288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.85699999999999998},"min":{"1min":0.50800000000000001,"5min":0.41099999999999998,"15min":0.34200000000000003},"max":{"1min":1.175,"5min":1.512,"15min":14.859},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.63400000000000001,"5min":0.42699999999999999,"15min":0.317},"max":{"1min":1.371,"5min":1.804,"15min":5.0919999999999996},"last":0.749}]},{"osd":1,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.90900000000000003,"15min":0.90300000000000002},"min":{"1min":0.62,"5min":0.50600000000000001,"15min":0.39300000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":6.5570000000000004},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.95699999999999996,"15min":0.97099999999999997},"min":{"1min":0.55800000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.482,"5min":1.7669999999999999,"15min":5.7519999999999998},"last":0.58199999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.085,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48599999999999999,"15min":0.40600000000000003},"max":{"1min":1.6910000000000001,"5min":1.8680000000000001,"15min":2.391},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.157,"15min":1.1819999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.44800000000000001},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":4.1429999999999998},"last":1.1299999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.323,"15min":1.331},"min":{"1min":0.86699999999999999,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.831,"5min":2.423,"15min":10.858000000000001},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.292,"15min":1.337},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.63600000000000001},"max":{"1min":1.6379999999999999,"5min":2.3359999999999999,"15min":10.846},"last":1.1970000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.238,"15min":1.2829999999999999},"min":{"1min":0.99399999999999999,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.595,"5min":1.7709999999999999,"15min":7.3639999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.351,"5min":1.3089999999999999,"15min":1.381},"min":{"1min":0.92700000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.738,"5min":6.3220000000000001,"15min":14.523999999999999},"last":0.872}]},{"osd":6,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.369,"15min":1.357},"min":{"1min":0.92700000000000005,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.77,"5min":2.1819999999999999,"15min":4.9809999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.413,"5min":1.3720000000000001,"15min":1.3879999999999999},"min":{"1min":1.113,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":5.4210000000000003},"last":1.3100000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.3340000000000001,"15min":1.363},"min":{"1min":0.96999999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.004,"5min":2.004,"15min":5.7160000000000002},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.381,"15min":1.409},"min":{"1min":1.0860000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8839999999999999,"5min":2.5449999999999999,"15min":6.4279999999999999},"last":0.98199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575027,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315872,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":94055968,"statfs":{"total":96636764160,"available":96313311232,"internally_reserved":0,"allocated":2318336,"data_stored":1155246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.54100000000000004,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":1.1919999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85499999999999998,"15min":0.85399999999999998},"min":{"1min":0.53900000000000003,"5min":0.45300000000000001,"15min":0.373},"max":{"1min":1.1899999999999999,"5min":1.556,"15min":1.7350000000000001},"last":0.83299999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92600000000000005,"15min":0.86899999999999999},"min":{"1min":0.55400000000000005,"5min":0.46800000000000003,"15min":0.41299999999999998},"max":{"1min":1.8400000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.109,"5min":1,"15min":0.95799999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.41599999999999998},"max":{"1min":1.671,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.0449999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1659999999999999,"15min":1.137},"min":{"1min":0.66700000000000004,"5min":0.56200000000000006,"15min":0.47099999999999997},"max":{"1min":1.984,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.272},{"interface":"front","average":{"1min":1.296,"5min":1.2370000000000001,"15min":1.212},"min":{"1min":0.85999999999999999,"5min":0.64300000000000002,"15min":0.51100000000000001},"max":{"1min":1.7609999999999999,"5min":3.133,"15min":3.133},"last":1.3740000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.3140000000000001,"15min":1.278},"min":{"1min":1.0029999999999999,"5min":0.88500000000000001,"15min":0.59099999999999997},"max":{"1min":2.101,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.202},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.206,"15min":1.2010000000000001},"min":{"1min":0.74099999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":2.2829999999999999},"last":0.94399999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.2649999999999999,"15min":1.228},"min":{"1min":0.94699999999999995,"5min":0.84099999999999997,"15min":0.63800000000000001},"max":{"1min":2.1680000000000001,"5min":2.379,"15min":2.379},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.45,"5min":1.329,"15min":1.2909999999999999},"min":{"1min":1.181,"5min":0.84799999999999998,"15min":0.67000000000000004},"max":{"1min":2.1880000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.3109999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2609999999999999,"15min":1.254},"min":{"1min":0.79500000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":2.1920000000000002},"last":1.163},{"interface":"front","average":{"1min":1.47,"5min":1.3720000000000001,"15min":1.3160000000000001},"min":{"1min":0.98899999999999999,"5min":0.629,"15min":0.629},"max":{"1min":2.2759999999999998,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.1220000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3560000000000001,"15min":1.345},"min":{"1min":0.88500000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8200000000000001,"5min":1.9390000000000001,"15min":2.1749999999999998},"last":1.288},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.452,"15min":1.4219999999999999},"min":{"1min":1.121,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.2280000000000002,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.3520000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575028,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311784,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060056,"statfs":{"total":96636764160,"available":96317497344,"internally_reserved":0,"allocated":2326528,"data_stored":1155786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84899999999999998,"15min":0.86599999999999999},"min":{"1min":0.53500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.032,"5min":1.4830000000000001,"15min":3.4119999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.054,"5min":0.98099999999999998,"15min":0.997},"min":{"1min":0.66100000000000003,"5min":0.56999999999999995,"15min":0.41099999999999998},"max":{"1min":1.5089999999999999,"5min":1.6160000000000001,"15min":2.101},"last":0.77300000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.97499999999999998,"15min":0.98899999999999999},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.45500000000000002},"max":{"1min":1.3180000000000001,"5min":1.492,"15min":2.169},"last":0.997},{"interface":"front","average":{"1min":1.075,"5min":1.0589999999999999,"15min":1.0549999999999999},"min":{"1min":0.64900000000000002,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.478,"5min":1.5780000000000001,"15min":2.024},"last":1.1120000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.052,"15min":1.0429999999999999},"min":{"1min":0.73999999999999999,"5min":0.57399999999999995,"15min":0.38900000000000001},"max":{"1min":1.502,"5min":1.972,"15min":4.665},"last":1.2749999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.64600000000000002,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.2629999999999999,"5min":1.659,"15min":5.5830000000000002},"last":0.81799999999999995}]},{"osd":4,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2110000000000001,"15min":1.2490000000000001},"min":{"1min":0.86299999999999999,"5min":0.60299999999999998,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":1.958,"15min":15.76},"last":1.196},{"interface":"front","average":{"1min":1.341,"5min":1.2809999999999999,"15min":1.333},"min":{"1min":0.90400000000000003,"5min":0.74099999999999999,"15min":0.63500000000000001},"max":{"1min":1.649,"5min":1.714,"15min":16.975000000000001},"last":1.385}]},{"osd":5,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.264,"15min":1.232},"min":{"1min":0.88200000000000001,"5min":0.72599999999999998,"15min":0.55700000000000005},"max":{"1min":1.6240000000000001,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.274,"15min":1.2789999999999999},"min":{"1min":0.97199999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.784,"5min":2.1309999999999998,"15min":2.52},"last":1.468}]},{"osd":6,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.266,"15min":1.2609999999999999},"min":{"1min":0.95099999999999996,"5min":0.68999999999999995,"15min":0.55600000000000005},"max":{"1min":1.53,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3,"15min":1.327},"min":{"1min":1.056,"5min":0.76200000000000001,"15min":0.68799999999999994},"max":{"1min":1.6459999999999999,"5min":2.0609999999999999,"15min":2.5569999999999999},"last":1.355}]},{"osd":7,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.339,"15min":1.355},"min":{"1min":0.96299999999999997,"5min":0.69999999999999996,"15min":0.68100000000000005},"max":{"1min":1.754,"5min":1.8999999999999999,"15min":4.4329999999999998},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.355,"15min":1.3520000000000001},"min":{"1min":1.0109999999999999,"5min":0.81100000000000005,"15min":0.64900000000000002},"max":{"1min":1.7010000000000001,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":1.2969999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575027,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311780,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060060,"statfs":{"total":96636764160,"available":96317501440,"internally_reserved":0,"allocated":2322432,"data_stored":1156158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.81799999999999995,"15min":0.88500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.28699999999999998},"max":{"1min":1.0609999999999999,"5min":1.4219999999999999,"15min":15.273},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.877,"5min":0.874,"15min":0.91300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.34499999999999997},"max":{"1min":1.3680000000000001,"5min":1.625,"15min":4.4009999999999998},"last":1.5089999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.97799999999999998,"15min":1.0449999999999999},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.46400000000000002},"max":{"1min":1.363,"5min":1.6299999999999999,"15min":15.473000000000001},"last":1.071},{"interface":"front","average":{"1min":1.069,"5min":1.0249999999999999,"15min":1.0269999999999999},"min":{"1min":0.67400000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5509999999999999,"5min":1.6850000000000001,"15min":1.7989999999999999},"last":1.7070000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.95899999999999996,"15min":0.97699999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.39000000000000001},"max":{"1min":1.302,"5min":1.5049999999999999,"15min":5.3970000000000002},"last":1.8959999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.1100000000000001,"15min":1.177},"min":{"1min":0.67200000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.5529999999999999,"5min":1.79,"15min":15.439},"last":1.6619999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.208,"15min":1.2470000000000001},"min":{"1min":0.81999999999999995,"5min":0.81399999999999995,"15min":0.61399999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":5.1799999999999997},"last":1.774},{"interface":"front","average":{"1min":1.222,"5min":1.214,"15min":1.216},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.56200000000000006},"max":{"1min":1.615,"5min":1.738,"15min":3.4340000000000002},"last":1.6200000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.272,"15min":1.27},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.67600000000000005},"max":{"1min":1.579,"5min":1.9099999999999999,"15min":3.548},"last":1.802},{"interface":"front","average":{"1min":1.272,"5min":1.306,"15min":1.321},"min":{"1min":0.90300000000000002,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.587,"5min":1.7210000000000001,"15min":2.823},"last":1.8520000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3300000000000001,"15min":1.407},"min":{"1min":0.91700000000000004,"5min":0.879,"15min":0.59099999999999997},"max":{"1min":1.6559999999999999,"5min":1.7909999999999999,"15min":15.4},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3200000000000001,"15min":1.3720000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.72499999999999998},"max":{"1min":1.7010000000000001,"5min":1.8919999999999999,"15min":7.1349999999999998},"last":1.821}]},{"osd":7,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3740000000000001,"15min":1.4219999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.79900000000000004},"max":{"1min":1.7969999999999999,"5min":2.145,"15min":5.29},"last":1.9319999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.3680000000000001,"15min":1.367},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.752},"max":{"1min":1.7230000000000001,"5min":2.0470000000000002,"15min":2.7269999999999999},"last":1.7290000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:19:17.202 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:19:17.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.372+0000 7f1a45c00700 1 Processor -- start 2024-01-22T05:19:17.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.372+0000 7f1a45c00700 1 -- start start 2024-01-22T05:19:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.372+0000 7f1a45c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1a40155d20 0x7f1a40065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.372+0000 7f1a45c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1a40066070 0x7f1a400a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.372+0000 7f1a45c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a400c1a40 con 0x7f1a400a8c30 2024-01-22T05:19:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.372+0000 7f1a45c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a400a90c0 con 0x7f1a40066070 2024-01-22T05:19:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.372+0000 7f1a45c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a40159310 con 0x7f1a40155d20 2024-01-22T05:19:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.376+0000 7f1a3e000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1a40066070 0x7f1a400a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.376+0000 7f1a3e000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1a40066070 0x7f1a400a8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56152/0 (socket says 172.21.15.49:56152) 2024-01-22T05:19:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.376+0000 7f1a3e000700 1 -- 172.21.15.49:0/65352387 learned_addr learned my addr 172.21.15.49:0/65352387 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.376+0000 7f1a3ea00700 1 --2- 172.21.15.49:0/65352387 >> v2:172.21.15.110:3300/0 conn(0x7f1a40155d20 0x7f1a40065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.376+0000 7f1a3e000700 1 -- 172.21.15.49:0/65352387 >> v2:172.21.15.110:3300/0 conn(0x7f1a40155d20 msgr2=0x7f1a40065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.376+0000 7f1a3e000700 1 --2- 172.21.15.49:0/65352387 >> v2:172.21.15.110:3300/0 conn(0x7f1a40155d20 0x7f1a40065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:17.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.376+0000 7f1a3e000700 1 -- 172.21.15.49:0/65352387 >> v1:172.21.15.49:6789/0 conn(0x7f1a400a8c30 legacy=0x7f1a400c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:17.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.376+0000 7f1a3e000700 1 -- 172.21.15.49:0/65352387 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a400c13f0 con 0x7f1a40066070 2024-01-22T05:19:17.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.376+0000 7f1a3e000700 1 --2- 172.21.15.49:0/65352387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a40066070 0x7f1a400a8740 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f1a4005ff40 tx=0x7f1a280090f0).ready entity=mon.0 client_cookie=e2a1b90b4473d8c8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:17.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.376+0000 7f1a3d600700 1 -- 172.21.15.49:0/65352387 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2800b520 con 0x7f1a40066070 2024-01-22T05:19:17.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.376+0000 7f1a3d600700 1 -- 172.21.15.49:0/65352387 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2800b680 con 0x7f1a40066070 2024-01-22T05:19:17.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.376+0000 7f1a3d600700 1 -- 172.21.15.49:0/65352387 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2800ba00 con 0x7f1a40066070 2024-01-22T05:19:17.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.376+0000 7f1a45c00700 1 -- 172.21.15.49:0/65352387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a40066070 msgr2=0x7f1a400a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:17.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.376+0000 7f1a45c00700 1 --2- 172.21.15.49:0/65352387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a40066070 0x7f1a400a8740 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f1a4005ff40 tx=0x7f1a280090f0).stop 2024-01-22T05:19:17.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.380+0000 7f1a45c00700 1 -- 172.21.15.49:0/65352387 shutdown_connections 2024-01-22T05:19:17.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.380+0000 7f1a45c00700 1 --2- 172.21.15.49:0/65352387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a40066070 0x7f1a400a8740 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:17.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.380+0000 7f1a45c00700 1 --2- 172.21.15.49:0/65352387 >> v2:172.21.15.110:3300/0 conn(0x7f1a40155d20 0x7f1a40065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:17.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.380+0000 7f1a45c00700 1 -- 172.21.15.49:0/65352387 >> 172.21.15.49:0/65352387 conn(0x7f1a400c6540 msgr2=0x7f1a400c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:17.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.380+0000 7f1a45c00700 1 -- 172.21.15.49:0/65352387 shutdown_connections 2024-01-22T05:19:17.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.380+0000 7f1a45c00700 1 -- 172.21.15.49:0/65352387 wait complete. 2024-01-22T05:19:17.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.380+0000 7f1a45c00700 1 Processor -- start 2024-01-22T05:19:17.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a45c00700 1 -- start start 2024-01-22T05:19:17.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a45c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a40066070 0x7f1a40159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:17.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a45c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a400a8c30 0x7f1a4015ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:17.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a45c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a40155d20 0x7f1a401689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:17.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a45c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a400bedd0 con 0x7f1a40155d20 2024-01-22T05:19:17.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a45c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a40159a00 con 0x7f1a400a8c30 2024-01-22T05:19:17.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a45c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a40169430 con 0x7f1a40066070 2024-01-22T05:19:17.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a3f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a40155d20 0x7f1a401689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:17.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a3f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a40155d20 0x7f1a401689b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56162/0 (socket says 172.21.15.49:56162) 2024-01-22T05:19:17.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a3f400700 1 -- 172.21.15.49:0/4083907389 learned_addr learned my addr 172.21.15.49:0/4083907389 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:17.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a3e000700 1 --2- 172.21.15.49:0/4083907389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a400a8c30 0x7f1a4015ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:17.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a3ea00700 1 --2- 172.21.15.49:0/4083907389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a40066070 0x7f1a40159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:17.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a3f400700 1 -- 172.21.15.49:0/4083907389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a40066070 msgr2=0x7f1a40159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:17.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a3f400700 1 --2- 172.21.15.49:0/4083907389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a40066070 0x7f1a40159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:17.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a3f400700 1 -- 172.21.15.49:0/4083907389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a400a8c30 msgr2=0x7f1a4015ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:17.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a3f400700 1 --2- 172.21.15.49:0/4083907389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a400a8c30 0x7f1a4015ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:17.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a3f400700 1 -- 172.21.15.49:0/4083907389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a28009370 con 0x7f1a40155d20 2024-01-22T05:19:17.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.384+0000 7f1a3ea00700 1 --2- 172.21.15.49:0/4083907389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a40066070 0x7f1a40159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:17.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.388+0000 7f1a3f400700 1 --2- 172.21.15.49:0/4083907389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a40155d20 0x7f1a401689b0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f1a38002230 tx=0x7f1a380015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:17.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.388+0000 7f1a36000700 1 -- 172.21.15.49:0/4083907389 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a38010510 con 0x7f1a40155d20 2024-01-22T05:19:17.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.388+0000 7f1a36000700 1 -- 172.21.15.49:0/4083907389 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a38010670 con 0x7f1a40155d20 2024-01-22T05:19:17.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.388+0000 7f1a36000700 1 -- 172.21.15.49:0/4083907389 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a380109f0 con 0x7f1a40155d20 2024-01-22T05:19:17.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.388+0000 7f1a45c00700 1 -- 172.21.15.49:0/4083907389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a40169710 con 0x7f1a40155d20 2024-01-22T05:19:17.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.388+0000 7f1a45c00700 1 -- 172.21.15.49:0/4083907389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4015a380 con 0x7f1a40155d20 2024-01-22T05:19:17.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.388+0000 7f1a45c00700 1 -- 172.21.15.49:0/4083907389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a40159b70 con 0x7f1a40155d20 2024-01-22T05:19:17.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.392+0000 7f1a36000700 1 -- 172.21.15.49:0/4083907389 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1a3801b400 con 0x7f1a40155d20 2024-01-22T05:19:17.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.392+0000 7f1a36000700 1 --2- 172.21.15.49:0/4083907389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a1805a510 0x7f1a1805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:17.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.392+0000 7f1a36000700 1 -- 172.21.15.49:0/4083907389 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f1a380746a0 con 0x7f1a40155d20 2024-01-22T05:19:17.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.392+0000 7f1a3ea00700 1 --2- 172.21.15.49:0/4083907389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a1805a510 0x7f1a1805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:17.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.392+0000 7f1a3ea00700 1 --2- 172.21.15.49:0/4083907389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a1805a510 0x7f1a1805c9d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f1a30009b60 tx=0x7f1a30008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:17.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.400+0000 7f1a36000700 1 -- 172.21.15.49:0/4083907389 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1a38047cc0 con 0x7f1a40155d20 2024-01-22T05:19:17.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.560+0000 7f1a45c00700 1 -- 172.21.15.49:0/4083907389 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a40169900 con 0x7f1a1805a510 2024-01-22T05:19:17.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.576+0000 7f1a36000700 1 -- 172.21.15.49:0/4083907389 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359446 (secure 0 0 0) 0x7f1a40169900 con 0x7f1a1805a510 2024-01-22T05:19:17.584 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:17.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.584+0000 7f1a45c00700 1 -- 172.21.15.49:0/4083907389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a1805a510 msgr2=0x7f1a1805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:17.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.584+0000 7f1a45c00700 1 --2- 172.21.15.49:0/4083907389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a1805a510 0x7f1a1805c9d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f1a30009b60 tx=0x7f1a30008040).stop 2024-01-22T05:19:17.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.584+0000 7f1a45c00700 1 -- 172.21.15.49:0/4083907389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a40155d20 msgr2=0x7f1a401689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:17.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.584+0000 7f1a45c00700 1 --2- 172.21.15.49:0/4083907389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a40155d20 0x7f1a401689b0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f1a38002230 tx=0x7f1a380015e0).stop 2024-01-22T05:19:17.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.584+0000 7f1a45c00700 1 -- 172.21.15.49:0/4083907389 shutdown_connections 2024-01-22T05:19:17.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.584+0000 7f1a45c00700 1 --2- 172.21.15.49:0/4083907389 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1a1805a510 0x7f1a1805c9d0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:17.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.584+0000 7f1a45c00700 1 --2- 172.21.15.49:0/4083907389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a40155d20 0x7f1a401689b0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:17.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.584+0000 7f1a45c00700 1 --2- 172.21.15.49:0/4083907389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a400a8c30 0x7f1a4015ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:17.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.584+0000 7f1a45c00700 1 --2- 172.21.15.49:0/4083907389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a40066070 0x7f1a40159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:17.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.584+0000 7f1a45c00700 1 -- 172.21.15.49:0/4083907389 >> 172.21.15.49:0/4083907389 conn(0x7f1a400c6540 msgr2=0x7f1a400c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:17.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.584+0000 7f1a45c00700 1 -- 172.21.15.49:0/4083907389 shutdown_connections 2024-01-22T05:19:17.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.584+0000 7f1a45c00700 1 -- 172.21.15.49:0/4083907389 wait complete. 2024-01-22T05:19:17.589 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:19:17.608 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":622,"stamp":"2024-01-22T05:19:17.560087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2469664,"kb_used_data":18144,"kb_used_omap":0,"kb_used_meta":2451456,"kb_avail":752505056,"statfs":{"total":773094113280,"available":770565177344,"internally_reserved":0,"allocated":18579456,"data_stored":9246020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510290944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6310799,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-7,"num_read_kb":-4,"num_write":-82,"num_write_kb":-6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.000347"},"pg_stats":[{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.089268+0000","last_change":"2024-01-22T05:19:08.084948+0000","last_active":"2024-01-22T05:19:08.089268+0000","last_peered":"2024-01-22T05:19:08.089268+0000","last_clean":"2024-01-22T05:19:08.089268+0000","last_became_active":"2024-01-22T05:19:08.084684+0000","last_became_peered":"2024-01-22T05:19:08.084684+0000","last_unstale":"2024-01-22T05:19:08.089268+0000","last_undegraded":"2024-01-22T05:19:08.089268+0000","last_fullsized":"2024-01-22T05:19:08.089268+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3f","version":"183'3","reported_seq":13,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.112597+0000","last_change":"2024-01-22T05:19:07.656070+0000","last_active":"2024-01-22T05:19:08.112597+0000","last_peered":"2024-01-22T05:19:08.112597+0000","last_clean":"2024-01-22T05:19:08.112597+0000","last_became_active":"2024-01-22T05:19:07.655574+0000","last_became_peered":"2024-01-22T05:19:07.655574+0000","last_unstale":"2024-01-22T05:19:08.112597+0000","last_undegraded":"2024-01-22T05:19:08.112597+0000","last_fullsized":"2024-01-22T05:19:08.112597+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.113399+0000","last_change":"2024-01-22T05:19:08.105745+0000","last_active":"2024-01-22T05:19:08.113399+0000","last_peered":"2024-01-22T05:19:08.113399+0000","last_clean":"2024-01-22T05:19:08.113399+0000","last_became_active":"2024-01-22T05:19:08.105444+0000","last_became_peered":"2024-01-22T05:19:08.105444+0000","last_unstale":"2024-01-22T05:19:08.113399+0000","last_undegraded":"2024-01-22T05:19:08.113399+0000","last_fullsized":"2024-01-22T05:19:08.113399+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.093907+0000","last_change":"2024-01-22T05:19:07.669270+0000","last_active":"2024-01-22T05:19:08.093907+0000","last_peered":"2024-01-22T05:19:08.093907+0000","last_clean":"2024-01-22T05:19:08.093907+0000","last_became_active":"2024-01-22T05:19:07.668953+0000","last_became_peered":"2024-01-22T05:19:07.668953+0000","last_unstale":"2024-01-22T05:19:08.093907+0000","last_undegraded":"2024-01-22T05:19:08.093907+0000","last_fullsized":"2024-01-22T05:19:08.093907+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.108064+0000","last_change":"2024-01-22T05:19:08.104194+0000","last_active":"2024-01-22T05:19:08.108064+0000","last_peered":"2024-01-22T05:19:08.108064+0000","last_clean":"2024-01-22T05:19:08.108064+0000","last_became_active":"2024-01-22T05:19:08.103042+0000","last_became_peered":"2024-01-22T05:19:08.103042+0000","last_unstale":"2024-01-22T05:19:08.108064+0000","last_undegraded":"2024-01-22T05:19:08.108064+0000","last_fullsized":"2024-01-22T05:19:08.108064+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.090735+0000","last_change":"2024-01-22T05:19:07.651051+0000","last_active":"2024-01-22T05:19:08.090735+0000","last_peered":"2024-01-22T05:19:08.090735+0000","last_clean":"2024-01-22T05:19:08.090735+0000","last_became_active":"2024-01-22T05:19:07.650703+0000","last_became_peered":"2024-01-22T05:19:07.650703+0000","last_unstale":"2024-01-22T05:19:08.090735+0000","last_undegraded":"2024-01-22T05:19:08.090735+0000","last_fullsized":"2024-01-22T05:19:08.090735+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110577+0000","last_change":"2024-01-22T05:19:08.097453+0000","last_active":"2024-01-22T05:19:08.110577+0000","last_peered":"2024-01-22T05:19:08.110577+0000","last_clean":"2024-01-22T05:19:08.110577+0000","last_became_active":"2024-01-22T05:19:08.097164+0000","last_became_peered":"2024-01-22T05:19:08.097164+0000","last_unstale":"2024-01-22T05:19:08.110577+0000","last_undegraded":"2024-01-22T05:19:08.110577+0000","last_fullsized":"2024-01-22T05:19:08.110577+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3c","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.114566+0000","last_change":"2024-01-22T05:19:07.650060+0000","last_active":"2024-01-22T05:19:08.114566+0000","last_peered":"2024-01-22T05:19:08.114566+0000","last_clean":"2024-01-22T05:19:08.114566+0000","last_became_active":"2024-01-22T05:19:07.649797+0000","last_became_peered":"2024-01-22T05:19:07.649797+0000","last_unstale":"2024-01-22T05:19:08.114566+0000","last_undegraded":"2024-01-22T05:19:08.114566+0000","last_fullsized":"2024-01-22T05:19:08.114566+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.107902+0000","last_change":"2024-01-22T05:19:08.105224+0000","last_active":"2024-01-22T05:19:08.107902+0000","last_peered":"2024-01-22T05:19:08.107902+0000","last_clean":"2024-01-22T05:19:08.107902+0000","last_became_active":"2024-01-22T05:19:08.104957+0000","last_became_peered":"2024-01-22T05:19:08.104957+0000","last_unstale":"2024-01-22T05:19:08.107902+0000","last_undegraded":"2024-01-22T05:19:08.107902+0000","last_fullsized":"2024-01-22T05:19:08.107902+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.119110+0000","last_change":"2024-01-22T05:19:07.670474+0000","last_active":"2024-01-22T05:19:08.119110+0000","last_peered":"2024-01-22T05:19:08.119110+0000","last_clean":"2024-01-22T05:19:08.119110+0000","last_became_active":"2024-01-22T05:19:07.670188+0000","last_became_peered":"2024-01-22T05:19:07.670188+0000","last_unstale":"2024-01-22T05:19:08.119110+0000","last_undegraded":"2024-01-22T05:19:08.119110+0000","last_fullsized":"2024-01-22T05:19:08.119110+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.123392+0000","last_change":"2024-01-22T05:19:08.121080+0000","last_active":"2024-01-22T05:19:08.123392+0000","last_peered":"2024-01-22T05:19:08.123392+0000","last_clean":"2024-01-22T05:19:08.123392+0000","last_became_active":"2024-01-22T05:19:08.120818+0000","last_became_peered":"2024-01-22T05:19:08.120818+0000","last_unstale":"2024-01-22T05:19:08.123392+0000","last_undegraded":"2024-01-22T05:19:08.123392+0000","last_fullsized":"2024-01-22T05:19:08.123392+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.119989+0000","last_change":"2024-01-22T05:19:07.671413+0000","last_active":"2024-01-22T05:19:08.119989+0000","last_peered":"2024-01-22T05:19:08.119989+0000","last_clean":"2024-01-22T05:19:08.119989+0000","last_became_active":"2024-01-22T05:19:07.671100+0000","last_became_peered":"2024-01-22T05:19:07.671100+0000","last_unstale":"2024-01-22T05:19:08.119989+0000","last_undegraded":"2024-01-22T05:19:08.119989+0000","last_fullsized":"2024-01-22T05:19:08.119989+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.120711+0000","last_change":"2024-01-22T05:19:08.117346+0000","last_active":"2024-01-22T05:19:08.120711+0000","last_peered":"2024-01-22T05:19:08.120711+0000","last_clean":"2024-01-22T05:19:08.120711+0000","last_became_active":"2024-01-22T05:19:08.117050+0000","last_became_peered":"2024-01-22T05:19:08.117050+0000","last_unstale":"2024-01-22T05:19:08.120711+0000","last_undegraded":"2024-01-22T05:19:08.120711+0000","last_fullsized":"2024-01-22T05:19:08.120711+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.080440+0000","last_change":"2024-01-22T05:19:07.666450+0000","last_active":"2024-01-22T05:19:08.080440+0000","last_peered":"2024-01-22T05:19:08.080440+0000","last_clean":"2024-01-22T05:19:08.080440+0000","last_became_active":"2024-01-22T05:19:07.666151+0000","last_became_peered":"2024-01-22T05:19:07.666151+0000","last_unstale":"2024-01-22T05:19:08.080440+0000","last_undegraded":"2024-01-22T05:19:08.080440+0000","last_fullsized":"2024-01-22T05:19:08.080440+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.122008+0000","last_change":"2024-01-22T05:19:08.120496+0000","last_active":"2024-01-22T05:19:08.122008+0000","last_peered":"2024-01-22T05:19:08.122008+0000","last_clean":"2024-01-22T05:19:08.122008+0000","last_became_active":"2024-01-22T05:19:08.120211+0000","last_became_peered":"2024-01-22T05:19:08.120211+0000","last_unstale":"2024-01-22T05:19:08.122008+0000","last_undegraded":"2024-01-22T05:19:08.122008+0000","last_fullsized":"2024-01-22T05:19:08.122008+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.088836+0000","last_change":"2024-01-22T05:19:07.657604+0000","last_active":"2024-01-22T05:19:08.088836+0000","last_peered":"2024-01-22T05:19:08.088836+0000","last_clean":"2024-01-22T05:19:08.088836+0000","last_became_active":"2024-01-22T05:19:07.657049+0000","last_became_peered":"2024-01-22T05:19:07.657049+0000","last_unstale":"2024-01-22T05:19:08.088836+0000","last_undegraded":"2024-01-22T05:19:08.088836+0000","last_fullsized":"2024-01-22T05:19:08.088836+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117103+0000","last_change":"2024-01-22T05:19:08.107237+0000","last_active":"2024-01-22T05:19:08.117103+0000","last_peered":"2024-01-22T05:19:08.117103+0000","last_clean":"2024-01-22T05:19:08.117103+0000","last_became_active":"2024-01-22T05:19:08.106872+0000","last_became_peered":"2024-01-22T05:19:08.106872+0000","last_unstale":"2024-01-22T05:19:08.117103+0000","last_undegraded":"2024-01-22T05:19:08.117103+0000","last_fullsized":"2024-01-22T05:19:08.117103+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094858+0000","last_change":"2024-01-22T05:19:07.655847+0000","last_active":"2024-01-22T05:19:08.094858+0000","last_peered":"2024-01-22T05:19:08.094858+0000","last_clean":"2024-01-22T05:19:08.094858+0000","last_became_active":"2024-01-22T05:19:07.655215+0000","last_became_peered":"2024-01-22T05:19:07.655215+0000","last_unstale":"2024-01-22T05:19:08.094858+0000","last_undegraded":"2024-01-22T05:19:08.094858+0000","last_fullsized":"2024-01-22T05:19:08.094858+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.102212+0000","last_change":"2024-01-22T05:19:08.096055+0000","last_active":"2024-01-22T05:19:08.102212+0000","last_peered":"2024-01-22T05:19:08.102212+0000","last_clean":"2024-01-22T05:19:08.102212+0000","last_became_active":"2024-01-22T05:19:08.095727+0000","last_became_peered":"2024-01-22T05:19:08.095727+0000","last_unstale":"2024-01-22T05:19:08.102212+0000","last_undegraded":"2024-01-22T05:19:08.102212+0000","last_fullsized":"2024-01-22T05:19:08.102212+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.091263+0000","last_change":"2024-01-22T05:19:07.670516+0000","last_active":"2024-01-22T05:19:08.091263+0000","last_peered":"2024-01-22T05:19:08.091263+0000","last_clean":"2024-01-22T05:19:08.091263+0000","last_became_active":"2024-01-22T05:19:07.670199+0000","last_became_peered":"2024-01-22T05:19:07.670199+0000","last_unstale":"2024-01-22T05:19:08.091263+0000","last_undegraded":"2024-01-22T05:19:08.091263+0000","last_fullsized":"2024-01-22T05:19:08.091263+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.109610+0000","last_change":"2024-01-22T05:19:08.103330+0000","last_active":"2024-01-22T05:19:08.109610+0000","last_peered":"2024-01-22T05:19:08.109610+0000","last_clean":"2024-01-22T05:19:08.109610+0000","last_became_active":"2024-01-22T05:19:08.101344+0000","last_became_peered":"2024-01-22T05:19:08.101344+0000","last_unstale":"2024-01-22T05:19:08.109610+0000","last_undegraded":"2024-01-22T05:19:08.109610+0000","last_fullsized":"2024-01-22T05:19:08.109610+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.079329+0000","last_change":"2024-01-22T05:19:07.635899+0000","last_active":"2024-01-22T05:19:08.079329+0000","last_peered":"2024-01-22T05:19:08.079329+0000","last_clean":"2024-01-22T05:19:08.079329+0000","last_became_active":"2024-01-22T05:19:07.634902+0000","last_became_peered":"2024-01-22T05:19:07.634902+0000","last_unstale":"2024-01-22T05:19:08.079329+0000","last_undegraded":"2024-01-22T05:19:08.079329+0000","last_fullsized":"2024-01-22T05:19:08.079329+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.111140+0000","last_change":"2024-01-22T05:19:08.103939+0000","last_active":"2024-01-22T05:19:08.111140+0000","last_peered":"2024-01-22T05:19:08.111140+0000","last_clean":"2024-01-22T05:19:08.111140+0000","last_became_active":"2024-01-22T05:19:08.103677+0000","last_became_peered":"2024-01-22T05:19:08.103677+0000","last_unstale":"2024-01-22T05:19:08.111140+0000","last_undegraded":"2024-01-22T05:19:08.111140+0000","last_fullsized":"2024-01-22T05:19:08.111140+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.34","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.124565+0000","last_change":"2024-01-22T05:19:07.654867+0000","last_active":"2024-01-22T05:19:08.124565+0000","last_peered":"2024-01-22T05:19:08.124565+0000","last_clean":"2024-01-22T05:19:08.124565+0000","last_became_active":"2024-01-22T05:19:07.654182+0000","last_became_peered":"2024-01-22T05:19:07.654182+0000","last_unstale":"2024-01-22T05:19:08.124565+0000","last_undegraded":"2024-01-22T05:19:08.124565+0000","last_fullsized":"2024-01-22T05:19:08.124565+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.119873+0000","last_change":"2024-01-22T05:19:08.116385+0000","last_active":"2024-01-22T05:19:08.119873+0000","last_peered":"2024-01-22T05:19:08.119873+0000","last_clean":"2024-01-22T05:19:08.119873+0000","last_became_active":"2024-01-22T05:19:08.116107+0000","last_became_peered":"2024-01-22T05:19:08.116107+0000","last_unstale":"2024-01-22T05:19:08.119873+0000","last_undegraded":"2024-01-22T05:19:08.119873+0000","last_fullsized":"2024-01-22T05:19:08.119873+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110117+0000","last_change":"2024-01-22T05:19:07.642633+0000","last_active":"2024-01-22T05:19:08.110117+0000","last_peered":"2024-01-22T05:19:08.110117+0000","last_clean":"2024-01-22T05:19:08.110117+0000","last_became_active":"2024-01-22T05:19:07.641864+0000","last_became_peered":"2024-01-22T05:19:07.641864+0000","last_unstale":"2024-01-22T05:19:08.110117+0000","last_undegraded":"2024-01-22T05:19:08.110117+0000","last_fullsized":"2024-01-22T05:19:08.110117+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.111153+0000","last_change":"2024-01-22T05:19:08.108136+0000","last_active":"2024-01-22T05:19:08.111153+0000","last_peered":"2024-01-22T05:19:08.111153+0000","last_clean":"2024-01-22T05:19:08.111153+0000","last_became_active":"2024-01-22T05:19:08.106570+0000","last_became_peered":"2024-01-22T05:19:08.106570+0000","last_unstale":"2024-01-22T05:19:08.111153+0000","last_undegraded":"2024-01-22T05:19:08.111153+0000","last_fullsized":"2024-01-22T05:19:08.111153+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.079410+0000","last_change":"2024-01-22T05:19:07.659977+0000","last_active":"2024-01-22T05:19:08.079410+0000","last_peered":"2024-01-22T05:19:08.079410+0000","last_clean":"2024-01-22T05:19:08.079410+0000","last_became_active":"2024-01-22T05:19:07.659689+0000","last_became_peered":"2024-01-22T05:19:07.659689+0000","last_unstale":"2024-01-22T05:19:08.079410+0000","last_undegraded":"2024-01-22T05:19:08.079410+0000","last_fullsized":"2024-01-22T05:19:08.079410+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117980+0000","last_change":"2024-01-22T05:19:08.113752+0000","last_active":"2024-01-22T05:19:08.117980+0000","last_peered":"2024-01-22T05:19:08.117980+0000","last_clean":"2024-01-22T05:19:08.117980+0000","last_became_active":"2024-01-22T05:19:08.113446+0000","last_became_peered":"2024-01-22T05:19:08.113446+0000","last_unstale":"2024-01-22T05:19:08.117980+0000","last_undegraded":"2024-01-22T05:19:08.117980+0000","last_fullsized":"2024-01-22T05:19:08.117980+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094990+0000","last_change":"2024-01-22T05:19:07.663889+0000","last_active":"2024-01-22T05:19:08.094990+0000","last_peered":"2024-01-22T05:19:08.094990+0000","last_clean":"2024-01-22T05:19:08.094990+0000","last_became_active":"2024-01-22T05:19:07.663562+0000","last_became_peered":"2024-01-22T05:19:07.663562+0000","last_unstale":"2024-01-22T05:19:08.094990+0000","last_undegraded":"2024-01-22T05:19:08.094990+0000","last_fullsized":"2024-01-22T05:19:08.094990+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.120067+0000","last_change":"2024-01-22T05:19:08.112048+0000","last_active":"2024-01-22T05:19:08.120067+0000","last_peered":"2024-01-22T05:19:08.120067+0000","last_clean":"2024-01-22T05:19:08.120067+0000","last_became_active":"2024-01-22T05:19:08.111758+0000","last_became_peered":"2024-01-22T05:19:08.111758+0000","last_unstale":"2024-01-22T05:19:08.120067+0000","last_undegraded":"2024-01-22T05:19:08.120067+0000","last_fullsized":"2024-01-22T05:19:08.120067+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.30","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.118827+0000","last_change":"2024-01-22T05:19:07.662875+0000","last_active":"2024-01-22T05:19:08.118827+0000","last_peered":"2024-01-22T05:19:08.118827+0000","last_clean":"2024-01-22T05:19:08.118827+0000","last_became_active":"2024-01-22T05:19:07.662369+0000","last_became_peered":"2024-01-22T05:19:07.662369+0000","last_unstale":"2024-01-22T05:19:08.118827+0000","last_undegraded":"2024-01-22T05:19:08.118827+0000","last_fullsized":"2024-01-22T05:19:08.118827+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117083+0000","last_change":"2024-01-22T05:19:08.103341+0000","last_active":"2024-01-22T05:19:08.117083+0000","last_peered":"2024-01-22T05:19:08.117083+0000","last_clean":"2024-01-22T05:19:08.117083+0000","last_became_active":"2024-01-22T05:19:08.103044+0000","last_became_peered":"2024-01-22T05:19:08.103044+0000","last_unstale":"2024-01-22T05:19:08.117083+0000","last_undegraded":"2024-01-22T05:19:08.117083+0000","last_fullsized":"2024-01-22T05:19:08.117083+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.092456+0000","last_change":"2024-01-22T05:19:07.668441+0000","last_active":"2024-01-22T05:19:08.092456+0000","last_peered":"2024-01-22T05:19:08.092456+0000","last_clean":"2024-01-22T05:19:08.092456+0000","last_became_active":"2024-01-22T05:19:07.668160+0000","last_became_peered":"2024-01-22T05:19:07.668160+0000","last_unstale":"2024-01-22T05:19:08.092456+0000","last_undegraded":"2024-01-22T05:19:08.092456+0000","last_fullsized":"2024-01-22T05:19:08.092456+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.113416+0000","last_change":"2024-01-22T05:19:08.107290+0000","last_active":"2024-01-22T05:19:08.113416+0000","last_peered":"2024-01-22T05:19:08.113416+0000","last_clean":"2024-01-22T05:19:08.113416+0000","last_became_active":"2024-01-22T05:19:08.107019+0000","last_became_peered":"2024-01-22T05:19:08.107019+0000","last_unstale":"2024-01-22T05:19:08.113416+0000","last_undegraded":"2024-01-22T05:19:08.113416+0000","last_fullsized":"2024-01-22T05:19:08.113416+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.081618+0000","last_change":"2024-01-22T05:19:07.649987+0000","last_active":"2024-01-22T05:19:08.081618+0000","last_peered":"2024-01-22T05:19:08.081618+0000","last_clean":"2024-01-22T05:19:08.081618+0000","last_became_active":"2024-01-22T05:19:07.649673+0000","last_became_peered":"2024-01-22T05:19:07.649673+0000","last_unstale":"2024-01-22T05:19:08.081618+0000","last_undegraded":"2024-01-22T05:19:08.081618+0000","last_fullsized":"2024-01-22T05:19:08.081618+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.122514+0000","last_change":"2024-01-22T05:19:08.120697+0000","last_active":"2024-01-22T05:19:08.122514+0000","last_peered":"2024-01-22T05:19:08.122514+0000","last_clean":"2024-01-22T05:19:08.122514+0000","last_became_active":"2024-01-22T05:19:08.120328+0000","last_became_peered":"2024-01-22T05:19:08.120328+0000","last_unstale":"2024-01-22T05:19:08.122514+0000","last_undegraded":"2024-01-22T05:19:08.122514+0000","last_fullsized":"2024-01-22T05:19:08.122514+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2d","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.109944+0000","last_change":"2024-01-22T05:19:07.655048+0000","last_active":"2024-01-22T05:19:08.109944+0000","last_peered":"2024-01-22T05:19:08.109944+0000","last_clean":"2024-01-22T05:19:08.109944+0000","last_became_active":"2024-01-22T05:19:07.654764+0000","last_became_peered":"2024-01-22T05:19:07.654764+0000","last_unstale":"2024-01-22T05:19:08.109944+0000","last_undegraded":"2024-01-22T05:19:08.109944+0000","last_fullsized":"2024-01-22T05:19:08.109944+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117175+0000","last_change":"2024-01-22T05:19:08.108885+0000","last_active":"2024-01-22T05:19:08.117175+0000","last_peered":"2024-01-22T05:19:08.117175+0000","last_clean":"2024-01-22T05:19:08.117175+0000","last_became_active":"2024-01-22T05:19:08.108611+0000","last_became_peered":"2024-01-22T05:19:08.108611+0000","last_unstale":"2024-01-22T05:19:08.117175+0000","last_undegraded":"2024-01-22T05:19:08.117175+0000","last_fullsized":"2024-01-22T05:19:08.117175+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.092028+0000","last_change":"2024-01-22T05:19:07.671996+0000","last_active":"2024-01-22T05:19:08.092028+0000","last_peered":"2024-01-22T05:19:08.092028+0000","last_clean":"2024-01-22T05:19:08.092028+0000","last_became_active":"2024-01-22T05:19:07.669870+0000","last_became_peered":"2024-01-22T05:19:07.669870+0000","last_unstale":"2024-01-22T05:19:08.092028+0000","last_undegraded":"2024-01-22T05:19:08.092028+0000","last_fullsized":"2024-01-22T05:19:08.092028+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.109689+0000","last_change":"2024-01-22T05:19:08.102102+0000","last_active":"2024-01-22T05:19:08.109689+0000","last_peered":"2024-01-22T05:19:08.109689+0000","last_clean":"2024-01-22T05:19:08.109689+0000","last_became_active":"2024-01-22T05:19:08.101800+0000","last_became_peered":"2024-01-22T05:19:08.101800+0000","last_unstale":"2024-01-22T05:19:08.109689+0000","last_undegraded":"2024-01-22T05:19:08.109689+0000","last_fullsized":"2024-01-22T05:19:08.109689+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.106054+0000","last_change":"2024-01-22T05:19:07.650195+0000","last_active":"2024-01-22T05:19:08.106054+0000","last_peered":"2024-01-22T05:19:08.106054+0000","last_clean":"2024-01-22T05:19:08.106054+0000","last_became_active":"2024-01-22T05:19:07.648467+0000","last_became_peered":"2024-01-22T05:19:07.648467+0000","last_unstale":"2024-01-22T05:19:08.106054+0000","last_undegraded":"2024-01-22T05:19:08.106054+0000","last_fullsized":"2024-01-22T05:19:08.106054+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110751+0000","last_change":"2024-01-22T05:19:08.108142+0000","last_active":"2024-01-22T05:19:08.110751+0000","last_peered":"2024-01-22T05:19:08.110751+0000","last_clean":"2024-01-22T05:19:08.110751+0000","last_became_active":"2024-01-22T05:19:08.107822+0000","last_became_peered":"2024-01-22T05:19:08.107822+0000","last_unstale":"2024-01-22T05:19:08.110751+0000","last_undegraded":"2024-01-22T05:19:08.110751+0000","last_fullsized":"2024-01-22T05:19:08.110751+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.093978+0000","last_change":"2024-01-22T05:19:07.654513+0000","last_active":"2024-01-22T05:19:08.093978+0000","last_peered":"2024-01-22T05:19:08.093978+0000","last_clean":"2024-01-22T05:19:08.093978+0000","last_became_active":"2024-01-22T05:19:07.654248+0000","last_became_peered":"2024-01-22T05:19:07.654248+0000","last_unstale":"2024-01-22T05:19:08.093978+0000","last_undegraded":"2024-01-22T05:19:08.093978+0000","last_fullsized":"2024-01-22T05:19:08.093978+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110560+0000","last_change":"2024-01-22T05:19:08.107784+0000","last_active":"2024-01-22T05:19:08.110560+0000","last_peered":"2024-01-22T05:19:08.110560+0000","last_clean":"2024-01-22T05:19:08.110560+0000","last_became_active":"2024-01-22T05:19:08.107467+0000","last_became_peered":"2024-01-22T05:19:08.107467+0000","last_unstale":"2024-01-22T05:19:08.110560+0000","last_undegraded":"2024-01-22T05:19:08.110560+0000","last_fullsized":"2024-01-22T05:19:08.110560+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.092082+0000","last_change":"2024-01-22T05:19:07.656150+0000","last_active":"2024-01-22T05:19:08.092082+0000","last_peered":"2024-01-22T05:19:08.092082+0000","last_clean":"2024-01-22T05:19:08.092082+0000","last_became_active":"2024-01-22T05:19:07.655806+0000","last_became_peered":"2024-01-22T05:19:07.655806+0000","last_unstale":"2024-01-22T05:19:08.092082+0000","last_undegraded":"2024-01-22T05:19:08.092082+0000","last_fullsized":"2024-01-22T05:19:08.092082+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.109130+0000","last_change":"2024-01-22T05:19:08.105164+0000","last_active":"2024-01-22T05:19:08.109130+0000","last_peered":"2024-01-22T05:19:08.109130+0000","last_clean":"2024-01-22T05:19:08.109130+0000","last_became_active":"2024-01-22T05:19:08.104882+0000","last_became_peered":"2024-01-22T05:19:08.104882+0000","last_unstale":"2024-01-22T05:19:08.109130+0000","last_undegraded":"2024-01-22T05:19:08.109130+0000","last_fullsized":"2024-01-22T05:19:08.109130+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094631+0000","last_change":"2024-01-22T05:19:07.656269+0000","last_active":"2024-01-22T05:19:08.094631+0000","last_peered":"2024-01-22T05:19:08.094631+0000","last_clean":"2024-01-22T05:19:08.094631+0000","last_became_active":"2024-01-22T05:19:07.655975+0000","last_became_peered":"2024-01-22T05:19:07.655975+0000","last_unstale":"2024-01-22T05:19:08.094631+0000","last_undegraded":"2024-01-22T05:19:08.094631+0000","last_fullsized":"2024-01-22T05:19:08.094631+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110205+0000","last_change":"2024-01-22T05:19:08.101703+0000","last_active":"2024-01-22T05:19:08.110205+0000","last_peered":"2024-01-22T05:19:08.110205+0000","last_clean":"2024-01-22T05:19:08.110205+0000","last_became_active":"2024-01-22T05:19:08.101432+0000","last_became_peered":"2024-01-22T05:19:08.101432+0000","last_unstale":"2024-01-22T05:19:08.110205+0000","last_undegraded":"2024-01-22T05:19:08.110205+0000","last_fullsized":"2024-01-22T05:19:08.110205+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.080556+0000","last_change":"2024-01-22T05:19:07.672992+0000","last_active":"2024-01-22T05:19:08.080556+0000","last_peered":"2024-01-22T05:19:08.080556+0000","last_clean":"2024-01-22T05:19:08.080556+0000","last_became_active":"2024-01-22T05:19:07.672708+0000","last_became_peered":"2024-01-22T05:19:07.672708+0000","last_unstale":"2024-01-22T05:19:08.080556+0000","last_undegraded":"2024-01-22T05:19:08.080556+0000","last_fullsized":"2024-01-22T05:19:08.080556+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110664+0000","last_change":"2024-01-22T05:19:08.103409+0000","last_active":"2024-01-22T05:19:08.110664+0000","last_peered":"2024-01-22T05:19:08.110664+0000","last_clean":"2024-01-22T05:19:08.110664+0000","last_became_active":"2024-01-22T05:19:08.103111+0000","last_became_peered":"2024-01-22T05:19:08.103111+0000","last_unstale":"2024-01-22T05:19:08.110664+0000","last_undegraded":"2024-01-22T05:19:08.110664+0000","last_fullsized":"2024-01-22T05:19:08.110664+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.26","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-01-22T05:19:09.091025+0000","last_change":"2024-01-22T05:19:07.667371+0000","last_active":"2024-01-22T05:19:09.091025+0000","last_peered":"2024-01-22T05:19:09.091025+0000","last_clean":"2024-01-22T05:19:09.091025+0000","last_became_active":"2024-01-22T05:19:07.667040+0000","last_became_peered":"2024-01-22T05:19:07.667040+0000","last_unstale":"2024-01-22T05:19:09.091025+0000","last_undegraded":"2024-01-22T05:19:09.091025+0000","last_fullsized":"2024-01-22T05:19:09.091025+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.112535+0000","last_change":"2024-01-22T05:19:08.106616+0000","last_active":"2024-01-22T05:19:08.112535+0000","last_peered":"2024-01-22T05:19:08.112535+0000","last_clean":"2024-01-22T05:19:08.112535+0000","last_became_active":"2024-01-22T05:19:08.106349+0000","last_became_peered":"2024-01-22T05:19:08.106349+0000","last_unstale":"2024-01-22T05:19:08.112535+0000","last_undegraded":"2024-01-22T05:19:08.112535+0000","last_fullsized":"2024-01-22T05:19:08.112535+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.090170+0000","last_change":"2024-01-22T05:19:07.658712+0000","last_active":"2024-01-22T05:19:08.090170+0000","last_peered":"2024-01-22T05:19:08.090170+0000","last_clean":"2024-01-22T05:19:08.090170+0000","last_became_active":"2024-01-22T05:19:07.658420+0000","last_became_peered":"2024-01-22T05:19:07.658420+0000","last_unstale":"2024-01-22T05:19:08.090170+0000","last_undegraded":"2024-01-22T05:19:08.090170+0000","last_fullsized":"2024-01-22T05:19:08.090170+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.107422+0000","last_change":"2024-01-22T05:19:08.102544+0000","last_active":"2024-01-22T05:19:08.107422+0000","last_peered":"2024-01-22T05:19:08.107422+0000","last_clean":"2024-01-22T05:19:08.107422+0000","last_became_active":"2024-01-22T05:19:08.102244+0000","last_became_peered":"2024-01-22T05:19:08.102244+0000","last_unstale":"2024-01-22T05:19:08.107422+0000","last_undegraded":"2024-01-22T05:19:08.107422+0000","last_fullsized":"2024-01-22T05:19:08.107422+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.092124+0000","last_change":"2024-01-22T05:19:07.671577+0000","last_active":"2024-01-22T05:19:08.092124+0000","last_peered":"2024-01-22T05:19:08.092124+0000","last_clean":"2024-01-22T05:19:08.092124+0000","last_became_active":"2024-01-22T05:19:07.671271+0000","last_became_peered":"2024-01-22T05:19:07.671271+0000","last_unstale":"2024-01-22T05:19:08.092124+0000","last_undegraded":"2024-01-22T05:19:08.092124+0000","last_fullsized":"2024-01-22T05:19:08.092124+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.097328+0000","last_change":"2024-01-22T05:19:08.090067+0000","last_active":"2024-01-22T05:19:08.097328+0000","last_peered":"2024-01-22T05:19:08.097328+0000","last_clean":"2024-01-22T05:19:08.097328+0000","last_became_active":"2024-01-22T05:19:08.089777+0000","last_became_peered":"2024-01-22T05:19:08.089777+0000","last_unstale":"2024-01-22T05:19:08.097328+0000","last_undegraded":"2024-01-22T05:19:08.097328+0000","last_fullsized":"2024-01-22T05:19:08.097328+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.079352+0000","last_change":"2024-01-22T05:19:07.655218+0000","last_active":"2024-01-22T05:19:08.079352+0000","last_peered":"2024-01-22T05:19:08.079352+0000","last_clean":"2024-01-22T05:19:08.079352+0000","last_became_active":"2024-01-22T05:19:07.654869+0000","last_became_peered":"2024-01-22T05:19:07.654869+0000","last_unstale":"2024-01-22T05:19:08.079352+0000","last_undegraded":"2024-01-22T05:19:08.079352+0000","last_fullsized":"2024-01-22T05:19:08.079352+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.108842+0000","last_change":"2024-01-22T05:19:08.103189+0000","last_active":"2024-01-22T05:19:08.108842+0000","last_peered":"2024-01-22T05:19:08.108842+0000","last_clean":"2024-01-22T05:19:08.108842+0000","last_became_active":"2024-01-22T05:19:08.102796+0000","last_became_peered":"2024-01-22T05:19:08.102796+0000","last_unstale":"2024-01-22T05:19:08.108842+0000","last_undegraded":"2024-01-22T05:19:08.108842+0000","last_fullsized":"2024-01-22T05:19:08.108842+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.079528+0000","last_change":"2024-01-22T05:19:07.656104+0000","last_active":"2024-01-22T05:19:08.079528+0000","last_peered":"2024-01-22T05:19:08.079528+0000","last_clean":"2024-01-22T05:19:08.079528+0000","last_became_active":"2024-01-22T05:19:07.655842+0000","last_became_peered":"2024-01-22T05:19:07.655842+0000","last_unstale":"2024-01-22T05:19:08.079528+0000","last_undegraded":"2024-01-22T05:19:08.079528+0000","last_fullsized":"2024-01-22T05:19:08.079528+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.113353+0000","last_change":"2024-01-22T05:19:08.105794+0000","last_active":"2024-01-22T05:19:08.113353+0000","last_peered":"2024-01-22T05:19:08.113353+0000","last_clean":"2024-01-22T05:19:08.113353+0000","last_became_active":"2024-01-22T05:19:08.105425+0000","last_became_peered":"2024-01-22T05:19:08.105425+0000","last_unstale":"2024-01-22T05:19:08.113353+0000","last_undegraded":"2024-01-22T05:19:08.113353+0000","last_fullsized":"2024-01-22T05:19:08.113353+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.079782+0000","last_change":"2024-01-22T05:19:07.661508+0000","last_active":"2024-01-22T05:19:08.079782+0000","last_peered":"2024-01-22T05:19:08.079782+0000","last_clean":"2024-01-22T05:19:08.079782+0000","last_became_active":"2024-01-22T05:19:07.661230+0000","last_became_peered":"2024-01-22T05:19:07.661230+0000","last_unstale":"2024-01-22T05:19:08.079782+0000","last_undegraded":"2024-01-22T05:19:08.079782+0000","last_fullsized":"2024-01-22T05:19:08.079782+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.112725+0000","last_change":"2024-01-22T05:19:08.101524+0000","last_active":"2024-01-22T05:19:08.112725+0000","last_peered":"2024-01-22T05:19:08.112725+0000","last_clean":"2024-01-22T05:19:08.112725+0000","last_became_active":"2024-01-22T05:19:08.101243+0000","last_became_peered":"2024-01-22T05:19:08.101243+0000","last_unstale":"2024-01-22T05:19:08.112725+0000","last_undegraded":"2024-01-22T05:19:08.112725+0000","last_fullsized":"2024-01-22T05:19:08.112725+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.093238+0000","last_change":"2024-01-22T05:19:07.662674+0000","last_active":"2024-01-22T05:19:08.093238+0000","last_peered":"2024-01-22T05:19:08.093238+0000","last_clean":"2024-01-22T05:19:08.093238+0000","last_became_active":"2024-01-22T05:19:07.661955+0000","last_became_peered":"2024-01-22T05:19:07.661955+0000","last_unstale":"2024-01-22T05:19:08.093238+0000","last_undegraded":"2024-01-22T05:19:08.093238+0000","last_fullsized":"2024-01-22T05:19:08.093238+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.107778+0000","last_change":"2024-01-22T05:19:08.101783+0000","last_active":"2024-01-22T05:19:08.107778+0000","last_peered":"2024-01-22T05:19:08.107778+0000","last_clean":"2024-01-22T05:19:08.107778+0000","last_became_active":"2024-01-22T05:19:08.101495+0000","last_became_peered":"2024-01-22T05:19:08.101495+0000","last_unstale":"2024-01-22T05:19:08.107778+0000","last_undegraded":"2024-01-22T05:19:08.107778+0000","last_fullsized":"2024-01-22T05:19:08.107778+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094860+0000","last_change":"2024-01-22T05:19:07.669424+0000","last_active":"2024-01-22T05:19:08.094860+0000","last_peered":"2024-01-22T05:19:08.094860+0000","last_clean":"2024-01-22T05:19:08.094860+0000","last_became_active":"2024-01-22T05:19:07.669031+0000","last_became_peered":"2024-01-22T05:19:07.669031+0000","last_unstale":"2024-01-22T05:19:08.094860+0000","last_undegraded":"2024-01-22T05:19:08.094860+0000","last_fullsized":"2024-01-22T05:19:08.094860+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.111017+0000","last_change":"2024-01-22T05:19:08.101248+0000","last_active":"2024-01-22T05:19:08.111017+0000","last_peered":"2024-01-22T05:19:08.111017+0000","last_clean":"2024-01-22T05:19:08.111017+0000","last_became_active":"2024-01-22T05:19:08.100964+0000","last_became_peered":"2024-01-22T05:19:08.100964+0000","last_unstale":"2024-01-22T05:19:08.111017+0000","last_undegraded":"2024-01-22T05:19:08.111017+0000","last_fullsized":"2024-01-22T05:19:08.111017+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.081575+0000","last_change":"2024-01-22T05:19:07.637578+0000","last_active":"2024-01-22T05:19:08.081575+0000","last_peered":"2024-01-22T05:19:08.081575+0000","last_clean":"2024-01-22T05:19:08.081575+0000","last_became_active":"2024-01-22T05:19:07.636741+0000","last_became_peered":"2024-01-22T05:19:07.636741+0000","last_unstale":"2024-01-22T05:19:08.081575+0000","last_undegraded":"2024-01-22T05:19:08.081575+0000","last_fullsized":"2024-01-22T05:19:08.081575+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.108083+0000","last_change":"2024-01-22T05:19:08.104706+0000","last_active":"2024-01-22T05:19:08.108083+0000","last_peered":"2024-01-22T05:19:08.108083+0000","last_clean":"2024-01-22T05:19:08.108083+0000","last_became_active":"2024-01-22T05:19:08.104347+0000","last_became_peered":"2024-01-22T05:19:08.104347+0000","last_unstale":"2024-01-22T05:19:08.108083+0000","last_undegraded":"2024-01-22T05:19:08.108083+0000","last_fullsized":"2024-01-22T05:19:08.108083+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"183'3","reported_seq":13,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.115625+0000","last_change":"2024-01-22T05:19:07.665545+0000","last_active":"2024-01-22T05:19:08.115625+0000","last_peered":"2024-01-22T05:19:08.115625+0000","last_clean":"2024-01-22T05:19:08.115625+0000","last_became_active":"2024-01-22T05:19:07.665244+0000","last_became_peered":"2024-01-22T05:19:07.665244+0000","last_unstale":"2024-01-22T05:19:08.115625+0000","last_undegraded":"2024-01-22T05:19:08.115625+0000","last_fullsized":"2024-01-22T05:19:08.115625+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.118698+0000","last_change":"2024-01-22T05:19:08.112006+0000","last_active":"2024-01-22T05:19:08.118698+0000","last_peered":"2024-01-22T05:19:08.118698+0000","last_clean":"2024-01-22T05:19:08.118698+0000","last_became_active":"2024-01-22T05:19:08.111731+0000","last_became_peered":"2024-01-22T05:19:08.111731+0000","last_unstale":"2024-01-22T05:19:08.118698+0000","last_undegraded":"2024-01-22T05:19:08.118698+0000","last_fullsized":"2024-01-22T05:19:08.118698+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.108974+0000","last_change":"2024-01-22T05:19:07.653326+0000","last_active":"2024-01-22T05:19:08.108974+0000","last_peered":"2024-01-22T05:19:08.108974+0000","last_clean":"2024-01-22T05:19:08.108974+0000","last_became_active":"2024-01-22T05:19:07.653033+0000","last_became_peered":"2024-01-22T05:19:07.653033+0000","last_unstale":"2024-01-22T05:19:08.108974+0000","last_undegraded":"2024-01-22T05:19:08.108974+0000","last_fullsized":"2024-01-22T05:19:08.108974+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.123382+0000","last_change":"2024-01-22T05:19:08.120922+0000","last_active":"2024-01-22T05:19:08.123382+0000","last_peered":"2024-01-22T05:19:08.123382+0000","last_clean":"2024-01-22T05:19:08.123382+0000","last_became_active":"2024-01-22T05:19:08.120325+0000","last_became_peered":"2024-01-22T05:19:08.120325+0000","last_unstale":"2024-01-22T05:19:08.123382+0000","last_undegraded":"2024-01-22T05:19:08.123382+0000","last_fullsized":"2024-01-22T05:19:08.123382+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.105890+0000","last_change":"2024-01-22T05:19:07.652901+0000","last_active":"2024-01-22T05:19:08.105890+0000","last_peered":"2024-01-22T05:19:08.105890+0000","last_clean":"2024-01-22T05:19:08.105890+0000","last_became_active":"2024-01-22T05:19:07.652390+0000","last_became_peered":"2024-01-22T05:19:07.652390+0000","last_unstale":"2024-01-22T05:19:08.105890+0000","last_undegraded":"2024-01-22T05:19:08.105890+0000","last_fullsized":"2024-01-22T05:19:08.105890+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117380+0000","last_change":"2024-01-22T05:19:08.110361+0000","last_active":"2024-01-22T05:19:08.117380+0000","last_peered":"2024-01-22T05:19:08.117380+0000","last_clean":"2024-01-22T05:19:08.117380+0000","last_became_active":"2024-01-22T05:19:08.110106+0000","last_became_peered":"2024-01-22T05:19:08.110106+0000","last_unstale":"2024-01-22T05:19:08.117380+0000","last_undegraded":"2024-01-22T05:19:08.117380+0000","last_fullsized":"2024-01-22T05:19:08.117380+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.081286+0000","last_change":"2024-01-22T05:19:07.654238+0000","last_active":"2024-01-22T05:19:08.081286+0000","last_peered":"2024-01-22T05:19:08.081286+0000","last_clean":"2024-01-22T05:19:08.081286+0000","last_became_active":"2024-01-22T05:19:07.653955+0000","last_became_peered":"2024-01-22T05:19:07.653955+0000","last_unstale":"2024-01-22T05:19:08.081286+0000","last_undegraded":"2024-01-22T05:19:08.081286+0000","last_fullsized":"2024-01-22T05:19:08.081286+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.114393+0000","last_change":"2024-01-22T05:19:08.108649+0000","last_active":"2024-01-22T05:19:08.114393+0000","last_peered":"2024-01-22T05:19:08.114393+0000","last_clean":"2024-01-22T05:19:08.114393+0000","last_became_active":"2024-01-22T05:19:08.108186+0000","last_became_peered":"2024-01-22T05:19:08.108186+0000","last_unstale":"2024-01-22T05:19:08.114393+0000","last_undegraded":"2024-01-22T05:19:08.114393+0000","last_fullsized":"2024-01-22T05:19:08.114393+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.089608+0000","last_change":"2024-01-22T05:19:07.660725+0000","last_active":"2024-01-22T05:19:08.089608+0000","last_peered":"2024-01-22T05:19:08.089608+0000","last_clean":"2024-01-22T05:19:08.089608+0000","last_became_active":"2024-01-22T05:19:07.660417+0000","last_became_peered":"2024-01-22T05:19:07.660417+0000","last_unstale":"2024-01-22T05:19:08.089608+0000","last_undegraded":"2024-01-22T05:19:08.089608+0000","last_fullsized":"2024-01-22T05:19:08.089608+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117485+0000","last_change":"2024-01-22T05:19:08.108355+0000","last_active":"2024-01-22T05:19:08.117485+0000","last_peered":"2024-01-22T05:19:08.117485+0000","last_clean":"2024-01-22T05:19:08.117485+0000","last_became_active":"2024-01-22T05:19:08.108099+0000","last_became_peered":"2024-01-22T05:19:08.108099+0000","last_unstale":"2024-01-22T05:19:08.117485+0000","last_undegraded":"2024-01-22T05:19:08.117485+0000","last_fullsized":"2024-01-22T05:19:08.117485+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"183'4","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.113791+0000","last_change":"2024-01-22T05:19:07.667771+0000","last_active":"2024-01-22T05:19:08.113791+0000","last_peered":"2024-01-22T05:19:08.113791+0000","last_clean":"2024-01-22T05:19:08.113791+0000","last_became_active":"2024-01-22T05:19:07.667502+0000","last_became_peered":"2024-01-22T05:19:07.667502+0000","last_unstale":"2024-01-22T05:19:08.113791+0000","last_undegraded":"2024-01-22T05:19:08.113791+0000","last_fullsized":"2024-01-22T05:19:08.113791+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.099030+0000","last_change":"2024-01-22T05:19:08.090714+0000","last_active":"2024-01-22T05:19:08.099030+0000","last_peered":"2024-01-22T05:19:08.099030+0000","last_clean":"2024-01-22T05:19:08.099030+0000","last_became_active":"2024-01-22T05:19:08.088222+0000","last_became_peered":"2024-01-22T05:19:08.088222+0000","last_unstale":"2024-01-22T05:19:08.099030+0000","last_undegraded":"2024-01-22T05:19:08.099030+0000","last_fullsized":"2024-01-22T05:19:08.099030+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.120403+0000","last_change":"2024-01-22T05:19:07.673987+0000","last_active":"2024-01-22T05:19:08.120403+0000","last_peered":"2024-01-22T05:19:08.120403+0000","last_clean":"2024-01-22T05:19:08.120403+0000","last_became_active":"2024-01-22T05:19:07.673724+0000","last_became_peered":"2024-01-22T05:19:07.673724+0000","last_unstale":"2024-01-22T05:19:08.120403+0000","last_undegraded":"2024-01-22T05:19:08.120403+0000","last_fullsized":"2024-01-22T05:19:08.120403+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110802+0000","last_change":"2024-01-22T05:19:08.104127+0000","last_active":"2024-01-22T05:19:08.110802+0000","last_peered":"2024-01-22T05:19:08.110802+0000","last_clean":"2024-01-22T05:19:08.110802+0000","last_became_active":"2024-01-22T05:19:08.103848+0000","last_became_peered":"2024-01-22T05:19:08.103848+0000","last_unstale":"2024-01-22T05:19:08.110802+0000","last_undegraded":"2024-01-22T05:19:08.110802+0000","last_fullsized":"2024-01-22T05:19:08.110802+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.113436+0000","last_change":"2024-01-22T05:19:07.667361+0000","last_active":"2024-01-22T05:19:08.113436+0000","last_peered":"2024-01-22T05:19:08.113436+0000","last_clean":"2024-01-22T05:19:08.113436+0000","last_became_active":"2024-01-22T05:19:07.667056+0000","last_became_peered":"2024-01-22T05:19:07.667056+0000","last_unstale":"2024-01-22T05:19:08.113436+0000","last_undegraded":"2024-01-22T05:19:08.113436+0000","last_fullsized":"2024-01-22T05:19:08.113436+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.099964+0000","last_change":"2024-01-22T05:19:08.093695+0000","last_active":"2024-01-22T05:19:08.099964+0000","last_peered":"2024-01-22T05:19:08.099964+0000","last_clean":"2024-01-22T05:19:08.099964+0000","last_became_active":"2024-01-22T05:19:08.093396+0000","last_became_peered":"2024-01-22T05:19:08.093396+0000","last_unstale":"2024-01-22T05:19:08.099964+0000","last_undegraded":"2024-01-22T05:19:08.099964+0000","last_fullsized":"2024-01-22T05:19:08.099964+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.091300+0000","last_change":"2024-01-22T05:19:07.670213+0000","last_active":"2024-01-22T05:19:08.091300+0000","last_peered":"2024-01-22T05:19:08.091300+0000","last_clean":"2024-01-22T05:19:08.091300+0000","last_became_active":"2024-01-22T05:19:07.669903+0000","last_became_peered":"2024-01-22T05:19:07.669903+0000","last_unstale":"2024-01-22T05:19:08.091300+0000","last_undegraded":"2024-01-22T05:19:08.091300+0000","last_fullsized":"2024-01-22T05:19:08.091300+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117630+0000","last_change":"2024-01-22T05:19:08.114287+0000","last_active":"2024-01-22T05:19:08.117630+0000","last_peered":"2024-01-22T05:19:08.117630+0000","last_clean":"2024-01-22T05:19:08.117630+0000","last_became_active":"2024-01-22T05:19:08.114015+0000","last_became_peered":"2024-01-22T05:19:08.114015+0000","last_unstale":"2024-01-22T05:19:08.117630+0000","last_undegraded":"2024-01-22T05:19:08.117630+0000","last_fullsized":"2024-01-22T05:19:08.117630+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.080962+0000","last_change":"2024-01-22T05:19:07.664586+0000","last_active":"2024-01-22T05:19:08.080962+0000","last_peered":"2024-01-22T05:19:08.080962+0000","last_clean":"2024-01-22T05:19:08.080962+0000","last_became_active":"2024-01-22T05:19:07.664286+0000","last_became_peered":"2024-01-22T05:19:07.664286+0000","last_unstale":"2024-01-22T05:19:08.080962+0000","last_undegraded":"2024-01-22T05:19:08.080962+0000","last_fullsized":"2024-01-22T05:19:08.080962+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.122568+0000","last_change":"2024-01-22T05:19:08.119871+0000","last_active":"2024-01-22T05:19:08.122568+0000","last_peered":"2024-01-22T05:19:08.122568+0000","last_clean":"2024-01-22T05:19:08.122568+0000","last_became_active":"2024-01-22T05:19:08.119624+0000","last_became_peered":"2024-01-22T05:19:08.119624+0000","last_unstale":"2024-01-22T05:19:08.122568+0000","last_undegraded":"2024-01-22T05:19:08.122568+0000","last_fullsized":"2024-01-22T05:19:08.122568+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.114072+0000","last_change":"2024-01-22T05:19:07.666365+0000","last_active":"2024-01-22T05:19:08.114072+0000","last_peered":"2024-01-22T05:19:08.114072+0000","last_clean":"2024-01-22T05:19:08.114072+0000","last_became_active":"2024-01-22T05:19:07.666092+0000","last_became_peered":"2024-01-22T05:19:07.666092+0000","last_unstale":"2024-01-22T05:19:08.114072+0000","last_undegraded":"2024-01-22T05:19:08.114072+0000","last_fullsized":"2024-01-22T05:19:08.114072+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.112378+0000","last_change":"2024-01-22T05:19:08.106605+0000","last_active":"2024-01-22T05:19:08.112378+0000","last_peered":"2024-01-22T05:19:08.112378+0000","last_clean":"2024-01-22T05:19:08.112378+0000","last_became_active":"2024-01-22T05:19:08.106327+0000","last_became_peered":"2024-01-22T05:19:08.106327+0000","last_unstale":"2024-01-22T05:19:08.112378+0000","last_undegraded":"2024-01-22T05:19:08.112378+0000","last_fullsized":"2024-01-22T05:19:08.112378+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.099032+0000","last_change":"2024-01-22T05:19:07.638691+0000","last_active":"2024-01-22T05:19:08.099032+0000","last_peered":"2024-01-22T05:19:08.099032+0000","last_clean":"2024-01-22T05:19:08.099032+0000","last_became_active":"2024-01-22T05:19:07.635620+0000","last_became_peered":"2024-01-22T05:19:07.635620+0000","last_unstale":"2024-01-22T05:19:08.099032+0000","last_undegraded":"2024-01-22T05:19:08.099032+0000","last_fullsized":"2024-01-22T05:19:08.099032+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.088612+0000","last_change":"2024-01-22T05:19:08.083410+0000","last_active":"2024-01-22T05:19:08.088612+0000","last_peered":"2024-01-22T05:19:08.088612+0000","last_clean":"2024-01-22T05:19:08.088612+0000","last_became_active":"2024-01-22T05:19:08.083072+0000","last_became_peered":"2024-01-22T05:19:08.083072+0000","last_unstale":"2024-01-22T05:19:08.088612+0000","last_undegraded":"2024-01-22T05:19:08.088612+0000","last_fullsized":"2024-01-22T05:19:08.088612+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.097875+0000","last_change":"2024-01-22T05:19:07.649462+0000","last_active":"2024-01-22T05:19:08.097875+0000","last_peered":"2024-01-22T05:19:08.097875+0000","last_clean":"2024-01-22T05:19:08.097875+0000","last_became_active":"2024-01-22T05:19:07.649182+0000","last_became_peered":"2024-01-22T05:19:07.649182+0000","last_unstale":"2024-01-22T05:19:08.097875+0000","last_undegraded":"2024-01-22T05:19:08.097875+0000","last_fullsized":"2024-01-22T05:19:08.097875+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.108800+0000","last_change":"2024-01-22T05:19:08.098506+0000","last_active":"2024-01-22T05:19:08.108800+0000","last_peered":"2024-01-22T05:19:08.108800+0000","last_clean":"2024-01-22T05:19:08.108800+0000","last_became_active":"2024-01-22T05:19:08.098232+0000","last_became_peered":"2024-01-22T05:19:08.098232+0000","last_unstale":"2024-01-22T05:19:08.108800+0000","last_undegraded":"2024-01-22T05:19:08.108800+0000","last_fullsized":"2024-01-22T05:19:08.108800+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094729+0000","last_change":"2024-01-22T05:19:07.673127+0000","last_active":"2024-01-22T05:19:08.094729+0000","last_peered":"2024-01-22T05:19:08.094729+0000","last_clean":"2024-01-22T05:19:08.094729+0000","last_became_active":"2024-01-22T05:19:07.672849+0000","last_became_peered":"2024-01-22T05:19:07.672849+0000","last_unstale":"2024-01-22T05:19:08.094729+0000","last_undegraded":"2024-01-22T05:19:08.094729+0000","last_fullsized":"2024-01-22T05:19:08.094729+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.109873+0000","last_change":"2024-01-22T05:19:08.103601+0000","last_active":"2024-01-22T05:19:08.109873+0000","last_peered":"2024-01-22T05:19:08.109873+0000","last_clean":"2024-01-22T05:19:08.109873+0000","last_became_active":"2024-01-22T05:19:08.102826+0000","last_became_peered":"2024-01-22T05:19:08.102826+0000","last_unstale":"2024-01-22T05:19:08.109873+0000","last_undegraded":"2024-01-22T05:19:08.109873+0000","last_fullsized":"2024-01-22T05:19:08.109873+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.110785+0000","last_change":"2024-01-22T05:19:07.663194+0000","last_active":"2024-01-22T05:19:08.110785+0000","last_peered":"2024-01-22T05:19:08.110785+0000","last_clean":"2024-01-22T05:19:08.110785+0000","last_became_active":"2024-01-22T05:19:07.662920+0000","last_became_peered":"2024-01-22T05:19:07.662920+0000","last_unstale":"2024-01-22T05:19:08.110785+0000","last_undegraded":"2024-01-22T05:19:08.110785+0000","last_fullsized":"2024-01-22T05:19:08.110785+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.119776+0000","last_change":"2024-01-22T05:19:08.115826+0000","last_active":"2024-01-22T05:19:08.119776+0000","last_peered":"2024-01-22T05:19:08.119776+0000","last_clean":"2024-01-22T05:19:08.119776+0000","last_became_active":"2024-01-22T05:19:08.115563+0000","last_became_peered":"2024-01-22T05:19:08.115563+0000","last_unstale":"2024-01-22T05:19:08.119776+0000","last_undegraded":"2024-01-22T05:19:08.119776+0000","last_fullsized":"2024-01-22T05:19:08.119776+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.090249+0000","last_change":"2024-01-22T05:19:07.653389+0000","last_active":"2024-01-22T05:19:08.090249+0000","last_peered":"2024-01-22T05:19:08.090249+0000","last_clean":"2024-01-22T05:19:08.090249+0000","last_became_active":"2024-01-22T05:19:07.653107+0000","last_became_peered":"2024-01-22T05:19:07.653107+0000","last_unstale":"2024-01-22T05:19:08.090249+0000","last_undegraded":"2024-01-22T05:19:08.090249+0000","last_fullsized":"2024-01-22T05:19:08.090249+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.108028+0000","last_change":"2024-01-22T05:19:08.100660+0000","last_active":"2024-01-22T05:19:08.108028+0000","last_peered":"2024-01-22T05:19:08.108028+0000","last_clean":"2024-01-22T05:19:08.108028+0000","last_became_active":"2024-01-22T05:19:08.100384+0000","last_became_peered":"2024-01-22T05:19:08.100384+0000","last_unstale":"2024-01-22T05:19:08.108028+0000","last_undegraded":"2024-01-22T05:19:08.108028+0000","last_fullsized":"2024-01-22T05:19:08.108028+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.093737+0000","last_change":"2024-01-22T05:19:07.674870+0000","last_active":"2024-01-22T05:19:08.093737+0000","last_peered":"2024-01-22T05:19:08.093737+0000","last_clean":"2024-01-22T05:19:08.093737+0000","last_became_active":"2024-01-22T05:19:07.674587+0000","last_became_peered":"2024-01-22T05:19:07.674587+0000","last_unstale":"2024-01-22T05:19:08.093737+0000","last_undegraded":"2024-01-22T05:19:08.093737+0000","last_fullsized":"2024-01-22T05:19:08.093737+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.108885+0000","last_change":"2024-01-22T05:19:08.105909+0000","last_active":"2024-01-22T05:19:08.108885+0000","last_peered":"2024-01-22T05:19:08.108885+0000","last_clean":"2024-01-22T05:19:08.108885+0000","last_became_active":"2024-01-22T05:19:08.105599+0000","last_became_peered":"2024-01-22T05:19:08.105599+0000","last_unstale":"2024-01-22T05:19:08.108885+0000","last_undegraded":"2024-01-22T05:19:08.108885+0000","last_fullsized":"2024-01-22T05:19:08.108885+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.080927+0000","last_change":"2024-01-22T05:19:07.658170+0000","last_active":"2024-01-22T05:19:08.080927+0000","last_peered":"2024-01-22T05:19:08.080927+0000","last_clean":"2024-01-22T05:19:08.080927+0000","last_became_active":"2024-01-22T05:19:07.655485+0000","last_became_peered":"2024-01-22T05:19:07.655485+0000","last_unstale":"2024-01-22T05:19:08.080927+0000","last_undegraded":"2024-01-22T05:19:08.080927+0000","last_fullsized":"2024-01-22T05:19:08.080927+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117726+0000","last_change":"2024-01-22T05:19:08.109690+0000","last_active":"2024-01-22T05:19:08.117726+0000","last_peered":"2024-01-22T05:19:08.117726+0000","last_clean":"2024-01-22T05:19:08.117726+0000","last_became_active":"2024-01-22T05:19:08.109382+0000","last_became_peered":"2024-01-22T05:19:08.109382+0000","last_unstale":"2024-01-22T05:19:08.117726+0000","last_undegraded":"2024-01-22T05:19:08.117726+0000","last_fullsized":"2024-01-22T05:19:08.117726+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.089675+0000","last_change":"2024-01-22T05:19:07.656175+0000","last_active":"2024-01-22T05:19:08.089675+0000","last_peered":"2024-01-22T05:19:08.089675+0000","last_clean":"2024-01-22T05:19:08.089675+0000","last_became_active":"2024-01-22T05:19:07.655925+0000","last_became_peered":"2024-01-22T05:19:07.655925+0000","last_unstale":"2024-01-22T05:19:08.089675+0000","last_undegraded":"2024-01-22T05:19:08.089675+0000","last_fullsized":"2024-01-22T05:19:08.089675+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.111797+0000","last_change":"2024-01-22T05:19:08.110545+0000","last_active":"2024-01-22T05:19:08.111797+0000","last_peered":"2024-01-22T05:19:08.111797+0000","last_clean":"2024-01-22T05:19:08.111797+0000","last_became_active":"2024-01-22T05:19:08.110230+0000","last_became_peered":"2024-01-22T05:19:08.110230+0000","last_unstale":"2024-01-22T05:19:08.111797+0000","last_undegraded":"2024-01-22T05:19:08.111797+0000","last_fullsized":"2024-01-22T05:19:08.111797+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.093871+0000","last_change":"2024-01-22T05:19:07.673375+0000","last_active":"2024-01-22T05:19:08.093871+0000","last_peered":"2024-01-22T05:19:08.093871+0000","last_clean":"2024-01-22T05:19:08.093871+0000","last_became_active":"2024-01-22T05:19:07.672880+0000","last_became_peered":"2024-01-22T05:19:07.672880+0000","last_unstale":"2024-01-22T05:19:08.093871+0000","last_undegraded":"2024-01-22T05:19:08.093871+0000","last_fullsized":"2024-01-22T05:19:08.093871+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.114376+0000","last_change":"2024-01-22T05:19:08.108472+0000","last_active":"2024-01-22T05:19:08.114376+0000","last_peered":"2024-01-22T05:19:08.114376+0000","last_clean":"2024-01-22T05:19:08.114376+0000","last_became_active":"2024-01-22T05:19:08.108159+0000","last_became_peered":"2024-01-22T05:19:08.108159+0000","last_unstale":"2024-01-22T05:19:08.114376+0000","last_undegraded":"2024-01-22T05:19:08.114376+0000","last_fullsized":"2024-01-22T05:19:08.114376+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.081012+0000","last_change":"2024-01-22T05:19:07.639511+0000","last_active":"2024-01-22T05:19:08.081012+0000","last_peered":"2024-01-22T05:19:08.081012+0000","last_clean":"2024-01-22T05:19:08.081012+0000","last_became_active":"2024-01-22T05:19:07.639209+0000","last_became_peered":"2024-01-22T05:19:07.639209+0000","last_unstale":"2024-01-22T05:19:08.081012+0000","last_undegraded":"2024-01-22T05:19:08.081012+0000","last_fullsized":"2024-01-22T05:19:08.081012+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.102224+0000","last_change":"2024-01-22T05:19:08.096650+0000","last_active":"2024-01-22T05:19:08.102224+0000","last_peered":"2024-01-22T05:19:08.102224+0000","last_clean":"2024-01-22T05:19:08.102224+0000","last_became_active":"2024-01-22T05:19:08.096368+0000","last_became_peered":"2024-01-22T05:19:08.096368+0000","last_unstale":"2024-01-22T05:19:08.102224+0000","last_undegraded":"2024-01-22T05:19:08.102224+0000","last_fullsized":"2024-01-22T05:19:08.102224+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.087986+0000","last_change":"2024-01-22T05:19:07.646932+0000","last_active":"2024-01-22T05:19:08.087986+0000","last_peered":"2024-01-22T05:19:08.087986+0000","last_clean":"2024-01-22T05:19:08.087986+0000","last_became_active":"2024-01-22T05:19:07.646654+0000","last_became_peered":"2024-01-22T05:19:07.646654+0000","last_unstale":"2024-01-22T05:19:08.087986+0000","last_undegraded":"2024-01-22T05:19:08.087986+0000","last_fullsized":"2024-01-22T05:19:08.087986+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.092518+0000","last_change":"2024-01-22T05:19:08.085441+0000","last_active":"2024-01-22T05:19:08.092518+0000","last_peered":"2024-01-22T05:19:08.092518+0000","last_clean":"2024-01-22T05:19:08.092518+0000","last_became_active":"2024-01-22T05:19:08.085053+0000","last_became_peered":"2024-01-22T05:19:08.085053+0000","last_unstale":"2024-01-22T05:19:08.092518+0000","last_undegraded":"2024-01-22T05:19:08.092518+0000","last_fullsized":"2024-01-22T05:19:08.092518+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.103184+0000","last_change":"2024-01-22T05:19:07.644729+0000","last_active":"2024-01-22T05:19:08.103184+0000","last_peered":"2024-01-22T05:19:08.103184+0000","last_clean":"2024-01-22T05:19:08.103184+0000","last_became_active":"2024-01-22T05:19:07.642034+0000","last_became_peered":"2024-01-22T05:19:07.642034+0000","last_unstale":"2024-01-22T05:19:08.103184+0000","last_undegraded":"2024-01-22T05:19:08.103184+0000","last_fullsized":"2024-01-22T05:19:08.103184+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":150,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.091348+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:19:08.091348+0000","last_peered":"2024-01-22T05:19:08.091348+0000","last_clean":"2024-01-22T05:19:08.091348+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:19:08.091348+0000","last_undegraded":"2024-01-22T05:19:08.091348+0000","last_fullsized":"2024-01-22T05:19:08.091348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.105832+0000","last_change":"2024-01-22T05:19:08.097395+0000","last_active":"2024-01-22T05:19:08.105832+0000","last_peered":"2024-01-22T05:19:08.105832+0000","last_clean":"2024-01-22T05:19:08.105832+0000","last_became_active":"2024-01-22T05:19:08.097117+0000","last_became_peered":"2024-01-22T05:19:08.097117+0000","last_unstale":"2024-01-22T05:19:08.105832+0000","last_undegraded":"2024-01-22T05:19:08.105832+0000","last_fullsized":"2024-01-22T05:19:08.105832+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.096832+0000","last_change":"2024-01-22T05:19:07.650218+0000","last_active":"2024-01-22T05:19:08.096832+0000","last_peered":"2024-01-22T05:19:08.096832+0000","last_clean":"2024-01-22T05:19:08.096832+0000","last_became_active":"2024-01-22T05:19:07.649606+0000","last_became_peered":"2024-01-22T05:19:07.649606+0000","last_unstale":"2024-01-22T05:19:08.096832+0000","last_undegraded":"2024-01-22T05:19:08.096832+0000","last_fullsized":"2024-01-22T05:19:08.096832+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":155,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.093995+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:19:08.093995+0000","last_peered":"2024-01-22T05:19:08.093995+0000","last_clean":"2024-01-22T05:19:08.093995+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:19:08.093995+0000","last_undegraded":"2024-01-22T05:19:08.093995+0000","last_fullsized":"2024-01-22T05:19:08.093995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.113374+0000","last_change":"2024-01-22T05:19:08.107188+0000","last_active":"2024-01-22T05:19:08.113374+0000","last_peered":"2024-01-22T05:19:08.113374+0000","last_clean":"2024-01-22T05:19:08.113374+0000","last_became_active":"2024-01-22T05:19:08.106919+0000","last_became_peered":"2024-01-22T05:19:08.106919+0000","last_unstale":"2024-01-22T05:19:08.113374+0000","last_undegraded":"2024-01-22T05:19:08.113374+0000","last_fullsized":"2024-01-22T05:19:08.113374+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"183'2","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.114878+0000","last_change":"2024-01-22T05:19:07.667134+0000","last_active":"2024-01-22T05:19:08.114878+0000","last_peered":"2024-01-22T05:19:08.114878+0000","last_clean":"2024-01-22T05:19:08.114878+0000","last_became_active":"2024-01-22T05:19:07.666847+0000","last_became_peered":"2024-01-22T05:19:07.666847+0000","last_unstale":"2024-01-22T05:19:08.114878+0000","last_undegraded":"2024-01-22T05:19:08.114878+0000","last_fullsized":"2024-01-22T05:19:08.114878+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":144,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.092136+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:19:08.092136+0000","last_peered":"2024-01-22T05:19:08.092136+0000","last_clean":"2024-01-22T05:19:08.092136+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:19:08.092136+0000","last_undegraded":"2024-01-22T05:19:08.092136+0000","last_fullsized":"2024-01-22T05:19:08.092136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117648+0000","last_change":"2024-01-22T05:19:08.114417+0000","last_active":"2024-01-22T05:19:08.117648+0000","last_peered":"2024-01-22T05:19:08.117648+0000","last_clean":"2024-01-22T05:19:08.117648+0000","last_became_active":"2024-01-22T05:19:08.114118+0000","last_became_peered":"2024-01-22T05:19:08.114118+0000","last_unstale":"2024-01-22T05:19:08.117648+0000","last_undegraded":"2024-01-22T05:19:08.117648+0000","last_fullsized":"2024-01-22T05:19:08.117648+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094678+0000","last_change":"2024-01-22T05:19:07.659047+0000","last_active":"2024-01-22T05:19:08.094678+0000","last_peered":"2024-01-22T05:19:08.094678+0000","last_clean":"2024-01-22T05:19:08.094678+0000","last_became_active":"2024-01-22T05:19:07.658127+0000","last_became_peered":"2024-01-22T05:19:07.658127+0000","last_unstale":"2024-01-22T05:19:08.094678+0000","last_undegraded":"2024-01-22T05:19:08.094678+0000","last_fullsized":"2024-01-22T05:19:08.094678+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":155,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094483+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:19:08.094483+0000","last_peered":"2024-01-22T05:19:08.094483+0000","last_clean":"2024-01-22T05:19:08.094483+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:19:08.094483+0000","last_undegraded":"2024-01-22T05:19:08.094483+0000","last_fullsized":"2024-01-22T05:19:08.094483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.109462+0000","last_change":"2024-01-22T05:19:08.106088+0000","last_active":"2024-01-22T05:19:08.109462+0000","last_peered":"2024-01-22T05:19:08.109462+0000","last_clean":"2024-01-22T05:19:08.109462+0000","last_became_active":"2024-01-22T05:19:08.105814+0000","last_became_peered":"2024-01-22T05:19:08.105814+0000","last_unstale":"2024-01-22T05:19:08.109462+0000","last_undegraded":"2024-01-22T05:19:08.109462+0000","last_fullsized":"2024-01-22T05:19:08.109462+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.094068+0000","last_change":"2024-01-22T05:19:07.664950+0000","last_active":"2024-01-22T05:19:08.094068+0000","last_peered":"2024-01-22T05:19:08.094068+0000","last_clean":"2024-01-22T05:19:08.094068+0000","last_became_active":"2024-01-22T05:19:07.664413+0000","last_became_peered":"2024-01-22T05:19:07.664413+0000","last_unstale":"2024-01-22T05:19:08.094068+0000","last_undegraded":"2024-01-22T05:19:08.094068+0000","last_fullsized":"2024-01-22T05:19:08.094068+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.079557+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:19:08.079557+0000","last_peered":"2024-01-22T05:19:08.079557+0000","last_clean":"2024-01-22T05:19:08.079557+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:19:08.079557+0000","last_undegraded":"2024-01-22T05:19:08.079557+0000","last_fullsized":"2024-01-22T05:19:08.079557+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.118163+0000","last_change":"2024-01-22T05:19:08.104533+0000","last_active":"2024-01-22T05:19:08.118163+0000","last_peered":"2024-01-22T05:19:08.118163+0000","last_clean":"2024-01-22T05:19:08.118163+0000","last_became_active":"2024-01-22T05:19:08.104242+0000","last_became_peered":"2024-01-22T05:19:08.104242+0000","last_unstale":"2024-01-22T05:19:08.118163+0000","last_undegraded":"2024-01-22T05:19:08.118163+0000","last_fullsized":"2024-01-22T05:19:08.118163+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.093434+0000","last_change":"2024-01-22T05:19:07.673651+0000","last_active":"2024-01-22T05:19:08.093434+0000","last_peered":"2024-01-22T05:19:08.093434+0000","last_clean":"2024-01-22T05:19:08.093434+0000","last_became_active":"2024-01-22T05:19:07.673373+0000","last_became_peered":"2024-01-22T05:19:07.673373+0000","last_unstale":"2024-01-22T05:19:08.093434+0000","last_undegraded":"2024-01-22T05:19:08.093434+0000","last_fullsized":"2024-01-22T05:19:08.093434+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":153,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.080204+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:19:08.080204+0000","last_peered":"2024-01-22T05:19:08.080204+0000","last_clean":"2024-01-22T05:19:08.080204+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:19:08.080204+0000","last_undegraded":"2024-01-22T05:19:08.080204+0000","last_fullsized":"2024-01-22T05:19:08.080204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.111393+0000","last_change":"2024-01-22T05:19:08.109868+0000","last_active":"2024-01-22T05:19:08.111393+0000","last_peered":"2024-01-22T05:19:08.111393+0000","last_clean":"2024-01-22T05:19:08.111393+0000","last_became_active":"2024-01-22T05:19:08.109574+0000","last_became_peered":"2024-01-22T05:19:08.109574+0000","last_unstale":"2024-01-22T05:19:08.111393+0000","last_undegraded":"2024-01-22T05:19:08.111393+0000","last_fullsized":"2024-01-22T05:19:08.111393+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.078986+0000","last_change":"2024-01-22T05:19:07.657425+0000","last_active":"2024-01-22T05:19:08.078986+0000","last_peered":"2024-01-22T05:19:08.078986+0000","last_clean":"2024-01-22T05:19:08.078986+0000","last_became_active":"2024-01-22T05:19:07.657039+0000","last_became_peered":"2024-01-22T05:19:07.657039+0000","last_unstale":"2024-01-22T05:19:08.078986+0000","last_undegraded":"2024-01-22T05:19:08.078986+0000","last_fullsized":"2024-01-22T05:19:08.078986+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":144,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.088932+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:19:08.088932+0000","last_peered":"2024-01-22T05:19:08.088932+0000","last_clean":"2024-01-22T05:19:08.088932+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:19:08.088932+0000","last_undegraded":"2024-01-22T05:19:08.088932+0000","last_fullsized":"2024-01-22T05:19:08.088932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.117744+0000","last_change":"2024-01-22T05:19:08.110252+0000","last_active":"2024-01-22T05:19:08.117744+0000","last_peered":"2024-01-22T05:19:08.117744+0000","last_clean":"2024-01-22T05:19:08.117744+0000","last_became_active":"2024-01-22T05:19:08.109965+0000","last_became_peered":"2024-01-22T05:19:08.109965+0000","last_unstale":"2024-01-22T05:19:08.117744+0000","last_undegraded":"2024-01-22T05:19:08.117744+0000","last_fullsized":"2024-01-22T05:19:08.117744+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:07.612991+0000","last_clean_scrub_stamp":"2024-01-22T05:19:07.612991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":10,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.089260+0000","last_change":"2024-01-22T05:19:07.657569+0000","last_active":"2024-01-22T05:19:08.089260+0000","last_peered":"2024-01-22T05:19:08.089260+0000","last_clean":"2024-01-22T05:19:08.089260+0000","last_became_active":"2024-01-22T05:19:07.657272+0000","last_became_peered":"2024-01-22T05:19:07.657272+0000","last_unstale":"2024-01-22T05:19:08.089260+0000","last_undegraded":"2024-01-22T05:19:08.089260+0000","last_fullsized":"2024-01-22T05:19:08.089260+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:06.601696+0000","last_clean_scrub_stamp":"2024-01-22T05:19:06.601696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":176,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.079450+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:19:08.079450+0000","last_peered":"2024-01-22T05:19:08.079450+0000","last_clean":"2024-01-22T05:19:08.079450+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:19:08.079450+0000","last_undegraded":"2024-01-22T05:19:08.079450+0000","last_fullsized":"2024-01-22T05:19:08.079450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":145,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-01-22T05:19:08.089023+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:19:08.089023+0000","last_peered":"2024-01-22T05:19:08.089023+0000","last_clean":"2024-01-22T05:19:08.089023+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:19:08.089023+0000","last_undegraded":"2024-01-22T05:19:08.089023+0000","last_fullsized":"2024-01-22T05:19:08.089023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575028,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311788,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060052,"statfs":{"total":96636764160,"available":96317493248,"internally_reserved":0,"allocated":2330624,"data_stored":1157266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2450000000000001,"15min":1.0760000000000001},"min":{"1min":0.83299999999999996,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.5209999999999999,"5min":14.779999999999999,"15min":14.779999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.145,"5min":2.0070000000000001,"15min":1.3759999999999999},"min":{"1min":0.80000000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.55,"5min":76.662000000000006,"15min":76.662000000000006},"last":0.876}]},{"osd":1,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.167,"15min":1.0589999999999999},"min":{"1min":0.86199999999999999,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.4650000000000001,"5min":4.9269999999999996,"15min":4.9269999999999996},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2989999999999999,"15min":1.2030000000000001},"min":{"1min":0.88,"5min":0.71599999999999997,"15min":0.58999999999999997},"max":{"1min":1.655,"5min":12.691000000000001,"15min":12.691000000000001},"last":1.4219999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1579999999999999,"15min":1.125},"min":{"1min":0.77800000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5700000000000001,"5min":2.1589999999999998,"15min":2.5150000000000001},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.355,"15min":1.2210000000000001},"min":{"1min":0.97699999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5449999999999999,"5min":15.036,"15min":15.036},"last":1.335}]},{"osd":3,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.9339999999999999,"15min":1.4470000000000001},"min":{"1min":0.92300000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.748,"5min":64.983999999999995,"15min":64.983999999999995},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.4299999999999999,"15min":1.2949999999999999},"min":{"1min":1.0029999999999999,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":1.714,"5min":15.073,"15min":15.073},"last":1.1439999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.415,"15min":1.1850000000000001},"min":{"1min":0.77900000000000003,"5min":0.53000000000000003,"15min":0.32900000000000001},"max":{"1min":1.504,"5min":22.239000000000001,"15min":22.239000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.28,"5min":1.5269999999999999,"15min":1.2669999999999999},"min":{"1min":0.92000000000000004,"5min":0.68799999999999994,"15min":0.52200000000000002},"max":{"1min":1.9830000000000001,"5min":27.872,"15min":27.872},"last":1.0940000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":2.0110000000000001,"15min":1.452},"min":{"1min":0.88100000000000001,"5min":0.67400000000000004,"15min":0.40400000000000003},"max":{"1min":1.6279999999999999,"5min":65.652000000000001,"15min":65.652000000000001},"last":1.21},{"interface":"front","average":{"1min":1.387,"5min":1.341,"15min":1.2869999999999999},"min":{"1min":1.0589999999999999,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":2.1539999999999999,"5min":2.1629999999999998,"15min":3.625},"last":1.4059999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.363,"15min":1.262},"min":{"1min":0.997,"5min":0.80700000000000005,"15min":0.53400000000000003},"max":{"1min":2.3580000000000001,"5min":6.9939999999999998,"15min":6.9939999999999998},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.54,"15min":1.411},"min":{"1min":1.224,"5min":0.82999999999999996,"15min":0.56100000000000005},"max":{"1min":2.0600000000000001,"5min":12.965,"15min":12.965},"last":1.484}]}]},{"osd":6,"up_from":13,"seq":55834575028,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307676,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064164,"statfs":{"total":96636764160,"available":96321703936,"internally_reserved":0,"allocated":2314240,"data_stored":1155176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.0580000000000001,"15min":1.2849999999999999},"min":{"1min":0.72999999999999998,"5min":0.66600000000000004,"15min":0.35999999999999999},"max":{"1min":1.927,"5min":1.927,"15min":77.745000000000005},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0429999999999999,"15min":1.0780000000000001},"min":{"1min":0.64500000000000002,"5min":0.57499999999999996,"15min":0.44},"max":{"1min":1.5,"5min":1.74,"15min":13.555999999999999},"last":1.0660000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.0740000000000001,"15min":1.125},"min":{"1min":0.91300000000000003,"5min":0.56999999999999995,"15min":0.40000000000000002},"max":{"1min":1.3240000000000001,"5min":1.554,"15min":15.499000000000001},"last":1.105},{"interface":"front","average":{"1min":1.206,"5min":1.117,"15min":1.155},"min":{"1min":0.76200000000000001,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.6379999999999999,"5min":1.702,"15min":7.7629999999999999},"last":1.304}]},{"osd":2,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1850000000000001,"15min":1.165},"min":{"1min":0.89000000000000001,"5min":0.84999999999999998,"15min":0.57399999999999995},"max":{"1min":1.4199999999999999,"5min":1.667,"15min":3.0960000000000001},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.1359999999999999,"15min":1.145},"min":{"1min":0.747,"5min":0.68999999999999995,"15min":0.38200000000000001},"max":{"1min":1.401,"5min":1.7390000000000001,"15min":4.9660000000000002},"last":1.198}]},{"osd":3,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.173,"15min":1.486},"min":{"1min":0.97899999999999998,"5min":0.66700000000000004,"15min":0.59299999999999997},"max":{"1min":1.4610000000000001,"5min":2.343,"15min":102.08199999999999},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.82599999999999996,"5min":0.66300000000000003,"15min":0.374},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":15.468},"last":1.2350000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1799999999999999,"15min":1.147},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.495},"max":{"1min":1.6040000000000001,"5min":1.631,"15min":3.1749999999999998},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.204,"15min":1.165},"min":{"1min":0.82799999999999996,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.6910000000000001,"5min":2.5489999999999999,"15min":5.1200000000000001},"last":1.3420000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1499999999999999,"15min":1.2430000000000001},"min":{"1min":0.93000000000000005,"5min":0.58699999999999997,"15min":0.48099999999999998},"max":{"1min":1.6020000000000001,"5min":1.7829999999999999,"15min":30.533000000000001},"last":1.365},{"interface":"front","average":{"1min":1.359,"5min":1.294,"15min":1.278},"min":{"1min":1.0029999999999999,"5min":0.79500000000000004,"15min":0.46600000000000003},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":3.875},"last":1.502}]},{"osd":7,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3500000000000001,"15min":1.4279999999999999},"min":{"1min":0.97999999999999998,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":1.6379999999999999,"5min":2.7490000000000001,"15min":23.547999999999998},"last":1.54},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3149999999999999,"15min":1.5509999999999999},"min":{"1min":0.80200000000000005,"5min":0.77700000000000002,"15min":0.495},"max":{"1min":1.7110000000000001,"5min":1.9019999999999999,"15min":63.737000000000002},"last":1.4730000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575028,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307676,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064164,"statfs":{"total":96636764160,"available":96321703936,"internally_reserved":0,"allocated":2314240,"data_stored":1155176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0089999999999999,"15min":1.0129999999999999},"min":{"1min":0.58599999999999997,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.556,"5min":1.651,"15min":2.0609999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0529999999999999,"15min":1.042},"min":{"1min":0.61699999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5840000000000001,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.88500000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.224,"15min":1.1850000000000001},"min":{"1min":0.85099999999999998,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.6619999999999999,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2050000000000001,"15min":1.2},"min":{"1min":0.879,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.6140000000000001,"5min":1.9930000000000001,"15min":2.0209999999999999},"last":1.212}]},{"osd":2,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1479999999999999,"15min":1.135},"min":{"1min":0.80700000000000005,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.4370000000000001,"5min":1.9219999999999999,"15min":1.925},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.145,"15min":1.115},"min":{"1min":0.82499999999999996,"5min":0.71799999999999997,"15min":0.59899999999999998},"max":{"1min":1.4410000000000001,"5min":1.982,"15min":1.982},"last":1.0089999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.216,"15min":1.1599999999999999},"min":{"1min":0.71199999999999997,"5min":0.69799999999999995,"15min":0.66900000000000004},"max":{"1min":1.5660000000000001,"5min":3.202,"15min":3.202},"last":1.383},{"interface":"front","average":{"1min":1.246,"5min":1.1899999999999999,"15min":1.2090000000000001},"min":{"1min":0.98199999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.546,"5min":1.6830000000000001,"15min":4.8819999999999997},"last":1.125}]},{"osd":4,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.103,"15min":1.097},"min":{"1min":0.77700000000000002,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.5369999999999999,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.085},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1950000000000001,"15min":1.1779999999999999},"min":{"1min":0.78000000000000003,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.4430000000000001,"5min":2.081,"15min":2.081},"last":1.165}]},{"osd":6,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.226,"15min":1.2190000000000001},"min":{"1min":0.97999999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.482,"5min":2.0099999999999998,"15min":2.2010000000000001},"last":1.046},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.24,"15min":1.2410000000000001},"min":{"1min":0.71899999999999997,"5min":0.70699999999999996,"15min":0.55900000000000005},"max":{"1min":1.4530000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.26}]},{"osd":7,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3169999999999999,"15min":1.304},"min":{"1min":0.91400000000000003,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.7410000000000001,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.371,"5min":1.3420000000000001,"15min":1.3360000000000001},"min":{"1min":0.96099999999999997,"5min":0.72699999999999998,"15min":0.60799999999999998},"max":{"1min":1.6819999999999999,"5min":1.8859999999999999,"15min":3.1840000000000002},"last":1.3660000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575028,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299500,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072340,"statfs":{"total":96636764160,"available":96330076160,"internally_reserved":0,"allocated":2330624,"data_stored":1155924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1279999999999999,"15min":1.103},"min":{"1min":0.81000000000000005,"5min":0.63700000000000001,"15min":0.47799999999999998},"max":{"1min":1.4379999999999999,"5min":1.696,"15min":2.0150000000000001},"last":1.339},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1950000000000001,"15min":1.147},"min":{"1min":0.92100000000000004,"5min":0.75700000000000001,"15min":0.48899999999999999},"max":{"1min":1.548,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.244}]},{"osd":1,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.091,"15min":1.0760000000000001},"min":{"1min":0.77800000000000002,"5min":0.59899999999999998,"15min":0.53100000000000003},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.04},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.82199999999999995,"5min":0.52500000000000002,"15min":0.46000000000000002},"max":{"1min":1.3879999999999999,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":1.0009999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0760000000000001,"15min":1.0720000000000001},"min":{"1min":0.79500000000000004,"5min":0.66400000000000003,"15min":0.49199999999999999},"max":{"1min":1.361,"5min":1.516,"15min":5.3390000000000004},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.204,"5min":1.149,"15min":1.161},"min":{"1min":0.88,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5089999999999999,"5min":1.6140000000000001,"15min":2.3479999999999999},"last":1.204}]},{"osd":3,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.149,"15min":1.135},"min":{"1min":0.86799999999999999,"5min":0.65700000000000003,"15min":0.496},"max":{"1min":1.478,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.155},{"interface":"front","average":{"1min":1.2,"5min":1.1719999999999999,"15min":1.1499999999999999},"min":{"1min":0.97199999999999998,"5min":0.67700000000000005,"15min":0.53100000000000003},"max":{"1min":1.4039999999999999,"5min":2.2959999999999998,"15min":5.3029999999999999},"last":1.286}]},{"osd":5,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.113,"15min":1.1180000000000001},"min":{"1min":0.76200000000000001,"5min":0.63500000000000001,"15min":0.54100000000000004},"max":{"1min":1.365,"5min":1.6899999999999999,"15min":2.0790000000000002},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.244,"5min":1.2070000000000001,"15min":1.133},"min":{"1min":0.94299999999999995,"5min":0.68200000000000005,"15min":0.52200000000000002},"max":{"1min":1.583,"5min":1.8240000000000001,"15min":2.0030000000000001},"last":0.88300000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.149,"15min":1.1439999999999999},"min":{"1min":0.88100000000000001,"5min":0.67400000000000004,"15min":0.44500000000000001},"max":{"1min":1.387,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.28,"15min":1.27},"min":{"1min":0.98999999999999999,"5min":0.73699999999999999,"15min":0.51900000000000002},"max":{"1min":1.45,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":1.097}]},{"osd":7,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3500000000000001,"15min":1.3120000000000001},"min":{"1min":1.0700000000000001,"5min":0.74099999999999999,"15min":0.59399999999999997},"max":{"1min":1.6299999999999999,"5min":1.8999999999999999,"15min":2.2839999999999998},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.94999999999999996,"5min":0.89300000000000002,"15min":0.56899999999999995},"max":{"1min":1.5049999999999999,"5min":1.843,"15min":5.2629999999999999},"last":1.4059999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575028,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303588,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068252,"statfs":{"total":96636764160,"available":96325890048,"internally_reserved":0,"allocated":2322432,"data_stored":1155288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.85699999999999998},"min":{"1min":0.50800000000000001,"5min":0.41099999999999998,"15min":0.34200000000000003},"max":{"1min":1.175,"5min":1.512,"15min":14.859},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.63400000000000001,"5min":0.42699999999999999,"15min":0.317},"max":{"1min":1.371,"5min":1.804,"15min":5.0919999999999996},"last":0.69399999999999995}]},{"osd":1,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.90900000000000003,"15min":0.90300000000000002},"min":{"1min":0.62,"5min":0.50600000000000001,"15min":0.39300000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":6.5570000000000004},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.95699999999999996,"15min":0.97099999999999997},"min":{"1min":0.55800000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.482,"5min":1.7669999999999999,"15min":5.7519999999999998},"last":0.76400000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.085,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48599999999999999,"15min":0.40600000000000003},"max":{"1min":1.6910000000000001,"5min":1.8680000000000001,"15min":2.391},"last":1.151},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.157,"15min":1.1819999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.44800000000000001},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":4.1429999999999998},"last":1.2030000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.323,"15min":1.331},"min":{"1min":0.86699999999999999,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.831,"5min":2.423,"15min":10.858000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.292,"15min":1.337},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.63600000000000001},"max":{"1min":1.6379999999999999,"5min":2.3359999999999999,"15min":10.846},"last":1.3779999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.238,"15min":1.2829999999999999},"min":{"1min":0.99399999999999999,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.595,"5min":1.7709999999999999,"15min":7.3639999999999999},"last":1.278},{"interface":"front","average":{"1min":1.351,"5min":1.3089999999999999,"15min":1.381},"min":{"1min":0.92700000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.738,"5min":6.3220000000000001,"15min":14.523999999999999},"last":1.401}]},{"osd":6,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.369,"15min":1.357},"min":{"1min":0.92700000000000005,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.77,"5min":2.1819999999999999,"15min":4.9809999999999999},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.413,"5min":1.3720000000000001,"15min":1.3879999999999999},"min":{"1min":1.113,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":5.4210000000000003},"last":1.429}]},{"osd":7,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.3340000000000001,"15min":1.363},"min":{"1min":0.96999999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.004,"5min":2.004,"15min":5.7160000000000002},"last":1.49},{"interface":"front","average":{"1min":1.448,"5min":1.381,"15min":1.409},"min":{"1min":1.0860000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8839999999999999,"5min":2.5449999999999999,"15min":6.4279999999999999},"last":1.4390000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575028,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315872,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":94055968,"statfs":{"total":96636764160,"available":96313311232,"internally_reserved":0,"allocated":2318336,"data_stored":1155246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.54100000000000004,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":1.1919999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85499999999999998,"15min":0.85399999999999998},"min":{"1min":0.53900000000000003,"5min":0.45300000000000001,"15min":0.373},"max":{"1min":1.1899999999999999,"5min":1.556,"15min":1.7350000000000001},"last":1.133}]},{"osd":1,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92600000000000005,"15min":0.86899999999999999},"min":{"1min":0.55400000000000005,"5min":0.46800000000000003,"15min":0.41299999999999998},"max":{"1min":1.8400000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.218},{"interface":"front","average":{"1min":1.109,"5min":1,"15min":0.95799999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.41599999999999998},"max":{"1min":1.671,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.85499999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1659999999999999,"15min":1.137},"min":{"1min":0.66700000000000004,"5min":0.56200000000000006,"15min":0.47099999999999997},"max":{"1min":1.984,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":1.008},{"interface":"front","average":{"1min":1.296,"5min":1.2370000000000001,"15min":1.212},"min":{"1min":0.85999999999999999,"5min":0.64300000000000002,"15min":0.51100000000000001},"max":{"1min":1.7609999999999999,"5min":3.133,"15min":3.133},"last":1.0880000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.3140000000000001,"15min":1.278},"min":{"1min":1.0029999999999999,"5min":0.88500000000000001,"15min":0.59099999999999997},"max":{"1min":2.101,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.206,"15min":1.2010000000000001},"min":{"1min":0.74099999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":2.2829999999999999},"last":1.2589999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.2649999999999999,"15min":1.228},"min":{"1min":0.94699999999999995,"5min":0.84099999999999997,"15min":0.63800000000000001},"max":{"1min":2.1680000000000001,"5min":2.379,"15min":2.379},"last":1.3},{"interface":"front","average":{"1min":1.45,"5min":1.329,"15min":1.2909999999999999},"min":{"1min":1.181,"5min":0.84799999999999998,"15min":0.67000000000000004},"max":{"1min":2.1880000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.351}]},{"osd":6,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2609999999999999,"15min":1.254},"min":{"1min":0.79500000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":2.1920000000000002},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.47,"5min":1.3720000000000001,"15min":1.3160000000000001},"min":{"1min":0.98899999999999999,"5min":0.629,"15min":0.629},"max":{"1min":2.2759999999999998,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.462}]},{"osd":7,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3560000000000001,"15min":1.345},"min":{"1min":0.88500000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8200000000000001,"5min":1.9390000000000001,"15min":2.1749999999999998},"last":1.431},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.452,"15min":1.4219999999999999},"min":{"1min":1.121,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.2280000000000002,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.3859999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575029,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311784,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060056,"statfs":{"total":96636764160,"available":96317497344,"internally_reserved":0,"allocated":2326528,"data_stored":1155786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84899999999999998,"15min":0.86599999999999999},"min":{"1min":0.53500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.032,"5min":1.4830000000000001,"15min":3.4119999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.054,"5min":0.98099999999999998,"15min":0.997},"min":{"1min":0.66100000000000003,"5min":0.56999999999999995,"15min":0.41099999999999998},"max":{"1min":1.5089999999999999,"5min":1.6160000000000001,"15min":2.101},"last":1.167}]},{"osd":2,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.97499999999999998,"15min":0.98899999999999999},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.45500000000000002},"max":{"1min":1.3180000000000001,"5min":1.492,"15min":2.169},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.0589999999999999,"15min":1.0549999999999999},"min":{"1min":0.64900000000000002,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.478,"5min":1.5780000000000001,"15min":2.024},"last":1.004}]},{"osd":3,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.052,"15min":1.0429999999999999},"min":{"1min":0.73999999999999999,"5min":0.57399999999999995,"15min":0.38900000000000001},"max":{"1min":1.502,"5min":1.972,"15min":4.665},"last":1.25},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.64600000000000002,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.2629999999999999,"5min":1.659,"15min":5.5830000000000002},"last":1.0800000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2110000000000001,"15min":1.2490000000000001},"min":{"1min":0.86299999999999999,"5min":0.60299999999999998,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":1.958,"15min":15.76},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.2809999999999999,"15min":1.333},"min":{"1min":0.90400000000000003,"5min":0.74099999999999999,"15min":0.63500000000000001},"max":{"1min":1.649,"5min":1.714,"15min":16.975000000000001},"last":1.2170000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.264,"15min":1.232},"min":{"1min":0.88200000000000001,"5min":0.72599999999999998,"15min":0.55700000000000005},"max":{"1min":1.6240000000000001,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.26},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.274,"15min":1.2789999999999999},"min":{"1min":0.97199999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.784,"5min":2.1309999999999998,"15min":2.52},"last":1.4890000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.266,"15min":1.2609999999999999},"min":{"1min":0.95099999999999996,"5min":0.68999999999999995,"15min":0.55600000000000005},"max":{"1min":1.53,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3,"15min":1.327},"min":{"1min":1.056,"5min":0.76200000000000001,"15min":0.68799999999999994},"max":{"1min":1.6459999999999999,"5min":2.0609999999999999,"15min":2.5569999999999999},"last":1.571}]},{"osd":7,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.339,"15min":1.355},"min":{"1min":0.96299999999999997,"5min":0.69999999999999996,"15min":0.68100000000000005},"max":{"1min":1.754,"5min":1.8999999999999999,"15min":4.4329999999999998},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.355,"15min":1.3520000000000001},"min":{"1min":1.0109999999999999,"5min":0.81100000000000005,"15min":0.64900000000000002},"max":{"1min":1.7010000000000001,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":1.601}]}]},{"osd":0,"up_from":13,"seq":55834575028,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311780,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060060,"statfs":{"total":96636764160,"available":96317501440,"internally_reserved":0,"allocated":2322432,"data_stored":1156158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.81799999999999995,"15min":0.88500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.28699999999999998},"max":{"1min":1.0609999999999999,"5min":1.4219999999999999,"15min":15.273},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.874,"15min":0.91300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.34499999999999997},"max":{"1min":1.3680000000000001,"5min":1.625,"15min":4.4009999999999998},"last":1.155}]},{"osd":2,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.97799999999999998,"15min":1.0449999999999999},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.46400000000000002},"max":{"1min":1.363,"5min":1.6299999999999999,"15min":15.473000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.0249999999999999,"15min":1.0269999999999999},"min":{"1min":0.67400000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5509999999999999,"5min":1.6850000000000001,"15min":1.7989999999999999},"last":1.238}]},{"osd":3,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.95899999999999996,"15min":0.97699999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.39000000000000001},"max":{"1min":1.302,"5min":1.5049999999999999,"15min":5.3970000000000002},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.069,"5min":1.1100000000000001,"15min":1.177},"min":{"1min":0.67200000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.5529999999999999,"5min":1.79,"15min":15.439},"last":1.0940000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.208,"15min":1.2470000000000001},"min":{"1min":0.81999999999999995,"5min":0.81399999999999995,"15min":0.61399999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":5.1799999999999997},"last":1.052},{"interface":"front","average":{"1min":1.222,"5min":1.214,"15min":1.216},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.56200000000000006},"max":{"1min":1.615,"5min":1.738,"15min":3.4340000000000002},"last":1.0389999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.272,"15min":1.27},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.67600000000000005},"max":{"1min":1.579,"5min":1.9099999999999999,"15min":3.548},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.272,"5min":1.306,"15min":1.321},"min":{"1min":0.90300000000000002,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.587,"5min":1.7210000000000001,"15min":2.823},"last":1.21}]},{"osd":6,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3300000000000001,"15min":1.407},"min":{"1min":0.91700000000000004,"5min":0.879,"15min":0.59099999999999997},"max":{"1min":1.6559999999999999,"5min":1.7909999999999999,"15min":15.4},"last":1.365},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3200000000000001,"15min":1.3720000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.72499999999999998},"max":{"1min":1.7010000000000001,"5min":1.8919999999999999,"15min":7.1349999999999998},"last":0.879}]},{"osd":7,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3740000000000001,"15min":1.4219999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.79900000000000004},"max":{"1min":1.7969999999999999,"5min":2.145,"15min":5.29},"last":1.319},{"interface":"front","average":{"1min":1.357,"5min":1.3680000000000001,"15min":1.367},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.752},"max":{"1min":1.7230000000000001,"5min":2.0470000000000002,"15min":2.7269999999999999},"last":1.1359999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:19:17.614 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:19:17.614 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-22T05:19:17.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.828+0000 7f1422800700 1 Processor -- start 2024-01-22T05:19:17.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.832+0000 7f1422800700 1 -- start start 2024-01-22T05:19:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f1422800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f141c0c0760 0x7f141c1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f1422800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f141c151ba0 0x7f141c067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f1422800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141c155770 con 0x7f141c067f80 2024-01-22T05:19:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f1422800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141c0c2e40 con 0x7f141c0c0760 2024-01-22T05:19:17.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f1422800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0c2880 con 0x7f141c151ba0 2024-01-22T05:19:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f141b400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f141c0c0760 0x7f141c1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f141b400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f141c0c0760 0x7f141c1516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56166/0 (socket says 172.21.15.49:56166) 2024-01-22T05:19:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f141b400700 1 -- 172.21.15.49:0/3781446242 learned_addr learned my addr 172.21.15.49:0/3781446242 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f141aa00700 1 --2- 172.21.15.49:0/3781446242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f141c151ba0 0x7f141c067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f141b400700 1 -- 172.21.15.49:0/3781446242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f141c151ba0 msgr2=0x7f141c067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f141b400700 1 --2- 172.21.15.49:0/3781446242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f141c151ba0 0x7f141c067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f141b400700 1 -- 172.21.15.49:0/3781446242 >> v1:172.21.15.49:6789/0 conn(0x7f141c067f80 legacy=0x7f141c155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f141b400700 1 -- 172.21.15.49:0/3781446242 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0c2b60 con 0x7f141c0c0760 2024-01-22T05:19:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f141aa00700 1 --2- 172.21.15.49:0/3781446242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f141c151ba0 0x7f141c067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:17.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f141b400700 1 --2- 172.21.15.49:0/3781446242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f141c0c0760 0x7f141c1516b0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f140c006fd0 tx=0x7f140c0090f0).ready entity=mon.0 client_cookie=b18e32ee172d461d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:17.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f141a000700 1 -- 172.21.15.49:0/3781446242 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c00b600 con 0x7f141c0c0760 2024-01-22T05:19:17.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f141a000700 1 -- 172.21.15.49:0/3781446242 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c00b760 con 0x7f141c0c0760 2024-01-22T05:19:17.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.836+0000 7f141a000700 1 -- 172.21.15.49:0/3781446242 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c00bb00 con 0x7f141c0c0760 2024-01-22T05:19:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.840+0000 7f1422800700 1 -- 172.21.15.49:0/3781446242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f141c0c0760 msgr2=0x7f141c1516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.840+0000 7f1422800700 1 --2- 172.21.15.49:0/3781446242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f141c0c0760 0x7f141c1516b0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f140c006fd0 tx=0x7f140c0090f0).stop 2024-01-22T05:19:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.840+0000 7f1422800700 1 -- 172.21.15.49:0/3781446242 shutdown_connections 2024-01-22T05:19:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.840+0000 7f1422800700 1 --2- 172.21.15.49:0/3781446242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f141c151ba0 0x7f141c067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.840+0000 7f1422800700 1 --2- 172.21.15.49:0/3781446242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f141c0c0760 0x7f141c1516b0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.840+0000 7f1422800700 1 -- 172.21.15.49:0/3781446242 >> 172.21.15.49:0/3781446242 conn(0x7f141c062cb0 msgr2=0x7f141c0c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.840+0000 7f1422800700 1 -- 172.21.15.49:0/3781446242 shutdown_connections 2024-01-22T05:19:17.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.840+0000 7f1422800700 1 -- 172.21.15.49:0/3781446242 wait complete. 2024-01-22T05:19:17.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.844+0000 7f1422800700 1 Processor -- start 2024-01-22T05:19:17.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.844+0000 7f1422800700 1 -- start start 2024-01-22T05:19:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.844+0000 7f1422800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f141c067f80 0x7f141c146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.844+0000 7f1422800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f141c0c0760 0x7f141c0bbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.844+0000 7f1422800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f141c151ba0 0x7f141c0bc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.844+0000 7f1422800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0bc550 con 0x7f141c0c0760 2024-01-22T05:19:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.844+0000 7f1422800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c154250 con 0x7f141c151ba0 2024-01-22T05:19:17.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.844+0000 7f1422800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c153640 con 0x7f141c067f80 2024-01-22T05:19:17.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.844+0000 7f141aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f141c0c0760 0x7f141c0bbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:17.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.844+0000 7f141aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f141c0c0760 0x7f141c0bbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56180/0 (socket says 172.21.15.49:56180) 2024-01-22T05:19:17.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.844+0000 7f141aa00700 1 -- 172.21.15.49:0/3666687955 learned_addr learned my addr 172.21.15.49:0/3666687955 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:17.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.844+0000 7f141b400700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f141c067f80 0x7f141c146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:17.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.844+0000 7f141be00700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f141c151ba0 0x7f141c0bc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:17.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.848+0000 7f141aa00700 1 -- 172.21.15.49:0/3666687955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f141c067f80 msgr2=0x7f141c146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.848+0000 7f141aa00700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f141c067f80 0x7f141c146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.848+0000 7f141aa00700 1 -- 172.21.15.49:0/3666687955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f141c151ba0 msgr2=0x7f141c0bc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.848+0000 7f141aa00700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f141c151ba0 0x7f141c0bc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.848+0000 7f141aa00700 1 -- 172.21.15.49:0/3666687955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c009370 con 0x7f141c0c0760 2024-01-22T05:19:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.848+0000 7f141b400700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f141c067f80 0x7f141c146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.848+0000 7f141be00700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f141c151ba0 0x7f141c0bc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:17.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.848+0000 7f141aa00700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f141c0c0760 0x7f141c0bbb70 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f140400d860 tx=0x7f1404008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:17.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.848+0000 7f1412a00700 1 -- 172.21.15.49:0/3666687955 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404017070 con 0x7f141c0c0760 2024-01-22T05:19:17.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.848+0000 7f1412a00700 1 -- 172.21.15.49:0/3666687955 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1404005880 con 0x7f141c0c0760 2024-01-22T05:19:17.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.848+0000 7f1422800700 1 -- 172.21.15.49:0/3666687955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141c153920 con 0x7f141c0c0760 2024-01-22T05:19:17.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.848+0000 7f1412a00700 1 -- 172.21.15.49:0/3666687955 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404005c00 con 0x7f141c0c0760 2024-01-22T05:19:17.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.848+0000 7f1422800700 1 -- 172.21.15.49:0/3666687955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141c153ee0 con 0x7f141c0c0760 2024-01-22T05:19:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.848+0000 7f1422800700 1 -- 172.21.15.49:0/3666687955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141c0c0c00 con 0x7f141c0c0760 2024-01-22T05:19:17.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.848+0000 7f1412a00700 1 -- 172.21.15.49:0/3666687955 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1404006020 con 0x7f141c0c0760 2024-01-22T05:19:17.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.852+0000 7f1412a00700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13f405a510 0x7f13f405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:17.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.852+0000 7f1412a00700 1 -- 172.21.15.49:0/3666687955 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f14040748a0 con 0x7f141c0c0760 2024-01-22T05:19:17.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.852+0000 7f141b400700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13f405a510 0x7f13f405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.852+0000 7f141b400700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13f405a510 0x7f13f405c9d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f140c00b3c0 tx=0x7f140c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:17.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:17.856+0000 7f1412a00700 1 -- 172.21.15.49:0/3666687955 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1404047f20 con 0x7f141c0c0760 2024-01-22T05:19:18.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.080+0000 7f1422800700 1 -- 172.21.15.49:0/3666687955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f141c0c2530 con 0x7f141c0c0760 2024-01-22T05:19:18.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.088+0000 7f1412a00700 1 -- 172.21.15.49:0/3666687955 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) v1 ==== 190+0+0 (secure 0 0 0) 0x7f140404b540 con 0x7f141c0c0760 2024-01-22T05:19:18.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.092+0000 7f1422800700 1 -- 172.21.15.49:0/3666687955 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13f405a510 msgr2=0x7f13f405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:18.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.092+0000 7f1422800700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13f405a510 0x7f13f405c9d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f140c00b3c0 tx=0x7f140c017000).stop 2024-01-22T05:19:18.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.092+0000 7f1422800700 1 -- 172.21.15.49:0/3666687955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f141c0c0760 msgr2=0x7f141c0bbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:18.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.092+0000 7f1422800700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f141c0c0760 0x7f141c0bbb70 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f140400d860 tx=0x7f1404008040).stop 2024-01-22T05:19:18.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.092+0000 7f1422800700 1 -- 172.21.15.49:0/3666687955 shutdown_connections 2024-01-22T05:19:18.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.092+0000 7f1422800700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f13f405a510 0x7f13f405c9d0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:18.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.092+0000 7f1422800700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f141c151ba0 0x7f141c0bc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:18.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.092+0000 7f1422800700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f141c0c0760 0x7f141c0bbb70 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:18.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.092+0000 7f1422800700 1 --2- 172.21.15.49:0/3666687955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f141c067f80 0x7f141c146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:18.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.092+0000 7f1422800700 1 -- 172.21.15.49:0/3666687955 >> 172.21.15.49:0/3666687955 conn(0x7f141c062cb0 msgr2=0x7f141c0c5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:18.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.092+0000 7f1422800700 1 -- 172.21.15.49:0/3666687955 shutdown_connections 2024-01-22T05:19:18.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.092+0000 7f1422800700 1 -- 172.21.15.49:0/3666687955 wait complete. 2024-01-22T05:19:18.096 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-01-22T05:19:18.117 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:19:18.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.284+0000 7f3497200700 1 Processor -- start 2024-01-22T05:19:18.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.284+0000 7f3497200700 1 -- start start 2024-01-22T05:19:18.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3497200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3498068aa0 0x7f3498068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:18.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3497200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3498063d30 0x7f34980641c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:18.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3497200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34980638a0 con 0x7f34980c13f0 2024-01-22T05:19:18.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3497200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34980bc3c0 con 0x7f3498063d30 2024-01-22T05:19:18.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3497200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3498139c80 con 0x7f3498068aa0 2024-01-22T05:19:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3496800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3498063d30 0x7f34980641c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3496800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3498063d30 0x7f34980641c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56186/0 (socket says 172.21.15.49:56186) 2024-01-22T05:19:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3496800700 1 -- 172.21.15.49:0/1699061961 learned_addr learned my addr 172.21.15.49:0/1699061961 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3495400700 1 --2- 172.21.15.49:0/1699061961 >> v2:172.21.15.110:3300/0 conn(0x7f3498068aa0 0x7f3498068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3496800700 1 -- 172.21.15.49:0/1699061961 >> v2:172.21.15.110:3300/0 conn(0x7f3498068aa0 msgr2=0x7f3498068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3496800700 1 --2- 172.21.15.49:0/1699061961 >> v2:172.21.15.110:3300/0 conn(0x7f3498068aa0 0x7f3498068ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3496800700 1 -- 172.21.15.49:0/1699061961 >> v1:172.21.15.110:6789/0 conn(0x7f34980c13f0 legacy=0x7f34980bbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:18.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3496800700 1 -- 172.21.15.49:0/1699061961 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34980693d0 con 0x7f3498063d30 2024-01-22T05:19:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3496800700 1 --2- 172.21.15.49:0/1699061961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3498063d30 0x7f34980641c0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 rx=0x7f3498153a70 tx=0x7f3490009840).ready entity=mon.0 client_cookie=7b2dfee5a4bd2715 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3494a00700 1 -- 172.21.15.49:0/1699061961 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349000e070 con 0x7f3498063d30 2024-01-22T05:19:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.288+0000 7f3494a00700 1 -- 172.21.15.49:0/1699061961 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349000ba50 con 0x7f3498063d30 2024-01-22T05:19:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.292+0000 7f3494a00700 1 -- 172.21.15.49:0/1699061961 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349000bdd0 con 0x7f3498063d30 2024-01-22T05:19:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.292+0000 7f3497200700 1 -- 172.21.15.49:0/1699061961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3498063d30 msgr2=0x7f34980641c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.292+0000 7f3497200700 1 --2- 172.21.15.49:0/1699061961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3498063d30 0x7f34980641c0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 rx=0x7f3498153a70 tx=0x7f3490009840).stop 2024-01-22T05:19:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.292+0000 7f3497200700 1 -- 172.21.15.49:0/1699061961 shutdown_connections 2024-01-22T05:19:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.292+0000 7f3497200700 1 --2- 172.21.15.49:0/1699061961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3498063d30 0x7f34980641c0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.292+0000 7f3497200700 1 --2- 172.21.15.49:0/1699061961 >> v2:172.21.15.110:3300/0 conn(0x7f3498068aa0 0x7f3498068ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:18.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.292+0000 7f3497200700 1 -- 172.21.15.49:0/1699061961 >> 172.21.15.49:0/1699061961 conn(0x7f34980c42c0 msgr2=0x7f3498065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.292+0000 7f3497200700 1 -- 172.21.15.49:0/1699061961 shutdown_connections 2024-01-22T05:19:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.292+0000 7f3497200700 1 -- 172.21.15.49:0/1699061961 wait complete. 2024-01-22T05:19:18.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.296+0000 7f3497200700 1 Processor -- start 2024-01-22T05:19:18.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.296+0000 7f3497200700 1 -- start start 2024-01-22T05:19:18.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.296+0000 7f3497200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3498063d30 0x7f34980aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:18.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.296+0000 7f3497200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3498068aa0 0x7f34980a90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:18.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.296+0000 7f3497200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34980c13f0 0x7f34980c0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:18.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.296+0000 7f3497200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3498139220 con 0x7f3498068aa0 2024-01-22T05:19:18.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.296+0000 7f3497200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34980a69a0 con 0x7f3498063d30 2024-01-22T05:19:18.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.296+0000 7f3497200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34980a95b0 con 0x7f34980c13f0 2024-01-22T05:19:18.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.296+0000 7f3495400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3498068aa0 0x7f34980a90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:18.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.296+0000 7f3495400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3498068aa0 0x7f34980a90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56196/0 (socket says 172.21.15.49:56196) 2024-01-22T05:19:18.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.296+0000 7f3495400700 1 -- 172.21.15.49:0/3059524553 learned_addr learned my addr 172.21.15.49:0/3059524553 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:18.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.296+0000 7f3495e00700 1 --2- 172.21.15.49:0/3059524553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3498063d30 0x7f34980aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:18.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.296+0000 7f3496800700 1 --2- 172.21.15.49:0/3059524553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34980c13f0 0x7f34980c0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:18.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.300+0000 7f3495400700 1 -- 172.21.15.49:0/3059524553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34980c13f0 msgr2=0x7f34980c0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.300+0000 7f3495400700 1 --2- 172.21.15.49:0/3059524553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34980c13f0 0x7f34980c0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.300+0000 7f3495400700 1 -- 172.21.15.49:0/3059524553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3498063d30 msgr2=0x7f34980aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.300+0000 7f3495400700 1 --2- 172.21.15.49:0/3059524553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3498063d30 0x7f34980aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.300+0000 7f3495400700 1 -- 172.21.15.49:0/3059524553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490009ae0 con 0x7f3498068aa0 2024-01-22T05:19:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.300+0000 7f3495400700 1 --2- 172.21.15.49:0/3059524553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3498068aa0 0x7f34980a90c0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7f348000d890 tx=0x7f3480008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.300+0000 7f348d600700 1 -- 172.21.15.49:0/3059524553 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480011590 con 0x7f3498068aa0 2024-01-22T05:19:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.300+0000 7f348d600700 1 -- 172.21.15.49:0/3059524553 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34800116f0 con 0x7f3498068aa0 2024-01-22T05:19:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.300+0000 7f3497200700 1 -- 172.21.15.49:0/3059524553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34980ab960 con 0x7f3498068aa0 2024-01-22T05:19:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.300+0000 7f348d600700 1 -- 172.21.15.49:0/3059524553 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480011a70 con 0x7f3498068aa0 2024-01-22T05:19:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.300+0000 7f3497200700 1 -- 172.21.15.49:0/3059524553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34980abf20 con 0x7f3498068aa0 2024-01-22T05:19:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.300+0000 7f3497200700 1 -- 172.21.15.49:0/3059524553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3498065120 con 0x7f3498068aa0 2024-01-22T05:19:18.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.304+0000 7f348d600700 1 -- 172.21.15.49:0/3059524553 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f348001c460 con 0x7f3498068aa0 2024-01-22T05:19:18.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.304+0000 7f348d600700 1 --2- 172.21.15.49:0/3059524553 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f347005a4e0 0x7f347005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:18.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.304+0000 7f348d600700 1 -- 172.21.15.49:0/3059524553 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f34800745c0 con 0x7f3498068aa0 2024-01-22T05:19:18.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.304+0000 7f3495e00700 1 --2- 172.21.15.49:0/3059524553 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f347005a4e0 0x7f347005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:18.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.308+0000 7f3495e00700 1 --2- 172.21.15.49:0/3059524553 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f347005a4e0 0x7f347005c9a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f3488003860 tx=0x7f3488007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:18.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.312+0000 7f348d600700 1 -- 172.21.15.49:0/3059524553 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3480047be0 con 0x7f3498068aa0 2024-01-22T05:19:18.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.512+0000 7f3497200700 1 -- 172.21.15.49:0/3059524553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34980bc5b0 con 0x7f3498068aa0 2024-01-22T05:19:18.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.512+0000 7f348d600700 1 -- 172.21.15.49:0/3059524553 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 142 v142) v1 ==== 95+0+4506 (secure 0 0 0) 0x7f348004b200 con 0x7f3498068aa0 2024-01-22T05:19:18.512 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:18.512 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":142,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1331200361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1331200361},{"type":"v1","addr":"172.21.15.110:6835","nonce":1331200361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137},{"gid":9994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/377934467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":377934467},{"type":"v1","addr":"172.21.15.110:6834","nonce":377934467}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137},{"gid":10101,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3482770597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3482770597},{"type":"v1","addr":"172.21.15.49:6835","nonce":3482770597}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137}],"filesystems":[{"mdsmap":{"epoch":142,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:08.068628+0000","modified":"2024-01-22T05:19:11.100914+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10104},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10104":{"gid":10104,"name":"a","rank":0,"incarnation":138,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3574461601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3574461601},{"type":"v1","addr":"172.21.15.49:6837","nonce":3574461601}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2024-01-22T05:19:18.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.516+0000 7f3497200700 1 -- 172.21.15.49:0/3059524553 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f347005a4e0 msgr2=0x7f347005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:18.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.516+0000 7f3497200700 1 --2- 172.21.15.49:0/3059524553 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f347005a4e0 0x7f347005c9a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f3488003860 tx=0x7f3488007d40).stop 2024-01-22T05:19:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.516+0000 7f3497200700 1 -- 172.21.15.49:0/3059524553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3498068aa0 msgr2=0x7f34980a90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.516+0000 7f3497200700 1 --2- 172.21.15.49:0/3059524553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3498068aa0 0x7f34980a90c0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7f348000d890 tx=0x7f3480008040).stop 2024-01-22T05:19:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.516+0000 7f3497200700 1 -- 172.21.15.49:0/3059524553 shutdown_connections 2024-01-22T05:19:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.516+0000 7f3497200700 1 --2- 172.21.15.49:0/3059524553 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f347005a4e0 0x7f347005c9a0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.516+0000 7f3497200700 1 --2- 172.21.15.49:0/3059524553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34980c13f0 0x7f34980c0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.516+0000 7f3497200700 1 --2- 172.21.15.49:0/3059524553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3498068aa0 0x7f34980a90c0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.516+0000 7f3497200700 1 --2- 172.21.15.49:0/3059524553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3498063d30 0x7f34980aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.516+0000 7f3497200700 1 -- 172.21.15.49:0/3059524553 >> 172.21.15.49:0/3059524553 conn(0x7f34980c42c0 msgr2=0x7f3498156010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.516+0000 7f3497200700 1 -- 172.21.15.49:0/3059524553 shutdown_connections 2024-01-22T05:19:18.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:18.516+0000 7f3497200700 1 -- 172.21.15.49:0/3059524553 wait complete. 2024-01-22T05:19:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 142 2024-01-22T05:19:18.941 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 142, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:19:08.068628+0000', 'modified': '2024-01-22T05:19:11.100914+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10104}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10104': {'gid': 10104, 'name': 'a', 'rank': 0, 'incarnation': 138, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6837/3574461601', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6836', 'nonce': 3574461601}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 3574461601}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:19:18.941 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:19:18.941 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-22T05:19:19.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.108+0000 7fcb78400700 1 Processor -- start 2024-01-22T05:19:19.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.108+0000 7fcb78400700 1 -- start start 2024-01-22T05:19:19.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb78400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb70066fb0 0x7fcb700c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb78400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb700a8b10 0x7fcb70157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb78400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcb700a8f90 0x7fcb70157c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb78400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb70158120 con 0x7fcb700a8b10 2024-01-22T05:19:19.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb78400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb700c1ee0 con 0x7fcb700a8f90 2024-01-22T05:19:19.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb78400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700c12f0 con 0x7fcb70066fb0 2024-01-22T05:19:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb75000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb700a8b10 0x7fcb70157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb76400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcb700a8f90 0x7fcb70157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb75a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb70066fb0 0x7fcb700c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb75000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcb700a8b10 0x7fcb70157740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56210/0 (socket says 172.21.15.49:56210) 2024-01-22T05:19:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb75000700 1 -- 172.21.15.49:0/1054366097 learned_addr learned my addr 172.21.15.49:0/1054366097 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb75000700 1 -- 172.21.15.49:0/1054366097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb70066fb0 msgr2=0x7fcb700c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb75000700 1 --2- 172.21.15.49:0/1054366097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb70066fb0 0x7fcb700c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb75000700 1 -- 172.21.15.49:0/1054366097 >> v2:172.21.15.110:3300/0 conn(0x7fcb700a8f90 msgr2=0x7fcb70157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb75000700 1 --2- 172.21.15.49:0/1054366097 >> v2:172.21.15.110:3300/0 conn(0x7fcb700a8f90 0x7fcb70157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb75000700 1 -- 172.21.15.49:0/1054366097 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700c15b0 con 0x7fcb700a8b10 2024-01-22T05:19:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb76400700 1 --2- 172.21.15.49:0/1054366097 >> v2:172.21.15.110:3300/0 conn(0x7fcb700a8f90 0x7fcb70157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb75000700 1 --2- 172.21.15.49:0/1054366097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb700a8b10 0x7fcb70157740 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7fcb58006fd0 tx=0x7fcb580090f0).ready entity=mon.0 client_cookie=6b0729291a2396e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb6fe00700 1 -- 172.21.15.49:0/1054366097 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5800f510 con 0x7fcb700a8b10 2024-01-22T05:19:19.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb6fe00700 1 -- 172.21.15.49:0/1054366097 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5800f670 con 0x7fcb700a8b10 2024-01-22T05:19:19.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.112+0000 7fcb6fe00700 1 -- 172.21.15.49:0/1054366097 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5800f9f0 con 0x7fcb700a8b10 2024-01-22T05:19:19.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.116+0000 7fcb78400700 1 -- 172.21.15.49:0/1054366097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb700a8b10 msgr2=0x7fcb70157740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.116+0000 7fcb78400700 1 --2- 172.21.15.49:0/1054366097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb700a8b10 0x7fcb70157740 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7fcb58006fd0 tx=0x7fcb580090f0).stop 2024-01-22T05:19:19.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.116+0000 7fcb78400700 1 -- 172.21.15.49:0/1054366097 shutdown_connections 2024-01-22T05:19:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.116+0000 7fcb78400700 1 --2- 172.21.15.49:0/1054366097 >> v2:172.21.15.110:3300/0 conn(0x7fcb700a8f90 0x7fcb70157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.116+0000 7fcb78400700 1 --2- 172.21.15.49:0/1054366097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb700a8b10 0x7fcb70157740 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.116+0000 7fcb78400700 1 --2- 172.21.15.49:0/1054366097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb70066fb0 0x7fcb700c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.116+0000 7fcb78400700 1 -- 172.21.15.49:0/1054366097 >> 172.21.15.49:0/1054366097 conn(0x7fcb700c6540 msgr2=0x7fcb700c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.116+0000 7fcb78400700 1 -- 172.21.15.49:0/1054366097 shutdown_connections 2024-01-22T05:19:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.116+0000 7fcb78400700 1 -- 172.21.15.49:0/1054366097 wait complete. 2024-01-22T05:19:19.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb78400700 1 Processor -- start 2024-01-22T05:19:19.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb78400700 1 -- start start 2024-01-22T05:19:19.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb78400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb70066fb0 0x7fcb70135a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb78400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb700a8b10 0x7fcb70167450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb78400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb700a8f90 0x7fcb70167940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb78400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700a9ff0 con 0x7fcb70066fb0 2024-01-22T05:19:19.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb78400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb70167e30 con 0x7fcb700a8b10 2024-01-22T05:19:19.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb78400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb70135f70 con 0x7fcb700a8f90 2024-01-22T05:19:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb75a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb70066fb0 0x7fcb70135a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb75a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb70066fb0 0x7fcb70135a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56224/0 (socket says 172.21.15.49:56224) 2024-01-22T05:19:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb75a00700 1 -- 172.21.15.49:0/3558762765 learned_addr learned my addr 172.21.15.49:0/3558762765 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb75000700 1 --2- 172.21.15.49:0/3558762765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb700a8b10 0x7fcb70167450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb76400700 1 --2- 172.21.15.49:0/3558762765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb700a8f90 0x7fcb70167940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb75000700 1 -- 172.21.15.49:0/3558762765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb700a8f90 msgr2=0x7fcb70167940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb75000700 1 --2- 172.21.15.49:0/3558762765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb700a8f90 0x7fcb70167940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb75000700 1 -- 172.21.15.49:0/3558762765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb70066fb0 msgr2=0x7fcb70135a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb75000700 1 --2- 172.21.15.49:0/3558762765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb70066fb0 0x7fcb70135a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb75000700 1 -- 172.21.15.49:0/3558762765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb68009a20 con 0x7fcb700a8b10 2024-01-22T05:19:19.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.120+0000 7fcb75a00700 1 --2- 172.21.15.49:0/3558762765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb70066fb0 0x7fcb70135a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:19.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.124+0000 7fcb75000700 1 --2- 172.21.15.49:0/3558762765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb700a8b10 0x7fcb70167450 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fcb58014000 tx=0x7fcb58017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:19.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.124+0000 7fcb6cc00700 1 -- 172.21.15.49:0/3558762765 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5800f7e0 con 0x7fcb700a8b10 2024-01-22T05:19:19.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.124+0000 7fcb6cc00700 1 -- 172.21.15.49:0/3558762765 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5800f940 con 0x7fcb700a8b10 2024-01-22T05:19:19.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.124+0000 7fcb78400700 1 -- 172.21.15.49:0/3558762765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb58009370 con 0x7fcb700a8b10 2024-01-22T05:19:19.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.124+0000 7fcb6cc00700 1 -- 172.21.15.49:0/3558762765 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5801c670 con 0x7fcb700a8b10 2024-01-22T05:19:19.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.124+0000 7fcb78400700 1 -- 172.21.15.49:0/3558762765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7014bca0 con 0x7fcb700a8b10 2024-01-22T05:19:19.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.128+0000 7fcb6cc00700 1 -- 172.21.15.49:0/3558762765 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcb5801caa0 con 0x7fcb700a8b10 2024-01-22T05:19:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.128+0000 7fcb6cc00700 1 --2- 172.21.15.49:0/3558762765 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcb4805a510 0x7fcb4805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.128+0000 7fcb6cc00700 1 -- 172.21.15.49:0/3558762765 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fcb58076530 con 0x7fcb700a8b10 2024-01-22T05:19:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.128+0000 7fcb75a00700 1 --2- 172.21.15.49:0/3558762765 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcb4805a510 0x7fcb4805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.128+0000 7fcb75a00700 1 --2- 172.21.15.49:0/3558762765 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcb4805a510 0x7fcb4805c9d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fcb60009fd0 tx=0x7fcb60009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:19.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb828b2740 1 Processor -- start 2024-01-22T05:19:19.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb828b2740 1 -- start start 2024-01-22T05:19:19.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb828b2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22de3a0 0x22de780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb828b2740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22e0c80 0x229c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb828b2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x229de40 0x2296990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb828b2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x221d410 con 0x22de3a0 2024-01-22T05:19:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb828b2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x221d550 con 0x229de40 2024-01-22T05:19:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb828b2740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x221da00 con 0x22e0c80 2024-01-22T05:19:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb75a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22de3a0 0x22de780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb75a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22de3a0 0x22de780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56240/0 (socket says 172.21.15.49:56240) 2024-01-22T05:19:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb75a00700 1 -- 172.21.15.49:0/2388253501 learned_addr learned my addr 172.21.15.49:0/2388253501 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb75000700 1 --2- 172.21.15.49:0/2388253501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22e0c80 0x229c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb76400700 1 --2- 172.21.15.49:0/2388253501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x229de40 0x2296990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb75a00700 1 -- 172.21.15.49:0/2388253501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22e0c80 msgr2=0x229c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb75a00700 1 --2- 172.21.15.49:0/2388253501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22e0c80 0x229c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb75a00700 1 -- 172.21.15.49:0/2388253501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x229de40 msgr2=0x2296990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb75a00700 1 --2- 172.21.15.49:0/2388253501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x229de40 0x2296990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb75a00700 1 -- 172.21.15.49:0/2388253501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2216730 con 0x22de3a0 2024-01-22T05:19:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb76400700 1 --2- 172.21.15.49:0/2388253501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x229de40 0x2296990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:19:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.132+0000 7fcb75a00700 1 --2- 172.21.15.49:0/2388253501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22de3a0 0x22de780 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 rx=0x7fcb60014820 tx=0x7fcb60017000).ready entity=mon.0 client_cookie=9fe652ba94ec0a9e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.136+0000 7fcb65600700 1 -- 172.21.15.49:0/2388253501 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60011d60 con 0x22de3a0 2024-01-22T05:19:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.136+0000 7fcb65600700 1 -- 172.21.15.49:0/2388253501 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb60013470 con 0x22de3a0 2024-01-22T05:19:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.136+0000 7fcb65600700 1 -- 172.21.15.49:0/2388253501 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb600137f0 con 0x22de3a0 2024-01-22T05:19:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.136+0000 7fcb828b2740 1 -- 172.21.15.49:0/2388253501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22de3a0 msgr2=0x22de780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.136+0000 7fcb828b2740 1 --2- 172.21.15.49:0/2388253501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22de3a0 0x22de780 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 rx=0x7fcb60014820 tx=0x7fcb60017000).stop 2024-01-22T05:19:19.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.136+0000 7fcb828b2740 1 -- 172.21.15.49:0/2388253501 shutdown_connections 2024-01-22T05:19:19.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.136+0000 7fcb828b2740 1 --2- 172.21.15.49:0/2388253501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x229de40 0x2296990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.136+0000 7fcb828b2740 1 --2- 172.21.15.49:0/2388253501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22e0c80 0x229c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.136+0000 7fcb828b2740 1 --2- 172.21.15.49:0/2388253501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22de3a0 0x22de780 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.136+0000 7fcb828b2740 1 -- 172.21.15.49:0/2388253501 >> 172.21.15.49:0/2388253501 conn(0x207b550 msgr2=0x229d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:19.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.136+0000 7fcb828b2740 1 -- 172.21.15.49:0/2388253501 shutdown_connections 2024-01-22T05:19:19.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.136+0000 7fcb828b2740 1 -- 172.21.15.49:0/2388253501 wait complete. 2024-01-22T05:19:19.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.136+0000 7fcb828b2740 1 -- start start 2024-01-22T05:19:19.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.140+0000 7fcb828b2740 1 Processor -- start 2024-01-22T05:19:19.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.140+0000 7fcb828b2740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x229de40 0x22c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.140+0000 7fcb828b2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22de3a0 0x22bffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.140+0000 7fcb828b2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x22c9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.140+0000 7fcb828b2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x21e8650 con 0x22e0c80 2024-01-22T05:19:19.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.140+0000 7fcb828b2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x22fc390 con 0x22de3a0 2024-01-22T05:19:19.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.140+0000 7fcb828b2740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x22f81a0 con 0x229de40 2024-01-22T05:19:19.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.140+0000 7fcb828b2740 10 client.0 ll_register_callbacks cb 0x2255020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:19:19.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.140+0000 7fcb76400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x22c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.140+0000 7fcb76400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x22c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56246/0 (socket says 172.21.15.49:56246) 2024-01-22T05:19:19.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.140+0000 7fcb76400700 1 -- 172.21.15.49:0/1706954367 learned_addr learned my addr 172.21.15.49:0/1706954367 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:19.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.140+0000 7fcb75a00700 1 --2- 172.21.15.49:0/1706954367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x229de40 0x22c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.140+0000 7fcb75000700 1 --2- 172.21.15.49:0/1706954367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22de3a0 0x22bffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb76400700 1 -- 172.21.15.49:0/1706954367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x229de40 msgr2=0x22c27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:19.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb76400700 1 --2- 172.21.15.49:0/1706954367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x229de40 0x22c27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb76400700 1 -- 172.21.15.49:0/1706954367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22de3a0 msgr2=0x22bffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:19.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb76400700 1 --2- 172.21.15.49:0/1706954367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22de3a0 0x22bffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb76400700 1 -- 172.21.15.49:0/1706954367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb60014440 con 0x22e0c80 2024-01-22T05:19:19.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb75a00700 1 --2- 172.21.15.49:0/1706954367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x229de40 0x22c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:19.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb76400700 1 --2- 172.21.15.49:0/1706954367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x22c9640 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7fcb68007fc0 tx=0x7fcb6800b040).ready entity=mon.0 client_cookie=34c587de55a0db3f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:19.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb5e000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:19:19.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb5e000700 1 -- 172.21.15.49:0/1706954367 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800e040 con 0x22e0c80 2024-01-22T05:19:19.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb5e000700 1 -- 172.21.15.49:0/1706954367 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fcb68012e50 con 0x22e0c80 2024-01-22T05:19:19.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb828b2740 1 -- 172.21.15.49:0/1706954367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x22131a0 con 0x22e0c80 2024-01-22T05:19:19.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb5e000700 1 -- 172.21.15.49:0/1706954367 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=142) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb68016670 con 0x22e0c80 2024-01-22T05:19:19.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb828b2740 10 client.10284 fetch_fsmap learned FSMap version 142 2024-01-22T05:19:19.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb828b2740 1 -- 172.21.15.49:0/1706954367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=142,monmap=2+}) v3 -- 0x2211960 con 0x22e0c80 2024-01-22T05:19:19.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb5e000700 1 -- 172.21.15.49:0/1706954367 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x22131a0 con 0x22e0c80 2024-01-22T05:19:19.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb5e000700 1 -- 172.21.15.49:0/1706954367 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 142) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcb68014040 con 0x22e0c80 2024-01-22T05:19:19.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb828b2740 10 client.10284 fetch_fsmap finished waiting for FSMap version 142 2024-01-22T05:19:19.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb828b2740 10 client.10284 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:19:19.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb828b2740 20 client.10284 populate_metadata read hostname 'smithi049' 2024-01-22T05:19:19.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb828b2740 1 --2- 172.21.15.49:0/1706954367 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x229b730 0x22c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb828b2740 4 client.10284 mds_command: new command op to 10104 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:19:19.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb828b2740 1 -- 172.21.15.49:0/1706954367 --> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x22096f0 con 0x229b730 2024-01-22T05:19:19.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb75a00700 1 --2- 172.21.15.49:0/1706954367 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x229b730 0x22c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb5e000700 10 client.10284 ms_handle_connect on v2:172.21.15.49:6836/3574461601 2024-01-22T05:19:19.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.144+0000 7fcb75a00700 1 --2- 172.21.15.49:0/1706954367 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x229b730 0x22c7ba0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=98d3d2bc9213c84b server_cookie=d948dc6c17de6a96 in_seq=0 out_seq=0 2024-01-22T05:19:19.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.148+0000 7fcb5e000700 1 -- 172.21.15.49:0/1706954367 <== mds.0 v2:172.21.15.49:6836/3574461601 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x22096f0 con 0x229b730 2024-01-22T05:19:19.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.148+0000 7fcb5e000700 10 client.10284 handle_command_reply: tid=0 2024-01-22T05:19:19.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.148+0000 7fcb828b2740 1 client.10284 shutdown 2024-01-22T05:19:19.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.148+0000 7fcb828b2740 1 -- 172.21.15.49:0/1706954367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 msgr2=0x22c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.148+0000 7fcb828b2740 1 --2- 172.21.15.49:0/1706954367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x22c9640 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7fcb68007fc0 tx=0x7fcb6800b040).stop 2024-01-22T05:19:19.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.148+0000 7fcb828b2740 1 -- 172.21.15.49:0/1706954367 shutdown_connections 2024-01-22T05:19:19.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.148+0000 7fcb828b2740 1 --2- 172.21.15.49:0/1706954367 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x229b730 0x22c7ba0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.148+0000 7fcb828b2740 1 --2- 172.21.15.49:0/1706954367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x22c9640 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.148+0000 7fcb828b2740 1 --2- 172.21.15.49:0/1706954367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22de3a0 0x22bffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.148+0000 7fcb828b2740 1 --2- 172.21.15.49:0/1706954367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x229de40 0x22c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.148+0000 7fcb5e000700 0 client.10284 ms_handle_reset on v2:172.21.15.49:6836/3574461601 2024-01-22T05:19:19.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.148+0000 7fcb828b2740 1 -- 172.21.15.49:0/1706954367 >> 172.21.15.49:0/1706954367 conn(0x207b550 msgr2=0x22e4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:19.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.148+0000 7fcb828b2740 1 -- 172.21.15.49:0/1706954367 shutdown_connections 2024-01-22T05:19:19.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.148+0000 7fcb828b2740 1 -- 172.21.15.49:0/1706954367 wait complete. 2024-01-22T05:19:19.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.148+0000 7fcb828b2740 20 client.10284 trim_cache size 0 max 16384 2024-01-22T05:19:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.168+0000 7fcb828b2740 1 Processor -- start 2024-01-22T05:19:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.168+0000 7fcb828b2740 1 -- start start 2024-01-22T05:19:19.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb828b2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x229de40 0x22c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb828b2740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22de3a0 0x22dfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb828b2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x2299af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb828b2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700599d0 con 0x22e0c80 2024-01-22T05:19:19.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb828b2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x22deaf0 con 0x229de40 2024-01-22T05:19:19.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb828b2740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x22096f0 con 0x22de3a0 2024-01-22T05:19:19.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb76400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x2299af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb76400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x2299af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56260/0 (socket says 172.21.15.49:56260) 2024-01-22T05:19:19.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb76400700 1 -- 172.21.15.49:0/4113767055 learned_addr learned my addr 172.21.15.49:0/4113767055 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:19.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb75000700 1 --2- 172.21.15.49:0/4113767055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22de3a0 0x22dfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb75a00700 1 --2- 172.21.15.49:0/4113767055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x229de40 0x22c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb76400700 1 -- 172.21.15.49:0/4113767055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22de3a0 msgr2=0x22dfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:19.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb76400700 1 --2- 172.21.15.49:0/4113767055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22de3a0 0x22dfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb76400700 1 -- 172.21.15.49:0/4113767055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x229de40 msgr2=0x22c2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:19.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb76400700 1 --2- 172.21.15.49:0/4113767055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x229de40 0x22c2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb76400700 1 -- 172.21.15.49:0/4113767055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb70067df0 con 0x22e0c80 2024-01-22T05:19:19.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb75a00700 1 --2- 172.21.15.49:0/4113767055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x229de40 0x22c2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:19.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb76400700 1 --2- 172.21.15.49:0/4113767055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x2299af0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 rx=0x7fcb68009c20 tx=0x7fcb68022000).ready entity=mon.0 client_cookie=168a9f66f3a4218c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:19.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb66000700 1 -- 172.21.15.49:0/4113767055 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800e070 con 0x22e0c80 2024-01-22T05:19:19.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb66000700 1 -- 172.21.15.49:0/4113767055 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6800f040 con 0x22e0c80 2024-01-22T05:19:19.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb66000700 1 -- 172.21.15.49:0/4113767055 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68012e50 con 0x22e0c80 2024-01-22T05:19:19.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb828b2740 1 -- 172.21.15.49:0/4113767055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 msgr2=0x2299af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.172+0000 7fcb828b2740 1 --2- 172.21.15.49:0/4113767055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x2299af0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 rx=0x7fcb68009c20 tx=0x7fcb68022000).stop 2024-01-22T05:19:19.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.176+0000 7fcb828b2740 1 -- 172.21.15.49:0/4113767055 shutdown_connections 2024-01-22T05:19:19.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.176+0000 7fcb828b2740 1 --2- 172.21.15.49:0/4113767055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x2299af0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.176+0000 7fcb828b2740 1 --2- 172.21.15.49:0/4113767055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22de3a0 0x22dfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.176+0000 7fcb828b2740 1 --2- 172.21.15.49:0/4113767055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x229de40 0x22c2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.176+0000 7fcb828b2740 1 -- 172.21.15.49:0/4113767055 >> 172.21.15.49:0/4113767055 conn(0x207b550 msgr2=0x229d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:19.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.176+0000 7fcb828b2740 1 -- 172.21.15.49:0/4113767055 shutdown_connections 2024-01-22T05:19:19.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.176+0000 7fcb828b2740 1 -- 172.21.15.49:0/4113767055 wait complete. 2024-01-22T05:19:19.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.176+0000 7fcb828b2740 1 -- start start 2024-01-22T05:19:19.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.176+0000 7fcb828b2740 1 Processor -- start 2024-01-22T05:19:19.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x229de40 0x234d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22de3a0 0x22f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x22f7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x234d9a0 con 0x22e0c80 2024-01-22T05:19:19.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x22f7960 con 0x22de3a0 2024-01-22T05:19:19.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x22fb410 con 0x229de40 2024-01-22T05:19:19.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 10 client.0 ll_register_callbacks cb 0x7fcb68007bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:19:19.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb76400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x22f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb76400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x22f7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56264/0 (socket says 172.21.15.49:56264) 2024-01-22T05:19:19.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb76400700 1 -- 172.21.15.49:0/2112577156 learned_addr learned my addr 172.21.15.49:0/2112577156 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:19.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb75a00700 1 --2- 172.21.15.49:0/2112577156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x229de40 0x234d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb75000700 1 --2- 172.21.15.49:0/2112577156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22de3a0 0x22f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb76400700 1 -- 172.21.15.49:0/2112577156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x229de40 msgr2=0x234d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:19.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb76400700 1 --2- 172.21.15.49:0/2112577156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x229de40 0x234d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb76400700 1 -- 172.21.15.49:0/2112577156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22de3a0 msgr2=0x22f6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:19.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb76400700 1 --2- 172.21.15.49:0/2112577156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22de3a0 0x22f6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb76400700 1 -- 172.21.15.49:0/2112577156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2211960 con 0x22e0c80 2024-01-22T05:19:19.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb76400700 1 --2- 172.21.15.49:0/2112577156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x22f7470 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7fcb68000f80 tx=0x7fcb6800b070).ready entity=mon.0 client_cookie=7b6733bdfb50f5bf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:19.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb5e000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:19:19.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb5e000700 1 -- 172.21.15.49:0/2112577156 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800e040 con 0x22e0c80 2024-01-22T05:19:19.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb5e000700 1 -- 172.21.15.49:0/2112577156 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fcb6801f600 con 0x22e0c80 2024-01-22T05:19:19.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 1 -- 172.21.15.49:0/2112577156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb60013470 con 0x22e0c80 2024-01-22T05:19:19.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb5e000700 1 -- 172.21.15.49:0/2112577156 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=142) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb68016e50 con 0x22e0c80 2024-01-22T05:19:19.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 10 client.10290 fetch_fsmap learned FSMap version 142 2024-01-22T05:19:19.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 1 -- 172.21.15.49:0/2112577156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=142,monmap=2+}) v3 -- 0x22116b0 con 0x22e0c80 2024-01-22T05:19:19.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb5e000700 1 -- 172.21.15.49:0/2112577156 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb60013470 con 0x22e0c80 2024-01-22T05:19:19.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb5e000700 1 -- 172.21.15.49:0/2112577156 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 142) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcb680122f0 con 0x22e0c80 2024-01-22T05:19:19.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 10 client.10290 fetch_fsmap finished waiting for FSMap version 142 2024-01-22T05:19:19.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 10 client.10290 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:19:19.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 20 client.10290 populate_metadata read hostname 'smithi049' 2024-01-22T05:19:19.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 1 --2- 172.21.15.49:0/2112577156 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x229a6d0 0x229aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 4 client.10290 mds_command: new command op to 10104 tid=0[{"prefix": "status"}] 2024-01-22T05:19:19.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.180+0000 7fcb828b2740 1 -- 172.21.15.49:0/2112577156 --> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] -- command(tid 0: {"prefix": "status"}) v1 -- 0x20d24e0 con 0x229a6d0 2024-01-22T05:19:19.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb75a00700 1 --2- 172.21.15.49:0/2112577156 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x229a6d0 0x229aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb5e000700 10 client.10290 ms_handle_connect on v2:172.21.15.49:6836/3574461601 2024-01-22T05:19:19.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb75a00700 1 --2- 172.21.15.49:0/2112577156 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x229a6d0 0x229aab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b7e0d00231703207 server_cookie=3bd438b2e45cbd69 in_seq=0 out_seq=0 2024-01-22T05:19:19.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb5e000700 1 -- 172.21.15.49:0/2112577156 <== mds.0 v2:172.21.15.49:6836/3574461601 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+335 (crc 0 0 0) 0x20d24e0 con 0x229a6d0 2024-01-22T05:19:19.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb5e000700 10 client.10290 handle_command_reply: tid=0 2024-01-22T05:19:19.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb828b2740 1 client.10290 shutdown 2024-01-22T05:19:19.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb828b2740 1 -- 172.21.15.49:0/2112577156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 msgr2=0x22f7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb828b2740 1 --2- 172.21.15.49:0/2112577156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x22f7470 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7fcb68000f80 tx=0x7fcb6800b070).stop 2024-01-22T05:19:19.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb828b2740 1 -- 172.21.15.49:0/2112577156 shutdown_connections 2024-01-22T05:19:19.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb828b2740 1 --2- 172.21.15.49:0/2112577156 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x229a6d0 0x229aab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb828b2740 1 --2- 172.21.15.49:0/2112577156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22e0c80 0x22f7470 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb828b2740 1 --2- 172.21.15.49:0/2112577156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22de3a0 0x22f6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb828b2740 1 --2- 172.21.15.49:0/2112577156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x229de40 0x234d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb5e000700 0 client.10290 ms_handle_reset on v2:172.21.15.49:6836/3574461601 2024-01-22T05:19:19.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb828b2740 1 -- 172.21.15.49:0/2112577156 >> 172.21.15.49:0/2112577156 conn(0x207b550 msgr2=0x22c2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:19.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb828b2740 1 -- 172.21.15.49:0/2112577156 shutdown_connections 2024-01-22T05:19:19.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.184+0000 7fcb828b2740 1 -- 172.21.15.49:0/2112577156 wait complete. 2024-01-22T05:19:19.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.188+0000 7fcb828b2740 20 client.10290 trim_cache size 0 max 16384 2024-01-22T05:19:19.187 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:19:19.187 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:19:19.187 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:19:19.187 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 10104, 2024-01-22T05:19:19.187 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:19:19.187 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:19:19.187 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:19:19.188 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 11.112355131999999, 2024-01-22T05:19:19.188 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 142, 2024-01-22T05:19:19.188 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 184, 2024-01-22T05:19:19.188 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 184, 2024-01-22T05:19:19.188 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 16.463986827999999 2024-01-22T05:19:19.188 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:19:19.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.188+0000 7fcb78400700 1 -- 172.21.15.49:0/3558762765 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcb4805a510 msgr2=0x7fcb4805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.188+0000 7fcb78400700 1 --2- 172.21.15.49:0/3558762765 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcb4805a510 0x7fcb4805c9d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fcb60009fd0 tx=0x7fcb60009060).stop 2024-01-22T05:19:19.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.188+0000 7fcb78400700 1 -- 172.21.15.49:0/3558762765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb700a8b10 msgr2=0x7fcb70167450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.188+0000 7fcb78400700 1 --2- 172.21.15.49:0/3558762765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb700a8b10 0x7fcb70167450 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fcb58014000 tx=0x7fcb58017000).stop 2024-01-22T05:19:19.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.188+0000 7fcb78400700 1 -- 172.21.15.49:0/3558762765 shutdown_connections 2024-01-22T05:19:19.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.188+0000 7fcb78400700 1 --2- 172.21.15.49:0/3558762765 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcb4805a510 0x7fcb4805c9d0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.188+0000 7fcb78400700 1 --2- 172.21.15.49:0/3558762765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb700a8f90 0x7fcb70167940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.188+0000 7fcb78400700 1 --2- 172.21.15.49:0/3558762765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb700a8b10 0x7fcb70167450 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.188+0000 7fcb78400700 1 --2- 172.21.15.49:0/3558762765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb70066fb0 0x7fcb70135a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.188+0000 7fcb78400700 1 -- 172.21.15.49:0/3558762765 >> 172.21.15.49:0/3558762765 conn(0x7fcb700c6540 msgr2=0x7fcb700c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:19.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.188+0000 7fcb78400700 1 -- 172.21.15.49:0/3558762765 shutdown_connections 2024-01-22T05:19:19.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.188+0000 7fcb78400700 1 -- 172.21.15.49:0/3558762765 wait complete. 2024-01-22T05:19:19.212 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:19:19.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.360+0000 7fe0b2600700 1 Processor -- start 2024-01-22T05:19:19.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.360+0000 7fe0b2600700 1 -- start start 2024-01-22T05:19:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.364+0000 7fe0b2600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe0ac062a70 0x7fe0ac152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.364+0000 7fe0b2600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac155cb0 con 0x7fe0ac062690 2024-01-22T05:19:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.364+0000 7fe0b2600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac0acb60 con 0x7fe0ac0c9580 2024-01-22T05:19:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.364+0000 7fe0b2600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ac1556a0 con 0x7fe0ac062a70 2024-01-22T05:19:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.364+0000 7fe0aaa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe0ac062a70 0x7fe0ac152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.368+0000 7fe0aaa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe0ac062a70 0x7fe0ac152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56272/0 (socket says 172.21.15.49:56272) 2024-01-22T05:19:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.368+0000 7fe0aaa00700 1 -- 172.21.15.49:0/507124676 learned_addr learned my addr 172.21.15.49:0/507124676 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.368+0000 7fe0aaa00700 1 -- 172.21.15.49:0/507124676 >> v1:172.21.15.110:6789/0 conn(0x7fe0ac0c9580 legacy=0x7fe0ac0c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.368+0000 7fe0aaa00700 1 -- 172.21.15.49:0/507124676 >> v1:172.21.15.49:6789/0 conn(0x7fe0ac062690 legacy=0x7fe0ac0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.368+0000 7fe0aaa00700 1 -- 172.21.15.49:0/507124676 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac156560 con 0x7fe0ac062a70 2024-01-22T05:19:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.368+0000 7fe0aaa00700 1 --2- 172.21.15.49:0/507124676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0ac062a70 0x7fe0ac152030 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7fe0ac0accf0 tx=0x7fe0940090f0).ready entity=mon.0 client_cookie=28df60f61f3535 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:19.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.368+0000 7fe0aa000700 1 -- 172.21.15.49:0/507124676 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09400b600 con 0x7fe0ac062a70 2024-01-22T05:19:19.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.368+0000 7fe0aa000700 1 -- 172.21.15.49:0/507124676 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09400b760 con 0x7fe0ac062a70 2024-01-22T05:19:19.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.368+0000 7fe0aa000700 1 -- 172.21.15.49:0/507124676 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09400bae0 con 0x7fe0ac062a70 2024-01-22T05:19:19.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.368+0000 7fe0b2600700 1 -- 172.21.15.49:0/507124676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0ac062a70 msgr2=0x7fe0ac152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.368+0000 7fe0b2600700 1 --2- 172.21.15.49:0/507124676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0ac062a70 0x7fe0ac152030 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7fe0ac0accf0 tx=0x7fe0940090f0).stop 2024-01-22T05:19:19.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.372+0000 7fe0b2600700 1 -- 172.21.15.49:0/507124676 shutdown_connections 2024-01-22T05:19:19.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.372+0000 7fe0b2600700 1 --2- 172.21.15.49:0/507124676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0ac062a70 0x7fe0ac152030 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.372+0000 7fe0b2600700 1 -- 172.21.15.49:0/507124676 >> 172.21.15.49:0/507124676 conn(0x7fe0ac0ca0f0 msgr2=0x7fe0ac0ca500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:19.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.372+0000 7fe0b2600700 1 -- 172.21.15.49:0/507124676 shutdown_connections 2024-01-22T05:19:19.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.372+0000 7fe0b2600700 1 -- 172.21.15.49:0/507124676 wait complete. 2024-01-22T05:19:19.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.376+0000 7fe0b2600700 1 Processor -- start 2024-01-22T05:19:19.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.376+0000 7fe0b2600700 1 -- start start 2024-01-22T05:19:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.376+0000 7fe0b2600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0ac062690 0x7fe0ac0c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.376+0000 7fe0b2600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0ac062a70 0x7fe0ac1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.376+0000 7fe0b2600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0ac0c9580 0x7fe0ac14bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.376+0000 7fe0b2600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac156f00 con 0x7fe0ac062a70 2024-01-22T05:19:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.376+0000 7fe0b2600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac0c2770 con 0x7fe0ac0c9580 2024-01-22T05:19:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.376+0000 7fe0b2600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac0c2a50 con 0x7fe0ac062690 2024-01-22T05:19:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.376+0000 7fe0aaa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0ac062a70 0x7fe0ac1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.376+0000 7fe0aaa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0ac062a70 0x7fe0ac1566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56288/0 (socket says 172.21.15.49:56288) 2024-01-22T05:19:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.376+0000 7fe0aaa00700 1 -- 172.21.15.49:0/1387228517 learned_addr learned my addr 172.21.15.49:0/1387228517 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.376+0000 7fe0ab400700 1 --2- 172.21.15.49:0/1387228517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0ac062690 0x7fe0ac0c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.376+0000 7fe0b1000700 1 --2- 172.21.15.49:0/1387228517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0ac0c9580 0x7fe0ac14bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.380+0000 7fe0aaa00700 1 -- 172.21.15.49:0/1387228517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0ac062690 msgr2=0x7fe0ac0c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.380+0000 7fe0aaa00700 1 --2- 172.21.15.49:0/1387228517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0ac062690 0x7fe0ac0c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.380+0000 7fe0aaa00700 1 -- 172.21.15.49:0/1387228517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0ac0c9580 msgr2=0x7fe0ac14bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.380+0000 7fe0aaa00700 1 --2- 172.21.15.49:0/1387228517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0ac0c9580 0x7fe0ac14bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.380+0000 7fe0aaa00700 1 -- 172.21.15.49:0/1387228517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe094009370 con 0x7fe0ac062a70 2024-01-22T05:19:19.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.380+0000 7fe0aaa00700 1 --2- 172.21.15.49:0/1387228517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0ac062a70 0x7fe0ac1566f0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7fe094009130 tx=0x7fe094017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:19.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.380+0000 7fe0a2a00700 1 -- 172.21.15.49:0/1387228517 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09400bee0 con 0x7fe0ac062a70 2024-01-22T05:19:19.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.380+0000 7fe0a2a00700 1 -- 172.21.15.49:0/1387228517 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09400b8d0 con 0x7fe0ac062a70 2024-01-22T05:19:19.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.380+0000 7fe0b2600700 1 -- 172.21.15.49:0/1387228517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac0c2d30 con 0x7fe0ac062a70 2024-01-22T05:19:19.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.380+0000 7fe0a2a00700 1 -- 172.21.15.49:0/1387228517 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094024470 con 0x7fe0ac062a70 2024-01-22T05:19:19.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.380+0000 7fe0b2600700 1 -- 172.21.15.49:0/1387228517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac14c0b0 con 0x7fe0ac062a70 2024-01-22T05:19:19.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.380+0000 7fe0b2600700 1 -- 172.21.15.49:0/1387228517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ac082af0 con 0x7fe0ac062a70 2024-01-22T05:19:19.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.384+0000 7fe0a2a00700 1 -- 172.21.15.49:0/1387228517 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe094021070 con 0x7fe0ac062a70 2024-01-22T05:19:19.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.384+0000 7fe0a2a00700 1 --2- 172.21.15.49:0/1387228517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe08405a510 0x7fe08405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:19.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.384+0000 7fe0a2a00700 1 -- 172.21.15.49:0/1387228517 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe094076560 con 0x7fe0ac062a70 2024-01-22T05:19:19.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.384+0000 7fe0ab400700 1 --2- 172.21.15.49:0/1387228517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe08405a510 0x7fe08405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:19.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.388+0000 7fe0ab400700 1 --2- 172.21.15.49:0/1387228517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe08405a510 0x7fe08405c9d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fe09c003900 tx=0x7fe09c007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:19.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.392+0000 7fe0a2a00700 1 -- 172.21.15.49:0/1387228517 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe094049b20 con 0x7fe0ac062a70 2024-01-22T05:19:19.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.592+0000 7fe0b2600700 1 -- 172.21.15.49:0/1387228517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe0ac152c80 con 0x7fe0ac062a70 2024-01-22T05:19:19.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.592+0000 7fe0a2a00700 1 -- 172.21.15.49:0/1387228517 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v142) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe094029070 con 0x7fe0ac062a70 2024-01-22T05:19:19.593 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:19:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.596+0000 7fe0b2600700 1 -- 172.21.15.49:0/1387228517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe08405a510 msgr2=0x7fe08405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.596+0000 7fe0b2600700 1 --2- 172.21.15.49:0/1387228517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe08405a510 0x7fe08405c9d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fe09c003900 tx=0x7fe09c007d40).stop 2024-01-22T05:19:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.596+0000 7fe0b2600700 1 -- 172.21.15.49:0/1387228517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0ac062a70 msgr2=0x7fe0ac1566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.596+0000 7fe0b2600700 1 --2- 172.21.15.49:0/1387228517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0ac062a70 0x7fe0ac1566f0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7fe094009130 tx=0x7fe094017000).stop 2024-01-22T05:19:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.596+0000 7fe0b2600700 1 -- 172.21.15.49:0/1387228517 shutdown_connections 2024-01-22T05:19:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.596+0000 7fe0b2600700 1 --2- 172.21.15.49:0/1387228517 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe08405a510 0x7fe08405c9d0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.596+0000 7fe0b2600700 1 --2- 172.21.15.49:0/1387228517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0ac0c9580 0x7fe0ac14bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.596+0000 7fe0b2600700 1 --2- 172.21.15.49:0/1387228517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0ac062a70 0x7fe0ac1566f0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.596+0000 7fe0b2600700 1 --2- 172.21.15.49:0/1387228517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0ac062690 0x7fe0ac0c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.596+0000 7fe0b2600700 1 -- 172.21.15.49:0/1387228517 >> 172.21.15.49:0/1387228517 conn(0x7fe0ac0ca0f0 msgr2=0x7fe0ac1532a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.596+0000 7fe0b2600700 1 -- 172.21.15.49:0/1387228517 shutdown_connections 2024-01-22T05:19:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:19.596+0000 7fe0b2600700 1 -- 172.21.15.49:0/1387228517 wait complete. 2024-01-22T05:19:19.620 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-22T05:19:19.620 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:19:19.621 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:19:19.621 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:19:19.621 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:19:19.621 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-22T05:19:19.621 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-22T05:19:19.621 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:19:19.621 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:19:19.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:19.621 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:19:19.638 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:19:19.638 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:19:19.638 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:19:19.638 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:19.639 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:19:19.639 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:19.639 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:19:19.639 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:19:19.639 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:19:19.639 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:19:19.639 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:19:19.639 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:19:19.639 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:19:19.639 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41611sec preferred_lft 41611sec 2024-01-22T05:19:19.639 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:19:19.639 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:19.639 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:19:19.639 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:19:19.640 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:19:19.640 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:19:19.640 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:19:19.640 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:19:19.640 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:19:19.640 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:19:19.640 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:19:19.640 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:19.640 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:19:19.640 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:19:19.640 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:19:19.640 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:19.640 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::7ce7:e3ff:fed1:1e88/64 scope link 2024-01-22T05:19:19.640 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:19.640 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:19:19.641 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 82:c1:48:e7:c7:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:19:19.641 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::80c1:48ff:fee7:c731/64 scope link 2024-01-22T05:19:19.641 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:19.641 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:19:19.641 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:19:19.641 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3426:32ff:feee:c4c9/64 scope link 2024-01-22T05:19:19.641 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:19.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:19.642 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:19:19.724 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:19:19.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:19.727 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:19:19.790 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:19:19.791 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:19:19.791 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:19:19.791 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:19:19.791 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:19:19.791 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:19:19.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:19.791 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:19:19.791 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:19:19.791 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:19:19.791 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:19:19.792 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:19:19.792 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:19:19.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:19.935 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:19:19.953 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:19:19.953 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:19:19.954 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:19:19.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:19.955 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-22T05:19:20.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:20.038 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-22T05:19:20.099 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:19:20.099 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:19:20.221 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:19:20.221 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:19:20.247 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:19:20.247 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:19:20.252 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:19:20.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:20.252 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:19:20.283 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:19:20.283 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-01-22T05:19:20.283 DEBUG:teuthology.orchestra.run.smithi049:> import uuid 2024-01-22T05:19:20.283 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:19:20.283 DEBUG:teuthology.orchestra.run.smithi049:> n = 1000 2024-01-22T05:19:20.283 DEBUG:teuthology.orchestra.run.smithi049:> create_hard_links = False 2024-01-22T05:19:20.283 DEBUG:teuthology.orchestra.run.smithi049:> if 0 > 0: 2024-01-22T05:19:20.283 DEBUG:teuthology.orchestra.run.smithi049:> create_hard_links = True 2024-01-22T05:19:20.283 DEBUG:teuthology.orchestra.run.smithi049:> path = "/home/ubuntu/cephtest/mnt.0/scrub-new-files/file" 2024-01-22T05:19:20.283 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:19:20.283 DEBUG:teuthology.orchestra.run.smithi049:> dpath = os.path.dirname(path) 2024-01-22T05:19:20.283 DEBUG:teuthology.orchestra.run.smithi049:> fnameprefix = os.path.basename(path) 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> os.makedirs(dpath, exist_ok=True) 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> try: 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> for i in range(n): 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> with open(fpath, '"'"'w'"'"') as f: 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> f.write(f"{i}") 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> f.flush() 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(f.fileno()) 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> os.unlink(fpath) 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-01-22T05:19:20.284 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(dirfd) 2024-01-22T05:19:20.285 DEBUG:teuthology.orchestra.run.smithi049:> if create_hard_links: 2024-01-22T05:19:20.285 DEBUG:teuthology.orchestra.run.smithi049:> for j in range(0): 2024-01-22T05:19:20.285 DEBUG:teuthology.orchestra.run.smithi049:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-01-22T05:19:20.285 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-01-22T05:19:20.285 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(dirfd) 2024-01-22T05:19:20.285 DEBUG:teuthology.orchestra.run.smithi049:> finally: 2024-01-22T05:19:20.285 DEBUG:teuthology.orchestra.run.smithi049:> os.close(dirfd) 2024-01-22T05:19:20.285 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-01-22T05:19:21.424 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.12:0 scrub status 2024-01-22T05:19:21.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.644+0000 7faea5e00700 1 Processor -- start 2024-01-22T05:19:21.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.648+0000 7faea5e00700 1 -- start start 2024-01-22T05:19:21.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.648+0000 7faea5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faea0064540 0x7faea015c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.648+0000 7faea5e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea00bc950 con 0x7faea0151c20 2024-01-22T05:19:21.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.648+0000 7faea5e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea00bc650 con 0x7faea00a9d90 2024-01-22T05:19:21.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.648+0000 7faea5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea0068b60 con 0x7faea0064540 2024-01-22T05:19:21.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.648+0000 7fae9e000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faea0151c20 0x7faea0063e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48178/0 (socket says 172.21.15.49:48178) 2024-01-22T05:19:21.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.648+0000 7fae9e000700 1 -- 172.21.15.49:0/2260164350 learned_addr learned my addr 172.21.15.49:0/2260164350 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:21.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9f400700 1 --2- 172.21.15.49:0/2260164350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faea0064540 0x7faea015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 -- 172.21.15.49:0/2260164350 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231616408 0 0) 0x7faea00bc950 con 0x7faea0151c20 2024-01-22T05:19:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 -- 172.21.15.49:0/2260164350 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae800033f0 con 0x7faea0151c20 2024-01-22T05:19:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 -- 172.21.15.49:0/2260164350 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 687706949 0 0) 0x7fae800033f0 con 0x7faea0151c20 2024-01-22T05:19:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 -- 172.21.15.49:0/2260164350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faea0064540 msgr2=0x7faea015c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 --2- 172.21.15.49:0/2260164350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faea0064540 0x7faea015c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 -- 172.21.15.49:0/2260164350 >> v1:172.21.15.110:6789/0 conn(0x7faea00a9d90 legacy=0x7faea0068450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 -- 172.21.15.49:0/2260164350 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea0068e10 con 0x7faea0151c20 2024-01-22T05:19:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 -- 172.21.15.49:0/2260164350 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fae88001470 con 0x7faea0151c20 2024-01-22T05:19:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 -- 172.21.15.49:0/2260164350 >> v1:172.21.15.49:6789/0 conn(0x7faea0151c20 legacy=0x7faea0063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 --2- 172.21.15.49:0/2260164350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae80003910 0x7fae80003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 --2- 172.21.15.49:0/2260164350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae80004690 0x7fae80004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 --2- 172.21.15.49:0/2260164350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faea0064540 0x7fae80005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 -- 172.21.15.49:0/2260164350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea0068b60 con 0x7fae80003910 2024-01-22T05:19:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 -- 172.21.15.49:0/2260164350 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8000b8e0 con 0x7fae80004690 2024-01-22T05:19:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 -- 172.21.15.49:0/2260164350 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8000ba50 con 0x7faea0064540 2024-01-22T05:19:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9f400700 1 --2- 172.21.15.49:0/2260164350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faea0064540 0x7fae80005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9ea00700 1 --2- 172.21.15.49:0/2260164350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae80003910 0x7fae80003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9e000700 1 --2- 172.21.15.49:0/2260164350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae80004690 0x7fae80004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9f400700 1 -- 172.21.15.49:0/2260164350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae80004690 msgr2=0x7fae80004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9f400700 1 --2- 172.21.15.49:0/2260164350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae80004690 0x7fae80004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9f400700 1 -- 172.21.15.49:0/2260164350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae80003910 msgr2=0x7fae80003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9f400700 1 --2- 172.21.15.49:0/2260164350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae80003910 0x7fae80003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9f400700 1 -- 172.21.15.49:0/2260164350 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae800033f0 con 0x7faea0064540 2024-01-22T05:19:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9f400700 1 --2- 172.21.15.49:0/2260164350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faea0064540 0x7fae80005000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7faea00a6810 tx=0x7fae9800b040).ready entity=mon.2 client_cookie=8d02111a515bdd58 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.652+0000 7fae9d600700 1 -- 172.21.15.49:0/2260164350 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae98009ac0 con 0x7faea0064540 2024-01-22T05:19:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.656+0000 7fae9d600700 1 -- 172.21.15.49:0/2260164350 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9800f040 con 0x7faea0064540 2024-01-22T05:19:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.656+0000 7fae9d600700 1 -- 172.21.15.49:0/2260164350 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9800ec10 con 0x7faea0064540 2024-01-22T05:19:21.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.656+0000 7faea5e00700 1 -- 172.21.15.49:0/2260164350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faea0064540 msgr2=0x7fae80005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.656+0000 7faea5e00700 1 --2- 172.21.15.49:0/2260164350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faea0064540 0x7fae80005000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7faea00a6810 tx=0x7fae9800b040).stop 2024-01-22T05:19:21.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.656+0000 7fae9f400700 1 -- 172.21.15.49:0/2260164350 reap_dead start 2024-01-22T05:19:21.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.656+0000 7faea5e00700 1 -- 172.21.15.49:0/2260164350 shutdown_connections 2024-01-22T05:19:21.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.656+0000 7faea5e00700 1 -- 172.21.15.49:0/2260164350 >> 172.21.15.49:0/2260164350 conn(0x7faea00c40f0 msgr2=0x7faea00c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:21.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.656+0000 7faea5e00700 1 -- 172.21.15.49:0/2260164350 shutdown_connections 2024-01-22T05:19:21.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.656+0000 7faea5e00700 1 -- 172.21.15.49:0/2260164350 wait complete. 2024-01-22T05:19:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.660+0000 7faea5e00700 1 Processor -- start 2024-01-22T05:19:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.660+0000 7faea5e00700 1 -- start start 2024-01-22T05:19:21.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.660+0000 7faea5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faea0064540 0x7faea014c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.660+0000 7faea5e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faea0149c30 0x7faea014a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.660+0000 7faea5e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faea00ab7d0 0x7faea00abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.660+0000 7faea5e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea014a5a0 con 0x7faea0064540 2024-01-22T05:19:21.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.660+0000 7faea5e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea00ac530 con 0x7faea0149c30 2024-01-22T05:19:21.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.660+0000 7faea5e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea00ac810 con 0x7faea00ab7d0 2024-01-22T05:19:21.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7fae9ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faea0064540 0x7faea014c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7fae9ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faea0064540 0x7faea014c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56302/0 (socket says 172.21.15.49:56302) 2024-01-22T05:19:21.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7fae9ea00700 1 -- 172.21.15.49:0/3449375410 learned_addr learned my addr 172.21.15.49:0/3449375410 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:21.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7fae9e000700 1 --2- 172.21.15.49:0/3449375410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faea0149c30 0x7faea014a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7fae9f400700 1 --2- 172.21.15.49:0/3449375410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faea00ab7d0 0x7faea00abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7fae9ea00700 1 -- 172.21.15.49:0/3449375410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faea00ab7d0 msgr2=0x7faea00abc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7fae9ea00700 1 --2- 172.21.15.49:0/3449375410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faea00ab7d0 0x7faea00abc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7fae9ea00700 1 -- 172.21.15.49:0/3449375410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faea0149c30 msgr2=0x7faea014a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7fae9ea00700 1 --2- 172.21.15.49:0/3449375410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faea0149c30 0x7faea014a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7fae9ea00700 1 -- 172.21.15.49:0/3449375410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea00acaf0 con 0x7faea0064540 2024-01-22T05:19:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7fae9ea00700 1 --2- 172.21.15.49:0/3449375410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faea0064540 0x7faea014c8e0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7fae90007700 tx=0x7fae90007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7fae96000700 1 -- 172.21.15.49:0/3449375410 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9000e500 con 0x7faea0064540 2024-01-22T05:19:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7fae96000700 1 -- 172.21.15.49:0/3449375410 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9000e660 con 0x7faea0064540 2024-01-22T05:19:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7faea5e00700 1 -- 172.21.15.49:0/3449375410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea00acdd0 con 0x7faea0064540 2024-01-22T05:19:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7fae96000700 1 -- 172.21.15.49:0/3449375410 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9000e9e0 con 0x7faea0064540 2024-01-22T05:19:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.664+0000 7faea5e00700 1 -- 172.21.15.49:0/3449375410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea00ac100 con 0x7faea0064540 2024-01-22T05:19:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.668+0000 7fae96000700 1 -- 172.21.15.49:0/3449375410 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fae9000ed50 con 0x7faea0064540 2024-01-22T05:19:21.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.668+0000 7fae96000700 1 --2- 172.21.15.49:0/3449375410 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae7805a510 0x7fae7805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.668+0000 7fae96000700 1 -- 172.21.15.49:0/3449375410 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fae90074300 con 0x7faea0064540 2024-01-22T05:19:21.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.668+0000 7fae9e000700 1 --2- 172.21.15.49:0/3449375410 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae7805a510 0x7fae7805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.668+0000 7fae9e000700 1 --2- 172.21.15.49:0/3449375410 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae7805a510 0x7fae7805c9d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7faea00ad450 tx=0x7fae88007040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:21.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.672+0000 7faeb026a740 1 Processor -- start 2024-01-22T05:19:21.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.672+0000 7faeb026a740 1 -- start start 2024-01-22T05:19:21.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7faeb026a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b6c4d0 0x2b6c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7faeb026a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b73570 0x2b739f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7faeb026a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73ee0 0x2b524f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7faeb026a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a84540 con 0x2b6c4d0 2024-01-22T05:19:21.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7faeb026a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a47e90 con 0x2b73ee0 2024-01-22T05:19:21.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7faeb026a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a4dd90 con 0x2b73570 2024-01-22T05:19:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7fae9ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b6c4d0 0x2b6c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7fae9ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b6c4d0 0x2b6c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56314/0 (socket says 172.21.15.49:56314) 2024-01-22T05:19:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7fae9ea00700 1 -- 172.21.15.49:0/392830104 learned_addr learned my addr 172.21.15.49:0/392830104 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7fae9e000700 1 --2- 172.21.15.49:0/392830104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b73570 0x2b739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7fae9f400700 1 --2- 172.21.15.49:0/392830104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73ee0 0x2b524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7fae9ea00700 1 -- 172.21.15.49:0/392830104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b73570 msgr2=0x2b739f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7fae9ea00700 1 --2- 172.21.15.49:0/392830104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b73570 0x2b739f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7fae9ea00700 1 -- 172.21.15.49:0/392830104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73ee0 msgr2=0x2b524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7fae9ea00700 1 --2- 172.21.15.49:0/392830104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73ee0 0x2b524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7fae9ea00700 1 -- 172.21.15.49:0/392830104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2ab24c0 con 0x2b6c4d0 2024-01-22T05:19:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7fae9f400700 1 --2- 172.21.15.49:0/392830104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73ee0 0x2b524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:21.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7fae9ea00700 1 --2- 172.21.15.49:0/392830104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b6c4d0 0x2b6c8b0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7fae9004b220 tx=0x7fae90012000).ready entity=mon.0 client_cookie=4f9a7f5491d2642d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:21.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7fae8ea00700 1 -- 172.21.15.49:0/392830104 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90049920 con 0x2b6c4d0 2024-01-22T05:19:21.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7fae8ea00700 1 -- 172.21.15.49:0/392830104 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae90072230 con 0x2b6c4d0 2024-01-22T05:19:21.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7fae8ea00700 1 -- 172.21.15.49:0/392830104 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae900723a0 con 0x2b6c4d0 2024-01-22T05:19:21.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7faeb026a740 1 -- 172.21.15.49:0/392830104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b6c4d0 msgr2=0x2b6c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7faeb026a740 1 --2- 172.21.15.49:0/392830104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b6c4d0 0x2b6c8b0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7fae9004b220 tx=0x7fae90012000).stop 2024-01-22T05:19:21.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7faeb026a740 1 -- 172.21.15.49:0/392830104 shutdown_connections 2024-01-22T05:19:21.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7faeb026a740 1 --2- 172.21.15.49:0/392830104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73ee0 0x2b524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7faeb026a740 1 --2- 172.21.15.49:0/392830104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b73570 0x2b739f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7faeb026a740 1 --2- 172.21.15.49:0/392830104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b6c4d0 0x2b6c8b0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.676+0000 7faeb026a740 1 -- 172.21.15.49:0/392830104 >> 172.21.15.49:0/392830104 conn(0x2906680 msgr2=0x2b25de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:21.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.680+0000 7faeb026a740 1 -- 172.21.15.49:0/392830104 shutdown_connections 2024-01-22T05:19:21.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.680+0000 7faeb026a740 1 -- 172.21.15.49:0/392830104 wait complete. 2024-01-22T05:19:21.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.680+0000 7faeb026a740 1 -- start start 2024-01-22T05:19:21.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.680+0000 7faeb026a740 1 Processor -- start 2024-01-22T05:19:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.680+0000 7faeb026a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b6c4d0 0x2b480d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.680+0000 7faeb026a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73570 0x2b4cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.680+0000 7faeb026a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b73ee0 0x2b241e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.680+0000 7faeb026a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b4ef50 con 0x2b73ee0 2024-01-22T05:19:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.680+0000 7faeb026a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b4d4d0 con 0x2b73570 2024-01-22T05:19:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7faeb026a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b506e0 con 0x2b6c4d0 2024-01-22T05:19:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7faeb026a740 10 client.0 ll_register_callbacks cb 0x2ade5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:19:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae9f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b73ee0 0x2b241e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae9f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b73ee0 0x2b241e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56316/0 (socket says 172.21.15.49:56316) 2024-01-22T05:19:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae9ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b6c4d0 0x2b480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae9f400700 1 -- 172.21.15.49:0/3843174895 learned_addr learned my addr 172.21.15.49:0/3843174895 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:21.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae9e000700 1 --2- 172.21.15.49:0/3843174895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73570 0x2b4cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae9ea00700 1 -- 172.21.15.49:0/3843174895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73570 msgr2=0x2b4cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae9ea00700 1 --2- 172.21.15.49:0/3843174895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73570 0x2b4cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae9ea00700 1 -- 172.21.15.49:0/3843174895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b73ee0 msgr2=0x2b241e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae9ea00700 1 --2- 172.21.15.49:0/3843174895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b73ee0 0x2b241e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae9ea00700 1 -- 172.21.15.49:0/3843174895 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea00ac100 con 0x2b6c4d0 2024-01-22T05:19:21.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae9ea00700 1 --2- 172.21.15.49:0/3843174895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b6c4d0 0x2b480d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fae90072790 tx=0x7fae90050000).ready entity=mon.2 client_cookie=849833b836786ebd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:21.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae87400700 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2024-01-22T05:19:21.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae87400700 1 -- 172.21.15.49:0/3843174895 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae900723a0 con 0x2b6c4d0 2024-01-22T05:19:21.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae87400700 1 -- 172.21.15.49:0/3843174895 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fae90049920 con 0x2b6c4d0 2024-01-22T05:19:21.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7faeb026a740 1 -- 172.21.15.49:0/3843174895 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2a9e230 con 0x2b6c4d0 2024-01-22T05:19:21.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae87400700 1 -- 172.21.15.49:0/3843174895 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=142) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae90047580 con 0x2b6c4d0 2024-01-22T05:19:21.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7faeb026a740 10 client.8675 fetch_fsmap learned FSMap version 142 2024-01-22T05:19:21.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7faeb026a740 1 -- 172.21.15.49:0/3843174895 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=142,monmap=2+}) v3 -- 0x2aa17c0 con 0x2b6c4d0 2024-01-22T05:19:21.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae87400700 1 -- 172.21.15.49:0/3843174895 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2a9e230 con 0x2b6c4d0 2024-01-22T05:19:21.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7fae87400700 1 -- 172.21.15.49:0/3843174895 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 142) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fae9005b030 con 0x2b6c4d0 2024-01-22T05:19:21.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7faeb026a740 10 client.8675 fetch_fsmap finished waiting for FSMap version 142 2024-01-22T05:19:21.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7faeb026a740 10 client.8675 resolve_mds: resolved 12:0 to role '12:0' aka daemon mds.a 2024-01-22T05:19:21.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7faeb026a740 20 client.8675 populate_metadata read hostname 'smithi049' 2024-01-22T05:19:21.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7faeb026a740 1 --2- 172.21.15.49:0/3843174895 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x2b4e190 0x2b4e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7faeb026a740 4 client.8675 mds_command: new command op to 10104 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:19:21.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.684+0000 7faeb026a740 1 -- 172.21.15.49:0/3843174895 --> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2a94780 con 0x2b4e190 2024-01-22T05:19:21.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7fae9e000700 1 --2- 172.21.15.49:0/3843174895 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x2b4e190 0x2b4e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7fae9e000700 1 --2- 172.21.15.49:0/3843174895 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x2b4e190 0x2b4e5a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=624e1e85e434d02b server_cookie=d045652236d307f3 in_seq=0 out_seq=0 2024-01-22T05:19:21.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7fae87400700 10 client.8675 ms_handle_connect on v2:172.21.15.49:6836/3574461601 2024-01-22T05:19:21.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7fae87400700 1 -- 172.21.15.49:0/3843174895 <== mds.0 v2:172.21.15.49:6836/3574461601 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2a94780 con 0x2b4e190 2024-01-22T05:19:21.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7fae87400700 10 client.8675 handle_command_reply: tid=0 2024-01-22T05:19:21.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7faeb026a740 1 client.8675 shutdown 2024-01-22T05:19:21.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7faeb026a740 1 -- 172.21.15.49:0/3843174895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b6c4d0 msgr2=0x2b480d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7faeb026a740 1 --2- 172.21.15.49:0/3843174895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b6c4d0 0x2b480d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fae90072790 tx=0x7fae90050000).stop 2024-01-22T05:19:21.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7faeb026a740 1 -- 172.21.15.49:0/3843174895 shutdown_connections 2024-01-22T05:19:21.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7faeb026a740 1 --2- 172.21.15.49:0/3843174895 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x2b4e190 0x2b4e5a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7faeb026a740 1 --2- 172.21.15.49:0/3843174895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b73ee0 0x2b241e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7faeb026a740 1 --2- 172.21.15.49:0/3843174895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73570 0x2b4cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7faeb026a740 1 --2- 172.21.15.49:0/3843174895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b6c4d0 0x2b480d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7faeb026a740 1 -- 172.21.15.49:0/3843174895 >> 172.21.15.49:0/3843174895 conn(0x2906680 msgr2=0x2b51450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7fae87400700 0 client.8675 ms_handle_reset on v2:172.21.15.49:6836/3574461601 2024-01-22T05:19:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7faeb026a740 1 -- 172.21.15.49:0/3843174895 shutdown_connections 2024-01-22T05:19:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.688+0000 7faeb026a740 1 -- 172.21.15.49:0/3843174895 wait complete. 2024-01-22T05:19:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.692+0000 7faeb026a740 20 client.8675 trim_cache size 0 max 16384 2024-01-22T05:19:21.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7faeb026a740 1 Processor -- start 2024-01-22T05:19:21.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7faeb026a740 1 -- start start 2024-01-22T05:19:21.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7faeb026a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b6c4d0 0x2b23a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7faeb026a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b73570 0x2b27450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7faeb026a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b73ee0 0x2b652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7faeb026a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b24590 con 0x2b73ee0 2024-01-22T05:19:21.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7faeb026a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a5fe00 con 0x2b6c4d0 2024-01-22T05:19:21.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7faeb026a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b73d40 con 0x2b73570 2024-01-22T05:19:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7fae9f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b73ee0 0x2b652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7fae9f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b73ee0 0x2b652b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56320/0 (socket says 172.21.15.49:56320) 2024-01-22T05:19:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7fae9f400700 1 -- 172.21.15.49:0/2086458301 learned_addr learned my addr 172.21.15.49:0/2086458301 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7fae9ea00700 1 --2- 172.21.15.49:0/2086458301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b6c4d0 0x2b23a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7fae9e000700 1 --2- 172.21.15.49:0/2086458301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b73570 0x2b27450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7fae9ea00700 1 -- 172.21.15.49:0/2086458301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b73570 msgr2=0x2b27450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7fae9ea00700 1 --2- 172.21.15.49:0/2086458301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b73570 0x2b27450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7fae9ea00700 1 -- 172.21.15.49:0/2086458301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b73ee0 msgr2=0x2b652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7fae9ea00700 1 --2- 172.21.15.49:0/2086458301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b73ee0 0x2b652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7fae9ea00700 1 -- 172.21.15.49:0/2086458301 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea00c6ee0 con 0x2b6c4d0 2024-01-22T05:19:21.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.712+0000 7fae9f400700 1 --2- 172.21.15.49:0/2086458301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b73ee0 0x2b652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.716+0000 7fae9ea00700 1 --2- 172.21.15.49:0/2086458301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b6c4d0 0x2b23a90 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fae90047fa0 tx=0x7fae90056070).ready entity=mon.1 client_cookie=88637a8dd47a2cd8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.716+0000 7fae8f400700 1 -- 172.21.15.49:0/2086458301 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae900723a0 con 0x2b6c4d0 2024-01-22T05:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.716+0000 7fae8f400700 1 -- 172.21.15.49:0/2086458301 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9000e040 con 0x2b6c4d0 2024-01-22T05:19:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.716+0000 7fae8f400700 1 -- 172.21.15.49:0/2086458301 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90049920 con 0x2b6c4d0 2024-01-22T05:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.716+0000 7faeb026a740 1 -- 172.21.15.49:0/2086458301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b6c4d0 msgr2=0x2b23a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.716+0000 7faeb026a740 1 --2- 172.21.15.49:0/2086458301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b6c4d0 0x2b23a90 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fae90047fa0 tx=0x7fae90056070).stop 2024-01-22T05:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.716+0000 7faeb026a740 1 -- 172.21.15.49:0/2086458301 shutdown_connections 2024-01-22T05:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.716+0000 7faeb026a740 1 --2- 172.21.15.49:0/2086458301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b73ee0 0x2b652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.716+0000 7faeb026a740 1 --2- 172.21.15.49:0/2086458301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b73570 0x2b27450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.716+0000 7faeb026a740 1 --2- 172.21.15.49:0/2086458301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b6c4d0 0x2b23a90 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.716+0000 7faeb026a740 1 -- 172.21.15.49:0/2086458301 >> 172.21.15.49:0/2086458301 conn(0x2906680 msgr2=0x2b680d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:21.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.716+0000 7faeb026a740 1 -- 172.21.15.49:0/2086458301 shutdown_connections 2024-01-22T05:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.716+0000 7faeb026a740 1 -- 172.21.15.49:0/2086458301 wait complete. 2024-01-22T05:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.716+0000 7faeb026a740 1 -- start start 2024-01-22T05:19:21.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.716+0000 7faeb026a740 1 Processor -- start 2024-01-22T05:19:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7faeb026a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b6c4d0 0x2bc9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7faeb026a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73570 0x2bbf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7faeb026a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b73ee0 0x2b26e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7faeb026a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b279c0 con 0x2b6c4d0 2024-01-22T05:19:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7faeb026a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2bbf620 con 0x2b73570 2024-01-22T05:19:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7faeb026a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b68540 con 0x2b73ee0 2024-01-22T05:19:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7faeb026a740 10 client.0 ll_register_callbacks cb 0x7fae9004aee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:19:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7fae9ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b6c4d0 0x2bc9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7fae9ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b6c4d0 0x2bc9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56336/0 (socket says 172.21.15.49:56336) 2024-01-22T05:19:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7fae9ea00700 1 -- 172.21.15.49:0/467192370 learned_addr learned my addr 172.21.15.49:0/467192370 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7fae9e000700 1 --2- 172.21.15.49:0/467192370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73570 0x2bbf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7fae9f400700 1 --2- 172.21.15.49:0/467192370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b73ee0 0x2b26e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7fae9ea00700 1 -- 172.21.15.49:0/467192370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b73ee0 msgr2=0x2b26e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7fae9ea00700 1 --2- 172.21.15.49:0/467192370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b73ee0 0x2b26e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7fae9ea00700 1 -- 172.21.15.49:0/467192370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73570 msgr2=0x2bbf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7fae9ea00700 1 --2- 172.21.15.49:0/467192370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73570 0x2bbf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7fae9ea00700 1 -- 172.21.15.49:0/467192370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae800033f0 con 0x2b6c4d0 2024-01-22T05:19:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7fae9ea00700 1 --2- 172.21.15.49:0/467192370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b6c4d0 0x2bc9300 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7fae90047a80 tx=0x7fae9001a040).ready entity=mon.0 client_cookie=9d5a4bdb30edace6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.720+0000 7fae87400700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:19:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7fae87400700 1 -- 172.21.15.49:0/467192370 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90054070 con 0x2b6c4d0 2024-01-22T05:19:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7fae87400700 1 -- 172.21.15.49:0/467192370 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fae90049920 con 0x2b6c4d0 2024-01-22T05:19:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 1 -- 172.21.15.49:0/467192370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x295d610 con 0x2b6c4d0 2024-01-22T05:19:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7fae87400700 1 -- 172.21.15.49:0/467192370 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=142) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae9000e040 con 0x2b6c4d0 2024-01-22T05:19:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 10 client.10317 fetch_fsmap learned FSMap version 142 2024-01-22T05:19:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 1 -- 172.21.15.49:0/467192370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=142,monmap=2+}) v3 -- 0x2aa17c0 con 0x2b6c4d0 2024-01-22T05:19:21.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7fae87400700 1 -- 172.21.15.49:0/467192370 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x295d610 con 0x2b6c4d0 2024-01-22T05:19:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7fae87400700 1 -- 172.21.15.49:0/467192370 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 142) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fae9006c030 con 0x2b6c4d0 2024-01-22T05:19:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 10 client.10317 fetch_fsmap finished waiting for FSMap version 142 2024-01-22T05:19:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 10 client.10317 resolve_mds: resolved 12:0 to role '12:0' aka daemon mds.a 2024-01-22T05:19:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 20 client.10317 populate_metadata read hostname 'smithi049' 2024-01-22T05:19:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 1 --2- 172.21.15.49:0/467192370 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x2b272f0 0x2bc0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 4 client.10317 mds_command: new command op to 10104 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:19:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 1 -- 172.21.15.49:0/467192370 --> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x2913390 con 0x2b272f0 2024-01-22T05:19:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7fae9e000700 1 --2- 172.21.15.49:0/467192370 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x2b272f0 0x2bc0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7fae9e000700 1 --2- 172.21.15.49:0/467192370 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x2b272f0 0x2bc0a10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3fec36b45a46f28b server_cookie=b708da5cf04f7ed2 in_seq=0 out_seq=0 2024-01-22T05:19:21.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7fae87400700 10 client.10317 ms_handle_connect on v2:172.21.15.49:6836/3574461601 2024-01-22T05:19:21.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7fae87400700 1 -- 172.21.15.49:0/467192370 <== mds.0 v2:172.21.15.49:6836/3574461601 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x2913390 con 0x2b272f0 2024-01-22T05:19:21.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7fae87400700 10 client.10317 handle_command_reply: tid=0 2024-01-22T05:19:21.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 1 client.10317 shutdown 2024-01-22T05:19:21.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 1 -- 172.21.15.49:0/467192370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b6c4d0 msgr2=0x2bc9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 1 --2- 172.21.15.49:0/467192370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b6c4d0 0x2bc9300 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7fae90047a80 tx=0x7fae9001a040).stop 2024-01-22T05:19:21.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 1 -- 172.21.15.49:0/467192370 shutdown_connections 2024-01-22T05:19:21.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 1 --2- 172.21.15.49:0/467192370 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x2b272f0 0x2bc0a10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 1 --2- 172.21.15.49:0/467192370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2b73ee0 0x2b26e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 1 --2- 172.21.15.49:0/467192370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2b73570 0x2bbf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.724+0000 7faeb026a740 1 --2- 172.21.15.49:0/467192370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2b6c4d0 0x2bc9300 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7fae87400700 0 client.10317 ms_handle_reset on v2:172.21.15.49:6836/3574461601 2024-01-22T05:19:21.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faeb026a740 1 -- 172.21.15.49:0/467192370 >> 172.21.15.49:0/467192370 conn(0x2906680 msgr2=0x2b652b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:21.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faeb026a740 1 -- 172.21.15.49:0/467192370 shutdown_connections 2024-01-22T05:19:21.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faeb026a740 1 -- 172.21.15.49:0/467192370 wait complete. 2024-01-22T05:19:21.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faeb026a740 20 client.10317 trim_cache size 0 max 16384 2024-01-22T05:19:21.728 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:19:21.728 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-01-22T05:19:21.728 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-01-22T05:19:21.728 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:19:21.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faea5e00700 1 -- 172.21.15.49:0/3449375410 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae7805a510 msgr2=0x7fae7805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faea5e00700 1 --2- 172.21.15.49:0/3449375410 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae7805a510 0x7fae7805c9d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7faea00ad450 tx=0x7fae88007040).stop 2024-01-22T05:19:21.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faea5e00700 1 -- 172.21.15.49:0/3449375410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faea0064540 msgr2=0x7faea014c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faea5e00700 1 --2- 172.21.15.49:0/3449375410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faea0064540 0x7faea014c8e0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7fae90007700 tx=0x7fae90007c20).stop 2024-01-22T05:19:21.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faea5e00700 1 -- 172.21.15.49:0/3449375410 shutdown_connections 2024-01-22T05:19:21.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faea5e00700 1 --2- 172.21.15.49:0/3449375410 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fae7805a510 0x7fae7805c9d0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faea5e00700 1 --2- 172.21.15.49:0/3449375410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faea00ab7d0 0x7faea00abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faea5e00700 1 --2- 172.21.15.49:0/3449375410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faea0149c30 0x7faea014a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faea5e00700 1 --2- 172.21.15.49:0/3449375410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faea0064540 0x7faea014c8e0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faea5e00700 1 -- 172.21.15.49:0/3449375410 >> 172.21.15.49:0/3449375410 conn(0x7faea00c40f0 msgr2=0x7faea00a9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:21.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faea5e00700 1 -- 172.21.15.49:0/3449375410 shutdown_connections 2024-01-22T05:19:21.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.728+0000 7faea5e00700 1 -- 172.21.15.49:0/3449375410 wait complete. 2024-01-22T05:19:21.751 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-22T05:19:21.751 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.12:0 damage ls 2024-01-22T05:19:21.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.928+0000 7fef0fe00700 1 Processor -- start 2024-01-22T05:19:21.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.928+0000 7fef0fe00700 1 -- start start 2024-01-22T05:19:21.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.932+0000 7fef0fe00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fef080bf1d0 0x7fef080be0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.932+0000 7fef0fe00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef08068070 con 0x7fef080be5a0 2024-01-22T05:19:21.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.932+0000 7fef0fe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef08068350 con 0x7fef08067a90 2024-01-22T05:19:21.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.932+0000 7fef0fe00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef081564d0 con 0x7fef080bf1d0 2024-01-22T05:19:21.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.932+0000 7fef0ca00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fef080bf1d0 0x7fef080be0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.932+0000 7fef0de00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fef080be5a0 0x7fef08151e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48190/0 (socket says 172.21.15.49:48190) 2024-01-22T05:19:21.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.932+0000 7fef0de00700 1 -- 172.21.15.49:0/927378144 learned_addr learned my addr 172.21.15.49:0/927378144 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:21.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef07e00700 1 -- 172.21.15.49:0/927378144 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366342344 0 0) 0x7fef08068070 con 0x7fef080be5a0 2024-01-22T05:19:21.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef07e00700 1 -- 172.21.15.49:0/927378144 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feee80033f0 con 0x7fef080be5a0 2024-01-22T05:19:21.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef07e00700 1 -- 172.21.15.49:0/927378144 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875228966 0 0) 0x7fef08068350 con 0x7fef08067a90 2024-01-22T05:19:21.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef07e00700 1 -- 172.21.15.49:0/927378144 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef08068070 con 0x7fef08067a90 2024-01-22T05:19:21.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef0ca00700 1 -- 172.21.15.49:0/927378144 >> v1:172.21.15.110:6789/0 conn(0x7fef08067a90 legacy=0x7fef080bd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef0ca00700 1 -- 172.21.15.49:0/927378144 >> v1:172.21.15.49:6789/0 conn(0x7fef080be5a0 legacy=0x7fef08151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef0ca00700 1 -- 172.21.15.49:0/927378144 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef08068630 con 0x7fef080bf1d0 2024-01-22T05:19:21.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef0ca00700 1 --2- 172.21.15.49:0/927378144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef080bf1d0 0x7fef080be0b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7feef0009760 tx=0x7feef0009060).ready entity=mon.1 client_cookie=b767d6ae26e22343 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:21.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef07e00700 1 -- 172.21.15.49:0/927378144 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef000d4a0 con 0x7fef080bf1d0 2024-01-22T05:19:21.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef07e00700 1 -- 172.21.15.49:0/927378144 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef000d600 con 0x7fef080bf1d0 2024-01-22T05:19:21.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef07e00700 1 -- 172.21.15.49:0/927378144 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef000d980 con 0x7fef080bf1d0 2024-01-22T05:19:21.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef0fe00700 1 -- 172.21.15.49:0/927378144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef080bf1d0 msgr2=0x7fef080be0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef0fe00700 1 --2- 172.21.15.49:0/927378144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef080bf1d0 0x7fef080be0b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7feef0009760 tx=0x7feef0009060).stop 2024-01-22T05:19:21.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef0fe00700 1 -- 172.21.15.49:0/927378144 shutdown_connections 2024-01-22T05:19:21.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef0fe00700 1 --2- 172.21.15.49:0/927378144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef080bf1d0 0x7fef080be0b0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.936+0000 7fef0fe00700 1 -- 172.21.15.49:0/927378144 >> 172.21.15.49:0/927378144 conn(0x7fef080c8750 msgr2=0x7fef080c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:21.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.940+0000 7fef0fe00700 1 -- 172.21.15.49:0/927378144 shutdown_connections 2024-01-22T05:19:21.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.940+0000 7fef0fe00700 1 -- 172.21.15.49:0/927378144 wait complete. 2024-01-22T05:19:21.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.940+0000 7fef0fe00700 1 Processor -- start 2024-01-22T05:19:21.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.944+0000 7fef0fe00700 1 -- start start 2024-01-22T05:19:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.944+0000 7fef0fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef08067a90 0x7fef0814e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.944+0000 7fef0fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef080be5a0 0x7fef080c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.944+0000 7fef0fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef080bf1d0 0x7fef080c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.944+0000 7fef0fe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef080c7ea0 con 0x7fef08067a90 2024-01-22T05:19:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.944+0000 7fef0fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef08063040 con 0x7fef080be5a0 2024-01-22T05:19:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.944+0000 7fef0fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef080bf870 con 0x7fef080bf1d0 2024-01-22T05:19:21.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.944+0000 7fef0d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef08067a90 0x7fef0814e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.944+0000 7fef0d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef08067a90 0x7fef0814e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56344/0 (socket says 172.21.15.49:56344) 2024-01-22T05:19:21.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.944+0000 7fef0d400700 1 -- 172.21.15.49:0/1584195906 learned_addr learned my addr 172.21.15.49:0/1584195906 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:21.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.944+0000 7fef0ca00700 1 --2- 172.21.15.49:0/1584195906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef080be5a0 0x7fef080c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.948+0000 7fef0de00700 1 --2- 172.21.15.49:0/1584195906 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef080bf1d0 0x7fef080c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.948+0000 7fef0d400700 1 -- 172.21.15.49:0/1584195906 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef080bf1d0 msgr2=0x7fef080c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.948+0000 7fef0d400700 1 --2- 172.21.15.49:0/1584195906 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef080bf1d0 0x7fef080c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.948+0000 7fef0d400700 1 -- 172.21.15.49:0/1584195906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef080be5a0 msgr2=0x7fef080c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.948+0000 7fef0d400700 1 --2- 172.21.15.49:0/1584195906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef080be5a0 0x7fef080c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.948+0000 7fef0d400700 1 -- 172.21.15.49:0/1584195906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef00092a0 con 0x7fef08067a90 2024-01-22T05:19:21.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.948+0000 7fef0ca00700 1 --2- 172.21.15.49:0/1584195906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef080be5a0 0x7fef080c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:21.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.948+0000 7fef0d400700 1 --2- 172.21.15.49:0/1584195906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef08067a90 0x7fef0814e1d0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7feef800c440 tx=0x7feef8007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:21.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.948+0000 7fef04c00700 1 -- 172.21.15.49:0/1584195906 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef8012400 con 0x7fef08067a90 2024-01-22T05:19:21.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.948+0000 7fef04c00700 1 -- 172.21.15.49:0/1584195906 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef8012560 con 0x7fef08067a90 2024-01-22T05:19:21.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.948+0000 7fef0fe00700 1 -- 172.21.15.49:0/1584195906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef080bfb50 con 0x7fef08067a90 2024-01-22T05:19:21.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.948+0000 7fef04c00700 1 -- 172.21.15.49:0/1584195906 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef8012920 con 0x7fef08067a90 2024-01-22T05:19:21.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.948+0000 7fef0fe00700 1 -- 172.21.15.49:0/1584195906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef080c0110 con 0x7fef08067a90 2024-01-22T05:19:21.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.952+0000 7fef04c00700 1 -- 172.21.15.49:0/1584195906 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7feef801b3b0 con 0x7fef08067a90 2024-01-22T05:19:21.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.956+0000 7fef04c00700 1 --2- 172.21.15.49:0/1584195906 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feee005a4e0 0x7feee005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.956+0000 7fef04c00700 1 -- 172.21.15.49:0/1584195906 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7feef80741a0 con 0x7fef08067a90 2024-01-22T05:19:21.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.956+0000 7fef0ca00700 1 --2- 172.21.15.49:0/1584195906 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feee005a4e0 0x7feee005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.956+0000 7fef0ca00700 1 --2- 172.21.15.49:0/1584195906 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feee005a4e0 0x7feee005c9a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7feef0009630 tx=0x7feef0016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:21.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.956+0000 7fef1a2a5740 1 Processor -- start 2024-01-22T05:19:21.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.956+0000 7fef1a2a5740 1 -- start start 2024-01-22T05:19:21.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef1a2a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25de6a0 0x25dea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef1a2a5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 0x25977e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef1a2a5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c2d60 0x25998f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef1a2a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x24d7340 con 0x25de6a0 2024-01-22T05:19:21.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef1a2a5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x24fa4e0 con 0x25e37b0 2024-01-22T05:19:21.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef1a2a5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x24c3ce0 con 0x25c2d60 2024-01-22T05:19:21.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef0d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25de6a0 0x25dea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef0d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25de6a0 0x25dea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56354/0 (socket says 172.21.15.49:56354) 2024-01-22T05:19:21.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef0d400700 1 -- 172.21.15.49:0/3471601913 learned_addr learned my addr 172.21.15.49:0/3471601913 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:21.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef0ca00700 1 --2- 172.21.15.49:0/3471601913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 0x25977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef0de00700 1 --2- 172.21.15.49:0/3471601913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c2d60 0x25998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef0d400700 1 -- 172.21.15.49:0/3471601913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c2d60 msgr2=0x25998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef0d400700 1 --2- 172.21.15.49:0/3471601913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c2d60 0x25998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef0d400700 1 -- 172.21.15.49:0/3471601913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 msgr2=0x25977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef0d400700 1 --2- 172.21.15.49:0/3471601913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 0x25977e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef0d400700 1 -- 172.21.15.49:0/3471601913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x24caed0 con 0x25de6a0 2024-01-22T05:19:21.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef0ca00700 1 --2- 172.21.15.49:0/3471601913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 0x25977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:21.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef0d400700 1 --2- 172.21.15.49:0/3471601913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25de6a0 0x25dea80 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7feef804b230 tx=0x7feef800f000).ready entity=mon.0 client_cookie=a4d2fd8b1cbe2170 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:21.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7feefd200700 1 -- 172.21.15.49:0/3471601913 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef804b360 con 0x25de6a0 2024-01-22T05:19:21.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7feefd200700 1 -- 172.21.15.49:0/3471601913 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef8050b00 con 0x25de6a0 2024-01-22T05:19:21.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7feefd200700 1 -- 172.21.15.49:0/3471601913 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef8047ad0 con 0x25de6a0 2024-01-22T05:19:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3471601913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25de6a0 msgr2=0x25dea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.960+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/3471601913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25de6a0 0x25dea80 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7feef804b230 tx=0x7feef800f000).stop 2024-01-22T05:19:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.964+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3471601913 shutdown_connections 2024-01-22T05:19:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.964+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/3471601913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c2d60 0x25998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.964+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/3471601913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 0x25977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.964+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/3471601913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25de6a0 0x25dea80 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.964+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3471601913 >> 172.21.15.49:0/3471601913 conn(0x237c680 msgr2=0x259d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:21.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.964+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3471601913 shutdown_connections 2024-01-22T05:19:21.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.964+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3471601913 wait complete. 2024-01-22T05:19:21.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.964+0000 7fef1a2a5740 1 -- start start 2024-01-22T05:19:21.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.964+0000 7fef1a2a5740 1 Processor -- start 2024-01-22T05:19:21.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef1a2a5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c2d60 0x25c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef1a2a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25de6a0 0x25c16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef1a2a5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 0x25e16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef1a2a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x25ef560 con 0x25de6a0 2024-01-22T05:19:21.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef1a2a5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x25dc640 con 0x25e37b0 2024-01-22T05:19:21.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef1a2a5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x25ef760 con 0x25c2d60 2024-01-22T05:19:21.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef1a2a5740 10 client.0 ll_register_callbacks cb 0x25547c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:19:21.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef0ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25de6a0 0x25c16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef0ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25de6a0 0x25c16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56364/0 (socket says 172.21.15.49:56364) 2024-01-22T05:19:21.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef0ca00700 1 -- 172.21.15.49:0/1489495018 learned_addr learned my addr 172.21.15.49:0/1489495018 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:21.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef0d400700 1 --2- 172.21.15.49:0/1489495018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c2d60 0x25c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef0de00700 1 --2- 172.21.15.49:0/1489495018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 0x25e16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef0ca00700 1 -- 172.21.15.49:0/1489495018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c2d60 msgr2=0x25c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef0ca00700 1 --2- 172.21.15.49:0/1489495018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c2d60 0x25c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef0ca00700 1 -- 172.21.15.49:0/1489495018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 msgr2=0x25e16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef0ca00700 1 --2- 172.21.15.49:0/1489495018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 0x25e16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef0ca00700 1 -- 172.21.15.49:0/1489495018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef080c0110 con 0x25de6a0 2024-01-22T05:19:21.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef0ca00700 1 --2- 172.21.15.49:0/1489495018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25de6a0 0x25c16b0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 rx=0x7fef080676a0 tx=0x7feef0020070).ready entity=mon.0 client_cookie=8f9dad4db3451fc2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:21.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7feef5600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:19:21.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7feef5600700 1 -- 172.21.15.49:0/1489495018 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef002d030 con 0x25de6a0 2024-01-22T05:19:21.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7feef5600700 1 -- 172.21.15.49:0/1489495018 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7feef002e070 con 0x25de6a0 2024-01-22T05:19:21.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.968+0000 7fef1a2a5740 1 -- 172.21.15.49:0/1489495018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2514230 con 0x25de6a0 2024-01-22T05:19:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7feef5600700 1 -- 172.21.15.49:0/1489495018 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=142) v2 ==== 24+0+0 (secure 0 0 0) 0x7feef001e980 con 0x25de6a0 2024-01-22T05:19:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7fef1a2a5740 10 client.10329 fetch_fsmap learned FSMap version 142 2024-01-22T05:19:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7fef1a2a5740 1 -- 172.21.15.49:0/1489495018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=142,monmap=2+}) v3 -- 0x25177c0 con 0x25de6a0 2024-01-22T05:19:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7feef5600700 1 -- 172.21.15.49:0/1489495018 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2514230 con 0x25de6a0 2024-01-22T05:19:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7feef5600700 1 -- 172.21.15.49:0/1489495018 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 142) v1 ==== 3100+0+0 (secure 0 0 0) 0x7feef001eae0 con 0x25de6a0 2024-01-22T05:19:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7fef1a2a5740 10 client.10329 fetch_fsmap finished waiting for FSMap version 142 2024-01-22T05:19:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7fef1a2a5740 10 client.10329 resolve_mds: resolved 12:0 to role '12:0' aka daemon mds.a 2024-01-22T05:19:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7fef1a2a5740 20 client.10329 populate_metadata read hostname 'smithi049' 2024-01-22T05:19:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/1489495018 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x25db0a0 0x25db4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7fef1a2a5740 4 client.10329 mds_command: new command op to 10104 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:19:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7fef1a2a5740 1 -- 172.21.15.49:0/1489495018 --> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x250a780 con 0x25db0a0 2024-01-22T05:19:21.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7fef0d400700 1 --2- 172.21.15.49:0/1489495018 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x25db0a0 0x25db4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7fef0d400700 1 --2- 172.21.15.49:0/1489495018 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x25db0a0 0x25db4b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ff114b8e94addc1c server_cookie=1ede91d450f6463e in_seq=0 out_seq=0 2024-01-22T05:19:21.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7feef5600700 10 client.10329 ms_handle_connect on v2:172.21.15.49:6836/3574461601 2024-01-22T05:19:21.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7feef5600700 1 -- 172.21.15.49:0/1489495018 <== mds.0 v2:172.21.15.49:6836/3574461601 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x250a780 con 0x25db0a0 2024-01-22T05:19:21.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7feef5600700 10 client.10329 handle_command_reply: tid=0 2024-01-22T05:19:21.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.972+0000 7fef1a2a5740 1 client.10329 shutdown 2024-01-22T05:19:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.976+0000 7fef1a2a5740 1 -- 172.21.15.49:0/1489495018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25de6a0 msgr2=0x25c16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.976+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/1489495018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25de6a0 0x25c16b0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 rx=0x7fef080676a0 tx=0x7feef0020070).stop 2024-01-22T05:19:21.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.976+0000 7fef1a2a5740 1 -- 172.21.15.49:0/1489495018 shutdown_connections 2024-01-22T05:19:21.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.976+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/1489495018 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x25db0a0 0x25db4b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.976+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/1489495018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 0x25e16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.976+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/1489495018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25de6a0 0x25c16b0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.976+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/1489495018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25c2d60 0x25c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.976+0000 7feef5600700 0 client.10329 ms_handle_reset on v2:172.21.15.49:6836/3574461601 2024-01-22T05:19:21.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.976+0000 7fef1a2a5740 1 -- 172.21.15.49:0/1489495018 >> 172.21.15.49:0/1489495018 conn(0x237c680 msgr2=0x25df750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:21.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.976+0000 7fef1a2a5740 1 -- 172.21.15.49:0/1489495018 shutdown_connections 2024-01-22T05:19:21.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.976+0000 7fef1a2a5740 1 -- 172.21.15.49:0/1489495018 wait complete. 2024-01-22T05:19:21.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.976+0000 7fef1a2a5740 20 client.10329 trim_cache size 0 max 16384 2024-01-22T05:19:21.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.992+0000 7fef1a2a5740 1 Processor -- start 2024-01-22T05:19:21.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.992+0000 7fef1a2a5740 1 -- start start 2024-01-22T05:19:21.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef1a2a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c2d60 0x25dde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef1a2a5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25de6a0 0x25db630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef1a2a5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25e37b0 0x25c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:21.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef1a2a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x25df530 con 0x25c2d60 2024-01-22T05:19:21.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef1a2a5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x25df240 con 0x25de6a0 2024-01-22T05:19:21.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef1a2a5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x25c1480 con 0x25e37b0 2024-01-22T05:19:21.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef0d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c2d60 0x25dde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef0ca00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25de6a0 0x25db630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef0d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c2d60 0x25dde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56368/0 (socket says 172.21.15.49:56368) 2024-01-22T05:19:21.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef0d400700 1 -- 172.21.15.49:0/3687166826 learned_addr learned my addr 172.21.15.49:0/3687166826 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:21.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef0de00700 1 --2- 172.21.15.49:0/3687166826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25e37b0 0x25c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:21.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef0d400700 1 -- 172.21.15.49:0/3687166826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25e37b0 msgr2=0x25c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef0d400700 1 --2- 172.21.15.49:0/3687166826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25e37b0 0x25c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef0d400700 1 -- 172.21.15.49:0/3687166826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25de6a0 msgr2=0x25db630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:21.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef0d400700 1 --2- 172.21.15.49:0/3687166826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25de6a0 0x25db630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:21.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:21.996+0000 7fef0d400700 1 -- 172.21.15.49:0/3687166826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef08153fb0 con 0x25c2d60 2024-01-22T05:19:21.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.000+0000 7fef0d400700 1 --2- 172.21.15.49:0/3687166826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c2d60 0x25dde90 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7feef804b0c0 tx=0x7feef8051000).ready entity=mon.0 client_cookie=7b33f250b2054509 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:21.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.000+0000 7feefdc00700 1 -- 172.21.15.49:0/3687166826 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef8064070 con 0x25c2d60 2024-01-22T05:19:21.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.000+0000 7feefdc00700 1 -- 172.21.15.49:0/3687166826 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef8012a80 con 0x25c2d60 2024-01-22T05:19:21.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.000+0000 7feefdc00700 1 -- 172.21.15.49:0/3687166826 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef804aac0 con 0x25c2d60 2024-01-22T05:19:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.000+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3687166826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c2d60 msgr2=0x25dde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.000+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/3687166826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c2d60 0x25dde90 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7feef804b0c0 tx=0x7feef8051000).stop 2024-01-22T05:19:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.000+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3687166826 shutdown_connections 2024-01-22T05:19:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.000+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/3687166826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25e37b0 0x25c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.000+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/3687166826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25de6a0 0x25db630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.000+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/3687166826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c2d60 0x25dde90 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.000+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3687166826 >> 172.21.15.49:0/3687166826 conn(0x237c680 msgr2=0x25e2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:22.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.000+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3687166826 shutdown_connections 2024-01-22T05:19:22.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.000+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3687166826 wait complete. 2024-01-22T05:19:22.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.000+0000 7fef1a2a5740 1 -- start start 2024-01-22T05:19:22.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.004+0000 7fef1a2a5740 1 Processor -- start 2024-01-22T05:19:22.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.004+0000 7fef1a2a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c2d60 0x25c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:22.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.004+0000 7fef1a2a5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25de6a0 0x25c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:22.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.004+0000 7fef1a2a5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 0x25972c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:22.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.004+0000 7fef1a2a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2601f80 con 0x25c2d60 2024-01-22T05:19:22.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.004+0000 7fef1a2a5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x25c0eb0 con 0x25e37b0 2024-01-22T05:19:22.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.004+0000 7fef1a2a5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2595d70 con 0x25de6a0 2024-01-22T05:19:22.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.004+0000 7fef1a2a5740 10 client.0 ll_register_callbacks cb 0x7feef000df00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:19:22.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.004+0000 7fef0d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c2d60 0x25c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:22.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.004+0000 7fef0ca00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25de6a0 0x25c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:22.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef0d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c2d60 0x25c04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56374/0 (socket says 172.21.15.49:56374) 2024-01-22T05:19:22.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef0d400700 1 -- 172.21.15.49:0/3273080186 learned_addr learned my addr 172.21.15.49:0/3273080186 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:22.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef0de00700 1 --2- 172.21.15.49:0/3273080186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 0x25972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:22.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef0ca00700 1 -- 172.21.15.49:0/3273080186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 msgr2=0x25972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:22.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef0ca00700 1 --2- 172.21.15.49:0/3273080186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 0x25972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef0ca00700 1 -- 172.21.15.49:0/3273080186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c2d60 msgr2=0x25c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:22.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef0ca00700 1 --2- 172.21.15.49:0/3273080186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c2d60 0x25c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef0ca00700 1 -- 172.21.15.49:0/3273080186 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef8054040 con 0x25de6a0 2024-01-22T05:19:22.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef0ca00700 1 --2- 172.21.15.49:0/3273080186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25de6a0 0x25c09c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7feef0007fd0 tx=0x7feef002b070).ready entity=mon.2 client_cookie=e48805fd2a65eeaf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:22.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7feef5600700 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2024-01-22T05:19:22.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7feef5600700 1 -- 172.21.15.49:0/3273080186 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef002d040 con 0x25de6a0 2024-01-22T05:19:22.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7feef5600700 1 -- 172.21.15.49:0/3273080186 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7feef003bdb0 con 0x25de6a0 2024-01-22T05:19:22.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3273080186 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x25c5af0 con 0x25de6a0 2024-01-22T05:19:22.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7feef5600700 1 -- 172.21.15.49:0/3273080186 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=142) v2 ==== 24+0+0 (secure 0 0 0) 0x7feef0011ea0 con 0x25de6a0 2024-01-22T05:19:22.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef1a2a5740 10 client.8696 fetch_fsmap learned FSMap version 142 2024-01-22T05:19:22.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3273080186 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=142,monmap=2+}) v3 -- 0x25129f0 con 0x25de6a0 2024-01-22T05:19:22.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7feef5600700 1 -- 172.21.15.49:0/3273080186 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x25c5af0 con 0x25de6a0 2024-01-22T05:19:22.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7feef5600700 1 -- 172.21.15.49:0/3273080186 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 142) v1 ==== 3100+0+0 (secure 0 0 0) 0x7feef0031850 con 0x25de6a0 2024-01-22T05:19:22.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef1a2a5740 10 client.8696 fetch_fsmap finished waiting for FSMap version 142 2024-01-22T05:19:22.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef1a2a5740 10 client.8696 resolve_mds: resolved 12:0 to role '12:0' aka daemon mds.a 2024-01-22T05:19:22.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef1a2a5740 20 client.8696 populate_metadata read hostname 'smithi049' 2024-01-22T05:19:22.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/3273080186 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x25c65e0 0x25977b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:22.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef1a2a5740 4 client.8696 mds_command: new command op to 10104 tid=0[{"prefix": "damage ls"}] 2024-01-22T05:19:22.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3273080186 --> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7feef8050b00 con 0x25c65e0 2024-01-22T05:19:22.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.008+0000 7fef0d400700 1 --2- 172.21.15.49:0/3273080186 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x25c65e0 0x25977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:22.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7fef0d400700 1 --2- 172.21.15.49:0/3273080186 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x25c65e0 0x25977b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=27df6241d5da97a1 server_cookie=d57c8c11f1b11ead in_seq=0 out_seq=0 2024-01-22T05:19:22.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7feef5600700 10 client.8696 ms_handle_connect on v2:172.21.15.49:6836/3574461601 2024-01-22T05:19:22.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7feef5600700 1 -- 172.21.15.49:0/3273080186 <== mds.0 v2:172.21.15.49:6836/3574461601 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7feef8050b00 con 0x25c65e0 2024-01-22T05:19:22.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7feef5600700 10 client.8696 handle_command_reply: tid=0 2024-01-22T05:19:22.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7fef1a2a5740 1 client.8696 shutdown 2024-01-22T05:19:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3273080186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25de6a0 msgr2=0x25c09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/3273080186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25de6a0 0x25c09c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7feef0007fd0 tx=0x7feef002b070).stop 2024-01-22T05:19:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3273080186 shutdown_connections 2024-01-22T05:19:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/3273080186 >> [v2:172.21.15.49:6836/3574461601,v1:172.21.15.49:6837/3574461601] conn(0x25c65e0 0x25977b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/3273080186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25e37b0 0x25972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/3273080186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25de6a0 0x25c09c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7fef1a2a5740 1 --2- 172.21.15.49:0/3273080186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25c2d60 0x25c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3273080186 >> 172.21.15.49:0/3273080186 conn(0x237c680 msgr2=0x25c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:22.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7feef5600700 0 client.8696 ms_handle_reset on v2:172.21.15.49:6836/3574461601 2024-01-22T05:19:22.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3273080186 shutdown_connections 2024-01-22T05:19:22.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7fef1a2a5740 1 -- 172.21.15.49:0/3273080186 wait complete. 2024-01-22T05:19:22.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.012+0000 7fef1a2a5740 20 client.8696 trim_cache size 0 max 16384 2024-01-22T05:19:22.014 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-01-22T05:19:22.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.016+0000 7fef0fe00700 1 -- 172.21.15.49:0/1584195906 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feee005a4e0 msgr2=0x7feee005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:22.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.016+0000 7fef0fe00700 1 --2- 172.21.15.49:0/1584195906 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feee005a4e0 0x7feee005c9a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7feef0009630 tx=0x7feef0016000).stop 2024-01-22T05:19:22.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.016+0000 7fef0fe00700 1 -- 172.21.15.49:0/1584195906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef08067a90 msgr2=0x7fef0814e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:22.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.016+0000 7fef0fe00700 1 --2- 172.21.15.49:0/1584195906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef08067a90 0x7fef0814e1d0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7feef800c440 tx=0x7feef8007c90).stop 2024-01-22T05:19:22.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.016+0000 7fef0fe00700 1 -- 172.21.15.49:0/1584195906 shutdown_connections 2024-01-22T05:19:22.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.016+0000 7fef0fe00700 1 --2- 172.21.15.49:0/1584195906 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7feee005a4e0 0x7feee005c9a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.016+0000 7fef0fe00700 1 --2- 172.21.15.49:0/1584195906 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef080bf1d0 0x7fef080c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.016+0000 7fef0fe00700 1 --2- 172.21.15.49:0/1584195906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef080be5a0 0x7fef080c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.016+0000 7fef0fe00700 1 --2- 172.21.15.49:0/1584195906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef08067a90 0x7fef0814e1d0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.016+0000 7fef0fe00700 1 -- 172.21.15.49:0/1584195906 >> 172.21.15.49:0/1584195906 conn(0x7fef080c8750 msgr2=0x7fef08153060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:22.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.016+0000 7fef0fe00700 1 -- 172.21.15.49:0/1584195906 shutdown_connections 2024-01-22T05:19:22.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.016+0000 7fef0fe00700 1 -- 172.21.15.49:0/1584195906 wait complete. 2024-01-22T05:19:22.039 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:19:22.039 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:19:22.083 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:19:22.130 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:19:22.130 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T05:19:22.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:19:22.131 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-22T05:19:22.756 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:19:22.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:22.756 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:19:22.770 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:19:22.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.988+0000 7fa158200700 1 Processor -- start 2024-01-22T05:19:22.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.988+0000 7fa158200700 1 -- start start 2024-01-22T05:19:22.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.992+0000 7fa158200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500644f0 0x7fa150064950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:22.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.992+0000 7fa158200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1500bcc80 0x7fa1500bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:22.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.992+0000 7fa158200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1500c2700 con 0x7fa150065660 2024-01-22T05:19:22.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.992+0000 7fa158200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1500a7650 con 0x7fa1500bcc80 2024-01-22T05:19:22.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.992+0000 7fa158200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa150064e40 con 0x7fa1500644f0 2024-01-22T05:19:22.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.992+0000 7fa156c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1500bcc80 0x7fa1500bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:22.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.992+0000 7fa156c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa1500bcc80 0x7fa1500bd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56380/0 (socket says 172.21.15.49:56380) 2024-01-22T05:19:22.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.992+0000 7fa156c00700 1 -- 172.21.15.49:0/3176286990 learned_addr learned my addr 172.21.15.49:0/3176286990 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:22.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.992+0000 7fa154e00700 1 --2- 172.21.15.49:0/3176286990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500644f0 0x7fa150064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:22.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.992+0000 7fa156c00700 1 -- 172.21.15.49:0/3176286990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500644f0 msgr2=0x7fa150064950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:22.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.992+0000 7fa156c00700 1 --2- 172.21.15.49:0/3176286990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500644f0 0x7fa150064950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.992+0000 7fa156c00700 1 -- 172.21.15.49:0/3176286990 >> v1:172.21.15.110:6789/0 conn(0x7fa150065660 legacy=0x7fa1500a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:22.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.992+0000 7fa156c00700 1 -- 172.21.15.49:0/3176286990 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500c2930 con 0x7fa1500bcc80 2024-01-22T05:19:22.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.992+0000 7fa156c00700 1 --2- 172.21.15.49:0/3176286990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1500bcc80 0x7fa1500bd110 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7fa148009f50 tx=0x7fa148009840).ready entity=mon.0 client_cookie=9c82ddd7355bd2e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:22.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.992+0000 7fa14fe00700 1 -- 172.21.15.49:0/3176286990 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14800e070 con 0x7fa1500bcc80 2024-01-22T05:19:22.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.996+0000 7fa14fe00700 1 -- 172.21.15.49:0/3176286990 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14800b9c0 con 0x7fa1500bcc80 2024-01-22T05:19:22.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.996+0000 7fa14fe00700 1 -- 172.21.15.49:0/3176286990 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14800bd40 con 0x7fa1500bcc80 2024-01-22T05:19:22.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.996+0000 7fa158200700 1 -- 172.21.15.49:0/3176286990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1500bcc80 msgr2=0x7fa1500bd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:22.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.996+0000 7fa158200700 1 --2- 172.21.15.49:0/3176286990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1500bcc80 0x7fa1500bd110 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7fa148009f50 tx=0x7fa148009840).stop 2024-01-22T05:19:22.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.996+0000 7fa158200700 1 -- 172.21.15.49:0/3176286990 shutdown_connections 2024-01-22T05:19:22.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.996+0000 7fa158200700 1 --2- 172.21.15.49:0/3176286990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1500bcc80 0x7fa1500bd110 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.996+0000 7fa158200700 1 --2- 172.21.15.49:0/3176286990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500644f0 0x7fa150064950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:22.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.996+0000 7fa158200700 1 -- 172.21.15.49:0/3176286990 >> 172.21.15.49:0/3176286990 conn(0x7fa1500c87f0 msgr2=0x7fa1500c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:22.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.996+0000 7fa158200700 1 -- 172.21.15.49:0/3176286990 shutdown_connections 2024-01-22T05:19:22.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:22.996+0000 7fa158200700 1 -- 172.21.15.49:0/3176286990 wait complete. 2024-01-22T05:19:22.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.000+0000 7fa158200700 1 Processor -- start 2024-01-22T05:19:23.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.000+0000 7fa158200700 1 -- start start 2024-01-22T05:19:23.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa158200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500644f0 0x7fa150150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa158200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa150065660 0x7fa1500ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa158200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1500bcc80 0x7fa1500a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa158200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500acdd0 con 0x7fa150065660 2024-01-22T05:19:23.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa158200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500ad0b0 con 0x7fa1500bcc80 2024-01-22T05:19:23.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa158200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500ad390 con 0x7fa1500644f0 2024-01-22T05:19:23.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa154e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa150065660 0x7fa1500ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa154e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa150065660 0x7fa1500ac3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56396/0 (socket says 172.21.15.49:56396) 2024-01-22T05:19:23.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa154e00700 1 -- 172.21.15.49:0/2568446956 learned_addr learned my addr 172.21.15.49:0/2568446956 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:23.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa155800700 1 --2- 172.21.15.49:0/2568446956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500644f0 0x7fa150150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa156c00700 1 --2- 172.21.15.49:0/2568446956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1500bcc80 0x7fa1500a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa154e00700 1 -- 172.21.15.49:0/2568446956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500644f0 msgr2=0x7fa150150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:23.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa154e00700 1 --2- 172.21.15.49:0/2568446956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500644f0 0x7fa150150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa154e00700 1 -- 172.21.15.49:0/2568446956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1500bcc80 msgr2=0x7fa1500a9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:23.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa154e00700 1 --2- 172.21.15.49:0/2568446956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1500bcc80 0x7fa1500a9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa154e00700 1 -- 172.21.15.49:0/2568446956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa148009ae0 con 0x7fa150065660 2024-01-22T05:19:23.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa155800700 1 --2- 172.21.15.49:0/2568446956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500644f0 0x7fa150150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:23.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa154e00700 1 --2- 172.21.15.49:0/2568446956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa150065660 0x7fa1500ac3f0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7fa13800e930 tx=0x7fa138009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:23.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa14cc00700 1 -- 172.21.15.49:0/2568446956 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138012600 con 0x7fa150065660 2024-01-22T05:19:23.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa14cc00700 1 -- 172.21.15.49:0/2568446956 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa138012760 con 0x7fa150065660 2024-01-22T05:19:23.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa158200700 1 -- 172.21.15.49:0/2568446956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1500ad670 con 0x7fa150065660 2024-01-22T05:19:23.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa14cc00700 1 -- 172.21.15.49:0/2568446956 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138012ae0 con 0x7fa150065660 2024-01-22T05:19:23.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.004+0000 7fa158200700 1 -- 172.21.15.49:0/2568446956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa150150530 con 0x7fa150065660 2024-01-22T05:19:23.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.008+0000 7fa158200700 1 -- 172.21.15.49:0/2568446956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1500adaf0 con 0x7fa150065660 2024-01-22T05:19:23.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.008+0000 7fa14cc00700 1 -- 172.21.15.49:0/2568446956 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa13801b400 con 0x7fa150065660 2024-01-22T05:19:23.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.012+0000 7fa14cc00700 1 --2- 172.21.15.49:0/2568446956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa12805a510 0x7fa12805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.012+0000 7fa14cc00700 1 -- 172.21.15.49:0/2568446956 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa138074df0 con 0x7fa150065660 2024-01-22T05:19:23.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.012+0000 7fa155800700 1 --2- 172.21.15.49:0/2568446956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa12805a510 0x7fa12805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.012+0000 7fa155800700 1 --2- 172.21.15.49:0/2568446956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa12805a510 0x7fa12805c9d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7fa140001c40 tx=0x7fa140009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:23.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.016+0000 7fa14cc00700 1 -- 172.21.15.49:0/2568446956 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa138048350 con 0x7fa150065660 2024-01-22T05:19:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.208+0000 7fa158200700 1 -- 172.21.15.49:0/2568446956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa150047060 con 0x7fa150065660 2024-01-22T05:19:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.208+0000 7fa14cc00700 1 -- 172.21.15.49:0/2568446956 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 142 v142) v1 ==== 95+0+4506 (secure 0 0 0) 0x7fa13804b970 con 0x7fa150065660 2024-01-22T05:19:23.210 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:23.210 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":142,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1331200361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1331200361},{"type":"v1","addr":"172.21.15.110:6835","nonce":1331200361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137},{"gid":9994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/377934467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":377934467},{"type":"v1","addr":"172.21.15.110:6834","nonce":377934467}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137},{"gid":10101,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3482770597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3482770597},{"type":"v1","addr":"172.21.15.49:6835","nonce":3482770597}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137}],"filesystems":[{"mdsmap":{"epoch":142,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:08.068628+0000","modified":"2024-01-22T05:19:11.100914+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10104},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10104":{"gid":10104,"name":"a","rank":0,"incarnation":138,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3574461601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3574461601},{"type":"v1","addr":"172.21.15.49:6837","nonce":3574461601}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2024-01-22T05:19:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.212+0000 7fa158200700 1 -- 172.21.15.49:0/2568446956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa12805a510 msgr2=0x7fa12805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.212+0000 7fa158200700 1 --2- 172.21.15.49:0/2568446956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa12805a510 0x7fa12805c9d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7fa140001c40 tx=0x7fa140009040).stop 2024-01-22T05:19:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.212+0000 7fa158200700 1 -- 172.21.15.49:0/2568446956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa150065660 msgr2=0x7fa1500ac3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.212+0000 7fa158200700 1 --2- 172.21.15.49:0/2568446956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa150065660 0x7fa1500ac3f0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7fa13800e930 tx=0x7fa138009060).stop 2024-01-22T05:19:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.212+0000 7fa158200700 1 -- 172.21.15.49:0/2568446956 shutdown_connections 2024-01-22T05:19:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.212+0000 7fa158200700 1 --2- 172.21.15.49:0/2568446956 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa12805a510 0x7fa12805c9d0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.212+0000 7fa158200700 1 --2- 172.21.15.49:0/2568446956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1500bcc80 0x7fa1500a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.212+0000 7fa158200700 1 --2- 172.21.15.49:0/2568446956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa150065660 0x7fa1500ac3f0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.212+0000 7fa158200700 1 --2- 172.21.15.49:0/2568446956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1500644f0 0x7fa150150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.212+0000 7fa158200700 1 -- 172.21.15.49:0/2568446956 >> 172.21.15.49:0/2568446956 conn(0x7fa1500c87f0 msgr2=0x7fa1500a61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.212+0000 7fa158200700 1 -- 172.21.15.49:0/2568446956 shutdown_connections 2024-01-22T05:19:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.212+0000 7fa158200700 1 -- 172.21.15.49:0/2568446956 wait complete. 2024-01-22T05:19:23.217 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 142 2024-01-22T05:19:23.235 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:19:23.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.396+0000 7f091cc00700 1 Processor -- start 2024-01-22T05:19:23.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.396+0000 7f091cc00700 1 -- start start 2024-01-22T05:19:23.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.396+0000 7f091cc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09180a8740 0x7f09180a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.396+0000 7f091cc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09180c1ed0 0x7f09180c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.396+0000 7f091cc00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09180c1a40 con 0x7f0918155d20 2024-01-22T05:19:23.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.396+0000 7f091cc00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09180a90b0 con 0x7f09180a8740 2024-01-22T05:19:23.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.396+0000 7f091cc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0918159310 con 0x7f09180c1ed0 2024-01-22T05:19:23.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.396+0000 7f0915400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09180a8740 0x7f09180a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.396+0000 7f0915400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09180a8740 0x7f09180a8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34504/0 (socket says 172.21.15.49:34504) 2024-01-22T05:19:23.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.396+0000 7f0915400700 1 -- 172.21.15.49:0/3770588555 learned_addr learned my addr 172.21.15.49:0/3770588555 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:23.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.396+0000 7f0916800700 1 --2- 172.21.15.49:0/3770588555 >> v2:172.21.15.110:3300/0 conn(0x7f09180c1ed0 0x7f09180c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f0915400700 1 -- 172.21.15.49:0/3770588555 >> v2:172.21.15.110:3300/0 conn(0x7f09180c1ed0 msgr2=0x7f09180c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:23.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f0915400700 1 --2- 172.21.15.49:0/3770588555 >> v2:172.21.15.110:3300/0 conn(0x7f09180c1ed0 0x7f09180c2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f0915400700 1 -- 172.21.15.49:0/3770588555 >> v1:172.21.15.110:6789/0 conn(0x7f0918155d20 legacy=0x7f0918065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:23.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f0915400700 1 -- 172.21.15.49:0/3770588555 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09180c13f0 con 0x7f09180a8740 2024-01-22T05:19:23.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f0915400700 1 --2- 172.21.15.49:0/3770588555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180a8740 0x7f09180a8bc0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f09180c19b0 tx=0x7f09000090f0).ready entity=mon.0 client_cookie=a55bfe875fd95ed4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:23.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f0914a00700 1 -- 172.21.15.49:0/3770588555 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000b520 con 0x7f09180a8740 2024-01-22T05:19:23.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f0914a00700 1 -- 172.21.15.49:0/3770588555 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090000b680 con 0x7f09180a8740 2024-01-22T05:19:23.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f0914a00700 1 -- 172.21.15.49:0/3770588555 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000ba00 con 0x7f09180a8740 2024-01-22T05:19:23.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f091cc00700 1 -- 172.21.15.49:0/3770588555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180a8740 msgr2=0x7f09180a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:23.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f091cc00700 1 --2- 172.21.15.49:0/3770588555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180a8740 0x7f09180a8bc0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f09180c19b0 tx=0x7f09000090f0).stop 2024-01-22T05:19:23.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f091cc00700 1 -- 172.21.15.49:0/3770588555 shutdown_connections 2024-01-22T05:19:23.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f091cc00700 1 --2- 172.21.15.49:0/3770588555 >> v2:172.21.15.110:3300/0 conn(0x7f09180c1ed0 0x7f09180c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f091cc00700 1 --2- 172.21.15.49:0/3770588555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180a8740 0x7f09180a8bc0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f091cc00700 1 -- 172.21.15.49:0/3770588555 >> 172.21.15.49:0/3770588555 conn(0x7f09180c6540 msgr2=0x7f09180c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:23.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f091cc00700 1 -- 172.21.15.49:0/3770588555 shutdown_connections 2024-01-22T05:19:23.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.400+0000 7f091cc00700 1 -- 172.21.15.49:0/3770588555 wait complete. 2024-01-22T05:19:23.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.404+0000 7f091cc00700 1 Processor -- start 2024-01-22T05:19:23.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.408+0000 7f091cc00700 1 -- start start 2024-01-22T05:19:23.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.408+0000 7f091cc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09180a8740 0x7f09180a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.408+0000 7f091cc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180c1ed0 0x7f091816cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.408+0000 7f091cc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0918155d20 0x7f09180ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.408+0000 7f091cc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09180bf440 con 0x7f09180c1ed0 2024-01-22T05:19:23.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.408+0000 7f091cc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091816d490 con 0x7f0918155d20 2024-01-22T05:19:23.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.408+0000 7f091cc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09180ac050 con 0x7f09180a8740 2024-01-22T05:19:23.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.408+0000 7f0915400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180c1ed0 0x7f091816cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.408+0000 7f0915400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180c1ed0 0x7f091816cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34510/0 (socket says 172.21.15.49:34510) 2024-01-22T05:19:23.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.408+0000 7f0915400700 1 -- 172.21.15.49:0/1404499885 learned_addr learned my addr 172.21.15.49:0/1404499885 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:23.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.408+0000 7f0915e00700 1 --2- 172.21.15.49:0/1404499885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09180a8740 0x7f09180a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.408+0000 7f0916800700 1 --2- 172.21.15.49:0/1404499885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0918155d20 0x7f09180ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.412+0000 7f0915400700 1 -- 172.21.15.49:0/1404499885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09180a8740 msgr2=0x7f09180a9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:23.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.412+0000 7f0915400700 1 --2- 172.21.15.49:0/1404499885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09180a8740 0x7f09180a9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.412+0000 7f0915400700 1 -- 172.21.15.49:0/1404499885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0918155d20 msgr2=0x7f09180ab820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:23.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.412+0000 7f0915400700 1 --2- 172.21.15.49:0/1404499885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0918155d20 0x7f09180ab820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.412+0000 7f0915400700 1 -- 172.21.15.49:0/1404499885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900009370 con 0x7f09180c1ed0 2024-01-22T05:19:23.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.412+0000 7f0915400700 1 --2- 172.21.15.49:0/1404499885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180c1ed0 0x7f091816cfa0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7f0900009130 tx=0x7f0900017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:23.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.412+0000 7f090d600700 1 -- 172.21.15.49:0/1404499885 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900000bc0 con 0x7f09180c1ed0 2024-01-22T05:19:23.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.412+0000 7f090d600700 1 -- 172.21.15.49:0/1404499885 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090000b7f0 con 0x7f09180c1ed0 2024-01-22T05:19:23.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.412+0000 7f091cc00700 1 -- 172.21.15.49:0/1404499885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09180ac330 con 0x7f09180c1ed0 2024-01-22T05:19:23.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.412+0000 7f090d600700 1 -- 172.21.15.49:0/1404499885 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900000d20 con 0x7f09180c1ed0 2024-01-22T05:19:23.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.412+0000 7f091cc00700 1 -- 172.21.15.49:0/1404499885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09180bedc0 con 0x7f09180c1ed0 2024-01-22T05:19:23.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.412+0000 7f091cc00700 1 -- 172.21.15.49:0/1404499885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0918047060 con 0x7f09180c1ed0 2024-01-22T05:19:23.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.416+0000 7f090d600700 1 -- 172.21.15.49:0/1404499885 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f090001c880 con 0x7f09180c1ed0 2024-01-22T05:19:23.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.416+0000 7f090d600700 1 --2- 172.21.15.49:0/1404499885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f005a510 0x7f08f005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.416+0000 7f090d600700 1 -- 172.21.15.49:0/1404499885 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f09000765d0 con 0x7f09180c1ed0 2024-01-22T05:19:23.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.416+0000 7f0915e00700 1 --2- 172.21.15.49:0/1404499885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f005a510 0x7f08f005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.416+0000 7f0915e00700 1 --2- 172.21.15.49:0/1404499885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f005a510 0x7f08f005c9d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f0908003860 tx=0x7f0908007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:23.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.424+0000 7f090d600700 1 -- 172.21.15.49:0/1404499885 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0900049b30 con 0x7f09180c1ed0 2024-01-22T05:19:23.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.588+0000 7f091cc00700 1 -- 172.21.15.49:0/1404499885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09180c16d0 con 0x7f09180c1ed0 2024-01-22T05:19:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.588+0000 7f090d600700 1 -- 172.21.15.49:0/1404499885 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+17178 (secure 0 0 0) 0x7f090002a020 con 0x7f09180c1ed0 2024-01-22T05:19:23.590 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:23.590 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":184,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:19:09.074168+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:19:06.223141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-01-22T05:19:07.103306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:19:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.592+0000 7f091cc00700 1 -- 172.21.15.49:0/1404499885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f005a510 msgr2=0x7f08f005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.592+0000 7f091cc00700 1 --2- 172.21.15.49:0/1404499885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f005a510 0x7f08f005c9d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f0908003860 tx=0x7f0908007d40).stop 2024-01-22T05:19:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.592+0000 7f091cc00700 1 -- 172.21.15.49:0/1404499885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180c1ed0 msgr2=0x7f091816cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.592+0000 7f091cc00700 1 --2- 172.21.15.49:0/1404499885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180c1ed0 0x7f091816cfa0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7f0900009130 tx=0x7f0900017000).stop 2024-01-22T05:19:23.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.592+0000 7f091cc00700 1 -- 172.21.15.49:0/1404499885 shutdown_connections 2024-01-22T05:19:23.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.592+0000 7f091cc00700 1 --2- 172.21.15.49:0/1404499885 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f08f005a510 0x7f08f005c9d0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.592+0000 7f091cc00700 1 --2- 172.21.15.49:0/1404499885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0918155d20 0x7f09180ab820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.592+0000 7f091cc00700 1 --2- 172.21.15.49:0/1404499885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09180c1ed0 0x7f091816cfa0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.592+0000 7f091cc00700 1 --2- 172.21.15.49:0/1404499885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09180a8740 0x7f09180a9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.592+0000 7f091cc00700 1 -- 172.21.15.49:0/1404499885 >> 172.21.15.49:0/1404499885 conn(0x7f09180c6540 msgr2=0x7f09180c3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:23.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.592+0000 7f091cc00700 1 -- 172.21.15.49:0/1404499885 shutdown_connections 2024-01-22T05:19:23.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.592+0000 7f091cc00700 1 -- 172.21.15.49:0/1404499885 wait complete. 2024-01-22T05:19:23.617 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 26, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:19:06.223141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '183', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 27, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:19:07.103306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '184', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:19:23.618 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:19:23.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.780+0000 7f600ee00700 1 Processor -- start 2024-01-22T05:19:23.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.780+0000 7f600ee00700 1 -- start start 2024-01-22T05:19:23.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.784+0000 7f600ee00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f60080a8c20 0x7f60080c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.784+0000 7f600ee00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f60080c1ac0 0x7f60080bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.784+0000 7f600ee00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60080bc9c0 0x7f6008068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.784+0000 7f600ee00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6008158650 con 0x7f60080a8c20 2024-01-22T05:19:23.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.784+0000 7f600ee00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60080c1f20 con 0x7f60080c1ac0 2024-01-22T05:19:23.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.784+0000 7f600ee00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60080bd170 con 0x7f60080bc9c0 2024-01-22T05:19:23.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.784+0000 7f6007e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f60080a8c20 0x7f60080c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.784+0000 7f6007e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f60080a8c20 0x7f60080c15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34516/0 (socket says 172.21.15.49:34516) 2024-01-22T05:19:23.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.784+0000 7f6007e00700 1 -- 172.21.15.49:0/3019857155 learned_addr learned my addr 172.21.15.49:0/3019857155 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:23.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.784+0000 7f600ce00700 1 --2- 172.21.15.49:0/3019857155 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60080bc9c0 0x7f6008068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.784+0000 7f6007400700 1 --2- 172.21.15.49:0/3019857155 >> v2:172.21.15.110:3300/0 conn(0x7f60080c1ac0 0x7f60080bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f6007e00700 1 -- 172.21.15.49:0/3019857155 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60080bc9c0 msgr2=0x7f6008068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f6007e00700 1 --2- 172.21.15.49:0/3019857155 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60080bc9c0 0x7f6008068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f6007e00700 1 -- 172.21.15.49:0/3019857155 >> v2:172.21.15.110:3300/0 conn(0x7f60080c1ac0 msgr2=0x7f60080bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f6007e00700 1 --2- 172.21.15.49:0/3019857155 >> v2:172.21.15.110:3300/0 conn(0x7f60080c1ac0 0x7f60080bc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f6007e00700 1 -- 172.21.15.49:0/3019857155 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6008067c30 con 0x7f60080a8c20 2024-01-22T05:19:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f6007400700 1 --2- 172.21.15.49:0/3019857155 >> v2:172.21.15.110:3300/0 conn(0x7f60080c1ac0 0x7f60080bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:23.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f6007e00700 1 --2- 172.21.15.49:0/3019857155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60080a8c20 0x7f60080c15d0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7f60080bb7b0 tx=0x7f5ff80090f0).ready entity=mon.0 client_cookie=555fb1bc259df283 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:23.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f6006a00700 1 -- 172.21.15.49:0/3019857155 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff800f510 con 0x7f60080a8c20 2024-01-22T05:19:23.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f6006a00700 1 -- 172.21.15.49:0/3019857155 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff800f670 con 0x7f60080a8c20 2024-01-22T05:19:23.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f6006a00700 1 -- 172.21.15.49:0/3019857155 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff800f9f0 con 0x7f60080a8c20 2024-01-22T05:19:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f600ee00700 1 -- 172.21.15.49:0/3019857155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60080a8c20 msgr2=0x7f60080c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f600ee00700 1 --2- 172.21.15.49:0/3019857155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60080a8c20 0x7f60080c15d0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7f60080bb7b0 tx=0x7f5ff80090f0).stop 2024-01-22T05:19:23.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f600ee00700 1 -- 172.21.15.49:0/3019857155 shutdown_connections 2024-01-22T05:19:23.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f600ee00700 1 --2- 172.21.15.49:0/3019857155 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60080bc9c0 0x7f6008068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f600ee00700 1 --2- 172.21.15.49:0/3019857155 >> v2:172.21.15.110:3300/0 conn(0x7f60080c1ac0 0x7f60080bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f600ee00700 1 --2- 172.21.15.49:0/3019857155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60080a8c20 0x7f60080c15d0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.788+0000 7f600ee00700 1 -- 172.21.15.49:0/3019857155 >> 172.21.15.49:0/3019857155 conn(0x7f6008062cb0 msgr2=0x7f60080c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:23.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.792+0000 7f600ee00700 1 -- 172.21.15.49:0/3019857155 shutdown_connections 2024-01-22T05:19:23.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.792+0000 7f600ee00700 1 -- 172.21.15.49:0/3019857155 wait complete. 2024-01-22T05:19:23.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.792+0000 7f600ee00700 1 Processor -- start 2024-01-22T05:19:23.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.792+0000 7f600ee00700 1 -- start start 2024-01-22T05:19:23.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f600ee00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60080a8c20 0x7f60081587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f600ee00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60080bc9c0 0x7f6008159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f600ee00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60080c1ac0 0x7f6008168ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f600ee00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60081599e0 con 0x7f60080bc9c0 2024-01-22T05:19:23.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f600ee00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60081691d0 con 0x7f60080a8c20 2024-01-22T05:19:23.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f600ee00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6008158dd0 con 0x7f60080c1ac0 2024-01-22T05:19:23.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f6007400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60080bc9c0 0x7f6008159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f6007400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60080bc9c0 0x7f6008159e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34528/0 (socket says 172.21.15.49:34528) 2024-01-22T05:19:23.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f6007400700 1 -- 172.21.15.49:0/638906766 learned_addr learned my addr 172.21.15.49:0/638906766 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:23.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f600ce00700 1 --2- 172.21.15.49:0/638906766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60080c1ac0 0x7f6008168ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f6007e00700 1 --2- 172.21.15.49:0/638906766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60080a8c20 0x7f60081587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f600ce00700 1 -- 172.21.15.49:0/638906766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60080a8c20 msgr2=0x7f60081587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:23.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f600ce00700 1 --2- 172.21.15.49:0/638906766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60080a8c20 0x7f60081587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f600ce00700 1 -- 172.21.15.49:0/638906766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60080bc9c0 msgr2=0x7f6008159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:23.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f600ce00700 1 --2- 172.21.15.49:0/638906766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60080bc9c0 0x7f6008159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f600ce00700 1 -- 172.21.15.49:0/638906766 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff0009250 con 0x7f60080c1ac0 2024-01-22T05:19:23.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f600ce00700 1 --2- 172.21.15.49:0/638906766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60080c1ac0 0x7f6008168ce0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f6000009e50 tx=0x7f600000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:23.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f5fff400700 1 -- 172.21.15.49:0/638906766 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600000caa0 con 0x7f60080c1ac0 2024-01-22T05:19:23.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f5fff400700 1 -- 172.21.15.49:0/638906766 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600000f040 con 0x7f60080c1ac0 2024-01-22T05:19:23.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f5fff400700 1 -- 172.21.15.49:0/638906766 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600000ce10 con 0x7f60080c1ac0 2024-01-22T05:19:23.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f600ee00700 1 -- 172.21.15.49:0/638906766 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff8009370 con 0x7f60080c1ac0 2024-01-22T05:19:23.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.796+0000 7f600ee00700 1 -- 172.21.15.49:0/638906766 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6008159390 con 0x7f60080c1ac0 2024-01-22T05:19:23.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.800+0000 7f600ee00700 1 -- 172.21.15.49:0/638906766 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60080c0c00 con 0x7f60080c1ac0 2024-01-22T05:19:23.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.800+0000 7f5fff400700 1 -- 172.21.15.49:0/638906766 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6000013610 con 0x7f60080c1ac0 2024-01-22T05:19:23.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.800+0000 7f5fff400700 1 --2- 172.21.15.49:0/638906766 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5fe005a510 0x7f5fe005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:23.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.804+0000 7f5fff400700 1 -- 172.21.15.49:0/638906766 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f60000750d0 con 0x7f60080c1ac0 2024-01-22T05:19:23.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.804+0000 7f6007e00700 1 --2- 172.21.15.49:0/638906766 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5fe005a510 0x7f5fe005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:23.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.804+0000 7f6007e00700 1 --2- 172.21.15.49:0/638906766 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5fe005a510 0x7f5fe005c9d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f5ff8009130 tx=0x7f5ff8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:23.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.812+0000 7f5fff400700 1 -- 172.21.15.49:0/638906766 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6000048750 con 0x7f60080c1ac0 2024-01-22T05:19:23.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.980+0000 7f600ee00700 1 -- 172.21.15.49:0/638906766 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6008067f10 con 0x7f60080c1ac0 2024-01-22T05:19:23.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.984+0000 7f5fff400700 1 -- 172.21.15.49:0/638906766 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v184) v1 ==== 110+0+10 (secure 0 0 0) 0x7f600004bd70 con 0x7f60080c1ac0 2024-01-22T05:19:23.982 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:19:23.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.984+0000 7f600ee00700 1 -- 172.21.15.49:0/638906766 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5fe005a510 msgr2=0x7f5fe005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:23.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.984+0000 7f600ee00700 1 --2- 172.21.15.49:0/638906766 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5fe005a510 0x7f5fe005c9d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f5ff8009130 tx=0x7f5ff8017000).stop 2024-01-22T05:19:23.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.984+0000 7f600ee00700 1 -- 172.21.15.49:0/638906766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60080c1ac0 msgr2=0x7f6008168ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:23.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.984+0000 7f600ee00700 1 --2- 172.21.15.49:0/638906766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60080c1ac0 0x7f6008168ce0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f6000009e50 tx=0x7f600000b040).stop 2024-01-22T05:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.984+0000 7f600ee00700 1 -- 172.21.15.49:0/638906766 shutdown_connections 2024-01-22T05:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.984+0000 7f600ee00700 1 --2- 172.21.15.49:0/638906766 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5fe005a510 0x7f5fe005c9d0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.984+0000 7f600ee00700 1 --2- 172.21.15.49:0/638906766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60080c1ac0 0x7f6008168ce0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.984+0000 7f600ee00700 1 --2- 172.21.15.49:0/638906766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60080bc9c0 0x7f6008159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.984+0000 7f600ee00700 1 --2- 172.21.15.49:0/638906766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60080a8c20 0x7f60081587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.984+0000 7f600ee00700 1 -- 172.21.15.49:0/638906766 >> 172.21.15.49:0/638906766 conn(0x7f6008062cb0 msgr2=0x7f60080656d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.984+0000 7f600ee00700 1 -- 172.21.15.49:0/638906766 shutdown_connections 2024-01-22T05:19:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:23.984+0000 7f600ee00700 1 -- 172.21.15.49:0/638906766 wait complete. 2024-01-22T05:19:24.003 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:19:24.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.156+0000 7f5704000700 1 Processor -- start 2024-01-22T05:19:24.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.156+0000 7f5704000700 1 -- start start 2024-01-22T05:19:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5704000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56fc0690f0 0x7f56fc155f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5704000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f56fc064530 0x7f56fc0a7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5704000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56fc068c60 con 0x7f56fc151960 2024-01-22T05:19:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5704000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56fc0694d0 con 0x7f56fc064530 2024-01-22T05:19:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5704000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc068050 con 0x7f56fc0690f0 2024-01-22T05:19:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5702000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f56fc064530 0x7f56fc0a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5701600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56fc0690f0 0x7f56fc155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5701600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56fc0690f0 0x7f56fc155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:53258/0 (socket says 172.21.15.49:53258) 2024-01-22T05:19:24.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5702000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f56fc064530 0x7f56fc0a7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:35898/0 (socket says 172.21.15.49:35898) 2024-01-22T05:19:24.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5701600700 1 -- 172.21.15.49:0/3831362254 learned_addr learned my addr 172.21.15.49:0/3831362254 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:24.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5700c00700 1 --1- 172.21.15.49:0/3831362254 >> v1:172.21.15.110:6789/0 conn(0x7f56fc151960 0x7f56fc063e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:44934/0 (socket says 172.21.15.49:44934) 2024-01-22T05:19:24.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f56fbe00700 1 -- 172.21.15.49:0/3831362254 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728309835 0 0) 0x7f56fc068c60 con 0x7f56fc151960 2024-01-22T05:19:24.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f56fbe00700 1 -- 172.21.15.49:0/3831362254 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56dc0033f0 con 0x7f56fc151960 2024-01-22T05:19:24.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5701600700 1 -- 172.21.15.49:0/3831362254 >> v2:172.21.15.110:3300/0 conn(0x7f56fc064530 msgr2=0x7f56fc0a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:24.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5701600700 1 --2- 172.21.15.49:0/3831362254 >> v2:172.21.15.110:3300/0 conn(0x7f56fc064530 0x7f56fc0a7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5701600700 1 -- 172.21.15.49:0/3831362254 >> v1:172.21.15.110:6789/0 conn(0x7f56fc151960 legacy=0x7f56fc063e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5701600700 1 -- 172.21.15.49:0/3831362254 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc068330 con 0x7f56fc0690f0 2024-01-22T05:19:24.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.160+0000 7f5702000700 1 --2- 172.21.15.49:0/3831362254 >> v2:172.21.15.110:3300/0 conn(0x7f56fc064530 0x7f56fc0a7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.164+0000 7f5701600700 1 --2- 172.21.15.49:0/3831362254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56fc0690f0 0x7f56fc155f40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f56ec006fd0 tx=0x7f56ec0090f0).ready entity=mon.2 client_cookie=ab395a2757b902be server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.164+0000 7f56fbe00700 1 -- 172.21.15.49:0/3831362254 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec00f510 con 0x7f56fc0690f0 2024-01-22T05:19:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.164+0000 7f56fbe00700 1 -- 172.21.15.49:0/3831362254 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec00f670 con 0x7f56fc0690f0 2024-01-22T05:19:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.164+0000 7f56fbe00700 1 -- 172.21.15.49:0/3831362254 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec00f9f0 con 0x7f56fc0690f0 2024-01-22T05:19:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.164+0000 7f5704000700 1 -- 172.21.15.49:0/3831362254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56fc0690f0 msgr2=0x7f56fc155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.164+0000 7f5704000700 1 --2- 172.21.15.49:0/3831362254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56fc0690f0 0x7f56fc155f40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f56ec006fd0 tx=0x7f56ec0090f0).stop 2024-01-22T05:19:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.164+0000 7f5704000700 1 -- 172.21.15.49:0/3831362254 shutdown_connections 2024-01-22T05:19:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.164+0000 7f5704000700 1 --2- 172.21.15.49:0/3831362254 >> v2:172.21.15.110:3300/0 conn(0x7f56fc064530 0x7f56fc0a7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.164+0000 7f5704000700 1 --2- 172.21.15.49:0/3831362254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56fc0690f0 0x7f56fc155f40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.164+0000 7f5704000700 1 -- 172.21.15.49:0/3831362254 >> 172.21.15.49:0/3831362254 conn(0x7f56fc066810 msgr2=0x7f56fc066bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:24.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.164+0000 7f5704000700 1 -- 172.21.15.49:0/3831362254 shutdown_connections 2024-01-22T05:19:24.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.164+0000 7f5704000700 1 -- 172.21.15.49:0/3831362254 wait complete. 2024-01-22T05:19:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.168+0000 7f5704000700 1 Processor -- start 2024-01-22T05:19:24.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.168+0000 7f5704000700 1 -- start start 2024-01-22T05:19:24.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.168+0000 7f5704000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56fc064530 0x7f56fc14c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.168+0000 7f5704000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56fc0690f0 0x7f56fc0bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.168+0000 7f5704000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56fc151960 0x7f56fc161d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.168+0000 7f5704000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc14c800 con 0x7f56fc064530 2024-01-22T05:19:24.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.168+0000 7f5704000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0c15c0 con 0x7f56fc151960 2024-01-22T05:19:24.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.168+0000 7f5704000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0c09b0 con 0x7f56fc0690f0 2024-01-22T05:19:24.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f5701600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56fc064530 0x7f56fc14c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f5701600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56fc064530 0x7f56fc14c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34534/0 (socket says 172.21.15.49:34534) 2024-01-22T05:19:24.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f5701600700 1 -- 172.21.15.49:0/983059703 learned_addr learned my addr 172.21.15.49:0/983059703 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f5702000700 1 --2- 172.21.15.49:0/983059703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56fc151960 0x7f56fc161d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f5700c00700 1 --2- 172.21.15.49:0/983059703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56fc0690f0 0x7f56fc0bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f5701600700 1 -- 172.21.15.49:0/983059703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56fc0690f0 msgr2=0x7f56fc0bf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f5701600700 1 --2- 172.21.15.49:0/983059703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56fc0690f0 0x7f56fc0bf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f5701600700 1 -- 172.21.15.49:0/983059703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56fc151960 msgr2=0x7f56fc161d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f5701600700 1 --2- 172.21.15.49:0/983059703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56fc151960 0x7f56fc161d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f5701600700 1 -- 172.21.15.49:0/983059703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f4009a20 con 0x7f56fc064530 2024-01-22T05:19:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f5702000700 1 --2- 172.21.15.49:0/983059703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56fc151960 0x7f56fc161d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f5701600700 1 --2- 172.21.15.49:0/983059703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56fc064530 0x7f56fc14c310 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7f56fc06a760 tx=0x7f56ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f56f8c00700 1 -- 172.21.15.49:0/983059703 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec00f7e0 con 0x7f56fc064530 2024-01-22T05:19:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f56f8c00700 1 -- 172.21.15.49:0/983059703 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec00f940 con 0x7f56fc064530 2024-01-22T05:19:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f56f8c00700 1 -- 172.21.15.49:0/983059703 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec01c670 con 0x7f56fc064530 2024-01-22T05:19:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f5704000700 1 -- 172.21.15.49:0/983059703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ec009370 con 0x7f56fc064530 2024-01-22T05:19:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f5704000700 1 -- 172.21.15.49:0/983059703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56fc0c0f70 con 0x7f56fc064530 2024-01-22T05:19:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.172+0000 7f5704000700 1 -- 172.21.15.49:0/983059703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56fc065790 con 0x7f56fc064530 2024-01-22T05:19:24.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.176+0000 7f56f8c00700 1 -- 172.21.15.49:0/983059703 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f56ec01c9e0 con 0x7f56fc064530 2024-01-22T05:19:24.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.176+0000 7f56f8c00700 1 --2- 172.21.15.49:0/983059703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56d405a510 0x7f56d405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.176+0000 7f56f8c00700 1 -- 172.21.15.49:0/983059703 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f56ec0765a0 con 0x7f56fc064530 2024-01-22T05:19:24.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.176+0000 7f5700c00700 1 --2- 172.21.15.49:0/983059703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56d405a510 0x7f56d405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.176+0000 7f5700c00700 1 --2- 172.21.15.49:0/983059703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56d405a510 0x7f56d405c9d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f56fc0656c0 tx=0x7f56e4007aa0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:24.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.184+0000 7f56f8c00700 1 -- 172.21.15.49:0/983059703 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f56ec049b60 con 0x7f56fc064530 2024-01-22T05:19:24.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.344+0000 7f5704000700 1 -- 172.21.15.49:0/983059703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f56fc068610 con 0x7f56fc064530 2024-01-22T05:19:24.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.344+0000 7f56f8c00700 1 -- 172.21.15.49:0/983059703 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v184) v1 ==== 92+0+10 (secure 0 0 0) 0x7f56ec02a020 con 0x7f56fc064530 2024-01-22T05:19:24.345 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:19:24.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.348+0000 7f5704000700 1 -- 172.21.15.49:0/983059703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56d405a510 msgr2=0x7f56d405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.348+0000 7f5704000700 1 --2- 172.21.15.49:0/983059703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56d405a510 0x7f56d405c9d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f56fc0656c0 tx=0x7f56e4007aa0).stop 2024-01-22T05:19:24.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.348+0000 7f5704000700 1 -- 172.21.15.49:0/983059703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56fc064530 msgr2=0x7f56fc14c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.348+0000 7f5704000700 1 --2- 172.21.15.49:0/983059703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56fc064530 0x7f56fc14c310 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7f56fc06a760 tx=0x7f56ec017000).stop 2024-01-22T05:19:24.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.348+0000 7f5704000700 1 -- 172.21.15.49:0/983059703 shutdown_connections 2024-01-22T05:19:24.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.348+0000 7f5704000700 1 --2- 172.21.15.49:0/983059703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f56d405a510 0x7f56d405c9d0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.348+0000 7f5704000700 1 --2- 172.21.15.49:0/983059703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56fc151960 0x7f56fc161d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.348+0000 7f5704000700 1 --2- 172.21.15.49:0/983059703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56fc0690f0 0x7f56fc0bf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.348+0000 7f5704000700 1 --2- 172.21.15.49:0/983059703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56fc064530 0x7f56fc14c310 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.348+0000 7f5704000700 1 -- 172.21.15.49:0/983059703 >> 172.21.15.49:0/983059703 conn(0x7f56fc066810 msgr2=0x7f56fc0c6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:24.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.348+0000 7f5704000700 1 -- 172.21.15.49:0/983059703 shutdown_connections 2024-01-22T05:19:24.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.348+0000 7f5704000700 1 -- 172.21.15.49:0/983059703 wait complete. 2024-01-22T05:19:24.370 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:19:24.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.540+0000 7f3e8ea00700 1 Processor -- start 2024-01-22T05:19:24.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.544+0000 7f3e8ea00700 1 -- start start 2024-01-22T05:19:24.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.544+0000 7f3e8ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3e88151700 0x7f3e880c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.544+0000 7f3e8ea00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3e88068280 0x7f3e88062c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.544+0000 7f3e8ea00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e880c73f0 con 0x7f3e880c6fd0 2024-01-22T05:19:24.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.544+0000 7f3e8ea00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e88068880 con 0x7f3e88151700 2024-01-22T05:19:24.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.544+0000 7f3e8ea00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e88068b60 con 0x7f3e88068280 2024-01-22T05:19:24.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e87e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3e88151700 0x7f3e880c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e87e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3e88151700 0x7f3e880c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34544/0 (socket says 172.21.15.49:34544) 2024-01-22T05:19:24.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e8ca00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3e88068280 0x7f3e88062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e87e00700 1 -- 172.21.15.49:0/1414515616 learned_addr learned my addr 172.21.15.49:0/1414515616 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:24.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e8ca00700 1 -- 172.21.15.49:0/1414515616 >> v2:172.21.15.49:3300/0 conn(0x7f3e88151700 msgr2=0x7f3e880c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:24.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e8ca00700 1 --2- 172.21.15.49:0/1414515616 >> v2:172.21.15.49:3300/0 conn(0x7f3e88151700 0x7f3e880c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e8ca00700 1 -- 172.21.15.49:0/1414515616 >> v1:172.21.15.110:6789/0 conn(0x7f3e880c6fd0 legacy=0x7f3e88067b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e8ca00700 1 -- 172.21.15.49:0/1414515616 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e88068e40 con 0x7f3e88068280 2024-01-22T05:19:24.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e8ca00700 1 --2- 172.21.15.49:0/1414515616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e88068280 0x7f3e88062c00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f3e88069400 tx=0x7f3e80009780).ready entity=mon.1 client_cookie=1f26de2ee4eea831 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:24.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e86a00700 1 -- 172.21.15.49:0/1414515616 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8000e070 con 0x7f3e88068280 2024-01-22T05:19:24.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e86a00700 1 -- 172.21.15.49:0/1414515616 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8000bb60 con 0x7f3e88068280 2024-01-22T05:19:24.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e86a00700 1 -- 172.21.15.49:0/1414515616 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e80012410 con 0x7f3e88068280 2024-01-22T05:19:24.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e8ea00700 1 -- 172.21.15.49:0/1414515616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e88068280 msgr2=0x7f3e88062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e8ea00700 1 --2- 172.21.15.49:0/1414515616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e88068280 0x7f3e88062c00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f3e88069400 tx=0x7f3e80009780).stop 2024-01-22T05:19:24.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e8ea00700 1 -- 172.21.15.49:0/1414515616 shutdown_connections 2024-01-22T05:19:24.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e8ea00700 1 --2- 172.21.15.49:0/1414515616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e88068280 0x7f3e88062c00 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e8ea00700 1 --2- 172.21.15.49:0/1414515616 >> v2:172.21.15.49:3300/0 conn(0x7f3e88151700 0x7f3e880c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e8ea00700 1 -- 172.21.15.49:0/1414515616 >> 172.21.15.49:0/1414515616 conn(0x7f3e880c9270 msgr2=0x7f3e880c5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:24.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e8ea00700 1 -- 172.21.15.49:0/1414515616 shutdown_connections 2024-01-22T05:19:24.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.548+0000 7f3e8ea00700 1 -- 172.21.15.49:0/1414515616 wait complete. 2024-01-22T05:19:24.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.552+0000 7f3e8ea00700 1 Processor -- start 2024-01-22T05:19:24.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.552+0000 7f3e8ea00700 1 -- start start 2024-01-22T05:19:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.552+0000 7f3e8ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e88068280 0x7f3e8814d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.552+0000 7f3e8ea00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e880c6fd0 0x7f3e881693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.552+0000 7f3e8ea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e88151700 0x7f3e880aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.552+0000 7f3e8ea00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8814e7b0 con 0x7f3e88151700 2024-01-22T05:19:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.552+0000 7f3e8ea00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e881698e0 con 0x7f3e88068280 2024-01-22T05:19:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.552+0000 7f3e8ea00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8814dba0 con 0x7f3e880c6fd0 2024-01-22T05:19:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.552+0000 7f3e8ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e88151700 0x7f3e880aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e8ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e88151700 0x7f3e880aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34552/0 (socket says 172.21.15.49:34552) 2024-01-22T05:19:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e8ca00700 1 -- 172.21.15.49:0/186227006 learned_addr learned my addr 172.21.15.49:0/186227006 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e87e00700 1 --2- 172.21.15.49:0/186227006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e88068280 0x7f3e8814d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e87400700 1 --2- 172.21.15.49:0/186227006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e880c6fd0 0x7f3e881693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e8ca00700 1 -- 172.21.15.49:0/186227006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e880c6fd0 msgr2=0x7f3e881693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e8ca00700 1 --2- 172.21.15.49:0/186227006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e880c6fd0 0x7f3e881693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e8ca00700 1 -- 172.21.15.49:0/186227006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e88068280 msgr2=0x7f3e8814d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e8ca00700 1 --2- 172.21.15.49:0/186227006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e88068280 0x7f3e8814d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e8ca00700 1 -- 172.21.15.49:0/186227006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e80009a20 con 0x7f3e88151700 2024-01-22T05:19:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e8ca00700 1 --2- 172.21.15.49:0/186227006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e88151700 0x7f3e880aa730 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7f3e88068ca0 tx=0x7f3e880c85a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e7f400700 1 -- 172.21.15.49:0/186227006 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8000b6f0 con 0x7f3e88151700 2024-01-22T05:19:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e7f400700 1 -- 172.21.15.49:0/186227006 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8001d630 con 0x7f3e88151700 2024-01-22T05:19:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e8ea00700 1 -- 172.21.15.49:0/186227006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8814de80 con 0x7f3e88151700 2024-01-22T05:19:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e7f400700 1 -- 172.21.15.49:0/186227006 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8001d9b0 con 0x7f3e88151700 2024-01-22T05:19:24.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e8ea00700 1 -- 172.21.15.49:0/186227006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8814e440 con 0x7f3e88151700 2024-01-22T05:19:24.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.556+0000 7f3e8ea00700 1 -- 172.21.15.49:0/186227006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e88062920 con 0x7f3e88151700 2024-01-22T05:19:24.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.560+0000 7f3e7f400700 1 -- 172.21.15.49:0/186227006 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3e80003040 con 0x7f3e88151700 2024-01-22T05:19:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.560+0000 7f3e7f400700 1 --2- 172.21.15.49:0/186227006 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e6005a4e0 0x7f3e6005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.560+0000 7f3e7f400700 1 -- 172.21.15.49:0/186227006 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3e800767e0 con 0x7f3e88151700 2024-01-22T05:19:24.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.560+0000 7f3e87e00700 1 --2- 172.21.15.49:0/186227006 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e6005a4e0 0x7f3e6005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.560+0000 7f3e87e00700 1 --2- 172.21.15.49:0/186227006 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e6005a4e0 0x7f3e6005c9a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f3e8814d340 tx=0x7f3e780090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:24.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.564+0000 7f3e7f400700 1 -- 172.21.15.49:0/186227006 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3e88062920 con 0x7f3e88151700 2024-01-22T05:19:24.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.732+0000 7f3e8ea00700 1 -- 172.21.15.49:0/186227006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e88062920 con 0x7f3e88151700 2024-01-22T05:19:24.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.732+0000 7f3e7f400700 1 -- 172.21.15.49:0/186227006 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v184) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e88062920 con 0x7f3e88151700 2024-01-22T05:19:24.732 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:19:24.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.736+0000 7f3e8ea00700 1 -- 172.21.15.49:0/186227006 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e6005a4e0 msgr2=0x7f3e6005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.736+0000 7f3e8ea00700 1 --2- 172.21.15.49:0/186227006 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e6005a4e0 0x7f3e6005c9a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f3e8814d340 tx=0x7f3e780090f0).stop 2024-01-22T05:19:24.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.736+0000 7f3e8ea00700 1 -- 172.21.15.49:0/186227006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e88151700 msgr2=0x7f3e880aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.736+0000 7f3e8ea00700 1 --2- 172.21.15.49:0/186227006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e88151700 0x7f3e880aa730 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7f3e88068ca0 tx=0x7f3e880c85a0).stop 2024-01-22T05:19:24.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.736+0000 7f3e8ea00700 1 -- 172.21.15.49:0/186227006 shutdown_connections 2024-01-22T05:19:24.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.736+0000 7f3e8ea00700 1 --2- 172.21.15.49:0/186227006 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3e6005a4e0 0x7f3e6005c9a0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.736+0000 7f3e8ea00700 1 --2- 172.21.15.49:0/186227006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e88151700 0x7f3e880aa730 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.736+0000 7f3e8ea00700 1 --2- 172.21.15.49:0/186227006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e880c6fd0 0x7f3e881693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.736+0000 7f3e8ea00700 1 --2- 172.21.15.49:0/186227006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e88068280 0x7f3e8814d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.736+0000 7f3e8ea00700 1 -- 172.21.15.49:0/186227006 >> 172.21.15.49:0/186227006 conn(0x7f3e880c9270 msgr2=0x7f3e880c1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:24.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.736+0000 7f3e8ea00700 1 -- 172.21.15.49:0/186227006 shutdown_connections 2024-01-22T05:19:24.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.736+0000 7f3e8ea00700 1 -- 172.21.15.49:0/186227006 wait complete. 2024-01-22T05:19:24.758 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:19:24.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.924+0000 7fd24c000700 1 Processor -- start 2024-01-22T05:19:24.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.924+0000 7fd24c000700 1 -- start start 2024-01-22T05:19:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd24c000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd244157f70 0x7fd2441583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd24c000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2440ac0c0 0x7fd2440ac570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd24c000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2440aca60 con 0x7fd244067eb0 2024-01-22T05:19:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd24c000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd244065aa0 con 0x7fd244157f70 2024-01-22T05:19:24.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd24c000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440acfb0 con 0x7fd2440ac0c0 2024-01-22T05:19:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd249600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd244067eb0 0x7fd244065f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60728/0 (socket says 172.21.15.49:60728) 2024-01-22T05:19:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd249600700 1 -- 172.21.15.49:0/2388115503 learned_addr learned my addr 172.21.15.49:0/2388115503 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd248c00700 1 --2- 172.21.15.49:0/2388115503 >> v2:172.21.15.110:3300/0 conn(0x7fd244157f70 0x7fd2441583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd24a000700 1 --2- 172.21.15.49:0/2388115503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2440ac0c0 0x7fd2440ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd243e00700 1 -- 172.21.15.49:0/2388115503 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272614519 0 0) 0x7fd234001110 con 0x7fd244067eb0 2024-01-22T05:19:24.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd243e00700 1 -- 172.21.15.49:0/2388115503 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2240033f0 con 0x7fd244067eb0 2024-01-22T05:19:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd248c00700 1 -- 172.21.15.49:0/2388115503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2440ac0c0 msgr2=0x7fd2440ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:24.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd248c00700 1 --2- 172.21.15.49:0/2388115503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2440ac0c0 0x7fd2440ac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd248c00700 1 -- 172.21.15.49:0/2388115503 >> v1:172.21.15.49:6789/0 conn(0x7fd244067eb0 legacy=0x7fd244065f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd248c00700 1 -- 172.21.15.49:0/2388115503 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd244065770 con 0x7fd244157f70 2024-01-22T05:19:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd248c00700 1 --2- 172.21.15.49:0/2388115503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd244157f70 0x7fd2441583d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fd22c009760 tx=0x7fd22c009060).ready entity=mon.1 client_cookie=a090d55c870eb421 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd243e00700 1 -- 172.21.15.49:0/2388115503 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c00d4a0 con 0x7fd244157f70 2024-01-22T05:19:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd243e00700 1 -- 172.21.15.49:0/2388115503 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c00d600 con 0x7fd244157f70 2024-01-22T05:19:24.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd243e00700 1 -- 172.21.15.49:0/2388115503 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c00d980 con 0x7fd244157f70 2024-01-22T05:19:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd24c000700 1 -- 172.21.15.49:0/2388115503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd244157f70 msgr2=0x7fd2441583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd24c000700 1 --2- 172.21.15.49:0/2388115503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd244157f70 0x7fd2441583d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fd22c009760 tx=0x7fd22c009060).stop 2024-01-22T05:19:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd24c000700 1 -- 172.21.15.49:0/2388115503 shutdown_connections 2024-01-22T05:19:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd24c000700 1 --2- 172.21.15.49:0/2388115503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2440ac0c0 0x7fd2440ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd24c000700 1 --2- 172.21.15.49:0/2388115503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd244157f70 0x7fd2441583d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.928+0000 7fd24c000700 1 -- 172.21.15.49:0/2388115503 >> 172.21.15.49:0/2388115503 conn(0x7fd244062cc0 msgr2=0x7fd2440ca970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.932+0000 7fd24c000700 1 -- 172.21.15.49:0/2388115503 shutdown_connections 2024-01-22T05:19:24.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.932+0000 7fd24c000700 1 -- 172.21.15.49:0/2388115503 wait complete. 2024-01-22T05:19:24.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.932+0000 7fd24c000700 1 Processor -- start 2024-01-22T05:19:24.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.932+0000 7fd24c000700 1 -- start start 2024-01-22T05:19:24.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24c000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd244067eb0 0x7fd2440c1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24c000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2440ac0c0 0x7fd244084c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24c000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd244157f70 0x7fd244085100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24c000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440855f0 con 0x7fd244157f70 2024-01-22T05:19:24.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24c000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd244083d40 con 0x7fd2440ac0c0 2024-01-22T05:19:24.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24c000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd244084020 con 0x7fd244067eb0 2024-01-22T05:19:24.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd244157f70 0x7fd244085100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd244157f70 0x7fd244085100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34558/0 (socket says 172.21.15.49:34558) 2024-01-22T05:19:24.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24a000700 1 -- 172.21.15.49:0/1494093699 learned_addr learned my addr 172.21.15.49:0/1494093699 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:24.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd249600700 1 --2- 172.21.15.49:0/1494093699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd244067eb0 0x7fd2440c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd248c00700 1 --2- 172.21.15.49:0/1494093699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2440ac0c0 0x7fd244084c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24a000700 1 -- 172.21.15.49:0/1494093699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd244067eb0 msgr2=0x7fd2440c1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24a000700 1 --2- 172.21.15.49:0/1494093699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd244067eb0 0x7fd2440c1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24a000700 1 -- 172.21.15.49:0/1494093699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2440ac0c0 msgr2=0x7fd244084c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:24.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24a000700 1 --2- 172.21.15.49:0/1494093699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2440ac0c0 0x7fd244084c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:24.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24a000700 1 -- 172.21.15.49:0/1494093699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c0092a0 con 0x7fd244157f70 2024-01-22T05:19:24.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd249600700 1 --2- 172.21.15.49:0/1494093699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd244067eb0 0x7fd2440c1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:24.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24a000700 1 --2- 172.21.15.49:0/1494093699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd244157f70 0x7fd244085100 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7fd23c009df0 tx=0x7fd23c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:24.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd240c00700 1 -- 172.21.15.49:0/1494093699 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00caa0 con 0x7fd244157f70 2024-01-22T05:19:24.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd240c00700 1 -- 172.21.15.49:0/1494093699 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c00f040 con 0x7fd244157f70 2024-01-22T05:19:24.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd24c000700 1 -- 172.21.15.49:0/1494093699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd244084300 con 0x7fd244157f70 2024-01-22T05:19:24.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.936+0000 7fd240c00700 1 -- 172.21.15.49:0/1494093699 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00ce10 con 0x7fd244157f70 2024-01-22T05:19:24.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.940+0000 7fd24c000700 1 -- 172.21.15.49:0/1494093699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2440848c0 con 0x7fd244157f70 2024-01-22T05:19:24.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.940+0000 7fd24c000700 1 -- 172.21.15.49:0/1494093699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd244046800 con 0x7fd244157f70 2024-01-22T05:19:24.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.940+0000 7fd240c00700 1 -- 172.21.15.49:0/1494093699 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd23c013610 con 0x7fd244157f70 2024-01-22T05:19:24.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.944+0000 7fd240c00700 1 --2- 172.21.15.49:0/1494093699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd21c05a510 0x7fd21c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:24.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.944+0000 7fd240c00700 1 -- 172.21.15.49:0/1494093699 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fd23c075050 con 0x7fd244157f70 2024-01-22T05:19:24.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.944+0000 7fd249600700 1 --2- 172.21.15.49:0/1494093699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd21c05a510 0x7fd21c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:24.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.944+0000 7fd249600700 1 --2- 172.21.15.49:0/1494093699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd21c05a510 0x7fd21c05c9d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7fd234001270 tx=0x7fd234000bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:24.948+0000 7fd240c00700 1 -- 172.21.15.49:0/1494093699 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd23c0486d0 con 0x7fd244157f70 2024-01-22T05:19:25.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.116+0000 7fd24c000700 1 -- 172.21.15.49:0/1494093699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd244064630 con 0x7fd244157f70 2024-01-22T05:19:25.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.120+0000 7fd240c00700 1 -- 172.21.15.49:0/1494093699 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v184) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd23c04bcf0 con 0x7fd244157f70 2024-01-22T05:19:25.119 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:19:25.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.124+0000 7fd24c000700 1 -- 172.21.15.49:0/1494093699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd21c05a510 msgr2=0x7fd21c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.124+0000 7fd24c000700 1 --2- 172.21.15.49:0/1494093699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd21c05a510 0x7fd21c05c9d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7fd234001270 tx=0x7fd234000bc0).stop 2024-01-22T05:19:25.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.124+0000 7fd24c000700 1 -- 172.21.15.49:0/1494093699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd244157f70 msgr2=0x7fd244085100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.124+0000 7fd24c000700 1 --2- 172.21.15.49:0/1494093699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd244157f70 0x7fd244085100 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7fd23c009df0 tx=0x7fd23c00b040).stop 2024-01-22T05:19:25.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.124+0000 7fd24c000700 1 -- 172.21.15.49:0/1494093699 shutdown_connections 2024-01-22T05:19:25.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.124+0000 7fd24c000700 1 --2- 172.21.15.49:0/1494093699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd21c05a510 0x7fd21c05c9d0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.124+0000 7fd24c000700 1 --2- 172.21.15.49:0/1494093699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd244157f70 0x7fd244085100 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.124+0000 7fd24c000700 1 --2- 172.21.15.49:0/1494093699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2440ac0c0 0x7fd244084c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.124+0000 7fd24c000700 1 --2- 172.21.15.49:0/1494093699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd244067eb0 0x7fd2440c1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.124+0000 7fd24c000700 1 -- 172.21.15.49:0/1494093699 >> 172.21.15.49:0/1494093699 conn(0x7fd244062cc0 msgr2=0x7fd2440c8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:25.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.124+0000 7fd24c000700 1 -- 172.21.15.49:0/1494093699 shutdown_connections 2024-01-22T05:19:25.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.124+0000 7fd24c000700 1 -- 172.21.15.49:0/1494093699 wait complete. 2024-01-22T05:19:25.146 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:19:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.300+0000 7fa7ee000700 1 Processor -- start 2024-01-22T05:19:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.304+0000 7fa7ee000700 1 -- start start 2024-01-22T05:19:25.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.304+0000 7fa7ee000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7e80c25e0 0x7fa7e80a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:25.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.304+0000 7fa7ee000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e80c1a40 con 0x7fa7e80a8740 2024-01-22T05:19:25.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.304+0000 7fa7ee000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e80a90b0 con 0x7fa7e8155d20 2024-01-22T05:19:25.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.304+0000 7fa7ee000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e8159310 con 0x7fa7e80c25e0 2024-01-22T05:19:25.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.304+0000 7fa7e7e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7e80c25e0 0x7fa7e80a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:25.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.304+0000 7fa7e7e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7e80c25e0 0x7fa7e80a8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34564/0 (socket says 172.21.15.49:34564) 2024-01-22T05:19:25.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.304+0000 7fa7e7e00700 1 -- 172.21.15.49:0/131532833 learned_addr learned my addr 172.21.15.49:0/131532833 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:25.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.308+0000 7fa7e6000700 1 -- 172.21.15.49:0/131532833 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524251930 0 0) 0x7fa7e80a90b0 con 0x7fa7e8155d20 2024-01-22T05:19:25.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.308+0000 7fa7e6000700 1 -- 172.21.15.49:0/131532833 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7c80033f0 con 0x7fa7e8155d20 2024-01-22T05:19:25.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.308+0000 7fa7e7e00700 1 -- 172.21.15.49:0/131532833 >> v1:172.21.15.110:6789/0 conn(0x7fa7e8155d20 legacy=0x7fa7e8065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.308+0000 7fa7e7e00700 1 -- 172.21.15.49:0/131532833 >> v1:172.21.15.49:6789/0 conn(0x7fa7e80a8740 legacy=0x7fa7e80c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.308+0000 7fa7e7e00700 1 -- 172.21.15.49:0/131532833 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e80c13f0 con 0x7fa7e80c25e0 2024-01-22T05:19:25.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.308+0000 7fa7e7e00700 1 --2- 172.21.15.49:0/131532833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80c25e0 0x7fa7e80a8bc0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7fa7e0009f20 tx=0x7fa7e0009840).ready entity=mon.0 client_cookie=f97def3b0fd62a1b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:25.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.308+0000 7fa7e6000700 1 -- 172.21.15.49:0/131532833 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000e070 con 0x7fa7e80c25e0 2024-01-22T05:19:25.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.308+0000 7fa7e6000700 1 -- 172.21.15.49:0/131532833 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e000b9d0 con 0x7fa7e80c25e0 2024-01-22T05:19:25.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.308+0000 7fa7e6000700 1 -- 172.21.15.49:0/131532833 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000bd50 con 0x7fa7e80c25e0 2024-01-22T05:19:25.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.308+0000 7fa7ee000700 1 -- 172.21.15.49:0/131532833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80c25e0 msgr2=0x7fa7e80a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.308+0000 7fa7ee000700 1 --2- 172.21.15.49:0/131532833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80c25e0 0x7fa7e80a8bc0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7fa7e0009f20 tx=0x7fa7e0009840).stop 2024-01-22T05:19:25.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.308+0000 7fa7ee000700 1 -- 172.21.15.49:0/131532833 shutdown_connections 2024-01-22T05:19:25.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.308+0000 7fa7ee000700 1 --2- 172.21.15.49:0/131532833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80c25e0 0x7fa7e80a8bc0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.308+0000 7fa7ee000700 1 -- 172.21.15.49:0/131532833 >> 172.21.15.49:0/131532833 conn(0x7fa7e80c6540 msgr2=0x7fa7e80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:25.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.312+0000 7fa7ee000700 1 -- 172.21.15.49:0/131532833 shutdown_connections 2024-01-22T05:19:25.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.312+0000 7fa7ee000700 1 -- 172.21.15.49:0/131532833 wait complete. 2024-01-22T05:19:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.312+0000 7fa7ee000700 1 Processor -- start 2024-01-22T05:19:25.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7ee000700 1 -- start start 2024-01-22T05:19:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7ee000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7e80a8740 0x7fa7e80c0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7ee000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80c25e0 0x7fa7e80a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7ee000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7e8155d20 0x7fa7e8149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7ee000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80aa9f0 con 0x7fa7e80c25e0 2024-01-22T05:19:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7ee000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80aacd0 con 0x7fa7e80a8740 2024-01-22T05:19:25.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7ee000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80a9e00 con 0x7fa7e8155d20 2024-01-22T05:19:25.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7e6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80c25e0 0x7fa7e80a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:25.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7e6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80c25e0 0x7fa7e80a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34572/0 (socket says 172.21.15.49:34572) 2024-01-22T05:19:25.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7e6a00700 1 -- 172.21.15.49:0/1938286913 learned_addr learned my addr 172.21.15.49:0/1938286913 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:25.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7e7400700 1 --2- 172.21.15.49:0/1938286913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7e80a8740 0x7fa7e80c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:25.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7e7e00700 1 --2- 172.21.15.49:0/1938286913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7e8155d20 0x7fa7e8149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:25.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7e6a00700 1 -- 172.21.15.49:0/1938286913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7e8155d20 msgr2=0x7fa7e8149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7e6a00700 1 --2- 172.21.15.49:0/1938286913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7e8155d20 0x7fa7e8149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7e6a00700 1 -- 172.21.15.49:0/1938286913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7e80a8740 msgr2=0x7fa7e80c0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7e6a00700 1 --2- 172.21.15.49:0/1938286913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7e80a8740 0x7fa7e80c0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7e6a00700 1 -- 172.21.15.49:0/1938286913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0009ae0 con 0x7fa7e80c25e0 2024-01-22T05:19:25.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7e7e00700 1 --2- 172.21.15.49:0/1938286913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7e8155d20 0x7fa7e8149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:19:25.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.316+0000 7fa7e6a00700 1 --2- 172.21.15.49:0/1938286913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80c25e0 0x7fa7e80a95b0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7fa7d000c470 tx=0x7fa7d0007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:25.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.320+0000 7fa7dea00700 1 -- 172.21.15.49:0/1938286913 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d000f470 con 0x7fa7e80c25e0 2024-01-22T05:19:25.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.320+0000 7fa7dea00700 1 -- 172.21.15.49:0/1938286913 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d000f5d0 con 0x7fa7e80c25e0 2024-01-22T05:19:25.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.320+0000 7fa7dea00700 1 -- 172.21.15.49:0/1938286913 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d000f970 con 0x7fa7e80c25e0 2024-01-22T05:19:25.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.320+0000 7fa7ee000700 1 -- 172.21.15.49:0/1938286913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e80aa0e0 con 0x7fa7e80c25e0 2024-01-22T05:19:25.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.320+0000 7fa7ee000700 1 -- 172.21.15.49:0/1938286913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e80a9aa0 con 0x7fa7e80c25e0 2024-01-22T05:19:25.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.320+0000 7fa7ee000700 1 -- 172.21.15.49:0/1938286913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e80aae60 con 0x7fa7e80c25e0 2024-01-22T05:19:25.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.320+0000 7fa7dea00700 1 -- 172.21.15.49:0/1938286913 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa7d001b3b0 con 0x7fa7e80c25e0 2024-01-22T05:19:25.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.324+0000 7fa7dea00700 1 --2- 172.21.15.49:0/1938286913 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7c005a510 0x7fa7c005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:25.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.324+0000 7fa7dea00700 1 -- 172.21.15.49:0/1938286913 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa7d0073d90 con 0x7fa7e80c25e0 2024-01-22T05:19:25.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.324+0000 7fa7e7400700 1 --2- 172.21.15.49:0/1938286913 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7c005a510 0x7fa7c005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:25.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.324+0000 7fa7e7400700 1 --2- 172.21.15.49:0/1938286913 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7c005a510 0x7fa7c005c9d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7fa7d8003660 tx=0x7fa7d8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:25.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.328+0000 7fa7dea00700 1 -- 172.21.15.49:0/1938286913 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa7d0047460 con 0x7fa7e80c25e0 2024-01-22T05:19:25.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.524+0000 7fa7ee000700 1 -- 172.21.15.49:0/1938286913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7e8047060 con 0x7fa7e80c25e0 2024-01-22T05:19:25.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.524+0000 7fa7dea00700 1 -- 172.21.15.49:0/1938286913 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+4506 (secure 0 0 0) 0x7fa7d0017030 con 0x7fa7e80c25e0 2024-01-22T05:19:25.524 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:25.524 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":143,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1331200361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1331200361},{"type":"v1","addr":"172.21.15.110:6835","nonce":1331200361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137},{"gid":9994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/377934467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":377934467},{"type":"v1","addr":"172.21.15.110:6834","nonce":377934467}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137},{"gid":10101,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3482770597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3482770597},{"type":"v1","addr":"172.21.15.49:6835","nonce":3482770597}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:08.068628+0000","modified":"2024-01-22T05:19:24.558075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10104},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10104":{"gid":10104,"name":"a","rank":0,"incarnation":138,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6837/3574461601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3574461601},{"type":"v1","addr":"172.21.15.49:6837","nonce":3574461601}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2024-01-22T05:19:25.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.528+0000 7fa7ee000700 1 -- 172.21.15.49:0/1938286913 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7c005a510 msgr2=0x7fa7c005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.528+0000 7fa7ee000700 1 --2- 172.21.15.49:0/1938286913 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7c005a510 0x7fa7c005c9d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7fa7d8003660 tx=0x7fa7d8009040).stop 2024-01-22T05:19:25.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.528+0000 7fa7ee000700 1 -- 172.21.15.49:0/1938286913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80c25e0 msgr2=0x7fa7e80a95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.528+0000 7fa7ee000700 1 --2- 172.21.15.49:0/1938286913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80c25e0 0x7fa7e80a95b0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7fa7d000c470 tx=0x7fa7d0007dc0).stop 2024-01-22T05:19:25.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.528+0000 7fa7ee000700 1 -- 172.21.15.49:0/1938286913 shutdown_connections 2024-01-22T05:19:25.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.528+0000 7fa7ee000700 1 --2- 172.21.15.49:0/1938286913 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7c005a510 0x7fa7c005c9d0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.528+0000 7fa7ee000700 1 --2- 172.21.15.49:0/1938286913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7e8155d20 0x7fa7e8149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.528+0000 7fa7ee000700 1 --2- 172.21.15.49:0/1938286913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7e80c25e0 0x7fa7e80a95b0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.528+0000 7fa7ee000700 1 --2- 172.21.15.49:0/1938286913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7e80a8740 0x7fa7e80c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.528+0000 7fa7ee000700 1 -- 172.21.15.49:0/1938286913 >> 172.21.15.49:0/1938286913 conn(0x7fa7e80c6540 msgr2=0x7fa7e8065bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:25.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.528+0000 7fa7ee000700 1 -- 172.21.15.49:0/1938286913 shutdown_connections 2024-01-22T05:19:25.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.528+0000 7fa7ee000700 1 -- 172.21.15.49:0/1938286913 wait complete. 2024-01-22T05:19:25.531 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 143 2024-01-22T05:19:25.554 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:19:25.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.720+0000 7f5fa0000700 1 Processor -- start 2024-01-22T05:19:25.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.720+0000 7f5fa0000700 1 -- start start 2024-01-22T05:19:25.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5fa0000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f980be6a0 0x7f5f980c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:25.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5fa0000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f980be210 con 0x7f5f98064690 2024-01-22T05:19:25.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5fa0000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f980bd650 con 0x7f5f98151a80 2024-01-22T05:19:25.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5fa0000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980bd8e0 con 0x7f5f980be6a0 2024-01-22T05:19:25.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f9cc00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5f98064690 0x7f5f98151370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60740/0 (socket says 172.21.15.49:60740) 2024-01-22T05:19:25.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f9cc00700 1 -- 172.21.15.49:0/3581680599 learned_addr learned my addr 172.21.15.49:0/3581680599 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:25.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f9d600700 1 --2- 172.21.15.49:0/3581680599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f980be6a0 0x7f5f980c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f97e00700 1 -- 172.21.15.49:0/3581680599 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335127049 0 0) 0x7f5f980be210 con 0x7f5f98064690 2024-01-22T05:19:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f97e00700 1 -- 172.21.15.49:0/3581680599 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f780033f0 con 0x7f5f98064690 2024-01-22T05:19:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f97e00700 1 -- 172.21.15.49:0/3581680599 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4147232588 0 0) 0x7f5f780033f0 con 0x7f5f98064690 2024-01-22T05:19:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f97e00700 1 -- 172.21.15.49:0/3581680599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f980be6a0 msgr2=0x7f5f980c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f97e00700 1 --2- 172.21.15.49:0/3581680599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f980be6a0 0x7f5f980c2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f97e00700 1 -- 172.21.15.49:0/3581680599 >> v1:172.21.15.110:6789/0 conn(0x7f5f98151a80 legacy=0x7f5f980a7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f97e00700 1 -- 172.21.15.49:0/3581680599 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f980bdbc0 con 0x7f5f98064690 2024-01-22T05:19:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f97e00700 1 -- 172.21.15.49:0/3581680599 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f5f80001470 con 0x7f5f98064690 2024-01-22T05:19:25.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f97e00700 1 -- 172.21.15.49:0/3581680599 >> v1:172.21.15.49:6789/0 conn(0x7f5f98064690 legacy=0x7f5f98151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f97e00700 1 --2- 172.21.15.49:0/3581680599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f980be6a0 0x7f5f78003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:25.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f97e00700 1 --2- 172.21.15.49:0/3581680599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f78003e40 0x7f5f78004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:25.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f97e00700 1 --2- 172.21.15.49:0/3581680599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f78004b80 0x7f5f78005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:25.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f97e00700 1 -- 172.21.15.49:0/3581680599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980bd8e0 con 0x7f5f78003e40 2024-01-22T05:19:25.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f97e00700 1 -- 172.21.15.49:0/3581680599 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7800ba10 con 0x7f5f78004b80 2024-01-22T05:19:25.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f97e00700 1 -- 172.21.15.49:0/3581680599 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7800bbd0 con 0x7f5f980be6a0 2024-01-22T05:19:25.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f9cc00700 1 --2- 172.21.15.49:0/3581680599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f78003e40 0x7f5f78004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f9d600700 1 --2- 172.21.15.49:0/3581680599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f980be6a0 0x7f5f78003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f9ea00700 1 --2- 172.21.15.49:0/3581680599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f78004b80 0x7f5f78005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f9cc00700 1 -- 172.21.15.49:0/3581680599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f980be6a0 msgr2=0x7f5f78003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f9cc00700 1 --2- 172.21.15.49:0/3581680599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f980be6a0 0x7f5f78003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f9cc00700 1 -- 172.21.15.49:0/3581680599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f78004b80 msgr2=0x7f5f78005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f9cc00700 1 --2- 172.21.15.49:0/3581680599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f78004b80 0x7f5f78005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f9cc00700 1 -- 172.21.15.49:0/3581680599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f780033f0 con 0x7f5f78003e40 2024-01-22T05:19:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f9ea00700 1 --2- 172.21.15.49:0/3581680599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f78004b80 0x7f5f78005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:19:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.724+0000 7f5f9cc00700 1 --2- 172.21.15.49:0/3581680599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f78003e40 0x7f5f78004690 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7f5f8000c160 tx=0x7f5f80001e50).ready entity=mon.0 client_cookie=802cee898b0f9f44 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.728+0000 7f5f97e00700 1 -- 172.21.15.49:0/3581680599 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80007a20 con 0x7f5f78003e40 2024-01-22T05:19:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.728+0000 7f5f97e00700 1 -- 172.21.15.49:0/3581680599 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8000ca90 con 0x7f5f78003e40 2024-01-22T05:19:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.728+0000 7f5f97e00700 1 -- 172.21.15.49:0/3581680599 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8000ce30 con 0x7f5f78003e40 2024-01-22T05:19:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.728+0000 7f5fa0000700 1 -- 172.21.15.49:0/3581680599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f78003e40 msgr2=0x7f5f78004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.728+0000 7f5fa0000700 1 --2- 172.21.15.49:0/3581680599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f78003e40 0x7f5f78004690 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7f5f8000c160 tx=0x7f5f80001e50).stop 2024-01-22T05:19:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.728+0000 7f5f9ea00700 1 -- 172.21.15.49:0/3581680599 reap_dead start 2024-01-22T05:19:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.728+0000 7f5fa0000700 1 -- 172.21.15.49:0/3581680599 shutdown_connections 2024-01-22T05:19:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.728+0000 7f5fa0000700 1 -- 172.21.15.49:0/3581680599 >> 172.21.15.49:0/3581680599 conn(0x7f5f980c87f0 msgr2=0x7f5f980c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.728+0000 7f5fa0000700 1 -- 172.21.15.49:0/3581680599 shutdown_connections 2024-01-22T05:19:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.728+0000 7f5fa0000700 1 -- 172.21.15.49:0/3581680599 wait complete. 2024-01-22T05:19:25.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.732+0000 7f5fa0000700 1 Processor -- start 2024-01-22T05:19:25.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.732+0000 7f5fa0000700 1 -- start start 2024-01-22T05:19:25.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.732+0000 7f5fa0000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f78003e40 0x7f5f9814bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:25.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.732+0000 7f5fa0000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f980ab6a0 0x7f5f980abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:25.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.732+0000 7f5fa0000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f98152580 0x7f5f98152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:25.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.732+0000 7f5fa0000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f98152ef0 con 0x7f5f78003e40 2024-01-22T05:19:25.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.732+0000 7f5fa0000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980bfb00 con 0x7f5f980ab6a0 2024-01-22T05:19:25.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.732+0000 7f5fa0000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980beef0 con 0x7f5f98152580 2024-01-22T05:19:25.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.732+0000 7f5f9d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f78003e40 0x7f5f9814bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:25.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.732+0000 7f5f9d600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f78003e40 0x7f5f9814bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34596/0 (socket says 172.21.15.49:34596) 2024-01-22T05:19:25.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.732+0000 7f5f9d600700 1 -- 172.21.15.49:0/1589736275 learned_addr learned my addr 172.21.15.49:0/1589736275 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:25.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.736+0000 7f5f9ea00700 1 --2- 172.21.15.49:0/1589736275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f98152580 0x7f5f98152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:25.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.736+0000 7f5f9cc00700 1 --2- 172.21.15.49:0/1589736275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f980ab6a0 0x7f5f980abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:25.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.736+0000 7f5f9d600700 1 -- 172.21.15.49:0/1589736275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f98152580 msgr2=0x7f5f98152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.736+0000 7f5f9d600700 1 --2- 172.21.15.49:0/1589736275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f98152580 0x7f5f98152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.736+0000 7f5f9d600700 1 -- 172.21.15.49:0/1589736275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f980ab6a0 msgr2=0x7f5f980abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.736+0000 7f5f9d600700 1 --2- 172.21.15.49:0/1589736275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f980ab6a0 0x7f5f980abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.736+0000 7f5f9d600700 1 -- 172.21.15.49:0/1589736275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f980bf1d0 con 0x7f5f78003e40 2024-01-22T05:19:25.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.736+0000 7f5f9cc00700 1 --2- 172.21.15.49:0/1589736275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f980ab6a0 0x7f5f980abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:25.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.736+0000 7f5f9d600700 1 --2- 172.21.15.49:0/1589736275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f78003e40 0x7f5f9814bba0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7f5f88011a20 tx=0x7f5f88009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:25.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.736+0000 7f5f94c00700 1 -- 172.21.15.49:0/1589736275 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8800f8e0 con 0x7f5f78003e40 2024-01-22T05:19:25.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.736+0000 7f5f94c00700 1 -- 172.21.15.49:0/1589736275 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8800fa40 con 0x7f5f78003e40 2024-01-22T05:19:25.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.736+0000 7f5fa0000700 1 -- 172.21.15.49:0/1589736275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f980bf4b0 con 0x7f5f78003e40 2024-01-22T05:19:25.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.736+0000 7f5f94c00700 1 -- 172.21.15.49:0/1589736275 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8800fdc0 con 0x7f5f78003e40 2024-01-22T05:19:25.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.736+0000 7f5fa0000700 1 -- 172.21.15.49:0/1589736275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f980ace00 con 0x7f5f78003e40 2024-01-22T05:19:25.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.736+0000 7f5fa0000700 1 -- 172.21.15.49:0/1589736275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f980bf930 con 0x7f5f78003e40 2024-01-22T05:19:25.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.740+0000 7f5f94c00700 1 -- 172.21.15.49:0/1589736275 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5f88014650 con 0x7f5f78003e40 2024-01-22T05:19:25.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.740+0000 7f5f94c00700 1 --2- 172.21.15.49:0/1589736275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f7005a510 0x7f5f7005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:25.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.740+0000 7f5f94c00700 1 -- 172.21.15.49:0/1589736275 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f5f880754b0 con 0x7f5f78003e40 2024-01-22T05:19:25.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.740+0000 7f5f9cc00700 1 --2- 172.21.15.49:0/1589736275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f7005a510 0x7f5f7005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:25.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.740+0000 7f5f9cc00700 1 --2- 172.21.15.49:0/1589736275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f7005a510 0x7f5f7005c9d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f5f80001e90 tx=0x7f5f80015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:25.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.748+0000 7f5f94c00700 1 -- 172.21.15.49:0/1589736275 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5f88048b30 con 0x7f5f78003e40 2024-01-22T05:19:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.912+0000 7f5fa0000700 1 -- 172.21.15.49:0/1589736275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f98047060 con 0x7f5f78003e40 2024-01-22T05:19:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.916+0000 7f5f94c00700 1 -- 172.21.15.49:0/1589736275 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+17178 (secure 0 0 0) 0x7f5f8804c150 con 0x7f5f78003e40 2024-01-22T05:19:25.917 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:25.917 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":184,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:19:09.074168+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:19:06.223141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-01-22T05:19:07.103306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:19:25.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.920+0000 7f5fa0000700 1 -- 172.21.15.49:0/1589736275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f7005a510 msgr2=0x7f5f7005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.920+0000 7f5fa0000700 1 --2- 172.21.15.49:0/1589736275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f7005a510 0x7f5f7005c9d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f5f80001e90 tx=0x7f5f80015000).stop 2024-01-22T05:19:25.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.920+0000 7f5fa0000700 1 -- 172.21.15.49:0/1589736275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f78003e40 msgr2=0x7f5f9814bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:25.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.920+0000 7f5fa0000700 1 --2- 172.21.15.49:0/1589736275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f78003e40 0x7f5f9814bba0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7f5f88011a20 tx=0x7f5f88009060).stop 2024-01-22T05:19:25.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.920+0000 7f5fa0000700 1 -- 172.21.15.49:0/1589736275 shutdown_connections 2024-01-22T05:19:25.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.920+0000 7f5fa0000700 1 --2- 172.21.15.49:0/1589736275 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f5f7005a510 0x7f5f7005c9d0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.920+0000 7f5fa0000700 1 --2- 172.21.15.49:0/1589736275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f98152580 0x7f5f98152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.920+0000 7f5fa0000700 1 --2- 172.21.15.49:0/1589736275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f980ab6a0 0x7f5f980abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.920+0000 7f5fa0000700 1 --2- 172.21.15.49:0/1589736275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f78003e40 0x7f5f9814bba0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:25.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.920+0000 7f5fa0000700 1 -- 172.21.15.49:0/1589736275 >> 172.21.15.49:0/1589736275 conn(0x7f5f980c87f0 msgr2=0x7f5f980a7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:25.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.920+0000 7f5fa0000700 1 -- 172.21.15.49:0/1589736275 shutdown_connections 2024-01-22T05:19:25.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:25.920+0000 7f5fa0000700 1 -- 172.21.15.49:0/1589736275 wait complete. 2024-01-22T05:19:25.942 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:19:25.942 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:19:26.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.104+0000 7f7215e00700 1 Processor -- start 2024-01-22T05:19:26.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.104+0000 7f7215e00700 1 -- start start 2024-01-22T05:19:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.108+0000 7f7215e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f72100c2d90 0x7f72100c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.108+0000 7f7215e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72100bd110 con 0x7f72100bc580 2024-01-22T05:19:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.108+0000 7f7215e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72100c2130 con 0x7f7210153930 2024-01-22T05:19:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.108+0000 7f7215e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7210154c50 con 0x7f72100c2d90 2024-01-22T05:19:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.108+0000 7f720ea00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f72100c2d90 0x7f72100c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.108+0000 7f720e000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f72100bc580 0x7f72100bca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60756/0 (socket says 172.21.15.49:60756) 2024-01-22T05:19:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.112+0000 7f720e000700 1 -- 172.21.15.49:0/894207295 learned_addr learned my addr 172.21.15.49:0/894207295 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.108+0000 7f720f400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7210153930 0x7f7210153da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:44976/0 (socket says 172.21.15.49:44976) 2024-01-22T05:19:26.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.112+0000 7f720ea00700 1 -- 172.21.15.49:0/894207295 >> v1:172.21.15.110:6789/0 conn(0x7f7210153930 legacy=0x7f7210153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.112+0000 7f720ea00700 1 -- 172.21.15.49:0/894207295 >> v1:172.21.15.49:6789/0 conn(0x7f72100bc580 legacy=0x7f72100bca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.112+0000 7f720ea00700 1 -- 172.21.15.49:0/894207295 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7210154f30 con 0x7f72100c2d90 2024-01-22T05:19:26.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.112+0000 7f720d600700 1 -- 172.21.15.49:0/894207295 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104985440 0 0) 0x7f72100c2130 con 0x7f7210153930 2024-01-22T05:19:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.112+0000 7f720ea00700 1 --2- 172.21.15.49:0/894207295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72100c2d90 0x7f72100c3170 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f7200009760 tx=0x7f7200009060).ready entity=mon.1 client_cookie=4281e96633fdf44d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.112+0000 7f720d600700 1 -- 172.21.15.49:0/894207295 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720000b580 con 0x7f72100c2d90 2024-01-22T05:19:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.112+0000 7f720d600700 1 -- 172.21.15.49:0/894207295 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720000b6e0 con 0x7f72100c2d90 2024-01-22T05:19:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.112+0000 7f720d600700 1 -- 172.21.15.49:0/894207295 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720000ba60 con 0x7f72100c2d90 2024-01-22T05:19:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.112+0000 7f7215e00700 1 -- 172.21.15.49:0/894207295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72100c2d90 msgr2=0x7f72100c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.112+0000 7f7215e00700 1 --2- 172.21.15.49:0/894207295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72100c2d90 0x7f72100c3170 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f7200009760 tx=0x7f7200009060).stop 2024-01-22T05:19:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.112+0000 7f7215e00700 1 -- 172.21.15.49:0/894207295 shutdown_connections 2024-01-22T05:19:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.112+0000 7f7215e00700 1 --2- 172.21.15.49:0/894207295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72100c2d90 0x7f72100c3170 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.112+0000 7f7215e00700 1 -- 172.21.15.49:0/894207295 >> 172.21.15.49:0/894207295 conn(0x7f7210066830 msgr2=0x7f7210066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.116+0000 7f7215e00700 1 -- 172.21.15.49:0/894207295 shutdown_connections 2024-01-22T05:19:26.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.116+0000 7f7215e00700 1 -- 172.21.15.49:0/894207295 wait complete. 2024-01-22T05:19:26.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.116+0000 7f7215e00700 1 Processor -- start 2024-01-22T05:19:26.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.116+0000 7f7215e00700 1 -- start start 2024-01-22T05:19:26.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f7215e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72100bc580 0x7f7210150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f7215e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72100c2d90 0x7f7210151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f7215e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7210153930 0x7f72100acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f7215e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72100ad6d0 con 0x7f7210153930 2024-01-22T05:19:26.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f7215e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7210151ab0 con 0x7f72100bc580 2024-01-22T05:19:26.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f7215e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72100ad3f0 con 0x7f72100c2d90 2024-01-22T05:19:26.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f720f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7210153930 0x7f72100acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f720f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7210153930 0x7f72100acaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34610/0 (socket says 172.21.15.49:34610) 2024-01-22T05:19:26.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f720f400700 1 -- 172.21.15.49:0/1217886194 learned_addr learned my addr 172.21.15.49:0/1217886194 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:26.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f720ea00700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72100bc580 0x7f7210150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f720e000700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72100c2d90 0x7f7210151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f720f400700 1 -- 172.21.15.49:0/1217886194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72100c2d90 msgr2=0x7f7210151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f720f400700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72100c2d90 0x7f7210151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f720f400700 1 -- 172.21.15.49:0/1217886194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72100bc580 msgr2=0x7f7210150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f720f400700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72100bc580 0x7f7210150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f720f400700 1 -- 172.21.15.49:0/1217886194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72000092a0 con 0x7f7210153930 2024-01-22T05:19:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f720e000700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72100c2d90 0x7f7210151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:19:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f720ea00700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72100bc580 0x7f7210150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f720f400700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7210153930 0x7f72100acaf0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7f720800c7e0 tx=0x7f7208007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f7206000700 1 -- 172.21.15.49:0/1217886194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7208005c70 con 0x7f7210153930 2024-01-22T05:19:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f7206000700 1 -- 172.21.15.49:0/1217886194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7208005dd0 con 0x7f7210153930 2024-01-22T05:19:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f7215e00700 1 -- 172.21.15.49:0/1217886194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7210151460 con 0x7f7210153930 2024-01-22T05:19:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.120+0000 7f7206000700 1 -- 172.21.15.49:0/1217886194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7208007320 con 0x7f7210153930 2024-01-22T05:19:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.124+0000 7f7215e00700 1 -- 172.21.15.49:0/1217886194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7210151010 con 0x7f7210153930 2024-01-22T05:19:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.124+0000 7f7215e00700 1 -- 172.21.15.49:0/1217886194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72101512c0 con 0x7f7210153930 2024-01-22T05:19:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.124+0000 7f7206000700 1 -- 172.21.15.49:0/1217886194 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7208007710 con 0x7f7210153930 2024-01-22T05:19:26.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.128+0000 7f7206000700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71e805a540 0x7f71e805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.128+0000 7f7206000700 1 -- 172.21.15.49:0/1217886194 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7208074a50 con 0x7f7210153930 2024-01-22T05:19:26.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.128+0000 7f720ea00700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71e805a540 0x7f71e805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.128+0000 7f720ea00700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71e805a540 0x7f71e805ca00 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f720000b340 tx=0x7f7200017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:26.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.132+0000 7f7206000700 1 -- 172.21.15.49:0/1217886194 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f72101512c0 con 0x7f7210153930 2024-01-22T05:19:26.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.332+0000 7f7215e00700 1 -- 172.21.15.49:0/1217886194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72101512c0 con 0x7f7210153930 2024-01-22T05:19:26.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.332+0000 7f7206000700 1 -- 172.21.15.49:0/1217886194 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+4506 (secure 0 0 0) 0x7f72101512c0 con 0x7f7210153930 2024-01-22T05:19:26.333 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:26.333 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":143,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1331200361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1331200361},{"type":"v1","addr":"172.21.15.110:6835","nonce":1331200361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137},{"gid":9994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/377934467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":377934467},{"type":"v1","addr":"172.21.15.110:6834","nonce":377934467}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137},{"gid":10101,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3482770597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3482770597},{"type":"v1","addr":"172.21.15.49:6835","nonce":3482770597}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:08.068628+0000","modified":"2024-01-22T05:19:24.558075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10104},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10104":{"gid":10104,"name":"a","rank":0,"incarnation":138,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6837/3574461601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3574461601},{"type":"v1","addr":"172.21.15.49:6837","nonce":3574461601}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2024-01-22T05:19:26.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.336+0000 7f7215e00700 1 -- 172.21.15.49:0/1217886194 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71e805a540 msgr2=0x7f71e805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.336+0000 7f7215e00700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71e805a540 0x7f71e805ca00 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f720000b340 tx=0x7f7200017000).stop 2024-01-22T05:19:26.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.336+0000 7f7215e00700 1 -- 172.21.15.49:0/1217886194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7210153930 msgr2=0x7f72100acaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.336+0000 7f7215e00700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7210153930 0x7f72100acaf0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7f720800c7e0 tx=0x7f7208007f60).stop 2024-01-22T05:19:26.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.336+0000 7f7215e00700 1 -- 172.21.15.49:0/1217886194 shutdown_connections 2024-01-22T05:19:26.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.336+0000 7f7215e00700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f71e805a540 0x7f71e805ca00 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.336+0000 7f7215e00700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7210153930 0x7f72100acaf0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.336+0000 7f7215e00700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72100c2d90 0x7f7210151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.336+0000 7f7215e00700 1 --2- 172.21.15.49:0/1217886194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72100bc580 0x7f7210150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.336+0000 7f7215e00700 1 -- 172.21.15.49:0/1217886194 >> 172.21.15.49:0/1217886194 conn(0x7f7210066830 msgr2=0x7f72100c5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:26.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.336+0000 7f7215e00700 1 -- 172.21.15.49:0/1217886194 shutdown_connections 2024-01-22T05:19:26.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.336+0000 7f7215e00700 1 -- 172.21.15.49:0/1217886194 wait complete. 2024-01-22T05:19:26.340 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 143 2024-01-22T05:19:26.360 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:19:26.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.516+0000 7fdbae600700 1 Processor -- start 2024-01-22T05:19:26.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.516+0000 7fdbae600700 1 -- start start 2024-01-22T05:19:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.520+0000 7fdbae600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdba80a7ad0 0x7fdba80a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.520+0000 7fdbae600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8068460 0x7fdba80be6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.520+0000 7fdbae600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba80c72c0 con 0x7fdba80688a0 2024-01-22T05:19:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.520+0000 7fdbae600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba80bdee0 con 0x7fdba80a7ad0 2024-01-22T05:19:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.520+0000 7fdbae600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80c66b0 con 0x7fdba8068460 2024-01-22T05:19:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdba7400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdba80a7ad0 0x7fdba80a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdba6a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8068460 0x7fdba80be6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdbad000700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fdba80688a0 0x7fdba80beba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:44984/0 (socket says 172.21.15.49:44984) 2024-01-22T05:19:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdba7400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdba80a7ad0 0x7fdba80a5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:36008/0 (socket says 172.21.15.49:36008) 2024-01-22T05:19:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdbad000700 1 -- 172.21.15.49:0/577188228 learned_addr learned my addr 172.21.15.49:0/577188228 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:26.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdba7400700 1 -- 172.21.15.49:0/577188228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8068460 msgr2=0x7fdba80be6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:26.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdba7400700 1 --2- 172.21.15.49:0/577188228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8068460 0x7fdba80be6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdba7400700 1 -- 172.21.15.49:0/577188228 >> v1:172.21.15.110:6789/0 conn(0x7fdba80688a0 legacy=0x7fdba80beba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdba7400700 1 -- 172.21.15.49:0/577188228 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80c6990 con 0x7fdba80a7ad0 2024-01-22T05:19:26.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdba6000700 1 -- 172.21.15.49:0/577188228 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457160189 0 0) 0x7fdba80c72c0 con 0x7fdba80688a0 2024-01-22T05:19:26.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdba6a00700 1 --2- 172.21.15.49:0/577188228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8068460 0x7fdba80be6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:26.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdba7400700 1 --2- 172.21.15.49:0/577188228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba80a7ad0 0x7fdba80a5360 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7fdb9800a900 tx=0x7fdb9800a200).ready entity=mon.1 client_cookie=409d9bf5545ebcb2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:26.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdba6000700 1 -- 172.21.15.49:0/577188228 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9800c790 con 0x7fdba80a7ad0 2024-01-22T05:19:26.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdba6000700 1 -- 172.21.15.49:0/577188228 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9800c8f0 con 0x7fdba80a7ad0 2024-01-22T05:19:26.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdba6000700 1 -- 172.21.15.49:0/577188228 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9800cc70 con 0x7fdba80a7ad0 2024-01-22T05:19:26.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdbae600700 1 -- 172.21.15.49:0/577188228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba80a7ad0 msgr2=0x7fdba80a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.524+0000 7fdbae600700 1 --2- 172.21.15.49:0/577188228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba80a7ad0 0x7fdba80a5360 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7fdb9800a900 tx=0x7fdb9800a200).stop 2024-01-22T05:19:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.528+0000 7fdbae600700 1 -- 172.21.15.49:0/577188228 shutdown_connections 2024-01-22T05:19:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.528+0000 7fdbae600700 1 --2- 172.21.15.49:0/577188228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba8068460 0x7fdba80be6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.528+0000 7fdbae600700 1 --2- 172.21.15.49:0/577188228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba80a7ad0 0x7fdba80a5360 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.528+0000 7fdbae600700 1 -- 172.21.15.49:0/577188228 >> 172.21.15.49:0/577188228 conn(0x7fdba8062a10 msgr2=0x7fdba8081fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:26.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.528+0000 7fdbae600700 1 -- 172.21.15.49:0/577188228 shutdown_connections 2024-01-22T05:19:26.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.528+0000 7fdbae600700 1 -- 172.21.15.49:0/577188228 wait complete. 2024-01-22T05:19:26.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.528+0000 7fdbae600700 1 Processor -- start 2024-01-22T05:19:26.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.528+0000 7fdbae600700 1 -- start start 2024-01-22T05:19:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdbae600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba8068460 0x7fdba80ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdbae600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba80688a0 0x7fdba816bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdbae600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba80a7ad0 0x7fdba80aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdbae600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba816c240 con 0x7fdba80688a0 2024-01-22T05:19:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdbae600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba816c4d0 con 0x7fdba8068460 2024-01-22T05:19:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdbae600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba816c7b0 con 0x7fdba80a7ad0 2024-01-22T05:19:26.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdba6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba80688a0 0x7fdba816bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdba6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba80688a0 0x7fdba816bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34618/0 (socket says 172.21.15.49:34618) 2024-01-22T05:19:26.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdba6a00700 1 -- 172.21.15.49:0/3020748830 learned_addr learned my addr 172.21.15.49:0/3020748830 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:26.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdba7400700 1 --2- 172.21.15.49:0/3020748830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba8068460 0x7fdba80ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdbad000700 1 --2- 172.21.15.49:0/3020748830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba80a7ad0 0x7fdba80aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdba6a00700 1 -- 172.21.15.49:0/3020748830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba80a7ad0 msgr2=0x7fdba80aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdba6a00700 1 --2- 172.21.15.49:0/3020748830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba80a7ad0 0x7fdba80aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdba6a00700 1 -- 172.21.15.49:0/3020748830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba8068460 msgr2=0x7fdba80ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdba6a00700 1 --2- 172.21.15.49:0/3020748830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba8068460 0x7fdba80ab750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdba6a00700 1 -- 172.21.15.49:0/3020748830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb900092a0 con 0x7fdba80688a0 2024-01-22T05:19:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdbad000700 1 --2- 172.21.15.49:0/3020748830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba80a7ad0 0x7fdba80aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdba6a00700 1 --2- 172.21.15.49:0/3020748830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba80688a0 0x7fdba816bd50 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7fdb9000e980 tx=0x7fdb90009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdb9ea00700 1 -- 172.21.15.49:0/3020748830 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9000ee70 con 0x7fdba80688a0 2024-01-22T05:19:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdb9ea00700 1 -- 172.21.15.49:0/3020748830 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9000c850 con 0x7fdba80688a0 2024-01-22T05:19:26.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdbae600700 1 -- 172.21.15.49:0/3020748830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9800a440 con 0x7fdba80688a0 2024-01-22T05:19:26.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdb9ea00700 1 -- 172.21.15.49:0/3020748830 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9000cbd0 con 0x7fdba80688a0 2024-01-22T05:19:26.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.532+0000 7fdbae600700 1 -- 172.21.15.49:0/3020748830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba813fd00 con 0x7fdba80688a0 2024-01-22T05:19:26.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.536+0000 7fdbae600700 1 -- 172.21.15.49:0/3020748830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba816ccb0 con 0x7fdba80688a0 2024-01-22T05:19:26.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.536+0000 7fdb9ea00700 1 -- 172.21.15.49:0/3020748830 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdb9001b400 con 0x7fdba80688a0 2024-01-22T05:19:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.536+0000 7fdb9ea00700 1 --2- 172.21.15.49:0/3020748830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb8005a510 0x7fdb8005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.540+0000 7fdb9ea00700 1 -- 172.21.15.49:0/3020748830 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fdb90074eb0 con 0x7fdba80688a0 2024-01-22T05:19:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.540+0000 7fdba7400700 1 --2- 172.21.15.49:0/3020748830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb8005a510 0x7fdb8005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.540+0000 7fdba7400700 1 --2- 172.21.15.49:0/3020748830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb8005a510 0x7fdb8005c9d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fdb98006d10 tx=0x7fdb9800a200).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:26.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.544+0000 7fdb9ea00700 1 -- 172.21.15.49:0/3020748830 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdb90048410 con 0x7fdba80688a0 2024-01-22T05:19:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.748+0000 7fdbae600700 1 -- 172.21.15.49:0/3020748830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdba80c6c70 con 0x7fdba80688a0 2024-01-22T05:19:26.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.748+0000 7fdb9ea00700 1 -- 172.21.15.49:0/3020748830 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+4506 (secure 0 0 0) 0x7fdb9004ba30 con 0x7fdba80688a0 2024-01-22T05:19:26.748 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:26.748 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":143,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1331200361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1331200361},{"type":"v1","addr":"172.21.15.110:6835","nonce":1331200361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137},{"gid":9994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/377934467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":377934467},{"type":"v1","addr":"172.21.15.110:6834","nonce":377934467}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137},{"gid":10101,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3482770597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3482770597},{"type":"v1","addr":"172.21.15.49:6835","nonce":3482770597}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:08.068628+0000","modified":"2024-01-22T05:19:24.558075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10104},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10104":{"gid":10104,"name":"a","rank":0,"incarnation":138,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6837/3574461601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3574461601},{"type":"v1","addr":"172.21.15.49:6837","nonce":3574461601}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2024-01-22T05:19:26.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.752+0000 7fdbae600700 1 -- 172.21.15.49:0/3020748830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb8005a510 msgr2=0x7fdb8005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.752+0000 7fdbae600700 1 --2- 172.21.15.49:0/3020748830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb8005a510 0x7fdb8005c9d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fdb98006d10 tx=0x7fdb9800a200).stop 2024-01-22T05:19:26.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.752+0000 7fdbae600700 1 -- 172.21.15.49:0/3020748830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba80688a0 msgr2=0x7fdba816bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.752+0000 7fdbae600700 1 --2- 172.21.15.49:0/3020748830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba80688a0 0x7fdba816bd50 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7fdb9000e980 tx=0x7fdb90009060).stop 2024-01-22T05:19:26.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.752+0000 7fdbae600700 1 -- 172.21.15.49:0/3020748830 shutdown_connections 2024-01-22T05:19:26.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.752+0000 7fdbae600700 1 --2- 172.21.15.49:0/3020748830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb8005a510 0x7fdb8005c9d0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.752+0000 7fdbae600700 1 --2- 172.21.15.49:0/3020748830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba80a7ad0 0x7fdba80aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.752+0000 7fdbae600700 1 --2- 172.21.15.49:0/3020748830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba80688a0 0x7fdba816bd50 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.752+0000 7fdbae600700 1 --2- 172.21.15.49:0/3020748830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba8068460 0x7fdba80ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.752+0000 7fdbae600700 1 -- 172.21.15.49:0/3020748830 >> 172.21.15.49:0/3020748830 conn(0x7fdba8062a10 msgr2=0x7fdba814b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:26.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.752+0000 7fdbae600700 1 -- 172.21.15.49:0/3020748830 shutdown_connections 2024-01-22T05:19:26.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.752+0000 7fdbae600700 1 -- 172.21.15.49:0/3020748830 wait complete. 2024-01-22T05:19:26.755 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 143 2024-01-22T05:19:26.774 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:19:26.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.932+0000 7fe561000700 1 Processor -- start 2024-01-22T05:19:26.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.932+0000 7fe561000700 1 -- start start 2024-01-22T05:19:26.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.936+0000 7fe561000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe55c151850 0x7fe55c151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.936+0000 7fe561000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe55c155670 0x7fe55c155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.936+0000 7fe561000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55c0bdfd0 con 0x7fe55c155fa0 2024-01-22T05:19:26.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.936+0000 7fe561000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55c063490 con 0x7fe55c155670 2024-01-22T05:19:26.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.936+0000 7fe561000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55c063770 con 0x7fe55c151850 2024-01-22T05:19:26.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.936+0000 7fe559400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe55c155670 0x7fe55c155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.936+0000 7fe559400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe55c155670 0x7fe55c155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34626/0 (socket says 172.21.15.49:34626) 2024-01-22T05:19:26.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.936+0000 7fe559400700 1 -- 172.21.15.49:0/2963181572 learned_addr learned my addr 172.21.15.49:0/2963181572 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:26.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.936+0000 7fe559e00700 1 --2- 172.21.15.49:0/2963181572 >> v2:172.21.15.110:3300/0 conn(0x7fe55c151850 0x7fe55c151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.936+0000 7fe559400700 1 -- 172.21.15.49:0/2963181572 >> v2:172.21.15.110:3300/0 conn(0x7fe55c151850 msgr2=0x7fe55c151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:26.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.936+0000 7fe559400700 1 --2- 172.21.15.49:0/2963181572 >> v2:172.21.15.110:3300/0 conn(0x7fe55c151850 0x7fe55c151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.936+0000 7fe559400700 1 -- 172.21.15.49:0/2963181572 >> v1:172.21.15.49:6789/0 conn(0x7fe55c155fa0 legacy=0x7fe55c062230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.940+0000 7fe559400700 1 -- 172.21.15.49:0/2963181572 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c063a50 con 0x7fe55c155670 2024-01-22T05:19:26.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.940+0000 7fe559400700 1 --2- 172.21.15.49:0/2963181572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c155670 0x7fe55c155ab0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7fe55c067800 tx=0x7fe5440090f0).ready entity=mon.0 client_cookie=d674eb8c52586895 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:26.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.940+0000 7fe558a00700 1 -- 172.21.15.49:0/2963181572 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54400b520 con 0x7fe55c155670 2024-01-22T05:19:26.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.940+0000 7fe558a00700 1 -- 172.21.15.49:0/2963181572 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54400b680 con 0x7fe55c155670 2024-01-22T05:19:26.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.940+0000 7fe558a00700 1 -- 172.21.15.49:0/2963181572 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54400ba00 con 0x7fe55c155670 2024-01-22T05:19:26.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.940+0000 7fe561000700 1 -- 172.21.15.49:0/2963181572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c155670 msgr2=0x7fe55c155ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.940+0000 7fe561000700 1 --2- 172.21.15.49:0/2963181572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c155670 0x7fe55c155ab0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7fe55c067800 tx=0x7fe5440090f0).stop 2024-01-22T05:19:26.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.940+0000 7fe561000700 1 -- 172.21.15.49:0/2963181572 shutdown_connections 2024-01-22T05:19:26.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.940+0000 7fe561000700 1 --2- 172.21.15.49:0/2963181572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c155670 0x7fe55c155ab0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.940+0000 7fe561000700 1 --2- 172.21.15.49:0/2963181572 >> v2:172.21.15.110:3300/0 conn(0x7fe55c151850 0x7fe55c151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.940+0000 7fe561000700 1 -- 172.21.15.49:0/2963181572 >> 172.21.15.49:0/2963181572 conn(0x7fe55c0c5860 msgr2=0x7fe55c0c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:26.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.940+0000 7fe561000700 1 -- 172.21.15.49:0/2963181572 shutdown_connections 2024-01-22T05:19:26.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.940+0000 7fe561000700 1 -- 172.21.15.49:0/2963181572 wait complete. 2024-01-22T05:19:26.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.944+0000 7fe561000700 1 Processor -- start 2024-01-22T05:19:26.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.944+0000 7fe561000700 1 -- start start 2024-01-22T05:19:26.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.944+0000 7fe561000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c151850 0x7fe55c150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.944+0000 7fe561000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c155670 0x7fe55c0c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.944+0000 7fe561000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe55c155fa0 0x7fe55c0c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.944+0000 7fe561000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c150710 con 0x7fe55c155670 2024-01-22T05:19:26.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.944+0000 7fe561000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c154130 con 0x7fe55c155fa0 2024-01-22T05:19:26.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.944+0000 7fe561000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c1520c0 con 0x7fe55c151850 2024-01-22T05:19:26.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.944+0000 7fe559400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c155670 0x7fe55c0c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe559e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c151850 0x7fe55c150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe55b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe55c155fa0 0x7fe55c0c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe559400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c155670 0x7fe55c0c33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34628/0 (socket says 172.21.15.49:34628) 2024-01-22T05:19:26.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe559e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c151850 0x7fe55c150220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:53364/0 (socket says 172.21.15.49:53364) 2024-01-22T05:19:26.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe559400700 1 -- 172.21.15.49:0/2360868830 learned_addr learned my addr 172.21.15.49:0/2360868830 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:26.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe559e00700 1 -- 172.21.15.49:0/2360868830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe55c155fa0 msgr2=0x7fe55c0c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe559e00700 1 --2- 172.21.15.49:0/2360868830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe55c155fa0 0x7fe55c0c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe559e00700 1 -- 172.21.15.49:0/2360868830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c155670 msgr2=0x7fe55c0c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:26.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe559e00700 1 --2- 172.21.15.49:0/2360868830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c155670 0x7fe55c0c33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:26.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe559e00700 1 -- 172.21.15.49:0/2360868830 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe544009370 con 0x7fe55c151850 2024-01-22T05:19:26.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe55b200700 1 --2- 172.21.15.49:0/2360868830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe55c155fa0 0x7fe55c0c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:26.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe559e00700 1 --2- 172.21.15.49:0/2360868830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c151850 0x7fe55c150220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fe54c00e880 tx=0x7fe54c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:26.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe551600700 1 -- 172.21.15.49:0/2360868830 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c012600 con 0x7fe55c151850 2024-01-22T05:19:26.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe551600700 1 -- 172.21.15.49:0/2360868830 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c012760 con 0x7fe55c151850 2024-01-22T05:19:26.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe561000700 1 -- 172.21.15.49:0/2360868830 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55c153ae0 con 0x7fe55c151850 2024-01-22T05:19:26.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe551600700 1 -- 172.21.15.49:0/2360868830 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c012ae0 con 0x7fe55c151850 2024-01-22T05:19:26.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe561000700 1 -- 172.21.15.49:0/2360868830 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55c153720 con 0x7fe55c151850 2024-01-22T05:19:26.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.948+0000 7fe561000700 1 -- 172.21.15.49:0/2360868830 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55c047060 con 0x7fe55c151850 2024-01-22T05:19:26.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.952+0000 7fe551600700 1 -- 172.21.15.49:0/2360868830 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe54c01b400 con 0x7fe55c151850 2024-01-22T05:19:26.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.952+0000 7fe551600700 1 --2- 172.21.15.49:0/2360868830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe53405a510 0x7fe53405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:26.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.952+0000 7fe551600700 1 -- 172.21.15.49:0/2360868830 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe54c074db0 con 0x7fe55c151850 2024-01-22T05:19:26.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.952+0000 7fe559400700 1 --2- 172.21.15.49:0/2360868830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe53405a510 0x7fe53405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:26.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.952+0000 7fe559400700 1 --2- 172.21.15.49:0/2360868830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe53405a510 0x7fe53405c9d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7fe55c0aefd0 tx=0x7fe544017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:26.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:26.960+0000 7fe551600700 1 -- 172.21.15.49:0/2360868830 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe54c048470 con 0x7fe55c151850 2024-01-22T05:19:27.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.128+0000 7fe561000700 1 -- 172.21.15.49:0/2360868830 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe55c0bdd20 con 0x7fe55c151850 2024-01-22T05:19:27.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.132+0000 7fe551600700 1 -- 172.21.15.49:0/2360868830 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+17178 (secure 0 0 0) 0x7fe54c016070 con 0x7fe55c151850 2024-01-22T05:19:27.131 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:27.131 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":184,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:19:09.074168+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:19:06.223141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-01-22T05:19:07.103306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:19:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.136+0000 7fe561000700 1 -- 172.21.15.49:0/2360868830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe53405a510 msgr2=0x7fe53405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.136+0000 7fe561000700 1 --2- 172.21.15.49:0/2360868830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe53405a510 0x7fe53405c9d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7fe55c0aefd0 tx=0x7fe544017000).stop 2024-01-22T05:19:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.136+0000 7fe561000700 1 -- 172.21.15.49:0/2360868830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c151850 msgr2=0x7fe55c150220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:27.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.136+0000 7fe561000700 1 --2- 172.21.15.49:0/2360868830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c151850 0x7fe55c150220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fe54c00e880 tx=0x7fe54c009060).stop 2024-01-22T05:19:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.136+0000 7fe561000700 1 -- 172.21.15.49:0/2360868830 shutdown_connections 2024-01-22T05:19:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.136+0000 7fe561000700 1 --2- 172.21.15.49:0/2360868830 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe53405a510 0x7fe53405c9d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.136+0000 7fe561000700 1 --2- 172.21.15.49:0/2360868830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe55c155fa0 0x7fe55c0c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.136+0000 7fe561000700 1 --2- 172.21.15.49:0/2360868830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe55c155670 0x7fe55c0c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.136+0000 7fe561000700 1 --2- 172.21.15.49:0/2360868830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe55c151850 0x7fe55c150220 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.136+0000 7fe561000700 1 -- 172.21.15.49:0/2360868830 >> 172.21.15.49:0/2360868830 conn(0x7fe55c0c5860 msgr2=0x7fe55c062230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:27.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.136+0000 7fe561000700 1 -- 172.21.15.49:0/2360868830 shutdown_connections 2024-01-22T05:19:27.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.136+0000 7fe561000700 1 -- 172.21.15.49:0/2360868830 wait complete. 2024-01-22T05:19:27.160 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:19:27.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.324+0000 7fb3d2e00700 1 Processor -- start 2024-01-22T05:19:27.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.324+0000 7fb3d2e00700 1 -- start start 2024-01-22T05:19:27.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3d2e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3cc0c7fe0 0x7fb3cc0c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:27.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3d2e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3cc0bf890 0x7fb3cc068c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:27.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3d2e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3cc0c67a0 con 0x7fb3cc069150 2024-01-22T05:19:27.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3d2e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3cc1541c0 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3d2e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc0c5b90 con 0x7fb3cc0bf890 2024-01-22T05:19:27.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3cbe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3cc0c7fe0 0x7fb3cc0c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:27.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3cbe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3cc0c7fe0 0x7fb3cc0c6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34638/0 (socket says 172.21.15.49:34638) 2024-01-22T05:19:27.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3cbe00700 1 -- 172.21.15.49:0/832309465 learned_addr learned my addr 172.21.15.49:0/832309465 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:27.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3cbe00700 1 -- 172.21.15.49:0/832309465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3cc0bf890 msgr2=0x7fb3cc068c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:27.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3cb400700 1 --2- 172.21.15.49:0/832309465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3cc0bf890 0x7fb3cc068c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:27.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3cbe00700 1 --2- 172.21.15.49:0/832309465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3cc0bf890 0x7fb3cc068c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3cbe00700 1 -- 172.21.15.49:0/832309465 >> v1:172.21.15.49:6789/0 conn(0x7fb3cc069150 legacy=0x7fb3cc0c01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:27.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3cbe00700 1 -- 172.21.15.49:0/832309465 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc0c5e70 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3cb400700 1 --2- 172.21.15.49:0/832309465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3cc0bf890 0x7fb3cc068c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:19:27.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3cbe00700 1 --2- 172.21.15.49:0/832309465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3cc0c7fe0 0x7fb3cc0c6c30 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 rx=0x7fb3bc009830 tx=0x7fb3bc0090f0).ready entity=mon.0 client_cookie=9057c0e02112c05a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3caa00700 1 -- 172.21.15.49:0/832309465 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc00b600 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3caa00700 1 -- 172.21.15.49:0/832309465 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3bc00b760 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3caa00700 1 -- 172.21.15.49:0/832309465 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc00bb00 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3d2e00700 1 -- 172.21.15.49:0/832309465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3cc0c7fe0 msgr2=0x7fb3cc0c6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.328+0000 7fb3d2e00700 1 --2- 172.21.15.49:0/832309465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3cc0c7fe0 0x7fb3cc0c6c30 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 rx=0x7fb3bc009830 tx=0x7fb3bc0090f0).stop 2024-01-22T05:19:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.332+0000 7fb3d2e00700 1 -- 172.21.15.49:0/832309465 shutdown_connections 2024-01-22T05:19:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.332+0000 7fb3d2e00700 1 --2- 172.21.15.49:0/832309465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3cc0bf890 0x7fb3cc068c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.332+0000 7fb3d2e00700 1 --2- 172.21.15.49:0/832309465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3cc0c7fe0 0x7fb3cc0c6c30 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.332+0000 7fb3d2e00700 1 -- 172.21.15.49:0/832309465 >> 172.21.15.49:0/832309465 conn(0x7fb3cc0cb3a0 msgr2=0x7fb3cc0c73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.332+0000 7fb3d2e00700 1 -- 172.21.15.49:0/832309465 shutdown_connections 2024-01-22T05:19:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.332+0000 7fb3d2e00700 1 -- 172.21.15.49:0/832309465 wait complete. 2024-01-22T05:19:27.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.332+0000 7fb3d2e00700 1 Processor -- start 2024-01-22T05:19:27.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.332+0000 7fb3d2e00700 1 -- start start 2024-01-22T05:19:27.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3d2e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3cc069150 0x7fb3cc0c2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:27.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3d2e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3cc0bf890 0x7fb3cc0c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:27.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3d2e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3cc0c7fe0 0x7fb3cc0c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:27.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3d2e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc0c3e80 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3d2e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc0ae280 con 0x7fb3cc069150 2024-01-22T05:19:27.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3d2e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc0c2bf0 con 0x7fb3cc0bf890 2024-01-22T05:19:27.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3d0e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3cc0c7fe0 0x7fb3cc0c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:27.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3d0e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3cc0c7fe0 0x7fb3cc0c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34640/0 (socket says 172.21.15.49:34640) 2024-01-22T05:19:27.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3d0e00700 1 -- 172.21.15.49:0/3675837911 learned_addr learned my addr 172.21.15.49:0/3675837911 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:27.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3cb400700 1 --2- 172.21.15.49:0/3675837911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3cc0bf890 0x7fb3cc0c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:27.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3cbe00700 1 --2- 172.21.15.49:0/3675837911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3cc069150 0x7fb3cc0c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:27.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3d0e00700 1 -- 172.21.15.49:0/3675837911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3cc0bf890 msgr2=0x7fb3cc0c34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:27.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3d0e00700 1 --2- 172.21.15.49:0/3675837911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3cc0bf890 0x7fb3cc0c34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3d0e00700 1 -- 172.21.15.49:0/3675837911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3cc069150 msgr2=0x7fb3cc0c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:27.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3d0e00700 1 --2- 172.21.15.49:0/3675837911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3cc069150 0x7fb3cc0c2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.336+0000 7fb3d0e00700 1 -- 172.21.15.49:0/3675837911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc009370 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.340+0000 7fb3d0e00700 1 --2- 172.21.15.49:0/3675837911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3cc0c7fe0 0x7fb3cc0c3990 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7fb3c400c7c0 tx=0x7fb3c4001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:27.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.340+0000 7fb3c3400700 1 -- 172.21.15.49:0/3675837911 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c400e4a0 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.340+0000 7fb3c3400700 1 -- 172.21.15.49:0/3675837911 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c400e600 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.340+0000 7fb3c3400700 1 -- 172.21.15.49:0/3675837911 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c400e980 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.340+0000 7fb3d2e00700 1 -- 172.21.15.49:0/3675837911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3cc0ad950 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.340+0000 7fb3d2e00700 1 -- 172.21.15.49:0/3675837911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3cc0adf10 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.340+0000 7fb3c3400700 1 -- 172.21.15.49:0/3675837911 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb3c400ed30 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.340+0000 7fb3d2e00700 1 -- 172.21.15.49:0/3675837911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3cc0ae430 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.344+0000 7fb3c3400700 1 --2- 172.21.15.49:0/3675837911 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb3a405a510 0x7fb3a405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:27.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.344+0000 7fb3c3400700 1 -- 172.21.15.49:0/3675837911 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb3c4073f80 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.344+0000 7fb3cbe00700 1 --2- 172.21.15.49:0/3675837911 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb3a405a510 0x7fb3a405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:27.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.344+0000 7fb3cbe00700 1 --2- 172.21.15.49:0/3675837911 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb3a405a510 0x7fb3a405c9d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7fb3cc0c9b80 tx=0x7fb3bc017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:27.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.348+0000 7fb3c3400700 1 -- 172.21.15.49:0/3675837911 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb3c40a2b00 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.544+0000 7fb3d2e00700 1 -- 172.21.15.49:0/3675837911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb3cc064260 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.581 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:19:27.580+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:19:27.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.588+0000 7fb3c3400700 1 -- 172.21.15.49:0/3675837911 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v144) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb3c4017030 con 0x7fb3cc0c7fe0 2024-01-22T05:19:27.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.592+0000 7fb3d2e00700 1 -- 172.21.15.49:0/3675837911 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb3a405a510 msgr2=0x7fb3a405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:27.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.592+0000 7fb3d2e00700 1 --2- 172.21.15.49:0/3675837911 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb3a405a510 0x7fb3a405c9d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7fb3cc0c9b80 tx=0x7fb3bc017000).stop 2024-01-22T05:19:27.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.592+0000 7fb3d2e00700 1 -- 172.21.15.49:0/3675837911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3cc0c7fe0 msgr2=0x7fb3cc0c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:27.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.592+0000 7fb3d2e00700 1 --2- 172.21.15.49:0/3675837911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3cc0c7fe0 0x7fb3cc0c3990 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7fb3c400c7c0 tx=0x7fb3c4001510).stop 2024-01-22T05:19:27.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.592+0000 7fb3d2e00700 1 -- 172.21.15.49:0/3675837911 shutdown_connections 2024-01-22T05:19:27.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.592+0000 7fb3d2e00700 1 --2- 172.21.15.49:0/3675837911 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb3a405a510 0x7fb3a405c9d0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.592+0000 7fb3d2e00700 1 --2- 172.21.15.49:0/3675837911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3cc0c7fe0 0x7fb3cc0c3990 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.592+0000 7fb3d2e00700 1 --2- 172.21.15.49:0/3675837911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3cc0bf890 0x7fb3cc0c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.592+0000 7fb3d2e00700 1 --2- 172.21.15.49:0/3675837911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3cc069150 0x7fb3cc0c2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.592+0000 7fb3d2e00700 1 -- 172.21.15.49:0/3675837911 >> 172.21.15.49:0/3675837911 conn(0x7fb3cc0cb3a0 msgr2=0x7fb3cc154300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:27.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.592+0000 7fb3d2e00700 1 -- 172.21.15.49:0/3675837911 shutdown_connections 2024-01-22T05:19:27.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.592+0000 7fb3d2e00700 1 -- 172.21.15.49:0/3675837911 wait complete. 2024-01-22T05:19:27.596 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:19:27.615 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:19:27.655 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:19:27.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.780+0000 7fc666e00700 1 Processor -- start 2024-01-22T05:19:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.780+0000 7fc666e00700 1 -- start start 2024-01-22T05:19:27.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc666e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc6601581e0 0x7fc6600c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:27.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc666e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc660065bd0 con 0x7fc6600a8e50 2024-01-22T05:19:27.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc666e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6600c18c0 con 0x7fc6600c13d0 2024-01-22T05:19:27.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc666e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6600c1ba0 con 0x7fc6601581e0 2024-01-22T05:19:27.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc666400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc6600a8e50 0x7fc660066080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60794/0 (socket says 172.21.15.49:60794) 2024-01-22T05:19:27.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc666400700 1 -- 172.21.15.49:0/4215170000 learned_addr learned my addr 172.21.15.49:0/4215170000 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:27.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc665a00700 1 --2- 172.21.15.49:0/4215170000 >> v2:172.21.15.110:3300/0 conn(0x7fc6601581e0 0x7fc6600c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:27.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc65fe00700 1 -- 172.21.15.49:0/4215170000 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410572687 0 0) 0x7fc660065bd0 con 0x7fc6600a8e50 2024-01-22T05:19:27.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc65fe00700 1 -- 172.21.15.49:0/4215170000 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6400033f0 con 0x7fc6600a8e50 2024-01-22T05:19:27.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc65fe00700 1 -- 172.21.15.49:0/4215170000 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880372682 0 0) 0x7fc6600c18c0 con 0x7fc6600c13d0 2024-01-22T05:19:27.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc65fe00700 1 -- 172.21.15.49:0/4215170000 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc660065bd0 con 0x7fc6600c13d0 2024-01-22T05:19:27.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc665a00700 1 -- 172.21.15.49:0/4215170000 >> v1:172.21.15.110:6789/0 conn(0x7fc6600c13d0 legacy=0x7fc6600a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:27.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc665a00700 1 -- 172.21.15.49:0/4215170000 >> v1:172.21.15.49:6789/0 conn(0x7fc6600a8e50 legacy=0x7fc660066080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:27.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc665a00700 1 -- 172.21.15.49:0/4215170000 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6600c1e80 con 0x7fc6601581e0 2024-01-22T05:19:27.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc665a00700 1 --2- 172.21.15.49:0/4215170000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6601581e0 0x7fc6600c0ee0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7fc650009760 tx=0x7fc650009060).ready entity=mon.1 client_cookie=40a93209c5849c2b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:27.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc65fe00700 1 -- 172.21.15.49:0/4215170000 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650009120 con 0x7fc6601581e0 2024-01-22T05:19:27.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc65fe00700 1 -- 172.21.15.49:0/4215170000 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65000d4a0 con 0x7fc6601581e0 2024-01-22T05:19:27.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.784+0000 7fc65fe00700 1 -- 172.21.15.49:0/4215170000 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65000d820 con 0x7fc6601581e0 2024-01-22T05:19:27.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.788+0000 7fc666e00700 1 -- 172.21.15.49:0/4215170000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6601581e0 msgr2=0x7fc6600c0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:27.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.788+0000 7fc666e00700 1 --2- 172.21.15.49:0/4215170000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6601581e0 0x7fc6600c0ee0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7fc650009760 tx=0x7fc650009060).stop 2024-01-22T05:19:27.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.788+0000 7fc666e00700 1 -- 172.21.15.49:0/4215170000 shutdown_connections 2024-01-22T05:19:27.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.788+0000 7fc666e00700 1 --2- 172.21.15.49:0/4215170000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6601581e0 0x7fc6600c0ee0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.788+0000 7fc666e00700 1 -- 172.21.15.49:0/4215170000 >> 172.21.15.49:0/4215170000 conn(0x7fc6600c6540 msgr2=0x7fc6600c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:27.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.788+0000 7fc666e00700 1 -- 172.21.15.49:0/4215170000 shutdown_connections 2024-01-22T05:19:27.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.788+0000 7fc666e00700 1 -- 172.21.15.49:0/4215170000 wait complete. 2024-01-22T05:19:27.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc666e00700 1 Processor -- start 2024-01-22T05:19:27.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc666e00700 1 -- start start 2024-01-22T05:19:27.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc666e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6600a8e50 0x7fc660156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:27.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc666e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6600c13d0 0x7fc6600a11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:27.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc666e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6601581e0 0x7fc6600bf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:27.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc666e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc660156ce0 con 0x7fc6600c13d0 2024-01-22T05:19:27.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc666e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6600a1b40 con 0x7fc6601581e0 2024-01-22T05:19:27.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc666e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6600a1d70 con 0x7fc6600a8e50 2024-01-22T05:19:27.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc665000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6600c13d0 0x7fc6600a11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:27.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc665000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6600c13d0 0x7fc6600a11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34674/0 (socket says 172.21.15.49:34674) 2024-01-22T05:19:27.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc665000700 1 -- 172.21.15.49:0/4276894903 learned_addr learned my addr 172.21.15.49:0/4276894903 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:27.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc665a00700 1 --2- 172.21.15.49:0/4276894903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6600a8e50 0x7fc660156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:27.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc666400700 1 --2- 172.21.15.49:0/4276894903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6601581e0 0x7fc6600bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:27.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc665000700 1 -- 172.21.15.49:0/4276894903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6600a8e50 msgr2=0x7fc660156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:27.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc665000700 1 --2- 172.21.15.49:0/4276894903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6600a8e50 0x7fc660156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc665000700 1 -- 172.21.15.49:0/4276894903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6601581e0 msgr2=0x7fc6600bf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:27.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.792+0000 7fc665000700 1 --2- 172.21.15.49:0/4276894903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6601581e0 0x7fc6600bf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:27.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.796+0000 7fc665000700 1 -- 172.21.15.49:0/4276894903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6500092a0 con 0x7fc6600c13d0 2024-01-22T05:19:27.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.796+0000 7fc665000700 1 --2- 172.21.15.49:0/4276894903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6600c13d0 0x7fc6600a11b0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7fc64800c490 tx=0x7fc648007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:27.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.796+0000 7fc65cc00700 1 -- 172.21.15.49:0/4276894903 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64800ce40 con 0x7fc6600c13d0 2024-01-22T05:19:27.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.796+0000 7fc65cc00700 1 -- 172.21.15.49:0/4276894903 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64800f470 con 0x7fc6600c13d0 2024-01-22T05:19:27.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.796+0000 7fc65cc00700 1 -- 172.21.15.49:0/4276894903 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64800f830 con 0x7fc6600c13d0 2024-01-22T05:19:27.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.796+0000 7fc666e00700 1 -- 172.21.15.49:0/4276894903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6600a2050 con 0x7fc6600c13d0 2024-01-22T05:19:27.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.796+0000 7fc666e00700 1 -- 172.21.15.49:0/4276894903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6600a2610 con 0x7fc6600c13d0 2024-01-22T05:19:27.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.796+0000 7fc666e00700 1 -- 172.21.15.49:0/4276894903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc660047060 con 0x7fc6600c13d0 2024-01-22T05:19:27.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.800+0000 7fc65cc00700 1 -- 172.21.15.49:0/4276894903 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc64800fbe0 con 0x7fc6600c13d0 2024-01-22T05:19:27.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.800+0000 7fc65cc00700 1 --2- 172.21.15.49:0/4276894903 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc63805a510 0x7fc63805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:27.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.800+0000 7fc65cc00700 1 -- 172.21.15.49:0/4276894903 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6647+0+0 (secure 0 0 0) 0x7fc648073ed0 con 0x7fc6600c13d0 2024-01-22T05:19:27.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.800+0000 7fc665a00700 1 --2- 172.21.15.49:0/4276894903 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc63805a510 0x7fc63805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:27.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.800+0000 7fc665a00700 1 --2- 172.21.15.49:0/4276894903 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc63805a510 0x7fc63805c9d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fc650006d60 tx=0x7fc650016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:27.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:27.804+0000 7fc65cc00700 1 -- 172.21.15.49:0/4276894903 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc6480474a0 con 0x7fc6600c13d0 2024-01-22T05:19:28.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.004+0000 7fc666e00700 1 -- 172.21.15.49:0/4276894903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc660063ea0 con 0x7fc6600c13d0 2024-01-22T05:19:28.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.604+0000 7fc65cc00700 1 -- 172.21.15.49:0/4276894903 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v145) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc648007d80 con 0x7fc6600c13d0 2024-01-22T05:19:28.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.608+0000 7fc666e00700 1 -- 172.21.15.49:0/4276894903 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc63805a510 msgr2=0x7fc63805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:28.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.608+0000 7fc666e00700 1 --2- 172.21.15.49:0/4276894903 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc63805a510 0x7fc63805c9d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fc650006d60 tx=0x7fc650016000).stop 2024-01-22T05:19:28.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.608+0000 7fc666e00700 1 -- 172.21.15.49:0/4276894903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6600c13d0 msgr2=0x7fc6600a11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:28.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.608+0000 7fc666e00700 1 --2- 172.21.15.49:0/4276894903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6600c13d0 0x7fc6600a11b0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7fc64800c490 tx=0x7fc648007c60).stop 2024-01-22T05:19:28.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.612+0000 7fc666e00700 1 -- 172.21.15.49:0/4276894903 shutdown_connections 2024-01-22T05:19:28.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.612+0000 7fc666e00700 1 --2- 172.21.15.49:0/4276894903 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc63805a510 0x7fc63805c9d0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:28.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.612+0000 7fc666e00700 1 --2- 172.21.15.49:0/4276894903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6601581e0 0x7fc6600bf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:28.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.612+0000 7fc666e00700 1 --2- 172.21.15.49:0/4276894903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6600c13d0 0x7fc6600a11b0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.612+0000 7fc666e00700 1 --2- 172.21.15.49:0/4276894903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6600a8e50 0x7fc660156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.612+0000 7fc666e00700 1 -- 172.21.15.49:0/4276894903 >> 172.21.15.49:0/4276894903 conn(0x7fc6600c6540 msgr2=0x7fc6600c50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.612+0000 7fc666e00700 1 -- 172.21.15.49:0/4276894903 shutdown_connections 2024-01-22T05:19:28.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.612+0000 7fc666e00700 1 -- 172.21.15.49:0/4276894903 wait complete. 2024-01-22T05:19:28.636 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:19:28.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.848+0000 7fde89600700 1 Processor -- start 2024-01-22T05:19:28.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.852+0000 7fde89600700 1 -- start start 2024-01-22T05:19:28.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.856+0000 7fde89600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde840c4110 0x7fde84157de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:28.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.856+0000 7fde89600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde840c1f10 con 0x7fde84062940 2024-01-22T05:19:28.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.856+0000 7fde89600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde840c21f0 con 0x7fde841582d0 2024-01-22T05:19:28.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.856+0000 7fde89600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde840c24d0 con 0x7fde840c4110 2024-01-22T05:19:28.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.856+0000 7fde83400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fde84062940 0x7fde840bc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60802/0 (socket says 172.21.15.49:60802) 2024-01-22T05:19:28.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.856+0000 7fde83400700 1 -- 172.21.15.49:0/2103700455 learned_addr learned my addr 172.21.15.49:0/2103700455 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:28.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.856+0000 7fde82a00700 1 --2- 172.21.15.49:0/2103700455 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde840c4110 0x7fde84157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:28.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.856+0000 7fde81600700 1 -- 172.21.15.49:0/2103700455 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032922988 0 0) 0x7fde840c1f10 con 0x7fde84062940 2024-01-22T05:19:28.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.856+0000 7fde81600700 1 -- 172.21.15.49:0/2103700455 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde640033f0 con 0x7fde84062940 2024-01-22T05:19:28.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.856+0000 7fde81600700 1 -- 172.21.15.49:0/2103700455 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793705810 0 0) 0x7fde840c21f0 con 0x7fde841582d0 2024-01-22T05:19:28.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.856+0000 7fde82a00700 1 -- 172.21.15.49:0/2103700455 >> v1:172.21.15.110:6789/0 conn(0x7fde841582d0 legacy=0x7fde84062230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:28.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.856+0000 7fde82a00700 1 -- 172.21.15.49:0/2103700455 >> v1:172.21.15.49:6789/0 conn(0x7fde84062940 legacy=0x7fde840bc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:28.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.856+0000 7fde82a00700 1 -- 172.21.15.49:0/2103700455 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde840bc410 con 0x7fde840c4110 2024-01-22T05:19:28.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.860+0000 7fde82a00700 1 --2- 172.21.15.49:0/2103700455 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde840c4110 0x7fde84157de0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fde740097c0 tx=0x7fde74009060).ready entity=mon.2 client_cookie=48e5f3783e101a0f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:28.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.860+0000 7fde81600700 1 -- 172.21.15.49:0/2103700455 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0017f0 con 0x7fde840c4110 2024-01-22T05:19:28.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.860+0000 7fde81600700 1 -- 172.21.15.49:0/2103700455 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde74012410 con 0x7fde840c4110 2024-01-22T05:19:28.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.860+0000 7fde81600700 1 -- 172.21.15.49:0/2103700455 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74012790 con 0x7fde840c4110 2024-01-22T05:19:28.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.860+0000 7fde89600700 1 -- 172.21.15.49:0/2103700455 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde840c4110 msgr2=0x7fde84157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:28.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.860+0000 7fde89600700 1 --2- 172.21.15.49:0/2103700455 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde840c4110 0x7fde84157de0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fde740097c0 tx=0x7fde74009060).stop 2024-01-22T05:19:28.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.860+0000 7fde89600700 1 -- 172.21.15.49:0/2103700455 shutdown_connections 2024-01-22T05:19:28.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.860+0000 7fde89600700 1 --2- 172.21.15.49:0/2103700455 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde840c4110 0x7fde84157de0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:28.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.860+0000 7fde89600700 1 -- 172.21.15.49:0/2103700455 >> 172.21.15.49:0/2103700455 conn(0x7fde840c7800 msgr2=0x7fde840c3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:28.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.860+0000 7fde89600700 1 -- 172.21.15.49:0/2103700455 shutdown_connections 2024-01-22T05:19:28.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.860+0000 7fde89600700 1 -- 172.21.15.49:0/2103700455 wait complete. 2024-01-22T05:19:28.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.864+0000 7fde89600700 1 Processor -- start 2024-01-22T05:19:28.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.864+0000 7fde89600700 1 -- start start 2024-01-22T05:19:28.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde89600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde84062940 0x7fde8416c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:28.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde89600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde840c4110 0x7fde840a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:28.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde89600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde841582d0 0x7fde84168860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:28.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde89600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde84169800 con 0x7fde84062940 2024-01-22T05:19:28.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde89600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8416ccc0 con 0x7fde840c4110 2024-01-22T05:19:28.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde89600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde84169240 con 0x7fde841582d0 2024-01-22T05:19:28.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde82a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde84062940 0x7fde8416c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:28.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde82a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde84062940 0x7fde8416c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34682/0 (socket says 172.21.15.49:34682) 2024-01-22T05:19:28.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde82a00700 1 -- 172.21.15.49:0/3342493856 learned_addr learned my addr 172.21.15.49:0/3342493856 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:28.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde82000700 1 --2- 172.21.15.49:0/3342493856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde840c4110 0x7fde840a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:28.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde83400700 1 --2- 172.21.15.49:0/3342493856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde841582d0 0x7fde84168860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:28.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde82a00700 1 -- 172.21.15.49:0/3342493856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde841582d0 msgr2=0x7fde84168860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:28.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde82a00700 1 --2- 172.21.15.49:0/3342493856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde841582d0 0x7fde84168860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:28.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde82a00700 1 -- 172.21.15.49:0/3342493856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde840c4110 msgr2=0x7fde840a7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:28.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde82a00700 1 --2- 172.21.15.49:0/3342493856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde840c4110 0x7fde840a7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:28.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde82a00700 1 -- 172.21.15.49:0/3342493856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde740092a0 con 0x7fde84062940 2024-01-22T05:19:28.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde82000700 1 --2- 172.21.15.49:0/3342493856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde840c4110 0x7fde840a7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:28.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde82a00700 1 --2- 172.21.15.49:0/3342493856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde84062940 0x7fde8416c7d0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 rx=0x7fde74012fd0 tx=0x7fde74015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:28.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde7a000700 1 -- 172.21.15.49:0/3342493856 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74011940 con 0x7fde84062940 2024-01-22T05:19:28.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde89600700 1 -- 172.21.15.49:0/3342493856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde84169520 con 0x7fde84062940 2024-01-22T05:19:28.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde7a000700 1 -- 172.21.15.49:0/3342493856 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde74011aa0 con 0x7fde84062940 2024-01-22T05:19:28.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.868+0000 7fde7a000700 1 -- 172.21.15.49:0/3342493856 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74011e40 con 0x7fde84062940 2024-01-22T05:19:28.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.872+0000 7fde89600700 1 -- 172.21.15.49:0/3342493856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8416c2b0 con 0x7fde84062940 2024-01-22T05:19:28.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.872+0000 7fde89600700 1 -- 172.21.15.49:0/3342493856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8416be30 con 0x7fde84062940 2024-01-22T05:19:28.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.872+0000 7fde7a000700 1 -- 172.21.15.49:0/3342493856 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fde7401d600 con 0x7fde84062940 2024-01-22T05:19:28.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.876+0000 7fde7a000700 1 --2- 172.21.15.49:0/3342493856 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde5c05a510 0x7fde5c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:28.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.876+0000 7fde7a000700 1 -- 172.21.15.49:0/3342493856 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6647+0+0 (secure 0 0 0) 0x7fde74076580 con 0x7fde84062940 2024-01-22T05:19:28.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.876+0000 7fde82000700 1 --2- 172.21.15.49:0/3342493856 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde5c05a510 0x7fde5c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:28.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.876+0000 7fde82000700 1 --2- 172.21.15.49:0/3342493856 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde5c05a510 0x7fde5c05c9d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fde840ad010 tx=0x7fde6c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:28.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:28.884+0000 7fde7a000700 1 -- 172.21.15.49:0/3342493856 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fde8416be30 con 0x7fde84062940 2024-01-22T05:19:29.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.056+0000 7fde89600700 1 -- 172.21.15.49:0/3342493856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fde8416be30 con 0x7fde84062940 2024-01-22T05:19:29.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.616+0000 7fde7a000700 1 -- 172.21.15.49:0/3342493856 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v187) v1 ==== 181+0+0 (secure 0 0 0) 0x7fde8416be30 con 0x7fde84062940 2024-01-22T05:19:29.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.620+0000 7fde89600700 1 -- 172.21.15.49:0/3342493856 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde5c05a510 msgr2=0x7fde5c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:29.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.620+0000 7fde89600700 1 --2- 172.21.15.49:0/3342493856 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde5c05a510 0x7fde5c05c9d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fde840ad010 tx=0x7fde6c009040).stop 2024-01-22T05:19:29.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.620+0000 7fde89600700 1 -- 172.21.15.49:0/3342493856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde84062940 msgr2=0x7fde8416c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:29.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.620+0000 7fde89600700 1 --2- 172.21.15.49:0/3342493856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde84062940 0x7fde8416c7d0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 rx=0x7fde74012fd0 tx=0x7fde74015000).stop 2024-01-22T05:19:29.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.624+0000 7fde89600700 1 -- 172.21.15.49:0/3342493856 shutdown_connections 2024-01-22T05:19:29.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.624+0000 7fde89600700 1 --2- 172.21.15.49:0/3342493856 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde5c05a510 0x7fde5c05c9d0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:29.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.624+0000 7fde89600700 1 --2- 172.21.15.49:0/3342493856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde841582d0 0x7fde84168860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:29.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.624+0000 7fde89600700 1 --2- 172.21.15.49:0/3342493856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde840c4110 0x7fde840a7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:29.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.624+0000 7fde89600700 1 --2- 172.21.15.49:0/3342493856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde84062940 0x7fde8416c7d0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:29.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.624+0000 7fde89600700 1 -- 172.21.15.49:0/3342493856 >> 172.21.15.49:0/3342493856 conn(0x7fde840c7800 msgr2=0x7fde840c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:29.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.624+0000 7fde89600700 1 -- 172.21.15.49:0/3342493856 shutdown_connections 2024-01-22T05:19:29.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.624+0000 7fde89600700 1 -- 172.21.15.49:0/3342493856 wait complete. 2024-01-22T05:19:29.625 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:19:29.644 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:19:29.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.812+0000 7f8cfd600700 1 Processor -- start 2024-01-22T05:19:29.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.812+0000 7f8cfd600700 1 -- start start 2024-01-22T05:19:29.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.812+0000 7f8cfd600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8cf8067a90 0x7f8cf8067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:29.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.812+0000 7f8cfd600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cf8062230 0x7f8cf80626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:29.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.812+0000 7f8cfd600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf8155d30 con 0x7f8cf8152870 2024-01-22T05:19:29.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.812+0000 7f8cfd600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf80683e0 con 0x7f8cf8067a90 2024-01-22T05:19:29.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.812+0000 7f8cfd600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf8059890 con 0x7f8cf8062230 2024-01-22T05:19:29.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cf6000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8cf8067a90 0x7f8cf8067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:29.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cf6a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8cf8152870 0x7f8cf814f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60810/0 (socket says 172.21.15.49:60810) 2024-01-22T05:19:29.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cf6a00700 1 -- 172.21.15.49:0/1977586768 learned_addr learned my addr 172.21.15.49:0/1977586768 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:29.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cf7400700 1 --2- 172.21.15.49:0/1977586768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cf8062230 0x7f8cf80626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:29.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cf6000700 1 -- 172.21.15.49:0/1977586768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cf8062230 msgr2=0x7f8cf80626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:29.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cf5600700 1 -- 172.21.15.49:0/1977586768 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782123747 0 0) 0x7f8cf8155d30 con 0x7f8cf8152870 2024-01-22T05:19:29.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cf6000700 1 --2- 172.21.15.49:0/1977586768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cf8062230 0x7f8cf80626c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:29.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cf6000700 1 -- 172.21.15.49:0/1977586768 >> v1:172.21.15.49:6789/0 conn(0x7f8cf8152870 legacy=0x7f8cf814f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:29.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cf6000700 1 -- 172.21.15.49:0/1977586768 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf8152d00 con 0x7f8cf8067a90 2024-01-22T05:19:29.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cf7400700 1 --2- 172.21.15.49:0/1977586768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cf8062230 0x7f8cf80626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:29.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cf6000700 1 --2- 172.21.15.49:0/1977586768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cf8067a90 0x7f8cf8067ef0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f8ce0009760 tx=0x7f8ce0009060).ready entity=mon.1 client_cookie=dc8527b9e1d51c74 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:29.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cf5600700 1 -- 172.21.15.49:0/1977586768 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000f510 con 0x7f8cf8067a90 2024-01-22T05:19:29.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cf5600700 1 -- 172.21.15.49:0/1977586768 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce000f670 con 0x7f8cf8067a90 2024-01-22T05:19:29.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cf5600700 1 -- 172.21.15.49:0/1977586768 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000f9f0 con 0x7f8cf8067a90 2024-01-22T05:19:29.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cfd600700 1 -- 172.21.15.49:0/1977586768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cf8067a90 msgr2=0x7f8cf8067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:29.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cfd600700 1 --2- 172.21.15.49:0/1977586768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cf8067a90 0x7f8cf8067ef0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f8ce0009760 tx=0x7f8ce0009060).stop 2024-01-22T05:19:29.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cfd600700 1 -- 172.21.15.49:0/1977586768 shutdown_connections 2024-01-22T05:19:29.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cfd600700 1 --2- 172.21.15.49:0/1977586768 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cf8062230 0x7f8cf80626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:29.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cfd600700 1 --2- 172.21.15.49:0/1977586768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cf8067a90 0x7f8cf8067ef0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:29.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.816+0000 7f8cfd600700 1 -- 172.21.15.49:0/1977586768 >> 172.21.15.49:0/1977586768 conn(0x7f8cf80c3830 msgr2=0x7f8cf80c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:29.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.820+0000 7f8cfd600700 1 -- 172.21.15.49:0/1977586768 shutdown_connections 2024-01-22T05:19:29.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.820+0000 7f8cfd600700 1 -- 172.21.15.49:0/1977586768 wait complete. 2024-01-22T05:19:29.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.820+0000 7f8cfd600700 1 Processor -- start 2024-01-22T05:19:29.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.820+0000 7f8cfd600700 1 -- start start 2024-01-22T05:19:29.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cfd600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf8062230 0x7f8cf814fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:29.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cfd600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cf8067a90 0x7f8cf80a7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:29.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cfd600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cf80c3010 0x7f8cf81513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:29.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cfd600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf8150f20 con 0x7f8cf8062230 2024-01-22T05:19:29.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cfd600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf8150310 con 0x7f8cf8067a90 2024-01-22T05:19:29.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cfd600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf81505f0 con 0x7f8cf80c3010 2024-01-22T05:19:29.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cf6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf8062230 0x7f8cf814fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:29.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cf6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf8062230 0x7f8cf814fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34690/0 (socket says 172.21.15.49:34690) 2024-01-22T05:19:29.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cf6a00700 1 -- 172.21.15.49:0/1142286716 learned_addr learned my addr 172.21.15.49:0/1142286716 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:29.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cf6000700 1 --2- 172.21.15.49:0/1142286716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cf8067a90 0x7f8cf80a7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:29.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cf7400700 1 --2- 172.21.15.49:0/1142286716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cf80c3010 0x7f8cf81513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:29.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cf6a00700 1 -- 172.21.15.49:0/1142286716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cf80c3010 msgr2=0x7f8cf81513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:29.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cf6a00700 1 --2- 172.21.15.49:0/1142286716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cf80c3010 0x7f8cf81513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:29.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cf6a00700 1 -- 172.21.15.49:0/1142286716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cf8067a90 msgr2=0x7f8cf80a7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:29.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cf6a00700 1 --2- 172.21.15.49:0/1142286716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cf8067a90 0x7f8cf80a7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:29.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cf6a00700 1 -- 172.21.15.49:0/1142286716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf0009a20 con 0x7f8cf8062230 2024-01-22T05:19:29.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cf6a00700 1 --2- 172.21.15.49:0/1142286716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf8062230 0x7f8cf814fa30 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7f8ce8001eb0 tx=0x7f8ce8007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:29.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cee000700 1 -- 172.21.15.49:0/1142286716 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce800ce30 con 0x7f8cf8062230 2024-01-22T05:19:29.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cee000700 1 -- 172.21.15.49:0/1142286716 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce80072e0 con 0x7f8cf8062230 2024-01-22T05:19:29.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cfd600700 1 -- 172.21.15.49:0/1142286716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce00092a0 con 0x7f8cf8062230 2024-01-22T05:19:29.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cee000700 1 -- 172.21.15.49:0/1142286716 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8007680 con 0x7f8cf8062230 2024-01-22T05:19:29.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.824+0000 7f8cfd600700 1 -- 172.21.15.49:0/1142286716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf8150bb0 con 0x7f8cf8062230 2024-01-22T05:19:29.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.828+0000 7f8cfd600700 1 -- 172.21.15.49:0/1142286716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf8065670 con 0x7f8cf8062230 2024-01-22T05:19:29.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.828+0000 7f8cee000700 1 -- 172.21.15.49:0/1142286716 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8ce80059b0 con 0x7f8cf8062230 2024-01-22T05:19:29.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.832+0000 7f8cee000700 1 --2- 172.21.15.49:0/1142286716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8cd005a540 0x7f8cd005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:29.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.832+0000 7f8cee000700 1 -- 172.21.15.49:0/1142286716 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6122+0+0 (secure 0 0 0) 0x7f8ce8073e50 con 0x7f8cf8062230 2024-01-22T05:19:29.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.832+0000 7f8cf6000700 1 --2- 172.21.15.49:0/1142286716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8cd005a540 0x7f8cd005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:29.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.832+0000 7f8cf6000700 1 --2- 172.21.15.49:0/1142286716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8cd005a540 0x7f8cd005ca00 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f8cf80c1300 tx=0x7f8ce0017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:29.836+0000 7f8cee000700 1 -- 172.21.15.49:0/1142286716 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8ce8047630 con 0x7f8cf8062230 2024-01-22T05:19:29.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.000+0000 7f8cfd600700 1 -- 172.21.15.49:0/1142286716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8cf8155400 con 0x7f8cf8062230 2024-01-22T05:19:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.628+0000 7f8cee000700 1 -- 172.21.15.49:0/1142286716 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v188) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8ce804ac50 con 0x7f8cf8062230 2024-01-22T05:19:30.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.636+0000 7f8cfd600700 1 -- 172.21.15.49:0/1142286716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8cd005a540 msgr2=0x7f8cd005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:30.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.636+0000 7f8cfd600700 1 --2- 172.21.15.49:0/1142286716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8cd005a540 0x7f8cd005ca00 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f8cf80c1300 tx=0x7f8ce0017000).stop 2024-01-22T05:19:30.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.636+0000 7f8cfd600700 1 -- 172.21.15.49:0/1142286716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf8062230 msgr2=0x7f8cf814fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:30.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.636+0000 7f8cfd600700 1 --2- 172.21.15.49:0/1142286716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf8062230 0x7f8cf814fa30 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7f8ce8001eb0 tx=0x7f8ce8007e90).stop 2024-01-22T05:19:30.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.636+0000 7f8cfd600700 1 -- 172.21.15.49:0/1142286716 shutdown_connections 2024-01-22T05:19:30.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.636+0000 7f8cfd600700 1 --2- 172.21.15.49:0/1142286716 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8cd005a540 0x7f8cd005ca00 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:30.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.636+0000 7f8cfd600700 1 --2- 172.21.15.49:0/1142286716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cf80c3010 0x7f8cf81513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:30.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.636+0000 7f8cfd600700 1 --2- 172.21.15.49:0/1142286716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cf8067a90 0x7f8cf80a7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:30.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.636+0000 7f8cfd600700 1 --2- 172.21.15.49:0/1142286716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf8062230 0x7f8cf814fa30 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:30.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.636+0000 7f8cfd600700 1 -- 172.21.15.49:0/1142286716 >> 172.21.15.49:0/1142286716 conn(0x7f8cf80c3830 msgr2=0x7f8cf814e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:30.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.636+0000 7f8cfd600700 1 -- 172.21.15.49:0/1142286716 shutdown_connections 2024-01-22T05:19:30.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.636+0000 7f8cfd600700 1 -- 172.21.15.49:0/1142286716 wait complete. 2024-01-22T05:19:30.641 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-01-22T05:19:30.661 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-22T05:19:30.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.828+0000 7fd112400700 1 Processor -- start 2024-01-22T05:19:30.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.828+0000 7fd112400700 1 -- start start 2024-01-22T05:19:30.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd112400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd10c062900 0x7fd10c062d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:30.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd112400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10c063260 con 0x7fd10c068b30 2024-01-22T05:19:30.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd112400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10c067a90 con 0x7fd10c0bded0 2024-01-22T05:19:30.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd112400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10c0be2b0 con 0x7fd10c062900 2024-01-22T05:19:30.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd10be00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd10c068b30 0x7fd10c0c4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60826/0 (socket says 172.21.15.49:60826) 2024-01-22T05:19:30.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd10be00700 1 -- 172.21.15.49:0/1707327810 learned_addr learned my addr 172.21.15.49:0/1707327810 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:30.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd10aa00700 1 --2- 172.21.15.49:0/1707327810 >> v2:172.21.15.110:3300/0 conn(0x7fd10c062900 0x7fd10c062d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:30.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd10a000700 1 -- 172.21.15.49:0/1707327810 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487084244 0 0) 0x7fd10c063260 con 0x7fd10c068b30 2024-01-22T05:19:30.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd10a000700 1 -- 172.21.15.49:0/1707327810 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0ec0033f0 con 0x7fd10c068b30 2024-01-22T05:19:30.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd10a000700 1 -- 172.21.15.49:0/1707327810 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593836582 0 0) 0x7fd10c067a90 con 0x7fd10c0bded0 2024-01-22T05:19:30.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd10a000700 1 -- 172.21.15.49:0/1707327810 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd10c063260 con 0x7fd10c0bded0 2024-01-22T05:19:30.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd10aa00700 1 -- 172.21.15.49:0/1707327810 >> v1:172.21.15.110:6789/0 conn(0x7fd10c0bded0 legacy=0x7fd10c157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:30.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd10aa00700 1 -- 172.21.15.49:0/1707327810 >> v1:172.21.15.49:6789/0 conn(0x7fd10c068b30 legacy=0x7fd10c0c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:30.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd10aa00700 1 -- 172.21.15.49:0/1707327810 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c067d70 con 0x7fd10c062900 2024-01-22T05:19:30.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd10aa00700 1 --2- 172.21.15.49:0/1707327810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd10c062900 0x7fd10c062d70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fd0f4009760 tx=0x7fd0f4009060).ready entity=mon.1 client_cookie=680a2c5ec7a6e1c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:30.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd10a000700 1 -- 172.21.15.49:0/1707327810 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f400d4a0 con 0x7fd10c062900 2024-01-22T05:19:30.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd10a000700 1 -- 172.21.15.49:0/1707327810 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f400d600 con 0x7fd10c062900 2024-01-22T05:19:30.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.832+0000 7fd10a000700 1 -- 172.21.15.49:0/1707327810 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f400d980 con 0x7fd10c062900 2024-01-22T05:19:30.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.836+0000 7fd112400700 1 -- 172.21.15.49:0/1707327810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd10c062900 msgr2=0x7fd10c062d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:30.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.836+0000 7fd112400700 1 --2- 172.21.15.49:0/1707327810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd10c062900 0x7fd10c062d70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fd0f4009760 tx=0x7fd0f4009060).stop 2024-01-22T05:19:30.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.836+0000 7fd112400700 1 -- 172.21.15.49:0/1707327810 shutdown_connections 2024-01-22T05:19:30.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.836+0000 7fd112400700 1 --2- 172.21.15.49:0/1707327810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd10c062900 0x7fd10c062d70 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:30.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.836+0000 7fd112400700 1 -- 172.21.15.49:0/1707327810 >> 172.21.15.49:0/1707327810 conn(0x7fd10c0c8740 msgr2=0x7fd10c0c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:30.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.836+0000 7fd112400700 1 -- 172.21.15.49:0/1707327810 shutdown_connections 2024-01-22T05:19:30.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.836+0000 7fd112400700 1 -- 172.21.15.49:0/1707327810 wait complete. 2024-01-22T05:19:30.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.840+0000 7fd112400700 1 Processor -- start 2024-01-22T05:19:30.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.840+0000 7fd112400700 1 -- start start 2024-01-22T05:19:30.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.840+0000 7fd112400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd10c062900 0x7fd10c0a8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:30.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.840+0000 7fd112400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd10c068b30 0x7fd10c0a9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:30.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.840+0000 7fd112400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd10c0bded0 0x7fd10c168b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:30.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.840+0000 7fd112400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c15b300 con 0x7fd10c0bded0 2024-01-22T05:19:30.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.840+0000 7fd112400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c15b5e0 con 0x7fd10c068b30 2024-01-22T05:19:30.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.840+0000 7fd112400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c15b8c0 con 0x7fd10c062900 2024-01-22T05:19:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd10be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd10c0bded0 0x7fd10c168b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd10be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd10c0bded0 0x7fd10c168b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34696/0 (socket says 172.21.15.49:34696) 2024-01-22T05:19:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd10be00700 1 -- 172.21.15.49:0/1456752447 learned_addr learned my addr 172.21.15.49:0/1456752447 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd10b400700 1 --2- 172.21.15.49:0/1456752447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd10c062900 0x7fd10c0a8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:30.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd10aa00700 1 --2- 172.21.15.49:0/1456752447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd10c068b30 0x7fd10c0a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:30.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd10be00700 1 -- 172.21.15.49:0/1456752447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd10c062900 msgr2=0x7fd10c0a8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:30.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd10be00700 1 --2- 172.21.15.49:0/1456752447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd10c062900 0x7fd10c0a8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:30.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd10be00700 1 -- 172.21.15.49:0/1456752447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd10c068b30 msgr2=0x7fd10c0a9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:30.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd10be00700 1 --2- 172.21.15.49:0/1456752447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd10c068b30 0x7fd10c0a9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:30.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd10be00700 1 -- 172.21.15.49:0/1456752447 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f40092a0 con 0x7fd10c0bded0 2024-01-22T05:19:30.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd10be00700 1 --2- 172.21.15.49:0/1456752447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd10c0bded0 0x7fd10c168b80 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 rx=0x7fd104001560 tx=0x7fd104001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:30.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd102a00700 1 -- 172.21.15.49:0/1456752447 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104005d30 con 0x7fd10c0bded0 2024-01-22T05:19:30.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd102a00700 1 -- 172.21.15.49:0/1456752447 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd104005e90 con 0x7fd10c0bded0 2024-01-22T05:19:30.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd112400700 1 -- 172.21.15.49:0/1456752447 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10c15bba0 con 0x7fd10c0bded0 2024-01-22T05:19:30.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd102a00700 1 -- 172.21.15.49:0/1456752447 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104007340 con 0x7fd10c0bded0 2024-01-22T05:19:30.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.844+0000 7fd112400700 1 -- 172.21.15.49:0/1456752447 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c15c160 con 0x7fd10c0bded0 2024-01-22T05:19:30.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.848+0000 7fd112400700 1 -- 172.21.15.49:0/1456752447 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10c157710 con 0x7fd10c0bded0 2024-01-22T05:19:30.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.848+0000 7fd102a00700 1 -- 172.21.15.49:0/1456752447 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd1040076b0 con 0x7fd10c0bded0 2024-01-22T05:19:30.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.848+0000 7fd102a00700 1 --2- 172.21.15.49:0/1456752447 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd0e405a510 0x7fd0e405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:30.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.848+0000 7fd102a00700 1 -- 172.21.15.49:0/1456752447 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fd104074620 con 0x7fd10c0bded0 2024-01-22T05:19:30.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.852+0000 7fd10b400700 1 --2- 172.21.15.49:0/1456752447 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd0e405a510 0x7fd0e405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:30.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.852+0000 7fd10b400700 1 --2- 172.21.15.49:0/1456752447 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd0e405a510 0x7fd0e405c9d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fd0fc003890 tx=0x7fd0fc007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:30.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:30.856+0000 7fd102a00700 1 -- 172.21.15.49:0/1456752447 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd10c157710 con 0x7fd10c0bded0 2024-01-22T05:19:31.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.020+0000 7fd112400700 1 -- 172.21.15.49:0/1456752447 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd10c157710 con 0x7fd10c0bded0 2024-01-22T05:19:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.028+0000 7fd102a00700 1 -- 172.21.15.49:0/1456752447 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd10c157710 con 0x7fd10c0bded0 2024-01-22T05:19:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.032+0000 7fd112400700 1 -- 172.21.15.49:0/1456752447 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd0e405a510 msgr2=0x7fd0e405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.032+0000 7fd112400700 1 --2- 172.21.15.49:0/1456752447 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd0e405a510 0x7fd0e405c9d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fd0fc003890 tx=0x7fd0fc007bd0).stop 2024-01-22T05:19:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.032+0000 7fd112400700 1 -- 172.21.15.49:0/1456752447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd10c0bded0 msgr2=0x7fd10c168b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.032+0000 7fd112400700 1 --2- 172.21.15.49:0/1456752447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd10c0bded0 0x7fd10c168b80 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 rx=0x7fd104001560 tx=0x7fd104001650).stop 2024-01-22T05:19:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.032+0000 7fd112400700 1 -- 172.21.15.49:0/1456752447 shutdown_connections 2024-01-22T05:19:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.032+0000 7fd112400700 1 --2- 172.21.15.49:0/1456752447 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd0e405a510 0x7fd0e405c9d0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.032+0000 7fd112400700 1 --2- 172.21.15.49:0/1456752447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd10c0bded0 0x7fd10c168b80 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.032+0000 7fd112400700 1 --2- 172.21.15.49:0/1456752447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd10c068b30 0x7fd10c0a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.032+0000 7fd112400700 1 --2- 172.21.15.49:0/1456752447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd10c062900 0x7fd10c0a8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.032+0000 7fd112400700 1 -- 172.21.15.49:0/1456752447 >> 172.21.15.49:0/1456752447 conn(0x7fd10c0c8740 msgr2=0x7fd10c157000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.032+0000 7fd112400700 1 -- 172.21.15.49:0/1456752447 shutdown_connections 2024-01-22T05:19:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.032+0000 7fd112400700 1 -- 172.21.15.49:0/1456752447 wait complete. 2024-01-22T05:19:31.053 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files' 2024-01-22T05:19:31.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.216+0000 7f90a7e00700 1 Processor -- start 2024-01-22T05:19:31.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.216+0000 7f90a7e00700 1 -- start start 2024-01-22T05:19:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a7e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f90a00c5150 0x7f90a01554b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a7e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90a01559a0 0x7f90a0065d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a7e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a00c5530 con 0x7f90a0066250 2024-01-22T05:19:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a7e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a00675a0 con 0x7f90a00c5150 2024-01-22T05:19:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a7e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0066a20 con 0x7f90a01559a0 2024-01-22T05:19:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a5400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f90a00c5150 0x7f90a01554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a5400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f90a00c5150 0x7f90a01554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34704/0 (socket says 172.21.15.49:34704) 2024-01-22T05:19:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a5400700 1 -- 172.21.15.49:0/3722811778 learned_addr learned my addr 172.21.15.49:0/3722811778 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a4a00700 1 --2- 172.21.15.49:0/3722811778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90a01559a0 0x7f90a0065d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a5400700 1 -- 172.21.15.49:0/3722811778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90a01559a0 msgr2=0x7f90a0065d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a5400700 1 --2- 172.21.15.49:0/3722811778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90a01559a0 0x7f90a0065d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a5400700 1 -- 172.21.15.49:0/3722811778 >> v1:172.21.15.110:6789/0 conn(0x7f90a0066250 legacy=0x7f90a00a8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a5400700 1 -- 172.21.15.49:0/3722811778 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a0066d00 con 0x7f90a00c5150 2024-01-22T05:19:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a5400700 1 --2- 172.21.15.49:0/3722811778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90a00c5150 0x7f90a01554b0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7f9090009830 tx=0x7f90900090f0).ready entity=mon.0 client_cookie=5170478b7f126af5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f909fe00700 1 -- 172.21.15.49:0/3722811778 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909000b600 con 0x7f90a00c5150 2024-01-22T05:19:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f909fe00700 1 -- 172.21.15.49:0/3722811778 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909000b760 con 0x7f90a00c5150 2024-01-22T05:19:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f909fe00700 1 -- 172.21.15.49:0/3722811778 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909000bae0 con 0x7f90a00c5150 2024-01-22T05:19:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a7e00700 1 -- 172.21.15.49:0/3722811778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90a00c5150 msgr2=0x7f90a01554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a7e00700 1 --2- 172.21.15.49:0/3722811778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90a00c5150 0x7f90a01554b0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7f9090009830 tx=0x7f90900090f0).stop 2024-01-22T05:19:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a7e00700 1 -- 172.21.15.49:0/3722811778 shutdown_connections 2024-01-22T05:19:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a7e00700 1 --2- 172.21.15.49:0/3722811778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90a01559a0 0x7f90a0065d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a7e00700 1 --2- 172.21.15.49:0/3722811778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90a00c5150 0x7f90a01554b0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.220+0000 7f90a7e00700 1 -- 172.21.15.49:0/3722811778 >> 172.21.15.49:0/3722811778 conn(0x7f90a0062cd0 msgr2=0x7f90a00c6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:31.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.224+0000 7f90a7e00700 1 -- 172.21.15.49:0/3722811778 shutdown_connections 2024-01-22T05:19:31.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.224+0000 7f90a7e00700 1 -- 172.21.15.49:0/3722811778 wait complete. 2024-01-22T05:19:31.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.224+0000 7f90a7e00700 1 Processor -- start 2024-01-22T05:19:31.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.224+0000 7f90a7e00700 1 -- start start 2024-01-22T05:19:31.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.224+0000 7f90a7e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90a0066250 0x7f90a00ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:31.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.224+0000 7f90a7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90a00c5150 0x7f90a016c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:31.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.224+0000 7f90a7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90a01559a0 0x7f90a00aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:31.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.224+0000 7f90a7e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00abc70 con 0x7f90a01559a0 2024-01-22T05:19:31.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.224+0000 7f90a7e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00ab0d0 con 0x7f90a00c5150 2024-01-22T05:19:31.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.224+0000 7f90a7e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00aad60 con 0x7f90a0066250 2024-01-22T05:19:31.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f90a5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90a01559a0 0x7f90a00aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f90a5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90a01559a0 0x7f90a00aa870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34708/0 (socket says 172.21.15.49:34708) 2024-01-22T05:19:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f90a5e00700 1 -- 172.21.15.49:0/1402467194 learned_addr learned my addr 172.21.15.49:0/1402467194 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f90a5400700 1 --2- 172.21.15.49:0/1402467194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90a0066250 0x7f90a00ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f90a4a00700 1 --2- 172.21.15.49:0/1402467194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90a00c5150 0x7f90a016c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f90a5e00700 1 -- 172.21.15.49:0/1402467194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90a0066250 msgr2=0x7f90a00ac100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f90a5e00700 1 --2- 172.21.15.49:0/1402467194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90a0066250 0x7f90a00ac100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f90a5e00700 1 -- 172.21.15.49:0/1402467194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90a00c5150 msgr2=0x7f90a016c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f90a5e00700 1 --2- 172.21.15.49:0/1402467194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90a00c5150 0x7f90a016c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f90a5e00700 1 -- 172.21.15.49:0/1402467194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9090009370 con 0x7f90a01559a0 2024-01-22T05:19:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f90a5e00700 1 --2- 172.21.15.49:0/1402467194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90a01559a0 0x7f90a00aa870 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7f909800c7c0 tx=0x7f90980015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f909cc00700 1 -- 172.21.15.49:0/1402467194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9098010510 con 0x7f90a01559a0 2024-01-22T05:19:31.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f909cc00700 1 -- 172.21.15.49:0/1402467194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9098010670 con 0x7f90a01559a0 2024-01-22T05:19:31.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f909cc00700 1 -- 172.21.15.49:0/1402467194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90980109f0 con 0x7f90a01559a0 2024-01-22T05:19:31.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f90a7e00700 1 -- 172.21.15.49:0/1402467194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a00ab340 con 0x7f90a01559a0 2024-01-22T05:19:31.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f90a7e00700 1 -- 172.21.15.49:0/1402467194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a00ab900 con 0x7f90a01559a0 2024-01-22T05:19:31.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f90a7e00700 1 -- 172.21.15.49:0/1402467194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a00abe20 con 0x7f90a01559a0 2024-01-22T05:19:31.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.228+0000 7f909cc00700 1 -- 172.21.15.49:0/1402467194 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f909801b400 con 0x7f90a01559a0 2024-01-22T05:19:31.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.232+0000 7f909cc00700 1 --2- 172.21.15.49:0/1402467194 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f907805a510 0x7f907805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:31.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.232+0000 7f909cc00700 1 -- 172.21.15.49:0/1402467194 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f90980742c0 con 0x7f90a01559a0 2024-01-22T05:19:31.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.232+0000 7f90a5400700 1 --2- 172.21.15.49:0/1402467194 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f907805a510 0x7f907805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:31.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.232+0000 7f90a5400700 1 --2- 172.21.15.49:0/1402467194 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f907805a510 0x7f907805c9d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f9090009130 tx=0x7f9090017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:31.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.236+0000 7f909cc00700 1 -- 172.21.15.49:0/1402467194 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9098047be0 con 0x7f90a01559a0 2024-01-22T05:19:31.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.452+0000 7f90a7e00700 1 -- 172.21.15.49:0/1402467194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]} v 0) v1 -- 0x7f90a0047060 con 0x7f90a01559a0 2024-01-22T05:19:31.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.636+0000 7f909cc00700 1 -- 172.21.15.49:0/1402467194 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]}]=0 v698) v1 ==== 147+0+0 (secure 0 0 0) 0x7f909804b200 con 0x7f90a01559a0 2024-01-22T05:19:31.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.640+0000 7f90a7e00700 1 -- 172.21.15.49:0/1402467194 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f907805a510 msgr2=0x7f907805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:31.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.640+0000 7f90a7e00700 1 --2- 172.21.15.49:0/1402467194 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f907805a510 0x7f907805c9d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f9090009130 tx=0x7f9090017000).stop 2024-01-22T05:19:31.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.640+0000 7f90a7e00700 1 -- 172.21.15.49:0/1402467194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90a01559a0 msgr2=0x7f90a00aa870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:31.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.640+0000 7f90a7e00700 1 --2- 172.21.15.49:0/1402467194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90a01559a0 0x7f90a00aa870 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7f909800c7c0 tx=0x7f90980015e0).stop 2024-01-22T05:19:31.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.640+0000 7f90a7e00700 1 -- 172.21.15.49:0/1402467194 shutdown_connections 2024-01-22T05:19:31.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.640+0000 7f90a7e00700 1 --2- 172.21.15.49:0/1402467194 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f907805a510 0x7f907805c9d0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.640+0000 7f90a7e00700 1 --2- 172.21.15.49:0/1402467194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90a01559a0 0x7f90a00aa870 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.640+0000 7f90a7e00700 1 --2- 172.21.15.49:0/1402467194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90a00c5150 0x7f90a016c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.640+0000 7f90a7e00700 1 --2- 172.21.15.49:0/1402467194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90a0066250 0x7f90a00ac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.640+0000 7f90a7e00700 1 -- 172.21.15.49:0/1402467194 >> 172.21.15.49:0/1402467194 conn(0x7f90a0062cd0 msgr2=0x7f90a00c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:31.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.640+0000 7f90a7e00700 1 -- 172.21.15.49:0/1402467194 shutdown_connections 2024-01-22T05:19:31.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.640+0000 7f90a7e00700 1 -- 172.21.15.49:0/1402467194 wait complete. 2024-01-22T05:19:31.667 INFO:tasks.cephfs_test_runner:test_scrub_backtrace_for_new_files (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-01-22T05:19:31.667 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_dup_inode (tasks.cephfs.test_scrub.TestScrub) 2024-01-22T05:19:31.668 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode' 2024-01-22T05:19:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.836+0000 7fcc62800700 1 Processor -- start 2024-01-22T05:19:31.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.836+0000 7fcc62800700 1 -- start start 2024-01-22T05:19:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc62800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcc5c0a8740 0x7fcc5c0a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc62800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc5c0c1ed0 0x7fcc5c0c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc62800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c0c1a40 con 0x7fcc5c155d20 2024-01-22T05:19:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc62800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5c0a90b0 con 0x7fcc5c0c1ed0 2024-01-22T05:19:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc62800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5c159310 con 0x7fcc5c0a8740 2024-01-22T05:19:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc5be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc5c0c1ed0 0x7fcc5c0c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc5be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc5c0c1ed0 0x7fcc5c0c2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34712/0 (socket says 172.21.15.49:34712) 2024-01-22T05:19:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc5be00700 1 -- 172.21.15.49:0/2890077847 learned_addr learned my addr 172.21.15.49:0/2890077847 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc5aa00700 1 --2- 172.21.15.49:0/2890077847 >> v2:172.21.15.110:3300/0 conn(0x7fcc5c0a8740 0x7fcc5c0a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc5be00700 1 -- 172.21.15.49:0/2890077847 >> v2:172.21.15.110:3300/0 conn(0x7fcc5c0a8740 msgr2=0x7fcc5c0a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc5be00700 1 --2- 172.21.15.49:0/2890077847 >> v2:172.21.15.110:3300/0 conn(0x7fcc5c0a8740 0x7fcc5c0a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc5be00700 1 -- 172.21.15.49:0/2890077847 >> v1:172.21.15.110:6789/0 conn(0x7fcc5c155d20 legacy=0x7fcc5c065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc5be00700 1 -- 172.21.15.49:0/2890077847 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c0c13f0 con 0x7fcc5c0c1ed0 2024-01-22T05:19:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc5be00700 1 --2- 172.21.15.49:0/2890077847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc5c0c1ed0 0x7fcc5c0c2360 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7fcc5c0c0ad0 tx=0x7fcc54009840).ready entity=mon.0 client_cookie=3d9c6e23db9504e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc5a000700 1 -- 172.21.15.49:0/2890077847 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400e070 con 0x7fcc5c0c1ed0 2024-01-22T05:19:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc5a000700 1 -- 172.21.15.49:0/2890077847 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5400ba50 con 0x7fcc5c0c1ed0 2024-01-22T05:19:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.840+0000 7fcc5a000700 1 -- 172.21.15.49:0/2890077847 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400bdd0 con 0x7fcc5c0c1ed0 2024-01-22T05:19:31.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.844+0000 7fcc62800700 1 -- 172.21.15.49:0/2890077847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc5c0c1ed0 msgr2=0x7fcc5c0c2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:31.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.844+0000 7fcc62800700 1 --2- 172.21.15.49:0/2890077847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc5c0c1ed0 0x7fcc5c0c2360 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7fcc5c0c0ad0 tx=0x7fcc54009840).stop 2024-01-22T05:19:31.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.844+0000 7fcc62800700 1 -- 172.21.15.49:0/2890077847 shutdown_connections 2024-01-22T05:19:31.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.844+0000 7fcc62800700 1 --2- 172.21.15.49:0/2890077847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc5c0c1ed0 0x7fcc5c0c2360 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.844+0000 7fcc62800700 1 --2- 172.21.15.49:0/2890077847 >> v2:172.21.15.110:3300/0 conn(0x7fcc5c0a8740 0x7fcc5c0a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.844+0000 7fcc62800700 1 -- 172.21.15.49:0/2890077847 >> 172.21.15.49:0/2890077847 conn(0x7fcc5c0c6540 msgr2=0x7fcc5c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:31.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.844+0000 7fcc62800700 1 -- 172.21.15.49:0/2890077847 shutdown_connections 2024-01-22T05:19:31.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.844+0000 7fcc62800700 1 -- 172.21.15.49:0/2890077847 wait complete. 2024-01-22T05:19:31.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.844+0000 7fcc62800700 1 Processor -- start 2024-01-22T05:19:31.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc62800700 1 -- start start 2024-01-22T05:19:31.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc62800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc5c0a8740 0x7fcc5c1680a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:31.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc62800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc5c0c1ed0 0x7fcc5c169120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:31.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc62800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc5c155d20 0x7fcc5c0a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:31.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc62800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0abb20 con 0x7fcc5c0a8740 2024-01-22T05:19:31.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc62800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c168590 con 0x7fcc5c0c1ed0 2024-01-22T05:19:31.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc62800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c169610 con 0x7fcc5c155d20 2024-01-22T05:19:31.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc5b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc5c0a8740 0x7fcc5c1680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:31.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc5b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc5c0a8740 0x7fcc5c1680a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34716/0 (socket says 172.21.15.49:34716) 2024-01-22T05:19:31.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc5b400700 1 -- 172.21.15.49:0/1420512738 learned_addr learned my addr 172.21.15.49:0/1420512738 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:31.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc5be00700 1 --2- 172.21.15.49:0/1420512738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc5c155d20 0x7fcc5c0a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:31.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc5aa00700 1 --2- 172.21.15.49:0/1420512738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc5c0c1ed0 0x7fcc5c169120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:31.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc5b400700 1 -- 172.21.15.49:0/1420512738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc5c155d20 msgr2=0x7fcc5c0a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:31.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc5b400700 1 --2- 172.21.15.49:0/1420512738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc5c155d20 0x7fcc5c0a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc5b400700 1 -- 172.21.15.49:0/1420512738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc5c0c1ed0 msgr2=0x7fcc5c169120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:31.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc5b400700 1 --2- 172.21.15.49:0/1420512738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc5c0c1ed0 0x7fcc5c169120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:31.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc5b400700 1 -- 172.21.15.49:0/1420512738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc54009ae0 con 0x7fcc5c0a8740 2024-01-22T05:19:31.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.848+0000 7fcc5b400700 1 --2- 172.21.15.49:0/1420512738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc5c0a8740 0x7fcc5c1680a0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 rx=0x7fcc4c00c440 tx=0x7fcc4c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:31.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.852+0000 7fcc52a00700 1 -- 172.21.15.49:0/1420512738 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c007020 con 0x7fcc5c0a8740 2024-01-22T05:19:31.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.852+0000 7fcc52a00700 1 -- 172.21.15.49:0/1420512738 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c007180 con 0x7fcc5c0a8740 2024-01-22T05:19:31.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.852+0000 7fcc62800700 1 -- 172.21.15.49:0/1420512738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5c0aaf10 con 0x7fcc5c0a8740 2024-01-22T05:19:31.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.852+0000 7fcc52a00700 1 -- 172.21.15.49:0/1420512738 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c007540 con 0x7fcc5c0a8740 2024-01-22T05:19:31.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.852+0000 7fcc62800700 1 -- 172.21.15.49:0/1420512738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5c0ab4d0 con 0x7fcc5c0a8740 2024-01-22T05:19:31.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.852+0000 7fcc62800700 1 -- 172.21.15.49:0/1420512738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5c047060 con 0x7fcc5c0a8740 2024-01-22T05:19:31.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.856+0000 7fcc52a00700 1 -- 172.21.15.49:0/1420512738 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcc4c0068b0 con 0x7fcc5c0a8740 2024-01-22T05:19:31.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.856+0000 7fcc52a00700 1 --2- 172.21.15.49:0/1420512738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc3405a510 0x7fcc3405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:31.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.856+0000 7fcc52a00700 1 -- 172.21.15.49:0/1420512738 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fcc4c073870 con 0x7fcc5c0a8740 2024-01-22T05:19:31.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.856+0000 7fcc5aa00700 1 --2- 172.21.15.49:0/1420512738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc3405a510 0x7fcc3405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:31.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.856+0000 7fcc5aa00700 1 --2- 172.21.15.49:0/1420512738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc3405a510 0x7fcc3405c9d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fcc5c0aa590 tx=0x7fcc44008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:31.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:31.860+0000 7fcc52a00700 1 -- 172.21.15.49:0/1420512738 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcc4c047130 con 0x7fcc5c0a8740 2024-01-22T05:19:32.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.076+0000 7fcc62800700 1 -- 172.21.15.49:0/1420512738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]} v 0) v1 -- 0x7fcc5c0c16d0 con 0x7fcc5c0a8740 2024-01-22T05:19:32.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.640+0000 7fcc52a00700 1 -- 172.21.15.49:0/1420512738 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]}]=0 v699) v1 ==== 136+0+0 (secure 0 0 0) 0x7fcc4c04a750 con 0x7fcc5c0a8740 2024-01-22T05:19:32.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.644+0000 7fcc62800700 1 -- 172.21.15.49:0/1420512738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc3405a510 msgr2=0x7fcc3405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:32.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.644+0000 7fcc62800700 1 --2- 172.21.15.49:0/1420512738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc3405a510 0x7fcc3405c9d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fcc5c0aa590 tx=0x7fcc44008040).stop 2024-01-22T05:19:32.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.644+0000 7fcc62800700 1 -- 172.21.15.49:0/1420512738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc5c0a8740 msgr2=0x7fcc5c1680a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:32.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.644+0000 7fcc62800700 1 --2- 172.21.15.49:0/1420512738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc5c0a8740 0x7fcc5c1680a0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 rx=0x7fcc4c00c440 tx=0x7fcc4c007e00).stop 2024-01-22T05:19:32.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.644+0000 7fcc62800700 1 -- 172.21.15.49:0/1420512738 shutdown_connections 2024-01-22T05:19:32.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.644+0000 7fcc62800700 1 --2- 172.21.15.49:0/1420512738 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcc3405a510 0x7fcc3405c9d0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:32.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.644+0000 7fcc62800700 1 --2- 172.21.15.49:0/1420512738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc5c155d20 0x7fcc5c0a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:32.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.644+0000 7fcc62800700 1 --2- 172.21.15.49:0/1420512738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc5c0c1ed0 0x7fcc5c169120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:32.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.644+0000 7fcc62800700 1 --2- 172.21.15.49:0/1420512738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc5c0a8740 0x7fcc5c1680a0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:32.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.644+0000 7fcc62800700 1 -- 172.21.15.49:0/1420512738 >> 172.21.15.49:0/1420512738 conn(0x7fcc5c0c6540 msgr2=0x7fcc5c1583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:32.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.644+0000 7fcc62800700 1 -- 172.21.15.49:0/1420512738 shutdown_connections 2024-01-22T05:19:32.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.644+0000 7fcc62800700 1 -- 172.21.15.49:0/1420512738 wait complete. 2024-01-22T05:19:32.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-22T05:19:32.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.844+0000 7f8e1e400700 1 Processor -- start 2024-01-22T05:19:32.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.848+0000 7f8e1e400700 1 -- start start 2024-01-22T05:19:32.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e1e400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e180c7160 0x7f8e18068c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:32.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e1e400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8e180c38c0 0x7f8e18063840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:32.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e1e400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e180c7540 con 0x7f8e18069130 2024-01-22T05:19:32.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e1e400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e18067ba0 con 0x7f8e180c38c0 2024-01-22T05:19:32.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e1e400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e18067e80 con 0x7f8e180c7160 2024-01-22T05:19:32.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e17e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8e180c38c0 0x7f8e18063840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:32.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e16a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8e18069130 0x7f8e180c31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60842/0 (socket says 172.21.15.49:60842) 2024-01-22T05:19:32.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e16a00700 1 -- 172.21.15.49:0/565419972 learned_addr learned my addr 172.21.15.49:0/565419972 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:32.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e17400700 1 --2- 172.21.15.49:0/565419972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e180c7160 0x7f8e18068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:32.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e16000700 1 -- 172.21.15.49:0/565419972 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697603943 0 0) 0x7f8e00001110 con 0x7f8e18069130 2024-01-22T05:19:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e16000700 1 -- 172.21.15.49:0/565419972 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8df80033f0 con 0x7f8e18069130 2024-01-22T05:19:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e17e00700 1 -- 172.21.15.49:0/565419972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e180c7160 msgr2=0x7f8e18068c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e17e00700 1 --2- 172.21.15.49:0/565419972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e180c7160 0x7f8e18068c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e17e00700 1 -- 172.21.15.49:0/565419972 >> v1:172.21.15.49:6789/0 conn(0x7f8e18069130 legacy=0x7f8e180c31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e17e00700 1 -- 172.21.15.49:0/565419972 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e18068160 con 0x7f8e180c38c0 2024-01-22T05:19:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e17e00700 1 --2- 172.21.15.49:0/565419972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e180c38c0 0x7f8e18063840 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7f8e10009e60 tx=0x7f8e10009780).ready entity=mon.0 client_cookie=34b732c67bf0fa40 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:32.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e16000700 1 -- 172.21.15.49:0/565419972 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1000e070 con 0x7f8e180c38c0 2024-01-22T05:19:32.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e16000700 1 -- 172.21.15.49:0/565419972 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1000bab0 con 0x7f8e180c38c0 2024-01-22T05:19:32.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.852+0000 7f8e16000700 1 -- 172.21.15.49:0/565419972 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1000be30 con 0x7f8e180c38c0 2024-01-22T05:19:32.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.856+0000 7f8e1e400700 1 -- 172.21.15.49:0/565419972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e180c38c0 msgr2=0x7f8e18063840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:32.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.856+0000 7f8e1e400700 1 --2- 172.21.15.49:0/565419972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e180c38c0 0x7f8e18063840 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7f8e10009e60 tx=0x7f8e10009780).stop 2024-01-22T05:19:32.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.856+0000 7f8e1e400700 1 -- 172.21.15.49:0/565419972 shutdown_connections 2024-01-22T05:19:32.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.856+0000 7f8e1e400700 1 --2- 172.21.15.49:0/565419972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e180c38c0 0x7f8e18063840 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:32.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.856+0000 7f8e1e400700 1 --2- 172.21.15.49:0/565419972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e180c7160 0x7f8e18068c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:32.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.856+0000 7f8e1e400700 1 -- 172.21.15.49:0/565419972 >> 172.21.15.49:0/565419972 conn(0x7f8e18064f10 msgr2=0x7f8e180c8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:32.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.856+0000 7f8e1e400700 1 -- 172.21.15.49:0/565419972 shutdown_connections 2024-01-22T05:19:32.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.856+0000 7f8e1e400700 1 -- 172.21.15.49:0/565419972 wait complete. 2024-01-22T05:19:32.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.856+0000 7f8e1e400700 1 Processor -- start 2024-01-22T05:19:32.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e1e400700 1 -- start start 2024-01-22T05:19:32.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e1e400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e18069130 0x7f8e180ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:32.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e1e400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e180c38c0 0x7f8e180c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:32.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e1e400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e180c7160 0x7f8e1814f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:32.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e1e400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180a8d30 con 0x7f8e180c38c0 2024-01-22T05:19:32.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e1e400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180a8120 con 0x7f8e180c7160 2024-01-22T05:19:32.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e1e400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180a8400 con 0x7f8e18069130 2024-01-22T05:19:32.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e16a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e180c38c0 0x7f8e180c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:32.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e16a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e180c38c0 0x7f8e180c1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34730/0 (socket says 172.21.15.49:34730) 2024-01-22T05:19:32.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e16a00700 1 -- 172.21.15.49:0/2782489156 learned_addr learned my addr 172.21.15.49:0/2782489156 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:32.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e17400700 1 --2- 172.21.15.49:0/2782489156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e18069130 0x7f8e180ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:32.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e17e00700 1 --2- 172.21.15.49:0/2782489156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e180c7160 0x7f8e1814f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:32.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e16a00700 1 -- 172.21.15.49:0/2782489156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e18069130 msgr2=0x7f8e180ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:32.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e16a00700 1 --2- 172.21.15.49:0/2782489156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e18069130 0x7f8e180ac650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:32.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e16a00700 1 -- 172.21.15.49:0/2782489156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e180c7160 msgr2=0x7f8e1814f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:32.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e16a00700 1 --2- 172.21.15.49:0/2782489156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e180c7160 0x7f8e1814f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:32.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e16a00700 1 -- 172.21.15.49:0/2782489156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e10009a20 con 0x7f8e180c38c0 2024-01-22T05:19:32.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e16a00700 1 --2- 172.21.15.49:0/2782489156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e180c38c0 0x7f8e180c1f00 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7f8e0000c410 tx=0x7f8e00007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:32.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.860+0000 7f8e0ea00700 1 -- 172.21.15.49:0/2782489156 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000ce30 con 0x7f8e180c38c0 2024-01-22T05:19:32.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.864+0000 7f8e0ea00700 1 -- 172.21.15.49:0/2782489156 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e000072e0 con 0x7f8e180c38c0 2024-01-22T05:19:32.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.864+0000 7f8e0ea00700 1 -- 172.21.15.49:0/2782489156 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e000057a0 con 0x7f8e180c38c0 2024-01-22T05:19:32.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.864+0000 7f8e1e400700 1 -- 172.21.15.49:0/2782489156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e180a86e0 con 0x7f8e180c38c0 2024-01-22T05:19:32.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.864+0000 7f8e1e400700 1 -- 172.21.15.49:0/2782489156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e180a91c0 con 0x7f8e180c38c0 2024-01-22T05:19:32.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.864+0000 7f8e1e400700 1 -- 172.21.15.49:0/2782489156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e180a8ea0 con 0x7f8e180c38c0 2024-01-22T05:19:32.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.864+0000 7f8e0ea00700 1 -- 172.21.15.49:0/2782489156 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8e00005b90 con 0x7f8e180c38c0 2024-01-22T05:19:32.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.864+0000 7f8e0ea00700 1 --2- 172.21.15.49:0/2782489156 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8df005a510 0x7f8df005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:32.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.868+0000 7f8e0ea00700 1 -- 172.21.15.49:0/2782489156 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5708+0+0 (secure 0 0 0) 0x7f8e00073b60 con 0x7f8e180c38c0 2024-01-22T05:19:32.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.868+0000 7f8e17400700 1 --2- 172.21.15.49:0/2782489156 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8df005a510 0x7f8df005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:32.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.868+0000 7f8e17400700 1 --2- 172.21.15.49:0/2782489156 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8df005a510 0x7f8df005c9d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f8e18068a40 tx=0x7f8e08009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:32.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:32.872+0000 7f8e0ea00700 1 -- 172.21.15.49:0/2782489156 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8e000474e0 con 0x7f8e180c38c0 2024-01-22T05:19:33.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.036+0000 7f8e1e400700 1 -- 172.21.15.49:0/2782489156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8e180c7540 con 0x7f8e180c38c0 2024-01-22T05:19:33.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.040+0000 7f8e0ea00700 1 -- 172.21.15.49:0/2782489156 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8e180c7540 con 0x7f8e180c38c0 2024-01-22T05:19:33.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.044+0000 7f8e1e400700 1 -- 172.21.15.49:0/2782489156 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8df005a510 msgr2=0x7f8df005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:33.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.044+0000 7f8e1e400700 1 --2- 172.21.15.49:0/2782489156 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8df005a510 0x7f8df005c9d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f8e18068a40 tx=0x7f8e08009060).stop 2024-01-22T05:19:33.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.044+0000 7f8e1e400700 1 -- 172.21.15.49:0/2782489156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e180c38c0 msgr2=0x7f8e180c1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:33.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.044+0000 7f8e1e400700 1 --2- 172.21.15.49:0/2782489156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e180c38c0 0x7f8e180c1f00 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7f8e0000c410 tx=0x7f8e00007ad0).stop 2024-01-22T05:19:33.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.044+0000 7f8e1e400700 1 -- 172.21.15.49:0/2782489156 shutdown_connections 2024-01-22T05:19:33.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.044+0000 7f8e1e400700 1 --2- 172.21.15.49:0/2782489156 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f8df005a510 0x7f8df005c9d0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.044+0000 7f8e1e400700 1 --2- 172.21.15.49:0/2782489156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e180c7160 0x7f8e1814f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.044+0000 7f8e1e400700 1 --2- 172.21.15.49:0/2782489156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e180c38c0 0x7f8e180c1f00 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.044+0000 7f8e1e400700 1 --2- 172.21.15.49:0/2782489156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e18069130 0x7f8e180ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.044+0000 7f8e1e400700 1 -- 172.21.15.49:0/2782489156 >> 172.21.15.49:0/2782489156 conn(0x7f8e18064f10 msgr2=0x7f8e180bded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:33.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.044+0000 7f8e1e400700 1 -- 172.21.15.49:0/2782489156 shutdown_connections 2024-01-22T05:19:33.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.044+0000 7f8e1e400700 1 -- 172.21.15.49:0/2782489156 wait complete. 2024-01-22T05:19:33.066 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:19:33.066 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:19:33.108 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:19:33.153 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:19:33.153 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-22T05:19:33.153 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:19:33.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.316+0000 7fd633200700 1 Processor -- start 2024-01-22T05:19:33.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.316+0000 7fd633200700 1 -- start start 2024-01-22T05:19:33.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.320+0000 7fd633200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd62c0c4d60 0x7fd62c0681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:33.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.320+0000 7fd633200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd62c068690 0x7fd62c15b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:33.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.320+0000 7fd633200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62c0c38c0 con 0x7fd62c0be070 2024-01-22T05:19:33.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.320+0000 7fd633200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c0be450 con 0x7fd62c068690 2024-01-22T05:19:33.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.320+0000 7fd633200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0a8880 con 0x7fd62c0c4d60 2024-01-22T05:19:33.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.320+0000 7fd631200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd62c068690 0x7fd62c15b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:33.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.320+0000 7fd62b400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd62c0c4d60 0x7fd62c0681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:33.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd631200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd62c068690 0x7fd62c15b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:54156/0 (socket says 172.21.15.49:54156) 2024-01-22T05:19:33.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd631200700 1 -- 172.21.15.49:0/1561031459 learned_addr learned my addr 172.21.15.49:0/1561031459 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:33.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd631200700 1 -- 172.21.15.49:0/1561031459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd62c0c4d60 msgr2=0x7fd62c0681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:33.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd631200700 1 --2- 172.21.15.49:0/1561031459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd62c0c4d60 0x7fd62c0681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd631200700 1 -- 172.21.15.49:0/1561031459 >> v1:172.21.15.110:6789/0 conn(0x7fd62c0be070 legacy=0x7fd62c067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:33.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd631200700 1 -- 172.21.15.49:0/1561031459 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c0be650 con 0x7fd62c068690 2024-01-22T05:19:33.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd62b400700 1 --2- 172.21.15.49:0/1561031459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd62c0c4d60 0x7fd62c0681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:33.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd631200700 1 --2- 172.21.15.49:0/1561031459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd62c068690 0x7fd62c15b830 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fd624009f20 tx=0x7fd624009840).ready entity=mon.1 client_cookie=4a37bde27a491db3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:33.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd62aa00700 1 -- 172.21.15.49:0/1561031459 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400e070 con 0x7fd62c068690 2024-01-22T05:19:33.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd62aa00700 1 -- 172.21.15.49:0/1561031459 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62400b9d0 con 0x7fd62c068690 2024-01-22T05:19:33.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd62aa00700 1 -- 172.21.15.49:0/1561031459 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400bd50 con 0x7fd62c068690 2024-01-22T05:19:33.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd633200700 1 -- 172.21.15.49:0/1561031459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd62c068690 msgr2=0x7fd62c15b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:33.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd633200700 1 --2- 172.21.15.49:0/1561031459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd62c068690 0x7fd62c15b830 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fd624009f20 tx=0x7fd624009840).stop 2024-01-22T05:19:33.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd633200700 1 -- 172.21.15.49:0/1561031459 shutdown_connections 2024-01-22T05:19:33.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd633200700 1 --2- 172.21.15.49:0/1561031459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd62c068690 0x7fd62c15b830 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd633200700 1 --2- 172.21.15.49:0/1561031459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd62c0c4d60 0x7fd62c0681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.324+0000 7fd633200700 1 -- 172.21.15.49:0/1561031459 >> 172.21.15.49:0/1561031459 conn(0x7fd62c0c8730 msgr2=0x7fd62c0c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:33.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.328+0000 7fd633200700 1 -- 172.21.15.49:0/1561031459 shutdown_connections 2024-01-22T05:19:33.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.328+0000 7fd633200700 1 -- 172.21.15.49:0/1561031459 wait complete. 2024-01-22T05:19:33.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.328+0000 7fd633200700 1 Processor -- start 2024-01-22T05:19:33.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.328+0000 7fd633200700 1 -- start start 2024-01-22T05:19:33.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd633200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c068690 0x7fd62c147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:33.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd633200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd62c0be070 0x7fd62c067a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:33.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd633200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd62c0c4d60 0x7fd62c067f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:33.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd633200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c068470 con 0x7fd62c068690 2024-01-22T05:19:33.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd633200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c147860 con 0x7fd62c0be070 2024-01-22T05:19:33.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd633200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c1497f0 con 0x7fd62c0c4d60 2024-01-22T05:19:33.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd62be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c068690 0x7fd62c147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:33.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd62be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c068690 0x7fd62c147370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37180/0 (socket says 172.21.15.49:37180) 2024-01-22T05:19:33.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd62be00700 1 -- 172.21.15.49:0/49536348 learned_addr learned my addr 172.21.15.49:0/49536348 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:33.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd62b400700 1 --2- 172.21.15.49:0/49536348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd62c0be070 0x7fd62c067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:33.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd631200700 1 --2- 172.21.15.49:0/49536348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd62c0c4d60 0x7fd62c067f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:33.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd62be00700 1 -- 172.21.15.49:0/49536348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd62c0c4d60 msgr2=0x7fd62c067f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:33.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd62be00700 1 --2- 172.21.15.49:0/49536348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd62c0c4d60 0x7fd62c067f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd62be00700 1 -- 172.21.15.49:0/49536348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd62c0be070 msgr2=0x7fd62c067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:33.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd62be00700 1 --2- 172.21.15.49:0/49536348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd62c0be070 0x7fd62c067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd62be00700 1 -- 172.21.15.49:0/49536348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6140092a0 con 0x7fd62c068690 2024-01-22T05:19:33.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd62be00700 1 --2- 172.21.15.49:0/49536348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c068690 0x7fd62c147370 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7fd61c00c4c0 tx=0x7fd61c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:33.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd623400700 1 -- 172.21.15.49:0/49536348 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c00ce70 con 0x7fd62c068690 2024-01-22T05:19:33.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd623400700 1 -- 172.21.15.49:0/49536348 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c001e90 con 0x7fd62c068690 2024-01-22T05:19:33.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd633200700 1 -- 172.21.15.49:0/49536348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd624009ae0 con 0x7fd62c068690 2024-01-22T05:19:33.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.332+0000 7fd623400700 1 -- 172.21.15.49:0/49536348 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c007250 con 0x7fd62c068690 2024-01-22T05:19:33.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.336+0000 7fd633200700 1 -- 172.21.15.49:0/49536348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c0632f0 con 0x7fd62c068690 2024-01-22T05:19:33.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.336+0000 7fd633200700 1 -- 172.21.15.49:0/49536348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62c0667c0 con 0x7fd62c068690 2024-01-22T05:19:33.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.336+0000 7fd623400700 1 -- 172.21.15.49:0/49536348 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd61c0066a0 con 0x7fd62c068690 2024-01-22T05:19:33.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.340+0000 7fd623400700 1 --2- 172.21.15.49:0/49536348 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd60405a510 0x7fd60405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:33.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.340+0000 7fd623400700 1 -- 172.21.15.49:0/49536348 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fd61c073e40 con 0x7fd62c068690 2024-01-22T05:19:33.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.340+0000 7fd62b400700 1 --2- 172.21.15.49:0/49536348 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd60405a510 0x7fd60405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:33.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.340+0000 7fd62b400700 1 --2- 172.21.15.49:0/49536348 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd60405a510 0x7fd60405c9d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fd62c1493b0 tx=0x7fd614009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:33.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.344+0000 7fd623400700 1 -- 172.21.15.49:0/49536348 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd61c0477c0 con 0x7fd62c068690 2024-01-22T05:19:33.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.548+0000 7fd633200700 1 -- 172.21.15.49:0/49536348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd62c147f40 con 0x7fd62c068690 2024-01-22T05:19:33.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.548+0000 7fd623400700 1 -- 172.21.15.49:0/49536348 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 145 v145) v1 ==== 95+0+3536 (secure 0 0 0) 0x7fd61c04ade0 con 0x7fd62c068690 2024-01-22T05:19:33.548 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:33.549 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":145,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1331200361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1331200361},{"type":"v1","addr":"172.21.15.110:6835","nonce":1331200361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137},{"gid":9994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/377934467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":377934467},{"type":"v1","addr":"172.21.15.110:6834","nonce":377934467}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137},{"gid":10101,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3482770597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3482770597},{"type":"v1","addr":"172.21.15.49:6835","nonce":3482770597}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137},{"gid":10416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/899413276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":899413276},{"type":"v1","addr":"172.21.15.49:6837","nonce":899413276}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":145}],"filesystems":[]} 2024-01-22T05:19:33.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.552+0000 7fd633200700 1 -- 172.21.15.49:0/49536348 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd60405a510 msgr2=0x7fd60405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:33.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.552+0000 7fd633200700 1 --2- 172.21.15.49:0/49536348 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd60405a510 0x7fd60405c9d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fd62c1493b0 tx=0x7fd614009060).stop 2024-01-22T05:19:33.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.552+0000 7fd633200700 1 -- 172.21.15.49:0/49536348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c068690 msgr2=0x7fd62c147370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:33.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.552+0000 7fd633200700 1 --2- 172.21.15.49:0/49536348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c068690 0x7fd62c147370 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7fd61c00c4c0 tx=0x7fd61c007e00).stop 2024-01-22T05:19:33.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.552+0000 7fd633200700 1 -- 172.21.15.49:0/49536348 shutdown_connections 2024-01-22T05:19:33.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.552+0000 7fd633200700 1 --2- 172.21.15.49:0/49536348 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd60405a510 0x7fd60405c9d0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.552+0000 7fd633200700 1 --2- 172.21.15.49:0/49536348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd62c0c4d60 0x7fd62c067f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.552+0000 7fd633200700 1 --2- 172.21.15.49:0/49536348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd62c0be070 0x7fd62c067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.552+0000 7fd633200700 1 --2- 172.21.15.49:0/49536348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62c068690 0x7fd62c147370 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.552+0000 7fd633200700 1 -- 172.21.15.49:0/49536348 >> 172.21.15.49:0/49536348 conn(0x7fd62c0c8730 msgr2=0x7fd62c0a8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:33.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.552+0000 7fd633200700 1 -- 172.21.15.49:0/49536348 shutdown_connections 2024-01-22T05:19:33.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.556+0000 7fd633200700 1 -- 172.21.15.49:0/49536348 wait complete. 2024-01-22T05:19:33.558 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 145 2024-01-22T05:19:33.580 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:19:33.580 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-22T05:19:33.580 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:19:33.580 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:19:33.580 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:19:33.580 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-22T05:19:33.581 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:19:33.581 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:19:33.581 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:19:33.581 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-22T05:19:33.581 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:19:33.581 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:19:33.581 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:19:33.582 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-22T05:19:33.582 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:19:33.582 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:19:33.600 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:19:33.601 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:19:33.602 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:19:33.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:19:33.603 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:19:33.603 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:19:33.606 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:19:33.606 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:19:33.650 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:19:33.651 DEBUG:teuthology.parallel:result is None 2024-01-22T05:19:33.654 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:19:33.654 DEBUG:teuthology.parallel:result is None 2024-01-22T05:19:33.656 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:19:33.656 DEBUG:teuthology.parallel:result is None 2024-01-22T05:19:33.659 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:19:33.659 DEBUG:teuthology.parallel:result is None 2024-01-22T05:19:33.660 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-22T05:19:33.749 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-22T05:19:33.749 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:19:33.764 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-22T05:19:33.768 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-22T05:19:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.808+0000 7fcedc400700 1 Processor -- start 2024-01-22T05:19:33.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.812+0000 7fcedc400700 1 -- start start 2024-01-22T05:19:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.816+0000 7fcedc400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fced4063f40 0x7fced4064380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.816+0000 7fcedc400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced4157b40 con 0x7fced4153650 2024-01-22T05:19:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.816+0000 7fcedc400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced4158610 con 0x7fced40bdfa0 2024-01-22T05:19:33.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.816+0000 7fcedc400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced4069000 con 0x7fced4063f40 2024-01-22T05:19:33.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.816+0000 7fced9000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fced4063f40 0x7fced4064380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:33.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.816+0000 7fceda400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fced4153650 0x7fced4153ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45978/0 (socket says 172.21.15.49:45978) 2024-01-22T05:19:33.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.816+0000 7fceda400700 1 -- 172.21.15.49:0/2429828682 learned_addr learned my addr 172.21.15.49:0/2429828682 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:33.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.816+0000 7fced3e00700 1 -- 172.21.15.49:0/2429828682 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854376403 0 0) 0x7fced4158610 con 0x7fced40bdfa0 2024-01-22T05:19:33.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.816+0000 7fced9000700 1 -- 172.21.15.49:0/2429828682 >> v1:172.21.15.110:6789/0 conn(0x7fced40bdfa0 legacy=0x7fced40688f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:33.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.816+0000 7fced9000700 1 -- 172.21.15.49:0/2429828682 >> v1:172.21.15.49:6789/0 conn(0x7fced4153650 legacy=0x7fced4153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:33.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.816+0000 7fced9000700 1 -- 172.21.15.49:0/2429828682 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced40bc740 con 0x7fced4063f40 2024-01-22T05:19:33.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.816+0000 7fced9000700 1 --2- 172.21.15.49:0/2429828682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced4063f40 0x7fced4064380 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7fcebc009760 tx=0x7fcebc009060).ready entity=mon.0 client_cookie=6e6fe2eead795df7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:33.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.816+0000 7fced3e00700 1 -- 172.21.15.49:0/2429828682 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc009120 con 0x7fced4063f40 2024-01-22T05:19:33.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.816+0000 7fced3e00700 1 -- 172.21.15.49:0/2429828682 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc00b580 con 0x7fced4063f40 2024-01-22T05:19:33.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.816+0000 7fced3e00700 1 -- 172.21.15.49:0/2429828682 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc00b900 con 0x7fced4063f40 2024-01-22T05:19:33.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.820+0000 7fcedc400700 1 -- 172.21.15.49:0/2429828682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced4063f40 msgr2=0x7fced4064380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:33.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.820+0000 7fcedc400700 1 --2- 172.21.15.49:0/2429828682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced4063f40 0x7fced4064380 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7fcebc009760 tx=0x7fcebc009060).stop 2024-01-22T05:19:33.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.820+0000 7fcedc400700 1 -- 172.21.15.49:0/2429828682 shutdown_connections 2024-01-22T05:19:33.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.820+0000 7fcedc400700 1 --2- 172.21.15.49:0/2429828682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced4063f40 0x7fced4064380 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.820+0000 7fcedc400700 1 -- 172.21.15.49:0/2429828682 >> 172.21.15.49:0/2429828682 conn(0x7fced40c40c0 msgr2=0x7fced40c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:33.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.820+0000 7fcedc400700 1 -- 172.21.15.49:0/2429828682 shutdown_connections 2024-01-22T05:19:33.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.820+0000 7fcedc400700 1 -- 172.21.15.49:0/2429828682 wait complete. 2024-01-22T05:19:33.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.820+0000 7fcedc400700 1 Processor -- start 2024-01-22T05:19:33.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.820+0000 7fcedc400700 1 -- start start 2024-01-22T05:19:33.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fcedc400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fced4063f40 0x7fced414f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:33.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fcedc400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced40bdfa0 0x7fced4150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:33.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fcedc400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fced4153650 0x7fced4150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:33.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fcedc400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced4151e40 con 0x7fced40bdfa0 2024-01-22T05:19:33.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fcedc400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced4150d40 con 0x7fced4063f40 2024-01-22T05:19:33.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fcedc400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced40bebb0 con 0x7fced4153650 2024-01-22T05:19:33.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fced9000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced40bdfa0 0x7fced4150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:33.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fced9000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced40bdfa0 0x7fced4150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37222/0 (socket says 172.21.15.49:37222) 2024-01-22T05:19:33.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fced9000700 1 -- 172.21.15.49:0/3404383734 learned_addr learned my addr 172.21.15.49:0/3404383734 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:33.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fceda400700 1 --2- 172.21.15.49:0/3404383734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fced4153650 0x7fced4150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:33.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fced9a00700 1 --2- 172.21.15.49:0/3404383734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fced4063f40 0x7fced414f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:33.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fced9000700 1 -- 172.21.15.49:0/3404383734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fced4153650 msgr2=0x7fced4150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:33.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fced9000700 1 --2- 172.21.15.49:0/3404383734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fced4153650 0x7fced4150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fced9000700 1 -- 172.21.15.49:0/3404383734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fced4063f40 msgr2=0x7fced414f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:33.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fced9000700 1 --2- 172.21.15.49:0/3404383734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fced4063f40 0x7fced414f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:33.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fced9000700 1 -- 172.21.15.49:0/3404383734 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc0092a0 con 0x7fced40bdfa0 2024-01-22T05:19:33.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fced9000700 1 --2- 172.21.15.49:0/3404383734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced40bdfa0 0x7fced4150360 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7fcebc006e00 tx=0x7fcebc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:33.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fced0c00700 1 -- 172.21.15.49:0/3404383734 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc00b900 con 0x7fced40bdfa0 2024-01-22T05:19:33.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fced0c00700 1 -- 172.21.15.49:0/3404383734 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc006970 con 0x7fced40bdfa0 2024-01-22T05:19:33.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fced0c00700 1 -- 172.21.15.49:0/3404383734 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc00bed0 con 0x7fced40bdfa0 2024-01-22T05:19:33.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fcedc400700 1 -- 172.21.15.49:0/3404383734 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced4150f80 con 0x7fced40bdfa0 2024-01-22T05:19:33.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.824+0000 7fcedc400700 1 -- 172.21.15.49:0/3404383734 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced40be840 con 0x7fced40bdfa0 2024-01-22T05:19:33.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.828+0000 7fcedc400700 1 -- 172.21.15.49:0/3404383734 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced40be6a0 con 0x7fced40bdfa0 2024-01-22T05:19:33.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.828+0000 7fced0c00700 1 -- 172.21.15.49:0/3404383734 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcebc01b620 con 0x7fced40bdfa0 2024-01-22T05:19:33.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.832+0000 7fced0c00700 1 --2- 172.21.15.49:0/3404383734 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fceac05a510 0x7fceac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:33.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.832+0000 7fced0c00700 1 -- 172.21.15.49:0/3404383734 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5708+0+0 (secure 0 0 0) 0x7fcebc0762a0 con 0x7fced40bdfa0 2024-01-22T05:19:33.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.832+0000 7fced9a00700 1 --2- 172.21.15.49:0/3404383734 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fceac05a510 0x7fceac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:33.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.832+0000 7fced9a00700 1 --2- 172.21.15.49:0/3404383734 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fceac05a510 0x7fceac05c9d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7fcec40011e0 tx=0x7fcec4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:33.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:33.836+0000 7fced0c00700 1 -- 172.21.15.49:0/3404383734 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fced40be6a0 con 0x7fced40bdfa0 2024-01-22T05:19:34.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.016+0000 7fcedc400700 1 -- 172.21.15.49:0/3404383734 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fced40be6a0 con 0x7fced40bdfa0 2024-01-22T05:19:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.800+0000 7fced0c00700 1 -- 172.21.15.49:0/3404383734 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v193) v1 ==== 97+0+0 (secure 0 0 0) 0x7fced40be6a0 con 0x7fced40bdfa0 2024-01-22T05:19:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.804+0000 7fcedc400700 1 -- 172.21.15.49:0/3404383734 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fceac05a510 msgr2=0x7fceac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.804+0000 7fcedc400700 1 --2- 172.21.15.49:0/3404383734 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fceac05a510 0x7fceac05c9d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7fcec40011e0 tx=0x7fcec4009040).stop 2024-01-22T05:19:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.804+0000 7fcedc400700 1 -- 172.21.15.49:0/3404383734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced40bdfa0 msgr2=0x7fced4150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.804+0000 7fcedc400700 1 --2- 172.21.15.49:0/3404383734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced40bdfa0 0x7fced4150360 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7fcebc006e00 tx=0x7fcebc017000).stop 2024-01-22T05:19:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.804+0000 7fcedc400700 1 -- 172.21.15.49:0/3404383734 shutdown_connections 2024-01-22T05:19:34.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.804+0000 7fcedc400700 1 --2- 172.21.15.49:0/3404383734 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fceac05a510 0x7fceac05c9d0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:34.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.804+0000 7fcedc400700 1 --2- 172.21.15.49:0/3404383734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fced4153650 0x7fced4150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:34.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.804+0000 7fcedc400700 1 --2- 172.21.15.49:0/3404383734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fced40bdfa0 0x7fced4150360 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:34.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.804+0000 7fcedc400700 1 --2- 172.21.15.49:0/3404383734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fced4063f40 0x7fced414f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:34.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.804+0000 7fcedc400700 1 -- 172.21.15.49:0/3404383734 >> 172.21.15.49:0/3404383734 conn(0x7fced40c40c0 msgr2=0x7fced4066550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:34.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.804+0000 7fcedc400700 1 -- 172.21.15.49:0/3404383734 shutdown_connections 2024-01-22T05:19:34.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.804+0000 7fcedc400700 1 -- 172.21.15.49:0/3404383734 wait complete. 2024-01-22T05:19:34.807 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-01-22T05:19:34.822 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-22T05:19:34.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.984+0000 7f6e79000700 1 Processor -- start 2024-01-22T05:19:34.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.984+0000 7f6e79000700 1 -- start start 2024-01-22T05:19:34.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.988+0000 7f6e79000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e74064c00 0x7f6e740bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:34.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.988+0000 7f6e79000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6e74065620 0x7f6e740bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:34.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.988+0000 7f6e79000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e740c2700 con 0x7f6e74065240 2024-01-22T05:19:34.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.988+0000 7f6e79000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e740c29a0 con 0x7f6e74065620 2024-01-22T05:19:34.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.988+0000 7f6e79000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740c2c80 con 0x7f6e74064c00 2024-01-22T05:19:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.988+0000 7f6e73200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6e74065620 0x7f6e740bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.988+0000 7f6e71e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6e74065240 0x7f6e740644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45982/0 (socket says 172.21.15.49:45982) 2024-01-22T05:19:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.988+0000 7f6e71e00700 1 -- 172.21.15.49:0/3786430659 learned_addr learned my addr 172.21.15.49:0/3786430659 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:34.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e71400700 1 --2- 172.21.15.49:0/3786430659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e74064c00 0x7f6e740bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e70a00700 1 -- 172.21.15.49:0/3786430659 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395287057 0 0) 0x7f6e740c2700 con 0x7f6e74065240 2024-01-22T05:19:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e73200700 1 -- 172.21.15.49:0/3786430659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e74064c00 msgr2=0x7f6e740bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e73200700 1 --2- 172.21.15.49:0/3786430659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e74064c00 0x7f6e740bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e73200700 1 -- 172.21.15.49:0/3786430659 >> v1:172.21.15.49:6789/0 conn(0x7f6e74065240 legacy=0x7f6e740644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e73200700 1 -- 172.21.15.49:0/3786430659 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e740c2f60 con 0x7f6e74065620 2024-01-22T05:19:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e71400700 1 --2- 172.21.15.49:0/3786430659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e74064c00 0x7f6e740bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e73200700 1 --2- 172.21.15.49:0/3786430659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e74065620 0x7f6e740bd170 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7f6e6c009e60 tx=0x7f6e6c009780).ready entity=mon.0 client_cookie=612ba3936b532d68 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:34.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e70a00700 1 -- 172.21.15.49:0/3786430659 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c00e070 con 0x7f6e74065620 2024-01-22T05:19:34.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e70a00700 1 -- 172.21.15.49:0/3786430659 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c00bc30 con 0x7f6e74065620 2024-01-22T05:19:34.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e70a00700 1 -- 172.21.15.49:0/3786430659 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c012410 con 0x7f6e74065620 2024-01-22T05:19:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e79000700 1 -- 172.21.15.49:0/3786430659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e74065620 msgr2=0x7f6e740bd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e79000700 1 --2- 172.21.15.49:0/3786430659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e74065620 0x7f6e740bd170 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7f6e6c009e60 tx=0x7f6e6c009780).stop 2024-01-22T05:19:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e79000700 1 -- 172.21.15.49:0/3786430659 shutdown_connections 2024-01-22T05:19:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e79000700 1 --2- 172.21.15.49:0/3786430659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e74065620 0x7f6e740bd170 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e79000700 1 --2- 172.21.15.49:0/3786430659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e74064c00 0x7f6e740bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.992+0000 7f6e79000700 1 -- 172.21.15.49:0/3786430659 >> 172.21.15.49:0/3786430659 conn(0x7f6e740c87f0 msgr2=0x7f6e740c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:34.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.996+0000 7f6e79000700 1 -- 172.21.15.49:0/3786430659 shutdown_connections 2024-01-22T05:19:34.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.996+0000 7f6e79000700 1 -- 172.21.15.49:0/3786430659 wait complete. 2024-01-22T05:19:34.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.996+0000 7f6e79000700 1 Processor -- start 2024-01-22T05:19:34.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:34.996+0000 7f6e79000700 1 -- start start 2024-01-22T05:19:34.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e79000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e74064c00 0x7f6e74168120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:34.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e79000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e74065240 0x7f6e74148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:34.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e79000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e74065620 0x7f6e74158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:34.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e79000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740bf9d0 con 0x7f6e74064c00 2024-01-22T05:19:34.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e79000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740bedc0 con 0x7f6e74065240 2024-01-22T05:19:34.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e79000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740bf0a0 con 0x7f6e74065620 2024-01-22T05:19:35.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e71e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e74064c00 0x7f6e74168120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e71e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e74064c00 0x7f6e74168120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37236/0 (socket says 172.21.15.49:37236) 2024-01-22T05:19:35.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e71e00700 1 -- 172.21.15.49:0/1565015563 learned_addr learned my addr 172.21.15.49:0/1565015563 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:35.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e73200700 1 --2- 172.21.15.49:0/1565015563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e74065620 0x7f6e74158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e71400700 1 --2- 172.21.15.49:0/1565015563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e74065240 0x7f6e74148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e71e00700 1 -- 172.21.15.49:0/1565015563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e74065620 msgr2=0x7f6e74158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:35.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e71e00700 1 --2- 172.21.15.49:0/1565015563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e74065620 0x7f6e74158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e71e00700 1 -- 172.21.15.49:0/1565015563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e74065240 msgr2=0x7f6e74148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:35.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e71e00700 1 --2- 172.21.15.49:0/1565015563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e74065240 0x7f6e74148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e71e00700 1 -- 172.21.15.49:0/1565015563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c009a20 con 0x7f6e74064c00 2024-01-22T05:19:35.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e71e00700 1 --2- 172.21.15.49:0/1565015563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e74064c00 0x7f6e74168120 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7f6e6400c4e0 tx=0x7f6e64007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:35.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e69600700 1 -- 172.21.15.49:0/1565015563 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e640072e0 con 0x7f6e74064c00 2024-01-22T05:19:35.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e69600700 1 -- 172.21.15.49:0/1565015563 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e64007440 con 0x7f6e74064c00 2024-01-22T05:19:35.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e79000700 1 -- 172.21.15.49:0/1565015563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e740bf380 con 0x7f6e74064c00 2024-01-22T05:19:35.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e69600700 1 -- 172.21.15.49:0/1565015563 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e640057a0 con 0x7f6e74064c00 2024-01-22T05:19:35.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.000+0000 7f6e79000700 1 -- 172.21.15.49:0/1565015563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e740c1220 con 0x7f6e74064c00 2024-01-22T05:19:35.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.004+0000 7f6e79000700 1 -- 172.21.15.49:0/1565015563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e740aae10 con 0x7f6e74064c00 2024-01-22T05:19:35.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.004+0000 7f6e69600700 1 -- 172.21.15.49:0/1565015563 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6e64005bd0 con 0x7f6e74064c00 2024-01-22T05:19:35.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.008+0000 7f6e69600700 1 --2- 172.21.15.49:0/1565015563 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e4c05a510 0x7f6e4c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:35.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.008+0000 7f6e69600700 1 -- 172.21.15.49:0/1565015563 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f6e64073ff0 con 0x7f6e74064c00 2024-01-22T05:19:35.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.008+0000 7f6e71400700 1 --2- 172.21.15.49:0/1565015563 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e4c05a510 0x7f6e4c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.008+0000 7f6e71400700 1 --2- 172.21.15.49:0/1565015563 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e4c05a510 0x7f6e4c05c9d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f6e74157520 tx=0x7f6e5c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:35.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.012+0000 7f6e69600700 1 -- 172.21.15.49:0/1565015563 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6e740aae10 con 0x7f6e74064c00 2024-01-22T05:19:35.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.232+0000 7f6e79000700 1 -- 172.21.15.49:0/1565015563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6e740aae10 con 0x7f6e74064c00 2024-01-22T05:19:35.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.232+0000 7f6e69600700 1 -- 172.21.15.49:0/1565015563 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6e740aae10 con 0x7f6e74064c00 2024-01-22T05:19:35.232 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:35.232 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:19:35.232 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-01-22T05:19:35.232 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.232 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-01-22T05:19:35.232 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lTCfoJxAAxDGvXKXgooA9/f0J70s6AA==", 2024-01-22T05:19:35.232 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.233 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:35.233 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:19:35.233 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:19:35.233 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:35.233 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.233 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.233 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.233 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-01-22T05:19:35.233 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lHqV6ORAA1DwpPV2PyDBF/6/ePTdQJw==", 2024-01-22T05:19:35.233 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.233 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:35.233 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:19:35.233 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:19:35.233 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:35.234 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.234 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.234 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.234 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-01-22T05:19:35.234 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lPo86MhAAonfC3M+AkLldljODYNGzyA==", 2024-01-22T05:19:35.234 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.234 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:35.234 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:19:35.234 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:19:35.234 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:35.234 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.234 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.234 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.234 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-01-22T05:19:35.234 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lLwvMBxAAFm52HWeGbTH1gbWVm6r5zQ==", 2024-01-22T05:19:35.235 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.235 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:35.235 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:19:35.235 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:19:35.235 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:35.235 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.235 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.235 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.235 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-01-22T05:19:35.235 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAt961lH2F9NBAAHm8R9/Q5IuFUvb0o1GyD4Q==", 2024-01-22T05:19:35.235 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.235 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:35.235 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:35.235 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:35.235 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.236 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.236 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.236 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-01-22T05:19:35.236 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAx961lS1lEIhAAuDm2OYfTYff1kVEq5vXvFw==", 2024-01-22T05:19:35.236 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.236 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:35.236 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:35.236 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:35.236 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.236 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.236 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.236 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-01-22T05:19:35.236 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA1961limLvERAAv23crKrwjLIg84u48BHHbg==", 2024-01-22T05:19:35.236 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.236 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:35.237 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:35.237 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:35.237 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.237 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.237 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.237 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2024-01-22T05:19:35.237 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA5961lShJiABAAnvyhz0ggDaITaMgwzi9kAA==", 2024-01-22T05:19:35.237 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.237 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:35.237 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:35.237 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:35.237 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.237 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.237 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQA9961lcopfNRAAAZgHzI1t7YHI5cAjaCMiNw==", 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBB961lX+nTIxAAtP3YQypuFWM5O/LADjvybA==", 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:35.238 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.239 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.239 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.239 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2024-01-22T05:19:35.239 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBF961lQ4/XERAARZPqENsV3jokk2g3OXUI5w==", 2024-01-22T05:19:35.239 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.239 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:35.239 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:35.239 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:35.239 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.239 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.239 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.239 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2024-01-22T05:19:35.239 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQBI961luxnqOhAAGsV74DKQda5cetNA/woOnA==", 2024-01-22T05:19:35.239 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.239 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-22T05:19:35.240 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-22T05:19:35.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:35.240 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.240 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.240 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.240 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-01-22T05:19:35.240 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lmrM6DhAAYU09HviWyrUIz4lio15wFw==", 2024-01-22T05:19:35.240 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.240 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:35.240 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-01-22T05:19:35.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-22T05:19:35.240 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.240 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.240 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.240 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lIhYRGRAAFG+YtkDLFsra6zU44xKCHw==", 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lRuyaExAAQO3a7ahOEcuE+WVfXYEBTg==", 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:19:35.241 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:19:35.242 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.242 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.242 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.242 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2024-01-22T05:19:35.242 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAs961lMiMkHhAAxPdKpcHdtqSphbc/2agq9Q==", 2024-01-22T05:19:35.242 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.242 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-22T05:19:35.242 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-22T05:19:35.242 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-22T05:19:35.242 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-22T05:19:35.242 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.242 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.242 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.242 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-01-22T05:19:35.242 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961ljsweARAAJrY3z/sBjayjB2BRQNrJew==", 2024-01-22T05:19:35.243 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.243 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:19:35.243 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-22T05:19:35.243 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-22T05:19:35.243 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:35.243 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.243 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.243 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.243 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-01-22T05:19:35.243 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961l0DwDIhAAeuCu79LxNMEJvWiW/BfDhA==", 2024-01-22T05:19:35.243 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.243 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:19:35.243 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:19:35.243 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:35.243 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:35.244 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:35.244 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2024-01-22T05:19:35.244 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAr961lZlmPGxAA1KVZR+XzNdoFVo/980hD8w==", 2024-01-22T05:19:35.244 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-22T05:19:35.244 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-22T05:19:35.244 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-22T05:19:35.244 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-22T05:19:35.244 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.244 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:35.244 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-01-22T05:19:35.244 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:19:35.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.236+0000 7f6e79000700 1 -- 172.21.15.49:0/1565015563 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e4c05a510 msgr2=0x7f6e4c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:35.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.236+0000 7f6e79000700 1 --2- 172.21.15.49:0/1565015563 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e4c05a510 0x7f6e4c05c9d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f6e74157520 tx=0x7f6e5c008040).stop 2024-01-22T05:19:35.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.236+0000 7f6e79000700 1 -- 172.21.15.49:0/1565015563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e74064c00 msgr2=0x7f6e74168120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:35.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.236+0000 7f6e79000700 1 --2- 172.21.15.49:0/1565015563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e74064c00 0x7f6e74168120 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7f6e6400c4e0 tx=0x7f6e64007c70).stop 2024-01-22T05:19:35.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.236+0000 7f6e79000700 1 -- 172.21.15.49:0/1565015563 shutdown_connections 2024-01-22T05:19:35.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.236+0000 7f6e79000700 1 --2- 172.21.15.49:0/1565015563 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f6e4c05a510 0x7f6e4c05c9d0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.236+0000 7f6e79000700 1 --2- 172.21.15.49:0/1565015563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e74065620 0x7f6e74158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.236+0000 7f6e79000700 1 --2- 172.21.15.49:0/1565015563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e74065240 0x7f6e74148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.236+0000 7f6e79000700 1 --2- 172.21.15.49:0/1565015563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e74064c00 0x7f6e74168120 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.236+0000 7f6e79000700 1 -- 172.21.15.49:0/1565015563 >> 172.21.15.49:0/1565015563 conn(0x7f6e740c87f0 msgr2=0x7f6e74063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:35.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.236+0000 7f6e79000700 1 -- 172.21.15.49:0/1565015563 shutdown_connections 2024-01-22T05:19:35.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.236+0000 7f6e79000700 1 -- 172.21.15.49:0/1565015563 wait complete. 2024-01-22T05:19:35.257 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:19:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.420+0000 7fdb42e00700 1 Processor -- start 2024-01-22T05:19:35.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.420+0000 7fdb42e00700 1 -- start start 2024-01-22T05:19:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb42e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb3c064c00 0x7fdb3c0bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb42e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdb3c065620 0x7fdb3c0bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb42e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3c0c2700 con 0x7fdb3c065240 2024-01-22T05:19:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb42e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb3c0c29a0 con 0x7fdb3c065620 2024-01-22T05:19:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb42e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c0c2c80 con 0x7fdb3c064c00 2024-01-22T05:19:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb3be00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdb3c065240 0x7fdb3c0644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45988/0 (socket says 172.21.15.49:45988) 2024-01-22T05:19:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb3be00700 1 -- 172.21.15.49:0/1315045236 learned_addr learned my addr 172.21.15.49:0/1315045236 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:35.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb41800700 1 --2- 172.21.15.49:0/1315045236 >> v2:172.21.15.49:3300/0 conn(0x7fdb3c065620 0x7fdb3c0bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb3b400700 1 --2- 172.21.15.49:0/1315045236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb3c064c00 0x7fdb3c0bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb3aa00700 1 -- 172.21.15.49:0/1315045236 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989039610 0 0) 0x7fdb3c0c2700 con 0x7fdb3c065240 2024-01-22T05:19:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb3aa00700 1 -- 172.21.15.49:0/1315045236 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb1c0033f0 con 0x7fdb3c065240 2024-01-22T05:19:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb41800700 1 -- 172.21.15.49:0/1315045236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb3c064c00 msgr2=0x7fdb3c0bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb41800700 1 --2- 172.21.15.49:0/1315045236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb3c064c00 0x7fdb3c0bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb41800700 1 -- 172.21.15.49:0/1315045236 >> v1:172.21.15.49:6789/0 conn(0x7fdb3c065240 legacy=0x7fdb3c0644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb41800700 1 -- 172.21.15.49:0/1315045236 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c0c2f60 con 0x7fdb3c065620 2024-01-22T05:19:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb41800700 1 --2- 172.21.15.49:0/1315045236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb3c065620 0x7fdb3c0bd170 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7fdb34009e60 tx=0x7fdb34009780).ready entity=mon.0 client_cookie=3ff4f48ad5f29615 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.424+0000 7fdb3aa00700 1 -- 172.21.15.49:0/1315045236 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3400e070 con 0x7fdb3c065620 2024-01-22T05:19:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.428+0000 7fdb3aa00700 1 -- 172.21.15.49:0/1315045236 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3400bab0 con 0x7fdb3c065620 2024-01-22T05:19:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.428+0000 7fdb3aa00700 1 -- 172.21.15.49:0/1315045236 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3400be30 con 0x7fdb3c065620 2024-01-22T05:19:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.428+0000 7fdb42e00700 1 -- 172.21.15.49:0/1315045236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb3c065620 msgr2=0x7fdb3c0bd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.428+0000 7fdb42e00700 1 --2- 172.21.15.49:0/1315045236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb3c065620 0x7fdb3c0bd170 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7fdb34009e60 tx=0x7fdb34009780).stop 2024-01-22T05:19:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.428+0000 7fdb42e00700 1 -- 172.21.15.49:0/1315045236 shutdown_connections 2024-01-22T05:19:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.428+0000 7fdb42e00700 1 --2- 172.21.15.49:0/1315045236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb3c065620 0x7fdb3c0bd170 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.428+0000 7fdb42e00700 1 --2- 172.21.15.49:0/1315045236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb3c064c00 0x7fdb3c0bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.428+0000 7fdb42e00700 1 -- 172.21.15.49:0/1315045236 >> 172.21.15.49:0/1315045236 conn(0x7fdb3c0c87f0 msgr2=0x7fdb3c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:35.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.428+0000 7fdb42e00700 1 -- 172.21.15.49:0/1315045236 shutdown_connections 2024-01-22T05:19:35.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.428+0000 7fdb42e00700 1 -- 172.21.15.49:0/1315045236 wait complete. 2024-01-22T05:19:35.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.432+0000 7fdb42e00700 1 Processor -- start 2024-01-22T05:19:35.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.432+0000 7fdb42e00700 1 -- start start 2024-01-22T05:19:35.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.432+0000 7fdb42e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb3c064c00 0x7fdb3c159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:35.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.432+0000 7fdb42e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb3c065240 0x7fdb3c1566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:35.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.432+0000 7fdb42e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb3c065620 0x7fdb3c0c1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:35.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.432+0000 7fdb42e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c156b90 con 0x7fdb3c065620 2024-01-22T05:19:35.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.432+0000 7fdb42e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c168090 con 0x7fdb3c065240 2024-01-22T05:19:35.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.432+0000 7fdb42e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c0c19b0 con 0x7fdb3c064c00 2024-01-22T05:19:35.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.432+0000 7fdb41800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb3c065620 0x7fdb3c0c1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.432+0000 7fdb41800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb3c065620 0x7fdb3c0c1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37250/0 (socket says 172.21.15.49:37250) 2024-01-22T05:19:35.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.432+0000 7fdb41800700 1 -- 172.21.15.49:0/1439563523 learned_addr learned my addr 172.21.15.49:0/1439563523 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:35.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.432+0000 7fdb3b400700 1 --2- 172.21.15.49:0/1439563523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb3c065240 0x7fdb3c1566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.432+0000 7fdb3be00700 1 --2- 172.21.15.49:0/1439563523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb3c064c00 0x7fdb3c159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.432+0000 7fdb41800700 1 -- 172.21.15.49:0/1439563523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb3c064c00 msgr2=0x7fdb3c159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:35.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.432+0000 7fdb41800700 1 --2- 172.21.15.49:0/1439563523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb3c064c00 0x7fdb3c159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.436+0000 7fdb41800700 1 -- 172.21.15.49:0/1439563523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb3c065240 msgr2=0x7fdb3c1566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:35.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.436+0000 7fdb41800700 1 --2- 172.21.15.49:0/1439563523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb3c065240 0x7fdb3c1566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.436+0000 7fdb41800700 1 -- 172.21.15.49:0/1439563523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb34009a20 con 0x7fdb3c065620 2024-01-22T05:19:35.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.436+0000 7fdb3be00700 1 --2- 172.21.15.49:0/1439563523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb3c064c00 0x7fdb3c159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:35.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.436+0000 7fdb41800700 1 --2- 172.21.15.49:0/1439563523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb3c065620 0x7fdb3c0c1190 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 rx=0x7fdb34011000 tx=0x7fdb3c0c2890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:35.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.436+0000 7fdb33400700 1 -- 172.21.15.49:0/1439563523 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34013e40 con 0x7fdb3c065620 2024-01-22T05:19:35.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.436+0000 7fdb33400700 1 -- 172.21.15.49:0/1439563523 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3401d630 con 0x7fdb3c065620 2024-01-22T05:19:35.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.436+0000 7fdb42e00700 1 -- 172.21.15.49:0/1439563523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb3c0c1c90 con 0x7fdb3c065620 2024-01-22T05:19:35.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.436+0000 7fdb33400700 1 -- 172.21.15.49:0/1439563523 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3401d9f0 con 0x7fdb3c065620 2024-01-22T05:19:35.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.436+0000 7fdb42e00700 1 -- 172.21.15.49:0/1439563523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb3c0c1680 con 0x7fdb3c065620 2024-01-22T05:19:35.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.436+0000 7fdb42e00700 1 -- 172.21.15.49:0/1439563523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3c168200 con 0x7fdb3c065620 2024-01-22T05:19:35.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.436+0000 7fdb33400700 1 -- 172.21.15.49:0/1439563523 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdb34003040 con 0x7fdb3c065620 2024-01-22T05:19:35.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.440+0000 7fdb33400700 1 --2- 172.21.15.49:0/1439563523 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb1405a4e0 0x7fdb1405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:35.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.440+0000 7fdb33400700 1 -- 172.21.15.49:0/1439563523 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5622+0+0 (secure 0 0 0) 0x7fdb34076380 con 0x7fdb3c065620 2024-01-22T05:19:35.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.440+0000 7fdb3be00700 1 --2- 172.21.15.49:0/1439563523 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb1405a4e0 0x7fdb1405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.440+0000 7fdb3be00700 1 --2- 172.21.15.49:0/1439563523 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb1405a4e0 0x7fdb1405c9a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fdb2c005750 tx=0x7fdb2c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:35.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.444+0000 7fdb33400700 1 -- 172.21.15.49:0/1439563523 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdb34049c90 con 0x7fdb3c065620 2024-01-22T05:19:35.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.612+0000 7fdb42e00700 1 -- 172.21.15.49:0/1439563523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb3c047060 con 0x7fdb3c065620 2024-01-22T05:19:35.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.612+0000 7fdb33400700 1 -- 172.21.15.49:0/1439563523 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+13958 (secure 0 0 0) 0x7fdb3404d2b0 con 0x7fdb3c065620 2024-01-22T05:19:35.613 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:35.613 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":193,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:19:34.793376+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:19:35.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.616+0000 7fdb42e00700 1 -- 172.21.15.49:0/1439563523 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb1405a4e0 msgr2=0x7fdb1405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:35.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.616+0000 7fdb42e00700 1 --2- 172.21.15.49:0/1439563523 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb1405a4e0 0x7fdb1405c9a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fdb2c005750 tx=0x7fdb2c009040).stop 2024-01-22T05:19:35.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.616+0000 7fdb42e00700 1 -- 172.21.15.49:0/1439563523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb3c065620 msgr2=0x7fdb3c0c1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:35.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.616+0000 7fdb42e00700 1 --2- 172.21.15.49:0/1439563523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb3c065620 0x7fdb3c0c1190 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 rx=0x7fdb34011000 tx=0x7fdb3c0c2890).stop 2024-01-22T05:19:35.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.616+0000 7fdb42e00700 1 -- 172.21.15.49:0/1439563523 shutdown_connections 2024-01-22T05:19:35.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.616+0000 7fdb42e00700 1 --2- 172.21.15.49:0/1439563523 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb1405a4e0 0x7fdb1405c9a0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.616+0000 7fdb42e00700 1 --2- 172.21.15.49:0/1439563523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb3c065620 0x7fdb3c0c1190 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.616+0000 7fdb42e00700 1 --2- 172.21.15.49:0/1439563523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb3c065240 0x7fdb3c1566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.616+0000 7fdb42e00700 1 --2- 172.21.15.49:0/1439563523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb3c064c00 0x7fdb3c159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.616+0000 7fdb42e00700 1 -- 172.21.15.49:0/1439563523 >> 172.21.15.49:0/1439563523 conn(0x7fdb3c0c87f0 msgr2=0x7fdb3c0c5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:35.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.616+0000 7fdb42e00700 1 -- 172.21.15.49:0/1439563523 shutdown_connections 2024-01-22T05:19:35.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.616+0000 7fdb42e00700 1 -- 172.21.15.49:0/1439563523 wait complete. 2024-01-22T05:19:35.640 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:19:35.640 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:19:35.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.808+0000 7ff456c00700 1 Processor -- start 2024-01-22T05:19:35.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.812+0000 7ff456c00700 1 -- start start 2024-01-22T05:19:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.812+0000 7ff456c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450155970 0x7ff4500a5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.812+0000 7ff456c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff450068370 0x7ff4500c5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff456c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff450068800 con 0x7ff4500a5e20 2024-01-22T05:19:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff456c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4500c4bc0 con 0x7ff450068370 2024-01-22T05:19:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff456c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff450155d50 con 0x7ff450155970 2024-01-22T05:19:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff44fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450155970 0x7ff4500a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff454c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff450068370 0x7ff4500c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff454c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff450068370 0x7ff4500c5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:54220/0 (socket says 172.21.15.49:54220) 2024-01-22T05:19:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff454c00700 1 -- 172.21.15.49:0/2573278861 learned_addr learned my addr 172.21.15.49:0/2573278861 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff44fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450155970 0x7ff4500a5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:48444/0 (socket says 172.21.15.49:48444) 2024-01-22T05:19:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff454c00700 1 -- 172.21.15.49:0/2573278861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450155970 msgr2=0x7ff4500a5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff454c00700 1 --2- 172.21.15.49:0/2573278861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450155970 0x7ff4500a5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff454c00700 1 -- 172.21.15.49:0/2573278861 >> v1:172.21.15.110:6789/0 conn(0x7ff4500a5e20 legacy=0x7ff450067c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff454c00700 1 -- 172.21.15.49:0/2573278861 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4500a6280 con 0x7ff450068370 2024-01-22T05:19:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff454c00700 1 --2- 172.21.15.49:0/2573278861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff450068370 0x7ff4500c5010 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7ff448009f20 tx=0x7ff448009840).ready entity=mon.1 client_cookie=732b7d908bd78c3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff44ea00700 1 -- 172.21.15.49:0/2573278861 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44800e070 con 0x7ff450068370 2024-01-22T05:19:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff44ea00700 1 -- 172.21.15.49:0/2573278861 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44800b9d0 con 0x7ff450068370 2024-01-22T05:19:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.816+0000 7ff44ea00700 1 -- 172.21.15.49:0/2573278861 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44800bd50 con 0x7ff450068370 2024-01-22T05:19:35.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.820+0000 7ff456c00700 1 -- 172.21.15.49:0/2573278861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff450068370 msgr2=0x7ff4500c5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:35.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.820+0000 7ff456c00700 1 --2- 172.21.15.49:0/2573278861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff450068370 0x7ff4500c5010 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7ff448009f20 tx=0x7ff448009840).stop 2024-01-22T05:19:35.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.820+0000 7ff456c00700 1 -- 172.21.15.49:0/2573278861 shutdown_connections 2024-01-22T05:19:35.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.820+0000 7ff456c00700 1 --2- 172.21.15.49:0/2573278861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff450068370 0x7ff4500c5010 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.820+0000 7ff456c00700 1 --2- 172.21.15.49:0/2573278861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450155970 0x7ff4500a5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.820+0000 7ff456c00700 1 -- 172.21.15.49:0/2573278861 >> 172.21.15.49:0/2573278861 conn(0x7ff4500c3ef0 msgr2=0x7ff450065a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:35.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.820+0000 7ff456c00700 1 -- 172.21.15.49:0/2573278861 shutdown_connections 2024-01-22T05:19:35.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.820+0000 7ff456c00700 1 -- 172.21.15.49:0/2573278861 wait complete. 2024-01-22T05:19:35.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.824+0000 7ff456c00700 1 Processor -- start 2024-01-22T05:19:35.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.824+0000 7ff456c00700 1 -- start start 2024-01-22T05:19:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.824+0000 7ff456c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff450068370 0x7ff4500ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.824+0000 7ff456c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4500a5e20 0x7ff4500ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.824+0000 7ff456c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450155970 0x7ff450167850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.824+0000 7ff456c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4500abcd0 con 0x7ff450068370 2024-01-22T05:19:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.824+0000 7ff456c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45016b4d0 con 0x7ff4500a5e20 2024-01-22T05:19:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.824+0000 7ff456c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45016b720 con 0x7ff450155970 2024-01-22T05:19:35.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff44fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff450068370 0x7ff4500ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff44fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff450068370 0x7ff4500ab2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37256/0 (socket says 172.21.15.49:37256) 2024-01-22T05:19:35.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff44fe00700 1 -- 172.21.15.49:0/1661911770 learned_addr learned my addr 172.21.15.49:0/1661911770 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:35.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff454c00700 1 --2- 172.21.15.49:0/1661911770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450155970 0x7ff450167850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff44f400700 1 --2- 172.21.15.49:0/1661911770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4500a5e20 0x7ff4500ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff44fe00700 1 -- 172.21.15.49:0/1661911770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450155970 msgr2=0x7ff450167850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:35.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff44fe00700 1 --2- 172.21.15.49:0/1661911770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450155970 0x7ff450167850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff44fe00700 1 -- 172.21.15.49:0/1661911770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4500a5e20 msgr2=0x7ff4500ab7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:35.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff44fe00700 1 --2- 172.21.15.49:0/1661911770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4500a5e20 0x7ff4500ab7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:35.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff44fe00700 1 -- 172.21.15.49:0/1661911770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff448009ae0 con 0x7ff450068370 2024-01-22T05:19:35.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff454c00700 1 --2- 172.21.15.49:0/1661911770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450155970 0x7ff450167850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:35.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff44fe00700 1 --2- 172.21.15.49:0/1661911770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff450068370 0x7ff4500ab2f0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7ff44000e900 tx=0x7ff440009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:35.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff447400700 1 -- 172.21.15.49:0/1661911770 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440012600 con 0x7ff450068370 2024-01-22T05:19:35.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff447400700 1 -- 172.21.15.49:0/1661911770 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff440012760 con 0x7ff450068370 2024-01-22T05:19:35.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff456c00700 1 -- 172.21.15.49:0/1661911770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45016ba00 con 0x7ff450068370 2024-01-22T05:19:35.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff447400700 1 -- 172.21.15.49:0/1661911770 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440012ae0 con 0x7ff450068370 2024-01-22T05:19:35.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.828+0000 7ff456c00700 1 -- 172.21.15.49:0/1661911770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45016bfc0 con 0x7ff450068370 2024-01-22T05:19:35.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.832+0000 7ff456c00700 1 -- 172.21.15.49:0/1661911770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4500649a0 con 0x7ff450068370 2024-01-22T05:19:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.832+0000 7ff447400700 1 -- 172.21.15.49:0/1661911770 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff44001b400 con 0x7ff450068370 2024-01-22T05:19:35.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.832+0000 7ff447400700 1 --2- 172.21.15.49:0/1661911770 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff42805a4e0 0x7ff42805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:35.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.832+0000 7ff447400700 1 -- 172.21.15.49:0/1661911770 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5622+0+0 (secure 0 0 0) 0x7ff440074940 con 0x7ff450068370 2024-01-22T05:19:35.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.832+0000 7ff44f400700 1 --2- 172.21.15.49:0/1661911770 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff42805a4e0 0x7ff42805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:35.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.836+0000 7ff44f400700 1 --2- 172.21.15.49:0/1661911770 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff42805a4e0 0x7ff42805c9a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7ff4501517b0 tx=0x7ff438007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:35.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:35.840+0000 7ff447400700 1 -- 172.21.15.49:0/1661911770 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff4400482b0 con 0x7ff450068370 2024-01-22T05:19:36.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.012+0000 7ff456c00700 1 -- 172.21.15.49:0/1661911770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff450068a30 con 0x7ff450068370 2024-01-22T05:19:36.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.012+0000 7ff447400700 1 -- 172.21.15.49:0/1661911770 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v193) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff440016070 con 0x7ff450068370 2024-01-22T05:19:36.012 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:19:36.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.016+0000 7ff456c00700 1 -- 172.21.15.49:0/1661911770 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff42805a4e0 msgr2=0x7ff42805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.016+0000 7ff456c00700 1 --2- 172.21.15.49:0/1661911770 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff42805a4e0 0x7ff42805c9a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7ff4501517b0 tx=0x7ff438007d40).stop 2024-01-22T05:19:36.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.016+0000 7ff456c00700 1 -- 172.21.15.49:0/1661911770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff450068370 msgr2=0x7ff4500ab2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.016+0000 7ff456c00700 1 --2- 172.21.15.49:0/1661911770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff450068370 0x7ff4500ab2f0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7ff44000e900 tx=0x7ff440009060).stop 2024-01-22T05:19:36.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.016+0000 7ff456c00700 1 -- 172.21.15.49:0/1661911770 shutdown_connections 2024-01-22T05:19:36.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.016+0000 7ff456c00700 1 --2- 172.21.15.49:0/1661911770 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff42805a4e0 0x7ff42805c9a0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.016+0000 7ff456c00700 1 --2- 172.21.15.49:0/1661911770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450155970 0x7ff450167850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.016+0000 7ff456c00700 1 --2- 172.21.15.49:0/1661911770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4500a5e20 0x7ff4500ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.016+0000 7ff456c00700 1 --2- 172.21.15.49:0/1661911770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff450068370 0x7ff4500ab2f0 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.016+0000 7ff456c00700 1 -- 172.21.15.49:0/1661911770 >> 172.21.15.49:0/1661911770 conn(0x7ff4500c3ef0 msgr2=0x7ff450151ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:36.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.016+0000 7ff456c00700 1 -- 172.21.15.49:0/1661911770 shutdown_connections 2024-01-22T05:19:36.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.016+0000 7ff456c00700 1 -- 172.21.15.49:0/1661911770 wait complete. 2024-01-22T05:19:36.038 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:19:36.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.200+0000 7ff44fe00700 1 Processor -- start 2024-01-22T05:19:36.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.200+0000 7ff44fe00700 1 -- start start 2024-01-22T05:19:36.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.200+0000 7ff44fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff4500a8ef0 0x7ff450151a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.200+0000 7ff44fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450151f30 0x7ff4501523a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.200+0000 7ff44fe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4500659a0 con 0x7ff450067a90 2024-01-22T05:19:36.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.200+0000 7ff44fe00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff450152930 con 0x7ff4500a8ef0 2024-01-22T05:19:36.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.200+0000 7ff44fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff450152c10 con 0x7ff450151f30 2024-01-22T05:19:36.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.200+0000 7ff44e000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff4500a8ef0 0x7ff450151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.200+0000 7ff44e000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff4500a8ef0 0x7ff450151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37260/0 (socket says 172.21.15.49:37260) 2024-01-22T05:19:36.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.200+0000 7ff44f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450151f30 0x7ff4501523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.200+0000 7ff44e000700 1 -- 172.21.15.49:0/3669355705 learned_addr learned my addr 172.21.15.49:0/3669355705 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:36.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44d600700 1 -- 172.21.15.49:0/3669355705 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280544049 0 0) 0x7ff4500659a0 con 0x7ff450067a90 2024-01-22T05:19:36.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44d600700 1 -- 172.21.15.49:0/3669355705 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4300033f0 con 0x7ff450067a90 2024-01-22T05:19:36.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44e000700 1 -- 172.21.15.49:0/3669355705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450151f30 msgr2=0x7ff4501523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:36.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44e000700 1 --2- 172.21.15.49:0/3669355705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450151f30 0x7ff4501523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44e000700 1 -- 172.21.15.49:0/3669355705 >> v1:172.21.15.110:6789/0 conn(0x7ff450067a90 legacy=0x7ff4500a87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44e000700 1 -- 172.21.15.49:0/3669355705 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff450065630 con 0x7ff4500a8ef0 2024-01-22T05:19:36.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44f400700 1 --2- 172.21.15.49:0/3669355705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450151f30 0x7ff4501523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:36.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44e000700 1 --2- 172.21.15.49:0/3669355705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4500a8ef0 0x7ff450151a40 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7ff438006fd0 tx=0x7ff4380090f0).ready entity=mon.0 client_cookie=2acdc334aa5ef9e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:36.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44d600700 1 -- 172.21.15.49:0/3669355705 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800f510 con 0x7ff4500a8ef0 2024-01-22T05:19:36.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44d600700 1 -- 172.21.15.49:0/3669355705 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43800f670 con 0x7ff4500a8ef0 2024-01-22T05:19:36.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44d600700 1 -- 172.21.15.49:0/3669355705 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800f9f0 con 0x7ff4500a8ef0 2024-01-22T05:19:36.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44fe00700 1 -- 172.21.15.49:0/3669355705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4500a8ef0 msgr2=0x7ff450151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44fe00700 1 --2- 172.21.15.49:0/3669355705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4500a8ef0 0x7ff450151a40 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7ff438006fd0 tx=0x7ff4380090f0).stop 2024-01-22T05:19:36.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44fe00700 1 -- 172.21.15.49:0/3669355705 shutdown_connections 2024-01-22T05:19:36.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44fe00700 1 --2- 172.21.15.49:0/3669355705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff450151f30 0x7ff4501523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44fe00700 1 --2- 172.21.15.49:0/3669355705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4500a8ef0 0x7ff450151a40 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44fe00700 1 -- 172.21.15.49:0/3669355705 >> 172.21.15.49:0/3669355705 conn(0x7ff4500c6fc0 msgr2=0x7ff4500c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:36.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44fe00700 1 -- 172.21.15.49:0/3669355705 shutdown_connections 2024-01-22T05:19:36.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.204+0000 7ff44fe00700 1 -- 172.21.15.49:0/3669355705 wait complete. 2024-01-22T05:19:36.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.208+0000 7ff44fe00700 1 Processor -- start 2024-01-22T05:19:36.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.208+0000 7ff44fe00700 1 -- start start 2024-01-22T05:19:36.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.208+0000 7ff44fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff450067a90 0x7ff45013d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.208+0000 7ff44fe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4500a8ef0 0x7ff4501502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.208+0000 7ff44fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff450151f30 0x7ff450150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.208+0000 7ff44fe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45013dd00 con 0x7ff450151f30 2024-01-22T05:19:36.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.208+0000 7ff44fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff450151310 con 0x7ff450067a90 2024-01-22T05:19:36.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.208+0000 7ff44fe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff450153c00 con 0x7ff4500a8ef0 2024-01-22T05:19:36.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff44f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff450151f30 0x7ff450150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff44f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff450151f30 0x7ff450150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37274/0 (socket says 172.21.15.49:37274) 2024-01-22T05:19:36.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff44f400700 1 -- 172.21.15.49:0/935166951 learned_addr learned my addr 172.21.15.49:0/935166951 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:36.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff44e000700 1 --2- 172.21.15.49:0/935166951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4500a8ef0 0x7ff4501502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff44ea00700 1 --2- 172.21.15.49:0/935166951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff450067a90 0x7ff45013d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff44f400700 1 -- 172.21.15.49:0/935166951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4500a8ef0 msgr2=0x7ff4501502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff44f400700 1 --2- 172.21.15.49:0/935166951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4500a8ef0 0x7ff4501502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff44f400700 1 -- 172.21.15.49:0/935166951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff450067a90 msgr2=0x7ff45013d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff44f400700 1 --2- 172.21.15.49:0/935166951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff450067a90 0x7ff45013d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff44f400700 1 -- 172.21.15.49:0/935166951 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff448009a20 con 0x7ff450151f30 2024-01-22T05:19:36.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff44f400700 1 --2- 172.21.15.49:0/935166951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff450151f30 0x7ff450150790 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 rx=0x7ff448009f20 tx=0x7ff44800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:36.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff446000700 1 -- 172.21.15.49:0/935166951 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44800cc80 con 0x7ff450151f30 2024-01-22T05:19:36.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff446000700 1 -- 172.21.15.49:0/935166951 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44800f040 con 0x7ff450151f30 2024-01-22T05:19:36.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff44fe00700 1 -- 172.21.15.49:0/935166951 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff438009370 con 0x7ff450151f30 2024-01-22T05:19:36.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff446000700 1 -- 172.21.15.49:0/935166951 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448013400 con 0x7ff450151f30 2024-01-22T05:19:36.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff44fe00700 1 -- 172.21.15.49:0/935166951 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4501535b0 con 0x7ff450151f30 2024-01-22T05:19:36.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.212+0000 7ff44fe00700 1 -- 172.21.15.49:0/935166951 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff450153d70 con 0x7ff450151f30 2024-01-22T05:19:36.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.216+0000 7ff446000700 1 -- 172.21.15.49:0/935166951 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff4480137b0 con 0x7ff450151f30 2024-01-22T05:19:36.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.216+0000 7ff446000700 1 --2- 172.21.15.49:0/935166951 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff42805a4e0 0x7ff42805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.216+0000 7ff446000700 1 -- 172.21.15.49:0/935166951 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5622+0+0 (secure 0 0 0) 0x7ff448074f80 con 0x7ff450151f30 2024-01-22T05:19:36.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.216+0000 7ff44ea00700 1 --2- 172.21.15.49:0/935166951 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff42805a4e0 0x7ff42805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.216+0000 7ff44ea00700 1 --2- 172.21.15.49:0/935166951 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff42805a4e0 0x7ff42805c9a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7ff440003730 tx=0x7ff440009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:36.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.224+0000 7ff446000700 1 -- 172.21.15.49:0/935166951 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff4480a3b00 con 0x7ff450151f30 2024-01-22T05:19:36.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.388+0000 7ff44fe00700 1 -- 172.21.15.49:0/935166951 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff450047060 con 0x7ff450151f30 2024-01-22T05:19:36.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.388+0000 7ff446000700 1 -- 172.21.15.49:0/935166951 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v193) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff448048950 con 0x7ff450151f30 2024-01-22T05:19:36.388 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:19:36.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.392+0000 7ff44fe00700 1 -- 172.21.15.49:0/935166951 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff42805a4e0 msgr2=0x7ff42805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.392+0000 7ff44fe00700 1 --2- 172.21.15.49:0/935166951 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff42805a4e0 0x7ff42805c9a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7ff440003730 tx=0x7ff440009040).stop 2024-01-22T05:19:36.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.392+0000 7ff44fe00700 1 -- 172.21.15.49:0/935166951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff450151f30 msgr2=0x7ff450150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.392+0000 7ff44fe00700 1 --2- 172.21.15.49:0/935166951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff450151f30 0x7ff450150790 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 rx=0x7ff448009f20 tx=0x7ff44800b040).stop 2024-01-22T05:19:36.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.392+0000 7ff44fe00700 1 -- 172.21.15.49:0/935166951 shutdown_connections 2024-01-22T05:19:36.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.392+0000 7ff44fe00700 1 --2- 172.21.15.49:0/935166951 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff42805a4e0 0x7ff42805c9a0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.392+0000 7ff44fe00700 1 --2- 172.21.15.49:0/935166951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff450151f30 0x7ff450150790 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.392+0000 7ff44fe00700 1 --2- 172.21.15.49:0/935166951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4500a8ef0 0x7ff4501502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.392+0000 7ff44fe00700 1 --2- 172.21.15.49:0/935166951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff450067a90 0x7ff45013d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.392+0000 7ff44fe00700 1 -- 172.21.15.49:0/935166951 >> 172.21.15.49:0/935166951 conn(0x7ff4500c6fc0 msgr2=0x7ff4500bb490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:36.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.392+0000 7ff44fe00700 1 -- 172.21.15.49:0/935166951 shutdown_connections 2024-01-22T05:19:36.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.392+0000 7ff44fe00700 1 -- 172.21.15.49:0/935166951 wait complete. 2024-01-22T05:19:36.415 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:19:36.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.584+0000 7f839de00700 1 Processor -- start 2024-01-22T05:19:36.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.584+0000 7f839de00700 1 -- start start 2024-01-22T05:19:36.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f839de00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f83980644f0 0x7f8398064950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f839de00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83980bcc80 0x7f83980bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f839de00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83980c2700 con 0x7f8398065660 2024-01-22T05:19:36.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f839de00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83980a7650 con 0x7f83980644f0 2024-01-22T05:19:36.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f839de00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8398064e40 con 0x7f83980bcc80 2024-01-22T05:19:36.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f8396a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8398065660 0x7f83980a6f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45994/0 (socket says 172.21.15.49:45994) 2024-01-22T05:19:36.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f8396a00700 1 -- 172.21.15.49:0/3107276976 learned_addr learned my addr 172.21.15.49:0/3107276976 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:36.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f8396000700 1 --2- 172.21.15.49:0/3107276976 >> v2:172.21.15.49:3300/0 conn(0x7f83980644f0 0x7f8398064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f8397e00700 1 --2- 172.21.15.49:0/3107276976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83980bcc80 0x7f83980bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f8395600700 1 -- 172.21.15.49:0/3107276976 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349425411 0 0) 0x7f83980c2700 con 0x7f8398065660 2024-01-22T05:19:36.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f8395600700 1 -- 172.21.15.49:0/3107276976 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83780033f0 con 0x7f8398065660 2024-01-22T05:19:36.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f8397e00700 1 -- 172.21.15.49:0/3107276976 >> v2:172.21.15.49:3300/0 conn(0x7f83980644f0 msgr2=0x7f8398064950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:36.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f8397e00700 1 --2- 172.21.15.49:0/3107276976 >> v2:172.21.15.49:3300/0 conn(0x7f83980644f0 0x7f8398064950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f8397e00700 1 -- 172.21.15.49:0/3107276976 >> v1:172.21.15.49:6789/0 conn(0x7f8398065660 legacy=0x7f83980a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f8397e00700 1 -- 172.21.15.49:0/3107276976 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83980c2930 con 0x7f83980bcc80 2024-01-22T05:19:36.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f8397e00700 1 --2- 172.21.15.49:0/3107276976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83980bcc80 0x7f83980bd110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f8390009e60 tx=0x7f8390009780).ready entity=mon.2 client_cookie=f9e57f972ca53ac3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:36.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f8395600700 1 -- 172.21.15.49:0/3107276976 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839000e070 con 0x7f83980bcc80 2024-01-22T05:19:36.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f8395600700 1 -- 172.21.15.49:0/3107276976 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839000bab0 con 0x7f83980bcc80 2024-01-22T05:19:36.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.588+0000 7f8395600700 1 -- 172.21.15.49:0/3107276976 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839000be30 con 0x7f83980bcc80 2024-01-22T05:19:36.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.592+0000 7f839de00700 1 -- 172.21.15.49:0/3107276976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83980bcc80 msgr2=0x7f83980bd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.592+0000 7f839de00700 1 --2- 172.21.15.49:0/3107276976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83980bcc80 0x7f83980bd110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f8390009e60 tx=0x7f8390009780).stop 2024-01-22T05:19:36.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.592+0000 7f839de00700 1 -- 172.21.15.49:0/3107276976 shutdown_connections 2024-01-22T05:19:36.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.592+0000 7f839de00700 1 --2- 172.21.15.49:0/3107276976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83980bcc80 0x7f83980bd110 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.592+0000 7f839de00700 1 --2- 172.21.15.49:0/3107276976 >> v2:172.21.15.49:3300/0 conn(0x7f83980644f0 0x7f8398064950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.592+0000 7f839de00700 1 -- 172.21.15.49:0/3107276976 >> 172.21.15.49:0/3107276976 conn(0x7f83980c87f0 msgr2=0x7f83980c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:36.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.592+0000 7f839de00700 1 -- 172.21.15.49:0/3107276976 shutdown_connections 2024-01-22T05:19:36.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.592+0000 7f839de00700 1 -- 172.21.15.49:0/3107276976 wait complete. 2024-01-22T05:19:36.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.596+0000 7f839de00700 1 Processor -- start 2024-01-22T05:19:36.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.596+0000 7f839de00700 1 -- start start 2024-01-22T05:19:36.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.596+0000 7f839de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83980644f0 0x7f8398163900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.596+0000 7f839de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8398065660 0x7f8398167580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.596+0000 7f839de00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83980bcc80 0x7f8398167a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.596+0000 7f839de00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8398167f60 con 0x7f83980644f0 2024-01-22T05:19:36.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.596+0000 7f839de00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8398163df0 con 0x7f8398065660 2024-01-22T05:19:36.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.596+0000 7f839de00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83980ad1c0 con 0x7f83980bcc80 2024-01-22T05:19:36.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f8396a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83980644f0 0x7f8398163900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f8396a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83980644f0 0x7f8398163900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37294/0 (socket says 172.21.15.49:37294) 2024-01-22T05:19:36.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f8396a00700 1 -- 172.21.15.49:0/2193040417 learned_addr learned my addr 172.21.15.49:0/2193040417 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:36.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f8396000700 1 --2- 172.21.15.49:0/2193040417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8398065660 0x7f8398167580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f8397e00700 1 --2- 172.21.15.49:0/2193040417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83980bcc80 0x7f8398167a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f8396a00700 1 -- 172.21.15.49:0/2193040417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83980bcc80 msgr2=0x7f8398167a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f8396a00700 1 --2- 172.21.15.49:0/2193040417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83980bcc80 0x7f8398167a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f8396a00700 1 -- 172.21.15.49:0/2193040417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8398065660 msgr2=0x7f8398167580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f8396a00700 1 --2- 172.21.15.49:0/2193040417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8398065660 0x7f8398167580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f8396a00700 1 -- 172.21.15.49:0/2193040417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8390009a20 con 0x7f83980644f0 2024-01-22T05:19:36.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f8397e00700 1 --2- 172.21.15.49:0/2193040417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83980bcc80 0x7f8398167a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:36.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f8396a00700 1 --2- 172.21.15.49:0/2193040417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83980644f0 0x7f8398163900 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 rx=0x7f838800c590 tx=0x7f8388007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:36.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f838e000700 1 -- 172.21.15.49:0/2193040417 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83880072e0 con 0x7f83980644f0 2024-01-22T05:19:36.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f838e000700 1 -- 172.21.15.49:0/2193040417 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8388007440 con 0x7f83980644f0 2024-01-22T05:19:36.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f838e000700 1 -- 172.21.15.49:0/2193040417 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83880057a0 con 0x7f83980644f0 2024-01-22T05:19:36.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f839de00700 1 -- 172.21.15.49:0/2193040417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83980ad4a0 con 0x7f83980644f0 2024-01-22T05:19:36.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.600+0000 7f839de00700 1 -- 172.21.15.49:0/2193040417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83980ada60 con 0x7f83980644f0 2024-01-22T05:19:36.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.604+0000 7f839de00700 1 -- 172.21.15.49:0/2193040417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83980a7790 con 0x7f83980644f0 2024-01-22T05:19:36.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.604+0000 7f838e000700 1 -- 172.21.15.49:0/2193040417 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8388005bd0 con 0x7f83980644f0 2024-01-22T05:19:36.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.604+0000 7f838e000700 1 --2- 172.21.15.49:0/2193040417 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f837005a510 0x7f837005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.604+0000 7f838e000700 1 -- 172.21.15.49:0/2193040417 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f8388073e10 con 0x7f83980644f0 2024-01-22T05:19:36.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.604+0000 7f8396000700 1 --2- 172.21.15.49:0/2193040417 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f837005a510 0x7f837005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.608+0000 7f8396000700 1 --2- 172.21.15.49:0/2193040417 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f837005a510 0x7f837005c9d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f83980c1a00 tx=0x7f8380009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:36.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.612+0000 7f838e000700 1 -- 172.21.15.49:0/2193040417 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f83980a7790 con 0x7f83980644f0 2024-01-22T05:19:36.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.780+0000 7f839de00700 1 -- 172.21.15.49:0/2193040417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f83980a7790 con 0x7f83980644f0 2024-01-22T05:19:36.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.784+0000 7f838e000700 1 -- 172.21.15.49:0/2193040417 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v193) v1 ==== 84+0+143 (secure 0 0 0) 0x7f83880477e0 con 0x7f83980644f0 2024-01-22T05:19:36.783 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:36.783 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-22T05:19:36.783 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:36.783 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-01-22T05:19:36.784 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "device_health_metrics" 2024-01-22T05:19:36.784 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-22T05:19:36.784 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-22T05:19:36.784 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2024-01-22T05:19:36.784 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2024-01-22T05:19:36.784 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:36.784 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-22T05:19:36.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.784+0000 7f839de00700 1 -- 172.21.15.49:0/2193040417 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f837005a510 msgr2=0x7f837005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.784+0000 7f839de00700 1 --2- 172.21.15.49:0/2193040417 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f837005a510 0x7f837005c9d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f83980c1a00 tx=0x7f8380009060).stop 2024-01-22T05:19:36.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.784+0000 7f839de00700 1 -- 172.21.15.49:0/2193040417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83980644f0 msgr2=0x7f8398163900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.784+0000 7f839de00700 1 --2- 172.21.15.49:0/2193040417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83980644f0 0x7f8398163900 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 rx=0x7f838800c590 tx=0x7f8388007c80).stop 2024-01-22T05:19:36.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.784+0000 7f839de00700 1 -- 172.21.15.49:0/2193040417 shutdown_connections 2024-01-22T05:19:36.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.784+0000 7f839de00700 1 --2- 172.21.15.49:0/2193040417 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f837005a510 0x7f837005c9d0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.784+0000 7f839de00700 1 --2- 172.21.15.49:0/2193040417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83980bcc80 0x7f8398167a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.784+0000 7f839de00700 1 --2- 172.21.15.49:0/2193040417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8398065660 0x7f8398167580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.784+0000 7f839de00700 1 --2- 172.21.15.49:0/2193040417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83980644f0 0x7f8398163900 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.788+0000 7f839de00700 1 -- 172.21.15.49:0/2193040417 >> 172.21.15.49:0/2193040417 conn(0x7f83980c87f0 msgr2=0x7f83980634f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:36.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.788+0000 7f839de00700 1 -- 172.21.15.49:0/2193040417 shutdown_connections 2024-01-22T05:19:36.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.788+0000 7f839de00700 1 -- 172.21.15.49:0/2193040417 wait complete. 2024-01-22T05:19:36.807 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:19:36.808 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:19:36.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.968+0000 7f4cd7200700 1 Processor -- start 2024-01-22T05:19:36.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.972+0000 7f4cd7200700 1 -- start start 2024-01-22T05:19:36.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.972+0000 7f4cd7200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4cd8067a90 0x7f4cd8067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.972+0000 7f4cd7200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd8066560 con 0x7f4cd8068cb0 2024-01-22T05:19:36.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.972+0000 7f4cd7200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd8068840 con 0x7f4cd80683e0 2024-01-22T05:19:36.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.972+0000 7f4cd7200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd80bc930 con 0x7f4cd8067a90 2024-01-22T05:19:36.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.976+0000 7f4cd5400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4cd8067a90 0x7f4cd8067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.976+0000 7f4cd5e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4cd8068cb0 0x7f4cd815b3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46010/0 (socket says 172.21.15.49:46010) 2024-01-22T05:19:36.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.976+0000 7f4cd5e00700 1 -- 172.21.15.49:0/1842444014 learned_addr learned my addr 172.21.15.49:0/1842444014 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:36.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.976+0000 7f4cd5400700 1 -- 172.21.15.49:0/1842444014 >> v1:172.21.15.110:6789/0 conn(0x7f4cd80683e0 legacy=0x7f4cd80c1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.976+0000 7f4cd5400700 1 -- 172.21.15.49:0/1842444014 >> v1:172.21.15.49:6789/0 conn(0x7f4cd8068cb0 legacy=0x7f4cd815b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.976+0000 7f4cd5400700 1 -- 172.21.15.49:0/1842444014 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd8065950 con 0x7f4cd8067a90 2024-01-22T05:19:36.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.976+0000 7f4cd4a00700 1 -- 172.21.15.49:0/1842444014 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542521339 0 0) 0x7f4cd8066560 con 0x7f4cd8068cb0 2024-01-22T05:19:36.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.976+0000 7f4cd5400700 1 --2- 172.21.15.49:0/1842444014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cd8067a90 0x7f4cd8067ef0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7f4cc0009760 tx=0x7f4cc0009060).ready entity=mon.0 client_cookie=55acbc5fa854b095 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:36.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.976+0000 7f4cd4a00700 1 -- 172.21.15.49:0/1842444014 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc000b580 con 0x7f4cd8067a90 2024-01-22T05:19:36.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.976+0000 7f4cd4a00700 1 -- 172.21.15.49:0/1842444014 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc000b6e0 con 0x7f4cd8067a90 2024-01-22T05:19:36.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.976+0000 7f4cd4a00700 1 -- 172.21.15.49:0/1842444014 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc000ba60 con 0x7f4cd8067a90 2024-01-22T05:19:36.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.976+0000 7f4cd7200700 1 -- 172.21.15.49:0/1842444014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cd8067a90 msgr2=0x7f4cd8067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.976+0000 7f4cd7200700 1 --2- 172.21.15.49:0/1842444014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cd8067a90 0x7f4cd8067ef0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7f4cc0009760 tx=0x7f4cc0009060).stop 2024-01-22T05:19:36.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.980+0000 7f4cd7200700 1 -- 172.21.15.49:0/1842444014 shutdown_connections 2024-01-22T05:19:36.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.980+0000 7f4cd7200700 1 --2- 172.21.15.49:0/1842444014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cd8067a90 0x7f4cd8067ef0 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.980+0000 7f4cd7200700 1 -- 172.21.15.49:0/1842444014 >> 172.21.15.49:0/1842444014 conn(0x7f4cd80c6f70 msgr2=0x7f4cd80c2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:36.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.980+0000 7f4cd7200700 1 -- 172.21.15.49:0/1842444014 shutdown_connections 2024-01-22T05:19:36.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.980+0000 7f4cd7200700 1 -- 172.21.15.49:0/1842444014 wait complete. 2024-01-22T05:19:36.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.980+0000 7f4cd7200700 1 Processor -- start 2024-01-22T05:19:36.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.980+0000 7f4cd7200700 1 -- start start 2024-01-22T05:19:36.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd7200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cd8067a90 0x7f4cd8150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd7200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cd80683e0 0x7f4cd80a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd7200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cd8068cb0 0x7f4cd80a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd7200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd80aa2d0 con 0x7f4cd80683e0 2024-01-22T05:19:36.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd7200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd8169710 con 0x7f4cd8068cb0 2024-01-22T05:19:36.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd7200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd8168b40 con 0x7f4cd8067a90 2024-01-22T05:19:36.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cd80683e0 0x7f4cd80a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cd80683e0 0x7f4cd80a98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37310/0 (socket says 172.21.15.49:37310) 2024-01-22T05:19:36.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd5400700 1 -- 172.21.15.49:0/1150069957 learned_addr learned my addr 172.21.15.49:0/1150069957 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:36.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd5e00700 1 --2- 172.21.15.49:0/1150069957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cd8067a90 0x7f4cd8150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd6800700 1 --2- 172.21.15.49:0/1150069957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cd8068cb0 0x7f4cd80a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd5400700 1 -- 172.21.15.49:0/1150069957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cd8067a90 msgr2=0x7f4cd8150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd5400700 1 --2- 172.21.15.49:0/1150069957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cd8067a90 0x7f4cd8150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd5400700 1 -- 172.21.15.49:0/1150069957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cd8068cb0 msgr2=0x7f4cd80a9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:36.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd5400700 1 --2- 172.21.15.49:0/1150069957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cd8068cb0 0x7f4cd80a9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:36.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd5400700 1 -- 172.21.15.49:0/1150069957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc00092a0 con 0x7f4cd80683e0 2024-01-22T05:19:36.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd6800700 1 --2- 172.21.15.49:0/1150069957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cd8068cb0 0x7f4cd80a9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:36.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd5400700 1 --2- 172.21.15.49:0/1150069957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cd80683e0 0x7f4cd80a98f0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7f4cc0009eb0 tx=0x7f4cc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:36.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4ccd600700 1 -- 172.21.15.49:0/1150069957 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc000b850 con 0x7f4cd80683e0 2024-01-22T05:19:36.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4ccd600700 1 -- 172.21.15.49:0/1150069957 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc000b9b0 con 0x7f4cd80683e0 2024-01-22T05:19:36.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4ccd600700 1 -- 172.21.15.49:0/1150069957 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc001b620 con 0x7f4cd80683e0 2024-01-22T05:19:36.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd7200700 1 -- 172.21.15.49:0/1150069957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd8168de0 con 0x7f4cd80683e0 2024-01-22T05:19:36.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.984+0000 7f4cd7200700 1 -- 172.21.15.49:0/1150069957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd81693a0 con 0x7f4cd80683e0 2024-01-22T05:19:36.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.988+0000 7f4cd7200700 1 -- 172.21.15.49:0/1150069957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd805fd40 con 0x7f4cd80683e0 2024-01-22T05:19:36.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.988+0000 7f4ccd600700 1 -- 172.21.15.49:0/1150069957 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4cc001b9d0 con 0x7f4cd80683e0 2024-01-22T05:19:36.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.992+0000 7f4ccd600700 1 --2- 172.21.15.49:0/1150069957 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4cb005a510 0x7f4cb005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:36.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.992+0000 7f4ccd600700 1 -- 172.21.15.49:0/1150069957 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5622+0+0 (secure 0 0 0) 0x7f4cc0075fc0 con 0x7f4cd80683e0 2024-01-22T05:19:36.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.992+0000 7f4cd5e00700 1 --2- 172.21.15.49:0/1150069957 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4cb005a510 0x7f4cb005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:36.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.992+0000 7f4cd5e00700 1 --2- 172.21.15.49:0/1150069957 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4cb005a510 0x7f4cb005c9d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f4cc8007fd0 tx=0x7f4cc8007db0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:36.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:36.996+0000 7f4ccd600700 1 -- 172.21.15.49:0/1150069957 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4cc00498d0 con 0x7f4cd80683e0 2024-01-22T05:19:37.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:37.160+0000 7f4cd7200700 1 -- 172.21.15.49:0/1150069957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f4cd8046800 con 0x7f4cd80683e0 2024-01-22T05:19:37.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:37.820+0000 7f4ccd600700 1 -- 172.21.15.49:0/1150069957 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v194) v1 ==== 152+0+0 (secure 0 0 0) 0x7f4cc004cef0 con 0x7f4cd80683e0 2024-01-22T05:19:37.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:37.824+0000 7f4cd7200700 1 -- 172.21.15.49:0/1150069957 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4cb005a510 msgr2=0x7f4cb005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:37.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:37.824+0000 7f4cd7200700 1 --2- 172.21.15.49:0/1150069957 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4cb005a510 0x7f4cb005c9d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f4cc8007fd0 tx=0x7f4cc8007db0).stop 2024-01-22T05:19:37.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:37.824+0000 7f4cd7200700 1 -- 172.21.15.49:0/1150069957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cd80683e0 msgr2=0x7f4cd80a98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:37.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:37.824+0000 7f4cd7200700 1 --2- 172.21.15.49:0/1150069957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cd80683e0 0x7f4cd80a98f0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7f4cc0009eb0 tx=0x7f4cc0017000).stop 2024-01-22T05:19:37.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:37.828+0000 7f4cd7200700 1 -- 172.21.15.49:0/1150069957 shutdown_connections 2024-01-22T05:19:37.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:37.828+0000 7f4cd7200700 1 --2- 172.21.15.49:0/1150069957 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4cb005a510 0x7f4cb005c9d0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:37.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:37.828+0000 7f4cd7200700 1 --2- 172.21.15.49:0/1150069957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cd8068cb0 0x7f4cd80a9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:37.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:37.828+0000 7f4cd7200700 1 --2- 172.21.15.49:0/1150069957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cd80683e0 0x7f4cd80a98f0 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:37.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:37.828+0000 7f4cd7200700 1 --2- 172.21.15.49:0/1150069957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cd8067a90 0x7f4cd8150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:37.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:37.828+0000 7f4cd7200700 1 -- 172.21.15.49:0/1150069957 >> 172.21.15.49:0/1150069957 conn(0x7f4cd80c6f70 msgr2=0x7f4cd80c1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:37.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:37.832+0000 7f4cd7200700 1 -- 172.21.15.49:0/1150069957 shutdown_connections 2024-01-22T05:19:37.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:37.832+0000 7f4cd7200700 1 -- 172.21.15.49:0/1150069957 wait complete. 2024-01-22T05:19:37.836 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-01-22T05:19:37.855 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:19:38.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.028+0000 7f3053e00700 1 Processor -- start 2024-01-22T05:19:38.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.028+0000 7f3053e00700 1 -- start start 2024-01-22T05:19:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.032+0000 7f3053e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30540bc1c0 0x7f30540bc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.032+0000 7f3053e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30540c2c00 con 0x7f3054067a90 2024-01-22T05:19:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.032+0000 7f3053e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30540c3090 con 0x7f3054157f90 2024-01-22T05:19:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.032+0000 7f3053e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30540bcaf0 con 0x7f30540bc1c0 2024-01-22T05:19:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.032+0000 7f3053400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3054067a90 0x7f3054067f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46026/0 (socket says 172.21.15.49:46026) 2024-01-22T05:19:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.032+0000 7f3053400700 1 -- 172.21.15.49:0/1476928280 learned_addr learned my addr 172.21.15.49:0/1476928280 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:38.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.032+0000 7f3052000700 1 --2- 172.21.15.49:0/1476928280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30540bc1c0 0x7f30540bc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:38.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.032+0000 7f3051600700 1 -- 172.21.15.49:0/1476928280 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988567418 0 0) 0x7f30540c2c00 con 0x7f3054067a90 2024-01-22T05:19:38.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.032+0000 7f3051600700 1 -- 172.21.15.49:0/1476928280 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30340033f0 con 0x7f3054067a90 2024-01-22T05:19:38.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.032+0000 7f3051600700 1 -- 172.21.15.49:0/1476928280 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133074482 0 0) 0x7f30540c3090 con 0x7f3054157f90 2024-01-22T05:19:38.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.032+0000 7f3051600700 1 -- 172.21.15.49:0/1476928280 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30540c2c00 con 0x7f3054157f90 2024-01-22T05:19:38.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.032+0000 7f3052000700 1 -- 172.21.15.49:0/1476928280 >> v1:172.21.15.110:6789/0 conn(0x7f3054157f90 legacy=0x7f3054158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:38.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.032+0000 7f3052000700 1 -- 172.21.15.49:0/1476928280 >> v1:172.21.15.49:6789/0 conn(0x7f3054067a90 legacy=0x7f3054067f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:38.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.032+0000 7f3052000700 1 -- 172.21.15.49:0/1476928280 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30540c1d30 con 0x7f30540bc1c0 2024-01-22T05:19:38.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.032+0000 7f3052000700 1 --2- 172.21.15.49:0/1476928280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30540bc1c0 0x7f30540bc600 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f303c009790 tx=0x7f303c009060).ready entity=mon.2 client_cookie=986b8f31195fdf0d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:38.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.036+0000 7f3051600700 1 -- 172.21.15.49:0/1476928280 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c00f510 con 0x7f30540bc1c0 2024-01-22T05:19:38.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.036+0000 7f3051600700 1 -- 172.21.15.49:0/1476928280 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c00f670 con 0x7f30540bc1c0 2024-01-22T05:19:38.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.036+0000 7f3051600700 1 -- 172.21.15.49:0/1476928280 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c00f9f0 con 0x7f30540bc1c0 2024-01-22T05:19:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.036+0000 7f3053e00700 1 -- 172.21.15.49:0/1476928280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30540bc1c0 msgr2=0x7f30540bc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.036+0000 7f3053e00700 1 --2- 172.21.15.49:0/1476928280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30540bc1c0 0x7f30540bc600 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f303c009790 tx=0x7f303c009060).stop 2024-01-22T05:19:38.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.036+0000 7f3053e00700 1 -- 172.21.15.49:0/1476928280 shutdown_connections 2024-01-22T05:19:38.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.036+0000 7f3053e00700 1 --2- 172.21.15.49:0/1476928280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30540bc1c0 0x7f30540bc600 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:38.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.036+0000 7f3053e00700 1 -- 172.21.15.49:0/1476928280 >> 172.21.15.49:0/1476928280 conn(0x7f30540c3880 msgr2=0x7f30540c3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:38.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.036+0000 7f3053e00700 1 -- 172.21.15.49:0/1476928280 shutdown_connections 2024-01-22T05:19:38.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.036+0000 7f3053e00700 1 -- 172.21.15.49:0/1476928280 wait complete. 2024-01-22T05:19:38.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.040+0000 7f3053e00700 1 Processor -- start 2024-01-22T05:19:38.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.040+0000 7f3053e00700 1 -- start start 2024-01-22T05:19:38.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3053e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3054067a90 0x7f3054169390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:38.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3053e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30540bc1c0 0x7f3054155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:38.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3053e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3054157f90 0x7f30540a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:38.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3053e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305416caf0 con 0x7f3054067a90 2024-01-22T05:19:38.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3053e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3054169880 con 0x7f30540bc1c0 2024-01-22T05:19:38.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3053e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305416bee0 con 0x7f3054157f90 2024-01-22T05:19:38.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3052a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3054067a90 0x7f3054169390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:38.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3052a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3054067a90 0x7f3054169390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37326/0 (socket says 172.21.15.49:37326) 2024-01-22T05:19:38.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3052a00700 1 -- 172.21.15.49:0/3342982871 learned_addr learned my addr 172.21.15.49:0/3342982871 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:38.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3053400700 1 --2- 172.21.15.49:0/3342982871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3054157f90 0x7f30540a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:38.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3052000700 1 --2- 172.21.15.49:0/3342982871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30540bc1c0 0x7f3054155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:38.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3052a00700 1 -- 172.21.15.49:0/3342982871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3054157f90 msgr2=0x7f30540a8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:38.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3052a00700 1 --2- 172.21.15.49:0/3342982871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3054157f90 0x7f30540a8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:38.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3052a00700 1 -- 172.21.15.49:0/3342982871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30540bc1c0 msgr2=0x7f3054155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:38.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3052a00700 1 --2- 172.21.15.49:0/3342982871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30540bc1c0 0x7f3054155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:38.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3052a00700 1 -- 172.21.15.49:0/3342982871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0092a0 con 0x7f3054067a90 2024-01-22T05:19:38.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3052a00700 1 --2- 172.21.15.49:0/3342982871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3054067a90 0x7f3054169390 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7f304400c440 tx=0x7f3044007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:38.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f304a000700 1 -- 172.21.15.49:0/3342982871 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044012400 con 0x7f3054067a90 2024-01-22T05:19:38.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f304a000700 1 -- 172.21.15.49:0/3342982871 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3044012560 con 0x7f3054067a90 2024-01-22T05:19:38.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f304a000700 1 -- 172.21.15.49:0/3342982871 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044012920 con 0x7f3054067a90 2024-01-22T05:19:38.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.044+0000 7f3053e00700 1 -- 172.21.15.49:0/3342982871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305416c1c0 con 0x7f3054067a90 2024-01-22T05:19:38.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.048+0000 7f3053e00700 1 -- 172.21.15.49:0/3342982871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305416c780 con 0x7f3054067a90 2024-01-22T05:19:38.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.048+0000 7f3053e00700 1 -- 172.21.15.49:0/3342982871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3054064eb0 con 0x7f3054067a90 2024-01-22T05:19:38.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.048+0000 7f304a000700 1 -- 172.21.15.49:0/3342982871 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f304401b3b0 con 0x7f3054067a90 2024-01-22T05:19:38.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.048+0000 7f304a000700 1 --2- 172.21.15.49:0/3342982871 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f302c05a510 0x7f302c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:38.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.048+0000 7f304a000700 1 -- 172.21.15.49:0/3342982871 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5992+0+0 (secure 0 0 0) 0x7f3044073f00 con 0x7f3054067a90 2024-01-22T05:19:38.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.052+0000 7f3052000700 1 --2- 172.21.15.49:0/3342982871 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f302c05a510 0x7f302c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:38.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.052+0000 7f3052000700 1 --2- 172.21.15.49:0/3342982871 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f302c05a510 0x7f302c05c9d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f303c009fd0 tx=0x7f303c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:38.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.060+0000 7f304a000700 1 -- 172.21.15.49:0/3342982871 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3044047700 con 0x7f3054067a90 2024-01-22T05:19:38.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.228+0000 7f3053e00700 1 -- 172.21.15.49:0/3342982871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3054046800 con 0x7f3054067a90 2024-01-22T05:19:38.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.836+0000 7f304a000700 1 -- 172.21.15.49:0/3342982871 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v195) v1 ==== 170+0+0 (secure 0 0 0) 0x7f304404ad20 con 0x7f3054067a90 2024-01-22T05:19:38.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.848+0000 7f3053e00700 1 -- 172.21.15.49:0/3342982871 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f302c05a510 msgr2=0x7f302c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:38.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.848+0000 7f3053e00700 1 --2- 172.21.15.49:0/3342982871 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f302c05a510 0x7f302c05c9d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f303c009fd0 tx=0x7f303c017000).stop 2024-01-22T05:19:38.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.848+0000 7f3053e00700 1 -- 172.21.15.49:0/3342982871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3054067a90 msgr2=0x7f3054169390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:38.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.848+0000 7f3053e00700 1 --2- 172.21.15.49:0/3342982871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3054067a90 0x7f3054169390 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7f304400c440 tx=0x7f3044007c90).stop 2024-01-22T05:19:38.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.848+0000 7f3053e00700 1 -- 172.21.15.49:0/3342982871 shutdown_connections 2024-01-22T05:19:38.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.848+0000 7f3053e00700 1 --2- 172.21.15.49:0/3342982871 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f302c05a510 0x7f302c05c9d0 secure :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0x7f303c009fd0 tx=0x7f303c017000).stop 2024-01-22T05:19:38.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.848+0000 7f3053e00700 1 --2- 172.21.15.49:0/3342982871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3054157f90 0x7f30540a8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:38.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.848+0000 7f3053e00700 1 --2- 172.21.15.49:0/3342982871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30540bc1c0 0x7f3054155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:38.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.848+0000 7f3053e00700 1 --2- 172.21.15.49:0/3342982871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3054067a90 0x7f3054169390 secure :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 rx=0x7f304400c440 tx=0x7f3044007c90).stop 2024-01-22T05:19:38.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.848+0000 7f3053e00700 1 -- 172.21.15.49:0/3342982871 >> 172.21.15.49:0/3342982871 conn(0x7f30540c3880 msgr2=0x7f3054068710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:38.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.852+0000 7f3053e00700 1 -- 172.21.15.49:0/3342982871 shutdown_connections 2024-01-22T05:19:38.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:38.852+0000 7f3053e00700 1 -- 172.21.15.49:0/3342982871 wait complete. 2024-01-22T05:19:38.862 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-01-22T05:19:38.883 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:19:39.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.056+0000 7f66ac000700 1 Processor -- start 2024-01-22T05:19:39.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.056+0000 7f66ac000700 1 -- start start 2024-01-22T05:19:39.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.060+0000 7f66ac000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66a4069c70 0x7f66a40bcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.060+0000 7f66ac000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a4068bd0 con 0x7f66a4064500 2024-01-22T05:19:39.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.060+0000 7f66ac000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a4068eb0 con 0x7f66a40bd4b0 2024-01-22T05:19:39.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.060+0000 7f66ac000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a4069190 con 0x7f66a4069c70 2024-01-22T05:19:39.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.060+0000 7f66aa000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f66a4064500 0x7f66a40c1c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46036/0 (socket says 172.21.15.49:46036) 2024-01-22T05:19:39.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.060+0000 7f66a8c00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f66a40bd4b0 0x7f66a4063df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:52066/0 (socket says 172.21.15.49:52066) 2024-01-22T05:19:39.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.060+0000 7f66a8c00700 1 -- 172.21.15.49:0/1388930123 learned_addr learned my addr 172.21.15.49:0/1388930123 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:39.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.060+0000 7f66a9600700 1 --2- 172.21.15.49:0/1388930123 >> v2:172.21.15.110:3300/0 conn(0x7f66a4069c70 0x7f66a40bcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.060+0000 7f66a3e00700 1 -- 172.21.15.49:0/1388930123 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494944333 0 0) 0x7f66a4068eb0 con 0x7f66a40bd4b0 2024-01-22T05:19:39.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.060+0000 7f66a3e00700 1 -- 172.21.15.49:0/1388930123 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66840033f0 con 0x7f66a40bd4b0 2024-01-22T05:19:39.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.060+0000 7f66a3e00700 1 -- 172.21.15.49:0/1388930123 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276204524 0 0) 0x7f66a4068bd0 con 0x7f66a4064500 2024-01-22T05:19:39.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.060+0000 7f66a3e00700 1 -- 172.21.15.49:0/1388930123 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66a4068eb0 con 0x7f66a4064500 2024-01-22T05:19:39.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.060+0000 7f66a9600700 1 -- 172.21.15.49:0/1388930123 >> v1:172.21.15.110:6789/0 conn(0x7f66a40bd4b0 legacy=0x7f66a4063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.060+0000 7f66a9600700 1 -- 172.21.15.49:0/1388930123 >> v1:172.21.15.49:6789/0 conn(0x7f66a4064500 legacy=0x7f66a40c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.060+0000 7f66a9600700 1 -- 172.21.15.49:0/1388930123 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a4069470 con 0x7f66a4069c70 2024-01-22T05:19:39.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.064+0000 7f66a9600700 1 --2- 172.21.15.49:0/1388930123 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66a4069c70 0x7f66a40bcfc0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f6694009760 tx=0x7f6694009060).ready entity=mon.1 client_cookie=13b3de37bcb53a0d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:39.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.064+0000 7f66a3e00700 1 -- 172.21.15.49:0/1388930123 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400d4a0 con 0x7f66a4069c70 2024-01-22T05:19:39.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.064+0000 7f66a3e00700 1 -- 172.21.15.49:0/1388930123 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400d600 con 0x7f66a4069c70 2024-01-22T05:19:39.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.064+0000 7f66a3e00700 1 -- 172.21.15.49:0/1388930123 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400d980 con 0x7f66a4069c70 2024-01-22T05:19:39.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.064+0000 7f66ac000700 1 -- 172.21.15.49:0/1388930123 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66a4069c70 msgr2=0x7f66a40bcfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.064+0000 7f66ac000700 1 --2- 172.21.15.49:0/1388930123 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66a4069c70 0x7f66a40bcfc0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f6694009760 tx=0x7f6694009060).stop 2024-01-22T05:19:39.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.064+0000 7f66ac000700 1 -- 172.21.15.49:0/1388930123 shutdown_connections 2024-01-22T05:19:39.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.064+0000 7f66ac000700 1 --2- 172.21.15.49:0/1388930123 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66a4069c70 0x7f66a40bcfc0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.064+0000 7f66ac000700 1 -- 172.21.15.49:0/1388930123 >> 172.21.15.49:0/1388930123 conn(0x7f66a40c40f0 msgr2=0x7f66a40c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:39.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.064+0000 7f66ac000700 1 -- 172.21.15.49:0/1388930123 shutdown_connections 2024-01-22T05:19:39.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.064+0000 7f66ac000700 1 -- 172.21.15.49:0/1388930123 wait complete. 2024-01-22T05:19:39.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.068+0000 7f66ac000700 1 Processor -- start 2024-01-22T05:19:39.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.068+0000 7f66ac000700 1 -- start start 2024-01-22T05:19:39.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.068+0000 7f66ac000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66a4064500 0x7f66a4148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.068+0000 7f66ac000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66a4069c70 0x7f66a40bf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.068+0000 7f66ac000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66a40bd4b0 0x7f66a40bfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.068+0000 7f66ac000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a409fc70 con 0x7f66a40bd4b0 2024-01-22T05:19:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.068+0000 7f66ac000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a4156030 con 0x7f66a4069c70 2024-01-22T05:19:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.068+0000 7f66ac000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40c2100 con 0x7f66a4064500 2024-01-22T05:19:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66aa000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66a40bd4b0 0x7f66a40bfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66a8c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66a4069c70 0x7f66a40bf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66aa000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66a40bd4b0 0x7f66a40bfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37338/0 (socket says 172.21.15.49:37338) 2024-01-22T05:19:39.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66aa000700 1 -- 172.21.15.49:0/3879568532 learned_addr learned my addr 172.21.15.49:0/3879568532 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:39.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66a9600700 1 --2- 172.21.15.49:0/3879568532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66a4064500 0x7f66a4148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66a8c00700 1 -- 172.21.15.49:0/3879568532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66a4064500 msgr2=0x7f66a4148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66a8c00700 1 --2- 172.21.15.49:0/3879568532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66a4064500 0x7f66a4148840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66a8c00700 1 -- 172.21.15.49:0/3879568532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66a40bd4b0 msgr2=0x7f66a40bfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66a8c00700 1 --2- 172.21.15.49:0/3879568532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66a40bd4b0 0x7f66a40bfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66a8c00700 1 -- 172.21.15.49:0/3879568532 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66940092a0 con 0x7f66a4069c70 2024-01-22T05:19:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66a8c00700 1 --2- 172.21.15.49:0/3879568532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66a4069c70 0x7f66a40bf6c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f668c00c3f0 tx=0x7f668c007bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66a0c00700 1 -- 172.21.15.49:0/3879568532 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c0070d0 con 0x7f66a4069c70 2024-01-22T05:19:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66a0c00700 1 -- 172.21.15.49:0/3879568532 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c007230 con 0x7f66a4069c70 2024-01-22T05:19:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66a0c00700 1 -- 172.21.15.49:0/3879568532 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c0075d0 con 0x7f66a4069c70 2024-01-22T05:19:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66ac000700 1 -- 172.21.15.49:0/3879568532 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a409f620 con 0x7f66a4069c70 2024-01-22T05:19:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.072+0000 7f66ac000700 1 -- 172.21.15.49:0/3879568532 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a4148d30 con 0x7f66a4069c70 2024-01-22T05:19:39.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.076+0000 7f66ac000700 1 -- 172.21.15.49:0/3879568532 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a4067220 con 0x7f66a4069c70 2024-01-22T05:19:39.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.076+0000 7f66a0c00700 1 -- 172.21.15.49:0/3879568532 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f668c0059b0 con 0x7f66a4069c70 2024-01-22T05:19:39.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.076+0000 7f66a0c00700 1 --2- 172.21.15.49:0/3879568532 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f667c05a510 0x7f667c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.076+0000 7f66a0c00700 1 -- 172.21.15.49:0/3879568532 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f668c073f20 con 0x7f66a4069c70 2024-01-22T05:19:39.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.076+0000 7f66a9600700 1 --2- 172.21.15.49:0/3879568532 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f667c05a510 0x7f667c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.076+0000 7f66a9600700 1 --2- 172.21.15.49:0/3879568532 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f667c05a510 0x7f667c05c9d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f6694006d60 tx=0x7f6694016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:39.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.084+0000 7f66a0c00700 1 -- 172.21.15.49:0/3879568532 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f66a4067220 con 0x7f66a4069c70 2024-01-22T05:19:39.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.292+0000 7f66ac000700 1 -- 172.21.15.49:0/3879568532 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f66a4069990 con 0x7f66a4069c70 2024-01-22T05:19:39.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.308+0000 7f66a0c00700 1 -- 172.21.15.49:0/3879568532 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 28 and data pool 29 v147) v1 ==== 174+0+0 (secure 0 0 0) 0x7f66a4069990 con 0x7f66a4069c70 2024-01-22T05:19:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.316+0000 7f66ac000700 1 -- 172.21.15.49:0/3879568532 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f667c05a510 msgr2=0x7f667c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.316+0000 7f66ac000700 1 --2- 172.21.15.49:0/3879568532 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f667c05a510 0x7f667c05c9d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f6694006d60 tx=0x7f6694016000).stop 2024-01-22T05:19:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.316+0000 7f66ac000700 1 -- 172.21.15.49:0/3879568532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66a4069c70 msgr2=0x7f66a40bf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.316+0000 7f66ac000700 1 --2- 172.21.15.49:0/3879568532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66a4069c70 0x7f66a40bf6c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f668c00c3f0 tx=0x7f668c007bf0).stop 2024-01-22T05:19:39.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.320+0000 7f66ac000700 1 -- 172.21.15.49:0/3879568532 shutdown_connections 2024-01-22T05:19:39.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.320+0000 7f66ac000700 1 --2- 172.21.15.49:0/3879568532 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f667c05a510 0x7f667c05c9d0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.320+0000 7f66ac000700 1 --2- 172.21.15.49:0/3879568532 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66a40bd4b0 0x7f66a40bfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.320+0000 7f66ac000700 1 --2- 172.21.15.49:0/3879568532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66a4069c70 0x7f66a40bf6c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.320+0000 7f66ac000700 1 --2- 172.21.15.49:0/3879568532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66a4064500 0x7f66a4148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.320+0000 7f66ac000700 1 -- 172.21.15.49:0/3879568532 >> 172.21.15.49:0/3879568532 conn(0x7f66a40c40f0 msgr2=0x7f66a40ab690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:39.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.324+0000 7f66ac000700 1 -- 172.21.15.49:0/3879568532 shutdown_connections 2024-01-22T05:19:39.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.324+0000 7f66ac000700 1 -- 172.21.15.49:0/3879568532 wait complete. 2024-01-22T05:19:39.335 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 28 and data pool 29 2024-01-22T05:19:39.357 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:19:39.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.520+0000 7f7541800700 1 Processor -- start 2024-01-22T05:19:39.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.520+0000 7f7541800700 1 -- start start 2024-01-22T05:19:39.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f7541800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f753c0bcfa0 0x7f753c151700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f7541800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753c068a60 con 0x7f753c151bf0 2024-01-22T05:19:39.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f7541800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753c0bd380 con 0x7f753c0abfa0 2024-01-22T05:19:39.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f7541800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753c0bb790 con 0x7f753c0bcfa0 2024-01-22T05:19:39.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f753a000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f753c151bf0 0x7f753c0ab890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46048/0 (socket says 172.21.15.49:46048) 2024-01-22T05:19:39.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f753a000700 1 -- 172.21.15.49:0/1481303045 learned_addr learned my addr 172.21.15.49:0/1481303045 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:39.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f753aa00700 1 --2- 172.21.15.49:0/1481303045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f753c0bcfa0 0x7f753c151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886445059 0 0) 0x7f753c068a60 con 0x7f753c151bf0 2024-01-22T05:19:39.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f751c0033f0 con 0x7f753c151bf0 2024-01-22T05:19:39.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500009448 0 0) 0x7f753c0bd380 con 0x7f753c0abfa0 2024-01-22T05:19:39.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f753c068a60 con 0x7f753c0abfa0 2024-01-22T05:19:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3202529627 0 0) 0x7f751c0033f0 con 0x7f753c151bf0 2024-01-22T05:19:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f753c0bcfa0 msgr2=0x7f753c151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f7539600700 1 --2- 172.21.15.49:0/1481303045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f753c0bcfa0 0x7f753c151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 >> v1:172.21.15.110:6789/0 conn(0x7f753c0abfa0 legacy=0x7f753c065550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c068460 con 0x7f753c151bf0 2024-01-22T05:19:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.524+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f7524001470 con 0x7f753c151bf0 2024-01-22T05:19:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 >> v1:172.21.15.49:6789/0 conn(0x7f753c151bf0 legacy=0x7f753c0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f7539600700 1 --2- 172.21.15.49:0/1481303045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f753c0bcfa0 0x7f751c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f7539600700 1 --2- 172.21.15.49:0/1481303045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751c003fd0 0x7f751c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f7539600700 1 --2- 172.21.15.49:0/1481303045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f751c004b80 0x7f751c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c0bb790 con 0x7f751c003fd0 2024-01-22T05:19:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c00ba10 con 0x7f751c004b80 2024-01-22T05:19:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c00bbd0 con 0x7f753c0bcfa0 2024-01-22T05:19:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f753a000700 1 --2- 172.21.15.49:0/1481303045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751c003fd0 0x7f751c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f753aa00700 1 --2- 172.21.15.49:0/1481303045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f753c0bcfa0 0x7f751c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f753b400700 1 --2- 172.21.15.49:0/1481303045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f751c004b80 0x7f751c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f753a000700 1 -- 172.21.15.49:0/1481303045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f753c0bcfa0 msgr2=0x7f751c003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:39.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f753a000700 1 --2- 172.21.15.49:0/1481303045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f753c0bcfa0 0x7f751c003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f753a000700 1 -- 172.21.15.49:0/1481303045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f751c004b80 msgr2=0x7f751c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:39.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f753a000700 1 --2- 172.21.15.49:0/1481303045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f751c004b80 0x7f751c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f753a000700 1 -- 172.21.15.49:0/1481303045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c0033f0 con 0x7f751c003fd0 2024-01-22T05:19:39.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f753a000700 1 --2- 172.21.15.49:0/1481303045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751c003fd0 0x7f751c004690 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7f752400c0e0 tx=0x7f7524001e10).ready entity=mon.0 client_cookie=d7f6e14242a592bd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:39.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400ca10 con 0x7f751c003fd0 2024-01-22T05:19:39.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752400cb70 con 0x7f751c003fd0 2024-01-22T05:19:39.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f7539600700 1 -- 172.21.15.49:0/1481303045 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240070d0 con 0x7f751c003fd0 2024-01-22T05:19:39.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f7541800700 1 -- 172.21.15.49:0/1481303045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751c003fd0 msgr2=0x7f751c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f7541800700 1 --2- 172.21.15.49:0/1481303045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f751c003fd0 0x7f751c004690 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7f752400c0e0 tx=0x7f7524001e10).stop 2024-01-22T05:19:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.528+0000 7f753b400700 1 -- 172.21.15.49:0/1481303045 reap_dead start 2024-01-22T05:19:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.532+0000 7f7541800700 1 -- 172.21.15.49:0/1481303045 shutdown_connections 2024-01-22T05:19:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.532+0000 7f7541800700 1 -- 172.21.15.49:0/1481303045 >> 172.21.15.49:0/1481303045 conn(0x7f753c0c6540 msgr2=0x7f753c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:39.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.532+0000 7f7541800700 1 -- 172.21.15.49:0/1481303045 shutdown_connections 2024-01-22T05:19:39.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.532+0000 7f7541800700 1 -- 172.21.15.49:0/1481303045 wait complete. 2024-01-22T05:19:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.532+0000 7f7541800700 1 Processor -- start 2024-01-22T05:19:39.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f7541800700 1 -- start start 2024-01-22T05:19:39.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f7541800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f751c003fd0 0x7f753c0c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f7541800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f753c165bc0 0x7f753c0c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f7541800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f753c0c38b0 0x7f753c14aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f7541800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c0c1880 con 0x7f753c165bc0 2024-01-22T05:19:39.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f7541800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c0c1b60 con 0x7f751c003fd0 2024-01-22T05:19:39.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f7541800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753c0c1e40 con 0x7f753c0c38b0 2024-01-22T05:19:39.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f753a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f753c165bc0 0x7f753c0c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f753a000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f753c165bc0 0x7f753c0c33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37364/0 (socket says 172.21.15.49:37364) 2024-01-22T05:19:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f753a000700 1 -- 172.21.15.49:0/3930117313 learned_addr learned my addr 172.21.15.49:0/3930117313 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f753aa00700 1 --2- 172.21.15.49:0/3930117313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f751c003fd0 0x7f753c0c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f753b400700 1 --2- 172.21.15.49:0/3930117313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f753c0c38b0 0x7f753c14aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f753a000700 1 -- 172.21.15.49:0/3930117313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f753c0c38b0 msgr2=0x7f753c14aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f753a000700 1 --2- 172.21.15.49:0/3930117313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f753c0c38b0 0x7f753c14aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f753a000700 1 -- 172.21.15.49:0/3930117313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f751c003fd0 msgr2=0x7f753c0c0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f753a000700 1 --2- 172.21.15.49:0/3930117313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f751c003fd0 0x7f753c0c0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.536+0000 7f753a000700 1 -- 172.21.15.49:0/3930117313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c0c2120 con 0x7f753c165bc0 2024-01-22T05:19:39.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.540+0000 7f753a000700 1 --2- 172.21.15.49:0/3930117313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f753c165bc0 0x7f753c0c33c0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 rx=0x7f752400c6d0 tx=0x7f7524015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:39.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.540+0000 7f7532000700 1 -- 172.21.15.49:0/3930117313 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524001580 con 0x7f753c165bc0 2024-01-22T05:19:39.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.540+0000 7f7532000700 1 -- 172.21.15.49:0/3930117313 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75240016e0 con 0x7f753c165bc0 2024-01-22T05:19:39.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.540+0000 7f7541800700 1 -- 172.21.15.49:0/3930117313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753c0c2400 con 0x7f753c165bc0 2024-01-22T05:19:39.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.540+0000 7f7532000700 1 -- 172.21.15.49:0/3930117313 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524004900 con 0x7f753c165bc0 2024-01-22T05:19:39.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.540+0000 7f7541800700 1 -- 172.21.15.49:0/3930117313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753c0c1610 con 0x7f753c165bc0 2024-01-22T05:19:39.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.540+0000 7f7541800700 1 -- 172.21.15.49:0/3930117313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753c047060 con 0x7f753c165bc0 2024-01-22T05:19:39.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.544+0000 7f7532000700 1 -- 172.21.15.49:0/3930117313 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7524004d30 con 0x7f753c165bc0 2024-01-22T05:19:39.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.544+0000 7f7532000700 1 --2- 172.21.15.49:0/3930117313 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f751405a540 0x7f751405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.544+0000 7f7532000700 1 -- 172.21.15.49:0/3930117313 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7524019020 con 0x7f753c165bc0 2024-01-22T05:19:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.544+0000 7f753aa00700 1 --2- 172.21.15.49:0/3930117313 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f751405a540 0x7f751405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.544+0000 7f753aa00700 1 --2- 172.21.15.49:0/3930117313 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f751405a540 0x7f751405ca00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f752c006f70 tx=0x7f752c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:39.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.552+0000 7f7532000700 1 -- 172.21.15.49:0/3930117313 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7524049000 con 0x7f753c165bc0 2024-01-22T05:19:39.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.712+0000 7f7541800700 1 -- 172.21.15.49:0/3930117313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f753c0c03f0 con 0x7f753c165bc0 2024-01-22T05:19:39.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.716+0000 7f7532000700 1 -- 172.21.15.49:0/3930117313 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+17191 (secure 0 0 0) 0x7f752404c620 con 0x7f753c165bc0 2024-01-22T05:19:39.716 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:39.716 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":196,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:19:39.297959+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:19:37.238555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-01-22T05:19:38.297767+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:19:39.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.720+0000 7f7541800700 1 -- 172.21.15.49:0/3930117313 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f751405a540 msgr2=0x7f751405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.720+0000 7f7541800700 1 --2- 172.21.15.49:0/3930117313 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f751405a540 0x7f751405ca00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f752c006f70 tx=0x7f752c009060).stop 2024-01-22T05:19:39.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.720+0000 7f7541800700 1 -- 172.21.15.49:0/3930117313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f753c165bc0 msgr2=0x7f753c0c33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.720+0000 7f7541800700 1 --2- 172.21.15.49:0/3930117313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f753c165bc0 0x7f753c0c33c0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 rx=0x7f752400c6d0 tx=0x7f7524015000).stop 2024-01-22T05:19:39.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.720+0000 7f7541800700 1 -- 172.21.15.49:0/3930117313 shutdown_connections 2024-01-22T05:19:39.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.720+0000 7f7541800700 1 --2- 172.21.15.49:0/3930117313 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f751405a540 0x7f751405ca00 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.720+0000 7f7541800700 1 --2- 172.21.15.49:0/3930117313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f753c0c38b0 0x7f753c14aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.720+0000 7f7541800700 1 --2- 172.21.15.49:0/3930117313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f753c165bc0 0x7f753c0c33c0 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.720+0000 7f7541800700 1 --2- 172.21.15.49:0/3930117313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f751c003fd0 0x7f753c0c0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.720+0000 7f7541800700 1 -- 172.21.15.49:0/3930117313 >> 172.21.15.49:0/3930117313 conn(0x7f753c0c6540 msgr2=0x7f753c14cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:39.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.720+0000 7f7541800700 1 -- 172.21.15.49:0/3930117313 shutdown_connections 2024-01-22T05:19:39.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.720+0000 7f7541800700 1 -- 172.21.15.49:0/3930117313 wait complete. 2024-01-22T05:19:39.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:19:39.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.908+0000 7f6161e00700 1 Processor -- start 2024-01-22T05:19:39.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.908+0000 7f6161e00700 1 -- start start 2024-01-22T05:19:39.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.912+0000 7f6161e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0c37d0 0x7f615c0c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.912+0000 7f6161e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c0c5880 con 0x7f615c0c5d10 2024-01-22T05:19:39.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.912+0000 7f6161e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c0bdd90 con 0x7f615c0bd650 2024-01-22T05:19:39.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.912+0000 7f6161e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0c5220 con 0x7f615c0c37d0 2024-01-22T05:19:39.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.912+0000 7f615be00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f615c0c5d10 0x7f615c0c61a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46060/0 (socket says 172.21.15.49:46060) 2024-01-22T05:19:39.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.912+0000 7f615be00700 1 -- 172.21.15.49:0/2285200385 learned_addr learned my addr 172.21.15.49:0/2285200385 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:39.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.912+0000 7f615a000700 1 --2- 172.21.15.49:0/2285200385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0c37d0 0x7f615c0c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.912+0000 7f6159600700 1 -- 172.21.15.49:0/2285200385 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586167235 0 0) 0x7f615c0c5880 con 0x7f615c0c5d10 2024-01-22T05:19:39.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.912+0000 7f6159600700 1 -- 172.21.15.49:0/2285200385 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f613c0033f0 con 0x7f615c0c5d10 2024-01-22T05:19:39.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.912+0000 7f6159600700 1 -- 172.21.15.49:0/2285200385 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992333628 0 0) 0x7f615c0bdd90 con 0x7f615c0bd650 2024-01-22T05:19:39.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.912+0000 7f6159600700 1 -- 172.21.15.49:0/2285200385 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f615c0c5880 con 0x7f615c0bd650 2024-01-22T05:19:39.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.912+0000 7f615a000700 1 -- 172.21.15.49:0/2285200385 >> v1:172.21.15.110:6789/0 conn(0x7f615c0bd650 legacy=0x7f615c1503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.912+0000 7f615a000700 1 -- 172.21.15.49:0/2285200385 >> v1:172.21.15.49:6789/0 conn(0x7f615c0c5d10 legacy=0x7f615c0c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.912+0000 7f615a000700 1 -- 172.21.15.49:0/2285200385 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c0be070 con 0x7f615c0c37d0 2024-01-22T05:19:39.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.912+0000 7f615a000700 1 --2- 172.21.15.49:0/2285200385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0c37d0 0x7f615c0c3c30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f6144009790 tx=0x7f6144009060).ready entity=mon.2 client_cookie=f429caf6f6f4dcfc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:39.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.916+0000 7f6159600700 1 -- 172.21.15.49:0/2285200385 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614400f510 con 0x7f615c0c37d0 2024-01-22T05:19:39.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.916+0000 7f6159600700 1 -- 172.21.15.49:0/2285200385 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614400f670 con 0x7f615c0c37d0 2024-01-22T05:19:39.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.916+0000 7f6159600700 1 -- 172.21.15.49:0/2285200385 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614400f9f0 con 0x7f615c0c37d0 2024-01-22T05:19:39.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.916+0000 7f6161e00700 1 -- 172.21.15.49:0/2285200385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0c37d0 msgr2=0x7f615c0c3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.916+0000 7f6161e00700 1 --2- 172.21.15.49:0/2285200385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0c37d0 0x7f615c0c3c30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f6144009790 tx=0x7f6144009060).stop 2024-01-22T05:19:39.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.916+0000 7f6161e00700 1 -- 172.21.15.49:0/2285200385 shutdown_connections 2024-01-22T05:19:39.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.916+0000 7f6161e00700 1 --2- 172.21.15.49:0/2285200385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0c37d0 0x7f615c0c3c30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.916+0000 7f6161e00700 1 -- 172.21.15.49:0/2285200385 >> 172.21.15.49:0/2285200385 conn(0x7f615c0c87f0 msgr2=0x7f615c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:39.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.916+0000 7f6161e00700 1 -- 172.21.15.49:0/2285200385 shutdown_connections 2024-01-22T05:19:39.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.916+0000 7f6161e00700 1 -- 172.21.15.49:0/2285200385 wait complete. 2024-01-22T05:19:39.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.920+0000 7f6161e00700 1 Processor -- start 2024-01-22T05:19:39.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.920+0000 7f6161e00700 1 -- start start 2024-01-22T05:19:39.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f6161e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0bd650 0x7f615c0ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f6161e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c0c37d0 0x7f615c14aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f6161e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f615c0c5d10 0x7f615c1503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f6161e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0c76b0 con 0x7f615c0c5d10 2024-01-22T05:19:39.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f6161e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c162cc0 con 0x7f615c0c37d0 2024-01-22T05:19:39.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f6161e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c1620b0 con 0x7f615c0bd650 2024-01-22T05:19:39.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f615be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f615c0c5d10 0x7f615c1503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f615aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0bd650 0x7f615c0ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f615a000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c0c37d0 0x7f615c14aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f615aa00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0bd650 0x7f615c0ad680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:48566/0 (socket says 172.21.15.49:48566) 2024-01-22T05:19:39.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f615aa00700 1 -- 172.21.15.49:0/3981561701 learned_addr learned my addr 172.21.15.49:0/3981561701 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:39.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f615aa00700 1 -- 172.21.15.49:0/3981561701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c0c37d0 msgr2=0x7f615c14aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f615aa00700 1 --2- 172.21.15.49:0/3981561701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c0c37d0 0x7f615c14aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f615aa00700 1 -- 172.21.15.49:0/3981561701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f615c0c5d10 msgr2=0x7f615c1503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:39.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f615aa00700 1 --2- 172.21.15.49:0/3981561701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f615c0c5d10 0x7f615c1503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:39.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f615aa00700 1 -- 172.21.15.49:0/3981561701 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61440092a0 con 0x7f615c0bd650 2024-01-22T05:19:39.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f615aa00700 1 --2- 172.21.15.49:0/3981561701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0bd650 0x7f615c0ad680 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f614c00c440 tx=0x7f614c007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:39.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f6152000700 1 -- 172.21.15.49:0/3981561701 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c012400 con 0x7f615c0bd650 2024-01-22T05:19:39.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f6152000700 1 -- 172.21.15.49:0/3981561701 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c012560 con 0x7f615c0bd650 2024-01-22T05:19:39.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f6161e00700 1 -- 172.21.15.49:0/3981561701 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c162390 con 0x7f615c0bd650 2024-01-22T05:19:39.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.924+0000 7f6152000700 1 -- 172.21.15.49:0/3981561701 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c012920 con 0x7f615c0bd650 2024-01-22T05:19:39.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.928+0000 7f6161e00700 1 -- 172.21.15.49:0/3981561701 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c162950 con 0x7f615c0bd650 2024-01-22T05:19:39.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.928+0000 7f6161e00700 1 -- 172.21.15.49:0/3981561701 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c047060 con 0x7f615c0bd650 2024-01-22T05:19:39.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.928+0000 7f6152000700 1 -- 172.21.15.49:0/3981561701 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f614c01b3b0 con 0x7f615c0bd650 2024-01-22T05:19:39.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.932+0000 7f6152000700 1 --2- 172.21.15.49:0/3981561701 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f613405a510 0x7f613405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:39.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.932+0000 7f6152000700 1 -- 172.21.15.49:0/3981561701 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f614c073c90 con 0x7f615c0bd650 2024-01-22T05:19:39.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.932+0000 7f615a000700 1 --2- 172.21.15.49:0/3981561701 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f613405a510 0x7f613405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:39.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.932+0000 7f615a000700 1 --2- 172.21.15.49:0/3981561701 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f613405a510 0x7f613405c9d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f6144009fd0 tx=0x7f6144017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:39.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:39.940+0000 7f6152000700 1 -- 172.21.15.49:0/3981561701 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f614c047360 con 0x7f615c0bd650 2024-01-22T05:19:40.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.104+0000 7f6161e00700 1 -- 172.21.15.49:0/3981561701 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f615c0be350 con 0x7f615c0bd650 2024-01-22T05:19:40.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.108+0000 7f6152000700 1 -- 172.21.15.49:0/3981561701 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+17191 (secure 0 0 0) 0x7f614c04a980 con 0x7f615c0bd650 2024-01-22T05:19:40.109 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:40.109 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":196,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:19:39.297959+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:19:37.238555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-01-22T05:19:38.297767+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:19:40.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.112+0000 7f6161e00700 1 -- 172.21.15.49:0/3981561701 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f613405a510 msgr2=0x7f613405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:40.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.112+0000 7f6161e00700 1 --2- 172.21.15.49:0/3981561701 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f613405a510 0x7f613405c9d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f6144009fd0 tx=0x7f6144017000).stop 2024-01-22T05:19:40.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.112+0000 7f6161e00700 1 -- 172.21.15.49:0/3981561701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0bd650 msgr2=0x7f615c0ad680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:40.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.112+0000 7f6161e00700 1 --2- 172.21.15.49:0/3981561701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0bd650 0x7f615c0ad680 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f614c00c440 tx=0x7f614c007c90).stop 2024-01-22T05:19:40.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.112+0000 7f6161e00700 1 -- 172.21.15.49:0/3981561701 shutdown_connections 2024-01-22T05:19:40.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.112+0000 7f6161e00700 1 --2- 172.21.15.49:0/3981561701 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f613405a510 0x7f613405c9d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:40.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.112+0000 7f6161e00700 1 --2- 172.21.15.49:0/3981561701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f615c0c5d10 0x7f615c1503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:40.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.112+0000 7f6161e00700 1 --2- 172.21.15.49:0/3981561701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c0c37d0 0x7f615c14aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:40.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.112+0000 7f6161e00700 1 --2- 172.21.15.49:0/3981561701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f615c0bd650 0x7f615c0ad680 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:40.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.112+0000 7f6161e00700 1 -- 172.21.15.49:0/3981561701 >> 172.21.15.49:0/3981561701 conn(0x7f615c0c87f0 msgr2=0x7f615c062510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:40.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.112+0000 7f6161e00700 1 -- 172.21.15.49:0/3981561701 shutdown_connections 2024-01-22T05:19:40.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.112+0000 7f6161e00700 1 -- 172.21.15.49:0/3981561701 wait complete. 2024-01-22T05:19:40.138 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:19:40.290 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:19:40.297 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:19:40.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.308+0000 7f7dd3200700 1 Processor -- start 2024-01-22T05:19:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.308+0000 7f7dd3200700 1 -- start start 2024-01-22T05:19:40.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.312+0000 7f7dd3200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd415c2d0 0x7f7dd4065900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:40.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.312+0000 7f7dd3200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7dd4065df0 0x7f7dd4066260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:40.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.312+0000 7f7dd3200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd4069600 con 0x7f7dd4067a90 2024-01-22T05:19:40.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.312+0000 7f7dd3200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd41561a0 con 0x7f7dd4065df0 2024-01-22T05:19:40.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.312+0000 7f7dd3200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd4068dd0 con 0x7f7dd415c2d0 2024-01-22T05:19:40.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.312+0000 7f7dd1400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd415c2d0 0x7f7dd4065900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:40.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.312+0000 7f7dd1400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd415c2d0 0x7f7dd4065900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:48576/0 (socket says 172.21.15.49:48576) 2024-01-22T05:19:40.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.312+0000 7f7dd1400700 1 -- 172.21.15.49:0/3368289490 learned_addr learned my addr 172.21.15.49:0/3368289490 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:40.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.312+0000 7f7dd2800700 1 --2- 172.21.15.49:0/3368289490 >> v2:172.21.15.49:3300/0 conn(0x7f7dd4065df0 0x7f7dd4066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:40.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.312+0000 7f7dd1400700 1 -- 172.21.15.49:0/3368289490 >> v2:172.21.15.49:3300/0 conn(0x7f7dd4065df0 msgr2=0x7f7dd4066260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:40.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.312+0000 7f7dd1400700 1 --2- 172.21.15.49:0/3368289490 >> v2:172.21.15.49:3300/0 conn(0x7f7dd4065df0 0x7f7dd4066260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:40.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.312+0000 7f7dd1400700 1 -- 172.21.15.49:0/3368289490 >> v1:172.21.15.49:6789/0 conn(0x7f7dd4067a90 legacy=0x7f7dd415bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:40.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.312+0000 7f7dd1400700 1 -- 172.21.15.49:0/3368289490 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd40a90f0 con 0x7f7dd415c2d0 2024-01-22T05:19:40.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.312+0000 7f7dd2800700 1 --2- 172.21.15.49:0/3368289490 >> v2:172.21.15.49:3300/0 conn(0x7f7dd4065df0 0x7f7dd4066260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:40.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.312+0000 7f7dd1400700 1 --2- 172.21.15.49:0/3368289490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd415c2d0 0x7f7dd4065900 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f7dbc006fd0 tx=0x7f7dbc0090f0).ready entity=mon.2 client_cookie=b5876caf45c600a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:40.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.320+0000 7f7dd0a00700 1 -- 172.21.15.49:0/3368289490 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc00b600 con 0x7f7dd415c2d0 2024-01-22T05:19:40.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.320+0000 7f7dd0a00700 1 -- 172.21.15.49:0/3368289490 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc00b760 con 0x7f7dd415c2d0 2024-01-22T05:19:40.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.320+0000 7f7dd0a00700 1 -- 172.21.15.49:0/3368289490 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc00bae0 con 0x7f7dd415c2d0 2024-01-22T05:19:40.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.320+0000 7f7dd3200700 1 -- 172.21.15.49:0/3368289490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd415c2d0 msgr2=0x7f7dd4065900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:40.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.320+0000 7f7dd3200700 1 --2- 172.21.15.49:0/3368289490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd415c2d0 0x7f7dd4065900 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f7dbc006fd0 tx=0x7f7dbc0090f0).stop 2024-01-22T05:19:40.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.320+0000 7f7dd3200700 1 -- 172.21.15.49:0/3368289490 shutdown_connections 2024-01-22T05:19:40.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.320+0000 7f7dd3200700 1 --2- 172.21.15.49:0/3368289490 >> v2:172.21.15.49:3300/0 conn(0x7f7dd4065df0 0x7f7dd4066260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:40.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.320+0000 7f7dd3200700 1 --2- 172.21.15.49:0/3368289490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd415c2d0 0x7f7dd4065900 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:40.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.320+0000 7f7dd3200700 1 -- 172.21.15.49:0/3368289490 >> 172.21.15.49:0/3368289490 conn(0x7f7dd40c6fc0 msgr2=0x7f7dd40c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:40.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.320+0000 7f7dd3200700 1 -- 172.21.15.49:0/3368289490 shutdown_connections 2024-01-22T05:19:40.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.320+0000 7f7dd3200700 1 -- 172.21.15.49:0/3368289490 wait complete. 2024-01-22T05:19:40.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd3200700 1 Processor -- start 2024-01-22T05:19:40.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd3200700 1 -- start start 2024-01-22T05:19:40.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd3200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dd4065df0 0x7f7dd4162db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:40.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd3200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd4067a90 0x7f7dd416cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:40.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd3200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd415c2d0 0x7f7dd40abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:40.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd3200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd416c790 con 0x7f7dd4065df0 2024-01-22T05:19:40.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd3200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd416c460 con 0x7f7dd415c2d0 2024-01-22T05:19:40.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd3200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40aa060 con 0x7f7dd4067a90 2024-01-22T05:19:40.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd1e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dd4065df0 0x7f7dd4162db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd1e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dd4065df0 0x7f7dd4162db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37390/0 (socket says 172.21.15.49:37390) 2024-01-22T05:19:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd1e00700 1 -- 172.21.15.49:0/103845653 learned_addr learned my addr 172.21.15.49:0/103845653 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd2800700 1 --2- 172.21.15.49:0/103845653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd415c2d0 0x7f7dd40abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd1400700 1 --2- 172.21.15.49:0/103845653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd4067a90 0x7f7dd416cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd1e00700 1 -- 172.21.15.49:0/103845653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd4067a90 msgr2=0x7f7dd416cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd1e00700 1 --2- 172.21.15.49:0/103845653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd4067a90 0x7f7dd416cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd1e00700 1 -- 172.21.15.49:0/103845653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd415c2d0 msgr2=0x7f7dd40abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd1e00700 1 --2- 172.21.15.49:0/103845653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd415c2d0 0x7f7dd40abb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.324+0000 7f7dd1e00700 1 -- 172.21.15.49:0/103845653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc009370 con 0x7f7dd4065df0 2024-01-22T05:19:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.328+0000 7f7dd1e00700 1 --2- 172.21.15.49:0/103845653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dd4065df0 0x7f7dd4162db0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 rx=0x7f7dc400c4c0 tx=0x7f7dc4007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.328+0000 7f7dc9600700 1 -- 172.21.15.49:0/103845653 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc400ce10 con 0x7f7dd4065df0 2024-01-22T05:19:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.328+0000 7f7dc9600700 1 -- 172.21.15.49:0/103845653 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc4013450 con 0x7f7dd4065df0 2024-01-22T05:19:40.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.328+0000 7f7dc9600700 1 -- 172.21.15.49:0/103845653 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40137f0 con 0x7f7dd4065df0 2024-01-22T05:19:40.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.328+0000 7f7dd3200700 1 -- 172.21.15.49:0/103845653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd40aa340 con 0x7f7dd4065df0 2024-01-22T05:19:40.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.328+0000 7f7dd3200700 1 -- 172.21.15.49:0/103845653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd40aa620 con 0x7f7dd4065df0 2024-01-22T05:19:40.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.328+0000 7f7dd3200700 1 -- 172.21.15.49:0/103845653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd4047060 con 0x7f7dd4065df0 2024-01-22T05:19:40.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.328+0000 7f7dc9600700 1 -- 172.21.15.49:0/103845653 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7dc4013ba0 con 0x7f7dd4065df0 2024-01-22T05:19:40.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.332+0000 7f7dc9600700 1 --2- 172.21.15.49:0/103845653 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7dac05a540 0x7f7dac05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:40.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.332+0000 7f7dc9600700 1 -- 172.21.15.49:0/103845653 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7dc4073fe0 con 0x7f7dd4065df0 2024-01-22T05:19:40.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.332+0000 7f7dd1400700 1 --2- 172.21.15.49:0/103845653 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7dac05a540 0x7f7dac05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:40.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.332+0000 7f7dd1400700 1 --2- 172.21.15.49:0/103845653 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7dac05a540 0x7f7dac05ca00 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f7dbc009130 tx=0x7f7dbc017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:40.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.336+0000 7f7dc9600700 1 -- 172.21.15.49:0/103845653 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7dc4047660 con 0x7f7dd4065df0 2024-01-22T05:19:40.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:40.540+0000 7f7dd3200700 1 -- 172.21.15.49:0/103845653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7dd40681c0 con 0x7f7dd4065df0 2024-01-22T05:19:41.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.328+0000 7f7dc9600700 1 -- 172.21.15.49:0/103845653 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v150) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7dc404ac80 con 0x7f7dd4065df0 2024-01-22T05:19:41.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.332+0000 7f7dd3200700 1 -- 172.21.15.49:0/103845653 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7dac05a540 msgr2=0x7f7dac05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:41.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.332+0000 7f7dd3200700 1 --2- 172.21.15.49:0/103845653 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7dac05a540 0x7f7dac05ca00 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f7dbc009130 tx=0x7f7dbc017000).stop 2024-01-22T05:19:41.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.332+0000 7f7dd3200700 1 -- 172.21.15.49:0/103845653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dd4065df0 msgr2=0x7f7dd4162db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:41.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.332+0000 7f7dd3200700 1 --2- 172.21.15.49:0/103845653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dd4065df0 0x7f7dd4162db0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 rx=0x7f7dc400c4c0 tx=0x7f7dc4007d80).stop 2024-01-22T05:19:41.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.332+0000 7f7dd3200700 1 -- 172.21.15.49:0/103845653 shutdown_connections 2024-01-22T05:19:41.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.332+0000 7f7dd3200700 1 --2- 172.21.15.49:0/103845653 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7dac05a540 0x7f7dac05ca00 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:41.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.332+0000 7f7dd3200700 1 --2- 172.21.15.49:0/103845653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd415c2d0 0x7f7dd40abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:41.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.332+0000 7f7dd3200700 1 --2- 172.21.15.49:0/103845653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd4067a90 0x7f7dd416cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:41.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.332+0000 7f7dd3200700 1 --2- 172.21.15.49:0/103845653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dd4065df0 0x7f7dd4162db0 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:41.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.332+0000 7f7dd3200700 1 -- 172.21.15.49:0/103845653 >> 172.21.15.49:0/103845653 conn(0x7f7dd40c6fc0 msgr2=0x7f7dd40bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:41.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.332+0000 7f7dd3200700 1 -- 172.21.15.49:0/103845653 shutdown_connections 2024-01-22T05:19:41.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.332+0000 7f7dd3200700 1 -- 172.21.15.49:0/103845653 wait complete. 2024-01-22T05:19:41.356 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T05:19:41.356 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:19:41.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.524+0000 7f25d7600700 1 Processor -- start 2024-01-22T05:19:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.524+0000 7f25d7600700 1 -- start start 2024-01-22T05:19:41.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25d7600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f25d00a8c20 0x7f25d00c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:41.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25d7600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25d00c1ac0 0x7f25d00bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:41.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25d7600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d0158650 con 0x7f25d00bc9c0 2024-01-22T05:19:41.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25d7600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d00c1f20 con 0x7f25d00a8c20 2024-01-22T05:19:41.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25d7600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d00bd170 con 0x7f25d00c1ac0 2024-01-22T05:19:41.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25cfe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25d00c1ac0 0x7f25d00bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25cfe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25d00c1ac0 0x7f25d00bc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:48594/0 (socket says 172.21.15.49:48594) 2024-01-22T05:19:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25cfe00700 1 -- 172.21.15.49:0/494261436 learned_addr learned my addr 172.21.15.49:0/494261436 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25d4c00700 1 --2- 172.21.15.49:0/494261436 >> v2:172.21.15.110:3300/0 conn(0x7f25d00a8c20 0x7f25d00c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25cfe00700 1 -- 172.21.15.49:0/494261436 >> v2:172.21.15.110:3300/0 conn(0x7f25d00a8c20 msgr2=0x7f25d00c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25cfe00700 1 --2- 172.21.15.49:0/494261436 >> v2:172.21.15.110:3300/0 conn(0x7f25d00a8c20 0x7f25d00c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25cfe00700 1 -- 172.21.15.49:0/494261436 >> v1:172.21.15.110:6789/0 conn(0x7f25d00bc9c0 legacy=0x7f25d0068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25cfe00700 1 -- 172.21.15.49:0/494261436 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d0067c30 con 0x7f25d00c1ac0 2024-01-22T05:19:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25d4c00700 1 --2- 172.21.15.49:0/494261436 >> v2:172.21.15.110:3300/0 conn(0x7f25d00a8c20 0x7f25d00c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25cfe00700 1 --2- 172.21.15.49:0/494261436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25d00c1ac0 0x7f25d00bc4d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f25b8009810 tx=0x7f25b8009060).ready entity=mon.2 client_cookie=329e2c3492585be5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:41.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25cf400700 1 -- 172.21.15.49:0/494261436 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8005880 con 0x7f25d00c1ac0 2024-01-22T05:19:41.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25cf400700 1 -- 172.21.15.49:0/494261436 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b80059e0 con 0x7f25d00c1ac0 2024-01-22T05:19:41.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25cf400700 1 -- 172.21.15.49:0/494261436 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8005d60 con 0x7f25d00c1ac0 2024-01-22T05:19:41.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25d7600700 1 -- 172.21.15.49:0/494261436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25d00c1ac0 msgr2=0x7f25d00bc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:41.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.528+0000 7f25d7600700 1 --2- 172.21.15.49:0/494261436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25d00c1ac0 0x7f25d00bc4d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f25b8009810 tx=0x7f25b8009060).stop 2024-01-22T05:19:41.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.532+0000 7f25d7600700 1 -- 172.21.15.49:0/494261436 shutdown_connections 2024-01-22T05:19:41.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.532+0000 7f25d7600700 1 --2- 172.21.15.49:0/494261436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25d00c1ac0 0x7f25d00bc4d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:41.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.532+0000 7f25d7600700 1 --2- 172.21.15.49:0/494261436 >> v2:172.21.15.110:3300/0 conn(0x7f25d00a8c20 0x7f25d00c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:41.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.532+0000 7f25d7600700 1 -- 172.21.15.49:0/494261436 >> 172.21.15.49:0/494261436 conn(0x7f25d0062cb0 msgr2=0x7f25d00c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:41.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.532+0000 7f25d7600700 1 -- 172.21.15.49:0/494261436 shutdown_connections 2024-01-22T05:19:41.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.532+0000 7f25d7600700 1 -- 172.21.15.49:0/494261436 wait complete. 2024-01-22T05:19:41.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.536+0000 7f25d7600700 1 Processor -- start 2024-01-22T05:19:41.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.536+0000 7f25d7600700 1 -- start start 2024-01-22T05:19:41.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.536+0000 7f25d7600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d00a8c20 0x7f25d00bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:41.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.536+0000 7f25d7600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25d00bc9c0 0x7f25d0065be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:41.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.536+0000 7f25d7600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25d00c1ac0 0x7f25d00660d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:41.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.536+0000 7f25d7600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0168580 con 0x7f25d00a8c20 2024-01-22T05:19:41.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.536+0000 7f25d7600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d00665c0 con 0x7f25d00c1ac0 2024-01-22T05:19:41.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.536+0000 7f25d7600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d014c010 con 0x7f25d00bc9c0 2024-01-22T05:19:41.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.536+0000 7f25d4c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d00a8c20 0x7f25d00bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:41.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.536+0000 7f25d4c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d00a8c20 0x7f25d00bfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37394/0 (socket says 172.21.15.49:37394) 2024-01-22T05:19:41.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.536+0000 7f25d4c00700 1 -- 172.21.15.49:0/2857321120 learned_addr learned my addr 172.21.15.49:0/2857321120 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:41.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.536+0000 7f25cfe00700 1 --2- 172.21.15.49:0/2857321120 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25d00bc9c0 0x7f25d0065be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:41.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.536+0000 7f25d5600700 1 --2- 172.21.15.49:0/2857321120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25d00c1ac0 0x7f25d00660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:41.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.540+0000 7f25d4c00700 1 -- 172.21.15.49:0/2857321120 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25d00bc9c0 msgr2=0x7f25d0065be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:41.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.540+0000 7f25d4c00700 1 --2- 172.21.15.49:0/2857321120 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25d00bc9c0 0x7f25d0065be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:41.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.540+0000 7f25d4c00700 1 -- 172.21.15.49:0/2857321120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25d00c1ac0 msgr2=0x7f25d00660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:41.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.540+0000 7f25d4c00700 1 --2- 172.21.15.49:0/2857321120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25d00c1ac0 0x7f25d00660d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:41.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.540+0000 7f25d4c00700 1 -- 172.21.15.49:0/2857321120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b8009300 con 0x7f25d00a8c20 2024-01-22T05:19:41.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.540+0000 7f25d4c00700 1 --2- 172.21.15.49:0/2857321120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d00a8c20 0x7f25d00bfef0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7f25c000d860 tx=0x7f25c0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:41.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.540+0000 7f25c7e00700 1 -- 172.21.15.49:0/2857321120 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000f520 con 0x7f25d00a8c20 2024-01-22T05:19:41.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.540+0000 7f25c7e00700 1 -- 172.21.15.49:0/2857321120 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c000f680 con 0x7f25d00a8c20 2024-01-22T05:19:41.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.540+0000 7f25d7600700 1 -- 172.21.15.49:0/2857321120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d014c2f0 con 0x7f25d00a8c20 2024-01-22T05:19:41.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.540+0000 7f25c7e00700 1 -- 172.21.15.49:0/2857321120 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000fa00 con 0x7f25d00a8c20 2024-01-22T05:19:41.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.540+0000 7f25d7600700 1 -- 172.21.15.49:0/2857321120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d014c8b0 con 0x7f25d00a8c20 2024-01-22T05:19:41.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.540+0000 7f25d7600700 1 -- 172.21.15.49:0/2857321120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d00c0c00 con 0x7f25d00a8c20 2024-01-22T05:19:41.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.544+0000 7f25c7e00700 1 -- 172.21.15.49:0/2857321120 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f25c0013480 con 0x7f25d00a8c20 2024-01-22T05:19:41.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.544+0000 7f25c7e00700 1 --2- 172.21.15.49:0/2857321120 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f25a805a510 0x7f25a805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:41.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.544+0000 7f25c7e00700 1 -- 172.21.15.49:0/2857321120 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f25c0074520 con 0x7f25d00a8c20 2024-01-22T05:19:41.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.544+0000 7f25cfe00700 1 --2- 172.21.15.49:0/2857321120 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f25a805a510 0x7f25a805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:41.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.548+0000 7f25cfe00700 1 --2- 172.21.15.49:0/2857321120 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f25a805a510 0x7f25a805c9d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f25b8009fd0 tx=0x7f25b8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:41.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.552+0000 7f25c7e00700 1 -- 172.21.15.49:0/2857321120 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f25c0047b40 con 0x7f25d00a8c20 2024-01-22T05:19:41.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:41.752+0000 7f25d7600700 1 -- 172.21.15.49:0/2857321120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f25d0067f10 con 0x7f25d00a8c20 2024-01-22T05:19:42.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.448+0000 7f25c7e00700 1 -- 172.21.15.49:0/2857321120 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v151) v1 ==== 122+0+0 (secure 0 0 0) 0x7f25c000b3f0 con 0x7f25d00a8c20 2024-01-22T05:19:42.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.452+0000 7f25d7600700 1 -- 172.21.15.49:0/2857321120 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f25a805a510 msgr2=0x7f25a805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:42.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.452+0000 7f25d7600700 1 --2- 172.21.15.49:0/2857321120 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f25a805a510 0x7f25a805c9d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f25b8009fd0 tx=0x7f25b8016000).stop 2024-01-22T05:19:42.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.452+0000 7f25d7600700 1 -- 172.21.15.49:0/2857321120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d00a8c20 msgr2=0x7f25d00bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:42.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.452+0000 7f25d7600700 1 --2- 172.21.15.49:0/2857321120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d00a8c20 0x7f25d00bfef0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7f25c000d860 tx=0x7f25c0008040).stop 2024-01-22T05:19:42.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.452+0000 7f25d7600700 1 -- 172.21.15.49:0/2857321120 shutdown_connections 2024-01-22T05:19:42.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.452+0000 7f25d7600700 1 --2- 172.21.15.49:0/2857321120 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f25a805a510 0x7f25a805c9d0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:42.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.452+0000 7f25d7600700 1 --2- 172.21.15.49:0/2857321120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25d00c1ac0 0x7f25d00660d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:42.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.452+0000 7f25d7600700 1 --2- 172.21.15.49:0/2857321120 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25d00bc9c0 0x7f25d0065be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:42.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.452+0000 7f25d7600700 1 --2- 172.21.15.49:0/2857321120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25d00a8c20 0x7f25d00bfef0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:42.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.452+0000 7f25d7600700 1 -- 172.21.15.49:0/2857321120 >> 172.21.15.49:0/2857321120 conn(0x7f25d0062cb0 msgr2=0x7f25d00c2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:42.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.452+0000 7f25d7600700 1 -- 172.21.15.49:0/2857321120 shutdown_connections 2024-01-22T05:19:42.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.452+0000 7f25d7600700 1 -- 172.21.15.49:0/2857321120 wait complete. 2024-01-22T05:19:42.479 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:19:42.479 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:19:42.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.640+0000 7fb359e00700 1 Processor -- start 2024-01-22T05:19:42.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.644+0000 7fb359e00700 1 -- start start 2024-01-22T05:19:42.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.644+0000 7fb359e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb354068aa0 0x7fb354068f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:42.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.644+0000 7fb359e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb354063340 0x7fb3540637d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:42.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.644+0000 7fb359e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb354062eb0 con 0x7fb354157e80 2024-01-22T05:19:42.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.644+0000 7fb359e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3540c2c70 con 0x7fb354063340 2024-01-22T05:19:42.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.644+0000 7fb359e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540693f0 con 0x7fb354068aa0 2024-01-22T05:19:42.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.644+0000 7fb358a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb354157e80 0x7fb3540c1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46074/0 (socket says 172.21.15.49:46074) 2024-01-22T05:19:42.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.644+0000 7fb358a00700 1 -- 172.21.15.49:0/1593409388 learned_addr learned my addr 172.21.15.49:0/1593409388 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:42.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.644+0000 7fb353e00700 1 --2- 172.21.15.49:0/1593409388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb354068aa0 0x7fb354068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:42.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.644+0000 7fb359400700 1 --2- 172.21.15.49:0/1593409388 >> v2:172.21.15.110:3300/0 conn(0x7fb354063340 0x7fb3540637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:42.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.648+0000 7fb353400700 1 -- 172.21.15.49:0/1593409388 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263987026 0 0) 0x7fb354062eb0 con 0x7fb354157e80 2024-01-22T05:19:42.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.648+0000 7fb353e00700 1 -- 172.21.15.49:0/1593409388 >> v2:172.21.15.110:3300/0 conn(0x7fb354063340 msgr2=0x7fb3540637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:42.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.648+0000 7fb353e00700 1 --2- 172.21.15.49:0/1593409388 >> v2:172.21.15.110:3300/0 conn(0x7fb354063340 0x7fb3540637d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:42.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.648+0000 7fb353e00700 1 -- 172.21.15.49:0/1593409388 >> v1:172.21.15.49:6789/0 conn(0x7fb354157e80 legacy=0x7fb3540c1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:42.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.648+0000 7fb353e00700 1 -- 172.21.15.49:0/1593409388 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354062b80 con 0x7fb354068aa0 2024-01-22T05:19:42.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.648+0000 7fb353e00700 1 --2- 172.21.15.49:0/1593409388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb354068aa0 0x7fb354068f00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fb33c009760 tx=0x7fb33c009060).ready entity=mon.2 client_cookie=695727bd8c892993 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:42.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.648+0000 7fb353400700 1 -- 172.21.15.49:0/1593409388 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c00f510 con 0x7fb354068aa0 2024-01-22T05:19:42.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.648+0000 7fb353400700 1 -- 172.21.15.49:0/1593409388 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c00f670 con 0x7fb354068aa0 2024-01-22T05:19:42.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.648+0000 7fb353400700 1 -- 172.21.15.49:0/1593409388 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c00f9f0 con 0x7fb354068aa0 2024-01-22T05:19:42.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.648+0000 7fb359e00700 1 -- 172.21.15.49:0/1593409388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb354068aa0 msgr2=0x7fb354068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:42.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.648+0000 7fb359e00700 1 --2- 172.21.15.49:0/1593409388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb354068aa0 0x7fb354068f00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fb33c009760 tx=0x7fb33c009060).stop 2024-01-22T05:19:42.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.648+0000 7fb359e00700 1 -- 172.21.15.49:0/1593409388 shutdown_connections 2024-01-22T05:19:42.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.648+0000 7fb359e00700 1 --2- 172.21.15.49:0/1593409388 >> v2:172.21.15.110:3300/0 conn(0x7fb354063340 0x7fb3540637d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:42.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.648+0000 7fb359e00700 1 --2- 172.21.15.49:0/1593409388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb354068aa0 0x7fb354068f00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:42.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.648+0000 7fb359e00700 1 -- 172.21.15.49:0/1593409388 >> 172.21.15.49:0/1593409388 conn(0x7fb3540c42c0 msgr2=0x7fb354065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:42.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.652+0000 7fb359e00700 1 -- 172.21.15.49:0/1593409388 shutdown_connections 2024-01-22T05:19:42.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.652+0000 7fb359e00700 1 -- 172.21.15.49:0/1593409388 wait complete. 2024-01-22T05:19:42.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.652+0000 7fb359e00700 1 Processor -- start 2024-01-22T05:19:42.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.652+0000 7fb359e00700 1 -- start start 2024-01-22T05:19:42.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb354063340 0x7fb354145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:42.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb354068aa0 0x7fb3540be5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:42.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb354157e80 0x7fb3540beaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:42.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540bef90 con 0x7fb354157e80 2024-01-22T05:19:42.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540bbcb0 con 0x7fb354063340 2024-01-22T05:19:42.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540bbf90 con 0x7fb354068aa0 2024-01-22T05:19:42.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb354157e80 0x7fb3540beaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:42.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb354157e80 0x7fb3540beaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37396/0 (socket says 172.21.15.49:37396) 2024-01-22T05:19:42.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359400700 1 -- 172.21.15.49:0/2690010900 learned_addr learned my addr 172.21.15.49:0/2690010900 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:42.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb358a00700 1 --2- 172.21.15.49:0/2690010900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb354063340 0x7fb354145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:42.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb353e00700 1 --2- 172.21.15.49:0/2690010900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb354068aa0 0x7fb3540be5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:42.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359400700 1 -- 172.21.15.49:0/2690010900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb354068aa0 msgr2=0x7fb3540be5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:42.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359400700 1 --2- 172.21.15.49:0/2690010900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb354068aa0 0x7fb3540be5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:42.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359400700 1 -- 172.21.15.49:0/2690010900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb354063340 msgr2=0x7fb354145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:42.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359400700 1 --2- 172.21.15.49:0/2690010900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb354063340 0x7fb354145de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:42.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359400700 1 -- 172.21.15.49:0/2690010900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c0092a0 con 0x7fb354157e80 2024-01-22T05:19:42.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359400700 1 --2- 172.21.15.49:0/2690010900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb354157e80 0x7fb3540beaa0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 rx=0x7fb34c009e90 tx=0x7fb34c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:42.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb34be00700 1 -- 172.21.15.49:0/2690010900 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c00caa0 con 0x7fb354157e80 2024-01-22T05:19:42.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb34be00700 1 -- 172.21.15.49:0/2690010900 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c00f040 con 0x7fb354157e80 2024-01-22T05:19:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359e00700 1 -- 172.21.15.49:0/2690010900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3540bc270 con 0x7fb354157e80 2024-01-22T05:19:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb34be00700 1 -- 172.21.15.49:0/2690010900 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c00ce10 con 0x7fb354157e80 2024-01-22T05:19:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.656+0000 7fb359e00700 1 -- 172.21.15.49:0/2690010900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3540bc830 con 0x7fb354157e80 2024-01-22T05:19:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.660+0000 7fb359e00700 1 -- 172.21.15.49:0/2690010900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3540bca50 con 0x7fb354157e80 2024-01-22T05:19:42.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.660+0000 7fb34be00700 1 -- 172.21.15.49:0/2690010900 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb34c013610 con 0x7fb354157e80 2024-01-22T05:19:42.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.664+0000 7fb34be00700 1 --2- 172.21.15.49:0/2690010900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb32c05a510 0x7fb32c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:42.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.664+0000 7fb34be00700 1 -- 172.21.15.49:0/2690010900 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fb34c075250 con 0x7fb354157e80 2024-01-22T05:19:42.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.664+0000 7fb358a00700 1 --2- 172.21.15.49:0/2690010900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb32c05a510 0x7fb32c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:42.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.664+0000 7fb358a00700 1 --2- 172.21.15.49:0/2690010900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb32c05a510 0x7fb32c05c9d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7fb344007fd0 tx=0x7fb344007dd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:42.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.668+0000 7fb34be00700 1 -- 172.21.15.49:0/2690010900 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb34c048810 con 0x7fb354157e80 2024-01-22T05:19:42.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.876+0000 7fb359e00700 1 -- 172.21.15.49:0/2690010900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3540c23d0 con 0x7fb354157e80 2024-01-22T05:19:42.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.876+0000 7fb34be00700 1 -- 172.21.15.49:0/2690010900 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) v1 ==== 95+0+4511 (secure 0 0 0) 0x7fb34c04be30 con 0x7fb354157e80 2024-01-22T05:19:42.877 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:42.877 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":151,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1805560931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1805560931},{"type":"v1","addr":"172.21.15.110:6833","nonce":1805560931}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3941922826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3941922826},{"type":"v1","addr":"172.21.15.110:6835","nonce":3941922826}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2796452202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2796452202},{"type":"v1","addr":"172.21.15.49:6836","nonce":2796452202}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:39.299248+0000","modified":"2024-01-22T05:19:42.441820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10476":{"gid":10476,"name":"a","rank":0,"incarnation":147,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/1585471135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1585471135},{"type":"v1","addr":"172.21.15.49:6837","nonce":1585471135}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2024-01-22T05:19:42.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.880+0000 7fb359e00700 1 -- 172.21.15.49:0/2690010900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb32c05a510 msgr2=0x7fb32c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:42.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.880+0000 7fb359e00700 1 --2- 172.21.15.49:0/2690010900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb32c05a510 0x7fb32c05c9d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7fb344007fd0 tx=0x7fb344007dd0).stop 2024-01-22T05:19:42.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.880+0000 7fb359e00700 1 -- 172.21.15.49:0/2690010900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb354157e80 msgr2=0x7fb3540beaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:42.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.880+0000 7fb359e00700 1 --2- 172.21.15.49:0/2690010900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb354157e80 0x7fb3540beaa0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 rx=0x7fb34c009e90 tx=0x7fb34c00b040).stop 2024-01-22T05:19:42.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.880+0000 7fb359e00700 1 -- 172.21.15.49:0/2690010900 shutdown_connections 2024-01-22T05:19:42.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.880+0000 7fb359e00700 1 --2- 172.21.15.49:0/2690010900 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb32c05a510 0x7fb32c05c9d0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:42.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.880+0000 7fb359e00700 1 --2- 172.21.15.49:0/2690010900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb354157e80 0x7fb3540beaa0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:42.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.880+0000 7fb359e00700 1 --2- 172.21.15.49:0/2690010900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb354068aa0 0x7fb3540be5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:42.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.880+0000 7fb359e00700 1 --2- 172.21.15.49:0/2690010900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb354063340 0x7fb354145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:42.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.880+0000 7fb359e00700 1 -- 172.21.15.49:0/2690010900 >> 172.21.15.49:0/2690010900 conn(0x7fb3540c42c0 msgr2=0x7fb35415a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:42.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.880+0000 7fb359e00700 1 -- 172.21.15.49:0/2690010900 shutdown_connections 2024-01-22T05:19:42.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:42.880+0000 7fb359e00700 1 -- 172.21.15.49:0/2690010900 wait complete. 2024-01-22T05:19:42.884 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 151 2024-01-22T05:19:42.903 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:19:43.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.060+0000 7f0d2ae00700 1 Processor -- start 2024-01-22T05:19:43.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.064+0000 7f0d2ae00700 1 -- start start 2024-01-22T05:19:43.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d2ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d24155c60 0x7f0d240a6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d2ae00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0d240a7040 0x7f0d240659b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d2ae00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d24068a60 con 0x7f0d24155880 2024-01-22T05:19:43.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d2ae00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d24067e50 con 0x7f0d240a7040 2024-01-22T05:19:43.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d2ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24068130 con 0x7f0d24155c60 2024-01-22T05:19:43.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d29000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d24155c60 0x7f0d240a6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d2a400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0d240a7040 0x7f0d240659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d29000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d24155c60 0x7f0d240a6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:48636/0 (socket says 172.21.15.49:48636) 2024-01-22T05:19:43.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d29000700 1 -- 172.21.15.49:0/3541768854 learned_addr learned my addr 172.21.15.49:0/3541768854 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:43.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d29000700 1 -- 172.21.15.49:0/3541768854 >> v2:172.21.15.110:3300/0 conn(0x7f0d240a7040 msgr2=0x7f0d240659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:43.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d29000700 1 --2- 172.21.15.49:0/3541768854 >> v2:172.21.15.110:3300/0 conn(0x7f0d240a7040 0x7f0d240659b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d29000700 1 -- 172.21.15.49:0/3541768854 >> v1:172.21.15.110:6789/0 conn(0x7f0d24155880 legacy=0x7f0d240a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:43.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d29000700 1 -- 172.21.15.49:0/3541768854 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24068410 con 0x7f0d24155c60 2024-01-22T05:19:43.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d29000700 1 --2- 172.21.15.49:0/3541768854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d24155c60 0x7f0d240a6b50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f0d0c006fd0 tx=0x7f0d0c0090f0).ready entity=mon.2 client_cookie=671e024b29dabcb2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:43.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d23e00700 1 -- 172.21.15.49:0/3541768854 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c00b580 con 0x7f0d24155c60 2024-01-22T05:19:43.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d23e00700 1 -- 172.21.15.49:0/3541768854 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c00b6e0 con 0x7f0d24155c60 2024-01-22T05:19:43.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.068+0000 7f0d23e00700 1 -- 172.21.15.49:0/3541768854 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c00ba60 con 0x7f0d24155c60 2024-01-22T05:19:43.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.072+0000 7f0d2ae00700 1 -- 172.21.15.49:0/3541768854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d24155c60 msgr2=0x7f0d240a6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:43.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.072+0000 7f0d2ae00700 1 --2- 172.21.15.49:0/3541768854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d24155c60 0x7f0d240a6b50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f0d0c006fd0 tx=0x7f0d0c0090f0).stop 2024-01-22T05:19:43.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.072+0000 7f0d2ae00700 1 -- 172.21.15.49:0/3541768854 shutdown_connections 2024-01-22T05:19:43.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.072+0000 7f0d2ae00700 1 --2- 172.21.15.49:0/3541768854 >> v2:172.21.15.110:3300/0 conn(0x7f0d240a7040 0x7f0d240659b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.072+0000 7f0d2ae00700 1 --2- 172.21.15.49:0/3541768854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d24155c60 0x7f0d240a6b50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.072+0000 7f0d2ae00700 1 -- 172.21.15.49:0/3541768854 >> 172.21.15.49:0/3541768854 conn(0x7f0d240c6530 msgr2=0x7f0d240c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:43.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.072+0000 7f0d2ae00700 1 -- 172.21.15.49:0/3541768854 shutdown_connections 2024-01-22T05:19:43.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.072+0000 7f0d2ae00700 1 -- 172.21.15.49:0/3541768854 wait complete. 2024-01-22T05:19:43.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.072+0000 7f0d2ae00700 1 Processor -- start 2024-01-22T05:19:43.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2ae00700 1 -- start start 2024-01-22T05:19:43.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d240a7040 0x7f0d24154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d24155880 0x7f0d240a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2ae00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d24155c60 0x7f0d240a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2ae00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240a4a60 con 0x7f0d24155c60 2024-01-22T05:19:43.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240a53e0 con 0x7f0d240a7040 2024-01-22T05:19:43.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240a3e50 con 0x7f0d24155880 2024-01-22T05:19:43.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2a400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d24155c60 0x7f0d240a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2a400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d24155c60 0x7f0d240a1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37400/0 (socket says 172.21.15.49:37400) 2024-01-22T05:19:43.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2a400700 1 -- 172.21.15.49:0/47590434 learned_addr learned my addr 172.21.15.49:0/47590434 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:43.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d29000700 1 --2- 172.21.15.49:0/47590434 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d24155880 0x7f0d240a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d29a00700 1 --2- 172.21.15.49:0/47590434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d240a7040 0x7f0d24154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2a400700 1 -- 172.21.15.49:0/47590434 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d24155880 msgr2=0x7f0d240a4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:43.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2a400700 1 --2- 172.21.15.49:0/47590434 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d24155880 0x7f0d240a4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2a400700 1 -- 172.21.15.49:0/47590434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d240a7040 msgr2=0x7f0d24154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:43.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2a400700 1 --2- 172.21.15.49:0/47590434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d240a7040 0x7f0d24154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2a400700 1 -- 172.21.15.49:0/47590434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c009370 con 0x7f0d24155c60 2024-01-22T05:19:43.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d29000700 1 --2- 172.21.15.49:0/47590434 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d24155880 0x7f0d240a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:43.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2a400700 1 --2- 172.21.15.49:0/47590434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d24155c60 0x7f0d240a1c70 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7f0d1c009e20 tx=0x7f0d1c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:43.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d20c00700 1 -- 172.21.15.49:0/47590434 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c00cc20 con 0x7f0d24155c60 2024-01-22T05:19:43.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d20c00700 1 -- 172.21.15.49:0/47590434 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c00f040 con 0x7f0d24155c60 2024-01-22T05:19:43.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d20c00700 1 -- 172.21.15.49:0/47590434 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c013400 con 0x7f0d24155c60 2024-01-22T05:19:43.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.076+0000 7f0d2ae00700 1 -- 172.21.15.49:0/47590434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d240a4130 con 0x7f0d24155c60 2024-01-22T05:19:43.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.080+0000 7f0d2ae00700 1 -- 172.21.15.49:0/47590434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d240a46f0 con 0x7f0d24155c60 2024-01-22T05:19:43.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.080+0000 7f0d2ae00700 1 -- 172.21.15.49:0/47590434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d240a4c10 con 0x7f0d24155c60 2024-01-22T05:19:43.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.080+0000 7f0d20c00700 1 -- 172.21.15.49:0/47590434 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0d1c0137b0 con 0x7f0d24155c60 2024-01-22T05:19:43.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.084+0000 7f0d20c00700 1 --2- 172.21.15.49:0/47590434 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0cfc05a540 0x7f0cfc05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.084+0000 7f0d20c00700 1 -- 172.21.15.49:0/47590434 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f0d1c0750f0 con 0x7f0d24155c60 2024-01-22T05:19:43.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.084+0000 7f0d29a00700 1 --2- 172.21.15.49:0/47590434 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0cfc05a540 0x7f0cfc05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.084+0000 7f0d29a00700 1 --2- 172.21.15.49:0/47590434 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0cfc05a540 0x7f0cfc05ca00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f0d140036d0 tx=0x7f0d14009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:43.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.092+0000 7f0d20c00700 1 -- 172.21.15.49:0/47590434 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0d240a4c10 con 0x7f0d24155c60 2024-01-22T05:19:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.256+0000 7f0d2ae00700 1 -- 172.21.15.49:0/47590434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d240a4c10 con 0x7f0d24155c60 2024-01-22T05:19:43.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.256+0000 7f0d20c00700 1 -- 172.21.15.49:0/47590434 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+17178 (secure 0 0 0) 0x7f0d240a4c10 con 0x7f0d24155c60 2024-01-22T05:19:43.258 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:43.258 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":197,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:19:40.305015+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:19:37.238555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-01-22T05:19:38.297767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:19:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.260+0000 7f0d2ae00700 1 -- 172.21.15.49:0/47590434 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0cfc05a540 msgr2=0x7f0cfc05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.260+0000 7f0d2ae00700 1 --2- 172.21.15.49:0/47590434 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0cfc05a540 0x7f0cfc05ca00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f0d140036d0 tx=0x7f0d14009040).stop 2024-01-22T05:19:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.260+0000 7f0d2ae00700 1 -- 172.21.15.49:0/47590434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d24155c60 msgr2=0x7f0d240a1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.260+0000 7f0d2ae00700 1 --2- 172.21.15.49:0/47590434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d24155c60 0x7f0d240a1c70 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7f0d1c009e20 tx=0x7f0d1c00b040).stop 2024-01-22T05:19:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.260+0000 7f0d2ae00700 1 -- 172.21.15.49:0/47590434 shutdown_connections 2024-01-22T05:19:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.260+0000 7f0d2ae00700 1 --2- 172.21.15.49:0/47590434 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0cfc05a540 0x7f0cfc05ca00 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.260+0000 7f0d2ae00700 1 --2- 172.21.15.49:0/47590434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d24155c60 0x7f0d240a1c70 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.260+0000 7f0d2ae00700 1 --2- 172.21.15.49:0/47590434 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d24155880 0x7f0d240a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.260+0000 7f0d2ae00700 1 --2- 172.21.15.49:0/47590434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d240a7040 0x7f0d24154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.260+0000 7f0d2ae00700 1 -- 172.21.15.49:0/47590434 >> 172.21.15.49:0/47590434 conn(0x7f0d240c6530 msgr2=0x7f0d24156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.260+0000 7f0d2ae00700 1 -- 172.21.15.49:0/47590434 shutdown_connections 2024-01-22T05:19:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.260+0000 7f0d2ae00700 1 -- 172.21.15.49:0/47590434 wait complete. 2024-01-22T05:19:43.284 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:19:43.284 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:19:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.443+0000 7fbf18e00700 1 Processor -- start 2024-01-22T05:19:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.443+0000 7fbf18e00700 1 -- start start 2024-01-22T05:19:43.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf18e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf140a9bb0 0x7fbf14064190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf18e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf140a9f90 0x7fbf14067d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf18e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf14064680 0x7fbf14068230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf18e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf14068720 con 0x7fbf14064680 2024-01-22T05:19:43.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf18e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf141523c0 con 0x7fbf140a9bb0 2024-01-22T05:19:43.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf18e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf141526a0 con 0x7fbf140a9f90 2024-01-22T05:19:43.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf12800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf14064680 0x7fbf14068230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf11e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf140a9bb0 0x7fbf14064190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf12800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf14064680 0x7fbf14068230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33848/0 (socket says 172.21.15.49:33848) 2024-01-22T05:19:43.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf12800700 1 -- 172.21.15.49:0/1107803808 learned_addr learned my addr 172.21.15.49:0/1107803808 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:43.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf11400700 1 --2- 172.21.15.49:0/1107803808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf140a9f90 0x7fbf14067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf11e00700 1 -- 172.21.15.49:0/1107803808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf140a9f90 msgr2=0x7fbf14067d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:43.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf11e00700 1 --2- 172.21.15.49:0/1107803808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf140a9f90 0x7fbf14067d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf11e00700 1 -- 172.21.15.49:0/1107803808 >> v2:172.21.15.49:3300/0 conn(0x7fbf14064680 msgr2=0x7fbf14068230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:43.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf11e00700 1 --2- 172.21.15.49:0/1107803808 >> v2:172.21.15.49:3300/0 conn(0x7fbf14064680 0x7fbf14068230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf11e00700 1 -- 172.21.15.49:0/1107803808 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf14152980 con 0x7fbf140a9bb0 2024-01-22T05:19:43.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf12800700 1 --2- 172.21.15.49:0/1107803808 >> v2:172.21.15.49:3300/0 conn(0x7fbf14064680 0x7fbf14068230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:43.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf11e00700 1 --2- 172.21.15.49:0/1107803808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf140a9bb0 0x7fbf14064190 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7fbf14060240 tx=0x7fbf04009060).ready entity=mon.1 client_cookie=19f4f06057cf39ac server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf10a00700 1 -- 172.21.15.49:0/1107803808 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400d4a0 con 0x7fbf140a9bb0 2024-01-22T05:19:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf10a00700 1 -- 172.21.15.49:0/1107803808 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0400d600 con 0x7fbf140a9bb0 2024-01-22T05:19:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.451+0000 7fbf10a00700 1 -- 172.21.15.49:0/1107803808 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400d980 con 0x7fbf140a9bb0 2024-01-22T05:19:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.455+0000 7fbf18e00700 1 -- 172.21.15.49:0/1107803808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf140a9bb0 msgr2=0x7fbf14064190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.455+0000 7fbf18e00700 1 --2- 172.21.15.49:0/1107803808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf140a9bb0 0x7fbf14064190 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7fbf14060240 tx=0x7fbf04009060).stop 2024-01-22T05:19:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.455+0000 7fbf18e00700 1 -- 172.21.15.49:0/1107803808 shutdown_connections 2024-01-22T05:19:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.455+0000 7fbf18e00700 1 --2- 172.21.15.49:0/1107803808 >> v2:172.21.15.49:3300/0 conn(0x7fbf14064680 0x7fbf14068230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.455+0000 7fbf18e00700 1 --2- 172.21.15.49:0/1107803808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf140a9f90 0x7fbf14067d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.455+0000 7fbf18e00700 1 --2- 172.21.15.49:0/1107803808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf140a9bb0 0x7fbf14064190 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.455+0000 7fbf18e00700 1 -- 172.21.15.49:0/1107803808 >> 172.21.15.49:0/1107803808 conn(0x7fbf14066830 msgr2=0x7fbf14066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.455+0000 7fbf18e00700 1 -- 172.21.15.49:0/1107803808 shutdown_connections 2024-01-22T05:19:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.455+0000 7fbf18e00700 1 -- 172.21.15.49:0/1107803808 wait complete. 2024-01-22T05:19:43.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.459+0000 7fbf18e00700 1 Processor -- start 2024-01-22T05:19:43.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.459+0000 7fbf18e00700 1 -- start start 2024-01-22T05:19:43.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.459+0000 7fbf18e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf14064680 0x7fbf1413d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.459+0000 7fbf18e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf140a9bb0 0x7fbf140a8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.459+0000 7fbf18e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf140ab150 0x7fbf14150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.459+0000 7fbf18e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140be750 con 0x7fbf140a9bb0 2024-01-22T05:19:43.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.459+0000 7fbf18e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf14166130 con 0x7fbf140ab150 2024-01-22T05:19:43.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.459+0000 7fbf18e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf14166410 con 0x7fbf14064680 2024-01-22T05:19:43.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf11e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf14064680 0x7fbf1413d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf11400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf140a9bb0 0x7fbf140a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf11e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf14064680 0x7fbf1413d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:58370/0 (socket says 172.21.15.49:58370) 2024-01-22T05:19:43.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf11e00700 1 -- 172.21.15.49:0/118474006 learned_addr learned my addr 172.21.15.49:0/118474006 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:43.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf12800700 1 --2- 172.21.15.49:0/118474006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf140ab150 0x7fbf14150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf11e00700 1 -- 172.21.15.49:0/118474006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf140ab150 msgr2=0x7fbf14150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:43.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf11e00700 1 --2- 172.21.15.49:0/118474006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf140ab150 0x7fbf14150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf11e00700 1 -- 172.21.15.49:0/118474006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf140a9bb0 msgr2=0x7fbf140a8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:43.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf11e00700 1 --2- 172.21.15.49:0/118474006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf140a9bb0 0x7fbf140a8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf11e00700 1 -- 172.21.15.49:0/118474006 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c009ae0 con 0x7fbf14064680 2024-01-22T05:19:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf11e00700 1 --2- 172.21.15.49:0/118474006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf14064680 0x7fbf1413d160 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fbf04009d20 tx=0x7fbf04016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf09600700 1 -- 172.21.15.49:0/118474006 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04021070 con 0x7fbf14064680 2024-01-22T05:19:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf09600700 1 -- 172.21.15.49:0/118474006 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0400dd30 con 0x7fbf14064680 2024-01-22T05:19:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf18e00700 1 -- 172.21.15.49:0/118474006 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf040092a0 con 0x7fbf14064680 2024-01-22T05:19:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf09600700 1 -- 172.21.15.49:0/118474006 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400dea0 con 0x7fbf14064680 2024-01-22T05:19:43.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf18e00700 1 -- 172.21.15.49:0/118474006 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf141669d0 con 0x7fbf14064680 2024-01-22T05:19:43.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.463+0000 7fbf18e00700 1 -- 172.21.15.49:0/118474006 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf140657b0 con 0x7fbf14064680 2024-01-22T05:19:43.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.467+0000 7fbf09600700 1 -- 172.21.15.49:0/118474006 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbf0401d640 con 0x7fbf14064680 2024-01-22T05:19:43.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.467+0000 7fbf09600700 1 --2- 172.21.15.49:0/118474006 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbeec05a510 0x7fbeec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.467+0000 7fbf09600700 1 -- 172.21.15.49:0/118474006 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fbf04075ce0 con 0x7fbf14064680 2024-01-22T05:19:43.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.467+0000 7fbf11400700 1 --2- 172.21.15.49:0/118474006 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbeec05a510 0x7fbeec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.467+0000 7fbf11400700 1 --2- 172.21.15.49:0/118474006 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbeec05a510 0x7fbeec05c9d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fbf14166cb0 tx=0x7fbefc009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:43.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.479+0000 7fbf09600700 1 -- 172.21.15.49:0/118474006 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbf04049240 con 0x7fbf14064680 2024-01-22T05:19:43.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.643+0000 7fbf18e00700 1 -- 172.21.15.49:0/118474006 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf14046800 con 0x7fbeec05a510 2024-01-22T05:19:43.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.663+0000 7fbf09600700 1 -- 172.21.15.49:0/118474006 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359517 (secure 0 0 0) 0x7fbf14046800 con 0x7fbeec05a510 2024-01-22T05:19:43.672 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.671+0000 7fbf18e00700 1 -- 172.21.15.49:0/118474006 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbeec05a510 msgr2=0x7fbeec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.671+0000 7fbf18e00700 1 --2- 172.21.15.49:0/118474006 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbeec05a510 0x7fbeec05c9d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fbf14166cb0 tx=0x7fbefc009060).stop 2024-01-22T05:19:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.671+0000 7fbf18e00700 1 -- 172.21.15.49:0/118474006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf14064680 msgr2=0x7fbf1413d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.671+0000 7fbf18e00700 1 --2- 172.21.15.49:0/118474006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf14064680 0x7fbf1413d160 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fbf04009d20 tx=0x7fbf04016000).stop 2024-01-22T05:19:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.671+0000 7fbf18e00700 1 -- 172.21.15.49:0/118474006 shutdown_connections 2024-01-22T05:19:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.671+0000 7fbf18e00700 1 --2- 172.21.15.49:0/118474006 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbeec05a510 0x7fbeec05c9d0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.671+0000 7fbf18e00700 1 --2- 172.21.15.49:0/118474006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf140ab150 0x7fbf14150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.671+0000 7fbf18e00700 1 --2- 172.21.15.49:0/118474006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf140a9bb0 0x7fbf140a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.671+0000 7fbf18e00700 1 --2- 172.21.15.49:0/118474006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf14064680 0x7fbf1413d160 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.671+0000 7fbf18e00700 1 -- 172.21.15.49:0/118474006 >> 172.21.15.49:0/118474006 conn(0x7fbf14066830 msgr2=0x7fbf14067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.675+0000 7fbf18e00700 1 -- 172.21.15.49:0/118474006 shutdown_connections 2024-01-22T05:19:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.675+0000 7fbf18e00700 1 -- 172.21.15.49:0/118474006 wait complete. 2024-01-22T05:19:43.677 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:19:43.696 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":648,"stamp":"2024-01-22T05:19:43.568550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":221,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454592,"kb_used_data":19456,"kb_used_omap":0,"kb_used_meta":2435072,"kb_avail":752520128,"statfs":{"total":773094113280,"available":770580611072,"internally_reserved":0,"allocated":19922944,"data_stored":9923388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2493513728},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3908464,"num_objects":-959,"num_object_clones":0,"num_object_copies":-1918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-959,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-987,"num_write_kb":-4765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.067263"},"pg_stats":[{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.340863+0000","last_change":"2024-01-22T05:19:39.336606+0000","last_active":"2024-01-22T05:19:39.340863+0000","last_peered":"2024-01-22T05:19:39.340863+0000","last_clean":"2024-01-22T05:19:39.340863+0000","last_became_active":"2024-01-22T05:19:39.333842+0000","last_became_peered":"2024-01-22T05:19:39.333842+0000","last_unstale":"2024-01-22T05:19:39.340863+0000","last_undegraded":"2024-01-22T05:19:39.340863+0000","last_fullsized":"2024-01-22T05:19:39.340863+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3f","version":"196'3","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.342076+0000","last_change":"2024-01-22T05:19:38.860474+0000","last_active":"2024-01-22T05:19:39.342076+0000","last_peered":"2024-01-22T05:19:39.342076+0000","last_clean":"2024-01-22T05:19:39.342076+0000","last_became_active":"2024-01-22T05:19:38.860177+0000","last_became_peered":"2024-01-22T05:19:38.860177+0000","last_unstale":"2024-01-22T05:19:39.342076+0000","last_undegraded":"2024-01-22T05:19:39.342076+0000","last_fullsized":"2024-01-22T05:19:39.342076+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.338000+0000","last_change":"2024-01-22T05:19:39.331997+0000","last_active":"2024-01-22T05:19:39.338000+0000","last_peered":"2024-01-22T05:19:39.338000+0000","last_clean":"2024-01-22T05:19:39.338000+0000","last_became_active":"2024-01-22T05:19:39.331382+0000","last_became_peered":"2024-01-22T05:19:39.331382+0000","last_unstale":"2024-01-22T05:19:39.338000+0000","last_undegraded":"2024-01-22T05:19:39.338000+0000","last_fullsized":"2024-01-22T05:19:39.338000+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.309315+0000","last_change":"2024-01-22T05:19:38.860463+0000","last_active":"2024-01-22T05:19:39.309315+0000","last_peered":"2024-01-22T05:19:39.309315+0000","last_clean":"2024-01-22T05:19:39.309315+0000","last_became_active":"2024-01-22T05:19:38.857044+0000","last_became_peered":"2024-01-22T05:19:38.857044+0000","last_unstale":"2024-01-22T05:19:39.309315+0000","last_undegraded":"2024-01-22T05:19:39.309315+0000","last_fullsized":"2024-01-22T05:19:39.309315+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346398+0000","last_change":"2024-01-22T05:19:39.341045+0000","last_active":"2024-01-22T05:19:39.346398+0000","last_peered":"2024-01-22T05:19:39.346398+0000","last_clean":"2024-01-22T05:19:39.346398+0000","last_became_active":"2024-01-22T05:19:39.340784+0000","last_became_peered":"2024-01-22T05:19:39.340784+0000","last_unstale":"2024-01-22T05:19:39.346398+0000","last_undegraded":"2024-01-22T05:19:39.346398+0000","last_fullsized":"2024-01-22T05:19:39.346398+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.329265+0000","last_change":"2024-01-22T05:19:38.872917+0000","last_active":"2024-01-22T05:19:39.329265+0000","last_peered":"2024-01-22T05:19:39.329265+0000","last_clean":"2024-01-22T05:19:39.329265+0000","last_became_active":"2024-01-22T05:19:38.872472+0000","last_became_peered":"2024-01-22T05:19:38.872472+0000","last_unstale":"2024-01-22T05:19:39.329265+0000","last_undegraded":"2024-01-22T05:19:39.329265+0000","last_fullsized":"2024-01-22T05:19:39.329265+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344304+0000","last_change":"2024-01-22T05:19:39.329320+0000","last_active":"2024-01-22T05:19:39.344304+0000","last_peered":"2024-01-22T05:19:39.344304+0000","last_clean":"2024-01-22T05:19:39.344304+0000","last_became_active":"2024-01-22T05:19:39.328941+0000","last_became_peered":"2024-01-22T05:19:39.328941+0000","last_unstale":"2024-01-22T05:19:39.344304+0000","last_undegraded":"2024-01-22T05:19:39.344304+0000","last_fullsized":"2024-01-22T05:19:39.344304+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.3c","version":"196'2","reported_seq":12,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.338158+0000","last_change":"2024-01-22T05:19:38.868662+0000","last_active":"2024-01-22T05:19:39.338158+0000","last_peered":"2024-01-22T05:19:39.338158+0000","last_clean":"2024-01-22T05:19:39.338158+0000","last_became_active":"2024-01-22T05:19:38.868341+0000","last_became_peered":"2024-01-22T05:19:38.868341+0000","last_unstale":"2024-01-22T05:19:39.338158+0000","last_undegraded":"2024-01-22T05:19:39.338158+0000","last_fullsized":"2024-01-22T05:19:39.338158+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.330848+0000","last_change":"2024-01-22T05:19:39.326238+0000","last_active":"2024-01-22T05:19:39.330848+0000","last_peered":"2024-01-22T05:19:39.330848+0000","last_clean":"2024-01-22T05:19:39.330848+0000","last_became_active":"2024-01-22T05:19:39.325223+0000","last_became_peered":"2024-01-22T05:19:39.325223+0000","last_unstale":"2024-01-22T05:19:39.330848+0000","last_undegraded":"2024-01-22T05:19:39.330848+0000","last_fullsized":"2024-01-22T05:19:39.330848+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3b","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343242+0000","last_change":"2024-01-22T05:19:38.869366+0000","last_active":"2024-01-22T05:19:39.343242+0000","last_peered":"2024-01-22T05:19:39.343242+0000","last_clean":"2024-01-22T05:19:39.343242+0000","last_became_active":"2024-01-22T05:19:38.869035+0000","last_became_peered":"2024-01-22T05:19:38.869035+0000","last_unstale":"2024-01-22T05:19:39.343242+0000","last_undegraded":"2024-01-22T05:19:39.343242+0000","last_fullsized":"2024-01-22T05:19:39.343242+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345171+0000","last_change":"2024-01-22T05:19:39.335893+0000","last_active":"2024-01-22T05:19:39.345171+0000","last_peered":"2024-01-22T05:19:39.345171+0000","last_clean":"2024-01-22T05:19:39.345171+0000","last_became_active":"2024-01-22T05:19:39.335619+0000","last_became_peered":"2024-01-22T05:19:39.335619+0000","last_unstale":"2024-01-22T05:19:39.345171+0000","last_undegraded":"2024-01-22T05:19:39.345171+0000","last_fullsized":"2024-01-22T05:19:39.345171+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3a","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.342190+0000","last_change":"2024-01-22T05:19:38.869852+0000","last_active":"2024-01-22T05:19:39.342190+0000","last_peered":"2024-01-22T05:19:39.342190+0000","last_clean":"2024-01-22T05:19:39.342190+0000","last_became_active":"2024-01-22T05:19:38.869483+0000","last_became_peered":"2024-01-22T05:19:38.869483+0000","last_unstale":"2024-01-22T05:19:39.342190+0000","last_undegraded":"2024-01-22T05:19:39.342190+0000","last_fullsized":"2024-01-22T05:19:39.342190+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345488+0000","last_change":"2024-01-22T05:19:39.341967+0000","last_active":"2024-01-22T05:19:39.345488+0000","last_peered":"2024-01-22T05:19:39.345488+0000","last_clean":"2024-01-22T05:19:39.345488+0000","last_became_active":"2024-01-22T05:19:39.340717+0000","last_became_peered":"2024-01-22T05:19:39.340717+0000","last_unstale":"2024-01-22T05:19:39.345488+0000","last_undegraded":"2024-01-22T05:19:39.345488+0000","last_fullsized":"2024-01-22T05:19:39.345488+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.320088+0000","last_change":"2024-01-22T05:19:38.869398+0000","last_active":"2024-01-22T05:19:39.320088+0000","last_peered":"2024-01-22T05:19:39.320088+0000","last_clean":"2024-01-22T05:19:39.320088+0000","last_became_active":"2024-01-22T05:19:38.869063+0000","last_became_peered":"2024-01-22T05:19:38.869063+0000","last_unstale":"2024-01-22T05:19:39.320088+0000","last_undegraded":"2024-01-22T05:19:39.320088+0000","last_fullsized":"2024-01-22T05:19:39.320088+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343749+0000","last_change":"2024-01-22T05:19:39.327123+0000","last_active":"2024-01-22T05:19:39.343749+0000","last_peered":"2024-01-22T05:19:39.343749+0000","last_clean":"2024-01-22T05:19:39.343749+0000","last_became_active":"2024-01-22T05:19:39.325018+0000","last_became_peered":"2024-01-22T05:19:39.325018+0000","last_unstale":"2024-01-22T05:19:39.343749+0000","last_undegraded":"2024-01-22T05:19:39.343749+0000","last_fullsized":"2024-01-22T05:19:39.343749+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317114+0000","last_change":"2024-01-22T05:19:38.862533+0000","last_active":"2024-01-22T05:19:39.317114+0000","last_peered":"2024-01-22T05:19:39.317114+0000","last_clean":"2024-01-22T05:19:39.317114+0000","last_became_active":"2024-01-22T05:19:38.862271+0000","last_became_peered":"2024-01-22T05:19:38.862271+0000","last_unstale":"2024-01-22T05:19:39.317114+0000","last_undegraded":"2024-01-22T05:19:39.317114+0000","last_fullsized":"2024-01-22T05:19:39.317114+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.341095+0000","last_change":"2024-01-22T05:19:39.334701+0000","last_active":"2024-01-22T05:19:39.341095+0000","last_peered":"2024-01-22T05:19:39.341095+0000","last_clean":"2024-01-22T05:19:39.341095+0000","last_became_active":"2024-01-22T05:19:39.333501+0000","last_became_peered":"2024-01-22T05:19:39.333501+0000","last_unstale":"2024-01-22T05:19:39.341095+0000","last_undegraded":"2024-01-22T05:19:39.341095+0000","last_fullsized":"2024-01-22T05:19:39.341095+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317388+0000","last_change":"2024-01-22T05:19:38.846932+0000","last_active":"2024-01-22T05:19:39.317388+0000","last_peered":"2024-01-22T05:19:39.317388+0000","last_clean":"2024-01-22T05:19:39.317388+0000","last_became_active":"2024-01-22T05:19:38.846597+0000","last_became_peered":"2024-01-22T05:19:38.846597+0000","last_unstale":"2024-01-22T05:19:39.317388+0000","last_undegraded":"2024-01-22T05:19:39.317388+0000","last_fullsized":"2024-01-22T05:19:39.317388+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344593+0000","last_change":"2024-01-22T05:19:39.335089+0000","last_active":"2024-01-22T05:19:39.344593+0000","last_peered":"2024-01-22T05:19:39.344593+0000","last_clean":"2024-01-22T05:19:39.344593+0000","last_became_active":"2024-01-22T05:19:39.334763+0000","last_became_peered":"2024-01-22T05:19:39.334763+0000","last_unstale":"2024-01-22T05:19:39.344593+0000","last_undegraded":"2024-01-22T05:19:39.344593+0000","last_fullsized":"2024-01-22T05:19:39.344593+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.325865+0000","last_change":"2024-01-22T05:19:38.866754+0000","last_active":"2024-01-22T05:19:39.325865+0000","last_peered":"2024-01-22T05:19:39.325865+0000","last_clean":"2024-01-22T05:19:39.325865+0000","last_became_active":"2024-01-22T05:19:38.866466+0000","last_became_peered":"2024-01-22T05:19:38.866466+0000","last_unstale":"2024-01-22T05:19:39.325865+0000","last_undegraded":"2024-01-22T05:19:39.325865+0000","last_fullsized":"2024-01-22T05:19:39.325865+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.336255+0000","last_change":"2024-01-22T05:19:39.323355+0000","last_active":"2024-01-22T05:19:39.336255+0000","last_peered":"2024-01-22T05:19:39.336255+0000","last_clean":"2024-01-22T05:19:39.336255+0000","last_became_active":"2024-01-22T05:19:39.321996+0000","last_became_peered":"2024-01-22T05:19:39.321996+0000","last_unstale":"2024-01-22T05:19:39.336255+0000","last_undegraded":"2024-01-22T05:19:39.336255+0000","last_fullsized":"2024-01-22T05:19:39.336255+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.329358+0000","last_change":"2024-01-22T05:19:38.873352+0000","last_active":"2024-01-22T05:19:39.329358+0000","last_peered":"2024-01-22T05:19:39.329358+0000","last_clean":"2024-01-22T05:19:39.329358+0000","last_became_active":"2024-01-22T05:19:38.871800+0000","last_became_peered":"2024-01-22T05:19:38.871800+0000","last_unstale":"2024-01-22T05:19:39.329358+0000","last_undegraded":"2024-01-22T05:19:39.329358+0000","last_fullsized":"2024-01-22T05:19:39.329358+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343659+0000","last_change":"2024-01-22T05:19:39.337953+0000","last_active":"2024-01-22T05:19:39.343659+0000","last_peered":"2024-01-22T05:19:39.343659+0000","last_clean":"2024-01-22T05:19:39.343659+0000","last_became_active":"2024-01-22T05:19:39.337171+0000","last_became_peered":"2024-01-22T05:19:39.337171+0000","last_unstale":"2024-01-22T05:19:39.343659+0000","last_undegraded":"2024-01-22T05:19:39.343659+0000","last_fullsized":"2024-01-22T05:19:39.343659+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.34","version":"196'4","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.347145+0000","last_change":"2024-01-22T05:19:38.866673+0000","last_active":"2024-01-22T05:19:39.347145+0000","last_peered":"2024-01-22T05:19:39.347145+0000","last_clean":"2024-01-22T05:19:39.347145+0000","last_became_active":"2024-01-22T05:19:38.866388+0000","last_became_peered":"2024-01-22T05:19:38.866388+0000","last_unstale":"2024-01-22T05:19:39.347145+0000","last_undegraded":"2024-01-22T05:19:39.347145+0000","last_fullsized":"2024-01-22T05:19:39.347145+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.335472+0000","last_change":"2024-01-22T05:19:39.328659+0000","last_active":"2024-01-22T05:19:39.335472+0000","last_peered":"2024-01-22T05:19:39.335472+0000","last_clean":"2024-01-22T05:19:39.335472+0000","last_became_active":"2024-01-22T05:19:39.328203+0000","last_became_peered":"2024-01-22T05:19:39.328203+0000","last_unstale":"2024-01-22T05:19:39.335472+0000","last_undegraded":"2024-01-22T05:19:39.335472+0000","last_fullsized":"2024-01-22T05:19:39.335472+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.33","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.339708+0000","last_change":"2024-01-22T05:19:38.869528+0000","last_active":"2024-01-22T05:19:39.339708+0000","last_peered":"2024-01-22T05:19:39.339708+0000","last_clean":"2024-01-22T05:19:39.339708+0000","last_became_active":"2024-01-22T05:19:38.869157+0000","last_became_peered":"2024-01-22T05:19:38.869157+0000","last_unstale":"2024-01-22T05:19:39.339708+0000","last_undegraded":"2024-01-22T05:19:39.339708+0000","last_fullsized":"2024-01-22T05:19:39.339708+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.333144+0000","last_change":"2024-01-22T05:19:39.321197+0000","last_active":"2024-01-22T05:19:39.333144+0000","last_peered":"2024-01-22T05:19:39.333144+0000","last_clean":"2024-01-22T05:19:39.333144+0000","last_became_active":"2024-01-22T05:19:39.320846+0000","last_became_peered":"2024-01-22T05:19:39.320846+0000","last_unstale":"2024-01-22T05:19:39.333144+0000","last_undegraded":"2024-01-22T05:19:39.333144+0000","last_fullsized":"2024-01-22T05:19:39.333144+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.320831+0000","last_change":"2024-01-22T05:19:38.859666+0000","last_active":"2024-01-22T05:19:39.320831+0000","last_peered":"2024-01-22T05:19:39.320831+0000","last_clean":"2024-01-22T05:19:39.320831+0000","last_became_active":"2024-01-22T05:19:38.856953+0000","last_became_peered":"2024-01-22T05:19:38.856953+0000","last_unstale":"2024-01-22T05:19:39.320831+0000","last_undegraded":"2024-01-22T05:19:39.320831+0000","last_fullsized":"2024-01-22T05:19:39.320831+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.336337+0000","last_change":"2024-01-22T05:19:39.329587+0000","last_active":"2024-01-22T05:19:39.336337+0000","last_peered":"2024-01-22T05:19:39.336337+0000","last_clean":"2024-01-22T05:19:39.336337+0000","last_became_active":"2024-01-22T05:19:39.322887+0000","last_became_peered":"2024-01-22T05:19:39.322887+0000","last_unstale":"2024-01-22T05:19:39.336337+0000","last_undegraded":"2024-01-22T05:19:39.336337+0000","last_fullsized":"2024-01-22T05:19:39.336337+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308619+0000","last_change":"2024-01-22T05:19:38.860029+0000","last_active":"2024-01-22T05:19:39.308619+0000","last_peered":"2024-01-22T05:19:39.308619+0000","last_clean":"2024-01-22T05:19:39.308619+0000","last_became_active":"2024-01-22T05:19:38.859676+0000","last_became_peered":"2024-01-22T05:19:38.859676+0000","last_unstale":"2024-01-22T05:19:39.308619+0000","last_undegraded":"2024-01-22T05:19:39.308619+0000","last_fullsized":"2024-01-22T05:19:39.308619+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.337274+0000","last_change":"2024-01-22T05:19:39.334944+0000","last_active":"2024-01-22T05:19:39.337274+0000","last_peered":"2024-01-22T05:19:39.337274+0000","last_clean":"2024-01-22T05:19:39.337274+0000","last_became_active":"2024-01-22T05:19:39.334592+0000","last_became_peered":"2024-01-22T05:19:39.334592+0000","last_unstale":"2024-01-22T05:19:39.337274+0000","last_undegraded":"2024-01-22T05:19:39.337274+0000","last_fullsized":"2024-01-22T05:19:39.337274+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.30","version":"196'4","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.341380+0000","last_change":"2024-01-22T05:19:38.861605+0000","last_active":"2024-01-22T05:19:39.341380+0000","last_peered":"2024-01-22T05:19:39.341380+0000","last_clean":"2024-01-22T05:19:39.341380+0000","last_became_active":"2024-01-22T05:19:38.861289+0000","last_became_peered":"2024-01-22T05:19:38.861289+0000","last_unstale":"2024-01-22T05:19:39.341380+0000","last_undegraded":"2024-01-22T05:19:39.341380+0000","last_fullsized":"2024-01-22T05:19:39.341380+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.341272+0000","last_change":"2024-01-22T05:19:39.338968+0000","last_active":"2024-01-22T05:19:39.341272+0000","last_peered":"2024-01-22T05:19:39.341272+0000","last_clean":"2024-01-22T05:19:39.341272+0000","last_became_active":"2024-01-22T05:19:39.338708+0000","last_became_peered":"2024-01-22T05:19:39.338708+0000","last_unstale":"2024-01-22T05:19:39.341272+0000","last_undegraded":"2024-01-22T05:19:39.341272+0000","last_fullsized":"2024-01-22T05:19:39.341272+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317496+0000","last_change":"2024-01-22T05:19:38.870046+0000","last_active":"2024-01-22T05:19:39.317496+0000","last_peered":"2024-01-22T05:19:39.317496+0000","last_clean":"2024-01-22T05:19:39.317496+0000","last_became_active":"2024-01-22T05:19:38.868880+0000","last_became_peered":"2024-01-22T05:19:38.868880+0000","last_unstale":"2024-01-22T05:19:39.317496+0000","last_undegraded":"2024-01-22T05:19:39.317496+0000","last_fullsized":"2024-01-22T05:19:39.317496+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.335722+0000","last_change":"2024-01-22T05:19:39.328087+0000","last_active":"2024-01-22T05:19:39.335722+0000","last_peered":"2024-01-22T05:19:39.335722+0000","last_clean":"2024-01-22T05:19:39.335722+0000","last_became_active":"2024-01-22T05:19:39.327801+0000","last_became_peered":"2024-01-22T05:19:39.327801+0000","last_unstale":"2024-01-22T05:19:39.335722+0000","last_undegraded":"2024-01-22T05:19:39.335722+0000","last_fullsized":"2024-01-22T05:19:39.335722+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317159+0000","last_change":"2024-01-22T05:19:38.871006+0000","last_active":"2024-01-22T05:19:39.317159+0000","last_peered":"2024-01-22T05:19:39.317159+0000","last_clean":"2024-01-22T05:19:39.317159+0000","last_became_active":"2024-01-22T05:19:38.870697+0000","last_became_peered":"2024-01-22T05:19:38.870697+0000","last_unstale":"2024-01-22T05:19:39.317159+0000","last_undegraded":"2024-01-22T05:19:39.317159+0000","last_fullsized":"2024-01-22T05:19:39.317159+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.330930+0000","last_change":"2024-01-22T05:19:39.324287+0000","last_active":"2024-01-22T05:19:39.330930+0000","last_peered":"2024-01-22T05:19:39.330930+0000","last_clean":"2024-01-22T05:19:39.330930+0000","last_became_active":"2024-01-22T05:19:39.324000+0000","last_became_peered":"2024-01-22T05:19:39.324000+0000","last_unstale":"2024-01-22T05:19:39.330930+0000","last_undegraded":"2024-01-22T05:19:39.330930+0000","last_fullsized":"2024-01-22T05:19:39.330930+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2d","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344362+0000","last_change":"2024-01-22T05:19:38.854628+0000","last_active":"2024-01-22T05:19:39.344362+0000","last_peered":"2024-01-22T05:19:39.344362+0000","last_clean":"2024-01-22T05:19:39.344362+0000","last_became_active":"2024-01-22T05:19:38.854341+0000","last_became_peered":"2024-01-22T05:19:38.854341+0000","last_unstale":"2024-01-22T05:19:39.344362+0000","last_undegraded":"2024-01-22T05:19:39.344362+0000","last_fullsized":"2024-01-22T05:19:39.344362+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346436+0000","last_change":"2024-01-22T05:19:39.341609+0000","last_active":"2024-01-22T05:19:39.346436+0000","last_peered":"2024-01-22T05:19:39.346436+0000","last_clean":"2024-01-22T05:19:39.346436+0000","last_became_active":"2024-01-22T05:19:39.338157+0000","last_became_peered":"2024-01-22T05:19:39.338157+0000","last_unstale":"2024-01-22T05:19:39.346436+0000","last_undegraded":"2024-01-22T05:19:39.346436+0000","last_fullsized":"2024-01-22T05:19:39.346436+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.331802+0000","last_change":"2024-01-22T05:19:38.850365+0000","last_active":"2024-01-22T05:19:39.331802+0000","last_peered":"2024-01-22T05:19:39.331802+0000","last_clean":"2024-01-22T05:19:39.331802+0000","last_became_active":"2024-01-22T05:19:38.849105+0000","last_became_peered":"2024-01-22T05:19:38.849105+0000","last_unstale":"2024-01-22T05:19:39.331802+0000","last_undegraded":"2024-01-22T05:19:39.331802+0000","last_fullsized":"2024-01-22T05:19:39.331802+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344900+0000","last_change":"2024-01-22T05:19:39.342744+0000","last_active":"2024-01-22T05:19:39.344900+0000","last_peered":"2024-01-22T05:19:39.344900+0000","last_clean":"2024-01-22T05:19:39.344900+0000","last_became_active":"2024-01-22T05:19:39.342397+0000","last_became_peered":"2024-01-22T05:19:39.342397+0000","last_unstale":"2024-01-22T05:19:39.344900+0000","last_undegraded":"2024-01-22T05:19:39.344900+0000","last_fullsized":"2024-01-22T05:19:39.344900+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2b","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344527+0000","last_change":"2024-01-22T05:19:38.857625+0000","last_active":"2024-01-22T05:19:39.344527+0000","last_peered":"2024-01-22T05:19:39.344527+0000","last_clean":"2024-01-22T05:19:39.344527+0000","last_became_active":"2024-01-22T05:19:38.856260+0000","last_became_peered":"2024-01-22T05:19:38.856260+0000","last_unstale":"2024-01-22T05:19:39.344527+0000","last_undegraded":"2024-01-22T05:19:39.344527+0000","last_fullsized":"2024-01-22T05:19:39.344527+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345327+0000","last_change":"2024-01-22T05:19:39.336330+0000","last_active":"2024-01-22T05:19:39.345327+0000","last_peered":"2024-01-22T05:19:39.345327+0000","last_clean":"2024-01-22T05:19:39.345327+0000","last_became_active":"2024-01-22T05:19:39.335230+0000","last_became_peered":"2024-01-22T05:19:39.335230+0000","last_unstale":"2024-01-22T05:19:39.345327+0000","last_undegraded":"2024-01-22T05:19:39.345327+0000","last_fullsized":"2024-01-22T05:19:39.345327+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.320928+0000","last_change":"2024-01-22T05:19:38.857212+0000","last_active":"2024-01-22T05:19:39.320928+0000","last_peered":"2024-01-22T05:19:39.320928+0000","last_clean":"2024-01-22T05:19:39.320928+0000","last_became_active":"2024-01-22T05:19:38.856618+0000","last_became_peered":"2024-01-22T05:19:38.856618+0000","last_unstale":"2024-01-22T05:19:39.320928+0000","last_undegraded":"2024-01-22T05:19:39.320928+0000","last_fullsized":"2024-01-22T05:19:39.320928+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345189+0000","last_change":"2024-01-22T05:19:39.335982+0000","last_active":"2024-01-22T05:19:39.345189+0000","last_peered":"2024-01-22T05:19:39.345189+0000","last_clean":"2024-01-22T05:19:39.345189+0000","last_became_active":"2024-01-22T05:19:39.334912+0000","last_became_peered":"2024-01-22T05:19:39.334912+0000","last_unstale":"2024-01-22T05:19:39.345189+0000","last_undegraded":"2024-01-22T05:19:39.345189+0000","last_fullsized":"2024-01-22T05:19:39.345189+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308005+0000","last_change":"2024-01-22T05:19:38.855796+0000","last_active":"2024-01-22T05:19:39.308005+0000","last_peered":"2024-01-22T05:19:39.308005+0000","last_clean":"2024-01-22T05:19:39.308005+0000","last_became_active":"2024-01-22T05:19:38.855389+0000","last_became_peered":"2024-01-22T05:19:38.855389+0000","last_unstale":"2024-01-22T05:19:39.308005+0000","last_undegraded":"2024-01-22T05:19:39.308005+0000","last_fullsized":"2024-01-22T05:19:39.308005+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.337782+0000","last_change":"2024-01-22T05:19:39.330569+0000","last_active":"2024-01-22T05:19:39.337782+0000","last_peered":"2024-01-22T05:19:39.337782+0000","last_clean":"2024-01-22T05:19:39.337782+0000","last_became_active":"2024-01-22T05:19:39.330082+0000","last_became_peered":"2024-01-22T05:19:39.330082+0000","last_unstale":"2024-01-22T05:19:39.337782+0000","last_undegraded":"2024-01-22T05:19:39.337782+0000","last_fullsized":"2024-01-22T05:19:39.337782+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.319887+0000","last_change":"2024-01-22T05:19:38.860328+0000","last_active":"2024-01-22T05:19:39.319887+0000","last_peered":"2024-01-22T05:19:39.319887+0000","last_clean":"2024-01-22T05:19:39.319887+0000","last_became_active":"2024-01-22T05:19:38.860050+0000","last_became_peered":"2024-01-22T05:19:38.860050+0000","last_unstale":"2024-01-22T05:19:39.319887+0000","last_undegraded":"2024-01-22T05:19:39.319887+0000","last_fullsized":"2024-01-22T05:19:39.319887+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344802+0000","last_change":"2024-01-22T05:19:39.332014+0000","last_active":"2024-01-22T05:19:39.344802+0000","last_peered":"2024-01-22T05:19:39.344802+0000","last_clean":"2024-01-22T05:19:39.344802+0000","last_became_active":"2024-01-22T05:19:39.331720+0000","last_became_peered":"2024-01-22T05:19:39.331720+0000","last_unstale":"2024-01-22T05:19:39.344802+0000","last_undegraded":"2024-01-22T05:19:39.344802+0000","last_fullsized":"2024-01-22T05:19:39.344802+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317620+0000","last_change":"2024-01-22T05:19:38.859775+0000","last_active":"2024-01-22T05:19:39.317620+0000","last_peered":"2024-01-22T05:19:39.317620+0000","last_clean":"2024-01-22T05:19:39.317620+0000","last_became_active":"2024-01-22T05:19:38.859519+0000","last_became_peered":"2024-01-22T05:19:38.859519+0000","last_unstale":"2024-01-22T05:19:39.317620+0000","last_undegraded":"2024-01-22T05:19:39.317620+0000","last_fullsized":"2024-01-22T05:19:39.317620+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.329720+0000","last_change":"2024-01-22T05:19:39.327041+0000","last_active":"2024-01-22T05:19:39.329720+0000","last_peered":"2024-01-22T05:19:39.329720+0000","last_clean":"2024-01-22T05:19:39.329720+0000","last_became_active":"2024-01-22T05:19:39.326740+0000","last_became_peered":"2024-01-22T05:19:39.326740+0000","last_unstale":"2024-01-22T05:19:39.329720+0000","last_undegraded":"2024-01-22T05:19:39.329720+0000","last_fullsized":"2024-01-22T05:19:39.329720+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.309441+0000","last_change":"2024-01-22T05:19:38.858737+0000","last_active":"2024-01-22T05:19:39.309441+0000","last_peered":"2024-01-22T05:19:39.309441+0000","last_clean":"2024-01-22T05:19:39.309441+0000","last_became_active":"2024-01-22T05:19:38.858459+0000","last_became_peered":"2024-01-22T05:19:38.858459+0000","last_unstale":"2024-01-22T05:19:39.309441+0000","last_undegraded":"2024-01-22T05:19:39.309441+0000","last_fullsized":"2024-01-22T05:19:39.309441+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.333195+0000","last_change":"2024-01-22T05:19:39.330023+0000","last_active":"2024-01-22T05:19:39.333195+0000","last_peered":"2024-01-22T05:19:39.333195+0000","last_clean":"2024-01-22T05:19:39.333195+0000","last_became_active":"2024-01-22T05:19:39.329698+0000","last_became_peered":"2024-01-22T05:19:39.329698+0000","last_unstale":"2024-01-22T05:19:39.333195+0000","last_undegraded":"2024-01-22T05:19:39.333195+0000","last_fullsized":"2024-01-22T05:19:39.333195+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.329446+0000","last_change":"2024-01-22T05:19:38.872735+0000","last_active":"2024-01-22T05:19:39.329446+0000","last_peered":"2024-01-22T05:19:39.329446+0000","last_clean":"2024-01-22T05:19:39.329446+0000","last_became_active":"2024-01-22T05:19:38.872134+0000","last_became_peered":"2024-01-22T05:19:38.872134+0000","last_unstale":"2024-01-22T05:19:39.329446+0000","last_undegraded":"2024-01-22T05:19:39.329446+0000","last_fullsized":"2024-01-22T05:19:39.329446+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344377+0000","last_change":"2024-01-22T05:19:39.339471+0000","last_active":"2024-01-22T05:19:39.344377+0000","last_peered":"2024-01-22T05:19:39.344377+0000","last_clean":"2024-01-22T05:19:39.344377+0000","last_became_active":"2024-01-22T05:19:39.338252+0000","last_became_peered":"2024-01-22T05:19:39.338252+0000","last_unstale":"2024-01-22T05:19:39.344377+0000","last_undegraded":"2024-01-22T05:19:39.344377+0000","last_fullsized":"2024-01-22T05:19:39.344377+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.320258+0000","last_change":"2024-01-22T05:19:38.863405+0000","last_active":"2024-01-22T05:19:39.320258+0000","last_peered":"2024-01-22T05:19:39.320258+0000","last_clean":"2024-01-22T05:19:39.320258+0000","last_became_active":"2024-01-22T05:19:38.863082+0000","last_became_peered":"2024-01-22T05:19:38.863082+0000","last_unstale":"2024-01-22T05:19:39.320258+0000","last_undegraded":"2024-01-22T05:19:39.320258+0000","last_fullsized":"2024-01-22T05:19:39.320258+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343643+0000","last_change":"2024-01-22T05:19:39.337252+0000","last_active":"2024-01-22T05:19:39.343643+0000","last_peered":"2024-01-22T05:19:39.343643+0000","last_clean":"2024-01-22T05:19:39.343643+0000","last_became_active":"2024-01-22T05:19:39.336940+0000","last_became_peered":"2024-01-22T05:19:39.336940+0000","last_unstale":"2024-01-22T05:19:39.343643+0000","last_undegraded":"2024-01-22T05:19:39.343643+0000","last_fullsized":"2024-01-22T05:19:39.343643+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317580+0000","last_change":"2024-01-22T05:19:38.851100+0000","last_active":"2024-01-22T05:19:39.317580+0000","last_peered":"2024-01-22T05:19:39.317580+0000","last_clean":"2024-01-22T05:19:39.317580+0000","last_became_active":"2024-01-22T05:19:38.850789+0000","last_became_peered":"2024-01-22T05:19:38.850789+0000","last_unstale":"2024-01-22T05:19:39.317580+0000","last_undegraded":"2024-01-22T05:19:39.317580+0000","last_fullsized":"2024-01-22T05:19:39.317580+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.335702+0000","last_change":"2024-01-22T05:19:39.332403+0000","last_active":"2024-01-22T05:19:39.335702+0000","last_peered":"2024-01-22T05:19:39.335702+0000","last_clean":"2024-01-22T05:19:39.335702+0000","last_became_active":"2024-01-22T05:19:39.332109+0000","last_became_peered":"2024-01-22T05:19:39.332109+0000","last_unstale":"2024-01-22T05:19:39.335702+0000","last_undegraded":"2024-01-22T05:19:39.335702+0000","last_fullsized":"2024-01-22T05:19:39.335702+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308838+0000","last_change":"2024-01-22T05:19:38.852005+0000","last_active":"2024-01-22T05:19:39.308838+0000","last_peered":"2024-01-22T05:19:39.308838+0000","last_clean":"2024-01-22T05:19:39.308838+0000","last_became_active":"2024-01-22T05:19:38.851732+0000","last_became_peered":"2024-01-22T05:19:38.851732+0000","last_unstale":"2024-01-22T05:19:39.308838+0000","last_undegraded":"2024-01-22T05:19:39.308838+0000","last_fullsized":"2024-01-22T05:19:39.308838+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.337535+0000","last_change":"2024-01-22T05:19:39.335389+0000","last_active":"2024-01-22T05:19:39.337535+0000","last_peered":"2024-01-22T05:19:39.337535+0000","last_clean":"2024-01-22T05:19:39.337535+0000","last_became_active":"2024-01-22T05:19:39.335055+0000","last_became_peered":"2024-01-22T05:19:39.335055+0000","last_unstale":"2024-01-22T05:19:39.337535+0000","last_undegraded":"2024-01-22T05:19:39.337535+0000","last_fullsized":"2024-01-22T05:19:39.337535+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.311632+0000","last_change":"2024-01-22T05:19:38.866613+0000","last_active":"2024-01-22T05:19:39.311632+0000","last_peered":"2024-01-22T05:19:39.311632+0000","last_clean":"2024-01-22T05:19:39.311632+0000","last_became_active":"2024-01-22T05:19:38.865409+0000","last_became_peered":"2024-01-22T05:19:38.865409+0000","last_unstale":"2024-01-22T05:19:39.311632+0000","last_undegraded":"2024-01-22T05:19:39.311632+0000","last_fullsized":"2024-01-22T05:19:39.311632+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346188+0000","last_change":"2024-01-22T05:19:39.336565+0000","last_active":"2024-01-22T05:19:39.346188+0000","last_peered":"2024-01-22T05:19:39.346188+0000","last_clean":"2024-01-22T05:19:39.346188+0000","last_became_active":"2024-01-22T05:19:39.335207+0000","last_became_peered":"2024-01-22T05:19:39.335207+0000","last_unstale":"2024-01-22T05:19:39.346188+0000","last_undegraded":"2024-01-22T05:19:39.346188+0000","last_fullsized":"2024-01-22T05:19:39.346188+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.310489+0000","last_change":"2024-01-22T05:19:38.864678+0000","last_active":"2024-01-22T05:19:39.310489+0000","last_peered":"2024-01-22T05:19:39.310489+0000","last_clean":"2024-01-22T05:19:39.310489+0000","last_became_active":"2024-01-22T05:19:38.864359+0000","last_became_peered":"2024-01-22T05:19:38.864359+0000","last_unstale":"2024-01-22T05:19:39.310489+0000","last_undegraded":"2024-01-22T05:19:39.310489+0000","last_fullsized":"2024-01-22T05:19:39.310489+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.341817+0000","last_change":"2024-01-22T05:19:39.337252+0000","last_active":"2024-01-22T05:19:39.341817+0000","last_peered":"2024-01-22T05:19:39.341817+0000","last_clean":"2024-01-22T05:19:39.341817+0000","last_became_active":"2024-01-22T05:19:39.333421+0000","last_became_peered":"2024-01-22T05:19:39.333421+0000","last_unstale":"2024-01-22T05:19:39.341817+0000","last_undegraded":"2024-01-22T05:19:39.341817+0000","last_fullsized":"2024-01-22T05:19:39.341817+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.314284+0000","last_change":"2024-01-22T05:19:38.868853+0000","last_active":"2024-01-22T05:19:39.314284+0000","last_peered":"2024-01-22T05:19:39.314284+0000","last_clean":"2024-01-22T05:19:39.314284+0000","last_became_active":"2024-01-22T05:19:38.868512+0000","last_became_peered":"2024-01-22T05:19:38.868512+0000","last_unstale":"2024-01-22T05:19:39.314284+0000","last_undegraded":"2024-01-22T05:19:39.314284+0000","last_fullsized":"2024-01-22T05:19:39.314284+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344346+0000","last_change":"2024-01-22T05:19:39.339800+0000","last_active":"2024-01-22T05:19:39.344346+0000","last_peered":"2024-01-22T05:19:39.344346+0000","last_clean":"2024-01-22T05:19:39.344346+0000","last_became_active":"2024-01-22T05:19:39.339533+0000","last_became_peered":"2024-01-22T05:19:39.339533+0000","last_unstale":"2024-01-22T05:19:39.344346+0000","last_undegraded":"2024-01-22T05:19:39.344346+0000","last_fullsized":"2024-01-22T05:19:39.344346+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317254+0000","last_change":"2024-01-22T05:19:38.868096+0000","last_active":"2024-01-22T05:19:39.317254+0000","last_peered":"2024-01-22T05:19:39.317254+0000","last_clean":"2024-01-22T05:19:39.317254+0000","last_became_active":"2024-01-22T05:19:38.867793+0000","last_became_peered":"2024-01-22T05:19:38.867793+0000","last_unstale":"2024-01-22T05:19:39.317254+0000","last_undegraded":"2024-01-22T05:19:39.317254+0000","last_fullsized":"2024-01-22T05:19:39.317254+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.337532+0000","last_change":"2024-01-22T05:19:39.335126+0000","last_active":"2024-01-22T05:19:39.337532+0000","last_peered":"2024-01-22T05:19:39.337532+0000","last_clean":"2024-01-22T05:19:39.337532+0000","last_became_active":"2024-01-22T05:19:39.331740+0000","last_became_peered":"2024-01-22T05:19:39.331740+0000","last_unstale":"2024-01-22T05:19:39.337532+0000","last_undegraded":"2024-01-22T05:19:39.337532+0000","last_fullsized":"2024-01-22T05:19:39.337532+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"196'3","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346309+0000","last_change":"2024-01-22T05:19:38.860783+0000","last_active":"2024-01-22T05:19:39.346309+0000","last_peered":"2024-01-22T05:19:39.346309+0000","last_clean":"2024-01-22T05:19:39.346309+0000","last_became_active":"2024-01-22T05:19:38.859697+0000","last_became_peered":"2024-01-22T05:19:38.859697+0000","last_unstale":"2024-01-22T05:19:39.346309+0000","last_undegraded":"2024-01-22T05:19:39.346309+0000","last_fullsized":"2024-01-22T05:19:39.346309+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344424+0000","last_change":"2024-01-22T05:19:39.340642+0000","last_active":"2024-01-22T05:19:39.344424+0000","last_peered":"2024-01-22T05:19:39.344424+0000","last_clean":"2024-01-22T05:19:39.344424+0000","last_became_active":"2024-01-22T05:19:39.340378+0000","last_became_peered":"2024-01-22T05:19:39.340378+0000","last_unstale":"2024-01-22T05:19:39.344424+0000","last_undegraded":"2024-01-22T05:19:39.344424+0000","last_fullsized":"2024-01-22T05:19:39.344424+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"196'2","reported_seq":12,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343135+0000","last_change":"2024-01-22T05:19:38.868370+0000","last_active":"2024-01-22T05:19:39.343135+0000","last_peered":"2024-01-22T05:19:39.343135+0000","last_clean":"2024-01-22T05:19:39.343135+0000","last_became_active":"2024-01-22T05:19:38.868085+0000","last_became_peered":"2024-01-22T05:19:38.868085+0000","last_unstale":"2024-01-22T05:19:39.343135+0000","last_undegraded":"2024-01-22T05:19:39.343135+0000","last_fullsized":"2024-01-22T05:19:39.343135+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.342756+0000","last_change":"2024-01-22T05:19:39.341098+0000","last_active":"2024-01-22T05:19:39.342756+0000","last_peered":"2024-01-22T05:19:39.342756+0000","last_clean":"2024-01-22T05:19:39.342756+0000","last_became_active":"2024-01-22T05:19:39.340829+0000","last_became_peered":"2024-01-22T05:19:39.340829+0000","last_unstale":"2024-01-22T05:19:39.342756+0000","last_undegraded":"2024-01-22T05:19:39.342756+0000","last_fullsized":"2024-01-22T05:19:39.342756+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.350370+0000","last_change":"2024-01-22T05:19:38.869281+0000","last_active":"2024-01-22T05:19:39.350370+0000","last_peered":"2024-01-22T05:19:39.350370+0000","last_clean":"2024-01-22T05:19:39.350370+0000","last_became_active":"2024-01-22T05:19:38.868929+0000","last_became_peered":"2024-01-22T05:19:38.868929+0000","last_unstale":"2024-01-22T05:19:39.350370+0000","last_undegraded":"2024-01-22T05:19:39.350370+0000","last_fullsized":"2024-01-22T05:19:39.350370+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345308+0000","last_change":"2024-01-22T05:19:39.340635+0000","last_active":"2024-01-22T05:19:39.345308+0000","last_peered":"2024-01-22T05:19:39.345308+0000","last_clean":"2024-01-22T05:19:39.345308+0000","last_became_active":"2024-01-22T05:19:39.340210+0000","last_became_peered":"2024-01-22T05:19:39.340210+0000","last_unstale":"2024-01-22T05:19:39.345308+0000","last_undegraded":"2024-01-22T05:19:39.345308+0000","last_fullsized":"2024-01-22T05:19:39.345308+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317942+0000","last_change":"2024-01-22T05:19:38.847706+0000","last_active":"2024-01-22T05:19:39.317942+0000","last_peered":"2024-01-22T05:19:39.317942+0000","last_clean":"2024-01-22T05:19:39.317942+0000","last_became_active":"2024-01-22T05:19:38.847365+0000","last_became_peered":"2024-01-22T05:19:38.847365+0000","last_unstale":"2024-01-22T05:19:39.317942+0000","last_undegraded":"2024-01-22T05:19:39.317942+0000","last_fullsized":"2024-01-22T05:19:39.317942+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345171+0000","last_change":"2024-01-22T05:19:39.338890+0000","last_active":"2024-01-22T05:19:39.345171+0000","last_peered":"2024-01-22T05:19:39.345171+0000","last_clean":"2024-01-22T05:19:39.345171+0000","last_became_active":"2024-01-22T05:19:39.338604+0000","last_became_peered":"2024-01-22T05:19:39.338604+0000","last_unstale":"2024-01-22T05:19:39.345171+0000","last_undegraded":"2024-01-22T05:19:39.345171+0000","last_fullsized":"2024-01-22T05:19:39.345171+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.324729+0000","last_change":"2024-01-22T05:19:38.867811+0000","last_active":"2024-01-22T05:19:39.324729+0000","last_peered":"2024-01-22T05:19:39.324729+0000","last_clean":"2024-01-22T05:19:39.324729+0000","last_became_active":"2024-01-22T05:19:38.867506+0000","last_became_peered":"2024-01-22T05:19:38.867506+0000","last_unstale":"2024-01-22T05:19:39.324729+0000","last_undegraded":"2024-01-22T05:19:39.324729+0000","last_fullsized":"2024-01-22T05:19:39.324729+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.320692+0000","last_change":"2024-01-22T05:19:39.315819+0000","last_active":"2024-01-22T05:19:39.320692+0000","last_peered":"2024-01-22T05:19:39.320692+0000","last_clean":"2024-01-22T05:19:39.320692+0000","last_became_active":"2024-01-22T05:19:39.313153+0000","last_became_peered":"2024-01-22T05:19:39.313153+0000","last_unstale":"2024-01-22T05:19:39.320692+0000","last_undegraded":"2024-01-22T05:19:39.320692+0000","last_fullsized":"2024-01-22T05:19:39.320692+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"196'4","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.337358+0000","last_change":"2024-01-22T05:19:38.836660+0000","last_active":"2024-01-22T05:19:39.337358+0000","last_peered":"2024-01-22T05:19:39.337358+0000","last_clean":"2024-01-22T05:19:39.337358+0000","last_became_active":"2024-01-22T05:19:38.836354+0000","last_became_peered":"2024-01-22T05:19:38.836354+0000","last_unstale":"2024-01-22T05:19:39.337358+0000","last_undegraded":"2024-01-22T05:19:39.337358+0000","last_fullsized":"2024-01-22T05:19:39.337358+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344827+0000","last_change":"2024-01-22T05:19:39.332194+0000","last_active":"2024-01-22T05:19:39.344827+0000","last_peered":"2024-01-22T05:19:39.344827+0000","last_clean":"2024-01-22T05:19:39.344827+0000","last_became_active":"2024-01-22T05:19:39.331287+0000","last_became_peered":"2024-01-22T05:19:39.331287+0000","last_unstale":"2024-01-22T05:19:39.344827+0000","last_undegraded":"2024-01-22T05:19:39.344827+0000","last_fullsized":"2024-01-22T05:19:39.344827+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343969+0000","last_change":"2024-01-22T05:19:38.861051+0000","last_active":"2024-01-22T05:19:39.343969+0000","last_peered":"2024-01-22T05:19:39.343969+0000","last_clean":"2024-01-22T05:19:39.343969+0000","last_became_active":"2024-01-22T05:19:38.859408+0000","last_became_peered":"2024-01-22T05:19:38.859408+0000","last_unstale":"2024-01-22T05:19:39.343969+0000","last_undegraded":"2024-01-22T05:19:39.343969+0000","last_fullsized":"2024-01-22T05:19:39.343969+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.341901+0000","last_change":"2024-01-22T05:19:39.338292+0000","last_active":"2024-01-22T05:19:39.341901+0000","last_peered":"2024-01-22T05:19:39.341901+0000","last_clean":"2024-01-22T05:19:39.341901+0000","last_became_active":"2024-01-22T05:19:39.338018+0000","last_became_peered":"2024-01-22T05:19:39.338018+0000","last_unstale":"2024-01-22T05:19:39.341901+0000","last_undegraded":"2024-01-22T05:19:39.341901+0000","last_fullsized":"2024-01-22T05:19:39.341901+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"196'2","reported_seq":12,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.332287+0000","last_change":"2024-01-22T05:19:38.855805+0000","last_active":"2024-01-22T05:19:39.332287+0000","last_peered":"2024-01-22T05:19:39.332287+0000","last_clean":"2024-01-22T05:19:39.332287+0000","last_became_active":"2024-01-22T05:19:38.855498+0000","last_became_peered":"2024-01-22T05:19:38.855498+0000","last_unstale":"2024-01-22T05:19:39.332287+0000","last_undegraded":"2024-01-22T05:19:39.332287+0000","last_fullsized":"2024-01-22T05:19:39.332287+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344727+0000","last_change":"2024-01-22T05:19:39.335658+0000","last_active":"2024-01-22T05:19:39.344727+0000","last_peered":"2024-01-22T05:19:39.344727+0000","last_clean":"2024-01-22T05:19:39.344727+0000","last_became_active":"2024-01-22T05:19:39.335387+0000","last_became_peered":"2024-01-22T05:19:39.335387+0000","last_unstale":"2024-01-22T05:19:39.344727+0000","last_undegraded":"2024-01-22T05:19:39.344727+0000","last_fullsized":"2024-01-22T05:19:39.344727+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.312761+0000","last_change":"2024-01-22T05:19:38.866899+0000","last_active":"2024-01-22T05:19:39.312761+0000","last_peered":"2024-01-22T05:19:39.312761+0000","last_clean":"2024-01-22T05:19:39.312761+0000","last_became_active":"2024-01-22T05:19:38.866055+0000","last_became_peered":"2024-01-22T05:19:38.866055+0000","last_unstale":"2024-01-22T05:19:39.312761+0000","last_undegraded":"2024-01-22T05:19:39.312761+0000","last_fullsized":"2024-01-22T05:19:39.312761+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345115+0000","last_change":"2024-01-22T05:19:39.336768+0000","last_active":"2024-01-22T05:19:39.345115+0000","last_peered":"2024-01-22T05:19:39.345115+0000","last_clean":"2024-01-22T05:19:39.345115+0000","last_became_active":"2024-01-22T05:19:39.335264+0000","last_became_peered":"2024-01-22T05:19:39.335264+0000","last_unstale":"2024-01-22T05:19:39.345115+0000","last_undegraded":"2024-01-22T05:19:39.345115+0000","last_fullsized":"2024-01-22T05:19:39.345115+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308873+0000","last_change":"2024-01-22T05:19:38.854236+0000","last_active":"2024-01-22T05:19:39.308873+0000","last_peered":"2024-01-22T05:19:39.308873+0000","last_clean":"2024-01-22T05:19:39.308873+0000","last_became_active":"2024-01-22T05:19:38.853877+0000","last_became_peered":"2024-01-22T05:19:38.853877+0000","last_unstale":"2024-01-22T05:19:39.308873+0000","last_undegraded":"2024-01-22T05:19:39.308873+0000","last_fullsized":"2024-01-22T05:19:39.308873+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.341486+0000","last_change":"2024-01-22T05:19:39.334705+0000","last_active":"2024-01-22T05:19:39.341486+0000","last_peered":"2024-01-22T05:19:39.341486+0000","last_clean":"2024-01-22T05:19:39.341486+0000","last_became_active":"2024-01-22T05:19:39.331932+0000","last_became_peered":"2024-01-22T05:19:39.331932+0000","last_unstale":"2024-01-22T05:19:39.341486+0000","last_undegraded":"2024-01-22T05:19:39.341486+0000","last_fullsized":"2024-01-22T05:19:39.341486+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344247+0000","last_change":"2024-01-22T05:19:38.856373+0000","last_active":"2024-01-22T05:19:39.344247+0000","last_peered":"2024-01-22T05:19:39.344247+0000","last_clean":"2024-01-22T05:19:39.344247+0000","last_became_active":"2024-01-22T05:19:38.856063+0000","last_became_peered":"2024-01-22T05:19:38.856063+0000","last_unstale":"2024-01-22T05:19:39.344247+0000","last_undegraded":"2024-01-22T05:19:39.344247+0000","last_fullsized":"2024-01-22T05:19:39.344247+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344300+0000","last_change":"2024-01-22T05:19:39.334101+0000","last_active":"2024-01-22T05:19:39.344300+0000","last_peered":"2024-01-22T05:19:39.344300+0000","last_clean":"2024-01-22T05:19:39.344300+0000","last_became_active":"2024-01-22T05:19:39.333425+0000","last_became_peered":"2024-01-22T05:19:39.333425+0000","last_unstale":"2024-01-22T05:19:39.344300+0000","last_undegraded":"2024-01-22T05:19:39.344300+0000","last_fullsized":"2024-01-22T05:19:39.344300+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308837+0000","last_change":"2024-01-22T05:19:38.851197+0000","last_active":"2024-01-22T05:19:39.308837+0000","last_peered":"2024-01-22T05:19:39.308837+0000","last_clean":"2024-01-22T05:19:39.308837+0000","last_became_active":"2024-01-22T05:19:38.850851+0000","last_became_peered":"2024-01-22T05:19:38.850851+0000","last_unstale":"2024-01-22T05:19:39.308837+0000","last_undegraded":"2024-01-22T05:19:39.308837+0000","last_fullsized":"2024-01-22T05:19:39.308837+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345072+0000","last_change":"2024-01-22T05:19:39.333229+0000","last_active":"2024-01-22T05:19:39.345072+0000","last_peered":"2024-01-22T05:19:39.345072+0000","last_clean":"2024-01-22T05:19:39.345072+0000","last_became_active":"2024-01-22T05:19:39.332945+0000","last_became_peered":"2024-01-22T05:19:39.332945+0000","last_unstale":"2024-01-22T05:19:39.345072+0000","last_undegraded":"2024-01-22T05:19:39.345072+0000","last_fullsized":"2024-01-22T05:19:39.345072+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308647+0000","last_change":"2024-01-22T05:19:38.858973+0000","last_active":"2024-01-22T05:19:39.308647+0000","last_peered":"2024-01-22T05:19:39.308647+0000","last_clean":"2024-01-22T05:19:39.308647+0000","last_became_active":"2024-01-22T05:19:38.858070+0000","last_became_peered":"2024-01-22T05:19:38.858070+0000","last_unstale":"2024-01-22T05:19:39.308647+0000","last_undegraded":"2024-01-22T05:19:39.308647+0000","last_fullsized":"2024-01-22T05:19:39.308647+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346591+0000","last_change":"2024-01-22T05:19:39.341609+0000","last_active":"2024-01-22T05:19:39.346591+0000","last_peered":"2024-01-22T05:19:39.346591+0000","last_clean":"2024-01-22T05:19:39.346591+0000","last_became_active":"2024-01-22T05:19:39.341321+0000","last_became_peered":"2024-01-22T05:19:39.341321+0000","last_unstale":"2024-01-22T05:19:39.346591+0000","last_undegraded":"2024-01-22T05:19:39.346591+0000","last_fullsized":"2024-01-22T05:19:39.346591+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317232+0000","last_change":"2024-01-22T05:19:38.855072+0000","last_active":"2024-01-22T05:19:39.317232+0000","last_peered":"2024-01-22T05:19:39.317232+0000","last_clean":"2024-01-22T05:19:39.317232+0000","last_became_active":"2024-01-22T05:19:38.854703+0000","last_became_peered":"2024-01-22T05:19:38.854703+0000","last_unstale":"2024-01-22T05:19:39.317232+0000","last_undegraded":"2024-01-22T05:19:39.317232+0000","last_fullsized":"2024-01-22T05:19:39.317232+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346572+0000","last_change":"2024-01-22T05:19:39.344514+0000","last_active":"2024-01-22T05:19:39.346572+0000","last_peered":"2024-01-22T05:19:39.346572+0000","last_clean":"2024-01-22T05:19:39.346572+0000","last_became_active":"2024-01-22T05:19:39.344252+0000","last_became_peered":"2024-01-22T05:19:39.344252+0000","last_unstale":"2024-01-22T05:19:39.346572+0000","last_undegraded":"2024-01-22T05:19:39.346572+0000","last_fullsized":"2024-01-22T05:19:39.346572+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"196'2","reported_seq":12,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.348096+0000","last_change":"2024-01-22T05:19:38.870889+0000","last_active":"2024-01-22T05:19:39.348096+0000","last_peered":"2024-01-22T05:19:39.348096+0000","last_clean":"2024-01-22T05:19:39.348096+0000","last_became_active":"2024-01-22T05:19:38.870608+0000","last_became_peered":"2024-01-22T05:19:38.870608+0000","last_unstale":"2024-01-22T05:19:39.348096+0000","last_undegraded":"2024-01-22T05:19:39.348096+0000","last_fullsized":"2024-01-22T05:19:39.348096+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345211+0000","last_change":"2024-01-22T05:19:39.339888+0000","last_active":"2024-01-22T05:19:39.345211+0000","last_peered":"2024-01-22T05:19:39.345211+0000","last_clean":"2024-01-22T05:19:39.345211+0000","last_became_active":"2024-01-22T05:19:39.339601+0000","last_became_peered":"2024-01-22T05:19:39.339601+0000","last_unstale":"2024-01-22T05:19:39.345211+0000","last_undegraded":"2024-01-22T05:19:39.345211+0000","last_fullsized":"2024-01-22T05:19:39.345211+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.311061+0000","last_change":"2024-01-22T05:19:38.870600+0000","last_active":"2024-01-22T05:19:39.311061+0000","last_peered":"2024-01-22T05:19:39.311061+0000","last_clean":"2024-01-22T05:19:39.311061+0000","last_became_active":"2024-01-22T05:19:38.870125+0000","last_became_peered":"2024-01-22T05:19:38.870125+0000","last_unstale":"2024-01-22T05:19:39.311061+0000","last_undegraded":"2024-01-22T05:19:39.311061+0000","last_fullsized":"2024-01-22T05:19:39.311061+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343777+0000","last_change":"2024-01-22T05:19:39.325463+0000","last_active":"2024-01-22T05:19:39.343777+0000","last_peered":"2024-01-22T05:19:39.343777+0000","last_clean":"2024-01-22T05:19:39.343777+0000","last_became_active":"2024-01-22T05:19:39.324883+0000","last_became_peered":"2024-01-22T05:19:39.324883+0000","last_unstale":"2024-01-22T05:19:39.343777+0000","last_undegraded":"2024-01-22T05:19:39.343777+0000","last_fullsized":"2024-01-22T05:19:39.343777+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.312878+0000","last_change":"2024-01-22T05:19:38.870610+0000","last_active":"2024-01-22T05:19:39.312878+0000","last_peered":"2024-01-22T05:19:39.312878+0000","last_clean":"2024-01-22T05:19:39.312878+0000","last_became_active":"2024-01-22T05:19:38.870289+0000","last_became_peered":"2024-01-22T05:19:38.870289+0000","last_unstale":"2024-01-22T05:19:39.312878+0000","last_undegraded":"2024-01-22T05:19:39.312878+0000","last_fullsized":"2024-01-22T05:19:39.312878+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346412+0000","last_change":"2024-01-22T05:19:39.337876+0000","last_active":"2024-01-22T05:19:39.346412+0000","last_peered":"2024-01-22T05:19:39.346412+0000","last_clean":"2024-01-22T05:19:39.346412+0000","last_became_active":"2024-01-22T05:19:39.337377+0000","last_became_peered":"2024-01-22T05:19:39.337377+0000","last_unstale":"2024-01-22T05:19:39.346412+0000","last_undegraded":"2024-01-22T05:19:39.346412+0000","last_fullsized":"2024-01-22T05:19:39.346412+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.331906+0000","last_change":"2024-01-22T05:19:38.857590+0000","last_active":"2024-01-22T05:19:39.331906+0000","last_peered":"2024-01-22T05:19:39.331906+0000","last_clean":"2024-01-22T05:19:39.331906+0000","last_became_active":"2024-01-22T05:19:38.856882+0000","last_became_peered":"2024-01-22T05:19:38.856882+0000","last_unstale":"2024-01-22T05:19:39.331906+0000","last_undegraded":"2024-01-22T05:19:39.331906+0000","last_fullsized":"2024-01-22T05:19:39.331906+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.332700+0000","last_change":"2024-01-22T05:19:39.319985+0000","last_active":"2024-01-22T05:19:39.332700+0000","last_peered":"2024-01-22T05:19:39.332700+0000","last_clean":"2024-01-22T05:19:39.332700+0000","last_became_active":"2024-01-22T05:19:39.319675+0000","last_became_peered":"2024-01-22T05:19:39.319675+0000","last_unstale":"2024-01-22T05:19:39.332700+0000","last_undegraded":"2024-01-22T05:19:39.332700+0000","last_fullsized":"2024-01-22T05:19:39.332700+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.309363+0000","last_change":"2024-01-22T05:19:38.856870+0000","last_active":"2024-01-22T05:19:39.309363+0000","last_peered":"2024-01-22T05:19:39.309363+0000","last_clean":"2024-01-22T05:19:39.309363+0000","last_became_active":"2024-01-22T05:19:38.856537+0000","last_became_peered":"2024-01-22T05:19:38.856537+0000","last_unstale":"2024-01-22T05:19:39.309363+0000","last_undegraded":"2024-01-22T05:19:39.309363+0000","last_fullsized":"2024-01-22T05:19:39.309363+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345288+0000","last_change":"2024-01-22T05:19:39.340468+0000","last_active":"2024-01-22T05:19:39.345288+0000","last_peered":"2024-01-22T05:19:39.345288+0000","last_clean":"2024-01-22T05:19:39.345288+0000","last_became_active":"2024-01-22T05:19:39.339862+0000","last_became_peered":"2024-01-22T05:19:39.339862+0000","last_unstale":"2024-01-22T05:19:39.345288+0000","last_undegraded":"2024-01-22T05:19:39.345288+0000","last_fullsized":"2024-01-22T05:19:39.345288+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.318038+0000","last_change":"2024-01-22T05:19:38.868139+0000","last_active":"2024-01-22T05:19:39.318038+0000","last_peered":"2024-01-22T05:19:39.318038+0000","last_clean":"2024-01-22T05:19:39.318038+0000","last_became_active":"2024-01-22T05:19:38.867846+0000","last_became_peered":"2024-01-22T05:19:38.867846+0000","last_unstale":"2024-01-22T05:19:39.318038+0000","last_undegraded":"2024-01-22T05:19:39.318038+0000","last_fullsized":"2024-01-22T05:19:39.318038+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.340254+0000","last_change":"2024-01-22T05:19:39.325316+0000","last_active":"2024-01-22T05:19:39.340254+0000","last_peered":"2024-01-22T05:19:39.340254+0000","last_clean":"2024-01-22T05:19:39.340254+0000","last_became_active":"2024-01-22T05:19:39.325016+0000","last_became_peered":"2024-01-22T05:19:39.325016+0000","last_unstale":"2024-01-22T05:19:39.340254+0000","last_undegraded":"2024-01-22T05:19:39.340254+0000","last_fullsized":"2024-01-22T05:19:39.340254+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.324832+0000","last_change":"2024-01-22T05:19:38.869820+0000","last_active":"2024-01-22T05:19:39.324832+0000","last_peered":"2024-01-22T05:19:39.324832+0000","last_clean":"2024-01-22T05:19:39.324832+0000","last_became_active":"2024-01-22T05:19:38.869500+0000","last_became_peered":"2024-01-22T05:19:38.869500+0000","last_unstale":"2024-01-22T05:19:39.324832+0000","last_undegraded":"2024-01-22T05:19:39.324832+0000","last_fullsized":"2024-01-22T05:19:39.324832+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.320706+0000","last_change":"2024-01-22T05:19:39.318343+0000","last_active":"2024-01-22T05:19:39.320706+0000","last_peered":"2024-01-22T05:19:39.320706+0000","last_clean":"2024-01-22T05:19:39.320706+0000","last_became_active":"2024-01-22T05:19:39.318025+0000","last_became_peered":"2024-01-22T05:19:39.318025+0000","last_unstale":"2024-01-22T05:19:39.320706+0000","last_undegraded":"2024-01-22T05:19:39.320706+0000","last_fullsized":"2024-01-22T05:19:39.320706+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317345+0000","last_change":"2024-01-22T05:19:38.855612+0000","last_active":"2024-01-22T05:19:39.317345+0000","last_peered":"2024-01-22T05:19:39.317345+0000","last_clean":"2024-01-22T05:19:39.317345+0000","last_became_active":"2024-01-22T05:19:38.855342+0000","last_became_peered":"2024-01-22T05:19:38.855342+0000","last_unstale":"2024-01-22T05:19:39.317345+0000","last_undegraded":"2024-01-22T05:19:39.317345+0000","last_fullsized":"2024-01-22T05:19:39.317345+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.331385+0000","last_change":"2024-01-22T05:19:39.325957+0000","last_active":"2024-01-22T05:19:39.331385+0000","last_peered":"2024-01-22T05:19:39.331385+0000","last_clean":"2024-01-22T05:19:39.331385+0000","last_became_active":"2024-01-22T05:19:39.325687+0000","last_became_peered":"2024-01-22T05:19:39.325687+0000","last_unstale":"2024-01-22T05:19:39.331385+0000","last_undegraded":"2024-01-22T05:19:39.331385+0000","last_fullsized":"2024-01-22T05:19:39.331385+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308546+0000","last_change":"2024-01-22T05:19:38.846663+0000","last_active":"2024-01-22T05:19:39.308546+0000","last_peered":"2024-01-22T05:19:39.308546+0000","last_clean":"2024-01-22T05:19:39.308546+0000","last_became_active":"2024-01-22T05:19:38.846318+0000","last_became_peered":"2024-01-22T05:19:38.846318+0000","last_unstale":"2024-01-22T05:19:39.308546+0000","last_undegraded":"2024-01-22T05:19:39.308546+0000","last_fullsized":"2024-01-22T05:19:39.308546+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":162,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.327496+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:19:39.327496+0000","last_peered":"2024-01-22T05:19:39.327496+0000","last_clean":"2024-01-22T05:19:39.327496+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:19:39.327496+0000","last_undegraded":"2024-01-22T05:19:39.327496+0000","last_fullsized":"2024-01-22T05:19:39.327496+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.336602+0000","last_change":"2024-01-22T05:19:39.332469+0000","last_active":"2024-01-22T05:19:39.336602+0000","last_peered":"2024-01-22T05:19:39.336602+0000","last_clean":"2024-01-22T05:19:39.336602+0000","last_became_active":"2024-01-22T05:19:39.332189+0000","last_became_peered":"2024-01-22T05:19:39.332189+0000","last_unstale":"2024-01-22T05:19:39.336602+0000","last_undegraded":"2024-01-22T05:19:39.336602+0000","last_fullsized":"2024-01-22T05:19:39.336602+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308164+0000","last_change":"2024-01-22T05:19:38.854148+0000","last_active":"2024-01-22T05:19:39.308164+0000","last_peered":"2024-01-22T05:19:39.308164+0000","last_clean":"2024-01-22T05:19:39.308164+0000","last_became_active":"2024-01-22T05:19:38.853768+0000","last_became_peered":"2024-01-22T05:19:38.853768+0000","last_unstale":"2024-01-22T05:19:39.308164+0000","last_undegraded":"2024-01-22T05:19:39.308164+0000","last_fullsized":"2024-01-22T05:19:39.308164+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":167,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.328187+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:19:39.328187+0000","last_peered":"2024-01-22T05:19:39.328187+0000","last_clean":"2024-01-22T05:19:39.328187+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:19:39.328187+0000","last_undegraded":"2024-01-22T05:19:39.328187+0000","last_fullsized":"2024-01-22T05:19:39.328187+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344549+0000","last_change":"2024-01-22T05:19:39.343490+0000","last_active":"2024-01-22T05:19:39.344549+0000","last_peered":"2024-01-22T05:19:39.344549+0000","last_clean":"2024-01-22T05:19:39.344549+0000","last_became_active":"2024-01-22T05:19:39.342878+0000","last_became_peered":"2024-01-22T05:19:39.342878+0000","last_unstale":"2024-01-22T05:19:39.344549+0000","last_undegraded":"2024-01-22T05:19:39.344549+0000","last_fullsized":"2024-01-22T05:19:39.344549+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.323940+0000","last_change":"2024-01-22T05:19:38.866446+0000","last_active":"2024-01-22T05:19:39.323940+0000","last_peered":"2024-01-22T05:19:39.323940+0000","last_clean":"2024-01-22T05:19:39.323940+0000","last_became_active":"2024-01-22T05:19:38.866148+0000","last_became_peered":"2024-01-22T05:19:38.866148+0000","last_unstale":"2024-01-22T05:19:39.323940+0000","last_undegraded":"2024-01-22T05:19:39.323940+0000","last_fullsized":"2024-01-22T05:19:39.323940+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.313043+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:19:39.313043+0000","last_peered":"2024-01-22T05:19:39.313043+0000","last_clean":"2024-01-22T05:19:39.313043+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:19:39.313043+0000","last_undegraded":"2024-01-22T05:19:39.313043+0000","last_fullsized":"2024-01-22T05:19:39.313043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346324+0000","last_change":"2024-01-22T05:19:39.338219+0000","last_active":"2024-01-22T05:19:39.346324+0000","last_peered":"2024-01-22T05:19:39.346324+0000","last_clean":"2024-01-22T05:19:39.346324+0000","last_became_active":"2024-01-22T05:19:39.337956+0000","last_became_peered":"2024-01-22T05:19:39.337956+0000","last_unstale":"2024-01-22T05:19:39.346324+0000","last_undegraded":"2024-01-22T05:19:39.346324+0000","last_fullsized":"2024-01-22T05:19:39.346324+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.321023+0000","last_change":"2024-01-22T05:19:38.860675+0000","last_active":"2024-01-22T05:19:39.321023+0000","last_peered":"2024-01-22T05:19:39.321023+0000","last_clean":"2024-01-22T05:19:39.321023+0000","last_became_active":"2024-01-22T05:19:38.860371+0000","last_became_peered":"2024-01-22T05:19:38.860371+0000","last_unstale":"2024-01-22T05:19:39.321023+0000","last_undegraded":"2024-01-22T05:19:39.321023+0000","last_fullsized":"2024-01-22T05:19:39.321023+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":167,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.325853+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:19:39.325853+0000","last_peered":"2024-01-22T05:19:39.325853+0000","last_clean":"2024-01-22T05:19:39.325853+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:19:39.325853+0000","last_undegraded":"2024-01-22T05:19:39.325853+0000","last_fullsized":"2024-01-22T05:19:39.325853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.337480+0000","last_change":"2024-01-22T05:19:39.334614+0000","last_active":"2024-01-22T05:19:39.337480+0000","last_peered":"2024-01-22T05:19:39.337480+0000","last_clean":"2024-01-22T05:19:39.337480+0000","last_became_active":"2024-01-22T05:19:39.331645+0000","last_became_peered":"2024-01-22T05:19:39.331645+0000","last_unstale":"2024-01-22T05:19:39.337480+0000","last_undegraded":"2024-01-22T05:19:39.337480+0000","last_fullsized":"2024-01-22T05:19:39.337480+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.309239+0000","last_change":"2024-01-22T05:19:38.852843+0000","last_active":"2024-01-22T05:19:39.309239+0000","last_peered":"2024-01-22T05:19:39.309239+0000","last_clean":"2024-01-22T05:19:39.309239+0000","last_became_active":"2024-01-22T05:19:38.852464+0000","last_became_peered":"2024-01-22T05:19:38.852464+0000","last_unstale":"2024-01-22T05:19:39.309239+0000","last_undegraded":"2024-01-22T05:19:39.309239+0000","last_fullsized":"2024-01-22T05:19:39.309239+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":189,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308945+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:19:39.308945+0000","last_peered":"2024-01-22T05:19:39.308945+0000","last_clean":"2024-01-22T05:19:39.308945+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:19:39.308945+0000","last_undegraded":"2024-01-22T05:19:39.308945+0000","last_fullsized":"2024-01-22T05:19:39.308945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344523+0000","last_change":"2024-01-22T05:19:39.334626+0000","last_active":"2024-01-22T05:19:39.344523+0000","last_peered":"2024-01-22T05:19:39.344523+0000","last_clean":"2024-01-22T05:19:39.344523+0000","last_became_active":"2024-01-22T05:19:39.334355+0000","last_became_peered":"2024-01-22T05:19:39.334355+0000","last_unstale":"2024-01-22T05:19:39.344523+0000","last_undegraded":"2024-01-22T05:19:39.344523+0000","last_fullsized":"2024-01-22T05:19:39.344523+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343401+0000","last_change":"2024-01-22T05:19:38.859268+0000","last_active":"2024-01-22T05:19:39.343401+0000","last_peered":"2024-01-22T05:19:39.343401+0000","last_clean":"2024-01-22T05:19:39.343401+0000","last_became_active":"2024-01-22T05:19:38.858965+0000","last_became_peered":"2024-01-22T05:19:38.858965+0000","last_unstale":"2024-01-22T05:19:39.343401+0000","last_undegraded":"2024-01-22T05:19:39.343401+0000","last_fullsized":"2024-01-22T05:19:39.343401+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":164,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.320168+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:19:39.320168+0000","last_peered":"2024-01-22T05:19:39.320168+0000","last_clean":"2024-01-22T05:19:39.320168+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:19:39.320168+0000","last_undegraded":"2024-01-22T05:19:39.320168+0000","last_fullsized":"2024-01-22T05:19:39.320168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344833+0000","last_change":"2024-01-22T05:19:39.331633+0000","last_active":"2024-01-22T05:19:39.344833+0000","last_peered":"2024-01-22T05:19:39.344833+0000","last_clean":"2024-01-22T05:19:39.344833+0000","last_became_active":"2024-01-22T05:19:39.331359+0000","last_became_peered":"2024-01-22T05:19:39.331359+0000","last_unstale":"2024-01-22T05:19:39.344833+0000","last_undegraded":"2024-01-22T05:19:39.344833+0000","last_fullsized":"2024-01-22T05:19:39.344833+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.336765+0000","last_change":"2024-01-22T05:19:38.860899+0000","last_active":"2024-01-22T05:19:39.336765+0000","last_peered":"2024-01-22T05:19:39.336765+0000","last_clean":"2024-01-22T05:19:39.336765+0000","last_became_active":"2024-01-22T05:19:38.860614+0000","last_became_peered":"2024-01-22T05:19:38.860614+0000","last_unstale":"2024-01-22T05:19:39.336765+0000","last_undegraded":"2024-01-22T05:19:39.336765+0000","last_fullsized":"2024-01-22T05:19:39.336765+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.310658+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:19:39.310658+0000","last_peered":"2024-01-22T05:19:39.310658+0000","last_clean":"2024-01-22T05:19:39.310658+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:19:39.310658+0000","last_undegraded":"2024-01-22T05:19:39.310658+0000","last_fullsized":"2024-01-22T05:19:39.310658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.338105+0000","last_change":"2024-01-22T05:19:39.329527+0000","last_active":"2024-01-22T05:19:39.338105+0000","last_peered":"2024-01-22T05:19:39.338105+0000","last_clean":"2024-01-22T05:19:39.338105+0000","last_became_active":"2024-01-22T05:19:39.329039+0000","last_became_peered":"2024-01-22T05:19:39.329039+0000","last_unstale":"2024-01-22T05:19:39.338105+0000","last_undegraded":"2024-01-22T05:19:39.338105+0000","last_fullsized":"2024-01-22T05:19:39.338105+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"196'2","reported_seq":12,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344303+0000","last_change":"2024-01-22T05:19:38.862894+0000","last_active":"2024-01-22T05:19:39.344303+0000","last_peered":"2024-01-22T05:19:39.344303+0000","last_clean":"2024-01-22T05:19:39.344303+0000","last_became_active":"2024-01-22T05:19:38.862585+0000","last_became_peered":"2024-01-22T05:19:38.862585+0000","last_unstale":"2024-01-22T05:19:39.344303+0000","last_undegraded":"2024-01-22T05:19:39.344303+0000","last_fullsized":"2024-01-22T05:19:39.344303+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":189,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.309461+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:19:39.309461+0000","last_peered":"2024-01-22T05:19:39.309461+0000","last_clean":"2024-01-22T05:19:39.309461+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:19:39.309461+0000","last_undegraded":"2024-01-22T05:19:39.309461+0000","last_fullsized":"2024-01-22T05:19:39.309461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":156,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.310770+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:19:39.310770+0000","last_peered":"2024-01-22T05:19:39.310770+0000","last_clean":"2024-01-22T05:19:39.310770+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:19:39.310770+0000","last_undegraded":"2024-01-22T05:19:39.310770+0000","last_fullsized":"2024-01-22T05:19:39.310770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575033,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311936,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059904,"statfs":{"total":96636764160,"available":96317341696,"internally_reserved":0,"allocated":2482176,"data_stored":1239847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2450000000000001,"15min":1.0760000000000001},"min":{"1min":0.83299999999999996,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.5209999999999999,"5min":14.779999999999999,"15min":14.779999999999999},"last":1.119},{"interface":"front","average":{"1min":1.145,"5min":2.0070000000000001,"15min":1.3759999999999999},"min":{"1min":0.80000000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.55,"5min":76.662000000000006,"15min":76.662000000000006},"last":1.071}]},{"osd":1,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.167,"15min":1.0589999999999999},"min":{"1min":0.86199999999999999,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.4650000000000001,"5min":4.9269999999999996,"15min":4.9269999999999996},"last":1.016},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2989999999999999,"15min":1.2030000000000001},"min":{"1min":0.88,"5min":0.71599999999999997,"15min":0.58999999999999997},"max":{"1min":1.655,"5min":12.691000000000001,"15min":12.691000000000001},"last":1.302}]},{"osd":2,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1579999999999999,"15min":1.125},"min":{"1min":0.77800000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5700000000000001,"5min":2.1589999999999998,"15min":2.5150000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.355,"15min":1.2210000000000001},"min":{"1min":0.97699999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5449999999999999,"5min":15.036,"15min":15.036},"last":1.2809999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.9339999999999999,"15min":1.4470000000000001},"min":{"1min":0.92300000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.748,"5min":64.983999999999995,"15min":64.983999999999995},"last":1.482},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.4299999999999999,"15min":1.2949999999999999},"min":{"1min":1.0029999999999999,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":1.714,"5min":15.073,"15min":15.073},"last":1.351}]},{"osd":4,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.415,"15min":1.1850000000000001},"min":{"1min":0.77900000000000003,"5min":0.53000000000000003,"15min":0.32900000000000001},"max":{"1min":1.504,"5min":22.239000000000001,"15min":22.239000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.5269999999999999,"15min":1.2669999999999999},"min":{"1min":0.92000000000000004,"5min":0.68799999999999994,"15min":0.52200000000000002},"max":{"1min":1.9830000000000001,"5min":27.872,"15min":27.872},"last":1.214}]},{"osd":5,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":2.0110000000000001,"15min":1.452},"min":{"1min":0.88100000000000001,"5min":0.67400000000000004,"15min":0.40400000000000003},"max":{"1min":1.6279999999999999,"5min":65.652000000000001,"15min":65.652000000000001},"last":1.204},{"interface":"front","average":{"1min":1.387,"5min":1.341,"15min":1.2869999999999999},"min":{"1min":1.0589999999999999,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":2.1539999999999999,"5min":2.1629999999999998,"15min":3.625},"last":1.5589999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.363,"15min":1.262},"min":{"1min":0.997,"5min":0.80700000000000005,"15min":0.53400000000000003},"max":{"1min":2.3580000000000001,"5min":6.9939999999999998,"15min":6.9939999999999998},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.54,"15min":1.411},"min":{"1min":1.224,"5min":0.82999999999999996,"15min":0.56100000000000005},"max":{"1min":2.0600000000000001,"5min":12.965,"15min":12.965},"last":1.718}]}]},{"osd":6,"up_from":13,"seq":55834575033,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307856,"kb_used_data":2440,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063984,"statfs":{"total":96636764160,"available":96321519616,"internally_reserved":0,"allocated":2498560,"data_stored":1240527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.0580000000000001,"15min":1.2849999999999999},"min":{"1min":0.72999999999999998,"5min":0.66600000000000004,"15min":0.35999999999999999},"max":{"1min":1.927,"5min":1.927,"15min":77.745000000000005},"last":1.282},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0429999999999999,"15min":1.0780000000000001},"min":{"1min":0.64500000000000002,"5min":0.57499999999999996,"15min":0.44},"max":{"1min":1.5,"5min":1.74,"15min":13.555999999999999},"last":1.2569999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.0740000000000001,"15min":1.125},"min":{"1min":0.91300000000000003,"5min":0.56999999999999995,"15min":0.40000000000000002},"max":{"1min":1.3240000000000001,"5min":1.554,"15min":15.499000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.117,"15min":1.155},"min":{"1min":0.76200000000000001,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.6379999999999999,"5min":1.702,"15min":7.7629999999999999},"last":0.88500000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1850000000000001,"15min":1.165},"min":{"1min":0.89000000000000001,"5min":0.84999999999999998,"15min":0.57399999999999995},"max":{"1min":1.4199999999999999,"5min":1.667,"15min":3.0960000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.1359999999999999,"15min":1.145},"min":{"1min":0.747,"5min":0.68999999999999995,"15min":0.38200000000000001},"max":{"1min":1.401,"5min":1.7390000000000001,"15min":4.9660000000000002},"last":1.363}]},{"osd":3,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.173,"15min":1.486},"min":{"1min":0.97899999999999998,"5min":0.66700000000000004,"15min":0.59299999999999997},"max":{"1min":1.4610000000000001,"5min":2.343,"15min":102.08199999999999},"last":1.421},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.82599999999999996,"5min":0.66300000000000003,"15min":0.374},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":15.468},"last":1.3819999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1799999999999999,"15min":1.147},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.495},"max":{"1min":1.6040000000000001,"5min":1.631,"15min":3.1749999999999998},"last":1.002},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.204,"15min":1.165},"min":{"1min":0.82799999999999996,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.6910000000000001,"5min":2.5489999999999999,"15min":5.1200000000000001},"last":1.159}]},{"osd":5,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1499999999999999,"15min":1.2430000000000001},"min":{"1min":0.93000000000000005,"5min":0.58699999999999997,"15min":0.48099999999999998},"max":{"1min":1.6020000000000001,"5min":1.7829999999999999,"15min":30.533000000000001},"last":1.125},{"interface":"front","average":{"1min":1.359,"5min":1.294,"15min":1.278},"min":{"1min":1.0029999999999999,"5min":0.79500000000000004,"15min":0.46600000000000003},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":3.875},"last":1.341}]},{"osd":7,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3500000000000001,"15min":1.4279999999999999},"min":{"1min":0.97999999999999998,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":1.6379999999999999,"5min":2.7490000000000001,"15min":23.547999999999998},"last":1.474},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3149999999999999,"15min":1.5509999999999999},"min":{"1min":0.80200000000000005,"5min":0.77700000000000002,"15min":0.495},"max":{"1min":1.7110000000000001,"5min":1.9019999999999999,"15min":63.737000000000002},"last":1.226}]}]},{"osd":5,"up_from":13,"seq":55834575033,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307844,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063996,"statfs":{"total":96636764160,"available":96321531904,"internally_reserved":0,"allocated":2486272,"data_stored":1240401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0089999999999999,"15min":1.0129999999999999},"min":{"1min":0.58599999999999997,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.556,"5min":1.651,"15min":2.0609999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0529999999999999,"15min":1.042},"min":{"1min":0.61699999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5840000000000001,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.147}]},{"osd":1,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.224,"15min":1.1850000000000001},"min":{"1min":0.85099999999999998,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.6619999999999999,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2050000000000001,"15min":1.2},"min":{"1min":0.879,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.6140000000000001,"5min":1.9930000000000001,"15min":2.0209999999999999},"last":1.048}]},{"osd":2,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1479999999999999,"15min":1.135},"min":{"1min":0.80700000000000005,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.4370000000000001,"5min":1.9219999999999999,"15min":1.925},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.145,"15min":1.115},"min":{"1min":0.82499999999999996,"5min":0.71799999999999997,"15min":0.59899999999999998},"max":{"1min":1.4410000000000001,"5min":1.982,"15min":1.982},"last":1.3540000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.216,"15min":1.1599999999999999},"min":{"1min":0.71199999999999997,"5min":0.69799999999999995,"15min":0.66900000000000004},"max":{"1min":1.5660000000000001,"5min":3.202,"15min":3.202},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.1899999999999999,"15min":1.2090000000000001},"min":{"1min":0.98199999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.546,"5min":1.6830000000000001,"15min":4.8819999999999997},"last":1.2350000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.103,"15min":1.097},"min":{"1min":0.77700000000000002,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.5369999999999999,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1950000000000001,"15min":1.1779999999999999},"min":{"1min":0.78000000000000003,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.4430000000000001,"5min":2.081,"15min":2.081},"last":1.016}]},{"osd":6,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.226,"15min":1.2190000000000001},"min":{"1min":0.97999999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.482,"5min":2.0099999999999998,"15min":2.2010000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.24,"15min":1.2410000000000001},"min":{"1min":0.71899999999999997,"5min":0.70699999999999996,"15min":0.55900000000000005},"max":{"1min":1.4530000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.409}]},{"osd":7,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3169999999999999,"15min":1.304},"min":{"1min":0.91400000000000003,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.7410000000000001,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.371,"5min":1.3420000000000001,"15min":1.3360000000000001},"min":{"1min":0.96099999999999997,"5min":0.72699999999999998,"15min":0.60799999999999998},"max":{"1min":1.6819999999999999,"5min":1.8859999999999999,"15min":3.1840000000000002},"last":1.111}]}]},{"osd":4,"up_from":13,"seq":55834575033,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299648,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072192,"statfs":{"total":96636764160,"available":96329924608,"internally_reserved":0,"allocated":2482176,"data_stored":1239847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1279999999999999,"15min":1.103},"min":{"1min":0.81000000000000005,"5min":0.63700000000000001,"15min":0.47799999999999998},"max":{"1min":1.4379999999999999,"5min":1.696,"15min":2.0150000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1950000000000001,"15min":1.147},"min":{"1min":0.92100000000000004,"5min":0.75700000000000001,"15min":0.48899999999999999},"max":{"1min":1.548,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.1339999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.091,"15min":1.0760000000000001},"min":{"1min":0.77800000000000002,"5min":0.59899999999999998,"15min":0.53100000000000003},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.82199999999999995,"5min":0.52500000000000002,"15min":0.46000000000000002},"max":{"1min":1.3879999999999999,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.80100000000000005}]},{"osd":2,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0760000000000001,"15min":1.0720000000000001},"min":{"1min":0.79500000000000004,"5min":0.66400000000000003,"15min":0.49199999999999999},"max":{"1min":1.361,"5min":1.516,"15min":5.3390000000000004},"last":1.3},{"interface":"front","average":{"1min":1.204,"5min":1.149,"15min":1.161},"min":{"1min":0.88,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5089999999999999,"5min":1.6140000000000001,"15min":2.3479999999999999},"last":1.244}]},{"osd":3,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.149,"15min":1.135},"min":{"1min":0.86799999999999999,"5min":0.65700000000000003,"15min":0.496},"max":{"1min":1.478,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.26},{"interface":"front","average":{"1min":1.2,"5min":1.1719999999999999,"15min":1.1499999999999999},"min":{"1min":0.97199999999999998,"5min":0.67700000000000005,"15min":0.53100000000000003},"max":{"1min":1.4039999999999999,"5min":2.2959999999999998,"15min":5.3029999999999999},"last":1.2210000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.113,"15min":1.1180000000000001},"min":{"1min":0.76200000000000001,"5min":0.63500000000000001,"15min":0.54100000000000004},"max":{"1min":1.365,"5min":1.6899999999999999,"15min":2.0790000000000002},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.2070000000000001,"15min":1.133},"min":{"1min":0.94299999999999995,"5min":0.68200000000000005,"15min":0.52200000000000002},"max":{"1min":1.583,"5min":1.8240000000000001,"15min":2.0030000000000001},"last":1.4079999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.149,"15min":1.1439999999999999},"min":{"1min":0.88100000000000001,"5min":0.67400000000000004,"15min":0.44500000000000001},"max":{"1min":1.387,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.28,"15min":1.27},"min":{"1min":0.98999999999999999,"5min":0.73699999999999999,"15min":0.51900000000000002},"max":{"1min":1.45,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":1.1899999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3500000000000001,"15min":1.3120000000000001},"min":{"1min":1.0700000000000001,"5min":0.74099999999999999,"15min":0.59399999999999997},"max":{"1min":1.6299999999999999,"5min":1.8999999999999999,"15min":2.2839999999999998},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.94999999999999996,"5min":0.89300000000000002,"15min":0.56899999999999995},"max":{"1min":1.5049999999999999,"5min":1.843,"15min":5.2629999999999999},"last":1.3740000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575033,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303752,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068088,"statfs":{"total":96636764160,"available":96325722112,"internally_reserved":0,"allocated":2490368,"data_stored":1240491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.85699999999999998},"min":{"1min":0.50800000000000001,"5min":0.41099999999999998,"15min":0.34200000000000003},"max":{"1min":1.175,"5min":1.512,"15min":14.859},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.63400000000000001,"5min":0.42699999999999999,"15min":0.317},"max":{"1min":1.371,"5min":1.804,"15min":5.0919999999999996},"last":1.0780000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.90900000000000003,"15min":0.90300000000000002},"min":{"1min":0.62,"5min":0.50600000000000001,"15min":0.39300000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":6.5570000000000004},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.95699999999999996,"15min":0.97099999999999997},"min":{"1min":0.55800000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.482,"5min":1.7669999999999999,"15min":5.7519999999999998},"last":1.0169999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.085,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48599999999999999,"15min":0.40600000000000003},"max":{"1min":1.6910000000000001,"5min":1.8680000000000001,"15min":2.391},"last":1.458},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.157,"15min":1.1819999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.44800000000000001},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":4.1429999999999998},"last":1.357}]},{"osd":4,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.323,"15min":1.331},"min":{"1min":0.86699999999999999,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.831,"5min":2.423,"15min":10.858000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.292,"15min":1.337},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.63600000000000001},"max":{"1min":1.6379999999999999,"5min":2.3359999999999999,"15min":10.846},"last":1.4410000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.238,"15min":1.2829999999999999},"min":{"1min":0.99399999999999999,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.595,"5min":1.7709999999999999,"15min":7.3639999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.3089999999999999,"15min":1.381},"min":{"1min":0.92700000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.738,"5min":6.3220000000000001,"15min":14.523999999999999},"last":1.1259999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.369,"15min":1.357},"min":{"1min":0.92700000000000005,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.77,"5min":2.1819999999999999,"15min":4.9809999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.3720000000000001,"15min":1.3879999999999999},"min":{"1min":1.113,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":5.4210000000000003},"last":1.492}]},{"osd":7,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.3340000000000001,"15min":1.363},"min":{"1min":0.96999999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.004,"5min":2.004,"15min":5.7160000000000002},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.381,"15min":1.409},"min":{"1min":1.0860000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8839999999999999,"5min":2.5449999999999999,"15min":6.4279999999999999},"last":1.321}]}]},{"osd":2,"up_from":13,"seq":55834575033,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299668,"kb_used_data":2444,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072172,"statfs":{"total":96636764160,"available":96329904128,"internally_reserved":0,"allocated":2502656,"data_stored":1241439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.54100000000000004,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":1.1919999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.2809999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85499999999999998,"15min":0.85399999999999998},"min":{"1min":0.53900000000000003,"5min":0.45300000000000001,"15min":0.373},"max":{"1min":1.1899999999999999,"5min":1.556,"15min":1.7350000000000001},"last":0.91200000000000003}]},{"osd":1,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92600000000000005,"15min":0.86899999999999999},"min":{"1min":0.55400000000000005,"5min":0.46800000000000003,"15min":0.41299999999999998},"max":{"1min":1.8400000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.109,"5min":1,"15min":0.95799999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.41599999999999998},"max":{"1min":1.671,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.0720000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1659999999999999,"15min":1.137},"min":{"1min":0.66700000000000004,"5min":0.56200000000000006,"15min":0.47099999999999997},"max":{"1min":1.984,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.296,"5min":1.2370000000000001,"15min":1.212},"min":{"1min":0.85999999999999999,"5min":0.64300000000000002,"15min":0.51100000000000001},"max":{"1min":1.7609999999999999,"5min":3.133,"15min":3.133},"last":0.97899999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.3140000000000001,"15min":1.278},"min":{"1min":1.0029999999999999,"5min":0.88500000000000001,"15min":0.59099999999999997},"max":{"1min":2.101,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.25},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.206,"15min":1.2010000000000001},"min":{"1min":0.74099999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":2.2829999999999999},"last":1.3420000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.2649999999999999,"15min":1.228},"min":{"1min":0.94699999999999995,"5min":0.84099999999999997,"15min":0.63800000000000001},"max":{"1min":2.1680000000000001,"5min":2.379,"15min":2.379},"last":1.129},{"interface":"front","average":{"1min":1.45,"5min":1.329,"15min":1.2909999999999999},"min":{"1min":1.181,"5min":0.84799999999999998,"15min":0.67000000000000004},"max":{"1min":2.1880000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.2130000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2609999999999999,"15min":1.254},"min":{"1min":0.79500000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":2.1920000000000002},"last":1.26},{"interface":"front","average":{"1min":1.47,"5min":1.3720000000000001,"15min":1.3160000000000001},"min":{"1min":0.98899999999999999,"5min":0.629,"15min":0.629},"max":{"1min":2.2759999999999998,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.2270000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3560000000000001,"15min":1.345},"min":{"1min":0.88500000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8200000000000001,"5min":1.9390000000000001,"15min":2.1749999999999998},"last":1.431},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.452,"15min":1.4219999999999999},"min":{"1min":1.121,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.2280000000000002,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.417}]}]},{"osd":1,"up_from":13,"seq":55834575034,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311940,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059900,"statfs":{"total":96636764160,"available":96317337600,"internally_reserved":0,"allocated":2486272,"data_stored":1239937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84899999999999998,"15min":0.86599999999999999},"min":{"1min":0.53500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.032,"5min":1.4830000000000001,"15min":3.4119999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.054,"5min":0.98099999999999998,"15min":0.997},"min":{"1min":0.66100000000000003,"5min":0.56999999999999995,"15min":0.41099999999999998},"max":{"1min":1.5089999999999999,"5min":1.6160000000000001,"15min":2.101},"last":1}]},{"osd":2,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.97499999999999998,"15min":0.98899999999999999},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.45500000000000002},"max":{"1min":1.3180000000000001,"5min":1.492,"15min":2.169},"last":1.556},{"interface":"front","average":{"1min":1.075,"5min":1.0589999999999999,"15min":1.0549999999999999},"min":{"1min":0.64900000000000002,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.478,"5min":1.5780000000000001,"15min":2.024},"last":1.302}]},{"osd":3,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.052,"15min":1.0429999999999999},"min":{"1min":0.73999999999999999,"5min":0.57399999999999995,"15min":0.38900000000000001},"max":{"1min":1.502,"5min":1.972,"15min":4.665},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.64600000000000002,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.2629999999999999,"5min":1.659,"15min":5.5830000000000002},"last":0.81000000000000005}]},{"osd":4,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2110000000000001,"15min":1.2490000000000001},"min":{"1min":0.86299999999999999,"5min":0.60299999999999998,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":1.958,"15min":15.76},"last":1.647},{"interface":"front","average":{"1min":1.341,"5min":1.2809999999999999,"15min":1.333},"min":{"1min":0.90400000000000003,"5min":0.74099999999999999,"15min":0.63500000000000001},"max":{"1min":1.649,"5min":1.714,"15min":16.975000000000001},"last":1.393}]},{"osd":5,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.264,"15min":1.232},"min":{"1min":0.88200000000000001,"5min":0.72599999999999998,"15min":0.55700000000000005},"max":{"1min":1.6240000000000001,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.323},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.274,"15min":1.2789999999999999},"min":{"1min":0.97199999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.784,"5min":2.1309999999999998,"15min":2.52},"last":1.339}]},{"osd":6,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.266,"15min":1.2609999999999999},"min":{"1min":0.95099999999999996,"5min":0.68999999999999995,"15min":0.55600000000000005},"max":{"1min":1.53,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3,"15min":1.327},"min":{"1min":1.056,"5min":0.76200000000000001,"15min":0.68799999999999994},"max":{"1min":1.6459999999999999,"5min":2.0609999999999999,"15min":2.5569999999999999},"last":1.4490000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.339,"15min":1.355},"min":{"1min":0.96299999999999997,"5min":0.69999999999999996,"15min":0.68100000000000005},"max":{"1min":1.754,"5min":1.8999999999999999,"15min":4.4329999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.355,"15min":1.3520000000000001},"min":{"1min":1.0109999999999999,"5min":0.81100000000000005,"15min":0.64900000000000002},"max":{"1min":1.7010000000000001,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":1.48}]}]},{"osd":0,"up_from":13,"seq":55834575033,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1240899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.81799999999999995,"15min":0.88500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.28699999999999998},"max":{"1min":1.0609999999999999,"5min":1.4219999999999999,"15min":15.273},"last":1.206},{"interface":"front","average":{"1min":0.877,"5min":0.874,"15min":0.91300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.34499999999999997},"max":{"1min":1.3680000000000001,"5min":1.625,"15min":4.4009999999999998},"last":1.2549999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.97799999999999998,"15min":1.0449999999999999},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.46400000000000002},"max":{"1min":1.363,"5min":1.6299999999999999,"15min":15.473000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.069,"5min":1.0249999999999999,"15min":1.0269999999999999},"min":{"1min":0.67400000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5509999999999999,"5min":1.6850000000000001,"15min":1.7989999999999999},"last":1.4139999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.95899999999999996,"15min":0.97699999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.39000000000000001},"max":{"1min":1.302,"5min":1.5049999999999999,"15min":5.3970000000000002},"last":0.75},{"interface":"front","average":{"1min":1.069,"5min":1.1100000000000001,"15min":1.177},"min":{"1min":0.67200000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.5529999999999999,"5min":1.79,"15min":15.439},"last":0.88600000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.208,"15min":1.2470000000000001},"min":{"1min":0.81999999999999995,"5min":0.81399999999999995,"15min":0.61399999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":5.1799999999999997},"last":1.476},{"interface":"front","average":{"1min":1.222,"5min":1.214,"15min":1.216},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.56200000000000006},"max":{"1min":1.615,"5min":1.738,"15min":3.4340000000000002},"last":1.161}]},{"osd":5,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.272,"15min":1.27},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.67600000000000005},"max":{"1min":1.579,"5min":1.9099999999999999,"15min":3.548},"last":1.022},{"interface":"front","average":{"1min":1.272,"5min":1.306,"15min":1.321},"min":{"1min":0.90300000000000002,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.587,"5min":1.7210000000000001,"15min":2.823},"last":1.1359999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3300000000000001,"15min":1.407},"min":{"1min":0.91700000000000004,"5min":0.879,"15min":0.59099999999999997},"max":{"1min":1.6559999999999999,"5min":1.7909999999999999,"15min":15.4},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3200000000000001,"15min":1.3720000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.72499999999999998},"max":{"1min":1.7010000000000001,"5min":1.8919999999999999,"15min":7.1349999999999998},"last":1.538}]},{"osd":7,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3740000000000001,"15min":1.4219999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.79900000000000004},"max":{"1min":1.7969999999999999,"5min":2.145,"15min":5.29},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.3680000000000001,"15min":1.367},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.752},"max":{"1min":1.7230000000000001,"5min":2.0470000000000002,"15min":2.7269999999999999},"last":1.2170000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:19:43.702 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:19:43.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.907+0000 7f8784200700 1 Processor -- start 2024-01-22T05:19:43.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.907+0000 7f8784200700 1 -- start start 2024-01-22T05:19:43.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f8784200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f877c064c00 0x7f877c0bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f8784200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f877c065620 0x7f877c0bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f8784200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877c0c2700 con 0x7f877c065240 2024-01-22T05:19:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f8784200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877c0c29a0 con 0x7f877c064c00 2024-01-22T05:19:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f8784200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0c2c80 con 0x7f877c065620 2024-01-22T05:19:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f8781800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f877c065240 0x7f877c0644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53740/0 (socket says 172.21.15.49:53740) 2024-01-22T05:19:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f8781800700 1 -- 172.21.15.49:0/2421309832 learned_addr learned my addr 172.21.15.49:0/2421309832 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f8782c00700 1 --2- 172.21.15.49:0/2421309832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f877c065620 0x7f877c0bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f8780e00700 1 --2- 172.21.15.49:0/2421309832 >> v2:172.21.15.110:3300/0 conn(0x7f877c064c00 0x7f877c0bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f877be00700 1 -- 172.21.15.49:0/2421309832 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492571063 0 0) 0x7f877c0c2700 con 0x7f877c065240 2024-01-22T05:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f877be00700 1 -- 172.21.15.49:0/2421309832 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f875c0033f0 con 0x7f877c065240 2024-01-22T05:19:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f8782c00700 1 -- 172.21.15.49:0/2421309832 >> v2:172.21.15.110:3300/0 conn(0x7f877c064c00 msgr2=0x7f877c0bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f8782c00700 1 --2- 172.21.15.49:0/2421309832 >> v2:172.21.15.110:3300/0 conn(0x7f877c064c00 0x7f877c0bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f8782c00700 1 -- 172.21.15.49:0/2421309832 >> v1:172.21.15.49:6789/0 conn(0x7f877c065240 legacy=0x7f877c0644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f8782c00700 1 -- 172.21.15.49:0/2421309832 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c0c2f60 con 0x7f877c065620 2024-01-22T05:19:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.911+0000 7f8782c00700 1 --2- 172.21.15.49:0/2421309832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f877c065620 0x7f877c0bd170 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f8774009e60 tx=0x7f8774009780).ready entity=mon.2 client_cookie=b75fb3cbfaae2641 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.915+0000 7f877be00700 1 -- 172.21.15.49:0/2421309832 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877400e070 con 0x7f877c065620 2024-01-22T05:19:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.915+0000 7f877be00700 1 -- 172.21.15.49:0/2421309832 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877400bab0 con 0x7f877c065620 2024-01-22T05:19:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.915+0000 7f877be00700 1 -- 172.21.15.49:0/2421309832 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877400be30 con 0x7f877c065620 2024-01-22T05:19:43.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.915+0000 7f8784200700 1 -- 172.21.15.49:0/2421309832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f877c065620 msgr2=0x7f877c0bd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:43.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.915+0000 7f8784200700 1 --2- 172.21.15.49:0/2421309832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f877c065620 0x7f877c0bd170 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f8774009e60 tx=0x7f8774009780).stop 2024-01-22T05:19:43.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.915+0000 7f8784200700 1 -- 172.21.15.49:0/2421309832 shutdown_connections 2024-01-22T05:19:43.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.915+0000 7f8784200700 1 --2- 172.21.15.49:0/2421309832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f877c065620 0x7f877c0bd170 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.915+0000 7f8784200700 1 --2- 172.21.15.49:0/2421309832 >> v2:172.21.15.110:3300/0 conn(0x7f877c064c00 0x7f877c0bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.915+0000 7f8784200700 1 -- 172.21.15.49:0/2421309832 >> 172.21.15.49:0/2421309832 conn(0x7f877c0c87f0 msgr2=0x7f877c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:43.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.915+0000 7f8784200700 1 -- 172.21.15.49:0/2421309832 shutdown_connections 2024-01-22T05:19:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.915+0000 7f8784200700 1 -- 172.21.15.49:0/2421309832 wait complete. 2024-01-22T05:19:43.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.919+0000 7f8784200700 1 Processor -- start 2024-01-22T05:19:43.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.919+0000 7f8784200700 1 -- start start 2024-01-22T05:19:43.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8784200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f877c064c00 0x7f877c0a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8784200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c065240 0x7f877c152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8784200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f877c065620 0x7f877c0c1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8784200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0a8ca0 con 0x7f877c065240 2024-01-22T05:19:43.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8784200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0a9ac0 con 0x7f877c065620 2024-01-22T05:19:43.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8784200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0a8eb0 con 0x7f877c064c00 2024-01-22T05:19:43.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8780e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c065240 0x7f877c152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8780e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c065240 0x7f877c152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33878/0 (socket says 172.21.15.49:33878) 2024-01-22T05:19:43.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8780e00700 1 -- 172.21.15.49:0/2547578232 learned_addr learned my addr 172.21.15.49:0/2547578232 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:43.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8781800700 1 --2- 172.21.15.49:0/2547578232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f877c064c00 0x7f877c0a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8782c00700 1 --2- 172.21.15.49:0/2547578232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f877c065620 0x7f877c0c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8780e00700 1 -- 172.21.15.49:0/2547578232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f877c064c00 msgr2=0x7f877c0a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:43.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8780e00700 1 --2- 172.21.15.49:0/2547578232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f877c064c00 0x7f877c0a9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8780e00700 1 -- 172.21.15.49:0/2547578232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f877c065620 msgr2=0x7f877c0c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:43.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8780e00700 1 --2- 172.21.15.49:0/2547578232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f877c065620 0x7f877c0c1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:43.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8780e00700 1 -- 172.21.15.49:0/2547578232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8774009a20 con 0x7f877c065240 2024-01-22T05:19:43.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8780e00700 1 --2- 172.21.15.49:0/2547578232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c065240 0x7f877c152250 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 rx=0x7f876400e900 tx=0x7f8764009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:43.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8778c00700 1 -- 172.21.15.49:0/2547578232 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764012600 con 0x7f877c065240 2024-01-22T05:19:43.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8778c00700 1 -- 172.21.15.49:0/2547578232 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8764012760 con 0x7f877c065240 2024-01-22T05:19:43.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8784200700 1 -- 172.21.15.49:0/2547578232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877c0a9190 con 0x7f877c065240 2024-01-22T05:19:43.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8778c00700 1 -- 172.21.15.49:0/2547578232 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764012ae0 con 0x7f877c065240 2024-01-22T05:19:43.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.923+0000 7f8784200700 1 -- 172.21.15.49:0/2547578232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877c0a9750 con 0x7f877c065240 2024-01-22T05:19:43.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.927+0000 7f8784200700 1 -- 172.21.15.49:0/2547578232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877c0a9c30 con 0x7f877c065240 2024-01-22T05:19:43.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.927+0000 7f8778c00700 1 -- 172.21.15.49:0/2547578232 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f876401b400 con 0x7f877c065240 2024-01-22T05:19:43.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.927+0000 7f8778c00700 1 --2- 172.21.15.49:0/2547578232 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f875405a510 0x7f875405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:43.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.927+0000 7f8778c00700 1 -- 172.21.15.49:0/2547578232 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f8764074ba0 con 0x7f877c065240 2024-01-22T05:19:43.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.927+0000 7f8781800700 1 --2- 172.21.15.49:0/2547578232 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f875405a510 0x7f875405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:43.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.931+0000 7f8781800700 1 --2- 172.21.15.49:0/2547578232 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f875405a510 0x7f875405c9d0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f876c001200 tx=0x7f876c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:43.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:43.935+0000 7f8778c00700 1 -- 172.21.15.49:0/2547578232 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f87640481c0 con 0x7f877c065240 2024-01-22T05:19:44.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.095+0000 7f8784200700 1 -- 172.21.15.49:0/2547578232 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f877c047060 con 0x7f875405a510 2024-01-22T05:19:44.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.107+0000 7f8778c00700 1 -- 172.21.15.49:0/2547578232 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359517 (secure 0 0 0) 0x7f877c047060 con 0x7f875405a510 2024-01-22T05:19:44.114 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.115+0000 7f8784200700 1 -- 172.21.15.49:0/2547578232 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f875405a510 msgr2=0x7f875405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.115+0000 7f8784200700 1 --2- 172.21.15.49:0/2547578232 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f875405a510 0x7f875405c9d0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f876c001200 tx=0x7f876c009040).stop 2024-01-22T05:19:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.115+0000 7f8784200700 1 -- 172.21.15.49:0/2547578232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c065240 msgr2=0x7f877c152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.115+0000 7f8784200700 1 --2- 172.21.15.49:0/2547578232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c065240 0x7f877c152250 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 rx=0x7f876400e900 tx=0x7f8764009060).stop 2024-01-22T05:19:44.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.115+0000 7f8784200700 1 -- 172.21.15.49:0/2547578232 shutdown_connections 2024-01-22T05:19:44.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.115+0000 7f8784200700 1 --2- 172.21.15.49:0/2547578232 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f875405a510 0x7f875405c9d0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.115+0000 7f8784200700 1 --2- 172.21.15.49:0/2547578232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f877c065620 0x7f877c0c1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.115+0000 7f8784200700 1 --2- 172.21.15.49:0/2547578232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c065240 0x7f877c152250 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.115+0000 7f8784200700 1 --2- 172.21.15.49:0/2547578232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f877c064c00 0x7f877c0a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.115+0000 7f8784200700 1 -- 172.21.15.49:0/2547578232 >> 172.21.15.49:0/2547578232 conn(0x7f877c0c87f0 msgr2=0x7f877c0ab560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:44.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.115+0000 7f8784200700 1 -- 172.21.15.49:0/2547578232 shutdown_connections 2024-01-22T05:19:44.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.115+0000 7f8784200700 1 -- 172.21.15.49:0/2547578232 wait complete. 2024-01-22T05:19:44.121 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:19:44.140 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":648,"stamp":"2024-01-22T05:19:43.568550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":221,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454592,"kb_used_data":19456,"kb_used_omap":0,"kb_used_meta":2435072,"kb_avail":752520128,"statfs":{"total":773094113280,"available":770580611072,"internally_reserved":0,"allocated":19922944,"data_stored":9923388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2493513728},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3908464,"num_objects":-959,"num_object_clones":0,"num_object_copies":-1918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-959,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-987,"num_write_kb":-4765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.067263"},"pg_stats":[{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.340863+0000","last_change":"2024-01-22T05:19:39.336606+0000","last_active":"2024-01-22T05:19:39.340863+0000","last_peered":"2024-01-22T05:19:39.340863+0000","last_clean":"2024-01-22T05:19:39.340863+0000","last_became_active":"2024-01-22T05:19:39.333842+0000","last_became_peered":"2024-01-22T05:19:39.333842+0000","last_unstale":"2024-01-22T05:19:39.340863+0000","last_undegraded":"2024-01-22T05:19:39.340863+0000","last_fullsized":"2024-01-22T05:19:39.340863+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3f","version":"196'3","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.342076+0000","last_change":"2024-01-22T05:19:38.860474+0000","last_active":"2024-01-22T05:19:39.342076+0000","last_peered":"2024-01-22T05:19:39.342076+0000","last_clean":"2024-01-22T05:19:39.342076+0000","last_became_active":"2024-01-22T05:19:38.860177+0000","last_became_peered":"2024-01-22T05:19:38.860177+0000","last_unstale":"2024-01-22T05:19:39.342076+0000","last_undegraded":"2024-01-22T05:19:39.342076+0000","last_fullsized":"2024-01-22T05:19:39.342076+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.338000+0000","last_change":"2024-01-22T05:19:39.331997+0000","last_active":"2024-01-22T05:19:39.338000+0000","last_peered":"2024-01-22T05:19:39.338000+0000","last_clean":"2024-01-22T05:19:39.338000+0000","last_became_active":"2024-01-22T05:19:39.331382+0000","last_became_peered":"2024-01-22T05:19:39.331382+0000","last_unstale":"2024-01-22T05:19:39.338000+0000","last_undegraded":"2024-01-22T05:19:39.338000+0000","last_fullsized":"2024-01-22T05:19:39.338000+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.309315+0000","last_change":"2024-01-22T05:19:38.860463+0000","last_active":"2024-01-22T05:19:39.309315+0000","last_peered":"2024-01-22T05:19:39.309315+0000","last_clean":"2024-01-22T05:19:39.309315+0000","last_became_active":"2024-01-22T05:19:38.857044+0000","last_became_peered":"2024-01-22T05:19:38.857044+0000","last_unstale":"2024-01-22T05:19:39.309315+0000","last_undegraded":"2024-01-22T05:19:39.309315+0000","last_fullsized":"2024-01-22T05:19:39.309315+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346398+0000","last_change":"2024-01-22T05:19:39.341045+0000","last_active":"2024-01-22T05:19:39.346398+0000","last_peered":"2024-01-22T05:19:39.346398+0000","last_clean":"2024-01-22T05:19:39.346398+0000","last_became_active":"2024-01-22T05:19:39.340784+0000","last_became_peered":"2024-01-22T05:19:39.340784+0000","last_unstale":"2024-01-22T05:19:39.346398+0000","last_undegraded":"2024-01-22T05:19:39.346398+0000","last_fullsized":"2024-01-22T05:19:39.346398+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.329265+0000","last_change":"2024-01-22T05:19:38.872917+0000","last_active":"2024-01-22T05:19:39.329265+0000","last_peered":"2024-01-22T05:19:39.329265+0000","last_clean":"2024-01-22T05:19:39.329265+0000","last_became_active":"2024-01-22T05:19:38.872472+0000","last_became_peered":"2024-01-22T05:19:38.872472+0000","last_unstale":"2024-01-22T05:19:39.329265+0000","last_undegraded":"2024-01-22T05:19:39.329265+0000","last_fullsized":"2024-01-22T05:19:39.329265+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344304+0000","last_change":"2024-01-22T05:19:39.329320+0000","last_active":"2024-01-22T05:19:39.344304+0000","last_peered":"2024-01-22T05:19:39.344304+0000","last_clean":"2024-01-22T05:19:39.344304+0000","last_became_active":"2024-01-22T05:19:39.328941+0000","last_became_peered":"2024-01-22T05:19:39.328941+0000","last_unstale":"2024-01-22T05:19:39.344304+0000","last_undegraded":"2024-01-22T05:19:39.344304+0000","last_fullsized":"2024-01-22T05:19:39.344304+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.3c","version":"196'2","reported_seq":12,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.338158+0000","last_change":"2024-01-22T05:19:38.868662+0000","last_active":"2024-01-22T05:19:39.338158+0000","last_peered":"2024-01-22T05:19:39.338158+0000","last_clean":"2024-01-22T05:19:39.338158+0000","last_became_active":"2024-01-22T05:19:38.868341+0000","last_became_peered":"2024-01-22T05:19:38.868341+0000","last_unstale":"2024-01-22T05:19:39.338158+0000","last_undegraded":"2024-01-22T05:19:39.338158+0000","last_fullsized":"2024-01-22T05:19:39.338158+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.330848+0000","last_change":"2024-01-22T05:19:39.326238+0000","last_active":"2024-01-22T05:19:39.330848+0000","last_peered":"2024-01-22T05:19:39.330848+0000","last_clean":"2024-01-22T05:19:39.330848+0000","last_became_active":"2024-01-22T05:19:39.325223+0000","last_became_peered":"2024-01-22T05:19:39.325223+0000","last_unstale":"2024-01-22T05:19:39.330848+0000","last_undegraded":"2024-01-22T05:19:39.330848+0000","last_fullsized":"2024-01-22T05:19:39.330848+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3b","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343242+0000","last_change":"2024-01-22T05:19:38.869366+0000","last_active":"2024-01-22T05:19:39.343242+0000","last_peered":"2024-01-22T05:19:39.343242+0000","last_clean":"2024-01-22T05:19:39.343242+0000","last_became_active":"2024-01-22T05:19:38.869035+0000","last_became_peered":"2024-01-22T05:19:38.869035+0000","last_unstale":"2024-01-22T05:19:39.343242+0000","last_undegraded":"2024-01-22T05:19:39.343242+0000","last_fullsized":"2024-01-22T05:19:39.343242+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345171+0000","last_change":"2024-01-22T05:19:39.335893+0000","last_active":"2024-01-22T05:19:39.345171+0000","last_peered":"2024-01-22T05:19:39.345171+0000","last_clean":"2024-01-22T05:19:39.345171+0000","last_became_active":"2024-01-22T05:19:39.335619+0000","last_became_peered":"2024-01-22T05:19:39.335619+0000","last_unstale":"2024-01-22T05:19:39.345171+0000","last_undegraded":"2024-01-22T05:19:39.345171+0000","last_fullsized":"2024-01-22T05:19:39.345171+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3a","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.342190+0000","last_change":"2024-01-22T05:19:38.869852+0000","last_active":"2024-01-22T05:19:39.342190+0000","last_peered":"2024-01-22T05:19:39.342190+0000","last_clean":"2024-01-22T05:19:39.342190+0000","last_became_active":"2024-01-22T05:19:38.869483+0000","last_became_peered":"2024-01-22T05:19:38.869483+0000","last_unstale":"2024-01-22T05:19:39.342190+0000","last_undegraded":"2024-01-22T05:19:39.342190+0000","last_fullsized":"2024-01-22T05:19:39.342190+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345488+0000","last_change":"2024-01-22T05:19:39.341967+0000","last_active":"2024-01-22T05:19:39.345488+0000","last_peered":"2024-01-22T05:19:39.345488+0000","last_clean":"2024-01-22T05:19:39.345488+0000","last_became_active":"2024-01-22T05:19:39.340717+0000","last_became_peered":"2024-01-22T05:19:39.340717+0000","last_unstale":"2024-01-22T05:19:39.345488+0000","last_undegraded":"2024-01-22T05:19:39.345488+0000","last_fullsized":"2024-01-22T05:19:39.345488+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.320088+0000","last_change":"2024-01-22T05:19:38.869398+0000","last_active":"2024-01-22T05:19:39.320088+0000","last_peered":"2024-01-22T05:19:39.320088+0000","last_clean":"2024-01-22T05:19:39.320088+0000","last_became_active":"2024-01-22T05:19:38.869063+0000","last_became_peered":"2024-01-22T05:19:38.869063+0000","last_unstale":"2024-01-22T05:19:39.320088+0000","last_undegraded":"2024-01-22T05:19:39.320088+0000","last_fullsized":"2024-01-22T05:19:39.320088+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343749+0000","last_change":"2024-01-22T05:19:39.327123+0000","last_active":"2024-01-22T05:19:39.343749+0000","last_peered":"2024-01-22T05:19:39.343749+0000","last_clean":"2024-01-22T05:19:39.343749+0000","last_became_active":"2024-01-22T05:19:39.325018+0000","last_became_peered":"2024-01-22T05:19:39.325018+0000","last_unstale":"2024-01-22T05:19:39.343749+0000","last_undegraded":"2024-01-22T05:19:39.343749+0000","last_fullsized":"2024-01-22T05:19:39.343749+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317114+0000","last_change":"2024-01-22T05:19:38.862533+0000","last_active":"2024-01-22T05:19:39.317114+0000","last_peered":"2024-01-22T05:19:39.317114+0000","last_clean":"2024-01-22T05:19:39.317114+0000","last_became_active":"2024-01-22T05:19:38.862271+0000","last_became_peered":"2024-01-22T05:19:38.862271+0000","last_unstale":"2024-01-22T05:19:39.317114+0000","last_undegraded":"2024-01-22T05:19:39.317114+0000","last_fullsized":"2024-01-22T05:19:39.317114+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.341095+0000","last_change":"2024-01-22T05:19:39.334701+0000","last_active":"2024-01-22T05:19:39.341095+0000","last_peered":"2024-01-22T05:19:39.341095+0000","last_clean":"2024-01-22T05:19:39.341095+0000","last_became_active":"2024-01-22T05:19:39.333501+0000","last_became_peered":"2024-01-22T05:19:39.333501+0000","last_unstale":"2024-01-22T05:19:39.341095+0000","last_undegraded":"2024-01-22T05:19:39.341095+0000","last_fullsized":"2024-01-22T05:19:39.341095+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317388+0000","last_change":"2024-01-22T05:19:38.846932+0000","last_active":"2024-01-22T05:19:39.317388+0000","last_peered":"2024-01-22T05:19:39.317388+0000","last_clean":"2024-01-22T05:19:39.317388+0000","last_became_active":"2024-01-22T05:19:38.846597+0000","last_became_peered":"2024-01-22T05:19:38.846597+0000","last_unstale":"2024-01-22T05:19:39.317388+0000","last_undegraded":"2024-01-22T05:19:39.317388+0000","last_fullsized":"2024-01-22T05:19:39.317388+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344593+0000","last_change":"2024-01-22T05:19:39.335089+0000","last_active":"2024-01-22T05:19:39.344593+0000","last_peered":"2024-01-22T05:19:39.344593+0000","last_clean":"2024-01-22T05:19:39.344593+0000","last_became_active":"2024-01-22T05:19:39.334763+0000","last_became_peered":"2024-01-22T05:19:39.334763+0000","last_unstale":"2024-01-22T05:19:39.344593+0000","last_undegraded":"2024-01-22T05:19:39.344593+0000","last_fullsized":"2024-01-22T05:19:39.344593+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.325865+0000","last_change":"2024-01-22T05:19:38.866754+0000","last_active":"2024-01-22T05:19:39.325865+0000","last_peered":"2024-01-22T05:19:39.325865+0000","last_clean":"2024-01-22T05:19:39.325865+0000","last_became_active":"2024-01-22T05:19:38.866466+0000","last_became_peered":"2024-01-22T05:19:38.866466+0000","last_unstale":"2024-01-22T05:19:39.325865+0000","last_undegraded":"2024-01-22T05:19:39.325865+0000","last_fullsized":"2024-01-22T05:19:39.325865+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.336255+0000","last_change":"2024-01-22T05:19:39.323355+0000","last_active":"2024-01-22T05:19:39.336255+0000","last_peered":"2024-01-22T05:19:39.336255+0000","last_clean":"2024-01-22T05:19:39.336255+0000","last_became_active":"2024-01-22T05:19:39.321996+0000","last_became_peered":"2024-01-22T05:19:39.321996+0000","last_unstale":"2024-01-22T05:19:39.336255+0000","last_undegraded":"2024-01-22T05:19:39.336255+0000","last_fullsized":"2024-01-22T05:19:39.336255+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.329358+0000","last_change":"2024-01-22T05:19:38.873352+0000","last_active":"2024-01-22T05:19:39.329358+0000","last_peered":"2024-01-22T05:19:39.329358+0000","last_clean":"2024-01-22T05:19:39.329358+0000","last_became_active":"2024-01-22T05:19:38.871800+0000","last_became_peered":"2024-01-22T05:19:38.871800+0000","last_unstale":"2024-01-22T05:19:39.329358+0000","last_undegraded":"2024-01-22T05:19:39.329358+0000","last_fullsized":"2024-01-22T05:19:39.329358+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343659+0000","last_change":"2024-01-22T05:19:39.337953+0000","last_active":"2024-01-22T05:19:39.343659+0000","last_peered":"2024-01-22T05:19:39.343659+0000","last_clean":"2024-01-22T05:19:39.343659+0000","last_became_active":"2024-01-22T05:19:39.337171+0000","last_became_peered":"2024-01-22T05:19:39.337171+0000","last_unstale":"2024-01-22T05:19:39.343659+0000","last_undegraded":"2024-01-22T05:19:39.343659+0000","last_fullsized":"2024-01-22T05:19:39.343659+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.34","version":"196'4","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.347145+0000","last_change":"2024-01-22T05:19:38.866673+0000","last_active":"2024-01-22T05:19:39.347145+0000","last_peered":"2024-01-22T05:19:39.347145+0000","last_clean":"2024-01-22T05:19:39.347145+0000","last_became_active":"2024-01-22T05:19:38.866388+0000","last_became_peered":"2024-01-22T05:19:38.866388+0000","last_unstale":"2024-01-22T05:19:39.347145+0000","last_undegraded":"2024-01-22T05:19:39.347145+0000","last_fullsized":"2024-01-22T05:19:39.347145+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.335472+0000","last_change":"2024-01-22T05:19:39.328659+0000","last_active":"2024-01-22T05:19:39.335472+0000","last_peered":"2024-01-22T05:19:39.335472+0000","last_clean":"2024-01-22T05:19:39.335472+0000","last_became_active":"2024-01-22T05:19:39.328203+0000","last_became_peered":"2024-01-22T05:19:39.328203+0000","last_unstale":"2024-01-22T05:19:39.335472+0000","last_undegraded":"2024-01-22T05:19:39.335472+0000","last_fullsized":"2024-01-22T05:19:39.335472+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.33","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.339708+0000","last_change":"2024-01-22T05:19:38.869528+0000","last_active":"2024-01-22T05:19:39.339708+0000","last_peered":"2024-01-22T05:19:39.339708+0000","last_clean":"2024-01-22T05:19:39.339708+0000","last_became_active":"2024-01-22T05:19:38.869157+0000","last_became_peered":"2024-01-22T05:19:38.869157+0000","last_unstale":"2024-01-22T05:19:39.339708+0000","last_undegraded":"2024-01-22T05:19:39.339708+0000","last_fullsized":"2024-01-22T05:19:39.339708+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.333144+0000","last_change":"2024-01-22T05:19:39.321197+0000","last_active":"2024-01-22T05:19:39.333144+0000","last_peered":"2024-01-22T05:19:39.333144+0000","last_clean":"2024-01-22T05:19:39.333144+0000","last_became_active":"2024-01-22T05:19:39.320846+0000","last_became_peered":"2024-01-22T05:19:39.320846+0000","last_unstale":"2024-01-22T05:19:39.333144+0000","last_undegraded":"2024-01-22T05:19:39.333144+0000","last_fullsized":"2024-01-22T05:19:39.333144+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.320831+0000","last_change":"2024-01-22T05:19:38.859666+0000","last_active":"2024-01-22T05:19:39.320831+0000","last_peered":"2024-01-22T05:19:39.320831+0000","last_clean":"2024-01-22T05:19:39.320831+0000","last_became_active":"2024-01-22T05:19:38.856953+0000","last_became_peered":"2024-01-22T05:19:38.856953+0000","last_unstale":"2024-01-22T05:19:39.320831+0000","last_undegraded":"2024-01-22T05:19:39.320831+0000","last_fullsized":"2024-01-22T05:19:39.320831+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.336337+0000","last_change":"2024-01-22T05:19:39.329587+0000","last_active":"2024-01-22T05:19:39.336337+0000","last_peered":"2024-01-22T05:19:39.336337+0000","last_clean":"2024-01-22T05:19:39.336337+0000","last_became_active":"2024-01-22T05:19:39.322887+0000","last_became_peered":"2024-01-22T05:19:39.322887+0000","last_unstale":"2024-01-22T05:19:39.336337+0000","last_undegraded":"2024-01-22T05:19:39.336337+0000","last_fullsized":"2024-01-22T05:19:39.336337+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308619+0000","last_change":"2024-01-22T05:19:38.860029+0000","last_active":"2024-01-22T05:19:39.308619+0000","last_peered":"2024-01-22T05:19:39.308619+0000","last_clean":"2024-01-22T05:19:39.308619+0000","last_became_active":"2024-01-22T05:19:38.859676+0000","last_became_peered":"2024-01-22T05:19:38.859676+0000","last_unstale":"2024-01-22T05:19:39.308619+0000","last_undegraded":"2024-01-22T05:19:39.308619+0000","last_fullsized":"2024-01-22T05:19:39.308619+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.337274+0000","last_change":"2024-01-22T05:19:39.334944+0000","last_active":"2024-01-22T05:19:39.337274+0000","last_peered":"2024-01-22T05:19:39.337274+0000","last_clean":"2024-01-22T05:19:39.337274+0000","last_became_active":"2024-01-22T05:19:39.334592+0000","last_became_peered":"2024-01-22T05:19:39.334592+0000","last_unstale":"2024-01-22T05:19:39.337274+0000","last_undegraded":"2024-01-22T05:19:39.337274+0000","last_fullsized":"2024-01-22T05:19:39.337274+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.30","version":"196'4","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.341380+0000","last_change":"2024-01-22T05:19:38.861605+0000","last_active":"2024-01-22T05:19:39.341380+0000","last_peered":"2024-01-22T05:19:39.341380+0000","last_clean":"2024-01-22T05:19:39.341380+0000","last_became_active":"2024-01-22T05:19:38.861289+0000","last_became_peered":"2024-01-22T05:19:38.861289+0000","last_unstale":"2024-01-22T05:19:39.341380+0000","last_undegraded":"2024-01-22T05:19:39.341380+0000","last_fullsized":"2024-01-22T05:19:39.341380+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.341272+0000","last_change":"2024-01-22T05:19:39.338968+0000","last_active":"2024-01-22T05:19:39.341272+0000","last_peered":"2024-01-22T05:19:39.341272+0000","last_clean":"2024-01-22T05:19:39.341272+0000","last_became_active":"2024-01-22T05:19:39.338708+0000","last_became_peered":"2024-01-22T05:19:39.338708+0000","last_unstale":"2024-01-22T05:19:39.341272+0000","last_undegraded":"2024-01-22T05:19:39.341272+0000","last_fullsized":"2024-01-22T05:19:39.341272+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317496+0000","last_change":"2024-01-22T05:19:38.870046+0000","last_active":"2024-01-22T05:19:39.317496+0000","last_peered":"2024-01-22T05:19:39.317496+0000","last_clean":"2024-01-22T05:19:39.317496+0000","last_became_active":"2024-01-22T05:19:38.868880+0000","last_became_peered":"2024-01-22T05:19:38.868880+0000","last_unstale":"2024-01-22T05:19:39.317496+0000","last_undegraded":"2024-01-22T05:19:39.317496+0000","last_fullsized":"2024-01-22T05:19:39.317496+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.335722+0000","last_change":"2024-01-22T05:19:39.328087+0000","last_active":"2024-01-22T05:19:39.335722+0000","last_peered":"2024-01-22T05:19:39.335722+0000","last_clean":"2024-01-22T05:19:39.335722+0000","last_became_active":"2024-01-22T05:19:39.327801+0000","last_became_peered":"2024-01-22T05:19:39.327801+0000","last_unstale":"2024-01-22T05:19:39.335722+0000","last_undegraded":"2024-01-22T05:19:39.335722+0000","last_fullsized":"2024-01-22T05:19:39.335722+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317159+0000","last_change":"2024-01-22T05:19:38.871006+0000","last_active":"2024-01-22T05:19:39.317159+0000","last_peered":"2024-01-22T05:19:39.317159+0000","last_clean":"2024-01-22T05:19:39.317159+0000","last_became_active":"2024-01-22T05:19:38.870697+0000","last_became_peered":"2024-01-22T05:19:38.870697+0000","last_unstale":"2024-01-22T05:19:39.317159+0000","last_undegraded":"2024-01-22T05:19:39.317159+0000","last_fullsized":"2024-01-22T05:19:39.317159+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.330930+0000","last_change":"2024-01-22T05:19:39.324287+0000","last_active":"2024-01-22T05:19:39.330930+0000","last_peered":"2024-01-22T05:19:39.330930+0000","last_clean":"2024-01-22T05:19:39.330930+0000","last_became_active":"2024-01-22T05:19:39.324000+0000","last_became_peered":"2024-01-22T05:19:39.324000+0000","last_unstale":"2024-01-22T05:19:39.330930+0000","last_undegraded":"2024-01-22T05:19:39.330930+0000","last_fullsized":"2024-01-22T05:19:39.330930+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2d","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344362+0000","last_change":"2024-01-22T05:19:38.854628+0000","last_active":"2024-01-22T05:19:39.344362+0000","last_peered":"2024-01-22T05:19:39.344362+0000","last_clean":"2024-01-22T05:19:39.344362+0000","last_became_active":"2024-01-22T05:19:38.854341+0000","last_became_peered":"2024-01-22T05:19:38.854341+0000","last_unstale":"2024-01-22T05:19:39.344362+0000","last_undegraded":"2024-01-22T05:19:39.344362+0000","last_fullsized":"2024-01-22T05:19:39.344362+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346436+0000","last_change":"2024-01-22T05:19:39.341609+0000","last_active":"2024-01-22T05:19:39.346436+0000","last_peered":"2024-01-22T05:19:39.346436+0000","last_clean":"2024-01-22T05:19:39.346436+0000","last_became_active":"2024-01-22T05:19:39.338157+0000","last_became_peered":"2024-01-22T05:19:39.338157+0000","last_unstale":"2024-01-22T05:19:39.346436+0000","last_undegraded":"2024-01-22T05:19:39.346436+0000","last_fullsized":"2024-01-22T05:19:39.346436+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.331802+0000","last_change":"2024-01-22T05:19:38.850365+0000","last_active":"2024-01-22T05:19:39.331802+0000","last_peered":"2024-01-22T05:19:39.331802+0000","last_clean":"2024-01-22T05:19:39.331802+0000","last_became_active":"2024-01-22T05:19:38.849105+0000","last_became_peered":"2024-01-22T05:19:38.849105+0000","last_unstale":"2024-01-22T05:19:39.331802+0000","last_undegraded":"2024-01-22T05:19:39.331802+0000","last_fullsized":"2024-01-22T05:19:39.331802+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344900+0000","last_change":"2024-01-22T05:19:39.342744+0000","last_active":"2024-01-22T05:19:39.344900+0000","last_peered":"2024-01-22T05:19:39.344900+0000","last_clean":"2024-01-22T05:19:39.344900+0000","last_became_active":"2024-01-22T05:19:39.342397+0000","last_became_peered":"2024-01-22T05:19:39.342397+0000","last_unstale":"2024-01-22T05:19:39.344900+0000","last_undegraded":"2024-01-22T05:19:39.344900+0000","last_fullsized":"2024-01-22T05:19:39.344900+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2b","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344527+0000","last_change":"2024-01-22T05:19:38.857625+0000","last_active":"2024-01-22T05:19:39.344527+0000","last_peered":"2024-01-22T05:19:39.344527+0000","last_clean":"2024-01-22T05:19:39.344527+0000","last_became_active":"2024-01-22T05:19:38.856260+0000","last_became_peered":"2024-01-22T05:19:38.856260+0000","last_unstale":"2024-01-22T05:19:39.344527+0000","last_undegraded":"2024-01-22T05:19:39.344527+0000","last_fullsized":"2024-01-22T05:19:39.344527+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345327+0000","last_change":"2024-01-22T05:19:39.336330+0000","last_active":"2024-01-22T05:19:39.345327+0000","last_peered":"2024-01-22T05:19:39.345327+0000","last_clean":"2024-01-22T05:19:39.345327+0000","last_became_active":"2024-01-22T05:19:39.335230+0000","last_became_peered":"2024-01-22T05:19:39.335230+0000","last_unstale":"2024-01-22T05:19:39.345327+0000","last_undegraded":"2024-01-22T05:19:39.345327+0000","last_fullsized":"2024-01-22T05:19:39.345327+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.320928+0000","last_change":"2024-01-22T05:19:38.857212+0000","last_active":"2024-01-22T05:19:39.320928+0000","last_peered":"2024-01-22T05:19:39.320928+0000","last_clean":"2024-01-22T05:19:39.320928+0000","last_became_active":"2024-01-22T05:19:38.856618+0000","last_became_peered":"2024-01-22T05:19:38.856618+0000","last_unstale":"2024-01-22T05:19:39.320928+0000","last_undegraded":"2024-01-22T05:19:39.320928+0000","last_fullsized":"2024-01-22T05:19:39.320928+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345189+0000","last_change":"2024-01-22T05:19:39.335982+0000","last_active":"2024-01-22T05:19:39.345189+0000","last_peered":"2024-01-22T05:19:39.345189+0000","last_clean":"2024-01-22T05:19:39.345189+0000","last_became_active":"2024-01-22T05:19:39.334912+0000","last_became_peered":"2024-01-22T05:19:39.334912+0000","last_unstale":"2024-01-22T05:19:39.345189+0000","last_undegraded":"2024-01-22T05:19:39.345189+0000","last_fullsized":"2024-01-22T05:19:39.345189+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308005+0000","last_change":"2024-01-22T05:19:38.855796+0000","last_active":"2024-01-22T05:19:39.308005+0000","last_peered":"2024-01-22T05:19:39.308005+0000","last_clean":"2024-01-22T05:19:39.308005+0000","last_became_active":"2024-01-22T05:19:38.855389+0000","last_became_peered":"2024-01-22T05:19:38.855389+0000","last_unstale":"2024-01-22T05:19:39.308005+0000","last_undegraded":"2024-01-22T05:19:39.308005+0000","last_fullsized":"2024-01-22T05:19:39.308005+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.337782+0000","last_change":"2024-01-22T05:19:39.330569+0000","last_active":"2024-01-22T05:19:39.337782+0000","last_peered":"2024-01-22T05:19:39.337782+0000","last_clean":"2024-01-22T05:19:39.337782+0000","last_became_active":"2024-01-22T05:19:39.330082+0000","last_became_peered":"2024-01-22T05:19:39.330082+0000","last_unstale":"2024-01-22T05:19:39.337782+0000","last_undegraded":"2024-01-22T05:19:39.337782+0000","last_fullsized":"2024-01-22T05:19:39.337782+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.319887+0000","last_change":"2024-01-22T05:19:38.860328+0000","last_active":"2024-01-22T05:19:39.319887+0000","last_peered":"2024-01-22T05:19:39.319887+0000","last_clean":"2024-01-22T05:19:39.319887+0000","last_became_active":"2024-01-22T05:19:38.860050+0000","last_became_peered":"2024-01-22T05:19:38.860050+0000","last_unstale":"2024-01-22T05:19:39.319887+0000","last_undegraded":"2024-01-22T05:19:39.319887+0000","last_fullsized":"2024-01-22T05:19:39.319887+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344802+0000","last_change":"2024-01-22T05:19:39.332014+0000","last_active":"2024-01-22T05:19:39.344802+0000","last_peered":"2024-01-22T05:19:39.344802+0000","last_clean":"2024-01-22T05:19:39.344802+0000","last_became_active":"2024-01-22T05:19:39.331720+0000","last_became_peered":"2024-01-22T05:19:39.331720+0000","last_unstale":"2024-01-22T05:19:39.344802+0000","last_undegraded":"2024-01-22T05:19:39.344802+0000","last_fullsized":"2024-01-22T05:19:39.344802+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317620+0000","last_change":"2024-01-22T05:19:38.859775+0000","last_active":"2024-01-22T05:19:39.317620+0000","last_peered":"2024-01-22T05:19:39.317620+0000","last_clean":"2024-01-22T05:19:39.317620+0000","last_became_active":"2024-01-22T05:19:38.859519+0000","last_became_peered":"2024-01-22T05:19:38.859519+0000","last_unstale":"2024-01-22T05:19:39.317620+0000","last_undegraded":"2024-01-22T05:19:39.317620+0000","last_fullsized":"2024-01-22T05:19:39.317620+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.329720+0000","last_change":"2024-01-22T05:19:39.327041+0000","last_active":"2024-01-22T05:19:39.329720+0000","last_peered":"2024-01-22T05:19:39.329720+0000","last_clean":"2024-01-22T05:19:39.329720+0000","last_became_active":"2024-01-22T05:19:39.326740+0000","last_became_peered":"2024-01-22T05:19:39.326740+0000","last_unstale":"2024-01-22T05:19:39.329720+0000","last_undegraded":"2024-01-22T05:19:39.329720+0000","last_fullsized":"2024-01-22T05:19:39.329720+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.309441+0000","last_change":"2024-01-22T05:19:38.858737+0000","last_active":"2024-01-22T05:19:39.309441+0000","last_peered":"2024-01-22T05:19:39.309441+0000","last_clean":"2024-01-22T05:19:39.309441+0000","last_became_active":"2024-01-22T05:19:38.858459+0000","last_became_peered":"2024-01-22T05:19:38.858459+0000","last_unstale":"2024-01-22T05:19:39.309441+0000","last_undegraded":"2024-01-22T05:19:39.309441+0000","last_fullsized":"2024-01-22T05:19:39.309441+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.333195+0000","last_change":"2024-01-22T05:19:39.330023+0000","last_active":"2024-01-22T05:19:39.333195+0000","last_peered":"2024-01-22T05:19:39.333195+0000","last_clean":"2024-01-22T05:19:39.333195+0000","last_became_active":"2024-01-22T05:19:39.329698+0000","last_became_peered":"2024-01-22T05:19:39.329698+0000","last_unstale":"2024-01-22T05:19:39.333195+0000","last_undegraded":"2024-01-22T05:19:39.333195+0000","last_fullsized":"2024-01-22T05:19:39.333195+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.329446+0000","last_change":"2024-01-22T05:19:38.872735+0000","last_active":"2024-01-22T05:19:39.329446+0000","last_peered":"2024-01-22T05:19:39.329446+0000","last_clean":"2024-01-22T05:19:39.329446+0000","last_became_active":"2024-01-22T05:19:38.872134+0000","last_became_peered":"2024-01-22T05:19:38.872134+0000","last_unstale":"2024-01-22T05:19:39.329446+0000","last_undegraded":"2024-01-22T05:19:39.329446+0000","last_fullsized":"2024-01-22T05:19:39.329446+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344377+0000","last_change":"2024-01-22T05:19:39.339471+0000","last_active":"2024-01-22T05:19:39.344377+0000","last_peered":"2024-01-22T05:19:39.344377+0000","last_clean":"2024-01-22T05:19:39.344377+0000","last_became_active":"2024-01-22T05:19:39.338252+0000","last_became_peered":"2024-01-22T05:19:39.338252+0000","last_unstale":"2024-01-22T05:19:39.344377+0000","last_undegraded":"2024-01-22T05:19:39.344377+0000","last_fullsized":"2024-01-22T05:19:39.344377+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.320258+0000","last_change":"2024-01-22T05:19:38.863405+0000","last_active":"2024-01-22T05:19:39.320258+0000","last_peered":"2024-01-22T05:19:39.320258+0000","last_clean":"2024-01-22T05:19:39.320258+0000","last_became_active":"2024-01-22T05:19:38.863082+0000","last_became_peered":"2024-01-22T05:19:38.863082+0000","last_unstale":"2024-01-22T05:19:39.320258+0000","last_undegraded":"2024-01-22T05:19:39.320258+0000","last_fullsized":"2024-01-22T05:19:39.320258+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343643+0000","last_change":"2024-01-22T05:19:39.337252+0000","last_active":"2024-01-22T05:19:39.343643+0000","last_peered":"2024-01-22T05:19:39.343643+0000","last_clean":"2024-01-22T05:19:39.343643+0000","last_became_active":"2024-01-22T05:19:39.336940+0000","last_became_peered":"2024-01-22T05:19:39.336940+0000","last_unstale":"2024-01-22T05:19:39.343643+0000","last_undegraded":"2024-01-22T05:19:39.343643+0000","last_fullsized":"2024-01-22T05:19:39.343643+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317580+0000","last_change":"2024-01-22T05:19:38.851100+0000","last_active":"2024-01-22T05:19:39.317580+0000","last_peered":"2024-01-22T05:19:39.317580+0000","last_clean":"2024-01-22T05:19:39.317580+0000","last_became_active":"2024-01-22T05:19:38.850789+0000","last_became_peered":"2024-01-22T05:19:38.850789+0000","last_unstale":"2024-01-22T05:19:39.317580+0000","last_undegraded":"2024-01-22T05:19:39.317580+0000","last_fullsized":"2024-01-22T05:19:39.317580+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.335702+0000","last_change":"2024-01-22T05:19:39.332403+0000","last_active":"2024-01-22T05:19:39.335702+0000","last_peered":"2024-01-22T05:19:39.335702+0000","last_clean":"2024-01-22T05:19:39.335702+0000","last_became_active":"2024-01-22T05:19:39.332109+0000","last_became_peered":"2024-01-22T05:19:39.332109+0000","last_unstale":"2024-01-22T05:19:39.335702+0000","last_undegraded":"2024-01-22T05:19:39.335702+0000","last_fullsized":"2024-01-22T05:19:39.335702+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308838+0000","last_change":"2024-01-22T05:19:38.852005+0000","last_active":"2024-01-22T05:19:39.308838+0000","last_peered":"2024-01-22T05:19:39.308838+0000","last_clean":"2024-01-22T05:19:39.308838+0000","last_became_active":"2024-01-22T05:19:38.851732+0000","last_became_peered":"2024-01-22T05:19:38.851732+0000","last_unstale":"2024-01-22T05:19:39.308838+0000","last_undegraded":"2024-01-22T05:19:39.308838+0000","last_fullsized":"2024-01-22T05:19:39.308838+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.337535+0000","last_change":"2024-01-22T05:19:39.335389+0000","last_active":"2024-01-22T05:19:39.337535+0000","last_peered":"2024-01-22T05:19:39.337535+0000","last_clean":"2024-01-22T05:19:39.337535+0000","last_became_active":"2024-01-22T05:19:39.335055+0000","last_became_peered":"2024-01-22T05:19:39.335055+0000","last_unstale":"2024-01-22T05:19:39.337535+0000","last_undegraded":"2024-01-22T05:19:39.337535+0000","last_fullsized":"2024-01-22T05:19:39.337535+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.311632+0000","last_change":"2024-01-22T05:19:38.866613+0000","last_active":"2024-01-22T05:19:39.311632+0000","last_peered":"2024-01-22T05:19:39.311632+0000","last_clean":"2024-01-22T05:19:39.311632+0000","last_became_active":"2024-01-22T05:19:38.865409+0000","last_became_peered":"2024-01-22T05:19:38.865409+0000","last_unstale":"2024-01-22T05:19:39.311632+0000","last_undegraded":"2024-01-22T05:19:39.311632+0000","last_fullsized":"2024-01-22T05:19:39.311632+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346188+0000","last_change":"2024-01-22T05:19:39.336565+0000","last_active":"2024-01-22T05:19:39.346188+0000","last_peered":"2024-01-22T05:19:39.346188+0000","last_clean":"2024-01-22T05:19:39.346188+0000","last_became_active":"2024-01-22T05:19:39.335207+0000","last_became_peered":"2024-01-22T05:19:39.335207+0000","last_unstale":"2024-01-22T05:19:39.346188+0000","last_undegraded":"2024-01-22T05:19:39.346188+0000","last_fullsized":"2024-01-22T05:19:39.346188+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.310489+0000","last_change":"2024-01-22T05:19:38.864678+0000","last_active":"2024-01-22T05:19:39.310489+0000","last_peered":"2024-01-22T05:19:39.310489+0000","last_clean":"2024-01-22T05:19:39.310489+0000","last_became_active":"2024-01-22T05:19:38.864359+0000","last_became_peered":"2024-01-22T05:19:38.864359+0000","last_unstale":"2024-01-22T05:19:39.310489+0000","last_undegraded":"2024-01-22T05:19:39.310489+0000","last_fullsized":"2024-01-22T05:19:39.310489+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.341817+0000","last_change":"2024-01-22T05:19:39.337252+0000","last_active":"2024-01-22T05:19:39.341817+0000","last_peered":"2024-01-22T05:19:39.341817+0000","last_clean":"2024-01-22T05:19:39.341817+0000","last_became_active":"2024-01-22T05:19:39.333421+0000","last_became_peered":"2024-01-22T05:19:39.333421+0000","last_unstale":"2024-01-22T05:19:39.341817+0000","last_undegraded":"2024-01-22T05:19:39.341817+0000","last_fullsized":"2024-01-22T05:19:39.341817+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.314284+0000","last_change":"2024-01-22T05:19:38.868853+0000","last_active":"2024-01-22T05:19:39.314284+0000","last_peered":"2024-01-22T05:19:39.314284+0000","last_clean":"2024-01-22T05:19:39.314284+0000","last_became_active":"2024-01-22T05:19:38.868512+0000","last_became_peered":"2024-01-22T05:19:38.868512+0000","last_unstale":"2024-01-22T05:19:39.314284+0000","last_undegraded":"2024-01-22T05:19:39.314284+0000","last_fullsized":"2024-01-22T05:19:39.314284+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344346+0000","last_change":"2024-01-22T05:19:39.339800+0000","last_active":"2024-01-22T05:19:39.344346+0000","last_peered":"2024-01-22T05:19:39.344346+0000","last_clean":"2024-01-22T05:19:39.344346+0000","last_became_active":"2024-01-22T05:19:39.339533+0000","last_became_peered":"2024-01-22T05:19:39.339533+0000","last_unstale":"2024-01-22T05:19:39.344346+0000","last_undegraded":"2024-01-22T05:19:39.344346+0000","last_fullsized":"2024-01-22T05:19:39.344346+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317254+0000","last_change":"2024-01-22T05:19:38.868096+0000","last_active":"2024-01-22T05:19:39.317254+0000","last_peered":"2024-01-22T05:19:39.317254+0000","last_clean":"2024-01-22T05:19:39.317254+0000","last_became_active":"2024-01-22T05:19:38.867793+0000","last_became_peered":"2024-01-22T05:19:38.867793+0000","last_unstale":"2024-01-22T05:19:39.317254+0000","last_undegraded":"2024-01-22T05:19:39.317254+0000","last_fullsized":"2024-01-22T05:19:39.317254+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.337532+0000","last_change":"2024-01-22T05:19:39.335126+0000","last_active":"2024-01-22T05:19:39.337532+0000","last_peered":"2024-01-22T05:19:39.337532+0000","last_clean":"2024-01-22T05:19:39.337532+0000","last_became_active":"2024-01-22T05:19:39.331740+0000","last_became_peered":"2024-01-22T05:19:39.331740+0000","last_unstale":"2024-01-22T05:19:39.337532+0000","last_undegraded":"2024-01-22T05:19:39.337532+0000","last_fullsized":"2024-01-22T05:19:39.337532+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"196'3","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346309+0000","last_change":"2024-01-22T05:19:38.860783+0000","last_active":"2024-01-22T05:19:39.346309+0000","last_peered":"2024-01-22T05:19:39.346309+0000","last_clean":"2024-01-22T05:19:39.346309+0000","last_became_active":"2024-01-22T05:19:38.859697+0000","last_became_peered":"2024-01-22T05:19:38.859697+0000","last_unstale":"2024-01-22T05:19:39.346309+0000","last_undegraded":"2024-01-22T05:19:39.346309+0000","last_fullsized":"2024-01-22T05:19:39.346309+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344424+0000","last_change":"2024-01-22T05:19:39.340642+0000","last_active":"2024-01-22T05:19:39.344424+0000","last_peered":"2024-01-22T05:19:39.344424+0000","last_clean":"2024-01-22T05:19:39.344424+0000","last_became_active":"2024-01-22T05:19:39.340378+0000","last_became_peered":"2024-01-22T05:19:39.340378+0000","last_unstale":"2024-01-22T05:19:39.344424+0000","last_undegraded":"2024-01-22T05:19:39.344424+0000","last_fullsized":"2024-01-22T05:19:39.344424+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"196'2","reported_seq":12,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343135+0000","last_change":"2024-01-22T05:19:38.868370+0000","last_active":"2024-01-22T05:19:39.343135+0000","last_peered":"2024-01-22T05:19:39.343135+0000","last_clean":"2024-01-22T05:19:39.343135+0000","last_became_active":"2024-01-22T05:19:38.868085+0000","last_became_peered":"2024-01-22T05:19:38.868085+0000","last_unstale":"2024-01-22T05:19:39.343135+0000","last_undegraded":"2024-01-22T05:19:39.343135+0000","last_fullsized":"2024-01-22T05:19:39.343135+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.342756+0000","last_change":"2024-01-22T05:19:39.341098+0000","last_active":"2024-01-22T05:19:39.342756+0000","last_peered":"2024-01-22T05:19:39.342756+0000","last_clean":"2024-01-22T05:19:39.342756+0000","last_became_active":"2024-01-22T05:19:39.340829+0000","last_became_peered":"2024-01-22T05:19:39.340829+0000","last_unstale":"2024-01-22T05:19:39.342756+0000","last_undegraded":"2024-01-22T05:19:39.342756+0000","last_fullsized":"2024-01-22T05:19:39.342756+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.350370+0000","last_change":"2024-01-22T05:19:38.869281+0000","last_active":"2024-01-22T05:19:39.350370+0000","last_peered":"2024-01-22T05:19:39.350370+0000","last_clean":"2024-01-22T05:19:39.350370+0000","last_became_active":"2024-01-22T05:19:38.868929+0000","last_became_peered":"2024-01-22T05:19:38.868929+0000","last_unstale":"2024-01-22T05:19:39.350370+0000","last_undegraded":"2024-01-22T05:19:39.350370+0000","last_fullsized":"2024-01-22T05:19:39.350370+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345308+0000","last_change":"2024-01-22T05:19:39.340635+0000","last_active":"2024-01-22T05:19:39.345308+0000","last_peered":"2024-01-22T05:19:39.345308+0000","last_clean":"2024-01-22T05:19:39.345308+0000","last_became_active":"2024-01-22T05:19:39.340210+0000","last_became_peered":"2024-01-22T05:19:39.340210+0000","last_unstale":"2024-01-22T05:19:39.345308+0000","last_undegraded":"2024-01-22T05:19:39.345308+0000","last_fullsized":"2024-01-22T05:19:39.345308+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317942+0000","last_change":"2024-01-22T05:19:38.847706+0000","last_active":"2024-01-22T05:19:39.317942+0000","last_peered":"2024-01-22T05:19:39.317942+0000","last_clean":"2024-01-22T05:19:39.317942+0000","last_became_active":"2024-01-22T05:19:38.847365+0000","last_became_peered":"2024-01-22T05:19:38.847365+0000","last_unstale":"2024-01-22T05:19:39.317942+0000","last_undegraded":"2024-01-22T05:19:39.317942+0000","last_fullsized":"2024-01-22T05:19:39.317942+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345171+0000","last_change":"2024-01-22T05:19:39.338890+0000","last_active":"2024-01-22T05:19:39.345171+0000","last_peered":"2024-01-22T05:19:39.345171+0000","last_clean":"2024-01-22T05:19:39.345171+0000","last_became_active":"2024-01-22T05:19:39.338604+0000","last_became_peered":"2024-01-22T05:19:39.338604+0000","last_unstale":"2024-01-22T05:19:39.345171+0000","last_undegraded":"2024-01-22T05:19:39.345171+0000","last_fullsized":"2024-01-22T05:19:39.345171+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.324729+0000","last_change":"2024-01-22T05:19:38.867811+0000","last_active":"2024-01-22T05:19:39.324729+0000","last_peered":"2024-01-22T05:19:39.324729+0000","last_clean":"2024-01-22T05:19:39.324729+0000","last_became_active":"2024-01-22T05:19:38.867506+0000","last_became_peered":"2024-01-22T05:19:38.867506+0000","last_unstale":"2024-01-22T05:19:39.324729+0000","last_undegraded":"2024-01-22T05:19:39.324729+0000","last_fullsized":"2024-01-22T05:19:39.324729+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.320692+0000","last_change":"2024-01-22T05:19:39.315819+0000","last_active":"2024-01-22T05:19:39.320692+0000","last_peered":"2024-01-22T05:19:39.320692+0000","last_clean":"2024-01-22T05:19:39.320692+0000","last_became_active":"2024-01-22T05:19:39.313153+0000","last_became_peered":"2024-01-22T05:19:39.313153+0000","last_unstale":"2024-01-22T05:19:39.320692+0000","last_undegraded":"2024-01-22T05:19:39.320692+0000","last_fullsized":"2024-01-22T05:19:39.320692+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"196'4","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.337358+0000","last_change":"2024-01-22T05:19:38.836660+0000","last_active":"2024-01-22T05:19:39.337358+0000","last_peered":"2024-01-22T05:19:39.337358+0000","last_clean":"2024-01-22T05:19:39.337358+0000","last_became_active":"2024-01-22T05:19:38.836354+0000","last_became_peered":"2024-01-22T05:19:38.836354+0000","last_unstale":"2024-01-22T05:19:39.337358+0000","last_undegraded":"2024-01-22T05:19:39.337358+0000","last_fullsized":"2024-01-22T05:19:39.337358+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344827+0000","last_change":"2024-01-22T05:19:39.332194+0000","last_active":"2024-01-22T05:19:39.344827+0000","last_peered":"2024-01-22T05:19:39.344827+0000","last_clean":"2024-01-22T05:19:39.344827+0000","last_became_active":"2024-01-22T05:19:39.331287+0000","last_became_peered":"2024-01-22T05:19:39.331287+0000","last_unstale":"2024-01-22T05:19:39.344827+0000","last_undegraded":"2024-01-22T05:19:39.344827+0000","last_fullsized":"2024-01-22T05:19:39.344827+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343969+0000","last_change":"2024-01-22T05:19:38.861051+0000","last_active":"2024-01-22T05:19:39.343969+0000","last_peered":"2024-01-22T05:19:39.343969+0000","last_clean":"2024-01-22T05:19:39.343969+0000","last_became_active":"2024-01-22T05:19:38.859408+0000","last_became_peered":"2024-01-22T05:19:38.859408+0000","last_unstale":"2024-01-22T05:19:39.343969+0000","last_undegraded":"2024-01-22T05:19:39.343969+0000","last_fullsized":"2024-01-22T05:19:39.343969+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.341901+0000","last_change":"2024-01-22T05:19:39.338292+0000","last_active":"2024-01-22T05:19:39.341901+0000","last_peered":"2024-01-22T05:19:39.341901+0000","last_clean":"2024-01-22T05:19:39.341901+0000","last_became_active":"2024-01-22T05:19:39.338018+0000","last_became_peered":"2024-01-22T05:19:39.338018+0000","last_unstale":"2024-01-22T05:19:39.341901+0000","last_undegraded":"2024-01-22T05:19:39.341901+0000","last_fullsized":"2024-01-22T05:19:39.341901+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"196'2","reported_seq":12,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.332287+0000","last_change":"2024-01-22T05:19:38.855805+0000","last_active":"2024-01-22T05:19:39.332287+0000","last_peered":"2024-01-22T05:19:39.332287+0000","last_clean":"2024-01-22T05:19:39.332287+0000","last_became_active":"2024-01-22T05:19:38.855498+0000","last_became_peered":"2024-01-22T05:19:38.855498+0000","last_unstale":"2024-01-22T05:19:39.332287+0000","last_undegraded":"2024-01-22T05:19:39.332287+0000","last_fullsized":"2024-01-22T05:19:39.332287+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344727+0000","last_change":"2024-01-22T05:19:39.335658+0000","last_active":"2024-01-22T05:19:39.344727+0000","last_peered":"2024-01-22T05:19:39.344727+0000","last_clean":"2024-01-22T05:19:39.344727+0000","last_became_active":"2024-01-22T05:19:39.335387+0000","last_became_peered":"2024-01-22T05:19:39.335387+0000","last_unstale":"2024-01-22T05:19:39.344727+0000","last_undegraded":"2024-01-22T05:19:39.344727+0000","last_fullsized":"2024-01-22T05:19:39.344727+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.312761+0000","last_change":"2024-01-22T05:19:38.866899+0000","last_active":"2024-01-22T05:19:39.312761+0000","last_peered":"2024-01-22T05:19:39.312761+0000","last_clean":"2024-01-22T05:19:39.312761+0000","last_became_active":"2024-01-22T05:19:38.866055+0000","last_became_peered":"2024-01-22T05:19:38.866055+0000","last_unstale":"2024-01-22T05:19:39.312761+0000","last_undegraded":"2024-01-22T05:19:39.312761+0000","last_fullsized":"2024-01-22T05:19:39.312761+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345115+0000","last_change":"2024-01-22T05:19:39.336768+0000","last_active":"2024-01-22T05:19:39.345115+0000","last_peered":"2024-01-22T05:19:39.345115+0000","last_clean":"2024-01-22T05:19:39.345115+0000","last_became_active":"2024-01-22T05:19:39.335264+0000","last_became_peered":"2024-01-22T05:19:39.335264+0000","last_unstale":"2024-01-22T05:19:39.345115+0000","last_undegraded":"2024-01-22T05:19:39.345115+0000","last_fullsized":"2024-01-22T05:19:39.345115+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308873+0000","last_change":"2024-01-22T05:19:38.854236+0000","last_active":"2024-01-22T05:19:39.308873+0000","last_peered":"2024-01-22T05:19:39.308873+0000","last_clean":"2024-01-22T05:19:39.308873+0000","last_became_active":"2024-01-22T05:19:38.853877+0000","last_became_peered":"2024-01-22T05:19:38.853877+0000","last_unstale":"2024-01-22T05:19:39.308873+0000","last_undegraded":"2024-01-22T05:19:39.308873+0000","last_fullsized":"2024-01-22T05:19:39.308873+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.341486+0000","last_change":"2024-01-22T05:19:39.334705+0000","last_active":"2024-01-22T05:19:39.341486+0000","last_peered":"2024-01-22T05:19:39.341486+0000","last_clean":"2024-01-22T05:19:39.341486+0000","last_became_active":"2024-01-22T05:19:39.331932+0000","last_became_peered":"2024-01-22T05:19:39.331932+0000","last_unstale":"2024-01-22T05:19:39.341486+0000","last_undegraded":"2024-01-22T05:19:39.341486+0000","last_fullsized":"2024-01-22T05:19:39.341486+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344247+0000","last_change":"2024-01-22T05:19:38.856373+0000","last_active":"2024-01-22T05:19:39.344247+0000","last_peered":"2024-01-22T05:19:39.344247+0000","last_clean":"2024-01-22T05:19:39.344247+0000","last_became_active":"2024-01-22T05:19:38.856063+0000","last_became_peered":"2024-01-22T05:19:38.856063+0000","last_unstale":"2024-01-22T05:19:39.344247+0000","last_undegraded":"2024-01-22T05:19:39.344247+0000","last_fullsized":"2024-01-22T05:19:39.344247+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344300+0000","last_change":"2024-01-22T05:19:39.334101+0000","last_active":"2024-01-22T05:19:39.344300+0000","last_peered":"2024-01-22T05:19:39.344300+0000","last_clean":"2024-01-22T05:19:39.344300+0000","last_became_active":"2024-01-22T05:19:39.333425+0000","last_became_peered":"2024-01-22T05:19:39.333425+0000","last_unstale":"2024-01-22T05:19:39.344300+0000","last_undegraded":"2024-01-22T05:19:39.344300+0000","last_fullsized":"2024-01-22T05:19:39.344300+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308837+0000","last_change":"2024-01-22T05:19:38.851197+0000","last_active":"2024-01-22T05:19:39.308837+0000","last_peered":"2024-01-22T05:19:39.308837+0000","last_clean":"2024-01-22T05:19:39.308837+0000","last_became_active":"2024-01-22T05:19:38.850851+0000","last_became_peered":"2024-01-22T05:19:38.850851+0000","last_unstale":"2024-01-22T05:19:39.308837+0000","last_undegraded":"2024-01-22T05:19:39.308837+0000","last_fullsized":"2024-01-22T05:19:39.308837+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345072+0000","last_change":"2024-01-22T05:19:39.333229+0000","last_active":"2024-01-22T05:19:39.345072+0000","last_peered":"2024-01-22T05:19:39.345072+0000","last_clean":"2024-01-22T05:19:39.345072+0000","last_became_active":"2024-01-22T05:19:39.332945+0000","last_became_peered":"2024-01-22T05:19:39.332945+0000","last_unstale":"2024-01-22T05:19:39.345072+0000","last_undegraded":"2024-01-22T05:19:39.345072+0000","last_fullsized":"2024-01-22T05:19:39.345072+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308647+0000","last_change":"2024-01-22T05:19:38.858973+0000","last_active":"2024-01-22T05:19:39.308647+0000","last_peered":"2024-01-22T05:19:39.308647+0000","last_clean":"2024-01-22T05:19:39.308647+0000","last_became_active":"2024-01-22T05:19:38.858070+0000","last_became_peered":"2024-01-22T05:19:38.858070+0000","last_unstale":"2024-01-22T05:19:39.308647+0000","last_undegraded":"2024-01-22T05:19:39.308647+0000","last_fullsized":"2024-01-22T05:19:39.308647+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346591+0000","last_change":"2024-01-22T05:19:39.341609+0000","last_active":"2024-01-22T05:19:39.346591+0000","last_peered":"2024-01-22T05:19:39.346591+0000","last_clean":"2024-01-22T05:19:39.346591+0000","last_became_active":"2024-01-22T05:19:39.341321+0000","last_became_peered":"2024-01-22T05:19:39.341321+0000","last_unstale":"2024-01-22T05:19:39.346591+0000","last_undegraded":"2024-01-22T05:19:39.346591+0000","last_fullsized":"2024-01-22T05:19:39.346591+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317232+0000","last_change":"2024-01-22T05:19:38.855072+0000","last_active":"2024-01-22T05:19:39.317232+0000","last_peered":"2024-01-22T05:19:39.317232+0000","last_clean":"2024-01-22T05:19:39.317232+0000","last_became_active":"2024-01-22T05:19:38.854703+0000","last_became_peered":"2024-01-22T05:19:38.854703+0000","last_unstale":"2024-01-22T05:19:39.317232+0000","last_undegraded":"2024-01-22T05:19:39.317232+0000","last_fullsized":"2024-01-22T05:19:39.317232+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346572+0000","last_change":"2024-01-22T05:19:39.344514+0000","last_active":"2024-01-22T05:19:39.346572+0000","last_peered":"2024-01-22T05:19:39.346572+0000","last_clean":"2024-01-22T05:19:39.346572+0000","last_became_active":"2024-01-22T05:19:39.344252+0000","last_became_peered":"2024-01-22T05:19:39.344252+0000","last_unstale":"2024-01-22T05:19:39.346572+0000","last_undegraded":"2024-01-22T05:19:39.346572+0000","last_fullsized":"2024-01-22T05:19:39.346572+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"196'2","reported_seq":12,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.348096+0000","last_change":"2024-01-22T05:19:38.870889+0000","last_active":"2024-01-22T05:19:39.348096+0000","last_peered":"2024-01-22T05:19:39.348096+0000","last_clean":"2024-01-22T05:19:39.348096+0000","last_became_active":"2024-01-22T05:19:38.870608+0000","last_became_peered":"2024-01-22T05:19:38.870608+0000","last_unstale":"2024-01-22T05:19:39.348096+0000","last_undegraded":"2024-01-22T05:19:39.348096+0000","last_fullsized":"2024-01-22T05:19:39.348096+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345211+0000","last_change":"2024-01-22T05:19:39.339888+0000","last_active":"2024-01-22T05:19:39.345211+0000","last_peered":"2024-01-22T05:19:39.345211+0000","last_clean":"2024-01-22T05:19:39.345211+0000","last_became_active":"2024-01-22T05:19:39.339601+0000","last_became_peered":"2024-01-22T05:19:39.339601+0000","last_unstale":"2024-01-22T05:19:39.345211+0000","last_undegraded":"2024-01-22T05:19:39.345211+0000","last_fullsized":"2024-01-22T05:19:39.345211+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.311061+0000","last_change":"2024-01-22T05:19:38.870600+0000","last_active":"2024-01-22T05:19:39.311061+0000","last_peered":"2024-01-22T05:19:39.311061+0000","last_clean":"2024-01-22T05:19:39.311061+0000","last_became_active":"2024-01-22T05:19:38.870125+0000","last_became_peered":"2024-01-22T05:19:38.870125+0000","last_unstale":"2024-01-22T05:19:39.311061+0000","last_undegraded":"2024-01-22T05:19:39.311061+0000","last_fullsized":"2024-01-22T05:19:39.311061+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343777+0000","last_change":"2024-01-22T05:19:39.325463+0000","last_active":"2024-01-22T05:19:39.343777+0000","last_peered":"2024-01-22T05:19:39.343777+0000","last_clean":"2024-01-22T05:19:39.343777+0000","last_became_active":"2024-01-22T05:19:39.324883+0000","last_became_peered":"2024-01-22T05:19:39.324883+0000","last_unstale":"2024-01-22T05:19:39.343777+0000","last_undegraded":"2024-01-22T05:19:39.343777+0000","last_fullsized":"2024-01-22T05:19:39.343777+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.312878+0000","last_change":"2024-01-22T05:19:38.870610+0000","last_active":"2024-01-22T05:19:39.312878+0000","last_peered":"2024-01-22T05:19:39.312878+0000","last_clean":"2024-01-22T05:19:39.312878+0000","last_became_active":"2024-01-22T05:19:38.870289+0000","last_became_peered":"2024-01-22T05:19:38.870289+0000","last_unstale":"2024-01-22T05:19:39.312878+0000","last_undegraded":"2024-01-22T05:19:39.312878+0000","last_fullsized":"2024-01-22T05:19:39.312878+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346412+0000","last_change":"2024-01-22T05:19:39.337876+0000","last_active":"2024-01-22T05:19:39.346412+0000","last_peered":"2024-01-22T05:19:39.346412+0000","last_clean":"2024-01-22T05:19:39.346412+0000","last_became_active":"2024-01-22T05:19:39.337377+0000","last_became_peered":"2024-01-22T05:19:39.337377+0000","last_unstale":"2024-01-22T05:19:39.346412+0000","last_undegraded":"2024-01-22T05:19:39.346412+0000","last_fullsized":"2024-01-22T05:19:39.346412+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.331906+0000","last_change":"2024-01-22T05:19:38.857590+0000","last_active":"2024-01-22T05:19:39.331906+0000","last_peered":"2024-01-22T05:19:39.331906+0000","last_clean":"2024-01-22T05:19:39.331906+0000","last_became_active":"2024-01-22T05:19:38.856882+0000","last_became_peered":"2024-01-22T05:19:38.856882+0000","last_unstale":"2024-01-22T05:19:39.331906+0000","last_undegraded":"2024-01-22T05:19:39.331906+0000","last_fullsized":"2024-01-22T05:19:39.331906+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.332700+0000","last_change":"2024-01-22T05:19:39.319985+0000","last_active":"2024-01-22T05:19:39.332700+0000","last_peered":"2024-01-22T05:19:39.332700+0000","last_clean":"2024-01-22T05:19:39.332700+0000","last_became_active":"2024-01-22T05:19:39.319675+0000","last_became_peered":"2024-01-22T05:19:39.319675+0000","last_unstale":"2024-01-22T05:19:39.332700+0000","last_undegraded":"2024-01-22T05:19:39.332700+0000","last_fullsized":"2024-01-22T05:19:39.332700+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.309363+0000","last_change":"2024-01-22T05:19:38.856870+0000","last_active":"2024-01-22T05:19:39.309363+0000","last_peered":"2024-01-22T05:19:39.309363+0000","last_clean":"2024-01-22T05:19:39.309363+0000","last_became_active":"2024-01-22T05:19:38.856537+0000","last_became_peered":"2024-01-22T05:19:38.856537+0000","last_unstale":"2024-01-22T05:19:39.309363+0000","last_undegraded":"2024-01-22T05:19:39.309363+0000","last_fullsized":"2024-01-22T05:19:39.309363+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.345288+0000","last_change":"2024-01-22T05:19:39.340468+0000","last_active":"2024-01-22T05:19:39.345288+0000","last_peered":"2024-01-22T05:19:39.345288+0000","last_clean":"2024-01-22T05:19:39.345288+0000","last_became_active":"2024-01-22T05:19:39.339862+0000","last_became_peered":"2024-01-22T05:19:39.339862+0000","last_unstale":"2024-01-22T05:19:39.345288+0000","last_undegraded":"2024-01-22T05:19:39.345288+0000","last_fullsized":"2024-01-22T05:19:39.345288+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.318038+0000","last_change":"2024-01-22T05:19:38.868139+0000","last_active":"2024-01-22T05:19:39.318038+0000","last_peered":"2024-01-22T05:19:39.318038+0000","last_clean":"2024-01-22T05:19:39.318038+0000","last_became_active":"2024-01-22T05:19:38.867846+0000","last_became_peered":"2024-01-22T05:19:38.867846+0000","last_unstale":"2024-01-22T05:19:39.318038+0000","last_undegraded":"2024-01-22T05:19:39.318038+0000","last_fullsized":"2024-01-22T05:19:39.318038+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.340254+0000","last_change":"2024-01-22T05:19:39.325316+0000","last_active":"2024-01-22T05:19:39.340254+0000","last_peered":"2024-01-22T05:19:39.340254+0000","last_clean":"2024-01-22T05:19:39.340254+0000","last_became_active":"2024-01-22T05:19:39.325016+0000","last_became_peered":"2024-01-22T05:19:39.325016+0000","last_unstale":"2024-01-22T05:19:39.340254+0000","last_undegraded":"2024-01-22T05:19:39.340254+0000","last_fullsized":"2024-01-22T05:19:39.340254+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.324832+0000","last_change":"2024-01-22T05:19:38.869820+0000","last_active":"2024-01-22T05:19:39.324832+0000","last_peered":"2024-01-22T05:19:39.324832+0000","last_clean":"2024-01-22T05:19:39.324832+0000","last_became_active":"2024-01-22T05:19:38.869500+0000","last_became_peered":"2024-01-22T05:19:38.869500+0000","last_unstale":"2024-01-22T05:19:39.324832+0000","last_undegraded":"2024-01-22T05:19:39.324832+0000","last_fullsized":"2024-01-22T05:19:39.324832+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.320706+0000","last_change":"2024-01-22T05:19:39.318343+0000","last_active":"2024-01-22T05:19:39.320706+0000","last_peered":"2024-01-22T05:19:39.320706+0000","last_clean":"2024-01-22T05:19:39.320706+0000","last_became_active":"2024-01-22T05:19:39.318025+0000","last_became_peered":"2024-01-22T05:19:39.318025+0000","last_unstale":"2024-01-22T05:19:39.320706+0000","last_undegraded":"2024-01-22T05:19:39.320706+0000","last_fullsized":"2024-01-22T05:19:39.320706+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.317345+0000","last_change":"2024-01-22T05:19:38.855612+0000","last_active":"2024-01-22T05:19:39.317345+0000","last_peered":"2024-01-22T05:19:39.317345+0000","last_clean":"2024-01-22T05:19:39.317345+0000","last_became_active":"2024-01-22T05:19:38.855342+0000","last_became_peered":"2024-01-22T05:19:38.855342+0000","last_unstale":"2024-01-22T05:19:39.317345+0000","last_undegraded":"2024-01-22T05:19:39.317345+0000","last_fullsized":"2024-01-22T05:19:39.317345+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.331385+0000","last_change":"2024-01-22T05:19:39.325957+0000","last_active":"2024-01-22T05:19:39.331385+0000","last_peered":"2024-01-22T05:19:39.331385+0000","last_clean":"2024-01-22T05:19:39.331385+0000","last_became_active":"2024-01-22T05:19:39.325687+0000","last_became_peered":"2024-01-22T05:19:39.325687+0000","last_unstale":"2024-01-22T05:19:39.331385+0000","last_undegraded":"2024-01-22T05:19:39.331385+0000","last_fullsized":"2024-01-22T05:19:39.331385+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308546+0000","last_change":"2024-01-22T05:19:38.846663+0000","last_active":"2024-01-22T05:19:39.308546+0000","last_peered":"2024-01-22T05:19:39.308546+0000","last_clean":"2024-01-22T05:19:39.308546+0000","last_became_active":"2024-01-22T05:19:38.846318+0000","last_became_peered":"2024-01-22T05:19:38.846318+0000","last_unstale":"2024-01-22T05:19:39.308546+0000","last_undegraded":"2024-01-22T05:19:39.308546+0000","last_fullsized":"2024-01-22T05:19:39.308546+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":162,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.327496+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:19:39.327496+0000","last_peered":"2024-01-22T05:19:39.327496+0000","last_clean":"2024-01-22T05:19:39.327496+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:19:39.327496+0000","last_undegraded":"2024-01-22T05:19:39.327496+0000","last_fullsized":"2024-01-22T05:19:39.327496+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.336602+0000","last_change":"2024-01-22T05:19:39.332469+0000","last_active":"2024-01-22T05:19:39.336602+0000","last_peered":"2024-01-22T05:19:39.336602+0000","last_clean":"2024-01-22T05:19:39.336602+0000","last_became_active":"2024-01-22T05:19:39.332189+0000","last_became_peered":"2024-01-22T05:19:39.332189+0000","last_unstale":"2024-01-22T05:19:39.336602+0000","last_undegraded":"2024-01-22T05:19:39.336602+0000","last_fullsized":"2024-01-22T05:19:39.336602+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308164+0000","last_change":"2024-01-22T05:19:38.854148+0000","last_active":"2024-01-22T05:19:39.308164+0000","last_peered":"2024-01-22T05:19:39.308164+0000","last_clean":"2024-01-22T05:19:39.308164+0000","last_became_active":"2024-01-22T05:19:38.853768+0000","last_became_peered":"2024-01-22T05:19:38.853768+0000","last_unstale":"2024-01-22T05:19:39.308164+0000","last_undegraded":"2024-01-22T05:19:39.308164+0000","last_fullsized":"2024-01-22T05:19:39.308164+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":167,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.328187+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:19:39.328187+0000","last_peered":"2024-01-22T05:19:39.328187+0000","last_clean":"2024-01-22T05:19:39.328187+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:19:39.328187+0000","last_undegraded":"2024-01-22T05:19:39.328187+0000","last_fullsized":"2024-01-22T05:19:39.328187+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344549+0000","last_change":"2024-01-22T05:19:39.343490+0000","last_active":"2024-01-22T05:19:39.344549+0000","last_peered":"2024-01-22T05:19:39.344549+0000","last_clean":"2024-01-22T05:19:39.344549+0000","last_became_active":"2024-01-22T05:19:39.342878+0000","last_became_peered":"2024-01-22T05:19:39.342878+0000","last_unstale":"2024-01-22T05:19:39.344549+0000","last_undegraded":"2024-01-22T05:19:39.344549+0000","last_fullsized":"2024-01-22T05:19:39.344549+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.323940+0000","last_change":"2024-01-22T05:19:38.866446+0000","last_active":"2024-01-22T05:19:39.323940+0000","last_peered":"2024-01-22T05:19:39.323940+0000","last_clean":"2024-01-22T05:19:39.323940+0000","last_became_active":"2024-01-22T05:19:38.866148+0000","last_became_peered":"2024-01-22T05:19:38.866148+0000","last_unstale":"2024-01-22T05:19:39.323940+0000","last_undegraded":"2024-01-22T05:19:39.323940+0000","last_fullsized":"2024-01-22T05:19:39.323940+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.313043+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:19:39.313043+0000","last_peered":"2024-01-22T05:19:39.313043+0000","last_clean":"2024-01-22T05:19:39.313043+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:19:39.313043+0000","last_undegraded":"2024-01-22T05:19:39.313043+0000","last_fullsized":"2024-01-22T05:19:39.313043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.346324+0000","last_change":"2024-01-22T05:19:39.338219+0000","last_active":"2024-01-22T05:19:39.346324+0000","last_peered":"2024-01-22T05:19:39.346324+0000","last_clean":"2024-01-22T05:19:39.346324+0000","last_became_active":"2024-01-22T05:19:39.337956+0000","last_became_peered":"2024-01-22T05:19:39.337956+0000","last_unstale":"2024-01-22T05:19:39.346324+0000","last_undegraded":"2024-01-22T05:19:39.346324+0000","last_fullsized":"2024-01-22T05:19:39.346324+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.321023+0000","last_change":"2024-01-22T05:19:38.860675+0000","last_active":"2024-01-22T05:19:39.321023+0000","last_peered":"2024-01-22T05:19:39.321023+0000","last_clean":"2024-01-22T05:19:39.321023+0000","last_became_active":"2024-01-22T05:19:38.860371+0000","last_became_peered":"2024-01-22T05:19:38.860371+0000","last_unstale":"2024-01-22T05:19:39.321023+0000","last_undegraded":"2024-01-22T05:19:39.321023+0000","last_fullsized":"2024-01-22T05:19:39.321023+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":167,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.325853+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:19:39.325853+0000","last_peered":"2024-01-22T05:19:39.325853+0000","last_clean":"2024-01-22T05:19:39.325853+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:19:39.325853+0000","last_undegraded":"2024-01-22T05:19:39.325853+0000","last_fullsized":"2024-01-22T05:19:39.325853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.337480+0000","last_change":"2024-01-22T05:19:39.334614+0000","last_active":"2024-01-22T05:19:39.337480+0000","last_peered":"2024-01-22T05:19:39.337480+0000","last_clean":"2024-01-22T05:19:39.337480+0000","last_became_active":"2024-01-22T05:19:39.331645+0000","last_became_peered":"2024-01-22T05:19:39.331645+0000","last_unstale":"2024-01-22T05:19:39.337480+0000","last_undegraded":"2024-01-22T05:19:39.337480+0000","last_fullsized":"2024-01-22T05:19:39.337480+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":10,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.309239+0000","last_change":"2024-01-22T05:19:38.852843+0000","last_active":"2024-01-22T05:19:39.309239+0000","last_peered":"2024-01-22T05:19:39.309239+0000","last_clean":"2024-01-22T05:19:39.309239+0000","last_became_active":"2024-01-22T05:19:38.852464+0000","last_became_peered":"2024-01-22T05:19:38.852464+0000","last_unstale":"2024-01-22T05:19:39.309239+0000","last_undegraded":"2024-01-22T05:19:39.309239+0000","last_fullsized":"2024-01-22T05:19:39.309239+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":189,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.308945+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:19:39.308945+0000","last_peered":"2024-01-22T05:19:39.308945+0000","last_clean":"2024-01-22T05:19:39.308945+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:19:39.308945+0000","last_undegraded":"2024-01-22T05:19:39.308945+0000","last_fullsized":"2024-01-22T05:19:39.308945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344523+0000","last_change":"2024-01-22T05:19:39.334626+0000","last_active":"2024-01-22T05:19:39.344523+0000","last_peered":"2024-01-22T05:19:39.344523+0000","last_clean":"2024-01-22T05:19:39.344523+0000","last_became_active":"2024-01-22T05:19:39.334355+0000","last_became_peered":"2024-01-22T05:19:39.334355+0000","last_unstale":"2024-01-22T05:19:39.344523+0000","last_undegraded":"2024-01-22T05:19:39.344523+0000","last_fullsized":"2024-01-22T05:19:39.344523+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.343401+0000","last_change":"2024-01-22T05:19:38.859268+0000","last_active":"2024-01-22T05:19:39.343401+0000","last_peered":"2024-01-22T05:19:39.343401+0000","last_clean":"2024-01-22T05:19:39.343401+0000","last_became_active":"2024-01-22T05:19:38.858965+0000","last_became_peered":"2024-01-22T05:19:38.858965+0000","last_unstale":"2024-01-22T05:19:39.343401+0000","last_undegraded":"2024-01-22T05:19:39.343401+0000","last_fullsized":"2024-01-22T05:19:39.343401+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":164,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.320168+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:19:39.320168+0000","last_peered":"2024-01-22T05:19:39.320168+0000","last_clean":"2024-01-22T05:19:39.320168+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:19:39.320168+0000","last_undegraded":"2024-01-22T05:19:39.320168+0000","last_fullsized":"2024-01-22T05:19:39.320168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344833+0000","last_change":"2024-01-22T05:19:39.331633+0000","last_active":"2024-01-22T05:19:39.344833+0000","last_peered":"2024-01-22T05:19:39.344833+0000","last_clean":"2024-01-22T05:19:39.344833+0000","last_became_active":"2024-01-22T05:19:39.331359+0000","last_became_peered":"2024-01-22T05:19:39.331359+0000","last_unstale":"2024-01-22T05:19:39.344833+0000","last_undegraded":"2024-01-22T05:19:39.344833+0000","last_fullsized":"2024-01-22T05:19:39.344833+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.336765+0000","last_change":"2024-01-22T05:19:38.860899+0000","last_active":"2024-01-22T05:19:39.336765+0000","last_peered":"2024-01-22T05:19:39.336765+0000","last_clean":"2024-01-22T05:19:39.336765+0000","last_became_active":"2024-01-22T05:19:38.860614+0000","last_became_peered":"2024-01-22T05:19:38.860614+0000","last_unstale":"2024-01-22T05:19:39.336765+0000","last_undegraded":"2024-01-22T05:19:39.336765+0000","last_fullsized":"2024-01-22T05:19:39.336765+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.310658+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:19:39.310658+0000","last_peered":"2024-01-22T05:19:39.310658+0000","last_clean":"2024-01-22T05:19:39.310658+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:19:39.310658+0000","last_undegraded":"2024-01-22T05:19:39.310658+0000","last_fullsized":"2024-01-22T05:19:39.310658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.338105+0000","last_change":"2024-01-22T05:19:39.329527+0000","last_active":"2024-01-22T05:19:39.338105+0000","last_peered":"2024-01-22T05:19:39.338105+0000","last_clean":"2024-01-22T05:19:39.338105+0000","last_became_active":"2024-01-22T05:19:39.329039+0000","last_became_peered":"2024-01-22T05:19:39.329039+0000","last_unstale":"2024-01-22T05:19:39.338105+0000","last_undegraded":"2024-01-22T05:19:39.338105+0000","last_fullsized":"2024-01-22T05:19:39.338105+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:38.818514+0000","last_clean_scrub_stamp":"2024-01-22T05:19:38.818514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"196'2","reported_seq":12,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.344303+0000","last_change":"2024-01-22T05:19:38.862894+0000","last_active":"2024-01-22T05:19:39.344303+0000","last_peered":"2024-01-22T05:19:39.344303+0000","last_clean":"2024-01-22T05:19:39.344303+0000","last_became_active":"2024-01-22T05:19:38.862585+0000","last_became_peered":"2024-01-22T05:19:38.862585+0000","last_unstale":"2024-01-22T05:19:39.344303+0000","last_undegraded":"2024-01-22T05:19:39.344303+0000","last_fullsized":"2024-01-22T05:19:39.344303+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:19:37.805620+0000","last_clean_scrub_stamp":"2024-01-22T05:19:37.805620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":189,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.309461+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:19:39.309461+0000","last_peered":"2024-01-22T05:19:39.309461+0000","last_clean":"2024-01-22T05:19:39.309461+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:19:39.309461+0000","last_undegraded":"2024-01-22T05:19:39.309461+0000","last_fullsized":"2024-01-22T05:19:39.309461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":156,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-01-22T05:19:39.310770+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:19:39.310770+0000","last_peered":"2024-01-22T05:19:39.310770+0000","last_clean":"2024-01-22T05:19:39.310770+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:19:39.310770+0000","last_undegraded":"2024-01-22T05:19:39.310770+0000","last_fullsized":"2024-01-22T05:19:39.310770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575033,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311936,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059904,"statfs":{"total":96636764160,"available":96317341696,"internally_reserved":0,"allocated":2482176,"data_stored":1239847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2450000000000001,"15min":1.0760000000000001},"min":{"1min":0.83299999999999996,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.5209999999999999,"5min":14.779999999999999,"15min":14.779999999999999},"last":1.119},{"interface":"front","average":{"1min":1.145,"5min":2.0070000000000001,"15min":1.3759999999999999},"min":{"1min":0.80000000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.55,"5min":76.662000000000006,"15min":76.662000000000006},"last":1.071}]},{"osd":1,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.167,"15min":1.0589999999999999},"min":{"1min":0.86199999999999999,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.4650000000000001,"5min":4.9269999999999996,"15min":4.9269999999999996},"last":1.016},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2989999999999999,"15min":1.2030000000000001},"min":{"1min":0.88,"5min":0.71599999999999997,"15min":0.58999999999999997},"max":{"1min":1.655,"5min":12.691000000000001,"15min":12.691000000000001},"last":1.302}]},{"osd":2,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1579999999999999,"15min":1.125},"min":{"1min":0.77800000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5700000000000001,"5min":2.1589999999999998,"15min":2.5150000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.355,"15min":1.2210000000000001},"min":{"1min":0.97699999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5449999999999999,"5min":15.036,"15min":15.036},"last":1.2809999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.9339999999999999,"15min":1.4470000000000001},"min":{"1min":0.92300000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.748,"5min":64.983999999999995,"15min":64.983999999999995},"last":1.482},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.4299999999999999,"15min":1.2949999999999999},"min":{"1min":1.0029999999999999,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":1.714,"5min":15.073,"15min":15.073},"last":1.351}]},{"osd":4,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.415,"15min":1.1850000000000001},"min":{"1min":0.77900000000000003,"5min":0.53000000000000003,"15min":0.32900000000000001},"max":{"1min":1.504,"5min":22.239000000000001,"15min":22.239000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.5269999999999999,"15min":1.2669999999999999},"min":{"1min":0.92000000000000004,"5min":0.68799999999999994,"15min":0.52200000000000002},"max":{"1min":1.9830000000000001,"5min":27.872,"15min":27.872},"last":1.214}]},{"osd":5,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":2.0110000000000001,"15min":1.452},"min":{"1min":0.88100000000000001,"5min":0.67400000000000004,"15min":0.40400000000000003},"max":{"1min":1.6279999999999999,"5min":65.652000000000001,"15min":65.652000000000001},"last":1.204},{"interface":"front","average":{"1min":1.387,"5min":1.341,"15min":1.2869999999999999},"min":{"1min":1.0589999999999999,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":2.1539999999999999,"5min":2.1629999999999998,"15min":3.625},"last":1.5589999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:19:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.363,"15min":1.262},"min":{"1min":0.997,"5min":0.80700000000000005,"15min":0.53400000000000003},"max":{"1min":2.3580000000000001,"5min":6.9939999999999998,"15min":6.9939999999999998},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.54,"15min":1.411},"min":{"1min":1.224,"5min":0.82999999999999996,"15min":0.56100000000000005},"max":{"1min":2.0600000000000001,"5min":12.965,"15min":12.965},"last":1.718}]}]},{"osd":6,"up_from":13,"seq":55834575033,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307856,"kb_used_data":2440,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063984,"statfs":{"total":96636764160,"available":96321519616,"internally_reserved":0,"allocated":2498560,"data_stored":1240527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.0580000000000001,"15min":1.2849999999999999},"min":{"1min":0.72999999999999998,"5min":0.66600000000000004,"15min":0.35999999999999999},"max":{"1min":1.927,"5min":1.927,"15min":77.745000000000005},"last":1.282},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0429999999999999,"15min":1.0780000000000001},"min":{"1min":0.64500000000000002,"5min":0.57499999999999996,"15min":0.44},"max":{"1min":1.5,"5min":1.74,"15min":13.555999999999999},"last":1.2569999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.0740000000000001,"15min":1.125},"min":{"1min":0.91300000000000003,"5min":0.56999999999999995,"15min":0.40000000000000002},"max":{"1min":1.3240000000000001,"5min":1.554,"15min":15.499000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.117,"15min":1.155},"min":{"1min":0.76200000000000001,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.6379999999999999,"5min":1.702,"15min":7.7629999999999999},"last":0.88500000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1850000000000001,"15min":1.165},"min":{"1min":0.89000000000000001,"5min":0.84999999999999998,"15min":0.57399999999999995},"max":{"1min":1.4199999999999999,"5min":1.667,"15min":3.0960000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.1359999999999999,"15min":1.145},"min":{"1min":0.747,"5min":0.68999999999999995,"15min":0.38200000000000001},"max":{"1min":1.401,"5min":1.7390000000000001,"15min":4.9660000000000002},"last":1.363}]},{"osd":3,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.173,"15min":1.486},"min":{"1min":0.97899999999999998,"5min":0.66700000000000004,"15min":0.59299999999999997},"max":{"1min":1.4610000000000001,"5min":2.343,"15min":102.08199999999999},"last":1.421},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.82599999999999996,"5min":0.66300000000000003,"15min":0.374},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":15.468},"last":1.3819999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1799999999999999,"15min":1.147},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.495},"max":{"1min":1.6040000000000001,"5min":1.631,"15min":3.1749999999999998},"last":1.002},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.204,"15min":1.165},"min":{"1min":0.82799999999999996,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.6910000000000001,"5min":2.5489999999999999,"15min":5.1200000000000001},"last":1.159}]},{"osd":5,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1499999999999999,"15min":1.2430000000000001},"min":{"1min":0.93000000000000005,"5min":0.58699999999999997,"15min":0.48099999999999998},"max":{"1min":1.6020000000000001,"5min":1.7829999999999999,"15min":30.533000000000001},"last":1.125},{"interface":"front","average":{"1min":1.359,"5min":1.294,"15min":1.278},"min":{"1min":1.0029999999999999,"5min":0.79500000000000004,"15min":0.46600000000000003},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":3.875},"last":1.341}]},{"osd":7,"last update":"Mon Jan 22 05:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3500000000000001,"15min":1.4279999999999999},"min":{"1min":0.97999999999999998,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":1.6379999999999999,"5min":2.7490000000000001,"15min":23.547999999999998},"last":1.474},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3149999999999999,"15min":1.5509999999999999},"min":{"1min":0.80200000000000005,"5min":0.77700000000000002,"15min":0.495},"max":{"1min":1.7110000000000001,"5min":1.9019999999999999,"15min":63.737000000000002},"last":1.226}]}]},{"osd":5,"up_from":13,"seq":55834575033,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307844,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063996,"statfs":{"total":96636764160,"available":96321531904,"internally_reserved":0,"allocated":2486272,"data_stored":1240401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0089999999999999,"15min":1.0129999999999999},"min":{"1min":0.58599999999999997,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.556,"5min":1.651,"15min":2.0609999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0529999999999999,"15min":1.042},"min":{"1min":0.61699999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5840000000000001,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.147}]},{"osd":1,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.224,"15min":1.1850000000000001},"min":{"1min":0.85099999999999998,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.6619999999999999,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2050000000000001,"15min":1.2},"min":{"1min":0.879,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.6140000000000001,"5min":1.9930000000000001,"15min":2.0209999999999999},"last":1.048}]},{"osd":2,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1479999999999999,"15min":1.135},"min":{"1min":0.80700000000000005,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.4370000000000001,"5min":1.9219999999999999,"15min":1.925},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.145,"15min":1.115},"min":{"1min":0.82499999999999996,"5min":0.71799999999999997,"15min":0.59899999999999998},"max":{"1min":1.4410000000000001,"5min":1.982,"15min":1.982},"last":1.3540000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.216,"15min":1.1599999999999999},"min":{"1min":0.71199999999999997,"5min":0.69799999999999995,"15min":0.66900000000000004},"max":{"1min":1.5660000000000001,"5min":3.202,"15min":3.202},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.1899999999999999,"15min":1.2090000000000001},"min":{"1min":0.98199999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.546,"5min":1.6830000000000001,"15min":4.8819999999999997},"last":1.2350000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.103,"15min":1.097},"min":{"1min":0.77700000000000002,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.5369999999999999,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1950000000000001,"15min":1.1779999999999999},"min":{"1min":0.78000000000000003,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.4430000000000001,"5min":2.081,"15min":2.081},"last":1.016}]},{"osd":6,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.226,"15min":1.2190000000000001},"min":{"1min":0.97999999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.482,"5min":2.0099999999999998,"15min":2.2010000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.24,"15min":1.2410000000000001},"min":{"1min":0.71899999999999997,"5min":0.70699999999999996,"15min":0.55900000000000005},"max":{"1min":1.4530000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.409}]},{"osd":7,"last update":"Mon Jan 22 05:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3169999999999999,"15min":1.304},"min":{"1min":0.91400000000000003,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.7410000000000001,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.371,"5min":1.3420000000000001,"15min":1.3360000000000001},"min":{"1min":0.96099999999999997,"5min":0.72699999999999998,"15min":0.60799999999999998},"max":{"1min":1.6819999999999999,"5min":1.8859999999999999,"15min":3.1840000000000002},"last":1.111}]}]},{"osd":4,"up_from":13,"seq":55834575033,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299648,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072192,"statfs":{"total":96636764160,"available":96329924608,"internally_reserved":0,"allocated":2482176,"data_stored":1239847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1279999999999999,"15min":1.103},"min":{"1min":0.81000000000000005,"5min":0.63700000000000001,"15min":0.47799999999999998},"max":{"1min":1.4379999999999999,"5min":1.696,"15min":2.0150000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1950000000000001,"15min":1.147},"min":{"1min":0.92100000000000004,"5min":0.75700000000000001,"15min":0.48899999999999999},"max":{"1min":1.548,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.1339999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.091,"15min":1.0760000000000001},"min":{"1min":0.77800000000000002,"5min":0.59899999999999998,"15min":0.53100000000000003},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.82199999999999995,"5min":0.52500000000000002,"15min":0.46000000000000002},"max":{"1min":1.3879999999999999,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.80100000000000005}]},{"osd":2,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0760000000000001,"15min":1.0720000000000001},"min":{"1min":0.79500000000000004,"5min":0.66400000000000003,"15min":0.49199999999999999},"max":{"1min":1.361,"5min":1.516,"15min":5.3390000000000004},"last":1.3},{"interface":"front","average":{"1min":1.204,"5min":1.149,"15min":1.161},"min":{"1min":0.88,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5089999999999999,"5min":1.6140000000000001,"15min":2.3479999999999999},"last":1.244}]},{"osd":3,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.149,"15min":1.135},"min":{"1min":0.86799999999999999,"5min":0.65700000000000003,"15min":0.496},"max":{"1min":1.478,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.26},{"interface":"front","average":{"1min":1.2,"5min":1.1719999999999999,"15min":1.1499999999999999},"min":{"1min":0.97199999999999998,"5min":0.67700000000000005,"15min":0.53100000000000003},"max":{"1min":1.4039999999999999,"5min":2.2959999999999998,"15min":5.3029999999999999},"last":1.2210000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.113,"15min":1.1180000000000001},"min":{"1min":0.76200000000000001,"5min":0.63500000000000001,"15min":0.54100000000000004},"max":{"1min":1.365,"5min":1.6899999999999999,"15min":2.0790000000000002},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.2070000000000001,"15min":1.133},"min":{"1min":0.94299999999999995,"5min":0.68200000000000005,"15min":0.52200000000000002},"max":{"1min":1.583,"5min":1.8240000000000001,"15min":2.0030000000000001},"last":1.4079999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.149,"15min":1.1439999999999999},"min":{"1min":0.88100000000000001,"5min":0.67400000000000004,"15min":0.44500000000000001},"max":{"1min":1.387,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.28,"15min":1.27},"min":{"1min":0.98999999999999999,"5min":0.73699999999999999,"15min":0.51900000000000002},"max":{"1min":1.45,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":1.1899999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3500000000000001,"15min":1.3120000000000001},"min":{"1min":1.0700000000000001,"5min":0.74099999999999999,"15min":0.59399999999999997},"max":{"1min":1.6299999999999999,"5min":1.8999999999999999,"15min":2.2839999999999998},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.94999999999999996,"5min":0.89300000000000002,"15min":0.56899999999999995},"max":{"1min":1.5049999999999999,"5min":1.843,"15min":5.2629999999999999},"last":1.3740000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575033,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303752,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068088,"statfs":{"total":96636764160,"available":96325722112,"internally_reserved":0,"allocated":2490368,"data_stored":1240491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.85699999999999998},"min":{"1min":0.50800000000000001,"5min":0.41099999999999998,"15min":0.34200000000000003},"max":{"1min":1.175,"5min":1.512,"15min":14.859},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.63400000000000001,"5min":0.42699999999999999,"15min":0.317},"max":{"1min":1.371,"5min":1.804,"15min":5.0919999999999996},"last":1.0780000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.90900000000000003,"15min":0.90300000000000002},"min":{"1min":0.62,"5min":0.50600000000000001,"15min":0.39300000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":6.5570000000000004},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.95699999999999996,"15min":0.97099999999999997},"min":{"1min":0.55800000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.482,"5min":1.7669999999999999,"15min":5.7519999999999998},"last":1.0169999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.085,"15min":1.107},"min":{"1min":0.48699999999999999,"5min":0.48599999999999999,"15min":0.40600000000000003},"max":{"1min":1.6910000000000001,"5min":1.8680000000000001,"15min":2.391},"last":1.458},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.157,"15min":1.1819999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.44800000000000001},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":4.1429999999999998},"last":1.357}]},{"osd":4,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.323,"15min":1.331},"min":{"1min":0.86699999999999999,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.831,"5min":2.423,"15min":10.858000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.292,"15min":1.337},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.63600000000000001},"max":{"1min":1.6379999999999999,"5min":2.3359999999999999,"15min":10.846},"last":1.4410000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.238,"15min":1.2829999999999999},"min":{"1min":0.99399999999999999,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.595,"5min":1.7709999999999999,"15min":7.3639999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.3089999999999999,"15min":1.381},"min":{"1min":0.92700000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.738,"5min":6.3220000000000001,"15min":14.523999999999999},"last":1.1259999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.369,"15min":1.357},"min":{"1min":0.92700000000000005,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.77,"5min":2.1819999999999999,"15min":4.9809999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.3720000000000001,"15min":1.3879999999999999},"min":{"1min":1.113,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":5.4210000000000003},"last":1.492}]},{"osd":7,"last update":"Mon Jan 22 05:18:47 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.3340000000000001,"15min":1.363},"min":{"1min":0.96999999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.004,"5min":2.004,"15min":5.7160000000000002},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.381,"15min":1.409},"min":{"1min":1.0860000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8839999999999999,"5min":2.5449999999999999,"15min":6.4279999999999999},"last":1.321}]}]},{"osd":2,"up_from":13,"seq":55834575033,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299668,"kb_used_data":2444,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072172,"statfs":{"total":96636764160,"available":96329904128,"internally_reserved":0,"allocated":2502656,"data_stored":1241439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.54100000000000004,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":1.1919999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.2809999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85499999999999998,"15min":0.85399999999999998},"min":{"1min":0.53900000000000003,"5min":0.45300000000000001,"15min":0.373},"max":{"1min":1.1899999999999999,"5min":1.556,"15min":1.7350000000000001},"last":0.91200000000000003}]},{"osd":1,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92600000000000005,"15min":0.86899999999999999},"min":{"1min":0.55400000000000005,"5min":0.46800000000000003,"15min":0.41299999999999998},"max":{"1min":1.8400000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.109,"5min":1,"15min":0.95799999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.41599999999999998},"max":{"1min":1.671,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.0720000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1659999999999999,"15min":1.137},"min":{"1min":0.66700000000000004,"5min":0.56200000000000006,"15min":0.47099999999999997},"max":{"1min":1.984,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.296,"5min":1.2370000000000001,"15min":1.212},"min":{"1min":0.85999999999999999,"5min":0.64300000000000002,"15min":0.51100000000000001},"max":{"1min":1.7609999999999999,"5min":3.133,"15min":3.133},"last":0.97899999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.3140000000000001,"15min":1.278},"min":{"1min":1.0029999999999999,"5min":0.88500000000000001,"15min":0.59099999999999997},"max":{"1min":2.101,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.25},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.206,"15min":1.2010000000000001},"min":{"1min":0.74099999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":2.2829999999999999},"last":1.3420000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.2649999999999999,"15min":1.228},"min":{"1min":0.94699999999999995,"5min":0.84099999999999997,"15min":0.63800000000000001},"max":{"1min":2.1680000000000001,"5min":2.379,"15min":2.379},"last":1.129},{"interface":"front","average":{"1min":1.45,"5min":1.329,"15min":1.2909999999999999},"min":{"1min":1.181,"5min":0.84799999999999998,"15min":0.67000000000000004},"max":{"1min":2.1880000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.2130000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2609999999999999,"15min":1.254},"min":{"1min":0.79500000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":2.1920000000000002},"last":1.26},{"interface":"front","average":{"1min":1.47,"5min":1.3720000000000001,"15min":1.3160000000000001},"min":{"1min":0.98899999999999999,"5min":0.629,"15min":0.629},"max":{"1min":2.2759999999999998,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.2270000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3560000000000001,"15min":1.345},"min":{"1min":0.88500000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8200000000000001,"5min":1.9390000000000001,"15min":2.1749999999999998},"last":1.431},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.452,"15min":1.4219999999999999},"min":{"1min":1.121,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.2280000000000002,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.417}]}]},{"osd":1,"up_from":13,"seq":55834575034,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311940,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059900,"statfs":{"total":96636764160,"available":96317337600,"internally_reserved":0,"allocated":2486272,"data_stored":1239937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84899999999999998,"15min":0.86599999999999999},"min":{"1min":0.53500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.032,"5min":1.4830000000000001,"15min":3.4119999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.054,"5min":0.98099999999999998,"15min":0.997},"min":{"1min":0.66100000000000003,"5min":0.56999999999999995,"15min":0.41099999999999998},"max":{"1min":1.5089999999999999,"5min":1.6160000000000001,"15min":2.101},"last":1}]},{"osd":2,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.97499999999999998,"15min":0.98899999999999999},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.45500000000000002},"max":{"1min":1.3180000000000001,"5min":1.492,"15min":2.169},"last":1.556},{"interface":"front","average":{"1min":1.075,"5min":1.0589999999999999,"15min":1.0549999999999999},"min":{"1min":0.64900000000000002,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.478,"5min":1.5780000000000001,"15min":2.024},"last":1.302}]},{"osd":3,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.052,"15min":1.0429999999999999},"min":{"1min":0.73999999999999999,"5min":0.57399999999999995,"15min":0.38900000000000001},"max":{"1min":1.502,"5min":1.972,"15min":4.665},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.64600000000000002,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.2629999999999999,"5min":1.659,"15min":5.5830000000000002},"last":0.81000000000000005}]},{"osd":4,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2110000000000001,"15min":1.2490000000000001},"min":{"1min":0.86299999999999999,"5min":0.60299999999999998,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":1.958,"15min":15.76},"last":1.647},{"interface":"front","average":{"1min":1.341,"5min":1.2809999999999999,"15min":1.333},"min":{"1min":0.90400000000000003,"5min":0.74099999999999999,"15min":0.63500000000000001},"max":{"1min":1.649,"5min":1.714,"15min":16.975000000000001},"last":1.393}]},{"osd":5,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.264,"15min":1.232},"min":{"1min":0.88200000000000001,"5min":0.72599999999999998,"15min":0.55700000000000005},"max":{"1min":1.6240000000000001,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.323},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.274,"15min":1.2789999999999999},"min":{"1min":0.97199999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.784,"5min":2.1309999999999998,"15min":2.52},"last":1.339}]},{"osd":6,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.266,"15min":1.2609999999999999},"min":{"1min":0.95099999999999996,"5min":0.68999999999999995,"15min":0.55600000000000005},"max":{"1min":1.53,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3,"15min":1.327},"min":{"1min":1.056,"5min":0.76200000000000001,"15min":0.68799999999999994},"max":{"1min":1.6459999999999999,"5min":2.0609999999999999,"15min":2.5569999999999999},"last":1.4490000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.339,"15min":1.355},"min":{"1min":0.96299999999999997,"5min":0.69999999999999996,"15min":0.68100000000000005},"max":{"1min":1.754,"5min":1.8999999999999999,"15min":4.4329999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.355,"15min":1.3520000000000001},"min":{"1min":1.0109999999999999,"5min":0.81100000000000005,"15min":0.64900000000000002},"max":{"1min":1.7010000000000001,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":1.48}]}]},{"osd":0,"up_from":13,"seq":55834575033,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1240899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.81799999999999995,"15min":0.88500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.28699999999999998},"max":{"1min":1.0609999999999999,"5min":1.4219999999999999,"15min":15.273},"last":1.206},{"interface":"front","average":{"1min":0.877,"5min":0.874,"15min":0.91300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.34499999999999997},"max":{"1min":1.3680000000000001,"5min":1.625,"15min":4.4009999999999998},"last":1.2549999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.97799999999999998,"15min":1.0449999999999999},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.46400000000000002},"max":{"1min":1.363,"5min":1.6299999999999999,"15min":15.473000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.069,"5min":1.0249999999999999,"15min":1.0269999999999999},"min":{"1min":0.67400000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5509999999999999,"5min":1.6850000000000001,"15min":1.7989999999999999},"last":1.4139999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.95899999999999996,"15min":0.97699999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.39000000000000001},"max":{"1min":1.302,"5min":1.5049999999999999,"15min":5.3970000000000002},"last":0.75},{"interface":"front","average":{"1min":1.069,"5min":1.1100000000000001,"15min":1.177},"min":{"1min":0.67200000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.5529999999999999,"5min":1.79,"15min":15.439},"last":0.88600000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.208,"15min":1.2470000000000001},"min":{"1min":0.81999999999999995,"5min":0.81399999999999995,"15min":0.61399999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":5.1799999999999997},"last":1.476},{"interface":"front","average":{"1min":1.222,"5min":1.214,"15min":1.216},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.56200000000000006},"max":{"1min":1.615,"5min":1.738,"15min":3.4340000000000002},"last":1.161}]},{"osd":5,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.272,"15min":1.27},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.67600000000000005},"max":{"1min":1.579,"5min":1.9099999999999999,"15min":3.548},"last":1.022},{"interface":"front","average":{"1min":1.272,"5min":1.306,"15min":1.321},"min":{"1min":0.90300000000000002,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.587,"5min":1.7210000000000001,"15min":2.823},"last":1.1359999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3300000000000001,"15min":1.407},"min":{"1min":0.91700000000000004,"5min":0.879,"15min":0.59099999999999997},"max":{"1min":1.6559999999999999,"5min":1.7909999999999999,"15min":15.4},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3200000000000001,"15min":1.3720000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.72499999999999998},"max":{"1min":1.7010000000000001,"5min":1.8919999999999999,"15min":7.1349999999999998},"last":1.538}]},{"osd":7,"last update":"Mon Jan 22 05:18:48 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3740000000000001,"15min":1.4219999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.79900000000000004},"max":{"1min":1.7969999999999999,"5min":2.145,"15min":5.29},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.3680000000000001,"15min":1.367},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.752},"max":{"1min":1.7230000000000001,"5min":2.0470000000000002,"15min":2.7269999999999999},"last":1.2170000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:19:44.145 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:19:44.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-22T05:19:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.355+0000 7f3fcfe00700 1 Processor -- start 2024-01-22T05:19:44.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.355+0000 7f3fcfe00700 1 -- start start 2024-01-22T05:19:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.359+0000 7f3fcfe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3fd01581b0 0x7f3fd0068c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.359+0000 7f3fcfe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd0069150 0x7f3fd0062aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.359+0000 7f3fcfe00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd00687d0 con 0x7f3fd0062f90 2024-01-22T05:19:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.359+0000 7f3fcfe00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd0063400 con 0x7f3fd01581b0 2024-01-22T05:19:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.359+0000 7f3fcfe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd0067bc0 con 0x7f3fd0069150 2024-01-22T05:19:44.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.359+0000 7f3fcea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3fd01581b0 0x7f3fd0068c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.359+0000 7f3fcea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3fd01581b0 0x7f3fd0068c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33882/0 (socket says 172.21.15.49:33882) 2024-01-22T05:19:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.359+0000 7f3fcea00700 1 -- 172.21.15.49:0/2246922570 learned_addr learned my addr 172.21.15.49:0/2246922570 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.359+0000 7f3fce000700 1 --2- 172.21.15.49:0/2246922570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd0069150 0x7f3fd0062aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.359+0000 7f3fcea00700 1 -- 172.21.15.49:0/2246922570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd0069150 msgr2=0x7f3fd0062aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.359+0000 7f3fcea00700 1 --2- 172.21.15.49:0/2246922570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd0069150 0x7f3fd0062aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.359+0000 7f3fcea00700 1 -- 172.21.15.49:0/2246922570 >> v1:172.21.15.110:6789/0 conn(0x7f3fd0062f90 legacy=0x7f3fd00c31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.359+0000 7f3fcea00700 1 -- 172.21.15.49:0/2246922570 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0067ea0 con 0x7f3fd01581b0 2024-01-22T05:19:44.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.363+0000 7f3fcea00700 1 --2- 172.21.15.49:0/2246922570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd01581b0 0x7f3fd0068c60 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7f3fc0006fd0 tx=0x7f3fc00090f0).ready entity=mon.0 client_cookie=68cfbfa61b210bbd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:44.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.363+0000 7f3fcd600700 1 -- 172.21.15.49:0/2246922570 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc000b600 con 0x7f3fd01581b0 2024-01-22T05:19:44.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.363+0000 7f3fcd600700 1 -- 172.21.15.49:0/2246922570 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc000b760 con 0x7f3fd01581b0 2024-01-22T05:19:44.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.363+0000 7f3fcd600700 1 -- 172.21.15.49:0/2246922570 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc000bae0 con 0x7f3fd01581b0 2024-01-22T05:19:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.363+0000 7f3fcfe00700 1 -- 172.21.15.49:0/2246922570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd01581b0 msgr2=0x7f3fd0068c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.363+0000 7f3fcfe00700 1 --2- 172.21.15.49:0/2246922570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd01581b0 0x7f3fd0068c60 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7f3fc0006fd0 tx=0x7f3fc00090f0).stop 2024-01-22T05:19:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.363+0000 7f3fcfe00700 1 -- 172.21.15.49:0/2246922570 shutdown_connections 2024-01-22T05:19:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.363+0000 7f3fcfe00700 1 --2- 172.21.15.49:0/2246922570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd0069150 0x7f3fd0062aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.363+0000 7f3fcfe00700 1 --2- 172.21.15.49:0/2246922570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd01581b0 0x7f3fd0068c60 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.363+0000 7f3fcfe00700 1 -- 172.21.15.49:0/2246922570 >> 172.21.15.49:0/2246922570 conn(0x7f3fd00c8740 msgr2=0x7f3fd00c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:44.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.363+0000 7f3fcfe00700 1 -- 172.21.15.49:0/2246922570 shutdown_connections 2024-01-22T05:19:44.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.363+0000 7f3fcfe00700 1 -- 172.21.15.49:0/2246922570 wait complete. 2024-01-22T05:19:44.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.367+0000 7f3fcfe00700 1 Processor -- start 2024-01-22T05:19:44.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.367+0000 7f3fcfe00700 1 -- start start 2024-01-22T05:19:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.367+0000 7f3fcfe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd0062f90 0x7f3fd00aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.367+0000 7f3fcfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd0069150 0x7f3fd0158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.367+0000 7f3fcfe00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd01581b0 0x7f3fd015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:44.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.367+0000 7f3fcfe00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd0159f90 con 0x7f3fd0062f90 2024-01-22T05:19:44.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.367+0000 7f3fcfe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd0159490 con 0x7f3fd0069150 2024-01-22T05:19:44.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.367+0000 7f3fcfe00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd01596f0 con 0x7f3fd01581b0 2024-01-22T05:19:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.367+0000 7f3fcea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd0062f90 0x7f3fd00aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.367+0000 7f3fcea00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd0062f90 0x7f3fd00aaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33890/0 (socket says 172.21.15.49:33890) 2024-01-22T05:19:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.367+0000 7f3fcea00700 1 -- 172.21.15.49:0/301686141 learned_addr learned my addr 172.21.15.49:0/301686141 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.371+0000 7f3fce000700 1 --2- 172.21.15.49:0/301686141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd0069150 0x7f3fd0158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.371+0000 7f3fcf400700 1 --2- 172.21.15.49:0/301686141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd01581b0 0x7f3fd015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.371+0000 7f3fcea00700 1 -- 172.21.15.49:0/301686141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd01581b0 msgr2=0x7f3fd015a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.371+0000 7f3fcea00700 1 --2- 172.21.15.49:0/301686141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd01581b0 0x7f3fd015a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.371+0000 7f3fcea00700 1 -- 172.21.15.49:0/301686141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd0069150 msgr2=0x7f3fd0158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.371+0000 7f3fcea00700 1 --2- 172.21.15.49:0/301686141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd0069150 0x7f3fd0158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.371+0000 7f3fcea00700 1 -- 172.21.15.49:0/301686141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc0009370 con 0x7f3fd0062f90 2024-01-22T05:19:44.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.371+0000 7f3fcea00700 1 --2- 172.21.15.49:0/301686141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd0062f90 0x7f3fd00aaeb0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f3fd00c51b0 tx=0x7f3fc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:44.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.371+0000 7f3fc6000700 1 -- 172.21.15.49:0/301686141 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc000b8d0 con 0x7f3fd0062f90 2024-01-22T05:19:44.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.371+0000 7f3fc6000700 1 -- 172.21.15.49:0/301686141 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc000ba30 con 0x7f3fd0062f90 2024-01-22T05:19:44.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.371+0000 7f3fcfe00700 1 -- 172.21.15.49:0/301686141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd01599d0 con 0x7f3fd0062f90 2024-01-22T05:19:44.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.371+0000 7f3fc6000700 1 -- 172.21.15.49:0/301686141 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc001b660 con 0x7f3fd0062f90 2024-01-22T05:19:44.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.371+0000 7f3fcfe00700 1 -- 172.21.15.49:0/301686141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd0153df0 con 0x7f3fd0062f90 2024-01-22T05:19:44.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.375+0000 7f3fcfe00700 1 -- 172.21.15.49:0/301686141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd0066520 con 0x7f3fd0062f90 2024-01-22T05:19:44.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.375+0000 7f3fc6000700 1 -- 172.21.15.49:0/301686141 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3fc001ba50 con 0x7f3fd0062f90 2024-01-22T05:19:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.375+0000 7f3fc6000700 1 --2- 172.21.15.49:0/301686141 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3fa805a510 0x7f3fa805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:44.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.375+0000 7f3fc6000700 1 -- 172.21.15.49:0/301686141 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3fc00763f0 con 0x7f3fd0062f90 2024-01-22T05:19:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.375+0000 7f3fce000700 1 --2- 172.21.15.49:0/301686141 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3fa805a510 0x7f3fa805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:44.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.375+0000 7f3fce000700 1 --2- 172.21.15.49:0/301686141 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3fa805a510 0x7f3fa805c9d0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f3fd015ba00 tx=0x7f3fb8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.379+0000 7f3fc6000700 1 -- 172.21.15.49:0/301686141 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3fc00499b0 con 0x7f3fd0062f90 2024-01-22T05:19:44.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.595+0000 7f3fcfe00700 1 -- 172.21.15.49:0/301686141 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3fd0068180 con 0x7f3fd0062f90 2024-01-22T05:19:44.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.603+0000 7f3fc6000700 1 -- 172.21.15.49:0/301686141 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3fc0029020 con 0x7f3fd0062f90 2024-01-22T05:19:44.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.607+0000 7f3fcfe00700 1 -- 172.21.15.49:0/301686141 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3fa805a510 msgr2=0x7f3fa805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:44.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.607+0000 7f3fcfe00700 1 --2- 172.21.15.49:0/301686141 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3fa805a510 0x7f3fa805c9d0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f3fd015ba00 tx=0x7f3fb8008040).stop 2024-01-22T05:19:44.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.607+0000 7f3fcfe00700 1 -- 172.21.15.49:0/301686141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd0062f90 msgr2=0x7f3fd00aaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:44.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.607+0000 7f3fcfe00700 1 --2- 172.21.15.49:0/301686141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd0062f90 0x7f3fd00aaeb0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f3fd00c51b0 tx=0x7f3fc0017000).stop 2024-01-22T05:19:44.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.607+0000 7f3fcfe00700 1 -- 172.21.15.49:0/301686141 shutdown_connections 2024-01-22T05:19:44.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.607+0000 7f3fcfe00700 1 --2- 172.21.15.49:0/301686141 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f3fa805a510 0x7f3fa805c9d0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.607+0000 7f3fcfe00700 1 --2- 172.21.15.49:0/301686141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd01581b0 0x7f3fd015a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.607+0000 7f3fcfe00700 1 --2- 172.21.15.49:0/301686141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd0069150 0x7f3fd0158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.607+0000 7f3fcfe00700 1 --2- 172.21.15.49:0/301686141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fd0062f90 0x7f3fd00aaeb0 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.607+0000 7f3fcfe00700 1 -- 172.21.15.49:0/301686141 >> 172.21.15.49:0/301686141 conn(0x7f3fd00c8740 msgr2=0x7f3fd00c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:44.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.607+0000 7f3fcfe00700 1 -- 172.21.15.49:0/301686141 shutdown_connections 2024-01-22T05:19:44.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.607+0000 7f3fcfe00700 1 -- 172.21.15.49:0/301686141 wait complete. 2024-01-22T05:19:44.612 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-01-22T05:19:44.633 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:19:44.663 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-22T05:19:44.663+0000 7f5f09200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:19:44.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.799+0000 7fa468600700 1 Processor -- start 2024-01-22T05:19:44.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.803+0000 7fa468600700 1 -- start start 2024-01-22T05:19:44.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.803+0000 7fa468600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa4601395b0 0x7fa460139990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:44.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.803+0000 7fa468600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa460064980 0x7fa4600c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:44.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.803+0000 7fa468600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4600bdc90 con 0x7fa4600644f0 2024-01-22T05:19:44.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.803+0000 7fa468600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4600c40e0 con 0x7fa460064980 2024-01-22T05:19:44.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.803+0000 7fa468600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4600c3460 con 0x7fa4601395b0 2024-01-22T05:19:44.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.803+0000 7fa467000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa460064980 0x7fa4600c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:44.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.803+0000 7fa467000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa460064980 0x7fa4600c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33898/0 (socket says 172.21.15.49:33898) 2024-01-22T05:19:44.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.803+0000 7fa467000700 1 -- 172.21.15.49:0/2634122901 learned_addr learned my addr 172.21.15.49:0/2634122901 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:44.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.803+0000 7fa465c00700 1 --2- 172.21.15.49:0/2634122901 >> v2:172.21.15.110:3300/0 conn(0x7fa4601395b0 0x7fa460139990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:44.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.807+0000 7fa467000700 1 -- 172.21.15.49:0/2634122901 >> v2:172.21.15.110:3300/0 conn(0x7fa4601395b0 msgr2=0x7fa460139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:44.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.807+0000 7fa467000700 1 --2- 172.21.15.49:0/2634122901 >> v2:172.21.15.110:3300/0 conn(0x7fa4601395b0 0x7fa460139990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.807+0000 7fa467000700 1 -- 172.21.15.49:0/2634122901 >> v1:172.21.15.110:6789/0 conn(0x7fa4600644f0 legacy=0x7fa4600c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:44.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.807+0000 7fa467000700 1 -- 172.21.15.49:0/2634122901 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4600c3740 con 0x7fa460064980 2024-01-22T05:19:44.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.807+0000 7fa467000700 1 --2- 172.21.15.49:0/2634122901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa460064980 0x7fa4600c5f90 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7fa4600c57c0 tx=0x7fa458009840).ready entity=mon.0 client_cookie=d8b68ea38fc6548b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:44.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.807+0000 7fa45fe00700 1 -- 172.21.15.49:0/2634122901 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800e070 con 0x7fa460064980 2024-01-22T05:19:44.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.807+0000 7fa45fe00700 1 -- 172.21.15.49:0/2634122901 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45800ba20 con 0x7fa460064980 2024-01-22T05:19:44.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.807+0000 7fa45fe00700 1 -- 172.21.15.49:0/2634122901 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800bda0 con 0x7fa460064980 2024-01-22T05:19:44.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.807+0000 7fa468600700 1 -- 172.21.15.49:0/2634122901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa460064980 msgr2=0x7fa4600c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:44.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.807+0000 7fa468600700 1 --2- 172.21.15.49:0/2634122901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa460064980 0x7fa4600c5f90 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7fa4600c57c0 tx=0x7fa458009840).stop 2024-01-22T05:19:44.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.807+0000 7fa468600700 1 -- 172.21.15.49:0/2634122901 shutdown_connections 2024-01-22T05:19:44.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.807+0000 7fa468600700 1 --2- 172.21.15.49:0/2634122901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa460064980 0x7fa4600c5f90 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.807+0000 7fa468600700 1 --2- 172.21.15.49:0/2634122901 >> v2:172.21.15.110:3300/0 conn(0x7fa4601395b0 0x7fa460139990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.807+0000 7fa468600700 1 -- 172.21.15.49:0/2634122901 >> 172.21.15.49:0/2634122901 conn(0x7fa4600c87f0 msgr2=0x7fa4600c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:44.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.811+0000 7fa468600700 1 -- 172.21.15.49:0/2634122901 shutdown_connections 2024-01-22T05:19:44.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.811+0000 7fa468600700 1 -- 172.21.15.49:0/2634122901 wait complete. 2024-01-22T05:19:44.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.811+0000 7fa468600700 1 Processor -- start 2024-01-22T05:19:44.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.811+0000 7fa468600700 1 -- start start 2024-01-22T05:19:44.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa468600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4600644f0 0x7fa460135e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa468600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa460064980 0x7fa460165570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa468600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4601395b0 0x7fa4601643a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa468600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600a93b0 con 0x7fa4601395b0 2024-01-22T05:19:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa468600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600a8da0 con 0x7fa4600644f0 2024-01-22T05:19:44.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa468600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa460164e60 con 0x7fa460064980 2024-01-22T05:19:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa467000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4601395b0 0x7fa4601643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa467000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4601395b0 0x7fa4601643a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33910/0 (socket says 172.21.15.49:33910) 2024-01-22T05:19:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa467000700 1 -- 172.21.15.49:0/2098823343 learned_addr learned my addr 172.21.15.49:0/2098823343 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa465200700 1 --2- 172.21.15.49:0/2098823343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa460064980 0x7fa460165570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa465c00700 1 --2- 172.21.15.49:0/2098823343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4600644f0 0x7fa460135e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa467000700 1 -- 172.21.15.49:0/2098823343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa460064980 msgr2=0x7fa460165570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa467000700 1 --2- 172.21.15.49:0/2098823343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa460064980 0x7fa460165570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa467000700 1 -- 172.21.15.49:0/2098823343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4600644f0 msgr2=0x7fa460135e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa467000700 1 --2- 172.21.15.49:0/2098823343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4600644f0 0x7fa460135e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa467000700 1 -- 172.21.15.49:0/2098823343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa458009ae0 con 0x7fa4601395b0 2024-01-22T05:19:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa465c00700 1 --2- 172.21.15.49:0/2098823343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4600644f0 0x7fa460135e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:19:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa467000700 1 --2- 172.21.15.49:0/2098823343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4601395b0 0x7fa4601643a0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7fa45800b6c0 tx=0x7fa458009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa45cc00700 1 -- 172.21.15.49:0/2098823343 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4580092e0 con 0x7fa4601395b0 2024-01-22T05:19:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa45cc00700 1 -- 172.21.15.49:0/2098823343 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45801e470 con 0x7fa4601395b0 2024-01-22T05:19:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa45cc00700 1 -- 172.21.15.49:0/2098823343 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45801e830 con 0x7fa4601395b0 2024-01-22T05:19:44.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.815+0000 7fa468600700 1 -- 172.21.15.49:0/2098823343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa460165140 con 0x7fa4601395b0 2024-01-22T05:19:44.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.819+0000 7fa468600700 1 -- 172.21.15.49:0/2098823343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa460136370 con 0x7fa4601395b0 2024-01-22T05:19:44.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.819+0000 7fa468600700 1 -- 172.21.15.49:0/2098823343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa460047060 con 0x7fa4601395b0 2024-01-22T05:19:44.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.819+0000 7fa45cc00700 1 -- 172.21.15.49:0/2098823343 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa458003040 con 0x7fa4601395b0 2024-01-22T05:19:44.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.823+0000 7fa45cc00700 1 --2- 172.21.15.49:0/2098823343 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa43805a510 0x7fa43805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:44.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.823+0000 7fa45cc00700 1 -- 172.21.15.49:0/2098823343 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fa458075f90 con 0x7fa4601395b0 2024-01-22T05:19:44.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.823+0000 7fa465c00700 1 --2- 172.21.15.49:0/2098823343 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa43805a510 0x7fa43805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:44.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.823+0000 7fa465c00700 1 --2- 172.21.15.49:0/2098823343 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa43805a510 0x7fa43805c9d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fa450006d80 tx=0x7fa450008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:44.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:44.827+0000 7fa45cc00700 1 -- 172.21.15.49:0/2098823343 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa458049550 con 0x7fa4601395b0 2024-01-22T05:19:45.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.027+0000 7fa468600700 1 -- 172.21.15.49:0/2098823343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4600c3a20 con 0x7fa4601395b0 2024-01-22T05:19:45.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.027+0000 7fa45cc00700 1 -- 172.21.15.49:0/2098823343 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) v1 ==== 95+0+4511 (secure 0 0 0) 0x7fa458023030 con 0x7fa4601395b0 2024-01-22T05:19:45.030 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:45.030 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":151,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1805560931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1805560931},{"type":"v1","addr":"172.21.15.110:6833","nonce":1805560931}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3941922826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3941922826},{"type":"v1","addr":"172.21.15.110:6835","nonce":3941922826}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2796452202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2796452202},{"type":"v1","addr":"172.21.15.49:6836","nonce":2796452202}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:39.299248+0000","modified":"2024-01-22T05:19:42.441820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10476":{"gid":10476,"name":"a","rank":0,"incarnation":147,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/1585471135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1585471135},{"type":"v1","addr":"172.21.15.49:6837","nonce":1585471135}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2024-01-22T05:19:45.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.031+0000 7fa468600700 1 -- 172.21.15.49:0/2098823343 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa43805a510 msgr2=0x7fa43805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:45.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.031+0000 7fa468600700 1 --2- 172.21.15.49:0/2098823343 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa43805a510 0x7fa43805c9d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fa450006d80 tx=0x7fa450008040).stop 2024-01-22T05:19:45.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.031+0000 7fa468600700 1 -- 172.21.15.49:0/2098823343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4601395b0 msgr2=0x7fa4601643a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:45.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.031+0000 7fa468600700 1 --2- 172.21.15.49:0/2098823343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4601395b0 0x7fa4601643a0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7fa45800b6c0 tx=0x7fa458009840).stop 2024-01-22T05:19:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.031+0000 7fa468600700 1 -- 172.21.15.49:0/2098823343 shutdown_connections 2024-01-22T05:19:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.031+0000 7fa468600700 1 --2- 172.21.15.49:0/2098823343 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa43805a510 0x7fa43805c9d0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.031+0000 7fa468600700 1 --2- 172.21.15.49:0/2098823343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4601395b0 0x7fa4601643a0 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.031+0000 7fa468600700 1 --2- 172.21.15.49:0/2098823343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa460064980 0x7fa460165570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.031+0000 7fa468600700 1 --2- 172.21.15.49:0/2098823343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4600644f0 0x7fa460135e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.031+0000 7fa468600700 1 -- 172.21.15.49:0/2098823343 >> 172.21.15.49:0/2098823343 conn(0x7fa4600c87f0 msgr2=0x7fa460062b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.031+0000 7fa468600700 1 -- 172.21.15.49:0/2098823343 shutdown_connections 2024-01-22T05:19:45.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.031+0000 7fa468600700 1 -- 172.21.15.49:0/2098823343 wait complete. 2024-01-22T05:19:45.037 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 151 2024-01-22T05:19:45.458 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 151, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:19:39.299248+0000', 'modified': '2024-01-22T05:19:42.441820+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10476': {'gid': 10476, 'name': 'a', 'rank': 0, 'incarnation': 147, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6837/1585471135', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6835', 'nonce': 1585471135}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 1585471135}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:19:45.458 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:19:45.459 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-22T05:19:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.631+0000 7f79ae600700 1 Processor -- start 2024-01-22T05:19:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.631+0000 7f79ae600700 1 -- start start 2024-01-22T05:19:45.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79ae600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f79a80bee30 0x7f79a81528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79ae600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a80a9050 0x7f79a8067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79ae600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f79a80a94b0 0x7f79a8067f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79ae600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a80bf210 con 0x7f79a80bee30 2024-01-22T05:19:45.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79ae600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a8068470 con 0x7f79a80a94b0 2024-01-22T05:19:45.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79ae600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a8151d60 con 0x7f79a80a9050 2024-01-22T05:19:45.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79a7400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f79a80bee30 0x7f79a81528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79a7400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f79a80bee30 0x7f79a81528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33920/0 (socket says 172.21.15.49:33920) 2024-01-22T05:19:45.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79a7400700 1 -- 172.21.15.49:0/3913071676 learned_addr learned my addr 172.21.15.49:0/3913071676 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:45.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79ad000700 1 --2- 172.21.15.49:0/3913071676 >> v2:172.21.15.110:3300/0 conn(0x7f79a80a94b0 0x7f79a8067f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79a6a00700 1 --2- 172.21.15.49:0/3913071676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a80a9050 0x7f79a8067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79a7400700 1 -- 172.21.15.49:0/3913071676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a80a9050 msgr2=0x7f79a8067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:45.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79a7400700 1 --2- 172.21.15.49:0/3913071676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a80a9050 0x7f79a8067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79a7400700 1 -- 172.21.15.49:0/3913071676 >> v2:172.21.15.110:3300/0 conn(0x7f79a80a94b0 msgr2=0x7f79a8067f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:45.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79a7400700 1 --2- 172.21.15.49:0/3913071676 >> v2:172.21.15.110:3300/0 conn(0x7f79a80a94b0 0x7f79a8067f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79a7400700 1 -- 172.21.15.49:0/3913071676 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a81559f0 con 0x7f79a80bee30 2024-01-22T05:19:45.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79ad000700 1 --2- 172.21.15.49:0/3913071676 >> v2:172.21.15.110:3300/0 conn(0x7f79a80a94b0 0x7f79a8067f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79a7400700 1 --2- 172.21.15.49:0/3913071676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79a80bee30 0x7f79a81528e0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7f79a81382c0 tx=0x7f79980090f0).ready entity=mon.0 client_cookie=275d360a13996891 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79a6000700 1 -- 172.21.15.49:0/3913071676 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799800b600 con 0x7f79a80bee30 2024-01-22T05:19:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79a6000700 1 -- 172.21.15.49:0/3913071676 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799800b760 con 0x7f79a80bee30 2024-01-22T05:19:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.635+0000 7f79a6000700 1 -- 172.21.15.49:0/3913071676 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799800bae0 con 0x7f79a80bee30 2024-01-22T05:19:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.639+0000 7f79ae600700 1 -- 172.21.15.49:0/3913071676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79a80bee30 msgr2=0x7f79a81528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.639+0000 7f79ae600700 1 --2- 172.21.15.49:0/3913071676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79a80bee30 0x7f79a81528e0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7f79a81382c0 tx=0x7f79980090f0).stop 2024-01-22T05:19:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.639+0000 7f79ae600700 1 -- 172.21.15.49:0/3913071676 shutdown_connections 2024-01-22T05:19:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.639+0000 7f79ae600700 1 --2- 172.21.15.49:0/3913071676 >> v2:172.21.15.110:3300/0 conn(0x7f79a80a94b0 0x7f79a8067f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.639+0000 7f79ae600700 1 --2- 172.21.15.49:0/3913071676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a80a9050 0x7f79a8067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.639+0000 7f79ae600700 1 --2- 172.21.15.49:0/3913071676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79a80bee30 0x7f79a81528e0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.639+0000 7f79ae600700 1 -- 172.21.15.49:0/3913071676 >> 172.21.15.49:0/3913071676 conn(0x7f79a80ca9a0 msgr2=0x7f79a80c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.639+0000 7f79ae600700 1 -- 172.21.15.49:0/3913071676 shutdown_connections 2024-01-22T05:19:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.639+0000 7f79ae600700 1 -- 172.21.15.49:0/3913071676 wait complete. 2024-01-22T05:19:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.639+0000 7f79ae600700 1 Processor -- start 2024-01-22T05:19:45.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ae600700 1 -- start start 2024-01-22T05:19:45.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ae600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79a80a9050 0x7f79a814fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ae600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a80a94b0 0x7f79a8150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ae600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79a80bee30 0x7f79a80aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ae600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a81507f0 con 0x7f79a80bee30 2024-01-22T05:19:45.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ae600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a8152e40 con 0x7f79a80a9050 2024-01-22T05:19:45.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ae600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80ac500 con 0x7f79a80a94b0 2024-01-22T05:19:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ad000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79a80bee30 0x7f79a80aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ad000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79a80bee30 0x7f79a80aefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33934/0 (socket says 172.21.15.49:33934) 2024-01-22T05:19:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ad000700 1 -- 172.21.15.49:0/2209798337 learned_addr learned my addr 172.21.15.49:0/2209798337 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79a6a00700 1 --2- 172.21.15.49:0/2209798337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a80a94b0 0x7f79a8150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79a7400700 1 --2- 172.21.15.49:0/2209798337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79a80a9050 0x7f79a814fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ad000700 1 -- 172.21.15.49:0/2209798337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a80a94b0 msgr2=0x7f79a8150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:45.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ad000700 1 --2- 172.21.15.49:0/2209798337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a80a94b0 0x7f79a8150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ad000700 1 -- 172.21.15.49:0/2209798337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79a80a9050 msgr2=0x7f79a814fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:45.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ad000700 1 --2- 172.21.15.49:0/2209798337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79a80a9050 0x7f79a814fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ad000700 1 -- 172.21.15.49:0/2209798337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7998009370 con 0x7f79a80bee30 2024-01-22T05:19:45.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.643+0000 7f79ad000700 1 --2- 172.21.15.49:0/2209798337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79a80bee30 0x7f79a80aefb0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 rx=0x7f79a000d150 tx=0x7f79a0009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:45.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.647+0000 7f799ea00700 1 -- 172.21.15.49:0/2209798337 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a000dc90 con 0x7f79a80bee30 2024-01-22T05:19:45.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.647+0000 7f799ea00700 1 -- 172.21.15.49:0/2209798337 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a000f040 con 0x7f79a80bee30 2024-01-22T05:19:45.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.647+0000 7f799ea00700 1 -- 172.21.15.49:0/2209798337 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a00133f0 con 0x7f79a80bee30 2024-01-22T05:19:45.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.647+0000 7f79ae600700 1 -- 172.21.15.49:0/2209798337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a8152510 con 0x7f79a80bee30 2024-01-22T05:19:45.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.647+0000 7f79ae600700 1 -- 172.21.15.49:0/2209798337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a8152ad0 con 0x7f79a80bee30 2024-01-22T05:19:45.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.647+0000 7f799ea00700 1 -- 172.21.15.49:0/2209798337 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f79a00137e0 con 0x7f79a80bee30 2024-01-22T05:19:45.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.651+0000 7f799ea00700 1 --2- 172.21.15.49:0/2209798337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f798005a510 0x7f798005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.651+0000 7f799ea00700 1 -- 172.21.15.49:0/2209798337 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f79a0074f40 con 0x7f79a80bee30 2024-01-22T05:19:45.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.651+0000 7f79a7400700 1 --2- 172.21.15.49:0/2209798337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f798005a510 0x7f798005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.651+0000 7f79a7400700 1 --2- 172.21.15.49:0/2209798337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f798005a510 0x7f798005c9d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f7998009130 tx=0x7f7998017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.651+0000 7f79b8b62740 1 Processor -- start 2024-01-22T05:19:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79b8b62740 1 -- start start 2024-01-22T05:19:45.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79b8b62740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22113a0 0x21f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79b8b62740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x21ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79b8b62740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2211780 0x21ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79b8b62740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2150410 con 0x21d0e40 2024-01-22T05:19:45.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79b8b62740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2150550 con 0x22113a0 2024-01-22T05:19:45.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79b8b62740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2150a00 con 0x2211780 2024-01-22T05:19:45.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79a6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x21ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79a6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x21ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33946/0 (socket says 172.21.15.49:33946) 2024-01-22T05:19:45.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79a6a00700 1 -- 172.21.15.49:0/3314928387 learned_addr learned my addr 172.21.15.49:0/3314928387 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:45.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79ad000700 1 --2- 172.21.15.49:0/3314928387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2211780 0x21ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79a7400700 1 --2- 172.21.15.49:0/3314928387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22113a0 0x21f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79a6a00700 1 -- 172.21.15.49:0/3314928387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2211780 msgr2=0x21ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:45.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79a6a00700 1 --2- 172.21.15.49:0/3314928387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2211780 0x21ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79a6a00700 1 -- 172.21.15.49:0/3314928387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22113a0 msgr2=0x21f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:45.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79a6a00700 1 --2- 172.21.15.49:0/3314928387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22113a0 0x21f5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79a6a00700 1 -- 172.21.15.49:0/3314928387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2149730 con 0x21d0e40 2024-01-22T05:19:45.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79ad000700 1 --2- 172.21.15.49:0/3314928387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2211780 0x21ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:45.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79a7400700 1 --2- 172.21.15.49:0/3314928387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22113a0 0x21f5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:45.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f79a6a00700 1 --2- 172.21.15.49:0/3314928387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x21ccaf0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7f799000b970 tx=0x7f7990008040).ready entity=mon.0 client_cookie=e962c59781ad65d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f7997400700 1 -- 172.21.15.49:0/3314928387 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79900108f0 con 0x21d0e40 2024-01-22T05:19:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f7997400700 1 -- 172.21.15.49:0/3314928387 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7990010a50 con 0x21d0e40 2024-01-22T05:19:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.655+0000 7f7997400700 1 -- 172.21.15.49:0/3314928387 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990010dd0 con 0x21d0e40 2024-01-22T05:19:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.659+0000 7f79b8b62740 1 -- 172.21.15.49:0/3314928387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 msgr2=0x21ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.659+0000 7f79b8b62740 1 --2- 172.21.15.49:0/3314928387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x21ccaf0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7f799000b970 tx=0x7f7990008040).stop 2024-01-22T05:19:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.659+0000 7f79b8b62740 1 -- 172.21.15.49:0/3314928387 shutdown_connections 2024-01-22T05:19:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.659+0000 7f79b8b62740 1 --2- 172.21.15.49:0/3314928387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2211780 0x21ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.659+0000 7f79b8b62740 1 --2- 172.21.15.49:0/3314928387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x21ccaf0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.659+0000 7f79b8b62740 1 --2- 172.21.15.49:0/3314928387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22113a0 0x21f5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.659+0000 7f79b8b62740 1 -- 172.21.15.49:0/3314928387 >> 172.21.15.49:0/3314928387 conn(0x1fae550 msgr2=0x21d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:45.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.659+0000 7f79b8b62740 1 -- 172.21.15.49:0/3314928387 shutdown_connections 2024-01-22T05:19:45.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.659+0000 7f79b8b62740 1 -- 172.21.15.49:0/3314928387 wait complete. 2024-01-22T05:19:45.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.659+0000 7f79b8b62740 1 -- start start 2024-01-22T05:19:45.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.659+0000 7f79b8b62740 1 Processor -- start 2024-01-22T05:19:45.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79b8b62740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x21fbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79b8b62740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22113a0 0x2210410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79b8b62740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2211780 0x21f4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79b8b62740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x211b650 con 0x21d0e40 2024-01-22T05:19:45.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79b8b62740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x220fe20 con 0x2211780 2024-01-22T05:19:45.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79b8b62740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x21fc310 con 0x22113a0 2024-01-22T05:19:45.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79b8b62740 10 client.0 ll_register_callbacks cb 0x2188020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:19:45.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79a7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x21fbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79a7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x21fbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33960/0 (socket says 172.21.15.49:33960) 2024-01-22T05:19:45.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79a7400700 1 -- 172.21.15.49:0/765671503 learned_addr learned my addr 172.21.15.49:0/765671503 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:45.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79a6a00700 1 --2- 172.21.15.49:0/765671503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22113a0 0x2210410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79ad000700 1 --2- 172.21.15.49:0/765671503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2211780 0x21f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79a7400700 1 -- 172.21.15.49:0/765671503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22113a0 msgr2=0x2210410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:45.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79a7400700 1 --2- 172.21.15.49:0/765671503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22113a0 0x2210410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79a7400700 1 -- 172.21.15.49:0/765671503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2211780 msgr2=0x21f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79a7400700 1 --2- 172.21.15.49:0/765671503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2211780 0x21f4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79a7400700 1 -- 172.21.15.49:0/765671503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799000e040 con 0x21d0e40 2024-01-22T05:19:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79ad000700 1 --2- 172.21.15.49:0/765671503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2211780 0x21f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79a7400700 1 --2- 172.21.15.49:0/765671503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x21fbd10 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7f79a8082ca0 tx=0x7f799801e070).ready entity=mon.0 client_cookie=257b2431d91e748d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f798fe00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:19:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f798fe00700 1 -- 172.21.15.49:0/765671503 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998030420 con 0x21d0e40 2024-01-22T05:19:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f798fe00700 1 -- 172.21.15.49:0/765671503 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(197..197 src has 1..197) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7998030580 con 0x21d0e40 2024-01-22T05:19:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.663+0000 7f79b8b62740 1 -- 172.21.15.49:0/765671503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x21461a0 con 0x21d0e40 2024-01-22T05:19:45.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f798fe00700 1 -- 172.21.15.49:0/765671503 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=151) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7998030740 con 0x21d0e40 2024-01-22T05:19:45.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f79b8b62740 10 client.10617 fetch_fsmap learned FSMap version 151 2024-01-22T05:19:45.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f79b8b62740 1 -- 172.21.15.49:0/765671503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) v3 -- 0x2144960 con 0x21d0e40 2024-01-22T05:19:45.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f798fe00700 1 -- 172.21.15.49:0/765671503 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x21461a0 con 0x21d0e40 2024-01-22T05:19:45.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f798fe00700 1 -- 172.21.15.49:0/765671503 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 151) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f79980308a0 con 0x21d0e40 2024-01-22T05:19:45.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f79b8b62740 10 client.10617 fetch_fsmap finished waiting for FSMap version 151 2024-01-22T05:19:45.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f79b8b62740 10 client.10617 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:19:45.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f79b8b62740 20 client.10617 populate_metadata read hostname 'smithi049' 2024-01-22T05:19:45.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f79b8b62740 1 --2- 172.21.15.49:0/765671503 >> [v2:172.21.15.49:6835/1585471135,v1:172.21.15.49:6837/1585471135] conn(0x21fadf0 0x2214e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f79b8b62740 4 client.10617 mds_command: new command op to 10476 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:19:45.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f79b8b62740 1 -- 172.21.15.49:0/765671503 --> [v2:172.21.15.49:6835/1585471135,v1:172.21.15.49:6837/1585471135] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x213c6f0 con 0x21fadf0 2024-01-22T05:19:45.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f79a6a00700 1 --2- 172.21.15.49:0/765671503 >> [v2:172.21.15.49:6835/1585471135,v1:172.21.15.49:6837/1585471135] conn(0x21fadf0 0x2214e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f79a6a00700 1 --2- 172.21.15.49:0/765671503 >> [v2:172.21.15.49:6835/1585471135,v1:172.21.15.49:6837/1585471135] conn(0x21fadf0 0x2214e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2ad3907924165d34 server_cookie=65b7311e25183d40 in_seq=0 out_seq=0 2024-01-22T05:19:45.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f798fe00700 10 client.10617 ms_handle_connect on v2:172.21.15.49:6835/1585471135 2024-01-22T05:19:45.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f798fe00700 1 -- 172.21.15.49:0/765671503 <== mds.0 v2:172.21.15.49:6835/1585471135 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x213c6f0 con 0x21fadf0 2024-01-22T05:19:45.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f798fe00700 10 client.10617 handle_command_reply: tid=0 2024-01-22T05:19:45.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.667+0000 7f79b8b62740 1 client.10617 shutdown 2024-01-22T05:19:45.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.671+0000 7f79b8b62740 1 -- 172.21.15.49:0/765671503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 msgr2=0x21fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:45.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.671+0000 7f79b8b62740 1 --2- 172.21.15.49:0/765671503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x21fbd10 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7f79a8082ca0 tx=0x7f799801e070).stop 2024-01-22T05:19:45.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.671+0000 7f79b8b62740 1 -- 172.21.15.49:0/765671503 shutdown_connections 2024-01-22T05:19:45.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.671+0000 7f79b8b62740 1 --2- 172.21.15.49:0/765671503 >> [v2:172.21.15.49:6835/1585471135,v1:172.21.15.49:6837/1585471135] conn(0x21fadf0 0x2214e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.671+0000 7f79b8b62740 1 --2- 172.21.15.49:0/765671503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2211780 0x21f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.671+0000 7f79b8b62740 1 --2- 172.21.15.49:0/765671503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22113a0 0x2210410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.671+0000 7f79b8b62740 1 --2- 172.21.15.49:0/765671503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x21fbd10 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.671+0000 7f79b8b62740 1 -- 172.21.15.49:0/765671503 >> 172.21.15.49:0/765671503 conn(0x1fae550 msgr2=0x2217350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:45.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.671+0000 7f798fe00700 0 client.10617 ms_handle_reset on v2:172.21.15.49:6835/1585471135 2024-01-22T05:19:45.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.671+0000 7f79b8b62740 1 -- 172.21.15.49:0/765671503 shutdown_connections 2024-01-22T05:19:45.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.671+0000 7f79b8b62740 1 -- 172.21.15.49:0/765671503 wait complete. 2024-01-22T05:19:45.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.671+0000 7f79b8b62740 20 client.10617 trim_cache size 0 max 16384 2024-01-22T05:19:45.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79b8b62740 1 Processor -- start 2024-01-22T05:19:45.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79b8b62740 1 -- start start 2024-01-22T05:19:45.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79b8b62740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x21d0e40 0x21f5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79b8b62740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22113a0 0x2213030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79b8b62740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2211780 0x2213520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79b8b62740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x220d7e0 con 0x22113a0 2024-01-22T05:19:45.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79b8b62740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x220d210 con 0x2211780 2024-01-22T05:19:45.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79b8b62740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x21f5ca0 con 0x21d0e40 2024-01-22T05:19:45.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79a6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22113a0 0x2213030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79a6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22113a0 0x2213030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33964/0 (socket says 172.21.15.49:33964) 2024-01-22T05:19:45.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79a6a00700 1 -- 172.21.15.49:0/2499278254 learned_addr learned my addr 172.21.15.49:0/2499278254 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79ad000700 1 --2- 172.21.15.49:0/2499278254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2211780 0x2213520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79a6a00700 1 -- 172.21.15.49:0/2499278254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x21d0e40 msgr2=0x21f5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79a6a00700 1 --2- 172.21.15.49:0/2499278254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x21d0e40 0x21f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:19:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79a6a00700 1 -- 172.21.15.49:0/2499278254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2211780 msgr2=0x2213520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79a6a00700 1 --2- 172.21.15.49:0/2499278254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2211780 0x2213520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79a6a00700 1 -- 172.21.15.49:0/2499278254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2216260 con 0x22113a0 2024-01-22T05:19:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79ad000700 1 --2- 172.21.15.49:0/2499278254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2211780 0x2213520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:19:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f79a6a00700 1 --2- 172.21.15.49:0/2499278254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22113a0 0x2213030 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 rx=0x7f7990015000 tx=0x7f7990026280).ready entity=mon.0 client_cookie=a28d5603cfe15b70 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f7997e00700 1 -- 172.21.15.49:0/2499278254 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990010e40 con 0x22113a0 2024-01-22T05:19:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f7997e00700 1 -- 172.21.15.49:0/2499278254 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7990005880 con 0x22113a0 2024-01-22T05:19:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.691+0000 7f7997e00700 1 -- 172.21.15.49:0/2499278254 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79900059f0 con 0x22113a0 2024-01-22T05:19:45.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.695+0000 7f79b8b62740 1 -- 172.21.15.49:0/2499278254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22113a0 msgr2=0x2213030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:45.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.695+0000 7f79b8b62740 1 --2- 172.21.15.49:0/2499278254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22113a0 0x2213030 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 rx=0x7f7990015000 tx=0x7f7990026280).stop 2024-01-22T05:19:45.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.695+0000 7f79b8b62740 1 -- 172.21.15.49:0/2499278254 shutdown_connections 2024-01-22T05:19:45.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.695+0000 7f79b8b62740 1 --2- 172.21.15.49:0/2499278254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2211780 0x2213520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.695+0000 7f79b8b62740 1 --2- 172.21.15.49:0/2499278254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22113a0 0x2213030 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.695+0000 7f79b8b62740 1 --2- 172.21.15.49:0/2499278254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x21d0e40 0x21f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:19:45.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.695+0000 7f79b8b62740 1 -- 172.21.15.49:0/2499278254 >> 172.21.15.49:0/2499278254 conn(0x1fae550 msgr2=0x21fb290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:45.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.695+0000 7f79b8b62740 1 -- 172.21.15.49:0/2499278254 shutdown_connections 2024-01-22T05:19:45.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.695+0000 7f79b8b62740 1 -- 172.21.15.49:0/2499278254 wait complete. 2024-01-22T05:19:45.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.695+0000 7f79b8b62740 1 -- start start 2024-01-22T05:19:45.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.699+0000 7f79b8b62740 1 Processor -- start 2024-01-22T05:19:45.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.699+0000 7f79b8b62740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x2277be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.699+0000 7f79b8b62740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22113a0 0x22246a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.699+0000 7f79b8b62740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2211780 0x2224b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.699+0000 7f79b8b62740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x21f57a0 con 0x21d0e40 2024-01-22T05:19:45.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.699+0000 7f79b8b62740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2225080 con 0x22113a0 2024-01-22T05:19:45.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.699+0000 7f79b8b62740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x21f3a80 con 0x2211780 2024-01-22T05:19:45.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.699+0000 7f79b8b62740 10 client.0 ll_register_callbacks cb 0x7f7998000c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:19:45.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79a7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x2277be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79a7400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x2277be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33970/0 (socket says 172.21.15.49:33970) 2024-01-22T05:19:45.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79a7400700 1 -- 172.21.15.49:0/2429893064 learned_addr learned my addr 172.21.15.49:0/2429893064 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:45.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79ad000700 1 --2- 172.21.15.49:0/2429893064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2211780 0x2224b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79a6a00700 1 --2- 172.21.15.49:0/2429893064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22113a0 0x22246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79a7400700 1 -- 172.21.15.49:0/2429893064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2211780 msgr2=0x2224b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:45.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79a7400700 1 --2- 172.21.15.49:0/2429893064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2211780 0x2224b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79a7400700 1 -- 172.21.15.49:0/2429893064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22113a0 msgr2=0x22246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:45.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79a7400700 1 --2- 172.21.15.49:0/2429893064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22113a0 0x22246a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79a7400700 1 -- 172.21.15.49:0/2429893064 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2149730 con 0x21d0e40 2024-01-22T05:19:45.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79ad000700 1 --2- 172.21.15.49:0/2429893064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2211780 0x2224b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:45.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79a6a00700 1 --2- 172.21.15.49:0/2429893064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22113a0 0x22246a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:45.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79a7400700 1 --2- 172.21.15.49:0/2429893064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x2277be0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 rx=0x7f799800a010 tx=0x7f7998029070).ready entity=mon.0 client_cookie=7611fe25564268b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:45.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f798fe00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:19:45.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f798fe00700 1 -- 172.21.15.49:0/2429893064 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998030880 con 0x21d0e40 2024-01-22T05:19:45.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f798fe00700 1 -- 172.21.15.49:0/2429893064 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(197..197 src has 1..197) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f7998027410 con 0x21d0e40 2024-01-22T05:19:45.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79b8b62740 1 -- 172.21.15.49:0/2429893064 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2212920 con 0x21d0e40 2024-01-22T05:19:45.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f798fe00700 1 -- 172.21.15.49:0/2429893064 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=151) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79980309e0 con 0x21d0e40 2024-01-22T05:19:45.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79b8b62740 10 client.10623 fetch_fsmap learned FSMap version 151 2024-01-22T05:19:45.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79b8b62740 1 -- 172.21.15.49:0/2429893064 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) v3 -- 0x7f79a80c5d20 con 0x21d0e40 2024-01-22T05:19:45.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f798fe00700 1 -- 172.21.15.49:0/2429893064 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2212920 con 0x21d0e40 2024-01-22T05:19:45.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f798fe00700 1 -- 172.21.15.49:0/2429893064 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 151) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f79980277e0 con 0x21d0e40 2024-01-22T05:19:45.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79b8b62740 10 client.10623 fetch_fsmap finished waiting for FSMap version 151 2024-01-22T05:19:45.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79b8b62740 10 client.10623 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:19:45.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79b8b62740 20 client.10623 populate_metadata read hostname 'smithi049' 2024-01-22T05:19:45.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79b8b62740 1 --2- 172.21.15.49:0/2429893064 >> [v2:172.21.15.49:6835/1585471135,v1:172.21.15.49:6837/1585471135] conn(0x21cd0e0 0x21cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79b8b62740 4 client.10623 mds_command: new command op to 10476 tid=0[{"prefix": "status"}] 2024-01-22T05:19:45.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79b8b62740 1 -- 172.21.15.49:0/2429893064 --> [v2:172.21.15.49:6835/1585471135,v1:172.21.15.49:6837/1585471135] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f7990010a50 con 0x21cd0e0 2024-01-22T05:19:45.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.703+0000 7f79a6a00700 1 --2- 172.21.15.49:0/2429893064 >> [v2:172.21.15.49:6835/1585471135,v1:172.21.15.49:6837/1585471135] conn(0x21cd0e0 0x21cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f798fe00700 10 client.10623 ms_handle_connect on v2:172.21.15.49:6835/1585471135 2024-01-22T05:19:45.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f79a6a00700 1 --2- 172.21.15.49:0/2429893064 >> [v2:172.21.15.49:6835/1585471135,v1:172.21.15.49:6837/1585471135] conn(0x21cd0e0 0x21cd4c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9cab87410fcf93a server_cookie=e86154a0fa749a0a in_seq=0 out_seq=0 2024-01-22T05:19:45.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f798fe00700 1 -- 172.21.15.49:0/2429893064 <== mds.0 v2:172.21.15.49:6835/1585471135 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+329 (crc 0 0 0) 0x7f7990010a50 con 0x21cd0e0 2024-01-22T05:19:45.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f798fe00700 10 client.10623 handle_command_reply: tid=0 2024-01-22T05:19:45.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f79b8b62740 1 client.10623 shutdown 2024-01-22T05:19:45.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f79b8b62740 1 -- 172.21.15.49:0/2429893064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 msgr2=0x2277be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:45.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f79b8b62740 1 --2- 172.21.15.49:0/2429893064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x2277be0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 rx=0x7f799800a010 tx=0x7f7998029070).stop 2024-01-22T05:19:45.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f79b8b62740 1 -- 172.21.15.49:0/2429893064 shutdown_connections 2024-01-22T05:19:45.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f79b8b62740 1 --2- 172.21.15.49:0/2429893064 >> [v2:172.21.15.49:6835/1585471135,v1:172.21.15.49:6837/1585471135] conn(0x21cd0e0 0x21cd4c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f79b8b62740 1 --2- 172.21.15.49:0/2429893064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2211780 0x2224b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f79b8b62740 1 --2- 172.21.15.49:0/2429893064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22113a0 0x22246a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f798fe00700 0 client.10623 ms_handle_reset on v2:172.21.15.49:6835/1585471135 2024-01-22T05:19:45.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f79b8b62740 1 --2- 172.21.15.49:0/2429893064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x21d0e40 0x2277be0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f79b8b62740 1 -- 172.21.15.49:0/2429893064 >> 172.21.15.49:0/2429893064 conn(0x1fae550 msgr2=0x21cb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:45.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f79b8b62740 1 -- 172.21.15.49:0/2429893064 shutdown_connections 2024-01-22T05:19:45.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f79b8b62740 1 -- 172.21.15.49:0/2429893064 wait complete. 2024-01-22T05:19:45.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.707+0000 7f79b8b62740 20 client.10623 trim_cache size 0 max 16384 2024-01-22T05:19:45.712 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:19:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:19:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:19:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 10476, 2024-01-22T05:19:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:19:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:19:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:19:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 6.4052527990000003, 2024-01-22T05:19:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 151, 2024-01-22T05:19:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 197, 2024-01-22T05:19:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 197, 2024-01-22T05:19:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 11.952977554 2024-01-22T05:19:45.713 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:19:45.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.711+0000 7f79ae600700 1 -- 172.21.15.49:0/2209798337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f798005a510 msgr2=0x7f798005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:45.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.711+0000 7f79ae600700 1 --2- 172.21.15.49:0/2209798337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f798005a510 0x7f798005c9d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f7998009130 tx=0x7f7998017000).stop 2024-01-22T05:19:45.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.711+0000 7f79ae600700 1 -- 172.21.15.49:0/2209798337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79a80bee30 msgr2=0x7f79a80aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:45.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.711+0000 7f79ae600700 1 --2- 172.21.15.49:0/2209798337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79a80bee30 0x7f79a80aefb0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 rx=0x7f79a000d150 tx=0x7f79a0009a50).stop 2024-01-22T05:19:45.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.711+0000 7f79ae600700 1 -- 172.21.15.49:0/2209798337 shutdown_connections 2024-01-22T05:19:45.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.711+0000 7f79ae600700 1 --2- 172.21.15.49:0/2209798337 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f798005a510 0x7f798005c9d0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.711+0000 7f79ae600700 1 --2- 172.21.15.49:0/2209798337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79a80bee30 0x7f79a80aefb0 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.711+0000 7f79ae600700 1 --2- 172.21.15.49:0/2209798337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a80a94b0 0x7f79a8150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.711+0000 7f79ae600700 1 --2- 172.21.15.49:0/2209798337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79a80a9050 0x7f79a814fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.711+0000 7f79ae600700 1 -- 172.21.15.49:0/2209798337 >> 172.21.15.49:0/2209798337 conn(0x7f79a80ca9a0 msgr2=0x7f79a8067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:45.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.711+0000 7f79ae600700 1 -- 172.21.15.49:0/2209798337 shutdown_connections 2024-01-22T05:19:45.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.711+0000 7f79ae600700 1 -- 172.21.15.49:0/2209798337 wait complete. 2024-01-22T05:19:45.735 DEBUG:teuthology.orchestra.run.smithi049:> ceph fs ls 2024-01-22T05:19:45.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.875+0000 7fe3cb600700 1 Processor -- start 2024-01-22T05:19:45.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.875+0000 7fe3cb600700 1 -- start start 2024-01-22T05:19:45.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.875+0000 7fe3cb600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3c4063870 0x7fe3c4153800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3cb600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c40c22b0 0x7fe3c4157730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3cb600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c4062fc0 con 0x7fe3c4153cf0 2024-01-22T05:19:45.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3cb600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c40623b0 con 0x7fe3c4063870 2024-01-22T05:19:45.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3cb600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4062690 con 0x7fe3c40c22b0 2024-01-22T05:19:45.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3c3e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe3c4153cf0 0x7fe3c40c1ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53756/0 (socket says 172.21.15.49:53756) 2024-01-22T05:19:45.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3c3e00700 1 -- 172.21.15.49:0/967773596 learned_addr learned my addr 172.21.15.49:0/967773596 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:45.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3c8c00700 1 --2- 172.21.15.49:0/967773596 >> v2:172.21.15.110:3300/0 conn(0x7fe3c4063870 0x7fe3c4153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3c9600700 1 --2- 172.21.15.49:0/967773596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c40c22b0 0x7fe3c4157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3c3400700 1 -- 172.21.15.49:0/967773596 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515868997 0 0) 0x7fe3c4062fc0 con 0x7fe3c4153cf0 2024-01-22T05:19:45.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3c3400700 1 -- 172.21.15.49:0/967773596 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3a40033f0 con 0x7fe3c4153cf0 2024-01-22T05:19:45.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3c8c00700 1 -- 172.21.15.49:0/967773596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c40c22b0 msgr2=0x7fe3c4157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:45.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3c8c00700 1 --2- 172.21.15.49:0/967773596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c40c22b0 0x7fe3c4157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3c8c00700 1 -- 172.21.15.49:0/967773596 >> v1:172.21.15.49:6789/0 conn(0x7fe3c4153cf0 legacy=0x7fe3c40c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:45.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3c8c00700 1 -- 172.21.15.49:0/967773596 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c4062970 con 0x7fe3c4063870 2024-01-22T05:19:45.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3c8c00700 1 --2- 172.21.15.49:0/967773596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c4063870 0x7fe3c4153800 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7fe3b4009760 tx=0x7fe3b4009060).ready entity=mon.1 client_cookie=182af80f795bfd6c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:45.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3c3400700 1 -- 172.21.15.49:0/967773596 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400d4a0 con 0x7fe3c4063870 2024-01-22T05:19:45.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3c3400700 1 -- 172.21.15.49:0/967773596 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b400d600 con 0x7fe3c4063870 2024-01-22T05:19:45.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3c3400700 1 -- 172.21.15.49:0/967773596 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400d980 con 0x7fe3c4063870 2024-01-22T05:19:45.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3cb600700 1 -- 172.21.15.49:0/967773596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c4063870 msgr2=0x7fe3c4153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:45.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.879+0000 7fe3cb600700 1 --2- 172.21.15.49:0/967773596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c4063870 0x7fe3c4153800 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7fe3b4009760 tx=0x7fe3b4009060).stop 2024-01-22T05:19:45.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.883+0000 7fe3cb600700 1 -- 172.21.15.49:0/967773596 shutdown_connections 2024-01-22T05:19:45.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.883+0000 7fe3cb600700 1 --2- 172.21.15.49:0/967773596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c40c22b0 0x7fe3c4157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.883+0000 7fe3cb600700 1 --2- 172.21.15.49:0/967773596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c4063870 0x7fe3c4153800 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.883+0000 7fe3cb600700 1 -- 172.21.15.49:0/967773596 >> 172.21.15.49:0/967773596 conn(0x7fe3c40c30c0 msgr2=0x7fe3c40c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:45.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.883+0000 7fe3cb600700 1 -- 172.21.15.49:0/967773596 shutdown_connections 2024-01-22T05:19:45.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.883+0000 7fe3cb600700 1 -- 172.21.15.49:0/967773596 wait complete. 2024-01-22T05:19:45.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.883+0000 7fe3cb600700 1 Processor -- start 2024-01-22T05:19:45.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.883+0000 7fe3cb600700 1 -- start start 2024-01-22T05:19:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3cb600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c4063870 0x7fe3c4164080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3cb600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c40c22b0 0x7fe3c4152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3cb600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c4153cf0 0x7fe3c4149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3cb600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4164570 con 0x7fe3c4153cf0 2024-01-22T05:19:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3cb600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4165000 con 0x7fe3c40c22b0 2024-01-22T05:19:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3cb600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c41542c0 con 0x7fe3c4063870 2024-01-22T05:19:45.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3c9600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c4153cf0 0x7fe3c4149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3c9600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c4153cf0 0x7fe3c4149d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33982/0 (socket says 172.21.15.49:33982) 2024-01-22T05:19:45.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3c9600700 1 -- 172.21.15.49:0/2135794322 learned_addr learned my addr 172.21.15.49:0/2135794322 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:45.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3c8c00700 1 --2- 172.21.15.49:0/2135794322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c4063870 0x7fe3c4164080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3c3e00700 1 --2- 172.21.15.49:0/2135794322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c40c22b0 0x7fe3c4152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3c9600700 1 -- 172.21.15.49:0/2135794322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c4063870 msgr2=0x7fe3c4164080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:45.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3c9600700 1 --2- 172.21.15.49:0/2135794322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c4063870 0x7fe3c4164080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3c9600700 1 -- 172.21.15.49:0/2135794322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c40c22b0 msgr2=0x7fe3c4152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:45.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3c9600700 1 --2- 172.21.15.49:0/2135794322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c40c22b0 0x7fe3c4152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:45.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3c9600700 1 -- 172.21.15.49:0/2135794322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b40092a0 con 0x7fe3c4153cf0 2024-01-22T05:19:45.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3c9600700 1 --2- 172.21.15.49:0/2135794322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c4153cf0 0x7fe3c4149d10 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 rx=0x7fe3bc009f20 tx=0x7fe3bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:45.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3bbe00700 1 -- 172.21.15.49:0/2135794322 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00cb70 con 0x7fe3c4153cf0 2024-01-22T05:19:45.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3bbe00700 1 -- 172.21.15.49:0/2135794322 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc00f040 con 0x7fe3c4153cf0 2024-01-22T05:19:45.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3cb600700 1 -- 172.21.15.49:0/2135794322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c41530e0 con 0x7fe3c4153cf0 2024-01-22T05:19:45.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3bbe00700 1 -- 172.21.15.49:0/2135794322 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00cee0 con 0x7fe3c4153cf0 2024-01-22T05:19:45.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.887+0000 7fe3cb600700 1 -- 172.21.15.49:0/2135794322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c4164a40 con 0x7fe3c4153cf0 2024-01-22T05:19:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.891+0000 7fe3cb600700 1 -- 172.21.15.49:0/2135794322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c4067700 con 0x7fe3c4153cf0 2024-01-22T05:19:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.891+0000 7fe3bbe00700 1 -- 172.21.15.49:0/2135794322 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe3bc013610 con 0x7fe3c4153cf0 2024-01-22T05:19:45.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.891+0000 7fe3bbe00700 1 --2- 172.21.15.49:0/2135794322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe39c05a510 0x7fe39c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:45.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.895+0000 7fe3bbe00700 1 -- 172.21.15.49:0/2135794322 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6474+0+0 (secure 0 0 0) 0x7fe3bc075260 con 0x7fe3c4153cf0 2024-01-22T05:19:45.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.895+0000 7fe3c8c00700 1 --2- 172.21.15.49:0/2135794322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe39c05a510 0x7fe39c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:45.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.895+0000 7fe3c8c00700 1 --2- 172.21.15.49:0/2135794322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe39c05a510 0x7fe39c05c9d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fe3c4161ca0 tx=0x7fe3b4016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:45.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:45.899+0000 7fe3bbe00700 1 -- 172.21.15.49:0/2135794322 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe3bc048820 con 0x7fe3c4153cf0 2024-01-22T05:19:46.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:46.099+0000 7fe3cb600700 1 -- 172.21.15.49:0/2135794322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe3c4154400 con 0x7fe3c4153cf0 2024-01-22T05:19:46.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:46.099+0000 7fe3bbe00700 1 -- 172.21.15.49:0/2135794322 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v151) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe3bc04be40 con 0x7fe3c4153cf0 2024-01-22T05:19:46.100 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:19:46.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:46.103+0000 7fe3cb600700 1 -- 172.21.15.49:0/2135794322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe39c05a510 msgr2=0x7fe39c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:46.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:46.103+0000 7fe3cb600700 1 --2- 172.21.15.49:0/2135794322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe39c05a510 0x7fe39c05c9d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fe3c4161ca0 tx=0x7fe3b4016000).stop 2024-01-22T05:19:46.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:46.103+0000 7fe3cb600700 1 -- 172.21.15.49:0/2135794322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c4153cf0 msgr2=0x7fe3c4149d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:46.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:46.103+0000 7fe3cb600700 1 --2- 172.21.15.49:0/2135794322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c4153cf0 0x7fe3c4149d10 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 rx=0x7fe3bc009f20 tx=0x7fe3bc00b040).stop 2024-01-22T05:19:46.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:46.103+0000 7fe3cb600700 1 -- 172.21.15.49:0/2135794322 shutdown_connections 2024-01-22T05:19:46.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:46.103+0000 7fe3cb600700 1 --2- 172.21.15.49:0/2135794322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe39c05a510 0x7fe39c05c9d0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:46.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:46.103+0000 7fe3cb600700 1 --2- 172.21.15.49:0/2135794322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c4153cf0 0x7fe3c4149d10 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:46.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:46.103+0000 7fe3cb600700 1 --2- 172.21.15.49:0/2135794322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3c40c22b0 0x7fe3c4152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:46.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:46.103+0000 7fe3cb600700 1 --2- 172.21.15.49:0/2135794322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3c4063870 0x7fe3c4164080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:46.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:46.103+0000 7fe3cb600700 1 -- 172.21.15.49:0/2135794322 >> 172.21.15.49:0/2135794322 conn(0x7fe3c40c30c0 msgr2=0x7fe3c40686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:46.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:46.103+0000 7fe3cb600700 1 -- 172.21.15.49:0/2135794322 shutdown_connections 2024-01-22T05:19:46.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:46.103+0000 7fe3cb600700 1 -- 172.21.15.49:0/2135794322 wait complete. 2024-01-22T05:19:46.128 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-22T05:19:46.128 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:19:46.128 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-22T05:19:46.128 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:19:46.128 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:19:46.128 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-22T05:19:46.128 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-22T05:19:46.128 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:19:46.129 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:19:46.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:46.129 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-22T05:19:46.148 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:19:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:19:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:19:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-22T05:19:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:46.148 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:19:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:19:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-22T05:19:46.148 INFO:teuthology.orchestra.run.smithi049.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:19:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:19:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-22T05:19:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-22T05:19:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41585sec preferred_lft 41585sec 2024-01-22T05:19:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-22T05:19:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:46.149 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:19:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:19:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-22T05:19:46.149 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-22T05:19:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:19:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-22T05:19:46.149 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-22T05:19:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:02:32:bb:04 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:19:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-22T05:19:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:46.150 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:19:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:19:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:19:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::7ce7:e3ff:fed1:1e88/64 scope link 2024-01-22T05:19:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:46.150 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:19:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 82:c1:48:e7:c7:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:19:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::80c1:48ff:fee7:c731/64 scope link 2024-01-22T05:19:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:46.150 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:19:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 36:26:32:ee:c4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:19:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::3426:32ff:feee:c4c9/64 scope link 2024-01-22T05:19:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:19:46.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:46.151 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:19:46.232 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-22T05:19:46.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:46.235 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-22T05:19:46.296 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-22T05:19:46.296 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:19:46.296 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-22T05:19:46.296 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-22T05:19:46.296 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-22T05:19:46.297 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:19:46.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:46.297 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-22T05:19:46.297 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-22T05:19:46.297 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-22T05:19:46.297 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-22T05:19:46.297 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-22T05:19:46.297 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-22T05:19:46.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:46.434 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:19:46.450 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:19:46.450 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:19:46.451 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:19:46.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:46.452 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-22T05:19:46.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:46.536 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-22T05:19:46.597 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:19:46.597 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:19:46.716 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:19:46.716 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:19:46.737 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-22T05:19:46.737 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-22T05:19:46.741 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T05:19:46.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:46.742 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:19:46.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:19:46.772 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent) 2024-01-22T05:19:46.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:19:46.846 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/child) 2024-01-22T05:19:46.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:19:46.920 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=parent/parentfile bs=1M conv=fdatasync count=6 seek=0) 2024-01-22T05:19:47.084 INFO:teuthology.orchestra.run.smithi049.stderr:6+0 records in 2024-01-22T05:19:47.084 INFO:teuthology.orchestra.run.smithi049.stderr:6+0 records out 2024-01-22T05:19:47.084 INFO:teuthology.orchestra.run.smithi049.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.1018 s, 61.8 MB/s 2024-01-22T05:19:47.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:19:47.086 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=parent/child/childfile bs=1M conv=fdatasync count=6 seek=0) 2024-01-22T05:19:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:6+0 records in 2024-01-22T05:19:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:6+0 records out 2024-01-22T05:19:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.10482 s, 60.0 MB/s 2024-01-22T05:19:47.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-22T05:19:47.217 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-22T05:19:47.284 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2024-01-22T05:19:47.284 INFO:teuthology.orchestra.run.smithi049.stdout: chdir = "" 2024-01-22T05:19:47.284 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-22T05:19:47.285 INFO:teuthology.orchestra.run.smithi049.stdout: auth supported = cephx 2024-01-22T05:19:47.285 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.285 INFO:teuthology.orchestra.run.smithi049.stdout: filestore xattr use omap = true 2024-01-22T05:19:47.285 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.285 INFO:teuthology.orchestra.run.smithi049.stdout: mon clock drift allowed = 1.000 2024-01-22T05:19:47.285 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.285 INFO:teuthology.orchestra.run.smithi049.stdout: osd crush chooseleaf type = 0 2024-01-22T05:19:47.285 INFO:teuthology.orchestra.run.smithi049.stdout: auth debug = true 2024-01-22T05:19:47.285 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.285 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on old message = true 2024-01-22T05:19:47.285 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on bug = true 2024-01-22T05:19:47.285 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.285 INFO:teuthology.orchestra.run.smithi049.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-22T05:19:47.285 INFO:teuthology.orchestra.run.smithi049.stdout: mon pg warn max object skew = 0 2024-01-22T05:19:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: # disable pg_autoscaler by default for new pools 2024-01-22T05:19:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-22T05:19:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default size = 2 2024-01-22T05:19:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow primary affinity = true 2024-01-22T05:19:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow pg remap = true 2024-01-22T05:19:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on legacy crush tunables = false 2024-01-22T05:19:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on crush straw calc version zero = false 2024-01-22T05:19:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on no sortbitwise = false 2024-01-22T05:19:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on osd down out interval zero = false 2024-01-22T05:19:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on too few osds = false 2024-01-22T05:19:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-22T05:19:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-22T05:19:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: mon_allow_pool_size_one = true 2024-01-22T05:19:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2024-01-22T05:19:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: osd default data pool replay window = 5 2024-01-22T05:19:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: mon allow pool delete = true 2024-01-22T05:19:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: mon cluster log file level = debug 2024-01-22T05:19:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: debug asserts on shutdown = true 2024-01-22T05:19:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: mon health detail to clog = false 2024-01-22T05:19:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: mon host = "172.21.15.49,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-01-22T05:19:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on skipped message = False 2024-01-22T05:19:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = f4203cdb-f79e-4d7b-b9de-f994381af719 2024-01-22T05:19:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.288 INFO:teuthology.orchestra.run.smithi049.stdout:[osd] 2024-01-22T05:19:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: osd journal size = 100 2024-01-22T05:19:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub load threshold = 5.0 2024-01-22T05:19:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub max interval = 600 2024-01-22T05:19:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: osd recover clone overlap = true 2024-01-22T05:19:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: osd recovery max chunk = 1048576 2024-01-22T05:19:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug shutdown = true 2024-01-22T05:19:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug op order = true 2024-01-22T05:19:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug verify stray on activate = true 2024-01-22T05:19:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: osd open classes on start = true 2024-01-22T05:19:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug pg log writeout = true 2024-01-22T05:19:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: osd deep scrub update digest min age = 30 2024-01-22T05:19:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: osd map max advance = 10 2024-01-22T05:19:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: journal zero on create = true 2024-01-22T05:19:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: filestore ondisk finisher threads = 3 2024-01-22T05:19:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: filestore apply finisher threads = 3 2024-01-22T05:19:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: bdev debug aio = true 2024-01-22T05:19:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug misdirected ops = true 2024-01-22T05:19:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore block size = 96636764160 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore fsck on mount = True 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluefs = 20 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluestore = 20 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: debug osd = 20 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: debug rocksdb = 10 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd backfillfull_ratio = 0.85 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd full ratio = 0.9 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd nearfull ratio = 0.8 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: osd failsafe full ratio = 0.95 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: osd objectstore = bluestore 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr] 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:19:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: debug mgr = 20 2024-01-22T05:19:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-01-22T05:19:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-01-22T05:19:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:19:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:19:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: mgr/telemetry/nag = false 2024-01-22T05:19:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.291 INFO:teuthology.orchestra.run.smithi049.stdout:[mon] 2024-01-22T05:19:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:19:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-01-22T05:19:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: debug paxos = 20 2024-01-22T05:19:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-01-22T05:19:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: mon data avail warn = 5 2024-01-22T05:19:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: mon mgr mkfs grace = 240 2024-01-22T05:19:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:19:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd reporter subtree level = osd 2024-01-22T05:19:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd prime pg temp = true 2024-01-22T05:19:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:19:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-22T05:19:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: auth mon ticket ttl = 660 # 11m 2024-01-22T05:19:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: auth service ticket ttl = 240 # 4m 2024-01-22T05:19:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: # don't complain about insecure global_id in the test suite 2024-01-22T05:19:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-22T05:19:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-22T05:19:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: mon op complaint time = 120 2024-01-22T05:19:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.292 INFO:teuthology.orchestra.run.smithi049.stdout:[client] 2024-01-22T05:19:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: rgw cache enabled = true 2024-01-22T05:19:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable ops log = true 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable usage log = true 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: client mount timeout = 600 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 20 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = "" 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.a] 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.b] 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.c] 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2024-01-22T05:19:47.293 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2024-01-22T05:19:47.294 INFO:teuthology.orchestra.run.smithi049.stdout:[mds] 2024-01-22T05:19:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds = 20 2024-01-22T05:19:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds balancer = 20 2024-01-22T05:19:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:19:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: mds cache max size = 1000 2024-01-22T05:19:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug frag = True 2024-01-22T05:19:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug scatterstat = False 2024-01-22T05:19:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: mds log max segments = 1 2024-01-22T05:19:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: mds op complaint time = 180 2024-01-22T05:19:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: mds verify scatter = False 2024-01-22T05:19:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2024-01-22T05:19:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2024-01-22T05:19:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2024-01-22T05:19:47.295 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-01-22T05:19:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-01-22T05:19:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-22T05:19:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-01-22T05:19:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-01-22T05:19:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-01-22T05:19:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-01-22T05:19:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-01-22T05:19:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-01-22T05:19:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-01-22T05:19:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-22T05:19:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-01-22T05:19:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-01-22T05:19:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-22T05:19:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-01-22T05:19:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-01-22T05:19:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-01-22T05:19:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-01-22T05:19:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-01-22T05:19:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-01-22T05:19:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-01-22T05:19:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-01-22T05:19:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-22T05:19:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-22T05:19:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-01-22T05:19:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2024-01-22T05:19:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-01-22T05:19:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.49,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on skipped message = False 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = f4203cdb-f79e-4d7b-b9de-f994381af719 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-01-22T05:19:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-01-22T05:19:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-01-22T05:19:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-01-22T05:19:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-01-22T05:19:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-01-22T05:19:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-01-22T05:19:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-01-22T05:19:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-01-22T05:19:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-01-22T05:19:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-01-22T05:19:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-01-22T05:19:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-01-22T05:19:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-01-22T05:19:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-01-22T05:19:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-01-22T05:19:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 20 2024-01-22T05:19:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 20 2024-01-22T05:19:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:19:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-01-22T05:19:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 10 2024-01-22T05:19:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-01-22T05:19:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-01-22T05:19:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:19:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-01-22T05:19:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-01-22T05:19:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-01-22T05:19:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-01-22T05:19:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-01-22T05:19:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:19:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-01-22T05:19:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-01-22T05:19:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:19:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-22T05:19:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-01-22T05:19:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-01-22T05:19:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-01-22T05:19:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = "" 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-01-22T05:19:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-01-22T05:19:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-01-22T05:19:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-01-22T05:19:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-01-22T05:19:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-01-22T05:19:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-01-22T05:19:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-01-22T05:19:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2024-01-22T05:19:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2024-01-22T05:19:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds balancer = 20 2024-01-22T05:19:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:19:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: mds cache max size = 1000 2024-01-22T05:19:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2024-01-22T05:19:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = False 2024-01-22T05:19:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: mds log max segments = 1 2024-01-22T05:19:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2024-01-22T05:19:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = False 2024-01-22T05:19:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-01-22T05:19:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-01-22T05:19:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-01-22T05:19:47.307 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-22T05:19:47.359 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-22T05:19:47.423 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2024-01-22T05:19:47.423 INFO:teuthology.orchestra.run.smithi049.stdout: chdir = "" 2024-01-22T05:19:47.423 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-22T05:19:47.423 INFO:teuthology.orchestra.run.smithi049.stdout: auth supported = cephx 2024-01-22T05:19:47.423 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.423 INFO:teuthology.orchestra.run.smithi049.stdout: filestore xattr use omap = true 2024-01-22T05:19:47.423 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.423 INFO:teuthology.orchestra.run.smithi049.stdout: mon clock drift allowed = 1.000 2024-01-22T05:19:47.423 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.424 INFO:teuthology.orchestra.run.smithi049.stdout: osd crush chooseleaf type = 0 2024-01-22T05:19:47.424 INFO:teuthology.orchestra.run.smithi049.stdout: auth debug = true 2024-01-22T05:19:47.424 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.424 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on old message = true 2024-01-22T05:19:47.424 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on bug = true 2024-01-22T05:19:47.424 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.424 INFO:teuthology.orchestra.run.smithi049.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-22T05:19:47.424 INFO:teuthology.orchestra.run.smithi049.stdout: mon pg warn max object skew = 0 2024-01-22T05:19:47.424 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.424 INFO:teuthology.orchestra.run.smithi049.stdout: # disable pg_autoscaler by default for new pools 2024-01-22T05:19:47.424 INFO:teuthology.orchestra.run.smithi049.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-22T05:19:47.424 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.424 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default size = 2 2024-01-22T05:19:47.424 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.425 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow primary affinity = true 2024-01-22T05:19:47.425 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow pg remap = true 2024-01-22T05:19:47.425 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on legacy crush tunables = false 2024-01-22T05:19:47.425 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on crush straw calc version zero = false 2024-01-22T05:19:47.425 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on no sortbitwise = false 2024-01-22T05:19:47.425 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on osd down out interval zero = false 2024-01-22T05:19:47.425 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on too few osds = false 2024-01-22T05:19:47.425 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-22T05:19:47.425 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-22T05:19:47.425 INFO:teuthology.orchestra.run.smithi049.stdout: mon_allow_pool_size_one = true 2024-01-22T05:19:47.425 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.425 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2024-01-22T05:19:47.425 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.425 INFO:teuthology.orchestra.run.smithi049.stdout: osd default data pool replay window = 5 2024-01-22T05:19:47.425 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.426 INFO:teuthology.orchestra.run.smithi049.stdout: mon allow pool delete = true 2024-01-22T05:19:47.426 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.426 INFO:teuthology.orchestra.run.smithi049.stdout: mon cluster log file level = debug 2024-01-22T05:19:47.426 INFO:teuthology.orchestra.run.smithi049.stdout: debug asserts on shutdown = true 2024-01-22T05:19:47.426 INFO:teuthology.orchestra.run.smithi049.stdout: mon health detail to clog = false 2024-01-22T05:19:47.426 INFO:teuthology.orchestra.run.smithi049.stdout: mon host = "172.21.15.49,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-01-22T05:19:47.426 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on skipped message = False 2024-01-22T05:19:47.426 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = f4203cdb-f79e-4d7b-b9de-f994381af719 2024-01-22T05:19:47.426 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.426 INFO:teuthology.orchestra.run.smithi049.stdout:[osd] 2024-01-22T05:19:47.426 INFO:teuthology.orchestra.run.smithi049.stdout: osd journal size = 100 2024-01-22T05:19:47.426 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.426 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub load threshold = 5.0 2024-01-22T05:19:47.426 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub max interval = 600 2024-01-22T05:19:47.427 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.427 INFO:teuthology.orchestra.run.smithi049.stdout: osd recover clone overlap = true 2024-01-22T05:19:47.427 INFO:teuthology.orchestra.run.smithi049.stdout: osd recovery max chunk = 1048576 2024-01-22T05:19:47.427 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.427 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug shutdown = true 2024-01-22T05:19:47.427 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug op order = true 2024-01-22T05:19:47.427 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug verify stray on activate = true 2024-01-22T05:19:47.427 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.427 INFO:teuthology.orchestra.run.smithi049.stdout: osd open classes on start = true 2024-01-22T05:19:47.427 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug pg log writeout = true 2024-01-22T05:19:47.427 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.427 INFO:teuthology.orchestra.run.smithi049.stdout: osd deep scrub update digest min age = 30 2024-01-22T05:19:47.427 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.427 INFO:teuthology.orchestra.run.smithi049.stdout: osd map max advance = 10 2024-01-22T05:19:47.427 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.428 INFO:teuthology.orchestra.run.smithi049.stdout: journal zero on create = true 2024-01-22T05:19:47.428 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.428 INFO:teuthology.orchestra.run.smithi049.stdout: filestore ondisk finisher threads = 3 2024-01-22T05:19:47.428 INFO:teuthology.orchestra.run.smithi049.stdout: filestore apply finisher threads = 3 2024-01-22T05:19:47.428 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.428 INFO:teuthology.orchestra.run.smithi049.stdout: bdev debug aio = true 2024-01-22T05:19:47.428 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug misdirected ops = true 2024-01-22T05:19:47.428 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore block size = 96636764160 2024-01-22T05:19:47.428 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore fsck on mount = True 2024-01-22T05:19:47.428 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluefs = 20 2024-01-22T05:19:47.428 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluestore = 20 2024-01-22T05:19:47.428 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:19:47.428 INFO:teuthology.orchestra.run.smithi049.stdout: debug osd = 20 2024-01-22T05:19:47.428 INFO:teuthology.orchestra.run.smithi049.stdout: debug rocksdb = 10 2024-01-22T05:19:47.428 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd backfillfull_ratio = 0.85 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd full ratio = 0.9 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd nearfull ratio = 0.8 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout: osd failsafe full ratio = 0.95 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout: osd objectstore = bluestore 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr] 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout: debug mgr = 20 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout: mgr/telemetry/nag = false 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.429 INFO:teuthology.orchestra.run.smithi049.stdout:[mon] 2024-01-22T05:19:47.430 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:19:47.430 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-01-22T05:19:47.430 INFO:teuthology.orchestra.run.smithi049.stdout: debug paxos = 20 2024-01-22T05:19:47.430 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-01-22T05:19:47.430 INFO:teuthology.orchestra.run.smithi049.stdout: mon data avail warn = 5 2024-01-22T05:19:47.430 INFO:teuthology.orchestra.run.smithi049.stdout: mon mgr mkfs grace = 240 2024-01-22T05:19:47.430 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:19:47.430 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd reporter subtree level = osd 2024-01-22T05:19:47.430 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd prime pg temp = true 2024-01-22T05:19:47.430 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:19:47.430 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.430 INFO:teuthology.orchestra.run.smithi049.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-22T05:19:47.430 INFO:teuthology.orchestra.run.smithi049.stdout: auth mon ticket ttl = 660 # 11m 2024-01-22T05:19:47.430 INFO:teuthology.orchestra.run.smithi049.stdout: auth service ticket ttl = 240 # 4m 2024-01-22T05:19:47.430 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: # don't complain about insecure global_id in the test suite 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: mon op complaint time = 120 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout:[client] 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: rgw cache enabled = true 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable ops log = true 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable usage log = true 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: client mount timeout = 600 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 20 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = "" 2024-01-22T05:19:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2024-01-22T05:19:47.432 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2024-01-22T05:19:47.432 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.a] 2024-01-22T05:19:47.432 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.b] 2024-01-22T05:19:47.432 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.c] 2024-01-22T05:19:47.432 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2024-01-22T05:19:47.432 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2024-01-22T05:19:47.432 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2024-01-22T05:19:47.432 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2024-01-22T05:19:47.432 INFO:teuthology.orchestra.run.smithi049.stdout:[mds] 2024-01-22T05:19:47.432 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds = 20 2024-01-22T05:19:47.432 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds balancer = 20 2024-01-22T05:19:47.432 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-22T05:19:47.432 INFO:teuthology.orchestra.run.smithi049.stdout: mds cache max size = 1000 2024-01-22T05:19:47.433 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug frag = True 2024-01-22T05:19:47.433 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug scatterstat = False 2024-01-22T05:19:47.433 INFO:teuthology.orchestra.run.smithi049.stdout: mds log max segments = 1 2024-01-22T05:19:47.433 INFO:teuthology.orchestra.run.smithi049.stdout: mds op complaint time = 180 2024-01-22T05:19:47.433 INFO:teuthology.orchestra.run.smithi049.stdout: mds verify scatter = False 2024-01-22T05:19:47.433 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2024-01-22T05:19:47.433 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2024-01-22T05:19:47.433 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2024-01-22T05:19:47.433 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-01-22T05:19:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-01-22T05:19:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-22T05:19:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-01-22T05:19:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-01-22T05:19:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-01-22T05:19:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-01-22T05:19:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-01-22T05:19:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-01-22T05:19:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-01-22T05:19:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-22T05:19:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-01-22T05:19:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-01-22T05:19:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-22T05:19:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-01-22T05:19:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-01-22T05:19:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-01-22T05:19:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-01-22T05:19:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-01-22T05:19:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-01-22T05:19:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-01-22T05:19:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-01-22T05:19:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-22T05:19:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-22T05:19:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-01-22T05:19:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2024-01-22T05:19:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-01-22T05:19:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-01-22T05:19:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-01-22T05:19:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-01-22T05:19:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-01-22T05:19:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.49,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-01-22T05:19:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on skipped message = False 2024-01-22T05:19:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = f4203cdb-f79e-4d7b-b9de-f994381af719 2024-01-22T05:19:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.437 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-01-22T05:19:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-01-22T05:19:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-01-22T05:19:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-01-22T05:19:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-01-22T05:19:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-01-22T05:19:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-01-22T05:19:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-01-22T05:19:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-01-22T05:19:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-01-22T05:19:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-01-22T05:19:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-01-22T05:19:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-01-22T05:19:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-01-22T05:19:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-01-22T05:19:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-01-22T05:19:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-01-22T05:19:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-01-22T05:19:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-01-22T05:19:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-01-22T05:19:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 20 2024-01-22T05:19:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 20 2024-01-22T05:19:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:19:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-01-22T05:19:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 10 2024-01-22T05:19:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-01-22T05:19:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-01-22T05:19:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-01-22T05:19:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-01-22T05:19:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-01-22T05:19:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-01-22T05:19:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.440 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-01-22T05:19:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:19:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-01-22T05:19:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-01-22T05:19:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-01-22T05:19:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:19:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:19:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-01-22T05:19:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.440 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-01-22T05:19:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:19:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-01-22T05:19:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-01-22T05:19:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-01-22T05:19:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-01-22T05:19:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-01-22T05:19:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:19:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-01-22T05:19:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-01-22T05:19:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:19:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-22T05:19:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-01-22T05:19:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-01-22T05:19:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-01-22T05:19:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-22T05:19:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-22T05:19:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2024-01-22T05:19:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-22T05:19:47.442 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-01-22T05:19:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-01-22T05:19:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-01-22T05:19:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-01-22T05:19:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-22T05:19:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-22T05:19:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2024-01-22T05:19:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2024-01-22T05:19:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:19:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = "" 2024-01-22T05:19:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-01-22T05:19:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-01-22T05:19:47.443 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-01-22T05:19:47.443 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-01-22T05:19:47.443 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-01-22T05:19:47.443 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-01-22T05:19:47.443 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-01-22T05:19:47.443 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-01-22T05:19:47.443 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-01-22T05:19:47.443 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2024-01-22T05:19:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2024-01-22T05:19:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds balancer = 20 2024-01-22T05:19:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-22T05:19:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: mds cache max size = 1000 2024-01-22T05:19:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2024-01-22T05:19:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = False 2024-01-22T05:19:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: mds log max segments = 1 2024-01-22T05:19:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2024-01-22T05:19:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = False 2024-01-22T05:19:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-01-22T05:19:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-01-22T05:19:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-01-22T05:19:47.457 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T05:19:47.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:19:47.457 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-22T05:19:47.563 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:19:47.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:19:47.563 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:19:47.582 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:19:47.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.791+0000 7f3556200700 1 Processor -- start 2024-01-22T05:19:47.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.791+0000 7f3556200700 1 -- start start 2024-01-22T05:19:47.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f3556200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3550068ba0 0x7f3550069020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:47.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f3556200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f35501549d0 0x7f3550154e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:47.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f3556200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3550151db0 con 0x7f35500bdf60 2024-01-22T05:19:47.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f3556200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35500a9f10 con 0x7f3550068ba0 2024-01-22T05:19:47.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f3556200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3550154580 con 0x7f35501549d0 2024-01-22T05:19:47.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f354ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3550068ba0 0x7f3550069020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:47.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f354ea00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3550068ba0 0x7f3550069020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33998/0 (socket says 172.21.15.49:33998) 2024-01-22T05:19:47.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f354ea00700 1 -- 172.21.15.49:0/529548015 learned_addr learned my addr 172.21.15.49:0/529548015 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:47.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f354f400700 1 --1- 172.21.15.49:0/529548015 >> v1:172.21.15.49:6789/0 conn(0x7f35500bdf60 0x7f3550150cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53772/0 (socket says 172.21.15.49:53772) 2024-01-22T05:19:47.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f354fe00700 1 --2- 172.21.15.49:0/529548015 >> v2:172.21.15.110:3300/0 conn(0x7f35501549d0 0x7f3550154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:47.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f354ea00700 1 -- 172.21.15.49:0/529548015 >> v2:172.21.15.110:3300/0 conn(0x7f35501549d0 msgr2=0x7f3550154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:47.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f354ea00700 1 --2- 172.21.15.49:0/529548015 >> v2:172.21.15.110:3300/0 conn(0x7f35501549d0 0x7f3550154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:47.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f354ea00700 1 -- 172.21.15.49:0/529548015 >> v1:172.21.15.49:6789/0 conn(0x7f35500bdf60 legacy=0x7f3550150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:47.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f354ea00700 1 -- 172.21.15.49:0/529548015 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3550155300 con 0x7f3550068ba0 2024-01-22T05:19:47.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f354ea00700 1 --2- 172.21.15.49:0/529548015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3550068ba0 0x7f3550069020 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 rx=0x7f35500c75c0 tx=0x7f353800b3b0).ready entity=mon.0 client_cookie=2729b9952c078f8a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:47.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.795+0000 7f354e000700 1 -- 172.21.15.49:0/529548015 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353800da40 con 0x7f3550068ba0 2024-01-22T05:19:47.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.799+0000 7f354e000700 1 -- 172.21.15.49:0/529548015 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353800dba0 con 0x7f3550068ba0 2024-01-22T05:19:47.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.799+0000 7f354e000700 1 -- 172.21.15.49:0/529548015 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538010470 con 0x7f3550068ba0 2024-01-22T05:19:47.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.799+0000 7f3556200700 1 -- 172.21.15.49:0/529548015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3550068ba0 msgr2=0x7f3550069020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:47.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.799+0000 7f3556200700 1 --2- 172.21.15.49:0/529548015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3550068ba0 0x7f3550069020 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 rx=0x7f35500c75c0 tx=0x7f353800b3b0).stop 2024-01-22T05:19:47.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.799+0000 7f3556200700 1 -- 172.21.15.49:0/529548015 shutdown_connections 2024-01-22T05:19:47.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.799+0000 7f3556200700 1 --2- 172.21.15.49:0/529548015 >> v2:172.21.15.110:3300/0 conn(0x7f35501549d0 0x7f3550154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:47.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.799+0000 7f3556200700 1 --2- 172.21.15.49:0/529548015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3550068ba0 0x7f3550069020 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:47.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.799+0000 7f3556200700 1 -- 172.21.15.49:0/529548015 >> 172.21.15.49:0/529548015 conn(0x7f35500c40c0 msgr2=0x7f35500c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:47.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.799+0000 7f3556200700 1 -- 172.21.15.49:0/529548015 shutdown_connections 2024-01-22T05:19:47.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.799+0000 7f3556200700 1 -- 172.21.15.49:0/529548015 wait complete. 2024-01-22T05:19:47.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f3556200700 1 Processor -- start 2024-01-22T05:19:47.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f3556200700 1 -- start start 2024-01-22T05:19:47.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f3556200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3550068ba0 0x7f35500bcf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:47.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f3556200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35500bdf60 0x7f3550163e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:47.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f3556200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35501549d0 0x7f355014b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:47.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f3556200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35500bd800 con 0x7f3550068ba0 2024-01-22T05:19:47.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f3556200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35500ac800 con 0x7f35500bdf60 2024-01-22T05:19:47.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f3556200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3550164380 con 0x7f35501549d0 2024-01-22T05:19:47.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f354f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3550068ba0 0x7f35500bcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:47.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f354f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3550068ba0 0x7f35500bcf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34012/0 (socket says 172.21.15.49:34012) 2024-01-22T05:19:47.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f354f400700 1 -- 172.21.15.49:0/2534367319 learned_addr learned my addr 172.21.15.49:0/2534367319 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:47.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f354ea00700 1 --2- 172.21.15.49:0/2534367319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35500bdf60 0x7f3550163e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:47.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f354fe00700 1 --2- 172.21.15.49:0/2534367319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35501549d0 0x7f355014b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:47.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f354f400700 1 -- 172.21.15.49:0/2534367319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35501549d0 msgr2=0x7f355014b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:47.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f354f400700 1 --2- 172.21.15.49:0/2534367319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35501549d0 0x7f355014b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:47.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f354f400700 1 -- 172.21.15.49:0/2534367319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35500bdf60 msgr2=0x7f3550163e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:47.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f354f400700 1 --2- 172.21.15.49:0/2534367319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35500bdf60 0x7f3550163e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:47.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.803+0000 7f354f400700 1 -- 172.21.15.49:0/2534367319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353800b610 con 0x7f3550068ba0 2024-01-22T05:19:47.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.807+0000 7f354f400700 1 --2- 172.21.15.49:0/2534367319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3550068ba0 0x7f35500bcf40 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 rx=0x7f3540007fd0 tx=0x7f3540007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:47.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.807+0000 7f3546a00700 1 -- 172.21.15.49:0/2534367319 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35400072e0 con 0x7f3550068ba0 2024-01-22T05:19:47.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.807+0000 7f3546a00700 1 -- 172.21.15.49:0/2534367319 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3540007440 con 0x7f3550068ba0 2024-01-22T05:19:47.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.807+0000 7f3546a00700 1 -- 172.21.15.49:0/2534367319 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35400058f0 con 0x7f3550068ba0 2024-01-22T05:19:47.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.807+0000 7f3556200700 1 -- 172.21.15.49:0/2534367319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35500abea0 con 0x7f3550068ba0 2024-01-22T05:19:47.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.807+0000 7f3556200700 1 -- 172.21.15.49:0/2534367319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35500ac140 con 0x7f3550068ba0 2024-01-22T05:19:47.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.807+0000 7f3556200700 1 -- 172.21.15.49:0/2534367319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35500ac940 con 0x7f3550068ba0 2024-01-22T05:19:47.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.811+0000 7f3546a00700 1 -- 172.21.15.49:0/2534367319 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3540005d20 con 0x7f3550068ba0 2024-01-22T05:19:47.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.811+0000 7f3546a00700 1 --2- 172.21.15.49:0/2534367319 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f352805a510 0x7f352805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:47.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.811+0000 7f3546a00700 1 -- 172.21.15.49:0/2534367319 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f3540074200 con 0x7f3550068ba0 2024-01-22T05:19:47.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.811+0000 7f354ea00700 1 --2- 172.21.15.49:0/2534367319 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f352805a510 0x7f352805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:47.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.811+0000 7f354ea00700 1 --2- 172.21.15.49:0/2534367319 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f352805a510 0x7f352805c9d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f353800bfd0 tx=0x7f353800b3b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:47.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:47.815+0000 7f3546a00700 1 -- 172.21.15.49:0/2534367319 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f35500ac940 con 0x7f3550068ba0 2024-01-22T05:19:48.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.011+0000 7f3556200700 1 -- 172.21.15.49:0/2534367319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3550065660 con 0x7f3550068ba0 2024-01-22T05:19:48.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.015+0000 7f3546a00700 1 -- 172.21.15.49:0/2534367319 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) v1 ==== 95+0+4511 (secure 0 0 0) 0x7f3540047760 con 0x7f3550068ba0 2024-01-22T05:19:48.015 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:48.015 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":151,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1805560931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1805560931},{"type":"v1","addr":"172.21.15.110:6833","nonce":1805560931}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3941922826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3941922826},{"type":"v1","addr":"172.21.15.110:6835","nonce":3941922826}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2796452202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2796452202},{"type":"v1","addr":"172.21.15.49:6836","nonce":2796452202}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:39.299248+0000","modified":"2024-01-22T05:19:42.441820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10476":{"gid":10476,"name":"a","rank":0,"incarnation":147,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/1585471135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1585471135},{"type":"v1","addr":"172.21.15.49:6837","nonce":1585471135}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2024-01-22T05:19:48.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.015+0000 7f3556200700 1 -- 172.21.15.49:0/2534367319 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f352805a510 msgr2=0x7f352805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:48.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.015+0000 7f3556200700 1 --2- 172.21.15.49:0/2534367319 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f352805a510 0x7f352805c9d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f353800bfd0 tx=0x7f353800b3b0).stop 2024-01-22T05:19:48.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.015+0000 7f3556200700 1 -- 172.21.15.49:0/2534367319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3550068ba0 msgr2=0x7f35500bcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:48.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.015+0000 7f3556200700 1 --2- 172.21.15.49:0/2534367319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3550068ba0 0x7f35500bcf40 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 rx=0x7f3540007fd0 tx=0x7f3540007df0).stop 2024-01-22T05:19:48.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.015+0000 7f3556200700 1 -- 172.21.15.49:0/2534367319 shutdown_connections 2024-01-22T05:19:48.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.015+0000 7f3556200700 1 --2- 172.21.15.49:0/2534367319 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f352805a510 0x7f352805c9d0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:48.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.015+0000 7f3556200700 1 --2- 172.21.15.49:0/2534367319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35501549d0 0x7f355014b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:48.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.015+0000 7f3556200700 1 --2- 172.21.15.49:0/2534367319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35500bdf60 0x7f3550163e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:48.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.015+0000 7f3556200700 1 --2- 172.21.15.49:0/2534367319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3550068ba0 0x7f35500bcf40 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:48.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.015+0000 7f3556200700 1 -- 172.21.15.49:0/2534367319 >> 172.21.15.49:0/2534367319 conn(0x7f35500c40c0 msgr2=0x7f35500c3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:48.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.019+0000 7f3556200700 1 -- 172.21.15.49:0/2534367319 shutdown_connections 2024-01-22T05:19:48.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.019+0000 7f3556200700 1 -- 172.21.15.49:0/2534367319 wait complete. 2024-01-22T05:19:48.023 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 151 2024-01-22T05:19:48.044 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-01-22T05:19:48.222 INFO:teuthology.orchestra.run.smithi049.stdout:{"message":"","return_code":0} 2024-01-22T05:19:48.222 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-01-22T05:19:48.223 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:19:48.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.391+0000 7f04ff200700 1 Processor -- start 2024-01-22T05:19:48.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.395+0000 7f04ff200700 1 -- start start 2024-01-22T05:19:48.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.395+0000 7f04ff200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f04f80a7ad0 0x7f04f80a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:48.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.395+0000 7f04ff200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f04f8068460 0x7f04f80be6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:48.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04ff200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f80c72c0 con 0x7f04f80688d0 2024-01-22T05:19:48.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04ff200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f80bdee0 con 0x7f04f8068460 2024-01-22T05:19:48.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04ff200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f80c66b0 con 0x7f04f80a7ad0 2024-01-22T05:19:48.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04fdc00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f04f80688d0 0x7f04f80beba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53776/0 (socket says 172.21.15.49:53776) 2024-01-22T05:19:48.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04fdc00700 1 -- 172.21.15.49:0/2364176839 learned_addr learned my addr 172.21.15.49:0/2364176839 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:48.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04f7e00700 1 --2- 172.21.15.49:0/2364176839 >> v2:172.21.15.110:3300/0 conn(0x7f04f80a7ad0 0x7f04f80a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:48.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04f7400700 1 --2- 172.21.15.49:0/2364176839 >> v2:172.21.15.49:3300/0 conn(0x7f04f8068460 0x7f04f80be6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04f6a00700 1 -- 172.21.15.49:0/2364176839 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160131566 0 0) 0x7f04f80c72c0 con 0x7f04f80688d0 2024-01-22T05:19:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04f6a00700 1 -- 172.21.15.49:0/2364176839 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04d80033f0 con 0x7f04f80688d0 2024-01-22T05:19:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04f7e00700 1 -- 172.21.15.49:0/2364176839 >> v2:172.21.15.49:3300/0 conn(0x7f04f8068460 msgr2=0x7f04f80be6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04f7e00700 1 --2- 172.21.15.49:0/2364176839 >> v2:172.21.15.49:3300/0 conn(0x7f04f8068460 0x7f04f80be6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04f7e00700 1 -- 172.21.15.49:0/2364176839 >> v1:172.21.15.49:6789/0 conn(0x7f04f80688d0 legacy=0x7f04f80beba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04f7e00700 1 -- 172.21.15.49:0/2364176839 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f80c6990 con 0x7f04f80a7ad0 2024-01-22T05:19:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04f7400700 1 --2- 172.21.15.49:0/2364176839 >> v2:172.21.15.49:3300/0 conn(0x7f04f8068460 0x7f04f80be6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:48.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04f7e00700 1 --2- 172.21.15.49:0/2364176839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04f80a7ad0 0x7f04f80a5360 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f04f80c9620 tx=0x7f04e8009060).ready entity=mon.1 client_cookie=20111ce586bc6f08 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:48.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04f6a00700 1 -- 172.21.15.49:0/2364176839 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e800d4a0 con 0x7f04f80a7ad0 2024-01-22T05:19:48.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04f6a00700 1 -- 172.21.15.49:0/2364176839 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e800d600 con 0x7f04f80a7ad0 2024-01-22T05:19:48.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.399+0000 7f04f6a00700 1 -- 172.21.15.49:0/2364176839 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e800d980 con 0x7f04f80a7ad0 2024-01-22T05:19:48.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.403+0000 7f04ff200700 1 -- 172.21.15.49:0/2364176839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04f80a7ad0 msgr2=0x7f04f80a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:48.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.403+0000 7f04ff200700 1 --2- 172.21.15.49:0/2364176839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04f80a7ad0 0x7f04f80a5360 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f04f80c9620 tx=0x7f04e8009060).stop 2024-01-22T05:19:48.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.403+0000 7f04ff200700 1 -- 172.21.15.49:0/2364176839 shutdown_connections 2024-01-22T05:19:48.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.403+0000 7f04ff200700 1 --2- 172.21.15.49:0/2364176839 >> v2:172.21.15.49:3300/0 conn(0x7f04f8068460 0x7f04f80be6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:48.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.403+0000 7f04ff200700 1 --2- 172.21.15.49:0/2364176839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04f80a7ad0 0x7f04f80a5360 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:48.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.403+0000 7f04ff200700 1 -- 172.21.15.49:0/2364176839 >> 172.21.15.49:0/2364176839 conn(0x7f04f8062a10 msgr2=0x7f04f8081fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:48.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.403+0000 7f04ff200700 1 -- 172.21.15.49:0/2364176839 shutdown_connections 2024-01-22T05:19:48.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.403+0000 7f04ff200700 1 -- 172.21.15.49:0/2364176839 wait complete. 2024-01-22T05:19:48.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.403+0000 7f04ff200700 1 Processor -- start 2024-01-22T05:19:48.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04ff200700 1 -- start start 2024-01-22T05:19:48.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04ff200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04f8068460 0x7f04f8144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:48.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04ff200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04f80688d0 0x7f04f8145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:48.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04ff200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04f80a7ad0 0x7f04f8145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:48.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04ff200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f81460f0 con 0x7f04f8068460 2024-01-22T05:19:48.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04ff200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f8146be0 con 0x7f04f80688d0 2024-01-22T05:19:48.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04ff200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f81462f0 con 0x7f04f80a7ad0 2024-01-22T05:19:48.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04f7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04f8068460 0x7f04f8144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:48.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04f7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04f8068460 0x7f04f8144740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34030/0 (socket says 172.21.15.49:34030) 2024-01-22T05:19:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04f7e00700 1 -- 172.21.15.49:0/4062640130 learned_addr learned my addr 172.21.15.49:0/4062640130 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04fdc00700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04f80a7ad0 0x7f04f8145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04f7400700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04f80688d0 0x7f04f8145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04f7e00700 1 -- 172.21.15.49:0/4062640130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04f80a7ad0 msgr2=0x7f04f8145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04f7e00700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04f80a7ad0 0x7f04f8145c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04f7e00700 1 -- 172.21.15.49:0/4062640130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04f80688d0 msgr2=0x7f04f8145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:48.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04f7e00700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04f80688d0 0x7f04f8145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:48.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04f7e00700 1 -- 172.21.15.49:0/4062640130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e00092a0 con 0x7f04f8068460 2024-01-22T05:19:48.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04fdc00700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04f80a7ad0 0x7f04f8145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:19:48.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04f7400700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04f80688d0 0x7f04f8145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:19:48.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04f7e00700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04f8068460 0x7f04f8144740 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 rx=0x7f04e8009d20 tx=0x7f04e8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:48.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.407+0000 7f04ef400700 1 -- 172.21.15.49:0/4062640130 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8000c90 con 0x7f04f8068460 2024-01-22T05:19:48.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.411+0000 7f04ef400700 1 -- 172.21.15.49:0/4062640130 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e800d770 con 0x7f04f8068460 2024-01-22T05:19:48.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.411+0000 7f04ff200700 1 -- 172.21.15.49:0/4062640130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e80092a0 con 0x7f04f8068460 2024-01-22T05:19:48.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.411+0000 7f04ef400700 1 -- 172.21.15.49:0/4062640130 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e801d430 con 0x7f04f8068460 2024-01-22T05:19:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.411+0000 7f04ff200700 1 -- 172.21.15.49:0/4062640130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f8146870 con 0x7f04f8068460 2024-01-22T05:19:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.411+0000 7f04ff200700 1 -- 172.21.15.49:0/4062640130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f8152d60 con 0x7f04f8068460 2024-01-22T05:19:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.411+0000 7f04ef400700 1 -- 172.21.15.49:0/4062640130 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f04e80263b0 con 0x7f04f8068460 2024-01-22T05:19:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.415+0000 7f04ef400700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04d005a510 0x7f04d005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.415+0000 7f04ef400700 1 -- 172.21.15.49:0/4062640130 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f04e8075850 con 0x7f04f8068460 2024-01-22T05:19:48.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.415+0000 7f04f7400700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04d005a510 0x7f04d005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:48.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.415+0000 7f04f7400700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04d005a510 0x7f04d005c9d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f04e0009270 tx=0x7f04e0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:48.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.419+0000 7f04ef400700 1 -- 172.21.15.49:0/4062640130 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f04e8048f10 con 0x7f04f8068460 2024-01-22T05:19:48.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:48.623+0000 7f04ff200700 1 -- 172.21.15.49:0/4062640130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f04f8047060 con 0x7f04f8068460 2024-01-22T05:19:49.484 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:19:49.483+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:19:49.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.499+0000 7f04ef400700 1 -- 172.21.15.49:0/4062640130 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v152) v1 ==== 161+0+0 (secure 0 0 0) 0x7f04e8022070 con 0x7f04f8068460 2024-01-22T05:19:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.503+0000 7f04ff200700 1 -- 172.21.15.49:0/4062640130 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04d005a510 msgr2=0x7f04d005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.503+0000 7f04ff200700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04d005a510 0x7f04d005c9d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f04e0009270 tx=0x7f04e0008040).stop 2024-01-22T05:19:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.503+0000 7f04ff200700 1 -- 172.21.15.49:0/4062640130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04f8068460 msgr2=0x7f04f8144740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.503+0000 7f04ff200700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04f8068460 0x7f04f8144740 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 rx=0x7f04e8009d20 tx=0x7f04e8016000).stop 2024-01-22T05:19:49.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.503+0000 7f04ff200700 1 -- 172.21.15.49:0/4062640130 shutdown_connections 2024-01-22T05:19:49.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.503+0000 7f04ff200700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f04d005a510 0x7f04d005c9d0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.503+0000 7f04ff200700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04f80a7ad0 0x7f04f8145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.503+0000 7f04ff200700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04f80688d0 0x7f04f8145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.503+0000 7f04ff200700 1 --2- 172.21.15.49:0/4062640130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04f8068460 0x7f04f8144740 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.503+0000 7f04ff200700 1 -- 172.21.15.49:0/4062640130 >> 172.21.15.49:0/4062640130 conn(0x7f04f8062a10 msgr2=0x7f04f8064a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.503+0000 7f04ff200700 1 -- 172.21.15.49:0/4062640130 shutdown_connections 2024-01-22T05:19:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.503+0000 7f04ff200700 1 -- 172.21.15.49:0/4062640130 wait complete. 2024-01-22T05:19:49.506 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:19:49.512 INFO:tasks.ceph.mds.a.smithi049.stderr: -4118> 2024-01-22T05:19:44.663+0000 7f5f09200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:19:49.529 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapval 10000000000.00000000 parentfile_head - 2024-01-22T05:19:49.562 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:19:49.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdeed8d00 1 Processor -- start 2024-01-22T05:19:49.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdeed8d00 1 -- start start 2024-01-22T05:19:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdeed8d00 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55871445ef70 0x55871445f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdeed8d00 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558714469bf0 0x5587143b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdeed8d00 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55871445dfa0 0x5587143b94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdeed8d00 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x558714337cc0 con 0x55871445ef70 2024-01-22T05:19:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdeed8d00 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x558714302220 con 0x55871445dfa0 2024-01-22T05:19:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdeed8d00 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55871446af00 con 0x558714469bf0 2024-01-22T05:19:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55871445ef70 0x55871445f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdbe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55871445ef70 0x55871445f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34074/0 (socket says 172.21.15.49:34074) 2024-01-22T05:19:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdbe00700 1 -- 172.21.15.49:0/652372607 learned_addr learned my addr 172.21.15.49:0/652372607 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfd3e00700 1 --2- 172.21.15.49:0/652372607 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558714469bf0 0x5587143b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdc800700 1 --2- 172.21.15.49:0/652372607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55871445dfa0 0x5587143b94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdbe00700 1 -- 172.21.15.49:0/652372607 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558714469bf0 msgr2=0x5587143b8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdbe00700 1 --2- 172.21.15.49:0/652372607 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558714469bf0 0x5587143b8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdbe00700 1 -- 172.21.15.49:0/652372607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55871445dfa0 msgr2=0x5587143b94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdbe00700 1 --2- 172.21.15.49:0/652372607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55871445dfa0 0x5587143b94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.591+0000 7fcfdbe00700 1 -- 172.21.15.49:0/652372607 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587142faa70 con 0x55871445ef70 2024-01-22T05:19:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdc800700 1 --2- 172.21.15.49:0/652372607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55871445dfa0 0x5587143b94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdbe00700 1 --2- 172.21.15.49:0/652372607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55871445ef70 0x55871445f350 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 rx=0x7fcfcc0095f0 tx=0x7fcfcc00c040).ready entity=mon.0 client_cookie=fce2a5c1145a475 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdaa00700 1 -- 172.21.15.49:0/652372607 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc00f040 con 0x55871445ef70 2024-01-22T05:19:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdaa00700 1 -- 172.21.15.49:0/652372607 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc0065b0 con 0x55871445ef70 2024-01-22T05:19:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdaa00700 1 -- 172.21.15.49:0/652372607 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc006970 con 0x55871445ef70 2024-01-22T05:19:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdeed8d00 1 -- 172.21.15.49:0/652372607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55871445ef70 msgr2=0x55871445f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdeed8d00 1 --2- 172.21.15.49:0/652372607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55871445ef70 0x55871445f350 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 rx=0x7fcfcc0095f0 tx=0x7fcfcc00c040).stop 2024-01-22T05:19:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdeed8d00 1 -- 172.21.15.49:0/652372607 shutdown_connections 2024-01-22T05:19:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdeed8d00 1 --2- 172.21.15.49:0/652372607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55871445dfa0 0x5587143b94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdeed8d00 1 --2- 172.21.15.49:0/652372607 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558714469bf0 0x5587143b8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdeed8d00 1 --2- 172.21.15.49:0/652372607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55871445ef70 0x55871445f350 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdeed8d00 1 -- 172.21.15.49:0/652372607 >> 172.21.15.49:0/652372607 conn(0x5587143d9b20 msgr2=0x55871446a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdeed8d00 1 -- 172.21.15.49:0/652372607 shutdown_connections 2024-01-22T05:19:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdeed8d00 1 -- 172.21.15.49:0/652372607 wait complete. 2024-01-22T05:19:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdeed8d00 1 Processor -- start 2024-01-22T05:19:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.595+0000 7fcfdeed8d00 1 -- start start 2024-01-22T05:19:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfdeed8d00 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55871445dfa0 0x55871445ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfdeed8d00 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55871445ef70 0x558714464480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfdeed8d00 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558714469bf0 0x558714464970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfdeed8d00 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x558714473ba0 con 0x55871445ef70 2024-01-22T05:19:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfdeed8d00 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x558714465b40 con 0x558714469bf0 2024-01-22T05:19:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfdeed8d00 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587144652a0 con 0x55871445dfa0 2024-01-22T05:19:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfd3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55871445ef70 0x558714464480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfd3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55871445ef70 0x558714464480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34080/0 (socket says 172.21.15.49:34080) 2024-01-22T05:19:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfd3e00700 1 -- 172.21.15.49:0/1222710525 learned_addr learned my addr 172.21.15.49:0/1222710525 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfdbe00700 1 --2- 172.21.15.49:0/1222710525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55871445dfa0 0x55871445ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfdc800700 1 --2- 172.21.15.49:0/1222710525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558714469bf0 0x558714464970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfd3e00700 1 -- 172.21.15.49:0/1222710525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55871445dfa0 msgr2=0x55871445ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfd3e00700 1 --2- 172.21.15.49:0/1222710525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55871445dfa0 0x55871445ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfd3e00700 1 -- 172.21.15.49:0/1222710525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558714469bf0 msgr2=0x558714464970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfd3e00700 1 --2- 172.21.15.49:0/1222710525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558714469bf0 0x558714464970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfd3e00700 1 -- 172.21.15.49:0/1222710525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc005e70 con 0x55871445ef70 2024-01-22T05:19:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfdc800700 1 --2- 172.21.15.49:0/1222710525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558714469bf0 0x558714464970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfd3e00700 1 --2- 172.21.15.49:0/1222710525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55871445ef70 0x558714464480 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 rx=0x7fcfbc00a8f0 tx=0x7fcfc40018f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfd8c00700 1 -- 172.21.15.49:0/1222710525 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc401b600 con 0x55871445ef70 2024-01-22T05:19:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfd8c00700 1 -- 172.21.15.49:0/1222710525 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc401b760 con 0x55871445ef70 2024-01-22T05:19:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfd8c00700 1 -- 172.21.15.49:0/1222710525 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc401bae0 con 0x55871445ef70 2024-01-22T05:19:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfdeed8d00 1 -- 172.21.15.49:0/1222710525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558714306010 con 0x55871445ef70 2024-01-22T05:19:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.599+0000 7fcfdeed8d00 1 -- 172.21.15.49:0/1222710525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558714465860 con 0x55871445ef70 2024-01-22T05:19:49.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.603+0000 7fcfd8c00700 1 -- 172.21.15.49:0/1222710525 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcfc4017070 con 0x55871445ef70 2024-01-22T05:19:49.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.603+0000 7fcfd8c00700 1 --2- 172.21.15.49:0/1222710525 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcfb4058ff0 0x7fcfb405b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.603+0000 7fcfd8c00700 1 -- 172.21.15.49:0/1222710525 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fcfc4074f80 con 0x55871445ef70 2024-01-22T05:19:49.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.603+0000 7fcfdbe00700 1 --2- 172.21.15.49:0/1222710525 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcfb4058ff0 0x7fcfb405b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.603+0000 7fcfdeed8d00 1 --2- 172.21.15.49:0/1222710525 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x5587143b87f0 0x558714463120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.603+0000 7fcfdeed8d00 1 -- 172.21.15.49:0/1222710525 --> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] -- osd_op(unknown.0.0:1 28.30 28:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected e198) v8 -- 0x5587143bb1e0 con 0x5587143b87f0 2024-01-22T05:19:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.603+0000 7fcfdbe00700 1 --2- 172.21.15.49:0/1222710525 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcfb4058ff0 0x7fcfb405b4b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x5587143b87a0 tx=0x7fcfcc016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.603+0000 7fcfdc800700 1 --2- 172.21.15.49:0/1222710525 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x5587143b87f0 0x558714463120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.603+0000 7fcfdc800700 1 --2- 172.21.15.49:0/1222710525 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x5587143b87f0 0x558714463120 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.607+0000 7fcfdc800700 1 -- 172.21.15.49:0/1222710525 <== osd.1 v2:172.21.15.49:6824/22976 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-vals-by-keys out=515b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+515 (crc 0 0 0) 0x7fcfd40048e0 con 0x5587143b87f0 2024-01-22T05:19:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:Writing to - 2024-01-22T05:19:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.607+0000 7fcfdeed8d00 1 -- 172.21.15.49:0/1222710525 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x5587143b87f0 msgr2=0x558714463120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.607+0000 7fcfdeed8d00 1 --2- 172.21.15.49:0/1222710525 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x5587143b87f0 0x558714463120 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.607+0000 7fcfdeed8d00 1 -- 172.21.15.49:0/1222710525 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcfb4058ff0 msgr2=0x7fcfb405b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.607+0000 7fcfdeed8d00 1 --2- 172.21.15.49:0/1222710525 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fcfb4058ff0 0x7fcfb405b4b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x5587143b87a0 tx=0x7fcfcc016000).stop 2024-01-22T05:19:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.607+0000 7fcfdeed8d00 1 -- 172.21.15.49:0/1222710525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55871445ef70 msgr2=0x558714464480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.607+0000 7fcfdeed8d00 1 --2- 172.21.15.49:0/1222710525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55871445ef70 0x558714464480 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 rx=0x7fcfbc00a8f0 tx=0x7fcfc40018f0).stop 2024-01-22T05:19:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.607+0000 7fcfdc800700 1 -- 172.21.15.49:0/1222710525 reap_dead start 2024-01-22T05:19:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.607+0000 7fcfdeed8d00 1 -- 172.21.15.49:0/1222710525 shutdown_connections 2024-01-22T05:19:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.607+0000 7fcfdeed8d00 1 -- 172.21.15.49:0/1222710525 >> 172.21.15.49:0/1222710525 conn(0x5587143d9b20 msgr2=0x55871445c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.607+0000 7fcfdeed8d00 1 -- 172.21.15.49:0/1222710525 shutdown_connections 2024-01-22T05:19:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.607+0000 7fcfdeed8d00 1 -- 172.21.15.49:0/1222710525 wait complete. 2024-01-22T05:19:49.612 INFO:teuthology.orchestra.run.smithi049.stdout:i������e{tl����@@`�����������e{tl���e��g:(8`���e{tl8`���e{tl�����������e��g:������������ 2024-01-22T05:19:49.613 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 shadow_head 2024-01-22T05:19:49.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.707+0000 7fe10b767d00 1 Processor -- start 2024-01-22T05:19:49.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.707+0000 7fe10b767d00 1 -- start start 2024-01-22T05:19:49.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.707+0000 7fe10b767d00 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563184997e00 0x563184a6e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.707+0000 7fe10b767d00 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563184998940 0x56318499ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.707+0000 7fe10b767d00 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563184a72d90 0x56318499bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe10b767d00 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x563184944cc0 con 0x563184998940 2024-01-22T05:19:49.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe10b767d00 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318490f220 con 0x563184a72d90 2024-01-22T05:19:49.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe10b767d00 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x563184a736e0 con 0x563184997e00 2024-01-22T05:19:49.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe0f7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563184998940 0x56318499ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe0f7e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563184998940 0x56318499ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34086/0 (socket says 172.21.15.49:34086) 2024-01-22T05:19:49.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe0f7e00700 1 -- 172.21.15.49:0/3978410968 learned_addr learned my addr 172.21.15.49:0/3978410968 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:49.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe0ffe00700 1 --2- 172.21.15.49:0/3978410968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563184a72d90 0x56318499bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe0ff400700 1 --2- 172.21.15.49:0/3978410968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563184997e00 0x563184a6e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe0f7e00700 1 -- 172.21.15.49:0/3978410968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563184997e00 msgr2=0x563184a6e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:49.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe0f7e00700 1 --2- 172.21.15.49:0/3978410968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563184997e00 0x563184a6e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe0f7e00700 1 -- 172.21.15.49:0/3978410968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563184a72d90 msgr2=0x56318499bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:49.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe0f7e00700 1 --2- 172.21.15.49:0/3978410968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563184a72d90 0x56318499bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe0f7e00700 1 -- 172.21.15.49:0/3978410968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e8005cf0 con 0x563184998940 2024-01-22T05:19:49.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe0ffe00700 1 --2- 172.21.15.49:0/3978410968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563184a72d90 0x56318499bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:49.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe0f7e00700 1 --2- 172.21.15.49:0/3978410968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563184998940 0x56318499ba20 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 rx=0x7fe0e800add0 tx=0x7fe0e8016000).ready entity=mon.0 client_cookie=881d0f43b7384b2c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe0fe000700 1 -- 172.21.15.49:0/3978410968 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8000bc0 con 0x563184998940 2024-01-22T05:19:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe0fe000700 1 -- 172.21.15.49:0/3978410968 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e80089d0 con 0x563184998940 2024-01-22T05:19:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe0fe000700 1 -- 172.21.15.49:0/3978410968 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8000d20 con 0x563184998940 2024-01-22T05:19:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe10b767d00 1 -- 172.21.15.49:0/3978410968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563184998940 msgr2=0x56318499ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe10b767d00 1 --2- 172.21.15.49:0/3978410968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563184998940 0x56318499ba20 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 rx=0x7fe0e800add0 tx=0x7fe0e8016000).stop 2024-01-22T05:19:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe10b767d00 1 -- 172.21.15.49:0/3978410968 shutdown_connections 2024-01-22T05:19:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe10b767d00 1 --2- 172.21.15.49:0/3978410968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563184a72d90 0x56318499bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe10b767d00 1 --2- 172.21.15.49:0/3978410968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563184998940 0x56318499ba20 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe10b767d00 1 --2- 172.21.15.49:0/3978410968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563184997e00 0x563184a6e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe10b767d00 1 -- 172.21.15.49:0/3978410968 >> 172.21.15.49:0/3978410968 conn(0x5631849e6b10 msgr2=0x563184a70610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe10b767d00 1 -- 172.21.15.49:0/3978410968 shutdown_connections 2024-01-22T05:19:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.711+0000 7fe10b767d00 1 -- 172.21.15.49:0/3978410968 wait complete. 2024-01-22T05:19:49.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe10b767d00 1 Processor -- start 2024-01-22T05:19:49.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe10b767d00 1 -- start start 2024-01-22T05:19:49.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe10b767d00 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563184997e00 0x563184a6e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe10b767d00 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563184998940 0x563184a6b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe10b767d00 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563184a72d90 0x563184a6bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe10b767d00 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318499cb20 con 0x563184997e00 2024-01-22T05:19:49.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe10b767d00 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318499ce00 con 0x563184998940 2024-01-22T05:19:49.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe10b767d00 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x56318499d0e0 con 0x563184a72d90 2024-01-22T05:19:49.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe0ff400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563184997e00 0x563184a6e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe0ff400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563184997e00 0x563184a6e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34090/0 (socket says 172.21.15.49:34090) 2024-01-22T05:19:49.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe0ff400700 1 -- 172.21.15.49:0/2122219552 learned_addr learned my addr 172.21.15.49:0/2122219552 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:49.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe0ffe00700 1 --2- 172.21.15.49:0/2122219552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563184a72d90 0x563184a6bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe0f7e00700 1 --2- 172.21.15.49:0/2122219552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563184998940 0x563184a6b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe0ff400700 1 -- 172.21.15.49:0/2122219552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563184a72d90 msgr2=0x563184a6bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe0ff400700 1 --2- 172.21.15.49:0/2122219552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563184a72d90 0x563184a6bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe0ff400700 1 -- 172.21.15.49:0/2122219552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563184998940 msgr2=0x563184a6b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe0ff400700 1 --2- 172.21.15.49:0/2122219552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563184998940 0x563184a6b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe0ff400700 1 -- 172.21.15.49:0/2122219552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563184938a20 con 0x563184997e00 2024-01-22T05:19:49.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe0ff400700 1 --2- 172.21.15.49:0/2122219552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563184997e00 0x563184a6e420 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 rx=0x7fe0f000c6e0 tx=0x7fe0f0001730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:49.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe0f7400700 1 -- 172.21.15.49:0/2122219552 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0001bc0 con 0x563184997e00 2024-01-22T05:19:49.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe0f7400700 1 -- 172.21.15.49:0/2122219552 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f0005070 con 0x563184997e00 2024-01-22T05:19:49.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe0f7400700 1 -- 172.21.15.49:0/2122219552 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000f660 con 0x563184997e00 2024-01-22T05:19:49.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.715+0000 7fe10b767d00 1 -- 172.21.15.49:0/2122219552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563184938770 con 0x563184997e00 2024-01-22T05:19:49.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.719+0000 7fe10b767d00 1 -- 172.21.15.49:0/2122219552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563184907a70 con 0x563184997e00 2024-01-22T05:19:49.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.719+0000 7fe0f7400700 1 -- 172.21.15.49:0/2122219552 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe0f000fa90 con 0x563184997e00 2024-01-22T05:19:49.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.719+0000 7fe0f7400700 1 --2- 172.21.15.49:0/2122219552 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe0d8058ff0 0x7fe0d805b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.719+0000 7fe0f7400700 1 -- 172.21.15.49:0/2122219552 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fe0f0073a20 con 0x563184997e00 2024-01-22T05:19:49.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.723+0000 7fe0f7e00700 1 --2- 172.21.15.49:0/2122219552 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe0d8058ff0 0x7fe0d805b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.723+0000 7fe10b767d00 1 --2- 172.21.15.49:0/2122219552 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x563184a87720 0x563184a87b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.723+0000 7fe10b767d00 1 -- 172.21.15.49:0/2122219552 --> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] -- osd_op(unknown.0.0:1 28.30 28:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected e198) v8 -- 0x5631849e1d90 con 0x563184a87720 2024-01-22T05:19:49.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.723+0000 7fe0ffe00700 1 --2- 172.21.15.49:0/2122219552 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x563184a87720 0x563184a87b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.723+0000 7fe0f7e00700 1 --2- 172.21.15.49:0/2122219552 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe0d8058ff0 0x7fe0d805b4b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7fe0e8021000 tx=0x7fe0e801c000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:49.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.723+0000 7fe0ffe00700 1 --2- 172.21.15.49:0/2122219552 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x563184a87720 0x563184a87b40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:49.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.723+0000 7fe0ffe00700 1 -- 172.21.15.49:0/2122219552 <== osd.1 v2:172.21.15.49:6824/22976 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v198'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe0f80019c0 con 0x563184a87720 2024-01-22T05:19:49.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.723+0000 7fe10b767d00 1 -- 172.21.15.49:0/2122219552 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x563184a87720 msgr2=0x563184a87b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.723+0000 7fe10b767d00 1 --2- 172.21.15.49:0/2122219552 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x563184a87720 0x563184a87b40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.723+0000 7fe10b767d00 1 -- 172.21.15.49:0/2122219552 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe0d8058ff0 msgr2=0x7fe0d805b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.723+0000 7fe10b767d00 1 --2- 172.21.15.49:0/2122219552 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe0d8058ff0 0x7fe0d805b4b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7fe0e8021000 tx=0x7fe0e801c000).stop 2024-01-22T05:19:49.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.727+0000 7fe10b767d00 1 -- 172.21.15.49:0/2122219552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563184997e00 msgr2=0x563184a6e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.727+0000 7fe10b767d00 1 --2- 172.21.15.49:0/2122219552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563184997e00 0x563184a6e420 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 rx=0x7fe0f000c6e0 tx=0x7fe0f0001730).stop 2024-01-22T05:19:49.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.727+0000 7fe0ffe00700 1 -- 172.21.15.49:0/2122219552 reap_dead start 2024-01-22T05:19:49.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.727+0000 7fe10b767d00 1 -- 172.21.15.49:0/2122219552 shutdown_connections 2024-01-22T05:19:49.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.727+0000 7fe10b767d00 1 -- 172.21.15.49:0/2122219552 >> 172.21.15.49:0/2122219552 conn(0x5631849e6b10 msgr2=0x563184996a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:49.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.727+0000 7fe10b767d00 1 -- 172.21.15.49:0/2122219552 shutdown_connections 2024-01-22T05:19:49.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.727+0000 7fe10b767d00 1 -- 172.21.15.49:0/2122219552 wait complete. 2024-01-22T05:19:49.731 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_hack_allow_loading_invalid_metadata True 2024-01-22T05:19:49.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.955+0000 7f2309c00700 1 Processor -- start 2024-01-22T05:19:49.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.955+0000 7f2309c00700 1 -- start start 2024-01-22T05:19:49.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.959+0000 7f2309c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2304062c00 0x7f23040c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.959+0000 7f2309c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23040c3a20 con 0x7f23040bdff0 2024-01-22T05:19:49.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.959+0000 7f2309c00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23041584c0 con 0x7f23040bdb90 2024-01-22T05:19:49.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.959+0000 7f2309c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23040be4a0 con 0x7f2304062c00 2024-01-22T05:19:49.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.959+0000 7f2309200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f23040bdff0 0x7f2304157db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53816/0 (socket says 172.21.15.49:53816) 2024-01-22T05:19:49.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.959+0000 7f2309200700 1 -- 172.21.15.49:0/2472163762 learned_addr learned my addr 172.21.15.49:0/2472163762 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:49.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.959+0000 7f2303e00700 1 --2- 172.21.15.49:0/2472163762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2304062c00 0x7f23040c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.963+0000 7f2302a00700 1 -- 172.21.15.49:0/2472163762 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770221511 0 0) 0x7f23040c3a20 con 0x7f23040bdff0 2024-01-22T05:19:49.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.963+0000 7f2302a00700 1 -- 172.21.15.49:0/2472163762 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e40033f0 con 0x7f23040bdff0 2024-01-22T05:19:49.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.963+0000 7f2302a00700 1 -- 172.21.15.49:0/2472163762 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588847206 0 0) 0x7f23041584c0 con 0x7f23040bdb90 2024-01-22T05:19:49.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.963+0000 7f2302a00700 1 -- 172.21.15.49:0/2472163762 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23040c3a20 con 0x7f23040bdb90 2024-01-22T05:19:49.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.963+0000 7f2303e00700 1 -- 172.21.15.49:0/2472163762 >> v1:172.21.15.110:6789/0 conn(0x7f23040bdb90 legacy=0x7f23041576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.963+0000 7f2303e00700 1 -- 172.21.15.49:0/2472163762 >> v1:172.21.15.49:6789/0 conn(0x7f23040bdff0 legacy=0x7f2304157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.963+0000 7f2302a00700 1 -- 172.21.15.49:0/2472163762 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1662481887 0 0) 0x7f22e40033f0 con 0x7f23040bdff0 2024-01-22T05:19:49.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.963+0000 7f2303e00700 1 -- 172.21.15.49:0/2472163762 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304063390 con 0x7f2304062c00 2024-01-22T05:19:49.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.963+0000 7f2303e00700 1 --2- 172.21.15.49:0/2472163762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2304062c00 0x7f23040c42d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f22f4009790 tx=0x7f22f4009060).ready entity=mon.2 client_cookie=16457cf9ff0a66c3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:49.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.963+0000 7f2302a00700 1 -- 172.21.15.49:0/2472163762 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc0017f0 con 0x7f2304062c00 2024-01-22T05:19:49.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.963+0000 7f2302a00700 1 -- 172.21.15.49:0/2472163762 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f4011400 con 0x7f2304062c00 2024-01-22T05:19:49.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.963+0000 7f2302a00700 1 -- 172.21.15.49:0/2472163762 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f4011780 con 0x7f2304062c00 2024-01-22T05:19:49.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.963+0000 7f2309c00700 1 -- 172.21.15.49:0/2472163762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2304062c00 msgr2=0x7f23040c42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.963+0000 7f2309c00700 1 --2- 172.21.15.49:0/2472163762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2304062c00 0x7f23040c42d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f22f4009790 tx=0x7f22f4009060).stop 2024-01-22T05:19:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.967+0000 7f2309c00700 1 -- 172.21.15.49:0/2472163762 shutdown_connections 2024-01-22T05:19:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.967+0000 7f2309c00700 1 --2- 172.21.15.49:0/2472163762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2304062c00 0x7f23040c42d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.967+0000 7f2309c00700 1 -- 172.21.15.49:0/2472163762 >> 172.21.15.49:0/2472163762 conn(0x7f23040c8770 msgr2=0x7f23040c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:49.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.967+0000 7f2309c00700 1 -- 172.21.15.49:0/2472163762 shutdown_connections 2024-01-22T05:19:49.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.967+0000 7f2309c00700 1 -- 172.21.15.49:0/2472163762 wait complete. 2024-01-22T05:19:49.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.967+0000 7f2309c00700 1 Processor -- start 2024-01-22T05:19:49.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2309c00700 1 -- start start 2024-01-22T05:19:49.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2309c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2304062c00 0x7f230414d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2309c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23040bdb90 0x7f2304165620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2309c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23040bdff0 0x7f2304165b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2309c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23040ab2e0 con 0x7f2304062c00 2024-01-22T05:19:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2309c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23040a8830 con 0x7f23040bdb90 2024-01-22T05:19:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2309c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23040ab000 con 0x7f23040bdff0 2024-01-22T05:19:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2303e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2304062c00 0x7f230414d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2303e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2304062c00 0x7f230414d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34104/0 (socket says 172.21.15.49:34104) 2024-01-22T05:19:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2303e00700 1 -- 172.21.15.49:0/2944765969 learned_addr learned my addr 172.21.15.49:0/2944765969 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2303400700 1 --2- 172.21.15.49:0/2944765969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23040bdb90 0x7f2304165620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2309200700 1 --2- 172.21.15.49:0/2944765969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23040bdff0 0x7f2304165b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2303e00700 1 -- 172.21.15.49:0/2944765969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23040bdff0 msgr2=0x7f2304165b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2303e00700 1 --2- 172.21.15.49:0/2944765969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23040bdff0 0x7f2304165b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2303e00700 1 -- 172.21.15.49:0/2944765969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23040bdb90 msgr2=0x7f2304165620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2303e00700 1 --2- 172.21.15.49:0/2944765969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23040bdb90 0x7f2304165620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2303e00700 1 -- 172.21.15.49:0/2944765969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f40092a0 con 0x7f2304062c00 2024-01-22T05:19:49.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2303e00700 1 --2- 172.21.15.49:0/2944765969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2304062c00 0x7f230414d530 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 rx=0x7f22f4009d80 tx=0x7f22f4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:49.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f22fb400700 1 -- 172.21.15.49:0/2944765969 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f40108a0 con 0x7f2304062c00 2024-01-22T05:19:49.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f22fb400700 1 -- 172.21.15.49:0/2944765969 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f4010a20 con 0x7f2304062c00 2024-01-22T05:19:49.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f2309c00700 1 -- 172.21.15.49:0/2944765969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23040a81e0 con 0x7f2304062c00 2024-01-22T05:19:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.971+0000 7f22fb400700 1 -- 172.21.15.49:0/2944765969 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f4010de0 con 0x7f2304062c00 2024-01-22T05:19:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.975+0000 7f2309c00700 1 -- 172.21.15.49:0/2944765969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23040a8cc0 con 0x7f2304062c00 2024-01-22T05:19:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.975+0000 7f2309c00700 1 -- 172.21.15.49:0/2944765969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23040a8040 con 0x7f2304062c00 2024-01-22T05:19:49.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.975+0000 7f22fb400700 1 -- 172.21.15.49:0/2944765969 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f22f401d640 con 0x7f2304062c00 2024-01-22T05:19:49.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.979+0000 7f22fb400700 1 --2- 172.21.15.49:0/2944765969 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f22dc05a510 0x7f22dc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:49.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.979+0000 7f22fb400700 1 -- 172.21.15.49:0/2944765969 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f22f4075fe0 con 0x7f2304062c00 2024-01-22T05:19:49.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.979+0000 7f2303400700 1 --2- 172.21.15.49:0/2944765969 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f22dc05a510 0x7f22dc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:49.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.979+0000 7f2303400700 1 --2- 172.21.15.49:0/2944765969 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f22dc05a510 0x7f22dc05c9d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f2304064410 tx=0x7f22ec009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:49.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:49.983+0000 7f22fb400700 1 -- 172.21.15.49:0/2944765969 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f23040a8040 con 0x7f2304062c00 2024-01-22T05:19:50.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.151+0000 7f2309c00700 1 -- 172.21.15.49:0/2944765969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mds_hack_allow_loading_invalid_metadata}] v 0) v1 -- 0x7f23040a8040 con 0x7f2304062c00 2024-01-22T05:19:50.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.163+0000 7f22fb400700 1 -- 172.21.15.49:0/2944765969 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_hack_allow_loading_invalid_metadata}]=0 v25)=0 v25) v1 ==== 140+0+0 (secure 0 0 0) 0x7f23040a8040 con 0x7f2304062c00 2024-01-22T05:19:50.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.167+0000 7f2309c00700 1 -- 172.21.15.49:0/2944765969 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f22dc05a510 msgr2=0x7f22dc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:50.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.167+0000 7f2309c00700 1 --2- 172.21.15.49:0/2944765969 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f22dc05a510 0x7f22dc05c9d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f2304064410 tx=0x7f22ec009040).stop 2024-01-22T05:19:50.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.167+0000 7f2309c00700 1 -- 172.21.15.49:0/2944765969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2304062c00 msgr2=0x7f230414d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:50.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.167+0000 7f2309c00700 1 --2- 172.21.15.49:0/2944765969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2304062c00 0x7f230414d530 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 rx=0x7f22f4009d80 tx=0x7f22f4016000).stop 2024-01-22T05:19:50.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.167+0000 7f2309c00700 1 -- 172.21.15.49:0/2944765969 shutdown_connections 2024-01-22T05:19:50.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.167+0000 7f2309c00700 1 --2- 172.21.15.49:0/2944765969 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f22dc05a510 0x7f22dc05c9d0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:50.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.167+0000 7f2309c00700 1 --2- 172.21.15.49:0/2944765969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23040bdff0 0x7f2304165b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:50.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.167+0000 7f2309c00700 1 --2- 172.21.15.49:0/2944765969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23040bdb90 0x7f2304165620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:50.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.167+0000 7f2309c00700 1 --2- 172.21.15.49:0/2944765969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2304062c00 0x7f230414d530 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:50.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.167+0000 7f2309c00700 1 -- 172.21.15.49:0/2944765969 >> 172.21.15.49:0/2944765969 conn(0x7f23040c8770 msgr2=0x7f23040c1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:50.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.167+0000 7f2309c00700 1 -- 172.21.15.49:0/2944765969 shutdown_connections 2024-01-22T05:19:50.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.167+0000 7f2309c00700 1 -- 172.21.15.49:0/2944765969 wait complete. 2024-01-22T05:19:50.188 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-01-22T05:19:50.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.355+0000 7fd854e00700 1 Processor -- start 2024-01-22T05:19:50.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.355+0000 7fd854e00700 1 -- start start 2024-01-22T05:19:50.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd854e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd850150d00 0x7fd850063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:50.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd854e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd8500642e0 0x7fd8500bca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:50.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd854e00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8500bc5b0 con 0x7fd8500c3c80 2024-01-22T05:19:50.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd854e00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd850151160 con 0x7fd8500642e0 2024-01-22T05:19:50.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd854e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8500be4d0 con 0x7fd850150d00 2024-01-22T05:19:50.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd84e800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd8500642e0 0x7fd8500bca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:50.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd84e800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd8500642e0 0x7fd8500bca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:58712/0 (socket says 172.21.15.49:58712) 2024-01-22T05:19:50.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd84d400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd850150d00 0x7fd850063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:50.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd84e800700 1 -- 172.21.15.49:0/3378437681 learned_addr learned my addr 172.21.15.49:0/3378437681 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:50.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd84d400700 1 -- 172.21.15.49:0/3378437681 >> v2:172.21.15.110:3300/0 conn(0x7fd8500642e0 msgr2=0x7fd8500bca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:50.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd84d400700 1 --2- 172.21.15.49:0/3378437681 >> v2:172.21.15.110:3300/0 conn(0x7fd8500642e0 0x7fd8500bca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:50.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd84d400700 1 -- 172.21.15.49:0/3378437681 >> v1:172.21.15.110:6789/0 conn(0x7fd8500c3c80 legacy=0x7fd8500bddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:50.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd84d400700 1 -- 172.21.15.49:0/3378437681 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd850064770 con 0x7fd850150d00 2024-01-22T05:19:50.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd84d400700 1 --2- 172.21.15.49:0/3378437681 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd850150d00 0x7fd850063df0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fd838009760 tx=0x7fd838009060).ready entity=mon.2 client_cookie=910be7f50525cc25 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:50.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd84ca00700 1 -- 172.21.15.49:0/3378437681 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8380090d0 con 0x7fd850150d00 2024-01-22T05:19:50.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd84ca00700 1 -- 172.21.15.49:0/3378437681 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83800f510 con 0x7fd850150d00 2024-01-22T05:19:50.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.359+0000 7fd84ca00700 1 -- 172.21.15.49:0/3378437681 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83800f890 con 0x7fd850150d00 2024-01-22T05:19:50.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.363+0000 7fd854e00700 1 -- 172.21.15.49:0/3378437681 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd850150d00 msgr2=0x7fd850063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:50.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.363+0000 7fd854e00700 1 --2- 172.21.15.49:0/3378437681 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd850150d00 0x7fd850063df0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fd838009760 tx=0x7fd838009060).stop 2024-01-22T05:19:50.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.363+0000 7fd854e00700 1 -- 172.21.15.49:0/3378437681 shutdown_connections 2024-01-22T05:19:50.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.363+0000 7fd854e00700 1 --2- 172.21.15.49:0/3378437681 >> v2:172.21.15.110:3300/0 conn(0x7fd8500642e0 0x7fd8500bca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:50.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.363+0000 7fd854e00700 1 --2- 172.21.15.49:0/3378437681 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd850150d00 0x7fd850063df0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:50.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.363+0000 7fd854e00700 1 -- 172.21.15.49:0/3378437681 >> 172.21.15.49:0/3378437681 conn(0x7fd8500c40f0 msgr2=0x7fd8500c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:50.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.363+0000 7fd854e00700 1 -- 172.21.15.49:0/3378437681 shutdown_connections 2024-01-22T05:19:50.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.363+0000 7fd854e00700 1 -- 172.21.15.49:0/3378437681 wait complete. 2024-01-22T05:19:50.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.367+0000 7fd854e00700 1 Processor -- start 2024-01-22T05:19:50.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.367+0000 7fd854e00700 1 -- start start 2024-01-22T05:19:50.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd854e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8500642e0 0x7fd8500a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:50.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd854e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8500c3c80 0x7fd85014e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:50.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd854e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd850150d00 0x7fd8500bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:50.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd854e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8500bf930 con 0x7fd850150d00 2024-01-22T05:19:50.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd854e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8500c05b0 con 0x7fd8500c3c80 2024-01-22T05:19:50.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd854e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8500bfc80 con 0x7fd8500642e0 2024-01-22T05:19:50.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd84e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd850150d00 0x7fd8500bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:50.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd84de00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8500642e0 0x7fd8500a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:50.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd84d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8500c3c80 0x7fd85014e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:50.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd84de00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8500642e0 0x7fd8500a4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:58608/0 (socket says 172.21.15.49:58608) 2024-01-22T05:19:50.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd84de00700 1 -- 172.21.15.49:0/3055876336 learned_addr learned my addr 172.21.15.49:0/3055876336 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:50.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd84de00700 1 -- 172.21.15.49:0/3055876336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8500c3c80 msgr2=0x7fd85014e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:50.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd84de00700 1 --2- 172.21.15.49:0/3055876336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8500c3c80 0x7fd85014e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:50.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd84de00700 1 -- 172.21.15.49:0/3055876336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd850150d00 msgr2=0x7fd8500bf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:50.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd84de00700 1 --2- 172.21.15.49:0/3055876336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd850150d00 0x7fd8500bf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:50.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd84de00700 1 -- 172.21.15.49:0/3055876336 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8380092a0 con 0x7fd8500642e0 2024-01-22T05:19:50.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd84de00700 1 --2- 172.21.15.49:0/3055876336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8500642e0 0x7fd8500a4390 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fd84000c470 tx=0x7fd840007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:50.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd845600700 1 -- 172.21.15.49:0/3055876336 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840012400 con 0x7fd8500642e0 2024-01-22T05:19:50.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd845600700 1 -- 172.21.15.49:0/3055876336 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd840012560 con 0x7fd8500642e0 2024-01-22T05:19:50.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd854e00700 1 -- 172.21.15.49:0/3055876336 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8500bff60 con 0x7fd8500642e0 2024-01-22T05:19:50.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd845600700 1 -- 172.21.15.49:0/3055876336 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840012900 con 0x7fd8500642e0 2024-01-22T05:19:50.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.371+0000 7fd854e00700 1 -- 172.21.15.49:0/3055876336 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85014e7a0 con 0x7fd8500642e0 2024-01-22T05:19:50.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.375+0000 7fd854e00700 1 -- 172.21.15.49:0/3055876336 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8500656b0 con 0x7fd8500642e0 2024-01-22T05:19:50.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.375+0000 7fd845600700 1 -- 172.21.15.49:0/3055876336 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd84001b3b0 con 0x7fd8500642e0 2024-01-22T05:19:50.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.379+0000 7fd845600700 1 --2- 172.21.15.49:0/3055876336 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd82805a510 0x7fd82805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:50.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.379+0000 7fd845600700 1 -- 172.21.15.49:0/3055876336 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fd840073ed0 con 0x7fd8500642e0 2024-01-22T05:19:50.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.379+0000 7fd84d400700 1 --2- 172.21.15.49:0/3055876336 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd82805a510 0x7fd82805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:50.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.379+0000 7fd84d400700 1 --2- 172.21.15.49:0/3055876336 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd82805a510 0x7fd82805c9d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fd85014efc0 tx=0x7fd838017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:50.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.387+0000 7fd845600700 1 -- 172.21.15.49:0/3055876336 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd8400474b0 con 0x7fd8500642e0 2024-01-22T05:19:50.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:50.587+0000 7fd854e00700 1 -- 172.21.15.49:0/3055876336 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fd850151340 con 0x7fd8500642e0 2024-01-22T05:19:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.447+0000 7fd845600700 1 -- 172.21.15.49:0/3055876336 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v154) v1 ==== 162+0+0 (secure 0 0 0) 0x7fd840017030 con 0x7fd8500642e0 2024-01-22T05:19:51.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.455+0000 7fd854e00700 1 -- 172.21.15.49:0/3055876336 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd82805a510 msgr2=0x7fd82805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:51.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.455+0000 7fd854e00700 1 --2- 172.21.15.49:0/3055876336 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd82805a510 0x7fd82805c9d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fd85014efc0 tx=0x7fd838017000).stop 2024-01-22T05:19:51.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.455+0000 7fd854e00700 1 -- 172.21.15.49:0/3055876336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8500642e0 msgr2=0x7fd8500a4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:51.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.455+0000 7fd854e00700 1 --2- 172.21.15.49:0/3055876336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8500642e0 0x7fd8500a4390 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fd84000c470 tx=0x7fd840007dc0).stop 2024-01-22T05:19:51.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.455+0000 7fd854e00700 1 -- 172.21.15.49:0/3055876336 shutdown_connections 2024-01-22T05:19:51.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.455+0000 7fd854e00700 1 --2- 172.21.15.49:0/3055876336 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd82805a510 0x7fd82805c9d0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:51.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.455+0000 7fd854e00700 1 --2- 172.21.15.49:0/3055876336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd850150d00 0x7fd8500bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:51.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.455+0000 7fd854e00700 1 --2- 172.21.15.49:0/3055876336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8500c3c80 0x7fd85014e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:51.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.455+0000 7fd854e00700 1 --2- 172.21.15.49:0/3055876336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8500642e0 0x7fd8500a4390 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.455+0000 7fd854e00700 1 -- 172.21.15.49:0/3055876336 >> 172.21.15.49:0/3055876336 conn(0x7fd8500c40f0 msgr2=0x7fd8500c53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.455+0000 7fd854e00700 1 -- 172.21.15.49:0/3055876336 shutdown_connections 2024-01-22T05:19:51.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.455+0000 7fd854e00700 1 -- 172.21.15.49:0/3055876336 wait complete. 2024-01-22T05:19:51.459 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked joinable; MDS may join as newly active. 2024-01-22T05:19:51.480 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:19:51.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.643+0000 7fe7bc200700 1 Processor -- start 2024-01-22T05:19:51.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.643+0000 7fe7bc200700 1 -- start start 2024-01-22T05:19:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.647+0000 7fe7bc200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7b4065240 0x7fe7b40644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.647+0000 7fe7bc200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b4065620 0x7fe7b40649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.647+0000 7fe7bc200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe7b415b9b0 0x7fe7b415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.647+0000 7fe7bc200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b4064ed0 con 0x7fe7b4065240 2024-01-22T05:19:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.647+0000 7fe7bc200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b40c2700 con 0x7fe7b415b9b0 2024-01-22T05:19:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.647+0000 7fe7bc200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40c29a0 con 0x7fe7b4065620 2024-01-22T05:19:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.647+0000 7fe7b9800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7b4065240 0x7fe7b40644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.647+0000 7fe7b9800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe7b4065240 0x7fe7b40644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34134/0 (socket says 172.21.15.49:34134) 2024-01-22T05:19:51.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.647+0000 7fe7b9800700 1 -- 172.21.15.49:0/2163307685 learned_addr learned my addr 172.21.15.49:0/2163307685 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:51.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.647+0000 7fe7b8e00700 1 --2- 172.21.15.49:0/2163307685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b4065620 0x7fe7b40649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:51.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.647+0000 7fe7bac00700 1 --2- 172.21.15.49:0/2163307685 >> v2:172.21.15.110:3300/0 conn(0x7fe7b415b9b0 0x7fe7b415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.647+0000 7fe7b8e00700 1 -- 172.21.15.49:0/2163307685 >> v2:172.21.15.110:3300/0 conn(0x7fe7b415b9b0 msgr2=0x7fe7b415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7b8e00700 1 --2- 172.21.15.49:0/2163307685 >> v2:172.21.15.110:3300/0 conn(0x7fe7b415b9b0 0x7fe7b415be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7b8e00700 1 -- 172.21.15.49:0/2163307685 >> v2:172.21.15.49:3300/0 conn(0x7fe7b4065240 msgr2=0x7fe7b40644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7b8e00700 1 --2- 172.21.15.49:0/2163307685 >> v2:172.21.15.49:3300/0 conn(0x7fe7b4065240 0x7fe7b40644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7b8e00700 1 -- 172.21.15.49:0/2163307685 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b40c2c80 con 0x7fe7b4065620 2024-01-22T05:19:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7bac00700 1 --2- 172.21.15.49:0/2163307685 >> v2:172.21.15.110:3300/0 conn(0x7fe7b415b9b0 0x7fe7b415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7b9800700 1 --2- 172.21.15.49:0/2163307685 >> v2:172.21.15.49:3300/0 conn(0x7fe7b4065240 0x7fe7b40644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7b8e00700 1 --2- 172.21.15.49:0/2163307685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b4065620 0x7fe7b40649e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fe7b40665c0 tx=0x7fe79c009060).ready entity=mon.2 client_cookie=ebf437b2ad1c3543 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7b3e00700 1 -- 172.21.15.49:0/2163307685 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00f510 con 0x7fe7b4065620 2024-01-22T05:19:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7b3e00700 1 -- 172.21.15.49:0/2163307685 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c00f670 con 0x7fe7b4065620 2024-01-22T05:19:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7b3e00700 1 -- 172.21.15.49:0/2163307685 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00f9f0 con 0x7fe7b4065620 2024-01-22T05:19:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7bc200700 1 -- 172.21.15.49:0/2163307685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b4065620 msgr2=0x7fe7b40649e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7bc200700 1 --2- 172.21.15.49:0/2163307685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b4065620 0x7fe7b40649e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fe7b40665c0 tx=0x7fe79c009060).stop 2024-01-22T05:19:51.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7bc200700 1 -- 172.21.15.49:0/2163307685 shutdown_connections 2024-01-22T05:19:51.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7bc200700 1 --2- 172.21.15.49:0/2163307685 >> v2:172.21.15.110:3300/0 conn(0x7fe7b415b9b0 0x7fe7b415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:51.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7bc200700 1 --2- 172.21.15.49:0/2163307685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b4065620 0x7fe7b40649e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:51.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7bc200700 1 --2- 172.21.15.49:0/2163307685 >> v2:172.21.15.49:3300/0 conn(0x7fe7b4065240 0x7fe7b40644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:51.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7bc200700 1 -- 172.21.15.49:0/2163307685 >> 172.21.15.49:0/2163307685 conn(0x7fe7b40c87f0 msgr2=0x7fe7b40c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:51.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7bc200700 1 -- 172.21.15.49:0/2163307685 shutdown_connections 2024-01-22T05:19:51.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.651+0000 7fe7bc200700 1 -- 172.21.15.49:0/2163307685 wait complete. 2024-01-22T05:19:51.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.655+0000 7fe7bc200700 1 Processor -- start 2024-01-22T05:19:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.655+0000 7fe7bc200700 1 -- start start 2024-01-22T05:19:51.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bc200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b4065240 0x7fe7b40aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:51.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bc200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7b4065620 0x7fe7b40a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:51.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bc200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b415b9b0 0x7fe7b4154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:51.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bc200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40c0cf0 con 0x7fe7b415b9b0 2024-01-22T05:19:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bc200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40a9370 con 0x7fe7b4065620 2024-01-22T05:19:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bc200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40c09c0 con 0x7fe7b4065240 2024-01-22T05:19:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bac00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b415b9b0 0x7fe7b4154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bac00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b415b9b0 0x7fe7b4154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34150/0 (socket says 172.21.15.49:34150) 2024-01-22T05:19:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bac00700 1 -- 172.21.15.49:0/2843756442 learned_addr learned my addr 172.21.15.49:0/2843756442 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7b9800700 1 --2- 172.21.15.49:0/2843756442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b4065240 0x7fe7b40aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7b8e00700 1 --2- 172.21.15.49:0/2843756442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7b4065620 0x7fe7b40a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bac00700 1 -- 172.21.15.49:0/2843756442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b4065240 msgr2=0x7fe7b40aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bac00700 1 --2- 172.21.15.49:0/2843756442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b4065240 0x7fe7b40aa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bac00700 1 -- 172.21.15.49:0/2843756442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7b4065620 msgr2=0x7fe7b40a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bac00700 1 --2- 172.21.15.49:0/2843756442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7b4065620 0x7fe7b40a8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bac00700 1 -- 172.21.15.49:0/2843756442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a4009370 con 0x7fe7b415b9b0 2024-01-22T05:19:51.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bac00700 1 --2- 172.21.15.49:0/2843756442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b415b9b0 0x7fe7b4154fd0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7fe7ac009fc0 tx=0x7fe7ac0099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:51.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7b0c00700 1 -- 172.21.15.49:0/2843756442 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00dbe0 con 0x7fe7b415b9b0 2024-01-22T05:19:51.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7b0c00700 1 -- 172.21.15.49:0/2843756442 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac00f040 con 0x7fe7b415b9b0 2024-01-22T05:19:51.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7b0c00700 1 -- 172.21.15.49:0/2843756442 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0133f0 con 0x7fe7b415b9b0 2024-01-22T05:19:51.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.659+0000 7fe7bc200700 1 -- 172.21.15.49:0/2843756442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c0092a0 con 0x7fe7b415b9b0 2024-01-22T05:19:51.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.663+0000 7fe7bc200700 1 -- 172.21.15.49:0/2843756442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b40bef60 con 0x7fe7b415b9b0 2024-01-22T05:19:51.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.663+0000 7fe7bc200700 1 -- 172.21.15.49:0/2843756442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b4047060 con 0x7fe7b415b9b0 2024-01-22T05:19:51.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.663+0000 7fe7b0c00700 1 -- 172.21.15.49:0/2843756442 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe7ac0137e0 con 0x7fe7b415b9b0 2024-01-22T05:19:51.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.667+0000 7fe7b0c00700 1 --2- 172.21.15.49:0/2843756442 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe78c05a510 0x7fe78c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:51.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.667+0000 7fe7b0c00700 1 -- 172.21.15.49:0/2843756442 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7fe7ac074f70 con 0x7fe7b415b9b0 2024-01-22T05:19:51.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.667+0000 7fe7b9800700 1 --2- 172.21.15.49:0/2843756442 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe78c05a510 0x7fe78c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:51.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.667+0000 7fe7b9800700 1 --2- 172.21.15.49:0/2843756442 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe78c05a510 0x7fe78c05c9d0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7fe7b4156520 tx=0x7fe7a40090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:51.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.675+0000 7fe7b0c00700 1 -- 172.21.15.49:0/2843756442 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe7ac0a3b00 con 0x7fe7b415b9b0 2024-01-22T05:19:51.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.875+0000 7fe7bc200700 1 -- 172.21.15.49:0/2843756442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7b40c2f60 con 0x7fe7b415b9b0 2024-01-22T05:19:51.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.875+0000 7fe7b0c00700 1 -- 172.21.15.49:0/2843756442 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 154 v154) v1 ==== 95+0+4513 (secure 0 0 0) 0x7fe7ac0485a0 con 0x7fe7b415b9b0 2024-01-22T05:19:51.877 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:51.877 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":154,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1805560931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1805560931},{"type":"v1","addr":"172.21.15.110:6833","nonce":1805560931}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3941922826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3941922826},{"type":"v1","addr":"172.21.15.110:6835","nonce":3941922826}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2796452202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2796452202},{"type":"v1","addr":"172.21.15.49:6836","nonce":2796452202}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":154,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:39.299248+0000","modified":"2024-01-22T05:19:51.442357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":198,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10656":{"gid":10656,"name":"a","rank":0,"incarnation":154,"state":"up:replay","state_seq":1,"addr":"172.21.15.49:6837/1689534801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1689534801},{"type":"v1","addr":"172.21.15.49:6837","nonce":1689534801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2024-01-22T05:19:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.879+0000 7fe7bc200700 1 -- 172.21.15.49:0/2843756442 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe78c05a510 msgr2=0x7fe78c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.879+0000 7fe7bc200700 1 --2- 172.21.15.49:0/2843756442 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe78c05a510 0x7fe78c05c9d0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7fe7b4156520 tx=0x7fe7a40090f0).stop 2024-01-22T05:19:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.879+0000 7fe7bc200700 1 -- 172.21.15.49:0/2843756442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b415b9b0 msgr2=0x7fe7b4154fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.879+0000 7fe7bc200700 1 --2- 172.21.15.49:0/2843756442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b415b9b0 0x7fe7b4154fd0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7fe7ac009fc0 tx=0x7fe7ac0099b0).stop 2024-01-22T05:19:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.879+0000 7fe7bc200700 1 -- 172.21.15.49:0/2843756442 shutdown_connections 2024-01-22T05:19:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.879+0000 7fe7bc200700 1 --2- 172.21.15.49:0/2843756442 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe78c05a510 0x7fe78c05c9d0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.879+0000 7fe7bc200700 1 --2- 172.21.15.49:0/2843756442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b415b9b0 0x7fe7b4154fd0 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.879+0000 7fe7bc200700 1 --2- 172.21.15.49:0/2843756442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7b4065620 0x7fe7b40a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.879+0000 7fe7bc200700 1 --2- 172.21.15.49:0/2843756442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b4065240 0x7fe7b40aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:51.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.879+0000 7fe7bc200700 1 -- 172.21.15.49:0/2843756442 >> 172.21.15.49:0/2843756442 conn(0x7fe7b40c87f0 msgr2=0x7fe7b4063370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.879+0000 7fe7bc200700 1 -- 172.21.15.49:0/2843756442 shutdown_connections 2024-01-22T05:19:51.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:51.879+0000 7fe7bc200700 1 -- 172.21.15.49:0/2843756442 wait complete. 2024-01-22T05:19:51.883 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 154 2024-01-22T05:19:52.307 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 154, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:19:39.299248+0000', 'modified': '2024-01-22T05:19:51.442357+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 198, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10656}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10656': {'gid': 10656, 'name': 'a', 'rank': 0, 'incarnation': 154, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.49:6837/1689534801', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6835', 'nonce': 1689534801}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 1689534801}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:19:52.307 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10656:up:replay 2024-01-22T05:19:53.308 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:19:53.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.479+0000 7f9053200700 1 Processor -- start 2024-01-22T05:19:53.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.479+0000 7f9053200700 1 -- start start 2024-01-22T05:19:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.483+0000 7f9053200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f904c0ab890 0x7f904c0abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.483+0000 7f9053200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c068a60 con 0x7f904c065550 2024-01-22T05:19:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.483+0000 7f9053200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c0bd380 con 0x7f904c0bcfa0 2024-01-22T05:19:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.483+0000 7f9053200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0bb790 con 0x7f904c0ab890 2024-01-22T05:19:53.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.483+0000 7f9051200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f904c065550 0x7f904c0659c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58786/0 (socket says 172.21.15.49:58786) 2024-01-22T05:19:53.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.483+0000 7f9051200700 1 -- 172.21.15.49:0/469086723 learned_addr learned my addr 172.21.15.49:0/469086723 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:53.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.483+0000 7f904b400700 1 --2- 172.21.15.49:0/469086723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f904c0ab890 0x7f904c0abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:53.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.483+0000 7f904aa00700 1 -- 172.21.15.49:0/469086723 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020634793 0 0) 0x7f904c0bd380 con 0x7f904c0bcfa0 2024-01-22T05:19:53.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.483+0000 7f904aa00700 1 -- 172.21.15.49:0/469086723 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f902c0033f0 con 0x7f904c0bcfa0 2024-01-22T05:19:53.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.483+0000 7f904aa00700 1 -- 172.21.15.49:0/469086723 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523148605 0 0) 0x7f904c068a60 con 0x7f904c065550 2024-01-22T05:19:53.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.483+0000 7f904aa00700 1 -- 172.21.15.49:0/469086723 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f904c0bd380 con 0x7f904c065550 2024-01-22T05:19:53.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.483+0000 7f904b400700 1 -- 172.21.15.49:0/469086723 >> v1:172.21.15.110:6789/0 conn(0x7f904c0bcfa0 legacy=0x7f904c151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:53.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.483+0000 7f904b400700 1 -- 172.21.15.49:0/469086723 >> v1:172.21.15.49:6789/0 conn(0x7f904c065550 legacy=0x7f904c0659c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:53.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.483+0000 7f904b400700 1 -- 172.21.15.49:0/469086723 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c068460 con 0x7f904c0ab890 2024-01-22T05:19:53.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.487+0000 7f904b400700 1 --2- 172.21.15.49:0/469086723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f904c0ab890 0x7f904c0abcf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f904c0bb8d0 tx=0x7f9034009060).ready entity=mon.2 client_cookie=b52d48740b2d1490 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:53.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.487+0000 7f904aa00700 1 -- 172.21.15.49:0/469086723 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903400d4a0 con 0x7f904c0ab890 2024-01-22T05:19:53.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.487+0000 7f904aa00700 1 -- 172.21.15.49:0/469086723 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903400d600 con 0x7f904c0ab890 2024-01-22T05:19:53.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.487+0000 7f904aa00700 1 -- 172.21.15.49:0/469086723 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903400d980 con 0x7f904c0ab890 2024-01-22T05:19:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.487+0000 7f9053200700 1 -- 172.21.15.49:0/469086723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f904c0ab890 msgr2=0x7f904c0abcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:53.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.487+0000 7f9053200700 1 --2- 172.21.15.49:0/469086723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f904c0ab890 0x7f904c0abcf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f904c0bb8d0 tx=0x7f9034009060).stop 2024-01-22T05:19:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.487+0000 7f9053200700 1 -- 172.21.15.49:0/469086723 shutdown_connections 2024-01-22T05:19:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.487+0000 7f9053200700 1 --2- 172.21.15.49:0/469086723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f904c0ab890 0x7f904c0abcf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.487+0000 7f9053200700 1 -- 172.21.15.49:0/469086723 >> 172.21.15.49:0/469086723 conn(0x7f904c0c6540 msgr2=0x7f904c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:53.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.487+0000 7f9053200700 1 -- 172.21.15.49:0/469086723 shutdown_connections 2024-01-22T05:19:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.487+0000 7f9053200700 1 -- 172.21.15.49:0/469086723 wait complete. 2024-01-22T05:19:53.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.491+0000 7f9053200700 1 Processor -- start 2024-01-22T05:19:53.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.491+0000 7f9053200700 1 -- start start 2024-01-22T05:19:53.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f9053200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f904c065550 0x7f904c16ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:53.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f9053200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f904c0ab890 0x7f904c154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:53.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f9053200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f904c0bcfa0 0x7f904c14e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:53.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f9053200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0a8150 con 0x7f904c065550 2024-01-22T05:19:53.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f9053200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c154fe0 con 0x7f904c0ab890 2024-01-22T05:19:53.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f9053200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c1544e0 con 0x7f904c0bcfa0 2024-01-22T05:19:53.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f904be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f904c065550 0x7f904c16ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:53.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f904be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f904c065550 0x7f904c16ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47966/0 (socket says 172.21.15.49:47966) 2024-01-22T05:19:53.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f904be00700 1 -- 172.21.15.49:0/2535297836 learned_addr learned my addr 172.21.15.49:0/2535297836 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:53.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f904b400700 1 --2- 172.21.15.49:0/2535297836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f904c0ab890 0x7f904c154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:53.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f9051200700 1 --2- 172.21.15.49:0/2535297836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f904c0bcfa0 0x7f904c14e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:53.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f904be00700 1 -- 172.21.15.49:0/2535297836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f904c0bcfa0 msgr2=0x7f904c14e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:53.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f904be00700 1 --2- 172.21.15.49:0/2535297836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f904c0bcfa0 0x7f904c14e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:53.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f904be00700 1 -- 172.21.15.49:0/2535297836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f904c0ab890 msgr2=0x7f904c154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:53.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f904be00700 1 --2- 172.21.15.49:0/2535297836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f904c0ab890 0x7f904c154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:53.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f904be00700 1 -- 172.21.15.49:0/2535297836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90340092a0 con 0x7f904c065550 2024-01-22T05:19:53.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.495+0000 7f9051200700 1 --2- 172.21.15.49:0/2535297836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f904c0bcfa0 0x7f904c14e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:53.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.499+0000 7f904be00700 1 --2- 172.21.15.49:0/2535297836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f904c065550 0x7f904c16ce60 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 rx=0x7f903c00c440 tx=0x7f903c007cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.499+0000 7f9043400700 1 -- 172.21.15.49:0/2535297836 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c00ce60 con 0x7f904c065550 2024-01-22T05:19:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.499+0000 7f9043400700 1 -- 172.21.15.49:0/2535297836 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c00f470 con 0x7f904c065550 2024-01-22T05:19:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.499+0000 7f9053200700 1 -- 172.21.15.49:0/2535297836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904c153f20 con 0x7f904c065550 2024-01-22T05:19:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.499+0000 7f9043400700 1 -- 172.21.15.49:0/2535297836 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c00f810 con 0x7f904c065550 2024-01-22T05:19:53.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.499+0000 7f9053200700 1 -- 172.21.15.49:0/2535297836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904c0a7de0 con 0x7f904c065550 2024-01-22T05:19:53.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.499+0000 7f9053200700 1 -- 172.21.15.49:0/2535297836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904c0c3e50 con 0x7f904c065550 2024-01-22T05:19:53.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.503+0000 7f9043400700 1 -- 172.21.15.49:0/2535297836 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f903c00fc00 con 0x7f904c065550 2024-01-22T05:19:53.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.503+0000 7f9043400700 1 --2- 172.21.15.49:0/2535297836 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f902405a510 0x7f902405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:53.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.503+0000 7f9043400700 1 -- 172.21.15.49:0/2535297836 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f903c073f30 con 0x7f904c065550 2024-01-22T05:19:53.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.503+0000 7f904b400700 1 --2- 172.21.15.49:0/2535297836 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f902405a510 0x7f902405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:53.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.503+0000 7f904b400700 1 --2- 172.21.15.49:0/2535297836 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f902405a510 0x7f902405c9d0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f904c0c0550 tx=0x7f9034016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:53.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.511+0000 7f9043400700 1 -- 172.21.15.49:0/2535297836 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f903c047560 con 0x7f904c065550 2024-01-22T05:19:53.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.723+0000 7f9053200700 1 -- 172.21.15.49:0/2535297836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f904c047060 con 0x7f904c065550 2024-01-22T05:19:53.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.723+0000 7f9043400700 1 -- 172.21.15.49:0/2535297836 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 156 v156) v1 ==== 95+0+4513 (secure 0 0 0) 0x7f903c04ab80 con 0x7f904c065550 2024-01-22T05:19:53.726 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:53.726 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":156,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1805560931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1805560931},{"type":"v1","addr":"172.21.15.110:6833","nonce":1805560931}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3941922826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3941922826},{"type":"v1","addr":"172.21.15.110:6835","nonce":3941922826}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2796452202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2796452202},{"type":"v1","addr":"172.21.15.49:6836","nonce":2796452202}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":156,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:39.299248+0000","modified":"2024-01-22T05:19:53.457666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":198,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10656":{"gid":10656,"name":"a","rank":0,"incarnation":154,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.49:6837/1689534801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1689534801},{"type":"v1","addr":"172.21.15.49:6837","nonce":1689534801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2024-01-22T05:19:53.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.727+0000 7f9053200700 1 -- 172.21.15.49:0/2535297836 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f902405a510 msgr2=0x7f902405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:53.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.727+0000 7f9053200700 1 --2- 172.21.15.49:0/2535297836 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f902405a510 0x7f902405c9d0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f904c0c0550 tx=0x7f9034016000).stop 2024-01-22T05:19:53.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.727+0000 7f9053200700 1 -- 172.21.15.49:0/2535297836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f904c065550 msgr2=0x7f904c16ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:53.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.727+0000 7f9053200700 1 --2- 172.21.15.49:0/2535297836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f904c065550 0x7f904c16ce60 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 rx=0x7f903c00c440 tx=0x7f903c007cb0).stop 2024-01-22T05:19:53.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.727+0000 7f9053200700 1 -- 172.21.15.49:0/2535297836 shutdown_connections 2024-01-22T05:19:53.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.727+0000 7f9053200700 1 --2- 172.21.15.49:0/2535297836 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f902405a510 0x7f902405c9d0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:53.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.727+0000 7f9053200700 1 --2- 172.21.15.49:0/2535297836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f904c0bcfa0 0x7f904c14e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:53.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.727+0000 7f9053200700 1 --2- 172.21.15.49:0/2535297836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f904c0ab890 0x7f904c154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:53.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.727+0000 7f9053200700 1 --2- 172.21.15.49:0/2535297836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f904c065550 0x7f904c16ce60 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:53.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.727+0000 7f9053200700 1 -- 172.21.15.49:0/2535297836 >> 172.21.15.49:0/2535297836 conn(0x7f904c0c6540 msgr2=0x7f904c0c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:53.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.727+0000 7f9053200700 1 -- 172.21.15.49:0/2535297836 shutdown_connections 2024-01-22T05:19:53.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:53.727+0000 7f9053200700 1 -- 172.21.15.49:0/2535297836 wait complete. 2024-01-22T05:19:53.734 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 156 2024-01-22T05:19:54.157 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 156, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:19:39.299248+0000', 'modified': '2024-01-22T05:19:53.457666+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 198, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10656}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10656': {'gid': 10656, 'name': 'a', 'rank': 0, 'incarnation': 154, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.49:6837/1689534801', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6835', 'nonce': 1689534801}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 1689534801}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:19:54.157 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10656:up:rejoin 2024-01-22T05:19:55.158 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:19:55.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.327+0000 7f0df8800700 1 Processor -- start 2024-01-22T05:19:55.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.331+0000 7f0df8800700 1 -- start start 2024-01-22T05:19:55.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.331+0000 7f0df8800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df00c4210 0x7f0df0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:55.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.331+0000 7f0df8800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df00632d0 con 0x7f0df01581b0 2024-01-22T05:19:55.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.331+0000 7f0df8800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df00bfa30 con 0x7f0df0062230 2024-01-22T05:19:55.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df8800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df0063b80 con 0x7f0df00c4210 2024-01-22T05:19:55.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df5400700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0df01581b0 0x7f0df00c3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58788/0 (socket says 172.21.15.49:58788) 2024-01-22T05:19:55.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df5400700 1 -- 172.21.15.49:0/2429110575 learned_addr learned my addr 172.21.15.49:0/2429110575 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:55.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df5e00700 1 --1- 172.21.15.49:0/2429110575 >> v1:172.21.15.110:6789/0 conn(0x7f0df0062230 0x7f0df0153ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:38954/0 (socket says 172.21.15.49:38954) 2024-01-22T05:19:55.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df7200700 1 --2- 172.21.15.49:0/2429110575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df00c4210 0x7f0df0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127548297 0 0) 0x7f0df00632d0 con 0x7f0df01581b0 2024-01-22T05:19:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd00033f0 con 0x7f0df01581b0 2024-01-22T05:19:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487184404 0 0) 0x7f0df00bfa30 con 0x7f0df0062230 2024-01-22T05:19:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0df00632d0 con 0x7f0df0062230 2024-01-22T05:19:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4081668516 0 0) 0x7f0dd00033f0 con 0x7f0df01581b0 2024-01-22T05:19:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df00c4210 msgr2=0x7f0df0067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 --2- 172.21.15.49:0/2429110575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df00c4210 0x7f0df0067f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 >> v1:172.21.15.110:6789/0 conn(0x7f0df0062230 legacy=0x7f0df0153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df0158640 con 0x7f0df01581b0 2024-01-22T05:19:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f0dd8001470 con 0x7f0df01581b0 2024-01-22T05:19:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 >> v1:172.21.15.49:6789/0 conn(0x7f0df01581b0 legacy=0x7f0df00c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 --2- 172.21.15.49:0/2429110575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dd0004b00 0x7f0dd0004f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 --2- 172.21.15.49:0/2429110575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dd0003630 0x7f0dd0003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 --2- 172.21.15.49:0/2429110575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dd0003fa0 0x7f0dd000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df0063b80 con 0x7f0dd0003630 2024-01-22T05:19:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd000beb0 con 0x7f0dd0004b00 2024-01-22T05:19:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd000c070 con 0x7f0dd0003fa0 2024-01-22T05:19:55.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df7200700 1 --2- 172.21.15.49:0/2429110575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df00c4210 0x7f0df0067f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df5400700 1 --2- 172.21.15.49:0/2429110575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dd0003630 0x7f0dd0003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df5e00700 1 --2- 172.21.15.49:0/2429110575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dd0004b00 0x7f0dd0004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df7200700 1 --2- 172.21.15.49:0/2429110575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dd0003fa0 0x7f0dd000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df5400700 1 -- 172.21.15.49:0/2429110575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dd0003fa0 msgr2=0x7f0dd000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df5400700 1 --2- 172.21.15.49:0/2429110575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dd0003fa0 0x7f0dd000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df5400700 1 -- 172.21.15.49:0/2429110575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dd0004b00 msgr2=0x7f0dd0004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df5400700 1 --2- 172.21.15.49:0/2429110575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dd0004b00 0x7f0dd0004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df5400700 1 -- 172.21.15.49:0/2429110575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd00033f0 con 0x7f0dd0003630 2024-01-22T05:19:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df7200700 1 --2- 172.21.15.49:0/2429110575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dd0003fa0 0x7f0dd000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:19:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.335+0000 7f0df5400700 1 --2- 172.21.15.49:0/2429110575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dd0003630 0x7f0dd0003ab0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 rx=0x7f0dd800c190 tx=0x7f0dd8001e10).ready entity=mon.0 client_cookie=4c0e1fc3b6578d9f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.339+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd800ca00 con 0x7f0dd0003630 2024-01-22T05:19:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.339+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd800cb60 con 0x7f0dd0003630 2024-01-22T05:19:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.339+0000 7f0df4a00700 1 -- 172.21.15.49:0/2429110575 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd80070d0 con 0x7f0dd0003630 2024-01-22T05:19:55.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.339+0000 7f0df8800700 1 -- 172.21.15.49:0/2429110575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dd0003630 msgr2=0x7f0dd0003ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:55.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.339+0000 7f0df8800700 1 --2- 172.21.15.49:0/2429110575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dd0003630 0x7f0dd0003ab0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 rx=0x7f0dd800c190 tx=0x7f0dd8001e10).stop 2024-01-22T05:19:55.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.339+0000 7f0df7200700 1 -- 172.21.15.49:0/2429110575 reap_dead start 2024-01-22T05:19:55.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.339+0000 7f0df8800700 1 -- 172.21.15.49:0/2429110575 shutdown_connections 2024-01-22T05:19:55.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.339+0000 7f0df8800700 1 -- 172.21.15.49:0/2429110575 >> 172.21.15.49:0/2429110575 conn(0x7f0df00c5860 msgr2=0x7f0df00c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:55.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.339+0000 7f0df8800700 1 -- 172.21.15.49:0/2429110575 shutdown_connections 2024-01-22T05:19:55.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.339+0000 7f0df8800700 1 -- 172.21.15.49:0/2429110575 wait complete. 2024-01-22T05:19:55.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.343+0000 7f0df8800700 1 Processor -- start 2024-01-22T05:19:55.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.343+0000 7f0df8800700 1 -- start start 2024-01-22T05:19:55.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.343+0000 7f0df8800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dd0003630 0x7f0df014ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:55.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.343+0000 7f0df8800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df0155980 0x7f0df00aa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:55.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.343+0000 7f0df8800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df0155e00 0x7f0df0067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:55.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.343+0000 7f0df8800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df014ef80 con 0x7f0dd0003630 2024-01-22T05:19:55.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.343+0000 7f0df8800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00a8d40 con 0x7f0df0155e00 2024-01-22T05:19:55.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.343+0000 7f0df8800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00ab600 con 0x7f0df0155980 2024-01-22T05:19:55.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.343+0000 7f0df5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dd0003630 0x7f0df014ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.343+0000 7f0df5e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dd0003630 0x7f0df014ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47986/0 (socket says 172.21.15.49:47986) 2024-01-22T05:19:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.343+0000 7f0df5e00700 1 -- 172.21.15.49:0/3442359509 learned_addr learned my addr 172.21.15.49:0/3442359509 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.343+0000 7f0df7200700 1 --2- 172.21.15.49:0/3442359509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df0155e00 0x7f0df0067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.343+0000 7f0df5400700 1 --2- 172.21.15.49:0/3442359509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df0155980 0x7f0df00aa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.347+0000 7f0df5e00700 1 -- 172.21.15.49:0/3442359509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df0155980 msgr2=0x7f0df00aa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.347+0000 7f0df5e00700 1 --2- 172.21.15.49:0/3442359509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df0155980 0x7f0df00aa5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.347+0000 7f0df5e00700 1 -- 172.21.15.49:0/3442359509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df0155e00 msgr2=0x7f0df0067fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.347+0000 7f0df5e00700 1 --2- 172.21.15.49:0/3442359509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df0155e00 0x7f0df0067fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.347+0000 7f0df5e00700 1 -- 172.21.15.49:0/3442359509 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df00a8a10 con 0x7f0dd0003630 2024-01-22T05:19:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.347+0000 7f0df7200700 1 --2- 172.21.15.49:0/3442359509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df0155e00 0x7f0df0067fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.347+0000 7f0df5e00700 1 --2- 172.21.15.49:0/3442359509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dd0003630 0x7f0df014ea90 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7f0de0001610 tx=0x7f0de0007ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:55.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.347+0000 7f0ded600700 1 -- 172.21.15.49:0/3442359509 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0005e40 con 0x7f0dd0003630 2024-01-22T05:19:55.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.347+0000 7f0ded600700 1 -- 172.21.15.49:0/3442359509 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de0010450 con 0x7f0dd0003630 2024-01-22T05:19:55.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.347+0000 7f0ded600700 1 -- 172.21.15.49:0/3442359509 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de00107d0 con 0x7f0dd0003630 2024-01-22T05:19:55.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.347+0000 7f0df8800700 1 -- 172.21.15.49:0/3442359509 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df00ab040 con 0x7f0dd0003630 2024-01-22T05:19:55.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.347+0000 7f0df8800700 1 -- 172.21.15.49:0/3442359509 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df00acf00 con 0x7f0dd0003630 2024-01-22T05:19:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.347+0000 7f0df8800700 1 -- 172.21.15.49:0/3442359509 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df0047060 con 0x7f0dd0003630 2024-01-22T05:19:55.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.351+0000 7f0ded600700 1 -- 172.21.15.49:0/3442359509 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0de0010b40 con 0x7f0dd0003630 2024-01-22T05:19:55.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.351+0000 7f0ded600700 1 --2- 172.21.15.49:0/3442359509 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0dc805a540 0x7f0dc805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:55.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.351+0000 7f0ded600700 1 -- 172.21.15.49:0/3442359509 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f0de00749b0 con 0x7f0dd0003630 2024-01-22T05:19:55.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.351+0000 7f0df5400700 1 --2- 172.21.15.49:0/3442359509 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0dc805a540 0x7f0dc805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:55.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.351+0000 7f0df5400700 1 --2- 172.21.15.49:0/3442359509 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0dc805a540 0x7f0dc805ca00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f0dd8001e70 tx=0x7f0dd8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:55.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.355+0000 7f0ded600700 1 -- 172.21.15.49:0/3442359509 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0de0047f40 con 0x7f0dd0003630 2024-01-22T05:19:55.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.579+0000 7f0df8800700 1 -- 172.21.15.49:0/3442359509 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0df00bdf40 con 0x7f0dd0003630 2024-01-22T05:19:55.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.579+0000 7f0ded600700 1 -- 172.21.15.49:0/3442359509 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) v1 ==== 95+0+4513 (secure 0 0 0) 0x7f0de004b560 con 0x7f0dd0003630 2024-01-22T05:19:55.581 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:19:55.581 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":157,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1805560931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1805560931},{"type":"v1","addr":"172.21.15.110:6833","nonce":1805560931}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3941922826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3941922826},{"type":"v1","addr":"172.21.15.110:6835","nonce":3941922826}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2796452202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2796452202},{"type":"v1","addr":"172.21.15.49:6836","nonce":2796452202}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:39.299248+0000","modified":"2024-01-22T05:19:54.461466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":198,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10656":{"gid":10656,"name":"a","rank":0,"incarnation":154,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/1689534801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1689534801},{"type":"v1","addr":"172.21.15.49:6837","nonce":1689534801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2024-01-22T05:19:55.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.583+0000 7f0df8800700 1 -- 172.21.15.49:0/3442359509 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0dc805a540 msgr2=0x7f0dc805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:55.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.583+0000 7f0df8800700 1 --2- 172.21.15.49:0/3442359509 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0dc805a540 0x7f0dc805ca00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f0dd8001e70 tx=0x7f0dd8015000).stop 2024-01-22T05:19:55.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.583+0000 7f0df8800700 1 -- 172.21.15.49:0/3442359509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dd0003630 msgr2=0x7f0df014ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:55.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.583+0000 7f0df8800700 1 --2- 172.21.15.49:0/3442359509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dd0003630 0x7f0df014ea90 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7f0de0001610 tx=0x7f0de0007ea0).stop 2024-01-22T05:19:55.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.583+0000 7f0df8800700 1 -- 172.21.15.49:0/3442359509 shutdown_connections 2024-01-22T05:19:55.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.583+0000 7f0df8800700 1 --2- 172.21.15.49:0/3442359509 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f0dc805a540 0x7f0dc805ca00 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:55.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.583+0000 7f0df8800700 1 --2- 172.21.15.49:0/3442359509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df0155e00 0x7f0df0067fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:55.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.583+0000 7f0df8800700 1 --2- 172.21.15.49:0/3442359509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df0155980 0x7f0df00aa5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:55.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.583+0000 7f0df8800700 1 --2- 172.21.15.49:0/3442359509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dd0003630 0x7f0df014ea90 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:55.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.583+0000 7f0df8800700 1 -- 172.21.15.49:0/3442359509 >> 172.21.15.49:0/3442359509 conn(0x7f0df00c5860 msgr2=0x7f0df00c36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:55.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.583+0000 7f0df8800700 1 -- 172.21.15.49:0/3442359509 shutdown_connections 2024-01-22T05:19:55.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:55.583+0000 7f0df8800700 1 -- 172.21.15.49:0/3442359509 wait complete. 2024-01-22T05:19:55.590 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 157 2024-01-22T05:19:56.012 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 157, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:19:39.299248+0000', 'modified': '2024-01-22T05:19:54.461466+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 198, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10656}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10656': {'gid': 10656, 'name': 'a', 'rank': 0, 'incarnation': 154, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.49:6837/1689534801', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6835', 'nonce': 1689534801}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 1689534801}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:19:56.012 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:19:56.012 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-22T05:19:56.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.183+0000 7f615d400700 1 Processor -- start 2024-01-22T05:19:56.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.183+0000 7f615d400700 1 -- start start 2024-01-22T05:19:56.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.187+0000 7f615d400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f61580a8740 0x7f61580a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.187+0000 7f615d400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f61580c1ed0 0x7f61580c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.187+0000 7f615d400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61580c1a40 con 0x7f6158155d20 2024-01-22T05:19:56.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.187+0000 7f615d400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61580a90b0 con 0x7f61580a8740 2024-01-22T05:19:56.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.187+0000 7f615d400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6158159310 con 0x7f61580c1ed0 2024-01-22T05:19:56.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.187+0000 7f6155e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f61580a8740 0x7f61580a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.187+0000 7f6155e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f61580a8740 0x7f61580a8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48002/0 (socket says 172.21.15.49:48002) 2024-01-22T05:19:56.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.187+0000 7f6155e00700 1 -- 172.21.15.49:0/3127313409 learned_addr learned my addr 172.21.15.49:0/3127313409 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.187+0000 7f6157200700 1 --2- 172.21.15.49:0/3127313409 >> v2:172.21.15.110:3300/0 conn(0x7f61580c1ed0 0x7f61580c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.187+0000 7f6155e00700 1 -- 172.21.15.49:0/3127313409 >> v2:172.21.15.110:3300/0 conn(0x7f61580c1ed0 msgr2=0x7f61580c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.187+0000 7f6155e00700 1 --2- 172.21.15.49:0/3127313409 >> v2:172.21.15.110:3300/0 conn(0x7f61580c1ed0 0x7f61580c2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.187+0000 7f6155e00700 1 -- 172.21.15.49:0/3127313409 >> v1:172.21.15.110:6789/0 conn(0x7f6158155d20 legacy=0x7f6158065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.187+0000 7f6155e00700 1 -- 172.21.15.49:0/3127313409 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61580c13f0 con 0x7f61580a8740 2024-01-22T05:19:56.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.187+0000 7f6155e00700 1 --2- 172.21.15.49:0/3127313409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61580a8740 0x7f61580a8bc0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7f61580c19b0 tx=0x7f61400090f0).ready entity=mon.0 client_cookie=4f204b6a65eea40c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.191+0000 7f6155400700 1 -- 172.21.15.49:0/3127313409 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614000b520 con 0x7f61580a8740 2024-01-22T05:19:56.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.191+0000 7f6155400700 1 -- 172.21.15.49:0/3127313409 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614000b680 con 0x7f61580a8740 2024-01-22T05:19:56.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.191+0000 7f6155400700 1 -- 172.21.15.49:0/3127313409 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614000ba00 con 0x7f61580a8740 2024-01-22T05:19:56.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.191+0000 7f615d400700 1 -- 172.21.15.49:0/3127313409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61580a8740 msgr2=0x7f61580a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.191+0000 7f615d400700 1 --2- 172.21.15.49:0/3127313409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61580a8740 0x7f61580a8bc0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7f61580c19b0 tx=0x7f61400090f0).stop 2024-01-22T05:19:56.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.191+0000 7f615d400700 1 -- 172.21.15.49:0/3127313409 shutdown_connections 2024-01-22T05:19:56.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.191+0000 7f615d400700 1 --2- 172.21.15.49:0/3127313409 >> v2:172.21.15.110:3300/0 conn(0x7f61580c1ed0 0x7f61580c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.191+0000 7f615d400700 1 --2- 172.21.15.49:0/3127313409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61580a8740 0x7f61580a8bc0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.191+0000 7f615d400700 1 -- 172.21.15.49:0/3127313409 >> 172.21.15.49:0/3127313409 conn(0x7f61580c6540 msgr2=0x7f61580c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.191+0000 7f615d400700 1 -- 172.21.15.49:0/3127313409 shutdown_connections 2024-01-22T05:19:56.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.191+0000 7f615d400700 1 -- 172.21.15.49:0/3127313409 wait complete. 2024-01-22T05:19:56.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.195+0000 7f615d400700 1 Processor -- start 2024-01-22T05:19:56.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.195+0000 7f615d400700 1 -- start start 2024-01-22T05:19:56.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.195+0000 7f615d400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61580a8740 0x7f61581534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.195+0000 7f615d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61580c1ed0 0x7f6158168d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.195+0000 7f615d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6158155d20 0x7f61581660f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.195+0000 7f615d400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61580a95b0 con 0x7f61580c1ed0 2024-01-22T05:19:56.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.195+0000 7f615d400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61580a9890 con 0x7f6158155d20 2024-01-22T05:19:56.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.195+0000 7f615d400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6158169560 con 0x7f61580a8740 2024-01-22T05:19:56.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f6155e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61580c1ed0 0x7f6158168d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f6157200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6158155d20 0x7f61581660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f6157200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6158155d20 0x7f61581660f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:55236/0 (socket says 172.21.15.49:55236) 2024-01-22T05:19:56.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f6157200700 1 -- 172.21.15.49:0/1027916236 learned_addr learned my addr 172.21.15.49:0/1027916236 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f6156800700 1 --2- 172.21.15.49:0/1027916236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61580a8740 0x7f61581534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f6155e00700 1 -- 172.21.15.49:0/1027916236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61580a8740 msgr2=0x7f61581534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f6155e00700 1 --2- 172.21.15.49:0/1027916236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61580a8740 0x7f61581534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f6155e00700 1 -- 172.21.15.49:0/1027916236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6158155d20 msgr2=0x7f61581660f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f6155e00700 1 --2- 172.21.15.49:0/1027916236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6158155d20 0x7f61581660f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f6155e00700 1 -- 172.21.15.49:0/1027916236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6140009370 con 0x7f61580c1ed0 2024-01-22T05:19:56.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f6157200700 1 --2- 172.21.15.49:0/1027916236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6158155d20 0x7f61581660f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:56.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f6155e00700 1 --2- 172.21.15.49:0/1027916236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61580c1ed0 0x7f6158168d30 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7f615805ff40 tx=0x7f6140017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f614e000700 1 -- 172.21.15.49:0/1027916236 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140000bc0 con 0x7f61580c1ed0 2024-01-22T05:19:56.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f614e000700 1 -- 172.21.15.49:0/1027916236 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614000b7f0 con 0x7f61580c1ed0 2024-01-22T05:19:56.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f615d400700 1 -- 172.21.15.49:0/1027916236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6158169840 con 0x7f61580c1ed0 2024-01-22T05:19:56.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f614e000700 1 -- 172.21.15.49:0/1027916236 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140000d20 con 0x7f61580c1ed0 2024-01-22T05:19:56.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.199+0000 7f615d400700 1 -- 172.21.15.49:0/1027916236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6158169220 con 0x7f61580c1ed0 2024-01-22T05:19:56.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.203+0000 7f614e000700 1 -- 172.21.15.49:0/1027916236 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f614001c8c0 con 0x7f61580c1ed0 2024-01-22T05:19:56.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.203+0000 7f614e000700 1 --2- 172.21.15.49:0/1027916236 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f613005a540 0x7f613005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.203+0000 7f614e000700 1 -- 172.21.15.49:0/1027916236 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f6140076510 con 0x7f61580c1ed0 2024-01-22T05:19:56.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.203+0000 7f6156800700 1 --2- 172.21.15.49:0/1027916236 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f613005a540 0x7f613005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.207+0000 7f6156800700 1 --2- 172.21.15.49:0/1027916236 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f613005a540 0x7f613005ca00 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f6148000c00 tx=0x7f6148007d20).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.207+0000 7f61677c1740 1 Processor -- start 2024-01-22T05:19:56.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.207+0000 7f61677c1740 1 -- start start 2024-01-22T05:19:56.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.207+0000 7f61677c1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f543a0 0x1f38d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.207+0000 7f61677c1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f13e40 0x1f0faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.207+0000 7f61677c1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f54780 0x1f0d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.207+0000 7f61677c1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e93410 con 0x1f543a0 2024-01-22T05:19:56.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.207+0000 7f61677c1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e93550 con 0x1f54780 2024-01-22T05:19:56.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.207+0000 7f61677c1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e93a00 con 0x1f13e40 2024-01-22T05:19:56.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.207+0000 7f6156800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f543a0 0x1f38d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.207+0000 7f6156800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f543a0 0x1f38d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48012/0 (socket says 172.21.15.49:48012) 2024-01-22T05:19:56.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.207+0000 7f6156800700 1 -- 172.21.15.49:0/1525504464 learned_addr learned my addr 172.21.15.49:0/1525504464 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.207+0000 7f6155e00700 1 --2- 172.21.15.49:0/1525504464 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f13e40 0x1f0faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.207+0000 7f6157200700 1 --2- 172.21.15.49:0/1525504464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f54780 0x1f0d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f6155e00700 1 -- 172.21.15.49:0/1525504464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f54780 msgr2=0x1f0d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f6155e00700 1 --2- 172.21.15.49:0/1525504464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f54780 0x1f0d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f6155e00700 1 -- 172.21.15.49:0/1525504464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f543a0 msgr2=0x1f38d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f6155e00700 1 --2- 172.21.15.49:0/1525504464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f543a0 0x1f38d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f6155e00700 1 -- 172.21.15.49:0/1525504464 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1e8c730 con 0x1f13e40 2024-01-22T05:19:56.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f6156800700 1 --2- 172.21.15.49:0/1525504464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f543a0 0x1f38d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:56.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f6155e00700 1 --2- 172.21.15.49:0/1525504464 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f13e40 0x1f0faf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f6140049c00 tx=0x7f614000e000).ready entity=mon.2 client_cookie=240a3018218ed734 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f6146600700 1 -- 172.21.15.49:0/1525504464 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614004d060 con 0x1f13e40 2024-01-22T05:19:56.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f6146600700 1 -- 172.21.15.49:0/1525504464 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6140051070 con 0x1f13e40 2024-01-22T05:19:56.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f6146600700 1 -- 172.21.15.49:0/1525504464 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614004d6a0 con 0x1f13e40 2024-01-22T05:19:56.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f61677c1740 1 -- 172.21.15.49:0/1525504464 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f13e40 msgr2=0x1f0faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f61677c1740 1 --2- 172.21.15.49:0/1525504464 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f13e40 0x1f0faf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f6140049c00 tx=0x7f614000e000).stop 2024-01-22T05:19:56.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f61677c1740 1 -- 172.21.15.49:0/1525504464 shutdown_connections 2024-01-22T05:19:56.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f61677c1740 1 --2- 172.21.15.49:0/1525504464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f54780 0x1f0d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f61677c1740 1 --2- 172.21.15.49:0/1525504464 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f13e40 0x1f0faf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f61677c1740 1 --2- 172.21.15.49:0/1525504464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f543a0 0x1f38d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f61677c1740 1 -- 172.21.15.49:0/1525504464 >> 172.21.15.49:0/1525504464 conn(0x1cf1550 msgr2=0x1f13730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f61677c1740 1 -- 172.21.15.49:0/1525504464 shutdown_connections 2024-01-22T05:19:56.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.211+0000 7f61677c1740 1 -- 172.21.15.49:0/1525504464 wait complete. 2024-01-22T05:19:56.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.215+0000 7f61677c1740 1 -- start start 2024-01-22T05:19:56.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.215+0000 7f61677c1740 1 Processor -- start 2024-01-22T05:19:56.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f13e40 0x1f35990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f543a0 0x1f39fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f54780 0x1f38530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e5e650 con 0x1f13e40 2024-01-22T05:19:56.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f3a4a0 con 0x1f543a0 2024-01-22T05:19:56.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f38a20 con 0x1f54780 2024-01-22T05:19:56.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 10 client.0 ll_register_callbacks cb 0x1ecb020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:19:56.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f6156800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f13e40 0x1f35990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f6156800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f13e40 0x1f35990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48026/0 (socket says 172.21.15.49:48026) 2024-01-22T05:19:56.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f6156800700 1 -- 172.21.15.49:0/2593757131 learned_addr learned my addr 172.21.15.49:0/2593757131 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f6157200700 1 --2- 172.21.15.49:0/2593757131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f54780 0x1f38530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f6155e00700 1 --2- 172.21.15.49:0/2593757131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f543a0 0x1f39fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f6156800700 1 -- 172.21.15.49:0/2593757131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f54780 msgr2=0x1f38530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f6156800700 1 --2- 172.21.15.49:0/2593757131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f54780 0x1f38530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f6156800700 1 -- 172.21.15.49:0/2593757131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f543a0 msgr2=0x1f39fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f6156800700 1 --2- 172.21.15.49:0/2593757131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f543a0 0x1f39fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f6156800700 1 -- 172.21.15.49:0/2593757131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61580c1a40 con 0x1f13e40 2024-01-22T05:19:56.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f6155e00700 1 --2- 172.21.15.49:0/2593757131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f543a0 0x1f39fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:56.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f6156800700 1 --2- 172.21.15.49:0/2593757131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f13e40 0x1f35990 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7f614800ff10 tx=0x7f614800a000).ready entity=mon.0 client_cookie=8be0bb08eeae06a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f613ea00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:19:56.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f613ea00700 1 -- 172.21.15.49:0/2593757131 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614801c070 con 0x1f13e40 2024-01-22T05:19:56.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 1 -- 172.21.15.49:0/2593757131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1e891a0 con 0x1f13e40 2024-01-22T05:19:56.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f613ea00700 1 -- 172.21.15.49:0/2593757131 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f6148016b60 con 0x1f13e40 2024-01-22T05:19:56.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f613ea00700 1 -- 172.21.15.49:0/2593757131 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6148014450 con 0x1f13e40 2024-01-22T05:19:56.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 10 client.10713 fetch_fsmap learned FSMap version 157 2024-01-22T05:19:56.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 1 -- 172.21.15.49:0/2593757131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x7f6158169220 con 0x1f13e40 2024-01-22T05:19:56.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f613ea00700 1 -- 172.21.15.49:0/2593757131 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1e891a0 con 0x1f13e40 2024-01-22T05:19:56.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f613ea00700 1 -- 172.21.15.49:0/2593757131 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f61480145b0 con 0x1f13e40 2024-01-22T05:19:56.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 10 client.10713 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:19:56.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 10 client.10713 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:19:56.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 20 client.10713 populate_metadata read hostname 'smithi049' 2024-01-22T05:19:56.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 1 --2- 172.21.15.49:0/2593757131 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1f37b60 0x1f3bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 4 client.10713 mds_command: new command op to 10656 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:19:56.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.219+0000 7f61677c1740 1 -- 172.21.15.49:0/2593757131 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1e7f6f0 con 0x1f37b60 2024-01-22T05:19:56.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.223+0000 7f6155e00700 1 --2- 172.21.15.49:0/2593757131 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1f37b60 0x1f3bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.223+0000 7f6155e00700 1 --2- 172.21.15.49:0/2593757131 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1f37b60 0x1f3bff0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=20dec7f380b9d78 server_cookie=74513cf831b088e4 in_seq=0 out_seq=0 2024-01-22T05:19:56.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.223+0000 7f613ea00700 10 client.10713 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:19:56.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.223+0000 7f613ea00700 1 -- 172.21.15.49:0/2593757131 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1e7f6f0 con 0x1f37b60 2024-01-22T05:19:56.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.223+0000 7f613ea00700 10 client.10713 handle_command_reply: tid=0 2024-01-22T05:19:56.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.223+0000 7f61677c1740 1 client.10713 shutdown 2024-01-22T05:19:56.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.223+0000 7f61677c1740 1 -- 172.21.15.49:0/2593757131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f13e40 msgr2=0x1f35990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.223+0000 7f61677c1740 1 --2- 172.21.15.49:0/2593757131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f13e40 0x1f35990 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7f614800ff10 tx=0x7f614800a000).stop 2024-01-22T05:19:56.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.223+0000 7f61677c1740 1 -- 172.21.15.49:0/2593757131 shutdown_connections 2024-01-22T05:19:56.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.223+0000 7f61677c1740 1 --2- 172.21.15.49:0/2593757131 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1f37b60 0x1f3bff0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.223+0000 7f61677c1740 1 --2- 172.21.15.49:0/2593757131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f54780 0x1f38530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.223+0000 7f61677c1740 1 --2- 172.21.15.49:0/2593757131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f543a0 0x1f39fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.223+0000 7f61677c1740 1 --2- 172.21.15.49:0/2593757131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f13e40 0x1f35990 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.223+0000 7f613ea00700 0 client.10713 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:19:56.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.223+0000 7f61677c1740 1 -- 172.21.15.49:0/2593757131 >> 172.21.15.49:0/2593757131 conn(0x1cf1550 msgr2=0x1f5a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.227+0000 7f61677c1740 1 -- 172.21.15.49:0/2593757131 shutdown_connections 2024-01-22T05:19:56.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.227+0000 7f61677c1740 1 -- 172.21.15.49:0/2593757131 wait complete. 2024-01-22T05:19:56.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.227+0000 7f61677c1740 20 client.10713 trim_cache size 0 max 16384 2024-01-22T05:19:56.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.247+0000 7f61677c1740 1 Processor -- start 2024-01-22T05:19:56.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.247+0000 7f61677c1740 1 -- start start 2024-01-22T05:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.247+0000 7f61677c1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f13e40 0x1f12a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.247+0000 7f61677c1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f543a0 0x1f131a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.247+0000 7f61677c1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f54780 0x1f6db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.247+0000 7f61677c1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f39460 con 0x1f54780 2024-01-22T05:19:56.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.247+0000 7f61677c1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f55d70 con 0x1f13e40 2024-01-22T05:19:56.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.247+0000 7f61677c1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f57040 con 0x1f543a0 2024-01-22T05:19:56.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.247+0000 7f6157200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f54780 0x1f6db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.247+0000 7f6157200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f54780 0x1f6db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48032/0 (socket says 172.21.15.49:48032) 2024-01-22T05:19:56.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.247+0000 7f6157200700 1 -- 172.21.15.49:0/2857957510 learned_addr learned my addr 172.21.15.49:0/2857957510 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.247+0000 7f6156800700 1 --2- 172.21.15.49:0/2857957510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f13e40 0x1f12a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f6155e00700 1 --2- 172.21.15.49:0/2857957510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f543a0 0x1f131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f6157200700 1 -- 172.21.15.49:0/2857957510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f543a0 msgr2=0x1f131a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f6157200700 1 --2- 172.21.15.49:0/2857957510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f543a0 0x1f131a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f6157200700 1 -- 172.21.15.49:0/2857957510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f13e40 msgr2=0x1f12a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f6157200700 1 --2- 172.21.15.49:0/2857957510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f13e40 0x1f12a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f6157200700 1 -- 172.21.15.49:0/2857957510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61580c6c80 con 0x1f54780 2024-01-22T05:19:56.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f6157200700 1 --2- 172.21.15.49:0/2857957510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f54780 0x1f6db50 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 rx=0x7f615000ecc0 tx=0x7f615000b040).ready entity=mon.0 client_cookie=524e8e2bfd76f7be server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f6147000700 1 -- 172.21.15.49:0/2857957510 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000e810 con 0x1f54780 2024-01-22T05:19:56.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f6147000700 1 -- 172.21.15.49:0/2857957510 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615001c070 con 0x1f54780 2024-01-22T05:19:56.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f6147000700 1 -- 172.21.15.49:0/2857957510 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150017850 con 0x1f54780 2024-01-22T05:19:56.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f61677c1740 1 -- 172.21.15.49:0/2857957510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f54780 msgr2=0x1f6db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f61677c1740 1 --2- 172.21.15.49:0/2857957510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f54780 0x1f6db50 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 rx=0x7f615000ecc0 tx=0x7f615000b040).stop 2024-01-22T05:19:56.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f61677c1740 1 -- 172.21.15.49:0/2857957510 shutdown_connections 2024-01-22T05:19:56.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f61677c1740 1 --2- 172.21.15.49:0/2857957510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f54780 0x1f6db50 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f61677c1740 1 --2- 172.21.15.49:0/2857957510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f543a0 0x1f131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f61677c1740 1 --2- 172.21.15.49:0/2857957510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f13e40 0x1f12a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f61677c1740 1 -- 172.21.15.49:0/2857957510 >> 172.21.15.49:0/2857957510 conn(0x1cf1550 msgr2=0x1f13730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f61677c1740 1 -- 172.21.15.49:0/2857957510 shutdown_connections 2024-01-22T05:19:56.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.251+0000 7f61677c1740 1 -- 172.21.15.49:0/2857957510 wait complete. 2024-01-22T05:19:56.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.255+0000 7f61677c1740 1 -- start start 2024-01-22T05:19:56.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.255+0000 7f61677c1740 1 Processor -- start 2024-01-22T05:19:56.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f61677c1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f13e40 0x1f35970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f61677c1740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f543a0 0x1faf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f61677c1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f54780 0x1fafe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f61677c1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fb5640 con 0x1f13e40 2024-01-22T05:19:56.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f61677c1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fb0690 con 0x1f54780 2024-01-22T05:19:56.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f61677c1740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f12830 con 0x1f543a0 2024-01-22T05:19:56.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f61677c1740 10 client.0 ll_register_callbacks cb 0x7f614800fb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:19:56.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f6156800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f13e40 0x1f35970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f6156800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f13e40 0x1f35970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48044/0 (socket says 172.21.15.49:48044) 2024-01-22T05:19:56.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f6156800700 1 -- 172.21.15.49:0/1400275853 learned_addr learned my addr 172.21.15.49:0/1400275853 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f6157200700 1 --2- 172.21.15.49:0/1400275853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f54780 0x1fafe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f6155e00700 1 --2- 172.21.15.49:0/1400275853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f543a0 0x1faf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f6156800700 1 -- 172.21.15.49:0/1400275853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f543a0 msgr2=0x1faf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f6156800700 1 --2- 172.21.15.49:0/1400275853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f543a0 0x1faf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f6156800700 1 -- 172.21.15.49:0/1400275853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f54780 msgr2=0x1fafe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f6156800700 1 --2- 172.21.15.49:0/1400275853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f54780 0x1fafe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f6156800700 1 -- 172.21.15.49:0/1400275853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615000e9c0 con 0x1f13e40 2024-01-22T05:19:56.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f6156800700 1 --2- 172.21.15.49:0/1400275853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f13e40 0x1f35970 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7f614800ff10 tx=0x7f6148014000).ready entity=mon.0 client_cookie=7d0a7db8035f47b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f613ea00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:19:56.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f613ea00700 1 -- 172.21.15.49:0/1400275853 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148014a70 con 0x1f13e40 2024-01-22T05:19:56.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f613ea00700 1 -- 172.21.15.49:0/1400275853 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f614802f430 con 0x1f13e40 2024-01-22T05:19:56.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f61677c1740 1 -- 172.21.15.49:0/1400275853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6140051070 con 0x1f13e40 2024-01-22T05:19:56.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f613ea00700 1 -- 172.21.15.49:0/1400275853 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6148014bd0 con 0x1f13e40 2024-01-22T05:19:56.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f61677c1740 10 client.10719 fetch_fsmap learned FSMap version 157 2024-01-22T05:19:56.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.259+0000 7f61677c1740 1 -- 172.21.15.49:0/1400275853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x1e87960 con 0x1f13e40 2024-01-22T05:19:56.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f613ea00700 1 -- 172.21.15.49:0/1400275853 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6140051070 con 0x1f13e40 2024-01-22T05:19:56.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f613ea00700 1 -- 172.21.15.49:0/1400275853 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f614802f800 con 0x1f13e40 2024-01-22T05:19:56.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f61677c1740 10 client.10719 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:19:56.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f61677c1740 10 client.10719 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:19:56.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f61677c1740 20 client.10719 populate_metadata read hostname 'smithi049' 2024-01-22T05:19:56.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f61677c1740 1 --2- 172.21.15.49:0/1400275853 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1fb4970 0x1fb4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f61677c1740 4 client.10719 mds_command: new command op to 10656 tid=0[{"prefix": "status"}] 2024-01-22T05:19:56.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f61677c1740 1 -- 172.21.15.49:0/1400275853 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1d484e0 con 0x1fb4970 2024-01-22T05:19:56.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f6155e00700 1 --2- 172.21.15.49:0/1400275853 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1fb4970 0x1fb4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f6155e00700 1 --2- 172.21.15.49:0/1400275853 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1fb4970 0x1fb4d50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=eb7c0fee0e07287b server_cookie=bd262bb1b56786aa in_seq=0 out_seq=0 2024-01-22T05:19:56.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f613ea00700 10 client.10719 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:19:56.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f613ea00700 1 -- 172.21.15.49:0/1400275853 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+335 (crc 0 0 0) 0x1d484e0 con 0x1fb4970 2024-01-22T05:19:56.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f613ea00700 10 client.10719 handle_command_reply: tid=0 2024-01-22T05:19:56.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f61677c1740 1 client.10719 shutdown 2024-01-22T05:19:56.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f61677c1740 1 -- 172.21.15.49:0/1400275853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f13e40 msgr2=0x1f35970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f61677c1740 1 --2- 172.21.15.49:0/1400275853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f13e40 0x1f35970 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7f614800ff10 tx=0x7f6148014000).stop 2024-01-22T05:19:56.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f61677c1740 1 -- 172.21.15.49:0/1400275853 shutdown_connections 2024-01-22T05:19:56.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f61677c1740 1 --2- 172.21.15.49:0/1400275853 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1fb4970 0x1fb4d50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f61677c1740 1 --2- 172.21.15.49:0/1400275853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1f54780 0x1fafe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f61677c1740 1 --2- 172.21.15.49:0/1400275853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1f543a0 0x1faf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f61677c1740 1 --2- 172.21.15.49:0/1400275853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1f13e40 0x1f35970 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f613ea00700 0 client.10719 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:19:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.263+0000 7f61677c1740 1 -- 172.21.15.49:0/1400275853 >> 172.21.15.49:0/1400275853 conn(0x1cf1550 msgr2=0x1f131a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.267+0000 7f61677c1740 1 -- 172.21.15.49:0/1400275853 shutdown_connections 2024-01-22T05:19:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.267+0000 7f61677c1740 1 -- 172.21.15.49:0/1400275853 wait complete. 2024-01-22T05:19:56.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.267+0000 7f61677c1740 20 client.10719 trim_cache size 0 max 16384 2024-01-22T05:19:56.268 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:19:56.268 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:19:56.268 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:19:56.268 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 10656, 2024-01-22T05:19:56.268 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:19:56.268 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:19:56.268 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:19:56.268 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 4.8200496929999996, 2024-01-22T05:19:56.268 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 157, 2024-01-22T05:19:56.268 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 198, 2024-01-22T05:19:56.268 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 198, 2024-01-22T05:19:56.269 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 6.6967466619999998 2024-01-22T05:19:56.269 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:19:56.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.267+0000 7f615d400700 1 -- 172.21.15.49:0/1027916236 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f613005a540 msgr2=0x7f613005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.267+0000 7f615d400700 1 --2- 172.21.15.49:0/1027916236 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f613005a540 0x7f613005ca00 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f6148000c00 tx=0x7f6148007d20).stop 2024-01-22T05:19:56.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.267+0000 7f615d400700 1 -- 172.21.15.49:0/1027916236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61580c1ed0 msgr2=0x7f6158168d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.267+0000 7f615d400700 1 --2- 172.21.15.49:0/1027916236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61580c1ed0 0x7f6158168d30 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7f615805ff40 tx=0x7f6140017000).stop 2024-01-22T05:19:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.267+0000 7f615d400700 1 -- 172.21.15.49:0/1027916236 shutdown_connections 2024-01-22T05:19:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.267+0000 7f615d400700 1 --2- 172.21.15.49:0/1027916236 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f613005a540 0x7f613005ca00 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.267+0000 7f615d400700 1 --2- 172.21.15.49:0/1027916236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6158155d20 0x7f61581660f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.267+0000 7f615d400700 1 --2- 172.21.15.49:0/1027916236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61580c1ed0 0x7f6158168d30 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.267+0000 7f615d400700 1 --2- 172.21.15.49:0/1027916236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61580a8740 0x7f61581534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.267+0000 7f615d400700 1 -- 172.21.15.49:0/1027916236 >> 172.21.15.49:0/1027916236 conn(0x7f61580c6540 msgr2=0x7f6158065b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.267+0000 7f615d400700 1 -- 172.21.15.49:0/1027916236 shutdown_connections 2024-01-22T05:19:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.267+0000 7f615d400700 1 -- 172.21.15.49:0/1027916236 wait complete. 2024-01-22T05:19:56.293 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub start / recursive,repair 2024-01-22T05:19:56.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.483+0000 7f025f400700 1 Processor -- start 2024-01-22T05:19:56.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.487+0000 7f025f400700 1 -- start start 2024-01-22T05:19:56.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.487+0000 7f025f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0258160bd0 0x7f0258162fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.487+0000 7f025f400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02580a7cb0 con 0x7f02580ac3b0 2024-01-22T05:19:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.487+0000 7f025f400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02580a8b10 con 0x7f0258066690 2024-01-22T05:19:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.487+0000 7f025f400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02580a7f00 con 0x7f0258160bd0 2024-01-22T05:19:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.487+0000 7f025d400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0258160bd0 0x7f0258162fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.491+0000 7f0257e00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0258066690 0x7f0258066af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:38966/0 (socket says 172.21.15.49:38966) 2024-01-22T05:19:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.491+0000 7f0257e00700 1 -- 172.21.15.49:0/2304842033 learned_addr learned my addr 172.21.15.49:0/2304842033 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.487+0000 7f025ca00700 1 --1- 172.21.15.49:0/2304842033 >> v1:172.21.15.49:6789/0 conn(0x7f02580ac3b0 0x7f0258159000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58798/0 (socket says 172.21.15.49:58798) 2024-01-22T05:19:56.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.491+0000 7f0257400700 1 -- 172.21.15.49:0/2304842033 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143594927 0 0) 0x7f02580a8b10 con 0x7f0258066690 2024-01-22T05:19:56.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.491+0000 7f0257400700 1 -- 172.21.15.49:0/2304842033 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02380033f0 con 0x7f0258066690 2024-01-22T05:19:56.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.491+0000 7f025d400700 1 -- 172.21.15.49:0/2304842033 >> v1:172.21.15.110:6789/0 conn(0x7f0258066690 legacy=0x7f0258066af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.491+0000 7f025d400700 1 -- 172.21.15.49:0/2304842033 >> v1:172.21.15.49:6789/0 conn(0x7f02580ac3b0 legacy=0x7f0258159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.491+0000 7f0257400700 1 -- 172.21.15.49:0/2304842033 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188977336 0 0) 0x7f02580a7cb0 con 0x7f02580ac3b0 2024-01-22T05:19:56.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.491+0000 7f025d400700 1 -- 172.21.15.49:0/2304842033 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02580a81e0 con 0x7f0258160bd0 2024-01-22T05:19:56.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.491+0000 7f025d400700 1 --2- 172.21.15.49:0/2304842033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258160bd0 0x7f0258162fc0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 rx=0x7f0250009e60 tx=0x7f0250009780).ready entity=mon.0 client_cookie=b37fa9e636dad571 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.491+0000 7f0257400700 1 -- 172.21.15.49:0/2304842033 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025000e070 con 0x7f0258160bd0 2024-01-22T05:19:56.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.491+0000 7f0257400700 1 -- 172.21.15.49:0/2304842033 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025000bb60 con 0x7f0258160bd0 2024-01-22T05:19:56.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.491+0000 7f0257400700 1 -- 172.21.15.49:0/2304842033 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025000bee0 con 0x7f0258160bd0 2024-01-22T05:19:56.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.491+0000 7f025f400700 1 -- 172.21.15.49:0/2304842033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258160bd0 msgr2=0x7f0258162fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.491+0000 7f025f400700 1 --2- 172.21.15.49:0/2304842033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258160bd0 0x7f0258162fc0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 rx=0x7f0250009e60 tx=0x7f0250009780).stop 2024-01-22T05:19:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.495+0000 7f025f400700 1 -- 172.21.15.49:0/2304842033 shutdown_connections 2024-01-22T05:19:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.495+0000 7f025f400700 1 --2- 172.21.15.49:0/2304842033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258160bd0 0x7f0258162fc0 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.495+0000 7f025f400700 1 -- 172.21.15.49:0/2304842033 >> 172.21.15.49:0/2304842033 conn(0x7f02580c6500 msgr2=0x7f02580c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.495+0000 7f025f400700 1 -- 172.21.15.49:0/2304842033 shutdown_connections 2024-01-22T05:19:56.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.495+0000 7f025f400700 1 -- 172.21.15.49:0/2304842033 wait complete. 2024-01-22T05:19:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.495+0000 7f025f400700 1 Processor -- start 2024-01-22T05:19:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025f400700 1 -- start start 2024-01-22T05:19:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025f400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258066690 0x7f025814a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02580ac3b0 0x7f02580c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025f400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0258160bd0 0x7f02580c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025f400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02580c3980 con 0x7f0258066690 2024-01-22T05:19:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025f400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02580bb6a0 con 0x7f02580ac3b0 2024-01-22T05:19:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025f400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02580c0340 con 0x7f0258160bd0 2024-01-22T05:19:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258066690 0x7f025814a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258066690 0x7f025814a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48060/0 (socket says 172.21.15.49:48060) 2024-01-22T05:19:56.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025ca00700 1 -- 172.21.15.49:0/1474901316 learned_addr learned my addr 172.21.15.49:0/1474901316 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f0257e00700 1 --2- 172.21.15.49:0/1474901316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02580ac3b0 0x7f02580c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025d400700 1 --2- 172.21.15.49:0/1474901316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0258160bd0 0x7f02580c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025ca00700 1 -- 172.21.15.49:0/1474901316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0258160bd0 msgr2=0x7f02580c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025ca00700 1 --2- 172.21.15.49:0/1474901316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0258160bd0 0x7f02580c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025ca00700 1 -- 172.21.15.49:0/1474901316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02580ac3b0 msgr2=0x7f02580c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025ca00700 1 --2- 172.21.15.49:0/1474901316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02580ac3b0 0x7f02580c2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025ca00700 1 -- 172.21.15.49:0/1474901316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0250009a20 con 0x7f0258066690 2024-01-22T05:19:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025ca00700 1 --2- 172.21.15.49:0/1474901316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258066690 0x7f025814a2f0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7f024800c5c0 tx=0x7f0248007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f024fe00700 1 -- 172.21.15.49:0/1474901316 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024800ce90 con 0x7f0258066690 2024-01-22T05:19:56.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f024fe00700 1 -- 172.21.15.49:0/1474901316 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02480072e0 con 0x7f0258066690 2024-01-22T05:19:56.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f025f400700 1 -- 172.21.15.49:0/1474901316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02580bfaa0 con 0x7f0258066690 2024-01-22T05:19:56.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.499+0000 7f024fe00700 1 -- 172.21.15.49:0/1474901316 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02480056e0 con 0x7f0258066690 2024-01-22T05:19:56.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.503+0000 7f025f400700 1 -- 172.21.15.49:0/1474901316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02580c0060 con 0x7f0258066690 2024-01-22T05:19:56.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.503+0000 7f024fe00700 1 -- 172.21.15.49:0/1474901316 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0248005ad0 con 0x7f0258066690 2024-01-22T05:19:56.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.507+0000 7f024fe00700 1 --2- 172.21.15.49:0/1474901316 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f023005a510 0x7f023005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.507+0000 7f024fe00700 1 -- 172.21.15.49:0/1474901316 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f0248074200 con 0x7f0258066690 2024-01-22T05:19:56.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.507+0000 7f0257e00700 1 --2- 172.21.15.49:0/1474901316 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f023005a510 0x7f023005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.507+0000 7f026990b740 1 Processor -- start 2024-01-22T05:19:56.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.507+0000 7f026990b740 1 -- start start 2024-01-22T05:19:56.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.507+0000 7f0257e00700 1 --2- 172.21.15.49:0/1474901316 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f023005a510 0x7f023005c9d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f0240007fd0 tx=0x7f0240009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.509 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-22T05:19:56.507+0000 7fbb41000700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:19:56.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.507+0000 7f026990b740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e96b10 0x1e96ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.507+0000 7f026990b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e51540 0x1e519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.507+0000 7f026990b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e4b0d0 0x1e4b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.507+0000 7f026990b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1daf5b0 con 0x1e51540 2024-01-22T05:19:56.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.507+0000 7f026990b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d73000 con 0x1e4b0d0 2024-01-22T05:19:56.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.507+0000 7f026990b740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d9e0c0 con 0x1e96b10 2024-01-22T05:19:56.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.507+0000 7f0257e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e51540 0x1e519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f0257e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e51540 0x1e519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48070/0 (socket says 172.21.15.49:48070) 2024-01-22T05:19:56.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f0257e00700 1 -- 172.21.15.49:0/2940280134 learned_addr learned my addr 172.21.15.49:0/2940280134 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f025ca00700 1 --2- 172.21.15.49:0/2940280134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e96b10 0x1e96ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f025d400700 1 --2- 172.21.15.49:0/2940280134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e4b0d0 0x1e4b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f0257e00700 1 -- 172.21.15.49:0/2940280134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e96b10 msgr2=0x1e96ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f0257e00700 1 --2- 172.21.15.49:0/2940280134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e96b10 0x1e96ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f0257e00700 1 -- 172.21.15.49:0/2940280134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e4b0d0 msgr2=0x1e4b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f0257e00700 1 --2- 172.21.15.49:0/2940280134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e4b0d0 0x1e4b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f0257e00700 1 -- 172.21.15.49:0/2940280134 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1dcc890 con 0x1e51540 2024-01-22T05:19:56.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f0257e00700 1 --2- 172.21.15.49:0/2940280134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e51540 0x1e519c0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7f024000f750 tx=0x7f0240013000).ready entity=mon.0 client_cookie=7a6285104a93ae0d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f0247e00700 1 -- 172.21.15.49:0/2940280134 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024000fe70 con 0x1e51540 2024-01-22T05:19:56.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f0247e00700 1 -- 172.21.15.49:0/2940280134 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0240020450 con 0x1e51540 2024-01-22T05:19:56.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f0247e00700 1 -- 172.21.15.49:0/2940280134 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02400207f0 con 0x1e51540 2024-01-22T05:19:56.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f026990b740 1 -- 172.21.15.49:0/2940280134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e51540 msgr2=0x1e519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f026990b740 1 --2- 172.21.15.49:0/2940280134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e51540 0x1e519c0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7f024000f750 tx=0x7f0240013000).stop 2024-01-22T05:19:56.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f026990b740 1 -- 172.21.15.49:0/2940280134 shutdown_connections 2024-01-22T05:19:56.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f026990b740 1 --2- 172.21.15.49:0/2940280134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e4b0d0 0x1e4b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f026990b740 1 --2- 172.21.15.49:0/2940280134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e51540 0x1e519c0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f026990b740 1 --2- 172.21.15.49:0/2940280134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e96b10 0x1e96ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f026990b740 1 -- 172.21.15.49:0/2940280134 >> 172.21.15.49:0/2940280134 conn(0x1c317f0 msgr2=0x1e502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f026990b740 1 -- 172.21.15.49:0/2940280134 shutdown_connections 2024-01-22T05:19:56.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f026990b740 1 -- 172.21.15.49:0/2940280134 wait complete. 2024-01-22T05:19:56.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.511+0000 7f026990b740 1 -- start start 2024-01-22T05:19:56.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.515+0000 7f026990b740 1 Processor -- start 2024-01-22T05:19:56.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.515+0000 7f026990b740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e4b0d0 0x1ea3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.515+0000 7f026990b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e51540 0x1e7dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.515+0000 7f026990b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e96b10 0x1e7c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.515+0000 7f026990b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e92640 con 0x1e96b10 2024-01-22T05:19:56.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.515+0000 7f026990b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ea48a0 con 0x1e51540 2024-01-22T05:19:56.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.515+0000 7f026990b740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e7e5a0 con 0x1e4b0d0 2024-01-22T05:19:56.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.515+0000 7f026990b740 10 client.0 ll_register_callbacks cb 0x1dc9710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:19:56.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.515+0000 7f025d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e96b10 0x1e7c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.515+0000 7f025d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e96b10 0x1e7c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48074/0 (socket says 172.21.15.49:48074) 2024-01-22T05:19:56.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.515+0000 7f025d400700 1 -- 172.21.15.49:0/3614358706 learned_addr learned my addr 172.21.15.49:0/3614358706 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.515+0000 7f025ca00700 1 --2- 172.21.15.49:0/3614358706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e4b0d0 0x1ea3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.515+0000 7f0257e00700 1 --2- 172.21.15.49:0/3614358706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e51540 0x1e7dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f025d400700 1 -- 172.21.15.49:0/3614358706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e4b0d0 msgr2=0x1ea3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f025d400700 1 --2- 172.21.15.49:0/3614358706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e4b0d0 0x1ea3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f025d400700 1 -- 172.21.15.49:0/3614358706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e51540 msgr2=0x1e7dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f025d400700 1 --2- 172.21.15.49:0/3614358706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e51540 0x1e7dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f025d400700 1 -- 172.21.15.49:0/3614358706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02380033f0 con 0x1e96b10 2024-01-22T05:19:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f0257e00700 1 --2- 172.21.15.49:0/3614358706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e51540 0x1e7dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f025d400700 1 --2- 172.21.15.49:0/3614358706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e96b10 0x1e7c5d0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7f0250011000 tx=0x7f02580a8a80).ready entity=mon.0 client_cookie=a5086cbc84169a76 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f0244c00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:19:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f0244c00700 1 -- 172.21.15.49:0/3614358706 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025001f410 con 0x1e96b10 2024-01-22T05:19:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f0244c00700 1 -- 172.21.15.49:0/3614358706 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f025001f570 con 0x1e96b10 2024-01-22T05:19:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f026990b740 1 -- 172.21.15.49:0/3614358706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1dc9300 con 0x1e96b10 2024-01-22T05:19:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f0244c00700 1 -- 172.21.15.49:0/3614358706 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7f025001f730 con 0x1e96b10 2024-01-22T05:19:56.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f026990b740 10 client.10734 fetch_fsmap learned FSMap version 157 2024-01-22T05:19:56.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f026990b740 1 -- 172.21.15.49:0/3614358706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x1dc7ac0 con 0x1e96b10 2024-01-22T05:19:56.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f0244c00700 1 -- 172.21.15.49:0/3614358706 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1dc9300 con 0x1e96b10 2024-01-22T05:19:56.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f0244c00700 1 -- 172.21.15.49:0/3614358706 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f025001f890 con 0x1e96b10 2024-01-22T05:19:56.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f026990b740 10 client.10734 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:19:56.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f026990b740 10 client.10734 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-01-22T05:19:56.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f026990b740 20 client.10734 populate_metadata read hostname 'smithi049' 2024-01-22T05:19:56.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f026990b740 1 --2- 172.21.15.49:0/3614358706 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1e754d0 0x1e76330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f026990b740 4 client.10734 mds_command: new command op to 10656 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:19:56.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f026990b740 1 -- 172.21.15.49:0/3614358706 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1dbf850 con 0x1e754d0 2024-01-22T05:19:56.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f025ca00700 1 --2- 172.21.15.49:0/3614358706 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1e754d0 0x1e76330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f025ca00700 1 --2- 172.21.15.49:0/3614358706 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1e754d0 0x1e76330 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c002d78ff524136c server_cookie=313d0b6d787f0bf5 in_seq=0 out_seq=0 2024-01-22T05:19:56.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.519+0000 7f0244c00700 10 client.10734 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:19:56.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.523+0000 7f0244c00700 1 -- 172.21.15.49:0/3614358706 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1dbf850 con 0x1e754d0 2024-01-22T05:19:56.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.523+0000 7f0244c00700 10 client.10734 handle_command_reply: tid=0 2024-01-22T05:19:56.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.523+0000 7f026990b740 1 client.10734 shutdown 2024-01-22T05:19:56.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.523+0000 7f026990b740 1 -- 172.21.15.49:0/3614358706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e96b10 msgr2=0x1e7c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.523+0000 7f026990b740 1 --2- 172.21.15.49:0/3614358706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e96b10 0x1e7c5d0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7f0250011000 tx=0x7f02580a8a80).stop 2024-01-22T05:19:56.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.523+0000 7f026990b740 1 -- 172.21.15.49:0/3614358706 shutdown_connections 2024-01-22T05:19:56.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.523+0000 7f026990b740 1 --2- 172.21.15.49:0/3614358706 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1e754d0 0x1e76330 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.523+0000 7f026990b740 1 --2- 172.21.15.49:0/3614358706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e96b10 0x1e7c5d0 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.523+0000 7f026990b740 1 --2- 172.21.15.49:0/3614358706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e51540 0x1e7dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.523+0000 7f026990b740 1 --2- 172.21.15.49:0/3614358706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e4b0d0 0x1ea3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.523+0000 7f026990b740 1 -- 172.21.15.49:0/3614358706 >> 172.21.15.49:0/3614358706 conn(0x1c317f0 msgr2=0x1e98e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.523+0000 7f0244c00700 0 client.10734 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:19:56.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.523+0000 7f026990b740 1 -- 172.21.15.49:0/3614358706 shutdown_connections 2024-01-22T05:19:56.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.523+0000 7f026990b740 1 -- 172.21.15.49:0/3614358706 wait complete. 2024-01-22T05:19:56.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.523+0000 7f026990b740 20 client.10734 trim_cache size 0 max 16384 2024-01-22T05:19:56.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.543+0000 7f026990b740 1 Processor -- start 2024-01-22T05:19:56.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.543+0000 7f026990b740 1 -- start start 2024-01-22T05:19:56.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.543+0000 7f026990b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e4b0d0 0x1e7cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.543+0000 7f026990b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e51540 0x1e79d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.543+0000 7f026990b740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e96b10 0x1e7a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.543+0000 7f026990b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e7e890 con 0x1e4b0d0 2024-01-22T05:19:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f026990b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e96ef0 con 0x1e51540 2024-01-22T05:19:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f026990b740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e164c0 con 0x1e96b10 2024-01-22T05:19:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f025ca00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e4b0d0 0x1e7cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f025d400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e96b10 0x1e7a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f025d400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e96b10 0x1e7a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:36832/0 (socket says 172.21.15.49:36832) 2024-01-22T05:19:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f025d400700 1 -- 172.21.15.49:0/663008540 learned_addr learned my addr 172.21.15.49:0/663008540 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f0257e00700 1 --2- 172.21.15.49:0/663008540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e51540 0x1e79d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f025d400700 1 -- 172.21.15.49:0/663008540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e51540 msgr2=0x1e79d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f025d400700 1 --2- 172.21.15.49:0/663008540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e51540 0x1e79d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f025d400700 1 -- 172.21.15.49:0/663008540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e4b0d0 msgr2=0x1e7cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f025d400700 1 --2- 172.21.15.49:0/663008540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e4b0d0 0x1e7cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f025d400700 1 -- 172.21.15.49:0/663008540 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025814fd60 con 0x1e96b10 2024-01-22T05:19:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f025d400700 1 --2- 172.21.15.49:0/663008540 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e96b10 0x1e7a270 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f02500094c0 tx=0x7f0250021070).ready entity=mon.2 client_cookie=99d691a2c48eeb76 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f024d200700 1 -- 172.21.15.49:0/663008540 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250012410 con 0x1e96b10 2024-01-22T05:19:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f024d200700 1 -- 172.21.15.49:0/663008540 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025001fd50 con 0x1e96b10 2024-01-22T05:19:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f024d200700 1 -- 172.21.15.49:0/663008540 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025001f620 con 0x1e96b10 2024-01-22T05:19:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f026990b740 1 -- 172.21.15.49:0/663008540 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e96b10 msgr2=0x1e7a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f026990b740 1 --2- 172.21.15.49:0/663008540 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e96b10 0x1e7a270 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f02500094c0 tx=0x7f0250021070).stop 2024-01-22T05:19:56.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f026990b740 1 -- 172.21.15.49:0/663008540 shutdown_connections 2024-01-22T05:19:56.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f026990b740 1 --2- 172.21.15.49:0/663008540 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e96b10 0x1e7a270 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f026990b740 1 --2- 172.21.15.49:0/663008540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e51540 0x1e79d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f026990b740 1 --2- 172.21.15.49:0/663008540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e4b0d0 0x1e7cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f026990b740 1 -- 172.21.15.49:0/663008540 >> 172.21.15.49:0/663008540 conn(0x1c317f0 msgr2=0x1e77050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f026990b740 1 -- 172.21.15.49:0/663008540 shutdown_connections 2024-01-22T05:19:56.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.547+0000 7f026990b740 1 -- 172.21.15.49:0/663008540 wait complete. 2024-01-22T05:19:56.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.551+0000 7f026990b740 1 -- start start 2024-01-22T05:19:56.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.551+0000 7f026990b740 1 Processor -- start 2024-01-22T05:19:56.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.551+0000 7f026990b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e4b0d0 0x1efde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.551+0000 7f026990b740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e51540 0x1e944b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.551+0000 7f026990b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e96b10 0x1eb26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.551+0000 7f026990b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1eb3f30 con 0x1e96b10 2024-01-22T05:19:56.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.551+0000 7f026990b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e4c440 con 0x1e4b0d0 2024-01-22T05:19:56.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.551+0000 7f026990b740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e7b540 con 0x1e51540 2024-01-22T05:19:56.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.551+0000 7f026990b740 10 client.0 ll_register_callbacks cb 0x7f0250012620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:19:56.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.551+0000 7f025d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e96b10 0x1eb26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.551+0000 7f025d400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e96b10 0x1eb26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48096/0 (socket says 172.21.15.49:48096) 2024-01-22T05:19:56.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f025d400700 1 -- 172.21.15.49:0/3665178999 learned_addr learned my addr 172.21.15.49:0/3665178999 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f0257e00700 1 --2- 172.21.15.49:0/3665178999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e51540 0x1e944b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f025ca00700 1 --2- 172.21.15.49:0/3665178999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e4b0d0 0x1efde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f025d400700 1 -- 172.21.15.49:0/3665178999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e51540 msgr2=0x1e944b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f025d400700 1 --2- 172.21.15.49:0/3665178999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e51540 0x1e944b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f025d400700 1 -- 172.21.15.49:0/3665178999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e4b0d0 msgr2=0x1efde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f025d400700 1 --2- 172.21.15.49:0/3665178999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e4b0d0 0x1efde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f025d400700 1 -- 172.21.15.49:0/3665178999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1dc7ac0 con 0x1e96b10 2024-01-22T05:19:56.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f025d400700 1 --2- 172.21.15.49:0/3665178999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e96b10 0x1eb26c0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7f025000b7c0 tx=0x7f0250034070).ready entity=mon.0 client_cookie=e93fbfea0ba5f908 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f0244c00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:19:56.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f0244c00700 1 -- 172.21.15.49:0/3665178999 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250012b70 con 0x1e96b10 2024-01-22T05:19:56.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f026990b740 1 -- 172.21.15.49:0/3665178999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0240020450 con 0x1e96b10 2024-01-22T05:19:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f0244c00700 1 -- 172.21.15.49:0/3665178999 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f0250012cd0 con 0x1e96b10 2024-01-22T05:19:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f0244c00700 1 -- 172.21.15.49:0/3665178999 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0250028670 con 0x1e96b10 2024-01-22T05:19:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f026990b740 10 client.10740 fetch_fsmap learned FSMap version 157 2024-01-22T05:19:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f026990b740 1 -- 172.21.15.49:0/3665178999 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x1dc7810 con 0x1e96b10 2024-01-22T05:19:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f0244c00700 1 -- 172.21.15.49:0/3665178999 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0240020450 con 0x1e96b10 2024-01-22T05:19:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f0244c00700 1 -- 172.21.15.49:0/3665178999 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f02500287d0 con 0x1e96b10 2024-01-22T05:19:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f026990b740 10 client.10740 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:19:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f026990b740 10 client.10740 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-01-22T05:19:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f026990b740 20 client.10740 populate_metadata read hostname 'smithi049' 2024-01-22T05:19:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f026990b740 1 --2- 172.21.15.49:0/3665178999 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1e94d10 0x1eb2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f026990b740 4 client.10740 mds_command: new command op to 10656 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-01-22T05:19:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f026990b740 1 -- 172.21.15.49:0/3665178999 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) v1 -- 0x1c88780 con 0x1e94d10 2024-01-22T05:19:56.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.555+0000 7f025ca00700 1 --2- 172.21.15.49:0/3665178999 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1e94d10 0x1eb2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f0244c00700 10 client.10740 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:19:56.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f025ca00700 1 --2- 172.21.15.49:0/3665178999 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1e94d10 0x1eb2bb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ae9628124debcd1f server_cookie=c19edefb440a3ca6 in_seq=0 out_seq=0 2024-01-22T05:19:56.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f0244c00700 1 -- 172.21.15.49:0/3665178999 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1c88780 con 0x1e94d10 2024-01-22T05:19:56.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f0244c00700 10 client.10740 handle_command_reply: tid=0 2024-01-22T05:19:56.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f026990b740 1 client.10740 shutdown 2024-01-22T05:19:56.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f026990b740 1 -- 172.21.15.49:0/3665178999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e96b10 msgr2=0x1eb26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f026990b740 1 --2- 172.21.15.49:0/3665178999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e96b10 0x1eb26c0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7f025000b7c0 tx=0x7f0250034070).stop 2024-01-22T05:19:56.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f026990b740 1 -- 172.21.15.49:0/3665178999 shutdown_connections 2024-01-22T05:19:56.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f026990b740 1 --2- 172.21.15.49:0/3665178999 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1e94d10 0x1eb2bb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f026990b740 1 --2- 172.21.15.49:0/3665178999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1e96b10 0x1eb26c0 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f026990b740 1 --2- 172.21.15.49:0/3665178999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1e51540 0x1e944b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f026990b740 1 --2- 172.21.15.49:0/3665178999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1e4b0d0 0x1efde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f026990b740 1 -- 172.21.15.49:0/3665178999 >> 172.21.15.49:0/3665178999 conn(0x1c317f0 msgr2=0x1e72580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f0244c00700 0 client.10740 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:19:56.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f026990b740 1 -- 172.21.15.49:0/3665178999 shutdown_connections 2024-01-22T05:19:56.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.559+0000 7f026990b740 1 -- 172.21.15.49:0/3665178999 wait complete. 2024-01-22T05:19:56.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.563+0000 7f026990b740 20 client.10740 trim_cache size 0 max 16384 2024-01-22T05:19:56.563 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:19:56.563 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:19:56.563 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "2daacdba-ba54-4b1e-b237-55843c1c7930", 2024-01-22T05:19:56.563 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:19:56.563 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:19:56.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.563+0000 7f025f400700 1 -- 172.21.15.49:0/1474901316 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f023005a510 msgr2=0x7f023005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.563+0000 7f025f400700 1 --2- 172.21.15.49:0/1474901316 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f023005a510 0x7f023005c9d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f0240007fd0 tx=0x7f0240009040).stop 2024-01-22T05:19:56.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.563+0000 7f025f400700 1 -- 172.21.15.49:0/1474901316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258066690 msgr2=0x7f025814a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.563+0000 7f025f400700 1 --2- 172.21.15.49:0/1474901316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258066690 0x7f025814a2f0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7f024800c5c0 tx=0x7f0248007c90).stop 2024-01-22T05:19:56.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.563+0000 7f025f400700 1 -- 172.21.15.49:0/1474901316 shutdown_connections 2024-01-22T05:19:56.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.563+0000 7f025f400700 1 --2- 172.21.15.49:0/1474901316 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f023005a510 0x7f023005c9d0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.563+0000 7f025f400700 1 --2- 172.21.15.49:0/1474901316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0258160bd0 0x7f02580c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.563+0000 7f025f400700 1 --2- 172.21.15.49:0/1474901316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02580ac3b0 0x7f02580c2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.563+0000 7f025f400700 1 --2- 172.21.15.49:0/1474901316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258066690 0x7f025814a2f0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.563+0000 7f025f400700 1 -- 172.21.15.49:0/1474901316 >> 172.21.15.49:0/1474901316 conn(0x7f02580c6500 msgr2=0x7f025814bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.563+0000 7f025f400700 1 -- 172.21.15.49:0/1474901316 shutdown_connections 2024-01-22T05:19:56.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.563+0000 7f025f400700 1 -- 172.21.15.49:0/1474901316 wait complete. 2024-01-22T05:19:56.586 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub status 2024-01-22T05:19:56.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.755+0000 7f88f8200700 1 Processor -- start 2024-01-22T05:19:56.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.755+0000 7f88f8200700 1 -- start start 2024-01-22T05:19:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.759+0000 7f88f8200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f88f0139550 0x7f88f01399e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.759+0000 7f88f8200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88f00c1730 0x7f88f00c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.759+0000 7f88f8200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f00648d0 con 0x7f88f0154660 2024-01-22T05:19:56.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.759+0000 7f88f8200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f0139ed0 con 0x7f88f0139550 2024-01-22T05:19:56.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.759+0000 7f88f8200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0063d50 con 0x7f88f00c1730 2024-01-22T05:19:56.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.759+0000 7f88f5800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f88f0154660 0x7f88f0068c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58814/0 (socket says 172.21.15.49:58814) 2024-01-22T05:19:56.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.759+0000 7f88f5800700 1 -- 172.21.15.49:0/3835084490 learned_addr learned my addr 172.21.15.49:0/3835084490 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:19:56.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.759+0000 7f88f4e00700 1 --2- 172.21.15.49:0/3835084490 >> v2:172.21.15.110:3300/0 conn(0x7f88f0139550 0x7f88f01399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.759+0000 7f88f6200700 1 --2- 172.21.15.49:0/3835084490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88f00c1730 0x7f88f00c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.759+0000 7f88efe00700 1 -- 172.21.15.49:0/3835084490 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798912363 0 0) 0x7f88f00648d0 con 0x7f88f0154660 2024-01-22T05:19:56.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.759+0000 7f88efe00700 1 -- 172.21.15.49:0/3835084490 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88d00033f0 con 0x7f88f0154660 2024-01-22T05:19:56.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.763+0000 7f88f4e00700 1 -- 172.21.15.49:0/3835084490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88f00c1730 msgr2=0x7f88f00c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.763+0000 7f88f4e00700 1 --2- 172.21.15.49:0/3835084490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88f00c1730 0x7f88f00c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.763+0000 7f88efe00700 1 -- 172.21.15.49:0/3835084490 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3823387912 0 0) 0x7f88d00033f0 con 0x7f88f0154660 2024-01-22T05:19:56.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.763+0000 7f88f4e00700 1 -- 172.21.15.49:0/3835084490 >> v1:172.21.15.49:6789/0 conn(0x7f88f0154660 legacy=0x7f88f0068c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.763+0000 7f88f4e00700 1 -- 172.21.15.49:0/3835084490 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f0064030 con 0x7f88f0139550 2024-01-22T05:19:56.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.763+0000 7f88f4e00700 1 --2- 172.21.15.49:0/3835084490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88f0139550 0x7f88f01399e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f88d8009790 tx=0x7f88d8009060).ready entity=mon.1 client_cookie=44280a88b0f83177 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.763+0000 7f88efe00700 1 -- 172.21.15.49:0/3835084490 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0001470 con 0x7f88f0139550 2024-01-22T05:19:56.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.763+0000 7f88efe00700 1 -- 172.21.15.49:0/3835084490 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d8011400 con 0x7f88f0139550 2024-01-22T05:19:56.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.763+0000 7f88efe00700 1 -- 172.21.15.49:0/3835084490 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8011780 con 0x7f88f0139550 2024-01-22T05:19:56.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.763+0000 7f88f8200700 1 -- 172.21.15.49:0/3835084490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88f0139550 msgr2=0x7f88f01399e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.763+0000 7f88f8200700 1 --2- 172.21.15.49:0/3835084490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88f0139550 0x7f88f01399e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f88d8009790 tx=0x7f88d8009060).stop 2024-01-22T05:19:56.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.763+0000 7f88f8200700 1 -- 172.21.15.49:0/3835084490 shutdown_connections 2024-01-22T05:19:56.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.763+0000 7f88f8200700 1 --2- 172.21.15.49:0/3835084490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88f00c1730 0x7f88f00c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.763+0000 7f88f8200700 1 --2- 172.21.15.49:0/3835084490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88f0139550 0x7f88f01399e0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.763+0000 7f88f8200700 1 -- 172.21.15.49:0/3835084490 >> 172.21.15.49:0/3835084490 conn(0x7f88f0065f30 msgr2=0x7f88f0066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.767+0000 7f88f8200700 1 -- 172.21.15.49:0/3835084490 shutdown_connections 2024-01-22T05:19:56.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.767+0000 7f88f8200700 1 -- 172.21.15.49:0/3835084490 wait complete. 2024-01-22T05:19:56.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.767+0000 7f88f8200700 1 Processor -- start 2024-01-22T05:19:56.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f8200700 1 -- start start 2024-01-22T05:19:56.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f8200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88f00c1730 0x7f88f014f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f8200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88f0139550 0x7f88f00a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f8200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f0154660 0x7f88f00a8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f8200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f00a7390 con 0x7f88f0154660 2024-01-22T05:19:56.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f8200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f00a8140 con 0x7f88f00c1730 2024-01-22T05:19:56.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f8200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f00a7570 con 0x7f88f0139550 2024-01-22T05:19:56.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f6200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f0154660 0x7f88f00a8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f6200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f0154660 0x7f88f00a8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48108/0 (socket says 172.21.15.49:48108) 2024-01-22T05:19:56.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f6200700 1 -- 172.21.15.49:0/3579387329 learned_addr learned my addr 172.21.15.49:0/3579387329 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f4e00700 1 --2- 172.21.15.49:0/3579387329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88f0139550 0x7f88f00a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f5800700 1 --2- 172.21.15.49:0/3579387329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88f00c1730 0x7f88f014f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f6200700 1 -- 172.21.15.49:0/3579387329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88f0139550 msgr2=0x7f88f00a85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f6200700 1 --2- 172.21.15.49:0/3579387329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88f0139550 0x7f88f00a85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f6200700 1 -- 172.21.15.49:0/3579387329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88f00c1730 msgr2=0x7f88f014f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f6200700 1 --2- 172.21.15.49:0/3579387329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88f00c1730 0x7f88f014f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f6200700 1 -- 172.21.15.49:0/3579387329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d80092a0 con 0x7f88f0154660 2024-01-22T05:19:56.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.771+0000 7f88f5800700 1 --2- 172.21.15.49:0/3579387329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88f00c1730 0x7f88f014f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:19:56.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.775+0000 7f88f6200700 1 --2- 172.21.15.49:0/3579387329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f0154660 0x7f88f00a8ac0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 rx=0x7f88e8009e20 tx=0x7f88e800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.775+0000 7f88ecc00700 1 -- 172.21.15.49:0/3579387329 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e800cb50 con 0x7f88f0154660 2024-01-22T05:19:56.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.775+0000 7f88ecc00700 1 -- 172.21.15.49:0/3579387329 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e800f040 con 0x7f88f0154660 2024-01-22T05:19:56.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.775+0000 7f88ecc00700 1 -- 172.21.15.49:0/3579387329 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e800cec0 con 0x7f88f0154660 2024-01-22T05:19:56.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.775+0000 7f88f8200700 1 -- 172.21.15.49:0/3579387329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f00a7810 con 0x7f88f0154660 2024-01-22T05:19:56.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.775+0000 7f88f8200700 1 -- 172.21.15.49:0/3579387329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f00a7dd0 con 0x7f88f0154660 2024-01-22T05:19:56.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.779+0000 7f88ecc00700 1 -- 172.21.15.49:0/3579387329 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f88e8013610 con 0x7f88f0154660 2024-01-22T05:19:56.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.779+0000 7f88ecc00700 1 --2- 172.21.15.49:0/3579387329 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f88c805a510 0x7f88c805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.779+0000 7f88ecc00700 1 -- 172.21.15.49:0/3579387329 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f88e80750f0 con 0x7f88f0154660 2024-01-22T05:19:56.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.779+0000 7f88f5800700 1 --2- 172.21.15.49:0/3579387329 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f88c805a510 0x7f88c805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.779+0000 7f88f5800700 1 --2- 172.21.15.49:0/3579387329 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f88c805a510 0x7f88c805c9d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f88e00011e0 tx=0x7f88e0001aa0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.783+0000 7f89025e5740 1 Processor -- start 2024-01-22T05:19:56.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.783+0000 7f89025e5740 1 -- start start 2024-01-22T05:19:56.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f89025e5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 0x22fcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f89025e5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2328690 0x2346180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f89025e5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2346670 0x23439a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f89025e5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x225f540 con 0x2328690 2024-01-22T05:19:56.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f89025e5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2222e90 con 0x2345da0 2024-01-22T05:19:56.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f89025e5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2228d90 con 0x2346670 2024-01-22T05:19:56.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f88f4e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2328690 0x2346180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f88f4e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2328690 0x2346180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48112/0 (socket says 172.21.15.49:48112) 2024-01-22T05:19:56.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f88f4e00700 1 -- 172.21.15.49:0/2962633340 learned_addr learned my addr 172.21.15.49:0/2962633340 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f88f5800700 1 --2- 172.21.15.49:0/2962633340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 0x22fcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f88f6200700 1 --2- 172.21.15.49:0/2962633340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2346670 0x23439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f88f4e00700 1 -- 172.21.15.49:0/2962633340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2346670 msgr2=0x23439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f88f4e00700 1 --2- 172.21.15.49:0/2962633340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2346670 0x23439a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f88f4e00700 1 -- 172.21.15.49:0/2962633340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 msgr2=0x22fcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f88f4e00700 1 --2- 172.21.15.49:0/2962633340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 0x22fcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f88f4e00700 1 -- 172.21.15.49:0/2962633340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x228d4c0 con 0x2328690 2024-01-22T05:19:56.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f88f4e00700 1 --2- 172.21.15.49:0/2962633340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2328690 0x2346180 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7f88d8006cd0 tx=0x7f88d8016000).ready entity=mon.0 client_cookie=292da6764361b10 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f88e5600700 1 -- 172.21.15.49:0/2962633340 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8011570 con 0x2328690 2024-01-22T05:19:56.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f88e5600700 1 -- 172.21.15.49:0/2962633340 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d8022070 con 0x2328690 2024-01-22T05:19:56.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f88e5600700 1 -- 172.21.15.49:0/2962633340 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80116d0 con 0x2328690 2024-01-22T05:19:56.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f89025e5740 1 -- 172.21.15.49:0/2962633340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2328690 msgr2=0x2346180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f89025e5740 1 --2- 172.21.15.49:0/2962633340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2328690 0x2346180 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7f88d8006cd0 tx=0x7f88d8016000).stop 2024-01-22T05:19:56.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f89025e5740 1 -- 172.21.15.49:0/2962633340 shutdown_connections 2024-01-22T05:19:56.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f89025e5740 1 --2- 172.21.15.49:0/2962633340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2346670 0x23439a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f89025e5740 1 --2- 172.21.15.49:0/2962633340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2328690 0x2346180 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f89025e5740 1 --2- 172.21.15.49:0/2962633340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 0x22fcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f89025e5740 1 -- 172.21.15.49:0/2962633340 >> 172.21.15.49:0/2962633340 conn(0x20e1680 msgr2=0x2300de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f89025e5740 1 -- 172.21.15.49:0/2962633340 shutdown_connections 2024-01-22T05:19:56.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.787+0000 7f89025e5740 1 -- 172.21.15.49:0/2962633340 wait complete. 2024-01-22T05:19:56.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.791+0000 7f89025e5740 1 -- start start 2024-01-22T05:19:56.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.791+0000 7f89025e5740 1 Processor -- start 2024-01-22T05:19:56.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f89025e5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2328690 0x235cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f89025e5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 0x2327330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f89025e5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2346670 0x232d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f89025e5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2327820 con 0x2346670 2024-01-22T05:19:56.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f89025e5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x232a630 con 0x2345da0 2024-01-22T05:19:56.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f89025e5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2343350 con 0x2328690 2024-01-22T05:19:56.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f89025e5740 10 client.0 ll_register_callbacks cb 0x22b95d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:19:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88f6200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2346670 0x232d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88f6200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2346670 0x232d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48114/0 (socket says 172.21.15.49:48114) 2024-01-22T05:19:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88f6200700 1 -- 172.21.15.49:0/4043315486 learned_addr learned my addr 172.21.15.49:0/4043315486 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88f4e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 0x2327330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88f5800700 1 --2- 172.21.15.49:0/4043315486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2328690 0x235cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88f6200700 1 -- 172.21.15.49:0/4043315486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2328690 msgr2=0x235cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88f6200700 1 --2- 172.21.15.49:0/4043315486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2328690 0x235cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88f6200700 1 -- 172.21.15.49:0/4043315486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 msgr2=0x2327330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88f6200700 1 --2- 172.21.15.49:0/4043315486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 0x2327330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88f6200700 1 -- 172.21.15.49:0/4043315486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f0064030 con 0x2346670 2024-01-22T05:19:56.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88f4e00700 1 --2- 172.21.15.49:0/4043315486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 0x2327330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:56.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88f6200700 1 --2- 172.21.15.49:0/4043315486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2346670 0x232d800 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 rx=0x7f88e80734b0 tx=0x7f88e8009780).ready entity=mon.0 client_cookie=263cd4d5ae7f70bc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88de000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:19:56.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88de000700 1 -- 172.21.15.49:0/4043315486 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8051070 con 0x2346670 2024-01-22T05:19:56.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88de000700 1 -- 172.21.15.49:0/4043315486 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f88e80481d0 con 0x2346670 2024-01-22T05:19:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f89025e5740 1 -- 172.21.15.49:0/4043315486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2279230 con 0x2346670 2024-01-22T05:19:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88de000700 1 -- 172.21.15.49:0/4043315486 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88e804c150 con 0x2346670 2024-01-22T05:19:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f89025e5740 10 client.10752 fetch_fsmap learned FSMap version 157 2024-01-22T05:19:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f89025e5740 1 -- 172.21.15.49:0/4043315486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x227c7c0 con 0x2346670 2024-01-22T05:19:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88de000700 1 -- 172.21.15.49:0/4043315486 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2279230 con 0x2346670 2024-01-22T05:19:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f88de000700 1 -- 172.21.15.49:0/4043315486 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f88e8058060 con 0x2346670 2024-01-22T05:19:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f89025e5740 10 client.10752 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:19:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f89025e5740 10 client.10752 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-01-22T05:19:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f89025e5740 20 client.10752 populate_metadata read hostname 'smithi049' 2024-01-22T05:19:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.795+0000 7f89025e5740 1 --2- 172.21.15.49:0/4043315486 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x232c1e0 0x232c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f89025e5740 4 client.10752 mds_command: new command op to 10656 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:19:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f89025e5740 1 -- 172.21.15.49:0/4043315486 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x226f780 con 0x232c1e0 2024-01-22T05:19:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f88f5800700 1 --2- 172.21.15.49:0/4043315486 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x232c1e0 0x232c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f88f5800700 1 --2- 172.21.15.49:0/4043315486 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x232c1e0 0x232c5f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1bba117ababb5ca6 server_cookie=18cc04d91174ccd0 in_seq=0 out_seq=0 2024-01-22T05:19:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f88de000700 10 client.10752 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:19:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f88de000700 1 -- 172.21.15.49:0/4043315486 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x226f780 con 0x232c1e0 2024-01-22T05:19:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f88de000700 10 client.10752 handle_command_reply: tid=0 2024-01-22T05:19:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f89025e5740 1 client.10752 shutdown 2024-01-22T05:19:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f89025e5740 1 -- 172.21.15.49:0/4043315486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2346670 msgr2=0x232d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f89025e5740 1 --2- 172.21.15.49:0/4043315486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2346670 0x232d800 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 rx=0x7f88e80734b0 tx=0x7f88e8009780).stop 2024-01-22T05:19:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f89025e5740 1 -- 172.21.15.49:0/4043315486 shutdown_connections 2024-01-22T05:19:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f89025e5740 1 --2- 172.21.15.49:0/4043315486 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x232c1e0 0x232c5f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f89025e5740 1 --2- 172.21.15.49:0/4043315486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2346670 0x232d800 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f89025e5740 1 --2- 172.21.15.49:0/4043315486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 0x2327330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f89025e5740 1 --2- 172.21.15.49:0/4043315486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2328690 0x235cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f88de000700 0 client.10752 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:19:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.799+0000 7f89025e5740 1 -- 172.21.15.49:0/4043315486 >> 172.21.15.49:0/4043315486 conn(0x20e1680 msgr2=0x22fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.803+0000 7f89025e5740 1 -- 172.21.15.49:0/4043315486 shutdown_connections 2024-01-22T05:19:56.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.803+0000 7f89025e5740 1 -- 172.21.15.49:0/4043315486 wait complete. 2024-01-22T05:19:56.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.803+0000 7f89025e5740 20 client.10752 trim_cache size 0 max 16384 2024-01-22T05:19:56.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.819+0000 7f89025e5740 1 Processor -- start 2024-01-22T05:19:56.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.819+0000 7f89025e5740 1 -- start start 2024-01-22T05:19:56.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.819+0000 7f89025e5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2328690 0x234a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.819+0000 7f89025e5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2345da0 0x22fcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.819+0000 7f89025e5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2346670 0x232e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.819+0000 7f89025e5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x22c5040 con 0x2346670 2024-01-22T05:19:56.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.819+0000 7f89025e5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x234a050 con 0x2328690 2024-01-22T05:19:56.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.819+0000 7f89025e5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2279230 con 0x2345da0 2024-01-22T05:19:56.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.819+0000 7f88f6200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2346670 0x232e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.819+0000 7f88f5800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2328690 0x234a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.819+0000 7f88f4e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2345da0 0x22fcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.819+0000 7f88f5800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2328690 0x234a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:55344/0 (socket says 172.21.15.49:55344) 2024-01-22T05:19:56.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.819+0000 7f88f6200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2346670 0x232e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48124/0 (socket says 172.21.15.49:48124) 2024-01-22T05:19:56.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.819+0000 7f88f5800700 1 -- 172.21.15.49:0/2579380258 learned_addr learned my addr 172.21.15.49:0/2579380258 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f88f5800700 1 -- 172.21.15.49:0/2579380258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2345da0 msgr2=0x22fcf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f88f5800700 1 --2- 172.21.15.49:0/2579380258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2345da0 0x22fcf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f88f5800700 1 -- 172.21.15.49:0/2579380258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2346670 msgr2=0x232e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f88f5800700 1 --2- 172.21.15.49:0/2579380258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2346670 0x232e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f88f5800700 1 -- 172.21.15.49:0/2579380258 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2327690 con 0x2328690 2024-01-22T05:19:56.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f88f5800700 1 --2- 172.21.15.49:0/2579380258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2328690 0x234a280 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f88e0001db0 tx=0x7f88e0009000).ready entity=mon.1 client_cookie=d38036b7bf14ec9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f88e6000700 1 -- 172.21.15.49:0/2579380258 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0027030 con 0x2328690 2024-01-22T05:19:56.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f88e6000700 1 -- 172.21.15.49:0/2579380258 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e001e040 con 0x2328690 2024-01-22T05:19:56.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f88e6000700 1 -- 172.21.15.49:0/2579380258 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0005240 con 0x2328690 2024-01-22T05:19:56.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f89025e5740 1 -- 172.21.15.49:0/2579380258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2328690 msgr2=0x234a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f89025e5740 1 --2- 172.21.15.49:0/2579380258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2328690 0x234a280 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f88e0001db0 tx=0x7f88e0009000).stop 2024-01-22T05:19:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f89025e5740 1 -- 172.21.15.49:0/2579380258 shutdown_connections 2024-01-22T05:19:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f89025e5740 1 --2- 172.21.15.49:0/2579380258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2346670 0x232e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f89025e5740 1 --2- 172.21.15.49:0/2579380258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2345da0 0x22fcf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f89025e5740 1 --2- 172.21.15.49:0/2579380258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2328690 0x234a280 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f89025e5740 1 -- 172.21.15.49:0/2579380258 >> 172.21.15.49:0/2579380258 conn(0x20e1680 msgr2=0x2300db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f89025e5740 1 -- 172.21.15.49:0/2579380258 shutdown_connections 2024-01-22T05:19:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.823+0000 7f89025e5740 1 -- 172.21.15.49:0/2579380258 wait complete. 2024-01-22T05:19:56.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.827+0000 7f89025e5740 1 -- start start 2024-01-22T05:19:56.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.827+0000 7f89025e5740 1 Processor -- start 2024-01-22T05:19:56.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f89025e5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2328690 0x23261d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f89025e5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 0x23983c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f89025e5740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2346670 0x23988b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f89025e5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2343960 con 0x2328690 2024-01-22T05:19:56.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f89025e5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2343dc0 con 0x2345da0 2024-01-22T05:19:56.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f89025e5740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2351ca0 con 0x2346670 2024-01-22T05:19:56.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f89025e5740 10 client.0 ll_register_callbacks cb 0x7f88e804c010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:19:56.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f88f5800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2328690 0x23261d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f88f5800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2328690 0x23261d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48132/0 (socket says 172.21.15.49:48132) 2024-01-22T05:19:56.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f88f5800700 1 -- 172.21.15.49:0/2304363678 learned_addr learned my addr 172.21.15.49:0/2304363678 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:19:56.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f88f4e00700 1 --2- 172.21.15.49:0/2304363678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 0x23983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f88f6200700 1 --2- 172.21.15.49:0/2304363678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2346670 0x23988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f88f5800700 1 -- 172.21.15.49:0/2304363678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2346670 msgr2=0x23988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f88f5800700 1 --2- 172.21.15.49:0/2304363678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2346670 0x23988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f88f5800700 1 -- 172.21.15.49:0/2304363678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 msgr2=0x23983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:19:56.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f88f5800700 1 --2- 172.21.15.49:0/2304363678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 0x23983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f88f5800700 1 -- 172.21.15.49:0/2304363678 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e000f040 con 0x2328690 2024-01-22T05:19:56.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f88f6200700 1 --2- 172.21.15.49:0/2304363678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2346670 0x23988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:56.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f88f4e00700 1 --2- 172.21.15.49:0/2304363678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 0x23983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:19:56.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f88f5800700 1 --2- 172.21.15.49:0/2304363678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2328690 0x23261d0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 rx=0x7f88e0000de0 tx=0x7f88e001a070).ready entity=mon.0 client_cookie=ae199a526d61931f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:19:56.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.831+0000 7f88de000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:19:56.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f88de000700 1 -- 172.21.15.49:0/2304363678 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0019a60 con 0x2328690 2024-01-22T05:19:56.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f88de000700 1 -- 172.21.15.49:0/2304363678 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f88e0028070 con 0x2328690 2024-01-22T05:19:56.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f89025e5740 1 -- 172.21.15.49:0/2304363678 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x232d090 con 0x2328690 2024-01-22T05:19:56.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f88de000700 1 -- 172.21.15.49:0/2304363678 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88e0019bc0 con 0x2328690 2024-01-22T05:19:56.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f89025e5740 10 client.10758 fetch_fsmap learned FSMap version 157 2024-01-22T05:19:56.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f89025e5740 1 -- 172.21.15.49:0/2304363678 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x7f88f00bc0e0 con 0x2328690 2024-01-22T05:19:56.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f88de000700 1 -- 172.21.15.49:0/2304363678 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x232d090 con 0x2328690 2024-01-22T05:19:56.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f88de000700 1 -- 172.21.15.49:0/2304363678 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f88e0019d20 con 0x2328690 2024-01-22T05:19:56.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f89025e5740 10 client.10758 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:19:56.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f89025e5740 10 client.10758 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-01-22T05:19:56.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f89025e5740 20 client.10758 populate_metadata read hostname 'smithi049' 2024-01-22T05:19:56.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f89025e5740 1 --2- 172.21.15.49:0/2304363678 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x232f010 0x2348f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:19:56.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f89025e5740 4 client.10758 mds_command: new command op to 10656 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:19:56.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f89025e5740 1 -- 172.21.15.49:0/2304363678 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f88d8022070 con 0x232f010 2024-01-22T05:19:56.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f88f4e00700 1 --2- 172.21.15.49:0/2304363678 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x232f010 0x2348f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:19:56.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f88de000700 10 client.10758 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:19:56.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f88f4e00700 1 --2- 172.21.15.49:0/2304363678 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x232f010 0x2348f10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8e40cd59c7d2c77a server_cookie=afe97527d0721732 in_seq=0 out_seq=0 2024-01-22T05:19:56.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f88de000700 1 -- 172.21.15.49:0/2304363678 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x7f88d8022070 con 0x232f010 2024-01-22T05:19:56.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f88de000700 10 client.10758 handle_command_reply: tid=0 2024-01-22T05:19:56.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.835+0000 7f89025e5740 1 client.10758 shutdown 2024-01-22T05:19:56.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f89025e5740 1 -- 172.21.15.49:0/2304363678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2328690 msgr2=0x23261d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f89025e5740 1 --2- 172.21.15.49:0/2304363678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2328690 0x23261d0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 rx=0x7f88e0000de0 tx=0x7f88e001a070).stop 2024-01-22T05:19:56.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f89025e5740 1 -- 172.21.15.49:0/2304363678 shutdown_connections 2024-01-22T05:19:56.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f89025e5740 1 --2- 172.21.15.49:0/2304363678 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x232f010 0x2348f10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f89025e5740 1 --2- 172.21.15.49:0/2304363678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2346670 0x23988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f89025e5740 1 --2- 172.21.15.49:0/2304363678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2345da0 0x23983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f89025e5740 1 --2- 172.21.15.49:0/2304363678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2328690 0x23261d0 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f88de000700 0 client.10758 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:19:56.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f89025e5740 1 -- 172.21.15.49:0/2304363678 >> 172.21.15.49:0/2304363678 conn(0x20e1680 msgr2=0x22fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f89025e5740 1 -- 172.21.15.49:0/2304363678 shutdown_connections 2024-01-22T05:19:56.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f89025e5740 1 -- 172.21.15.49:0/2304363678 wait complete. 2024-01-22T05:19:56.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f89025e5740 20 client.10758 trim_cache size 0 max 16384 2024-01-22T05:19:56.841 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:19:56.841 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-01-22T05:19:56.841 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-01-22T05:19:56.841 INFO:teuthology.orchestra.run.smithi049.stdout: "2daacdba-ba54-4b1e-b237-55843c1c7930": { 2024-01-22T05:19:56.841 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-01-22T05:19:56.841 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "2daacdba-ba54-4b1e-b237-55843c1c7930", 2024-01-22T05:19:56.841 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,repair" 2024-01-22T05:19:56.842 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:56.842 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:19:56.842 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:19:56.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f88f8200700 1 -- 172.21.15.49:0/3579387329 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f88c805a510 msgr2=0x7f88c805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f88f8200700 1 --2- 172.21.15.49:0/3579387329 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f88c805a510 0x7f88c805c9d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f88e00011e0 tx=0x7f88e0001aa0).stop 2024-01-22T05:19:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f88f8200700 1 -- 172.21.15.49:0/3579387329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f0154660 msgr2=0x7f88f00a8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:19:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f88f8200700 1 --2- 172.21.15.49:0/3579387329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f0154660 0x7f88f00a8ac0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 rx=0x7f88e8009e20 tx=0x7f88e800b040).stop 2024-01-22T05:19:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f88f8200700 1 -- 172.21.15.49:0/3579387329 shutdown_connections 2024-01-22T05:19:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f88f8200700 1 --2- 172.21.15.49:0/3579387329 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f88c805a510 0x7f88c805c9d0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f88f8200700 1 --2- 172.21.15.49:0/3579387329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f0154660 0x7f88f00a8ac0 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f88f8200700 1 --2- 172.21.15.49:0/3579387329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88f0139550 0x7f88f00a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f88f8200700 1 --2- 172.21.15.49:0/3579387329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88f00c1730 0x7f88f014f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:19:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.839+0000 7f88f8200700 1 -- 172.21.15.49:0/3579387329 >> 172.21.15.49:0/3579387329 conn(0x7f88f0065f30 msgr2=0x7f88f00c2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:19:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.843+0000 7f88f8200700 1 -- 172.21.15.49:0/3579387329 shutdown_connections 2024-01-22T05:19:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:19:56.843+0000 7f88f8200700 1 -- 172.21.15.49:0/3579387329 wait complete. 2024-01-22T05:19:56.867 INFO:tasks.cephfs.filesystem:scrub status for tag:2daacdba-ba54-4b1e-b237-55843c1c7930 - {'path': '/', 'tag': '2daacdba-ba54-4b1e-b237-55843c1c7930', 'options': 'recursive,repair'} 2024-01-22T05:20:10.381 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:20:10.389 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:20:26.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub status 2024-01-22T05:20:27.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.030+0000 7f3699600700 1 Processor -- start 2024-01-22T05:20:27.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.030+0000 7f3699600700 1 -- start start 2024-01-22T05:20:27.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.034+0000 7f3699600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3694064590 0x7f369415b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.034+0000 7f3699600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36940690f0 con 0x7f369406a120 2024-01-22T05:20:27.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.034+0000 7f3699600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36940693d0 con 0x7f3694069d40 2024-01-22T05:20:27.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.034+0000 7f3699600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36940bc5d0 con 0x7f3694064590 2024-01-22T05:20:27.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.034+0000 7f3692000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f369406a120 0x7f3694063e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38996/0 (socket says 172.21.15.49:38996) 2024-01-22T05:20:27.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.034+0000 7f3692000700 1 -- 172.21.15.49:0/1314606171 learned_addr learned my addr 172.21.15.49:0/1314606171 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:20:27.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.034+0000 7f3693400700 1 --2- 172.21.15.49:0/1314606171 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3694064590 0x7f369415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.034+0000 7f3691600700 1 -- 172.21.15.49:0/1314606171 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566722988 0 0) 0x7f36940690f0 con 0x7f369406a120 2024-01-22T05:20:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.034+0000 7f3691600700 1 -- 172.21.15.49:0/1314606171 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36740033f0 con 0x7f369406a120 2024-01-22T05:20:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.034+0000 7f3691600700 1 -- 172.21.15.49:0/1314606171 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157450482 0 0) 0x7f36940693d0 con 0x7f3694069d40 2024-01-22T05:20:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.034+0000 7f3691600700 1 -- 172.21.15.49:0/1314606171 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36940690f0 con 0x7f3694069d40 2024-01-22T05:20:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.034+0000 7f3693400700 1 -- 172.21.15.49:0/1314606171 >> v1:172.21.15.110:6789/0 conn(0x7f3694069d40 legacy=0x7f36940c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.034+0000 7f3693400700 1 -- 172.21.15.49:0/1314606171 >> v1:172.21.15.49:6789/0 conn(0x7f369406a120 legacy=0x7f3694063e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.034+0000 7f3693400700 1 -- 172.21.15.49:0/1314606171 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36940696b0 con 0x7f3694064590 2024-01-22T05:20:27.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.034+0000 7f3693400700 1 --2- 172.21.15.49:0/1314606171 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3694064590 0x7f369415b750 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f368c009e90 tx=0x7f368c009780).ready entity=mon.2 client_cookie=a2f405e1798ecc06 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.038+0000 7f3691600700 1 -- 172.21.15.49:0/1314606171 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c00e070 con 0x7f3694064590 2024-01-22T05:20:27.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.038+0000 7f3691600700 1 -- 172.21.15.49:0/1314606171 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c00bab0 con 0x7f3694064590 2024-01-22T05:20:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.038+0000 7f3691600700 1 -- 172.21.15.49:0/1314606171 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c00be30 con 0x7f3694064590 2024-01-22T05:20:27.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.038+0000 7f3699600700 1 -- 172.21.15.49:0/1314606171 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3694064590 msgr2=0x7f369415b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.038+0000 7f3699600700 1 --2- 172.21.15.49:0/1314606171 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3694064590 0x7f369415b750 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f368c009e90 tx=0x7f368c009780).stop 2024-01-22T05:20:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.038+0000 7f3699600700 1 -- 172.21.15.49:0/1314606171 shutdown_connections 2024-01-22T05:20:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.038+0000 7f3699600700 1 --2- 172.21.15.49:0/1314606171 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3694064590 0x7f369415b750 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.038+0000 7f3699600700 1 -- 172.21.15.49:0/1314606171 >> 172.21.15.49:0/1314606171 conn(0x7f36940c7670 msgr2=0x7f36940c7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.038+0000 7f3699600700 1 -- 172.21.15.49:0/1314606171 shutdown_connections 2024-01-22T05:20:27.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.038+0000 7f3699600700 1 -- 172.21.15.49:0/1314606171 wait complete. 2024-01-22T05:20:27.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.042+0000 7f3699600700 1 Processor -- start 2024-01-22T05:20:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.042+0000 7f3699600700 1 -- start start 2024-01-22T05:20:27.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3699600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3694064590 0x7f3694067a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3699600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3694069d40 0x7f36940ac200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3699600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f369406a120 0x7f369414f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3699600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3694068670 con 0x7f3694064590 2024-01-22T05:20:27.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3699600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36940abd70 con 0x7f369406a120 2024-01-22T05:20:27.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3699600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3694068390 con 0x7f3694069d40 2024-01-22T05:20:27.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3692a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3694064590 0x7f3694067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3692a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3694064590 0x7f3694067a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33414/0 (socket says 172.21.15.49:33414) 2024-01-22T05:20:27.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3692a00700 1 -- 172.21.15.49:0/1759990495 learned_addr learned my addr 172.21.15.49:0/1759990495 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3692000700 1 --2- 172.21.15.49:0/1759990495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3694069d40 0x7f36940ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3693400700 1 --2- 172.21.15.49:0/1759990495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f369406a120 0x7f369414f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3692a00700 1 -- 172.21.15.49:0/1759990495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3694069d40 msgr2=0x7f36940ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3692a00700 1 --2- 172.21.15.49:0/1759990495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3694069d40 0x7f36940ac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3692a00700 1 -- 172.21.15.49:0/1759990495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f369406a120 msgr2=0x7f369414f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3692a00700 1 --2- 172.21.15.49:0/1759990495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f369406a120 0x7f369414f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3692a00700 1 -- 172.21.15.49:0/1759990495 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c009a20 con 0x7f3694064590 2024-01-22T05:20:27.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3693400700 1 --2- 172.21.15.49:0/1759990495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f369406a120 0x7f369414f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:20:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f3692a00700 1 --2- 172.21.15.49:0/1759990495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3694064590 0x7f3694067a90 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7f368400c4c0 tx=0x7f3684007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.046+0000 7f368a000700 1 -- 172.21.15.49:0/1759990495 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368400ce30 con 0x7f3694064590 2024-01-22T05:20:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.050+0000 7f368a000700 1 -- 172.21.15.49:0/1759990495 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368400f470 con 0x7f3694064590 2024-01-22T05:20:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.050+0000 7f3699600700 1 -- 172.21.15.49:0/1759990495 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36940ab720 con 0x7f3694064590 2024-01-22T05:20:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.050+0000 7f368a000700 1 -- 172.21.15.49:0/1759990495 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368400f810 con 0x7f3694064590 2024-01-22T05:20:27.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.050+0000 7f3699600700 1 -- 172.21.15.49:0/1759990495 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3694067f80 con 0x7f3694064590 2024-01-22T05:20:27.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.050+0000 7f368a000700 1 -- 172.21.15.49:0/1759990495 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f368400fbc0 con 0x7f3694064590 2024-01-22T05:20:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.054+0000 7f368a000700 1 --2- 172.21.15.49:0/1759990495 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f366c05a510 0x7f366c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.054+0000 7f368a000700 1 -- 172.21.15.49:0/1759990495 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f3684073d10 con 0x7f3694064590 2024-01-22T05:20:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.054+0000 7f3692000700 1 --2- 172.21.15.49:0/1759990495 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f366c05a510 0x7f366c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.058+0000 7f3692000700 1 --2- 172.21.15.49:0/1759990495 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f366c05a510 0x7f366c05c9d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f367c007fd0 tx=0x7f367c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.058+0000 7f36a3ab3740 1 Processor -- start 2024-01-22T05:20:27.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.058+0000 7f36a3ab3740 1 -- start start 2024-01-22T05:20:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f36a3ab3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x14834d0 0x14838b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f36a3ab3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 0x148a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f36a3ab3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148aee0 0x14694f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f36a3ab3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x139b540 con 0x148aee0 2024-01-22T05:20:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f36a3ab3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x135ee90 con 0x14834d0 2024-01-22T05:20:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f36a3ab3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1364d90 con 0x148a570 2024-01-22T05:20:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f3693400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148aee0 0x14694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f3693400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148aee0 0x14694f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33420/0 (socket says 172.21.15.49:33420) 2024-01-22T05:20:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f3693400700 1 -- 172.21.15.49:0/4042604774 learned_addr learned my addr 172.21.15.49:0/4042604774 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f3692a00700 1 --2- 172.21.15.49:0/4042604774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x14834d0 0x14838b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f3692000700 1 --2- 172.21.15.49:0/4042604774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 0x148a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f3693400700 1 -- 172.21.15.49:0/4042604774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 msgr2=0x148a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f3693400700 1 --2- 172.21.15.49:0/4042604774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 0x148a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f3693400700 1 -- 172.21.15.49:0/4042604774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x14834d0 msgr2=0x14838b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f3693400700 1 --2- 172.21.15.49:0/4042604774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x14834d0 0x14838b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f3693400700 1 -- 172.21.15.49:0/4042604774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x13c94c0 con 0x148aee0 2024-01-22T05:20:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f3693400700 1 --2- 172.21.15.49:0/4042604774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148aee0 0x14694f0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 rx=0x7f368c00b610 tx=0x7f368c009780).ready entity=mon.0 client_cookie=537cb8f2f4b32b7a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f3682600700 1 -- 172.21.15.49:0/4042604774 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c0126f0 con 0x148aee0 2024-01-22T05:20:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f3682600700 1 -- 172.21.15.49:0/4042604774 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c022070 con 0x148aee0 2024-01-22T05:20:27.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f3682600700 1 -- 172.21.15.49:0/4042604774 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c012870 con 0x148aee0 2024-01-22T05:20:27.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f36a3ab3740 1 -- 172.21.15.49:0/4042604774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148aee0 msgr2=0x14694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.062+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/4042604774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148aee0 0x14694f0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 rx=0x7f368c00b610 tx=0x7f368c009780).stop 2024-01-22T05:20:27.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.066+0000 7f36a3ab3740 1 -- 172.21.15.49:0/4042604774 shutdown_connections 2024-01-22T05:20:27.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.066+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/4042604774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148aee0 0x14694f0 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.066+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/4042604774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 0x148a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.066+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/4042604774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x14834d0 0x14838b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.066+0000 7f36a3ab3740 1 -- 172.21.15.49:0/4042604774 >> 172.21.15.49:0/4042604774 conn(0x121d680 msgr2=0x143cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.066+0000 7f36a3ab3740 1 -- 172.21.15.49:0/4042604774 shutdown_connections 2024-01-22T05:20:27.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.066+0000 7f36a3ab3740 1 -- 172.21.15.49:0/4042604774 wait complete. 2024-01-22T05:20:27.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.066+0000 7f36a3ab3740 1 -- start start 2024-01-22T05:20:27.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.066+0000 7f36a3ab3740 1 Processor -- start 2024-01-22T05:20:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f36a3ab3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x14834d0 0x145d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f36a3ab3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148a570 0x14655e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f36a3ab3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x148aee0 0x1465ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f36a3ab3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1492010 con 0x148a570 2024-01-22T05:20:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f36a3ab3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1466130 con 0x148aee0 2024-01-22T05:20:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f36a3ab3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1462bf0 con 0x14834d0 2024-01-22T05:20:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f36a3ab3740 10 client.0 ll_register_callbacks cb 0x13f55d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:20:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f3692000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148a570 0x14655e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f3692000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148a570 0x14655e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33434/0 (socket says 172.21.15.49:33434) 2024-01-22T05:20:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f3692000700 1 -- 172.21.15.49:0/449675061 learned_addr learned my addr 172.21.15.49:0/449675061 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f3692a00700 1 --2- 172.21.15.49:0/449675061 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x14834d0 0x145d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f3693400700 1 --2- 172.21.15.49:0/449675061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x148aee0 0x1465ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f3692000700 1 -- 172.21.15.49:0/449675061 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x14834d0 msgr2=0x145d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f3692000700 1 --2- 172.21.15.49:0/449675061 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x14834d0 0x145d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f3692000700 1 -- 172.21.15.49:0/449675061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x148aee0 msgr2=0x1465ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f3692000700 1 --2- 172.21.15.49:0/449675061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x148aee0 0x1465ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f3692000700 1 -- 172.21.15.49:0/449675061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36940696b0 con 0x148a570 2024-01-22T05:20:27.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f3692000700 1 --2- 172.21.15.49:0/449675061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148a570 0x14655e0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7f367c005750 tx=0x7f367c013000).ready entity=mon.0 client_cookie=875ade42a0029d1b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f367aa00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:20:27.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f367aa00700 1 -- 172.21.15.49:0/449675061 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c014ca0 con 0x148a570 2024-01-22T05:20:27.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f367aa00700 1 -- 172.21.15.49:0/449675061 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f367c014e00 con 0x148a570 2024-01-22T05:20:27.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.070+0000 7f36a3ab3740 1 -- 172.21.15.49:0/449675061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x13b5230 con 0x148a570 2024-01-22T05:20:27.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f367aa00700 1 -- 172.21.15.49:0/449675061 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7f367c005240 con 0x148a570 2024-01-22T05:20:27.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f36a3ab3740 10 client.10770 fetch_fsmap learned FSMap version 157 2024-01-22T05:20:27.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f36a3ab3740 1 -- 172.21.15.49:0/449675061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x13b87c0 con 0x148a570 2024-01-22T05:20:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f367aa00700 1 -- 172.21.15.49:0/449675061 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x13b5230 con 0x148a570 2024-01-22T05:20:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f367aa00700 1 -- 172.21.15.49:0/449675061 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f367c01f070 con 0x148a570 2024-01-22T05:20:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f36a3ab3740 10 client.10770 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:20:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f36a3ab3740 10 client.10770 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-01-22T05:20:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f36a3ab3740 20 client.10770 populate_metadata read hostname 'smithi049' 2024-01-22T05:20:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/449675061 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1463b80 0x1463f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f36a3ab3740 4 client.10770 mds_command: new command op to 10656 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:20:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f36a3ab3740 1 -- 172.21.15.49:0/449675061 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x13ab780 con 0x1463b80 2024-01-22T05:20:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f3692a00700 1 --2- 172.21.15.49:0/449675061 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1463b80 0x1463f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f367aa00700 10 client.10770 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f3692a00700 1 --2- 172.21.15.49:0/449675061 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1463b80 0x1463f60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5702bfaa8ee106a2 server_cookie=3efd677de1362855 in_seq=0 out_seq=0 2024-01-22T05:20:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f367aa00700 1 -- 172.21.15.49:0/449675061 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x13ab780 con 0x1463b80 2024-01-22T05:20:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f367aa00700 10 client.10770 handle_command_reply: tid=0 2024-01-22T05:20:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.074+0000 7f36a3ab3740 1 client.10770 shutdown 2024-01-22T05:20:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.078+0000 7f36a3ab3740 1 -- 172.21.15.49:0/449675061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148a570 msgr2=0x14655e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.078+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/449675061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148a570 0x14655e0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7f367c005750 tx=0x7f367c013000).stop 2024-01-22T05:20:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.078+0000 7f36a3ab3740 1 -- 172.21.15.49:0/449675061 shutdown_connections 2024-01-22T05:20:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.078+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/449675061 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1463b80 0x1463f60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.078+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/449675061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x148aee0 0x1465ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.078+0000 7f367aa00700 0 client.10770 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.078+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/449675061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148a570 0x14655e0 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.078+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/449675061 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x14834d0 0x145d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.078+0000 7f36a3ab3740 1 -- 172.21.15.49:0/449675061 >> 172.21.15.49:0/449675061 conn(0x121d680 msgr2=0x1485740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.078+0000 7f36a3ab3740 1 -- 172.21.15.49:0/449675061 shutdown_connections 2024-01-22T05:20:27.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.078+0000 7f36a3ab3740 1 -- 172.21.15.49:0/449675061 wait complete. 2024-01-22T05:20:27.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.078+0000 7f36a3ab3740 20 client.10770 trim_cache size 0 max 16384 2024-01-22T05:20:27.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.098+0000 7f36a3ab3740 1 Processor -- start 2024-01-22T05:20:27.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.098+0000 7f36a3ab3740 1 -- start start 2024-01-22T05:20:27.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.098+0000 7f36a3ab3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x14834d0 0x147ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.098+0000 7f36a3ab3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 0x1463f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.098+0000 7f36a3ab3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x148aee0 0x1484580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.098+0000 7f36a3ab3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1466630 con 0x14834d0 2024-01-22T05:20:27.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.098+0000 7f36a3ab3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1401040 con 0x148aee0 2024-01-22T05:20:27.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.098+0000 7f36a3ab3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x13c5a10 con 0x148a570 2024-01-22T05:20:27.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.098+0000 7f3692a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x14834d0 0x147ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.098+0000 7f3692a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x14834d0 0x147ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33440/0 (socket says 172.21.15.49:33440) 2024-01-22T05:20:27.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.098+0000 7f3692a00700 1 -- 172.21.15.49:0/1123944312 learned_addr learned my addr 172.21.15.49:0/1123944312 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.098+0000 7f3693400700 1 --2- 172.21.15.49:0/1123944312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x148aee0 0x1484580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.098+0000 7f3692000700 1 --2- 172.21.15.49:0/1123944312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 0x1463f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f3692a00700 1 -- 172.21.15.49:0/1123944312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 msgr2=0x1463f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f3692a00700 1 --2- 172.21.15.49:0/1123944312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 0x1463f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f3692a00700 1 -- 172.21.15.49:0/1123944312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x148aee0 msgr2=0x1484580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f3692a00700 1 --2- 172.21.15.49:0/1123944312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x148aee0 0x1484580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f3692a00700 1 -- 172.21.15.49:0/1123944312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1483c10 con 0x14834d0 2024-01-22T05:20:27.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f3692000700 1 --2- 172.21.15.49:0/1123944312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 0x1463f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:20:27.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f3692a00700 1 --2- 172.21.15.49:0/1123944312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x14834d0 0x147ecf0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7f368404adb0 tx=0x7f3684014040).ready entity=mon.0 client_cookie=4076e6897a580752 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f3683000700 1 -- 172.21.15.49:0/1123944312 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684055040 con 0x14834d0 2024-01-22T05:20:27.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f3683000700 1 -- 172.21.15.49:0/1123944312 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3684049450 con 0x14834d0 2024-01-22T05:20:27.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f3683000700 1 -- 172.21.15.49:0/1123944312 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368404a5a0 con 0x14834d0 2024-01-22T05:20:27.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f36a3ab3740 1 -- 172.21.15.49:0/1123944312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x14834d0 msgr2=0x147ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/1123944312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x14834d0 0x147ecf0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7f368404adb0 tx=0x7f3684014040).stop 2024-01-22T05:20:27.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f36a3ab3740 1 -- 172.21.15.49:0/1123944312 shutdown_connections 2024-01-22T05:20:27.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/1123944312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x148aee0 0x1484580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/1123944312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 0x1463f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/1123944312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x14834d0 0x147ecf0 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f36a3ab3740 1 -- 172.21.15.49:0/1123944312 >> 172.21.15.49:0/1123944312 conn(0x121d680 msgr2=0x143e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f36a3ab3740 1 -- 172.21.15.49:0/1123944312 shutdown_connections 2024-01-22T05:20:27.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f36a3ab3740 1 -- 172.21.15.49:0/1123944312 wait complete. 2024-01-22T05:20:27.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.102+0000 7f36a3ab3740 1 -- start start 2024-01-22T05:20:27.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f36a3ab3740 1 Processor -- start 2024-01-22T05:20:27.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f36a3ab3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x14834d0 0x1481970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f36a3ab3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 0x1481e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f36a3ab3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148aee0 0x147d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f36a3ab3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x147ecd0 con 0x148aee0 2024-01-22T05:20:27.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f36a3ab3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1461b80 con 0x14834d0 2024-01-22T05:20:27.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f36a3ab3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1482350 con 0x148a570 2024-01-22T05:20:27.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f36a3ab3740 10 client.0 ll_register_callbacks cb 0x7f367c0014e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:20:27.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f3693400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148aee0 0x147d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f3693400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148aee0 0x147d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33444/0 (socket says 172.21.15.49:33444) 2024-01-22T05:20:27.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f3693400700 1 -- 172.21.15.49:0/3144781547 learned_addr learned my addr 172.21.15.49:0/3144781547 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f3692000700 1 --2- 172.21.15.49:0/3144781547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 0x1481e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f3692a00700 1 --2- 172.21.15.49:0/3144781547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x14834d0 0x1481970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f3693400700 1 -- 172.21.15.49:0/3144781547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 msgr2=0x1481e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f3693400700 1 --2- 172.21.15.49:0/3144781547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 0x1481e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f3693400700 1 -- 172.21.15.49:0/3144781547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x14834d0 msgr2=0x1481970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f3693400700 1 --2- 172.21.15.49:0/3144781547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x14834d0 0x1481970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f3693400700 1 -- 172.21.15.49:0/3144781547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x13b87c0 con 0x148aee0 2024-01-22T05:20:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f3692000700 1 --2- 172.21.15.49:0/3144781547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 0x1481e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:20:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.106+0000 7f3692a00700 1 --2- 172.21.15.49:0/3144781547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x14834d0 0x1481970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:20:27.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f3693400700 1 --2- 172.21.15.49:0/3144781547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148aee0 0x147d740 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 rx=0x7f368c020040 tx=0x7f368c020070).ready entity=mon.0 client_cookie=1abe1190fdeea3ff server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f367aa00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:20:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f367aa00700 1 -- 172.21.15.49:0/3144781547 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c029440 con 0x148aee0 2024-01-22T05:20:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f36a3ab3740 1 -- 172.21.15.49:0/3144781547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f368c022070 con 0x148aee0 2024-01-22T05:20:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f367aa00700 1 -- 172.21.15.49:0/3144781547 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f368c0295a0 con 0x148aee0 2024-01-22T05:20:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f367aa00700 1 -- 172.21.15.49:0/3144781547 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7f368c0299c0 con 0x148aee0 2024-01-22T05:20:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f36a3ab3740 10 client.10776 fetch_fsmap learned FSMap version 157 2024-01-22T05:20:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f36a3ab3740 1 -- 172.21.15.49:0/3144781547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x7f3694067f80 con 0x148aee0 2024-01-22T05:20:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f367aa00700 1 -- 172.21.15.49:0/3144781547 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c022070 con 0x148aee0 2024-01-22T05:20:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f367aa00700 1 -- 172.21.15.49:0/3144781547 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f368c029b20 con 0x148aee0 2024-01-22T05:20:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f36a3ab3740 10 client.10776 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:20:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f36a3ab3740 10 client.10776 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-01-22T05:20:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f36a3ab3740 20 client.10776 populate_metadata read hostname 'smithi049' 2024-01-22T05:20:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/3144781547 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1484580 0x147dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f36a3ab3740 4 client.10776 mds_command: new command op to 10656 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:20:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f36a3ab3740 1 -- 172.21.15.49:0/3144781547 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1274610 con 0x1484580 2024-01-22T05:20:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f3692a00700 1 --2- 172.21.15.49:0/3144781547 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1484580 0x147dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f367aa00700 10 client.10776 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f3692a00700 1 --2- 172.21.15.49:0/3144781547 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1484580 0x147dc30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=65c17dc2ed4ad3fd server_cookie=f1b77f984559b5a9 in_seq=0 out_seq=0 2024-01-22T05:20:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f367aa00700 1 -- 172.21.15.49:0/3144781547 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1274610 con 0x1484580 2024-01-22T05:20:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f367aa00700 10 client.10776 handle_command_reply: tid=0 2024-01-22T05:20:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.110+0000 7f36a3ab3740 1 client.10776 shutdown 2024-01-22T05:20:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f36a3ab3740 1 -- 172.21.15.49:0/3144781547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148aee0 msgr2=0x147d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/3144781547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148aee0 0x147d740 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 rx=0x7f368c020040 tx=0x7f368c020070).stop 2024-01-22T05:20:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f36a3ab3740 1 -- 172.21.15.49:0/3144781547 shutdown_connections 2024-01-22T05:20:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/3144781547 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x1484580 0x147dc30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/3144781547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x148aee0 0x147d740 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/3144781547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x148a570 0x1481e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f36a3ab3740 1 --2- 172.21.15.49:0/3144781547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x14834d0 0x1481970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f367aa00700 0 client.10776 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f36a3ab3740 1 -- 172.21.15.49:0/3144781547 >> 172.21.15.49:0/3144781547 conn(0x121d680 msgr2=0x143e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f36a3ab3740 1 -- 172.21.15.49:0/3144781547 shutdown_connections 2024-01-22T05:20:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f36a3ab3740 1 -- 172.21.15.49:0/3144781547 wait complete. 2024-01-22T05:20:27.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f36a3ab3740 20 client.10776 trim_cache size 0 max 16384 2024-01-22T05:20:27.117 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:20:27.117 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-01-22T05:20:27.117 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-01-22T05:20:27.117 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:20:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f3699600700 1 -- 172.21.15.49:0/1759990495 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f366c05a510 msgr2=0x7f366c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f3699600700 1 --2- 172.21.15.49:0/1759990495 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f366c05a510 0x7f366c05c9d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f367c007fd0 tx=0x7f367c009040).stop 2024-01-22T05:20:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f3699600700 1 -- 172.21.15.49:0/1759990495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3694064590 msgr2=0x7f3694067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f3699600700 1 --2- 172.21.15.49:0/1759990495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3694064590 0x7f3694067a90 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7f368400c4c0 tx=0x7f3684007c90).stop 2024-01-22T05:20:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f3699600700 1 -- 172.21.15.49:0/1759990495 shutdown_connections 2024-01-22T05:20:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f3699600700 1 --2- 172.21.15.49:0/1759990495 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f366c05a510 0x7f366c05c9d0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f3699600700 1 --2- 172.21.15.49:0/1759990495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f369406a120 0x7f369414f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f3699600700 1 --2- 172.21.15.49:0/1759990495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3694069d40 0x7f36940ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f3699600700 1 --2- 172.21.15.49:0/1759990495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3694064590 0x7f3694067a90 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f3699600700 1 -- 172.21.15.49:0/1759990495 >> 172.21.15.49:0/1759990495 conn(0x7f36940c7670 msgr2=0x7f36940a7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f3699600700 1 -- 172.21.15.49:0/1759990495 shutdown_connections 2024-01-22T05:20:27.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.114+0000 7f3699600700 1 -- 172.21.15.49:0/1759990495 wait complete. 2024-01-22T05:20:27.140 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-22T05:20:27.140 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub start / recursive,repair 2024-01-22T05:20:27.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.310+0000 7f4bb2a00700 1 Processor -- start 2024-01-22T05:20:27.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.310+0000 7f4bb2a00700 1 -- start start 2024-01-22T05:20:27.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.314+0000 7f4bb2a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bac0c45b0 0x7f4bac0a6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.314+0000 7f4bb2a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4bac0c4990 0x7f4bac0be150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.314+0000 7f4bb2a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bac0c2dc0 con 0x7f4bac0a6d20 2024-01-22T05:20:27.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.314+0000 7f4bb2a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac0c21b0 con 0x7f4bac0c4990 2024-01-22T05:20:27.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4bb2a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0c2490 con 0x7f4bac0c45b0 2024-01-22T05:20:27.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4bb1600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bac0c45b0 0x7f4bac0a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4bb1600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bac0c45b0 0x7f4bac0a6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:52132/0 (socket says 172.21.15.49:52132) 2024-01-22T05:20:27.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4bb1600700 1 -- 172.21.15.49:0/10098025 learned_addr learned my addr 172.21.15.49:0/10098025 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4bb2000700 1 --2- 172.21.15.49:0/10098025 >> v2:172.21.15.110:3300/0 conn(0x7f4bac0c4990 0x7f4bac0be150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4bb0c00700 1 --1- 172.21.15.49:0/10098025 >> v1:172.21.15.49:6789/0 conn(0x7f4bac0a6d20 0x7f4bac0bda40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:39006/0 (socket says 172.21.15.49:39006) 2024-01-22T05:20:27.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4bb1600700 1 -- 172.21.15.49:0/10098025 >> v2:172.21.15.110:3300/0 conn(0x7f4bac0c4990 msgr2=0x7f4bac0be150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4bb1600700 1 --2- 172.21.15.49:0/10098025 >> v2:172.21.15.110:3300/0 conn(0x7f4bac0c4990 0x7f4bac0be150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4bb1600700 1 -- 172.21.15.49:0/10098025 >> v1:172.21.15.49:6789/0 conn(0x7f4bac0a6d20 legacy=0x7f4bac0bda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4babe00700 1 -- 172.21.15.49:0/10098025 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254292487 0 0) 0x7f4bac0c2dc0 con 0x7f4bac0a6d20 2024-01-22T05:20:27.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4bb1600700 1 -- 172.21.15.49:0/10098025 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0c2770 con 0x7f4bac0c45b0 2024-01-22T05:20:27.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4bb1600700 1 --2- 172.21.15.49:0/10098025 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bac0c45b0 0x7f4bac0a6830 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f4b9c006fd0 tx=0x7f4b9c0090f0).ready entity=mon.2 client_cookie=aeaf9416578de49 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4babe00700 1 -- 172.21.15.49:0/10098025 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00b580 con 0x7f4bac0c45b0 2024-01-22T05:20:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4babe00700 1 -- 172.21.15.49:0/10098025 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c00b6e0 con 0x7f4bac0c45b0 2024-01-22T05:20:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4babe00700 1 -- 172.21.15.49:0/10098025 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00ba60 con 0x7f4bac0c45b0 2024-01-22T05:20:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4bb2a00700 1 -- 172.21.15.49:0/10098025 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bac0c45b0 msgr2=0x7f4bac0a6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.318+0000 7f4bb2a00700 1 --2- 172.21.15.49:0/10098025 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bac0c45b0 0x7f4bac0a6830 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f4b9c006fd0 tx=0x7f4b9c0090f0).stop 2024-01-22T05:20:27.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.322+0000 7f4bb2a00700 1 -- 172.21.15.49:0/10098025 shutdown_connections 2024-01-22T05:20:27.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.322+0000 7f4bb2a00700 1 --2- 172.21.15.49:0/10098025 >> v2:172.21.15.110:3300/0 conn(0x7f4bac0c4990 0x7f4bac0be150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.322+0000 7f4bb2a00700 1 --2- 172.21.15.49:0/10098025 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bac0c45b0 0x7f4bac0a6830 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.322+0000 7f4bb2a00700 1 -- 172.21.15.49:0/10098025 >> 172.21.15.49:0/10098025 conn(0x7f4bac0aa6b0 msgr2=0x7f4bac0aaac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.322+0000 7f4bb2a00700 1 -- 172.21.15.49:0/10098025 shutdown_connections 2024-01-22T05:20:27.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.322+0000 7f4bb2a00700 1 -- 172.21.15.49:0/10098025 wait complete. 2024-01-22T05:20:27.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.326+0000 7f4bb2a00700 1 Processor -- start 2024-01-22T05:20:27.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.326+0000 7f4bb2a00700 1 -- start start 2024-01-22T05:20:27.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb2a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bac0c45b0 0x7f4bac164160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb2a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bac0c4990 0x7f4bac0a7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb2a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bac150480 0x7f4bac0a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb2a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0a8a00 con 0x7f4bac0c4990 2024-01-22T05:20:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb2a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0a8570 con 0x7f4bac0c45b0 2024-01-22T05:20:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb2a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0a7960 con 0x7f4bac150480 2024-01-22T05:20:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb0c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bac0c4990 0x7f4bac0a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb1600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bac0c45b0 0x7f4bac164160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb2000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bac150480 0x7f4bac0a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb1600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bac0c45b0 0x7f4bac164160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:50858/0 (socket says 172.21.15.49:50858) 2024-01-22T05:20:27.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb0c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bac0c4990 0x7f4bac0a7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33458/0 (socket says 172.21.15.49:33458) 2024-01-22T05:20:27.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb1600700 1 -- 172.21.15.49:0/1836493643 learned_addr learned my addr 172.21.15.49:0/1836493643 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb1600700 1 -- 172.21.15.49:0/1836493643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bac150480 msgr2=0x7f4bac0a93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb1600700 1 --2- 172.21.15.49:0/1836493643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bac150480 0x7f4bac0a93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb1600700 1 -- 172.21.15.49:0/1836493643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bac0c4990 msgr2=0x7f4bac0a7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb1600700 1 --2- 172.21.15.49:0/1836493643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bac0c4990 0x7f4bac0a7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb1600700 1 -- 172.21.15.49:0/1836493643 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c009370 con 0x7f4bac0c45b0 2024-01-22T05:20:27.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb1600700 1 --2- 172.21.15.49:0/1836493643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bac0c45b0 0x7f4bac164160 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f4b9c009fd0 tx=0x7f4b9c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4ba8c00700 1 -- 172.21.15.49:0/1836493643 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c000bc0 con 0x7f4bac0c45b0 2024-01-22T05:20:27.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4ba8c00700 1 -- 172.21.15.49:0/1836493643 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c00b850 con 0x7f4bac0c45b0 2024-01-22T05:20:27.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4ba8c00700 1 -- 172.21.15.49:0/1836493643 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c000d20 con 0x7f4bac0c45b0 2024-01-22T05:20:27.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb2a00700 1 -- 172.21.15.49:0/1836493643 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac0a7c40 con 0x7f4bac0c45b0 2024-01-22T05:20:27.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.330+0000 7f4bb2a00700 1 -- 172.21.15.49:0/1836493643 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac0a8200 con 0x7f4bac0c45b0 2024-01-22T05:20:27.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.334+0000 7f4ba8c00700 1 -- 172.21.15.49:0/1836493643 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4b9c01cad0 con 0x7f4bac0c45b0 2024-01-22T05:20:27.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.338+0000 7f4ba8c00700 1 --2- 172.21.15.49:0/1836493643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b8405a540 0x7f4b8405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.338+0000 7f4ba8c00700 1 -- 172.21.15.49:0/1836493643 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f4b9c0766f0 con 0x7f4bac0c45b0 2024-01-22T05:20:27.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.338+0000 7f4bb0c00700 1 --2- 172.21.15.49:0/1836493643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b8405a540 0x7f4b8405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.338+0000 7f4bb0c00700 1 --2- 172.21.15.49:0/1836493643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b8405a540 0x7f4b8405ca00 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f4bac068950 tx=0x7f4b94007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.338+0000 7f4bbe59a740 1 Processor -- start 2024-01-22T05:20:27.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.338+0000 7f4bbe59a740 1 -- start start 2024-01-22T05:20:27.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bbe59a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2551b10 0x2551ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bbe59a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x250c540 0x250c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bbe59a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25060d0 0x2506550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bbe59a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x246a5b0 con 0x25060d0 2024-01-22T05:20:27.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bbe59a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x242e000 con 0x2551b10 2024-01-22T05:20:27.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bbe59a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x24590c0 con 0x250c540 2024-01-22T05:20:27.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bb2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25060d0 0x2506550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bb0c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x250c540 0x250c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bb2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25060d0 0x2506550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33462/0 (socket says 172.21.15.49:33462) 2024-01-22T05:20:27.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bb2000700 1 -- 172.21.15.49:0/2287256093 learned_addr learned my addr 172.21.15.49:0/2287256093 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bb1600700 1 --2- 172.21.15.49:0/2287256093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2551b10 0x2551ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bb2000700 1 -- 172.21.15.49:0/2287256093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x250c540 msgr2=0x250c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bb2000700 1 --2- 172.21.15.49:0/2287256093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x250c540 0x250c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bb2000700 1 -- 172.21.15.49:0/2287256093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2551b10 msgr2=0x2551ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bb2000700 1 --2- 172.21.15.49:0/2287256093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2551b10 0x2551ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bb2000700 1 -- 172.21.15.49:0/2287256093 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2487890 con 0x25060d0 2024-01-22T05:20:27.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bb0c00700 1 --2- 172.21.15.49:0/2287256093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x250c540 0x250c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:20:27.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bb2000700 1 --2- 172.21.15.49:0/2287256093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25060d0 0x2506550 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 rx=0x7f4ba4011500 tx=0x7f4ba400b040).ready entity=mon.0 client_cookie=d913cdf462211555 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4ba1200700 1 -- 172.21.15.49:0/2287256093 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400e040 con 0x25060d0 2024-01-22T05:20:27.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4ba1200700 1 -- 172.21.15.49:0/2287256093 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba400f040 con 0x25060d0 2024-01-22T05:20:27.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4ba1200700 1 -- 172.21.15.49:0/2287256093 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4015660 con 0x25060d0 2024-01-22T05:20:27.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bbe59a740 1 -- 172.21.15.49:0/2287256093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25060d0 msgr2=0x2506550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.342+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/2287256093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25060d0 0x2506550 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 rx=0x7f4ba4011500 tx=0x7f4ba400b040).stop 2024-01-22T05:20:27.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.346+0000 7f4bbe59a740 1 -- 172.21.15.49:0/2287256093 shutdown_connections 2024-01-22T05:20:27.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.346+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/2287256093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25060d0 0x2506550 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.346+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/2287256093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x250c540 0x250c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.346+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/2287256093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2551b10 0x2551ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.346+0000 7f4bbe59a740 1 -- 172.21.15.49:0/2287256093 >> 172.21.15.49:0/2287256093 conn(0x22ec7f0 msgr2=0x250b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.346+0000 7f4bbe59a740 1 -- 172.21.15.49:0/2287256093 shutdown_connections 2024-01-22T05:20:27.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.346+0000 7f4bbe59a740 1 -- 172.21.15.49:0/2287256093 wait complete. 2024-01-22T05:20:27.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.346+0000 7f4bbe59a740 1 -- start start 2024-01-22T05:20:27.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.346+0000 7f4bbe59a740 1 Processor -- start 2024-01-22T05:20:27.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bbe59a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25060d0 0x25371e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bbe59a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x250c540 0x2506890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bbe59a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2551b10 0x252fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bbe59a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2538fb0 con 0x2551b10 2024-01-22T05:20:27.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bbe59a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x254ade0 con 0x250c540 2024-01-22T05:20:27.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bbe59a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x254bc40 con 0x25060d0 2024-01-22T05:20:27.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bbe59a740 10 client.0 ll_register_callbacks cb 0x2484710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:20:27.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bb2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2551b10 0x252fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bb1600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25060d0 0x25371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bb1600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25060d0 0x25371e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:52152/0 (socket says 172.21.15.49:52152) 2024-01-22T05:20:27.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bb1600700 1 -- 172.21.15.49:0/3254175123 learned_addr learned my addr 172.21.15.49:0/3254175123 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bb2000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2551b10 0x252fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33474/0 (socket says 172.21.15.49:33474) 2024-01-22T05:20:27.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bb0c00700 1 --2- 172.21.15.49:0/3254175123 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x250c540 0x2506890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bb2000700 1 -- 172.21.15.49:0/3254175123 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25060d0 msgr2=0x25371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bb2000700 1 --2- 172.21.15.49:0/3254175123 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25060d0 0x25371e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bb2000700 1 -- 172.21.15.49:0/3254175123 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x250c540 msgr2=0x2506890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bb2000700 1 --2- 172.21.15.49:0/3254175123 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x250c540 0x2506890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bb2000700 1 -- 172.21.15.49:0/3254175123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b94001370 con 0x2551b10 2024-01-22T05:20:27.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bb1600700 1 --2- 172.21.15.49:0/3254175123 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25060d0 0x25371e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:20:27.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bb2000700 1 --2- 172.21.15.49:0/3254175123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2551b10 0x252fe00 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 rx=0x254dce0 tx=0x7f4ba401d000).ready entity=mon.0 client_cookie=78715fced4ce62a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4b99600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:20:27.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4b99600700 1 -- 172.21.15.49:0/3254175123 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400e070 con 0x2551b10 2024-01-22T05:20:27.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4b99600700 1 -- 172.21.15.49:0/3254175123 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f4ba401f640 con 0x2551b10 2024-01-22T05:20:27.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3254175123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2484300 con 0x2551b10 2024-01-22T05:20:27.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4b99600700 1 -- 172.21.15.49:0/3254175123 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ba401f800 con 0x2551b10 2024-01-22T05:20:27.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bbe59a740 10 client.10788 fetch_fsmap learned FSMap version 157 2024-01-22T05:20:27.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.350+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3254175123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x7f4ba4011230 con 0x2551b10 2024-01-22T05:20:27.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4b99600700 1 -- 172.21.15.49:0/3254175123 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2484300 con 0x2551b10 2024-01-22T05:20:27.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4b99600700 1 -- 172.21.15.49:0/3254175123 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4ba401f960 con 0x2551b10 2024-01-22T05:20:27.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4bbe59a740 10 client.10788 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:20:27.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4bbe59a740 10 client.10788 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-01-22T05:20:27.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4bbe59a740 20 client.10788 populate_metadata read hostname 'smithi049' 2024-01-22T05:20:27.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/3254175123 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x2562720 0x2562b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4bbe59a740 4 client.10788 mds_command: new command op to 10656 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:20:27.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3254175123 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x247a850 con 0x2562720 2024-01-22T05:20:27.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4bb1600700 1 --2- 172.21.15.49:0/3254175123 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x2562720 0x2562b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4bb1600700 1 --2- 172.21.15.49:0/3254175123 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x2562720 0x2562b30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7813fc336fd704cd server_cookie=5edfcf63f3d386d2 in_seq=0 out_seq=0 2024-01-22T05:20:27.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4b99600700 10 client.10788 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:27.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4b99600700 1 -- 172.21.15.49:0/3254175123 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x247a850 con 0x2562720 2024-01-22T05:20:27.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4b99600700 10 client.10788 handle_command_reply: tid=0 2024-01-22T05:20:27.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4bbe59a740 1 client.10788 shutdown 2024-01-22T05:20:27.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3254175123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2551b10 msgr2=0x252fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.354+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/3254175123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2551b10 0x252fe00 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 rx=0x254dce0 tx=0x7f4ba401d000).stop 2024-01-22T05:20:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.358+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3254175123 shutdown_connections 2024-01-22T05:20:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.358+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/3254175123 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x2562720 0x2562b30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.358+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/3254175123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2551b10 0x252fe00 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.358+0000 7f4b99600700 0 client.10788 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.358+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/3254175123 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x250c540 0x2506890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.358+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/3254175123 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x25060d0 0x25371e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.358+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3254175123 >> 172.21.15.49:0/3254175123 conn(0x22ec7f0 msgr2=0x2553e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.358+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3254175123 shutdown_connections 2024-01-22T05:20:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.358+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3254175123 wait complete. 2024-01-22T05:20:27.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.358+0000 7f4bbe59a740 20 client.10788 trim_cache size 0 max 16384 2024-01-22T05:20:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.374+0000 7f4bbe59a740 1 Processor -- start 2024-01-22T05:20:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.374+0000 7f4bbe59a740 1 -- start start 2024-01-22T05:20:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bbe59a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25060d0 0x2569170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bbe59a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x250c540 0x2535600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bbe59a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2551b10 0x2531fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bbe59a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2532c30 con 0x250c540 2024-01-22T05:20:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bbe59a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2506750 con 0x25060d0 2024-01-22T05:20:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bbe59a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2536250 con 0x2551b10 2024-01-22T05:20:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bb1600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25060d0 0x2569170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bb0c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x250c540 0x2535600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bb1600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25060d0 0x2569170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:50884/0 (socket says 172.21.15.49:50884) 2024-01-22T05:20:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bb0c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x250c540 0x2535600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33478/0 (socket says 172.21.15.49:33478) 2024-01-22T05:20:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bb1600700 1 -- 172.21.15.49:0/4255922476 learned_addr learned my addr 172.21.15.49:0/4255922476 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bb2000700 1 --2- 172.21.15.49:0/4255922476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2551b10 0x2531fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bb1600700 1 -- 172.21.15.49:0/4255922476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2551b10 msgr2=0x2531fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bb1600700 1 --2- 172.21.15.49:0/4255922476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2551b10 0x2531fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bb1600700 1 -- 172.21.15.49:0/4255922476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x250c540 msgr2=0x2535600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bb1600700 1 --2- 172.21.15.49:0/4255922476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x250c540 0x2535600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bb1600700 1 -- 172.21.15.49:0/4255922476 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0a9c30 con 0x25060d0 2024-01-22T05:20:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4bb1600700 1 --2- 172.21.15.49:0/4255922476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25060d0 0x2569170 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f4b9c04d910 tx=0x7f4b9c04f040).ready entity=mon.1 client_cookie=bff1d383bb26823c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4ba1c00700 1 -- 172.21.15.49:0/4255922476 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c034070 con 0x25060d0 2024-01-22T05:20:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4ba1c00700 1 -- 172.21.15.49:0/4255922476 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c006af0 con 0x25060d0 2024-01-22T05:20:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.378+0000 7f4ba1c00700 1 -- 172.21.15.49:0/4255922476 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c052040 con 0x25060d0 2024-01-22T05:20:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.382+0000 7f4bbe59a740 1 -- 172.21.15.49:0/4255922476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25060d0 msgr2=0x2569170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.382+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/4255922476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25060d0 0x2569170 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f4b9c04d910 tx=0x7f4b9c04f040).stop 2024-01-22T05:20:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.382+0000 7f4bbe59a740 1 -- 172.21.15.49:0/4255922476 shutdown_connections 2024-01-22T05:20:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.382+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/4255922476 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2551b10 0x2531fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.382+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/4255922476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x250c540 0x2535600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.382+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/4255922476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x25060d0 0x2569170 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.382+0000 7f4bbe59a740 1 -- 172.21.15.49:0/4255922476 >> 172.21.15.49:0/4255922476 conn(0x22ec7f0 msgr2=0x254d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.382+0000 7f4bbe59a740 1 -- 172.21.15.49:0/4255922476 shutdown_connections 2024-01-22T05:20:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.382+0000 7f4bbe59a740 1 -- 172.21.15.49:0/4255922476 wait complete. 2024-01-22T05:20:27.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.382+0000 7f4bbe59a740 1 -- start start 2024-01-22T05:20:27.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.386+0000 7f4bbe59a740 1 Processor -- start 2024-01-22T05:20:27.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.386+0000 7f4bbe59a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25060d0 0x25a4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.386+0000 7f4bbe59a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x250c540 0x2531fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.386+0000 7f4bbe59a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2551b10 0x2532490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.386+0000 7f4bbe59a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2532980 con 0x25060d0 2024-01-22T05:20:27.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.386+0000 7f4bbe59a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2570a20 con 0x250c540 2024-01-22T05:20:27.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.386+0000 7f4bbe59a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x256dcc0 con 0x2551b10 2024-01-22T05:20:27.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.386+0000 7f4bbe59a740 10 client.0 ll_register_callbacks cb 0x7f4b9c074b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:20:27.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bb1600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25060d0 0x25a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bb1600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25060d0 0x25a4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33488/0 (socket says 172.21.15.49:33488) 2024-01-22T05:20:27.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bb1600700 1 -- 172.21.15.49:0/3634921624 learned_addr learned my addr 172.21.15.49:0/3634921624 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bb2000700 1 --2- 172.21.15.49:0/3634921624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2551b10 0x2532490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bb0c00700 1 --2- 172.21.15.49:0/3634921624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x250c540 0x2531fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bb1600700 1 -- 172.21.15.49:0/3634921624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2551b10 msgr2=0x2532490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bb1600700 1 --2- 172.21.15.49:0/3634921624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2551b10 0x2532490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bb1600700 1 -- 172.21.15.49:0/3634921624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x250c540 msgr2=0x2531fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bb1600700 1 --2- 172.21.15.49:0/3634921624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x250c540 0x2531fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bb1600700 1 -- 172.21.15.49:0/3634921624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac0a8200 con 0x25060d0 2024-01-22T05:20:27.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bb1600700 1 --2- 172.21.15.49:0/3634921624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25060d0 0x25a4590 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 rx=0x7f4b9c074ab0 tx=0x7f4b9c038000).ready entity=mon.0 client_cookie=a2463feadb062ced server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4b99600700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:20:27.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4b99600700 1 -- 172.21.15.49:0/3634921624 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c01ce50 con 0x25060d0 2024-01-22T05:20:27.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4b99600700 1 -- 172.21.15.49:0/3634921624 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f4b9c052040 con 0x25060d0 2024-01-22T05:20:27.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3634921624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ba400f040 con 0x25060d0 2024-01-22T05:20:27.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4b99600700 1 -- 172.21.15.49:0/3634921624 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b9c04ced0 con 0x25060d0 2024-01-22T05:20:27.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bbe59a740 10 client.10794 fetch_fsmap learned FSMap version 157 2024-01-22T05:20:27.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3634921624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x2482ac0 con 0x25060d0 2024-01-22T05:20:27.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4b99600700 1 -- 172.21.15.49:0/3634921624 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba400f040 con 0x25060d0 2024-01-22T05:20:27.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4b99600700 1 -- 172.21.15.49:0/3634921624 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4b9c0492f0 con 0x25060d0 2024-01-22T05:20:27.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bbe59a740 10 client.10794 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:20:27.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bbe59a740 10 client.10794 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-01-22T05:20:27.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bbe59a740 20 client.10794 populate_metadata read hostname 'smithi049' 2024-01-22T05:20:27.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/3634921624 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x254b6f0 0x256f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bbe59a740 4 client.10794 mds_command: new command op to 10656 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-01-22T05:20:27.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3634921624 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) v1 -- 0x2343780 con 0x254b6f0 2024-01-22T05:20:27.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.390+0000 7f4bb0c00700 1 --2- 172.21.15.49:0/3634921624 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x254b6f0 0x256f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4bb0c00700 1 --2- 172.21.15.49:0/3634921624 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x254b6f0 0x256f910 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=96e0791cfadf3fb0 server_cookie=54a955189f7f8005 in_seq=0 out_seq=0 2024-01-22T05:20:27.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4b99600700 10 client.10794 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:27.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4b99600700 1 -- 172.21.15.49:0/3634921624 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x2343780 con 0x254b6f0 2024-01-22T05:20:27.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4b99600700 10 client.10794 handle_command_reply: tid=0 2024-01-22T05:20:27.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4bbe59a740 1 client.10794 shutdown 2024-01-22T05:20:27.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3634921624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25060d0 msgr2=0x25a4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/3634921624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25060d0 0x25a4590 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 rx=0x7f4b9c074ab0 tx=0x7f4b9c038000).stop 2024-01-22T05:20:27.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3634921624 shutdown_connections 2024-01-22T05:20:27.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/3634921624 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x254b6f0 0x256f910 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/3634921624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2551b10 0x2532490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/3634921624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x250c540 0x2531fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4bbe59a740 1 --2- 172.21.15.49:0/3634921624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x25060d0 0x25a4590 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3634921624 >> 172.21.15.49:0/3634921624 conn(0x22ec7f0 msgr2=0x254d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4b99600700 0 client.10794 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:27.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3634921624 shutdown_connections 2024-01-22T05:20:27.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.394+0000 7f4bbe59a740 1 -- 172.21.15.49:0/3634921624 wait complete. 2024-01-22T05:20:27.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.398+0000 7f4bbe59a740 20 client.10794 trim_cache size 0 max 16384 2024-01-22T05:20:27.398 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:20:27.398 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-01-22T05:20:27.398 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "dc814411-f827-4ecc-9348-9bb09610575e", 2024-01-22T05:20:27.399 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-01-22T05:20:27.399 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:20:27.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.398+0000 7f4bb2a00700 1 -- 172.21.15.49:0/1836493643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b8405a540 msgr2=0x7f4b8405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.398+0000 7f4bb2a00700 1 --2- 172.21.15.49:0/1836493643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b8405a540 0x7f4b8405ca00 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f4bac068950 tx=0x7f4b94007bd0).stop 2024-01-22T05:20:27.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.398+0000 7f4bb2a00700 1 -- 172.21.15.49:0/1836493643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bac0c45b0 msgr2=0x7f4bac164160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.398+0000 7f4bb2a00700 1 --2- 172.21.15.49:0/1836493643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bac0c45b0 0x7f4bac164160 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f4b9c009fd0 tx=0x7f4b9c017000).stop 2024-01-22T05:20:27.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.398+0000 7f4bb2a00700 1 -- 172.21.15.49:0/1836493643 shutdown_connections 2024-01-22T05:20:27.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.398+0000 7f4bb2a00700 1 --2- 172.21.15.49:0/1836493643 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4b8405a540 0x7f4b8405ca00 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.398+0000 7f4bb2a00700 1 --2- 172.21.15.49:0/1836493643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bac150480 0x7f4bac0a93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.398+0000 7f4bb2a00700 1 --2- 172.21.15.49:0/1836493643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4bac0c4990 0x7f4bac0a7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.398+0000 7f4bb2a00700 1 --2- 172.21.15.49:0/1836493643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bac0c45b0 0x7f4bac164160 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.398+0000 7f4bb2a00700 1 -- 172.21.15.49:0/1836493643 >> 172.21.15.49:0/1836493643 conn(0x7f4bac0aa6b0 msgr2=0x7f4bac0a57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.398+0000 7f4bb2a00700 1 -- 172.21.15.49:0/1836493643 shutdown_connections 2024-01-22T05:20:27.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.398+0000 7f4bb2a00700 1 -- 172.21.15.49:0/1836493643 wait complete. 2024-01-22T05:20:27.422 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub status 2024-01-22T05:20:27.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.590+0000 7f464b200700 1 Processor -- start 2024-01-22T05:20:27.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.590+0000 7f464b200700 1 -- start start 2024-01-22T05:20:27.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.594+0000 7f464b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0a8b10 0x7f464c066d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.594+0000 7f464b200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f464c067220 0x7f464c067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.594+0000 7f464b200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f464c067f80 0x7f464c157760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.594+0000 7f464b200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c068430 con 0x7f464c067220 2024-01-22T05:20:27.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.594+0000 7f464b200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c0bc680 con 0x7f464c067f80 2024-01-22T05:20:27.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.594+0000 7f464b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c066600 con 0x7f464c0a8b10 2024-01-22T05:20:27.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.594+0000 7f4649400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f464c067220 0x7f464c067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.594+0000 7f4649400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f464c067220 0x7f464c067a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33502/0 (socket says 172.21.15.49:33502) 2024-01-22T05:20:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.594+0000 7f4649400700 1 -- 172.21.15.49:0/895606647 learned_addr learned my addr 172.21.15.49:0/895606647 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f4649e00700 1 --2- 172.21.15.49:0/895606647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0a8b10 0x7f464c066d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f464a800700 1 --2- 172.21.15.49:0/895606647 >> v2:172.21.15.110:3300/0 conn(0x7f464c067f80 0x7f464c157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f4649400700 1 -- 172.21.15.49:0/895606647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0a8b10 msgr2=0x7f464c066d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f4649400700 1 --2- 172.21.15.49:0/895606647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0a8b10 0x7f464c066d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f4649400700 1 -- 172.21.15.49:0/895606647 >> v2:172.21.15.110:3300/0 conn(0x7f464c067f80 msgr2=0x7f464c157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f4649400700 1 --2- 172.21.15.49:0/895606647 >> v2:172.21.15.110:3300/0 conn(0x7f464c067f80 0x7f464c157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f4649400700 1 -- 172.21.15.49:0/895606647 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c0bbde0 con 0x7f464c067220 2024-01-22T05:20:27.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f464a800700 1 --2- 172.21.15.49:0/895606647 >> v2:172.21.15.110:3300/0 conn(0x7f464c067f80 0x7f464c157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:20:27.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f4649400700 1 --2- 172.21.15.49:0/895606647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c067220 0x7f464c067a90 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 rx=0x7f464c0a9340 tx=0x7f46340090f0).ready entity=mon.0 client_cookie=6629aa64da3ee2f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f4648a00700 1 -- 172.21.15.49:0/895606647 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463400b520 con 0x7f464c067220 2024-01-22T05:20:27.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f4648a00700 1 -- 172.21.15.49:0/895606647 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463400b680 con 0x7f464c067220 2024-01-22T05:20:27.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f4648a00700 1 -- 172.21.15.49:0/895606647 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463400ba00 con 0x7f464c067220 2024-01-22T05:20:27.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f464b200700 1 -- 172.21.15.49:0/895606647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c067220 msgr2=0x7f464c067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f464b200700 1 --2- 172.21.15.49:0/895606647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c067220 0x7f464c067a90 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 rx=0x7f464c0a9340 tx=0x7f46340090f0).stop 2024-01-22T05:20:27.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f464b200700 1 -- 172.21.15.49:0/895606647 shutdown_connections 2024-01-22T05:20:27.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f464b200700 1 --2- 172.21.15.49:0/895606647 >> v2:172.21.15.110:3300/0 conn(0x7f464c067f80 0x7f464c157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f464b200700 1 --2- 172.21.15.49:0/895606647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c067220 0x7f464c067a90 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f464b200700 1 --2- 172.21.15.49:0/895606647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0a8b10 0x7f464c066d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f464b200700 1 -- 172.21.15.49:0/895606647 >> 172.21.15.49:0/895606647 conn(0x7f464c0c6540 msgr2=0x7f464c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f464b200700 1 -- 172.21.15.49:0/895606647 shutdown_connections 2024-01-22T05:20:27.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.598+0000 7f464b200700 1 -- 172.21.15.49:0/895606647 wait complete. 2024-01-22T05:20:27.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.602+0000 7f464b200700 1 Processor -- start 2024-01-22T05:20:27.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.602+0000 7f464b200700 1 -- start start 2024-01-22T05:20:27.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.602+0000 7f464b200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c067220 0x7f464c0c0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.602+0000 7f464b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f464c067f80 0x7f464c146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.602+0000 7f464b200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0a8b10 0x7f464c0abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.602+0000 7f464b200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0bfcb0 con 0x7f464c067220 2024-01-22T05:20:27.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.602+0000 7f464b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c146df0 con 0x7f464c067f80 2024-01-22T05:20:27.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.602+0000 7f464b200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0bf0a0 con 0x7f464c0a8b10 2024-01-22T05:20:27.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f4649e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c067220 0x7f464c0c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f4649e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c067220 0x7f464c0c0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33514/0 (socket says 172.21.15.49:33514) 2024-01-22T05:20:27.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f4649e00700 1 -- 172.21.15.49:0/619381056 learned_addr learned my addr 172.21.15.49:0/619381056 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f464a800700 1 --2- 172.21.15.49:0/619381056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0a8b10 0x7f464c0abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f4649400700 1 --2- 172.21.15.49:0/619381056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f464c067f80 0x7f464c146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f4649e00700 1 -- 172.21.15.49:0/619381056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0a8b10 msgr2=0x7f464c0abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f4649e00700 1 --2- 172.21.15.49:0/619381056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0a8b10 0x7f464c0abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f4649e00700 1 -- 172.21.15.49:0/619381056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f464c067f80 msgr2=0x7f464c146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f4649e00700 1 --2- 172.21.15.49:0/619381056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f464c067f80 0x7f464c146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f4649e00700 1 -- 172.21.15.49:0/619381056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4634009370 con 0x7f464c067220 2024-01-22T05:20:27.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f4649e00700 1 --2- 172.21.15.49:0/619381056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c067220 0x7f464c0c0140 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7f463c00e950 tx=0x7f463c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f4641600700 1 -- 172.21.15.49:0/619381056 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c00c850 con 0x7f464c067220 2024-01-22T05:20:27.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f4641600700 1 -- 172.21.15.49:0/619381056 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c00c9b0 con 0x7f464c067220 2024-01-22T05:20:27.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f464b200700 1 -- 172.21.15.49:0/619381056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464c0bf380 con 0x7f464c067220 2024-01-22T05:20:27.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f4641600700 1 -- 172.21.15.49:0/619381056 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c00cd30 con 0x7f464c067220 2024-01-22T05:20:27.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.606+0000 7f464b200700 1 -- 172.21.15.49:0/619381056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c0bf940 con 0x7f464c067220 2024-01-22T05:20:27.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.610+0000 7f4641600700 1 -- 172.21.15.49:0/619381056 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f463c012600 con 0x7f464c067220 2024-01-22T05:20:27.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.610+0000 7f4641600700 1 --2- 172.21.15.49:0/619381056 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f462405a510 0x7f462405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.610+0000 7f4641600700 1 -- 172.21.15.49:0/619381056 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f463c074ff0 con 0x7f464c067220 2024-01-22T05:20:27.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.610+0000 7f465b6eb740 1 Processor -- start 2024-01-22T05:20:27.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.610+0000 7f4649400700 1 --2- 172.21.15.49:0/619381056 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f462405a510 0x7f462405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f465b6eb740 1 -- start start 2024-01-22T05:20:27.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f4649400700 1 --2- 172.21.15.49:0/619381056 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f462405a510 0x7f462405c9d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f464c0a9340 tx=0x7f4634017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f465b6eb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b3d00 0x22b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f465b6eb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x226baa0 0x226a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f465b6eb740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2270810 0x226a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f465b6eb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x21cd540 con 0x226baa0 2024-01-22T05:20:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f465b6eb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2190e90 con 0x22b3d00 2024-01-22T05:20:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f465b6eb740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2196d90 con 0x2270810 2024-01-22T05:20:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f4649400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x226baa0 0x226a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f4649400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x226baa0 0x226a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33524/0 (socket says 172.21.15.49:33524) 2024-01-22T05:20:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f4649400700 1 -- 172.21.15.49:0/115525033 learned_addr learned my addr 172.21.15.49:0/115525033 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f4649e00700 1 --2- 172.21.15.49:0/115525033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b3d00 0x22b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f464a800700 1 --2- 172.21.15.49:0/115525033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2270810 0x226a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f4649400700 1 -- 172.21.15.49:0/115525033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2270810 msgr2=0x226a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f4649400700 1 --2- 172.21.15.49:0/115525033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2270810 0x226a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f4649400700 1 -- 172.21.15.49:0/115525033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b3d00 msgr2=0x22b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f4649400700 1 --2- 172.21.15.49:0/115525033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b3d00 0x22b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f4649400700 1 -- 172.21.15.49:0/115525033 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21fb4c0 con 0x226baa0 2024-01-22T05:20:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f4649400700 1 --2- 172.21.15.49:0/115525033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x226baa0 0x226a3a0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 rx=0x7f4634006fd0 tx=0x7f463401e070).ready entity=mon.0 client_cookie=4c07846ed2f269ac server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f463a000700 1 -- 172.21.15.49:0/115525033 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340069b0 con 0x226baa0 2024-01-22T05:20:27.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.614+0000 7f463a000700 1 -- 172.21.15.49:0/115525033 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4634000c90 con 0x226baa0 2024-01-22T05:20:27.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.618+0000 7f463a000700 1 -- 172.21.15.49:0/115525033 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463401c630 con 0x226baa0 2024-01-22T05:20:27.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.618+0000 7f465b6eb740 1 -- 172.21.15.49:0/115525033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x226baa0 msgr2=0x226a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.618+0000 7f465b6eb740 1 --2- 172.21.15.49:0/115525033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x226baa0 0x226a3a0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 rx=0x7f4634006fd0 tx=0x7f463401e070).stop 2024-01-22T05:20:27.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.618+0000 7f465b6eb740 1 -- 172.21.15.49:0/115525033 shutdown_connections 2024-01-22T05:20:27.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.618+0000 7f465b6eb740 1 --2- 172.21.15.49:0/115525033 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2270810 0x226a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.618+0000 7f465b6eb740 1 --2- 172.21.15.49:0/115525033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x226baa0 0x226a3a0 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.618+0000 7f465b6eb740 1 --2- 172.21.15.49:0/115525033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x22b3d00 0x22b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.618+0000 7f465b6eb740 1 -- 172.21.15.49:0/115525033 >> 172.21.15.49:0/115525033 conn(0x204f680 msgr2=0x226efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.618+0000 7f465b6eb740 1 -- 172.21.15.49:0/115525033 shutdown_connections 2024-01-22T05:20:27.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.618+0000 7f465b6eb740 1 -- 172.21.15.49:0/115525033 wait complete. 2024-01-22T05:20:27.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.618+0000 7f465b6eb740 1 -- start start 2024-01-22T05:20:27.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.618+0000 7f465b6eb740 1 Processor -- start 2024-01-22T05:20:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.622+0000 7f465b6eb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x226baa0 0x22881a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.622+0000 7f465b6eb740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2270810 0x229ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.622+0000 7f465b6eb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b3d00 0x229cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.622+0000 7f465b6eb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2298d50 con 0x22b3d00 2024-01-22T05:20:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.622+0000 7f465b6eb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x229af90 con 0x226baa0 2024-01-22T05:20:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.622+0000 7f465b6eb740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x229b4c0 con 0x2270810 2024-01-22T05:20:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.622+0000 7f465b6eb740 10 client.0 ll_register_callbacks cb 0x22275d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:20:27.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.622+0000 7f464a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b3d00 0x229cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.622+0000 7f464a800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b3d00 0x229cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33530/0 (socket says 172.21.15.49:33530) 2024-01-22T05:20:27.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.622+0000 7f464a800700 1 -- 172.21.15.49:0/1626473188 learned_addr learned my addr 172.21.15.49:0/1626473188 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.622+0000 7f4649e00700 1 --2- 172.21.15.49:0/1626473188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x226baa0 0x22881a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.622+0000 7f4649400700 1 --2- 172.21.15.49:0/1626473188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2270810 0x229ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f464a800700 1 -- 172.21.15.49:0/1626473188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2270810 msgr2=0x229ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f464a800700 1 --2- 172.21.15.49:0/1626473188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2270810 0x229ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f464a800700 1 -- 172.21.15.49:0/1626473188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x226baa0 msgr2=0x22881a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f464a800700 1 --2- 172.21.15.49:0/1626473188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x226baa0 0x22881a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f464a800700 1 -- 172.21.15.49:0/1626473188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c0bbde0 con 0x22b3d00 2024-01-22T05:20:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f4649e00700 1 --2- 172.21.15.49:0/1626473188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x226baa0 0x22881a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:20:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f464a800700 1 --2- 172.21.15.49:0/1626473188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b3d00 0x229cf00 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 rx=0x7f4644007e20 tx=0x7f4644009b40).ready entity=mon.0 client_cookie=1db8b6559cb31700 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f4632a00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:20:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f4632a00700 1 -- 172.21.15.49:0/1626473188 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644009e70 con 0x22b3d00 2024-01-22T05:20:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f4632a00700 1 -- 172.21.15.49:0/1626473188 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f4644002c60 con 0x22b3d00 2024-01-22T05:20:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f465b6eb740 1 -- 172.21.15.49:0/1626473188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x21e7230 con 0x22b3d00 2024-01-22T05:20:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f4632a00700 1 -- 172.21.15.49:0/1626473188 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4644016420 con 0x22b3d00 2024-01-22T05:20:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f465b6eb740 10 client.10806 fetch_fsmap learned FSMap version 157 2024-01-22T05:20:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f465b6eb740 1 -- 172.21.15.49:0/1626473188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x21ea7c0 con 0x22b3d00 2024-01-22T05:20:27.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f4632a00700 1 -- 172.21.15.49:0/1626473188 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x21e7230 con 0x22b3d00 2024-01-22T05:20:27.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f4632a00700 1 -- 172.21.15.49:0/1626473188 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4644014040 con 0x22b3d00 2024-01-22T05:20:27.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f465b6eb740 10 client.10806 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:20:27.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f465b6eb740 10 client.10806 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-01-22T05:20:27.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f465b6eb740 20 client.10806 populate_metadata read hostname 'smithi049' 2024-01-22T05:20:27.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f465b6eb740 1 --2- 172.21.15.49:0/1626473188 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x22c65d0 0x22c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f465b6eb740 4 client.10806 mds_command: new command op to 10656 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:20:27.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f465b6eb740 1 -- 172.21.15.49:0/1626473188 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x21dd780 con 0x22c65d0 2024-01-22T05:20:27.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f4649e00700 1 --2- 172.21.15.49:0/1626473188 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x22c65d0 0x22c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f4632a00700 10 client.10806 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:27.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.626+0000 7f4649e00700 1 --2- 172.21.15.49:0/1626473188 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x22c65d0 0x22c69e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=367af149a9035893 server_cookie=cea0edaf1428a606 in_seq=0 out_seq=0 2024-01-22T05:20:27.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.630+0000 7f4632a00700 1 -- 172.21.15.49:0/1626473188 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x21dd780 con 0x22c65d0 2024-01-22T05:20:27.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.630+0000 7f4632a00700 10 client.10806 handle_command_reply: tid=0 2024-01-22T05:20:27.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.630+0000 7f465b6eb740 1 client.10806 shutdown 2024-01-22T05:20:27.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.630+0000 7f465b6eb740 1 -- 172.21.15.49:0/1626473188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b3d00 msgr2=0x229cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.630+0000 7f465b6eb740 1 --2- 172.21.15.49:0/1626473188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b3d00 0x229cf00 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 rx=0x7f4644007e20 tx=0x7f4644009b40).stop 2024-01-22T05:20:27.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.630+0000 7f465b6eb740 1 -- 172.21.15.49:0/1626473188 shutdown_connections 2024-01-22T05:20:27.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.630+0000 7f465b6eb740 1 --2- 172.21.15.49:0/1626473188 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x22c65d0 0x22c69e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.630+0000 7f465b6eb740 1 --2- 172.21.15.49:0/1626473188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x22b3d00 0x229cf00 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.630+0000 7f465b6eb740 1 --2- 172.21.15.49:0/1626473188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x2270810 0x229ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.630+0000 7f4632a00700 0 client.10806 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:27.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.630+0000 7f465b6eb740 1 --2- 172.21.15.49:0/1626473188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x226baa0 0x22881a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.630+0000 7f465b6eb740 1 -- 172.21.15.49:0/1626473188 >> 172.21.15.49:0/1626473188 conn(0x204f680 msgr2=0x22b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.630+0000 7f465b6eb740 1 -- 172.21.15.49:0/1626473188 shutdown_connections 2024-01-22T05:20:27.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.630+0000 7f465b6eb740 1 -- 172.21.15.49:0/1626473188 wait complete. 2024-01-22T05:20:27.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.630+0000 7f465b6eb740 20 client.10806 trim_cache size 0 max 16384 2024-01-22T05:20:27.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.650+0000 7f465b6eb740 1 Processor -- start 2024-01-22T05:20:27.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.650+0000 7f465b6eb740 1 -- start start 2024-01-22T05:20:27.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.650+0000 7f465b6eb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x226baa0 0x22b5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.650+0000 7f465b6eb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2270810 0x22b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.650+0000 7f465b6eb740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b3d00 0x22c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.650+0000 7f465b6eb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0599d0 con 0x226baa0 2024-01-22T05:20:27.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.650+0000 7f465b6eb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2270280 con 0x2270810 2024-01-22T05:20:27.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.650+0000 7f465b6eb740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x226c540 con 0x22b3d00 2024-01-22T05:20:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.650+0000 7f4649e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x226baa0 0x22b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.650+0000 7f4649400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2270810 0x22b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.650+0000 7f4649400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2270810 0x22b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:50950/0 (socket says 172.21.15.49:50950) 2024-01-22T05:20:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.650+0000 7f4649400700 1 -- 172.21.15.49:0/4281023438 learned_addr learned my addr 172.21.15.49:0/4281023438 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.650+0000 7f4649e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x226baa0 0x22b5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33534/0 (socket says 172.21.15.49:33534) 2024-01-22T05:20:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f464a800700 1 --2- 172.21.15.49:0/4281023438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b3d00 0x22c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f4649e00700 1 -- 172.21.15.49:0/4281023438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b3d00 msgr2=0x22c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f4649e00700 1 --2- 172.21.15.49:0/4281023438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b3d00 0x22c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f4649e00700 1 -- 172.21.15.49:0/4281023438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2270810 msgr2=0x22b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f4649e00700 1 --2- 172.21.15.49:0/4281023438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2270810 0x22b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f4649e00700 1 -- 172.21.15.49:0/4281023438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c0c2480 con 0x226baa0 2024-01-22T05:20:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f4649e00700 1 --2- 172.21.15.49:0/4281023438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x226baa0 0x22b5230 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7f463c048760 tx=0x7f463c011000).ready entity=mon.0 client_cookie=29363041245be35c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f463aa00700 1 -- 172.21.15.49:0/4281023438 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c05f030 con 0x226baa0 2024-01-22T05:20:27.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f463aa00700 1 -- 172.21.15.49:0/4281023438 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c04a470 con 0x226baa0 2024-01-22T05:20:27.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f463aa00700 1 -- 172.21.15.49:0/4281023438 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c056040 con 0x226baa0 2024-01-22T05:20:27.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f465b6eb740 1 -- 172.21.15.49:0/4281023438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x226baa0 msgr2=0x22b5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f465b6eb740 1 --2- 172.21.15.49:0/4281023438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x226baa0 0x22b5230 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7f463c048760 tx=0x7f463c011000).stop 2024-01-22T05:20:27.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f465b6eb740 1 -- 172.21.15.49:0/4281023438 shutdown_connections 2024-01-22T05:20:27.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f465b6eb740 1 --2- 172.21.15.49:0/4281023438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b3d00 0x22c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f465b6eb740 1 --2- 172.21.15.49:0/4281023438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x2270810 0x22b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f465b6eb740 1 --2- 172.21.15.49:0/4281023438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x226baa0 0x22b5230 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f465b6eb740 1 -- 172.21.15.49:0/4281023438 >> 172.21.15.49:0/4281023438 conn(0x204f680 msgr2=0x22b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f465b6eb740 1 -- 172.21.15.49:0/4281023438 shutdown_connections 2024-01-22T05:20:27.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.654+0000 7f465b6eb740 1 -- 172.21.15.49:0/4281023438 wait complete. 2024-01-22T05:20:27.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.658+0000 7f465b6eb740 1 -- start start 2024-01-22T05:20:27.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.658+0000 7f465b6eb740 1 Processor -- start 2024-01-22T05:20:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.658+0000 7f465b6eb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x226baa0 0x2294570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.658+0000 7f465b6eb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2270810 0x22925c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.658+0000 7f465b6eb740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b3d00 0x2292ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.658+0000 7f465b6eb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2292fa0 con 0x2270810 2024-01-22T05:20:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.658+0000 7f465b6eb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x2295230 con 0x226baa0 2024-01-22T05:20:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.658+0000 7f465b6eb740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2295510 con 0x22b3d00 2024-01-22T05:20:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.658+0000 7f465b6eb740 10 client.0 ll_register_callbacks cb 0x7f4644009dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:20:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.658+0000 7f4649400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2270810 0x22925c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.658+0000 7f4649400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2270810 0x22925c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33542/0 (socket says 172.21.15.49:33542) 2024-01-22T05:20:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.658+0000 7f4649400700 1 -- 172.21.15.49:0/491640505 learned_addr learned my addr 172.21.15.49:0/491640505 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.658+0000 7f4649e00700 1 --2- 172.21.15.49:0/491640505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x226baa0 0x2294570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.658+0000 7f464a800700 1 --2- 172.21.15.49:0/491640505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b3d00 0x2292ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4649400700 1 -- 172.21.15.49:0/491640505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b3d00 msgr2=0x2292ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4649400700 1 --2- 172.21.15.49:0/491640505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b3d00 0x2292ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4649400700 1 -- 172.21.15.49:0/491640505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x226baa0 msgr2=0x2294570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4649400700 1 --2- 172.21.15.49:0/491640505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x226baa0 0x2294570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4649400700 1 -- 172.21.15.49:0/491640505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c0bf940 con 0x2270810 2024-01-22T05:20:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4649400700 1 --2- 172.21.15.49:0/491640505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2270810 0x22925c0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 rx=0x7f464c05f4d0 tx=0x7f4634027000).ready entity=mon.0 client_cookie=333c7bd6c2db8901 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4632a00700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:20:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4632a00700 1 -- 172.21.15.49:0/491640505 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634034040 con 0x2270810 2024-01-22T05:20:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f465b6eb740 1 -- 172.21.15.49:0/491640505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4634000c90 con 0x2270810 2024-01-22T05:20:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4632a00700 1 -- 172.21.15.49:0/491640505 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 6560+0+0 (secure 0 0 0) 0x7f463401cbb0 con 0x2270810 2024-01-22T05:20:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4632a00700 1 -- 172.21.15.49:0/491640505 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7f463403b450 con 0x2270810 2024-01-22T05:20:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f465b6eb740 10 client.10812 fetch_fsmap learned FSMap version 157 2024-01-22T05:20:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f465b6eb740 1 -- 172.21.15.49:0/491640505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x21e59f0 con 0x2270810 2024-01-22T05:20:27.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4632a00700 1 -- 172.21.15.49:0/491640505 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4634000c90 con 0x2270810 2024-01-22T05:20:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4632a00700 1 -- 172.21.15.49:0/491640505 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f463403b5b0 con 0x2270810 2024-01-22T05:20:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f465b6eb740 10 client.10812 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:20:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f465b6eb740 10 client.10812 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-01-22T05:20:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f465b6eb740 20 client.10812 populate_metadata read hostname 'smithi049' 2024-01-22T05:20:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f465b6eb740 1 --2- 172.21.15.49:0/491640505 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x22b7450 0x22b7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f465b6eb740 4 client.10812 mds_command: new command op to 10656 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:20:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f465b6eb740 1 -- 172.21.15.49:0/491640505 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x20a6610 con 0x22b7450 2024-01-22T05:20:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4649e00700 1 --2- 172.21.15.49:0/491640505 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x22b7450 0x22b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4649e00700 1 --2- 172.21.15.49:0/491640505 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x22b7450 0x22b7860 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=39fff717bf6f73bb server_cookie=deba0f6197ab90a in_seq=0 out_seq=0 2024-01-22T05:20:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4632a00700 10 client.10812 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:27.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4632a00700 1 -- 172.21.15.49:0/491640505 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x20a6610 con 0x22b7450 2024-01-22T05:20:27.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.662+0000 7f4632a00700 10 client.10812 handle_command_reply: tid=0 2024-01-22T05:20:27.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f465b6eb740 1 client.10812 shutdown 2024-01-22T05:20:27.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f465b6eb740 1 -- 172.21.15.49:0/491640505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2270810 msgr2=0x22925c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f465b6eb740 1 --2- 172.21.15.49:0/491640505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2270810 0x22925c0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 rx=0x7f464c05f4d0 tx=0x7f4634027000).stop 2024-01-22T05:20:27.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f465b6eb740 1 -- 172.21.15.49:0/491640505 shutdown_connections 2024-01-22T05:20:27.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f465b6eb740 1 --2- 172.21.15.49:0/491640505 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x22b7450 0x22b7860 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f465b6eb740 1 --2- 172.21.15.49:0/491640505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x22b3d00 0x2292ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f465b6eb740 1 --2- 172.21.15.49:0/491640505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x2270810 0x22925c0 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f465b6eb740 1 --2- 172.21.15.49:0/491640505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x226baa0 0x2294570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f4632a00700 0 client.10812 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:27.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f465b6eb740 1 -- 172.21.15.49:0/491640505 >> 172.21.15.49:0/491640505 conn(0x204f680 msgr2=0x22b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f465b6eb740 1 -- 172.21.15.49:0/491640505 shutdown_connections 2024-01-22T05:20:27.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f465b6eb740 1 -- 172.21.15.49:0/491640505 wait complete. 2024-01-22T05:20:27.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f465b6eb740 20 client.10812 trim_cache size 0 max 16384 2024-01-22T05:20:27.669 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:20:27.669 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-01-22T05:20:27.669 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-01-22T05:20:27.669 INFO:teuthology.orchestra.run.smithi049.stdout: "dc814411-f827-4ecc-9348-9bb09610575e": { 2024-01-22T05:20:27.669 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-01-22T05:20:27.669 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "dc814411-f827-4ecc-9348-9bb09610575e", 2024-01-22T05:20:27.669 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,repair" 2024-01-22T05:20:27.669 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:20:27.669 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-22T05:20:27.669 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:20:27.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f464b200700 1 -- 172.21.15.49:0/619381056 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f462405a510 msgr2=0x7f462405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f464b200700 1 --2- 172.21.15.49:0/619381056 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f462405a510 0x7f462405c9d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f464c0a9340 tx=0x7f4634017000).stop 2024-01-22T05:20:27.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f464b200700 1 -- 172.21.15.49:0/619381056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c067220 msgr2=0x7f464c0c0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:27.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f464b200700 1 --2- 172.21.15.49:0/619381056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c067220 0x7f464c0c0140 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7f463c00e950 tx=0x7f463c009060).stop 2024-01-22T05:20:27.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f464b200700 1 -- 172.21.15.49:0/619381056 shutdown_connections 2024-01-22T05:20:27.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f464b200700 1 --2- 172.21.15.49:0/619381056 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f462405a510 0x7f462405c9d0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f464b200700 1 --2- 172.21.15.49:0/619381056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f464c0a8b10 0x7f464c0abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f464b200700 1 --2- 172.21.15.49:0/619381056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f464c067f80 0x7f464c146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f464b200700 1 --2- 172.21.15.49:0/619381056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f464c067220 0x7f464c0c0140 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:27.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f464b200700 1 -- 172.21.15.49:0/619381056 >> 172.21.15.49:0/619381056 conn(0x7f464c0c6540 msgr2=0x7f464c0c2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:27.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f464b200700 1 -- 172.21.15.49:0/619381056 shutdown_connections 2024-01-22T05:20:27.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:27.666+0000 7f464b200700 1 -- 172.21.15.49:0/619381056 wait complete. 2024-01-22T05:20:27.694 INFO:tasks.cephfs.filesystem:scrub status for tag:dc814411-f827-4ecc-9348-9bb09610575e - {'path': '/', 'tag': 'dc814411-f827-4ecc-9348-9bb09610575e', 'options': 'recursive,repair'} 2024-01-22T05:20:40.479 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:20:40.486 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:20:57.696 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub status 2024-01-22T05:20:57.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.869+0000 7f89eae00700 1 Processor -- start 2024-01-22T05:20:57.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.869+0000 7f89eae00700 1 -- start start 2024-01-22T05:20:57.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.873+0000 7f89eae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89e40c1fa0 0x7f89e4157a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.873+0000 7f89eae00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f89e4157f00 0x7f89e40a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.873+0000 7f89eae00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89e40a6220 0x7f89e40bc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.873+0000 7f89eae00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e40a66b0 con 0x7f89e40a6220 2024-01-22T05:20:57.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.873+0000 7f89eae00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e4158660 con 0x7f89e4157f00 2024-01-22T05:20:57.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.873+0000 7f89eae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e4067de0 con 0x7f89e40c1fa0 2024-01-22T05:20:57.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.873+0000 7f89ea400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89e40a6220 0x7f89e40bc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.873+0000 7f89ea400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89e40a6220 0x7f89e40bc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41072/0 (socket says 172.21.15.49:41072) 2024-01-22T05:20:57.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.873+0000 7f89ea400700 1 -- 172.21.15.49:0/2287019488 learned_addr learned my addr 172.21.15.49:0/2287019488 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:57.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.873+0000 7f89e9a00700 1 --2- 172.21.15.49:0/2287019488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89e40c1fa0 0x7f89e4157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.873+0000 7f89e9000700 1 --2- 172.21.15.49:0/2287019488 >> v2:172.21.15.110:3300/0 conn(0x7f89e4157f00 0x7f89e40a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.873+0000 7f89ea400700 1 -- 172.21.15.49:0/2287019488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89e40c1fa0 msgr2=0x7f89e4157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89ea400700 1 --2- 172.21.15.49:0/2287019488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89e40c1fa0 0x7f89e4157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89ea400700 1 -- 172.21.15.49:0/2287019488 >> v2:172.21.15.110:3300/0 conn(0x7f89e4157f00 msgr2=0x7f89e40a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89ea400700 1 --2- 172.21.15.49:0/2287019488 >> v2:172.21.15.110:3300/0 conn(0x7f89e4157f00 0x7f89e40a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89ea400700 1 -- 172.21.15.49:0/2287019488 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e40680c0 con 0x7f89e40a6220 2024-01-22T05:20:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89e9000700 1 --2- 172.21.15.49:0/2287019488 >> v2:172.21.15.110:3300/0 conn(0x7f89e4157f00 0x7f89e40a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:20:57.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89ea400700 1 --2- 172.21.15.49:0/2287019488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e40a6220 0x7f89e40bc010 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7f89e405f4c0 tx=0x7f89dc009840).ready entity=mon.0 client_cookie=3a4f472b6c56942f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89e3e00700 1 -- 172.21.15.49:0/2287019488 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc00e070 con 0x7f89e40a6220 2024-01-22T05:20:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89e3e00700 1 -- 172.21.15.49:0/2287019488 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc00ba20 con 0x7f89e40a6220 2024-01-22T05:20:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89e3e00700 1 -- 172.21.15.49:0/2287019488 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc00bda0 con 0x7f89e40a6220 2024-01-22T05:20:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89eae00700 1 -- 172.21.15.49:0/2287019488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e40a6220 msgr2=0x7f89e40bc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:57.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89eae00700 1 --2- 172.21.15.49:0/2287019488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e40a6220 0x7f89e40bc010 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7f89e405f4c0 tx=0x7f89dc009840).stop 2024-01-22T05:20:57.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89eae00700 1 -- 172.21.15.49:0/2287019488 shutdown_connections 2024-01-22T05:20:57.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89eae00700 1 --2- 172.21.15.49:0/2287019488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e40a6220 0x7f89e40bc010 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89eae00700 1 --2- 172.21.15.49:0/2287019488 >> v2:172.21.15.110:3300/0 conn(0x7f89e4157f00 0x7f89e40a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89eae00700 1 --2- 172.21.15.49:0/2287019488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89e40c1fa0 0x7f89e4157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89eae00700 1 -- 172.21.15.49:0/2287019488 >> 172.21.15.49:0/2287019488 conn(0x7f89e40c3830 msgr2=0x7f89e40c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89eae00700 1 -- 172.21.15.49:0/2287019488 shutdown_connections 2024-01-22T05:20:57.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.877+0000 7f89eae00700 1 -- 172.21.15.49:0/2287019488 wait complete. 2024-01-22T05:20:57.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.881+0000 7f89eae00700 1 Processor -- start 2024-01-22T05:20:57.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.885+0000 7f89eae00700 1 -- start start 2024-01-22T05:20:57.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.885+0000 7f89eae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89e40a6220 0x7f89e40a8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.885+0000 7f89eae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89e40c1fa0 0x7f89e40a8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.885+0000 7f89eae00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e4157f00 0x7f89e40bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.885+0000 7f89eae00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40a91d0 con 0x7f89e4157f00 2024-01-22T05:20:57.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.885+0000 7f89eae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40aa2b0 con 0x7f89e40c1fa0 2024-01-22T05:20:57.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.885+0000 7f89eae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40a8ef0 con 0x7f89e40a6220 2024-01-22T05:20:57.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.885+0000 7f89ea400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e4157f00 0x7f89e40bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.885+0000 7f89ea400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e4157f00 0x7f89e40bfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41082/0 (socket says 172.21.15.49:41082) 2024-01-22T05:20:57.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.885+0000 7f89ea400700 1 -- 172.21.15.49:0/3404511664 learned_addr learned my addr 172.21.15.49:0/3404511664 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.885+0000 7f89e9000700 1 --2- 172.21.15.49:0/3404511664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89e40c1fa0 0x7f89e40a8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.885+0000 7f89e9a00700 1 --2- 172.21.15.49:0/3404511664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89e40a6220 0x7f89e40a8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.889+0000 7f89ea400700 1 -- 172.21.15.49:0/3404511664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89e40a6220 msgr2=0x7f89e40a8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.889+0000 7f89ea400700 1 --2- 172.21.15.49:0/3404511664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89e40a6220 0x7f89e40a8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.889+0000 7f89ea400700 1 -- 172.21.15.49:0/3404511664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89e40c1fa0 msgr2=0x7f89e40a8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.889+0000 7f89ea400700 1 --2- 172.21.15.49:0/3404511664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89e40c1fa0 0x7f89e40a8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.889+0000 7f89ea400700 1 -- 172.21.15.49:0/3404511664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc009ae0 con 0x7f89e4157f00 2024-01-22T05:20:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.889+0000 7f89ea400700 1 --2- 172.21.15.49:0/3404511664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e4157f00 0x7f89e40bfad0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 rx=0x7f89e405f540 tx=0x7f89e40c2ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.889+0000 7f89e0c00700 1 -- 172.21.15.49:0/3404511664 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc0032f0 con 0x7f89e4157f00 2024-01-22T05:20:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.889+0000 7f89e0c00700 1 -- 172.21.15.49:0/3404511664 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc0092e0 con 0x7f89e4157f00 2024-01-22T05:20:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.889+0000 7f89e0c00700 1 -- 172.21.15.49:0/3404511664 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc01e6a0 con 0x7f89e4157f00 2024-01-22T05:20:57.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.889+0000 7f89eae00700 1 -- 172.21.15.49:0/3404511664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e40aa550 con 0x7f89e4157f00 2024-01-22T05:20:57.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.889+0000 7f89eae00700 1 -- 172.21.15.49:0/3404511664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e40a8c10 con 0x7f89e4157f00 2024-01-22T05:20:57.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.893+0000 7f89e0c00700 1 -- 172.21.15.49:0/3404511664 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f89dc003040 con 0x7f89e4157f00 2024-01-22T05:20:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.893+0000 7f89e0c00700 1 --2- 172.21.15.49:0/3404511664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f89bc05a510 0x7f89bc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.893+0000 7f89e0c00700 1 -- 172.21.15.49:0/3404511664 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7f89dc075d70 con 0x7f89e4157f00 2024-01-22T05:20:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.893+0000 7f89e9a00700 1 --2- 172.21.15.49:0/3404511664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f89bc05a510 0x7f89bc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.893+0000 7f89f6832740 1 Processor -- start 2024-01-22T05:20:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.893+0000 7f89f6832740 1 -- start start 2024-01-22T05:20:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.893+0000 7f89e9a00700 1 --2- 172.21.15.49:0/3404511664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f89bc05a510 0x7f89bc05c9d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f89d4009c30 tx=0x7f89d4009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:57.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89f6832740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28eb4d0 0x28eb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89f6832740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2570 0x28f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89f6832740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 0x28d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89f6832740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x2803540 con 0x28eb4d0 2024-01-22T05:20:57.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89f6832740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x27c6e90 con 0x28f2ee0 2024-01-22T05:20:57.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89f6832740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x27ccd90 con 0x28f2570 2024-01-22T05:20:57.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89e9a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28eb4d0 0x28eb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89e9a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28eb4d0 0x28eb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41086/0 (socket says 172.21.15.49:41086) 2024-01-22T05:20:57.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89e9a00700 1 -- 172.21.15.49:0/1706510706 learned_addr learned my addr 172.21.15.49:0/1706510706 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:57.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89ea400700 1 --2- 172.21.15.49:0/1706510706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 0x28d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89e9000700 1 --2- 172.21.15.49:0/1706510706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2570 0x28f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89e9a00700 1 -- 172.21.15.49:0/1706510706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2570 msgr2=0x28f29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:57.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89e9a00700 1 --2- 172.21.15.49:0/1706510706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2570 0x28f29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89e9a00700 1 -- 172.21.15.49:0/1706510706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 msgr2=0x28d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:57.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89e9a00700 1 --2- 172.21.15.49:0/1706510706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 0x28d14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89e9a00700 1 -- 172.21.15.49:0/1706510706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28314c0 con 0x28eb4d0 2024-01-22T05:20:57.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89e9a00700 1 --2- 172.21.15.49:0/1706510706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28eb4d0 0x28eb8b0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 rx=0x7f89d4011db0 tx=0x7f89d4017000).ready entity=mon.0 client_cookie=d51cd5df5bca9c32 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:57.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89d9600700 1 -- 172.21.15.49:0/1706510706 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d4011eb0 con 0x28eb4d0 2024-01-22T05:20:57.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89d9600700 1 -- 172.21.15.49:0/1706510706 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d4014c60 con 0x28eb4d0 2024-01-22T05:20:57.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.897+0000 7f89d9600700 1 -- 172.21.15.49:0/1706510706 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d401e3f0 con 0x28eb4d0 2024-01-22T05:20:57.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.901+0000 7f89f6832740 1 -- 172.21.15.49:0/1706510706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28eb4d0 msgr2=0x28eb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:57.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.901+0000 7f89f6832740 1 --2- 172.21.15.49:0/1706510706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28eb4d0 0x28eb8b0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 rx=0x7f89d4011db0 tx=0x7f89d4017000).stop 2024-01-22T05:20:57.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.901+0000 7f89f6832740 1 -- 172.21.15.49:0/1706510706 shutdown_connections 2024-01-22T05:20:57.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.901+0000 7f89f6832740 1 --2- 172.21.15.49:0/1706510706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 0x28d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.901+0000 7f89f6832740 1 --2- 172.21.15.49:0/1706510706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2570 0x28f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.901+0000 7f89f6832740 1 --2- 172.21.15.49:0/1706510706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28eb4d0 0x28eb8b0 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.901+0000 7f89f6832740 1 -- 172.21.15.49:0/1706510706 >> 172.21.15.49:0/1706510706 conn(0x2685680 msgr2=0x28a4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:57.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.901+0000 7f89f6832740 1 -- 172.21.15.49:0/1706510706 shutdown_connections 2024-01-22T05:20:57.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.901+0000 7f89f6832740 1 -- 172.21.15.49:0/1706510706 wait complete. 2024-01-22T05:20:57.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.901+0000 7f89f6832740 1 -- start start 2024-01-22T05:20:57.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.901+0000 7f89f6832740 1 Processor -- start 2024-01-22T05:20:57.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89f6832740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28eb4d0 0x28cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89f6832740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28f2570 0x28cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89f6832740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 0x28cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89f6832740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x28a2b20 con 0x28f2570 2024-01-22T05:20:57.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89f6832740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x28a42b0 con 0x28f2ee0 2024-01-22T05:20:57.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89f6832740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x28ce1f0 con 0x28eb4d0 2024-01-22T05:20:57.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89f6832740 10 client.0 ll_register_callbacks cb 0x285d5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:20:57.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89e9000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28f2570 0x28cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89e9000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28f2570 0x28cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41088/0 (socket says 172.21.15.49:41088) 2024-01-22T05:20:57.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89e9000700 1 -- 172.21.15.49:0/2320996689 learned_addr learned my addr 172.21.15.49:0/2320996689 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:57.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89ea400700 1 --2- 172.21.15.49:0/2320996689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 0x28cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89e9a00700 1 --2- 172.21.15.49:0/2320996689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28eb4d0 0x28cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89ea400700 1 -- 172.21.15.49:0/2320996689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28eb4d0 msgr2=0x28cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:57.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89ea400700 1 --2- 172.21.15.49:0/2320996689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28eb4d0 0x28cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89ea400700 1 -- 172.21.15.49:0/2320996689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28f2570 msgr2=0x28cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:57.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89ea400700 1 --2- 172.21.15.49:0/2320996689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28f2570 0x28cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89ea400700 1 -- 172.21.15.49:0/2320996689 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d40119d0 con 0x28f2ee0 2024-01-22T05:20:57.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89ea400700 1 --2- 172.21.15.49:0/2320996689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 0x28cf170 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f89dc0094b0 tx=0x7f89dc02a040).ready entity=mon.1 client_cookie=c1d888bc569311ab server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:57.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.905+0000 7f89d2000700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-01-22T05:20:57.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89d2000700 1 -- 172.21.15.49:0/2320996689 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc04c660 con 0x28f2ee0 2024-01-22T05:20:57.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89d2000700 1 -- 172.21.15.49:0/2320996689 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7f89dc0522f0 con 0x28f2ee0 2024-01-22T05:20:57.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89f6832740 1 -- 172.21.15.49:0/2320996689 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x281d230 con 0x28f2ee0 2024-01-22T05:20:57.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89d2000700 1 -- 172.21.15.49:0/2320996689 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89dc048d50 con 0x28f2ee0 2024-01-22T05:20:57.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89f6832740 10 client.10684 fetch_fsmap learned FSMap version 157 2024-01-22T05:20:57.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89f6832740 1 -- 172.21.15.49:0/2320996689 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x28207c0 con 0x28f2ee0 2024-01-22T05:20:57.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89d2000700 1 -- 172.21.15.49:0/2320996689 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x281d230 con 0x28f2ee0 2024-01-22T05:20:57.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89d2000700 1 -- 172.21.15.49:0/2320996689 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f89dc048eb0 con 0x28f2ee0 2024-01-22T05:20:57.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89f6832740 10 client.10684 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:20:57.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89f6832740 10 client.10684 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-01-22T05:20:57.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89f6832740 20 client.10684 populate_metadata read hostname 'smithi049' 2024-01-22T05:20:57.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89f6832740 1 --2- 172.21.15.49:0/2320996689 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x28e42a0 0x28e46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89f6832740 4 client.10684 mds_command: new command op to 10656 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:20:57.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89f6832740 1 -- 172.21.15.49:0/2320996689 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2813780 con 0x28e42a0 2024-01-22T05:20:57.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89e9a00700 1 --2- 172.21.15.49:0/2320996689 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x28e42a0 0x28e46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89e9a00700 1 --2- 172.21.15.49:0/2320996689 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x28e42a0 0x28e46b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fcb067e2d02b05f3 server_cookie=12510857c2b1c5e1 in_seq=0 out_seq=0 2024-01-22T05:20:57.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89d2000700 10 client.10684 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:57.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89d2000700 1 -- 172.21.15.49:0/2320996689 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2813780 con 0x28e42a0 2024-01-22T05:20:57.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89d2000700 10 client.10684 handle_command_reply: tid=0 2024-01-22T05:20:57.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.909+0000 7f89f6832740 1 client.10684 shutdown 2024-01-22T05:20:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.913+0000 7f89f6832740 1 -- 172.21.15.49:0/2320996689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 msgr2=0x28cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.913+0000 7f89f6832740 1 --2- 172.21.15.49:0/2320996689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 0x28cf170 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f89dc0094b0 tx=0x7f89dc02a040).stop 2024-01-22T05:20:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.913+0000 7f89f6832740 1 -- 172.21.15.49:0/2320996689 shutdown_connections 2024-01-22T05:20:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.913+0000 7f89f6832740 1 --2- 172.21.15.49:0/2320996689 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x28e42a0 0x28e46b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.913+0000 7f89f6832740 1 --2- 172.21.15.49:0/2320996689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 0x28cf170 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.913+0000 7f89f6832740 1 --2- 172.21.15.49:0/2320996689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28f2570 0x28cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.913+0000 7f89f6832740 1 --2- 172.21.15.49:0/2320996689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28eb4d0 0x28cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.913+0000 7f89d2000700 0 client.10684 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.913+0000 7f89f6832740 1 -- 172.21.15.49:0/2320996689 >> 172.21.15.49:0/2320996689 conn(0x2685680 msgr2=0x28ec230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.913+0000 7f89f6832740 1 -- 172.21.15.49:0/2320996689 shutdown_connections 2024-01-22T05:20:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.913+0000 7f89f6832740 1 -- 172.21.15.49:0/2320996689 wait complete. 2024-01-22T05:20:57.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.913+0000 7f89f6832740 20 client.10684 trim_cache size 0 max 16384 2024-01-22T05:20:57.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.933+0000 7f89f6832740 1 Processor -- start 2024-01-22T05:20:57.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.933+0000 7f89f6832740 1 -- start start 2024-01-22T05:20:57.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.933+0000 7f89f6832740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28eb4d0 0x2901e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.933+0000 7f89f6832740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28f2570 0x28a2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.933+0000 7f89f6832740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2ee0 0x28a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.933+0000 7f89f6832740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x27dee00 con 0x28f2570 2024-01-22T05:20:57.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.933+0000 7f89f6832740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x28ccb30 con 0x28eb4d0 2024-01-22T05:20:57.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.933+0000 7f89f6832740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x28a67b0 con 0x28f2ee0 2024-01-22T05:20:57.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89e9000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28f2570 0x28a2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89e9000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28f2570 0x28a2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41094/0 (socket says 172.21.15.49:41094) 2024-01-22T05:20:57.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89e9000700 1 -- 172.21.15.49:0/916923601 learned_addr learned my addr 172.21.15.49:0/916923601 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:57.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89ea400700 1 --2- 172.21.15.49:0/916923601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2ee0 0x28a32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89e9a00700 1 --2- 172.21.15.49:0/916923601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28eb4d0 0x2901e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89e9000700 1 -- 172.21.15.49:0/916923601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2ee0 msgr2=0x28a32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:57.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89e9000700 1 --2- 172.21.15.49:0/916923601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2ee0 0x28a32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89e9000700 1 -- 172.21.15.49:0/916923601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28eb4d0 msgr2=0x2901e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:57.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89e9000700 1 --2- 172.21.15.49:0/916923601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28eb4d0 0x2901e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89e9000700 1 -- 172.21.15.49:0/916923601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e40a5c20 con 0x28f2570 2024-01-22T05:20:57.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89e9000700 1 --2- 172.21.15.49:0/916923601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28f2570 0x28a2dc0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 rx=0x7f89cc00bca0 tx=0x7f89cc008040).ready entity=mon.0 client_cookie=f43f771d945053b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:57.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89da000700 1 -- 172.21.15.49:0/916923601 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc00b910 con 0x28f2570 2024-01-22T05:20:57.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89da000700 1 -- 172.21.15.49:0/916923601 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc016c90 con 0x28f2570 2024-01-22T05:20:57.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89da000700 1 -- 172.21.15.49:0/916923601 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc01f650 con 0x28f2570 2024-01-22T05:20:57.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89f6832740 1 -- 172.21.15.49:0/916923601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28f2570 msgr2=0x28a2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:57.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89f6832740 1 --2- 172.21.15.49:0/916923601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28f2570 0x28a2dc0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 rx=0x7f89cc00bca0 tx=0x7f89cc008040).stop 2024-01-22T05:20:57.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89f6832740 1 -- 172.21.15.49:0/916923601 shutdown_connections 2024-01-22T05:20:57.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89f6832740 1 --2- 172.21.15.49:0/916923601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2ee0 0x28a32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89f6832740 1 --2- 172.21.15.49:0/916923601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28f2570 0x28a2dc0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89f6832740 1 --2- 172.21.15.49:0/916923601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28eb4d0 0x2901e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89f6832740 1 -- 172.21.15.49:0/916923601 >> 172.21.15.49:0/916923601 conn(0x2685680 msgr2=0x28cef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:57.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89f6832740 1 -- 172.21.15.49:0/916923601 shutdown_connections 2024-01-22T05:20:57.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.937+0000 7f89f6832740 1 -- 172.21.15.49:0/916923601 wait complete. 2024-01-22T05:20:57.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.941+0000 7f89f6832740 1 -- start start 2024-01-22T05:20:57.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.941+0000 7f89f6832740 1 Processor -- start 2024-01-22T05:20:57.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.941+0000 7f89f6832740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28eb4d0 0x2949550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.941+0000 7f89f6832740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2570 0x28ebdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.941+0000 7f89f6832740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 0x28ec2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.941+0000 7f89f6832740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x28eaa20 con 0x28eb4d0 2024-01-22T05:20:57.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.941+0000 7f89f6832740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x28ec7a0 con 0x28f2ee0 2024-01-22T05:20:57.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.941+0000 7f89f6832740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x2950620 con 0x28f2570 2024-01-22T05:20:57.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.941+0000 7f89f6832740 10 client.0 ll_register_callbacks cb 0x7f89dc049320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:20:57.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.941+0000 7f89e9a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28eb4d0 0x2949550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.941+0000 7f89e9a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28eb4d0 0x2949550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41108/0 (socket says 172.21.15.49:41108) 2024-01-22T05:20:57.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.941+0000 7f89e9a00700 1 -- 172.21.15.49:0/1344721403 learned_addr learned my addr 172.21.15.49:0/1344721403 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:57.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.941+0000 7f89e9000700 1 --2- 172.21.15.49:0/1344721403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2570 0x28ebdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.941+0000 7f89ea400700 1 --2- 172.21.15.49:0/1344721403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 0x28ec2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.941+0000 7f89e9a00700 1 -- 172.21.15.49:0/1344721403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2570 msgr2=0x28ebdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:57.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89e9a00700 1 --2- 172.21.15.49:0/1344721403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2570 0x28ebdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89e9a00700 1 -- 172.21.15.49:0/1344721403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 msgr2=0x28ec2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:57.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89e9a00700 1 --2- 172.21.15.49:0/1344721403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 0x28ec2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89e9a00700 1 -- 172.21.15.49:0/1344721403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc00e040 con 0x28eb4d0 2024-01-22T05:20:57.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89e9000700 1 --2- 172.21.15.49:0/1344721403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2570 0x28ebdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:20:57.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89ea400700 1 --2- 172.21.15.49:0/1344721403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 0x28ec2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:20:57.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89e9a00700 1 --2- 172.21.15.49:0/1344721403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28eb4d0 0x2949550 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 rx=0x7f89d4009130 tx=0x7f89d402b040).ready entity=mon.0 client_cookie=77144987cd7f9bb4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:57.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89d2000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:20:57.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89d2000700 1 -- 172.21.15.49:0/1344721403 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d4030070 con 0x28eb4d0 2024-01-22T05:20:57.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89d2000700 1 -- 172.21.15.49:0/1344721403 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7f89d4011de0 con 0x28eb4d0 2024-01-22T05:20:57.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89f6832740 1 -- 172.21.15.49:0/1344721403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f89d4014c60 con 0x28eb4d0 2024-01-22T05:20:57.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89d2000700 1 -- 172.21.15.49:0/1344721403 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89d4034280 con 0x28eb4d0 2024-01-22T05:20:57.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89f6832740 10 client.10830 fetch_fsmap learned FSMap version 157 2024-01-22T05:20:57.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89f6832740 1 -- 172.21.15.49:0/1344721403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x281b9f0 con 0x28eb4d0 2024-01-22T05:20:57.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89d2000700 1 -- 172.21.15.49:0/1344721403 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d4014c60 con 0x28eb4d0 2024-01-22T05:20:57.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89d2000700 1 -- 172.21.15.49:0/1344721403 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f89d4025070 con 0x28eb4d0 2024-01-22T05:20:57.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89f6832740 10 client.10830 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:20:57.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89f6832740 10 client.10830 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-01-22T05:20:57.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89f6832740 20 client.10830 populate_metadata read hostname 'smithi049' 2024-01-22T05:20:57.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89f6832740 1 --2- 172.21.15.49:0/1344721403 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x28edbf0 0x28edfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:57.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89f6832740 4 client.10830 mds_command: new command op to 10656 tid=0[{"prefix": "scrub status"}] 2024-01-22T05:20:57.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89f6832740 1 -- 172.21.15.49:0/1344721403 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x26dc610 con 0x28edbf0 2024-01-22T05:20:57.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89e9000700 1 --2- 172.21.15.49:0/1344721403 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x28edbf0 0x28edfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:57.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89d2000700 10 client.10830 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:57.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89e9000700 1 --2- 172.21.15.49:0/1344721403 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x28edbf0 0x28edfd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=82381a83d9cb45a0 server_cookie=ad6617d75db8e9d9 in_seq=0 out_seq=0 2024-01-22T05:20:57.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89d2000700 1 -- 172.21.15.49:0/1344721403 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x26dc610 con 0x28edbf0 2024-01-22T05:20:57.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89d2000700 10 client.10830 handle_command_reply: tid=0 2024-01-22T05:20:57.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.945+0000 7f89f6832740 1 client.10830 shutdown 2024-01-22T05:20:57.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89f6832740 1 -- 172.21.15.49:0/1344721403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28eb4d0 msgr2=0x2949550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:57.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89f6832740 1 --2- 172.21.15.49:0/1344721403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28eb4d0 0x2949550 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 rx=0x7f89d4009130 tx=0x7f89d402b040).stop 2024-01-22T05:20:57.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89f6832740 1 -- 172.21.15.49:0/1344721403 shutdown_connections 2024-01-22T05:20:57.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89f6832740 1 --2- 172.21.15.49:0/1344721403 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x28edbf0 0x28edfd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89f6832740 1 --2- 172.21.15.49:0/1344721403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x28f2ee0 0x28ec2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89f6832740 1 --2- 172.21.15.49:0/1344721403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x28f2570 0x28ebdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89f6832740 1 --2- 172.21.15.49:0/1344721403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x28eb4d0 0x2949550 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89d2000700 0 client.10830 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:57.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89f6832740 1 -- 172.21.15.49:0/1344721403 >> 172.21.15.49:0/1344721403 conn(0x2685680 msgr2=0x28a4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:57.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89f6832740 1 -- 172.21.15.49:0/1344721403 shutdown_connections 2024-01-22T05:20:57.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89f6832740 1 -- 172.21.15.49:0/1344721403 wait complete. 2024-01-22T05:20:57.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89f6832740 20 client.10830 trim_cache size 0 max 16384 2024-01-22T05:20:57.953 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:20:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-01-22T05:20:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-01-22T05:20:57.953 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:20:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89eae00700 1 -- 172.21.15.49:0/3404511664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f89bc05a510 msgr2=0x7f89bc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89eae00700 1 --2- 172.21.15.49:0/3404511664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f89bc05a510 0x7f89bc05c9d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f89d4009c30 tx=0x7f89d4009060).stop 2024-01-22T05:20:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89eae00700 1 -- 172.21.15.49:0/3404511664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e4157f00 msgr2=0x7f89e40bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89eae00700 1 --2- 172.21.15.49:0/3404511664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e4157f00 0x7f89e40bfad0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 rx=0x7f89e405f540 tx=0x7f89e40c2ac0).stop 2024-01-22T05:20:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89eae00700 1 -- 172.21.15.49:0/3404511664 shutdown_connections 2024-01-22T05:20:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89eae00700 1 --2- 172.21.15.49:0/3404511664 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f89bc05a510 0x7f89bc05c9d0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89eae00700 1 --2- 172.21.15.49:0/3404511664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89e4157f00 0x7f89e40bfad0 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89eae00700 1 --2- 172.21.15.49:0/3404511664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89e40c1fa0 0x7f89e40a8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89eae00700 1 --2- 172.21.15.49:0/3404511664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89e40a6220 0x7f89e40a8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:57.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89eae00700 1 -- 172.21.15.49:0/3404511664 >> 172.21.15.49:0/3404511664 conn(0x7f89e40c3830 msgr2=0x7f89e40c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:57.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89eae00700 1 -- 172.21.15.49:0/3404511664 shutdown_connections 2024-01-22T05:20:57.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:57.949+0000 7f89eae00700 1 -- 172.21.15.49:0/3404511664 wait complete. 2024-01-22T05:20:57.973 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-22T05:20:58.377 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:20:58.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.541+0000 7ff2f7800700 1 Processor -- start 2024-01-22T05:20:58.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.541+0000 7ff2f7800700 1 -- start start 2024-01-22T05:20:58.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2f7800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2f0064530 0x7ff2f0154600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:58.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2f7800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f00c3dd0 con 0x7ff2f006a1c0 2024-01-22T05:20:58.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2f7800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f006a5a0 con 0x7ff2f01508e0 2024-01-22T05:20:58.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2f7800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00a6f00 con 0x7ff2f0064530 2024-01-22T05:20:58.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2f4e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff2f006a1c0 0x7ff2f00a6720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53278/0 (socket says 172.21.15.49:53278) 2024-01-22T05:20:58.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2f4e00700 1 -- 172.21.15.49:0/791056972 learned_addr learned my addr 172.21.15.49:0/791056972 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:20:58.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2f5800700 1 --2- 172.21.15.49:0/791056972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2f0064530 0x7ff2f0154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:58.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916058701 0 0) 0x7ff2f00c3dd0 con 0x7ff2f006a1c0 2024-01-22T05:20:58.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d00033f0 con 0x7ff2f006a1c0 2024-01-22T05:20:58.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768650688 0 0) 0x7ff2f006a5a0 con 0x7ff2f01508e0 2024-01-22T05:20:58.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2f00c3dd0 con 0x7ff2f01508e0 2024-01-22T05:20:58.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1487581753 0 0) 0x7ff2d00033f0 con 0x7ff2f006a1c0 2024-01-22T05:20:58.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2f0064530 msgr2=0x7ff2f0154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:58.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 --2- 172.21.15.49:0/791056972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2f0064530 0x7ff2f0154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:58.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 >> v1:172.21.15.110:6789/0 conn(0x7ff2f01508e0 legacy=0x7ff2f0063e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:58.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f00c3200 con 0x7ff2f006a1c0 2024-01-22T05:20:58.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7ff2e0001470 con 0x7ff2f006a1c0 2024-01-22T05:20:58.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 >> v1:172.21.15.49:6789/0 conn(0x7ff2f006a1c0 legacy=0x7ff2f00a6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:58.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 --2- 172.21.15.49:0/791056972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2d0003aa0 0x7ff2d0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:58.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 --2- 172.21.15.49:0/791056972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2d0004690 0x7ff2d0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:58.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 --2- 172.21.15.49:0/791056972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d0005000 0x7ff2d000daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:58.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00a6f00 con 0x7ff2d0005000 2024-01-22T05:20:58.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d000e090 con 0x7ff2d0003aa0 2024-01-22T05:20:58.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d000e250 con 0x7ff2d0004690 2024-01-22T05:20:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2f5800700 1 --2- 172.21.15.49:0/791056972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d0005000 0x7ff2d000daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2f4e00700 1 --2- 172.21.15.49:0/791056972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2d0003aa0 0x7ff2d0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.545+0000 7ff2efe00700 1 --2- 172.21.15.49:0/791056972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2d0004690 0x7ff2d0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2f5800700 1 -- 172.21.15.49:0/791056972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2d0004690 msgr2=0x7ff2d0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2f5800700 1 --2- 172.21.15.49:0/791056972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2d0004690 0x7ff2d0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2f5800700 1 -- 172.21.15.49:0/791056972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2d0003aa0 msgr2=0x7ff2d0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2f5800700 1 --2- 172.21.15.49:0/791056972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2d0003aa0 0x7ff2d0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2f5800700 1 -- 172.21.15.49:0/791056972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d00033f0 con 0x7ff2d0005000 2024-01-22T05:20:58.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2f4e00700 1 --2- 172.21.15.49:0/791056972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2d0003aa0 0x7ff2d0003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:20:58.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2f5800700 1 --2- 172.21.15.49:0/791056972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d0005000 0x7ff2d000daf0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 rx=0x7ff2f0064f40 tx=0x7ff2e800b040).ready entity=mon.0 client_cookie=552486fbcda356c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:58.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e800e930 con 0x7ff2d0005000 2024-01-22T05:20:58.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e800f040 con 0x7ff2d0005000 2024-01-22T05:20:58.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2ef400700 1 -- 172.21.15.49:0/791056972 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e800eca0 con 0x7ff2d0005000 2024-01-22T05:20:58.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2f7800700 1 -- 172.21.15.49:0/791056972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d0005000 msgr2=0x7ff2d000daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:58.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2f7800700 1 --2- 172.21.15.49:0/791056972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d0005000 0x7ff2d000daf0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 rx=0x7ff2f0064f40 tx=0x7ff2e800b040).stop 2024-01-22T05:20:58.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2f5800700 1 -- 172.21.15.49:0/791056972 reap_dead start 2024-01-22T05:20:58.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2f7800700 1 -- 172.21.15.49:0/791056972 shutdown_connections 2024-01-22T05:20:58.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2f7800700 1 -- 172.21.15.49:0/791056972 >> 172.21.15.49:0/791056972 conn(0x7ff2f0066830 msgr2=0x7ff2f0066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:58.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2f7800700 1 -- 172.21.15.49:0/791056972 shutdown_connections 2024-01-22T05:20:58.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.549+0000 7ff2f7800700 1 -- 172.21.15.49:0/791056972 wait complete. 2024-01-22T05:20:58.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.553+0000 7ff2f7800700 1 Processor -- start 2024-01-22T05:20:58.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.553+0000 7ff2f7800700 1 -- start start 2024-01-22T05:20:58.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f7800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d0005000 0x7ff2f00ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f7800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2f00abaa0 0x7ff2f0163bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f7800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f013eeb0 0x7ff2f00bcac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f7800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00abf20 con 0x7ff2d0005000 2024-01-22T05:20:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f7800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00ac140 con 0x7ff2f013eeb0 2024-01-22T05:20:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f7800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00ac420 con 0x7ff2f00abaa0 2024-01-22T05:20:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f4e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d0005000 0x7ff2f00ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f4e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d0005000 0x7ff2f00ad1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41130/0 (socket says 172.21.15.49:41130) 2024-01-22T05:20:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f4e00700 1 -- 172.21.15.49:0/1388636290 learned_addr learned my addr 172.21.15.49:0/1388636290 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f5800700 1 --2- 172.21.15.49:0/1388636290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f013eeb0 0x7ff2f00bcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2efe00700 1 --2- 172.21.15.49:0/1388636290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2f00abaa0 0x7ff2f0163bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f4e00700 1 -- 172.21.15.49:0/1388636290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2f00abaa0 msgr2=0x7ff2f0163bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f4e00700 1 --2- 172.21.15.49:0/1388636290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2f00abaa0 0x7ff2f0163bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f4e00700 1 -- 172.21.15.49:0/1388636290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f013eeb0 msgr2=0x7ff2f00bcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f4e00700 1 --2- 172.21.15.49:0/1388636290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f013eeb0 0x7ff2f00bcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:58.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f4e00700 1 -- 172.21.15.49:0/1388636290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f00ac700 con 0x7ff2d0005000 2024-01-22T05:20:58.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f5800700 1 --2- 172.21.15.49:0/1388636290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f013eeb0 0x7ff2f00bcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:20:58.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f4e00700 1 --2- 172.21.15.49:0/1388636290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d0005000 0x7ff2f00ad1e0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 rx=0x7ff2e0007b80 tx=0x7ff2e00077c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:58.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2e7e00700 1 -- 172.21.15.49:0/1388636290 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0013030 con 0x7ff2d0005000 2024-01-22T05:20:58.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2e7e00700 1 -- 172.21.15.49:0/1388636290 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0014040 con 0x7ff2d0005000 2024-01-22T05:20:58.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f7800700 1 -- 172.21.15.49:0/1388636290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f00ac9e0 con 0x7ff2d0005000 2024-01-22T05:20:58.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2e7e00700 1 -- 172.21.15.49:0/1388636290 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000ecf0 con 0x7ff2d0005000 2024-01-22T05:20:58.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.557+0000 7ff2f7800700 1 -- 172.21.15.49:0/1388636290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f01640a0 con 0x7ff2d0005000 2024-01-22T05:20:58.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.561+0000 7ff2f7800700 1 -- 172.21.15.49:0/1388636290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f00acee0 con 0x7ff2d0005000 2024-01-22T05:20:58.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.561+0000 7ff2e7e00700 1 -- 172.21.15.49:0/1388636290 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff2e000c660 con 0x7ff2d0005000 2024-01-22T05:20:58.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.561+0000 7ff2e7e00700 1 --2- 172.21.15.49:0/1388636290 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff2c805a510 0x7ff2c805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:58.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.561+0000 7ff2e7e00700 1 -- 172.21.15.49:0/1388636290 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7ff2e0078f40 con 0x7ff2d0005000 2024-01-22T05:20:58.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.561+0000 7ff2efe00700 1 --2- 172.21.15.49:0/1388636290 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff2c805a510 0x7ff2c805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:58.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.565+0000 7ff2efe00700 1 --2- 172.21.15.49:0/1388636290 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff2c805a510 0x7ff2c805c9d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7ff2f0154110 tx=0x7ff2d8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:58.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.569+0000 7ff2e7e00700 1 -- 172.21.15.49:0/1388636290 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff2e004c3c0 con 0x7ff2d0005000 2024-01-22T05:20:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.773+0000 7ff2f7800700 1 -- 172.21.15.49:0/1388636290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2f0046800 con 0x7ff2d0005000 2024-01-22T05:20:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.773+0000 7ff2e7e00700 1 -- 172.21.15.49:0/1388636290 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) v1 ==== 95+0+4513 (secure 0 0 0) 0x7ff2e004f9e0 con 0x7ff2d0005000 2024-01-22T05:20:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:20:58.778 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":157,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1805560931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1805560931},{"type":"v1","addr":"172.21.15.110:6833","nonce":1805560931}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3941922826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3941922826},{"type":"v1","addr":"172.21.15.110:6835","nonce":3941922826}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2796452202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2796452202},{"type":"v1","addr":"172.21.15.49:6836","nonce":2796452202}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:39.299248+0000","modified":"2024-01-22T05:19:54.461466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":198,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10656":{"gid":10656,"name":"a","rank":0,"incarnation":154,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/1689534801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1689534801},{"type":"v1","addr":"172.21.15.49:6837","nonce":1689534801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2024-01-22T05:20:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.777+0000 7ff2f7800700 1 -- 172.21.15.49:0/1388636290 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff2c805a510 msgr2=0x7ff2c805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.777+0000 7ff2f7800700 1 --2- 172.21.15.49:0/1388636290 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff2c805a510 0x7ff2c805c9d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7ff2f0154110 tx=0x7ff2d8009040).stop 2024-01-22T05:20:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.777+0000 7ff2f7800700 1 -- 172.21.15.49:0/1388636290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d0005000 msgr2=0x7ff2f00ad1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.777+0000 7ff2f7800700 1 --2- 172.21.15.49:0/1388636290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d0005000 0x7ff2f00ad1e0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 rx=0x7ff2e0007b80 tx=0x7ff2e00077c0).stop 2024-01-22T05:20:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.781+0000 7ff2f7800700 1 -- 172.21.15.49:0/1388636290 shutdown_connections 2024-01-22T05:20:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.781+0000 7ff2f7800700 1 --2- 172.21.15.49:0/1388636290 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7ff2c805a510 0x7ff2c805c9d0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.781+0000 7ff2f7800700 1 --2- 172.21.15.49:0/1388636290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f013eeb0 0x7ff2f00bcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.781+0000 7ff2f7800700 1 --2- 172.21.15.49:0/1388636290 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2f00abaa0 0x7ff2f0163bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.781+0000 7ff2f7800700 1 --2- 172.21.15.49:0/1388636290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d0005000 0x7ff2f00ad1e0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.781+0000 7ff2f7800700 1 -- 172.21.15.49:0/1388636290 >> 172.21.15.49:0/1388636290 conn(0x7ff2f0066830 msgr2=0x7ff2f00a9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.781+0000 7ff2f7800700 1 -- 172.21.15.49:0/1388636290 shutdown_connections 2024-01-22T05:20:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.781+0000 7ff2f7800700 1 -- 172.21.15.49:0/1388636290 wait complete. 2024-01-22T05:20:58.786 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 157 2024-01-22T05:20:58.804 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 157, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:19:39.299248+0000', 'modified': '2024-01-22T05:19:54.461466+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 198, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10656}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10656': {'gid': 10656, 'name': 'a', 'rank': 0, 'incarnation': 154, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.49:6837/1689534801', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6835', 'nonce': 1689534801}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 1689534801}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:20:58.804 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:20:58.804 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-22T05:20:58.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.969+0000 7efcfac00700 1 Processor -- start 2024-01-22T05:20:58.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.973+0000 7efcfac00700 1 -- start start 2024-01-22T05:20:58.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.973+0000 7efcfac00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcf4155880 0x7efcf40a8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:58.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.973+0000 7efcfac00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efcf4155c60 0x7efcf40a6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:58.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.973+0000 7efcfac00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf4068a60 con 0x7efcf40a8e80 2024-01-22T05:20:58.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.973+0000 7efcfac00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf4067e50 con 0x7efcf4155c60 2024-01-22T05:20:58.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.973+0000 7efcfac00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4068130 con 0x7efcf4155880 2024-01-22T05:20:58.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcf8e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efcf4155c60 0x7efcf40a6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:58.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcf8e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efcf4155c60 0x7efcf40a6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41134/0 (socket says 172.21.15.49:41134) 2024-01-22T05:20:58.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcf8e00700 1 -- 172.21.15.49:0/3763950942 learned_addr learned my addr 172.21.15.49:0/3763950942 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:58.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcfa200700 1 --1- 172.21.15.49:0/3763950942 >> v1:172.21.15.49:6789/0 conn(0x7efcf40a8e80 0x7efcf40659b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53282/0 (socket says 172.21.15.49:53282) 2024-01-22T05:20:58.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcf9800700 1 --2- 172.21.15.49:0/3763950942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcf4155880 0x7efcf40a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:58.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcf8e00700 1 -- 172.21.15.49:0/3763950942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcf4155880 msgr2=0x7efcf40a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:58.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcf8e00700 1 --2- 172.21.15.49:0/3763950942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcf4155880 0x7efcf40a8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:58.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcf8e00700 1 -- 172.21.15.49:0/3763950942 >> v1:172.21.15.49:6789/0 conn(0x7efcf40a8e80 legacy=0x7efcf40659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:58.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcf8e00700 1 -- 172.21.15.49:0/3763950942 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf4068410 con 0x7efcf4155c60 2024-01-22T05:20:58.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcf3e00700 1 -- 172.21.15.49:0/3763950942 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800079315 0 0) 0x7efcf4068a60 con 0x7efcf40a8e80 2024-01-22T05:20:58.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcf8e00700 1 --2- 172.21.15.49:0/3763950942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf4155c60 0x7efcf40a6b50 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 rx=0x7efcdc006fd0 tx=0x7efcdc0090f0).ready entity=mon.0 client_cookie=7c2b12b1ef064510 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcf3e00700 1 -- 172.21.15.49:0/3763950942 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc00b580 con 0x7efcf4155c60 2024-01-22T05:20:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcf3e00700 1 -- 172.21.15.49:0/3763950942 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc00b6e0 con 0x7efcf4155c60 2024-01-22T05:20:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcf3e00700 1 -- 172.21.15.49:0/3763950942 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc00ba60 con 0x7efcf4155c60 2024-01-22T05:20:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcfac00700 1 -- 172.21.15.49:0/3763950942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf4155c60 msgr2=0x7efcf40a6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:58.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcfac00700 1 --2- 172.21.15.49:0/3763950942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf4155c60 0x7efcf40a6b50 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 rx=0x7efcdc006fd0 tx=0x7efcdc0090f0).stop 2024-01-22T05:20:58.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcfac00700 1 -- 172.21.15.49:0/3763950942 shutdown_connections 2024-01-22T05:20:58.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcfac00700 1 --2- 172.21.15.49:0/3763950942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf4155c60 0x7efcf40a6b50 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:58.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcfac00700 1 --2- 172.21.15.49:0/3763950942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcf4155880 0x7efcf40a8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:58.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.977+0000 7efcfac00700 1 -- 172.21.15.49:0/3763950942 >> 172.21.15.49:0/3763950942 conn(0x7efcf40c6530 msgr2=0x7efcf40c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:58.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.981+0000 7efcfac00700 1 -- 172.21.15.49:0/3763950942 shutdown_connections 2024-01-22T05:20:58.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.981+0000 7efcfac00700 1 -- 172.21.15.49:0/3763950942 wait complete. 2024-01-22T05:20:58.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.981+0000 7efcfac00700 1 Processor -- start 2024-01-22T05:20:58.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.981+0000 7efcfac00700 1 -- start start 2024-01-22T05:20:58.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcfac00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcf40a8e80 0x7efcf40aab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:58.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcfac00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf4155880 0x7efcf415a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:58.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcfac00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf4155c60 0x7efcf415ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:58.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcfac00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf415b060 con 0x7efcf4155c60 2024-01-22T05:20:58.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcfac00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4159670 con 0x7efcf4155880 2024-01-22T05:20:58.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcfac00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf415a1f0 con 0x7efcf40a8e80 2024-01-22T05:20:58.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcfa200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf4155c60 0x7efcf415ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:58.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcfa200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf4155c60 0x7efcf415ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41146/0 (socket says 172.21.15.49:41146) 2024-01-22T05:20:58.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcfa200700 1 -- 172.21.15.49:0/1741339281 learned_addr learned my addr 172.21.15.49:0/1741339281 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:58.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcf9800700 1 --2- 172.21.15.49:0/1741339281 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcf40a8e80 0x7efcf40aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:58.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcf8e00700 1 --2- 172.21.15.49:0/1741339281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf4155880 0x7efcf415a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:58.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcf9800700 1 -- 172.21.15.49:0/1741339281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf4155880 msgr2=0x7efcf415a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:58.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcf9800700 1 --2- 172.21.15.49:0/1741339281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf4155880 0x7efcf415a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcf9800700 1 -- 172.21.15.49:0/1741339281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf4155c60 msgr2=0x7efcf415ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcf9800700 1 --2- 172.21.15.49:0/1741339281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf4155c60 0x7efcf415ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcf9800700 1 -- 172.21.15.49:0/1741339281 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc009370 con 0x7efcf40a8e80 2024-01-22T05:20:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcfa200700 1 --2- 172.21.15.49:0/1741339281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf4155c60 0x7efcf415ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:20:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcf9800700 1 --2- 172.21.15.49:0/1741339281 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcf40a8e80 0x7efcf40aab80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7efce400e850 tx=0x7efce4009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcf0c00700 1 -- 172.21.15.49:0/1741339281 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4009430 con 0x7efcf40a8e80 2024-01-22T05:20:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcf0c00700 1 -- 172.21.15.49:0/1741339281 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce4012600 con 0x7efcf40a8e80 2024-01-22T05:20:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcfac00700 1 -- 172.21.15.49:0/1741339281 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf41598c0 con 0x7efcf40a8e80 2024-01-22T05:20:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcf0c00700 1 -- 172.21.15.49:0/1741339281 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4012980 con 0x7efcf40a8e80 2024-01-22T05:20:58.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.985+0000 7efcfac00700 1 -- 172.21.15.49:0/1741339281 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf4159e80 con 0x7efcf40a8e80 2024-01-22T05:20:58.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.989+0000 7efcf0c00700 1 -- 172.21.15.49:0/1741339281 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7efce4012cf0 con 0x7efcf40a8e80 2024-01-22T05:20:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.989+0000 7efcf0c00700 1 --2- 172.21.15.49:0/1741339281 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efccc05a510 0x7efccc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.989+0000 7efcf0c00700 1 -- 172.21.15.49:0/1741339281 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7efce4074f00 con 0x7efcf40a8e80 2024-01-22T05:20:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.989+0000 7efcf8e00700 1 --2- 172.21.15.49:0/1741339281 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efccc05a510 0x7efccc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.993+0000 7efcf8e00700 1 --2- 172.21.15.49:0/1741339281 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efccc05a510 0x7efccc05c9d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7efcdc006fd0 tx=0x7efcdc017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.993+0000 7efd066af740 1 Processor -- start 2024-01-22T05:20:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.993+0000 7efd066af740 1 -- start start 2024-01-22T05:20:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efd066af740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13493a0 0x132dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efd066af740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1308e40 0x1304af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efd066af740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1349780 0x13023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efd066af740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1288410 con 0x13493a0 2024-01-22T05:20:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efd066af740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1288550 con 0x1308e40 2024-01-22T05:20:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efd066af740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1288a00 con 0x1349780 2024-01-22T05:20:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efcf9800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13493a0 0x132dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efcf9800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13493a0 0x132dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41148/0 (socket says 172.21.15.49:41148) 2024-01-22T05:20:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efcf9800700 1 -- 172.21.15.49:0/657868039 learned_addr learned my addr 172.21.15.49:0/657868039 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efcfa200700 1 --2- 172.21.15.49:0/657868039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1349780 0x13023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efcf8e00700 1 --2- 172.21.15.49:0/657868039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1308e40 0x1304af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efcf9800700 1 -- 172.21.15.49:0/657868039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1349780 msgr2=0x13023a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efcf9800700 1 --2- 172.21.15.49:0/657868039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1349780 0x13023a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efcf9800700 1 -- 172.21.15.49:0/657868039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1308e40 msgr2=0x1304af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efcf9800700 1 --2- 172.21.15.49:0/657868039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1308e40 0x1304af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efcf9800700 1 -- 172.21.15.49:0/657868039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1281730 con 0x13493a0 2024-01-22T05:20:59.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efcf9800700 1 --2- 172.21.15.49:0/657868039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13493a0 0x132dd10 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7efce404bb20 tx=0x7efce4011000).ready entity=mon.0 client_cookie=3af3f269df911069 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:59.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efce9600700 1 -- 172.21.15.49:0/657868039 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4072d70 con 0x13493a0 2024-01-22T05:20:59.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efce9600700 1 -- 172.21.15.49:0/657868039 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce4072ed0 con 0x13493a0 2024-01-22T05:20:59.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efce9600700 1 -- 172.21.15.49:0/657868039 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4019be0 con 0x13493a0 2024-01-22T05:20:59.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efd066af740 1 -- 172.21.15.49:0/657868039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13493a0 msgr2=0x132dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:58.997+0000 7efd066af740 1 --2- 172.21.15.49:0/657868039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13493a0 0x132dd10 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7efce404bb20 tx=0x7efce4011000).stop 2024-01-22T05:20:59.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.001+0000 7efd066af740 1 -- 172.21.15.49:0/657868039 shutdown_connections 2024-01-22T05:20:59.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.001+0000 7efd066af740 1 --2- 172.21.15.49:0/657868039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1349780 0x13023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.001+0000 7efd066af740 1 --2- 172.21.15.49:0/657868039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1308e40 0x1304af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.001+0000 7efd066af740 1 --2- 172.21.15.49:0/657868039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x13493a0 0x132dd10 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.001+0000 7efd066af740 1 -- 172.21.15.49:0/657868039 >> 172.21.15.49:0/657868039 conn(0x10e6550 msgr2=0x1308730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:59.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.001+0000 7efd066af740 1 -- 172.21.15.49:0/657868039 shutdown_connections 2024-01-22T05:20:59.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.001+0000 7efd066af740 1 -- 172.21.15.49:0/657868039 wait complete. 2024-01-22T05:20:59.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.001+0000 7efd066af740 1 -- start start 2024-01-22T05:20:59.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.001+0000 7efd066af740 1 Processor -- start 2024-01-22T05:20:59.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efd066af740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1308e40 0x13278f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efd066af740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13493a0 0x1333760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efd066af740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1349780 0x132cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efd066af740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x1253650 con 0x1308e40 2024-01-22T05:20:59.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efd066af740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x1329600 con 0x1349780 2024-01-22T05:20:59.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efd066af740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x135df10 con 0x13493a0 2024-01-22T05:20:59.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efd066af740 10 client.0 ll_register_callbacks cb 0x12c0020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:20:59.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efcf9800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1308e40 0x13278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efcf9800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1308e40 0x13278f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41164/0 (socket says 172.21.15.49:41164) 2024-01-22T05:20:59.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efcf9800700 1 -- 172.21.15.49:0/1701629702 learned_addr learned my addr 172.21.15.49:0/1701629702 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:59.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efcf8e00700 1 --2- 172.21.15.49:0/1701629702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13493a0 0x1333760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efcfa200700 1 --2- 172.21.15.49:0/1701629702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1349780 0x132cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efcf9800700 1 -- 172.21.15.49:0/1701629702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13493a0 msgr2=0x1333760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:59.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efcf9800700 1 --2- 172.21.15.49:0/1701629702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13493a0 0x1333760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efcf9800700 1 -- 172.21.15.49:0/1701629702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1349780 msgr2=0x132cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:59.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efcf9800700 1 --2- 172.21.15.49:0/1701629702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1349780 0x132cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efcf9800700 1 -- 172.21.15.49:0/1701629702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf4159e80 con 0x1308e40 2024-01-22T05:20:59.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efcfa200700 1 --2- 172.21.15.49:0/1701629702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1349780 0x132cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:20:59.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efcf9800700 1 --2- 172.21.15.49:0/1701629702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1308e40 0x13278f0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 rx=0x7efce404bb20 tx=0x7efce4056000).ready entity=mon.0 client_cookie=3a6f06d0b495aaa7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:59.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efce2000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:20:59.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efce2000700 1 -- 172.21.15.49:0/1701629702 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4047eb0 con 0x1308e40 2024-01-22T05:20:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efce2000700 1 -- 172.21.15.49:0/1701629702 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7efce4048010 con 0x1308e40 2024-01-22T05:20:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efd066af740 1 -- 172.21.15.49:0/1701629702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x127e1a0 con 0x1308e40 2024-01-22T05:20:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efce2000700 1 -- 172.21.15.49:0/1701629702 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7efce40481d0 con 0x1308e40 2024-01-22T05:20:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efd066af740 10 client.10851 fetch_fsmap learned FSMap version 157 2024-01-22T05:20:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.005+0000 7efd066af740 1 -- 172.21.15.49:0/1701629702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x127c960 con 0x1308e40 2024-01-22T05:20:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efce2000700 1 -- 172.21.15.49:0/1701629702 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x127e1a0 con 0x1308e40 2024-01-22T05:20:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efce2000700 1 -- 172.21.15.49:0/1701629702 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efce404b020 con 0x1308e40 2024-01-22T05:20:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efd066af740 10 client.10851 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:20:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efd066af740 10 client.10851 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:20:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efd066af740 20 client.10851 populate_metadata read hostname 'smithi049' 2024-01-22T05:20:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efd066af740 1 --2- 172.21.15.49:0/1701629702 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x134cd60 0x134d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efd066af740 4 client.10851 mds_command: new command op to 10656 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:20:59.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efd066af740 1 -- 172.21.15.49:0/1701629702 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x12746f0 con 0x134cd60 2024-01-22T05:20:59.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efcf8e00700 1 --2- 172.21.15.49:0/1701629702 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x134cd60 0x134d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efcf8e00700 1 --2- 172.21.15.49:0/1701629702 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x134cd60 0x134d160 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e06360e6b753ae6e server_cookie=b47f970cf7301718 in_seq=0 out_seq=0 2024-01-22T05:20:59.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efce2000700 10 client.10851 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:59.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efce2000700 1 -- 172.21.15.49:0/1701629702 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x12746f0 con 0x134cd60 2024-01-22T05:20:59.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efce2000700 10 client.10851 handle_command_reply: tid=0 2024-01-22T05:20:59.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efd066af740 1 client.10851 shutdown 2024-01-22T05:20:59.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efd066af740 1 -- 172.21.15.49:0/1701629702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1308e40 msgr2=0x13278f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.009+0000 7efd066af740 1 --2- 172.21.15.49:0/1701629702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1308e40 0x13278f0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 rx=0x7efce404bb20 tx=0x7efce4056000).stop 2024-01-22T05:20:59.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.013+0000 7efd066af740 1 -- 172.21.15.49:0/1701629702 shutdown_connections 2024-01-22T05:20:59.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.013+0000 7efd066af740 1 --2- 172.21.15.49:0/1701629702 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x134cd60 0x134d160 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.013+0000 7efd066af740 1 --2- 172.21.15.49:0/1701629702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1349780 0x132cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.013+0000 7efd066af740 1 --2- 172.21.15.49:0/1701629702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13493a0 0x1333760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.013+0000 7efd066af740 1 --2- 172.21.15.49:0/1701629702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1308e40 0x13278f0 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.013+0000 7efce2000700 0 client.10851 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:59.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.013+0000 7efd066af740 1 -- 172.21.15.49:0/1701629702 >> 172.21.15.49:0/1701629702 conn(0x10e6550 msgr2=0x134f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:59.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.013+0000 7efd066af740 1 -- 172.21.15.49:0/1701629702 shutdown_connections 2024-01-22T05:20:59.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.013+0000 7efd066af740 1 -- 172.21.15.49:0/1701629702 wait complete. 2024-01-22T05:20:59.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.013+0000 7efd066af740 20 client.10851 trim_cache size 0 max 16384 2024-01-22T05:20:59.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.033+0000 7efd066af740 1 Processor -- start 2024-01-22T05:20:59.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.033+0000 7efd066af740 1 -- start start 2024-01-22T05:20:59.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.033+0000 7efd066af740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1308e40 0x135cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.033+0000 7efd066af740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13493a0 0x132bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.033+0000 7efd066af740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1349780 0x134ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.033+0000 7efd066af740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x13046d0 con 0x1349780 2024-01-22T05:20:59.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.033+0000 7efd066af740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x12cbe60 con 0x13493a0 2024-01-22T05:20:59.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.033+0000 7efd066af740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x134d790 con 0x1308e40 2024-01-22T05:20:59.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.033+0000 7efcfa200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1349780 0x134ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efcfa200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1349780 0x134ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41168/0 (socket says 172.21.15.49:41168) 2024-01-22T05:20:59.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efcf9800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1308e40 0x135cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efcfa200700 1 -- 172.21.15.49:0/3083572802 learned_addr learned my addr 172.21.15.49:0/3083572802 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:59.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efcf8e00700 1 --2- 172.21.15.49:0/3083572802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13493a0 0x132bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efcf9800700 1 -- 172.21.15.49:0/3083572802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13493a0 msgr2=0x132bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:59.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efcf9800700 1 --2- 172.21.15.49:0/3083572802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13493a0 0x132bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efcf9800700 1 -- 172.21.15.49:0/3083572802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1349780 msgr2=0x134ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:59.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efcf9800700 1 --2- 172.21.15.49:0/3083572802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1349780 0x134ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efcf9800700 1 -- 172.21.15.49:0/3083572802 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf4158ec0 con 0x1308e40 2024-01-22T05:20:59.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efcfa200700 1 --2- 172.21.15.49:0/3083572802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1349780 0x134ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:20:59.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efcf9800700 1 --2- 172.21.15.49:0/3083572802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1308e40 0x135cf30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7efce400e820 tx=0x7efce405e070).ready entity=mon.2 client_cookie=82a66db4ee41653b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:59.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efcea000700 1 -- 172.21.15.49:0/3083572802 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4048400 con 0x1308e40 2024-01-22T05:20:59.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efcea000700 1 -- 172.21.15.49:0/3083572802 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce400e030 con 0x1308e40 2024-01-22T05:20:59.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efcea000700 1 -- 172.21.15.49:0/3083572802 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce404b020 con 0x1308e40 2024-01-22T05:20:59.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efd066af740 1 -- 172.21.15.49:0/3083572802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1308e40 msgr2=0x135cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efd066af740 1 --2- 172.21.15.49:0/3083572802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1308e40 0x135cf30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7efce400e820 tx=0x7efce405e070).stop 2024-01-22T05:20:59.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efd066af740 1 -- 172.21.15.49:0/3083572802 shutdown_connections 2024-01-22T05:20:59.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efd066af740 1 --2- 172.21.15.49:0/3083572802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1349780 0x134ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efd066af740 1 --2- 172.21.15.49:0/3083572802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x13493a0 0x132bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efd066af740 1 --2- 172.21.15.49:0/3083572802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x1308e40 0x135cf30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efd066af740 1 -- 172.21.15.49:0/3083572802 >> 172.21.15.49:0/3083572802 conn(0x10e6550 msgr2=0x132c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:59.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efd066af740 1 -- 172.21.15.49:0/3083572802 shutdown_connections 2024-01-22T05:20:59.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.037+0000 7efd066af740 1 -- 172.21.15.49:0/3083572802 wait complete. 2024-01-22T05:20:59.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.041+0000 7efd066af740 1 -- start start 2024-01-22T05:20:59.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.041+0000 7efd066af740 1 Processor -- start 2024-01-22T05:20:59.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.041+0000 7efd066af740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1308e40 0x13b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.041+0000 7efd066af740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13493a0 0x135c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.041+0000 7efd066af740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1349780 0x135cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.041+0000 7efd066af740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x135d190 con 0x1349780 2024-01-22T05:20:59.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.041+0000 7efd066af740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x13306f0 con 0x1308e40 2024-01-22T05:20:59.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efd066af740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x1304fe0 con 0x13493a0 2024-01-22T05:20:59.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efd066af740 10 client.0 ll_register_callbacks cb 0x7efce40730f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:20:59.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efcfa200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1349780 0x135cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efcfa200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1349780 0x135cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41172/0 (socket says 172.21.15.49:41172) 2024-01-22T05:20:59.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efcfa200700 1 -- 172.21.15.49:0/23618407 learned_addr learned my addr 172.21.15.49:0/23618407 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:59.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efcf9800700 1 --2- 172.21.15.49:0/23618407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1308e40 0x13b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efcf8e00700 1 --2- 172.21.15.49:0/23618407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13493a0 0x135c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efcfa200700 1 -- 172.21.15.49:0/23618407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13493a0 msgr2=0x135c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:59.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efcfa200700 1 --2- 172.21.15.49:0/23618407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13493a0 0x135c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efcfa200700 1 -- 172.21.15.49:0/23618407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1308e40 msgr2=0x13b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:59.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efcfa200700 1 --2- 172.21.15.49:0/23618407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1308e40 0x13b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efcfa200700 1 -- 172.21.15.49:0/23618407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcec001ba0 con 0x1349780 2024-01-22T05:20:59.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efcf9800700 1 --2- 172.21.15.49:0/23618407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1308e40 0x13b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:20:59.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efcfa200700 1 --2- 172.21.15.49:0/23618407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1349780 0x135cca0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7efcec0076f0 tx=0x7efcec009040).ready entity=mon.0 client_cookie=47de8b65a7aa8c28 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:59.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efce2000700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-22T05:20:59.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efce2000700 1 -- 172.21.15.49:0/23618407 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec016b90 con 0x1349780 2024-01-22T05:20:59.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efce2000700 1 -- 172.21.15.49:0/23618407 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7efcec016cf0 con 0x1349780 2024-01-22T05:20:59.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efd066af740 1 -- 172.21.15.49:0/23618407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efce4072ed0 con 0x1349780 2024-01-22T05:20:59.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efce2000700 1 -- 172.21.15.49:0/23618407 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcec016eb0 con 0x1349780 2024-01-22T05:20:59.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efd066af740 10 client.10857 fetch_fsmap learned FSMap version 157 2024-01-22T05:20:59.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efd066af740 1 -- 172.21.15.49:0/23618407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) v3 -- 0x127c960 con 0x1349780 2024-01-22T05:20:59.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efce2000700 1 -- 172.21.15.49:0/23618407 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce4072ed0 con 0x1349780 2024-01-22T05:20:59.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efce2000700 1 -- 172.21.15.49:0/23618407 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 157) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efcec012070 con 0x1349780 2024-01-22T05:20:59.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efd066af740 10 client.10857 fetch_fsmap finished waiting for FSMap version 157 2024-01-22T05:20:59.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efd066af740 10 client.10857 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:20:59.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efd066af740 20 client.10857 populate_metadata read hostname 'smithi049' 2024-01-22T05:20:59.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efd066af740 1 --2- 172.21.15.49:0/23618407 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x13079d0 0x1307db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efd066af740 4 client.10857 mds_command: new command op to 10656 tid=0[{"prefix": "status"}] 2024-01-22T05:20:59.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efd066af740 1 -- 172.21.15.49:0/23618407 --> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] -- command(tid 0: {"prefix": "status"}) v1 -- 0x113d4e0 con 0x13079d0 2024-01-22T05:20:59.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.045+0000 7efcf9800700 1 --2- 172.21.15.49:0/23618407 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x13079d0 0x1307db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efcf9800700 1 --2- 172.21.15.49:0/23618407 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x13079d0 0x1307db0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=88061cad727369b9 server_cookie=1f302cdd2ae2b22c in_seq=0 out_seq=0 2024-01-22T05:20:59.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efce2000700 10 client.10857 ms_handle_connect on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:59.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efce2000700 1 -- 172.21.15.49:0/23618407 <== mds.0 v2:172.21.15.49:6835/1689534801 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+335 (crc 0 0 0) 0x113d4e0 con 0x13079d0 2024-01-22T05:20:59.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efce2000700 10 client.10857 handle_command_reply: tid=0 2024-01-22T05:20:59.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efd066af740 1 client.10857 shutdown 2024-01-22T05:20:59.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efd066af740 1 -- 172.21.15.49:0/23618407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1349780 msgr2=0x135cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efd066af740 1 --2- 172.21.15.49:0/23618407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1349780 0x135cca0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7efcec0076f0 tx=0x7efcec009040).stop 2024-01-22T05:20:59.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efd066af740 1 -- 172.21.15.49:0/23618407 shutdown_connections 2024-01-22T05:20:59.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efd066af740 1 --2- 172.21.15.49:0/23618407 >> [v2:172.21.15.49:6835/1689534801,v1:172.21.15.49:6837/1689534801] conn(0x13079d0 0x1307db0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efd066af740 1 --2- 172.21.15.49:0/23618407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x1349780 0x135cca0 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efd066af740 1 --2- 172.21.15.49:0/23618407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x13493a0 0x135c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efd066af740 1 --2- 172.21.15.49:0/23618407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x1308e40 0x13b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efce2000700 0 client.10857 ms_handle_reset on v2:172.21.15.49:6835/1689534801 2024-01-22T05:20:59.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efd066af740 1 -- 172.21.15.49:0/23618407 >> 172.21.15.49:0/23618407 conn(0x10e6550 msgr2=0x134ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:59.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efd066af740 1 -- 172.21.15.49:0/23618407 shutdown_connections 2024-01-22T05:20:59.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efd066af740 1 -- 172.21.15.49:0/23618407 wait complete. 2024-01-22T05:20:59.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.049+0000 7efd066af740 20 client.10857 trim_cache size 0 max 16384 2024-01-22T05:20:59.056 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:20:59.056 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f4203cdb-f79e-4d7b-b9de-f994381af719", 2024-01-22T05:20:59.056 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-22T05:20:59.056 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 10656, 2024-01-22T05:20:59.057 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-22T05:20:59.057 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-22T05:20:59.057 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-22T05:20:59.057 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 67.606349957999996, 2024-01-22T05:20:59.057 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 157, 2024-01-22T05:20:59.057 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 200, 2024-01-22T05:20:59.057 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 198, 2024-01-22T05:20:59.057 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 69.483040466999995 2024-01-22T05:20:59.057 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:20:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.053+0000 7efcfac00700 1 -- 172.21.15.49:0/1741339281 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efccc05a510 msgr2=0x7efccc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.053+0000 7efcfac00700 1 --2- 172.21.15.49:0/1741339281 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efccc05a510 0x7efccc05c9d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7efcdc006fd0 tx=0x7efcdc017000).stop 2024-01-22T05:20:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.053+0000 7efcfac00700 1 -- 172.21.15.49:0/1741339281 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcf40a8e80 msgr2=0x7efcf40aab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.053+0000 7efcfac00700 1 --2- 172.21.15.49:0/1741339281 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcf40a8e80 0x7efcf40aab80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7efce400e850 tx=0x7efce4009060).stop 2024-01-22T05:20:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.053+0000 7efcfac00700 1 -- 172.21.15.49:0/1741339281 shutdown_connections 2024-01-22T05:20:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.053+0000 7efcfac00700 1 --2- 172.21.15.49:0/1741339281 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7efccc05a510 0x7efccc05c9d0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.053+0000 7efcfac00700 1 --2- 172.21.15.49:0/1741339281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcf4155c60 0x7efcf415ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.053+0000 7efcfac00700 1 --2- 172.21.15.49:0/1741339281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf4155880 0x7efcf415a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.053+0000 7efcfac00700 1 --2- 172.21.15.49:0/1741339281 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcf40a8e80 0x7efcf40aab80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.053+0000 7efcfac00700 1 -- 172.21.15.49:0/1741339281 >> 172.21.15.49:0/1741339281 conn(0x7efcf40c6530 msgr2=0x7efcf4158450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:59.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.053+0000 7efcfac00700 1 -- 172.21.15.49:0/1741339281 shutdown_connections 2024-01-22T05:20:59.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.053+0000 7efcfac00700 1 -- 172.21.15.49:0/1741339281 wait complete. 2024-01-22T05:20:59.078 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:20:59.079 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:20:59.123 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:20:59.165 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:20:59.166 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:20:59.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.329+0000 7fbe52000700 1 Processor -- start 2024-01-22T05:20:59.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.329+0000 7fbe52000700 1 -- start start 2024-01-22T05:20:59.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.333+0000 7fbe52000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe4c0c5710 0x7fbe4c0c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.333+0000 7fbe52000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4c154e00 con 0x7fbe4c0bef20 2024-01-22T05:20:59.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.333+0000 7fbe52000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4c0c5af0 con 0x7fbe4c0c49c0 2024-01-22T05:20:59.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.333+0000 7fbe52000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4c0c4e20 con 0x7fbe4c0c5710 2024-01-22T05:20:59.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.333+0000 7fbe4b400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe4c0c5710 0x7fbe4c0c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.333+0000 7fbe4b400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe4c0c5710 0x7fbe4c0c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41188/0 (socket says 172.21.15.49:41188) 2024-01-22T05:20:59.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.333+0000 7fbe4b400700 1 -- 172.21.15.49:0/1358473923 learned_addr learned my addr 172.21.15.49:0/1358473923 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:59.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.333+0000 7fbe4b400700 1 -- 172.21.15.49:0/1358473923 >> v1:172.21.15.110:6789/0 conn(0x7fbe4c0c49c0 legacy=0x7fbe4c0be810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.333+0000 7fbe4b400700 1 -- 172.21.15.49:0/1358473923 >> v1:172.21.15.49:6789/0 conn(0x7fbe4c0bef20 legacy=0x7fbe4c067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.337+0000 7fbe4b400700 1 -- 172.21.15.49:0/1358473923 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c154510 con 0x7fbe4c0c5710 2024-01-22T05:20:59.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.337+0000 7fbe4b400700 1 --2- 172.21.15.49:0/1358473923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c0c5710 0x7fbe4c0c44d0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 rx=0x7fbe3c006fd0 tx=0x7fbe3c0090f0).ready entity=mon.0 client_cookie=31539b9d8acd49ec server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:59.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.337+0000 7fbe4a000700 1 -- 172.21.15.49:0/1358473923 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00b600 con 0x7fbe4c0c5710 2024-01-22T05:20:59.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.337+0000 7fbe4a000700 1 -- 172.21.15.49:0/1358473923 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c00b760 con 0x7fbe4c0c5710 2024-01-22T05:20:59.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.337+0000 7fbe4a000700 1 -- 172.21.15.49:0/1358473923 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00bae0 con 0x7fbe4c0c5710 2024-01-22T05:20:59.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.337+0000 7fbe52000700 1 -- 172.21.15.49:0/1358473923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c0c5710 msgr2=0x7fbe4c0c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.337+0000 7fbe52000700 1 --2- 172.21.15.49:0/1358473923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c0c5710 0x7fbe4c0c44d0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 rx=0x7fbe3c006fd0 tx=0x7fbe3c0090f0).stop 2024-01-22T05:20:59.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.337+0000 7fbe52000700 1 -- 172.21.15.49:0/1358473923 shutdown_connections 2024-01-22T05:20:59.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.337+0000 7fbe52000700 1 --2- 172.21.15.49:0/1358473923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c0c5710 0x7fbe4c0c44d0 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.337+0000 7fbe52000700 1 -- 172.21.15.49:0/1358473923 >> 172.21.15.49:0/1358473923 conn(0x7fbe4c0c9030 msgr2=0x7fbe4c0c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:59.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.337+0000 7fbe52000700 1 -- 172.21.15.49:0/1358473923 shutdown_connections 2024-01-22T05:20:59.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.337+0000 7fbe52000700 1 -- 172.21.15.49:0/1358473923 wait complete. 2024-01-22T05:20:59.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.341+0000 7fbe52000700 1 Processor -- start 2024-01-22T05:20:59.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.341+0000 7fbe52000700 1 -- start start 2024-01-22T05:20:59.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe52000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c0bef20 0x7fbe4c0bfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe52000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe4c0c49c0 0x7fbe4c0c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe52000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe4c0c5710 0x7fbe4c146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe52000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c14e9c0 con 0x7fbe4c0bef20 2024-01-22T05:20:59.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe52000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0c01d0 con 0x7fbe4c0c5710 2024-01-22T05:20:59.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe52000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0ade30 con 0x7fbe4c0c49c0 2024-01-22T05:20:59.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe4b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c0bef20 0x7fbe4c0bfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe4b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c0bef20 0x7fbe4c0bfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41198/0 (socket says 172.21.15.49:41198) 2024-01-22T05:20:59.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe4b400700 1 -- 172.21.15.49:0/4183053176 learned_addr learned my addr 172.21.15.49:0/4183053176 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:59.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe4aa00700 1 --2- 172.21.15.49:0/4183053176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe4c0c49c0 0x7fbe4c0c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe50a00700 1 --2- 172.21.15.49:0/4183053176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe4c0c5710 0x7fbe4c146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe4b400700 1 -- 172.21.15.49:0/4183053176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe4c0c49c0 msgr2=0x7fbe4c0c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe4b400700 1 --2- 172.21.15.49:0/4183053176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe4c0c49c0 0x7fbe4c0c11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe4b400700 1 -- 172.21.15.49:0/4183053176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe4c0c5710 msgr2=0x7fbe4c146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe4b400700 1 --2- 172.21.15.49:0/4183053176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe4c0c5710 0x7fbe4c146e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe4b400700 1 -- 172.21.15.49:0/4183053176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c009370 con 0x7fbe4c0bef20 2024-01-22T05:20:59.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe4b400700 1 --2- 172.21.15.49:0/4183053176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c0bef20 0x7fbe4c0bfb60 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 rx=0x7fbe3c009f50 tx=0x7fbe3c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:59.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe42a00700 1 -- 172.21.15.49:0/4183053176 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00b8d0 con 0x7fbe4c0bef20 2024-01-22T05:20:59.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe42a00700 1 -- 172.21.15.49:0/4183053176 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c00ba30 con 0x7fbe4c0bef20 2024-01-22T05:20:59.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe42a00700 1 -- 172.21.15.49:0/4183053176 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c01b660 con 0x7fbe4c0bef20 2024-01-22T05:20:59.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe52000700 1 -- 172.21.15.49:0/4183053176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4c0c16c0 con 0x7fbe4c0bef20 2024-01-22T05:20:59.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe52000700 1 -- 172.21.15.49:0/4183053176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4c0ad870 con 0x7fbe4c0bef20 2024-01-22T05:20:59.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.345+0000 7fbe52000700 1 -- 172.21.15.49:0/4183053176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4c047060 con 0x7fbe4c0bef20 2024-01-22T05:20:59.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.349+0000 7fbe42a00700 1 -- 172.21.15.49:0/4183053176 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbe3c01ba10 con 0x7fbe4c0bef20 2024-01-22T05:20:59.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.349+0000 7fbe42a00700 1 --2- 172.21.15.49:0/4183053176 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe2405a510 0x7fbe2405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.349+0000 7fbe42a00700 1 -- 172.21.15.49:0/4183053176 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7fbe3c076690 con 0x7fbe4c0bef20 2024-01-22T05:20:59.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.349+0000 7fbe4aa00700 1 --2- 172.21.15.49:0/4183053176 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe2405a510 0x7fbe2405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.349+0000 7fbe4aa00700 1 --2- 172.21.15.49:0/4183053176 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe2405a510 0x7fbe2405c9d0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fbe4c0c7740 tx=0x7fbe34007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:59.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.357+0000 7fbe42a00700 1 -- 172.21.15.49:0/4183053176 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbe3c049b10 con 0x7fbe4c0bef20 2024-01-22T05:20:59.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.553+0000 7fbe52000700 1 -- 172.21.15.49:0/4183053176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe4c0c5d80 con 0x7fbe4c0bef20 2024-01-22T05:20:59.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.557+0000 7fbe42a00700 1 -- 172.21.15.49:0/4183053176 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) v1 ==== 95+0+4513 (secure 0 0 0) 0x7fbe3c01f020 con 0x7fbe4c0bef20 2024-01-22T05:20:59.559 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:20:59.559 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":157,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1805560931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1805560931},{"type":"v1","addr":"172.21.15.110:6833","nonce":1805560931}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3941922826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3941922826},{"type":"v1","addr":"172.21.15.110:6835","nonce":3941922826}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2796452202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2796452202},{"type":"v1","addr":"172.21.15.49:6836","nonce":2796452202}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:39.299248+0000","modified":"2024-01-22T05:19:54.461466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":198,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10656":{"gid":10656,"name":"a","rank":0,"incarnation":154,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/1689534801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1689534801},{"type":"v1","addr":"172.21.15.49:6837","nonce":1689534801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2024-01-22T05:20:59.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.557+0000 7fbe52000700 1 -- 172.21.15.49:0/4183053176 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe2405a510 msgr2=0x7fbe2405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.557+0000 7fbe52000700 1 --2- 172.21.15.49:0/4183053176 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe2405a510 0x7fbe2405c9d0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fbe4c0c7740 tx=0x7fbe34007d40).stop 2024-01-22T05:20:59.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.557+0000 7fbe52000700 1 -- 172.21.15.49:0/4183053176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c0bef20 msgr2=0x7fbe4c0bfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.557+0000 7fbe52000700 1 --2- 172.21.15.49:0/4183053176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c0bef20 0x7fbe4c0bfb60 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 rx=0x7fbe3c009f50 tx=0x7fbe3c017000).stop 2024-01-22T05:20:59.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.561+0000 7fbe52000700 1 -- 172.21.15.49:0/4183053176 shutdown_connections 2024-01-22T05:20:59.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.561+0000 7fbe52000700 1 --2- 172.21.15.49:0/4183053176 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe2405a510 0x7fbe2405c9d0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.561+0000 7fbe52000700 1 --2- 172.21.15.49:0/4183053176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe4c0c5710 0x7fbe4c146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.561+0000 7fbe52000700 1 --2- 172.21.15.49:0/4183053176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe4c0c49c0 0x7fbe4c0c11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.561+0000 7fbe52000700 1 --2- 172.21.15.49:0/4183053176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe4c0bef20 0x7fbe4c0bfb60 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.561+0000 7fbe52000700 1 -- 172.21.15.49:0/4183053176 >> 172.21.15.49:0/4183053176 conn(0x7fbe4c0c9030 msgr2=0x7fbe4c147a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:59.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.561+0000 7fbe52000700 1 -- 172.21.15.49:0/4183053176 shutdown_connections 2024-01-22T05:20:59.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.561+0000 7fbe52000700 1 -- 172.21.15.49:0/4183053176 wait complete. 2024-01-22T05:20:59.566 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 157 2024-01-22T05:20:59.586 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:20:59.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.741+0000 7f45df200700 1 Processor -- start 2024-01-22T05:20:59.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.745+0000 7f45df200700 1 -- start start 2024-01-22T05:20:59.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.745+0000 7f45df200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f45d8155d20 0x7f45d8065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.745+0000 7f45df200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d8066070 0x7f45d80a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.745+0000 7f45df200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45d80a8c30 0x7f45d80c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.745+0000 7f45df200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d80c1a40 con 0x7f45d80a8c30 2024-01-22T05:20:59.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.745+0000 7f45df200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d80a9090 con 0x7f45d8155d20 2024-01-22T05:20:59.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.745+0000 7f45df200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d8159310 con 0x7f45d8066070 2024-01-22T05:20:59.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45dd200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45d80a8c30 0x7f45d80c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45d7e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f45d8155d20 0x7f45d8065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45d7400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d8066070 0x7f45d80a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45d7e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f45d8155d20 0x7f45d8065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:38572/0 (socket says 172.21.15.49:38572) 2024-01-22T05:20:59.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45d7e00700 1 -- 172.21.15.49:0/4153138291 learned_addr learned my addr 172.21.15.49:0/4153138291 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:59.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45d7e00700 1 -- 172.21.15.49:0/4153138291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d8066070 msgr2=0x7f45d80a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:59.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45d7e00700 1 --2- 172.21.15.49:0/4153138291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d8066070 0x7f45d80a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45d7e00700 1 -- 172.21.15.49:0/4153138291 >> v2:172.21.15.49:3300/0 conn(0x7f45d80a8c30 msgr2=0x7f45d80c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:20:59.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45d7e00700 1 --2- 172.21.15.49:0/4153138291 >> v2:172.21.15.49:3300/0 conn(0x7f45d80a8c30 0x7f45d80c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45d7e00700 1 -- 172.21.15.49:0/4153138291 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d80c13f0 con 0x7f45d8155d20 2024-01-22T05:20:59.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45d7e00700 1 --2- 172.21.15.49:0/4153138291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45d8155d20 0x7f45d8065b80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f45d805ff40 tx=0x7f45c80090f0).ready entity=mon.1 client_cookie=961ccf642276846d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:59.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45d6a00700 1 -- 172.21.15.49:0/4153138291 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c800f510 con 0x7f45d8155d20 2024-01-22T05:20:59.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45d6a00700 1 -- 172.21.15.49:0/4153138291 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c800f670 con 0x7f45d8155d20 2024-01-22T05:20:59.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45d6a00700 1 -- 172.21.15.49:0/4153138291 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c800f9f0 con 0x7f45d8155d20 2024-01-22T05:20:59.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45df200700 1 -- 172.21.15.49:0/4153138291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45d8155d20 msgr2=0x7f45d8065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45df200700 1 --2- 172.21.15.49:0/4153138291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45d8155d20 0x7f45d8065b80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f45d805ff40 tx=0x7f45c80090f0).stop 2024-01-22T05:20:59.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45df200700 1 -- 172.21.15.49:0/4153138291 shutdown_connections 2024-01-22T05:20:59.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45df200700 1 --2- 172.21.15.49:0/4153138291 >> v2:172.21.15.49:3300/0 conn(0x7f45d80a8c30 0x7f45d80c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45df200700 1 --2- 172.21.15.49:0/4153138291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d8066070 0x7f45d80a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45df200700 1 --2- 172.21.15.49:0/4153138291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45d8155d20 0x7f45d8065b80 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.749+0000 7f45df200700 1 -- 172.21.15.49:0/4153138291 >> 172.21.15.49:0/4153138291 conn(0x7f45d80c6540 msgr2=0x7f45d80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:59.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.753+0000 7f45df200700 1 -- 172.21.15.49:0/4153138291 shutdown_connections 2024-01-22T05:20:59.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.753+0000 7f45df200700 1 -- 172.21.15.49:0/4153138291 wait complete. 2024-01-22T05:20:59.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.753+0000 7f45df200700 1 Processor -- start 2024-01-22T05:20:59.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.757+0000 7f45df200700 1 -- start start 2024-01-22T05:20:59.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.757+0000 7f45df200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45d8066070 0x7f45d8159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.757+0000 7f45df200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d80a8c30 0x7f45d80bd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.757+0000 7f45df200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d8155d20 0x7f45d816c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.757+0000 7f45df200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80ac610 con 0x7f45d8155d20 2024-01-22T05:20:59.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.757+0000 7f45df200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80a9f50 con 0x7f45d8066070 2024-01-22T05:20:59.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.757+0000 7f45df200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d815a500 con 0x7f45d80a8c30 2024-01-22T05:20:59.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.757+0000 7f45dd200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d8155d20 0x7f45d816c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.757+0000 7f45dd200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d8155d20 0x7f45d816c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41210/0 (socket says 172.21.15.49:41210) 2024-01-22T05:20:59.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.757+0000 7f45dd200700 1 -- 172.21.15.49:0/434537765 learned_addr learned my addr 172.21.15.49:0/434537765 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:20:59.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.757+0000 7f45d7400700 1 --2- 172.21.15.49:0/434537765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d80a8c30 0x7f45d80bd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.761+0000 7f45d7e00700 1 --2- 172.21.15.49:0/434537765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45d8066070 0x7f45d8159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.761+0000 7f45dd200700 1 -- 172.21.15.49:0/434537765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d80a8c30 msgr2=0x7f45d80bd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.761+0000 7f45dd200700 1 --2- 172.21.15.49:0/434537765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d80a8c30 0x7f45d80bd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.761+0000 7f45dd200700 1 -- 172.21.15.49:0/434537765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45d8066070 msgr2=0x7f45d8159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.761+0000 7f45dd200700 1 --2- 172.21.15.49:0/434537765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45d8066070 0x7f45d8159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.761+0000 7f45dd200700 1 -- 172.21.15.49:0/434537765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c8009370 con 0x7f45d8155d20 2024-01-22T05:20:59.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.761+0000 7f45dd200700 1 --2- 172.21.15.49:0/434537765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d8155d20 0x7f45d816c280 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 rx=0x7f45d0009e90 tx=0x7f45d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:59.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.761+0000 7f45cf400700 1 -- 172.21.15.49:0/434537765 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d000caa0 con 0x7f45d8155d20 2024-01-22T05:20:59.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.761+0000 7f45cf400700 1 -- 172.21.15.49:0/434537765 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d000f040 con 0x7f45d8155d20 2024-01-22T05:20:59.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.761+0000 7f45df200700 1 -- 172.21.15.49:0/434537765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d815a7e0 con 0x7f45d8155d20 2024-01-22T05:20:59.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.761+0000 7f45cf400700 1 -- 172.21.15.49:0/434537765 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d000ce10 con 0x7f45d8155d20 2024-01-22T05:20:59.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.761+0000 7f45df200700 1 -- 172.21.15.49:0/434537765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d815ada0 con 0x7f45d8155d20 2024-01-22T05:20:59.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.761+0000 7f45df200700 1 -- 172.21.15.49:0/434537765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d80aa100 con 0x7f45d8155d20 2024-01-22T05:20:59.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.761+0000 7f45cf400700 1 -- 172.21.15.49:0/434537765 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f45d0013610 con 0x7f45d8155d20 2024-01-22T05:20:59.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.765+0000 7f45cf400700 1 --2- 172.21.15.49:0/434537765 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45b005a510 0x7f45b005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:20:59.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.765+0000 7f45cf400700 1 -- 172.21.15.49:0/434537765 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7f45d00752c0 con 0x7f45d8155d20 2024-01-22T05:20:59.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.765+0000 7f45d7e00700 1 --2- 172.21.15.49:0/434537765 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45b005a510 0x7f45b005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:20:59.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.765+0000 7f45d7e00700 1 --2- 172.21.15.49:0/434537765 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45b005a510 0x7f45b005c9d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f45c8009130 tx=0x7f45c8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:20:59.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.773+0000 7f45cf400700 1 -- 172.21.15.49:0/434537765 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f45d80aa100 con 0x7f45d8155d20 2024-01-22T05:20:59.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.937+0000 7f45df200700 1 -- 172.21.15.49:0/434537765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45d8047060 con 0x7f45d8155d20 2024-01-22T05:20:59.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.937+0000 7f45cf400700 1 -- 172.21.15.49:0/434537765 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) v1 ==== 74+0+17691 (secure 0 0 0) 0x7f45d0048740 con 0x7f45d8155d20 2024-01-22T05:20:59.941 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:20:59.941 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":200,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:20:29.484295+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:19:37.238555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-01-22T05:19:38.297767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"28.0","mappings":[{"from":6,"to":4}]},{"pgid":"28.8","mappings":[{"from":6,"to":1}]},{"pgid":"28.1d","mappings":[{"from":6,"to":4}]},{"pgid":"29.10","mappings":[{"from":6,"to":0}]},{"pgid":"29.14","mappings":[{"from":6,"to":0}]},{"pgid":"29.19","mappings":[{"from":6,"to":0}]},{"pgid":"29.23","mappings":[{"from":6,"to":0}]},{"pgid":"29.39","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6837/1585471135":"2024-01-23T05:19:48.627681+0000","172.21.15.49:6835/1585471135":"2024-01-23T05:19:48.627681+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:20:59.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.941+0000 7f45df200700 1 -- 172.21.15.49:0/434537765 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45b005a510 msgr2=0x7f45b005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.941+0000 7f45df200700 1 --2- 172.21.15.49:0/434537765 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45b005a510 0x7f45b005c9d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f45c8009130 tx=0x7f45c8017000).stop 2024-01-22T05:20:59.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.941+0000 7f45df200700 1 -- 172.21.15.49:0/434537765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d8155d20 msgr2=0x7f45d816c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:20:59.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.941+0000 7f45df200700 1 --2- 172.21.15.49:0/434537765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d8155d20 0x7f45d816c280 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 rx=0x7f45d0009e90 tx=0x7f45d000b040).stop 2024-01-22T05:20:59.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.941+0000 7f45df200700 1 -- 172.21.15.49:0/434537765 shutdown_connections 2024-01-22T05:20:59.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.941+0000 7f45df200700 1 --2- 172.21.15.49:0/434537765 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45b005a510 0x7f45b005c9d0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.941+0000 7f45df200700 1 --2- 172.21.15.49:0/434537765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d8155d20 0x7f45d816c280 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.941+0000 7f45df200700 1 --2- 172.21.15.49:0/434537765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d80a8c30 0x7f45d80bd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.941+0000 7f45df200700 1 --2- 172.21.15.49:0/434537765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45d8066070 0x7f45d8159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:20:59.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.941+0000 7f45df200700 1 -- 172.21.15.49:0/434537765 >> 172.21.15.49:0/434537765 conn(0x7f45d80c6540 msgr2=0x7f45d80c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:20:59.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.945+0000 7f45df200700 1 -- 172.21.15.49:0/434537765 shutdown_connections 2024-01-22T05:20:59.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:20:59.945+0000 7f45df200700 1 -- 172.21.15.49:0/434537765 wait complete. 2024-01-22T05:20:59.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:04:26.438331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:04:28.181948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 28, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:19:37.238555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '196', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 29, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:19:38.297767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '197', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:20:59.969 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:21:00.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.129+0000 7fec7da00700 1 Processor -- start 2024-01-22T05:21:00.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.129+0000 7fec7da00700 1 -- start start 2024-01-22T05:21:00.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.133+0000 7fec7da00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec780a8c20 0x7fec780c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.133+0000 7fec7da00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fec780bcbe0 0x7fec78068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.133+0000 7fec7da00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec78158650 con 0x7fec780c1ac0 2024-01-22T05:21:00.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.133+0000 7fec7da00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec780c1f20 con 0x7fec780a8c20 2024-01-22T05:21:00.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.133+0000 7fec7da00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec780bd170 con 0x7fec780bcbe0 2024-01-22T05:21:00.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.133+0000 7fec76a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fec780a8c20 0x7fec780c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.133+0000 7fec76000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fec780c1ac0 0x7fec780bc4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53300/0 (socket says 172.21.15.49:53300) 2024-01-22T05:21:00.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.133+0000 7fec76000700 1 -- 172.21.15.49:0/3399049950 learned_addr learned my addr 172.21.15.49:0/3399049950 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:00.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.133+0000 7fec77400700 1 --2- 172.21.15.49:0/3399049950 >> v2:172.21.15.110:3300/0 conn(0x7fec780bcbe0 0x7fec78068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.133+0000 7fec75600700 1 -- 172.21.15.49:0/3399049950 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529502179 0 0) 0x7fec60001290 con 0x7fec780c1ac0 2024-01-22T05:21:00.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec75600700 1 -- 172.21.15.49:0/3399049950 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec580033f0 con 0x7fec780c1ac0 2024-01-22T05:21:00.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec77400700 1 -- 172.21.15.49:0/3399049950 >> v2:172.21.15.49:3300/0 conn(0x7fec780a8c20 msgr2=0x7fec780c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:00.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec77400700 1 --2- 172.21.15.49:0/3399049950 >> v2:172.21.15.49:3300/0 conn(0x7fec780a8c20 0x7fec780c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec77400700 1 -- 172.21.15.49:0/3399049950 >> v1:172.21.15.49:6789/0 conn(0x7fec780c1ac0 legacy=0x7fec780bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec77400700 1 -- 172.21.15.49:0/3399049950 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec78067c30 con 0x7fec780bcbe0 2024-01-22T05:21:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec76a00700 1 --2- 172.21.15.49:0/3399049950 >> v2:172.21.15.49:3300/0 conn(0x7fec780a8c20 0x7fec780c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:21:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec77400700 1 --2- 172.21.15.49:0/3399049950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec780bcbe0 0x7fec78068710 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7fec780c4410 tx=0x7fec70009780).ready entity=mon.1 client_cookie=d10a15cf9616e364 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec75600700 1 -- 172.21.15.49:0/3399049950 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7000e070 con 0x7fec780bcbe0 2024-01-22T05:21:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec75600700 1 -- 172.21.15.49:0/3399049950 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7000bab0 con 0x7fec780bcbe0 2024-01-22T05:21:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec75600700 1 -- 172.21.15.49:0/3399049950 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7000be30 con 0x7fec780bcbe0 2024-01-22T05:21:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec7da00700 1 -- 172.21.15.49:0/3399049950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec780bcbe0 msgr2=0x7fec78068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec7da00700 1 --2- 172.21.15.49:0/3399049950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec780bcbe0 0x7fec78068710 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7fec780c4410 tx=0x7fec70009780).stop 2024-01-22T05:21:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec7da00700 1 -- 172.21.15.49:0/3399049950 shutdown_connections 2024-01-22T05:21:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec7da00700 1 --2- 172.21.15.49:0/3399049950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec780bcbe0 0x7fec78068710 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec7da00700 1 --2- 172.21.15.49:0/3399049950 >> v2:172.21.15.49:3300/0 conn(0x7fec780a8c20 0x7fec780c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec7da00700 1 -- 172.21.15.49:0/3399049950 >> 172.21.15.49:0/3399049950 conn(0x7fec78062cb0 msgr2=0x7fec780c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec7da00700 1 -- 172.21.15.49:0/3399049950 shutdown_connections 2024-01-22T05:21:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.137+0000 7fec7da00700 1 -- 172.21.15.49:0/3399049950 wait complete. 2024-01-22T05:21:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.141+0000 7fec7da00700 1 Processor -- start 2024-01-22T05:21:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.141+0000 7fec7da00700 1 -- start start 2024-01-22T05:21:00.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.141+0000 7fec7da00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec780a8c20 0x7fec781514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.141+0000 7fec7da00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec780bcbe0 0x7fec78153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.141+0000 7fec7da00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec780c1ac0 0x7fec780ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.141+0000 7fec7da00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec781597c0 con 0x7fec780c1ac0 2024-01-22T05:21:00.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.141+0000 7fec7da00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7815a620 con 0x7fec780bcbe0 2024-01-22T05:21:00.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.141+0000 7fec7da00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7815aab0 con 0x7fec780a8c20 2024-01-22T05:21:00.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec77400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec780c1ac0 0x7fec780ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec77400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec780c1ac0 0x7fec780ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41230/0 (socket says 172.21.15.49:41230) 2024-01-22T05:21:00.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec77400700 1 -- 172.21.15.49:0/2776012918 learned_addr learned my addr 172.21.15.49:0/2776012918 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:00.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec76a00700 1 --2- 172.21.15.49:0/2776012918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec780a8c20 0x7fec781514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec76000700 1 --2- 172.21.15.49:0/2776012918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec780bcbe0 0x7fec78153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec77400700 1 -- 172.21.15.49:0/2776012918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec780a8c20 msgr2=0x7fec781514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:00.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec77400700 1 --2- 172.21.15.49:0/2776012918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec780a8c20 0x7fec781514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec77400700 1 -- 172.21.15.49:0/2776012918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec780bcbe0 msgr2=0x7fec78153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:00.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec77400700 1 --2- 172.21.15.49:0/2776012918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec780bcbe0 0x7fec78153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec77400700 1 -- 172.21.15.49:0/2776012918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec680092a0 con 0x7fec780c1ac0 2024-01-22T05:21:00.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec76a00700 1 --2- 172.21.15.49:0/2776012918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec780a8c20 0x7fec781514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:21:00.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec77400700 1 --2- 172.21.15.49:0/2776012918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec780c1ac0 0x7fec780ab060 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 rx=0x7fec70012cb0 tx=0x7fec70009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:00.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec6e000700 1 -- 172.21.15.49:0/2776012918 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7001d630 con 0x7fec780c1ac0 2024-01-22T05:21:00.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec6e000700 1 -- 172.21.15.49:0/2776012918 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7001d790 con 0x7fec780c1ac0 2024-01-22T05:21:00.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec7da00700 1 -- 172.21.15.49:0/2776012918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec70009a20 con 0x7fec780c1ac0 2024-01-22T05:21:00.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec6e000700 1 -- 172.21.15.49:0/2776012918 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7001db30 con 0x7fec780c1ac0 2024-01-22T05:21:00.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.145+0000 7fec7da00700 1 -- 172.21.15.49:0/2776012918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec78159cf0 con 0x7fec780c1ac0 2024-01-22T05:21:00.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.149+0000 7fec7da00700 1 -- 172.21.15.49:0/2776012918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec780c0c00 con 0x7fec780c1ac0 2024-01-22T05:21:00.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.149+0000 7fec6e000700 1 -- 172.21.15.49:0/2776012918 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fec70026410 con 0x7fec780c1ac0 2024-01-22T05:21:00.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.149+0000 7fec6e000700 1 --2- 172.21.15.49:0/2776012918 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fec5005a510 0x7fec5005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.149+0000 7fec6e000700 1 -- 172.21.15.49:0/2776012918 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7fec70076960 con 0x7fec780c1ac0 2024-01-22T05:21:00.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.153+0000 7fec76a00700 1 --2- 172.21.15.49:0/2776012918 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fec5005a510 0x7fec5005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.153+0000 7fec76a00700 1 --2- 172.21.15.49:0/2776012918 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fec5005a510 0x7fec5005c9d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fec68009270 tx=0x7fec68008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:00.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.157+0000 7fec6e000700 1 -- 172.21.15.49:0/2776012918 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fec70049d80 con 0x7fec780c1ac0 2024-01-22T05:21:00.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.321+0000 7fec7da00700 1 -- 172.21.15.49:0/2776012918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fec7815a760 con 0x7fec780c1ac0 2024-01-22T05:21:00.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.321+0000 7fec6e000700 1 -- 172.21.15.49:0/2776012918 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v200) v1 ==== 110+0+10 (secure 0 0 0) 0x7fec7004d3a0 con 0x7fec780c1ac0 2024-01-22T05:21:00.323 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-22T05:21:00.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.325+0000 7fec7da00700 1 -- 172.21.15.49:0/2776012918 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fec5005a510 msgr2=0x7fec5005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:00.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.325+0000 7fec7da00700 1 --2- 172.21.15.49:0/2776012918 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fec5005a510 0x7fec5005c9d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fec68009270 tx=0x7fec68008040).stop 2024-01-22T05:21:00.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.325+0000 7fec7da00700 1 -- 172.21.15.49:0/2776012918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec780c1ac0 msgr2=0x7fec780ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:00.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.325+0000 7fec7da00700 1 --2- 172.21.15.49:0/2776012918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec780c1ac0 0x7fec780ab060 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 rx=0x7fec70012cb0 tx=0x7fec70009780).stop 2024-01-22T05:21:00.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.325+0000 7fec7da00700 1 -- 172.21.15.49:0/2776012918 shutdown_connections 2024-01-22T05:21:00.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.325+0000 7fec7da00700 1 --2- 172.21.15.49:0/2776012918 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fec5005a510 0x7fec5005c9d0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.325+0000 7fec7da00700 1 --2- 172.21.15.49:0/2776012918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec780c1ac0 0x7fec780ab060 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.325+0000 7fec7da00700 1 --2- 172.21.15.49:0/2776012918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec780bcbe0 0x7fec78153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.325+0000 7fec7da00700 1 --2- 172.21.15.49:0/2776012918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec780a8c20 0x7fec781514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.325+0000 7fec7da00700 1 -- 172.21.15.49:0/2776012918 >> 172.21.15.49:0/2776012918 conn(0x7fec78062cb0 msgr2=0x7fec780c5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:00.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.325+0000 7fec7da00700 1 -- 172.21.15.49:0/2776012918 shutdown_connections 2024-01-22T05:21:00.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.325+0000 7fec7da00700 1 -- 172.21.15.49:0/2776012918 wait complete. 2024-01-22T05:21:00.351 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:21:00.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.513+0000 7fb58be00700 1 Processor -- start 2024-01-22T05:21:00.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.513+0000 7fb58be00700 1 -- start start 2024-01-22T05:21:00.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.517+0000 7fb58be00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb58c157ee0 0x7fb58c065590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.517+0000 7fb58be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb58c068af0 0x7fb58c065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.517+0000 7fb58be00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58c068280 con 0x7fb58c068710 2024-01-22T05:21:00.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.517+0000 7fb58be00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58c069600 con 0x7fb58c157ee0 2024-01-22T05:21:00.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.517+0000 7fb58be00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c0c1cc0 con 0x7fb58c068af0 2024-01-22T05:21:00.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.517+0000 7fb58aa00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb58c068710 0x7fb58c1577d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53314/0 (socket says 172.21.15.49:53314) 2024-01-22T05:21:00.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.517+0000 7fb58aa00700 1 -- 172.21.15.49:0/2663588794 learned_addr learned my addr 172.21.15.49:0/2663588794 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:00.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.517+0000 7fb58b400700 1 --2- 172.21.15.49:0/2663588794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb58c068af0 0x7fb58c065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.517+0000 7fb58a000700 1 --2- 172.21.15.49:0/2663588794 >> v2:172.21.15.110:3300/0 conn(0x7fb58c157ee0 0x7fb58c065590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.521+0000 7fb589600700 1 -- 172.21.15.49:0/2663588794 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343333306 0 0) 0x7fb58c068280 con 0x7fb58c068710 2024-01-22T05:21:00.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.521+0000 7fb58b400700 1 -- 172.21.15.49:0/2663588794 >> v2:172.21.15.110:3300/0 conn(0x7fb58c157ee0 msgr2=0x7fb58c065590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:00.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.521+0000 7fb58b400700 1 --2- 172.21.15.49:0/2663588794 >> v2:172.21.15.110:3300/0 conn(0x7fb58c157ee0 0x7fb58c065590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.521+0000 7fb58b400700 1 -- 172.21.15.49:0/2663588794 >> v1:172.21.15.49:6789/0 conn(0x7fb58c068710 legacy=0x7fb58c1577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:00.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.521+0000 7fb58b400700 1 -- 172.21.15.49:0/2663588794 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c067c30 con 0x7fb58c068af0 2024-01-22T05:21:00.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.521+0000 7fb58b400700 1 --2- 172.21.15.49:0/2663588794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb58c068af0 0x7fb58c065a80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fb584009e60 tx=0x7fb584009780).ready entity=mon.2 client_cookie=20c4f6cd433ae32b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:00.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.521+0000 7fb589600700 1 -- 172.21.15.49:0/2663588794 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58400e070 con 0x7fb58c068af0 2024-01-22T05:21:00.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.521+0000 7fb589600700 1 -- 172.21.15.49:0/2663588794 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58400bb60 con 0x7fb58c068af0 2024-01-22T05:21:00.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.521+0000 7fb589600700 1 -- 172.21.15.49:0/2663588794 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb584012410 con 0x7fb58c068af0 2024-01-22T05:21:00.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.521+0000 7fb58be00700 1 -- 172.21.15.49:0/2663588794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb58c068af0 msgr2=0x7fb58c065a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:00.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.521+0000 7fb58be00700 1 --2- 172.21.15.49:0/2663588794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb58c068af0 0x7fb58c065a80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fb584009e60 tx=0x7fb584009780).stop 2024-01-22T05:21:00.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.521+0000 7fb58be00700 1 -- 172.21.15.49:0/2663588794 shutdown_connections 2024-01-22T05:21:00.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.521+0000 7fb58be00700 1 --2- 172.21.15.49:0/2663588794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb58c068af0 0x7fb58c065a80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.521+0000 7fb58be00700 1 --2- 172.21.15.49:0/2663588794 >> v2:172.21.15.110:3300/0 conn(0x7fb58c157ee0 0x7fb58c065590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.521+0000 7fb58be00700 1 -- 172.21.15.49:0/2663588794 >> 172.21.15.49:0/2663588794 conn(0x7fb58c0c6fc0 msgr2=0x7fb58c0c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:00.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.525+0000 7fb58be00700 1 -- 172.21.15.49:0/2663588794 shutdown_connections 2024-01-22T05:21:00.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.525+0000 7fb58be00700 1 -- 172.21.15.49:0/2663588794 wait complete. 2024-01-22T05:21:00.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.525+0000 7fb58be00700 1 Processor -- start 2024-01-22T05:21:00.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.525+0000 7fb58be00700 1 -- start start 2024-01-22T05:21:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58be00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb58c068710 0x7fb58c14e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb58c068af0 0x7fb58c165270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb58c157ee0 0x7fb58c164180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58be00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c14f530 con 0x7fb58c068710 2024-01-22T05:21:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58be00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c165760 con 0x7fb58c157ee0 2024-01-22T05:21:00.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58be00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c164670 con 0x7fb58c068af0 2024-01-22T05:21:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb58c068710 0x7fb58c14e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb58c068710 0x7fb58c14e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41232/0 (socket says 172.21.15.49:41232) 2024-01-22T05:21:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58aa00700 1 -- 172.21.15.49:0/3475990095 learned_addr learned my addr 172.21.15.49:0/3475990095 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58a000700 1 --2- 172.21.15.49:0/3475990095 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb58c068af0 0x7fb58c165270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58b400700 1 --2- 172.21.15.49:0/3475990095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb58c157ee0 0x7fb58c164180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58aa00700 1 -- 172.21.15.49:0/3475990095 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb58c068af0 msgr2=0x7fb58c165270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:00.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58aa00700 1 --2- 172.21.15.49:0/3475990095 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb58c068af0 0x7fb58c165270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58aa00700 1 -- 172.21.15.49:0/3475990095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb58c157ee0 msgr2=0x7fb58c164180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:00.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58aa00700 1 --2- 172.21.15.49:0/3475990095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb58c157ee0 0x7fb58c164180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58aa00700 1 -- 172.21.15.49:0/3475990095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb584009a20 con 0x7fb58c068710 2024-01-22T05:21:00.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb58aa00700 1 --2- 172.21.15.49:0/3475990095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb58c068710 0x7fb58c14e9b0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 rx=0x7fb57c00c490 tx=0x7fb57c007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:00.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.529+0000 7fb582000700 1 -- 172.21.15.49:0/3475990095 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0070d0 con 0x7fb58c068710 2024-01-22T05:21:00.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.533+0000 7fb582000700 1 -- 172.21.15.49:0/3475990095 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c007230 con 0x7fb58c068710 2024-01-22T05:21:00.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.533+0000 7fb58be00700 1 -- 172.21.15.49:0/3475990095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58c14ef70 con 0x7fb58c068710 2024-01-22T05:21:00.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.533+0000 7fb582000700 1 -- 172.21.15.49:0/3475990095 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0075b0 con 0x7fb58c068710 2024-01-22T05:21:00.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.533+0000 7fb58be00700 1 -- 172.21.15.49:0/3475990095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58c167f40 con 0x7fb58c068710 2024-01-22T05:21:00.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.533+0000 7fb58be00700 1 -- 172.21.15.49:0/3475990095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58c167da0 con 0x7fb58c068710 2024-01-22T05:21:00.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.537+0000 7fb582000700 1 -- 172.21.15.49:0/3475990095 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb57c005bc0 con 0x7fb58c068710 2024-01-22T05:21:00.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.537+0000 7fb582000700 1 --2- 172.21.15.49:0/3475990095 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb56405a540 0x7fb56405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.537+0000 7fb582000700 1 -- 172.21.15.49:0/3475990095 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7fb57c0742b0 con 0x7fb58c068710 2024-01-22T05:21:00.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.537+0000 7fb58a000700 1 --2- 172.21.15.49:0/3475990095 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb56405a540 0x7fb56405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.537+0000 7fb58a000700 1 --2- 172.21.15.49:0/3475990095 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb56405a540 0x7fb56405ca00 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fb58c14eea0 tx=0x7fb574009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:00.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.541+0000 7fb582000700 1 -- 172.21.15.49:0/3475990095 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb58c167da0 con 0x7fb58c068710 2024-01-22T05:21:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.713+0000 7fb58be00700 1 -- 172.21.15.49:0/3475990095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb58c167da0 con 0x7fb58c068710 2024-01-22T05:21:00.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.713+0000 7fb582000700 1 -- 172.21.15.49:0/3475990095 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v200) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb58c167da0 con 0x7fb58c068710 2024-01-22T05:21:00.715 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-01-22T05:21:00.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.717+0000 7fb58be00700 1 -- 172.21.15.49:0/3475990095 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb56405a540 msgr2=0x7fb56405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:00.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.717+0000 7fb58be00700 1 --2- 172.21.15.49:0/3475990095 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb56405a540 0x7fb56405ca00 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fb58c14eea0 tx=0x7fb574009060).stop 2024-01-22T05:21:00.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.717+0000 7fb58be00700 1 -- 172.21.15.49:0/3475990095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb58c068710 msgr2=0x7fb58c14e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:00.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.717+0000 7fb58be00700 1 --2- 172.21.15.49:0/3475990095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb58c068710 0x7fb58c14e9b0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 rx=0x7fb57c00c490 tx=0x7fb57c007e30).stop 2024-01-22T05:21:00.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.717+0000 7fb58be00700 1 -- 172.21.15.49:0/3475990095 shutdown_connections 2024-01-22T05:21:00.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.717+0000 7fb58be00700 1 --2- 172.21.15.49:0/3475990095 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb56405a540 0x7fb56405ca00 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.717+0000 7fb58be00700 1 --2- 172.21.15.49:0/3475990095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb58c157ee0 0x7fb58c164180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.717+0000 7fb58be00700 1 --2- 172.21.15.49:0/3475990095 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb58c068af0 0x7fb58c165270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.717+0000 7fb58be00700 1 --2- 172.21.15.49:0/3475990095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb58c068710 0x7fb58c14e9b0 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.717+0000 7fb58be00700 1 -- 172.21.15.49:0/3475990095 >> 172.21.15.49:0/3475990095 conn(0x7fb58c0c6fc0 msgr2=0x7fb58c14fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.717+0000 7fb58be00700 1 -- 172.21.15.49:0/3475990095 shutdown_connections 2024-01-22T05:21:00.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.717+0000 7fb58be00700 1 -- 172.21.15.49:0/3475990095 wait complete. 2024-01-22T05:21:00.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:21:00.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.909+0000 7fce96200700 1 Processor -- start 2024-01-22T05:21:00.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.909+0000 7fce96200700 1 -- start start 2024-01-22T05:21:00.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.909+0000 7fce96200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fce90067a90 0x7fce9015bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.909+0000 7fce96200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce9015c0b0 0x7fce90158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.909+0000 7fce96200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce90158b60 0x7fce90158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.909+0000 7fce96200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce901561a0 con 0x7fce90158b60 2024-01-22T05:21:00.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.909+0000 7fce96200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce90068dd0 con 0x7fce90067a90 2024-01-22T05:21:00.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.909+0000 7fce96200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce90069600 con 0x7fce9015c0b0 2024-01-22T05:21:00.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce95800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce90158b60 0x7fce90158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce95800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce90158b60 0x7fce90158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41234/0 (socket says 172.21.15.49:41234) 2024-01-22T05:21:00.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce95800700 1 -- 172.21.15.49:0/4241453763 learned_addr learned my addr 172.21.15.49:0/4241453763 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:00.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce8fe00700 1 --2- 172.21.15.49:0/4241453763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce9015c0b0 0x7fce90158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce94e00700 1 --2- 172.21.15.49:0/4241453763 >> v2:172.21.15.110:3300/0 conn(0x7fce90067a90 0x7fce9015bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce95800700 1 -- 172.21.15.49:0/4241453763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce9015c0b0 msgr2=0x7fce90158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:00.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce95800700 1 --2- 172.21.15.49:0/4241453763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce9015c0b0 0x7fce90158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce95800700 1 -- 172.21.15.49:0/4241453763 >> v2:172.21.15.110:3300/0 conn(0x7fce90067a90 msgr2=0x7fce9015bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:00.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce95800700 1 --2- 172.21.15.49:0/4241453763 >> v2:172.21.15.110:3300/0 conn(0x7fce90067a90 0x7fce9015bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce95800700 1 -- 172.21.15.49:0/4241453763 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9015c510 con 0x7fce90158b60 2024-01-22T05:21:00.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce95800700 1 --2- 172.21.15.49:0/4241453763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce90158b60 0x7fce90158ff0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 rx=0x7fce90065490 tx=0x7fce88009840).ready entity=mon.0 client_cookie=6be21c3463ccbb95 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:00.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce8f400700 1 -- 172.21.15.49:0/4241453763 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8800e070 con 0x7fce90158b60 2024-01-22T05:21:00.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce8f400700 1 -- 172.21.15.49:0/4241453763 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8800b930 con 0x7fce90158b60 2024-01-22T05:21:00.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce8f400700 1 -- 172.21.15.49:0/4241453763 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8800bcb0 con 0x7fce90158b60 2024-01-22T05:21:00.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce96200700 1 -- 172.21.15.49:0/4241453763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce90158b60 msgr2=0x7fce90158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:00.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.913+0000 7fce96200700 1 --2- 172.21.15.49:0/4241453763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce90158b60 0x7fce90158ff0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 rx=0x7fce90065490 tx=0x7fce88009840).stop 2024-01-22T05:21:00.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.917+0000 7fce96200700 1 -- 172.21.15.49:0/4241453763 shutdown_connections 2024-01-22T05:21:00.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.917+0000 7fce96200700 1 --2- 172.21.15.49:0/4241453763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce90158b60 0x7fce90158ff0 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.917+0000 7fce96200700 1 --2- 172.21.15.49:0/4241453763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce9015c0b0 0x7fce90158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.917+0000 7fce96200700 1 --2- 172.21.15.49:0/4241453763 >> v2:172.21.15.110:3300/0 conn(0x7fce90067a90 0x7fce9015bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.917+0000 7fce96200700 1 -- 172.21.15.49:0/4241453763 >> 172.21.15.49:0/4241453763 conn(0x7fce900c6fc0 msgr2=0x7fce900c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:00.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.917+0000 7fce96200700 1 -- 172.21.15.49:0/4241453763 shutdown_connections 2024-01-22T05:21:00.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.917+0000 7fce96200700 1 -- 172.21.15.49:0/4241453763 wait complete. 2024-01-22T05:21:00.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.917+0000 7fce96200700 1 Processor -- start 2024-01-22T05:21:00.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce96200700 1 -- start start 2024-01-22T05:21:00.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce96200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce90067a90 0x7fce900a9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce96200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce90158b60 0x7fce90145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce96200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9015c0b0 0x7fce9016be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce96200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce900abb90 con 0x7fce90158b60 2024-01-22T05:21:00.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce96200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce900abde0 con 0x7fce9015c0b0 2024-01-22T05:21:00.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce96200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce900ac0c0 con 0x7fce90067a90 2024-01-22T05:21:00.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce8fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce90158b60 0x7fce90145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce8fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce90158b60 0x7fce90145720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41246/0 (socket says 172.21.15.49:41246) 2024-01-22T05:21:00.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce8fe00700 1 -- 172.21.15.49:0/3984210430 learned_addr learned my addr 172.21.15.49:0/3984210430 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:00.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce94e00700 1 --2- 172.21.15.49:0/3984210430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce90067a90 0x7fce900a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce95800700 1 --2- 172.21.15.49:0/3984210430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9015c0b0 0x7fce9016be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce8fe00700 1 -- 172.21.15.49:0/3984210430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce90067a90 msgr2=0x7fce900a9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:00.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce8fe00700 1 --2- 172.21.15.49:0/3984210430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce90067a90 0x7fce900a9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce8fe00700 1 -- 172.21.15.49:0/3984210430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9015c0b0 msgr2=0x7fce9016be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:00.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce8fe00700 1 --2- 172.21.15.49:0/3984210430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9015c0b0 0x7fce9016be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:00.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.921+0000 7fce8fe00700 1 -- 172.21.15.49:0/3984210430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce88009ae0 con 0x7fce90158b60 2024-01-22T05:21:00.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.925+0000 7fce8fe00700 1 --2- 172.21.15.49:0/3984210430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce90158b60 0x7fce90145720 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 rx=0x7fce7800e930 tx=0x7fce78009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:00.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.925+0000 7fce87e00700 1 -- 172.21.15.49:0/3984210430 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7800eed0 con 0x7fce90158b60 2024-01-22T05:21:00.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.925+0000 7fce87e00700 1 -- 172.21.15.49:0/3984210430 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce78009510 con 0x7fce90158b60 2024-01-22T05:21:00.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.925+0000 7fce96200700 1 -- 172.21.15.49:0/3984210430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce900ac3a0 con 0x7fce90158b60 2024-01-22T05:21:00.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.925+0000 7fce87e00700 1 -- 172.21.15.49:0/3984210430 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7800ca60 con 0x7fce90158b60 2024-01-22T05:21:00.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.925+0000 7fce96200700 1 -- 172.21.15.49:0/3984210430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce900a9a30 con 0x7fce90158b60 2024-01-22T05:21:00.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.925+0000 7fce96200700 1 -- 172.21.15.49:0/3984210430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce90156620 con 0x7fce90158b60 2024-01-22T05:21:00.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.925+0000 7fce87e00700 1 -- 172.21.15.49:0/3984210430 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fce7801b400 con 0x7fce90158b60 2024-01-22T05:21:00.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.929+0000 7fce87e00700 1 --2- 172.21.15.49:0/3984210430 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce6805a4e0 0x7fce6805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:00.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.929+0000 7fce87e00700 1 -- 172.21.15.49:0/3984210430 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7fce78074f60 con 0x7fce90158b60 2024-01-22T05:21:00.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.929+0000 7fce94e00700 1 --2- 172.21.15.49:0/3984210430 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce6805a4e0 0x7fce6805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:00.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.929+0000 7fce94e00700 1 --2- 172.21.15.49:0/3984210430 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce6805a4e0 0x7fce6805c9a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7fce80009200 tx=0x7fce80008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:00.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:00.933+0000 7fce87e00700 1 -- 172.21.15.49:0/3984210430 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fce78048400 con 0x7fce90158b60 2024-01-22T05:21:01.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.101+0000 7fce96200700 1 -- 172.21.15.49:0/3984210430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fce90047060 con 0x7fce90158b60 2024-01-22T05:21:01.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.101+0000 7fce87e00700 1 -- 172.21.15.49:0/3984210430 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v200) v1 ==== 104+0+11 (secure 0 0 0) 0x7fce7804ba20 con 0x7fce90158b60 2024-01-22T05:21:01.103 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:21:01.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.101+0000 7fce96200700 1 -- 172.21.15.49:0/3984210430 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce6805a4e0 msgr2=0x7fce6805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:01.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.101+0000 7fce96200700 1 --2- 172.21.15.49:0/3984210430 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce6805a4e0 0x7fce6805c9a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7fce80009200 tx=0x7fce80008040).stop 2024-01-22T05:21:01.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.101+0000 7fce96200700 1 -- 172.21.15.49:0/3984210430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce90158b60 msgr2=0x7fce90145720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:01.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.101+0000 7fce96200700 1 --2- 172.21.15.49:0/3984210430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce90158b60 0x7fce90145720 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 rx=0x7fce7800e930 tx=0x7fce78009060).stop 2024-01-22T05:21:01.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.105+0000 7fce96200700 1 -- 172.21.15.49:0/3984210430 shutdown_connections 2024-01-22T05:21:01.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.105+0000 7fce96200700 1 --2- 172.21.15.49:0/3984210430 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce6805a4e0 0x7fce6805c9a0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.105+0000 7fce96200700 1 --2- 172.21.15.49:0/3984210430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9015c0b0 0x7fce9016be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.105+0000 7fce96200700 1 --2- 172.21.15.49:0/3984210430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce90158b60 0x7fce90145720 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.105+0000 7fce96200700 1 --2- 172.21.15.49:0/3984210430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce90067a90 0x7fce900a9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.105+0000 7fce96200700 1 -- 172.21.15.49:0/3984210430 >> 172.21.15.49:0/3984210430 conn(0x7fce900c6fc0 msgr2=0x7fce900c55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:01.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.105+0000 7fce96200700 1 -- 172.21.15.49:0/3984210430 shutdown_connections 2024-01-22T05:21:01.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.105+0000 7fce96200700 1 -- 172.21.15.49:0/3984210430 wait complete. 2024-01-22T05:21:01.130 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:21:01.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.297+0000 7fbe94c00700 1 Processor -- start 2024-01-22T05:21:01.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.297+0000 7fbe94c00700 1 -- start start 2024-01-22T05:21:01.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe94c00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe900c5200 0x7fbe90063570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:01.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe94c00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbe901577d0 0x7fbe90157c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:01.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe94c00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe900be5e0 con 0x7fbe90067d70 2024-01-22T05:21:01.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe94c00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe900beba0 con 0x7fbe900c5200 2024-01-22T05:21:01.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe94c00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe901540d0 con 0x7fbe901577d0 2024-01-22T05:21:01.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe8d400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe900c5200 0x7fbe90063570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:01.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe8d400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbe900c5200 0x7fbe90063570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41252/0 (socket says 172.21.15.49:41252) 2024-01-22T05:21:01.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe8d400700 1 -- 172.21.15.49:0/4094720903 learned_addr learned my addr 172.21.15.49:0/4094720903 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:01.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe8de00700 1 --1- 172.21.15.49:0/4094720903 >> v1:172.21.15.49:6789/0 conn(0x7fbe90067d70 0x7fbe90062e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53316/0 (socket says 172.21.15.49:53316) 2024-01-22T05:21:01.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe8f200700 1 --2- 172.21.15.49:0/4094720903 >> v2:172.21.15.110:3300/0 conn(0x7fbe901577d0 0x7fbe90157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:01.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe8d400700 1 -- 172.21.15.49:0/4094720903 >> v2:172.21.15.110:3300/0 conn(0x7fbe901577d0 msgr2=0x7fbe90157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe8d400700 1 --2- 172.21.15.49:0/4094720903 >> v2:172.21.15.110:3300/0 conn(0x7fbe901577d0 0x7fbe90157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe8d400700 1 -- 172.21.15.49:0/4094720903 >> v1:172.21.15.49:6789/0 conn(0x7fbe90067d70 legacy=0x7fbe90062e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe8d400700 1 -- 172.21.15.49:0/4094720903 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe900c4a90 con 0x7fbe900c5200 2024-01-22T05:21:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe8d400700 1 --2- 172.21.15.49:0/4094720903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe900c5200 0x7fbe90063570 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 rx=0x7fbe90059900 tx=0x7fbe780090f0).ready entity=mon.0 client_cookie=5407b2aabaa88339 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.301+0000 7fbe8ca00700 1 -- 172.21.15.49:0/4094720903 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7800b520 con 0x7fbe900c5200 2024-01-22T05:21:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.305+0000 7fbe8ca00700 1 -- 172.21.15.49:0/4094720903 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7800b680 con 0x7fbe900c5200 2024-01-22T05:21:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.305+0000 7fbe8ca00700 1 -- 172.21.15.49:0/4094720903 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7800ba00 con 0x7fbe900c5200 2024-01-22T05:21:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.305+0000 7fbe94c00700 1 -- 172.21.15.49:0/4094720903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe900c5200 msgr2=0x7fbe90063570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.305+0000 7fbe94c00700 1 --2- 172.21.15.49:0/4094720903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe900c5200 0x7fbe90063570 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 rx=0x7fbe90059900 tx=0x7fbe780090f0).stop 2024-01-22T05:21:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.305+0000 7fbe94c00700 1 -- 172.21.15.49:0/4094720903 shutdown_connections 2024-01-22T05:21:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.305+0000 7fbe94c00700 1 --2- 172.21.15.49:0/4094720903 >> v2:172.21.15.110:3300/0 conn(0x7fbe901577d0 0x7fbe90157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.305+0000 7fbe94c00700 1 --2- 172.21.15.49:0/4094720903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe900c5200 0x7fbe90063570 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.305+0000 7fbe94c00700 1 -- 172.21.15.49:0/4094720903 >> 172.21.15.49:0/4094720903 conn(0x7fbe90064080 msgr2=0x7fbe90064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.305+0000 7fbe94c00700 1 -- 172.21.15.49:0/4094720903 shutdown_connections 2024-01-22T05:21:01.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.305+0000 7fbe94c00700 1 -- 172.21.15.49:0/4094720903 wait complete. 2024-01-22T05:21:01.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.309+0000 7fbe94c00700 1 Processor -- start 2024-01-22T05:21:01.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.309+0000 7fbe94c00700 1 -- start start 2024-01-22T05:21:01.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.309+0000 7fbe94c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe90067d70 0x7fbe90168850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:01.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.309+0000 7fbe94c00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe900c5200 0x7fbe900ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:01.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.309+0000 7fbe94c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe901577d0 0x7fbe901563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:01.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.309+0000 7fbe94c00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90165810 con 0x7fbe90067d70 2024-01-22T05:21:01.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.309+0000 7fbe94c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90164c00 con 0x7fbe901577d0 2024-01-22T05:21:01.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.309+0000 7fbe94c00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90164ee0 con 0x7fbe900c5200 2024-01-22T05:21:01.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe8de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe90067d70 0x7fbe90168850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:01.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe8de00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe90067d70 0x7fbe90168850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41268/0 (socket says 172.21.15.49:41268) 2024-01-22T05:21:01.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe8de00700 1 -- 172.21.15.49:0/258486699 learned_addr learned my addr 172.21.15.49:0/258486699 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:01.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe8d400700 1 --2- 172.21.15.49:0/258486699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe900c5200 0x7fbe900ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:01.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe8f200700 1 --2- 172.21.15.49:0/258486699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe901577d0 0x7fbe901563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:01.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe8de00700 1 -- 172.21.15.49:0/258486699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe900c5200 msgr2=0x7fbe900ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:01.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe8de00700 1 --2- 172.21.15.49:0/258486699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe900c5200 0x7fbe900ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe8de00700 1 -- 172.21.15.49:0/258486699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe901577d0 msgr2=0x7fbe901563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:01.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe8de00700 1 --2- 172.21.15.49:0/258486699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe901577d0 0x7fbe901563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe8de00700 1 -- 172.21.15.49:0/258486699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe78009370 con 0x7fbe90067d70 2024-01-22T05:21:01.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe8de00700 1 --2- 172.21.15.49:0/258486699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe90067d70 0x7fbe90168850 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 rx=0x7fbe80001eb0 tx=0x7fbe80007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:01.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe85600700 1 -- 172.21.15.49:0/258486699 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe800070d0 con 0x7fbe90067d70 2024-01-22T05:21:01.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe85600700 1 -- 172.21.15.49:0/258486699 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe80007230 con 0x7fbe90067d70 2024-01-22T05:21:01.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe85600700 1 -- 172.21.15.49:0/258486699 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe800075b0 con 0x7fbe90067d70 2024-01-22T05:21:01.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe94c00700 1 -- 172.21.15.49:0/258486699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe901651c0 con 0x7fbe90067d70 2024-01-22T05:21:01.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe94c00700 1 -- 172.21.15.49:0/258486699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe90168d40 con 0x7fbe90067d70 2024-01-22T05:21:01.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.313+0000 7fbe94c00700 1 -- 172.21.15.49:0/258486699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe90047060 con 0x7fbe90067d70 2024-01-22T05:21:01.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.317+0000 7fbe85600700 1 -- 172.21.15.49:0/258486699 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbe800058f0 con 0x7fbe90067d70 2024-01-22T05:21:01.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.317+0000 7fbe85600700 1 --2- 172.21.15.49:0/258486699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe6805a540 0x7fbe6805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:01.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.317+0000 7fbe85600700 1 -- 172.21.15.49:0/258486699 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7fbe80074110 con 0x7fbe90067d70 2024-01-22T05:21:01.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.317+0000 7fbe8d400700 1 --2- 172.21.15.49:0/258486699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe6805a540 0x7fbe6805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:01.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.321+0000 7fbe8d400700 1 --2- 172.21.15.49:0/258486699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe6805a540 0x7fbe6805ca00 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fbe78009130 tx=0x7fbe78017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:01.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.325+0000 7fbe85600700 1 -- 172.21.15.49:0/258486699 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbe80047590 con 0x7fbe90067d70 2024-01-22T05:21:01.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.489+0000 7fbe94c00700 1 -- 172.21.15.49:0/258486699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe900c4d70 con 0x7fbe90067d70 2024-01-22T05:21:01.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.489+0000 7fbe85600700 1 -- 172.21.15.49:0/258486699 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v200) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe8004abb0 con 0x7fbe90067d70 2024-01-22T05:21:01.494 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-22T05:21:01.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.493+0000 7fbe94c00700 1 -- 172.21.15.49:0/258486699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe6805a540 msgr2=0x7fbe6805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:01.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.493+0000 7fbe94c00700 1 --2- 172.21.15.49:0/258486699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe6805a540 0x7fbe6805ca00 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fbe78009130 tx=0x7fbe78017000).stop 2024-01-22T05:21:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.493+0000 7fbe94c00700 1 -- 172.21.15.49:0/258486699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe90067d70 msgr2=0x7fbe90168850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:01.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.493+0000 7fbe94c00700 1 --2- 172.21.15.49:0/258486699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe90067d70 0x7fbe90168850 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 rx=0x7fbe80001eb0 tx=0x7fbe80007df0).stop 2024-01-22T05:21:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.493+0000 7fbe94c00700 1 -- 172.21.15.49:0/258486699 shutdown_connections 2024-01-22T05:21:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.493+0000 7fbe94c00700 1 --2- 172.21.15.49:0/258486699 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fbe6805a540 0x7fbe6805ca00 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.493+0000 7fbe94c00700 1 --2- 172.21.15.49:0/258486699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe901577d0 0x7fbe901563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.493+0000 7fbe94c00700 1 --2- 172.21.15.49:0/258486699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe900c5200 0x7fbe900ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.493+0000 7fbe94c00700 1 --2- 172.21.15.49:0/258486699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe90067d70 0x7fbe90168850 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.493+0000 7fbe94c00700 1 -- 172.21.15.49:0/258486699 >> 172.21.15.49:0/258486699 conn(0x7fbe90064080 msgr2=0x7fbe90153010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.493+0000 7fbe94c00700 1 -- 172.21.15.49:0/258486699 shutdown_connections 2024-01-22T05:21:01.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.493+0000 7fbe94c00700 1 -- 172.21.15.49:0/258486699 wait complete. 2024-01-22T05:21:01.524 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:21:01.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.677+0000 7f45e0800700 1 Processor -- start 2024-01-22T05:21:01.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.681+0000 7f45e0800700 1 -- start start 2024-01-22T05:21:01.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45e0800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d80abd20 0x7f45d8065c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:01.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45e0800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d8068a60 con 0x7f45d80bcfa0 2024-01-22T05:21:01.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45e0800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d80bd380 con 0x7f45d80ab890 2024-01-22T05:21:01.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45e0800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80bb790 con 0x7f45d80abd20 2024-01-22T05:21:01.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dde00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f45d80bcfa0 0x7f45d8151700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53324/0 (socket says 172.21.15.49:53324) 2024-01-22T05:21:01.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dde00700 1 -- 172.21.15.49:0/271191671 learned_addr learned my addr 172.21.15.49:0/271191671 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:01.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45de800700 1 --2- 172.21.15.49:0/271191671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d80abd20 0x7f45d8065c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:01.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dca00700 1 -- 172.21.15.49:0/271191671 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390619585 0 0) 0x7f45d8068a60 con 0x7f45d80bcfa0 2024-01-22T05:21:01.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dca00700 1 -- 172.21.15.49:0/271191671 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b80033f0 con 0x7f45d80bcfa0 2024-01-22T05:21:01.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dca00700 1 -- 172.21.15.49:0/271191671 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1967622100 0 0) 0x7f45b80033f0 con 0x7f45d80bcfa0 2024-01-22T05:21:01.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dca00700 1 -- 172.21.15.49:0/271191671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d80abd20 msgr2=0x7f45d8065c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:01.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dca00700 1 --2- 172.21.15.49:0/271191671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d80abd20 0x7f45d8065c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dca00700 1 -- 172.21.15.49:0/271191671 >> v1:172.21.15.110:6789/0 conn(0x7f45d80ab890 legacy=0x7f45d8065550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:01.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dca00700 1 -- 172.21.15.49:0/271191671 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d8068460 con 0x7f45d80bcfa0 2024-01-22T05:21:01.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dca00700 1 -- 172.21.15.49:0/271191671 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f45c8001470 con 0x7f45d80bcfa0 2024-01-22T05:21:01.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dca00700 1 -- 172.21.15.49:0/271191671 >> v1:172.21.15.49:6789/0 conn(0x7f45d80bcfa0 legacy=0x7f45d8151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:01.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dca00700 1 --2- 172.21.15.49:0/271191671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d80abd20 0x7f45b8003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:01.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dca00700 1 --2- 172.21.15.49:0/271191671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45b8003e20 0x7f45b8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:01.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dca00700 1 --2- 172.21.15.49:0/271191671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45b8004b80 0x7f45b8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:01.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dca00700 1 -- 172.21.15.49:0/271191671 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80bb790 con 0x7f45b8003e20 2024-01-22T05:21:01.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dca00700 1 -- 172.21.15.49:0/271191671 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b800b910 con 0x7f45b8004b80 2024-01-22T05:21:01.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.685+0000 7f45dca00700 1 -- 172.21.15.49:0/271191671 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b800bad0 con 0x7f45d80abd20 2024-01-22T05:21:01.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45dd400700 1 --2- 172.21.15.49:0/271191671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45b8003e20 0x7f45b8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:01.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45dde00700 1 --2- 172.21.15.49:0/271191671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d80abd20 0x7f45b8003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:01.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45de800700 1 --2- 172.21.15.49:0/271191671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45b8004b80 0x7f45b8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:01.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45dd400700 1 -- 172.21.15.49:0/271191671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d80abd20 msgr2=0x7f45b8003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:01.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45dd400700 1 --2- 172.21.15.49:0/271191671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d80abd20 0x7f45b8003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45dd400700 1 -- 172.21.15.49:0/271191671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45b8004b80 msgr2=0x7f45b8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:01.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45dd400700 1 --2- 172.21.15.49:0/271191671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45b8004b80 0x7f45b8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45dd400700 1 -- 172.21.15.49:0/271191671 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b80033f0 con 0x7f45b8003e20 2024-01-22T05:21:01.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45dd400700 1 --2- 172.21.15.49:0/271191671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45b8003e20 0x7f45b8004690 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 rx=0x7f45c0001820 tx=0x7f45c0007b90).ready entity=mon.0 client_cookie=76827a930672694c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:01.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45dca00700 1 -- 172.21.15.49:0/271191671 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0007ea0 con 0x7f45b8003e20 2024-01-22T05:21:01.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45dca00700 1 -- 172.21.15.49:0/271191671 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c0012400 con 0x7f45b8003e20 2024-01-22T05:21:01.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45dca00700 1 -- 172.21.15.49:0/271191671 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c00127a0 con 0x7f45b8003e20 2024-01-22T05:21:01.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45e0800700 1 -- 172.21.15.49:0/271191671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45b8003e20 msgr2=0x7f45b8004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:01.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45e0800700 1 --2- 172.21.15.49:0/271191671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45b8003e20 0x7f45b8004690 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 rx=0x7f45c0001820 tx=0x7f45c0007b90).stop 2024-01-22T05:21:01.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45de800700 1 -- 172.21.15.49:0/271191671 reap_dead start 2024-01-22T05:21:01.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45e0800700 1 -- 172.21.15.49:0/271191671 shutdown_connections 2024-01-22T05:21:01.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45e0800700 1 -- 172.21.15.49:0/271191671 >> 172.21.15.49:0/271191671 conn(0x7f45d80c6540 msgr2=0x7f45d80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:01.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45e0800700 1 -- 172.21.15.49:0/271191671 shutdown_connections 2024-01-22T05:21:01.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.689+0000 7f45e0800700 1 -- 172.21.15.49:0/271191671 wait complete. 2024-01-22T05:21:01.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.693+0000 7f45e0800700 1 Processor -- start 2024-01-22T05:21:01.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.693+0000 7f45e0800700 1 -- start start 2024-01-22T05:21:01.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.693+0000 7f45e0800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45b8003e20 0x7f45d8140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:01.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.693+0000 7f45e0800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d81412c0 0x7f45d80a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:01.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.693+0000 7f45e0800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d80a53a0 0x7f45d80a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:01.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.693+0000 7f45e0800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d8156f70 con 0x7f45d80a53a0 2024-01-22T05:21:01.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.693+0000 7f45e0800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80a5820 con 0x7f45b8003e20 2024-01-22T05:21:01.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.693+0000 7f45e0800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80a7c60 con 0x7f45d81412c0 2024-01-22T05:21:01.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.693+0000 7f45de800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d80a53a0 0x7f45d80a6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:01.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45de800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d80a53a0 0x7f45d80a6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41274/0 (socket says 172.21.15.49:41274) 2024-01-22T05:21:01.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45de800700 1 -- 172.21.15.49:0/353342322 learned_addr learned my addr 172.21.15.49:0/353342322 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:01.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45dd400700 1 --2- 172.21.15.49:0/353342322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d81412c0 0x7f45d80a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:01.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45dde00700 1 --2- 172.21.15.49:0/353342322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45b8003e20 0x7f45d8140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:01.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45de800700 1 -- 172.21.15.49:0/353342322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d81412c0 msgr2=0x7f45d80a4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:01.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45de800700 1 --2- 172.21.15.49:0/353342322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d81412c0 0x7f45d80a4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45de800700 1 -- 172.21.15.49:0/353342322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45b8003e20 msgr2=0x7f45d8140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:01.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45de800700 1 --2- 172.21.15.49:0/353342322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45b8003e20 0x7f45d8140dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45de800700 1 -- 172.21.15.49:0/353342322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d80a7f40 con 0x7f45d80a53a0 2024-01-22T05:21:01.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45de800700 1 --2- 172.21.15.49:0/353342322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d80a53a0 0x7f45d80a6ea0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 rx=0x7f45d8069200 tx=0x7f45d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:01.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45d5600700 1 -- 172.21.15.49:0/353342322 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d000e070 con 0x7f45d80a53a0 2024-01-22T05:21:01.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45d5600700 1 -- 172.21.15.49:0/353342322 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d0011b80 con 0x7f45d80a53a0 2024-01-22T05:21:01.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45e0800700 1 -- 172.21.15.49:0/353342322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d80a8220 con 0x7f45d80a53a0 2024-01-22T05:21:01.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45d5600700 1 -- 172.21.15.49:0/353342322 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0016450 con 0x7f45d80a53a0 2024-01-22T05:21:01.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45e0800700 1 -- 172.21.15.49:0/353342322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d80a7390 con 0x7f45d80a53a0 2024-01-22T05:21:01.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.697+0000 7f45e0800700 1 -- 172.21.15.49:0/353342322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d8157120 con 0x7f45d80a53a0 2024-01-22T05:21:01.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.701+0000 7f45d5600700 1 -- 172.21.15.49:0/353342322 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f45d0016840 con 0x7f45d80a53a0 2024-01-22T05:21:01.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.701+0000 7f45d5600700 1 --2- 172.21.15.49:0/353342322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45b005a540 0x7f45b005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:01.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.701+0000 7f45d5600700 1 -- 172.21.15.49:0/353342322 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7f45d0074f60 con 0x7f45d80a53a0 2024-01-22T05:21:01.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.701+0000 7f45dde00700 1 --2- 172.21.15.49:0/353342322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45b005a540 0x7f45b005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:01.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.705+0000 7f45dde00700 1 --2- 172.21.15.49:0/353342322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45b005a540 0x7f45b005ca00 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f45c8001200 tx=0x7f45c8001e70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:01.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.709+0000 7f45d5600700 1 -- 172.21.15.49:0/353342322 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f45d8157120 con 0x7f45d80a53a0 2024-01-22T05:21:01.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.905+0000 7f45e0800700 1 -- 172.21.15.49:0/353342322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45d8157120 con 0x7f45d80a53a0 2024-01-22T05:21:01.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.905+0000 7f45d5600700 1 -- 172.21.15.49:0/353342322 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) v1 ==== 95+0+4513 (secure 0 0 0) 0x7f45d8157120 con 0x7f45d80a53a0 2024-01-22T05:21:01.910 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:21:01.910 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":157,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1805560931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1805560931},{"type":"v1","addr":"172.21.15.110:6833","nonce":1805560931}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3941922826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3941922826},{"type":"v1","addr":"172.21.15.110:6835","nonce":3941922826}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2796452202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2796452202},{"type":"v1","addr":"172.21.15.49:6836","nonce":2796452202}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:39.299248+0000","modified":"2024-01-22T05:19:54.461466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":198,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10656":{"gid":10656,"name":"a","rank":0,"incarnation":154,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/1689534801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1689534801},{"type":"v1","addr":"172.21.15.49:6837","nonce":1689534801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2024-01-22T05:21:01.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.909+0000 7f45e0800700 1 -- 172.21.15.49:0/353342322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45b005a540 msgr2=0x7f45b005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:01.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.909+0000 7f45e0800700 1 --2- 172.21.15.49:0/353342322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45b005a540 0x7f45b005ca00 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f45c8001200 tx=0x7f45c8001e70).stop 2024-01-22T05:21:01.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.909+0000 7f45e0800700 1 -- 172.21.15.49:0/353342322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d80a53a0 msgr2=0x7f45d80a6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:01.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.909+0000 7f45e0800700 1 --2- 172.21.15.49:0/353342322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d80a53a0 0x7f45d80a6ea0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 rx=0x7f45d8069200 tx=0x7f45d000b040).stop 2024-01-22T05:21:01.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.913+0000 7f45e0800700 1 -- 172.21.15.49:0/353342322 shutdown_connections 2024-01-22T05:21:01.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.913+0000 7f45e0800700 1 --2- 172.21.15.49:0/353342322 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f45b005a540 0x7f45b005ca00 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.913+0000 7f45e0800700 1 --2- 172.21.15.49:0/353342322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d80a53a0 0x7f45d80a6ea0 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.913+0000 7f45e0800700 1 --2- 172.21.15.49:0/353342322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45d81412c0 0x7f45d80a4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.913+0000 7f45e0800700 1 --2- 172.21.15.49:0/353342322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45b8003e20 0x7f45d8140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:01.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.913+0000 7f45e0800700 1 -- 172.21.15.49:0/353342322 >> 172.21.15.49:0/353342322 conn(0x7f45d80c6540 msgr2=0x7f45d80aa090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:01.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.913+0000 7f45e0800700 1 -- 172.21.15.49:0/353342322 shutdown_connections 2024-01-22T05:21:01.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:01.913+0000 7f45e0800700 1 -- 172.21.15.49:0/353342322 wait complete. 2024-01-22T05:21:01.919 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 157 2024-01-22T05:21:01.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:21:02.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.097+0000 7f2f45400700 1 Processor -- start 2024-01-22T05:21:02.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.101+0000 7f2f45400700 1 -- start start 2024-01-22T05:21:02.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.101+0000 7f2f45400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f400ab890 0x7f2f400abd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.101+0000 7f2f45400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f40068a60 con 0x7f2f40065550 2024-01-22T05:21:02.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.101+0000 7f2f45400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f400bd380 con 0x7f2f400bcfa0 2024-01-22T05:21:02.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.101+0000 7f2f45400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f400bb790 con 0x7f2f400ab890 2024-01-22T05:21:02.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.101+0000 7f2f3de00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f400ab890 0x7f2f400abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.101+0000 7f2f3f200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2f40065550 0x7f2f40065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53330/0 (socket says 172.21.15.49:53330) 2024-01-22T05:21:02.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.101+0000 7f2f3f200700 1 -- 172.21.15.49:0/2890657110 learned_addr learned my addr 172.21.15.49:0/2890657110 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:02.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.101+0000 7f2f3e800700 1 --1- 172.21.15.49:0/2890657110 >> v1:172.21.15.110:6789/0 conn(0x7f2f400bcfa0 0x7f2f40151700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:43726/0 (socket says 172.21.15.49:43726) 2024-01-22T05:21:02.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.101+0000 7f2f3de00700 1 -- 172.21.15.49:0/2890657110 >> v1:172.21.15.110:6789/0 conn(0x7f2f400bcfa0 legacy=0x7f2f40151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.101+0000 7f2f3d400700 1 -- 172.21.15.49:0/2890657110 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682186433 0 0) 0x7f2f400bd380 con 0x7f2f400bcfa0 2024-01-22T05:21:02.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.101+0000 7f2f3de00700 1 -- 172.21.15.49:0/2890657110 >> v1:172.21.15.49:6789/0 conn(0x7f2f40065550 legacy=0x7f2f40065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.105+0000 7f2f3de00700 1 -- 172.21.15.49:0/2890657110 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f400ac210 con 0x7f2f400ab890 2024-01-22T05:21:02.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.105+0000 7f2f3de00700 1 --2- 172.21.15.49:0/2890657110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f400ab890 0x7f2f400abd20 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 rx=0x7f2f400bb8d0 tx=0x7f2f28009060).ready entity=mon.0 client_cookie=30113326b226313b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:02.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.105+0000 7f2f3d400700 1 -- 172.21.15.49:0/2890657110 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f280090d0 con 0x7f2f400ab890 2024-01-22T05:21:02.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.105+0000 7f2f3d400700 1 -- 172.21.15.49:0/2890657110 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2800f510 con 0x7f2f400ab890 2024-01-22T05:21:02.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.105+0000 7f2f3d400700 1 -- 172.21.15.49:0/2890657110 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2800f890 con 0x7f2f400ab890 2024-01-22T05:21:02.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.105+0000 7f2f45400700 1 -- 172.21.15.49:0/2890657110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f400ab890 msgr2=0x7f2f400abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.105+0000 7f2f45400700 1 --2- 172.21.15.49:0/2890657110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f400ab890 0x7f2f400abd20 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 rx=0x7f2f400bb8d0 tx=0x7f2f28009060).stop 2024-01-22T05:21:02.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.105+0000 7f2f45400700 1 -- 172.21.15.49:0/2890657110 shutdown_connections 2024-01-22T05:21:02.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.105+0000 7f2f45400700 1 --2- 172.21.15.49:0/2890657110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f400ab890 0x7f2f400abd20 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.105+0000 7f2f45400700 1 -- 172.21.15.49:0/2890657110 >> 172.21.15.49:0/2890657110 conn(0x7f2f400c6540 msgr2=0x7f2f400c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:02.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.105+0000 7f2f45400700 1 -- 172.21.15.49:0/2890657110 shutdown_connections 2024-01-22T05:21:02.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.105+0000 7f2f45400700 1 -- 172.21.15.49:0/2890657110 wait complete. 2024-01-22T05:21:02.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.109+0000 7f2f45400700 1 Processor -- start 2024-01-22T05:21:02.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.109+0000 7f2f45400700 1 -- start start 2024-01-22T05:21:02.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f45400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f40065550 0x7f2f40168bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f45400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f400ab890 0x7f2f400c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f45400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f400bcfa0 0x7f2f40169660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f45400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f400c22b0 con 0x7f2f400bcfa0 2024-01-22T05:21:02.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f45400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f400c30d0 con 0x7f2f400ab890 2024-01-22T05:21:02.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f45400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f40169b50 con 0x7f2f40065550 2024-01-22T05:21:02.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f3f200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f400bcfa0 0x7f2f40169660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f3f200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f400bcfa0 0x7f2f40169660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41288/0 (socket says 172.21.15.49:41288) 2024-01-22T05:21:02.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f3f200700 1 -- 172.21.15.49:0/2018860861 learned_addr learned my addr 172.21.15.49:0/2018860861 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:02.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f3e800700 1 --2- 172.21.15.49:0/2018860861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f40065550 0x7f2f40168bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f3de00700 1 --2- 172.21.15.49:0/2018860861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f400ab890 0x7f2f400c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f3f200700 1 -- 172.21.15.49:0/2018860861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f40065550 msgr2=0x7f2f40168bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f3f200700 1 --2- 172.21.15.49:0/2018860861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f40065550 0x7f2f40168bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f3f200700 1 -- 172.21.15.49:0/2018860861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f400ab890 msgr2=0x7f2f400c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f3f200700 1 --2- 172.21.15.49:0/2018860861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f400ab890 0x7f2f400c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f3f200700 1 -- 172.21.15.49:0/2018860861 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f280092a0 con 0x7f2f400bcfa0 2024-01-22T05:21:02.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f3f200700 1 --2- 172.21.15.49:0/2018860861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f400bcfa0 0x7f2f40169660 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 rx=0x7f2f3800c960 tx=0x7f2f380016f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:02.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f36000700 1 -- 172.21.15.49:0/2018860861 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38005d30 con 0x7f2f400bcfa0 2024-01-22T05:21:02.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f36000700 1 -- 172.21.15.49:0/2018860861 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f38005e90 con 0x7f2f400bcfa0 2024-01-22T05:21:02.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f45400700 1 -- 172.21.15.49:0/2018860861 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f40152f20 con 0x7f2f400bcfa0 2024-01-22T05:21:02.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.113+0000 7f2f36000700 1 -- 172.21.15.49:0/2018860861 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38007320 con 0x7f2f400bcfa0 2024-01-22T05:21:02.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.117+0000 7f2f45400700 1 -- 172.21.15.49:0/2018860861 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f400c27a0 con 0x7f2f400bcfa0 2024-01-22T05:21:02.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.117+0000 7f2f45400700 1 -- 172.21.15.49:0/2018860861 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f400c3240 con 0x7f2f400bcfa0 2024-01-22T05:21:02.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.117+0000 7f2f36000700 1 -- 172.21.15.49:0/2018860861 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2f38007710 con 0x7f2f400bcfa0 2024-01-22T05:21:02.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.121+0000 7f2f36000700 1 --2- 172.21.15.49:0/2018860861 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f1805a510 0x7f2f1805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.121+0000 7f2f36000700 1 -- 172.21.15.49:0/2018860861 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7f2f38074cc0 con 0x7f2f400bcfa0 2024-01-22T05:21:02.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.121+0000 7f2f3e800700 1 --2- 172.21.15.49:0/2018860861 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f1805a510 0x7f2f1805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.121+0000 7f2f3e800700 1 --2- 172.21.15.49:0/2018860861 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f1805a510 0x7f2f1805c9d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f2f4014cea0 tx=0x7f2f30007c30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:02.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.125+0000 7f2f36000700 1 -- 172.21.15.49:0/2018860861 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2f3807b080 con 0x7f2f400bcfa0 2024-01-22T05:21:02.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.293+0000 7f2f45400700 1 -- 172.21.15.49:0/2018860861 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f40047060 con 0x7f2f400bcfa0 2024-01-22T05:21:02.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.293+0000 7f2f36000700 1 -- 172.21.15.49:0/2018860861 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) v1 ==== 74+0+17691 (secure 0 0 0) 0x7f2f38048140 con 0x7f2f400bcfa0 2024-01-22T05:21:02.298 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:21:02.298 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":200,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:20:29.484295+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:19:37.238555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-01-22T05:19:38.297767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"28.0","mappings":[{"from":6,"to":4}]},{"pgid":"28.8","mappings":[{"from":6,"to":1}]},{"pgid":"28.1d","mappings":[{"from":6,"to":4}]},{"pgid":"29.10","mappings":[{"from":6,"to":0}]},{"pgid":"29.14","mappings":[{"from":6,"to":0}]},{"pgid":"29.19","mappings":[{"from":6,"to":0}]},{"pgid":"29.23","mappings":[{"from":6,"to":0}]},{"pgid":"29.39","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6837/1585471135":"2024-01-23T05:19:48.627681+0000","172.21.15.49:6835/1585471135":"2024-01-23T05:19:48.627681+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:21:02.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.297+0000 7f2f45400700 1 -- 172.21.15.49:0/2018860861 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f1805a510 msgr2=0x7f2f1805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.297+0000 7f2f45400700 1 --2- 172.21.15.49:0/2018860861 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f1805a510 0x7f2f1805c9d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f2f4014cea0 tx=0x7f2f30007c30).stop 2024-01-22T05:21:02.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.297+0000 7f2f45400700 1 -- 172.21.15.49:0/2018860861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f400bcfa0 msgr2=0x7f2f40169660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.297+0000 7f2f45400700 1 --2- 172.21.15.49:0/2018860861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f400bcfa0 0x7f2f40169660 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 rx=0x7f2f3800c960 tx=0x7f2f380016f0).stop 2024-01-22T05:21:02.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.297+0000 7f2f45400700 1 -- 172.21.15.49:0/2018860861 shutdown_connections 2024-01-22T05:21:02.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.297+0000 7f2f45400700 1 --2- 172.21.15.49:0/2018860861 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f2f1805a510 0x7f2f1805c9d0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.297+0000 7f2f45400700 1 --2- 172.21.15.49:0/2018860861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f400bcfa0 0x7f2f40169660 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.297+0000 7f2f45400700 1 --2- 172.21.15.49:0/2018860861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f400ab890 0x7f2f400c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.297+0000 7f2f45400700 1 --2- 172.21.15.49:0/2018860861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f40065550 0x7f2f40168bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.297+0000 7f2f45400700 1 -- 172.21.15.49:0/2018860861 >> 172.21.15.49:0/2018860861 conn(0x7f2f400c6540 msgr2=0x7f2f4014d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:02.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.297+0000 7f2f45400700 1 -- 172.21.15.49:0/2018860861 shutdown_connections 2024-01-22T05:21:02.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.297+0000 7f2f45400700 1 -- 172.21.15.49:0/2018860861 wait complete. 2024-01-22T05:21:02.324 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:21:02.324 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:21:02.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.477+0000 7f7f97800700 1 Processor -- start 2024-01-22T05:21:02.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.477+0000 7f7f97800700 1 -- start start 2024-01-22T05:21:02.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.481+0000 7f7f97800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f90065620 0x7f7f900bd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.481+0000 7f7f97800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f900c2700 con 0x7f7f90065240 2024-01-22T05:21:02.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.481+0000 7f7f97800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f900c29a0 con 0x7f7f90064c00 2024-01-22T05:21:02.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.481+0000 7f7f97800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f900c2c80 con 0x7f7f90065620 2024-01-22T05:21:02.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.481+0000 7f7f94e00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7f90065240 0x7f7f900644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53338/0 (socket says 172.21.15.49:53338) 2024-01-22T05:21:02.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.481+0000 7f7f94e00700 1 -- 172.21.15.49:0/2753905271 learned_addr learned my addr 172.21.15.49:0/2753905271 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:02.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.481+0000 7f7f96200700 1 --2- 172.21.15.49:0/2753905271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f90065620 0x7f7f900bd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.481+0000 7f7f8f400700 1 -- 172.21.15.49:0/2753905271 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190106472 0 0) 0x7f7f900c2700 con 0x7f7f90065240 2024-01-22T05:21:02.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.481+0000 7f7f8f400700 1 -- 172.21.15.49:0/2753905271 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f700033f0 con 0x7f7f90065240 2024-01-22T05:21:02.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.481+0000 7f7f8f400700 1 -- 172.21.15.49:0/2753905271 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2423472863 0 0) 0x7f7f700033f0 con 0x7f7f90065240 2024-01-22T05:21:02.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.481+0000 7f7f96200700 1 -- 172.21.15.49:0/2753905271 >> v1:172.21.15.110:6789/0 conn(0x7f7f90064c00 legacy=0x7f7f900bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.481+0000 7f7f96200700 1 -- 172.21.15.49:0/2753905271 >> v1:172.21.15.49:6789/0 conn(0x7f7f90065240 legacy=0x7f7f900644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.481+0000 7f7f96200700 1 -- 172.21.15.49:0/2753905271 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f900c2f60 con 0x7f7f90065620 2024-01-22T05:21:02.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.485+0000 7f7f96200700 1 --2- 172.21.15.49:0/2753905271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f90065620 0x7f7f900bd390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f7f88009e90 tx=0x7f7f88009780).ready entity=mon.2 client_cookie=f124b6a07e14b562 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:02.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.485+0000 7f7f8f400700 1 -- 172.21.15.49:0/2753905271 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8800e070 con 0x7f7f90065620 2024-01-22T05:21:02.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.485+0000 7f7f8f400700 1 -- 172.21.15.49:0/2753905271 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8800b850 con 0x7f7f90065620 2024-01-22T05:21:02.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.485+0000 7f7f8f400700 1 -- 172.21.15.49:0/2753905271 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80001490 con 0x7f7f90065620 2024-01-22T05:21:02.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.485+0000 7f7f97800700 1 -- 172.21.15.49:0/2753905271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f90065620 msgr2=0x7f7f900bd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.485+0000 7f7f97800700 1 --2- 172.21.15.49:0/2753905271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f90065620 0x7f7f900bd390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f7f88009e90 tx=0x7f7f88009780).stop 2024-01-22T05:21:02.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.485+0000 7f7f97800700 1 -- 172.21.15.49:0/2753905271 shutdown_connections 2024-01-22T05:21:02.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.485+0000 7f7f97800700 1 --2- 172.21.15.49:0/2753905271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f90065620 0x7f7f900bd390 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.485+0000 7f7f97800700 1 -- 172.21.15.49:0/2753905271 >> 172.21.15.49:0/2753905271 conn(0x7f7f900c87f0 msgr2=0x7f7f900c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:02.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.485+0000 7f7f97800700 1 -- 172.21.15.49:0/2753905271 shutdown_connections 2024-01-22T05:21:02.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.485+0000 7f7f97800700 1 -- 172.21.15.49:0/2753905271 wait complete. 2024-01-22T05:21:02.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.489+0000 7f7f97800700 1 Processor -- start 2024-01-22T05:21:02.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.489+0000 7f7f97800700 1 -- start start 2024-01-22T05:21:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f97800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f90064c00 0x7f7f9013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f97800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f90065240 0x7f7f9016b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f97800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f90065620 0x7f7f9016b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f97800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9016be90 con 0x7f7f90065240 2024-01-22T05:21:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f97800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9016c090 con 0x7f7f90065620 2024-01-22T05:21:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f97800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90169140 con 0x7f7f90064c00 2024-01-22T05:21:02.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f8fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f90065240 0x7f7f9016b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f8fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f90065240 0x7f7f9016b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41290/0 (socket says 172.21.15.49:41290) 2024-01-22T05:21:02.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f8fe00700 1 -- 172.21.15.49:0/3363247173 learned_addr learned my addr 172.21.15.49:0/3363247173 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f94e00700 1 --2- 172.21.15.49:0/3363247173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f90064c00 0x7f7f9013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f96200700 1 --2- 172.21.15.49:0/3363247173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f90065620 0x7f7f9016b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f8fe00700 1 -- 172.21.15.49:0/3363247173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f90064c00 msgr2=0x7f7f9013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f8fe00700 1 --2- 172.21.15.49:0/3363247173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f90064c00 0x7f7f9013fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f8fe00700 1 -- 172.21.15.49:0/3363247173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f90065620 msgr2=0x7f7f9016b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f8fe00700 1 --2- 172.21.15.49:0/3363247173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f90065620 0x7f7f9016b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f8fe00700 1 -- 172.21.15.49:0/3363247173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f88009a20 con 0x7f7f90065240 2024-01-22T05:21:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f94e00700 1 --2- 172.21.15.49:0/3363247173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f90064c00 0x7f7f9013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:21:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f8fe00700 1 --2- 172.21.15.49:0/3363247173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f90065240 0x7f7f9016b4b0 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 rx=0x7f7f7800c4c0 tx=0x7f7f78007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f87e00700 1 -- 172.21.15.49:0/3363247173 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7800ce70 con 0x7f7f90065240 2024-01-22T05:21:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f87e00700 1 -- 172.21.15.49:0/3363247173 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f78001e90 con 0x7f7f90065240 2024-01-22T05:21:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f87e00700 1 -- 172.21.15.49:0/3363247173 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78007250 con 0x7f7f90065240 2024-01-22T05:21:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f97800700 1 -- 172.21.15.49:0/3363247173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f90169420 con 0x7f7f90065240 2024-01-22T05:21:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.493+0000 7f7f97800700 1 -- 172.21.15.49:0/3363247173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f90140210 con 0x7f7f90065240 2024-01-22T05:21:02.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.497+0000 7f7f97800700 1 -- 172.21.15.49:0/3363247173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f900aae30 con 0x7f7f90065240 2024-01-22T05:21:02.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.497+0000 7f7f87e00700 1 -- 172.21.15.49:0/3363247173 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7f780066a0 con 0x7f7f90065240 2024-01-22T05:21:02.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.497+0000 7f7f87e00700 1 --2- 172.21.15.49:0/3363247173 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f6805a510 0x7f7f6805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.497+0000 7f7f87e00700 1 -- 172.21.15.49:0/3363247173 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7f7f780742e0 con 0x7f7f90065240 2024-01-22T05:21:02.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.497+0000 7f7f94e00700 1 --2- 172.21.15.49:0/3363247173 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f6805a510 0x7f7f6805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.501+0000 7f7f94e00700 1 --2- 172.21.15.49:0/3363247173 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f6805a510 0x7f7f6805c9d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f7f80001200 tx=0x7f7f80000bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:02.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.505+0000 7f7f87e00700 1 -- 172.21.15.49:0/3363247173 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7f900aae30 con 0x7f7f90065240 2024-01-22T05:21:02.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.709+0000 7f7f97800700 1 -- 172.21.15.49:0/3363247173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f900aae30 con 0x7f7f90065240 2024-01-22T05:21:02.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.709+0000 7f7f87e00700 1 -- 172.21.15.49:0/3363247173 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) v1 ==== 95+0+4513 (secure 0 0 0) 0x7f7f900aae30 con 0x7f7f90065240 2024-01-22T05:21:02.714 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:21:02.714 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":157,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1805560931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1805560931},{"type":"v1","addr":"172.21.15.110:6833","nonce":1805560931}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3941922826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3941922826},{"type":"v1","addr":"172.21.15.110:6835","nonce":3941922826}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2796452202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2796452202},{"type":"v1","addr":"172.21.15.49:6836","nonce":2796452202}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:39.299248+0000","modified":"2024-01-22T05:19:54.461466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":198,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10656":{"gid":10656,"name":"a","rank":0,"incarnation":154,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/1689534801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1689534801},{"type":"v1","addr":"172.21.15.49:6837","nonce":1689534801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2024-01-22T05:21:02.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.713+0000 7f7f97800700 1 -- 172.21.15.49:0/3363247173 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f6805a510 msgr2=0x7f7f6805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.713+0000 7f7f97800700 1 --2- 172.21.15.49:0/3363247173 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f6805a510 0x7f7f6805c9d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f7f80001200 tx=0x7f7f80000bc0).stop 2024-01-22T05:21:02.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.713+0000 7f7f97800700 1 -- 172.21.15.49:0/3363247173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f90065240 msgr2=0x7f7f9016b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.713+0000 7f7f97800700 1 --2- 172.21.15.49:0/3363247173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f90065240 0x7f7f9016b4b0 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 rx=0x7f7f7800c4c0 tx=0x7f7f78007e00).stop 2024-01-22T05:21:02.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.713+0000 7f7f97800700 1 -- 172.21.15.49:0/3363247173 shutdown_connections 2024-01-22T05:21:02.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.713+0000 7f7f97800700 1 --2- 172.21.15.49:0/3363247173 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f7f6805a510 0x7f7f6805c9d0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.713+0000 7f7f97800700 1 --2- 172.21.15.49:0/3363247173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f90065620 0x7f7f9016b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.713+0000 7f7f97800700 1 --2- 172.21.15.49:0/3363247173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f90065240 0x7f7f9016b4b0 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.713+0000 7f7f97800700 1 --2- 172.21.15.49:0/3363247173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f90064c00 0x7f7f9013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.713+0000 7f7f97800700 1 -- 172.21.15.49:0/3363247173 >> 172.21.15.49:0/3363247173 conn(0x7f7f900c87f0 msgr2=0x7f7f900c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:02.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.713+0000 7f7f97800700 1 -- 172.21.15.49:0/3363247173 shutdown_connections 2024-01-22T05:21:02.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.713+0000 7f7f97800700 1 -- 172.21.15.49:0/3363247173 wait complete. 2024-01-22T05:21:02.721 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 157 2024-01-22T05:21:02.739 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:21:02.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.901+0000 7f1d99600700 1 Processor -- start 2024-01-22T05:21:02.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.901+0000 7f1d99600700 1 -- start start 2024-01-22T05:21:02.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.901+0000 7f1d99600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1d940a7ad0 0x7f1d940a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.901+0000 7f1d99600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d940688d0 0x7f1d940be6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.901+0000 7f1d99600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d940c72c0 con 0x7f1d94068460 2024-01-22T05:21:02.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.901+0000 7f1d99600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d940bdee0 con 0x7f1d940a7ad0 2024-01-22T05:21:02.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.901+0000 7f1d99600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94059b80 con 0x7f1d940688d0 2024-01-22T05:21:02.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.901+0000 7f1d93e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d940688d0 0x7f1d940be6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.901+0000 7f1d92a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1d940a7ad0 0x7f1d940a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.901+0000 7f1d93e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d940688d0 0x7f1d940be6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:55820/0 (socket says 172.21.15.49:55820) 2024-01-22T05:21:02.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.901+0000 7f1d93e00700 1 -- 172.21.15.49:0/506563349 learned_addr learned my addr 172.21.15.49:0/506563349 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:02.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.901+0000 7f1d92a00700 1 -- 172.21.15.49:0/506563349 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d940688d0 msgr2=0x7f1d940be6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:02.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.901+0000 7f1d92a00700 1 --2- 172.21.15.49:0/506563349 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d940688d0 0x7f1d940be6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.901+0000 7f1d92a00700 1 -- 172.21.15.49:0/506563349 >> v1:172.21.15.110:6789/0 conn(0x7f1d94068460 legacy=0x7f1d94059470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.905+0000 7f1d92a00700 1 -- 172.21.15.49:0/506563349 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d940c66b0 con 0x7f1d940a7ad0 2024-01-22T05:21:02.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.905+0000 7f1d92a00700 1 --2- 172.21.15.49:0/506563349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d940a7ad0 0x7f1d940a5360 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f1d84009790 tx=0x7f1d84009060).ready entity=mon.1 client_cookie=50a29762827a4ee server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:02.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.905+0000 7f1d91600700 1 -- 172.21.15.49:0/506563349 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8400f510 con 0x7f1d940a7ad0 2024-01-22T05:21:02.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.905+0000 7f1d91600700 1 -- 172.21.15.49:0/506563349 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8400f670 con 0x7f1d940a7ad0 2024-01-22T05:21:02.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.905+0000 7f1d91600700 1 -- 172.21.15.49:0/506563349 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8400f9f0 con 0x7f1d940a7ad0 2024-01-22T05:21:02.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.905+0000 7f1d99600700 1 -- 172.21.15.49:0/506563349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d940a7ad0 msgr2=0x7f1d940a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.905+0000 7f1d99600700 1 --2- 172.21.15.49:0/506563349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d940a7ad0 0x7f1d940a5360 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f1d84009790 tx=0x7f1d84009060).stop 2024-01-22T05:21:02.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.905+0000 7f1d99600700 1 -- 172.21.15.49:0/506563349 shutdown_connections 2024-01-22T05:21:02.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.905+0000 7f1d99600700 1 --2- 172.21.15.49:0/506563349 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d940688d0 0x7f1d940be6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.905+0000 7f1d99600700 1 --2- 172.21.15.49:0/506563349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d940a7ad0 0x7f1d940a5360 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.905+0000 7f1d99600700 1 -- 172.21.15.49:0/506563349 >> 172.21.15.49:0/506563349 conn(0x7f1d94062a10 msgr2=0x7f1d94081fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:02.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.905+0000 7f1d99600700 1 -- 172.21.15.49:0/506563349 shutdown_connections 2024-01-22T05:21:02.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.905+0000 7f1d99600700 1 -- 172.21.15.49:0/506563349 wait complete. 2024-01-22T05:21:02.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.909+0000 7f1d99600700 1 Processor -- start 2024-01-22T05:21:02.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.913+0000 7f1d99600700 1 -- start start 2024-01-22T05:21:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.913+0000 7f1d99600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d94068460 0x7f1d9413fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.913+0000 7f1d99600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d940688d0 0x7f1d941404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.913+0000 7f1d99600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d940a7ad0 0x7f1d941409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.913+0000 7f1d99600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940aaee0 con 0x7f1d94068460 2024-01-22T05:21:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.913+0000 7f1d99600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940ac780 con 0x7f1d940a7ad0 2024-01-22T05:21:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.913+0000 7f1d99600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940abb70 con 0x7f1d940688d0 2024-01-22T05:21:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.913+0000 7f1d92a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d94068460 0x7f1d9413fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.913+0000 7f1d92a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d94068460 0x7f1d9413fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41294/0 (socket says 172.21.15.49:41294) 2024-01-22T05:21:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.913+0000 7f1d92a00700 1 -- 172.21.15.49:0/4294340510 learned_addr learned my addr 172.21.15.49:0/4294340510 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:02.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.913+0000 7f1d92000700 1 --2- 172.21.15.49:0/4294340510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d940688d0 0x7f1d941404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.913+0000 7f1d93e00700 1 --2- 172.21.15.49:0/4294340510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d940a7ad0 0x7f1d941409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.917+0000 7f1d92a00700 1 -- 172.21.15.49:0/4294340510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d940688d0 msgr2=0x7f1d941404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.917+0000 7f1d92a00700 1 --2- 172.21.15.49:0/4294340510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d940688d0 0x7f1d941404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.917+0000 7f1d92a00700 1 -- 172.21.15.49:0/4294340510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d940a7ad0 msgr2=0x7f1d941409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:02.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.917+0000 7f1d92a00700 1 --2- 172.21.15.49:0/4294340510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d940a7ad0 0x7f1d941409a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:02.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.917+0000 7f1d92a00700 1 -- 172.21.15.49:0/4294340510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d840092a0 con 0x7f1d94068460 2024-01-22T05:21:02.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.917+0000 7f1d92a00700 1 --2- 172.21.15.49:0/4294340510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d94068460 0x7f1d9413fb90 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 rx=0x7f1d84009e30 tx=0x7f1d84017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:02.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.917+0000 7f1d8a000700 1 -- 172.21.15.49:0/4294340510 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8400f7e0 con 0x7f1d94068460 2024-01-22T05:21:02.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.917+0000 7f1d8a000700 1 -- 172.21.15.49:0/4294340510 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8400f960 con 0x7f1d94068460 2024-01-22T05:21:02.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.917+0000 7f1d99600700 1 -- 172.21.15.49:0/4294340510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d940abe50 con 0x7f1d94068460 2024-01-22T05:21:02.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.917+0000 7f1d8a000700 1 -- 172.21.15.49:0/4294340510 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8401b690 con 0x7f1d94068460 2024-01-22T05:21:02.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.917+0000 7f1d99600700 1 -- 172.21.15.49:0/4294340510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d940ac410 con 0x7f1d94068460 2024-01-22T05:21:02.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.917+0000 7f1d99600700 1 -- 172.21.15.49:0/4294340510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d94047060 con 0x7f1d94068460 2024-01-22T05:21:02.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.921+0000 7f1d8a000700 1 -- 172.21.15.49:0/4294340510 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1d8401ba00 con 0x7f1d94068460 2024-01-22T05:21:02.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.921+0000 7f1d8a000700 1 --2- 172.21.15.49:0/4294340510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d6c05a510 0x7f1d6c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:02.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.921+0000 7f1d8a000700 1 -- 172.21.15.49:0/4294340510 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7f1d84076130 con 0x7f1d94068460 2024-01-22T05:21:02.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.921+0000 7f1d92000700 1 --2- 172.21.15.49:0/4294340510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d6c05a510 0x7f1d6c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:02.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.921+0000 7f1d92000700 1 --2- 172.21.15.49:0/4294340510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d6c05a510 0x7f1d6c05c9d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f1d940bee70 tx=0x7f1d7c007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:02.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:02.929+0000 7f1d8a000700 1 -- 172.21.15.49:0/4294340510 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1d840495b0 con 0x7f1d94068460 2024-01-22T05:21:03.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.129+0000 7f1d99600700 1 -- 172.21.15.49:0/4294340510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d940a7ed0 con 0x7f1d94068460 2024-01-22T05:21:03.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.129+0000 7f1d8a000700 1 -- 172.21.15.49:0/4294340510 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) v1 ==== 95+0+4513 (secure 0 0 0) 0x7f1d8401bcb0 con 0x7f1d94068460 2024-01-22T05:21:03.134 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:21:03.134 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":157,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1805560931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1805560931},{"type":"v1","addr":"172.21.15.110:6833","nonce":1805560931}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3941922826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3941922826},{"type":"v1","addr":"172.21.15.110:6835","nonce":3941922826}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2796452202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2796452202},{"type":"v1","addr":"172.21.15.49:6836","nonce":2796452202}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:19:39.299248+0000","modified":"2024-01-22T05:19:54.461466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":198,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10656":{"gid":10656,"name":"a","rank":0,"incarnation":154,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6837/1689534801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":1689534801},{"type":"v1","addr":"172.21.15.49:6837","nonce":1689534801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2024-01-22T05:21:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.133+0000 7f1d99600700 1 -- 172.21.15.49:0/4294340510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d6c05a510 msgr2=0x7f1d6c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.133+0000 7f1d99600700 1 --2- 172.21.15.49:0/4294340510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d6c05a510 0x7f1d6c05c9d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f1d940bee70 tx=0x7f1d7c007d40).stop 2024-01-22T05:21:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.133+0000 7f1d99600700 1 -- 172.21.15.49:0/4294340510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d94068460 msgr2=0x7f1d9413fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:03.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.133+0000 7f1d99600700 1 --2- 172.21.15.49:0/4294340510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d94068460 0x7f1d9413fb90 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 rx=0x7f1d84009e30 tx=0x7f1d84017000).stop 2024-01-22T05:21:03.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.137+0000 7f1d99600700 1 -- 172.21.15.49:0/4294340510 shutdown_connections 2024-01-22T05:21:03.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.137+0000 7f1d99600700 1 --2- 172.21.15.49:0/4294340510 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1d6c05a510 0x7f1d6c05c9d0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.137+0000 7f1d99600700 1 --2- 172.21.15.49:0/4294340510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d940a7ad0 0x7f1d941409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.137+0000 7f1d99600700 1 --2- 172.21.15.49:0/4294340510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d940688d0 0x7f1d941404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.137+0000 7f1d99600700 1 --2- 172.21.15.49:0/4294340510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d94068460 0x7f1d9413fb90 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.137+0000 7f1d99600700 1 -- 172.21.15.49:0/4294340510 >> 172.21.15.49:0/4294340510 conn(0x7f1d94062a10 msgr2=0x7f1d940a5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:03.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.137+0000 7f1d99600700 1 -- 172.21.15.49:0/4294340510 shutdown_connections 2024-01-22T05:21:03.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.137+0000 7f1d99600700 1 -- 172.21.15.49:0/4294340510 wait complete. 2024-01-22T05:21:03.143 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 157 2024-01-22T05:21:03.163 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:21:03.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.321+0000 7fd134600700 1 Processor -- start 2024-01-22T05:21:03.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.321+0000 7fd134600700 1 -- start start 2024-01-22T05:21:03.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.325+0000 7fd134600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd12c064c00 0x7fd12c0bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:03.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.325+0000 7fd134600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12c0c2700 con 0x7fd12c065240 2024-01-22T05:21:03.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.325+0000 7fd134600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12c0c29a0 con 0x7fd12c065620 2024-01-22T05:21:03.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.325+0000 7fd134600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12c0c2c80 con 0x7fd12c064c00 2024-01-22T05:21:03.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.325+0000 7fd131200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd12c064c00 0x7fd12c0bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:03.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.325+0000 7fd131c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd12c065240 0x7fd12c0644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59674/0 (socket says 172.21.15.49:59674) 2024-01-22T05:21:03.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.325+0000 7fd131c00700 1 -- 172.21.15.49:0/202423557 learned_addr learned my addr 172.21.15.49:0/202423557 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:03.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.329+0000 7fd131200700 1 -- 172.21.15.49:0/202423557 >> v1:172.21.15.110:6789/0 conn(0x7fd12c065620 legacy=0x7fd12c0bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:03.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.329+0000 7fd131200700 1 -- 172.21.15.49:0/202423557 >> v1:172.21.15.49:6789/0 conn(0x7fd12c065240 legacy=0x7fd12c0644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:03.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.329+0000 7fd131200700 1 -- 172.21.15.49:0/202423557 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c0c2f60 con 0x7fd12c064c00 2024-01-22T05:21:03.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.329+0000 7fd131200700 1 --2- 172.21.15.49:0/202423557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c064c00 0x7fd12c0bcc80 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 rx=0x7fd114009760 tx=0x7fd114009060).ready entity=mon.0 client_cookie=c6da257b1c4024 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:03.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.329+0000 7fd12be00700 1 -- 172.21.15.49:0/202423557 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11400b520 con 0x7fd12c064c00 2024-01-22T05:21:03.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.329+0000 7fd12be00700 1 -- 172.21.15.49:0/202423557 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11400b680 con 0x7fd12c064c00 2024-01-22T05:21:03.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.329+0000 7fd12be00700 1 -- 172.21.15.49:0/202423557 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11400ba00 con 0x7fd12c064c00 2024-01-22T05:21:03.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.329+0000 7fd134600700 1 -- 172.21.15.49:0/202423557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c064c00 msgr2=0x7fd12c0bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:03.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.329+0000 7fd134600700 1 --2- 172.21.15.49:0/202423557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c064c00 0x7fd12c0bcc80 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 rx=0x7fd114009760 tx=0x7fd114009060).stop 2024-01-22T05:21:03.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.329+0000 7fd134600700 1 -- 172.21.15.49:0/202423557 shutdown_connections 2024-01-22T05:21:03.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.329+0000 7fd134600700 1 --2- 172.21.15.49:0/202423557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c064c00 0x7fd12c0bcc80 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.329+0000 7fd134600700 1 -- 172.21.15.49:0/202423557 >> 172.21.15.49:0/202423557 conn(0x7fd12c0c87f0 msgr2=0x7fd12c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:03.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.329+0000 7fd134600700 1 -- 172.21.15.49:0/202423557 shutdown_connections 2024-01-22T05:21:03.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.329+0000 7fd134600700 1 -- 172.21.15.49:0/202423557 wait complete. 2024-01-22T05:21:03.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.333+0000 7fd134600700 1 Processor -- start 2024-01-22T05:21:03.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.333+0000 7fd134600700 1 -- start start 2024-01-22T05:21:03.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.333+0000 7fd134600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd12c064c00 0x7fd12c169250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:03.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.333+0000 7fd134600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd12c065240 0x7fd12c153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:03.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.333+0000 7fd134600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c065620 0x7fd12c154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:03.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.333+0000 7fd134600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c154720 con 0x7fd12c065620 2024-01-22T05:21:03.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.333+0000 7fd134600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c0c0530 con 0x7fd12c064c00 2024-01-22T05:21:03.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.333+0000 7fd134600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c0c0810 con 0x7fd12c065240 2024-01-22T05:21:03.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd133000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c065620 0x7fd12c154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:03.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd133000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c065620 0x7fd12c154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50906/0 (socket says 172.21.15.49:50906) 2024-01-22T05:21:03.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd133000700 1 -- 172.21.15.49:0/396211373 learned_addr learned my addr 172.21.15.49:0/396211373 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:03.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd131200700 1 --2- 172.21.15.49:0/396211373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd12c065240 0x7fd12c153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:03.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd131c00700 1 --2- 172.21.15.49:0/396211373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd12c064c00 0x7fd12c169250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:03.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd133000700 1 -- 172.21.15.49:0/396211373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd12c065240 msgr2=0x7fd12c153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:03.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd133000700 1 --2- 172.21.15.49:0/396211373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd12c065240 0x7fd12c153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd133000700 1 -- 172.21.15.49:0/396211373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd12c064c00 msgr2=0x7fd12c169250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:03.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd133000700 1 --2- 172.21.15.49:0/396211373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd12c064c00 0x7fd12c169250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd133000700 1 -- 172.21.15.49:0/396211373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1140092a0 con 0x7fd12c065620 2024-01-22T05:21:03.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd133000700 1 --2- 172.21.15.49:0/396211373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c065620 0x7fd12c154230 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 rx=0x7fd12400b840 tx=0x7fd124009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd128c00700 1 -- 172.21.15.49:0/396211373 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12400d4a0 con 0x7fd12c065620 2024-01-22T05:21:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd134600700 1 -- 172.21.15.49:0/396211373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12c0a8850 con 0x7fd12c065620 2024-01-22T05:21:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd128c00700 1 -- 172.21.15.49:0/396211373 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12400d600 con 0x7fd12c065620 2024-01-22T05:21:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd128c00700 1 -- 172.21.15.49:0/396211373 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12400d9c0 con 0x7fd12c065620 2024-01-22T05:21:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.337+0000 7fd134600700 1 -- 172.21.15.49:0/396211373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12c0a8e10 con 0x7fd12c065620 2024-01-22T05:21:03.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.341+0000 7fd134600700 1 -- 172.21.15.49:0/396211373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12c047060 con 0x7fd12c065620 2024-01-22T05:21:03.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.341+0000 7fd128c00700 1 -- 172.21.15.49:0/396211373 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd124011400 con 0x7fd12c065620 2024-01-22T05:21:03.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.341+0000 7fd128c00700 1 --2- 172.21.15.49:0/396211373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd10405a510 0x7fd10405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:03.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.341+0000 7fd128c00700 1 -- 172.21.15.49:0/396211373 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7fd1240743c0 con 0x7fd12c065620 2024-01-22T05:21:03.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.341+0000 7fd131c00700 1 --2- 172.21.15.49:0/396211373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd10405a510 0x7fd10405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:03.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.341+0000 7fd131c00700 1 --2- 172.21.15.49:0/396211373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd10405a510 0x7fd10405c9d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7fd11c007fd0 tx=0x7fd11c007d30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:03.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.353+0000 7fd128c00700 1 -- 172.21.15.49:0/396211373 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd124047910 con 0x7fd12c065620 2024-01-22T05:21:03.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.513+0000 7fd134600700 1 -- 172.21.15.49:0/396211373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd12c0c3240 con 0x7fd12c065620 2024-01-22T05:21:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.513+0000 7fd128c00700 1 -- 172.21.15.49:0/396211373 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) v1 ==== 74+0+17691 (secure 0 0 0) 0x7fd12404af30 con 0x7fd12c065620 2024-01-22T05:21:03.519 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:21:03.519 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":200,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:20:29.484295+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:19:37.238555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-01-22T05:19:38.297767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"28.0","mappings":[{"from":6,"to":4}]},{"pgid":"28.8","mappings":[{"from":6,"to":1}]},{"pgid":"28.1d","mappings":[{"from":6,"to":4}]},{"pgid":"29.10","mappings":[{"from":6,"to":0}]},{"pgid":"29.14","mappings":[{"from":6,"to":0}]},{"pgid":"29.19","mappings":[{"from":6,"to":0}]},{"pgid":"29.23","mappings":[{"from":6,"to":0}]},{"pgid":"29.39","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6837/1585471135":"2024-01-23T05:19:48.627681+0000","172.21.15.49:6835/1585471135":"2024-01-23T05:19:48.627681+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:21:03.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.517+0000 7fd134600700 1 -- 172.21.15.49:0/396211373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd10405a510 msgr2=0x7fd10405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:03.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.517+0000 7fd134600700 1 --2- 172.21.15.49:0/396211373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd10405a510 0x7fd10405c9d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7fd11c007fd0 tx=0x7fd11c007d30).stop 2024-01-22T05:21:03.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.517+0000 7fd134600700 1 -- 172.21.15.49:0/396211373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c065620 msgr2=0x7fd12c154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:03.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.517+0000 7fd134600700 1 --2- 172.21.15.49:0/396211373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c065620 0x7fd12c154230 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 rx=0x7fd12400b840 tx=0x7fd124009290).stop 2024-01-22T05:21:03.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.517+0000 7fd134600700 1 -- 172.21.15.49:0/396211373 shutdown_connections 2024-01-22T05:21:03.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.517+0000 7fd134600700 1 --2- 172.21.15.49:0/396211373 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fd10405a510 0x7fd10405c9d0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.517+0000 7fd134600700 1 --2- 172.21.15.49:0/396211373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c065620 0x7fd12c154230 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.517+0000 7fd134600700 1 --2- 172.21.15.49:0/396211373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd12c065240 0x7fd12c153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.517+0000 7fd134600700 1 --2- 172.21.15.49:0/396211373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd12c064c00 0x7fd12c169250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.517+0000 7fd134600700 1 -- 172.21.15.49:0/396211373 >> 172.21.15.49:0/396211373 conn(0x7fd12c0c87f0 msgr2=0x7fd12c063750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:03.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.517+0000 7fd134600700 1 -- 172.21.15.49:0/396211373 shutdown_connections 2024-01-22T05:21:03.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.517+0000 7fd134600700 1 -- 172.21.15.49:0/396211373 wait complete. 2024-01-22T05:21:03.543 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:21:03.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fec000700 1 Processor -- start 2024-01-22T05:21:03.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fec000700 1 -- start start 2024-01-22T05:21:03.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fec000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fe40a8b40 0x7f1fe40a8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:03.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fec000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1fe4068290 0x7f1fe40686d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:03.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fec000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe40bbce0 con 0x7f1fe4156120 2024-01-22T05:21:03.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fec000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe40a9490 con 0x7f1fe4068290 2024-01-22T05:21:03.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fec000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40c2e90 con 0x7f1fe40a8b40 2024-01-22T05:21:03.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fe9600700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1fe4156120 0x7f1fe4151830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59686/0 (socket says 172.21.15.49:59686) 2024-01-22T05:21:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fe9600700 1 -- 172.21.15.49:0/136759205 learned_addr learned my addr 172.21.15.49:0/136759205 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fea000700 1 --2- 172.21.15.49:0/136759205 >> v2:172.21.15.49:3300/0 conn(0x7f1fe4068290 0x7f1fe40686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fe8c00700 1 --2- 172.21.15.49:0/136759205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fe40a8b40 0x7f1fe40a8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fe3e00700 1 -- 172.21.15.49:0/136759205 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986026226 0 0) 0x7f1fe40bbce0 con 0x7f1fe4156120 2024-01-22T05:21:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fe3e00700 1 -- 172.21.15.49:0/136759205 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fc40033f0 con 0x7f1fe4156120 2024-01-22T05:21:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fe8c00700 1 -- 172.21.15.49:0/136759205 >> v2:172.21.15.49:3300/0 conn(0x7f1fe4068290 msgr2=0x7f1fe40686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fe8c00700 1 --2- 172.21.15.49:0/136759205 >> v2:172.21.15.49:3300/0 conn(0x7f1fe4068290 0x7f1fe40686d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fe8c00700 1 -- 172.21.15.49:0/136759205 >> v1:172.21.15.49:6789/0 conn(0x7f1fe4156120 legacy=0x7f1fe4151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fe8c00700 1 -- 172.21.15.49:0/136759205 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe40c2c60 con 0x7f1fe40a8b40 2024-01-22T05:21:03.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.709+0000 7f1fea000700 1 --2- 172.21.15.49:0/136759205 >> v2:172.21.15.49:3300/0 conn(0x7f1fe4068290 0x7f1fe40686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:21:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.717+0000 7f1fe8c00700 1 --2- 172.21.15.49:0/136759205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fe40a8b40 0x7f1fe40a8fa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f1fcc009760 tx=0x7f1fcc009060).ready entity=mon.2 client_cookie=b7de956c8cd080a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.717+0000 7f1fe3e00700 1 -- 172.21.15.49:0/136759205 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00d4a0 con 0x7f1fe40a8b40 2024-01-22T05:21:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.717+0000 7f1fe3e00700 1 -- 172.21.15.49:0/136759205 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc00d600 con 0x7f1fe40a8b40 2024-01-22T05:21:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.717+0000 7f1fe3e00700 1 -- 172.21.15.49:0/136759205 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00d980 con 0x7f1fe40a8b40 2024-01-22T05:21:03.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.717+0000 7f1fec000700 1 -- 172.21.15.49:0/136759205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fe40a8b40 msgr2=0x7f1fe40a8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:03.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.717+0000 7f1fec000700 1 --2- 172.21.15.49:0/136759205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fe40a8b40 0x7f1fe40a8fa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f1fcc009760 tx=0x7f1fcc009060).stop 2024-01-22T05:21:03.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.717+0000 7f1fec000700 1 -- 172.21.15.49:0/136759205 shutdown_connections 2024-01-22T05:21:03.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.717+0000 7f1fec000700 1 --2- 172.21.15.49:0/136759205 >> v2:172.21.15.49:3300/0 conn(0x7f1fe4068290 0x7f1fe40686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.717+0000 7f1fec000700 1 --2- 172.21.15.49:0/136759205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fe40a8b40 0x7f1fe40a8fa0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.717+0000 7f1fec000700 1 -- 172.21.15.49:0/136759205 >> 172.21.15.49:0/136759205 conn(0x7f1fe40c7850 msgr2=0x7f1fe40c3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:03.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.717+0000 7f1fec000700 1 -- 172.21.15.49:0/136759205 shutdown_connections 2024-01-22T05:21:03.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.717+0000 7f1fec000700 1 -- 172.21.15.49:0/136759205 wait complete. 2024-01-22T05:21:03.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.717+0000 7f1fec000700 1 Processor -- start 2024-01-22T05:21:03.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.717+0000 7f1fec000700 1 -- start start 2024-01-22T05:21:03.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fec000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fe4068290 0x7f1fe40c0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:03.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fec000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fe40a8b40 0x7f1fe40be800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:03.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fec000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fe4156120 0x7f1fe41463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:03.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fec000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40c0500 con 0x7f1fe4156120 2024-01-22T05:21:03.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fec000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40becf0 con 0x7f1fe4068290 2024-01-22T05:21:03.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fec000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4149a20 con 0x7f1fe40a8b40 2024-01-22T05:21:03.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fea000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fe4156120 0x7f1fe41463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:03.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fea000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fe4156120 0x7f1fe41463b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50930/0 (socket says 172.21.15.49:50930) 2024-01-22T05:21:03.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fea000700 1 -- 172.21.15.49:0/1290870411 learned_addr learned my addr 172.21.15.49:0/1290870411 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:03.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fe8c00700 1 --2- 172.21.15.49:0/1290870411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fe40a8b40 0x7f1fe40be800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:03.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fe9600700 1 --2- 172.21.15.49:0/1290870411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fe4068290 0x7f1fe40c0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:03.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fea000700 1 -- 172.21.15.49:0/1290870411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fe40a8b40 msgr2=0x7f1fe40be800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:03.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fea000700 1 --2- 172.21.15.49:0/1290870411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fe40a8b40 0x7f1fe40be800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fea000700 1 -- 172.21.15.49:0/1290870411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fe4068290 msgr2=0x7f1fe40c0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:03.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fea000700 1 --2- 172.21.15.49:0/1290870411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fe4068290 0x7f1fe40c0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:03.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fea000700 1 -- 172.21.15.49:0/1290870411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc009a20 con 0x7f1fe4156120 2024-01-22T05:21:03.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fe9600700 1 --2- 172.21.15.49:0/1290870411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fe4068290 0x7f1fe40c0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:21:03.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fea000700 1 --2- 172.21.15.49:0/1290870411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fe4156120 0x7f1fe41463b0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 rx=0x7f1fdc00c0f0 tx=0x7f1fdc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fe0c00700 1 -- 172.21.15.49:0/1290870411 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc00cce0 con 0x7f1fe4156120 2024-01-22T05:21:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fe0c00700 1 -- 172.21.15.49:0/1290870411 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc00f040 con 0x7f1fe4156120 2024-01-22T05:21:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fec000700 1 -- 172.21.15.49:0/1290870411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fcc0092a0 con 0x7f1fe4156120 2024-01-22T05:21:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.721+0000 7f1fe0c00700 1 -- 172.21.15.49:0/1290870411 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc013610 con 0x7f1fe4156120 2024-01-22T05:21:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.725+0000 7f1fec000700 1 -- 172.21.15.49:0/1290870411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe40bfbd0 con 0x7f1fe4156120 2024-01-22T05:21:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.725+0000 7f1fec000700 1 -- 172.21.15.49:0/1290870411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe40c06b0 con 0x7f1fe4156120 2024-01-22T05:21:03.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.725+0000 7f1fe0c00700 1 -- 172.21.15.49:0/1290870411 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1fdc013a00 con 0x7f1fe4156120 2024-01-22T05:21:03.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.725+0000 7f1fe0c00700 1 --2- 172.21.15.49:0/1290870411 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1fbc05a540 0x7f1fbc05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:03.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.729+0000 7f1fe0c00700 1 -- 172.21.15.49:0/1290870411 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6792+0+0 (secure 0 0 0) 0x7f1fdc075440 con 0x7f1fe4156120 2024-01-22T05:21:03.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.729+0000 7f1fe9600700 1 --2- 172.21.15.49:0/1290870411 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1fbc05a540 0x7f1fbc05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:03.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.729+0000 7f1fe9600700 1 --2- 172.21.15.49:0/1290870411 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1fbc05a540 0x7f1fbc05ca00 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f1fd4007fd0 tx=0x7f1fd4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:03.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.737+0000 7f1fe0c00700 1 -- 172.21.15.49:0/1290870411 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1fe40c06b0 con 0x7f1fe4156120 2024-01-22T05:21:03.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:03.937+0000 7f1fec000700 1 -- 172.21.15.49:0/1290870411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1fe40c06b0 con 0x7f1fe4156120 2024-01-22T05:21:04.659 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-22T05:21:04.661+0000 7f7813600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:21:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.677+0000 7f1fe0c00700 1 -- 172.21.15.49:0/1290870411 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v158) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1fe40c06b0 con 0x7f1fe4156120 2024-01-22T05:21:04.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.681+0000 7f1fec000700 1 -- 172.21.15.49:0/1290870411 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1fbc05a540 msgr2=0x7f1fbc05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:04.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.681+0000 7f1fec000700 1 --2- 172.21.15.49:0/1290870411 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1fbc05a540 0x7f1fbc05ca00 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f1fd4007fd0 tx=0x7f1fd4009040).stop 2024-01-22T05:21:04.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.681+0000 7f1fec000700 1 -- 172.21.15.49:0/1290870411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fe4156120 msgr2=0x7f1fe41463b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:04.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.681+0000 7f1fec000700 1 --2- 172.21.15.49:0/1290870411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fe4156120 0x7f1fe41463b0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 rx=0x7f1fdc00c0f0 tx=0x7f1fdc00b040).stop 2024-01-22T05:21:04.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.681+0000 7f1fec000700 1 -- 172.21.15.49:0/1290870411 shutdown_connections 2024-01-22T05:21:04.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.681+0000 7f1fec000700 1 --2- 172.21.15.49:0/1290870411 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1fbc05a540 0x7f1fbc05ca00 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:04.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.681+0000 7f1fec000700 1 --2- 172.21.15.49:0/1290870411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fe4156120 0x7f1fe41463b0 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:04.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.681+0000 7f1fec000700 1 --2- 172.21.15.49:0/1290870411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fe40a8b40 0x7f1fe40be800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:04.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.681+0000 7f1fec000700 1 --2- 172.21.15.49:0/1290870411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fe4068290 0x7f1fe40c0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:04.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.681+0000 7f1fec000700 1 -- 172.21.15.49:0/1290870411 >> 172.21.15.49:0/1290870411 conn(0x7f1fe40c7850 msgr2=0x7f1fe40c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:04.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.681+0000 7f1fec000700 1 -- 172.21.15.49:0/1290870411 shutdown_connections 2024-01-22T05:21:04.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.681+0000 7f1fec000700 1 -- 172.21.15.49:0/1290870411 wait complete. 2024-01-22T05:21:04.682 INFO:tasks.ceph.mds.a.smithi049.stderr: -2553> 2024-01-22T05:19:56.507+0000 7fbb41000700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:21:04.683 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:21:04.706 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:21:04.739 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-22T05:21:04.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.869+0000 7fa09ae00700 1 Processor -- start 2024-01-22T05:21:04.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.869+0000 7fa09ae00700 1 -- start start 2024-01-22T05:21:04.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.873+0000 7fa09ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0940bc3d0 0x7fa0941576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:04.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.873+0000 7fa09ae00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa094157bc0 0x7fa09414df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:04.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.873+0000 7fa09ae00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa094067a90 con 0x7fa0940bc7b0 2024-01-22T05:21:04.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.873+0000 7fa09ae00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0940c1160 con 0x7fa094157bc0 2024-01-22T05:21:04.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.873+0000 7fa09ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa094067d70 con 0x7fa0940bc3d0 2024-01-22T05:21:04.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.873+0000 7fa098e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa094157bc0 0x7fa09414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:04.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.873+0000 7fa093400700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa0940bc7b0 0x7fa09414d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:60128/0 (socket says 172.21.15.49:60128) 2024-01-22T05:21:04.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.873+0000 7fa093400700 1 -- 172.21.15.49:0/1767088227 learned_addr learned my addr 172.21.15.49:0/1767088227 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:04.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.873+0000 7fa093e00700 1 --2- 172.21.15.49:0/1767088227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0940bc3d0 0x7fa0941576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa092a00700 1 -- 172.21.15.49:0/1767088227 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57768163 0 0) 0x7fa094067a90 con 0x7fa0940bc7b0 2024-01-22T05:21:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa098e00700 1 -- 172.21.15.49:0/1767088227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0940bc3d0 msgr2=0x7fa0941576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa098e00700 1 --2- 172.21.15.49:0/1767088227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0940bc3d0 0x7fa0941576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa098e00700 1 -- 172.21.15.49:0/1767088227 >> v1:172.21.15.110:6789/0 conn(0x7fa0940bc7b0 legacy=0x7fa09414d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa098e00700 1 -- 172.21.15.49:0/1767088227 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa094157fe0 con 0x7fa094157bc0 2024-01-22T05:21:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa098e00700 1 --2- 172.21.15.49:0/1767088227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa094157bc0 0x7fa09414df30 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 rx=0x7fa08c009e60 tx=0x7fa08c009780).ready entity=mon.0 client_cookie=6e817bf2b3dca531 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:04.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa092a00700 1 -- 172.21.15.49:0/1767088227 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c00e070 con 0x7fa094157bc0 2024-01-22T05:21:04.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa092a00700 1 -- 172.21.15.49:0/1767088227 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c00bb60 con 0x7fa094157bc0 2024-01-22T05:21:04.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa092a00700 1 -- 172.21.15.49:0/1767088227 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c012410 con 0x7fa094157bc0 2024-01-22T05:21:04.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa09ae00700 1 -- 172.21.15.49:0/1767088227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa094157bc0 msgr2=0x7fa09414df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:04.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa09ae00700 1 --2- 172.21.15.49:0/1767088227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa094157bc0 0x7fa09414df30 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 rx=0x7fa08c009e60 tx=0x7fa08c009780).stop 2024-01-22T05:21:04.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa09ae00700 1 -- 172.21.15.49:0/1767088227 shutdown_connections 2024-01-22T05:21:04.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa09ae00700 1 --2- 172.21.15.49:0/1767088227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa094157bc0 0x7fa09414df30 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:04.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa09ae00700 1 --2- 172.21.15.49:0/1767088227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0940bc3d0 0x7fa0941576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:04.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa09ae00700 1 -- 172.21.15.49:0/1767088227 >> 172.21.15.49:0/1767088227 conn(0x7fa0940c6560 msgr2=0x7fa0940c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:04.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa09ae00700 1 -- 172.21.15.49:0/1767088227 shutdown_connections 2024-01-22T05:21:04.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.877+0000 7fa09ae00700 1 -- 172.21.15.49:0/1767088227 wait complete. 2024-01-22T05:21:04.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.881+0000 7fa09ae00700 1 Processor -- start 2024-01-22T05:21:04.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.885+0000 7fa09ae00700 1 -- start start 2024-01-22T05:21:04.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.885+0000 7fa09ae00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0940bc3d0 0x7fa09414e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:04.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.885+0000 7fa09ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0940bc7b0 0x7fa0940bf750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:04.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.885+0000 7fa09ae00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa094157bc0 0x7fa0940c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:04.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.885+0000 7fa09ae00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa094150df0 con 0x7fa094157bc0 2024-01-22T05:21:04.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.885+0000 7fa09ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09414ff40 con 0x7fa0940bc7b0 2024-01-22T05:21:04.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.885+0000 7fa09ae00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0941501e0 con 0x7fa0940bc3d0 2024-01-22T05:21:04.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.885+0000 7fa098e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa094157bc0 0x7fa0940c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:04.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.885+0000 7fa098e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa094157bc0 0x7fa0940c4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50972/0 (socket says 172.21.15.49:50972) 2024-01-22T05:21:04.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.885+0000 7fa098e00700 1 -- 172.21.15.49:0/1713104551 learned_addr learned my addr 172.21.15.49:0/1713104551 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:04.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.885+0000 7fa093e00700 1 --2- 172.21.15.49:0/1713104551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0940bc3d0 0x7fa09414e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:04.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.885+0000 7fa093400700 1 --2- 172.21.15.49:0/1713104551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0940bc7b0 0x7fa0940bf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:04.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.889+0000 7fa098e00700 1 -- 172.21.15.49:0/1713104551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0940bc3d0 msgr2=0x7fa09414e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:04.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.889+0000 7fa098e00700 1 --2- 172.21.15.49:0/1713104551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0940bc3d0 0x7fa09414e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:04.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.889+0000 7fa098e00700 1 -- 172.21.15.49:0/1713104551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0940bc7b0 msgr2=0x7fa0940bf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:04.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.889+0000 7fa098e00700 1 --2- 172.21.15.49:0/1713104551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0940bc7b0 0x7fa0940bf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:04.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.889+0000 7fa098e00700 1 -- 172.21.15.49:0/1713104551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c009a20 con 0x7fa094157bc0 2024-01-22T05:21:04.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.889+0000 7fa098e00700 1 --2- 172.21.15.49:0/1713104551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa094157bc0 0x7fa0940c4880 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 rx=0x7fa09405f520 tx=0x7fa094067eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:04.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.889+0000 7fa08b400700 1 -- 172.21.15.49:0/1713104551 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c012410 con 0x7fa094157bc0 2024-01-22T05:21:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.889+0000 7fa08b400700 1 -- 172.21.15.49:0/1713104551 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c01d630 con 0x7fa094157bc0 2024-01-22T05:21:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.889+0000 7fa09ae00700 1 -- 172.21.15.49:0/1713104551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0941504c0 con 0x7fa094157bc0 2024-01-22T05:21:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.889+0000 7fa08b400700 1 -- 172.21.15.49:0/1713104551 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c01d9d0 con 0x7fa094157bc0 2024-01-22T05:21:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.889+0000 7fa09ae00700 1 -- 172.21.15.49:0/1713104551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa094150a80 con 0x7fa094157bc0 2024-01-22T05:21:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.889+0000 7fa09ae00700 1 -- 172.21.15.49:0/1713104551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa094150f60 con 0x7fa094157bc0 2024-01-22T05:21:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.893+0000 7fa08b400700 1 -- 172.21.15.49:0/1713104551 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa08c003040 con 0x7fa094157bc0 2024-01-22T05:21:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.893+0000 7fa08b400700 1 --2- 172.21.15.49:0/1713104551 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa06c05a510 0x7fa06c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.893+0000 7fa08b400700 1 -- 172.21.15.49:0/1713104551 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6878+0+0 (secure 0 0 0) 0x7fa08c076930 con 0x7fa094157bc0 2024-01-22T05:21:04.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.893+0000 7fa093e00700 1 --2- 172.21.15.49:0/1713104551 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa06c05a510 0x7fa06c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:04.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.893+0000 7fa093e00700 1 --2- 172.21.15.49:0/1713104551 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa06c05a510 0x7fa06c05c9d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7fa084009b90 tx=0x7fa084009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:04.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:04.901+0000 7fa08b400700 1 -- 172.21.15.49:0/1713104551 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa08c049de0 con 0x7fa094157bc0 2024-01-22T05:21:05.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.101+0000 7fa09ae00700 1 -- 172.21.15.49:0/1713104551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa094047060 con 0x7fa094157bc0 2024-01-22T05:21:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.677+0000 7fa08b400700 1 -- 172.21.15.49:0/1713104551 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v159) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa08c04d400 con 0x7fa094157bc0 2024-01-22T05:21:05.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.681+0000 7fa09ae00700 1 -- 172.21.15.49:0/1713104551 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa06c05a510 msgr2=0x7fa06c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:05.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.681+0000 7fa09ae00700 1 --2- 172.21.15.49:0/1713104551 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa06c05a510 0x7fa06c05c9d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7fa084009b90 tx=0x7fa084009060).stop 2024-01-22T05:21:05.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.681+0000 7fa09ae00700 1 -- 172.21.15.49:0/1713104551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa094157bc0 msgr2=0x7fa0940c4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:05.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.681+0000 7fa09ae00700 1 --2- 172.21.15.49:0/1713104551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa094157bc0 0x7fa0940c4880 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 rx=0x7fa09405f520 tx=0x7fa094067eb0).stop 2024-01-22T05:21:05.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.681+0000 7fa09ae00700 1 -- 172.21.15.49:0/1713104551 shutdown_connections 2024-01-22T05:21:05.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.681+0000 7fa09ae00700 1 --2- 172.21.15.49:0/1713104551 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa06c05a510 0x7fa06c05c9d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:05.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.681+0000 7fa09ae00700 1 --2- 172.21.15.49:0/1713104551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa094157bc0 0x7fa0940c4880 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:05.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.681+0000 7fa09ae00700 1 --2- 172.21.15.49:0/1713104551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0940bc7b0 0x7fa0940bf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:05.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.681+0000 7fa09ae00700 1 --2- 172.21.15.49:0/1713104551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0940bc3d0 0x7fa09414e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:05.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.681+0000 7fa09ae00700 1 -- 172.21.15.49:0/1713104551 >> 172.21.15.49:0/1713104551 conn(0x7fa0940c6560 msgr2=0x7fa0941552b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:05.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.685+0000 7fa09ae00700 1 -- 172.21.15.49:0/1713104551 shutdown_connections 2024-01-22T05:21:05.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.685+0000 7fa09ae00700 1 -- 172.21.15.49:0/1713104551 wait complete. 2024-01-22T05:21:05.706 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:21:05.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.921+0000 7fe5b8000700 1 Processor -- start 2024-01-22T05:21:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.925+0000 7fe5b8000700 1 -- start start 2024-01-22T05:21:05.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.925+0000 7fe5b8000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe5b0156260 0x7fe5b00c2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.925+0000 7fe5b8000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe5b00c2b40 0x7fe5b01516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.925+0000 7fe5b8000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5b0151b90 0x7fe5b00ab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.925+0000 7fe5b8000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b0066d80 con 0x7fe5b0156260 2024-01-22T05:21:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.925+0000 7fe5b8000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b00675e0 con 0x7fe5b00c2b40 2024-01-22T05:21:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.925+0000 7fe5b8000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b0067020 con 0x7fe5b0151b90 2024-01-22T05:21:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.925+0000 7fe5b5600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe5b0156260 0x7fe5b00c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.925+0000 7fe5b5600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe5b0156260 0x7fe5b00c2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50988/0 (socket says 172.21.15.49:50988) 2024-01-22T05:21:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.925+0000 7fe5b5600700 1 -- 172.21.15.49:0/4149193492 learned_addr learned my addr 172.21.15.49:0/4149193492 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:05.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.925+0000 7fe5b5600700 1 -- 172.21.15.49:0/4149193492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5b0151b90 msgr2=0x7fe5b00ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:05.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.925+0000 7fe5b5600700 1 --2- 172.21.15.49:0/4149193492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5b0151b90 0x7fe5b00ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:21:05.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.925+0000 7fe5b5600700 1 -- 172.21.15.49:0/4149193492 >> v2:172.21.15.110:3300/0 conn(0x7fe5b00c2b40 msgr2=0x7fe5b01516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:05.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.925+0000 7fe5b5600700 1 --2- 172.21.15.49:0/4149193492 >> v2:172.21.15.110:3300/0 conn(0x7fe5b00c2b40 0x7fe5b01516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:21:05.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.925+0000 7fe5b5600700 1 -- 172.21.15.49:0/4149193492 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b0067300 con 0x7fe5b0156260 2024-01-22T05:21:05.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.929+0000 7fe5b5600700 1 --2- 172.21.15.49:0/4149193492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5b0156260 0x7fe5b00c2650 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 rx=0x7fe5b00a8670 tx=0x7fe5a00090f0).ready entity=mon.0 client_cookie=cb5ff173624d46fd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:05.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.929+0000 7fe5afe00700 1 -- 172.21.15.49:0/4149193492 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000b600 con 0x7fe5b0156260 2024-01-22T05:21:05.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.929+0000 7fe5afe00700 1 -- 172.21.15.49:0/4149193492 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a000b760 con 0x7fe5b0156260 2024-01-22T05:21:05.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.929+0000 7fe5afe00700 1 -- 172.21.15.49:0/4149193492 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000bae0 con 0x7fe5b0156260 2024-01-22T05:21:05.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.929+0000 7fe5b8000700 1 -- 172.21.15.49:0/4149193492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5b0156260 msgr2=0x7fe5b00c2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:05.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.929+0000 7fe5b8000700 1 --2- 172.21.15.49:0/4149193492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5b0156260 0x7fe5b00c2650 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 rx=0x7fe5b00a8670 tx=0x7fe5a00090f0).stop 2024-01-22T05:21:05.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.929+0000 7fe5b8000700 1 -- 172.21.15.49:0/4149193492 shutdown_connections 2024-01-22T05:21:05.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.929+0000 7fe5b8000700 1 --2- 172.21.15.49:0/4149193492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5b0151b90 0x7fe5b00ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:21:05.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.929+0000 7fe5b8000700 1 --2- 172.21.15.49:0/4149193492 >> v2:172.21.15.110:3300/0 conn(0x7fe5b00c2b40 0x7fe5b01516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:21:05.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.929+0000 7fe5b8000700 1 --2- 172.21.15.49:0/4149193492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5b0156260 0x7fe5b00c2650 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:05.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.929+0000 7fe5b8000700 1 -- 172.21.15.49:0/4149193492 >> 172.21.15.49:0/4149193492 conn(0x7fe5b00c6500 msgr2=0x7fe5b00c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:05.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.929+0000 7fe5b8000700 1 -- 172.21.15.49:0/4149193492 shutdown_connections 2024-01-22T05:21:05.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.929+0000 7fe5b8000700 1 -- 172.21.15.49:0/4149193492 wait complete. 2024-01-22T05:21:05.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.933+0000 7fe5b8000700 1 Processor -- start 2024-01-22T05:21:05.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.933+0000 7fe5b8000700 1 -- start start 2024-01-22T05:21:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b8000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5b00c2b40 0x7fe5b01620b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b8000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5b0151b90 0x7fe5b015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b8000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5b0156260 0x7fe5b0164e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b8000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b015b4d0 con 0x7fe5b00c2b40 2024-01-22T05:21:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b8000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b0165980 con 0x7fe5b0156260 2024-01-22T05:21:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b8000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b0165c60 con 0x7fe5b0151b90 2024-01-22T05:21:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b5600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5b00c2b40 0x7fe5b01620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b5600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5b00c2b40 0x7fe5b01620b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51000/0 (socket says 172.21.15.49:51000) 2024-01-22T05:21:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b5600700 1 -- 172.21.15.49:0/2325634106 learned_addr learned my addr 172.21.15.49:0/2325634106 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b6000700 1 --2- 172.21.15.49:0/2325634106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5b0156260 0x7fe5b0164e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b4c00700 1 --2- 172.21.15.49:0/2325634106 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5b0151b90 0x7fe5b015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b5600700 1 -- 172.21.15.49:0/2325634106 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5b0151b90 msgr2=0x7fe5b015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b5600700 1 --2- 172.21.15.49:0/2325634106 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5b0151b90 0x7fe5b015afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b5600700 1 -- 172.21.15.49:0/2325634106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5b0156260 msgr2=0x7fe5b0164e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b5600700 1 --2- 172.21.15.49:0/2325634106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5b0156260 0x7fe5b0164e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b5600700 1 -- 172.21.15.49:0/2325634106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a0009370 con 0x7fe5b00c2b40 2024-01-22T05:21:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b4c00700 1 --2- 172.21.15.49:0/2325634106 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5b0151b90 0x7fe5b015afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:21:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.937+0000 7fe5b5600700 1 --2- 172.21.15.49:0/2325634106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5b00c2b40 0x7fe5b01620b0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 rx=0x7fe5b0064d80 tx=0x7fe5a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.941+0000 7fe5acc00700 1 -- 172.21.15.49:0/2325634106 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000bea0 con 0x7fe5b00c2b40 2024-01-22T05:21:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.941+0000 7fe5acc00700 1 -- 172.21.15.49:0/2325634106 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a000b8d0 con 0x7fe5b00c2b40 2024-01-22T05:21:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.941+0000 7fe5acc00700 1 -- 172.21.15.49:0/2325634106 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a001b660 con 0x7fe5b00c2b40 2024-01-22T05:21:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.941+0000 7fe5b8000700 1 -- 172.21.15.49:0/2325634106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b0165f40 con 0x7fe5b00c2b40 2024-01-22T05:21:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.941+0000 7fe5b8000700 1 -- 172.21.15.49:0/2325634106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b0166500 con 0x7fe5b00c2b40 2024-01-22T05:21:05.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.941+0000 7fe5b8000700 1 -- 172.21.15.49:0/2325634106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b0166690 con 0x7fe5b00c2b40 2024-01-22T05:21:05.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.945+0000 7fe5acc00700 1 -- 172.21.15.49:0/2325634106 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe5a001ba50 con 0x7fe5b00c2b40 2024-01-22T05:21:05.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.945+0000 7fe5acc00700 1 --2- 172.21.15.49:0/2325634106 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe58805a510 0x7fe58805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:05.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.945+0000 7fe5acc00700 1 -- 172.21.15.49:0/2325634106 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6878+0+0 (secure 0 0 0) 0x7fe5a0075fc0 con 0x7fe5b00c2b40 2024-01-22T05:21:05.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.945+0000 7fe5b4c00700 1 --2- 172.21.15.49:0/2325634106 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe58805a510 0x7fe58805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:05.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.945+0000 7fe5b4c00700 1 --2- 172.21.15.49:0/2325634106 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe58805a510 0x7fe58805c9d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7fe5b00c1500 tx=0x7fe598008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:05.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:05.949+0000 7fe5acc00700 1 -- 172.21.15.49:0/2325634106 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe5a004cf80 con 0x7fe5b00c2b40 2024-01-22T05:21:06.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.113+0000 7fe5b8000700 1 -- 172.21.15.49:0/2325634106 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe5b00c0ba0 con 0x7fe5b00c2b40 2024-01-22T05:21:06.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.685+0000 7fe5acc00700 1 -- 172.21.15.49:0/2325634106 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v202) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe5a004cb70 con 0x7fe5b00c2b40 2024-01-22T05:21:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.693+0000 7fe5b8000700 1 -- 172.21.15.49:0/2325634106 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe58805a510 msgr2=0x7fe58805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.693+0000 7fe5b8000700 1 --2- 172.21.15.49:0/2325634106 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe58805a510 0x7fe58805c9d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7fe5b00c1500 tx=0x7fe598008040).stop 2024-01-22T05:21:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.693+0000 7fe5b8000700 1 -- 172.21.15.49:0/2325634106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5b00c2b40 msgr2=0x7fe5b01620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.693+0000 7fe5b8000700 1 --2- 172.21.15.49:0/2325634106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5b00c2b40 0x7fe5b01620b0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 rx=0x7fe5b0064d80 tx=0x7fe5a0017000).stop 2024-01-22T05:21:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.693+0000 7fe5b8000700 1 -- 172.21.15.49:0/2325634106 shutdown_connections 2024-01-22T05:21:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.693+0000 7fe5b8000700 1 --2- 172.21.15.49:0/2325634106 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe58805a510 0x7fe58805c9d0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.693+0000 7fe5b8000700 1 --2- 172.21.15.49:0/2325634106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5b0156260 0x7fe5b0164e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.693+0000 7fe5b8000700 1 --2- 172.21.15.49:0/2325634106 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5b0151b90 0x7fe5b015afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.693+0000 7fe5b8000700 1 --2- 172.21.15.49:0/2325634106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5b00c2b40 0x7fe5b01620b0 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:06.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.693+0000 7fe5b8000700 1 -- 172.21.15.49:0/2325634106 >> 172.21.15.49:0/2325634106 conn(0x7fe5b00c6500 msgr2=0x7fe5b00c4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:06.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.693+0000 7fe5b8000700 1 -- 172.21.15.49:0/2325634106 shutdown_connections 2024-01-22T05:21:06.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.693+0000 7fe5b8000700 1 -- 172.21.15.49:0/2325634106 wait complete. 2024-01-22T05:21:06.694 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:21:06.714 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:21:06.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.885+0000 7f87ae200700 1 Processor -- start 2024-01-22T05:21:06.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.885+0000 7f87ae200700 1 -- start start 2024-01-22T05:21:06.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.885+0000 7f87ae200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f87a80ac3b0 0x7f87a8159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:06.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.885+0000 7f87ae200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87a8066690 0x7f87a8066af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:06.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.885+0000 7f87ae200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a80a7cb0 con 0x7f87a8067a90 2024-01-22T05:21:06.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87ae200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a80a8b10 con 0x7f87a8066690 2024-01-22T05:21:06.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87ae200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a80a7f00 con 0x7f87a80ac3b0 2024-01-22T05:21:06.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87a6a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87a8066690 0x7f87a8066af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:06.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87a6a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87a8066690 0x7f87a8066af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51016/0 (socket says 172.21.15.49:51016) 2024-01-22T05:21:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87a6a00700 1 -- 172.21.15.49:0/3436998224 learned_addr learned my addr 172.21.15.49:0/3436998224 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87a7400700 1 --2- 172.21.15.49:0/3436998224 >> v2:172.21.15.110:3300/0 conn(0x7f87a80ac3b0 0x7f87a8159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87a6a00700 1 -- 172.21.15.49:0/3436998224 >> v2:172.21.15.110:3300/0 conn(0x7f87a80ac3b0 msgr2=0x7f87a8159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87a6a00700 1 --2- 172.21.15.49:0/3436998224 >> v2:172.21.15.110:3300/0 conn(0x7f87a80ac3b0 0x7f87a8159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87a6a00700 1 -- 172.21.15.49:0/3436998224 >> v1:172.21.15.49:6789/0 conn(0x7f87a8067a90 legacy=0x7f87a8067f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87a6a00700 1 -- 172.21.15.49:0/3436998224 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a80a81e0 con 0x7f87a8066690 2024-01-22T05:21:06.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87a6000700 1 -- 172.21.15.49:0/3436998224 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422204468 0 0) 0x7f87a80a7cb0 con 0x7f87a8067a90 2024-01-22T05:21:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87a6a00700 1 --2- 172.21.15.49:0/3436998224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8066690 0x7f87a8066af0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 rx=0x7f87a80642d0 tx=0x7f87900090f0).ready entity=mon.0 client_cookie=b30c4e050d7de14b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87a6000700 1 -- 172.21.15.49:0/3436998224 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879000b600 con 0x7f87a8066690 2024-01-22T05:21:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87a6000700 1 -- 172.21.15.49:0/3436998224 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879000b760 con 0x7f87a8066690 2024-01-22T05:21:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87a6000700 1 -- 172.21.15.49:0/3436998224 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879000bae0 con 0x7f87a8066690 2024-01-22T05:21:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87ae200700 1 -- 172.21.15.49:0/3436998224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8066690 msgr2=0x7f87a8066af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:06.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87ae200700 1 --2- 172.21.15.49:0/3436998224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8066690 0x7f87a8066af0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 rx=0x7f87a80642d0 tx=0x7f87900090f0).stop 2024-01-22T05:21:06.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87ae200700 1 -- 172.21.15.49:0/3436998224 shutdown_connections 2024-01-22T05:21:06.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87ae200700 1 --2- 172.21.15.49:0/3436998224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8066690 0x7f87a8066af0 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:06.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87ae200700 1 --2- 172.21.15.49:0/3436998224 >> v2:172.21.15.110:3300/0 conn(0x7f87a80ac3b0 0x7f87a8159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:06.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.889+0000 7f87ae200700 1 -- 172.21.15.49:0/3436998224 >> 172.21.15.49:0/3436998224 conn(0x7f87a80c6500 msgr2=0x7f87a80c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.893+0000 7f87ae200700 1 -- 172.21.15.49:0/3436998224 shutdown_connections 2024-01-22T05:21:06.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.893+0000 7f87ae200700 1 -- 172.21.15.49:0/3436998224 wait complete. 2024-01-22T05:21:06.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.893+0000 7f87ae200700 1 Processor -- start 2024-01-22T05:21:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.893+0000 7f87ae200700 1 -- start start 2024-01-22T05:21:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87ae200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87a8066690 0x7f87a8146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87ae200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8067a90 0x7f87a80aae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87ae200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87a80ac3b0 0x7f87a80ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87ae200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a8140c60 con 0x7f87a8067a90 2024-01-22T05:21:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87ae200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80ab830 con 0x7f87a80ac3b0 2024-01-22T05:21:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87ae200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a8141ef0 con 0x7f87a8066690 2024-01-22T05:21:06.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87a6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8067a90 0x7f87a80aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:06.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87a6a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8067a90 0x7f87a80aae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51022/0 (socket says 172.21.15.49:51022) 2024-01-22T05:21:06.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87a6a00700 1 -- 172.21.15.49:0/2400067328 learned_addr learned my addr 172.21.15.49:0/2400067328 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:06.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87a7400700 1 --2- 172.21.15.49:0/2400067328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87a8066690 0x7f87a8146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:06.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87a7e00700 1 --2- 172.21.15.49:0/2400067328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87a80ac3b0 0x7f87a80ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:06.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87a6a00700 1 -- 172.21.15.49:0/2400067328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87a8066690 msgr2=0x7f87a8146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:06.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87a6a00700 1 --2- 172.21.15.49:0/2400067328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87a8066690 0x7f87a8146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:06.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87a6a00700 1 -- 172.21.15.49:0/2400067328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87a80ac3b0 msgr2=0x7f87a80ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:06.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87a6a00700 1 --2- 172.21.15.49:0/2400067328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87a80ac3b0 0x7f87a80ab340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:06.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87a6a00700 1 -- 172.21.15.49:0/2400067328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8790009370 con 0x7f87a8067a90 2024-01-22T05:21:06.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87a6a00700 1 --2- 172.21.15.49:0/2400067328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8067a90 0x7f87a80aae50 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 rx=0x7f8790009130 tx=0x7f8790017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:06.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f879ea00700 1 -- 172.21.15.49:0/2400067328 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879000b8d0 con 0x7f87a8067a90 2024-01-22T05:21:06.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f879ea00700 1 -- 172.21.15.49:0/2400067328 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879000ba30 con 0x7f87a8067a90 2024-01-22T05:21:06.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f87ae200700 1 -- 172.21.15.49:0/2400067328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a81421d0 con 0x7f87a8067a90 2024-01-22T05:21:06.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.897+0000 7f879ea00700 1 -- 172.21.15.49:0/2400067328 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879001c670 con 0x7f87a8067a90 2024-01-22T05:21:06.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.901+0000 7f87ae200700 1 -- 172.21.15.49:0/2400067328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a8142810 con 0x7f87a8067a90 2024-01-22T05:21:06.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.901+0000 7f87ae200700 1 -- 172.21.15.49:0/2400067328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a80c0ba0 con 0x7f87a8067a90 2024-01-22T05:21:06.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.901+0000 7f879ea00700 1 -- 172.21.15.49:0/2400067328 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f879001c9e0 con 0x7f87a8067a90 2024-01-22T05:21:06.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.905+0000 7f879ea00700 1 --2- 172.21.15.49:0/2400067328 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f878005a510 0x7f878005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:06.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.905+0000 7f879ea00700 1 -- 172.21.15.49:0/2400067328 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6353+0+0 (secure 0 0 0) 0x7f8790076730 con 0x7f87a8067a90 2024-01-22T05:21:06.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.905+0000 7f87a7400700 1 --2- 172.21.15.49:0/2400067328 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f878005a510 0x7f878005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:06.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.905+0000 7f87a7400700 1 --2- 172.21.15.49:0/2400067328 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f878005a510 0x7f878005c9d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f8798006fd0 tx=0x7f8798008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:06.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:06.909+0000 7f879ea00700 1 -- 172.21.15.49:0/2400067328 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8790049de0 con 0x7f87a8067a90 2024-01-22T05:21:07.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.081+0000 7f87ae200700 1 -- 172.21.15.49:0/2400067328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f87a80a84c0 con 0x7f87a8067a90 2024-01-22T05:21:07.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.697+0000 7f879ea00700 1 -- 172.21.15.49:0/2400067328 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v203) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8790020020 con 0x7f87a8067a90 2024-01-22T05:21:07.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.705+0000 7f87ae200700 1 -- 172.21.15.49:0/2400067328 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f878005a510 msgr2=0x7f878005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:07.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.705+0000 7f87ae200700 1 --2- 172.21.15.49:0/2400067328 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f878005a510 0x7f878005c9d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f8798006fd0 tx=0x7f8798008040).stop 2024-01-22T05:21:07.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.705+0000 7f87ae200700 1 -- 172.21.15.49:0/2400067328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8067a90 msgr2=0x7f87a80aae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:07.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.705+0000 7f87ae200700 1 --2- 172.21.15.49:0/2400067328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8067a90 0x7f87a80aae50 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 rx=0x7f8790009130 tx=0x7f8790017000).stop 2024-01-22T05:21:07.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.705+0000 7f87ae200700 1 -- 172.21.15.49:0/2400067328 shutdown_connections 2024-01-22T05:21:07.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.705+0000 7f87ae200700 1 --2- 172.21.15.49:0/2400067328 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f878005a510 0x7f878005c9d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:07.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.705+0000 7f87ae200700 1 --2- 172.21.15.49:0/2400067328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87a80ac3b0 0x7f87a80ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:07.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.705+0000 7f87ae200700 1 --2- 172.21.15.49:0/2400067328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8067a90 0x7f87a80aae50 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:07.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.705+0000 7f87ae200700 1 --2- 172.21.15.49:0/2400067328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87a8066690 0x7f87a8146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:07.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.705+0000 7f87ae200700 1 -- 172.21.15.49:0/2400067328 >> 172.21.15.49:0/2400067328 conn(0x7f87a80c6500 msgr2=0x7f87a80c5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:07.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.709+0000 7f87ae200700 1 -- 172.21.15.49:0/2400067328 shutdown_connections 2024-01-22T05:21:07.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.709+0000 7f87ae200700 1 -- 172.21.15.49:0/2400067328 wait complete. 2024-01-22T05:21:07.713 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-01-22T05:21:07.731 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_hack_allow_loading_invalid_metadata 2024-01-22T05:21:07.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.901+0000 7fa8bbc00700 1 Processor -- start 2024-01-22T05:21:07.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.901+0000 7fa8bbc00700 1 -- start start 2024-01-22T05:21:07.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.905+0000 7fa8bbc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa8b40a9da0 0x7fa8b4151900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:07.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.905+0000 7fa8bbc00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8b4068ad0 0x7fa8b4063e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:07.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.905+0000 7fa8bbc00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b4155cc0 con 0x7fa8b4064370 2024-01-22T05:21:07.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.905+0000 7fa8bbc00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b4151df0 con 0x7fa8b40a9da0 2024-01-22T05:21:07.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.905+0000 7fa8bbc00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b4064800 con 0x7fa8b4068ad0 2024-01-22T05:21:07.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8b9200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa8b40a9da0 0x7fa8b4151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:07.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8b3e00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8b4068ad0 0x7fa8b4063e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:07.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8b9c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa8b4064370 0x7fa8b4067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59712/0 (socket says 172.21.15.49:59712) 2024-01-22T05:21:07.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8b9c00700 1 -- 172.21.15.49:0/3054297672 learned_addr learned my addr 172.21.15.49:0/3054297672 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:07.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8b3e00700 1 -- 172.21.15.49:0/3054297672 >> v2:172.21.15.49:3300/0 conn(0x7fa8b40a9da0 msgr2=0x7fa8b4151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:07.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8b3e00700 1 --2- 172.21.15.49:0/3054297672 >> v2:172.21.15.49:3300/0 conn(0x7fa8b40a9da0 0x7fa8b4151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:07.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8b3e00700 1 -- 172.21.15.49:0/3054297672 >> v1:172.21.15.49:6789/0 conn(0x7fa8b4064370 legacy=0x7fa8b4067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:07.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8b3e00700 1 -- 172.21.15.49:0/3054297672 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b4069320 con 0x7fa8b4068ad0 2024-01-22T05:21:07.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8b3e00700 1 --2- 172.21.15.49:0/3054297672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b4068ad0 0x7fa8b4063e80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7fa8b40be740 tx=0x7fa89c009060).ready entity=mon.1 client_cookie=d58c4a8184b13978 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:07.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8b3400700 1 -- 172.21.15.49:0/3054297672 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00f510 con 0x7fa8b4068ad0 2024-01-22T05:21:07.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8b3400700 1 -- 172.21.15.49:0/3054297672 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c00f670 con 0x7fa8b4068ad0 2024-01-22T05:21:07.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8b3400700 1 -- 172.21.15.49:0/3054297672 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00f9f0 con 0x7fa8b4068ad0 2024-01-22T05:21:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8bbc00700 1 -- 172.21.15.49:0/3054297672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b4068ad0 msgr2=0x7fa8b4063e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8bbc00700 1 --2- 172.21.15.49:0/3054297672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b4068ad0 0x7fa8b4063e80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7fa8b40be740 tx=0x7fa89c009060).stop 2024-01-22T05:21:07.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8bbc00700 1 -- 172.21.15.49:0/3054297672 shutdown_connections 2024-01-22T05:21:07.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8bbc00700 1 --2- 172.21.15.49:0/3054297672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b4068ad0 0x7fa8b4063e80 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:07.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8bbc00700 1 --2- 172.21.15.49:0/3054297672 >> v2:172.21.15.49:3300/0 conn(0x7fa8b40a9da0 0x7fa8b4151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:07.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.909+0000 7fa8bbc00700 1 -- 172.21.15.49:0/3054297672 >> 172.21.15.49:0/3054297672 conn(0x7fa8b4067290 msgr2=0x7fa8b40c7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:07.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.913+0000 7fa8bbc00700 1 -- 172.21.15.49:0/3054297672 shutdown_connections 2024-01-22T05:21:07.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.913+0000 7fa8bbc00700 1 -- 172.21.15.49:0/3054297672 wait complete. 2024-01-22T05:21:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.913+0000 7fa8bbc00700 1 Processor -- start 2024-01-22T05:21:07.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.913+0000 7fa8bbc00700 1 -- start start 2024-01-22T05:21:07.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8bbc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8b4064370 0x7fa8b4153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:07.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8bbc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b4068ad0 0x7fa8b4154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:07.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8bbc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8b40a9da0 0x7fa8b41622c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:07.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8bbc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b4154910 con 0x7fa8b4064370 2024-01-22T05:21:07.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8bbc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b41534e0 con 0x7fa8b4068ad0 2024-01-22T05:21:07.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8bbc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40ad2b0 con 0x7fa8b40a9da0 2024-01-22T05:21:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8b9200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8b4064370 0x7fa8b4153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8b9200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8b4064370 0x7fa8b4153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51028/0 (socket says 172.21.15.49:51028) 2024-01-22T05:21:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8b9200700 1 -- 172.21.15.49:0/2666879770 learned_addr learned my addr 172.21.15.49:0/2666879770 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8b3e00700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b4068ad0 0x7fa8b4154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8b9200700 1 -- 172.21.15.49:0/2666879770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8b40a9da0 msgr2=0x7fa8b41622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8b9c00700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8b40a9da0 0x7fa8b41622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8b9200700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8b40a9da0 0x7fa8b41622c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8b9200700 1 -- 172.21.15.49:0/2666879770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b4068ad0 msgr2=0x7fa8b4154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8b9200700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b4068ad0 0x7fa8b4154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8b9200700 1 -- 172.21.15.49:0/2666879770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c0092a0 con 0x7fa8b4064370 2024-01-22T05:21:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8b3e00700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b4068ad0 0x7fa8b4154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:21:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8b9c00700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8b40a9da0 0x7fa8b41622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:21:07.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8b9200700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8b4064370 0x7fa8b4153f30 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 rx=0x7fa8a400e900 tx=0x7fa8a4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8abe00700 1 -- 172.21.15.49:0/2666879770 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a400c640 con 0x7fa8b4064370 2024-01-22T05:21:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8abe00700 1 -- 172.21.15.49:0/2666879770 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a400c7a0 con 0x7fa8b4064370 2024-01-22T05:21:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8bbc00700 1 -- 172.21.15.49:0/2666879770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b4152440 con 0x7fa8b4064370 2024-01-22T05:21:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8abe00700 1 -- 172.21.15.49:0/2666879770 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a400cb20 con 0x7fa8b4064370 2024-01-22T05:21:07.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.917+0000 7fa8bbc00700 1 -- 172.21.15.49:0/2666879770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b4152a00 con 0x7fa8b4064370 2024-01-22T05:21:07.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.921+0000 7fa8abe00700 1 -- 172.21.15.49:0/2666879770 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa8a401b400 con 0x7fa8b4064370 2024-01-22T05:21:07.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.921+0000 7fa8bbc00700 1 -- 172.21.15.49:0/2666879770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b4065720 con 0x7fa8b4064370 2024-01-22T05:21:07.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.921+0000 7fa8abe00700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa88c05a510 0x7fa88c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:07.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.921+0000 7fa8abe00700 1 -- 172.21.15.49:0/2666879770 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7fa8a4074ad0 con 0x7fa8b4064370 2024-01-22T05:21:07.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.921+0000 7fa8b3e00700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa88c05a510 0x7fa88c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:07.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.925+0000 7fa8b3e00700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa88c05a510 0x7fa88c05c9d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7fa8b41559e0 tx=0x7fa89c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:07.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:07.929+0000 7fa8abe00700 1 -- 172.21.15.49:0/2666879770 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa8a4048390 con 0x7fa8b4064370 2024-01-22T05:21:08.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.093+0000 7fa8bbc00700 1 -- 172.21.15.49:0/2666879770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_hack_allow_loading_invalid_metadata"} v 0) v1 -- 0x7fa8b41553b0 con 0x7fa8b4064370 2024-01-22T05:21:08.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.105+0000 7fa8abe00700 1 -- 172.21.15.49:0/2666879770 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_hack_allow_loading_invalid_metadata"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa8a4016030 con 0x7fa8b4064370 2024-01-22T05:21:08.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.105+0000 7fa8bbc00700 1 -- 172.21.15.49:0/2666879770 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa88c05a510 msgr2=0x7fa88c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:08.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.105+0000 7fa8bbc00700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa88c05a510 0x7fa88c05c9d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7fa8b41559e0 tx=0x7fa89c017000).stop 2024-01-22T05:21:08.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.105+0000 7fa8bbc00700 1 -- 172.21.15.49:0/2666879770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8b4064370 msgr2=0x7fa8b4153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:08.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.105+0000 7fa8bbc00700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8b4064370 0x7fa8b4153f30 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 rx=0x7fa8a400e900 tx=0x7fa8a4009060).stop 2024-01-22T05:21:08.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.105+0000 7fa8bbc00700 1 -- 172.21.15.49:0/2666879770 shutdown_connections 2024-01-22T05:21:08.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.105+0000 7fa8bbc00700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa88c05a510 0x7fa88c05c9d0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.105+0000 7fa8bbc00700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8b40a9da0 0x7fa8b41622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.105+0000 7fa8bbc00700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b4068ad0 0x7fa8b4154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.105+0000 7fa8bbc00700 1 --2- 172.21.15.49:0/2666879770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8b4064370 0x7fa8b4153f30 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.105+0000 7fa8bbc00700 1 -- 172.21.15.49:0/2666879770 >> 172.21.15.49:0/2666879770 conn(0x7fa8b4067290 msgr2=0x7fa8b40bc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:08.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.109+0000 7fa8bbc00700 1 -- 172.21.15.49:0/2666879770 shutdown_connections 2024-01-22T05:21:08.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.109+0000 7fa8bbc00700 1 -- 172.21.15.49:0/2666879770 wait complete. 2024-01-22T05:21:08.129 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-22T05:21:08.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.301+0000 7f2110200700 1 Processor -- start 2024-01-22T05:21:08.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.305+0000 7f2110200700 1 -- start start 2024-01-22T05:21:08.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.305+0000 7f2110200700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f21080bd0b0 0x7f21080a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:08.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.305+0000 7f2110200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21080a8c30 0x7f2108067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:08.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.305+0000 7f2110200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2108066680 con 0x7f21080bccd0 2024-01-22T05:21:08.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.305+0000 7f2110200700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21080bc840 con 0x7f21080bd0b0 2024-01-22T05:21:08.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.305+0000 7f2110200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21080a90c0 con 0x7f21080a8c30 2024-01-22T05:21:08.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.309+0000 7f210d800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f21080bccd0 0x7f2108065f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59720/0 (socket says 172.21.15.49:59720) 2024-01-22T05:21:08.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.309+0000 7f210d800700 1 -- 172.21.15.49:0/4204494122 learned_addr learned my addr 172.21.15.49:0/4204494122 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:08.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.309+0000 7f210e200700 1 --2- 172.21.15.49:0/4204494122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21080a8c30 0x7f2108067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:08.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.309+0000 7f210ce00700 1 --2- 172.21.15.49:0/4204494122 >> v2:172.21.15.110:3300/0 conn(0x7f21080bd0b0 0x7f21080a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:08.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.309+0000 7f2107e00700 1 -- 172.21.15.49:0/4204494122 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3696844860 0 0) 0x7f20f8001110 con 0x7f21080bccd0 2024-01-22T05:21:08.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.309+0000 7f2107e00700 1 -- 172.21.15.49:0/4204494122 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20e80033f0 con 0x7f21080bccd0 2024-01-22T05:21:08.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.309+0000 7f210e200700 1 -- 172.21.15.49:0/4204494122 >> v2:172.21.15.110:3300/0 conn(0x7f21080bd0b0 msgr2=0x7f21080a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:08.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.309+0000 7f210e200700 1 --2- 172.21.15.49:0/4204494122 >> v2:172.21.15.110:3300/0 conn(0x7f21080bd0b0 0x7f21080a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.309+0000 7f210e200700 1 -- 172.21.15.49:0/4204494122 >> v1:172.21.15.49:6789/0 conn(0x7f21080bccd0 legacy=0x7f2108065f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:08.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.309+0000 7f210e200700 1 -- 172.21.15.49:0/4204494122 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2108151dd0 con 0x7f21080a8c30 2024-01-22T05:21:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.309+0000 7f210e200700 1 --2- 172.21.15.49:0/4204494122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21080a8c30 0x7f2108067a90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f2100009e60 tx=0x7f2100009780).ready entity=mon.2 client_cookie=cbef277fd45b4cad server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.309+0000 7f2107e00700 1 -- 172.21.15.49:0/4204494122 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210000e070 con 0x7f21080a8c30 2024-01-22T05:21:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.309+0000 7f2107e00700 1 -- 172.21.15.49:0/4204494122 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210000bab0 con 0x7f21080a8c30 2024-01-22T05:21:08.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.309+0000 7f2107e00700 1 -- 172.21.15.49:0/4204494122 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210000be30 con 0x7f21080a8c30 2024-01-22T05:21:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.313+0000 7f2110200700 1 -- 172.21.15.49:0/4204494122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21080a8c30 msgr2=0x7f2108067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:08.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.313+0000 7f2110200700 1 --2- 172.21.15.49:0/4204494122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21080a8c30 0x7f2108067a90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f2100009e60 tx=0x7f2100009780).stop 2024-01-22T05:21:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.313+0000 7f2110200700 1 -- 172.21.15.49:0/4204494122 shutdown_connections 2024-01-22T05:21:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.313+0000 7f2110200700 1 --2- 172.21.15.49:0/4204494122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21080a8c30 0x7f2108067a90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.313+0000 7f2110200700 1 --2- 172.21.15.49:0/4204494122 >> v2:172.21.15.110:3300/0 conn(0x7f21080bd0b0 0x7f21080a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.313+0000 7f2110200700 1 -- 172.21.15.49:0/4204494122 >> 172.21.15.49:0/4204494122 conn(0x7f21080c6560 msgr2=0x7f21080c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:08.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.313+0000 7f2110200700 1 -- 172.21.15.49:0/4204494122 shutdown_connections 2024-01-22T05:21:08.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.313+0000 7f2110200700 1 -- 172.21.15.49:0/4204494122 wait complete. 2024-01-22T05:21:08.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.317+0000 7f2110200700 1 Processor -- start 2024-01-22T05:21:08.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.317+0000 7f2110200700 1 -- start start 2024-01-22T05:21:08.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.317+0000 7f2110200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21080a8c30 0x7f21080bf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:08.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.317+0000 7f2110200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21080bccd0 0x7f210814c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:08.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.317+0000 7f2110200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21080bd0b0 0x7f21080bea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:08.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.317+0000 7f2110200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2108163430 con 0x7f21080bd0b0 2024-01-22T05:21:08.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.317+0000 7f2110200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210814e180 con 0x7f21080a8c30 2024-01-22T05:21:08.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.317+0000 7f2110200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2108162820 con 0x7f21080bccd0 2024-01-22T05:21:08.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f210e200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21080bd0b0 0x7f21080bea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:08.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f210e200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21080bd0b0 0x7f21080bea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51030/0 (socket says 172.21.15.49:51030) 2024-01-22T05:21:08.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f210e200700 1 -- 172.21.15.49:0/3503078814 learned_addr learned my addr 172.21.15.49:0/3503078814 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:08.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f210ce00700 1 --2- 172.21.15.49:0/3503078814 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21080bccd0 0x7f210814c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:08.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f210d800700 1 --2- 172.21.15.49:0/3503078814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21080a8c30 0x7f21080bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:08.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f210e200700 1 -- 172.21.15.49:0/3503078814 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21080bccd0 msgr2=0x7f210814c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:08.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f210e200700 1 --2- 172.21.15.49:0/3503078814 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21080bccd0 0x7f210814c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f210e200700 1 -- 172.21.15.49:0/3503078814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21080a8c30 msgr2=0x7f21080bf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:08.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f210e200700 1 --2- 172.21.15.49:0/3503078814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21080a8c30 0x7f21080bf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f210e200700 1 -- 172.21.15.49:0/3503078814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2100009a20 con 0x7f21080bd0b0 2024-01-22T05:21:08.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f210e200700 1 --2- 172.21.15.49:0/3503078814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21080bd0b0 0x7f21080bea00 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 rx=0x7f210000b610 tx=0x7f2100009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:08.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f2104c00700 1 -- 172.21.15.49:0/3503078814 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2100013e70 con 0x7f21080bd0b0 2024-01-22T05:21:08.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f2104c00700 1 -- 172.21.15.49:0/3503078814 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210001d630 con 0x7f21080bd0b0 2024-01-22T05:21:08.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f2110200700 1 -- 172.21.15.49:0/3503078814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2108162b00 con 0x7f21080bd0b0 2024-01-22T05:21:08.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f2104c00700 1 -- 172.21.15.49:0/3503078814 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210001d9f0 con 0x7f21080bd0b0 2024-01-22T05:21:08.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.321+0000 7f2110200700 1 -- 172.21.15.49:0/3503078814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21081630c0 con 0x7f21080bd0b0 2024-01-22T05:21:08.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.325+0000 7f2110200700 1 -- 172.21.15.49:0/3503078814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21080bd690 con 0x7f21080bd0b0 2024-01-22T05:21:08.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.325+0000 7f2104c00700 1 -- 172.21.15.49:0/3503078814 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2100003040 con 0x7f21080bd0b0 2024-01-22T05:21:08.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.329+0000 7f2104c00700 1 --2- 172.21.15.49:0/3503078814 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f20e005a4e0 0x7f20e005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:08.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.329+0000 7f2104c00700 1 -- 172.21.15.49:0/3503078814 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f21000763b0 con 0x7f21080bd0b0 2024-01-22T05:21:08.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.329+0000 7f210d800700 1 --2- 172.21.15.49:0/3503078814 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f20e005a4e0 0x7f20e005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:08.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.329+0000 7f210d800700 1 --2- 172.21.15.49:0/3503078814 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f20e005a4e0 0x7f20e005c9a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f20f8001270 tx=0x7f20f8007a70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:08.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.333+0000 7f2104c00700 1 -- 172.21.15.49:0/3503078814 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f21080bd690 con 0x7f21080bd0b0 2024-01-22T05:21:08.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.497+0000 7f2110200700 1 -- 172.21.15.49:0/3503078814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f21080bd690 con 0x7f21080bd0b0 2024-01-22T05:21:08.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.509+0000 7f2104c00700 1 -- 172.21.15.49:0/3503078814 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f21080bd690 con 0x7f21080bd0b0 2024-01-22T05:21:08.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.513+0000 7f2110200700 1 -- 172.21.15.49:0/3503078814 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f20e005a4e0 msgr2=0x7f20e005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:08.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.513+0000 7f2110200700 1 --2- 172.21.15.49:0/3503078814 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f20e005a4e0 0x7f20e005c9a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f20f8001270 tx=0x7f20f8007a70).stop 2024-01-22T05:21:08.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.513+0000 7f2110200700 1 -- 172.21.15.49:0/3503078814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21080bd0b0 msgr2=0x7f21080bea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:08.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.513+0000 7f2110200700 1 --2- 172.21.15.49:0/3503078814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21080bd0b0 0x7f21080bea00 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 rx=0x7f210000b610 tx=0x7f2100009780).stop 2024-01-22T05:21:08.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.513+0000 7f2110200700 1 -- 172.21.15.49:0/3503078814 shutdown_connections 2024-01-22T05:21:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.513+0000 7f2110200700 1 --2- 172.21.15.49:0/3503078814 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f20e005a4e0 0x7f20e005c9a0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.513+0000 7f2110200700 1 --2- 172.21.15.49:0/3503078814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21080bd0b0 0x7f21080bea00 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.513+0000 7f2110200700 1 --2- 172.21.15.49:0/3503078814 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21080bccd0 0x7f210814c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.513+0000 7f2110200700 1 --2- 172.21.15.49:0/3503078814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21080a8c30 0x7f21080bf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.513+0000 7f2110200700 1 -- 172.21.15.49:0/3503078814 >> 172.21.15.49:0/3503078814 conn(0x7f21080c6560 msgr2=0x7f21080c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.513+0000 7f2110200700 1 -- 172.21.15.49:0/3503078814 shutdown_connections 2024-01-22T05:21:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.513+0000 7f2110200700 1 -- 172.21.15.49:0/3503078814 wait complete. 2024-01-22T05:21:08.536 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode' 2024-01-22T05:21:08.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.705+0000 7f4eb2400700 1 Processor -- start 2024-01-22T05:21:08.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.705+0000 7f4eb2400700 1 -- start start 2024-01-22T05:21:08.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.709+0000 7f4eb2400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4eac15b0f0 0x7f4eac15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:08.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.709+0000 7f4eb2400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4eac0681a0 0x7f4eac15bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:08.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.709+0000 7f4eb2400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eac0c9230 con 0x7f4eac15ba30 2024-01-22T05:21:08.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.709+0000 7f4eb2400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac15c4f0 con 0x7f4eac0681a0 2024-01-22T05:21:08.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.709+0000 7f4eb2400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac15c7d0 con 0x7f4eac15b0f0 2024-01-22T05:21:08.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.709+0000 7f4eb0e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4eac0681a0 0x7f4eac15bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:08.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.709+0000 7f4eab400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4eac15b0f0 0x7f4eac15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:08.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.709+0000 7f4eaaa00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4eac15ba30 0x7f4eac067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:60138/0 (socket says 172.21.15.49:60138) 2024-01-22T05:21:08.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.709+0000 7f4eaaa00700 1 -- 172.21.15.49:0/3136617018 learned_addr learned my addr 172.21.15.49:0/3136617018 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.709+0000 7f4eab400700 1 -- 172.21.15.49:0/3136617018 >> v2:172.21.15.49:3300/0 conn(0x7f4eac0681a0 msgr2=0x7f4eac15bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.709+0000 7f4eab400700 1 --2- 172.21.15.49:0/3136617018 >> v2:172.21.15.49:3300/0 conn(0x7f4eac0681a0 0x7f4eac15bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.709+0000 7f4eab400700 1 -- 172.21.15.49:0/3136617018 >> v1:172.21.15.110:6789/0 conn(0x7f4eac15ba30 legacy=0x7f4eac067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.709+0000 7f4eab400700 1 -- 172.21.15.49:0/3136617018 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac0c8ec0 con 0x7f4eac15b0f0 2024-01-22T05:21:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.709+0000 7f4eaa000700 1 -- 172.21.15.49:0/3136617018 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130229152 0 0) 0x7f4eac0c9230 con 0x7f4eac15ba30 2024-01-22T05:21:08.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.709+0000 7f4eab400700 1 --2- 172.21.15.49:0/3136617018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4eac15b0f0 0x7f4eac15b4d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f4eac082c70 tx=0x7f4e9c009060).ready entity=mon.1 client_cookie=f239808df16b9da5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.713+0000 7f4eaa000700 1 -- 172.21.15.49:0/3136617018 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c00f510 con 0x7f4eac15b0f0 2024-01-22T05:21:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.713+0000 7f4eaa000700 1 -- 172.21.15.49:0/3136617018 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c00f670 con 0x7f4eac15b0f0 2024-01-22T05:21:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.713+0000 7f4eaa000700 1 -- 172.21.15.49:0/3136617018 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c00f9f0 con 0x7f4eac15b0f0 2024-01-22T05:21:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.713+0000 7f4eb2400700 1 -- 172.21.15.49:0/3136617018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4eac15b0f0 msgr2=0x7f4eac15b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:08.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.713+0000 7f4eb2400700 1 --2- 172.21.15.49:0/3136617018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4eac15b0f0 0x7f4eac15b4d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f4eac082c70 tx=0x7f4e9c009060).stop 2024-01-22T05:21:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.713+0000 7f4eb2400700 1 -- 172.21.15.49:0/3136617018 shutdown_connections 2024-01-22T05:21:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.713+0000 7f4eb2400700 1 --2- 172.21.15.49:0/3136617018 >> v2:172.21.15.49:3300/0 conn(0x7f4eac0681a0 0x7f4eac15bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.713+0000 7f4eb2400700 1 --2- 172.21.15.49:0/3136617018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4eac15b0f0 0x7f4eac15b4d0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.713+0000 7f4eb2400700 1 -- 172.21.15.49:0/3136617018 >> 172.21.15.49:0/3136617018 conn(0x7f4eac0ca9a0 msgr2=0x7f4eac0c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.713+0000 7f4eb2400700 1 -- 172.21.15.49:0/3136617018 shutdown_connections 2024-01-22T05:21:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.713+0000 7f4eb2400700 1 -- 172.21.15.49:0/3136617018 wait complete. 2024-01-22T05:21:08.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.717+0000 7f4eb2400700 1 Processor -- start 2024-01-22T05:21:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.717+0000 7f4eb2400700 1 -- start start 2024-01-22T05:21:08.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eb2400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eac0681a0 0x7f4eac14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:08.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eb2400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4eac15b0f0 0x7f4eac14b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:08.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eb2400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4eac15ba30 0x7f4eac14cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:08.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eb2400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac14e320 con 0x7f4eac0681a0 2024-01-22T05:21:08.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eb2400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac14d710 con 0x7f4eac15b0f0 2024-01-22T05:21:08.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eb2400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac14d9f0 con 0x7f4eac15ba30 2024-01-22T05:21:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eab400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eac0681a0 0x7f4eac14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eab400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eac0681a0 0x7f4eac14e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51036/0 (socket says 172.21.15.49:51036) 2024-01-22T05:21:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eab400700 1 -- 172.21.15.49:0/791964723 learned_addr learned my addr 172.21.15.49:0/791964723 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eb0e00700 1 --2- 172.21.15.49:0/791964723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4eac15ba30 0x7f4eac14cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eaaa00700 1 --2- 172.21.15.49:0/791964723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4eac15b0f0 0x7f4eac14b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eab400700 1 -- 172.21.15.49:0/791964723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4eac15ba30 msgr2=0x7f4eac14cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eab400700 1 --2- 172.21.15.49:0/791964723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4eac15ba30 0x7f4eac14cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eab400700 1 -- 172.21.15.49:0/791964723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4eac15b0f0 msgr2=0x7f4eac14b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eab400700 1 --2- 172.21.15.49:0/791964723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4eac15b0f0 0x7f4eac14b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eab400700 1 -- 172.21.15.49:0/791964723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c0092a0 con 0x7f4eac0681a0 2024-01-22T05:21:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eb0e00700 1 --2- 172.21.15.49:0/791964723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4eac15ba30 0x7f4eac14cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:21:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eab400700 1 --2- 172.21.15.49:0/791964723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eac0681a0 0x7f4eac14e7b0 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 rx=0x7f4e9c009dd0 tx=0x7f4e9c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4ea2a00700 1 -- 172.21.15.49:0/791964723 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c00f7e0 con 0x7f4eac0681a0 2024-01-22T05:21:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4ea2a00700 1 -- 172.21.15.49:0/791964723 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c00f940 con 0x7f4eac0681a0 2024-01-22T05:21:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4eb2400700 1 -- 172.21.15.49:0/791964723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eac14dcd0 con 0x7f4eac0681a0 2024-01-22T05:21:08.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.721+0000 7f4ea2a00700 1 -- 172.21.15.49:0/791964723 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c01b660 con 0x7f4eac0681a0 2024-01-22T05:21:08.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.725+0000 7f4eb2400700 1 -- 172.21.15.49:0/791964723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac14eca0 con 0x7f4eac0681a0 2024-01-22T05:21:08.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.725+0000 7f4eb2400700 1 -- 172.21.15.49:0/791964723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eac047060 con 0x7f4eac0681a0 2024-01-22T05:21:08.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.725+0000 7f4ea2a00700 1 -- 172.21.15.49:0/791964723 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4e9c01ba10 con 0x7f4eac0681a0 2024-01-22T05:21:08.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.729+0000 7f4ea2a00700 1 --2- 172.21.15.49:0/791964723 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e8405a510 0x7f4e8405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:08.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.729+0000 7f4ea2a00700 1 -- 172.21.15.49:0/791964723 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f4e9c075fa0 con 0x7f4eac0681a0 2024-01-22T05:21:08.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.729+0000 7f4eaaa00700 1 --2- 172.21.15.49:0/791964723 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e8405a510 0x7f4e8405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:08.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.729+0000 7f4eaaa00700 1 --2- 172.21.15.49:0/791964723 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e8405a510 0x7f4e8405c9d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f4eac065820 tx=0x7f4e94007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:08.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.733+0000 7f4ea2a00700 1 -- 172.21.15.49:0/791964723 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4e9c0498c0 con 0x7f4eac0681a0 2024-01-22T05:21:08.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:08.961+0000 7f4eb2400700 1 -- 172.21.15.49:0/791964723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]} v 0) v1 -- 0x7f4eac0c8b70 con 0x7f4eac0681a0 2024-01-22T05:21:09.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:09.713+0000 7f4ea2a00700 1 -- 172.21.15.49:0/791964723 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]}]=0 v767) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4e9c028070 con 0x7f4eac0681a0 2024-01-22T05:21:09.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:09.717+0000 7f4eb2400700 1 -- 172.21.15.49:0/791964723 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e8405a510 msgr2=0x7f4e8405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:09.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:09.717+0000 7f4eb2400700 1 --2- 172.21.15.49:0/791964723 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e8405a510 0x7f4e8405c9d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f4eac065820 tx=0x7f4e94007bb0).stop 2024-01-22T05:21:09.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:09.717+0000 7f4eb2400700 1 -- 172.21.15.49:0/791964723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eac0681a0 msgr2=0x7f4eac14e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:09.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:09.717+0000 7f4eb2400700 1 --2- 172.21.15.49:0/791964723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eac0681a0 0x7f4eac14e7b0 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 rx=0x7f4e9c009dd0 tx=0x7f4e9c017000).stop 2024-01-22T05:21:09.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:09.717+0000 7f4eb2400700 1 -- 172.21.15.49:0/791964723 shutdown_connections 2024-01-22T05:21:09.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:09.717+0000 7f4eb2400700 1 --2- 172.21.15.49:0/791964723 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4e8405a510 0x7f4e8405c9d0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:09.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:09.717+0000 7f4eb2400700 1 --2- 172.21.15.49:0/791964723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4eac15ba30 0x7f4eac14cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:09.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:09.717+0000 7f4eb2400700 1 --2- 172.21.15.49:0/791964723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4eac15b0f0 0x7f4eac14b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:09.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:09.717+0000 7f4eb2400700 1 --2- 172.21.15.49:0/791964723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eac0681a0 0x7f4eac14e7b0 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:09.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:09.717+0000 7f4eb2400700 1 -- 172.21.15.49:0/791964723 >> 172.21.15.49:0/791964723 conn(0x7f4eac0ca9a0 msgr2=0x7f4eac0bf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:09.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:09.717+0000 7f4eb2400700 1 -- 172.21.15.49:0/791964723 shutdown_connections 2024-01-22T05:21:09.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:09.717+0000 7f4eb2400700 1 -- 172.21.15.49:0/791964723 wait complete. 2024-01-22T05:21:09.742 INFO:tasks.cephfs_test_runner:test_scrub_dup_inode (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-01-22T05:21:09.742 INFO:tasks.cephfs_test_runner: 2024-01-22T05:21:09.742 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-22T05:21:09.742 INFO:tasks.cephfs_test_runner:Ran 12 tests in 947.045s 2024-01-22T05:21:09.742 INFO:tasks.cephfs_test_runner: 2024-01-22T05:21:09.742 INFO:tasks.cephfs_test_runner:OK 2024-01-22T05:21:09.742 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-01-22T05:21:09.756 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-01-22T05:21:09.765 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-22T05:21:09.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:21:09.766 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:21:09.787 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:21:09.787 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:21:09.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:21:09.788 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:21:09.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:21:09.870 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:21:09.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:21:09.989 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-01-22T05:21:10.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:21:10.157 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-22T05:21:10.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:21:10.171 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-01-22T05:21:10.263 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2024-01-22T05:21:10.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:21:10.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:21:10.267 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-22T05:21:10.284 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-22T05:21:10.285 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-01-22T05:21:10.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:21:10.286 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-22T05:21:10.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:21:10.371 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-22T05:21:10.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:21:10.477 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-01-22T05:21:10.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:21:10.576 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:21:10.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:21:10.638 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-22T05:21:10.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:21:10.654 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-01-22T05:21:10.748 INFO:teuthology.orchestra.run.smithi110.stderr:Cannot find device "ceph-brx" 2024-01-22T05:21:10.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:21:10.752 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-22T05:21:10.760 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-01-22T05:21:10.761 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:21:10.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.929+0000 7fb935400700 1 Processor -- start 2024-01-22T05:21:10.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.929+0000 7fb935400700 1 -- start start 2024-01-22T05:21:10.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb935400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb930155d20 0x7fb930065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:10.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb935400700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb930066070 0x7fb9300a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:10.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb935400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9300a90e0 con 0x7fb9300a8c30 2024-01-22T05:21:10.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb935400700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9300c1a40 con 0x7fb930066070 2024-01-22T05:21:10.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb935400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb930159310 con 0x7fb930155d20 2024-01-22T05:21:10.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92f200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb9300a8c30 0x7fb9300c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59734/0 (socket says 172.21.15.49:59734) 2024-01-22T05:21:10.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92f200700 1 -- 172.21.15.49:0/3439342752 learned_addr learned my addr 172.21.15.49:0/3439342752 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:10.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92de00700 1 --2- 172.21.15.49:0/3439342752 >> v2:172.21.15.110:3300/0 conn(0x7fb930066070 0x7fb9300a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:10.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92e800700 1 --2- 172.21.15.49:0/3439342752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb930155d20 0x7fb930065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:10.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92d400700 1 -- 172.21.15.49:0/3439342752 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330529667 0 0) 0x7fb928001490 con 0x7fb9300a8c30 2024-01-22T05:21:10.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92d400700 1 -- 172.21.15.49:0/3439342752 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9100033f0 con 0x7fb9300a8c30 2024-01-22T05:21:10.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92d400700 1 -- 172.21.15.49:0/3439342752 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4169881730 0 0) 0x7fb9100033f0 con 0x7fb9300a8c30 2024-01-22T05:21:10.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92e800700 1 -- 172.21.15.49:0/3439342752 >> v2:172.21.15.110:3300/0 conn(0x7fb930066070 msgr2=0x7fb9300a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:10.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92e800700 1 --2- 172.21.15.49:0/3439342752 >> v2:172.21.15.110:3300/0 conn(0x7fb930066070 0x7fb9300a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:10.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92e800700 1 -- 172.21.15.49:0/3439342752 >> v1:172.21.15.49:6789/0 conn(0x7fb9300a8c30 legacy=0x7fb9300c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:10.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92e800700 1 -- 172.21.15.49:0/3439342752 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300c13f0 con 0x7fb930155d20 2024-01-22T05:21:10.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92de00700 1 --2- 172.21.15.49:0/3439342752 >> v2:172.21.15.110:3300/0 conn(0x7fb930066070 0x7fb9300a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:21:10.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92e800700 1 --2- 172.21.15.49:0/3439342752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb930155d20 0x7fb930065b80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fb920009760 tx=0x7fb920009060).ready entity=mon.2 client_cookie=92a48d9518068e08 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:10.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92d400700 1 -- 172.21.15.49:0/3439342752 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928001980 con 0x7fb930155d20 2024-01-22T05:21:10.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92d400700 1 -- 172.21.15.49:0/3439342752 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb920011400 con 0x7fb930155d20 2024-01-22T05:21:10.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.933+0000 7fb92d400700 1 -- 172.21.15.49:0/3439342752 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb920011780 con 0x7fb930155d20 2024-01-22T05:21:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.937+0000 7fb935400700 1 -- 172.21.15.49:0/3439342752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb930155d20 msgr2=0x7fb930065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.937+0000 7fb935400700 1 --2- 172.21.15.49:0/3439342752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb930155d20 0x7fb930065b80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fb920009760 tx=0x7fb920009060).stop 2024-01-22T05:21:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.937+0000 7fb935400700 1 -- 172.21.15.49:0/3439342752 shutdown_connections 2024-01-22T05:21:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.937+0000 7fb935400700 1 --2- 172.21.15.49:0/3439342752 >> v2:172.21.15.110:3300/0 conn(0x7fb930066070 0x7fb9300a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.937+0000 7fb935400700 1 --2- 172.21.15.49:0/3439342752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb930155d20 0x7fb930065b80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.937+0000 7fb935400700 1 -- 172.21.15.49:0/3439342752 >> 172.21.15.49:0/3439342752 conn(0x7fb9300c6540 msgr2=0x7fb9300c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:10.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.937+0000 7fb935400700 1 -- 172.21.15.49:0/3439342752 shutdown_connections 2024-01-22T05:21:10.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.937+0000 7fb935400700 1 -- 172.21.15.49:0/3439342752 wait complete. 2024-01-22T05:21:10.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.941+0000 7fb935400700 1 Processor -- start 2024-01-22T05:21:10.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.941+0000 7fb935400700 1 -- start start 2024-01-22T05:21:10.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb935400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb930066070 0x7fb930151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:10.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb935400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9300a8c30 0x7fb9300a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:10.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb935400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb930155d20 0x7fb9300c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:10.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb935400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300bf2e0 con 0x7fb930155d20 2024-01-22T05:21:10.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb935400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb930151740 con 0x7fb930066070 2024-01-22T05:21:10.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb935400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb930151a20 con 0x7fb9300a8c30 2024-01-22T05:21:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb92f200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb930155d20 0x7fb9300c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb92f200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb930155d20 0x7fb9300c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51040/0 (socket says 172.21.15.49:51040) 2024-01-22T05:21:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb92de00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9300a8c30 0x7fb9300a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb92f200700 1 -- 172.21.15.49:0/3716178207 learned_addr learned my addr 172.21.15.49:0/3716178207 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:10.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb92e800700 1 --2- 172.21.15.49:0/3716178207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb930066070 0x7fb930151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb92f200700 1 -- 172.21.15.49:0/3716178207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9300a8c30 msgr2=0x7fb9300a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb92f200700 1 --2- 172.21.15.49:0/3716178207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9300a8c30 0x7fb9300a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb92f200700 1 -- 172.21.15.49:0/3716178207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb930066070 msgr2=0x7fb930151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb92f200700 1 --2- 172.21.15.49:0/3716178207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb930066070 0x7fb930151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb92f200700 1 -- 172.21.15.49:0/3716178207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9180092a0 con 0x7fb930155d20 2024-01-22T05:21:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb92e800700 1 --2- 172.21.15.49:0/3716178207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb930066070 0x7fb930151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:21:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb92de00700 1 --2- 172.21.15.49:0/3716178207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9300a8c30 0x7fb9300a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:21:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb92f200700 1 --2- 172.21.15.49:0/3716178207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb930155d20 0x7fb9300c5a20 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 rx=0x7fb92800cb90 tx=0x7fb928001740).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb926000700 1 -- 172.21.15.49:0/3716178207 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928004c40 con 0x7fb930155d20 2024-01-22T05:21:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb926000700 1 -- 172.21.15.49:0/3716178207 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb928004da0 con 0x7fb930155d20 2024-01-22T05:21:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb935400700 1 -- 172.21.15.49:0/3716178207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9200092a0 con 0x7fb930155d20 2024-01-22T05:21:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb926000700 1 -- 172.21.15.49:0/3716178207 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9280073c0 con 0x7fb930155d20 2024-01-22T05:21:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.945+0000 7fb935400700 1 -- 172.21.15.49:0/3716178207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9300c5f10 con 0x7fb930155d20 2024-01-22T05:21:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.949+0000 7fb935400700 1 -- 172.21.15.49:0/3716178207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9300bf140 con 0x7fb930155d20 2024-01-22T05:21:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.949+0000 7fb926000700 1 -- 172.21.15.49:0/3716178207 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb928007770 con 0x7fb930155d20 2024-01-22T05:21:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.953+0000 7fb926000700 1 --2- 172.21.15.49:0/3716178207 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb90805a4e0 0x7fb90805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.953+0000 7fb926000700 1 -- 172.21.15.49:0/3716178207 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7fb928074420 con 0x7fb930155d20 2024-01-22T05:21:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.953+0000 7fb92e800700 1 --2- 172.21.15.49:0/3716178207 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb90805a4e0 0x7fb90805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.953+0000 7fb92e800700 1 --2- 172.21.15.49:0/3716178207 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb90805a4e0 0x7fb90805c9a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fb920009270 tx=0x7fb920016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:10.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:10.957+0000 7fb926000700 1 -- 172.21.15.49:0/3716178207 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb9300bf140 con 0x7fb930155d20 2024-01-22T05:21:11.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.121+0000 7fb935400700 1 -- 172.21.15.49:0/3716178207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9300a90e0 con 0x7fb930155d20 2024-01-22T05:21:11.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.121+0000 7fb926000700 1 -- 172.21.15.49:0/3716178207 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) v1 ==== 74+0+14217 (secure 0 0 0) 0x7fb9300a90e0 con 0x7fb930155d20 2024-01-22T05:21:11.122 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:21:11.122 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":203,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:21:07.685524+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6837/1689534801":"2024-01-23T05:21:03.939323+0000","172.21.15.49:6835/1689534801":"2024-01-23T05:21:03.939323+0000","172.21.15.49:6837/1585471135":"2024-01-23T05:19:48.627681+0000","172.21.15.49:6835/1585471135":"2024-01-23T05:19:48.627681+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:21:11.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.125+0000 7fb935400700 1 -- 172.21.15.49:0/3716178207 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb90805a4e0 msgr2=0x7fb90805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:11.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.125+0000 7fb935400700 1 --2- 172.21.15.49:0/3716178207 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb90805a4e0 0x7fb90805c9a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fb920009270 tx=0x7fb920016000).stop 2024-01-22T05:21:11.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.125+0000 7fb935400700 1 -- 172.21.15.49:0/3716178207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb930155d20 msgr2=0x7fb9300c5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:11.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.125+0000 7fb935400700 1 --2- 172.21.15.49:0/3716178207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb930155d20 0x7fb9300c5a20 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 rx=0x7fb92800cb90 tx=0x7fb928001740).stop 2024-01-22T05:21:11.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.125+0000 7fb935400700 1 -- 172.21.15.49:0/3716178207 shutdown_connections 2024-01-22T05:21:11.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.125+0000 7fb935400700 1 --2- 172.21.15.49:0/3716178207 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fb90805a4e0 0x7fb90805c9a0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.125+0000 7fb935400700 1 --2- 172.21.15.49:0/3716178207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb930155d20 0x7fb9300c5a20 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.125+0000 7fb935400700 1 --2- 172.21.15.49:0/3716178207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9300a8c30 0x7fb9300a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.125+0000 7fb935400700 1 --2- 172.21.15.49:0/3716178207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb930066070 0x7fb930151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.125+0000 7fb935400700 1 -- 172.21.15.49:0/3716178207 >> 172.21.15.49:0/3716178207 conn(0x7fb9300c6540 msgr2=0x7fb930066e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:11.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.125+0000 7fb935400700 1 -- 172.21.15.49:0/3716178207 shutdown_connections 2024-01-22T05:21:11.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.125+0000 7fb935400700 1 -- 172.21.15.49:0/3716178207 wait complete. 2024-01-22T05:21:11.147 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-22T05:21:11.148 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:21:11.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.321+0000 7f85d7200700 1 Processor -- start 2024-01-22T05:21:11.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.321+0000 7f85d7200700 1 -- start start 2024-01-22T05:21:11.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85d7200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85d0064c00 0x7f85d00bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:11.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85d7200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d00c2700 con 0x7f85d0065240 2024-01-22T05:21:11.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85d7200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d00c29a0 con 0x7f85d0065620 2024-01-22T05:21:11.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85d7200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00c2c80 con 0x7f85d0064c00 2024-01-22T05:21:11.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cfe00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f85d0065240 0x7f85d00644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59750/0 (socket says 172.21.15.49:59750) 2024-01-22T05:21:11.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cfe00700 1 -- 172.21.15.49:0/3397677890 learned_addr learned my addr 172.21.15.49:0/3397677890 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:11.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cf400700 1 --2- 172.21.15.49:0/3397677890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85d0064c00 0x7f85d00bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:11.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422721871 0 0) 0x7f85d00c2700 con 0x7f85d0065240 2024-01-22T05:21:11.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85b00033f0 con 0x7f85d0065240 2024-01-22T05:21:11.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031559897 0 0) 0x7f85d00c29a0 con 0x7f85d0065620 2024-01-22T05:21:11.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d00c2700 con 0x7f85d0065620 2024-01-22T05:21:11.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 520678670 0 0) 0x7f85b00033f0 con 0x7f85d0065240 2024-01-22T05:21:11.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85d0064c00 msgr2=0x7f85d00bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:11.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 --2- 172.21.15.49:0/3397677890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85d0064c00 0x7f85d00bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 >> v1:172.21.15.110:6789/0 conn(0x7f85d0065620 legacy=0x7f85d00bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:11.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d00c2f60 con 0x7f85d0065240 2024-01-22T05:21:11.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f85c0001470 con 0x7f85d0065240 2024-01-22T05:21:11.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 >> v1:172.21.15.49:6789/0 conn(0x7f85d0065240 legacy=0x7f85d00644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:11.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 --2- 172.21.15.49:0/3397677890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85d0064c00 0x7f85b0003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:11.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 --2- 172.21.15.49:0/3397677890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85b0003fb0 0x7f85b0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:11.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 --2- 172.21.15.49:0/3397677890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85b0004b80 0x7f85b0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:11.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00c2c80 con 0x7f85b0004b80 2024-01-22T05:21:11.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b000b990 con 0x7f85b0003fb0 2024-01-22T05:21:11.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.325+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b000bb50 con 0x7f85d0064c00 2024-01-22T05:21:11.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85cfe00700 1 --2- 172.21.15.49:0/3397677890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85d0064c00 0x7f85b0003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:11.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85d5c00700 1 --2- 172.21.15.49:0/3397677890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85b0004b80 0x7f85b0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:11.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85cf400700 1 --2- 172.21.15.49:0/3397677890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85b0003fb0 0x7f85b0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:11.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85cfe00700 1 -- 172.21.15.49:0/3397677890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85b0003fb0 msgr2=0x7f85b0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:11.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85cfe00700 1 --2- 172.21.15.49:0/3397677890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85b0003fb0 0x7f85b0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85cfe00700 1 -- 172.21.15.49:0/3397677890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85b0004b80 msgr2=0x7f85b0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:11.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85cfe00700 1 --2- 172.21.15.49:0/3397677890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85b0004b80 0x7f85b0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85cfe00700 1 -- 172.21.15.49:0/3397677890 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b00033f0 con 0x7f85d0064c00 2024-01-22T05:21:11.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85cf400700 1 --2- 172.21.15.49:0/3397677890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85b0003fb0 0x7f85b0004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:21:11.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85cfe00700 1 --2- 172.21.15.49:0/3397677890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85d0064c00 0x7f85b0003aa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f85c000c190 tx=0x7f85c0001e10).ready entity=mon.2 client_cookie=cd3e2b14240712cc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:11.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c000ca00 con 0x7f85d0064c00 2024-01-22T05:21:11.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c000cb60 con 0x7f85d0064c00 2024-01-22T05:21:11.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85cea00700 1 -- 172.21.15.49:0/3397677890 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00070d0 con 0x7f85d0064c00 2024-01-22T05:21:11.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85d7200700 1 -- 172.21.15.49:0/3397677890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85d0064c00 msgr2=0x7f85b0003aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:11.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85d7200700 1 --2- 172.21.15.49:0/3397677890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85d0064c00 0x7f85b0003aa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f85c000c190 tx=0x7f85c0001e10).stop 2024-01-22T05:21:11.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85d5c00700 1 -- 172.21.15.49:0/3397677890 reap_dead start 2024-01-22T05:21:11.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85d7200700 1 -- 172.21.15.49:0/3397677890 shutdown_connections 2024-01-22T05:21:11.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.329+0000 7f85d7200700 1 -- 172.21.15.49:0/3397677890 >> 172.21.15.49:0/3397677890 conn(0x7f85d00c87f0 msgr2=0x7f85d00c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:11.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.333+0000 7f85d7200700 1 -- 172.21.15.49:0/3397677890 shutdown_connections 2024-01-22T05:21:11.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.333+0000 7f85d7200700 1 -- 172.21.15.49:0/3397677890 wait complete. 2024-01-22T05:21:11.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85d7200700 1 Processor -- start 2024-01-22T05:21:11.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85d7200700 1 -- start start 2024-01-22T05:21:11.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85d7200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85d0064c00 0x7f85d0155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:11.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85d7200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0145f60 0x7f85d00c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:11.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85d7200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85d00bf770 0x7f85d00bfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:11.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85d7200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00a8790 con 0x7f85d0145f60 2024-01-22T05:21:11.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85d7200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00c00e0 con 0x7f85d0064c00 2024-01-22T05:21:11.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85d7200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d01562d0 con 0x7f85d00bf770 2024-01-22T05:21:11.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85cf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0145f60 0x7f85d00c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:11.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85cf400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0145f60 0x7f85d00c1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51060/0 (socket says 172.21.15.49:51060) 2024-01-22T05:21:11.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85cf400700 1 -- 172.21.15.49:0/1023774437 learned_addr learned my addr 172.21.15.49:0/1023774437 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:11.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85d5c00700 1 --2- 172.21.15.49:0/1023774437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85d00bf770 0x7f85d00bfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:11.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85cfe00700 1 --2- 172.21.15.49:0/1023774437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85d0064c00 0x7f85d0155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:11.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85cf400700 1 -- 172.21.15.49:0/1023774437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85d00bf770 msgr2=0x7f85d00bfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:11.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85cf400700 1 --2- 172.21.15.49:0/1023774437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85d00bf770 0x7f85d00bfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85cf400700 1 -- 172.21.15.49:0/1023774437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85d0064c00 msgr2=0x7f85d0155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:11.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85cf400700 1 --2- 172.21.15.49:0/1023774437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85d0064c00 0x7f85d0155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.337+0000 7f85cf400700 1 -- 172.21.15.49:0/1023774437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d01565b0 con 0x7f85d0145f60 2024-01-22T05:21:11.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.341+0000 7f85cf400700 1 --2- 172.21.15.49:0/1023774437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0145f60 0x7f85d00c1ac0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 rx=0x7f85b8011760 tx=0x7f85b8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:11.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.341+0000 7f85c7400700 1 -- 172.21.15.49:0/1023774437 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b8013620 con 0x7f85d0145f60 2024-01-22T05:21:11.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.341+0000 7f85c7400700 1 -- 172.21.15.49:0/1023774437 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b8013780 con 0x7f85d0145f60 2024-01-22T05:21:11.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.341+0000 7f85d7200700 1 -- 172.21.15.49:0/1023774437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d0156890 con 0x7f85d0145f60 2024-01-22T05:21:11.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.341+0000 7f85c7400700 1 -- 172.21.15.49:0/1023774437 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b8013b00 con 0x7f85d0145f60 2024-01-22T05:21:11.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.341+0000 7f85d7200700 1 -- 172.21.15.49:0/1023774437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d00c1fb0 con 0x7f85d0145f60 2024-01-22T05:21:11.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.341+0000 7f85d7200700 1 -- 172.21.15.49:0/1023774437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d0156d10 con 0x7f85d0145f60 2024-01-22T05:21:11.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.341+0000 7f85c7400700 1 -- 172.21.15.49:0/1023774437 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f85b8015480 con 0x7f85d0145f60 2024-01-22T05:21:11.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.345+0000 7f85c7400700 1 --2- 172.21.15.49:0/1023774437 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f85a805a540 0x7f85a805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:11.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.345+0000 7f85c7400700 1 -- 172.21.15.49:0/1023774437 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f85b8074d90 con 0x7f85d0145f60 2024-01-22T05:21:11.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.345+0000 7f85cfe00700 1 --2- 172.21.15.49:0/1023774437 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f85a805a540 0x7f85a805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:11.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.345+0000 7f85cfe00700 1 --2- 172.21.15.49:0/1023774437 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f85a805a540 0x7f85a805ca00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f85c0001e70 tx=0x7f85c0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:11.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.353+0000 7f85c7400700 1 -- 172.21.15.49:0/1023774437 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f85b8048590 con 0x7f85d0145f60 2024-01-22T05:21:11.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.521+0000 7f85d7200700 1 -- 172.21.15.49:0/1023774437 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85d0047060 con 0x7f85a805a540 2024-01-22T05:21:11.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.529+0000 7f85c7400700 1 -- 172.21.15.49:0/1023774437 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68583 (secure 0 0 0) 0x7f85d0047060 con 0x7f85a805a540 2024-01-22T05:21:11.529 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:21:11.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.533+0000 7f85d7200700 1 -- 172.21.15.49:0/1023774437 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f85a805a540 msgr2=0x7f85a805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:11.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.533+0000 7f85d7200700 1 --2- 172.21.15.49:0/1023774437 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f85a805a540 0x7f85a805ca00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f85c0001e70 tx=0x7f85c0015000).stop 2024-01-22T05:21:11.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.533+0000 7f85d7200700 1 -- 172.21.15.49:0/1023774437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0145f60 msgr2=0x7f85d00c1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:11.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.533+0000 7f85d7200700 1 --2- 172.21.15.49:0/1023774437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0145f60 0x7f85d00c1ac0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 rx=0x7f85b8011760 tx=0x7f85b8008040).stop 2024-01-22T05:21:11.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.533+0000 7f85d7200700 1 -- 172.21.15.49:0/1023774437 shutdown_connections 2024-01-22T05:21:11.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.533+0000 7f85d7200700 1 --2- 172.21.15.49:0/1023774437 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f85a805a540 0x7f85a805ca00 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.533+0000 7f85d7200700 1 --2- 172.21.15.49:0/1023774437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85d00bf770 0x7f85d00bfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.533+0000 7f85d7200700 1 --2- 172.21.15.49:0/1023774437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0145f60 0x7f85d00c1ac0 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.533+0000 7f85d7200700 1 --2- 172.21.15.49:0/1023774437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85d0064c00 0x7f85d0155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.533+0000 7f85d7200700 1 -- 172.21.15.49:0/1023774437 >> 172.21.15.49:0/1023774437 conn(0x7f85d00c87f0 msgr2=0x7f85d00ad770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:11.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.533+0000 7f85d7200700 1 -- 172.21.15.49:0/1023774437 shutdown_connections 2024-01-22T05:21:11.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.533+0000 7f85d7200700 1 -- 172.21.15.49:0/1023774437 wait complete. 2024-01-22T05:21:11.536 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:21:11.554 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":697,"stamp":"2024-01-22T05:21:09.605939+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2483724,"kb_used_data":44492,"kb_used_omap":0,"kb_used_meta":2439168,"kb_avail":752490996,"statfs":{"total":773094113280,"available":770550779904,"internally_reserved":0,"allocated":45559808,"data_stored":35398834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2497708032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12620476,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-66,"num_read_kb":-71,"num_write":-91,"num_write_kb":-12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.095826"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":167,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:04.341498+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:21:04.341498+0000","last_peered":"2024-01-22T05:21:04.341498+0000","last_clean":"2024-01-22T05:21:04.341498+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:21:04.341498+0000","last_undegraded":"2024-01-22T05:21:04.341498+0000","last_fullsized":"2024-01-22T05:21:04.341498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:04.346973+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:21:04.346973+0000","last_peered":"2024-01-22T05:21:04.346973+0000","last_clean":"2024-01-22T05:21:04.346973+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:21:04.346973+0000","last_undegraded":"2024-01-22T05:21:04.346973+0000","last_fullsized":"2024-01-22T05:21:04.346973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":159,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-01-22T05:20:30.314505+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:20:30.314505+0000","last_peered":"2024-01-22T05:20:30.314505+0000","last_clean":"2024-01-22T05:20:30.314505+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:20:30.314505+0000","last_undegraded":"2024-01-22T05:20:30.314505+0000","last_fullsized":"2024-01-22T05:20:30.314505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:04.347385+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:21:04.347385+0000","last_peered":"2024-01-22T05:21:04.347385+0000","last_clean":"2024-01-22T05:21:04.347385+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:21:04.347385+0000","last_undegraded":"2024-01-22T05:21:04.347385+0000","last_fullsized":"2024-01-22T05:21:04.347385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":194,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:03.944536+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:21:03.944536+0000","last_peered":"2024-01-22T05:21:03.944536+0000","last_clean":"2024-01-22T05:21:03.944536+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:21:03.944536+0000","last_undegraded":"2024-01-22T05:21:03.944536+0000","last_fullsized":"2024-01-22T05:21:03.944536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:04.349875+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:21:04.349875+0000","last_peered":"2024-01-22T05:21:04.349875+0000","last_clean":"2024-01-22T05:21:04.349875+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:21:04.349875+0000","last_undegraded":"2024-01-22T05:21:04.349875+0000","last_fullsized":"2024-01-22T05:21:04.349875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":159,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-01-22T05:20:30.314680+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:20:30.314680+0000","last_peered":"2024-01-22T05:20:30.314680+0000","last_clean":"2024-01-22T05:20:30.314680+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:20:30.314680+0000","last_undegraded":"2024-01-22T05:20:30.314680+0000","last_fullsized":"2024-01-22T05:20:30.314680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":194,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:03.944340+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:21:03.944340+0000","last_peered":"2024-01-22T05:21:03.944340+0000","last_clean":"2024-01-22T05:21:03.944340+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:21:03.944340+0000","last_undegraded":"2024-01-22T05:21:03.944340+0000","last_fullsized":"2024-01-22T05:21:03.944340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":160,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-01-22T05:20:30.315036+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:20:30.315036+0000","last_peered":"2024-01-22T05:20:30.315036+0000","last_clean":"2024-01-22T05:20:30.315036+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:20:30.315036+0000","last_undegraded":"2024-01-22T05:20:30.315036+0000","last_fullsized":"2024-01-22T05:20:30.315036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575050,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311984,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059856,"statfs":{"total":96636764160,"available":96317292544,"internally_reserved":0,"allocated":2531328,"data_stored":1268073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.194,"15min":1.1040000000000001},"min":{"1min":0.71199999999999997,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.512,"5min":7.3170000000000002,"15min":14.779999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.1519999999999999,"15min":1.3839999999999999},"min":{"1min":0.80700000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.411,"5min":3.7789999999999999,"15min":76.662000000000006},"last":1.373}]},{"osd":1,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.153,"15min":1.0800000000000001},"min":{"1min":0.77400000000000002,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.5089999999999999,"5min":1.657,"15min":4.9269999999999996},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.206,"15min":1.2010000000000001},"min":{"1min":0.78700000000000003,"5min":0.71599999999999997,"15min":0.58999999999999997},"max":{"1min":1.4770000000000001,"5min":3.6040000000000001,"15min":12.691000000000001},"last":1.1699999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1759999999999999,"15min":1.135},"min":{"1min":0.59499999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.482,"5min":2.1589999999999998,"15min":2.5150000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.244,"15min":1.232},"min":{"1min":0.93100000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4550000000000001,"5min":2.633,"15min":15.036},"last":1.2110000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2230000000000001,"15min":1.4470000000000001},"min":{"1min":0.83699999999999997,"5min":0.82399999999999995,"15min":0.69799999999999995},"max":{"1min":1.5409999999999999,"5min":1.752,"15min":64.983999999999995},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.304,"15min":1.3029999999999999},"min":{"1min":1.0349999999999999,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":1.581,"5min":2.2770000000000001,"15min":15.073},"last":1.581}]},{"osd":4,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1859999999999999,"15min":1.1970000000000001},"min":{"1min":0.81399999999999995,"5min":0.53000000000000003,"15min":0.32900000000000001},"max":{"1min":1.4790000000000001,"5min":3.1840000000000002,"15min":22.239000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.228,"15min":1.27},"min":{"1min":0.77100000000000002,"5min":0.66200000000000003,"15min":0.52200000000000002},"max":{"1min":1.488,"5min":1.9830000000000001,"15min":27.872},"last":1.4059999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2629999999999999,"15min":1.456},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.40400000000000003},"max":{"1min":1.5840000000000001,"5min":2.3530000000000002,"15min":65.652000000000001},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.329,"15min":1.2989999999999999},"min":{"1min":0.90800000000000003,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":1.4950000000000001,"5min":2.1539999999999999,"15min":3.625},"last":1.48}]},{"osd":6,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.325,"15min":1.264},"min":{"1min":0.91200000000000003,"5min":0.85299999999999998,"15min":0.53400000000000003},"max":{"1min":1.5669999999999999,"5min":3.3439999999999999,"15min":6.9939999999999998},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.425,"15min":1.421},"min":{"1min":1.01,"5min":0.73299999999999998,"15min":0.56100000000000005},"max":{"1min":1.6100000000000001,"5min":2.246,"15min":12.965},"last":1.5469999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575050,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309952,"kb_used_data":4536,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94061888,"statfs":{"total":96636764160,"available":96319373312,"internally_reserved":0,"allocated":4644864,"data_stored":3372267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.079,"15min":1.2869999999999999},"min":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.35999999999999999},"max":{"1min":1.5409999999999999,"5min":1.927,"15min":77.745000000000005},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.70999999999999996,"5min":0.64500000000000002,"15min":0.44},"max":{"1min":1.4790000000000001,"5min":1.74,"15min":13.555999999999999},"last":0.97899999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1000000000000001,"15min":1.1259999999999999},"min":{"1min":0.73499999999999999,"5min":0.629,"15min":0.40000000000000002},"max":{"1min":1.329,"5min":1.554,"15min":15.499000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.139,"15min":1.1459999999999999},"min":{"1min":0.78400000000000003,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.474,"5min":1.702,"15min":7.7629999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.1990000000000001,"15min":1.169},"min":{"1min":0.95199999999999996,"5min":0.84999999999999998,"15min":0.57399999999999995},"max":{"1min":1.5680000000000001,"5min":1.667,"15min":3.0960000000000001},"last":1.345},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.157,"15min":1.149},"min":{"1min":0.85699999999999998,"5min":0.68999999999999995,"15min":0.38200000000000001},"max":{"1min":1.4590000000000001,"5min":1.7390000000000001,"15min":4.9660000000000002},"last":1.165}]},{"osd":3,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.1950000000000001,"15min":1.4950000000000001},"min":{"1min":1.014,"5min":0.72699999999999998,"15min":0.59299999999999997},"max":{"1min":1.4870000000000001,"5min":2.343,"15min":102.08199999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1819999999999999,"15min":1.2170000000000001},"min":{"1min":0.86299999999999999,"5min":0.81799999999999995,"15min":0.374},"max":{"1min":1.488,"5min":1.5409999999999999,"15min":15.468},"last":1.3089999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.175,"15min":1.155},"min":{"1min":0.76200000000000001,"5min":0.69399999999999995,"15min":0.495},"max":{"1min":1.55,"5min":1.631,"15min":3.1749999999999998},"last":1.48},{"interface":"front","average":{"1min":1.206,"5min":1.21,"15min":1.1699999999999999},"min":{"1min":0.86799999999999999,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.5740000000000001,"5min":2.5489999999999999,"15min":5.1200000000000001},"last":1.4950000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1599999999999999,"15min":1.242},"min":{"1min":0.78600000000000003,"5min":0.65000000000000002,"15min":0.48099999999999998},"max":{"1min":1.617,"5min":1.7829999999999999,"15min":30.533000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2929999999999999,"15min":1.28},"min":{"1min":1.0189999999999999,"5min":0.79500000000000004,"15min":0.46600000000000003},"max":{"1min":1.6439999999999999,"5min":1.8169999999999999,"15min":3.875},"last":1.601}]},{"osd":7,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.3660000000000001,"15min":1.4279999999999999},"min":{"1min":1.0680000000000001,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":1.6539999999999999,"5min":2.7490000000000001,"15min":23.547999999999998},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.3080000000000001,"15min":1.5449999999999999},"min":{"1min":0.93600000000000005,"5min":0.77700000000000002,"15min":0.495},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":63.737000000000002},"last":1.5169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575050,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311988,"kb_used_data":6572,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94059852,"statfs":{"total":96636764160,"available":96317288448,"internally_reserved":0,"allocated":6729728,"data_stored":5462931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0169999999999999,"15min":1.0189999999999999},"min":{"1min":0.73599999999999999,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.534,"5min":1.556,"15min":2.0609999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0649999999999999,"15min":1.038},"min":{"1min":0.86099999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.427,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.82799999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.206,"15min":1.181},"min":{"1min":0.93600000000000005,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.619,"5min":1.744,"15min":2.0310000000000001},"last":1.536},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.224,"15min":1.1919999999999999},"min":{"1min":0.752,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.762,"5min":1.7989999999999999,"15min":2.0209999999999999},"last":1.23}]},{"osd":2,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.169,"15min":1.139},"min":{"1min":0.73999999999999999,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.3899999999999999,"5min":1.8089999999999999,"15min":1.925},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.133,"15min":1.115},"min":{"1min":0.90600000000000003,"5min":0.71799999999999997,"15min":0.59899999999999998},"max":{"1min":1.657,"5min":1.657,"15min":1.982},"last":0.93999999999999995}]},{"osd":3,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2070000000000001,"15min":1.161},"min":{"1min":0.72299999999999998,"5min":0.69799999999999995,"15min":0.66900000000000004},"max":{"1min":1.6599999999999999,"5min":3.202,"15min":3.202},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.212,"15min":1.2030000000000001},"min":{"1min":0.90700000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.544,"5min":1.6830000000000001,"15min":4.8819999999999997},"last":0.88300000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.0980000000000001,"15min":1.0900000000000001},"min":{"1min":0.747,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.718,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.373},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1759999999999999,"15min":1.169},"min":{"1min":0.80000000000000004,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.7,"5min":1.8779999999999999,"15min":2.081},"last":1.603}]},{"osd":6,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.252,"15min":1.2130000000000001},"min":{"1min":0.89700000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.8680000000000001,"5min":2.0099999999999998,"15min":2.2010000000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.232,"15min":1.236},"min":{"1min":1.024,"5min":0.70699999999999996,"15min":0.55900000000000005},"max":{"1min":1.575,"5min":1.927,"15min":2.0779999999999998},"last":1.506}]},{"osd":7,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3140000000000001,"15min":1.2949999999999999},"min":{"1min":0.95799999999999996,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":2.6789999999999998},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.365,"15min":1.327},"min":{"1min":0.83999999999999997,"5min":0.75600000000000001,"15min":0.60799999999999998},"max":{"1min":1.734,"5min":1.8859999999999999,"15min":3.1840000000000002},"last":1.415}]}]},{"osd":4,"up_from":13,"seq":55834575050,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2531328,"data_stored":1268073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1990000000000001,"15min":1.1140000000000001},"min":{"1min":0.88300000000000001,"5min":0.70999999999999996,"15min":0.51500000000000001},"max":{"1min":1.5309999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.23,"15min":1.1719999999999999},"min":{"1min":0.93600000000000005,"5min":0.75700000000000001,"15min":0.48899999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.7470000000000001},"last":1.2649999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1339999999999999,"15min":1.085},"min":{"1min":0.88200000000000001,"5min":0.59899999999999998,"15min":0.53100000000000003},"max":{"1min":1.591,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.147,"15min":1.0640000000000001},"min":{"1min":0.89900000000000002,"5min":0.69199999999999995,"15min":0.46000000000000002},"max":{"1min":1.635,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":1.794}]},{"osd":2,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1060000000000001,"15min":1.0800000000000001},"min":{"1min":0.82199999999999995,"5min":0.66400000000000003,"15min":0.49199999999999999},"max":{"1min":1.456,"5min":1.5800000000000001,"15min":5.3390000000000004},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.1879999999999999,"15min":1.1459999999999999},"min":{"1min":0.98199999999999998,"5min":0.71099999999999997,"15min":0.59199999999999997},"max":{"1min":1.506,"5min":1.621,"15min":1.641},"last":1.6040000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1870000000000001,"15min":1.139},"min":{"1min":0.98499999999999999,"5min":0.69799999999999995,"15min":0.496},"max":{"1min":1.5369999999999999,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.752},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.204,"15min":1.161},"min":{"1min":1.0669999999999999,"5min":0.73899999999999999,"15min":0.53100000000000003},"max":{"1min":1.5069999999999999,"5min":1.647,"15min":5.3029999999999999},"last":1.222}]},{"osd":5,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.1080000000000001,"15min":1.0980000000000001},"min":{"1min":0.77400000000000002,"5min":0.63500000000000001,"15min":0.54100000000000004},"max":{"1min":1.506,"5min":1.581,"15min":1.6970000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1990000000000001,"15min":1.1379999999999999},"min":{"1min":0.877,"5min":0.70099999999999996,"15min":0.52200000000000002},"max":{"1min":1.744,"5min":1.744,"15min":1.8240000000000001},"last":1.0960000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1499999999999999,"15min":1.137},"min":{"1min":0.84599999999999997,"5min":0.67400000000000004,"15min":0.44500000000000001},"max":{"1min":1.5960000000000001,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.341,"5min":1.3,"15min":1.25},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.51900000000000002},"max":{"1min":1.6930000000000001,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":2.1339999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.365,"15min":1.3140000000000001},"min":{"1min":1.109,"5min":0.74099999999999999,"15min":0.59399999999999997},"max":{"1min":1.7709999999999999,"5min":1.7949999999999999,"15min":1.9119999999999999},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3360000000000001,"15min":1.3129999999999999},"min":{"1min":0.84199999999999997,"5min":0.74199999999999999,"15min":0.56899999999999995},"max":{"1min":1.873,"5min":1.873,"15min":5.2629999999999999},"last":1.373}]}]},{"osd":3,"up_from":13,"seq":55834575050,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307896,"kb_used_data":6576,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94063944,"statfs":{"total":96636764160,"available":96321478656,"internally_reserved":0,"allocated":6733824,"data_stored":5463021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82399999999999995,"15min":0.85599999999999998},"min":{"1min":0.59399999999999997,"5min":0.47899999999999998,"15min":0.34200000000000003},"max":{"1min":1.4590000000000001,"5min":1.512,"15min":14.859},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.89600000000000002,"15min":0.90800000000000003},"min":{"1min":0.64400000000000002,"5min":0.42699999999999999,"15min":0.317},"max":{"1min":1.1140000000000001,"5min":1.724,"15min":5.0919999999999996},"last":0.90600000000000003}]},{"osd":1,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91600000000000004,"15min":0.90700000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.39300000000000002},"max":{"1min":1.4450000000000001,"5min":1.5860000000000001,"15min":6.5570000000000004},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.97199999999999998,"15min":0.97099999999999997},"min":{"1min":0.63800000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4339999999999999,"5min":1.482,"15min":5.7519999999999998},"last":1.417}]},{"osd":2,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1160000000000001,"15min":1.1040000000000001},"min":{"1min":0.91900000000000004,"5min":0.48699999999999999,"15min":0.40600000000000003},"max":{"1min":1.4510000000000001,"5min":1.7350000000000001,"15min":2.391},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.1899999999999999,"15min":1.1839999999999999},"min":{"1min":0.92100000000000004,"5min":0.60699999999999998,"15min":0.44800000000000001},"max":{"1min":1.641,"5min":1.768,"15min":4.1429999999999998},"last":1.3580000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.339,"15min":1.343},"min":{"1min":0.88700000000000001,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.6240000000000001,"5min":2.157,"15min":10.858000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.325,"15min":1.343},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.63600000000000001},"max":{"1min":1.6359999999999999,"5min":1.7769999999999999,"15min":10.846},"last":1.552}]},{"osd":5,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.262,"15min":1.2809999999999999},"min":{"1min":0.83399999999999996,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.6459999999999999,"5min":1.6739999999999999,"15min":7.3639999999999999},"last":1.246},{"interface":"front","average":{"1min":1.268,"5min":1.28,"15min":1.3819999999999999},"min":{"1min":0.91700000000000004,"5min":0.85599999999999998,"15min":0.71199999999999997},"max":{"1min":1.603,"5min":1.796,"15min":14.523999999999999},"last":1.159}]},{"osd":6,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3640000000000001,"15min":1.349},"min":{"1min":1.018,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.591,"5min":2.2570000000000001,"15min":4.9809999999999999},"last":1.462},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4019999999999999,"15min":1.3919999999999999},"min":{"1min":0.93600000000000005,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.754,"5min":1.8700000000000001,"15min":5.4210000000000003},"last":1.484}]},{"osd":7,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3360000000000001,"15min":1.3580000000000001},"min":{"1min":1.01,"5min":0.90800000000000003,"15min":0.72799999999999998},"max":{"1min":1.681,"5min":2.004,"15min":5.7160000000000002},"last":1.522},{"interface":"front","average":{"1min":1.365,"5min":1.399,"15min":1.4079999999999999},"min":{"1min":0.95799999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6930000000000001,"5min":2.4449999999999998,"15min":6.4279999999999999},"last":1.319}]}]},{"osd":2,"up_from":13,"seq":55834575050,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307940,"kb_used_data":10716,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94063900,"statfs":{"total":96636764160,"available":96321433600,"internally_reserved":0,"allocated":10973184,"data_stored":9693531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.82299999999999995,"15min":0.78000000000000003},"min":{"1min":0.64600000000000002,"5min":0.432,"15min":0.378},"max":{"1min":1.135,"5min":1.373,"15min":1.7270000000000001},"last":0.879},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.89200000000000002,"15min":0.86799999999999999},"min":{"1min":0.68400000000000005,"5min":0.45300000000000001,"15min":0.373},"max":{"1min":1.417,"5min":1.417,"15min":1.7350000000000001},"last":1.821}]},{"osd":1,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94699999999999995,"15min":0.89000000000000001},"min":{"1min":0.69399999999999995,"5min":0.55400000000000005,"15min":0.41299999999999998},"max":{"1min":1.3879999999999999,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.032,"15min":0.96799999999999997},"min":{"1min":0.79100000000000004,"5min":0.47899999999999998,"15min":0.41599999999999998},"max":{"1min":1.5780000000000001,"5min":1.671,"15min":2.8849999999999998},"last":0.97099999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.1779999999999999,"15min":1.1499999999999999},"min":{"1min":0.68300000000000005,"5min":0.66700000000000004,"15min":0.47099999999999997},"max":{"1min":1.633,"5min":2.3090000000000002,"15min":3.0990000000000002},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.2470000000000001,"15min":1.22},"min":{"1min":0.86899999999999999,"5min":0.76000000000000001,"15min":0.51100000000000001},"max":{"1min":1.6180000000000001,"5min":1.8340000000000001,"15min":3.133},"last":1.073}]},{"osd":4,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.3560000000000001,"15min":1.282},"min":{"1min":1.1930000000000001,"5min":0.90400000000000003,"15min":0.59099999999999997},"max":{"1min":1.746,"5min":2.101,"15min":3.0129999999999999},"last":1.218},{"interface":"front","average":{"1min":1.319,"5min":1.244,"15min":1.206},"min":{"1min":1.052,"5min":0.71699999999999997,"15min":0.52100000000000002},"max":{"1min":1.6299999999999999,"5min":1.9970000000000001,"15min":2.2829999999999999},"last":1.726}]},{"osd":5,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.276,"15min":1.236},"min":{"1min":0.91900000000000004,"5min":0.84099999999999997,"15min":0.63800000000000001},"max":{"1min":1.5329999999999999,"5min":2.379,"15min":2.379},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.371,"5min":1.3480000000000001,"15min":1.292},"min":{"1min":1.216,"5min":0.84799999999999998,"15min":0.67000000000000004},"max":{"1min":1.5620000000000001,"5min":2.1880000000000002,"15min":3.0910000000000002},"last":1.333}]},{"osd":6,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2689999999999999,"15min":1.252},"min":{"1min":0.96399999999999997,"5min":0.79500000000000004,"15min":0.61799999999999999},"max":{"1min":1.5469999999999999,"5min":1.9119999999999999,"15min":2.1389999999999998},"last":2.0449999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3839999999999999,"15min":1.321},"min":{"1min":0.95999999999999996,"5min":0.91100000000000003,"15min":0.629},"max":{"1min":1.6859999999999999,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.605}]},{"osd":7,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3759999999999999,"15min":1.3460000000000001},"min":{"1min":1.0860000000000001,"5min":0.88500000000000001,"15min":0.75900000000000001},"max":{"1min":1.7549999999999999,"5min":1.8200000000000001,"15min":2.1749999999999998},"last":1.9299999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.47,"15min":1.425},"min":{"1min":1.109,"5min":0.89700000000000002,"15min":0.79000000000000004},"max":{"1min":1.7170000000000001,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.52}]}]},{"osd":1,"up_from":13,"seq":55834575051,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314048,"kb_used_data":4536,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94057792,"statfs":{"total":96636764160,"available":96315179008,"internally_reserved":0,"allocated":4644864,"data_stored":3372267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.85499999999999998,"15min":0.873},"min":{"1min":0.67300000000000004,"5min":0.36699999999999999,"15min":0.36199999999999999},"max":{"1min":1.3149999999999999,"5min":1.4830000000000001,"15min":3.4119999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.024,"15min":1.0029999999999999},"min":{"1min":0.73999999999999999,"5min":0.504,"15min":0.41099999999999998},"max":{"1min":1.3700000000000001,"5min":1.6160000000000001,"15min":2.101},"last":0.78100000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.97799999999999998,"15min":0.98899999999999999},"min":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.45500000000000002},"max":{"1min":1.393,"5min":1.556,"15min":2.169},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.0860000000000001,"15min":1.0660000000000001},"min":{"1min":0.89300000000000002,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.611,"5min":1.611,"15min":2.024},"last":1.276}]},{"osd":3,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0609999999999999,"15min":1.05},"min":{"1min":0.83299999999999996,"5min":0.57399999999999995,"15min":0.38900000000000001},"max":{"1min":1.4790000000000001,"5min":1.972,"15min":4.665},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.90700000000000003,"15min":0.94899999999999995},"min":{"1min":0.71199999999999997,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.5129999999999999,"5min":1.659,"15min":5.5830000000000002},"last":1.2989999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.236,"15min":1.2589999999999999},"min":{"1min":1.0649999999999999,"5min":0.83699999999999997,"15min":0.57899999999999996},"max":{"1min":1.6779999999999999,"5min":1.7769999999999999,"15min":15.76},"last":1.262},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3129999999999999,"15min":1.345},"min":{"1min":1.1240000000000001,"5min":0.90400000000000003,"15min":0.63500000000000001},"max":{"1min":1.5629999999999999,"5min":1.673,"15min":16.975000000000001},"last":0.96499999999999997}]},{"osd":5,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.252,"15min":1.238},"min":{"1min":0.81200000000000006,"5min":0.72599999999999998,"15min":0.55700000000000005},"max":{"1min":1.4370000000000001,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.163},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2889999999999999,"15min":1.286},"min":{"1min":1.0609999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5900000000000001,"5min":1.879,"15min":2.52},"last":1.329}]},{"osd":6,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2989999999999999,"15min":1.266},"min":{"1min":1.0529999999999999,"5min":0.77400000000000002,"15min":0.55600000000000005},"max":{"1min":1.5249999999999999,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.379},{"interface":"front","average":{"1min":1.403,"5min":1.3140000000000001,"15min":1.331},"min":{"1min":1.133,"5min":0.76200000000000001,"15min":0.68799999999999994},"max":{"1min":1.6439999999999999,"5min":2.008,"15min":2.5569999999999999},"last":1.395}]},{"osd":7,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.3680000000000001,"15min":1.3560000000000001},"min":{"1min":1.181,"5min":0.77200000000000002,"15min":0.68100000000000005},"max":{"1min":1.7170000000000001,"5min":1.835,"15min":4.4329999999999998},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.363,"15min":1.351},"min":{"1min":1.044,"5min":0.81100000000000005,"15min":0.64900000000000002},"max":{"1min":1.619,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":1.4279999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575050,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316124,"kb_used_data":6612,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94055716,"statfs":{"total":96636764160,"available":96313053184,"internally_reserved":0,"allocated":6770688,"data_stored":5498671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80900000000000005,"15min":0.872},"min":{"1min":0.69299999999999995,"5min":0.39600000000000002,"15min":0.28699999999999998},"max":{"1min":1.206,"5min":1.361,"15min":15.273},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.92300000000000004,"15min":0.90800000000000003},"min":{"1min":0.76600000000000001,"5min":0.48899999999999999,"15min":0.34499999999999997},"max":{"1min":1.2150000000000001,"5min":1.625,"15min":4.4009999999999998},"last":0.71299999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98799999999999999,"15min":1.0329999999999999},"min":{"1min":0.85999999999999999,"5min":0.60299999999999998,"15min":0.46400000000000002},"max":{"1min":1.4219999999999999,"5min":1.6299999999999999,"15min":15.473000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.1299999999999999,"15min":1.0509999999999999},"min":{"1min":0.95199999999999996,"5min":0.67400000000000004,"15min":0.42699999999999999},"max":{"1min":1.482,"5min":1.7070000000000001,"15min":1.7989999999999999},"last":0.99199999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0229999999999999,"15min":0.98299999999999998},"min":{"1min":0.85399999999999998,"5min":0.50600000000000001,"15min":0.39000000000000001},"max":{"1min":1.643,"5min":1.8959999999999999,"15min":5.3970000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.1639999999999999,"15min":1.1779999999999999},"min":{"1min":1.0429999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.5740000000000001,"5min":2.863,"15min":15.439},"last":1.3049999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.286,"15min":1.236},"min":{"1min":1.1879999999999999,"5min":0.81999999999999995,"15min":0.61399999999999999},"max":{"1min":1.669,"5min":1.7949999999999999,"15min":2.1280000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.2609999999999999,"15min":1.22},"min":{"1min":0.88600000000000001,"5min":0.70199999999999996,"15min":0.56200000000000006},"max":{"1min":1.6990000000000001,"5min":1.706,"15min":3.4340000000000002},"last":0.93000000000000005}]},{"osd":5,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.302,"15min":1.26},"min":{"1min":1.0369999999999999,"5min":0.79000000000000004,"15min":0.67600000000000005},"max":{"1min":1.524,"5min":1.802,"15min":2.891},"last":1.143},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.321,"15min":1.3100000000000001},"min":{"1min":1.179,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.881,"5min":1.881,"15min":2.823},"last":1.393}]},{"osd":6,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.373,"15min":1.4039999999999999},"min":{"1min":1.2390000000000001,"5min":0.879,"15min":0.59099999999999997},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":15.4},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.3819999999999999,"15min":1.357},"min":{"1min":1.244,"5min":0.80500000000000005,"15min":0.72499999999999998},"max":{"1min":1.774,"5min":1.8919999999999999,"15min":7.1349999999999998},"last":1.2789999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.4450000000000001,"15min":1.3959999999999999},"min":{"1min":1.1819999999999999,"5min":0.86899999999999999,"15min":0.79900000000000004},"max":{"1min":1.8109999999999999,"5min":2.145,"15min":2.1819999999999999},"last":1.331},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.419,"15min":1.3660000000000001},"min":{"1min":1.2829999999999999,"5min":0.76600000000000001,"15min":0.752},"max":{"1min":1.9379999999999999,"5min":2.0470000000000002,"15min":2.7269999999999999},"last":1.0980000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:21:11.556 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:21:11.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.721+0000 7f10f9a00700 1 Processor -- start 2024-01-22T05:21:11.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.721+0000 7f10f9a00700 1 -- start start 2024-01-22T05:21:11.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f9a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f10f40bcc50 0x7f10f40bd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:11.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f9a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f10f40a8740 0x7f10f40a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:11.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f9a00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f40bc4d0 con 0x7f10f41544a0 2024-01-22T05:21:11.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f9a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f40bc960 con 0x7f10f40a8740 2024-01-22T05:21:11.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f9a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f40a9070 con 0x7f10f40bcc50 2024-01-22T05:21:11.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f2a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f10f40bcc50 0x7f10f40bd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:11.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f2000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f10f40a8740 0x7f10f40a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:11.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f2a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f10f40bcc50 0x7f10f40bd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:35906/0 (socket says 172.21.15.49:35906) 2024-01-22T05:21:11.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f2a00700 1 -- 172.21.15.49:0/375143742 learned_addr learned my addr 172.21.15.49:0/375143742 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:11.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f2a00700 1 -- 172.21.15.49:0/375143742 >> v2:172.21.15.49:3300/0 conn(0x7f10f40a8740 msgr2=0x7f10f40a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:11.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f2a00700 1 --2- 172.21.15.49:0/375143742 >> v2:172.21.15.49:3300/0 conn(0x7f10f40a8740 0x7f10f40a8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f2a00700 1 -- 172.21.15.49:0/375143742 >> v1:172.21.15.49:6789/0 conn(0x7f10f41544a0 legacy=0x7f10f4154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:11.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f2a00700 1 -- 172.21.15.49:0/375143742 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f40bb8c0 con 0x7f10f40bcc50 2024-01-22T05:21:11.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f2000700 1 --2- 172.21.15.49:0/375143742 >> v2:172.21.15.49:3300/0 conn(0x7f10f40a8740 0x7f10f40a8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:21:11.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f2a00700 1 --2- 172.21.15.49:0/375143742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10f40bcc50 0x7f10f40bd030 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f10f40694a0 tx=0x7f10e40090f0).ready entity=mon.1 client_cookie=12845fe01753ab65 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:11.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f1600700 1 -- 172.21.15.49:0/375143742 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e400b520 con 0x7f10f40bcc50 2024-01-22T05:21:11.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f1600700 1 -- 172.21.15.49:0/375143742 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e400b680 con 0x7f10f40bcc50 2024-01-22T05:21:11.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f1600700 1 -- 172.21.15.49:0/375143742 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e400ba00 con 0x7f10f40bcc50 2024-01-22T05:21:11.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f9a00700 1 -- 172.21.15.49:0/375143742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10f40bcc50 msgr2=0x7f10f40bd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:11.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.725+0000 7f10f9a00700 1 --2- 172.21.15.49:0/375143742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10f40bcc50 0x7f10f40bd030 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f10f40694a0 tx=0x7f10e40090f0).stop 2024-01-22T05:21:11.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.729+0000 7f10f9a00700 1 -- 172.21.15.49:0/375143742 shutdown_connections 2024-01-22T05:21:11.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.729+0000 7f10f9a00700 1 --2- 172.21.15.49:0/375143742 >> v2:172.21.15.49:3300/0 conn(0x7f10f40a8740 0x7f10f40a8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.729+0000 7f10f9a00700 1 --2- 172.21.15.49:0/375143742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10f40bcc50 0x7f10f40bd030 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.729+0000 7f10f9a00700 1 -- 172.21.15.49:0/375143742 >> 172.21.15.49:0/375143742 conn(0x7f10f40c6540 msgr2=0x7f10f40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:11.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.729+0000 7f10f9a00700 1 -- 172.21.15.49:0/375143742 shutdown_connections 2024-01-22T05:21:11.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.729+0000 7f10f9a00700 1 -- 172.21.15.49:0/375143742 wait complete. 2024-01-22T05:21:11.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.729+0000 7f10f9a00700 1 Processor -- start 2024-01-22T05:21:11.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.729+0000 7f10f9a00700 1 -- start start 2024-01-22T05:21:11.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f9a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10f40a8740 0x7f10f414ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:11.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f9a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10f40bcc50 0x7f10f4165830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:11.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f9a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f41544a0 0x7f10f4165d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:11.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f9a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f40a8550 con 0x7f10f41544a0 2024-01-22T05:21:11.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f9a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f409f930 con 0x7f10f40bcc50 2024-01-22T05:21:11.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f9a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f409fef0 con 0x7f10f40a8740 2024-01-22T05:21:11.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f41544a0 0x7f10f4165d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:11.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f3400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f41544a0 0x7f10f4165d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51084/0 (socket says 172.21.15.49:51084) 2024-01-22T05:21:11.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f3400700 1 -- 172.21.15.49:0/2765433025 learned_addr learned my addr 172.21.15.49:0/2765433025 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:11.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f2000700 1 --2- 172.21.15.49:0/2765433025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10f40bcc50 0x7f10f4165830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:11.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f2a00700 1 --2- 172.21.15.49:0/2765433025 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10f40a8740 0x7f10f414ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:11.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f3400700 1 -- 172.21.15.49:0/2765433025 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10f40a8740 msgr2=0x7f10f414ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:11.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f3400700 1 --2- 172.21.15.49:0/2765433025 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10f40a8740 0x7f10f414ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f3400700 1 -- 172.21.15.49:0/2765433025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10f40bcc50 msgr2=0x7f10f4165830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:11.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f3400700 1 --2- 172.21.15.49:0/2765433025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10f40bcc50 0x7f10f4165830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f3400700 1 -- 172.21.15.49:0/2765433025 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc0092a0 con 0x7f10f41544a0 2024-01-22T05:21:11.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f3400700 1 --2- 172.21.15.49:0/2765433025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f41544a0 0x7f10f4165d20 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 rx=0x7f10ec00c790 tx=0x7f10ec0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:11.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10ea000700 1 -- 172.21.15.49:0/2765433025 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec010510 con 0x7f10f41544a0 2024-01-22T05:21:11.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10ea000700 1 -- 172.21.15.49:0/2765433025 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec010670 con 0x7f10f41544a0 2024-01-22T05:21:11.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10ea000700 1 -- 172.21.15.49:0/2765433025 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0109f0 con 0x7f10f41544a0 2024-01-22T05:21:11.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f9a00700 1 -- 172.21.15.49:0/2765433025 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e4009370 con 0x7f10f41544a0 2024-01-22T05:21:11.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.733+0000 7f10f9a00700 1 -- 172.21.15.49:0/2765433025 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f4166590 con 0x7f10f41544a0 2024-01-22T05:21:11.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.737+0000 7f10f9a00700 1 -- 172.21.15.49:0/2765433025 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f40a0060 con 0x7f10f41544a0 2024-01-22T05:21:11.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.737+0000 7f10ea000700 1 -- 172.21.15.49:0/2765433025 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f10ec01b400 con 0x7f10f41544a0 2024-01-22T05:21:11.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.737+0000 7f10ea000700 1 --2- 172.21.15.49:0/2765433025 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f10cc05a4e0 0x7f10cc05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:11.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.737+0000 7f10ea000700 1 -- 172.21.15.49:0/2765433025 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f10ec074540 con 0x7f10f41544a0 2024-01-22T05:21:11.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.737+0000 7f10f2a00700 1 --2- 172.21.15.49:0/2765433025 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f10cc05a4e0 0x7f10cc05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:11.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.737+0000 7f10f2a00700 1 --2- 172.21.15.49:0/2765433025 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f10cc05a4e0 0x7f10cc05c9a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f10e4009130 tx=0x7f10e4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:11.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.741+0000 7f10ea000700 1 -- 172.21.15.49:0/2765433025 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f10ec047e00 con 0x7f10f41544a0 2024-01-22T05:21:11.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.901+0000 7f10f9a00700 1 -- 172.21.15.49:0/2765433025 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10f40bbba0 con 0x7f10cc05a4e0 2024-01-22T05:21:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.905+0000 7f10ea000700 1 -- 172.21.15.49:0/2765433025 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68583 (secure 0 0 0) 0x7f10f40bbba0 con 0x7f10cc05a4e0 2024-01-22T05:21:11.907 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:21:11.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.909+0000 7f10f9a00700 1 -- 172.21.15.49:0/2765433025 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f10cc05a4e0 msgr2=0x7f10cc05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:11.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.909+0000 7f10f9a00700 1 --2- 172.21.15.49:0/2765433025 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f10cc05a4e0 0x7f10cc05c9a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f10e4009130 tx=0x7f10e4017000).stop 2024-01-22T05:21:11.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.909+0000 7f10f9a00700 1 -- 172.21.15.49:0/2765433025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f41544a0 msgr2=0x7f10f4165d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.909+0000 7f10f9a00700 1 --2- 172.21.15.49:0/2765433025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f41544a0 0x7f10f4165d20 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 rx=0x7f10ec00c790 tx=0x7f10ec0015e0).stop 2024-01-22T05:21:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.909+0000 7f10f9a00700 1 -- 172.21.15.49:0/2765433025 shutdown_connections 2024-01-22T05:21:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.909+0000 7f10f9a00700 1 --2- 172.21.15.49:0/2765433025 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f10cc05a4e0 0x7f10cc05c9a0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.909+0000 7f10f9a00700 1 --2- 172.21.15.49:0/2765433025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f41544a0 0x7f10f4165d20 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.909+0000 7f10f9a00700 1 --2- 172.21.15.49:0/2765433025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10f40bcc50 0x7f10f4165830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.909+0000 7f10f9a00700 1 --2- 172.21.15.49:0/2765433025 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10f40a8740 0x7f10f414ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.909+0000 7f10f9a00700 1 -- 172.21.15.49:0/2765433025 >> 172.21.15.49:0/2765433025 conn(0x7f10f40c6540 msgr2=0x7f10f40bf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.909+0000 7f10f9a00700 1 -- 172.21.15.49:0/2765433025 shutdown_connections 2024-01-22T05:21:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:11.909+0000 7f10f9a00700 1 -- 172.21.15.49:0/2765433025 wait complete. 2024-01-22T05:21:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:21:11.932 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":698,"stamp":"2024-01-22T05:21:11.606411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2483724,"kb_used_data":44492,"kb_used_omap":0,"kb_used_meta":2439168,"kb_avail":752490996,"statfs":{"total":773094113280,"available":770550779904,"internally_reserved":0,"allocated":45559808,"data_stored":35398834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2497708032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12620476,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-66,"num_read_kb":-71,"num_write":-91,"num_write_kb":-12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.095826"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":167,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:04.341498+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:21:04.341498+0000","last_peered":"2024-01-22T05:21:04.341498+0000","last_clean":"2024-01-22T05:21:04.341498+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:21:04.341498+0000","last_undegraded":"2024-01-22T05:21:04.341498+0000","last_fullsized":"2024-01-22T05:21:04.341498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:04.346973+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:21:04.346973+0000","last_peered":"2024-01-22T05:21:04.346973+0000","last_clean":"2024-01-22T05:21:04.346973+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:21:04.346973+0000","last_undegraded":"2024-01-22T05:21:04.346973+0000","last_fullsized":"2024-01-22T05:21:04.346973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":159,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-01-22T05:20:30.314505+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:20:30.314505+0000","last_peered":"2024-01-22T05:20:30.314505+0000","last_clean":"2024-01-22T05:20:30.314505+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:20:30.314505+0000","last_undegraded":"2024-01-22T05:20:30.314505+0000","last_fullsized":"2024-01-22T05:20:30.314505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:04.347385+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:21:04.347385+0000","last_peered":"2024-01-22T05:21:04.347385+0000","last_clean":"2024-01-22T05:21:04.347385+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:21:04.347385+0000","last_undegraded":"2024-01-22T05:21:04.347385+0000","last_fullsized":"2024-01-22T05:21:04.347385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":194,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:03.944536+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:21:03.944536+0000","last_peered":"2024-01-22T05:21:03.944536+0000","last_clean":"2024-01-22T05:21:03.944536+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:21:03.944536+0000","last_undegraded":"2024-01-22T05:21:03.944536+0000","last_fullsized":"2024-01-22T05:21:03.944536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:04.349875+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:21:04.349875+0000","last_peered":"2024-01-22T05:21:04.349875+0000","last_clean":"2024-01-22T05:21:04.349875+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:21:04.349875+0000","last_undegraded":"2024-01-22T05:21:04.349875+0000","last_fullsized":"2024-01-22T05:21:04.349875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":159,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-01-22T05:20:30.314680+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:20:30.314680+0000","last_peered":"2024-01-22T05:20:30.314680+0000","last_clean":"2024-01-22T05:20:30.314680+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:20:30.314680+0000","last_undegraded":"2024-01-22T05:20:30.314680+0000","last_fullsized":"2024-01-22T05:20:30.314680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":194,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:03.944340+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:21:03.944340+0000","last_peered":"2024-01-22T05:21:03.944340+0000","last_clean":"2024-01-22T05:21:03.944340+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:21:03.944340+0000","last_undegraded":"2024-01-22T05:21:03.944340+0000","last_fullsized":"2024-01-22T05:21:03.944340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":160,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-01-22T05:20:30.315036+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:20:30.315036+0000","last_peered":"2024-01-22T05:20:30.315036+0000","last_clean":"2024-01-22T05:20:30.315036+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:20:30.315036+0000","last_undegraded":"2024-01-22T05:20:30.315036+0000","last_fullsized":"2024-01-22T05:20:30.315036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575050,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311984,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059856,"statfs":{"total":96636764160,"available":96317292544,"internally_reserved":0,"allocated":2531328,"data_stored":1268073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.194,"15min":1.1040000000000001},"min":{"1min":0.71199999999999997,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.512,"5min":7.3170000000000002,"15min":14.779999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.1519999999999999,"15min":1.3839999999999999},"min":{"1min":0.80700000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.411,"5min":3.7789999999999999,"15min":76.662000000000006},"last":1.373}]},{"osd":1,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.153,"15min":1.0800000000000001},"min":{"1min":0.77400000000000002,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.5089999999999999,"5min":1.657,"15min":4.9269999999999996},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.206,"15min":1.2010000000000001},"min":{"1min":0.78700000000000003,"5min":0.71599999999999997,"15min":0.58999999999999997},"max":{"1min":1.4770000000000001,"5min":3.6040000000000001,"15min":12.691000000000001},"last":1.1699999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1759999999999999,"15min":1.135},"min":{"1min":0.59499999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.482,"5min":2.1589999999999998,"15min":2.5150000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.244,"15min":1.232},"min":{"1min":0.93100000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4550000000000001,"5min":2.633,"15min":15.036},"last":1.2110000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2230000000000001,"15min":1.4470000000000001},"min":{"1min":0.83699999999999997,"5min":0.82399999999999995,"15min":0.69799999999999995},"max":{"1min":1.5409999999999999,"5min":1.752,"15min":64.983999999999995},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.304,"15min":1.3029999999999999},"min":{"1min":1.0349999999999999,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":1.581,"5min":2.2770000000000001,"15min":15.073},"last":1.581}]},{"osd":4,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1859999999999999,"15min":1.1970000000000001},"min":{"1min":0.81399999999999995,"5min":0.53000000000000003,"15min":0.32900000000000001},"max":{"1min":1.4790000000000001,"5min":3.1840000000000002,"15min":22.239000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.228,"15min":1.27},"min":{"1min":0.77100000000000002,"5min":0.66200000000000003,"15min":0.52200000000000002},"max":{"1min":1.488,"5min":1.9830000000000001,"15min":27.872},"last":1.4059999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2629999999999999,"15min":1.456},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.40400000000000003},"max":{"1min":1.5840000000000001,"5min":2.3530000000000002,"15min":65.652000000000001},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.329,"15min":1.2989999999999999},"min":{"1min":0.90800000000000003,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":1.4950000000000001,"5min":2.1539999999999999,"15min":3.625},"last":1.48}]},{"osd":6,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.325,"15min":1.264},"min":{"1min":0.91200000000000003,"5min":0.85299999999999998,"15min":0.53400000000000003},"max":{"1min":1.5669999999999999,"5min":3.3439999999999999,"15min":6.9939999999999998},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.425,"15min":1.421},"min":{"1min":1.01,"5min":0.73299999999999998,"15min":0.56100000000000005},"max":{"1min":1.6100000000000001,"5min":2.246,"15min":12.965},"last":1.5469999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575050,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309952,"kb_used_data":4536,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94061888,"statfs":{"total":96636764160,"available":96319373312,"internally_reserved":0,"allocated":4644864,"data_stored":3372267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.079,"15min":1.2869999999999999},"min":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.35999999999999999},"max":{"1min":1.5409999999999999,"5min":1.927,"15min":77.745000000000005},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.70999999999999996,"5min":0.64500000000000002,"15min":0.44},"max":{"1min":1.4790000000000001,"5min":1.74,"15min":13.555999999999999},"last":0.97899999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1000000000000001,"15min":1.1259999999999999},"min":{"1min":0.73499999999999999,"5min":0.629,"15min":0.40000000000000002},"max":{"1min":1.329,"5min":1.554,"15min":15.499000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.139,"15min":1.1459999999999999},"min":{"1min":0.78400000000000003,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.474,"5min":1.702,"15min":7.7629999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.1990000000000001,"15min":1.169},"min":{"1min":0.95199999999999996,"5min":0.84999999999999998,"15min":0.57399999999999995},"max":{"1min":1.5680000000000001,"5min":1.667,"15min":3.0960000000000001},"last":1.345},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.157,"15min":1.149},"min":{"1min":0.85699999999999998,"5min":0.68999999999999995,"15min":0.38200000000000001},"max":{"1min":1.4590000000000001,"5min":1.7390000000000001,"15min":4.9660000000000002},"last":1.165}]},{"osd":3,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.1950000000000001,"15min":1.4950000000000001},"min":{"1min":1.014,"5min":0.72699999999999998,"15min":0.59299999999999997},"max":{"1min":1.4870000000000001,"5min":2.343,"15min":102.08199999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1819999999999999,"15min":1.2170000000000001},"min":{"1min":0.86299999999999999,"5min":0.81799999999999995,"15min":0.374},"max":{"1min":1.488,"5min":1.5409999999999999,"15min":15.468},"last":1.3089999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.175,"15min":1.155},"min":{"1min":0.76200000000000001,"5min":0.69399999999999995,"15min":0.495},"max":{"1min":1.55,"5min":1.631,"15min":3.1749999999999998},"last":1.48},{"interface":"front","average":{"1min":1.206,"5min":1.21,"15min":1.1699999999999999},"min":{"1min":0.86799999999999999,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.5740000000000001,"5min":2.5489999999999999,"15min":5.1200000000000001},"last":1.4950000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1599999999999999,"15min":1.242},"min":{"1min":0.78600000000000003,"5min":0.65000000000000002,"15min":0.48099999999999998},"max":{"1min":1.617,"5min":1.7829999999999999,"15min":30.533000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2929999999999999,"15min":1.28},"min":{"1min":1.0189999999999999,"5min":0.79500000000000004,"15min":0.46600000000000003},"max":{"1min":1.6439999999999999,"5min":1.8169999999999999,"15min":3.875},"last":1.601}]},{"osd":7,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.3660000000000001,"15min":1.4279999999999999},"min":{"1min":1.0680000000000001,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":1.6539999999999999,"5min":2.7490000000000001,"15min":23.547999999999998},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.3080000000000001,"15min":1.5449999999999999},"min":{"1min":0.93600000000000005,"5min":0.77700000000000002,"15min":0.495},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":63.737000000000002},"last":1.5169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575050,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311988,"kb_used_data":6572,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94059852,"statfs":{"total":96636764160,"available":96317288448,"internally_reserved":0,"allocated":6729728,"data_stored":5462931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0169999999999999,"15min":1.0189999999999999},"min":{"1min":0.73599999999999999,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.534,"5min":1.556,"15min":2.0609999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0649999999999999,"15min":1.038},"min":{"1min":0.86099999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.427,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.82799999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.206,"15min":1.181},"min":{"1min":0.93600000000000005,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.619,"5min":1.744,"15min":2.0310000000000001},"last":1.536},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.224,"15min":1.1919999999999999},"min":{"1min":0.752,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.762,"5min":1.7989999999999999,"15min":2.0209999999999999},"last":1.23}]},{"osd":2,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.169,"15min":1.139},"min":{"1min":0.73999999999999999,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.3899999999999999,"5min":1.8089999999999999,"15min":1.925},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.133,"15min":1.115},"min":{"1min":0.90600000000000003,"5min":0.71799999999999997,"15min":0.59899999999999998},"max":{"1min":1.657,"5min":1.657,"15min":1.982},"last":0.93999999999999995}]},{"osd":3,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2070000000000001,"15min":1.161},"min":{"1min":0.72299999999999998,"5min":0.69799999999999995,"15min":0.66900000000000004},"max":{"1min":1.6599999999999999,"5min":3.202,"15min":3.202},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.212,"15min":1.2030000000000001},"min":{"1min":0.90700000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.544,"5min":1.6830000000000001,"15min":4.8819999999999997},"last":0.88300000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.0980000000000001,"15min":1.0900000000000001},"min":{"1min":0.747,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.718,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.373},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1759999999999999,"15min":1.169},"min":{"1min":0.80000000000000004,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.7,"5min":1.8779999999999999,"15min":2.081},"last":1.603}]},{"osd":6,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.252,"15min":1.2130000000000001},"min":{"1min":0.89700000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.8680000000000001,"5min":2.0099999999999998,"15min":2.2010000000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.232,"15min":1.236},"min":{"1min":1.024,"5min":0.70699999999999996,"15min":0.55900000000000005},"max":{"1min":1.575,"5min":1.927,"15min":2.0779999999999998},"last":1.506}]},{"osd":7,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3140000000000001,"15min":1.2949999999999999},"min":{"1min":0.95799999999999996,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":2.6789999999999998},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.365,"15min":1.327},"min":{"1min":0.83999999999999997,"5min":0.75600000000000001,"15min":0.60799999999999998},"max":{"1min":1.734,"5min":1.8859999999999999,"15min":3.1840000000000002},"last":1.415}]}]},{"osd":4,"up_from":13,"seq":55834575050,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2531328,"data_stored":1268073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1990000000000001,"15min":1.1140000000000001},"min":{"1min":0.88300000000000001,"5min":0.70999999999999996,"15min":0.51500000000000001},"max":{"1min":1.5309999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.23,"15min":1.1719999999999999},"min":{"1min":0.93600000000000005,"5min":0.75700000000000001,"15min":0.48899999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.7470000000000001},"last":1.2649999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1339999999999999,"15min":1.085},"min":{"1min":0.88200000000000001,"5min":0.59899999999999998,"15min":0.53100000000000003},"max":{"1min":1.591,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.147,"15min":1.0640000000000001},"min":{"1min":0.89900000000000002,"5min":0.69199999999999995,"15min":0.46000000000000002},"max":{"1min":1.635,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":1.794}]},{"osd":2,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1060000000000001,"15min":1.0800000000000001},"min":{"1min":0.82199999999999995,"5min":0.66400000000000003,"15min":0.49199999999999999},"max":{"1min":1.456,"5min":1.5800000000000001,"15min":5.3390000000000004},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.1879999999999999,"15min":1.1459999999999999},"min":{"1min":0.98199999999999998,"5min":0.71099999999999997,"15min":0.59199999999999997},"max":{"1min":1.506,"5min":1.621,"15min":1.641},"last":1.6040000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1870000000000001,"15min":1.139},"min":{"1min":0.98499999999999999,"5min":0.69799999999999995,"15min":0.496},"max":{"1min":1.5369999999999999,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.752},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.204,"15min":1.161},"min":{"1min":1.0669999999999999,"5min":0.73899999999999999,"15min":0.53100000000000003},"max":{"1min":1.5069999999999999,"5min":1.647,"15min":5.3029999999999999},"last":1.222}]},{"osd":5,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.1080000000000001,"15min":1.0980000000000001},"min":{"1min":0.77400000000000002,"5min":0.63500000000000001,"15min":0.54100000000000004},"max":{"1min":1.506,"5min":1.581,"15min":1.6970000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1990000000000001,"15min":1.1379999999999999},"min":{"1min":0.877,"5min":0.70099999999999996,"15min":0.52200000000000002},"max":{"1min":1.744,"5min":1.744,"15min":1.8240000000000001},"last":1.0960000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1499999999999999,"15min":1.137},"min":{"1min":0.84599999999999997,"5min":0.67400000000000004,"15min":0.44500000000000001},"max":{"1min":1.5960000000000001,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.341,"5min":1.3,"15min":1.25},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.51900000000000002},"max":{"1min":1.6930000000000001,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":2.1339999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.365,"15min":1.3140000000000001},"min":{"1min":1.109,"5min":0.74099999999999999,"15min":0.59399999999999997},"max":{"1min":1.7709999999999999,"5min":1.7949999999999999,"15min":1.9119999999999999},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3360000000000001,"15min":1.3129999999999999},"min":{"1min":0.84199999999999997,"5min":0.74199999999999999,"15min":0.56899999999999995},"max":{"1min":1.873,"5min":1.873,"15min":5.2629999999999999},"last":1.373}]}]},{"osd":3,"up_from":13,"seq":55834575050,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307896,"kb_used_data":6576,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94063944,"statfs":{"total":96636764160,"available":96321478656,"internally_reserved":0,"allocated":6733824,"data_stored":5463021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82399999999999995,"15min":0.85599999999999998},"min":{"1min":0.59399999999999997,"5min":0.47899999999999998,"15min":0.34200000000000003},"max":{"1min":1.4590000000000001,"5min":1.512,"15min":14.859},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.89600000000000002,"15min":0.90800000000000003},"min":{"1min":0.64400000000000002,"5min":0.42699999999999999,"15min":0.317},"max":{"1min":1.1140000000000001,"5min":1.724,"15min":5.0919999999999996},"last":0.90600000000000003}]},{"osd":1,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91600000000000004,"15min":0.90700000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.39300000000000002},"max":{"1min":1.4450000000000001,"5min":1.5860000000000001,"15min":6.5570000000000004},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.97199999999999998,"15min":0.97099999999999997},"min":{"1min":0.63800000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4339999999999999,"5min":1.482,"15min":5.7519999999999998},"last":1.417}]},{"osd":2,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1160000000000001,"15min":1.1040000000000001},"min":{"1min":0.91900000000000004,"5min":0.48699999999999999,"15min":0.40600000000000003},"max":{"1min":1.4510000000000001,"5min":1.7350000000000001,"15min":2.391},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.1899999999999999,"15min":1.1839999999999999},"min":{"1min":0.92100000000000004,"5min":0.60699999999999998,"15min":0.44800000000000001},"max":{"1min":1.641,"5min":1.768,"15min":4.1429999999999998},"last":1.3580000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.339,"15min":1.343},"min":{"1min":0.88700000000000001,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.6240000000000001,"5min":2.157,"15min":10.858000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.325,"15min":1.343},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.63600000000000001},"max":{"1min":1.6359999999999999,"5min":1.7769999999999999,"15min":10.846},"last":1.552}]},{"osd":5,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.262,"15min":1.2809999999999999},"min":{"1min":0.83399999999999996,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.6459999999999999,"5min":1.6739999999999999,"15min":7.3639999999999999},"last":1.246},{"interface":"front","average":{"1min":1.268,"5min":1.28,"15min":1.3819999999999999},"min":{"1min":0.91700000000000004,"5min":0.85599999999999998,"15min":0.71199999999999997},"max":{"1min":1.603,"5min":1.796,"15min":14.523999999999999},"last":1.159}]},{"osd":6,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3640000000000001,"15min":1.349},"min":{"1min":1.018,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.591,"5min":2.2570000000000001,"15min":4.9809999999999999},"last":1.462},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4019999999999999,"15min":1.3919999999999999},"min":{"1min":0.93600000000000005,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.754,"5min":1.8700000000000001,"15min":5.4210000000000003},"last":1.484}]},{"osd":7,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3360000000000001,"15min":1.3580000000000001},"min":{"1min":1.01,"5min":0.90800000000000003,"15min":0.72799999999999998},"max":{"1min":1.681,"5min":2.004,"15min":5.7160000000000002},"last":1.522},{"interface":"front","average":{"1min":1.365,"5min":1.399,"15min":1.4079999999999999},"min":{"1min":0.95799999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6930000000000001,"5min":2.4449999999999998,"15min":6.4279999999999999},"last":1.319}]}]},{"osd":2,"up_from":13,"seq":55834575050,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307940,"kb_used_data":10716,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94063900,"statfs":{"total":96636764160,"available":96321433600,"internally_reserved":0,"allocated":10973184,"data_stored":9693531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.82299999999999995,"15min":0.78000000000000003},"min":{"1min":0.64600000000000002,"5min":0.432,"15min":0.378},"max":{"1min":1.135,"5min":1.373,"15min":1.7270000000000001},"last":0.879},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.89200000000000002,"15min":0.86799999999999999},"min":{"1min":0.68400000000000005,"5min":0.45300000000000001,"15min":0.373},"max":{"1min":1.417,"5min":1.417,"15min":1.7350000000000001},"last":1.821}]},{"osd":1,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94699999999999995,"15min":0.89000000000000001},"min":{"1min":0.69399999999999995,"5min":0.55400000000000005,"15min":0.41299999999999998},"max":{"1min":1.3879999999999999,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.032,"15min":0.96799999999999997},"min":{"1min":0.79100000000000004,"5min":0.47899999999999998,"15min":0.41599999999999998},"max":{"1min":1.5780000000000001,"5min":1.671,"15min":2.8849999999999998},"last":0.97099999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.1779999999999999,"15min":1.1499999999999999},"min":{"1min":0.68300000000000005,"5min":0.66700000000000004,"15min":0.47099999999999997},"max":{"1min":1.633,"5min":2.3090000000000002,"15min":3.0990000000000002},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.2470000000000001,"15min":1.22},"min":{"1min":0.86899999999999999,"5min":0.76000000000000001,"15min":0.51100000000000001},"max":{"1min":1.6180000000000001,"5min":1.8340000000000001,"15min":3.133},"last":1.073}]},{"osd":4,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.3560000000000001,"15min":1.282},"min":{"1min":1.1930000000000001,"5min":0.90400000000000003,"15min":0.59099999999999997},"max":{"1min":1.746,"5min":2.101,"15min":3.0129999999999999},"last":1.218},{"interface":"front","average":{"1min":1.319,"5min":1.244,"15min":1.206},"min":{"1min":1.052,"5min":0.71699999999999997,"15min":0.52100000000000002},"max":{"1min":1.6299999999999999,"5min":1.9970000000000001,"15min":2.2829999999999999},"last":1.726}]},{"osd":5,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.276,"15min":1.236},"min":{"1min":0.91900000000000004,"5min":0.84099999999999997,"15min":0.63800000000000001},"max":{"1min":1.5329999999999999,"5min":2.379,"15min":2.379},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.371,"5min":1.3480000000000001,"15min":1.292},"min":{"1min":1.216,"5min":0.84799999999999998,"15min":0.67000000000000004},"max":{"1min":1.5620000000000001,"5min":2.1880000000000002,"15min":3.0910000000000002},"last":1.333}]},{"osd":6,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2689999999999999,"15min":1.252},"min":{"1min":0.96399999999999997,"5min":0.79500000000000004,"15min":0.61799999999999999},"max":{"1min":1.5469999999999999,"5min":1.9119999999999999,"15min":2.1389999999999998},"last":2.0449999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3839999999999999,"15min":1.321},"min":{"1min":0.95999999999999996,"5min":0.91100000000000003,"15min":0.629},"max":{"1min":1.6859999999999999,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.605}]},{"osd":7,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3759999999999999,"15min":1.3460000000000001},"min":{"1min":1.0860000000000001,"5min":0.88500000000000001,"15min":0.75900000000000001},"max":{"1min":1.7549999999999999,"5min":1.8200000000000001,"15min":2.1749999999999998},"last":1.9299999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.47,"15min":1.425},"min":{"1min":1.109,"5min":0.89700000000000002,"15min":0.79000000000000004},"max":{"1min":1.7170000000000001,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.52}]}]},{"osd":1,"up_from":13,"seq":55834575051,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314048,"kb_used_data":4536,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94057792,"statfs":{"total":96636764160,"available":96315179008,"internally_reserved":0,"allocated":4644864,"data_stored":3372267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.85499999999999998,"15min":0.873},"min":{"1min":0.67300000000000004,"5min":0.36699999999999999,"15min":0.36199999999999999},"max":{"1min":1.3149999999999999,"5min":1.4830000000000001,"15min":3.4119999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.024,"15min":1.0029999999999999},"min":{"1min":0.73999999999999999,"5min":0.504,"15min":0.41099999999999998},"max":{"1min":1.3700000000000001,"5min":1.6160000000000001,"15min":2.101},"last":0.78100000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.97799999999999998,"15min":0.98899999999999999},"min":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.45500000000000002},"max":{"1min":1.393,"5min":1.556,"15min":2.169},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.0860000000000001,"15min":1.0660000000000001},"min":{"1min":0.89300000000000002,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.611,"5min":1.611,"15min":2.024},"last":1.276}]},{"osd":3,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0609999999999999,"15min":1.05},"min":{"1min":0.83299999999999996,"5min":0.57399999999999995,"15min":0.38900000000000001},"max":{"1min":1.4790000000000001,"5min":1.972,"15min":4.665},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.90700000000000003,"15min":0.94899999999999995},"min":{"1min":0.71199999999999997,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.5129999999999999,"5min":1.659,"15min":5.5830000000000002},"last":1.2989999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.236,"15min":1.2589999999999999},"min":{"1min":1.0649999999999999,"5min":0.83699999999999997,"15min":0.57899999999999996},"max":{"1min":1.6779999999999999,"5min":1.7769999999999999,"15min":15.76},"last":1.262},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3129999999999999,"15min":1.345},"min":{"1min":1.1240000000000001,"5min":0.90400000000000003,"15min":0.63500000000000001},"max":{"1min":1.5629999999999999,"5min":1.673,"15min":16.975000000000001},"last":0.96499999999999997}]},{"osd":5,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.252,"15min":1.238},"min":{"1min":0.81200000000000006,"5min":0.72599999999999998,"15min":0.55700000000000005},"max":{"1min":1.4370000000000001,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.163},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2889999999999999,"15min":1.286},"min":{"1min":1.0609999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5900000000000001,"5min":1.879,"15min":2.52},"last":1.329}]},{"osd":6,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2989999999999999,"15min":1.266},"min":{"1min":1.0529999999999999,"5min":0.77400000000000002,"15min":0.55600000000000005},"max":{"1min":1.5249999999999999,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.379},{"interface":"front","average":{"1min":1.403,"5min":1.3140000000000001,"15min":1.331},"min":{"1min":1.133,"5min":0.76200000000000001,"15min":0.68799999999999994},"max":{"1min":1.6439999999999999,"5min":2.008,"15min":2.5569999999999999},"last":1.395}]},{"osd":7,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.3680000000000001,"15min":1.3560000000000001},"min":{"1min":1.181,"5min":0.77200000000000002,"15min":0.68100000000000005},"max":{"1min":1.7170000000000001,"5min":1.835,"15min":4.4329999999999998},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.363,"15min":1.351},"min":{"1min":1.044,"5min":0.81100000000000005,"15min":0.64900000000000002},"max":{"1min":1.619,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":1.4279999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575050,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316124,"kb_used_data":6612,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94055716,"statfs":{"total":96636764160,"available":96313053184,"internally_reserved":0,"allocated":6770688,"data_stored":5498671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80900000000000005,"15min":0.872},"min":{"1min":0.69299999999999995,"5min":0.39600000000000002,"15min":0.28699999999999998},"max":{"1min":1.206,"5min":1.361,"15min":15.273},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.92300000000000004,"15min":0.90800000000000003},"min":{"1min":0.76600000000000001,"5min":0.48899999999999999,"15min":0.34499999999999997},"max":{"1min":1.2150000000000001,"5min":1.625,"15min":4.4009999999999998},"last":0.71299999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98799999999999999,"15min":1.0329999999999999},"min":{"1min":0.85999999999999999,"5min":0.60299999999999998,"15min":0.46400000000000002},"max":{"1min":1.4219999999999999,"5min":1.6299999999999999,"15min":15.473000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.1299999999999999,"15min":1.0509999999999999},"min":{"1min":0.95199999999999996,"5min":0.67400000000000004,"15min":0.42699999999999999},"max":{"1min":1.482,"5min":1.7070000000000001,"15min":1.7989999999999999},"last":0.99199999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0229999999999999,"15min":0.98299999999999998},"min":{"1min":0.85399999999999998,"5min":0.50600000000000001,"15min":0.39000000000000001},"max":{"1min":1.643,"5min":1.8959999999999999,"15min":5.3970000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.1639999999999999,"15min":1.1779999999999999},"min":{"1min":1.0429999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.5740000000000001,"5min":2.863,"15min":15.439},"last":1.3049999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.286,"15min":1.236},"min":{"1min":1.1879999999999999,"5min":0.81999999999999995,"15min":0.61399999999999999},"max":{"1min":1.669,"5min":1.7949999999999999,"15min":2.1280000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.2609999999999999,"15min":1.22},"min":{"1min":0.88600000000000001,"5min":0.70199999999999996,"15min":0.56200000000000006},"max":{"1min":1.6990000000000001,"5min":1.706,"15min":3.4340000000000002},"last":0.93000000000000005}]},{"osd":5,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.302,"15min":1.26},"min":{"1min":1.0369999999999999,"5min":0.79000000000000004,"15min":0.67600000000000005},"max":{"1min":1.524,"5min":1.802,"15min":2.891},"last":1.143},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.321,"15min":1.3100000000000001},"min":{"1min":1.179,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.881,"5min":1.881,"15min":2.823},"last":1.393}]},{"osd":6,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.373,"15min":1.4039999999999999},"min":{"1min":1.2390000000000001,"5min":0.879,"15min":0.59099999999999997},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":15.4},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.3819999999999999,"15min":1.357},"min":{"1min":1.244,"5min":0.80500000000000005,"15min":0.72499999999999998},"max":{"1min":1.774,"5min":1.8919999999999999,"15min":7.1349999999999998},"last":1.2789999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.4450000000000001,"15min":1.3959999999999999},"min":{"1min":1.1819999999999999,"5min":0.86899999999999999,"15min":0.79900000000000004},"max":{"1min":1.8109999999999999,"5min":2.145,"15min":2.1819999999999999},"last":1.331},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.419,"15min":1.3660000000000001},"min":{"1min":1.2829999999999999,"5min":0.76600000000000001,"15min":0.752},"max":{"1min":1.9379999999999999,"5min":2.0470000000000002,"15min":2.7269999999999999},"last":1.0980000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:21:11.934 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-22T05:21:11.935 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:21:12.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.093+0000 7f70e0a00700 1 Processor -- start 2024-01-22T05:21:12.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.093+0000 7f70e0a00700 1 -- start start 2024-01-22T05:21:12.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.093+0000 7f70e0a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f70d8152b50 0x7f70d80c5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:12.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.093+0000 7f70e0a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70d8068fc0 0x7f70d80c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:12.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.093+0000 7f70e0a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d8067b20 con 0x7f70d80bff50 2024-01-22T05:21:12.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.093+0000 7f70e0a00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d8152f30 con 0x7f70d8152b50 2024-01-22T05:21:12.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.093+0000 7f70e0a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d80c08b0 con 0x7f70d8068fc0 2024-01-22T05:21:12.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.097+0000 7f70de000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f70d8152b50 0x7f70d80c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:12.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.097+0000 7f70de000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f70d8152b50 0x7f70d80c5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51100/0 (socket says 172.21.15.49:51100) 2024-01-22T05:21:12.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.097+0000 7f70de000700 1 -- 172.21.15.49:0/3019770629 learned_addr learned my addr 172.21.15.49:0/3019770629 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:12.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.097+0000 7f70df400700 1 --2- 172.21.15.49:0/3019770629 >> v2:172.21.15.110:3300/0 conn(0x7f70d8068fc0 0x7f70d80c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:12.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.097+0000 7f70de000700 1 -- 172.21.15.49:0/3019770629 >> v2:172.21.15.110:3300/0 conn(0x7f70d8068fc0 msgr2=0x7f70d80c03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:12.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.097+0000 7f70de000700 1 --2- 172.21.15.49:0/3019770629 >> v2:172.21.15.110:3300/0 conn(0x7f70d8068fc0 0x7f70d80c03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.097+0000 7f70de000700 1 -- 172.21.15.49:0/3019770629 >> v1:172.21.15.110:6789/0 conn(0x7f70d80bff50 legacy=0x7f70d81554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:12.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.097+0000 7f70de000700 1 -- 172.21.15.49:0/3019770629 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d80c5d70 con 0x7f70d8152b50 2024-01-22T05:21:12.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.097+0000 7f70de000700 1 --2- 172.21.15.49:0/3019770629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70d8152b50 0x7f70d80c5460 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 rx=0x7f70d80836b0 tx=0x7f70c80090f0).ready entity=mon.0 client_cookie=bcfc2576a8118871 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:12.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.097+0000 7f70dcc00700 1 -- 172.21.15.49:0/3019770629 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c800b600 con 0x7f70d8152b50 2024-01-22T05:21:12.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.097+0000 7f70dcc00700 1 -- 172.21.15.49:0/3019770629 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c800b760 con 0x7f70d8152b50 2024-01-22T05:21:12.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.097+0000 7f70dcc00700 1 -- 172.21.15.49:0/3019770629 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c800bb00 con 0x7f70d8152b50 2024-01-22T05:21:12.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.097+0000 7f70e0a00700 1 -- 172.21.15.49:0/3019770629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70d8152b50 msgr2=0x7f70d80c5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:12.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.097+0000 7f70e0a00700 1 --2- 172.21.15.49:0/3019770629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70d8152b50 0x7f70d80c5460 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 rx=0x7f70d80836b0 tx=0x7f70c80090f0).stop 2024-01-22T05:21:12.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.101+0000 7f70e0a00700 1 -- 172.21.15.49:0/3019770629 shutdown_connections 2024-01-22T05:21:12.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.101+0000 7f70e0a00700 1 --2- 172.21.15.49:0/3019770629 >> v2:172.21.15.110:3300/0 conn(0x7f70d8068fc0 0x7f70d80c03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.101+0000 7f70e0a00700 1 --2- 172.21.15.49:0/3019770629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70d8152b50 0x7f70d80c5460 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.101+0000 7f70e0a00700 1 -- 172.21.15.49:0/3019770629 >> 172.21.15.49:0/3019770629 conn(0x7f70d80c9f50 msgr2=0x7f70d80ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:12.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.101+0000 7f70e0a00700 1 -- 172.21.15.49:0/3019770629 shutdown_connections 2024-01-22T05:21:12.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.101+0000 7f70e0a00700 1 -- 172.21.15.49:0/3019770629 wait complete. 2024-01-22T05:21:12.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70e0a00700 1 Processor -- start 2024-01-22T05:21:12.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70e0a00700 1 -- start start 2024-01-22T05:21:12.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70e0a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70d8068fc0 0x7f70d8064160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:12.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70e0a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70d80bff50 0x7f70d80a8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:12.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70e0a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70d8152b50 0x7f70d8164a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:12.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70e0a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d8150660 con 0x7f70d80bff50 2024-01-22T05:21:12.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70e0a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80adea0 con 0x7f70d8152b50 2024-01-22T05:21:12.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70e0a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80a8b60 con 0x7f70d8068fc0 2024-01-22T05:21:12.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70dd600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70d80bff50 0x7f70d80a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:12.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70dd600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70d80bff50 0x7f70d80a8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51104/0 (socket says 172.21.15.49:51104) 2024-01-22T05:21:12.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70dd600700 1 -- 172.21.15.49:0/1699531217 learned_addr learned my addr 172.21.15.49:0/1699531217 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:12.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70de000700 1 --2- 172.21.15.49:0/1699531217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70d8068fc0 0x7f70d8064160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:12.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70df400700 1 --2- 172.21.15.49:0/1699531217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70d8152b50 0x7f70d8164a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:12.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70dd600700 1 -- 172.21.15.49:0/1699531217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70d8068fc0 msgr2=0x7f70d8064160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:12.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70dd600700 1 --2- 172.21.15.49:0/1699531217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70d8068fc0 0x7f70d8064160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70dd600700 1 -- 172.21.15.49:0/1699531217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70d8152b50 msgr2=0x7f70d8164a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:12.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70dd600700 1 --2- 172.21.15.49:0/1699531217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70d8152b50 0x7f70d8164a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.105+0000 7f70dd600700 1 -- 172.21.15.49:0/1699531217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8009370 con 0x7f70d80bff50 2024-01-22T05:21:12.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.109+0000 7f70df400700 1 --2- 172.21.15.49:0/1699531217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70d8152b50 0x7f70d8164a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:21:12.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.109+0000 7f70dd600700 1 --2- 172.21.15.49:0/1699531217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70d80bff50 0x7f70d80a8670 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 rx=0x7f70c000c440 tx=0x7f70c0007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:12.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.109+0000 7f70d5600700 1 -- 172.21.15.49:0/1699531217 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0012400 con 0x7f70d80bff50 2024-01-22T05:21:12.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.109+0000 7f70d5600700 1 -- 172.21.15.49:0/1699531217 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0012560 con 0x7f70d80bff50 2024-01-22T05:21:12.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.109+0000 7f70e0a00700 1 -- 172.21.15.49:0/1699531217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d80ae0d0 con 0x7f70d80bff50 2024-01-22T05:21:12.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.109+0000 7f70d5600700 1 -- 172.21.15.49:0/1699531217 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0012920 con 0x7f70d80bff50 2024-01-22T05:21:12.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.109+0000 7f70e0a00700 1 -- 172.21.15.49:0/1699531217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d80ae370 con 0x7f70d80bff50 2024-01-22T05:21:12.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.109+0000 7f70e0a00700 1 -- 172.21.15.49:0/1699531217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d8047060 con 0x7f70d80bff50 2024-01-22T05:21:12.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.113+0000 7f70d5600700 1 -- 172.21.15.49:0/1699531217 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f70c001b3b0 con 0x7f70d80bff50 2024-01-22T05:21:12.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.113+0000 7f70d5600700 1 --2- 172.21.15.49:0/1699531217 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f70b005a4e0 0x7f70b005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.113+0000 7f70d5600700 1 -- 172.21.15.49:0/1699531217 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f70c00739a0 con 0x7f70d80bff50 2024-01-22T05:21:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.113+0000 7f70de000700 1 --2- 172.21.15.49:0/1699531217 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f70b005a4e0 0x7f70b005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.113+0000 7f70de000700 1 --2- 172.21.15.49:0/1699531217 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f70b005a4e0 0x7f70b005c9a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f70c800b3c0 tx=0x7f70c8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:12.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.117+0000 7f70d5600700 1 -- 172.21.15.49:0/1699531217 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f70c0047250 con 0x7f70d80bff50 2024-01-22T05:21:12.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.281+0000 7f70e0a00700 1 -- 172.21.15.49:0/1699531217 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70d80c6050 con 0x7f70b005a4e0 2024-01-22T05:21:12.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.289+0000 7f70d5600700 1 -- 172.21.15.49:0/1699531217 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68583 (secure 0 0 0) 0x7f70d80c6050 con 0x7f70b005a4e0 2024-01-22T05:21:12.290 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:21:12.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.293+0000 7f70e0a00700 1 -- 172.21.15.49:0/1699531217 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f70b005a4e0 msgr2=0x7f70b005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:12.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.293+0000 7f70e0a00700 1 --2- 172.21.15.49:0/1699531217 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f70b005a4e0 0x7f70b005c9a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f70c800b3c0 tx=0x7f70c8017000).stop 2024-01-22T05:21:12.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.293+0000 7f70e0a00700 1 -- 172.21.15.49:0/1699531217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70d80bff50 msgr2=0x7f70d80a8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:12.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.293+0000 7f70e0a00700 1 --2- 172.21.15.49:0/1699531217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70d80bff50 0x7f70d80a8670 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 rx=0x7f70c000c440 tx=0x7f70c0007db0).stop 2024-01-22T05:21:12.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.293+0000 7f70e0a00700 1 -- 172.21.15.49:0/1699531217 shutdown_connections 2024-01-22T05:21:12.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.293+0000 7f70e0a00700 1 --2- 172.21.15.49:0/1699531217 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f70b005a4e0 0x7f70b005c9a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.293+0000 7f70e0a00700 1 --2- 172.21.15.49:0/1699531217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70d8152b50 0x7f70d8164a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.293+0000 7f70e0a00700 1 --2- 172.21.15.49:0/1699531217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70d80bff50 0x7f70d80a8670 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.293+0000 7f70e0a00700 1 --2- 172.21.15.49:0/1699531217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70d8068fc0 0x7f70d8064160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.293+0000 7f70e0a00700 1 -- 172.21.15.49:0/1699531217 >> 172.21.15.49:0/1699531217 conn(0x7f70d80c9f50 msgr2=0x7f70d80c7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:12.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.293+0000 7f70e0a00700 1 -- 172.21.15.49:0/1699531217 shutdown_connections 2024-01-22T05:21:12.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.293+0000 7f70e0a00700 1 -- 172.21.15.49:0/1699531217 wait complete. 2024-01-22T05:21:12.297 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:21:12.319 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":698,"stamp":"2024-01-22T05:21:11.606411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2483724,"kb_used_data":44492,"kb_used_omap":0,"kb_used_meta":2439168,"kb_avail":752490996,"statfs":{"total":773094113280,"available":770550779904,"internally_reserved":0,"allocated":45559808,"data_stored":35398834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2497708032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12620476,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-66,"num_read_kb":-71,"num_write":-91,"num_write_kb":-12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.095826"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":167,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:04.341498+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:21:04.341498+0000","last_peered":"2024-01-22T05:21:04.341498+0000","last_clean":"2024-01-22T05:21:04.341498+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:21:04.341498+0000","last_undegraded":"2024-01-22T05:21:04.341498+0000","last_fullsized":"2024-01-22T05:21:04.341498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:04.346973+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:21:04.346973+0000","last_peered":"2024-01-22T05:21:04.346973+0000","last_clean":"2024-01-22T05:21:04.346973+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:21:04.346973+0000","last_undegraded":"2024-01-22T05:21:04.346973+0000","last_fullsized":"2024-01-22T05:21:04.346973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":159,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-01-22T05:20:30.314505+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:20:30.314505+0000","last_peered":"2024-01-22T05:20:30.314505+0000","last_clean":"2024-01-22T05:20:30.314505+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:20:30.314505+0000","last_undegraded":"2024-01-22T05:20:30.314505+0000","last_fullsized":"2024-01-22T05:20:30.314505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:04.347385+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:21:04.347385+0000","last_peered":"2024-01-22T05:21:04.347385+0000","last_clean":"2024-01-22T05:21:04.347385+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:21:04.347385+0000","last_undegraded":"2024-01-22T05:21:04.347385+0000","last_fullsized":"2024-01-22T05:21:04.347385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":194,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:03.944536+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:21:03.944536+0000","last_peered":"2024-01-22T05:21:03.944536+0000","last_clean":"2024-01-22T05:21:03.944536+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:21:03.944536+0000","last_undegraded":"2024-01-22T05:21:03.944536+0000","last_fullsized":"2024-01-22T05:21:03.944536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:04.349875+0000","last_change":"2024-01-22T05:04:30.306294+0000","last_active":"2024-01-22T05:21:04.349875+0000","last_peered":"2024-01-22T05:21:04.349875+0000","last_clean":"2024-01-22T05:21:04.349875+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:21:04.349875+0000","last_undegraded":"2024-01-22T05:21:04.349875+0000","last_fullsized":"2024-01-22T05:21:04.349875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":159,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-01-22T05:20:30.314680+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:20:30.314680+0000","last_peered":"2024-01-22T05:20:30.314680+0000","last_clean":"2024-01-22T05:20:30.314680+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:20:30.314680+0000","last_undegraded":"2024-01-22T05:20:30.314680+0000","last_fullsized":"2024-01-22T05:20:30.314680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":194,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:03.944340+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:21:03.944340+0000","last_peered":"2024-01-22T05:21:03.944340+0000","last_clean":"2024-01-22T05:21:03.944340+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:21:03.944340+0000","last_undegraded":"2024-01-22T05:21:03.944340+0000","last_fullsized":"2024-01-22T05:21:03.944340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":160,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-01-22T05:20:30.315036+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:20:30.315036+0000","last_peered":"2024-01-22T05:20:30.315036+0000","last_clean":"2024-01-22T05:20:30.315036+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:20:30.315036+0000","last_undegraded":"2024-01-22T05:20:30.315036+0000","last_fullsized":"2024-01-22T05:20:30.315036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575050,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311984,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059856,"statfs":{"total":96636764160,"available":96317292544,"internally_reserved":0,"allocated":2531328,"data_stored":1268073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.194,"15min":1.1040000000000001},"min":{"1min":0.71199999999999997,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.512,"5min":7.3170000000000002,"15min":14.779999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.1519999999999999,"15min":1.3839999999999999},"min":{"1min":0.80700000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.411,"5min":3.7789999999999999,"15min":76.662000000000006},"last":1.373}]},{"osd":1,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.153,"15min":1.0800000000000001},"min":{"1min":0.77400000000000002,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.5089999999999999,"5min":1.657,"15min":4.9269999999999996},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.206,"15min":1.2010000000000001},"min":{"1min":0.78700000000000003,"5min":0.71599999999999997,"15min":0.58999999999999997},"max":{"1min":1.4770000000000001,"5min":3.6040000000000001,"15min":12.691000000000001},"last":1.1699999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1759999999999999,"15min":1.135},"min":{"1min":0.59499999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.482,"5min":2.1589999999999998,"15min":2.5150000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.244,"15min":1.232},"min":{"1min":0.93100000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4550000000000001,"5min":2.633,"15min":15.036},"last":1.2110000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2230000000000001,"15min":1.4470000000000001},"min":{"1min":0.83699999999999997,"5min":0.82399999999999995,"15min":0.69799999999999995},"max":{"1min":1.5409999999999999,"5min":1.752,"15min":64.983999999999995},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.304,"15min":1.3029999999999999},"min":{"1min":1.0349999999999999,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":1.581,"5min":2.2770000000000001,"15min":15.073},"last":1.581}]},{"osd":4,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1859999999999999,"15min":1.1970000000000001},"min":{"1min":0.81399999999999995,"5min":0.53000000000000003,"15min":0.32900000000000001},"max":{"1min":1.4790000000000001,"5min":3.1840000000000002,"15min":22.239000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.228,"15min":1.27},"min":{"1min":0.77100000000000002,"5min":0.66200000000000003,"15min":0.52200000000000002},"max":{"1min":1.488,"5min":1.9830000000000001,"15min":27.872},"last":1.4059999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2629999999999999,"15min":1.456},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.40400000000000003},"max":{"1min":1.5840000000000001,"5min":2.3530000000000002,"15min":65.652000000000001},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.329,"15min":1.2989999999999999},"min":{"1min":0.90800000000000003,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":1.4950000000000001,"5min":2.1539999999999999,"15min":3.625},"last":1.48}]},{"osd":6,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.325,"15min":1.264},"min":{"1min":0.91200000000000003,"5min":0.85299999999999998,"15min":0.53400000000000003},"max":{"1min":1.5669999999999999,"5min":3.3439999999999999,"15min":6.9939999999999998},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.425,"15min":1.421},"min":{"1min":1.01,"5min":0.73299999999999998,"15min":0.56100000000000005},"max":{"1min":1.6100000000000001,"5min":2.246,"15min":12.965},"last":1.5469999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575050,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309952,"kb_used_data":4536,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94061888,"statfs":{"total":96636764160,"available":96319373312,"internally_reserved":0,"allocated":4644864,"data_stored":3372267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.079,"15min":1.2869999999999999},"min":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.35999999999999999},"max":{"1min":1.5409999999999999,"5min":1.927,"15min":77.745000000000005},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.70999999999999996,"5min":0.64500000000000002,"15min":0.44},"max":{"1min":1.4790000000000001,"5min":1.74,"15min":13.555999999999999},"last":0.97899999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1000000000000001,"15min":1.1259999999999999},"min":{"1min":0.73499999999999999,"5min":0.629,"15min":0.40000000000000002},"max":{"1min":1.329,"5min":1.554,"15min":15.499000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.139,"15min":1.1459999999999999},"min":{"1min":0.78400000000000003,"5min":0.60799999999999998,"15min":0.54800000000000004},"max":{"1min":1.474,"5min":1.702,"15min":7.7629999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.1990000000000001,"15min":1.169},"min":{"1min":0.95199999999999996,"5min":0.84999999999999998,"15min":0.57399999999999995},"max":{"1min":1.5680000000000001,"5min":1.667,"15min":3.0960000000000001},"last":1.345},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.157,"15min":1.149},"min":{"1min":0.85699999999999998,"5min":0.68999999999999995,"15min":0.38200000000000001},"max":{"1min":1.4590000000000001,"5min":1.7390000000000001,"15min":4.9660000000000002},"last":1.165}]},{"osd":3,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.1950000000000001,"15min":1.4950000000000001},"min":{"1min":1.014,"5min":0.72699999999999998,"15min":0.59299999999999997},"max":{"1min":1.4870000000000001,"5min":2.343,"15min":102.08199999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1819999999999999,"15min":1.2170000000000001},"min":{"1min":0.86299999999999999,"5min":0.81799999999999995,"15min":0.374},"max":{"1min":1.488,"5min":1.5409999999999999,"15min":15.468},"last":1.3089999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.175,"15min":1.155},"min":{"1min":0.76200000000000001,"5min":0.69399999999999995,"15min":0.495},"max":{"1min":1.55,"5min":1.631,"15min":3.1749999999999998},"last":1.48},{"interface":"front","average":{"1min":1.206,"5min":1.21,"15min":1.1699999999999999},"min":{"1min":0.86799999999999999,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.5740000000000001,"5min":2.5489999999999999,"15min":5.1200000000000001},"last":1.4950000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1599999999999999,"15min":1.242},"min":{"1min":0.78600000000000003,"5min":0.65000000000000002,"15min":0.48099999999999998},"max":{"1min":1.617,"5min":1.7829999999999999,"15min":30.533000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2929999999999999,"15min":1.28},"min":{"1min":1.0189999999999999,"5min":0.79500000000000004,"15min":0.46600000000000003},"max":{"1min":1.6439999999999999,"5min":1.8169999999999999,"15min":3.875},"last":1.601}]},{"osd":7,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.3660000000000001,"15min":1.4279999999999999},"min":{"1min":1.0680000000000001,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":1.6539999999999999,"5min":2.7490000000000001,"15min":23.547999999999998},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.3080000000000001,"15min":1.5449999999999999},"min":{"1min":0.93600000000000005,"5min":0.77700000000000002,"15min":0.495},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":63.737000000000002},"last":1.5169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575050,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311988,"kb_used_data":6572,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94059852,"statfs":{"total":96636764160,"available":96317288448,"internally_reserved":0,"allocated":6729728,"data_stored":5462931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0169999999999999,"15min":1.0189999999999999},"min":{"1min":0.73599999999999999,"5min":0.56499999999999995,"15min":0.53300000000000003},"max":{"1min":1.534,"5min":1.556,"15min":2.0609999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0649999999999999,"15min":1.038},"min":{"1min":0.86099999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.427,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.82799999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.206,"15min":1.181},"min":{"1min":0.93600000000000005,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.619,"5min":1.744,"15min":2.0310000000000001},"last":1.536},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.224,"15min":1.1919999999999999},"min":{"1min":0.752,"5min":0.63500000000000001,"15min":0.50900000000000001},"max":{"1min":1.762,"5min":1.7989999999999999,"15min":2.0209999999999999},"last":1.23}]},{"osd":2,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.169,"15min":1.139},"min":{"1min":0.73999999999999999,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.3899999999999999,"5min":1.8089999999999999,"15min":1.925},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.133,"15min":1.115},"min":{"1min":0.90600000000000003,"5min":0.71799999999999997,"15min":0.59899999999999998},"max":{"1min":1.657,"5min":1.657,"15min":1.982},"last":0.93999999999999995}]},{"osd":3,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2070000000000001,"15min":1.161},"min":{"1min":0.72299999999999998,"5min":0.69799999999999995,"15min":0.66900000000000004},"max":{"1min":1.6599999999999999,"5min":3.202,"15min":3.202},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.212,"15min":1.2030000000000001},"min":{"1min":0.90700000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.544,"5min":1.6830000000000001,"15min":4.8819999999999997},"last":0.88300000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.0980000000000001,"15min":1.0900000000000001},"min":{"1min":0.747,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.718,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.373},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1759999999999999,"15min":1.169},"min":{"1min":0.80000000000000004,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.7,"5min":1.8779999999999999,"15min":2.081},"last":1.603}]},{"osd":6,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.252,"15min":1.2130000000000001},"min":{"1min":0.89700000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.8680000000000001,"5min":2.0099999999999998,"15min":2.2010000000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.232,"15min":1.236},"min":{"1min":1.024,"5min":0.70699999999999996,"15min":0.55900000000000005},"max":{"1min":1.575,"5min":1.927,"15min":2.0779999999999998},"last":1.506}]},{"osd":7,"last update":"Mon Jan 22 05:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3140000000000001,"15min":1.2949999999999999},"min":{"1min":0.95799999999999996,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":2.6789999999999998},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.365,"15min":1.327},"min":{"1min":0.83999999999999997,"5min":0.75600000000000001,"15min":0.60799999999999998},"max":{"1min":1.734,"5min":1.8859999999999999,"15min":3.1840000000000002},"last":1.415}]}]},{"osd":4,"up_from":13,"seq":55834575050,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2531328,"data_stored":1268073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1990000000000001,"15min":1.1140000000000001},"min":{"1min":0.88300000000000001,"5min":0.70999999999999996,"15min":0.51500000000000001},"max":{"1min":1.5309999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.23,"15min":1.1719999999999999},"min":{"1min":0.93600000000000005,"5min":0.75700000000000001,"15min":0.48899999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.7470000000000001},"last":1.2649999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1339999999999999,"15min":1.085},"min":{"1min":0.88200000000000001,"5min":0.59899999999999998,"15min":0.53100000000000003},"max":{"1min":1.591,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.147,"15min":1.0640000000000001},"min":{"1min":0.89900000000000002,"5min":0.69199999999999995,"15min":0.46000000000000002},"max":{"1min":1.635,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":1.794}]},{"osd":2,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1060000000000001,"15min":1.0800000000000001},"min":{"1min":0.82199999999999995,"5min":0.66400000000000003,"15min":0.49199999999999999},"max":{"1min":1.456,"5min":1.5800000000000001,"15min":5.3390000000000004},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.1879999999999999,"15min":1.1459999999999999},"min":{"1min":0.98199999999999998,"5min":0.71099999999999997,"15min":0.59199999999999997},"max":{"1min":1.506,"5min":1.621,"15min":1.641},"last":1.6040000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1870000000000001,"15min":1.139},"min":{"1min":0.98499999999999999,"5min":0.69799999999999995,"15min":0.496},"max":{"1min":1.5369999999999999,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.752},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.204,"15min":1.161},"min":{"1min":1.0669999999999999,"5min":0.73899999999999999,"15min":0.53100000000000003},"max":{"1min":1.5069999999999999,"5min":1.647,"15min":5.3029999999999999},"last":1.222}]},{"osd":5,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.1080000000000001,"15min":1.0980000000000001},"min":{"1min":0.77400000000000002,"5min":0.63500000000000001,"15min":0.54100000000000004},"max":{"1min":1.506,"5min":1.581,"15min":1.6970000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1990000000000001,"15min":1.1379999999999999},"min":{"1min":0.877,"5min":0.70099999999999996,"15min":0.52200000000000002},"max":{"1min":1.744,"5min":1.744,"15min":1.8240000000000001},"last":1.0960000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1499999999999999,"15min":1.137},"min":{"1min":0.84599999999999997,"5min":0.67400000000000004,"15min":0.44500000000000001},"max":{"1min":1.5960000000000001,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.341,"5min":1.3,"15min":1.25},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.51900000000000002},"max":{"1min":1.6930000000000001,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":2.1339999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.365,"15min":1.3140000000000001},"min":{"1min":1.109,"5min":0.74099999999999999,"15min":0.59399999999999997},"max":{"1min":1.7709999999999999,"5min":1.7949999999999999,"15min":1.9119999999999999},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3360000000000001,"15min":1.3129999999999999},"min":{"1min":0.84199999999999997,"5min":0.74199999999999999,"15min":0.56899999999999995},"max":{"1min":1.873,"5min":1.873,"15min":5.2629999999999999},"last":1.373}]}]},{"osd":3,"up_from":13,"seq":55834575050,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307896,"kb_used_data":6576,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94063944,"statfs":{"total":96636764160,"available":96321478656,"internally_reserved":0,"allocated":6733824,"data_stored":5463021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82399999999999995,"15min":0.85599999999999998},"min":{"1min":0.59399999999999997,"5min":0.47899999999999998,"15min":0.34200000000000003},"max":{"1min":1.4590000000000001,"5min":1.512,"15min":14.859},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.89600000000000002,"15min":0.90800000000000003},"min":{"1min":0.64400000000000002,"5min":0.42699999999999999,"15min":0.317},"max":{"1min":1.1140000000000001,"5min":1.724,"15min":5.0919999999999996},"last":0.90600000000000003}]},{"osd":1,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91600000000000004,"15min":0.90700000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.39300000000000002},"max":{"1min":1.4450000000000001,"5min":1.5860000000000001,"15min":6.5570000000000004},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.97199999999999998,"15min":0.97099999999999997},"min":{"1min":0.63800000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4339999999999999,"5min":1.482,"15min":5.7519999999999998},"last":1.417}]},{"osd":2,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1160000000000001,"15min":1.1040000000000001},"min":{"1min":0.91900000000000004,"5min":0.48699999999999999,"15min":0.40600000000000003},"max":{"1min":1.4510000000000001,"5min":1.7350000000000001,"15min":2.391},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.1899999999999999,"15min":1.1839999999999999},"min":{"1min":0.92100000000000004,"5min":0.60699999999999998,"15min":0.44800000000000001},"max":{"1min":1.641,"5min":1.768,"15min":4.1429999999999998},"last":1.3580000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.339,"15min":1.343},"min":{"1min":0.88700000000000001,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.6240000000000001,"5min":2.157,"15min":10.858000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.325,"15min":1.343},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.63600000000000001},"max":{"1min":1.6359999999999999,"5min":1.7769999999999999,"15min":10.846},"last":1.552}]},{"osd":5,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.262,"15min":1.2809999999999999},"min":{"1min":0.83399999999999996,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.6459999999999999,"5min":1.6739999999999999,"15min":7.3639999999999999},"last":1.246},{"interface":"front","average":{"1min":1.268,"5min":1.28,"15min":1.3819999999999999},"min":{"1min":0.91700000000000004,"5min":0.85599999999999998,"15min":0.71199999999999997},"max":{"1min":1.603,"5min":1.796,"15min":14.523999999999999},"last":1.159}]},{"osd":6,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3640000000000001,"15min":1.349},"min":{"1min":1.018,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.591,"5min":2.2570000000000001,"15min":4.9809999999999999},"last":1.462},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4019999999999999,"15min":1.3919999999999999},"min":{"1min":0.93600000000000005,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.754,"5min":1.8700000000000001,"15min":5.4210000000000003},"last":1.484}]},{"osd":7,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3360000000000001,"15min":1.3580000000000001},"min":{"1min":1.01,"5min":0.90800000000000003,"15min":0.72799999999999998},"max":{"1min":1.681,"5min":2.004,"15min":5.7160000000000002},"last":1.522},{"interface":"front","average":{"1min":1.365,"5min":1.399,"15min":1.4079999999999999},"min":{"1min":0.95799999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6930000000000001,"5min":2.4449999999999998,"15min":6.4279999999999999},"last":1.319}]}]},{"osd":2,"up_from":13,"seq":55834575050,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307940,"kb_used_data":10716,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94063900,"statfs":{"total":96636764160,"available":96321433600,"internally_reserved":0,"allocated":10973184,"data_stored":9693531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.82299999999999995,"15min":0.78000000000000003},"min":{"1min":0.64600000000000002,"5min":0.432,"15min":0.378},"max":{"1min":1.135,"5min":1.373,"15min":1.7270000000000001},"last":0.879},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.89200000000000002,"15min":0.86799999999999999},"min":{"1min":0.68400000000000005,"5min":0.45300000000000001,"15min":0.373},"max":{"1min":1.417,"5min":1.417,"15min":1.7350000000000001},"last":1.821}]},{"osd":1,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94699999999999995,"15min":0.89000000000000001},"min":{"1min":0.69399999999999995,"5min":0.55400000000000005,"15min":0.41299999999999998},"max":{"1min":1.3879999999999999,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.032,"15min":0.96799999999999997},"min":{"1min":0.79100000000000004,"5min":0.47899999999999998,"15min":0.41599999999999998},"max":{"1min":1.5780000000000001,"5min":1.671,"15min":2.8849999999999998},"last":0.97099999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.1779999999999999,"15min":1.1499999999999999},"min":{"1min":0.68300000000000005,"5min":0.66700000000000004,"15min":0.47099999999999997},"max":{"1min":1.633,"5min":2.3090000000000002,"15min":3.0990000000000002},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.2470000000000001,"15min":1.22},"min":{"1min":0.86899999999999999,"5min":0.76000000000000001,"15min":0.51100000000000001},"max":{"1min":1.6180000000000001,"5min":1.8340000000000001,"15min":3.133},"last":1.073}]},{"osd":4,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.3560000000000001,"15min":1.282},"min":{"1min":1.1930000000000001,"5min":0.90400000000000003,"15min":0.59099999999999997},"max":{"1min":1.746,"5min":2.101,"15min":3.0129999999999999},"last":1.218},{"interface":"front","average":{"1min":1.319,"5min":1.244,"15min":1.206},"min":{"1min":1.052,"5min":0.71699999999999997,"15min":0.52100000000000002},"max":{"1min":1.6299999999999999,"5min":1.9970000000000001,"15min":2.2829999999999999},"last":1.726}]},{"osd":5,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.276,"15min":1.236},"min":{"1min":0.91900000000000004,"5min":0.84099999999999997,"15min":0.63800000000000001},"max":{"1min":1.5329999999999999,"5min":2.379,"15min":2.379},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.371,"5min":1.3480000000000001,"15min":1.292},"min":{"1min":1.216,"5min":0.84799999999999998,"15min":0.67000000000000004},"max":{"1min":1.5620000000000001,"5min":2.1880000000000002,"15min":3.0910000000000002},"last":1.333}]},{"osd":6,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2689999999999999,"15min":1.252},"min":{"1min":0.96399999999999997,"5min":0.79500000000000004,"15min":0.61799999999999999},"max":{"1min":1.5469999999999999,"5min":1.9119999999999999,"15min":2.1389999999999998},"last":2.0449999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3839999999999999,"15min":1.321},"min":{"1min":0.95999999999999996,"5min":0.91100000000000003,"15min":0.629},"max":{"1min":1.6859999999999999,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.605}]},{"osd":7,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3759999999999999,"15min":1.3460000000000001},"min":{"1min":1.0860000000000001,"5min":0.88500000000000001,"15min":0.75900000000000001},"max":{"1min":1.7549999999999999,"5min":1.8200000000000001,"15min":2.1749999999999998},"last":1.9299999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.47,"15min":1.425},"min":{"1min":1.109,"5min":0.89700000000000002,"15min":0.79000000000000004},"max":{"1min":1.7170000000000001,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.52}]}]},{"osd":1,"up_from":13,"seq":55834575051,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314048,"kb_used_data":4536,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94057792,"statfs":{"total":96636764160,"available":96315179008,"internally_reserved":0,"allocated":4644864,"data_stored":3372267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.85499999999999998,"15min":0.873},"min":{"1min":0.67300000000000004,"5min":0.36699999999999999,"15min":0.36199999999999999},"max":{"1min":1.3149999999999999,"5min":1.4830000000000001,"15min":3.4119999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.024,"15min":1.0029999999999999},"min":{"1min":0.73999999999999999,"5min":0.504,"15min":0.41099999999999998},"max":{"1min":1.3700000000000001,"5min":1.6160000000000001,"15min":2.101},"last":0.78100000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.97799999999999998,"15min":0.98899999999999999},"min":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.45500000000000002},"max":{"1min":1.393,"5min":1.556,"15min":2.169},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.0860000000000001,"15min":1.0660000000000001},"min":{"1min":0.89300000000000002,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.611,"5min":1.611,"15min":2.024},"last":1.276}]},{"osd":3,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0609999999999999,"15min":1.05},"min":{"1min":0.83299999999999996,"5min":0.57399999999999995,"15min":0.38900000000000001},"max":{"1min":1.4790000000000001,"5min":1.972,"15min":4.665},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.90700000000000003,"15min":0.94899999999999995},"min":{"1min":0.71199999999999997,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.5129999999999999,"5min":1.659,"15min":5.5830000000000002},"last":1.2989999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.236,"15min":1.2589999999999999},"min":{"1min":1.0649999999999999,"5min":0.83699999999999997,"15min":0.57899999999999996},"max":{"1min":1.6779999999999999,"5min":1.7769999999999999,"15min":15.76},"last":1.262},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3129999999999999,"15min":1.345},"min":{"1min":1.1240000000000001,"5min":0.90400000000000003,"15min":0.63500000000000001},"max":{"1min":1.5629999999999999,"5min":1.673,"15min":16.975000000000001},"last":0.96499999999999997}]},{"osd":5,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.252,"15min":1.238},"min":{"1min":0.81200000000000006,"5min":0.72599999999999998,"15min":0.55700000000000005},"max":{"1min":1.4370000000000001,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.163},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2889999999999999,"15min":1.286},"min":{"1min":1.0609999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5900000000000001,"5min":1.879,"15min":2.52},"last":1.329}]},{"osd":6,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2989999999999999,"15min":1.266},"min":{"1min":1.0529999999999999,"5min":0.77400000000000002,"15min":0.55600000000000005},"max":{"1min":1.5249999999999999,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.379},{"interface":"front","average":{"1min":1.403,"5min":1.3140000000000001,"15min":1.331},"min":{"1min":1.133,"5min":0.76200000000000001,"15min":0.68799999999999994},"max":{"1min":1.6439999999999999,"5min":2.008,"15min":2.5569999999999999},"last":1.395}]},{"osd":7,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.3680000000000001,"15min":1.3560000000000001},"min":{"1min":1.181,"5min":0.77200000000000002,"15min":0.68100000000000005},"max":{"1min":1.7170000000000001,"5min":1.835,"15min":4.4329999999999998},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.363,"15min":1.351},"min":{"1min":1.044,"5min":0.81100000000000005,"15min":0.64900000000000002},"max":{"1min":1.619,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":1.4279999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575050,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316124,"kb_used_data":6612,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94055716,"statfs":{"total":96636764160,"available":96313053184,"internally_reserved":0,"allocated":6770688,"data_stored":5498671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80900000000000005,"15min":0.872},"min":{"1min":0.69299999999999995,"5min":0.39600000000000002,"15min":0.28699999999999998},"max":{"1min":1.206,"5min":1.361,"15min":15.273},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.92300000000000004,"15min":0.90800000000000003},"min":{"1min":0.76600000000000001,"5min":0.48899999999999999,"15min":0.34499999999999997},"max":{"1min":1.2150000000000001,"5min":1.625,"15min":4.4009999999999998},"last":0.71299999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98799999999999999,"15min":1.0329999999999999},"min":{"1min":0.85999999999999999,"5min":0.60299999999999998,"15min":0.46400000000000002},"max":{"1min":1.4219999999999999,"5min":1.6299999999999999,"15min":15.473000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.1299999999999999,"15min":1.0509999999999999},"min":{"1min":0.95199999999999996,"5min":0.67400000000000004,"15min":0.42699999999999999},"max":{"1min":1.482,"5min":1.7070000000000001,"15min":1.7989999999999999},"last":0.99199999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0229999999999999,"15min":0.98299999999999998},"min":{"1min":0.85399999999999998,"5min":0.50600000000000001,"15min":0.39000000000000001},"max":{"1min":1.643,"5min":1.8959999999999999,"15min":5.3970000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.1639999999999999,"15min":1.1779999999999999},"min":{"1min":1.0429999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.5740000000000001,"5min":2.863,"15min":15.439},"last":1.3049999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.286,"15min":1.236},"min":{"1min":1.1879999999999999,"5min":0.81999999999999995,"15min":0.61399999999999999},"max":{"1min":1.669,"5min":1.7949999999999999,"15min":2.1280000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.2609999999999999,"15min":1.22},"min":{"1min":0.88600000000000001,"5min":0.70199999999999996,"15min":0.56200000000000006},"max":{"1min":1.6990000000000001,"5min":1.706,"15min":3.4340000000000002},"last":0.93000000000000005}]},{"osd":5,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.302,"15min":1.26},"min":{"1min":1.0369999999999999,"5min":0.79000000000000004,"15min":0.67600000000000005},"max":{"1min":1.524,"5min":1.802,"15min":2.891},"last":1.143},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.321,"15min":1.3100000000000001},"min":{"1min":1.179,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.881,"5min":1.881,"15min":2.823},"last":1.393}]},{"osd":6,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.373,"15min":1.4039999999999999},"min":{"1min":1.2390000000000001,"5min":0.879,"15min":0.59099999999999997},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":15.4},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.3819999999999999,"15min":1.357},"min":{"1min":1.244,"5min":0.80500000000000005,"15min":0.72499999999999998},"max":{"1min":1.774,"5min":1.8919999999999999,"15min":7.1349999999999998},"last":1.2789999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.4450000000000001,"15min":1.3959999999999999},"min":{"1min":1.1819999999999999,"5min":0.86899999999999999,"15min":0.79900000000000004},"max":{"1min":1.8109999999999999,"5min":2.145,"15min":2.1819999999999999},"last":1.331},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.419,"15min":1.3660000000000001},"min":{"1min":1.2829999999999999,"5min":0.76600000000000001,"15min":0.752},"max":{"1min":1.9379999999999999,"5min":2.0470000000000002,"15min":2.7269999999999999},"last":1.0980000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:21:12.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:21:12.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.477+0000 7f9a62400700 1 Processor -- start 2024-01-22T05:21:12.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.477+0000 7f9a62400700 1 -- start start 2024-01-22T05:21:12.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.481+0000 7f9a62400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a5c155d20 0x7f9a5c065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:12.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.481+0000 7f9a62400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a5c066070 0x7f9a5c0a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:12.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.481+0000 7f9a62400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c0a90e0 con 0x7f9a5c0a8c30 2024-01-22T05:21:12.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.481+0000 7f9a62400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5c0c1a40 con 0x7f9a5c066070 2024-01-22T05:21:12.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.481+0000 7f9a62400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c159310 con 0x7f9a5c155d20 2024-01-22T05:21:12.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.481+0000 7f9a5aa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a5c066070 0x7f9a5c0a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:12.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.481+0000 7f9a5aa00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9a5c066070 0x7f9a5c0a8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51110/0 (socket says 172.21.15.49:51110) 2024-01-22T05:21:12.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.481+0000 7f9a5aa00700 1 -- 172.21.15.49:0/3560773689 learned_addr learned my addr 172.21.15.49:0/3560773689 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:12.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.481+0000 7f9a5b400700 1 --2- 172.21.15.49:0/3560773689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a5c155d20 0x7f9a5c065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:12.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.481+0000 7f9a5aa00700 1 -- 172.21.15.49:0/3560773689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a5c155d20 msgr2=0x7f9a5c065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:12.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.481+0000 7f9a5aa00700 1 --2- 172.21.15.49:0/3560773689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a5c155d20 0x7f9a5c065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.481+0000 7f9a5aa00700 1 -- 172.21.15.49:0/3560773689 >> v1:172.21.15.49:6789/0 conn(0x7f9a5c0a8c30 legacy=0x7f9a5c0c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:12.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.481+0000 7f9a5aa00700 1 -- 172.21.15.49:0/3560773689 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c0c13f0 con 0x7f9a5c066070 2024-01-22T05:21:12.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.485+0000 7f9a5aa00700 1 --2- 172.21.15.49:0/3560773689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c066070 0x7f9a5c0a8740 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 rx=0x7f9a44006fd0 tx=0x7f9a440090f0).ready entity=mon.0 client_cookie=e63865c7e8668219 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:12.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.485+0000 7f9a5a000700 1 -- 172.21.15.49:0/3560773689 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4400b600 con 0x7f9a5c066070 2024-01-22T05:21:12.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.485+0000 7f9a5a000700 1 -- 172.21.15.49:0/3560773689 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4400b760 con 0x7f9a5c066070 2024-01-22T05:21:12.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.485+0000 7f9a5a000700 1 -- 172.21.15.49:0/3560773689 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4400bae0 con 0x7f9a5c066070 2024-01-22T05:21:12.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.485+0000 7f9a62400700 1 -- 172.21.15.49:0/3560773689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c066070 msgr2=0x7f9a5c0a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:12.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.485+0000 7f9a62400700 1 --2- 172.21.15.49:0/3560773689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c066070 0x7f9a5c0a8740 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 rx=0x7f9a44006fd0 tx=0x7f9a440090f0).stop 2024-01-22T05:21:12.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.485+0000 7f9a62400700 1 -- 172.21.15.49:0/3560773689 shutdown_connections 2024-01-22T05:21:12.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.485+0000 7f9a62400700 1 --2- 172.21.15.49:0/3560773689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c066070 0x7f9a5c0a8740 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.485+0000 7f9a62400700 1 --2- 172.21.15.49:0/3560773689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a5c155d20 0x7f9a5c065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.485+0000 7f9a62400700 1 -- 172.21.15.49:0/3560773689 >> 172.21.15.49:0/3560773689 conn(0x7f9a5c0c6540 msgr2=0x7f9a5c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:12.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.485+0000 7f9a62400700 1 -- 172.21.15.49:0/3560773689 shutdown_connections 2024-01-22T05:21:12.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.485+0000 7f9a62400700 1 -- 172.21.15.49:0/3560773689 wait complete. 2024-01-22T05:21:12.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.489+0000 7f9a62400700 1 Processor -- start 2024-01-22T05:21:12.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.489+0000 7f9a62400700 1 -- start start 2024-01-22T05:21:12.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a62400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a5c066070 0x7f9a5c15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:12.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a62400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c0a8c30 0x7f9a5c152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:12.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a62400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a5c155d20 0x7f9a5c0c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:12.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a62400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0c05b0 con 0x7f9a5c0a8c30 2024-01-22T05:21:12.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a62400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c15a7e0 con 0x7f9a5c155d20 2024-01-22T05:21:12.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a62400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0c02d0 con 0x7f9a5c066070 2024-01-22T05:21:12.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a5aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c0a8c30 0x7f9a5c152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:12.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a5aa00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c0a8c30 0x7f9a5c152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51122/0 (socket says 172.21.15.49:51122) 2024-01-22T05:21:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a5aa00700 1 -- 172.21.15.49:0/2162108254 learned_addr learned my addr 172.21.15.49:0/2162108254 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a5b400700 1 --2- 172.21.15.49:0/2162108254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a5c066070 0x7f9a5c15a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a5be00700 1 --2- 172.21.15.49:0/2162108254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a5c155d20 0x7f9a5c0c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a5aa00700 1 -- 172.21.15.49:0/2162108254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a5c066070 msgr2=0x7f9a5c15a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a5aa00700 1 --2- 172.21.15.49:0/2162108254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a5c066070 0x7f9a5c15a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a5aa00700 1 -- 172.21.15.49:0/2162108254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a5c155d20 msgr2=0x7f9a5c0c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a5aa00700 1 --2- 172.21.15.49:0/2162108254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a5c155d20 0x7f9a5c0c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a5aa00700 1 -- 172.21.15.49:0/2162108254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a44009370 con 0x7f9a5c0a8c30 2024-01-22T05:21:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a5aa00700 1 --2- 172.21.15.49:0/2162108254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c0a8c30 0x7f9a5c152860 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 rx=0x7f9a5c059c60 tx=0x7f9a44017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a52a00700 1 -- 172.21.15.49:0/2162108254 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4400b8d0 con 0x7f9a5c0a8c30 2024-01-22T05:21:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a52a00700 1 -- 172.21.15.49:0/2162108254 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4400ba30 con 0x7f9a5c0a8c30 2024-01-22T05:21:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a52a00700 1 -- 172.21.15.49:0/2162108254 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4401b660 con 0x7f9a5c0a8c30 2024-01-22T05:21:12.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a62400700 1 -- 172.21.15.49:0/2162108254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5c159810 con 0x7f9a5c0a8c30 2024-01-22T05:21:12.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a62400700 1 -- 172.21.15.49:0/2162108254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5c159dd0 con 0x7f9a5c0a8c30 2024-01-22T05:21:12.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.493+0000 7f9a62400700 1 -- 172.21.15.49:0/2162108254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5c159670 con 0x7f9a5c0a8c30 2024-01-22T05:21:12.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.497+0000 7f9a52a00700 1 -- 172.21.15.49:0/2162108254 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9a4401ba50 con 0x7f9a5c0a8c30 2024-01-22T05:21:12.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.497+0000 7f9a52a00700 1 --2- 172.21.15.49:0/2162108254 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a3405a510 0x7f9a3405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:12.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.497+0000 7f9a52a00700 1 -- 172.21.15.49:0/2162108254 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f9a44076180 con 0x7f9a5c0a8c30 2024-01-22T05:21:12.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.497+0000 7f9a5b400700 1 --2- 172.21.15.49:0/2162108254 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a3405a510 0x7f9a3405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:12.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.501+0000 7f9a5b400700 1 --2- 172.21.15.49:0/2162108254 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a3405a510 0x7f9a3405c9d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f9a5c0bebc0 tx=0x7f9a4c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:12.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.505+0000 7f9a52a00700 1 -- 172.21.15.49:0/2162108254 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9a5c159670 con 0x7f9a5c0a8c30 2024-01-22T05:21:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.673+0000 7f9a62400700 1 -- 172.21.15.49:0/2162108254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a5c159670 con 0x7f9a5c0a8c30 2024-01-22T05:21:12.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.673+0000 7f9a52a00700 1 -- 172.21.15.49:0/2162108254 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) v1 ==== 74+0+14217 (secure 0 0 0) 0x7f9a5c159670 con 0x7f9a5c0a8c30 2024-01-22T05:21:12.673 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:21:12.673 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":203,"fsid":"f4203cdb-f79e-4d7b-b9de-f994381af719","created":"2024-01-22T05:04:16.264930+0000","modified":"2024-01-22T05:21:07.685524+0000","last_up_change":"2024-01-22T05:04:26.334781+0000","last_in_change":"2024-01-22T05:04:19.190638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:04:26.438331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:04:28.181948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"295d3558-ee93-4059-bc87-d4fcd45e15a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":22975},{"type":"v1","addr":"172.21.15.49:6809","nonce":22975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":22975},{"type":"v1","addr":"172.21.15.49:6811","nonce":22975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":22975},{"type":"v1","addr":"172.21.15.49:6815","nonce":22975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":22975},{"type":"v1","addr":"172.21.15.49:6813","nonce":22975}]},"public_addr":"172.21.15.49:6809/22975","cluster_addr":"172.21.15.49:6811/22975","heartbeat_back_addr":"172.21.15.49:6815/22975","heartbeat_front_addr":"172.21.15.49:6813/22975","state":["exists","up"]},{"osd":1,"uuid":"42b7d27b-f000-4511-8ad2-f9002c77403c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":22976},{"type":"v1","addr":"172.21.15.49:6825","nonce":22976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":22976},{"type":"v1","addr":"172.21.15.49:6827","nonce":22976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":22976},{"type":"v1","addr":"172.21.15.49:6831","nonce":22976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":22976},{"type":"v1","addr":"172.21.15.49:6829","nonce":22976}]},"public_addr":"172.21.15.49:6825/22976","cluster_addr":"172.21.15.49:6827/22976","heartbeat_back_addr":"172.21.15.49:6831/22976","heartbeat_front_addr":"172.21.15.49:6829/22976","state":["exists","up"]},{"osd":2,"uuid":"ab58d13a-6c68-4ba8-a07d-96744498741d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":22974},{"type":"v1","addr":"172.21.15.49:6801","nonce":22974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":22974},{"type":"v1","addr":"172.21.15.49:6803","nonce":22974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":22974},{"type":"v1","addr":"172.21.15.49:6807","nonce":22974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":22974},{"type":"v1","addr":"172.21.15.49:6805","nonce":22974}]},"public_addr":"172.21.15.49:6801/22974","cluster_addr":"172.21.15.49:6803/22974","heartbeat_back_addr":"172.21.15.49:6807/22974","heartbeat_front_addr":"172.21.15.49:6805/22974","state":["exists","up"]},{"osd":3,"uuid":"420cb179-1cf6-4897-91da-ad00b55f1adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":22977},{"type":"v1","addr":"172.21.15.49:6817","nonce":22977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":22977},{"type":"v1","addr":"172.21.15.49:6819","nonce":22977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":22977},{"type":"v1","addr":"172.21.15.49:6823","nonce":22977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":22977},{"type":"v1","addr":"172.21.15.49:6821","nonce":22977}]},"public_addr":"172.21.15.49:6817/22977","cluster_addr":"172.21.15.49:6819/22977","heartbeat_back_addr":"172.21.15.49:6823/22977","heartbeat_front_addr":"172.21.15.49:6821/22977","state":["exists","up"]},{"osd":4,"uuid":"a5dc6fc9-918f-4dcd-a8b2-9de9ffdc8c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":23256},{"type":"v1","addr":"172.21.15.110:6817","nonce":23256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":23256},{"type":"v1","addr":"172.21.15.110:6819","nonce":23256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":23256},{"type":"v1","addr":"172.21.15.110:6826","nonce":23256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":23256},{"type":"v1","addr":"172.21.15.110:6821","nonce":23256}]},"public_addr":"172.21.15.110:6817/23256","cluster_addr":"172.21.15.110:6819/23256","heartbeat_back_addr":"172.21.15.110:6826/23256","heartbeat_front_addr":"172.21.15.110:6821/23256","state":["exists","up"]},{"osd":5,"uuid":"4c829917-a356-46b7-b3f7-1d0381633228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":23253},{"type":"v1","addr":"172.21.15.110:6801","nonce":23253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":23253},{"type":"v1","addr":"172.21.15.110:6803","nonce":23253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":23253},{"type":"v1","addr":"172.21.15.110:6807","nonce":23253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":23253},{"type":"v1","addr":"172.21.15.110:6805","nonce":23253}]},"public_addr":"172.21.15.110:6801/23253","cluster_addr":"172.21.15.110:6803/23253","heartbeat_back_addr":"172.21.15.110:6807/23253","heartbeat_front_addr":"172.21.15.110:6805/23253","state":["exists","up"]},{"osd":6,"uuid":"4775e21c-633a-4873-86e5-f7b8dbfc89cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":23255},{"type":"v1","addr":"172.21.15.110:6823","nonce":23255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":23255},{"type":"v1","addr":"172.21.15.110:6827","nonce":23255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":23255},{"type":"v1","addr":"172.21.15.110:6831","nonce":23255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":23255},{"type":"v1","addr":"172.21.15.110:6829","nonce":23255}]},"public_addr":"172.21.15.110:6823/23255","cluster_addr":"172.21.15.110:6827/23255","heartbeat_back_addr":"172.21.15.110:6831/23255","heartbeat_front_addr":"172.21.15.110:6829/23255","state":["exists","up"]},{"osd":7,"uuid":"a1f6e936-fae7-4731-95d2-2a7553ba71fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":23254},{"type":"v1","addr":"172.21.15.110:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":23254},{"type":"v1","addr":"172.21.15.110:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":23254},{"type":"v1","addr":"172.21.15.110:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":23254},{"type":"v1","addr":"172.21.15.110:6813","nonce":23254}]},"public_addr":"172.21.15.110:6809/23254","cluster_addr":"172.21.15.110:6811/23254","heartbeat_back_addr":"172.21.15.110:6815/23254","heartbeat_front_addr":"172.21.15.110:6813/23254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.060818+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.203492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.190360+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.270786+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.136103+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.072456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.174577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:04:25.102634+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6837/1689534801":"2024-01-23T05:21:03.939323+0000","172.21.15.49:6835/1689534801":"2024-01-23T05:21:03.939323+0000","172.21.15.49:6837/1585471135":"2024-01-23T05:19:48.627681+0000","172.21.15.49:6835/1585471135":"2024-01-23T05:19:48.627681+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:21:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.677+0000 7f9a62400700 1 -- 172.21.15.49:0/2162108254 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a3405a510 msgr2=0x7f9a3405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.677+0000 7f9a62400700 1 --2- 172.21.15.49:0/2162108254 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a3405a510 0x7f9a3405c9d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f9a5c0bebc0 tx=0x7f9a4c008040).stop 2024-01-22T05:21:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.677+0000 7f9a62400700 1 -- 172.21.15.49:0/2162108254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c0a8c30 msgr2=0x7f9a5c152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.677+0000 7f9a62400700 1 --2- 172.21.15.49:0/2162108254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c0a8c30 0x7f9a5c152860 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 rx=0x7f9a5c059c60 tx=0x7f9a44017000).stop 2024-01-22T05:21:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.677+0000 7f9a62400700 1 -- 172.21.15.49:0/2162108254 shutdown_connections 2024-01-22T05:21:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.677+0000 7f9a62400700 1 --2- 172.21.15.49:0/2162108254 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9a3405a510 0x7f9a3405c9d0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.677+0000 7f9a62400700 1 --2- 172.21.15.49:0/2162108254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a5c155d20 0x7f9a5c0c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.677+0000 7f9a62400700 1 --2- 172.21.15.49:0/2162108254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c0a8c30 0x7f9a5c152860 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.677+0000 7f9a62400700 1 --2- 172.21.15.49:0/2162108254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a5c066070 0x7f9a5c15a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.677+0000 7f9a62400700 1 -- 172.21.15.49:0/2162108254 >> 172.21.15.49:0/2162108254 conn(0x7f9a5c0c6540 msgr2=0x7f9a5c066520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.677+0000 7f9a62400700 1 -- 172.21.15.49:0/2162108254 shutdown_connections 2024-01-22T05:21:12.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:12.677+0000 7f9a62400700 1 -- 172.21.15.49:0/2162108254 wait complete. 2024-01-22T05:21:13.700 INFO:tasks.ceph:Scrubbing osd.0 2024-01-22T05:21:13.701 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:21:13.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.873+0000 7f5126800700 1 Processor -- start 2024-01-22T05:21:13.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.873+0000 7f5126800700 1 -- start start 2024-01-22T05:21:13.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f5126800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51200ac3b0 0x7f5120159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:13.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f5126800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f512015fbc0 0x7f5120161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:13.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f5126800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51200a7cb0 con 0x7f5120066690 2024-01-22T05:21:13.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f5126800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51200a8b10 con 0x7f51200ac3b0 2024-01-22T05:21:13.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f5126800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51200a7f00 con 0x7f512015fbc0 2024-01-22T05:21:13.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f511f400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51200ac3b0 0x7f5120159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:13.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f511ea00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5120066690 0x7f5120066af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45150/0 (socket says 172.21.15.49:45150) 2024-01-22T05:21:13.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f511ea00700 1 -- 172.21.15.49:0/3049680459 learned_addr learned my addr 172.21.15.49:0/3049680459 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:13.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f511fe00700 1 --2- 172.21.15.49:0/3049680459 >> v2:172.21.15.110:3300/0 conn(0x7f512015fbc0 0x7f5120161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:13.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f511e000700 1 -- 172.21.15.49:0/3049680459 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462415777 0 0) 0x7f51200a7cb0 con 0x7f5120066690 2024-01-22T05:21:13.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f511e000700 1 -- 172.21.15.49:0/3049680459 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51000033f0 con 0x7f5120066690 2024-01-22T05:21:13.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f511f400700 1 -- 172.21.15.49:0/3049680459 >> v2:172.21.15.110:3300/0 conn(0x7f512015fbc0 msgr2=0x7f5120161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:13.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f511f400700 1 --2- 172.21.15.49:0/3049680459 >> v2:172.21.15.110:3300/0 conn(0x7f512015fbc0 0x7f5120161fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:13.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f511f400700 1 -- 172.21.15.49:0/3049680459 >> v1:172.21.15.49:6789/0 conn(0x7f5120066690 legacy=0x7f5120066af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:13.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f511f400700 1 -- 172.21.15.49:0/3049680459 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51200a81e0 con 0x7f51200ac3b0 2024-01-22T05:21:13.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f511f400700 1 --2- 172.21.15.49:0/3049680459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51200ac3b0 0x7f5120159000 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 rx=0x7f5120069510 tx=0x7f5110009060).ready entity=mon.0 client_cookie=e4d0018614ebbf93 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:13.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f511e000700 1 -- 172.21.15.49:0/3049680459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000d4a0 con 0x7f51200ac3b0 2024-01-22T05:21:13.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f511e000700 1 -- 172.21.15.49:0/3049680459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511000d600 con 0x7f51200ac3b0 2024-01-22T05:21:13.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.877+0000 7f511e000700 1 -- 172.21.15.49:0/3049680459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000d980 con 0x7f51200ac3b0 2024-01-22T05:21:13.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.881+0000 7f5126800700 1 -- 172.21.15.49:0/3049680459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51200ac3b0 msgr2=0x7f5120159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:13.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.881+0000 7f5126800700 1 --2- 172.21.15.49:0/3049680459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51200ac3b0 0x7f5120159000 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 rx=0x7f5120069510 tx=0x7f5110009060).stop 2024-01-22T05:21:13.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.881+0000 7f5126800700 1 -- 172.21.15.49:0/3049680459 shutdown_connections 2024-01-22T05:21:13.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.881+0000 7f5126800700 1 --2- 172.21.15.49:0/3049680459 >> v2:172.21.15.110:3300/0 conn(0x7f512015fbc0 0x7f5120161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:13.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.881+0000 7f5126800700 1 --2- 172.21.15.49:0/3049680459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51200ac3b0 0x7f5120159000 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:13.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.881+0000 7f5126800700 1 -- 172.21.15.49:0/3049680459 >> 172.21.15.49:0/3049680459 conn(0x7f51200c6500 msgr2=0x7f51200c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:13.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.881+0000 7f5126800700 1 -- 172.21.15.49:0/3049680459 shutdown_connections 2024-01-22T05:21:13.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.881+0000 7f5126800700 1 -- 172.21.15.49:0/3049680459 wait complete. 2024-01-22T05:21:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.885+0000 7f5126800700 1 Processor -- start 2024-01-22T05:21:13.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.885+0000 7f5126800700 1 -- start start 2024-01-22T05:21:13.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.885+0000 7f5126800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5120066690 0x7f5120151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:13.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.885+0000 7f5126800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51200ac3b0 0x7f512015dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:13.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.885+0000 7f5126800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f512015fbc0 0x7f512015ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:13.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.885+0000 7f5126800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512015d950 con 0x7f512015fbc0 2024-01-22T05:21:13.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.885+0000 7f5126800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512015cd40 con 0x7f51200ac3b0 2024-01-22T05:21:13.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.885+0000 7f5126800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512015d020 con 0x7f5120066690 2024-01-22T05:21:13.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f511fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f512015fbc0 0x7f512015ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:13.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f511ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51200ac3b0 0x7f512015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:13.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f511fe00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f512015fbc0 0x7f512015ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60874/0 (socket says 172.21.15.49:60874) 2024-01-22T05:21:13.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f511fe00700 1 -- 172.21.15.49:0/1128190346 learned_addr learned my addr 172.21.15.49:0/1128190346 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:13.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f511f400700 1 --2- 172.21.15.49:0/1128190346 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5120066690 0x7f5120151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f511ea00700 1 -- 172.21.15.49:0/1128190346 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5120066690 msgr2=0x7f5120151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f511ea00700 1 --2- 172.21.15.49:0/1128190346 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5120066690 0x7f5120151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f511ea00700 1 -- 172.21.15.49:0/1128190346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f512015fbc0 msgr2=0x7f512015ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f511ea00700 1 --2- 172.21.15.49:0/1128190346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f512015fbc0 0x7f512015ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f511ea00700 1 -- 172.21.15.49:0/1128190346 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51100092a0 con 0x7f51200ac3b0 2024-01-22T05:21:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f511fe00700 1 --2- 172.21.15.49:0/1128190346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f512015fbc0 0x7f512015ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:21:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f511ea00700 1 --2- 172.21.15.49:0/1128190346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51200ac3b0 0x7f512015dde0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f510800c410 tx=0x7f5108007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:13.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f5116a00700 1 -- 172.21.15.49:0/1128190346 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51080070d0 con 0x7f51200ac3b0 2024-01-22T05:21:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f5116a00700 1 -- 172.21.15.49:0/1128190346 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5108007250 con 0x7f51200ac3b0 2024-01-22T05:21:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f5126800700 1 -- 172.21.15.49:0/1128190346 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512015d300 con 0x7f51200ac3b0 2024-01-22T05:21:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f5116a00700 1 -- 172.21.15.49:0/1128190346 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108007610 con 0x7f51200ac3b0 2024-01-22T05:21:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.889+0000 7f5126800700 1 -- 172.21.15.49:0/1128190346 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51201522f0 con 0x7f51200ac3b0 2024-01-22T05:21:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.893+0000 7f5126800700 1 -- 172.21.15.49:0/1128190346 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5120046800 con 0x7f51200ac3b0 2024-01-22T05:21:13.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.893+0000 7f5116a00700 1 -- 172.21.15.49:0/1128190346 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f51080059b0 con 0x7f51200ac3b0 2024-01-22T05:21:13.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.893+0000 7f5116a00700 1 --2- 172.21.15.49:0/1128190346 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f50f805a540 0x7f50f805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:13.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.893+0000 7f5116a00700 1 -- 172.21.15.49:0/1128190346 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f5108073aa0 con 0x7f51200ac3b0 2024-01-22T05:21:13.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.893+0000 7f511f400700 1 --2- 172.21.15.49:0/1128190346 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f50f805a540 0x7f50f805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:13.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.893+0000 7f5116a00700 1 --2- 172.21.15.49:0/1128190346 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x7f50f8061270 0x7f50f8063710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:13.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.893+0000 7f5116a00700 1 -- 172.21.15.49:0/1128190346 --> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50f8063d90 con 0x7f50f8061270 2024-01-22T05:21:13.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.893+0000 7f5116a00700 1 -- 172.21.15.49:0/1128190346 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51080781e0 con 0x7f51200ac3b0 2024-01-22T05:21:13.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.897+0000 7f511f400700 1 --2- 172.21.15.49:0/1128190346 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f50f805a540 0x7f50f805ca00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f5110009fd0 tx=0x7f5110016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:13.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.897+0000 7f511fe00700 1 --2- 172.21.15.49:0/1128190346 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x7f50f8061270 0x7f50f8063710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:13.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.897+0000 7f511fe00700 1 --2- 172.21.15.49:0/1128190346 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x7f50f8061270 0x7f50f8063710 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:13.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.897+0000 7f5116a00700 1 -- 172.21.15.49:0/1128190346 <== osd.0 v2:172.21.15.49:6808/22975 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f50f8063d90 con 0x7f50f8061270 2024-01-22T05:21:13.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.921+0000 7f5126800700 1 -- 172.21.15.49:0/1128190346 --> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f512015dac0 con 0x7f50f8061270 2024-01-22T05:21:13.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.921+0000 7f5116a00700 1 -- 172.21.15.49:0/1128190346 <== osd.0 v2:172.21.15.49:6808/22975 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f512015dac0 con 0x7f50f8061270 2024-01-22T05:21:13.919 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:21:13.919 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:21:13.920 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:21:13.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.921+0000 7f5126800700 1 -- 172.21.15.49:0/1128190346 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x7f50f8061270 msgr2=0x7f50f8063710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:13.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.921+0000 7f5126800700 1 --2- 172.21.15.49:0/1128190346 >> [v2:172.21.15.49:6808/22975,v1:172.21.15.49:6809/22975] conn(0x7f50f8061270 0x7f50f8063710 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:13.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.921+0000 7f5126800700 1 -- 172.21.15.49:0/1128190346 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f50f805a540 msgr2=0x7f50f805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:13.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.921+0000 7f5126800700 1 --2- 172.21.15.49:0/1128190346 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f50f805a540 0x7f50f805ca00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f5110009fd0 tx=0x7f5110016000).stop 2024-01-22T05:21:13.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.921+0000 7f5126800700 1 -- 172.21.15.49:0/1128190346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51200ac3b0 msgr2=0x7f512015dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:13.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.921+0000 7f5126800700 1 --2- 172.21.15.49:0/1128190346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51200ac3b0 0x7f512015dde0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f510800c410 tx=0x7f5108007b90).stop 2024-01-22T05:21:13.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.921+0000 7f511fe00700 1 -- 172.21.15.49:0/1128190346 reap_dead start 2024-01-22T05:21:13.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.921+0000 7f5126800700 1 -- 172.21.15.49:0/1128190346 shutdown_connections 2024-01-22T05:21:13.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.921+0000 7f5126800700 1 -- 172.21.15.49:0/1128190346 >> 172.21.15.49:0/1128190346 conn(0x7f51200c6500 msgr2=0x7f51200c51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:13.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.921+0000 7f5126800700 1 -- 172.21.15.49:0/1128190346 shutdown_connections 2024-01-22T05:21:13.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:13.921+0000 7f5126800700 1 -- 172.21.15.49:0/1128190346 wait complete. 2024-01-22T05:21:13.944 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-22T05:21:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.113+0000 7f4f49800700 1 Processor -- start 2024-01-22T05:21:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.117+0000 7f4f49800700 1 -- start start 2024-01-22T05:21:14.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.117+0000 7f4f49800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f44155d20 0x7f4f44065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.117+0000 7f4f49800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f440a8e50 0x7f4f440c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.117+0000 7f4f49800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f440c1a40 con 0x7f4f44066070 2024-01-22T05:21:14.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.117+0000 7f4f49800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f44159310 con 0x7f4f44155d20 2024-01-22T05:21:14.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.117+0000 7f4f49800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f440c13f0 con 0x7f4f440a8e50 2024-01-22T05:21:14.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.117+0000 7f4f42a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f44155d20 0x7f4f44065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.117+0000 7f4f42a00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4f44155d20 0x7f4f44065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60884/0 (socket says 172.21.15.49:60884) 2024-01-22T05:21:14.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.117+0000 7f4f42a00700 1 -- 172.21.15.49:0/3008000322 learned_addr learned my addr 172.21.15.49:0/3008000322 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:14.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.117+0000 7f4f43400700 1 --2- 172.21.15.49:0/3008000322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f440a8e50 0x7f4f440c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.117+0000 7f4f42a00700 1 -- 172.21.15.49:0/3008000322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f440a8e50 msgr2=0x7f4f440c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:14.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.117+0000 7f4f42a00700 1 --2- 172.21.15.49:0/3008000322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f440a8e50 0x7f4f440c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.117+0000 7f4f42a00700 1 -- 172.21.15.49:0/3008000322 >> v1:172.21.15.110:6789/0 conn(0x7f4f44066070 legacy=0x7f4f440a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.117+0000 7f4f42a00700 1 -- 172.21.15.49:0/3008000322 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f440c16d0 con 0x7f4f44155d20 2024-01-22T05:21:14.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.117+0000 7f4f42a00700 1 --2- 172.21.15.49:0/3008000322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f44155d20 0x7f4f44065b80 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 rx=0x7f4f34006fd0 tx=0x7f4f340090f0).ready entity=mon.0 client_cookie=2bc96d5ebb31a907 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:14.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.121+0000 7f4f41600700 1 -- 172.21.15.49:0/3008000322 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400b600 con 0x7f4f44155d20 2024-01-22T05:21:14.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.121+0000 7f4f41600700 1 -- 172.21.15.49:0/3008000322 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3400b760 con 0x7f4f44155d20 2024-01-22T05:21:14.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.121+0000 7f4f41600700 1 -- 172.21.15.49:0/3008000322 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400bae0 con 0x7f4f44155d20 2024-01-22T05:21:14.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.121+0000 7f4f49800700 1 -- 172.21.15.49:0/3008000322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f44155d20 msgr2=0x7f4f44065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.121+0000 7f4f49800700 1 --2- 172.21.15.49:0/3008000322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f44155d20 0x7f4f44065b80 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 rx=0x7f4f34006fd0 tx=0x7f4f340090f0).stop 2024-01-22T05:21:14.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.121+0000 7f4f49800700 1 -- 172.21.15.49:0/3008000322 shutdown_connections 2024-01-22T05:21:14.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.121+0000 7f4f49800700 1 --2- 172.21.15.49:0/3008000322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f440a8e50 0x7f4f440c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.121+0000 7f4f49800700 1 --2- 172.21.15.49:0/3008000322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f44155d20 0x7f4f44065b80 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.121+0000 7f4f49800700 1 -- 172.21.15.49:0/3008000322 >> 172.21.15.49:0/3008000322 conn(0x7f4f440c6540 msgr2=0x7f4f440c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:14.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.121+0000 7f4f49800700 1 -- 172.21.15.49:0/3008000322 shutdown_connections 2024-01-22T05:21:14.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.121+0000 7f4f49800700 1 -- 172.21.15.49:0/3008000322 wait complete. 2024-01-22T05:21:14.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.125+0000 7f4f49800700 1 Processor -- start 2024-01-22T05:21:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.125+0000 7f4f49800700 1 -- start start 2024-01-22T05:21:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f49800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f44066070 0x7f4f44168860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f49800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f440a8e50 0x7f4f44152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f49800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f44155d20 0x7f4f4416c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f49800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f440a9870 con 0x7f4f44155d20 2024-01-22T05:21:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f49800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4416be60 con 0x7f4f440a8e50 2024-01-22T05:21:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f49800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4416c140 con 0x7f4f44066070 2024-01-22T05:21:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f43400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f44155d20 0x7f4f4416c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f43400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f44155d20 0x7f4f4416c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60900/0 (socket says 172.21.15.49:60900) 2024-01-22T05:21:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f43400700 1 -- 172.21.15.49:0/3103441172 learned_addr learned my addr 172.21.15.49:0/3103441172 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:14.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f42000700 1 --2- 172.21.15.49:0/3103441172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f440a8e50 0x7f4f44152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f42a00700 1 --2- 172.21.15.49:0/3103441172 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f44066070 0x7f4f44168860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f43400700 1 -- 172.21.15.49:0/3103441172 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f44066070 msgr2=0x7f4f44168860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f43400700 1 --2- 172.21.15.49:0/3103441172 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f44066070 0x7f4f44168860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f43400700 1 -- 172.21.15.49:0/3103441172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f440a8e50 msgr2=0x7f4f44152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f43400700 1 --2- 172.21.15.49:0/3103441172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f440a8e50 0x7f4f44152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f43400700 1 -- 172.21.15.49:0/3103441172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f34009370 con 0x7f4f44155d20 2024-01-22T05:21:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f43400700 1 --2- 172.21.15.49:0/3103441172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f44155d20 0x7f4f4416c5d0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 rx=0x7f4f3c009fd0 tx=0x7f4f3c009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f3a000700 1 -- 172.21.15.49:0/3103441172 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c00ebf0 con 0x7f4f44155d20 2024-01-22T05:21:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f3a000700 1 -- 172.21.15.49:0/3103441172 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c00ed50 con 0x7f4f44155d20 2024-01-22T05:21:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f3a000700 1 -- 172.21.15.49:0/3103441172 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c014610 con 0x7f4f44155d20 2024-01-22T05:21:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f49800700 1 -- 172.21.15.49:0/3103441172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f44169070 con 0x7f4f44155d20 2024-01-22T05:21:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.129+0000 7f4f49800700 1 -- 172.21.15.49:0/3103441172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f44169630 con 0x7f4f44155d20 2024-01-22T05:21:14.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.133+0000 7f4f49800700 1 -- 172.21.15.49:0/3103441172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f44047060 con 0x7f4f44155d20 2024-01-22T05:21:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.133+0000 7f4f3a000700 1 -- 172.21.15.49:0/3103441172 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4f3c01d3b0 con 0x7f4f44155d20 2024-01-22T05:21:14.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.133+0000 7f4f3a000700 1 --2- 172.21.15.49:0/3103441172 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f1c05a510 0x7f4f1c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.133+0000 7f4f3a000700 1 -- 172.21.15.49:0/3103441172 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f4f3c074a90 con 0x7f4f44155d20 2024-01-22T05:21:14.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.133+0000 7f4f42a00700 1 --2- 172.21.15.49:0/3103441172 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f1c05a510 0x7f4f1c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.137+0000 7f4f42a00700 1 --2- 172.21.15.49:0/3103441172 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f1c05a510 0x7f4f1c05c9d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f4f34009130 tx=0x7f4f34017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:14.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.141+0000 7f4f3a000700 1 -- 172.21.15.49:0/3103441172 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4f3c048350 con 0x7f4f44155d20 2024-01-22T05:21:14.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.309+0000 7f4f49800700 1 -- 172.21.15.49:0/3103441172 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f440c23c0 con 0x7f4f1c05a510 2024-01-22T05:21:14.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.309+0000 7f4f3a000700 1 -- 172.21.15.49:0/3103441172 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4f440c23c0 con 0x7f4f1c05a510 2024-01-22T05:21:14.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.313+0000 7f4f49800700 1 -- 172.21.15.49:0/3103441172 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f1c05a510 msgr2=0x7f4f1c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.313+0000 7f4f49800700 1 --2- 172.21.15.49:0/3103441172 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f1c05a510 0x7f4f1c05c9d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f4f34009130 tx=0x7f4f34017000).stop 2024-01-22T05:21:14.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.313+0000 7f4f49800700 1 -- 172.21.15.49:0/3103441172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f44155d20 msgr2=0x7f4f4416c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.313+0000 7f4f49800700 1 --2- 172.21.15.49:0/3103441172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f44155d20 0x7f4f4416c5d0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 rx=0x7f4f3c009fd0 tx=0x7f4f3c009900).stop 2024-01-22T05:21:14.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.313+0000 7f4f49800700 1 -- 172.21.15.49:0/3103441172 shutdown_connections 2024-01-22T05:21:14.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.313+0000 7f4f49800700 1 --2- 172.21.15.49:0/3103441172 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f4f1c05a510 0x7f4f1c05c9d0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.313+0000 7f4f49800700 1 --2- 172.21.15.49:0/3103441172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f44155d20 0x7f4f4416c5d0 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.313+0000 7f4f49800700 1 --2- 172.21.15.49:0/3103441172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f440a8e50 0x7f4f44152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.313+0000 7f4f49800700 1 --2- 172.21.15.49:0/3103441172 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f44066070 0x7f4f44168860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.313+0000 7f4f49800700 1 -- 172.21.15.49:0/3103441172 >> 172.21.15.49:0/3103441172 conn(0x7f4f440c6540 msgr2=0x7f4f44153840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:14.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.313+0000 7f4f49800700 1 -- 172.21.15.49:0/3103441172 shutdown_connections 2024-01-22T05:21:14.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.313+0000 7f4f49800700 1 -- 172.21.15.49:0/3103441172 wait complete. 2024-01-22T05:21:14.317 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 0 to deep-scrub 2024-01-22T05:21:14.336 INFO:tasks.ceph:Scrubbing osd.1 2024-01-22T05:21:14.336 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:21:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.509+0000 7fde30800700 1 Processor -- start 2024-01-22T05:21:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.513+0000 7fde30800700 1 -- start start 2024-01-22T05:21:14.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.517+0000 7fde30800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fde280c1bf0 0x7fde28063b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.517+0000 7fde30800700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde280c4580 con 0x7fde280c7090 2024-01-22T05:21:14.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.517+0000 7fde30800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde280c4860 con 0x7fde280ab200 2024-01-22T05:21:14.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.517+0000 7fde30800700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde280c4b40 con 0x7fde280c1bf0 2024-01-22T05:21:14.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.517+0000 7fde2de00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fde280c1bf0 0x7fde28063b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.517+0000 7fde2e800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fde280c7090 0x7fde28062750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45162/0 (socket says 172.21.15.49:45162) 2024-01-22T05:21:14.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.517+0000 7fde2e800700 1 -- 172.21.15.49:0/1738154615 learned_addr learned my addr 172.21.15.49:0/1738154615 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:14.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.517+0000 7fde2de00700 1 -- 172.21.15.49:0/1738154615 >> v1:172.21.15.110:6789/0 conn(0x7fde280ab200 legacy=0x7fde280c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.517+0000 7fde2ca00700 1 -- 172.21.15.49:0/1738154615 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139424458 0 0) 0x7fde280c4580 con 0x7fde280c7090 2024-01-22T05:21:14.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.517+0000 7fde2de00700 1 -- 172.21.15.49:0/1738154615 >> v1:172.21.15.49:6789/0 conn(0x7fde280c7090 legacy=0x7fde28062750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.517+0000 7fde2de00700 1 -- 172.21.15.49:0/1738154615 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde280c4e20 con 0x7fde280c1bf0 2024-01-22T05:21:14.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.517+0000 7fde2de00700 1 --2- 172.21.15.49:0/1738154615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde280c1bf0 0x7fde28063b40 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 rx=0x7fde18006fd0 tx=0x7fde18006f40).ready entity=mon.0 client_cookie=22eb19d5662e1daf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:14.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.517+0000 7fde2ca00700 1 -- 172.21.15.49:0/1738154615 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde18005880 con 0x7fde280c1bf0 2024-01-22T05:21:14.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.517+0000 7fde2ca00700 1 -- 172.21.15.49:0/1738154615 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde180059e0 con 0x7fde280c1bf0 2024-01-22T05:21:14.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.517+0000 7fde2ca00700 1 -- 172.21.15.49:0/1738154615 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde18005d60 con 0x7fde280c1bf0 2024-01-22T05:21:14.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.521+0000 7fde30800700 1 -- 172.21.15.49:0/1738154615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde280c1bf0 msgr2=0x7fde28063b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.521+0000 7fde30800700 1 --2- 172.21.15.49:0/1738154615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde280c1bf0 0x7fde28063b40 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 rx=0x7fde18006fd0 tx=0x7fde18006f40).stop 2024-01-22T05:21:14.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.521+0000 7fde30800700 1 -- 172.21.15.49:0/1738154615 shutdown_connections 2024-01-22T05:21:14.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.521+0000 7fde30800700 1 --2- 172.21.15.49:0/1738154615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde280c1bf0 0x7fde28063b40 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.521+0000 7fde30800700 1 -- 172.21.15.49:0/1738154615 >> 172.21.15.49:0/1738154615 conn(0x7fde280aa670 msgr2=0x7fde280aaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:14.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.521+0000 7fde30800700 1 -- 172.21.15.49:0/1738154615 shutdown_connections 2024-01-22T05:21:14.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.521+0000 7fde30800700 1 -- 172.21.15.49:0/1738154615 wait complete. 2024-01-22T05:21:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.525+0000 7fde30800700 1 Processor -- start 2024-01-22T05:21:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.525+0000 7fde30800700 1 -- start start 2024-01-22T05:21:14.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde30800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde280ab200 0x7fde280c1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde30800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde280c1bf0 0x7fde281578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde30800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde280c7090 0x7fde2814c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde30800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde280a4360 con 0x7fde280c7090 2024-01-22T05:21:14.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde30800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde280a4640 con 0x7fde280ab200 2024-01-22T05:21:14.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde30800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde28158080 con 0x7fde280c1bf0 2024-01-22T05:21:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde2e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde280c7090 0x7fde2814c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde2e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde280c7090 0x7fde2814c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60926/0 (socket says 172.21.15.49:60926) 2024-01-22T05:21:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde2e800700 1 -- 172.21.15.49:0/817435979 learned_addr learned my addr 172.21.15.49:0/817435979 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde2de00700 1 --2- 172.21.15.49:0/817435979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde280ab200 0x7fde280c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde2d400700 1 --2- 172.21.15.49:0/817435979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde280c1bf0 0x7fde281578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde2e800700 1 -- 172.21.15.49:0/817435979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde280c1bf0 msgr2=0x7fde281578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde2e800700 1 --2- 172.21.15.49:0/817435979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde280c1bf0 0x7fde281578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde2e800700 1 -- 172.21.15.49:0/817435979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde280ab200 msgr2=0x7fde280c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde2e800700 1 --2- 172.21.15.49:0/817435979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde280ab200 0x7fde280c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde2e800700 1 -- 172.21.15.49:0/817435979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde18009250 con 0x7fde280c7090 2024-01-22T05:21:14.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde2de00700 1 --2- 172.21.15.49:0/817435979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde280ab200 0x7fde280c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:21:14.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde2e800700 1 --2- 172.21.15.49:0/817435979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde280c7090 0x7fde2814c470 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 rx=0x7fde2000c760 tx=0x7fde20001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:14.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde25600700 1 -- 172.21.15.49:0/817435979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20005d30 con 0x7fde280c7090 2024-01-22T05:21:14.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde25600700 1 -- 172.21.15.49:0/817435979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde20005e90 con 0x7fde280c7090 2024-01-22T05:21:14.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde25600700 1 -- 172.21.15.49:0/817435979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20007340 con 0x7fde280c7090 2024-01-22T05:21:14.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde30800700 1 -- 172.21.15.49:0/817435979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde28158360 con 0x7fde280c7090 2024-01-22T05:21:14.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.529+0000 7fde30800700 1 -- 172.21.15.49:0/817435979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde28157d90 con 0x7fde280c7090 2024-01-22T05:21:14.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.533+0000 7fde30800700 1 -- 172.21.15.49:0/817435979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde280a68c0 con 0x7fde280c7090 2024-01-22T05:21:14.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.533+0000 7fde25600700 1 -- 172.21.15.49:0/817435979 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fde200076f0 con 0x7fde280c7090 2024-01-22T05:21:14.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.537+0000 7fde25600700 1 --2- 172.21.15.49:0/817435979 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde0005a510 0x7fde0005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.537+0000 7fde25600700 1 -- 172.21.15.49:0/817435979 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7fde200746e0 con 0x7fde280c7090 2024-01-22T05:21:14.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.537+0000 7fde25600700 1 --2- 172.21.15.49:0/817435979 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x7fde000611c0 0x7fde00063660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.537+0000 7fde25600700 1 -- 172.21.15.49:0/817435979 --> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde00063ce0 con 0x7fde000611c0 2024-01-22T05:21:14.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.537+0000 7fde25600700 1 -- 172.21.15.49:0/817435979 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde20076c40 con 0x7fde280c7090 2024-01-22T05:21:14.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.537+0000 7fde2de00700 1 --2- 172.21.15.49:0/817435979 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde0005a510 0x7fde0005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.537+0000 7fde2d400700 1 --2- 172.21.15.49:0/817435979 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x7fde000611c0 0x7fde00063660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.537+0000 7fde2de00700 1 --2- 172.21.15.49:0/817435979 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde0005a510 0x7fde0005c9d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fde18006fa0 tx=0x7fde18016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:14.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.537+0000 7fde2d400700 1 --2- 172.21.15.49:0/817435979 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x7fde000611c0 0x7fde00063660 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:14.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.537+0000 7fde25600700 1 -- 172.21.15.49:0/817435979 <== osd.1 v2:172.21.15.49:6824/22976 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fde00063ce0 con 0x7fde000611c0 2024-01-22T05:21:14.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.557+0000 7fde30800700 1 -- 172.21.15.49:0/817435979 --> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fde280647e0 con 0x7fde000611c0 2024-01-22T05:21:14.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.557+0000 7fde25600700 1 -- 172.21.15.49:0/817435979 <== osd.1 v2:172.21.15.49:6824/22976 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fde280647e0 con 0x7fde000611c0 2024-01-22T05:21:14.556 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:21:14.556 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:21:14.556 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:21:14.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.557+0000 7fde30800700 1 -- 172.21.15.49:0/817435979 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x7fde000611c0 msgr2=0x7fde00063660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.557+0000 7fde30800700 1 --2- 172.21.15.49:0/817435979 >> [v2:172.21.15.49:6824/22976,v1:172.21.15.49:6825/22976] conn(0x7fde000611c0 0x7fde00063660 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.557+0000 7fde30800700 1 -- 172.21.15.49:0/817435979 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde0005a510 msgr2=0x7fde0005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.557+0000 7fde30800700 1 --2- 172.21.15.49:0/817435979 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fde0005a510 0x7fde0005c9d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fde18006fa0 tx=0x7fde18016000).stop 2024-01-22T05:21:14.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.557+0000 7fde30800700 1 -- 172.21.15.49:0/817435979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde280c7090 msgr2=0x7fde2814c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.557+0000 7fde30800700 1 --2- 172.21.15.49:0/817435979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde280c7090 0x7fde2814c470 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 rx=0x7fde2000c760 tx=0x7fde20001520).stop 2024-01-22T05:21:14.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.557+0000 7fde2e800700 1 -- 172.21.15.49:0/817435979 reap_dead start 2024-01-22T05:21:14.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.557+0000 7fde30800700 1 -- 172.21.15.49:0/817435979 shutdown_connections 2024-01-22T05:21:14.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.557+0000 7fde30800700 1 -- 172.21.15.49:0/817435979 >> 172.21.15.49:0/817435979 conn(0x7fde280aa670 msgr2=0x7fde28156740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:14.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.557+0000 7fde30800700 1 -- 172.21.15.49:0/817435979 shutdown_connections 2024-01-22T05:21:14.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.557+0000 7fde30800700 1 -- 172.21.15.49:0/817435979 wait complete. 2024-01-22T05:21:14.582 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-22T05:21:14.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.753+0000 7fe07f000700 1 Processor -- start 2024-01-22T05:21:14.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.753+0000 7fe07f000700 1 -- start start 2024-01-22T05:21:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.757+0000 7fe07f000700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe078066fb0 0x7fe0780c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.757+0000 7fe07f000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780a8b10 0x7fe078157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.757+0000 7fe07f000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0780c1ee0 con 0x7fe0780a8f90 2024-01-22T05:21:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.757+0000 7fe07f000700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0780c12f0 con 0x7fe078066fb0 2024-01-22T05:21:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.757+0000 7fe07f000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780c15b0 con 0x7fe0780a8b10 2024-01-22T05:21:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.757+0000 7fe07d000700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe0780a8f90 0x7fe078065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45170/0 (socket says 172.21.15.49:45170) 2024-01-22T05:21:14.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe07d000700 1 -- 172.21.15.49:0/347045315 learned_addr learned my addr 172.21.15.49:0/347045315 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:14.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe077e00700 1 --2- 172.21.15.49:0/347045315 >> v2:172.21.15.110:3300/0 conn(0x7fe078066fb0 0x7fe0780c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe077400700 1 --2- 172.21.15.49:0/347045315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780a8b10 0x7fe078157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe076a00700 1 -- 172.21.15.49:0/347045315 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719709448 0 0) 0x7fe0780c1ee0 con 0x7fe0780a8f90 2024-01-22T05:21:14.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe076a00700 1 -- 172.21.15.49:0/347045315 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0580033f0 con 0x7fe0780a8f90 2024-01-22T05:21:14.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe077e00700 1 -- 172.21.15.49:0/347045315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780a8b10 msgr2=0x7fe078157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:14.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe077e00700 1 --2- 172.21.15.49:0/347045315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780a8b10 0x7fe078157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe077e00700 1 -- 172.21.15.49:0/347045315 >> v1:172.21.15.49:6789/0 conn(0x7fe0780a8f90 legacy=0x7fe078065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe077e00700 1 -- 172.21.15.49:0/347045315 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780c1890 con 0x7fe078066fb0 2024-01-22T05:21:14.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe077400700 1 --2- 172.21.15.49:0/347045315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780a8b10 0x7fe078157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:21:14.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe077e00700 1 --2- 172.21.15.49:0/347045315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078066fb0 0x7fe0780c2370 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fe068009760 tx=0x7fe068009060).ready entity=mon.1 client_cookie=81cdf2f3e8dd2593 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:14.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe076a00700 1 -- 172.21.15.49:0/347045315 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06800d4a0 con 0x7fe078066fb0 2024-01-22T05:21:14.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe076a00700 1 -- 172.21.15.49:0/347045315 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06800d600 con 0x7fe078066fb0 2024-01-22T05:21:14.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe076a00700 1 -- 172.21.15.49:0/347045315 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06800d980 con 0x7fe078066fb0 2024-01-22T05:21:14.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe07f000700 1 -- 172.21.15.49:0/347045315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078066fb0 msgr2=0x7fe0780c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe07f000700 1 --2- 172.21.15.49:0/347045315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078066fb0 0x7fe0780c2370 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fe068009760 tx=0x7fe068009060).stop 2024-01-22T05:21:14.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe07f000700 1 -- 172.21.15.49:0/347045315 shutdown_connections 2024-01-22T05:21:14.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe07f000700 1 --2- 172.21.15.49:0/347045315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780a8b10 0x7fe078157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe07f000700 1 --2- 172.21.15.49:0/347045315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078066fb0 0x7fe0780c2370 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.761+0000 7fe07f000700 1 -- 172.21.15.49:0/347045315 >> 172.21.15.49:0/347045315 conn(0x7fe0780c6540 msgr2=0x7fe0780c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:14.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.765+0000 7fe07f000700 1 -- 172.21.15.49:0/347045315 shutdown_connections 2024-01-22T05:21:14.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.765+0000 7fe07f000700 1 -- 172.21.15.49:0/347045315 wait complete. 2024-01-22T05:21:14.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.765+0000 7fe07f000700 1 Processor -- start 2024-01-22T05:21:14.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.765+0000 7fe07f000700 1 -- start start 2024-01-22T05:21:14.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe07f000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078066fb0 0x7fe078149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe07f000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0780a8b10 0x7fe0781463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe07f000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780a8f90 0x7fe0780ab720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe07f000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780ac560 con 0x7fe0780a8b10 2024-01-22T05:21:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe07f000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07814a6d0 con 0x7fe078066fb0 2024-01-22T05:21:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe07f000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe078149760 con 0x7fe0780a8f90 2024-01-22T05:21:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe077400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0780a8b10 0x7fe0781463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe077400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0780a8b10 0x7fe0781463d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60932/0 (socket says 172.21.15.49:60932) 2024-01-22T05:21:14.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe077400700 1 -- 172.21.15.49:0/422235703 learned_addr learned my addr 172.21.15.49:0/422235703 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:14.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe07d000700 1 --2- 172.21.15.49:0/422235703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780a8f90 0x7fe0780ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe077e00700 1 --2- 172.21.15.49:0/422235703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078066fb0 0x7fe078149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe077400700 1 -- 172.21.15.49:0/422235703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780a8f90 msgr2=0x7fe0780ab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe077400700 1 --2- 172.21.15.49:0/422235703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780a8f90 0x7fe0780ab720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe077400700 1 -- 172.21.15.49:0/422235703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078066fb0 msgr2=0x7fe078149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe077400700 1 --2- 172.21.15.49:0/422235703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078066fb0 0x7fe078149270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe077400700 1 -- 172.21.15.49:0/422235703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0600092a0 con 0x7fe0780a8b10 2024-01-22T05:21:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe077400700 1 --2- 172.21.15.49:0/422235703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0780a8b10 0x7fe0781463d0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 rx=0x7fe06000ea50 tx=0x7fe060009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe06f400700 1 -- 172.21.15.49:0/422235703 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06000c850 con 0x7fe0780a8b10 2024-01-22T05:21:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe06f400700 1 -- 172.21.15.49:0/422235703 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06000c9b0 con 0x7fe0780a8b10 2024-01-22T05:21:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe06f400700 1 -- 172.21.15.49:0/422235703 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06000cd30 con 0x7fe0780a8b10 2024-01-22T05:21:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe07f000700 1 -- 172.21.15.49:0/422235703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0680092a0 con 0x7fe0780a8b10 2024-01-22T05:21:14.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.769+0000 7fe07f000700 1 -- 172.21.15.49:0/422235703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe078149cc0 con 0x7fe0780a8b10 2024-01-22T05:21:14.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.773+0000 7fe07f000700 1 -- 172.21.15.49:0/422235703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07814a880 con 0x7fe0780a8b10 2024-01-22T05:21:14.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.773+0000 7fe06f400700 1 -- 172.21.15.49:0/422235703 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe060012600 con 0x7fe0780a8b10 2024-01-22T05:21:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.773+0000 7fe06f400700 1 --2- 172.21.15.49:0/422235703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05005a510 0x7fe05005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.773+0000 7fe06f400700 1 -- 172.21.15.49:0/422235703 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7fe060074de0 con 0x7fe0780a8b10 2024-01-22T05:21:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.773+0000 7fe077e00700 1 --2- 172.21.15.49:0/422235703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05005a510 0x7fe05005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.777+0000 7fe077e00700 1 --2- 172.21.15.49:0/422235703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05005a510 0x7fe05005c9d0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7fe06800d260 tx=0x7fe068016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:14.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.781+0000 7fe06f400700 1 -- 172.21.15.49:0/422235703 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe07814a880 con 0x7fe0780a8b10 2024-01-22T05:21:14.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.949+0000 7fe07f000700 1 -- 172.21.15.49:0/422235703 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe07814a880 con 0x7fe05005a510 2024-01-22T05:21:14.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.953+0000 7fe06f400700 1 -- 172.21.15.49:0/422235703 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe07814a880 con 0x7fe05005a510 2024-01-22T05:21:14.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.957+0000 7fe07f000700 1 -- 172.21.15.49:0/422235703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05005a510 msgr2=0x7fe05005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.957+0000 7fe07f000700 1 --2- 172.21.15.49:0/422235703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05005a510 0x7fe05005c9d0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7fe06800d260 tx=0x7fe068016000).stop 2024-01-22T05:21:14.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.957+0000 7fe07f000700 1 -- 172.21.15.49:0/422235703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0780a8b10 msgr2=0x7fe0781463d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:14.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.957+0000 7fe07f000700 1 --2- 172.21.15.49:0/422235703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0780a8b10 0x7fe0781463d0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 rx=0x7fe06000ea50 tx=0x7fe060009060).stop 2024-01-22T05:21:14.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.957+0000 7fe07f000700 1 -- 172.21.15.49:0/422235703 shutdown_connections 2024-01-22T05:21:14.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.957+0000 7fe07f000700 1 --2- 172.21.15.49:0/422235703 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fe05005a510 0x7fe05005c9d0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.957+0000 7fe07f000700 1 --2- 172.21.15.49:0/422235703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0780a8f90 0x7fe0780ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.957+0000 7fe07f000700 1 --2- 172.21.15.49:0/422235703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0780a8b10 0x7fe0781463d0 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.957+0000 7fe07f000700 1 --2- 172.21.15.49:0/422235703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078066fb0 0x7fe078149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:14.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.957+0000 7fe07f000700 1 -- 172.21.15.49:0/422235703 >> 172.21.15.49:0/422235703 conn(0x7fe0780c6540 msgr2=0x7fe078154010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:14.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.957+0000 7fe07f000700 1 -- 172.21.15.49:0/422235703 shutdown_connections 2024-01-22T05:21:14.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:14.957+0000 7fe07f000700 1 -- 172.21.15.49:0/422235703 wait complete. 2024-01-22T05:21:14.960 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 1 to deep-scrub 2024-01-22T05:21:14.978 INFO:tasks.ceph:Scrubbing osd.2 2024-01-22T05:21:14.978 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:21:15.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.153+0000 7fce71400700 1 Processor -- start 2024-01-22T05:21:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.153+0000 7fce71400700 1 -- start start 2024-01-22T05:21:15.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.157+0000 7fce71400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce6c067eb0 0x7fce6c0bdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.157+0000 7fce71400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce6c0be650 0x7fce6c0a8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce71400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6c0c3870 con 0x7fce6c0be1f0 2024-01-22T05:21:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce71400700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6c151db0 con 0x7fce6c067eb0 2024-01-22T05:21:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce71400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c068290 con 0x7fce6c0be650 2024-01-22T05:21:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce6be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce6c067eb0 0x7fce6c0bdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce6be00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce6c067eb0 0x7fce6c0bdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60936/0 (socket says 172.21.15.49:60936) 2024-01-22T05:21:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce6be00700 1 -- 172.21.15.49:0/3487168824 learned_addr learned my addr 172.21.15.49:0/3487168824 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce70a00700 1 --2- 172.21.15.49:0/3487168824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce6c0be650 0x7fce6c0a8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce6be00700 1 -- 172.21.15.49:0/3487168824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce6c0be650 msgr2=0x7fce6c0a8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce6be00700 1 --2- 172.21.15.49:0/3487168824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce6c0be650 0x7fce6c0a8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce6be00700 1 -- 172.21.15.49:0/3487168824 >> v1:172.21.15.110:6789/0 conn(0x7fce6c0be1f0 legacy=0x7fce6c0a8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce6be00700 1 -- 172.21.15.49:0/3487168824 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c0beae0 con 0x7fce6c067eb0 2024-01-22T05:21:15.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce6be00700 1 --2- 172.21.15.49:0/3487168824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce6c067eb0 0x7fce6c0bdd00 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 rx=0x7fce5c006fd0 tx=0x7fce5c0090f0).ready entity=mon.0 client_cookie=2df8715aebd307c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:15.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce6aa00700 1 -- 172.21.15.49:0/3487168824 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c00b580 con 0x7fce6c067eb0 2024-01-22T05:21:15.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce6aa00700 1 -- 172.21.15.49:0/3487168824 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c00b6e0 con 0x7fce6c067eb0 2024-01-22T05:21:15.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce6aa00700 1 -- 172.21.15.49:0/3487168824 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c00ba60 con 0x7fce6c067eb0 2024-01-22T05:21:15.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce71400700 1 -- 172.21.15.49:0/3487168824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce6c067eb0 msgr2=0x7fce6c0bdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce71400700 1 --2- 172.21.15.49:0/3487168824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce6c067eb0 0x7fce6c0bdd00 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 rx=0x7fce5c006fd0 tx=0x7fce5c0090f0).stop 2024-01-22T05:21:15.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce71400700 1 -- 172.21.15.49:0/3487168824 shutdown_connections 2024-01-22T05:21:15.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce71400700 1 --2- 172.21.15.49:0/3487168824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce6c0be650 0x7fce6c0a8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce71400700 1 --2- 172.21.15.49:0/3487168824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce6c067eb0 0x7fce6c0bdd00 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.161+0000 7fce71400700 1 -- 172.21.15.49:0/3487168824 >> 172.21.15.49:0/3487168824 conn(0x7fce6c0c51a0 msgr2=0x7fce6c0c55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:15.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.165+0000 7fce71400700 1 -- 172.21.15.49:0/3487168824 shutdown_connections 2024-01-22T05:21:15.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.165+0000 7fce71400700 1 -- 172.21.15.49:0/3487168824 wait complete. 2024-01-22T05:21:15.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.165+0000 7fce71400700 1 Processor -- start 2024-01-22T05:21:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.169+0000 7fce71400700 1 -- start start 2024-01-22T05:21:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.169+0000 7fce71400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce6c067eb0 0x7fce6c150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.169+0000 7fce71400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce6c0be1f0 0x7fce6c169db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.169+0000 7fce71400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce6c0be650 0x7fce6c16b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.169+0000 7fce71400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c16b330 con 0x7fce6c0be1f0 2024-01-22T05:21:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.169+0000 7fce71400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c150c80 con 0x7fce6c0be650 2024-01-22T05:21:15.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.169+0000 7fce71400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c16a720 con 0x7fce6c067eb0 2024-01-22T05:21:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.169+0000 7fce6b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce6c0be1f0 0x7fce6c169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.169+0000 7fce6b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce6c0be1f0 0x7fce6c169db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60944/0 (socket says 172.21.15.49:60944) 2024-01-22T05:21:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.169+0000 7fce6b400700 1 -- 172.21.15.49:0/3163061501 learned_addr learned my addr 172.21.15.49:0/3163061501 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.169+0000 7fce6be00700 1 --2- 172.21.15.49:0/3163061501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce6c067eb0 0x7fce6c150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.169+0000 7fce70a00700 1 --2- 172.21.15.49:0/3163061501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce6c0be650 0x7fce6c16b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.173+0000 7fce6b400700 1 -- 172.21.15.49:0/3163061501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce6c067eb0 msgr2=0x7fce6c150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.173+0000 7fce6b400700 1 --2- 172.21.15.49:0/3163061501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce6c067eb0 0x7fce6c150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.173+0000 7fce6b400700 1 -- 172.21.15.49:0/3163061501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce6c0be650 msgr2=0x7fce6c16b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.173+0000 7fce6b400700 1 --2- 172.21.15.49:0/3163061501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce6c0be650 0x7fce6c16b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.173+0000 7fce6b400700 1 -- 172.21.15.49:0/3163061501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c009370 con 0x7fce6c0be1f0 2024-01-22T05:21:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.173+0000 7fce70a00700 1 --2- 172.21.15.49:0/3163061501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce6c0be650 0x7fce6c16b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:21:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.173+0000 7fce6b400700 1 --2- 172.21.15.49:0/3163061501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce6c0be1f0 0x7fce6c169db0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 rx=0x7fce5400c4c0 tx=0x7fce54007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.173+0000 7fce63400700 1 -- 172.21.15.49:0/3163061501 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5400ce70 con 0x7fce6c0be1f0 2024-01-22T05:21:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.173+0000 7fce63400700 1 -- 172.21.15.49:0/3163061501 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce54001e90 con 0x7fce6c0be1f0 2024-01-22T05:21:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.173+0000 7fce71400700 1 -- 172.21.15.49:0/3163061501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6c16aa00 con 0x7fce6c0be1f0 2024-01-22T05:21:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.173+0000 7fce63400700 1 -- 172.21.15.49:0/3163061501 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54007250 con 0x7fce6c0be1f0 2024-01-22T05:21:15.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.173+0000 7fce71400700 1 -- 172.21.15.49:0/3163061501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6c16afc0 con 0x7fce6c0be1f0 2024-01-22T05:21:15.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.173+0000 7fce71400700 1 -- 172.21.15.49:0/3163061501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce6c066470 con 0x7fce6c0be1f0 2024-01-22T05:21:15.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.177+0000 7fce63400700 1 -- 172.21.15.49:0/3163061501 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fce540066a0 con 0x7fce6c0be1f0 2024-01-22T05:21:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.177+0000 7fce63400700 1 --2- 172.21.15.49:0/3163061501 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce4405a540 0x7fce4405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.177+0000 7fce63400700 1 -- 172.21.15.49:0/3163061501 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7fce54073fc0 con 0x7fce6c0be1f0 2024-01-22T05:21:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.177+0000 7fce6be00700 1 --2- 172.21.15.49:0/3163061501 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce4405a540 0x7fce4405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.177+0000 7fce63400700 1 --2- 172.21.15.49:0/3163061501 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x7fce440611f0 0x7fce44063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.177+0000 7fce63400700 1 -- 172.21.15.49:0/3163061501 --> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce44063d10 con 0x7fce440611f0 2024-01-22T05:21:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.177+0000 7fce63400700 1 -- 172.21.15.49:0/3163061501 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce54076520 con 0x7fce6c0be1f0 2024-01-22T05:21:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.177+0000 7fce70a00700 1 --2- 172.21.15.49:0/3163061501 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x7fce440611f0 0x7fce44063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.177+0000 7fce6be00700 1 --2- 172.21.15.49:0/3163061501 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce4405a540 0x7fce4405ca00 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fce5c009130 tx=0x7fce5c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.177+0000 7fce70a00700 1 --2- 172.21.15.49:0/3163061501 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x7fce440611f0 0x7fce44063690 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:15.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.181+0000 7fce63400700 1 -- 172.21.15.49:0/3163061501 <== osd.2 v2:172.21.15.49:6800/22974 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fce44063d10 con 0x7fce440611f0 2024-01-22T05:21:15.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.197+0000 7fce71400700 1 -- 172.21.15.49:0/3163061501 --> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fce6c046800 con 0x7fce440611f0 2024-01-22T05:21:15.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.197+0000 7fce63400700 1 -- 172.21.15.49:0/3163061501 <== osd.2 v2:172.21.15.49:6800/22974 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fce6c046800 con 0x7fce440611f0 2024-01-22T05:21:15.197 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:21:15.197 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:21:15.197 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:21:15.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.197+0000 7fce71400700 1 -- 172.21.15.49:0/3163061501 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x7fce440611f0 msgr2=0x7fce44063690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.197+0000 7fce71400700 1 --2- 172.21.15.49:0/3163061501 >> [v2:172.21.15.49:6800/22974,v1:172.21.15.49:6801/22974] conn(0x7fce440611f0 0x7fce44063690 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.201+0000 7fce71400700 1 -- 172.21.15.49:0/3163061501 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce4405a540 msgr2=0x7fce4405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.201+0000 7fce71400700 1 --2- 172.21.15.49:0/3163061501 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fce4405a540 0x7fce4405ca00 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fce5c009130 tx=0x7fce5c017000).stop 2024-01-22T05:21:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.201+0000 7fce71400700 1 -- 172.21.15.49:0/3163061501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce6c0be1f0 msgr2=0x7fce6c169db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.201+0000 7fce71400700 1 --2- 172.21.15.49:0/3163061501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce6c0be1f0 0x7fce6c169db0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 rx=0x7fce5400c4c0 tx=0x7fce54007e00).stop 2024-01-22T05:21:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.201+0000 7fce70a00700 1 -- 172.21.15.49:0/3163061501 reap_dead start 2024-01-22T05:21:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.201+0000 7fce71400700 1 -- 172.21.15.49:0/3163061501 shutdown_connections 2024-01-22T05:21:15.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.201+0000 7fce71400700 1 -- 172.21.15.49:0/3163061501 >> 172.21.15.49:0/3163061501 conn(0x7fce6c0c51a0 msgr2=0x7fce6c0a9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.201+0000 7fce71400700 1 -- 172.21.15.49:0/3163061501 shutdown_connections 2024-01-22T05:21:15.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.201+0000 7fce71400700 1 -- 172.21.15.49:0/3163061501 wait complete. 2024-01-22T05:21:15.221 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-22T05:21:15.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.389+0000 7f6151600700 1 Processor -- start 2024-01-22T05:21:15.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.393+0000 7f6151600700 1 -- start start 2024-01-22T05:21:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.393+0000 7f6151600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f614c0a7260 0x7f614c0659b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.393+0000 7f6151600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c068a60 con 0x7f614c155880 2024-01-22T05:21:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.393+0000 7f6151600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c067e50 con 0x7f614c155c60 2024-01-22T05:21:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.393+0000 7f6151600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614c068130 con 0x7f614c0a7260 2024-01-22T05:21:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.393+0000 7f614be00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f614c155880 0x7f614c0a8990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45186/0 (socket says 172.21.15.49:45186) 2024-01-22T05:21:15.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.393+0000 7f614be00700 1 -- 172.21.15.49:0/3261793312 learned_addr learned my addr 172.21.15.49:0/3261793312 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.393+0000 7f6150c00700 1 --2- 172.21.15.49:0/3261793312 >> v2:172.21.15.110:3300/0 conn(0x7f614c0a7260 0x7f614c0659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.393+0000 7f614aa00700 1 -- 172.21.15.49:0/3261793312 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082157750 0 0) 0x7f614c068a60 con 0x7f614c155880 2024-01-22T05:21:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f614aa00700 1 -- 172.21.15.49:0/3261793312 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f612c0033f0 con 0x7f614c155880 2024-01-22T05:21:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f614aa00700 1 -- 172.21.15.49:0/3261793312 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080573962 0 0) 0x7f614c067e50 con 0x7f614c155c60 2024-01-22T05:21:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f614aa00700 1 -- 172.21.15.49:0/3261793312 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f614c068a60 con 0x7f614c155c60 2024-01-22T05:21:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f6150c00700 1 -- 172.21.15.49:0/3261793312 >> v1:172.21.15.110:6789/0 conn(0x7f614c155c60 legacy=0x7f614c0a6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f6150c00700 1 -- 172.21.15.49:0/3261793312 >> v1:172.21.15.49:6789/0 conn(0x7f614c155880 legacy=0x7f614c0a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f6150c00700 1 -- 172.21.15.49:0/3261793312 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c068410 con 0x7f614c0a7260 2024-01-22T05:21:15.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f6150c00700 1 --2- 172.21.15.49:0/3261793312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f614c0a7260 0x7f614c0659b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f614c0a7700 tx=0x7f6144009780).ready entity=mon.1 client_cookie=31c21f77b837f561 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f614aa00700 1 -- 172.21.15.49:0/3261793312 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614400e070 con 0x7f614c0a7260 2024-01-22T05:21:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f614aa00700 1 -- 172.21.15.49:0/3261793312 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614400bab0 con 0x7f614c0a7260 2024-01-22T05:21:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f614aa00700 1 -- 172.21.15.49:0/3261793312 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614400be30 con 0x7f614c0a7260 2024-01-22T05:21:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f6151600700 1 -- 172.21.15.49:0/3261793312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f614c0a7260 msgr2=0x7f614c0659b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f6151600700 1 --2- 172.21.15.49:0/3261793312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f614c0a7260 0x7f614c0659b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f614c0a7700 tx=0x7f6144009780).stop 2024-01-22T05:21:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f6151600700 1 -- 172.21.15.49:0/3261793312 shutdown_connections 2024-01-22T05:21:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f6151600700 1 --2- 172.21.15.49:0/3261793312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f614c0a7260 0x7f614c0659b0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f6151600700 1 -- 172.21.15.49:0/3261793312 >> 172.21.15.49:0/3261793312 conn(0x7f614c0c6530 msgr2=0x7f614c0c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:15.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f6151600700 1 -- 172.21.15.49:0/3261793312 shutdown_connections 2024-01-22T05:21:15.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.397+0000 7f6151600700 1 -- 172.21.15.49:0/3261793312 wait complete. 2024-01-22T05:21:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.401+0000 7f6151600700 1 Processor -- start 2024-01-22T05:21:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.401+0000 7f6151600700 1 -- start start 2024-01-22T05:21:15.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6151600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f614c0a7260 0x7f614c16b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6151600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f614c155880 0x7f614c0a29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6151600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f614c155c60 0x7f614c0a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6151600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0a33d0 con 0x7f614c155c60 2024-01-22T05:21:15.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6151600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0c26e0 con 0x7f614c0a7260 2024-01-22T05:21:15.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6151600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c16b9e0 con 0x7f614c155880 2024-01-22T05:21:15.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6150c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f614c155c60 0x7f614c0a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6150c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f614c155c60 0x7f614c0a2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60954/0 (socket says 172.21.15.49:60954) 2024-01-22T05:21:15.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6150c00700 1 -- 172.21.15.49:0/816259990 learned_addr learned my addr 172.21.15.49:0/816259990 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:15.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f614be00700 1 --2- 172.21.15.49:0/816259990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f614c0a7260 0x7f614c16b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f614b400700 1 --2- 172.21.15.49:0/816259990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f614c155880 0x7f614c0a29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6150c00700 1 -- 172.21.15.49:0/816259990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f614c155880 msgr2=0x7f614c0a29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6150c00700 1 --2- 172.21.15.49:0/816259990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f614c155880 0x7f614c0a29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6150c00700 1 -- 172.21.15.49:0/816259990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f614c0a7260 msgr2=0x7f614c16b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6150c00700 1 --2- 172.21.15.49:0/816259990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f614c0a7260 0x7f614c16b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6150c00700 1 -- 172.21.15.49:0/816259990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6144009a20 con 0x7f614c155c60 2024-01-22T05:21:15.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f614be00700 1 --2- 172.21.15.49:0/816259990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f614c0a7260 0x7f614c16b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:21:15.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6150c00700 1 --2- 172.21.15.49:0/816259990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f614c155c60 0x7f614c0a2ee0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 rx=0x7f614400b610 tx=0x7f614c1584c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:15.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6143400700 1 -- 172.21.15.49:0/816259990 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614401d5a0 con 0x7f614c155c60 2024-01-22T05:21:15.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6143400700 1 -- 172.21.15.49:0/816259990 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614401d700 con 0x7f614c155c60 2024-01-22T05:21:15.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6151600700 1 -- 172.21.15.49:0/816259990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c159710 con 0x7f614c155c60 2024-01-22T05:21:15.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6143400700 1 -- 172.21.15.49:0/816259990 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614401da80 con 0x7f614c155c60 2024-01-22T05:21:15.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.405+0000 7f6151600700 1 -- 172.21.15.49:0/816259990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c159a30 con 0x7f614c155c60 2024-01-22T05:21:15.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.409+0000 7f6151600700 1 -- 172.21.15.49:0/816259990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614c159560 con 0x7f614c155c60 2024-01-22T05:21:15.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.409+0000 7f6143400700 1 -- 172.21.15.49:0/816259990 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6144003040 con 0x7f614c155c60 2024-01-22T05:21:15.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.413+0000 7f6143400700 1 --2- 172.21.15.49:0/816259990 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f612405a510 0x7f612405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.413+0000 7f6143400700 1 -- 172.21.15.49:0/816259990 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f6144076780 con 0x7f614c155c60 2024-01-22T05:21:15.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.413+0000 7f614be00700 1 --2- 172.21.15.49:0/816259990 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f612405a510 0x7f612405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.413+0000 7f614be00700 1 --2- 172.21.15.49:0/816259990 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f612405a510 0x7f612405c9d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f614c0c1c20 tx=0x7f613c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:15.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.417+0000 7f6143400700 1 -- 172.21.15.49:0/816259990 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6144049fe0 con 0x7f614c155c60 2024-01-22T05:21:15.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.585+0000 7f6151600700 1 -- 172.21.15.49:0/816259990 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f614c046800 con 0x7f612405a510 2024-01-22T05:21:15.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.589+0000 7f6143400700 1 -- 172.21.15.49:0/816259990 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f614c046800 con 0x7f612405a510 2024-01-22T05:21:15.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.593+0000 7f6151600700 1 -- 172.21.15.49:0/816259990 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f612405a510 msgr2=0x7f612405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.593+0000 7f6151600700 1 --2- 172.21.15.49:0/816259990 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f612405a510 0x7f612405c9d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f614c0c1c20 tx=0x7f613c009040).stop 2024-01-22T05:21:15.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.593+0000 7f6151600700 1 -- 172.21.15.49:0/816259990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f614c155c60 msgr2=0x7f614c0a2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.593+0000 7f6151600700 1 --2- 172.21.15.49:0/816259990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f614c155c60 0x7f614c0a2ee0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 rx=0x7f614400b610 tx=0x7f614c1584c0).stop 2024-01-22T05:21:15.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.593+0000 7f6151600700 1 -- 172.21.15.49:0/816259990 shutdown_connections 2024-01-22T05:21:15.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.593+0000 7f6151600700 1 --2- 172.21.15.49:0/816259990 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f612405a510 0x7f612405c9d0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.593+0000 7f6151600700 1 --2- 172.21.15.49:0/816259990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f614c155c60 0x7f614c0a2ee0 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.593+0000 7f6151600700 1 --2- 172.21.15.49:0/816259990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f614c155880 0x7f614c0a29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.593+0000 7f6151600700 1 --2- 172.21.15.49:0/816259990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f614c0a7260 0x7f614c16b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.593+0000 7f6151600700 1 -- 172.21.15.49:0/816259990 >> 172.21.15.49:0/816259990 conn(0x7f614c0c6530 msgr2=0x7f614c156110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:15.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.593+0000 7f6151600700 1 -- 172.21.15.49:0/816259990 shutdown_connections 2024-01-22T05:21:15.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.593+0000 7f6151600700 1 -- 172.21.15.49:0/816259990 wait complete. 2024-01-22T05:21:15.595 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 2 to deep-scrub 2024-01-22T05:21:15.614 INFO:tasks.ceph:Scrubbing osd.3 2024-01-22T05:21:15.614 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:21:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.785+0000 7f58a8e00700 1 Processor -- start 2024-01-22T05:21:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.785+0000 7f58a8e00700 1 -- start start 2024-01-22T05:21:15.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a8e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58a4068cd0 0x7f58a4062aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a8e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a4069130 0x7f58a4062f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a8e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a40bf1c0 con 0x7f58a4158220 2024-01-22T05:21:15.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a8e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a4063480 con 0x7f58a4068cd0 2024-01-22T05:21:15.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a8e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4068840 con 0x7f58a4069130 2024-01-22T05:21:15.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a1400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58a4068cd0 0x7f58a4062aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a1400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58a4068cd0 0x7f58a4062aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60960/0 (socket says 172.21.15.49:60960) 2024-01-22T05:21:15.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a1400700 1 -- 172.21.15.49:0/4171638302 learned_addr learned my addr 172.21.15.49:0/4171638302 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:15.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a1e00700 1 --1- 172.21.15.49:0/4171638302 >> v1:172.21.15.49:6789/0 conn(0x7f58a4158220 0x7f58a40beab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45196/0 (socket says 172.21.15.49:45196) 2024-01-22T05:21:15.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a2800700 1 --2- 172.21.15.49:0/4171638302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a4069130 0x7f58a4062f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a1400700 1 -- 172.21.15.49:0/4171638302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a4069130 msgr2=0x7f58a4062f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:15.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a1400700 1 --2- 172.21.15.49:0/4171638302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a4069130 0x7f58a4062f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a1400700 1 -- 172.21.15.49:0/4171638302 >> v1:172.21.15.49:6789/0 conn(0x7f58a4158220 legacy=0x7f58a40beab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a1400700 1 -- 172.21.15.49:0/4171638302 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a4067c30 con 0x7f58a4068cd0 2024-01-22T05:21:15.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a1400700 1 --2- 172.21.15.49:0/4171638302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a4068cd0 0x7f58a4062aa0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 rx=0x7f588c006fd0 tx=0x7f588c0090f0).ready entity=mon.0 client_cookie=48350471809aadf9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:15.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a0a00700 1 -- 172.21.15.49:0/4171638302 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c00b600 con 0x7f58a4068cd0 2024-01-22T05:21:15.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a0a00700 1 -- 172.21.15.49:0/4171638302 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c00b760 con 0x7f58a4068cd0 2024-01-22T05:21:15.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.789+0000 7f58a0a00700 1 -- 172.21.15.49:0/4171638302 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c00bae0 con 0x7f58a4068cd0 2024-01-22T05:21:15.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.793+0000 7f58a8e00700 1 -- 172.21.15.49:0/4171638302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a4068cd0 msgr2=0x7f58a4062aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.793+0000 7f58a8e00700 1 --2- 172.21.15.49:0/4171638302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a4068cd0 0x7f58a4062aa0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 rx=0x7f588c006fd0 tx=0x7f588c0090f0).stop 2024-01-22T05:21:15.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.793+0000 7f58a8e00700 1 -- 172.21.15.49:0/4171638302 shutdown_connections 2024-01-22T05:21:15.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.793+0000 7f58a8e00700 1 --2- 172.21.15.49:0/4171638302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a4069130 0x7f58a4062f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.793+0000 7f58a8e00700 1 --2- 172.21.15.49:0/4171638302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a4068cd0 0x7f58a4062aa0 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.793+0000 7f58a8e00700 1 -- 172.21.15.49:0/4171638302 >> 172.21.15.49:0/4171638302 conn(0x7f58a40c8740 msgr2=0x7f58a40c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:15.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.793+0000 7f58a8e00700 1 -- 172.21.15.49:0/4171638302 shutdown_connections 2024-01-22T05:21:15.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.793+0000 7f58a8e00700 1 -- 172.21.15.49:0/4171638302 wait complete. 2024-01-22T05:21:15.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.797+0000 7f58a8e00700 1 Processor -- start 2024-01-22T05:21:15.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.797+0000 7f58a8e00700 1 -- start start 2024-01-22T05:21:15.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.797+0000 7f58a8e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a4068cd0 0x7f58a416c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.797+0000 7f58a8e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a4069130 0x7f58a40aa760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.797+0000 7f58a8e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a4158220 0x7f58a4168000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.797+0000 7f58a8e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a416ce60 con 0x7f58a4068cd0 2024-01-22T05:21:15.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.797+0000 7f58a8e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40aac50 con 0x7f58a4158220 2024-01-22T05:21:15.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.797+0000 7f58a8e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4159740 con 0x7f58a4069130 2024-01-22T05:21:15.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.797+0000 7f58a1e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a4068cd0 0x7f58a416c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.797+0000 7f58a1e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a4068cd0 0x7f58a416c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60972/0 (socket says 172.21.15.49:60972) 2024-01-22T05:21:15.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.797+0000 7f58a1e00700 1 -- 172.21.15.49:0/3538674926 learned_addr learned my addr 172.21.15.49:0/3538674926 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:15.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.801+0000 7f58a1400700 1 --2- 172.21.15.49:0/3538674926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a4069130 0x7f58a40aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.801+0000 7f58a2800700 1 --2- 172.21.15.49:0/3538674926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a4158220 0x7f58a4168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.801+0000 7f58a1e00700 1 -- 172.21.15.49:0/3538674926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a4069130 msgr2=0x7f58a40aa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.801+0000 7f58a1e00700 1 --2- 172.21.15.49:0/3538674926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a4069130 0x7f58a40aa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.801+0000 7f58a1e00700 1 -- 172.21.15.49:0/3538674926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a4158220 msgr2=0x7f58a4168000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.801+0000 7f58a1e00700 1 --2- 172.21.15.49:0/3538674926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a4158220 0x7f58a4168000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.801+0000 7f58a1e00700 1 -- 172.21.15.49:0/3538674926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c009370 con 0x7f58a4068cd0 2024-01-22T05:21:15.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.801+0000 7f58a1e00700 1 --2- 172.21.15.49:0/3538674926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a4068cd0 0x7f58a416c970 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 rx=0x7f5894007fd0 tx=0x7f5894007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:15.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.801+0000 7f5899600700 1 -- 172.21.15.49:0/3538674926 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58940072e0 con 0x7f58a4068cd0 2024-01-22T05:21:15.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.801+0000 7f5899600700 1 -- 172.21.15.49:0/3538674926 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5894007440 con 0x7f58a4068cd0 2024-01-22T05:21:15.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.801+0000 7f58a8e00700 1 -- 172.21.15.49:0/3538674926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a4159a20 con 0x7f58a4068cd0 2024-01-22T05:21:15.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.801+0000 7f5899600700 1 -- 172.21.15.49:0/3538674926 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58940058f0 con 0x7f58a4068cd0 2024-01-22T05:21:15.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.801+0000 7f58a8e00700 1 -- 172.21.15.49:0/3538674926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a4159fe0 con 0x7f58a4068cd0 2024-01-22T05:21:15.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.801+0000 7f58a8e00700 1 -- 172.21.15.49:0/3538674926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58a4066560 con 0x7f58a4068cd0 2024-01-22T05:21:15.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.801+0000 7f5899600700 1 -- 172.21.15.49:0/3538674926 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5894005ce0 con 0x7f58a4068cd0 2024-01-22T05:21:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.805+0000 7f5899600700 1 --2- 172.21.15.49:0/3538674926 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f587c05a510 0x7f587c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.805+0000 7f5899600700 1 -- 172.21.15.49:0/3538674926 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f5894073fc0 con 0x7f58a4068cd0 2024-01-22T05:21:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.805+0000 7f58a1400700 1 --2- 172.21.15.49:0/3538674926 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f587c05a510 0x7f587c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.805+0000 7f5899600700 1 --2- 172.21.15.49:0/3538674926 >> [v2:172.21.15.49:6816/22977,v1:172.21.15.49:6817/22977] conn(0x7f587c061140 0x7f587c0635e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.805+0000 7f5899600700 1 -- 172.21.15.49:0/3538674926 --> [v2:172.21.15.49:6816/22977,v1:172.21.15.49:6817/22977] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f587c063c60 con 0x7f587c061140 2024-01-22T05:21:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.805+0000 7f5899600700 1 -- 172.21.15.49:0/3538674926 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5894076520 con 0x7f58a4068cd0 2024-01-22T05:21:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.805+0000 7f58a2800700 1 --2- 172.21.15.49:0/3538674926 >> [v2:172.21.15.49:6816/22977,v1:172.21.15.49:6817/22977] conn(0x7f587c061140 0x7f587c0635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:15.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.805+0000 7f58a2800700 1 --2- 172.21.15.49:0/3538674926 >> [v2:172.21.15.49:6816/22977,v1:172.21.15.49:6817/22977] conn(0x7f587c061140 0x7f587c0635e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.805+0000 7f58a1400700 1 --2- 172.21.15.49:0/3538674926 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f587c05a510 0x7f587c05c9d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f588c009130 tx=0x7f588c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:15.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.809+0000 7f5899600700 1 -- 172.21.15.49:0/3538674926 <== osd.3 v2:172.21.15.49:6816/22977 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f587c063c60 con 0x7f587c061140 2024-01-22T05:21:15.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.825+0000 7f58a8e00700 1 -- 172.21.15.49:0/3538674926 --> [v2:172.21.15.49:6816/22977,v1:172.21.15.49:6817/22977] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f58a4067f10 con 0x7f587c061140 2024-01-22T05:21:15.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.825+0000 7f5899600700 1 -- 172.21.15.49:0/3538674926 <== osd.3 v2:172.21.15.49:6816/22977 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f58a4067f10 con 0x7f587c061140 2024-01-22T05:21:15.824 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:21:15.824 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:21:15.824 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:21:15.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.825+0000 7f58a8e00700 1 -- 172.21.15.49:0/3538674926 >> [v2:172.21.15.49:6816/22977,v1:172.21.15.49:6817/22977] conn(0x7f587c061140 msgr2=0x7f587c0635e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.825+0000 7f58a8e00700 1 --2- 172.21.15.49:0/3538674926 >> [v2:172.21.15.49:6816/22977,v1:172.21.15.49:6817/22977] conn(0x7f587c061140 0x7f587c0635e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:15.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.825+0000 7f58a8e00700 1 -- 172.21.15.49:0/3538674926 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f587c05a510 msgr2=0x7f587c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.825+0000 7f58a8e00700 1 --2- 172.21.15.49:0/3538674926 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f587c05a510 0x7f587c05c9d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f588c009130 tx=0x7f588c017000).stop 2024-01-22T05:21:15.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.825+0000 7f58a8e00700 1 -- 172.21.15.49:0/3538674926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a4068cd0 msgr2=0x7f58a416c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:15.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.825+0000 7f58a8e00700 1 --2- 172.21.15.49:0/3538674926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a4068cd0 0x7f58a416c970 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 rx=0x7f5894007fd0 tx=0x7f5894007df0).stop 2024-01-22T05:21:15.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.825+0000 7f58a2800700 1 -- 172.21.15.49:0/3538674926 reap_dead start 2024-01-22T05:21:15.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.825+0000 7f58a8e00700 1 -- 172.21.15.49:0/3538674926 shutdown_connections 2024-01-22T05:21:15.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.825+0000 7f58a8e00700 1 -- 172.21.15.49:0/3538674926 >> 172.21.15.49:0/3538674926 conn(0x7f58a40c8740 msgr2=0x7f58a40c0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:15.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.825+0000 7f58a8e00700 1 -- 172.21.15.49:0/3538674926 shutdown_connections 2024-01-22T05:21:15.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:15.825+0000 7f58a8e00700 1 -- 172.21.15.49:0/3538674926 wait complete. 2024-01-22T05:21:15.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-22T05:21:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.017+0000 7f75a6000700 1 Processor -- start 2024-01-22T05:21:16.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.017+0000 7f75a6000700 1 -- start start 2024-01-22T05:21:16.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f75a6000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75a0066d10 0x7f75a00c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f75a6000700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a00695a0 con 0x7f75a00bc570 2024-01-22T05:21:16.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f75a6000700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a0068990 con 0x7f75a00c3250 2024-01-22T05:21:16.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f75a6000700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a0068c70 con 0x7f75a0066d10 2024-01-22T05:21:16.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f759fe00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f75a0066d10 0x7f75a00c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f75a4c00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f75a00bc570 0x7f75a0066600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45206/0 (socket says 172.21.15.49:45206) 2024-01-22T05:21:16.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f75a4c00700 1 -- 172.21.15.49:0/2909864407 learned_addr learned my addr 172.21.15.49:0/2909864407 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:16.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f759fe00700 1 -- 172.21.15.49:0/2909864407 >> v1:172.21.15.110:6789/0 conn(0x7f75a00c3250 legacy=0x7f75a0069a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f759fe00700 1 -- 172.21.15.49:0/2909864407 >> v1:172.21.15.49:6789/0 conn(0x7f75a00bc570 legacy=0x7f75a0066600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f759fe00700 1 -- 172.21.15.49:0/2909864407 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a0068f50 con 0x7f75a0066d10 2024-01-22T05:21:16.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f759fe00700 1 --2- 172.21.15.49:0/2909864407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0066d10 0x7f75a00c2d60 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 rx=0x7f7588009760 tx=0x7f7588009060).ready entity=mon.0 client_cookie=26728aecba33d899 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:16.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f759f400700 1 -- 172.21.15.49:0/2909864407 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758800b580 con 0x7f75a0066d10 2024-01-22T05:21:16.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f759f400700 1 -- 172.21.15.49:0/2909864407 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758800b6e0 con 0x7f75a0066d10 2024-01-22T05:21:16.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f759f400700 1 -- 172.21.15.49:0/2909864407 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758800ba60 con 0x7f75a0066d10 2024-01-22T05:21:16.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f75a6000700 1 -- 172.21.15.49:0/2909864407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0066d10 msgr2=0x7f75a00c2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.021+0000 7f75a6000700 1 --2- 172.21.15.49:0/2909864407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0066d10 0x7f75a00c2d60 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 rx=0x7f7588009760 tx=0x7f7588009060).stop 2024-01-22T05:21:16.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.025+0000 7f75a6000700 1 -- 172.21.15.49:0/2909864407 shutdown_connections 2024-01-22T05:21:16.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.025+0000 7f75a6000700 1 --2- 172.21.15.49:0/2909864407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0066d10 0x7f75a00c2d60 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.025+0000 7f75a6000700 1 -- 172.21.15.49:0/2909864407 >> 172.21.15.49:0/2909864407 conn(0x7f75a00c40b0 msgr2=0x7f75a00c44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.025+0000 7f75a6000700 1 -- 172.21.15.49:0/2909864407 shutdown_connections 2024-01-22T05:21:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.025+0000 7f75a6000700 1 -- 172.21.15.49:0/2909864407 wait complete. 2024-01-22T05:21:16.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.025+0000 7f75a6000700 1 Processor -- start 2024-01-22T05:21:16.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.025+0000 7f75a6000700 1 -- start start 2024-01-22T05:21:16.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a6000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0066d10 0x7f75a0150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a6000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a00bc570 0x7f75a0157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a6000700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75a00c3250 0x7f75a0155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a6000700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a01596e0 con 0x7f75a0066d10 2024-01-22T05:21:16.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a6000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a0151230 con 0x7f75a00bc570 2024-01-22T05:21:16.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a6000700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a0158ad0 con 0x7f75a00c3250 2024-01-22T05:21:16.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a4c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0066d10 0x7f75a0150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a4c00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0066d10 0x7f75a0150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60986/0 (socket says 172.21.15.49:60986) 2024-01-22T05:21:16.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a4c00700 1 -- 172.21.15.49:0/3137504691 learned_addr learned my addr 172.21.15.49:0/3137504691 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:16.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f759fe00700 1 --2- 172.21.15.49:0/3137504691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a00bc570 0x7f75a0157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a5600700 1 --2- 172.21.15.49:0/3137504691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75a00c3250 0x7f75a0155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a4c00700 1 -- 172.21.15.49:0/3137504691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75a00c3250 msgr2=0x7f75a0155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a4c00700 1 --2- 172.21.15.49:0/3137504691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75a00c3250 0x7f75a0155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a4c00700 1 -- 172.21.15.49:0/3137504691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a00bc570 msgr2=0x7f75a0157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a4c00700 1 --2- 172.21.15.49:0/3137504691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a00bc570 0x7f75a0157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a4c00700 1 -- 172.21.15.49:0/3137504691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75880092a0 con 0x7f75a0066d10 2024-01-22T05:21:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f759fe00700 1 --2- 172.21.15.49:0/3137504691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a00bc570 0x7f75a0157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:21:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a4c00700 1 --2- 172.21.15.49:0/3137504691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0066d10 0x7f75a0150d40 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 rx=0x7f7590007fd0 tx=0x7f7590007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f7597e00700 1 -- 172.21.15.49:0/3137504691 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75900072e0 con 0x7f75a0066d10 2024-01-22T05:21:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f7597e00700 1 -- 172.21.15.49:0/3137504691 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7590007440 con 0x7f75a0066d10 2024-01-22T05:21:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f7597e00700 1 -- 172.21.15.49:0/3137504691 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75900057a0 con 0x7f75a0066d10 2024-01-22T05:21:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a6000700 1 -- 172.21.15.49:0/3137504691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a0158db0 con 0x7f75a0066d10 2024-01-22T05:21:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.029+0000 7f75a6000700 1 -- 172.21.15.49:0/3137504691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a0159370 con 0x7f75a0066d10 2024-01-22T05:21:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.033+0000 7f75a6000700 1 -- 172.21.15.49:0/3137504691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a00bece0 con 0x7f75a0066d10 2024-01-22T05:21:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.033+0000 7f7597e00700 1 -- 172.21.15.49:0/3137504691 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7590005b90 con 0x7f75a0066d10 2024-01-22T05:21:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.037+0000 7f7597e00700 1 --2- 172.21.15.49:0/3137504691 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f757805a540 0x7f757805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.037+0000 7f7597e00700 1 -- 172.21.15.49:0/3137504691 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f7590073de0 con 0x7f75a0066d10 2024-01-22T05:21:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.037+0000 7f759fe00700 1 --2- 172.21.15.49:0/3137504691 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f757805a540 0x7f757805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.037+0000 7f759fe00700 1 --2- 172.21.15.49:0/3137504691 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f757805a540 0x7f757805ca00 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f75a0067110 tx=0x7f7588017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.045+0000 7f7597e00700 1 -- 172.21.15.49:0/3137504691 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7590047700 con 0x7f75a0066d10 2024-01-22T05:21:16.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.209+0000 7f75a6000700 1 -- 172.21.15.49:0/3137504691 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f75a0069230 con 0x7f757805a540 2024-01-22T05:21:16.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.209+0000 7f7597e00700 1 -- 172.21.15.49:0/3137504691 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f75a0069230 con 0x7f757805a540 2024-01-22T05:21:16.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.213+0000 7f75a6000700 1 -- 172.21.15.49:0/3137504691 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f757805a540 msgr2=0x7f757805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.213+0000 7f75a6000700 1 --2- 172.21.15.49:0/3137504691 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f757805a540 0x7f757805ca00 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f75a0067110 tx=0x7f7588017000).stop 2024-01-22T05:21:16.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.213+0000 7f75a6000700 1 -- 172.21.15.49:0/3137504691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0066d10 msgr2=0x7f75a0150d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.213+0000 7f75a6000700 1 --2- 172.21.15.49:0/3137504691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0066d10 0x7f75a0150d40 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 rx=0x7f7590007fd0 tx=0x7f7590007df0).stop 2024-01-22T05:21:16.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.213+0000 7f75a6000700 1 -- 172.21.15.49:0/3137504691 shutdown_connections 2024-01-22T05:21:16.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.213+0000 7f75a6000700 1 --2- 172.21.15.49:0/3137504691 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f757805a540 0x7f757805ca00 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.213+0000 7f75a6000700 1 --2- 172.21.15.49:0/3137504691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75a00c3250 0x7f75a0155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.213+0000 7f75a6000700 1 --2- 172.21.15.49:0/3137504691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a00bc570 0x7f75a0157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.213+0000 7f75a6000700 1 --2- 172.21.15.49:0/3137504691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75a0066d10 0x7f75a0150d40 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.213+0000 7f75a6000700 1 -- 172.21.15.49:0/3137504691 >> 172.21.15.49:0/3137504691 conn(0x7f75a00c40b0 msgr2=0x7f75a00c5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:16.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.213+0000 7f75a6000700 1 -- 172.21.15.49:0/3137504691 shutdown_connections 2024-01-22T05:21:16.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.213+0000 7f75a6000700 1 -- 172.21.15.49:0/3137504691 wait complete. 2024-01-22T05:21:16.216 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 3 to deep-scrub 2024-01-22T05:21:16.235 INFO:tasks.ceph:Scrubbing osd.4 2024-01-22T05:21:16.235 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:21:16.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.401+0000 7f1159400700 1 Processor -- start 2024-01-22T05:21:16.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.401+0000 7f1159400700 1 -- start start 2024-01-22T05:21:16.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.401+0000 7f1159400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11540bcf40 0x7f115414ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1159400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11540c3f10 con 0x7f11540a8bc0 2024-01-22T05:21:16.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1159400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1154151980 con 0x7f11540a8740 2024-01-22T05:21:16.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1159400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11540c3cc0 con 0x7f11540bcf40 2024-01-22T05:21:16.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1158a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f11540a8bc0 0x7f1154154b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45210/0 (socket says 172.21.15.49:45210) 2024-01-22T05:21:16.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1158a00700 1 -- 172.21.15.49:0/2624686649 learned_addr learned my addr 172.21.15.49:0/2624686649 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:16.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1153e00700 1 --2- 172.21.15.49:0/2624686649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11540bcf40 0x7f115414ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 -- 172.21.15.49:0/2624686649 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433667418 0 0) 0x7f11540c3f10 con 0x7f11540a8bc0 2024-01-22T05:21:16.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 -- 172.21.15.49:0/2624686649 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11340033f0 con 0x7f11540a8bc0 2024-01-22T05:21:16.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 -- 172.21.15.49:0/2624686649 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2086334331 0 0) 0x7f11340033f0 con 0x7f11540a8bc0 2024-01-22T05:21:16.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 -- 172.21.15.49:0/2624686649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11540bcf40 msgr2=0x7f115414ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:16.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 --2- 172.21.15.49:0/2624686649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11540bcf40 0x7f115414ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 -- 172.21.15.49:0/2624686649 >> v1:172.21.15.110:6789/0 conn(0x7f11540a8740 legacy=0x7f1154154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 -- 172.21.15.49:0/2624686649 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11541552a0 con 0x7f11540a8bc0 2024-01-22T05:21:16.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 -- 172.21.15.49:0/2624686649 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7f114c0017f0 con 0x7f11540a8bc0 2024-01-22T05:21:16.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 -- 172.21.15.49:0/2624686649 >> v1:172.21.15.49:6789/0 conn(0x7f11540a8bc0 legacy=0x7f1154154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 --2- 172.21.15.49:0/2624686649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1134003910 0x7f1134003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 --2- 172.21.15.49:0/2624686649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1134004690 0x7f1134004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 --2- 172.21.15.49:0/2624686649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11540bcf40 0x7f1134005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 -- 172.21.15.49:0/2624686649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11540c3cc0 con 0x7f1134004690 2024-01-22T05:21:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 -- 172.21.15.49:0/2624686649 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113400b910 con 0x7f1134003910 2024-01-22T05:21:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 -- 172.21.15.49:0/2624686649 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113400bad0 con 0x7f11540bcf40 2024-01-22T05:21:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1153400700 1 --2- 172.21.15.49:0/2624686649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1134004690 0x7f1134004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1153e00700 1 --2- 172.21.15.49:0/2624686649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1134003910 0x7f1134003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1158a00700 1 --2- 172.21.15.49:0/2624686649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11540bcf40 0x7f1134005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1153400700 1 -- 172.21.15.49:0/2624686649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11540bcf40 msgr2=0x7f1134005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1153400700 1 --2- 172.21.15.49:0/2624686649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11540bcf40 0x7f1134005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1153400700 1 -- 172.21.15.49:0/2624686649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1134003910 msgr2=0x7f1134003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1153400700 1 --2- 172.21.15.49:0/2624686649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1134003910 0x7f1134003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1153400700 1 -- 172.21.15.49:0/2624686649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11340033f0 con 0x7f1134004690 2024-01-22T05:21:16.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1153e00700 1 --2- 172.21.15.49:0/2624686649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1134003910 0x7f1134003d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:21:16.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1153400700 1 --2- 172.21.15.49:0/2624686649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1134004690 0x7f1134004b10 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 rx=0x7f113c001700 tx=0x7f113c007bb0).ready entity=mon.0 client_cookie=16e18311834230ae server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:16.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 -- 172.21.15.49:0/2624686649 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c007020 con 0x7f1134004690 2024-01-22T05:21:16.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 -- 172.21.15.49:0/2624686649 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c007180 con 0x7f1134004690 2024-01-22T05:21:16.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.405+0000 7f1152a00700 1 -- 172.21.15.49:0/2624686649 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c007500 con 0x7f1134004690 2024-01-22T05:21:16.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.409+0000 7f1159400700 1 -- 172.21.15.49:0/2624686649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1134004690 msgr2=0x7f1134004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.409+0000 7f1159400700 1 --2- 172.21.15.49:0/2624686649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1134004690 0x7f1134004b10 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 rx=0x7f113c001700 tx=0x7f113c007bb0).stop 2024-01-22T05:21:16.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.409+0000 7f1158a00700 1 -- 172.21.15.49:0/2624686649 reap_dead start 2024-01-22T05:21:16.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.409+0000 7f1159400700 1 -- 172.21.15.49:0/2624686649 shutdown_connections 2024-01-22T05:21:16.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.409+0000 7f1159400700 1 -- 172.21.15.49:0/2624686649 >> 172.21.15.49:0/2624686649 conn(0x7f11540c6f70 msgr2=0x7f11540c2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:16.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.409+0000 7f1159400700 1 -- 172.21.15.49:0/2624686649 shutdown_connections 2024-01-22T05:21:16.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.409+0000 7f1159400700 1 -- 172.21.15.49:0/2624686649 wait complete. 2024-01-22T05:21:16.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1159400700 1 Processor -- start 2024-01-22T05:21:16.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1159400700 1 -- start start 2024-01-22T05:21:16.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1159400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1134004690 0x7f11540bd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1159400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11540be9a0 0x7f1154162720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1159400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f115414c5b0 0x7f11540bf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1159400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1154148eb0 con 0x7f11540be9a0 2024-01-22T05:21:16.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1159400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1154162c10 con 0x7f1134004690 2024-01-22T05:21:16.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1159400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11540be510 con 0x7f115414c5b0 2024-01-22T05:21:16.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1153400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11540be9a0 0x7f1154162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1153400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11540be9a0 0x7f1154162720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60998/0 (socket says 172.21.15.49:60998) 2024-01-22T05:21:16.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1153400700 1 -- 172.21.15.49:0/3746429657 learned_addr learned my addr 172.21.15.49:0/3746429657 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:16.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1158a00700 1 --2- 172.21.15.49:0/3746429657 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f115414c5b0 0x7f11540bf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1153e00700 1 --2- 172.21.15.49:0/3746429657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1134004690 0x7f11540bd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1153400700 1 -- 172.21.15.49:0/3746429657 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f115414c5b0 msgr2=0x7f11540bf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1153400700 1 --2- 172.21.15.49:0/3746429657 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f115414c5b0 0x7f11540bf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1153400700 1 -- 172.21.15.49:0/3746429657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1134004690 msgr2=0x7f11540bd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1153400700 1 --2- 172.21.15.49:0/3746429657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1134004690 0x7f11540bd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.413+0000 7f1153400700 1 -- 172.21.15.49:0/3746429657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11540bd900 con 0x7f11540be9a0 2024-01-22T05:21:16.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.417+0000 7f1153400700 1 --2- 172.21.15.49:0/3746429657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11540be9a0 0x7f1154162720 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 rx=0x7f113c008fd0 tx=0x7f113c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:16.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.417+0000 7f114b400700 1 -- 172.21.15.49:0/3746429657 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c001ea0 con 0x7f11540be9a0 2024-01-22T05:21:16.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.417+0000 7f114b400700 1 -- 172.21.15.49:0/3746429657 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c012610 con 0x7f11540be9a0 2024-01-22T05:21:16.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.417+0000 7f114b400700 1 -- 172.21.15.49:0/3746429657 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c012990 con 0x7f11540be9a0 2024-01-22T05:21:16.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.417+0000 7f1159400700 1 -- 172.21.15.49:0/3746429657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11540bdbe0 con 0x7f11540be9a0 2024-01-22T05:21:16.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.417+0000 7f1159400700 1 -- 172.21.15.49:0/3746429657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11540be1a0 con 0x7f11540be9a0 2024-01-22T05:21:16.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.417+0000 7f1159400700 1 -- 172.21.15.49:0/3746429657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f115405fd40 con 0x7f11540be9a0 2024-01-22T05:21:16.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.421+0000 7f114b400700 1 -- 172.21.15.49:0/3746429657 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f113c01d440 con 0x7f11540be9a0 2024-01-22T05:21:16.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.421+0000 7f114b400700 1 --2- 172.21.15.49:0/3746429657 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f112c05a510 0x7f112c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.421+0000 7f114b400700 1 -- 172.21.15.49:0/3746429657 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f113c075380 con 0x7f11540be9a0 2024-01-22T05:21:16.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.421+0000 7f114b400700 1 --2- 172.21.15.49:0/3746429657 >> [v2:172.21.15.110:6816/23256,v1:172.21.15.110:6817/23256] conn(0x7f112c0611c0 0x7f112c063660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.421+0000 7f114b400700 1 -- 172.21.15.49:0/3746429657 --> [v2:172.21.15.110:6816/23256,v1:172.21.15.110:6817/23256] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f112c063ce0 con 0x7f112c0611c0 2024-01-22T05:21:16.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.421+0000 7f114b400700 1 -- 172.21.15.49:0/3746429657 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7f113c0778e0 con 0x7f11540be9a0 2024-01-22T05:21:16.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.421+0000 7f1153e00700 1 --2- 172.21.15.49:0/3746429657 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f112c05a510 0x7f112c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.421+0000 7f1158a00700 1 --2- 172.21.15.49:0/3746429657 >> [v2:172.21.15.110:6816/23256,v1:172.21.15.110:6817/23256] conn(0x7f112c0611c0 0x7f112c063660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.421+0000 7f1153e00700 1 --2- 172.21.15.49:0/3746429657 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f112c05a510 0x7f112c05c9d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f1144009d60 tx=0x7f1144008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:16.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.421+0000 7f1158a00700 1 --2- 172.21.15.49:0/3746429657 >> [v2:172.21.15.110:6816/23256,v1:172.21.15.110:6817/23256] conn(0x7f112c0611c0 0x7f112c063660 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:16.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.425+0000 7f114b400700 1 -- 172.21.15.49:0/3746429657 <== osd.4 v2:172.21.15.110:6816/23256 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f112c063ce0 con 0x7f112c0611c0 2024-01-22T05:21:16.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.441+0000 7f1159400700 1 -- 172.21.15.49:0/3746429657 --> [v2:172.21.15.110:6816/23256,v1:172.21.15.110:6817/23256] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f11540c0e10 con 0x7f112c0611c0 2024-01-22T05:21:16.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.445+0000 7f114b400700 1 -- 172.21.15.49:0/3746429657 <== osd.4 v2:172.21.15.110:6816/23256 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f11540c0e10 con 0x7f112c0611c0 2024-01-22T05:21:16.443 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:21:16.444 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:21:16.444 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:21:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.445+0000 7f1159400700 1 -- 172.21.15.49:0/3746429657 >> [v2:172.21.15.110:6816/23256,v1:172.21.15.110:6817/23256] conn(0x7f112c0611c0 msgr2=0x7f112c063660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.445+0000 7f1159400700 1 --2- 172.21.15.49:0/3746429657 >> [v2:172.21.15.110:6816/23256,v1:172.21.15.110:6817/23256] conn(0x7f112c0611c0 0x7f112c063660 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.445+0000 7f1159400700 1 -- 172.21.15.49:0/3746429657 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f112c05a510 msgr2=0x7f112c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.445+0000 7f1159400700 1 --2- 172.21.15.49:0/3746429657 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f112c05a510 0x7f112c05c9d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f1144009d60 tx=0x7f1144008040).stop 2024-01-22T05:21:16.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.445+0000 7f1159400700 1 -- 172.21.15.49:0/3746429657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11540be9a0 msgr2=0x7f1154162720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.445+0000 7f1159400700 1 --2- 172.21.15.49:0/3746429657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11540be9a0 0x7f1154162720 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 rx=0x7f113c008fd0 tx=0x7f113c016000).stop 2024-01-22T05:21:16.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.445+0000 7f1158a00700 1 -- 172.21.15.49:0/3746429657 reap_dead start 2024-01-22T05:21:16.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.445+0000 7f1159400700 1 -- 172.21.15.49:0/3746429657 shutdown_connections 2024-01-22T05:21:16.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.445+0000 7f1159400700 1 -- 172.21.15.49:0/3746429657 >> 172.21.15.49:0/3746429657 conn(0x7f11540c6f70 msgr2=0x7f11540c2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:16.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.445+0000 7f1159400700 1 -- 172.21.15.49:0/3746429657 shutdown_connections 2024-01-22T05:21:16.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.445+0000 7f1159400700 1 -- 172.21.15.49:0/3746429657 wait complete. 2024-01-22T05:21:16.469 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-22T05:21:16.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.645+0000 7f496b600700 1 Processor -- start 2024-01-22T05:21:16.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.649+0000 7f496b600700 1 -- start start 2024-01-22T05:21:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.649+0000 7f496b600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4964151990 0x7f49640684a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.649+0000 7f496b600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4964068990 0x7f49640bea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.649+0000 7f496b600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49640bf4f0 con 0x7f4964151d70 2024-01-22T05:21:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.649+0000 7f496b600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49640ab8b0 con 0x7f4964068990 2024-01-22T05:21:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.649+0000 7f496b600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49640bef60 con 0x7f4964151990 2024-01-22T05:21:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.649+0000 7f496a000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4964068990 0x7f49640bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f496a000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4964068990 0x7f49640bea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32778/0 (socket says 172.21.15.49:32778) 2024-01-22T05:21:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f496a000700 1 -- 172.21.15.49:0/2589224138 learned_addr learned my addr 172.21.15.49:0/2589224138 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f4968c00700 1 --2- 172.21.15.49:0/2589224138 >> v2:172.21.15.110:3300/0 conn(0x7f4964151990 0x7f49640684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f496a000700 1 -- 172.21.15.49:0/2589224138 >> v2:172.21.15.110:3300/0 conn(0x7f4964151990 msgr2=0x7f49640684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f496a000700 1 --2- 172.21.15.49:0/2589224138 >> v2:172.21.15.110:3300/0 conn(0x7f4964151990 0x7f49640684a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f496a000700 1 -- 172.21.15.49:0/2589224138 >> v1:172.21.15.49:6789/0 conn(0x7f4964151d70 legacy=0x7f49640be360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f496a000700 1 -- 172.21.15.49:0/2589224138 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4964067e00 con 0x7f4964068990 2024-01-22T05:21:16.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f496a000700 1 --2- 172.21.15.49:0/2589224138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4964068990 0x7f49640bea70 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 rx=0x7f49640a9980 tx=0x7f495c009840).ready entity=mon.0 client_cookie=573caafac3093da3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:16.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f4963400700 1 -- 172.21.15.49:0/2589224138 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00e070 con 0x7f4964068990 2024-01-22T05:21:16.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f4963400700 1 -- 172.21.15.49:0/2589224138 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c00ba50 con 0x7f4964068990 2024-01-22T05:21:16.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f4963400700 1 -- 172.21.15.49:0/2589224138 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00bdd0 con 0x7f4964068990 2024-01-22T05:21:16.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f496b600700 1 -- 172.21.15.49:0/2589224138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4964068990 msgr2=0x7f49640bea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f496b600700 1 --2- 172.21.15.49:0/2589224138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4964068990 0x7f49640bea70 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 rx=0x7f49640a9980 tx=0x7f495c009840).stop 2024-01-22T05:21:16.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f496b600700 1 -- 172.21.15.49:0/2589224138 shutdown_connections 2024-01-22T05:21:16.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f496b600700 1 --2- 172.21.15.49:0/2589224138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4964068990 0x7f49640bea70 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f496b600700 1 --2- 172.21.15.49:0/2589224138 >> v2:172.21.15.110:3300/0 conn(0x7f4964151990 0x7f49640684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.653+0000 7f496b600700 1 -- 172.21.15.49:0/2589224138 >> 172.21.15.49:0/2589224138 conn(0x7f49640c5860 msgr2=0x7f49640c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:16.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.657+0000 7f496b600700 1 -- 172.21.15.49:0/2589224138 shutdown_connections 2024-01-22T05:21:16.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.657+0000 7f496b600700 1 -- 172.21.15.49:0/2589224138 wait complete. 2024-01-22T05:21:16.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.657+0000 7f496b600700 1 Processor -- start 2024-01-22T05:21:16.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f496b600700 1 -- start start 2024-01-22T05:21:16.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f496b600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4964068990 0x7f49641563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f496b600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4964151990 0x7f496414cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f496b600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4964151d70 0x7f496414d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f496b600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4964157120 con 0x7f4964151990 2024-01-22T05:21:16.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f496b600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496414d8e0 con 0x7f4964151d70 2024-01-22T05:21:16.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f496b600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49641568a0 con 0x7f4964068990 2024-01-22T05:21:16.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f4963e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4964151990 0x7f496414cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f4963e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4964151990 0x7f496414cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32782/0 (socket says 172.21.15.49:32782) 2024-01-22T05:21:16.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f4963e00700 1 -- 172.21.15.49:0/3639055660 learned_addr learned my addr 172.21.15.49:0/3639055660 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:16.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f4968c00700 1 --2- 172.21.15.49:0/3639055660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4964068990 0x7f49641563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f496a000700 1 --2- 172.21.15.49:0/3639055660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4964151d70 0x7f496414d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f4963e00700 1 -- 172.21.15.49:0/3639055660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4964068990 msgr2=0x7f49641563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f4963e00700 1 --2- 172.21.15.49:0/3639055660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4964068990 0x7f49641563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f4963e00700 1 -- 172.21.15.49:0/3639055660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4964151d70 msgr2=0x7f496414d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f4963e00700 1 --2- 172.21.15.49:0/3639055660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4964151d70 0x7f496414d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f4963e00700 1 -- 172.21.15.49:0/3639055660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c009ae0 con 0x7f4964151990 2024-01-22T05:21:16.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f4963e00700 1 --2- 172.21.15.49:0/3639055660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4964151990 0x7f496414cf00 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 rx=0x7f494c00c470 tx=0x7f494c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:16.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.661+0000 7f495be00700 1 -- 172.21.15.49:0/3639055660 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c007020 con 0x7f4964151990 2024-01-22T05:21:16.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.665+0000 7f495be00700 1 -- 172.21.15.49:0/3639055660 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494c007180 con 0x7f4964151990 2024-01-22T05:21:16.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.665+0000 7f496b600700 1 -- 172.21.15.49:0/3639055660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4964156b60 con 0x7f4964151990 2024-01-22T05:21:16.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.665+0000 7f495be00700 1 -- 172.21.15.49:0/3639055660 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c007520 con 0x7f4964151990 2024-01-22T05:21:16.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.665+0000 7f496b600700 1 -- 172.21.15.49:0/3639055660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49640c3560 con 0x7f4964151990 2024-01-22T05:21:16.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.665+0000 7f496b600700 1 -- 172.21.15.49:0/3639055660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4964047060 con 0x7f4964151990 2024-01-22T05:21:16.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.665+0000 7f495be00700 1 -- 172.21.15.49:0/3639055660 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f494c0068b0 con 0x7f4964151990 2024-01-22T05:21:16.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.669+0000 7f495be00700 1 --2- 172.21.15.49:0/3639055660 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f493c05a510 0x7f493c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:16.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.669+0000 7f495be00700 1 -- 172.21.15.49:0/3639055660 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f494c073a80 con 0x7f4964151990 2024-01-22T05:21:16.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.669+0000 7f4968c00700 1 --2- 172.21.15.49:0/3639055660 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f493c05a510 0x7f493c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:16.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.669+0000 7f4968c00700 1 --2- 172.21.15.49:0/3639055660 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f493c05a510 0x7f493c05c9d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f495400bb20 tx=0x7f4954008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:16.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.673+0000 7f495be00700 1 -- 172.21.15.49:0/3639055660 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f494c0472e0 con 0x7f4964151990 2024-01-22T05:21:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.849+0000 7f496b600700 1 -- 172.21.15.49:0/3639055660 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f49640680e0 con 0x7f493c05a510 2024-01-22T05:21:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.849+0000 7f495be00700 1 -- 172.21.15.49:0/3639055660 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f49640680e0 con 0x7f493c05a510 2024-01-22T05:21:16.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.853+0000 7f496b600700 1 -- 172.21.15.49:0/3639055660 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f493c05a510 msgr2=0x7f493c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.853+0000 7f496b600700 1 --2- 172.21.15.49:0/3639055660 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f493c05a510 0x7f493c05c9d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f495400bb20 tx=0x7f4954008040).stop 2024-01-22T05:21:16.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.853+0000 7f496b600700 1 -- 172.21.15.49:0/3639055660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4964151990 msgr2=0x7f496414cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:16.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.853+0000 7f496b600700 1 --2- 172.21.15.49:0/3639055660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4964151990 0x7f496414cf00 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 rx=0x7f494c00c470 tx=0x7f494c007e00).stop 2024-01-22T05:21:16.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.853+0000 7f496b600700 1 -- 172.21.15.49:0/3639055660 shutdown_connections 2024-01-22T05:21:16.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.853+0000 7f496b600700 1 --2- 172.21.15.49:0/3639055660 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f493c05a510 0x7f493c05c9d0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.853+0000 7f496b600700 1 --2- 172.21.15.49:0/3639055660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4964151d70 0x7f496414d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.853+0000 7f496b600700 1 --2- 172.21.15.49:0/3639055660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4964151990 0x7f496414cf00 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.853+0000 7f496b600700 1 --2- 172.21.15.49:0/3639055660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4964068990 0x7f49641563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.853+0000 7f496b600700 1 -- 172.21.15.49:0/3639055660 >> 172.21.15.49:0/3639055660 conn(0x7f49640c5860 msgr2=0x7f49640632d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.853+0000 7f496b600700 1 -- 172.21.15.49:0/3639055660 shutdown_connections 2024-01-22T05:21:16.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:16.853+0000 7f496b600700 1 -- 172.21.15.49:0/3639055660 wait complete. 2024-01-22T05:21:16.858 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 4 to deep-scrub 2024-01-22T05:21:16.877 INFO:tasks.ceph:Scrubbing osd.5 2024-01-22T05:21:16.877 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:21:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.049+0000 7fee08600700 1 Processor -- start 2024-01-22T05:21:17.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.049+0000 7fee08600700 1 -- start start 2024-01-22T05:21:17.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.049+0000 7fee08600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee00157dc0 0x7fee00063da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.049+0000 7fee08600700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0015bb10 con 0x7fee001581a0 2024-01-22T05:21:17.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.049+0000 7fee08600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0015c970 con 0x7fee000be200 2024-01-22T05:21:17.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.049+0000 7fee08600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0015bd60 con 0x7fee00157dc0 2024-01-22T05:21:17.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fee05200700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fee001581a0 0x7fee000bdaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45230/0 (socket says 172.21.15.49:45230) 2024-01-22T05:21:17.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fee05200700 1 -- 172.21.15.49:0/3452051111 learned_addr learned my addr 172.21.15.49:0/3452051111 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:17.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fee05c00700 1 --2- 172.21.15.49:0/3452051111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee00157dc0 0x7fee00063da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610552362 0 0) 0x7fee0015bb10 con 0x7fee001581a0 2024-01-22T05:21:17.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fede00033f0 con 0x7fee001581a0 2024-01-22T05:21:17.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513670159 0 0) 0x7fee0015c970 con 0x7fee000be200 2024-01-22T05:21:17.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee0015bb10 con 0x7fee000be200 2024-01-22T05:21:17.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4061471751 0 0) 0x7fede00033f0 con 0x7fee001581a0 2024-01-22T05:21:17.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee00157dc0 msgr2=0x7fee00063da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:17.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 --2- 172.21.15.49:0/3452051111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee00157dc0 0x7fee00063da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 >> v1:172.21.15.110:6789/0 conn(0x7fee000be200 legacy=0x7fee000bc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0015c040 con 0x7fee001581a0 2024-01-22T05:21:17.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3404730099 0 0) 0x7fede8001470 con 0x7fee001581a0 2024-01-22T05:21:17.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 >> v1:172.21.15.49:6789/0 conn(0x7fee001581a0 legacy=0x7fee000bdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 --2- 172.21.15.49:0/3452051111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee00157dc0 0x7fede0003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 --2- 172.21.15.49:0/3452051111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fede0003fb0 0x7fede0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 --2- 172.21.15.49:0/3452051111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fede0004b80 0x7fede0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0015bd60 con 0x7fede0004b80 2024-01-22T05:21:17.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede000b990 con 0x7fede0003fb0 2024-01-22T05:21:17.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede000bb50 con 0x7fee00157dc0 2024-01-22T05:21:17.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fee06600700 1 --2- 172.21.15.49:0/3452051111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fede0004b80 0x7fede0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fee05c00700 1 --2- 172.21.15.49:0/3452051111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee00157dc0 0x7fede0003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fee05200700 1 --2- 172.21.15.49:0/3452051111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fede0003fb0 0x7fede0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fee06600700 1 -- 172.21.15.49:0/3452051111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee00157dc0 msgr2=0x7fede0003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:17.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fee06600700 1 --2- 172.21.15.49:0/3452051111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee00157dc0 0x7fede0003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fee06600700 1 -- 172.21.15.49:0/3452051111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fede0003fb0 msgr2=0x7fede0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:17.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fee06600700 1 --2- 172.21.15.49:0/3452051111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fede0003fb0 0x7fede0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fee06600700 1 -- 172.21.15.49:0/3452051111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede00033f0 con 0x7fede0004b80 2024-01-22T05:21:17.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fee05200700 1 --2- 172.21.15.49:0/3452051111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fede0003fb0 0x7fede0004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:21:17.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fee06600700 1 --2- 172.21.15.49:0/3452051111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fede0004b80 0x7fede0005000 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 rx=0x7fedf8001f60 tx=0x7fedf8007f30).ready entity=mon.0 client_cookie=e03add7270591117 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:17.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf80020c0 con 0x7fede0004b80 2024-01-22T05:21:17.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf8006a20 con 0x7fede0004b80 2024-01-22T05:21:17.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.053+0000 7fedffe00700 1 -- 172.21.15.49:0/3452051111 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf8006dc0 con 0x7fede0004b80 2024-01-22T05:21:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.057+0000 7fee08600700 1 -- 172.21.15.49:0/3452051111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fede0004b80 msgr2=0x7fede0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.057+0000 7fee08600700 1 --2- 172.21.15.49:0/3452051111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fede0004b80 0x7fede0005000 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 rx=0x7fedf8001f60 tx=0x7fedf8007f30).stop 2024-01-22T05:21:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.057+0000 7fee06600700 1 -- 172.21.15.49:0/3452051111 reap_dead start 2024-01-22T05:21:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.057+0000 7fee08600700 1 -- 172.21.15.49:0/3452051111 shutdown_connections 2024-01-22T05:21:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.057+0000 7fee08600700 1 -- 172.21.15.49:0/3452051111 >> 172.21.15.49:0/3452051111 conn(0x7fee000c40c0 msgr2=0x7fee000c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.057+0000 7fee08600700 1 -- 172.21.15.49:0/3452051111 shutdown_connections 2024-01-22T05:21:17.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.057+0000 7fee08600700 1 -- 172.21.15.49:0/3452051111 wait complete. 2024-01-22T05:21:17.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee08600700 1 Processor -- start 2024-01-22T05:21:17.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee08600700 1 -- start start 2024-01-22T05:21:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee08600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fede0004b80 0x7fee000a8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee08600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee000a8530 0x7fee0016be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee08600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee0016c380 0x7fee00154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee08600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee00159800 con 0x7fee000a8530 2024-01-22T05:21:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee08600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee00159aa0 con 0x7fee0016c380 2024-01-22T05:21:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee08600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee00159d80 con 0x7fede0004b80 2024-01-22T05:21:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee05200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee000a8530 0x7fee0016be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee05200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee000a8530 0x7fee0016be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32800/0 (socket says 172.21.15.49:32800) 2024-01-22T05:21:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee05200700 1 -- 172.21.15.49:0/4114653483 learned_addr learned my addr 172.21.15.49:0/4114653483 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:17.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee06600700 1 --2- 172.21.15.49:0/4114653483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee0016c380 0x7fee00154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee05c00700 1 --2- 172.21.15.49:0/4114653483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fede0004b80 0x7fee000a8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee05200700 1 -- 172.21.15.49:0/4114653483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fede0004b80 msgr2=0x7fee000a8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee05200700 1 --2- 172.21.15.49:0/4114653483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fede0004b80 0x7fee000a8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee05200700 1 -- 172.21.15.49:0/4114653483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee0016c380 msgr2=0x7fee00154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee05200700 1 --2- 172.21.15.49:0/4114653483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee0016c380 0x7fee00154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee05200700 1 -- 172.21.15.49:0/4114653483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0015a060 con 0x7fee000a8530 2024-01-22T05:21:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.061+0000 7fee05200700 1 --2- 172.21.15.49:0/4114653483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee000a8530 0x7fee0016be90 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 rx=0x7fede8001c80 tx=0x7fede8001060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.065+0000 7fedfcc00700 1 -- 172.21.15.49:0/4114653483 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8015440 con 0x7fee000a8530 2024-01-22T05:21:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.065+0000 7fedfcc00700 1 -- 172.21.15.49:0/4114653483 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede8010040 con 0x7fee000a8530 2024-01-22T05:21:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.065+0000 7fee08600700 1 -- 172.21.15.49:0/4114653483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee00155870 con 0x7fee000a8530 2024-01-22T05:21:17.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.065+0000 7fedfcc00700 1 -- 172.21.15.49:0/4114653483 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede80157d0 con 0x7fee000a8530 2024-01-22T05:21:17.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.065+0000 7fee08600700 1 -- 172.21.15.49:0/4114653483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee00155210 con 0x7fee000a8530 2024-01-22T05:21:17.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.065+0000 7fee08600700 1 -- 172.21.15.49:0/4114653483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee00065660 con 0x7fee000a8530 2024-01-22T05:21:17.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.069+0000 7fedfcc00700 1 -- 172.21.15.49:0/4114653483 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fede8015bc0 con 0x7fee000a8530 2024-01-22T05:21:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.069+0000 7fedfcc00700 1 --2- 172.21.15.49:0/4114653483 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fedd805a510 0x7fedd805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.069+0000 7fedfcc00700 1 -- 172.21.15.49:0/4114653483 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7fede8073e30 con 0x7fee000a8530 2024-01-22T05:21:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.069+0000 7fee05c00700 1 --2- 172.21.15.49:0/4114653483 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fedd805a510 0x7fedd805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.069+0000 7fedfcc00700 1 --2- 172.21.15.49:0/4114653483 >> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] conn(0x7fedd80611c0 0x7fedd8063660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.069+0000 7fedfcc00700 1 -- 172.21.15.49:0/4114653483 --> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fedd8063ce0 con 0x7fedd80611c0 2024-01-22T05:21:17.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.069+0000 7fedfcc00700 1 -- 172.21.15.49:0/4114653483 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7fede8076390 con 0x7fee000a8530 2024-01-22T05:21:17.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.069+0000 7fee05c00700 1 --2- 172.21.15.49:0/4114653483 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fedd805a510 0x7fedd805c9d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fedf0006d80 tx=0x7fedf0009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:17.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.069+0000 7fee06600700 1 --2- 172.21.15.49:0/4114653483 >> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] conn(0x7fedd80611c0 0x7fedd8063660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.069+0000 7fee06600700 1 --2- 172.21.15.49:0/4114653483 >> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] conn(0x7fedd80611c0 0x7fedd8063660 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:17.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.073+0000 7fedfcc00700 1 -- 172.21.15.49:0/4114653483 <== osd.5 v2:172.21.15.110:6800/23253 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fedd8063ce0 con 0x7fedd80611c0 2024-01-22T05:21:17.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.093+0000 7fee08600700 1 -- 172.21.15.49:0/4114653483 --> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fee0015a1f0 con 0x7fedd80611c0 2024-01-22T05:21:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.093+0000 7fedfcc00700 1 -- 172.21.15.49:0/4114653483 <== osd.5 v2:172.21.15.110:6800/23253 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fee0015a1f0 con 0x7fedd80611c0 2024-01-22T05:21:17.094 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:21:17.094 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:21:17.094 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:21:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.097+0000 7fee08600700 1 -- 172.21.15.49:0/4114653483 >> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] conn(0x7fedd80611c0 msgr2=0x7fedd8063660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.097+0000 7fee08600700 1 --2- 172.21.15.49:0/4114653483 >> [v2:172.21.15.110:6800/23253,v1:172.21.15.110:6801/23253] conn(0x7fedd80611c0 0x7fedd8063660 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.097+0000 7fee08600700 1 -- 172.21.15.49:0/4114653483 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fedd805a510 msgr2=0x7fedd805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.097+0000 7fee08600700 1 --2- 172.21.15.49:0/4114653483 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fedd805a510 0x7fedd805c9d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fedf0006d80 tx=0x7fedf0009060).stop 2024-01-22T05:21:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.097+0000 7fee08600700 1 -- 172.21.15.49:0/4114653483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee000a8530 msgr2=0x7fee0016be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.097+0000 7fee08600700 1 --2- 172.21.15.49:0/4114653483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee000a8530 0x7fee0016be90 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 rx=0x7fede8001c80 tx=0x7fede8001060).stop 2024-01-22T05:21:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.097+0000 7fee06600700 1 -- 172.21.15.49:0/4114653483 reap_dead start 2024-01-22T05:21:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.097+0000 7fee08600700 1 -- 172.21.15.49:0/4114653483 shutdown_connections 2024-01-22T05:21:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.097+0000 7fee08600700 1 -- 172.21.15.49:0/4114653483 >> 172.21.15.49:0/4114653483 conn(0x7fee000c40c0 msgr2=0x7fee00152660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:17.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.097+0000 7fee08600700 1 -- 172.21.15.49:0/4114653483 shutdown_connections 2024-01-22T05:21:17.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.097+0000 7fee08600700 1 -- 172.21.15.49:0/4114653483 wait complete. 2024-01-22T05:21:17.120 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-22T05:21:17.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.285+0000 7f882f800700 1 Processor -- start 2024-01-22T05:21:17.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.285+0000 7f882f800700 1 -- start start 2024-01-22T05:21:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.289+0000 7f882f800700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8828155d20 0x7f8828065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.289+0000 7f882f800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8828066070 0x7f88280a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.289+0000 7f882f800700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88280c1a40 con 0x7f88280a8c30 2024-01-22T05:21:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.289+0000 7f882f800700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88280a9090 con 0x7f8828155d20 2024-01-22T05:21:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.289+0000 7f882f800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8828159310 con 0x7f8828066070 2024-01-22T05:21:17.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.289+0000 7f8827e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8828066070 0x7f88280a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.289+0000 7f882ce00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8828155d20 0x7f8828065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.289+0000 7f8827e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8828066070 0x7f88280a8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:40896/0 (socket says 172.21.15.49:40896) 2024-01-22T05:21:17.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.289+0000 7f8827e00700 1 -- 172.21.15.49:0/2674399414 learned_addr learned my addr 172.21.15.49:0/2674399414 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:17.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.289+0000 7f8827e00700 1 -- 172.21.15.49:0/2674399414 >> v2:172.21.15.110:3300/0 conn(0x7f8828155d20 msgr2=0x7f8828065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:17.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.289+0000 7f8827e00700 1 --2- 172.21.15.49:0/2674399414 >> v2:172.21.15.110:3300/0 conn(0x7f8828155d20 0x7f8828065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.289+0000 7f8827e00700 1 -- 172.21.15.49:0/2674399414 >> v1:172.21.15.110:6789/0 conn(0x7f88280a8c30 legacy=0x7f88280c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.289+0000 7f8827e00700 1 -- 172.21.15.49:0/2674399414 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88280c13f0 con 0x7f8828066070 2024-01-22T05:21:17.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.289+0000 7f8827e00700 1 --2- 172.21.15.49:0/2674399414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8828066070 0x7f88280a8740 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f8810006fd0 tx=0x7f88100090f0).ready entity=mon.2 client_cookie=80783a8da8b9a4b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:17.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.293+0000 7f8827400700 1 -- 172.21.15.49:0/2674399414 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881000b580 con 0x7f8828066070 2024-01-22T05:21:17.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.293+0000 7f8827400700 1 -- 172.21.15.49:0/2674399414 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881000b6e0 con 0x7f8828066070 2024-01-22T05:21:17.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.293+0000 7f8827400700 1 -- 172.21.15.49:0/2674399414 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881000ba60 con 0x7f8828066070 2024-01-22T05:21:17.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.293+0000 7f882f800700 1 -- 172.21.15.49:0/2674399414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8828066070 msgr2=0x7f88280a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.293+0000 7f882f800700 1 --2- 172.21.15.49:0/2674399414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8828066070 0x7f88280a8740 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f8810006fd0 tx=0x7f88100090f0).stop 2024-01-22T05:21:17.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.293+0000 7f882f800700 1 -- 172.21.15.49:0/2674399414 shutdown_connections 2024-01-22T05:21:17.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.293+0000 7f882f800700 1 --2- 172.21.15.49:0/2674399414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8828066070 0x7f88280a8740 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.293+0000 7f882f800700 1 --2- 172.21.15.49:0/2674399414 >> v2:172.21.15.110:3300/0 conn(0x7f8828155d20 0x7f8828065b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.293+0000 7f882f800700 1 -- 172.21.15.49:0/2674399414 >> 172.21.15.49:0/2674399414 conn(0x7f88280c6540 msgr2=0x7f88280c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:17.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.293+0000 7f882f800700 1 -- 172.21.15.49:0/2674399414 shutdown_connections 2024-01-22T05:21:17.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.293+0000 7f882f800700 1 -- 172.21.15.49:0/2674399414 wait complete. 2024-01-22T05:21:17.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.297+0000 7f882f800700 1 Processor -- start 2024-01-22T05:21:17.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.297+0000 7f882f800700 1 -- start start 2024-01-22T05:21:17.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.297+0000 7f882f800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8828066070 0x7f88280ac160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.297+0000 7f882f800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88280a8c30 0x7f8828168e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.297+0000 7f882f800700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8828155d20 0x7f88280c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.297+0000 7f882f800700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88280ac650 con 0x7f88280a8c30 2024-01-22T05:21:17.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.297+0000 7f882f800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8828152f90 con 0x7f8828066070 2024-01-22T05:21:17.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.297+0000 7f882f800700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882816c410 con 0x7f8828155d20 2024-01-22T05:21:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f8827e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88280a8c30 0x7f8828168e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f8827e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88280a8c30 0x7f8828168e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32812/0 (socket says 172.21.15.49:32812) 2024-01-22T05:21:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f8827e00700 1 -- 172.21.15.49:0/1249877396 learned_addr learned my addr 172.21.15.49:0/1249877396 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f882ce00700 1 --2- 172.21.15.49:0/1249877396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8828066070 0x7f88280ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f882d800700 1 --2- 172.21.15.49:0/1249877396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8828155d20 0x7f88280c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f8827e00700 1 -- 172.21.15.49:0/1249877396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8828155d20 msgr2=0x7f88280c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f8827e00700 1 --2- 172.21.15.49:0/1249877396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8828155d20 0x7f88280c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f8827e00700 1 -- 172.21.15.49:0/1249877396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8828066070 msgr2=0x7f88280ac160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f8827e00700 1 --2- 172.21.15.49:0/1249877396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8828066070 0x7f88280ac160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f8827e00700 1 -- 172.21.15.49:0/1249877396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8810009370 con 0x7f88280a8c30 2024-01-22T05:21:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f8827e00700 1 --2- 172.21.15.49:0/1249877396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88280a8c30 0x7f8828168e60 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 rx=0x7f8810009ea0 tx=0x7f8810017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f881fe00700 1 -- 172.21.15.49:0/1249877396 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8810000bc0 con 0x7f88280a8c30 2024-01-22T05:21:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f881fe00700 1 -- 172.21.15.49:0/1249877396 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881000b850 con 0x7f88280a8c30 2024-01-22T05:21:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f882f800700 1 -- 172.21.15.49:0/1249877396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882816c6f0 con 0x7f88280a8c30 2024-01-22T05:21:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f881fe00700 1 -- 172.21.15.49:0/1249877396 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8810000d20 con 0x7f88280a8c30 2024-01-22T05:21:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.301+0000 7f882f800700 1 -- 172.21.15.49:0/1249877396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88281693a0 con 0x7f88280a8c30 2024-01-22T05:21:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.305+0000 7f882f800700 1 -- 172.21.15.49:0/1249877396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882816c880 con 0x7f88280a8c30 2024-01-22T05:21:17.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.305+0000 7f881fe00700 1 -- 172.21.15.49:0/1249877396 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f881001cad0 con 0x7f88280a8c30 2024-01-22T05:21:17.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.305+0000 7f881fe00700 1 --2- 172.21.15.49:0/1249877396 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f880005a4e0 0x7f880005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.305+0000 7f881fe00700 1 -- 172.21.15.49:0/1249877396 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f8810076900 con 0x7f88280a8c30 2024-01-22T05:21:17.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.309+0000 7f882ce00700 1 --2- 172.21.15.49:0/1249877396 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f880005a4e0 0x7f880005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.309+0000 7f882ce00700 1 --2- 172.21.15.49:0/1249877396 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f880005a4e0 0x7f880005c9a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f8818009b90 tx=0x7f8818009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:17.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.313+0000 7f881fe00700 1 -- 172.21.15.49:0/1249877396 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f881004a0e0 con 0x7f88280a8c30 2024-01-22T05:21:17.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.481+0000 7f882f800700 1 -- 172.21.15.49:0/1249877396 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f88280c16d0 con 0x7f880005a4e0 2024-01-22T05:21:17.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.481+0000 7f881fe00700 1 -- 172.21.15.49:0/1249877396 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f88280c16d0 con 0x7f880005a4e0 2024-01-22T05:21:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.485+0000 7f882f800700 1 -- 172.21.15.49:0/1249877396 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f880005a4e0 msgr2=0x7f880005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.485+0000 7f882f800700 1 --2- 172.21.15.49:0/1249877396 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f880005a4e0 0x7f880005c9a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f8818009b90 tx=0x7f8818009060).stop 2024-01-22T05:21:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.485+0000 7f882f800700 1 -- 172.21.15.49:0/1249877396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88280a8c30 msgr2=0x7f8828168e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.485+0000 7f882f800700 1 --2- 172.21.15.49:0/1249877396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88280a8c30 0x7f8828168e60 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 rx=0x7f8810009ea0 tx=0x7f8810017000).stop 2024-01-22T05:21:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.485+0000 7f882f800700 1 -- 172.21.15.49:0/1249877396 shutdown_connections 2024-01-22T05:21:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.485+0000 7f882f800700 1 --2- 172.21.15.49:0/1249877396 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f880005a4e0 0x7f880005c9a0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.485+0000 7f882f800700 1 --2- 172.21.15.49:0/1249877396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8828155d20 0x7f88280c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.485+0000 7f882f800700 1 --2- 172.21.15.49:0/1249877396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88280a8c30 0x7f8828168e60 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.485+0000 7f882f800700 1 --2- 172.21.15.49:0/1249877396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8828066070 0x7f88280ac160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.485+0000 7f882f800700 1 -- 172.21.15.49:0/1249877396 >> 172.21.15.49:0/1249877396 conn(0x7f88280c6540 msgr2=0x7f8828067c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.485+0000 7f882f800700 1 -- 172.21.15.49:0/1249877396 shutdown_connections 2024-01-22T05:21:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.485+0000 7f882f800700 1 -- 172.21.15.49:0/1249877396 wait complete. 2024-01-22T05:21:17.486 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 5 to deep-scrub 2024-01-22T05:21:17.504 INFO:tasks.ceph:Scrubbing osd.6 2024-01-22T05:21:17.504 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:21:17.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.669+0000 7f9d81a00700 1 Processor -- start 2024-01-22T05:21:17.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.673+0000 7f9d81a00700 1 -- start start 2024-01-22T05:21:17.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.673+0000 7f9d81a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d7c068cb0 0x7f9d7c15b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d81a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9d7c067a90 0x7f9d7c067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d81a00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c066560 con 0x7f9d7c0683e0 2024-01-22T05:21:17.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d81a00700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7c0bc930 con 0x7f9d7c067a90 2024-01-22T05:21:17.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d81a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c068890 con 0x7f9d7c068cb0 2024-01-22T05:21:17.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d7be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d7c068cb0 0x7f9d7c15b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d7be00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d7c068cb0 0x7f9d7c15b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:40902/0 (socket says 172.21.15.49:40902) 2024-01-22T05:21:17.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d7be00700 1 -- 172.21.15.49:0/1021157082 learned_addr learned my addr 172.21.15.49:0/1021157082 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:17.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d7b400700 1 --2- 172.21.15.49:0/1021157082 >> v2:172.21.15.110:3300/0 conn(0x7f9d7c067a90 0x7f9d7c067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d7be00700 1 -- 172.21.15.49:0/1021157082 >> v2:172.21.15.110:3300/0 conn(0x7f9d7c067a90 msgr2=0x7f9d7c067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:17.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d7be00700 1 --2- 172.21.15.49:0/1021157082 >> v2:172.21.15.110:3300/0 conn(0x7f9d7c067a90 0x7f9d7c067ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d7be00700 1 -- 172.21.15.49:0/1021157082 >> v1:172.21.15.110:6789/0 conn(0x7f9d7c0683e0 legacy=0x7f9d7c15bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d7aa00700 1 -- 172.21.15.49:0/1021157082 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327890543 0 0) 0x7f9d7c066560 con 0x7f9d7c0683e0 2024-01-22T05:21:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d7be00700 1 -- 172.21.15.49:0/1021157082 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c065950 con 0x7f9d7c068cb0 2024-01-22T05:21:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d7b400700 1 --2- 172.21.15.49:0/1021157082 >> v2:172.21.15.110:3300/0 conn(0x7f9d7c067a90 0x7f9d7c067ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:21:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d7be00700 1 --2- 172.21.15.49:0/1021157082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d7c068cb0 0x7f9d7c15b3d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f9d6c006fd0 tx=0x7f9d6c0090f0).ready entity=mon.2 client_cookie=956fdb406f89c6f9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:17.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d7aa00700 1 -- 172.21.15.49:0/1021157082 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c00b580 con 0x7f9d7c068cb0 2024-01-22T05:21:17.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d7aa00700 1 -- 172.21.15.49:0/1021157082 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c00b6e0 con 0x7f9d7c068cb0 2024-01-22T05:21:17.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.677+0000 7f9d7aa00700 1 -- 172.21.15.49:0/1021157082 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c00ba60 con 0x7f9d7c068cb0 2024-01-22T05:21:17.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.681+0000 7f9d81a00700 1 -- 172.21.15.49:0/1021157082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d7c068cb0 msgr2=0x7f9d7c15b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.681+0000 7f9d81a00700 1 --2- 172.21.15.49:0/1021157082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d7c068cb0 0x7f9d7c15b3d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f9d6c006fd0 tx=0x7f9d6c0090f0).stop 2024-01-22T05:21:17.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.681+0000 7f9d81a00700 1 -- 172.21.15.49:0/1021157082 shutdown_connections 2024-01-22T05:21:17.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.681+0000 7f9d81a00700 1 --2- 172.21.15.49:0/1021157082 >> v2:172.21.15.110:3300/0 conn(0x7f9d7c067a90 0x7f9d7c067ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.681+0000 7f9d81a00700 1 --2- 172.21.15.49:0/1021157082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d7c068cb0 0x7f9d7c15b3d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.681+0000 7f9d81a00700 1 -- 172.21.15.49:0/1021157082 >> 172.21.15.49:0/1021157082 conn(0x7f9d7c0c6f70 msgr2=0x7f9d7c0c2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:17.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.681+0000 7f9d81a00700 1 -- 172.21.15.49:0/1021157082 shutdown_connections 2024-01-22T05:21:17.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.681+0000 7f9d81a00700 1 -- 172.21.15.49:0/1021157082 wait complete. 2024-01-22T05:21:17.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.685+0000 7f9d81a00700 1 Processor -- start 2024-01-22T05:21:17.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.685+0000 7f9d81a00700 1 -- start start 2024-01-22T05:21:17.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.685+0000 7f9d81a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d7c067a90 0x7f9d7c14cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.685+0000 7f9d81a00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d7c0683e0 0x7f9d7c0bf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d81a00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d7c068cb0 0x7f9d7c169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d81a00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c169df0 con 0x7f9d7c0683e0 2024-01-22T05:21:17.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d81a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0bfa30 con 0x7f9d7c067a90 2024-01-22T05:21:17.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d81a00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c09f540 con 0x7f9d7c068cb0 2024-01-22T05:21:17.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d7be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d7c067a90 0x7f9d7c14cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d7b400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d7c0683e0 0x7f9d7c0bf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d7be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d7c067a90 0x7f9d7c14cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.49:43574/0 (socket says 172.21.15.49:43574) 2024-01-22T05:21:17.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d7be00700 1 -- 172.21.15.49:0/2605626915 learned_addr learned my addr 172.21.15.49:0/2605626915 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:17.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d81000700 1 --2- 172.21.15.49:0/2605626915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d7c068cb0 0x7f9d7c169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d81000700 1 -- 172.21.15.49:0/2605626915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d7c067a90 msgr2=0x7f9d7c14cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d81000700 1 --2- 172.21.15.49:0/2605626915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d7c067a90 0x7f9d7c14cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d81000700 1 -- 172.21.15.49:0/2605626915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d7c0683e0 msgr2=0x7f9d7c0bf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d81000700 1 --2- 172.21.15.49:0/2605626915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d7c0683e0 0x7f9d7c0bf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d81000700 1 -- 172.21.15.49:0/2605626915 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d640092a0 con 0x7f9d7c068cb0 2024-01-22T05:21:17.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d7b400700 1 --2- 172.21.15.49:0/2605626915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d7c0683e0 0x7f9d7c0bf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:21:17.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d81000700 1 --2- 172.21.15.49:0/2605626915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d7c068cb0 0x7f9d7c169900 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f9d7400c810 tx=0x7f9d74007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:17.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d73400700 1 -- 172.21.15.49:0/2605626915 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7400e4a0 con 0x7f9d7c068cb0 2024-01-22T05:21:17.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d73400700 1 -- 172.21.15.49:0/2605626915 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7400e620 con 0x7f9d7c068cb0 2024-01-22T05:21:17.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d73400700 1 -- 172.21.15.49:0/2605626915 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7400e7d0 con 0x7f9d7c068cb0 2024-01-22T05:21:17.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d81a00700 1 -- 172.21.15.49:0/2605626915 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6c009370 con 0x7f9d7c068cb0 2024-01-22T05:21:17.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.689+0000 7f9d81a00700 1 -- 172.21.15.49:0/2605626915 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c09fb00 con 0x7f9d7c068cb0 2024-01-22T05:21:17.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.693+0000 7f9d81a00700 1 -- 172.21.15.49:0/2605626915 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d7c05fd40 con 0x7f9d7c068cb0 2024-01-22T05:21:17.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.693+0000 7f9d73400700 1 -- 172.21.15.49:0/2605626915 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9d7400eb40 con 0x7f9d7c068cb0 2024-01-22T05:21:17.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.693+0000 7f9d73400700 1 --2- 172.21.15.49:0/2605626915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d5405a510 0x7f9d5405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.693+0000 7f9d73400700 1 -- 172.21.15.49:0/2605626915 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f9d74074130 con 0x7f9d7c068cb0 2024-01-22T05:21:17.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.693+0000 7f9d7be00700 1 --2- 172.21.15.49:0/2605626915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d5405a510 0x7f9d5405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.693+0000 7f9d73400700 1 --2- 172.21.15.49:0/2605626915 >> [v2:172.21.15.110:6822/23255,v1:172.21.15.110:6823/23255] conn(0x7f9d540611c0 0x7f9d54063660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.693+0000 7f9d73400700 1 -- 172.21.15.49:0/2605626915 --> [v2:172.21.15.110:6822/23255,v1:172.21.15.110:6823/23255] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d54063ce0 con 0x7f9d540611c0 2024-01-22T05:21:17.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.693+0000 7f9d73400700 1 -- 172.21.15.49:0/2605626915 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d74076690 con 0x7f9d7c068cb0 2024-01-22T05:21:17.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.697+0000 7f9d7b400700 1 --2- 172.21.15.49:0/2605626915 >> [v2:172.21.15.110:6822/23255,v1:172.21.15.110:6823/23255] conn(0x7f9d540611c0 0x7f9d54063660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.697+0000 7f9d7be00700 1 --2- 172.21.15.49:0/2605626915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d5405a510 0x7f9d5405c9d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f9d6c00b340 tx=0x7f9d6c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:17.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.697+0000 7f9d7b400700 1 --2- 172.21.15.49:0/2605626915 >> [v2:172.21.15.110:6822/23255,v1:172.21.15.110:6823/23255] conn(0x7f9d540611c0 0x7f9d54063660 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:17.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.697+0000 7f9d73400700 1 -- 172.21.15.49:0/2605626915 <== osd.6 v2:172.21.15.110:6822/23255 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f9d54063ce0 con 0x7f9d540611c0 2024-01-22T05:21:17.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.717+0000 7f9d81a00700 1 -- 172.21.15.49:0/2605626915 --> [v2:172.21.15.110:6822/23255,v1:172.21.15.110:6823/23255] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9d7c0bc510 con 0x7f9d540611c0 2024-01-22T05:21:17.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.717+0000 7f9d73400700 1 -- 172.21.15.49:0/2605626915 <== osd.6 v2:172.21.15.110:6822/23255 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9d7c0bc510 con 0x7f9d540611c0 2024-01-22T05:21:17.716 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:21:17.716 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:21:17.716 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:21:17.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.717+0000 7f9d81a00700 1 -- 172.21.15.49:0/2605626915 >> [v2:172.21.15.110:6822/23255,v1:172.21.15.110:6823/23255] conn(0x7f9d540611c0 msgr2=0x7f9d54063660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.717+0000 7f9d81a00700 1 --2- 172.21.15.49:0/2605626915 >> [v2:172.21.15.110:6822/23255,v1:172.21.15.110:6823/23255] conn(0x7f9d540611c0 0x7f9d54063660 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.717+0000 7f9d81a00700 1 -- 172.21.15.49:0/2605626915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d5405a510 msgr2=0x7f9d5405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.717+0000 7f9d81a00700 1 --2- 172.21.15.49:0/2605626915 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f9d5405a510 0x7f9d5405c9d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f9d6c00b340 tx=0x7f9d6c017000).stop 2024-01-22T05:21:17.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.717+0000 7f9d81a00700 1 -- 172.21.15.49:0/2605626915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d7c068cb0 msgr2=0x7f9d7c169900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.717+0000 7f9d81a00700 1 --2- 172.21.15.49:0/2605626915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d7c068cb0 0x7f9d7c169900 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f9d7400c810 tx=0x7f9d74007e60).stop 2024-01-22T05:21:17.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.717+0000 7f9d81000700 1 -- 172.21.15.49:0/2605626915 reap_dead start 2024-01-22T05:21:17.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.721+0000 7f9d81a00700 1 -- 172.21.15.49:0/2605626915 shutdown_connections 2024-01-22T05:21:17.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.721+0000 7f9d81a00700 1 -- 172.21.15.49:0/2605626915 >> 172.21.15.49:0/2605626915 conn(0x7f9d7c0c6f70 msgr2=0x7f9d7c0a9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:17.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.721+0000 7f9d81a00700 1 -- 172.21.15.49:0/2605626915 shutdown_connections 2024-01-22T05:21:17.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.721+0000 7f9d81a00700 1 -- 172.21.15.49:0/2605626915 wait complete. 2024-01-22T05:21:17.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-22T05:21:17.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.905+0000 7fdba5400700 1 Processor -- start 2024-01-22T05:21:17.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.905+0000 7fdba5400700 1 -- start start 2024-01-22T05:21:17.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.909+0000 7fdba5400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba00a8b10 0x7fdba0157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.909+0000 7fdba5400700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba00c1ee0 con 0x7fdba0066fb0 2024-01-22T05:21:17.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.909+0000 7fdba5400700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba00c12f0 con 0x7fdba00a8f90 2024-01-22T05:21:17.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.909+0000 7fdba5400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba00c15b0 con 0x7fdba00a8b10 2024-01-22T05:21:17.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.909+0000 7fdb9e800700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdba0066fb0 0x7fdba00c2370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45246/0 (socket says 172.21.15.49:45246) 2024-01-22T05:21:17.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.909+0000 7fdb9e800700 1 -- 172.21.15.49:0/1684685677 learned_addr learned my addr 172.21.15.49:0/1684685677 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.909+0000 7fdb9de00700 1 --2- 172.21.15.49:0/1684685677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba00a8b10 0x7fdba0157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.909+0000 7fdb9d400700 1 -- 172.21.15.49:0/1684685677 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104357320 0 0) 0x7fdba00c1ee0 con 0x7fdba0066fb0 2024-01-22T05:21:17.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdb9d400700 1 -- 172.21.15.49:0/1684685677 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb800033f0 con 0x7fdba0066fb0 2024-01-22T05:21:17.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdb9de00700 1 -- 172.21.15.49:0/1684685677 >> v1:172.21.15.110:6789/0 conn(0x7fdba00a8f90 legacy=0x7fdba0065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdb9de00700 1 -- 172.21.15.49:0/1684685677 >> v1:172.21.15.49:6789/0 conn(0x7fdba0066fb0 legacy=0x7fdba00c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdb9d400700 1 -- 172.21.15.49:0/1684685677 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732630764 0 0) 0x7fdba00c12f0 con 0x7fdba00a8f90 2024-01-22T05:21:17.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdb9de00700 1 -- 172.21.15.49:0/1684685677 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba00c1890 con 0x7fdba00a8b10 2024-01-22T05:21:17.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdb9de00700 1 --2- 172.21.15.49:0/1684685677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba00a8b10 0x7fdba0157740 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fdb88009790 tx=0x7fdb88009060).ready entity=mon.2 client_cookie=a0bce5ca20337c75 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:17.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdb9d400700 1 -- 172.21.15.49:0/1684685677 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8800f510 con 0x7fdba00a8b10 2024-01-22T05:21:17.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdb9d400700 1 -- 172.21.15.49:0/1684685677 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8800f670 con 0x7fdba00a8b10 2024-01-22T05:21:17.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdb9d400700 1 -- 172.21.15.49:0/1684685677 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8800f9f0 con 0x7fdba00a8b10 2024-01-22T05:21:17.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdba5400700 1 -- 172.21.15.49:0/1684685677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba00a8b10 msgr2=0x7fdba0157740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdba5400700 1 --2- 172.21.15.49:0/1684685677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba00a8b10 0x7fdba0157740 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fdb88009790 tx=0x7fdb88009060).stop 2024-01-22T05:21:17.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdba5400700 1 -- 172.21.15.49:0/1684685677 shutdown_connections 2024-01-22T05:21:17.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdba5400700 1 --2- 172.21.15.49:0/1684685677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba00a8b10 0x7fdba0157740 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdba5400700 1 -- 172.21.15.49:0/1684685677 >> 172.21.15.49:0/1684685677 conn(0x7fdba00c6540 msgr2=0x7fdba00c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:17.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdba5400700 1 -- 172.21.15.49:0/1684685677 shutdown_connections 2024-01-22T05:21:17.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.913+0000 7fdba5400700 1 -- 172.21.15.49:0/1684685677 wait complete. 2024-01-22T05:21:17.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.917+0000 7fdba5400700 1 Processor -- start 2024-01-22T05:21:17.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.917+0000 7fdba5400700 1 -- start start 2024-01-22T05:21:17.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.917+0000 7fdba5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba0066fb0 0x7fdba0151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.917+0000 7fdba5400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba00a8b10 0x7fdba00aa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.917+0000 7fdba5400700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba00a8f90 0x7fdba00bf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.917+0000 7fdba5400700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba00bfa80 con 0x7fdba0066fb0 2024-01-22T05:21:17.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.917+0000 7fdba5400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba00a95b0 con 0x7fdba00a8b10 2024-01-22T05:21:17.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.917+0000 7fdba5400700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba00aafa0 con 0x7fdba00a8f90 2024-01-22T05:21:17.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdb9e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba0066fb0 0x7fdba0151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdb9e800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba0066fb0 0x7fdba0151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32828/0 (socket says 172.21.15.49:32828) 2024-01-22T05:21:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdb9e800700 1 -- 172.21.15.49:0/2075531746 learned_addr learned my addr 172.21.15.49:0/2075531746 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdb9de00700 1 --2- 172.21.15.49:0/2075531746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba00a8b10 0x7fdba00aa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdb9f200700 1 --2- 172.21.15.49:0/2075531746 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba00a8f90 0x7fdba00bf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdb9e800700 1 -- 172.21.15.49:0/2075531746 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba00a8f90 msgr2=0x7fdba00bf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdb9e800700 1 --2- 172.21.15.49:0/2075531746 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba00a8f90 0x7fdba00bf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdb9e800700 1 -- 172.21.15.49:0/2075531746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba00a8b10 msgr2=0x7fdba00aa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdb9e800700 1 --2- 172.21.15.49:0/2075531746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba00a8b10 0x7fdba00aa9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdb9e800700 1 -- 172.21.15.49:0/2075531746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb880092a0 con 0x7fdba0066fb0 2024-01-22T05:21:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdb9e800700 1 --2- 172.21.15.49:0/2075531746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba0066fb0 0x7fdba0151810 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 rx=0x7fdb90001ed0 tx=0x7fdb90007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdb96000700 1 -- 172.21.15.49:0/2075531746 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9000ce10 con 0x7fdba0066fb0 2024-01-22T05:21:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdb96000700 1 -- 172.21.15.49:0/2075531746 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb900072e0 con 0x7fdba0066fb0 2024-01-22T05:21:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdba5400700 1 -- 172.21.15.49:0/2075531746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba00ab280 con 0x7fdba0066fb0 2024-01-22T05:21:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdb96000700 1 -- 172.21.15.49:0/2075531746 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb900057a0 con 0x7fdba0066fb0 2024-01-22T05:21:17.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.921+0000 7fdba5400700 1 -- 172.21.15.49:0/2075531746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba00ab840 con 0x7fdba0066fb0 2024-01-22T05:21:17.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.925+0000 7fdba5400700 1 -- 172.21.15.49:0/2075531746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba0047060 con 0x7fdba0066fb0 2024-01-22T05:21:17.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.925+0000 7fdb96000700 1 -- 172.21.15.49:0/2075531746 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdb90005b50 con 0x7fdba0066fb0 2024-01-22T05:21:17.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.925+0000 7fdb96000700 1 --2- 172.21.15.49:0/2075531746 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb7805a510 0x7fdb7805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:17.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.925+0000 7fdb96000700 1 -- 172.21.15.49:0/2075531746 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7fdb90073d20 con 0x7fdba0066fb0 2024-01-22T05:21:17.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.925+0000 7fdb9de00700 1 --2- 172.21.15.49:0/2075531746 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb7805a510 0x7fdb7805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:17.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.929+0000 7fdb9de00700 1 --2- 172.21.15.49:0/2075531746 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb7805a510 0x7fdb7805c9d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fdba01534a0 tx=0x7fdb88017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:17.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:17.933+0000 7fdb96000700 1 -- 172.21.15.49:0/2075531746 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdb90047640 con 0x7fdba0066fb0 2024-01-22T05:21:18.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.093+0000 7fdba5400700 1 -- 172.21.15.49:0/2075531746 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fdba00c1b70 con 0x7fdb7805a510 2024-01-22T05:21:18.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.093+0000 7fdb96000700 1 -- 172.21.15.49:0/2075531746 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdba00c1b70 con 0x7fdb7805a510 2024-01-22T05:21:18.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.097+0000 7fdba5400700 1 -- 172.21.15.49:0/2075531746 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb7805a510 msgr2=0x7fdb7805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.097+0000 7fdba5400700 1 --2- 172.21.15.49:0/2075531746 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb7805a510 0x7fdb7805c9d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fdba01534a0 tx=0x7fdb88017000).stop 2024-01-22T05:21:18.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.097+0000 7fdba5400700 1 -- 172.21.15.49:0/2075531746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba0066fb0 msgr2=0x7fdba0151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.097+0000 7fdba5400700 1 --2- 172.21.15.49:0/2075531746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba0066fb0 0x7fdba0151810 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 rx=0x7fdb90001ed0 tx=0x7fdb90007c70).stop 2024-01-22T05:21:18.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.097+0000 7fdba5400700 1 -- 172.21.15.49:0/2075531746 shutdown_connections 2024-01-22T05:21:18.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.097+0000 7fdba5400700 1 --2- 172.21.15.49:0/2075531746 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fdb7805a510 0x7fdb7805c9d0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.097+0000 7fdba5400700 1 --2- 172.21.15.49:0/2075531746 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdba00a8f90 0x7fdba00bf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.097+0000 7fdba5400700 1 --2- 172.21.15.49:0/2075531746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba00a8b10 0x7fdba00aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.097+0000 7fdba5400700 1 --2- 172.21.15.49:0/2075531746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdba0066fb0 0x7fdba0151810 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.097+0000 7fdba5400700 1 -- 172.21.15.49:0/2075531746 >> 172.21.15.49:0/2075531746 conn(0x7fdba00c6540 msgr2=0x7fdba00c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:18.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.097+0000 7fdba5400700 1 -- 172.21.15.49:0/2075531746 shutdown_connections 2024-01-22T05:21:18.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.097+0000 7fdba5400700 1 -- 172.21.15.49:0/2075531746 wait complete. 2024-01-22T05:21:18.101 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 6 to deep-scrub 2024-01-22T05:21:18.118 INFO:tasks.ceph:Scrubbing osd.7 2024-01-22T05:21:18.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:21:18.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.297+0000 7f97a7200700 1 Processor -- start 2024-01-22T05:21:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.301+0000 7f97a7200700 1 -- start start 2024-01-22T05:21:18.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a7200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f97a8064400 0x7f97a815ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a7200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a80697e0 con 0x7f97a80bd5f0 2024-01-22T05:21:18.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a7200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a8068bd0 con 0x7f97a8069c70 2024-01-22T05:21:18.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a7200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a80680b0 con 0x7f97a8064400 2024-01-22T05:21:18.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a6800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f97a8064400 0x7f97a815ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a6800700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f97a8064400 0x7f97a815ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32840/0 (socket says 172.21.15.49:32840) 2024-01-22T05:21:18.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a6800700 1 -- 172.21.15.49:0/3849586669 learned_addr learned my addr 172.21.15.49:0/3849586669 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:18.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a5400700 1 --1- 172.21.15.49:0/3849586669 >> v1:172.21.15.49:6789/0 conn(0x7f97a80bd5f0 0x7f97a8063cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45254/0 (socket says 172.21.15.49:45254) 2024-01-22T05:21:18.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a6800700 1 -- 172.21.15.49:0/3849586669 >> v1:172.21.15.110:6789/0 conn(0x7f97a8069c70 legacy=0x7f97a80bcee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:18.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a6800700 1 -- 172.21.15.49:0/3849586669 >> v1:172.21.15.49:6789/0 conn(0x7f97a80bd5f0 legacy=0x7f97a8063cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a6800700 1 -- 172.21.15.49:0/3849586669 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a8068eb0 con 0x7f97a8064400 2024-01-22T05:21:18.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a4a00700 1 -- 172.21.15.49:0/3849586669 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451181141 0 0) 0x7f97a80697e0 con 0x7f97a80bd5f0 2024-01-22T05:21:18.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a6800700 1 --2- 172.21.15.49:0/3849586669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97a8064400 0x7f97a815ea30 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 rx=0x7f97a0009f20 tx=0x7f97a0009840).ready entity=mon.0 client_cookie=60215311d725a268 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:18.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a4a00700 1 -- 172.21.15.49:0/3849586669 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a000e070 con 0x7f97a8064400 2024-01-22T05:21:18.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a4a00700 1 -- 172.21.15.49:0/3849586669 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a000ba80 con 0x7f97a8064400 2024-01-22T05:21:18.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a4a00700 1 -- 172.21.15.49:0/3849586669 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a000be00 con 0x7f97a8064400 2024-01-22T05:21:18.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a7200700 1 -- 172.21.15.49:0/3849586669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97a8064400 msgr2=0x7f97a815ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.305+0000 7f97a7200700 1 --2- 172.21.15.49:0/3849586669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97a8064400 0x7f97a815ea30 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 rx=0x7f97a0009f20 tx=0x7f97a0009840).stop 2024-01-22T05:21:18.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.309+0000 7f97a7200700 1 -- 172.21.15.49:0/3849586669 shutdown_connections 2024-01-22T05:21:18.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.309+0000 7f97a7200700 1 --2- 172.21.15.49:0/3849586669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97a8064400 0x7f97a815ea30 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.309+0000 7f97a7200700 1 -- 172.21.15.49:0/3849586669 >> 172.21.15.49:0/3849586669 conn(0x7f97a80627d0 msgr2=0x7f97a8062bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:18.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.309+0000 7f97a7200700 1 -- 172.21.15.49:0/3849586669 shutdown_connections 2024-01-22T05:21:18.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.309+0000 7f97a7200700 1 -- 172.21.15.49:0/3849586669 wait complete. 2024-01-22T05:21:18.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.309+0000 7f97a7200700 1 Processor -- start 2024-01-22T05:21:18.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.313+0000 7f97a7200700 1 -- start start 2024-01-22T05:21:18.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.313+0000 7f97a7200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97a8064400 0x7f97a8168a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.313+0000 7f97a7200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97a8069c70 0x7f97a80bedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.313+0000 7f97a7200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97a80bd5f0 0x7f97a814f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.313+0000 7f97a7200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a80be660 con 0x7f97a8069c70 2024-01-22T05:21:18.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.313+0000 7f97a7200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a81692c0 con 0x7f97a80bd5f0 2024-01-22T05:21:18.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.313+0000 7f97a7200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a81695a0 con 0x7f97a8064400 2024-01-22T05:21:18.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.313+0000 7f97a5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97a8069c70 0x7f97a80bedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.313+0000 7f97a5400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97a8069c70 0x7f97a80bedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32856/0 (socket says 172.21.15.49:32856) 2024-01-22T05:21:18.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.313+0000 7f97a5400700 1 -- 172.21.15.49:0/2224344647 learned_addr learned my addr 172.21.15.49:0/2224344647 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:18.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.313+0000 7f97a6800700 1 --2- 172.21.15.49:0/2224344647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97a80bd5f0 0x7f97a814f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.313+0000 7f97a5e00700 1 --2- 172.21.15.49:0/2224344647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97a8064400 0x7f97a8168a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.317+0000 7f97a5400700 1 -- 172.21.15.49:0/2224344647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97a8064400 msgr2=0x7f97a8168a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.317+0000 7f97a5400700 1 --2- 172.21.15.49:0/2224344647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97a8064400 0x7f97a8168a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.317+0000 7f97a5400700 1 -- 172.21.15.49:0/2224344647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97a80bd5f0 msgr2=0x7f97a814f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.317+0000 7f97a5400700 1 --2- 172.21.15.49:0/2224344647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97a80bd5f0 0x7f97a814f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.317+0000 7f97a5400700 1 -- 172.21.15.49:0/2224344647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a0009ae0 con 0x7f97a8069c70 2024-01-22T05:21:18.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.317+0000 7f97a5400700 1 --2- 172.21.15.49:0/2224344647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97a8069c70 0x7f97a80bedb0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 rx=0x7f979000c4c0 tx=0x7f9790007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:18.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.317+0000 7f979d600700 1 -- 172.21.15.49:0/2224344647 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97900072e0 con 0x7f97a8069c70 2024-01-22T05:21:18.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.317+0000 7f979d600700 1 -- 172.21.15.49:0/2224344647 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9790007440 con 0x7f97a8069c70 2024-01-22T05:21:18.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.317+0000 7f979d600700 1 -- 172.21.15.49:0/2224344647 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790005930 con 0x7f97a8069c70 2024-01-22T05:21:18.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.317+0000 7f97a7200700 1 -- 172.21.15.49:0/2224344647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a8169880 con 0x7f97a8069c70 2024-01-22T05:21:18.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.317+0000 7f97a7200700 1 -- 172.21.15.49:0/2224344647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a8168f30 con 0x7f97a8069c70 2024-01-22T05:21:18.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.317+0000 7f97a7200700 1 -- 172.21.15.49:0/2224344647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97a80655f0 con 0x7f97a8069c70 2024-01-22T05:21:18.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.321+0000 7f979d600700 1 -- 172.21.15.49:0/2224344647 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9790005ce0 con 0x7f97a8069c70 2024-01-22T05:21:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.321+0000 7f979d600700 1 --2- 172.21.15.49:0/2224344647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f978005a510 0x7f978005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.321+0000 7f979d600700 1 -- 172.21.15.49:0/2224344647 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f9790073f60 con 0x7f97a8069c70 2024-01-22T05:21:18.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.321+0000 7f97a5e00700 1 --2- 172.21.15.49:0/2224344647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f978005a510 0x7f978005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.321+0000 7f979d600700 1 --2- 172.21.15.49:0/2224344647 >> [v2:172.21.15.110:6808/23254,v1:172.21.15.110:6809/23254] conn(0x7f97800611c0 0x7f9780063660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.321+0000 7f979d600700 1 -- 172.21.15.49:0/2224344647 --> [v2:172.21.15.110:6808/23254,v1:172.21.15.110:6809/23254] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9780063ce0 con 0x7f97800611c0 2024-01-22T05:21:18.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.321+0000 7f979d600700 1 -- 172.21.15.49:0/2224344647 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97900764c0 con 0x7f97a8069c70 2024-01-22T05:21:18.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.321+0000 7f97a6800700 1 --2- 172.21.15.49:0/2224344647 >> [v2:172.21.15.110:6808/23254,v1:172.21.15.110:6809/23254] conn(0x7f97800611c0 0x7f9780063660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.321+0000 7f97a5e00700 1 --2- 172.21.15.49:0/2224344647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f978005a510 0x7f978005c9d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f97a80c73f0 tx=0x7f9798009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.325+0000 7f97a6800700 1 --2- 172.21.15.49:0/2224344647 >> [v2:172.21.15.110:6808/23254,v1:172.21.15.110:6809/23254] conn(0x7f97800611c0 0x7f9780063660 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:18.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.325+0000 7f979d600700 1 -- 172.21.15.49:0/2224344647 <== osd.7 v2:172.21.15.110:6808/23254 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f9780063ce0 con 0x7f97800611c0 2024-01-22T05:21:18.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.341+0000 7f97a7200700 1 -- 172.21.15.49:0/2224344647 --> [v2:172.21.15.110:6808/23254,v1:172.21.15.110:6809/23254] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f97a80c63a0 con 0x7f97800611c0 2024-01-22T05:21:18.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.345+0000 7f979d600700 1 -- 172.21.15.49:0/2224344647 <== osd.7 v2:172.21.15.110:6808/23254 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f97a80c63a0 con 0x7f97800611c0 2024-01-22T05:21:18.343 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-22T05:21:18.343 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:21:18.343 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-22T05:21:18.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.345+0000 7f97a7200700 1 -- 172.21.15.49:0/2224344647 >> [v2:172.21.15.110:6808/23254,v1:172.21.15.110:6809/23254] conn(0x7f97800611c0 msgr2=0x7f9780063660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.345+0000 7f97a7200700 1 --2- 172.21.15.49:0/2224344647 >> [v2:172.21.15.110:6808/23254,v1:172.21.15.110:6809/23254] conn(0x7f97800611c0 0x7f9780063660 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.345+0000 7f97a7200700 1 -- 172.21.15.49:0/2224344647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f978005a510 msgr2=0x7f978005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.345+0000 7f97a7200700 1 --2- 172.21.15.49:0/2224344647 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f978005a510 0x7f978005c9d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f97a80c73f0 tx=0x7f9798009040).stop 2024-01-22T05:21:18.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.345+0000 7f97a7200700 1 -- 172.21.15.49:0/2224344647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97a8069c70 msgr2=0x7f97a80bedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.345+0000 7f97a7200700 1 --2- 172.21.15.49:0/2224344647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97a8069c70 0x7f97a80bedb0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 rx=0x7f979000c4c0 tx=0x7f9790007c10).stop 2024-01-22T05:21:18.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.345+0000 7f97a6800700 1 -- 172.21.15.49:0/2224344647 reap_dead start 2024-01-22T05:21:18.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.345+0000 7f97a7200700 1 -- 172.21.15.49:0/2224344647 shutdown_connections 2024-01-22T05:21:18.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.345+0000 7f97a7200700 1 -- 172.21.15.49:0/2224344647 >> 172.21.15.49:0/2224344647 conn(0x7f97a80627d0 msgr2=0x7f97a80664e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:18.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.345+0000 7f97a7200700 1 -- 172.21.15.49:0/2224344647 shutdown_connections 2024-01-22T05:21:18.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.345+0000 7f97a7200700 1 -- 172.21.15.49:0/2224344647 wait complete. 2024-01-22T05:21:18.370 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-22T05:21:18.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.537+0000 7f05db600700 1 Processor -- start 2024-01-22T05:21:18.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.537+0000 7f05db600700 1 -- start start 2024-01-22T05:21:18.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05db600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f05d4150600 0x7f05d4067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05db600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f05d4150a70 0x7f05d4067f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05db600700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d40c4490 con 0x7f05d40a8240 2024-01-22T05:21:18.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05db600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d4062940 con 0x7f05d4150a70 2024-01-22T05:21:18.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05db600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d4068470 con 0x7f05d4150600 2024-01-22T05:21:18.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05da000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f05d4150a70 0x7f05d4067f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05da000700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f05d4150a70 0x7f05d4067f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32858/0 (socket says 172.21.15.49:32858) 2024-01-22T05:21:18.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05da000700 1 -- 172.21.15.49:0/2036205553 learned_addr learned my addr 172.21.15.49:0/2036205553 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:18.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05d8c00700 1 --1- 172.21.15.49:0/2036205553 >> v1:172.21.15.110:6789/0 conn(0x7f05d40a8240 0x7f05d4062230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.49:42992/0 (socket says 172.21.15.49:42992) 2024-01-22T05:21:18.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05d3e00700 1 --2- 172.21.15.49:0/2036205553 >> v2:172.21.15.110:3300/0 conn(0x7f05d4150600 0x7f05d4067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05da000700 1 -- 172.21.15.49:0/2036205553 >> v2:172.21.15.110:3300/0 conn(0x7f05d4150600 msgr2=0x7f05d4067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:18.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05da000700 1 --2- 172.21.15.49:0/2036205553 >> v2:172.21.15.110:3300/0 conn(0x7f05d4150600 0x7f05d4067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05da000700 1 -- 172.21.15.49:0/2036205553 >> v1:172.21.15.110:6789/0 conn(0x7f05d40a8240 legacy=0x7f05d4062230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05da000700 1 -- 172.21.15.49:0/2036205553 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d4154800 con 0x7f05d4150a70 2024-01-22T05:21:18.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05da000700 1 --2- 172.21.15.49:0/2036205553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05d4150a70 0x7f05d4067f80 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 rx=0x7f05d40c7bd0 tx=0x7f05cc009840).ready entity=mon.0 client_cookie=3c8e5c705a750b6f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:18.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05d3400700 1 -- 172.21.15.49:0/2036205553 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc00ba50 con 0x7f05d4150a70 2024-01-22T05:21:18.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05d3400700 1 -- 172.21.15.49:0/2036205553 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc00bbb0 con 0x7f05d4150a70 2024-01-22T05:21:18.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05d3400700 1 -- 172.21.15.49:0/2036205553 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc011480 con 0x7f05d4150a70 2024-01-22T05:21:18.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05db600700 1 -- 172.21.15.49:0/2036205553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05d4150a70 msgr2=0x7f05d4067f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.541+0000 7f05db600700 1 --2- 172.21.15.49:0/2036205553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05d4150a70 0x7f05d4067f80 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 rx=0x7f05d40c7bd0 tx=0x7f05cc009840).stop 2024-01-22T05:21:18.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.545+0000 7f05db600700 1 -- 172.21.15.49:0/2036205553 shutdown_connections 2024-01-22T05:21:18.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.545+0000 7f05db600700 1 --2- 172.21.15.49:0/2036205553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05d4150a70 0x7f05d4067f80 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.545+0000 7f05db600700 1 --2- 172.21.15.49:0/2036205553 >> v2:172.21.15.110:3300/0 conn(0x7f05d4150600 0x7f05d4067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.545+0000 7f05db600700 1 -- 172.21.15.49:0/2036205553 >> 172.21.15.49:0/2036205553 conn(0x7f05d40c5860 msgr2=0x7f05d40c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:18.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.545+0000 7f05db600700 1 -- 172.21.15.49:0/2036205553 shutdown_connections 2024-01-22T05:21:18.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.545+0000 7f05db600700 1 -- 172.21.15.49:0/2036205553 wait complete. 2024-01-22T05:21:18.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.545+0000 7f05db600700 1 Processor -- start 2024-01-22T05:21:18.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.545+0000 7f05db600700 1 -- start start 2024-01-22T05:21:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05db600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d40a8240 0x7f05d414b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05db600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05d4150600 0x7f05d4150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05db600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05d4150a70 0x7f05d4152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05db600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40a95f0 con 0x7f05d4150a70 2024-01-22T05:21:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05db600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d414be20 con 0x7f05d40a8240 2024-01-22T05:21:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05db600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d41517a0 con 0x7f05d4150600 2024-01-22T05:21:18.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05da000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05d4150a70 0x7f05d4152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05da000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05d4150a70 0x7f05d4152b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32872/0 (socket says 172.21.15.49:32872) 2024-01-22T05:21:18.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05da000700 1 -- 172.21.15.49:0/850937976 learned_addr learned my addr 172.21.15.49:0/850937976 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:18.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05d8c00700 1 --2- 172.21.15.49:0/850937976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d40a8240 0x7f05d414b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05d3e00700 1 --2- 172.21.15.49:0/850937976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05d4150600 0x7f05d4150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05da000700 1 -- 172.21.15.49:0/850937976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05d4150600 msgr2=0x7f05d4150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05da000700 1 --2- 172.21.15.49:0/850937976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05d4150600 0x7f05d4150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05da000700 1 -- 172.21.15.49:0/850937976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d40a8240 msgr2=0x7f05d414b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05da000700 1 --2- 172.21.15.49:0/850937976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d40a8240 0x7f05d414b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05da000700 1 -- 172.21.15.49:0/850937976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc009ae0 con 0x7f05d4150a70 2024-01-22T05:21:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05da000700 1 --2- 172.21.15.49:0/850937976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05d4150a70 0x7f05d4152b80 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 rx=0x7f05cc009fd0 tx=0x7f05cc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:18.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05cbe00700 1 -- 172.21.15.49:0/850937976 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc01b400 con 0x7f05d4150a70 2024-01-22T05:21:18.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05cbe00700 1 -- 172.21.15.49:0/850937976 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc01b560 con 0x7f05d4150a70 2024-01-22T05:21:18.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05cbe00700 1 -- 172.21.15.49:0/850937976 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc01b8e0 con 0x7f05d4150a70 2024-01-22T05:21:18.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05db600700 1 -- 172.21.15.49:0/850937976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d4151a80 con 0x7f05d4150a70 2024-01-22T05:21:18.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.549+0000 7f05db600700 1 -- 172.21.15.49:0/850937976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d4152040 con 0x7f05d4150a70 2024-01-22T05:21:18.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.553+0000 7f05db600700 1 -- 172.21.15.49:0/850937976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d406a380 con 0x7f05d4150a70 2024-01-22T05:21:18.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.553+0000 7f05cbe00700 1 -- 172.21.15.49:0/850937976 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f05cc01bcd0 con 0x7f05d4150a70 2024-01-22T05:21:18.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.557+0000 7f05cbe00700 1 --2- 172.21.15.49:0/850937976 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05ac05a510 0x7f05ac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.557+0000 7f05cbe00700 1 -- 172.21.15.49:0/850937976 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f05cc076420 con 0x7f05d4150a70 2024-01-22T05:21:18.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.557+0000 7f05d8c00700 1 --2- 172.21.15.49:0/850937976 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05ac05a510 0x7f05ac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.557+0000 7f05d8c00700 1 --2- 172.21.15.49:0/850937976 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05ac05a510 0x7f05ac05c9d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f05c4007fd0 tx=0x7f05c4007d30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:18.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.561+0000 7f05cbe00700 1 -- 172.21.15.49:0/850937976 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f05d406a380 con 0x7f05d4150a70 2024-01-22T05:21:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.729+0000 7f05db600700 1 -- 172.21.15.49:0/850937976 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f05d406a380 con 0x7f05ac05a510 2024-01-22T05:21:18.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.733+0000 7f05cbe00700 1 -- 172.21.15.49:0/850937976 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f05d406a380 con 0x7f05ac05a510 2024-01-22T05:21:18.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.737+0000 7f05db600700 1 -- 172.21.15.49:0/850937976 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05ac05a510 msgr2=0x7f05ac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.737+0000 7f05db600700 1 --2- 172.21.15.49:0/850937976 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05ac05a510 0x7f05ac05c9d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f05c4007fd0 tx=0x7f05c4007d30).stop 2024-01-22T05:21:18.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.737+0000 7f05db600700 1 -- 172.21.15.49:0/850937976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05d4150a70 msgr2=0x7f05d4152b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.737+0000 7f05db600700 1 --2- 172.21.15.49:0/850937976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05d4150a70 0x7f05d4152b80 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 rx=0x7f05cc009fd0 tx=0x7f05cc009840).stop 2024-01-22T05:21:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.737+0000 7f05db600700 1 -- 172.21.15.49:0/850937976 shutdown_connections 2024-01-22T05:21:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.737+0000 7f05db600700 1 --2- 172.21.15.49:0/850937976 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f05ac05a510 0x7f05ac05c9d0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.737+0000 7f05db600700 1 --2- 172.21.15.49:0/850937976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05d4150a70 0x7f05d4152b80 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.737+0000 7f05db600700 1 --2- 172.21.15.49:0/850937976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05d4150600 0x7f05d4150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.737+0000 7f05db600700 1 --2- 172.21.15.49:0/850937976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d40a8240 0x7f05d414b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.737+0000 7f05db600700 1 -- 172.21.15.49:0/850937976 >> 172.21.15.49:0/850937976 conn(0x7f05d40c5860 msgr2=0x7f05d40c7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.737+0000 7f05db600700 1 -- 172.21.15.49:0/850937976 shutdown_connections 2024-01-22T05:21:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.737+0000 7f05db600700 1 -- 172.21.15.49:0/850937976 wait complete. 2024-01-22T05:21:18.740 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 7 to deep-scrub 2024-01-22T05:21:18.758 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:21:18.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.913+0000 7fa7d4e00700 1 Processor -- start 2024-01-22T05:21:18.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.917+0000 7fa7d4e00700 1 -- start start 2024-01-22T05:21:18.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.917+0000 7fa7d4e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7d0067a90 0x7fa7d0067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.917+0000 7fa7d4e00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7d00bdad0 0x7fa7d00bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.917+0000 7fa7d4e00700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d00693b0 con 0x7fa7d01554f0 2024-01-22T05:21:18.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.917+0000 7fa7d4e00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d0152dd0 con 0x7fa7d00bdad0 2024-01-22T05:21:18.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.917+0000 7fa7d4e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00687a0 con 0x7fa7d0067a90 2024-01-22T05:21:18.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.917+0000 7fa7cde00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa7d01554f0 0x7fa7d01558d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45264/0 (socket says 172.21.15.49:45264) 2024-01-22T05:21:18.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.917+0000 7fa7cde00700 1 -- 172.21.15.49:0/170247011 learned_addr learned my addr 172.21.15.49:0/170247011 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:18.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7cd400700 1 --2- 172.21.15.49:0/170247011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7d0067a90 0x7fa7d0067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7ce800700 1 --2- 172.21.15.49:0/170247011 >> v2:172.21.15.49:3300/0 conn(0x7fa7d00bdad0 0x7fa7d00bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7cca00700 1 -- 172.21.15.49:0/170247011 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802369319 0 0) 0x7fa7d00693b0 con 0x7fa7d01554f0 2024-01-22T05:21:18.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7cca00700 1 -- 172.21.15.49:0/170247011 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7b00033f0 con 0x7fa7d01554f0 2024-01-22T05:21:18.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7cd400700 1 -- 172.21.15.49:0/170247011 >> v2:172.21.15.49:3300/0 conn(0x7fa7d00bdad0 msgr2=0x7fa7d00bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:18.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7cd400700 1 --2- 172.21.15.49:0/170247011 >> v2:172.21.15.49:3300/0 conn(0x7fa7d00bdad0 0x7fa7d00bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7cd400700 1 -- 172.21.15.49:0/170247011 >> v1:172.21.15.49:6789/0 conn(0x7fa7d01554f0 legacy=0x7fa7d01558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7cd400700 1 -- 172.21.15.49:0/170247011 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d0068a80 con 0x7fa7d0067a90 2024-01-22T05:21:18.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7cd400700 1 --2- 172.21.15.49:0/170247011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7d0067a90 0x7fa7d0067ef0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fa7b8009760 tx=0x7fa7b8009060).ready entity=mon.2 client_cookie=bfa80f43e6670770 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7cca00700 1 -- 172.21.15.49:0/170247011 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b800d4a0 con 0x7fa7d0067a90 2024-01-22T05:21:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7cca00700 1 -- 172.21.15.49:0/170247011 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b800d600 con 0x7fa7d0067a90 2024-01-22T05:21:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7cca00700 1 -- 172.21.15.49:0/170247011 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b800d980 con 0x7fa7d0067a90 2024-01-22T05:21:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7d4e00700 1 -- 172.21.15.49:0/170247011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7d0067a90 msgr2=0x7fa7d0067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7d4e00700 1 --2- 172.21.15.49:0/170247011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7d0067a90 0x7fa7d0067ef0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fa7b8009760 tx=0x7fa7b8009060).stop 2024-01-22T05:21:18.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7d4e00700 1 -- 172.21.15.49:0/170247011 shutdown_connections 2024-01-22T05:21:18.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7d4e00700 1 --2- 172.21.15.49:0/170247011 >> v2:172.21.15.49:3300/0 conn(0x7fa7d00bdad0 0x7fa7d00bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7d4e00700 1 --2- 172.21.15.49:0/170247011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7d0067a90 0x7fa7d0067ef0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.921+0000 7fa7d4e00700 1 -- 172.21.15.49:0/170247011 >> 172.21.15.49:0/170247011 conn(0x7fa7d00c8710 msgr2=0x7fa7d00c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:18.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.925+0000 7fa7d4e00700 1 -- 172.21.15.49:0/170247011 shutdown_connections 2024-01-22T05:21:18.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.925+0000 7fa7d4e00700 1 -- 172.21.15.49:0/170247011 wait complete. 2024-01-22T05:21:18.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.925+0000 7fa7d4e00700 1 Processor -- start 2024-01-22T05:21:18.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.925+0000 7fa7d4e00700 1 -- start start 2024-01-22T05:21:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7d4e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7d0067a90 0x7fa7d0167e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7d4e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7d00bdad0 0x7fa7d00c1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7d4e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d01554f0 0x7fa7d00c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7d4e00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00bf550 con 0x7fa7d01554f0 2024-01-22T05:21:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7d4e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0149300 con 0x7fa7d00bdad0 2024-01-22T05:21:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7d4e00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0149ba0 con 0x7fa7d0067a90 2024-01-22T05:21:18.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7ce800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d01554f0 0x7fa7d00c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7ce800700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d01554f0 0x7fa7d00c2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32880/0 (socket says 172.21.15.49:32880) 2024-01-22T05:21:18.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7ce800700 1 -- 172.21.15.49:0/2240562351 learned_addr learned my addr 172.21.15.49:0/2240562351 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:18.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7cde00700 1 --2- 172.21.15.49:0/2240562351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7d0067a90 0x7fa7d0167e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7cd400700 1 --2- 172.21.15.49:0/2240562351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7d00bdad0 0x7fa7d00c1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7ce800700 1 -- 172.21.15.49:0/2240562351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7d0067a90 msgr2=0x7fa7d0167e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7ce800700 1 --2- 172.21.15.49:0/2240562351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7d0067a90 0x7fa7d0167e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7ce800700 1 -- 172.21.15.49:0/2240562351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7d00bdad0 msgr2=0x7fa7d00c1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:18.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7ce800700 1 --2- 172.21.15.49:0/2240562351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7d00bdad0 0x7fa7d00c1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:18.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7ce800700 1 -- 172.21.15.49:0/2240562351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b80092a0 con 0x7fa7d01554f0 2024-01-22T05:21:18.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7ce800700 1 --2- 172.21.15.49:0/2240562351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d01554f0 0x7fa7d00c2250 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 rx=0x7fa7c8009ec0 tx=0x7fa7c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:18.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7c5600700 1 -- 172.21.15.49:0/2240562351 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c800cc20 con 0x7fa7d01554f0 2024-01-22T05:21:18.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7c5600700 1 -- 172.21.15.49:0/2240562351 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c800f040 con 0x7fa7d01554f0 2024-01-22T05:21:18.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7d4e00700 1 -- 172.21.15.49:0/2240562351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d0153c30 con 0x7fa7d01554f0 2024-01-22T05:21:18.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.929+0000 7fa7c5600700 1 -- 172.21.15.49:0/2240562351 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8013400 con 0x7fa7d01554f0 2024-01-22T05:21:18.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.933+0000 7fa7d4e00700 1 -- 172.21.15.49:0/2240562351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d0149830 con 0x7fa7d01554f0 2024-01-22T05:21:18.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.933+0000 7fa7d4e00700 1 -- 172.21.15.49:0/2240562351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d0047060 con 0x7fa7d01554f0 2024-01-22T05:21:18.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.933+0000 7fa7c5600700 1 -- 172.21.15.49:0/2240562351 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa7c80137b0 con 0x7fa7d01554f0 2024-01-22T05:21:18.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.933+0000 7fa7c5600700 1 --2- 172.21.15.49:0/2240562351 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7a805a510 0x7fa7a805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:18.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.933+0000 7fa7c5600700 1 -- 172.21.15.49:0/2240562351 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7fa7c8074fe0 con 0x7fa7d01554f0 2024-01-22T05:21:18.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.933+0000 7fa7cde00700 1 --2- 172.21.15.49:0/2240562351 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7a805a510 0x7fa7a805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:18.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.937+0000 7fa7cde00700 1 --2- 172.21.15.49:0/2240562351 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7a805a510 0x7fa7a805c9d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7fa7c0001360 tx=0x7fa7c0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:18.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:18.941+0000 7fa7c5600700 1 -- 172.21.15.49:0/2240562351 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa7c8048860 con 0x7fa7d01554f0 2024-01-22T05:21:19.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:19.105+0000 7fa7d4e00700 1 -- 172.21.15.49:0/2240562351 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7d0046800 con 0x7fa7a805a510 2024-01-22T05:21:19.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:19.113+0000 7fa7c5600700 1 -- 172.21.15.49:0/2240562351 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68631 (secure 0 0 0) 0x7fa7d0046800 con 0x7fa7a805a510 2024-01-22T05:21:19.113 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:21:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:19.117+0000 7fa7d4e00700 1 -- 172.21.15.49:0/2240562351 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7a805a510 msgr2=0x7fa7a805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:19.117+0000 7fa7d4e00700 1 --2- 172.21.15.49:0/2240562351 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7a805a510 0x7fa7a805c9d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7fa7c0001360 tx=0x7fa7c0009040).stop 2024-01-22T05:21:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:19.117+0000 7fa7d4e00700 1 -- 172.21.15.49:0/2240562351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d01554f0 msgr2=0x7fa7d00c2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:19.117+0000 7fa7d4e00700 1 --2- 172.21.15.49:0/2240562351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d01554f0 0x7fa7d00c2250 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 rx=0x7fa7c8009ec0 tx=0x7fa7c800b040).stop 2024-01-22T05:21:19.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:19.117+0000 7fa7d4e00700 1 -- 172.21.15.49:0/2240562351 shutdown_connections 2024-01-22T05:21:19.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:19.117+0000 7fa7d4e00700 1 --2- 172.21.15.49:0/2240562351 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fa7a805a510 0x7fa7a805c9d0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:19.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:19.117+0000 7fa7d4e00700 1 --2- 172.21.15.49:0/2240562351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d01554f0 0x7fa7d00c2250 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:19.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:19.117+0000 7fa7d4e00700 1 --2- 172.21.15.49:0/2240562351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7d00bdad0 0x7fa7d00c1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:19.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:19.117+0000 7fa7d4e00700 1 --2- 172.21.15.49:0/2240562351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7d0067a90 0x7fa7d0167e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:19.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:19.117+0000 7fa7d4e00700 1 -- 172.21.15.49:0/2240562351 >> 172.21.15.49:0/2240562351 conn(0x7fa7d00c8710 msgr2=0x7fa7d00c3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:19.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:19.117+0000 7fa7d4e00700 1 -- 172.21.15.49:0/2240562351 shutdown_connections 2024-01-22T05:21:19.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:19.117+0000 7fa7d4e00700 1 -- 172.21.15.49:0/2240562351 wait complete. 2024-01-22T05:21:19.120 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:21:19.139 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":701,"stamp":"2024-01-22T05:21:17.607960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2459264,"kb_used_data":20032,"kb_used_omap":0,"kb_used_meta":2439168,"kb_avail":752515456,"statfs":{"total":773094113280,"available":770575826944,"internally_reserved":0,"allocated":20512768,"data_stored":10252864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2497708032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12620476,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-66,"num_read_kb":-71,"num_write":-91,"num_write_kb":-12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.095826"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-01-22T05:21:06.690803+0000","last_change":"2024-01-22T05:04:29.386796+0000","last_active":"2024-01-22T05:21:06.690803+0000","last_peered":"2024-01-22T05:21:06.690803+0000","last_clean":"2024-01-22T05:21:06.690803+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:21:06.690803+0000","last_undegraded":"2024-01-22T05:21:06.690803+0000","last_fullsized":"2024-01-22T05:21:06.690803+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":173,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-01-22T05:21:06.690690+0000","last_change":"2024-01-22T05:04:29.388023+0000","last_active":"2024-01-22T05:21:06.690690+0000","last_peered":"2024-01-22T05:21:06.690690+0000","last_clean":"2024-01-22T05:21:06.690690+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:21:06.690690+0000","last_undegraded":"2024-01-22T05:21:06.690690+0000","last_fullsized":"2024-01-22T05:21:06.690690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":160,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:04.340429+0000","last_change":"2024-01-22T05:04:30.122384+0000","last_active":"2024-01-22T05:21:04.340429+0000","last_peered":"2024-01-22T05:21:04.340429+0000","last_clean":"2024-01-22T05:21:04.340429+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:21:04.340429+0000","last_undegraded":"2024-01-22T05:21:04.340429+0000","last_fullsized":"2024-01-22T05:21:04.340429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":173,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-01-22T05:21:06.691242+0000","last_change":"2024-01-22T05:04:30.123581+0000","last_active":"2024-01-22T05:21:06.691242+0000","last_peered":"2024-01-22T05:21:06.691242+0000","last_clean":"2024-01-22T05:21:06.691242+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:21:06.691242+0000","last_undegraded":"2024-01-22T05:21:06.691242+0000","last_fullsized":"2024-01-22T05:21:06.691242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":195,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-01-22T05:21:06.687554+0000","last_change":"2024-01-22T05:04:29.384970+0000","last_active":"2024-01-22T05:21:06.687554+0000","last_peered":"2024-01-22T05:21:06.687554+0000","last_clean":"2024-01-22T05:21:06.687554+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:21:06.687554+0000","last_undegraded":"2024-01-22T05:21:06.687554+0000","last_fullsized":"2024-01-22T05:21:06.687554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":175,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-22T05:21:16.403463+0000","last_change":"2024-01-22T05:21:16.403463+0000","last_active":"2024-01-22T05:21:16.403463+0000","last_peered":"2024-01-22T05:21:16.403463+0000","last_clean":"2024-01-22T05:21:16.403463+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:21:16.403463+0000","last_undegraded":"2024-01-22T05:21:16.403463+0000","last_fullsized":"2024-01-22T05:21:16.403463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:21:16.403340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:21:16.403340+0000","last_clean_scrub_stamp":"2024-01-22T05:21:16.403340+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":160,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:04.338459+0000","last_change":"2024-01-22T05:04:29.388420+0000","last_active":"2024-01-22T05:21:04.338459+0000","last_peered":"2024-01-22T05:21:04.338459+0000","last_clean":"2024-01-22T05:21:04.338459+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:21:04.338459+0000","last_undegraded":"2024-01-22T05:21:04.338459+0000","last_fullsized":"2024-01-22T05:21:04.338459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":195,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-01-22T05:21:06.685094+0000","last_change":"2024-01-22T05:04:29.388841+0000","last_active":"2024-01-22T05:21:06.685094+0000","last_peered":"2024-01-22T05:21:06.685094+0000","last_clean":"2024-01-22T05:21:06.685094+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:21:06.685094+0000","last_undegraded":"2024-01-22T05:21:06.685094+0000","last_fullsized":"2024-01-22T05:21:06.685094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:28.364976+0000","last_clean_scrub_stamp":"2024-01-22T05:04:28.364976+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":161,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-01-22T05:21:04.338620+0000","last_change":"2024-01-22T05:04:28.388833+0000","last_active":"2024-01-22T05:21:04.338620+0000","last_peered":"2024-01-22T05:21:04.338620+0000","last_clean":"2024-01-22T05:21:04.338620+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:21:04.338620+0000","last_undegraded":"2024-01-22T05:21:04.338620+0000","last_fullsized":"2024-01-22T05:21:04.338620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:04:27.355522+0000","last_clean_scrub_stamp":"2024-01-22T05:04:27.355522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575052,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312016,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059824,"statfs":{"total":96636764160,"available":96317259776,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.194,"15min":1.1040000000000001},"min":{"1min":0.71199999999999997,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.512,"5min":7.3170000000000002,"15min":14.779999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.1519999999999999,"15min":1.3839999999999999},"min":{"1min":0.80700000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.411,"5min":3.7789999999999999,"15min":76.662000000000006},"last":0.84199999999999997}]},{"osd":1,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.153,"15min":1.0800000000000001},"min":{"1min":0.77400000000000002,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.5089999999999999,"5min":1.657,"15min":4.9269999999999996},"last":1.26},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.206,"15min":1.2010000000000001},"min":{"1min":0.78700000000000003,"5min":0.71599999999999997,"15min":0.58999999999999997},"max":{"1min":1.4770000000000001,"5min":3.6040000000000001,"15min":12.691000000000001},"last":0.94499999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1759999999999999,"15min":1.135},"min":{"1min":0.59499999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.482,"5min":2.1589999999999998,"15min":2.5150000000000001},"last":1.115},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.244,"15min":1.232},"min":{"1min":0.93100000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4550000000000001,"5min":2.633,"15min":15.036},"last":1.3620000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2230000000000001,"15min":1.4470000000000001},"min":{"1min":0.83699999999999997,"5min":0.82399999999999995,"15min":0.69799999999999995},"max":{"1min":1.5409999999999999,"5min":1.752,"15min":64.983999999999995},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.304,"15min":1.3029999999999999},"min":{"1min":1.0349999999999999,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":1.581,"5min":2.2770000000000001,"15min":15.073},"last":1.175}]},{"osd":4,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1859999999999999,"15min":1.1970000000000001},"min":{"1min":0.81399999999999995,"5min":0.53000000000000003,"15min":0.32900000000000001},"max":{"1min":1.4790000000000001,"5min":3.1840000000000002,"15min":22.239000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.228,"15min":1.27},"min":{"1min":0.77100000000000002,"5min":0.66200000000000003,"15min":0.52200000000000002},"max":{"1min":1.488,"5min":1.9830000000000001,"15min":27.872},"last":1.012}]},{"osd":5,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2629999999999999,"15min":1.456},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.40400000000000003},"max":{"1min":1.5840000000000001,"5min":2.3530000000000002,"15min":65.652000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.329,"15min":1.2989999999999999},"min":{"1min":0.90800000000000003,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":1.4950000000000001,"5min":2.1539999999999999,"15min":3.625},"last":1.2869999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.325,"15min":1.264},"min":{"1min":0.91200000000000003,"5min":0.85299999999999998,"15min":0.53400000000000003},"max":{"1min":1.5669999999999999,"5min":3.3439999999999999,"15min":6.9939999999999998},"last":1.325},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.425,"15min":1.421},"min":{"1min":1.01,"5min":0.73299999999999998,"15min":0.56100000000000005},"max":{"1min":1.6100000000000001,"5min":2.246,"15min":12.965},"last":1.464}]}]},{"osd":6,"up_from":13,"seq":55834575052,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307920,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063920,"statfs":{"total":96636764160,"available":96321454080,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.091,"15min":1.2849999999999999},"min":{"1min":0.81999999999999995,"5min":0.66600000000000004,"15min":0.35999999999999999},"max":{"1min":1.4039999999999999,"5min":1.927,"15min":77.745000000000005},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.165,"5min":1.0720000000000001,"15min":1.0860000000000001},"min":{"1min":0.89300000000000002,"5min":0.64500000000000002,"15min":0.44},"max":{"1min":1.5,"5min":1.74,"15min":13.555999999999999},"last":0.73799999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0940000000000001,"15min":1.127},"min":{"1min":0.72499999999999998,"5min":0.629,"15min":0.40000000000000002},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":15.499000000000001},"last":1.034},{"interface":"front","average":{"1min":1.131,"5min":1.155,"15min":1.1379999999999999},"min":{"1min":0.79900000000000004,"5min":0.76200000000000001,"15min":0.54800000000000004},"max":{"1min":1.3879999999999999,"5min":1.6379999999999999,"15min":7.7629999999999999},"last":1.119}]},{"osd":2,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1990000000000001,"15min":1.1699999999999999},"min":{"1min":0.95299999999999996,"5min":0.84999999999999998,"15min":0.57399999999999995},"max":{"1min":1.373,"5min":1.5680000000000001,"15min":3.0960000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.175,"15min":1.1559999999999999},"min":{"1min":0.98399999999999999,"5min":0.747,"15min":0.38200000000000001},"max":{"1min":1.657,"5min":1.657,"15min":4.9660000000000002},"last":0.95199999999999996}]},{"osd":3,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2010000000000001,"15min":1.5009999999999999},"min":{"1min":0.997,"5min":0.72699999999999998,"15min":0.63500000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":102.08199999999999},"last":1.141},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.181,"15min":1.2150000000000001},"min":{"1min":0.88300000000000001,"5min":0.81799999999999995,"15min":0.374},"max":{"1min":1.4750000000000001,"5min":1.5409999999999999,"15min":15.468},"last":1.2350000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.155,"15min":1.159},"min":{"1min":0.69999999999999996,"5min":0.69399999999999995,"15min":0.495},"max":{"1min":1.48,"5min":1.6040000000000001,"15min":3.1749999999999998},"last":1.272},{"interface":"front","average":{"1min":1.254,"5min":1.1970000000000001,"15min":1.1779999999999999},"min":{"1min":0.90700000000000003,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.53,"5min":1.865,"15min":5.1200000000000001},"last":1.1899999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1559999999999999,"15min":1.2390000000000001},"min":{"1min":0.75900000000000001,"5min":0.68400000000000005,"15min":0.48099999999999998},"max":{"1min":1.4610000000000001,"5min":1.617,"15min":30.533000000000001},"last":1.306},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.268,"15min":1.276},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.46600000000000003},"max":{"1min":1.601,"5min":1.8169999999999999,"15min":3.875},"last":1.3360000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3500000000000001,"15min":1.427},"min":{"1min":0.81399999999999995,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":1.802,"5min":2.0009999999999999,"15min":23.547999999999998},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3089999999999999,"15min":1.5389999999999999},"min":{"1min":1.0900000000000001,"5min":0.77700000000000002,"15min":0.495},"max":{"1min":1.6459999999999999,"5min":1.7170000000000001,"15min":63.737000000000002},"last":1.4970000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575052,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307920,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063920,"statfs":{"total":96636764160,"available":96321454080,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.04,"15min":1.024},"min":{"1min":0.78000000000000003,"5min":0.58599999999999997,"15min":0.53300000000000003},"max":{"1min":1.5369999999999999,"5min":1.556,"15min":2.0609999999999999},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.052,"15min":1.032},"min":{"1min":0.67300000000000004,"5min":0.58699999999999997,"15min":0.52500000000000002},"max":{"1min":1.599,"5min":1.599,"15min":2.7040000000000002},"last":1.1950000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.2350000000000001,"15min":1.1859999999999999},"min":{"1min":0.95999999999999996,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.5449999999999999,"5min":1.744,"15min":2.0310000000000001},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.254,"15min":1.1879999999999999},"min":{"1min":0.97299999999999998,"5min":0.752,"15min":0.50900000000000001},"max":{"1min":1.5009999999999999,"5min":1.7989999999999999,"15min":2.0209999999999999},"last":1.0549999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1599999999999999,"15min":1.1359999999999999},"min":{"1min":0.84199999999999997,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.4730000000000001,"5min":1.6279999999999999,"15min":1.925},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.149,"15min":1.1160000000000001},"min":{"1min":0.84299999999999997,"5min":0.74299999999999999,"15min":0.59899999999999998},"max":{"1min":1.3720000000000001,"5min":1.657,"15min":1.982},"last":1.397}]},{"osd":3,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.198,"15min":1.1599999999999999},"min":{"1min":0.85899999999999999,"5min":0.71199999999999997,"15min":0.66900000000000004},"max":{"1min":1.4419999999999999,"5min":1.6599999999999999,"15min":3.202},"last":1.022},{"interface":"front","average":{"1min":1.22,"5min":1.2250000000000001,"15min":1.1950000000000001},"min":{"1min":0.84499999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5629999999999999,"5min":1.6830000000000001,"15min":4.8819999999999997},"last":0.85199999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1180000000000001,"15min":1.087},"min":{"1min":0.872,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.5049999999999999,"5min":1.8240000000000001,"15min":2.1309999999999998},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.208,"15min":1.1639999999999999},"min":{"1min":0.77100000000000002,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.7,"5min":1.8779999999999999,"15min":2.081},"last":1.2509999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2569999999999999,"15min":1.2010000000000001},"min":{"1min":0.96799999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4359999999999999,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.208},{"interface":"front","average":{"1min":1.304,"5min":1.2529999999999999,"15min":1.2350000000000001},"min":{"1min":1.0329999999999999,"5min":0.71399999999999997,"15min":0.55900000000000005},"max":{"1min":1.506,"5min":1.927,"15min":2.0779999999999998},"last":1.486}]},{"osd":7,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3260000000000001,"15min":1.288},"min":{"1min":0.80700000000000005,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.7310000000000001,"5min":1.8089999999999999,"15min":2.6789999999999998},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.371,"15min":1.3160000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.60799999999999998},"max":{"1min":1.5780000000000001,"5min":1.8859999999999999,"15min":2.0499999999999998},"last":1.131}]}]},{"osd":4,"up_from":13,"seq":55834575052,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303824,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068016,"statfs":{"total":96636764160,"available":96325648384,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1990000000000001,"15min":1.1140000000000001},"min":{"1min":0.88300000000000001,"5min":0.70999999999999996,"15min":0.51500000000000001},"max":{"1min":1.5309999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.48},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.23,"15min":1.1719999999999999},"min":{"1min":0.93600000000000005,"5min":0.75700000000000001,"15min":0.48899999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.7470000000000001},"last":1.339}]},{"osd":1,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1339999999999999,"15min":1.085},"min":{"1min":0.88200000000000001,"5min":0.59899999999999998,"15min":0.53100000000000003},"max":{"1min":1.591,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.095},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.147,"15min":1.0640000000000001},"min":{"1min":0.89900000000000002,"5min":0.69199999999999995,"15min":0.46000000000000002},"max":{"1min":1.635,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":1.1699999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1060000000000001,"15min":1.0800000000000001},"min":{"1min":0.82199999999999995,"5min":0.66400000000000003,"15min":0.49199999999999999},"max":{"1min":1.456,"5min":1.5800000000000001,"15min":5.3390000000000004},"last":1.081},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.1879999999999999,"15min":1.1459999999999999},"min":{"1min":0.98199999999999998,"5min":0.71099999999999997,"15min":0.59199999999999997},"max":{"1min":1.506,"5min":1.621,"15min":1.641},"last":1.282}]},{"osd":3,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1870000000000001,"15min":1.139},"min":{"1min":0.98499999999999999,"5min":0.69799999999999995,"15min":0.496},"max":{"1min":1.5369999999999999,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.139},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.204,"15min":1.161},"min":{"1min":1.0669999999999999,"5min":0.73899999999999999,"15min":0.53100000000000003},"max":{"1min":1.5069999999999999,"5min":1.647,"15min":5.3029999999999999},"last":1.3109999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.1080000000000001,"15min":1.0980000000000001},"min":{"1min":0.77400000000000002,"5min":0.63500000000000001,"15min":0.54100000000000004},"max":{"1min":1.506,"5min":1.581,"15min":1.6970000000000001},"last":1.044},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1990000000000001,"15min":1.1379999999999999},"min":{"1min":0.877,"5min":0.70099999999999996,"15min":0.52200000000000002},"max":{"1min":1.744,"5min":1.744,"15min":1.8240000000000001},"last":1.01}]},{"osd":6,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1499999999999999,"15min":1.137},"min":{"1min":0.84599999999999997,"5min":0.67400000000000004,"15min":0.44500000000000001},"max":{"1min":1.5960000000000001,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.341,"5min":1.3,"15min":1.25},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.51900000000000002},"max":{"1min":1.6930000000000001,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":1.389}]},{"osd":7,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.365,"15min":1.3140000000000001},"min":{"1min":1.109,"5min":0.74099999999999999,"15min":0.59399999999999997},"max":{"1min":1.7709999999999999,"5min":1.7949999999999999,"15min":1.9119999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3360000000000001,"15min":1.3129999999999999},"min":{"1min":0.84199999999999997,"5min":0.74199999999999999,"15min":0.56899999999999995},"max":{"1min":1.873,"5min":1.873,"15min":5.2629999999999999},"last":1.153}]}]},{"osd":3,"up_from":13,"seq":55834575052,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303824,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068016,"statfs":{"total":96636764160,"available":96325648384,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82399999999999995,"15min":0.85599999999999998},"min":{"1min":0.59399999999999997,"5min":0.47899999999999998,"15min":0.34200000000000003},"max":{"1min":1.4590000000000001,"5min":1.512,"15min":14.859},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.89600000000000002,"15min":0.90800000000000003},"min":{"1min":0.64400000000000002,"5min":0.42699999999999999,"15min":0.317},"max":{"1min":1.1140000000000001,"5min":1.724,"15min":5.0919999999999996},"last":0.55900000000000005}]},{"osd":1,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91600000000000004,"15min":0.90700000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.39300000000000002},"max":{"1min":1.4450000000000001,"5min":1.5860000000000001,"15min":6.5570000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.97199999999999998,"15min":0.97099999999999997},"min":{"1min":0.63800000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4339999999999999,"5min":1.482,"15min":5.7519999999999998},"last":0.96199999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1160000000000001,"15min":1.1040000000000001},"min":{"1min":0.91900000000000004,"5min":0.48699999999999999,"15min":0.40600000000000003},"max":{"1min":1.4510000000000001,"5min":1.7350000000000001,"15min":2.391},"last":1.089},{"interface":"front","average":{"1min":1.254,"5min":1.1899999999999999,"15min":1.1839999999999999},"min":{"1min":0.92100000000000004,"5min":0.60699999999999998,"15min":0.44800000000000001},"max":{"1min":1.641,"5min":1.768,"15min":4.1429999999999998},"last":1.284}]},{"osd":4,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.339,"15min":1.343},"min":{"1min":0.88700000000000001,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.6240000000000001,"5min":2.157,"15min":10.858000000000001},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.325,"15min":1.343},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.63600000000000001},"max":{"1min":1.6359999999999999,"5min":1.7769999999999999,"15min":10.846},"last":1.4019999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.262,"15min":1.2809999999999999},"min":{"1min":0.83399999999999996,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.6459999999999999,"5min":1.6739999999999999,"15min":7.3639999999999999},"last":0.997},{"interface":"front","average":{"1min":1.268,"5min":1.28,"15min":1.3819999999999999},"min":{"1min":0.91700000000000004,"5min":0.85599999999999998,"15min":0.71199999999999997},"max":{"1min":1.603,"5min":1.796,"15min":14.523999999999999},"last":1.105}]},{"osd":6,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3640000000000001,"15min":1.349},"min":{"1min":1.018,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.591,"5min":2.2570000000000001,"15min":4.9809999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4019999999999999,"15min":1.3919999999999999},"min":{"1min":0.93600000000000005,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.754,"5min":1.8700000000000001,"15min":5.4210000000000003},"last":1.4830000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3360000000000001,"15min":1.3580000000000001},"min":{"1min":1.01,"5min":0.90800000000000003,"15min":0.72799999999999998},"max":{"1min":1.681,"5min":2.004,"15min":5.7160000000000002},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.399,"15min":1.4079999999999999},"min":{"1min":0.95799999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6930000000000001,"5min":2.4449999999999998,"15min":6.4279999999999999},"last":1.175}]}]},{"osd":2,"up_from":13,"seq":55834575052,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299728,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072112,"statfs":{"total":96636764160,"available":96329842688,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.82299999999999995,"15min":0.78000000000000003},"min":{"1min":0.64600000000000002,"5min":0.432,"15min":0.378},"max":{"1min":1.135,"5min":1.373,"15min":1.7270000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.89200000000000002,"15min":0.86799999999999999},"min":{"1min":0.68400000000000005,"5min":0.45300000000000001,"15min":0.373},"max":{"1min":1.417,"5min":1.417,"15min":1.7350000000000001},"last":0.86599999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94699999999999995,"15min":0.89000000000000001},"min":{"1min":0.69399999999999995,"5min":0.55400000000000005,"15min":0.41299999999999998},"max":{"1min":1.3879999999999999,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.032,"15min":0.96799999999999997},"min":{"1min":0.79100000000000004,"5min":0.47899999999999998,"15min":0.41599999999999998},"max":{"1min":1.5780000000000001,"5min":1.671,"15min":2.8849999999999998},"last":1.0549999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.1779999999999999,"15min":1.1499999999999999},"min":{"1min":0.68300000000000005,"5min":0.66700000000000004,"15min":0.47099999999999997},"max":{"1min":1.633,"5min":2.3090000000000002,"15min":3.0990000000000002},"last":1.363},{"interface":"front","average":{"1min":1.292,"5min":1.2470000000000001,"15min":1.22},"min":{"1min":0.86899999999999999,"5min":0.76000000000000001,"15min":0.51100000000000001},"max":{"1min":1.6180000000000001,"5min":1.8340000000000001,"15min":3.133},"last":1.4390000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.3560000000000001,"15min":1.282},"min":{"1min":1.1930000000000001,"5min":0.90400000000000003,"15min":0.59099999999999997},"max":{"1min":1.746,"5min":2.101,"15min":3.0129999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.244,"15min":1.206},"min":{"1min":1.052,"5min":0.71699999999999997,"15min":0.52100000000000002},"max":{"1min":1.6299999999999999,"5min":1.9970000000000001,"15min":2.2829999999999999},"last":1.617}]},{"osd":5,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.276,"15min":1.236},"min":{"1min":0.91900000000000004,"5min":0.84099999999999997,"15min":0.63800000000000001},"max":{"1min":1.5329999999999999,"5min":2.379,"15min":2.379},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.3480000000000001,"15min":1.292},"min":{"1min":1.216,"5min":0.84799999999999998,"15min":0.67000000000000004},"max":{"1min":1.5620000000000001,"5min":2.1880000000000002,"15min":3.0910000000000002},"last":1.3420000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2689999999999999,"15min":1.252},"min":{"1min":0.96399999999999997,"5min":0.79500000000000004,"15min":0.61799999999999999},"max":{"1min":1.5469999999999999,"5min":1.9119999999999999,"15min":2.1389999999999998},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3839999999999999,"15min":1.321},"min":{"1min":0.95999999999999996,"5min":0.91100000000000003,"15min":0.629},"max":{"1min":1.6859999999999999,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.5660000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3759999999999999,"15min":1.3460000000000001},"min":{"1min":1.0860000000000001,"5min":0.88500000000000001,"15min":0.75900000000000001},"max":{"1min":1.7549999999999999,"5min":1.8200000000000001,"15min":2.1749999999999998},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.47,"15min":1.425},"min":{"1min":1.109,"5min":0.89700000000000002,"15min":0.79000000000000004},"max":{"1min":1.7170000000000001,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.478}]}]},{"osd":1,"up_from":13,"seq":55834575053,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312016,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059824,"statfs":{"total":96636764160,"available":96317259776,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.85499999999999998,"15min":0.873},"min":{"1min":0.67300000000000004,"5min":0.36699999999999999,"15min":0.36199999999999999},"max":{"1min":1.3149999999999999,"5min":1.4830000000000001,"15min":3.4119999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.024,"15min":1.0029999999999999},"min":{"1min":0.73999999999999999,"5min":0.504,"15min":0.41099999999999998},"max":{"1min":1.3700000000000001,"5min":1.6160000000000001,"15min":2.101},"last":1.486}]},{"osd":2,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.97799999999999998,"15min":0.98899999999999999},"min":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.45500000000000002},"max":{"1min":1.393,"5min":1.556,"15min":2.169},"last":1.145},{"interface":"front","average":{"1min":1.206,"5min":1.0860000000000001,"15min":1.0660000000000001},"min":{"1min":0.89300000000000002,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.611,"5min":1.611,"15min":2.024},"last":1.347}]},{"osd":3,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0609999999999999,"15min":1.05},"min":{"1min":0.83299999999999996,"5min":0.57399999999999995,"15min":0.38900000000000001},"max":{"1min":1.4790000000000001,"5min":1.972,"15min":4.665},"last":1.5629999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.90700000000000003,"15min":0.94899999999999995},"min":{"1min":0.71199999999999997,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.5129999999999999,"5min":1.659,"15min":5.5830000000000002},"last":0.97699999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.236,"15min":1.2589999999999999},"min":{"1min":1.0649999999999999,"5min":0.83699999999999997,"15min":0.57899999999999996},"max":{"1min":1.6779999999999999,"5min":1.7769999999999999,"15min":15.76},"last":1.258},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3129999999999999,"15min":1.345},"min":{"1min":1.1240000000000001,"5min":0.90400000000000003,"15min":0.63500000000000001},"max":{"1min":1.5629999999999999,"5min":1.673,"15min":16.975000000000001},"last":1.613}]},{"osd":5,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.252,"15min":1.238},"min":{"1min":0.81200000000000006,"5min":0.72599999999999998,"15min":0.55700000000000005},"max":{"1min":1.4370000000000001,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2889999999999999,"15min":1.286},"min":{"1min":1.0609999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5900000000000001,"5min":1.879,"15min":2.52},"last":1.526}]},{"osd":6,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2989999999999999,"15min":1.266},"min":{"1min":1.0529999999999999,"5min":0.77400000000000002,"15min":0.55600000000000005},"max":{"1min":1.5249999999999999,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.3140000000000001,"15min":1.331},"min":{"1min":1.133,"5min":0.76200000000000001,"15min":0.68799999999999994},"max":{"1min":1.6439999999999999,"5min":2.008,"15min":2.5569999999999999},"last":1.4039999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.3680000000000001,"15min":1.3560000000000001},"min":{"1min":1.181,"5min":0.77200000000000002,"15min":0.68100000000000005},"max":{"1min":1.7170000000000001,"5min":1.835,"15min":4.4329999999999998},"last":1.659},{"interface":"front","average":{"1min":1.361,"5min":1.363,"15min":1.351},"min":{"1min":1.044,"5min":0.81100000000000005,"15min":0.64900000000000002},"max":{"1min":1.619,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":1.4490000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575052,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312016,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059824,"statfs":{"total":96636764160,"available":96317259776,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80900000000000005,"15min":0.872},"min":{"1min":0.69299999999999995,"5min":0.39600000000000002,"15min":0.28699999999999998},"max":{"1min":1.206,"5min":1.361,"15min":15.273},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.92300000000000004,"15min":0.90800000000000003},"min":{"1min":0.76600000000000001,"5min":0.48899999999999999,"15min":0.34499999999999997},"max":{"1min":1.2150000000000001,"5min":1.625,"15min":4.4009999999999998},"last":0.73999999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98799999999999999,"15min":1.0329999999999999},"min":{"1min":0.85999999999999999,"5min":0.60299999999999998,"15min":0.46400000000000002},"max":{"1min":1.4219999999999999,"5min":1.6299999999999999,"15min":15.473000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.179,"5min":1.1299999999999999,"15min":1.0509999999999999},"min":{"1min":0.95199999999999996,"5min":0.67400000000000004,"15min":0.42699999999999999},"max":{"1min":1.482,"5min":1.7070000000000001,"15min":1.7989999999999999},"last":1.0429999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0229999999999999,"15min":0.98299999999999998},"min":{"1min":0.85399999999999998,"5min":0.50600000000000001,"15min":0.39000000000000001},"max":{"1min":1.643,"5min":1.8959999999999999,"15min":5.3970000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.1639999999999999,"15min":1.1779999999999999},"min":{"1min":1.0429999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.5740000000000001,"5min":2.863,"15min":15.439},"last":0.98799999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.286,"15min":1.236},"min":{"1min":1.1879999999999999,"5min":0.81999999999999995,"15min":0.61399999999999999},"max":{"1min":1.669,"5min":1.7949999999999999,"15min":2.1280000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.2609999999999999,"15min":1.22},"min":{"1min":0.88600000000000001,"5min":0.70199999999999996,"15min":0.56200000000000006},"max":{"1min":1.6990000000000001,"5min":1.706,"15min":3.4340000000000002},"last":0.93899999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.302,"15min":1.26},"min":{"1min":1.0369999999999999,"5min":0.79000000000000004,"15min":0.67600000000000005},"max":{"1min":1.524,"5min":1.802,"15min":2.891},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.321,"15min":1.3100000000000001},"min":{"1min":1.179,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.881,"5min":1.881,"15min":2.823},"last":1.2909999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.373,"15min":1.4039999999999999},"min":{"1min":1.2390000000000001,"5min":0.879,"15min":0.59099999999999997},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":15.4},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.468,"5min":1.3819999999999999,"15min":1.357},"min":{"1min":1.244,"5min":0.80500000000000005,"15min":0.72499999999999998},"max":{"1min":1.774,"5min":1.8919999999999999,"15min":7.1349999999999998},"last":1.276}]},{"osd":7,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.4450000000000001,"15min":1.3959999999999999},"min":{"1min":1.1819999999999999,"5min":0.86899999999999999,"15min":0.79900000000000004},"max":{"1min":1.8109999999999999,"5min":2.145,"15min":2.1819999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.419,"15min":1.3660000000000001},"min":{"1min":1.2829999999999999,"5min":0.76600000000000001,"15min":0.752},"max":{"1min":1.9379999999999999,"5min":2.0470000000000002,"15min":2.7269999999999999},"last":1.0049999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:21:19.145 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-01-22T05:04:28.364976+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=4, tm_sec=28, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=21, tm_sec=12, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:21:19.145 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-01-22T05:04:28.364976+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=4, tm_sec=28, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=21, tm_sec=12, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:21:19.145 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-01-22T05:04:28.364976+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=4, tm_sec=28, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=21, tm_sec=12, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:21:19.145 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-01-22T05:04:28.364976+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=4, tm_sec=28, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=21, tm_sec=12, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:21:19.145 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-01-22T05:04:28.364976+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=4, tm_sec=28, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=21, tm_sec=12, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:21:19.145 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-01-22T05:04:28.364976+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=4, tm_sec=28, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=21, tm_sec=12, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:21:19.146 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-01-22T05:04:28.364976+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=4, tm_sec=28, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=21, tm_sec=12, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:21:19.146 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-01-22T05:04:27.355522+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=4, tm_sec=27, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=21, tm_sec=12, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:21:19.146 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-22T05:21:39.147 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:21:39.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.316+0000 7f1c6fc00700 1 Processor -- start 2024-01-22T05:21:39.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.316+0000 7f1c6fc00700 1 -- start start 2024-01-22T05:21:39.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.320+0000 7f1c6fc00700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1c68155d20 0x7f1c68065b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:39.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.320+0000 7f1c6fc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c68066070 0x7f1c680a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:39.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.320+0000 7f1c6fc00700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c680c1a40 con 0x7f1c680a8c30 2024-01-22T05:21:39.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.320+0000 7f1c6fc00700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c680a9090 con 0x7f1c68155d20 2024-01-22T05:21:39.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.320+0000 7f1c6fc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68159310 con 0x7f1c68066070 2024-01-22T05:21:39.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.320+0000 7f1c6d200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1c68155d20 0x7f1c68065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:39.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.320+0000 7f1c6d200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1c68155d20 0x7f1c68065b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43936/0 (socket says 172.21.15.49:43936) 2024-01-22T05:21:39.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.320+0000 7f1c6d200700 1 -- 172.21.15.49:0/1376210066 learned_addr learned my addr 172.21.15.49:0/1376210066 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:39.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.320+0000 7f1c67e00700 1 --2- 172.21.15.49:0/1376210066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c68066070 0x7f1c680a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:39.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.320+0000 7f1c6d200700 1 -- 172.21.15.49:0/1376210066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c68066070 msgr2=0x7f1c680a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:39.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.320+0000 7f1c6d200700 1 --2- 172.21.15.49:0/1376210066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c68066070 0x7f1c680a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.320+0000 7f1c6d200700 1 -- 172.21.15.49:0/1376210066 >> v1:172.21.15.110:6789/0 conn(0x7f1c680a8c30 legacy=0x7f1c680c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:39.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.320+0000 7f1c6d200700 1 -- 172.21.15.49:0/1376210066 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c680c13f0 con 0x7f1c68155d20 2024-01-22T05:21:39.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.320+0000 7f1c6d200700 1 --2- 172.21.15.49:0/1376210066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c68155d20 0x7f1c68065b80 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 rx=0x7f1c58006fd0 tx=0x7f1c580090f0).ready entity=mon.0 client_cookie=e827eca109a489cf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:39.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.320+0000 7f1c67400700 1 -- 172.21.15.49:0/1376210066 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5800b580 con 0x7f1c68155d20 2024-01-22T05:21:39.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.324+0000 7f1c67400700 1 -- 172.21.15.49:0/1376210066 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5800b6e0 con 0x7f1c68155d20 2024-01-22T05:21:39.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.324+0000 7f1c67400700 1 -- 172.21.15.49:0/1376210066 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5800ba60 con 0x7f1c68155d20 2024-01-22T05:21:39.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.324+0000 7f1c6fc00700 1 -- 172.21.15.49:0/1376210066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c68155d20 msgr2=0x7f1c68065b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:39.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.324+0000 7f1c6fc00700 1 --2- 172.21.15.49:0/1376210066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c68155d20 0x7f1c68065b80 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 rx=0x7f1c58006fd0 tx=0x7f1c580090f0).stop 2024-01-22T05:21:39.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.324+0000 7f1c6fc00700 1 -- 172.21.15.49:0/1376210066 shutdown_connections 2024-01-22T05:21:39.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.324+0000 7f1c6fc00700 1 --2- 172.21.15.49:0/1376210066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c68066070 0x7f1c680a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.324+0000 7f1c6fc00700 1 --2- 172.21.15.49:0/1376210066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c68155d20 0x7f1c68065b80 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.324+0000 7f1c6fc00700 1 -- 172.21.15.49:0/1376210066 >> 172.21.15.49:0/1376210066 conn(0x7f1c680c6540 msgr2=0x7f1c680c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:39.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.324+0000 7f1c6fc00700 1 -- 172.21.15.49:0/1376210066 shutdown_connections 2024-01-22T05:21:39.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.324+0000 7f1c6fc00700 1 -- 172.21.15.49:0/1376210066 wait complete. 2024-01-22T05:21:39.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.328+0000 7f1c6fc00700 1 Processor -- start 2024-01-22T05:21:39.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.328+0000 7f1c6fc00700 1 -- start start 2024-01-22T05:21:39.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.328+0000 7f1c6fc00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c68066070 0x7f1c68152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:39.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.328+0000 7f1c6fc00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c680a8c30 0x7f1c680bd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:39.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.328+0000 7f1c6fc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c68155d20 0x7f1c680bdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:39.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.328+0000 7f1c6fc00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680be3a0 con 0x7f1c680a8c30 2024-01-22T05:21:39.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.328+0000 7f1c6fc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680aa8d0 con 0x7f1c68155d20 2024-01-22T05:21:39.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.328+0000 7f1c6fc00700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680bee40 con 0x7f1c68066070 2024-01-22T05:21:39.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.328+0000 7f1c67e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c680a8c30 0x7f1c680bd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:39.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.328+0000 7f1c67e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c680a8c30 0x7f1c680bd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43942/0 (socket says 172.21.15.49:43942) 2024-01-22T05:21:39.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.328+0000 7f1c67e00700 1 -- 172.21.15.49:0/221652363 learned_addr learned my addr 172.21.15.49:0/221652363 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:39.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.328+0000 7f1c6d200700 1 --2- 172.21.15.49:0/221652363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c68066070 0x7f1c68152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:39.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.328+0000 7f1c6dc00700 1 --2- 172.21.15.49:0/221652363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c68155d20 0x7f1c680bdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:39.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.332+0000 7f1c67e00700 1 -- 172.21.15.49:0/221652363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c68066070 msgr2=0x7f1c68152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:39.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.332+0000 7f1c67e00700 1 --2- 172.21.15.49:0/221652363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c68066070 0x7f1c68152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.332+0000 7f1c67e00700 1 -- 172.21.15.49:0/221652363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c68155d20 msgr2=0x7f1c680bdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:39.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.332+0000 7f1c67e00700 1 --2- 172.21.15.49:0/221652363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c68155d20 0x7f1c680bdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.332+0000 7f1c67e00700 1 -- 172.21.15.49:0/221652363 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c58009370 con 0x7f1c680a8c30 2024-01-22T05:21:39.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.332+0000 7f1c6dc00700 1 --2- 172.21.15.49:0/221652363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c68155d20 0x7f1c680bdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:21:39.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.332+0000 7f1c67e00700 1 --2- 172.21.15.49:0/221652363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c680a8c30 0x7f1c680bd9c0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 rx=0x7f1c5000e930 tx=0x7f1c50009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:39.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.332+0000 7f1c5fe00700 1 -- 172.21.15.49:0/221652363 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5000c670 con 0x7f1c680a8c30 2024-01-22T05:21:39.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.332+0000 7f1c5fe00700 1 -- 172.21.15.49:0/221652363 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5000c7d0 con 0x7f1c680a8c30 2024-01-22T05:21:39.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.332+0000 7f1c6fc00700 1 -- 172.21.15.49:0/221652363 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c680be5a0 con 0x7f1c680a8c30 2024-01-22T05:21:39.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.332+0000 7f1c5fe00700 1 -- 172.21.15.49:0/221652363 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5000cb50 con 0x7f1c680a8c30 2024-01-22T05:21:39.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.332+0000 7f1c6fc00700 1 -- 172.21.15.49:0/221652363 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c680beb60 con 0x7f1c680a8c30 2024-01-22T05:21:39.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.332+0000 7f1c6fc00700 1 -- 172.21.15.49:0/221652363 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c680c62c0 con 0x7f1c680a8c30 2024-01-22T05:21:39.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.336+0000 7f1c5fe00700 1 -- 172.21.15.49:0/221652363 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1c5001b400 con 0x7f1c680a8c30 2024-01-22T05:21:39.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.336+0000 7f1c5fe00700 1 --2- 172.21.15.49:0/221652363 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1c4005a510 0x7f1c4005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.336+0000 7f1c5fe00700 1 -- 172.21.15.49:0/221652363 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f1c50074c20 con 0x7f1c680a8c30 2024-01-22T05:21:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.336+0000 7f1c6d200700 1 --2- 172.21.15.49:0/221652363 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1c4005a510 0x7f1c4005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.336+0000 7f1c6d200700 1 --2- 172.21.15.49:0/221652363 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1c4005a510 0x7f1c4005c9d0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f1c58009fd0 tx=0x7f1c58017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.344+0000 7f1c5fe00700 1 -- 172.21.15.49:0/221652363 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1c50048420 con 0x7f1c680a8c30 2024-01-22T05:21:39.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.508+0000 7f1c6fc00700 1 -- 172.21.15.49:0/221652363 --> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c68047090 con 0x7f1c4005a510 2024-01-22T05:21:39.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.516+0000 7f1c5fe00700 1 -- 172.21.15.49:0/221652363 <== mgr.4110 v2:172.21.15.49:6832/22885 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68638 (secure 0 0 0) 0x7f1c68047090 con 0x7f1c4005a510 2024-01-22T05:21:39.518 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:21:39.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.520+0000 7f1c6fc00700 1 -- 172.21.15.49:0/221652363 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1c4005a510 msgr2=0x7f1c4005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:39.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.520+0000 7f1c6fc00700 1 --2- 172.21.15.49:0/221652363 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1c4005a510 0x7f1c4005c9d0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f1c58009fd0 tx=0x7f1c58017000).stop 2024-01-22T05:21:39.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.520+0000 7f1c6fc00700 1 -- 172.21.15.49:0/221652363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c680a8c30 msgr2=0x7f1c680bd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:39.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.520+0000 7f1c6fc00700 1 --2- 172.21.15.49:0/221652363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c680a8c30 0x7f1c680bd9c0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 rx=0x7f1c5000e930 tx=0x7f1c50009060).stop 2024-01-22T05:21:39.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.520+0000 7f1c6fc00700 1 -- 172.21.15.49:0/221652363 shutdown_connections 2024-01-22T05:21:39.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.520+0000 7f1c6fc00700 1 --2- 172.21.15.49:0/221652363 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f1c4005a510 0x7f1c4005c9d0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.520+0000 7f1c6fc00700 1 --2- 172.21.15.49:0/221652363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c68155d20 0x7f1c680bdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.520+0000 7f1c6fc00700 1 --2- 172.21.15.49:0/221652363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c680a8c30 0x7f1c680bd9c0 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.520+0000 7f1c6fc00700 1 --2- 172.21.15.49:0/221652363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c68066070 0x7f1c68152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.520+0000 7f1c6fc00700 1 -- 172.21.15.49:0/221652363 >> 172.21.15.49:0/221652363 conn(0x7f1c680c6540 msgr2=0x7f1c68067c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:39.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.520+0000 7f1c6fc00700 1 -- 172.21.15.49:0/221652363 shutdown_connections 2024-01-22T05:21:39.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.520+0000 7f1c6fc00700 1 -- 172.21.15.49:0/221652363 wait complete. 2024-01-22T05:21:39.525 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-22T05:21:39.546 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":711,"stamp":"2024-01-22T05:21:37.613588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2459264,"kb_used_data":20032,"kb_used_omap":0,"kb_used_meta":2439168,"kb_avail":752515456,"statfs":{"total":773094113280,"available":770575826944,"internally_reserved":0,"allocated":20512768,"data_stored":10252864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2497708032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12620476,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-66,"num_read_kb":-71,"num_write":-91,"num_write_kb":-12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.095826"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":173,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-22T05:21:19.392020+0000","last_change":"2024-01-22T05:21:19.392020+0000","last_active":"2024-01-22T05:21:19.392020+0000","last_peered":"2024-01-22T05:21:19.392020+0000","last_clean":"2024-01-22T05:21:19.392020+0000","last_became_active":"2024-01-22T05:04:29.386238+0000","last_became_peered":"2024-01-22T05:04:29.386238+0000","last_unstale":"2024-01-22T05:21:19.392020+0000","last_undegraded":"2024-01-22T05:21:19.392020+0000","last_fullsized":"2024-01-22T05:21:19.392020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:21:19.391912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:21:19.391912+0000","last_clean_scrub_stamp":"2024-01-22T05:21:19.391912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":178,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-22T05:21:18.489354+0000","last_change":"2024-01-22T05:21:18.489354+0000","last_active":"2024-01-22T05:21:18.489354+0000","last_peered":"2024-01-22T05:21:18.489354+0000","last_clean":"2024-01-22T05:21:18.489354+0000","last_became_active":"2024-01-22T05:04:29.387661+0000","last_became_peered":"2024-01-22T05:04:29.387661+0000","last_unstale":"2024-01-22T05:21:18.489354+0000","last_undegraded":"2024-01-22T05:21:18.489354+0000","last_fullsized":"2024-01-22T05:21:18.489354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:21:18.489228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:21:18.489228+0000","last_clean_scrub_stamp":"2024-01-22T05:21:18.489228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":165,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-22T05:21:20.939023+0000","last_change":"2024-01-22T05:21:20.939023+0000","last_active":"2024-01-22T05:21:20.939023+0000","last_peered":"2024-01-22T05:21:20.939023+0000","last_clean":"2024-01-22T05:21:20.939023+0000","last_became_active":"2024-01-22T05:04:30.121673+0000","last_became_peered":"2024-01-22T05:04:30.121673+0000","last_unstale":"2024-01-22T05:21:20.939023+0000","last_undegraded":"2024-01-22T05:21:20.939023+0000","last_fullsized":"2024-01-22T05:21:20.939023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:21:20.938913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:21:20.938913+0000","last_clean_scrub_stamp":"2024-01-22T05:21:20.938913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-22T05:21:17.444597+0000","last_change":"2024-01-22T05:21:17.444597+0000","last_active":"2024-01-22T05:21:17.444597+0000","last_peered":"2024-01-22T05:21:17.444597+0000","last_clean":"2024-01-22T05:21:17.444597+0000","last_became_active":"2024-01-22T05:04:30.122573+0000","last_became_peered":"2024-01-22T05:04:30.122573+0000","last_unstale":"2024-01-22T05:21:17.444597+0000","last_undegraded":"2024-01-22T05:21:17.444597+0000","last_fullsized":"2024-01-22T05:21:17.444597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:21:17.444493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:21:17.444493+0000","last_clean_scrub_stamp":"2024-01-22T05:21:17.444493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":200,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-22T05:21:23.433839+0000","last_change":"2024-01-22T05:21:23.433839+0000","last_active":"2024-01-22T05:21:23.433839+0000","last_peered":"2024-01-22T05:21:23.433839+0000","last_clean":"2024-01-22T05:21:23.433839+0000","last_became_active":"2024-01-22T05:04:29.384694+0000","last_became_peered":"2024-01-22T05:04:29.384694+0000","last_unstale":"2024-01-22T05:21:23.433839+0000","last_undegraded":"2024-01-22T05:21:23.433839+0000","last_fullsized":"2024-01-22T05:21:23.433839+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:21:23.433621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:21:23.433621+0000","last_clean_scrub_stamp":"2024-01-22T05:21:23.433621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":175,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-22T05:21:16.403463+0000","last_change":"2024-01-22T05:21:16.403463+0000","last_active":"2024-01-22T05:21:16.403463+0000","last_peered":"2024-01-22T05:21:16.403463+0000","last_clean":"2024-01-22T05:21:16.403463+0000","last_became_active":"2024-01-22T05:04:30.305774+0000","last_became_peered":"2024-01-22T05:04:30.305774+0000","last_unstale":"2024-01-22T05:21:16.403463+0000","last_undegraded":"2024-01-22T05:21:16.403463+0000","last_fullsized":"2024-01-22T05:21:16.403463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:21:16.403340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:21:16.403340+0000","last_clean_scrub_stamp":"2024-01-22T05:21:16.403340+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":165,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-22T05:21:19.961581+0000","last_change":"2024-01-22T05:21:19.961581+0000","last_active":"2024-01-22T05:21:19.961581+0000","last_peered":"2024-01-22T05:21:19.961581+0000","last_clean":"2024-01-22T05:21:19.961581+0000","last_became_active":"2024-01-22T05:04:29.388092+0000","last_became_peered":"2024-01-22T05:04:29.388092+0000","last_unstale":"2024-01-22T05:21:19.961581+0000","last_undegraded":"2024-01-22T05:21:19.961581+0000","last_fullsized":"2024-01-22T05:21:19.961581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:21:19.961483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:21:19.961483+0000","last_clean_scrub_stamp":"2024-01-22T05:21:19.961483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":200,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-22T05:21:24.424789+0000","last_change":"2024-01-22T05:21:24.424789+0000","last_active":"2024-01-22T05:21:24.424789+0000","last_peered":"2024-01-22T05:21:24.424789+0000","last_clean":"2024-01-22T05:21:24.424789+0000","last_became_active":"2024-01-22T05:04:29.388490+0000","last_became_peered":"2024-01-22T05:04:29.388490+0000","last_unstale":"2024-01-22T05:21:24.424789+0000","last_undegraded":"2024-01-22T05:21:24.424789+0000","last_fullsized":"2024-01-22T05:21:24.424789+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:21:24.424685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:21:24.424685+0000","last_clean_scrub_stamp":"2024-01-22T05:21:24.424685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":166,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-22T05:21:18.982297+0000","last_change":"2024-01-22T05:21:18.982297+0000","last_active":"2024-01-22T05:21:18.982297+0000","last_peered":"2024-01-22T05:21:18.982297+0000","last_clean":"2024-01-22T05:21:18.982297+0000","last_became_active":"2024-01-22T05:04:28.388346+0000","last_became_peered":"2024-01-22T05:04:28.388346+0000","last_unstale":"2024-01-22T05:21:18.982297+0000","last_undegraded":"2024-01-22T05:21:18.982297+0000","last_fullsized":"2024-01-22T05:21:18.982297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:21:18.982069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:21:18.982069+0000","last_clean_scrub_stamp":"2024-01-22T05:21:18.982069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575056,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312016,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059824,"statfs":{"total":96636764160,"available":96317259776,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.194,"15min":1.1040000000000001},"min":{"1min":0.71199999999999997,"5min":0.50600000000000001,"15min":0.46500000000000002},"max":{"1min":1.512,"5min":7.3170000000000002,"15min":14.779999999999999},"last":1.304},{"interface":"front","average":{"1min":1.131,"5min":1.1519999999999999,"15min":1.3839999999999999},"min":{"1min":0.80700000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.411,"5min":3.7789999999999999,"15min":76.662000000000006},"last":1.4870000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.153,"15min":1.0800000000000001},"min":{"1min":0.77400000000000002,"5min":0.57599999999999996,"15min":0.54400000000000004},"max":{"1min":1.5089999999999999,"5min":1.657,"15min":4.9269999999999996},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.206,"15min":1.2010000000000001},"min":{"1min":0.78700000000000003,"5min":0.71599999999999997,"15min":0.58999999999999997},"max":{"1min":1.4770000000000001,"5min":3.6040000000000001,"15min":12.691000000000001},"last":1.3899999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1759999999999999,"15min":1.135},"min":{"1min":0.59499999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.482,"5min":2.1589999999999998,"15min":2.5150000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.244,"15min":1.232},"min":{"1min":0.93100000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4550000000000001,"5min":2.633,"15min":15.036},"last":1.504}]},{"osd":3,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2230000000000001,"15min":1.4470000000000001},"min":{"1min":0.83699999999999997,"5min":0.82399999999999995,"15min":0.69799999999999995},"max":{"1min":1.5409999999999999,"5min":1.752,"15min":64.983999999999995},"last":1.363},{"interface":"front","average":{"1min":1.302,"5min":1.304,"15min":1.3029999999999999},"min":{"1min":1.0349999999999999,"5min":0.63100000000000001,"15min":0.60199999999999998},"max":{"1min":1.581,"5min":2.2770000000000001,"15min":15.073},"last":1.4330000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1859999999999999,"15min":1.1970000000000001},"min":{"1min":0.81399999999999995,"5min":0.53000000000000003,"15min":0.32900000000000001},"max":{"1min":1.4790000000000001,"5min":3.1840000000000002,"15min":22.239000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.149,"5min":1.228,"15min":1.27},"min":{"1min":0.77100000000000002,"5min":0.66200000000000003,"15min":0.52200000000000002},"max":{"1min":1.488,"5min":1.9830000000000001,"15min":27.872},"last":1.518}]},{"osd":5,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2629999999999999,"15min":1.456},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.40400000000000003},"max":{"1min":1.5840000000000001,"5min":2.3530000000000002,"15min":65.652000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.329,"15min":1.2989999999999999},"min":{"1min":0.90800000000000003,"5min":0.76600000000000001,"15min":0.61499999999999999},"max":{"1min":1.4950000000000001,"5min":2.1539999999999999,"15min":3.625},"last":1.228}]},{"osd":6,"last update":"Mon Jan 22 05:21:06 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.325,"15min":1.264},"min":{"1min":0.91200000000000003,"5min":0.85299999999999998,"15min":0.53400000000000003},"max":{"1min":1.5669999999999999,"5min":3.3439999999999999,"15min":6.9939999999999998},"last":1.268},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.425,"15min":1.421},"min":{"1min":1.01,"5min":0.73299999999999998,"15min":0.56100000000000005},"max":{"1min":1.6100000000000001,"5min":2.246,"15min":12.965},"last":1.4550000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575056,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307920,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063920,"statfs":{"total":96636764160,"available":96321454080,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.091,"15min":1.2849999999999999},"min":{"1min":0.81999999999999995,"5min":0.66600000000000004,"15min":0.35999999999999999},"max":{"1min":1.4039999999999999,"5min":1.927,"15min":77.745000000000005},"last":1.24},{"interface":"front","average":{"1min":1.165,"5min":1.0720000000000001,"15min":1.0860000000000001},"min":{"1min":0.89300000000000002,"5min":0.64500000000000002,"15min":0.44},"max":{"1min":1.5,"5min":1.74,"15min":13.555999999999999},"last":0.88900000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0940000000000001,"15min":1.127},"min":{"1min":0.72499999999999998,"5min":0.629,"15min":0.40000000000000002},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":15.499000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.155,"15min":1.1379999999999999},"min":{"1min":0.79900000000000004,"5min":0.76200000000000001,"15min":0.54800000000000004},"max":{"1min":1.3879999999999999,"5min":1.6379999999999999,"15min":7.7629999999999999},"last":1.304}]},{"osd":2,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1990000000000001,"15min":1.1699999999999999},"min":{"1min":0.95299999999999996,"5min":0.84999999999999998,"15min":0.57399999999999995},"max":{"1min":1.373,"5min":1.5680000000000001,"15min":3.0960000000000001},"last":1.389},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.175,"15min":1.1559999999999999},"min":{"1min":0.98399999999999999,"5min":0.747,"15min":0.38200000000000001},"max":{"1min":1.657,"5min":1.657,"15min":4.9660000000000002},"last":1.1060000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2010000000000001,"15min":1.5009999999999999},"min":{"1min":0.997,"5min":0.72699999999999998,"15min":0.63500000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":102.08199999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.181,"15min":1.2150000000000001},"min":{"1min":0.88300000000000001,"5min":0.81799999999999995,"15min":0.374},"max":{"1min":1.4750000000000001,"5min":1.5409999999999999,"15min":15.468},"last":1.1919999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.155,"15min":1.159},"min":{"1min":0.69999999999999996,"5min":0.69399999999999995,"15min":0.495},"max":{"1min":1.48,"5min":1.6040000000000001,"15min":3.1749999999999998},"last":1.002},{"interface":"front","average":{"1min":1.254,"5min":1.1970000000000001,"15min":1.1779999999999999},"min":{"1min":0.90700000000000003,"5min":0.67200000000000004,"15min":0.48299999999999998},"max":{"1min":1.53,"5min":1.865,"15min":5.1200000000000001},"last":1.2150000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1559999999999999,"15min":1.2390000000000001},"min":{"1min":0.75900000000000001,"5min":0.68400000000000005,"15min":0.48099999999999998},"max":{"1min":1.4610000000000001,"5min":1.617,"15min":30.533000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.268,"15min":1.276},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.46600000000000003},"max":{"1min":1.601,"5min":1.8169999999999999,"15min":3.875},"last":1.155}]},{"osd":7,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3500000000000001,"15min":1.427},"min":{"1min":0.81399999999999995,"5min":0.63500000000000001,"15min":0.42699999999999999},"max":{"1min":1.802,"5min":2.0009999999999999,"15min":23.547999999999998},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3089999999999999,"15min":1.5389999999999999},"min":{"1min":1.0900000000000001,"5min":0.77700000000000002,"15min":0.495},"max":{"1min":1.6459999999999999,"5min":1.7170000000000001,"15min":63.737000000000002},"last":1.379}]}]},{"osd":5,"up_from":13,"seq":55834575056,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307920,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063920,"statfs":{"total":96636764160,"available":96321454080,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.04,"15min":1.024},"min":{"1min":0.78000000000000003,"5min":0.58599999999999997,"15min":0.53300000000000003},"max":{"1min":1.5369999999999999,"5min":1.556,"15min":2.0609999999999999},"last":1.149},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.052,"15min":1.032},"min":{"1min":0.67300000000000004,"5min":0.58699999999999997,"15min":0.52500000000000002},"max":{"1min":1.599,"5min":1.599,"15min":2.7040000000000002},"last":1.5389999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.2350000000000001,"15min":1.1859999999999999},"min":{"1min":0.95999999999999996,"5min":0.66200000000000003,"15min":0.50600000000000001},"max":{"1min":1.5449999999999999,"5min":1.744,"15min":2.0310000000000001},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.254,"15min":1.1879999999999999},"min":{"1min":0.97299999999999998,"5min":0.752,"15min":0.50900000000000001},"max":{"1min":1.5009999999999999,"5min":1.7989999999999999,"15min":2.0209999999999999},"last":1.4019999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1599999999999999,"15min":1.1359999999999999},"min":{"1min":0.84199999999999997,"5min":0.69499999999999995,"15min":0.63500000000000001},"max":{"1min":1.4730000000000001,"5min":1.6279999999999999,"15min":1.925},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.149,"15min":1.1160000000000001},"min":{"1min":0.84299999999999997,"5min":0.74299999999999999,"15min":0.59899999999999998},"max":{"1min":1.3720000000000001,"5min":1.657,"15min":1.982},"last":1.2490000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.198,"15min":1.1599999999999999},"min":{"1min":0.85899999999999999,"5min":0.71199999999999997,"15min":0.66900000000000004},"max":{"1min":1.4419999999999999,"5min":1.6599999999999999,"15min":3.202},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.2250000000000001,"15min":1.1950000000000001},"min":{"1min":0.84499999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5629999999999999,"5min":1.6830000000000001,"15min":4.8819999999999997},"last":1.2190000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1180000000000001,"15min":1.087},"min":{"1min":0.872,"5min":0.54100000000000004,"15min":0.44400000000000001},"max":{"1min":1.5049999999999999,"5min":1.8240000000000001,"15min":2.1309999999999998},"last":0.996},{"interface":"front","average":{"1min":1.26,"5min":1.208,"15min":1.1639999999999999},"min":{"1min":0.77100000000000002,"5min":0.50900000000000001,"15min":0.36899999999999999},"max":{"1min":1.7,"5min":1.8779999999999999,"15min":2.081},"last":1.2829999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2569999999999999,"15min":1.2010000000000001},"min":{"1min":0.96799999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4359999999999999,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.2529999999999999,"15min":1.2350000000000001},"min":{"1min":1.0329999999999999,"5min":0.71399999999999997,"15min":0.55900000000000005},"max":{"1min":1.506,"5min":1.927,"15min":2.0779999999999998},"last":1.353}]},{"osd":7,"last update":"Mon Jan 22 05:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3260000000000001,"15min":1.288},"min":{"1min":0.80700000000000005,"5min":0.74199999999999999,"15min":0.41899999999999998},"max":{"1min":1.7310000000000001,"5min":1.8089999999999999,"15min":2.6789999999999998},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.371,"15min":1.3160000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.60799999999999998},"max":{"1min":1.5780000000000001,"5min":1.8859999999999999,"15min":2.0499999999999998},"last":1.47}]}]},{"osd":4,"up_from":13,"seq":55834575056,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303824,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068016,"statfs":{"total":96636764160,"available":96325648384,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1990000000000001,"15min":1.1140000000000001},"min":{"1min":0.88300000000000001,"5min":0.70999999999999996,"15min":0.51500000000000001},"max":{"1min":1.5309999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.218},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.23,"15min":1.1719999999999999},"min":{"1min":0.93600000000000005,"5min":0.75700000000000001,"15min":0.48899999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.7470000000000001},"last":1.167}]},{"osd":1,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1339999999999999,"15min":1.085},"min":{"1min":0.88200000000000001,"5min":0.59899999999999998,"15min":0.53100000000000003},"max":{"1min":1.591,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.147,"15min":1.0640000000000001},"min":{"1min":0.89900000000000002,"5min":0.69199999999999995,"15min":0.46000000000000002},"max":{"1min":1.635,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.90400000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1060000000000001,"15min":1.0800000000000001},"min":{"1min":0.82199999999999995,"5min":0.66400000000000003,"15min":0.49199999999999999},"max":{"1min":1.456,"5min":1.5800000000000001,"15min":5.3390000000000004},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.1879999999999999,"15min":1.1459999999999999},"min":{"1min":0.98199999999999998,"5min":0.71099999999999997,"15min":0.59199999999999997},"max":{"1min":1.506,"5min":1.621,"15min":1.641},"last":1.0800000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1870000000000001,"15min":1.139},"min":{"1min":0.98499999999999999,"5min":0.69799999999999995,"15min":0.496},"max":{"1min":1.5369999999999999,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.204,"15min":1.161},"min":{"1min":1.0669999999999999,"5min":0.73899999999999999,"15min":0.53100000000000003},"max":{"1min":1.5069999999999999,"5min":1.647,"15min":5.3029999999999999},"last":1.27}]},{"osd":5,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.1080000000000001,"15min":1.0980000000000001},"min":{"1min":0.77400000000000002,"5min":0.63500000000000001,"15min":0.54100000000000004},"max":{"1min":1.506,"5min":1.581,"15min":1.6970000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1990000000000001,"15min":1.1379999999999999},"min":{"1min":0.877,"5min":0.70099999999999996,"15min":0.52200000000000002},"max":{"1min":1.744,"5min":1.744,"15min":1.8240000000000001},"last":0.91700000000000004}]},{"osd":6,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1499999999999999,"15min":1.137},"min":{"1min":0.84599999999999997,"5min":0.67400000000000004,"15min":0.44500000000000001},"max":{"1min":1.5960000000000001,"5min":1.6599999999999999,"15min":5.3769999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.341,"5min":1.3,"15min":1.25},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.51900000000000002},"max":{"1min":1.6930000000000001,"5min":2.0259999999999998,"15min":4.4409999999999998},"last":1.151}]},{"osd":7,"last update":"Mon Jan 22 05:20:54 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.365,"15min":1.3140000000000001},"min":{"1min":1.109,"5min":0.74099999999999999,"15min":0.59399999999999997},"max":{"1min":1.7709999999999999,"5min":1.7949999999999999,"15min":1.9119999999999999},"last":1.3},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3360000000000001,"15min":1.3129999999999999},"min":{"1min":0.84199999999999997,"5min":0.74199999999999999,"15min":0.56899999999999995},"max":{"1min":1.873,"5min":1.873,"15min":5.2629999999999999},"last":1.1890000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575056,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303824,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068016,"statfs":{"total":96636764160,"available":96325648384,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82399999999999995,"15min":0.85599999999999998},"min":{"1min":0.59399999999999997,"5min":0.47899999999999998,"15min":0.34200000000000003},"max":{"1min":1.4590000000000001,"5min":1.512,"15min":14.859},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.89600000000000002,"15min":0.90800000000000003},"min":{"1min":0.64400000000000002,"5min":0.42699999999999999,"15min":0.317},"max":{"1min":1.1140000000000001,"5min":1.724,"15min":5.0919999999999996},"last":0.70499999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91600000000000004,"15min":0.90700000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.39300000000000002},"max":{"1min":1.4450000000000001,"5min":1.5860000000000001,"15min":6.5570000000000004},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.97199999999999998,"15min":0.97099999999999997},"min":{"1min":0.63800000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4339999999999999,"5min":1.482,"15min":5.7519999999999998},"last":1.054}]},{"osd":2,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1160000000000001,"15min":1.1040000000000001},"min":{"1min":0.91900000000000004,"5min":0.48699999999999999,"15min":0.40600000000000003},"max":{"1min":1.4510000000000001,"5min":1.7350000000000001,"15min":2.391},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.1899999999999999,"15min":1.1839999999999999},"min":{"1min":0.92100000000000004,"5min":0.60699999999999998,"15min":0.44800000000000001},"max":{"1min":1.641,"5min":1.768,"15min":4.1429999999999998},"last":1.399}]},{"osd":4,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.339,"15min":1.343},"min":{"1min":0.88700000000000001,"5min":0.79000000000000004,"15min":0.51700000000000002},"max":{"1min":1.6240000000000001,"5min":2.157,"15min":10.858000000000001},"last":1.294},{"interface":"front","average":{"1min":1.367,"5min":1.325,"15min":1.343},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.63600000000000001},"max":{"1min":1.6359999999999999,"5min":1.7769999999999999,"15min":10.846},"last":1.2649999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.262,"15min":1.2809999999999999},"min":{"1min":0.83399999999999996,"5min":0.69299999999999995,"15min":0.505},"max":{"1min":1.6459999999999999,"5min":1.6739999999999999,"15min":7.3639999999999999},"last":1.038},{"interface":"front","average":{"1min":1.268,"5min":1.28,"15min":1.3819999999999999},"min":{"1min":0.91700000000000004,"5min":0.85599999999999998,"15min":0.71199999999999997},"max":{"1min":1.603,"5min":1.796,"15min":14.523999999999999},"last":1.169}]},{"osd":6,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3640000000000001,"15min":1.349},"min":{"1min":1.018,"5min":0.76000000000000001,"15min":0.56699999999999995},"max":{"1min":1.591,"5min":2.2570000000000001,"15min":4.9809999999999999},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4019999999999999,"15min":1.3919999999999999},"min":{"1min":0.93600000000000005,"5min":0.92600000000000005,"15min":0.68500000000000005},"max":{"1min":1.754,"5min":1.8700000000000001,"15min":5.4210000000000003},"last":1.508}]},{"osd":7,"last update":"Mon Jan 22 05:20:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3360000000000001,"15min":1.3580000000000001},"min":{"1min":1.01,"5min":0.90800000000000003,"15min":0.72799999999999998},"max":{"1min":1.681,"5min":2.004,"15min":5.7160000000000002},"last":1.337},{"interface":"front","average":{"1min":1.365,"5min":1.399,"15min":1.4079999999999999},"min":{"1min":0.95799999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6930000000000001,"5min":2.4449999999999998,"15min":6.4279999999999999},"last":1.5800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575056,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299728,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072112,"statfs":{"total":96636764160,"available":96329842688,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.82299999999999995,"15min":0.78000000000000003},"min":{"1min":0.64600000000000002,"5min":0.432,"15min":0.378},"max":{"1min":1.135,"5min":1.373,"15min":1.7270000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.89200000000000002,"15min":0.86799999999999999},"min":{"1min":0.68400000000000005,"5min":0.45300000000000001,"15min":0.373},"max":{"1min":1.417,"5min":1.417,"15min":1.7350000000000001},"last":0.996}]},{"osd":1,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94699999999999995,"15min":0.89000000000000001},"min":{"1min":0.69399999999999995,"5min":0.55400000000000005,"15min":0.41299999999999998},"max":{"1min":1.3879999999999999,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.032,"15min":0.96799999999999997},"min":{"1min":0.79100000000000004,"5min":0.47899999999999998,"15min":0.41599999999999998},"max":{"1min":1.5780000000000001,"5min":1.671,"15min":2.8849999999999998},"last":1.099}]},{"osd":3,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.1779999999999999,"15min":1.1499999999999999},"min":{"1min":0.68300000000000005,"5min":0.66700000000000004,"15min":0.47099999999999997},"max":{"1min":1.633,"5min":2.3090000000000002,"15min":3.0990000000000002},"last":1.052},{"interface":"front","average":{"1min":1.292,"5min":1.2470000000000001,"15min":1.22},"min":{"1min":0.86899999999999999,"5min":0.76000000000000001,"15min":0.51100000000000001},"max":{"1min":1.6180000000000001,"5min":1.8340000000000001,"15min":3.133},"last":1.2070000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.3560000000000001,"15min":1.282},"min":{"1min":1.1930000000000001,"5min":0.90400000000000003,"15min":0.59099999999999997},"max":{"1min":1.746,"5min":2.101,"15min":3.0129999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.244,"15min":1.206},"min":{"1min":1.052,"5min":0.71699999999999997,"15min":0.52100000000000002},"max":{"1min":1.6299999999999999,"5min":1.9970000000000001,"15min":2.2829999999999999},"last":1.5289999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.276,"15min":1.236},"min":{"1min":0.91900000000000004,"5min":0.84099999999999997,"15min":0.63800000000000001},"max":{"1min":1.5329999999999999,"5min":2.379,"15min":2.379},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.3480000000000001,"15min":1.292},"min":{"1min":1.216,"5min":0.84799999999999998,"15min":0.67000000000000004},"max":{"1min":1.5620000000000001,"5min":2.1880000000000002,"15min":3.0910000000000002},"last":1.264}]},{"osd":6,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2689999999999999,"15min":1.252},"min":{"1min":0.96399999999999997,"5min":0.79500000000000004,"15min":0.61799999999999999},"max":{"1min":1.5469999999999999,"5min":1.9119999999999999,"15min":2.1389999999999998},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3839999999999999,"15min":1.321},"min":{"1min":0.95999999999999996,"5min":0.91100000000000003,"15min":0.629},"max":{"1min":1.6859999999999999,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.2250000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:21:01 2024","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3759999999999999,"15min":1.3460000000000001},"min":{"1min":1.0860000000000001,"5min":0.88500000000000001,"15min":0.75900000000000001},"max":{"1min":1.7549999999999999,"5min":1.8200000000000001,"15min":2.1749999999999998},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.464,"5min":1.47,"15min":1.425},"min":{"1min":1.109,"5min":0.89700000000000002,"15min":0.79000000000000004},"max":{"1min":1.7170000000000001,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.4930000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575057,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312016,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059824,"statfs":{"total":96636764160,"available":96317259776,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.85499999999999998,"15min":0.873},"min":{"1min":0.67300000000000004,"5min":0.36699999999999999,"15min":0.36199999999999999},"max":{"1min":1.3149999999999999,"5min":1.4830000000000001,"15min":3.4119999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.024,"15min":1.0029999999999999},"min":{"1min":0.73999999999999999,"5min":0.504,"15min":0.41099999999999998},"max":{"1min":1.3700000000000001,"5min":1.6160000000000001,"15min":2.101},"last":1.2949999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.97799999999999998,"15min":0.98899999999999999},"min":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.45500000000000002},"max":{"1min":1.393,"5min":1.556,"15min":2.169},"last":1.202},{"interface":"front","average":{"1min":1.206,"5min":1.0860000000000001,"15min":1.0660000000000001},"min":{"1min":0.89300000000000002,"5min":0.52600000000000002,"15min":0.46899999999999997},"max":{"1min":1.611,"5min":1.611,"15min":2.024},"last":1.4410000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0609999999999999,"15min":1.05},"min":{"1min":0.83299999999999996,"5min":0.57399999999999995,"15min":0.38900000000000001},"max":{"1min":1.4790000000000001,"5min":1.972,"15min":4.665},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.90700000000000003,"15min":0.94899999999999995},"min":{"1min":0.71199999999999997,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.5129999999999999,"5min":1.659,"15min":5.5830000000000002},"last":0.80100000000000005}]},{"osd":4,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.236,"15min":1.2589999999999999},"min":{"1min":1.0649999999999999,"5min":0.83699999999999997,"15min":0.57899999999999996},"max":{"1min":1.6779999999999999,"5min":1.7769999999999999,"15min":15.76},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3129999999999999,"15min":1.345},"min":{"1min":1.1240000000000001,"5min":0.90400000000000003,"15min":0.63500000000000001},"max":{"1min":1.5629999999999999,"5min":1.673,"15min":16.975000000000001},"last":1.5780000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.252,"15min":1.238},"min":{"1min":0.81200000000000006,"5min":0.72599999999999998,"15min":0.55700000000000005},"max":{"1min":1.4370000000000001,"5min":5.3159999999999998,"15min":5.3159999999999998},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2889999999999999,"15min":1.286},"min":{"1min":1.0609999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5900000000000001,"5min":1.879,"15min":2.52},"last":1.708}]},{"osd":6,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2989999999999999,"15min":1.266},"min":{"1min":1.0529999999999999,"5min":0.77400000000000002,"15min":0.55600000000000005},"max":{"1min":1.5249999999999999,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.3140000000000001,"15min":1.331},"min":{"1min":1.133,"5min":0.76200000000000001,"15min":0.68799999999999994},"max":{"1min":1.6439999999999999,"5min":2.008,"15min":2.5569999999999999},"last":1.647}]},{"osd":7,"last update":"Mon Jan 22 05:20:56 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.3680000000000001,"15min":1.3560000000000001},"min":{"1min":1.181,"5min":0.77200000000000002,"15min":0.68100000000000005},"max":{"1min":1.7170000000000001,"5min":1.835,"15min":4.4329999999999998},"last":1.675},{"interface":"front","average":{"1min":1.361,"5min":1.363,"15min":1.351},"min":{"1min":1.044,"5min":0.81100000000000005,"15min":0.64900000000000002},"max":{"1min":1.619,"5min":5.4939999999999998,"15min":5.4939999999999998},"last":1.321}]}]},{"osd":0,"up_from":13,"seq":55834575056,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312016,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059824,"statfs":{"total":96636764160,"available":96317259776,"internally_reserved":0,"allocated":2564096,"data_stored":1281608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80900000000000005,"15min":0.872},"min":{"1min":0.69299999999999995,"5min":0.39600000000000002,"15min":0.28699999999999998},"max":{"1min":1.206,"5min":1.361,"15min":15.273},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.92300000000000004,"15min":0.90800000000000003},"min":{"1min":0.76600000000000001,"5min":0.48899999999999999,"15min":0.34499999999999997},"max":{"1min":1.2150000000000001,"5min":1.625,"15min":4.4009999999999998},"last":0.92000000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98799999999999999,"15min":1.0329999999999999},"min":{"1min":0.85999999999999999,"5min":0.60299999999999998,"15min":0.46400000000000002},"max":{"1min":1.4219999999999999,"5min":1.6299999999999999,"15min":15.473000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.179,"5min":1.1299999999999999,"15min":1.0509999999999999},"min":{"1min":0.95199999999999996,"5min":0.67400000000000004,"15min":0.42699999999999999},"max":{"1min":1.482,"5min":1.7070000000000001,"15min":1.7989999999999999},"last":1.014}]},{"osd":3,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0229999999999999,"15min":0.98299999999999998},"min":{"1min":0.85399999999999998,"5min":0.50600000000000001,"15min":0.39000000000000001},"max":{"1min":1.643,"5min":1.8959999999999999,"15min":5.3970000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.1639999999999999,"15min":1.1779999999999999},"min":{"1min":1.0429999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.5740000000000001,"5min":2.863,"15min":15.439},"last":1.1599999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.286,"15min":1.236},"min":{"1min":1.1879999999999999,"5min":0.81999999999999995,"15min":0.61399999999999999},"max":{"1min":1.669,"5min":1.7949999999999999,"15min":2.1280000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.2609999999999999,"15min":1.22},"min":{"1min":0.88600000000000001,"5min":0.70199999999999996,"15min":0.56200000000000006},"max":{"1min":1.6990000000000001,"5min":1.706,"15min":3.4340000000000002},"last":0.79300000000000004}]},{"osd":5,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.302,"15min":1.26},"min":{"1min":1.0369999999999999,"5min":0.79000000000000004,"15min":0.67600000000000005},"max":{"1min":1.524,"5min":1.802,"15min":2.891},"last":0.873},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.321,"15min":1.3100000000000001},"min":{"1min":1.179,"5min":0.73599999999999999,"15min":0.59499999999999997},"max":{"1min":1.881,"5min":1.881,"15min":2.823},"last":1.228}]},{"osd":6,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.373,"15min":1.4039999999999999},"min":{"1min":1.2390000000000001,"5min":0.879,"15min":0.59099999999999997},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":15.4},"last":1.347},{"interface":"front","average":{"1min":1.468,"5min":1.3819999999999999,"15min":1.357},"min":{"1min":1.244,"5min":0.80500000000000005,"15min":0.72499999999999998},"max":{"1min":1.774,"5min":1.8919999999999999,"15min":7.1349999999999998},"last":1.2010000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.4450000000000001,"15min":1.3959999999999999},"min":{"1min":1.1819999999999999,"5min":0.86899999999999999,"15min":0.79900000000000004},"max":{"1min":1.8109999999999999,"5min":2.145,"15min":2.1819999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.419,"15min":1.3660000000000001},"min":{"1min":1.2829999999999999,"5min":0.76600000000000001,"15min":0.752},"max":{"1min":1.9379999999999999,"5min":2.0470000000000002,"15min":2.7269999999999999},"last":1.0569999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:21:39.548 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-22T05:21:39.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.696+0000 7f40ea600700 1 Processor -- start 2024-01-22T05:21:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.696+0000 7f40ea600700 1 -- start start 2024-01-22T05:21:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.696+0000 7f40ea600700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40e4068e10 0x7f40e40c3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.696+0000 7f40ea600700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f40e40c3c20 0x7f40e40c6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.696+0000 7f40ea600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e40691f0 0x7f40e40c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.696+0000 7f40ea600700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40c7100 con 0x7f40e4068e10 2024-01-22T05:21:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.696+0000 7f40ea600700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40c8390 con 0x7f40e40c3c20 2024-01-22T05:21:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.696+0000 7f40ea600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4067a90 con 0x7f40e40691f0 2024-01-22T05:21:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40e3e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e40691f0 0x7f40e40c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40e2a00700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f40e40c3c20 0x7f40e40c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:39.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.696+0000 7f40e3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40e4068e10 0x7f40e40c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:39.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40e3e00700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e40691f0 0x7f40e40c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.49:52450/0 (socket says 172.21.15.49:52450) 2024-01-22T05:21:39.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40e3e00700 1 -- 172.21.15.49:0/2186427133 learned_addr learned my addr 172.21.15.49:0/2186427133 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:39.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40e3400700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f40e4068e10 0x7f40e40c3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43956/0 (socket says 172.21.15.49:43956) 2024-01-22T05:21:39.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40e3e00700 1 -- 172.21.15.49:0/2186427133 >> v2:172.21.15.110:3300/0 conn(0x7f40e40c3c20 msgr2=0x7f40e40c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:39.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40e3e00700 1 --2- 172.21.15.49:0/2186427133 >> v2:172.21.15.110:3300/0 conn(0x7f40e40c3c20 0x7f40e40c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40e3e00700 1 -- 172.21.15.49:0/2186427133 >> v2:172.21.15.49:3300/0 conn(0x7f40e4068e10 msgr2=0x7f40e40c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:21:39.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40e3e00700 1 --2- 172.21.15.49:0/2186427133 >> v2:172.21.15.49:3300/0 conn(0x7f40e4068e10 0x7f40e40c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40e3e00700 1 -- 172.21.15.49:0/2186427133 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e4067d70 con 0x7f40e40691f0 2024-01-22T05:21:39.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40e3e00700 1 --2- 172.21.15.49:0/2186427133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e40691f0 0x7f40e40c6c10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f40e4069bb0 tx=0x7f40dc009840).ready entity=mon.2 client_cookie=333a65d130fc1942 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:39.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40e2000700 1 -- 172.21.15.49:0/2186427133 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc00e070 con 0x7f40e40691f0 2024-01-22T05:21:39.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40e2000700 1 -- 172.21.15.49:0/2186427133 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc00b970 con 0x7f40e40691f0 2024-01-22T05:21:39.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40e2000700 1 -- 172.21.15.49:0/2186427133 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc00bcf0 con 0x7f40e40691f0 2024-01-22T05:21:39.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40ea600700 1 -- 172.21.15.49:0/2186427133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e40691f0 msgr2=0x7f40e40c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:39.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40ea600700 1 --2- 172.21.15.49:0/2186427133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e40691f0 0x7f40e40c6c10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f40e4069bb0 tx=0x7f40dc009840).stop 2024-01-22T05:21:39.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40ea600700 1 -- 172.21.15.49:0/2186427133 shutdown_connections 2024-01-22T05:21:39.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40ea600700 1 --2- 172.21.15.49:0/2186427133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e40691f0 0x7f40e40c6c10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40ea600700 1 --2- 172.21.15.49:0/2186427133 >> v2:172.21.15.110:3300/0 conn(0x7f40e40c3c20 0x7f40e40c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40ea600700 1 --2- 172.21.15.49:0/2186427133 >> v2:172.21.15.49:3300/0 conn(0x7f40e4068e10 0x7f40e40c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40ea600700 1 -- 172.21.15.49:0/2186427133 >> 172.21.15.49:0/2186427133 conn(0x7f40e4064f10 msgr2=0x7f40e40c8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:39.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40ea600700 1 -- 172.21.15.49:0/2186427133 shutdown_connections 2024-01-22T05:21:39.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.700+0000 7f40ea600700 1 -- 172.21.15.49:0/2186427133 wait complete. 2024-01-22T05:21:39.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.704+0000 7f40ea600700 1 Processor -- start 2024-01-22T05:21:39.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.704+0000 7f40ea600700 1 -- start start 2024-01-22T05:21:39.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40ea600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40e4068e10 0x7f40e40a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:39.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40ea600700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e40691f0 0x7f40e40ab710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:39.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40ea600700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40e40c3c20 0x7f40e414df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:39.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40ea600700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40a1000 con 0x7f40e40c3c20 2024-01-22T05:21:39.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40ea600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40ad960 con 0x7f40e4068e10 2024-01-22T05:21:39.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40ea600700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40abef0 con 0x7f40e40691f0 2024-01-22T05:21:39.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40e3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40e40c3c20 0x7f40e414df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:39.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40e3e00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40e40c3c20 0x7f40e414df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43968/0 (socket says 172.21.15.49:43968) 2024-01-22T05:21:39.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40e3e00700 1 -- 172.21.15.49:0/1895107186 learned_addr learned my addr 172.21.15.49:0/1895107186 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:39.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40e3400700 1 --2- 172.21.15.49:0/1895107186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40e4068e10 0x7f40e40a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:39.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40e2a00700 1 --2- 172.21.15.49:0/1895107186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e40691f0 0x7f40e40ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:39.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40e3400700 1 -- 172.21.15.49:0/1895107186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e40691f0 msgr2=0x7f40e40ab710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:39.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40e3400700 1 --2- 172.21.15.49:0/1895107186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e40691f0 0x7f40e40ab710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40e3400700 1 -- 172.21.15.49:0/1895107186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40e40c3c20 msgr2=0x7f40e414df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:39.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40e3400700 1 --2- 172.21.15.49:0/1895107186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40e40c3c20 0x7f40e414df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40e3400700 1 -- 172.21.15.49:0/1895107186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc009ae0 con 0x7f40e4068e10 2024-01-22T05:21:39.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40e3400700 1 --2- 172.21.15.49:0/1895107186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40e4068e10 0x7f40e40a0b10 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f40d400e900 tx=0x7f40d4009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:39.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40daa00700 1 -- 172.21.15.49:0/1895107186 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4009450 con 0x7f40e4068e10 2024-01-22T05:21:39.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40daa00700 1 -- 172.21.15.49:0/1895107186 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d4012600 con 0x7f40e4068e10 2024-01-22T05:21:39.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40ea600700 1 -- 172.21.15.49:0/1895107186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e40ac1d0 con 0x7f40e4068e10 2024-01-22T05:21:39.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40daa00700 1 -- 172.21.15.49:0/1895107186 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4012980 con 0x7f40e4068e10 2024-01-22T05:21:39.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.708+0000 7f40ea600700 1 -- 172.21.15.49:0/1895107186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e40abc00 con 0x7f40e4068e10 2024-01-22T05:21:39.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.712+0000 7f40ea600700 1 -- 172.21.15.49:0/1895107186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e40ac6d0 con 0x7f40e4068e10 2024-01-22T05:21:39.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.712+0000 7f40daa00700 1 -- 172.21.15.49:0/1895107186 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f40d4012d30 con 0x7f40e4068e10 2024-01-22T05:21:39.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.712+0000 7f40daa00700 1 --2- 172.21.15.49:0/1895107186 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40bc05a560 0x7f40bc05ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:39.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.712+0000 7f40daa00700 1 -- 172.21.15.49:0/1895107186 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7f40d4074a30 con 0x7f40e4068e10 2024-01-22T05:21:39.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.712+0000 7f40e2a00700 1 --2- 172.21.15.49:0/1895107186 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40bc05a560 0x7f40bc05ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:39.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.716+0000 7f40e2a00700 1 --2- 172.21.15.49:0/1895107186 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40bc05a560 0x7f40bc05ca20 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f40e4165340 tx=0x7f40cc009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:39.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.724+0000 7f40daa00700 1 -- 172.21.15.49:0/1895107186 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f40d4048290 con 0x7f40e4068e10 2024-01-22T05:21:39.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.888+0000 7f40ea600700 1 -- 172.21.15.49:0/1895107186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f40e4066590 con 0x7f40e4068e10 2024-01-22T05:21:39.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.900+0000 7f40daa00700 1 -- 172.21.15.49:0/1895107186 <== mon.1 v2:172.21.15.110:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f40d4048290 con 0x7f40e4068e10 2024-01-22T05:21:39.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.900+0000 7f40daa00700 1 -- 172.21.15.49:0/1895107186 <== mon.1 v2:172.21.15.110:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v28)=0 v28) v1 ==== 123+0+0 (secure 0 0 0) 0x7f40d404b8b0 con 0x7f40e4068e10 2024-01-22T05:21:39.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.904+0000 7f40ea600700 1 -- 172.21.15.49:0/1895107186 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40bc05a560 msgr2=0x7f40bc05ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:39.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.904+0000 7f40ea600700 1 --2- 172.21.15.49:0/1895107186 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40bc05a560 0x7f40bc05ca20 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f40e4165340 tx=0x7f40cc009060).stop 2024-01-22T05:21:39.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.904+0000 7f40ea600700 1 -- 172.21.15.49:0/1895107186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40e4068e10 msgr2=0x7f40e40a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:39.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.904+0000 7f40ea600700 1 --2- 172.21.15.49:0/1895107186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40e4068e10 0x7f40e40a0b10 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f40d400e900 tx=0x7f40d4009060).stop 2024-01-22T05:21:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.904+0000 7f40ea600700 1 -- 172.21.15.49:0/1895107186 shutdown_connections 2024-01-22T05:21:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.904+0000 7f40ea600700 1 --2- 172.21.15.49:0/1895107186 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7f40bc05a560 0x7f40bc05ca20 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.904+0000 7f40ea600700 1 --2- 172.21.15.49:0/1895107186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40e40c3c20 0x7f40e414df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.904+0000 7f40ea600700 1 --2- 172.21.15.49:0/1895107186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e40691f0 0x7f40e40ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.904+0000 7f40ea600700 1 --2- 172.21.15.49:0/1895107186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40e4068e10 0x7f40e40a0b10 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.904+0000 7f40ea600700 1 -- 172.21.15.49:0/1895107186 >> 172.21.15.49:0/1895107186 conn(0x7f40e4064f10 msgr2=0x7f40e4150ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.904+0000 7f40ea600700 1 -- 172.21.15.49:0/1895107186 shutdown_connections 2024-01-22T05:21:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:39.904+0000 7f40ea600700 1 -- 172.21.15.49:0/1895107186 wait complete. 2024-01-22T05:21:39.924 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:21:39.924 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:21:40.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.080+0000 7fc369200700 1 Processor -- start 2024-01-22T05:21:40.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.084+0000 7fc369200700 1 -- start start 2024-01-22T05:21:40.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.084+0000 7fc369200700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc3640643f0 0x7fc3640c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:40.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.084+0000 7fc369200700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3641584c0 con 0x7fc3641570a0 2024-01-22T05:21:40.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.084+0000 7fc369200700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3641578f0 con 0x7fc364156cc0 2024-01-22T05:21:40.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.084+0000 7fc369200700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc364157b90 con 0x7fc3640643f0 2024-01-22T05:21:40.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc362a00700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc3641570a0 0x7fc364063ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42142/0 (socket says 172.21.15.49:42142) 2024-01-22T05:21:40.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc362a00700 1 -- 172.21.15.49:0/2953610686 learned_addr learned my addr 172.21.15.49:0/2953610686 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-22T05:21:40.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc363e00700 1 --2- 172.21.15.49:0/2953610686 >> v2:172.21.15.49:3300/0 conn(0x7fc3640643f0 0x7fc3640c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:40.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc363e00700 1 -- 172.21.15.49:0/2953610686 >> v1:172.21.15.110:6789/0 conn(0x7fc364156cc0 legacy=0x7fc3640c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:40.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc363e00700 1 -- 172.21.15.49:0/2953610686 >> v1:172.21.15.49:6789/0 conn(0x7fc3641570a0 legacy=0x7fc364063ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:40.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc363e00700 1 -- 172.21.15.49:0/2953610686 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc364157e70 con 0x7fc3640643f0 2024-01-22T05:21:40.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc363e00700 1 --2- 172.21.15.49:0/2953610686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640643f0 0x7fc3640c53d0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 rx=0x7fc35c009e60 tx=0x7fc35c009780).ready entity=mon.0 client_cookie=1889a62587d098d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:40.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc362000700 1 -- 172.21.15.49:0/2953610686 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c00e070 con 0x7fc3640643f0 2024-01-22T05:21:40.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc362000700 1 -- 172.21.15.49:0/2953610686 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc35c00bc30 con 0x7fc3640643f0 2024-01-22T05:21:40.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc362000700 1 -- 172.21.15.49:0/2953610686 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c012410 con 0x7fc3640643f0 2024-01-22T05:21:40.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc369200700 1 -- 172.21.15.49:0/2953610686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640643f0 msgr2=0x7fc3640c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:40.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc369200700 1 --2- 172.21.15.49:0/2953610686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640643f0 0x7fc3640c53d0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 rx=0x7fc35c009e60 tx=0x7fc35c009780).stop 2024-01-22T05:21:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc369200700 1 -- 172.21.15.49:0/2953610686 shutdown_connections 2024-01-22T05:21:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc369200700 1 --2- 172.21.15.49:0/2953610686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640643f0 0x7fc3640c53d0 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc369200700 1 -- 172.21.15.49:0/2953610686 >> 172.21.15.49:0/2953610686 conn(0x7fc3640626d0 msgr2=0x7fc364062ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc369200700 1 -- 172.21.15.49:0/2953610686 shutdown_connections 2024-01-22T05:21:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.088+0000 7fc369200700 1 -- 172.21.15.49:0/2953610686 wait complete. 2024-01-22T05:21:40.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.092+0000 7fc369200700 1 Processor -- start 2024-01-22T05:21:40.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.092+0000 7fc369200700 1 -- start start 2024-01-22T05:21:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.092+0000 7fc369200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640643f0 0x7fc364142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.092+0000 7fc369200700 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc364156cc0 0x7fc3640ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.092+0000 7fc369200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3641570a0 0x7fc3640ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.092+0000 7fc369200700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640abed0 con 0x7fc3640643f0 2024-01-22T05:21:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.092+0000 7fc369200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640ac690 con 0x7fc3641570a0 2024-01-22T05:21:40.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.092+0000 7fc369200700 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc364153320 con 0x7fc364156cc0 2024-01-22T05:21:40.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.092+0000 7fc363400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640643f0 0x7fc364142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:40.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.092+0000 7fc363e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3641570a0 0x7fc3640ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:40.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.092+0000 7fc363400700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640643f0 0x7fc364142f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43980/0 (socket says 172.21.15.49:43980) 2024-01-22T05:21:40.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.092+0000 7fc363400700 1 -- 172.21.15.49:0/2123604791 learned_addr learned my addr 172.21.15.49:0/2123604791 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-22T05:21:40.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.092+0000 7fc362a00700 1 --2- 172.21.15.49:0/2123604791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc364156cc0 0x7fc3640ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:40.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.096+0000 7fc363400700 1 -- 172.21.15.49:0/2123604791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc364156cc0 msgr2=0x7fc3640ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:40.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.096+0000 7fc363400700 1 --2- 172.21.15.49:0/2123604791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc364156cc0 0x7fc3640ab4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:40.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.096+0000 7fc363400700 1 -- 172.21.15.49:0/2123604791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3641570a0 msgr2=0x7fc3640ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:40.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.096+0000 7fc363400700 1 --2- 172.21.15.49:0/2123604791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3641570a0 0x7fc3640ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:40.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.096+0000 7fc363400700 1 -- 172.21.15.49:0/2123604791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c009a20 con 0x7fc3640643f0 2024-01-22T05:21:40.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.096+0000 7fc363400700 1 --2- 172.21.15.49:0/2123604791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640643f0 0x7fc364142f30 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 rx=0x7fc35400c4f0 tx=0x7fc354007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:40.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.096+0000 7fc35aa00700 1 -- 172.21.15.49:0/2123604791 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35400ce60 con 0x7fc3640643f0 2024-01-22T05:21:40.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.096+0000 7fc35aa00700 1 -- 172.21.15.49:0/2123604791 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc354001e90 con 0x7fc3640643f0 2024-01-22T05:21:40.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.096+0000 7fc369200700 1 -- 172.21.15.49:0/2123604791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc364152ff0 con 0x7fc3640643f0 2024-01-22T05:21:40.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.096+0000 7fc35aa00700 1 -- 172.21.15.49:0/2123604791 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354007270 con 0x7fc3640643f0 2024-01-22T05:21:40.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.096+0000 7fc369200700 1 -- 172.21.15.49:0/2123604791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3640ac3b0 con 0x7fc3640643f0 2024-01-22T05:21:40.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.096+0000 7fc369200700 1 -- 172.21.15.49:0/2123604791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36406a330 con 0x7fc3640643f0 2024-01-22T05:21:40.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.100+0000 7fc35aa00700 1 -- 172.21.15.49:0/2123604791 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc3540066a0 con 0x7fc3640643f0 2024-01-22T05:21:40.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.100+0000 7fc35aa00700 1 --2- 172.21.15.49:0/2123604791 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc33c05a510 0x7fc33c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:21:40.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.100+0000 7fc35aa00700 1 -- 172.21.15.49:0/2123604791 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5794+0+0 (secure 0 0 0) 0x7fc354073f50 con 0x7fc3640643f0 2024-01-22T05:21:40.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.100+0000 7fc362a00700 1 --2- 172.21.15.49:0/2123604791 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc33c05a510 0x7fc33c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:21:40.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.100+0000 7fc362a00700 1 --2- 172.21.15.49:0/2123604791 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc33c05a510 0x7fc33c05c9d0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fc364157700 tx=0x7fc34c007d30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:21:40.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.104+0000 7fc35aa00700 1 -- 172.21.15.49:0/2123604791 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc36406a330 con 0x7fc3640643f0 2024-01-22T05:21:40.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.316+0000 7fc369200700 1 -- 172.21.15.49:0/2123604791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc36406a330 con 0x7fc3640643f0 2024-01-22T05:21:40.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.316+0000 7fc35aa00700 1 -- 172.21.15.49:0/2123604791 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 159 v159) v1 ==== 95+0+3541 (secure 0 0 0) 0x7fc36406a330 con 0x7fc3640643f0 2024-01-22T05:21:40.317 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-22T05:21:40.317 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":159,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1805560931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1805560931},{"type":"v1","addr":"172.21.15.110:6833","nonce":1805560931}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3941922826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3941922826},{"type":"v1","addr":"172.21.15.110:6835","nonce":3941922826}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2796452202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2796452202},{"type":"v1","addr":"172.21.15.49:6836","nonce":2796452202}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10950,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/747286744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":747286744},{"type":"v1","addr":"172.21.15.49:6837","nonce":747286744}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":159}],"filesystems":[]} 2024-01-22T05:21:40.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.320+0000 7fc369200700 1 -- 172.21.15.49:0/2123604791 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc33c05a510 msgr2=0x7fc33c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:40.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.320+0000 7fc369200700 1 --2- 172.21.15.49:0/2123604791 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc33c05a510 0x7fc33c05c9d0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fc364157700 tx=0x7fc34c007d30).stop 2024-01-22T05:21:40.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.320+0000 7fc369200700 1 -- 172.21.15.49:0/2123604791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640643f0 msgr2=0x7fc364142f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:21:40.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.320+0000 7fc369200700 1 --2- 172.21.15.49:0/2123604791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640643f0 0x7fc364142f30 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 rx=0x7fc35400c4f0 tx=0x7fc354007e00).stop 2024-01-22T05:21:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.320+0000 7fc369200700 1 -- 172.21.15.49:0/2123604791 shutdown_connections 2024-01-22T05:21:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.320+0000 7fc369200700 1 --2- 172.21.15.49:0/2123604791 >> [v2:172.21.15.49:6832/22885,v1:172.21.15.49:6833/22885] conn(0x7fc33c05a510 0x7fc33c05c9d0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.320+0000 7fc369200700 1 --2- 172.21.15.49:0/2123604791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3641570a0 0x7fc3640ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.320+0000 7fc369200700 1 --2- 172.21.15.49:0/2123604791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc364156cc0 0x7fc3640ab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.320+0000 7fc369200700 1 --2- 172.21.15.49:0/2123604791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640643f0 0x7fc364142f30 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:21:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.320+0000 7fc369200700 1 -- 172.21.15.49:0/2123604791 >> 172.21.15.49:0/2123604791 conn(0x7fc3640626d0 msgr2=0x7fc3640bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:21:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.320+0000 7fc369200700 1 -- 172.21.15.49:0/2123604791 shutdown_connections 2024-01-22T05:21:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-22T05:21:40.320+0000 7fc369200700 1 -- 172.21.15.49:0/2123604791 wait complete. 2024-01-22T05:21:40.324 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 159 2024-01-22T05:21:40.343 DEBUG:tasks.cephfs.filesystem:already dead... 2024-01-22T05:21:40.344 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-22T05:21:40.344 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:21:40.344 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:21:40.364 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:21:40.365 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:21:40.365 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:21:40.428 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:21:40.428 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:21:40.428 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:21:40.451 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:21:40.451 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:21:40.451 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:21:40.515 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:21:40.515 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-22T05:21:40.515 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-22T05:21:40.515 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:21:40.612 INFO:tasks.ceph.osd.0:Stopped 2024-01-22T05:21:40.613 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-22T05:21:40.613 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:21:40.667 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:21:40.674 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:21:45.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-01-22T05:21:46.714 INFO:tasks.ceph.osd.1:Stopped 2024-01-22T05:21:46.714 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-22T05:21:46.714 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:21:46.800 INFO:tasks.ceph.osd.2:Stopped 2024-01-22T05:21:46.800 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-22T05:21:46.800 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:21:50.944 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-01-22T05:21:50.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-01-22T05:21:52.902 INFO:tasks.ceph.osd.3:Stopped 2024-01-22T05:21:52.903 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-22T05:21:52.903 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:21:52.992 INFO:tasks.ceph.osd.4:Stopped 2024-01-22T05:21:52.993 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-22T05:21:52.993 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:21:56.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-01-22T05:21:56.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-01-22T05:21:59.095 INFO:tasks.ceph.osd.5:Stopped 2024-01-22T05:21:59.095 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-22T05:21:59.095 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:21:59.194 INFO:tasks.ceph.osd.6:Stopped 2024-01-22T05:21:59.194 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-22T05:21:59.194 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:22:02.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-01-22T05:22:02.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-01-22T05:22:05.296 INFO:tasks.ceph.osd.7:Stopped 2024-01-22T05:22:05.296 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-22T05:22:05.297 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-22T05:22:05.297 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:22:05.356 INFO:tasks.ceph.mgr.y:Stopped 2024-01-22T05:22:05.356 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-22T05:22:05.356 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:22:05.439 INFO:tasks.ceph.mgr.x:Stopped 2024-01-22T05:22:05.439 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-22T05:22:05.439 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-22T05:22:05.440 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:22:05.489 INFO:tasks.ceph.mon.a:Stopped 2024-01-22T05:22:05.490 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-22T05:22:05.490 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:22:05.524 INFO:tasks.ceph.mon.b:Stopped 2024-01-22T05:22:05.524 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-22T05:22:05.525 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:22:05.596 INFO:tasks.ceph.mon.c:Stopped 2024-01-22T05:22:05.596 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-22T05:22:05.596 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-01-22T05:22:05.648 INFO:teuthology.orchestra.run.smithi049.stdout:2024-01-22T05:14:30.395561+0000 mon.a (mon.0) 995 : cluster [WRN] Health check failed: Degraded data redundancy: 18/2092 objects degraded (0.860%), 1 pg degraded (PG_DEGRADED) 2024-01-22T05:22:05.649 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-01-22T05:22:05.650 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-01-22T05:22:05.692 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-01-22T05:22:05.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-01-22T05:22:05.878 INFO:teuthology.orchestra.run.smithi049.stdout:2024-01-22T05:14:30.395561+0000 mon.a (mon.0) 995 : cluster [WRN] Health check failed: Degraded data redundancy: 18/2092 objects degraded (0.860%), 1 pg degraded (PG_DEGRADED) 2024-01-22T05:22:05.879 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:22:05.879 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-22T05:22:06.214 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:22:06.214 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-22T05:22:06.466 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:22:06.466 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-22T05:22:06.671 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:22:06.672 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-22T05:22:06.893 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-22T05:22:06.893 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-22T05:22:07.130 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-22T05:22:07.130 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-22T05:22:07.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-01-22T05:22:07.343 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-22T05:22:07.343 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-22T05:22:07.505 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-22T05:22:07.505 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-22T05:22:07.678 INFO:tasks.ceph:Archiving mon data... 2024-01-22T05:22:07.679 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560/data/mon.a.tgz 2024-01-22T05:22:07.679 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-01-22T05:22:07.698 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.uldPUft4Ed 2024-01-22T05:22:07.698 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.uldPUft4Ed 2024-01-22T05:22:08.062 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.uldPUft4Ed 2024-01-22T05:22:08.158 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.uldPUft4Ed is 938KB 2024-01-22T05:22:08.241 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.uldPUft4Ed 2024-01-22T05:22:08.262 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560/data/mon.b.tgz 2024-01-22T05:22:08.262 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-01-22T05:22:08.280 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.kcKtvHVRzB 2024-01-22T05:22:08.281 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.kcKtvHVRzB 2024-01-22T05:22:08.621 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.kcKtvHVRzB 2024-01-22T05:22:08.715 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.kcKtvHVRzB is 996KB 2024-01-22T05:22:08.797 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.kcKtvHVRzB 2024-01-22T05:22:08.816 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560/data/mon.c.tgz 2024-01-22T05:22:08.817 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-01-22T05:22:08.875 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.vAN2Uqj0UV 2024-01-22T05:22:08.876 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.vAN2Uqj0UV 2024-01-22T05:22:09.220 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.vAN2Uqj0UV 2024-01-22T05:22:09.315 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.vAN2Uqj0UV is 996KB 2024-01-22T05:22:09.401 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.vAN2Uqj0UV 2024-01-22T05:22:09.420 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-22T05:22:09.420 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-22T05:22:09.427 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-22T05:22:09.496 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-01-22T05:22:09.496 DEBUG:teuthology.orchestra.run.smithi049:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-01-22T05:22:09.507 DEBUG:teuthology.orchestra.run.smithi110:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-01-22T05:22:09.554 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-01-22T05:22:09.584 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-01-22T05:22:09.598 INFO:tasks.ceph:Archiving crash dumps... 2024-01-22T05:22:09.599 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560/remote/smithi049/crash 2024-01-22T05:22:09.600 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-22T05:22:09.633 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560/remote/smithi110/crash 2024-01-22T05:22:09.634 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-22T05:22:09.673 INFO:tasks.ceph:Shutting down logrotate 2024-01-22T05:22:09.673 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:22:09.687 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:22:09.874 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-22T05:22:09.913 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-22T05:22:09.948 INFO:tasks.ceph:Compressing logs... 2024-01-22T05:22:09.948 DEBUG:teuthology.orchestra.run.smithi049:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-22T05:22:09.959 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-22T05:22:10.042 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67016.log 2024-01-22T05:22:10.044 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65352.log 2024-01-22T05:22:10.046 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74978.log 2024-01-22T05:22:10.047 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-01-22T05:22:10.048 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65352.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.67016.log.gz 2024-01-22T05:22:10.048 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46626.log 2024-01-22T05:22:10.049 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.26869.log 2024-01-22T05:22:10.049 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65352.log.gz 2024-01-22T05:22:10.050 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71936.log 2024-01-22T05:22:10.051 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74978.log.gz 2024-01-22T05:22:10.051 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23187.log 2024-01-22T05:22:10.052 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71598.log 2024-01-22T05:22:10.053 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.3.26869.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-22T05:22:10.053 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.26869.log.gz 2024-01-22T05:22:10.054 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46626.log: /var/log/ceph/ceph-client.admin.71936.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46626.log.gz 2024-01-22T05:22:10.054 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71936.log.gz 2024-01-22T05:22:10.054 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45860.log 2024-01-22T05:22:10.055 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26650.log 2024-01-22T05:22:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70706.log 2024-01-22T05:22:10.055 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45860.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71598.log.gz 2024-01-22T05:22:10.056 INFO:teuthology.orchestra.run.smithi049.stderr: 90.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.45860.log.gz 2024-01-22T05:22:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.77044.log 2024-01-22T05:22:10.056 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23187.log: /var/log/ceph/ceph-mon.b.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.23187.log.gz 2024-01-22T05:22:10.056 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23053.log 2024-01-22T05:22:10.057 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70706.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70706.log.gz 2024-01-22T05:22:10.057 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44613.log 2024-01-22T05:22:10.058 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26650.log: 92.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-01-22T05:22:10.059 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-22T05:22:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47622.log 2024-01-22T05:22:10.059 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.77044.log.gz 2024-01-22T05:22:10.060 INFO:teuthology.orchestra.run.smithi110.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.26650.log.gz 2024-01-22T05:22:10.060 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23213.log 2024-01-22T05:22:10.060 INFO:teuthology.orchestra.run.smithi110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.23053.log.gz 2024-01-22T05:22:10.061 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44613.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.44613.log.gz 2024-01-22T05:22:10.062 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65242.log 2024-01-22T05:22:10.062 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-22T05:22:10.063 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23213.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.23213.log.gz 2024-01-22T05:22:10.063 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-22T05:22:10.064 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.28848.log 2024-01-22T05:22:10.064 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47622.log.gz 2024-01-22T05:22:10.064 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22844.log 2024-01-22T05:22:10.064 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65242.log.gz 2024-01-22T05:22:10.065 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-22T05:22:10.065 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.2.28848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.28848.log.gz 2024-01-22T05:22:10.066 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26469.log 2024-01-22T05:22:10.066 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23080.log 2024-01-22T05:22:10.067 INFO:teuthology.orchestra.run.smithi049.stderr:gzip /var/log/ceph/ceph-client.admin.22844.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.67439.log 2024-01-22T05:22:10.068 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-22T05:22:10.068 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26469.log: 88.3% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.26469.log.gz -- replaced with /var/log/ceph/ceph-client.admin.22844.log.gz 2024-01-22T05:22:10.068 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-22T05:22:10.069 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76510.log 2024-01-22T05:22:10.070 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23080.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-01-22T05:22:10.070 INFO:teuthology.orchestra.run.smithi110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.23080.log.gz 2024-01-22T05:22:10.071 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77608.log 2024-01-22T05:22:10.071 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67439.log.gz 2024-01-22T05:22:10.072 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23028.log 2024-01-22T05:22:10.072 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76510.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76510.log.gz 2024-01-22T05:22:10.072 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73789.log 2024-01-22T05:22:10.073 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77608.log: gzip 89.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.77608.log.gz--verbose 2024-01-22T05:22:10.073 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.27726.log 2024-01-22T05:22:10.074 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30327.log 2024-01-22T05:22:10.074 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73789.log.gz 2024-01-22T05:22:10.075 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27726.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27726.log.gz 2024-01-22T05:22:10.075 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-client.admin.23028.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.23028.log.gz 2024-01-22T05:22:10.076 INFO:teuthology.orchestra.run.smithi110.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-22T05:22:10.076 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26787.log 2024-01-22T05:22:10.076 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65772.log 2024-01-22T05:22:10.077 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23158.log 2024-01-22T05:22:10.079 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26787.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.26787.log.gz 2024-01-22T05:22:10.079 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26731.log 2024-01-22T05:22:10.079 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30327.log: /var/log/ceph/ceph-client.0.65772.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30327.log.gz 2024-01-22T05:22:10.080 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65772.log.gz 2024-01-22T05:22:10.080 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71040.log 2024-01-22T05:22:10.080 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-22T05:22:10.080 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23158.log: 94.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-22T05:22:10.081 INFO:teuthology.orchestra.run.smithi110.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.23158.log.gz 2024-01-22T05:22:10.081 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23131.log 2024-01-22T05:22:10.081 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26731.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.26731.log.gz 2024-01-22T05:22:10.081 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.61586.log 2024-01-22T05:22:10.082 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71094.log 2024-01-22T05:22:10.083 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-01-22T05:22:10.083 INFO:teuthology.orchestra.run.smithi049.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71040.log.gz 2024-01-22T05:22:10.084 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23131.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.23131.log.gz 2024-01-22T05:22:10.084 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61586.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61586.log.gz 2024-01-22T05:22:10.084 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48116.log 2024-01-22T05:22:10.085 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.26765.log 2024-01-22T05:22:10.086 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77948.log 2024-01-22T05:22:10.086 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71094.log.gz 2024-01-22T05:22:10.087 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48116.log: gzip -5 88.7%--verbose -- replaced with /var/log/ceph/ceph-client.admin.48116.log.gz 2024-01-22T05:22:10.087 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.76693.log 2024-01-22T05:22:10.088 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65408.log 2024-01-22T05:22:10.089 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23105.log 2024-01-22T05:22:10.090 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.1.26765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.26765.log.gz 2024-01-22T05:22:10.090 INFO:teuthology.orchestra.run.smithi110.stderr: 92.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-22T05:22:10.090 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77948.log.gz 2024-01-22T05:22:10.090 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76693.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76693.log.gz 2024-01-22T05:22:10.091 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67883.log 2024-01-22T05:22:10.091 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23105.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.23105.log.gz 2024-01-22T05:22:10.091 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-01-22T05:22:10.092 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61993.log 2024-01-22T05:22:10.092 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65408.log.gz 2024-01-22T05:22:10.093 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72119.log 2024-01-22T05:22:10.093 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67883.log.gz 2024-01-22T05:22:10.094 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61993.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61993.log.gz 2024-01-22T05:22:10.094 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78440.log 2024-01-22T05:22:10.096 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72119.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72119.log.gz 2024-01-22T05:22:10.096 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73644.log 2024-01-22T05:22:10.097 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81230.log 2024-01-22T05:22:10.097 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78440.log.gz 2024-01-22T05:22:10.099 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73644.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73644.log.gz 2024-01-22T05:22:10.099 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73733.log 2024-01-22T05:22:10.100 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27699.log 2024-01-22T05:22:10.100 INFO:teuthology.orchestra.run.smithi049.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.81230.log.gz 2024-01-22T05:22:10.101 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73733.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73733.log.gz 2024-01-22T05:22:10.102 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74484.log 2024-01-22T05:22:10.103 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77919.log 2024-01-22T05:22:10.103 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27699.log.gz 2024-01-22T05:22:10.104 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74484.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74484.log.gz 2024-01-22T05:22:10.104 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73973.log 2024-01-22T05:22:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43561.log 2024-01-22T05:22:10.106 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77919.log.gz 2024-01-22T05:22:10.107 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44457.log 88.0% 2024-01-22T05:22:10.107 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73973.log.gz 2024-01-22T05:22:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30109.log 2024-01-22T05:22:10.108 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43561.log.gz 2024-01-22T05:22:10.110 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74244.log 2024-01-22T05:22:10.110 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.44457.log.gz 2024-01-22T05:22:10.111 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64522.log 2024-01-22T05:22:10.111 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30109.log.gz 2024-01-22T05:22:10.113 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74398.log 2024-01-22T05:22:10.113 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74244.log.gz 2024-01-22T05:22:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64522.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64522.log.gz 2024-01-22T05:22:10.114 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29901.log 2024-01-22T05:22:10.115 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74398.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74398.log.gz 2024-01-22T05:22:10.116 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78918.log 2024-01-22T05:22:10.117 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61474.log 2024-01-22T05:22:10.119 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29901.log: /var/log/ceph/ceph-client.admin.78918.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78918.log.gz 2024-01-22T05:22:10.119 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29901.log.gz 2024-01-22T05:22:10.119 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-22T05:22:10.120 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61723.log 2024-01-22T05:22:10.121 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mon.a.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.61474.log.gz 2024-01-22T05:22:10.122 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62287.log 2024-01-22T05:22:10.124 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61723.log: gzip -5 --verbose -- 88.5%/var/log/ceph/ceph-client.admin.76483.log 2024-01-22T05:22:10.124 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61723.log.gz 2024-01-22T05:22:10.125 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64684.log 2024-01-22T05:22:10.127 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62287.log: /var/log/ceph/ceph-client.admin.76483.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76483.log.gz 2024-01-22T05:22:10.127 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62287.log.gz 2024-01-22T05:22:10.127 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81473.log 2024-01-22T05:22:10.128 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61669.log 2024-01-22T05:22:10.129 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81473.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64684.log.gz 2024-01-22T05:22:10.129 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81473.log.gz 2024-01-22T05:22:10.130 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75377.log 2024-01-22T05:22:10.132 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66965.log 2024-01-22T05:22:10.132 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61669.log.gz 2024-01-22T05:22:10.133 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43480.log 2024-01-22T05:22:10.134 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.66965.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.75377.log.gz 2024-01-22T05:22:10.135 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48948.log 2024-01-22T05:22:10.135 INFO:teuthology.orchestra.run.smithi049.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.66965.log.gz 2024-01-22T05:22:10.136 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28915.log 2024-01-22T05:22:10.137 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48948.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43480.log.gz 2024-01-22T05:22:10.137 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48948.log.gz 2024-01-22T05:22:10.138 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70181.log 2024-01-22T05:22:10.140 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28915.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28915.log.gz 2024-01-22T05:22:10.140 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75705.log 2024-01-22T05:22:10.142 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43715.log 2024-01-22T05:22:10.143 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70181.log: /var/log/ceph/ceph-client.admin.75705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75759.log 2024-01-22T05:22:10.143 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75705.log.gz 2024-01-22T05:22:10.143 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.70181.log.gz 2024-01-22T05:22:10.145 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74081.log 2024-01-22T05:22:10.145 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43715.log.gz 2024-01-22T05:22:10.146 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75759.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75759.log.gz 2024-01-22T05:22:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71625.log 2024-01-22T05:22:10.148 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74081.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.74081.log.gz 2024-01-22T05:22:10.148 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43955.log 2024-01-22T05:22:10.149 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46919.log 2024-01-22T05:22:10.150 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71625.log.gz 2024-01-22T05:22:10.150 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43955.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43955.log.gz 2024-01-22T05:22:10.151 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27618.log 2024-01-22T05:22:10.153 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46251.log 2024-01-22T05:22:10.153 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46919.log.gz 2024-01-22T05:22:10.154 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62544.log 2024-01-22T05:22:10.155 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27618.log.gz 2024-01-22T05:22:10.155 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46251.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46251.log.gz 2024-01-22T05:22:10.155 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71799.log 2024-01-22T05:22:10.157 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47699.log 2024-01-22T05:22:10.157 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62544.log.gz 2024-01-22T05:22:10.158 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71799.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.71799.log.gz 2024-01-22T05:22:10.158 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65543.log 2024-01-22T05:22:10.159 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70760.log 2024-01-22T05:22:10.160 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47699.log.gz 2024-01-22T05:22:10.161 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65543.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65543.log.gz 2024-01-22T05:22:10.161 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46753.log 2024-01-22T05:22:10.162 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68594.log 2024-01-22T05:22:10.163 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70760.log.gz 2024-01-22T05:22:10.163 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46753.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46753.log.gz 2024-01-22T05:22:10.164 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64323.log 2024-01-22T05:22:10.165 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49212.log 2024-01-22T05:22:10.165 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68594.log.gz 2024-01-22T05:22:10.166 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76645.log 2024-01-22T05:22:10.166 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64323.log.gz 2024-01-22T05:22:10.167 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49212.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49212.log.gz 2024-01-22T05:22:10.168 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30246.log 2024-01-22T05:22:10.169 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64738.log 2024-01-22T05:22:10.171 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76645.log: /var/log/ceph/ceph-client.admin.30246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65570.log 2024-01-22T05:22:10.171 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30246.log.gz 2024-01-22T05:22:10.171 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.76645.log.gz 2024-01-22T05:22:10.172 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78380.log 2024-01-22T05:22:10.172 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64738.log.gz 2024-01-22T05:22:10.173 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65570.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65570.log.gz 2024-01-22T05:22:10.174 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49110.log 2024-01-22T05:22:10.175 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44009.log 2024-01-22T05:22:10.176 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78380.log: /var/log/ceph/ceph-client.admin.49110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48813.log 2024-01-22T05:22:10.177 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49110.log.gz 2024-01-22T05:22:10.177 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44009.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44009.log.gz 2024-01-22T05:22:10.178 INFO:teuthology.orchestra.run.smithi049.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.78380.log.gz 2024-01-22T05:22:10.179 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29455.log 2024-01-22T05:22:10.181 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48813.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48813.log.gz 2024-01-22T05:22:10.181 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62206.log 2024-01-22T05:22:10.182 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70814.log 2024-01-22T05:22:10.183 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29455.log: /var/log/ceph/ceph-client.admin.62206.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29455.log.gz 2024-01-22T05:22:10.183 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62206.log.gz 2024-01-22T05:22:10.183 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46890.log 2024-01-22T05:22:10.189 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79332.log 2024-01-22T05:22:10.189 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46890.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70814.log.gz 2024-01-22T05:22:10.190 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46890.log.gz 2024-01-22T05:22:10.190 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27753.log 2024-01-22T05:22:10.190 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75850.log 2024-01-22T05:22:10.190 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79332.log.gz 2024-01-22T05:22:10.190 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44551.log 2024-01-22T05:22:10.190 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27753.log.gz 2024-01-22T05:22:10.191 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64296.log 2024-01-22T05:22:10.191 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.75850.log.gz 2024-01-22T05:22:10.191 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.44551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44551.log.gz 2024-01-22T05:22:10.192 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78656.log 2024-01-22T05:22:10.193 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78548.log 2024-01-22T05:22:10.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64296.log: /var/log/ceph/ceph-client.admin.78656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75940.log 2024-01-22T05:22:10.195 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78656.log.gz 2024-01-22T05:22:10.195 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64296.log.gz 2024-01-22T05:22:10.196 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65381.log 2024-01-22T05:22:10.196 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78548.log.gz 2024-01-22T05:22:10.197 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75940.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75940.log.gz 2024-01-22T05:22:10.198 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81149.log 2024-01-22T05:22:10.199 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64811.log 2024-01-22T05:22:10.199 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65381.log.gz 2024-01-22T05:22:10.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71356.log 2024-01-22T05:22:10.200 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.81149.log.gz 2024-01-22T05:22:10.202 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64811.log: gzip -5 --verbose -- 87.7%/var/log/ceph/ceph-client.admin.27969.log -- replaced with /var/log/ceph/ceph-client.admin.64811.log.gz 2024-01-22T05:22:10.202 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-22T05:22:10.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71356.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71356.log.gz 2024-01-22T05:22:10.204 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43048.log 2024-01-22T05:22:10.205 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62598.log 2024-01-22T05:22:10.207 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27969.log.gz 2024-01-22T05:22:10.207 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77287.log 2024-01-22T05:22:10.207 INFO:teuthology.orchestra.run.smithi049.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.43048.log.gz 2024-01-22T05:22:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62598.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62598.log.gz 2024-01-22T05:22:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44830.log 2024-01-22T05:22:10.210 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45614.log 2024-01-22T05:22:10.212 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77287.log: /var/log/ceph/ceph-client.admin.44830.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44830.log.gz 2024-01-22T05:22:10.212 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71652.log 2024-01-22T05:22:10.212 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.77287.log.gz 2024-01-22T05:22:10.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26568.log 2024-01-22T05:22:10.214 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3%/var/log/ceph/ceph-client.admin.71652.log: -- replaced with /var/log/ceph/ceph-client.admin.45614.log.gz 2024-01-22T05:22:10.214 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71652.log.gz 2024-01-22T05:22:10.214 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79241.log 2024-01-22T05:22:10.216 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26568.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.26568.log.gz 2024-01-22T05:22:10.216 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47091.log 2024-01-22T05:22:10.217 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30555.log 2024-01-22T05:22:10.217 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79241.log.gz 2024-01-22T05:22:10.218 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47091.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47091.log.gz 2024-01-22T05:22:10.218 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71735.log 2024-01-22T05:22:10.219 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26650.log 2024-01-22T05:22:10.219 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30555.log.gz 2024-01-22T05:22:10.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71735.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71735.log.gz 2024-01-22T05:22:10.220 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74638.log 2024-01-22T05:22:10.221 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64215.log 2024-01-22T05:22:10.221 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.26650.log.gz 2024-01-22T05:22:10.222 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74638.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74638.log.gz 2024-01-22T05:22:10.222 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26442.log 2024-01-22T05:22:10.223 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27036.log 2024-01-22T05:22:10.223 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64215.log.gz 2024-01-22T05:22:10.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26442.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.26442.log.gz 2024-01-22T05:22:10.224 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72017.log 2024-01-22T05:22:10.226 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48674.log 2024-01-22T05:22:10.226 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27036.log.gz 2024-01-22T05:22:10.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72017.log: gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72017.log.gz 2024-01-22T05:22:10.227 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-01-22T05:22:10.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48674.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48674.log.gz 2024-01-22T05:22:10.228 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65651.log 2024-01-22T05:22:10.229 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49164.log 2024-01-22T05:22:10.230 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65651.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65651.log.gz 2024-01-22T05:22:10.230 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70499.log 2024-01-22T05:22:10.231 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44293.log 2024-01-22T05:22:10.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70499.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.49164.log.gz 2024-01-22T05:22:10.233 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47309.log 2024-01-22T05:22:10.234 INFO:teuthology.orchestra.run.smithi049.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.70499.log.gz 2024-01-22T05:22:10.234 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44293.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44293.log.gz 2024-01-22T05:22:10.234 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49029.log 2024-01-22T05:22:10.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70259.log 2024-01-22T05:22:10.236 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47309.log.gz 2024-01-22T05:22:10.238 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49029.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49029.log.gz 2024-01-22T05:22:10.238 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28996.log 2024-01-22T05:22:10.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43453.log 2024-01-22T05:22:10.240 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70259.log.gz 2024-01-22T05:22:10.240 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28996.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28996.log.gz 2024-01-22T05:22:10.241 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68099.log 2024-01-22T05:22:10.242 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43099.log 2024-01-22T05:22:10.243 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43453.log.gz 2024-01-22T05:22:10.244 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68099.log: gzip -5 --verbose 87.4%-- /var/log/ceph/ceph-client.admin.68126.log -- replaced with /var/log/ceph/ceph-client.admin.68099.log.gz 2024-01-22T05:22:10.244 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-22T05:22:10.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47064.log 2024-01-22T05:22:10.246 INFO:teuthology.orchestra.run.smithi049.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.43099.log.gz 2024-01-22T05:22:10.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28969.log 2024-01-22T05:22:10.247 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68126.log.gz 2024-01-22T05:22:10.248 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73458.log 2024-01-22T05:22:10.248 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47064.log.gz 2024-01-22T05:22:10.249 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28969.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28969.log.gz 2024-01-22T05:22:10.249 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73407.log 2024-01-22T05:22:10.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71706.log 2024-01-22T05:22:10.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73407.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.73458.log.gz 2024-01-22T05:22:10.252 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77017.log 2024-01-22T05:22:10.252 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.73407.log.gz 2024-01-22T05:22:10.253 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65213.log 2024-01-22T05:22:10.254 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71706.log.gz 2024-01-22T05:22:10.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77017.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77017.log.gz 2024-01-22T05:22:10.255 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76261.log 2024-01-22T05:22:10.256 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46834.log 2024-01-22T05:22:10.256 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65213.log.gz 2024-01-22T05:22:10.257 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76261.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76261.log.gz 2024-01-22T05:22:10.257 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26416.log 2024-01-22T05:22:10.258 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46834.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-01-22T05:22:10.259 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46834.log.gz 2024-01-22T05:22:10.260 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26416.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.26416.log.gz 2024-01-22T05:22:10.260 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46726.log 2024-01-22T05:22:10.261 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23099.log 2024-01-22T05:22:10.263 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46726.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46726.log.gz 2024-01-22T05:22:10.263 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30136.log 2024-01-22T05:22:10.264 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.23099.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.23099.log.gz 2024-01-22T05:22:10.264 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45756.log 2024-01-22T05:22:10.266 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81068.log 2024-01-22T05:22:10.266 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30136.log.gz 2024-01-22T05:22:10.267 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29982.log 2024-01-22T05:22:10.268 INFO:teuthology.orchestra.run.smithi049.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.45756.log.gz 2024-01-22T05:22:10.268 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67628.log 2024-01-22T05:22:10.269 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81068.log.gz 2024-01-22T05:22:10.270 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29982.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29982.log.gz 2024-01-22T05:22:10.270 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79864.log 2024-01-22T05:22:10.271 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73536.log 2024-01-22T05:22:10.271 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67628.log.gz 2024-01-22T05:22:10.273 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79864.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.79864.log.gz 2024-01-22T05:22:10.273 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29820.log 2024-01-22T05:22:10.274 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30528.log 2024-01-22T05:22:10.274 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73536.log.gz 2024-01-22T05:22:10.275 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46567.log 2024-01-22T05:22:10.275 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29820.log.gz 2024-01-22T05:22:10.276 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62463.log 2024-01-22T05:22:10.277 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30528.log.gz 2024-01-22T05:22:10.279 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48921.log 2024-01-22T05:22:10.279 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46567.log.gz 2024-01-22T05:22:10.280 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79772.log 2024-01-22T05:22:10.280 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62463.log.gz 2024-01-22T05:22:10.281 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62020.log 2024-01-22T05:22:10.281 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48921.log.gz 2024-01-22T05:22:10.282 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65298.log 2024-01-22T05:22:10.282 INFO:teuthology.orchestra.run.smithi049.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.79772.log.gz 2024-01-22T05:22:10.283 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73617.log 2024-01-22T05:22:10.284 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62020.log.gz 2024-01-22T05:22:10.285 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77662.log 2024-01-22T05:22:10.286 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65298.log.gz 2024-01-22T05:22:10.286 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65132.log 2024-01-22T05:22:10.287 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73617.log.gz 2024-01-22T05:22:10.288 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70421.log 2024-01-22T05:22:10.288 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77662.log.gz 2024-01-22T05:22:10.290 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29955.log 2024-01-22T05:22:10.290 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65132.log.gz 2024-01-22T05:22:10.291 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70421.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70421.log.gz 2024-01-22T05:22:10.291 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49258.log 2024-01-22T05:22:10.292 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79104.log 2024-01-22T05:22:10.292 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29955.log.gz 2024-01-22T05:22:10.293 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.49258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49258.log.gz 2024-01-22T05:22:10.294 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61939.log 2024-01-22T05:22:10.295 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46459.log 2024-01-22T05:22:10.296 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79104.log.gz 2024-01-22T05:22:10.297 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61885.log 2024-01-22T05:22:10.297 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61939.log.gz 2024-01-22T05:22:10.298 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81311.log 2024-01-22T05:22:10.298 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46459.log.gz 2024-01-22T05:22:10.300 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81606.log 2024-01-22T05:22:10.300 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61885.log.gz 2024-01-22T05:22:10.301 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30800.log 2024-01-22T05:22:10.301 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81311.log.gz 2024-01-22T05:22:10.302 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64576.log 2024-01-22T05:22:10.303 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81606.log.gz 2024-01-22T05:22:10.304 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29739.log 2024-01-22T05:22:10.304 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30800.log.gz 2024-01-22T05:22:10.305 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64576.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64576.log.gz 2024-01-22T05:22:10.305 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26901.log 2024-01-22T05:22:10.306 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75059.log 2024-01-22T05:22:10.307 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29739.log.gz 2024-01-22T05:22:10.308 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26901.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.26901.log.gz 2024-01-22T05:22:10.308 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74162.log 2024-01-22T05:22:10.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43769.log 2024-01-22T05:22:10.309 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75059.log.gz 2024-01-22T05:22:10.311 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74162.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.74162.log.gz 2024-01-22T05:22:10.311 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47120.log 2024-01-22T05:22:10.312 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68207.log 2024-01-22T05:22:10.312 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43769.log.gz 2024-01-22T05:22:10.313 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47120.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47120.log.gz 2024-01-22T05:22:10.313 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28104.log 2024-01-22T05:22:10.314 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68890.log 2024-01-22T05:22:10.315 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68207.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68207.log.gz 2024-01-22T05:22:10.315 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28104.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.28104.log.gz 2024-01-22T05:22:10.316 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74924.log 2024-01-22T05:22:10.316 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81527.log 2024-01-22T05:22:10.317 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68890.log.gz 2024-01-22T05:22:10.317 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74924.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74924.log.gz 2024-01-22T05:22:10.318 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74779.log 2024-01-22T05:22:10.319 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71469.log 2024-01-22T05:22:10.320 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81527.log: /var/log/ceph/ceph-client.admin.74779.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81527.log.gz 2024-01-22T05:22:10.320 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74779.log.gz 2024-01-22T05:22:10.320 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64468.log 2024-01-22T05:22:10.321 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27138.log 2024-01-22T05:22:10.322 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71469.log.gz 2024-01-22T05:22:10.322 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64468.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64468.log.gz 2024-01-22T05:22:10.323 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48499.log 2024-01-22T05:22:10.324 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68815.log 2024-01-22T05:22:10.324 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27138.log.gz 2024-01-22T05:22:10.325 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48499.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48499.log.gz 2024-01-22T05:22:10.325 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68420.log 2024-01-22T05:22:10.326 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43399.log 2024-01-22T05:22:10.327 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68815.log.gz 2024-01-22T05:22:10.327 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68420.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68420.log.gz 2024-01-22T05:22:10.328 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65186.log 2024-01-22T05:22:10.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75624.log 2024-01-22T05:22:10.329 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43399.log.gz 2024-01-22T05:22:10.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65186.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65186.log.gz 2024-01-22T05:22:10.330 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44664.log 2024-01-22T05:22:10.331 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76317.log 2024-01-22T05:22:10.332 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75624.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75624.log.gz 2024-01-22T05:22:10.332 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44664.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44664.log.gz 2024-01-22T05:22:10.332 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77341.log 2024-01-22T05:22:10.333 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65624.log 2024-01-22T05:22:10.334 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76317.log.gz 2024-01-22T05:22:10.335 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77341.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77341.log.gz 2024-01-22T05:22:10.335 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80763.log 2024-01-22T05:22:10.336 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26595.log 2024-01-22T05:22:10.336 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65624.log.gz 2024-01-22T05:22:10.337 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80763.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80763.log.gz 2024-01-22T05:22:10.337 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75322.log 2024-01-22T05:22:10.338 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64161.log 2024-01-22T05:22:10.339 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.26595.log.gz 2024-01-22T05:22:10.340 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76021.log 2024-01-22T05:22:10.340 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.75322.log.gz 2024-01-22T05:22:10.341 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48380.log 2024-01-22T05:22:10.341 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64161.log.gz 2024-01-22T05:22:10.343 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28050.log 2024-01-22T05:22:10.343 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76021.log.gz 2024-01-22T05:22:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48380.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48380.log.gz 2024-01-22T05:22:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68503.log 2024-01-22T05:22:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80087.log 2024-01-22T05:22:10.345 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28050.log.gz 2024-01-22T05:22:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68503.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68503.log.gz 2024-01-22T05:22:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70787.log 2024-01-22T05:22:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80087.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-22T05:22:10.349 INFO:teuthology.orchestra.run.smithi049.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.80087.log.gz 2024-01-22T05:22:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64350.log 2024-01-22T05:22:10.350 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70787.log.gz 2024-01-22T05:22:10.351 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78329.log 2024-01-22T05:22:10.353 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64350.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64350.log.gz 2024-01-22T05:22:10.353 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76739.log 2024-01-22T05:22:10.355 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44862.log 2024-01-22T05:22:10.355 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.78329.log.gz 2024-01-22T05:22:10.356 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.76739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.76739.log.gz 2024-01-22T05:22:10.356 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43372.log 2024-01-22T05:22:10.357 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78575.log 2024-01-22T05:22:10.358 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43372.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.44862.log.gz 2024-01-22T05:22:10.358 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43372.log.gz 2024-01-22T05:22:10.359 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67067.log 2024-01-22T05:22:10.360 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67466.log 2024-01-22T05:22:10.360 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78575.log.gz 2024-01-22T05:22:10.361 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72071.log 2024-01-22T05:22:10.361 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67067.log.gz 2024-01-22T05:22:10.363 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70986.log 2024-01-22T05:22:10.363 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67466.log.gz 2024-01-22T05:22:10.364 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64269.log 2024-01-22T05:22:10.364 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.72071.log.gz 2024-01-22T05:22:10.365 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71437.log 2024-01-22T05:22:10.365 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70986.log.gz 2024-01-22T05:22:10.367 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64269.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64269.log.gz 2024-01-22T05:22:10.367 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61750.log 2024-01-22T05:22:10.368 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71437.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.17957.log 2024-01-22T05:22:10.368 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71437.log.gz 2024-01-22T05:22:10.369 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61750.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61750.log.gz 2024-01-22T05:22:10.369 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78002.log 2024-01-22T05:22:10.370 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.tmp-client.admin.17957.log: gzip 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.17957.log.gz-5 2024-01-22T05:22:10.370 INFO:teuthology.orchestra.run.smithi049.stderr:--verbose -- /var/log/ceph/ceph-client.admin.62260.log 2024-01-22T05:22:10.372 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28512.log 87.1% 2024-01-22T05:22:10.372 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78002.log.gz 2024-01-22T05:22:10.373 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62260.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62260.log.gz 2024-01-22T05:22:10.373 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48299.log 2024-01-22T05:22:10.374 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77689.log 2024-01-22T05:22:10.375 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28512.log.gz 2024-01-22T05:22:10.376 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65516.log 2024-01-22T05:22:10.376 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48299.log.gz 2024-01-22T05:22:10.378 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81122.log 2024-01-22T05:22:10.378 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77689.log.gz 2024-01-22T05:22:10.379 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62490.log 2024-01-22T05:22:10.379 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65516.log.gz 2024-01-22T05:22:10.380 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73760.log 2024-01-22T05:22:10.380 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81122.log.gz 2024-01-22T05:22:10.382 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62490.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71302.log 2024-01-22T05:22:10.382 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62490.log.gz 2024-01-22T05:22:10.383 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43426.log 2024-01-22T05:22:10.383 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73760.log.gz 2024-01-22T05:22:10.388 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71302.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71302.log.gz 2024-01-22T05:22:10.388 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70394.log 2024-01-22T05:22:10.388 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71067.log 2024-01-22T05:22:10.388 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43426.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43426.log.gz 2024-01-22T05:22:10.388 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70394.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.70394.log.gz 2024-01-22T05:22:10.388 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61421.log 2024-01-22T05:22:10.389 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62517.log 2024-01-22T05:22:10.389 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71067.log.gz 2024-01-22T05:22:10.389 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75134.log 2024-01-22T05:22:10.390 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.61421.log.gz 2024-01-22T05:22:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62517.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62517.log.gz 2024-01-22T05:22:10.391 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44183.log 2024-01-22T05:22:10.392 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81500.log 2024-01-22T05:22:10.392 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75134.log.gz 2024-01-22T05:22:10.393 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44183.log: gzip -5 88.4%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44183.log.gz/var/log/ceph/ceph-client.admin.64784.log 2024-01-22T05:22:10.393 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-22T05:22:10.395 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81500.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81500.log.gz-5 2024-01-22T05:22:10.395 INFO:teuthology.orchestra.run.smithi049.stderr:--verbose -- /var/log/ceph/ceph-client.admin.74750.log 2024-01-22T05:22:10.396 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49137.log 2024-01-22T05:22:10.397 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64784.log.gz 2024-01-22T05:22:10.397 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74750.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74750.log.gz 2024-01-22T05:22:10.398 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64549.log 2024-01-22T05:22:10.399 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68532.log 2024-01-22T05:22:10.399 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49137.log.gz 2024-01-22T05:22:10.400 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80672.log 2024-01-22T05:22:10.400 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64549.log.gz 2024-01-22T05:22:10.402 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68532.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68532.log.gz 2024-01-22T05:22:10.402 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28185.log 2024-01-22T05:22:10.403 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62679.log 2024-01-22T05:22:10.404 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80672.log.gz 2024-01-22T05:22:10.404 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28185.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28185.log.gz 2024-01-22T05:22:10.404 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47174.log 2024-01-22T05:22:10.405 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71853.log 2024-01-22T05:22:10.406 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62679.log.gz 2024-01-22T05:22:10.407 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47174.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47174.log.gz 2024-01-22T05:22:10.407 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77206.log 2024-01-22T05:22:10.408 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73882.log 2024-01-22T05:22:10.408 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71853.log.gz 2024-01-22T05:22:10.409 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77206.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.77206.log.gz 2024-01-22T05:22:10.409 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74371.log 2024-01-22T05:22:10.410 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27348.log 2024-01-22T05:22:10.411 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73882.log.gz 2024-01-22T05:22:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74371.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74371.log.gz 2024-01-22T05:22:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75967.log 2024-01-22T05:22:10.413 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64711.log 2024-01-22T05:22:10.413 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27348.log.gz 2024-01-22T05:22:10.414 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46197.log 2024-01-22T05:22:10.414 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75967.log.gz 2024-01-22T05:22:10.416 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68936.log 2024-01-22T05:22:10.416 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64711.log.gz 2024-01-22T05:22:10.416 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80591.log 2024-01-22T05:22:10.417 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46197.log.gz 2024-01-22T05:22:10.417 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.68936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68936.log.gz 2024-01-22T05:22:10.418 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29631.log 2024-01-22T05:22:10.420 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80591.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.80591.log.gz 2024-01-22T05:22:10.420 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46861.log 2024-01-22T05:22:10.421 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26816.log 2024-01-22T05:22:10.421 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29631.log.gz 2024-01-22T05:22:10.423 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46861.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46861.log.gz 2024-01-22T05:22:10.423 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27375.log 2024-01-22T05:22:10.424 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61966.log 2024-01-22T05:22:10.424 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.26816.log.gz 2024-01-22T05:22:10.425 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43318.log 2024-01-22T05:22:10.426 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27375.log.gz 2024-01-22T05:22:10.427 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67910.log 2024-01-22T05:22:10.427 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61966.log.gz 2024-01-22T05:22:10.428 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47849.log 2024-01-22T05:22:10.429 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43318.log.gz 2024-01-22T05:22:10.429 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45032.log 2024-01-22T05:22:10.430 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67910.log.gz 2024-01-22T05:22:10.430 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.47849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47849.log.gz 2024-01-22T05:22:10.431 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79716.log 2024-01-22T05:22:10.433 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72044.log 2024-01-22T05:22:10.433 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45032.log.gz 2024-01-22T05:22:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79716.log: gzip 88.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.79716.log.gz--verbose 2024-01-22T05:22:10.434 INFO:teuthology.orchestra.run.smithi049.stderr:-- /var/log/ceph/ceph-client.admin.75913.log 2024-01-22T05:22:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47954.log 2024-01-22T05:22:10.435 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72044.log.gz 2024-01-22T05:22:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75913.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75913.log.gz 2024-01-22T05:22:10.437 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62800.log 2024-01-22T05:22:10.438 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44237.log 2024-01-22T05:22:10.438 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47954.log.gz 2024-01-22T05:22:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.62800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62800.log.gz 2024-01-22T05:22:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29766.log 2024-01-22T05:22:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61615.log 2024-01-22T05:22:10.441 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44237.log.gz 2024-01-22T05:22:10.441 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29766.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29766.log.gz 2024-01-22T05:22:10.442 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70448.log 2024-01-22T05:22:10.443 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44505.log 2024-01-22T05:22:10.444 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61615.log.gz 2024-01-22T05:22:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78945.log 2024-01-22T05:22:10.445 INFO:teuthology.orchestra.run.smithi049.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.70448.log.gz 2024-01-22T05:22:10.446 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28630.log 2024-01-22T05:22:10.446 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44505.log.gz 2024-01-22T05:22:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78945.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78945.log.gz 2024-01-22T05:22:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46170.log 2024-01-22T05:22:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29158.log 2024-01-22T05:22:10.449 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28630.log.gz 2024-01-22T05:22:10.450 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46170.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46170.log.gz 2024-01-22T05:22:10.450 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30466.log 2024-01-22T05:22:10.451 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81041.log 2024-01-22T05:22:10.451 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29158.log.gz 2024-01-22T05:22:10.453 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78602.log 2024-01-22T05:22:10.453 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30466.log.gz 2024-01-22T05:22:10.454 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62074.log 2024-01-22T05:22:10.454 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81041.log.gz 2024-01-22T05:22:10.455 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78602.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78602.log.gz 2024-01-22T05:22:10.456 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67829.log 2024-01-22T05:22:10.456 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45210.log 2024-01-22T05:22:10.457 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62074.log.gz 2024-01-22T05:22:10.458 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47147.log 2024-01-22T05:22:10.458 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67829.log.gz 2024-01-22T05:22:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64377.log 2024-01-22T05:22:10.460 INFO:teuthology.orchestra.run.smithi049.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.45210.log.gz 2024-01-22T05:22:10.461 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28239.log 2024-01-22T05:22:10.461 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47147.log.gz 2024-01-22T05:22:10.462 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64377.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64377.log.gz 2024-01-22T05:22:10.463 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64946.log 2024-01-22T05:22:10.464 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28239.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28239.log.gz 2024-01-22T05:22:10.464 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30746.log 2024-01-22T05:22:10.465 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64946.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64946.log.gz 2024-01-22T05:22:10.466 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80456.log 2024-01-22T05:22:10.467 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76990.log 2024-01-22T05:22:10.467 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30746.log.gz 2024-01-22T05:22:10.468 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80456.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.80456.log.gz 2024-01-22T05:22:10.468 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77395.log 2024-01-22T05:22:10.469 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29536.log 2024-01-22T05:22:10.470 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76990.log.gz 2024-01-22T05:22:10.471 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77395.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.77395.log.gz 2024-01-22T05:22:10.471 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48326.log 2024-01-22T05:22:10.472 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76564.log 2024-01-22T05:22:10.472 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29536.log.gz 2024-01-22T05:22:10.473 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48326.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48326.log.gz 2024-01-22T05:22:10.474 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67229.log 2024-01-22T05:22:10.475 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61696.log 2024-01-22T05:22:10.475 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.76564.log.gz 2024-01-22T05:22:10.476 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67229.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67229.log.gz 2024-01-22T05:22:10.476 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28158.log 2024-01-22T05:22:10.478 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27429.log 2024-01-22T05:22:10.478 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61696.log.gz 2024-01-22T05:22:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28158.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28158.log.gz 2024-01-22T05:22:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71175.log 2024-01-22T05:22:10.480 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73590.log 2024-01-22T05:22:10.480 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27429.log.gz 2024-01-22T05:22:10.481 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71175.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71175.log.gz 2024-01-22T05:22:10.482 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75193.log 2024-01-22T05:22:10.483 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74694.log 2024-01-22T05:22:10.483 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73590.log.gz 2024-01-22T05:22:10.484 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26704.log 2024-01-22T05:22:10.485 INFO:teuthology.orchestra.run.smithi049.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.75193.log.gz 2024-01-22T05:22:10.485 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71229.log 2024-01-22T05:22:10.486 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74694.log.gz 2024-01-22T05:22:10.487 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26704.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-22T05:22:10.487 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.26704.log.gz 2024-01-22T05:22:10.488 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30929.log 2024-01-22T05:22:10.488 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71229.log.gz 2024-01-22T05:22:10.490 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43150.log 2024-01-22T05:22:10.491 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46332.log 2024-01-22T05:22:10.491 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30929.log.gz 2024-01-22T05:22:10.493 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43150.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.43150.log.gz 2024-01-22T05:22:10.493 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-22T05:22:10.494 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46332.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46332.log.gz 2024-01-22T05:22:10.494 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62314.log 2024-01-22T05:22:10.495 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29104.log 2024-01-22T05:22:10.497 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62314.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.62314.log.gz-5 2024-01-22T05:22:10.497 INFO:teuthology.orchestra.run.smithi049.stderr:--verbose -- /var/log/ceph/ceph-client.admin.71882.log 2024-01-22T05:22:10.498 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68153.log 2024-01-22T05:22:10.499 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29104.log.gz 2024-01-22T05:22:10.500 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71882.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71882.log.gz 2024-01-22T05:22:10.500 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81392.log 2024-01-22T05:22:10.501 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48867.log 2024-01-22T05:22:10.501 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68153.log.gz 2024-01-22T05:22:10.503 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81392.log: gzip -5 88.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.81392.log.gz/var/log/ceph/ceph-client.admin.75786.log 2024-01-22T05:22:10.503 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-22T05:22:10.503 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.7.log: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-22T05:22:10.504 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28765.log 2024-01-22T05:22:10.504 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48867.log.gz 2024-01-22T05:22:10.505 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75786.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.75786.log.gz 2024-01-22T05:22:10.505 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30300.log 2024-01-22T05:22:10.507 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77743.log 2024-01-22T05:22:10.507 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28765.log.gz 2024-01-22T05:22:10.508 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80907.log 2024-01-22T05:22:10.508 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30300.log.gz 2024-01-22T05:22:10.509 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77743.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77743.log.gz 2024-01-22T05:22:10.509 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79985.log 2024-01-22T05:22:10.510 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74667.log 2024-01-22T05:22:10.511 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80907.log.gz 2024-01-22T05:22:10.512 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44984.log 2024-01-22T05:22:10.512 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.79985.log.gz 2024-01-22T05:22:10.513 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61912.log 2024-01-22T05:22:10.513 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74667.log.gz 2024-01-22T05:22:10.514 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79837.log 2024-01-22T05:22:10.515 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61912.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44984.log.gz 2024-01-22T05:22:10.516 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61912.log.gz 2024-01-22T05:22:10.516 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80564.log 2024-01-22T05:22:10.517 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74271.log 2024-01-22T05:22:10.517 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.79837.log.gz 2024-01-22T05:22:10.519 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80564.log: gzip 88.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.80564.log.gz-- 2024-01-22T05:22:10.519 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.79673.log 2024-01-22T05:22:10.520 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67547.log 2024-01-22T05:22:10.520 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74271.log.gz 2024-01-22T05:22:10.521 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.79673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.79673.log.gz 2024-01-22T05:22:10.521 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68734.log 2024-01-22T05:22:10.523 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67547.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67547.log.gz 2024-01-22T05:22:10.523 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48620.log 2024-01-22T05:22:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45408.log 2024-01-22T05:22:10.524 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68734.log.gz 2024-01-22T05:22:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48620.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48620.log.gz 2024-01-22T05:22:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68072.log 2024-01-22T05:22:10.527 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48062.log 2024-01-22T05:22:10.527 INFO:teuthology.orchestra.run.smithi049.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.45408.log.gz 2024-01-22T05:22:10.528 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68072.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68072.log.gz 2024-01-22T05:22:10.528 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68366.log 2024-01-22T05:22:10.529 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68761.log 2024-01-22T05:22:10.529 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48062.log.gz 2024-01-22T05:22:10.531 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68366.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68366.log.gz 2024-01-22T05:22:10.531 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46143.log 2024-01-22T05:22:10.532 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44148.log 2024-01-22T05:22:10.532 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68761.log.gz 2024-01-22T05:22:10.533 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46143.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46143.log.gz 2024-01-22T05:22:10.533 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70868.log 2024-01-22T05:22:10.534 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28404.log 2024-01-22T05:22:10.535 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44148.log.gz 2024-01-22T05:22:10.536 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70868.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70868.log.gz 2024-01-22T05:22:10.536 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74027.log 2024-01-22T05:22:10.537 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27456.log 2024-01-22T05:22:10.537 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.28404.log.gz 2024-01-22T05:22:10.538 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74027.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74027.log.gz 2024-01-22T05:22:10.538 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76955.log 2024-01-22T05:22:10.539 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71990.log 2024-01-22T05:22:10.540 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27456.log.gz 2024-01-22T05:22:10.541 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49271.log 2024-01-22T05:22:10.542 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76955.log.gz 2024-01-22T05:22:10.543 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71990.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71990.log.gz 2024-01-22T05:22:10.543 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81095.log 2024-01-22T05:22:10.543 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68393.log 2024-01-22T05:22:10.544 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49271.log.gz 2024-01-22T05:22:10.545 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81095.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.81095.log.gz 2024-01-22T05:22:10.545 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.48145.log 2024-01-22T05:22:10.547 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45459.log 2024-01-22T05:22:10.547 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68393.log.gz 2024-01-22T05:22:10.548 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48145.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30042.log 2024-01-22T05:22:10.549 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48145.log.gz 2024-01-22T05:22:10.549 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48786.log 2024-01-22T05:22:10.550 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30042.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.45459.log.gz 2024-01-22T05:22:10.551 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30042.log.gz 2024-01-22T05:22:10.551 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48701.log 2024-01-22T05:22:10.553 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48786.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.48786.log.gz 2024-01-22T05:22:10.553 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.67337.log 2024-01-22T05:22:10.554 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48701.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48701.log.gz 2024-01-22T05:22:10.554 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26502.log 2024-01-22T05:22:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64838.log 2024-01-22T05:22:10.556 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26502.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.67337.log.gz 2024-01-22T05:22:10.556 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.26502.log.gz 2024-01-22T05:22:10.556 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46305.log 2024-01-22T05:22:10.558 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43888.log 2024-01-22T05:22:10.558 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64838.log.gz 2024-01-22T05:22:10.559 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46305.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46305.log.gz 2024-01-22T05:22:10.559 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76591.log 2024-01-22T05:22:10.560 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76618.log 2024-01-22T05:22:10.561 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43888.log.gz 2024-01-22T05:22:10.562 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47755.log 2024-01-22T05:22:10.562 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76591.log.gz 2024-01-22T05:22:10.564 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65597.log 2024-01-22T05:22:10.564 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76618.log.gz 2024-01-22T05:22:10.565 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64188.log 2024-01-22T05:22:10.565 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47755.log.gz 2024-01-22T05:22:10.567 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65462.log 2024-01-22T05:22:10.567 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65597.log.gz 2024-01-22T05:22:10.567 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29685.log 2024-01-22T05:22:10.568 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64188.log.gz 2024-01-22T05:22:10.569 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65462.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.65462.log.gz 2024-01-22T05:22:10.569 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30584.log 2024-01-22T05:22:10.569 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29685.log: 91.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-01-22T05:22:10.570 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29685.log.gz 2024-01-22T05:22:10.570 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71121.log 2024-01-22T05:22:10.571 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80853.log 2024-01-22T05:22:10.572 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30584.log.gz 2024-01-22T05:22:10.573 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71121.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71121.log.gz 2024-01-22T05:22:10.573 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29509.log 2024-01-22T05:22:10.574 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80853.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80853.log.gz 2024-01-22T05:22:10.574 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45911.log 2024-01-22T05:22:10.575 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67802.log 2024-01-22T05:22:10.576 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29509.log.gz 2024-01-22T05:22:10.577 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74135.log 2024-01-22T05:22:10.578 INFO:teuthology.orchestra.run.smithi049.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.45911.log.gz 2024-01-22T05:22:10.578 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28458.log 2024-01-22T05:22:10.579 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67802.log.gz 2024-01-22T05:22:10.580 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45807.log 2024-01-22T05:22:10.580 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74135.log.gz 2024-01-22T05:22:10.581 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28458.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.28458.log.gz 2024-01-22T05:22:10.581 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44374.log 2024-01-22T05:22:10.582 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80618.log 2024-01-22T05:22:10.583 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44374.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.45807.log.gz 2024-01-22T05:22:10.584 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44210.log 2024-01-22T05:22:10.584 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44374.log.gz 2024-01-22T05:22:10.585 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80618.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80618.log.gz 2024-01-22T05:22:10.585 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74344.log 2024-01-22T05:22:10.587 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75032.log 2024-01-22T05:22:10.587 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44210.log.gz 2024-01-22T05:22:10.588 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74344.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74344.log.gz 2024-01-22T05:22:10.588 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79390.log 2024-01-22T05:22:10.590 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77772.log 2024-01-22T05:22:10.590 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75032.log.gz 2024-01-22T05:22:10.591 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29212.log 2024-01-22T05:22:10.591 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79390.log.gz 2024-01-22T05:22:10.592 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77772.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77772.log.gzgzip 2024-01-22T05:22:10.593 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.30163.log 2024-01-22T05:22:10.594 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28566.log 2024-01-22T05:22:10.594 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29212.log.gz 2024-01-22T05:22:10.596 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30163.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30163.log.gz 2024-01-22T05:22:10.596 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71826.log 2024-01-22T05:22:10.597 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48566.log 2024-01-22T05:22:10.599 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.28566.log.gz 2024-01-22T05:22:10.599 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29077.log 2024-01-22T05:22:10.599 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71826.log.gz 2024-01-22T05:22:10.600 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80537.log 2024-01-22T05:22:10.600 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29077.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48566.log.gz 2024-01-22T05:22:10.601 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29077.log.gz 2024-01-22T05:22:10.601 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48199.log 2024-01-22T05:22:10.603 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46278.log 2024-01-22T05:22:10.603 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.80537.log.gz 2024-01-22T05:22:10.604 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43255.log 2024-01-22T05:22:10.604 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48199.log.gz 2024-01-22T05:22:10.605 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46278.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46278.log.gz 2024-01-22T05:22:10.606 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29482.log 2024-01-22T05:22:10.607 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80699.log 2024-01-22T05:22:10.608 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29482.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.43255.log.gz 2024-01-22T05:22:10.609 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29482.log.gz 2024-01-22T05:22:10.609 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48172.log 2024-01-22T05:22:10.610 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29928.log 2024-01-22T05:22:10.610 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80699.log.gz 2024-01-22T05:22:10.611 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43982.log 88.0% 2024-01-22T05:22:10.612 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48172.log.gz 2024-01-22T05:22:10.613 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75180.log 2024-01-22T05:22:10.613 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29928.log.gz 2024-01-22T05:22:10.614 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43982.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43982.log.gz 2024-01-22T05:22:10.614 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26677.log 2024-01-22T05:22:10.615 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.75180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.75180.log.gz 2024-01-22T05:22:10.616 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46040.log 2024-01-22T05:22:10.617 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48647.log 2024-01-22T05:22:10.618 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.26677.log.gz 2024-01-22T05:22:10.619 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78029.log 2024-01-22T05:22:10.619 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46040.log.gz 2024-01-22T05:22:10.620 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48647.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48647.log.gz 2024-01-22T05:22:10.620 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44347.log 2024-01-22T05:22:10.621 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76346.log 2024-01-22T05:22:10.621 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78029.log.gz 2024-01-22T05:22:10.623 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44347.log: gzip -5 88.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44347.log.gz/var/log/ceph/ceph-client.admin.70959.log 2024-01-22T05:22:10.623 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-22T05:22:10.625 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26870.log 2024-01-22T05:22:10.625 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76346.log.gz 2024-01-22T05:22:10.626 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70959.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70959.log.gz 2024-01-22T05:22:10.626 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45962.log 2024-01-22T05:22:10.627 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67388.log 2024-01-22T05:22:10.627 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.26870.log.gz 2024-01-22T05:22:10.628 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77863.log 2024-01-22T05:22:10.629 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45962.log.gz 2024-01-22T05:22:10.630 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29131.log 2024-01-22T05:22:10.631 INFO:teuthology.orchestra.run.smithi049.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.67388.log.gz 2024-01-22T05:22:10.631 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71202.log 2024-01-22T05:22:10.632 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77863.log.gz 2024-01-22T05:22:10.633 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48593.log 2024-01-22T05:22:10.633 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29131.log.gz 2024-01-22T05:22:10.635 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78864.log 2024-01-22T05:22:10.635 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71202.log.gz 2024-01-22T05:22:10.636 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48593.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48593.log.gz 2024-01-22T05:22:10.636 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27009.log 2024-01-22T05:22:10.637 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29793.log 2024-01-22T05:22:10.637 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78864.log.gz 2024-01-22T05:22:10.639 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28860.log 2024-01-22T05:22:10.639 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.27009.log.gz 2024-01-22T05:22:10.640 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29793.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29793.log.gz 2024-01-22T05:22:10.640 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72165.log 2024-01-22T05:22:10.641 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46386.log 2024-01-22T05:22:10.641 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28860.log.gz 2024-01-22T05:22:10.642 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.72165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.72165.log.gz 2024-01-22T05:22:10.643 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49002.log 2024-01-22T05:22:10.644 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46386.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46386.log.gz 2024-01-22T05:22:10.645 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61525.log 2024-01-22T05:22:10.646 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74000.log 2024-01-22T05:22:10.646 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49002.log.gz 2024-01-22T05:22:10.648 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67856.log 2024-01-22T05:22:10.648 INFO:teuthology.orchestra.run.smithi049.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.61525.log.gz 2024-01-22T05:22:10.649 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61831.log 2024-01-22T05:22:10.650 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74000.log: /var/log/ceph/ceph-client.admin.67856.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74000.log.gz 2024-01-22T05:22:10.651 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43855.log 2024-01-22T05:22:10.651 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67856.log.gz 2024-01-22T05:22:10.652 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48975.log 2024-01-22T05:22:10.652 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61831.log.gz 2024-01-22T05:22:10.653 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43855.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43855.log.gzgzip 2024-01-22T05:22:10.654 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.47228.log 2024-01-22T05:22:10.655 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65435.log 2024-01-22T05:22:10.655 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48975.log.gz 2024-01-22T05:22:10.656 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44266.log 2024-01-22T05:22:10.657 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47228.log.gz 2024-01-22T05:22:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65435.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65435.log.gz 2024-01-22T05:22:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78494.log 2024-01-22T05:22:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30611.log 2024-01-22T05:22:10.659 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44266.log.gz 2024-01-22T05:22:10.660 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78494.log: gzip -5 88.8%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.78494.log.gz/var/log/ceph/ceph-client.admin.70367.log 2024-01-22T05:22:10.660 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-22T05:22:10.662 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71329.log 2024-01-22T05:22:10.662 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30611.log.gz 2024-01-22T05:22:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70367.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70367.log.gzgzip 2024-01-22T05:22:10.664 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.81338.log 2024-01-22T05:22:10.664 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79305.log 2024-01-22T05:22:10.665 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71329.log.gz 2024-01-22T05:22:10.666 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27483.log 2024-01-22T05:22:10.666 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81338.log.gz 2024-01-22T05:22:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79305.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79305.log.gz 2024-01-22T05:22:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81176.log 2024-01-22T05:22:10.668 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81203.log 2024-01-22T05:22:10.669 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27483.log.gz 2024-01-22T05:22:10.670 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65159.log 2024-01-22T05:22:10.670 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.81176.log.gz 2024-01-22T05:22:10.672 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81203.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81203.log.gz 2024-01-22T05:22:10.672 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79131.log 2024-01-22T05:22:10.673 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30854.log 2024-01-22T05:22:10.673 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65159.log.gz 2024-01-22T05:22:10.674 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79131.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79131.log.gz 2024-01-22T05:22:10.675 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47515.log 2024-01-22T05:22:10.676 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29874.log 2024-01-22T05:22:10.676 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.30854.log.gz 2024-01-22T05:22:10.677 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47515.log: gzip -5 87.3%--verbose -- replaced with /var/log/ceph/ceph-client.admin.47515.log.gz-- 2024-01-22T05:22:10.678 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77975.log 2024-01-22T05:22:10.679 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76429.log 2024-01-22T05:22:10.679 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29874.log.gz 2024-01-22T05:22:10.680 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74611.log 2024-01-22T05:22:10.680 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77975.log.gz 2024-01-22T05:22:10.681 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76429.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76429.log.gzgzip 2024-01-22T05:22:10.682 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.78110.log 2024-01-22T05:22:10.683 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30773.log 2024-01-22T05:22:10.683 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74611.log.gz 2024-01-22T05:22:10.684 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67148.log 2024-01-22T05:22:10.684 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78110.log.gz 2024-01-22T05:22:10.686 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30773.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30773.log.gz 2024-01-22T05:22:10.686 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30665.log 2024-01-22T05:22:10.687 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73674.log 2024-01-22T05:22:10.687 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67148.log.gz 2024-01-22T05:22:10.688 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75678.log 2024-01-22T05:22:10.689 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30665.log.gz 2024-01-22T05:22:10.690 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70577.log 2024-01-22T05:22:10.690 INFO:teuthology.orchestra.run.smithi049.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.73674.log.gz 2024-01-22T05:22:10.691 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48466.log 2024-01-22T05:22:10.691 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75678.log.gz 2024-01-22T05:22:10.692 INFO:teuthology.orchestra.run.smithi110.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-22T05:22:10.693 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74951.log 2024-01-22T05:22:10.693 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70577.log.gz 2024-01-22T05:22:10.694 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48466.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48466.log.gz 2024-01-22T05:22:10.694 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47430.log 2024-01-22T05:22:10.695 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74951.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74951.log.gz 2024-01-22T05:22:10.695 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71148.log 2024-01-22T05:22:10.696 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.47430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47430.log.gz 2024-01-22T05:22:10.697 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48840.log 2024-01-22T05:22:10.699 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77422.log 2024-01-22T05:22:10.699 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71148.log.gz 2024-01-22T05:22:10.700 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28377.log 2024-01-22T05:22:10.700 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48840.log.gz 2024-01-22T05:22:10.701 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70232.log 2024-01-22T05:22:10.702 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77422.log.gz 2024-01-22T05:22:10.703 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79158.log 2024-01-22T05:22:10.703 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28377.log.gz 2024-01-22T05:22:10.704 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70232.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70232.log.gz 2024-01-22T05:22:10.704 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67964.log 2024-01-22T05:22:10.706 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62754.log 2024-01-22T05:22:10.706 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79158.log.gz 2024-01-22T05:22:10.707 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67964.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67964.log.gz 2024-01-22T05:22:10.707 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45376.log 2024-01-22T05:22:10.709 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75479.log 2024-01-22T05:22:10.709 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62754.log.gz 2024-01-22T05:22:10.710 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78266.log 2024-01-22T05:22:10.710 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45376.log.gz 2024-01-22T05:22:10.711 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27090.log 2024-01-22T05:22:10.712 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75479.log.gz 2024-01-22T05:22:10.713 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78266.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78266.log.gz 2024-01-22T05:22:10.713 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-01-22T05:22:10.715 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78772.log 2024-01-22T05:22:10.715 INFO:teuthology.orchestra.run.smithi049.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.27090.log.gz 2024-01-22T05:22:10.716 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70130.log 2024-01-22T05:22:10.718 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47927.log 2024-01-22T05:22:10.718 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78772.log.gz 2024-01-22T05:22:10.719 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30975.log 2024-01-22T05:22:10.720 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.70130.log.gz 2024-01-22T05:22:10.720 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74317.log 2024-01-22T05:22:10.721 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47927.log.gz 2024-01-22T05:22:10.721 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.30975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.30975.log.gz 2024-01-22T05:22:10.722 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73909.log 2024-01-22T05:22:10.723 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47255.log 2024-01-22T05:22:10.724 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.74317.log.gz 2024-01-22T05:22:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78737.log 2024-01-22T05:22:10.724 INFO:teuthology.orchestra.run.smithi049.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73909.log.gz 2024-01-22T05:22:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64242.log 2024-01-22T05:22:10.726 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47255.log.gz 2024-01-22T05:22:10.727 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74108.log 2024-01-22T05:22:10.727 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78737.log.gz 2024-01-22T05:22:10.728 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26843.log 2024-01-22T05:22:10.728 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64242.log.gz 2024-01-22T05:22:10.730 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62399.log 2024-01-22T05:22:10.730 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74108.log.gz 2024-01-22T05:22:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27262.log 2024-01-22T05:22:10.732 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.26843.log.gz 2024-01-22T05:22:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64630.log 2024-01-22T05:22:10.733 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62399.log.gz 2024-01-22T05:22:10.736 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48089.log 2024-01-22T05:22:10.736 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77449.log 2024-01-22T05:22:10.736 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64630.log.gz 2024-01-22T05:22:10.736 INFO:teuthology.orchestra.run.smithi049.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.27262.log.gz 2024-01-22T05:22:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44581.log 2024-01-22T05:22:10.737 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48089.log.gz 2024-01-22T05:22:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28266.log 2024-01-22T05:22:10.738 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77449.log.gz 2024-01-22T05:22:10.739 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67684.log 2024-01-22T05:22:10.740 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44581.log.gz 2024-01-22T05:22:10.741 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74841.log 2024-01-22T05:22:10.741 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28266.log.gz 2024-01-22T05:22:10.742 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68339.log 2024-01-22T05:22:10.742 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67684.log.gz 2024-01-22T05:22:10.743 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75994.log 2024-01-22T05:22:10.744 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74841.log.gz 2024-01-22T05:22:10.745 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74425.log 2024-01-22T05:22:10.745 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68339.log.gz 2024-01-22T05:22:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80429.log 2024-01-22T05:22:10.746 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75994.log.gz 2024-01-22T05:22:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47803.log 2024-01-22T05:22:10.748 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.74425.log.gz 2024-01-22T05:22:10.749 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30988.log 2024-01-22T05:22:10.749 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80429.log.gz 2024-01-22T05:22:10.750 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47803.log: gzip -5 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47803.log.gz 2024-01-22T05:22:10.751 INFO:teuthology.orchestra.run.smithi049.stderr:--verbose -- /var/log/ceph/ceph-client.admin.79498.log 2024-01-22T05:22:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28942.log 2024-01-22T05:22:10.752 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.30988.log.gz 2024-01-22T05:22:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44063.log 2024-01-22T05:22:10.753 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79498.log.gz 2024-01-22T05:22:10.755 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30219.log 2024-01-22T05:22:10.755 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28942.log.gz 2024-01-22T05:22:10.756 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68567.log 2024-01-22T05:22:10.756 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44063.log.gz 2024-01-22T05:22:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78191.log 2024-01-22T05:22:10.757 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30219.log.gz 2024-01-22T05:22:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45261.log 2024-01-22T05:22:10.760 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68567.log.gz 2024-01-22T05:22:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79010.log 2024-01-22T05:22:10.760 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78191.log.gz 2024-01-22T05:22:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71013.log 2024-01-22T05:22:10.761 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45261.log.gz 2024-01-22T05:22:10.763 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28323.log 2024-01-22T05:22:10.763 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79010.log.gz 2024-01-22T05:22:10.764 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77098.log 2024-01-22T05:22:10.764 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71013.log.gz 2024-01-22T05:22:10.765 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62571.log 2024-01-22T05:22:10.766 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28323.log.gz 2024-01-22T05:22:10.767 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75086.log 2024-01-22T05:22:10.767 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.77098.log.gz 2024-01-22T05:22:10.768 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67121.log 2024-01-22T05:22:10.768 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62571.log.gz 2024-01-22T05:22:10.770 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75543.log 2024-01-22T05:22:10.770 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.75086.log.gz 2024-01-22T05:22:10.771 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67121.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67121.log.gz 2024-01-22T05:22:10.771 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48759.log 2024-01-22T05:22:10.772 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75543.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.75543.log.gz 2024-01-22T05:22:10.772 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61642.log 2024-01-22T05:22:10.774 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27564.log 2024-01-22T05:22:10.774 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48759.log.gz 2024-01-22T05:22:10.775 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79812.log 2024-01-22T05:22:10.775 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61642.log.gz 2024-01-22T05:22:10.777 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77716.log 2024-01-22T05:22:10.777 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27564.log.gz 2024-01-22T05:22:10.778 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75886.log 2024-01-22T05:22:10.778 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79812.log.gz 2024-01-22T05:22:10.779 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48894.log 2024-01-22T05:22:10.779 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77716.log.gz 2024-01-22T05:22:10.781 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78218.log 2024-01-22T05:22:10.781 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.75886.log.gz 2024-01-22T05:22:10.782 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45989.log 2024-01-22T05:22:10.782 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48894.log.gz 2024-01-22T05:22:10.783 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28023.log 2024-01-22T05:22:10.784 INFO:teuthology.orchestra.run.smithi049.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.78218.log.gz 2024-01-22T05:22:10.785 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64110.log 2024-01-22T05:22:10.785 INFO:teuthology.orchestra.run.smithi049.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.45989.log.gz 2024-01-22T05:22:10.786 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79579.log 2024-01-22T05:22:10.787 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28023.log.gz 2024-01-22T05:22:10.788 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76086.log 2024-01-22T05:22:10.788 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.64110.log.gz 2024-01-22T05:22:10.789 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68180.log 2024-01-22T05:22:10.790 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76086.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.79579.log.gz 2024-01-22T05:22:10.791 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29023.log 2024-01-22T05:22:10.791 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76086.log.gz 2024-01-22T05:22:10.792 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80799.log 2024-01-22T05:22:10.792 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68180.log.gz 2024-01-22T05:22:10.793 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43796.log 2024-01-22T05:22:10.794 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29023.log.gz 2024-01-22T05:22:10.795 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72178.log 2024-01-22T05:22:10.795 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.80799.log.gz 2024-01-22T05:22:10.796 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46513.log 2024-01-22T05:22:10.796 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43796.log.gz 2024-01-22T05:22:10.797 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79471.log 2024-01-22T05:22:10.798 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72178.log.gz 2024-01-22T05:22:10.799 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44779.log 2024-01-22T05:22:10.799 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46513.log.gz 2024-01-22T05:22:10.804 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76234.log 2024-01-22T05:22:10.804 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79471.log.gz 2024-01-22T05:22:10.804 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63955.log 2024-01-22T05:22:10.804 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.44779.log.gz 2024-01-22T05:22:10.804 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76234.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76234.log.gz 2024-01-22T05:22:10.804 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75271.log 2024-01-22T05:22:10.805 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79359.log 2024-01-22T05:22:10.805 INFO:teuthology.orchestra.run.smithi049.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.63955.log.gz 2024-01-22T05:22:10.806 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73701.log 2024-01-22T05:22:10.807 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.75271.log.gz 2024-01-22T05:22:10.807 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71963.log 2024-01-22T05:22:10.807 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79359.log.gz 2024-01-22T05:22:10.808 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44915.log 2024-01-22T05:22:10.809 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73701.log.gz 2024-01-22T05:22:10.810 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78977.log 2024-01-22T05:22:10.810 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71963.log.gz 2024-01-22T05:22:10.811 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30354.log 2024-01-22T05:22:10.811 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44915.log.gz 2024-01-22T05:22:10.813 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81446.log 2024-01-22T05:22:10.813 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78977.log.gz 2024-01-22T05:22:10.814 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78083.log 2024-01-22T05:22:10.814 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30354.log.gz 2024-01-22T05:22:10.815 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79212.log 2024-01-22T05:22:10.816 INFO:teuthology.orchestra.run.smithi049.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.81446.log.gz 2024-01-22T05:22:10.817 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80645.log 2024-01-22T05:22:10.817 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78083.log.gz 2024-01-22T05:22:10.818 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68788.log 2024-01-22T05:22:10.818 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.79212.log.gz 2024-01-22T05:22:10.819 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80645.log: gzip -5 87.5%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.80645.log.gz/var/log/ceph/ceph-client.admin.27591.log 2024-01-22T05:22:10.819 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-22T05:22:10.821 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43588.log 2024-01-22T05:22:10.821 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68788.log.gz 2024-01-22T05:22:10.822 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49083.log 2024-01-22T05:22:10.822 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27591.log.gz 2024-01-22T05:22:10.824 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27402.log 2024-01-22T05:22:10.824 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43588.log.gz 2024-01-22T05:22:10.825 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74189.log 2024-01-22T05:22:10.825 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49083.log.gz 2024-01-22T05:22:10.826 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71502.log 2024-01-22T05:22:10.826 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27402.log.gz 2024-01-22T05:22:10.828 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65489.log 2024-01-22T05:22:10.828 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74189.log.gz 2024-01-22T05:22:10.829 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47336.log 2024-01-22T05:22:10.829 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71502.log.gz 2024-01-22T05:22:10.830 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29847.log 2024-01-22T05:22:10.830 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65489.log.gz 2024-01-22T05:22:10.832 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44119.log 2024-01-22T05:22:10.832 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.47336.log.gz 2024-01-22T05:22:10.833 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64657.log 2024-01-22T05:22:10.833 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29847.log.gz 2024-01-22T05:22:10.834 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28212.log 2024-01-22T05:22:10.834 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44119.log.gz 2024-01-22T05:22:10.836 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47864.log 2024-01-22T05:22:10.836 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64657.log.gz 2024-01-22T05:22:10.837 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43823.log 2024-01-22T05:22:10.837 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28212.log.gz 2024-01-22T05:22:10.838 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62106.log 2024-01-22T05:22:10.839 INFO:teuthology.orchestra.run.smithi049.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.47864.log.gz 2024-01-22T05:22:10.840 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73563.log 2024-01-22T05:22:10.840 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43823.log.gz 2024-01-22T05:22:10.841 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44401.log 2024-01-22T05:22:10.841 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62106.log.gz 2024-01-22T05:22:10.842 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67775.log 2024-01-22T05:22:10.842 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73563.log.gz 2024-01-22T05:22:10.844 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47282.log 2024-01-22T05:22:10.844 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44401.log.gz 2024-01-22T05:22:10.845 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79929.log 2024-01-22T05:22:10.845 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67775.log.gz 2024-01-22T05:22:10.846 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43204.log 2024-01-22T05:22:10.846 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47282.log.gz 2024-01-22T05:22:10.848 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81014.log 2024-01-22T05:22:10.848 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79929.log.gz 2024-01-22T05:22:10.849 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67748.log 2024-01-22T05:22:10.849 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.43204.log.gz 2024-01-22T05:22:10.850 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78683.log 2024-01-22T05:22:10.850 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81014.log.gz 2024-01-22T05:22:10.851 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68621.log 2024-01-22T05:22:10.852 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67748.log.gz 2024-01-22T05:22:10.853 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79958.log 2024-01-22T05:22:10.853 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78683.log.gz 2024-01-22T05:22:10.854 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30692.log 2024-01-22T05:22:10.854 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68621.log.gz 2024-01-22T05:22:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28131.log 2024-01-22T05:22:10.856 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79958.log.gz 2024-01-22T05:22:10.857 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80483.log 2024-01-22T05:22:10.857 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30692.log.gz 2024-01-22T05:22:10.858 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67937.log 2024-01-22T05:22:10.858 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28131.log.gz 2024-01-22T05:22:10.860 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74897.log 2024-01-22T05:22:10.860 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80483.log.gz 2024-01-22T05:22:10.861 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27996.log 2024-01-22T05:22:10.861 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67937.log.gz 2024-01-22T05:22:10.862 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76180.log 2024-01-22T05:22:10.862 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74897.log.gz 2024-01-22T05:22:10.864 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77071.log 2024-01-22T05:22:10.864 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27996.log.gz 2024-01-22T05:22:10.865 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44320.log 2024-01-22T05:22:10.865 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76180.log.gz 2024-01-22T05:22:10.866 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74054.log 2024-01-22T05:22:10.866 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77071.log.gz 2024-01-22T05:22:10.868 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.28743.log 2024-01-22T05:22:10.868 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44320.log.gz 2024-01-22T05:22:10.869 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48008.log 2024-01-22T05:22:10.869 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74054.log.gz 2024-01-22T05:22:10.870 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.28743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.28743.log.gz 2024-01-22T05:22:10.871 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70655.log 2024-01-22T05:22:10.872 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47454.log 2024-01-22T05:22:10.872 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48008.log.gz 2024-01-22T05:22:10.873 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62706.log 2024-01-22T05:22:10.873 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.70655.log.gz 2024-01-22T05:22:10.875 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48035.log 2024-01-22T05:22:10.875 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47454.log.gz 2024-01-22T05:22:10.876 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81257.log 2024-01-22T05:22:10.876 INFO:teuthology.orchestra.run.smithi049.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.62706.log.gz 2024-01-22T05:22:10.877 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48035.log: gzip 88.4%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.48035.log.gz-- 2024-01-22T05:22:10.877 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78521.log 2024-01-22T05:22:10.879 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66914.log 2024-01-22T05:22:10.879 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81257.log.gz 2024-01-22T05:22:10.880 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45288.log 2024-01-22T05:22:10.880 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78521.log.gz 2024-01-22T05:22:10.882 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.66914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73946.log 2024-01-22T05:22:10.882 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.66914.log.gz 2024-01-22T05:22:10.883 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80295.log 2024-01-22T05:22:10.883 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45288.log.gz 2024-01-22T05:22:10.884 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28431.log 2024-01-22T05:22:10.884 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.73946.log.gz 2024-01-22T05:22:10.886 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76402.log 2024-01-22T05:22:10.886 INFO:teuthology.orchestra.run.smithi049.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.80295.log.gz 2024-01-22T05:22:10.887 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26787.log 2024-01-22T05:22:10.887 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28431.log.gz 2024-01-22T05:22:10.888 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71909.log 2024-01-22T05:22:10.888 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76402.log.gz 2024-01-22T05:22:10.890 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48226.log 2024-01-22T05:22:10.890 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.26787.log.gz 2024-01-22T05:22:10.891 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67657.log 2024-01-22T05:22:10.891 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.71909.log.gz 2024-01-22T05:22:10.892 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68239.log 2024-01-22T05:22:10.892 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48226.log.gz 2024-01-22T05:22:10.894 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30881.log 2024-01-22T05:22:10.894 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67657.log.gz 2024-01-22T05:22:10.895 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68239.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68239.log.gz 2024-01-22T05:22:10.895 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27888.log 2024-01-22T05:22:10.897 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71383.log 2024-01-22T05:22:10.897 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.30881.log.gz 2024-01-22T05:22:10.898 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48730.log 2024-01-22T05:22:10.898 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27888.log.gz 2024-01-22T05:22:10.899 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76801.log 87.7% 2024-01-22T05:22:10.899 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71383.log.gz 2024-01-22T05:22:10.901 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75428.log 2024-01-22T05:22:10.901 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48730.log.gz 2024-01-22T05:22:10.902 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45731.log 2024-01-22T05:22:10.902 INFO:teuthology.orchestra.run.smithi049.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.76801.log.gz 2024-01-22T05:22:10.903 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45510.log 2024-01-22T05:22:10.904 INFO:teuthology.orchestra.run.smithi049.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.75428.log.gz 2024-01-22T05:22:10.905 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78710.log 2024-01-22T05:22:10.905 INFO:teuthology.orchestra.run.smithi049.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45731.log.gz 2024-01-22T05:22:10.906 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77836.log 2024-01-22T05:22:10.906 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.45510.log.gz 2024-01-22T05:22:10.908 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29428.log 2024-01-22T05:22:10.908 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78710.log.gz 2024-01-22T05:22:10.909 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80036.log 2024-01-22T05:22:10.909 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77836.log.gz 2024-01-22T05:22:10.910 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29604.log 2024-01-22T05:22:10.910 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29428.log.gz 2024-01-22T05:22:10.912 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47981.log 2024-01-22T05:22:10.912 INFO:teuthology.orchestra.run.smithi049.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.80036.log.gz 2024-01-22T05:22:10.913 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73816.log 2024-01-22T05:22:10.913 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29604.log.gz 2024-01-22T05:22:10.914 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62047.log 2024-01-22T05:22:10.914 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47981.log.gz 2024-01-22T05:22:10.916 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78164.log 2024-01-22T05:22:10.916 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73816.log.gz 2024-01-22T05:22:10.917 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70604.log 2024-01-22T05:22:10.917 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62047.log.gz 2024-01-22T05:22:10.918 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80960.log 2024-01-22T05:22:10.919 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.78164.log.gz 2024-01-22T05:22:10.920 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80191.log 2024-01-22T05:22:10.920 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.70604.log.gz 2024-01-22T05:22:10.921 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75516.log 2024-01-22T05:22:10.921 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.80960.log.gz 2024-01-22T05:22:10.922 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67574.log 2024-01-22T05:22:10.923 INFO:teuthology.orchestra.run.smithi049.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.80191.log.gz 2024-01-22T05:22:10.924 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76826.log 2024-01-22T05:22:10.924 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75516.log.gz 2024-01-22T05:22:10.925 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68707.log 2024-01-22T05:22:10.925 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67574.log.gz 2024-01-22T05:22:10.926 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30273.log 2024-01-22T05:22:10.927 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.76826.log.gz 2024-01-22T05:22:10.928 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70895.log 2024-01-22T05:22:10.928 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68707.log.gz 2024-01-22T05:22:10.929 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61858.log 2024-01-22T05:22:10.929 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30273.log.gz 2024-01-22T05:22:10.931 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65011.log 2024-01-22T05:22:10.931 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70895.log.gz 2024-01-22T05:22:10.932 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28077.log 2024-01-22T05:22:10.932 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61858.log.gz 2024-01-22T05:22:10.933 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80346.log 2024-01-22T05:22:10.933 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65011.log.gz 2024-01-22T05:22:10.935 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76153.log 2024-01-22T05:22:10.935 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28077.log.gz 2024-01-22T05:22:10.936 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61370.log 2024-01-22T05:22:10.936 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.80346.log.gz 2024-01-22T05:22:10.937 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48434.log 2024-01-22T05:22:10.937 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76153.log.gz 2024-01-22T05:22:10.939 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47514.log 2024-01-22T05:22:10.939 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61370.log.gz 2024-01-22T05:22:10.940 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29374.log 2024-01-22T05:22:10.940 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48434.log.gz 2024-01-22T05:22:10.941 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47520.log 2024-01-22T05:22:10.941 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47514.log.gz 2024-01-22T05:22:10.943 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64404.log 2024-01-22T05:22:10.943 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29374.log.gz 2024-01-22T05:22:10.944 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77368.log 2024-01-22T05:22:10.944 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47520.log.gz 2024-01-22T05:22:10.945 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29266.log 2024-01-22T05:22:10.945 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64404.log.gz 2024-01-22T05:22:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30719.log 2024-01-22T05:22:10.947 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77368.log.gz 2024-01-22T05:22:10.948 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27861.log 2024-01-22T05:22:10.948 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29266.log.gz 2024-01-22T05:22:10.949 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81419.log 2024-01-22T05:22:10.949 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.30719.log.gz 2024-01-22T05:22:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27861.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27861.log.gz 2024-01-22T05:22:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80826.log 2024-01-22T05:22:10.952 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80242.log 2024-01-22T05:22:10.952 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81419.log.gz 2024-01-22T05:22:10.953 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75597.log 2024-01-22T05:22:10.953 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.80826.log.gz 2024-01-22T05:22:10.955 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75244.log 2024-01-22T05:22:10.955 INFO:teuthology.orchestra.run.smithi049.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.80242.log.gz 2024-01-22T05:22:10.956 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77541.log 2024-01-22T05:22:10.956 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75597.log.gz 2024-01-22T05:22:10.957 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81579.log 2024-01-22T05:22:10.957 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75244.log.gz 2024-01-22T05:22:10.959 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77125.log 2024-01-22T05:22:10.959 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77541.log.gz 2024-01-22T05:22:10.960 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78629.log 2024-01-22T05:22:10.960 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81579.log.gz 2024-01-22T05:22:10.962 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46807.log 2024-01-22T05:22:10.962 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77125.log.gz 2024-01-22T05:22:10.963 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78629.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78629.log.gz 2024-01-22T05:22:10.963 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28888.log 2024-01-22T05:22:10.964 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64892.log 2024-01-22T05:22:10.965 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46807.log.gz 2024-01-22T05:22:10.966 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78137.log 2024-01-22T05:22:10.966 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28888.log.gz 2024-01-22T05:22:10.967 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77476.log 2024-01-22T05:22:10.968 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64892.log.gz 2024-01-22T05:22:10.968 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67721.log 2024-01-22T05:22:10.969 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78137.log.gz 2024-01-22T05:22:10.970 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77233.log 2024-01-22T05:22:10.970 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77476.log.gz 2024-01-22T05:22:10.971 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67721.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67721.log.gz 2024-01-22T05:22:10.971 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-22T05:22:10.973 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64495.log 2024-01-22T05:22:10.973 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.77233.log.gz 2024-01-22T05:22:10.974 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30437.log 2024-01-22T05:22:10.976 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27063.log 2024-01-22T05:22:10.976 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64495.log.gz 2024-01-22T05:22:10.977 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30437.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30437.log.gz 2024-01-22T05:22:10.978 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76931.log 2024-01-22T05:22:10.978 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27063.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27063.log.gz 2024-01-22T05:22:10.978 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-22T05:22:10.979 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46224.log 2024-01-22T05:22:10.980 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43345.log 2024-01-22T05:22:10.980 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76931.log.gz 2024-01-22T05:22:10.982 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79185.log 2024-01-22T05:22:10.982 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46224.log.gz 2024-01-22T05:22:10.983 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46089.log 2024-01-22T05:22:10.983 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43345.log.gz 2024-01-22T05:22:10.984 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48271.log 2024-01-22T05:22:10.984 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79185.log.gz 2024-01-22T05:22:10.986 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70733.log 2024-01-22T05:22:10.986 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46089.log.gz 2024-01-22T05:22:10.987 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67310.log 2024-01-22T05:22:10.987 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48271.log.gz 2024-01-22T05:22:10.988 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47037.log 2024-01-22T05:22:10.988 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70733.log.gz 2024-01-22T05:22:10.989 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62625.log 2024-01-22T05:22:10.990 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67310.log.gz 2024-01-22T05:22:10.991 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78056.log 2024-01-22T05:22:10.991 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47037.log.gz 2024-01-22T05:22:10.992 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65105.log 2024-01-22T05:22:10.992 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62625.log.gz 2024-01-22T05:22:10.994 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44090.log 2024-01-22T05:22:10.994 INFO:teuthology.orchestra.run.smithi049.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.78056.log.gz 2024-01-22T05:22:10.995 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65105.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-22T05:22:10.995 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65105.log.gz 2024-01-22T05:22:10.996 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26982.log 2024-01-22T05:22:10.996 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44090.log.gz 2024-01-22T05:22:10.998 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47483.log 2024-01-22T05:22:10.999 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26982.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.26982.log.gz 2024-01-22T05:22:10.999 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27915.log 2024-01-22T05:22:11.001 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45339.log 2024-01-22T05:22:11.001 INFO:teuthology.orchestra.run.smithi049.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47483.log.gz 2024-01-22T05:22:11.002 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26955.log 2024-01-22T05:22:11.002 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27915.log.gz 2024-01-22T05:22:11.004 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45339.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71410.log 2024-01-22T05:22:11.004 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45339.log.gz 2024-01-22T05:22:11.008 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26955.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.26955.log.gz 2024-01-22T05:22:11.008 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67175.log 2024-01-22T05:22:11.008 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71410.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71410.log.gz 2024-01-22T05:22:11.008 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79417.log 2024-01-22T05:22:11.008 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76877.log 2024-01-22T05:22:11.008 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67175.log.gz 2024-01-22T05:22:11.009 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65271.log 2024-01-22T05:22:11.009 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79417.log.gz 2024-01-22T05:22:11.011 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70079.log 2024-01-22T05:22:11.011 INFO:teuthology.orchestra.run.smithi049.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.76877.log.gz 2024-01-22T05:22:11.012 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65271.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65271.log.gz 2024-01-22T05:22:11.012 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29347.log 2024-01-22T05:22:11.014 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64603.log 2024-01-22T05:22:11.014 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.70079.log.gz 2024-01-22T05:22:11.015 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29347.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29347.log.gz 2024-01-22T05:22:11.016 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64603.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64603.log.gz 2024-01-22T05:22:11.017 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43644.log 2024-01-22T05:22:11.018 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46486.log 2024-01-22T05:22:11.020 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27834.log 2024-01-22T05:22:11.020 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43644.log.gz 2024-01-22T05:22:11.021 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76537.log 2024-01-22T05:22:11.021 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46486.log.gz 2024-01-22T05:22:11.023 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46594.log 2024-01-22T05:22:11.023 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27834.log.gz 2024-01-22T05:22:11.024 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79525.log 2024-01-22T05:22:11.024 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76537.log.gz 2024-01-22T05:22:11.025 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46594.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46594.log.gz 2024-01-22T05:22:11.025 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77179.log 2024-01-22T05:22:11.027 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78467.log 2024-01-22T05:22:11.027 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79525.log.gz 2024-01-22T05:22:11.028 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70313.log 2024-01-22T05:22:11.028 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77179.log.gz 2024-01-22T05:22:11.030 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68045.log 2024-01-22T05:22:11.030 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78467.log.gz 2024-01-22T05:22:11.031 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70313.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70313.log.gz 2024-01-22T05:22:11.031 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68842.log 2024-01-22T05:22:11.032 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68680.log 2024-01-22T05:22:11.032 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68045.log.gz 2024-01-22T05:22:11.034 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30192.log 2024-01-22T05:22:11.034 INFO:teuthology.orchestra.run.smithi049.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.68842.log.gz 2024-01-22T05:22:11.035 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68680.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68680.log.gz 2024-01-22T05:22:11.036 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29712.log 2024-01-22T05:22:11.037 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30192.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30192.log.gz 2024-01-22T05:22:11.037 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81284.log 2024-01-22T05:22:11.039 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75570.log 2024-01-22T05:22:11.039 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29712.log.gz 2024-01-22T05:22:11.040 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81284.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81284.log.gz 2024-01-22T05:22:11.041 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75570.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75570.log.gz 2024-01-22T05:22:11.042 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2024-01-22T05:22:11.043 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67991.log 2024-01-22T05:22:11.045 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78891.log 2024-01-22T05:22:11.045 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2024-01-22T05:22:11.046 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76777.log 2024-01-22T05:22:11.046 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67991.log.gz 2024-01-22T05:22:11.047 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47008.log 2024-01-22T05:22:11.048 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78891.log.gz 2024-01-22T05:22:11.049 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76777.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.76777.log.gz 2024-01-22T05:22:11.049 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74814.log 2024-01-22T05:22:11.050 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47008.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47008.log.gz 2024-01-22T05:22:11.050 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77508.log 2024-01-22T05:22:11.052 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74868.log 2024-01-22T05:22:11.052 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74814.log.gz 2024-01-22T05:22:11.053 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80880.log 2024-01-22T05:22:11.054 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77508.log.gz 2024-01-22T05:22:11.055 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71571.log 2024-01-22T05:22:11.055 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.74868.log.gz 2024-01-22T05:22:11.056 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80880.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80880.log.gz 2024-01-22T05:22:11.057 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71571.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71571.log.gz 2024-01-22T05:22:11.058 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65078.log 2024-01-22T05:22:11.059 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68474.log 2024-01-22T05:22:11.061 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64919.log 2024-01-22T05:22:11.061 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65078.log.gz 2024-01-22T05:22:11.062 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68474.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68474.log.gz 2024-01-22T05:22:11.063 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64919.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64919.log.gz 2024-01-22T05:22:11.064 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28539.log 2024-01-22T05:22:11.065 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29401.log 2024-01-22T05:22:11.067 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28539.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.28539.log.gz-5 2024-01-22T05:22:11.067 INFO:teuthology.orchestra.run.smithi049.stderr:--verbose -- /var/log/ceph/ceph-client.admin.73855.log 2024-01-22T05:22:11.068 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47384.log 2024-01-22T05:22:11.068 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29401.log.gz 2024-01-22T05:22:11.069 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61804.log 2024-01-22T05:22:11.070 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.73855.log.gz 2024-01-22T05:22:11.071 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47384.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47384.log.gz 2024-01-22T05:22:11.071 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68650.log 2024-01-22T05:22:11.072 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61804.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61804.log.gz 2024-01-22T05:22:11.073 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79444.log 2024-01-22T05:22:11.074 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48353.log 2024-01-22T05:22:11.074 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68650.log.gz 2024-01-22T05:22:11.075 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22973.log 2024-01-22T05:22:11.076 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79444.log.gz 2024-01-22T05:22:11.077 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71256.log 2024-01-22T05:22:11.077 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48353.log.gz 2024-01-22T05:22:11.078 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.22973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29050.log 2024-01-22T05:22:11.078 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.22973.log.gz 2024-01-22T05:22:11.080 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30381.log 2024-01-22T05:22:11.080 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71256.log.gz 2024-01-22T05:22:11.081 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70932.log 2024-01-22T05:22:11.081 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29050.log.gz 2024-01-22T05:22:11.083 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79077.log 2024-01-22T05:22:11.083 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30381.log.gz 2024-01-22T05:22:11.084 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70932.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70932.log.gz 2024-01-22T05:22:11.085 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79077.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79077.log.gz 2024-01-22T05:22:11.086 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75651.log 2024-01-22T05:22:11.087 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48407.log 2024-01-22T05:22:11.088 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29185.log 2024-01-22T05:22:11.088 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75651.log.gz 2024-01-22T05:22:11.090 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67256.log 2024-01-22T05:22:11.090 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48407.log.gz 2024-01-22T05:22:11.091 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67094.log 2024-01-22T05:22:11.091 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29185.log.gz 2024-01-22T05:22:11.093 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68272.log 2024-01-22T05:22:11.093 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67256.log.gz 2024-01-22T05:22:11.094 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67094.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67094.log.gz 2024-01-22T05:22:11.095 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68447.log 2024-01-22T05:22:11.096 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68272.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.68272.log.gz-5 2024-01-22T05:22:11.096 INFO:teuthology.orchestra.run.smithi049.stderr:--verbose -- /var/log/ceph/ceph-client.admin.44949.log 2024-01-22T05:22:11.097 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44036.log 2024-01-22T05:22:11.097 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68447.log.gz 2024-01-22T05:22:11.098 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79627.log 2024-01-22T05:22:11.098 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44949.log.gz 2024-01-22T05:22:11.100 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44036.log: gzip -5 87.6%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44036.log.gz 2024-01-22T05:22:11.100 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75732.log 2024-01-22T05:22:11.101 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79627.log: gzip 87.9%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.79627.log.gz-- 2024-01-22T05:22:11.101 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77801.log 2024-01-22T05:22:11.102 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29239.log 2024-01-22T05:22:11.103 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.75732.log.gz 2024-01-22T05:22:11.104 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46780.log 2024-01-22T05:22:11.104 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77801.log.gz 2024-01-22T05:22:11.105 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77890.log 2024-01-22T05:22:11.105 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29239.log.gz 2024-01-22T05:22:11.107 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71764.log 2024-01-22T05:22:11.107 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46780.log.gz 2024-01-22T05:22:11.108 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47201.log 2024-01-22T05:22:11.108 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77890.log.gz 2024-01-22T05:22:11.110 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27321.log 2024-01-22T05:22:11.110 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71764.log.gz 2024-01-22T05:22:11.111 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47201.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47201.log.gz 2024-01-22T05:22:11.113 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27321.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27321.log.gz 2024-01-22T05:22:11.113 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81554.log 2024-01-22T05:22:11.114 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64006.log 2024-01-22T05:22:11.115 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29577.log 2024-01-22T05:22:11.116 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81554.log.gz 2024-01-22T05:22:11.117 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26758.log 2024-01-22T05:22:11.117 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.64006.log.gz 2024-01-22T05:22:11.118 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29577.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29577.log.gz 2024-01-22T05:22:11.118 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70286.log 2024-01-22T05:22:11.119 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26758.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.26758.log.gz 2024-01-22T05:22:11.120 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62233.log 2024-01-22T05:22:11.121 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64441.log 2024-01-22T05:22:11.121 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70286.log.gz 2024-01-22T05:22:11.123 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62233.log: gzip -5 --verbose -- 88.4%/var/log/ceph/ceph-client.admin.70841.log -- replaced with /var/log/ceph/ceph-client.admin.62233.log.gz 2024-01-22T05:22:11.123 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-22T05:22:11.124 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46413.log 2024-01-22T05:22:11.124 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64441.log.gz 2024-01-22T05:22:11.125 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70841.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70841.log.gz 2024-01-22T05:22:11.127 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46413.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46413.log.gz 2024-01-22T05:22:11.127 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29293.log 2024-01-22T05:22:11.128 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74584.log 2024-01-22T05:22:11.130 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76375.log 2024-01-22T05:22:11.130 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29293.log.gz 2024-01-22T05:22:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49056.log 2024-01-22T05:22:11.131 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74584.log.gz 2024-01-22T05:22:11.133 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78312.log 2024-01-22T05:22:11.133 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76375.log.gz 2024-01-22T05:22:11.134 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49056.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49056.log.gz 2024-01-22T05:22:11.135 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.78312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.78312.log.gz 2024-01-22T05:22:11.135 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47726.log 2024-01-22T05:22:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-22T05:22:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26623.log 2024-01-22T05:22:11.140 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47726.log.gz 2024-01-22T05:22:11.141 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28485.log 2024-01-22T05:22:11.141 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26623.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.26623.log.gz 2024-01-22T05:22:11.142 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28293.log 2024-01-22T05:22:11.143 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28485.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28485.log.gz 2024-01-22T05:22:11.144 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28293.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28293.log.gz 2024-01-22T05:22:11.145 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44747.log 2024-01-22T05:22:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77314.log 2024-01-22T05:22:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44747.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44747.log.gz 2024-01-22T05:22:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77314.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77314.log.gz 2024-01-22T05:22:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76456.log 2024-01-22T05:22:11.151 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64978.log 2024-01-22T05:22:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76456.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.76456.log.gz 2024-01-22T05:22:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64978.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64978.log.gz 2024-01-22T05:22:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46540.log 2024-01-22T05:22:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45159.log 2024-01-22T05:22:11.157 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46540.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46540.log.gz 2024-01-22T05:22:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45159.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.45159.log.gz 2024-01-22T05:22:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78810.log 2024-01-22T05:22:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27942.log 2024-01-22T05:22:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78810.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.78810.log.gz 2024-01-22T05:22:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27645.log 2024-01-22T05:22:11.165 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27942.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27942.log.gz 2024-01-22T05:22:11.165 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46954.log 2024-01-22T05:22:11.165 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27645.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27645.log.gz 2024-01-22T05:22:11.167 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46954.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46954.log.gz 2024-01-22T05:22:11.168 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47519.log 2024-01-22T05:22:11.169 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27672.log 2024-01-22T05:22:11.171 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47519.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47519.log.gz 2024-01-22T05:22:11.172 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27672.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27672.log.gz 2024-01-22T05:22:11.172 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44696.log 2024-01-22T05:22:11.174 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76288.log 2024-01-22T05:22:11.177 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44696.log: /var/log/ceph/ceph-client.admin.76288.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.44696.log.gz 2024-01-22T05:22:11.177 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.76288.log.gz 2024-01-22T05:22:11.177 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75005.log 2024-01-22T05:22:11.178 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67520.log 2024-01-22T05:22:11.180 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75005.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.75005.log.gz 2024-01-22T05:22:11.181 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67520.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67520.log.gz 2024-01-22T05:22:11.181 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80987.log 2024-01-22T05:22:11.183 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67601.log 2024-01-22T05:22:11.185 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80987.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.80987.log.gz 2024-01-22T05:22:11.185 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67601.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67601.log.gz 2024-01-22T05:22:11.186 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27537.log 2024-01-22T05:22:11.188 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43615.log 2024-01-22T05:22:11.189 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27537.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27537.log.gz 2024-01-22T05:22:11.190 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43615.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43615.log.gz 2024-01-22T05:22:11.191 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45648.log 2024-01-22T05:22:11.192 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77635.log 2024-01-22T05:22:11.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45648.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45648.log.gz 2024-01-22T05:22:11.194 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80140.log 2024-01-22T05:22:11.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77635.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77635.log.gz 2024-01-22T05:22:11.198 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79902.log 2024-01-22T05:22:11.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80140.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.80140.log.gz 2024-01-22T05:22:11.199 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79902.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79902.log.gz 2024-01-22T05:22:11.199 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74519.log 2024-01-22T05:22:11.201 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79748.log 2024-01-22T05:22:11.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74519.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.74519.log.gz 2024-01-22T05:22:11.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79748.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79748.log.gz 2024-01-22T05:22:11.204 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64057.log 2024-01-22T05:22:11.206 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73356.log 2024-01-22T05:22:11.208 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64057.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.64057.log.gz 2024-01-22T05:22:11.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73356.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.73356.log.gz 2024-01-22T05:22:11.209 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43507.log 2024-01-22T05:22:11.211 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45561.log 2024-01-22T05:22:11.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43507.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43507.log.gz 2024-01-22T05:22:11.214 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45561.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.45561.log.gz 2024-01-22T05:22:11.214 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44428.log 2024-01-22T05:22:11.216 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30501.log 2024-01-22T05:22:11.218 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44428.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44428.log.gz 2024-01-22T05:22:11.218 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77152.log 2024-01-22T05:22:11.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30501.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30501.log.gz 2024-01-22T05:22:11.220 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29320.log 2024-01-22T05:22:11.221 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77152.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.77152.log.gz 2024-01-22T05:22:11.223 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.29320.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29320.log.gz 2024-01-22T05:22:11.223 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61319.log 2024-01-22T05:22:11.225 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77260.log 2024-01-22T05:22:11.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61319.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.61319.log.gz 2024-01-22T05:22:11.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77260.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77260.log.gz 2024-01-22T05:22:11.228 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27807.log 2024-01-22T05:22:11.229 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80726.log 2024-01-22T05:22:11.231 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27807.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27807.log.gz 2024-01-22T05:22:11.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80726.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80726.log.gz 2024-01-22T05:22:11.232 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78837.log 2024-01-22T05:22:11.234 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62139.log 2024-01-22T05:22:11.235 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78837.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78837.log.gz 2024-01-22T05:22:11.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62139.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62139.log.gz 2024-01-22T05:22:11.237 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74452.log 2024-01-22T05:22:11.238 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81365.log 2024-01-22T05:22:11.240 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74452.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74452.log.gz 2024-01-22T05:22:11.241 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81365.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81365.log.gz 2024-01-22T05:22:11.241 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46116.log 2024-01-22T05:22:11.243 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62434.log 2024-01-22T05:22:11.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46116.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46116.log.gz 2024-01-22T05:22:11.246 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62434.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62434.log.gz 2024-01-22T05:22:11.246 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65726.log 2024-01-22T05:22:11.248 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46981.log 2024-01-22T05:22:11.249 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65726.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65726.log.gz 2024-01-22T05:22:11.250 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46981.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46981.log.gz 2024-01-22T05:22:11.251 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75813.log 2024-01-22T05:22:11.252 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62370.log 2024-01-22T05:22:11.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75813.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75813.log.gz 2024-01-22T05:22:11.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62370.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62370.log.gz 2024-01-22T05:22:11.255 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76207.log 2024-01-22T05:22:11.257 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43534.log 2024-01-22T05:22:11.258 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76207.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76207.log.gz 2024-01-22T05:22:11.260 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43534.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43534.log.gz 2024-01-22T05:22:11.260 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80373.log 2024-01-22T05:22:11.261 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43742.log 2024-01-22T05:22:11.263 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80373.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.80373.log.gz 2024-01-22T05:22:11.264 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43742.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43742.log.gz 2024-01-22T05:22:11.264 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45683.log 2024-01-22T05:22:11.266 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61777.log 2024-01-22T05:22:11.268 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45683.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45683.log.gz 2024-01-22T05:22:11.269 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61777.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61777.log.gz 2024-01-22T05:22:11.269 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79270.log 2024-01-22T05:22:11.271 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27780.log 2024-01-22T05:22:11.272 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79270.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79270.log.gz 2024-01-22T05:22:11.273 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27780.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27780.log.gz 2024-01-22T05:22:11.274 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27510.log 2024-01-22T05:22:11.275 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30408.log 2024-01-22T05:22:11.277 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27510.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27510.log.gz 2024-01-22T05:22:11.278 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30408.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30408.log.gz 2024-01-22T05:22:11.278 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30009.log 2024-01-22T05:22:11.280 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45108.log 2024-01-22T05:22:11.281 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30009.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30009.log.gz 2024-01-22T05:22:11.283 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45108.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.45108.log.gz 2024-01-22T05:22:11.283 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64865.log 2024-01-22T05:22:11.285 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74216.log 2024-01-22T05:22:11.286 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64865.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64865.log.gz 2024-01-22T05:22:11.287 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74216.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74216.log.gz 2024-01-22T05:22:11.288 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28350.log 2024-01-22T05:22:11.289 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30827.log 2024-01-22T05:22:11.291 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.28350.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28350.log.gz 2024-01-22T05:22:11.292 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30827.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30827.log.gz 2024-01-22T05:22:11.292 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65678.log 2024-01-22T05:22:11.294 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74721.log 2024-01-22T05:22:11.296 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65678.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.65678.log.gz 2024-01-22T05:22:11.297 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74721.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74721.log.gz 2024-01-22T05:22:11.297 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67283.log 2024-01-22T05:22:11.299 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68018.log 2024-01-22T05:22:11.300 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67283.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67283.log.gz 2024-01-22T05:22:11.301 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68018.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68018.log.gz 2024-01-22T05:22:11.302 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79552.log 2024-01-22T05:22:11.303 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67493.log 2024-01-22T05:22:11.305 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79552.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79552.log.gz 2024-01-22T05:22:11.306 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67493.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67493.log.gz 2024-01-22T05:22:11.306 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70340.log 2024-01-22T05:22:11.308 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73509.log 2024-01-22T05:22:11.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70340.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70340.log.gz 2024-01-22T05:22:11.310 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73509.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73509.log.gz 2024-01-22T05:22:11.311 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26928.log 2024-01-22T05:22:11.312 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67202.log 2024-01-22T05:22:11.314 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.26928.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.26928.log.gz 2024-01-22T05:22:11.315 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67202.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67202.log.gz 2024-01-22T05:22:11.316 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76053.log 2024-01-22T05:22:11.317 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62341.log 2024-01-22T05:22:11.319 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76053.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.76053.log.gz 2024-01-22T05:22:11.320 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62341.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62341.log.gz 2024-01-22T05:22:11.320 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-22T05:22:11.322 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29658.log 2024-01-22T05:22:11.325 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.29658.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29658.log.gz 2024-01-22T05:22:11.325 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62652.log 2024-01-22T05:22:11.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62652.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62652.log.gz 2024-01-22T05:22:11.328 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45057.log 2024-01-22T05:22:11.331 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65325.log 2024-01-22T05:22:11.332 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45057.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.45057.log.gz 2024-01-22T05:22:11.334 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80510.log 2024-01-22T05:22:11.337 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65325.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65325.log.gz 2024-01-22T05:22:11.339 INFO:teuthology.orchestra.run.smithi049.stderr:gzip /var/log/ceph/ceph-client.admin.80510.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80510.log.gz 2024-01-22T05:22:11.339 INFO:teuthology.orchestra.run.smithi049.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.46359.log 2024-01-22T05:22:11.342 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46359.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46359.log.gz 2024-01-22T05:22:11.342 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46679.log 2024-01-22T05:22:11.345 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46679.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46679.log.gz 2024-01-22T05:22:11.345 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70550.log 2024-01-22T05:22:11.349 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70550.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70550.log.gz 2024-01-22T05:22:11.349 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30638.log 2024-01-22T05:22:11.350 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72205.log 2024-01-22T05:22:11.352 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.30638.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30638.log.gz 2024-01-22T05:22:11.354 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71679.log 2024-01-22T05:22:11.357 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72205.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72205.log.gz 2024-01-22T05:22:11.358 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71679.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71679.log.gz 2024-01-22T05:22:11.447 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-22T05:22:13.658 INFO:teuthology.orchestra.run.smithi049.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-01-22T05:22:15.311 INFO:teuthology.orchestra.run.smithi110.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-22T05:22:15.419 INFO:teuthology.orchestra.run.smithi110.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-22T05:22:16.031 INFO:teuthology.orchestra.run.smithi110.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-22T05:22:17.029 INFO:teuthology.orchestra.run.smithi049.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-22T05:22:17.032 INFO:teuthology.orchestra.run.smithi049.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-22T05:22:17.242 INFO:teuthology.orchestra.run.smithi049.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-22T05:22:17.274 INFO:teuthology.orchestra.run.smithi110.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-22T05:22:18.090 INFO:teuthology.orchestra.run.smithi049.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-22T05:22:30.561 INFO:teuthology.orchestra.run.smithi110.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-01-22T05:22:30.565 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-01-22T05:22:30.565 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m20.561s 2024-01-22T05:22:30.565 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m42.252s 2024-01-22T05:22:30.565 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m3.146s 2024-01-22T05:22:36.777 INFO:teuthology.orchestra.run.smithi049.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-01-22T05:22:36.781 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-22T05:22:36.782 INFO:teuthology.orchestra.run.smithi049.stderr:real 0m26.813s 2024-01-22T05:22:36.782 INFO:teuthology.orchestra.run.smithi049.stderr:user 0m53.549s 2024-01-22T05:22:36.782 INFO:teuthology.orchestra.run.smithi049.stderr:sys 0m5.981s 2024-01-22T05:22:36.783 INFO:tasks.ceph:Archiving logs... 2024-01-22T05:22:36.783 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560/remote/smithi049/log 2024-01-22T05:22:36.784 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-22T05:22:44.452 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560/remote/smithi110/log 2024-01-22T05:22:44.453 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-22T05:22:50.507 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-22T05:22:50.517 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-22T05:22:50.517 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-22T05:22:50.523 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-22T05:22:50.621 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-22T05:22:50.631 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-22T05:22:50.631 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-22T05:22:50.637 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-22T05:22:50.673 INFO:teuthology.orchestra.run.smithi049.stdout: remote refid st t when poll reach delay offset jitter 2024-01-22T05:22:50.673 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================== 2024-01-22T05:22:50.673 INFO:teuthology.orchestra.run.smithi049.stdout:*hv01.front.sepi 44.4.53.2 2 u 20 64 377 0.105 -3.168 0.578 2024-01-22T05:22:50.674 INFO:teuthology.orchestra.run.smithi049.stdout:+hv02.front.sepi 63.231.80.2 3 u 19 64 377 0.090 -1.736 0.619 2024-01-22T05:22:50.674 INFO:teuthology.orchestra.run.smithi049.stdout:+hv03.front.sepi 74.6.168.72 3 u 15 64 377 0.113 -2.711 0.612 2024-01-22T05:22:50.674 INFO:teuthology.orchestra.run.smithi049.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2024-01-22T05:22:50.678 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2024-01-22T05:22:50.678 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2024-01-22T05:22:50.678 INFO:teuthology.orchestra.run.smithi110.stdout:*hv01.front.sepi 44.4.53.2 2 u 27 64 377 0.087 1.767 0.196 2024-01-22T05:22:50.678 INFO:teuthology.orchestra.run.smithi110.stdout:+hv02.front.sepi 63.231.80.2 3 u 26 64 377 0.124 4.367 0.339 2024-01-22T05:22:50.678 INFO:teuthology.orchestra.run.smithi110.stdout:+hv03.front.sepi 74.6.168.72 3 u 28 64 377 0.097 2.506 0.468 2024-01-22T05:22:50.678 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2024-01-22T05:22:50.680 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-22T05:22:50.690 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-22T05:22:50.690 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-22T05:22:50.699 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-22T05:22:50.708 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-22T05:22:50.716 INFO:teuthology.task.internal:Duration was 1755.335514 seconds 2024-01-22T05:22:50.717 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-22T05:22:50.725 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-22T05:22:50.725 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-22T05:22:50.731 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-22T05:22:50.893 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-22T05:22:50.893 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2024-01-22T05:22:50.893 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-22T05:22:50.924 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-01-22T05:22:50.924 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-22T05:22:50.959 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-22T05:22:50.960 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-22T05:22:50.973 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-22T05:22:51.068 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-22T05:22:51.069 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-22T05:22:51.075 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-22T05:22:51.186 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-22T05:22:51.196 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-22T05:22:51.196 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-22T05:22:51.232 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-22T05:22:51.266 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-22T05:22:51.277 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-22T05:22:51.283 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-22T05:22:51.312 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2024-01-22T05:22:51.347 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-01-22T05:22:51.386 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-22T05:22:51.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:22:51.411 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-22T05:22:51.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:22:51.445 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-22T05:22:51.455 INFO:teuthology.task.internal:Transferring archived files... 2024-01-22T05:22:51.456 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560/remote/smithi049 2024-01-22T05:22:51.456 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-22T05:22:51.501 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560/remote/smithi110 2024-01-22T05:22:51.501 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-22T05:22:51.548 INFO:teuthology.task.internal:Removing archive directory... 2024-01-22T05:22:51.548 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-22T05:22:51.553 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-22T05:22:51.608 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-22T05:22:51.619 INFO:teuthology.task.internal:Not uploading archives. 2024-01-22T05:22:51.619 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-22T05:22:51.691 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-22T05:22:51.691 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-22T05:22:51.697 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-22T05:22:51.714 INFO:teuthology.orchestra.run.smithi049.stdout: 1048609 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 22 05:22 /home/ubuntu/cephtest 2024-01-22T05:22:51.716 INFO:teuthology.orchestra.run.smithi110.stdout: 1048603 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 22 05:22 /home/ubuntu/cephtest 2024-01-22T05:22:51.721 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-22T05:22:51.732 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-22T05:22:51.754 INFO:teuthology.nuke:Checking targets against current locks 2024-01-22T05:22:51.781 DEBUG:teuthology.nuke:shortname: smithi049 2024-01-22T05:22:51.781 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-22T05:22:51.806 DEBUG:teuthology.nuke:shortname: smithi110 2024-01-22T05:22:51.806 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-22T05:22:51.810 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 04:40:54.227718', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2024-01-22T05:22:51.830 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523560', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 04:40:54.226256', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2024-01-22T05:22:51.860 INFO:teuthology.orchestra.console.smithi049:Power off 2024-01-22T05:22:51.860 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-22T05:22:51.884 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2024-01-22T05:22:51.884 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T05:22:51.899 INFO:teuthology.orchestra.console.smithi110:Power off 2024-01-22T05:22:51.899 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-22T05:22:51.911 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-01-22T05:22:51.923 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2024-01-22T05:22:51.923 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T05:22:51.948 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-01-22T05:22:55.912 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T05:22:55.949 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T05:22:56.096 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-01-22T05:22:56.197 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-01-22T05:23:00.100 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T05:23:00.197 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T05:23:00.210 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-01-22T05:23:00.308 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-01-22T05:23:00.409 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-01-22T05:23:04.212 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T05:23:04.322 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-01-22T05:23:04.423 INFO:teuthology.orchestra.console.smithi049:Power off completed 2024-01-22T05:23:04.528 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 06652275eb934672217aaf9d4180f4a90395eb16 client.1-kernel-sha1: 06652275eb934672217aaf9d4180f4a90395eb16 description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} duration: 1755.335513830185 failure_reason: '"2024-01-22T05:14:30.395561+0000 mon.a (mon.0) 995 : cluster [WRN] Health check failed: Degraded data redundancy: 18/2092 objects degraded (0.860%), 1 pg degraded (PG_DEGRADED)" in cluster log' flavor: default owner: scheduled_vshankar@teuthology success: false 2024-01-22T05:23:04.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T05:23:04.610 INFO:teuthology.run:FAIL